Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.000000] Linux version 5.15.0-78-generic (buildd@lcy02-amd64-008) (gcc (Ubuntu 11.3.0-1ubuntu1~22.04.1) 11.3.0, GNU ld (GNU Binutils for Ubuntu) 2.38) #85-Ubuntu SMP Fri Jul 7 15:25:09 UTC 2023 (Ubuntu 5.15.0-78.85-generic 5.15.99) Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.000000] Command line: BOOT_IMAGE=/boot/vmlinuz-5.15.0-78-generic root=LABEL=cloudimg-rootfs ro console=tty1 console=ttyS0 Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.000000] KERNEL supported cpus: Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.000000] Intel GenuineIntel Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.000000] AMD AuthenticAMD Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.000000] Hygon HygonGenuine Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.000000] Centaur CentaurHauls Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.000000] zhaoxin Shanghai Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.000000] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.000000] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.000000] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.000000] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.000000] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'compacted' format. Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.000000] signal: max sigframe size: 1776 Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.000000] BIOS-provided physical RAM map: Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000bffdafff] usable Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.000000] BIOS-e820: [mem 0x00000000bffdb000-0x00000000bfffffff] reserved Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x0000000b3fffffff] usable Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.000000] NX (Execute Disable) protection: active Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.000000] SMBIOS 2.8 present. Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.000000] DMI: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.000000] Hypervisor detected: KVM Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.000000] kvm-clock: cpu 0, msr 1f4401001, primary cpu clock Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.000001] kvm-clock: using sched offset of 1195309367 cycles Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.000003] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.000007] tsc: Detected 2500.000 MHz processor Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.001104] e820: update [mem 0x00000000-0x00000fff] usable ==> reserved Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.001108] e820: remove [mem 0x000a0000-0x000fffff] usable Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.001113] last_pfn = 0xb40000 max_arch_pfn = 0x400000000 Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.001161] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.001172] last_pfn = 0xbffdb max_arch_pfn = 0x400000000 Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.004087] found SMP MP-table at [mem 0x000f5c50-0x000f5c5f] Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.004109] Using GB pages for direct mapping Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.004217] RAMDISK: [mem 0x3424b000-0x3611cfff] Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.004224] ACPI: Early table checksum verification disabled Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.004229] ACPI: RSDP 0x00000000000F5C10 000014 (v00 BOCHS ) Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.004234] ACPI: RSDT 0x00000000BFFE12DF 00002C (v01 BOCHS BXPCRSDT 00000001 BXPC 00000001) Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.004240] ACPI: FACP 0x00000000BFFE11EB 000074 (v01 BOCHS BXPCFACP 00000001 BXPC 00000001) Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.004246] ACPI: DSDT 0x00000000BFFDFDC0 00142B (v01 BOCHS BXPCDSDT 00000001 BXPC 00000001) Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.004250] ACPI: FACS 0x00000000BFFDFD80 000040 Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.004253] ACPI: APIC 0x00000000BFFE125F 000080 (v01 BOCHS BXPCAPIC 00000001 BXPC 00000001) Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.004256] ACPI: Reserving FACP table memory at [mem 0xbffe11eb-0xbffe125e] Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.004259] ACPI: Reserving DSDT table memory at [mem 0xbffdfdc0-0xbffe11ea] Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.004260] ACPI: Reserving FACS table memory at [mem 0xbffdfd80-0xbffdfdbf] Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.004261] ACPI: Reserving APIC table memory at [mem 0xbffe125f-0xbffe12de] Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.004633] No NUMA configuration found Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.004635] Faking a node at [mem 0x0000000000000000-0x0000000b3fffffff] Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.004644] NODE_DATA(0) allocated [mem 0xb3ffd6000-0xb3fffffff] Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.005198] Zone ranges: Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.005199] DMA [mem 0x0000000000001000-0x0000000000ffffff] Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.005202] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.005204] Normal [mem 0x0000000100000000-0x0000000b3fffffff] Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.005207] Device empty Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.005208] Movable zone start for each node Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.005212] Early memory node ranges Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.005213] node 0: [mem 0x0000000000001000-0x000000000009efff] Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.005215] node 0: [mem 0x0000000000100000-0x00000000bffdafff] Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.005217] node 0: [mem 0x0000000100000000-0x0000000b3fffffff] Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.005225] Initmem setup node 0 [mem 0x0000000000001000-0x0000000b3fffffff] Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.008737] On node 0, zone DMA: 1 pages in unavailable ranges Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.008767] On node 0, zone DMA: 97 pages in unavailable ranges Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.147245] On node 0, zone Normal: 37 pages in unavailable ranges Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.147562] ACPI: PM-Timer IO Port: 0x608 Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.147578] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.147607] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.147610] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.147612] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.147614] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.147616] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.147617] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.147621] ACPI: Using ACPI (MADT) for SMP configuration information Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.147626] smpboot: Allowing 2 CPUs, 0 hotplug CPUs Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.147652] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.147654] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x0009ffff] Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.147656] PM: hibernation: Registered nosave memory: [mem 0x000a0000-0x000effff] Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.147657] PM: hibernation: Registered nosave memory: [mem 0x000f0000-0x000fffff] Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.147659] PM: hibernation: Registered nosave memory: [mem 0xbffdb000-0xbfffffff] Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.147660] PM: hibernation: Registered nosave memory: [mem 0xc0000000-0xfeffbfff] Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.147661] PM: hibernation: Registered nosave memory: [mem 0xfeffc000-0xfeffffff] Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.147663] PM: hibernation: Registered nosave memory: [mem 0xff000000-0xfffbffff] Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.147664] PM: hibernation: Registered nosave memory: [mem 0xfffc0000-0xffffffff] Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.147666] [mem 0xc0000000-0xfeffbfff] available for PCI devices Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.147668] Booting paravirtualized kernel on KVM Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.147671] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645519600211568 ns Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.147742] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:2 nr_cpu_ids:2 nr_node_ids:1 Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.148035] percpu: Embedded 60 pages/cpu s208896 r8192 d28672 u1048576 Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.148042] pcpu-alloc: s208896 r8192 d28672 u1048576 alloc=1*2097152 Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.148044] pcpu-alloc: [0] 0 1 Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.148065] kvm-guest: stealtime: cpu 0, msr b13c32080 Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.148068] kvm-guest: PV spinlocks disabled, no host support Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.148074] Built 1 zonelists, mobility grouping on. Total pages: 11353819 Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.148076] Policy zone: Normal Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.148077] Kernel command line: BOOT_IMAGE=/boot/vmlinuz-5.15.0-78-generic root=LABEL=cloudimg-rootfs ro console=tty1 console=ttyS0 Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.148143] Unknown kernel command line parameters "BOOT_IMAGE=/boot/vmlinuz-5.15.0-78-generic", will be passed to user space. Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.154788] Dentry cache hash table entries: 8388608 (order: 14, 67108864 bytes, linear) Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.158059] Inode-cache hash table entries: 4194304 (order: 13, 33554432 bytes, linear) Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.158097] mem auto-init: stack:off, heap alloc:on, heap free:off Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.241967] Memory: 45160720K/46136804K available (16393K kernel code, 4383K rwdata, 10844K rodata, 3248K init, 18832K bss, 975824K reserved, 0K cma-reserved) Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.242707] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=2, Nodes=1 Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.242737] ftrace: allocating 50600 entries in 198 pages Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.267687] ftrace: allocated 198 pages with 4 groups Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.268006] rcu: Hierarchical RCU implementation. Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.268008] rcu: RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=2. Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.268010] Rude variant of Tasks RCU enabled. Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.268010] Tracing variant of Tasks RCU enabled. Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.268012] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies. Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.268013] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=2 Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.272175] NR_IRQS: 524544, nr_irqs: 440, preallocated irqs: 16 Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.272369] random: crng init done Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.278907] Console: colour VGA+ 80x25 Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.301534] printk: console [tty1] enabled Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.347241] printk: console [ttyS0] enabled Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.347715] ACPI: Core revision 20210730 Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.348181] APIC: Switch to symmetric I/O mode setup Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.348793] x2apic enabled Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.349219] Switched APIC routing to physical x2apic. Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.350399] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.350948] tsc: Marking TSC unstable due to TSCs unsynchronized Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.351472] Calibrating delay loop (skipped) preset value.. 5000.00 BogoMIPS (lpj=10000000) Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.355473] pid_max: default: 32768 minimum: 301 Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.355952] LSM: Security Framework initializing Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.356393] landlock: Up and running. Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.356757] Yama: becoming mindful. Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.357328] AppArmor: AppArmor initialized Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.357794] Mount-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.358719] Mountpoint-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.359740] x86/cpu: User Mode Instruction Prevention (UMIP) activated Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.360414] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127 Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.361921] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0 Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.362480] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.363229] Spectre V2 : Mitigation: Retpolines Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.363470] Spectre V2 : Spectre v2 / SpectreRSB mitigation: Filling RSB on context switch Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.364216] Spectre V2 : Spectre v2 / SpectreRSB : Filling RSB on VMEXIT Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.364783] Spectre V2 : Enabling Speculation Barrier for firmware calls Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.365370] RETBleed: Mitigation: untrained return thunk Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.365851] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.366609] Speculative Store Bypass: Vulnerable Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.378348] Freeing SMP alternatives memory: 44K Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.487012] smpboot: CPU0: AMD EPYC-Rome Processor (family: 0x17, model: 0x31, stepping: 0x0) Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.487467] Performance Events: Fam17h+ core perfctr, AMD PMU driver. Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.487467] ... version: 0 Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.487467] ... bit width: 48 Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.487467] ... generic registers: 6 Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.487467] ... value mask: 0000ffffffffffff Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.487471] ... max period: 00007fffffffffff Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.488327] ... fixed-purpose events: 0 Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.489029] ... event mask: 000000000000003f Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.490075] rcu: Hierarchical SRCU implementation. Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.491822] smp: Bringing up secondary CPUs ... Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.492820] x86: Booting SMP configuration: Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.493422] .... node #0, CPUs: #1 Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.079118] kvm-clock: cpu 1, msr 1f4401041, secondary cpu clock Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.079118] smpboot: CPU 1 Converting physical 4 to logical die 1 Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.494945] kvm-guest: stealtime: cpu 1, msr b13d32080 Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.495500] smp: Brought up 1 node, 2 CPUs Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.496098] smpboot: Max logical packages: 2 Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.496807] smpboot: Total of 2 processors activated (10000.00 BogoMIPS) Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.501341] devtmpfs: initialized Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.501341] x86/mm: Memory block size: 128MB Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.504996] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.505525] futex hash table entries: 512 (order: 3, 32768 bytes, linear) Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.507572] pinctrl core: initialized pinctrl subsystem Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.509444] PM: RTC time: 05:20:47, date: 2023-08-22 Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.510112] NET: Registered PF_NETLINK/PF_ROUTE protocol family Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.511209] DMA: preallocated 4096 KiB GFP_KERNEL pool for atomic allocations Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.511729] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.519714] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.520575] audit: initializing netlink subsys (disabled) Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.521166] audit: type=2000 audit(1692681647.707:1): state=initialized audit_enabled=0 res=1 Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.521166] thermal_sys: Registered thermal governor 'fair_share' Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.521166] thermal_sys: Registered thermal governor 'bang_bang' Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.521166] thermal_sys: Registered thermal governor 'step_wise' Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.521445] thermal_sys: Registered thermal governor 'user_space' Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.523476] thermal_sys: Registered thermal governor 'power_allocator' Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.524030] EISA bus registered Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.524956] cpuidle: using governor ladder Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.525361] cpuidle: using governor menu Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.526086] ACPI: bus type PCI registered Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.526086] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.527596] PCI: Using configuration type 1 for base access Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.528095] PCI: Using configuration type 1 for extended access Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.530369] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.531227] HugeTLB registered 1.00 GiB page size, pre-allocated 0 pages Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.531479] HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.532115] ACPI: Added _OSI(Module Device) Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.535472] ACPI: Added _OSI(Processor Device) Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.535889] ACPI: Added _OSI(3.0 _SCP Extensions) Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.536333] ACPI: Added _OSI(Processor Aggregator Device) Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.536814] ACPI: Added _OSI(Linux-Dell-Video) Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.537227] ACPI: Added _OSI(Linux-Lenovo-NV-HDMI-Audio) Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.537702] ACPI: Added _OSI(Linux-HPI-Hybrid-Graphics) Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.539021] ACPI: 1 ACPI AML tables successfully acquired and loaded Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.540583] ACPI: Interpreter enabled Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.540977] ACPI: PM: (supports S0 S3 S4 S5) Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.541385] ACPI: Using IOAPIC for interrupt routing Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.541855] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.543482] PCI: Using E820 reservations for host bridge windows Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.544104] ACPI: Enabled 2 GPEs in block 00 to 0F Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.546928] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.547529] acpi PNP0A03:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.549435] acpiphp: Slot [3] registered Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.550148] acpiphp: Slot [4] registered Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.550863] acpiphp: Slot [5] registered Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.551493] acpiphp: Slot [6] registered Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.551906] acpiphp: Slot [7] registered Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.552303] acpiphp: Slot [8] registered Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.552701] acpiphp: Slot [9] registered Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.553089] acpiphp: Slot [10] registered Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.553484] acpiphp: Slot [11] registered Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.553883] acpiphp: Slot [12] registered Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.554282] acpiphp: Slot [13] registered Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.554678] acpiphp: Slot [14] registered Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.555482] acpiphp: Slot [15] registered Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.555880] acpiphp: Slot [16] registered Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.556290] acpiphp: Slot [17] registered Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.556684] acpiphp: Slot [18] registered Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.557138] acpiphp: Slot [19] registered Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.557539] acpiphp: Slot [20] registered Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.557932] acpiphp: Slot [21] registered Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.558330] acpiphp: Slot [22] registered Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.558724] acpiphp: Slot [23] registered Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.559123] acpiphp: Slot [24] registered Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.559486] acpiphp: Slot [25] registered Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.559882] acpiphp: Slot [26] registered Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.560293] acpiphp: Slot [27] registered Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.560688] acpiphp: Slot [28] registered Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.561083] acpiphp: Slot [29] registered Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.561479] acpiphp: Slot [30] registered Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.561877] acpiphp: Slot [31] registered Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.562274] PCI host bridge to bus 0000:00 Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.562665] pci_bus 0000:00: root bus resource [bus 00-ff] Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.563166] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.563472] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.564063] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.564737] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.565412] pci_bus 0000:00: root bus resource [mem 0xb40000000-0xbbfffffff window] Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.566282] pci 0000:00:00.0: [8086:1237] type 00 class 0x060000 Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.567924] pci 0000:00:01.0: [8086:7000] type 00 class 0x060100 Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.568833] pci 0000:00:01.1: [8086:7010] type 00 class 0x010180 Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.572128] pci 0000:00:01.1: reg 0x20: [io 0xc180-0xc18f] Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.573418] pci 0000:00:01.1: legacy IDE quirk: reg 0x10: [io 0x01f0-0x01f7] Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.574038] pci 0000:00:01.1: legacy IDE quirk: reg 0x14: [io 0x03f6] Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.574599] pci 0000:00:01.1: legacy IDE quirk: reg 0x18: [io 0x0170-0x0177] Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.575210] pci 0000:00:01.1: legacy IDE quirk: reg 0x1c: [io 0x0376] Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.575739] pci 0000:00:01.2: [8086:7020] type 00 class 0x0c0300 Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.578065] pci 0000:00:01.2: reg 0x20: [io 0xc100-0xc11f] Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.579906] pci 0000:00:01.3: [8086:7113] type 00 class 0x068000 Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.580730] pci 0000:00:01.3: quirk: [io 0x0600-0x063f] claimed by PIIX4 ACPI Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.582031] pci 0000:00:01.3: quirk: [io 0x0700-0x070f] claimed by PIIX4 SMB Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.583050] pci 0000:00:02.0: [1b36:0100] type 00 class 0x030000 Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.585782] pci 0000:00:02.0: reg 0x10: [mem 0xf4000000-0xf7ffffff] Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.587478] pci 0000:00:02.0: reg 0x14: [mem 0xf8000000-0xfbffffff] Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.589449] pci 0000:00:02.0: reg 0x18: [mem 0xfc090000-0xfc091fff] Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.591478] pci 0000:00:02.0: reg 0x1c: [io 0xc120-0xc13f] Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.597610] pci 0000:00:02.0: reg 0x30: [mem 0xfc080000-0xfc08ffff pref] Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.598805] pci 0000:00:02.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.600222] pci 0000:00:03.0: [1af4:1000] type 00 class 0x020000 Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.605028] pci 0000:00:03.0: reg 0x10: [io 0xc080-0xc0bf] Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.607472] pci 0000:00:03.0: reg 0x14: [mem 0xfc092000-0xfc092fff] Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.612309] pci 0000:00:03.0: reg 0x20: [mem 0xfebec000-0xfebeffff 64bit pref] Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.614972] pci 0000:00:03.0: reg 0x30: [mem 0xfc000000-0xfc07ffff pref] Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.616229] pci 0000:00:04.0: [1af4:1003] type 00 class 0x078000 Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.617614] pci 0000:00:04.0: reg 0x10: [io 0xc0c0-0xc0ff] Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.618824] pci 0000:00:04.0: reg 0x14: [mem 0xfc093000-0xfc093fff] Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.621472] pci 0000:00:04.0: reg 0x20: [mem 0xfebf0000-0xfebf3fff 64bit pref] Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.623995] pci 0000:00:05.0: [1af4:1001] type 00 class 0x010000 Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.625671] pci 0000:00:05.0: reg 0x10: [io 0xc000-0xc07f] Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.627850] pci 0000:00:05.0: reg 0x14: [mem 0xfc094000-0xfc094fff] Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.630593] pci 0000:00:05.0: reg 0x20: [mem 0xfebf4000-0xfebf7fff 64bit pref] Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.633013] pci 0000:00:06.0: [1af4:1002] type 00 class 0x00ff00 Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.634066] pci 0000:00:06.0: reg 0x10: [io 0xc140-0xc15f] Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.638246] pci 0000:00:06.0: reg 0x20: [mem 0xfebf8000-0xfebfbfff 64bit pref] Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.640108] pci 0000:00:07.0: [1af4:1005] type 00 class 0x00ff00 Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.641180] pci 0000:00:07.0: reg 0x10: [io 0xc160-0xc17f] Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.643480] pci 0000:00:07.0: reg 0x20: [mem 0xfebfc000-0xfebfffff 64bit pref] Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.649942] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.650636] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.651243] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.651571] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.652167] ACPI: PCI: Interrupt link LNKS configured for IRQ 9 Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.652999] iommu: Default domain type: Translated Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.652999] iommu: DMA domain TLB invalidation policy: lazy mode Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.652999] SCSI subsystem initialized Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.653073] libata version 3.00 loaded. Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.653073] pci 0000:00:02.0: vgaarb: setting as boot VGA device Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.653073] pci 0000:00:02.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.655476] pci 0000:00:02.0: vgaarb: bridge control possible Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.656018] vgaarb: loaded Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.656505] ACPI: bus type USB registered Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.656900] usbcore: registered new interface driver usbfs Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.657393] usbcore: registered new interface driver hub Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.657914] usbcore: registered new device driver usb Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.659502] pps_core: LinuxPPS API ver. 1 registered Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.659999] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.660890] PTP clock support registered Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.662462] EDAC MC: Ver: 3.0.0 Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.662462] NetLabel: Initializing Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.663480] NetLabel: domain hash size = 128 Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.663893] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.664427] NetLabel: unlabeled traffic allowed by default Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.664941] PCI: Using ACPI for IRQ routing Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.664941] PCI: pci_cache_line_size set to 64 bytes Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.664941] e820: reserve RAM buffer [mem 0x0009fc00-0x0009ffff] Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.664941] e820: reserve RAM buffer [mem 0xbffdb000-0xbfffffff] Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.664941] clocksource: Switched to clocksource kvm-clock Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.679155] VFS: Disk quotas dquot_6.6.0 Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.679648] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.680387] AppArmor: AppArmor Filesystem Enabled Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.680856] pnp: PnP ACPI init Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.681316] pnp 00:03: [dma 2] Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.681562] pnp: PnP ACPI: found 5 devices Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.689297] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.690219] NET: Registered PF_INET protocol family Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.690964] IP idents hash table entries: 262144 (order: 9, 2097152 bytes, linear) Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.693746] tcp_listen_portaddr_hash hash table entries: 32768 (order: 7, 524288 bytes, linear) Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.694980] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.696196] TCP established hash table entries: 524288 (order: 10, 4194304 bytes, linear) Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.698256] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes, linear) Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.699250] TCP: Hash tables configured (established 524288 bind 65536) Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.700186] MPTCP token hash table entries: 65536 (order: 8, 1572864 bytes, linear) Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.702403] UDP hash table entries: 32768 (order: 8, 1048576 bytes, linear) Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.703522] UDP-Lite hash table entries: 32768 (order: 8, 1048576 bytes, linear) Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.704721] NET: Registered PF_UNIX/PF_LOCAL protocol family Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.705240] NET: Registered PF_XDP protocol family Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.705707] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.706262] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.706814] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.707399] pci_bus 0000:00: resource 7 [mem 0xc0000000-0xfebfffff window] Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.708026] pci_bus 0000:00: resource 8 [mem 0xb40000000-0xbbfffffff window] Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.708678] pci 0000:00:01.0: PIIX3: Enabling Passive Release Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.709209] pci 0000:00:00.0: Limiting direct PCI/PCI transfers Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.709735] pci 0000:00:01.0: Activating ISA DMA hang workarounds Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.730304] ACPI: \_SB_.LNKD: Enabled at IRQ 11 Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.750842] pci 0000:00:01.2: quirk_usb_early_handoff+0x0/0x160 took 39586 usecs Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.751694] PCI: CLS 0 bytes, default 64 Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.752170] Trying to unpack rootfs image as initramfs... Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.759565] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.760395] software IO TLB: mapped [mem 0x00000000bbfdb000-0x00000000bffdb000] (64MB) Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.768094] Initialise system trusted keyrings Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.768594] Key type blacklist registered Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.769054] workingset: timestamp_bits=36 max_order=24 bucket_order=0 Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.770596] zbud: loaded Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.771107] squashfs: version 4.0 (2009/01/31) Phillip Lougher Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.775768] fuse: init (API version 7.34) Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.776629] integrity: Platform Keyring initialized Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.787557] Key type asymmetric registered Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.788023] Asymmetric key parser 'x509' registered Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.788525] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 243) Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.789275] io scheduler mq-deadline registered Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.790155] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.790897] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0 Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.791653] ACPI: button: Power Button [PWRF] Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.815783] ACPI: \_SB_.LNKC: Enabled at IRQ 10 Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.858044] ACPI: \_SB_.LNKA: Enabled at IRQ 10 Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.879357] ACPI: \_SB_.LNKB: Enabled at IRQ 11 Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.902397] Serial: 8250/16550 driver, 32 ports, IRQ sharing enabled Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.927093] 00:04: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.937018] Linux agpgart interface v0.103 Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.938936] loop: module loaded Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.939414] ata_piix 0000:00:01.1: version 2.13 Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.940247] scsi host0: ata_piix Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.940856] scsi host1: ata_piix Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.941238] ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc180 irq 14 Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.941839] ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc188 irq 15 Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.942584] tun: Universal TUN/TAP device driver, 1.6 Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.943242] PPP generic driver version 2.4.2 Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.943712] VFIO - User Level meta-driver version: 0.3 Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.944260] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.944838] ehci-pci: EHCI PCI platform driver Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.945269] ehci-platform: EHCI generic platform driver Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.945856] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.946424] ohci-pci: OHCI PCI platform driver Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.946852] ohci-platform: OHCI generic platform driver Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.947334] uhci_hcd: USB Universal Host Controller Interface driver Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.968418] uhci_hcd 0000:00:01.2: UHCI Host Controller Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.968955] uhci_hcd 0000:00:01.2: new USB bus registered, assigned bus number 1 Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.969662] uhci_hcd 0000:00:01.2: detected 2 ports Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.970207] uhci_hcd 0000:00:01.2: irq 11, io base 0x0000c100 Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.970977] usb usb1: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 5.15 Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.971997] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.972802] usb usb1: Product: UHCI Host Controller Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.973373] usb usb1: Manufacturer: Linux 5.15.0-78-generic uhci_hcd Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.974062] usb usb1: SerialNumber: 0000:00:01.2 Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.974687] hub 1-0:1.0: USB hub found Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.975157] hub 1-0:1.0: 2 ports detected Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.975813] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.977458] serio: i8042 KBD port at 0x60,0x64 irq 1 Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.978048] serio: i8042 AUX port at 0x60,0x64 irq 12 Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.978720] mousedev: PS/2 mouse device common for all mice Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.979556] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input1 Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.980592] rtc_cmos 00:00: RTC can wake from S4 Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.981526] rtc_cmos 00:00: registered as rtc0 Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.982097] rtc_cmos 00:00: setting system clock to 2023-08-22T05:20:47 UTC (1692681647) Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.983049] rtc_cmos 00:00: alarms up to one day, y3k, 114 bytes nvram Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.983784] i2c_dev: i2c /dev entries driver Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.984294] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.984600] Freeing initrd memory: 31560K Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.985605] device-mapper: uevent: version 1.0.3 Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.986586] device-mapper: ioctl: 4.45.0-ioctl (2021-03-22) initialised: dm-devel@redhat.com Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.987368] platform eisa.0: Probing EISA bus 0 Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.987871] platform eisa.0: EISA: Cannot allocate resource for mainboard Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.988486] platform eisa.0: Cannot allocate resource for EISA slot 1 Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.989054] platform eisa.0: Cannot allocate resource for EISA slot 2 Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.989662] platform eisa.0: Cannot allocate resource for EISA slot 3 Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.990254] platform eisa.0: Cannot allocate resource for EISA slot 4 Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.990855] platform eisa.0: Cannot allocate resource for EISA slot 5 Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.991422] platform eisa.0: Cannot allocate resource for EISA slot 6 Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.992000] platform eisa.0: Cannot allocate resource for EISA slot 7 Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.992592] platform eisa.0: Cannot allocate resource for EISA slot 8 Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.993161] platform eisa.0: EISA: Detected 0 cards Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.993688] ledtrig-cpu: registered to indicate activity on CPUs Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.994348] drop_monitor: Initializing network drop monitor service Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 0.995065] NET: Registered PF_INET6 protocol family Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 1.000150] Segment Routing with IPv6 Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 1.000568] In-situ OAM (IOAM) with IPv6 Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 1.000975] NET: Registered PF_PACKET protocol family Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 1.001503] Key type dns_resolver registered Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 1.002192] IPI shorthand broadcast: enabled Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 1.002640] sched_clock: Marking stable (926990710, 75118400)->(1004828590, -2719480) Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 1.003501] registered taskstats version 1 Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 1.003986] Loading compiled-in X.509 certificates Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 1.004996] Loaded X.509 cert 'Build time autogenerated kernel key: 9d82e5e7ad5edec3b7fd52847c6ba9a5bea7ed9c' Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 1.006353] Loaded X.509 cert 'Canonical Ltd. Live Patch Signing: 14df34d1a87cf37625abec039ef2bf521249b969' Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 1.007682] Loaded X.509 cert 'Canonical Ltd. Kernel Module Signing: 88f752e560a1e0737e31163a466ad7b70a850c19' Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 1.008573] blacklist: Loading compiled-in revocation X.509 certificates Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 1.009196] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing: 61482aa2830d0ab2ad5af10b7250da9033ddcef0' Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 1.010094] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2017): 242ade75ac4a15e50d50c84b0d45ff3eae707a03' Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 1.011047] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (ESM 2018): 365188c1d374d6b07c3c8f240f8ef722433d6a8b' Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 1.012029] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2019): c0746fd6c5da3ae827864651ad66ae47fe24b3e8' Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 1.012993] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2021 v1): a8d54bbb3825cfb94fa13c9f8a594a195c107b8d' Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 1.013953] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2021 v2): 4cf046892d6fd3c9a5b03f98d845f90851dc6a8c' Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 1.014921] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2021 v3): 100437bb6de6e469b581e61cd66bce3ef4ed53af' Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 1.015933] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (Ubuntu Core 2019): c1d57b8f6b743f23ee41f4f7ee292f06eecadfb9' Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 1.017173] zswap: loaded using pool lzo/zbud Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 1.017808] Key type .fscrypt registered Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 1.018221] Key type fscrypt-provisioning registered Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 1.020795] Key type encrypted registered Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 1.021229] AppArmor: AppArmor sha1 policy hashing enabled Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 1.021738] ima: No TPM chip found, activating TPM-bypass! Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 1.022305] Loading compiled-in module X.509 certificates Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 1.023242] Loaded X.509 cert 'Build time autogenerated kernel key: 9d82e5e7ad5edec3b7fd52847c6ba9a5bea7ed9c' Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 1.024150] ima: Allocated hash algorithm: sha1 Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 1.024585] ima: No architecture policies found Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 1.025026] evm: Initialising EVM extended attributes: Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 1.025498] evm: security.selinux Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 1.025840] evm: security.SMACK64 Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 1.026209] evm: security.SMACK64EXEC Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 1.026623] evm: security.SMACK64TRANSMUTE Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 1.027023] evm: security.SMACK64MMAP Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 1.027386] evm: security.apparmor Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 1.027749] evm: security.ima Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 1.028083] evm: security.capability Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 1.028440] evm: HMAC attrs: 0x1 Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 1.030047] PM: Magic number: 3:465:315 Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 1.030499] tty tty40: hash matches Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 1.031159] RAS: Correctable Errors collector initialized. Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 1.108845] Freeing unused decrypted memory: 2036K Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 1.109907] Freeing unused kernel image (initmem) memory: 3248K Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 1.110552] Write protecting the kernel read-only data: 30720k Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 1.111532] Freeing unused kernel image (text/rodata gap) memory: 2036K Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 1.112390] Freeing unused kernel image (rodata/data gap) memory: 1444K Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 1.163053] x86/mm: Checked W+X mappings: passed, no W+X pages found. Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 1.163701] Run /init as init process Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 1.164076] with arguments: Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 1.164077] /init Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 1.164078] with environment: Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 1.164079] HOME=/ Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 1.164080] TERM=linux Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 1.164080] BOOT_IMAGE=/boot/vmlinuz-5.15.0-78-generic Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 1.288193] virtio_blk virtio2: [vda] 41943040 512-byte logical blocks (21.5 GB/20.0 GiB) Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 1.293963] GPT:Primary header thinks Alt. header is not at the end of the disk. Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 1.294881] GPT:4612095 != 41943039 Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 1.295311] GPT:Alternate GPT header not at the end of the disk. Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 1.295991] GPT:4612095 != 41943039 Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 1.296424] GPT: Use GNU Parted to correct GPT errors. Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 1.297057] vda: vda1 vda14 vda15 Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 1.297557] cryptd: max_cpu_qlen set to 1000 Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 1.303052] AVX2 version of gcm_enc/dec engaged. Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 1.303808] AES CTR mode by8 optimization enabled Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 1.305506] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input4 Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 1.306560] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input3 Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 1.331945] FDC 0 is a S82078B Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 1.336451] virtio_net virtio0 ens3: renamed from eth0 Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 2.603483] raid6: avx2x4 gen() 25337 MB/s Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 2.671477] raid6: avx2x4 xor() 5042 MB/s Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 2.739477] raid6: avx2x2 gen() 27056 MB/s Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 2.807477] raid6: avx2x2 xor() 19246 MB/s Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 2.875477] raid6: avx2x1 gen() 23516 MB/s Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 2.943476] raid6: avx2x1 xor() 14659 MB/s Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 3.011476] raid6: sse2x4 gen() 14296 MB/s Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 3.079475] raid6: sse2x4 xor() 7220 MB/s Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 3.147478] raid6: sse2x2 gen() 14880 MB/s Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 3.215482] raid6: sse2x2 xor() 9890 MB/s Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 3.283477] raid6: sse2x1 gen() 11902 MB/s Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 3.351475] raid6: sse2x1 xor() 7470 MB/s Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 3.351926] raid6: using algorithm avx2x2 gen() 27056 MB/s Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 3.352429] raid6: .... xor() 19246 MB/s, rmw enabled Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 3.352914] raid6: using avx2x2 recovery algorithm Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 3.356615] xor: automatically using best checksumming function avx Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 3.358107] async_tx: api initialized (async) Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 3.420080] Btrfs loaded, crc32c=crc32c-intel, zoned=yes, fsverity=yes Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 3.443732] EXT4-fs (vda1): mounted filesystem with ordered data mode. Opts: (null). Quota mode: none. Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 3.878068] EXT4-fs (vda1): re-mounted. Opts: discard,errors=remount-ro. Quota mode: none. Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 3.902493] alua: device handler registered Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 3.904812] emc: device handler registered Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 3.905881] rdac: device handler registered Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 3.976867] loop0: detected capacity change from 0 to 129944 Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 3.980189] loop1: detected capacity change from 0 to 229272 Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 3.985639] loop2: detected capacity change from 0 to 109072 Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 4.231086] kvm: Nested Virtualization enabled Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 4.231090] SVM: kvm: Nested Paging enabled Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 4.388422] audit: type=1400 audit(1692681650.904:2): apparmor="STATUS" operation="profile_load" profile="unconfined" name="nvidia_modprobe" pid=461 comm="apparmor_parser" Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 4.406312] audit: type=1400 audit(1692681650.920:3): apparmor="STATUS" operation="profile_load" profile="unconfined" name="nvidia_modprobe//kmod" pid=461 comm="apparmor_parser" Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 4.446749] audit: type=1400 audit(1692681650.960:4): apparmor="STATUS" operation="profile_load" profile="unconfined" name="lsb_release" pid=460 comm="apparmor_parser" Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 4.582493] audit: type=1400 audit(1692681651.096:5): apparmor="STATUS" operation="profile_load" profile="unconfined" name="/usr/bin/man" pid=479 comm="apparmor_parser" Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 4.583496] audit: type=1400 audit(1692681651.096:6): apparmor="STATUS" operation="profile_load" profile="unconfined" name="man_filter" pid=479 comm="apparmor_parser" Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 4.584807] audit: type=1400 audit(1692681651.100:7): apparmor="STATUS" operation="profile_load" profile="unconfined" name="man_groff" pid=479 comm="apparmor_parser" Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 4.651974] audit: type=1400 audit(1692681651.168:8): apparmor="STATUS" operation="profile_load" profile="unconfined" name="/usr/lib/NetworkManager/nm-dhcp-client.action" pid=465 comm="apparmor_parser" Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 4.653460] audit: type=1400 audit(1692681651.168:9): apparmor="STATUS" operation="profile_load" profile="unconfined" name="/usr/lib/NetworkManager/nm-dhcp-helper" pid=465 comm="apparmor_parser" Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 4.654874] audit: type=1400 audit(1692681651.168:10): apparmor="STATUS" operation="profile_load" profile="unconfined" name="/usr/lib/connman/scripts/dhclient-script" pid=465 comm="apparmor_parser" Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 5.575219] kauditd_printk_skb: 11 callbacks suppressed Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 5.575222] audit: type=1400 audit(1692681652.088:22): apparmor="STATUS" operation="profile_load" profile="unconfined" name="snap.lxd.buginfo" pid=539 comm="apparmor_parser" Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 5.631206] audit: type=1400 audit(1692681652.144:23): apparmor="STATUS" operation="profile_load" profile="unconfined" name="snap.lxd.check-kernel" pid=540 comm="apparmor_parser" Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 5.744098] audit: type=1400 audit(1692681652.260:24): apparmor="STATUS" operation="profile_load" profile="unconfined" name="snap.lxd.daemon" pid=541 comm="apparmor_parser" Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 5.796242] audit: type=1400 audit(1692681652.312:25): apparmor="STATUS" operation="profile_load" profile="unconfined" name="snap.lxd.hook.configure" pid=542 comm="apparmor_parser" Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 5.858755] audit: type=1400 audit(1692681652.372:26): apparmor="STATUS" operation="profile_load" profile="unconfined" name="snap.lxd.hook.install" pid=543 comm="apparmor_parser" Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 5.934631] audit: type=1400 audit(1692681652.448:27): apparmor="STATUS" operation="profile_load" profile="unconfined" name="snap.lxd.hook.remove" pid=544 comm="apparmor_parser" Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 5.981410] audit: type=1400 audit(1692681652.496:28): apparmor="STATUS" operation="profile_load" profile="unconfined" name="snap.lxd.lxc" pid=545 comm="apparmor_parser" Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 6.177044] audit: type=1400 audit(1692681652.692:29): apparmor="STATUS" operation="profile_load" profile="unconfined" name="snap.lxd.lxc-to-lxd" pid=546 comm="apparmor_parser" Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 6.218412] audit: type=1400 audit(1692681652.732:30): apparmor="STATUS" operation="profile_load" profile="unconfined" name="snap.lxd.lxd" pid=547 comm="apparmor_parser" Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 6.309936] audit: type=1400 audit(1692681652.824:31): apparmor="STATUS" operation="profile_load" profile="unconfined" name="snap.lxd.migrate" pid=548 comm="apparmor_parser" Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 14.017400] EXT4-fs (vda1): resizing filesystem from 548091 to 5214459 blocks Aug 22 05:21:01 juju-e4d256-prod-github-runner-207 kernel: [ 14.052742] EXT4-fs (vda1): resized filesystem to 5214459 Aug 22 05:21:03 juju-e4d256-prod-github-runner-207 kernel: [ 16.784131] loop3: detected capacity change from 0 to 8 Aug 22 05:22:01 juju-e4d256-prod-github-runner-207 kernel: [ 73.982257] bridge: filtering via arp/ip/ip6tables is no longer available by default. Update your scripts to load br_netfilter if you need this. Aug 22 05:22:01 juju-e4d256-prod-github-runner-207 kernel: [ 74.004389] fan-252: port 1(ftun0) entered blocking state Aug 22 05:22:01 juju-e4d256-prod-github-runner-207 kernel: [ 74.004393] fan-252: port 1(ftun0) entered disabled state Aug 22 05:22:01 juju-e4d256-prod-github-runner-207 kernel: [ 74.004446] device ftun0 entered promiscuous mode Aug 22 05:22:01 juju-e4d256-prod-github-runner-207 kernel: [ 74.122872] fan-252: port 1(ftun0) entered blocking state Aug 22 05:22:01 juju-e4d256-prod-github-runner-207 kernel: [ 74.122878] fan-252: port 1(ftun0) entered forwarding state Aug 22 05:22:02 juju-e4d256-prod-github-runner-207 kernel: [ 74.999524] IPv6: ADDRCONF(NETDEV_CHANGE): fan-252: link becomes ready Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.000000] Linux version 5.15.0-83-generic (buildd@lcy02-amd64-027) (gcc (Ubuntu 11.4.0-1ubuntu1~22.04) 11.4.0, GNU ld (GNU Binutils for Ubuntu) 2.38) #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 (Ubuntu 5.15.0-83.92-generic 5.15.116) Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.000000] Command line: BOOT_IMAGE=/boot/vmlinuz-5.15.0-83-generic root=UUID=a6de04b8-3631-4ce4-bb96-48076f4a56bf ro console=tty1 console=ttyS0 Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.000000] KERNEL supported cpus: Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.000000] Intel GenuineIntel Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.000000] AMD AuthenticAMD Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.000000] Hygon HygonGenuine Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.000000] Centaur CentaurHauls Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.000000] zhaoxin Shanghai Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.000000] BIOS-provided physical RAM map: Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000bffdafff] usable Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.000000] BIOS-e820: [mem 0x00000000bffdb000-0x00000000bfffffff] reserved Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x0000000b3fffffff] usable Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.000000] NX (Execute Disable) protection: active Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.000000] SMBIOS 2.8 present. Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.000000] DMI: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.000000] Hypervisor detected: KVM Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.000000] kvm-clock: cpu 0, msr 867e01001, primary cpu clock Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.000001] kvm-clock: using sched offset of 179959913164 cycles Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.000003] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.000007] tsc: Detected 2500.000 MHz processor Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.001149] e820: update [mem 0x00000000-0x00000fff] usable ==> reserved Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.001154] e820: remove [mem 0x000a0000-0x000fffff] usable Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.001160] last_pfn = 0xb40000 max_arch_pfn = 0x400000000 Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.001205] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.001216] last_pfn = 0xbffdb max_arch_pfn = 0x400000000 Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.004122] found SMP MP-table at [mem 0x000f5c50-0x000f5c5f] Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.004145] Using GB pages for direct mapping Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.004306] RAMDISK: [mem 0x2aee5000-0x31769fff] Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.004319] ACPI: Early table checksum verification disabled Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.004323] ACPI: RSDP 0x00000000000F5C10 000014 (v00 BOCHS ) Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.004328] ACPI: RSDT 0x00000000BFFE12DF 00002C (v01 BOCHS BXPCRSDT 00000001 BXPC 00000001) Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.004334] ACPI: FACP 0x00000000BFFE11EB 000074 (v01 BOCHS BXPCFACP 00000001 BXPC 00000001) Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.004340] ACPI: DSDT 0x00000000BFFDFDC0 00142B (v01 BOCHS BXPCDSDT 00000001 BXPC 00000001) Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.004344] ACPI: FACS 0x00000000BFFDFD80 000040 Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.004348] ACPI: APIC 0x00000000BFFE125F 000080 (v01 BOCHS BXPCAPIC 00000001 BXPC 00000001) Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.004351] ACPI: Reserving FACP table memory at [mem 0xbffe11eb-0xbffe125e] Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.004353] ACPI: Reserving DSDT table memory at [mem 0xbffdfdc0-0xbffe11ea] Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.004354] ACPI: Reserving FACS table memory at [mem 0xbffdfd80-0xbffdfdbf] Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.004356] ACPI: Reserving APIC table memory at [mem 0xbffe125f-0xbffe12de] Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.004656] No NUMA configuration found Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.004658] Faking a node at [mem 0x0000000000000000-0x0000000b3fffffff] Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.004667] NODE_DATA(0) allocated [mem 0xb3ffd6000-0xb3fffffff] Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.005044] Zone ranges: Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.005046] DMA [mem 0x0000000000001000-0x0000000000ffffff] Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.005048] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.005050] Normal [mem 0x0000000100000000-0x0000000b3fffffff] Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.005052] Device empty Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.005054] Movable zone start for each node Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.005057] Early memory node ranges Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.005058] node 0: [mem 0x0000000000001000-0x000000000009efff] Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.005060] node 0: [mem 0x0000000000100000-0x00000000bffdafff] Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.005062] node 0: [mem 0x0000000100000000-0x0000000b3fffffff] Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.005069] Initmem setup node 0 [mem 0x0000000000001000-0x0000000b3fffffff] Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.005455] On node 0, zone DMA: 1 pages in unavailable ranges Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.005484] On node 0, zone DMA: 97 pages in unavailable ranges Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.200122] On node 0, zone Normal: 37 pages in unavailable ranges Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.200408] ACPI: PM-Timer IO Port: 0x608 Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.200421] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.200454] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.200457] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.200459] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.200461] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.200463] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.200464] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.200468] ACPI: Using ACPI (MADT) for SMP configuration information Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.200473] smpboot: Allowing 2 CPUs, 0 hotplug CPUs Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.200495] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.200498] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x0009ffff] Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.200499] PM: hibernation: Registered nosave memory: [mem 0x000a0000-0x000effff] Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.200500] PM: hibernation: Registered nosave memory: [mem 0x000f0000-0x000fffff] Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.200502] PM: hibernation: Registered nosave memory: [mem 0xbffdb000-0xbfffffff] Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.200503] PM: hibernation: Registered nosave memory: [mem 0xc0000000-0xfeffbfff] Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.200505] PM: hibernation: Registered nosave memory: [mem 0xfeffc000-0xfeffffff] Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.200506] PM: hibernation: Registered nosave memory: [mem 0xff000000-0xfffbffff] Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.200507] PM: hibernation: Registered nosave memory: [mem 0xfffc0000-0xffffffff] Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.200509] [mem 0xc0000000-0xfeffbfff] available for PCI devices Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.200511] Booting paravirtualized kernel on KVM Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.200514] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645519600211568 ns Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.200526] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:2 nr_cpu_ids:2 nr_node_ids:1 Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.200722] percpu: Embedded 61 pages/cpu s212992 r8192 d28672 u1048576 Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.200727] pcpu-alloc: s212992 r8192 d28672 u1048576 alloc=1*2097152 Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.200730] pcpu-alloc: [0] 0 1 Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.200751] kvm-guest: stealtime: cpu 0, msr b13c33080 Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.200754] kvm-guest: PV spinlocks disabled, no host support Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.200758] Built 1 zonelists, mobility grouping on. Total pages: 11353819 Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.200760] Policy zone: Normal Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.200762] Kernel command line: BOOT_IMAGE=/boot/vmlinuz-5.15.0-83-generic root=UUID=a6de04b8-3631-4ce4-bb96-48076f4a56bf ro console=tty1 console=ttyS0 Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.201016] Unknown kernel command line parameters "BOOT_IMAGE=/boot/vmlinuz-5.15.0-83-generic", will be passed to user space. Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.206476] Dentry cache hash table entries: 8388608 (order: 14, 67108864 bytes, linear) Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.208863] Inode-cache hash table entries: 4194304 (order: 13, 33554432 bytes, linear) Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.208900] mem auto-init: stack:off, heap alloc:on, heap free:off Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.290616] Memory: 45085236K/46136804K available (16393K kernel code, 4391K rwdata, 10864K rodata, 3352K init, 18720K bss, 1051308K reserved, 0K cma-reserved) Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.291360] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=2, Nodes=1 Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.291416] ftrace: allocating 50648 entries in 198 pages Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.316623] ftrace: allocated 198 pages with 4 groups Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.316992] rcu: Hierarchical RCU implementation. Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.316994] rcu: RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=2. Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.316996] Rude variant of Tasks RCU enabled. Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.316997] Tracing variant of Tasks RCU enabled. Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.316998] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies. Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.316999] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=2 Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.321095] NR_IRQS: 524544, nr_irqs: 440, preallocated irqs: 16 Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.321293] random: crng init done Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.328729] Console: colour VGA+ 80x25 Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.349658] printk: console [tty1] enabled Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.394172] printk: console [ttyS0] enabled Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.394641] ACPI: Core revision 20210730 Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.395109] APIC: Switch to symmetric I/O mode setup Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.395707] x2apic enabled Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.396138] Switched APIC routing to physical x2apic. Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.397295] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.397844] tsc: Marking TSC unstable due to TSCs unsynchronized Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.398405] Calibrating delay loop (skipped) preset value.. 5000.00 BogoMIPS (lpj=10000000) Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.402467] x86/cpu: User Mode Instruction Prevention (UMIP) activated Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.403109] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127 Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.403634] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0 Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.404198] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.404956] Spectre V2 : Mitigation: Retpolines Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.405410] Spectre V2 : Spectre v2 / SpectreRSB mitigation: Filling RSB on context switch Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.406155] Spectre V2 : Spectre v2 / SpectreRSB : Filling RSB on VMEXIT Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.406401] Spectre V2 : Enabling Speculation Barrier for firmware calls Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.407009] RETBleed: Mitigation: untrained return thunk Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.407521] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.408277] Speculative Store Bypass: Vulnerable Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.408725] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.410403] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.410965] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.411511] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.412042] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format. Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.423755] Freeing SMP alternatives memory: 44K Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.424326] pid_max: default: 32768 minimum: 301 Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.424802] LSM: Security Framework initializing Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.425255] landlock: Up and running. Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.425623] Yama: becoming mindful. Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.426029] AppArmor: AppArmor initialized Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.426492] Mount-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.427305] Mountpoint-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.536376] smpboot: CPU0: AMD EPYC-Rome Processor (family: 0x17, model: 0x31, stepping: 0x0) Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.537385] Performance Events: Fam17h+ core perfctr, AMD PMU driver. Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.537966] ... version: 0 Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.538348] ... bit width: 48 Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.538400] ... generic registers: 6 Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.538400] ... value mask: 0000ffffffffffff Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.538400] ... max period: 00007fffffffffff Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.538400] ... fixed-purpose events: 0 Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.538401] ... event mask: 000000000000003f Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.538925] signal: max sigframe size: 1776 Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.539353] rcu: Hierarchical SRCU implementation. Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.540272] smp: Bringing up secondary CPUs ... Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.540802] x86: Booting SMP configuration: Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.541207] .... node #0, CPUs: #1 Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.077127] kvm-clock: cpu 1, msr 867e01041, secondary cpu clock Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.077127] smpboot: CPU 1 Converting physical 4 to logical die 1 Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.542734] kvm-guest: stealtime: cpu 1, msr b13d33080 Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.542973] smp: Brought up 1 node, 2 CPUs Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.542973] smpboot: Max logical packages: 2 Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.543236] smpboot: Total of 2 processors activated (10000.00 BogoMIPS) Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.546636] devtmpfs: initialized Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.546796] x86/mm: Memory block size: 128MB Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.549618] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.550410] futex hash table entries: 512 (order: 3, 32768 bytes, linear) Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.551072] pinctrl core: initialized pinctrl subsystem Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.551657] PM: RTC time: 05:23:46, date: 2023-08-22 Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.552272] NET: Registered PF_NETLINK/PF_ROUTE protocol family Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.554730] DMA: preallocated 4096 KiB GFP_KERNEL pool for atomic allocations Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.555604] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.558480] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.559299] audit: initializing netlink subsys (disabled) Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.559848] audit: type=2000 audit(1692681826.515:1): state=initialized audit_enabled=0 res=1 Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.559848] thermal_sys: Registered thermal governor 'fair_share' Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.559848] thermal_sys: Registered thermal governor 'bang_bang' Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.559874] thermal_sys: Registered thermal governor 'step_wise' Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.560429] thermal_sys: Registered thermal governor 'user_space' Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.562412] thermal_sys: Registered thermal governor 'power_allocator' Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.563051] EISA bus registered Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.564338] cpuidle: using governor ladder Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.564805] cpuidle: using governor menu Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.565583] ACPI: bus type PCI registered Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.565583] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.566508] PCI: Using configuration type 1 for base access Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.567131] PCI: Using configuration type 1 for extended access Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.569387] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.570456] HugeTLB registered 1.00 GiB page size, pre-allocated 0 pages Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.571150] HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.571901] ACPI: Added _OSI(Module Device) Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.574404] ACPI: Added _OSI(Processor Device) Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.574925] ACPI: Added _OSI(3.0 _SCP Extensions) Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.575460] ACPI: Added _OSI(Processor Aggregator Device) Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.576046] ACPI: Added _OSI(Linux-Dell-Video) Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.576545] ACPI: Added _OSI(Linux-Lenovo-NV-HDMI-Audio) Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.577121] ACPI: Added _OSI(Linux-HPI-Hybrid-Graphics) Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.578936] ACPI: 1 ACPI AML tables successfully acquired and loaded Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.580057] ACPI: Interpreter enabled Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.580517] ACPI: PM: (supports S0 S3 S4 S5) Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.581012] ACPI: Using IOAPIC for interrupt routing Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.581571] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.582408] PCI: Using E820 reservations for host bridge windows Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.583156] ACPI: Enabled 2 GPEs in block 00 to 0F Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.585945] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.586426] acpi PNP0A03:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.588400] acpiphp: Slot [3] registered Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.588885] acpiphp: Slot [4] registered Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.589372] acpiphp: Slot [5] registered Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.589845] acpiphp: Slot [6] registered Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.590422] acpiphp: Slot [7] registered Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.590898] acpiphp: Slot [8] registered Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.591380] acpiphp: Slot [9] registered Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.591849] acpiphp: Slot [10] registered Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.592324] acpiphp: Slot [11] registered Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.592799] acpiphp: Slot [12] registered Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.593272] acpiphp: Slot [13] registered Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.593758] acpiphp: Slot [14] registered Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.594418] acpiphp: Slot [15] registered Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.594897] acpiphp: Slot [16] registered Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.595392] acpiphp: Slot [17] registered Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.595872] acpiphp: Slot [18] registered Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.596348] acpiphp: Slot [19] registered Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.596821] acpiphp: Slot [20] registered Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.597298] acpiphp: Slot [21] registered Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.597771] acpiphp: Slot [22] registered Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.598242] acpiphp: Slot [23] registered Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.598417] acpiphp: Slot [24] registered Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.598909] acpiphp: Slot [25] registered Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.599389] acpiphp: Slot [26] registered Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.599862] acpiphp: Slot [27] registered Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.600335] acpiphp: Slot [28] registered Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.600814] acpiphp: Slot [29] registered Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.601292] acpiphp: Slot [30] registered Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.601767] acpiphp: Slot [31] registered Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.602414] PCI host bridge to bus 0000:00 Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.602891] pci_bus 0000:00: root bus resource [bus 00-ff] Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.603428] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.604006] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.604584] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.605401] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.606402] pci_bus 0000:00: root bus resource [mem 0xb40000000-0xbbfffffff window] Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.607423] pci 0000:00:00.0: [8086:1237] type 00 class 0x060000 Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.608568] pci 0000:00:01.0: [8086:7000] type 00 class 0x060100 Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.609576] pci 0000:00:01.1: [8086:7010] type 00 class 0x010180 Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.611974] pci 0000:00:01.1: reg 0x20: [io 0xc180-0xc18f] Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.613254] pci 0000:00:01.1: legacy IDE quirk: reg 0x10: [io 0x01f0-0x01f7] Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.614051] pci 0000:00:01.1: legacy IDE quirk: reg 0x14: [io 0x03f6] Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.614405] pci 0000:00:01.1: legacy IDE quirk: reg 0x18: [io 0x0170-0x0177] Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.615160] pci 0000:00:01.1: legacy IDE quirk: reg 0x1c: [io 0x0376] Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.616040] pci 0000:00:01.2: [8086:7020] type 00 class 0x0c0300 Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.619434] pci 0000:00:01.2: reg 0x20: [io 0xc100-0xc11f] Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.621490] pci 0000:00:01.3: [8086:7113] type 00 class 0x068000 Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.622654] pci 0000:00:01.3: quirk: [io 0x0600-0x063f] claimed by PIIX4 ACPI Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.623469] pci 0000:00:01.3: quirk: [io 0x0700-0x070f] claimed by PIIX4 SMB Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.624583] pci 0000:00:02.0: [1b36:0100] type 00 class 0x030000 Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.627123] pci 0000:00:02.0: reg 0x10: [mem 0xf4000000-0xf7ffffff] Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.632379] pci 0000:00:02.0: reg 0x14: [mem 0xf8000000-0xfbffffff] Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.634405] pci 0000:00:02.0: reg 0x18: [mem 0xfc090000-0xfc091fff] Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.637394] pci 0000:00:02.0: reg 0x1c: [io 0xc120-0xc13f] Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.643131] pci 0000:00:02.0: reg 0x30: [mem 0xfc080000-0xfc08ffff pref] Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.643935] pci 0000:00:02.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.645278] pci 0000:00:03.0: [1af4:1000] type 00 class 0x020000 Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.647142] pci 0000:00:03.0: reg 0x10: [io 0xc080-0xc0bf] Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.649608] pci 0000:00:03.0: reg 0x14: [mem 0xfc092000-0xfc092fff] Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.652733] pci 0000:00:03.0: reg 0x20: [mem 0xfebec000-0xfebeffff 64bit pref] Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.655123] pci 0000:00:03.0: reg 0x30: [mem 0xfc000000-0xfc07ffff pref] Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.656709] pci 0000:00:04.0: [1af4:1003] type 00 class 0x078000 Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.658032] pci 0000:00:04.0: reg 0x10: [io 0xc0c0-0xc0ff] Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.659103] pci 0000:00:04.0: reg 0x14: [mem 0xfc093000-0xfc093fff] Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.662405] pci 0000:00:04.0: reg 0x20: [mem 0xfebf0000-0xfebf3fff 64bit pref] Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.665473] pci 0000:00:05.0: [1af4:1001] type 00 class 0x010000 Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.666774] pci 0000:00:05.0: reg 0x10: [io 0xc000-0xc07f] Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.668121] pci 0000:00:05.0: reg 0x14: [mem 0xfc094000-0xfc094fff] Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.671158] pci 0000:00:05.0: reg 0x20: [mem 0xfebf4000-0xfebf7fff 64bit pref] Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.673181] pci 0000:00:06.0: [1af4:1002] type 00 class 0x00ff00 Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.674403] pci 0000:00:06.0: reg 0x10: [io 0xc140-0xc15f] Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.677514] pci 0000:00:06.0: reg 0x20: [mem 0xfebf8000-0xfebfbfff 64bit pref] Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.680386] pci 0000:00:07.0: [1af4:1005] type 00 class 0x00ff00 Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.681426] pci 0000:00:07.0: reg 0x10: [io 0xc160-0xc17f] Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.683806] pci 0000:00:07.0: reg 0x20: [mem 0xfebfc000-0xfebfffff 64bit pref] Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.689938] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.690499] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.691105] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.691711] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.692277] ACPI: PCI: Interrupt link LNKS configured for IRQ 9 Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.693024] iommu: Default domain type: Translated Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.693024] iommu: DMA domain TLB invalidation policy: lazy mode Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.694552] SCSI subsystem initialized Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.694942] libata version 3.00 loaded. Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.694942] pci 0000:00:02.0: vgaarb: setting as boot VGA device Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.694956] pci 0000:00:02.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.695706] pci 0000:00:02.0: vgaarb: bridge control possible Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.696207] vgaarb: loaded Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.696553] ACPI: bus type USB registered Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.697013] usbcore: registered new interface driver usbfs Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.697560] usbcore: registered new interface driver hub Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.698407] usbcore: registered new device driver usb Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.698886] pps_core: LinuxPPS API ver. 1 registered Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.699348] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.700143] PTP clock support registered Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.700547] EDAC MC: Ver: 3.0.0 Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.700547] NetLabel: Initializing Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.700547] NetLabel: domain hash size = 128 Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.700547] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.702418] NetLabel: unlabeled traffic allowed by default Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.702937] PCI: Using ACPI for IRQ routing Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.702937] PCI: pci_cache_line_size set to 64 bytes Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.702937] e820: reserve RAM buffer [mem 0x0009fc00-0x0009ffff] Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.702937] e820: reserve RAM buffer [mem 0xbffdb000-0xbfffffff] Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.702937] clocksource: Switched to clocksource kvm-clock Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.716032] VFS: Disk quotas dquot_6.6.0 Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.716477] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.717168] AppArmor: AppArmor Filesystem Enabled Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.717634] pnp: PnP ACPI init Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.718066] pnp 00:03: [dma 2] Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.718296] pnp: PnP ACPI: found 5 devices Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.725191] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.726026] NET: Registered PF_INET protocol family Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.726620] IP idents hash table entries: 262144 (order: 9, 2097152 bytes, linear) Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.729197] tcp_listen_portaddr_hash hash table entries: 32768 (order: 7, 524288 bytes, linear) Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.730220] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.731158] TCP established hash table entries: 524288 (order: 10, 4194304 bytes, linear) Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.733210] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes, linear) Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.734220] TCP: Hash tables configured (established 524288 bind 65536) Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.734956] MPTCP token hash table entries: 65536 (order: 8, 1572864 bytes, linear) Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.736874] UDP hash table entries: 32768 (order: 8, 1048576 bytes, linear) Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.738023] UDP-Lite hash table entries: 32768 (order: 8, 1048576 bytes, linear) Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.739185] NET: Registered PF_UNIX/PF_LOCAL protocol family Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.740898] NET: Registered PF_XDP protocol family Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.741468] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.742142] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.742798] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.743520] pci_bus 0000:00: resource 7 [mem 0xc0000000-0xfebfffff window] Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.744254] pci_bus 0000:00: resource 8 [mem 0xb40000000-0xbbfffffff window] Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.745113] pci 0000:00:01.0: PIIX3: Enabling Passive Release Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.745661] pci 0000:00:00.0: Limiting direct PCI/PCI transfers Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.746185] pci 0000:00:01.0: Activating ISA DMA hang workarounds Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.768096] ACPI: \_SB_.LNKD: Enabled at IRQ 11 Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.791432] pci 0000:00:01.2: quirk_usb_early_handoff+0x0/0x160 took 43661 usecs Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.792268] PCI: CLS 0 bytes, default 64 Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.792839] Trying to unpack rootfs image as initramfs... Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.801483] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.802270] software IO TLB: mapped [mem 0x00000000bbfdb000-0x00000000bffdb000] (64MB) Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.805772] Initialise system trusted keyrings Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.806368] Key type blacklist registered Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.809171] workingset: timestamp_bits=36 max_order=24 bucket_order=0 Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.810936] zbud: loaded Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.811604] squashfs: version 4.0 (2009/01/31) Phillip Lougher Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.812514] fuse: init (API version 7.34) Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.813300] integrity: Platform Keyring initialized Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.825195] Key type asymmetric registered Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.825671] Asymmetric key parser 'x509' registered Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.826167] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 243) Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.826926] io scheduler mq-deadline registered Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.827702] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.828399] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0 Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.829109] ACPI: button: Power Button [PWRF] Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.850539] ACPI: \_SB_.LNKC: Enabled at IRQ 10 Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.896818] ACPI: \_SB_.LNKA: Enabled at IRQ 10 Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.921064] ACPI: \_SB_.LNKB: Enabled at IRQ 11 Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.943255] Serial: 8250/16550 driver, 32 ports, IRQ sharing enabled Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.966029] 00:04: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.977573] Linux agpgart interface v0.103 Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.979804] loop: module loaded Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.981059] ata_piix 0000:00:01.1: version 2.13 Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.981750] scsi host0: ata_piix Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.982370] scsi host1: ata_piix Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.982736] ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc180 irq 14 Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.983331] ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc188 irq 15 Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.984016] tun: Universal TUN/TAP device driver, 1.6 Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.984782] PPP generic driver version 2.4.2 Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.985484] VFIO - User Level meta-driver version: 0.3 Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.986103] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.986696] ehci-pci: EHCI PCI platform driver Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.987128] ehci-platform: EHCI generic platform driver Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.987613] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.988160] ohci-pci: OHCI PCI platform driver Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.988583] ohci-platform: OHCI generic platform driver Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 0.989066] uhci_hcd: USB Universal Host Controller Interface driver Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 1.011134] uhci_hcd 0000:00:01.2: UHCI Host Controller Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 1.011637] uhci_hcd 0000:00:01.2: new USB bus registered, assigned bus number 1 Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 1.012371] uhci_hcd 0000:00:01.2: detected 2 ports Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 1.012868] uhci_hcd 0000:00:01.2: irq 11, io base 0x0000c100 Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 1.013478] usb usb1: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 5.15 Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 1.014259] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 1.014977] usb usb1: Product: UHCI Host Controller Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 1.015432] usb usb1: Manufacturer: Linux 5.15.0-83-generic uhci_hcd Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 1.016013] usb usb1: SerialNumber: 0000:00:01.2 Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 1.016701] hub 1-0:1.0: USB hub found Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 1.017087] hub 1-0:1.0: 2 ports detected Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 1.017613] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 1.018881] serio: i8042 KBD port at 0x60,0x64 irq 1 Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 1.019369] serio: i8042 AUX port at 0x60,0x64 irq 12 Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 1.020056] mousedev: PS/2 mouse device common for all mice Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 1.021018] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input1 Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 1.021980] rtc_cmos 00:00: RTC can wake from S4 Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 1.022854] rtc_cmos 00:00: registered as rtc0 Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 1.023320] rtc_cmos 00:00: setting system clock to 2023-08-22T05:23:46 UTC (1692681826) Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 1.024128] rtc_cmos 00:00: alarms up to one day, y3k, 114 bytes nvram Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 1.024718] i2c_dev: i2c /dev entries driver Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 1.025187] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 1.026311] device-mapper: uevent: version 1.0.3 Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 1.027029] device-mapper: ioctl: 4.45.0-ioctl (2021-03-22) initialised: dm-devel@redhat.com Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 1.027818] platform eisa.0: Probing EISA bus 0 Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 1.028259] platform eisa.0: EISA: Cannot allocate resource for mainboard Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 1.028848] platform eisa.0: Cannot allocate resource for EISA slot 1 Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 1.029452] platform eisa.0: Cannot allocate resource for EISA slot 2 Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 1.030065] platform eisa.0: Cannot allocate resource for EISA slot 3 Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 1.030650] platform eisa.0: Cannot allocate resource for EISA slot 4 Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 1.031232] platform eisa.0: Cannot allocate resource for EISA slot 5 Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 1.031799] platform eisa.0: Cannot allocate resource for EISA slot 6 Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 1.032369] platform eisa.0: Cannot allocate resource for EISA slot 7 Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 1.032969] platform eisa.0: Cannot allocate resource for EISA slot 8 Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 1.033542] platform eisa.0: EISA: Detected 0 cards Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 1.034401] ledtrig-cpu: registered to indicate activity on CPUs Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 1.035004] drop_monitor: Initializing network drop monitor service Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 1.035696] NET: Registered PF_INET6 protocol family Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 1.427657] Freeing initrd memory: 107028K Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 1.432605] Segment Routing with IPv6 Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 1.433058] In-situ OAM (IOAM) with IPv6 Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 1.433485] NET: Registered PF_PACKET protocol family Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 1.434026] Key type dns_resolver registered Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 1.434661] IPI shorthand broadcast: enabled Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 1.435096] sched_clock: Marking stable (1361487390, 73127960)->(1434910970, -295620) Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 1.435956] registered taskstats version 1 Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 1.436429] Loading compiled-in X.509 certificates Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 1.437410] Loaded X.509 cert 'Build time autogenerated kernel key: ced9953b39166bc6a497e5fc5420fc29069a55cd' Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 1.438737] Loaded X.509 cert 'Canonical Ltd. Live Patch Signing: 14df34d1a87cf37625abec039ef2bf521249b969' Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 1.440033] Loaded X.509 cert 'Canonical Ltd. Kernel Module Signing: 88f752e560a1e0737e31163a466ad7b70a850c19' Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 1.440908] blacklist: Loading compiled-in revocation X.509 certificates Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 1.441553] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing: 61482aa2830d0ab2ad5af10b7250da9033ddcef0' Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 1.442446] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2017): 242ade75ac4a15e50d50c84b0d45ff3eae707a03' Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 1.443368] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (ESM 2018): 365188c1d374d6b07c3c8f240f8ef722433d6a8b' Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 1.444316] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2019): c0746fd6c5da3ae827864651ad66ae47fe24b3e8' Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 1.445244] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2021 v1): a8d54bbb3825cfb94fa13c9f8a594a195c107b8d' Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 1.446188] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2021 v2): 4cf046892d6fd3c9a5b03f98d845f90851dc6a8c' Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 1.447192] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2021 v3): 100437bb6de6e469b581e61cd66bce3ef4ed53af' Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 1.448133] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (Ubuntu Core 2019): c1d57b8f6b743f23ee41f4f7ee292f06eecadfb9' Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 1.449202] zswap: loaded using pool lzo/zbud Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 1.449816] Key type .fscrypt registered Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 1.450303] Key type fscrypt-provisioning registered Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 1.452865] Key type encrypted registered Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 1.453374] AppArmor: AppArmor sha1 policy hashing enabled Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 1.454010] ima: No TPM chip found, activating TPM-bypass! Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 1.454625] Loading compiled-in module X.509 certificates Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 1.455655] Loaded X.509 cert 'Build time autogenerated kernel key: ced9953b39166bc6a497e5fc5420fc29069a55cd' Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 1.456721] ima: Allocated hash algorithm: sha1 Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 1.457261] ima: No architecture policies found Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 1.457814] evm: Initialising EVM extended attributes: Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 1.458452] evm: security.selinux Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 1.458860] evm: security.SMACK64 Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 1.459277] evm: security.SMACK64EXEC Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 1.459714] evm: security.SMACK64TRANSMUTE Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 1.460188] evm: security.SMACK64MMAP Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 1.461462] evm: security.apparmor Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 1.461892] evm: security.ima Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 1.462265] evm: security.capability Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 1.462692] evm: HMAC attrs: 0x1 Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 1.463363] PM: Magic number: 3:18:366 Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 1.464056] RAS: Correctable Errors collector initialized. Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 1.466031] Freeing unused decrypted memory: 2036K Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 1.466955] Freeing unused kernel image (initmem) memory: 3352K Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 1.477153] Write protecting the kernel read-only data: 30720k Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 1.478247] Freeing unused kernel image (text/rodata gap) memory: 2036K Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 1.479139] Freeing unused kernel image (rodata/data gap) memory: 1424K Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 1.531897] x86/mm: Checked W+X mappings: passed, no W+X pages found. Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 1.532643] Run /init as init process Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 1.533087] with arguments: Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 1.533089] /init Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 1.533090] with environment: Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 1.533090] HOME=/ Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 1.533091] TERM=linux Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 1.533092] BOOT_IMAGE=/boot/vmlinuz-5.15.0-83-generic Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 1.658647] virtio_blk virtio2: [vda] 41943040 512-byte logical blocks (21.5 GB/20.0 GiB) Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 1.660435] piix4_smbus 0000:00:01.3: SMBus Host Controller at 0x700, revision 0 Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 1.662885] vda: vda1 vda14 vda15 Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 1.665163] cryptd: max_cpu_qlen set to 1000 Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 1.673946] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input4 Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 1.674964] AVX2 version of gcm_enc/dec engaged. Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 1.675517] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input3 Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 1.682598] AES CTR mode by8 optimization enabled Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 1.683351] FDC 0 is a S82078B Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 1.723708] qxl 0000:00:02.0: vgaarb: deactivate vga console Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 1.727201] Console: switching to colour dummy device 80x25 Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 1.727901] [drm] Device Version 0.0 Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 1.728140] [drm] Compression level 0 log level 0 Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 1.728430] [drm] 12286 io pages at offset 0x1000000 Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 1.728733] [drm] 16777216 byte draw area at offset 0x0 Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 1.729050] [drm] RAM header offset: 0x3ffe000 Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 1.729545] [drm] qxl: 16M of VRAM memory size Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 1.729841] [drm] qxl: 63M of IO pages memory ready (VRAM domain) Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 1.731027] [drm] qxl: 64M of Surface memory size Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 1.739610] virtio_net virtio0 ens3: renamed from eth0 Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 1.740800] [drm] slot 0 (main): base 0xf4000000, size 0x03ffe000 Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 1.742654] [drm] slot 1 (surfaces): base 0xf8000000, size 0x04000000 Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 1.744813] [drm] Initialized qxl 0.1.0 20120117 for 0000:00:02.0 on minor 0 Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 1.746045] fbcon: qxldrmfb (fb0) is primary device Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 1.759579] Console: switching to colour frame buffer device 128x48 Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 1.766780] qxl 0000:00:02.0: [drm] fb0: qxldrmfb frame buffer device Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 1.957146] raid6: avx2x4 gen() 29361 MB/s Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 2.025136] raid6: avx2x4 xor() 8109 MB/s Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 2.093135] raid6: avx2x2 gen() 32471 MB/s Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 2.161140] raid6: avx2x2 xor() 19200 MB/s Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 2.229135] raid6: avx2x1 gen() 23759 MB/s Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 2.297140] raid6: avx2x1 xor() 14678 MB/s Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 2.365134] raid6: sse2x4 gen() 14863 MB/s Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 2.433135] raid6: sse2x4 xor() 7237 MB/s Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 2.501136] raid6: sse2x2 gen() 16305 MB/s Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 2.569136] raid6: sse2x2 xor() 9885 MB/s Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 2.637135] raid6: sse2x1 gen() 12398 MB/s Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 2.705135] raid6: sse2x1 xor() 7477 MB/s Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 2.705441] raid6: using algorithm avx2x2 gen() 32471 MB/s Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 2.705801] raid6: .... xor() 19200 MB/s, rmw enabled Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 2.706123] raid6: using avx2x2 recovery algorithm Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 2.708447] xor: measuring software checksum speed Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 2.709253] prefetch64-sse : 21036 MB/sec Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 2.710061] generic_sse : 19239 MB/sec Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 2.710343] xor: using function: prefetch64-sse (21036 MB/sec) Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 2.711758] async_tx: api initialized (async) Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 2.768338] Btrfs loaded, crc32c=crc32c-intel, zoned=yes, fsverity=yes Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 2.805802] EXT4-fs (vda1): mounted filesystem with ordered data mode. Opts: (null). Quota mode: none. Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 3.290523] EXT4-fs (vda1): re-mounted. Opts: discard,errors=remount-ro. Quota mode: none. Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 3.341014] alua: device handler registered Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 3.346664] emc: device handler registered Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 3.356365] rdac: device handler registered Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 3.434912] loop0: detected capacity change from 0 to 229272 Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 3.435053] loop1: detected capacity change from 0 to 109072 Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 3.435641] loop2: detected capacity change from 0 to 129944 Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 3.668290] kvm: Nested Virtualization enabled Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 3.668292] SVM: kvm: Nested Paging enabled Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 3.760732] audit: type=1400 audit(1692681829.232:2): apparmor="STATUS" operation="profile_load" profile="unconfined" name="nvidia_modprobe" pid=470 comm="apparmor_parser" Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 3.760737] audit: type=1400 audit(1692681829.232:3): apparmor="STATUS" operation="profile_load" profile="unconfined" name="nvidia_modprobe//kmod" pid=470 comm="apparmor_parser" Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 3.760755] audit: type=1400 audit(1692681829.232:4): apparmor="STATUS" operation="profile_load" profile="unconfined" name="lsb_release" pid=469 comm="apparmor_parser" Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 3.788332] audit: type=1400 audit(1692681829.260:5): apparmor="STATUS" operation="profile_load" profile="unconfined" name="/usr/bin/man" pid=472 comm="apparmor_parser" Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 3.788336] audit: type=1400 audit(1692681829.260:6): apparmor="STATUS" operation="profile_load" profile="unconfined" name="man_filter" pid=472 comm="apparmor_parser" Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 3.788338] audit: type=1400 audit(1692681829.260:7): apparmor="STATUS" operation="profile_load" profile="unconfined" name="man_groff" pid=472 comm="apparmor_parser" Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 3.796777] audit: type=1400 audit(1692681829.268:8): apparmor="STATUS" operation="profile_load" profile="unconfined" name="tcpdump" pid=483 comm="apparmor_parser" Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 3.801428] audit: type=1400 audit(1692681829.276:9): apparmor="STATUS" operation="profile_load" profile="unconfined" name="/usr/lib/NetworkManager/nm-dhcp-client.action" pid=471 comm="apparmor_parser" Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 3.801432] audit: type=1400 audit(1692681829.276:10): apparmor="STATUS" operation="profile_load" profile="unconfined" name="/usr/lib/NetworkManager/nm-dhcp-helper" pid=471 comm="apparmor_parser" Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 6.483159] bridge: filtering via arp/ip/ip6tables is no longer available by default. Update your scripts to load br_netfilter if you need this. Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 6.510992] fan-252: port 1(ftun0) entered blocking state Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 6.510996] fan-252: port 1(ftun0) entered disabled state Aug 22 05:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 6.511041] device ftun0 entered promiscuous mode Aug 22 05:23:52 juju-e4d256-prod-github-runner-207 kernel: [ 6.620073] fan-252: port 1(ftun0) entered blocking state Aug 22 05:23:52 juju-e4d256-prod-github-runner-207 kernel: [ 6.620077] fan-252: port 1(ftun0) entered forwarding state Aug 22 05:23:52 juju-e4d256-prod-github-runner-207 kernel: [ 7.501986] IPv6: ADDRCONF(NETDEV_CHANGE): fan-252: link becomes ready Aug 22 05:23:57 juju-e4d256-prod-github-runner-207 kernel: [ 12.363703] loop3: detected capacity change from 0 to 8 Aug 22 05:24:50 juju-e4d256-prod-github-runner-207 kernel: [ 64.514331] loop3: detected capacity change from 0 to 151296 Aug 22 05:24:54 juju-e4d256-prod-github-runner-207 kernel: [ 68.160598] loop4: detected capacity change from 0 to 355240 Aug 22 05:24:55 juju-e4d256-prod-github-runner-207 kernel: [ 69.043038] kauditd_printk_skb: 20 callbacks suppressed Aug 22 05:24:55 juju-e4d256-prod-github-runner-207 kernel: [ 69.043040] audit: type=1400 audit(1692681895.070:31): apparmor="STATUS" operation="profile_replace" info="same as current profile, skipping" profile="unconfined" name="/snap/snapd/19457/usr/lib/snapd/snap-confine" pid=5059 comm="apparmor_parser" Aug 22 05:24:55 juju-e4d256-prod-github-runner-207 kernel: [ 69.043044] audit: type=1400 audit(1692681895.070:32): apparmor="STATUS" operation="profile_replace" info="same as current profile, skipping" profile="unconfined" name="/snap/snapd/19457/usr/lib/snapd/snap-confine//mount-namespace-capture-helper" pid=5059 comm="apparmor_parser" Aug 22 05:24:55 juju-e4d256-prod-github-runner-207 kernel: [ 69.167248] audit: type=1400 audit(1692681895.194:33): apparmor="STATUS" operation="profile_replace" profile="unconfined" name="snap.lxd.activate" pid=5061 comm="apparmor_parser" Aug 22 05:24:55 juju-e4d256-prod-github-runner-207 kernel: [ 69.299495] audit: type=1400 audit(1692681895.326:34): apparmor="STATUS" operation="profile_replace" profile="unconfined" name="snap.lxd.benchmark" pid=5062 comm="apparmor_parser" Aug 22 05:24:55 juju-e4d256-prod-github-runner-207 kernel: [ 69.422471] audit: type=1400 audit(1692681895.450:35): apparmor="STATUS" operation="profile_replace" profile="unconfined" name="snap.lxd.buginfo" pid=5063 comm="apparmor_parser" Aug 22 05:24:55 juju-e4d256-prod-github-runner-207 kernel: [ 69.545599] audit: type=1400 audit(1692681895.574:36): apparmor="STATUS" operation="profile_replace" profile="unconfined" name="snap.lxd.check-kernel" pid=5064 comm="apparmor_parser" Aug 22 05:24:55 juju-e4d256-prod-github-runner-207 kernel: [ 69.695271] audit: type=1400 audit(1692681895.722:37): apparmor="STATUS" operation="profile_replace" profile="unconfined" name="snap.lxd.daemon" pid=5065 comm="apparmor_parser" Aug 22 05:24:55 juju-e4d256-prod-github-runner-207 kernel: [ 69.848904] audit: type=1400 audit(1692681895.874:38): apparmor="STATUS" operation="profile_replace" profile="unconfined" name="snap.lxd.hook.configure" pid=5066 comm="apparmor_parser" Aug 22 05:24:55 juju-e4d256-prod-github-runner-207 kernel: [ 69.953753] audit: type=1400 audit(1692681895.982:39): apparmor="STATUS" operation="profile_replace" profile="unconfined" name="snap.lxd.hook.install" pid=5067 comm="apparmor_parser" Aug 22 05:24:56 juju-e4d256-prod-github-runner-207 kernel: [ 70.074464] audit: type=1400 audit(1692681896.102:40): apparmor="STATUS" operation="profile_replace" profile="unconfined" name="snap.lxd.hook.remove" pid=5068 comm="apparmor_parser" Aug 22 05:25:02 juju-e4d256-prod-github-runner-207 kernel: [ 76.093532] NET: Registered PF_VSOCK protocol family Aug 22 05:25:03 juju-e4d256-prod-github-runner-207 kernel: [ 77.496531] spl: loading out-of-tree module taints kernel. Aug 22 05:25:03 juju-e4d256-prod-github-runner-207 kernel: [ 77.500224] znvpair: module license 'CDDL' taints kernel. Aug 22 05:25:03 juju-e4d256-prod-github-runner-207 kernel: [ 77.500227] Disabling lock debugging due to kernel taint Aug 22 05:25:03 juju-e4d256-prod-github-runner-207 kernel: [ 77.648099] ZFS: Loaded module v2.1.5-1ubuntu6~22.04.1, ZFS pool version 5000, ZFS filesystem version 5 Aug 22 05:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 80.203169] kauditd_printk_skb: 6 callbacks suppressed Aug 22 05:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 80.203171] audit: type=1400 audit(1692681906.231:47): apparmor="STATUS" operation="profile_load" profile="unconfined" name="lxd_dnsmasq-lxdbr0_" pid=5741 comm="apparmor_parser" Aug 22 05:25:07 juju-e4d256-prod-github-runner-207 kernel: [ 81.401143] audit: type=1400 audit(1692681907.431:48): apparmor="STATUS" operation="profile_replace" info="same as current profile, skipping" profile="unconfined" name="lxd_dnsmasq-lxdbr0_" pid=5805 comm="apparmor_parser" Aug 22 05:25:08 juju-e4d256-prod-github-runner-207 kernel: [ 82.094695] Bridge firewalling registered Aug 22 05:25:09 juju-e4d256-prod-github-runner-207 kernel: [ 83.077004] audit: type=1400 audit(1692681909.107:49): apparmor="STATUS" operation="profile_replace" info="same as current profile, skipping" profile="unconfined" name="lxd_dnsmasq-lxdbr0_" pid=6193 comm="apparmor_parser" Aug 22 05:25:10 juju-e4d256-prod-github-runner-207 kernel: [ 83.969732] audit: type=1400 audit(1692681909.999:50): apparmor="STATUS" operation="profile_replace" info="same as current profile, skipping" profile="unconfined" name="lxd_dnsmasq-lxdbr0_" pid=6268 comm="apparmor_parser" Aug 22 05:25:21 juju-e4d256-prod-github-runner-207 kernel: [ 95.653593] audit: type=1400 audit(1692681921.683:51): apparmor="STATUS" operation="profile_load" profile="unconfined" name="lxd_archive-var-snap-lxd-common-lxd-storage-pools-runner-virtual-machines-large-105-208a3d0a-0f16-4563-80ca-577c360e4d61" pid=6610 comm="apparmor_parser" Aug 22 05:25:21 juju-e4d256-prod-github-runner-207 kernel: [ 95.755401] audit: type=1400 audit(1692681921.783:52): apparmor="STATUS" operation="profile_remove" profile="unconfined" name="lxd_archive-var-snap-lxd-common-lxd-storage-pools-runner-virtual-machines-large-105-208a3d0a-0f16-4563-80ca-577c360e4d61" pid=6615 comm="apparmor_parser" Aug 22 05:25:21 juju-e4d256-prod-github-runner-207 kernel: [ 95.797576] audit: type=1400 audit(1692681921.827:53): apparmor="STATUS" operation="profile_load" profile="unconfined" name="lxd_qemu-img-_" pid=6619 comm="apparmor_parser" Aug 22 05:25:21 juju-e4d256-prod-github-runner-207 kernel: [ 95.825046] audit: type=1400 audit(1692681921.855:54): apparmor="DENIED" operation="open" profile="lxd_qemu-img-_" name="/sys/devices/system/node/" pid=6620 comm="qemu-img" requested_mask="r" denied_mask="r" fsuid=0 ouid=0 Aug 22 05:25:21 juju-e4d256-prod-github-runner-207 kernel: [ 95.917864] audit: type=1400 audit(1692681921.947:55): apparmor="STATUS" operation="profile_remove" profile="unconfined" name="lxd_qemu-img-_" pid=6626 comm="apparmor_parser" Aug 22 05:25:21 juju-e4d256-prod-github-runner-207 kernel: [ 95.960154] audit: type=1400 audit(1692681921.987:56): apparmor="STATUS" operation="profile_load" profile="unconfined" name="lxd_qemu-img-_" pid=6628 comm="apparmor_parser" Aug 22 05:25:22 juju-e4d256-prod-github-runner-207 kernel: [ 95.975114] audit: type=1400 audit(1692681922.003:57): apparmor="DENIED" operation="open" profile="lxd_qemu-img-_" name="/sys/devices/system/node/" pid=6629 comm="qemu-img" requested_mask="r" denied_mask="r" fsuid=0 ouid=0 Aug 22 05:25:27 juju-e4d256-prod-github-runner-207 kernel: [ 101.747903] audit: type=1400 audit(1692681927.775:58): apparmor="STATUS" operation="profile_remove" profile="unconfined" name="lxd_qemu-img-_" pid=6644 comm="apparmor_parser" Aug 22 05:25:29 juju-e4d256-prod-github-runner-207 kernel: [ 103.286353] lxdbr0: port 1(tap739d0433) entered blocking state Aug 22 05:25:29 juju-e4d256-prod-github-runner-207 kernel: [ 103.286358] lxdbr0: port 1(tap739d0433) entered disabled state Aug 22 05:25:29 juju-e4d256-prod-github-runner-207 kernel: [ 103.286439] device tap739d0433 entered promiscuous mode Aug 22 05:25:29 juju-e4d256-prod-github-runner-207 kernel: [ 103.410382] audit: type=1400 audit(1692681929.439:59): apparmor="STATUS" operation="profile_load" profile="unconfined" name="lxd-large-105-208a3d0a-0f16-4563-80ca-577c360e4d61_" pid=6697 comm="apparmor_parser" Aug 22 05:25:29 juju-e4d256-prod-github-runner-207 kernel: [ 103.530306] kvm: SMP vm created on host with unstable TSC; guest TSC will not be reliable Aug 22 05:25:29 juju-e4d256-prod-github-runner-207 kernel: [ 103.588628] lxdbr0: port 1(tap739d0433) entered blocking state Aug 22 05:25:29 juju-e4d256-prod-github-runner-207 kernel: [ 103.588634] lxdbr0: port 1(tap739d0433) entered forwarding state Aug 22 05:25:43 juju-e4d256-prod-github-runner-207 kernel: [ 117.132909] BUG: kernel NULL pointer dereference, address: 0000000000000008 Aug 22 05:25:43 juju-e4d256-prod-github-runner-207 kernel: [ 117.133529] #PF: supervisor write access in kernel mode Aug 22 05:25:43 juju-e4d256-prod-github-runner-207 kernel: [ 117.133968] #PF: error_code(0x0002) - not-present page Aug 22 05:25:43 juju-e4d256-prod-github-runner-207 kernel: [ 117.134383] PGD 0 P4D 0 Aug 22 05:25:43 juju-e4d256-prod-github-runner-207 kernel: [ 117.134570] Oops: 0002 [#1] SMP NOPTI Aug 22 05:25:43 juju-e4d256-prod-github-runner-207 kernel: [ 117.134810] CPU: 0 PID: 6720 Comm: qemu-system-x86 Tainted: P O 5.15.0-83-generic #92-Ubuntu Aug 22 05:25:43 juju-e4d256-prod-github-runner-207 kernel: [ 117.135424] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 05:25:43 juju-e4d256-prod-github-runner-207 kernel: [ 117.135987] RIP: 0010:handle_removed_tdp_mmu_page+0x88/0x280 [kvm] Aug 22 05:25:43 juju-e4d256-prod-github-runner-207 kernel: [ 117.136483] Code: 8b 40 28 83 e3 0f 48 89 45 a8 0f 1f 44 00 00 41 0f b6 c5 89 45 b4 45 84 ed 0f 85 b8 01 00 00 48 8b 7d b8 48 8b 47 08 48 8b 17 <48> 89 42 08 48 89 10 44 0f b6 67 23 48 b8 00 01 00 00 00 00 ad de Aug 22 05:25:43 juju-e4d256-prod-github-runner-207 kernel: [ 117.137696] RSP: 0018:ffffa85380c5b7f0 EFLAGS: 00010246 Aug 22 05:25:43 juju-e4d256-prod-github-runner-207 kernel: [ 117.138054] RAX: 0000000000000000 RBX: 0000000000000002 RCX: 000000000000001e Aug 22 05:25:43 juju-e4d256-prod-github-runner-207 kernel: [ 117.138531] RDX: 0000000000000000 RSI: ffff8e4e0cb04000 RDI: ffff8e4e0caf5398 Aug 22 05:25:43 juju-e4d256-prod-github-runner-207 kernel: [ 117.139015] RBP: ffffa85380c5b858 R08: 0000000000000000 R09: 0000000000000003 Aug 22 05:25:43 juju-e4d256-prod-github-runner-207 kernel: [ 117.139488] R10: 000000000cb04800 R11: 0000000000000000 R12: 000000010cb04827 Aug 22 05:25:43 juju-e4d256-prod-github-runner-207 kernel: [ 117.139938] R13: 0000000000000001 R14: ffffa85381781000 R15: 000000010cb04801 Aug 22 05:25:43 juju-e4d256-prod-github-runner-207 kernel: [ 117.140407] FS: 00007fa8515be640(0000) GS:ffff8e5813c00000(0000) knlGS:0000000000000000 Aug 22 05:25:43 juju-e4d256-prod-github-runner-207 kernel: [ 117.140920] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 05:25:43 juju-e4d256-prod-github-runner-207 kernel: [ 117.141286] CR2: 0000000000000008 CR3: 00000001101fa000 CR4: 0000000000350ef0 Aug 22 05:25:43 juju-e4d256-prod-github-runner-207 kernel: [ 117.141744] Call Trace: Aug 22 05:25:43 juju-e4d256-prod-github-runner-207 kernel: [ 117.141909] Aug 22 05:25:43 juju-e4d256-prod-github-runner-207 kernel: [ 117.142063] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 05:25:43 juju-e4d256-prod-github-runner-207 kernel: [ 117.142349] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 05:25:43 juju-e4d256-prod-github-runner-207 kernel: [ 117.142632] ? __handle_changed_spte+0x1bc/0x3f0 [kvm] Aug 22 05:25:43 juju-e4d256-prod-github-runner-207 kernel: [ 117.142997] ? show_regs.part.0+0x23/0x29 Aug 22 05:25:43 juju-e4d256-prod-github-runner-207 kernel: [ 117.143259] ? __die_body.cold+0x8/0xd Aug 22 05:25:43 juju-e4d256-prod-github-runner-207 kernel: [ 117.143505] ? __die+0x2b/0x37 Aug 22 05:25:43 juju-e4d256-prod-github-runner-207 kernel: [ 117.143707] ? page_fault_oops+0x13b/0x170 Aug 22 05:25:43 juju-e4d256-prod-github-runner-207 kernel: [ 117.143974] ? kvm_make_all_cpus_request_except+0xca/0x120 [kvm] Aug 22 05:25:43 juju-e4d256-prod-github-runner-207 kernel: [ 117.144400] ? do_user_addr_fault+0x321/0x670 Aug 22 05:25:43 juju-e4d256-prod-github-runner-207 kernel: [ 117.144701] ? exc_page_fault+0x77/0x170 Aug 22 05:25:43 juju-e4d256-prod-github-runner-207 kernel: [ 117.144986] ? asm_exc_page_fault+0x27/0x30 Aug 22 05:25:43 juju-e4d256-prod-github-runner-207 kernel: [ 117.145292] ? handle_removed_tdp_mmu_page+0x88/0x280 [kvm] Aug 22 05:25:43 juju-e4d256-prod-github-runner-207 kernel: [ 117.145709] __handle_changed_spte+0x1bc/0x3f0 [kvm] Aug 22 05:25:43 juju-e4d256-prod-github-runner-207 kernel: [ 117.146086] ? update_load_avg+0x82/0x620 Aug 22 05:25:43 juju-e4d256-prod-github-runner-207 kernel: [ 117.146375] handle_removed_tdp_mmu_page+0x138/0x280 [kvm] Aug 22 05:25:43 juju-e4d256-prod-github-runner-207 kernel: [ 117.146787] __handle_changed_spte+0x1bc/0x3f0 [kvm] Aug 22 05:25:43 juju-e4d256-prod-github-runner-207 kernel: [ 117.147166] ? psi_task_switch+0xc6/0x220 Aug 22 05:25:43 juju-e4d256-prod-github-runner-207 kernel: [ 117.147455] ? tdp_iter_refresh_sptep+0x90/0x90 [kvm] Aug 22 05:25:43 juju-e4d256-prod-github-runner-207 kernel: [ 117.147891] zap_gfn_range+0x216/0x360 [kvm] Aug 22 05:25:43 juju-e4d256-prod-github-runner-207 kernel: [ 117.148235] ? __traceiter_kvm_test_age_hva+0x40/0x40 [kvm] Aug 22 05:25:43 juju-e4d256-prod-github-runner-207 kernel: [ 117.148647] kvm_tdp_mmu_zap_invalidated_roots+0x5b/0xb0 [kvm] Aug 22 05:25:43 juju-e4d256-prod-github-runner-207 kernel: [ 117.149076] kvm_mmu_zap_all_fast+0x18e/0x1c0 [kvm] Aug 22 05:25:43 juju-e4d256-prod-github-runner-207 kernel: [ 117.149451] kvm_mmu_invalidate_zap_pages_in_memslot+0xe/0x20 [kvm] Aug 22 05:25:43 juju-e4d256-prod-github-runner-207 kernel: [ 117.149907] kvm_page_track_flush_slot+0x59/0x90 [kvm] Aug 22 05:25:43 juju-e4d256-prod-github-runner-207 kernel: [ 117.150849] kvm_arch_flush_shadow_memslot+0xe/0x20 [kvm] Aug 22 05:25:43 juju-e4d256-prod-github-runner-207 kernel: [ 117.151813] kvm_set_memslot+0x36f/0x600 [kvm] Aug 22 05:25:43 juju-e4d256-prod-github-runner-207 kernel: [ 117.152897] kvm_delete_memslot+0x65/0x90 [kvm] Aug 22 05:25:43 juju-e4d256-prod-github-runner-207 kernel: [ 117.153756] __kvm_set_memory_region+0x440/0x7c0 [kvm] Aug 22 05:25:43 juju-e4d256-prod-github-runner-207 kernel: [ 117.154633] ? _copy_to_user+0x20/0x30 Aug 22 05:25:43 juju-e4d256-prod-github-runner-207 kernel: [ 117.155396] ? kvm_get_dirty_log_protect+0x1de/0x290 [kvm] Aug 22 05:25:43 juju-e4d256-prod-github-runner-207 kernel: [ 117.156300] ? __seccomp_filter+0x4a/0x4a0 Aug 22 05:25:43 juju-e4d256-prod-github-runner-207 kernel: [ 117.157090] kvm_vm_ioctl+0x2f6/0x810 [kvm] Aug 22 05:25:43 juju-e4d256-prod-github-runner-207 kernel: [ 117.157907] ? __fget_files+0x86/0xc0 Aug 22 05:25:43 juju-e4d256-prod-github-runner-207 kernel: [ 117.158645] __x64_sys_ioctl+0x95/0xd0 Aug 22 05:25:43 juju-e4d256-prod-github-runner-207 kernel: [ 117.159376] do_syscall_64+0x5c/0xc0 Aug 22 05:25:43 juju-e4d256-prod-github-runner-207 kernel: [ 117.160081] ? irqentry_exit_to_user_mode+0x9/0x20 Aug 22 05:25:43 juju-e4d256-prod-github-runner-207 kernel: [ 117.160858] ? irqentry_exit+0x1d/0x30 Aug 22 05:25:43 juju-e4d256-prod-github-runner-207 kernel: [ 117.161549] ? exc_page_fault+0x89/0x170 Aug 22 05:25:43 juju-e4d256-prod-github-runner-207 kernel: [ 117.162243] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 05:25:43 juju-e4d256-prod-github-runner-207 kernel: [ 117.163007] RIP: 0033:0x7faa5d0edaff Aug 22 05:25:43 juju-e4d256-prod-github-runner-207 kernel: [ 117.163684] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 05:25:43 juju-e4d256-prod-github-runner-207 kernel: [ 117.166045] RSP: 002b:00007fa8515b9ad0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 05:25:43 juju-e4d256-prod-github-runner-207 kernel: [ 117.167015] RAX: ffffffffffffffda RBX: 000000004020ae46 RCX: 00007faa5d0edaff Aug 22 05:25:43 juju-e4d256-prod-github-runner-207 kernel: [ 117.167940] RDX: 00007fa8515b9bf0 RSI: 000000004020ae46 RDI: 0000000000000015 Aug 22 05:25:43 juju-e4d256-prod-github-runner-207 kernel: [ 117.168882] RBP: 00005563cb849af0 R08: 00007fa840d74700 R09: 0000000000000000 Aug 22 05:25:43 juju-e4d256-prod-github-runner-207 kernel: [ 117.169793] R10: 0000000000000000 R11: 0000000000000246 R12: 00007fa8515b9bf0 Aug 22 05:25:43 juju-e4d256-prod-github-runner-207 kernel: [ 117.170709] R13: 0000000000800000 R14: 00005563cd43dad0 R15: 0000000080000000 Aug 22 05:25:43 juju-e4d256-prod-github-runner-207 kernel: [ 117.171629] Aug 22 05:25:43 juju-e4d256-prod-github-runner-207 kernel: [ 117.172267] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 05:25:43 juju-e4d256-prod-github-runner-207 kernel: [ 117.172496] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 05:25:43 juju-e4d256-prod-github-runner-207 kernel: [ 117.184832] CR2: 0000000000000008 Aug 22 05:25:43 juju-e4d256-prod-github-runner-207 kernel: [ 117.185715] ---[ end trace 52ac43d9385d4d0f ]--- Aug 22 05:25:43 juju-e4d256-prod-github-runner-207 kernel: [ 117.186675] RIP: 0010:handle_removed_tdp_mmu_page+0x88/0x280 [kvm] Aug 22 05:25:43 juju-e4d256-prod-github-runner-207 kernel: [ 117.187778] Code: 8b 40 28 83 e3 0f 48 89 45 a8 0f 1f 44 00 00 41 0f b6 c5 89 45 b4 45 84 ed 0f 85 b8 01 00 00 48 8b 7d b8 48 8b 47 08 48 8b 17 <48> 89 42 08 48 89 10 44 0f b6 67 23 48 b8 00 01 00 00 00 00 ad de Aug 22 05:25:43 juju-e4d256-prod-github-runner-207 kernel: [ 117.190328] RSP: 0018:ffffa85380c5b7f0 EFLAGS: 00010246 Aug 22 05:25:43 juju-e4d256-prod-github-runner-207 kernel: [ 117.191361] RAX: 0000000000000000 RBX: 0000000000000002 RCX: 000000000000001e Aug 22 05:25:43 juju-e4d256-prod-github-runner-207 kernel: [ 117.192525] RDX: 0000000000000000 RSI: ffff8e4e0cb04000 RDI: ffff8e4e0caf5398 Aug 22 05:25:43 juju-e4d256-prod-github-runner-207 kernel: [ 117.193677] RBP: ffffa85380c5b858 R08: 0000000000000000 R09: 0000000000000003 Aug 22 05:25:43 juju-e4d256-prod-github-runner-207 kernel: [ 117.194828] R10: 000000000cb04800 R11: 0000000000000000 R12: 000000010cb04827 Aug 22 05:25:43 juju-e4d256-prod-github-runner-207 kernel: [ 117.196228] R13: 0000000000000001 R14: ffffa85381781000 R15: 000000010cb04801 Aug 22 05:25:43 juju-e4d256-prod-github-runner-207 kernel: [ 117.197400] FS: 00007fa8515be640(0000) GS:ffff8e5813c00000(0000) knlGS:0000000000000000 Aug 22 05:25:43 juju-e4d256-prod-github-runner-207 kernel: [ 117.198617] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 05:25:43 juju-e4d256-prod-github-runner-207 kernel: [ 117.199687] CR2: 0000000000000008 CR3: 00000001101fa000 CR4: 0000000000350ef0 Aug 22 05:26:10 juju-e4d256-prod-github-runner-207 kernel: [ 144.541982] watchdog: BUG: soft lockup - CPU#1 stuck for 26s! [qemu-system-x86:6715] Aug 22 05:26:10 juju-e4d256-prod-github-runner-207 kernel: [ 144.544101] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 05:26:10 juju-e4d256-prod-github-runner-207 kernel: [ 144.544353] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 05:26:10 juju-e4d256-prod-github-runner-207 kernel: [ 144.559138] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O 5.15.0-83-generic #92-Ubuntu Aug 22 05:26:10 juju-e4d256-prod-github-runner-207 kernel: [ 144.560719] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 05:26:10 juju-e4d256-prod-github-runner-207 kernel: [ 144.562206] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 05:26:10 juju-e4d256-prod-github-runner-207 kernel: [ 144.563555] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 05:26:10 juju-e4d256-prod-github-runner-207 kernel: [ 144.566788] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 05:26:10 juju-e4d256-prod-github-runner-207 kernel: [ 144.568082] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 05:26:10 juju-e4d256-prod-github-runner-207 kernel: [ 144.569470] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 05:26:10 juju-e4d256-prod-github-runner-207 kernel: [ 144.570846] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 05:26:10 juju-e4d256-prod-github-runner-207 kernel: [ 144.572249] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 05:26:10 juju-e4d256-prod-github-runner-207 kernel: [ 144.573661] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 05:26:10 juju-e4d256-prod-github-runner-207 kernel: [ 144.575311] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 05:26:10 juju-e4d256-prod-github-runner-207 kernel: [ 144.576771] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 05:26:10 juju-e4d256-prod-github-runner-207 kernel: [ 144.578067] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 05:26:10 juju-e4d256-prod-github-runner-207 kernel: [ 144.579432] Call Trace: Aug 22 05:26:10 juju-e4d256-prod-github-runner-207 kernel: [ 144.580506] Aug 22 05:26:10 juju-e4d256-prod-github-runner-207 kernel: [ 144.581564] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 05:26:10 juju-e4d256-prod-github-runner-207 kernel: [ 144.582763] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 05:26:10 juju-e4d256-prod-github-runner-207 kernel: [ 144.583906] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 05:26:10 juju-e4d256-prod-github-runner-207 kernel: [ 144.585090] ? show_regs.part.0+0x23/0x29 Aug 22 05:26:10 juju-e4d256-prod-github-runner-207 kernel: [ 144.586151] ? show_regs.cold+0x8/0xd Aug 22 05:26:10 juju-e4d256-prod-github-runner-207 kernel: [ 144.587168] ? watchdog_timer_fn+0x1be/0x220 Aug 22 05:26:10 juju-e4d256-prod-github-runner-207 kernel: [ 144.588222] ? lockup_detector_update_enable+0x60/0x60 Aug 22 05:26:10 juju-e4d256-prod-github-runner-207 kernel: [ 144.589305] ? __hrtimer_run_queues+0x107/0x230 Aug 22 05:26:10 juju-e4d256-prod-github-runner-207 kernel: [ 144.590372] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 05:26:10 juju-e4d256-prod-github-runner-207 kernel: [ 144.591411] ? hrtimer_interrupt+0x101/0x220 Aug 22 05:26:10 juju-e4d256-prod-github-runner-207 kernel: [ 144.592532] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 05:26:10 juju-e4d256-prod-github-runner-207 kernel: [ 144.593591] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 05:26:10 juju-e4d256-prod-github-runner-207 kernel: [ 144.594676] Aug 22 05:26:10 juju-e4d256-prod-github-runner-207 kernel: [ 144.595537] Aug 22 05:26:10 juju-e4d256-prod-github-runner-207 kernel: [ 144.596391] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 05:26:10 juju-e4d256-prod-github-runner-207 kernel: [ 144.597438] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 05:26:10 juju-e4d256-prod-github-runner-207 kernel: [ 144.598483] ? _raw_spin_lock+0x22/0x30 Aug 22 05:26:10 juju-e4d256-prod-github-runner-207 kernel: [ 144.599437] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 05:26:10 juju-e4d256-prod-github-runner-207 kernel: [ 144.600466] direct_page_fault+0x206/0x310 [kvm] Aug 22 05:26:10 juju-e4d256-prod-github-runner-207 kernel: [ 144.601490] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 05:26:10 juju-e4d256-prod-github-runner-207 kernel: [ 144.602498] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 05:26:10 juju-e4d256-prod-github-runner-207 kernel: [ 144.603503] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 05:26:10 juju-e4d256-prod-github-runner-207 kernel: [ 144.604508] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 05:26:10 juju-e4d256-prod-github-runner-207 kernel: [ 144.605463] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 05:26:10 juju-e4d256-prod-github-runner-207 kernel: [ 144.606446] handle_exit+0x98/0x230 [kvm_amd] Aug 22 05:26:10 juju-e4d256-prod-github-runner-207 kernel: [ 144.607337] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 05:26:10 juju-e4d256-prod-github-runner-207 kernel: [ 144.608315] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 05:26:10 juju-e4d256-prod-github-runner-207 kernel: [ 144.609245] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 05:26:10 juju-e4d256-prod-github-runner-207 kernel: [ 144.610179] vcpu_run+0x62/0x2c0 [kvm] Aug 22 05:26:10 juju-e4d256-prod-github-runner-207 kernel: [ 144.610992] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 05:26:10 juju-e4d256-prod-github-runner-207 kernel: [ 144.611841] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 05:26:10 juju-e4d256-prod-github-runner-207 kernel: [ 144.612714] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 05:26:10 juju-e4d256-prod-github-runner-207 kernel: [ 144.613518] ? __seccomp_filter+0x4a/0x4a0 Aug 22 05:26:10 juju-e4d256-prod-github-runner-207 kernel: [ 144.614263] ? __fget_files+0x86/0xc0 Aug 22 05:26:10 juju-e4d256-prod-github-runner-207 kernel: [ 144.614986] __x64_sys_ioctl+0x95/0xd0 Aug 22 05:26:10 juju-e4d256-prod-github-runner-207 kernel: [ 144.615686] do_syscall_64+0x5c/0xc0 Aug 22 05:26:10 juju-e4d256-prod-github-runner-207 kernel: [ 144.616374] ? do_futex+0x162/0x1f0 Aug 22 05:26:10 juju-e4d256-prod-github-runner-207 kernel: [ 144.617022] ? __x64_sys_futex+0x78/0x1e0 Aug 22 05:26:10 juju-e4d256-prod-github-runner-207 kernel: [ 144.617696] ? __secure_computing+0xa9/0x120 Aug 22 05:26:10 juju-e4d256-prod-github-runner-207 kernel: [ 144.618385] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 05:26:10 juju-e4d256-prod-github-runner-207 kernel: [ 144.619142] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:26:10 juju-e4d256-prod-github-runner-207 kernel: [ 144.620761] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:26:10 juju-e4d256-prod-github-runner-207 kernel: [ 144.621508] ? do_syscall_64+0x69/0xc0 Aug 22 05:26:10 juju-e4d256-prod-github-runner-207 kernel: [ 144.622158] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:26:10 juju-e4d256-prod-github-runner-207 kernel: [ 144.622861] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:26:10 juju-e4d256-prod-github-runner-207 kernel: [ 144.623557] ? do_syscall_64+0x69/0xc0 Aug 22 05:26:10 juju-e4d256-prod-github-runner-207 kernel: [ 144.624190] ? do_syscall_64+0x69/0xc0 Aug 22 05:26:10 juju-e4d256-prod-github-runner-207 kernel: [ 144.624818] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 05:26:10 juju-e4d256-prod-github-runner-207 kernel: [ 144.625551] RIP: 0033:0x7faa5d0edaff Aug 22 05:26:10 juju-e4d256-prod-github-runner-207 kernel: [ 144.626208] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 05:26:10 juju-e4d256-prod-github-runner-207 kernel: [ 144.628236] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 05:26:10 juju-e4d256-prod-github-runner-207 kernel: [ 144.629160] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 05:26:10 juju-e4d256-prod-github-runner-207 kernel: [ 144.630055] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 05:26:10 juju-e4d256-prod-github-runner-207 kernel: [ 144.630942] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 05:26:10 juju-e4d256-prod-github-runner-207 kernel: [ 144.631849] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 05:26:10 juju-e4d256-prod-github-runner-207 kernel: [ 144.632741] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 05:26:10 juju-e4d256-prod-github-runner-207 kernel: [ 144.633633] Aug 22 05:26:38 juju-e4d256-prod-github-runner-207 kernel: [ 172.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 52s! [qemu-system-x86:6715] Aug 22 05:26:38 juju-e4d256-prod-github-runner-207 kernel: [ 172.543726] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 05:26:38 juju-e4d256-prod-github-runner-207 kernel: [ 172.543952] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 05:26:38 juju-e4d256-prod-github-runner-207 kernel: [ 172.556348] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 05:26:38 juju-e4d256-prod-github-runner-207 kernel: [ 172.557620] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 05:26:38 juju-e4d256-prod-github-runner-207 kernel: [ 172.559207] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 05:26:38 juju-e4d256-prod-github-runner-207 kernel: [ 172.560676] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 05:26:38 juju-e4d256-prod-github-runner-207 kernel: [ 172.563487] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 05:26:38 juju-e4d256-prod-github-runner-207 kernel: [ 172.564538] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 05:26:38 juju-e4d256-prod-github-runner-207 kernel: [ 172.565700] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 05:26:38 juju-e4d256-prod-github-runner-207 kernel: [ 172.566873] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 05:26:38 juju-e4d256-prod-github-runner-207 kernel: [ 172.568557] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 05:26:38 juju-e4d256-prod-github-runner-207 kernel: [ 172.569885] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 05:26:38 juju-e4d256-prod-github-runner-207 kernel: [ 172.571201] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 05:26:38 juju-e4d256-prod-github-runner-207 kernel: [ 172.572934] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 05:26:38 juju-e4d256-prod-github-runner-207 kernel: [ 172.574250] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 05:26:38 juju-e4d256-prod-github-runner-207 kernel: [ 172.575760] Call Trace: Aug 22 05:26:38 juju-e4d256-prod-github-runner-207 kernel: [ 172.576822] Aug 22 05:26:38 juju-e4d256-prod-github-runner-207 kernel: [ 172.577795] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 05:26:38 juju-e4d256-prod-github-runner-207 kernel: [ 172.578876] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 05:26:38 juju-e4d256-prod-github-runner-207 kernel: [ 172.580143] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 05:26:38 juju-e4d256-prod-github-runner-207 kernel: [ 172.581247] ? show_regs.part.0+0x23/0x29 Aug 22 05:26:38 juju-e4d256-prod-github-runner-207 kernel: [ 172.582332] ? show_regs.cold+0x8/0xd Aug 22 05:26:38 juju-e4d256-prod-github-runner-207 kernel: [ 172.583385] ? watchdog_timer_fn+0x1be/0x220 Aug 22 05:26:38 juju-e4d256-prod-github-runner-207 kernel: [ 172.584430] ? lockup_detector_update_enable+0x60/0x60 Aug 22 05:26:38 juju-e4d256-prod-github-runner-207 kernel: [ 172.585506] ? __hrtimer_run_queues+0x107/0x230 Aug 22 05:26:38 juju-e4d256-prod-github-runner-207 kernel: [ 172.586548] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 05:26:38 juju-e4d256-prod-github-runner-207 kernel: [ 172.587587] ? hrtimer_interrupt+0x101/0x220 Aug 22 05:26:38 juju-e4d256-prod-github-runner-207 kernel: [ 172.588601] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 05:26:38 juju-e4d256-prod-github-runner-207 kernel: [ 172.589672] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 05:26:38 juju-e4d256-prod-github-runner-207 kernel: [ 172.590719] Aug 22 05:26:38 juju-e4d256-prod-github-runner-207 kernel: [ 172.591579] Aug 22 05:26:38 juju-e4d256-prod-github-runner-207 kernel: [ 172.592420] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 05:26:38 juju-e4d256-prod-github-runner-207 kernel: [ 172.593457] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 05:26:38 juju-e4d256-prod-github-runner-207 kernel: [ 172.594494] ? _raw_spin_lock+0x22/0x30 Aug 22 05:26:38 juju-e4d256-prod-github-runner-207 kernel: [ 172.595443] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 05:26:38 juju-e4d256-prod-github-runner-207 kernel: [ 172.596482] direct_page_fault+0x206/0x310 [kvm] Aug 22 05:26:38 juju-e4d256-prod-github-runner-207 kernel: [ 172.597649] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 05:26:38 juju-e4d256-prod-github-runner-207 kernel: [ 172.598836] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 05:26:38 juju-e4d256-prod-github-runner-207 kernel: [ 172.599848] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 05:26:38 juju-e4d256-prod-github-runner-207 kernel: [ 172.600880] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 05:26:38 juju-e4d256-prod-github-runner-207 kernel: [ 172.601846] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 05:26:38 juju-e4d256-prod-github-runner-207 kernel: [ 172.602826] handle_exit+0x98/0x230 [kvm_amd] Aug 22 05:26:38 juju-e4d256-prod-github-runner-207 kernel: [ 172.603758] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 05:26:38 juju-e4d256-prod-github-runner-207 kernel: [ 172.604681] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 05:26:38 juju-e4d256-prod-github-runner-207 kernel: [ 172.605604] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 05:26:38 juju-e4d256-prod-github-runner-207 kernel: [ 172.606507] vcpu_run+0x62/0x2c0 [kvm] Aug 22 05:26:38 juju-e4d256-prod-github-runner-207 kernel: [ 172.607466] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 05:26:38 juju-e4d256-prod-github-runner-207 kernel: [ 172.608303] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 05:26:38 juju-e4d256-prod-github-runner-207 kernel: [ 172.609166] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 05:26:38 juju-e4d256-prod-github-runner-207 kernel: [ 172.609963] ? __seccomp_filter+0x4a/0x4a0 Aug 22 05:26:38 juju-e4d256-prod-github-runner-207 kernel: [ 172.610706] ? __fget_files+0x86/0xc0 Aug 22 05:26:38 juju-e4d256-prod-github-runner-207 kernel: [ 172.611413] __x64_sys_ioctl+0x95/0xd0 Aug 22 05:26:38 juju-e4d256-prod-github-runner-207 kernel: [ 172.612182] do_syscall_64+0x5c/0xc0 Aug 22 05:26:38 juju-e4d256-prod-github-runner-207 kernel: [ 172.612851] ? do_futex+0x162/0x1f0 Aug 22 05:26:38 juju-e4d256-prod-github-runner-207 kernel: [ 172.613500] ? __x64_sys_futex+0x78/0x1e0 Aug 22 05:26:38 juju-e4d256-prod-github-runner-207 kernel: [ 172.614193] ? __secure_computing+0xa9/0x120 Aug 22 05:26:38 juju-e4d256-prod-github-runner-207 kernel: [ 172.614895] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 05:26:38 juju-e4d256-prod-github-runner-207 kernel: [ 172.615677] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:26:38 juju-e4d256-prod-github-runner-207 kernel: [ 172.616401] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:26:38 juju-e4d256-prod-github-runner-207 kernel: [ 172.617123] ? do_syscall_64+0x69/0xc0 Aug 22 05:26:38 juju-e4d256-prod-github-runner-207 kernel: [ 172.617768] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:26:38 juju-e4d256-prod-github-runner-207 kernel: [ 172.618470] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:26:38 juju-e4d256-prod-github-runner-207 kernel: [ 172.619168] ? do_syscall_64+0x69/0xc0 Aug 22 05:26:38 juju-e4d256-prod-github-runner-207 kernel: [ 172.619804] ? do_syscall_64+0x69/0xc0 Aug 22 05:26:38 juju-e4d256-prod-github-runner-207 kernel: [ 172.620432] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 05:26:38 juju-e4d256-prod-github-runner-207 kernel: [ 172.621139] RIP: 0033:0x7faa5d0edaff Aug 22 05:26:38 juju-e4d256-prod-github-runner-207 kernel: [ 172.621808] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 05:26:38 juju-e4d256-prod-github-runner-207 kernel: [ 172.623805] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 05:26:38 juju-e4d256-prod-github-runner-207 kernel: [ 172.624724] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 05:26:38 juju-e4d256-prod-github-runner-207 kernel: [ 172.625613] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 05:26:38 juju-e4d256-prod-github-runner-207 kernel: [ 172.626501] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 05:26:38 juju-e4d256-prod-github-runner-207 kernel: [ 172.627389] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 05:26:38 juju-e4d256-prod-github-runner-207 kernel: [ 172.628290] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 05:26:38 juju-e4d256-prod-github-runner-207 kernel: [ 172.629187] Aug 22 05:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 177.200715] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 05:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 177.202455] rcu: 1-....: (14954 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=7307 Aug 22 05:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 177.203794] (t=15000 jiffies g=23269 q=2017) Aug 22 05:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 177.204620] NMI backtrace for cpu 1 Aug 22 05:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 177.205389] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 05:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 177.206691] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 05:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 177.207955] Call Trace: Aug 22 05:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 177.208667] Aug 22 05:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 177.209374] show_stack+0x52/0x5c Aug 22 05:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 177.210112] dump_stack_lvl+0x4a/0x63 Aug 22 05:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 177.210922] dump_stack+0x10/0x16 Aug 22 05:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 177.211752] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 05:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 177.212614] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 05:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 177.213486] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 05:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 177.214389] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 05:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 177.215283] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 05:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 177.216189] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 05:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 177.216997] print_cpu_stall.cold+0x2f/0xe2 Aug 22 05:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 177.217815] ? timekeeping_update+0xf7/0x150 Aug 22 05:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 177.218730] check_cpu_stall+0x109/0x270 Aug 22 05:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 177.219559] rcu_sched_clock_irq+0x9a/0x250 Aug 22 05:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 177.220416] update_process_times+0x94/0xd0 Aug 22 05:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 177.221260] tick_sched_handle+0x29/0x70 Aug 22 05:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 177.222084] tick_sched_timer+0x8c/0xc0 Aug 22 05:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 177.222999] ? tick_nohz_handler+0xb0/0xb0 Aug 22 05:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 177.224094] __hrtimer_run_queues+0x107/0x230 Aug 22 05:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 177.224968] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 05:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 177.225891] hrtimer_interrupt+0x101/0x220 Aug 22 05:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 177.226666] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 05:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 177.227555] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 05:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 177.228377] Aug 22 05:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 177.229043] Aug 22 05:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 177.229702] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 05:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 177.230599] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 05:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 177.231607] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 05:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 177.233919] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 05:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 177.234798] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 05:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 177.235930] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 05:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 177.236926] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 05:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 177.237899] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 05:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 177.238875] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 05:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 177.239885] ? _raw_spin_lock+0x22/0x30 Aug 22 05:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 177.240745] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 05:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 177.241746] direct_page_fault+0x206/0x310 [kvm] Aug 22 05:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 177.242613] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 05:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 177.243473] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 05:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 177.244307] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 05:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 177.245150] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 05:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 177.245940] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 05:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 177.246849] handle_exit+0x98/0x230 [kvm_amd] Aug 22 05:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 177.247653] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 05:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 177.248454] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 05:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 177.249311] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 05:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 177.250122] vcpu_run+0x62/0x2c0 [kvm] Aug 22 05:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 177.250867] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 05:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 177.251739] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 05:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 177.252572] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 05:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 177.253392] ? __seccomp_filter+0x4a/0x4a0 Aug 22 05:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 177.254182] ? __fget_files+0x86/0xc0 Aug 22 05:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 177.254883] __x64_sys_ioctl+0x95/0xd0 Aug 22 05:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 177.255607] do_syscall_64+0x5c/0xc0 Aug 22 05:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 177.256337] ? do_futex+0x162/0x1f0 Aug 22 05:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 177.257034] ? __x64_sys_futex+0x78/0x1e0 Aug 22 05:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 177.257749] ? __secure_computing+0xa9/0x120 Aug 22 05:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 177.258475] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 05:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 177.259303] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 177.260111] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 177.260873] ? do_syscall_64+0x69/0xc0 Aug 22 05:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 177.261629] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 177.262393] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 177.263157] ? do_syscall_64+0x69/0xc0 Aug 22 05:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 177.263934] ? do_syscall_64+0x69/0xc0 Aug 22 05:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 177.264687] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 05:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 177.265503] RIP: 0033:0x7faa5d0edaff Aug 22 05:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 177.266215] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 05:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 177.268364] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 05:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 177.269334] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 05:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 177.270408] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 05:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 177.271404] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 05:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 177.272371] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 05:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 177.273299] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 05:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 177.274216] Aug 22 05:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 204.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 82s! [qemu-system-x86:6715] Aug 22 05:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 204.543686] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 05:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 204.543908] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 05:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 204.555525] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 05:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 204.556747] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 05:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 204.557926] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 05:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 204.558988] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 05:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 204.561901] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 05:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 204.563097] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 05:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 204.564360] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 05:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 204.565488] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 05:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 204.566620] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 05:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 204.567761] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 05:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 204.568896] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 05:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 204.570097] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 05:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 204.571201] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 05:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 204.572752] Call Trace: Aug 22 05:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 204.573952] Aug 22 05:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 204.575142] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 05:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 204.576318] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 05:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 204.577657] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 05:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 204.578969] ? show_regs.part.0+0x23/0x29 Aug 22 05:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 204.579962] ? show_regs.cold+0x8/0xd Aug 22 05:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 204.581004] ? watchdog_timer_fn+0x1be/0x220 Aug 22 05:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 204.582281] ? lockup_detector_update_enable+0x60/0x60 Aug 22 05:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 204.583727] ? __hrtimer_run_queues+0x107/0x230 Aug 22 05:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 204.585102] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 05:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 204.586412] ? hrtimer_interrupt+0x101/0x220 Aug 22 05:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 204.587770] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 05:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 204.588972] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 05:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 204.590002] Aug 22 05:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 204.590846] Aug 22 05:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 204.591692] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 05:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 204.592702] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 05:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 204.593717] ? _raw_spin_lock+0x22/0x30 Aug 22 05:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 204.594675] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 05:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 204.595976] direct_page_fault+0x206/0x310 [kvm] Aug 22 05:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 204.597243] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 05:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 204.598498] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 05:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 204.599800] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 05:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 204.600829] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 05:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 204.601773] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 05:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 204.602750] handle_exit+0x98/0x230 [kvm_amd] Aug 22 05:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 204.603712] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 05:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 204.604873] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 05:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 204.605829] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 05:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 204.606728] vcpu_run+0x62/0x2c0 [kvm] Aug 22 05:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 204.607548] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 05:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 204.608342] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 05:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 204.609180] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 05:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 204.609961] ? __seccomp_filter+0x4a/0x4a0 Aug 22 05:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 204.610688] ? __fget_files+0x86/0xc0 Aug 22 05:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 204.611396] __x64_sys_ioctl+0x95/0xd0 Aug 22 05:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 204.612140] do_syscall_64+0x5c/0xc0 Aug 22 05:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 204.612791] ? do_futex+0x162/0x1f0 Aug 22 05:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 204.613433] ? __x64_sys_futex+0x78/0x1e0 Aug 22 05:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 204.614091] ? __secure_computing+0xa9/0x120 Aug 22 05:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 204.614765] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 05:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 204.615515] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 204.616220] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 204.616919] ? do_syscall_64+0x69/0xc0 Aug 22 05:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 204.617550] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 204.618235] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 204.618909] ? do_syscall_64+0x69/0xc0 Aug 22 05:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 204.619531] ? do_syscall_64+0x69/0xc0 Aug 22 05:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 204.620140] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 05:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 204.620828] RIP: 0033:0x7faa5d0edaff Aug 22 05:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 204.621464] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 05:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 204.623397] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 05:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 204.624278] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 05:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 204.625138] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 05:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 204.625998] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 05:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 204.626855] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 05:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 204.627836] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 05:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 204.629104] Aug 22 05:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 232.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 108s! [qemu-system-x86:6715] Aug 22 05:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 232.543726] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 05:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 232.543964] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 05:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 232.556162] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 05:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 232.557426] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 05:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 232.558651] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 05:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 232.559725] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 05:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 232.562267] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 05:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 232.563323] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 05:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 232.564491] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 05:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 232.565652] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 05:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 232.566830] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 05:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 232.567997] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 05:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 232.569172] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 05:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 232.570411] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 05:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 232.571525] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 05:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 232.572718] Call Trace: Aug 22 05:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 232.573631] Aug 22 05:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 232.574531] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 05:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 232.575575] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 05:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 232.576597] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 05:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 232.577699] ? show_regs.part.0+0x23/0x29 Aug 22 05:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 232.578703] ? show_regs.cold+0x8/0xd Aug 22 05:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 232.579680] ? watchdog_timer_fn+0x1be/0x220 Aug 22 05:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 232.580688] ? lockup_detector_update_enable+0x60/0x60 Aug 22 05:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 232.581757] ? __hrtimer_run_queues+0x107/0x230 Aug 22 05:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 232.582799] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 05:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 232.583824] ? hrtimer_interrupt+0x101/0x220 Aug 22 05:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 232.584840] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 05:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 232.585912] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 05:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 232.586964] Aug 22 05:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 232.587816] Aug 22 05:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 232.588653] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 05:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 232.589686] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 05:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 232.590741] ? _raw_spin_lock+0x22/0x30 Aug 22 05:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 232.591692] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 05:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 232.592712] direct_page_fault+0x206/0x310 [kvm] Aug 22 05:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 232.593738] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 05:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 232.594762] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 05:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 232.595771] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 05:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 232.596774] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 05:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 232.597721] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 05:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 232.598698] handle_exit+0x98/0x230 [kvm_amd] Aug 22 05:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 232.599668] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 05:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 232.600587] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 05:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 232.601524] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 05:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 232.602432] vcpu_run+0x62/0x2c0 [kvm] Aug 22 05:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 232.603273] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 05:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 232.604091] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 05:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 232.604947] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 05:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 232.605752] ? __seccomp_filter+0x4a/0x4a0 Aug 22 05:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 232.606497] ? __fget_files+0x86/0xc0 Aug 22 05:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 232.607216] __x64_sys_ioctl+0x95/0xd0 Aug 22 05:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 232.607917] do_syscall_64+0x5c/0xc0 Aug 22 05:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 232.608585] ? do_futex+0x162/0x1f0 Aug 22 05:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 232.609238] ? __x64_sys_futex+0x78/0x1e0 Aug 22 05:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 232.609915] ? __secure_computing+0xa9/0x120 Aug 22 05:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 232.610609] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 05:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 232.611386] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 232.612107] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 232.612831] ? do_syscall_64+0x69/0xc0 Aug 22 05:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 232.613477] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 232.614185] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 232.614895] ? do_syscall_64+0x69/0xc0 Aug 22 05:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 232.615526] ? do_syscall_64+0x69/0xc0 Aug 22 05:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 232.616150] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 05:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 232.616861] RIP: 0033:0x7faa5d0edaff Aug 22 05:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 232.617531] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 05:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 232.619541] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 05:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 232.620456] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 05:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 232.621349] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 05:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 232.622240] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 05:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 232.623136] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 05:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 232.624033] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 05:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 232.624929] Aug 22 05:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 260.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 134s! [qemu-system-x86:6715] Aug 22 05:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 260.543686] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 05:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 260.543917] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 05:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 260.555999] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 05:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 260.557261] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 05:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 260.558506] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 05:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 260.559562] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 05:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 260.562119] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 05:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 260.563193] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 05:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 260.564352] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 05:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 260.565513] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 05:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 260.566697] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 05:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 260.567855] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 05:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 260.569031] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 05:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 260.570460] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 05:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 260.571555] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 05:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 260.572748] Call Trace: Aug 22 05:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 260.573664] Aug 22 05:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 260.574576] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 05:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 260.575613] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 05:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 260.576629] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 05:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 260.577722] ? show_regs.part.0+0x23/0x29 Aug 22 05:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 260.578733] ? show_regs.cold+0x8/0xd Aug 22 05:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 260.579703] ? watchdog_timer_fn+0x1be/0x220 Aug 22 05:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 260.580711] ? lockup_detector_update_enable+0x60/0x60 Aug 22 05:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 260.581773] ? __hrtimer_run_queues+0x107/0x230 Aug 22 05:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 260.582807] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 05:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 260.583827] ? hrtimer_interrupt+0x101/0x220 Aug 22 05:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 260.584841] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 05:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 260.585907] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 05:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 260.586974] Aug 22 05:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 260.587830] Aug 22 05:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 260.588666] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 05:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 260.589705] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 05:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 260.590753] ? _raw_spin_lock+0x22/0x30 Aug 22 05:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 260.591695] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 05:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 260.592720] direct_page_fault+0x206/0x310 [kvm] Aug 22 05:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 260.593741] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 05:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 260.594786] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 05:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 260.595787] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 05:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 260.596804] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 05:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 260.597748] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 05:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 260.598742] handle_exit+0x98/0x230 [kvm_amd] Aug 22 05:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 260.599666] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 05:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 260.600578] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 05:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 260.601501] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 05:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 260.602428] vcpu_run+0x62/0x2c0 [kvm] Aug 22 05:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 260.603243] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 05:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 260.604049] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 05:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 260.604901] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 05:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 260.605695] ? __seccomp_filter+0x4a/0x4a0 Aug 22 05:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 260.606451] ? __fget_files+0x86/0xc0 Aug 22 05:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 260.607153] __x64_sys_ioctl+0x95/0xd0 Aug 22 05:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 260.607844] do_syscall_64+0x5c/0xc0 Aug 22 05:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 260.608512] ? do_futex+0x162/0x1f0 Aug 22 05:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 260.609160] ? __x64_sys_futex+0x78/0x1e0 Aug 22 05:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 260.609833] ? __secure_computing+0xa9/0x120 Aug 22 05:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 260.610537] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 05:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 260.611301] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 260.612021] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 260.612736] ? do_syscall_64+0x69/0xc0 Aug 22 05:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 260.613380] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 260.614081] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 260.614786] ? do_syscall_64+0x69/0xc0 Aug 22 05:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 260.615414] ? do_syscall_64+0x69/0xc0 Aug 22 05:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 260.616034] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 05:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 260.616735] RIP: 0033:0x7faa5d0edaff Aug 22 05:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 260.617370] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 05:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 260.619362] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 05:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 260.620267] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 05:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 260.621155] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 05:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 260.622047] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 05:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 260.622948] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 05:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 260.623836] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 05:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 260.624728] Aug 22 05:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 288.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 160s! [qemu-system-x86:6715] Aug 22 05:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 288.543742] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 05:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 288.543983] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 05:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 288.556441] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 05:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 288.557728] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 05:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 288.558985] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 05:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 288.560063] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 05:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 288.562750] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 05:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 288.563804] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 05:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 288.564976] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 05:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 288.566174] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 05:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 288.567343] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 05:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 288.568524] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 05:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 288.569723] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 05:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 288.570996] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 05:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 288.572103] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 05:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 288.573340] Call Trace: Aug 22 05:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 288.574274] Aug 22 05:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 288.575168] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 05:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 288.576202] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 05:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 288.577230] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 05:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 288.578343] ? show_regs.part.0+0x23/0x29 Aug 22 05:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 288.579370] ? show_regs.cold+0x8/0xd Aug 22 05:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 288.580367] ? watchdog_timer_fn+0x1be/0x220 Aug 22 05:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 288.581385] ? lockup_detector_update_enable+0x60/0x60 Aug 22 05:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 288.582464] ? __hrtimer_run_queues+0x107/0x230 Aug 22 05:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 288.583499] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 05:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 288.584533] ? hrtimer_interrupt+0x101/0x220 Aug 22 05:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 288.585556] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 05:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 288.586640] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 05:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 288.587694] Aug 22 05:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 288.588551] Aug 22 05:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 288.589391] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 05:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 288.590490] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 05:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 288.591560] ? _raw_spin_lock+0x22/0x30 Aug 22 05:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 288.592515] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 05:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 288.593538] direct_page_fault+0x206/0x310 [kvm] Aug 22 05:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 288.594586] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 05:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 288.595609] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 05:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 288.596637] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 05:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 288.597642] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 05:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 288.598608] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 05:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 288.599594] handle_exit+0x98/0x230 [kvm_amd] Aug 22 05:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 288.600526] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 05:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 288.601476] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 05:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 288.602432] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 05:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 288.603348] vcpu_run+0x62/0x2c0 [kvm] Aug 22 05:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 288.604167] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 05:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 288.604982] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 05:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 288.605843] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 05:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 288.606673] ? __seccomp_filter+0x4a/0x4a0 Aug 22 05:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 288.607420] ? __fget_files+0x86/0xc0 Aug 22 05:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 288.608149] __x64_sys_ioctl+0x95/0xd0 Aug 22 05:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 288.608860] do_syscall_64+0x5c/0xc0 Aug 22 05:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 288.609538] ? do_futex+0x162/0x1f0 Aug 22 05:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 288.610203] ? __x64_sys_futex+0x78/0x1e0 Aug 22 05:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 288.610978] ? __secure_computing+0xa9/0x120 Aug 22 05:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 288.611680] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 05:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 288.612451] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 288.613254] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 288.613976] ? do_syscall_64+0x69/0xc0 Aug 22 05:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 288.614643] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 288.615351] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 288.616053] ? do_syscall_64+0x69/0xc0 Aug 22 05:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 288.616687] ? do_syscall_64+0x69/0xc0 Aug 22 05:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 288.617317] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 05:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 288.618027] RIP: 0033:0x7faa5d0edaff Aug 22 05:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 288.618695] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 05:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 288.620733] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 05:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 288.621711] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 05:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 288.622698] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 05:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 288.623605] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 05:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 288.624505] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 05:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 288.625408] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 05:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 288.626320] Aug 22 05:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 316.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 186s! [qemu-system-x86:6715] Aug 22 05:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 316.543711] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 05:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 316.543954] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 05:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 316.556008] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 05:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 316.557264] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 05:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 316.558494] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 05:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 316.559546] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 05:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 316.562248] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 05:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 316.563289] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 05:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 316.564452] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 05:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 316.565608] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 05:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 316.566770] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 05:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 316.567934] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 05:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 316.569098] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 05:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 316.570338] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 05:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 316.571433] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 05:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 316.572632] Call Trace: Aug 22 05:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 316.573542] Aug 22 05:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 316.574440] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 05:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 316.575466] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 05:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 316.576484] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 05:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 316.577571] ? show_regs.part.0+0x23/0x29 Aug 22 05:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 316.578584] ? show_regs.cold+0x8/0xd Aug 22 05:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 316.579560] ? watchdog_timer_fn+0x1be/0x220 Aug 22 05:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 316.580564] ? lockup_detector_update_enable+0x60/0x60 Aug 22 05:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 316.581623] ? __hrtimer_run_queues+0x107/0x230 Aug 22 05:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 316.582657] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 05:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 316.583677] ? hrtimer_interrupt+0x101/0x220 Aug 22 05:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 316.584687] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 05:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 316.585769] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 05:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 316.586810] Aug 22 05:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 316.587659] Aug 22 05:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 316.588498] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 05:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 316.589527] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 05:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 316.590572] ? _raw_spin_lock+0x22/0x30 Aug 22 05:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 316.591517] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 05:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 316.592526] direct_page_fault+0x206/0x310 [kvm] Aug 22 05:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 316.593547] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 05:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 316.594702] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 05:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 316.595729] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 05:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 316.596840] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 05:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 316.597807] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 05:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 316.598788] handle_exit+0x98/0x230 [kvm_amd] Aug 22 05:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 316.599680] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 05:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 316.600593] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 05:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 316.601520] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 05:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 316.602427] vcpu_run+0x62/0x2c0 [kvm] Aug 22 05:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 316.603241] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 05:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 316.604046] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 05:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 316.604902] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 05:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 316.605706] ? __seccomp_filter+0x4a/0x4a0 Aug 22 05:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 316.606446] ? __fget_files+0x86/0xc0 Aug 22 05:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 316.607148] __x64_sys_ioctl+0x95/0xd0 Aug 22 05:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 316.607841] do_syscall_64+0x5c/0xc0 Aug 22 05:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 316.608517] ? do_futex+0x162/0x1f0 Aug 22 05:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 316.609175] ? __x64_sys_futex+0x78/0x1e0 Aug 22 05:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 316.609862] ? __secure_computing+0xa9/0x120 Aug 22 05:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 316.610555] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 05:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 316.611313] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 316.612101] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 316.612863] ? do_syscall_64+0x69/0xc0 Aug 22 05:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 316.613537] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 316.614248] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 316.614947] ? do_syscall_64+0x69/0xc0 Aug 22 05:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 316.615569] ? do_syscall_64+0x69/0xc0 Aug 22 05:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 316.616189] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 05:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 316.616892] RIP: 0033:0x7faa5d0edaff Aug 22 05:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 316.617548] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 05:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 316.619543] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 05:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 316.620453] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 05:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 316.621346] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 05:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 316.622250] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 05:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 316.623136] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 05:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 316.624024] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 05:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 316.624914] Aug 22 05:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 344.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 212s! [qemu-system-x86:6715] Aug 22 05:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 344.543717] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 05:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 344.543968] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 05:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 344.556205] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 05:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 344.557482] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 05:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 344.558712] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 05:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 344.559780] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 05:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 344.562330] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 05:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 344.563367] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 05:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 344.564539] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 05:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 344.565718] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 05:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 344.566907] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 05:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 344.568093] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 05:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 344.569289] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 05:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 344.570546] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 05:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 344.571690] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 05:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 344.572879] Call Trace: Aug 22 05:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 344.573816] Aug 22 05:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 344.574710] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 05:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 344.575744] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 05:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 344.576771] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 05:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 344.577895] ? show_regs.part.0+0x23/0x29 Aug 22 05:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 344.578889] ? show_regs.cold+0x8/0xd Aug 22 05:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 344.579858] ? watchdog_timer_fn+0x1be/0x220 Aug 22 05:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 344.580867] ? lockup_detector_update_enable+0x60/0x60 Aug 22 05:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 344.581950] ? __hrtimer_run_queues+0x107/0x230 Aug 22 05:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 344.582989] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 05:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 344.584029] ? hrtimer_interrupt+0x101/0x220 Aug 22 05:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 344.585059] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 05:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 344.586150] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 05:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 344.587192] Aug 22 05:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 344.588047] Aug 22 05:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 344.588885] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 05:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 344.589928] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 05:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 344.590968] ? _raw_spin_lock+0x22/0x30 Aug 22 05:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 344.591924] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 05:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 344.592959] direct_page_fault+0x206/0x310 [kvm] Aug 22 05:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 344.594016] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 05:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 344.595028] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 05:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 344.596024] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 05:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 344.597018] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 05:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 344.597970] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 05:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 344.598951] handle_exit+0x98/0x230 [kvm_amd] Aug 22 05:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 344.599854] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 05:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 344.600765] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 05:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 344.601697] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 05:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 344.602597] vcpu_run+0x62/0x2c0 [kvm] Aug 22 05:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 344.603408] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 05:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 344.604211] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 05:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 344.605060] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 05:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 344.606761] ? __seccomp_filter+0x4a/0x4a0 Aug 22 05:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 344.607510] ? __fget_files+0x86/0xc0 Aug 22 05:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 344.608209] __x64_sys_ioctl+0x95/0xd0 Aug 22 05:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 344.608896] do_syscall_64+0x5c/0xc0 Aug 22 05:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 344.609570] ? do_futex+0x162/0x1f0 Aug 22 05:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 344.610216] ? __x64_sys_futex+0x78/0x1e0 Aug 22 05:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 344.610887] ? __secure_computing+0xa9/0x120 Aug 22 05:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 344.611571] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 05:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 344.612325] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 344.613039] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 344.613760] ? do_syscall_64+0x69/0xc0 Aug 22 05:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 344.614401] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 344.615098] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 344.615789] ? do_syscall_64+0x69/0xc0 Aug 22 05:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 344.616409] ? do_syscall_64+0x69/0xc0 Aug 22 05:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 344.617026] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 05:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 344.617733] RIP: 0033:0x7faa5d0edaff Aug 22 05:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 344.618390] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 05:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 344.620398] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 05:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 344.621310] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 05:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 344.622213] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 05:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 344.623093] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 05:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 344.623976] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 05:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 344.624855] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 05:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 344.625749] Aug 22 05:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 357.212705] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 05:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 357.213674] rcu: 1-....: (59817 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=29174 Aug 22 05:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 357.214775] (t=60003 jiffies g=23269 q=3076) Aug 22 05:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 357.215537] NMI backtrace for cpu 1 Aug 22 05:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 357.216242] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 05:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 357.217360] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 05:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 357.218418] Call Trace: Aug 22 05:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 357.219088] Aug 22 05:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 357.219728] show_stack+0x52/0x5c Aug 22 05:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 357.220448] dump_stack_lvl+0x4a/0x63 Aug 22 05:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 357.221194] dump_stack+0x10/0x16 Aug 22 05:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 357.221922] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 05:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 357.222698] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 05:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 357.223472] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 05:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 357.224292] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 05:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 357.225108] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 05:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 357.225937] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 05:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 357.226705] print_cpu_stall.cold+0x2f/0xe2 Aug 22 05:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 357.227470] ? timekeeping_update+0xf7/0x150 Aug 22 05:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 357.228236] check_cpu_stall+0x109/0x270 Aug 22 05:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 357.228982] rcu_sched_clock_irq+0x9a/0x250 Aug 22 05:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 357.229756] update_process_times+0x94/0xd0 Aug 22 05:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 357.230516] tick_sched_handle+0x29/0x70 Aug 22 05:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 357.231258] tick_sched_timer+0x8c/0xc0 Aug 22 05:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 357.231990] ? tick_nohz_handler+0xb0/0xb0 Aug 22 05:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 357.232738] __hrtimer_run_queues+0x107/0x230 Aug 22 05:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 357.233557] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 05:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 357.234363] hrtimer_interrupt+0x101/0x220 Aug 22 05:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 357.235121] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 05:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 357.235926] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 05:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 357.236722] Aug 22 05:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 357.237368] Aug 22 05:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 357.237992] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 05:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 357.238804] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 05:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 357.239675] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 05:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 357.241882] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 05:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 357.242750] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 05:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 357.243734] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 05:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 357.244702] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 05:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 357.245672] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 05:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 357.246623] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 05:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 357.247568] ? _raw_spin_lock+0x22/0x30 Aug 22 05:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 357.248321] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 05:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 357.249151] direct_page_fault+0x206/0x310 [kvm] Aug 22 05:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 357.249993] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 05:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 357.250817] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 05:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 357.251634] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 05:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 357.252437] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 05:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 357.253238] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 05:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 357.254065] handle_exit+0x98/0x230 [kvm_amd] Aug 22 05:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 357.254817] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 05:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 357.255603] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 05:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 357.256399] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 05:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 357.257181] vcpu_run+0x62/0x2c0 [kvm] Aug 22 05:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 357.257926] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 05:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 357.258657] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 05:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 357.259459] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 05:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 357.260217] ? __seccomp_filter+0x4a/0x4a0 Aug 22 05:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 357.260934] ? __fget_files+0x86/0xc0 Aug 22 05:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 357.261637] __x64_sys_ioctl+0x95/0xd0 Aug 22 05:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 357.262335] do_syscall_64+0x5c/0xc0 Aug 22 05:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 357.263013] ? do_futex+0x162/0x1f0 Aug 22 05:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 357.263682] ? __x64_sys_futex+0x78/0x1e0 Aug 22 05:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 357.264380] ? __secure_computing+0xa9/0x120 Aug 22 05:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 357.265098] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 05:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 357.265899] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 357.266651] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 357.267402] ? do_syscall_64+0x69/0xc0 Aug 22 05:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 357.268094] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 357.268846] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 357.269614] ? do_syscall_64+0x69/0xc0 Aug 22 05:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 357.270310] ? do_syscall_64+0x69/0xc0 Aug 22 05:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 357.270999] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 05:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 357.271765] RIP: 0033:0x7faa5d0edaff Aug 22 05:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 357.272446] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 05:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 357.274547] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 05:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 357.275503] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 05:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 357.276520] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 05:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 357.277473] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 05:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 357.278412] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 05:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 357.279333] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 05:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 357.280243] Aug 22 05:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 384.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 250s! [qemu-system-x86:6715] Aug 22 05:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 384.543189] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 05:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 384.543413] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 05:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 384.555611] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 05:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 384.556896] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 05:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 384.558123] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 05:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 384.559175] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 05:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 384.561723] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 05:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 384.562765] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 05:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 384.563923] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 05:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 384.565091] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 05:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 384.566248] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 05:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 384.567410] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 05:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 384.568572] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 05:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 384.569818] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 05:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 384.570913] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 05:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 384.572102] Call Trace: Aug 22 05:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 384.573028] Aug 22 05:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 384.573912] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 05:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 384.574936] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 05:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 384.575953] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 05:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 384.577061] ? show_regs.part.0+0x23/0x29 Aug 22 05:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 384.578057] ? show_regs.cold+0x8/0xd Aug 22 05:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 384.579027] ? watchdog_timer_fn+0x1be/0x220 Aug 22 05:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 384.580032] ? lockup_detector_update_enable+0x60/0x60 Aug 22 05:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 384.581102] ? __hrtimer_run_queues+0x107/0x230 Aug 22 05:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 384.582129] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 05:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 384.583154] ? hrtimer_interrupt+0x101/0x220 Aug 22 05:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 384.584167] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 05:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 384.585245] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 05:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 384.586288] Aug 22 05:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 384.587138] Aug 22 05:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 384.587973] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 05:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 384.589036] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 05:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 384.590072] ? _raw_spin_lock+0x22/0x30 Aug 22 05:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 384.591014] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 05:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 384.592030] direct_page_fault+0x206/0x310 [kvm] Aug 22 05:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 384.593063] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 05:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 384.594079] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 05:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 384.595081] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 05:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 384.596067] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 05:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 384.597021] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 05:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 384.598001] handle_exit+0x98/0x230 [kvm_amd] Aug 22 05:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 384.598895] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 05:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 384.599806] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 05:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 384.600725] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 05:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 384.601645] vcpu_run+0x62/0x2c0 [kvm] Aug 22 05:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 384.602452] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 05:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 384.603261] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 05:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 384.604115] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 05:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 384.604924] ? __seccomp_filter+0x4a/0x4a0 Aug 22 05:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 384.605663] ? __fget_files+0x86/0xc0 Aug 22 05:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 384.606364] __x64_sys_ioctl+0x95/0xd0 Aug 22 05:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 384.607053] do_syscall_64+0x5c/0xc0 Aug 22 05:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 384.607715] ? do_futex+0x162/0x1f0 Aug 22 05:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 384.608367] ? __x64_sys_futex+0x78/0x1e0 Aug 22 05:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 384.609052] ? __secure_computing+0xa9/0x120 Aug 22 05:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 384.609739] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 05:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 384.610495] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 384.611218] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 384.611933] ? do_syscall_64+0x69/0xc0 Aug 22 05:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 384.612575] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 384.613293] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 384.613987] ? do_syscall_64+0x69/0xc0 Aug 22 05:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 384.614614] ? do_syscall_64+0x69/0xc0 Aug 22 05:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 384.615232] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 05:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 384.615933] RIP: 0033:0x7faa5d0edaff Aug 22 05:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 384.616578] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 05:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 384.618572] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 05:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 384.619493] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 05:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 384.620383] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 05:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 384.621283] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 05:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 384.622171] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 05:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 384.623057] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 05:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 384.623947] Aug 22 05:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 412.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 276s! [qemu-system-x86:6715] Aug 22 05:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 412.543690] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 05:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 412.543857] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 05:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 412.556005] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 05:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 412.557283] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 05:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 412.558519] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 05:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 412.559578] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 05:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 412.562134] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 05:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 412.563174] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 05:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 412.564334] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 05:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 412.565507] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 05:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 412.566665] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 05:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 412.567823] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 05:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 412.569009] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 05:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 412.570249] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 05:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 412.571349] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 05:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 412.572559] Call Trace: Aug 22 05:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 412.573470] Aug 22 05:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 412.574377] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 05:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 412.575407] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 05:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 412.576427] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 05:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 412.577527] ? show_regs.part.0+0x23/0x29 Aug 22 05:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 412.578521] ? show_regs.cold+0x8/0xd Aug 22 05:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 412.579488] ? watchdog_timer_fn+0x1be/0x220 Aug 22 05:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 412.580492] ? lockup_detector_update_enable+0x60/0x60 Aug 22 05:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 412.581566] ? __hrtimer_run_queues+0x107/0x230 Aug 22 05:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 412.582588] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 05:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 412.583606] ? hrtimer_interrupt+0x101/0x220 Aug 22 05:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 412.584634] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 05:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 412.585705] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 05:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 412.586749] Aug 22 05:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 412.587600] Aug 22 05:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 412.588434] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 05:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 412.589491] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 05:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 412.590530] ? _raw_spin_lock+0x22/0x30 Aug 22 05:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 412.591474] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 05:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 412.592494] direct_page_fault+0x206/0x310 [kvm] Aug 22 05:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 412.593539] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 05:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 412.594546] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 05:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 412.595551] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 05:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 412.596559] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 05:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 412.597510] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 05:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 412.598485] handle_exit+0x98/0x230 [kvm_amd] Aug 22 05:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 412.599375] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 05:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 412.600287] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 05:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 412.601228] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 05:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 412.602133] vcpu_run+0x62/0x2c0 [kvm] Aug 22 05:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 412.602942] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 05:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 412.603753] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 05:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 412.604618] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 05:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 412.605419] ? __seccomp_filter+0x4a/0x4a0 Aug 22 05:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 412.606161] ? __fget_files+0x86/0xc0 Aug 22 05:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 412.606864] __x64_sys_ioctl+0x95/0xd0 Aug 22 05:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 412.607555] do_syscall_64+0x5c/0xc0 Aug 22 05:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 412.608220] ? do_futex+0x162/0x1f0 Aug 22 05:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 412.608882] ? __x64_sys_futex+0x78/0x1e0 Aug 22 05:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 412.609556] ? __secure_computing+0xa9/0x120 Aug 22 05:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 412.610246] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 05:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 412.611014] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 412.611735] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 412.612454] ? do_syscall_64+0x69/0xc0 Aug 22 05:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 412.613130] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 412.613834] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 412.614529] ? do_syscall_64+0x69/0xc0 Aug 22 05:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 412.615154] ? do_syscall_64+0x69/0xc0 Aug 22 05:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 412.615776] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 05:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 412.616485] RIP: 0033:0x7faa5d0edaff Aug 22 05:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 412.617146] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 05:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 412.619288] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 05:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 412.620207] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 05:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 412.621118] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 05:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 412.622008] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 05:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 412.622902] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 05:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 412.623789] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 05:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 412.624693] Aug 22 05:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 440.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 302s! [qemu-system-x86:6715] Aug 22 05:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 440.543116] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 05:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 440.543183] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 05:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 440.555296] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 05:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 440.556622] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 05:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 440.557842] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 05:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 440.558897] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 05:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 440.561520] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 05:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 440.562578] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 05:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 440.563803] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 05:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 440.565180] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 05:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 440.566383] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 05:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 440.567551] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 05:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 440.568725] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 05:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 440.569955] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 05:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 440.571117] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 05:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 440.572340] Call Trace: Aug 22 05:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 440.573252] Aug 22 05:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 440.574138] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 05:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 440.575165] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 05:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 440.576226] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 05:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 440.577326] ? show_regs.part.0+0x23/0x29 Aug 22 05:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 440.578321] ? show_regs.cold+0x8/0xd Aug 22 05:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 440.579290] ? watchdog_timer_fn+0x1be/0x220 Aug 22 05:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 440.580307] ? lockup_detector_update_enable+0x60/0x60 Aug 22 05:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 440.581433] ? __hrtimer_run_queues+0x107/0x230 Aug 22 05:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 440.582618] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 05:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 440.583638] ? hrtimer_interrupt+0x101/0x220 Aug 22 05:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 440.584677] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 05:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 440.585761] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 05:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 440.586861] Aug 22 05:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 440.587723] Aug 22 05:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 440.588578] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 05:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 440.589609] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 05:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 440.590649] ? _raw_spin_lock+0x22/0x30 Aug 22 05:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 440.591643] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 05:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 440.592714] direct_page_fault+0x206/0x310 [kvm] Aug 22 05:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 440.593741] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 05:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 440.594831] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 05:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 440.595981] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 05:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 440.596997] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 05:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 440.597963] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 05:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 440.598940] handle_exit+0x98/0x230 [kvm_amd] Aug 22 05:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 440.599832] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 05:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 440.600763] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 05:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 440.601717] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 05:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 440.602663] vcpu_run+0x62/0x2c0 [kvm] Aug 22 05:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 440.603489] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 05:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 440.604311] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 05:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 440.605169] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 05:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 440.605972] ? __seccomp_filter+0x4a/0x4a0 Aug 22 05:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 440.606723] ? __fget_files+0x86/0xc0 Aug 22 05:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 440.607465] __x64_sys_ioctl+0x95/0xd0 Aug 22 05:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 440.608166] do_syscall_64+0x5c/0xc0 Aug 22 05:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 440.608850] ? do_futex+0x162/0x1f0 Aug 22 05:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 440.609498] ? __x64_sys_futex+0x78/0x1e0 Aug 22 05:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 440.610171] ? __secure_computing+0xa9/0x120 Aug 22 05:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 440.610857] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 05:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 440.611649] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 440.612448] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 440.613192] ? do_syscall_64+0x69/0xc0 Aug 22 05:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 440.613837] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 440.614536] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 440.615230] ? do_syscall_64+0x69/0xc0 Aug 22 05:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 440.615853] ? do_syscall_64+0x69/0xc0 Aug 22 05:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 440.616489] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 05:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 440.617209] RIP: 0033:0x7faa5d0edaff Aug 22 05:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 440.617872] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 05:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 440.619861] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 05:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 440.620786] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 05:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 440.621677] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 05:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 440.622611] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 05:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 440.623522] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 05:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 440.624438] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 05:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 440.625539] Aug 22 05:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 468.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 328s! [qemu-system-x86:6715] Aug 22 05:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 468.543700] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 05:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 468.543957] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 05:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 468.556495] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 05:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 468.557965] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 05:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 468.559348] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 05:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 468.560548] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 05:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 468.563437] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 05:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 468.564596] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 05:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 468.565897] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 05:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 468.567191] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 05:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 468.568503] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 05:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 468.569800] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 05:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 468.571104] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 05:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 468.572512] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 05:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 468.573721] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 05:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 468.575058] Call Trace: Aug 22 05:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 468.576063] Aug 22 05:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 468.577008] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 05:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 468.578133] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 05:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 468.579241] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 05:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 468.580455] ? show_regs.part.0+0x23/0x29 Aug 22 05:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 468.581542] ? show_regs.cold+0x8/0xd Aug 22 05:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 468.582586] ? watchdog_timer_fn+0x1be/0x220 Aug 22 05:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 468.583681] ? lockup_detector_update_enable+0x60/0x60 Aug 22 05:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 468.584869] ? __hrtimer_run_queues+0x107/0x230 Aug 22 05:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 468.585991] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 05:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 468.587102] ? hrtimer_interrupt+0x101/0x220 Aug 22 05:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 468.588222] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 05:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 468.589392] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 05:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 468.590534] Aug 22 05:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 468.591438] Aug 22 05:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 468.592335] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 05:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 468.593476] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 05:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 468.594629] ? _raw_spin_lock+0x22/0x30 Aug 22 05:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 468.595651] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 05:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 468.596778] direct_page_fault+0x206/0x310 [kvm] Aug 22 05:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 468.597897] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 05:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 468.598998] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 05:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 468.600115] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 05:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 468.601219] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 05:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 468.602262] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 05:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 468.603353] handle_exit+0x98/0x230 [kvm_amd] Aug 22 05:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 468.604351] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 05:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 468.605359] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 05:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 468.606379] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 05:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 468.607385] vcpu_run+0x62/0x2c0 [kvm] Aug 22 05:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 468.608293] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 05:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 468.609189] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 05:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 468.610144] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 05:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 468.611031] ? __seccomp_filter+0x4a/0x4a0 Aug 22 05:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 468.611879] ? __fget_files+0x86/0xc0 Aug 22 05:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 468.612664] __x64_sys_ioctl+0x95/0xd0 Aug 22 05:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 468.613440] do_syscall_64+0x5c/0xc0 Aug 22 05:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 468.614183] ? do_futex+0x162/0x1f0 Aug 22 05:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 468.614901] ? __x64_sys_futex+0x78/0x1e0 Aug 22 05:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 468.615657] ? __secure_computing+0xa9/0x120 Aug 22 05:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 468.616461] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 05:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 468.617333] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 468.618150] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 468.618964] ? do_syscall_64+0x69/0xc0 Aug 22 05:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 468.619695] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 468.620518] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 468.621451] ? do_syscall_64+0x69/0xc0 Aug 22 05:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 468.622162] ? do_syscall_64+0x69/0xc0 Aug 22 05:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 468.622861] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 05:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 468.623669] RIP: 0033:0x7faa5d0edaff Aug 22 05:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 468.624561] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 05:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 468.626911] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 05:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 468.627998] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 05:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 468.629033] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 05:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 468.630059] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 05:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 468.631093] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 05:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 468.632147] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 05:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 468.633188] Aug 22 05:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 496.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 354s! [qemu-system-x86:6715] Aug 22 05:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 496.543094] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 05:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 496.543162] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 05:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 496.555670] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 05:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 496.556936] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 05:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 496.558153] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 05:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 496.559211] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 05:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 496.561768] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 05:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 496.562807] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 05:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 496.563974] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 05:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 496.565130] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 05:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 496.566288] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 05:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 496.567446] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 05:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 496.568618] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 05:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 496.569852] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 05:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 496.570945] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 05:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 496.572143] Call Trace: Aug 22 05:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 496.573054] Aug 22 05:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 496.573936] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 05:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 496.574967] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 05:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 496.575996] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 05:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 496.577070] ? show_regs.part.0+0x23/0x29 Aug 22 05:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 496.578065] ? show_regs.cold+0x8/0xd Aug 22 05:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 496.579033] ? watchdog_timer_fn+0x1be/0x220 Aug 22 05:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 496.580051] ? lockup_detector_update_enable+0x60/0x60 Aug 22 05:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 496.581121] ? __hrtimer_run_queues+0x107/0x230 Aug 22 05:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 496.582153] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 05:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 496.583172] ? hrtimer_interrupt+0x101/0x220 Aug 22 05:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 496.584190] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 05:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 496.585253] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 05:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 496.586294] Aug 22 05:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 496.587143] Aug 22 05:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 496.587988] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 05:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 496.589022] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 05:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 496.590054] ? _raw_spin_lock+0x22/0x30 Aug 22 05:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 496.590998] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 05:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 496.592026] direct_page_fault+0x206/0x310 [kvm] Aug 22 05:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 496.593184] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 05:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 496.594187] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 05:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 496.595182] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 05:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 496.596153] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 05:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 496.597094] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 05:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 496.598073] handle_exit+0x98/0x230 [kvm_amd] Aug 22 05:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 496.598963] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 05:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 496.599879] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 05:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 496.600798] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 05:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 496.601695] vcpu_run+0x62/0x2c0 [kvm] Aug 22 05:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 496.602500] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 05:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 496.603303] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 05:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 496.604168] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 05:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 496.604959] ? __seccomp_filter+0x4a/0x4a0 Aug 22 05:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 496.605697] ? __fget_files+0x86/0xc0 Aug 22 05:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 496.606397] __x64_sys_ioctl+0x95/0xd0 Aug 22 05:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 496.607084] do_syscall_64+0x5c/0xc0 Aug 22 05:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 496.607751] ? do_futex+0x162/0x1f0 Aug 22 05:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 496.608396] ? __x64_sys_futex+0x78/0x1e0 Aug 22 05:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 496.609065] ? __secure_computing+0xa9/0x120 Aug 22 05:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 496.609754] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 05:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 496.610512] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 496.611229] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 496.611956] ? do_syscall_64+0x69/0xc0 Aug 22 05:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 496.612603] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 496.613301] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 496.613989] ? do_syscall_64+0x69/0xc0 Aug 22 05:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 496.614608] ? do_syscall_64+0x69/0xc0 Aug 22 05:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 496.615225] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 05:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 496.615937] RIP: 0033:0x7faa5d0edaff Aug 22 05:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 496.616560] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 05:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 496.618525] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 05:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 496.619433] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 05:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 496.620329] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 05:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 496.621213] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 05:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 496.622098] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 05:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 496.622985] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 05:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 496.623881] Aug 22 05:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 524.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 380s! [qemu-system-x86:6715] Aug 22 05:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 524.543757] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 05:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 524.544017] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 05:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 524.556705] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 05:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 524.557975] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 05:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 524.559207] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 05:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 524.560261] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 05:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 524.562814] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 05:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 524.563865] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 05:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 524.565044] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 05:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 524.566211] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 05:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 524.567387] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 05:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 524.568566] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 05:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 524.569756] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 05:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 524.570998] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 05:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 524.572116] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 05:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 524.573312] Call Trace: Aug 22 05:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 524.574226] Aug 22 05:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 524.575125] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 05:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 524.576203] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 05:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 524.577252] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 05:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 524.578351] ? show_regs.part.0+0x23/0x29 Aug 22 05:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 524.579362] ? show_regs.cold+0x8/0xd Aug 22 05:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 524.580354] ? watchdog_timer_fn+0x1be/0x220 Aug 22 05:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 524.581376] ? lockup_detector_update_enable+0x60/0x60 Aug 22 05:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 524.582437] ? __hrtimer_run_queues+0x107/0x230 Aug 22 05:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 524.583491] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 05:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 524.584525] ? hrtimer_interrupt+0x101/0x220 Aug 22 05:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 524.585548] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 05:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 524.586644] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 05:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 524.587708] Aug 22 05:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 524.588566] Aug 22 05:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 524.589401] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 05:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 524.590445] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 05:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 524.591494] ? _raw_spin_lock+0x22/0x30 Aug 22 05:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 524.592527] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 05:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 524.593545] direct_page_fault+0x206/0x310 [kvm] Aug 22 05:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 524.594566] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 05:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 524.595584] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 05:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 524.596596] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 05:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 524.597607] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 05:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 524.598553] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 05:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 524.599539] handle_exit+0x98/0x230 [kvm_amd] Aug 22 05:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 524.600430] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 05:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 524.601344] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 05:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 524.602274] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 05:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 524.603183] vcpu_run+0x62/0x2c0 [kvm] Aug 22 05:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 524.603993] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 05:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 524.604800] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 05:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 524.605654] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 05:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 524.606450] ? __seccomp_filter+0x4a/0x4a0 Aug 22 05:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 524.607225] ? __fget_files+0x86/0xc0 Aug 22 05:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 524.607932] __x64_sys_ioctl+0x95/0xd0 Aug 22 05:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 524.608624] do_syscall_64+0x5c/0xc0 Aug 22 05:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 524.609288] ? do_futex+0x162/0x1f0 Aug 22 05:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 524.609936] ? __x64_sys_futex+0x78/0x1e0 Aug 22 05:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 524.610613] ? __secure_computing+0xa9/0x120 Aug 22 05:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 524.611306] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 05:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 524.612067] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 524.612789] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 524.613505] ? do_syscall_64+0x69/0xc0 Aug 22 05:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 524.614154] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 524.614855] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 524.615557] ? do_syscall_64+0x69/0xc0 Aug 22 05:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 524.616182] ? do_syscall_64+0x69/0xc0 Aug 22 05:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 524.616806] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 05:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 524.617528] RIP: 0033:0x7faa5d0edaff Aug 22 05:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 524.618189] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 05:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 524.620195] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 05:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 524.621105] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 05:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 524.621995] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 05:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 524.622888] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 05:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 524.623786] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 05:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 524.624685] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 05:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 524.625591] Aug 22 05:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 537.224707] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 05:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 537.225682] rcu: 1-....: (104683 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=51232 Aug 22 05:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 537.226789] (t=105006 jiffies g=23269 q=8815) Aug 22 05:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 537.227566] NMI backtrace for cpu 1 Aug 22 05:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 537.228272] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 05:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 537.229375] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 05:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 537.230427] Call Trace: Aug 22 05:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 537.231112] Aug 22 05:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 537.231755] show_stack+0x52/0x5c Aug 22 05:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 537.232475] dump_stack_lvl+0x4a/0x63 Aug 22 05:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 537.233222] dump_stack+0x10/0x16 Aug 22 05:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 537.233936] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 05:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 537.234711] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 05:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 537.235494] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 05:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 537.236313] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 05:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 537.237125] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 05:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 537.237928] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 05:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 537.238700] print_cpu_stall.cold+0x2f/0xe2 Aug 22 05:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 537.239471] ? timekeeping_update+0xf7/0x150 Aug 22 05:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 537.240238] check_cpu_stall+0x109/0x270 Aug 22 05:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 537.240987] rcu_sched_clock_irq+0x9a/0x250 Aug 22 05:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 537.241745] update_process_times+0x94/0xd0 Aug 22 05:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 537.242502] tick_sched_handle+0x29/0x70 Aug 22 05:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 537.243263] tick_sched_timer+0x8c/0xc0 Aug 22 05:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 537.244004] ? tick_nohz_handler+0xb0/0xb0 Aug 22 05:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 537.244762] __hrtimer_run_queues+0x107/0x230 Aug 22 05:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 537.245531] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 05:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 537.246302] hrtimer_interrupt+0x101/0x220 Aug 22 05:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 537.247068] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 05:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 537.247883] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 05:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 537.248684] Aug 22 05:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 537.249320] Aug 22 05:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 537.249945] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 05:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 537.250760] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 05:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 537.251872] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 05:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 537.254074] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 05:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 537.254946] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 05:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 537.255949] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 05:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 537.257050] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 05:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 537.258015] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 05:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 537.258965] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 05:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 537.259926] ? _raw_spin_lock+0x22/0x30 Aug 22 05:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 537.260684] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 05:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 537.261520] direct_page_fault+0x206/0x310 [kvm] Aug 22 05:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 537.262355] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 05:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 537.263197] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 05:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 537.264024] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 05:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 537.264826] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 05:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 537.265608] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 05:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 537.266432] handle_exit+0x98/0x230 [kvm_amd] Aug 22 05:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 537.267196] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 05:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 537.267979] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 05:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 537.268778] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 05:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 537.269564] vcpu_run+0x62/0x2c0 [kvm] Aug 22 05:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 537.270308] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 05:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 537.271075] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 05:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 537.271879] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 05:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 537.272640] ? __seccomp_filter+0x4a/0x4a0 Aug 22 05:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 537.273361] ? __fget_files+0x86/0xc0 Aug 22 05:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 537.274059] __x64_sys_ioctl+0x95/0xd0 Aug 22 05:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 537.274757] do_syscall_64+0x5c/0xc0 Aug 22 05:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 537.275446] ? do_futex+0x162/0x1f0 Aug 22 05:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 537.276123] ? __x64_sys_futex+0x78/0x1e0 Aug 22 05:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 537.276828] ? __secure_computing+0xa9/0x120 Aug 22 05:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 537.277544] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 05:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 537.278332] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 537.279098] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 537.279853] ? do_syscall_64+0x69/0xc0 Aug 22 05:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 537.280541] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 537.281294] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 537.282053] ? do_syscall_64+0x69/0xc0 Aug 22 05:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 537.282748] ? do_syscall_64+0x69/0xc0 Aug 22 05:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 537.283445] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 05:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 537.284215] RIP: 0033:0x7faa5d0edaff Aug 22 05:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 537.284896] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 05:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 537.286985] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 05:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 537.287956] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 05:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 537.288905] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 05:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 537.289847] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 05:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 537.290786] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 05:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 537.291728] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 05:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 537.292643] Aug 22 05:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 564.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 417s! [qemu-system-x86:6715] Aug 22 05:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 564.543166] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 05:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 564.543234] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 05:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 564.555538] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 05:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 564.556809] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 05:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 564.558033] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 05:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 564.559169] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 05:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 564.561730] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 05:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 564.562820] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 05:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 564.563986] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 05:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 564.565143] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 05:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 564.566299] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 05:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 564.567479] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 05:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 564.568663] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 05:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 564.569910] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 05:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 564.571073] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 05:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 564.572415] Call Trace: Aug 22 05:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 564.573331] Aug 22 05:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 564.574219] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 05:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 564.575268] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 05:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 564.576290] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 05:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 564.577365] ? show_regs.part.0+0x23/0x29 Aug 22 05:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 564.578362] ? show_regs.cold+0x8/0xd Aug 22 05:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 564.579387] ? watchdog_timer_fn+0x1be/0x220 Aug 22 05:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 564.580407] ? lockup_detector_update_enable+0x60/0x60 Aug 22 05:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 564.581474] ? __hrtimer_run_queues+0x107/0x230 Aug 22 05:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 564.582500] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 05:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 564.583535] ? hrtimer_interrupt+0x101/0x220 Aug 22 05:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 564.584548] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 05:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 564.585616] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 05:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 564.586662] Aug 22 05:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 564.587532] Aug 22 05:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 564.588368] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 05:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 564.589420] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 05:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 564.590476] ? _raw_spin_lock+0x22/0x30 Aug 22 05:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 564.591438] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 05:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 564.592462] direct_page_fault+0x206/0x310 [kvm] Aug 22 05:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 564.593491] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 05:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 564.594498] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 05:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 564.595513] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 05:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 564.596486] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 05:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 564.597432] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 05:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 564.598407] handle_exit+0x98/0x230 [kvm_amd] Aug 22 05:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 564.599324] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 05:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 564.600253] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 05:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 564.601186] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 05:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 564.602092] vcpu_run+0x62/0x2c0 [kvm] Aug 22 05:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 564.602922] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 05:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 564.603737] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 05:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 564.604591] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 05:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 564.605395] ? __seccomp_filter+0x4a/0x4a0 Aug 22 05:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 564.606141] ? __fget_files+0x86/0xc0 Aug 22 05:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 564.606861] __x64_sys_ioctl+0x95/0xd0 Aug 22 05:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 564.607555] do_syscall_64+0x5c/0xc0 Aug 22 05:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 564.608218] ? do_futex+0x162/0x1f0 Aug 22 05:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 564.608867] ? __x64_sys_futex+0x78/0x1e0 Aug 22 05:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 564.609545] ? __secure_computing+0xa9/0x120 Aug 22 05:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 564.610234] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 05:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 564.611029] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 564.611753] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 564.612470] ? do_syscall_64+0x69/0xc0 Aug 22 05:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 564.613118] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 564.613822] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 564.614515] ? do_syscall_64+0x69/0xc0 Aug 22 05:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 564.615153] ? do_syscall_64+0x69/0xc0 Aug 22 05:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 564.615774] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 05:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 564.616476] RIP: 0033:0x7faa5d0edaff Aug 22 05:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 564.617099] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 05:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 564.619095] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 05:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 564.620004] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 05:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 564.620902] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 05:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 564.621805] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 05:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 564.622714] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 05:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 564.623614] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 05:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 564.624511] Aug 22 05:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 592.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 443s! [qemu-system-x86:6715] Aug 22 05:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 592.543093] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 05:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 592.543157] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 05:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 592.555259] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 05:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 592.556530] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 05:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 592.557754] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 05:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 592.558824] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 05:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 592.561374] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 05:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 592.562434] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 05:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 592.563596] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 05:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 592.564754] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 05:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 592.565919] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 05:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 592.567095] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 05:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 592.568266] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 05:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 592.569496] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 05:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 592.570611] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 05:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 592.571806] Call Trace: Aug 22 05:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 592.572722] Aug 22 05:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 592.573603] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 05:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 592.574648] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 05:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 592.575667] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 05:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 592.576740] ? show_regs.part.0+0x23/0x29 Aug 22 05:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 592.577736] ? show_regs.cold+0x8/0xd Aug 22 05:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 592.578719] ? watchdog_timer_fn+0x1be/0x220 Aug 22 05:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 592.579845] ? lockup_detector_update_enable+0x60/0x60 Aug 22 05:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 592.581039] ? __hrtimer_run_queues+0x107/0x230 Aug 22 05:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 592.582066] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 05:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 592.583099] ? hrtimer_interrupt+0x101/0x220 Aug 22 05:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 592.584114] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 05:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 592.585181] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 05:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 592.586230] Aug 22 05:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 592.587131] Aug 22 05:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 592.588042] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 05:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 592.589091] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 05:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 592.590138] ? _raw_spin_lock+0x22/0x30 Aug 22 05:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 592.591113] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 05:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 592.592300] direct_page_fault+0x206/0x310 [kvm] Aug 22 05:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 592.593332] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 05:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 592.594367] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 05:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 592.595369] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 05:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 592.596340] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 05:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 592.597288] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 05:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 592.598268] handle_exit+0x98/0x230 [kvm_amd] Aug 22 05:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 592.599177] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 05:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 592.600091] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 05:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 592.601017] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 05:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 592.601927] vcpu_run+0x62/0x2c0 [kvm] Aug 22 05:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 592.602757] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 05:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 592.603572] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 05:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 592.604428] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 05:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 592.605227] ? __seccomp_filter+0x4a/0x4a0 Aug 22 05:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 592.605970] ? __fget_files+0x86/0xc0 Aug 22 05:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 592.606691] __x64_sys_ioctl+0x95/0xd0 Aug 22 05:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 592.607385] do_syscall_64+0x5c/0xc0 Aug 22 05:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 592.608052] ? do_futex+0x162/0x1f0 Aug 22 05:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 592.608701] ? __x64_sys_futex+0x78/0x1e0 Aug 22 05:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 592.609381] ? __secure_computing+0xa9/0x120 Aug 22 05:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 592.610071] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 05:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 592.610844] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 592.611568] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 592.612292] ? do_syscall_64+0x69/0xc0 Aug 22 05:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 592.612940] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 592.613651] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 592.614371] ? do_syscall_64+0x69/0xc0 Aug 22 05:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 592.614999] ? do_syscall_64+0x69/0xc0 Aug 22 05:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 592.615622] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 05:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 592.616334] RIP: 0033:0x7faa5d0edaff Aug 22 05:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 592.616961] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 05:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 592.618968] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 05:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 592.619889] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 05:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 592.620783] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 05:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 592.621680] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 05:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 592.622581] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 05:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 592.623476] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 05:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 592.624371] Aug 22 05:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 620.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 469s! [qemu-system-x86:6715] Aug 22 05:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 620.543905] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 05:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 620.544158] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 05:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 620.558055] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 05:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 620.559502] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 05:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 620.560882] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 05:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 620.562071] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 05:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 620.564936] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 05:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 620.566088] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 05:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 620.567377] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 05:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 620.568664] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 05:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 620.569954] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 05:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 620.571267] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 05:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 620.572560] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 05:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 620.573935] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 05:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 620.575152] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 05:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 620.576471] Call Trace: Aug 22 05:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 620.577430] Aug 22 05:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 620.578392] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 05:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 620.579611] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 05:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 620.580719] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 05:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 620.581897] ? show_regs.part.0+0x23/0x29 Aug 22 05:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 620.583001] ? show_regs.cold+0x8/0xd Aug 22 05:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 620.584047] ? watchdog_timer_fn+0x1be/0x220 Aug 22 05:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 620.585142] ? lockup_detector_update_enable+0x60/0x60 Aug 22 05:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 620.586321] ? __hrtimer_run_queues+0x107/0x230 Aug 22 05:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 620.587435] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 05:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 620.588553] ? hrtimer_interrupt+0x101/0x220 Aug 22 05:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 620.589651] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 05:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 620.590845] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 05:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 620.591987] Aug 22 05:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 620.592886] Aug 22 05:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 620.593769] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 05:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 620.594926] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 05:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 620.596066] ? _raw_spin_lock+0x22/0x30 Aug 22 05:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 620.597085] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 05:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 620.598205] direct_page_fault+0x206/0x310 [kvm] Aug 22 05:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 620.599317] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 05:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 620.600410] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 05:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 620.601501] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 05:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 620.602599] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 05:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 620.603637] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 05:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 620.604717] handle_exit+0x98/0x230 [kvm_amd] Aug 22 05:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 620.605695] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 05:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 620.606712] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 05:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 620.607733] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 05:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 620.608734] vcpu_run+0x62/0x2c0 [kvm] Aug 22 05:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 620.609618] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 05:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 620.610525] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 05:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 620.611477] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 05:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 620.612363] ? __seccomp_filter+0x4a/0x4a0 Aug 22 05:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 620.613189] ? __fget_files+0x86/0xc0 Aug 22 05:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 620.613970] __x64_sys_ioctl+0x95/0xd0 Aug 22 05:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 620.614760] do_syscall_64+0x5c/0xc0 Aug 22 05:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 620.615499] ? do_futex+0x162/0x1f0 Aug 22 05:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 620.616217] ? __x64_sys_futex+0x78/0x1e0 Aug 22 05:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 620.616969] ? __secure_computing+0xa9/0x120 Aug 22 05:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 620.617745] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 05:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 620.618624] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 620.619435] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 620.620243] ? do_syscall_64+0x69/0xc0 Aug 22 05:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 620.620967] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 620.621760] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 620.622570] ? do_syscall_64+0x69/0xc0 Aug 22 05:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 620.623272] ? do_syscall_64+0x69/0xc0 Aug 22 05:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 620.623974] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 05:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 620.624774] RIP: 0033:0x7faa5d0edaff Aug 22 05:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 620.625489] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 05:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 620.627840] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 05:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 620.628890] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 05:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 620.629908] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 05:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 620.630945] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 05:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 620.631964] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 05:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 620.632981] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 05:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 620.634001] Aug 22 05:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 648.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 496s! [qemu-system-x86:6715] Aug 22 05:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 648.543075] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 05:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 648.543142] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 05:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 648.555219] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 05:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 648.556480] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 05:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 648.557715] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 05:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 648.558768] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 05:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 648.561314] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 05:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 648.562363] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 05:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 648.563533] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 05:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 648.564696] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 05:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 648.565867] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 05:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 648.567033] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 05:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 648.568198] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 05:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 648.569426] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 05:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 648.570541] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 05:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 648.571730] Call Trace: Aug 22 05:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 648.572641] Aug 22 05:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 648.573525] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 05:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 648.574571] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 05:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 648.575589] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 05:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 648.576662] ? show_regs.part.0+0x23/0x29 Aug 22 05:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 648.577658] ? show_regs.cold+0x8/0xd Aug 22 05:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 648.578639] ? watchdog_timer_fn+0x1be/0x220 Aug 22 05:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 648.579650] ? lockup_detector_update_enable+0x60/0x60 Aug 22 05:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 648.580709] ? __hrtimer_run_queues+0x107/0x230 Aug 22 05:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 648.581744] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 05:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 648.582766] ? hrtimer_interrupt+0x101/0x220 Aug 22 05:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 648.583785] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 05:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 648.584853] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 05:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 648.585914] Aug 22 05:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 648.586767] Aug 22 05:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 648.587604] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 05:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 648.588635] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 05:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 648.589673] ? _raw_spin_lock+0x22/0x30 Aug 22 05:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 648.590629] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 05:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 648.591643] direct_page_fault+0x206/0x310 [kvm] Aug 22 05:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 648.592670] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 05:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 648.593678] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 05:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 648.594701] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 05:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 648.595673] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 05:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 648.596619] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 05:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 648.597603] handle_exit+0x98/0x230 [kvm_amd] Aug 22 05:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 648.598515] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 05:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 648.599428] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 05:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 648.600372] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 05:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 648.601274] vcpu_run+0x62/0x2c0 [kvm] Aug 22 05:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 648.602100] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 05:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 648.602909] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 05:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 648.603771] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 05:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 648.604572] ? __seccomp_filter+0x4a/0x4a0 Aug 22 05:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 648.605314] ? __fget_files+0x86/0xc0 Aug 22 05:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 648.606023] __x64_sys_ioctl+0x95/0xd0 Aug 22 05:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 648.606722] do_syscall_64+0x5c/0xc0 Aug 22 05:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 648.607386] ? do_futex+0x162/0x1f0 Aug 22 05:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 648.608039] ? __x64_sys_futex+0x78/0x1e0 Aug 22 05:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 648.608714] ? __secure_computing+0xa9/0x120 Aug 22 05:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 648.609402] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 05:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 648.610174] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 648.610896] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 648.611614] ? do_syscall_64+0x69/0xc0 Aug 22 05:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 648.612259] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 648.612969] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 648.613669] ? do_syscall_64+0x69/0xc0 Aug 22 05:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 648.614308] ? do_syscall_64+0x69/0xc0 Aug 22 05:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 648.614929] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 05:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 648.615634] RIP: 0033:0x7faa5d0edaff Aug 22 05:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 648.616271] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 05:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 648.618268] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 05:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 648.619181] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 05:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 648.620365] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 05:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 648.621253] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 05:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 648.622145] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 05:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 648.623041] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 05:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 648.623933] Aug 22 05:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 676.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 522s! [qemu-system-x86:6715] Aug 22 05:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 676.543111] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 05:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 676.543180] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 05:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 676.555240] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 05:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 676.556502] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 05:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 676.557736] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 05:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 676.558794] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 05:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 676.561335] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 05:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 676.562382] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 05:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 676.563568] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 05:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 676.564730] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 05:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 676.565910] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 05:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 676.567213] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 05:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 676.568508] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 05:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 676.569905] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 05:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 676.571108] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 05:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 676.572430] Call Trace: Aug 22 05:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 676.573430] Aug 22 05:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 676.574384] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 05:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 676.575499] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 05:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 676.576602] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 05:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 676.577803] ? show_regs.part.0+0x23/0x29 Aug 22 05:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 676.578873] ? show_regs.cold+0x8/0xd Aug 22 05:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 676.579920] ? watchdog_timer_fn+0x1be/0x220 Aug 22 05:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 676.581004] ? lockup_detector_update_enable+0x60/0x60 Aug 22 05:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 676.582181] ? __hrtimer_run_queues+0x107/0x230 Aug 22 05:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 676.583296] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 05:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 676.584405] ? hrtimer_interrupt+0x101/0x220 Aug 22 05:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 676.585520] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 05:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 676.586683] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 05:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 676.587831] Aug 22 05:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 676.588729] Aug 22 05:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 676.589623] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 05:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 676.590757] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 05:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 676.591905] ? _raw_spin_lock+0x22/0x30 Aug 22 05:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 676.592921] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 05:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 676.594034] direct_page_fault+0x206/0x310 [kvm] Aug 22 05:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 676.595145] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 05:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 676.596238] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 05:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 676.597329] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 05:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 676.598417] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 05:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 676.599465] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 05:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 676.600553] handle_exit+0x98/0x230 [kvm_amd] Aug 22 05:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 676.601551] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 05:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 676.602548] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 05:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 676.603568] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 05:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 676.604568] vcpu_run+0x62/0x2c0 [kvm] Aug 22 05:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 676.605464] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 05:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 676.606356] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 05:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 676.607304] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 05:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 676.608183] ? __seccomp_filter+0x4a/0x4a0 Aug 22 05:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 676.609177] ? __fget_files+0x86/0xc0 Aug 22 05:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 676.609965] __x64_sys_ioctl+0x95/0xd0 Aug 22 05:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 676.610735] do_syscall_64+0x5c/0xc0 Aug 22 05:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 676.611471] ? do_futex+0x162/0x1f0 Aug 22 05:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 676.612184] ? __x64_sys_futex+0x78/0x1e0 Aug 22 05:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 676.612945] ? __secure_computing+0xa9/0x120 Aug 22 05:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 676.613753] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 05:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 676.614616] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 676.615424] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 676.616227] ? do_syscall_64+0x69/0xc0 Aug 22 05:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 676.616942] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 676.617749] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 676.618536] ? do_syscall_64+0x69/0xc0 Aug 22 05:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 676.619234] ? do_syscall_64+0x69/0xc0 Aug 22 05:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 676.619929] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 05:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 676.620728] RIP: 0033:0x7faa5d0edaff Aug 22 05:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 676.621440] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 05:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 676.623745] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 05:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 676.624798] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 05:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 676.625832] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 05:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 676.626847] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 05:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 676.627860] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 05:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 676.628873] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 05:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 676.629914] Aug 22 05:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 704.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 548s! [qemu-system-x86:6715] Aug 22 05:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 704.543746] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 05:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 704.544006] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 05:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 704.556104] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 05:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 704.557380] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 05:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 704.558604] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 05:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 704.559660] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 05:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 704.562228] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 05:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 704.563271] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 05:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 704.564442] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 05:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 704.565619] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 05:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 704.566781] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 05:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 704.567942] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 05:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 704.569125] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 05:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 704.570361] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 05:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 704.571467] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 05:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 704.572662] Call Trace: Aug 22 05:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 704.573599] Aug 22 05:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 704.574492] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 05:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 704.575521] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 05:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 704.576541] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 05:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 704.577654] ? show_regs.part.0+0x23/0x29 Aug 22 05:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 704.578650] ? show_regs.cold+0x8/0xd Aug 22 05:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 704.579620] ? watchdog_timer_fn+0x1be/0x220 Aug 22 05:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 704.580627] ? lockup_detector_update_enable+0x60/0x60 Aug 22 05:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 704.581708] ? __hrtimer_run_queues+0x107/0x230 Aug 22 05:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 704.582735] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 05:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 704.583761] ? hrtimer_interrupt+0x101/0x220 Aug 22 05:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 704.584774] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 05:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 704.585856] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 05:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 704.586899] Aug 22 05:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 704.587761] Aug 22 05:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 704.588596] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 05:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 704.589656] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 05:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 704.590697] ? _raw_spin_lock+0x22/0x30 Aug 22 05:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 704.591639] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 05:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 704.592659] direct_page_fault+0x206/0x310 [kvm] Aug 22 05:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 704.593705] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 05:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 704.594717] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 05:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 704.595719] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 05:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 704.596709] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 05:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 704.597671] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 05:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 704.598648] handle_exit+0x98/0x230 [kvm_amd] Aug 22 05:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 704.599544] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 05:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 704.600460] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 05:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 704.601400] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 05:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 704.602302] vcpu_run+0x62/0x2c0 [kvm] Aug 22 05:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 704.603115] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 05:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 704.603920] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 05:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 704.604776] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 05:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 704.605600] ? __seccomp_filter+0x4a/0x4a0 Aug 22 05:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 704.606347] ? __fget_files+0x86/0xc0 Aug 22 05:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 704.607050] __x64_sys_ioctl+0x95/0xd0 Aug 22 05:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 704.607740] do_syscall_64+0x5c/0xc0 Aug 22 05:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 704.608412] ? do_futex+0x162/0x1f0 Aug 22 05:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 704.609077] ? __x64_sys_futex+0x78/0x1e0 Aug 22 05:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 704.609750] ? __secure_computing+0xa9/0x120 Aug 22 05:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 704.610440] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 05:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 704.611207] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 704.611938] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 704.612651] ? do_syscall_64+0x69/0xc0 Aug 22 05:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 704.613314] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 704.614013] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 704.614708] ? do_syscall_64+0x69/0xc0 Aug 22 05:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 704.615329] ? do_syscall_64+0x69/0xc0 Aug 22 05:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 704.615944] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 05:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 704.616643] RIP: 0033:0x7faa5d0edaff Aug 22 05:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 704.617291] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 05:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 704.619268] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 05:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 704.620190] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 05:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 704.621101] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 05:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 704.621989] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 05:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 704.622870] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 05:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 704.623752] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 05:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 704.624644] Aug 22 05:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 717.236706] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 05:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 717.237658] rcu: 1-....: (149548 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=73066 Aug 22 05:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 717.238755] (t=150009 jiffies g=23269 q=9058) Aug 22 05:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 717.239521] NMI backtrace for cpu 1 Aug 22 05:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 717.240226] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 05:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 717.241336] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 05:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 717.242418] Call Trace: Aug 22 05:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 717.243109] Aug 22 05:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 717.243753] show_stack+0x52/0x5c Aug 22 05:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 717.244475] dump_stack_lvl+0x4a/0x63 Aug 22 05:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 717.245230] dump_stack+0x10/0x16 Aug 22 05:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 717.245946] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 05:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 717.246723] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 05:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 717.247514] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 05:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 717.248337] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 05:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 717.249170] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 05:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 717.249978] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 05:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 717.250757] print_cpu_stall.cold+0x2f/0xe2 Aug 22 05:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 717.251519] ? timekeeping_update+0xf7/0x150 Aug 22 05:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 717.252283] check_cpu_stall+0x109/0x270 Aug 22 05:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 717.253041] rcu_sched_clock_irq+0x9a/0x250 Aug 22 05:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 717.253978] update_process_times+0x94/0xd0 Aug 22 05:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 717.254741] tick_sched_handle+0x29/0x70 Aug 22 05:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 717.255483] tick_sched_timer+0x8c/0xc0 Aug 22 05:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 717.256216] ? tick_nohz_handler+0xb0/0xb0 Aug 22 05:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 717.257135] __hrtimer_run_queues+0x107/0x230 Aug 22 05:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 717.257907] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 05:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 717.258678] hrtimer_interrupt+0x101/0x220 Aug 22 05:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 717.259432] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 05:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 717.260238] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 05:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 717.261052] Aug 22 05:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 717.261686] Aug 22 05:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 717.262311] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 05:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 717.263130] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 05:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 717.264010] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 05:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 717.266266] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 05:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 717.267158] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 05:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 717.268149] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 05:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 717.269139] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 05:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 717.270105] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 05:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 717.271055] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 05:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 717.272004] ? _raw_spin_lock+0x22/0x30 Aug 22 05:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 717.272762] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 05:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 717.273611] direct_page_fault+0x206/0x310 [kvm] Aug 22 05:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 717.274446] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 05:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 717.275269] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 05:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 717.276090] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 05:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 717.276927] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 05:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 717.277720] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 05:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 717.278540] handle_exit+0x98/0x230 [kvm_amd] Aug 22 05:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 717.279290] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 05:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 717.280069] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 05:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 717.280874] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 05:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 717.281658] vcpu_run+0x62/0x2c0 [kvm] Aug 22 05:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 717.282370] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 05:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 717.283105] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 05:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 717.283901] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 05:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 717.284679] ? __seccomp_filter+0x4a/0x4a0 Aug 22 05:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 717.285421] ? __fget_files+0x86/0xc0 Aug 22 05:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 717.286155] __x64_sys_ioctl+0x95/0xd0 Aug 22 05:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 717.286854] do_syscall_64+0x5c/0xc0 Aug 22 05:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 717.287535] ? do_futex+0x162/0x1f0 Aug 22 05:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 717.288206] ? __x64_sys_futex+0x78/0x1e0 Aug 22 05:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 717.288950] ? __secure_computing+0xa9/0x120 Aug 22 05:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 717.289666] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 05:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 717.290453] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 717.291210] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 717.291962] ? do_syscall_64+0x69/0xc0 Aug 22 05:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 717.292650] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 717.293416] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 717.294174] ? do_syscall_64+0x69/0xc0 Aug 22 05:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 717.294865] ? do_syscall_64+0x69/0xc0 Aug 22 05:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 717.295555] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 05:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 717.296322] RIP: 0033:0x7faa5d0edaff Aug 22 05:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 717.297215] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 05:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 717.299313] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 05:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 717.300272] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 05:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 717.301241] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 05:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 717.302186] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 05:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 717.303123] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 05:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 717.304045] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 05:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 717.304972] Aug 22 05:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 744.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 585s! [qemu-system-x86:6715] Aug 22 05:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 744.543290] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 05:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 744.543358] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 05:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 744.557882] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 05:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 744.559413] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 05:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 744.560841] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 05:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 744.562028] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 05:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 744.564987] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 05:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 744.566152] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 05:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 744.567464] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 05:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 744.568793] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 05:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 744.570123] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 05:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 744.571443] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 05:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 744.572788] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 05:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 744.574197] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 05:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 744.575631] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 05:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 744.577015] Call Trace: Aug 22 05:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 744.577996] Aug 22 05:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 744.578938] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 05:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 744.580065] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 05:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 744.581315] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 05:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 744.582513] ? show_regs.part.0+0x23/0x29 Aug 22 05:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 744.583791] ? show_regs.cold+0x8/0xd Aug 22 05:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 744.584870] ? watchdog_timer_fn+0x1be/0x220 Aug 22 05:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 744.586185] ? lockup_detector_update_enable+0x60/0x60 Aug 22 05:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 744.587376] ? __hrtimer_run_queues+0x107/0x230 Aug 22 05:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 744.588505] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 05:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 744.589652] ? hrtimer_interrupt+0x101/0x220 Aug 22 05:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 744.591199] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 05:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 744.592411] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 05:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 744.593597] Aug 22 05:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 744.594505] Aug 22 05:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 744.595395] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 05:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 744.596564] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 05:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 744.597719] ? _raw_spin_lock+0x22/0x30 Aug 22 05:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 744.598764] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 05:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 744.599896] direct_page_fault+0x206/0x310 [kvm] Aug 22 05:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 744.601055] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 05:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 744.602179] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 05:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 744.603303] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 05:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 744.604387] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 05:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 744.605460] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 05:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 744.606585] handle_exit+0x98/0x230 [kvm_amd] Aug 22 05:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 744.607615] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 05:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 744.608701] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 05:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 744.609778] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 05:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 744.610808] vcpu_run+0x62/0x2c0 [kvm] Aug 22 05:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 744.611709] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 05:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 744.612651] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 05:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 744.613629] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 05:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 744.614531] ? __seccomp_filter+0x4a/0x4a0 Aug 22 05:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 744.615368] ? __fget_files+0x86/0xc0 Aug 22 05:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 744.616161] __x64_sys_ioctl+0x95/0xd0 Aug 22 05:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 744.616972] do_syscall_64+0x5c/0xc0 Aug 22 05:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 744.617731] ? do_futex+0x162/0x1f0 Aug 22 05:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 744.618459] ? __x64_sys_futex+0x78/0x1e0 Aug 22 05:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 744.619259] ? __secure_computing+0xa9/0x120 Aug 22 05:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 744.620133] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 05:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 744.620952] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 744.621709] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 744.622513] ? do_syscall_64+0x69/0xc0 Aug 22 05:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 744.623230] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 744.624037] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 744.625013] ? do_syscall_64+0x69/0xc0 Aug 22 05:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 744.625875] ? do_syscall_64+0x69/0xc0 Aug 22 05:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 744.626719] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 05:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 744.627677] RIP: 0033:0x7faa5d0edaff Aug 22 05:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 744.628517] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 05:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 744.631105] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 05:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 744.632268] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 05:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 744.633439] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 05:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 744.634571] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 05:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 744.635723] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 05:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 744.636792] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 05:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 744.637713] Aug 22 05:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 772.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 611s! [qemu-system-x86:6715] Aug 22 05:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 772.543115] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 05:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 772.543185] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 05:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 772.555451] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 05:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 772.556773] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 05:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 772.558003] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 05:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 772.559058] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 05:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 772.561651] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 05:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 772.562701] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 05:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 772.563888] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 05:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 772.565096] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 05:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 772.566337] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 05:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 772.567505] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 05:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 772.568701] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 05:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 772.569951] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 05:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 772.571067] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 05:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 772.572291] Call Trace: Aug 22 05:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 772.573207] Aug 22 05:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 772.574093] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 05:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 772.575121] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 05:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 772.576148] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 05:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 772.577348] ? show_regs.part.0+0x23/0x29 Aug 22 05:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 772.578432] ? show_regs.cold+0x8/0xd Aug 22 05:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 772.579485] ? watchdog_timer_fn+0x1be/0x220 Aug 22 05:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 772.580600] ? lockup_detector_update_enable+0x60/0x60 Aug 22 05:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 772.581769] ? __hrtimer_run_queues+0x107/0x230 Aug 22 05:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 772.582882] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 05:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 772.584002] ? hrtimer_interrupt+0x101/0x220 Aug 22 05:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 772.585128] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 05:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 772.586292] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 05:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 772.587428] Aug 22 05:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 772.588349] Aug 22 05:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 772.589241] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 05:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 772.590371] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 05:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 772.591519] ? _raw_spin_lock+0x22/0x30 Aug 22 05:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 772.592558] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 05:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 772.593671] direct_page_fault+0x206/0x310 [kvm] Aug 22 05:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 772.594790] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 05:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 772.595898] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 05:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 772.597012] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 05:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 772.598076] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 05:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 772.599118] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 05:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 772.600237] handle_exit+0x98/0x230 [kvm_amd] Aug 22 05:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 772.601216] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 05:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 772.602219] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 05:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 772.603247] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 05:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 772.604278] vcpu_run+0x62/0x2c0 [kvm] Aug 22 05:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 772.605174] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 05:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 772.606076] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 05:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 772.607032] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 05:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 772.607921] ? __seccomp_filter+0x4a/0x4a0 Aug 22 05:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 772.608770] ? __fget_files+0x86/0xc0 Aug 22 05:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 772.609559] __x64_sys_ioctl+0x95/0xd0 Aug 22 05:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 772.610333] do_syscall_64+0x5c/0xc0 Aug 22 05:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 772.611081] ? do_futex+0x162/0x1f0 Aug 22 05:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 772.611803] ? __x64_sys_futex+0x78/0x1e0 Aug 22 05:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 772.612582] ? __secure_computing+0xa9/0x120 Aug 22 05:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 772.613369] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 05:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 772.614242] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 772.615062] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 772.615884] ? do_syscall_64+0x69/0xc0 Aug 22 05:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 772.616658] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 772.617470] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 772.618266] ? do_syscall_64+0x69/0xc0 Aug 22 05:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 772.618972] ? do_syscall_64+0x69/0xc0 Aug 22 05:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 772.619676] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 05:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 772.620523] RIP: 0033:0x7faa5d0edaff Aug 22 05:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 772.621421] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 05:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 772.623762] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 05:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 772.624853] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 05:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 772.625884] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 05:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 772.626914] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 05:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 772.627945] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 05:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 772.629001] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 05:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 772.630040] Aug 22 05:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 800.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 637s! [qemu-system-x86:6715] Aug 22 05:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 800.543741] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 05:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 800.544014] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 05:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 800.556203] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 05:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 800.557470] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 05:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 800.558695] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 05:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 800.559895] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 05:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 800.563822] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 05:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 800.565334] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 05:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 800.566935] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 05:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 800.568539] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 05:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 800.570121] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 05:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 800.571783] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 05:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 800.573033] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 05:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 800.574282] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 05:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 800.575390] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 05:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 800.576656] Call Trace: Aug 22 05:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 800.577580] Aug 22 05:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 800.578495] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 05:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 800.579540] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 05:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 800.580598] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 05:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 800.581705] ? show_regs.part.0+0x23/0x29 Aug 22 05:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 800.582712] ? show_regs.cold+0x8/0xd Aug 22 05:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 800.583695] ? watchdog_timer_fn+0x1be/0x220 Aug 22 05:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 800.584724] ? lockup_detector_update_enable+0x60/0x60 Aug 22 05:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 800.585801] ? __hrtimer_run_queues+0x107/0x230 Aug 22 05:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 800.586836] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 05:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 800.587876] ? hrtimer_interrupt+0x101/0x220 Aug 22 05:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 800.588941] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 05:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 800.590032] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 05:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 800.591078] Aug 22 05:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 800.591967] Aug 22 05:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 800.592826] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 05:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 800.593885] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 05:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 800.594928] ? _raw_spin_lock+0x22/0x30 Aug 22 05:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 800.595890] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 05:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 800.596907] direct_page_fault+0x206/0x310 [kvm] Aug 22 05:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 800.597944] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 05:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 800.598993] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 05:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 800.600017] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 05:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 800.601024] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 05:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 800.601977] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 05:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 800.602965] handle_exit+0x98/0x230 [kvm_amd] Aug 22 05:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 800.603877] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 05:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 800.604808] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 05:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 800.605732] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 05:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 800.606637] vcpu_run+0x62/0x2c0 [kvm] Aug 22 05:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 800.607448] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 05:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 800.608300] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 05:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 800.609188] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 05:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 800.609991] ? __seccomp_filter+0x4a/0x4a0 Aug 22 05:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 800.610733] ? __fget_files+0x86/0xc0 Aug 22 05:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 800.611436] __x64_sys_ioctl+0x95/0xd0 Aug 22 05:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 800.612146] do_syscall_64+0x5c/0xc0 Aug 22 05:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 800.612812] ? do_futex+0x162/0x1f0 Aug 22 05:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 800.613471] ? __x64_sys_futex+0x78/0x1e0 Aug 22 05:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 800.614149] ? __secure_computing+0xa9/0x120 Aug 22 05:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 800.614849] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 05:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 800.615606] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 800.616347] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 800.617064] ? do_syscall_64+0x69/0xc0 Aug 22 05:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 800.617710] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 800.618421] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 800.619125] ? do_syscall_64+0x69/0xc0 Aug 22 05:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 800.619777] ? do_syscall_64+0x69/0xc0 Aug 22 05:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 800.620409] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 05:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 800.621115] RIP: 0033:0x7faa5d0edaff Aug 22 05:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 800.621764] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 05:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 800.623755] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 05:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 800.624693] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 05:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 800.625585] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 05:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 800.626478] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 05:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 800.627364] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 05:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 800.628280] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 05:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 800.629184] Aug 22 05:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 828.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 663s! [qemu-system-x86:6715] Aug 22 05:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 828.543081] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 05:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 828.543147] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 05:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 828.555774] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 05:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 828.557082] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 05:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 828.558317] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 05:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 828.559462] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 05:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 828.562036] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 05:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 828.563145] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 05:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 828.564426] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 05:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 828.566148] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 05:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 828.567988] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 05:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 828.570075] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 05:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 828.571856] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 05:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 828.573721] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 05:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 828.575019] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 05:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 828.576238] Call Trace: Aug 22 05:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 828.577157] Aug 22 05:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 828.578042] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 05:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 828.579072] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 05:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 828.580111] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 05:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 828.581187] ? show_regs.part.0+0x23/0x29 Aug 22 05:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 828.582189] ? show_regs.cold+0x8/0xd Aug 22 05:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 828.583160] ? watchdog_timer_fn+0x1be/0x220 Aug 22 05:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 828.584186] ? lockup_detector_update_enable+0x60/0x60 Aug 22 05:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 828.585268] ? __hrtimer_run_queues+0x107/0x230 Aug 22 05:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 828.586308] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 05:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 828.587335] ? hrtimer_interrupt+0x101/0x220 Aug 22 05:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 828.588370] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 05:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 828.589439] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 05:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 828.590488] Aug 22 05:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 828.591341] Aug 22 05:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 828.592203] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 05:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 828.593235] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 05:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 828.594274] ? _raw_spin_lock+0x22/0x30 Aug 22 05:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 828.595237] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 05:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 828.596284] direct_page_fault+0x206/0x310 [kvm] Aug 22 05:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 828.597304] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 05:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 828.598309] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 05:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 828.599305] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 05:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 828.600288] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 05:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 828.601234] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 05:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 828.602212] handle_exit+0x98/0x230 [kvm_amd] Aug 22 05:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 828.603104] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 05:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 828.604030] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 05:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 828.604960] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 05:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 828.605860] vcpu_run+0x62/0x2c0 [kvm] Aug 22 05:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 828.606670] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 05:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 828.607476] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 05:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 828.608341] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 05:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 828.609156] ? __seccomp_filter+0x4a/0x4a0 Aug 22 05:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 828.609912] ? __fget_files+0x86/0xc0 Aug 22 05:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 828.610728] __x64_sys_ioctl+0x95/0xd0 Aug 22 05:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 828.611804] do_syscall_64+0x5c/0xc0 Aug 22 05:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 828.612829] ? do_futex+0x162/0x1f0 Aug 22 05:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 828.613811] ? __x64_sys_futex+0x78/0x1e0 Aug 22 05:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 828.615033] ? __secure_computing+0xa9/0x120 Aug 22 05:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 828.616114] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 05:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 828.617470] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 828.618555] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 828.619611] ? do_syscall_64+0x69/0xc0 Aug 22 05:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 828.620261] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 828.621194] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 828.621895] ? do_syscall_64+0x69/0xc0 Aug 22 05:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 828.622520] ? do_syscall_64+0x69/0xc0 Aug 22 05:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 828.623141] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 05:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 828.623869] RIP: 0033:0x7faa5d0edaff Aug 22 05:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 828.624495] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 05:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 828.626698] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 05:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 828.627629] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 05:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 828.628519] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 05:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 828.629405] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 05:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 828.630297] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 05:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 828.631189] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 05:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 828.632096] Aug 22 05:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 856.541981] watchdog: BUG: soft lockup - CPU#1 stuck for 689s! [qemu-system-x86:6715] Aug 22 05:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 856.543108] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 05:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 856.543173] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 05:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 856.555654] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 05:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 856.556917] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 05:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 856.558139] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 05:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 856.559220] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 05:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 856.561799] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 05:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 856.562842] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 05:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 856.564076] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 05:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 856.565257] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 05:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 856.566425] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 05:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 856.567643] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 05:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 856.568820] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 05:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 856.570072] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 05:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 856.571262] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 05:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 856.572675] Call Trace: Aug 22 05:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 856.573646] Aug 22 05:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 856.574562] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 05:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 856.575624] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 05:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 856.576649] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 05:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 856.577731] ? show_regs.part.0+0x23/0x29 Aug 22 05:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 856.578735] ? show_regs.cold+0x8/0xd Aug 22 05:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 856.579725] ? watchdog_timer_fn+0x1be/0x220 Aug 22 05:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 856.580740] ? lockup_detector_update_enable+0x60/0x60 Aug 22 05:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 856.581801] ? __hrtimer_run_queues+0x107/0x230 Aug 22 05:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 856.582831] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 05:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 856.583882] ? hrtimer_interrupt+0x101/0x220 Aug 22 05:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 856.584913] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 05:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 856.585997] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 05:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 856.587158] Aug 22 05:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 856.588079] Aug 22 05:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 856.588926] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 05:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 856.589968] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 05:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 856.591007] ? _raw_spin_lock+0x22/0x30 Aug 22 05:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 856.592024] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 05:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 856.593054] direct_page_fault+0x206/0x310 [kvm] Aug 22 05:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 856.594079] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 05:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 856.595086] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 05:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 856.596164] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 05:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 856.597132] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 05:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 856.598075] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 05:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 856.599056] handle_exit+0x98/0x230 [kvm_amd] Aug 22 05:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 856.599999] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 05:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 856.600913] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 05:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 856.601836] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 05:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 856.602995] vcpu_run+0x62/0x2c0 [kvm] Aug 22 05:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 856.603927] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 05:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 856.604792] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 05:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 856.606138] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 05:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 856.606942] ? __seccomp_filter+0x4a/0x4a0 Aug 22 05:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 856.607740] ? __fget_files+0x86/0xc0 Aug 22 05:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 856.608450] __x64_sys_ioctl+0x95/0xd0 Aug 22 05:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 856.609153] do_syscall_64+0x5c/0xc0 Aug 22 05:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 856.609823] ? do_futex+0x162/0x1f0 Aug 22 05:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 856.610475] ? __x64_sys_futex+0x78/0x1e0 Aug 22 05:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 856.611150] ? __secure_computing+0xa9/0x120 Aug 22 05:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 856.611911] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 05:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 856.612672] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 856.613399] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 856.614116] ? do_syscall_64+0x69/0xc0 Aug 22 05:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 856.614759] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 856.615518] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 856.616217] ? do_syscall_64+0x69/0xc0 Aug 22 05:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 856.616841] ? do_syscall_64+0x69/0xc0 Aug 22 05:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 856.617475] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 05:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 856.618216] RIP: 0033:0x7faa5d0edaff Aug 22 05:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 856.618873] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 05:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 856.620991] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 05:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 856.622028] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 05:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 856.622982] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 05:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 856.623928] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 05:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 856.624849] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 05:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 856.625744] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 05:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 856.626646] Aug 22 05:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 884.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 715s! [qemu-system-x86:6715] Aug 22 05:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 884.543125] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 05:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 884.543188] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 05:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 884.555314] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 05:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 884.556852] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 05:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 884.558262] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 05:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 884.559464] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 05:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 884.562375] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 05:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 884.563543] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 05:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 884.564860] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 05:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 884.566162] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 05:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 884.567507] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 05:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 884.568820] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 05:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 884.570138] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 05:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 884.571550] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 05:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 884.572791] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 05:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 884.574136] Call Trace: Aug 22 05:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 884.575126] Aug 22 05:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 884.576074] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 05:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 884.577199] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 05:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 884.578315] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 05:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 884.579514] ? show_regs.part.0+0x23/0x29 Aug 22 05:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 884.580601] ? show_regs.cold+0x8/0xd Aug 22 05:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 884.581655] ? watchdog_timer_fn+0x1be/0x220 Aug 22 05:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 884.582764] ? lockup_detector_update_enable+0x60/0x60 Aug 22 05:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 884.583960] ? __hrtimer_run_queues+0x107/0x230 Aug 22 05:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 884.585088] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 05:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 884.586206] ? hrtimer_interrupt+0x101/0x220 Aug 22 05:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 884.587348] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 05:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 884.588545] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 05:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 884.589707] Aug 22 05:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 884.590619] Aug 22 05:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 884.591520] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 05:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 884.592672] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 05:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 884.593834] ? _raw_spin_lock+0x22/0x30 Aug 22 05:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 884.594874] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 05:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 884.596001] direct_page_fault+0x206/0x310 [kvm] Aug 22 05:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 884.597127] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 05:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 884.598244] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 05:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 884.599362] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 05:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 884.600447] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 05:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 884.601494] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 05:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 884.602595] handle_exit+0x98/0x230 [kvm_amd] Aug 22 05:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 884.603618] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 05:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 884.604643] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 05:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 884.605689] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 05:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 884.606713] vcpu_run+0x62/0x2c0 [kvm] Aug 22 05:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 884.607643] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 05:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 884.608570] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 05:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 884.609555] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 05:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 884.610450] ? __seccomp_filter+0x4a/0x4a0 Aug 22 05:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 884.611306] ? __fget_files+0x86/0xc0 Aug 22 05:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 884.612089] __x64_sys_ioctl+0x95/0xd0 Aug 22 05:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 884.612864] do_syscall_64+0x5c/0xc0 Aug 22 05:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 884.613609] ? do_futex+0x162/0x1f0 Aug 22 05:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 884.614332] ? __x64_sys_futex+0x78/0x1e0 Aug 22 05:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 884.615110] ? __secure_computing+0xa9/0x120 Aug 22 05:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 884.615898] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 05:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 884.616772] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 884.617620] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 884.618461] ? do_syscall_64+0x69/0xc0 Aug 22 05:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 884.619222] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 884.620031] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 884.620826] ? do_syscall_64+0x69/0xc0 Aug 22 05:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 884.621725] ? do_syscall_64+0x69/0xc0 Aug 22 05:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 884.622427] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 05:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 884.623268] RIP: 0033:0x7faa5d0edaff Aug 22 05:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 884.623969] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 05:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 884.626320] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 05:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 884.627403] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 05:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 884.628435] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 05:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 884.629470] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 05:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 884.630502] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 05:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 884.631551] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 05:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 884.632595] Aug 22 05:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 897.248714] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 05:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 897.250335] rcu: 1-....: (194407 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=94841 Aug 22 05:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 897.251473] (t=195012 jiffies g=23269 q=9411) Aug 22 05:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 897.252247] NMI backtrace for cpu 1 Aug 22 05:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 897.253128] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 05:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 897.254453] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 05:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 897.255571] Call Trace: Aug 22 05:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 897.256248] Aug 22 05:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 897.256910] show_stack+0x52/0x5c Aug 22 05:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 897.257749] dump_stack_lvl+0x4a/0x63 Aug 22 05:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 897.258708] dump_stack+0x10/0x16 Aug 22 05:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 897.259576] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 05:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 897.261127] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 05:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 897.262558] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 05:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 897.263858] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 05:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 897.265076] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 05:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 897.266292] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 05:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 897.267432] print_cpu_stall.cold+0x2f/0xe2 Aug 22 05:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 897.268496] ? timekeeping_update+0xf7/0x150 Aug 22 05:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 897.269595] check_cpu_stall+0x109/0x270 Aug 22 05:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 897.270641] rcu_sched_clock_irq+0x9a/0x250 Aug 22 05:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 897.271755] update_process_times+0x94/0xd0 Aug 22 05:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 897.272828] tick_sched_handle+0x29/0x70 Aug 22 05:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 897.273899] tick_sched_timer+0x8c/0xc0 Aug 22 05:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 897.274968] ? tick_nohz_handler+0xb0/0xb0 Aug 22 05:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 897.276036] __hrtimer_run_queues+0x107/0x230 Aug 22 05:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 897.277169] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 05:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 897.278393] hrtimer_interrupt+0x101/0x220 Aug 22 05:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 897.279620] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 05:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 897.280824] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 05:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 897.282123] Aug 22 05:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 897.283119] Aug 22 05:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 897.284025] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 05:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 897.285396] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 05:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 897.286838] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 05:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 897.290305] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 05:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 897.291598] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 05:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 897.293160] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 05:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 897.294733] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 05:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 897.296226] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 05:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 897.297714] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 05:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 897.299196] ? _raw_spin_lock+0x22/0x30 Aug 22 05:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 897.300418] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 05:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 897.301724] direct_page_fault+0x206/0x310 [kvm] Aug 22 05:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 897.302932] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 05:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 897.304102] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 05:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 897.305149] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 05:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 897.306357] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 05:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 897.307511] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 05:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 897.308681] handle_exit+0x98/0x230 [kvm_amd] Aug 22 05:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 897.309734] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 05:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 897.310876] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 05:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 897.312032] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 05:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 897.313132] vcpu_run+0x62/0x2c0 [kvm] Aug 22 05:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 897.314128] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 05:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 897.315154] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 05:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 897.316006] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 05:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 897.316984] ? __seccomp_filter+0x4a/0x4a0 Aug 22 05:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 897.317995] ? __fget_files+0x86/0xc0 Aug 22 05:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 897.319016] __x64_sys_ioctl+0x95/0xd0 Aug 22 05:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 897.319940] do_syscall_64+0x5c/0xc0 Aug 22 05:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 897.320928] ? do_futex+0x162/0x1f0 Aug 22 05:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 897.322013] ? __x64_sys_futex+0x78/0x1e0 Aug 22 05:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 897.323084] ? __secure_computing+0xa9/0x120 Aug 22 05:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 897.324134] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 05:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 897.325247] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 897.326339] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 897.327470] ? do_syscall_64+0x69/0xc0 Aug 22 05:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 897.328525] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 897.329645] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 897.330745] ? do_syscall_64+0x69/0xc0 Aug 22 05:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 897.331759] ? do_syscall_64+0x69/0xc0 Aug 22 05:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 897.332730] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 05:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 897.333864] RIP: 0033:0x7faa5d0edaff Aug 22 05:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 897.334892] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 05:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 897.337974] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 05:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 897.339424] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 05:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 897.340761] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 05:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 897.342095] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 05:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 897.343493] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 05:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 897.344810] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 05:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 897.346035] Aug 22 05:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 924.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 753s! [qemu-system-x86:6715] Aug 22 05:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 924.543128] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 05:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 924.543402] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 05:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 924.555598] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 05:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 924.556884] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 05:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 924.558109] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 05:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 924.559187] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 05:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 924.561771] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 05:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 924.562838] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 05:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 924.564007] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 05:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 924.565167] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 05:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 924.566401] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 05:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 924.567599] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 05:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 924.568765] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 05:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 924.570002] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 05:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 924.571139] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 05:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 924.572363] Call Trace: Aug 22 05:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 924.573277] Aug 22 05:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 924.574165] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 05:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 924.575210] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 05:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 924.576244] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 05:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 924.577342] ? show_regs.part.0+0x23/0x29 Aug 22 05:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 924.578341] ? show_regs.cold+0x8/0xd Aug 22 05:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 924.579328] ? watchdog_timer_fn+0x1be/0x220 Aug 22 05:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 924.580335] ? lockup_detector_update_enable+0x60/0x60 Aug 22 05:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 924.581407] ? __hrtimer_run_queues+0x107/0x230 Aug 22 05:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 924.582480] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 05:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 924.583543] ? hrtimer_interrupt+0x101/0x220 Aug 22 05:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 924.584558] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 05:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 924.585626] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 05:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 924.586702] Aug 22 05:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 924.587575] Aug 22 05:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 924.588415] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 05:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 924.589450] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 05:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 924.590509] ? _raw_spin_lock+0x22/0x30 Aug 22 05:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 924.591465] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 05:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 924.592568] direct_page_fault+0x206/0x310 [kvm] Aug 22 05:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 924.593605] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 05:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 924.594637] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 05:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 924.595640] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 05:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 924.596702] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 05:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 924.597680] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 05:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 924.598680] handle_exit+0x98/0x230 [kvm_amd] Aug 22 05:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 924.599583] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 05:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 924.600499] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 05:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 924.601425] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 05:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 924.602349] vcpu_run+0x62/0x2c0 [kvm] Aug 22 05:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 924.603218] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 05:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 924.604038] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 05:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 924.604894] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 05:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 924.605694] ? __seccomp_filter+0x4a/0x4a0 Aug 22 05:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 924.606450] ? __fget_files+0x86/0xc0 Aug 22 05:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 924.607172] __x64_sys_ioctl+0x95/0xd0 Aug 22 05:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 924.607872] do_syscall_64+0x5c/0xc0 Aug 22 05:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 924.608556] ? do_futex+0x162/0x1f0 Aug 22 05:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 924.609208] ? __x64_sys_futex+0x78/0x1e0 Aug 22 05:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 924.609882] ? __secure_computing+0xa9/0x120 Aug 22 05:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 924.610587] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 05:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 924.611353] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 924.612087] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 924.612818] ? do_syscall_64+0x69/0xc0 Aug 22 05:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 924.613488] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 924.614200] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 924.614911] ? do_syscall_64+0x69/0xc0 Aug 22 05:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 924.615540] ? do_syscall_64+0x69/0xc0 Aug 22 05:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 924.616165] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 05:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 924.616878] RIP: 0033:0x7faa5d0edaff Aug 22 05:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 924.617526] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 05:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 924.619570] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 05:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 924.620486] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 05:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 924.621381] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 05:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 924.622282] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 05:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 924.623206] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 05:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 924.624134] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 05:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 924.625032] Aug 22 05:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 952.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 779s! [qemu-system-x86:6715] Aug 22 05:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 952.543285] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 05:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 952.543354] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 05:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 952.557328] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 05:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 952.558789] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 05:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 952.560177] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 05:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 952.561504] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 05:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 952.564399] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 05:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 952.565544] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 05:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 952.566858] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 05:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 952.568148] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 05:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 952.569437] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 05:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 952.570748] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 05:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 952.572046] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 05:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 952.573427] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 05:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 952.574646] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 05:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 952.575979] Call Trace: Aug 22 05:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 952.576943] Aug 22 05:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 952.577885] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 05:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 952.579025] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 05:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 952.580135] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 05:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 952.581314] ? show_regs.part.0+0x23/0x29 Aug 22 05:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 952.582406] ? show_regs.cold+0x8/0xd Aug 22 05:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 952.583451] ? watchdog_timer_fn+0x1be/0x220 Aug 22 05:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 952.584551] ? lockup_detector_update_enable+0x60/0x60 Aug 22 05:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 952.585717] ? __hrtimer_run_queues+0x107/0x230 Aug 22 05:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 952.586868] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 05:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 952.587981] ? hrtimer_interrupt+0x101/0x220 Aug 22 05:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 952.589084] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 05:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 952.590288] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 05:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 952.591430] Aug 22 05:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 952.592329] Aug 22 05:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 952.593226] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 05:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 952.594386] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 05:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 952.595539] ? _raw_spin_lock+0x22/0x30 Aug 22 05:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 952.596573] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 05:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 952.597685] direct_page_fault+0x206/0x310 [kvm] Aug 22 05:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 952.598863] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 05:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 952.599886] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 05:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 952.600898] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 05:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 952.601866] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 05:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 952.602834] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 05:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 952.603843] handle_exit+0x98/0x230 [kvm_amd] Aug 22 05:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 952.604790] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 05:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 952.605709] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 05:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 952.606655] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 05:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 952.607555] vcpu_run+0x62/0x2c0 [kvm] Aug 22 05:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 952.608378] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 05:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 952.609191] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 05:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 952.610075] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 05:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 952.610874] ? __seccomp_filter+0x4a/0x4a0 Aug 22 05:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 952.611617] ? __fget_files+0x86/0xc0 Aug 22 05:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 952.612333] __x64_sys_ioctl+0x95/0xd0 Aug 22 05:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 952.613030] do_syscall_64+0x5c/0xc0 Aug 22 05:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 952.613697] ? do_futex+0x162/0x1f0 Aug 22 05:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 952.614468] ? __x64_sys_futex+0x78/0x1e0 Aug 22 05:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 952.615205] ? __secure_computing+0xa9/0x120 Aug 22 05:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 952.615934] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 05:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 952.616701] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 952.617424] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 952.618159] ? do_syscall_64+0x69/0xc0 Aug 22 05:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 952.618805] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 952.619507] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 952.620215] ? do_syscall_64+0x69/0xc0 Aug 22 05:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 952.620843] ? do_syscall_64+0x69/0xc0 Aug 22 05:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 952.621465] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 05:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 952.622187] RIP: 0033:0x7faa5d0edaff Aug 22 05:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 952.622813] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 05:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 952.624794] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 05:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 952.625706] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 05:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 952.626619] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 05:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 952.627508] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 05:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 952.628396] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 05:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 952.629286] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 05:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 952.630200] Aug 22 05:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 980.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 805s! [qemu-system-x86:6715] Aug 22 05:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 980.543902] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 05:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 980.544152] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 05:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 980.558072] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 05:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 980.559535] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 05:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 980.560928] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 05:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 980.562109] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 05:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 980.564995] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 05:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 980.566166] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 05:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 980.567460] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 05:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 980.568749] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 05:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 980.570053] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 05:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 980.571350] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 05:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 980.572653] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 05:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 980.574050] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 05:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 980.575256] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 05:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 980.576577] Call Trace: Aug 22 05:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 980.577551] Aug 22 05:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 980.578503] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 05:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 980.579621] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 05:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 980.580728] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 05:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 980.581932] ? show_regs.part.0+0x23/0x29 Aug 22 05:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 980.583021] ? show_regs.cold+0x8/0xd Aug 22 05:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 980.584067] ? watchdog_timer_fn+0x1be/0x220 Aug 22 05:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 980.585164] ? lockup_detector_update_enable+0x60/0x60 Aug 22 05:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 980.586347] ? __hrtimer_run_queues+0x107/0x230 Aug 22 05:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 980.587462] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 05:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 980.588570] ? hrtimer_interrupt+0x101/0x220 Aug 22 05:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 980.589703] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 05:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 980.590877] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 05:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 980.592018] Aug 22 05:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 980.592931] Aug 22 05:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 980.593840] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 05:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 980.594979] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 05:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 980.596121] ? _raw_spin_lock+0x22/0x30 Aug 22 05:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 980.597159] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 05:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 980.598264] direct_page_fault+0x206/0x310 [kvm] Aug 22 05:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 980.599390] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 05:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 980.600491] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 05:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 980.601600] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 05:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 980.602722] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 05:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 980.603772] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 05:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 980.604869] handle_exit+0x98/0x230 [kvm_amd] Aug 22 05:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 980.605867] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 05:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 980.606880] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 05:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 980.607903] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 05:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 980.608917] vcpu_run+0x62/0x2c0 [kvm] Aug 22 05:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 980.609821] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 05:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 980.610727] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 05:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 980.611683] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 05:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 980.612575] ? __seccomp_filter+0x4a/0x4a0 Aug 22 05:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 980.613402] ? __fget_files+0x86/0xc0 Aug 22 05:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 980.614196] __x64_sys_ioctl+0x95/0xd0 Aug 22 05:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 980.614976] do_syscall_64+0x5c/0xc0 Aug 22 05:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 980.615717] ? do_futex+0x162/0x1f0 Aug 22 05:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 980.616437] ? __x64_sys_futex+0x78/0x1e0 Aug 22 05:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 980.617194] ? __secure_computing+0xa9/0x120 Aug 22 05:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 980.617988] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 05:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 980.618859] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 980.619673] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 980.620487] ? do_syscall_64+0x69/0xc0 Aug 22 05:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 980.621211] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 980.622023] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 980.622822] ? do_syscall_64+0x69/0xc0 Aug 22 05:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 980.623527] ? do_syscall_64+0x69/0xc0 Aug 22 05:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 980.624228] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 05:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 980.625036] RIP: 0033:0x7faa5d0edaff Aug 22 05:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 980.625786] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 05:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 980.628107] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 05:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 980.629160] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 05:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 980.630200] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 05:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 980.631232] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 05:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 980.632256] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 05:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 980.633281] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 05:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 980.634319] Aug 22 05:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 1008.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 831s! [qemu-system-x86:6715] Aug 22 05:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 1008.543069] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 05:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 1008.543136] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 05:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 1008.555177] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 05:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 1008.556435] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 05:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 1008.557664] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 05:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 1008.558718] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 05:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 1008.561254] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 05:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 1008.562319] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 05:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 1008.563519] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 05:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 1008.564705] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 05:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 1008.565898] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 05:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 1008.567068] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 05:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 1008.568260] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 05:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 1008.569510] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 05:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 1008.570604] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 05:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 1008.571790] Call Trace: Aug 22 05:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 1008.572707] Aug 22 05:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 1008.573604] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 05:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 1008.574634] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 05:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 1008.575657] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 05:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 1008.576729] ? show_regs.part.0+0x23/0x29 Aug 22 05:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 1008.577737] ? show_regs.cold+0x8/0xd Aug 22 05:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 1008.578710] ? watchdog_timer_fn+0x1be/0x220 Aug 22 05:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 1008.579716] ? lockup_detector_update_enable+0x60/0x60 Aug 22 05:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 1008.580777] ? __hrtimer_run_queues+0x107/0x230 Aug 22 05:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 1008.583510] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 05:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 1008.584563] ? hrtimer_interrupt+0x101/0x220 Aug 22 05:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 1008.585780] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 05:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 1008.586845] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 05:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 1008.587888] Aug 22 05:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 1008.588738] Aug 22 05:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 1008.589591] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 05:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 1008.590628] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 05:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 1008.591664] ? _raw_spin_lock+0x22/0x30 Aug 22 05:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 1008.592605] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 05:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 1008.593637] direct_page_fault+0x206/0x310 [kvm] Aug 22 05:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 1008.594664] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 05:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 1008.595669] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 05:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 1008.596667] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 05:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 1008.597653] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 05:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 1008.598595] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 05:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 1008.599569] handle_exit+0x98/0x230 [kvm_amd] Aug 22 05:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 1008.600459] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 05:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 1008.601384] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 05:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 1008.602304] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 05:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 1008.603203] vcpu_run+0x62/0x2c0 [kvm] Aug 22 05:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 1008.604010] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 05:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 1008.604814] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 05:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 1008.605677] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 05:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 1008.606473] ? __seccomp_filter+0x4a/0x4a0 Aug 22 05:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 1008.607211] ? __fget_files+0x86/0xc0 Aug 22 05:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 1008.607911] __x64_sys_ioctl+0x95/0xd0 Aug 22 05:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 1008.608599] do_syscall_64+0x5c/0xc0 Aug 22 05:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 1008.609261] ? do_futex+0x162/0x1f0 Aug 22 05:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 1008.609917] ? __x64_sys_futex+0x78/0x1e0 Aug 22 05:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 1008.610587] ? __secure_computing+0xa9/0x120 Aug 22 05:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 1008.611274] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 05:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 1008.612029] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 1008.612747] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 1008.613477] ? do_syscall_64+0x69/0xc0 Aug 22 05:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 1008.614120] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 1008.614819] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 1008.615511] ? do_syscall_64+0x69/0xc0 Aug 22 05:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 1008.616133] ? do_syscall_64+0x69/0xc0 Aug 22 05:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 1008.616757] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 05:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 1008.617475] RIP: 0033:0x7faa5d0edaff Aug 22 05:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 1008.618114] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 05:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 1008.620093] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 05:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 1008.620998] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 05:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 1008.621900] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 05:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 1008.622789] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 05:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 1008.623671] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 05:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 1008.624553] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 05:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 1008.625460] Aug 22 05:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 1036.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 857s! [qemu-system-x86:6715] Aug 22 05:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 1036.543034] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 05:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 1036.543102] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 05:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 1036.554919] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 05:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 1036.556140] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 05:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 1036.557341] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 05:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 1036.558385] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 05:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 1036.560906] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 05:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 1036.562037] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 05:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 1036.563257] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 05:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 1036.564401] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 05:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 1036.565551] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 05:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 1036.566708] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 05:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 1036.567844] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 05:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 1036.569052] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 05:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 1036.570130] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 05:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 1036.571458] Call Trace: Aug 22 05:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 1036.572359] Aug 22 05:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 1036.573270] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 05:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 1036.574284] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 05:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 1036.575286] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 05:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 1036.576341] ? show_regs.part.0+0x23/0x29 Aug 22 05:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 1036.577335] ? show_regs.cold+0x8/0xd Aug 22 05:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 1036.578298] ? watchdog_timer_fn+0x1be/0x220 Aug 22 05:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 1036.579292] ? lockup_detector_update_enable+0x60/0x60 Aug 22 05:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 1036.580361] ? __hrtimer_run_queues+0x107/0x230 Aug 22 05:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 1036.581383] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 05:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 1036.582388] ? hrtimer_interrupt+0x101/0x220 Aug 22 05:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 1036.583390] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 05:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 1036.584432] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 05:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 1036.585477] Aug 22 05:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 1036.586323] Aug 22 05:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 1036.587154] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 05:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 1036.588163] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 05:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 1036.589201] ? _raw_spin_lock+0x22/0x30 Aug 22 05:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 1036.590130] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 05:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 1036.591177] direct_page_fault+0x206/0x310 [kvm] Aug 22 05:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 1036.592367] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 05:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 1036.593795] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 05:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 1036.594928] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 05:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 1036.596012] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 05:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 1036.597069] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 05:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 1036.598147] handle_exit+0x98/0x230 [kvm_amd] Aug 22 05:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 1036.599129] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 05:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 1036.600155] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 05:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 1036.601209] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 05:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 1036.602207] vcpu_run+0x62/0x2c0 [kvm] Aug 22 05:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 1036.603117] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 05:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 1036.603994] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 05:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 1036.604958] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 05:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 1036.605863] ? __seccomp_filter+0x4a/0x4a0 Aug 22 05:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 1036.606701] ? __fget_files+0x86/0xc0 Aug 22 05:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 1036.607476] __x64_sys_ioctl+0x95/0xd0 Aug 22 05:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 1036.608229] do_syscall_64+0x5c/0xc0 Aug 22 05:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 1036.608974] ? do_futex+0x162/0x1f0 Aug 22 05:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 1036.609705] ? __x64_sys_futex+0x78/0x1e0 Aug 22 05:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 1036.610440] ? __secure_computing+0xa9/0x120 Aug 22 05:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 1036.611244] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 05:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 1036.612091] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 1036.612891] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 1036.613702] ? do_syscall_64+0x69/0xc0 Aug 22 05:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 1036.614406] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 1036.615184] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 1036.615960] ? do_syscall_64+0x69/0xc0 Aug 22 05:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 1036.616646] ? do_syscall_64+0x69/0xc0 Aug 22 05:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 1036.617357] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 05:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 1036.618151] RIP: 0033:0x7faa5d0edaff Aug 22 05:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 1036.618835] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 05:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 1036.621103] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 05:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 1036.622125] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 05:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 1036.623156] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 05:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 1036.624196] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 05:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 1036.625215] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 05:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 1036.626210] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 05:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 1036.627239] Aug 22 05:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 1064.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 883s! [qemu-system-x86:6715] Aug 22 05:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 1064.543112] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 05:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 1064.543179] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 05:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 1064.555423] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 05:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 1064.556720] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 05:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 1064.557976] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 05:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 1064.559056] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 05:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 1064.561691] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 05:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 1064.562735] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 05:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 1064.563898] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 05:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 1064.565070] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 05:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 1064.566234] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 05:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 1064.567389] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 05:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 1064.568550] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 05:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 1064.569787] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 05:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 1064.570887] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 05:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 1064.572075] Call Trace: Aug 22 05:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 1064.572997] Aug 22 05:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 1064.573879] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 05:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 1064.574908] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 05:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 1064.575926] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 05:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 1064.577019] ? show_regs.part.0+0x23/0x29 Aug 22 05:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 1064.578016] ? show_regs.cold+0x8/0xd Aug 22 05:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 1064.578988] ? watchdog_timer_fn+0x1be/0x220 Aug 22 05:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 1064.580105] ? lockup_detector_update_enable+0x60/0x60 Aug 22 05:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 1064.581338] ? __hrtimer_run_queues+0x107/0x230 Aug 22 05:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 1064.582380] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 05:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 1064.583402] ? hrtimer_interrupt+0x101/0x220 Aug 22 05:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 1064.584418] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 05:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 1064.585501] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 05:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 1064.586548] Aug 22 05:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 1064.587401] Aug 22 05:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 1064.588238] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 05:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 1064.589289] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 05:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 1064.590331] ? _raw_spin_lock+0x22/0x30 Aug 22 05:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 1064.591277] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 05:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 1064.592307] direct_page_fault+0x206/0x310 [kvm] Aug 22 05:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 1064.593355] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 05:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 1064.594365] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 05:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 1064.595372] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 05:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 1064.596342] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 05:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 1064.597297] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 05:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 1064.598280] handle_exit+0x98/0x230 [kvm_amd] Aug 22 05:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 1064.599171] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 05:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 1064.600085] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 05:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 1064.601038] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 05:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 1064.601947] vcpu_run+0x62/0x2c0 [kvm] Aug 22 05:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 1064.602759] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 05:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 1064.603568] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 05:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 1064.604428] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 05:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 1064.605247] ? __seccomp_filter+0x4a/0x4a0 Aug 22 05:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 1064.605994] ? __fget_files+0x86/0xc0 Aug 22 05:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 1064.606698] __x64_sys_ioctl+0x95/0xd0 Aug 22 05:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 1064.607396] do_syscall_64+0x5c/0xc0 Aug 22 05:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 1064.608063] ? do_futex+0x162/0x1f0 Aug 22 05:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 1064.608722] ? __x64_sys_futex+0x78/0x1e0 Aug 22 05:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 1064.609404] ? __secure_computing+0xa9/0x120 Aug 22 05:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 1064.610254] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 05:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 1064.611097] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 1064.611823] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 1064.612541] ? do_syscall_64+0x69/0xc0 Aug 22 05:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 1064.613200] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 1064.613903] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 1064.614603] ? do_syscall_64+0x69/0xc0 Aug 22 05:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 1064.615228] ? do_syscall_64+0x69/0xc0 Aug 22 05:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 1064.615859] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 05:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 1064.616563] RIP: 0033:0x7faa5d0edaff Aug 22 05:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 1064.617218] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 05:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 1064.619199] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 05:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 1064.620115] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 05:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 1064.621014] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 05:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 1064.621903] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 05:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 1064.622790] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 05:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 1064.623681] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 05:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 1064.624571] Aug 22 05:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 1077.260712] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 05:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 1077.262360] rcu: 1-....: (239264 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=116569 Aug 22 05:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 1077.263563] (t=240015 jiffies g=23269 q=9562) Aug 22 05:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 1077.264398] NMI backtrace for cpu 1 Aug 22 05:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 1077.265257] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 05:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 1077.266464] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 05:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 1077.267576] Call Trace: Aug 22 05:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 1077.268293] Aug 22 05:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 1077.269038] show_stack+0x52/0x5c Aug 22 05:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 1077.269811] dump_stack_lvl+0x4a/0x63 Aug 22 05:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 1077.270600] dump_stack+0x10/0x16 Aug 22 05:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 1077.271403] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 05:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 1077.272251] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 05:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 1077.273126] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 05:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 1077.274019] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 05:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 1077.274931] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 05:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 1077.275811] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 05:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 1077.276663] print_cpu_stall.cold+0x2f/0xe2 Aug 22 05:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 1077.277467] ? timekeeping_update+0xf7/0x150 Aug 22 05:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 1077.278266] check_cpu_stall+0x109/0x270 Aug 22 05:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 1077.279043] rcu_sched_clock_irq+0x9a/0x250 Aug 22 05:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 1077.279831] update_process_times+0x94/0xd0 Aug 22 05:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 1077.280629] tick_sched_handle+0x29/0x70 Aug 22 05:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 1077.281477] tick_sched_timer+0x8c/0xc0 Aug 22 05:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 1077.282254] ? tick_nohz_handler+0xb0/0xb0 Aug 22 05:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 1077.283031] __hrtimer_run_queues+0x107/0x230 Aug 22 05:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 1077.283825] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 05:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 1077.284650] hrtimer_interrupt+0x101/0x220 Aug 22 05:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 1077.285431] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 05:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 1077.286271] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 05:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 1077.287114] Aug 22 05:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 1077.287767] Aug 22 05:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 1077.288413] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 05:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 1077.289272] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 05:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 1077.290179] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 05:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 1077.292504] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 05:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 1077.293426] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 05:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 1077.294447] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 05:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 1077.295443] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 05:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 1077.296620] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 05:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 1077.297677] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 05:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 1077.298649] ? _raw_spin_lock+0x22/0x30 Aug 22 05:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 1077.299444] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 05:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 1077.300316] direct_page_fault+0x206/0x310 [kvm] Aug 22 05:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 1077.301210] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 05:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 1077.302152] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 05:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 1077.303034] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 05:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 1077.303892] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 05:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 1077.304784] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 05:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 1077.305644] handle_exit+0x98/0x230 [kvm_amd] Aug 22 05:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 1077.306432] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 05:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 1077.307267] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 05:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 1077.308110] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 05:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 1077.308956] vcpu_run+0x62/0x2c0 [kvm] Aug 22 05:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 1077.309711] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 05:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 1077.310483] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 05:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 1077.311326] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 05:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 1077.312138] ? __seccomp_filter+0x4a/0x4a0 Aug 22 05:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 1077.312951] ? __fget_files+0x86/0xc0 Aug 22 05:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 1077.313698] __x64_sys_ioctl+0x95/0xd0 Aug 22 05:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 1077.314435] do_syscall_64+0x5c/0xc0 Aug 22 05:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 1077.315158] ? do_futex+0x162/0x1f0 Aug 22 05:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 1077.315872] ? __x64_sys_futex+0x78/0x1e0 Aug 22 05:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 1077.316647] ? __secure_computing+0xa9/0x120 Aug 22 05:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 1077.317410] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 05:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 1077.318258] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 1077.319059] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 1077.319864] ? do_syscall_64+0x69/0xc0 Aug 22 05:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 1077.320614] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 1077.321442] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 1077.322244] ? do_syscall_64+0x69/0xc0 Aug 22 05:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 1077.323065] ? do_syscall_64+0x69/0xc0 Aug 22 05:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 1077.323794] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 05:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 1077.324614] RIP: 0033:0x7faa5d0edaff Aug 22 05:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 1077.325356] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 05:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 1077.327690] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 05:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 1077.328727] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 05:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 1077.329705] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 05:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 1077.330682] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 05:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 1077.331666] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 05:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 1077.332642] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 05:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 1077.333667] Aug 22 05:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 1104.541982] watchdog: BUG: soft lockup - CPU#1 stuck for 920s! [qemu-system-x86:6715] Aug 22 05:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 1104.543141] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 05:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 1104.543444] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 05:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 1104.556222] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 05:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 1104.557568] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 05:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 1104.558825] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 05:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 1104.559889] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 05:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 1104.562490] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 05:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 1104.563551] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 05:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 1104.564736] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 05:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 1104.565899] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 05:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 1104.567066] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 05:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 1104.568264] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 05:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 1104.569451] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 05:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 1104.570687] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 05:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 1104.571785] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 05:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 1104.573004] Call Trace: Aug 22 05:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 1104.573928] Aug 22 05:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 1104.574831] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 05:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 1104.575870] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 05:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 1104.576907] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 05:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 1104.578001] ? show_regs.part.0+0x23/0x29 Aug 22 05:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 1104.579006] ? show_regs.cold+0x8/0xd Aug 22 05:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 1104.579987] ? watchdog_timer_fn+0x1be/0x220 Aug 22 05:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 1104.581024] ? lockup_detector_update_enable+0x60/0x60 Aug 22 05:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 1104.582090] ? __hrtimer_run_queues+0x107/0x230 Aug 22 05:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 1104.583135] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 05:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 1104.584168] ? hrtimer_interrupt+0x101/0x220 Aug 22 05:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 1104.585201] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 05:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 1104.586276] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 05:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 1104.587328] Aug 22 05:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 1104.588210] Aug 22 05:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 1104.589062] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 05:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 1104.590102] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 05:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 1104.591146] ? _raw_spin_lock+0x22/0x30 Aug 22 05:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 1104.592090] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 05:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 1104.593119] direct_page_fault+0x206/0x310 [kvm] Aug 22 05:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 1104.594142] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 05:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 1104.595150] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 05:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 1104.596152] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 05:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 1104.597138] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 05:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 1104.598084] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 05:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 1104.599067] handle_exit+0x98/0x230 [kvm_amd] Aug 22 05:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 1104.599972] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 05:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 1104.600950] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 05:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 1104.601888] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 05:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 1104.602841] vcpu_run+0x62/0x2c0 [kvm] Aug 22 05:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 1104.603657] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 05:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 1104.604546] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 05:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 1104.605431] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 05:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 1104.606255] ? __seccomp_filter+0x4a/0x4a0 Aug 22 05:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 1104.607022] ? __fget_files+0x86/0xc0 Aug 22 05:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 1104.607726] __x64_sys_ioctl+0x95/0xd0 Aug 22 05:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 1104.608438] do_syscall_64+0x5c/0xc0 Aug 22 05:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 1104.609110] ? do_futex+0x162/0x1f0 Aug 22 05:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 1104.609765] ? __x64_sys_futex+0x78/0x1e0 Aug 22 05:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 1104.610442] ? __secure_computing+0xa9/0x120 Aug 22 05:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 1104.611137] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 05:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 1104.611907] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 1104.612641] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 1104.613366] ? do_syscall_64+0x69/0xc0 Aug 22 05:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 1104.614016] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 1104.614724] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 1104.615425] ? do_syscall_64+0x69/0xc0 Aug 22 05:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 1104.616053] ? do_syscall_64+0x69/0xc0 Aug 22 05:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 1104.616691] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 05:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 1104.617427] RIP: 0033:0x7faa5d0edaff Aug 22 05:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 1104.618055] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 05:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 1104.620111] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 05:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 1104.621042] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 05:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 1104.621939] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 05:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 1104.622836] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 05:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 1104.623738] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 05:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 1104.624641] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 05:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 1104.625545] Aug 22 05:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 1132.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 946s! [qemu-system-x86:6715] Aug 22 05:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 1132.543106] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 05:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 1132.543178] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 05:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 1132.556952] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 05:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 1132.558425] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 05:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 1132.559670] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 05:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 1132.560758] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 05:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 1132.563352] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 05:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 1132.564432] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 05:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 1132.565597] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 05:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 1132.566760] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 05:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 1132.567947] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 05:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 1132.569114] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 05:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 1132.570316] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 05:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 1132.571546] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 05:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 1132.572781] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 05:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 1132.573986] Call Trace: Aug 22 05:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 1132.574987] Aug 22 05:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 1132.575919] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 05:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 1132.576964] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 05:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 1132.577989] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 05:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 1132.579065] ? show_regs.part.0+0x23/0x29 Aug 22 05:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 1132.580143] ? show_regs.cold+0x8/0xd Aug 22 05:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 1132.581132] ? watchdog_timer_fn+0x1be/0x220 Aug 22 05:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 1132.582259] ? lockup_detector_update_enable+0x60/0x60 Aug 22 05:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 1132.583421] ? __hrtimer_run_queues+0x107/0x230 Aug 22 05:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 1132.584675] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 05:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 1132.585893] ? hrtimer_interrupt+0x101/0x220 Aug 22 05:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 1132.586927] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 05:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 1132.588048] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 05:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 1132.589104] Aug 22 05:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 1132.589966] Aug 22 05:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 1132.590809] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 05:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 1132.591899] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 05:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 1132.592945] ? _raw_spin_lock+0x22/0x30 Aug 22 05:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 1132.593897] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 05:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 1132.594921] direct_page_fault+0x206/0x310 [kvm] Aug 22 05:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 1132.595966] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 05:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 1132.596976] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 05:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 1132.597979] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 05:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 1132.598949] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 05:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 1132.599946] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 05:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 1132.600937] handle_exit+0x98/0x230 [kvm_amd] Aug 22 05:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 1132.601831] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 05:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 1132.602887] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 05:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 1132.603967] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 05:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 1132.605003] vcpu_run+0x62/0x2c0 [kvm] Aug 22 05:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 1132.605845] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 05:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 1132.606666] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 05:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 1132.607526] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 05:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 1132.608354] ? __seccomp_filter+0x4a/0x4a0 Aug 22 05:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 1132.609100] ? __fget_files+0x86/0xc0 Aug 22 05:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 1132.609811] __x64_sys_ioctl+0x95/0xd0 Aug 22 05:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 1132.610504] do_syscall_64+0x5c/0xc0 Aug 22 05:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 1132.611174] ? do_futex+0x162/0x1f0 Aug 22 05:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 1132.611843] ? __x64_sys_futex+0x78/0x1e0 Aug 22 05:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 1132.612521] ? __secure_computing+0xa9/0x120 Aug 22 05:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 1132.613215] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 05:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 1132.613981] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 1132.614703] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 1132.615424] ? do_syscall_64+0x69/0xc0 Aug 22 05:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 1132.616182] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 1132.617297] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 1132.618107] ? do_syscall_64+0x69/0xc0 Aug 22 05:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 1132.618918] ? do_syscall_64+0x69/0xc0 Aug 22 05:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 1132.619547] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 05:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 1132.620288] RIP: 0033:0x7faa5d0edaff Aug 22 05:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 1132.620915] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 05:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 1132.622912] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 05:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 1132.623844] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 05:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 1132.624738] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 05:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 1132.625637] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 05:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 1132.626528] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 05:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 1132.627420] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 05:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 1132.628340] Aug 22 05:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 1160.541976] watchdog: BUG: soft lockup - CPU#1 stuck for 972s! [qemu-system-x86:6715] Aug 22 05:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 1160.543362] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 05:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 1160.543535] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 05:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 1160.555683] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 05:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 1160.556958] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 05:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 1160.558177] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 05:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 1160.559235] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 05:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 1160.561787] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 05:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 1160.562827] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 05:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 1160.563996] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 05:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 1160.565155] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 05:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 1160.566312] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 05:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 1160.567483] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 05:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 1160.568647] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 05:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 1160.569882] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 05:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 1160.570984] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 05:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 1160.572249] Call Trace: Aug 22 05:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 1160.573185] Aug 22 05:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 1160.574088] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 05:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 1160.575133] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 05:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 1160.576188] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 05:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 1160.577307] ? show_regs.part.0+0x23/0x29 Aug 22 05:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 1160.578320] ? show_regs.cold+0x8/0xd Aug 22 05:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 1160.579310] ? watchdog_timer_fn+0x1be/0x220 Aug 22 05:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 1160.580343] ? lockup_detector_update_enable+0x60/0x60 Aug 22 05:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 1160.581423] ? __hrtimer_run_queues+0x107/0x230 Aug 22 05:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 1160.582467] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 05:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 1160.583513] ? hrtimer_interrupt+0x101/0x220 Aug 22 05:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 1160.584538] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 05:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 1160.585616] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 05:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 1160.586675] Aug 22 05:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 1160.587547] Aug 22 05:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 1160.588400] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 05:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 1160.589443] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 05:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 1160.590495] ? _raw_spin_lock+0x22/0x30 Aug 22 05:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 1160.591465] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 05:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 1160.592493] direct_page_fault+0x206/0x310 [kvm] Aug 22 05:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 1160.593530] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 05:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 1160.594552] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 05:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 1160.595582] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 05:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 1160.596582] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 05:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 1160.597536] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 05:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 1160.598520] handle_exit+0x98/0x230 [kvm_amd] Aug 22 05:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 1160.599420] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 05:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 1160.600371] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 05:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 1160.601306] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 05:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 1160.602223] vcpu_run+0x62/0x2c0 [kvm] Aug 22 05:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 1160.603058] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 05:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 1160.603887] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 05:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 1160.604757] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 05:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 1160.605569] ? __seccomp_filter+0x4a/0x4a0 Aug 22 05:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 1160.606318] ? __fget_files+0x86/0xc0 Aug 22 05:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 1160.607034] __x64_sys_ioctl+0x95/0xd0 Aug 22 05:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 1160.607750] do_syscall_64+0x5c/0xc0 Aug 22 05:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 1160.608425] ? do_futex+0x162/0x1f0 Aug 22 05:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 1160.609086] ? __x64_sys_futex+0x78/0x1e0 Aug 22 05:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 1160.609766] ? __secure_computing+0xa9/0x120 Aug 22 05:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 1160.610468] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 05:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 1160.611237] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 1160.611984] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 1160.612711] ? do_syscall_64+0x69/0xc0 Aug 22 05:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 1160.613368] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 1160.614082] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 1160.614784] ? do_syscall_64+0x69/0xc0 Aug 22 05:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 1160.615415] ? do_syscall_64+0x69/0xc0 Aug 22 05:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 1160.616062] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 05:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 1160.616776] RIP: 0033:0x7faa5d0edaff Aug 22 05:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 1160.617411] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 05:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 1160.619411] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 05:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 1160.620349] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 05:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 1160.621252] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 05:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 1160.622148] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 05:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 1160.623039] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 05:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 1160.623951] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 05:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 1160.624851] Aug 22 05:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 1188.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 998s! [qemu-system-x86:6715] Aug 22 05:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 1188.543757] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 05:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 1188.543952] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 05:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 1188.556494] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 05:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 1188.557792] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 05:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 1188.559026] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 05:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 1188.560272] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 05:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 1188.563263] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 05:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 1188.564347] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 05:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 1188.565520] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 05:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 1188.566819] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 05:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 1188.568131] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 05:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 1188.569438] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 05:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 1188.570741] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 05:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 1188.572133] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 05:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 1188.573338] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 05:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 1188.574673] Call Trace: Aug 22 05:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 1188.575778] Aug 22 05:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 1188.576734] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 05:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 1188.577861] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 05:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 1188.578966] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 05:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 1188.580155] ? show_regs.part.0+0x23/0x29 Aug 22 05:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 1188.581235] ? show_regs.cold+0x8/0xd Aug 22 05:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 1188.582279] ? watchdog_timer_fn+0x1be/0x220 Aug 22 05:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 1188.583396] ? lockup_detector_update_enable+0x60/0x60 Aug 22 05:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 1188.584562] ? __hrtimer_run_queues+0x107/0x230 Aug 22 05:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 1188.585685] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 05:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 1188.586793] ? hrtimer_interrupt+0x101/0x220 Aug 22 05:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 1188.587906] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 05:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 1188.589076] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 05:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 1188.590224] Aug 22 05:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 1188.591148] Aug 22 05:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 1188.592037] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 05:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 1188.593177] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 05:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 1188.594327] ? _raw_spin_lock+0x22/0x30 Aug 22 05:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 1188.595364] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 05:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 1188.596480] direct_page_fault+0x206/0x310 [kvm] Aug 22 05:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 1188.597597] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 05:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 1188.598704] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 05:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 1188.599820] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 05:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 1188.600910] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 05:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 1188.601945] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 05:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 1188.603034] handle_exit+0x98/0x230 [kvm_amd] Aug 22 05:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 1188.604026] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 05:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 1188.605030] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 05:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 1188.606054] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 05:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 1188.607058] vcpu_run+0x62/0x2c0 [kvm] Aug 22 05:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 1188.607968] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 05:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 1188.608856] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 05:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 1188.609803] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 05:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 1188.610688] ? __seccomp_filter+0x4a/0x4a0 Aug 22 05:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 1188.611531] ? __fget_files+0x86/0xc0 Aug 22 05:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 1188.612321] __x64_sys_ioctl+0x95/0xd0 Aug 22 05:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 1188.613086] do_syscall_64+0x5c/0xc0 Aug 22 05:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 1188.613837] ? do_futex+0x162/0x1f0 Aug 22 05:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 1188.614647] ? __x64_sys_futex+0x78/0x1e0 Aug 22 05:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 1188.615541] ? __secure_computing+0xa9/0x120 Aug 22 05:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 1188.616455] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 05:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 1188.617252] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 1188.617978] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 1188.618705] ? do_syscall_64+0x69/0xc0 Aug 22 05:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 1188.619365] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 1188.620073] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 1188.620780] ? do_syscall_64+0x69/0xc0 Aug 22 05:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 1188.621412] ? do_syscall_64+0x69/0xc0 Aug 22 05:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 1188.622035] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 05:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 1188.622757] RIP: 0033:0x7faa5d0edaff Aug 22 05:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 1188.623442] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 05:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 1188.625439] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 05:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 1188.626355] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 05:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 1188.627266] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 05:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 1188.628155] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 05:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 1188.629062] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 05:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 1188.629953] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 05:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 1188.630845] Aug 22 05:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 1216.541976] watchdog: BUG: soft lockup - CPU#1 stuck for 1024s! [qemu-system-x86:6715] Aug 22 05:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 1216.545028] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 05:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 1216.545096] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 05:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 1216.559554] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 05:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 1216.560828] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 05:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 1216.562047] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 05:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 1216.563127] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 05:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 1216.565692] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 05:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 1216.566743] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 05:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 1216.567922] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 05:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 1216.569185] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 05:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 1216.570414] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 05:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 1216.571688] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 05:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 1216.573031] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 05:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 1216.574450] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 05:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 1216.575767] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 05:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 1216.577059] Call Trace: Aug 22 05:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 1216.578108] Aug 22 05:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 1216.579137] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 05:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 1216.580179] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 05:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 1216.581211] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 05:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 1216.582307] ? show_regs.part.0+0x23/0x29 Aug 22 05:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 1216.583320] ? show_regs.cold+0x8/0xd Aug 22 05:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 1216.584405] ? watchdog_timer_fn+0x1be/0x220 Aug 22 05:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 1216.585518] ? lockup_detector_update_enable+0x60/0x60 Aug 22 05:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 1216.586726] ? __hrtimer_run_queues+0x107/0x230 Aug 22 05:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 1216.587825] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 05:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 1216.588984] ? hrtimer_interrupt+0x101/0x220 Aug 22 05:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 1216.590009] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 05:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 1216.591093] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 05:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 1216.592148] Aug 22 05:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 1216.593036] Aug 22 05:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 1216.593946] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 05:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 1216.594997] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 05:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 1216.596043] ? _raw_spin_lock+0x22/0x30 Aug 22 05:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 1216.596988] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 05:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 1216.598010] direct_page_fault+0x206/0x310 [kvm] Aug 22 05:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 1216.599044] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 05:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 1216.600057] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 05:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 1216.601059] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 05:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 1216.602030] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 05:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 1216.602986] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 05:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 1216.603966] handle_exit+0x98/0x230 [kvm_amd] Aug 22 05:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 1216.604864] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 05:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 1216.605779] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 05:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 1216.606703] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 05:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 1216.607611] vcpu_run+0x62/0x2c0 [kvm] Aug 22 05:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 1216.608421] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 05:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 1216.609234] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 05:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 1216.610089] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 05:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 1216.610899] ? __seccomp_filter+0x4a/0x4a0 Aug 22 05:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 1216.611642] ? __fget_files+0x86/0xc0 Aug 22 05:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 1216.612347] __x64_sys_ioctl+0x95/0xd0 Aug 22 05:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 1216.613038] do_syscall_64+0x5c/0xc0 Aug 22 05:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 1216.613708] ? do_futex+0x162/0x1f0 Aug 22 05:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 1216.614356] ? __x64_sys_futex+0x78/0x1e0 Aug 22 05:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 1216.615036] ? __secure_computing+0xa9/0x120 Aug 22 05:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 1216.615726] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 05:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 1216.616492] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 1216.617215] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 1216.617932] ? do_syscall_64+0x69/0xc0 Aug 22 05:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 1216.618581] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 1216.619293] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 1216.619992] ? do_syscall_64+0x69/0xc0 Aug 22 05:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 1216.620617] ? do_syscall_64+0x69/0xc0 Aug 22 05:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 1216.621239] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 05:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 1216.621943] RIP: 0033:0x7faa5d0edaff Aug 22 05:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 1216.622566] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 05:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 1216.624566] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 05:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 1216.625477] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 05:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 1216.626366] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 05:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 1216.627259] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 05:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 1216.628146] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 05:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 1216.629034] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 05:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 1216.629929] Aug 22 05:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 1244.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 1051s! [qemu-system-x86:6715] Aug 22 05:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 1244.543199] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 05:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 1244.543267] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 05:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 1244.555856] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 05:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 1244.557119] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 05:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 1244.558339] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 05:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 1244.559466] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 05:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 1244.562002] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 05:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 1244.563103] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 05:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 1244.564267] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 05:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 1244.565421] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 05:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 1244.566640] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 05:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 1244.567810] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 05:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 1244.568977] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 05:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 1244.570211] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 05:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 1244.571355] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 05:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 1244.572545] Call Trace: Aug 22 05:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 1244.573455] Aug 22 05:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 1244.574334] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 05:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 1244.575422] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 05:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 1244.576441] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 05:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 1244.577525] ? show_regs.part.0+0x23/0x29 Aug 22 05:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 1244.578560] ? show_regs.cold+0x8/0xd Aug 22 05:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 1244.579545] ? watchdog_timer_fn+0x1be/0x220 Aug 22 05:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 1244.580558] ? lockup_detector_update_enable+0x60/0x60 Aug 22 05:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 1244.581619] ? __hrtimer_run_queues+0x107/0x230 Aug 22 05:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 1244.582722] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 05:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 1244.583746] ? hrtimer_interrupt+0x101/0x220 Aug 22 05:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 1244.584756] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 05:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 1244.585835] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 05:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 1244.586929] Aug 22 05:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 1244.587780] Aug 22 05:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 1244.588694] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 05:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 1244.589730] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 05:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 1244.590851] ? _raw_spin_lock+0x22/0x30 Aug 22 05:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 1244.591806] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 05:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 1244.592841] direct_page_fault+0x206/0x310 [kvm] Aug 22 05:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 1244.593862] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 05:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 1244.594875] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 05:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 1244.595880] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 05:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 1244.596848] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 05:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 1244.597795] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 05:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 1244.599337] handle_exit+0x98/0x230 [kvm_amd] Aug 22 05:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 1244.600237] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 05:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 1244.601158] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 05:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 1244.602085] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 05:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 1244.603043] vcpu_run+0x62/0x2c0 [kvm] Aug 22 05:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 1244.603855] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 05:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 1244.604660] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 05:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 1244.605516] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 05:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 1244.606309] ? __seccomp_filter+0x4a/0x4a0 Aug 22 05:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 1244.607113] ? __fget_files+0x86/0xc0 Aug 22 05:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 1244.607816] __x64_sys_ioctl+0x95/0xd0 Aug 22 05:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 1244.608506] do_syscall_64+0x5c/0xc0 Aug 22 05:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 1244.609170] ? do_futex+0x162/0x1f0 Aug 22 05:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 1244.609816] ? __x64_sys_futex+0x78/0x1e0 Aug 22 05:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 1244.610519] ? __secure_computing+0xa9/0x120 Aug 22 05:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 1244.611265] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 05:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 1244.612036] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 1244.612758] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 1244.613474] ? do_syscall_64+0x69/0xc0 Aug 22 05:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 1244.614123] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 1244.614914] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 1244.615613] ? do_syscall_64+0x69/0xc0 Aug 22 05:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 1244.616235] ? do_syscall_64+0x69/0xc0 Aug 22 05:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 1244.616861] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 05:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 1244.617565] RIP: 0033:0x7faa5d0edaff Aug 22 05:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 1244.618190] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 05:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 1244.620217] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 05:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 1244.621129] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 05:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 1244.622016] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 05:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 1244.622986] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 05:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 1244.623880] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 05:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 1244.624762] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 05:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 1244.625649] Aug 22 05:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 1257.272706] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 05:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 1257.274339] rcu: 1-....: (284127 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=138429 Aug 22 05:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 1257.275445] (t=285018 jiffies g=23269 q=9725) Aug 22 05:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 1257.276212] NMI backtrace for cpu 1 Aug 22 05:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 1257.276916] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 05:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 1257.278017] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 05:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 1257.279087] Call Trace: Aug 22 05:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 1257.279759] Aug 22 05:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 1257.280412] show_stack+0x52/0x5c Aug 22 05:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 1257.281138] dump_stack_lvl+0x4a/0x63 Aug 22 05:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 1257.281884] dump_stack+0x10/0x16 Aug 22 05:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 1257.282607] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 05:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 1257.283389] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 05:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 1257.284169] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 05:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 1257.284989] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 05:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 1257.285804] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 05:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 1257.286619] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 05:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 1257.287393] print_cpu_stall.cold+0x2f/0xe2 Aug 22 05:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 1257.288154] ? timekeeping_update+0xf7/0x150 Aug 22 05:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 1257.288920] check_cpu_stall+0x109/0x270 Aug 22 05:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 1257.289661] rcu_sched_clock_irq+0x9a/0x250 Aug 22 05:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 1257.290424] update_process_times+0x94/0xd0 Aug 22 05:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 1257.291187] tick_sched_handle+0x29/0x70 Aug 22 05:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 1257.291929] tick_sched_timer+0x8c/0xc0 Aug 22 05:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 1257.292662] ? tick_nohz_handler+0xb0/0xb0 Aug 22 05:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 1257.293413] __hrtimer_run_queues+0x107/0x230 Aug 22 05:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 1257.294186] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 05:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 1257.294964] hrtimer_interrupt+0x101/0x220 Aug 22 05:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 1257.295718] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 05:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 1257.296524] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 05:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 1257.297322] Aug 22 05:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 1257.297956] Aug 22 05:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 1257.298587] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 05:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 1257.299403] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 05:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 1257.300283] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 05:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 1257.302490] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 05:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 1257.303361] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 05:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 1257.304351] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 05:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 1257.305324] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 05:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 1257.306293] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 05:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 1257.307244] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 05:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 1257.308197] ? _raw_spin_lock+0x22/0x30 Aug 22 05:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 1257.308958] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 05:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 1257.309802] direct_page_fault+0x206/0x310 [kvm] Aug 22 05:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 1257.310650] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 05:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 1257.311480] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 05:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 1257.312308] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 05:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 1257.313128] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 05:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 1257.313910] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 05:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 1257.314741] handle_exit+0x98/0x230 [kvm_amd] Aug 22 05:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 1257.315503] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 05:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 1257.316284] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 05:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 1257.317084] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 05:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 1257.317869] vcpu_run+0x62/0x2c0 [kvm] Aug 22 05:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 1257.318597] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 05:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 1257.319336] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 05:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 1257.320140] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 05:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 1257.320906] ? __seccomp_filter+0x4a/0x4a0 Aug 22 05:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 1257.321625] ? __fget_files+0x86/0xc0 Aug 22 05:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 1257.322328] __x64_sys_ioctl+0x95/0xd0 Aug 22 05:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 1257.323026] do_syscall_64+0x5c/0xc0 Aug 22 05:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 1257.323706] ? do_futex+0x162/0x1f0 Aug 22 05:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 1257.324375] ? __x64_sys_futex+0x78/0x1e0 Aug 22 05:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 1257.325080] ? __secure_computing+0xa9/0x120 Aug 22 05:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 1257.325795] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 05:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 1257.326595] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 1257.327348] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 1257.328099] ? do_syscall_64+0x69/0xc0 Aug 22 05:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 1257.328786] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 1257.329545] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 1257.330311] ? do_syscall_64+0x69/0xc0 Aug 22 05:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 1257.331008] ? do_syscall_64+0x69/0xc0 Aug 22 05:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 1257.331770] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 05:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 1257.332634] RIP: 0033:0x7faa5d0edaff Aug 22 05:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 1257.333426] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 05:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 1257.335889] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 05:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 1257.336988] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 05:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 1257.338067] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 05:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 1257.339152] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 05:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 1257.340224] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 05:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 1257.341284] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 05:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 1257.342350] Aug 22 05:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 1284.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 1088s! [qemu-system-x86:6715] Aug 22 05:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 1284.543107] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 05:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 1284.543394] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 05:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 1284.555528] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 05:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 1284.556790] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 05:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 1284.558021] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 05:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 1284.559081] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 05:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 1284.561630] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 05:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 1284.562689] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 05:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 1284.563860] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 05:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 1284.565034] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 05:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 1284.566235] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 05:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 1284.567414] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 05:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 1284.568590] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 05:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 1284.569884] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 05:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 1284.571001] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 05:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 1284.572199] Call Trace: Aug 22 05:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 1284.573112] Aug 22 05:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 1284.574016] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 05:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 1284.575049] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 05:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 1284.576069] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 05:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 1284.577146] ? show_regs.part.0+0x23/0x29 Aug 22 05:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 1284.578159] ? show_regs.cold+0x8/0xd Aug 22 05:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 1284.579129] ? watchdog_timer_fn+0x1be/0x220 Aug 22 05:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 1284.580140] ? lockup_detector_update_enable+0x60/0x60 Aug 22 05:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 1284.581204] ? __hrtimer_run_queues+0x107/0x230 Aug 22 05:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 1284.582243] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 05:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 1284.583266] ? hrtimer_interrupt+0x101/0x220 Aug 22 05:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 1284.584278] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 05:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 1284.585344] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 05:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 1284.586401] Aug 22 05:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 1284.587258] Aug 22 05:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 1284.588092] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 05:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 1284.589124] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 05:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 1284.590181] ? _raw_spin_lock+0x22/0x30 Aug 22 05:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 1284.591125] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 05:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 1284.592139] direct_page_fault+0x206/0x310 [kvm] Aug 22 05:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 1284.593159] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 05:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 1284.594178] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 05:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 1284.595179] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 05:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 1284.596145] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 05:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 1284.597087] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 05:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 1284.598073] handle_exit+0x98/0x230 [kvm_amd] Aug 22 05:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 1284.598964] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 05:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 1284.599874] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 05:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 1284.600795] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 05:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 1284.601696] vcpu_run+0x62/0x2c0 [kvm] Aug 22 05:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 1284.602519] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 05:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 1284.603324] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 05:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 1284.604174] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 05:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 1284.604970] ? __seccomp_filter+0x4a/0x4a0 Aug 22 05:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 1284.605715] ? __fget_files+0x86/0xc0 Aug 22 05:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 1284.606431] __x64_sys_ioctl+0x95/0xd0 Aug 22 05:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 1284.607122] do_syscall_64+0x5c/0xc0 Aug 22 05:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 1284.607783] ? do_futex+0x162/0x1f0 Aug 22 05:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 1284.608434] ? __x64_sys_futex+0x78/0x1e0 Aug 22 05:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 1284.609103] ? __secure_computing+0xa9/0x120 Aug 22 05:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 1284.609789] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 05:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 1284.610551] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 1284.611269] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 1284.611984] ? do_syscall_64+0x69/0xc0 Aug 22 05:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 1284.612625] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 1284.613332] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 1284.614038] ? do_syscall_64+0x69/0xc0 Aug 22 05:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 1284.614662] ? do_syscall_64+0x69/0xc0 Aug 22 05:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 1284.615283] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 05:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 1284.615985] RIP: 0033:0x7faa5d0edaff Aug 22 05:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 1284.616606] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 05:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 1284.618596] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 05:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 1284.619504] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 05:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 1284.620389] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 05:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 1284.621275] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 05:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 1284.622164] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 05:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 1284.623050] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 05:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 1284.623938] Aug 22 05:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 1312.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 1114s! [qemu-system-x86:6715] Aug 22 05:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 1312.543097] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 05:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 1312.543165] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 05:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 1312.555279] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 05:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 1312.556546] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 05:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 1312.557812] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 05:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 1312.558896] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 05:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 1312.561482] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 05:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 1312.562541] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 05:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 1312.563699] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 05:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 1312.564856] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 05:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 1312.566033] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 05:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 1312.567191] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 05:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 1312.568397] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 05:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 1312.569662] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 05:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 1312.570809] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 05:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 1312.572008] Call Trace: Aug 22 05:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 1312.572924] Aug 22 05:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 1312.573831] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 05:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 1312.574879] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 05:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 1312.575917] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 05:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 1312.576992] ? show_regs.part.0+0x23/0x29 Aug 22 05:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 1312.578044] ? show_regs.cold+0x8/0xd Aug 22 05:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 1312.579055] ? watchdog_timer_fn+0x1be/0x220 Aug 22 05:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 1312.580071] ? lockup_detector_update_enable+0x60/0x60 Aug 22 05:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 1312.581136] ? __hrtimer_run_queues+0x107/0x230 Aug 22 05:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 1312.582187] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 05:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 1312.583214] ? hrtimer_interrupt+0x101/0x220 Aug 22 05:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 1312.584232] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 05:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 1312.585306] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 05:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 1312.586511] Aug 22 05:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 1312.587382] Aug 22 05:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 1312.588222] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 05:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 1312.589282] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 05:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 1312.590349] ? _raw_spin_lock+0x22/0x30 Aug 22 05:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 1312.591298] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 05:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 1312.592322] direct_page_fault+0x206/0x310 [kvm] Aug 22 05:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 1312.593350] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 05:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 1312.594524] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 05:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 1312.596146] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 05:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 1312.597392] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 05:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 1312.598732] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 05:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 1312.600037] handle_exit+0x98/0x230 [kvm_amd] Aug 22 05:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 1312.601235] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 05:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 1312.602463] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 05:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 1312.603683] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 05:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 1312.604888] vcpu_run+0x62/0x2c0 [kvm] Aug 22 05:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 1312.606014] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 05:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 1312.607155] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 05:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 1312.608623] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 05:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 1312.610017] ? __seccomp_filter+0x4a/0x4a0 Aug 22 05:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 1312.611288] ? __fget_files+0x86/0xc0 Aug 22 05:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 1312.612500] __x64_sys_ioctl+0x95/0xd0 Aug 22 05:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 1312.613458] do_syscall_64+0x5c/0xc0 Aug 22 05:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 1312.614515] ? do_futex+0x162/0x1f0 Aug 22 05:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 1312.615511] ? __x64_sys_futex+0x78/0x1e0 Aug 22 05:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 1312.616462] ? __secure_computing+0xa9/0x120 Aug 22 05:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 1312.617399] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 05:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 1312.618452] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 1312.619365] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 1312.620320] ? do_syscall_64+0x69/0xc0 Aug 22 05:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 1312.621135] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 1312.622079] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 1312.622999] ? do_syscall_64+0x69/0xc0 Aug 22 05:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 1312.623790] ? do_syscall_64+0x69/0xc0 Aug 22 05:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 1312.624603] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 05:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 1312.625571] RIP: 0033:0x7faa5d0edaff Aug 22 05:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 1312.626366] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 05:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 1312.628975] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 05:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 1312.630159] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 05:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 1312.631120] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 05:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 1312.632136] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 05:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 1312.633043] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 05:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 1312.633964] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 05:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 1312.634905] Aug 22 05:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 1340.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 1140s! [qemu-system-x86:6715] Aug 22 05:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 1340.543154] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 05:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 1340.543364] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 05:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 1340.555581] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 05:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 1340.556849] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 05:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 1340.558125] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 05:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 1340.559184] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 05:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 1340.561798] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 05:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 1340.562842] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 05:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 1340.564000] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 05:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 1340.565179] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 05:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 1340.566411] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 05:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 1340.567587] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 05:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 1340.568756] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 05:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 1340.570049] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 05:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 1340.571170] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 05:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 1340.572424] Call Trace: Aug 22 05:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 1340.573422] Aug 22 05:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 1340.574330] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 05:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 1340.575360] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 05:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 1340.576381] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 05:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 1340.577539] ? show_regs.part.0+0x23/0x29 Aug 22 05:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 1340.578559] ? show_regs.cold+0x8/0xd Aug 22 05:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 1340.579537] ? watchdog_timer_fn+0x1be/0x220 Aug 22 05:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 1340.580541] ? lockup_detector_update_enable+0x60/0x60 Aug 22 05:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 1340.581672] ? __hrtimer_run_queues+0x107/0x230 Aug 22 05:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 1340.582703] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 05:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 1340.583725] ? hrtimer_interrupt+0x101/0x220 Aug 22 05:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 1340.584739] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 05:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 1340.585872] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 05:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 1340.586916] Aug 22 05:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 1340.587767] Aug 22 05:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 1340.588601] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 05:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 1340.589711] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 05:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 1340.590754] ? _raw_spin_lock+0x22/0x30 Aug 22 05:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 1340.591696] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 05:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 1340.592714] direct_page_fault+0x206/0x310 [kvm] Aug 22 05:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 1340.593813] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 05:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 1340.594826] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 05:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 1340.595825] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 05:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 1340.596809] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 05:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 1340.597818] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 05:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 1340.598795] handle_exit+0x98/0x230 [kvm_amd] Aug 22 05:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 1340.599686] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 05:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 1340.600600] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 05:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 1340.601615] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 05:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 1340.602524] vcpu_run+0x62/0x2c0 [kvm] Aug 22 05:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 1340.603341] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 05:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 1340.604147] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 05:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 1340.605000] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 05:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 1340.605856] ? __seccomp_filter+0x4a/0x4a0 Aug 22 05:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 1340.606598] ? __fget_files+0x86/0xc0 Aug 22 05:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 1340.607300] __x64_sys_ioctl+0x95/0xd0 Aug 22 05:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 1340.607990] do_syscall_64+0x5c/0xc0 Aug 22 05:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 1340.608652] ? do_futex+0x162/0x1f0 Aug 22 05:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 1340.609341] ? __x64_sys_futex+0x78/0x1e0 Aug 22 05:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 1340.610054] ? __secure_computing+0xa9/0x120 Aug 22 05:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 1340.610769] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 05:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 1340.611530] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 1340.612260] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 1340.612984] ? do_syscall_64+0x69/0xc0 Aug 22 05:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 1340.613737] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 1340.614450] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 1340.615170] ? do_syscall_64+0x69/0xc0 Aug 22 05:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 1340.615806] ? do_syscall_64+0x69/0xc0 Aug 22 05:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 1340.616427] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 05:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 1340.617132] RIP: 0033:0x7faa5d0edaff Aug 22 05:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 1340.617854] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 05:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 1340.619839] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 05:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 1340.620748] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 05:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 1340.621750] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 05:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 1340.622641] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 05:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 1340.623528] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 05:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 1340.624414] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 05:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 1340.625587] Aug 22 05:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 1368.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 1166s! [qemu-system-x86:6715] Aug 22 05:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 1368.543640] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 05:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 1368.543775] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 05:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 1368.555919] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 05:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 1368.557245] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 05:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 1368.558659] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 05:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 1368.559739] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 05:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 1368.562380] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 05:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 1368.563431] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 05:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 1368.564598] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 05:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 1368.565783] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 05:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 1368.566949] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 05:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 1368.568120] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 05:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 1368.569313] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 05:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 1368.570552] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 05:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 1368.571650] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 05:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 1368.572900] Call Trace: Aug 22 05:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 1368.573832] Aug 22 05:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 1368.574723] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 05:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 1368.575753] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 05:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 1368.576775] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 05:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 1368.577878] ? show_regs.part.0+0x23/0x29 Aug 22 05:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 1368.578876] ? show_regs.cold+0x8/0xd Aug 22 05:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 1368.579851] ? watchdog_timer_fn+0x1be/0x220 Aug 22 05:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 1368.580882] ? lockup_detector_update_enable+0x60/0x60 Aug 22 05:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 1368.581946] ? __hrtimer_run_queues+0x107/0x230 Aug 22 05:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 1368.583153] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 05:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 1368.584283] ? hrtimer_interrupt+0x101/0x220 Aug 22 05:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 1368.585414] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 05:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 1368.586585] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 05:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 1368.587741] Aug 22 05:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 1368.588662] Aug 22 05:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 1368.589602] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 05:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 1368.590685] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 05:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 1368.591730] ? _raw_spin_lock+0x22/0x30 Aug 22 05:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 1368.592676] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 05:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 1368.593766] direct_page_fault+0x206/0x310 [kvm] Aug 22 05:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 1368.594807] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 05:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 1368.595822] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 05:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 1368.596844] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 05:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 1368.597938] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 05:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 1368.598993] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 05:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 1368.600082] handle_exit+0x98/0x230 [kvm_amd] Aug 22 05:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 1368.601087] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 05:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 1368.602104] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 05:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 1368.603135] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 05:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 1368.604155] vcpu_run+0x62/0x2c0 [kvm] Aug 22 05:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 1368.605060] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 05:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 1368.605959] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 05:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 1368.606914] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 05:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 1368.607815] ? __seccomp_filter+0x4a/0x4a0 Aug 22 05:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 1368.608642] ? __fget_files+0x86/0xc0 Aug 22 05:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 1368.609445] __x64_sys_ioctl+0x95/0xd0 Aug 22 05:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 1368.610216] do_syscall_64+0x5c/0xc0 Aug 22 05:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 1368.610959] ? do_futex+0x162/0x1f0 Aug 22 05:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 1368.611680] ? __x64_sys_futex+0x78/0x1e0 Aug 22 05:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 1368.612437] ? __secure_computing+0xa9/0x120 Aug 22 05:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 1368.613238] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 05:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 1368.614117] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 1368.614940] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 1368.615759] ? do_syscall_64+0x69/0xc0 Aug 22 05:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 1368.616481] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 1368.617308] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 1368.618098] ? do_syscall_64+0x69/0xc0 Aug 22 05:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 1368.618800] ? do_syscall_64+0x69/0xc0 Aug 22 05:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 1368.619497] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 05:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 1368.620305] RIP: 0033:0x7faa5d0edaff Aug 22 05:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 1368.621040] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 05:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 1368.623503] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 05:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 1368.624566] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 05:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 1368.625620] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 05:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 1368.626840] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 05:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 1368.627865] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 05:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 1368.628902] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 05:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 1368.629934] Aug 22 05:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 1396.541980] watchdog: BUG: soft lockup - CPU#1 stuck for 1192s! [qemu-system-x86:6715] Aug 22 05:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 1396.543098] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 05:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 1396.543168] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 05:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 1396.555392] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 05:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 1396.556673] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 05:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 1396.557898] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 05:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 1396.558964] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 05:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 1396.561688] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 05:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 1396.562753] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 05:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 1396.563919] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 05:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 1396.565105] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 05:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 1396.566266] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 05:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 1396.567433] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 05:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 1396.568617] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 05:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 1396.569864] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 05:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 1396.570966] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 05:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 1396.572157] Call Trace: Aug 22 05:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 1396.573189] Aug 22 05:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 1396.574123] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 05:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 1396.575160] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 05:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 1396.576185] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 05:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 1396.577292] ? show_regs.part.0+0x23/0x29 Aug 22 05:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 1396.578301] ? show_regs.cold+0x8/0xd Aug 22 05:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 1396.579282] ? watchdog_timer_fn+0x1be/0x220 Aug 22 05:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 1396.580418] ? lockup_detector_update_enable+0x60/0x60 Aug 22 05:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 1396.581632] ? __hrtimer_run_queues+0x107/0x230 Aug 22 05:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 1396.582773] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 05:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 1396.583831] ? hrtimer_interrupt+0x101/0x220 Aug 22 05:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 1396.584876] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 05:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 1396.585957] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 05:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 1396.587002] Aug 22 05:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 1396.587859] Aug 22 05:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 1396.588713] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 05:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 1396.589756] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 05:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 1396.590798] ? _raw_spin_lock+0x22/0x30 Aug 22 05:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 1396.591748] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 05:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 1396.592792] direct_page_fault+0x206/0x310 [kvm] Aug 22 05:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 1396.593827] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 05:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 1396.594839] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 05:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 1396.595850] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 05:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 1396.596912] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 05:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 1396.598004] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 05:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 1396.599009] handle_exit+0x98/0x230 [kvm_amd] Aug 22 05:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 1396.599908] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 05:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 1396.600850] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 05:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 1396.601889] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 05:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 1396.602798] vcpu_run+0x62/0x2c0 [kvm] Aug 22 05:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 1396.603612] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 05:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 1396.604422] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 05:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 1396.605439] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 05:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 1396.606239] ? __seccomp_filter+0x4a/0x4a0 Aug 22 05:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 1396.606984] ? __fget_files+0x86/0xc0 Aug 22 05:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 1396.607693] __x64_sys_ioctl+0x95/0xd0 Aug 22 05:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 1396.608386] do_syscall_64+0x5c/0xc0 Aug 22 05:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 1396.609072] ? do_futex+0x162/0x1f0 Aug 22 05:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 1396.609724] ? __x64_sys_futex+0x78/0x1e0 Aug 22 05:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 1396.610398] ? __secure_computing+0xa9/0x120 Aug 22 05:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 1396.611088] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 05:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 1396.611849] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 1396.612620] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 1396.613407] ? do_syscall_64+0x69/0xc0 Aug 22 05:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 1396.614062] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 1396.614773] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 1396.615472] ? do_syscall_64+0x69/0xc0 Aug 22 05:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 1396.616098] ? do_syscall_64+0x69/0xc0 Aug 22 05:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 1396.616736] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 05:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 1396.617446] RIP: 0033:0x7faa5d0edaff Aug 22 05:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 1396.618072] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 05:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 1396.620105] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 05:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 1396.621181] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 05:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 1396.622158] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 05:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 1396.623058] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 05:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 1396.623953] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 05:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 1396.624886] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 05:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 1396.625788] Aug 22 05:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 1424.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 1218s! [qemu-system-x86:6715] Aug 22 05:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 1424.543090] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 05:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 1424.543159] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 05:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 1424.557131] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 05:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 1424.558583] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 05:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 1424.559973] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 05:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 1424.561154] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 05:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 1424.564047] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 05:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 1424.565213] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 05:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 1424.566516] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 05:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 1424.567812] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 05:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 1424.569141] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 05:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 1424.570438] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 05:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 1424.571736] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 05:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 1424.573135] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 05:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 1424.574356] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 05:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 1424.575694] Call Trace: Aug 22 05:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 1424.576697] Aug 22 05:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 1424.577628] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 05:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 1424.578928] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 05:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 1424.580038] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 05:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 1424.581236] ? show_regs.part.0+0x23/0x29 Aug 22 05:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 1424.582483] ? show_regs.cold+0x8/0xd Aug 22 05:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 1424.583529] ? watchdog_timer_fn+0x1be/0x220 Aug 22 05:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 1424.584650] ? lockup_detector_update_enable+0x60/0x60 Aug 22 05:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 1424.585825] ? __hrtimer_run_queues+0x107/0x230 Aug 22 05:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 1424.586943] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 05:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 1424.588060] ? hrtimer_interrupt+0x101/0x220 Aug 22 05:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 1424.589192] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 05:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 1424.590366] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 05:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 1424.591508] Aug 22 05:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 1424.592427] Aug 22 05:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 1424.593312] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 05:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 1424.594453] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 05:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 1424.595603] ? _raw_spin_lock+0x22/0x30 Aug 22 05:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 1424.596662] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 05:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 1424.597768] direct_page_fault+0x206/0x310 [kvm] Aug 22 05:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 1424.598884] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 05:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 1424.599985] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 05:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 1424.601107] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 05:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 1424.602176] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 05:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 1424.603214] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 05:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 1424.604330] handle_exit+0x98/0x230 [kvm_amd] Aug 22 05:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 1424.605311] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 05:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 1424.606316] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 05:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 1424.607346] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 05:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 1424.608376] vcpu_run+0x62/0x2c0 [kvm] Aug 22 05:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 1424.609265] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 05:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 1424.610168] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 05:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 1424.611127] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 05:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 1424.612011] ? __seccomp_filter+0x4a/0x4a0 Aug 22 05:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 1424.612867] ? __fget_files+0x86/0xc0 Aug 22 05:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 1424.613649] __x64_sys_ioctl+0x95/0xd0 Aug 22 05:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 1424.614423] do_syscall_64+0x5c/0xc0 Aug 22 05:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 1424.615164] ? do_futex+0x162/0x1f0 Aug 22 05:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 1424.615892] ? __x64_sys_futex+0x78/0x1e0 Aug 22 05:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 1424.616680] ? __secure_computing+0xa9/0x120 Aug 22 05:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 1424.617464] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 05:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 1424.618348] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 1424.619169] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 1424.619995] ? do_syscall_64+0x69/0xc0 Aug 22 05:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 1424.620755] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 1424.621552] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 1424.622343] ? do_syscall_64+0x69/0xc0 Aug 22 05:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 1424.623048] ? do_syscall_64+0x69/0xc0 Aug 22 05:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 1424.623756] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 05:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 1424.624582] RIP: 0033:0x7faa5d0edaff Aug 22 05:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 1424.625286] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 05:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 1424.627616] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 05:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 1424.628704] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 05:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 1424.629726] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 05:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 1424.630746] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 05:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 1424.631771] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 05:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 1424.632820] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 05:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 1424.633851] Aug 22 05:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 1437.284707] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 05:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 1437.286462] rcu: 1-....: (328989 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=160289 Aug 22 05:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 1437.287939] (t=330021 jiffies g=23269 q=10079) Aug 22 05:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 1437.288805] NMI backtrace for cpu 1 Aug 22 05:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 1437.289577] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 05:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 1437.290853] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 05:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 1437.292106] Call Trace: Aug 22 05:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 1437.292843] Aug 22 05:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 1437.293545] show_stack+0x52/0x5c Aug 22 05:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 1437.294349] dump_stack_lvl+0x4a/0x63 Aug 22 05:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 1437.295165] dump_stack+0x10/0x16 Aug 22 05:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 1437.296052] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 05:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 1437.296914] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 05:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 1437.297786] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 05:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 1437.298693] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 05:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 1437.299599] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 05:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 1437.300515] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 05:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 1437.301370] print_cpu_stall.cold+0x2f/0xe2 Aug 22 05:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 1437.302214] ? timekeeping_update+0xf7/0x150 Aug 22 05:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 1437.303147] check_cpu_stall+0x109/0x270 Aug 22 05:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 1437.304045] rcu_sched_clock_irq+0x9a/0x250 Aug 22 05:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 1437.304814] update_process_times+0x94/0xd0 Aug 22 05:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 1437.305575] tick_sched_handle+0x29/0x70 Aug 22 05:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 1437.306331] tick_sched_timer+0x8c/0xc0 Aug 22 05:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 1437.307077] ? tick_nohz_handler+0xb0/0xb0 Aug 22 05:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 1437.307829] __hrtimer_run_queues+0x107/0x230 Aug 22 05:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 1437.308705] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 05:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 1437.309482] hrtimer_interrupt+0x101/0x220 Aug 22 05:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 1437.310237] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 05:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 1437.311043] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 05:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 1437.311846] Aug 22 05:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 1437.312515] Aug 22 05:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 1437.313152] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 05:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 1437.313978] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 05:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 1437.314865] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 05:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 1437.317084] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 05:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 1437.317973] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 05:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 1437.318964] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 05:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 1437.319958] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 05:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 1437.320930] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 05:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 1437.321890] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 05:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 1437.322854] ? _raw_spin_lock+0x22/0x30 Aug 22 05:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 1437.323636] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 05:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 1437.324504] direct_page_fault+0x206/0x310 [kvm] Aug 22 05:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 1437.325356] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 05:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 1437.326181] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 05:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 1437.327032] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 05:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 1437.327866] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 05:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 1437.328680] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 05:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 1437.329509] handle_exit+0x98/0x230 [kvm_amd] Aug 22 05:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 1437.330273] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 05:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 1437.331070] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 05:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 1437.331874] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 05:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 1437.332679] vcpu_run+0x62/0x2c0 [kvm] Aug 22 05:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 1437.333430] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 05:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 1437.334181] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 05:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 1437.334990] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 05:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 1437.335755] ? __seccomp_filter+0x4a/0x4a0 Aug 22 05:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 1437.336490] ? __fget_files+0x86/0xc0 Aug 22 05:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 1437.337192] __x64_sys_ioctl+0x95/0xd0 Aug 22 05:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 1437.337888] do_syscall_64+0x5c/0xc0 Aug 22 05:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 1437.338580] ? do_futex+0x162/0x1f0 Aug 22 05:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 1437.339260] ? __x64_sys_futex+0x78/0x1e0 Aug 22 05:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 1437.339989] ? __secure_computing+0xa9/0x120 Aug 22 05:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 1437.340716] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 05:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 1437.341523] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 1437.342286] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 1437.343040] ? do_syscall_64+0x69/0xc0 Aug 22 05:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 1437.343731] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 1437.344495] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 1437.345252] ? do_syscall_64+0x69/0xc0 Aug 22 05:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 1437.345945] ? do_syscall_64+0x69/0xc0 Aug 22 05:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 1437.346631] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 05:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 1437.347400] RIP: 0033:0x7faa5d0edaff Aug 22 05:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 1437.348141] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 05:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 1437.350255] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 05:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 1437.351221] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 05:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 1437.352197] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 05:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 1437.353155] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 05:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 1437.354102] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 05:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 1437.355039] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 05:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 1437.355970] Aug 22 05:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 1464.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 1255s! [qemu-system-x86:6715] Aug 22 05:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 1464.543108] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 05:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 1464.543416] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 05:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 1464.555513] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 05:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 1464.556785] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 05:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 1464.558007] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 05:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 1464.559059] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 05:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 1464.561617] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 05:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 1464.562657] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 05:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 1464.563839] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 05:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 1464.565001] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 05:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 1464.566161] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 05:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 1464.567317] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 05:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 1464.568492] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 05:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 1464.569725] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 05:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 1464.570819] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 05:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 1464.572029] Call Trace: Aug 22 05:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 1464.572938] Aug 22 05:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 1464.573819] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 05:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 1464.574845] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 05:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 1464.575881] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 05:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 1464.576963] ? show_regs.part.0+0x23/0x29 Aug 22 05:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 1464.577957] ? show_regs.cold+0x8/0xd Aug 22 05:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 1464.578925] ? watchdog_timer_fn+0x1be/0x220 Aug 22 05:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 1464.579947] ? lockup_detector_update_enable+0x60/0x60 Aug 22 05:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 1464.581009] ? __hrtimer_run_queues+0x107/0x230 Aug 22 05:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 1464.582036] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 05:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 1464.583055] ? hrtimer_interrupt+0x101/0x220 Aug 22 05:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 1464.584078] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 05:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 1464.585143] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 05:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 1464.586186] Aug 22 05:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 1464.587036] Aug 22 05:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 1464.587956] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 05:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 1464.589279] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 05:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 1464.590383] ? _raw_spin_lock+0x22/0x30 Aug 22 05:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 1464.591331] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 05:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 1464.592364] direct_page_fault+0x206/0x310 [kvm] Aug 22 05:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 1464.593384] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 05:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 1464.594395] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 05:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 1464.595391] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 05:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 1464.596374] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 05:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 1464.597317] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 05:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 1464.598291] handle_exit+0x98/0x230 [kvm_amd] Aug 22 05:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 1464.599185] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 05:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 1464.600112] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 05:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 1464.601040] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 05:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 1464.601940] vcpu_run+0x62/0x2c0 [kvm] Aug 22 05:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 1464.602748] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 05:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 1464.603553] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 05:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 1464.604422] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 05:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 1464.605222] ? __seccomp_filter+0x4a/0x4a0 Aug 22 05:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 1464.605961] ? __fget_files+0x86/0xc0 Aug 22 05:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 1464.606661] __x64_sys_ioctl+0x95/0xd0 Aug 22 05:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 1464.607350] do_syscall_64+0x5c/0xc0 Aug 22 05:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 1464.608022] ? do_futex+0x162/0x1f0 Aug 22 05:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 1464.608668] ? __x64_sys_futex+0x78/0x1e0 Aug 22 05:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 1464.609339] ? __secure_computing+0xa9/0x120 Aug 22 05:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 1464.610024] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 05:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 1464.610781] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 1464.611500] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 1464.612229] ? do_syscall_64+0x69/0xc0 Aug 22 05:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 1464.612871] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 1464.613576] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 1464.614272] ? do_syscall_64+0x69/0xc0 Aug 22 05:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 1464.614892] ? do_syscall_64+0x69/0xc0 Aug 22 05:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 1464.615530] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 05:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 1464.616540] RIP: 0033:0x7faa5d0edaff Aug 22 05:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 1464.617416] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 05:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 1464.620803] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 05:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 1464.622199] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 05:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 1464.623614] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 05:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 1464.625010] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 05:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 1464.626356] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 05:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 1464.627722] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 05:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 1464.629061] Aug 22 05:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 1492.541976] watchdog: BUG: soft lockup - CPU#1 stuck for 1282s! [qemu-system-x86:6715] Aug 22 05:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 1492.543091] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 05:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 1492.543156] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 05:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 1492.555242] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 05:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 1492.556505] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 05:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 1492.557724] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 05:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 1492.558785] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 05:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 1492.561342] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 05:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 1492.562386] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 05:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 1492.563567] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 05:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 1492.564725] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 05:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 1492.565882] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 05:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 1492.567047] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 05:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 1492.568235] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 05:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 1492.569474] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 05:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 1492.570581] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 05:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 1492.571862] Call Trace: Aug 22 05:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 1492.572781] Aug 22 05:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 1492.573666] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 05:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 1492.574697] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 05:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 1492.575747] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 05:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 1492.576832] ? show_regs.part.0+0x23/0x29 Aug 22 05:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 1492.577832] ? show_regs.cold+0x8/0xd Aug 22 05:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 1492.578802] ? watchdog_timer_fn+0x1be/0x220 Aug 22 05:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 1492.579831] ? lockup_detector_update_enable+0x60/0x60 Aug 22 05:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 1492.580902] ? __hrtimer_run_queues+0x107/0x230 Aug 22 05:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 1492.581932] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 05:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 1492.582957] ? hrtimer_interrupt+0x101/0x220 Aug 22 05:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 1492.583994] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 05:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 1492.585064] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 05:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 1492.586109] Aug 22 05:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 1492.586967] Aug 22 05:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 1492.587822] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 05:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 1492.588857] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 05:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 1492.589903] ? _raw_spin_lock+0x22/0x30 Aug 22 05:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 1492.590854] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 05:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 1492.591891] direct_page_fault+0x206/0x310 [kvm] Aug 22 05:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 1492.592925] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 05:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 1492.593940] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 05:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 1492.594941] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 05:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 1492.595938] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 05:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 1492.596895] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 05:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 1492.597875] handle_exit+0x98/0x230 [kvm_amd] Aug 22 05:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 1492.598768] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 05:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 1492.599703] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 05:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 1492.600628] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 05:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 1492.601532] vcpu_run+0x62/0x2c0 [kvm] Aug 22 05:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 1492.602351] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 05:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 1492.603159] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 05:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 1492.604028] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 05:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 1492.604825] ? __seccomp_filter+0x4a/0x4a0 Aug 22 05:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 1492.605569] ? __fget_files+0x86/0xc0 Aug 22 05:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 1492.606275] __x64_sys_ioctl+0x95/0xd0 Aug 22 05:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 1492.606970] do_syscall_64+0x5c/0xc0 Aug 22 05:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 1492.607659] ? do_futex+0x162/0x1f0 Aug 22 05:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 1492.608312] ? __x64_sys_futex+0x78/0x1e0 Aug 22 05:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 1492.608988] ? __secure_computing+0xa9/0x120 Aug 22 05:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 1492.609685] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 05:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 1492.610446] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 1492.611170] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 1492.611930] ? do_syscall_64+0x69/0xc0 Aug 22 05:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 1492.612603] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 1492.613310] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 1492.614005] ? do_syscall_64+0x69/0xc0 Aug 22 05:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 1492.614636] ? do_syscall_64+0x69/0xc0 Aug 22 05:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 1492.615280] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 05:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 1492.615988] RIP: 0033:0x7faa5d0edaff Aug 22 05:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 1492.616618] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 05:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 1492.618609] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 05:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 1492.619540] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 05:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 1492.620432] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 05:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 1492.621506] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 05:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 1492.622398] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 05:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 1492.623311] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 05:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 1492.624207] Aug 22 05:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 1520.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 1308s! [qemu-system-x86:6715] Aug 22 05:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 1520.543164] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 05:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 1520.543235] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 05:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 1520.555576] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 05:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 1520.557093] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 05:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 1520.558505] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 05:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 1520.559706] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 05:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 1520.562629] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 05:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 1520.563809] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 05:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 1520.565116] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 05:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 1520.566416] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 05:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 1520.567736] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 05:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 1520.569039] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 05:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 1520.570348] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 05:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 1520.571762] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 05:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 1520.572965] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 05:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 1520.574288] Call Trace: Aug 22 05:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 1520.575273] Aug 22 05:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 1520.576223] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 05:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 1520.577361] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 05:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 1520.578474] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 05:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 1520.579679] ? show_regs.part.0+0x23/0x29 Aug 22 05:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 1520.580753] ? show_regs.cold+0x8/0xd Aug 22 05:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 1520.581797] ? watchdog_timer_fn+0x1be/0x220 Aug 22 05:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 1520.582915] ? lockup_detector_update_enable+0x60/0x60 Aug 22 05:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 1520.584083] ? __hrtimer_run_queues+0x107/0x230 Aug 22 05:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 1520.585202] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 05:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 1520.586317] ? hrtimer_interrupt+0x101/0x220 Aug 22 05:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 1520.587451] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 05:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 1520.588636] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 05:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 1520.589781] Aug 22 05:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 1520.590688] Aug 22 05:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 1520.591594] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 05:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 1520.592753] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 05:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 1520.593911] ? _raw_spin_lock+0x22/0x30 Aug 22 05:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 1520.594964] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 05:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 1520.596073] direct_page_fault+0x206/0x310 [kvm] Aug 22 05:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 1520.597189] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 05:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 1520.598297] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 05:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 1520.599413] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 05:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 1520.600480] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 05:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 1520.601528] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 05:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 1520.602625] handle_exit+0x98/0x230 [kvm_amd] Aug 22 05:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 1520.603643] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 05:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 1520.604651] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 05:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 1520.605685] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 05:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 1520.606704] vcpu_run+0x62/0x2c0 [kvm] Aug 22 05:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 1520.607611] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 05:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 1520.608508] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 05:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 1520.609464] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 05:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 1520.610354] ? __seccomp_filter+0x4a/0x4a0 Aug 22 05:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 1520.611203] ? __fget_files+0x86/0xc0 Aug 22 05:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 1520.611985] __x64_sys_ioctl+0x95/0xd0 Aug 22 05:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 1520.612759] do_syscall_64+0x5c/0xc0 Aug 22 05:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 1520.613499] ? do_futex+0x162/0x1f0 Aug 22 05:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 1520.614221] ? __x64_sys_futex+0x78/0x1e0 Aug 22 05:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 1520.614986] ? __secure_computing+0xa9/0x120 Aug 22 05:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 1520.615760] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 05:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 1520.616627] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 1520.617448] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 1520.618275] ? do_syscall_64+0x69/0xc0 Aug 22 05:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 1520.619028] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 1520.619829] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 1520.620623] ? do_syscall_64+0x69/0xc0 Aug 22 05:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 1520.621333] ? do_syscall_64+0x69/0xc0 Aug 22 05:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 1520.622063] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 05:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 1520.622921] RIP: 0033:0x7faa5d0edaff Aug 22 05:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 1520.623626] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 05:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 1520.625958] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 05:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 1520.627028] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 05:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 1520.628052] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 05:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 1520.629075] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 05:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 1520.630097] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 05:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 1520.631154] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 05:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 1520.632188] Aug 22 05:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 1548.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 1334s! [qemu-system-x86:6715] Aug 22 05:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 1548.543673] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 05:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 1548.543909] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 05:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 1548.556065] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 05:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 1548.557347] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 05:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 1548.560808] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 05:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 1548.561871] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 05:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 1548.566603] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 05:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 1548.569959] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 05:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 1548.571148] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 05:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 1548.574437] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 05:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 1548.575626] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 05:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 1548.578895] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 05:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 1548.582152] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 05:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 1548.583414] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 05:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 1548.586616] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 05:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 1548.588282] Call Trace: Aug 22 05:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 1548.590739] Aug 22 05:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 1548.591649] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 05:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 1548.594735] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 05:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 1548.597278] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 05:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 1548.598927] ? show_regs.part.0+0x23/0x29 Aug 22 05:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 1548.602014] ? show_regs.cold+0x8/0xd Aug 22 05:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 1548.604590] ? watchdog_timer_fn+0x1be/0x220 Aug 22 05:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 1548.606128] ? lockup_detector_update_enable+0x60/0x60 Aug 22 05:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 1548.609360] ? __hrtimer_run_queues+0x107/0x230 Aug 22 05:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 1548.610393] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 05:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 1548.613588] ? hrtimer_interrupt+0x101/0x220 Aug 22 05:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 1548.615184] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 05:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 1548.617802] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 05:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 1548.621011] Aug 22 05:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 1548.621878] Aug 22 05:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 1548.624873] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 05:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 1548.625918] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 05:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 1548.628964] ? _raw_spin_lock+0x22/0x30 Aug 22 05:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 1548.629909] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 05:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 1548.633009] direct_page_fault+0x206/0x310 [kvm] Aug 22 05:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 1548.636045] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 05:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 1548.637077] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 05:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 1548.640218] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 05:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 1548.641240] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 05:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 1548.644309] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 05:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 1548.647356] handle_exit+0x98/0x230 [kvm_amd] Aug 22 05:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 1548.648279] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 05:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 1548.651217] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 05:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 1548.652170] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 05:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 1548.655318] vcpu_run+0x62/0x2c0 [kvm] Aug 22 05:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 1548.656145] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 05:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 1548.659212] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 05:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 1548.660199] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 05:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 1548.663108] ? __seccomp_filter+0x4a/0x4a0 Aug 22 05:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 1548.663956] ? __fget_files+0x86/0xc0 Aug 22 05:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 1548.666797] __x64_sys_ioctl+0x95/0xd0 Aug 22 05:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 1548.667576] do_syscall_64+0x5c/0xc0 Aug 22 05:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 1548.669165] ? do_futex+0x162/0x1f0 Aug 22 05:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 1548.671560] ? __x64_sys_futex+0x78/0x1e0 Aug 22 05:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 1548.672315] ? __secure_computing+0xa9/0x120 Aug 22 05:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 1548.675212] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 05:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 1548.676080] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 1548.679159] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 1548.679979] ? do_syscall_64+0x69/0xc0 Aug 22 05:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 1548.682812] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 1548.683616] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 1548.686566] ? do_syscall_64+0x69/0xc0 Aug 22 05:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 1548.687272] ? do_syscall_64+0x69/0xc0 Aug 22 05:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 1548.689982] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 05:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 1548.690864] RIP: 0033:0x7faa5d0edaff Aug 22 05:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 1548.692587] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 05:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 1548.698080] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 05:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 1548.699697] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 05:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 1548.702340] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 05:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 1548.705520] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 05:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 1548.706571] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 05:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 1548.709654] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 05:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 1548.712752] Aug 22 05:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 1576.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 1360s! [qemu-system-x86:6715] Aug 22 05:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 1576.543103] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 05:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 1576.543173] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 05:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 1576.555233] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 05:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 1576.556496] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 05:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 1576.557714] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 05:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 1576.558796] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 05:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 1576.561346] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 05:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 1576.562406] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 05:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 1576.563574] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 05:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 1576.564737] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 05:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 1576.565898] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 05:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 1576.567084] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 05:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 1576.568252] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 05:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 1576.569494] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 05:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 1576.570609] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 05:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 1576.571809] Call Trace: Aug 22 05:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 1576.572727] Aug 22 05:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 1576.573614] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 05:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 1576.574666] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 05:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 1576.575686] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 05:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 1576.576767] ? show_regs.part.0+0x23/0x29 Aug 22 05:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 1576.577770] ? show_regs.cold+0x8/0xd Aug 22 05:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 1576.578757] ? watchdog_timer_fn+0x1be/0x220 Aug 22 05:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 1576.579767] ? lockup_detector_update_enable+0x60/0x60 Aug 22 05:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 1576.580829] ? __hrtimer_run_queues+0x107/0x230 Aug 22 05:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 1576.581857] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 05:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 1576.582894] ? hrtimer_interrupt+0x101/0x220 Aug 22 05:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 1576.583917] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 05:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 1576.584984] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 05:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 1576.586028] Aug 22 05:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 1576.586895] Aug 22 05:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 1576.587730] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 05:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 1576.588769] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 05:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 1576.589811] ? _raw_spin_lock+0x22/0x30 Aug 22 05:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 1576.590770] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 05:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 1576.591785] direct_page_fault+0x206/0x310 [kvm] Aug 22 05:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 1576.592811] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 05:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 1576.593818] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 05:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 1576.594839] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 05:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 1576.595813] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 05:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 1576.596761] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 05:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 1576.597737] handle_exit+0x98/0x230 [kvm_amd] Aug 22 05:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 1576.598646] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 05:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 1576.599630] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 05:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 1576.600551] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 05:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 1576.601453] vcpu_run+0x62/0x2c0 [kvm] Aug 22 05:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 1576.602283] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 05:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 1576.603089] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 05:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 1576.603941] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 05:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 1576.604739] ? __seccomp_filter+0x4a/0x4a0 Aug 22 05:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 1576.605479] ? __fget_files+0x86/0xc0 Aug 22 05:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 1576.606203] __x64_sys_ioctl+0x95/0xd0 Aug 22 05:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 1576.606894] do_syscall_64+0x5c/0xc0 Aug 22 05:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 1576.607562] ? do_futex+0x162/0x1f0 Aug 22 05:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 1576.608215] ? __x64_sys_futex+0x78/0x1e0 Aug 22 05:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 1576.608889] ? __secure_computing+0xa9/0x120 Aug 22 05:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 1576.609578] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 05:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 1576.610352] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 1576.611074] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 1576.611791] ? do_syscall_64+0x69/0xc0 Aug 22 05:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 1576.612440] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 1576.613144] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 1576.613840] ? do_syscall_64+0x69/0xc0 Aug 22 05:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 1576.614488] ? do_syscall_64+0x69/0xc0 Aug 22 05:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 1576.615111] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 05:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 1576.615816] RIP: 0033:0x7faa5d0edaff Aug 22 05:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 1576.616440] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 05:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 1576.618457] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 05:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 1576.619369] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 05:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 1576.620259] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 05:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 1576.621150] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 05:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 1576.622036] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 05:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 1576.622959] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 05:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 1576.623853] Aug 22 05:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 1604.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 1386s! [qemu-system-x86:6715] Aug 22 05:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 1604.543094] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 05:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 1604.543165] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 05:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 1604.555514] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 05:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 1604.556784] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 05:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 1604.558027] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 05:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 1604.559084] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 05:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 1604.561632] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 05:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 1604.562701] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 05:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 1604.563862] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 05:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 1604.565024] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 05:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 1604.566209] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 05:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 1604.567372] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 05:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 1604.568541] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 05:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 1604.569775] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 05:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 1604.570889] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 05:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 1604.572081] Call Trace: Aug 22 05:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 1604.572994] Aug 22 05:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 1604.573905] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 05:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 1604.574937] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 05:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 1604.575959] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 05:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 1604.577039] ? show_regs.part.0+0x23/0x29 Aug 22 05:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 1604.578064] ? show_regs.cold+0x8/0xd Aug 22 05:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 1604.579041] ? watchdog_timer_fn+0x1be/0x220 Aug 22 05:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 1604.580049] ? lockup_detector_update_enable+0x60/0x60 Aug 22 05:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 1604.581116] ? __hrtimer_run_queues+0x107/0x230 Aug 22 05:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 1604.582165] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 05:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 1604.583193] ? hrtimer_interrupt+0x101/0x220 Aug 22 05:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 1604.584210] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 05:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 1604.585276] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 05:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 1604.586338] Aug 22 05:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 1604.587199] Aug 22 05:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 1604.588036] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 05:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 1604.589069] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 05:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 1604.590131] ? _raw_spin_lock+0x22/0x30 Aug 22 05:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 1604.591077] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 05:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 1604.592098] direct_page_fault+0x206/0x310 [kvm] Aug 22 05:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 1604.593126] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 05:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 1604.594159] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 05:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 1604.595166] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 05:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 1604.596146] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 05:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 1604.597092] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 05:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 1604.598096] handle_exit+0x98/0x230 [kvm_amd] Aug 22 05:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 1604.598995] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 05:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 1604.599911] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 05:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 1604.600834] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 05:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 1604.601744] vcpu_run+0x62/0x2c0 [kvm] Aug 22 05:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 1604.602581] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 05:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 1604.603389] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 05:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 1604.604248] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 05:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 1604.605045] ? __seccomp_filter+0x4a/0x4a0 Aug 22 05:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 1604.605790] ? __fget_files+0x86/0xc0 Aug 22 05:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 1604.606516] __x64_sys_ioctl+0x95/0xd0 Aug 22 05:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 1604.607212] do_syscall_64+0x5c/0xc0 Aug 22 05:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 1604.607879] ? do_futex+0x162/0x1f0 Aug 22 05:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 1604.608535] ? __x64_sys_futex+0x78/0x1e0 Aug 22 05:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 1604.609212] ? __secure_computing+0xa9/0x120 Aug 22 05:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 1604.609927] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 05:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 1604.610690] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 1604.611422] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 1604.612142] ? do_syscall_64+0x69/0xc0 Aug 22 05:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 1604.612788] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 1604.613494] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 1604.614210] ? do_syscall_64+0x69/0xc0 Aug 22 05:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 1604.614837] ? do_syscall_64+0x69/0xc0 Aug 22 05:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 1604.615460] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 05:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 1604.616167] RIP: 0033:0x7faa5d0edaff Aug 22 05:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 1604.616801] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 05:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 1604.618810] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 05:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 1604.619721] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 05:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 1604.620613] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 05:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 1604.621503] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 05:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 1604.622419] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 05:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 1604.623310] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 05:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 1604.624204] Aug 22 05:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 1617.296706] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 05:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 1617.297742] rcu: 1-....: (373832 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=182089 Aug 22 05:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 1617.298853] (t=375024 jiffies g=23269 q=10216) Aug 22 05:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 1617.299633] NMI backtrace for cpu 1 Aug 22 05:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 1617.300341] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 05:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 1617.301443] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 05:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 1617.302517] Call Trace: Aug 22 05:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 1617.303193] Aug 22 05:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 1617.303841] show_stack+0x52/0x5c Aug 22 05:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 1617.304566] dump_stack_lvl+0x4a/0x63 Aug 22 05:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 1617.305310] dump_stack+0x10/0x16 Aug 22 05:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 1617.306060] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 05:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 1617.306843] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 05:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 1617.307625] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 05:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 1617.308453] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 05:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 1617.309283] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 05:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 1617.310128] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 05:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 1617.310902] print_cpu_stall.cold+0x2f/0xe2 Aug 22 05:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 1617.311665] ? timekeeping_update+0xf7/0x150 Aug 22 05:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 1617.312440] check_cpu_stall+0x109/0x270 Aug 22 05:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 1617.313200] rcu_sched_clock_irq+0x9a/0x250 Aug 22 05:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 1617.313983] update_process_times+0x94/0xd0 Aug 22 05:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 1617.314748] tick_sched_handle+0x29/0x70 Aug 22 05:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 1617.315500] tick_sched_timer+0x8c/0xc0 Aug 22 05:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 1617.316327] ? tick_nohz_handler+0xb0/0xb0 Aug 22 05:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 1617.317187] __hrtimer_run_queues+0x107/0x230 Aug 22 05:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 1617.318105] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 05:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 1617.318901] hrtimer_interrupt+0x101/0x220 Aug 22 05:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 1617.319739] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 05:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 1617.320679] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 05:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 1617.321608] Aug 22 05:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 1617.322355] Aug 22 05:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 1617.323073] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 05:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 1617.324046] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 05:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 1617.325038] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 05:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 1617.327676] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 05:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 1617.328742] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 05:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 1617.329840] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 05:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 1617.330908] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 05:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 1617.332051] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 05:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 1617.333143] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 05:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 1617.334271] ? _raw_spin_lock+0x22/0x30 Aug 22 05:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 1617.335175] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 05:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 1617.336152] direct_page_fault+0x206/0x310 [kvm] Aug 22 05:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 1617.337004] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 05:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 1617.337865] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 05:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 1617.338699] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 05:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 1617.339542] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 05:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 1617.340329] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 05:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 1617.341152] handle_exit+0x98/0x230 [kvm_amd] Aug 22 05:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 1617.341926] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 05:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 1617.342715] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 05:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 1617.343520] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 05:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 1617.344311] vcpu_run+0x62/0x2c0 [kvm] Aug 22 05:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 1617.345029] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 05:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 1617.345785] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 05:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 1617.346591] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 05:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 1617.347354] ? __seccomp_filter+0x4a/0x4a0 Aug 22 05:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 1617.348084] ? __fget_files+0x86/0xc0 Aug 22 05:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 1617.348783] __x64_sys_ioctl+0x95/0xd0 Aug 22 05:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 1617.349480] do_syscall_64+0x5c/0xc0 Aug 22 05:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 1617.350185] ? do_futex+0x162/0x1f0 Aug 22 05:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 1617.350864] ? __x64_sys_futex+0x78/0x1e0 Aug 22 05:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 1617.351571] ? __secure_computing+0xa9/0x120 Aug 22 05:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 1617.352289] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 05:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 1617.353083] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 1617.353864] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 1617.354625] ? do_syscall_64+0x69/0xc0 Aug 22 05:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 1617.355316] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 1617.356072] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 1617.356858] ? do_syscall_64+0x69/0xc0 Aug 22 05:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 1617.357565] ? do_syscall_64+0x69/0xc0 Aug 22 05:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 1617.358283] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 05:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 1617.359057] RIP: 0033:0x7faa5d0edaff Aug 22 05:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 1617.359892] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 05:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 1617.362218] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 05:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 1617.363184] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 05:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 1617.364136] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 05:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 1617.365084] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 05:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 1617.366053] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 05:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 1617.366984] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 05:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 1617.367902] Aug 22 05:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 1644.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 1423s! [qemu-system-x86:6715] Aug 22 05:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 1644.543677] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 05:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 1644.543915] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 05:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 1644.556515] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 05:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 1644.557798] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 05:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 1644.559029] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 05:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 1644.560091] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 05:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 1644.562667] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 05:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 1644.563735] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 05:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 1644.564900] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 05:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 1644.566104] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 05:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 1644.567295] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 05:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 1644.568494] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 05:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 1644.569738] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 05:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 1644.571230] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 05:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 1644.572341] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 05:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 1644.573602] Call Trace: Aug 22 05:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 1644.574541] Aug 22 05:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 1644.575434] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 05:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 1644.576462] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 05:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 1644.577508] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 05:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 1644.578587] ? show_regs.part.0+0x23/0x29 Aug 22 05:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 1644.579615] ? show_regs.cold+0x8/0xd Aug 22 05:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 1644.580600] ? watchdog_timer_fn+0x1be/0x220 Aug 22 05:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 1644.581635] ? lockup_detector_update_enable+0x60/0x60 Aug 22 05:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 1644.582698] ? __hrtimer_run_queues+0x107/0x230 Aug 22 05:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 1644.583729] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 05:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 1644.584781] ? hrtimer_interrupt+0x101/0x220 Aug 22 05:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 1644.585864] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 05:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 1644.587126] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 05:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 1644.588186] Aug 22 05:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 1644.589120] Aug 22 05:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 1644.589995] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 05:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 1644.591023] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 05:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 1644.592056] ? _raw_spin_lock+0x22/0x30 Aug 22 05:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 1644.593007] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 05:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 1644.594075] direct_page_fault+0x206/0x310 [kvm] Aug 22 05:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 1644.595106] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 05:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 1644.596131] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 05:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 1644.597188] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 05:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 1644.598189] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 05:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 1644.599175] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 05:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 1644.600173] handle_exit+0x98/0x230 [kvm_amd] Aug 22 05:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 1644.601106] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 05:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 1644.602193] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 05:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 1644.603217] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 05:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 1644.604124] vcpu_run+0x62/0x2c0 [kvm] Aug 22 05:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 1644.604973] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 05:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 1644.605811] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 05:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 1644.606674] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 05:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 1644.607469] ? __seccomp_filter+0x4a/0x4a0 Aug 22 05:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 1644.608209] ? __fget_files+0x86/0xc0 Aug 22 05:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 1644.608916] __x64_sys_ioctl+0x95/0xd0 Aug 22 05:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 1644.609679] do_syscall_64+0x5c/0xc0 Aug 22 05:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 1644.610358] ? do_futex+0x162/0x1f0 Aug 22 05:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 1644.611006] ? __x64_sys_futex+0x78/0x1e0 Aug 22 05:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 1644.611677] ? __secure_computing+0xa9/0x120 Aug 22 05:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 1644.612370] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 05:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 1644.613126] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 1644.613857] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 1644.614607] ? do_syscall_64+0x69/0xc0 Aug 22 05:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 1644.615273] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 1644.615983] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 1644.616674] ? do_syscall_64+0x69/0xc0 Aug 22 05:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 1644.617297] ? do_syscall_64+0x69/0xc0 Aug 22 05:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 1644.618005] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 05:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 1644.618880] RIP: 0033:0x7faa5d0edaff Aug 22 05:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 1644.619538] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 05:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 1644.621586] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 05:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 1644.622510] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 05:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 1644.623401] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 05:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 1644.624285] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 05:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 1644.625177] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 05:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 1644.626147] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 05:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 1644.627474] Aug 22 05:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 1672.541983] watchdog: BUG: soft lockup - CPU#1 stuck for 1449s! [qemu-system-x86:6715] Aug 22 05:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 1672.543093] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 05:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 1672.543162] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 05:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 1672.555466] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 05:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 1672.556778] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 05:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 1672.558040] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 05:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 1672.559141] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 05:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 1672.561826] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 05:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 1672.562885] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 05:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 1672.564077] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 05:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 1672.565317] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 05:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 1672.566524] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 05:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 1672.567700] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 05:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 1672.568882] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 05:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 1672.570155] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 05:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 1672.571269] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 05:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 1672.572500] Call Trace: Aug 22 05:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 1672.573439] Aug 22 05:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 1672.574359] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 05:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 1672.575407] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 05:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 1672.576445] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 05:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 1672.577548] ? show_regs.part.0+0x23/0x29 Aug 22 05:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 1672.578588] ? show_regs.cold+0x8/0xd Aug 22 05:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 1672.579645] ? watchdog_timer_fn+0x1be/0x220 Aug 22 05:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 1672.580699] ? lockup_detector_update_enable+0x60/0x60 Aug 22 05:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 1672.581817] ? __hrtimer_run_queues+0x107/0x230 Aug 22 05:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 1672.582864] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 05:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 1672.583900] ? hrtimer_interrupt+0x101/0x220 Aug 22 05:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 1672.584949] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 05:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 1672.586066] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 05:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 1672.587126] Aug 22 05:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 1672.587984] Aug 22 05:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 1672.588822] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 05:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 1672.589881] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 05:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 1672.590928] ? _raw_spin_lock+0x22/0x30 Aug 22 05:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 1672.591880] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 05:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 1672.592925] direct_page_fault+0x206/0x310 [kvm] Aug 22 05:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 1672.593998] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 05:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 1672.595027] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 05:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 1672.596083] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 05:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 1672.597113] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 05:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 1672.598083] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 05:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 1672.599077] handle_exit+0x98/0x230 [kvm_amd] Aug 22 05:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 1672.599976] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 05:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 1672.600898] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 05:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 1672.601921] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 05:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 1672.602920] vcpu_run+0x62/0x2c0 [kvm] Aug 22 05:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 1672.603765] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 05:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 1672.604590] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 05:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 1672.605484] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 05:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 1672.606294] ? __seccomp_filter+0x4a/0x4a0 Aug 22 05:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 1672.607106] ? __fget_files+0x86/0xc0 Aug 22 05:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 1672.607827] __x64_sys_ioctl+0x95/0xd0 Aug 22 05:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 1672.608526] do_syscall_64+0x5c/0xc0 Aug 22 05:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 1672.609219] ? do_futex+0x162/0x1f0 Aug 22 05:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 1672.609883] ? __x64_sys_futex+0x78/0x1e0 Aug 22 05:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 1672.610571] ? __secure_computing+0xa9/0x120 Aug 22 05:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 1672.611279] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 05:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 1672.612048] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 1672.612834] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 1672.613594] ? do_syscall_64+0x69/0xc0 Aug 22 05:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 1672.614253] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 1672.614966] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 1672.615699] ? do_syscall_64+0x69/0xc0 Aug 22 05:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 1672.616354] ? do_syscall_64+0x69/0xc0 Aug 22 05:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 1672.617007] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 05:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 1672.617775] RIP: 0033:0x7faa5d0edaff Aug 22 05:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 1672.618411] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 05:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 1672.620454] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 05:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 1672.621428] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 05:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 1672.622363] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 05:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 1672.623380] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 05:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 1672.624349] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 05:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 1672.625264] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 05:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 1672.626164] Aug 22 05:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 1700.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 1475s! [qemu-system-x86:6715] Aug 22 05:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 1700.543101] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 05:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 1700.543169] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 05:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 1700.555470] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 05:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 1700.556796] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 05:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 1700.558032] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 05:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 1700.559101] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 05:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 1700.561748] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 05:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 1700.562829] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 05:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 1700.564001] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 05:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 1700.565187] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 05:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 1700.566362] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 05:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 1700.567529] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 05:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 1700.568722] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 05:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 1700.569992] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 05:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 1700.571111] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 05:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 1700.572325] Call Trace: Aug 22 05:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 1700.573266] Aug 22 05:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 1700.574151] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 05:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 1700.575189] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 05:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 1700.576238] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 05:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 1700.577363] ? show_regs.part.0+0x23/0x29 Aug 22 05:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 1700.578365] ? show_regs.cold+0x8/0xd Aug 22 05:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 1700.579345] ? watchdog_timer_fn+0x1be/0x220 Aug 22 05:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 1700.580387] ? lockup_detector_update_enable+0x60/0x60 Aug 22 05:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 1700.581495] ? __hrtimer_run_queues+0x107/0x230 Aug 22 05:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 1700.582540] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 05:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 1700.583570] ? hrtimer_interrupt+0x101/0x220 Aug 22 05:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 1700.584604] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 05:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 1700.585718] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 05:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 1700.586763] Aug 22 05:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 1700.587645] Aug 22 05:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 1700.588511] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 05:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 1700.589602] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 05:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 1700.590641] ? _raw_spin_lock+0x22/0x30 Aug 22 05:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 1700.591584] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 05:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 1700.592602] direct_page_fault+0x206/0x310 [kvm] Aug 22 05:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 1700.593650] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 05:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 1700.594663] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 05:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 1700.595701] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 05:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 1700.596677] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 05:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 1700.597645] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 05:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 1700.598638] handle_exit+0x98/0x230 [kvm_amd] Aug 22 05:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 1700.599536] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 05:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 1700.600470] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 05:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 1700.601419] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 05:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 1700.602322] vcpu_run+0x62/0x2c0 [kvm] Aug 22 05:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 1700.603138] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 05:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 1700.603946] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 05:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 1700.604819] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 05:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 1700.605622] ? __seccomp_filter+0x4a/0x4a0 Aug 22 05:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 1700.606372] ? __fget_files+0x86/0xc0 Aug 22 05:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 1700.607074] __x64_sys_ioctl+0x95/0xd0 Aug 22 05:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 1700.607771] do_syscall_64+0x5c/0xc0 Aug 22 05:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 1700.608439] ? do_futex+0x162/0x1f0 Aug 22 05:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 1700.609125] ? __x64_sys_futex+0x78/0x1e0 Aug 22 05:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 1700.609815] ? __secure_computing+0xa9/0x120 Aug 22 05:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 1700.610508] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 05:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 1700.611280] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 1700.612026] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 1700.612776] ? do_syscall_64+0x69/0xc0 Aug 22 05:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 1700.613424] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 1700.614130] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 1700.614832] ? do_syscall_64+0x69/0xc0 Aug 22 05:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 1700.615459] ? do_syscall_64+0x69/0xc0 Aug 22 05:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 1700.616087] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 05:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 1700.616806] RIP: 0033:0x7faa5d0edaff Aug 22 05:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 1700.617434] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 05:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 1700.619431] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 05:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 1700.620353] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 05:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 1700.621271] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 05:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 1700.622178] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 05:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 1700.623108] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 05:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 1700.624039] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 05:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 1700.624959] Aug 22 05:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 1728.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 1501s! [qemu-system-x86:6715] Aug 22 05:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 1728.543684] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 05:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 1728.543927] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 05:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 1728.555948] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 05:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 1728.557221] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 05:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 1728.558436] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 05:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 1728.559489] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 05:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 1728.562030] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 05:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 1728.563069] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 05:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 1728.564225] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 05:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 1728.565389] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 05:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 1728.566544] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 05:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 1728.567701] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 05:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 1728.568870] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 05:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 1728.570102] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 05:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 1728.571197] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 05:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 1728.572383] Call Trace: Aug 22 05:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 1728.573307] Aug 22 05:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 1728.574197] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 05:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 1728.575226] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 05:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 1728.576243] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 05:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 1728.577336] ? show_regs.part.0+0x23/0x29 Aug 22 05:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 1728.578329] ? show_regs.cold+0x8/0xd Aug 22 05:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 1728.579297] ? watchdog_timer_fn+0x1be/0x220 Aug 22 05:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 1728.580301] ? lockup_detector_update_enable+0x60/0x60 Aug 22 05:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 1728.581368] ? __hrtimer_run_queues+0x107/0x230 Aug 22 05:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 1728.582393] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 05:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 1728.583412] ? hrtimer_interrupt+0x101/0x220 Aug 22 05:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 1728.584432] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 05:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 1728.585505] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 05:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 1728.586548] Aug 22 05:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 1728.587399] Aug 22 05:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 1728.588234] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 05:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 1728.589277] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 05:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 1728.590314] ? _raw_spin_lock+0x22/0x30 Aug 22 05:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 1728.591255] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 05:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 1728.592267] direct_page_fault+0x206/0x310 [kvm] Aug 22 05:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 1728.593294] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 05:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 1728.594301] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 05:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 1728.595299] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 05:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 1728.596286] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 05:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 1728.597238] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 05:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 1728.598214] handle_exit+0x98/0x230 [kvm_amd] Aug 22 05:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 1728.599102] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 05:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 1728.600014] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 05:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 1728.600949] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 05:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 1728.601852] vcpu_run+0x62/0x2c0 [kvm] Aug 22 05:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 1728.602660] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 05:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 1728.603464] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 05:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 1728.604321] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 05:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 1728.605123] ? __seccomp_filter+0x4a/0x4a0 Aug 22 05:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 1728.605865] ? __fget_files+0x86/0xc0 Aug 22 05:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 1728.606567] __x64_sys_ioctl+0x95/0xd0 Aug 22 05:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 1728.607256] do_syscall_64+0x5c/0xc0 Aug 22 05:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 1728.607918] ? do_futex+0x162/0x1f0 Aug 22 05:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 1728.608572] ? __x64_sys_futex+0x78/0x1e0 Aug 22 05:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 1728.609245] ? __secure_computing+0xa9/0x120 Aug 22 05:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 1728.609932] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 05:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 1728.610689] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 1728.611596] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 1728.612310] ? do_syscall_64+0x69/0xc0 Aug 22 05:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 1728.612966] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 1728.613666] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 1728.614356] ? do_syscall_64+0x69/0xc0 Aug 22 05:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 1728.614978] ? do_syscall_64+0x69/0xc0 Aug 22 05:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 1728.615602] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 05:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 1728.616304] RIP: 0033:0x7faa5d0edaff Aug 22 05:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 1728.616956] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 05:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 1728.618932] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 05:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 1728.619844] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 05:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 1728.620738] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 05:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 1728.621631] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 05:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 1728.622513] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 05:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 1728.623403] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 05:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 1728.624289] Aug 22 05:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 1756.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 1527s! [qemu-system-x86:6715] Aug 22 05:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 1756.543276] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 05:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 1756.543347] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 05:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 1756.557457] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 05:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 1756.558931] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 05:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 1756.560364] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 05:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 1756.561564] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 05:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 1756.564562] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 05:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 1756.565753] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 05:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 1756.567065] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 05:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 1756.568397] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 05:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 1756.569721] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 05:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 1756.571049] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 05:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 1756.572443] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 05:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 1756.573879] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 05:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 1756.575145] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 05:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 1756.576519] Call Trace: Aug 22 05:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 1756.577495] Aug 22 05:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 1756.578439] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 05:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 1756.579560] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 05:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 1756.580699] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 05:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 1756.581894] ? show_regs.part.0+0x23/0x29 Aug 22 05:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 1756.582984] ? show_regs.cold+0x8/0xd Aug 22 05:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 1756.584043] ? watchdog_timer_fn+0x1be/0x220 Aug 22 05:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 1756.585155] ? lockup_detector_update_enable+0x60/0x60 Aug 22 05:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 1756.586338] ? __hrtimer_run_queues+0x107/0x230 Aug 22 05:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 1756.587466] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 05:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 1756.588605] ? hrtimer_interrupt+0x101/0x220 Aug 22 05:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 1756.589737] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 05:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 1756.590939] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 05:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 1756.592118] Aug 22 05:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 1756.593037] Aug 22 05:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 1756.593966] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 05:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 1756.595156] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 05:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 1756.596342] ? _raw_spin_lock+0x22/0x30 Aug 22 05:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 1756.597378] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 05:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 1756.598499] direct_page_fault+0x206/0x310 [kvm] Aug 22 05:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 1756.599630] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 05:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 1756.600717] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 05:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 1756.601875] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 05:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 1756.602975] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 05:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 1756.604075] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 05:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 1756.605205] handle_exit+0x98/0x230 [kvm_amd] Aug 22 05:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 1756.606212] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 05:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 1756.607257] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 05:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 1756.608351] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 05:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 1756.609401] vcpu_run+0x62/0x2c0 [kvm] Aug 22 05:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 1756.610308] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 05:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 1756.611221] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 05:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 1756.612226] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 05:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 1756.613148] ? __seccomp_filter+0x4a/0x4a0 Aug 22 05:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 1756.613995] ? __fget_files+0x86/0xc0 Aug 22 05:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 1756.614780] __x64_sys_ioctl+0x95/0xd0 Aug 22 05:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 1756.615566] do_syscall_64+0x5c/0xc0 Aug 22 05:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 1756.616331] ? do_futex+0x162/0x1f0 Aug 22 05:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 1756.617063] ? __x64_sys_futex+0x78/0x1e0 Aug 22 05:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 1756.617829] ? __secure_computing+0xa9/0x120 Aug 22 05:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 1756.618622] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 05:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 1756.619509] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 1756.620375] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 1756.621205] ? do_syscall_64+0x69/0xc0 Aug 22 05:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 1756.621947] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 1756.622755] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 1756.623554] ? do_syscall_64+0x69/0xc0 Aug 22 05:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 1756.624290] ? do_syscall_64+0x69/0xc0 Aug 22 05:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 1756.625010] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 05:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 1756.625840] RIP: 0033:0x7faa5d0edaff Aug 22 05:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 1756.626548] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 05:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 1756.628943] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 05:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 1756.630029] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 05:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 1756.631092] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 05:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 1756.632170] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 05:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 1756.633214] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 05:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 1756.634277] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 05:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 1756.635332] Aug 22 05:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 1784.541976] watchdog: BUG: soft lockup - CPU#1 stuck for 1553s! [qemu-system-x86:6715] Aug 22 05:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 1784.543107] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 05:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 1784.543178] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 05:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 1784.555258] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 05:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 1784.556536] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 05:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 1784.557757] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 05:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 1784.558813] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 05:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 1784.561366] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 05:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 1784.562405] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 05:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 1784.563562] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 05:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 1784.564758] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 05:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 1784.566096] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 05:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 1784.567271] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 05:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 1784.568454] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 05:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 1784.569811] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 05:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 1784.570904] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 05:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 1784.572108] Call Trace: Aug 22 05:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 1784.573018] Aug 22 05:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 1784.573904] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 05:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 1784.574931] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 05:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 1784.575964] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 05:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 1784.577037] ? show_regs.part.0+0x23/0x29 Aug 22 05:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 1784.578031] ? show_regs.cold+0x8/0xd Aug 22 05:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 1784.578999] ? watchdog_timer_fn+0x1be/0x220 Aug 22 05:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 1784.580019] ? lockup_detector_update_enable+0x60/0x60 Aug 22 05:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 1784.581077] ? __hrtimer_run_queues+0x107/0x230 Aug 22 05:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 1784.582101] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 05:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 1784.583124] ? hrtimer_interrupt+0x101/0x220 Aug 22 05:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 1784.584147] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 05:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 1784.585212] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 05:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 1784.586253] Aug 22 05:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 1784.587104] Aug 22 05:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 1784.587954] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 05:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 1784.588983] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 05:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 1784.590022] ? _raw_spin_lock+0x22/0x30 Aug 22 05:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 1784.590962] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 05:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 1784.591990] direct_page_fault+0x206/0x310 [kvm] Aug 22 05:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 1784.593011] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 05:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 1784.594016] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 05:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 1784.595013] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 05:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 1784.595999] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 05:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 1784.596942] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 05:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 1784.597915] handle_exit+0x98/0x230 [kvm_amd] Aug 22 05:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 1784.598803] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 05:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 1784.599711] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 05:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 1784.600642] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 05:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 1784.601540] vcpu_run+0x62/0x2c0 [kvm] Aug 22 05:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 1784.602352] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 05:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 1784.603156] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 05:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 1784.604020] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 05:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 1784.604816] ? __seccomp_filter+0x4a/0x4a0 Aug 22 05:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 1784.605555] ? __fget_files+0x86/0xc0 Aug 22 05:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 1784.606256] __x64_sys_ioctl+0x95/0xd0 Aug 22 05:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 1784.606946] do_syscall_64+0x5c/0xc0 Aug 22 05:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 1784.607609] ? do_futex+0x162/0x1f0 Aug 22 05:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 1784.608272] ? __x64_sys_futex+0x78/0x1e0 Aug 22 05:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 1784.608942] ? __secure_computing+0xa9/0x120 Aug 22 05:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 1784.609627] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 05:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 1784.610383] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 1784.611100] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 1784.611831] ? do_syscall_64+0x69/0xc0 Aug 22 05:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 1784.612474] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 1784.613174] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 1784.613864] ? do_syscall_64+0x69/0xc0 Aug 22 05:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 1784.614485] ? do_syscall_64+0x69/0xc0 Aug 22 05:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 1784.615104] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 05:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 1784.615823] RIP: 0033:0x7faa5d0edaff Aug 22 05:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 1784.616446] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 05:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 1784.618424] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 05:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 1784.619329] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 05:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 1784.620235] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 05:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 1784.621569] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 05:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 1784.622900] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 05:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 1784.623852] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 05:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 1784.624790] Aug 22 05:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 1797.308704] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 05:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 1797.309730] rcu: 1-....: (418697 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=203903 Aug 22 05:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 1797.310835] (t=420027 jiffies g=23269 q=10385) Aug 22 05:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 1797.311622] NMI backtrace for cpu 1 Aug 22 05:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 1797.312334] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 05:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 1797.313434] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 05:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 1797.314487] Call Trace: Aug 22 05:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 1797.315159] Aug 22 05:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 1797.315811] show_stack+0x52/0x5c Aug 22 05:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 1797.316534] dump_stack_lvl+0x4a/0x63 Aug 22 05:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 1797.317282] dump_stack+0x10/0x16 Aug 22 05:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 1797.317996] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 05:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 1797.318772] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 05:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 1797.319552] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 05:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 1797.320381] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 05:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 1797.321197] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 05:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 1797.322002] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 05:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 1797.322769] print_cpu_stall.cold+0x2f/0xe2 Aug 22 05:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 1797.323533] ? timekeeping_update+0xf7/0x150 Aug 22 05:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 1797.324313] check_cpu_stall+0x109/0x270 Aug 22 05:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 1797.325056] rcu_sched_clock_irq+0x9a/0x250 Aug 22 05:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 1797.325818] update_process_times+0x94/0xd0 Aug 22 05:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 1797.326575] tick_sched_handle+0x29/0x70 Aug 22 05:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 1797.327317] tick_sched_timer+0x8c/0xc0 Aug 22 05:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 1797.328072] ? tick_nohz_handler+0xb0/0xb0 Aug 22 05:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 1797.328830] __hrtimer_run_queues+0x107/0x230 Aug 22 05:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 1797.329600] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 05:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 1797.330376] hrtimer_interrupt+0x101/0x220 Aug 22 05:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 1797.331132] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 05:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 1797.331959] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 05:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 1797.332759] Aug 22 05:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 1797.333397] Aug 22 05:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 1797.334023] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 05:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 1797.334845] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 05:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 1797.335734] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 05:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 1797.337930] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 05:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 1797.338807] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 05:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 1797.339815] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 05:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 1797.340790] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 05:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 1797.341750] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 05:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 1797.342703] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 05:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 1797.343669] ? _raw_spin_lock+0x22/0x30 Aug 22 05:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 1797.344440] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 05:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 1797.345293] direct_page_fault+0x206/0x310 [kvm] Aug 22 05:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 1797.346130] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 05:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 1797.346956] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 05:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 1797.347827] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 05:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 1797.348652] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 05:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 1797.349437] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 05:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 1797.350258] handle_exit+0x98/0x230 [kvm_amd] Aug 22 05:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 1797.351015] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 05:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 1797.351810] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 05:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 1797.352609] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 05:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 1797.353399] vcpu_run+0x62/0x2c0 [kvm] Aug 22 05:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 1797.354114] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 05:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 1797.354846] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 05:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 1797.355660] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 05:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 1797.356421] ? __seccomp_filter+0x4a/0x4a0 Aug 22 05:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 1797.357140] ? __fget_files+0x86/0xc0 Aug 22 05:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 1797.357837] __x64_sys_ioctl+0x95/0xd0 Aug 22 05:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 1797.358535] do_syscall_64+0x5c/0xc0 Aug 22 05:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 1797.359216] ? do_futex+0x162/0x1f0 Aug 22 05:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 1797.359912] ? __x64_sys_futex+0x78/0x1e0 Aug 22 05:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 1797.360618] ? __secure_computing+0xa9/0x120 Aug 22 05:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 1797.361332] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 05:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 1797.362121] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 1797.362875] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 1797.363642] ? do_syscall_64+0x69/0xc0 Aug 22 05:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 1797.364331] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 1797.365085] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 1797.365841] ? do_syscall_64+0x69/0xc0 Aug 22 05:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 1797.366539] ? do_syscall_64+0x69/0xc0 Aug 22 05:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 1797.367224] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 05:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 1797.368009] RIP: 0033:0x7faa5d0edaff Aug 22 05:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 1797.368713] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 05:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 1797.370820] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 05:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 1797.371793] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 05:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 1797.372739] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 05:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 1797.373681] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 05:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 1797.374620] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 05:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 1797.375544] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 05:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 1797.376470] Aug 22 05:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 1824.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 1591s! [qemu-system-x86:6715] Aug 22 05:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 1824.543730] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 05:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 1824.543966] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 05:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 1824.556195] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 05:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 1824.557486] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 05:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 1824.558703] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 05:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 1824.559782] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 05:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 1824.562332] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 05:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 1824.563396] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 05:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 1824.564563] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 05:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 1824.565727] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 05:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 1824.566914] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 05:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 1824.568089] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 05:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 1824.569255] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 05:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 1824.570486] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 05:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 1824.571597] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 05:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 1824.572804] Call Trace: Aug 22 05:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 1824.573719] Aug 22 05:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 1824.574628] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 05:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 1824.575699] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 05:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 1824.576722] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 05:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 1824.577833] ? show_regs.part.0+0x23/0x29 Aug 22 05:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 1824.578836] ? show_regs.cold+0x8/0xd Aug 22 05:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 1824.579825] ? watchdog_timer_fn+0x1be/0x220 Aug 22 05:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 1824.580835] ? lockup_detector_update_enable+0x60/0x60 Aug 22 05:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 1824.581932] ? __hrtimer_run_queues+0x107/0x230 Aug 22 05:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 1824.583028] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 05:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 1824.584079] ? hrtimer_interrupt+0x101/0x220 Aug 22 05:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 1824.585095] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 05:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 1824.586181] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 05:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 1824.587261] Aug 22 05:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 1824.588168] Aug 22 05:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 1824.589165] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 05:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 1824.590199] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 05:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 1824.591265] ? _raw_spin_lock+0x22/0x30 Aug 22 05:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 1824.592223] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 05:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 1824.593259] direct_page_fault+0x206/0x310 [kvm] Aug 22 05:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 1824.594293] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 05:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 1824.595320] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 05:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 1824.596326] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 05:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 1824.597327] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 05:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 1824.598322] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 05:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 1824.599327] handle_exit+0x98/0x230 [kvm_amd] Aug 22 05:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 1824.600223] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 05:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 1824.601147] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 05:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 1824.602074] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 05:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 1824.602987] vcpu_run+0x62/0x2c0 [kvm] Aug 22 05:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 1824.603826] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 05:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 1824.604636] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 05:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 1824.605494] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 05:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 1824.606292] ? __seccomp_filter+0x4a/0x4a0 Aug 22 05:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 1824.607035] ? __fget_files+0x86/0xc0 Aug 22 05:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 1824.607771] __x64_sys_ioctl+0x95/0xd0 Aug 22 05:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 1824.608502] do_syscall_64+0x5c/0xc0 Aug 22 05:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 1824.609178] ? do_futex+0x162/0x1f0 Aug 22 05:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 1824.609835] ? __x64_sys_futex+0x78/0x1e0 Aug 22 05:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 1824.610511] ? __secure_computing+0xa9/0x120 Aug 22 05:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 1824.611202] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 05:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 1824.611985] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 1824.612713] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 1824.613445] ? do_syscall_64+0x69/0xc0 Aug 22 05:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 1824.614096] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 1824.614825] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 1824.615542] ? do_syscall_64+0x69/0xc0 Aug 22 05:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 1824.616178] ? do_syscall_64+0x69/0xc0 Aug 22 05:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 1824.616806] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 05:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 1824.617515] RIP: 0033:0x7faa5d0edaff Aug 22 05:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 1824.618155] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 05:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 1824.620175] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 05:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 1824.621087] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 05:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 1824.621976] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 05:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 1824.622864] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 05:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 1824.623775] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 05:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 1824.624670] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 05:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 1824.625569] Aug 22 05:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 1852.541976] watchdog: BUG: soft lockup - CPU#1 stuck for 1617s! [qemu-system-x86:6715] Aug 22 05:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 1852.543106] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 05:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 1852.543184] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 05:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 1852.555780] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 05:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 1852.557041] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 05:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 1852.558255] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 05:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 1852.559329] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 05:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 1852.561865] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 05:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 1852.562916] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 05:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 1852.564112] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 05:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 1852.565301] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 05:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 1852.566466] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 05:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 1852.567677] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 05:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 1852.568878] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 05:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 1852.570111] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 05:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 1852.571227] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 05:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 1852.572421] Call Trace: Aug 22 05:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 1852.573331] Aug 22 05:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 1852.574242] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 05:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 1852.575295] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 05:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 1852.576321] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 05:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 1852.577394] ? show_regs.part.0+0x23/0x29 Aug 22 05:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 1852.578389] ? show_regs.cold+0x8/0xd Aug 22 05:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 1852.579379] ? watchdog_timer_fn+0x1be/0x220 Aug 22 05:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 1852.580387] ? lockup_detector_update_enable+0x60/0x60 Aug 22 05:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 1852.581448] ? __hrtimer_run_queues+0x107/0x230 Aug 22 05:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 1852.582480] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 05:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 1852.583515] ? hrtimer_interrupt+0x101/0x220 Aug 22 05:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 1852.584567] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 05:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 1852.585635] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 05:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 1852.586679] Aug 22 05:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 1852.587557] Aug 22 05:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 1852.588398] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 05:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 1852.589431] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 05:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 1852.590467] ? _raw_spin_lock+0x22/0x30 Aug 22 05:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 1852.591576] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 05:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 1852.592597] direct_page_fault+0x206/0x310 [kvm] Aug 22 05:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 1852.593622] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 05:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 1852.594641] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 05:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 1852.595699] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 05:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 1852.596713] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 05:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 1852.597657] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 05:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 1852.598639] handle_exit+0x98/0x230 [kvm_amd] Aug 22 05:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 1852.599547] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 05:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 1852.600492] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 05:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 1852.601420] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 05:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 1852.602322] vcpu_run+0x62/0x2c0 [kvm] Aug 22 05:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 1852.603154] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 05:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 1852.603991] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 05:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 1852.605007] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 05:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 1852.605804] ? __seccomp_filter+0x4a/0x4a0 Aug 22 05:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 1852.606543] ? __fget_files+0x86/0xc0 Aug 22 05:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 1852.607268] __x64_sys_ioctl+0x95/0xd0 Aug 22 05:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 1852.607959] do_syscall_64+0x5c/0xc0 Aug 22 05:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 1852.608621] ? do_futex+0x162/0x1f0 Aug 22 05:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 1852.609273] ? __x64_sys_futex+0x78/0x1e0 Aug 22 05:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 1852.609946] ? __secure_computing+0xa9/0x120 Aug 22 05:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 1852.610633] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 05:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 1852.611410] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 1852.612130] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 1852.612845] ? do_syscall_64+0x69/0xc0 Aug 22 05:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 1852.613489] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 1852.614190] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 1852.614885] ? do_syscall_64+0x69/0xc0 Aug 22 05:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 1852.615525] ? do_syscall_64+0x69/0xc0 Aug 22 05:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 1852.616147] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 05:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 1852.616853] RIP: 0033:0x7faa5d0edaff Aug 22 05:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 1852.617476] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 05:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 1852.619467] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 05:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 1852.620383] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 05:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 1852.621272] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 05:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 1852.622158] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 05:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 1852.623073] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 05:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 1852.623961] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 05:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 1852.624873] Aug 22 05:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 1880.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 1643s! [qemu-system-x86:6715] Aug 22 05:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 1880.543130] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 05:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 1880.543211] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 05:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 1880.555837] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 05:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 1880.557140] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 05:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 1880.558396] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 05:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 1880.559506] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 05:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 1880.562147] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 05:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 1880.563243] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 05:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 1880.564434] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 05:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 1880.565612] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 05:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 1880.566835] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 05:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 1880.568067] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 05:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 1880.569292] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 05:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 1880.570551] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 05:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 1880.571687] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 05:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 1880.572997] Call Trace: Aug 22 05:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 1880.573954] Aug 22 05:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 1880.574856] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 05:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 1880.575894] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 05:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 1880.576943] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 05:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 1880.578064] ? show_regs.part.0+0x23/0x29 Aug 22 05:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 1880.579098] ? show_regs.cold+0x8/0xd Aug 22 05:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 1880.580085] ? watchdog_timer_fn+0x1be/0x220 Aug 22 05:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 1880.581123] ? lockup_detector_update_enable+0x60/0x60 Aug 22 05:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 1880.582263] ? __hrtimer_run_queues+0x107/0x230 Aug 22 05:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 1880.583366] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 05:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 1880.584434] ? hrtimer_interrupt+0x101/0x220 Aug 22 05:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 1880.585482] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 05:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 1880.586823] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 05:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 1880.587891] Aug 22 05:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 1880.588746] Aug 22 05:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 1880.589590] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 05:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 1880.590641] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 05:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 1880.591677] ? _raw_spin_lock+0x22/0x30 Aug 22 05:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 1880.592736] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 05:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 1880.593758] direct_page_fault+0x206/0x310 [kvm] Aug 22 05:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 1880.594796] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 05:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 1880.595906] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 05:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 1880.597172] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 05:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 1880.598223] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 05:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 1880.599227] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 05:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 1880.600245] handle_exit+0x98/0x230 [kvm_amd] Aug 22 05:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 1880.601152] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 05:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 1880.602085] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 05:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 1880.603085] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 05:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 1880.604036] vcpu_run+0x62/0x2c0 [kvm] Aug 22 05:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 1880.604876] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 05:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 1880.605705] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 05:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 1880.606609] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 05:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 1880.607435] ? __seccomp_filter+0x4a/0x4a0 Aug 22 05:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 1880.608185] ? __fget_files+0x86/0xc0 Aug 22 05:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 1880.608955] __x64_sys_ioctl+0x95/0xd0 Aug 22 05:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 1880.609691] do_syscall_64+0x5c/0xc0 Aug 22 05:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 1880.610374] ? do_futex+0x162/0x1f0 Aug 22 05:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 1880.611073] ? __x64_sys_futex+0x78/0x1e0 Aug 22 05:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 1880.611767] ? __secure_computing+0xa9/0x120 Aug 22 05:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 1880.612481] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 05:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 1880.613250] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 1880.614031] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 1880.614786] ? do_syscall_64+0x69/0xc0 Aug 22 05:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 1880.615458] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 1880.616184] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 1880.616946] ? do_syscall_64+0x69/0xc0 Aug 22 05:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 1880.617733] ? do_syscall_64+0x69/0xc0 Aug 22 05:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 1880.618369] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 05:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 1880.619094] RIP: 0033:0x7faa5d0edaff Aug 22 05:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 1880.619719] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 05:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 1880.621715] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 05:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 1880.622642] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 05:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 1880.623536] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 05:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 1880.624428] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 05:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 1880.625322] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 05:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 1880.626216] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 05:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 1880.627160] Aug 22 05:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 1908.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 1669s! [qemu-system-x86:6715] Aug 22 05:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 1908.543710] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 05:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 1908.543956] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 05:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 1908.556147] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 05:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 1908.557439] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 05:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 1908.558701] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 05:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 1908.559765] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 05:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 1908.562347] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 05:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 1908.563408] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 05:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 1908.564580] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 05:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 1908.565938] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 05:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 1908.567126] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 05:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 1908.568295] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 05:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 1908.569483] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 05:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 1908.570740] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 05:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 1908.571850] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 05:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 1908.573052] Call Trace: Aug 22 05:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 1908.573973] Aug 22 05:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 1908.574892] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 05:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 1908.575939] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 05:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 1908.576982] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 05:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 1908.578196] ? show_regs.part.0+0x23/0x29 Aug 22 05:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 1908.579497] ? show_regs.cold+0x8/0xd Aug 22 05:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 1908.580500] ? watchdog_timer_fn+0x1be/0x220 Aug 22 05:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 1908.581579] ? lockup_detector_update_enable+0x60/0x60 Aug 22 05:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 1908.582693] ? __hrtimer_run_queues+0x107/0x230 Aug 22 05:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 1908.583733] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 05:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 1908.584769] ? hrtimer_interrupt+0x101/0x220 Aug 22 05:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 1908.585796] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 05:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 1908.586902] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 05:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 1908.587998] Aug 22 05:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 1908.588870] Aug 22 05:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 1908.589720] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 05:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 1908.590781] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 05:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 1908.591829] ? _raw_spin_lock+0x22/0x30 Aug 22 05:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 1908.592798] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 05:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 1908.593854] direct_page_fault+0x206/0x310 [kvm] Aug 22 05:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 1908.594912] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 05:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 1908.595934] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 05:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 1908.596945] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 05:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 1908.597999] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 05:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 1908.598982] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 05:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 1908.599975] handle_exit+0x98/0x230 [kvm_amd] Aug 22 05:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 1908.600876] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 05:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 1908.601829] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 05:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 1908.602809] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 05:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 1908.603758] vcpu_run+0x62/0x2c0 [kvm] Aug 22 05:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 1908.604579] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 05:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 1908.605399] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 05:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 1908.606278] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 05:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 1908.607086] ? __seccomp_filter+0x4a/0x4a0 Aug 22 05:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 1908.607837] ? __fget_files+0x86/0xc0 Aug 22 05:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 1908.608583] __x64_sys_ioctl+0x95/0xd0 Aug 22 05:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 1908.609356] do_syscall_64+0x5c/0xc0 Aug 22 05:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 1908.610033] ? do_futex+0x162/0x1f0 Aug 22 05:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 1908.610709] ? __x64_sys_futex+0x78/0x1e0 Aug 22 05:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 1908.611389] ? __secure_computing+0xa9/0x120 Aug 22 05:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 1908.612084] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 05:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 1908.612855] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 1908.613605] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 1908.614355] ? do_syscall_64+0x69/0xc0 Aug 22 05:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 1908.615008] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 1908.615747] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 1908.616481] ? do_syscall_64+0x69/0xc0 Aug 22 05:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 1908.617117] ? do_syscall_64+0x69/0xc0 Aug 22 05:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 1908.617749] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 05:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 1908.618478] RIP: 0033:0x7faa5d0edaff Aug 22 05:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 1908.619151] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 05:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 1908.621164] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 05:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 1908.622092] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 05:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 1908.623012] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 05:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 1908.623938] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 05:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 1908.624847] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 05:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 1908.625749] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 05:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 1908.626675] Aug 22 05:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 1936.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 1695s! [qemu-system-x86:6715] Aug 22 05:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 1936.543097] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 05:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 1936.543166] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 05:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 1936.555220] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 05:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 1936.556481] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 05:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 1936.557698] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 05:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 1936.558764] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 05:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 1936.561307] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 05:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 1936.562364] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 05:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 1936.563525] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 05:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 1936.564687] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 05:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 1936.565847] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 05:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 1936.567013] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 05:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 1936.568178] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 05:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 1936.569410] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 05:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 1936.570524] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 05:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 1936.571735] Call Trace: Aug 22 05:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 1936.572647] Aug 22 05:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 1936.573529] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 05:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 1936.574577] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 05:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 1936.575597] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 05:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 1936.576670] ? show_regs.part.0+0x23/0x29 Aug 22 05:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 1936.577668] ? show_regs.cold+0x8/0xd Aug 22 05:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 1936.578657] ? watchdog_timer_fn+0x1be/0x220 Aug 22 05:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 1936.579666] ? lockup_detector_update_enable+0x60/0x60 Aug 22 05:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 1936.580727] ? __hrtimer_run_queues+0x107/0x230 Aug 22 05:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 1936.581754] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 05:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 1936.582791] ? hrtimer_interrupt+0x101/0x220 Aug 22 05:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 1936.583810] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 05:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 1936.584877] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 05:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 1936.585929] Aug 22 05:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 1936.586782] Aug 22 05:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 1936.587618] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 05:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 1936.588650] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 05:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 1936.589688] ? _raw_spin_lock+0x22/0x30 Aug 22 05:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 1936.590642] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 05:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 1936.591658] direct_page_fault+0x206/0x310 [kvm] Aug 22 05:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 1936.592681] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 05:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 1936.593688] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 05:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 1936.594699] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 05:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 1936.595670] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 05:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 1936.596615] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 05:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 1936.597598] handle_exit+0x98/0x230 [kvm_amd] Aug 22 05:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 1936.598501] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 05:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 1936.599416] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 05:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 1936.600345] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 05:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 1936.601248] vcpu_run+0x62/0x2c0 [kvm] Aug 22 05:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 1936.602072] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 05:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 1936.602881] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 05:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 1936.603734] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 05:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 1936.604532] ? __seccomp_filter+0x4a/0x4a0 Aug 22 05:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 1936.605277] ? __fget_files+0x86/0xc0 Aug 22 05:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 1936.606010] __x64_sys_ioctl+0x95/0xd0 Aug 22 05:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 1936.606703] do_syscall_64+0x5c/0xc0 Aug 22 05:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 1936.607369] ? do_futex+0x162/0x1f0 Aug 22 05:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 1936.608018] ? __x64_sys_futex+0x78/0x1e0 Aug 22 05:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 1936.608692] ? __secure_computing+0xa9/0x120 Aug 22 05:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 1936.609381] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 05:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 1936.610159] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 1936.610883] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 1936.611601] ? do_syscall_64+0x69/0xc0 Aug 22 05:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 1936.612252] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 1936.612955] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 1936.613650] ? do_syscall_64+0x69/0xc0 Aug 22 05:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 1936.614286] ? do_syscall_64+0x69/0xc0 Aug 22 05:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 1936.614915] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 05:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 1936.615622] RIP: 0033:0x7faa5d0edaff Aug 22 05:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 1936.616249] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 05:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 1936.618429] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 05:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 1936.619346] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 05:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 1936.620237] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 05:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 1936.621127] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 05:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 1936.622028] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 05:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 1936.622918] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 05:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 1936.623817] Aug 22 05:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 1964.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 1721s! [qemu-system-x86:6715] Aug 22 05:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 1964.543077] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 05:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 1964.543144] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 05:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 1964.555185] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 05:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 1964.556447] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 05:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 1964.557683] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 05:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 1964.558740] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 05:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 1964.561279] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 05:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 1964.562331] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 05:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 1964.563490] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 05:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 1964.564652] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 05:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 1964.565831] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 05:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 1964.566998] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 05:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 1964.568160] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 05:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 1964.569389] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 05:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 1964.570499] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 05:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 1964.571690] Call Trace: Aug 22 05:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 1964.572600] Aug 22 05:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 1964.573487] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 05:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 1964.574531] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 05:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 1964.575557] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 05:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 1964.576635] ? show_regs.part.0+0x23/0x29 Aug 22 05:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 1964.577659] ? show_regs.cold+0x8/0xd Aug 22 05:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 1964.578631] ? watchdog_timer_fn+0x1be/0x220 Aug 22 05:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 1964.579637] ? lockup_detector_update_enable+0x60/0x60 Aug 22 05:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 1964.580721] ? __hrtimer_run_queues+0x107/0x230 Aug 22 05:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 1964.581775] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 05:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 1964.582801] ? hrtimer_interrupt+0x101/0x220 Aug 22 05:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 1964.583813] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 05:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 1964.584880] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 05:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 1964.585943] Aug 22 05:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 1964.586795] Aug 22 05:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 1964.587631] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 05:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 1964.588664] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 05:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 1964.589723] ? _raw_spin_lock+0x22/0x30 Aug 22 05:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 1964.590666] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 05:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 1964.591688] direct_page_fault+0x206/0x310 [kvm] Aug 22 05:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 1964.592716] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 05:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 1964.593745] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 05:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 1964.594745] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 05:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 1964.595715] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 05:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 1964.596661] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 05:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 1964.597659] handle_exit+0x98/0x230 [kvm_amd] Aug 22 05:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 1964.598557] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 05:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 1964.599480] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 05:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 1964.600561] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 05:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 1964.601651] vcpu_run+0x62/0x2c0 [kvm] Aug 22 05:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 1964.602468] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 05:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 1964.603277] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 05:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 1964.604135] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 05:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 1964.604932] ? __seccomp_filter+0x4a/0x4a0 Aug 22 05:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 1964.605693] ? __fget_files+0x86/0xc0 Aug 22 05:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 1964.606402] __x64_sys_ioctl+0x95/0xd0 Aug 22 05:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 1964.607095] do_syscall_64+0x5c/0xc0 Aug 22 05:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 1964.607762] ? do_futex+0x162/0x1f0 Aug 22 05:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 1964.608411] ? __x64_sys_futex+0x78/0x1e0 Aug 22 05:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 1964.609084] ? __secure_computing+0xa9/0x120 Aug 22 05:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 1964.609795] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 05:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 1964.610555] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 1964.611280] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 1964.612000] ? do_syscall_64+0x69/0xc0 Aug 22 05:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 1964.612644] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 1964.613347] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 1964.614078] ? do_syscall_64+0x69/0xc0 Aug 22 05:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 1964.614705] ? do_syscall_64+0x69/0xc0 Aug 22 05:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 1964.615328] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 05:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 1964.616036] RIP: 0033:0x7faa5d0edaff Aug 22 05:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 1964.616662] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 05:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 1964.618670] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 05:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 1964.619580] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 05:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 1964.620475] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 05:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 1964.621366] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 05:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 1964.622268] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 05:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 1964.623156] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 05:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 1964.624053] Aug 22 05:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 1977.320707] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 05:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 1977.321715] rcu: 1-....: (463566 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=225685 Aug 22 05:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 1977.322845] (t=465030 jiffies g=23269 q=10528) Aug 22 05:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 1977.323619] NMI backtrace for cpu 1 Aug 22 05:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 1977.324324] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 05:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 1977.325442] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 05:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 1977.326503] Call Trace: Aug 22 05:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 1977.327174] Aug 22 05:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 1977.327823] show_stack+0x52/0x5c Aug 22 05:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 1977.328546] dump_stack_lvl+0x4a/0x63 Aug 22 05:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 1977.329303] dump_stack+0x10/0x16 Aug 22 05:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 1977.330065] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 05:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 1977.330862] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 05:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 1977.331638] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 05:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 1977.332474] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 05:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 1977.333313] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 05:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 1977.334143] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 05:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 1977.334911] print_cpu_stall.cold+0x2f/0xe2 Aug 22 05:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 1977.335676] ? timekeeping_update+0xf7/0x150 Aug 22 05:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 1977.336441] check_cpu_stall+0x109/0x270 Aug 22 05:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 1977.337326] rcu_sched_clock_irq+0x9a/0x250 Aug 22 05:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 1977.338516] update_process_times+0x94/0xd0 Aug 22 05:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 1977.339875] tick_sched_handle+0x29/0x70 Aug 22 05:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 1977.341043] tick_sched_timer+0x8c/0xc0 Aug 22 05:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 1977.342229] ? tick_nohz_handler+0xb0/0xb0 Aug 22 05:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 1977.343408] __hrtimer_run_queues+0x107/0x230 Aug 22 05:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 1977.344605] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 05:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 1977.345833] hrtimer_interrupt+0x101/0x220 Aug 22 05:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 1977.347007] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 05:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 1977.348262] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 05:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 1977.349502] Aug 22 05:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 1977.350478] Aug 22 05:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 1977.351444] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 05:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 1977.352680] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 05:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 1977.354033] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 05:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 1977.357428] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 05:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 1977.358834] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 05:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 1977.360280] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 05:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 1977.361314] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 05:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 1977.362302] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 05:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 1977.363256] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 05:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 1977.364213] ? _raw_spin_lock+0x22/0x30 Aug 22 05:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 1977.365163] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 05:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 1977.366014] direct_page_fault+0x206/0x310 [kvm] Aug 22 05:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 1977.366850] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 05:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 1977.367680] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 05:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 1977.368505] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 05:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 1977.369314] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 05:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 1977.370125] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 05:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 1977.370949] handle_exit+0x98/0x230 [kvm_amd] Aug 22 05:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 1977.371703] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 05:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 1977.372487] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 05:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 1977.373288] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 05:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 1977.374098] vcpu_run+0x62/0x2c0 [kvm] Aug 22 05:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 1977.374816] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 05:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 1977.375549] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 05:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 1977.376354] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 05:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 1977.377115] ? __seccomp_filter+0x4a/0x4a0 Aug 22 05:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 1977.377845] ? __fget_files+0x86/0xc0 Aug 22 05:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 1977.378539] __x64_sys_ioctl+0x95/0xd0 Aug 22 05:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 1977.379233] do_syscall_64+0x5c/0xc0 Aug 22 05:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 1977.379914] ? do_futex+0x162/0x1f0 Aug 22 05:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 1977.380586] ? __x64_sys_futex+0x78/0x1e0 Aug 22 05:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 1977.381288] ? __secure_computing+0xa9/0x120 Aug 22 05:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 1977.382012] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 05:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 1977.382802] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 1977.383556] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 1977.384314] ? do_syscall_64+0x69/0xc0 Aug 22 05:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 1977.385004] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 1977.385773] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 1977.386530] ? do_syscall_64+0x69/0xc0 Aug 22 05:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 1977.387224] ? do_syscall_64+0x69/0xc0 Aug 22 05:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 1977.387911] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 05:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 1977.388681] RIP: 0033:0x7faa5d0edaff Aug 22 05:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 1977.389368] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 05:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 1977.391504] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 05:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 1977.392476] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 05:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 1977.393445] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 05:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 1977.394393] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 05:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 1977.395473] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 05:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 1977.396528] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 05:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 1977.397602] Aug 22 05:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 2004.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 1758s! [qemu-system-x86:6715] Aug 22 05:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 2004.543703] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 05:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 2004.543957] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 05:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 2004.557274] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 05:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 2004.558734] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 05:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 2004.560124] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 05:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 2004.561324] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 05:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 2004.564238] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 05:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 2004.565425] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 05:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 2004.566735] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 05:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 2004.568053] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 05:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 2004.569367] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 05:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 2004.572700] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 05:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 2004.574110] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 05:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 2004.575743] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 05:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 2004.577025] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 05:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 2004.578440] Call Trace: Aug 22 05:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 2004.579412] Aug 22 05:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 2004.582296] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 05:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 2004.583453] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 05:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 2004.584666] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 05:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 2004.585903] ? show_regs.part.0+0x23/0x29 Aug 22 05:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 2004.587020] ? show_regs.cold+0x8/0xd Aug 22 05:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 2004.588222] ? watchdog_timer_fn+0x1be/0x220 Aug 22 05:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 2004.589728] ? lockup_detector_update_enable+0x60/0x60 Aug 22 05:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 2004.590829] ? __hrtimer_run_queues+0x107/0x230 Aug 22 05:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 2004.591876] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 05:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 2004.592906] ? hrtimer_interrupt+0x101/0x220 Aug 22 05:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 2004.593956] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 05:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 2004.595039] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 05:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 2004.596107] Aug 22 05:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 2004.597095] Aug 22 05:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 2004.597956] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 05:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 2004.598993] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 05:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 2004.600031] ? _raw_spin_lock+0x22/0x30 Aug 22 05:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 2004.600978] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 05:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 2004.602020] direct_page_fault+0x206/0x310 [kvm] Aug 22 05:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 2004.603043] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 05:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 2004.604053] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 05:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 2004.605054] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 05:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 2004.606072] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 05:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 2004.607019] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 05:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 2004.607996] handle_exit+0x98/0x230 [kvm_amd] Aug 22 05:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 2004.608894] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 05:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 2004.609828] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 05:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 2004.610750] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 05:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 2004.611651] vcpu_run+0x62/0x2c0 [kvm] Aug 22 05:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 2004.612470] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 05:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 2004.613291] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 05:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 2004.614145] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 05:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 2004.614942] ? __seccomp_filter+0x4a/0x4a0 Aug 22 05:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 2004.615685] ? __fget_files+0x86/0xc0 Aug 22 05:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 2004.616389] __x64_sys_ioctl+0x95/0xd0 Aug 22 05:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 2004.617200] do_syscall_64+0x5c/0xc0 Aug 22 05:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 2004.617951] ? do_futex+0x162/0x1f0 Aug 22 05:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 2004.618690] ? __x64_sys_futex+0x78/0x1e0 Aug 22 05:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 2004.619446] ? __secure_computing+0xa9/0x120 Aug 22 05:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 2004.620223] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 05:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 2004.621112] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 2004.621937] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 2004.622812] ? do_syscall_64+0x69/0xc0 Aug 22 05:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 2004.623595] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 2004.624307] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 2004.625009] ? do_syscall_64+0x69/0xc0 Aug 22 05:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 2004.625661] ? do_syscall_64+0x69/0xc0 Aug 22 05:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 2004.626286] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 05:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 2004.626995] RIP: 0033:0x7faa5d0edaff Aug 22 05:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 2004.627651] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 05:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 2004.629662] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 05:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 2004.630577] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 05:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 2004.631476] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 05:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 2004.632366] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 05:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 2004.633272] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 05:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 2004.634179] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 05:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 2004.635077] Aug 22 05:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 2032.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 1784s! [qemu-system-x86:6715] Aug 22 05:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 2032.543099] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 05:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 2032.543173] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 05:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 2032.555448] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 05:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 2032.556726] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 05:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 2032.557996] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 05:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 2032.559060] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 05:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 2032.561675] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 05:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 2032.562726] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 05:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 2032.563895] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 05:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 2032.565138] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 05:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 2032.566310] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 05:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 2032.567481] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 05:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 2032.568655] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 05:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 2032.570024] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 05:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 2032.571123] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 05:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 2032.572319] Call Trace: Aug 22 05:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 2032.573316] Aug 22 05:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 2032.574204] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 05:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 2032.575234] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 05:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 2032.576258] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 05:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 2032.577407] ? show_regs.part.0+0x23/0x29 Aug 22 05:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 2032.578408] ? show_regs.cold+0x8/0xd Aug 22 05:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 2032.579378] ? watchdog_timer_fn+0x1be/0x220 Aug 22 05:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 2032.580389] ? lockup_detector_update_enable+0x60/0x60 Aug 22 05:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 2032.581510] ? __hrtimer_run_queues+0x107/0x230 Aug 22 05:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 2032.582543] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 05:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 2032.583567] ? hrtimer_interrupt+0x101/0x220 Aug 22 05:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 2032.584581] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 05:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 2032.585672] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 05:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 2032.586718] Aug 22 05:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 2032.587572] Aug 22 05:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 2032.588412] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 05:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 2032.589542] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 05:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 2032.590586] ? _raw_spin_lock+0x22/0x30 Aug 22 05:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 2032.591535] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 05:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 2032.592552] direct_page_fault+0x206/0x310 [kvm] Aug 22 05:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 2032.593639] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 05:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 2032.594654] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 05:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 2032.595655] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 05:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 2032.596626] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 05:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 2032.597628] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 05:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 2032.598608] handle_exit+0x98/0x230 [kvm_amd] Aug 22 05:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 2032.599499] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 05:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 2032.600411] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 05:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 2032.601409] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 05:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 2032.602320] vcpu_run+0x62/0x2c0 [kvm] Aug 22 05:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 2032.603133] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 05:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 2032.603940] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 05:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 2032.604825] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 05:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 2032.605678] ? __seccomp_filter+0x4a/0x4a0 Aug 22 05:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 2032.606419] ? __fget_files+0x86/0xc0 Aug 22 05:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 2032.607128] __x64_sys_ioctl+0x95/0xd0 Aug 22 05:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 2032.607821] do_syscall_64+0x5c/0xc0 Aug 22 05:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 2032.608486] ? do_futex+0x162/0x1f0 Aug 22 05:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 2032.609235] ? __x64_sys_futex+0x78/0x1e0 Aug 22 05:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 2032.609911] ? __secure_computing+0xa9/0x120 Aug 22 05:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 2032.610603] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 05:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 2032.611368] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 2032.612089] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 2032.612835] ? do_syscall_64+0x69/0xc0 Aug 22 05:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 2032.613508] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 2032.614216] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 2032.614912] ? do_syscall_64+0x69/0xc0 Aug 22 05:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 2032.615534] ? do_syscall_64+0x69/0xc0 Aug 22 05:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 2032.616159] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 05:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 2032.616906] RIP: 0033:0x7faa5d0edaff Aug 22 05:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 2032.617560] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 05:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 2032.619552] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 05:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 2032.620460] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 05:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 2032.621590] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 05:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 2032.622477] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 05:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 2032.623364] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 05:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 2032.624259] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 05:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 2032.625159] Aug 22 05:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 2060.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 1811s! [qemu-system-x86:6715] Aug 22 05:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 2060.543103] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 05:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 2060.543176] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 05:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 2060.555189] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 05:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 2060.556460] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 05:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 2060.557679] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 05:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 2060.558738] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 05:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 2060.561282] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 05:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 2060.562328] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 05:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 2060.563483] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 05:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 2060.564661] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 05:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 2060.565825] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 05:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 2060.566982] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 05:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 2060.568148] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 05:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 2060.569397] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 05:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 2060.570492] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 05:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 2060.571684] Call Trace: Aug 22 05:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 2060.572622] Aug 22 05:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 2060.573506] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 05:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 2060.574533] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 05:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 2060.575551] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 05:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 2060.576641] ? show_regs.part.0+0x23/0x29 Aug 22 05:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 2060.577647] ? show_regs.cold+0x8/0xd Aug 22 05:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 2060.578632] ? watchdog_timer_fn+0x1be/0x220 Aug 22 05:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 2060.579639] ? lockup_detector_update_enable+0x60/0x60 Aug 22 05:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 2060.580720] ? __hrtimer_run_queues+0x107/0x230 Aug 22 05:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 2060.581750] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 05:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 2060.582770] ? hrtimer_interrupt+0x101/0x220 Aug 22 05:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 2060.583782] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 05:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 2060.584873] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 05:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 2060.585933] Aug 22 05:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 2060.586805] Aug 22 05:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 2060.587640] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 05:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 2060.588680] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 05:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 2060.589717] ? _raw_spin_lock+0x22/0x30 Aug 22 05:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 2060.590658] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 05:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 2060.591671] direct_page_fault+0x206/0x310 [kvm] Aug 22 05:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 2060.592711] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 05:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 2060.593723] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 05:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 2060.594726] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 05:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 2060.595696] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 05:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 2060.596656] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 05:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 2060.597632] handle_exit+0x98/0x230 [kvm_amd] Aug 22 05:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 2060.598521] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 05:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 2060.599436] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 05:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 2060.600355] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 05:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 2060.601274] vcpu_run+0x62/0x2c0 [kvm] Aug 22 05:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 2060.602087] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 05:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 2060.602892] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 05:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 2060.603748] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 05:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 2060.604679] ? __seccomp_filter+0x4a/0x4a0 Aug 22 05:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 2060.605422] ? __fget_files+0x86/0xc0 Aug 22 05:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 2060.606130] __x64_sys_ioctl+0x95/0xd0 Aug 22 05:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 2060.606821] do_syscall_64+0x5c/0xc0 Aug 22 05:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 2060.607488] ? do_futex+0x162/0x1f0 Aug 22 05:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 2060.608134] ? __x64_sys_futex+0x78/0x1e0 Aug 22 05:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 2060.608811] ? __secure_computing+0xa9/0x120 Aug 22 05:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 2060.609505] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 05:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 2060.610263] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 2060.610983] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 2060.611698] ? do_syscall_64+0x69/0xc0 Aug 22 05:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 2060.612344] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 2060.613057] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 2060.613750] ? do_syscall_64+0x69/0xc0 Aug 22 05:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 2060.614372] ? do_syscall_64+0x69/0xc0 Aug 22 05:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 2060.614996] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 05:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 2060.615697] RIP: 0033:0x7faa5d0edaff Aug 22 05:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 2060.616318] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 05:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 2060.618321] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 05:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 2060.619233] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 05:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 2060.620119] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 05:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 2060.621014] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 05:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 2060.621897] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 05:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 2060.622784] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 05:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 2060.623672] Aug 22 05:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 2088.541976] watchdog: BUG: soft lockup - CPU#1 stuck for 1837s! [qemu-system-x86:6715] Aug 22 05:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 2088.543688] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 05:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 2088.543937] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 05:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 2088.555976] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 05:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 2088.557246] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 05:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 2088.558463] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 05:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 2088.559523] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 05:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 2088.562072] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 05:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 2088.563110] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 05:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 2088.564279] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 05:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 2088.565435] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 05:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 2088.566591] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 05:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 2088.567751] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 05:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 2088.568925] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 05:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 2088.570159] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 05:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 2088.571257] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 05:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 2088.572456] Call Trace: Aug 22 05:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 2088.573367] Aug 22 05:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 2088.574256] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 05:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 2088.575283] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 05:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 2088.576314] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 05:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 2088.577407] ? show_regs.part.0+0x23/0x29 Aug 22 05:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 2088.578403] ? show_regs.cold+0x8/0xd Aug 22 05:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 2088.579372] ? watchdog_timer_fn+0x1be/0x220 Aug 22 05:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 2088.580390] ? lockup_detector_update_enable+0x60/0x60 Aug 22 05:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 2088.581452] ? __hrtimer_run_queues+0x107/0x230 Aug 22 05:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 2088.582478] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 05:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 2088.583499] ? hrtimer_interrupt+0x101/0x220 Aug 22 05:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 2088.584519] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 05:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 2088.585586] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 05:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 2088.586634] Aug 22 05:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 2088.587484] Aug 22 05:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 2088.588325] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 05:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 2088.589357] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 05:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 2088.590398] ? _raw_spin_lock+0x22/0x30 Aug 22 05:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 2088.591340] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 05:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 2088.592365] direct_page_fault+0x206/0x310 [kvm] Aug 22 05:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 2088.593390] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 05:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 2088.594398] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 05:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 2088.595396] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 05:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 2088.596395] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 05:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 2088.597338] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 05:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 2088.598312] handle_exit+0x98/0x230 [kvm_amd] Aug 22 05:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 2088.599204] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 05:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 2088.600122] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 05:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 2088.601045] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 05:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 2088.601947] vcpu_run+0x62/0x2c0 [kvm] Aug 22 05:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 2088.602756] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 05:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 2088.603562] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 05:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 2088.604537] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 05:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 2088.605338] ? __seccomp_filter+0x4a/0x4a0 Aug 22 05:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 2088.606079] ? __fget_files+0x86/0xc0 Aug 22 05:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 2088.606785] __x64_sys_ioctl+0x95/0xd0 Aug 22 05:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 2088.607476] do_syscall_64+0x5c/0xc0 Aug 22 05:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 2088.608149] ? do_futex+0x162/0x1f0 Aug 22 05:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 2088.608804] ? __x64_sys_futex+0x78/0x1e0 Aug 22 05:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 2088.609480] ? __secure_computing+0xa9/0x120 Aug 22 05:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 2088.610193] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 05:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 2088.610959] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 2088.611678] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 2088.612402] ? do_syscall_64+0x69/0xc0 Aug 22 05:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 2088.613049] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 2088.613758] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 2088.614452] ? do_syscall_64+0x69/0xc0 Aug 22 05:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 2088.615079] ? do_syscall_64+0x69/0xc0 Aug 22 05:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 2088.615701] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 05:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 2088.616417] RIP: 0033:0x7faa5d0edaff Aug 22 05:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 2088.617070] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 05:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 2088.619056] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 05:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 2088.619967] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 05:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 2088.620866] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 05:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 2088.621755] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 05:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 2088.622639] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 05:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 2088.623525] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 05:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 2088.624423] Aug 22 05:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 2116.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 1863s! [qemu-system-x86:6715] Aug 22 05:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 2116.543103] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 05:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 2116.543173] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 05:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 2116.555314] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 05:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 2116.556649] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 05:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 2116.557882] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 05:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 2116.558939] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 05:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 2116.561527] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 05:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 2116.562587] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 05:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 2116.563772] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 05:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 2116.564936] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 05:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 2116.566109] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 05:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 2116.567288] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 05:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 2116.568480] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 05:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 2116.569721] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 05:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 2116.570822] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 05:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 2116.572072] Call Trace: Aug 22 05:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 2116.572997] Aug 22 05:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 2116.573884] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 05:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 2116.574934] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 05:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 2116.575977] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 05:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 2116.577077] ? show_regs.part.0+0x23/0x29 Aug 22 05:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 2116.578095] ? show_regs.cold+0x8/0xd Aug 22 05:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 2116.579071] ? watchdog_timer_fn+0x1be/0x220 Aug 22 05:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 2116.580105] ? lockup_detector_update_enable+0x60/0x60 Aug 22 05:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 2116.581172] ? __hrtimer_run_queues+0x107/0x230 Aug 22 05:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 2116.582211] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 05:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 2116.583261] ? hrtimer_interrupt+0x101/0x220 Aug 22 05:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 2116.584298] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 05:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 2116.585404] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 05:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 2116.586477] Aug 22 05:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 2116.587340] Aug 22 05:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 2116.588211] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 05:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 2116.589254] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 05:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 2116.590301] ? _raw_spin_lock+0x22/0x30 Aug 22 05:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 2116.591253] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 05:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 2116.592303] direct_page_fault+0x206/0x310 [kvm] Aug 22 05:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 2116.593342] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 05:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 2116.594356] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 05:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 2116.595362] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 05:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 2116.596354] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 05:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 2116.597320] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 05:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 2116.598315] handle_exit+0x98/0x230 [kvm_amd] Aug 22 05:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 2116.599215] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 05:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 2116.600155] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 05:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 2116.601087] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 05:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 2116.602002] vcpu_run+0x62/0x2c0 [kvm] Aug 22 05:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 2116.602816] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 05:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 2116.603635] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 05:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 2116.604530] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 05:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 2116.605439] ? __seccomp_filter+0x4a/0x4a0 Aug 22 05:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 2116.606211] ? __fget_files+0x86/0xc0 Aug 22 05:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 2116.606914] __x64_sys_ioctl+0x95/0xd0 Aug 22 05:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 2116.607616] do_syscall_64+0x5c/0xc0 Aug 22 05:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 2116.608306] ? do_futex+0x162/0x1f0 Aug 22 05:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 2116.608958] ? __x64_sys_futex+0x78/0x1e0 Aug 22 05:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 2116.609638] ? __secure_computing+0xa9/0x120 Aug 22 05:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 2116.610329] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 05:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 2116.611088] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 2116.611824] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 2116.612557] ? do_syscall_64+0x69/0xc0 Aug 22 05:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 2116.613209] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 2116.613919] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 2116.614615] ? do_syscall_64+0x69/0xc0 Aug 22 05:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 2116.615240] ? do_syscall_64+0x69/0xc0 Aug 22 05:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 2116.615910] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 05:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 2116.616617] RIP: 0033:0x7faa5d0edaff Aug 22 05:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 2116.617245] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 05:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 2116.619255] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 05:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 2116.620204] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 05:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 2116.621096] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 05:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 2116.621988] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 05:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 2116.622888] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 05:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 2116.623810] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 05:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 2116.624708] Aug 22 05:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 2144.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 1889s! [qemu-system-x86:6715] Aug 22 05:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 2144.543110] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 05:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 2144.543177] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 05:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 2144.555483] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 05:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 2144.556756] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 05:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 2144.557978] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 05:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 2144.559033] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 05:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 2144.561602] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 05:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 2144.562647] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 05:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 2144.563834] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 05:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 2144.564991] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 05:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 2144.566147] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 05:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 2144.567308] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 05:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 2144.568492] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 05:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 2144.569721] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 05:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 2144.570825] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 05:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 2144.572033] Call Trace: Aug 22 05:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 2144.572943] Aug 22 05:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 2144.573825] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 05:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 2144.574853] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 05:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 2144.575891] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 05:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 2144.576970] ? show_regs.part.0+0x23/0x29 Aug 22 05:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 2144.577990] ? show_regs.cold+0x8/0xd Aug 22 05:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 2144.579008] ? watchdog_timer_fn+0x1be/0x220 Aug 22 05:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 2144.580271] ? lockup_detector_update_enable+0x60/0x60 Aug 22 05:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 2144.581677] ? __hrtimer_run_queues+0x107/0x230 Aug 22 05:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 2144.582749] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 05:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 2144.583844] ? hrtimer_interrupt+0x101/0x220 Aug 22 05:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 2144.584886] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 05:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 2144.586134] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 05:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 2144.587188] Aug 22 05:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 2144.588064] Aug 22 05:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 2144.589044] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 05:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 2144.590077] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 05:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 2144.591117] ? _raw_spin_lock+0x22/0x30 Aug 22 05:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 2144.592071] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 05:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 2144.593098] direct_page_fault+0x206/0x310 [kvm] Aug 22 05:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 2144.594126] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 05:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 2144.595134] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 05:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 2144.596142] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 05:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 2144.597114] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 05:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 2144.598057] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 05:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 2144.599031] handle_exit+0x98/0x230 [kvm_amd] Aug 22 05:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 2144.599928] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 05:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 2144.600840] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 05:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 2144.601776] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 05:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 2144.602678] vcpu_run+0x62/0x2c0 [kvm] Aug 22 05:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 2144.603504] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 05:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 2144.604312] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 05:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 2144.605167] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 05:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 2144.605969] ? __seccomp_filter+0x4a/0x4a0 Aug 22 05:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 2144.606712] ? __fget_files+0x86/0xc0 Aug 22 05:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 2144.607429] __x64_sys_ioctl+0x95/0xd0 Aug 22 05:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 2144.608121] do_syscall_64+0x5c/0xc0 Aug 22 05:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 2144.608785] ? do_futex+0x162/0x1f0 Aug 22 05:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 2144.609432] ? __x64_sys_futex+0x78/0x1e0 Aug 22 05:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 2144.610110] ? __secure_computing+0xa9/0x120 Aug 22 05:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 2144.610799] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 05:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 2144.611566] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 2144.612294] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 2144.613009] ? do_syscall_64+0x69/0xc0 Aug 22 05:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 2144.613654] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 2144.614356] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 2144.615049] ? do_syscall_64+0x69/0xc0 Aug 22 05:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 2144.615686] ? do_syscall_64+0x69/0xc0 Aug 22 05:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 2144.616308] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 05:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 2144.617011] RIP: 0033:0x7faa5d0edaff Aug 22 05:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 2144.617636] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 05:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 2144.619655] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 05:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 2144.620582] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 05:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 2144.621484] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 05:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 2144.622389] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 05:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 2144.623280] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 05:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 2144.624189] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 05:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 2144.625093] Aug 22 05:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 2157.332707] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 05:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 2157.333702] rcu: 1-....: (508430 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=247590 Aug 22 05:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 2157.334811] (t=510033 jiffies g=23269 q=10666) Aug 22 05:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 2157.335614] NMI backtrace for cpu 1 Aug 22 05:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 2157.336347] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 05:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 2157.337457] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 05:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 2157.338517] Call Trace: Aug 22 05:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 2157.339189] Aug 22 05:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 2157.339852] show_stack+0x52/0x5c Aug 22 05:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 2157.340583] dump_stack_lvl+0x4a/0x63 Aug 22 05:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 2157.341329] dump_stack+0x10/0x16 Aug 22 05:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 2157.342044] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 05:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 2157.342825] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 05:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 2157.343620] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 05:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 2157.344459] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 05:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 2157.345288] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 05:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 2157.346094] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 05:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 2157.346866] print_cpu_stall.cold+0x2f/0xe2 Aug 22 05:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 2157.347656] ? timekeeping_update+0xf7/0x150 Aug 22 05:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 2157.348447] check_cpu_stall+0x109/0x270 Aug 22 05:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 2157.349197] rcu_sched_clock_irq+0x9a/0x250 Aug 22 05:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 2157.349957] update_process_times+0x94/0xd0 Aug 22 05:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 2157.350715] tick_sched_handle+0x29/0x70 Aug 22 05:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 2157.351482] tick_sched_timer+0x8c/0xc0 Aug 22 05:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 2157.352228] ? tick_nohz_handler+0xb0/0xb0 Aug 22 05:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 2157.352985] __hrtimer_run_queues+0x107/0x230 Aug 22 05:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 2157.353758] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 05:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 2157.354533] hrtimer_interrupt+0x101/0x220 Aug 22 05:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 2157.355315] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 05:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 2157.356139] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 05:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 2157.356947] Aug 22 05:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 2157.357582] Aug 22 05:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 2157.358215] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 05:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 2157.359034] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 05:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 2157.359947] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 05:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 2157.362161] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 05:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 2157.363040] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 05:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 2157.364242] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 05:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 2157.365217] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 05:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 2157.366185] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 05:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 2157.367140] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 05:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 2157.368128] ? _raw_spin_lock+0x22/0x30 Aug 22 05:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 2157.368890] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 05:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 2157.369727] direct_page_fault+0x206/0x310 [kvm] Aug 22 05:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 2157.370571] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 05:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 2157.371412] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 05:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 2157.372241] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 05:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 2157.373048] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 05:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 2157.373836] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 05:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 2157.374658] handle_exit+0x98/0x230 [kvm_amd] Aug 22 05:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 2157.375427] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 05:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 2157.376216] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 05:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 2157.377014] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 05:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 2157.377801] vcpu_run+0x62/0x2c0 [kvm] Aug 22 05:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 2157.378519] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 05:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 2157.379277] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 05:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 2157.380078] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 05:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 2157.380840] ? __seccomp_filter+0x4a/0x4a0 Aug 22 05:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 2157.381560] ? __fget_files+0x86/0xc0 Aug 22 05:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 2157.382258] __x64_sys_ioctl+0x95/0xd0 Aug 22 05:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 2157.382953] do_syscall_64+0x5c/0xc0 Aug 22 05:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 2157.383652] ? do_futex+0x162/0x1f0 Aug 22 05:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 2157.384326] ? __x64_sys_futex+0x78/0x1e0 Aug 22 05:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 2157.385026] ? __secure_computing+0xa9/0x120 Aug 22 05:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 2157.385743] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 05:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 2157.386538] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 2157.387308] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 2157.388064] ? do_syscall_64+0x69/0xc0 Aug 22 05:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 2157.388756] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 05:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 2157.389512] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 05:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 2157.390270] ? do_syscall_64+0x69/0xc0 Aug 22 05:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 2157.390965] ? do_syscall_64+0x69/0xc0 Aug 22 05:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 2157.391677] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 05:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 2157.392452] RIP: 0033:0x7faa5d0edaff Aug 22 05:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 2157.393138] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 05:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 2157.395506] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 05:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 2157.396672] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 05:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 2157.397619] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 05:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 2157.398864] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 05:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 2157.400000] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 05:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 2157.401062] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 05:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 2157.402114] Aug 22 06:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 2184.541981] watchdog: BUG: soft lockup - CPU#1 stuck for 1926s! [qemu-system-x86:6715] Aug 22 06:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 2184.544544] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 06:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 2184.544766] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 06:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 2184.557995] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 06:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 2184.559331] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 06:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 2184.560572] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 2184.561640] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 06:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 2184.564265] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 06:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 2184.565377] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 06:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 2184.566557] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 06:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 2184.567765] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 06:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 2184.568956] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 06:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 2184.570148] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 06:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 2184.571353] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 06:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 2184.572620] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 06:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 2184.573738] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 06:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 2184.574974] Call Trace: Aug 22 06:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 2184.575906] Aug 22 06:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 2184.576820] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 2184.577959] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 2184.579110] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 2184.580345] ? show_regs.part.0+0x23/0x29 Aug 22 06:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 2184.581444] ? show_regs.cold+0x8/0xd Aug 22 06:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 2184.582494] ? watchdog_timer_fn+0x1be/0x220 Aug 22 06:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 2184.583615] ? lockup_detector_update_enable+0x60/0x60 Aug 22 06:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 2184.584789] ? __hrtimer_run_queues+0x107/0x230 Aug 22 06:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 2184.585916] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 06:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 2184.587042] ? hrtimer_interrupt+0x101/0x220 Aug 22 06:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 2184.588161] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 06:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 2184.589333] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 06:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 2184.590482] Aug 22 06:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 2184.591389] Aug 22 06:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 2184.592273] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 06:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 2184.593409] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 2184.594554] ? _raw_spin_lock+0x22/0x30 Aug 22 06:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 2184.595600] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 2184.596710] direct_page_fault+0x206/0x310 [kvm] Aug 22 06:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 2184.597822] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 06:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 2184.598941] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 06:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 2184.600034] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 06:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 2184.601148] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 06:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 2184.602191] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 06:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 2184.603346] handle_exit+0x98/0x230 [kvm_amd] Aug 22 06:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 2184.604334] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 06:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 2184.605340] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 06:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 2184.606365] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 06:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 2184.607440] vcpu_run+0x62/0x2c0 [kvm] Aug 22 06:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 2184.608346] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 06:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 2184.609241] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 06:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 2184.610189] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 06:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 2184.611081] ? __seccomp_filter+0x4a/0x4a0 Aug 22 06:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 2184.611906] ? __fget_files+0x86/0xc0 Aug 22 06:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 2184.612690] __x64_sys_ioctl+0x95/0xd0 Aug 22 06:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 2184.613464] do_syscall_64+0x5c/0xc0 Aug 22 06:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 2184.614206] ? do_futex+0x162/0x1f0 Aug 22 06:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 2184.614957] ? __x64_sys_futex+0x78/0x1e0 Aug 22 06:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 2184.615696] ? __secure_computing+0xa9/0x120 Aug 22 06:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 2184.616394] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 06:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 2184.617156] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 2184.617877] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 2184.618599] ? do_syscall_64+0x69/0xc0 Aug 22 06:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 2184.619313] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 2184.620021] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 2184.620717] ? do_syscall_64+0x69/0xc0 Aug 22 06:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 2184.621343] ? do_syscall_64+0x69/0xc0 Aug 22 06:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 2184.621965] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 06:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 2184.622671] RIP: 0033:0x7faa5d0edaff Aug 22 06:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 2184.623398] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 06:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 2184.625407] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 06:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 2184.626314] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 06:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 2184.627257] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 06:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 2184.628155] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 06:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 2184.629043] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 06:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 2184.629935] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 06:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 2184.630825] Aug 22 06:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 2212.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 1952s! [qemu-system-x86:6715] Aug 22 06:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 2212.543094] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 06:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 2212.543163] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 06:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 2212.555228] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 06:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 2212.556501] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 06:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 2212.557719] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 2212.558841] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 06:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 2212.561394] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 06:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 2212.562438] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 06:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 2212.563612] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 06:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 2212.564770] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 06:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 2212.565930] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 06:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 2212.567109] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 06:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 2212.568284] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 06:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 2212.569748] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 06:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 2212.570874] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 06:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 2212.572077] Call Trace: Aug 22 06:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 2212.573169] Aug 22 06:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 2212.574307] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 2212.575673] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 2212.577016] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 2212.578481] ? show_regs.part.0+0x23/0x29 Aug 22 06:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 2212.579599] ? show_regs.cold+0x8/0xd Aug 22 06:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 2212.580577] ? watchdog_timer_fn+0x1be/0x220 Aug 22 06:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 2212.581616] ? lockup_detector_update_enable+0x60/0x60 Aug 22 06:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 2212.582801] ? __hrtimer_run_queues+0x107/0x230 Aug 22 06:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 2212.584006] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 06:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 2212.585316] ? hrtimer_interrupt+0x101/0x220 Aug 22 06:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 2212.586667] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 06:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 2212.588050] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 06:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 2212.589227] Aug 22 06:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 2212.590090] Aug 22 06:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 2212.590948] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 06:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 2212.591982] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 2212.593026] ? _raw_spin_lock+0x22/0x30 Aug 22 06:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 2212.593976] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 2212.595046] direct_page_fault+0x206/0x310 [kvm] Aug 22 06:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 2212.596089] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 06:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 2212.597340] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 06:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 2212.598645] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 06:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 2212.599913] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 06:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 2212.600874] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 06:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 2212.601855] handle_exit+0x98/0x230 [kvm_amd] Aug 22 06:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 2212.602774] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 06:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 2212.603691] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 06:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 2212.604618] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 06:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 2212.605533] vcpu_run+0x62/0x2c0 [kvm] Aug 22 06:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 2212.606346] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 06:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 2212.607172] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 06:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 2212.608029] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 06:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 2212.608829] ? __seccomp_filter+0x4a/0x4a0 Aug 22 06:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 2212.609573] ? __fget_files+0x86/0xc0 Aug 22 06:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 2212.610294] __x64_sys_ioctl+0x95/0xd0 Aug 22 06:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 2212.611002] do_syscall_64+0x5c/0xc0 Aug 22 06:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 2212.611675] ? do_futex+0x162/0x1f0 Aug 22 06:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 2212.612325] ? __x64_sys_futex+0x78/0x1e0 Aug 22 06:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 2212.613000] ? __secure_computing+0xa9/0x120 Aug 22 06:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 2212.613690] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 06:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 2212.614454] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 2212.615195] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 2212.615917] ? do_syscall_64+0x69/0xc0 Aug 22 06:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 2212.616561] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 2212.617266] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 2212.617969] ? do_syscall_64+0x69/0xc0 Aug 22 06:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 2212.618614] ? do_syscall_64+0x69/0xc0 Aug 22 06:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 2212.619236] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 06:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 2212.619945] RIP: 0033:0x7faa5d0edaff Aug 22 06:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 2212.620571] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 06:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 2212.622577] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 06:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 2212.623487] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 06:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 2212.624375] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 06:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 2212.625264] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 06:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 2212.626156] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 06:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 2212.627055] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 06:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 2212.627950] Aug 22 06:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 2240.541976] watchdog: BUG: soft lockup - CPU#1 stuck for 1978s! [qemu-system-x86:6715] Aug 22 06:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 2240.543077] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 06:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 2240.543141] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 06:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 2240.555209] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 06:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 2240.556476] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 06:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 2240.557692] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 2240.558765] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 06:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 2240.561312] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 06:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 2240.562368] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 06:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 2240.563529] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 06:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 2240.564686] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 06:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 2240.565844] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 06:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 2240.567017] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 06:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 2240.568180] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 06:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 2240.569534] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 06:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 2240.570650] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 06:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 2240.571851] Call Trace: Aug 22 06:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 2240.572761] Aug 22 06:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 2240.573642] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 2240.574682] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 2240.575700] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 2240.576771] ? show_regs.part.0+0x23/0x29 Aug 22 06:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 2240.577770] ? show_regs.cold+0x8/0xd Aug 22 06:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 2240.578758] ? watchdog_timer_fn+0x1be/0x220 Aug 22 06:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 2240.579763] ? lockup_detector_update_enable+0x60/0x60 Aug 22 06:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 2240.580822] ? __hrtimer_run_queues+0x107/0x230 Aug 22 06:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 2240.581854] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 06:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 2240.582897] ? hrtimer_interrupt+0x101/0x220 Aug 22 06:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 2240.583910] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 06:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 2240.584976] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 06:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 2240.586023] Aug 22 06:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 2240.586883] Aug 22 06:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 2240.587718] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 06:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 2240.588746] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 2240.589782] ? _raw_spin_lock+0x22/0x30 Aug 22 06:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 2240.590733] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 2240.591746] direct_page_fault+0x206/0x310 [kvm] Aug 22 06:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 2240.592766] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 06:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 2240.593773] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 06:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 2240.594795] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 06:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 2240.595775] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 06:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 2240.596717] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 06:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 2240.597691] handle_exit+0x98/0x230 [kvm_amd] Aug 22 06:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 2240.598595] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 06:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 2240.599507] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 06:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 2240.600438] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 06:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 2240.601339] vcpu_run+0x62/0x2c0 [kvm] Aug 22 06:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 2240.602147] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 06:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 2240.602971] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 06:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 2240.603828] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 06:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 2240.604624] ? __seccomp_filter+0x4a/0x4a0 Aug 22 06:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 2240.605365] ? __fget_files+0x86/0xc0 Aug 22 06:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 2240.606066] __x64_sys_ioctl+0x95/0xd0 Aug 22 06:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 2240.606772] do_syscall_64+0x5c/0xc0 Aug 22 06:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 2240.607433] ? do_futex+0x162/0x1f0 Aug 22 06:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 2240.608079] ? __x64_sys_futex+0x78/0x1e0 Aug 22 06:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 2240.608750] ? __secure_computing+0xa9/0x120 Aug 22 06:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 2240.609439] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 06:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 2240.610239] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 2240.610959] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 2240.611671] ? do_syscall_64+0x69/0xc0 Aug 22 06:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 2240.612311] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 2240.613012] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 2240.613702] ? do_syscall_64+0x69/0xc0 Aug 22 06:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 2240.614334] ? do_syscall_64+0x69/0xc0 Aug 22 06:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 2240.614952] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 06:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 2240.615651] RIP: 0033:0x7faa5d0edaff Aug 22 06:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 2240.616273] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 06:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 2240.618260] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 06:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 2240.619168] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 06:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 2240.620051] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 06:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 2240.620934] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 06:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 2240.621821] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 06:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 2240.622718] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 06:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 2240.623603] Aug 22 06:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 2268.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 2004s! [qemu-system-x86:6715] Aug 22 06:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 2268.543731] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 06:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 2268.543982] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 06:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 2268.556301] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 06:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 2268.557572] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 06:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 2268.558816] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 2268.559875] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 06:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 2268.562489] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 06:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 2268.563559] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 06:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 2268.564737] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 06:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 2268.565915] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 06:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 2268.567076] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 06:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 2268.568270] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 06:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 2268.569485] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 06:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 2268.570734] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 06:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 2268.571850] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 06:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 2268.573055] Call Trace: Aug 22 06:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 2268.573986] Aug 22 06:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 2268.574881] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 2268.575925] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 2268.576944] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 2268.578065] ? show_regs.part.0+0x23/0x29 Aug 22 06:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 2268.579078] ? show_regs.cold+0x8/0xd Aug 22 06:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 2268.580048] ? watchdog_timer_fn+0x1be/0x220 Aug 22 06:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 2268.581068] ? lockup_detector_update_enable+0x60/0x60 Aug 22 06:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 2268.582151] ? __hrtimer_run_queues+0x107/0x230 Aug 22 06:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 2268.583180] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 06:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 2268.584208] ? hrtimer_interrupt+0x101/0x220 Aug 22 06:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 2268.585221] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 06:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 2268.586308] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 06:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 2268.587355] Aug 22 06:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 2268.588222] Aug 22 06:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 2268.589064] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 06:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 2268.590112] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 2268.591158] ? _raw_spin_lock+0x22/0x30 Aug 22 06:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 2268.592102] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 2268.593176] direct_page_fault+0x206/0x310 [kvm] Aug 22 06:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 2268.594229] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 06:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 2268.595238] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 06:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 2268.596238] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 06:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 2268.597226] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 06:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 2268.598214] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 06:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 2268.599192] handle_exit+0x98/0x230 [kvm_amd] Aug 22 06:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 2268.600097] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 06:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 2268.601015] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 06:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 2268.601989] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 06:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 2268.602902] vcpu_run+0x62/0x2c0 [kvm] Aug 22 06:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 2268.603713] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 06:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 2268.604528] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 06:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 2268.605386] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 06:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 2268.606201] ? __seccomp_filter+0x4a/0x4a0 Aug 22 06:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 2268.606951] ? __fget_files+0x86/0xc0 Aug 22 06:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 2268.607656] __x64_sys_ioctl+0x95/0xd0 Aug 22 06:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 2268.608348] do_syscall_64+0x5c/0xc0 Aug 22 06:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 2268.609012] ? do_futex+0x162/0x1f0 Aug 22 06:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 2268.609661] ? __x64_sys_futex+0x78/0x1e0 Aug 22 06:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 2268.610359] ? __secure_computing+0xa9/0x120 Aug 22 06:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 2268.611051] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 06:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 2268.611810] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 2268.612531] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 2268.613265] ? do_syscall_64+0x69/0xc0 Aug 22 06:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 2268.613935] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 2268.614640] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 2268.615336] ? do_syscall_64+0x69/0xc0 Aug 22 06:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 2268.615982] ? do_syscall_64+0x69/0xc0 Aug 22 06:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 2268.616606] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 06:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 2268.617314] RIP: 0033:0x7faa5d0edaff Aug 22 06:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 2268.617981] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 06:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 2268.619971] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 06:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 2268.620889] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 06:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 2268.621782] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 06:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 2268.622687] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 06:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 2268.623576] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 06:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 2268.624472] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 06:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 2268.625376] Aug 22 06:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 2296.541976] watchdog: BUG: soft lockup - CPU#1 stuck for 2030s! [qemu-system-x86:6715] Aug 22 06:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 2296.543079] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 06:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 2296.543145] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 06:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 2296.555175] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 06:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 2296.556445] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 06:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 2296.557689] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 2296.558745] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 06:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 2296.561282] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 06:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 2296.562336] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 06:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 2296.563495] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 06:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 2296.564652] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 06:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 2296.565823] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 06:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 2296.566982] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 06:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 2296.568144] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 06:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 2296.569373] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 06:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 2296.570484] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 06:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 2296.571677] Call Trace: Aug 22 06:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 2296.572586] Aug 22 06:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 2296.573468] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 2296.574507] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 2296.575523] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 2296.576593] ? show_regs.part.0+0x23/0x29 Aug 22 06:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 2296.577604] ? show_regs.cold+0x8/0xd Aug 22 06:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 2296.578579] ? watchdog_timer_fn+0x1be/0x220 Aug 22 06:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 2296.579590] ? lockup_detector_update_enable+0x60/0x60 Aug 22 06:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 2296.580655] ? __hrtimer_run_queues+0x107/0x230 Aug 22 06:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 2296.581699] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 06:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 2296.582722] ? hrtimer_interrupt+0x101/0x220 Aug 22 06:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 2296.583739] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 06:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 2296.584806] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 06:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 2296.585861] Aug 22 06:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 2296.586713] Aug 22 06:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 2296.587548] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 06:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 2296.588577] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 2296.589627] ? _raw_spin_lock+0x22/0x30 Aug 22 06:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 2296.590570] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 2296.591590] direct_page_fault+0x206/0x310 [kvm] Aug 22 06:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 2296.592613] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 06:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 2296.593637] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 06:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 2296.594636] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 06:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 2296.595603] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 06:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 2296.596547] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 06:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 2296.597535] handle_exit+0x98/0x230 [kvm_amd] Aug 22 06:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 2296.598427] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 06:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 2296.599345] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 06:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 2296.600445] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 06:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 2296.601347] vcpu_run+0x62/0x2c0 [kvm] Aug 22 06:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 2296.602169] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 06:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 2296.602980] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 06:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 2296.603832] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 06:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 2296.604634] ? __seccomp_filter+0x4a/0x4a0 Aug 22 06:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 2296.605375] ? __fget_files+0x86/0xc0 Aug 22 06:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 2296.606091] __x64_sys_ioctl+0x95/0xd0 Aug 22 06:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 2296.606782] do_syscall_64+0x5c/0xc0 Aug 22 06:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 2296.607444] ? do_futex+0x162/0x1f0 Aug 22 06:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 2296.608091] ? __x64_sys_futex+0x78/0x1e0 Aug 22 06:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 2296.608763] ? __secure_computing+0xa9/0x120 Aug 22 06:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 2296.609449] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 06:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 2296.610219] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 2296.610938] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 2296.611654] ? do_syscall_64+0x69/0xc0 Aug 22 06:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 2296.612299] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 2296.613000] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 2296.613701] ? do_syscall_64+0x69/0xc0 Aug 22 06:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 2296.614324] ? do_syscall_64+0x69/0xc0 Aug 22 06:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 2296.614945] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 06:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 2296.615646] RIP: 0033:0x7faa5d0edaff Aug 22 06:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 2296.616267] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 06:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 2296.618258] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 06:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 2296.619166] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 06:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 2296.620056] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 06:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 2296.620942] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 06:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 2296.621838] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 06:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 2296.622724] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 06:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 2296.623613] Aug 22 06:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 2324.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 2056s! [qemu-system-x86:6715] Aug 22 06:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 2324.543112] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 06:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 2324.543182] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 06:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 2324.555873] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 06:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 2324.557166] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 06:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 2324.558434] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 2324.559547] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 06:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 2324.562144] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 06:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 2324.563198] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 06:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 2324.564372] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 06:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 2324.565560] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 06:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 2324.566733] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 06:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 2324.567909] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 06:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 2324.569094] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 06:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 2324.570367] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 06:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 2324.571498] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 06:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 2324.572739] Call Trace: Aug 22 06:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 2324.573664] Aug 22 06:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 2324.574550] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 2324.575585] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 2324.576610] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 2324.577707] ? show_regs.part.0+0x23/0x29 Aug 22 06:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 2324.578713] ? show_regs.cold+0x8/0xd Aug 22 06:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 2324.579698] ? watchdog_timer_fn+0x1be/0x220 Aug 22 06:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 2324.580716] ? lockup_detector_update_enable+0x60/0x60 Aug 22 06:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 2324.581829] ? __hrtimer_run_queues+0x107/0x230 Aug 22 06:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 2324.582867] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 06:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 2324.583899] ? hrtimer_interrupt+0x101/0x220 Aug 22 06:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 2324.584954] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 06:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 2324.586058] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 06:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 2324.587115] Aug 22 06:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 2324.587972] Aug 22 06:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 2324.588815] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 06:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 2324.589887] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 2324.590944] ? _raw_spin_lock+0x22/0x30 Aug 22 06:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 2324.592029] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 2324.593052] direct_page_fault+0x206/0x310 [kvm] Aug 22 06:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 2324.594098] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 06:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 2324.595120] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 06:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 2324.596131] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 06:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 2324.597113] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 06:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 2324.598087] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 06:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 2324.599078] handle_exit+0x98/0x230 [kvm_amd] Aug 22 06:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 2324.599982] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 06:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 2324.600909] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 06:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 2324.601871] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 06:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 2324.602810] vcpu_run+0x62/0x2c0 [kvm] Aug 22 06:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 2324.603631] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 06:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 2324.604450] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 06:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 2324.605328] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 06:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 2324.606143] ? __seccomp_filter+0x4a/0x4a0 Aug 22 06:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 2324.606895] ? __fget_files+0x86/0xc0 Aug 22 06:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 2324.607611] __x64_sys_ioctl+0x95/0xd0 Aug 22 06:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 2324.608312] do_syscall_64+0x5c/0xc0 Aug 22 06:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 2324.608985] ? do_futex+0x162/0x1f0 Aug 22 06:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 2324.609655] ? __x64_sys_futex+0x78/0x1e0 Aug 22 06:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 2324.610339] ? __secure_computing+0xa9/0x120 Aug 22 06:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 2324.611052] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 06:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 2324.611842] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 2324.612572] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 2324.613314] ? do_syscall_64+0x69/0xc0 Aug 22 06:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 2324.613968] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 2324.614681] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 2324.615384] ? do_syscall_64+0x69/0xc0 Aug 22 06:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 2324.616014] ? do_syscall_64+0x69/0xc0 Aug 22 06:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 2324.616644] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 06:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 2324.617368] RIP: 0033:0x7faa5d0edaff Aug 22 06:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 2324.618009] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 06:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 2324.620062] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 06:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 2324.620999] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 06:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 2324.621911] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 06:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 2324.622811] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 06:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 2324.623710] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 06:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 2324.624611] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 06:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 2324.625531] Aug 22 06:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 2337.344706] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 06:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 2337.345707] rcu: 1-....: (553298 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=269589 Aug 22 06:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 2337.346814] (t=555036 jiffies g=23269 q=10930) Aug 22 06:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 2337.347587] NMI backtrace for cpu 1 Aug 22 06:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 2337.348293] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 06:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 2337.349406] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 06:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 2337.350460] Call Trace: Aug 22 06:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 2337.351135] Aug 22 06:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 2337.351780] show_stack+0x52/0x5c Aug 22 06:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 2337.352500] dump_stack_lvl+0x4a/0x63 Aug 22 06:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 2337.353260] dump_stack+0x10/0x16 Aug 22 06:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 2337.353973] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 06:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 2337.354747] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 06:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 2337.355520] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 06:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 2337.356334] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 06:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 2337.357156] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 06:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 2337.358065] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 06:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 2337.358832] print_cpu_stall.cold+0x2f/0xe2 Aug 22 06:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 2337.359715] ? timekeeping_update+0xf7/0x150 Aug 22 06:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 2337.360481] check_cpu_stall+0x109/0x270 Aug 22 06:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 2337.361238] rcu_sched_clock_irq+0x9a/0x250 Aug 22 06:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 2337.361995] update_process_times+0x94/0xd0 Aug 22 06:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 2337.362751] tick_sched_handle+0x29/0x70 Aug 22 06:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 2337.363495] tick_sched_timer+0x8c/0xc0 Aug 22 06:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 2337.364227] ? tick_nohz_handler+0xb0/0xb0 Aug 22 06:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 2337.364976] __hrtimer_run_queues+0x107/0x230 Aug 22 06:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 2337.365766] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 06:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 2337.366550] hrtimer_interrupt+0x101/0x220 Aug 22 06:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 2337.367304] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 06:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 2337.368112] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 06:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 2337.368908] Aug 22 06:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 2337.369558] Aug 22 06:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 2337.370186] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 06:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 2337.371018] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 2337.371900] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 06:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 2337.374135] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 06:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 2337.375004] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 06:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 2337.376002] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 06:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 2337.376970] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 06:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 2337.377946] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 06:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 2337.378901] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 06:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 2337.379846] ? _raw_spin_lock+0x22/0x30 Aug 22 06:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 2337.380599] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 2337.381438] direct_page_fault+0x206/0x310 [kvm] Aug 22 06:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 2337.382272] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 06:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 2337.383098] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 06:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 2337.383922] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 06:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 2337.384727] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 06:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 2337.385513] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 06:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 2337.386337] handle_exit+0x98/0x230 [kvm_amd] Aug 22 06:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 2337.387092] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 06:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 2337.387871] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 06:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 2337.388667] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 06:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 2337.389461] vcpu_run+0x62/0x2c0 [kvm] Aug 22 06:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 2337.390173] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 06:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 2337.390903] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 06:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 2337.391700] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 06:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 2337.394636] ? __seccomp_filter+0x4a/0x4a0 Aug 22 06:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 2337.395373] ? __fget_files+0x86/0xc0 Aug 22 06:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 2337.396078] __x64_sys_ioctl+0x95/0xd0 Aug 22 06:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 2337.396780] do_syscall_64+0x5c/0xc0 Aug 22 06:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 2337.397478] ? do_futex+0x162/0x1f0 Aug 22 06:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 2337.398150] ? __x64_sys_futex+0x78/0x1e0 Aug 22 06:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 2337.400885] ? __secure_computing+0xa9/0x120 Aug 22 06:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 2337.402646] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 06:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 2337.406403] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 2337.409159] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 2337.413208] ? do_syscall_64+0x69/0xc0 Aug 22 06:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 2337.414954] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 2337.418370] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 2337.422781] ? do_syscall_64+0x69/0xc0 Aug 22 06:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 2337.426208] ? do_syscall_64+0x69/0xc0 Aug 22 06:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 2337.428469] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 06:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 2337.432495] RIP: 0033:0x7faa5d0edaff Aug 22 06:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 2337.434351] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 06:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 2337.438698] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 06:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 2337.439688] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 06:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 2337.440649] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 06:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 2337.447533] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 06:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 2337.451199] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 06:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 2337.456669] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 06:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 2337.457673] Aug 22 06:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 2364.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 2094s! [qemu-system-x86:6715] Aug 22 06:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 2364.543692] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 06:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 2364.543921] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 06:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 2364.556376] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 06:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 2364.557727] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 06:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 2364.558996] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 2364.560062] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 06:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 2364.562719] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 06:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 2364.563780] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 06:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 2364.564973] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 06:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 2364.566176] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 06:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 2364.567357] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 06:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 2364.568542] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 06:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 2364.569746] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 06:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 2364.571010] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 06:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 2364.572153] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 06:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 2364.573390] Call Trace: Aug 22 06:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 2364.574311] Aug 22 06:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 2364.575214] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 2364.576255] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 2364.577301] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 2364.578404] ? show_regs.part.0+0x23/0x29 Aug 22 06:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 2364.579409] ? show_regs.cold+0x8/0xd Aug 22 06:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 2364.580387] ? watchdog_timer_fn+0x1be/0x220 Aug 22 06:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 2364.581423] ? lockup_detector_update_enable+0x60/0x60 Aug 22 06:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 2364.582498] ? __hrtimer_run_queues+0x107/0x230 Aug 22 06:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 2364.583534] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 06:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 2364.584570] ? hrtimer_interrupt+0x101/0x220 Aug 22 06:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 2364.585606] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 06:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 2364.586701] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 06:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 2364.587759] Aug 22 06:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 2364.588623] Aug 22 06:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 2364.589502] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 06:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 2364.590550] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 2364.591641] ? _raw_spin_lock+0x22/0x30 Aug 22 06:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 2364.592653] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 2364.593706] direct_page_fault+0x206/0x310 [kvm] Aug 22 06:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 2364.594746] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 06:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 2364.595765] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 06:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 2364.596793] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 06:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 2364.597810] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 06:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 2364.598770] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 06:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 2364.599774] handle_exit+0x98/0x230 [kvm_amd] Aug 22 06:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 2364.600683] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 06:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 2364.601637] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 06:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 2364.602588] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 06:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 2364.603501] vcpu_run+0x62/0x2c0 [kvm] Aug 22 06:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 2364.604320] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 06:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 2364.605158] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 06:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 2364.606026] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 06:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 2364.606839] ? __seccomp_filter+0x4a/0x4a0 Aug 22 06:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 2364.607592] ? __fget_files+0x86/0xc0 Aug 22 06:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 2364.608306] __x64_sys_ioctl+0x95/0xd0 Aug 22 06:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 2364.609018] do_syscall_64+0x5c/0xc0 Aug 22 06:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 2364.609690] ? do_futex+0x162/0x1f0 Aug 22 06:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 2364.610348] ? __x64_sys_futex+0x78/0x1e0 Aug 22 06:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 2364.611032] ? __secure_computing+0xa9/0x120 Aug 22 06:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 2364.611744] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 06:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 2364.612521] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 2364.613274] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 2364.614008] ? do_syscall_64+0x69/0xc0 Aug 22 06:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 2364.614664] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 2364.615376] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 2364.616095] ? do_syscall_64+0x69/0xc0 Aug 22 06:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 2364.616796] ? do_syscall_64+0x69/0xc0 Aug 22 06:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 2364.617445] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 06:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 2364.618171] RIP: 0033:0x7faa5d0edaff Aug 22 06:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 2364.618856] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 06:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 2364.620918] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 06:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 2364.621935] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 06:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 2364.622857] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 06:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 2364.623778] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 06:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 2364.624698] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 06:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 2364.625609] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 06:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 2364.626534] Aug 22 06:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 2392.541976] watchdog: BUG: soft lockup - CPU#1 stuck for 2120s! [qemu-system-x86:6715] Aug 22 06:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 2392.543085] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 06:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 2392.543152] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 06:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 2392.555289] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 06:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 2392.556570] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 06:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 2392.557786] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 2392.558848] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 06:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 2392.561407] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 06:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 2392.562463] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 06:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 2392.563623] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 06:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 2392.564806] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 06:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 2392.565962] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 06:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 2392.567120] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 06:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 2392.568286] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 06:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 2392.569531] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 06:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 2392.570627] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 06:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 2392.571817] Call Trace: Aug 22 06:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 2392.572763] Aug 22 06:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 2392.573653] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 2392.574682] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 2392.575701] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 2392.576787] ? show_regs.part.0+0x23/0x29 Aug 22 06:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 2392.577788] ? show_regs.cold+0x8/0xd Aug 22 06:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 2392.578757] ? watchdog_timer_fn+0x1be/0x220 Aug 22 06:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 2392.579761] ? lockup_detector_update_enable+0x60/0x60 Aug 22 06:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 2392.580837] ? __hrtimer_run_queues+0x107/0x230 Aug 22 06:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 2392.581862] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 06:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 2392.582884] ? hrtimer_interrupt+0x101/0x220 Aug 22 06:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 2392.583896] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 06:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 2392.584976] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 06:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 2392.586019] Aug 22 06:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 2392.586870] Aug 22 06:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 2392.587704] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 06:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 2392.588772] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 2392.589814] ? _raw_spin_lock+0x22/0x30 Aug 22 06:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 2392.590756] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 2392.591777] direct_page_fault+0x206/0x310 [kvm] Aug 22 06:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 2392.592829] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 06:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 2392.593840] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 06:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 2392.594844] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 06:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 2392.595816] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 06:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 2392.596782] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 06:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 2392.597759] handle_exit+0x98/0x230 [kvm_amd] Aug 22 06:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 2392.598650] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 06:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 2392.599567] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 06:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 2392.600502] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 06:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 2392.601404] vcpu_run+0x62/0x2c0 [kvm] Aug 22 06:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 2392.602213] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 06:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 2392.603019] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 06:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 2392.603871] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 06:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 2392.604686] ? __seccomp_filter+0x4a/0x4a0 Aug 22 06:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 2392.605428] ? __fget_files+0x86/0xc0 Aug 22 06:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 2392.606129] __x64_sys_ioctl+0x95/0xd0 Aug 22 06:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 2392.606820] do_syscall_64+0x5c/0xc0 Aug 22 06:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 2392.607481] ? do_futex+0x162/0x1f0 Aug 22 06:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 2392.608128] ? __x64_sys_futex+0x78/0x1e0 Aug 22 06:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 2392.608812] ? __secure_computing+0xa9/0x120 Aug 22 06:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 2392.609501] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 06:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 2392.610263] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 2392.610983] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 2392.611698] ? do_syscall_64+0x69/0xc0 Aug 22 06:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 2392.612359] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 2392.613061] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 2392.613776] ? do_syscall_64+0x69/0xc0 Aug 22 06:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 2392.614403] ? do_syscall_64+0x69/0xc0 Aug 22 06:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 2392.615025] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 06:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 2392.615729] RIP: 0033:0x7faa5d0edaff Aug 22 06:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 2392.616369] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 06:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 2392.618359] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 06:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 2392.619268] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 06:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 2392.620157] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 06:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 2392.621066] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 06:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 2392.621957] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 06:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 2392.622844] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 06:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 2392.623736] Aug 22 06:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 2420.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 2146s! [qemu-system-x86:6715] Aug 22 06:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 2420.543103] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 06:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 2420.543173] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 06:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 2420.555224] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 06:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 2420.556504] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 06:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 2420.557774] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 2420.558860] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 06:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 2420.561429] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 06:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 2420.562499] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 06:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 2420.563698] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 06:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 2420.564885] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 06:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 2420.566043] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 06:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 2420.567228] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 06:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 2420.568449] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 06:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 2420.569688] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 06:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 2420.570785] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 06:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 2420.571979] Call Trace: Aug 22 06:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 2420.572925] Aug 22 06:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 2420.573838] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 2420.574872] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 2420.575901] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 2420.577105] ? show_regs.part.0+0x23/0x29 Aug 22 06:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 2420.578124] ? show_regs.cold+0x8/0xd Aug 22 06:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 2420.579113] ? watchdog_timer_fn+0x1be/0x220 Aug 22 06:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 2420.580139] ? lockup_detector_update_enable+0x60/0x60 Aug 22 06:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 2420.581202] ? __hrtimer_run_queues+0x107/0x230 Aug 22 06:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 2420.582231] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 06:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 2420.583265] ? hrtimer_interrupt+0x101/0x220 Aug 22 06:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 2420.584356] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 06:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 2420.585430] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 06:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 2420.586476] Aug 22 06:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 2420.587334] Aug 22 06:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 2420.588201] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 06:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 2420.589268] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 2420.590312] ? _raw_spin_lock+0x22/0x30 Aug 22 06:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 2420.591260] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 2420.592315] direct_page_fault+0x206/0x310 [kvm] Aug 22 06:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 2420.593358] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 06:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 2420.594413] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 06:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 2420.595422] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 06:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 2420.596422] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 06:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 2420.597391] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 06:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 2420.598385] handle_exit+0x98/0x230 [kvm_amd] Aug 22 06:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 2420.599293] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 06:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 2420.600228] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 06:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 2420.601156] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 06:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 2420.602060] vcpu_run+0x62/0x2c0 [kvm] Aug 22 06:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 2420.602876] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 06:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 2420.603693] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 06:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 2420.604585] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 06:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 2420.605387] ? __seccomp_filter+0x4a/0x4a0 Aug 22 06:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 2420.606130] ? __fget_files+0x86/0xc0 Aug 22 06:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 2420.606837] __x64_sys_ioctl+0x95/0xd0 Aug 22 06:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 2420.607539] do_syscall_64+0x5c/0xc0 Aug 22 06:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 2420.608216] ? do_futex+0x162/0x1f0 Aug 22 06:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 2420.608879] ? __x64_sys_futex+0x78/0x1e0 Aug 22 06:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 2420.609569] ? __secure_computing+0xa9/0x120 Aug 22 06:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 2420.610272] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 06:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 2420.611032] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 2420.611757] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 2420.612486] ? do_syscall_64+0x69/0xc0 Aug 22 06:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 2420.613132] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 2420.613854] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 2420.614563] ? do_syscall_64+0x69/0xc0 Aug 22 06:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 2420.615205] ? do_syscall_64+0x69/0xc0 Aug 22 06:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 2420.615828] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 06:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 2420.616604] RIP: 0033:0x7faa5d0edaff Aug 22 06:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 2420.617353] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 06:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 2420.619636] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 06:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 2420.620618] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 06:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 2420.621510] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 06:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 2420.622399] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 06:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 2420.623292] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 06:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 2420.624221] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 06:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 2420.625152] Aug 22 06:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 2448.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 2172s! [qemu-system-x86:6715] Aug 22 06:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 2448.543745] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 06:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 2448.544010] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 06:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 2448.556078] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 06:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 2448.557343] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 06:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 2448.558564] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 2448.560461] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 06:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 2448.563053] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 06:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 2448.564112] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 06:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 2448.565271] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 06:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 2448.566428] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 06:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 2448.567584] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 06:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 2448.568758] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 06:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 2448.569923] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 06:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 2448.571153] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 06:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 2448.572273] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 06:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 2448.573464] Call Trace: Aug 22 06:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 2448.574486] Aug 22 06:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 2448.575379] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 2448.576429] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 2448.577449] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 2448.578537] ? show_regs.part.0+0x23/0x29 Aug 22 06:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 2448.579535] ? show_regs.cold+0x8/0xd Aug 22 06:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 2448.580653] ? watchdog_timer_fn+0x1be/0x220 Aug 22 06:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 2448.581660] ? lockup_detector_update_enable+0x60/0x60 Aug 22 06:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 2448.582720] ? __hrtimer_run_queues+0x107/0x230 Aug 22 06:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 2448.583761] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 06:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 2448.584784] ? hrtimer_interrupt+0x101/0x220 Aug 22 06:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 2448.585801] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 06:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 2448.586869] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 06:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 2448.587934] Aug 22 06:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 2448.588785] Aug 22 06:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 2448.589621] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 06:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 2448.590651] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 2448.591702] ? _raw_spin_lock+0x22/0x30 Aug 22 06:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 2448.592652] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 2448.593668] direct_page_fault+0x206/0x310 [kvm] Aug 22 06:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 2448.594692] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 06:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 2448.595717] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 06:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 2448.596719] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 06:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 2448.597704] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 06:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 2448.598647] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 06:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 2448.599623] handle_exit+0x98/0x230 [kvm_amd] Aug 22 06:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 2448.600529] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 06:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 2448.601446] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 06:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 2448.602369] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 06:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 2448.603271] vcpu_run+0x62/0x2c0 [kvm] Aug 22 06:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 2448.604103] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 06:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 2448.604912] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 06:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 2448.605766] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 06:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 2448.606563] ? __seccomp_filter+0x4a/0x4a0 Aug 22 06:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 2448.607305] ? __fget_files+0x86/0xc0 Aug 22 06:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 2448.608031] __x64_sys_ioctl+0x95/0xd0 Aug 22 06:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 2448.608722] do_syscall_64+0x5c/0xc0 Aug 22 06:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 2448.609386] ? do_futex+0x162/0x1f0 Aug 22 06:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 2448.610038] ? __x64_sys_futex+0x78/0x1e0 Aug 22 06:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 2448.610712] ? __secure_computing+0xa9/0x120 Aug 22 06:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 2448.611402] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 06:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 2448.612174] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 2448.612895] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 2448.613614] ? do_syscall_64+0x69/0xc0 Aug 22 06:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 2448.614262] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 2448.614965] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 2448.615674] ? do_syscall_64+0x69/0xc0 Aug 22 06:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 2448.616299] ? do_syscall_64+0x69/0xc0 Aug 22 06:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 2448.616924] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 06:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 2448.617630] RIP: 0033:0x7faa5d0edaff Aug 22 06:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 2448.618280] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 06:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 2448.620289] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 06:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 2448.621207] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 06:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 2448.622097] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 06:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 2448.622992] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 06:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 2448.623895] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 06:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 2448.624784] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 06:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 2448.625674] Aug 22 06:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 2476.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 2198s! [qemu-system-x86:6715] Aug 22 06:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 2476.543086] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 06:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 2476.543156] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 06:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 2476.555222] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 06:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 2476.556505] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 06:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 2476.557724] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 2476.558779] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 06:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 2476.561327] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 06:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 2476.562372] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 06:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 2476.563547] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 06:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 2476.564705] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 06:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 2476.565866] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 06:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 2476.567026] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 06:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 2476.568218] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 06:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 2476.569449] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 06:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 2476.570544] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 06:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 2476.571752] Call Trace: Aug 22 06:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 2476.572672] Aug 22 06:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 2476.573559] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 2476.574586] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 2476.575619] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 2476.576697] ? show_regs.part.0+0x23/0x29 Aug 22 06:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 2476.577693] ? show_regs.cold+0x8/0xd Aug 22 06:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 2476.578667] ? watchdog_timer_fn+0x1be/0x220 Aug 22 06:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 2476.579685] ? lockup_detector_update_enable+0x60/0x60 Aug 22 06:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 2476.580749] ? __hrtimer_run_queues+0x107/0x230 Aug 22 06:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 2476.581776] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 06:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 2476.582803] ? hrtimer_interrupt+0x101/0x220 Aug 22 06:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 2476.583831] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 06:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 2476.584904] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 06:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 2476.585947] Aug 22 06:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 2476.586799] Aug 22 06:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 2476.587648] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 06:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 2476.588681] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 2476.589724] ? _raw_spin_lock+0x22/0x30 Aug 22 06:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 2476.590667] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 2476.591691] direct_page_fault+0x206/0x310 [kvm] Aug 22 06:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 2476.592716] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 06:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 2476.593725] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 06:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 2476.594725] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 06:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 2476.595711] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 06:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 2476.596658] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 06:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 2476.597643] handle_exit+0x98/0x230 [kvm_amd] Aug 22 06:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 2476.598541] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 06:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 2476.599470] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 06:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 2476.600393] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 06:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 2476.601302] vcpu_run+0x62/0x2c0 [kvm] Aug 22 06:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 2476.602112] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 06:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 2476.602919] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 06:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 2476.603787] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 06:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 2476.604585] ? __seccomp_filter+0x4a/0x4a0 Aug 22 06:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 2476.605328] ? __fget_files+0x86/0xc0 Aug 22 06:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 2476.606030] __x64_sys_ioctl+0x95/0xd0 Aug 22 06:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 2476.606727] do_syscall_64+0x5c/0xc0 Aug 22 06:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 2476.607403] ? do_futex+0x162/0x1f0 Aug 22 06:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 2476.608051] ? __x64_sys_futex+0x78/0x1e0 Aug 22 06:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 2476.608724] ? __secure_computing+0xa9/0x120 Aug 22 06:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 2476.609413] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 06:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 2476.610172] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 2476.610894] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 2476.611617] ? do_syscall_64+0x69/0xc0 Aug 22 06:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 2476.612262] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 2476.612965] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 2476.613663] ? do_syscall_64+0x69/0xc0 Aug 22 06:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 2476.614292] ? do_syscall_64+0x69/0xc0 Aug 22 06:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 2476.614914] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 06:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 2476.615628] RIP: 0033:0x7faa5d0edaff Aug 22 06:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 2476.616271] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 06:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 2476.618266] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 06:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 2476.619176] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 06:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 2476.620072] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 06:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 2476.620959] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 06:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 2476.621846] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 06:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 2476.622740] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 06:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 2476.623640] Aug 22 06:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 2504.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 2224s! [qemu-system-x86:6715] Aug 22 06:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 2504.543127] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 06:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 2504.543197] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 06:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 2504.555296] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 06:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 2504.556572] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 06:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 2504.557791] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 2504.558848] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 06:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 2504.561412] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 06:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 2504.562457] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 06:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 2504.563654] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 06:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 2504.564815] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 06:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 2504.565974] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 06:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 2504.567152] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 06:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 2504.568327] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 06:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 2504.569572] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 06:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 2504.570671] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 06:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 2504.571877] Call Trace: Aug 22 06:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 2504.572793] Aug 22 06:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 2504.573674] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 2504.574707] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 2504.575739] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 2504.576814] ? show_regs.part.0+0x23/0x29 Aug 22 06:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 2504.577813] ? show_regs.cold+0x8/0xd Aug 22 06:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 2504.578781] ? watchdog_timer_fn+0x1be/0x220 Aug 22 06:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 2504.579800] ? lockup_detector_update_enable+0x60/0x60 Aug 22 06:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 2504.580861] ? __hrtimer_run_queues+0x107/0x230 Aug 22 06:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 2504.581887] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 06:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 2504.582908] ? hrtimer_interrupt+0x101/0x220 Aug 22 06:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 2504.583940] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 06:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 2504.585025] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 06:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 2504.586078] Aug 22 06:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 2504.586931] Aug 22 06:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 2504.587783] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 06:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 2504.588820] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 2504.589860] ? _raw_spin_lock+0x22/0x30 Aug 22 06:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 2504.590805] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 2504.591841] direct_page_fault+0x206/0x310 [kvm] Aug 22 06:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 2504.592864] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 06:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 2504.593875] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 06:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 2504.594876] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 06:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 2504.595857] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 06:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 2504.596798] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 06:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 2504.597773] handle_exit+0x98/0x230 [kvm_amd] Aug 22 06:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 2504.598663] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 06:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 2504.599593] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 06:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 2504.600517] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 06:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 2504.601424] vcpu_run+0x62/0x2c0 [kvm] Aug 22 06:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 2504.602235] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 06:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 2504.603060] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 06:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 2504.603913] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 06:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 2504.604709] ? __seccomp_filter+0x4a/0x4a0 Aug 22 06:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 2504.605458] ? __fget_files+0x86/0xc0 Aug 22 06:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 2504.606162] __x64_sys_ioctl+0x95/0xd0 Aug 22 06:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 2504.606854] do_syscall_64+0x5c/0xc0 Aug 22 06:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 2504.607534] ? do_futex+0x162/0x1f0 Aug 22 06:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 2504.608187] ? __x64_sys_futex+0x78/0x1e0 Aug 22 06:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 2504.608861] ? __secure_computing+0xa9/0x120 Aug 22 06:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 2504.609561] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 06:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 2504.610321] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 2504.611062] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 2504.611785] ? do_syscall_64+0x69/0xc0 Aug 22 06:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 2504.612428] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 2504.613132] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 2504.613844] ? do_syscall_64+0x69/0xc0 Aug 22 06:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 2504.614470] ? do_syscall_64+0x69/0xc0 Aug 22 06:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 2504.615104] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 06:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 2504.615811] RIP: 0033:0x7faa5d0edaff Aug 22 06:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 2504.616441] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 06:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 2504.618427] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 06:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 2504.619351] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 06:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 2504.620246] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 06:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 2504.621140] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 06:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 2504.622029] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 06:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 2504.622916] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 06:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 2504.623837] Aug 22 06:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 2517.356709] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 06:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 2517.357713] rcu: 1-....: (598156 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=291334 Aug 22 06:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 2517.358926] (t=600039 jiffies g=23269 q=11184) Aug 22 06:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 2517.359731] NMI backtrace for cpu 1 Aug 22 06:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 2517.360461] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 06:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 2517.361612] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 06:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 2517.362699] Call Trace: Aug 22 06:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 2517.363398] Aug 22 06:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 2517.364047] show_stack+0x52/0x5c Aug 22 06:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 2517.364786] dump_stack_lvl+0x4a/0x63 Aug 22 06:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 2517.365546] dump_stack+0x10/0x16 Aug 22 06:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 2517.366279] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 06:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 2517.367092] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 06:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 2517.367893] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 06:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 2517.368729] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 06:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 2517.369592] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 06:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 2517.370411] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 06:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 2517.371217] print_cpu_stall.cold+0x2f/0xe2 Aug 22 06:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 2517.371991] ? timekeeping_update+0xf7/0x150 Aug 22 06:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 2517.372785] check_cpu_stall+0x109/0x270 Aug 22 06:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 2517.373543] rcu_sched_clock_irq+0x9a/0x250 Aug 22 06:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 2517.374321] update_process_times+0x94/0xd0 Aug 22 06:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 2517.375105] tick_sched_handle+0x29/0x70 Aug 22 06:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 2517.375858] tick_sched_timer+0x8c/0xc0 Aug 22 06:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 2517.376620] ? tick_nohz_handler+0xb0/0xb0 Aug 22 06:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 2517.377438] __hrtimer_run_queues+0x107/0x230 Aug 22 06:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 2517.378226] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 06:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 2517.379029] hrtimer_interrupt+0x101/0x220 Aug 22 06:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 2517.379822] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 06:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 2517.380652] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 06:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 2517.381473] Aug 22 06:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 2517.382113] Aug 22 06:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 2517.382763] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 06:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 2517.383605] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 2517.384508] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 06:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 2517.386778] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 06:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 2517.387685] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 06:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 2517.388694] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 06:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 2517.389697] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 06:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 2517.390690] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 06:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 2517.391674] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 06:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 2517.392661] ? _raw_spin_lock+0x22/0x30 Aug 22 06:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 2517.393434] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 2517.394285] direct_page_fault+0x206/0x310 [kvm] Aug 22 06:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 2517.395158] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 06:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 2517.396002] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 06:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 2517.396842] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 06:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 2517.397657] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 06:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 2517.398496] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 06:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 2517.399366] handle_exit+0x98/0x230 [kvm_amd] Aug 22 06:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 2517.400134] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 06:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 2517.400942] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 06:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 2517.401760] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 06:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 2517.402566] vcpu_run+0x62/0x2c0 [kvm] Aug 22 06:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 2517.403308] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 06:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 2517.404053] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 06:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 2517.404872] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 06:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 2517.405652] ? __seccomp_filter+0x4a/0x4a0 Aug 22 06:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 2517.406383] ? __fget_files+0x86/0xc0 Aug 22 06:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 2517.407100] __x64_sys_ioctl+0x95/0xd0 Aug 22 06:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 2517.407814] do_syscall_64+0x5c/0xc0 Aug 22 06:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 2517.408511] ? do_futex+0x162/0x1f0 Aug 22 06:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 2517.409222] ? __x64_sys_futex+0x78/0x1e0 Aug 22 06:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 2517.409974] ? __secure_computing+0xa9/0x120 Aug 22 06:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 2517.410710] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 06:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 2517.411533] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 2517.412302] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 2517.413076] ? do_syscall_64+0x69/0xc0 Aug 22 06:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 2517.413785] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 2517.414566] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 2517.415359] ? do_syscall_64+0x69/0xc0 Aug 22 06:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 2517.416068] ? do_syscall_64+0x69/0xc0 Aug 22 06:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 2517.416775] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 06:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 2517.417576] RIP: 0033:0x7faa5d0edaff Aug 22 06:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 2517.418267] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 06:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 2517.420477] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 06:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 2517.421477] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 06:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 2517.422449] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 06:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 2517.423427] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 06:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 2517.424389] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 06:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 2517.425339] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 06:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 2517.426278] Aug 22 06:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 2544.541982] watchdog: BUG: soft lockup - CPU#1 stuck for 2261s! [qemu-system-x86:6715] Aug 22 06:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 2544.543771] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 06:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 2544.543992] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 06:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 2544.556351] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 06:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 2544.557640] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 06:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 2544.558899] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 2544.559969] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 06:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 2544.562853] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 06:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 2544.563920] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 06:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 2544.565144] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 06:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 2544.566358] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 06:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 2544.567581] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 06:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 2544.568828] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 06:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 2544.570068] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 06:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 2544.571397] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 06:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 2544.572583] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 06:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 2544.573828] Call Trace: Aug 22 06:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 2544.574787] Aug 22 06:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 2544.575706] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 2544.576882] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 2544.578010] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 2544.579235] ? show_regs.part.0+0x23/0x29 Aug 22 06:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 2544.580319] ? show_regs.cold+0x8/0xd Aug 22 06:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 2544.581371] ? watchdog_timer_fn+0x1be/0x220 Aug 22 06:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 2544.582481] ? lockup_detector_update_enable+0x60/0x60 Aug 22 06:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 2544.583701] ? __hrtimer_run_queues+0x107/0x230 Aug 22 06:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 2544.584839] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 06:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 2544.585957] ? hrtimer_interrupt+0x101/0x220 Aug 22 06:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 2544.587086] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 06:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 2544.588269] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 06:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 2544.589335] Aug 22 06:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 2544.590250] Aug 22 06:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 2544.591145] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 06:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 2544.592187] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 2544.593229] ? _raw_spin_lock+0x22/0x30 Aug 22 06:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 2544.594182] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 2544.595236] direct_page_fault+0x206/0x310 [kvm] Aug 22 06:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 2544.596312] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 06:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 2544.597335] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 06:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 2544.598348] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 06:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 2544.599373] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 06:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 2544.600365] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 06:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 2544.601382] handle_exit+0x98/0x230 [kvm_amd] Aug 22 06:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 2544.602358] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 06:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 2544.603306] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 06:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 2544.604259] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 06:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 2544.605183] vcpu_run+0x62/0x2c0 [kvm] Aug 22 06:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 2544.606002] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 06:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 2544.606859] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 06:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 2544.607721] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 06:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 2544.608546] ? __seccomp_filter+0x4a/0x4a0 Aug 22 06:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 2544.609308] ? __fget_files+0x86/0xc0 Aug 22 06:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 2544.610088] __x64_sys_ioctl+0x95/0xd0 Aug 22 06:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 2544.610878] do_syscall_64+0x5c/0xc0 Aug 22 06:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 2544.611577] ? do_futex+0x162/0x1f0 Aug 22 06:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 2544.612254] ? __x64_sys_futex+0x78/0x1e0 Aug 22 06:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 2544.612947] ? __secure_computing+0xa9/0x120 Aug 22 06:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 2544.613644] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 06:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 2544.614425] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 2544.615179] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 2544.615905] ? do_syscall_64+0x69/0xc0 Aug 22 06:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 2544.616556] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 2544.617273] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 2544.617975] ? do_syscall_64+0x69/0xc0 Aug 22 06:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 2544.618626] ? do_syscall_64+0x69/0xc0 Aug 22 06:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 2544.619259] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 06:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 2544.619990] RIP: 0033:0x7faa5d0edaff Aug 22 06:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 2544.620691] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 06:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 2544.622711] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 06:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 2544.623628] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 06:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 2544.624549] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 06:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 2544.625458] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 06:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 2544.626381] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 06:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 2544.627325] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 06:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 2544.628224] Aug 22 06:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 2572.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 2287s! [qemu-system-x86:6715] Aug 22 06:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 2572.543092] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 06:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 2572.543159] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 06:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 2572.555329] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 06:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 2572.556615] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 06:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 2572.557836] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 2572.558965] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 06:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 2572.561529] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 06:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 2572.562588] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 06:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 2572.563787] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 06:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 2572.564949] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 06:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 2572.566108] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 06:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 2572.567486] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 06:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 2572.568649] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 06:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 2572.569878] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 06:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 2572.570993] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 06:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 2572.572185] Call Trace: Aug 22 06:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 2572.573128] Aug 22 06:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 2572.574018] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 2572.575063] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 2572.576084] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 2572.577158] ? show_regs.part.0+0x23/0x29 Aug 22 06:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 2572.578188] ? show_regs.cold+0x8/0xd Aug 22 06:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 2572.579165] ? watchdog_timer_fn+0x1be/0x220 Aug 22 06:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 2572.580171] ? lockup_detector_update_enable+0x60/0x60 Aug 22 06:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 2572.581233] ? __hrtimer_run_queues+0x107/0x230 Aug 22 06:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 2572.582308] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 06:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 2572.583338] ? hrtimer_interrupt+0x101/0x220 Aug 22 06:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 2572.584354] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 06:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 2572.585424] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 06:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 2572.586500] Aug 22 06:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 2572.587358] Aug 22 06:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 2572.588193] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 06:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 2572.589299] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 2572.590499] ? _raw_spin_lock+0x22/0x30 Aug 22 06:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 2572.591744] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 2572.593043] direct_page_fault+0x206/0x310 [kvm] Aug 22 06:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 2572.594100] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 06:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 2572.595148] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 06:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 2572.596335] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 06:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 2572.597719] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 06:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 2572.598711] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 06:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 2572.599695] handle_exit+0x98/0x230 [kvm_amd] Aug 22 06:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 2572.600594] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 06:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 2572.601515] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 06:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 2572.602479] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 06:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 2572.603389] vcpu_run+0x62/0x2c0 [kvm] Aug 22 06:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 2572.604204] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 06:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 2572.605015] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 06:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 2572.605881] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 06:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 2572.606704] ? __seccomp_filter+0x4a/0x4a0 Aug 22 06:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 2572.607451] ? __fget_files+0x86/0xc0 Aug 22 06:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 2572.608159] __x64_sys_ioctl+0x95/0xd0 Aug 22 06:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 2572.608855] do_syscall_64+0x5c/0xc0 Aug 22 06:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 2572.609524] ? do_futex+0x162/0x1f0 Aug 22 06:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 2572.610208] ? __x64_sys_futex+0x78/0x1e0 Aug 22 06:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 2572.610945] ? __secure_computing+0xa9/0x120 Aug 22 06:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 2572.611876] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 06:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 2572.612926] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 2572.613666] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 2572.614458] ? do_syscall_64+0x69/0xc0 Aug 22 06:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 2572.615113] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 2572.615816] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 2572.616516] ? do_syscall_64+0x69/0xc0 Aug 22 06:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 2572.617141] ? do_syscall_64+0x69/0xc0 Aug 22 06:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 2572.617783] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 06:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 2572.618512] RIP: 0033:0x7faa5d0edaff Aug 22 06:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 2572.619208] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 06:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 2572.621202] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 06:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 2572.622138] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 06:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 2572.623070] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 06:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 2572.623960] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 06:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 2572.624847] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 06:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 2572.625747] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 06:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 2572.626828] Aug 22 06:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 2600.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 2313s! [qemu-system-x86:6715] Aug 22 06:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 2600.543098] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 06:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 2600.543165] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 06:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 2600.555449] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 06:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 2600.556709] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 06:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 2600.557943] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 2600.558999] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 06:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 2600.561606] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 06:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 2600.562679] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 06:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 2600.563845] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 06:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 2600.565012] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 06:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 2600.566190] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 06:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 2600.567360] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 06:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 2600.568531] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 06:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 2600.569763] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 06:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 2600.570878] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 06:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 2600.572094] Call Trace: Aug 22 06:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 2600.573011] Aug 22 06:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 2600.573912] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 2600.574947] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 2600.575976] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 2600.577055] ? show_regs.part.0+0x23/0x29 Aug 22 06:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 2600.578079] ? show_regs.cold+0x8/0xd Aug 22 06:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 2600.579056] ? watchdog_timer_fn+0x1be/0x220 Aug 22 06:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 2600.580066] ? lockup_detector_update_enable+0x60/0x60 Aug 22 06:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 2600.581127] ? __hrtimer_run_queues+0x107/0x230 Aug 22 06:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 2600.582175] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 06:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 2600.583226] ? hrtimer_interrupt+0x101/0x220 Aug 22 06:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 2600.584240] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 06:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 2600.585309] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 06:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 2600.586373] Aug 22 06:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 2600.587227] Aug 22 06:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 2600.588077] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 06:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 2600.589121] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 2600.590170] ? _raw_spin_lock+0x22/0x30 Aug 22 06:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 2600.591118] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 2600.592135] direct_page_fault+0x206/0x310 [kvm] Aug 22 06:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 2600.593160] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 06:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 2600.594179] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 06:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 2600.595182] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 06:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 2600.596152] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 06:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 2600.597099] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 06:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 2600.598088] handle_exit+0x98/0x230 [kvm_amd] Aug 22 06:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 2600.598984] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 06:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 2600.599893] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 06:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 2600.600817] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 06:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 2600.601720] vcpu_run+0x62/0x2c0 [kvm] Aug 22 06:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 2600.602536] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 06:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 2600.603339] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 06:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 2600.604189] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 06:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 2600.604982] ? __seccomp_filter+0x4a/0x4a0 Aug 22 06:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 2600.605725] ? __fget_files+0x86/0xc0 Aug 22 06:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 2600.606439] __x64_sys_ioctl+0x95/0xd0 Aug 22 06:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 2600.607127] do_syscall_64+0x5c/0xc0 Aug 22 06:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 2600.607793] ? do_futex+0x162/0x1f0 Aug 22 06:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 2600.608495] ? __x64_sys_futex+0x78/0x1e0 Aug 22 06:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 2600.609242] ? __secure_computing+0xa9/0x120 Aug 22 06:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 2600.609956] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 06:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 2600.610726] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 2600.611449] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 2600.612191] ? do_syscall_64+0x69/0xc0 Aug 22 06:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 2600.612871] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 2600.613575] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 2600.614281] ? do_syscall_64+0x69/0xc0 Aug 22 06:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 2600.614907] ? do_syscall_64+0x69/0xc0 Aug 22 06:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 2600.615525] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 06:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 2600.616229] RIP: 0033:0x7faa5d0edaff Aug 22 06:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 2600.616853] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 06:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 2600.618839] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 06:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 2600.619742] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 06:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 2600.620631] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 06:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 2600.621519] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 06:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 2600.622425] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 06:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 2600.623330] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 06:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 2600.624224] Aug 22 06:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 2628.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 2340s! [qemu-system-x86:6715] Aug 22 06:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 2628.543713] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 06:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 2628.543979] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 06:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 2628.556061] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 06:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 2628.557325] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 06:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 2628.558558] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 2628.559614] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 06:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 2628.562175] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 06:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 2628.563217] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 06:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 2628.564378] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 06:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 2628.565547] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 06:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 2628.566709] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 06:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 2628.567877] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 06:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 2628.569043] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 06:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 2628.570289] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 06:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 2628.571386] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 06:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 2628.572578] Call Trace: Aug 22 06:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 2628.573503] Aug 22 06:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 2628.574399] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 2628.575425] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 2628.576443] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 2628.577546] ? show_regs.part.0+0x23/0x29 Aug 22 06:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 2628.578581] ? show_regs.cold+0x8/0xd Aug 22 06:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 2628.579550] ? watchdog_timer_fn+0x1be/0x220 Aug 22 06:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 2628.580557] ? lockup_detector_update_enable+0x60/0x60 Aug 22 06:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 2628.581637] ? __hrtimer_run_queues+0x107/0x230 Aug 22 06:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 2628.582663] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 06:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 2628.583685] ? hrtimer_interrupt+0x101/0x220 Aug 22 06:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 2628.584698] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 06:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 2628.585783] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 06:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 2628.586828] Aug 22 06:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 2628.587680] Aug 22 06:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 2628.588516] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 06:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 2628.589571] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 2628.590611] ? _raw_spin_lock+0x22/0x30 Aug 22 06:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 2628.591554] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 2628.592568] direct_page_fault+0x206/0x310 [kvm] Aug 22 06:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 2628.593608] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 06:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 2628.594616] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 06:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 2628.595615] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 06:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 2628.596601] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 06:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 2628.597560] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 06:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 2628.598537] handle_exit+0x98/0x230 [kvm_amd] Aug 22 06:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 2628.599430] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 06:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 2628.600341] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 06:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 2628.601319] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 06:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 2628.602235] vcpu_run+0x62/0x2c0 [kvm] Aug 22 06:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 2628.603045] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 06:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 2628.603847] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 06:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 2628.604703] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 06:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 2628.605514] ? __seccomp_filter+0x4a/0x4a0 Aug 22 06:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 2628.606253] ? __fget_files+0x86/0xc0 Aug 22 06:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 2628.606954] __x64_sys_ioctl+0x95/0xd0 Aug 22 06:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 2628.607642] do_syscall_64+0x5c/0xc0 Aug 22 06:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 2628.608303] ? do_futex+0x162/0x1f0 Aug 22 06:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 2628.608948] ? __x64_sys_futex+0x78/0x1e0 Aug 22 06:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 2628.609630] ? __secure_computing+0xa9/0x120 Aug 22 06:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 2628.610316] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 06:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 2628.611073] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 2628.611798] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 2628.612513] ? do_syscall_64+0x69/0xc0 Aug 22 06:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 2628.613161] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 2628.613875] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 2628.614569] ? do_syscall_64+0x69/0xc0 Aug 22 06:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 2628.615198] ? do_syscall_64+0x69/0xc0 Aug 22 06:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 2628.615818] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 06:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 2628.616521] RIP: 0033:0x7faa5d0edaff Aug 22 06:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 2628.617162] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 06:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 2628.619152] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 06:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 2628.620061] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 06:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 2628.620953] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 06:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 2628.621858] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 06:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 2628.622746] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 06:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 2628.623638] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 06:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 2628.624528] Aug 22 06:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 2656.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 2366s! [qemu-system-x86:6715] Aug 22 06:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 2656.543284] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 06:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 2656.543352] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 06:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 2656.555807] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 06:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 2656.557187] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 06:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 2656.558470] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 2656.559567] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 06:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 2656.562237] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 06:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 2656.563319] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 06:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 2656.564497] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 06:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 2656.565698] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 06:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 2656.566927] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 06:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 2656.568174] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 06:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 2656.569411] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 06:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 2656.570678] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 06:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 2656.571807] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 06:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 2656.573046] Call Trace: Aug 22 06:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 2656.574000] Aug 22 06:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 2656.574897] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 2656.575961] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 2656.577012] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 2656.578197] ? show_regs.part.0+0x23/0x29 Aug 22 06:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 2656.579248] ? show_regs.cold+0x8/0xd Aug 22 06:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 2656.580244] ? watchdog_timer_fn+0x1be/0x220 Aug 22 06:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 2656.581291] ? lockup_detector_update_enable+0x60/0x60 Aug 22 06:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 2656.582399] ? __hrtimer_run_queues+0x107/0x230 Aug 22 06:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 2656.583460] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 06:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 2656.584503] ? hrtimer_interrupt+0x101/0x220 Aug 22 06:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 2656.585553] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 06:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 2656.586635] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 06:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 2656.587691] Aug 22 06:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 2656.588605] Aug 22 06:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 2656.589473] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 06:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 2656.590509] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 2656.591566] ? _raw_spin_lock+0x22/0x30 Aug 22 06:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 2656.592514] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 2656.593546] direct_page_fault+0x206/0x310 [kvm] Aug 22 06:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 2656.594583] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 06:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 2656.595594] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 06:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 2656.596596] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 06:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 2656.597586] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 06:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 2656.598555] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 06:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 2656.599575] handle_exit+0x98/0x230 [kvm_amd] Aug 22 06:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 2656.600474] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 06:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 2656.601407] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 06:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 2656.602331] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 06:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 2656.603237] vcpu_run+0x62/0x2c0 [kvm] Aug 22 06:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 2656.604045] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 06:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 2656.604875] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 06:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 2656.605755] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 06:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 2656.606550] ? __seccomp_filter+0x4a/0x4a0 Aug 22 06:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 2656.607298] ? __fget_files+0x86/0xc0 Aug 22 06:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 2656.608000] __x64_sys_ioctl+0x95/0xd0 Aug 22 06:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 2656.608690] do_syscall_64+0x5c/0xc0 Aug 22 06:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 2656.609393] ? do_futex+0x162/0x1f0 Aug 22 06:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 2656.610046] ? __x64_sys_futex+0x78/0x1e0 Aug 22 06:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 2656.610720] ? __secure_computing+0xa9/0x120 Aug 22 06:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 2656.611408] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 06:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 2656.612168] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 2656.612889] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 2656.613663] ? do_syscall_64+0x69/0xc0 Aug 22 06:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 2656.614310] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 2656.615011] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 2656.615703] ? do_syscall_64+0x69/0xc0 Aug 22 06:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 2656.616331] ? do_syscall_64+0x69/0xc0 Aug 22 06:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 2656.616964] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 06:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 2656.617692] RIP: 0033:0x7faa5d0edaff Aug 22 06:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 2656.618336] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 06:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 2656.620363] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 06:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 2656.621320] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 06:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 2656.622222] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 06:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 2656.623125] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 06:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 2656.624015] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 06:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 2656.624913] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 06:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 2656.625850] Aug 22 06:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 2684.541981] watchdog: BUG: soft lockup - CPU#1 stuck for 2392s! [qemu-system-x86:6715] Aug 22 06:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 2684.543137] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 06:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 2684.543213] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 06:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 2684.555643] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 06:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 2684.556953] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 06:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 2684.558206] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 2684.559285] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 06:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 2684.562112] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 06:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 2684.563175] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 06:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 2684.564351] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 06:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 2684.565558] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 06:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 2684.566724] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 06:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 2684.567881] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 06:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 2684.569148] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 06:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 2684.570454] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 06:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 2684.571600] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 06:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 2684.572848] Call Trace: Aug 22 06:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 2684.573794] Aug 22 06:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 2684.574682] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 2684.575712] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 2684.576746] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 2684.577910] ? show_regs.part.0+0x23/0x29 Aug 22 06:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 2684.578906] ? show_regs.cold+0x8/0xd Aug 22 06:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 2684.579880] ? watchdog_timer_fn+0x1be/0x220 Aug 22 06:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 2684.580957] ? lockup_detector_update_enable+0x60/0x60 Aug 22 06:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 2684.582039] ? __hrtimer_run_queues+0x107/0x230 Aug 22 06:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 2684.583067] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 06:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 2684.584090] ? hrtimer_interrupt+0x101/0x220 Aug 22 06:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 2684.585204] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 06:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 2684.586275] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 06:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 2684.587321] Aug 22 06:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 2684.588173] Aug 22 06:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 2684.589056] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 06:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 2684.590093] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 2684.591133] ? _raw_spin_lock+0x22/0x30 Aug 22 06:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 2684.592081] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 2684.593188] direct_page_fault+0x206/0x310 [kvm] Aug 22 06:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 2684.594228] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 06:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 2684.595237] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 06:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 2684.596288] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 06:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 2684.597327] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 06:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 2684.598285] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 06:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 2684.599291] handle_exit+0x98/0x230 [kvm_amd] Aug 22 06:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 2684.600188] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 06:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 2684.601197] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 06:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 2684.602129] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 06:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 2684.603037] vcpu_run+0x62/0x2c0 [kvm] Aug 22 06:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 2684.603848] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 06:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 2684.604660] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 06:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 2684.605569] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 06:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 2684.606366] ? __seccomp_filter+0x4a/0x4a0 Aug 22 06:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 2684.607108] ? __fget_files+0x86/0xc0 Aug 22 06:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 2684.607816] __x64_sys_ioctl+0x95/0xd0 Aug 22 06:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 2684.608514] do_syscall_64+0x5c/0xc0 Aug 22 06:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 2684.609262] ? do_futex+0x162/0x1f0 Aug 22 06:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 2684.609916] ? __x64_sys_futex+0x78/0x1e0 Aug 22 06:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 2684.610675] ? __secure_computing+0xa9/0x120 Aug 22 06:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 2684.611485] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 06:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 2684.612261] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 2684.613056] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 2684.613900] ? do_syscall_64+0x69/0xc0 Aug 22 06:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 2684.614554] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 2684.615334] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 2684.616051] ? do_syscall_64+0x69/0xc0 Aug 22 06:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 2684.616690] ? do_syscall_64+0x69/0xc0 Aug 22 06:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 2684.617411] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 06:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 2684.618123] RIP: 0033:0x7faa5d0edaff Aug 22 06:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 2684.618747] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 06:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 2684.620743] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 06:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 2684.621711] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 06:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 2684.622602] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 06:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 2684.623499] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 06:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 2684.624387] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 06:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 2684.625370] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 06:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 2684.626276] Aug 22 06:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 2697.368705] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 06:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 2697.369675] rcu: 1-....: (643022 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=313148 Aug 22 06:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 2697.370778] (t=645042 jiffies g=23269 q=11353) Aug 22 06:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 2697.371552] NMI backtrace for cpu 1 Aug 22 06:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 2697.372260] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 06:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 2697.373379] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 06:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 2697.374434] Call Trace: Aug 22 06:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 2697.375107] Aug 22 06:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 2697.375754] show_stack+0x52/0x5c Aug 22 06:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 2697.376481] dump_stack_lvl+0x4a/0x63 Aug 22 06:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 2697.377234] dump_stack+0x10/0x16 Aug 22 06:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 2697.377952] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 06:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 2697.378728] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 06:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 2697.379507] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 06:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 2697.380325] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 06:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 2697.381149] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 06:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 2697.381960] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 06:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 2697.382737] print_cpu_stall.cold+0x2f/0xe2 Aug 22 06:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 2697.383499] ? timekeeping_update+0xf7/0x150 Aug 22 06:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 2697.384267] check_cpu_stall+0x109/0x270 Aug 22 06:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 2697.385018] rcu_sched_clock_irq+0x9a/0x250 Aug 22 06:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 2697.385779] update_process_times+0x94/0xd0 Aug 22 06:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 2697.386537] tick_sched_handle+0x29/0x70 Aug 22 06:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 2697.387285] tick_sched_timer+0x8c/0xc0 Aug 22 06:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 2697.388023] ? tick_nohz_handler+0xb0/0xb0 Aug 22 06:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 2697.388792] __hrtimer_run_queues+0x107/0x230 Aug 22 06:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 2697.389564] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 06:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 2697.390341] hrtimer_interrupt+0x101/0x220 Aug 22 06:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 2697.391097] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 06:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 2697.391907] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 06:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 2697.392725] Aug 22 06:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 2697.393361] Aug 22 06:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 2697.393988] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 06:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 2697.394804] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 2697.395691] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 06:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 2697.397905] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 06:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 2697.398784] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 06:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 2697.399781] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 06:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 2697.400775] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 06:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 2697.401739] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 06:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 2697.402702] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 06:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 2697.403657] ? _raw_spin_lock+0x22/0x30 Aug 22 06:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 2697.404420] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 2697.405266] direct_page_fault+0x206/0x310 [kvm] Aug 22 06:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 2697.406104] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 06:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 2697.406930] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 06:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 2697.407752] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 06:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 2697.408553] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 06:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 2697.409348] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 06:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 2697.410174] handle_exit+0x98/0x230 [kvm_amd] Aug 22 06:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 2697.410929] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 06:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 2697.411711] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 06:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 2697.412509] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 06:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 2697.413315] vcpu_run+0x62/0x2c0 [kvm] Aug 22 06:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 2697.414038] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 06:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 2697.414777] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 06:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 2697.415579] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 06:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 2697.416346] ? __seccomp_filter+0x4a/0x4a0 Aug 22 06:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 2697.417077] ? __fget_files+0x86/0xc0 Aug 22 06:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 2697.417777] __x64_sys_ioctl+0x95/0xd0 Aug 22 06:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 2697.418472] do_syscall_64+0x5c/0xc0 Aug 22 06:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 2697.419154] ? do_futex+0x162/0x1f0 Aug 22 06:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 2697.419826] ? __x64_sys_futex+0x78/0x1e0 Aug 22 06:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 2697.420527] ? __secure_computing+0xa9/0x120 Aug 22 06:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 2697.421387] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 06:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 2697.422180] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 2697.422934] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 2697.423687] ? do_syscall_64+0x69/0xc0 Aug 22 06:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 2697.424383] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 2697.425249] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 2697.426014] ? do_syscall_64+0x69/0xc0 Aug 22 06:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 2697.426711] ? do_syscall_64+0x69/0xc0 Aug 22 06:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 2697.427398] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 06:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 2697.428167] RIP: 0033:0x7faa5d0edaff Aug 22 06:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 2697.428901] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 06:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 2697.431008] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 06:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 2697.431974] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 06:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 2697.433006] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 06:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 2697.433957] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 06:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 2697.435052] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 06:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 2697.435983] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 06:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 2697.436964] Aug 22 06:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 2724.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 2429s! [qemu-system-x86:6715] Aug 22 06:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 2724.543768] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 06:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 2724.544054] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 06:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 2724.556112] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 06:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 2724.557393] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 06:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 2724.558606] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 2724.559659] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 06:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 2724.562213] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 06:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 2724.563258] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 06:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 2724.564433] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 06:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 2724.565589] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 06:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 2724.566746] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 06:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 2724.567902] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 06:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 2724.569071] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 06:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 2724.570305] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 06:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 2724.571399] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 06:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 2724.572600] Call Trace: Aug 22 06:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 2724.573512] Aug 22 06:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 2724.574402] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 2724.575429] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 2724.576457] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 2724.577556] ? show_regs.part.0+0x23/0x29 Aug 22 06:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 2724.578550] ? show_regs.cold+0x8/0xd Aug 22 06:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 2724.579518] ? watchdog_timer_fn+0x1be/0x220 Aug 22 06:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 2724.580531] ? lockup_detector_update_enable+0x60/0x60 Aug 22 06:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 2724.581598] ? __hrtimer_run_queues+0x107/0x230 Aug 22 06:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 2724.582622] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 06:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 2724.583642] ? hrtimer_interrupt+0x101/0x220 Aug 22 06:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 2724.584669] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 06:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 2724.585735] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 06:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 2724.586777] Aug 22 06:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 2724.587627] Aug 22 06:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 2724.588467] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 06:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 2724.589498] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 2724.590533] ? _raw_spin_lock+0x22/0x30 Aug 22 06:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 2724.591478] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 2724.592506] direct_page_fault+0x206/0x310 [kvm] Aug 22 06:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 2724.593529] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 06:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 2724.594534] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 06:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 2724.595531] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 06:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 2724.596532] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 06:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 2724.597477] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 06:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 2724.598452] handle_exit+0x98/0x230 [kvm_amd] Aug 22 06:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 2724.599341] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 06:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 2724.600251] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 06:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 2724.601184] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 06:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 2724.602085] vcpu_run+0x62/0x2c0 [kvm] Aug 22 06:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 2724.602892] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 06:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 2724.603701] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 06:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 2724.604559] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 06:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 2724.605355] ? __seccomp_filter+0x4a/0x4a0 Aug 22 06:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 2724.606094] ? __fget_files+0x86/0xc0 Aug 22 06:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 2724.606797] __x64_sys_ioctl+0x95/0xd0 Aug 22 06:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 2724.607526] do_syscall_64+0x5c/0xc0 Aug 22 06:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 2724.608217] ? do_futex+0x162/0x1f0 Aug 22 06:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 2724.608893] ? __x64_sys_futex+0x78/0x1e0 Aug 22 06:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 2724.609565] ? __secure_computing+0xa9/0x120 Aug 22 06:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 2724.610258] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 06:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 2724.611016] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 2724.611736] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 2724.612479] ? do_syscall_64+0x69/0xc0 Aug 22 06:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 2724.613125] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 2724.613831] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 2724.614524] ? do_syscall_64+0x69/0xc0 Aug 22 06:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 2724.615146] ? do_syscall_64+0x69/0xc0 Aug 22 06:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 2724.615772] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 06:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 2724.616483] RIP: 0033:0x7faa5d0edaff Aug 22 06:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 2724.617149] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 06:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 2724.619148] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 06:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 2724.620063] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 06:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 2724.620970] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 06:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 2724.621859] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 06:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 2724.622754] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 06:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 2724.623647] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 06:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 2724.624553] Aug 22 06:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 2752.541981] watchdog: BUG: soft lockup - CPU#1 stuck for 2455s! [qemu-system-x86:6715] Aug 22 06:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 2752.543130] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 06:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 2752.543200] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 06:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 2752.555409] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 06:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 2752.556704] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 06:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 2752.557979] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 2752.559044] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 06:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 2752.561677] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 06:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 2752.562749] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 06:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 2752.563946] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 06:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 2752.565121] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 06:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 2752.566296] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 06:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 2752.567467] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 06:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 2752.568664] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 06:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 2752.569908] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 06:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 2752.571003] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 06:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 2752.572307] Call Trace: Aug 22 06:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 2752.573248] Aug 22 06:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 2752.574140] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 2752.575191] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 2752.576229] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 2752.577321] ? show_regs.part.0+0x23/0x29 Aug 22 06:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 2752.578338] ? show_regs.cold+0x8/0xd Aug 22 06:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 2752.579317] ? watchdog_timer_fn+0x1be/0x220 Aug 22 06:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 2752.580344] ? lockup_detector_update_enable+0x60/0x60 Aug 22 06:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 2752.581410] ? __hrtimer_run_queues+0x107/0x230 Aug 22 06:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 2752.582453] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 06:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 2752.583497] ? hrtimer_interrupt+0x101/0x220 Aug 22 06:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 2752.584535] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 06:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 2752.585608] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 06:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 2752.586659] Aug 22 06:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 2752.587535] Aug 22 06:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 2752.588411] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 06:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 2752.589460] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 2752.590541] ? _raw_spin_lock+0x22/0x30 Aug 22 06:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 2752.591494] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 2752.592542] direct_page_fault+0x206/0x310 [kvm] Aug 22 06:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 2752.593586] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 06:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 2752.594609] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 06:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 2752.595617] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 06:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 2752.596604] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 06:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 2752.597564] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 06:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 2752.598562] handle_exit+0x98/0x230 [kvm_amd] Aug 22 06:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 2752.599471] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 06:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 2752.600410] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 06:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 2752.601341] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 06:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 2752.602248] vcpu_run+0x62/0x2c0 [kvm] Aug 22 06:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 2752.603296] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 06:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 2752.604197] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 06:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 2752.605067] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 06:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 2752.605874] ? __seccomp_filter+0x4a/0x4a0 Aug 22 06:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 2752.606619] ? __fget_files+0x86/0xc0 Aug 22 06:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 2752.607331] __x64_sys_ioctl+0x95/0xd0 Aug 22 06:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 2752.608176] do_syscall_64+0x5c/0xc0 Aug 22 06:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 2752.608849] ? do_futex+0x162/0x1f0 Aug 22 06:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 2752.609512] ? __x64_sys_futex+0x78/0x1e0 Aug 22 06:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 2752.610191] ? __secure_computing+0xa9/0x120 Aug 22 06:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 2752.610889] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 06:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 2752.611653] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 2752.612392] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 2752.613115] ? do_syscall_64+0x69/0xc0 Aug 22 06:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 2752.613769] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 2752.614489] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 2752.615188] ? do_syscall_64+0x69/0xc0 Aug 22 06:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 2752.615814] ? do_syscall_64+0x69/0xc0 Aug 22 06:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 2752.616450] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 06:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 2752.617158] RIP: 0033:0x7faa5d0edaff Aug 22 06:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 2752.617784] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 06:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 2752.619794] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 06:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 2752.620721] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 06:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 2752.621611] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 06:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 2752.622502] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 06:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 2752.623388] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 06:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 2752.624300] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 06:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 2752.625212] Aug 22 06:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 2780.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 2481s! [qemu-system-x86:6715] Aug 22 06:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 2780.543103] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 06:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 2780.543173] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 06:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 2780.555210] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 06:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 2780.556491] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 06:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 2780.557713] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 2780.558769] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 06:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 2780.561325] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 06:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 2780.562369] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 06:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 2780.563531] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 06:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 2780.564701] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 06:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 2780.565859] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 06:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 2780.567023] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 06:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 2780.568213] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 06:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 2780.569449] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 06:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 2780.570542] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 06:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 2780.571748] Call Trace: Aug 22 06:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 2780.572664] Aug 22 06:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 2780.573548] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 2780.574597] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 2780.575624] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 2780.576714] ? show_regs.part.0+0x23/0x29 Aug 22 06:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 2780.577708] ? show_regs.cold+0x8/0xd Aug 22 06:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 2780.578677] ? watchdog_timer_fn+0x1be/0x220 Aug 22 06:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 2780.579693] ? lockup_detector_update_enable+0x60/0x60 Aug 22 06:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 2780.580754] ? __hrtimer_run_queues+0x107/0x230 Aug 22 06:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 2780.581785] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 06:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 2780.582806] ? hrtimer_interrupt+0x101/0x220 Aug 22 06:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 2780.583854] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 06:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 2780.584925] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 06:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 2780.585967] Aug 22 06:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 2780.586817] Aug 22 06:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 2780.587663] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 06:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 2780.588700] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 2780.589737] ? _raw_spin_lock+0x22/0x30 Aug 22 06:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 2780.590679] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 2780.591707] direct_page_fault+0x206/0x310 [kvm] Aug 22 06:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 2780.592734] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 06:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 2780.593741] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 06:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 2780.594745] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 06:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 2780.595725] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 06:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 2780.596675] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 06:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 2780.597658] handle_exit+0x98/0x230 [kvm_amd] Aug 22 06:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 2780.598549] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 06:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 2780.599462] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 06:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 2780.600401] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 06:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 2780.601302] vcpu_run+0x62/0x2c0 [kvm] Aug 22 06:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 2780.602110] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 06:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 2780.602917] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 06:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 2780.603780] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 06:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 2780.604583] ? __seccomp_filter+0x4a/0x4a0 Aug 22 06:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 2780.605328] ? __fget_files+0x86/0xc0 Aug 22 06:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 2780.606029] __x64_sys_ioctl+0x95/0xd0 Aug 22 06:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 2780.606721] do_syscall_64+0x5c/0xc0 Aug 22 06:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 2780.607385] ? do_futex+0x162/0x1f0 Aug 22 06:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 2780.608047] ? __x64_sys_futex+0x78/0x1e0 Aug 22 06:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 2780.608722] ? __secure_computing+0xa9/0x120 Aug 22 06:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 2780.609410] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 06:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 2780.610173] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 2780.610893] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 2780.611609] ? do_syscall_64+0x69/0xc0 Aug 22 06:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 2780.612264] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 2780.612966] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 2780.613665] ? do_syscall_64+0x69/0xc0 Aug 22 06:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 2780.614290] ? do_syscall_64+0x69/0xc0 Aug 22 06:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 2780.614911] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 06:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 2780.615614] RIP: 0033:0x7faa5d0edaff Aug 22 06:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 2780.616252] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 06:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 2780.618230] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 06:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 2780.619143] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 06:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 2780.620045] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 06:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 2780.620935] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 06:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 2780.621822] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 06:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 2780.622710] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 06:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 2780.623608] Aug 22 06:10:34 juju-e4d256-prod-github-runner-207 kernel: [ 2808.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 2507s! [qemu-system-x86:6715] Aug 22 06:10:34 juju-e4d256-prod-github-runner-207 kernel: [ 2808.543719] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 06:10:34 juju-e4d256-prod-github-runner-207 kernel: [ 2808.543961] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 06:10:34 juju-e4d256-prod-github-runner-207 kernel: [ 2808.556039] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 06:10:34 juju-e4d256-prod-github-runner-207 kernel: [ 2808.557319] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 06:10:34 juju-e4d256-prod-github-runner-207 kernel: [ 2808.558542] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:10:34 juju-e4d256-prod-github-runner-207 kernel: [ 2808.559625] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 06:10:34 juju-e4d256-prod-github-runner-207 kernel: [ 2808.562184] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 06:10:34 juju-e4d256-prod-github-runner-207 kernel: [ 2808.563226] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 06:10:34 juju-e4d256-prod-github-runner-207 kernel: [ 2808.564404] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 06:10:34 juju-e4d256-prod-github-runner-207 kernel: [ 2808.565560] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 06:10:34 juju-e4d256-prod-github-runner-207 kernel: [ 2808.566741] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 06:10:34 juju-e4d256-prod-github-runner-207 kernel: [ 2808.567923] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 06:10:34 juju-e4d256-prod-github-runner-207 kernel: [ 2808.569103] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 06:10:34 juju-e4d256-prod-github-runner-207 kernel: [ 2808.570340] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 06:10:34 juju-e4d256-prod-github-runner-207 kernel: [ 2808.571452] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 06:10:34 juju-e4d256-prod-github-runner-207 kernel: [ 2808.572659] Call Trace: Aug 22 06:10:34 juju-e4d256-prod-github-runner-207 kernel: [ 2808.573580] Aug 22 06:10:34 juju-e4d256-prod-github-runner-207 kernel: [ 2808.574483] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:10:34 juju-e4d256-prod-github-runner-207 kernel: [ 2808.575533] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:10:34 juju-e4d256-prod-github-runner-207 kernel: [ 2808.576559] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:10:34 juju-e4d256-prod-github-runner-207 kernel: [ 2808.577674] ? show_regs.part.0+0x23/0x29 Aug 22 06:10:34 juju-e4d256-prod-github-runner-207 kernel: [ 2808.578680] ? show_regs.cold+0x8/0xd Aug 22 06:10:34 juju-e4d256-prod-github-runner-207 kernel: [ 2808.579670] ? watchdog_timer_fn+0x1be/0x220 Aug 22 06:10:34 juju-e4d256-prod-github-runner-207 kernel: [ 2808.580694] ? lockup_detector_update_enable+0x60/0x60 Aug 22 06:10:34 juju-e4d256-prod-github-runner-207 kernel: [ 2808.581769] ? __hrtimer_run_queues+0x107/0x230 Aug 22 06:10:34 juju-e4d256-prod-github-runner-207 kernel: [ 2808.582799] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 06:10:34 juju-e4d256-prod-github-runner-207 kernel: [ 2808.583847] ? hrtimer_interrupt+0x101/0x220 Aug 22 06:10:34 juju-e4d256-prod-github-runner-207 kernel: [ 2808.584876] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 06:10:34 juju-e4d256-prod-github-runner-207 kernel: [ 2808.585950] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 06:10:34 juju-e4d256-prod-github-runner-207 kernel: [ 2808.586999] Aug 22 06:10:34 juju-e4d256-prod-github-runner-207 kernel: [ 2808.588010] Aug 22 06:10:34 juju-e4d256-prod-github-runner-207 kernel: [ 2808.588858] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 06:10:34 juju-e4d256-prod-github-runner-207 kernel: [ 2808.589895] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:10:34 juju-e4d256-prod-github-runner-207 kernel: [ 2808.591116] ? _raw_spin_lock+0x22/0x30 Aug 22 06:10:34 juju-e4d256-prod-github-runner-207 kernel: [ 2808.592078] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:10:34 juju-e4d256-prod-github-runner-207 kernel: [ 2808.593107] direct_page_fault+0x206/0x310 [kvm] Aug 22 06:10:34 juju-e4d256-prod-github-runner-207 kernel: [ 2808.594133] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 06:10:34 juju-e4d256-prod-github-runner-207 kernel: [ 2808.595139] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 06:10:34 juju-e4d256-prod-github-runner-207 kernel: [ 2808.596161] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 06:10:34 juju-e4d256-prod-github-runner-207 kernel: [ 2808.597167] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 06:10:34 juju-e4d256-prod-github-runner-207 kernel: [ 2808.598114] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 06:10:34 juju-e4d256-prod-github-runner-207 kernel: [ 2808.599089] handle_exit+0x98/0x230 [kvm_amd] Aug 22 06:10:34 juju-e4d256-prod-github-runner-207 kernel: [ 2808.599996] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 06:10:34 juju-e4d256-prod-github-runner-207 kernel: [ 2808.600922] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 06:10:34 juju-e4d256-prod-github-runner-207 kernel: [ 2808.601846] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 06:10:34 juju-e4d256-prod-github-runner-207 kernel: [ 2808.602748] vcpu_run+0x62/0x2c0 [kvm] Aug 22 06:10:34 juju-e4d256-prod-github-runner-207 kernel: [ 2808.603567] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 06:10:34 juju-e4d256-prod-github-runner-207 kernel: [ 2808.604377] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 06:10:34 juju-e4d256-prod-github-runner-207 kernel: [ 2808.605232] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 06:10:34 juju-e4d256-prod-github-runner-207 kernel: [ 2808.606032] ? __seccomp_filter+0x4a/0x4a0 Aug 22 06:10:34 juju-e4d256-prod-github-runner-207 kernel: [ 2808.606775] ? __fget_files+0x86/0xc0 Aug 22 06:10:34 juju-e4d256-prod-github-runner-207 kernel: [ 2808.607496] __x64_sys_ioctl+0x95/0xd0 Aug 22 06:10:34 juju-e4d256-prod-github-runner-207 kernel: [ 2808.608187] do_syscall_64+0x5c/0xc0 Aug 22 06:10:34 juju-e4d256-prod-github-runner-207 kernel: [ 2808.608850] ? do_futex+0x162/0x1f0 Aug 22 06:10:34 juju-e4d256-prod-github-runner-207 kernel: [ 2808.609502] ? __x64_sys_futex+0x78/0x1e0 Aug 22 06:10:34 juju-e4d256-prod-github-runner-207 kernel: [ 2808.610174] ? __secure_computing+0xa9/0x120 Aug 22 06:10:34 juju-e4d256-prod-github-runner-207 kernel: [ 2808.610863] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 06:10:34 juju-e4d256-prod-github-runner-207 kernel: [ 2808.611633] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:10:34 juju-e4d256-prod-github-runner-207 kernel: [ 2808.612358] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:10:34 juju-e4d256-prod-github-runner-207 kernel: [ 2808.613074] ? do_syscall_64+0x69/0xc0 Aug 22 06:10:34 juju-e4d256-prod-github-runner-207 kernel: [ 2808.613720] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:10:34 juju-e4d256-prod-github-runner-207 kernel: [ 2808.614422] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:10:34 juju-e4d256-prod-github-runner-207 kernel: [ 2808.615115] ? do_syscall_64+0x69/0xc0 Aug 22 06:10:34 juju-e4d256-prod-github-runner-207 kernel: [ 2808.615756] ? do_syscall_64+0x69/0xc0 Aug 22 06:10:34 juju-e4d256-prod-github-runner-207 kernel: [ 2808.616381] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 06:10:34 juju-e4d256-prod-github-runner-207 kernel: [ 2808.617086] RIP: 0033:0x7faa5d0edaff Aug 22 06:10:34 juju-e4d256-prod-github-runner-207 kernel: [ 2808.617737] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 06:10:34 juju-e4d256-prod-github-runner-207 kernel: [ 2808.619731] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 06:10:34 juju-e4d256-prod-github-runner-207 kernel: [ 2808.620644] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 06:10:34 juju-e4d256-prod-github-runner-207 kernel: [ 2808.621535] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 06:10:34 juju-e4d256-prod-github-runner-207 kernel: [ 2808.622428] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 06:10:34 juju-e4d256-prod-github-runner-207 kernel: [ 2808.623321] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 06:10:34 juju-e4d256-prod-github-runner-207 kernel: [ 2808.624205] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 06:10:34 juju-e4d256-prod-github-runner-207 kernel: [ 2808.625094] Aug 22 06:11:02 juju-e4d256-prod-github-runner-207 kernel: [ 2836.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 2533s! [qemu-system-x86:6715] Aug 22 06:11:02 juju-e4d256-prod-github-runner-207 kernel: [ 2836.543117] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 06:11:02 juju-e4d256-prod-github-runner-207 kernel: [ 2836.543184] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 06:11:02 juju-e4d256-prod-github-runner-207 kernel: [ 2836.555401] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 06:11:02 juju-e4d256-prod-github-runner-207 kernel: [ 2836.556662] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 06:11:02 juju-e4d256-prod-github-runner-207 kernel: [ 2836.557882] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:11:02 juju-e4d256-prod-github-runner-207 kernel: [ 2836.558938] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 06:11:02 juju-e4d256-prod-github-runner-207 kernel: [ 2836.561491] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 06:11:02 juju-e4d256-prod-github-runner-207 kernel: [ 2836.562532] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 06:11:02 juju-e4d256-prod-github-runner-207 kernel: [ 2836.563704] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 06:11:02 juju-e4d256-prod-github-runner-207 kernel: [ 2836.564861] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 06:11:02 juju-e4d256-prod-github-runner-207 kernel: [ 2836.566025] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 06:11:02 juju-e4d256-prod-github-runner-207 kernel: [ 2836.567204] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 06:11:02 juju-e4d256-prod-github-runner-207 kernel: [ 2836.568376] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 06:11:02 juju-e4d256-prod-github-runner-207 kernel: [ 2836.569611] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 06:11:02 juju-e4d256-prod-github-runner-207 kernel: [ 2836.570711] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 06:11:02 juju-e4d256-prod-github-runner-207 kernel: [ 2836.571935] Call Trace: Aug 22 06:11:02 juju-e4d256-prod-github-runner-207 kernel: [ 2836.572848] Aug 22 06:11:02 juju-e4d256-prod-github-runner-207 kernel: [ 2836.573736] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:11:02 juju-e4d256-prod-github-runner-207 kernel: [ 2836.574765] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:11:02 juju-e4d256-prod-github-runner-207 kernel: [ 2836.575801] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:11:02 juju-e4d256-prod-github-runner-207 kernel: [ 2836.576883] ? show_regs.part.0+0x23/0x29 Aug 22 06:11:02 juju-e4d256-prod-github-runner-207 kernel: [ 2836.577881] ? show_regs.cold+0x8/0xd Aug 22 06:11:02 juju-e4d256-prod-github-runner-207 kernel: [ 2836.578850] ? watchdog_timer_fn+0x1be/0x220 Aug 22 06:11:02 juju-e4d256-prod-github-runner-207 kernel: [ 2836.579871] ? lockup_detector_update_enable+0x60/0x60 Aug 22 06:11:02 juju-e4d256-prod-github-runner-207 kernel: [ 2836.580952] ? __hrtimer_run_queues+0x107/0x230 Aug 22 06:11:02 juju-e4d256-prod-github-runner-207 kernel: [ 2836.581981] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 06:11:02 juju-e4d256-prod-github-runner-207 kernel: [ 2836.583022] ? hrtimer_interrupt+0x101/0x220 Aug 22 06:11:02 juju-e4d256-prod-github-runner-207 kernel: [ 2836.584041] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 06:11:02 juju-e4d256-prod-github-runner-207 kernel: [ 2836.585107] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 06:11:02 juju-e4d256-prod-github-runner-207 kernel: [ 2836.586155] Aug 22 06:11:02 juju-e4d256-prod-github-runner-207 kernel: [ 2836.587034] Aug 22 06:11:02 juju-e4d256-prod-github-runner-207 kernel: [ 2836.587873] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 06:11:02 juju-e4d256-prod-github-runner-207 kernel: [ 2836.588903] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:11:02 juju-e4d256-prod-github-runner-207 kernel: [ 2836.589946] ? _raw_spin_lock+0x22/0x30 Aug 22 06:11:02 juju-e4d256-prod-github-runner-207 kernel: [ 2836.590890] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:11:02 juju-e4d256-prod-github-runner-207 kernel: [ 2836.591923] direct_page_fault+0x206/0x310 [kvm] Aug 22 06:11:02 juju-e4d256-prod-github-runner-207 kernel: [ 2836.592948] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 06:11:02 juju-e4d256-prod-github-runner-207 kernel: [ 2836.593952] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 06:11:02 juju-e4d256-prod-github-runner-207 kernel: [ 2836.594965] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 06:11:02 juju-e4d256-prod-github-runner-207 kernel: [ 2836.595936] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 06:11:02 juju-e4d256-prod-github-runner-207 kernel: [ 2836.596880] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 06:11:02 juju-e4d256-prod-github-runner-207 kernel: [ 2836.597856] handle_exit+0x98/0x230 [kvm_amd] Aug 22 06:11:02 juju-e4d256-prod-github-runner-207 kernel: [ 2836.598751] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 06:11:02 juju-e4d256-prod-github-runner-207 kernel: [ 2836.599674] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 06:11:02 juju-e4d256-prod-github-runner-207 kernel: [ 2836.600596] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 06:11:02 juju-e4d256-prod-github-runner-207 kernel: [ 2836.601498] vcpu_run+0x62/0x2c0 [kvm] Aug 22 06:11:02 juju-e4d256-prod-github-runner-207 kernel: [ 2836.602313] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 06:11:02 juju-e4d256-prod-github-runner-207 kernel: [ 2836.603139] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 06:11:02 juju-e4d256-prod-github-runner-207 kernel: [ 2836.603992] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 06:11:02 juju-e4d256-prod-github-runner-207 kernel: [ 2836.604787] ? __seccomp_filter+0x4a/0x4a0 Aug 22 06:11:02 juju-e4d256-prod-github-runner-207 kernel: [ 2836.605528] ? __fget_files+0x86/0xc0 Aug 22 06:11:02 juju-e4d256-prod-github-runner-207 kernel: [ 2836.606236] __x64_sys_ioctl+0x95/0xd0 Aug 22 06:11:02 juju-e4d256-prod-github-runner-207 kernel: [ 2836.606929] do_syscall_64+0x5c/0xc0 Aug 22 06:11:02 juju-e4d256-prod-github-runner-207 kernel: [ 2836.607608] ? do_futex+0x162/0x1f0 Aug 22 06:11:02 juju-e4d256-prod-github-runner-207 kernel: [ 2836.608255] ? __x64_sys_futex+0x78/0x1e0 Aug 22 06:11:02 juju-e4d256-prod-github-runner-207 kernel: [ 2836.608927] ? __secure_computing+0xa9/0x120 Aug 22 06:11:02 juju-e4d256-prod-github-runner-207 kernel: [ 2836.609615] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 06:11:02 juju-e4d256-prod-github-runner-207 kernel: [ 2836.610377] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:11:02 juju-e4d256-prod-github-runner-207 kernel: [ 2836.611109] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:11:02 juju-e4d256-prod-github-runner-207 kernel: [ 2836.611832] ? do_syscall_64+0x69/0xc0 Aug 22 06:11:02 juju-e4d256-prod-github-runner-207 kernel: [ 2836.612477] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:11:02 juju-e4d256-prod-github-runner-207 kernel: [ 2836.613181] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:11:02 juju-e4d256-prod-github-runner-207 kernel: [ 2836.613880] ? do_syscall_64+0x69/0xc0 Aug 22 06:11:02 juju-e4d256-prod-github-runner-207 kernel: [ 2836.614513] ? do_syscall_64+0x69/0xc0 Aug 22 06:11:02 juju-e4d256-prod-github-runner-207 kernel: [ 2836.615147] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 06:11:02 juju-e4d256-prod-github-runner-207 kernel: [ 2836.615856] RIP: 0033:0x7faa5d0edaff Aug 22 06:11:02 juju-e4d256-prod-github-runner-207 kernel: [ 2836.616515] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 06:11:02 juju-e4d256-prod-github-runner-207 kernel: [ 2836.618513] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 06:11:02 juju-e4d256-prod-github-runner-207 kernel: [ 2836.619433] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 06:11:02 juju-e4d256-prod-github-runner-207 kernel: [ 2836.620322] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 06:11:02 juju-e4d256-prod-github-runner-207 kernel: [ 2836.621218] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 06:11:02 juju-e4d256-prod-github-runner-207 kernel: [ 2836.622114] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 06:11:02 juju-e4d256-prod-github-runner-207 kernel: [ 2836.623021] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 06:11:02 juju-e4d256-prod-github-runner-207 kernel: [ 2836.623923] Aug 22 06:11:30 juju-e4d256-prod-github-runner-207 kernel: [ 2864.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 2559s! [qemu-system-x86:6715] Aug 22 06:11:30 juju-e4d256-prod-github-runner-207 kernel: [ 2864.543122] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 06:11:30 juju-e4d256-prod-github-runner-207 kernel: [ 2864.543191] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 06:11:30 juju-e4d256-prod-github-runner-207 kernel: [ 2864.555269] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 06:11:30 juju-e4d256-prod-github-runner-207 kernel: [ 2864.556534] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 06:11:30 juju-e4d256-prod-github-runner-207 kernel: [ 2864.557755] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:11:30 juju-e4d256-prod-github-runner-207 kernel: [ 2864.558829] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 06:11:30 juju-e4d256-prod-github-runner-207 kernel: [ 2864.561380] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 06:11:30 juju-e4d256-prod-github-runner-207 kernel: [ 2864.562427] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 06:11:30 juju-e4d256-prod-github-runner-207 kernel: [ 2864.563605] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 06:11:30 juju-e4d256-prod-github-runner-207 kernel: [ 2864.564771] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 06:11:30 juju-e4d256-prod-github-runner-207 kernel: [ 2864.565954] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 06:11:30 juju-e4d256-prod-github-runner-207 kernel: [ 2864.567170] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 06:11:30 juju-e4d256-prod-github-runner-207 kernel: [ 2864.568339] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 06:11:30 juju-e4d256-prod-github-runner-207 kernel: [ 2864.569578] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 06:11:30 juju-e4d256-prod-github-runner-207 kernel: [ 2864.570696] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 06:11:30 juju-e4d256-prod-github-runner-207 kernel: [ 2864.571899] Call Trace: Aug 22 06:11:30 juju-e4d256-prod-github-runner-207 kernel: [ 2864.572891] Aug 22 06:11:30 juju-e4d256-prod-github-runner-207 kernel: [ 2864.573909] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:11:30 juju-e4d256-prod-github-runner-207 kernel: [ 2864.574960] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:11:30 juju-e4d256-prod-github-runner-207 kernel: [ 2864.575981] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:11:30 juju-e4d256-prod-github-runner-207 kernel: [ 2864.577054] ? show_regs.part.0+0x23/0x29 Aug 22 06:11:30 juju-e4d256-prod-github-runner-207 kernel: [ 2864.578049] ? show_regs.cold+0x8/0xd Aug 22 06:11:30 juju-e4d256-prod-github-runner-207 kernel: [ 2864.579042] ? watchdog_timer_fn+0x1be/0x220 Aug 22 06:11:30 juju-e4d256-prod-github-runner-207 kernel: [ 2864.580053] ? lockup_detector_update_enable+0x60/0x60 Aug 22 06:11:30 juju-e4d256-prod-github-runner-207 kernel: [ 2864.581114] ? __hrtimer_run_queues+0x107/0x230 Aug 22 06:11:30 juju-e4d256-prod-github-runner-207 kernel: [ 2864.582142] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 06:11:30 juju-e4d256-prod-github-runner-207 kernel: [ 2864.583190] ? hrtimer_interrupt+0x101/0x220 Aug 22 06:11:30 juju-e4d256-prod-github-runner-207 kernel: [ 2864.584212] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 06:11:30 juju-e4d256-prod-github-runner-207 kernel: [ 2864.585282] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 06:11:30 juju-e4d256-prod-github-runner-207 kernel: [ 2864.586326] Aug 22 06:11:30 juju-e4d256-prod-github-runner-207 kernel: [ 2864.587194] Aug 22 06:11:30 juju-e4d256-prod-github-runner-207 kernel: [ 2864.588030] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 06:11:30 juju-e4d256-prod-github-runner-207 kernel: [ 2864.589067] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:11:30 juju-e4d256-prod-github-runner-207 kernel: [ 2864.590105] ? _raw_spin_lock+0x22/0x30 Aug 22 06:11:30 juju-e4d256-prod-github-runner-207 kernel: [ 2864.591062] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:11:30 juju-e4d256-prod-github-runner-207 kernel: [ 2864.592076] direct_page_fault+0x206/0x310 [kvm] Aug 22 06:11:30 juju-e4d256-prod-github-runner-207 kernel: [ 2864.593103] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 06:11:30 juju-e4d256-prod-github-runner-207 kernel: [ 2864.594111] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 06:11:30 juju-e4d256-prod-github-runner-207 kernel: [ 2864.595126] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 06:11:30 juju-e4d256-prod-github-runner-207 kernel: [ 2864.596098] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 06:11:30 juju-e4d256-prod-github-runner-207 kernel: [ 2864.597049] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 06:11:30 juju-e4d256-prod-github-runner-207 kernel: [ 2864.598031] handle_exit+0x98/0x230 [kvm_amd] Aug 22 06:11:30 juju-e4d256-prod-github-runner-207 kernel: [ 2864.598944] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 06:11:30 juju-e4d256-prod-github-runner-207 kernel: [ 2864.599862] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 06:11:30 juju-e4d256-prod-github-runner-207 kernel: [ 2864.600790] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 06:11:30 juju-e4d256-prod-github-runner-207 kernel: [ 2864.601693] vcpu_run+0x62/0x2c0 [kvm] Aug 22 06:11:30 juju-e4d256-prod-github-runner-207 kernel: [ 2864.602503] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 06:11:30 juju-e4d256-prod-github-runner-207 kernel: [ 2864.603323] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 06:11:30 juju-e4d256-prod-github-runner-207 kernel: [ 2864.604175] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 06:11:30 juju-e4d256-prod-github-runner-207 kernel: [ 2864.604972] ? __seccomp_filter+0x4a/0x4a0 Aug 22 06:11:30 juju-e4d256-prod-github-runner-207 kernel: [ 2864.605714] ? __fget_files+0x86/0xc0 Aug 22 06:11:30 juju-e4d256-prod-github-runner-207 kernel: [ 2864.606422] __x64_sys_ioctl+0x95/0xd0 Aug 22 06:11:30 juju-e4d256-prod-github-runner-207 kernel: [ 2864.607125] do_syscall_64+0x5c/0xc0 Aug 22 06:11:30 juju-e4d256-prod-github-runner-207 kernel: [ 2864.607789] ? do_futex+0x162/0x1f0 Aug 22 06:11:30 juju-e4d256-prod-github-runner-207 kernel: [ 2864.608440] ? __x64_sys_futex+0x78/0x1e0 Aug 22 06:11:30 juju-e4d256-prod-github-runner-207 kernel: [ 2864.609112] ? __secure_computing+0xa9/0x120 Aug 22 06:11:30 juju-e4d256-prod-github-runner-207 kernel: [ 2864.609801] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 06:11:30 juju-e4d256-prod-github-runner-207 kernel: [ 2864.610560] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:11:30 juju-e4d256-prod-github-runner-207 kernel: [ 2864.611298] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:11:30 juju-e4d256-prod-github-runner-207 kernel: [ 2864.612015] ? do_syscall_64+0x69/0xc0 Aug 22 06:11:30 juju-e4d256-prod-github-runner-207 kernel: [ 2864.612659] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:11:30 juju-e4d256-prod-github-runner-207 kernel: [ 2864.613361] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:11:30 juju-e4d256-prod-github-runner-207 kernel: [ 2864.614060] ? do_syscall_64+0x69/0xc0 Aug 22 06:11:30 juju-e4d256-prod-github-runner-207 kernel: [ 2864.614702] ? do_syscall_64+0x69/0xc0 Aug 22 06:11:30 juju-e4d256-prod-github-runner-207 kernel: [ 2864.615324] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 06:11:30 juju-e4d256-prod-github-runner-207 kernel: [ 2864.616031] RIP: 0033:0x7faa5d0edaff Aug 22 06:11:30 juju-e4d256-prod-github-runner-207 kernel: [ 2864.616654] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 06:11:30 juju-e4d256-prod-github-runner-207 kernel: [ 2864.618655] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 06:11:30 juju-e4d256-prod-github-runner-207 kernel: [ 2864.619568] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 06:11:30 juju-e4d256-prod-github-runner-207 kernel: [ 2864.620456] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 06:11:30 juju-e4d256-prod-github-runner-207 kernel: [ 2864.621351] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 06:11:30 juju-e4d256-prod-github-runner-207 kernel: [ 2864.622237] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 06:11:30 juju-e4d256-prod-github-runner-207 kernel: [ 2864.623136] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 06:11:30 juju-e4d256-prod-github-runner-207 kernel: [ 2864.624032] Aug 22 06:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 2877.380708] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 06:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 2877.382549] rcu: 1-....: (687892 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=335163 Aug 22 06:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 2877.385596] (t=690045 jiffies g=23269 q=11494) Aug 22 06:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 2877.388711] NMI backtrace for cpu 1 Aug 22 06:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 2877.389551] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 06:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 2877.392784] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 06:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 2877.396046] Call Trace: Aug 22 06:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 2877.396724] Aug 22 06:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 2877.397372] show_stack+0x52/0x5c Aug 22 06:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 2877.400228] dump_stack_lvl+0x4a/0x63 Aug 22 06:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 2877.400978] dump_stack+0x10/0x16 Aug 22 06:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 2877.403878] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 06:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 2877.404662] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 06:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 2877.407674] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 06:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 2877.408500] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 06:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 2877.411455] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 06:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 2877.412273] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 06:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 2877.415239] print_cpu_stall.cold+0x2f/0xe2 Aug 22 06:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 2877.416008] ? timekeeping_update+0xf7/0x150 Aug 22 06:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 2877.418426] check_cpu_stall+0x109/0x270 Aug 22 06:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 2877.419713] rcu_sched_clock_irq+0x9a/0x250 Aug 22 06:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 2877.421582] update_process_times+0x94/0xd0 Aug 22 06:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 2877.423442] tick_sched_handle+0x29/0x70 Aug 22 06:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 2877.424188] tick_sched_timer+0x8c/0xc0 Aug 22 06:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 2877.427171] ? tick_nohz_handler+0xb0/0xb0 Aug 22 06:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 2877.427930] __hrtimer_run_queues+0x107/0x230 Aug 22 06:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 2877.430885] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 06:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 2877.431668] hrtimer_interrupt+0x101/0x220 Aug 22 06:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 2877.432911] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 06:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 2877.435372] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 06:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 2877.436175] Aug 22 06:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 2877.436810] Aug 22 06:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 2877.439081] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 06:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 2877.440472] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 2877.441352] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 06:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 2877.445751] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 06:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 2877.446641] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 06:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 2877.447633] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 06:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 2877.448614] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 06:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 2877.449576] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 06:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 2877.450554] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 06:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 2877.451513] ? _raw_spin_lock+0x22/0x30 Aug 22 06:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 2877.452272] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 2877.453109] direct_page_fault+0x206/0x310 [kvm] Aug 22 06:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 2877.453947] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 06:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 2877.454789] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 06:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 2877.455614] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 06:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 2877.456418] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 06:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 2877.457203] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 06:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 2877.458027] handle_exit+0x98/0x230 [kvm_amd] Aug 22 06:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 2877.458789] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 06:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 2877.459573] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 06:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 2877.460372] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 06:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 2877.461162] vcpu_run+0x62/0x2c0 [kvm] Aug 22 06:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 2877.461879] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 06:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 2877.462632] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 06:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 2877.463434] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 06:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 2877.464196] ? __seccomp_filter+0x4a/0x4a0 Aug 22 06:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 2877.464915] ? __fget_files+0x86/0xc0 Aug 22 06:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 2877.465615] __x64_sys_ioctl+0x95/0xd0 Aug 22 06:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 2877.466311] do_syscall_64+0x5c/0xc0 Aug 22 06:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 2877.467004] ? do_futex+0x162/0x1f0 Aug 22 06:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 2877.467681] ? __x64_sys_futex+0x78/0x1e0 Aug 22 06:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 2877.468382] ? __secure_computing+0xa9/0x120 Aug 22 06:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 2877.469097] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 06:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 2877.469884] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 2877.470652] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 2877.471404] ? do_syscall_64+0x69/0xc0 Aug 22 06:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 2877.472095] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 2877.472849] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 2877.473610] ? do_syscall_64+0x69/0xc0 Aug 22 06:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 2877.474302] ? do_syscall_64+0x69/0xc0 Aug 22 06:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 2877.475002] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 06:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 2877.475768] RIP: 0033:0x7faa5d0edaff Aug 22 06:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 2877.476448] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 06:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 2877.478554] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 06:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 2877.479514] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 06:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 2877.480461] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 06:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 2877.481403] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 06:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 2877.482348] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 06:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 2877.483280] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 06:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 2877.484193] Aug 22 06:12:10 juju-e4d256-prod-github-runner-207 kernel: [ 2904.541984] watchdog: BUG: soft lockup - CPU#1 stuck for 2597s! [qemu-system-x86:6715] Aug 22 06:12:10 juju-e4d256-prod-github-runner-207 kernel: [ 2904.544408] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 06:12:10 juju-e4d256-prod-github-runner-207 kernel: [ 2904.544730] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 06:12:10 juju-e4d256-prod-github-runner-207 kernel: [ 2904.561985] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 06:12:10 juju-e4d256-prod-github-runner-207 kernel: [ 2904.563955] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 06:12:10 juju-e4d256-prod-github-runner-207 kernel: [ 2904.565858] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:12:10 juju-e4d256-prod-github-runner-207 kernel: [ 2904.567544] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 06:12:10 juju-e4d256-prod-github-runner-207 kernel: [ 2904.571429] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 06:12:10 juju-e4d256-prod-github-runner-207 kernel: [ 2904.572976] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 06:12:10 juju-e4d256-prod-github-runner-207 kernel: [ 2904.574662] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 06:12:10 juju-e4d256-prod-github-runner-207 kernel: [ 2904.576217] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 06:12:10 juju-e4d256-prod-github-runner-207 kernel: [ 2904.577796] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 06:12:10 juju-e4d256-prod-github-runner-207 kernel: [ 2904.579300] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 06:12:10 juju-e4d256-prod-github-runner-207 kernel: [ 2904.580788] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 06:12:10 juju-e4d256-prod-github-runner-207 kernel: [ 2904.582399] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 06:12:10 juju-e4d256-prod-github-runner-207 kernel: [ 2904.583831] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 06:12:10 juju-e4d256-prod-github-runner-207 kernel: [ 2904.585410] Call Trace: Aug 22 06:12:10 juju-e4d256-prod-github-runner-207 kernel: [ 2904.586624] Aug 22 06:12:10 juju-e4d256-prod-github-runner-207 kernel: [ 2904.587774] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:12:10 juju-e4d256-prod-github-runner-207 kernel: [ 2904.589093] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:12:10 juju-e4d256-prod-github-runner-207 kernel: [ 2904.590449] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:12:10 juju-e4d256-prod-github-runner-207 kernel: [ 2904.591930] ? show_regs.part.0+0x23/0x29 Aug 22 06:12:10 juju-e4d256-prod-github-runner-207 kernel: [ 2904.593307] ? show_regs.cold+0x8/0xd Aug 22 06:12:10 juju-e4d256-prod-github-runner-207 kernel: [ 2904.594750] ? watchdog_timer_fn+0x1be/0x220 Aug 22 06:12:10 juju-e4d256-prod-github-runner-207 kernel: [ 2904.596199] ? lockup_detector_update_enable+0x60/0x60 Aug 22 06:12:10 juju-e4d256-prod-github-runner-207 kernel: [ 2904.597924] ? __hrtimer_run_queues+0x107/0x230 Aug 22 06:12:10 juju-e4d256-prod-github-runner-207 kernel: [ 2904.599383] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 06:12:10 juju-e4d256-prod-github-runner-207 kernel: [ 2904.600748] ? hrtimer_interrupt+0x101/0x220 Aug 22 06:12:10 juju-e4d256-prod-github-runner-207 kernel: [ 2904.602173] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 06:12:10 juju-e4d256-prod-github-runner-207 kernel: [ 2904.603711] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 06:12:10 juju-e4d256-prod-github-runner-207 kernel: [ 2904.605310] Aug 22 06:12:10 juju-e4d256-prod-github-runner-207 kernel: [ 2904.606404] Aug 22 06:12:10 juju-e4d256-prod-github-runner-207 kernel: [ 2904.607277] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 06:12:10 juju-e4d256-prod-github-runner-207 kernel: [ 2904.608327] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:12:10 juju-e4d256-prod-github-runner-207 kernel: [ 2904.609395] ? _raw_spin_lock+0x22/0x30 Aug 22 06:12:10 juju-e4d256-prod-github-runner-207 kernel: [ 2904.610384] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:12:10 juju-e4d256-prod-github-runner-207 kernel: [ 2904.611423] direct_page_fault+0x206/0x310 [kvm] Aug 22 06:12:10 juju-e4d256-prod-github-runner-207 kernel: [ 2904.612494] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 06:12:10 juju-e4d256-prod-github-runner-207 kernel: [ 2904.613531] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 06:12:10 juju-e4d256-prod-github-runner-207 kernel: [ 2904.614576] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 06:12:10 juju-e4d256-prod-github-runner-207 kernel: [ 2904.615607] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 06:12:10 juju-e4d256-prod-github-runner-207 kernel: [ 2904.616564] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 06:12:10 juju-e4d256-prod-github-runner-207 kernel: [ 2904.617560] handle_exit+0x98/0x230 [kvm_amd] Aug 22 06:12:10 juju-e4d256-prod-github-runner-207 kernel: [ 2904.618490] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 06:12:10 juju-e4d256-prod-github-runner-207 kernel: [ 2904.619412] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 06:12:10 juju-e4d256-prod-github-runner-207 kernel: [ 2904.620340] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 06:12:10 juju-e4d256-prod-github-runner-207 kernel: [ 2904.621252] vcpu_run+0x62/0x2c0 [kvm] Aug 22 06:12:10 juju-e4d256-prod-github-runner-207 kernel: [ 2904.622076] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 06:12:10 juju-e4d256-prod-github-runner-207 kernel: [ 2904.622913] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 06:12:10 juju-e4d256-prod-github-runner-207 kernel: [ 2904.623774] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 06:12:10 juju-e4d256-prod-github-runner-207 kernel: [ 2904.624580] ? __seccomp_filter+0x4a/0x4a0 Aug 22 06:12:10 juju-e4d256-prod-github-runner-207 kernel: [ 2904.625338] ? __fget_files+0x86/0xc0 Aug 22 06:12:10 juju-e4d256-prod-github-runner-207 kernel: [ 2904.626050] __x64_sys_ioctl+0x95/0xd0 Aug 22 06:12:10 juju-e4d256-prod-github-runner-207 kernel: [ 2904.626764] do_syscall_64+0x5c/0xc0 Aug 22 06:12:10 juju-e4d256-prod-github-runner-207 kernel: [ 2904.627434] ? do_futex+0x162/0x1f0 Aug 22 06:12:10 juju-e4d256-prod-github-runner-207 kernel: [ 2904.628087] ? __x64_sys_futex+0x78/0x1e0 Aug 22 06:12:10 juju-e4d256-prod-github-runner-207 kernel: [ 2904.628763] ? __secure_computing+0xa9/0x120 Aug 22 06:12:10 juju-e4d256-prod-github-runner-207 kernel: [ 2904.629473] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 06:12:10 juju-e4d256-prod-github-runner-207 kernel: [ 2904.630251] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:12:10 juju-e4d256-prod-github-runner-207 kernel: [ 2904.630979] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:12:10 juju-e4d256-prod-github-runner-207 kernel: [ 2904.631704] ? do_syscall_64+0x69/0xc0 Aug 22 06:12:10 juju-e4d256-prod-github-runner-207 kernel: [ 2904.632353] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:12:10 juju-e4d256-prod-github-runner-207 kernel: [ 2904.633069] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:12:10 juju-e4d256-prod-github-runner-207 kernel: [ 2904.633768] ? do_syscall_64+0x69/0xc0 Aug 22 06:12:10 juju-e4d256-prod-github-runner-207 kernel: [ 2904.634414] ? do_syscall_64+0x69/0xc0 Aug 22 06:12:10 juju-e4d256-prod-github-runner-207 kernel: [ 2904.635041] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 06:12:10 juju-e4d256-prod-github-runner-207 kernel: [ 2904.635747] RIP: 0033:0x7faa5d0edaff Aug 22 06:12:10 juju-e4d256-prod-github-runner-207 kernel: [ 2904.636403] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 06:12:10 juju-e4d256-prod-github-runner-207 kernel: [ 2904.638429] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 06:12:10 juju-e4d256-prod-github-runner-207 kernel: [ 2904.639343] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 06:12:10 juju-e4d256-prod-github-runner-207 kernel: [ 2904.640232] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 06:12:10 juju-e4d256-prod-github-runner-207 kernel: [ 2904.641133] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 06:12:10 juju-e4d256-prod-github-runner-207 kernel: [ 2904.642024] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 06:12:10 juju-e4d256-prod-github-runner-207 kernel: [ 2904.642931] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 06:12:10 juju-e4d256-prod-github-runner-207 kernel: [ 2904.643830] Aug 22 06:12:38 juju-e4d256-prod-github-runner-207 kernel: [ 2932.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 2623s! [qemu-system-x86:6715] Aug 22 06:12:38 juju-e4d256-prod-github-runner-207 kernel: [ 2932.543096] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 06:12:38 juju-e4d256-prod-github-runner-207 kernel: [ 2932.543168] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 06:12:38 juju-e4d256-prod-github-runner-207 kernel: [ 2932.555284] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 06:12:38 juju-e4d256-prod-github-runner-207 kernel: [ 2932.556551] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 06:12:38 juju-e4d256-prod-github-runner-207 kernel: [ 2932.557792] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:12:38 juju-e4d256-prod-github-runner-207 kernel: [ 2932.558853] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 06:12:38 juju-e4d256-prod-github-runner-207 kernel: [ 2932.561397] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 06:12:38 juju-e4d256-prod-github-runner-207 kernel: [ 2932.562472] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 06:12:38 juju-e4d256-prod-github-runner-207 kernel: [ 2932.563630] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 06:12:38 juju-e4d256-prod-github-runner-207 kernel: [ 2932.564785] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 06:12:38 juju-e4d256-prod-github-runner-207 kernel: [ 2932.565949] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 06:12:38 juju-e4d256-prod-github-runner-207 kernel: [ 2932.567104] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 06:12:38 juju-e4d256-prod-github-runner-207 kernel: [ 2932.568286] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 06:12:38 juju-e4d256-prod-github-runner-207 kernel: [ 2932.569517] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 06:12:38 juju-e4d256-prod-github-runner-207 kernel: [ 2932.570620] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 06:12:38 juju-e4d256-prod-github-runner-207 kernel: [ 2932.571814] Call Trace: Aug 22 06:12:38 juju-e4d256-prod-github-runner-207 kernel: [ 2932.572724] Aug 22 06:12:38 juju-e4d256-prod-github-runner-207 kernel: [ 2932.573607] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:12:38 juju-e4d256-prod-github-runner-207 kernel: [ 2932.574651] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:12:38 juju-e4d256-prod-github-runner-207 kernel: [ 2932.575683] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:12:38 juju-e4d256-prod-github-runner-207 kernel: [ 2932.576784] ? show_regs.part.0+0x23/0x29 Aug 22 06:12:38 juju-e4d256-prod-github-runner-207 kernel: [ 2932.577817] ? show_regs.cold+0x8/0xd Aug 22 06:12:38 juju-e4d256-prod-github-runner-207 kernel: [ 2932.578818] ? watchdog_timer_fn+0x1be/0x220 Aug 22 06:12:38 juju-e4d256-prod-github-runner-207 kernel: [ 2932.579835] ? lockup_detector_update_enable+0x60/0x60 Aug 22 06:12:38 juju-e4d256-prod-github-runner-207 kernel: [ 2932.580896] ? __hrtimer_run_queues+0x107/0x230 Aug 22 06:12:38 juju-e4d256-prod-github-runner-207 kernel: [ 2932.581935] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 06:12:38 juju-e4d256-prod-github-runner-207 kernel: [ 2932.582957] ? hrtimer_interrupt+0x101/0x220 Aug 22 06:12:38 juju-e4d256-prod-github-runner-207 kernel: [ 2932.583969] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 06:12:38 juju-e4d256-prod-github-runner-207 kernel: [ 2932.585036] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 06:12:38 juju-e4d256-prod-github-runner-207 kernel: [ 2932.586089] Aug 22 06:12:38 juju-e4d256-prod-github-runner-207 kernel: [ 2932.586940] Aug 22 06:12:38 juju-e4d256-prod-github-runner-207 kernel: [ 2932.587775] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 06:12:38 juju-e4d256-prod-github-runner-207 kernel: [ 2932.588804] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:12:38 juju-e4d256-prod-github-runner-207 kernel: [ 2932.589858] ? _raw_spin_lock+0x22/0x30 Aug 22 06:12:38 juju-e4d256-prod-github-runner-207 kernel: [ 2932.590801] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:12:38 juju-e4d256-prod-github-runner-207 kernel: [ 2932.591817] direct_page_fault+0x206/0x310 [kvm] Aug 22 06:12:38 juju-e4d256-prod-github-runner-207 kernel: [ 2932.592838] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 06:12:38 juju-e4d256-prod-github-runner-207 kernel: [ 2932.593851] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 06:12:38 juju-e4d256-prod-github-runner-207 kernel: [ 2932.594851] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 06:12:38 juju-e4d256-prod-github-runner-207 kernel: [ 2932.595819] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 06:12:38 juju-e4d256-prod-github-runner-207 kernel: [ 2932.596761] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 06:12:38 juju-e4d256-prod-github-runner-207 kernel: [ 2932.597734] handle_exit+0x98/0x230 [kvm_amd] Aug 22 06:12:38 juju-e4d256-prod-github-runner-207 kernel: [ 2932.598634] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 06:12:38 juju-e4d256-prod-github-runner-207 kernel: [ 2932.599544] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 06:12:38 juju-e4d256-prod-github-runner-207 kernel: [ 2932.600484] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 06:12:38 juju-e4d256-prod-github-runner-207 kernel: [ 2932.601389] vcpu_run+0x62/0x2c0 [kvm] Aug 22 06:12:38 juju-e4d256-prod-github-runner-207 kernel: [ 2932.602222] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 06:12:38 juju-e4d256-prod-github-runner-207 kernel: [ 2932.603041] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 06:12:38 juju-e4d256-prod-github-runner-207 kernel: [ 2932.603894] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 06:12:38 juju-e4d256-prod-github-runner-207 kernel: [ 2932.604692] ? __seccomp_filter+0x4a/0x4a0 Aug 22 06:12:38 juju-e4d256-prod-github-runner-207 kernel: [ 2932.605446] ? __fget_files+0x86/0xc0 Aug 22 06:12:38 juju-e4d256-prod-github-runner-207 kernel: [ 2932.606177] __x64_sys_ioctl+0x95/0xd0 Aug 22 06:12:38 juju-e4d256-prod-github-runner-207 kernel: [ 2932.606895] do_syscall_64+0x5c/0xc0 Aug 22 06:12:38 juju-e4d256-prod-github-runner-207 kernel: [ 2932.607562] ? do_futex+0x162/0x1f0 Aug 22 06:12:38 juju-e4d256-prod-github-runner-207 kernel: [ 2932.608215] ? __x64_sys_futex+0x78/0x1e0 Aug 22 06:12:38 juju-e4d256-prod-github-runner-207 kernel: [ 2932.608928] ? __secure_computing+0xa9/0x120 Aug 22 06:12:38 juju-e4d256-prod-github-runner-207 kernel: [ 2932.609621] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 06:12:38 juju-e4d256-prod-github-runner-207 kernel: [ 2932.610399] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:12:38 juju-e4d256-prod-github-runner-207 kernel: [ 2932.611117] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:12:38 juju-e4d256-prod-github-runner-207 kernel: [ 2932.611834] ? do_syscall_64+0x69/0xc0 Aug 22 06:12:38 juju-e4d256-prod-github-runner-207 kernel: [ 2932.612475] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:12:38 juju-e4d256-prod-github-runner-207 kernel: [ 2932.613174] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:12:38 juju-e4d256-prod-github-runner-207 kernel: [ 2932.613875] ? do_syscall_64+0x69/0xc0 Aug 22 06:12:38 juju-e4d256-prod-github-runner-207 kernel: [ 2932.614496] ? do_syscall_64+0x69/0xc0 Aug 22 06:12:38 juju-e4d256-prod-github-runner-207 kernel: [ 2932.615116] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 06:12:38 juju-e4d256-prod-github-runner-207 kernel: [ 2932.615823] RIP: 0033:0x7faa5d0edaff Aug 22 06:12:38 juju-e4d256-prod-github-runner-207 kernel: [ 2932.616444] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 06:12:38 juju-e4d256-prod-github-runner-207 kernel: [ 2932.618427] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 06:12:38 juju-e4d256-prod-github-runner-207 kernel: [ 2932.619341] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 06:12:38 juju-e4d256-prod-github-runner-207 kernel: [ 2932.620230] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 06:12:38 juju-e4d256-prod-github-runner-207 kernel: [ 2932.621118] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 06:12:38 juju-e4d256-prod-github-runner-207 kernel: [ 2932.622019] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 06:12:38 juju-e4d256-prod-github-runner-207 kernel: [ 2932.622906] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 06:12:38 juju-e4d256-prod-github-runner-207 kernel: [ 2932.623794] Aug 22 06:13:06 juju-e4d256-prod-github-runner-207 kernel: [ 2960.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 2649s! [qemu-system-x86:6715] Aug 22 06:13:06 juju-e4d256-prod-github-runner-207 kernel: [ 2960.543074] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 06:13:06 juju-e4d256-prod-github-runner-207 kernel: [ 2960.543142] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 06:13:06 juju-e4d256-prod-github-runner-207 kernel: [ 2960.555288] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 06:13:06 juju-e4d256-prod-github-runner-207 kernel: [ 2960.556556] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 06:13:06 juju-e4d256-prod-github-runner-207 kernel: [ 2960.557794] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:13:06 juju-e4d256-prod-github-runner-207 kernel: [ 2960.558852] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 06:13:06 juju-e4d256-prod-github-runner-207 kernel: [ 2960.561407] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 06:13:06 juju-e4d256-prod-github-runner-207 kernel: [ 2960.562456] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 06:13:06 juju-e4d256-prod-github-runner-207 kernel: [ 2960.563618] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 06:13:06 juju-e4d256-prod-github-runner-207 kernel: [ 2960.564777] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 06:13:06 juju-e4d256-prod-github-runner-207 kernel: [ 2960.565954] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 06:13:06 juju-e4d256-prod-github-runner-207 kernel: [ 2960.567127] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 06:13:06 juju-e4d256-prod-github-runner-207 kernel: [ 2960.568300] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 06:13:06 juju-e4d256-prod-github-runner-207 kernel: [ 2960.569546] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 06:13:06 juju-e4d256-prod-github-runner-207 kernel: [ 2960.570745] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 06:13:06 juju-e4d256-prod-github-runner-207 kernel: [ 2960.572002] Call Trace: Aug 22 06:13:06 juju-e4d256-prod-github-runner-207 kernel: [ 2960.572922] Aug 22 06:13:06 juju-e4d256-prod-github-runner-207 kernel: [ 2960.573820] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:13:06 juju-e4d256-prod-github-runner-207 kernel: [ 2960.574851] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:13:06 juju-e4d256-prod-github-runner-207 kernel: [ 2960.575870] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:13:06 juju-e4d256-prod-github-runner-207 kernel: [ 2960.576943] ? show_regs.part.0+0x23/0x29 Aug 22 06:13:06 juju-e4d256-prod-github-runner-207 kernel: [ 2960.577946] ? show_regs.cold+0x8/0xd Aug 22 06:13:06 juju-e4d256-prod-github-runner-207 kernel: [ 2960.578941] ? watchdog_timer_fn+0x1be/0x220 Aug 22 06:13:06 juju-e4d256-prod-github-runner-207 kernel: [ 2960.579958] ? lockup_detector_update_enable+0x60/0x60 Aug 22 06:13:06 juju-e4d256-prod-github-runner-207 kernel: [ 2960.581024] ? __hrtimer_run_queues+0x107/0x230 Aug 22 06:13:06 juju-e4d256-prod-github-runner-207 kernel: [ 2960.582057] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 06:13:06 juju-e4d256-prod-github-runner-207 kernel: [ 2960.583081] ? hrtimer_interrupt+0x101/0x220 Aug 22 06:13:06 juju-e4d256-prod-github-runner-207 kernel: [ 2960.584097] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 06:13:06 juju-e4d256-prod-github-runner-207 kernel: [ 2960.585328] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 06:13:06 juju-e4d256-prod-github-runner-207 kernel: [ 2960.586386] Aug 22 06:13:06 juju-e4d256-prod-github-runner-207 kernel: [ 2960.587245] Aug 22 06:13:06 juju-e4d256-prod-github-runner-207 kernel: [ 2960.588081] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 06:13:06 juju-e4d256-prod-github-runner-207 kernel: [ 2960.589117] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:13:06 juju-e4d256-prod-github-runner-207 kernel: [ 2960.590204] ? _raw_spin_lock+0x22/0x30 Aug 22 06:13:06 juju-e4d256-prod-github-runner-207 kernel: [ 2960.591179] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:13:06 juju-e4d256-prod-github-runner-207 kernel: [ 2960.592211] direct_page_fault+0x206/0x310 [kvm] Aug 22 06:13:06 juju-e4d256-prod-github-runner-207 kernel: [ 2960.593241] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 06:13:06 juju-e4d256-prod-github-runner-207 kernel: [ 2960.594270] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 06:13:06 juju-e4d256-prod-github-runner-207 kernel: [ 2960.595310] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 06:13:06 juju-e4d256-prod-github-runner-207 kernel: [ 2960.596285] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 06:13:06 juju-e4d256-prod-github-runner-207 kernel: [ 2960.597236] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 06:13:06 juju-e4d256-prod-github-runner-207 kernel: [ 2960.598231] handle_exit+0x98/0x230 [kvm_amd] Aug 22 06:13:06 juju-e4d256-prod-github-runner-207 kernel: [ 2960.599124] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 06:13:06 juju-e4d256-prod-github-runner-207 kernel: [ 2960.600043] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 06:13:06 juju-e4d256-prod-github-runner-207 kernel: [ 2960.600972] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 06:13:06 juju-e4d256-prod-github-runner-207 kernel: [ 2960.601898] vcpu_run+0x62/0x2c0 [kvm] Aug 22 06:13:06 juju-e4d256-prod-github-runner-207 kernel: [ 2960.602800] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 06:13:06 juju-e4d256-prod-github-runner-207 kernel: [ 2960.603638] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 06:13:06 juju-e4d256-prod-github-runner-207 kernel: [ 2960.604497] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 06:13:06 juju-e4d256-prod-github-runner-207 kernel: [ 2960.605297] ? __seccomp_filter+0x4a/0x4a0 Aug 22 06:13:06 juju-e4d256-prod-github-runner-207 kernel: [ 2960.606055] ? __fget_files+0x86/0xc0 Aug 22 06:13:06 juju-e4d256-prod-github-runner-207 kernel: [ 2960.606759] __x64_sys_ioctl+0x95/0xd0 Aug 22 06:13:06 juju-e4d256-prod-github-runner-207 kernel: [ 2960.607451] do_syscall_64+0x5c/0xc0 Aug 22 06:13:06 juju-e4d256-prod-github-runner-207 kernel: [ 2960.608114] ? do_futex+0x162/0x1f0 Aug 22 06:13:06 juju-e4d256-prod-github-runner-207 kernel: [ 2960.608762] ? __x64_sys_futex+0x78/0x1e0 Aug 22 06:13:06 juju-e4d256-prod-github-runner-207 kernel: [ 2960.609447] ? __secure_computing+0xa9/0x120 Aug 22 06:13:06 juju-e4d256-prod-github-runner-207 kernel: [ 2960.610135] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 06:13:06 juju-e4d256-prod-github-runner-207 kernel: [ 2960.610893] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:13:06 juju-e4d256-prod-github-runner-207 kernel: [ 2960.611619] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:13:06 juju-e4d256-prod-github-runner-207 kernel: [ 2960.612337] ? do_syscall_64+0x69/0xc0 Aug 22 06:13:06 juju-e4d256-prod-github-runner-207 kernel: [ 2960.612986] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:13:06 juju-e4d256-prod-github-runner-207 kernel: [ 2960.613693] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:13:06 juju-e4d256-prod-github-runner-207 kernel: [ 2960.614388] ? do_syscall_64+0x69/0xc0 Aug 22 06:13:06 juju-e4d256-prod-github-runner-207 kernel: [ 2960.615011] ? do_syscall_64+0x69/0xc0 Aug 22 06:13:06 juju-e4d256-prod-github-runner-207 kernel: [ 2960.615631] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 06:13:06 juju-e4d256-prod-github-runner-207 kernel: [ 2960.616334] RIP: 0033:0x7faa5d0edaff Aug 22 06:13:06 juju-e4d256-prod-github-runner-207 kernel: [ 2960.616956] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 06:13:06 juju-e4d256-prod-github-runner-207 kernel: [ 2960.618953] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 06:13:06 juju-e4d256-prod-github-runner-207 kernel: [ 2960.619865] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 06:13:06 juju-e4d256-prod-github-runner-207 kernel: [ 2960.620755] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 06:13:06 juju-e4d256-prod-github-runner-207 kernel: [ 2960.621652] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 06:13:06 juju-e4d256-prod-github-runner-207 kernel: [ 2960.622613] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 06:13:06 juju-e4d256-prod-github-runner-207 kernel: [ 2960.623521] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 06:13:06 juju-e4d256-prod-github-runner-207 kernel: [ 2960.624418] Aug 22 06:13:34 juju-e4d256-prod-github-runner-207 kernel: [ 2988.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 2675s! [qemu-system-x86:6715] Aug 22 06:13:34 juju-e4d256-prod-github-runner-207 kernel: [ 2988.543754] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 06:13:34 juju-e4d256-prod-github-runner-207 kernel: [ 2988.544025] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 06:13:34 juju-e4d256-prod-github-runner-207 kernel: [ 2988.556647] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 06:13:34 juju-e4d256-prod-github-runner-207 kernel: [ 2988.557935] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 06:13:34 juju-e4d256-prod-github-runner-207 kernel: [ 2988.559164] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:13:34 juju-e4d256-prod-github-runner-207 kernel: [ 2988.560242] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 06:13:34 juju-e4d256-prod-github-runner-207 kernel: [ 2988.562826] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 06:13:34 juju-e4d256-prod-github-runner-207 kernel: [ 2988.563879] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 06:13:34 juju-e4d256-prod-github-runner-207 kernel: [ 2988.565069] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 06:13:34 juju-e4d256-prod-github-runner-207 kernel: [ 2988.566261] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 06:13:34 juju-e4d256-prod-github-runner-207 kernel: [ 2988.567421] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 06:13:34 juju-e4d256-prod-github-runner-207 kernel: [ 2988.568648] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 06:13:34 juju-e4d256-prod-github-runner-207 kernel: [ 2988.570006] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 06:13:34 juju-e4d256-prod-github-runner-207 kernel: [ 2988.571256] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 06:13:34 juju-e4d256-prod-github-runner-207 kernel: [ 2988.572356] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 06:13:34 juju-e4d256-prod-github-runner-207 kernel: [ 2988.573571] Call Trace: Aug 22 06:13:34 juju-e4d256-prod-github-runner-207 kernel: [ 2988.574499] Aug 22 06:13:34 juju-e4d256-prod-github-runner-207 kernel: [ 2988.575439] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:13:34 juju-e4d256-prod-github-runner-207 kernel: [ 2988.576473] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:13:34 juju-e4d256-prod-github-runner-207 kernel: [ 2988.577514] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:13:34 juju-e4d256-prod-github-runner-207 kernel: [ 2988.578644] ? show_regs.part.0+0x23/0x29 Aug 22 06:13:34 juju-e4d256-prod-github-runner-207 kernel: [ 2988.579660] ? show_regs.cold+0x8/0xd Aug 22 06:13:34 juju-e4d256-prod-github-runner-207 kernel: [ 2988.580652] ? watchdog_timer_fn+0x1be/0x220 Aug 22 06:13:34 juju-e4d256-prod-github-runner-207 kernel: [ 2988.581684] ? lockup_detector_update_enable+0x60/0x60 Aug 22 06:13:34 juju-e4d256-prod-github-runner-207 kernel: [ 2988.582758] ? __hrtimer_run_queues+0x107/0x230 Aug 22 06:13:34 juju-e4d256-prod-github-runner-207 kernel: [ 2988.583790] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 06:13:34 juju-e4d256-prod-github-runner-207 kernel: [ 2988.584829] ? hrtimer_interrupt+0x101/0x220 Aug 22 06:13:34 juju-e4d256-prod-github-runner-207 kernel: [ 2988.585912] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 06:13:34 juju-e4d256-prod-github-runner-207 kernel: [ 2988.587005] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 06:13:34 juju-e4d256-prod-github-runner-207 kernel: [ 2988.588068] Aug 22 06:13:34 juju-e4d256-prod-github-runner-207 kernel: [ 2988.588927] Aug 22 06:13:34 juju-e4d256-prod-github-runner-207 kernel: [ 2988.589805] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 06:13:34 juju-e4d256-prod-github-runner-207 kernel: [ 2988.590855] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:13:34 juju-e4d256-prod-github-runner-207 kernel: [ 2988.591897] ? _raw_spin_lock+0x22/0x30 Aug 22 06:13:34 juju-e4d256-prod-github-runner-207 kernel: [ 2988.592842] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:13:34 juju-e4d256-prod-github-runner-207 kernel: [ 2988.593879] direct_page_fault+0x206/0x310 [kvm] Aug 22 06:13:34 juju-e4d256-prod-github-runner-207 kernel: [ 2988.594918] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 06:13:34 juju-e4d256-prod-github-runner-207 kernel: [ 2988.595955] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 06:13:34 juju-e4d256-prod-github-runner-207 kernel: [ 2988.597044] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 06:13:34 juju-e4d256-prod-github-runner-207 kernel: [ 2988.598129] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 06:13:34 juju-e4d256-prod-github-runner-207 kernel: [ 2988.599079] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 06:13:34 juju-e4d256-prod-github-runner-207 kernel: [ 2988.600067] handle_exit+0x98/0x230 [kvm_amd] Aug 22 06:13:34 juju-e4d256-prod-github-runner-207 kernel: [ 2988.600980] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 06:13:34 juju-e4d256-prod-github-runner-207 kernel: [ 2988.601924] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 06:13:34 juju-e4d256-prod-github-runner-207 kernel: [ 2988.602847] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 06:13:34 juju-e4d256-prod-github-runner-207 kernel: [ 2988.603754] vcpu_run+0x62/0x2c0 [kvm] Aug 22 06:13:34 juju-e4d256-prod-github-runner-207 kernel: [ 2988.604565] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 06:13:34 juju-e4d256-prod-github-runner-207 kernel: [ 2988.605424] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 06:13:34 juju-e4d256-prod-github-runner-207 kernel: [ 2988.606467] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 06:13:34 juju-e4d256-prod-github-runner-207 kernel: [ 2988.607273] ? __seccomp_filter+0x4a/0x4a0 Aug 22 06:13:34 juju-e4d256-prod-github-runner-207 kernel: [ 2988.608014] ? __fget_files+0x86/0xc0 Aug 22 06:13:34 juju-e4d256-prod-github-runner-207 kernel: [ 2988.608723] __x64_sys_ioctl+0x95/0xd0 Aug 22 06:13:34 juju-e4d256-prod-github-runner-207 kernel: [ 2988.609441] do_syscall_64+0x5c/0xc0 Aug 22 06:13:34 juju-e4d256-prod-github-runner-207 kernel: [ 2988.610116] ? do_futex+0x162/0x1f0 Aug 22 06:13:34 juju-e4d256-prod-github-runner-207 kernel: [ 2988.610768] ? __x64_sys_futex+0x78/0x1e0 Aug 22 06:13:34 juju-e4d256-prod-github-runner-207 kernel: [ 2988.611453] ? __secure_computing+0xa9/0x120 Aug 22 06:13:34 juju-e4d256-prod-github-runner-207 kernel: [ 2988.612145] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 06:13:34 juju-e4d256-prod-github-runner-207 kernel: [ 2988.612903] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:13:34 juju-e4d256-prod-github-runner-207 kernel: [ 2988.613645] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:13:34 juju-e4d256-prod-github-runner-207 kernel: [ 2988.614363] ? do_syscall_64+0x69/0xc0 Aug 22 06:13:34 juju-e4d256-prod-github-runner-207 kernel: [ 2988.615009] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:13:34 juju-e4d256-prod-github-runner-207 kernel: [ 2988.615721] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:13:34 juju-e4d256-prod-github-runner-207 kernel: [ 2988.616452] ? do_syscall_64+0x69/0xc0 Aug 22 06:13:34 juju-e4d256-prod-github-runner-207 kernel: [ 2988.617082] ? do_syscall_64+0x69/0xc0 Aug 22 06:13:34 juju-e4d256-prod-github-runner-207 kernel: [ 2988.617731] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 06:13:34 juju-e4d256-prod-github-runner-207 kernel: [ 2988.618436] RIP: 0033:0x7faa5d0edaff Aug 22 06:13:34 juju-e4d256-prod-github-runner-207 kernel: [ 2988.619079] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 06:13:34 juju-e4d256-prod-github-runner-207 kernel: [ 2988.621086] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 06:13:34 juju-e4d256-prod-github-runner-207 kernel: [ 2988.622036] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 06:13:34 juju-e4d256-prod-github-runner-207 kernel: [ 2988.622929] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 06:13:34 juju-e4d256-prod-github-runner-207 kernel: [ 2988.623814] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 06:13:34 juju-e4d256-prod-github-runner-207 kernel: [ 2988.624706] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 06:13:34 juju-e4d256-prod-github-runner-207 kernel: [ 2988.625624] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 06:13:34 juju-e4d256-prod-github-runner-207 kernel: [ 2988.626545] Aug 22 06:14:02 juju-e4d256-prod-github-runner-207 kernel: [ 3016.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 2701s! [qemu-system-x86:6715] Aug 22 06:14:02 juju-e4d256-prod-github-runner-207 kernel: [ 3016.543083] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 06:14:02 juju-e4d256-prod-github-runner-207 kernel: [ 3016.543151] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 06:14:02 juju-e4d256-prod-github-runner-207 kernel: [ 3016.555224] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 06:14:02 juju-e4d256-prod-github-runner-207 kernel: [ 3016.556490] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 06:14:02 juju-e4d256-prod-github-runner-207 kernel: [ 3016.557733] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:14:02 juju-e4d256-prod-github-runner-207 kernel: [ 3016.558796] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 06:14:02 juju-e4d256-prod-github-runner-207 kernel: [ 3016.561359] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 06:14:02 juju-e4d256-prod-github-runner-207 kernel: [ 3016.562413] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 06:14:02 juju-e4d256-prod-github-runner-207 kernel: [ 3016.563579] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 06:14:02 juju-e4d256-prod-github-runner-207 kernel: [ 3016.564736] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 06:14:02 juju-e4d256-prod-github-runner-207 kernel: [ 3016.565908] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 06:14:02 juju-e4d256-prod-github-runner-207 kernel: [ 3016.567071] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 06:14:02 juju-e4d256-prod-github-runner-207 kernel: [ 3016.568245] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 06:14:02 juju-e4d256-prod-github-runner-207 kernel: [ 3016.569492] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 06:14:02 juju-e4d256-prod-github-runner-207 kernel: [ 3016.570595] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 06:14:02 juju-e4d256-prod-github-runner-207 kernel: [ 3016.571788] Call Trace: Aug 22 06:14:02 juju-e4d256-prod-github-runner-207 kernel: [ 3016.572698] Aug 22 06:14:02 juju-e4d256-prod-github-runner-207 kernel: [ 3016.573598] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:14:02 juju-e4d256-prod-github-runner-207 kernel: [ 3016.574628] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:14:02 juju-e4d256-prod-github-runner-207 kernel: [ 3016.575645] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:14:02 juju-e4d256-prod-github-runner-207 kernel: [ 3016.576723] ? show_regs.part.0+0x23/0x29 Aug 22 06:14:02 juju-e4d256-prod-github-runner-207 kernel: [ 3016.577734] ? show_regs.cold+0x8/0xd Aug 22 06:14:02 juju-e4d256-prod-github-runner-207 kernel: [ 3016.578705] ? watchdog_timer_fn+0x1be/0x220 Aug 22 06:14:02 juju-e4d256-prod-github-runner-207 kernel: [ 3016.579712] ? lockup_detector_update_enable+0x60/0x60 Aug 22 06:14:02 juju-e4d256-prod-github-runner-207 kernel: [ 3016.580800] ? __hrtimer_run_queues+0x107/0x230 Aug 22 06:14:02 juju-e4d256-prod-github-runner-207 kernel: [ 3016.581832] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 06:14:02 juju-e4d256-prod-github-runner-207 kernel: [ 3016.582855] ? hrtimer_interrupt+0x101/0x220 Aug 22 06:14:02 juju-e4d256-prod-github-runner-207 kernel: [ 3016.583881] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 06:14:02 juju-e4d256-prod-github-runner-207 kernel: [ 3016.584963] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 06:14:02 juju-e4d256-prod-github-runner-207 kernel: [ 3016.586013] Aug 22 06:14:02 juju-e4d256-prod-github-runner-207 kernel: [ 3016.586864] Aug 22 06:14:02 juju-e4d256-prod-github-runner-207 kernel: [ 3016.587710] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 06:14:02 juju-e4d256-prod-github-runner-207 kernel: [ 3016.589023] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:14:02 juju-e4d256-prod-github-runner-207 kernel: [ 3016.590094] ? _raw_spin_lock+0x22/0x30 Aug 22 06:14:02 juju-e4d256-prod-github-runner-207 kernel: [ 3016.591039] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:14:02 juju-e4d256-prod-github-runner-207 kernel: [ 3016.592055] direct_page_fault+0x206/0x310 [kvm] Aug 22 06:14:02 juju-e4d256-prod-github-runner-207 kernel: [ 3016.593099] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 06:14:02 juju-e4d256-prod-github-runner-207 kernel: [ 3016.594110] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 06:14:02 juju-e4d256-prod-github-runner-207 kernel: [ 3016.595109] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 06:14:02 juju-e4d256-prod-github-runner-207 kernel: [ 3016.596078] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 06:14:02 juju-e4d256-prod-github-runner-207 kernel: [ 3016.597040] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 06:14:02 juju-e4d256-prod-github-runner-207 kernel: [ 3016.598021] handle_exit+0x98/0x230 [kvm_amd] Aug 22 06:14:02 juju-e4d256-prod-github-runner-207 kernel: [ 3016.598920] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 06:14:02 juju-e4d256-prod-github-runner-207 kernel: [ 3016.599834] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 06:14:02 juju-e4d256-prod-github-runner-207 kernel: [ 3016.600775] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 06:14:02 juju-e4d256-prod-github-runner-207 kernel: [ 3016.601685] vcpu_run+0x62/0x2c0 [kvm] Aug 22 06:14:02 juju-e4d256-prod-github-runner-207 kernel: [ 3016.602494] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 06:14:02 juju-e4d256-prod-github-runner-207 kernel: [ 3016.603319] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 06:14:02 juju-e4d256-prod-github-runner-207 kernel: [ 3016.604183] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 06:14:02 juju-e4d256-prod-github-runner-207 kernel: [ 3016.604995] ? __seccomp_filter+0x4a/0x4a0 Aug 22 06:14:02 juju-e4d256-prod-github-runner-207 kernel: [ 3016.605737] ? __fget_files+0x86/0xc0 Aug 22 06:14:02 juju-e4d256-prod-github-runner-207 kernel: [ 3016.606438] __x64_sys_ioctl+0x95/0xd0 Aug 22 06:14:02 juju-e4d256-prod-github-runner-207 kernel: [ 3016.607126] do_syscall_64+0x5c/0xc0 Aug 22 06:14:02 juju-e4d256-prod-github-runner-207 kernel: [ 3016.607787] ? do_futex+0x162/0x1f0 Aug 22 06:14:02 juju-e4d256-prod-github-runner-207 kernel: [ 3016.608432] ? __x64_sys_futex+0x78/0x1e0 Aug 22 06:14:02 juju-e4d256-prod-github-runner-207 kernel: [ 3016.609127] ? __secure_computing+0xa9/0x120 Aug 22 06:14:02 juju-e4d256-prod-github-runner-207 kernel: [ 3016.609813] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 06:14:02 juju-e4d256-prod-github-runner-207 kernel: [ 3016.610568] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:14:02 juju-e4d256-prod-github-runner-207 kernel: [ 3016.611285] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:14:02 juju-e4d256-prod-github-runner-207 kernel: [ 3016.611998] ? do_syscall_64+0x69/0xc0 Aug 22 06:14:02 juju-e4d256-prod-github-runner-207 kernel: [ 3016.612645] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:14:02 juju-e4d256-prod-github-runner-207 kernel: [ 3016.613435] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:14:02 juju-e4d256-prod-github-runner-207 kernel: [ 3016.614152] ? do_syscall_64+0x69/0xc0 Aug 22 06:14:02 juju-e4d256-prod-github-runner-207 kernel: [ 3016.614787] ? do_syscall_64+0x69/0xc0 Aug 22 06:14:02 juju-e4d256-prod-github-runner-207 kernel: [ 3016.615411] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 06:14:02 juju-e4d256-prod-github-runner-207 kernel: [ 3016.616118] RIP: 0033:0x7faa5d0edaff Aug 22 06:14:02 juju-e4d256-prod-github-runner-207 kernel: [ 3016.616775] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 06:14:02 juju-e4d256-prod-github-runner-207 kernel: [ 3016.618767] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 06:14:02 juju-e4d256-prod-github-runner-207 kernel: [ 3016.619686] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 06:14:02 juju-e4d256-prod-github-runner-207 kernel: [ 3016.620576] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 06:14:02 juju-e4d256-prod-github-runner-207 kernel: [ 3016.621486] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 06:14:02 juju-e4d256-prod-github-runner-207 kernel: [ 3016.622375] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 06:14:02 juju-e4d256-prod-github-runner-207 kernel: [ 3016.623263] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 06:14:02 juju-e4d256-prod-github-runner-207 kernel: [ 3016.624156] Aug 22 06:14:30 juju-e4d256-prod-github-runner-207 kernel: [ 3044.541980] watchdog: BUG: soft lockup - CPU#1 stuck for 2727s! [qemu-system-x86:6715] Aug 22 06:14:30 juju-e4d256-prod-github-runner-207 kernel: [ 3044.543101] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 06:14:30 juju-e4d256-prod-github-runner-207 kernel: [ 3044.543170] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 06:14:30 juju-e4d256-prod-github-runner-207 kernel: [ 3044.555302] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 06:14:30 juju-e4d256-prod-github-runner-207 kernel: [ 3044.556594] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 06:14:30 juju-e4d256-prod-github-runner-207 kernel: [ 3044.557840] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:14:30 juju-e4d256-prod-github-runner-207 kernel: [ 3044.558921] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 06:14:30 juju-e4d256-prod-github-runner-207 kernel: [ 3044.561517] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 06:14:30 juju-e4d256-prod-github-runner-207 kernel: [ 3044.562593] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 06:14:30 juju-e4d256-prod-github-runner-207 kernel: [ 3044.563779] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 06:14:30 juju-e4d256-prod-github-runner-207 kernel: [ 3044.564969] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 06:14:30 juju-e4d256-prod-github-runner-207 kernel: [ 3044.566153] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 06:14:30 juju-e4d256-prod-github-runner-207 kernel: [ 3044.567329] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 06:14:30 juju-e4d256-prod-github-runner-207 kernel: [ 3044.568527] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 06:14:30 juju-e4d256-prod-github-runner-207 kernel: [ 3044.569779] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 06:14:30 juju-e4d256-prod-github-runner-207 kernel: [ 3044.570892] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 06:14:30 juju-e4d256-prod-github-runner-207 kernel: [ 3044.572102] Call Trace: Aug 22 06:14:30 juju-e4d256-prod-github-runner-207 kernel: [ 3044.573046] Aug 22 06:14:30 juju-e4d256-prod-github-runner-207 kernel: [ 3044.573948] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:14:30 juju-e4d256-prod-github-runner-207 kernel: [ 3044.575000] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:14:30 juju-e4d256-prod-github-runner-207 kernel: [ 3044.576037] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:14:30 juju-e4d256-prod-github-runner-207 kernel: [ 3044.577145] ? show_regs.part.0+0x23/0x29 Aug 22 06:14:30 juju-e4d256-prod-github-runner-207 kernel: [ 3044.578164] ? show_regs.cold+0x8/0xd Aug 22 06:14:30 juju-e4d256-prod-github-runner-207 kernel: [ 3044.579162] ? watchdog_timer_fn+0x1be/0x220 Aug 22 06:14:30 juju-e4d256-prod-github-runner-207 kernel: [ 3044.580184] ? lockup_detector_update_enable+0x60/0x60 Aug 22 06:14:30 juju-e4d256-prod-github-runner-207 kernel: [ 3044.581286] ? __hrtimer_run_queues+0x107/0x230 Aug 22 06:14:30 juju-e4d256-prod-github-runner-207 kernel: [ 3044.582327] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 06:14:30 juju-e4d256-prod-github-runner-207 kernel: [ 3044.583377] ? hrtimer_interrupt+0x101/0x220 Aug 22 06:14:30 juju-e4d256-prod-github-runner-207 kernel: [ 3044.584440] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 06:14:30 juju-e4d256-prod-github-runner-207 kernel: [ 3044.585513] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 06:14:30 juju-e4d256-prod-github-runner-207 kernel: [ 3044.586573] Aug 22 06:14:30 juju-e4d256-prod-github-runner-207 kernel: [ 3044.587438] Aug 22 06:14:30 juju-e4d256-prod-github-runner-207 kernel: [ 3044.588277] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 06:14:30 juju-e4d256-prod-github-runner-207 kernel: [ 3044.589351] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:14:30 juju-e4d256-prod-github-runner-207 kernel: [ 3044.590408] ? _raw_spin_lock+0x22/0x30 Aug 22 06:14:30 juju-e4d256-prod-github-runner-207 kernel: [ 3044.591355] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:14:30 juju-e4d256-prod-github-runner-207 kernel: [ 3044.592398] direct_page_fault+0x206/0x310 [kvm] Aug 22 06:14:30 juju-e4d256-prod-github-runner-207 kernel: [ 3044.593456] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 06:14:30 juju-e4d256-prod-github-runner-207 kernel: [ 3044.594499] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 06:14:30 juju-e4d256-prod-github-runner-207 kernel: [ 3044.595518] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 06:14:30 juju-e4d256-prod-github-runner-207 kernel: [ 3044.596506] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 06:14:30 juju-e4d256-prod-github-runner-207 kernel: [ 3044.597478] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 06:14:30 juju-e4d256-prod-github-runner-207 kernel: [ 3044.598461] handle_exit+0x98/0x230 [kvm_amd] Aug 22 06:14:30 juju-e4d256-prod-github-runner-207 kernel: [ 3044.599376] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 06:14:30 juju-e4d256-prod-github-runner-207 kernel: [ 3044.600314] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 06:14:30 juju-e4d256-prod-github-runner-207 kernel: [ 3044.601263] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 06:14:30 juju-e4d256-prod-github-runner-207 kernel: [ 3044.602191] vcpu_run+0x62/0x2c0 [kvm] Aug 22 06:14:30 juju-e4d256-prod-github-runner-207 kernel: [ 3044.603021] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 06:14:30 juju-e4d256-prod-github-runner-207 kernel: [ 3044.603832] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 06:14:30 juju-e4d256-prod-github-runner-207 kernel: [ 3044.604731] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 06:14:30 juju-e4d256-prod-github-runner-207 kernel: [ 3044.605549] ? __seccomp_filter+0x4a/0x4a0 Aug 22 06:14:30 juju-e4d256-prod-github-runner-207 kernel: [ 3044.606298] ? __fget_files+0x86/0xc0 Aug 22 06:14:30 juju-e4d256-prod-github-runner-207 kernel: [ 3044.607013] __x64_sys_ioctl+0x95/0xd0 Aug 22 06:14:30 juju-e4d256-prod-github-runner-207 kernel: [ 3044.607725] do_syscall_64+0x5c/0xc0 Aug 22 06:14:30 juju-e4d256-prod-github-runner-207 kernel: [ 3044.608393] ? do_futex+0x162/0x1f0 Aug 22 06:14:30 juju-e4d256-prod-github-runner-207 kernel: [ 3044.609063] ? __x64_sys_futex+0x78/0x1e0 Aug 22 06:14:30 juju-e4d256-prod-github-runner-207 kernel: [ 3044.609759] ? __secure_computing+0xa9/0x120 Aug 22 06:14:30 juju-e4d256-prod-github-runner-207 kernel: [ 3044.610465] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 06:14:30 juju-e4d256-prod-github-runner-207 kernel: [ 3044.611233] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:14:30 juju-e4d256-prod-github-runner-207 kernel: [ 3044.611959] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:14:30 juju-e4d256-prod-github-runner-207 kernel: [ 3044.612715] ? do_syscall_64+0x69/0xc0 Aug 22 06:14:30 juju-e4d256-prod-github-runner-207 kernel: [ 3044.613370] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:14:30 juju-e4d256-prod-github-runner-207 kernel: [ 3044.614076] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:14:30 juju-e4d256-prod-github-runner-207 kernel: [ 3044.614793] ? do_syscall_64+0x69/0xc0 Aug 22 06:14:30 juju-e4d256-prod-github-runner-207 kernel: [ 3044.615434] ? do_syscall_64+0x69/0xc0 Aug 22 06:14:30 juju-e4d256-prod-github-runner-207 kernel: [ 3044.616064] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 06:14:30 juju-e4d256-prod-github-runner-207 kernel: [ 3044.616795] RIP: 0033:0x7faa5d0edaff Aug 22 06:14:30 juju-e4d256-prod-github-runner-207 kernel: [ 3044.617449] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 06:14:30 juju-e4d256-prod-github-runner-207 kernel: [ 3044.619474] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 06:14:30 juju-e4d256-prod-github-runner-207 kernel: [ 3044.620398] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 06:14:30 juju-e4d256-prod-github-runner-207 kernel: [ 3044.621325] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 06:14:30 juju-e4d256-prod-github-runner-207 kernel: [ 3044.622220] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 06:14:30 juju-e4d256-prod-github-runner-207 kernel: [ 3044.623127] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 06:14:30 juju-e4d256-prod-github-runner-207 kernel: [ 3044.624023] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 06:14:30 juju-e4d256-prod-github-runner-207 kernel: [ 3044.624951] Aug 22 06:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 3057.392704] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 06:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 3057.393677] rcu: 1-....: (732747 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=357006 Aug 22 06:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 3057.394782] (t=735048 jiffies g=23269 q=11673) Aug 22 06:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 3057.395726] NMI backtrace for cpu 1 Aug 22 06:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 3057.396457] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 06:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 3057.397560] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 06:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 3057.398621] Call Trace: Aug 22 06:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 3057.399316] Aug 22 06:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 3057.399968] show_stack+0x52/0x5c Aug 22 06:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 3057.400711] dump_stack_lvl+0x4a/0x63 Aug 22 06:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 3057.401460] dump_stack+0x10/0x16 Aug 22 06:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 3057.402174] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 06:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 3057.402952] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 06:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 3057.403727] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 06:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 3057.404628] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 06:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 3057.405507] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 06:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 3057.406317] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 06:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 3057.407092] print_cpu_stall.cold+0x2f/0xe2 Aug 22 06:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 3057.407856] ? timekeeping_update+0xf7/0x150 Aug 22 06:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 3057.408640] check_cpu_stall+0x109/0x270 Aug 22 06:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 3057.409387] rcu_sched_clock_irq+0x9a/0x250 Aug 22 06:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 3057.410149] update_process_times+0x94/0xd0 Aug 22 06:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 3057.410907] tick_sched_handle+0x29/0x70 Aug 22 06:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 3057.411650] tick_sched_timer+0x8c/0xc0 Aug 22 06:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 3057.412399] ? tick_nohz_handler+0xb0/0xb0 Aug 22 06:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 3057.413152] __hrtimer_run_queues+0x107/0x230 Aug 22 06:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 3057.413948] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 06:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 3057.414900] hrtimer_interrupt+0x101/0x220 Aug 22 06:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 3057.415671] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 06:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 3057.416502] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 06:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 3057.417312] Aug 22 06:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 3057.417948] Aug 22 06:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 3057.418575] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 06:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 3057.419392] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 3057.420285] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 06:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 3057.422491] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 06:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 3057.423366] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 06:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 3057.424373] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 06:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 3057.425351] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 06:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 3057.426319] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 06:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 3057.427273] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 06:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 3057.428225] ? _raw_spin_lock+0x22/0x30 Aug 22 06:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 3057.429021] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 3057.429868] direct_page_fault+0x206/0x310 [kvm] Aug 22 06:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 3057.430707] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 06:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 3057.431531] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 06:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 3057.432379] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 06:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 3057.433185] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 06:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 3057.433967] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 06:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 3057.434785] handle_exit+0x98/0x230 [kvm_amd] Aug 22 06:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 3057.435536] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 06:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 3057.436343] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 06:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 3057.437144] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 06:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 3057.437926] vcpu_run+0x62/0x2c0 [kvm] Aug 22 06:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 3057.438640] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 06:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 3057.439372] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 06:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 3057.440168] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 06:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 3057.441040] ? __seccomp_filter+0x4a/0x4a0 Aug 22 06:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 3057.441757] ? __fget_files+0x86/0xc0 Aug 22 06:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 3057.442447] __x64_sys_ioctl+0x95/0xd0 Aug 22 06:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 3057.443139] do_syscall_64+0x5c/0xc0 Aug 22 06:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 3057.443818] ? do_futex+0x162/0x1f0 Aug 22 06:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 3057.444675] ? __x64_sys_futex+0x78/0x1e0 Aug 22 06:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 3057.445397] ? __secure_computing+0xa9/0x120 Aug 22 06:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 3057.446298] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 06:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 3057.447087] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 3057.447842] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 3057.448619] ? do_syscall_64+0x69/0xc0 Aug 22 06:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 3057.449311] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 3057.450075] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 3057.450831] ? do_syscall_64+0x69/0xc0 Aug 22 06:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 3057.451523] ? do_syscall_64+0x69/0xc0 Aug 22 06:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 3057.452216] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 06:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 3057.453010] RIP: 0033:0x7faa5d0edaff Aug 22 06:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 3057.453695] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 06:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 3057.455802] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 06:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 3057.456799] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 06:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 3057.457740] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 06:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 3057.458685] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 06:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 3057.459657] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 06:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 3057.460597] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 06:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 3057.461515] Aug 22 06:15:10 juju-e4d256-prod-github-runner-207 kernel: [ 3084.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 2764s! [qemu-system-x86:6715] Aug 22 06:15:10 juju-e4d256-prod-github-runner-207 kernel: [ 3084.543700] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 06:15:10 juju-e4d256-prod-github-runner-207 kernel: [ 3084.543953] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 06:15:10 juju-e4d256-prod-github-runner-207 kernel: [ 3084.556093] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 06:15:10 juju-e4d256-prod-github-runner-207 kernel: [ 3084.557557] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 06:15:10 juju-e4d256-prod-github-runner-207 kernel: [ 3084.559050] RIP: 0010:native_queued_spin_lock_slowpath+0xc/0x40 Aug 22 06:15:10 juju-e4d256-prod-github-runner-207 kernel: [ 3084.560153] Code: fe ff ff eb af 4c 89 fe 48 c7 c7 20 99 e9 89 e8 ca 69 55 00 e9 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 <8b> 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 eb Aug 22 06:15:10 juju-e4d256-prod-github-runner-207 kernel: [ 3084.562726] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 06:15:10 juju-e4d256-prod-github-runner-207 kernel: [ 3084.563769] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 06:15:10 juju-e4d256-prod-github-runner-207 kernel: [ 3084.564950] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 06:15:10 juju-e4d256-prod-github-runner-207 kernel: [ 3084.566119] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 06:15:10 juju-e4d256-prod-github-runner-207 kernel: [ 3084.567343] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 06:15:10 juju-e4d256-prod-github-runner-207 kernel: [ 3084.568550] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 06:15:10 juju-e4d256-prod-github-runner-207 kernel: [ 3084.569943] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 06:15:10 juju-e4d256-prod-github-runner-207 kernel: [ 3084.571225] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 06:15:10 juju-e4d256-prod-github-runner-207 kernel: [ 3084.572348] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 06:15:10 juju-e4d256-prod-github-runner-207 kernel: [ 3084.573547] Call Trace: Aug 22 06:15:10 juju-e4d256-prod-github-runner-207 kernel: [ 3084.574458] Aug 22 06:15:10 juju-e4d256-prod-github-runner-207 kernel: [ 3084.575366] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:15:10 juju-e4d256-prod-github-runner-207 kernel: [ 3084.576606] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:15:10 juju-e4d256-prod-github-runner-207 kernel: [ 3084.577632] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:15:10 juju-e4d256-prod-github-runner-207 kernel: [ 3084.578922] ? show_regs.part.0+0x23/0x29 Aug 22 06:15:10 juju-e4d256-prod-github-runner-207 kernel: [ 3084.579948] ? show_regs.cold+0x8/0xd Aug 22 06:15:10 juju-e4d256-prod-github-runner-207 kernel: [ 3084.580927] ? watchdog_timer_fn+0x1be/0x220 Aug 22 06:15:10 juju-e4d256-prod-github-runner-207 kernel: [ 3084.581943] ? lockup_detector_update_enable+0x60/0x60 Aug 22 06:15:10 juju-e4d256-prod-github-runner-207 kernel: [ 3084.583005] ? __hrtimer_run_queues+0x107/0x230 Aug 22 06:15:10 juju-e4d256-prod-github-runner-207 kernel: [ 3084.584058] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 06:15:10 juju-e4d256-prod-github-runner-207 kernel: [ 3084.585081] ? hrtimer_interrupt+0x101/0x220 Aug 22 06:15:10 juju-e4d256-prod-github-runner-207 kernel: [ 3084.586101] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 06:15:10 juju-e4d256-prod-github-runner-207 kernel: [ 3084.587177] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 06:15:10 juju-e4d256-prod-github-runner-207 kernel: [ 3084.588245] Aug 22 06:15:10 juju-e4d256-prod-github-runner-207 kernel: [ 3084.589098] Aug 22 06:15:10 juju-e4d256-prod-github-runner-207 kernel: [ 3084.589939] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 06:15:10 juju-e4d256-prod-github-runner-207 kernel: [ 3084.591012] ? native_queued_spin_lock_slowpath+0xc/0x40 Aug 22 06:15:10 juju-e4d256-prod-github-runner-207 kernel: [ 3084.592089] ? _raw_spin_lock+0x22/0x30 Aug 22 06:15:10 juju-e4d256-prod-github-runner-207 kernel: [ 3084.593040] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:15:10 juju-e4d256-prod-github-runner-207 kernel: [ 3084.594059] direct_page_fault+0x206/0x310 [kvm] Aug 22 06:15:10 juju-e4d256-prod-github-runner-207 kernel: [ 3084.595079] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 06:15:10 juju-e4d256-prod-github-runner-207 kernel: [ 3084.596115] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 06:15:10 juju-e4d256-prod-github-runner-207 kernel: [ 3084.597113] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 06:15:10 juju-e4d256-prod-github-runner-207 kernel: [ 3084.598124] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 06:15:10 juju-e4d256-prod-github-runner-207 kernel: [ 3084.599112] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 06:15:10 juju-e4d256-prod-github-runner-207 kernel: [ 3084.600133] handle_exit+0x98/0x230 [kvm_amd] Aug 22 06:15:10 juju-e4d256-prod-github-runner-207 kernel: [ 3084.601154] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 06:15:10 juju-e4d256-prod-github-runner-207 kernel: [ 3084.602083] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 06:15:10 juju-e4d256-prod-github-runner-207 kernel: [ 3084.603014] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 06:15:10 juju-e4d256-prod-github-runner-207 kernel: [ 3084.603917] vcpu_run+0x62/0x2c0 [kvm] Aug 22 06:15:10 juju-e4d256-prod-github-runner-207 kernel: [ 3084.604755] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 06:15:10 juju-e4d256-prod-github-runner-207 kernel: [ 3084.605567] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 06:15:10 juju-e4d256-prod-github-runner-207 kernel: [ 3084.606616] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 06:15:10 juju-e4d256-prod-github-runner-207 kernel: [ 3084.607417] ? __seccomp_filter+0x4a/0x4a0 Aug 22 06:15:10 juju-e4d256-prod-github-runner-207 kernel: [ 3084.608184] ? __fget_files+0x86/0xc0 Aug 22 06:15:10 juju-e4d256-prod-github-runner-207 kernel: [ 3084.608888] __x64_sys_ioctl+0x95/0xd0 Aug 22 06:15:10 juju-e4d256-prod-github-runner-207 kernel: [ 3084.609580] do_syscall_64+0x5c/0xc0 Aug 22 06:15:10 juju-e4d256-prod-github-runner-207 kernel: [ 3084.610244] ? do_futex+0x162/0x1f0 Aug 22 06:15:10 juju-e4d256-prod-github-runner-207 kernel: [ 3084.610893] ? __x64_sys_futex+0x78/0x1e0 Aug 22 06:15:10 juju-e4d256-prod-github-runner-207 kernel: [ 3084.611566] ? __secure_computing+0xa9/0x120 Aug 22 06:15:10 juju-e4d256-prod-github-runner-207 kernel: [ 3084.612278] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 06:15:10 juju-e4d256-prod-github-runner-207 kernel: [ 3084.613038] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:15:10 juju-e4d256-prod-github-runner-207 kernel: [ 3084.613764] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:15:10 juju-e4d256-prod-github-runner-207 kernel: [ 3084.614540] ? do_syscall_64+0x69/0xc0 Aug 22 06:15:10 juju-e4d256-prod-github-runner-207 kernel: [ 3084.615196] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:15:10 juju-e4d256-prod-github-runner-207 kernel: [ 3084.615899] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:15:10 juju-e4d256-prod-github-runner-207 kernel: [ 3084.616621] ? do_syscall_64+0x69/0xc0 Aug 22 06:15:10 juju-e4d256-prod-github-runner-207 kernel: [ 3084.617252] ? do_syscall_64+0x69/0xc0 Aug 22 06:15:10 juju-e4d256-prod-github-runner-207 kernel: [ 3084.617872] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 06:15:10 juju-e4d256-prod-github-runner-207 kernel: [ 3084.618576] RIP: 0033:0x7faa5d0edaff Aug 22 06:15:10 juju-e4d256-prod-github-runner-207 kernel: [ 3084.619235] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 06:15:10 juju-e4d256-prod-github-runner-207 kernel: [ 3084.621251] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 06:15:10 juju-e4d256-prod-github-runner-207 kernel: [ 3084.622160] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 06:15:10 juju-e4d256-prod-github-runner-207 kernel: [ 3084.623047] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 06:15:10 juju-e4d256-prod-github-runner-207 kernel: [ 3084.623968] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 06:15:10 juju-e4d256-prod-github-runner-207 kernel: [ 3084.624856] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 06:15:10 juju-e4d256-prod-github-runner-207 kernel: [ 3084.625744] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 06:15:10 juju-e4d256-prod-github-runner-207 kernel: [ 3084.626846] Aug 22 06:15:38 juju-e4d256-prod-github-runner-207 kernel: [ 3112.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 2790s! [qemu-system-x86:6715] Aug 22 06:15:38 juju-e4d256-prod-github-runner-207 kernel: [ 3112.543281] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 06:15:38 juju-e4d256-prod-github-runner-207 kernel: [ 3112.543362] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 06:15:38 juju-e4d256-prod-github-runner-207 kernel: [ 3112.557453] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 06:15:38 juju-e4d256-prod-github-runner-207 kernel: [ 3112.558890] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 06:15:38 juju-e4d256-prod-github-runner-207 kernel: [ 3112.560295] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:15:38 juju-e4d256-prod-github-runner-207 kernel: [ 3112.561478] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 06:15:38 juju-e4d256-prod-github-runner-207 kernel: [ 3112.564367] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 06:15:38 juju-e4d256-prod-github-runner-207 kernel: [ 3112.565510] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 06:15:38 juju-e4d256-prod-github-runner-207 kernel: [ 3112.566808] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 06:15:38 juju-e4d256-prod-github-runner-207 kernel: [ 3112.568122] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 06:15:38 juju-e4d256-prod-github-runner-207 kernel: [ 3112.569419] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 06:15:38 juju-e4d256-prod-github-runner-207 kernel: [ 3112.570714] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 06:15:38 juju-e4d256-prod-github-runner-207 kernel: [ 3112.572023] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 06:15:38 juju-e4d256-prod-github-runner-207 kernel: [ 3112.573418] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 06:15:38 juju-e4d256-prod-github-runner-207 kernel: [ 3112.574632] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 06:15:38 juju-e4d256-prod-github-runner-207 kernel: [ 3112.575981] Call Trace: Aug 22 06:15:38 juju-e4d256-prod-github-runner-207 kernel: [ 3112.576948] Aug 22 06:15:38 juju-e4d256-prod-github-runner-207 kernel: [ 3112.577894] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:15:38 juju-e4d256-prod-github-runner-207 kernel: [ 3112.579017] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:15:38 juju-e4d256-prod-github-runner-207 kernel: [ 3112.580132] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:15:38 juju-e4d256-prod-github-runner-207 kernel: [ 3112.581300] ? show_regs.part.0+0x23/0x29 Aug 22 06:15:38 juju-e4d256-prod-github-runner-207 kernel: [ 3112.582374] ? show_regs.cold+0x8/0xd Aug 22 06:15:38 juju-e4d256-prod-github-runner-207 kernel: [ 3112.583431] ? watchdog_timer_fn+0x1be/0x220 Aug 22 06:15:38 juju-e4d256-prod-github-runner-207 kernel: [ 3112.584543] ? lockup_detector_update_enable+0x60/0x60 Aug 22 06:15:38 juju-e4d256-prod-github-runner-207 kernel: [ 3112.585713] ? __hrtimer_run_queues+0x107/0x230 Aug 22 06:15:38 juju-e4d256-prod-github-runner-207 kernel: [ 3112.586835] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 06:15:38 juju-e4d256-prod-github-runner-207 kernel: [ 3112.587991] ? hrtimer_interrupt+0x101/0x220 Aug 22 06:15:38 juju-e4d256-prod-github-runner-207 kernel: [ 3112.589094] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 06:15:38 juju-e4d256-prod-github-runner-207 kernel: [ 3112.590273] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 06:15:38 juju-e4d256-prod-github-runner-207 kernel: [ 3112.591422] Aug 22 06:15:38 juju-e4d256-prod-github-runner-207 kernel: [ 3112.592336] Aug 22 06:15:38 juju-e4d256-prod-github-runner-207 kernel: [ 3112.593223] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 06:15:38 juju-e4d256-prod-github-runner-207 kernel: [ 3112.594355] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:15:38 juju-e4d256-prod-github-runner-207 kernel: [ 3112.595513] ? _raw_spin_lock+0x22/0x30 Aug 22 06:15:38 juju-e4d256-prod-github-runner-207 kernel: [ 3112.596553] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:15:38 juju-e4d256-prod-github-runner-207 kernel: [ 3112.597672] direct_page_fault+0x206/0x310 [kvm] Aug 22 06:15:38 juju-e4d256-prod-github-runner-207 kernel: [ 3112.598791] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 06:15:38 juju-e4d256-prod-github-runner-207 kernel: [ 3112.599913] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 06:15:38 juju-e4d256-prod-github-runner-207 kernel: [ 3112.601015] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 06:15:38 juju-e4d256-prod-github-runner-207 kernel: [ 3112.602083] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 06:15:38 juju-e4d256-prod-github-runner-207 kernel: [ 3112.603124] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 06:15:38 juju-e4d256-prod-github-runner-207 kernel: [ 3112.604232] handle_exit+0x98/0x230 [kvm_amd] Aug 22 06:15:38 juju-e4d256-prod-github-runner-207 kernel: [ 3112.605239] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 06:15:38 juju-e4d256-prod-github-runner-207 kernel: [ 3112.606255] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 06:15:38 juju-e4d256-prod-github-runner-207 kernel: [ 3112.607282] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 06:15:38 juju-e4d256-prod-github-runner-207 kernel: [ 3112.608304] vcpu_run+0x62/0x2c0 [kvm] Aug 22 06:15:38 juju-e4d256-prod-github-runner-207 kernel: [ 3112.609193] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 06:15:38 juju-e4d256-prod-github-runner-207 kernel: [ 3112.610101] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 06:15:38 juju-e4d256-prod-github-runner-207 kernel: [ 3112.611064] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 06:15:38 juju-e4d256-prod-github-runner-207 kernel: [ 3112.611967] ? __seccomp_filter+0x4a/0x4a0 Aug 22 06:15:38 juju-e4d256-prod-github-runner-207 kernel: [ 3112.612798] ? __fget_files+0x86/0xc0 Aug 22 06:15:38 juju-e4d256-prod-github-runner-207 kernel: [ 3112.613585] __x64_sys_ioctl+0x95/0xd0 Aug 22 06:15:38 juju-e4d256-prod-github-runner-207 kernel: [ 3112.614356] do_syscall_64+0x5c/0xc0 Aug 22 06:15:38 juju-e4d256-prod-github-runner-207 kernel: [ 3112.615103] ? do_futex+0x162/0x1f0 Aug 22 06:15:38 juju-e4d256-prod-github-runner-207 kernel: [ 3112.615838] ? __x64_sys_futex+0x78/0x1e0 Aug 22 06:15:38 juju-e4d256-prod-github-runner-207 kernel: [ 3112.616598] ? __secure_computing+0xa9/0x120 Aug 22 06:15:38 juju-e4d256-prod-github-runner-207 kernel: [ 3112.617381] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 06:15:38 juju-e4d256-prod-github-runner-207 kernel: [ 3112.618256] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:15:38 juju-e4d256-prod-github-runner-207 kernel: [ 3112.619081] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:15:38 juju-e4d256-prod-github-runner-207 kernel: [ 3112.619923] ? do_syscall_64+0x69/0xc0 Aug 22 06:15:38 juju-e4d256-prod-github-runner-207 kernel: [ 3112.620646] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:15:38 juju-e4d256-prod-github-runner-207 kernel: [ 3112.621454] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:15:38 juju-e4d256-prod-github-runner-207 kernel: [ 3112.622253] ? do_syscall_64+0x69/0xc0 Aug 22 06:15:38 juju-e4d256-prod-github-runner-207 kernel: [ 3112.622958] ? do_syscall_64+0x69/0xc0 Aug 22 06:15:38 juju-e4d256-prod-github-runner-207 kernel: [ 3112.623681] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 06:15:38 juju-e4d256-prod-github-runner-207 kernel: [ 3112.624494] RIP: 0033:0x7faa5d0edaff Aug 22 06:15:38 juju-e4d256-prod-github-runner-207 kernel: [ 3112.625203] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 06:15:38 juju-e4d256-prod-github-runner-207 kernel: [ 3112.627568] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 06:15:38 juju-e4d256-prod-github-runner-207 kernel: [ 3112.628648] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 06:15:38 juju-e4d256-prod-github-runner-207 kernel: [ 3112.629682] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 06:15:38 juju-e4d256-prod-github-runner-207 kernel: [ 3112.630714] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 06:15:38 juju-e4d256-prod-github-runner-207 kernel: [ 3112.631765] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 06:15:38 juju-e4d256-prod-github-runner-207 kernel: [ 3112.632806] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 06:15:38 juju-e4d256-prod-github-runner-207 kernel: [ 3112.633844] Aug 22 06:16:06 juju-e4d256-prod-github-runner-207 kernel: [ 3140.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 2816s! [qemu-system-x86:6715] Aug 22 06:16:06 juju-e4d256-prod-github-runner-207 kernel: [ 3140.543092] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 06:16:06 juju-e4d256-prod-github-runner-207 kernel: [ 3140.543163] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 06:16:06 juju-e4d256-prod-github-runner-207 kernel: [ 3140.555234] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 06:16:06 juju-e4d256-prod-github-runner-207 kernel: [ 3140.556504] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 06:16:06 juju-e4d256-prod-github-runner-207 kernel: [ 3140.557728] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:16:06 juju-e4d256-prod-github-runner-207 kernel: [ 3140.558784] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 06:16:06 juju-e4d256-prod-github-runner-207 kernel: [ 3140.561352] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 06:16:06 juju-e4d256-prod-github-runner-207 kernel: [ 3140.562404] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 06:16:06 juju-e4d256-prod-github-runner-207 kernel: [ 3140.563594] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 06:16:06 juju-e4d256-prod-github-runner-207 kernel: [ 3140.564762] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 06:16:06 juju-e4d256-prod-github-runner-207 kernel: [ 3140.565920] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 06:16:06 juju-e4d256-prod-github-runner-207 kernel: [ 3140.567078] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 06:16:06 juju-e4d256-prod-github-runner-207 kernel: [ 3140.568254] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 06:16:06 juju-e4d256-prod-github-runner-207 kernel: [ 3140.569484] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 06:16:06 juju-e4d256-prod-github-runner-207 kernel: [ 3140.570574] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 06:16:06 juju-e4d256-prod-github-runner-207 kernel: [ 3140.571777] Call Trace: Aug 22 06:16:06 juju-e4d256-prod-github-runner-207 kernel: [ 3140.572688] Aug 22 06:16:06 juju-e4d256-prod-github-runner-207 kernel: [ 3140.573571] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:16:06 juju-e4d256-prod-github-runner-207 kernel: [ 3140.574598] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:16:06 juju-e4d256-prod-github-runner-207 kernel: [ 3140.575630] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:16:06 juju-e4d256-prod-github-runner-207 kernel: [ 3140.576702] ? show_regs.part.0+0x23/0x29 Aug 22 06:16:06 juju-e4d256-prod-github-runner-207 kernel: [ 3140.577697] ? show_regs.cold+0x8/0xd Aug 22 06:16:06 juju-e4d256-prod-github-runner-207 kernel: [ 3140.578670] ? watchdog_timer_fn+0x1be/0x220 Aug 22 06:16:06 juju-e4d256-prod-github-runner-207 kernel: [ 3140.579685] ? lockup_detector_update_enable+0x60/0x60 Aug 22 06:16:06 juju-e4d256-prod-github-runner-207 kernel: [ 3140.580750] ? __hrtimer_run_queues+0x107/0x230 Aug 22 06:16:06 juju-e4d256-prod-github-runner-207 kernel: [ 3140.581779] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 06:16:06 juju-e4d256-prod-github-runner-207 kernel: [ 3140.582800] ? hrtimer_interrupt+0x101/0x220 Aug 22 06:16:06 juju-e4d256-prod-github-runner-207 kernel: [ 3140.583818] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 06:16:06 juju-e4d256-prod-github-runner-207 kernel: [ 3140.584883] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 06:16:06 juju-e4d256-prod-github-runner-207 kernel: [ 3140.585931] Aug 22 06:16:06 juju-e4d256-prod-github-runner-207 kernel: [ 3140.586786] Aug 22 06:16:06 juju-e4d256-prod-github-runner-207 kernel: [ 3140.587643] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 06:16:06 juju-e4d256-prod-github-runner-207 kernel: [ 3140.588675] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:16:06 juju-e4d256-prod-github-runner-207 kernel: [ 3140.589712] ? _raw_spin_lock+0x22/0x30 Aug 22 06:16:06 juju-e4d256-prod-github-runner-207 kernel: [ 3140.590655] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:16:06 juju-e4d256-prod-github-runner-207 kernel: [ 3140.591681] direct_page_fault+0x206/0x310 [kvm] Aug 22 06:16:06 juju-e4d256-prod-github-runner-207 kernel: [ 3140.592706] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 06:16:06 juju-e4d256-prod-github-runner-207 kernel: [ 3140.593713] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 06:16:06 juju-e4d256-prod-github-runner-207 kernel: [ 3140.594711] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 06:16:06 juju-e4d256-prod-github-runner-207 kernel: [ 3140.595690] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 06:16:06 juju-e4d256-prod-github-runner-207 kernel: [ 3140.596641] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 06:16:06 juju-e4d256-prod-github-runner-207 kernel: [ 3140.597617] handle_exit+0x98/0x230 [kvm_amd] Aug 22 06:16:06 juju-e4d256-prod-github-runner-207 kernel: [ 3140.598509] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 06:16:06 juju-e4d256-prod-github-runner-207 kernel: [ 3140.599446] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 06:16:06 juju-e4d256-prod-github-runner-207 kernel: [ 3140.600376] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 06:16:06 juju-e4d256-prod-github-runner-207 kernel: [ 3140.601277] vcpu_run+0x62/0x2c0 [kvm] Aug 22 06:16:06 juju-e4d256-prod-github-runner-207 kernel: [ 3140.602092] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 06:16:06 juju-e4d256-prod-github-runner-207 kernel: [ 3140.602900] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 06:16:06 juju-e4d256-prod-github-runner-207 kernel: [ 3140.603765] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 06:16:06 juju-e4d256-prod-github-runner-207 kernel: [ 3140.604562] ? __seccomp_filter+0x4a/0x4a0 Aug 22 06:16:06 juju-e4d256-prod-github-runner-207 kernel: [ 3140.605308] ? __fget_files+0x86/0xc0 Aug 22 06:16:06 juju-e4d256-prod-github-runner-207 kernel: [ 3140.606012] __x64_sys_ioctl+0x95/0xd0 Aug 22 06:16:06 juju-e4d256-prod-github-runner-207 kernel: [ 3140.606705] do_syscall_64+0x5c/0xc0 Aug 22 06:16:06 juju-e4d256-prod-github-runner-207 kernel: [ 3140.607380] ? do_futex+0x162/0x1f0 Aug 22 06:16:06 juju-e4d256-prod-github-runner-207 kernel: [ 3140.608029] ? __x64_sys_futex+0x78/0x1e0 Aug 22 06:16:06 juju-e4d256-prod-github-runner-207 kernel: [ 3140.608701] ? __secure_computing+0xa9/0x120 Aug 22 06:16:06 juju-e4d256-prod-github-runner-207 kernel: [ 3140.609391] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 06:16:06 juju-e4d256-prod-github-runner-207 kernel: [ 3140.610154] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:16:06 juju-e4d256-prod-github-runner-207 kernel: [ 3140.610876] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:16:06 juju-e4d256-prod-github-runner-207 kernel: [ 3140.611609] ? do_syscall_64+0x69/0xc0 Aug 22 06:16:06 juju-e4d256-prod-github-runner-207 kernel: [ 3140.612259] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:16:06 juju-e4d256-prod-github-runner-207 kernel: [ 3140.612968] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:16:06 juju-e4d256-prod-github-runner-207 kernel: [ 3140.613662] ? do_syscall_64+0x69/0xc0 Aug 22 06:16:06 juju-e4d256-prod-github-runner-207 kernel: [ 3140.614284] ? do_syscall_64+0x69/0xc0 Aug 22 06:16:06 juju-e4d256-prod-github-runner-207 kernel: [ 3140.614909] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 06:16:06 juju-e4d256-prod-github-runner-207 kernel: [ 3140.615618] RIP: 0033:0x7faa5d0edaff Aug 22 06:16:06 juju-e4d256-prod-github-runner-207 kernel: [ 3140.616244] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 06:16:06 juju-e4d256-prod-github-runner-207 kernel: [ 3140.618237] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 06:16:06 juju-e4d256-prod-github-runner-207 kernel: [ 3140.619147] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 06:16:06 juju-e4d256-prod-github-runner-207 kernel: [ 3140.620043] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 06:16:06 juju-e4d256-prod-github-runner-207 kernel: [ 3140.620938] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 06:16:06 juju-e4d256-prod-github-runner-207 kernel: [ 3140.621827] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 06:16:06 juju-e4d256-prod-github-runner-207 kernel: [ 3140.622713] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 06:16:06 juju-e4d256-prod-github-runner-207 kernel: [ 3140.623797] Aug 22 06:16:34 juju-e4d256-prod-github-runner-207 kernel: [ 3168.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 2842s! [qemu-system-x86:6715] Aug 22 06:16:34 juju-e4d256-prod-github-runner-207 kernel: [ 3168.543373] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 06:16:34 juju-e4d256-prod-github-runner-207 kernel: [ 3168.543599] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 06:16:34 juju-e4d256-prod-github-runner-207 kernel: [ 3168.555664] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 06:16:34 juju-e4d256-prod-github-runner-207 kernel: [ 3168.556921] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 06:16:34 juju-e4d256-prod-github-runner-207 kernel: [ 3168.558141] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:16:34 juju-e4d256-prod-github-runner-207 kernel: [ 3168.559203] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 06:16:34 juju-e4d256-prod-github-runner-207 kernel: [ 3168.561772] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 06:16:34 juju-e4d256-prod-github-runner-207 kernel: [ 3168.562824] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 06:16:34 juju-e4d256-prod-github-runner-207 kernel: [ 3168.564001] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 06:16:34 juju-e4d256-prod-github-runner-207 kernel: [ 3168.565157] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 06:16:34 juju-e4d256-prod-github-runner-207 kernel: [ 3168.566307] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 06:16:34 juju-e4d256-prod-github-runner-207 kernel: [ 3168.567485] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 06:16:34 juju-e4d256-prod-github-runner-207 kernel: [ 3168.568648] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 06:16:34 juju-e4d256-prod-github-runner-207 kernel: [ 3168.569873] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 06:16:34 juju-e4d256-prod-github-runner-207 kernel: [ 3168.570982] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 06:16:34 juju-e4d256-prod-github-runner-207 kernel: [ 3168.572167] Call Trace: Aug 22 06:16:34 juju-e4d256-prod-github-runner-207 kernel: [ 3168.573080] Aug 22 06:16:34 juju-e4d256-prod-github-runner-207 kernel: [ 3168.573972] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:16:34 juju-e4d256-prod-github-runner-207 kernel: [ 3168.575013] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:16:34 juju-e4d256-prod-github-runner-207 kernel: [ 3168.576030] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:16:34 juju-e4d256-prod-github-runner-207 kernel: [ 3168.577118] ? show_regs.part.0+0x23/0x29 Aug 22 06:16:34 juju-e4d256-prod-github-runner-207 kernel: [ 3168.578115] ? show_regs.cold+0x8/0xd Aug 22 06:16:34 juju-e4d256-prod-github-runner-207 kernel: [ 3168.579100] ? watchdog_timer_fn+0x1be/0x220 Aug 22 06:16:34 juju-e4d256-prod-github-runner-207 kernel: [ 3168.580110] ? lockup_detector_update_enable+0x60/0x60 Aug 22 06:16:34 juju-e4d256-prod-github-runner-207 kernel: [ 3168.581172] ? __hrtimer_run_queues+0x107/0x230 Aug 22 06:16:34 juju-e4d256-prod-github-runner-207 kernel: [ 3168.582206] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 06:16:34 juju-e4d256-prod-github-runner-207 kernel: [ 3168.583260] ? hrtimer_interrupt+0x101/0x220 Aug 22 06:16:34 juju-e4d256-prod-github-runner-207 kernel: [ 3168.584285] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 06:16:34 juju-e4d256-prod-github-runner-207 kernel: [ 3168.585349] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 06:16:34 juju-e4d256-prod-github-runner-207 kernel: [ 3168.586422] Aug 22 06:16:34 juju-e4d256-prod-github-runner-207 kernel: [ 3168.587292] Aug 22 06:16:34 juju-e4d256-prod-github-runner-207 kernel: [ 3168.588135] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 06:16:34 juju-e4d256-prod-github-runner-207 kernel: [ 3168.589181] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:16:34 juju-e4d256-prod-github-runner-207 kernel: [ 3168.590219] ? _raw_spin_lock+0x22/0x30 Aug 22 06:16:34 juju-e4d256-prod-github-runner-207 kernel: [ 3168.591172] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:16:34 juju-e4d256-prod-github-runner-207 kernel: [ 3168.592185] direct_page_fault+0x206/0x310 [kvm] Aug 22 06:16:34 juju-e4d256-prod-github-runner-207 kernel: [ 3168.593215] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 06:16:34 juju-e4d256-prod-github-runner-207 kernel: [ 3168.594226] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 06:16:34 juju-e4d256-prod-github-runner-207 kernel: [ 3168.595239] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 06:16:34 juju-e4d256-prod-github-runner-207 kernel: [ 3168.596228] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 06:16:34 juju-e4d256-prod-github-runner-207 kernel: [ 3168.597171] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 06:16:34 juju-e4d256-prod-github-runner-207 kernel: [ 3168.598151] handle_exit+0x98/0x230 [kvm_amd] Aug 22 06:16:34 juju-e4d256-prod-github-runner-207 kernel: [ 3168.599059] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 06:16:34 juju-e4d256-prod-github-runner-207 kernel: [ 3168.599971] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 06:16:34 juju-e4d256-prod-github-runner-207 kernel: [ 3168.600891] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 06:16:34 juju-e4d256-prod-github-runner-207 kernel: [ 3168.601790] vcpu_run+0x62/0x2c0 [kvm] Aug 22 06:16:34 juju-e4d256-prod-github-runner-207 kernel: [ 3168.602602] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 06:16:34 juju-e4d256-prod-github-runner-207 kernel: [ 3168.603424] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 06:16:34 juju-e4d256-prod-github-runner-207 kernel: [ 3168.604277] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 06:16:34 juju-e4d256-prod-github-runner-207 kernel: [ 3168.605070] ? __seccomp_filter+0x4a/0x4a0 Aug 22 06:16:34 juju-e4d256-prod-github-runner-207 kernel: [ 3168.605809] ? __fget_files+0x86/0xc0 Aug 22 06:16:34 juju-e4d256-prod-github-runner-207 kernel: [ 3168.606509] __x64_sys_ioctl+0x95/0xd0 Aug 22 06:16:34 juju-e4d256-prod-github-runner-207 kernel: [ 3168.607209] do_syscall_64+0x5c/0xc0 Aug 22 06:16:34 juju-e4d256-prod-github-runner-207 kernel: [ 3168.607869] ? do_futex+0x162/0x1f0 Aug 22 06:16:34 juju-e4d256-prod-github-runner-207 kernel: [ 3168.608521] ? __x64_sys_futex+0x78/0x1e0 Aug 22 06:16:34 juju-e4d256-prod-github-runner-207 kernel: [ 3168.609191] ? __secure_computing+0xa9/0x120 Aug 22 06:16:34 juju-e4d256-prod-github-runner-207 kernel: [ 3168.609878] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 06:16:34 juju-e4d256-prod-github-runner-207 kernel: [ 3168.610632] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:16:34 juju-e4d256-prod-github-runner-207 kernel: [ 3168.611355] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:16:34 juju-e4d256-prod-github-runner-207 kernel: [ 3168.612094] ? do_syscall_64+0x69/0xc0 Aug 22 06:16:34 juju-e4d256-prod-github-runner-207 kernel: [ 3168.612763] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:16:34 juju-e4d256-prod-github-runner-207 kernel: [ 3168.613485] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:16:34 juju-e4d256-prod-github-runner-207 kernel: [ 3168.614189] ? do_syscall_64+0x69/0xc0 Aug 22 06:16:34 juju-e4d256-prod-github-runner-207 kernel: [ 3168.614809] ? do_syscall_64+0x69/0xc0 Aug 22 06:16:34 juju-e4d256-prod-github-runner-207 kernel: [ 3168.615451] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 06:16:34 juju-e4d256-prod-github-runner-207 kernel: [ 3168.616151] RIP: 0033:0x7faa5d0edaff Aug 22 06:16:34 juju-e4d256-prod-github-runner-207 kernel: [ 3168.616790] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 06:16:34 juju-e4d256-prod-github-runner-207 kernel: [ 3168.618769] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 06:16:34 juju-e4d256-prod-github-runner-207 kernel: [ 3168.619683] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 06:16:34 juju-e4d256-prod-github-runner-207 kernel: [ 3168.620566] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 06:16:34 juju-e4d256-prod-github-runner-207 kernel: [ 3168.621459] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 06:16:34 juju-e4d256-prod-github-runner-207 kernel: [ 3168.622340] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 06:16:34 juju-e4d256-prod-github-runner-207 kernel: [ 3168.623230] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 06:16:34 juju-e4d256-prod-github-runner-207 kernel: [ 3168.624123] Aug 22 06:17:02 juju-e4d256-prod-github-runner-207 kernel: [ 3196.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 2869s! [qemu-system-x86:6715] Aug 22 06:17:02 juju-e4d256-prod-github-runner-207 kernel: [ 3196.543676] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 06:17:02 juju-e4d256-prod-github-runner-207 kernel: [ 3196.543819] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 06:17:02 juju-e4d256-prod-github-runner-207 kernel: [ 3196.556078] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 06:17:02 juju-e4d256-prod-github-runner-207 kernel: [ 3196.557339] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 06:17:02 juju-e4d256-prod-github-runner-207 kernel: [ 3196.558554] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:17:02 juju-e4d256-prod-github-runner-207 kernel: [ 3196.559644] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 06:17:02 juju-e4d256-prod-github-runner-207 kernel: [ 3196.562196] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 06:17:02 juju-e4d256-prod-github-runner-207 kernel: [ 3196.563251] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 06:17:02 juju-e4d256-prod-github-runner-207 kernel: [ 3196.564423] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 06:17:02 juju-e4d256-prod-github-runner-207 kernel: [ 3196.565584] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 06:17:02 juju-e4d256-prod-github-runner-207 kernel: [ 3196.566754] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 06:17:02 juju-e4d256-prod-github-runner-207 kernel: [ 3196.567917] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 06:17:02 juju-e4d256-prod-github-runner-207 kernel: [ 3196.569079] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 06:17:02 juju-e4d256-prod-github-runner-207 kernel: [ 3196.570327] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 06:17:02 juju-e4d256-prod-github-runner-207 kernel: [ 3196.571432] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 06:17:02 juju-e4d256-prod-github-runner-207 kernel: [ 3196.572627] Call Trace: Aug 22 06:17:02 juju-e4d256-prod-github-runner-207 kernel: [ 3196.573538] Aug 22 06:17:02 juju-e4d256-prod-github-runner-207 kernel: [ 3196.574439] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:17:02 juju-e4d256-prod-github-runner-207 kernel: [ 3196.575489] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:17:02 juju-e4d256-prod-github-runner-207 kernel: [ 3196.576509] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:17:02 juju-e4d256-prod-github-runner-207 kernel: [ 3196.577580] ? show_regs.part.0+0x23/0x29 Aug 22 06:17:02 juju-e4d256-prod-github-runner-207 kernel: [ 3196.578587] ? show_regs.cold+0x8/0xd Aug 22 06:17:02 juju-e4d256-prod-github-runner-207 kernel: [ 3196.579570] ? watchdog_timer_fn+0x1be/0x220 Aug 22 06:17:02 juju-e4d256-prod-github-runner-207 kernel: [ 3196.580583] ? lockup_detector_update_enable+0x60/0x60 Aug 22 06:17:02 juju-e4d256-prod-github-runner-207 kernel: [ 3196.581648] ? __hrtimer_run_queues+0x107/0x230 Aug 22 06:17:02 juju-e4d256-prod-github-runner-207 kernel: [ 3196.582694] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 06:17:02 juju-e4d256-prod-github-runner-207 kernel: [ 3196.583718] ? hrtimer_interrupt+0x101/0x220 Aug 22 06:17:02 juju-e4d256-prod-github-runner-207 kernel: [ 3196.584754] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 06:17:02 juju-e4d256-prod-github-runner-207 kernel: [ 3196.585847] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 06:17:02 juju-e4d256-prod-github-runner-207 kernel: [ 3196.586965] Aug 22 06:17:02 juju-e4d256-prod-github-runner-207 kernel: [ 3196.587819] Aug 22 06:17:02 juju-e4d256-prod-github-runner-207 kernel: [ 3196.588655] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 06:17:02 juju-e4d256-prod-github-runner-207 kernel: [ 3196.589688] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:17:02 juju-e4d256-prod-github-runner-207 kernel: [ 3196.590773] ? _raw_spin_lock+0x22/0x30 Aug 22 06:17:02 juju-e4d256-prod-github-runner-207 kernel: [ 3196.591723] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:17:02 juju-e4d256-prod-github-runner-207 kernel: [ 3196.592890] direct_page_fault+0x206/0x310 [kvm] Aug 22 06:17:02 juju-e4d256-prod-github-runner-207 kernel: [ 3196.593912] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 06:17:02 juju-e4d256-prod-github-runner-207 kernel: [ 3196.594925] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 06:17:02 juju-e4d256-prod-github-runner-207 kernel: [ 3196.595942] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 06:17:02 juju-e4d256-prod-github-runner-207 kernel: [ 3196.596929] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 06:17:02 juju-e4d256-prod-github-runner-207 kernel: [ 3196.597873] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 06:17:02 juju-e4d256-prod-github-runner-207 kernel: [ 3196.598873] handle_exit+0x98/0x230 [kvm_amd] Aug 22 06:17:02 juju-e4d256-prod-github-runner-207 kernel: [ 3196.599764] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 06:17:02 juju-e4d256-prod-github-runner-207 kernel: [ 3196.600694] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 06:17:02 juju-e4d256-prod-github-runner-207 kernel: [ 3196.601623] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 06:17:02 juju-e4d256-prod-github-runner-207 kernel: [ 3196.602525] vcpu_run+0x62/0x2c0 [kvm] Aug 22 06:17:02 juju-e4d256-prod-github-runner-207 kernel: [ 3196.603342] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 06:17:02 juju-e4d256-prod-github-runner-207 kernel: [ 3196.604149] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 06:17:02 juju-e4d256-prod-github-runner-207 kernel: [ 3196.605013] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 06:17:02 juju-e4d256-prod-github-runner-207 kernel: [ 3196.605833] ? __seccomp_filter+0x4a/0x4a0 Aug 22 06:17:02 juju-e4d256-prod-github-runner-207 kernel: [ 3196.606591] ? __fget_files+0x86/0xc0 Aug 22 06:17:02 juju-e4d256-prod-github-runner-207 kernel: [ 3196.607299] __x64_sys_ioctl+0x95/0xd0 Aug 22 06:17:02 juju-e4d256-prod-github-runner-207 kernel: [ 3196.607990] do_syscall_64+0x5c/0xc0 Aug 22 06:17:02 juju-e4d256-prod-github-runner-207 kernel: [ 3196.608653] ? do_futex+0x162/0x1f0 Aug 22 06:17:02 juju-e4d256-prod-github-runner-207 kernel: [ 3196.609304] ? __x64_sys_futex+0x78/0x1e0 Aug 22 06:17:02 juju-e4d256-prod-github-runner-207 kernel: [ 3196.609976] ? __secure_computing+0xa9/0x120 Aug 22 06:17:02 juju-e4d256-prod-github-runner-207 kernel: [ 3196.610689] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 06:17:02 juju-e4d256-prod-github-runner-207 kernel: [ 3196.611453] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:17:02 juju-e4d256-prod-github-runner-207 kernel: [ 3196.612177] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:17:02 juju-e4d256-prod-github-runner-207 kernel: [ 3196.612894] ? do_syscall_64+0x69/0xc0 Aug 22 06:17:02 juju-e4d256-prod-github-runner-207 kernel: [ 3196.613543] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:17:02 juju-e4d256-prod-github-runner-207 kernel: [ 3196.614248] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:17:02 juju-e4d256-prod-github-runner-207 kernel: [ 3196.614953] ? do_syscall_64+0x69/0xc0 Aug 22 06:17:02 juju-e4d256-prod-github-runner-207 kernel: [ 3196.615577] ? do_syscall_64+0x69/0xc0 Aug 22 06:17:02 juju-e4d256-prod-github-runner-207 kernel: [ 3196.616207] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 06:17:02 juju-e4d256-prod-github-runner-207 kernel: [ 3196.616916] RIP: 0033:0x7faa5d0edaff Aug 22 06:17:02 juju-e4d256-prod-github-runner-207 kernel: [ 3196.617562] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 06:17:02 juju-e4d256-prod-github-runner-207 kernel: [ 3196.619559] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 06:17:02 juju-e4d256-prod-github-runner-207 kernel: [ 3196.620472] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 06:17:02 juju-e4d256-prod-github-runner-207 kernel: [ 3196.621373] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 06:17:02 juju-e4d256-prod-github-runner-207 kernel: [ 3196.622267] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 06:17:02 juju-e4d256-prod-github-runner-207 kernel: [ 3196.623160] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 06:17:02 juju-e4d256-prod-github-runner-207 kernel: [ 3196.624049] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 06:17:02 juju-e4d256-prod-github-runner-207 kernel: [ 3196.624947] Aug 22 06:17:30 juju-e4d256-prod-github-runner-207 kernel: [ 3224.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 2895s! [qemu-system-x86:6715] Aug 22 06:17:30 juju-e4d256-prod-github-runner-207 kernel: [ 3224.543129] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 06:17:30 juju-e4d256-prod-github-runner-207 kernel: [ 3224.543200] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 06:17:30 juju-e4d256-prod-github-runner-207 kernel: [ 3224.555621] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 06:17:30 juju-e4d256-prod-github-runner-207 kernel: [ 3224.556899] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 06:17:30 juju-e4d256-prod-github-runner-207 kernel: [ 3224.558158] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:17:30 juju-e4d256-prod-github-runner-207 kernel: [ 3224.559262] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 06:17:30 juju-e4d256-prod-github-runner-207 kernel: [ 3224.561885] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 06:17:30 juju-e4d256-prod-github-runner-207 kernel: [ 3224.562962] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 06:17:30 juju-e4d256-prod-github-runner-207 kernel: [ 3224.564152] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 06:17:30 juju-e4d256-prod-github-runner-207 kernel: [ 3224.565345] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 06:17:30 juju-e4d256-prod-github-runner-207 kernel: [ 3224.566551] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 06:17:30 juju-e4d256-prod-github-runner-207 kernel: [ 3224.567736] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 06:17:30 juju-e4d256-prod-github-runner-207 kernel: [ 3224.568938] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 06:17:30 juju-e4d256-prod-github-runner-207 kernel: [ 3224.570188] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 06:17:30 juju-e4d256-prod-github-runner-207 kernel: [ 3224.571319] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 06:17:30 juju-e4d256-prod-github-runner-207 kernel: [ 3224.572524] Call Trace: Aug 22 06:17:30 juju-e4d256-prod-github-runner-207 kernel: [ 3224.573438] Aug 22 06:17:30 juju-e4d256-prod-github-runner-207 kernel: [ 3224.574353] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:17:30 juju-e4d256-prod-github-runner-207 kernel: [ 3224.575398] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:17:30 juju-e4d256-prod-github-runner-207 kernel: [ 3224.576441] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:17:30 juju-e4d256-prod-github-runner-207 kernel: [ 3224.577540] ? show_regs.part.0+0x23/0x29 Aug 22 06:17:30 juju-e4d256-prod-github-runner-207 kernel: [ 3224.578557] ? show_regs.cold+0x8/0xd Aug 22 06:17:30 juju-e4d256-prod-github-runner-207 kernel: [ 3224.579544] ? watchdog_timer_fn+0x1be/0x220 Aug 22 06:17:30 juju-e4d256-prod-github-runner-207 kernel: [ 3224.580571] ? lockup_detector_update_enable+0x60/0x60 Aug 22 06:17:30 juju-e4d256-prod-github-runner-207 kernel: [ 3224.581659] ? __hrtimer_run_queues+0x107/0x230 Aug 22 06:17:30 juju-e4d256-prod-github-runner-207 kernel: [ 3224.582737] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 06:17:30 juju-e4d256-prod-github-runner-207 kernel: [ 3224.583776] ? hrtimer_interrupt+0x101/0x220 Aug 22 06:17:30 juju-e4d256-prod-github-runner-207 kernel: [ 3224.584808] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 06:17:30 juju-e4d256-prod-github-runner-207 kernel: [ 3224.585887] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 06:17:30 juju-e4d256-prod-github-runner-207 kernel: [ 3224.586972] Aug 22 06:17:30 juju-e4d256-prod-github-runner-207 kernel: [ 3224.587834] Aug 22 06:17:30 juju-e4d256-prod-github-runner-207 kernel: [ 3224.588685] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 06:17:30 juju-e4d256-prod-github-runner-207 kernel: [ 3224.589749] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:17:30 juju-e4d256-prod-github-runner-207 kernel: [ 3224.590818] ? _raw_spin_lock+0x22/0x30 Aug 22 06:17:30 juju-e4d256-prod-github-runner-207 kernel: [ 3224.591785] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:17:30 juju-e4d256-prod-github-runner-207 kernel: [ 3224.592827] direct_page_fault+0x206/0x310 [kvm] Aug 22 06:17:30 juju-e4d256-prod-github-runner-207 kernel: [ 3224.593867] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 06:17:30 juju-e4d256-prod-github-runner-207 kernel: [ 3224.594916] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 06:17:30 juju-e4d256-prod-github-runner-207 kernel: [ 3224.595955] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 06:17:30 juju-e4d256-prod-github-runner-207 kernel: [ 3224.596942] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 06:17:30 juju-e4d256-prod-github-runner-207 kernel: [ 3224.597996] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 06:17:30 juju-e4d256-prod-github-runner-207 kernel: [ 3224.599013] handle_exit+0x98/0x230 [kvm_amd] Aug 22 06:17:30 juju-e4d256-prod-github-runner-207 kernel: [ 3224.599920] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 06:17:30 juju-e4d256-prod-github-runner-207 kernel: [ 3224.600852] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 06:17:30 juju-e4d256-prod-github-runner-207 kernel: [ 3224.601796] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 06:17:30 juju-e4d256-prod-github-runner-207 kernel: [ 3224.602728] vcpu_run+0x62/0x2c0 [kvm] Aug 22 06:17:30 juju-e4d256-prod-github-runner-207 kernel: [ 3224.603553] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 06:17:30 juju-e4d256-prod-github-runner-207 kernel: [ 3224.604380] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 06:17:30 juju-e4d256-prod-github-runner-207 kernel: [ 3224.605249] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 06:17:30 juju-e4d256-prod-github-runner-207 kernel: [ 3224.606058] ? __seccomp_filter+0x4a/0x4a0 Aug 22 06:17:30 juju-e4d256-prod-github-runner-207 kernel: [ 3224.606821] ? __fget_files+0x86/0xc0 Aug 22 06:17:30 juju-e4d256-prod-github-runner-207 kernel: [ 3224.607530] __x64_sys_ioctl+0x95/0xd0 Aug 22 06:17:30 juju-e4d256-prod-github-runner-207 kernel: [ 3224.608228] do_syscall_64+0x5c/0xc0 Aug 22 06:17:30 juju-e4d256-prod-github-runner-207 kernel: [ 3224.608903] ? do_futex+0x162/0x1f0 Aug 22 06:17:30 juju-e4d256-prod-github-runner-207 kernel: [ 3224.609564] ? __x64_sys_futex+0x78/0x1e0 Aug 22 06:17:30 juju-e4d256-prod-github-runner-207 kernel: [ 3224.610263] ? __secure_computing+0xa9/0x120 Aug 22 06:17:30 juju-e4d256-prod-github-runner-207 kernel: [ 3224.610969] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 06:17:30 juju-e4d256-prod-github-runner-207 kernel: [ 3224.611753] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:17:30 juju-e4d256-prod-github-runner-207 kernel: [ 3224.612485] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:17:30 juju-e4d256-prod-github-runner-207 kernel: [ 3224.613219] ? do_syscall_64+0x69/0xc0 Aug 22 06:17:30 juju-e4d256-prod-github-runner-207 kernel: [ 3224.613871] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:17:30 juju-e4d256-prod-github-runner-207 kernel: [ 3224.614605] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:17:30 juju-e4d256-prod-github-runner-207 kernel: [ 3224.615314] ? do_syscall_64+0x69/0xc0 Aug 22 06:17:30 juju-e4d256-prod-github-runner-207 kernel: [ 3224.615951] ? do_syscall_64+0x69/0xc0 Aug 22 06:17:30 juju-e4d256-prod-github-runner-207 kernel: [ 3224.616581] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 06:17:30 juju-e4d256-prod-github-runner-207 kernel: [ 3224.617307] RIP: 0033:0x7faa5d0edaff Aug 22 06:17:30 juju-e4d256-prod-github-runner-207 kernel: [ 3224.617946] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 06:17:30 juju-e4d256-prod-github-runner-207 kernel: [ 3224.620017] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 06:17:30 juju-e4d256-prod-github-runner-207 kernel: [ 3224.620953] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 06:17:30 juju-e4d256-prod-github-runner-207 kernel: [ 3224.621858] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 06:17:30 juju-e4d256-prod-github-runner-207 kernel: [ 3224.622794] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 06:17:30 juju-e4d256-prod-github-runner-207 kernel: [ 3224.623712] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 06:17:30 juju-e4d256-prod-github-runner-207 kernel: [ 3224.624621] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 06:17:30 juju-e4d256-prod-github-runner-207 kernel: [ 3224.625541] Aug 22 06:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 3237.404705] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 06:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 3237.405677] rcu: 1-....: (777613 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=378838 Aug 22 06:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 3237.406794] (t=780051 jiffies g=23269 q=11926) Aug 22 06:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 3237.407569] NMI backtrace for cpu 1 Aug 22 06:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 3237.408277] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 06:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 3237.409388] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 06:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 3237.410465] Call Trace: Aug 22 06:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 3237.411139] Aug 22 06:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 3237.411780] show_stack+0x52/0x5c Aug 22 06:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 3237.412512] dump_stack_lvl+0x4a/0x63 Aug 22 06:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 3237.413290] dump_stack+0x10/0x16 Aug 22 06:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 3237.414017] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 06:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 3237.414817] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 06:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 3237.415643] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 06:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 3237.416466] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 06:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 3237.417284] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 06:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 3237.418120] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 06:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 3237.418904] print_cpu_stall.cold+0x2f/0xe2 Aug 22 06:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 3237.419668] ? timekeeping_update+0xf7/0x150 Aug 22 06:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 3237.420454] check_cpu_stall+0x109/0x270 Aug 22 06:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 3237.421218] rcu_sched_clock_irq+0x9a/0x250 Aug 22 06:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 3237.421977] update_process_times+0x94/0xd0 Aug 22 06:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 3237.422761] tick_sched_handle+0x29/0x70 Aug 22 06:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 3237.423515] tick_sched_timer+0x8c/0xc0 Aug 22 06:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 3237.424261] ? tick_nohz_handler+0xb0/0xb0 Aug 22 06:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 3237.425018] __hrtimer_run_queues+0x107/0x230 Aug 22 06:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 3237.425788] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 06:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 3237.426583] hrtimer_interrupt+0x101/0x220 Aug 22 06:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 3237.427340] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 06:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 3237.428147] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 06:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 3237.428960] Aug 22 06:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 3237.429593] Aug 22 06:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 3237.430265] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 06:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 3237.431086] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 3237.431968] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 06:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 3237.434214] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 06:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 3237.435100] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 06:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 3237.436089] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 06:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 3237.437059] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 06:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 3237.438022] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 06:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 3237.439006] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 06:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 3237.439957] ? _raw_spin_lock+0x22/0x30 Aug 22 06:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 3237.440718] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 3237.441550] direct_page_fault+0x206/0x310 [kvm] Aug 22 06:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 3237.442403] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 06:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 3237.443247] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 06:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 3237.444088] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 06:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 3237.444920] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 06:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 3237.445706] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 06:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 3237.446551] handle_exit+0x98/0x230 [kvm_amd] Aug 22 06:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 3237.447309] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 06:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 3237.448093] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 06:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 3237.448895] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 06:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 3237.449694] vcpu_run+0x62/0x2c0 [kvm] Aug 22 06:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 3237.450427] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 06:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 3237.451167] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 06:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 3237.451965] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 06:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 3237.452721] ? __seccomp_filter+0x4a/0x4a0 Aug 22 06:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 3237.453449] ? __fget_files+0x86/0xc0 Aug 22 06:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 3237.454189] __x64_sys_ioctl+0x95/0xd0 Aug 22 06:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 3237.454896] do_syscall_64+0x5c/0xc0 Aug 22 06:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 3237.455577] ? do_futex+0x162/0x1f0 Aug 22 06:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 3237.456247] ? __x64_sys_futex+0x78/0x1e0 Aug 22 06:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 3237.456951] ? __secure_computing+0xa9/0x120 Aug 22 06:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 3237.457665] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 06:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 3237.458465] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 3237.459379] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 3237.460140] ? do_syscall_64+0x69/0xc0 Aug 22 06:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 3237.460920] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 3237.461703] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 3237.462478] ? do_syscall_64+0x69/0xc0 Aug 22 06:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 3237.463171] ? do_syscall_64+0x69/0xc0 Aug 22 06:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 3237.463883] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 06:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 3237.464665] RIP: 0033:0x7faa5d0edaff Aug 22 06:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 3237.465357] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 06:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 3237.467479] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 06:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 3237.468437] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 06:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 3237.469403] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 06:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 3237.470389] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 06:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 3237.471338] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 06:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 3237.472261] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 06:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 3237.473172] Aug 22 06:18:10 juju-e4d256-prod-github-runner-207 kernel: [ 3264.541982] watchdog: BUG: soft lockup - CPU#1 stuck for 2932s! [qemu-system-x86:6715] Aug 22 06:18:10 juju-e4d256-prod-github-runner-207 kernel: [ 3264.543855] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 06:18:10 juju-e4d256-prod-github-runner-207 kernel: [ 3264.544118] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 06:18:10 juju-e4d256-prod-github-runner-207 kernel: [ 3264.556688] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 06:18:10 juju-e4d256-prod-github-runner-207 kernel: [ 3264.557991] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 06:18:10 juju-e4d256-prod-github-runner-207 kernel: [ 3264.559236] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:18:10 juju-e4d256-prod-github-runner-207 kernel: [ 3264.560334] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 06:18:10 juju-e4d256-prod-github-runner-207 kernel: [ 3264.563008] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 06:18:10 juju-e4d256-prod-github-runner-207 kernel: [ 3264.564091] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 06:18:10 juju-e4d256-prod-github-runner-207 kernel: [ 3264.565299] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 06:18:10 juju-e4d256-prod-github-runner-207 kernel: [ 3264.566542] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 06:18:10 juju-e4d256-prod-github-runner-207 kernel: [ 3264.567727] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 06:18:10 juju-e4d256-prod-github-runner-207 kernel: [ 3264.568917] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 06:18:10 juju-e4d256-prod-github-runner-207 kernel: [ 3264.570121] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 06:18:10 juju-e4d256-prod-github-runner-207 kernel: [ 3264.571385] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 06:18:10 juju-e4d256-prod-github-runner-207 kernel: [ 3264.572495] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 06:18:10 juju-e4d256-prod-github-runner-207 kernel: [ 3264.573693] Call Trace: Aug 22 06:18:10 juju-e4d256-prod-github-runner-207 kernel: [ 3264.574638] Aug 22 06:18:10 juju-e4d256-prod-github-runner-207 kernel: [ 3264.575564] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:18:10 juju-e4d256-prod-github-runner-207 kernel: [ 3264.576608] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:18:10 juju-e4d256-prod-github-runner-207 kernel: [ 3264.577640] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:18:10 juju-e4d256-prod-github-runner-207 kernel: [ 3264.578783] ? show_regs.part.0+0x23/0x29 Aug 22 06:18:10 juju-e4d256-prod-github-runner-207 kernel: [ 3264.579826] ? show_regs.cold+0x8/0xd Aug 22 06:18:10 juju-e4d256-prod-github-runner-207 kernel: [ 3264.580825] ? watchdog_timer_fn+0x1be/0x220 Aug 22 06:18:10 juju-e4d256-prod-github-runner-207 kernel: [ 3264.581877] ? lockup_detector_update_enable+0x60/0x60 Aug 22 06:18:10 juju-e4d256-prod-github-runner-207 kernel: [ 3264.583216] ? __hrtimer_run_queues+0x107/0x230 Aug 22 06:18:10 juju-e4d256-prod-github-runner-207 kernel: [ 3264.584496] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 06:18:10 juju-e4d256-prod-github-runner-207 kernel: [ 3264.585813] ? hrtimer_interrupt+0x101/0x220 Aug 22 06:18:10 juju-e4d256-prod-github-runner-207 kernel: [ 3264.587095] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 06:18:10 juju-e4d256-prod-github-runner-207 kernel: [ 3264.588457] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 06:18:10 juju-e4d256-prod-github-runner-207 kernel: [ 3264.589886] Aug 22 06:18:10 juju-e4d256-prod-github-runner-207 kernel: [ 3264.590776] Aug 22 06:18:10 juju-e4d256-prod-github-runner-207 kernel: [ 3264.591625] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 06:18:10 juju-e4d256-prod-github-runner-207 kernel: [ 3264.592799] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:18:10 juju-e4d256-prod-github-runner-207 kernel: [ 3264.593988] ? _raw_spin_lock+0x22/0x30 Aug 22 06:18:10 juju-e4d256-prod-github-runner-207 kernel: [ 3264.595021] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:18:10 juju-e4d256-prod-github-runner-207 kernel: [ 3264.596162] direct_page_fault+0x206/0x310 [kvm] Aug 22 06:18:10 juju-e4d256-prod-github-runner-207 kernel: [ 3264.597291] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 06:18:10 juju-e4d256-prod-github-runner-207 kernel: [ 3264.598417] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 06:18:10 juju-e4d256-prod-github-runner-207 kernel: [ 3264.599517] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 06:18:10 juju-e4d256-prod-github-runner-207 kernel: [ 3264.600634] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 06:18:10 juju-e4d256-prod-github-runner-207 kernel: [ 3264.601683] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 06:18:10 juju-e4d256-prod-github-runner-207 kernel: [ 3264.602898] handle_exit+0x98/0x230 [kvm_amd] Aug 22 06:18:10 juju-e4d256-prod-github-runner-207 kernel: [ 3264.603895] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 06:18:10 juju-e4d256-prod-github-runner-207 kernel: [ 3264.605080] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 06:18:10 juju-e4d256-prod-github-runner-207 kernel: [ 3264.606202] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 06:18:10 juju-e4d256-prod-github-runner-207 kernel: [ 3264.607216] vcpu_run+0x62/0x2c0 [kvm] Aug 22 06:18:10 juju-e4d256-prod-github-runner-207 kernel: [ 3264.608191] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 06:18:10 juju-e4d256-prod-github-runner-207 kernel: [ 3264.609184] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 06:18:10 juju-e4d256-prod-github-runner-207 kernel: [ 3264.610110] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 06:18:10 juju-e4d256-prod-github-runner-207 kernel: [ 3264.610913] ? __seccomp_filter+0x4a/0x4a0 Aug 22 06:18:10 juju-e4d256-prod-github-runner-207 kernel: [ 3264.611745] ? __fget_files+0x86/0xc0 Aug 22 06:18:10 juju-e4d256-prod-github-runner-207 kernel: [ 3264.612528] __x64_sys_ioctl+0x95/0xd0 Aug 22 06:18:10 juju-e4d256-prod-github-runner-207 kernel: [ 3264.613297] do_syscall_64+0x5c/0xc0 Aug 22 06:18:10 juju-e4d256-prod-github-runner-207 kernel: [ 3264.614070] ? do_futex+0x162/0x1f0 Aug 22 06:18:10 juju-e4d256-prod-github-runner-207 kernel: [ 3264.614795] ? __x64_sys_futex+0x78/0x1e0 Aug 22 06:18:10 juju-e4d256-prod-github-runner-207 kernel: [ 3264.615553] ? __secure_computing+0xa9/0x120 Aug 22 06:18:10 juju-e4d256-prod-github-runner-207 kernel: [ 3264.616339] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 06:18:10 juju-e4d256-prod-github-runner-207 kernel: [ 3264.617211] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:18:10 juju-e4d256-prod-github-runner-207 kernel: [ 3264.618068] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:18:10 juju-e4d256-prod-github-runner-207 kernel: [ 3264.618890] ? do_syscall_64+0x69/0xc0 Aug 22 06:18:10 juju-e4d256-prod-github-runner-207 kernel: [ 3264.619618] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:18:10 juju-e4d256-prod-github-runner-207 kernel: [ 3264.620421] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:18:10 juju-e4d256-prod-github-runner-207 kernel: [ 3264.621221] ? do_syscall_64+0x69/0xc0 Aug 22 06:18:10 juju-e4d256-prod-github-runner-207 kernel: [ 3264.621955] ? do_syscall_64+0x69/0xc0 Aug 22 06:18:10 juju-e4d256-prod-github-runner-207 kernel: [ 3264.622662] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 06:18:10 juju-e4d256-prod-github-runner-207 kernel: [ 3264.623474] RIP: 0033:0x7faa5d0edaff Aug 22 06:18:10 juju-e4d256-prod-github-runner-207 kernel: [ 3264.624217] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 06:18:10 juju-e4d256-prod-github-runner-207 kernel: [ 3264.626604] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 06:18:10 juju-e4d256-prod-github-runner-207 kernel: [ 3264.627669] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 06:18:10 juju-e4d256-prod-github-runner-207 kernel: [ 3264.628700] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 06:18:10 juju-e4d256-prod-github-runner-207 kernel: [ 3264.629752] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 06:18:10 juju-e4d256-prod-github-runner-207 kernel: [ 3264.630782] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 06:18:10 juju-e4d256-prod-github-runner-207 kernel: [ 3264.631816] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 06:18:10 juju-e4d256-prod-github-runner-207 kernel: [ 3264.632851] Aug 22 06:18:38 juju-e4d256-prod-github-runner-207 kernel: [ 3292.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 2958s! [qemu-system-x86:6715] Aug 22 06:18:38 juju-e4d256-prod-github-runner-207 kernel: [ 3292.543118] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 06:18:38 juju-e4d256-prod-github-runner-207 kernel: [ 3292.543186] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 06:18:38 juju-e4d256-prod-github-runner-207 kernel: [ 3292.555356] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 06:18:38 juju-e4d256-prod-github-runner-207 kernel: [ 3292.556636] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 06:18:38 juju-e4d256-prod-github-runner-207 kernel: [ 3292.557873] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:18:38 juju-e4d256-prod-github-runner-207 kernel: [ 3292.558930] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 06:18:38 juju-e4d256-prod-github-runner-207 kernel: [ 3292.561502] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 06:18:38 juju-e4d256-prod-github-runner-207 kernel: [ 3292.562550] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 06:18:38 juju-e4d256-prod-github-runner-207 kernel: [ 3292.563714] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 06:18:38 juju-e4d256-prod-github-runner-207 kernel: [ 3292.564874] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 06:18:38 juju-e4d256-prod-github-runner-207 kernel: [ 3292.566055] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 06:18:38 juju-e4d256-prod-github-runner-207 kernel: [ 3292.567243] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 06:18:38 juju-e4d256-prod-github-runner-207 kernel: [ 3292.568415] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 06:18:38 juju-e4d256-prod-github-runner-207 kernel: [ 3292.569673] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 06:18:38 juju-e4d256-prod-github-runner-207 kernel: [ 3292.570772] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 06:18:38 juju-e4d256-prod-github-runner-207 kernel: [ 3292.571968] Call Trace: Aug 22 06:18:38 juju-e4d256-prod-github-runner-207 kernel: [ 3292.572880] Aug 22 06:18:38 juju-e4d256-prod-github-runner-207 kernel: [ 3292.573774] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:18:38 juju-e4d256-prod-github-runner-207 kernel: [ 3292.574805] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:18:38 juju-e4d256-prod-github-runner-207 kernel: [ 3292.575827] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:18:38 juju-e4d256-prod-github-runner-207 kernel: [ 3292.576915] ? show_regs.part.0+0x23/0x29 Aug 22 06:18:38 juju-e4d256-prod-github-runner-207 kernel: [ 3292.577927] ? show_regs.cold+0x8/0xd Aug 22 06:18:38 juju-e4d256-prod-github-runner-207 kernel: [ 3292.578899] ? watchdog_timer_fn+0x1be/0x220 Aug 22 06:18:38 juju-e4d256-prod-github-runner-207 kernel: [ 3292.579908] ? lockup_detector_update_enable+0x60/0x60 Aug 22 06:18:38 juju-e4d256-prod-github-runner-207 kernel: [ 3292.580972] ? __hrtimer_run_queues+0x107/0x230 Aug 22 06:18:38 juju-e4d256-prod-github-runner-207 kernel: [ 3292.582015] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 06:18:38 juju-e4d256-prod-github-runner-207 kernel: [ 3292.583049] ? hrtimer_interrupt+0x101/0x220 Aug 22 06:18:38 juju-e4d256-prod-github-runner-207 kernel: [ 3292.584063] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 06:18:38 juju-e4d256-prod-github-runner-207 kernel: [ 3292.585132] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 06:18:38 juju-e4d256-prod-github-runner-207 kernel: [ 3292.586198] Aug 22 06:18:38 juju-e4d256-prod-github-runner-207 kernel: [ 3292.587054] Aug 22 06:18:38 juju-e4d256-prod-github-runner-207 kernel: [ 3292.587891] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 06:18:38 juju-e4d256-prod-github-runner-207 kernel: [ 3292.588930] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:18:38 juju-e4d256-prod-github-runner-207 kernel: [ 3292.589989] ? _raw_spin_lock+0x22/0x30 Aug 22 06:18:38 juju-e4d256-prod-github-runner-207 kernel: [ 3292.590939] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:18:38 juju-e4d256-prod-github-runner-207 kernel: [ 3292.592292] direct_page_fault+0x206/0x310 [kvm] Aug 22 06:18:38 juju-e4d256-prod-github-runner-207 kernel: [ 3292.593755] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 06:18:38 juju-e4d256-prod-github-runner-207 kernel: [ 3292.595132] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 06:18:38 juju-e4d256-prod-github-runner-207 kernel: [ 3292.596465] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 06:18:38 juju-e4d256-prod-github-runner-207 kernel: [ 3292.597491] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 06:18:38 juju-e4d256-prod-github-runner-207 kernel: [ 3292.598642] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 06:18:38 juju-e4d256-prod-github-runner-207 kernel: [ 3292.599630] handle_exit+0x98/0x230 [kvm_amd] Aug 22 06:18:38 juju-e4d256-prod-github-runner-207 kernel: [ 3292.600857] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 06:18:38 juju-e4d256-prod-github-runner-207 kernel: [ 3292.601842] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 06:18:38 juju-e4d256-prod-github-runner-207 kernel: [ 3292.602774] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 06:18:38 juju-e4d256-prod-github-runner-207 kernel: [ 3292.603682] vcpu_run+0x62/0x2c0 [kvm] Aug 22 06:18:38 juju-e4d256-prod-github-runner-207 kernel: [ 3292.604493] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 06:18:38 juju-e4d256-prod-github-runner-207 kernel: [ 3292.605305] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 06:18:38 juju-e4d256-prod-github-runner-207 kernel: [ 3292.606177] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 06:18:38 juju-e4d256-prod-github-runner-207 kernel: [ 3292.606976] ? __seccomp_filter+0x4a/0x4a0 Aug 22 06:18:38 juju-e4d256-prod-github-runner-207 kernel: [ 3292.607724] ? __fget_files+0x86/0xc0 Aug 22 06:18:38 juju-e4d256-prod-github-runner-207 kernel: [ 3292.608432] __x64_sys_ioctl+0x95/0xd0 Aug 22 06:18:38 juju-e4d256-prod-github-runner-207 kernel: [ 3292.609127] do_syscall_64+0x5c/0xc0 Aug 22 06:18:38 juju-e4d256-prod-github-runner-207 kernel: [ 3292.609807] ? do_futex+0x162/0x1f0 Aug 22 06:18:38 juju-e4d256-prod-github-runner-207 kernel: [ 3292.610459] ? __x64_sys_futex+0x78/0x1e0 Aug 22 06:18:38 juju-e4d256-prod-github-runner-207 kernel: [ 3292.611135] ? __secure_computing+0xa9/0x120 Aug 22 06:18:38 juju-e4d256-prod-github-runner-207 kernel: [ 3292.611828] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 06:18:38 juju-e4d256-prod-github-runner-207 kernel: [ 3292.612592] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:18:38 juju-e4d256-prod-github-runner-207 kernel: [ 3292.613323] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:18:38 juju-e4d256-prod-github-runner-207 kernel: [ 3292.614057] ? do_syscall_64+0x69/0xc0 Aug 22 06:18:38 juju-e4d256-prod-github-runner-207 kernel: [ 3292.614706] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:18:38 juju-e4d256-prod-github-runner-207 kernel: [ 3292.615587] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:18:38 juju-e4d256-prod-github-runner-207 kernel: [ 3292.616293] ? do_syscall_64+0x69/0xc0 Aug 22 06:18:38 juju-e4d256-prod-github-runner-207 kernel: [ 3292.616919] ? do_syscall_64+0x69/0xc0 Aug 22 06:18:38 juju-e4d256-prod-github-runner-207 kernel: [ 3292.617554] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 06:18:38 juju-e4d256-prod-github-runner-207 kernel: [ 3292.618491] RIP: 0033:0x7faa5d0edaff Aug 22 06:18:38 juju-e4d256-prod-github-runner-207 kernel: [ 3292.619378] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 06:18:38 juju-e4d256-prod-github-runner-207 kernel: [ 3292.621884] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 06:18:38 juju-e4d256-prod-github-runner-207 kernel: [ 3292.622809] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 06:18:38 juju-e4d256-prod-github-runner-207 kernel: [ 3292.623705] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 06:18:38 juju-e4d256-prod-github-runner-207 kernel: [ 3292.624599] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 06:18:38 juju-e4d256-prod-github-runner-207 kernel: [ 3292.625504] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 06:18:38 juju-e4d256-prod-github-runner-207 kernel: [ 3292.626396] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 06:18:38 juju-e4d256-prod-github-runner-207 kernel: [ 3292.627295] Aug 22 06:19:06 juju-e4d256-prod-github-runner-207 kernel: [ 3320.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 2984s! [qemu-system-x86:6715] Aug 22 06:19:06 juju-e4d256-prod-github-runner-207 kernel: [ 3320.543090] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 06:19:06 juju-e4d256-prod-github-runner-207 kernel: [ 3320.543162] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 06:19:06 juju-e4d256-prod-github-runner-207 kernel: [ 3320.555325] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 06:19:06 juju-e4d256-prod-github-runner-207 kernel: [ 3320.556590] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 06:19:06 juju-e4d256-prod-github-runner-207 kernel: [ 3320.557846] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:19:06 juju-e4d256-prod-github-runner-207 kernel: [ 3320.558907] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 06:19:06 juju-e4d256-prod-github-runner-207 kernel: [ 3320.561457] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 06:19:06 juju-e4d256-prod-github-runner-207 kernel: [ 3320.562504] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 06:19:06 juju-e4d256-prod-github-runner-207 kernel: [ 3320.563664] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 06:19:06 juju-e4d256-prod-github-runner-207 kernel: [ 3320.564897] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 06:19:06 juju-e4d256-prod-github-runner-207 kernel: [ 3320.566079] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 06:19:06 juju-e4d256-prod-github-runner-207 kernel: [ 3320.567238] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 06:19:06 juju-e4d256-prod-github-runner-207 kernel: [ 3320.568408] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 06:19:06 juju-e4d256-prod-github-runner-207 kernel: [ 3320.569658] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 06:19:06 juju-e4d256-prod-github-runner-207 kernel: [ 3320.570761] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 06:19:06 juju-e4d256-prod-github-runner-207 kernel: [ 3320.571951] Call Trace: Aug 22 06:19:06 juju-e4d256-prod-github-runner-207 kernel: [ 3320.572861] Aug 22 06:19:06 juju-e4d256-prod-github-runner-207 kernel: [ 3320.573756] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:19:06 juju-e4d256-prod-github-runner-207 kernel: [ 3320.574786] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:19:06 juju-e4d256-prod-github-runner-207 kernel: [ 3320.575805] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:19:06 juju-e4d256-prod-github-runner-207 kernel: [ 3320.576878] ? show_regs.part.0+0x23/0x29 Aug 22 06:19:06 juju-e4d256-prod-github-runner-207 kernel: [ 3320.577880] ? show_regs.cold+0x8/0xd Aug 22 06:19:06 juju-e4d256-prod-github-runner-207 kernel: [ 3320.578848] ? watchdog_timer_fn+0x1be/0x220 Aug 22 06:19:06 juju-e4d256-prod-github-runner-207 kernel: [ 3320.579855] ? lockup_detector_update_enable+0x60/0x60 Aug 22 06:19:06 juju-e4d256-prod-github-runner-207 kernel: [ 3320.580921] ? __hrtimer_run_queues+0x107/0x230 Aug 22 06:19:06 juju-e4d256-prod-github-runner-207 kernel: [ 3320.581961] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 06:19:06 juju-e4d256-prod-github-runner-207 kernel: [ 3320.582982] ? hrtimer_interrupt+0x101/0x220 Aug 22 06:19:06 juju-e4d256-prod-github-runner-207 kernel: [ 3320.583993] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 06:19:06 juju-e4d256-prod-github-runner-207 kernel: [ 3320.585070] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 06:19:06 juju-e4d256-prod-github-runner-207 kernel: [ 3320.586112] Aug 22 06:19:06 juju-e4d256-prod-github-runner-207 kernel: [ 3320.586968] Aug 22 06:19:06 juju-e4d256-prod-github-runner-207 kernel: [ 3320.587806] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 06:19:06 juju-e4d256-prod-github-runner-207 kernel: [ 3320.588836] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:19:06 juju-e4d256-prod-github-runner-207 kernel: [ 3320.589891] ? _raw_spin_lock+0x22/0x30 Aug 22 06:19:06 juju-e4d256-prod-github-runner-207 kernel: [ 3320.590835] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:19:06 juju-e4d256-prod-github-runner-207 kernel: [ 3320.591851] direct_page_fault+0x206/0x310 [kvm] Aug 22 06:19:06 juju-e4d256-prod-github-runner-207 kernel: [ 3320.592872] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 06:19:06 juju-e4d256-prod-github-runner-207 kernel: [ 3320.593890] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 06:19:06 juju-e4d256-prod-github-runner-207 kernel: [ 3320.594887] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 06:19:06 juju-e4d256-prod-github-runner-207 kernel: [ 3320.595861] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 06:19:06 juju-e4d256-prod-github-runner-207 kernel: [ 3320.596805] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 06:19:06 juju-e4d256-prod-github-runner-207 kernel: [ 3320.597823] handle_exit+0x98/0x230 [kvm_amd] Aug 22 06:19:06 juju-e4d256-prod-github-runner-207 kernel: [ 3320.598723] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 06:19:06 juju-e4d256-prod-github-runner-207 kernel: [ 3320.599637] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 06:19:06 juju-e4d256-prod-github-runner-207 kernel: [ 3320.600556] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 06:19:06 juju-e4d256-prod-github-runner-207 kernel: [ 3320.601473] vcpu_run+0x62/0x2c0 [kvm] Aug 22 06:19:06 juju-e4d256-prod-github-runner-207 kernel: [ 3320.602282] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 06:19:06 juju-e4d256-prod-github-runner-207 kernel: [ 3320.603092] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 06:19:06 juju-e4d256-prod-github-runner-207 kernel: [ 3320.603943] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 06:19:06 juju-e4d256-prod-github-runner-207 kernel: [ 3320.604738] ? __seccomp_filter+0x4a/0x4a0 Aug 22 06:19:06 juju-e4d256-prod-github-runner-207 kernel: [ 3320.605494] ? __fget_files+0x86/0xc0 Aug 22 06:19:06 juju-e4d256-prod-github-runner-207 kernel: [ 3320.606205] __x64_sys_ioctl+0x95/0xd0 Aug 22 06:19:06 juju-e4d256-prod-github-runner-207 kernel: [ 3320.606896] do_syscall_64+0x5c/0xc0 Aug 22 06:19:06 juju-e4d256-prod-github-runner-207 kernel: [ 3320.607565] ? do_futex+0x162/0x1f0 Aug 22 06:19:06 juju-e4d256-prod-github-runner-207 kernel: [ 3320.608212] ? __x64_sys_futex+0x78/0x1e0 Aug 22 06:19:06 juju-e4d256-prod-github-runner-207 kernel: [ 3320.608888] ? __secure_computing+0xa9/0x120 Aug 22 06:19:06 juju-e4d256-prod-github-runner-207 kernel: [ 3320.609583] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 06:19:06 juju-e4d256-prod-github-runner-207 kernel: [ 3320.610342] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:19:06 juju-e4d256-prod-github-runner-207 kernel: [ 3320.611061] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:19:06 juju-e4d256-prod-github-runner-207 kernel: [ 3320.611777] ? do_syscall_64+0x69/0xc0 Aug 22 06:19:06 juju-e4d256-prod-github-runner-207 kernel: [ 3320.612420] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:19:06 juju-e4d256-prod-github-runner-207 kernel: [ 3320.613136] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:19:06 juju-e4d256-prod-github-runner-207 kernel: [ 3320.613831] ? do_syscall_64+0x69/0xc0 Aug 22 06:19:06 juju-e4d256-prod-github-runner-207 kernel: [ 3320.614455] ? do_syscall_64+0x69/0xc0 Aug 22 06:19:06 juju-e4d256-prod-github-runner-207 kernel: [ 3320.615081] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 06:19:06 juju-e4d256-prod-github-runner-207 kernel: [ 3320.615785] RIP: 0033:0x7faa5d0edaff Aug 22 06:19:06 juju-e4d256-prod-github-runner-207 kernel: [ 3320.616411] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 06:19:06 juju-e4d256-prod-github-runner-207 kernel: [ 3320.618407] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 06:19:06 juju-e4d256-prod-github-runner-207 kernel: [ 3320.619316] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 06:19:06 juju-e4d256-prod-github-runner-207 kernel: [ 3320.620209] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 06:19:06 juju-e4d256-prod-github-runner-207 kernel: [ 3320.621109] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 06:19:06 juju-e4d256-prod-github-runner-207 kernel: [ 3320.621996] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 06:19:06 juju-e4d256-prod-github-runner-207 kernel: [ 3320.622881] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 06:19:06 juju-e4d256-prod-github-runner-207 kernel: [ 3320.623771] Aug 22 06:19:34 juju-e4d256-prod-github-runner-207 kernel: [ 3348.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 3010s! [qemu-system-x86:6715] Aug 22 06:19:34 juju-e4d256-prod-github-runner-207 kernel: [ 3348.543187] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 06:19:34 juju-e4d256-prod-github-runner-207 kernel: [ 3348.543331] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 06:19:34 juju-e4d256-prod-github-runner-207 kernel: [ 3348.555407] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 06:19:34 juju-e4d256-prod-github-runner-207 kernel: [ 3348.556668] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 06:19:34 juju-e4d256-prod-github-runner-207 kernel: [ 3348.557898] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:19:34 juju-e4d256-prod-github-runner-207 kernel: [ 3348.558956] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 06:19:34 juju-e4d256-prod-github-runner-207 kernel: [ 3348.561531] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 06:19:34 juju-e4d256-prod-github-runner-207 kernel: [ 3348.562580] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 06:19:34 juju-e4d256-prod-github-runner-207 kernel: [ 3348.563746] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 06:19:34 juju-e4d256-prod-github-runner-207 kernel: [ 3348.564921] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 06:19:34 juju-e4d256-prod-github-runner-207 kernel: [ 3348.566080] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 06:19:34 juju-e4d256-prod-github-runner-207 kernel: [ 3348.567240] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 06:19:34 juju-e4d256-prod-github-runner-207 kernel: [ 3348.568404] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 06:19:34 juju-e4d256-prod-github-runner-207 kernel: [ 3348.569662] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 06:19:34 juju-e4d256-prod-github-runner-207 kernel: [ 3348.570759] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 06:19:34 juju-e4d256-prod-github-runner-207 kernel: [ 3348.571975] Call Trace: Aug 22 06:19:34 juju-e4d256-prod-github-runner-207 kernel: [ 3348.572922] Aug 22 06:19:34 juju-e4d256-prod-github-runner-207 kernel: [ 3348.573807] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:19:34 juju-e4d256-prod-github-runner-207 kernel: [ 3348.574838] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:19:34 juju-e4d256-prod-github-runner-207 kernel: [ 3348.575858] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:19:34 juju-e4d256-prod-github-runner-207 kernel: [ 3348.576981] ? show_regs.part.0+0x23/0x29 Aug 22 06:19:34 juju-e4d256-prod-github-runner-207 kernel: [ 3348.577984] ? show_regs.cold+0x8/0xd Aug 22 06:19:34 juju-e4d256-prod-github-runner-207 kernel: [ 3348.578954] ? watchdog_timer_fn+0x1be/0x220 Aug 22 06:19:34 juju-e4d256-prod-github-runner-207 kernel: [ 3348.579960] ? lockup_detector_update_enable+0x60/0x60 Aug 22 06:19:34 juju-e4d256-prod-github-runner-207 kernel: [ 3348.581034] ? __hrtimer_run_queues+0x107/0x230 Aug 22 06:19:34 juju-e4d256-prod-github-runner-207 kernel: [ 3348.582070] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 06:19:34 juju-e4d256-prod-github-runner-207 kernel: [ 3348.583099] ? hrtimer_interrupt+0x101/0x220 Aug 22 06:19:34 juju-e4d256-prod-github-runner-207 kernel: [ 3348.584114] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 06:19:34 juju-e4d256-prod-github-runner-207 kernel: [ 3348.585205] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 06:19:34 juju-e4d256-prod-github-runner-207 kernel: [ 3348.586248] Aug 22 06:19:34 juju-e4d256-prod-github-runner-207 kernel: [ 3348.587099] Aug 22 06:19:34 juju-e4d256-prod-github-runner-207 kernel: [ 3348.587934] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 06:19:34 juju-e4d256-prod-github-runner-207 kernel: [ 3348.588984] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:19:34 juju-e4d256-prod-github-runner-207 kernel: [ 3348.590023] ? _raw_spin_lock+0x22/0x30 Aug 22 06:19:34 juju-e4d256-prod-github-runner-207 kernel: [ 3348.591028] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:19:34 juju-e4d256-prod-github-runner-207 kernel: [ 3348.592042] direct_page_fault+0x206/0x310 [kvm] Aug 22 06:19:34 juju-e4d256-prod-github-runner-207 kernel: [ 3348.593107] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 06:19:34 juju-e4d256-prod-github-runner-207 kernel: [ 3348.594239] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 06:19:34 juju-e4d256-prod-github-runner-207 kernel: [ 3348.595237] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 06:19:34 juju-e4d256-prod-github-runner-207 kernel: [ 3348.596227] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 06:19:34 juju-e4d256-prod-github-runner-207 kernel: [ 3348.597185] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 06:19:34 juju-e4d256-prod-github-runner-207 kernel: [ 3348.598161] handle_exit+0x98/0x230 [kvm_amd] Aug 22 06:19:34 juju-e4d256-prod-github-runner-207 kernel: [ 3348.599050] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 06:19:34 juju-e4d256-prod-github-runner-207 kernel: [ 3348.599962] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 06:19:34 juju-e4d256-prod-github-runner-207 kernel: [ 3348.600896] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 06:19:34 juju-e4d256-prod-github-runner-207 kernel: [ 3348.601811] vcpu_run+0x62/0x2c0 [kvm] Aug 22 06:19:34 juju-e4d256-prod-github-runner-207 kernel: [ 3348.602625] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 06:19:34 juju-e4d256-prod-github-runner-207 kernel: [ 3348.603432] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 06:19:34 juju-e4d256-prod-github-runner-207 kernel: [ 3348.604289] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 06:19:34 juju-e4d256-prod-github-runner-207 kernel: [ 3348.605137] ? __seccomp_filter+0x4a/0x4a0 Aug 22 06:19:34 juju-e4d256-prod-github-runner-207 kernel: [ 3348.605926] ? __fget_files+0x86/0xc0 Aug 22 06:19:34 juju-e4d256-prod-github-runner-207 kernel: [ 3348.606648] __x64_sys_ioctl+0x95/0xd0 Aug 22 06:19:34 juju-e4d256-prod-github-runner-207 kernel: [ 3348.607350] do_syscall_64+0x5c/0xc0 Aug 22 06:19:34 juju-e4d256-prod-github-runner-207 kernel: [ 3348.608033] ? do_futex+0x162/0x1f0 Aug 22 06:19:34 juju-e4d256-prod-github-runner-207 kernel: [ 3348.608682] ? __x64_sys_futex+0x78/0x1e0 Aug 22 06:19:34 juju-e4d256-prod-github-runner-207 kernel: [ 3348.609372] ? __secure_computing+0xa9/0x120 Aug 22 06:19:34 juju-e4d256-prod-github-runner-207 kernel: [ 3348.610067] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 06:19:34 juju-e4d256-prod-github-runner-207 kernel: [ 3348.610827] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:19:34 juju-e4d256-prod-github-runner-207 kernel: [ 3348.611548] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:19:34 juju-e4d256-prod-github-runner-207 kernel: [ 3348.612267] ? do_syscall_64+0x69/0xc0 Aug 22 06:19:34 juju-e4d256-prod-github-runner-207 kernel: [ 3348.612923] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:19:34 juju-e4d256-prod-github-runner-207 kernel: [ 3348.613628] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:19:34 juju-e4d256-prod-github-runner-207 kernel: [ 3348.614328] ? do_syscall_64+0x69/0xc0 Aug 22 06:19:34 juju-e4d256-prod-github-runner-207 kernel: [ 3348.614953] ? do_syscall_64+0x69/0xc0 Aug 22 06:19:34 juju-e4d256-prod-github-runner-207 kernel: [ 3348.615575] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 06:19:34 juju-e4d256-prod-github-runner-207 kernel: [ 3348.616284] RIP: 0033:0x7faa5d0edaff Aug 22 06:19:34 juju-e4d256-prod-github-runner-207 kernel: [ 3348.616917] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 06:19:34 juju-e4d256-prod-github-runner-207 kernel: [ 3348.618898] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 06:19:34 juju-e4d256-prod-github-runner-207 kernel: [ 3348.619815] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 06:19:34 juju-e4d256-prod-github-runner-207 kernel: [ 3348.620703] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 06:19:34 juju-e4d256-prod-github-runner-207 kernel: [ 3348.621609] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 06:19:34 juju-e4d256-prod-github-runner-207 kernel: [ 3348.622508] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 06:19:34 juju-e4d256-prod-github-runner-207 kernel: [ 3348.623413] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 06:19:34 juju-e4d256-prod-github-runner-207 kernel: [ 3348.624308] Aug 22 06:20:02 juju-e4d256-prod-github-runner-207 kernel: [ 3376.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 3036s! [qemu-system-x86:6715] Aug 22 06:20:02 juju-e4d256-prod-github-runner-207 kernel: [ 3376.543891] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 06:20:02 juju-e4d256-prod-github-runner-207 kernel: [ 3376.544095] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 06:20:02 juju-e4d256-prod-github-runner-207 kernel: [ 3376.558664] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 06:20:02 juju-e4d256-prod-github-runner-207 kernel: [ 3376.560106] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 06:20:02 juju-e4d256-prod-github-runner-207 kernel: [ 3376.561550] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:20:02 juju-e4d256-prod-github-runner-207 kernel: [ 3376.563002] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 06:20:02 juju-e4d256-prod-github-runner-207 kernel: [ 3376.565860] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 06:20:02 juju-e4d256-prod-github-runner-207 kernel: [ 3376.567008] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 06:20:02 juju-e4d256-prod-github-runner-207 kernel: [ 3376.568319] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 06:20:02 juju-e4d256-prod-github-runner-207 kernel: [ 3376.569643] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 06:20:02 juju-e4d256-prod-github-runner-207 kernel: [ 3376.570950] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 06:20:02 juju-e4d256-prod-github-runner-207 kernel: [ 3376.572251] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 06:20:02 juju-e4d256-prod-github-runner-207 kernel: [ 3376.573583] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 06:20:02 juju-e4d256-prod-github-runner-207 kernel: [ 3376.574989] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 06:20:02 juju-e4d256-prod-github-runner-207 kernel: [ 3376.576227] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 06:20:02 juju-e4d256-prod-github-runner-207 kernel: [ 3376.577589] Call Trace: Aug 22 06:20:02 juju-e4d256-prod-github-runner-207 kernel: [ 3376.578713] Aug 22 06:20:02 juju-e4d256-prod-github-runner-207 kernel: [ 3376.579699] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:20:02 juju-e4d256-prod-github-runner-207 kernel: [ 3376.580770] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:20:02 juju-e4d256-prod-github-runner-207 kernel: [ 3376.581893] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:20:02 juju-e4d256-prod-github-runner-207 kernel: [ 3376.583009] ? show_regs.part.0+0x23/0x29 Aug 22 06:20:02 juju-e4d256-prod-github-runner-207 kernel: [ 3376.584007] ? show_regs.cold+0x8/0xd Aug 22 06:20:02 juju-e4d256-prod-github-runner-207 kernel: [ 3376.585005] ? watchdog_timer_fn+0x1be/0x220 Aug 22 06:20:02 juju-e4d256-prod-github-runner-207 kernel: [ 3376.586014] ? lockup_detector_update_enable+0x60/0x60 Aug 22 06:20:02 juju-e4d256-prod-github-runner-207 kernel: [ 3376.587078] ? __hrtimer_run_queues+0x107/0x230 Aug 22 06:20:02 juju-e4d256-prod-github-runner-207 kernel: [ 3376.588111] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 06:20:02 juju-e4d256-prod-github-runner-207 kernel: [ 3376.589161] ? hrtimer_interrupt+0x101/0x220 Aug 22 06:20:02 juju-e4d256-prod-github-runner-207 kernel: [ 3376.590181] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 06:20:02 juju-e4d256-prod-github-runner-207 kernel: [ 3376.591253] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 06:20:02 juju-e4d256-prod-github-runner-207 kernel: [ 3376.592308] Aug 22 06:20:02 juju-e4d256-prod-github-runner-207 kernel: [ 3376.593181] Aug 22 06:20:02 juju-e4d256-prod-github-runner-207 kernel: [ 3376.594022] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 06:20:02 juju-e4d256-prod-github-runner-207 kernel: [ 3376.595071] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:20:02 juju-e4d256-prod-github-runner-207 kernel: [ 3376.596120] ? _raw_spin_lock+0x22/0x30 Aug 22 06:20:02 juju-e4d256-prod-github-runner-207 kernel: [ 3376.597118] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:20:02 juju-e4d256-prod-github-runner-207 kernel: [ 3376.598166] direct_page_fault+0x206/0x310 [kvm] Aug 22 06:20:02 juju-e4d256-prod-github-runner-207 kernel: [ 3376.599211] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 06:20:02 juju-e4d256-prod-github-runner-207 kernel: [ 3376.600256] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 06:20:02 juju-e4d256-prod-github-runner-207 kernel: [ 3376.601297] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 06:20:02 juju-e4d256-prod-github-runner-207 kernel: [ 3376.602296] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 06:20:02 juju-e4d256-prod-github-runner-207 kernel: [ 3376.603250] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 06:20:02 juju-e4d256-prod-github-runner-207 kernel: [ 3376.604234] handle_exit+0x98/0x230 [kvm_amd] Aug 22 06:20:02 juju-e4d256-prod-github-runner-207 kernel: [ 3376.605162] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 06:20:02 juju-e4d256-prod-github-runner-207 kernel: [ 3376.606078] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 06:20:02 juju-e4d256-prod-github-runner-207 kernel: [ 3376.607003] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 06:20:02 juju-e4d256-prod-github-runner-207 kernel: [ 3376.607908] vcpu_run+0x62/0x2c0 [kvm] Aug 22 06:20:02 juju-e4d256-prod-github-runner-207 kernel: [ 3376.608750] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 06:20:02 juju-e4d256-prod-github-runner-207 kernel: [ 3376.609765] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 06:20:02 juju-e4d256-prod-github-runner-207 kernel: [ 3376.610691] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 06:20:02 juju-e4d256-prod-github-runner-207 kernel: [ 3376.611497] ? __seccomp_filter+0x4a/0x4a0 Aug 22 06:20:02 juju-e4d256-prod-github-runner-207 kernel: [ 3376.612281] ? __fget_files+0x86/0xc0 Aug 22 06:20:02 juju-e4d256-prod-github-runner-207 kernel: [ 3376.613026] __x64_sys_ioctl+0x95/0xd0 Aug 22 06:20:02 juju-e4d256-prod-github-runner-207 kernel: [ 3376.613726] do_syscall_64+0x5c/0xc0 Aug 22 06:20:02 juju-e4d256-prod-github-runner-207 kernel: [ 3376.614394] ? do_futex+0x162/0x1f0 Aug 22 06:20:02 juju-e4d256-prod-github-runner-207 kernel: [ 3376.615047] ? __x64_sys_futex+0x78/0x1e0 Aug 22 06:20:02 juju-e4d256-prod-github-runner-207 kernel: [ 3376.615726] ? __secure_computing+0xa9/0x120 Aug 22 06:20:02 juju-e4d256-prod-github-runner-207 kernel: [ 3376.616537] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 06:20:02 juju-e4d256-prod-github-runner-207 kernel: [ 3376.617322] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:20:02 juju-e4d256-prod-github-runner-207 kernel: [ 3376.620247] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:20:02 juju-e4d256-prod-github-runner-207 kernel: [ 3376.620999] ? do_syscall_64+0x69/0xc0 Aug 22 06:20:02 juju-e4d256-prod-github-runner-207 kernel: [ 3376.621653] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:20:02 juju-e4d256-prod-github-runner-207 kernel: [ 3376.622366] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:20:02 juju-e4d256-prod-github-runner-207 kernel: [ 3376.623065] ? do_syscall_64+0x69/0xc0 Aug 22 06:20:02 juju-e4d256-prod-github-runner-207 kernel: [ 3376.623711] ? do_syscall_64+0x69/0xc0 Aug 22 06:20:02 juju-e4d256-prod-github-runner-207 kernel: [ 3376.624347] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 06:20:02 juju-e4d256-prod-github-runner-207 kernel: [ 3376.625084] RIP: 0033:0x7faa5d0edaff Aug 22 06:20:02 juju-e4d256-prod-github-runner-207 kernel: [ 3376.625749] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 06:20:02 juju-e4d256-prod-github-runner-207 kernel: [ 3376.627771] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 06:20:02 juju-e4d256-prod-github-runner-207 kernel: [ 3376.628749] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 06:20:02 juju-e4d256-prod-github-runner-207 kernel: [ 3376.629659] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 06:20:02 juju-e4d256-prod-github-runner-207 kernel: [ 3376.630552] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 06:20:02 juju-e4d256-prod-github-runner-207 kernel: [ 3376.631455] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 06:20:02 juju-e4d256-prod-github-runner-207 kernel: [ 3376.632353] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 06:20:02 juju-e4d256-prod-github-runner-207 kernel: [ 3376.633286] Aug 22 06:20:30 juju-e4d256-prod-github-runner-207 kernel: [ 3404.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 3062s! [qemu-system-x86:6715] Aug 22 06:20:30 juju-e4d256-prod-github-runner-207 kernel: [ 3404.543088] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 06:20:30 juju-e4d256-prod-github-runner-207 kernel: [ 3404.543156] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 06:20:30 juju-e4d256-prod-github-runner-207 kernel: [ 3404.555305] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 06:20:30 juju-e4d256-prod-github-runner-207 kernel: [ 3404.556585] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 06:20:30 juju-e4d256-prod-github-runner-207 kernel: [ 3404.557800] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:20:30 juju-e4d256-prod-github-runner-207 kernel: [ 3404.558853] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 06:20:30 juju-e4d256-prod-github-runner-207 kernel: [ 3404.561536] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 06:20:30 juju-e4d256-prod-github-runner-207 kernel: [ 3404.562580] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 06:20:30 juju-e4d256-prod-github-runner-207 kernel: [ 3404.563738] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 06:20:30 juju-e4d256-prod-github-runner-207 kernel: [ 3404.564904] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 06:20:30 juju-e4d256-prod-github-runner-207 kernel: [ 3404.566060] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 06:20:30 juju-e4d256-prod-github-runner-207 kernel: [ 3404.567218] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 06:20:30 juju-e4d256-prod-github-runner-207 kernel: [ 3404.568405] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 06:20:30 juju-e4d256-prod-github-runner-207 kernel: [ 3404.569641] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 06:20:30 juju-e4d256-prod-github-runner-207 kernel: [ 3404.570735] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 06:20:30 juju-e4d256-prod-github-runner-207 kernel: [ 3404.571924] Call Trace: Aug 22 06:20:30 juju-e4d256-prod-github-runner-207 kernel: [ 3404.572850] Aug 22 06:20:30 juju-e4d256-prod-github-runner-207 kernel: [ 3404.573732] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:20:30 juju-e4d256-prod-github-runner-207 kernel: [ 3404.574759] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:20:30 juju-e4d256-prod-github-runner-207 kernel: [ 3404.575782] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:20:30 juju-e4d256-prod-github-runner-207 kernel: [ 3404.576870] ? show_regs.part.0+0x23/0x29 Aug 22 06:20:30 juju-e4d256-prod-github-runner-207 kernel: [ 3404.577863] ? show_regs.cold+0x8/0xd Aug 22 06:20:30 juju-e4d256-prod-github-runner-207 kernel: [ 3404.578831] ? watchdog_timer_fn+0x1be/0x220 Aug 22 06:20:30 juju-e4d256-prod-github-runner-207 kernel: [ 3404.579834] ? lockup_detector_update_enable+0x60/0x60 Aug 22 06:20:30 juju-e4d256-prod-github-runner-207 kernel: [ 3404.580908] ? __hrtimer_run_queues+0x107/0x230 Aug 22 06:20:30 juju-e4d256-prod-github-runner-207 kernel: [ 3404.581938] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 06:20:30 juju-e4d256-prod-github-runner-207 kernel: [ 3404.582958] ? hrtimer_interrupt+0x101/0x220 Aug 22 06:20:30 juju-e4d256-prod-github-runner-207 kernel: [ 3404.583969] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 06:20:30 juju-e4d256-prod-github-runner-207 kernel: [ 3404.585050] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 06:20:30 juju-e4d256-prod-github-runner-207 kernel: [ 3404.586097] Aug 22 06:20:30 juju-e4d256-prod-github-runner-207 kernel: [ 3404.586949] Aug 22 06:20:30 juju-e4d256-prod-github-runner-207 kernel: [ 3404.587785] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 06:20:30 juju-e4d256-prod-github-runner-207 kernel: [ 3404.588831] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:20:30 juju-e4d256-prod-github-runner-207 kernel: [ 3404.589865] ? _raw_spin_lock+0x22/0x30 Aug 22 06:20:30 juju-e4d256-prod-github-runner-207 kernel: [ 3404.590806] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:20:30 juju-e4d256-prod-github-runner-207 kernel: [ 3404.591825] direct_page_fault+0x206/0x310 [kvm] Aug 22 06:20:30 juju-e4d256-prod-github-runner-207 kernel: [ 3404.592859] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 06:20:30 juju-e4d256-prod-github-runner-207 kernel: [ 3404.593868] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 06:20:30 juju-e4d256-prod-github-runner-207 kernel: [ 3404.594884] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 06:20:30 juju-e4d256-prod-github-runner-207 kernel: [ 3404.595853] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 06:20:30 juju-e4d256-prod-github-runner-207 kernel: [ 3404.597430] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 06:20:30 juju-e4d256-prod-github-runner-207 kernel: [ 3404.598761] handle_exit+0x98/0x230 [kvm_amd] Aug 22 06:20:30 juju-e4d256-prod-github-runner-207 kernel: [ 3404.599909] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 06:20:30 juju-e4d256-prod-github-runner-207 kernel: [ 3404.601105] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 06:20:30 juju-e4d256-prod-github-runner-207 kernel: [ 3404.602288] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 06:20:30 juju-e4d256-prod-github-runner-207 kernel: [ 3404.603473] vcpu_run+0x62/0x2c0 [kvm] Aug 22 06:20:30 juju-e4d256-prod-github-runner-207 kernel: [ 3404.604513] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 06:20:30 juju-e4d256-prod-github-runner-207 kernel: [ 3404.605530] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 06:20:30 juju-e4d256-prod-github-runner-207 kernel: [ 3404.606602] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 06:20:30 juju-e4d256-prod-github-runner-207 kernel: [ 3404.607617] ? __seccomp_filter+0x4a/0x4a0 Aug 22 06:20:30 juju-e4d256-prod-github-runner-207 kernel: [ 3404.608606] ? __fget_files+0x86/0xc0 Aug 22 06:20:30 juju-e4d256-prod-github-runner-207 kernel: [ 3404.609494] __x64_sys_ioctl+0x95/0xd0 Aug 22 06:20:30 juju-e4d256-prod-github-runner-207 kernel: [ 3404.610356] do_syscall_64+0x5c/0xc0 Aug 22 06:20:30 juju-e4d256-prod-github-runner-207 kernel: [ 3404.611183] ? do_futex+0x162/0x1f0 Aug 22 06:20:30 juju-e4d256-prod-github-runner-207 kernel: [ 3404.611988] ? __x64_sys_futex+0x78/0x1e0 Aug 22 06:20:30 juju-e4d256-prod-github-runner-207 kernel: [ 3404.612873] ? __secure_computing+0xa9/0x120 Aug 22 06:20:30 juju-e4d256-prod-github-runner-207 kernel: [ 3404.613754] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 06:20:30 juju-e4d256-prod-github-runner-207 kernel: [ 3404.614704] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:20:30 juju-e4d256-prod-github-runner-207 kernel: [ 3404.615600] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:20:30 juju-e4d256-prod-github-runner-207 kernel: [ 3404.616502] ? do_syscall_64+0x69/0xc0 Aug 22 06:20:30 juju-e4d256-prod-github-runner-207 kernel: [ 3404.617327] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:20:30 juju-e4d256-prod-github-runner-207 kernel: [ 3404.618237] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:20:30 juju-e4d256-prod-github-runner-207 kernel: [ 3404.619115] ? do_syscall_64+0x69/0xc0 Aug 22 06:20:30 juju-e4d256-prod-github-runner-207 kernel: [ 3404.619894] ? do_syscall_64+0x69/0xc0 Aug 22 06:20:30 juju-e4d256-prod-github-runner-207 kernel: [ 3404.620677] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 06:20:30 juju-e4d256-prod-github-runner-207 kernel: [ 3404.621555] RIP: 0033:0x7faa5d0edaff Aug 22 06:20:30 juju-e4d256-prod-github-runner-207 kernel: [ 3404.622352] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 06:20:30 juju-e4d256-prod-github-runner-207 kernel: [ 3404.624764] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 06:20:30 juju-e4d256-prod-github-runner-207 kernel: [ 3404.625717] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 06:20:30 juju-e4d256-prod-github-runner-207 kernel: [ 3404.626636] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 06:20:30 juju-e4d256-prod-github-runner-207 kernel: [ 3404.627582] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 06:20:30 juju-e4d256-prod-github-runner-207 kernel: [ 3404.628506] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 06:20:30 juju-e4d256-prod-github-runner-207 kernel: [ 3404.629451] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 06:20:30 juju-e4d256-prod-github-runner-207 kernel: [ 3404.630371] Aug 22 06:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 3417.416709] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 06:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 3417.417662] rcu: 1-....: (822476 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=400616 Aug 22 06:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 3417.418768] (t=825054 jiffies g=23269 q=12066) Aug 22 06:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 3417.419543] NMI backtrace for cpu 1 Aug 22 06:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 3417.420267] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 06:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 3417.421364] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 06:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 3417.422422] Call Trace: Aug 22 06:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 3417.423102] Aug 22 06:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 3417.423745] show_stack+0x52/0x5c Aug 22 06:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 3417.424483] dump_stack_lvl+0x4a/0x63 Aug 22 06:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 3417.425226] dump_stack+0x10/0x16 Aug 22 06:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 3417.425941] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 06:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 3417.426718] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 06:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 3417.427496] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 06:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 3417.428331] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 06:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 3417.429150] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 06:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 3417.429954] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 06:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 3417.430722] print_cpu_stall.cold+0x2f/0xe2 Aug 22 06:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 3417.431484] ? timekeeping_update+0xf7/0x150 Aug 22 06:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 3417.432270] check_cpu_stall+0x109/0x270 Aug 22 06:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 3417.433155] rcu_sched_clock_irq+0x9a/0x250 Aug 22 06:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 3417.434014] update_process_times+0x94/0xd0 Aug 22 06:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 3417.434775] tick_sched_handle+0x29/0x70 Aug 22 06:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 3417.435519] tick_sched_timer+0x8c/0xc0 Aug 22 06:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 3417.436269] ? tick_nohz_handler+0xb0/0xb0 Aug 22 06:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 3417.437022] __hrtimer_run_queues+0x107/0x230 Aug 22 06:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 3417.437797] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 06:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 3417.438596] hrtimer_interrupt+0x101/0x220 Aug 22 06:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 3417.439362] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 06:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 3417.440185] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 06:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 3417.440985] Aug 22 06:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 3417.441617] Aug 22 06:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 3417.442242] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 06:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 3417.443088] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 3417.444015] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 06:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 3417.446206] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 06:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 3417.447099] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 06:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 3417.448109] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 06:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 3417.449091] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 06:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 3417.450049] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 06:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 3417.451002] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 06:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 3417.451964] ? _raw_spin_lock+0x22/0x30 Aug 22 06:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 3417.452718] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 3417.453559] direct_page_fault+0x206/0x310 [kvm] Aug 22 06:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 3417.454392] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 06:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 3417.455214] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 06:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 3417.456045] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 06:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 3417.456849] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 06:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 3417.457629] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 06:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 3417.458450] handle_exit+0x98/0x230 [kvm_amd] Aug 22 06:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 3417.459201] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 06:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 3417.460001] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 06:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 3417.460799] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 06:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 3417.461581] vcpu_run+0x62/0x2c0 [kvm] Aug 22 06:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 3417.462293] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 06:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 3417.463022] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 06:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 3417.463840] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 06:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 3417.464617] ? __seccomp_filter+0x4a/0x4a0 Aug 22 06:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 3417.465335] ? __fget_files+0x86/0xc0 Aug 22 06:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 3417.466025] __x64_sys_ioctl+0x95/0xd0 Aug 22 06:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 3417.466720] do_syscall_64+0x5c/0xc0 Aug 22 06:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 3417.467395] ? do_futex+0x162/0x1f0 Aug 22 06:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 3417.468077] ? __x64_sys_futex+0x78/0x1e0 Aug 22 06:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 3417.468803] ? __secure_computing+0xa9/0x120 Aug 22 06:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 3417.469528] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 06:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 3417.470317] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 3417.471068] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 3417.471818] ? do_syscall_64+0x69/0xc0 Aug 22 06:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 3417.472541] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 3417.473307] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 3417.474072] ? do_syscall_64+0x69/0xc0 Aug 22 06:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 3417.474764] ? do_syscall_64+0x69/0xc0 Aug 22 06:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 3417.475452] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 06:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 3417.476234] RIP: 0033:0x7faa5d0edaff Aug 22 06:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 3417.476945] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 06:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 3417.479062] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 06:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 3417.480037] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 06:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 3417.480984] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 06:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 3417.481926] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 06:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 3417.482863] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 06:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 3417.483794] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 06:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 3417.484730] Aug 22 06:21:10 juju-e4d256-prod-github-runner-207 kernel: [ 3444.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 3099s! [qemu-system-x86:6715] Aug 22 06:21:10 juju-e4d256-prod-github-runner-207 kernel: [ 3444.543138] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 06:21:10 juju-e4d256-prod-github-runner-207 kernel: [ 3444.543359] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 06:21:10 juju-e4d256-prod-github-runner-207 kernel: [ 3444.555416] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 06:21:10 juju-e4d256-prod-github-runner-207 kernel: [ 3444.556686] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 06:21:10 juju-e4d256-prod-github-runner-207 kernel: [ 3444.557904] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:21:10 juju-e4d256-prod-github-runner-207 kernel: [ 3444.558958] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 06:21:10 juju-e4d256-prod-github-runner-207 kernel: [ 3444.561518] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 06:21:10 juju-e4d256-prod-github-runner-207 kernel: [ 3444.562641] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 06:21:10 juju-e4d256-prod-github-runner-207 kernel: [ 3444.563891] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 06:21:10 juju-e4d256-prod-github-runner-207 kernel: [ 3444.565379] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 06:21:10 juju-e4d256-prod-github-runner-207 kernel: [ 3444.566611] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 06:21:10 juju-e4d256-prod-github-runner-207 kernel: [ 3444.567791] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 06:21:10 juju-e4d256-prod-github-runner-207 kernel: [ 3444.568960] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 06:21:10 juju-e4d256-prod-github-runner-207 kernel: [ 3444.570221] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 06:21:10 juju-e4d256-prod-github-runner-207 kernel: [ 3444.571327] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 06:21:10 juju-e4d256-prod-github-runner-207 kernel: [ 3444.572528] Call Trace: Aug 22 06:21:10 juju-e4d256-prod-github-runner-207 kernel: [ 3444.573438] Aug 22 06:21:10 juju-e4d256-prod-github-runner-207 kernel: [ 3444.574328] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:21:10 juju-e4d256-prod-github-runner-207 kernel: [ 3444.575355] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:21:10 juju-e4d256-prod-github-runner-207 kernel: [ 3444.576399] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:21:10 juju-e4d256-prod-github-runner-207 kernel: [ 3444.577510] ? show_regs.part.0+0x23/0x29 Aug 22 06:21:10 juju-e4d256-prod-github-runner-207 kernel: [ 3444.578509] ? show_regs.cold+0x8/0xd Aug 22 06:21:10 juju-e4d256-prod-github-runner-207 kernel: [ 3444.579479] ? watchdog_timer_fn+0x1be/0x220 Aug 22 06:21:10 juju-e4d256-prod-github-runner-207 kernel: [ 3444.580508] ? lockup_detector_update_enable+0x60/0x60 Aug 22 06:21:10 juju-e4d256-prod-github-runner-207 kernel: [ 3444.581571] ? __hrtimer_run_queues+0x107/0x230 Aug 22 06:21:10 juju-e4d256-prod-github-runner-207 kernel: [ 3444.582597] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 06:21:10 juju-e4d256-prod-github-runner-207 kernel: [ 3444.583631] ? hrtimer_interrupt+0x101/0x220 Aug 22 06:21:10 juju-e4d256-prod-github-runner-207 kernel: [ 3444.584644] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 06:21:10 juju-e4d256-prod-github-runner-207 kernel: [ 3444.585711] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 06:21:10 juju-e4d256-prod-github-runner-207 kernel: [ 3444.586756] Aug 22 06:21:10 juju-e4d256-prod-github-runner-207 kernel: [ 3444.587621] Aug 22 06:21:10 juju-e4d256-prod-github-runner-207 kernel: [ 3444.588456] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 06:21:10 juju-e4d256-prod-github-runner-207 kernel: [ 3444.589486] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:21:10 juju-e4d256-prod-github-runner-207 kernel: [ 3444.590527] ? _raw_spin_lock+0x22/0x30 Aug 22 06:21:10 juju-e4d256-prod-github-runner-207 kernel: [ 3444.591469] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:21:10 juju-e4d256-prod-github-runner-207 kernel: [ 3444.592494] direct_page_fault+0x206/0x310 [kvm] Aug 22 06:21:10 juju-e4d256-prod-github-runner-207 kernel: [ 3444.593515] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 06:21:10 juju-e4d256-prod-github-runner-207 kernel: [ 3444.594573] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 06:21:10 juju-e4d256-prod-github-runner-207 kernel: [ 3444.595596] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 06:21:10 juju-e4d256-prod-github-runner-207 kernel: [ 3444.596578] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 06:21:10 juju-e4d256-prod-github-runner-207 kernel: [ 3444.597522] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 06:21:10 juju-e4d256-prod-github-runner-207 kernel: [ 3444.598502] handle_exit+0x98/0x230 [kvm_amd] Aug 22 06:21:10 juju-e4d256-prod-github-runner-207 kernel: [ 3444.599393] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 06:21:10 juju-e4d256-prod-github-runner-207 kernel: [ 3444.600426] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 06:21:10 juju-e4d256-prod-github-runner-207 kernel: [ 3444.601364] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 06:21:10 juju-e4d256-prod-github-runner-207 kernel: [ 3444.602270] vcpu_run+0x62/0x2c0 [kvm] Aug 22 06:21:10 juju-e4d256-prod-github-runner-207 kernel: [ 3444.603078] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 06:21:10 juju-e4d256-prod-github-runner-207 kernel: [ 3444.603899] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 06:21:10 juju-e4d256-prod-github-runner-207 kernel: [ 3444.604763] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 06:21:10 juju-e4d256-prod-github-runner-207 kernel: [ 3444.605561] ? __seccomp_filter+0x4a/0x4a0 Aug 22 06:21:10 juju-e4d256-prod-github-runner-207 kernel: [ 3444.606302] ? __fget_files+0x86/0xc0 Aug 22 06:21:10 juju-e4d256-prod-github-runner-207 kernel: [ 3444.607013] __x64_sys_ioctl+0x95/0xd0 Aug 22 06:21:10 juju-e4d256-prod-github-runner-207 kernel: [ 3444.607721] do_syscall_64+0x5c/0xc0 Aug 22 06:21:10 juju-e4d256-prod-github-runner-207 kernel: [ 3444.608390] ? do_futex+0x162/0x1f0 Aug 22 06:21:10 juju-e4d256-prod-github-runner-207 kernel: [ 3444.609042] ? __x64_sys_futex+0x78/0x1e0 Aug 22 06:21:10 juju-e4d256-prod-github-runner-207 kernel: [ 3444.609714] ? __secure_computing+0xa9/0x120 Aug 22 06:21:10 juju-e4d256-prod-github-runner-207 kernel: [ 3444.610402] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 06:21:10 juju-e4d256-prod-github-runner-207 kernel: [ 3444.611166] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:21:10 juju-e4d256-prod-github-runner-207 kernel: [ 3444.611903] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:21:10 juju-e4d256-prod-github-runner-207 kernel: [ 3444.612632] ? do_syscall_64+0x69/0xc0 Aug 22 06:21:10 juju-e4d256-prod-github-runner-207 kernel: [ 3444.613280] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:21:10 juju-e4d256-prod-github-runner-207 kernel: [ 3444.613982] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:21:10 juju-e4d256-prod-github-runner-207 kernel: [ 3444.614676] ? do_syscall_64+0x69/0xc0 Aug 22 06:21:10 juju-e4d256-prod-github-runner-207 kernel: [ 3444.615299] ? do_syscall_64+0x69/0xc0 Aug 22 06:21:10 juju-e4d256-prod-github-runner-207 kernel: [ 3444.615940] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 06:21:10 juju-e4d256-prod-github-runner-207 kernel: [ 3444.616646] RIP: 0033:0x7faa5d0edaff Aug 22 06:21:10 juju-e4d256-prod-github-runner-207 kernel: [ 3444.617291] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 06:21:10 juju-e4d256-prod-github-runner-207 kernel: [ 3444.619275] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 06:21:10 juju-e4d256-prod-github-runner-207 kernel: [ 3444.620199] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 06:21:10 juju-e4d256-prod-github-runner-207 kernel: [ 3444.621087] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 06:21:10 juju-e4d256-prod-github-runner-207 kernel: [ 3444.621974] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 06:21:10 juju-e4d256-prod-github-runner-207 kernel: [ 3444.622861] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 06:21:10 juju-e4d256-prod-github-runner-207 kernel: [ 3444.623758] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 06:21:10 juju-e4d256-prod-github-runner-207 kernel: [ 3444.624649] Aug 22 06:21:38 juju-e4d256-prod-github-runner-207 kernel: [ 3472.541980] watchdog: BUG: soft lockup - CPU#1 stuck for 3126s! [qemu-system-x86:6715] Aug 22 06:21:38 juju-e4d256-prod-github-runner-207 kernel: [ 3472.543690] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 06:21:38 juju-e4d256-prod-github-runner-207 kernel: [ 3472.543843] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 06:21:38 juju-e4d256-prod-github-runner-207 kernel: [ 3472.556080] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 06:21:38 juju-e4d256-prod-github-runner-207 kernel: [ 3472.557353] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 06:21:38 juju-e4d256-prod-github-runner-207 kernel: [ 3472.558581] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:21:38 juju-e4d256-prod-github-runner-207 kernel: [ 3472.559663] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 06:21:38 juju-e4d256-prod-github-runner-207 kernel: [ 3472.562201] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 06:21:38 juju-e4d256-prod-github-runner-207 kernel: [ 3472.563262] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 06:21:38 juju-e4d256-prod-github-runner-207 kernel: [ 3472.564434] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 06:21:38 juju-e4d256-prod-github-runner-207 kernel: [ 3472.565614] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 06:21:38 juju-e4d256-prod-github-runner-207 kernel: [ 3472.566776] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 06:21:38 juju-e4d256-prod-github-runner-207 kernel: [ 3472.567955] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 06:21:38 juju-e4d256-prod-github-runner-207 kernel: [ 3472.569134] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 06:21:38 juju-e4d256-prod-github-runner-207 kernel: [ 3472.570363] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 06:21:38 juju-e4d256-prod-github-runner-207 kernel: [ 3472.571492] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 06:21:38 juju-e4d256-prod-github-runner-207 kernel: [ 3472.572703] Call Trace: Aug 22 06:21:38 juju-e4d256-prod-github-runner-207 kernel: [ 3472.573614] Aug 22 06:21:38 juju-e4d256-prod-github-runner-207 kernel: [ 3472.574498] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:21:38 juju-e4d256-prod-github-runner-207 kernel: [ 3472.575546] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:21:38 juju-e4d256-prod-github-runner-207 kernel: [ 3472.576567] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:21:38 juju-e4d256-prod-github-runner-207 kernel: [ 3472.577640] ? show_regs.part.0+0x23/0x29 Aug 22 06:21:38 juju-e4d256-prod-github-runner-207 kernel: [ 3472.578637] ? show_regs.cold+0x8/0xd Aug 22 06:21:38 juju-e4d256-prod-github-runner-207 kernel: [ 3472.579636] ? watchdog_timer_fn+0x1be/0x220 Aug 22 06:21:38 juju-e4d256-prod-github-runner-207 kernel: [ 3472.580792] ? lockup_detector_update_enable+0x60/0x60 Aug 22 06:21:38 juju-e4d256-prod-github-runner-207 kernel: [ 3472.581854] ? __hrtimer_run_queues+0x107/0x230 Aug 22 06:21:38 juju-e4d256-prod-github-runner-207 kernel: [ 3472.582880] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 06:21:38 juju-e4d256-prod-github-runner-207 kernel: [ 3472.583914] ? hrtimer_interrupt+0x101/0x220 Aug 22 06:21:38 juju-e4d256-prod-github-runner-207 kernel: [ 3472.584929] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 06:21:38 juju-e4d256-prod-github-runner-207 kernel: [ 3472.586002] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 06:21:38 juju-e4d256-prod-github-runner-207 kernel: [ 3472.587069] Aug 22 06:21:38 juju-e4d256-prod-github-runner-207 kernel: [ 3472.587946] Aug 22 06:21:38 juju-e4d256-prod-github-runner-207 kernel: [ 3472.588783] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 06:21:38 juju-e4d256-prod-github-runner-207 kernel: [ 3472.589813] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:21:38 juju-e4d256-prod-github-runner-207 kernel: [ 3472.590849] ? _raw_spin_lock+0x22/0x30 Aug 22 06:21:38 juju-e4d256-prod-github-runner-207 kernel: [ 3472.591814] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:21:38 juju-e4d256-prod-github-runner-207 kernel: [ 3472.592830] direct_page_fault+0x206/0x310 [kvm] Aug 22 06:21:38 juju-e4d256-prod-github-runner-207 kernel: [ 3472.593866] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 06:21:38 juju-e4d256-prod-github-runner-207 kernel: [ 3472.594921] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 06:21:38 juju-e4d256-prod-github-runner-207 kernel: [ 3472.595954] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 06:21:38 juju-e4d256-prod-github-runner-207 kernel: [ 3472.596949] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 06:21:38 juju-e4d256-prod-github-runner-207 kernel: [ 3472.597893] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 06:21:38 juju-e4d256-prod-github-runner-207 kernel: [ 3472.598870] handle_exit+0x98/0x230 [kvm_amd] Aug 22 06:21:38 juju-e4d256-prod-github-runner-207 kernel: [ 3472.599781] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 06:21:38 juju-e4d256-prod-github-runner-207 kernel: [ 3472.600696] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 06:21:38 juju-e4d256-prod-github-runner-207 kernel: [ 3472.601657] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 06:21:38 juju-e4d256-prod-github-runner-207 kernel: [ 3472.602561] vcpu_run+0x62/0x2c0 [kvm] Aug 22 06:21:38 juju-e4d256-prod-github-runner-207 kernel: [ 3472.603395] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 06:21:38 juju-e4d256-prod-github-runner-207 kernel: [ 3472.604209] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 06:21:38 juju-e4d256-prod-github-runner-207 kernel: [ 3472.605064] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 06:21:38 juju-e4d256-prod-github-runner-207 kernel: [ 3472.605863] ? __seccomp_filter+0x4a/0x4a0 Aug 22 06:21:38 juju-e4d256-prod-github-runner-207 kernel: [ 3472.606612] ? __fget_files+0x86/0xc0 Aug 22 06:21:38 juju-e4d256-prod-github-runner-207 kernel: [ 3472.607337] __x64_sys_ioctl+0x95/0xd0 Aug 22 06:21:38 juju-e4d256-prod-github-runner-207 kernel: [ 3472.608031] do_syscall_64+0x5c/0xc0 Aug 22 06:21:38 juju-e4d256-prod-github-runner-207 kernel: [ 3472.608697] ? do_futex+0x162/0x1f0 Aug 22 06:21:38 juju-e4d256-prod-github-runner-207 kernel: [ 3472.609347] ? __x64_sys_futex+0x78/0x1e0 Aug 22 06:21:38 juju-e4d256-prod-github-runner-207 kernel: [ 3472.610025] ? __secure_computing+0xa9/0x120 Aug 22 06:21:38 juju-e4d256-prod-github-runner-207 kernel: [ 3472.610718] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 06:21:38 juju-e4d256-prod-github-runner-207 kernel: [ 3472.611500] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:21:38 juju-e4d256-prod-github-runner-207 kernel: [ 3472.612221] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:21:38 juju-e4d256-prod-github-runner-207 kernel: [ 3472.612940] ? do_syscall_64+0x69/0xc0 Aug 22 06:21:38 juju-e4d256-prod-github-runner-207 kernel: [ 3472.613585] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:21:38 juju-e4d256-prod-github-runner-207 kernel: [ 3472.614289] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:21:38 juju-e4d256-prod-github-runner-207 kernel: [ 3472.614983] ? do_syscall_64+0x69/0xc0 Aug 22 06:21:38 juju-e4d256-prod-github-runner-207 kernel: [ 3472.615621] ? do_syscall_64+0x69/0xc0 Aug 22 06:21:38 juju-e4d256-prod-github-runner-207 kernel: [ 3472.616243] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 06:21:38 juju-e4d256-prod-github-runner-207 kernel: [ 3472.616965] RIP: 0033:0x7faa5d0edaff Aug 22 06:21:38 juju-e4d256-prod-github-runner-207 kernel: [ 3472.617635] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 06:21:38 juju-e4d256-prod-github-runner-207 kernel: [ 3472.619647] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 06:21:38 juju-e4d256-prod-github-runner-207 kernel: [ 3472.620568] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 06:21:38 juju-e4d256-prod-github-runner-207 kernel: [ 3472.621460] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 06:21:38 juju-e4d256-prod-github-runner-207 kernel: [ 3472.622354] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 06:21:38 juju-e4d256-prod-github-runner-207 kernel: [ 3472.623266] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 06:21:38 juju-e4d256-prod-github-runner-207 kernel: [ 3472.624175] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 06:21:38 juju-e4d256-prod-github-runner-207 kernel: [ 3472.625090] Aug 22 06:22:06 juju-e4d256-prod-github-runner-207 kernel: [ 3500.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 3152s! [qemu-system-x86:6715] Aug 22 06:22:06 juju-e4d256-prod-github-runner-207 kernel: [ 3500.543118] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 06:22:06 juju-e4d256-prod-github-runner-207 kernel: [ 3500.543189] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 06:22:06 juju-e4d256-prod-github-runner-207 kernel: [ 3500.555261] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 06:22:06 juju-e4d256-prod-github-runner-207 kernel: [ 3500.556528] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 06:22:06 juju-e4d256-prod-github-runner-207 kernel: [ 3500.557750] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:22:06 juju-e4d256-prod-github-runner-207 kernel: [ 3500.558806] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 06:22:06 juju-e4d256-prod-github-runner-207 kernel: [ 3500.561359] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 06:22:06 juju-e4d256-prod-github-runner-207 kernel: [ 3500.562400] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 06:22:06 juju-e4d256-prod-github-runner-207 kernel: [ 3500.563573] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 06:22:06 juju-e4d256-prod-github-runner-207 kernel: [ 3500.564737] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 06:22:06 juju-e4d256-prod-github-runner-207 kernel: [ 3500.565900] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 06:22:06 juju-e4d256-prod-github-runner-207 kernel: [ 3500.567076] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 06:22:06 juju-e4d256-prod-github-runner-207 kernel: [ 3500.568247] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 06:22:06 juju-e4d256-prod-github-runner-207 kernel: [ 3500.569479] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 06:22:06 juju-e4d256-prod-github-runner-207 kernel: [ 3500.570576] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 06:22:06 juju-e4d256-prod-github-runner-207 kernel: [ 3500.571774] Call Trace: Aug 22 06:22:06 juju-e4d256-prod-github-runner-207 kernel: [ 3500.572686] Aug 22 06:22:06 juju-e4d256-prod-github-runner-207 kernel: [ 3500.573570] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:22:06 juju-e4d256-prod-github-runner-207 kernel: [ 3500.574598] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:22:06 juju-e4d256-prod-github-runner-207 kernel: [ 3500.575625] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:22:06 juju-e4d256-prod-github-runner-207 kernel: [ 3500.576710] ? show_regs.part.0+0x23/0x29 Aug 22 06:22:06 juju-e4d256-prod-github-runner-207 kernel: [ 3500.577709] ? show_regs.cold+0x8/0xd Aug 22 06:22:06 juju-e4d256-prod-github-runner-207 kernel: [ 3500.578679] ? watchdog_timer_fn+0x1be/0x220 Aug 22 06:22:06 juju-e4d256-prod-github-runner-207 kernel: [ 3500.579736] ? lockup_detector_update_enable+0x60/0x60 Aug 22 06:22:06 juju-e4d256-prod-github-runner-207 kernel: [ 3500.580805] ? __hrtimer_run_queues+0x107/0x230 Aug 22 06:22:06 juju-e4d256-prod-github-runner-207 kernel: [ 3500.581834] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 06:22:06 juju-e4d256-prod-github-runner-207 kernel: [ 3500.582871] ? hrtimer_interrupt+0x101/0x220 Aug 22 06:22:06 juju-e4d256-prod-github-runner-207 kernel: [ 3500.583893] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 06:22:06 juju-e4d256-prod-github-runner-207 kernel: [ 3500.584959] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 06:22:06 juju-e4d256-prod-github-runner-207 kernel: [ 3500.586003] Aug 22 06:22:06 juju-e4d256-prod-github-runner-207 kernel: [ 3500.586855] Aug 22 06:22:06 juju-e4d256-prod-github-runner-207 kernel: [ 3500.587703] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 06:22:06 juju-e4d256-prod-github-runner-207 kernel: [ 3500.588739] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:22:06 juju-e4d256-prod-github-runner-207 kernel: [ 3500.589781] ? _raw_spin_lock+0x22/0x30 Aug 22 06:22:06 juju-e4d256-prod-github-runner-207 kernel: [ 3500.590723] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:22:06 juju-e4d256-prod-github-runner-207 kernel: [ 3500.591753] direct_page_fault+0x206/0x310 [kvm] Aug 22 06:22:06 juju-e4d256-prod-github-runner-207 kernel: [ 3500.592776] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 06:22:06 juju-e4d256-prod-github-runner-207 kernel: [ 3500.593784] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 06:22:06 juju-e4d256-prod-github-runner-207 kernel: [ 3500.594783] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 06:22:06 juju-e4d256-prod-github-runner-207 kernel: [ 3500.595774] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 06:22:06 juju-e4d256-prod-github-runner-207 kernel: [ 3500.596716] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 06:22:06 juju-e4d256-prod-github-runner-207 kernel: [ 3500.597694] handle_exit+0x98/0x230 [kvm_amd] Aug 22 06:22:06 juju-e4d256-prod-github-runner-207 kernel: [ 3500.598587] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 06:22:06 juju-e4d256-prod-github-runner-207 kernel: [ 3500.599517] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 06:22:06 juju-e4d256-prod-github-runner-207 kernel: [ 3500.600438] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 06:22:06 juju-e4d256-prod-github-runner-207 kernel: [ 3500.601342] vcpu_run+0x62/0x2c0 [kvm] Aug 22 06:22:06 juju-e4d256-prod-github-runner-207 kernel: [ 3500.602156] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 06:22:06 juju-e4d256-prod-github-runner-207 kernel: [ 3500.602974] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 06:22:06 juju-e4d256-prod-github-runner-207 kernel: [ 3500.603828] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 06:22:06 juju-e4d256-prod-github-runner-207 kernel: [ 3500.604626] ? __seccomp_filter+0x4a/0x4a0 Aug 22 06:22:06 juju-e4d256-prod-github-runner-207 kernel: [ 3500.605375] ? __fget_files+0x86/0xc0 Aug 22 06:22:06 juju-e4d256-prod-github-runner-207 kernel: [ 3500.606078] __x64_sys_ioctl+0x95/0xd0 Aug 22 06:22:06 juju-e4d256-prod-github-runner-207 kernel: [ 3500.606770] do_syscall_64+0x5c/0xc0 Aug 22 06:22:06 juju-e4d256-prod-github-runner-207 kernel: [ 3500.607451] ? do_futex+0x162/0x1f0 Aug 22 06:22:06 juju-e4d256-prod-github-runner-207 kernel: [ 3500.608104] ? __x64_sys_futex+0x78/0x1e0 Aug 22 06:22:06 juju-e4d256-prod-github-runner-207 kernel: [ 3500.608783] ? __secure_computing+0xa9/0x120 Aug 22 06:22:06 juju-e4d256-prod-github-runner-207 kernel: [ 3500.609481] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 06:22:06 juju-e4d256-prod-github-runner-207 kernel: [ 3500.610242] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:22:06 juju-e4d256-prod-github-runner-207 kernel: [ 3500.610988] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:22:06 juju-e4d256-prod-github-runner-207 kernel: [ 3500.611714] ? do_syscall_64+0x69/0xc0 Aug 22 06:22:06 juju-e4d256-prod-github-runner-207 kernel: [ 3500.612363] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:22:06 juju-e4d256-prod-github-runner-207 kernel: [ 3500.613066] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:22:06 juju-e4d256-prod-github-runner-207 kernel: [ 3500.613761] ? do_syscall_64+0x69/0xc0 Aug 22 06:22:06 juju-e4d256-prod-github-runner-207 kernel: [ 3500.614385] ? do_syscall_64+0x69/0xc0 Aug 22 06:22:06 juju-e4d256-prod-github-runner-207 kernel: [ 3500.615017] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 06:22:06 juju-e4d256-prod-github-runner-207 kernel: [ 3500.615723] RIP: 0033:0x7faa5d0edaff Aug 22 06:22:06 juju-e4d256-prod-github-runner-207 kernel: [ 3500.616350] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 06:22:06 juju-e4d256-prod-github-runner-207 kernel: [ 3500.618344] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 06:22:06 juju-e4d256-prod-github-runner-207 kernel: [ 3500.619261] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 06:22:06 juju-e4d256-prod-github-runner-207 kernel: [ 3500.620149] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 06:22:06 juju-e4d256-prod-github-runner-207 kernel: [ 3500.621036] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 06:22:06 juju-e4d256-prod-github-runner-207 kernel: [ 3500.622098] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 06:22:06 juju-e4d256-prod-github-runner-207 kernel: [ 3500.623164] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 06:22:06 juju-e4d256-prod-github-runner-207 kernel: [ 3500.624197] Aug 22 06:22:34 juju-e4d256-prod-github-runner-207 kernel: [ 3528.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 3178s! [qemu-system-x86:6715] Aug 22 06:22:34 juju-e4d256-prod-github-runner-207 kernel: [ 3528.543103] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 06:22:34 juju-e4d256-prod-github-runner-207 kernel: [ 3528.543172] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 06:22:34 juju-e4d256-prod-github-runner-207 kernel: [ 3528.555804] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 06:22:34 juju-e4d256-prod-github-runner-207 kernel: [ 3528.557075] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 06:22:34 juju-e4d256-prod-github-runner-207 kernel: [ 3528.558298] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:22:34 juju-e4d256-prod-github-runner-207 kernel: [ 3528.559425] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 06:22:34 juju-e4d256-prod-github-runner-207 kernel: [ 3528.562380] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 06:22:34 juju-e4d256-prod-github-runner-207 kernel: [ 3528.563601] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 06:22:34 juju-e4d256-prod-github-runner-207 kernel: [ 3528.564809] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 06:22:34 juju-e4d256-prod-github-runner-207 kernel: [ 3528.565977] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 06:22:34 juju-e4d256-prod-github-runner-207 kernel: [ 3528.567169] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 06:22:34 juju-e4d256-prod-github-runner-207 kernel: [ 3528.568337] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 06:22:34 juju-e4d256-prod-github-runner-207 kernel: [ 3528.569506] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 06:22:34 juju-e4d256-prod-github-runner-207 kernel: [ 3528.570756] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 06:22:34 juju-e4d256-prod-github-runner-207 kernel: [ 3528.571861] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 06:22:34 juju-e4d256-prod-github-runner-207 kernel: [ 3528.573057] Call Trace: Aug 22 06:22:34 juju-e4d256-prod-github-runner-207 kernel: [ 3528.573973] Aug 22 06:22:34 juju-e4d256-prod-github-runner-207 kernel: [ 3528.574871] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:22:34 juju-e4d256-prod-github-runner-207 kernel: [ 3528.575903] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:22:34 juju-e4d256-prod-github-runner-207 kernel: [ 3528.576925] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:22:34 juju-e4d256-prod-github-runner-207 kernel: [ 3528.578005] ? show_regs.part.0+0x23/0x29 Aug 22 06:22:34 juju-e4d256-prod-github-runner-207 kernel: [ 3528.579011] ? show_regs.cold+0x8/0xd Aug 22 06:22:34 juju-e4d256-prod-github-runner-207 kernel: [ 3528.579985] ? watchdog_timer_fn+0x1be/0x220 Aug 22 06:22:34 juju-e4d256-prod-github-runner-207 kernel: [ 3528.580993] ? lockup_detector_update_enable+0x60/0x60 Aug 22 06:22:34 juju-e4d256-prod-github-runner-207 kernel: [ 3528.582061] ? __hrtimer_run_queues+0x107/0x230 Aug 22 06:22:34 juju-e4d256-prod-github-runner-207 kernel: [ 3528.583096] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 06:22:34 juju-e4d256-prod-github-runner-207 kernel: [ 3528.584119] ? hrtimer_interrupt+0x101/0x220 Aug 22 06:22:34 juju-e4d256-prod-github-runner-207 kernel: [ 3528.585133] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 06:22:34 juju-e4d256-prod-github-runner-207 kernel: [ 3528.586201] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 06:22:34 juju-e4d256-prod-github-runner-207 kernel: [ 3528.587267] Aug 22 06:22:34 juju-e4d256-prod-github-runner-207 kernel: [ 3528.588141] Aug 22 06:22:34 juju-e4d256-prod-github-runner-207 kernel: [ 3528.589111] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 06:22:34 juju-e4d256-prod-github-runner-207 kernel: [ 3528.590141] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:22:34 juju-e4d256-prod-github-runner-207 kernel: [ 3528.591191] ? _raw_spin_lock+0x22/0x30 Aug 22 06:22:34 juju-e4d256-prod-github-runner-207 kernel: [ 3528.592135] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:22:34 juju-e4d256-prod-github-runner-207 kernel: [ 3528.593149] direct_page_fault+0x206/0x310 [kvm] Aug 22 06:22:34 juju-e4d256-prod-github-runner-207 kernel: [ 3528.594169] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 06:22:34 juju-e4d256-prod-github-runner-207 kernel: [ 3528.595187] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 06:22:34 juju-e4d256-prod-github-runner-207 kernel: [ 3528.596184] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 06:22:34 juju-e4d256-prod-github-runner-207 kernel: [ 3528.597150] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 06:22:34 juju-e4d256-prod-github-runner-207 kernel: [ 3528.598105] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 06:22:34 juju-e4d256-prod-github-runner-207 kernel: [ 3528.599097] handle_exit+0x98/0x230 [kvm_amd] Aug 22 06:22:34 juju-e4d256-prod-github-runner-207 kernel: [ 3528.599993] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 06:22:34 juju-e4d256-prod-github-runner-207 kernel: [ 3528.600909] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 06:22:34 juju-e4d256-prod-github-runner-207 kernel: [ 3528.601830] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 06:22:34 juju-e4d256-prod-github-runner-207 kernel: [ 3528.602924] vcpu_run+0x62/0x2c0 [kvm] Aug 22 06:22:34 juju-e4d256-prod-github-runner-207 kernel: [ 3528.603733] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 06:22:34 juju-e4d256-prod-github-runner-207 kernel: [ 3528.604538] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 06:22:34 juju-e4d256-prod-github-runner-207 kernel: [ 3528.605391] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 06:22:34 juju-e4d256-prod-github-runner-207 kernel: [ 3528.606375] ? __seccomp_filter+0x4a/0x4a0 Aug 22 06:22:34 juju-e4d256-prod-github-runner-207 kernel: [ 3528.607136] ? __fget_files+0x86/0xc0 Aug 22 06:22:34 juju-e4d256-prod-github-runner-207 kernel: [ 3528.607843] __x64_sys_ioctl+0x95/0xd0 Aug 22 06:22:34 juju-e4d256-prod-github-runner-207 kernel: [ 3528.608534] do_syscall_64+0x5c/0xc0 Aug 22 06:22:34 juju-e4d256-prod-github-runner-207 kernel: [ 3528.609199] ? do_futex+0x162/0x1f0 Aug 22 06:22:34 juju-e4d256-prod-github-runner-207 kernel: [ 3528.609851] ? __x64_sys_futex+0x78/0x1e0 Aug 22 06:22:34 juju-e4d256-prod-github-runner-207 kernel: [ 3528.610534] ? __secure_computing+0xa9/0x120 Aug 22 06:22:34 juju-e4d256-prod-github-runner-207 kernel: [ 3528.611223] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 06:22:34 juju-e4d256-prod-github-runner-207 kernel: [ 3528.611980] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:22:34 juju-e4d256-prod-github-runner-207 kernel: [ 3528.612704] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:22:34 juju-e4d256-prod-github-runner-207 kernel: [ 3528.613420] ? do_syscall_64+0x69/0xc0 Aug 22 06:22:34 juju-e4d256-prod-github-runner-207 kernel: [ 3528.614064] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:22:34 juju-e4d256-prod-github-runner-207 kernel: [ 3528.614773] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:22:34 juju-e4d256-prod-github-runner-207 kernel: [ 3528.615468] ? do_syscall_64+0x69/0xc0 Aug 22 06:22:34 juju-e4d256-prod-github-runner-207 kernel: [ 3528.616091] ? do_syscall_64+0x69/0xc0 Aug 22 06:22:34 juju-e4d256-prod-github-runner-207 kernel: [ 3528.616715] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 06:22:34 juju-e4d256-prod-github-runner-207 kernel: [ 3528.617418] RIP: 0033:0x7faa5d0edaff Aug 22 06:22:34 juju-e4d256-prod-github-runner-207 kernel: [ 3528.618052] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 06:22:34 juju-e4d256-prod-github-runner-207 kernel: [ 3528.620050] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 06:22:34 juju-e4d256-prod-github-runner-207 kernel: [ 3528.620959] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 06:22:34 juju-e4d256-prod-github-runner-207 kernel: [ 3528.621848] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 06:22:34 juju-e4d256-prod-github-runner-207 kernel: [ 3528.622743] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 06:22:34 juju-e4d256-prod-github-runner-207 kernel: [ 3528.623636] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 06:22:34 juju-e4d256-prod-github-runner-207 kernel: [ 3528.624523] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 06:22:34 juju-e4d256-prod-github-runner-207 kernel: [ 3528.625417] Aug 22 06:23:02 juju-e4d256-prod-github-runner-207 kernel: [ 3556.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 3204s! [qemu-system-x86:6715] Aug 22 06:23:02 juju-e4d256-prod-github-runner-207 kernel: [ 3556.543753] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 06:23:02 juju-e4d256-prod-github-runner-207 kernel: [ 3556.543993] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 06:23:02 juju-e4d256-prod-github-runner-207 kernel: [ 3556.556047] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 06:23:02 juju-e4d256-prod-github-runner-207 kernel: [ 3556.557307] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 06:23:02 juju-e4d256-prod-github-runner-207 kernel: [ 3556.558539] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:23:02 juju-e4d256-prod-github-runner-207 kernel: [ 3556.559600] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 06:23:02 juju-e4d256-prod-github-runner-207 kernel: [ 3556.562146] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 06:23:02 juju-e4d256-prod-github-runner-207 kernel: [ 3556.563192] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 06:23:02 juju-e4d256-prod-github-runner-207 kernel: [ 3556.564345] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 06:23:02 juju-e4d256-prod-github-runner-207 kernel: [ 3556.565498] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 06:23:02 juju-e4d256-prod-github-runner-207 kernel: [ 3556.566661] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 06:23:02 juju-e4d256-prod-github-runner-207 kernel: [ 3556.567840] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 06:23:02 juju-e4d256-prod-github-runner-207 kernel: [ 3556.569018] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 06:23:02 juju-e4d256-prod-github-runner-207 kernel: [ 3556.570265] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 06:23:02 juju-e4d256-prod-github-runner-207 kernel: [ 3556.571367] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 06:23:02 juju-e4d256-prod-github-runner-207 kernel: [ 3556.572745] Call Trace: Aug 22 06:23:02 juju-e4d256-prod-github-runner-207 kernel: [ 3556.573656] Aug 22 06:23:02 juju-e4d256-prod-github-runner-207 kernel: [ 3556.574561] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:23:02 juju-e4d256-prod-github-runner-207 kernel: [ 3556.575776] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:23:02 juju-e4d256-prod-github-runner-207 kernel: [ 3556.576797] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:23:02 juju-e4d256-prod-github-runner-207 kernel: [ 3556.578022] ? show_regs.part.0+0x23/0x29 Aug 22 06:23:02 juju-e4d256-prod-github-runner-207 kernel: [ 3556.579028] ? show_regs.cold+0x8/0xd Aug 22 06:23:02 juju-e4d256-prod-github-runner-207 kernel: [ 3556.579998] ? watchdog_timer_fn+0x1be/0x220 Aug 22 06:23:02 juju-e4d256-prod-github-runner-207 kernel: [ 3556.581009] ? lockup_detector_update_enable+0x60/0x60 Aug 22 06:23:02 juju-e4d256-prod-github-runner-207 kernel: [ 3556.582071] ? __hrtimer_run_queues+0x107/0x230 Aug 22 06:23:02 juju-e4d256-prod-github-runner-207 kernel: [ 3556.583113] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 06:23:02 juju-e4d256-prod-github-runner-207 kernel: [ 3556.584135] ? hrtimer_interrupt+0x101/0x220 Aug 22 06:23:02 juju-e4d256-prod-github-runner-207 kernel: [ 3556.585154] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 06:23:02 juju-e4d256-prod-github-runner-207 kernel: [ 3556.586234] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 06:23:02 juju-e4d256-prod-github-runner-207 kernel: [ 3556.587284] Aug 22 06:23:02 juju-e4d256-prod-github-runner-207 kernel: [ 3556.588136] Aug 22 06:23:02 juju-e4d256-prod-github-runner-207 kernel: [ 3556.588973] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 06:23:02 juju-e4d256-prod-github-runner-207 kernel: [ 3556.590022] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:23:02 juju-e4d256-prod-github-runner-207 kernel: [ 3556.591077] ? _raw_spin_lock+0x22/0x30 Aug 22 06:23:02 juju-e4d256-prod-github-runner-207 kernel: [ 3556.592017] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:23:02 juju-e4d256-prod-github-runner-207 kernel: [ 3556.593031] direct_page_fault+0x206/0x310 [kvm] Aug 22 06:23:02 juju-e4d256-prod-github-runner-207 kernel: [ 3556.594051] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 06:23:02 juju-e4d256-prod-github-runner-207 kernel: [ 3556.595062] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 06:23:02 juju-e4d256-prod-github-runner-207 kernel: [ 3556.596098] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 06:23:02 juju-e4d256-prod-github-runner-207 kernel: [ 3556.597097] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 06:23:02 juju-e4d256-prod-github-runner-207 kernel: [ 3556.598042] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 06:23:02 juju-e4d256-prod-github-runner-207 kernel: [ 3556.599034] handle_exit+0x98/0x230 [kvm_amd] Aug 22 06:23:02 juju-e4d256-prod-github-runner-207 kernel: [ 3556.599929] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 06:23:02 juju-e4d256-prod-github-runner-207 kernel: [ 3556.600839] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 06:23:02 juju-e4d256-prod-github-runner-207 kernel: [ 3556.601770] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 06:23:02 juju-e4d256-prod-github-runner-207 kernel: [ 3556.602683] vcpu_run+0x62/0x2c0 [kvm] Aug 22 06:23:02 juju-e4d256-prod-github-runner-207 kernel: [ 3556.603501] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 06:23:02 juju-e4d256-prod-github-runner-207 kernel: [ 3556.604304] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 06:23:02 juju-e4d256-prod-github-runner-207 kernel: [ 3556.605160] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 06:23:02 juju-e4d256-prod-github-runner-207 kernel: [ 3556.605954] ? __seccomp_filter+0x4a/0x4a0 Aug 22 06:23:02 juju-e4d256-prod-github-runner-207 kernel: [ 3556.606702] ? __fget_files+0x86/0xc0 Aug 22 06:23:02 juju-e4d256-prod-github-runner-207 kernel: [ 3556.607425] __x64_sys_ioctl+0x95/0xd0 Aug 22 06:23:02 juju-e4d256-prod-github-runner-207 kernel: [ 3556.608120] do_syscall_64+0x5c/0xc0 Aug 22 06:23:02 juju-e4d256-prod-github-runner-207 kernel: [ 3556.608782] ? do_futex+0x162/0x1f0 Aug 22 06:23:02 juju-e4d256-prod-github-runner-207 kernel: [ 3556.609433] ? __x64_sys_futex+0x78/0x1e0 Aug 22 06:23:02 juju-e4d256-prod-github-runner-207 kernel: [ 3556.610108] ? __secure_computing+0xa9/0x120 Aug 22 06:23:02 juju-e4d256-prod-github-runner-207 kernel: [ 3556.610803] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 06:23:02 juju-e4d256-prod-github-runner-207 kernel: [ 3556.611562] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:23:02 juju-e4d256-prod-github-runner-207 kernel: [ 3556.612278] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:23:02 juju-e4d256-prod-github-runner-207 kernel: [ 3556.612996] ? do_syscall_64+0x69/0xc0 Aug 22 06:23:02 juju-e4d256-prod-github-runner-207 kernel: [ 3556.613659] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:23:02 juju-e4d256-prod-github-runner-207 kernel: [ 3556.614369] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:23:02 juju-e4d256-prod-github-runner-207 kernel: [ 3556.615066] ? do_syscall_64+0x69/0xc0 Aug 22 06:23:02 juju-e4d256-prod-github-runner-207 kernel: [ 3556.615688] ? do_syscall_64+0x69/0xc0 Aug 22 06:23:02 juju-e4d256-prod-github-runner-207 kernel: [ 3556.616307] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 06:23:02 juju-e4d256-prod-github-runner-207 kernel: [ 3556.617155] RIP: 0033:0x7faa5d0edaff Aug 22 06:23:02 juju-e4d256-prod-github-runner-207 kernel: [ 3556.617826] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 06:23:02 juju-e4d256-prod-github-runner-207 kernel: [ 3556.619834] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 06:23:02 juju-e4d256-prod-github-runner-207 kernel: [ 3556.620741] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 06:23:02 juju-e4d256-prod-github-runner-207 kernel: [ 3556.621626] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 06:23:02 juju-e4d256-prod-github-runner-207 kernel: [ 3556.622519] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 06:23:02 juju-e4d256-prod-github-runner-207 kernel: [ 3556.623402] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 06:23:02 juju-e4d256-prod-github-runner-207 kernel: [ 3556.624288] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 06:23:02 juju-e4d256-prod-github-runner-207 kernel: [ 3556.625177] Aug 22 06:23:30 juju-e4d256-prod-github-runner-207 kernel: [ 3584.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 3230s! [qemu-system-x86:6715] Aug 22 06:23:30 juju-e4d256-prod-github-runner-207 kernel: [ 3584.543093] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 06:23:30 juju-e4d256-prod-github-runner-207 kernel: [ 3584.543162] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 06:23:30 juju-e4d256-prod-github-runner-207 kernel: [ 3584.555297] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 06:23:30 juju-e4d256-prod-github-runner-207 kernel: [ 3584.556584] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 06:23:30 juju-e4d256-prod-github-runner-207 kernel: [ 3584.557807] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:23:30 juju-e4d256-prod-github-runner-207 kernel: [ 3584.558878] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 06:23:30 juju-e4d256-prod-github-runner-207 kernel: [ 3584.561476] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 06:23:30 juju-e4d256-prod-github-runner-207 kernel: [ 3584.562547] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 06:23:30 juju-e4d256-prod-github-runner-207 kernel: [ 3584.563708] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 06:23:30 juju-e4d256-prod-github-runner-207 kernel: [ 3584.564866] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 06:23:30 juju-e4d256-prod-github-runner-207 kernel: [ 3584.566045] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 06:23:30 juju-e4d256-prod-github-runner-207 kernel: [ 3584.567207] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 06:23:30 juju-e4d256-prod-github-runner-207 kernel: [ 3584.568378] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 06:23:30 juju-e4d256-prod-github-runner-207 kernel: [ 3584.569612] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 06:23:30 juju-e4d256-prod-github-runner-207 kernel: [ 3584.570719] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 06:23:30 juju-e4d256-prod-github-runner-207 kernel: [ 3584.571914] Call Trace: Aug 22 06:23:30 juju-e4d256-prod-github-runner-207 kernel: [ 3584.572825] Aug 22 06:23:30 juju-e4d256-prod-github-runner-207 kernel: [ 3584.573709] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:23:30 juju-e4d256-prod-github-runner-207 kernel: [ 3584.574749] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:23:30 juju-e4d256-prod-github-runner-207 kernel: [ 3584.575767] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:23:30 juju-e4d256-prod-github-runner-207 kernel: [ 3584.576862] ? show_regs.part.0+0x23/0x29 Aug 22 06:23:30 juju-e4d256-prod-github-runner-207 kernel: [ 3584.577877] ? show_regs.cold+0x8/0xd Aug 22 06:23:30 juju-e4d256-prod-github-runner-207 kernel: [ 3584.578845] ? watchdog_timer_fn+0x1be/0x220 Aug 22 06:23:30 juju-e4d256-prod-github-runner-207 kernel: [ 3584.579855] ? lockup_detector_update_enable+0x60/0x60 Aug 22 06:23:30 juju-e4d256-prod-github-runner-207 kernel: [ 3584.580930] ? __hrtimer_run_queues+0x107/0x230 Aug 22 06:23:30 juju-e4d256-prod-github-runner-207 kernel: [ 3584.581975] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 06:23:30 juju-e4d256-prod-github-runner-207 kernel: [ 3584.582996] ? hrtimer_interrupt+0x101/0x220 Aug 22 06:23:30 juju-e4d256-prod-github-runner-207 kernel: [ 3584.584032] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 06:23:30 juju-e4d256-prod-github-runner-207 kernel: [ 3584.585103] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 06:23:30 juju-e4d256-prod-github-runner-207 kernel: [ 3584.586159] Aug 22 06:23:30 juju-e4d256-prod-github-runner-207 kernel: [ 3584.587011] Aug 22 06:23:30 juju-e4d256-prod-github-runner-207 kernel: [ 3584.587886] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 06:23:30 juju-e4d256-prod-github-runner-207 kernel: [ 3584.588918] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:23:30 juju-e4d256-prod-github-runner-207 kernel: [ 3584.589976] ? _raw_spin_lock+0x22/0x30 Aug 22 06:23:30 juju-e4d256-prod-github-runner-207 kernel: [ 3584.590923] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:23:30 juju-e4d256-prod-github-runner-207 kernel: [ 3584.591944] direct_page_fault+0x206/0x310 [kvm] Aug 22 06:23:30 juju-e4d256-prod-github-runner-207 kernel: [ 3584.592967] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 06:23:30 juju-e4d256-prod-github-runner-207 kernel: [ 3584.593986] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 06:23:30 juju-e4d256-prod-github-runner-207 kernel: [ 3584.595033] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 06:23:30 juju-e4d256-prod-github-runner-207 kernel: [ 3584.596008] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 06:23:30 juju-e4d256-prod-github-runner-207 kernel: [ 3584.596952] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 06:23:30 juju-e4d256-prod-github-runner-207 kernel: [ 3584.597962] handle_exit+0x98/0x230 [kvm_amd] Aug 22 06:23:30 juju-e4d256-prod-github-runner-207 kernel: [ 3584.598854] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 06:23:30 juju-e4d256-prod-github-runner-207 kernel: [ 3584.599765] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 06:23:30 juju-e4d256-prod-github-runner-207 kernel: [ 3584.600720] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 06:23:30 juju-e4d256-prod-github-runner-207 kernel: [ 3584.601653] vcpu_run+0x62/0x2c0 [kvm] Aug 22 06:23:30 juju-e4d256-prod-github-runner-207 kernel: [ 3584.602478] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 06:23:30 juju-e4d256-prod-github-runner-207 kernel: [ 3584.603288] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 06:23:30 juju-e4d256-prod-github-runner-207 kernel: [ 3584.604139] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 06:23:30 juju-e4d256-prod-github-runner-207 kernel: [ 3584.604943] ? __seccomp_filter+0x4a/0x4a0 Aug 22 06:23:30 juju-e4d256-prod-github-runner-207 kernel: [ 3584.605685] ? __fget_files+0x86/0xc0 Aug 22 06:23:30 juju-e4d256-prod-github-runner-207 kernel: [ 3584.606400] __x64_sys_ioctl+0x95/0xd0 Aug 22 06:23:30 juju-e4d256-prod-github-runner-207 kernel: [ 3584.607090] do_syscall_64+0x5c/0xc0 Aug 22 06:23:30 juju-e4d256-prod-github-runner-207 kernel: [ 3584.607783] ? do_futex+0x162/0x1f0 Aug 22 06:23:30 juju-e4d256-prod-github-runner-207 kernel: [ 3584.608441] ? __x64_sys_futex+0x78/0x1e0 Aug 22 06:23:30 juju-e4d256-prod-github-runner-207 kernel: [ 3584.609112] ? __secure_computing+0xa9/0x120 Aug 22 06:23:30 juju-e4d256-prod-github-runner-207 kernel: [ 3584.609804] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 06:23:30 juju-e4d256-prod-github-runner-207 kernel: [ 3584.610576] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:23:30 juju-e4d256-prod-github-runner-207 kernel: [ 3584.611298] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:23:30 juju-e4d256-prod-github-runner-207 kernel: [ 3584.612013] ? do_syscall_64+0x69/0xc0 Aug 22 06:23:30 juju-e4d256-prod-github-runner-207 kernel: [ 3584.612661] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:23:30 juju-e4d256-prod-github-runner-207 kernel: [ 3584.613363] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:23:30 juju-e4d256-prod-github-runner-207 kernel: [ 3584.614115] ? do_syscall_64+0x69/0xc0 Aug 22 06:23:30 juju-e4d256-prod-github-runner-207 kernel: [ 3584.614740] ? do_syscall_64+0x69/0xc0 Aug 22 06:23:30 juju-e4d256-prod-github-runner-207 kernel: [ 3584.615362] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 06:23:30 juju-e4d256-prod-github-runner-207 kernel: [ 3584.616063] RIP: 0033:0x7faa5d0edaff Aug 22 06:23:30 juju-e4d256-prod-github-runner-207 kernel: [ 3584.616684] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 06:23:30 juju-e4d256-prod-github-runner-207 kernel: [ 3584.618713] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 06:23:30 juju-e4d256-prod-github-runner-207 kernel: [ 3584.619621] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 06:23:30 juju-e4d256-prod-github-runner-207 kernel: [ 3584.620507] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 06:23:30 juju-e4d256-prod-github-runner-207 kernel: [ 3584.621426] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 06:23:30 juju-e4d256-prod-github-runner-207 kernel: [ 3584.622334] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 06:23:30 juju-e4d256-prod-github-runner-207 kernel: [ 3584.623217] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 06:23:30 juju-e4d256-prod-github-runner-207 kernel: [ 3584.624161] Aug 22 06:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 3597.428705] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 06:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 3597.429657] rcu: 1-....: (867342 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=422413 Aug 22 06:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 3597.430793] (t=870057 jiffies g=23269 q=12229) Aug 22 06:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 3597.431571] NMI backtrace for cpu 1 Aug 22 06:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 3597.432286] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 06:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 3597.433399] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 06:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 3597.434472] Call Trace: Aug 22 06:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 3597.435145] Aug 22 06:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 3597.435789] show_stack+0x52/0x5c Aug 22 06:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 3597.436518] dump_stack_lvl+0x4a/0x63 Aug 22 06:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 3597.437263] dump_stack+0x10/0x16 Aug 22 06:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 3597.437994] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 06:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 3597.438774] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 06:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 3597.439551] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 06:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 3597.440377] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 06:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 3597.441196] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 06:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 3597.442022] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 06:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 3597.442797] print_cpu_stall.cold+0x2f/0xe2 Aug 22 06:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 3597.443568] ? timekeeping_update+0xf7/0x150 Aug 22 06:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 3597.444337] check_cpu_stall+0x109/0x270 Aug 22 06:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 3597.445083] rcu_sched_clock_irq+0x9a/0x250 Aug 22 06:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 3597.445857] update_process_times+0x94/0xd0 Aug 22 06:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 3597.446618] tick_sched_handle+0x29/0x70 Aug 22 06:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 3597.447367] tick_sched_timer+0x8c/0xc0 Aug 22 06:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 3597.448105] ? tick_nohz_handler+0xb0/0xb0 Aug 22 06:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 3597.448861] __hrtimer_run_queues+0x107/0x230 Aug 22 06:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 3597.449633] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 06:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 3597.450426] hrtimer_interrupt+0x101/0x220 Aug 22 06:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 3597.451185] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 06:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 3597.451997] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 06:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 3597.452803] Aug 22 06:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 3597.453437] Aug 22 06:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 3597.454076] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 06:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 3597.454896] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 3597.455776] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 06:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 3597.457995] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 06:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 3597.458937] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 06:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 3597.459934] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 06:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 3597.461020] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 06:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 3597.461997] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 06:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 3597.462957] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 06:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 3597.463912] ? _raw_spin_lock+0x22/0x30 Aug 22 06:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 3597.464669] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 3597.465508] direct_page_fault+0x206/0x310 [kvm] Aug 22 06:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 3597.466356] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 06:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 3597.467181] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 06:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 3597.468002] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 06:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 3597.468810] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 06:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 3597.469593] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 06:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 3597.470426] handle_exit+0x98/0x230 [kvm_amd] Aug 22 06:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 3597.471179] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 06:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 3597.471960] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 06:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 3597.472756] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 06:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 3597.473540] vcpu_run+0x62/0x2c0 [kvm] Aug 22 06:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 3597.474268] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 06:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 3597.475000] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 06:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 3597.475798] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 06:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 3597.476561] ? __seccomp_filter+0x4a/0x4a0 Aug 22 06:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 3597.477280] ? __fget_files+0x86/0xc0 Aug 22 06:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 3597.478037] __x64_sys_ioctl+0x95/0xd0 Aug 22 06:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 3597.478826] do_syscall_64+0x5c/0xc0 Aug 22 06:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 3597.479574] ? do_futex+0x162/0x1f0 Aug 22 06:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 3597.480322] ? __x64_sys_futex+0x78/0x1e0 Aug 22 06:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 3597.481078] ? __secure_computing+0xa9/0x120 Aug 22 06:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 3597.481869] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 06:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 3597.482749] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 3597.483566] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 3597.484373] ? do_syscall_64+0x69/0xc0 Aug 22 06:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 3597.485156] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 3597.486052] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 3597.486873] ? do_syscall_64+0x69/0xc0 Aug 22 06:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 3597.487627] ? do_syscall_64+0x69/0xc0 Aug 22 06:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 3597.488365] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 06:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 3597.489189] RIP: 0033:0x7faa5d0edaff Aug 22 06:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 3597.489948] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 06:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 3597.492220] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 06:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 3597.493289] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 06:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 3597.494364] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 06:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 3597.495397] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 06:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 3597.496408] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 06:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 3597.497420] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 06:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 3597.498413] Aug 22 06:24:10 juju-e4d256-prod-github-runner-207 kernel: [ 3624.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 3267s! [qemu-system-x86:6715] Aug 22 06:24:10 juju-e4d256-prod-github-runner-207 kernel: [ 3624.543150] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 06:24:10 juju-e4d256-prod-github-runner-207 kernel: [ 3624.543289] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 06:24:10 juju-e4d256-prod-github-runner-207 kernel: [ 3624.555603] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 06:24:10 juju-e4d256-prod-github-runner-207 kernel: [ 3624.556860] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 06:24:10 juju-e4d256-prod-github-runner-207 kernel: [ 3624.558222] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:24:10 juju-e4d256-prod-github-runner-207 kernel: [ 3624.559325] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 06:24:10 juju-e4d256-prod-github-runner-207 kernel: [ 3624.561982] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 06:24:10 juju-e4d256-prod-github-runner-207 kernel: [ 3624.563027] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 06:24:10 juju-e4d256-prod-github-runner-207 kernel: [ 3624.564189] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 06:24:10 juju-e4d256-prod-github-runner-207 kernel: [ 3624.565379] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 06:24:10 juju-e4d256-prod-github-runner-207 kernel: [ 3624.566605] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 06:24:10 juju-e4d256-prod-github-runner-207 kernel: [ 3624.567768] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 06:24:10 juju-e4d256-prod-github-runner-207 kernel: [ 3624.568933] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 06:24:10 juju-e4d256-prod-github-runner-207 kernel: [ 3624.570185] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 06:24:10 juju-e4d256-prod-github-runner-207 kernel: [ 3624.571279] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 06:24:10 juju-e4d256-prod-github-runner-207 kernel: [ 3624.572466] Call Trace: Aug 22 06:24:10 juju-e4d256-prod-github-runner-207 kernel: [ 3624.573388] Aug 22 06:24:10 juju-e4d256-prod-github-runner-207 kernel: [ 3624.574270] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:24:10 juju-e4d256-prod-github-runner-207 kernel: [ 3624.575298] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:24:10 juju-e4d256-prod-github-runner-207 kernel: [ 3624.576317] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:24:10 juju-e4d256-prod-github-runner-207 kernel: [ 3624.577422] ? show_regs.part.0+0x23/0x29 Aug 22 06:24:10 juju-e4d256-prod-github-runner-207 kernel: [ 3624.578417] ? show_regs.cold+0x8/0xd Aug 22 06:24:10 juju-e4d256-prod-github-runner-207 kernel: [ 3624.579387] ? watchdog_timer_fn+0x1be/0x220 Aug 22 06:24:10 juju-e4d256-prod-github-runner-207 kernel: [ 3624.580393] ? lockup_detector_update_enable+0x60/0x60 Aug 22 06:24:10 juju-e4d256-prod-github-runner-207 kernel: [ 3624.581462] ? __hrtimer_run_queues+0x107/0x230 Aug 22 06:24:10 juju-e4d256-prod-github-runner-207 kernel: [ 3624.582553] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 06:24:10 juju-e4d256-prod-github-runner-207 kernel: [ 3624.583585] ? hrtimer_interrupt+0x101/0x220 Aug 22 06:24:10 juju-e4d256-prod-github-runner-207 kernel: [ 3624.584599] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 06:24:10 juju-e4d256-prod-github-runner-207 kernel: [ 3624.585694] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 06:24:10 juju-e4d256-prod-github-runner-207 kernel: [ 3624.586738] Aug 22 06:24:10 juju-e4d256-prod-github-runner-207 kernel: [ 3624.587589] Aug 22 06:24:10 juju-e4d256-prod-github-runner-207 kernel: [ 3624.588434] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 06:24:10 juju-e4d256-prod-github-runner-207 kernel: [ 3624.589496] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:24:10 juju-e4d256-prod-github-runner-207 kernel: [ 3624.590534] ? _raw_spin_lock+0x22/0x30 Aug 22 06:24:10 juju-e4d256-prod-github-runner-207 kernel: [ 3624.591476] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:24:10 juju-e4d256-prod-github-runner-207 kernel: [ 3624.592500] direct_page_fault+0x206/0x310 [kvm] Aug 22 06:24:10 juju-e4d256-prod-github-runner-207 kernel: [ 3624.593531] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 06:24:10 juju-e4d256-prod-github-runner-207 kernel: [ 3624.594546] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 06:24:10 juju-e4d256-prod-github-runner-207 kernel: [ 3624.595547] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 06:24:10 juju-e4d256-prod-github-runner-207 kernel: [ 3624.596537] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 06:24:10 juju-e4d256-prod-github-runner-207 kernel: [ 3624.597492] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 06:24:10 juju-e4d256-prod-github-runner-207 kernel: [ 3624.598468] handle_exit+0x98/0x230 [kvm_amd] Aug 22 06:24:10 juju-e4d256-prod-github-runner-207 kernel: [ 3624.599363] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 06:24:10 juju-e4d256-prod-github-runner-207 kernel: [ 3624.600274] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 06:24:10 juju-e4d256-prod-github-runner-207 kernel: [ 3624.601408] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 06:24:10 juju-e4d256-prod-github-runner-207 kernel: [ 3624.602329] vcpu_run+0x62/0x2c0 [kvm] Aug 22 06:24:10 juju-e4d256-prod-github-runner-207 kernel: [ 3624.603151] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 06:24:10 juju-e4d256-prod-github-runner-207 kernel: [ 3624.603966] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 06:24:10 juju-e4d256-prod-github-runner-207 kernel: [ 3624.604817] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 06:24:10 juju-e4d256-prod-github-runner-207 kernel: [ 3624.605636] ? __seccomp_filter+0x4a/0x4a0 Aug 22 06:24:10 juju-e4d256-prod-github-runner-207 kernel: [ 3624.606378] ? __fget_files+0x86/0xc0 Aug 22 06:24:10 juju-e4d256-prod-github-runner-207 kernel: [ 3624.607079] __x64_sys_ioctl+0x95/0xd0 Aug 22 06:24:10 juju-e4d256-prod-github-runner-207 kernel: [ 3624.607774] do_syscall_64+0x5c/0xc0 Aug 22 06:24:10 juju-e4d256-prod-github-runner-207 kernel: [ 3624.608437] ? do_futex+0x162/0x1f0 Aug 22 06:24:10 juju-e4d256-prod-github-runner-207 kernel: [ 3624.609088] ? __x64_sys_futex+0x78/0x1e0 Aug 22 06:24:10 juju-e4d256-prod-github-runner-207 kernel: [ 3624.609773] ? __secure_computing+0xa9/0x120 Aug 22 06:24:10 juju-e4d256-prod-github-runner-207 kernel: [ 3624.610461] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 06:24:10 juju-e4d256-prod-github-runner-207 kernel: [ 3624.611225] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:24:10 juju-e4d256-prod-github-runner-207 kernel: [ 3624.611987] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:24:10 juju-e4d256-prod-github-runner-207 kernel: [ 3624.612711] ? do_syscall_64+0x69/0xc0 Aug 22 06:24:10 juju-e4d256-prod-github-runner-207 kernel: [ 3624.613411] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:24:10 juju-e4d256-prod-github-runner-207 kernel: [ 3624.614135] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:24:10 juju-e4d256-prod-github-runner-207 kernel: [ 3624.614829] ? do_syscall_64+0x69/0xc0 Aug 22 06:24:10 juju-e4d256-prod-github-runner-207 kernel: [ 3624.615453] ? do_syscall_64+0x69/0xc0 Aug 22 06:24:10 juju-e4d256-prod-github-runner-207 kernel: [ 3624.616074] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 06:24:10 juju-e4d256-prod-github-runner-207 kernel: [ 3624.616798] RIP: 0033:0x7faa5d0edaff Aug 22 06:24:10 juju-e4d256-prod-github-runner-207 kernel: [ 3624.617452] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 06:24:10 juju-e4d256-prod-github-runner-207 kernel: [ 3624.619428] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 06:24:10 juju-e4d256-prod-github-runner-207 kernel: [ 3624.620337] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 06:24:10 juju-e4d256-prod-github-runner-207 kernel: [ 3624.621224] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 06:24:10 juju-e4d256-prod-github-runner-207 kernel: [ 3624.622166] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 06:24:10 juju-e4d256-prod-github-runner-207 kernel: [ 3624.623101] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 06:24:10 juju-e4d256-prod-github-runner-207 kernel: [ 3624.623989] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 06:24:10 juju-e4d256-prod-github-runner-207 kernel: [ 3624.624887] Aug 22 06:24:38 juju-e4d256-prod-github-runner-207 kernel: [ 3652.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 3293s! [qemu-system-x86:6715] Aug 22 06:24:38 juju-e4d256-prod-github-runner-207 kernel: [ 3652.544349] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 06:24:38 juju-e4d256-prod-github-runner-207 kernel: [ 3652.544655] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 06:24:38 juju-e4d256-prod-github-runner-207 kernel: [ 3652.557633] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 06:24:38 juju-e4d256-prod-github-runner-207 kernel: [ 3652.558912] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 06:24:38 juju-e4d256-prod-github-runner-207 kernel: [ 3652.560133] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:24:38 juju-e4d256-prod-github-runner-207 kernel: [ 3652.561431] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 06:24:38 juju-e4d256-prod-github-runner-207 kernel: [ 3652.564329] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 06:24:38 juju-e4d256-prod-github-runner-207 kernel: [ 3652.565569] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 06:24:38 juju-e4d256-prod-github-runner-207 kernel: [ 3652.566975] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 06:24:38 juju-e4d256-prod-github-runner-207 kernel: [ 3652.568138] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 06:24:38 juju-e4d256-prod-github-runner-207 kernel: [ 3652.569370] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 06:24:38 juju-e4d256-prod-github-runner-207 kernel: [ 3652.570538] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 06:24:38 juju-e4d256-prod-github-runner-207 kernel: [ 3652.571710] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 06:24:38 juju-e4d256-prod-github-runner-207 kernel: [ 3652.572953] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 06:24:38 juju-e4d256-prod-github-runner-207 kernel: [ 3652.574069] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 06:24:38 juju-e4d256-prod-github-runner-207 kernel: [ 3652.575420] Call Trace: Aug 22 06:24:38 juju-e4d256-prod-github-runner-207 kernel: [ 3652.576393] Aug 22 06:24:38 juju-e4d256-prod-github-runner-207 kernel: [ 3652.577366] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:24:38 juju-e4d256-prod-github-runner-207 kernel: [ 3652.578481] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:24:38 juju-e4d256-prod-github-runner-207 kernel: [ 3652.579583] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:24:38 juju-e4d256-prod-github-runner-207 kernel: [ 3652.580766] ? show_regs.part.0+0x23/0x29 Aug 22 06:24:38 juju-e4d256-prod-github-runner-207 kernel: [ 3652.581868] ? show_regs.cold+0x8/0xd Aug 22 06:24:38 juju-e4d256-prod-github-runner-207 kernel: [ 3652.582915] ? watchdog_timer_fn+0x1be/0x220 Aug 22 06:24:38 juju-e4d256-prod-github-runner-207 kernel: [ 3652.584010] ? lockup_detector_update_enable+0x60/0x60 Aug 22 06:24:38 juju-e4d256-prod-github-runner-207 kernel: [ 3652.585195] ? __hrtimer_run_queues+0x107/0x230 Aug 22 06:24:38 juju-e4d256-prod-github-runner-207 kernel: [ 3652.586319] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 06:24:38 juju-e4d256-prod-github-runner-207 kernel: [ 3652.587439] ? hrtimer_interrupt+0x101/0x220 Aug 22 06:24:38 juju-e4d256-prod-github-runner-207 kernel: [ 3652.588542] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 06:24:38 juju-e4d256-prod-github-runner-207 kernel: [ 3652.589725] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 06:24:38 juju-e4d256-prod-github-runner-207 kernel: [ 3652.590869] Aug 22 06:24:38 juju-e4d256-prod-github-runner-207 kernel: [ 3652.591769] Aug 22 06:24:38 juju-e4d256-prod-github-runner-207 kernel: [ 3652.592664] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 06:24:38 juju-e4d256-prod-github-runner-207 kernel: [ 3652.593843] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:24:38 juju-e4d256-prod-github-runner-207 kernel: [ 3652.594987] ? _raw_spin_lock+0x22/0x30 Aug 22 06:24:38 juju-e4d256-prod-github-runner-207 kernel: [ 3652.596008] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:24:38 juju-e4d256-prod-github-runner-207 kernel: [ 3652.597140] direct_page_fault+0x206/0x310 [kvm] Aug 22 06:24:38 juju-e4d256-prod-github-runner-207 kernel: [ 3652.598254] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 06:24:38 juju-e4d256-prod-github-runner-207 kernel: [ 3652.599350] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 06:24:38 juju-e4d256-prod-github-runner-207 kernel: [ 3652.600438] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 06:24:38 juju-e4d256-prod-github-runner-207 kernel: [ 3652.601553] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 06:24:38 juju-e4d256-prod-github-runner-207 kernel: [ 3652.602597] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 06:24:38 juju-e4d256-prod-github-runner-207 kernel: [ 3652.603685] handle_exit+0x98/0x230 [kvm_amd] Aug 22 06:24:38 juju-e4d256-prod-github-runner-207 kernel: [ 3652.604858] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 06:24:38 juju-e4d256-prod-github-runner-207 kernel: [ 3652.606055] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 06:24:38 juju-e4d256-prod-github-runner-207 kernel: [ 3652.607071] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 06:24:38 juju-e4d256-prod-github-runner-207 kernel: [ 3652.608083] vcpu_run+0x62/0x2c0 [kvm] Aug 22 06:24:38 juju-e4d256-prod-github-runner-207 kernel: [ 3652.608968] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 06:24:38 juju-e4d256-prod-github-runner-207 kernel: [ 3652.609887] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 06:24:38 juju-e4d256-prod-github-runner-207 kernel: [ 3652.610834] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 06:24:38 juju-e4d256-prod-github-runner-207 kernel: [ 3652.611714] ? __seccomp_filter+0x4a/0x4a0 Aug 22 06:24:38 juju-e4d256-prod-github-runner-207 kernel: [ 3652.612533] ? __fget_files+0x86/0xc0 Aug 22 06:24:38 juju-e4d256-prod-github-runner-207 kernel: [ 3652.613335] __x64_sys_ioctl+0x95/0xd0 Aug 22 06:24:38 juju-e4d256-prod-github-runner-207 kernel: [ 3652.614108] do_syscall_64+0x5c/0xc0 Aug 22 06:24:38 juju-e4d256-prod-github-runner-207 kernel: [ 3652.614844] ? do_futex+0x162/0x1f0 Aug 22 06:24:38 juju-e4d256-prod-github-runner-207 kernel: [ 3652.615565] ? __x64_sys_futex+0x78/0x1e0 Aug 22 06:24:38 juju-e4d256-prod-github-runner-207 kernel: [ 3652.616322] ? __secure_computing+0xa9/0x120 Aug 22 06:24:38 juju-e4d256-prod-github-runner-207 kernel: [ 3652.617117] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 06:24:38 juju-e4d256-prod-github-runner-207 kernel: [ 3652.617987] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:24:38 juju-e4d256-prod-github-runner-207 kernel: [ 3652.618804] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:24:38 juju-e4d256-prod-github-runner-207 kernel: [ 3652.619614] ? do_syscall_64+0x69/0xc0 Aug 22 06:24:38 juju-e4d256-prod-github-runner-207 kernel: [ 3652.620330] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:24:38 juju-e4d256-prod-github-runner-207 kernel: [ 3652.621143] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:24:38 juju-e4d256-prod-github-runner-207 kernel: [ 3652.621930] ? do_syscall_64+0x69/0xc0 Aug 22 06:24:38 juju-e4d256-prod-github-runner-207 kernel: [ 3652.622639] ? do_syscall_64+0x69/0xc0 Aug 22 06:24:38 juju-e4d256-prod-github-runner-207 kernel: [ 3652.623504] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 06:24:38 juju-e4d256-prod-github-runner-207 kernel: [ 3652.624369] RIP: 0033:0x7faa5d0edaff Aug 22 06:24:38 juju-e4d256-prod-github-runner-207 kernel: [ 3652.625117] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 06:24:38 juju-e4d256-prod-github-runner-207 kernel: [ 3652.627459] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 06:24:38 juju-e4d256-prod-github-runner-207 kernel: [ 3652.628519] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 06:24:38 juju-e4d256-prod-github-runner-207 kernel: [ 3652.629566] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 06:24:38 juju-e4d256-prod-github-runner-207 kernel: [ 3652.630589] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 06:24:38 juju-e4d256-prod-github-runner-207 kernel: [ 3652.631610] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 06:24:38 juju-e4d256-prod-github-runner-207 kernel: [ 3652.632632] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 06:24:38 juju-e4d256-prod-github-runner-207 kernel: [ 3652.633673] Aug 22 06:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 3680.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 3319s! [qemu-system-x86:6715] Aug 22 06:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 3680.543879] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 06:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 3680.544112] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 06:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 3680.558239] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 06:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 3680.559673] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 06:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 3680.561081] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 3680.562252] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 06:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 3680.565129] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 06:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 3680.566271] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 06:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 3680.567561] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 06:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 3680.568873] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 06:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 3680.570160] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 06:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 3680.571460] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 06:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 3680.572788] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 06:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 3680.574166] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 06:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 3680.575373] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 06:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 3680.576710] Call Trace: Aug 22 06:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 3680.577684] Aug 22 06:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 3680.578622] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 3680.579741] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 3680.580869] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 3680.582061] ? show_regs.part.0+0x23/0x29 Aug 22 06:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 3680.583140] ? show_regs.cold+0x8/0xd Aug 22 06:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 3680.584186] ? watchdog_timer_fn+0x1be/0x220 Aug 22 06:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 3680.585312] ? lockup_detector_update_enable+0x60/0x60 Aug 22 06:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 3680.586483] ? __hrtimer_run_queues+0x107/0x230 Aug 22 06:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 3680.587598] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 06:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 3680.588731] ? hrtimer_interrupt+0x101/0x220 Aug 22 06:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 3680.589836] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 06:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 3680.591004] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 06:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 3680.592152] Aug 22 06:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 3680.593066] Aug 22 06:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 3680.593948] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 06:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 3680.595077] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 3680.596220] ? _raw_spin_lock+0x22/0x30 Aug 22 06:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 3680.597272] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 3680.598376] direct_page_fault+0x206/0x310 [kvm] Aug 22 06:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 3680.599486] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 06:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 3680.600583] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 06:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 3680.601685] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 06:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 3680.602776] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 06:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 3680.603809] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 06:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 3680.604916] handle_exit+0x98/0x230 [kvm_amd] Aug 22 06:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 3680.605898] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 06:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 3680.606900] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 06:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 3680.607916] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 06:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 3680.608935] vcpu_run+0x62/0x2c0 [kvm] Aug 22 06:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 3680.609829] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 06:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 3680.610734] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 06:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 3680.611691] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 06:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 3680.612570] ? __seccomp_filter+0x4a/0x4a0 Aug 22 06:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 3680.613407] ? __fget_files+0x86/0xc0 Aug 22 06:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 3680.614187] __x64_sys_ioctl+0x95/0xd0 Aug 22 06:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 3680.614948] do_syscall_64+0x5c/0xc0 Aug 22 06:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 3680.615683] ? do_futex+0x162/0x1f0 Aug 22 06:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 3680.616408] ? __x64_sys_futex+0x78/0x1e0 Aug 22 06:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 3680.617185] ? __secure_computing+0xa9/0x120 Aug 22 06:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 3680.617955] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 06:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 3680.618816] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 3680.619628] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 3680.620444] ? do_syscall_64+0x69/0xc0 Aug 22 06:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 3680.621194] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 3680.621990] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 3680.622778] ? do_syscall_64+0x69/0xc0 Aug 22 06:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 3680.623481] ? do_syscall_64+0x69/0xc0 Aug 22 06:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 3680.624182] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 06:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 3680.625005] RIP: 0033:0x7faa5d0edaff Aug 22 06:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 3680.625725] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 06:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 3680.628036] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 06:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 3680.629107] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 06:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 3680.630128] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 06:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 3680.631148] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 06:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 3680.632163] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 06:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 3680.633204] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 06:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 3680.634228] Aug 22 06:25:34 juju-e4d256-prod-github-runner-207 kernel: [ 3708.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 3345s! [qemu-system-x86:6715] Aug 22 06:25:34 juju-e4d256-prod-github-runner-207 kernel: [ 3708.543770] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 06:25:34 juju-e4d256-prod-github-runner-207 kernel: [ 3708.544021] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 06:25:34 juju-e4d256-prod-github-runner-207 kernel: [ 3708.556105] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 06:25:34 juju-e4d256-prod-github-runner-207 kernel: [ 3708.557387] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 06:25:34 juju-e4d256-prod-github-runner-207 kernel: [ 3708.558611] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:25:34 juju-e4d256-prod-github-runner-207 kernel: [ 3708.559663] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 06:25:34 juju-e4d256-prod-github-runner-207 kernel: [ 3708.562218] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 06:25:34 juju-e4d256-prod-github-runner-207 kernel: [ 3708.563260] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 06:25:34 juju-e4d256-prod-github-runner-207 kernel: [ 3708.564428] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 06:25:34 juju-e4d256-prod-github-runner-207 kernel: [ 3708.565591] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 06:25:34 juju-e4d256-prod-github-runner-207 kernel: [ 3708.566754] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 06:25:34 juju-e4d256-prod-github-runner-207 kernel: [ 3708.567916] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 06:25:34 juju-e4d256-prod-github-runner-207 kernel: [ 3708.569097] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 06:25:34 juju-e4d256-prod-github-runner-207 kernel: [ 3708.570327] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 06:25:34 juju-e4d256-prod-github-runner-207 kernel: [ 3708.571436] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 06:25:34 juju-e4d256-prod-github-runner-207 kernel: [ 3708.572639] Call Trace: Aug 22 06:25:34 juju-e4d256-prod-github-runner-207 kernel: [ 3708.573557] Aug 22 06:25:34 juju-e4d256-prod-github-runner-207 kernel: [ 3708.574450] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:25:34 juju-e4d256-prod-github-runner-207 kernel: [ 3708.575484] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:25:34 juju-e4d256-prod-github-runner-207 kernel: [ 3708.576515] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:25:34 juju-e4d256-prod-github-runner-207 kernel: [ 3708.577658] ? show_regs.part.0+0x23/0x29 Aug 22 06:25:34 juju-e4d256-prod-github-runner-207 kernel: [ 3708.578682] ? show_regs.cold+0x8/0xd Aug 22 06:25:34 juju-e4d256-prod-github-runner-207 kernel: [ 3708.579652] ? watchdog_timer_fn+0x1be/0x220 Aug 22 06:25:34 juju-e4d256-prod-github-runner-207 kernel: [ 3708.580667] ? lockup_detector_update_enable+0x60/0x60 Aug 22 06:25:34 juju-e4d256-prod-github-runner-207 kernel: [ 3708.581729] ? __hrtimer_run_queues+0x107/0x230 Aug 22 06:25:34 juju-e4d256-prod-github-runner-207 kernel: [ 3708.582755] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 06:25:34 juju-e4d256-prod-github-runner-207 kernel: [ 3708.583782] ? hrtimer_interrupt+0x101/0x220 Aug 22 06:25:34 juju-e4d256-prod-github-runner-207 kernel: [ 3708.584804] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 06:25:34 juju-e4d256-prod-github-runner-207 kernel: [ 3708.585869] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 06:25:34 juju-e4d256-prod-github-runner-207 kernel: [ 3708.586916] Aug 22 06:25:34 juju-e4d256-prod-github-runner-207 kernel: [ 3708.587798] Aug 22 06:25:34 juju-e4d256-prod-github-runner-207 kernel: [ 3708.588685] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 06:25:34 juju-e4d256-prod-github-runner-207 kernel: [ 3708.589719] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:25:34 juju-e4d256-prod-github-runner-207 kernel: [ 3708.590755] ? _raw_spin_lock+0x22/0x30 Aug 22 06:25:34 juju-e4d256-prod-github-runner-207 kernel: [ 3708.591697] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:25:34 juju-e4d256-prod-github-runner-207 kernel: [ 3708.592734] direct_page_fault+0x206/0x310 [kvm] Aug 22 06:25:34 juju-e4d256-prod-github-runner-207 kernel: [ 3708.593759] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 06:25:34 juju-e4d256-prod-github-runner-207 kernel: [ 3708.594766] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 06:25:34 juju-e4d256-prod-github-runner-207 kernel: [ 3708.595771] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 06:25:34 juju-e4d256-prod-github-runner-207 kernel: [ 3708.596778] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 06:25:34 juju-e4d256-prod-github-runner-207 kernel: [ 3708.597723] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 06:25:34 juju-e4d256-prod-github-runner-207 kernel: [ 3708.598702] handle_exit+0x98/0x230 [kvm_amd] Aug 22 06:25:34 juju-e4d256-prod-github-runner-207 kernel: [ 3708.599594] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 06:25:34 juju-e4d256-prod-github-runner-207 kernel: [ 3708.600521] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 06:25:34 juju-e4d256-prod-github-runner-207 kernel: [ 3708.601447] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 06:25:34 juju-e4d256-prod-github-runner-207 kernel: [ 3708.602350] vcpu_run+0x62/0x2c0 [kvm] Aug 22 06:25:34 juju-e4d256-prod-github-runner-207 kernel: [ 3708.603167] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 06:25:34 juju-e4d256-prod-github-runner-207 kernel: [ 3708.603978] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 06:25:34 juju-e4d256-prod-github-runner-207 kernel: [ 3708.605024] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 06:25:34 juju-e4d256-prod-github-runner-207 kernel: [ 3708.605835] ? __seccomp_filter+0x4a/0x4a0 Aug 22 06:25:34 juju-e4d256-prod-github-runner-207 kernel: [ 3708.606576] ? __fget_files+0x86/0xc0 Aug 22 06:25:34 juju-e4d256-prod-github-runner-207 kernel: [ 3708.607362] __x64_sys_ioctl+0x95/0xd0 Aug 22 06:25:34 juju-e4d256-prod-github-runner-207 kernel: [ 3708.608057] do_syscall_64+0x5c/0xc0 Aug 22 06:25:34 juju-e4d256-prod-github-runner-207 kernel: [ 3708.608748] ? do_futex+0x162/0x1f0 Aug 22 06:25:34 juju-e4d256-prod-github-runner-207 kernel: [ 3708.609397] ? __x64_sys_futex+0x78/0x1e0 Aug 22 06:25:34 juju-e4d256-prod-github-runner-207 kernel: [ 3708.610070] ? __secure_computing+0xa9/0x120 Aug 22 06:25:34 juju-e4d256-prod-github-runner-207 kernel: [ 3708.610759] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 06:25:34 juju-e4d256-prod-github-runner-207 kernel: [ 3708.611522] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:25:34 juju-e4d256-prod-github-runner-207 kernel: [ 3708.612246] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:25:34 juju-e4d256-prod-github-runner-207 kernel: [ 3708.612971] ? do_syscall_64+0x69/0xc0 Aug 22 06:25:34 juju-e4d256-prod-github-runner-207 kernel: [ 3708.613615] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:25:34 juju-e4d256-prod-github-runner-207 kernel: [ 3708.614320] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:25:34 juju-e4d256-prod-github-runner-207 kernel: [ 3708.615018] ? do_syscall_64+0x69/0xc0 Aug 22 06:25:34 juju-e4d256-prod-github-runner-207 kernel: [ 3708.615642] ? do_syscall_64+0x69/0xc0 Aug 22 06:25:34 juju-e4d256-prod-github-runner-207 kernel: [ 3708.616263] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 06:25:34 juju-e4d256-prod-github-runner-207 kernel: [ 3708.616977] RIP: 0033:0x7faa5d0edaff Aug 22 06:25:34 juju-e4d256-prod-github-runner-207 kernel: [ 3708.617639] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 06:25:34 juju-e4d256-prod-github-runner-207 kernel: [ 3708.619629] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 06:25:34 juju-e4d256-prod-github-runner-207 kernel: [ 3708.620550] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 06:25:34 juju-e4d256-prod-github-runner-207 kernel: [ 3708.621447] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 06:25:34 juju-e4d256-prod-github-runner-207 kernel: [ 3708.622356] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 06:25:34 juju-e4d256-prod-github-runner-207 kernel: [ 3708.623278] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 06:25:34 juju-e4d256-prod-github-runner-207 kernel: [ 3708.624175] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 06:25:34 juju-e4d256-prod-github-runner-207 kernel: [ 3708.625081] Aug 22 06:26:02 juju-e4d256-prod-github-runner-207 kernel: [ 3736.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 3371s! [qemu-system-x86:6715] Aug 22 06:26:02 juju-e4d256-prod-github-runner-207 kernel: [ 3736.543703] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 06:26:02 juju-e4d256-prod-github-runner-207 kernel: [ 3736.543956] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 06:26:02 juju-e4d256-prod-github-runner-207 kernel: [ 3736.556062] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 06:26:02 juju-e4d256-prod-github-runner-207 kernel: [ 3736.557330] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 06:26:02 juju-e4d256-prod-github-runner-207 kernel: [ 3736.558563] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:26:02 juju-e4d256-prod-github-runner-207 kernel: [ 3736.559644] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 06:26:02 juju-e4d256-prod-github-runner-207 kernel: [ 3736.562215] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 06:26:02 juju-e4d256-prod-github-runner-207 kernel: [ 3736.563256] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 06:26:02 juju-e4d256-prod-github-runner-207 kernel: [ 3736.564427] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 06:26:02 juju-e4d256-prod-github-runner-207 kernel: [ 3736.565593] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 06:26:02 juju-e4d256-prod-github-runner-207 kernel: [ 3736.566757] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 06:26:02 juju-e4d256-prod-github-runner-207 kernel: [ 3736.567937] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 06:26:02 juju-e4d256-prod-github-runner-207 kernel: [ 3736.569110] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 06:26:02 juju-e4d256-prod-github-runner-207 kernel: [ 3736.570340] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 06:26:02 juju-e4d256-prod-github-runner-207 kernel: [ 3736.571438] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 06:26:02 juju-e4d256-prod-github-runner-207 kernel: [ 3736.572654] Call Trace: Aug 22 06:26:02 juju-e4d256-prod-github-runner-207 kernel: [ 3736.573580] Aug 22 06:26:02 juju-e4d256-prod-github-runner-207 kernel: [ 3736.574483] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:26:02 juju-e4d256-prod-github-runner-207 kernel: [ 3736.575511] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:26:02 juju-e4d256-prod-github-runner-207 kernel: [ 3736.576542] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:26:02 juju-e4d256-prod-github-runner-207 kernel: [ 3736.577706] ? show_regs.part.0+0x23/0x29 Aug 22 06:26:02 juju-e4d256-prod-github-runner-207 kernel: [ 3736.578728] ? show_regs.cold+0x8/0xd Aug 22 06:26:02 juju-e4d256-prod-github-runner-207 kernel: [ 3736.579710] ? watchdog_timer_fn+0x1be/0x220 Aug 22 06:26:02 juju-e4d256-prod-github-runner-207 kernel: [ 3736.580740] ? lockup_detector_update_enable+0x60/0x60 Aug 22 06:26:02 juju-e4d256-prod-github-runner-207 kernel: [ 3736.581804] ? __hrtimer_run_queues+0x107/0x230 Aug 22 06:26:02 juju-e4d256-prod-github-runner-207 kernel: [ 3736.582840] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 06:26:02 juju-e4d256-prod-github-runner-207 kernel: [ 3736.583869] ? hrtimer_interrupt+0x101/0x220 Aug 22 06:26:02 juju-e4d256-prod-github-runner-207 kernel: [ 3736.584894] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 06:26:02 juju-e4d256-prod-github-runner-207 kernel: [ 3736.585961] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 06:26:02 juju-e4d256-prod-github-runner-207 kernel: [ 3736.587009] Aug 22 06:26:02 juju-e4d256-prod-github-runner-207 kernel: [ 3736.587883] Aug 22 06:26:02 juju-e4d256-prod-github-runner-207 kernel: [ 3736.588764] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 06:26:02 juju-e4d256-prod-github-runner-207 kernel: [ 3736.589973] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:26:02 juju-e4d256-prod-github-runner-207 kernel: [ 3736.591198] ? _raw_spin_lock+0x22/0x30 Aug 22 06:26:02 juju-e4d256-prod-github-runner-207 kernel: [ 3736.592204] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:26:02 juju-e4d256-prod-github-runner-207 kernel: [ 3736.593267] direct_page_fault+0x206/0x310 [kvm] Aug 22 06:26:02 juju-e4d256-prod-github-runner-207 kernel: [ 3736.594306] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 06:26:02 juju-e4d256-prod-github-runner-207 kernel: [ 3736.595325] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 06:26:02 juju-e4d256-prod-github-runner-207 kernel: [ 3736.596389] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 06:26:02 juju-e4d256-prod-github-runner-207 kernel: [ 3736.597419] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 06:26:02 juju-e4d256-prod-github-runner-207 kernel: [ 3736.598378] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 06:26:02 juju-e4d256-prod-github-runner-207 kernel: [ 3736.599375] handle_exit+0x98/0x230 [kvm_amd] Aug 22 06:26:02 juju-e4d256-prod-github-runner-207 kernel: [ 3736.600299] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 06:26:02 juju-e4d256-prod-github-runner-207 kernel: [ 3736.601223] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 06:26:02 juju-e4d256-prod-github-runner-207 kernel: [ 3736.602169] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 06:26:02 juju-e4d256-prod-github-runner-207 kernel: [ 3736.603109] vcpu_run+0x62/0x2c0 [kvm] Aug 22 06:26:02 juju-e4d256-prod-github-runner-207 kernel: [ 3736.603941] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 06:26:02 juju-e4d256-prod-github-runner-207 kernel: [ 3736.604777] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 06:26:02 juju-e4d256-prod-github-runner-207 kernel: [ 3736.605642] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 06:26:02 juju-e4d256-prod-github-runner-207 kernel: [ 3736.606458] ? __seccomp_filter+0x4a/0x4a0 Aug 22 06:26:02 juju-e4d256-prod-github-runner-207 kernel: [ 3736.607225] ? __fget_files+0x86/0xc0 Aug 22 06:26:02 juju-e4d256-prod-github-runner-207 kernel: [ 3736.607951] __x64_sys_ioctl+0x95/0xd0 Aug 22 06:26:02 juju-e4d256-prod-github-runner-207 kernel: [ 3736.608679] do_syscall_64+0x5c/0xc0 Aug 22 06:26:02 juju-e4d256-prod-github-runner-207 kernel: [ 3736.609367] ? do_futex+0x162/0x1f0 Aug 22 06:26:02 juju-e4d256-prod-github-runner-207 kernel: [ 3736.610017] ? __x64_sys_futex+0x78/0x1e0 Aug 22 06:26:02 juju-e4d256-prod-github-runner-207 kernel: [ 3736.610690] ? __secure_computing+0xa9/0x120 Aug 22 06:26:02 juju-e4d256-prod-github-runner-207 kernel: [ 3736.611379] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 06:26:02 juju-e4d256-prod-github-runner-207 kernel: [ 3736.612160] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:26:02 juju-e4d256-prod-github-runner-207 kernel: [ 3736.612884] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:26:02 juju-e4d256-prod-github-runner-207 kernel: [ 3736.613604] ? do_syscall_64+0x69/0xc0 Aug 22 06:26:02 juju-e4d256-prod-github-runner-207 kernel: [ 3736.614250] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:26:02 juju-e4d256-prod-github-runner-207 kernel: [ 3736.614953] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:26:02 juju-e4d256-prod-github-runner-207 kernel: [ 3736.615747] ? do_syscall_64+0x69/0xc0 Aug 22 06:26:02 juju-e4d256-prod-github-runner-207 kernel: [ 3736.616384] ? do_syscall_64+0x69/0xc0 Aug 22 06:26:02 juju-e4d256-prod-github-runner-207 kernel: [ 3736.617007] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 06:26:02 juju-e4d256-prod-github-runner-207 kernel: [ 3736.617718] RIP: 0033:0x7faa5d0edaff Aug 22 06:26:02 juju-e4d256-prod-github-runner-207 kernel: [ 3736.618383] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 06:26:02 juju-e4d256-prod-github-runner-207 kernel: [ 3736.620382] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 06:26:02 juju-e4d256-prod-github-runner-207 kernel: [ 3736.621300] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 06:26:02 juju-e4d256-prod-github-runner-207 kernel: [ 3736.622196] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 06:26:02 juju-e4d256-prod-github-runner-207 kernel: [ 3736.623090] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 06:26:02 juju-e4d256-prod-github-runner-207 kernel: [ 3736.623990] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 06:26:02 juju-e4d256-prod-github-runner-207 kernel: [ 3736.624877] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 06:26:02 juju-e4d256-prod-github-runner-207 kernel: [ 3736.625769] Aug 22 06:26:30 juju-e4d256-prod-github-runner-207 kernel: [ 3764.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 3398s! [qemu-system-x86:6715] Aug 22 06:26:30 juju-e4d256-prod-github-runner-207 kernel: [ 3764.543762] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 06:26:30 juju-e4d256-prod-github-runner-207 kernel: [ 3764.544026] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 06:26:30 juju-e4d256-prod-github-runner-207 kernel: [ 3764.556213] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 06:26:30 juju-e4d256-prod-github-runner-207 kernel: [ 3764.557517] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 06:26:30 juju-e4d256-prod-github-runner-207 kernel: [ 3764.558756] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:26:30 juju-e4d256-prod-github-runner-207 kernel: [ 3764.559831] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 06:26:30 juju-e4d256-prod-github-runner-207 kernel: [ 3764.562384] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 06:26:30 juju-e4d256-prod-github-runner-207 kernel: [ 3764.563434] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 06:26:30 juju-e4d256-prod-github-runner-207 kernel: [ 3764.564626] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 06:26:30 juju-e4d256-prod-github-runner-207 kernel: [ 3764.565782] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 06:26:30 juju-e4d256-prod-github-runner-207 kernel: [ 3764.566944] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 06:26:30 juju-e4d256-prod-github-runner-207 kernel: [ 3764.568225] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 06:26:30 juju-e4d256-prod-github-runner-207 kernel: [ 3764.569423] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 06:26:30 juju-e4d256-prod-github-runner-207 kernel: [ 3764.570675] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 06:26:30 juju-e4d256-prod-github-runner-207 kernel: [ 3764.571798] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 06:26:30 juju-e4d256-prod-github-runner-207 kernel: [ 3764.573019] Call Trace: Aug 22 06:26:30 juju-e4d256-prod-github-runner-207 kernel: [ 3764.573939] Aug 22 06:26:30 juju-e4d256-prod-github-runner-207 kernel: [ 3764.574843] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:26:30 juju-e4d256-prod-github-runner-207 kernel: [ 3764.575911] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:26:30 juju-e4d256-prod-github-runner-207 kernel: [ 3764.576986] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:26:30 juju-e4d256-prod-github-runner-207 kernel: [ 3764.578281] ? show_regs.part.0+0x23/0x29 Aug 22 06:26:30 juju-e4d256-prod-github-runner-207 kernel: [ 3764.579295] ? show_regs.cold+0x8/0xd Aug 22 06:26:30 juju-e4d256-prod-github-runner-207 kernel: [ 3764.580283] ? watchdog_timer_fn+0x1be/0x220 Aug 22 06:26:30 juju-e4d256-prod-github-runner-207 kernel: [ 3764.581290] ? lockup_detector_update_enable+0x60/0x60 Aug 22 06:26:30 juju-e4d256-prod-github-runner-207 kernel: [ 3764.582350] ? __hrtimer_run_queues+0x107/0x230 Aug 22 06:26:30 juju-e4d256-prod-github-runner-207 kernel: [ 3764.583376] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 06:26:30 juju-e4d256-prod-github-runner-207 kernel: [ 3764.584411] ? hrtimer_interrupt+0x101/0x220 Aug 22 06:26:30 juju-e4d256-prod-github-runner-207 kernel: [ 3764.585427] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 06:26:30 juju-e4d256-prod-github-runner-207 kernel: [ 3764.586492] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 06:26:30 juju-e4d256-prod-github-runner-207 kernel: [ 3764.587533] Aug 22 06:26:30 juju-e4d256-prod-github-runner-207 kernel: [ 3764.588400] Aug 22 06:26:30 juju-e4d256-prod-github-runner-207 kernel: [ 3764.589235] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 06:26:30 juju-e4d256-prod-github-runner-207 kernel: [ 3764.590263] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:26:30 juju-e4d256-prod-github-runner-207 kernel: [ 3764.591297] ? _raw_spin_lock+0x22/0x30 Aug 22 06:26:30 juju-e4d256-prod-github-runner-207 kernel: [ 3764.592250] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:26:30 juju-e4d256-prod-github-runner-207 kernel: [ 3764.593273] direct_page_fault+0x206/0x310 [kvm] Aug 22 06:26:30 juju-e4d256-prod-github-runner-207 kernel: [ 3764.594327] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 06:26:30 juju-e4d256-prod-github-runner-207 kernel: [ 3764.595369] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 06:26:30 juju-e4d256-prod-github-runner-207 kernel: [ 3764.596406] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 06:26:30 juju-e4d256-prod-github-runner-207 kernel: [ 3764.597429] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 06:26:30 juju-e4d256-prod-github-runner-207 kernel: [ 3764.598442] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 06:26:30 juju-e4d256-prod-github-runner-207 kernel: [ 3764.599462] handle_exit+0x98/0x230 [kvm_amd] Aug 22 06:26:30 juju-e4d256-prod-github-runner-207 kernel: [ 3764.600385] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 06:26:30 juju-e4d256-prod-github-runner-207 kernel: [ 3764.601307] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 06:26:30 juju-e4d256-prod-github-runner-207 kernel: [ 3764.602235] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 06:26:30 juju-e4d256-prod-github-runner-207 kernel: [ 3764.603140] vcpu_run+0x62/0x2c0 [kvm] Aug 22 06:26:30 juju-e4d256-prod-github-runner-207 kernel: [ 3764.603982] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 06:26:30 juju-e4d256-prod-github-runner-207 kernel: [ 3764.604798] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 06:26:30 juju-e4d256-prod-github-runner-207 kernel: [ 3764.605657] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 06:26:30 juju-e4d256-prod-github-runner-207 kernel: [ 3764.606458] ? __seccomp_filter+0x4a/0x4a0 Aug 22 06:26:30 juju-e4d256-prod-github-runner-207 kernel: [ 3764.607204] ? __fget_files+0x86/0xc0 Aug 22 06:26:30 juju-e4d256-prod-github-runner-207 kernel: [ 3764.607937] __x64_sys_ioctl+0x95/0xd0 Aug 22 06:26:30 juju-e4d256-prod-github-runner-207 kernel: [ 3764.608660] do_syscall_64+0x5c/0xc0 Aug 22 06:26:30 juju-e4d256-prod-github-runner-207 kernel: [ 3764.609344] ? do_futex+0x162/0x1f0 Aug 22 06:26:30 juju-e4d256-prod-github-runner-207 kernel: [ 3764.609998] ? __x64_sys_futex+0x78/0x1e0 Aug 22 06:26:30 juju-e4d256-prod-github-runner-207 kernel: [ 3764.610673] ? __secure_computing+0xa9/0x120 Aug 22 06:26:30 juju-e4d256-prod-github-runner-207 kernel: [ 3764.611364] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 06:26:30 juju-e4d256-prod-github-runner-207 kernel: [ 3764.612155] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:26:30 juju-e4d256-prod-github-runner-207 kernel: [ 3764.612909] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:26:30 juju-e4d256-prod-github-runner-207 kernel: [ 3764.613642] ? do_syscall_64+0x69/0xc0 Aug 22 06:26:30 juju-e4d256-prod-github-runner-207 kernel: [ 3764.614287] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:26:30 juju-e4d256-prod-github-runner-207 kernel: [ 3764.614993] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:26:30 juju-e4d256-prod-github-runner-207 kernel: [ 3764.615711] ? do_syscall_64+0x69/0xc0 Aug 22 06:26:30 juju-e4d256-prod-github-runner-207 kernel: [ 3764.616337] ? do_syscall_64+0x69/0xc0 Aug 22 06:26:30 juju-e4d256-prod-github-runner-207 kernel: [ 3764.616961] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 06:26:30 juju-e4d256-prod-github-runner-207 kernel: [ 3764.617665] RIP: 0033:0x7faa5d0edaff Aug 22 06:26:30 juju-e4d256-prod-github-runner-207 kernel: [ 3764.618325] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 06:26:30 juju-e4d256-prod-github-runner-207 kernel: [ 3764.620325] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 06:26:30 juju-e4d256-prod-github-runner-207 kernel: [ 3764.621245] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 06:26:30 juju-e4d256-prod-github-runner-207 kernel: [ 3764.622135] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 06:26:30 juju-e4d256-prod-github-runner-207 kernel: [ 3764.623029] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 06:26:30 juju-e4d256-prod-github-runner-207 kernel: [ 3764.623931] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 06:26:30 juju-e4d256-prod-github-runner-207 kernel: [ 3764.624823] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 06:26:30 juju-e4d256-prod-github-runner-207 kernel: [ 3764.625720] Aug 22 06:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 3777.440706] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 06:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 3777.442325] rcu: 1-....: (912196 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=444222 Aug 22 06:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 3777.443459] (t=915060 jiffies g=23269 q=12673) Aug 22 06:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 3777.444271] NMI backtrace for cpu 1 Aug 22 06:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 3777.445015] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 06:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 3777.446130] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 06:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 3777.447195] Call Trace: Aug 22 06:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 3777.447897] Aug 22 06:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 3777.448598] show_stack+0x52/0x5c Aug 22 06:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 3777.449331] dump_stack_lvl+0x4a/0x63 Aug 22 06:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 3777.450073] dump_stack+0x10/0x16 Aug 22 06:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 3777.450788] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 06:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 3777.451587] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 06:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 3777.452421] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 06:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 3777.453284] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 06:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 3777.454116] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 06:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 3777.454921] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 06:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 3777.455709] print_cpu_stall.cold+0x2f/0xe2 Aug 22 06:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 3777.456471] ? timekeeping_update+0xf7/0x150 Aug 22 06:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 3777.457244] check_cpu_stall+0x109/0x270 Aug 22 06:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 3777.458005] rcu_sched_clock_irq+0x9a/0x250 Aug 22 06:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 3777.458768] update_process_times+0x94/0xd0 Aug 22 06:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 3777.459545] tick_sched_handle+0x29/0x70 Aug 22 06:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 3777.460316] tick_sched_timer+0x8c/0xc0 Aug 22 06:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 3777.461062] ? tick_nohz_handler+0xb0/0xb0 Aug 22 06:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 3777.461818] __hrtimer_run_queues+0x107/0x230 Aug 22 06:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 3777.462612] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 06:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 3777.463408] hrtimer_interrupt+0x101/0x220 Aug 22 06:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 3777.464188] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 06:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 3777.464995] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 06:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 3777.465792] Aug 22 06:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 3777.466424] Aug 22 06:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 3777.467092] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 06:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 3777.467962] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 3777.468868] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 06:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 3777.471093] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 06:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 3777.472002] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 06:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 3777.473016] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 06:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 3777.474010] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 06:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 3777.474974] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 06:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 3777.475951] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 06:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 3777.476930] ? _raw_spin_lock+0x22/0x30 Aug 22 06:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 3777.477723] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 3777.478638] direct_page_fault+0x206/0x310 [kvm] Aug 22 06:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 3777.479510] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 06:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 3777.480338] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 06:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 3777.481179] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 06:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 3777.482047] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 06:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 3777.482872] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 06:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 3777.483799] handle_exit+0x98/0x230 [kvm_amd] Aug 22 06:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 3777.484570] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 06:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 3777.485378] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 06:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 3777.486178] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 06:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 3777.486962] vcpu_run+0x62/0x2c0 [kvm] Aug 22 06:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 3777.487694] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 06:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 3777.488442] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 06:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 3777.489279] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 06:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 3777.490043] ? __seccomp_filter+0x4a/0x4a0 Aug 22 06:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 3777.490765] ? __fget_files+0x86/0xc0 Aug 22 06:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 3777.491458] __x64_sys_ioctl+0x95/0xd0 Aug 22 06:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 3777.492180] do_syscall_64+0x5c/0xc0 Aug 22 06:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 3777.492864] ? do_futex+0x162/0x1f0 Aug 22 06:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 3777.493553] ? __x64_sys_futex+0x78/0x1e0 Aug 22 06:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 3777.494288] ? __secure_computing+0xa9/0x120 Aug 22 06:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 3777.495010] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 06:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 3777.495847] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 3777.496608] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 3777.497362] ? do_syscall_64+0x69/0xc0 Aug 22 06:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 3777.498049] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 3777.498808] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 3777.499629] ? do_syscall_64+0x69/0xc0 Aug 22 06:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 3777.500340] ? do_syscall_64+0x69/0xc0 Aug 22 06:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 3777.501032] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 06:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 3777.501822] RIP: 0033:0x7faa5d0edaff Aug 22 06:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 3777.502571] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 06:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 3777.504758] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 06:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 3777.505752] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 06:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 3777.506705] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 06:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 3777.507693] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 06:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 3777.508728] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 06:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 3777.509673] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 06:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 3777.510605] Aug 22 06:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 3804.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 3435s! [qemu-system-x86:6715] Aug 22 06:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 3804.544119] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 06:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 3804.544360] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 06:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 3804.558302] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 06:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 3804.559762] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 06:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 3804.561140] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 3804.562304] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 06:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 3804.565187] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 06:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 3804.566340] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 06:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 3804.567659] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 06:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 3804.568955] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 06:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 3804.570254] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 06:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 3804.571562] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 06:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 3804.572864] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 06:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 3804.574246] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 06:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 3804.575465] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 06:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 3804.576797] Call Trace: Aug 22 06:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 3804.577771] Aug 22 06:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 3804.578725] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 3804.579868] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 3804.580982] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 3804.582186] ? show_regs.part.0+0x23/0x29 Aug 22 06:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 3804.583279] ? show_regs.cold+0x8/0xd Aug 22 06:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 3804.584325] ? watchdog_timer_fn+0x1be/0x220 Aug 22 06:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 3804.585421] ? lockup_detector_update_enable+0x60/0x60 Aug 22 06:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 3804.586582] ? __hrtimer_run_queues+0x107/0x230 Aug 22 06:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 3804.587721] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 06:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 3804.588829] ? hrtimer_interrupt+0x101/0x220 Aug 22 06:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 3804.589923] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 06:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 3804.591095] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 06:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 3804.592246] Aug 22 06:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 3804.593146] Aug 22 06:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 3804.594030] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 06:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 3804.595193] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 3804.596350] ? _raw_spin_lock+0x22/0x30 Aug 22 06:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 3804.597378] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 3804.598484] direct_page_fault+0x206/0x310 [kvm] Aug 22 06:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 3804.599606] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 06:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 3804.600781] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 06:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 3804.601847] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 06:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 3804.602854] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 06:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 3804.603830] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 06:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 3804.604823] handle_exit+0x98/0x230 [kvm_amd] Aug 22 06:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 3804.605726] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 06:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 3804.606672] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 06:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 3804.607619] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 06:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 3804.608541] vcpu_run+0x62/0x2c0 [kvm] Aug 22 06:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 3804.609362] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 06:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 3804.610192] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 06:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 3804.611102] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 06:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 3804.611924] ? __seccomp_filter+0x4a/0x4a0 Aug 22 06:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 3804.612708] ? __fget_files+0x86/0xc0 Aug 22 06:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 3804.613557] __x64_sys_ioctl+0x95/0xd0 Aug 22 06:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 3804.614398] do_syscall_64+0x5c/0xc0 Aug 22 06:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 3804.615591] ? do_futex+0x162/0x1f0 Aug 22 06:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 3804.616450] ? __x64_sys_futex+0x78/0x1e0 Aug 22 06:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 3804.617387] ? __secure_computing+0xa9/0x120 Aug 22 06:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 3804.618331] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 06:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 3804.619390] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 3804.620403] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 3804.621428] ? do_syscall_64+0x69/0xc0 Aug 22 06:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 3804.622318] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 3804.623320] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 3804.624297] ? do_syscall_64+0x69/0xc0 Aug 22 06:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 3804.625171] ? do_syscall_64+0x69/0xc0 Aug 22 06:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 3804.626031] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 06:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 3804.626980] RIP: 0033:0x7faa5d0edaff Aug 22 06:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 3804.627899] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 06:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 3804.630613] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 06:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 3804.631901] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 06:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 3804.633135] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 06:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 3804.634382] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 06:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 3804.635640] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 06:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 3804.636881] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 06:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 3804.638143] Aug 22 06:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 3832.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 3461s! [qemu-system-x86:6715] Aug 22 06:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 3832.543739] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 06:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 3832.543999] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 06:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 3832.556228] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 06:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 3832.557497] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 06:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 3832.558719] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 3832.559794] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 06:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 3832.562356] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 06:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 3832.563441] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 06:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 3832.564638] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 06:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 3832.565804] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 06:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 3832.567014] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 06:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 3832.568174] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 06:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 3832.569337] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 06:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 3832.570568] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 06:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 3832.571690] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 06:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 3832.572883] Call Trace: Aug 22 06:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 3832.573794] Aug 22 06:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 3832.574698] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 3832.575748] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 3832.576769] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 3832.577862] ? show_regs.part.0+0x23/0x29 Aug 22 06:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 3832.578911] ? show_regs.cold+0x8/0xd Aug 22 06:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 3832.579886] ? watchdog_timer_fn+0x1be/0x220 Aug 22 06:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 3832.580893] ? lockup_detector_update_enable+0x60/0x60 Aug 22 06:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 3832.581956] ? __hrtimer_run_queues+0x107/0x230 Aug 22 06:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 3832.582994] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 06:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 3832.584017] ? hrtimer_interrupt+0x101/0x220 Aug 22 06:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 3832.585031] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 06:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 3832.586102] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 06:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 3832.587167] Aug 22 06:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 3832.588025] Aug 22 06:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 3832.588868] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 06:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 3832.589900] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 3832.590948] ? _raw_spin_lock+0x22/0x30 Aug 22 06:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 3832.591921] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 3832.592958] direct_page_fault+0x206/0x310 [kvm] Aug 22 06:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 3832.593983] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 06:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 3832.595019] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 06:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 3832.596032] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 06:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 3832.597045] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 06:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 3832.597991] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 06:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 3832.598979] handle_exit+0x98/0x230 [kvm_amd] Aug 22 06:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 3832.599874] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 06:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 3832.600790] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 06:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 3832.601720] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 06:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 3832.602625] vcpu_run+0x62/0x2c0 [kvm] Aug 22 06:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 3832.603450] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 06:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 3832.604261] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 06:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 3832.605121] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 06:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 3832.606092] ? __seccomp_filter+0x4a/0x4a0 Aug 22 06:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 3832.606852] ? __fget_files+0x86/0xc0 Aug 22 06:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 3832.607557] __x64_sys_ioctl+0x95/0xd0 Aug 22 06:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 3832.608370] do_syscall_64+0x5c/0xc0 Aug 22 06:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 3832.609036] ? do_futex+0x162/0x1f0 Aug 22 06:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 3832.609687] ? __x64_sys_futex+0x78/0x1e0 Aug 22 06:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 3832.610363] ? __secure_computing+0xa9/0x120 Aug 22 06:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 3832.611069] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 06:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 3832.611831] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 3832.612554] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 3832.613275] ? do_syscall_64+0x69/0xc0 Aug 22 06:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 3832.613921] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 3832.614628] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 3832.615341] ? do_syscall_64+0x69/0xc0 Aug 22 06:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 3832.615967] ? do_syscall_64+0x69/0xc0 Aug 22 06:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 3832.616590] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 06:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 3832.617304] RIP: 0033:0x7faa5d0edaff Aug 22 06:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 3832.617978] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 06:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 3832.619990] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 06:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 3832.620910] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 06:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 3832.621814] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 06:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 3832.622713] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 06:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 3832.623616] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 06:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 3832.624512] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 06:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 3832.625410] Aug 22 06:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 3860.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 3487s! [qemu-system-x86:6715] Aug 22 06:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 3860.543769] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 06:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 3860.544032] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 06:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 3860.556191] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 06:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 3860.557479] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 06:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 3860.558791] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 3860.560008] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 06:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 3860.562745] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 06:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 3860.563845] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 06:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 3860.565015] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 06:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 3860.566195] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 06:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 3860.568659] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 06:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 3860.569938] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 06:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 3860.571211] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 06:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 3860.572484] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 06:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 3860.573633] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 06:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 3860.574849] Call Trace: Aug 22 06:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 3860.575822] Aug 22 06:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 3860.576741] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 3860.578305] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 3860.579417] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 3860.580513] ? show_regs.part.0+0x23/0x29 Aug 22 06:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 3860.581515] ? show_regs.cold+0x8/0xd Aug 22 06:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 3860.582538] ? watchdog_timer_fn+0x1be/0x220 Aug 22 06:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 3860.583610] ? lockup_detector_update_enable+0x60/0x60 Aug 22 06:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 3860.584707] ? __hrtimer_run_queues+0x107/0x230 Aug 22 06:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 3860.585759] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 06:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 3860.586838] ? hrtimer_interrupt+0x101/0x220 Aug 22 06:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 3860.587866] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 06:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 3860.588948] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 06:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 3860.589992] Aug 22 06:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 3860.590860] Aug 22 06:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 3860.591710] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 06:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 3860.592792] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 3860.593866] ? _raw_spin_lock+0x22/0x30 Aug 22 06:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 3860.594866] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 3860.595907] direct_page_fault+0x206/0x310 [kvm] Aug 22 06:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 3860.596933] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 06:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 3860.598039] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 06:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 3860.599306] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 06:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 3860.600473] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 06:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 3860.601442] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 06:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 3860.602535] handle_exit+0x98/0x230 [kvm_amd] Aug 22 06:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 3860.603510] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 06:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 3860.604438] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 06:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 3860.605408] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 06:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 3860.606333] vcpu_run+0x62/0x2c0 [kvm] Aug 22 06:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 3860.607164] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 06:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 3860.608082] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 06:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 3860.609352] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 06:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 3860.610518] ? __seccomp_filter+0x4a/0x4a0 Aug 22 06:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 3860.611619] ? __fget_files+0x86/0xc0 Aug 22 06:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 3860.612661] __x64_sys_ioctl+0x95/0xd0 Aug 22 06:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 3860.613723] do_syscall_64+0x5c/0xc0 Aug 22 06:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 3860.614773] ? do_futex+0x162/0x1f0 Aug 22 06:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 3860.615605] ? __x64_sys_futex+0x78/0x1e0 Aug 22 06:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 3860.616355] ? __secure_computing+0xa9/0x120 Aug 22 06:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 3860.617348] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 06:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 3860.618665] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 3860.619689] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 3860.620717] ? do_syscall_64+0x69/0xc0 Aug 22 06:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 3860.621617] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 3860.622579] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 3860.623449] ? do_syscall_64+0x69/0xc0 Aug 22 06:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 3860.624092] ? do_syscall_64+0x69/0xc0 Aug 22 06:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 3860.624718] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 06:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 3860.625434] RIP: 0033:0x7faa5d0edaff Aug 22 06:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 3860.626127] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 06:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 3860.628188] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 06:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 3860.629106] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 06:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 3860.629997] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 06:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 3860.630903] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 06:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 3860.631797] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 06:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 3860.632689] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 06:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 3860.633589] Aug 22 06:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 3888.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 3513s! [qemu-system-x86:6715] Aug 22 06:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 3888.543149] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 06:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 3888.543219] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 06:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 3888.555520] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 06:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 3888.556799] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 06:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 3888.558038] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 3888.559116] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 06:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 3888.561738] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 06:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 3888.562807] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 06:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 3888.563969] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 06:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 3888.565129] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 06:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 3888.566329] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 06:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 3888.567505] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 06:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 3888.568671] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 06:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 3888.569902] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 06:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 3888.571034] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 06:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 3888.572263] Call Trace: Aug 22 06:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 3888.573178] Aug 22 06:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 3888.574062] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 3888.575128] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 3888.576171] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 3888.577274] ? show_regs.part.0+0x23/0x29 Aug 22 06:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 3888.578286] ? show_regs.cold+0x8/0xd Aug 22 06:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 3888.579258] ? watchdog_timer_fn+0x1be/0x220 Aug 22 06:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 3888.580291] ? lockup_detector_update_enable+0x60/0x60 Aug 22 06:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 3888.581371] ? __hrtimer_run_queues+0x107/0x230 Aug 22 06:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 3888.582466] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 06:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 3888.583499] ? hrtimer_interrupt+0x101/0x220 Aug 22 06:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 3888.584527] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 06:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 3888.585617] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 06:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 3888.586691] Aug 22 06:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 3888.587566] Aug 22 06:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 3888.588410] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 06:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 3888.589448] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 3888.590512] ? _raw_spin_lock+0x22/0x30 Aug 22 06:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 3888.591467] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 3888.592503] direct_page_fault+0x206/0x310 [kvm] Aug 22 06:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 3888.593560] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 06:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 3888.594599] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 06:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 3888.595689] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 06:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 3888.596676] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 06:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 3888.597627] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 06:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 3888.598642] handle_exit+0x98/0x230 [kvm_amd] Aug 22 06:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 3888.599541] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 06:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 3888.600458] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 06:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 3888.601400] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 06:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 3888.602353] vcpu_run+0x62/0x2c0 [kvm] Aug 22 06:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 3888.603203] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 06:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 3888.604024] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 06:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 3888.604881] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 06:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 3888.605687] ? __seccomp_filter+0x4a/0x4a0 Aug 22 06:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 3888.606446] ? __fget_files+0x86/0xc0 Aug 22 06:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 3888.607171] __x64_sys_ioctl+0x95/0xd0 Aug 22 06:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 3888.607865] do_syscall_64+0x5c/0xc0 Aug 22 06:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 3888.608548] ? do_futex+0x162/0x1f0 Aug 22 06:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 3888.609208] ? __x64_sys_futex+0x78/0x1e0 Aug 22 06:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 3888.609984] ? __secure_computing+0xa9/0x120 Aug 22 06:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 3888.610709] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 06:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 3888.611475] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 3888.612213] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 3888.612957] ? do_syscall_64+0x69/0xc0 Aug 22 06:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 3888.613639] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 3888.614361] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 3888.615059] ? do_syscall_64+0x69/0xc0 Aug 22 06:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 3888.615686] ? do_syscall_64+0x69/0xc0 Aug 22 06:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 3888.616311] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 06:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 3888.617018] RIP: 0033:0x7faa5d0edaff Aug 22 06:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 3888.617664] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 06:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 3888.619679] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 06:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 3888.620593] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 06:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 3888.621484] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 06:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 3888.622408] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 06:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 3888.623326] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 06:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 3888.624248] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 06:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 3888.625146] Aug 22 06:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 3916.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 3539s! [qemu-system-x86:6715] Aug 22 06:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 3916.543719] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 06:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 3916.543967] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 06:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 3916.556064] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 06:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 3916.557328] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 06:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 3916.558577] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 3916.559635] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 06:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 3916.562207] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 06:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 3916.563250] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 06:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 3916.564411] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 06:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 3916.565576] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 06:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 3916.566755] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 06:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 3916.567915] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 06:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 3916.569086] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 06:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 3916.570334] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 06:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 3916.571440] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 06:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 3916.572634] Call Trace: Aug 22 06:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 3916.573547] Aug 22 06:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 3916.574461] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 3916.575496] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 3916.576516] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 3916.577612] ? show_regs.part.0+0x23/0x29 Aug 22 06:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 3916.578629] ? show_regs.cold+0x8/0xd Aug 22 06:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 3916.579601] ? watchdog_timer_fn+0x1be/0x220 Aug 22 06:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 3916.580608] ? lockup_detector_update_enable+0x60/0x60 Aug 22 06:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 3916.581674] ? __hrtimer_run_queues+0x107/0x230 Aug 22 06:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 3916.582721] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 06:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 3916.583744] ? hrtimer_interrupt+0x101/0x220 Aug 22 06:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 3916.584757] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 06:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 3916.585839] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 06:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 3916.586885] Aug 22 06:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 3916.587738] Aug 22 06:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 3916.588575] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 06:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 3916.589609] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 3916.590665] ? _raw_spin_lock+0x22/0x30 Aug 22 06:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 3916.591610] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 3916.592805] direct_page_fault+0x206/0x310 [kvm] Aug 22 06:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 3916.593848] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 06:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 3916.594858] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 06:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 3916.595862] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 06:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 3916.596874] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 06:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 3916.597997] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 06:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 3916.598976] handle_exit+0x98/0x230 [kvm_amd] Aug 22 06:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 3916.599876] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 06:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 3916.600793] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 06:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 3916.601719] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 06:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 3916.602642] vcpu_run+0x62/0x2c0 [kvm] Aug 22 06:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 3916.603453] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 06:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 3916.604261] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 06:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 3916.605118] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 06:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 3916.605933] ? __seccomp_filter+0x4a/0x4a0 Aug 22 06:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 3916.606683] ? __fget_files+0x86/0xc0 Aug 22 06:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 3916.607390] __x64_sys_ioctl+0x95/0xd0 Aug 22 06:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 3916.608083] do_syscall_64+0x5c/0xc0 Aug 22 06:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 3916.608752] ? do_futex+0x162/0x1f0 Aug 22 06:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 3916.609402] ? __x64_sys_futex+0x78/0x1e0 Aug 22 06:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 3916.610105] ? __secure_computing+0xa9/0x120 Aug 22 06:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 3916.610797] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 06:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 3916.611559] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 3916.612284] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 3916.613008] ? do_syscall_64+0x69/0xc0 Aug 22 06:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 3916.613659] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 3916.614382] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 3916.615078] ? do_syscall_64+0x69/0xc0 Aug 22 06:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 3916.615710] ? do_syscall_64+0x69/0xc0 Aug 22 06:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 3916.616333] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 06:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 3916.617039] RIP: 0033:0x7faa5d0edaff Aug 22 06:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 3916.617704] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 06:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 3916.619713] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 06:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 3916.620627] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 06:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 3916.621519] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 06:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 3916.622432] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 06:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 3916.623322] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 06:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 3916.624217] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 06:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 3916.625110] Aug 22 06:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 3944.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 3565s! [qemu-system-x86:6715] Aug 22 06:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 3944.543704] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 06:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 3944.543961] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 06:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 3944.556063] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 06:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 3944.557555] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 06:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 3944.558954] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 3944.560129] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 06:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 3944.563048] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 06:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 3944.564194] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 06:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 3944.565508] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 06:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 3944.566825] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 06:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 3944.568134] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 06:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 3944.569437] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 06:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 3944.570753] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 06:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 3944.572144] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 06:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 3944.573355] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 06:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 3944.574716] Call Trace: Aug 22 06:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 3944.575680] Aug 22 06:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 3944.576627] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 3944.577775] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 3944.578886] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 3944.580074] ? show_regs.part.0+0x23/0x29 Aug 22 06:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 3944.581155] ? show_regs.cold+0x8/0xd Aug 22 06:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 3944.582222] ? watchdog_timer_fn+0x1be/0x220 Aug 22 06:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 3944.583327] ? lockup_detector_update_enable+0x60/0x60 Aug 22 06:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 3944.584497] ? __hrtimer_run_queues+0x107/0x230 Aug 22 06:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 3944.585629] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 06:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 3944.586751] ? hrtimer_interrupt+0x101/0x220 Aug 22 06:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 3944.587857] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 06:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 3944.589033] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 06:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 3944.590219] Aug 22 06:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 3944.591125] Aug 22 06:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 3944.592012] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 06:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 3944.593153] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 3944.594336] ? _raw_spin_lock+0x22/0x30 Aug 22 06:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 3944.595379] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 3944.596496] direct_page_fault+0x206/0x310 [kvm] Aug 22 06:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 3944.597639] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 06:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 3944.598744] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 06:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 3944.599843] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 06:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 3944.600955] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 06:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 3944.602021] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 06:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 3944.603111] handle_exit+0x98/0x230 [kvm_amd] Aug 22 06:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 3944.604097] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 06:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 3944.605104] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 06:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 3944.606151] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 06:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 3944.607153] vcpu_run+0x62/0x2c0 [kvm] Aug 22 06:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 3944.608041] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 06:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 3944.608943] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 06:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 3944.609914] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 06:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 3944.610982] ? __seccomp_filter+0x4a/0x4a0 Aug 22 06:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 3944.611812] ? __fget_files+0x86/0xc0 Aug 22 06:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 3944.612600] __x64_sys_ioctl+0x95/0xd0 Aug 22 06:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 3944.613380] do_syscall_64+0x5c/0xc0 Aug 22 06:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 3944.614135] ? do_futex+0x162/0x1f0 Aug 22 06:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 3944.614868] ? __x64_sys_futex+0x78/0x1e0 Aug 22 06:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 3944.615640] ? __secure_computing+0xa9/0x120 Aug 22 06:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 3944.616426] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 06:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 3944.617300] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 3944.618143] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 3944.618959] ? do_syscall_64+0x69/0xc0 Aug 22 06:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 3944.619685] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 3944.620481] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 3944.621271] ? do_syscall_64+0x69/0xc0 Aug 22 06:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 3944.621995] ? do_syscall_64+0x69/0xc0 Aug 22 06:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 3944.622700] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 06:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 3944.623509] RIP: 0033:0x7faa5d0edaff Aug 22 06:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 3944.624236] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 06:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 3944.626603] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 06:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 3944.627716] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 06:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 3944.628756] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 06:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 3944.629912] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 06:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 3944.631236] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 06:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 3944.632169] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 06:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 3944.633123] Aug 22 06:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 3957.452706] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 06:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 3957.453692] rcu: 1-....: (957055 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=466038 Aug 22 06:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 3957.454795] (t=960063 jiffies g=23269 q=12846) Aug 22 06:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 3957.455573] NMI backtrace for cpu 1 Aug 22 06:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 3957.456288] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 06:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 3957.457407] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 06:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 3957.458466] Call Trace: Aug 22 06:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 3957.459139] Aug 22 06:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 3957.459781] show_stack+0x52/0x5c Aug 22 06:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 3957.460504] dump_stack_lvl+0x4a/0x63 Aug 22 06:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 3957.461249] dump_stack+0x10/0x16 Aug 22 06:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 3957.461977] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 06:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 3957.462753] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 06:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 3957.463528] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 06:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 3957.464350] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 06:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 3957.465172] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 06:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 3957.465987] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 06:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 3957.466757] print_cpu_stall.cold+0x2f/0xe2 Aug 22 06:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 3957.467520] ? timekeeping_update+0xf7/0x150 Aug 22 06:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 3957.468289] check_cpu_stall+0x109/0x270 Aug 22 06:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 3957.469034] rcu_sched_clock_irq+0x9a/0x250 Aug 22 06:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 3957.469933] update_process_times+0x94/0xd0 Aug 22 06:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 3957.470692] tick_sched_handle+0x29/0x70 Aug 22 06:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 3957.471438] tick_sched_timer+0x8c/0xc0 Aug 22 06:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 3957.472179] ? tick_nohz_handler+0xb0/0xb0 Aug 22 06:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 3957.472938] __hrtimer_run_queues+0x107/0x230 Aug 22 06:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 3957.473720] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 06:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 3957.474500] hrtimer_interrupt+0x101/0x220 Aug 22 06:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 3957.475257] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 06:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 3957.476067] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 06:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 3957.476868] Aug 22 06:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 3957.477522] Aug 22 06:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 3957.478151] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 06:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 3957.478967] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 3957.479844] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 06:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 3957.482197] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 06:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 3957.483075] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 06:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 3957.484071] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 06:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 3957.485048] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 06:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 3957.486020] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 06:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 3957.486974] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 06:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 3957.487924] ? _raw_spin_lock+0x22/0x30 Aug 22 06:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 3957.488680] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 3957.489529] direct_page_fault+0x206/0x310 [kvm] Aug 22 06:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 3957.490368] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 06:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 3957.491198] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 06:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 3957.492021] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 06:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 3957.492821] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 06:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 3957.493623] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 06:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 3957.494447] handle_exit+0x98/0x230 [kvm_amd] Aug 22 06:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 3957.495203] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 06:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 3957.495989] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 06:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 3957.496784] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 06:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 3957.497579] vcpu_run+0x62/0x2c0 [kvm] Aug 22 06:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 3957.498300] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 06:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 3957.499036] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 06:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 3957.499835] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 06:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 3957.500598] ? __seccomp_filter+0x4a/0x4a0 Aug 22 06:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 3957.501329] ? __fget_files+0x86/0xc0 Aug 22 06:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 3957.502025] __x64_sys_ioctl+0x95/0xd0 Aug 22 06:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 3957.502718] do_syscall_64+0x5c/0xc0 Aug 22 06:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 3957.503400] ? do_futex+0x162/0x1f0 Aug 22 06:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 3957.504070] ? __x64_sys_futex+0x78/0x1e0 Aug 22 06:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 3957.504769] ? __secure_computing+0xa9/0x120 Aug 22 06:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 3957.505496] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 06:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 3957.506284] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 3957.507041] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 3957.507793] ? do_syscall_64+0x69/0xc0 Aug 22 06:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 3957.508480] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 3957.509235] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 3957.510004] ? do_syscall_64+0x69/0xc0 Aug 22 06:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 3957.510695] ? do_syscall_64+0x69/0xc0 Aug 22 06:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 3957.511381] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 06:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 3957.512153] RIP: 0033:0x7faa5d0edaff Aug 22 06:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 3957.512850] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 06:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 3957.514972] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 06:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 3957.515931] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 06:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 3957.516875] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 06:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 3957.517830] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 06:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 3957.518768] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 06:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 3957.519693] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 06:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 3957.520604] Aug 22 06:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 3984.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 3602s! [qemu-system-x86:6715] Aug 22 06:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 3984.543140] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 06:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 3984.543234] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 06:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 3984.555935] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 06:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 3984.557259] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 06:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 3984.558535] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 3984.559676] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 06:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 3984.562601] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 06:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 3984.563914] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 06:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 3984.571273] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 06:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 3984.574141] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 06:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 3984.575425] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 06:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 3984.576866] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 06:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 3984.578056] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 06:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 3984.579294] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 06:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 3984.580391] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 06:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 3984.581720] Call Trace: Aug 22 06:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 3984.582696] Aug 22 06:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 3984.583723] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 3984.584922] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 3984.586158] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 3984.587356] ? show_regs.part.0+0x23/0x29 Aug 22 06:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 3984.588362] ? show_regs.cold+0x8/0xd Aug 22 06:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 3984.589409] ? watchdog_timer_fn+0x1be/0x220 Aug 22 06:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 3984.590499] ? lockup_detector_update_enable+0x60/0x60 Aug 22 06:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 3984.591694] ? __hrtimer_run_queues+0x107/0x230 Aug 22 06:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 3984.592925] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 06:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 3984.594059] ? hrtimer_interrupt+0x101/0x220 Aug 22 06:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 3984.595209] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 06:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 3984.596377] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 06:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 3984.597550] Aug 22 06:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 3984.598481] Aug 22 06:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 3984.599411] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 06:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 3984.600741] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 3984.601919] ? _raw_spin_lock+0x22/0x30 Aug 22 06:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 3984.602941] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 3984.604004] direct_page_fault+0x206/0x310 [kvm] Aug 22 06:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 3984.605070] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 06:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 3984.606097] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 06:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 3984.607118] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 06:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 3984.608099] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 06:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 3984.609060] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 06:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 3984.610046] handle_exit+0x98/0x230 [kvm_amd] Aug 22 06:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 3984.610942] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 06:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 3984.611857] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 06:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 3984.612919] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 06:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 3984.613992] vcpu_run+0x62/0x2c0 [kvm] Aug 22 06:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 3984.614803] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 06:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 3984.615611] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 06:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 3984.616470] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 06:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 3984.617285] ? __seccomp_filter+0x4a/0x4a0 Aug 22 06:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 3984.618029] ? __fget_files+0x86/0xc0 Aug 22 06:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 3984.618738] __x64_sys_ioctl+0x95/0xd0 Aug 22 06:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 3984.619430] do_syscall_64+0x5c/0xc0 Aug 22 06:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 3984.620103] ? do_futex+0x162/0x1f0 Aug 22 06:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 3984.620758] ? __x64_sys_futex+0x78/0x1e0 Aug 22 06:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 3984.621441] ? __secure_computing+0xa9/0x120 Aug 22 06:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 3984.622132] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 06:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 3984.622897] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 3984.623618] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 3984.624340] ? do_syscall_64+0x69/0xc0 Aug 22 06:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 3984.624994] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 3984.625703] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 3984.626409] ? do_syscall_64+0x69/0xc0 Aug 22 06:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 3984.627039] ? do_syscall_64+0x69/0xc0 Aug 22 06:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 3984.627666] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 06:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 3984.628371] RIP: 0033:0x7faa5d0edaff Aug 22 06:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 3984.629010] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 06:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 3984.631004] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 06:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 3984.631921] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 06:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 3984.632812] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 06:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 3984.633741] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 06:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 3984.634645] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 06:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 3984.635554] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 06:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 3984.636449] Aug 22 06:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 4012.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 3628s! [qemu-system-x86:6715] Aug 22 06:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 4012.543751] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 06:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 4012.544013] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 06:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 4012.556234] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 06:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 4012.557524] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 06:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 4012.558747] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 4012.559802] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 06:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 4012.562354] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 06:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 4012.563395] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 06:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 4012.564554] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 06:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 4012.565727] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 06:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 4012.566890] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 06:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 4012.568049] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 06:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 4012.569237] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 06:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 4012.570473] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 06:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 4012.571573] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 06:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 4012.572774] Call Trace: Aug 22 06:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 4012.573699] Aug 22 06:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 4012.574624] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 4012.575655] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 4012.576689] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 4012.577784] ? show_regs.part.0+0x23/0x29 Aug 22 06:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 4012.578778] ? show_regs.cold+0x8/0xd Aug 22 06:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 4012.579748] ? watchdog_timer_fn+0x1be/0x220 Aug 22 06:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 4012.580783] ? lockup_detector_update_enable+0x60/0x60 Aug 22 06:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 4012.581850] ? __hrtimer_run_queues+0x107/0x230 Aug 22 06:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 4012.582875] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 06:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 4012.583898] ? hrtimer_interrupt+0x101/0x220 Aug 22 06:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 4012.584929] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 06:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 4012.585996] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 06:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 4012.587134] Aug 22 06:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 4012.588159] Aug 22 06:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 4012.589003] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 06:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 4012.590036] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 4012.591072] ? _raw_spin_lock+0x22/0x30 Aug 22 06:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 4012.592014] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 4012.593051] direct_page_fault+0x206/0x310 [kvm] Aug 22 06:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 4012.594076] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 06:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 4012.595084] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 06:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 4012.596080] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 06:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 4012.597093] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 06:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 4012.598037] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 06:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 4012.599011] handle_exit+0x98/0x230 [kvm_amd] Aug 22 06:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 4012.599901] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 06:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 4012.600909] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 06:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 4012.601835] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 06:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 4012.602741] vcpu_run+0x62/0x2c0 [kvm] Aug 22 06:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 4012.603550] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 06:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 4012.604357] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 06:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 4012.605255] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 06:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 4012.606059] ? __seccomp_filter+0x4a/0x4a0 Aug 22 06:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 4012.606800] ? __fget_files+0x86/0xc0 Aug 22 06:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 4012.607504] __x64_sys_ioctl+0x95/0xd0 Aug 22 06:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 4012.608197] do_syscall_64+0x5c/0xc0 Aug 22 06:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 4012.608875] ? do_futex+0x162/0x1f0 Aug 22 06:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 4012.609524] ? __x64_sys_futex+0x78/0x1e0 Aug 22 06:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 4012.610196] ? __secure_computing+0xa9/0x120 Aug 22 06:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 4012.610886] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 06:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 4012.611649] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 4012.612369] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 4012.613097] ? do_syscall_64+0x69/0xc0 Aug 22 06:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 4012.613747] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 4012.614452] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 4012.615148] ? do_syscall_64+0x69/0xc0 Aug 22 06:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 4012.615905] ? do_syscall_64+0x69/0xc0 Aug 22 06:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 4012.616804] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 06:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 4012.617815] RIP: 0033:0x7faa5d0edaff Aug 22 06:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 4012.618723] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 06:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 4012.621456] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 06:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 4012.622372] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 06:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 4012.623260] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 06:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 4012.624149] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 06:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 4012.625045] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 06:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 4012.625936] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 06:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 4012.626829] Aug 22 06:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 4040.541981] watchdog: BUG: soft lockup - CPU#1 stuck for 3655s! [qemu-system-x86:6715] Aug 22 06:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 4040.543062] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 06:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 4040.543126] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 06:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 4040.555296] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 06:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 4040.556590] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 06:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 4040.557829] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 4040.558895] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 06:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 4040.561495] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 06:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 4040.562561] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 06:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 4040.563728] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 06:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 4040.564907] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 06:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 4040.566081] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 06:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 4040.567250] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 06:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 4040.568449] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 06:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 4040.569689] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 06:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 4040.570803] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 06:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 4040.572015] Call Trace: Aug 22 06:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 4040.572962] Aug 22 06:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 4040.573854] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 4040.574883] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 4040.575902] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 4040.577001] ? show_regs.part.0+0x23/0x29 Aug 22 06:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 4040.578009] ? show_regs.cold+0x8/0xd Aug 22 06:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 4040.578988] ? watchdog_timer_fn+0x1be/0x220 Aug 22 06:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 4040.580003] ? lockup_detector_update_enable+0x60/0x60 Aug 22 06:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 4040.581110] ? __hrtimer_run_queues+0x107/0x230 Aug 22 06:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 4040.582157] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 06:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 4040.583198] ? hrtimer_interrupt+0x101/0x220 Aug 22 06:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 4040.584292] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 06:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 4040.585520] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 06:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 4040.586584] Aug 22 06:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 4040.587439] Aug 22 06:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 4040.588327] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 06:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 4040.589371] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 4040.590411] ? _raw_spin_lock+0x22/0x30 Aug 22 06:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 4040.591362] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 4040.592443] direct_page_fault+0x206/0x310 [kvm] Aug 22 06:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 4040.593486] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 06:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 4040.594514] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 06:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 4040.595516] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 06:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 4040.596507] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 06:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 4040.597460] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 06:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 4040.598442] handle_exit+0x98/0x230 [kvm_amd] Aug 22 06:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 4040.599344] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 06:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 4040.600257] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 06:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 4040.601211] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 06:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 4040.602139] vcpu_run+0x62/0x2c0 [kvm] Aug 22 06:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 4040.602963] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 06:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 4040.603771] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 06:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 4040.604667] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 06:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 4040.605468] ? __seccomp_filter+0x4a/0x4a0 Aug 22 06:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 4040.606210] ? __fget_files+0x86/0xc0 Aug 22 06:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 4040.606912] __x64_sys_ioctl+0x95/0xd0 Aug 22 06:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 4040.607602] do_syscall_64+0x5c/0xc0 Aug 22 06:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 4040.608267] ? do_futex+0x162/0x1f0 Aug 22 06:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 4040.608931] ? __x64_sys_futex+0x78/0x1e0 Aug 22 06:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 4040.609614] ? __secure_computing+0xa9/0x120 Aug 22 06:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 4040.610303] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 06:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 4040.611063] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 4040.611783] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 4040.612556] ? do_syscall_64+0x69/0xc0 Aug 22 06:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 4040.613211] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 4040.613925] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 4040.614646] ? do_syscall_64+0x69/0xc0 Aug 22 06:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 4040.615410] ? do_syscall_64+0x69/0xc0 Aug 22 06:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 4040.616294] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 06:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 4040.617053] RIP: 0033:0x7faa5d0edaff Aug 22 06:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 4040.617682] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 06:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 4040.619691] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 06:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 4040.620639] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 06:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 4040.621532] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 06:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 4040.622437] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 06:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 4040.623343] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 06:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 4040.624231] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 06:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 4040.625161] Aug 22 06:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 4068.541976] watchdog: BUG: soft lockup - CPU#1 stuck for 3681s! [qemu-system-x86:6715] Aug 22 06:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 4068.543117] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 06:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 4068.543184] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 06:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 4068.555367] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 06:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 4068.556673] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 06:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 4068.557918] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 4068.558978] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 06:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 4068.561542] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 06:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 4068.562618] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 06:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 4068.563806] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 06:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 4068.564987] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 06:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 4068.566149] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 06:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 4068.567335] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 06:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 4068.568539] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 06:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 4068.569775] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 06:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 4068.570872] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 06:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 4068.572100] Call Trace: Aug 22 06:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 4068.573027] Aug 22 06:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 4068.573916] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 4068.574951] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 4068.575984] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 4068.577080] ? show_regs.part.0+0x23/0x29 Aug 22 06:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 4068.578086] ? show_regs.cold+0x8/0xd Aug 22 06:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 4068.579070] ? watchdog_timer_fn+0x1be/0x220 Aug 22 06:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 4068.580093] ? lockup_detector_update_enable+0x60/0x60 Aug 22 06:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 4068.581165] ? __hrtimer_run_queues+0x107/0x230 Aug 22 06:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 4068.582196] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 06:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 4068.583227] ? hrtimer_interrupt+0x101/0x220 Aug 22 06:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 4068.584266] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 06:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 4068.585373] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 06:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 4068.586471] Aug 22 06:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 4068.587324] Aug 22 06:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 4068.588197] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 06:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 4068.589245] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 4068.590288] ? _raw_spin_lock+0x22/0x30 Aug 22 06:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 4068.591235] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 4068.592858] direct_page_fault+0x206/0x310 [kvm] Aug 22 06:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 4068.593946] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 06:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 4068.594966] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 06:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 4068.596004] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 06:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 4068.596991] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 06:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 4068.598030] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 06:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 4068.599026] handle_exit+0x98/0x230 [kvm_amd] Aug 22 06:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 4068.599927] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 06:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 4068.600863] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 06:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 4068.601792] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 06:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 4068.602701] vcpu_run+0x62/0x2c0 [kvm] Aug 22 06:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 4068.603524] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 06:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 4068.604360] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 06:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 4068.605224] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 06:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 4068.606027] ? __seccomp_filter+0x4a/0x4a0 Aug 22 06:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 4068.606776] ? __fget_files+0x86/0xc0 Aug 22 06:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 4068.607483] __x64_sys_ioctl+0x95/0xd0 Aug 22 06:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 4068.608199] do_syscall_64+0x5c/0xc0 Aug 22 06:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 4068.608872] ? do_futex+0x162/0x1f0 Aug 22 06:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 4068.609534] ? __x64_sys_futex+0x78/0x1e0 Aug 22 06:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 4068.610216] ? __secure_computing+0xa9/0x120 Aug 22 06:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 4068.610910] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 06:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 4068.611673] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 4068.612422] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 4068.613149] ? do_syscall_64+0x69/0xc0 Aug 22 06:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 4068.613856] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 4068.614603] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 4068.615312] ? do_syscall_64+0x69/0xc0 Aug 22 06:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 4068.615959] ? do_syscall_64+0x69/0xc0 Aug 22 06:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 4068.616587] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 06:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 4068.617291] RIP: 0033:0x7faa5d0edaff Aug 22 06:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 4068.617918] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 06:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 4068.619960] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 06:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 4068.620880] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 06:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 4068.621788] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 06:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 4068.622686] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 06:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 4068.623601] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 06:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 4068.624518] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 06:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 4068.625425] Aug 22 06:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 4096.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 3707s! [qemu-system-x86:6715] Aug 22 06:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 4096.543702] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 06:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 4096.543947] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 06:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 4096.556049] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 06:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 4096.557326] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 06:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 4096.558551] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 4096.559618] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 06:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 4096.562175] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 06:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 4096.563219] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 06:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 4096.564394] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 06:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 4096.565558] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 06:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 4096.566726] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 06:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 4096.567910] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 06:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 4096.569081] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 06:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 4096.570323] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 06:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 4096.571421] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 06:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 4096.572627] Call Trace: Aug 22 06:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 4096.573541] Aug 22 06:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 4096.574433] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 4096.575464] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 4096.576494] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 4096.577569] ? show_regs.part.0+0x23/0x29 Aug 22 06:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 4096.578571] ? show_regs.cold+0x8/0xd Aug 22 06:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 4096.579541] ? watchdog_timer_fn+0x1be/0x220 Aug 22 06:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 4096.580556] ? lockup_detector_update_enable+0x60/0x60 Aug 22 06:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 4096.581620] ? __hrtimer_run_queues+0x107/0x230 Aug 22 06:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 4096.582646] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 06:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 4096.583681] ? hrtimer_interrupt+0x101/0x220 Aug 22 06:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 4096.584702] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 06:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 4096.585769] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 06:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 4096.586813] Aug 22 06:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 4096.587672] Aug 22 06:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 4096.588513] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 06:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 4096.589551] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 4096.590587] ? _raw_spin_lock+0x22/0x30 Aug 22 06:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 4096.591535] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 4096.592554] direct_page_fault+0x206/0x310 [kvm] Aug 22 06:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 4096.593577] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 06:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 4096.594586] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 06:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 4096.595584] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 06:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 4096.596566] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 06:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 4096.597512] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 06:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 4096.598490] handle_exit+0x98/0x230 [kvm_amd] Aug 22 06:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 4096.599382] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 06:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 4096.600301] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 06:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 4096.601223] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 06:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 4096.602130] vcpu_run+0x62/0x2c0 [kvm] Aug 22 06:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 4096.602939] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 06:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 4096.603759] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 06:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 4096.604665] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 06:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 4096.605462] ? __seccomp_filter+0x4a/0x4a0 Aug 22 06:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 4096.606203] ? __fget_files+0x86/0xc0 Aug 22 06:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 4096.606906] __x64_sys_ioctl+0x95/0xd0 Aug 22 06:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 4096.607617] do_syscall_64+0x5c/0xc0 Aug 22 06:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 4096.608286] ? do_futex+0x162/0x1f0 Aug 22 06:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 4096.608940] ? __x64_sys_futex+0x78/0x1e0 Aug 22 06:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 4096.609613] ? __secure_computing+0xa9/0x120 Aug 22 06:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 4096.610300] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 06:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 4096.611059] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 4096.611785] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 4096.612502] ? do_syscall_64+0x69/0xc0 Aug 22 06:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 4096.613145] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 4096.613850] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 4096.614545] ? do_syscall_64+0x69/0xc0 Aug 22 06:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 4096.615168] ? do_syscall_64+0x69/0xc0 Aug 22 06:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 4096.615797] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 06:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 4096.616507] RIP: 0033:0x7faa5d0edaff Aug 22 06:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 4096.617158] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 06:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 4096.619148] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 06:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 4096.620070] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 06:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 4096.620961] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 06:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 4096.621849] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 06:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 4096.622735] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 06:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 4096.623635] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 06:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 4096.624530] Aug 22 06:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 4124.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 3733s! [qemu-system-x86:6715] Aug 22 06:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 4124.543056] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 06:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 4124.543126] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 06:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 4124.554897] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 06:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 4124.556145] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 06:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 4124.557337] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 4124.558369] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 06:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 4124.561012] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 06:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 4124.562219] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 06:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 4124.563408] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 06:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 4124.564564] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 06:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 4124.565733] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 06:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 4124.566895] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 06:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 4124.568078] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 06:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 4124.569298] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 06:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 4124.570395] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 06:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 4124.571622] Call Trace: Aug 22 06:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 4124.572549] Aug 22 06:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 4124.573442] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 4124.574472] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 4124.575492] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 4124.576549] ? show_regs.part.0+0x23/0x29 Aug 22 06:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 4124.577528] ? show_regs.cold+0x8/0xd Aug 22 06:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 4124.578485] ? watchdog_timer_fn+0x1be/0x220 Aug 22 06:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 4124.579492] ? lockup_detector_update_enable+0x60/0x60 Aug 22 06:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 4124.580533] ? __hrtimer_run_queues+0x107/0x230 Aug 22 06:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 4124.581541] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 06:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 4124.582550] ? hrtimer_interrupt+0x101/0x220 Aug 22 06:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 4124.583562] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 06:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 4124.584609] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 06:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 4124.585637] Aug 22 06:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 4124.586482] Aug 22 06:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 4124.587321] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 06:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 4124.588329] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 4124.589353] ? _raw_spin_lock+0x22/0x30 Aug 22 06:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 4124.590285] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 4124.591289] direct_page_fault+0x206/0x310 [kvm] Aug 22 06:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 4124.592291] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 06:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 4124.593282] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 06:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 4124.594263] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 06:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 4124.595212] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 06:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 4124.596148] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 06:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 4124.597102] handle_exit+0x98/0x230 [kvm_amd] Aug 22 06:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 4124.597981] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 06:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 4124.598880] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 06:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 4124.599792] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 06:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 4124.600672] vcpu_run+0x62/0x2c0 [kvm] Aug 22 06:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 4124.601467] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 06:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 4124.602254] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 06:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 4124.603091] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 06:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 4124.603890] ? __seccomp_filter+0x4a/0x4a0 Aug 22 06:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 4124.604620] ? __fget_files+0x86/0xc0 Aug 22 06:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 4124.605309] __x64_sys_ioctl+0x95/0xd0 Aug 22 06:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 4124.605988] do_syscall_64+0x5c/0xc0 Aug 22 06:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 4124.606643] ? do_futex+0x162/0x1f0 Aug 22 06:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 4124.607293] ? __x64_sys_futex+0x78/0x1e0 Aug 22 06:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 4124.607955] ? __secure_computing+0xa9/0x120 Aug 22 06:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 4124.608626] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 06:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 4124.609365] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 4124.610067] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 4124.610768] ? do_syscall_64+0x69/0xc0 Aug 22 06:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 4124.611410] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 4124.612092] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 4124.612905] ? do_syscall_64+0x69/0xc0 Aug 22 06:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 4124.613519] ? do_syscall_64+0x69/0xc0 Aug 22 06:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 4124.614127] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 06:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 4124.614812] RIP: 0033:0x7faa5d0edaff Aug 22 06:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 4124.615439] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 06:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 4124.617365] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 06:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 4124.618259] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 06:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 4124.619122] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 06:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 4124.620003] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 06:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 4124.620869] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 06:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 4124.621740] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 06:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 4124.622605] Aug 22 06:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 4137.464704] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 06:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 4137.465655] rcu: 1-....: (1001918 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=487910 Aug 22 06:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 4137.466772] (t=1005066 jiffies g=23269 q=12976) Aug 22 06:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 4137.467568] NMI backtrace for cpu 1 Aug 22 06:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 4137.468282] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 06:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 4137.469380] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 06:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 4137.470436] Call Trace: Aug 22 06:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 4137.471115] Aug 22 06:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 4137.471758] show_stack+0x52/0x5c Aug 22 06:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 4137.472480] dump_stack_lvl+0x4a/0x63 Aug 22 06:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 4137.473228] dump_stack+0x10/0x16 Aug 22 06:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 4137.473943] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 06:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 4137.474721] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 06:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 4137.475506] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 06:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 4137.476330] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 06:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 4137.477153] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 06:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 4137.477967] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 06:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 4137.478740] print_cpu_stall.cold+0x2f/0xe2 Aug 22 06:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 4137.479510] ? timekeeping_update+0xf7/0x150 Aug 22 06:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 4137.480279] check_cpu_stall+0x109/0x270 Aug 22 06:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 4137.481023] rcu_sched_clock_irq+0x9a/0x250 Aug 22 06:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 4137.481787] update_process_times+0x94/0xd0 Aug 22 06:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 4137.482544] tick_sched_handle+0x29/0x70 Aug 22 06:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 4137.483294] tick_sched_timer+0x8c/0xc0 Aug 22 06:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 4137.484029] ? tick_nohz_handler+0xb0/0xb0 Aug 22 06:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 4137.484788] __hrtimer_run_queues+0x107/0x230 Aug 22 06:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 4137.485557] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 06:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 4137.486335] hrtimer_interrupt+0x101/0x220 Aug 22 06:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 4137.487102] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 06:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 4137.487912] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 06:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 4137.488710] Aug 22 06:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 4137.489343] Aug 22 06:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 4137.489969] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 06:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 4137.490785] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 4137.491668] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 06:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 4137.493874] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 06:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 4137.494746] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 06:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 4137.495753] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 06:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 4137.496733] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 06:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 4137.497699] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 06:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 4137.498651] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 06:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 4137.499607] ? _raw_spin_lock+0x22/0x30 Aug 22 06:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 4137.500370] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 4137.501208] direct_page_fault+0x206/0x310 [kvm] Aug 22 06:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 4137.502045] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 06:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 4137.502870] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 06:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 4137.503700] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 06:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 4137.504503] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 06:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 4137.505291] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 06:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 4137.506112] handle_exit+0x98/0x230 [kvm_amd] Aug 22 06:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 4137.506865] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 06:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 4137.507655] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 06:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 4137.508455] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 06:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 4137.509242] vcpu_run+0x62/0x2c0 [kvm] Aug 22 06:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 4137.509954] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 06:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 4137.510684] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 06:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 4137.511489] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 06:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 4137.512249] ? __seccomp_filter+0x4a/0x4a0 Aug 22 06:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 4137.512967] ? __fget_files+0x86/0xc0 Aug 22 06:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 4137.513656] __x64_sys_ioctl+0x95/0xd0 Aug 22 06:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 4137.514352] do_syscall_64+0x5c/0xc0 Aug 22 06:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 4137.515034] ? do_futex+0x162/0x1f0 Aug 22 06:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 4137.515718] ? __x64_sys_futex+0x78/0x1e0 Aug 22 06:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 4137.516416] ? __secure_computing+0xa9/0x120 Aug 22 06:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 4137.517133] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 06:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 4137.517918] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 4137.518669] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 4137.519427] ? do_syscall_64+0x69/0xc0 Aug 22 06:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 4137.520119] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 4137.520874] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 4137.521625] ? do_syscall_64+0x69/0xc0 Aug 22 06:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 4137.522320] ? do_syscall_64+0x69/0xc0 Aug 22 06:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 4137.523008] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 06:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 4137.523784] RIP: 0033:0x7faa5d0edaff Aug 22 06:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 4137.524463] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 06:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 4137.526545] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 06:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 4137.527511] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 06:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 4137.528452] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 06:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 4137.529392] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 06:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 4137.530333] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 06:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 4137.531408] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 06:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 4137.532644] Aug 22 06:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 4164.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 3770s! [qemu-system-x86:6715] Aug 22 06:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 4164.543193] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 06:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 4164.543331] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 06:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 4164.555427] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 06:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 4164.556698] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 06:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 4164.557916] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 4164.558986] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 06:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 4164.561529] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 06:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 4164.562570] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 06:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 4164.563743] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 06:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 4164.564901] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 06:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 4164.566066] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 06:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 4164.567239] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 06:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 4164.568404] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 06:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 4164.569637] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 06:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 4164.570736] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 06:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 4164.571956] Call Trace: Aug 22 06:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 4164.572867] Aug 22 06:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 4164.573749] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 4164.574997] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 4164.576017] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 4164.577298] ? show_regs.part.0+0x23/0x29 Aug 22 06:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 4164.578294] ? show_regs.cold+0x8/0xd Aug 22 06:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 4164.579274] ? watchdog_timer_fn+0x1be/0x220 Aug 22 06:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 4164.580280] ? lockup_detector_update_enable+0x60/0x60 Aug 22 06:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 4164.581341] ? __hrtimer_run_queues+0x107/0x230 Aug 22 06:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 4164.582367] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 06:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 4164.583401] ? hrtimer_interrupt+0x101/0x220 Aug 22 06:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 4164.584414] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 06:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 4164.585482] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 06:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 4164.586526] Aug 22 06:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 4164.587389] Aug 22 06:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 4164.588231] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 06:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 4164.589261] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 4164.590299] ? _raw_spin_lock+0x22/0x30 Aug 22 06:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 4164.591260] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 4164.592278] direct_page_fault+0x206/0x310 [kvm] Aug 22 06:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 4164.593426] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 06:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 4164.594545] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 06:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 4164.595660] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 06:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 4164.596764] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 06:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 4164.597833] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 06:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 4164.598982] handle_exit+0x98/0x230 [kvm_amd] Aug 22 06:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 4164.599981] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 06:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 4164.601003] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 06:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 4164.602135] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 06:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 4164.603175] vcpu_run+0x62/0x2c0 [kvm] Aug 22 06:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 4164.604065] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 06:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 4164.604965] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 06:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 4164.605934] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 06:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 4164.606834] ? __seccomp_filter+0x4a/0x4a0 Aug 22 06:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 4164.607674] ? __fget_files+0x86/0xc0 Aug 22 06:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 4164.608462] __x64_sys_ioctl+0x95/0xd0 Aug 22 06:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 4164.609230] do_syscall_64+0x5c/0xc0 Aug 22 06:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 4164.609969] ? do_futex+0x162/0x1f0 Aug 22 06:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 4164.610692] ? __x64_sys_futex+0x78/0x1e0 Aug 22 06:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 4164.611461] ? __secure_computing+0xa9/0x120 Aug 22 06:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 4164.612236] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 06:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 4164.613120] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 4164.613937] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 4164.614753] ? do_syscall_64+0x69/0xc0 Aug 22 06:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 4164.615502] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 4164.616303] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 4164.617097] ? do_syscall_64+0x69/0xc0 Aug 22 06:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 4164.617804] ? do_syscall_64+0x69/0xc0 Aug 22 06:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 4164.618512] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 06:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 4164.619335] RIP: 0033:0x7faa5d0edaff Aug 22 06:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 4164.620035] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 06:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 4164.622374] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 06:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 4164.623446] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 06:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 4164.624472] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 06:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 4164.625498] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 06:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 4164.626525] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 06:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 4164.627569] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 06:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 4164.628600] Aug 22 06:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 4192.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 3796s! [qemu-system-x86:6715] Aug 22 06:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 4192.543687] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 06:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 4192.543892] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 06:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 4192.555998] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 06:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 4192.557259] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 06:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 4192.558493] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 4192.559549] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 06:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 4192.562095] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 06:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 4192.563142] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 06:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 4192.564320] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 06:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 4192.565489] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 06:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 4192.566659] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 06:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 4192.567819] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 06:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 4192.568993] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 06:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 4192.570233] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 06:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 4192.571344] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 06:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 4192.572540] Call Trace: Aug 22 06:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 4192.573457] Aug 22 06:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 4192.574352] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 4192.575390] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 4192.576408] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 4192.577483] ? show_regs.part.0+0x23/0x29 Aug 22 06:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 4192.578489] ? show_regs.cold+0x8/0xd Aug 22 06:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 4192.579466] ? watchdog_timer_fn+0x1be/0x220 Aug 22 06:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 4192.580472] ? lockup_detector_update_enable+0x60/0x60 Aug 22 06:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 4192.581538] ? __hrtimer_run_queues+0x107/0x230 Aug 22 06:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 4192.582606] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 06:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 4192.583630] ? hrtimer_interrupt+0x101/0x220 Aug 22 06:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 4192.584679] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 06:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 4192.585757] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 06:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 4192.586815] Aug 22 06:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 4192.587668] Aug 22 06:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 4192.588504] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 06:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 4192.589536] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 4192.590585] ? _raw_spin_lock+0x22/0x30 Aug 22 06:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 4192.591572] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 4192.592605] direct_page_fault+0x206/0x310 [kvm] Aug 22 06:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 4192.593629] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 06:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 4192.594663] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 06:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 4192.595671] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 06:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 4192.596655] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 06:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 4192.597598] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 06:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 4192.598581] handle_exit+0x98/0x230 [kvm_amd] Aug 22 06:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 4192.599473] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 06:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 4192.600384] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 06:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 4192.601311] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 06:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 4192.602211] vcpu_run+0x62/0x2c0 [kvm] Aug 22 06:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 4192.603022] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 06:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 4192.603834] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 06:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 4192.604686] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 06:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 4192.605481] ? __seccomp_filter+0x4a/0x4a0 Aug 22 06:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 4192.606220] ? __fget_files+0x86/0xc0 Aug 22 06:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 4192.606944] __x64_sys_ioctl+0x95/0xd0 Aug 22 06:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 4192.607633] do_syscall_64+0x5c/0xc0 Aug 22 06:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 4192.608309] ? do_futex+0x162/0x1f0 Aug 22 06:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 4192.608959] ? __x64_sys_futex+0x78/0x1e0 Aug 22 06:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 4192.609635] ? __secure_computing+0xa9/0x120 Aug 22 06:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 4192.610327] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 06:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 4192.611092] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 4192.611822] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 4192.612535] ? do_syscall_64+0x69/0xc0 Aug 22 06:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 4192.613178] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 4192.613902] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 4192.614608] ? do_syscall_64+0x69/0xc0 Aug 22 06:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 4192.615231] ? do_syscall_64+0x69/0xc0 Aug 22 06:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 4192.615849] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 06:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 4192.616555] RIP: 0033:0x7faa5d0edaff Aug 22 06:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 4192.617200] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 06:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 4192.619184] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 06:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 4192.620099] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 06:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 4192.620987] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 06:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 4192.621884] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 06:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 4192.622773] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 06:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 4192.623663] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 06:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 4192.624565] Aug 22 06:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 4220.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 3822s! [qemu-system-x86:6715] Aug 22 06:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 4220.543095] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 06:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 4220.543164] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 06:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 4220.555259] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 06:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 4220.556551] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 06:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 4220.557772] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 4220.558841] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 06:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 4220.561378] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 06:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 4220.562427] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 06:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 4220.563616] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 06:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 4220.564775] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 06:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 4220.565938] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 06:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 4220.567106] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 06:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 4220.568271] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 06:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 4220.569537] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 06:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 4220.570652] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 06:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 4220.571860] Call Trace: Aug 22 06:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 4220.572775] Aug 22 06:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 4220.573659] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 4220.574705] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 4220.575729] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 4220.576810] ? show_regs.part.0+0x23/0x29 Aug 22 06:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 4220.577808] ? show_regs.cold+0x8/0xd Aug 22 06:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 4220.578790] ? watchdog_timer_fn+0x1be/0x220 Aug 22 06:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 4220.579797] ? lockup_detector_update_enable+0x60/0x60 Aug 22 06:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 4220.580858] ? __hrtimer_run_queues+0x107/0x230 Aug 22 06:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 4220.581887] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 06:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 4220.582917] ? hrtimer_interrupt+0x101/0x220 Aug 22 06:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 4220.583932] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 06:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 4220.584999] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 06:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 4220.586049] Aug 22 06:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 4220.586911] Aug 22 06:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 4220.587752] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 06:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 4220.588783] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 4220.589820] ? _raw_spin_lock+0x22/0x30 Aug 22 06:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 4220.590770] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 4220.591784] direct_page_fault+0x206/0x310 [kvm] Aug 22 06:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 4220.592806] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 06:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 4220.593815] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 06:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 4220.594892] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 06:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 4220.595874] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 06:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 4220.596822] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 06:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 4220.597813] handle_exit+0x98/0x230 [kvm_amd] Aug 22 06:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 4220.598720] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 06:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 4220.599646] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 06:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 4220.600579] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 06:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 4220.601744] vcpu_run+0x62/0x2c0 [kvm] Aug 22 06:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 4220.602728] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 06:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 4220.603627] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 06:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 4220.604486] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 06:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 4220.605287] ? __seccomp_filter+0x4a/0x4a0 Aug 22 06:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 4220.606032] ? __fget_files+0x86/0xc0 Aug 22 06:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 4220.606759] __x64_sys_ioctl+0x95/0xd0 Aug 22 06:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 4220.607453] do_syscall_64+0x5c/0xc0 Aug 22 06:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 4220.608118] ? do_futex+0x162/0x1f0 Aug 22 06:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 4220.608768] ? __x64_sys_futex+0x78/0x1e0 Aug 22 06:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 4220.609442] ? __secure_computing+0xa9/0x120 Aug 22 06:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 4220.610146] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 06:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 4220.610907] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 4220.611660] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 4220.612391] ? do_syscall_64+0x69/0xc0 Aug 22 06:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 4220.613073] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 4220.613862] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 4220.614827] ? do_syscall_64+0x69/0xc0 Aug 22 06:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 4220.615640] ? do_syscall_64+0x69/0xc0 Aug 22 06:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 4220.616418] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 06:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 4220.617165] RIP: 0033:0x7faa5d0edaff Aug 22 06:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 4220.617840] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 06:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 4220.619985] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 06:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 4220.620901] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 06:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 4220.621797] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 06:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 4220.622739] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 06:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 4220.623643] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 06:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 4220.624542] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 06:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 4220.625509] Aug 22 06:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 4248.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 3848s! [qemu-system-x86:6715] Aug 22 06:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 4248.543254] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 06:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 4248.543321] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 06:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 4248.557290] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 06:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 4248.558760] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 06:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 4248.560159] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 4248.561334] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 06:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 4248.564239] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 06:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 4248.565390] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 06:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 4248.566710] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 06:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 4248.568015] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 06:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 4248.569325] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 06:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 4248.570673] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 06:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 4248.571991] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 06:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 4248.573374] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 06:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 4248.574601] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 06:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 4248.575793] Call Trace: Aug 22 06:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 4248.576706] Aug 22 06:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 4248.577589] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 4248.578660] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 4248.579679] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 4248.580749] ? show_regs.part.0+0x23/0x29 Aug 22 06:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 4248.581758] ? show_regs.cold+0x8/0xd Aug 22 06:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 4248.582727] ? watchdog_timer_fn+0x1be/0x220 Aug 22 06:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 4248.584026] ? lockup_detector_update_enable+0x60/0x60 Aug 22 06:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 4248.585554] ? __hrtimer_run_queues+0x107/0x230 Aug 22 06:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 4248.586895] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 06:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 4248.587924] ? hrtimer_interrupt+0x101/0x220 Aug 22 06:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 4248.588941] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 06:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 4248.590028] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 06:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 4248.591071] Aug 22 06:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 4248.591922] Aug 22 06:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 4248.592757] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 06:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 4248.593805] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 4248.594840] ? _raw_spin_lock+0x22/0x30 Aug 22 06:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 4248.595782] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 4248.596798] direct_page_fault+0x206/0x310 [kvm] Aug 22 06:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 4248.597830] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 06:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 4248.598838] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 06:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 4248.599847] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 06:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 4248.600827] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 06:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 4248.601787] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 06:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 4248.602765] handle_exit+0x98/0x230 [kvm_amd] Aug 22 06:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 4248.603655] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 06:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 4248.604567] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 06:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 4248.605495] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 06:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 4248.606406] vcpu_run+0x62/0x2c0 [kvm] Aug 22 06:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 4248.607213] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 06:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 4248.608022] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 06:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 4248.608872] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 06:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 4248.609665] ? __seccomp_filter+0x4a/0x4a0 Aug 22 06:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 4248.610412] ? __fget_files+0x86/0xc0 Aug 22 06:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 4248.611112] __x64_sys_ioctl+0x95/0xd0 Aug 22 06:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 4248.611803] do_syscall_64+0x5c/0xc0 Aug 22 06:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 4248.612469] ? do_futex+0x162/0x1f0 Aug 22 06:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 4248.613114] ? __x64_sys_futex+0x78/0x1e0 Aug 22 06:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 4248.613812] ? __secure_computing+0xa9/0x120 Aug 22 06:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 4248.614499] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 06:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 4248.615254] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 4248.616028] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 4248.616748] ? do_syscall_64+0x69/0xc0 Aug 22 06:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 4248.617391] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 4248.618116] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 4248.618809] ? do_syscall_64+0x69/0xc0 Aug 22 06:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 4248.619432] ? do_syscall_64+0x69/0xc0 Aug 22 06:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 4248.620053] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 06:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 4248.620756] RIP: 0033:0x7faa5d0edaff Aug 22 06:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 4248.621378] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 06:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 4248.623368] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 06:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 4248.624280] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 06:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 4248.625169] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 06:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 4248.626466] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 06:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 4248.627806] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 06:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 4248.629154] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 06:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 4248.630564] Aug 22 06:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 4276.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 3874s! [qemu-system-x86:6715] Aug 22 06:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 4276.543708] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 06:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 4276.543952] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 06:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 4276.556059] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 06:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 4276.557318] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 06:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 4276.558554] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 4276.559610] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 06:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 4276.562166] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 06:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 4276.563213] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 06:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 4276.564375] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 06:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 4276.565559] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 06:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 4276.566725] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 06:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 4276.567885] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 06:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 4276.569050] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 06:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 4276.570304] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 06:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 4276.571400] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 06:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 4276.572593] Call Trace: Aug 22 06:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 4276.573525] Aug 22 06:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 4276.574422] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 4276.575454] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 4276.576480] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 4276.577591] ? show_regs.part.0+0x23/0x29 Aug 22 06:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 4276.578658] ? show_regs.cold+0x8/0xd Aug 22 06:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 4276.579827] ? watchdog_timer_fn+0x1be/0x220 Aug 22 06:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 4276.581504] ? lockup_detector_update_enable+0x60/0x60 Aug 22 06:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 4276.582568] ? __hrtimer_run_queues+0x107/0x230 Aug 22 06:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 4276.583593] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 06:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 4276.584614] ? hrtimer_interrupt+0x101/0x220 Aug 22 06:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 4276.585648] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 06:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 4276.586713] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 06:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 4276.587753] Aug 22 06:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 4276.588604] Aug 22 06:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 4276.589616] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 06:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 4276.590746] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 4276.591782] ? _raw_spin_lock+0x22/0x30 Aug 22 06:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 4276.592730] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 4276.593761] direct_page_fault+0x206/0x310 [kvm] Aug 22 06:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 4276.594780] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 06:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 4276.595789] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 06:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 4276.596785] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 06:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 4276.597808] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 06:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 4276.598752] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 06:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 4276.599731] handle_exit+0x98/0x230 [kvm_amd] Aug 22 06:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 4276.600624] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 06:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 4276.601563] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 06:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 4276.602488] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 06:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 4276.603389] vcpu_run+0x62/0x2c0 [kvm] Aug 22 06:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 4276.604205] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 06:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 4276.605011] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 06:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 4276.605885] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 06:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 4276.606683] ? __seccomp_filter+0x4a/0x4a0 Aug 22 06:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 4276.607425] ? __fget_files+0x86/0xc0 Aug 22 06:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 4276.608134] __x64_sys_ioctl+0x95/0xd0 Aug 22 06:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 4276.608825] do_syscall_64+0x5c/0xc0 Aug 22 06:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 4276.609506] ? do_futex+0x162/0x1f0 Aug 22 06:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 4276.610155] ? __x64_sys_futex+0x78/0x1e0 Aug 22 06:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 4276.610828] ? __secure_computing+0xa9/0x120 Aug 22 06:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 4276.611519] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 06:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 4276.612279] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 4276.613000] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 4276.613730] ? do_syscall_64+0x69/0xc0 Aug 22 06:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 4276.614379] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 4276.615080] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 4276.615774] ? do_syscall_64+0x69/0xc0 Aug 22 06:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 4276.616425] ? do_syscall_64+0x69/0xc0 Aug 22 06:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 4276.617045] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 06:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 4276.617768] RIP: 0033:0x7faa5d0edaff Aug 22 06:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 4276.618437] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 06:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 4276.620724] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 06:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 4276.621919] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 06:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 4276.622954] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 06:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 4276.623950] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 06:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 4276.624906] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 06:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 4276.626012] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 06:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 4276.627056] Aug 22 06:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 4304.541980] watchdog: BUG: soft lockup - CPU#1 stuck for 3900s! [qemu-system-x86:6715] Aug 22 06:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 4304.543078] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 06:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 4304.543143] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 06:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 4304.555285] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 06:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 4304.556559] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 06:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 4304.557803] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 4304.558864] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 06:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 4304.561545] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 06:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 4304.562596] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 06:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 4304.563764] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 06:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 4304.564927] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 06:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 4304.566097] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 06:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 4304.567262] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 06:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 4304.568432] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 06:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 4304.569683] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 06:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 4304.570781] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 06:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 4304.571987] Call Trace: Aug 22 06:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 4304.572896] Aug 22 06:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 4304.573799] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 4304.574828] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 4304.575846] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 4304.576923] ? show_regs.part.0+0x23/0x29 Aug 22 06:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 4304.577935] ? show_regs.cold+0x8/0xd Aug 22 06:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 4304.578910] ? watchdog_timer_fn+0x1be/0x220 Aug 22 06:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 4304.579914] ? lockup_detector_update_enable+0x60/0x60 Aug 22 06:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 4304.580973] ? __hrtimer_run_queues+0x107/0x230 Aug 22 06:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 4304.582037] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 06:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 4304.583064] ? hrtimer_interrupt+0x101/0x220 Aug 22 06:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 4304.584083] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 06:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 4304.585177] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 06:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 4304.586227] Aug 22 06:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 4304.587079] Aug 22 06:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 4304.587918] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 06:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 4304.588956] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 4304.590017] ? _raw_spin_lock+0x22/0x30 Aug 22 06:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 4304.591021] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 4304.592168] direct_page_fault+0x206/0x310 [kvm] Aug 22 06:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 4304.593253] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 06:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 4304.594268] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 06:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 4304.595280] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 06:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 4304.596252] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 06:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 4304.597221] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 06:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 4304.598207] handle_exit+0x98/0x230 [kvm_amd] Aug 22 06:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 4304.599100] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 06:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 4304.600015] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 06:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 4304.600942] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 06:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 4304.601890] vcpu_run+0x62/0x2c0 [kvm] Aug 22 06:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 4304.602712] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 06:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 4304.603516] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 06:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 4304.604368] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 06:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 4304.605180] ? __seccomp_filter+0x4a/0x4a0 Aug 22 06:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 4304.605929] ? __fget_files+0x86/0xc0 Aug 22 06:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 4304.606631] __x64_sys_ioctl+0x95/0xd0 Aug 22 06:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 4304.607322] do_syscall_64+0x5c/0xc0 Aug 22 06:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 4304.607984] ? do_futex+0x162/0x1f0 Aug 22 06:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 4304.608630] ? __x64_sys_futex+0x78/0x1e0 Aug 22 06:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 4304.609316] ? __secure_computing+0xa9/0x120 Aug 22 06:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 4304.610004] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 06:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 4304.610775] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 4304.611497] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 4304.612225] ? do_syscall_64+0x69/0xc0 Aug 22 06:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 4304.612880] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 4304.613604] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 4304.614297] ? do_syscall_64+0x69/0xc0 Aug 22 06:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 4304.614929] ? do_syscall_64+0x69/0xc0 Aug 22 06:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 4304.615549] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 06:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 4304.616258] RIP: 0033:0x7faa5d0edaff Aug 22 06:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 4304.616889] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 06:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 4304.618896] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 06:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 4304.619818] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 06:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 4304.620713] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 06:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 4304.621697] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 06:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 4304.622605] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 06:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 4304.623509] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 06:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 4304.624404] Aug 22 06:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 4317.476706] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 06:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 4317.477746] rcu: 1-....: (1046783 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=509786 Aug 22 06:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 4317.478873] (t=1050069 jiffies g=23269 q=13153) Aug 22 06:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 4317.479657] NMI backtrace for cpu 1 Aug 22 06:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 4317.480369] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 06:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 4317.481502] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 06:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 4317.482573] Call Trace: Aug 22 06:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 4317.483253] Aug 22 06:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 4317.483900] show_stack+0x52/0x5c Aug 22 06:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 4317.484631] dump_stack_lvl+0x4a/0x63 Aug 22 06:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 4317.485398] dump_stack+0x10/0x16 Aug 22 06:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 4317.486114] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 06:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 4317.486904] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 06:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 4317.487684] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 06:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 4317.488503] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 06:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 4317.489342] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 06:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 4317.490162] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 06:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 4317.490955] print_cpu_stall.cold+0x2f/0xe2 Aug 22 06:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 4317.491730] ? timekeeping_update+0xf7/0x150 Aug 22 06:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 4317.492497] check_cpu_stall+0x109/0x270 Aug 22 06:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 4317.493265] rcu_sched_clock_irq+0x9a/0x250 Aug 22 06:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 4317.494034] update_process_times+0x94/0xd0 Aug 22 06:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 4317.494790] tick_sched_handle+0x29/0x70 Aug 22 06:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 4317.495552] tick_sched_timer+0x8c/0xc0 Aug 22 06:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 4317.496290] ? tick_nohz_handler+0xb0/0xb0 Aug 22 06:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 4317.497057] __hrtimer_run_queues+0x107/0x230 Aug 22 06:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 4317.497833] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 06:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 4317.498690] hrtimer_interrupt+0x101/0x220 Aug 22 06:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 4317.499446] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 06:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 4317.500261] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 06:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 4317.501083] Aug 22 06:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 4317.501722] Aug 22 06:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 4317.502353] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 06:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 4317.503175] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 4317.504063] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 06:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 4317.506293] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 06:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 4317.507174] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 06:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 4317.508170] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 06:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 4317.509159] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 06:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 4317.510123] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 06:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 4317.511089] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 06:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 4317.512062] ? _raw_spin_lock+0x22/0x30 Aug 22 06:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 4317.512844] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 4317.513700] direct_page_fault+0x206/0x310 [kvm] Aug 22 06:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 4317.514543] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 06:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 4317.515383] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 06:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 4317.516209] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 06:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 4317.517216] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 06:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 4317.518009] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 06:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 4317.518833] handle_exit+0x98/0x230 [kvm_amd] Aug 22 06:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 4317.519588] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 06:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 4317.520370] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 06:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 4317.521181] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 06:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 4317.521970] vcpu_run+0x62/0x2c0 [kvm] Aug 22 06:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 4317.522691] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 06:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 4317.523430] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 06:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 4317.524306] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 06:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 4317.525090] ? __seccomp_filter+0x4a/0x4a0 Aug 22 06:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 4317.525989] ? __fget_files+0x86/0xc0 Aug 22 06:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 4317.526684] __x64_sys_ioctl+0x95/0xd0 Aug 22 06:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 4317.527380] do_syscall_64+0x5c/0xc0 Aug 22 06:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 4317.528067] ? do_futex+0x162/0x1f0 Aug 22 06:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 4317.528750] ? __x64_sys_futex+0x78/0x1e0 Aug 22 06:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 4317.529464] ? __secure_computing+0xa9/0x120 Aug 22 06:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 4317.530184] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 06:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 4317.530977] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 4317.531732] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 4317.532488] ? do_syscall_64+0x69/0xc0 Aug 22 06:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 4317.533191] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 4317.533951] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 4317.534721] ? do_syscall_64+0x69/0xc0 Aug 22 06:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 4317.535416] ? do_syscall_64+0x69/0xc0 Aug 22 06:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 4317.536107] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 06:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 4317.536881] RIP: 0033:0x7faa5d0edaff Aug 22 06:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 4317.537576] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 06:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 4317.539689] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 06:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 4317.540649] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 06:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 4317.541609] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 06:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 4317.542731] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 06:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 4317.543813] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 06:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 4317.544879] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 06:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 4317.545955] Aug 22 06:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 4344.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 3938s! [qemu-system-x86:6715] Aug 22 06:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 4344.543177] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 06:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 4344.543349] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 06:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 4344.555491] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 06:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 4344.556779] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 06:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 4344.557995] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 4344.559050] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 06:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 4344.561607] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 06:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 4344.562647] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 06:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 4344.563810] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 06:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 4344.564989] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 06:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 4344.566151] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 06:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 4344.567310] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 06:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 4344.568470] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 06:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 4344.569718] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 06:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 4344.570819] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 06:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 4344.572009] Call Trace: Aug 22 06:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 4344.572946] Aug 22 06:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 4344.573838] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 4344.574870] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 4344.575888] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 4344.576995] ? show_regs.part.0+0x23/0x29 Aug 22 06:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 4344.577990] ? show_regs.cold+0x8/0xd Aug 22 06:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 4344.578972] ? watchdog_timer_fn+0x1be/0x220 Aug 22 06:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 4344.579997] ? lockup_detector_update_enable+0x60/0x60 Aug 22 06:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 4344.581084] ? __hrtimer_run_queues+0x107/0x230 Aug 22 06:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 4344.582115] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 06:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 4344.583138] ? hrtimer_interrupt+0x101/0x220 Aug 22 06:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 4344.584151] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 06:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 4344.585256] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 06:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 4344.586318] Aug 22 06:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 4344.587173] Aug 22 06:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 4344.588013] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 06:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 4344.589060] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 4344.590109] ? _raw_spin_lock+0x22/0x30 Aug 22 06:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 4344.591060] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 4344.592078] direct_page_fault+0x206/0x310 [kvm] Aug 22 06:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 4344.593117] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 06:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 4344.594124] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 06:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 4344.595123] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 06:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 4344.596112] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 06:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 4344.597071] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 06:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 4344.598049] handle_exit+0x98/0x230 [kvm_amd] Aug 22 06:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 4344.598946] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 06:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 4344.599873] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 06:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 4344.600818] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 06:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 4344.601721] vcpu_run+0x62/0x2c0 [kvm] Aug 22 06:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 4344.602530] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 06:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 4344.603362] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 06:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 4344.604223] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 06:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 4344.605040] ? __seccomp_filter+0x4a/0x4a0 Aug 22 06:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 4344.605781] ? __fget_files+0x86/0xc0 Aug 22 06:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 4344.606498] __x64_sys_ioctl+0x95/0xd0 Aug 22 06:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 4344.607204] do_syscall_64+0x5c/0xc0 Aug 22 06:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 4344.607868] ? do_futex+0x162/0x1f0 Aug 22 06:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 4344.608526] ? __x64_sys_futex+0x78/0x1e0 Aug 22 06:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 4344.609232] ? __secure_computing+0xa9/0x120 Aug 22 06:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 4344.609922] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 06:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 4344.610705] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 4344.611440] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 4344.612157] ? do_syscall_64+0x69/0xc0 Aug 22 06:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 4344.612821] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 4344.613524] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 4344.614217] ? do_syscall_64+0x69/0xc0 Aug 22 06:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 4344.614842] ? do_syscall_64+0x69/0xc0 Aug 22 06:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 4344.615466] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 06:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 4344.616169] RIP: 0033:0x7faa5d0edaff Aug 22 06:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 4344.616810] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 06:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 4344.618813] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 06:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 4344.619728] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 06:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 4344.620641] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 06:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 4344.621534] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 06:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 4344.622438] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 06:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 4344.623330] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 06:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 4344.624223] Aug 22 06:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 4372.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 3964s! [qemu-system-x86:6715] Aug 22 06:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 4372.543877] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 06:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 4372.544059] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 06:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 4372.556434] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 06:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 4372.557699] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 06:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 4372.558941] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 4372.560012] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 06:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 4372.562664] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 06:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 4372.563708] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 06:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 4372.564897] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 06:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 4372.566072] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 06:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 4372.567260] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 06:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 4372.568457] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 06:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 4372.569635] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 06:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 4372.570895] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 06:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 4372.572002] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 06:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 4372.573195] Call Trace: Aug 22 06:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 4372.574110] Aug 22 06:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 4372.575000] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 4372.576028] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 4372.577052] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 4372.578122] ? show_regs.part.0+0x23/0x29 Aug 22 06:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 4372.579115] ? show_regs.cold+0x8/0xd Aug 22 06:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 4372.580083] ? watchdog_timer_fn+0x1be/0x220 Aug 22 06:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 4372.581132] ? lockup_detector_update_enable+0x60/0x60 Aug 22 06:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 4372.582238] ? __hrtimer_run_queues+0x107/0x230 Aug 22 06:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 4372.583315] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 06:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 4372.584364] ? hrtimer_interrupt+0x101/0x220 Aug 22 06:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 4372.585383] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 06:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 4372.586456] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 06:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 4372.587502] Aug 22 06:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 4372.588368] Aug 22 06:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 4372.589205] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 06:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 4372.590239] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 4372.591279] ? _raw_spin_lock+0x22/0x30 Aug 22 06:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 4372.592239] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 4372.593261] direct_page_fault+0x206/0x310 [kvm] Aug 22 06:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 4372.594295] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 06:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 4372.595331] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 06:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 4372.596362] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 06:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 4372.597347] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 06:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 4372.598293] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 06:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 4372.599299] handle_exit+0x98/0x230 [kvm_amd] Aug 22 06:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 4372.600202] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 06:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 4372.601127] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 06:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 4372.602053] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 06:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 4372.602958] vcpu_run+0x62/0x2c0 [kvm] Aug 22 06:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 4372.603801] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 06:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 4372.604651] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 06:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 4372.605544] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 06:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 4372.606352] ? __seccomp_filter+0x4a/0x4a0 Aug 22 06:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 4372.607110] ? __fget_files+0x86/0xc0 Aug 22 06:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 4372.607823] __x64_sys_ioctl+0x95/0xd0 Aug 22 06:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 4372.608533] do_syscall_64+0x5c/0xc0 Aug 22 06:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 4372.609220] ? do_futex+0x162/0x1f0 Aug 22 06:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 4372.609876] ? __x64_sys_futex+0x78/0x1e0 Aug 22 06:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 4372.610552] ? __secure_computing+0xa9/0x120 Aug 22 06:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 4372.611244] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 06:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 4372.612006] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 4372.612743] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 4372.613463] ? do_syscall_64+0x69/0xc0 Aug 22 06:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 4372.614113] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 4372.614816] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 4372.615512] ? do_syscall_64+0x69/0xc0 Aug 22 06:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 4372.616138] ? do_syscall_64+0x69/0xc0 Aug 22 06:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 4372.616768] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 06:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 4372.617471] RIP: 0033:0x7faa5d0edaff Aug 22 06:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 4372.618130] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 06:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 4372.620113] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 06:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 4372.621033] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 06:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 4372.621922] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 06:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 4372.622808] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 06:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 4372.623697] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 06:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 4372.624592] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 06:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 4372.625485] Aug 22 06:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 4400.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 3990s! [qemu-system-x86:6715] Aug 22 06:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 4400.543092] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 06:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 4400.543161] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 06:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 4400.555363] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 06:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 4400.556647] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 06:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 4400.557873] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 4400.558928] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 06:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 4400.561486] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 06:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 4400.562524] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 06:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 4400.563709] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 06:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 4400.564904] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 06:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 4400.566059] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 06:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 4400.567216] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 06:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 4400.568396] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 06:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 4400.569760] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 06:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 4400.570857] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 06:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 4400.572068] Call Trace: Aug 22 06:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 4400.572979] Aug 22 06:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 4400.573861] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 4400.574890] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 4400.575919] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 4400.577133] ? show_regs.part.0+0x23/0x29 Aug 22 06:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 4400.578128] ? show_regs.cold+0x8/0xd Aug 22 06:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 4400.579099] ? watchdog_timer_fn+0x1be/0x220 Aug 22 06:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 4400.580115] ? lockup_detector_update_enable+0x60/0x60 Aug 22 06:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 4400.581249] ? __hrtimer_run_queues+0x107/0x230 Aug 22 06:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 4400.582342] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 06:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 4400.583375] ? hrtimer_interrupt+0x101/0x220 Aug 22 06:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 4400.584406] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 06:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 4400.585535] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 06:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 4400.586595] Aug 22 06:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 4400.587448] Aug 22 06:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 4400.588300] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 06:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 4400.589338] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 4400.590471] ? _raw_spin_lock+0x22/0x30 Aug 22 06:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 4400.591422] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 4400.592469] direct_page_fault+0x206/0x310 [kvm] Aug 22 06:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 4400.593528] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 06:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 4400.594542] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 06:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 4400.595547] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 06:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 4400.596534] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 06:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 4400.597483] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 06:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 4400.598476] handle_exit+0x98/0x230 [kvm_amd] Aug 22 06:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 4400.599372] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 06:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 4400.600312] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 06:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 4400.601243] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 06:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 4400.602155] vcpu_run+0x62/0x2c0 [kvm] Aug 22 06:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 4400.603077] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 06:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 4400.604193] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 06:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 4400.605227] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 06:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 4400.606112] ? __seccomp_filter+0x4a/0x4a0 Aug 22 06:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 4400.607020] ? __fget_files+0x86/0xc0 Aug 22 06:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 4400.608004] __x64_sys_ioctl+0x95/0xd0 Aug 22 06:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 4400.609006] do_syscall_64+0x5c/0xc0 Aug 22 06:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 4400.609725] ? do_futex+0x162/0x1f0 Aug 22 06:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 4400.610397] ? __x64_sys_futex+0x78/0x1e0 Aug 22 06:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 4400.611130] ? __secure_computing+0xa9/0x120 Aug 22 06:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 4400.611858] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 06:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 4400.612646] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 4400.613373] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 4400.614097] ? do_syscall_64+0x69/0xc0 Aug 22 06:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 4400.614765] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 4400.615484] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 4400.616219] ? do_syscall_64+0x69/0xc0 Aug 22 06:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 4400.616859] ? do_syscall_64+0x69/0xc0 Aug 22 06:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 4400.617486] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 06:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 4400.618192] RIP: 0033:0x7faa5d0edaff Aug 22 06:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 4400.618820] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 06:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 4400.620828] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 06:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 4400.621852] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 06:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 4400.622777] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 06:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 4400.623677] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 06:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 4400.624588] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 06:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 4400.625478] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 06:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 4400.626374] Aug 22 06:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 4428.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 4016s! [qemu-system-x86:6715] Aug 22 06:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 4428.543081] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 06:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 4428.543148] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 06:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 4428.555267] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 06:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 4428.556550] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 06:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 4428.557775] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 4428.558833] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 06:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 4428.561409] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 06:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 4428.562465] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 06:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 4428.563647] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 06:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 4428.564808] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 06:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 4428.565963] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 06:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 4428.567143] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 06:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 4428.568324] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 06:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 4428.569551] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 06:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 4428.570659] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 06:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 4428.571877] Call Trace: Aug 22 06:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 4428.572791] Aug 22 06:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 4428.573671] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 4428.574697] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 4428.575730] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 4428.576804] ? show_regs.part.0+0x23/0x29 Aug 22 06:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 4428.577796] ? show_regs.cold+0x8/0xd Aug 22 06:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 4428.578763] ? watchdog_timer_fn+0x1be/0x220 Aug 22 06:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 4428.579784] ? lockup_detector_update_enable+0x60/0x60 Aug 22 06:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 4428.580849] ? __hrtimer_run_queues+0x107/0x230 Aug 22 06:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 4428.581880] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 06:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 4428.582908] ? hrtimer_interrupt+0x101/0x220 Aug 22 06:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 4428.583949] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 06:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 4428.585024] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 06:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 4428.586086] Aug 22 06:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 4428.586946] Aug 22 06:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 4428.587800] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 06:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 4428.588832] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 4428.589870] ? _raw_spin_lock+0x22/0x30 Aug 22 06:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 4428.590813] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 4428.591859] direct_page_fault+0x206/0x310 [kvm] Aug 22 06:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 4428.592896] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 06:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 4428.593904] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 06:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 4428.594902] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 06:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 4428.595894] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 06:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 4428.596861] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 06:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 4428.597839] handle_exit+0x98/0x230 [kvm_amd] Aug 22 06:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 4428.598730] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 06:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 4428.599665] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 06:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 4428.600586] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 06:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 4428.601489] vcpu_run+0x62/0x2c0 [kvm] Aug 22 06:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 4428.602305] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 06:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 4428.603111] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 06:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 4428.603978] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 06:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 4428.604809] ? __seccomp_filter+0x4a/0x4a0 Aug 22 06:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 4428.605551] ? __fget_files+0x86/0xc0 Aug 22 06:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 4428.606275] __x64_sys_ioctl+0x95/0xd0 Aug 22 06:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 4428.606974] do_syscall_64+0x5c/0xc0 Aug 22 06:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 4428.607665] ? do_futex+0x162/0x1f0 Aug 22 06:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 4428.608314] ? __x64_sys_futex+0x78/0x1e0 Aug 22 06:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 4428.608985] ? __secure_computing+0xa9/0x120 Aug 22 06:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 4428.609678] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 06:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 4428.610441] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 4428.611166] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 4428.611898] ? do_syscall_64+0x69/0xc0 Aug 22 06:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 4428.612545] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 4428.613246] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 4428.613938] ? do_syscall_64+0x69/0xc0 Aug 22 06:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 4428.614561] ? do_syscall_64+0x69/0xc0 Aug 22 06:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 4428.615182] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 06:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 4428.615899] RIP: 0033:0x7faa5d0edaff Aug 22 06:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 4428.616525] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 06:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 4428.618570] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 06:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 4428.619501] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 06:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 4428.620414] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 06:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 4428.621323] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 06:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 4428.622231] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 06:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 4428.623118] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 06:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 4428.624030] Aug 22 06:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 4456.541984] watchdog: BUG: soft lockup - CPU#1 stuck for 4042s! [qemu-system-x86:6715] Aug 22 06:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 4456.544473] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 06:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 4456.544782] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 06:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 4456.562212] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 06:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 4456.564070] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 06:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 4456.565932] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 4456.567531] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 06:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 4456.571165] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 06:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 4456.572752] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 06:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 4456.574448] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 06:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 4456.575864] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 06:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 4456.577161] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 06:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 4456.578644] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 06:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 4456.579920] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 06:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 4456.581278] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 06:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 4456.582387] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 06:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 4456.583808] Call Trace: Aug 22 06:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 4456.584723] Aug 22 06:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 4456.585625] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 4456.586658] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 4456.587766] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 4456.588867] ? show_regs.part.0+0x23/0x29 Aug 22 06:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 4456.589867] ? show_regs.cold+0x8/0xd Aug 22 06:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 4456.590983] ? watchdog_timer_fn+0x1be/0x220 Aug 22 06:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 4456.592153] ? lockup_detector_update_enable+0x60/0x60 Aug 22 06:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 4456.593220] ? __hrtimer_run_queues+0x107/0x230 Aug 22 06:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 4456.594250] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 06:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 4456.595404] ? hrtimer_interrupt+0x101/0x220 Aug 22 06:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 4456.596584] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 06:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 4456.597719] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 06:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 4456.598927] Aug 22 06:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 4456.599967] Aug 22 06:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 4456.600948] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 06:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 4456.602112] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 4456.603297] ? _raw_spin_lock+0x22/0x30 Aug 22 06:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 4456.604258] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 4456.605285] direct_page_fault+0x206/0x310 [kvm] Aug 22 06:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 4456.606323] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 06:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 4456.607382] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 06:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 4456.608480] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 06:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 4456.609508] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 06:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 4456.610461] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 06:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 4456.611682] handle_exit+0x98/0x230 [kvm_amd] Aug 22 06:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 4456.612702] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 06:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 4456.613757] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 06:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 4456.614841] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 06:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 4456.615802] vcpu_run+0x62/0x2c0 [kvm] Aug 22 06:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 4456.616732] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 06:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 4456.617579] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 06:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 4456.618432] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 06:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 4456.619328] ? __seccomp_filter+0x4a/0x4a0 Aug 22 06:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 4456.620146] ? __fget_files+0x86/0xc0 Aug 22 06:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 4456.620920] __x64_sys_ioctl+0x95/0xd0 Aug 22 06:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 4456.621676] do_syscall_64+0x5c/0xc0 Aug 22 06:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 4456.622503] ? do_futex+0x162/0x1f0 Aug 22 06:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 4456.623233] ? __x64_sys_futex+0x78/0x1e0 Aug 22 06:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 4456.623930] ? __secure_computing+0xa9/0x120 Aug 22 06:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 4456.624626] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 06:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 4456.625677] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 4456.626470] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 4456.627219] ? do_syscall_64+0x69/0xc0 Aug 22 06:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 4456.627867] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 4456.628571] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 4456.629266] ? do_syscall_64+0x69/0xc0 Aug 22 06:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 4456.629894] ? do_syscall_64+0x69/0xc0 Aug 22 06:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 4456.630515] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 06:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 4456.631229] RIP: 0033:0x7faa5d0edaff Aug 22 06:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 4456.631900] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 06:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 4456.633903] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 06:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 4456.634821] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 06:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 4456.635877] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 06:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 4456.636776] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 06:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 4456.637674] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 06:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 4456.638565] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 06:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 4456.639563] Aug 22 06:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 4484.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 4068s! [qemu-system-x86:6715] Aug 22 06:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 4484.543135] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 06:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 4484.543205] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 06:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 4484.555408] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 06:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 4484.556677] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 06:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 4484.557904] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 4484.558977] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 06:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 4484.561540] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 06:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 4484.562582] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 06:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 4484.563765] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 06:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 4484.564923] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 06:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 4484.566081] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 06:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 4484.567263] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 06:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 4484.568435] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 06:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 4484.569674] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 06:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 4484.570774] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 06:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 4484.571987] Call Trace: Aug 22 06:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 4484.572902] Aug 22 06:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 4484.573790] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 4484.574825] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 4484.575859] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 4484.576937] ? show_regs.part.0+0x23/0x29 Aug 22 06:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 4484.577939] ? show_regs.cold+0x8/0xd Aug 22 06:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 4484.578926] ? watchdog_timer_fn+0x1be/0x220 Aug 22 06:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 4484.579936] ? lockup_detector_update_enable+0x60/0x60 Aug 22 06:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 4484.581029] ? __hrtimer_run_queues+0x107/0x230 Aug 22 06:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 4484.582062] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 06:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 4484.583108] ? hrtimer_interrupt+0x101/0x220 Aug 22 06:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 4484.584122] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 06:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 4484.585197] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 06:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 4484.586242] Aug 22 06:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 4484.587114] Aug 22 06:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 4484.587952] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 06:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 4484.588982] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 4484.590025] ? _raw_spin_lock+0x22/0x30 Aug 22 06:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 4484.590984] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 4484.592004] direct_page_fault+0x206/0x310 [kvm] Aug 22 06:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 4484.593033] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 06:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 4484.594042] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 06:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 4484.595064] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 06:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 4484.596035] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 06:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 4484.596985] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 06:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 4484.597963] handle_exit+0x98/0x230 [kvm_amd] Aug 22 06:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 4484.598876] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 06:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 4484.599803] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 06:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 4484.600730] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 06:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 4484.601708] vcpu_run+0x62/0x2c0 [kvm] Aug 22 06:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 4484.602519] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 06:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 4484.603357] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 06:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 4484.604217] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 06:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 4484.605016] ? __seccomp_filter+0x4a/0x4a0 Aug 22 06:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 4484.605906] ? __fget_files+0x86/0xc0 Aug 22 06:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 4484.606608] __x64_sys_ioctl+0x95/0xd0 Aug 22 06:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 4484.607324] do_syscall_64+0x5c/0xc0 Aug 22 06:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 4484.607992] ? do_futex+0x162/0x1f0 Aug 22 06:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 4484.608641] ? __x64_sys_futex+0x78/0x1e0 Aug 22 06:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 4484.609318] ? __secure_computing+0xa9/0x120 Aug 22 06:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 4484.610011] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 06:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 4484.610807] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 4484.611558] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 4484.612278] ? do_syscall_64+0x69/0xc0 Aug 22 06:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 4484.612922] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 4484.613623] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 4484.614316] ? do_syscall_64+0x69/0xc0 Aug 22 06:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 4484.614959] ? do_syscall_64+0x69/0xc0 Aug 22 06:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 4484.615589] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 06:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 4484.616293] RIP: 0033:0x7faa5d0edaff Aug 22 06:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 4484.616917] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 06:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 4484.618925] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 06:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 4484.619835] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 06:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 4484.620729] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 06:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 4484.621621] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 06:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 4484.622516] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 06:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 4484.623429] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 06:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 4484.624320] Aug 22 06:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 4497.488707] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 06:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 4497.489670] rcu: 1-....: (1091648 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=531704 Aug 22 06:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 4497.490793] (t=1095072 jiffies g=23269 q=13497) Aug 22 06:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 4497.491576] NMI backtrace for cpu 1 Aug 22 06:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 4497.492285] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 06:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 4497.493385] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 06:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 4497.494446] Call Trace: Aug 22 06:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 4497.495133] Aug 22 06:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 4497.495804] show_stack+0x52/0x5c Aug 22 06:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 4497.496532] dump_stack_lvl+0x4a/0x63 Aug 22 06:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 4497.497277] dump_stack+0x10/0x16 Aug 22 06:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 4497.497993] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 06:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 4497.498793] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 06:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 4497.499571] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 06:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 4497.500390] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 06:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 4497.501209] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 06:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 4497.502021] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 06:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 4497.502807] print_cpu_stall.cold+0x2f/0xe2 Aug 22 06:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 4497.503575] ? timekeeping_update+0xf7/0x150 Aug 22 06:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 4497.504345] check_cpu_stall+0x109/0x270 Aug 22 06:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 4497.505090] rcu_sched_clock_irq+0x9a/0x250 Aug 22 06:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 4497.505850] update_process_times+0x94/0xd0 Aug 22 06:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 4497.506609] tick_sched_handle+0x29/0x70 Aug 22 06:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 4497.507365] tick_sched_timer+0x8c/0xc0 Aug 22 06:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 4497.508101] ? tick_nohz_handler+0xb0/0xb0 Aug 22 06:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 4497.508857] __hrtimer_run_queues+0x107/0x230 Aug 22 06:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 4497.509640] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 06:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 4497.510419] hrtimer_interrupt+0x101/0x220 Aug 22 06:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 4497.511198] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 06:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 4497.512007] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 06:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 4497.512805] Aug 22 06:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 4497.513478] Aug 22 06:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 4497.514114] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 06:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 4497.514949] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 4497.515840] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 06:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 4497.518057] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 06:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 4497.518953] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 06:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 4497.519938] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 06:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 4497.520927] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 06:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 4497.521897] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 06:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 4497.522883] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 06:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 4497.523834] ? _raw_spin_lock+0x22/0x30 Aug 22 06:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 4497.524591] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 4497.525427] direct_page_fault+0x206/0x310 [kvm] Aug 22 06:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 4497.526261] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 06:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 4497.527099] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 06:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 4497.527918] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 06:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 4497.528719] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 06:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 4497.529501] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 06:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 4497.530320] handle_exit+0x98/0x230 [kvm_amd] Aug 22 06:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 4497.531087] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 06:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 4497.531871] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 06:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 4497.532668] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 06:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 4497.533634] vcpu_run+0x62/0x2c0 [kvm] Aug 22 06:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 4497.534347] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 06:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 4497.535094] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 06:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 4497.535894] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 06:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 4497.536653] ? __seccomp_filter+0x4a/0x4a0 Aug 22 06:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 4497.537370] ? __fget_files+0x86/0xc0 Aug 22 06:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 4497.538060] __x64_sys_ioctl+0x95/0xd0 Aug 22 06:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 4497.538767] do_syscall_64+0x5c/0xc0 Aug 22 06:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 4497.539467] ? do_futex+0x162/0x1f0 Aug 22 06:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 4497.540137] ? __x64_sys_futex+0x78/0x1e0 Aug 22 06:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 4497.540846] ? __secure_computing+0xa9/0x120 Aug 22 06:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 4497.541750] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 06:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 4497.542545] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 4497.543321] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 4497.544093] ? do_syscall_64+0x69/0xc0 Aug 22 06:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 4497.544781] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 4497.545544] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 4497.546310] ? do_syscall_64+0x69/0xc0 Aug 22 06:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 4497.547018] ? do_syscall_64+0x69/0xc0 Aug 22 06:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 4497.547712] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 06:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 4497.548498] RIP: 0033:0x7faa5d0edaff Aug 22 06:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 4497.549177] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 06:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 4497.551304] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 06:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 4497.552260] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 06:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 4497.553199] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 06:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 4497.554136] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 06:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 4497.555086] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 06:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 4497.556011] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 06:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 4497.556919] Aug 22 06:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 4524.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 4105s! [qemu-system-x86:6715] Aug 22 06:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 4524.543116] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 06:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 4524.543185] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 06:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 4524.555200] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 06:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 4524.556466] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 06:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 4524.557690] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 4524.558756] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 06:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 4524.561290] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 06:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 4524.562328] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 06:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 4524.563498] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 06:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 4524.564658] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 06:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 4524.565813] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 06:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 4524.566980] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 06:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 4524.568149] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 06:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 4524.569378] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 06:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 4524.570490] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 06:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 4524.571684] Call Trace: Aug 22 06:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 4524.572594] Aug 22 06:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 4524.573476] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 4524.574514] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 4524.575541] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 4524.576613] ? show_regs.part.0+0x23/0x29 Aug 22 06:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 4524.577607] ? show_regs.cold+0x8/0xd Aug 22 06:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 4524.578586] ? watchdog_timer_fn+0x1be/0x220 Aug 22 06:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 4524.579591] ? lockup_detector_update_enable+0x60/0x60 Aug 22 06:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 4524.580651] ? __hrtimer_run_queues+0x107/0x230 Aug 22 06:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 4524.581675] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 06:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 4524.582708] ? hrtimer_interrupt+0x101/0x220 Aug 22 06:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 4524.583721] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 06:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 4524.584788] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 06:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 4524.585829] Aug 22 06:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 4524.586694] Aug 22 06:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 4524.587530] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 06:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 4524.588559] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 4524.589600] ? _raw_spin_lock+0x22/0x30 Aug 22 06:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 4524.590554] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 4524.591568] direct_page_fault+0x206/0x310 [kvm] Aug 22 06:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 4524.592594] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 06:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 4524.593600] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 06:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 4524.594618] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 06:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 4524.595591] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 06:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 4524.596536] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 06:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 4524.597512] handle_exit+0x98/0x230 [kvm_amd] Aug 22 06:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 4524.598412] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 06:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 4524.599324] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 06:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 4524.600245] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 06:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 4524.601149] vcpu_run+0x62/0x2c0 [kvm] Aug 22 06:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 4524.601956] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 06:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 4524.602777] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 06:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 4524.603629] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 06:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 4524.604424] ? __seccomp_filter+0x4a/0x4a0 Aug 22 06:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 4524.605163] ? __fget_files+0x86/0xc0 Aug 22 06:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 4524.605873] __x64_sys_ioctl+0x95/0xd0 Aug 22 06:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 4524.606577] do_syscall_64+0x5c/0xc0 Aug 22 06:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 4524.607239] ? do_futex+0x162/0x1f0 Aug 22 06:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 4524.607885] ? __x64_sys_futex+0x78/0x1e0 Aug 22 06:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 4524.608556] ? __secure_computing+0xa9/0x120 Aug 22 06:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 4524.609252] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 06:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 4524.610019] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 4524.610750] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 4524.611466] ? do_syscall_64+0x69/0xc0 Aug 22 06:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 4524.612113] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 4524.612813] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 4524.613505] ? do_syscall_64+0x69/0xc0 Aug 22 06:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 4524.614127] ? do_syscall_64+0x69/0xc0 Aug 22 06:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 4524.614756] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 06:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 4524.615459] RIP: 0033:0x7faa5d0edaff Aug 22 06:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 4524.616079] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 06:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 4524.618058] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 06:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 4524.618978] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 06:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 4524.619862] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 06:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 4524.620745] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 06:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 4524.621632] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 06:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 4524.622528] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 06:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 4524.623417] Aug 22 06:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 4552.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 4131s! [qemu-system-x86:6715] Aug 22 06:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 4552.543704] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 06:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 4552.543955] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 06:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 4552.556849] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 06:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 4552.558149] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 06:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 4552.559385] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 4552.560492] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 06:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 4552.563339] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 06:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 4552.564421] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 06:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 4552.565599] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 06:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 4552.566786] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 06:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 4552.567957] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 06:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 4552.569125] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 06:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 4552.570319] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 06:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 4552.571568] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 06:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 4552.572681] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 06:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 4552.573891] Call Trace: Aug 22 06:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 4552.574811] Aug 22 06:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 4552.575706] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 4552.576740] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 4552.577764] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 4552.578867] ? show_regs.part.0+0x23/0x29 Aug 22 06:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 4552.579865] ? show_regs.cold+0x8/0xd Aug 22 06:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 4552.580843] ? watchdog_timer_fn+0x1be/0x220 Aug 22 06:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 4552.581857] ? lockup_detector_update_enable+0x60/0x60 Aug 22 06:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 4552.582939] ? __hrtimer_run_queues+0x107/0x230 Aug 22 06:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 4552.584049] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 06:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 4552.585088] ? hrtimer_interrupt+0x101/0x220 Aug 22 06:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 4552.586150] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 06:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 4552.587506] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 06:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 4552.588562] Aug 22 06:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 4552.589492] Aug 22 06:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 4552.590391] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 06:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 4552.591436] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 4552.592484] ? _raw_spin_lock+0x22/0x30 Aug 22 06:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 4552.593451] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 4552.594485] direct_page_fault+0x206/0x310 [kvm] Aug 22 06:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 4552.595518] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 06:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 4552.596532] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 06:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 4552.597542] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 06:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 4552.598584] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 06:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 4552.599543] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 06:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 4552.600528] handle_exit+0x98/0x230 [kvm_amd] Aug 22 06:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 4552.601430] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 06:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 4552.602358] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 06:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 4552.603288] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 06:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 4552.604190] vcpu_run+0x62/0x2c0 [kvm] Aug 22 06:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 4552.604999] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 06:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 4552.605873] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 06:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 4552.606923] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 06:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 4552.607822] ? __seccomp_filter+0x4a/0x4a0 Aug 22 06:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 4552.608643] ? __fget_files+0x86/0xc0 Aug 22 06:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 4552.609664] __x64_sys_ioctl+0x95/0xd0 Aug 22 06:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 4552.610375] do_syscall_64+0x5c/0xc0 Aug 22 06:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 4552.611041] ? do_futex+0x162/0x1f0 Aug 22 06:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 4552.611701] ? __x64_sys_futex+0x78/0x1e0 Aug 22 06:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 4552.612381] ? __secure_computing+0xa9/0x120 Aug 22 06:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 4552.613070] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 06:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 4552.613842] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 4552.614575] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 4552.615298] ? do_syscall_64+0x69/0xc0 Aug 22 06:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 4552.615948] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 4552.616649] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 4552.617370] ? do_syscall_64+0x69/0xc0 Aug 22 06:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 4552.617994] ? do_syscall_64+0x69/0xc0 Aug 22 06:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 4552.618654] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 06:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 4552.619364] RIP: 0033:0x7faa5d0edaff Aug 22 06:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 4552.620033] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 06:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 4552.622106] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 06:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 4552.623016] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 06:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 4552.623902] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 06:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 4552.624788] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 06:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 4552.625680] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 06:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 4552.626587] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 06:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 4552.627476] Aug 22 06:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 4580.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 4157s! [qemu-system-x86:6715] Aug 22 06:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 4580.543087] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 06:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 4580.543155] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 06:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 4580.555168] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 06:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 4580.556451] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 06:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 4580.557666] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 4580.558730] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 06:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 4580.561259] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 06:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 4580.562311] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 06:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 4580.563470] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 06:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 4580.564624] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 06:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 4580.565795] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 06:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 4580.566956] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 06:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 4580.568123] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 06:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 4580.569349] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 06:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 4580.570465] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 06:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 4580.571654] Call Trace: Aug 22 06:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 4580.572564] Aug 22 06:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 4580.573444] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 4580.574480] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 4580.575496] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 4580.576572] ? show_regs.part.0+0x23/0x29 Aug 22 06:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 4580.577567] ? show_regs.cold+0x8/0xd Aug 22 06:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 4580.578546] ? watchdog_timer_fn+0x1be/0x220 Aug 22 06:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 4580.579554] ? lockup_detector_update_enable+0x60/0x60 Aug 22 06:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 4580.580622] ? __hrtimer_run_queues+0x107/0x230 Aug 22 06:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 4580.581656] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 06:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 4580.582700] ? hrtimer_interrupt+0x101/0x220 Aug 22 06:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 4580.583712] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 06:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 4580.584776] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 06:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 4580.585867] Aug 22 06:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 4580.586728] Aug 22 06:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 4580.587565] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 06:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 4580.588597] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 4580.589635] ? _raw_spin_lock+0x22/0x30 Aug 22 06:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 4580.590589] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 4580.591602] direct_page_fault+0x206/0x310 [kvm] Aug 22 06:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 4580.592623] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 06:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 4580.593630] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 06:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 4580.594638] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 06:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 4580.595606] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 06:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 4580.596550] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 06:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 4580.597527] handle_exit+0x98/0x230 [kvm_amd] Aug 22 06:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 4580.598430] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 06:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 4580.599342] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 06:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 4580.600264] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 06:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 4580.601165] vcpu_run+0x62/0x2c0 [kvm] Aug 22 06:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 4580.602010] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 06:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 4580.602826] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 06:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 4580.603679] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 06:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 4580.604509] ? __seccomp_filter+0x4a/0x4a0 Aug 22 06:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 4580.605262] ? __fget_files+0x86/0xc0 Aug 22 06:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 4580.605986] __x64_sys_ioctl+0x95/0xd0 Aug 22 06:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 4580.606702] do_syscall_64+0x5c/0xc0 Aug 22 06:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 4580.607522] ? do_futex+0x162/0x1f0 Aug 22 06:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 4580.608208] ? __x64_sys_futex+0x78/0x1e0 Aug 22 06:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 4580.608890] ? __secure_computing+0xa9/0x120 Aug 22 06:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 4580.609594] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 06:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 4580.610381] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 4580.611103] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 4580.611960] ? do_syscall_64+0x69/0xc0 Aug 22 06:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 4580.612614] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 4580.613344] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 4580.614080] ? do_syscall_64+0x69/0xc0 Aug 22 06:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 4580.614712] ? do_syscall_64+0x69/0xc0 Aug 22 06:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 4580.615342] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 06:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 4580.616046] RIP: 0033:0x7faa5d0edaff Aug 22 06:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 4580.616670] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 06:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 4580.618667] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 06:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 4580.619591] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 06:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 4580.620491] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 06:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 4580.621380] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 06:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 4580.622279] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 06:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 4580.623172] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 06:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 4580.624064] Aug 22 06:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 4608.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 4184s! [qemu-system-x86:6715] Aug 22 06:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 4608.543105] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 06:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 4608.543173] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 06:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 4608.555255] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 06:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 4608.556525] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 06:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 4608.557749] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 4608.558840] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 06:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 4608.561407] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 06:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 4608.562469] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 06:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 4608.563635] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 06:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 4608.564835] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 06:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 4608.566015] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 06:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 4608.567184] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 06:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 4608.568351] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 06:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 4608.569598] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 06:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 4608.570698] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 06:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 4608.571955] Call Trace: Aug 22 06:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 4608.572871] Aug 22 06:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 4608.573808] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 4608.575251] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 4608.576377] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 4608.577530] ? show_regs.part.0+0x23/0x29 Aug 22 06:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 4608.578529] ? show_regs.cold+0x8/0xd Aug 22 06:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 4608.579508] ? watchdog_timer_fn+0x1be/0x220 Aug 22 06:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 4608.580524] ? lockup_detector_update_enable+0x60/0x60 Aug 22 06:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 4608.581610] ? __hrtimer_run_queues+0x107/0x230 Aug 22 06:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 4608.582651] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 06:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 4608.583683] ? hrtimer_interrupt+0x101/0x220 Aug 22 06:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 4608.584704] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 06:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 4608.585785] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 06:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 4608.586835] Aug 22 06:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 4608.587687] Aug 22 06:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 4608.588525] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 06:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 4608.589573] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 4608.590615] ? _raw_spin_lock+0x22/0x30 Aug 22 06:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 4608.591564] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 4608.592586] direct_page_fault+0x206/0x310 [kvm] Aug 22 06:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 4608.593657] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 06:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 4608.594696] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 06:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 4608.595701] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 06:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 4608.596678] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 06:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 4608.597640] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 06:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 4608.598620] handle_exit+0x98/0x230 [kvm_amd] Aug 22 06:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 4608.599515] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 06:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 4608.600438] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 06:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 4608.601373] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 06:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 4608.602282] vcpu_run+0x62/0x2c0 [kvm] Aug 22 06:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 4608.603091] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 06:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 4608.603902] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 06:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 4608.604755] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 06:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 4608.605560] ? __seccomp_filter+0x4a/0x4a0 Aug 22 06:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 4608.606301] ? __fget_files+0x86/0xc0 Aug 22 06:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 4608.607004] __x64_sys_ioctl+0x95/0xd0 Aug 22 06:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 4608.607694] do_syscall_64+0x5c/0xc0 Aug 22 06:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 4608.608357] ? do_futex+0x162/0x1f0 Aug 22 06:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 4608.609004] ? __x64_sys_futex+0x78/0x1e0 Aug 22 06:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 4608.609685] ? __secure_computing+0xa9/0x120 Aug 22 06:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 4608.610375] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 06:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 4608.611137] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 4608.611857] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 4608.612597] ? do_syscall_64+0x69/0xc0 Aug 22 06:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 4608.613242] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 4608.613962] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 4608.614657] ? do_syscall_64+0x69/0xc0 Aug 22 06:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 4608.615283] ? do_syscall_64+0x69/0xc0 Aug 22 06:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 4608.615905] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 06:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 4608.616610] RIP: 0033:0x7faa5d0edaff Aug 22 06:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 4608.617235] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 06:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 4608.619252] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 06:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 4608.620169] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 06:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 4608.621061] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 06:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 4608.621966] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 06:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 4608.622874] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 06:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 4608.623779] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 06:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 4608.624670] Aug 22 06:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 4636.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 4210s! [qemu-system-x86:6715] Aug 22 06:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 4636.543358] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 06:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 4636.543576] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 06:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 4636.557602] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 06:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 4636.559046] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 06:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 4636.560425] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 4636.561612] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 06:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 4636.564516] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 06:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 4636.565704] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 06:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 4636.567007] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 06:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 4636.568307] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 06:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 4636.569619] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 06:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 4636.570912] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 06:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 4636.572215] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 06:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 4636.573625] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 06:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 4636.574847] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 06:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 4636.576191] Call Trace: Aug 22 06:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 4636.577178] Aug 22 06:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 4636.578140] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 4636.579264] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 4636.580375] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 4636.581579] ? show_regs.part.0+0x23/0x29 Aug 22 06:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 4636.582661] ? show_regs.cold+0x8/0xd Aug 22 06:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 4636.583715] ? watchdog_timer_fn+0x1be/0x220 Aug 22 06:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 4636.584806] ? lockup_detector_update_enable+0x60/0x60 Aug 22 06:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 4636.585986] ? __hrtimer_run_queues+0x107/0x230 Aug 22 06:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 4636.587107] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 06:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 4636.588221] ? hrtimer_interrupt+0x101/0x220 Aug 22 06:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 4636.589347] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 06:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 4636.590531] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 06:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 4636.591685] Aug 22 06:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 4636.592588] Aug 22 06:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 4636.593498] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 06:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 4636.594639] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 4636.595788] ? _raw_spin_lock+0x22/0x30 Aug 22 06:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 4636.596818] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 4636.597951] direct_page_fault+0x206/0x310 [kvm] Aug 22 06:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 4636.599075] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 06:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 4636.600178] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 06:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 4636.601363] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 06:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 4636.602464] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 06:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 4636.603508] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 06:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 4636.604590] handle_exit+0x98/0x230 [kvm_amd] Aug 22 06:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 4636.605597] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 06:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 4636.606614] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 06:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 4636.607637] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 06:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 4636.608577] vcpu_run+0x62/0x2c0 [kvm] Aug 22 06:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 4636.609513] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 06:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 4636.610415] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 06:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 4636.611365] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 06:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 4636.612258] ? __seccomp_filter+0x4a/0x4a0 Aug 22 06:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 4636.613103] ? __fget_files+0x86/0xc0 Aug 22 06:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 4636.613883] __x64_sys_ioctl+0x95/0xd0 Aug 22 06:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 4636.614651] do_syscall_64+0x5c/0xc0 Aug 22 06:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 4636.615393] ? do_futex+0x162/0x1f0 Aug 22 06:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 4636.616115] ? __x64_sys_futex+0x78/0x1e0 Aug 22 06:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 4636.616873] ? __secure_computing+0xa9/0x120 Aug 22 06:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 4636.617667] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 06:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 4636.618539] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 4636.619367] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 4636.620177] ? do_syscall_64+0x69/0xc0 Aug 22 06:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 4636.620847] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 4636.621572] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 4636.622418] ? do_syscall_64+0x69/0xc0 Aug 22 06:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 4636.623049] ? do_syscall_64+0x69/0xc0 Aug 22 06:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 4636.623674] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 06:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 4636.624418] RIP: 0033:0x7faa5d0edaff Aug 22 06:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 4636.625100] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 06:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 4636.627111] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 06:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 4636.628030] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 06:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 4636.628923] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 06:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 4636.629838] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 06:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 4636.630727] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 06:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 4636.631618] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 06:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 4636.632520] Aug 22 06:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 4664.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 4236s! [qemu-system-x86:6715] Aug 22 06:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 4664.543679] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 06:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 4664.543836] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 06:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 4664.555933] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 06:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 4664.557206] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 06:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 4664.558423] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 4664.559485] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 06:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 4664.562033] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 06:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 4664.563076] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 06:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 4664.564243] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 06:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 4664.565414] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 06:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 4664.566577] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 06:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 4664.567741] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 06:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 4664.568923] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 06:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 4664.570163] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 06:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 4664.571264] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 06:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 4664.572457] Call Trace: Aug 22 06:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 4664.573387] Aug 22 06:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 4664.574270] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 4664.575304] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 4664.576328] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 4664.577424] ? show_regs.part.0+0x23/0x29 Aug 22 06:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 4664.578421] ? show_regs.cold+0x8/0xd Aug 22 06:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 4664.579391] ? watchdog_timer_fn+0x1be/0x220 Aug 22 06:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 4664.580398] ? lockup_detector_update_enable+0x60/0x60 Aug 22 06:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 4664.581619] ? __hrtimer_run_queues+0x107/0x230 Aug 22 06:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 4664.582652] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 06:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 4664.583679] ? hrtimer_interrupt+0x101/0x220 Aug 22 06:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 4664.584703] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 06:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 4664.585776] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 06:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 4664.586823] Aug 22 06:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 4664.587674] Aug 22 06:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 4664.588508] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 06:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 4664.589554] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 4664.590592] ? _raw_spin_lock+0x22/0x30 Aug 22 06:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 4664.591538] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 4664.592550] direct_page_fault+0x206/0x310 [kvm] Aug 22 06:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 4664.593589] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 06:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 4664.594598] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 06:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 4664.595599] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 06:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 4664.596579] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 06:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 4664.597547] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 06:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 4664.598523] handle_exit+0x98/0x230 [kvm_amd] Aug 22 06:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 4664.599413] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 06:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 4664.600328] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 06:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 4664.601268] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 06:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 4664.602169] vcpu_run+0x62/0x2c0 [kvm] Aug 22 06:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 4664.602984] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 06:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 4664.603788] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 06:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 4664.604640] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 06:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 4664.605451] ? __seccomp_filter+0x4a/0x4a0 Aug 22 06:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 4664.606195] ? __fget_files+0x86/0xc0 Aug 22 06:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 4664.606895] __x64_sys_ioctl+0x95/0xd0 Aug 22 06:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 4664.607590] do_syscall_64+0x5c/0xc0 Aug 22 06:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 4664.608256] ? do_futex+0x162/0x1f0 Aug 22 06:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 4664.608916] ? __x64_sys_futex+0x78/0x1e0 Aug 22 06:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 4664.609593] ? __secure_computing+0xa9/0x120 Aug 22 06:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 4664.610278] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 06:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 4664.611037] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 4664.611755] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 4664.612469] ? do_syscall_64+0x69/0xc0 Aug 22 06:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 4664.613131] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 4664.613831] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 4664.614527] ? do_syscall_64+0x69/0xc0 Aug 22 06:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 4664.615149] ? do_syscall_64+0x69/0xc0 Aug 22 06:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 4664.615770] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 06:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 4664.616477] RIP: 0033:0x7faa5d0edaff Aug 22 06:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 4664.617118] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 06:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 4664.619099] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 06:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 4664.620011] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 06:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 4664.620908] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 06:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 4664.621799] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 06:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 4664.622688] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 06:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 4664.623578] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 06:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 4664.624472] Aug 22 06:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 4677.500706] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 06:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 4677.501681] rcu: 1-....: (1136515 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=553682 Aug 22 06:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 4677.502823] (t=1140075 jiffies g=23269 q=13663) Aug 22 06:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 4677.503673] NMI backtrace for cpu 1 Aug 22 06:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 4677.504416] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 06:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 4677.505748] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 06:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 4677.506827] Call Trace: Aug 22 06:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 4677.507547] Aug 22 06:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 4677.508211] show_stack+0x52/0x5c Aug 22 06:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 4677.508975] dump_stack_lvl+0x4a/0x63 Aug 22 06:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 4677.509740] dump_stack+0x10/0x16 Aug 22 06:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 4677.510516] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 06:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 4677.511319] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 06:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 4677.512171] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 06:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 4677.513024] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 06:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 4677.513854] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 06:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 4677.514686] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 06:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 4677.515458] print_cpu_stall.cold+0x2f/0xe2 Aug 22 06:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 4677.516227] ? timekeeping_update+0xf7/0x150 Aug 22 06:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 4677.517012] check_cpu_stall+0x109/0x270 Aug 22 06:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 4677.517757] rcu_sched_clock_irq+0x9a/0x250 Aug 22 06:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 4677.518517] update_process_times+0x94/0xd0 Aug 22 06:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 4677.519279] tick_sched_handle+0x29/0x70 Aug 22 06:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 4677.520022] tick_sched_timer+0x8c/0xc0 Aug 22 06:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 4677.520777] ? tick_nohz_handler+0xb0/0xb0 Aug 22 06:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 4677.521548] __hrtimer_run_queues+0x107/0x230 Aug 22 06:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 4677.522424] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 06:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 4677.523258] hrtimer_interrupt+0x101/0x220 Aug 22 06:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 4677.524033] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 06:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 4677.524874] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 06:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 4677.525687] Aug 22 06:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 4677.526344] Aug 22 06:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 4677.527046] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 06:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 4677.527896] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 4677.528886] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 06:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 4677.531308] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 06:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 4677.532257] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 06:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 4677.533306] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 06:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 4677.534316] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 06:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 4677.535308] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 06:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 4677.536288] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 06:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 4677.537265] ? _raw_spin_lock+0x22/0x30 Aug 22 06:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 4677.538050] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 4677.538914] direct_page_fault+0x206/0x310 [kvm] Aug 22 06:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 4677.539778] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 06:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 4677.540654] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 06:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 4677.541535] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 06:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 4677.542382] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 06:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 4677.543181] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 06:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 4677.544032] handle_exit+0x98/0x230 [kvm_amd] Aug 22 06:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 4677.544825] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 06:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 4677.545627] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 06:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 4677.546462] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 06:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 4677.547250] vcpu_run+0x62/0x2c0 [kvm] Aug 22 06:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 4677.547968] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 06:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 4677.548723] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 06:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 4677.549531] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 06:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 4677.550293] ? __seccomp_filter+0x4a/0x4a0 Aug 22 06:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 4677.551014] ? __fget_files+0x86/0xc0 Aug 22 06:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 4677.551711] __x64_sys_ioctl+0x95/0xd0 Aug 22 06:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 4677.552404] do_syscall_64+0x5c/0xc0 Aug 22 06:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 4677.553106] ? do_futex+0x162/0x1f0 Aug 22 06:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 4677.553780] ? __x64_sys_futex+0x78/0x1e0 Aug 22 06:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 4677.554500] ? __secure_computing+0xa9/0x120 Aug 22 06:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 4677.555219] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 06:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 4677.556009] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 4677.556825] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 4677.557671] ? do_syscall_64+0x69/0xc0 Aug 22 06:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 4677.558383] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 4677.559148] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 4677.559921] ? do_syscall_64+0x69/0xc0 Aug 22 06:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 4677.560652] ? do_syscall_64+0x69/0xc0 Aug 22 06:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 4677.561424] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 06:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 4677.562200] RIP: 0033:0x7faa5d0edaff Aug 22 06:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 4677.562898] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 06:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 4677.565017] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 06:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 4677.565978] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 06:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 4677.566921] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 06:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 4677.567865] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 06:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 4677.568824] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 06:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 4677.569750] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 06:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 4677.570696] Aug 22 06:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 4704.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 4273s! [qemu-system-x86:6715] Aug 22 06:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 4704.543138] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 06:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 4704.543208] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 06:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 4704.555271] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 06:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 4704.556547] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 06:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 4704.557768] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 4704.558821] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 06:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 4704.561376] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 06:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 4704.562422] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 06:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 4704.563584] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 06:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 4704.564749] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 06:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 4704.565907] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 06:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 4704.567067] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 06:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 4704.568239] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 06:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 4704.569471] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 06:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 4704.570566] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 06:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 4704.571757] Call Trace: Aug 22 06:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 4704.572676] Aug 22 06:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 4704.573560] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 4704.574589] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 4704.575609] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 4704.576691] ? show_regs.part.0+0x23/0x29 Aug 22 06:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 4704.577692] ? show_regs.cold+0x8/0xd Aug 22 06:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 4704.578665] ? watchdog_timer_fn+0x1be/0x220 Aug 22 06:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 4704.579672] ? lockup_detector_update_enable+0x60/0x60 Aug 22 06:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 4704.580742] ? __hrtimer_run_queues+0x107/0x230 Aug 22 06:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 4704.581770] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 06:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 4704.582792] ? hrtimer_interrupt+0x101/0x220 Aug 22 06:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 4704.583805] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 06:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 4704.584877] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 06:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 4704.585921] Aug 22 06:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 4704.586774] Aug 22 06:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 4704.587612] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 06:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 4704.588651] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 4704.589690] ? _raw_spin_lock+0x22/0x30 Aug 22 06:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 4704.590637] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 4704.591659] direct_page_fault+0x206/0x310 [kvm] Aug 22 06:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 4704.592693] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 06:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 4704.593706] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 06:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 4704.594710] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 06:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 4704.595684] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 06:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 4704.596646] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 06:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 4704.597630] handle_exit+0x98/0x230 [kvm_amd] Aug 22 06:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 4704.598526] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 06:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 4704.599443] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 06:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 4704.600375] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 06:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 4704.601279] vcpu_run+0x62/0x2c0 [kvm] Aug 22 06:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 4704.602090] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 06:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 4704.602895] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 06:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 4704.603749] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 06:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 4704.604554] ? __seccomp_filter+0x4a/0x4a0 Aug 22 06:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 4704.605298] ? __fget_files+0x86/0xc0 Aug 22 06:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 4704.606001] __x64_sys_ioctl+0x95/0xd0 Aug 22 06:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 4704.606697] do_syscall_64+0x5c/0xc0 Aug 22 06:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 4704.607367] ? do_futex+0x162/0x1f0 Aug 22 06:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 4704.608117] ? __x64_sys_futex+0x78/0x1e0 Aug 22 06:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 4704.608906] ? __secure_computing+0xa9/0x120 Aug 22 06:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 4704.609694] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 06:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 4704.610560] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 4704.611381] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 4704.612207] ? do_syscall_64+0x69/0xc0 Aug 22 06:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 4704.612946] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 4704.613741] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 4704.614526] ? do_syscall_64+0x69/0xc0 Aug 22 06:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 4704.615226] ? do_syscall_64+0x69/0xc0 Aug 22 06:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 4704.615937] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 06:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 4704.616748] RIP: 0033:0x7faa5d0edaff Aug 22 06:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 4704.617443] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 06:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 4704.619760] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 06:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 4704.620817] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 06:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 4704.621842] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 06:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 4704.622859] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 06:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 4704.623878] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 06:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 4704.624920] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 06:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 4704.625965] Aug 22 06:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 4732.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 4299s! [qemu-system-x86:6715] Aug 22 06:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 4732.543769] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 06:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 4732.544042] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 06:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 4732.556215] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 06:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 4732.557514] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 06:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 4732.558760] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 4732.559818] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 06:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 4732.562405] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 06:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 4732.563464] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 06:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 4732.564657] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 06:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 4732.565827] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 06:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 4732.566989] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 06:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 4732.568194] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 06:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 4732.569390] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 06:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 4732.570625] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 06:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 4732.571729] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 06:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 4732.573153] Call Trace: Aug 22 06:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 4732.574077] Aug 22 06:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 4732.574978] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 4732.576038] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 4732.577087] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 4732.578218] ? show_regs.part.0+0x23/0x29 Aug 22 06:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 4732.579268] ? show_regs.cold+0x8/0xd Aug 22 06:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 4732.580261] ? watchdog_timer_fn+0x1be/0x220 Aug 22 06:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 4732.581277] ? lockup_detector_update_enable+0x60/0x60 Aug 22 06:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 4732.582343] ? __hrtimer_run_queues+0x107/0x230 Aug 22 06:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 4732.583412] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 06:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 4732.584469] ? hrtimer_interrupt+0x101/0x220 Aug 22 06:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 4732.585493] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 06:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 4732.586568] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 06:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 4732.587615] Aug 22 06:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 4732.588501] Aug 22 06:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 4732.589368] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 06:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 4732.590417] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 4732.591459] ? _raw_spin_lock+0x22/0x30 Aug 22 06:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 4732.592426] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 4732.593470] direct_page_fault+0x206/0x310 [kvm] Aug 22 06:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 4732.594513] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 06:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 4732.595541] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 06:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 4732.596572] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 06:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 4732.597572] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 06:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 4732.598527] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 06:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 4732.599547] handle_exit+0x98/0x230 [kvm_amd] Aug 22 06:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 4732.600473] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 06:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 4732.601399] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 06:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 4732.602334] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 06:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 4732.603264] vcpu_run+0x62/0x2c0 [kvm] Aug 22 06:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 4732.604099] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 06:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 4732.604928] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 06:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 4732.605794] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 06:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 4732.606597] ? __seccomp_filter+0x4a/0x4a0 Aug 22 06:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 4732.607349] ? __fget_files+0x86/0xc0 Aug 22 06:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 4732.608070] __x64_sys_ioctl+0x95/0xd0 Aug 22 06:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 4732.608783] do_syscall_64+0x5c/0xc0 Aug 22 06:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 4732.609474] ? do_futex+0x162/0x1f0 Aug 22 06:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 4732.610130] ? __x64_sys_futex+0x78/0x1e0 Aug 22 06:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 4732.610816] ? __secure_computing+0xa9/0x120 Aug 22 06:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 4732.611508] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 06:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 4732.612292] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 4732.613039] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 4732.613776] ? do_syscall_64+0x69/0xc0 Aug 22 06:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 4732.614427] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 4732.615143] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 4732.615866] ? do_syscall_64+0x69/0xc0 Aug 22 06:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 4732.616493] ? do_syscall_64+0x69/0xc0 Aug 22 06:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 4732.617124] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 06:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 4732.617831] RIP: 0033:0x7faa5d0edaff Aug 22 06:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 4732.618473] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 06:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 4732.620520] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 06:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 4732.621444] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 06:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 4732.622343] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 06:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 4732.623235] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 06:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 4732.624147] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 06:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 4732.625052] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 06:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 4732.625951] Aug 22 06:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 4760.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 4325s! [qemu-system-x86:6715] Aug 22 06:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 4760.543045] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 06:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 4760.543114] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 06:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 4760.554770] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 06:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 4760.556035] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 06:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 4760.557238] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 4760.558279] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 06:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 4760.560754] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 06:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 4760.561772] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 06:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 4760.562901] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 06:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 4760.564049] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 06:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 4760.565180] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 06:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 4760.566319] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 06:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 4760.567464] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 06:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 4760.568675] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 06:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 4760.569748] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 06:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 4760.570925] Call Trace: Aug 22 06:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 4760.571842] Aug 22 06:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 4760.572719] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 4760.573740] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 4760.574744] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 4760.575812] ? show_regs.part.0+0x23/0x29 Aug 22 06:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 4760.576791] ? show_regs.cold+0x8/0xd Aug 22 06:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 4760.577747] ? watchdog_timer_fn+0x1be/0x220 Aug 22 06:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 4760.578741] ? lockup_detector_update_enable+0x60/0x60 Aug 22 06:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 4760.579789] ? __hrtimer_run_queues+0x107/0x230 Aug 22 06:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 4760.580801] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 06:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 4760.581814] ? hrtimer_interrupt+0x101/0x220 Aug 22 06:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 4760.582818] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 06:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 4760.583875] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 06:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 4760.584902] Aug 22 06:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 4760.585743] Aug 22 06:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 4760.586573] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 06:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 4760.587611] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 4760.588631] ? _raw_spin_lock+0x22/0x30 Aug 22 06:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 4760.589562] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 4760.590560] direct_page_fault+0x206/0x310 [kvm] Aug 22 06:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 4760.591595] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 06:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 4760.592601] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 06:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 4760.593581] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 06:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 4760.594530] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 06:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 4760.595453] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 06:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 4760.596424] handle_exit+0x98/0x230 [kvm_amd] Aug 22 06:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 4760.597299] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 06:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 4760.598193] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 06:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 4760.599098] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 06:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 4760.600009] vcpu_run+0x62/0x2c0 [kvm] Aug 22 06:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 4760.600803] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 06:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 4760.601590] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 06:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 4760.602425] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 06:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 4760.603205] ? __seccomp_filter+0x4a/0x4a0 Aug 22 06:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 4760.603937] ? __fget_files+0x86/0xc0 Aug 22 06:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 4760.604624] __x64_sys_ioctl+0x95/0xd0 Aug 22 06:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 4760.605299] do_syscall_64+0x5c/0xc0 Aug 22 06:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 4760.605953] ? do_futex+0x162/0x1f0 Aug 22 06:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 4760.606585] ? __x64_sys_futex+0x78/0x1e0 Aug 22 06:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 4760.607239] ? __secure_computing+0xa9/0x120 Aug 22 06:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 4760.607923] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 06:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 4760.608660] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 4760.609366] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 4760.610060] ? do_syscall_64+0x69/0xc0 Aug 22 06:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 4760.610685] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 4760.611368] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 4760.612050] ? do_syscall_64+0x69/0xc0 Aug 22 06:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 4760.612654] ? do_syscall_64+0x69/0xc0 Aug 22 06:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 4760.613258] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 06:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 4760.613938] RIP: 0033:0x7faa5d0edaff Aug 22 06:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 4760.614548] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 06:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 4760.616514] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 06:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 4760.617633] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 06:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 4760.618546] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 06:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 4760.619413] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 06:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 4760.620332] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 06:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 4760.621342] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 06:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 4760.622212] Aug 22 06:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 4788.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 4351s! [qemu-system-x86:6715] Aug 22 06:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 4788.543102] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 06:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 4788.543169] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 06:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 4788.555374] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 06:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 4788.556638] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 06:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 4788.557963] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 4788.559020] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 06:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 4788.561572] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 06:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 4788.562618] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 06:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 4788.563790] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 06:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 4788.564956] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 06:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 4788.566113] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 06:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 4788.567290] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 06:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 4788.568456] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 06:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 4788.569689] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 06:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 4788.570800] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 06:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 4788.572025] Call Trace: Aug 22 06:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 4788.572936] Aug 22 06:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 4788.573822] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 4788.574855] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 4788.575891] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 4788.576967] ? show_regs.part.0+0x23/0x29 Aug 22 06:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 4788.577966] ? show_regs.cold+0x8/0xd Aug 22 06:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 4788.578933] ? watchdog_timer_fn+0x1be/0x220 Aug 22 06:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 4788.579964] ? lockup_detector_update_enable+0x60/0x60 Aug 22 06:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 4788.581022] ? __hrtimer_run_queues+0x107/0x230 Aug 22 06:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 4788.582063] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 06:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 4788.583089] ? hrtimer_interrupt+0x101/0x220 Aug 22 06:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 4788.584122] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 06:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 4788.585192] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 06:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 4788.586240] Aug 22 06:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 4788.587099] Aug 22 06:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 4788.587953] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 06:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 4788.588982] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 4788.590025] ? _raw_spin_lock+0x22/0x30 Aug 22 06:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 4788.590970] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 4788.592001] direct_page_fault+0x206/0x310 [kvm] Aug 22 06:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 4788.593022] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 06:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 4788.594028] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 06:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 4788.595025] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 06:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 4788.596007] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 06:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 4788.596949] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 06:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 4788.597925] handle_exit+0x98/0x230 [kvm_amd] Aug 22 06:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 4788.598823] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 06:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 4788.599752] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 06:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 4788.600678] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 06:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 4788.601581] vcpu_run+0x62/0x2c0 [kvm] Aug 22 06:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 4788.602392] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 06:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 4788.603215] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 06:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 4788.604071] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 06:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 4788.604868] ? __seccomp_filter+0x4a/0x4a0 Aug 22 06:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 4788.605614] ? __fget_files+0x86/0xc0 Aug 22 06:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 4788.606317] __x64_sys_ioctl+0x95/0xd0 Aug 22 06:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 4788.607008] do_syscall_64+0x5c/0xc0 Aug 22 06:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 4788.607685] ? do_futex+0x162/0x1f0 Aug 22 06:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 4788.608338] ? __x64_sys_futex+0x78/0x1e0 Aug 22 06:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 4788.609010] ? __secure_computing+0xa9/0x120 Aug 22 06:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 4788.609702] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 06:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 4788.610460] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 4788.611198] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 4788.611918] ? do_syscall_64+0x69/0xc0 Aug 22 06:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 4788.612562] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 4788.613269] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 4788.613964] ? do_syscall_64+0x69/0xc0 Aug 22 06:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 4788.614594] ? do_syscall_64+0x69/0xc0 Aug 22 06:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 4788.615233] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 06:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 4788.615967] RIP: 0033:0x7faa5d0edaff Aug 22 06:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 4788.616593] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 06:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 4788.618578] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 06:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 4788.619504] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 06:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 4788.620399] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 06:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 4788.621289] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 06:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 4788.622175] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 06:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 4788.623063] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 06:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 4788.623974] Aug 22 06:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 4816.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 4377s! [qemu-system-x86:6715] Aug 22 06:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 4816.543160] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 06:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 4816.543386] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 06:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 4816.555547] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 06:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 4816.556827] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 06:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 4816.558043] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 4816.559247] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 06:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 4816.562117] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 06:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 4816.563270] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 06:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 4816.564578] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 06:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 4816.565879] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 06:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 4816.567180] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 06:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 4816.568477] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 06:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 4816.569661] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 06:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 4816.570899] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 06:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 4816.571993] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 06:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 4816.573179] Call Trace: Aug 22 06:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 4816.574088] Aug 22 06:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 4816.574988] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 4816.576014] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 4816.577035] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 4816.578125] ? show_regs.part.0+0x23/0x29 Aug 22 06:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 4816.579133] ? show_regs.cold+0x8/0xd Aug 22 06:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 4816.580101] ? watchdog_timer_fn+0x1be/0x220 Aug 22 06:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 4816.581118] ? lockup_detector_update_enable+0x60/0x60 Aug 22 06:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 4816.582187] ? __hrtimer_run_queues+0x107/0x230 Aug 22 06:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 4816.583251] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 06:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 4816.584275] ? hrtimer_interrupt+0x101/0x220 Aug 22 06:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 4816.585309] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 06:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 4816.586386] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 06:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 4816.587445] Aug 22 06:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 4816.588298] Aug 22 06:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 4816.589142] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 06:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 4816.590172] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 4816.591234] ? _raw_spin_lock+0x22/0x30 Aug 22 06:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 4816.592177] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 4816.593195] direct_page_fault+0x206/0x310 [kvm] Aug 22 06:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 4816.594216] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 06:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 4816.595238] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 06:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 4816.596236] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 06:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 4816.597230] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 06:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 4816.598180] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 06:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 4816.599177] handle_exit+0x98/0x230 [kvm_amd] Aug 22 06:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 4816.600125] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 06:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 4816.601178] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 06:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 4816.602121] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 06:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 4816.603059] vcpu_run+0x62/0x2c0 [kvm] Aug 22 06:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 4816.603874] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 06:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 4816.604678] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 06:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 4816.605528] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 06:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 4816.606325] ? __seccomp_filter+0x4a/0x4a0 Aug 22 06:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 4816.607077] ? __fget_files+0x86/0xc0 Aug 22 06:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 4816.607783] __x64_sys_ioctl+0x95/0xd0 Aug 22 06:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 4816.608478] do_syscall_64+0x5c/0xc0 Aug 22 06:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 4816.609143] ? do_futex+0x162/0x1f0 Aug 22 06:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 4816.609793] ? __x64_sys_futex+0x78/0x1e0 Aug 22 06:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 4816.610463] ? __secure_computing+0xa9/0x120 Aug 22 06:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 4816.611170] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 06:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 4816.611931] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 4816.612679] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 4816.613410] ? do_syscall_64+0x69/0xc0 Aug 22 06:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 4816.614056] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 4816.614773] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 4816.615498] ? do_syscall_64+0x69/0xc0 Aug 22 06:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 4816.616121] ? do_syscall_64+0x69/0xc0 Aug 22 06:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 4816.616746] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 06:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 4816.617449] RIP: 0033:0x7faa5d0edaff Aug 22 06:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 4816.618103] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 06:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 4816.620106] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 06:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 4816.621020] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 06:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 4816.621909] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 06:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 4816.622801] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 06:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 4816.623702] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 06:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 4816.624589] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 06:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 4816.625483] Aug 22 06:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 4844.541980] watchdog: BUG: soft lockup - CPU#1 stuck for 4403s! [qemu-system-x86:6715] Aug 22 06:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 4844.543689] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 06:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 4844.543843] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 06:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 4844.556050] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 06:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 4844.557312] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 06:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 4844.558570] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 4844.559633] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 06:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 4844.562235] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 06:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 4844.563298] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 06:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 4844.564488] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 06:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 4844.565727] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 06:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 4844.566925] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 06:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 4844.568086] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 06:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 4844.569288] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 06:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 4844.570545] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 06:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 4844.571641] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 06:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 4844.572862] Call Trace: Aug 22 06:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 4844.573777] Aug 22 06:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 4844.574683] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 4844.575722] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 4844.576773] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 4844.577867] ? show_regs.part.0+0x23/0x29 Aug 22 06:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 4844.578882] ? show_regs.cold+0x8/0xd Aug 22 06:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 4844.579858] ? watchdog_timer_fn+0x1be/0x220 Aug 22 06:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 4844.580869] ? lockup_detector_update_enable+0x60/0x60 Aug 22 06:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 4844.581935] ? __hrtimer_run_queues+0x107/0x230 Aug 22 06:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 4844.583010] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 06:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 4844.584049] ? hrtimer_interrupt+0x101/0x220 Aug 22 06:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 4844.585087] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 06:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 4844.586169] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 06:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 4844.587240] Aug 22 06:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 4844.588092] Aug 22 06:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 4844.588929] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 06:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 4844.589962] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 4844.591017] ? _raw_spin_lock+0x22/0x30 Aug 22 06:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 4844.591967] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 4844.592984] direct_page_fault+0x206/0x310 [kvm] Aug 22 06:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 4844.594007] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 06:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 4844.595120] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 06:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 4844.596134] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 06:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 4844.597120] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 06:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 4844.598069] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 06:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 4844.599118] handle_exit+0x98/0x230 [kvm_amd] Aug 22 06:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 4844.600019] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 06:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 4844.600934] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 06:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 4844.601860] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 06:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 4844.602787] vcpu_run+0x62/0x2c0 [kvm] Aug 22 06:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 4844.603597] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 06:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 4844.604403] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 06:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 4844.605258] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 06:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 4844.606102] ? __seccomp_filter+0x4a/0x4a0 Aug 22 06:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 4844.606865] ? __fget_files+0x86/0xc0 Aug 22 06:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 4844.607569] __x64_sys_ioctl+0x95/0xd0 Aug 22 06:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 4844.608417] do_syscall_64+0x5c/0xc0 Aug 22 06:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 4844.609093] ? do_futex+0x162/0x1f0 Aug 22 06:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 4844.609787] ? __x64_sys_futex+0x78/0x1e0 Aug 22 06:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 4844.610544] ? __secure_computing+0xa9/0x120 Aug 22 06:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 4844.611249] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 06:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 4844.612013] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 4844.612737] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 4844.613455] ? do_syscall_64+0x69/0xc0 Aug 22 06:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 4844.614101] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 4844.614818] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 4844.615515] ? do_syscall_64+0x69/0xc0 Aug 22 06:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 4844.616147] ? do_syscall_64+0x69/0xc0 Aug 22 06:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 4844.616779] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 06:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 4844.617485] RIP: 0033:0x7faa5d0edaff Aug 22 06:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 4844.618128] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 06:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 4844.620142] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 06:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 4844.621064] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 06:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 4844.621957] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 06:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 4844.622891] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 06:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 4844.623780] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 06:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 4844.624693] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 06:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 4844.625659] Aug 22 06:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 4857.512706] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 06:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 4857.513713] rcu: 1-....: (1181384 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=575638 Aug 22 06:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 4857.514855] (t=1185078 jiffies g=23269 q=13809) Aug 22 06:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 4857.515655] NMI backtrace for cpu 1 Aug 22 06:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 4857.516366] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 06:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 4857.517461] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 06:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 4857.518561] Call Trace: Aug 22 06:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 4857.519248] Aug 22 06:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 4857.519903] show_stack+0x52/0x5c Aug 22 06:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 4857.520650] dump_stack_lvl+0x4a/0x63 Aug 22 06:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 4857.521407] dump_stack+0x10/0x16 Aug 22 06:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 4857.522132] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 06:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 4857.522968] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 06:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 4857.523768] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 06:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 4857.524631] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 06:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 4857.525463] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 06:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 4857.526282] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 06:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 4857.527073] print_cpu_stall.cold+0x2f/0xe2 Aug 22 06:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 4857.527837] ? timekeeping_update+0xf7/0x150 Aug 22 06:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 4857.528631] check_cpu_stall+0x109/0x270 Aug 22 06:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 4857.529518] rcu_sched_clock_irq+0x9a/0x250 Aug 22 06:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 4857.530396] update_process_times+0x94/0xd0 Aug 22 06:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 4857.531240] tick_sched_handle+0x29/0x70 Aug 22 06:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 4857.532060] tick_sched_timer+0x8c/0xc0 Aug 22 06:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 4857.532870] ? tick_nohz_handler+0xb0/0xb0 Aug 22 06:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 4857.533708] __hrtimer_run_queues+0x107/0x230 Aug 22 06:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 4857.534621] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 06:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 4857.535491] hrtimer_interrupt+0x101/0x220 Aug 22 06:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 4857.536329] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 06:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 4857.537243] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 06:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 4857.538134] Aug 22 06:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 4857.538830] Aug 22 06:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 4857.539508] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 06:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 4857.540423] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 4857.541409] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 06:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 4857.543954] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 06:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 4857.544922] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 06:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 4857.546044] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 06:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 4857.547172] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 06:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 4857.548265] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 06:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 4857.549351] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 06:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 4857.550459] ? _raw_spin_lock+0x22/0x30 Aug 22 06:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 4857.551295] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 4857.552218] direct_page_fault+0x206/0x310 [kvm] Aug 22 06:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 4857.553150] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 06:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 4857.554082] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 06:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 4857.555032] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 06:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 4857.555929] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 06:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 4857.556800] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 06:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 4857.557721] handle_exit+0x98/0x230 [kvm_amd] Aug 22 06:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 4857.558589] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 06:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 4857.559465] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 06:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 4857.560359] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 06:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 4857.561241] vcpu_run+0x62/0x2c0 [kvm] Aug 22 06:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 4857.562035] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 06:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 4857.562874] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 06:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 4857.563777] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 06:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 4857.564627] ? __seccomp_filter+0x4a/0x4a0 Aug 22 06:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 4857.565433] ? __fget_files+0x86/0xc0 Aug 22 06:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 4857.566206] __x64_sys_ioctl+0x95/0xd0 Aug 22 06:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 4857.566998] do_syscall_64+0x5c/0xc0 Aug 22 06:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 4857.567752] ? do_futex+0x162/0x1f0 Aug 22 06:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 4857.568499] ? __x64_sys_futex+0x78/0x1e0 Aug 22 06:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 4857.569289] ? __secure_computing+0xa9/0x120 Aug 22 06:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 4857.570100] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 06:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 4857.571010] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 4857.571856] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 4857.572701] ? do_syscall_64+0x69/0xc0 Aug 22 06:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 4857.573473] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 4857.574326] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 4857.575206] ? do_syscall_64+0x69/0xc0 Aug 22 06:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 4857.575976] ? do_syscall_64+0x69/0xc0 Aug 22 06:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 4857.576741] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 06:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 4857.577610] RIP: 0033:0x7faa5d0edaff Aug 22 06:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 4857.578383] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 06:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 4857.580820] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 06:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 4857.581957] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 06:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 4857.583062] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 06:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 4857.584154] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 06:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 4857.585245] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 06:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 4857.586306] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 06:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 4857.587264] Aug 22 06:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 4884.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 4441s! [qemu-system-x86:6715] Aug 22 06:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 4884.543145] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 06:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 4884.543219] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 06:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 4884.555282] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 06:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 4884.556550] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 06:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 4884.557771] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 4884.558837] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 06:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 4884.561388] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 06:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 4884.562449] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 06:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 4884.563607] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 06:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 4884.564767] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 06:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 4884.565925] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 06:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 4884.567091] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 06:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 4884.568265] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 06:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 4884.569519] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 06:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 4884.570624] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 06:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 4884.571821] Call Trace: Aug 22 06:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 4884.572738] Aug 22 06:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 4884.573626] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 4884.574674] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 4884.575693] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 4884.576772] ? show_regs.part.0+0x23/0x29 Aug 22 06:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 4884.577776] ? show_regs.cold+0x8/0xd Aug 22 06:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 4884.578779] ? watchdog_timer_fn+0x1be/0x220 Aug 22 06:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 4884.579789] ? lockup_detector_update_enable+0x60/0x60 Aug 22 06:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 4884.580854] ? __hrtimer_run_queues+0x107/0x230 Aug 22 06:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 4884.581895] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 06:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 4884.582952] ? hrtimer_interrupt+0x101/0x220 Aug 22 06:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 4884.583969] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 06:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 4884.585035] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 06:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 4884.586093] Aug 22 06:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 4884.586949] Aug 22 06:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 4884.587785] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 06:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 4884.588822] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 4884.589874] ? _raw_spin_lock+0x22/0x30 Aug 22 06:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 4884.590838] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 4884.591852] direct_page_fault+0x206/0x310 [kvm] Aug 22 06:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 4884.592891] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 06:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 4884.593901] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 06:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 4884.594908] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 06:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 4884.595882] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 06:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 4884.596829] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 06:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 4884.597809] handle_exit+0x98/0x230 [kvm_amd] Aug 22 06:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 4884.598709] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 06:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 4884.599624] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 06:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 4884.600544] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 06:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 4884.601476] vcpu_run+0x62/0x2c0 [kvm] Aug 22 06:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 4884.602298] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 06:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 4884.603103] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 06:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 4884.603955] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 06:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 4884.604751] ? __seccomp_filter+0x4a/0x4a0 Aug 22 06:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 4884.605511] ? __fget_files+0x86/0xc0 Aug 22 06:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 4884.606237] __x64_sys_ioctl+0x95/0xd0 Aug 22 06:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 4884.606928] do_syscall_64+0x5c/0xc0 Aug 22 06:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 4884.607588] ? do_futex+0x162/0x1f0 Aug 22 06:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 4884.608239] ? __x64_sys_futex+0x78/0x1e0 Aug 22 06:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 4884.608908] ? __secure_computing+0xa9/0x120 Aug 22 06:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 4884.609595] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 06:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 4884.610365] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 4884.611084] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 4884.611801] ? do_syscall_64+0x69/0xc0 Aug 22 06:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 4884.612442] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 4884.613142] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 4884.613831] ? do_syscall_64+0x69/0xc0 Aug 22 06:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 4884.614463] ? do_syscall_64+0x69/0xc0 Aug 22 06:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 4884.615082] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 06:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 4884.615788] RIP: 0033:0x7faa5d0edaff Aug 22 06:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 4884.616424] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 06:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 4884.618409] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 06:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 4884.619321] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 06:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 4884.620362] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 06:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 4884.621251] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 06:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 4884.622176] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 06:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 4884.623061] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 06:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 4884.623948] Aug 22 06:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 4912.541980] watchdog: BUG: soft lockup - CPU#1 stuck for 4467s! [qemu-system-x86:6715] Aug 22 06:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 4912.543800] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 06:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 4912.544072] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 06:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 4912.556241] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 06:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 4912.557522] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 06:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 4912.558766] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 4912.559828] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 06:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 4912.562394] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 06:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 4912.563437] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 06:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 4912.564603] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 06:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 4912.565770] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 06:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 4912.566937] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 06:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 4912.568098] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 06:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 4912.569266] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 06:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 4912.570517] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 06:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 4912.571623] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 06:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 4912.572823] Call Trace: Aug 22 06:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 4912.573751] Aug 22 06:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 4912.574664] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 4912.575697] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 4912.576723] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 4912.577829] ? show_regs.part.0+0x23/0x29 Aug 22 06:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 4912.578830] ? show_regs.cold+0x8/0xd Aug 22 06:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 4912.579816] ? watchdog_timer_fn+0x1be/0x220 Aug 22 06:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 4912.580831] ? lockup_detector_update_enable+0x60/0x60 Aug 22 06:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 4912.581918] ? __hrtimer_run_queues+0x107/0x230 Aug 22 06:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 4912.582950] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 06:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 4912.583975] ? hrtimer_interrupt+0x101/0x220 Aug 22 06:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 4912.584991] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 06:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 4912.586079] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 06:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 4912.587131] Aug 22 06:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 4912.587990] Aug 22 06:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 4912.588833] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 06:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 4912.589881] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 4912.590923] ? _raw_spin_lock+0x22/0x30 Aug 22 06:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 4912.592019] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 4912.593040] direct_page_fault+0x206/0x310 [kvm] Aug 22 06:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 4912.594084] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 06:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 4912.595102] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 06:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 4912.596106] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 06:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 4912.597120] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 06:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 4912.598086] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 06:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 4912.599065] handle_exit+0x98/0x230 [kvm_amd] Aug 22 06:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 4912.599959] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 06:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 4912.600880] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 06:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 4912.601830] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 06:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 4912.602738] vcpu_run+0x62/0x2c0 [kvm] Aug 22 06:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 4912.603552] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 06:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 4912.604364] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 06:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 4912.605221] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 06:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 4912.606036] ? __seccomp_filter+0x4a/0x4a0 Aug 22 06:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 4912.606921] ? __fget_files+0x86/0xc0 Aug 22 06:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 4912.607630] __x64_sys_ioctl+0x95/0xd0 Aug 22 06:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 4912.608324] do_syscall_64+0x5c/0xc0 Aug 22 06:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 4912.608996] ? do_futex+0x162/0x1f0 Aug 22 06:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 4912.609652] ? __x64_sys_futex+0x78/0x1e0 Aug 22 06:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 4912.610342] ? __secure_computing+0xa9/0x120 Aug 22 06:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 4912.611037] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 06:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 4912.611804] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 4912.612531] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 4912.613257] ? do_syscall_64+0x69/0xc0 Aug 22 06:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 4912.613916] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 4912.614623] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 4912.615318] ? do_syscall_64+0x69/0xc0 Aug 22 06:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 4912.615951] ? do_syscall_64+0x69/0xc0 Aug 22 06:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 4912.616581] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 06:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 4912.617293] RIP: 0033:0x7faa5d0edaff Aug 22 06:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 4912.617970] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 06:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 4912.619962] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 06:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 4912.620887] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 06:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 4912.621803] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 06:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 4912.622704] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 06:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 4912.623604] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 06:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 4912.624492] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 06:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 4912.625386] Aug 22 06:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 4940.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 4493s! [qemu-system-x86:6715] Aug 22 06:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 4940.543095] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 06:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 4940.543167] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 06:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 4940.555255] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 06:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 4940.556529] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 06:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 4940.557768] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 4940.558828] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 06:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 4940.561436] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 06:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 4940.562481] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 06:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 4940.563644] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 06:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 4940.564811] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 06:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 4940.565988] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 06:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 4940.567151] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 06:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 4940.568319] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 06:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 4940.569600] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 06:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 4940.570718] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 06:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 4940.572007] Call Trace: Aug 22 06:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 4940.572918] Aug 22 06:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 4940.573824] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 4940.574863] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 4940.575881] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 4940.576962] ? show_regs.part.0+0x23/0x29 Aug 22 06:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 4940.577972] ? show_regs.cold+0x8/0xd Aug 22 06:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 4940.578943] ? watchdog_timer_fn+0x1be/0x220 Aug 22 06:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 4940.579953] ? lockup_detector_update_enable+0x60/0x60 Aug 22 06:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 4940.581017] ? __hrtimer_run_queues+0x107/0x230 Aug 22 06:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 4940.582066] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 06:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 4940.583101] ? hrtimer_interrupt+0x101/0x220 Aug 22 06:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 4940.584124] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 06:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 4940.585197] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 06:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 4940.586251] Aug 22 06:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 4940.587109] Aug 22 06:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 4940.587945] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 06:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 4940.588974] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 4940.590048] ? _raw_spin_lock+0x22/0x30 Aug 22 06:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 4940.591008] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 4940.592023] direct_page_fault+0x206/0x310 [kvm] Aug 22 06:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 4940.593054] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 06:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 4940.594077] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 06:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 4940.595077] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 06:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 4940.596046] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 06:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 4940.596995] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 06:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 4940.597984] handle_exit+0x98/0x230 [kvm_amd] Aug 22 06:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 4940.598875] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 06:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 4940.599791] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 06:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 4940.600727] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 06:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 4940.601644] vcpu_run+0x62/0x2c0 [kvm] Aug 22 06:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 4940.602453] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 06:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 4940.603262] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 06:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 4940.604118] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 06:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 4940.604914] ? __seccomp_filter+0x4a/0x4a0 Aug 22 06:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 4940.605663] ? __fget_files+0x86/0xc0 Aug 22 06:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 4940.606365] __x64_sys_ioctl+0x95/0xd0 Aug 22 06:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 4940.607055] do_syscall_64+0x5c/0xc0 Aug 22 06:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 4940.607717] ? do_futex+0x162/0x1f0 Aug 22 06:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 4940.608363] ? __x64_sys_futex+0x78/0x1e0 Aug 22 06:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 4940.609039] ? __secure_computing+0xa9/0x120 Aug 22 06:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 4940.609734] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 06:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 4940.610493] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 4940.611212] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 4940.611931] ? do_syscall_64+0x69/0xc0 Aug 22 06:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 4940.612589] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 4940.613293] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 4940.613992] ? do_syscall_64+0x69/0xc0 Aug 22 06:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 4940.614618] ? do_syscall_64+0x69/0xc0 Aug 22 06:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 4940.615238] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 06:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 4940.615940] RIP: 0033:0x7faa5d0edaff Aug 22 06:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 4940.616561] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 06:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 4940.618545] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 06:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 4940.619453] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 06:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 4940.620360] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 06:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 4940.621260] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 06:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 4940.622157] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 06:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 4940.623044] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 06:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 4940.623943] Aug 22 06:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 4968.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 4519s! [qemu-system-x86:6715] Aug 22 06:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 4968.543108] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 06:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 4968.543180] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 06:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 4968.555384] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 06:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 4968.556663] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 06:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 4968.557921] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 4968.559010] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 06:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 4968.561666] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 06:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 4968.562726] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 06:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 4968.563902] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 06:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 4968.565092] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 06:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 4968.566261] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 06:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 4968.567421] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 06:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 4968.568581] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 06:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 4968.569899] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 06:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 4968.571023] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 06:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 4968.572236] Call Trace: Aug 22 06:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 4968.573170] Aug 22 06:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 4968.574055] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 4968.575088] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 4968.576114] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 4968.577211] ? show_regs.part.0+0x23/0x29 Aug 22 06:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 4968.578217] ? show_regs.cold+0x8/0xd Aug 22 06:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 4968.579203] ? watchdog_timer_fn+0x1be/0x220 Aug 22 06:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 4968.580243] ? lockup_detector_update_enable+0x60/0x60 Aug 22 06:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 4968.581345] ? __hrtimer_run_queues+0x107/0x230 Aug 22 06:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 4968.582387] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 06:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 4968.583426] ? hrtimer_interrupt+0x101/0x220 Aug 22 06:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 4968.584453] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 06:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 4968.585552] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 06:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 4968.586610] Aug 22 06:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 4968.587467] Aug 22 06:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 4968.588308] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 06:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 4968.589365] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 4968.590612] ? _raw_spin_lock+0x22/0x30 Aug 22 06:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 4968.591579] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 4968.592607] direct_page_fault+0x206/0x310 [kvm] Aug 22 06:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 4968.593658] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 06:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 4968.594679] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 06:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 4968.595696] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 06:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 4968.596681] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 06:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 4968.597656] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 06:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 4968.598646] handle_exit+0x98/0x230 [kvm_amd] Aug 22 06:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 4968.599545] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 06:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 4968.600489] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 06:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 4968.601464] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 06:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 4968.602422] vcpu_run+0x62/0x2c0 [kvm] Aug 22 06:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 4968.603244] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 06:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 4968.604055] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 06:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 4968.604914] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 06:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 4968.605742] ? __seccomp_filter+0x4a/0x4a0 Aug 22 06:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 4968.606496] ? __fget_files+0x86/0xc0 Aug 22 06:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 4968.607205] __x64_sys_ioctl+0x95/0xd0 Aug 22 06:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 4968.607904] do_syscall_64+0x5c/0xc0 Aug 22 06:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 4968.608571] ? do_futex+0x162/0x1f0 Aug 22 06:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 4968.609235] ? __x64_sys_futex+0x78/0x1e0 Aug 22 06:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 4968.609916] ? __secure_computing+0xa9/0x120 Aug 22 06:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 4968.610645] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 06:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 4968.611433] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 4968.612173] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 4968.612905] ? do_syscall_64+0x69/0xc0 Aug 22 06:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 4968.613580] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 4968.614300] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 4968.615008] ? do_syscall_64+0x69/0xc0 Aug 22 06:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 4968.615647] ? do_syscall_64+0x69/0xc0 Aug 22 06:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 4968.616275] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 06:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 4968.616989] RIP: 0033:0x7faa5d0edaff Aug 22 06:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 4968.617632] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 06:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 4968.619648] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 06:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 4968.620601] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 06:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 4968.621570] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 06:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 4968.622473] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 06:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 4968.623380] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 06:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 4968.624282] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 06:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 4968.625205] Aug 22 06:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 4996.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 4545s! [qemu-system-x86:6715] Aug 22 06:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 4996.543114] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 06:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 4996.543183] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 06:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 4996.555276] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 06:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 4996.556637] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 06:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 4996.557878] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 4996.558937] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 06:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 4996.561507] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 06:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 4996.562549] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 06:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 4996.563719] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 06:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 4996.564893] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 06:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 4996.566052] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 06:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 4996.567219] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 06:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 4996.568389] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 06:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 4996.569636] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 06:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 4996.570739] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 06:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 4996.571931] Call Trace: Aug 22 06:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 4996.572854] Aug 22 06:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 4996.573740] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 4996.574769] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 4996.575881] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 4996.577062] ? show_regs.part.0+0x23/0x29 Aug 22 06:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 4996.578134] ? show_regs.cold+0x8/0xd Aug 22 06:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 4996.579179] ? watchdog_timer_fn+0x1be/0x220 Aug 22 06:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 4996.580265] ? lockup_detector_update_enable+0x60/0x60 Aug 22 06:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 4996.581472] ? __hrtimer_run_queues+0x107/0x230 Aug 22 06:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 4996.582603] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 06:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 4996.583712] ? hrtimer_interrupt+0x101/0x220 Aug 22 06:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 4996.584834] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 06:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 4996.586003] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 06:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 4996.587151] Aug 22 06:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 4996.588047] Aug 22 06:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 4996.588941] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 06:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 4996.590080] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 4996.591218] ? _raw_spin_lock+0x22/0x30 Aug 22 06:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 4996.592236] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 4996.593359] direct_page_fault+0x206/0x310 [kvm] Aug 22 06:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 4996.594477] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 06:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 4996.595569] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 06:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 4996.596654] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 06:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 4996.597732] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 06:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 4996.598768] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 06:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 4996.599848] handle_exit+0x98/0x230 [kvm_amd] Aug 22 06:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 4996.600846] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 06:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 4996.601847] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 06:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 4996.602868] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 06:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 4996.603871] vcpu_run+0x62/0x2c0 [kvm] Aug 22 06:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 4996.604768] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 06:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 4996.605661] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 06:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 4996.606621] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 06:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 4996.607505] ? __seccomp_filter+0x4a/0x4a0 Aug 22 06:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 4996.608325] ? __fget_files+0x86/0xc0 Aug 22 06:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 4996.609117] __x64_sys_ioctl+0x95/0xd0 Aug 22 06:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 4996.609887] do_syscall_64+0x5c/0xc0 Aug 22 06:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 4996.610620] ? do_futex+0x162/0x1f0 Aug 22 06:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 4996.611336] ? __x64_sys_futex+0x78/0x1e0 Aug 22 06:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 4996.612090] ? __secure_computing+0xa9/0x120 Aug 22 06:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 4996.612874] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 06:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 4996.613735] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 4996.614545] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 4996.615352] ? do_syscall_64+0x69/0xc0 Aug 22 06:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 4996.616071] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 4996.616878] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 4996.617673] ? do_syscall_64+0x69/0xc0 Aug 22 06:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 4996.618377] ? do_syscall_64+0x69/0xc0 Aug 22 06:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 4996.619074] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 06:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 4996.619876] RIP: 0033:0x7faa5d0edaff Aug 22 06:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 4996.620571] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 06:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 4996.622904] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 06:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 4996.623954] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 06:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 4996.624994] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 06:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 4996.626013] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 06:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 4996.627029] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 06:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 4996.628047] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 06:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 4996.629080] Aug 22 06:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 5024.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 4571s! [qemu-system-x86:6715] Aug 22 06:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 5024.543705] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 06:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 5024.543953] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 06:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 5024.558106] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 06:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 5024.559377] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 06:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 5024.560604] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 5024.561661] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 06:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 5024.564204] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 06:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 5024.565257] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 06:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 5024.566427] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 06:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 5024.567584] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 06:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 5024.568751] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 06:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 5024.569912] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 06:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 5024.571079] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 06:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 5024.572308] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 06:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 5024.573418] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 06:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 5024.574609] Call Trace: Aug 22 06:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 5024.575521] Aug 22 06:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 5024.576439] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 5024.577470] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 5024.578495] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 5024.579586] ? show_regs.part.0+0x23/0x29 Aug 22 06:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 5024.580594] ? show_regs.cold+0x8/0xd Aug 22 06:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 5024.581567] ? watchdog_timer_fn+0x1be/0x220 Aug 22 06:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 5024.582574] ? lockup_detector_update_enable+0x60/0x60 Aug 22 06:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 5024.583635] ? __hrtimer_run_queues+0x107/0x230 Aug 22 06:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 5024.584681] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 06:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 5024.585712] ? hrtimer_interrupt+0x101/0x220 Aug 22 06:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 5024.586724] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 06:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 5024.587789] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 06:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 5024.588844] Aug 22 06:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 5024.589696] Aug 22 06:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 5024.590530] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 06:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 5024.591565] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 5024.592618] ? _raw_spin_lock+0x22/0x30 Aug 22 06:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 5024.593562] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 5024.594579] direct_page_fault+0x206/0x310 [kvm] Aug 22 06:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 5024.595598] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 06:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 5024.596618] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 06:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 5024.597623] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 06:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 5024.598618] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 06:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 5024.599564] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 06:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 5024.600555] handle_exit+0x98/0x230 [kvm_amd] Aug 22 06:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 5024.601449] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 06:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 5024.602362] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 06:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 5024.603284] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 06:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 5024.604183] vcpu_run+0x62/0x2c0 [kvm] Aug 22 06:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 5024.604997] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 06:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 5024.605802] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 06:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 5024.606652] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 06:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 5024.607446] ? __seccomp_filter+0x4a/0x4a0 Aug 22 06:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 5024.608189] ? __fget_files+0x86/0xc0 Aug 22 06:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 5024.608904] __x64_sys_ioctl+0x95/0xd0 Aug 22 06:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 5024.609601] do_syscall_64+0x5c/0xc0 Aug 22 06:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 5024.610263] ? do_futex+0x162/0x1f0 Aug 22 06:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 5024.610910] ? __x64_sys_futex+0x78/0x1e0 Aug 22 06:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 5024.611583] ? __secure_computing+0xa9/0x120 Aug 22 06:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 5024.612273] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 06:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 5024.613051] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 5024.613771] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 5024.614487] ? do_syscall_64+0x69/0xc0 Aug 22 06:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 5024.615131] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 5024.615832] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 5024.616543] ? do_syscall_64+0x69/0xc0 Aug 22 06:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 5024.617174] ? do_syscall_64+0x69/0xc0 Aug 22 06:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 5024.617800] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 06:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 5024.618503] RIP: 0033:0x7faa5d0edaff Aug 22 06:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 5024.619151] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 06:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 5024.621146] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 06:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 5024.622062] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 06:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 5024.622960] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 06:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 5024.623845] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 06:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 5024.624742] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 06:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 5024.625634] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 06:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 5024.626522] Aug 22 06:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 5037.524707] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 06:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 5037.525667] rcu: 1-....: (1226251 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=597580 Aug 22 06:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 5037.526783] (t=1230081 jiffies g=23269 q=13939) Aug 22 06:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 5037.527563] NMI backtrace for cpu 1 Aug 22 06:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 5037.528286] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 06:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 5037.529391] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 06:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 5037.530460] Call Trace: Aug 22 06:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 5037.531151] Aug 22 06:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 5037.531811] show_stack+0x52/0x5c Aug 22 06:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 5037.532553] dump_stack_lvl+0x4a/0x63 Aug 22 06:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 5037.533302] dump_stack+0x10/0x16 Aug 22 06:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 5037.534029] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 06:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 5037.534817] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 06:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 5037.535600] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 06:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 5037.536435] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 06:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 5037.537252] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 06:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 5037.538055] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 06:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 5037.538821] print_cpu_stall.cold+0x2f/0xe2 Aug 22 06:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 5037.539581] ? timekeeping_update+0xf7/0x150 Aug 22 06:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 5037.540366] check_cpu_stall+0x109/0x270 Aug 22 06:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 5037.541131] rcu_sched_clock_irq+0x9a/0x250 Aug 22 06:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 5037.541894] update_process_times+0x94/0xd0 Aug 22 06:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 5037.542650] tick_sched_handle+0x29/0x70 Aug 22 06:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 5037.543396] tick_sched_timer+0x8c/0xc0 Aug 22 06:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 5037.544128] ? tick_nohz_handler+0xb0/0xb0 Aug 22 06:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 5037.544895] __hrtimer_run_queues+0x107/0x230 Aug 22 06:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 5037.545666] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 06:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 5037.546443] hrtimer_interrupt+0x101/0x220 Aug 22 06:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 5037.547197] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 06:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 5037.548003] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 06:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 5037.548821] Aug 22 06:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 5037.549457] Aug 22 06:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 5037.550081] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 06:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 5037.550962] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 5037.551845] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 06:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 5037.554064] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 06:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 5037.554938] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 06:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 5037.555932] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 06:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 5037.556926] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 06:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 5037.557891] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 06:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 5037.558843] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 06:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 5037.559799] ? _raw_spin_lock+0x22/0x30 Aug 22 06:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 5037.560583] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 5037.561461] direct_page_fault+0x206/0x310 [kvm] Aug 22 06:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 5037.562309] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 06:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 5037.563137] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 06:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 5037.563956] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 06:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 5037.564787] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 06:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 5037.565571] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 06:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 5037.566396] handle_exit+0x98/0x230 [kvm_amd] Aug 22 06:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 5037.567148] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 06:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 5037.567930] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 06:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 5037.568753] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 06:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 5037.569538] vcpu_run+0x62/0x2c0 [kvm] Aug 22 06:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 5037.570254] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 06:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 5037.570992] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 06:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 5037.571794] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 06:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 5037.572571] ? __seccomp_filter+0x4a/0x4a0 Aug 22 06:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 5037.573292] ? __fget_files+0x86/0xc0 Aug 22 06:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 5037.574075] __x64_sys_ioctl+0x95/0xd0 Aug 22 06:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 5037.574768] do_syscall_64+0x5c/0xc0 Aug 22 06:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 5037.575449] ? do_futex+0x162/0x1f0 Aug 22 06:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 5037.576118] ? __x64_sys_futex+0x78/0x1e0 Aug 22 06:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 5037.576846] ? __secure_computing+0xa9/0x120 Aug 22 06:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 5037.577563] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 06:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 5037.578465] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 5037.579222] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 5037.579974] ? do_syscall_64+0x69/0xc0 Aug 22 06:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 5037.580683] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 5037.581441] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 5037.582197] ? do_syscall_64+0x69/0xc0 Aug 22 06:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 5037.582889] ? do_syscall_64+0x69/0xc0 Aug 22 06:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 5037.583574] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 06:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 5037.584368] RIP: 0033:0x7faa5d0edaff Aug 22 06:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 5037.585053] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 06:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 5037.587147] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 06:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 5037.588113] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 06:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 5037.589078] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 06:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 5037.590029] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 06:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 5037.590997] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 06:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 5037.591937] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 06:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 5037.592880] Aug 22 06:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 5064.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 4608s! [qemu-system-x86:6715] Aug 22 06:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 5064.543103] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 06:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 5064.543174] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 06:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 5064.555379] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 06:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 5064.556797] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 06:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 5064.558022] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 5064.559083] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 06:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 5064.561655] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 06:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 5064.562707] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 06:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 5064.563881] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 06:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 5064.565063] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 06:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 5064.566235] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 06:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 5064.567394] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 06:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 5064.568580] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 06:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 5064.569813] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 06:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 5064.570915] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 06:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 5064.572117] Call Trace: Aug 22 06:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 5064.573050] Aug 22 06:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 5064.573949] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 5064.574983] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 5064.576027] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 5064.577100] ? show_regs.part.0+0x23/0x29 Aug 22 06:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 5064.578095] ? show_regs.cold+0x8/0xd Aug 22 06:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 5064.579070] ? watchdog_timer_fn+0x1be/0x220 Aug 22 06:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 5064.580087] ? lockup_detector_update_enable+0x60/0x60 Aug 22 06:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 5064.581148] ? __hrtimer_run_queues+0x107/0x230 Aug 22 06:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 5064.582179] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 06:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 5064.583200] ? hrtimer_interrupt+0x101/0x220 Aug 22 06:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 5064.584257] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 06:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 5064.585333] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 06:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 5064.586385] Aug 22 06:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 5064.587237] Aug 22 06:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 5064.588097] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 06:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 5064.589126] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 5064.590170] ? _raw_spin_lock+0x22/0x30 Aug 22 06:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 5064.591115] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 5064.592147] direct_page_fault+0x206/0x310 [kvm] Aug 22 06:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 5064.593168] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 06:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 5064.594195] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 06:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 5064.595204] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 06:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 5064.596191] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 06:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 5064.597136] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 06:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 5064.598113] handle_exit+0x98/0x230 [kvm_amd] Aug 22 06:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 5064.599003] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 06:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 5064.599916] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 06:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 5064.600891] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 06:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 5064.601816] vcpu_run+0x62/0x2c0 [kvm] Aug 22 06:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 5064.602626] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 06:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 5064.603430] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 06:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 5064.604340] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 06:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 5064.605153] ? __seccomp_filter+0x4a/0x4a0 Aug 22 06:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 5064.605898] ? __fget_files+0x86/0xc0 Aug 22 06:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 5064.606600] __x64_sys_ioctl+0x95/0xd0 Aug 22 06:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 5064.607298] do_syscall_64+0x5c/0xc0 Aug 22 06:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 5064.607979] ? do_futex+0x162/0x1f0 Aug 22 06:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 5064.608628] ? __x64_sys_futex+0x78/0x1e0 Aug 22 06:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 5064.609302] ? __secure_computing+0xa9/0x120 Aug 22 06:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 5064.609992] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 06:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 5064.610751] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 5064.611471] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 5064.612224] ? do_syscall_64+0x69/0xc0 Aug 22 06:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 5064.612871] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 5064.613571] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 5064.614271] ? do_syscall_64+0x69/0xc0 Aug 22 06:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 5064.614925] ? do_syscall_64+0x69/0xc0 Aug 22 06:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 5064.615551] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 06:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 5064.616282] RIP: 0033:0x7faa5d0edaff Aug 22 06:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 5064.616909] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 06:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 5064.618890] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 06:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 5064.619798] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 06:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 5064.620709] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 06:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 5064.621598] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 06:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 5064.622483] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 06:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 5064.623366] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 06:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 5064.624269] Aug 22 06:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 5092.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 4634s! [qemu-system-x86:6715] Aug 22 06:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 5092.544318] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 06:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 5092.544692] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 06:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 5092.556944] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 06:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 5092.558253] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 06:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 5092.559481] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 5092.560607] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 06:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 5092.563193] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 06:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 5092.564249] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 06:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 5092.565469] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 06:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 5092.566643] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 06:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 5092.567823] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 06:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 5092.568989] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 06:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 5092.570205] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 06:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 5092.571450] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 06:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 5092.572584] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 06:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 5092.573792] Call Trace: Aug 22 06:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 5092.574707] Aug 22 06:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 5092.575609] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 5092.576668] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 5092.577705] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 5092.578806] ? show_regs.part.0+0x23/0x29 Aug 22 06:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 5092.579842] ? show_regs.cold+0x8/0xd Aug 22 06:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 5092.580827] ? watchdog_timer_fn+0x1be/0x220 Aug 22 06:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 5092.581844] ? lockup_detector_update_enable+0x60/0x60 Aug 22 06:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 5092.582917] ? __hrtimer_run_queues+0x107/0x230 Aug 22 06:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 5092.583963] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 06:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 5092.584993] ? hrtimer_interrupt+0x101/0x220 Aug 22 06:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 5092.586011] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 06:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 5092.587089] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 06:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 5092.588152] Aug 22 06:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 5092.589007] Aug 22 06:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 5092.589847] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 06:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 5092.590883] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 5092.591935] ? _raw_spin_lock+0x22/0x30 Aug 22 06:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 5092.592882] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 5092.593903] direct_page_fault+0x206/0x310 [kvm] Aug 22 06:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 5092.594930] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 06:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 5092.595956] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 06:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 5092.596995] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 06:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 5092.598014] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 06:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 5092.598961] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 06:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 5092.599952] handle_exit+0x98/0x230 [kvm_amd] Aug 22 06:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 5092.600913] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 06:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 5092.601838] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 06:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 5092.602777] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 06:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 5092.603718] vcpu_run+0x62/0x2c0 [kvm] Aug 22 06:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 5092.604558] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 06:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 5092.605371] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 06:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 5092.606232] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 06:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 5092.607031] ? __seccomp_filter+0x4a/0x4a0 Aug 22 06:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 5092.607792] ? __fget_files+0x86/0xc0 Aug 22 06:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 5092.608506] __x64_sys_ioctl+0x95/0xd0 Aug 22 06:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 5092.609220] do_syscall_64+0x5c/0xc0 Aug 22 06:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 5092.609905] ? do_futex+0x162/0x1f0 Aug 22 06:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 5092.610564] ? __x64_sys_futex+0x78/0x1e0 Aug 22 06:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 5092.611239] ? __secure_computing+0xa9/0x120 Aug 22 06:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 5092.611972] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 06:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 5092.612743] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 5092.613471] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 5092.614202] ? do_syscall_64+0x69/0xc0 Aug 22 06:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 5092.614854] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 5092.615558] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 5092.616273] ? do_syscall_64+0x69/0xc0 Aug 22 06:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 5092.616897] ? do_syscall_64+0x69/0xc0 Aug 22 06:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 5092.617525] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 06:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 5092.618232] RIP: 0033:0x7faa5d0edaff Aug 22 06:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 5092.618901] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 06:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 5092.620903] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 06:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 5092.621814] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 06:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 5092.622730] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 06:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 5092.623644] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 06:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 5092.624654] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 06:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 5092.625562] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 06:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 5092.626469] Aug 22 06:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 5120.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 4660s! [qemu-system-x86:6715] Aug 22 06:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 5120.543757] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 06:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 5120.544018] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 06:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 5120.556108] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 06:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 5120.557376] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 06:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 5120.558594] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 5120.559665] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 06:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 5120.562211] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 06:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 5120.563256] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 06:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 5120.564419] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 06:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 5120.565575] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 06:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 5120.566730] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 06:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 5120.567896] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 06:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 5120.569059] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 06:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 5120.570288] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 06:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 5120.571390] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 06:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 5120.572585] Call Trace: Aug 22 06:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 5120.573496] Aug 22 06:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 5120.574387] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 5120.575421] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 5120.576440] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 5120.577539] ? show_regs.part.0+0x23/0x29 Aug 22 06:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 5120.578538] ? show_regs.cold+0x8/0xd Aug 22 06:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 5120.579527] ? watchdog_timer_fn+0x1be/0x220 Aug 22 06:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 5120.580533] ? lockup_detector_update_enable+0x60/0x60 Aug 22 06:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 5120.581601] ? __hrtimer_run_queues+0x107/0x230 Aug 22 06:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 5120.582632] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 06:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 5120.583661] ? hrtimer_interrupt+0x101/0x220 Aug 22 06:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 5120.584675] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 06:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 5120.585741] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 06:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 5120.586783] Aug 22 06:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 5120.587656] Aug 22 06:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 5120.588494] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 06:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 5120.589525] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 5120.590569] ? _raw_spin_lock+0x22/0x30 Aug 22 06:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 5120.591531] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 5120.592549] direct_page_fault+0x206/0x310 [kvm] Aug 22 06:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 5120.593583] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 06:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 5120.594597] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 06:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 5120.595613] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 06:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 5120.596682] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 06:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 5120.597634] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 06:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 5120.598662] handle_exit+0x98/0x230 [kvm_amd] Aug 22 06:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 5120.599564] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 06:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 5120.600477] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 06:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 5120.601408] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 06:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 5120.602312] vcpu_run+0x62/0x2c0 [kvm] Aug 22 06:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 5120.603122] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 06:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 5120.603945] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 06:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 5120.604798] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 06:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 5120.605594] ? __seccomp_filter+0x4a/0x4a0 Aug 22 06:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 5120.606506] ? __fget_files+0x86/0xc0 Aug 22 06:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 5120.607214] __x64_sys_ioctl+0x95/0xd0 Aug 22 06:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 5120.607919] do_syscall_64+0x5c/0xc0 Aug 22 06:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 5120.608582] ? do_futex+0x162/0x1f0 Aug 22 06:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 5120.609237] ? __x64_sys_futex+0x78/0x1e0 Aug 22 06:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 5120.609910] ? __secure_computing+0xa9/0x120 Aug 22 06:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 5120.610599] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 06:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 5120.611369] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 5120.612096] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 5120.612816] ? do_syscall_64+0x69/0xc0 Aug 22 06:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 5120.613460] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 5120.614163] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 5120.614857] ? do_syscall_64+0x69/0xc0 Aug 22 06:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 5120.615489] ? do_syscall_64+0x69/0xc0 Aug 22 06:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 5120.616115] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 06:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 5120.616821] RIP: 0033:0x7faa5d0edaff Aug 22 06:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 5120.617468] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 06:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 5120.619462] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 06:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 5120.620377] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 06:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 5120.621272] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 06:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 5120.622159] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 06:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 5120.623047] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 06:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 5120.623955] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 06:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 5120.624846] Aug 22 06:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 5148.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 4686s! [qemu-system-x86:6715] Aug 22 06:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 5148.543822] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 06:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 5148.544090] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 06:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 5148.557195] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 06:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 5148.558467] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 06:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 5148.559745] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 5148.560824] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 06:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 5148.563441] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 06:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 5148.564535] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 06:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 5148.565738] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 06:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 5148.566931] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 06:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 5148.568185] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 06:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 5148.569400] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 06:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 5148.570622] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 06:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 5148.571944] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 06:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 5148.573067] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 06:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 5148.574288] Call Trace: Aug 22 06:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 5148.575253] Aug 22 06:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 5148.576205] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 5148.577278] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 5148.578325] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 5148.579495] ? show_regs.part.0+0x23/0x29 Aug 22 06:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 5148.580542] ? show_regs.cold+0x8/0xd Aug 22 06:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 5148.581563] ? watchdog_timer_fn+0x1be/0x220 Aug 22 06:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 5148.582722] ? lockup_detector_update_enable+0x60/0x60 Aug 22 06:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 5148.583830] ? __hrtimer_run_queues+0x107/0x230 Aug 22 06:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 5148.584903] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 06:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 5148.585970] ? hrtimer_interrupt+0x101/0x220 Aug 22 06:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 5148.587087] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 06:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 5148.588173] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 06:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 5148.589223] Aug 22 06:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 5148.590107] Aug 22 06:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 5148.590994] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 06:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 5148.592047] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 5148.593112] ? _raw_spin_lock+0x22/0x30 Aug 22 06:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 5148.594073] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 5148.595160] direct_page_fault+0x206/0x310 [kvm] Aug 22 06:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 5148.596244] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 06:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 5148.597270] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 06:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 5148.598278] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 06:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 5148.599321] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 06:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 5148.600286] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 06:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 5148.601319] handle_exit+0x98/0x230 [kvm_amd] Aug 22 06:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 5148.602390] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 06:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 5148.603343] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 06:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 5148.604410] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 06:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 5148.605320] vcpu_run+0x62/0x2c0 [kvm] Aug 22 06:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 5148.606169] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 06:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 5148.607106] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 06:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 5148.607994] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 06:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 5148.608801] ? __seccomp_filter+0x4a/0x4a0 Aug 22 06:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 5148.609558] ? __fget_files+0x86/0xc0 Aug 22 06:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 5148.610275] __x64_sys_ioctl+0x95/0xd0 Aug 22 06:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 5148.611031] do_syscall_64+0x5c/0xc0 Aug 22 06:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 5148.611733] ? do_futex+0x162/0x1f0 Aug 22 06:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 5148.612405] ? __x64_sys_futex+0x78/0x1e0 Aug 22 06:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 5148.613088] ? __secure_computing+0xa9/0x120 Aug 22 06:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 5148.613786] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 06:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 5148.614552] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 5148.615300] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 5148.616049] ? do_syscall_64+0x69/0xc0 Aug 22 06:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 5148.616743] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 5148.617491] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 5148.618196] ? do_syscall_64+0x69/0xc0 Aug 22 06:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 5148.618823] ? do_syscall_64+0x69/0xc0 Aug 22 06:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 5148.619477] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 06:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 5148.620211] RIP: 0033:0x7faa5d0edaff Aug 22 06:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 5148.621062] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 06:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 5148.623344] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 06:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 5148.624334] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 06:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 5148.625310] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 06:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 5148.626215] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 06:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 5148.627396] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 06:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 5148.628643] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 06:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 5148.629567] Aug 22 06:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 5176.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 4713s! [qemu-system-x86:6715] Aug 22 06:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 5176.543772] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 06:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 5176.544044] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 06:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 5176.556547] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 06:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 5176.557859] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 06:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 5176.559103] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 5176.560165] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 06:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 5176.562778] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 06:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 5176.563830] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 06:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 5176.565030] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 06:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 5176.566211] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 06:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 5176.567438] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 06:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 5176.568634] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 06:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 5176.569831] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 06:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 5176.571108] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 06:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 5176.572226] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 06:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 5176.573442] Call Trace: Aug 22 06:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 5176.574359] Aug 22 06:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 5176.575474] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 5176.576519] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 5176.577570] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 5176.578692] ? show_regs.part.0+0x23/0x29 Aug 22 06:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 5176.579866] ? show_regs.cold+0x8/0xd Aug 22 06:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 5176.580854] ? watchdog_timer_fn+0x1be/0x220 Aug 22 06:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 5176.581882] ? lockup_detector_update_enable+0x60/0x60 Aug 22 06:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 5176.582988] ? __hrtimer_run_queues+0x107/0x230 Aug 22 06:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 5176.584033] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 06:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 5176.585079] ? hrtimer_interrupt+0x101/0x220 Aug 22 06:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 5176.586110] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 06:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 5176.587219] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 06:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 5176.588315] Aug 22 06:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 5176.589186] Aug 22 06:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 5176.590034] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 06:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 5176.591099] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 5176.592157] ? _raw_spin_lock+0x22/0x30 Aug 22 06:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 5176.593128] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 5176.594167] direct_page_fault+0x206/0x310 [kvm] Aug 22 06:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 5176.595242] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 06:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 5176.596273] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 06:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 5176.597312] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 06:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 5176.598372] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 06:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 5176.599367] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 06:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 5176.600349] handle_exit+0x98/0x230 [kvm_amd] Aug 22 06:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 5176.601260] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 06:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 5176.602189] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 06:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 5176.603152] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 06:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 5176.604086] vcpu_run+0x62/0x2c0 [kvm] Aug 22 06:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 5176.604914] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 06:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 5176.605737] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 06:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 5176.606629] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 06:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 5176.607443] ? __seccomp_filter+0x4a/0x4a0 Aug 22 06:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 5176.608206] ? __fget_files+0x86/0xc0 Aug 22 06:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 5176.608959] __x64_sys_ioctl+0x95/0xd0 Aug 22 06:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 5176.609670] do_syscall_64+0x5c/0xc0 Aug 22 06:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 5176.610344] ? do_futex+0x162/0x1f0 Aug 22 06:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 5176.611021] ? __x64_sys_futex+0x78/0x1e0 Aug 22 06:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 5176.611709] ? __secure_computing+0xa9/0x120 Aug 22 06:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 5176.612412] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 06:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 5176.613202] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 5176.613946] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 5176.614699] ? do_syscall_64+0x69/0xc0 Aug 22 06:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 5176.615354] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 5176.616065] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 5176.616784] ? do_syscall_64+0x69/0xc0 Aug 22 06:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 5176.617418] ? do_syscall_64+0x69/0xc0 Aug 22 06:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 5176.618054] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 06:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 5176.618796] RIP: 0033:0x7faa5d0edaff Aug 22 06:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 5176.619494] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 06:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 5176.621771] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 06:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 5176.622739] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 06:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 5176.623659] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 06:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 5176.624607] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 06:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 5176.625517] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 06:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 5176.626411] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 06:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 5176.627363] Aug 22 06:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 5204.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 4739s! [qemu-system-x86:6715] Aug 22 06:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 5204.543758] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 06:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 5204.544032] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 06:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 5204.556336] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 06:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 5204.557640] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 06:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 5204.558874] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 5204.559928] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 06:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 5204.562910] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 06:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 5204.563965] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 06:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 5204.565128] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 06:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 5204.566312] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 06:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 5204.567481] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 06:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 5204.568643] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 06:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 5204.569880] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 06:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 5204.571186] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 06:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 5204.572309] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 06:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 5204.573514] Call Trace: Aug 22 06:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 5204.574438] Aug 22 06:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 5204.575355] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 5204.576407] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 5204.577439] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 5204.578566] ? show_regs.part.0+0x23/0x29 Aug 22 06:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 5204.579577] ? show_regs.cold+0x8/0xd Aug 22 06:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 5204.580597] ? watchdog_timer_fn+0x1be/0x220 Aug 22 06:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 5204.581621] ? lockup_detector_update_enable+0x60/0x60 Aug 22 06:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 5204.582753] ? __hrtimer_run_queues+0x107/0x230 Aug 22 06:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 5204.583792] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 06:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 5204.584851] ? hrtimer_interrupt+0x101/0x220 Aug 22 06:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 5204.585882] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 06:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 5204.586997] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 06:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 5204.588060] Aug 22 06:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 5204.588926] Aug 22 06:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 5204.589765] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 06:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 5204.590909] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 5204.591971] ? _raw_spin_lock+0x22/0x30 Aug 22 06:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 5204.592963] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 5204.594053] direct_page_fault+0x206/0x310 [kvm] Aug 22 06:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 5204.595102] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 06:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 5204.596117] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 06:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 5204.597117] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 06:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 5204.598126] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 06:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 5204.599129] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 06:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 5204.600134] handle_exit+0x98/0x230 [kvm_amd] Aug 22 06:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 5204.601078] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 06:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 5204.602019] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 06:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 5204.602972] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 06:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 5204.603874] vcpu_run+0x62/0x2c0 [kvm] Aug 22 06:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 5204.604687] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 06:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 5204.605515] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 06:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 5204.606387] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 06:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 5204.607190] ? __seccomp_filter+0x4a/0x4a0 Aug 22 06:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 5204.607933] ? __fget_files+0x86/0xc0 Aug 22 06:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 5204.608640] __x64_sys_ioctl+0x95/0xd0 Aug 22 06:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 5204.609333] do_syscall_64+0x5c/0xc0 Aug 22 06:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 5204.609997] ? do_futex+0x162/0x1f0 Aug 22 06:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 5204.610659] ? __x64_sys_futex+0x78/0x1e0 Aug 22 06:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 5204.611333] ? __secure_computing+0xa9/0x120 Aug 22 06:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 5204.612031] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 06:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 5204.612789] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 5204.613513] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 5204.614243] ? do_syscall_64+0x69/0xc0 Aug 22 06:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 5204.614931] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 5204.615634] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 5204.616329] ? do_syscall_64+0x69/0xc0 Aug 22 06:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 5204.616973] ? do_syscall_64+0x69/0xc0 Aug 22 06:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 5204.617612] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 06:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 5204.618339] RIP: 0033:0x7faa5d0edaff Aug 22 06:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 5204.619002] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 06:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 5204.620995] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 06:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 5204.621913] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 06:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 5204.622821] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 06:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 5204.623804] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 06:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 5204.624696] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 06:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 5204.625581] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 06:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 5204.626492] Aug 22 06:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 5217.536706] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 06:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 5217.538328] rcu: 1-....: (1271109 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=619390 Aug 22 06:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 5217.539442] (t=1275084 jiffies g=23269 q=14113) Aug 22 06:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 5217.540221] NMI backtrace for cpu 1 Aug 22 06:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 5217.540928] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 06:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 5217.542046] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 06:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 5217.543113] Call Trace: Aug 22 06:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 5217.543787] Aug 22 06:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 5217.544442] show_stack+0x52/0x5c Aug 22 06:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 5217.545165] dump_stack_lvl+0x4a/0x63 Aug 22 06:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 5217.545910] dump_stack+0x10/0x16 Aug 22 06:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 5217.546638] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 06:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 5217.547418] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 06:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 5217.548195] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 06:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 5217.549011] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 06:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 5217.549828] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 06:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 5217.550645] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 06:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 5217.551533] print_cpu_stall.cold+0x2f/0xe2 Aug 22 06:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 5217.552380] ? timekeeping_update+0xf7/0x150 Aug 22 06:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 5217.553235] check_cpu_stall+0x109/0x270 Aug 22 06:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 5217.554075] rcu_sched_clock_irq+0x9a/0x250 Aug 22 06:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 5217.554944] update_process_times+0x94/0xd0 Aug 22 06:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 5217.555789] tick_sched_handle+0x29/0x70 Aug 22 06:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 5217.556613] tick_sched_timer+0x8c/0xc0 Aug 22 06:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 5217.557437] ? tick_nohz_handler+0xb0/0xb0 Aug 22 06:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 5217.558304] __hrtimer_run_queues+0x107/0x230 Aug 22 06:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 5217.559189] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 06:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 5217.560053] hrtimer_interrupt+0x101/0x220 Aug 22 06:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 5217.560890] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 06:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 5217.561813] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 06:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 5217.562728] Aug 22 06:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 5217.563409] Aug 22 06:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 5217.564082] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 06:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 5217.564999] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 5217.565998] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 06:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 5217.568866] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 06:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 5217.569842] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 06:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 5217.570993] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 06:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 5217.572114] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 06:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 5217.573248] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 06:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 5217.574375] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 06:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 5217.575646] ? _raw_spin_lock+0x22/0x30 Aug 22 06:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 5217.576488] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 5217.577431] direct_page_fault+0x206/0x310 [kvm] Aug 22 06:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 5217.578391] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 06:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 5217.579305] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 06:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 5217.580247] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 06:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 5217.581182] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 06:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 5217.582058] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 06:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 5217.583012] handle_exit+0x98/0x230 [kvm_amd] Aug 22 06:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 5217.583853] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 06:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 5217.584727] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 06:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 5217.585629] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 06:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 5217.586519] vcpu_run+0x62/0x2c0 [kvm] Aug 22 06:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 5217.587308] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 06:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 5217.588330] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 06:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 5217.589239] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 06:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 5217.590112] ? __seccomp_filter+0x4a/0x4a0 Aug 22 06:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 5217.590932] ? __fget_files+0x86/0xc0 Aug 22 06:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 5217.591701] __x64_sys_ioctl+0x95/0xd0 Aug 22 06:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 5217.592470] do_syscall_64+0x5c/0xc0 Aug 22 06:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 5217.593232] ? do_futex+0x162/0x1f0 Aug 22 06:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 5217.593977] ? __x64_sys_futex+0x78/0x1e0 Aug 22 06:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 5217.594777] ? __secure_computing+0xa9/0x120 Aug 22 06:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 5217.595587] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 06:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 5217.596488] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 5217.597340] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 5217.598212] ? do_syscall_64+0x69/0xc0 Aug 22 06:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 5217.598981] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 5217.599836] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 5217.600697] ? do_syscall_64+0x69/0xc0 Aug 22 06:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 5217.601469] ? do_syscall_64+0x69/0xc0 Aug 22 06:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 5217.602254] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 06:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 5217.603128] RIP: 0033:0x7faa5d0edaff Aug 22 06:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 5217.603931] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 06:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 5217.606398] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 06:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 5217.607506] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 06:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 5217.608604] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 06:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 5217.609691] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 06:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 5217.610793] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 06:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 5217.611859] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 06:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 5217.612925] Aug 22 06:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 5244.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 4776s! [qemu-system-x86:6715] Aug 22 06:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 5244.543757] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 06:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 5244.544005] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 06:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 5244.556276] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 06:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 5244.558256] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 06:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 5244.560093] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 5244.561627] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 06:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 5244.565490] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 06:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 5244.566994] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 06:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 5244.568667] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 06:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 5244.570349] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 06:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 5244.571708] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 06:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 5244.572872] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 06:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 5244.574049] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 06:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 5244.575286] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 06:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 5244.576390] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 06:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 5244.577586] Call Trace: Aug 22 06:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 5244.578505] Aug 22 06:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 5244.579414] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 5244.580445] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 5244.581474] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 5244.582579] ? show_regs.part.0+0x23/0x29 Aug 22 06:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 5244.583749] ? show_regs.cold+0x8/0xd Aug 22 06:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 5244.584747] ? watchdog_timer_fn+0x1be/0x220 Aug 22 06:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 5244.585760] ? lockup_detector_update_enable+0x60/0x60 Aug 22 06:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 5244.586842] ? __hrtimer_run_queues+0x107/0x230 Aug 22 06:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 5244.587869] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 06:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 5244.588891] ? hrtimer_interrupt+0x101/0x220 Aug 22 06:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 5244.589912] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 06:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 5244.590980] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 06:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 5244.592024] Aug 22 06:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 5244.592886] Aug 22 06:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 5244.593730] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 06:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 5244.594779] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 5244.595819] ? _raw_spin_lock+0x22/0x30 Aug 22 06:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 5244.596768] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 5244.597861] direct_page_fault+0x206/0x310 [kvm] Aug 22 06:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 5244.598903] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 06:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 5244.599912] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 06:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 5244.600918] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 06:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 5244.601938] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 06:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 5244.602885] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 06:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 5244.603864] handle_exit+0x98/0x230 [kvm_amd] Aug 22 06:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 5244.604762] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 06:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 5244.605676] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 06:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 5244.606613] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 06:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 5244.607515] vcpu_run+0x62/0x2c0 [kvm] Aug 22 06:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 5244.608326] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 06:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 5244.609132] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 06:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 5244.609999] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 06:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 5244.610797] ? __seccomp_filter+0x4a/0x4a0 Aug 22 06:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 5244.611540] ? __fget_files+0x86/0xc0 Aug 22 06:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 5244.612244] __x64_sys_ioctl+0x95/0xd0 Aug 22 06:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 5244.612936] do_syscall_64+0x5c/0xc0 Aug 22 06:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 5244.613601] ? do_futex+0x162/0x1f0 Aug 22 06:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 5244.614262] ? __x64_sys_futex+0x78/0x1e0 Aug 22 06:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 5244.614940] ? __secure_computing+0xa9/0x120 Aug 22 06:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 5244.615631] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 06:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 5244.616391] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 5244.617112] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 5244.617839] ? do_syscall_64+0x69/0xc0 Aug 22 06:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 5244.618484] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 5244.619273] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 5244.619972] ? do_syscall_64+0x69/0xc0 Aug 22 06:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 5244.620708] ? do_syscall_64+0x69/0xc0 Aug 22 06:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 5244.621331] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 06:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 5244.622042] RIP: 0033:0x7faa5d0edaff Aug 22 06:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 5244.622709] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 06:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 5244.624884] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 06:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 5244.625805] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 06:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 5244.626702] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 06:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 5244.627592] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 06:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 5244.628479] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 06:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 5244.629373] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 06:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 5244.630283] Aug 22 06:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 5272.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 4802s! [qemu-system-x86:6715] Aug 22 06:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 5272.543770] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 06:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 5272.544037] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 06:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 5272.556560] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 06:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 5272.557847] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 06:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 5272.559072] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 5272.560134] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 06:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 5272.562721] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 06:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 5272.563767] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 06:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 5272.564928] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 06:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 5272.566110] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 06:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 5272.567280] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 06:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 5272.568851] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 06:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 5272.570238] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 06:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 5272.571500] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 06:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 5272.572602] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 06:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 5272.573825] Call Trace: Aug 22 06:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 5272.574761] Aug 22 06:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 5272.575665] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 5272.576706] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 5272.577759] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 5272.578863] ? show_regs.part.0+0x23/0x29 Aug 22 06:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 5272.579864] ? show_regs.cold+0x8/0xd Aug 22 06:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 5272.580839] ? watchdog_timer_fn+0x1be/0x220 Aug 22 06:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 5272.581926] ? lockup_detector_update_enable+0x60/0x60 Aug 22 06:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 5272.583007] ? __hrtimer_run_queues+0x107/0x230 Aug 22 06:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 5272.584044] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 06:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 5272.585067] ? hrtimer_interrupt+0x101/0x220 Aug 22 06:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 5272.586120] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 06:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 5272.587204] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 06:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 5272.588256] Aug 22 06:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 5272.589116] Aug 22 06:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 5272.589969] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 06:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 5272.591011] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 5272.592062] ? _raw_spin_lock+0x22/0x30 Aug 22 06:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 5272.593010] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 5272.594046] direct_page_fault+0x206/0x310 [kvm] Aug 22 06:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 5272.595085] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 06:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 5272.596100] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 06:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 5272.597107] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 06:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 5272.598118] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 06:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 5272.599075] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 06:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 5272.600059] handle_exit+0x98/0x230 [kvm_amd] Aug 22 06:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 5272.600957] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 06:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 5272.601906] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 06:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 5272.602846] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 06:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 5272.603756] vcpu_run+0x62/0x2c0 [kvm] Aug 22 06:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 5272.604573] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 06:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 5272.605385] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 06:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 5272.606251] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 06:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 5272.607063] ? __seccomp_filter+0x4a/0x4a0 Aug 22 06:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 5272.607808] ? __fget_files+0x86/0xc0 Aug 22 06:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 5272.608514] __x64_sys_ioctl+0x95/0xd0 Aug 22 06:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 5272.609211] do_syscall_64+0x5c/0xc0 Aug 22 06:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 5272.609888] ? do_futex+0x162/0x1f0 Aug 22 06:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 5272.610546] ? __x64_sys_futex+0x78/0x1e0 Aug 22 06:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 5272.611250] ? __secure_computing+0xa9/0x120 Aug 22 06:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 5272.611952] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 06:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 5272.612720] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 5272.613508] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 5272.614254] ? do_syscall_64+0x69/0xc0 Aug 22 06:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 5272.614902] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 5272.615603] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 5272.616296] ? do_syscall_64+0x69/0xc0 Aug 22 06:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 5272.616920] ? do_syscall_64+0x69/0xc0 Aug 22 06:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 5272.617609] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 06:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 5272.618453] RIP: 0033:0x7faa5d0edaff Aug 22 06:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 5272.619155] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 06:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 5272.622025] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 06:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 5272.623394] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 06:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 5272.624594] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 06:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 5272.625594] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 06:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 5272.626492] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 06:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 5272.627385] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 06:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 5272.628296] Aug 22 06:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 5300.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 4828s! [qemu-system-x86:6715] Aug 22 06:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 5300.543689] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 06:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 5300.543926] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 06:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 5300.556289] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 06:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 5300.557583] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 06:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 5300.558799] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 5300.559851] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 06:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 5300.562419] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 06:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 5300.563468] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 06:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 5300.564628] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 06:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 5300.565798] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 06:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 5300.566965] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 06:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 5300.568134] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 06:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 5300.569321] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 06:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 5300.570558] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 06:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 5300.571656] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 06:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 5300.572868] Call Trace: Aug 22 06:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 5300.573794] Aug 22 06:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 5300.574836] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 5300.575864] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 5300.576888] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 5300.578151] ? show_regs.part.0+0x23/0x29 Aug 22 06:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 5300.579214] ? show_regs.cold+0x8/0xd Aug 22 06:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 5300.580319] ? watchdog_timer_fn+0x1be/0x220 Aug 22 06:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 5300.581367] ? lockup_detector_update_enable+0x60/0x60 Aug 22 06:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 5300.582450] ? __hrtimer_run_queues+0x107/0x230 Aug 22 06:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 5300.583486] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 06:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 5300.584512] ? hrtimer_interrupt+0x101/0x220 Aug 22 06:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 5300.585556] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 06:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 5300.586626] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 06:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 5300.587678] Aug 22 06:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 5300.588530] Aug 22 06:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 5300.589385] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 06:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 5300.590416] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 5300.591453] ? _raw_spin_lock+0x22/0x30 Aug 22 06:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 5300.592400] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 5300.593445] direct_page_fault+0x206/0x310 [kvm] Aug 22 06:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 5300.594470] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 06:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 5300.595481] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 06:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 5300.596478] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 06:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 5300.597496] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 06:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 5300.598459] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 06:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 5300.599436] handle_exit+0x98/0x230 [kvm_amd] Aug 22 06:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 5300.600327] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 06:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 5300.601256] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 06:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 5300.602187] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 06:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 5300.603114] vcpu_run+0x62/0x2c0 [kvm] Aug 22 06:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 5300.603928] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 06:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 5300.604735] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 06:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 5300.605604] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 06:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 5300.606403] ? __seccomp_filter+0x4a/0x4a0 Aug 22 06:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 5300.607145] ? __fget_files+0x86/0xc0 Aug 22 06:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 5300.607853] __x64_sys_ioctl+0x95/0xd0 Aug 22 06:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 5300.608558] do_syscall_64+0x5c/0xc0 Aug 22 06:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 5300.609242] ? do_futex+0x162/0x1f0 Aug 22 06:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 5300.609912] ? __x64_sys_futex+0x78/0x1e0 Aug 22 06:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 5300.610743] ? __secure_computing+0xa9/0x120 Aug 22 06:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 5300.611444] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 06:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 5300.612205] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 5300.612928] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 5300.613689] ? do_syscall_64+0x69/0xc0 Aug 22 06:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 5300.614344] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 5300.615045] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 5300.615742] ? do_syscall_64+0x69/0xc0 Aug 22 06:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 5300.616366] ? do_syscall_64+0x69/0xc0 Aug 22 06:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 5300.616985] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 06:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 5300.617706] RIP: 0033:0x7faa5d0edaff Aug 22 06:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 5300.618363] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 06:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 5300.620354] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 06:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 5300.621278] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 06:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 5300.622166] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 06:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 5300.623054] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 06:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 5300.623958] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 06:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 5300.624851] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 06:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 5300.625756] Aug 22 06:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 5328.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 4854s! [qemu-system-x86:6715] Aug 22 06:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 5328.543116] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 06:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 5328.543182] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 06:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 5328.555539] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 06:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 5328.557014] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 06:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 5328.558260] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 5328.559334] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 06:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 5328.561916] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 06:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 5328.563175] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 06:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 5328.564415] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 06:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 5328.565654] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 06:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 5328.566985] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 06:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 5328.568304] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 06:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 5328.569683] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 06:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 5328.571103] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 06:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 5328.572413] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 06:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 5328.573724] Call Trace: Aug 22 06:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 5328.574651] Aug 22 06:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 5328.575758] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 5328.577033] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 5328.578056] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 5328.579132] ? show_regs.part.0+0x23/0x29 Aug 22 06:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 5328.580132] ? show_regs.cold+0x8/0xd Aug 22 06:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 5328.581117] ? watchdog_timer_fn+0x1be/0x220 Aug 22 06:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 5328.582151] ? lockup_detector_update_enable+0x60/0x60 Aug 22 06:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 5328.583227] ? __hrtimer_run_queues+0x107/0x230 Aug 22 06:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 5328.584369] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 06:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 5328.585569] ? hrtimer_interrupt+0x101/0x220 Aug 22 06:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 5328.586629] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 06:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 5328.587705] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 06:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 5328.588862] Aug 22 06:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 5328.589879] Aug 22 06:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 5328.590720] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 06:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 5328.591795] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 5328.592859] ? _raw_spin_lock+0x22/0x30 Aug 22 06:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 5328.593808] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 5328.594830] direct_page_fault+0x206/0x310 [kvm] Aug 22 06:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 5328.595855] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 06:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 5328.596879] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 06:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 5328.597899] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 06:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 5328.598867] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 06:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 5328.599810] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 06:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 5328.600804] handle_exit+0x98/0x230 [kvm_amd] Aug 22 06:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 5328.601704] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 06:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 5328.602628] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 06:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 5328.603557] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 06:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 5328.604463] vcpu_run+0x62/0x2c0 [kvm] Aug 22 06:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 5328.605292] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 06:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 5328.606103] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 06:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 5328.606960] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 06:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 5328.607769] ? __seccomp_filter+0x4a/0x4a0 Aug 22 06:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 5328.608516] ? __fget_files+0x86/0xc0 Aug 22 06:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 5328.609243] __x64_sys_ioctl+0x95/0xd0 Aug 22 06:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 5328.609942] do_syscall_64+0x5c/0xc0 Aug 22 06:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 5328.610609] ? do_futex+0x162/0x1f0 Aug 22 06:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 5328.611259] ? __x64_sys_futex+0x78/0x1e0 Aug 22 06:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 5328.611933] ? __secure_computing+0xa9/0x120 Aug 22 06:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 5328.612640] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 06:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 5328.613575] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 5328.614395] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 5328.615162] ? do_syscall_64+0x69/0xc0 Aug 22 06:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 5328.615813] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 5328.616542] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 5328.617438] ? do_syscall_64+0x69/0xc0 Aug 22 06:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 5328.618466] ? do_syscall_64+0x69/0xc0 Aug 22 06:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 5328.619470] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 06:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 5328.620478] RIP: 0033:0x7faa5d0edaff Aug 22 06:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 5328.621420] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 06:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 5328.624194] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 06:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 5328.625514] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 06:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 5328.626777] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 06:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 5328.628030] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 06:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 5328.629244] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 06:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 5328.630379] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 06:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 5328.631497] Aug 22 06:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 5356.541976] watchdog: BUG: soft lockup - CPU#1 stuck for 4880s! [qemu-system-x86:6715] Aug 22 06:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 5356.543702] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 06:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 5356.543933] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 06:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 5356.556063] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 06:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 5356.557335] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 06:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 5356.558555] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 5356.559608] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 06:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 5356.562166] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 06:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 5356.563211] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 06:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 5356.564365] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 06:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 5356.565546] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 06:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 5356.566703] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 06:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 5356.567861] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 06:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 5356.569042] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 06:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 5356.570271] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 06:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 5356.571366] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 06:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 5356.572565] Call Trace: Aug 22 06:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 5356.573477] Aug 22 06:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 5356.574369] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 5356.575402] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 5356.576428] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 5356.577534] ? show_regs.part.0+0x23/0x29 Aug 22 06:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 5356.578548] ? show_regs.cold+0x8/0xd Aug 22 06:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 5356.579524] ? watchdog_timer_fn+0x1be/0x220 Aug 22 06:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 5356.580541] ? lockup_detector_update_enable+0x60/0x60 Aug 22 06:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 5356.581611] ? __hrtimer_run_queues+0x107/0x230 Aug 22 06:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 5356.582638] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 06:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 5356.583664] ? hrtimer_interrupt+0x101/0x220 Aug 22 06:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 5356.584696] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 06:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 5356.585768] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 06:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 5356.586812] Aug 22 06:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 5356.587664] Aug 22 06:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 5356.588508] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 06:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 5356.589542] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 5356.590603] ? _raw_spin_lock+0x22/0x30 Aug 22 06:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 5356.591547] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 5356.592577] direct_page_fault+0x206/0x310 [kvm] Aug 22 06:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 5356.593601] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 06:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 5356.594606] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 06:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 5356.595609] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 06:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 5356.596613] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 06:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 5356.597563] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 06:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 5356.598539] handle_exit+0x98/0x230 [kvm_amd] Aug 22 06:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 5356.599434] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 06:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 5356.600343] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 06:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 5356.601274] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 06:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 5356.602175] vcpu_run+0x62/0x2c0 [kvm] Aug 22 06:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 5356.602984] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 06:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 5356.603786] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 06:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 5356.604644] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 06:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 5356.605439] ? __seccomp_filter+0x4a/0x4a0 Aug 22 06:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 5356.606178] ? __fget_files+0x86/0xc0 Aug 22 06:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 5356.606882] __x64_sys_ioctl+0x95/0xd0 Aug 22 06:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 5356.607573] do_syscall_64+0x5c/0xc0 Aug 22 06:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 5356.608234] ? do_futex+0x162/0x1f0 Aug 22 06:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 5356.608892] ? __x64_sys_futex+0x78/0x1e0 Aug 22 06:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 5356.609562] ? __secure_computing+0xa9/0x120 Aug 22 06:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 5356.610246] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 06:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 5356.611000] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 5356.611718] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 5356.612457] ? do_syscall_64+0x69/0xc0 Aug 22 06:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 5356.613113] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 5356.613814] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 5356.614507] ? do_syscall_64+0x69/0xc0 Aug 22 06:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 5356.615128] ? do_syscall_64+0x69/0xc0 Aug 22 06:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 5356.615747] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 06:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 5356.616478] RIP: 0033:0x7faa5d0edaff Aug 22 06:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 5356.617127] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 06:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 5356.619111] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 06:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 5356.620020] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 06:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 5356.620918] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 06:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 5356.621840] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 06:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 5356.622741] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 06:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 5356.623628] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 06:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 5356.624527] Aug 22 06:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 5384.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 4906s! [qemu-system-x86:6715] Aug 22 06:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 5384.543719] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 06:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 5384.543976] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 06:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 5384.556304] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 06:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 5384.557616] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 06:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 5384.558848] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 5384.559915] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 06:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 5384.562499] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 06:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 5384.563567] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 06:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 5384.564747] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 06:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 5384.565920] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 06:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 5384.567085] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 06:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 5384.568339] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 06:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 5384.569617] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 06:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 5384.570880] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 06:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 5384.571992] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 06:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 5384.573227] Call Trace: Aug 22 06:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 5384.574161] Aug 22 06:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 5384.575070] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 5384.576125] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 5384.577159] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 5384.578262] ? show_regs.part.0+0x23/0x29 Aug 22 06:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 5384.579263] ? show_regs.cold+0x8/0xd Aug 22 06:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 5384.580254] ? watchdog_timer_fn+0x1be/0x220 Aug 22 06:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 5384.581269] ? lockup_detector_update_enable+0x60/0x60 Aug 22 06:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 5384.582336] ? __hrtimer_run_queues+0x107/0x230 Aug 22 06:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 5384.583375] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 06:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 5384.584432] ? hrtimer_interrupt+0x101/0x220 Aug 22 06:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 5384.585468] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 06:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 5384.586580] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 06:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 5384.587657] Aug 22 06:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 5384.588554] Aug 22 06:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 5384.589401] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 06:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 5384.590455] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 5384.591512] ? _raw_spin_lock+0x22/0x30 Aug 22 06:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 5384.592476] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 5384.593501] direct_page_fault+0x206/0x310 [kvm] Aug 22 06:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 5384.594534] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 06:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 5384.595557] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 06:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 5384.596592] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 06:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 5384.597615] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 06:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 5384.598577] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 06:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 5384.599560] handle_exit+0x98/0x230 [kvm_amd] Aug 22 06:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 5384.600483] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 06:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 5384.601415] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 06:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 5384.602358] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 06:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 5384.603271] vcpu_run+0x62/0x2c0 [kvm] Aug 22 06:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 5384.604088] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 06:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 5384.604918] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 06:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 5384.605778] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 06:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 5384.606581] ? __seccomp_filter+0x4a/0x4a0 Aug 22 06:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 5384.607333] ? __fget_files+0x86/0xc0 Aug 22 06:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 5384.608045] __x64_sys_ioctl+0x95/0xd0 Aug 22 06:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 5384.608784] do_syscall_64+0x5c/0xc0 Aug 22 06:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 5384.609455] ? do_futex+0x162/0x1f0 Aug 22 06:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 5384.610120] ? __x64_sys_futex+0x78/0x1e0 Aug 22 06:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 5384.610812] ? __secure_computing+0xa9/0x120 Aug 22 06:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 5384.611508] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 06:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 5384.612293] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 5384.613035] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 5384.613758] ? do_syscall_64+0x69/0xc0 Aug 22 06:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 5384.614413] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 5384.615117] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 5384.615820] ? do_syscall_64+0x69/0xc0 Aug 22 06:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 5384.616470] ? do_syscall_64+0x69/0xc0 Aug 22 06:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 5384.617096] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 06:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 5384.617940] RIP: 0033:0x7faa5d0edaff Aug 22 06:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 5384.618598] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 06:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 5384.620684] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 06:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 5384.621602] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 06:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 5384.622497] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 06:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 5384.623393] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 06:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 5384.624293] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 06:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 5384.625185] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 06:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 5384.626081] Aug 22 06:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 5397.548707] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 06:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 5397.549699] rcu: 1-....: (1315970 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=641086 Aug 22 06:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 5397.550822] (t=1320087 jiffies g=23269 q=14243) Aug 22 06:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 5397.551604] NMI backtrace for cpu 1 Aug 22 06:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 5397.552330] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 06:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 5397.553432] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 06:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 5397.554492] Call Trace: Aug 22 06:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 5397.555163] Aug 22 06:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 5397.555805] show_stack+0x52/0x5c Aug 22 06:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 5397.556559] dump_stack_lvl+0x4a/0x63 Aug 22 06:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 5397.557317] dump_stack+0x10/0x16 Aug 22 06:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 5397.558034] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 06:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 5397.558812] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 06:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 5397.559587] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 06:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 5397.560424] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 06:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 5397.561252] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 06:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 5397.562059] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 06:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 5397.562827] print_cpu_stall.cold+0x2f/0xe2 Aug 22 06:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 5397.563593] ? timekeeping_update+0xf7/0x150 Aug 22 06:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 5397.564371] check_cpu_stall+0x109/0x270 Aug 22 06:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 5397.565117] rcu_sched_clock_irq+0x9a/0x250 Aug 22 06:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 5397.565876] update_process_times+0x94/0xd0 Aug 22 06:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 5397.566639] tick_sched_handle+0x29/0x70 Aug 22 06:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 5397.567381] tick_sched_timer+0x8c/0xc0 Aug 22 06:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 5397.568129] ? tick_nohz_handler+0xb0/0xb0 Aug 22 06:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 5397.568886] __hrtimer_run_queues+0x107/0x230 Aug 22 06:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 5397.569666] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 06:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 5397.570440] hrtimer_interrupt+0x101/0x220 Aug 22 06:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 5397.571197] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 06:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 5397.572044] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 06:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 5397.572854] Aug 22 06:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 5397.573494] Aug 22 06:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 5397.574134] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 06:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 5397.574966] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 5397.575860] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 06:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 5397.578090] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 06:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 5397.578973] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 06:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 5397.580002] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 06:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 5397.580984] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 06:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 5397.581943] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 06:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 5397.582891] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 06:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 5397.583846] ? _raw_spin_lock+0x22/0x30 Aug 22 06:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 5397.584621] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 5397.585484] direct_page_fault+0x206/0x310 [kvm] Aug 22 06:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 5397.586328] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 06:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 5397.587152] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 06:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 5397.587986] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 06:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 5397.588786] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 06:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 5397.589564] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 06:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 5397.590381] handle_exit+0x98/0x230 [kvm_amd] Aug 22 06:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 5397.591131] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 06:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 5397.591911] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 06:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 5397.592718] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 06:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 5397.593511] vcpu_run+0x62/0x2c0 [kvm] Aug 22 06:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 5397.594224] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 06:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 5397.594953] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 06:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 5397.595751] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 06:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 5397.596532] ? __seccomp_filter+0x4a/0x4a0 Aug 22 06:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 5397.597258] ? __fget_files+0x86/0xc0 Aug 22 06:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 5397.597950] __x64_sys_ioctl+0x95/0xd0 Aug 22 06:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 5397.598641] do_syscall_64+0x5c/0xc0 Aug 22 06:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 5397.599318] ? do_futex+0x162/0x1f0 Aug 22 06:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 5397.600006] ? __x64_sys_futex+0x78/0x1e0 Aug 22 06:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 5397.600706] ? __secure_computing+0xa9/0x120 Aug 22 06:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 5397.601419] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 06:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 5397.602219] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 5397.602970] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 5397.603730] ? do_syscall_64+0x69/0xc0 Aug 22 06:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 5397.604445] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 5397.605209] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 5397.605971] ? do_syscall_64+0x69/0xc0 Aug 22 06:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 5397.606661] ? do_syscall_64+0x69/0xc0 Aug 22 06:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 5397.607351] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 06:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 5397.608134] RIP: 0033:0x7faa5d0edaff Aug 22 06:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 5397.608834] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 06:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 5397.610922] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 06:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 5397.611886] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 06:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 5397.612841] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 06:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 5397.613784] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 06:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 5397.614720] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 06:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 5397.615638] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 06:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 5397.616585] Aug 22 06:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 5424.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 4943s! [qemu-system-x86:6715] Aug 22 06:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 5424.543140] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 06:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 5424.543209] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 06:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 5424.555529] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 06:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 5424.556809] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 06:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 5424.558028] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 5424.559086] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 06:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 5424.561636] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 06:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 5424.562685] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 06:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 5424.563860] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 06:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 5424.565019] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 06:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 5424.566187] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 06:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 5424.567355] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 06:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 5424.568536] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 06:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 5424.569775] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 06:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 5424.570873] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 06:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 5424.572088] Call Trace: Aug 22 06:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 5424.573002] Aug 22 06:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 5424.573885] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 5424.574921] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 5424.575962] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 5424.577046] ? show_regs.part.0+0x23/0x29 Aug 22 06:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 5424.578042] ? show_regs.cold+0x8/0xd Aug 22 06:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 5424.579019] ? watchdog_timer_fn+0x1be/0x220 Aug 22 06:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 5424.580037] ? lockup_detector_update_enable+0x60/0x60 Aug 22 06:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 5424.581100] ? __hrtimer_run_queues+0x107/0x230 Aug 22 06:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 5424.582127] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 06:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 5424.583150] ? hrtimer_interrupt+0x101/0x220 Aug 22 06:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 5424.584184] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 06:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 5424.585257] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 06:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 5424.586300] Aug 22 06:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 5424.587157] Aug 22 06:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 5424.588074] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 06:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 5424.589114] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 5424.590153] ? _raw_spin_lock+0x22/0x30 Aug 22 06:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 5424.591104] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 5424.592132] direct_page_fault+0x206/0x310 [kvm] Aug 22 06:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 5424.593157] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 06:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 5424.594174] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 06:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 5424.595181] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 06:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 5424.596183] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 06:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 5424.597345] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 06:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 5424.598539] handle_exit+0x98/0x230 [kvm_amd] Aug 22 06:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 5424.599452] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 06:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 5424.600416] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 06:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 5424.601366] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 06:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 5424.602282] vcpu_run+0x62/0x2c0 [kvm] Aug 22 06:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 5424.603108] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 06:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 5424.603952] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 06:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 5424.604820] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 06:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 5424.605632] ? __seccomp_filter+0x4a/0x4a0 Aug 22 06:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 5424.606383] ? __fget_files+0x86/0xc0 Aug 22 06:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 5424.607093] __x64_sys_ioctl+0x95/0xd0 Aug 22 06:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 5424.607798] do_syscall_64+0x5c/0xc0 Aug 22 06:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 5424.608464] ? do_futex+0x162/0x1f0 Aug 22 06:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 5424.609118] ? __x64_sys_futex+0x78/0x1e0 Aug 22 06:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 5424.609796] ? __secure_computing+0xa9/0x120 Aug 22 06:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 5424.610485] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 06:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 5424.611243] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 5424.611973] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 5424.612694] ? do_syscall_64+0x69/0xc0 Aug 22 06:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 5424.613339] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 5424.614046] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 5424.614740] ? do_syscall_64+0x69/0xc0 Aug 22 06:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 5424.615363] ? do_syscall_64+0x69/0xc0 Aug 22 06:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 5424.615998] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 06:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 5424.616705] RIP: 0033:0x7faa5d0edaff Aug 22 06:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 5424.617328] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 06:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 5424.619311] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 06:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 5424.620235] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 06:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 5424.621122] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 06:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 5424.622008] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 06:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 5424.622900] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 06:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 5424.623790] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 06:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 5424.624682] Aug 22 06:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 5452.541981] watchdog: BUG: soft lockup - CPU#1 stuck for 4970s! [qemu-system-x86:6715] Aug 22 06:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 5452.543764] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 06:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 5452.544022] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 06:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 5452.556252] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 06:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 5452.557518] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 06:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 5452.558741] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 5452.559813] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 06:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 5452.562356] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 06:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 5452.563587] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 06:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 5452.564757] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 06:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 5452.565922] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 06:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 5452.567084] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 06:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 5452.568262] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 06:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 5452.569427] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 06:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 5452.570659] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 06:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 5452.571802] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 06:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 5452.573028] Call Trace: Aug 22 06:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 5452.573941] Aug 22 06:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 5452.574840] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 5452.575892] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 5452.576920] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 5452.578015] ? show_regs.part.0+0x23/0x29 Aug 22 06:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 5452.579011] ? show_regs.cold+0x8/0xd Aug 22 06:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 5452.579999] ? watchdog_timer_fn+0x1be/0x220 Aug 22 06:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 5452.581009] ? lockup_detector_update_enable+0x60/0x60 Aug 22 06:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 5452.582071] ? __hrtimer_run_queues+0x107/0x230 Aug 22 06:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 5452.583096] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 06:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 5452.584142] ? hrtimer_interrupt+0x101/0x220 Aug 22 06:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 5452.585156] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 06:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 5452.586223] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 06:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 5452.587266] Aug 22 06:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 5452.588137] Aug 22 06:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 5452.588973] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 06:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 5452.590003] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 5452.591045] ? _raw_spin_lock+0x22/0x30 Aug 22 06:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 5452.592013] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 5452.593039] direct_page_fault+0x206/0x310 [kvm] Aug 22 06:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 5452.594061] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 06:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 5452.595073] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 06:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 5452.596102] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 06:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 5452.597310] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 06:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 5452.600516] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 06:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 5452.601522] handle_exit+0x98/0x230 [kvm_amd] Aug 22 06:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 5452.602446] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 06:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 5452.603388] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 06:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 5452.604321] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 06:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 5452.605224] vcpu_run+0x62/0x2c0 [kvm] Aug 22 06:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 5452.606042] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 06:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 5452.606855] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 06:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 5452.607722] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 06:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 5452.608521] ? __seccomp_filter+0x4a/0x4a0 Aug 22 06:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 5452.609263] ? __fget_files+0x86/0xc0 Aug 22 06:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 5452.609975] __x64_sys_ioctl+0x95/0xd0 Aug 22 06:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 5452.610670] do_syscall_64+0x5c/0xc0 Aug 22 06:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 5452.611361] ? do_futex+0x162/0x1f0 Aug 22 06:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 5452.612017] ? __x64_sys_futex+0x78/0x1e0 Aug 22 06:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 5452.612698] ? __secure_computing+0xa9/0x120 Aug 22 06:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 5452.613400] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 06:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 5452.614168] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 5452.614900] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 5452.615637] ? do_syscall_64+0x69/0xc0 Aug 22 06:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 5452.616286] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 5452.616999] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 5452.617701] ? do_syscall_64+0x69/0xc0 Aug 22 06:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 5452.618331] ? do_syscall_64+0x69/0xc0 Aug 22 06:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 5452.618963] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 06:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 5452.619686] RIP: 0033:0x7faa5d0edaff Aug 22 06:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 5452.620350] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 06:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 5452.622389] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 06:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 5452.623361] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 06:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 5452.624265] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 06:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 5452.625173] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 06:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 5452.626093] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 06:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 5452.627031] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 06:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 5452.627957] Aug 22 06:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 5480.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 4996s! [qemu-system-x86:6715] Aug 22 06:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 5480.543102] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 06:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 5480.543171] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 06:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 5480.555390] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 06:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 5480.556659] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 06:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 5480.557880] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 5480.558934] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 06:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 5480.561493] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 06:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 5480.562540] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 06:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 5480.563707] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 06:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 5480.564869] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 06:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 5480.566054] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 06:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 5480.567240] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 06:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 5480.568415] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 06:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 5480.569644] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 06:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 5480.570736] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 06:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 5480.571932] Call Trace: Aug 22 06:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 5480.572843] Aug 22 06:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 5480.573725] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 5480.574757] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 5480.575789] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 5480.576862] ? show_regs.part.0+0x23/0x29 Aug 22 06:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 5480.577857] ? show_regs.cold+0x8/0xd Aug 22 06:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 5480.578831] ? watchdog_timer_fn+0x1be/0x220 Aug 22 06:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 5480.579940] ? lockup_detector_update_enable+0x60/0x60 Aug 22 06:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 5480.581094] ? __hrtimer_run_queues+0x107/0x230 Aug 22 06:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 5480.582125] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 06:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 5480.583154] ? hrtimer_interrupt+0x101/0x220 Aug 22 06:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 5480.584171] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 06:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 5480.585239] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 06:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 5480.586284] Aug 22 06:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 5480.587145] Aug 22 06:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 5480.587982] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 06:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 5480.589019] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 5480.590057] ? _raw_spin_lock+0x22/0x30 Aug 22 06:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 5480.591010] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 5480.592024] direct_page_fault+0x206/0x310 [kvm] Aug 22 06:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 5480.593048] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 06:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 5480.594055] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 06:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 5480.595063] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 06:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 5480.596062] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 06:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 5480.597012] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 06:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 5480.597994] handle_exit+0x98/0x230 [kvm_amd] Aug 22 06:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 5480.598888] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 06:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 5480.599810] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 06:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 5480.600739] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 06:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 5480.601641] vcpu_run+0x62/0x2c0 [kvm] Aug 22 06:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 5480.602469] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 06:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 5480.603303] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 06:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 5480.604158] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 06:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 5480.604957] ? __seccomp_filter+0x4a/0x4a0 Aug 22 06:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 5480.605698] ? __fget_files+0x86/0xc0 Aug 22 06:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 5480.606400] __x64_sys_ioctl+0x95/0xd0 Aug 22 06:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 5480.607104] do_syscall_64+0x5c/0xc0 Aug 22 06:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 5480.607773] ? do_futex+0x162/0x1f0 Aug 22 06:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 5480.608419] ? __x64_sys_futex+0x78/0x1e0 Aug 22 06:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 5480.609091] ? __secure_computing+0xa9/0x120 Aug 22 06:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 5480.609779] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 06:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 5480.610541] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 5480.611273] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 5480.611988] ? do_syscall_64+0x69/0xc0 Aug 22 06:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 5480.612631] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 5480.613339] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 5480.614034] ? do_syscall_64+0x69/0xc0 Aug 22 06:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 5480.614660] ? do_syscall_64+0x69/0xc0 Aug 22 06:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 5480.615291] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 06:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 5480.615995] RIP: 0033:0x7faa5d0edaff Aug 22 06:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 5480.616617] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 06:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 5480.618602] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 06:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 5480.619516] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 06:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 5480.620408] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 06:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 5480.621293] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 06:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 5480.622194] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 06:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 5480.623095] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 06:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 5480.623987] Aug 22 06:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 5508.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 5022s! [qemu-system-x86:6715] Aug 22 06:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 5508.543745] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 06:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 5508.544005] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 06:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 5508.556312] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 06:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 5508.557611] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 06:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 5508.558841] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 5508.559901] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 06:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 5508.562434] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 06:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 5508.563491] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 06:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 5508.564647] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 06:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 5508.565810] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 06:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 5508.566979] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 06:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 5508.568138] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 06:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 5508.569303] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 06:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 5508.570538] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 06:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 5508.571645] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 06:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 5508.572846] Call Trace: Aug 22 06:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 5508.573764] Aug 22 06:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 5508.574676] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 5508.575721] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 5508.576745] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 5508.577874] ? show_regs.part.0+0x23/0x29 Aug 22 06:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 5508.578913] ? show_regs.cold+0x8/0xd Aug 22 06:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 5508.579889] ? watchdog_timer_fn+0x1be/0x220 Aug 22 06:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 5508.580900] ? lockup_detector_update_enable+0x60/0x60 Aug 22 06:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 5508.581971] ? __hrtimer_run_queues+0x107/0x230 Aug 22 06:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 5508.583017] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 06:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 5508.584052] ? hrtimer_interrupt+0x101/0x220 Aug 22 06:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 5508.585105] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 06:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 5508.586171] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 06:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 5508.587225] Aug 22 06:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 5508.588078] Aug 22 06:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 5508.588918] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 06:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 5508.589947] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 5508.590995] ? _raw_spin_lock+0x22/0x30 Aug 22 06:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 5508.592038] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 5508.593149] direct_page_fault+0x206/0x310 [kvm] Aug 22 06:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 5508.594269] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 06:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 5508.595380] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 06:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 5508.596466] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 06:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 5508.597565] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 06:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 5508.598522] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 06:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 5508.599553] handle_exit+0x98/0x230 [kvm_amd] Aug 22 06:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 5508.600446] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 06:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 5508.601380] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 06:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 5508.602354] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 06:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 5508.603300] vcpu_run+0x62/0x2c0 [kvm] Aug 22 06:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 5508.604116] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 06:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 5508.604924] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 06:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 5508.605779] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 06:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 5508.606804] ? __seccomp_filter+0x4a/0x4a0 Aug 22 06:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 5508.607608] ? __fget_files+0x86/0xc0 Aug 22 06:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 5508.608328] __x64_sys_ioctl+0x95/0xd0 Aug 22 06:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 5508.609023] do_syscall_64+0x5c/0xc0 Aug 22 06:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 5508.609692] ? do_futex+0x162/0x1f0 Aug 22 06:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 5508.610341] ? __x64_sys_futex+0x78/0x1e0 Aug 22 06:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 5508.611064] ? __secure_computing+0xa9/0x120 Aug 22 06:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 5508.611776] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 06:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 5508.612543] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 5508.613275] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 5508.614002] ? do_syscall_64+0x69/0xc0 Aug 22 06:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 5508.614712] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 5508.615449] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 5508.616153] ? do_syscall_64+0x69/0xc0 Aug 22 06:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 5508.616778] ? do_syscall_64+0x69/0xc0 Aug 22 06:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 5508.617403] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 06:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 5508.618108] RIP: 0033:0x7faa5d0edaff Aug 22 06:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 5508.618788] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 06:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 5508.620775] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 06:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 5508.621686] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 06:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 5508.622746] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 06:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 5508.624091] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 06:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 5508.625899] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 06:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 5508.627145] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 06:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 5508.628312] Aug 22 06:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 5536.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 5048s! [qemu-system-x86:6715] Aug 22 06:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 5536.543279] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 06:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 5536.543347] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 06:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 5536.557492] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 06:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 5536.558967] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 06:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 5536.560377] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 5536.561547] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 06:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 5536.564896] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 06:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 5536.566230] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 06:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 5536.567544] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 06:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 5536.568835] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 06:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 5536.570138] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 06:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 5536.571473] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 06:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 5536.572779] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 06:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 5536.574168] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 06:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 5536.575401] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 06:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 5536.576739] Call Trace: Aug 22 06:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 5536.577708] Aug 22 06:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 5536.578659] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 5536.579788] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 5536.580897] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 5536.582072] ? show_regs.part.0+0x23/0x29 Aug 22 06:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 5536.583173] ? show_regs.cold+0x8/0xd Aug 22 06:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 5536.584223] ? watchdog_timer_fn+0x1be/0x220 Aug 22 06:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 5536.585320] ? lockup_detector_update_enable+0x60/0x60 Aug 22 06:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 5536.586525] ? __hrtimer_run_queues+0x107/0x230 Aug 22 06:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 5536.587656] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 06:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 5536.588774] ? hrtimer_interrupt+0x101/0x220 Aug 22 06:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 5536.589874] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 06:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 5536.591069] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 06:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 5536.592225] Aug 22 06:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 5536.593130] Aug 22 06:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 5536.594029] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 06:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 5536.595192] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 5536.596351] ? _raw_spin_lock+0x22/0x30 Aug 22 06:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 5536.597376] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 5536.598514] direct_page_fault+0x206/0x310 [kvm] Aug 22 06:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 5536.599671] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 06:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 5536.600778] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 06:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 5536.601889] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 06:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 5536.602976] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 06:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 5536.604033] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 06:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 5536.605127] handle_exit+0x98/0x230 [kvm_amd] Aug 22 06:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 5536.606137] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 06:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 5536.607177] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 06:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 5536.608206] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 06:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 5536.609223] vcpu_run+0x62/0x2c0 [kvm] Aug 22 06:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 5536.610122] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 06:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 5536.611053] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 06:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 5536.612017] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 06:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 5536.612918] ? __seccomp_filter+0x4a/0x4a0 Aug 22 06:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 5536.613755] ? __fget_files+0x86/0xc0 Aug 22 06:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 5536.614560] __x64_sys_ioctl+0x95/0xd0 Aug 22 06:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 5536.615330] do_syscall_64+0x5c/0xc0 Aug 22 06:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 5536.616082] ? do_futex+0x162/0x1f0 Aug 22 06:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 5536.616843] ? __x64_sys_futex+0x78/0x1e0 Aug 22 06:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 5536.617613] ? __secure_computing+0xa9/0x120 Aug 22 06:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 5536.618458] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 06:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 5536.619352] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 5536.620167] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 5536.620976] ? do_syscall_64+0x69/0xc0 Aug 22 06:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 5536.621695] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 5536.622563] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 5536.623374] ? do_syscall_64+0x69/0xc0 Aug 22 06:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 5536.624082] ? do_syscall_64+0x69/0xc0 Aug 22 06:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 5536.624785] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 06:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 5536.625593] RIP: 0033:0x7faa5d0edaff Aug 22 06:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 5536.626351] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 06:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 5536.628697] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 06:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 5536.629760] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 06:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 5536.630809] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 06:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 5536.631844] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 06:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 5536.632870] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 06:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 5536.633899] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 06:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 5536.634956] Aug 22 06:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 5564.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 5074s! [qemu-system-x86:6715] Aug 22 06:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 5564.543097] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 06:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 5564.543166] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 06:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 5564.555210] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 06:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 5564.556474] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 06:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 5564.557694] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 5564.558754] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 06:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 5564.561300] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 06:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 5564.562348] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 06:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 5564.563518] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 06:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 5564.564677] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 06:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 5564.565836] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 06:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 5564.567002] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 06:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 5564.568165] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 06:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 5564.569402] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 06:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 5564.570507] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 06:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 5564.571697] Call Trace: Aug 22 06:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 5564.572608] Aug 22 06:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 5564.573496] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 5564.574557] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 5564.575581] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 5564.576660] ? show_regs.part.0+0x23/0x29 Aug 22 06:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 5564.577654] ? show_regs.cold+0x8/0xd Aug 22 06:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 5564.578632] ? watchdog_timer_fn+0x1be/0x220 Aug 22 06:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 5564.579642] ? lockup_detector_update_enable+0x60/0x60 Aug 22 06:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 5564.580703] ? __hrtimer_run_queues+0x107/0x230 Aug 22 06:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 5564.581728] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 06:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 5564.582763] ? hrtimer_interrupt+0x101/0x220 Aug 22 06:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 5564.583776] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 06:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 5564.584841] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 06:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 5564.585889] Aug 22 06:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 5564.586770] Aug 22 06:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 5564.587607] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 06:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 5564.588640] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 5564.589671] ? _raw_spin_lock+0x22/0x30 Aug 22 06:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 5564.590633] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 5564.591645] direct_page_fault+0x206/0x310 [kvm] Aug 22 06:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 5564.592665] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 06:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 5564.593674] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 06:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 5564.594689] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 06:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 5564.595666] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 06:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 5564.596608] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 06:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 5564.597583] handle_exit+0x98/0x230 [kvm_amd] Aug 22 06:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 5564.598491] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 06:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 5564.599401] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 06:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 5564.600319] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 06:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 5564.601219] vcpu_run+0x62/0x2c0 [kvm] Aug 22 06:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 5564.602039] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 06:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 5564.602843] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 06:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 5564.603694] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 06:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 5564.604491] ? __seccomp_filter+0x4a/0x4a0 Aug 22 06:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 5564.605231] ? __fget_files+0x86/0xc0 Aug 22 06:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 5564.605938] __x64_sys_ioctl+0x95/0xd0 Aug 22 06:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 5564.606627] do_syscall_64+0x5c/0xc0 Aug 22 06:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 5564.607294] ? do_futex+0x162/0x1f0 Aug 22 06:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 5564.607939] ? __x64_sys_futex+0x78/0x1e0 Aug 22 06:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 5564.608613] ? __secure_computing+0xa9/0x120 Aug 22 06:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 5564.609299] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 06:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 5564.610073] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 5564.610791] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 5564.611508] ? do_syscall_64+0x69/0xc0 Aug 22 06:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 5564.612185] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 5564.612897] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 5564.613600] ? do_syscall_64+0x69/0xc0 Aug 22 06:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 5564.614233] ? do_syscall_64+0x69/0xc0 Aug 22 06:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 5564.614855] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 06:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 5564.615561] RIP: 0033:0x7faa5d0edaff Aug 22 06:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 5564.616183] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 06:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 5564.618181] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 06:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 5564.619090] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 06:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 5564.619976] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 06:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 5564.620862] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 06:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 5564.621760] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 06:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 5564.622653] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 06:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 5564.623680] Aug 22 06:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 5577.560708] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 06:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 5577.561688] rcu: 1-....: (1360836 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=662786 Aug 22 06:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 5577.562819] (t=1365090 jiffies g=23269 q=14420) Aug 22 06:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 5577.563600] NMI backtrace for cpu 1 Aug 22 06:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 5577.564357] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 06:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 5577.565500] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 06:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 5577.566577] Call Trace: Aug 22 06:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 5577.567256] Aug 22 06:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 5577.567898] show_stack+0x52/0x5c Aug 22 06:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 5577.568621] dump_stack_lvl+0x4a/0x63 Aug 22 06:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 5577.569412] dump_stack+0x10/0x16 Aug 22 06:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 5577.570175] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 06:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 5577.570955] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 06:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 5577.571734] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 06:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 5577.572551] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 06:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 5577.573370] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 06:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 5577.574197] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 06:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 5577.574968] print_cpu_stall.cold+0x2f/0xe2 Aug 22 06:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 5577.575731] ? timekeeping_update+0xf7/0x150 Aug 22 06:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 5577.576511] check_cpu_stall+0x109/0x270 Aug 22 06:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 5577.577269] rcu_sched_clock_irq+0x9a/0x250 Aug 22 06:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 5577.578053] update_process_times+0x94/0xd0 Aug 22 06:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 5577.578816] tick_sched_handle+0x29/0x70 Aug 22 06:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 5577.579560] tick_sched_timer+0x8c/0xc0 Aug 22 06:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 5577.580305] ? tick_nohz_handler+0xb0/0xb0 Aug 22 06:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 5577.581060] __hrtimer_run_queues+0x107/0x230 Aug 22 06:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 5577.581871] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 06:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 5577.582646] hrtimer_interrupt+0x101/0x220 Aug 22 06:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 5577.583414] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 06:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 5577.584231] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 06:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 5577.585034] Aug 22 06:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 5577.585680] Aug 22 06:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 5577.586344] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 06:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 5577.587170] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 5577.588056] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 06:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 5577.590302] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 06:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 5577.591184] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 06:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 5577.592181] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 06:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 5577.593171] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 06:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 5577.594160] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 06:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 5577.595114] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 06:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 5577.596067] ? _raw_spin_lock+0x22/0x30 Aug 22 06:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 5577.596831] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 5577.597666] direct_page_fault+0x206/0x310 [kvm] Aug 22 06:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 5577.598518] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 06:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 5577.599350] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 06:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 5577.600178] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 06:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 5577.600984] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 06:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 5577.601793] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 06:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 5577.602630] handle_exit+0x98/0x230 [kvm_amd] Aug 22 06:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 5577.603395] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 06:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 5577.604184] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 06:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 5577.604990] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 06:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 5577.605822] vcpu_run+0x62/0x2c0 [kvm] Aug 22 06:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 5577.606549] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 06:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 5577.607283] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 06:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 5577.608087] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 06:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 5577.608858] ? __seccomp_filter+0x4a/0x4a0 Aug 22 06:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 5577.609582] ? __fget_files+0x86/0xc0 Aug 22 06:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 5577.610291] __x64_sys_ioctl+0x95/0xd0 Aug 22 06:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 5577.610985] do_syscall_64+0x5c/0xc0 Aug 22 06:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 5577.611667] ? do_futex+0x162/0x1f0 Aug 22 06:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 5577.612339] ? __x64_sys_futex+0x78/0x1e0 Aug 22 06:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 5577.613046] ? __secure_computing+0xa9/0x120 Aug 22 06:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 5577.613818] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 06:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 5577.614640] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 5577.615400] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 5577.616162] ? do_syscall_64+0x69/0xc0 Aug 22 06:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 5577.616858] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 5577.617617] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 5577.618444] ? do_syscall_64+0x69/0xc0 Aug 22 06:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 5577.619174] ? do_syscall_64+0x69/0xc0 Aug 22 06:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 5577.619862] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 06:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 5577.620637] RIP: 0033:0x7faa5d0edaff Aug 22 06:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 5577.621331] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 06:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 5577.623464] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 06:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 5577.624443] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 06:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 5577.625393] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 06:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 5577.626379] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 06:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 5577.627318] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 06:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 5577.628241] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 06:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 5577.629155] Aug 22 06:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 5604.541981] watchdog: BUG: soft lockup - CPU#1 stuck for 5111s! [qemu-system-x86:6715] Aug 22 06:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 5604.544025] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 06:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 5604.544314] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 06:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 5604.559888] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 06:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 5604.561169] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 06:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 5604.562589] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 5604.563660] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 06:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 5604.566981] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 06:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 5604.568391] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 06:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 5604.570134] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 06:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 5604.571717] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 06:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 5604.573255] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 06:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 5604.575172] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 06:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 5604.576627] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 06:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 5604.578321] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 06:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 5604.579841] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 06:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 5604.581174] Call Trace: Aug 22 06:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 5604.582178] Aug 22 06:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 5604.583298] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 5604.584367] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 5604.585751] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 5604.586948] ? show_regs.part.0+0x23/0x29 Aug 22 06:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 5604.587960] ? show_regs.cold+0x8/0xd Aug 22 06:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 5604.589172] ? watchdog_timer_fn+0x1be/0x220 Aug 22 06:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 5604.590588] ? lockup_detector_update_enable+0x60/0x60 Aug 22 06:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 5604.592055] ? __hrtimer_run_queues+0x107/0x230 Aug 22 06:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 5604.593427] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 06:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 5604.594598] ? hrtimer_interrupt+0x101/0x220 Aug 22 06:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 5604.595639] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 06:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 5604.596728] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 06:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 5604.597860] Aug 22 06:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 5604.598729] Aug 22 06:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 5604.599689] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 06:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 5604.601105] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 5604.602447] ? _raw_spin_lock+0x22/0x30 Aug 22 06:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 5604.603696] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 5604.605058] direct_page_fault+0x206/0x310 [kvm] Aug 22 06:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 5604.606519] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 06:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 5604.607947] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 06:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 5604.609244] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 06:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 5604.610438] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 06:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 5604.611528] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 06:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 5604.612847] handle_exit+0x98/0x230 [kvm_amd] Aug 22 06:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 5604.614091] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 06:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 5604.615380] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 06:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 5604.616460] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 06:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 5604.617453] vcpu_run+0x62/0x2c0 [kvm] Aug 22 06:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 5604.618527] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 06:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 5604.619343] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 06:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 5604.620450] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 06:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 5604.621309] ? __seccomp_filter+0x4a/0x4a0 Aug 22 06:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 5604.622138] ? __fget_files+0x86/0xc0 Aug 22 06:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 5604.622896] __x64_sys_ioctl+0x95/0xd0 Aug 22 06:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 5604.623595] do_syscall_64+0x5c/0xc0 Aug 22 06:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 5604.624263] ? do_futex+0x162/0x1f0 Aug 22 06:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 5604.624914] ? __x64_sys_futex+0x78/0x1e0 Aug 22 06:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 5604.625633] ? __secure_computing+0xa9/0x120 Aug 22 06:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 5604.626495] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 06:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 5604.627520] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 5604.628447] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 5604.629339] ? do_syscall_64+0x69/0xc0 Aug 22 06:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 5604.630203] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 5604.631126] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 5604.632018] ? do_syscall_64+0x69/0xc0 Aug 22 06:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 5604.632764] ? do_syscall_64+0x69/0xc0 Aug 22 06:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 5604.633538] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 06:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 5604.634388] RIP: 0033:0x7faa5d0edaff Aug 22 06:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 5604.635165] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 06:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 5604.637748] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 06:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 5604.638975] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 06:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 5604.640164] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 06:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 5604.641067] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 06:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 5604.642103] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 06:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 5604.643089] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 06:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 5604.644278] Aug 22 06:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 5632.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 5137s! [qemu-system-x86:6715] Aug 22 06:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 5632.543091] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 06:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 5632.543157] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 06:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 5632.555330] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 06:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 5632.556650] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 06:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 5632.557896] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 5632.558950] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 06:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 5632.561504] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 06:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 5632.562554] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 06:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 5632.563720] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 06:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 5632.564875] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 06:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 5632.566044] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 06:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 5632.567201] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 06:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 5632.568363] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 06:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 5632.569607] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 06:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 5632.570702] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 06:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 5632.571891] Call Trace: Aug 22 06:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 5632.572802] Aug 22 06:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 5632.573709] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 5632.574737] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 5632.575804] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 5632.576892] ? show_regs.part.0+0x23/0x29 Aug 22 06:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 5632.577913] ? show_regs.cold+0x8/0xd Aug 22 06:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 5632.578890] ? watchdog_timer_fn+0x1be/0x220 Aug 22 06:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 5632.579897] ? lockup_detector_update_enable+0x60/0x60 Aug 22 06:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 5632.580959] ? __hrtimer_run_queues+0x107/0x230 Aug 22 06:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 5632.581999] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 06:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 5632.583021] ? hrtimer_interrupt+0x101/0x220 Aug 22 06:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 5632.584036] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 06:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 5632.585122] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 06:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 5632.586181] Aug 22 06:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 5632.587042] Aug 22 06:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 5632.587882] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 06:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 5632.588911] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 5632.589960] ? _raw_spin_lock+0x22/0x30 Aug 22 06:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 5632.590901] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 5632.591915] direct_page_fault+0x206/0x310 [kvm] Aug 22 06:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 5632.592937] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 06:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 5632.593962] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 06:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 5632.594959] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 06:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 5632.595929] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 06:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 5632.596872] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 06:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 5632.597861] handle_exit+0x98/0x230 [kvm_amd] Aug 22 06:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 5632.598751] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 06:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 5632.599661] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 06:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 5632.600582] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 06:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 5632.601520] vcpu_run+0x62/0x2c0 [kvm] Aug 22 06:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 5632.602340] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 06:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 5632.603146] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 06:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 5632.603998] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 06:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 5632.604796] ? __seccomp_filter+0x4a/0x4a0 Aug 22 06:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 5632.605600] ? __fget_files+0x86/0xc0 Aug 22 06:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 5632.606312] __x64_sys_ioctl+0x95/0xd0 Aug 22 06:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 5632.607008] do_syscall_64+0x5c/0xc0 Aug 22 06:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 5632.607670] ? do_futex+0x162/0x1f0 Aug 22 06:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 5632.608316] ? __x64_sys_futex+0x78/0x1e0 Aug 22 06:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 5632.608986] ? __secure_computing+0xa9/0x120 Aug 22 06:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 5632.609697] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 06:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 5632.610452] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 5632.611169] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 5632.611883] ? do_syscall_64+0x69/0xc0 Aug 22 06:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 5632.612523] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 5632.613243] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 5632.613943] ? do_syscall_64+0x69/0xc0 Aug 22 06:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 5632.614565] ? do_syscall_64+0x69/0xc0 Aug 22 06:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 5632.615181] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 06:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 5632.615894] RIP: 0033:0x7faa5d0edaff Aug 22 06:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 5632.616526] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 06:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 5632.618524] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 06:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 5632.619434] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 06:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 5632.620325] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 06:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 5632.621232] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 06:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 5632.622119] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 06:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 5632.623013] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 06:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 5632.623904] Aug 22 06:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 5660.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 5163s! [qemu-system-x86:6715] Aug 22 06:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 5660.543086] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 06:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 5660.543156] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 06:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 5660.555219] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 06:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 5660.556475] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 06:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 5660.557711] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 5660.558768] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 06:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 5660.561360] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 06:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 5660.562447] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 06:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 5660.563665] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 06:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 5660.564866] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 06:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 5660.566038] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 06:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 5660.567201] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 06:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 5660.568362] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 06:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 5660.569616] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 06:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 5660.570710] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 06:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 5660.571906] Call Trace: Aug 22 06:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 5660.572837] Aug 22 06:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 5660.573723] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 5660.574750] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 5660.575771] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 5660.576859] ? show_regs.part.0+0x23/0x29 Aug 22 06:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 5660.577854] ? show_regs.cold+0x8/0xd Aug 22 06:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 5660.578821] ? watchdog_timer_fn+0x1be/0x220 Aug 22 06:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 5660.579825] ? lockup_detector_update_enable+0x60/0x60 Aug 22 06:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 5660.580895] ? __hrtimer_run_queues+0x107/0x230 Aug 22 06:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 5660.581925] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 06:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 5660.582954] ? hrtimer_interrupt+0x101/0x220 Aug 22 06:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 5660.583971] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 06:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 5660.585043] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 06:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 5660.586093] Aug 22 06:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 5660.586949] Aug 22 06:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 5660.587784] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 06:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 5660.588931] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 5660.590016] ? _raw_spin_lock+0x22/0x30 Aug 22 06:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 5660.590970] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 5660.591986] direct_page_fault+0x206/0x310 [kvm] Aug 22 06:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 5660.593134] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 06:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 5660.594169] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 06:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 5660.595257] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 06:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 5660.596250] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 06:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 5660.597230] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 06:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 5660.598212] handle_exit+0x98/0x230 [kvm_amd] Aug 22 06:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 5660.599107] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 06:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 5660.600022] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 06:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 5660.600970] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 06:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 5660.601872] vcpu_run+0x62/0x2c0 [kvm] Aug 22 06:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 5660.602686] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 06:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 5660.603495] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 06:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 5660.604344] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 06:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 5660.605158] ? __seccomp_filter+0x4a/0x4a0 Aug 22 06:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 5660.605898] ? __fget_files+0x86/0xc0 Aug 22 06:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 5660.606596] __x64_sys_ioctl+0x95/0xd0 Aug 22 06:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 5660.607287] do_syscall_64+0x5c/0xc0 Aug 22 06:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 5660.607949] ? do_futex+0x162/0x1f0 Aug 22 06:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 5660.608595] ? __x64_sys_futex+0x78/0x1e0 Aug 22 06:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 5660.609293] ? __secure_computing+0xa9/0x120 Aug 22 06:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 5660.609984] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 06:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 5660.610740] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 5660.611464] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 5660.612202] ? do_syscall_64+0x69/0xc0 Aug 22 06:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 5660.612879] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 5660.613626] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 5660.614325] ? do_syscall_64+0x69/0xc0 Aug 22 06:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 5660.615026] ? do_syscall_64+0x69/0xc0 Aug 22 06:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 5660.615656] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 06:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 5660.616360] RIP: 0033:0x7faa5d0edaff Aug 22 06:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 5660.617009] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 06:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 5660.619028] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 06:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 5660.619969] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 06:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 5660.620876] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 06:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 5660.621771] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 06:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 5660.622676] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 06:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 5660.623589] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 06:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 5660.624504] Aug 22 06:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 5688.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 5189s! [qemu-system-x86:6715] Aug 22 06:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 5688.543764] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 06:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 5688.544038] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 06:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 5688.556113] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 06:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 5688.557406] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 06:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 5688.558634] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 5688.559701] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 06:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 5688.562301] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 06:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 5688.563346] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 06:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 5688.564573] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 06:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 5688.565756] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 06:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 5688.566926] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 06:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 5688.568097] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 06:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 5688.569289] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 06:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 5688.570559] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 06:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 5688.571663] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 06:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 5688.572879] Call Trace: Aug 22 06:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 5688.573792] Aug 22 06:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 5688.574690] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 5688.575738] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 5688.576791] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 5688.577887] ? show_regs.part.0+0x23/0x29 Aug 22 06:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 5688.578881] ? show_regs.cold+0x8/0xd Aug 22 06:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 5688.579859] ? watchdog_timer_fn+0x1be/0x220 Aug 22 06:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 5688.580892] ? lockup_detector_update_enable+0x60/0x60 Aug 22 06:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 5688.581954] ? __hrtimer_run_queues+0x107/0x230 Aug 22 06:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 5688.582978] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 06:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 5688.583996] ? hrtimer_interrupt+0x101/0x220 Aug 22 06:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 5688.585022] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 06:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 5688.586097] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 06:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 5688.587138] Aug 22 06:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 5688.587991] Aug 22 06:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 5688.588840] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 06:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 5688.589875] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 5688.591001] ? _raw_spin_lock+0x22/0x30 Aug 22 06:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 5688.591962] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 5688.593016] direct_page_fault+0x206/0x310 [kvm] Aug 22 06:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 5688.594065] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 06:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 5688.595094] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 06:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 5688.596133] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 06:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 5688.597169] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 06:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 5688.598116] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 06:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 5688.599119] handle_exit+0x98/0x230 [kvm_amd] Aug 22 06:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 5688.600036] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 06:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 5688.601019] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 06:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 5688.601958] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 06:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 5688.602867] vcpu_run+0x62/0x2c0 [kvm] Aug 22 06:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 5688.603725] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 06:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 5688.604559] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 06:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 5688.605426] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 06:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 5688.606250] ? __seccomp_filter+0x4a/0x4a0 Aug 22 06:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 5688.607021] ? __fget_files+0x86/0xc0 Aug 22 06:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 5688.607736] __x64_sys_ioctl+0x95/0xd0 Aug 22 06:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 5688.608450] do_syscall_64+0x5c/0xc0 Aug 22 06:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 5688.609116] ? do_futex+0x162/0x1f0 Aug 22 06:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 5688.609768] ? __x64_sys_futex+0x78/0x1e0 Aug 22 06:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 5688.610447] ? __secure_computing+0xa9/0x120 Aug 22 06:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 5688.611140] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 06:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 5688.611900] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 5688.612642] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 5688.613362] ? do_syscall_64+0x69/0xc0 Aug 22 06:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 5688.614007] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 5688.614708] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 5688.615406] ? do_syscall_64+0x69/0xc0 Aug 22 06:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 5688.616029] ? do_syscall_64+0x69/0xc0 Aug 22 06:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 5688.616662] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 06:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 5688.617487] RIP: 0033:0x7faa5d0edaff Aug 22 06:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 5688.618152] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 06:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 5688.620141] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 06:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 5688.621196] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 06:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 5688.622088] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 06:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 5688.622983] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 06:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 5688.623875] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 06:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 5688.624772] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 06:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 5688.625670] Aug 22 06:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 5716.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 5215s! [qemu-system-x86:6715] Aug 22 06:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 5716.543783] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 06:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 5716.544046] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 06:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 5716.556614] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 06:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 5716.557904] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 06:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 5716.559184] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 5716.560449] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 06:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 5716.563423] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 06:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 5716.564488] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 06:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 5716.565649] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 06:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 5716.566814] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 06:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 5716.567973] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 06:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 5716.569145] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 06:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 5716.570311] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 06:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 5716.571544] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 06:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 5716.572660] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 06:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 5716.573851] Call Trace: Aug 22 06:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 5716.574762] Aug 22 06:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 5716.575666] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 5716.576720] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 5716.577741] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 5716.578830] ? show_regs.part.0+0x23/0x29 Aug 22 06:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 5716.579829] ? show_regs.cold+0x8/0xd Aug 22 06:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 5716.580812] ? watchdog_timer_fn+0x1be/0x220 Aug 22 06:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 5716.581818] ? lockup_detector_update_enable+0x60/0x60 Aug 22 06:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 5716.582884] ? __hrtimer_run_queues+0x107/0x230 Aug 22 06:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 5716.583910] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 06:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 5716.584944] ? hrtimer_interrupt+0x101/0x220 Aug 22 06:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 5716.585958] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 06:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 5716.587031] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 06:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 5716.588094] Aug 22 06:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 5716.588946] Aug 22 06:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 5716.591961] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 06:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 5716.593030] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 5716.594068] ? _raw_spin_lock+0x22/0x30 Aug 22 06:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 5716.595012] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 5716.596046] direct_page_fault+0x206/0x310 [kvm] Aug 22 06:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 5716.597092] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 06:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 5716.598105] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 06:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 5716.599104] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 06:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 5716.600127] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 06:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 5716.601071] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 06:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 5716.602054] handle_exit+0x98/0x230 [kvm_amd] Aug 22 06:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 5716.602946] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 06:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 5716.603858] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 06:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 5716.604802] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 06:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 5716.605704] vcpu_run+0x62/0x2c0 [kvm] Aug 22 06:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 5716.606513] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 06:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 5716.607320] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 06:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 5716.608193] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 06:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 5716.608990] ? __seccomp_filter+0x4a/0x4a0 Aug 22 06:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 5716.609730] ? __fget_files+0x86/0xc0 Aug 22 06:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 5716.610432] __x64_sys_ioctl+0x95/0xd0 Aug 22 06:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 5716.611124] do_syscall_64+0x5c/0xc0 Aug 22 06:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 5716.611792] ? do_futex+0x162/0x1f0 Aug 22 06:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 5716.612458] ? __x64_sys_futex+0x78/0x1e0 Aug 22 06:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 5716.613133] ? __secure_computing+0xa9/0x120 Aug 22 06:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 5716.613827] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 06:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 5716.614585] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 5716.615306] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 5716.616022] ? do_syscall_64+0x69/0xc0 Aug 22 06:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 5716.616711] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 5716.617416] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 5716.618114] ? do_syscall_64+0x69/0xc0 Aug 22 06:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 5716.618737] ? do_syscall_64+0x69/0xc0 Aug 22 06:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 5716.619357] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 06:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 5716.620081] RIP: 0033:0x7faa5d0edaff Aug 22 06:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 5716.620751] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 06:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 5716.622737] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 06:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 5716.623673] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 06:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 5716.624585] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 06:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 5716.625470] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 06:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 5716.626355] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 06:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 5716.627247] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 06:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 5716.628154] Aug 22 06:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 5744.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 5242s! [qemu-system-x86:6715] Aug 22 06:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 5744.543811] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 06:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 5744.544082] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 06:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 5744.556251] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 06:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 5744.557521] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 06:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 5744.558741] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 5744.559835] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 06:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 5744.562388] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 06:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 5744.563429] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 06:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 5744.564600] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 06:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 5744.565774] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 06:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 5744.566962] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 06:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 5744.568153] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 06:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 5744.569338] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 06:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 5744.570586] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 06:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 5744.571686] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 06:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 5744.572908] Call Trace: Aug 22 06:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 5744.573829] Aug 22 06:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 5744.574740] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 5744.575800] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 06:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 5744.576827] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 5744.577925] ? show_regs.part.0+0x23/0x29 Aug 22 06:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 5744.578982] ? show_regs.cold+0x8/0xd Aug 22 06:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 5744.580030] ? watchdog_timer_fn+0x1be/0x220 Aug 22 06:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 5744.581058] ? lockup_detector_update_enable+0x60/0x60 Aug 22 06:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 5744.582122] ? __hrtimer_run_queues+0x107/0x230 Aug 22 06:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 5744.583164] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 06:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 5744.584225] ? hrtimer_interrupt+0x101/0x220 Aug 22 06:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 5744.585257] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 06:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 5744.586370] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 06:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 5744.587417] Aug 22 06:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 5744.588293] Aug 22 06:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 5744.589172] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 06:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 5744.590287] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 5744.591337] ? _raw_spin_lock+0x22/0x30 Aug 22 06:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 5744.592299] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 5744.593323] direct_page_fault+0x206/0x310 [kvm] Aug 22 06:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 5744.594349] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 06:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 5744.595359] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 06:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 5744.596374] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 06:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 5744.597389] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 06:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 5744.598526] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 06:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 5744.599507] handle_exit+0x98/0x230 [kvm_amd] Aug 22 06:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 5744.600560] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 06:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 5744.601479] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 06:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 5744.602405] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 06:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 5744.603312] vcpu_run+0x62/0x2c0 [kvm] Aug 22 06:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 5744.604138] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 06:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 5744.604953] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 06:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 5744.605812] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 06:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 5744.606623] ? __seccomp_filter+0x4a/0x4a0 Aug 22 06:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 5744.607376] ? __fget_files+0x86/0xc0 Aug 22 06:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 5744.608103] __x64_sys_ioctl+0x95/0xd0 Aug 22 06:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 5744.608802] do_syscall_64+0x5c/0xc0 Aug 22 06:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 5744.609472] ? do_futex+0x162/0x1f0 Aug 22 06:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 5744.610130] ? __x64_sys_futex+0x78/0x1e0 Aug 22 06:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 5744.610809] ? __secure_computing+0xa9/0x120 Aug 22 06:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 5744.611503] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 06:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 5744.612283] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 5744.613010] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 5744.613777] ? do_syscall_64+0x69/0xc0 Aug 22 06:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 5744.614431] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 5744.615136] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 5744.615856] ? do_syscall_64+0x69/0xc0 Aug 22 06:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 5744.616487] ? do_syscall_64+0x69/0xc0 Aug 22 06:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 5744.617130] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 06:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 5744.617847] RIP: 0033:0x7faa5d0edaff Aug 22 06:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 5744.618512] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 06:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 5744.620558] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 06:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 5744.621480] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 06:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 5744.622380] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 06:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 5744.623267] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 06:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 5744.624167] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 06:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 5744.625056] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 06:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 5744.625948] Aug 22 06:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 5757.572708] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 06:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 5757.573685] rcu: 1-....: (1405691 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=684557 Aug 22 06:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 5757.574808] (t=1410093 jiffies g=23269 q=14560) Aug 22 06:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 5757.575605] NMI backtrace for cpu 1 Aug 22 06:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 5757.576327] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 06:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 5757.577435] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 06:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 5757.578495] Call Trace: Aug 22 06:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 5757.579173] Aug 22 06:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 5757.579840] show_stack+0x52/0x5c Aug 22 06:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 5757.580663] dump_stack_lvl+0x4a/0x63 Aug 22 06:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 5757.581578] dump_stack+0x10/0x16 Aug 22 06:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 5757.582433] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 06:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 5757.583405] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 06:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 5757.584360] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 06:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 5757.585179] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 06:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 5757.586001] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 06:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 5757.586807] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 06:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 5757.587588] print_cpu_stall.cold+0x2f/0xe2 Aug 22 06:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 5757.588449] ? timekeeping_update+0xf7/0x150 Aug 22 06:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 5757.589314] check_cpu_stall+0x109/0x270 Aug 22 06:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 5757.590136] rcu_sched_clock_irq+0x9a/0x250 Aug 22 06:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 5757.590996] update_process_times+0x94/0xd0 Aug 22 06:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 5757.591868] tick_sched_handle+0x29/0x70 Aug 22 06:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 5757.592711] tick_sched_timer+0x8c/0xc0 Aug 22 06:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 5757.593530] ? tick_nohz_handler+0xb0/0xb0 Aug 22 06:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 5757.594378] __hrtimer_run_queues+0x107/0x230 Aug 22 06:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 5757.595244] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 06:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 5757.596132] hrtimer_interrupt+0x101/0x220 Aug 22 06:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 5757.596983] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 06:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 5757.597959] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 06:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 5757.598869] Aug 22 06:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 5757.599577] Aug 22 06:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 5757.600259] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 06:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 5757.601183] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 06:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 5757.602185] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 06:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 5757.604745] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 06:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 5757.605723] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 06:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 5757.606853] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 06:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 5757.607983] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 06:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 5757.609092] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 06:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 5757.610186] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 06:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 5757.611285] ? _raw_spin_lock+0x22/0x30 Aug 22 06:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 5757.612152] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 06:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 5757.613085] direct_page_fault+0x206/0x310 [kvm] Aug 22 06:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 5757.614019] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 06:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 5757.614940] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 06:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 5757.615875] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 06:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 5757.616778] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 06:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 5757.617659] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 06:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 5757.618591] handle_exit+0x98/0x230 [kvm_amd] Aug 22 06:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 5757.619439] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 06:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 5757.620343] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 06:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 5757.621250] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 06:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 5757.622143] vcpu_run+0x62/0x2c0 [kvm] Aug 22 06:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 5757.622938] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 06:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 5757.623790] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 06:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 5757.624699] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 06:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 5757.625551] ? __seccomp_filter+0x4a/0x4a0 Aug 22 06:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 5757.626356] ? __fget_files+0x86/0xc0 Aug 22 06:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 5757.627133] __x64_sys_ioctl+0x95/0xd0 Aug 22 06:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 5757.627920] do_syscall_64+0x5c/0xc0 Aug 22 06:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 5757.628679] ? do_futex+0x162/0x1f0 Aug 22 06:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 5757.629431] ? __x64_sys_futex+0x78/0x1e0 Aug 22 06:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 5757.630215] ? __secure_computing+0xa9/0x120 Aug 22 06:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 5757.631021] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 06:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 5757.631948] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 5757.632845] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 5757.633886] ? do_syscall_64+0x69/0xc0 Aug 22 06:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 5757.634814] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 06:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 5757.635835] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 06:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 5757.636664] ? do_syscall_64+0x69/0xc0 Aug 22 06:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 5757.637361] ? do_syscall_64+0x69/0xc0 Aug 22 06:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 5757.638051] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 06:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 5757.638829] RIP: 0033:0x7faa5d0edaff Aug 22 06:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 5757.639517] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 06:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 5757.641878] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 06:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 5757.643209] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 06:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 5757.644235] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 06:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 5757.645185] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 06:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 5757.646130] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 06:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 5757.647055] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 06:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 5757.647986] Aug 22 07:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 5784.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 5279s! [qemu-system-x86:6715] Aug 22 07:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 5784.543881] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 07:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 5784.544192] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 07:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 5784.556536] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 07:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 5784.557802] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 07:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 5784.559018] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 5784.560083] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 07:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 5784.562626] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 07:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 5784.563680] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 07:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 5784.564844] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 07:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 5784.566002] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 07:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 5784.567164] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 07:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 5784.568358] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 07:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 5784.569548] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 07:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 5784.570785] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 07:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 5784.571901] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 07:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 5784.573099] Call Trace: Aug 22 07:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 5784.574020] Aug 22 07:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 5784.574930] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 5784.576182] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 5784.577203] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 5784.578301] ? show_regs.part.0+0x23/0x29 Aug 22 07:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 5784.579322] ? show_regs.cold+0x8/0xd Aug 22 07:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 5784.580292] ? watchdog_timer_fn+0x1be/0x220 Aug 22 07:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 5784.581302] ? lockup_detector_update_enable+0x60/0x60 Aug 22 07:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 5784.582381] ? __hrtimer_run_queues+0x107/0x230 Aug 22 07:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 5784.583426] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 07:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 5784.584448] ? hrtimer_interrupt+0x101/0x220 Aug 22 07:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 5784.585598] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 07:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 5784.586792] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 07:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 5784.588008] Aug 22 07:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 5784.589708] Aug 22 07:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 5784.590590] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 07:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 5784.591752] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 5784.592893] ? _raw_spin_lock+0x22/0x30 Aug 22 07:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 5784.593911] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 5784.595019] direct_page_fault+0x206/0x310 [kvm] Aug 22 07:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 5784.596150] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 07:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 5784.597248] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 07:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 5784.598336] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 07:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 5784.599455] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 07:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 5784.600494] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 07:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 5784.601586] handle_exit+0x98/0x230 [kvm_amd] Aug 22 07:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 5784.602567] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 07:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 5784.603589] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 07:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 5784.604703] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 07:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 5784.605615] vcpu_run+0x62/0x2c0 [kvm] Aug 22 07:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 5784.606464] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 07:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 5784.607323] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 07:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 5784.608186] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 07:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 5784.608984] ? __seccomp_filter+0x4a/0x4a0 Aug 22 07:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 5784.609727] ? __fget_files+0x86/0xc0 Aug 22 07:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 5784.610459] __x64_sys_ioctl+0x95/0xd0 Aug 22 07:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 5784.611154] do_syscall_64+0x5c/0xc0 Aug 22 07:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 5784.611834] ? do_futex+0x162/0x1f0 Aug 22 07:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 5784.612515] ? __x64_sys_futex+0x78/0x1e0 Aug 22 07:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 5784.613189] ? __secure_computing+0xa9/0x120 Aug 22 07:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 5784.613880] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 07:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 5784.614645] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 5784.615381] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 5784.616118] ? do_syscall_64+0x69/0xc0 Aug 22 07:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 5784.616773] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 5784.617486] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 5784.618179] ? do_syscall_64+0x69/0xc0 Aug 22 07:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 5784.618801] ? do_syscall_64+0x69/0xc0 Aug 22 07:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 5784.619430] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 07:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 5784.620134] RIP: 0033:0x7faa5d0edaff Aug 22 07:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 5784.620794] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 07:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 5784.622778] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 07:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 5784.623695] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 07:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 5784.624584] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 07:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 5784.625474] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 07:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 5784.626359] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 07:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 5784.627276] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 07:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 5784.628170] Aug 22 07:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 5812.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 5305s! [qemu-system-x86:6715] Aug 22 07:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 5812.543961] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 07:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 5812.544187] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 07:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 5812.557645] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 07:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 5812.558941] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 07:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 5812.560165] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 5812.561222] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 07:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 5812.565010] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 07:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 5812.566420] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 07:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 5812.567902] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 07:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 5812.569463] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 07:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 5812.571042] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 07:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 5812.572564] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 07:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 5812.573936] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 07:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 5812.575418] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 07:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 5812.576686] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 07:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 5812.577894] Call Trace: Aug 22 07:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 5812.578822] Aug 22 07:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 5812.579744] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 5812.580775] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 5812.581803] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 5812.582925] ? show_regs.part.0+0x23/0x29 Aug 22 07:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 5812.583935] ? show_regs.cold+0x8/0xd Aug 22 07:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 5812.584917] ? watchdog_timer_fn+0x1be/0x220 Aug 22 07:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 5812.585936] ? lockup_detector_update_enable+0x60/0x60 Aug 22 07:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 5812.587019] ? __hrtimer_run_queues+0x107/0x230 Aug 22 07:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 5812.588055] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 07:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 5812.589080] ? hrtimer_interrupt+0x101/0x220 Aug 22 07:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 5812.590098] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 07:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 5812.591188] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 07:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 5812.592251] Aug 22 07:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 5812.593109] Aug 22 07:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 5812.593949] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 07:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 5812.595026] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 5812.596076] ? _raw_spin_lock+0x22/0x30 Aug 22 07:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 5812.597023] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 5812.598326] direct_page_fault+0x206/0x310 [kvm] Aug 22 07:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 5812.599791] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 07:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 5812.600845] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 07:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 5812.601872] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 07:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 5812.602899] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 07:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 5812.603852] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 07:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 5812.604855] handle_exit+0x98/0x230 [kvm_amd] Aug 22 07:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 5812.605784] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 07:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 5812.606715] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 07:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 5812.607677] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 07:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 5812.608615] vcpu_run+0x62/0x2c0 [kvm] Aug 22 07:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 5812.609447] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 07:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 5812.610266] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 07:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 5812.611169] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 07:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 5812.611985] ? __seccomp_filter+0x4a/0x4a0 Aug 22 07:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 5812.612741] ? __fget_files+0x86/0xc0 Aug 22 07:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 5812.613452] __x64_sys_ioctl+0x95/0xd0 Aug 22 07:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 5812.614153] do_syscall_64+0x5c/0xc0 Aug 22 07:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 5812.614847] ? do_futex+0x162/0x1f0 Aug 22 07:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 5812.615546] ? __x64_sys_futex+0x78/0x1e0 Aug 22 07:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 5812.616229] ? __secure_computing+0xa9/0x120 Aug 22 07:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 5812.616926] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 07:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 5812.617695] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 5812.618422] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 5812.619161] ? do_syscall_64+0x69/0xc0 Aug 22 07:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 5812.619814] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 5812.620521] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 5812.621217] ? do_syscall_64+0x69/0xc0 Aug 22 07:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 5812.621858] ? do_syscall_64+0x69/0xc0 Aug 22 07:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 5812.622492] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 07:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 5812.623223] RIP: 0033:0x7faa5d0edaff Aug 22 07:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 5812.623890] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 07:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 5812.625868] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 07:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 5812.626783] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 07:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 5812.627694] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 07:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 5812.628581] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 07:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 5812.629467] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 07:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 5812.630353] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 07:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 5812.631269] Aug 22 07:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 5840.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 5331s! [qemu-system-x86:6715] Aug 22 07:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 5840.543679] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 07:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 5840.543880] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 07:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 5840.555971] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 07:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 5840.557240] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 07:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 5840.558461] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 5840.559533] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 07:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 5840.562091] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 07:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 5840.563149] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 07:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 5840.564318] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 07:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 5840.565478] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 07:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 5840.566658] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 07:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 5840.567825] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 07:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 5840.568999] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 07:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 5840.570232] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 07:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 5840.571370] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 07:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 5840.572570] Call Trace: Aug 22 07:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 5840.573488] Aug 22 07:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 5840.574370] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 5840.575408] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 5840.576432] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 5840.577507] ? show_regs.part.0+0x23/0x29 Aug 22 07:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 5840.578502] ? show_regs.cold+0x8/0xd Aug 22 07:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 5840.579487] ? watchdog_timer_fn+0x1be/0x220 Aug 22 07:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 5840.580494] ? lockup_detector_update_enable+0x60/0x60 Aug 22 07:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 5840.581554] ? __hrtimer_run_queues+0x107/0x230 Aug 22 07:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 5840.582662] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 07:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 5840.583684] ? hrtimer_interrupt+0x101/0x220 Aug 22 07:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 5840.584717] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 07:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 5840.585811] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 07:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 5840.586875] Aug 22 07:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 5840.587731] Aug 22 07:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 5840.588567] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 07:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 5840.589603] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 5840.590650] ? _raw_spin_lock+0x22/0x30 Aug 22 07:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 5840.591597] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 5840.592616] direct_page_fault+0x206/0x310 [kvm] Aug 22 07:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 5840.593642] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 07:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 5840.594668] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 07:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 5840.595677] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 07:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 5840.596653] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 07:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 5840.597600] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 07:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 5840.598593] handle_exit+0x98/0x230 [kvm_amd] Aug 22 07:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 5840.599490] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 07:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 5840.600401] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 07:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 5840.601325] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 07:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 5840.602225] vcpu_run+0x62/0x2c0 [kvm] Aug 22 07:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 5840.603047] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 07:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 5840.603852] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 07:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 5840.604702] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 07:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 5840.605495] ? __seccomp_filter+0x4a/0x4a0 Aug 22 07:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 5840.606234] ? __fget_files+0x86/0xc0 Aug 22 07:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 5840.606949] __x64_sys_ioctl+0x95/0xd0 Aug 22 07:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 5840.607641] do_syscall_64+0x5c/0xc0 Aug 22 07:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 5840.608307] ? do_futex+0x162/0x1f0 Aug 22 07:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 5840.608953] ? __x64_sys_futex+0x78/0x1e0 Aug 22 07:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 5840.609624] ? __secure_computing+0xa9/0x120 Aug 22 07:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 5840.610311] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 07:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 5840.611088] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 5840.611812] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 5840.612526] ? do_syscall_64+0x69/0xc0 Aug 22 07:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 5840.613174] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 5840.613880] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 5840.614597] ? do_syscall_64+0x69/0xc0 Aug 22 07:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 5840.615228] ? do_syscall_64+0x69/0xc0 Aug 22 07:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 5840.615853] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 07:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 5840.616555] RIP: 0033:0x7faa5d0edaff Aug 22 07:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 5840.617181] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 07:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 5840.619173] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 07:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 5840.620088] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 07:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 5840.620979] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 07:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 5840.621868] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 07:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 5840.622768] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 07:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 5840.623654] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 07:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 5840.624543] Aug 22 07:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 5868.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 5357s! [qemu-system-x86:6715] Aug 22 07:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 5868.543913] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 07:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 5868.544167] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 07:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 5868.556393] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 07:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 5868.557673] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 07:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 5868.558915] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 5868.559970] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 07:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 5868.562541] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 07:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 5868.563584] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 07:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 5868.564745] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 07:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 5868.565907] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 07:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 5868.567083] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 07:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 5868.568250] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 07:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 5868.569419] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 07:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 5868.570765] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 07:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 5868.571910] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 07:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 5868.573105] Call Trace: Aug 22 07:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 5868.574023] Aug 22 07:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 5868.574940] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 5868.575969] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 5868.576991] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 5868.578081] ? show_regs.part.0+0x23/0x29 Aug 22 07:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 5868.579090] ? show_regs.cold+0x8/0xd Aug 22 07:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 5868.580060] ? watchdog_timer_fn+0x1be/0x220 Aug 22 07:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 5868.581066] ? lockup_detector_update_enable+0x60/0x60 Aug 22 07:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 5868.582126] ? __hrtimer_run_queues+0x107/0x230 Aug 22 07:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 5868.583159] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 07:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 5868.584186] ? hrtimer_interrupt+0x101/0x220 Aug 22 07:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 5868.585199] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 07:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 5868.586284] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 07:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 5868.587328] Aug 22 07:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 5868.588180] Aug 22 07:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 5868.589024] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 07:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 5868.590061] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 5868.591108] ? _raw_spin_lock+0x22/0x30 Aug 22 07:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 5868.592052] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 5868.593076] direct_page_fault+0x206/0x310 [kvm] Aug 22 07:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 5868.594111] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 07:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 5868.595137] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 07:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 5868.596143] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 07:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 5868.597142] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 07:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 5868.598111] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 07:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 5868.599123] handle_exit+0x98/0x230 [kvm_amd] Aug 22 07:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 5868.600018] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 07:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 5868.600931] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 07:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 5868.601854] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 07:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 5868.602771] vcpu_run+0x62/0x2c0 [kvm] Aug 22 07:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 5868.603581] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 07:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 5868.604387] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 07:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 5868.605242] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 07:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 5868.606037] ? __seccomp_filter+0x4a/0x4a0 Aug 22 07:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 5868.606792] ? __fget_files+0x86/0xc0 Aug 22 07:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 5868.607494] __x64_sys_ioctl+0x95/0xd0 Aug 22 07:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 5868.608187] do_syscall_64+0x5c/0xc0 Aug 22 07:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 5868.608855] ? do_futex+0x162/0x1f0 Aug 22 07:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 5868.609504] ? __x64_sys_futex+0x78/0x1e0 Aug 22 07:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 5868.610178] ? __secure_computing+0xa9/0x120 Aug 22 07:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 5868.610875] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 07:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 5868.611634] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 5868.612361] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 5868.613078] ? do_syscall_64+0x69/0xc0 Aug 22 07:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 5868.613723] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 5868.614457] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 5868.615166] ? do_syscall_64+0x69/0xc0 Aug 22 07:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 5868.615794] ? do_syscall_64+0x69/0xc0 Aug 22 07:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 5868.616416] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 07:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 5868.617124] RIP: 0033:0x7faa5d0edaff Aug 22 07:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 5868.617766] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 07:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 5868.619767] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 07:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 5868.620679] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 07:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 5868.621574] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 07:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 5868.622476] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 07:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 5868.623402] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 07:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 5868.624329] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 07:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 5868.625270] Aug 22 07:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 5896.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 5383s! [qemu-system-x86:6715] Aug 22 07:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 5896.543138] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 07:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 5896.543209] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 07:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 5896.555291] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 07:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 5896.556558] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 07:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 5896.557779] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 5896.558849] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 07:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 5896.561388] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 07:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 5896.562436] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 07:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 5896.563596] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 07:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 5896.564751] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 07:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 5896.565916] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 07:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 5896.567075] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 07:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 5896.568236] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 07:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 5896.569465] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 07:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 5896.570566] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 07:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 5896.571757] Call Trace: Aug 22 07:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 5896.572673] Aug 22 07:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 5896.573562] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 5896.574601] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 5896.575625] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 5896.576698] ? show_regs.part.0+0x23/0x29 Aug 22 07:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 5896.577692] ? show_regs.cold+0x8/0xd Aug 22 07:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 5896.578679] ? watchdog_timer_fn+0x1be/0x220 Aug 22 07:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 5896.579689] ? lockup_detector_update_enable+0x60/0x60 Aug 22 07:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 5896.580752] ? __hrtimer_run_queues+0x107/0x230 Aug 22 07:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 5896.581782] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 07:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 5896.582810] ? hrtimer_interrupt+0x101/0x220 Aug 22 07:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 5896.583821] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 07:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 5896.584884] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 07:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 5896.585935] Aug 22 07:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 5896.586793] Aug 22 07:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 5896.587627] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 07:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 5896.588655] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 5896.589689] ? _raw_spin_lock+0x22/0x30 Aug 22 07:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 5896.590634] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 5896.591650] direct_page_fault+0x206/0x310 [kvm] Aug 22 07:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 5896.592674] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 07:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 5896.593685] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 07:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 5896.594694] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 07:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 5896.595665] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 07:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 5896.596605] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 07:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 5896.597585] handle_exit+0x98/0x230 [kvm_amd] Aug 22 07:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 5896.598482] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 07:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 5896.599399] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 07:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 5896.600327] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 07:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 5896.601227] vcpu_run+0x62/0x2c0 [kvm] Aug 22 07:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 5896.602058] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 07:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 5896.602868] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 07:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 5896.603716] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 07:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 5896.604550] ? __seccomp_filter+0x4a/0x4a0 Aug 22 07:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 5896.605349] ? __fget_files+0x86/0xc0 Aug 22 07:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 5896.606087] __x64_sys_ioctl+0x95/0xd0 Aug 22 07:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 5896.606801] do_syscall_64+0x5c/0xc0 Aug 22 07:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 5896.607485] ? do_futex+0x162/0x1f0 Aug 22 07:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 5896.608142] ? __x64_sys_futex+0x78/0x1e0 Aug 22 07:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 5896.608825] ? __secure_computing+0xa9/0x120 Aug 22 07:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 5896.609521] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 07:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 5896.610316] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 5896.611038] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 5896.611781] ? do_syscall_64+0x69/0xc0 Aug 22 07:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 5896.612450] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 5896.613152] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 5896.613873] ? do_syscall_64+0x69/0xc0 Aug 22 07:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 5896.614495] ? do_syscall_64+0x69/0xc0 Aug 22 07:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 5896.615114] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 07:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 5896.615826] RIP: 0033:0x7faa5d0edaff Aug 22 07:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 5896.616463] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 07:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 5896.618503] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 07:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 5896.619420] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 07:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 5896.620309] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 07:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 5896.621214] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 07:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 5896.622138] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 07:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 5896.623036] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 07:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 5896.623951] Aug 22 07:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 5924.541976] watchdog: BUG: soft lockup - CPU#1 stuck for 5409s! [qemu-system-x86:6715] Aug 22 07:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 5924.543682] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 07:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 5924.543935] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 07:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 5924.556366] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 07:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 5924.557645] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 07:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 5924.558862] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 5924.559926] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 07:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 5924.562502] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 07:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 5924.563548] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 07:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 5924.564717] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 07:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 5924.565889] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 07:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 5924.567047] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 07:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 5924.568208] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 07:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 5924.569495] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 07:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 5924.570771] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 07:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 5924.571866] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 07:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 5924.573059] Call Trace: Aug 22 07:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 5924.573997] Aug 22 07:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 5924.574899] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 5924.575934] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 5924.576954] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 5924.578062] ? show_regs.part.0+0x23/0x29 Aug 22 07:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 5924.579064] ? show_regs.cold+0x8/0xd Aug 22 07:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 5924.580045] ? watchdog_timer_fn+0x1be/0x220 Aug 22 07:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 5924.581054] ? lockup_detector_update_enable+0x60/0x60 Aug 22 07:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 5924.582128] ? __hrtimer_run_queues+0x107/0x230 Aug 22 07:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 5924.583161] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 07:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 5924.584184] ? hrtimer_interrupt+0x101/0x220 Aug 22 07:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 5924.585207] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 07:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 5924.586294] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 07:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 5924.587338] Aug 22 07:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 5924.588191] Aug 22 07:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 5924.589032] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 07:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 5924.590090] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 5924.591152] ? _raw_spin_lock+0x22/0x30 Aug 22 07:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 5924.592100] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 5924.593114] direct_page_fault+0x206/0x310 [kvm] Aug 22 07:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 5924.594156] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 07:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 5924.595160] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 07:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 5924.596168] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 07:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 5924.597154] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 07:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 5924.598155] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 07:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 5924.599152] handle_exit+0x98/0x230 [kvm_amd] Aug 22 07:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 5924.600075] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 07:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 5924.601006] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 07:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 5924.601963] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 07:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 5924.602872] vcpu_run+0x62/0x2c0 [kvm] Aug 22 07:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 5924.603680] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 07:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 5924.604486] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 07:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 5924.605342] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 07:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 5924.606162] ? __seccomp_filter+0x4a/0x4a0 Aug 22 07:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 5924.606903] ? __fget_files+0x86/0xc0 Aug 22 07:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 5924.607610] __x64_sys_ioctl+0x95/0xd0 Aug 22 07:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 5924.608300] do_syscall_64+0x5c/0xc0 Aug 22 07:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 5924.608962] ? do_futex+0x162/0x1f0 Aug 22 07:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 5924.609631] ? __x64_sys_futex+0x78/0x1e0 Aug 22 07:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 5924.610301] ? __secure_computing+0xa9/0x120 Aug 22 07:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 5924.610988] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 07:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 5924.611757] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 5924.612477] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 5924.613199] ? do_syscall_64+0x69/0xc0 Aug 22 07:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 5924.613862] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 5924.614563] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 5924.615255] ? do_syscall_64+0x69/0xc0 Aug 22 07:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 5924.615876] ? do_syscall_64+0x69/0xc0 Aug 22 07:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 5924.616514] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 07:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 5924.617224] RIP: 0033:0x7faa5d0edaff Aug 22 07:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 5924.617886] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 07:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 5924.619877] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 07:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 5924.620791] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 07:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 5924.621707] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 07:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 5924.622599] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 07:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 5924.623489] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 07:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 5924.624376] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 07:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 5924.625269] Aug 22 07:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 5937.584709] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 07:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 5937.585653] rcu: 1-....: (1450555 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=706396 Aug 22 07:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 5937.586763] (t=1455096 jiffies g=23269 q=14726) Aug 22 07:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 5937.587556] NMI backtrace for cpu 1 Aug 22 07:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 5937.588264] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 07:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 5937.589376] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 07:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 5937.590430] Call Trace: Aug 22 07:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 5937.591102] Aug 22 07:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 5937.591742] show_stack+0x52/0x5c Aug 22 07:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 5937.592510] dump_stack_lvl+0x4a/0x63 Aug 22 07:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 5937.593271] dump_stack+0x10/0x16 Aug 22 07:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 5937.594005] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 07:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 5937.594784] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 07:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 5937.595577] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 07:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 5937.596402] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 07:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 5937.597225] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 07:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 5937.598049] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 07:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 5937.598819] print_cpu_stall.cold+0x2f/0xe2 Aug 22 07:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 5937.599579] ? timekeeping_update+0xf7/0x150 Aug 22 07:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 5937.600369] check_cpu_stall+0x109/0x270 Aug 22 07:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 5937.601120] rcu_sched_clock_irq+0x9a/0x250 Aug 22 07:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 5937.601907] update_process_times+0x94/0xd0 Aug 22 07:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 5937.602688] tick_sched_handle+0x29/0x70 Aug 22 07:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 5937.603449] tick_sched_timer+0x8c/0xc0 Aug 22 07:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 5937.604184] ? tick_nohz_handler+0xb0/0xb0 Aug 22 07:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 5937.604965] __hrtimer_run_queues+0x107/0x230 Aug 22 07:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 5937.605760] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 07:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 5937.606537] hrtimer_interrupt+0x101/0x220 Aug 22 07:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 5937.607296] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 07:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 5937.608106] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 07:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 5937.608910] Aug 22 07:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 5937.609583] Aug 22 07:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 5937.610222] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 07:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 5937.611046] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 5937.611932] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 07:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 5937.614240] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 07:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 5937.615124] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 07:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 5937.616140] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 07:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 5937.617153] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 07:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 5937.618152] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 07:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 5937.619115] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 07:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 5937.620071] ? _raw_spin_lock+0x22/0x30 Aug 22 07:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 5937.620853] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 5937.621711] direct_page_fault+0x206/0x310 [kvm] Aug 22 07:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 5937.622554] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 07:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 5937.623397] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 07:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 5937.624241] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 07:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 5937.625085] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 07:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 5937.625898] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 07:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 5937.626717] handle_exit+0x98/0x230 [kvm_amd] Aug 22 07:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 5937.627561] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 07:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 5937.628409] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 07:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 5937.629293] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 07:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 5937.630406] vcpu_run+0x62/0x2c0 [kvm] Aug 22 07:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 5937.631311] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 07:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 5937.632077] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 07:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 5937.632922] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 07:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 5937.633834] ? __seccomp_filter+0x4a/0x4a0 Aug 22 07:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 5937.634667] ? __fget_files+0x86/0xc0 Aug 22 07:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 5937.635445] __x64_sys_ioctl+0x95/0xd0 Aug 22 07:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 5937.636222] do_syscall_64+0x5c/0xc0 Aug 22 07:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 5937.637006] ? do_futex+0x162/0x1f0 Aug 22 07:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 5937.637779] ? __x64_sys_futex+0x78/0x1e0 Aug 22 07:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 5937.638619] ? __secure_computing+0xa9/0x120 Aug 22 07:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 5937.639443] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 07:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 5937.640237] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 5937.641191] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 5937.642125] ? do_syscall_64+0x69/0xc0 Aug 22 07:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 5937.642854] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 5937.643694] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 5937.644588] ? do_syscall_64+0x69/0xc0 Aug 22 07:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 5937.645398] ? do_syscall_64+0x69/0xc0 Aug 22 07:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 5937.646095] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 07:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 5937.646891] RIP: 0033:0x7faa5d0edaff Aug 22 07:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 5937.647575] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 07:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 5937.649691] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 07:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 5937.650661] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 07:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 5937.651610] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 07:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 5937.652555] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 07:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 5937.653520] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 07:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 5937.654475] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 07:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 5937.655413] Aug 22 07:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 5964.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 5446s! [qemu-system-x86:6715] Aug 22 07:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 5964.543753] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 07:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 5964.544008] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 07:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 5964.556155] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 07:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 5964.557440] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 07:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 5964.558661] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 5964.559892] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 07:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 5964.562541] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 07:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 5964.563583] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 07:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 5964.564746] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 07:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 5964.565928] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 07:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 5964.567086] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 07:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 5964.568246] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 07:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 5964.569430] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 07:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 5964.570664] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 07:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 5964.571760] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 07:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 5964.572953] Call Trace: Aug 22 07:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 5964.573916] Aug 22 07:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 5964.574845] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 5964.575879] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 5964.576905] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 5964.578014] ? show_regs.part.0+0x23/0x29 Aug 22 07:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 5964.579010] ? show_regs.cold+0x8/0xd Aug 22 07:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 5964.579981] ? watchdog_timer_fn+0x1be/0x220 Aug 22 07:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 5964.580988] ? lockup_detector_update_enable+0x60/0x60 Aug 22 07:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 5964.582126] ? __hrtimer_run_queues+0x107/0x230 Aug 22 07:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 5964.583152] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 07:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 5964.584172] ? hrtimer_interrupt+0x101/0x220 Aug 22 07:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 5964.585211] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 07:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 5964.586283] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 07:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 5964.587326] Aug 22 07:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 5964.588178] Aug 22 07:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 5964.589031] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 07:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 5964.590064] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 5964.591104] ? _raw_spin_lock+0x22/0x30 Aug 22 07:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 5964.592053] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 5964.593088] direct_page_fault+0x206/0x310 [kvm] Aug 22 07:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 5964.594111] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 07:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 5964.595125] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 07:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 5964.596128] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 07:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 5964.597148] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 07:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 5964.598093] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 07:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 5964.599113] handle_exit+0x98/0x230 [kvm_amd] Aug 22 07:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 5964.600065] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 07:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 5964.601078] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 07:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 5964.602082] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 07:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 5964.603048] vcpu_run+0x62/0x2c0 [kvm] Aug 22 07:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 5964.603910] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 07:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 5964.604758] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 07:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 5964.605688] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 07:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 5964.606531] ? __seccomp_filter+0x4a/0x4a0 Aug 22 07:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 5964.607322] ? __fget_files+0x86/0xc0 Aug 22 07:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 5964.608081] __x64_sys_ioctl+0x95/0xd0 Aug 22 07:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 5964.608799] do_syscall_64+0x5c/0xc0 Aug 22 07:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 5964.609531] ? do_futex+0x162/0x1f0 Aug 22 07:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 5964.610218] ? __x64_sys_futex+0x78/0x1e0 Aug 22 07:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 5964.610942] ? __secure_computing+0xa9/0x120 Aug 22 07:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 5964.611676] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 07:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 5964.612486] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 5964.613270] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 5964.614043] ? do_syscall_64+0x69/0xc0 Aug 22 07:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 5964.614746] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 5964.615495] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 5964.616233] ? do_syscall_64+0x69/0xc0 Aug 22 07:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 5964.616923] ? do_syscall_64+0x69/0xc0 Aug 22 07:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 5964.617618] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 07:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 5964.618366] RIP: 0033:0x7faa5d0edaff Aug 22 07:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 5964.619091] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 07:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 5964.621225] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 07:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 5964.622186] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 07:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 5964.623166] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 07:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 5964.624116] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 07:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 5964.625084] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 07:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 5964.626056] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 07:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 5964.627004] Aug 22 07:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 5992.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 5472s! [qemu-system-x86:6715] Aug 22 07:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 5992.543116] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 07:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 5992.543189] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 07:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 5992.555279] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 07:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 5992.556547] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 07:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 5992.557784] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 5992.558847] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 07:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 5992.561413] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 07:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 5992.562456] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 07:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 5992.563618] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 07:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 5992.564793] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 07:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 5992.565959] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 07:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 5992.567119] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 07:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 5992.568284] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 07:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 5992.569549] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 07:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 5992.570650] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 07:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 5992.571841] Call Trace: Aug 22 07:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 5992.572765] Aug 22 07:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 5992.573649] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 5992.574684] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 5992.575709] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 5992.576797] ? show_regs.part.0+0x23/0x29 Aug 22 07:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 5992.577794] ? show_regs.cold+0x8/0xd Aug 22 07:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 5992.578765] ? watchdog_timer_fn+0x1be/0x220 Aug 22 07:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 5992.579771] ? lockup_detector_update_enable+0x60/0x60 Aug 22 07:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 5992.580844] ? __hrtimer_run_queues+0x107/0x230 Aug 22 07:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 5992.581872] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 07:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 5992.582901] ? hrtimer_interrupt+0x101/0x220 Aug 22 07:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 5992.583921] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 07:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 5992.585010] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 07:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 5992.586059] Aug 22 07:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 5992.586910] Aug 22 07:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 5992.587750] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 07:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 5992.588799] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 5992.589838] ? _raw_spin_lock+0x22/0x30 Aug 22 07:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 5992.590786] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 5992.591801] direct_page_fault+0x206/0x310 [kvm] Aug 22 07:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 5992.592837] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 07:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 5992.593850] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 07:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 5992.594849] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 07:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 5992.595818] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 07:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 5992.596775] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 07:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 5992.597753] handle_exit+0x98/0x230 [kvm_amd] Aug 22 07:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 5992.598646] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 07:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 5992.599565] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 07:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 5992.600489] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 07:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 5992.601411] vcpu_run+0x62/0x2c0 [kvm] Aug 22 07:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 5992.602222] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 07:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 5992.603029] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 07:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 5992.603885] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 07:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 5992.604710] ? __seccomp_filter+0x4a/0x4a0 Aug 22 07:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 5992.605455] ? __fget_files+0x86/0xc0 Aug 22 07:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 5992.606158] __x64_sys_ioctl+0x95/0xd0 Aug 22 07:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 5992.606851] do_syscall_64+0x5c/0xc0 Aug 22 07:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 5992.607517] ? do_futex+0x162/0x1f0 Aug 22 07:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 5992.608167] ? __x64_sys_futex+0x78/0x1e0 Aug 22 07:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 5992.608856] ? __secure_computing+0xa9/0x120 Aug 22 07:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 5992.609553] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 07:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 5992.610314] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 5992.611036] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 5992.611757] ? do_syscall_64+0x69/0xc0 Aug 22 07:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 5992.612408] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 5992.613122] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 5992.613819] ? do_syscall_64+0x69/0xc0 Aug 22 07:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 5992.614445] ? do_syscall_64+0x69/0xc0 Aug 22 07:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 5992.615069] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 07:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 5992.615780] RIP: 0033:0x7faa5d0edaff Aug 22 07:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 5992.616405] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 07:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 5992.618404] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 07:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 5992.619320] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 07:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 5992.620211] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 07:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 5992.621126] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 07:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 5992.622023] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 07:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 5992.622912] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 07:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 5992.623806] Aug 22 07:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 6020.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 5499s! [qemu-system-x86:6715] Aug 22 07:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 6020.543186] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 07:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 6020.543326] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 07:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 6020.555464] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 07:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 6020.556743] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 07:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 6020.558001] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 6020.559057] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 07:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 6020.561608] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 07:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 6020.562649] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 07:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 6020.563812] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 07:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 6020.564985] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 07:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 6020.566141] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 07:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 6020.567316] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 07:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 6020.568524] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 07:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 6020.569759] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 07:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 6020.570851] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 07:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 6020.572040] Call Trace: Aug 22 07:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 6020.572958] Aug 22 07:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 6020.573847] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 6020.574876] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 6020.575896] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 6020.577005] ? show_regs.part.0+0x23/0x29 Aug 22 07:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 6020.578006] ? show_regs.cold+0x8/0xd Aug 22 07:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 6020.578975] ? watchdog_timer_fn+0x1be/0x220 Aug 22 07:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 6020.579987] ? lockup_detector_update_enable+0x60/0x60 Aug 22 07:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 6020.581055] ? __hrtimer_run_queues+0x107/0x230 Aug 22 07:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 6020.582088] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 07:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 6020.583115] ? hrtimer_interrupt+0x101/0x220 Aug 22 07:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 6020.584213] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 07:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 6020.585432] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 07:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 6020.586477] Aug 22 07:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 6020.587361] Aug 22 07:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 6020.588221] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 07:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 6020.589291] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 6020.590327] ? _raw_spin_lock+0x22/0x30 Aug 22 07:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 6020.591269] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 6020.592310] direct_page_fault+0x206/0x310 [kvm] Aug 22 07:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 6020.593351] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 07:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 6020.594358] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 07:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 6020.595355] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 07:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 6020.596360] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 07:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 6020.597310] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 07:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 6020.598283] handle_exit+0x98/0x230 [kvm_amd] Aug 22 07:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 6020.599177] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 07:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 6020.600087] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 07:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 6020.601016] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 07:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 6020.601917] vcpu_run+0x62/0x2c0 [kvm] Aug 22 07:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 6020.602748] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 07:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 6020.603561] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 07:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 6020.604443] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 07:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 6020.605246] ? __seccomp_filter+0x4a/0x4a0 Aug 22 07:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 6020.605987] ? __fget_files+0x86/0xc0 Aug 22 07:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 6020.606694] __x64_sys_ioctl+0x95/0xd0 Aug 22 07:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 6020.607385] do_syscall_64+0x5c/0xc0 Aug 22 07:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 6020.608050] ? do_futex+0x162/0x1f0 Aug 22 07:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 6020.608714] ? __x64_sys_futex+0x78/0x1e0 Aug 22 07:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 6020.609387] ? __secure_computing+0xa9/0x120 Aug 22 07:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 6020.610075] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 07:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 6020.610838] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 6020.611557] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 6020.612274] ? do_syscall_64+0x69/0xc0 Aug 22 07:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 6020.612929] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 6020.613630] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 6020.614323] ? do_syscall_64+0x69/0xc0 Aug 22 07:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 6020.614951] ? do_syscall_64+0x69/0xc0 Aug 22 07:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 6020.615571] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 07:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 6020.616274] RIP: 0033:0x7faa5d0edaff Aug 22 07:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 6020.616926] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 07:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 6020.618933] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 07:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 6020.619842] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 07:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 6020.620747] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 07:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 6020.621633] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 07:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 6020.622518] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 07:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 6020.623403] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 07:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 6020.624297] Aug 22 07:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 6048.541983] watchdog: BUG: soft lockup - CPU#1 stuck for 5525s! [qemu-system-x86:6715] Aug 22 07:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 6048.543774] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 07:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 6048.544012] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 07:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 6048.556275] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 07:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 6048.557546] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 07:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 6048.558770] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 6048.559831] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 07:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 6048.562402] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 07:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 6048.563445] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 07:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 6048.564628] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 07:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 6048.565794] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 07:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 6048.566959] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 07:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 6048.568136] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 07:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 6048.569310] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 07:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 6048.570548] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 07:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 6048.571651] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 07:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 6048.572870] Call Trace: Aug 22 07:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 6048.573807] Aug 22 07:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 6048.574729] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 6048.575771] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 6048.577230] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 6048.578956] ? show_regs.part.0+0x23/0x29 Aug 22 07:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 6048.580573] ? show_regs.cold+0x8/0xd Aug 22 07:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 6048.581615] ? watchdog_timer_fn+0x1be/0x220 Aug 22 07:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 6048.582645] ? lockup_detector_update_enable+0x60/0x60 Aug 22 07:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 6048.583715] ? __hrtimer_run_queues+0x107/0x230 Aug 22 07:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 6048.584770] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 07:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 6048.585802] ? hrtimer_interrupt+0x101/0x220 Aug 22 07:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 6048.587245] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 07:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 6048.588973] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 07:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 6048.590570] Aug 22 07:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 6048.591449] Aug 22 07:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 6048.592350] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 07:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 6048.593437] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 6048.594527] ? _raw_spin_lock+0x22/0x30 Aug 22 07:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 6048.595503] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 6048.596575] direct_page_fault+0x206/0x310 [kvm] Aug 22 07:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 6048.597621] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 07:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 6048.598829] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 07:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 6048.599861] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 07:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 6048.600905] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 07:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 6048.601861] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 07:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 6048.602920] handle_exit+0x98/0x230 [kvm_amd] Aug 22 07:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 6048.604026] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 07:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 6048.604968] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 07:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 6048.605908] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 07:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 6048.606829] vcpu_run+0x62/0x2c0 [kvm] Aug 22 07:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 6048.607647] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 07:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 6048.608490] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 07:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 6048.609636] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 07:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 6048.610739] ? __seccomp_filter+0x4a/0x4a0 Aug 22 07:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 6048.611781] ? __fget_files+0x86/0xc0 Aug 22 07:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 6048.612776] __x64_sys_ioctl+0x95/0xd0 Aug 22 07:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 6048.613771] do_syscall_64+0x5c/0xc0 Aug 22 07:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 6048.614763] ? do_futex+0x162/0x1f0 Aug 22 07:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 6048.615724] ? __x64_sys_futex+0x78/0x1e0 Aug 22 07:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 6048.616576] ? __secure_computing+0xa9/0x120 Aug 22 07:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 6048.617364] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 07:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 6048.618357] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 6048.619223] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 6048.620255] ? do_syscall_64+0x69/0xc0 Aug 22 07:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 6048.621161] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 6048.621949] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 6048.622666] ? do_syscall_64+0x69/0xc0 Aug 22 07:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 6048.623533] ? do_syscall_64+0x69/0xc0 Aug 22 07:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 6048.624460] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 07:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 6048.625383] RIP: 0033:0x7faa5d0edaff Aug 22 07:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 6048.626311] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 07:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 6048.629125] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 07:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 6048.630516] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 07:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 6048.631703] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 07:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 6048.632644] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 07:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 6048.633544] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 07:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 6048.634463] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 07:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 6048.635374] Aug 22 07:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 6076.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 5551s! [qemu-system-x86:6715] Aug 22 07:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 6076.543109] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 07:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 6076.543182] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 07:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 6076.555281] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 07:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 6076.556576] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 07:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 6076.557800] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 6076.558852] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 07:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 6076.561409] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 07:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 6076.562451] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 07:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 6076.563616] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 07:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 6076.564796] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 07:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 6076.565969] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 07:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 6076.567147] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 07:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 6076.568328] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 07:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 6076.569571] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 07:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 6076.570672] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 07:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 6076.571880] Call Trace: Aug 22 07:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 6076.572792] Aug 22 07:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 6076.573676] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 6076.574725] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 6076.575767] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 6076.576871] ? show_regs.part.0+0x23/0x29 Aug 22 07:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 6076.577871] ? show_regs.cold+0x8/0xd Aug 22 07:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 6076.578858] ? watchdog_timer_fn+0x1be/0x220 Aug 22 07:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 6076.579905] ? lockup_detector_update_enable+0x60/0x60 Aug 22 07:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 6076.580965] ? __hrtimer_run_queues+0x107/0x230 Aug 22 07:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 6076.581996] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 07:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 6076.583021] ? hrtimer_interrupt+0x101/0x220 Aug 22 07:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 6076.584053] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 07:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 6076.585118] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 07:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 6076.586164] Aug 22 07:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 6076.587037] Aug 22 07:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 6076.587916] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 07:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 6076.588947] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 6076.589988] ? _raw_spin_lock+0x22/0x30 Aug 22 07:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 6076.590928] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 6076.591961] direct_page_fault+0x206/0x310 [kvm] Aug 22 07:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 6076.592989] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 07:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 6076.593995] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 07:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 6076.594990] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 07:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 6076.595974] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 07:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 6076.596930] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 07:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 6076.597922] handle_exit+0x98/0x230 [kvm_amd] Aug 22 07:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 6076.598817] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 07:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 6076.599747] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 07:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 6076.600667] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 07:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 6076.601568] vcpu_run+0x62/0x2c0 [kvm] Aug 22 07:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 6076.602377] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 07:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 6076.603191] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 07:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 6076.604057] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 07:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 6076.604852] ? __seccomp_filter+0x4a/0x4a0 Aug 22 07:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 6076.605597] ? __fget_files+0x86/0xc0 Aug 22 07:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 6076.606297] __x64_sys_ioctl+0x95/0xd0 Aug 22 07:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 6076.606988] do_syscall_64+0x5c/0xc0 Aug 22 07:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 6076.607681] ? do_futex+0x162/0x1f0 Aug 22 07:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 6076.608340] ? __x64_sys_futex+0x78/0x1e0 Aug 22 07:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 6076.609011] ? __secure_computing+0xa9/0x120 Aug 22 07:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 6076.609698] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 07:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 6076.610483] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 6076.611202] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 6076.611937] ? do_syscall_64+0x69/0xc0 Aug 22 07:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 6076.612587] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 6076.613290] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 6076.613984] ? do_syscall_64+0x69/0xc0 Aug 22 07:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 6076.614611] ? do_syscall_64+0x69/0xc0 Aug 22 07:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 6076.615231] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 07:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 6076.615946] RIP: 0033:0x7faa5d0edaff Aug 22 07:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 6076.616568] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 07:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 6076.618577] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 07:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 6076.619487] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 07:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 6076.620389] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 07:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 6076.621282] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 07:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 6076.622167] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 07:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 6076.623059] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 07:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 6076.623969] Aug 22 07:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 6104.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 5577s! [qemu-system-x86:6715] Aug 22 07:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 6104.543790] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 07:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 6104.544072] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 07:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 6104.556253] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 07:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 6104.557527] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 07:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 6104.558749] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 6104.559816] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 07:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 6104.562391] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 07:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 6104.563454] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 07:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 6104.564618] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 07:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 6104.565780] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 07:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 6104.566945] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 07:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 6104.568117] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 07:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 6104.569282] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 07:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 6104.570520] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 07:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 6104.571637] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 07:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 6104.572834] Call Trace: Aug 22 07:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 6104.573747] Aug 22 07:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 6104.574674] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 6104.575720] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 6104.576882] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 6104.577978] ? show_regs.part.0+0x23/0x29 Aug 22 07:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 6104.578973] ? show_regs.cold+0x8/0xd Aug 22 07:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 6104.579955] ? watchdog_timer_fn+0x1be/0x220 Aug 22 07:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 6104.581139] ? lockup_detector_update_enable+0x60/0x60 Aug 22 07:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 6104.582204] ? __hrtimer_run_queues+0x107/0x230 Aug 22 07:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 6104.583232] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 07:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 6104.584268] ? hrtimer_interrupt+0x101/0x220 Aug 22 07:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 6104.585281] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 07:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 6104.586348] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 07:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 6104.587415] Aug 22 07:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 6104.588269] Aug 22 07:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 6104.589106] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 07:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 6104.590139] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 6104.591181] ? _raw_spin_lock+0x22/0x30 Aug 22 07:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 6104.592143] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 6104.593170] direct_page_fault+0x206/0x310 [kvm] Aug 22 07:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 6104.594194] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 07:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 6104.595204] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 07:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 6104.596221] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 07:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 6104.597224] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 07:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 6104.598170] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 07:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 6104.599148] handle_exit+0x98/0x230 [kvm_amd] Aug 22 07:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 6104.600057] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 07:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 6104.600977] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 07:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 6104.601905] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 07:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 6104.602811] vcpu_run+0x62/0x2c0 [kvm] Aug 22 07:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 6104.603632] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 07:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 6104.604455] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 07:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 6104.605318] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 07:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 6104.606125] ? __seccomp_filter+0x4a/0x4a0 Aug 22 07:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 6104.606871] ? __fget_files+0x86/0xc0 Aug 22 07:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 6104.607589] __x64_sys_ioctl+0x95/0xd0 Aug 22 07:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 6104.608286] do_syscall_64+0x5c/0xc0 Aug 22 07:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 6104.608953] ? do_futex+0x162/0x1f0 Aug 22 07:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 6104.609609] ? __x64_sys_futex+0x78/0x1e0 Aug 22 07:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 6104.610283] ? __secure_computing+0xa9/0x120 Aug 22 07:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 6104.610977] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 07:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 6104.611751] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 6104.612481] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 6104.613210] ? do_syscall_64+0x69/0xc0 Aug 22 07:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 6104.613858] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 6104.614568] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 6104.615264] ? do_syscall_64+0x69/0xc0 Aug 22 07:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 6104.615904] ? do_syscall_64+0x69/0xc0 Aug 22 07:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 6104.616527] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 07:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 6104.617238] RIP: 0033:0x7faa5d0edaff Aug 22 07:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 6104.617893] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 07:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 6104.619903] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 07:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 6104.620819] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 07:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 6104.621711] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 07:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 6104.622608] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 07:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 6104.623522] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 07:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 6104.624417] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 07:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 6104.625313] Aug 22 07:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 6117.596829] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 07:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 6117.597814] rcu: 1-....: (1495422 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=728321 Aug 22 07:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 6117.598928] (t=1500099 jiffies g=23269 q=14866) Aug 22 07:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 6117.599879] NMI backtrace for cpu 1 Aug 22 07:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 6117.600590] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 07:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 6117.601688] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 07:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 6117.602741] Call Trace: Aug 22 07:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 6117.603426] Aug 22 07:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 6117.604072] show_stack+0x52/0x5c Aug 22 07:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 6117.604795] dump_stack_lvl+0x4a/0x63 Aug 22 07:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 6117.605539] dump_stack+0x10/0x16 Aug 22 07:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 6117.606254] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 07:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 6117.607031] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 07:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 6117.607822] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 07:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 6117.608642] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 07:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 6117.609460] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 07:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 6117.610267] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 07:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 6117.611038] print_cpu_stall.cold+0x2f/0xe2 Aug 22 07:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 6117.611818] ? timekeeping_update+0xf7/0x150 Aug 22 07:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 6117.612587] check_cpu_stall+0x109/0x270 Aug 22 07:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 6117.613333] rcu_sched_clock_irq+0x9a/0x250 Aug 22 07:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 6117.614096] update_process_times+0x94/0xd0 Aug 22 07:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 6117.614872] tick_sched_handle+0x29/0x70 Aug 22 07:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 6117.615640] tick_sched_timer+0x8c/0xc0 Aug 22 07:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 6117.616377] ? tick_nohz_handler+0xb0/0xb0 Aug 22 07:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 6117.617138] __hrtimer_run_queues+0x107/0x230 Aug 22 07:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 6117.617912] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 07:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 6117.618690] hrtimer_interrupt+0x101/0x220 Aug 22 07:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 6117.619467] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 07:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 6117.620283] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 07:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 6117.621087] Aug 22 07:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 6117.621728] Aug 22 07:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 6117.622355] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 07:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 6117.623187] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 6117.624073] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 07:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 6117.626283] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 07:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 6117.627172] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 07:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 6117.628169] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 07:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 6117.629150] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 07:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 6117.630116] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 07:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 6117.631073] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 07:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 6117.632060] ? _raw_spin_lock+0x22/0x30 Aug 22 07:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 6117.632827] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 6117.633667] direct_page_fault+0x206/0x310 [kvm] Aug 22 07:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 6117.634516] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 07:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 6117.635362] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 07:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 6117.636187] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 07:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 6117.636991] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 07:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 6117.637777] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 07:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 6117.638600] handle_exit+0x98/0x230 [kvm_amd] Aug 22 07:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 6117.639371] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 07:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 6117.640160] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 07:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 6117.640967] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 07:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 6117.641754] vcpu_run+0x62/0x2c0 [kvm] Aug 22 07:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 6117.642470] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 07:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 6117.643230] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 07:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 6117.644046] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 07:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 6117.644831] ? __seccomp_filter+0x4a/0x4a0 Aug 22 07:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 6117.645553] ? __fget_files+0x86/0xc0 Aug 22 07:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 6117.646248] __x64_sys_ioctl+0x95/0xd0 Aug 22 07:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 6117.646943] do_syscall_64+0x5c/0xc0 Aug 22 07:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 6117.647649] ? do_futex+0x162/0x1f0 Aug 22 07:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 6117.648320] ? __x64_sys_futex+0x78/0x1e0 Aug 22 07:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 6117.649024] ? __secure_computing+0xa9/0x120 Aug 22 07:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 6117.649747] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 07:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 6117.650537] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 6117.651307] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 6117.652061] ? do_syscall_64+0x69/0xc0 Aug 22 07:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 6117.652751] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 6117.653508] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 6117.654268] ? do_syscall_64+0x69/0xc0 Aug 22 07:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 6117.654966] ? do_syscall_64+0x69/0xc0 Aug 22 07:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 6117.655668] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 07:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 6117.656438] RIP: 0033:0x7faa5d0edaff Aug 22 07:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 6117.657150] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 07:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 6117.659265] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 07:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 6117.660237] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 07:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 6117.661187] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 07:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 6117.662132] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 07:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 6117.663077] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 07:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 6117.664019] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 07:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 6117.664931] Aug 22 07:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 6144.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 5614s! [qemu-system-x86:6715] Aug 22 07:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 6144.543131] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 07:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 6144.543203] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 07:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 6144.555666] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 07:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 6144.556944] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 07:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 6144.558189] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 6144.559269] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 07:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 6144.561851] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 07:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 6144.562928] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 07:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 6144.564212] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 07:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 6144.565414] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 07:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 6144.566641] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 07:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 6144.567833] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 07:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 6144.569091] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 07:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 6144.570343] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 07:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 6144.571494] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 07:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 6144.572711] Call Trace: Aug 22 07:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 6144.573633] Aug 22 07:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 6144.574535] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 6144.575609] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 6144.576658] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 6144.577741] ? show_regs.part.0+0x23/0x29 Aug 22 07:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 6144.578743] ? show_regs.cold+0x8/0xd Aug 22 07:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 6144.579738] ? watchdog_timer_fn+0x1be/0x220 Aug 22 07:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 6144.580779] ? lockup_detector_update_enable+0x60/0x60 Aug 22 07:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 6144.581884] ? __hrtimer_run_queues+0x107/0x230 Aug 22 07:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 6144.583099] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 07:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 6144.584218] ? hrtimer_interrupt+0x101/0x220 Aug 22 07:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 6144.585334] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 07:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 6144.586512] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 07:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 6144.587683] Aug 22 07:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 6144.588589] Aug 22 07:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 6144.589484] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 07:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 6144.590626] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 6144.591815] ? _raw_spin_lock+0x22/0x30 Aug 22 07:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 6144.592847] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 6144.593970] direct_page_fault+0x206/0x310 [kvm] Aug 22 07:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 6144.595130] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 07:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 6144.596252] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 07:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 6144.597350] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 07:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 6144.598431] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 07:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 6144.599513] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 07:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 6144.600613] handle_exit+0x98/0x230 [kvm_amd] Aug 22 07:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 6144.601600] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 07:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 6144.602610] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 07:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 6144.603667] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 07:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 6144.604676] vcpu_run+0x62/0x2c0 [kvm] Aug 22 07:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 6144.605571] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 07:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 6144.606476] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 07:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 6144.607447] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 07:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 6144.608341] ? __seccomp_filter+0x4a/0x4a0 Aug 22 07:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 6144.609174] ? __fget_files+0x86/0xc0 Aug 22 07:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 6144.609958] __x64_sys_ioctl+0x95/0xd0 Aug 22 07:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 6144.610732] do_syscall_64+0x5c/0xc0 Aug 22 07:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 6144.611499] ? do_futex+0x162/0x1f0 Aug 22 07:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 6144.612223] ? __x64_sys_futex+0x78/0x1e0 Aug 22 07:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 6144.612980] ? __secure_computing+0xa9/0x120 Aug 22 07:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 6144.613763] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 07:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 6144.614632] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 6144.615465] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 6144.616284] ? do_syscall_64+0x69/0xc0 Aug 22 07:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 6144.617014] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 6144.617812] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 6144.618605] ? do_syscall_64+0x69/0xc0 Aug 22 07:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 6144.619328] ? do_syscall_64+0x69/0xc0 Aug 22 07:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 6144.620032] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 07:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 6144.620842] RIP: 0033:0x7faa5d0edaff Aug 22 07:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 6144.621543] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 07:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 6144.623904] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 07:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 6144.624968] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 07:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 6144.626001] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 07:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 6144.627059] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 07:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 6144.628087] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 07:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 6144.629107] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 07:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 6144.630132] Aug 22 07:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 6172.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 5640s! [qemu-system-x86:6715] Aug 22 07:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 6172.543121] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 07:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 6172.543195] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 07:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 6172.555314] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 07:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 6172.556578] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 07:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 6172.557811] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 6172.558881] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 07:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 6172.561422] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 07:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 6172.562478] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 07:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 6172.563640] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 07:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 6172.564798] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 07:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 6172.565958] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 07:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 6172.567141] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 07:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 6172.568316] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 07:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 6172.569555] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 07:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 6172.570665] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 07:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 6172.571858] Call Trace: Aug 22 07:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 6172.572770] Aug 22 07:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 6172.573655] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 6172.574697] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 6172.575716] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 6172.576798] ? show_regs.part.0+0x23/0x29 Aug 22 07:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 6172.577792] ? show_regs.cold+0x8/0xd Aug 22 07:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 6172.578780] ? watchdog_timer_fn+0x1be/0x220 Aug 22 07:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 6172.579788] ? lockup_detector_update_enable+0x60/0x60 Aug 22 07:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 6172.580849] ? __hrtimer_run_queues+0x107/0x230 Aug 22 07:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 6172.581875] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 07:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 6172.582910] ? hrtimer_interrupt+0x101/0x220 Aug 22 07:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 6172.583923] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 07:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 6172.584991] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 07:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 6172.586041] Aug 22 07:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 6172.586909] Aug 22 07:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 6172.587746] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 07:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 6172.588783] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 6172.589819] ? _raw_spin_lock+0x22/0x30 Aug 22 07:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 6172.590778] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 6172.591798] direct_page_fault+0x206/0x310 [kvm] Aug 22 07:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 6172.592822] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 07:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 6172.593828] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 07:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 6172.594843] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 07:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 6172.595814] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 07:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 6172.596758] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 07:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 6172.597733] handle_exit+0x98/0x230 [kvm_amd] Aug 22 07:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 6172.598639] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 07:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 6172.599552] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 07:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 6172.600478] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 07:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 6172.601381] vcpu_run+0x62/0x2c0 [kvm] Aug 22 07:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 6172.602190] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 07:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 6172.603008] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 07:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 6172.603864] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 07:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 6172.604658] ? __seccomp_filter+0x4a/0x4a0 Aug 22 07:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 6172.605403] ? __fget_files+0x86/0xc0 Aug 22 07:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 6172.606106] __x64_sys_ioctl+0x95/0xd0 Aug 22 07:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 6172.606808] do_syscall_64+0x5c/0xc0 Aug 22 07:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 6172.607476] ? do_futex+0x162/0x1f0 Aug 22 07:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 6172.608123] ? __x64_sys_futex+0x78/0x1e0 Aug 22 07:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 6172.608798] ? __secure_computing+0xa9/0x120 Aug 22 07:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 6172.609485] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 07:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 6172.610247] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 6172.610977] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 6172.611694] ? do_syscall_64+0x69/0xc0 Aug 22 07:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 6172.612338] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 6172.613041] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 6172.613737] ? do_syscall_64+0x69/0xc0 Aug 22 07:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 6172.614363] ? do_syscall_64+0x69/0xc0 Aug 22 07:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 6172.614996] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 07:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 6172.615704] RIP: 0033:0x7faa5d0edaff Aug 22 07:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 6172.616326] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 07:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 6172.618304] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 07:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 6172.619235] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 07:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 6172.620123] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 07:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 6172.621011] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 07:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 6172.621899] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 07:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 6172.622795] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 07:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 6172.623695] Aug 22 07:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 6200.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 5666s! [qemu-system-x86:6715] Aug 22 07:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 6200.544103] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 07:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 6200.544438] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 07:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 6200.556924] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 07:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 6200.558238] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 07:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 6200.559474] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 6200.560593] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 07:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 6200.563208] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 07:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 6200.564274] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 07:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 6200.565492] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 07:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 6200.566703] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 07:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 6200.567871] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 07:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 6200.569033] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 07:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 6200.570218] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 07:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 6200.571477] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 07:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 6200.572607] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 07:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 6200.573852] Call Trace: Aug 22 07:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 6200.574804] Aug 22 07:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 6200.575734] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 6200.576810] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 6200.577846] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 6200.578974] ? show_regs.part.0+0x23/0x29 Aug 22 07:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 6200.579971] ? show_regs.cold+0x8/0xd Aug 22 07:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 6200.580941] ? watchdog_timer_fn+0x1be/0x220 Aug 22 07:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 6200.581966] ? lockup_detector_update_enable+0x60/0x60 Aug 22 07:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 6200.583089] ? __hrtimer_run_queues+0x107/0x230 Aug 22 07:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 6200.584137] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 07:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 6200.585165] ? hrtimer_interrupt+0x101/0x220 Aug 22 07:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 6200.586254] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 07:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 6200.587337] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 07:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 6200.588386] Aug 22 07:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 6200.589279] Aug 22 07:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 6200.590148] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 07:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 6200.591189] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 6200.592229] ? _raw_spin_lock+0x22/0x30 Aug 22 07:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 6200.593184] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 6200.594387] direct_page_fault+0x206/0x310 [kvm] Aug 22 07:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 6200.595416] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 07:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 6200.596434] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 07:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 6200.597449] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 07:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 6200.598681] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 07:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 6200.599629] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 07:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 6200.600610] handle_exit+0x98/0x230 [kvm_amd] Aug 22 07:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 6200.601517] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 07:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 6200.602503] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 07:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 6200.603478] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 07:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 6200.604478] vcpu_run+0x62/0x2c0 [kvm] Aug 22 07:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 6200.605305] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 07:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 6200.606196] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 07:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 6200.607086] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 07:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 6200.607907] ? __seccomp_filter+0x4a/0x4a0 Aug 22 07:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 6200.608677] ? __fget_files+0x86/0xc0 Aug 22 07:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 6200.609390] __x64_sys_ioctl+0x95/0xd0 Aug 22 07:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 6200.610115] do_syscall_64+0x5c/0xc0 Aug 22 07:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 6200.610854] ? do_futex+0x162/0x1f0 Aug 22 07:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 6200.611507] ? __x64_sys_futex+0x78/0x1e0 Aug 22 07:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 6200.612179] ? __secure_computing+0xa9/0x120 Aug 22 07:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 6200.613014] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 07:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 6200.613783] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 6200.614528] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 6200.615250] ? do_syscall_64+0x69/0xc0 Aug 22 07:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 6200.615893] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 6200.616594] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 6200.617293] ? do_syscall_64+0x69/0xc0 Aug 22 07:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 6200.617924] ? do_syscall_64+0x69/0xc0 Aug 22 07:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 6200.618563] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 07:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 6200.619268] RIP: 0033:0x7faa5d0edaff Aug 22 07:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 6200.619931] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 07:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 6200.621922] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 07:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 6200.622845] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 07:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 6200.623736] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 07:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 6200.624627] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 07:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 6200.625521] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 07:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 6200.627331] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 07:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 6200.628254] Aug 22 07:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 6228.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 5692s! [qemu-system-x86:6715] Aug 22 07:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 6228.544333] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 07:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 6228.544666] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 07:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 6228.557061] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 07:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 6228.558374] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 07:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 6228.559613] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 6228.560691] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 07:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 6228.563300] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 07:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 6228.564362] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 07:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 6228.565555] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 07:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 6228.566756] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 07:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 6228.567939] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 07:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 6228.569220] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 07:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 6228.570547] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 07:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 6228.571903] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 07:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 6228.573071] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 07:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 6228.574368] Call Trace: Aug 22 07:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 6228.575340] Aug 22 07:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 6228.576328] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 6228.577400] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 6228.578462] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 6228.579572] ? show_regs.part.0+0x23/0x29 Aug 22 07:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 6228.580581] ? show_regs.cold+0x8/0xd Aug 22 07:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 6228.581565] ? watchdog_timer_fn+0x1be/0x220 Aug 22 07:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 6228.582598] ? lockup_detector_update_enable+0x60/0x60 Aug 22 07:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 6228.583685] ? __hrtimer_run_queues+0x107/0x230 Aug 22 07:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 6228.584731] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 07:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 6228.585764] ? hrtimer_interrupt+0x101/0x220 Aug 22 07:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 6228.586840] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 07:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 6228.587921] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 07:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 6228.588985] Aug 22 07:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 6228.589864] Aug 22 07:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 6228.590706] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 07:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 6228.591760] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 6228.592813] ? _raw_spin_lock+0x22/0x30 Aug 22 07:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 6228.593766] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 6228.594810] direct_page_fault+0x206/0x310 [kvm] Aug 22 07:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 6228.595845] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 07:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 6228.596866] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 07:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 6228.597889] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 07:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 6228.598909] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 07:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 6228.599862] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 07:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 6228.600851] handle_exit+0x98/0x230 [kvm_amd] Aug 22 07:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 6228.601758] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 07:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 6228.602689] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 07:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 6228.603625] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 07:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 6228.604567] vcpu_run+0x62/0x2c0 [kvm] Aug 22 07:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 6228.605434] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 07:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 6228.606419] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 07:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 6228.607290] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 07:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 6228.608135] ? __seccomp_filter+0x4a/0x4a0 Aug 22 07:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 6228.608896] ? __fget_files+0x86/0xc0 Aug 22 07:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 6228.609608] __x64_sys_ioctl+0x95/0xd0 Aug 22 07:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 6228.610325] do_syscall_64+0x5c/0xc0 Aug 22 07:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 6228.610998] ? do_futex+0x162/0x1f0 Aug 22 07:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 6228.611653] ? __x64_sys_futex+0x78/0x1e0 Aug 22 07:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 6228.612350] ? __secure_computing+0xa9/0x120 Aug 22 07:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 6228.613053] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 07:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 6228.613876] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 6228.614618] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 6228.615351] ? do_syscall_64+0x69/0xc0 Aug 22 07:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 6228.616071] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 6228.616787] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 6228.617512] ? do_syscall_64+0x69/0xc0 Aug 22 07:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 6228.618174] ? do_syscall_64+0x69/0xc0 Aug 22 07:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 6228.618840] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 07:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 6228.619554] RIP: 0033:0x7faa5d0edaff Aug 22 07:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 6228.620223] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 07:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 6228.622259] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 07:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 6228.623188] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 07:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 6228.624162] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 07:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 6228.625160] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 07:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 6228.626106] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 07:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 6228.627023] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 07:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 6228.627969] Aug 22 07:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 6256.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 5718s! [qemu-system-x86:6715] Aug 22 07:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 6256.543940] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 07:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 6256.544272] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 07:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 6256.556421] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 07:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 6256.557710] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 07:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 6256.558929] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 6256.559984] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 07:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 6256.562547] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 07:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 6256.563589] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 07:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 6256.564756] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 07:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 6256.565931] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 07:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 6256.567089] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 07:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 6256.568256] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 07:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 6256.569419] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 07:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 6256.570666] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 07:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 6256.572384] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 07:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 6256.573609] Call Trace: Aug 22 07:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 6256.574526] Aug 22 07:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 6256.575442] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 6256.576568] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 6256.577730] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 6256.579075] ? show_regs.part.0+0x23/0x29 Aug 22 07:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 6256.580306] ? show_regs.cold+0x8/0xd Aug 22 07:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 6256.581449] ? watchdog_timer_fn+0x1be/0x220 Aug 22 07:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 6256.582464] ? lockup_detector_update_enable+0x60/0x60 Aug 22 07:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 6256.583529] ? __hrtimer_run_queues+0x107/0x230 Aug 22 07:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 6256.584556] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 07:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 6256.585693] ? hrtimer_interrupt+0x101/0x220 Aug 22 07:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 6256.586724] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 07:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 6256.587796] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 07:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 6256.588847] Aug 22 07:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 6256.589798] Aug 22 07:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 6256.590765] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 07:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 6256.591845] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 6256.592893] ? _raw_spin_lock+0x22/0x30 Aug 22 07:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 6256.593860] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 6256.594913] direct_page_fault+0x206/0x310 [kvm] Aug 22 07:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 6256.595937] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 07:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 6256.596945] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 07:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 6256.597977] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 07:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 6256.598989] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 07:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 6256.599935] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 07:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 6256.601069] handle_exit+0x98/0x230 [kvm_amd] Aug 22 07:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 6256.601979] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 07:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 6256.602910] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 07:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 6256.603833] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 07:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 6256.604740] vcpu_run+0x62/0x2c0 [kvm] Aug 22 07:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 6256.605636] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 07:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 6256.606626] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 07:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 6256.607732] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 07:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 6256.608553] ? __seccomp_filter+0x4a/0x4a0 Aug 22 07:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 6256.609300] ? __fget_files+0x86/0xc0 Aug 22 07:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 6256.610044] __x64_sys_ioctl+0x95/0xd0 Aug 22 07:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 6256.610741] do_syscall_64+0x5c/0xc0 Aug 22 07:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 6256.611422] ? do_futex+0x162/0x1f0 Aug 22 07:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 6256.612078] ? __x64_sys_futex+0x78/0x1e0 Aug 22 07:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 6256.612749] ? __secure_computing+0xa9/0x120 Aug 22 07:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 6256.613458] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 07:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 6256.614221] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 6256.614979] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 6256.615702] ? do_syscall_64+0x69/0xc0 Aug 22 07:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 6256.616349] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 6256.617054] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 6256.617769] ? do_syscall_64+0x69/0xc0 Aug 22 07:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 6256.618420] ? do_syscall_64+0x69/0xc0 Aug 22 07:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 6256.619045] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 07:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 6256.619753] RIP: 0033:0x7faa5d0edaff Aug 22 07:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 6256.620426] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 07:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 6256.622660] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 07:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 6256.623581] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 07:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 6256.624486] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 07:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 6256.625379] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 07:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 6256.626282] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 07:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 6256.627170] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 07:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 6256.628061] Aug 22 07:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 6284.541981] watchdog: BUG: soft lockup - CPU#1 stuck for 5744s! [qemu-system-x86:6715] Aug 22 07:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 6284.543922] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 07:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 6284.544251] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 07:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 6284.556931] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 07:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 6284.558264] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 07:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 6284.559513] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 6284.560596] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 07:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 6284.563262] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 07:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 6284.564329] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 07:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 6284.565595] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 07:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 6284.566811] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 07:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 6284.568089] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 07:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 6284.569446] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 07:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 6284.570824] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 07:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 6284.572114] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 07:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 6284.573262] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 07:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 6284.574481] Call Trace: Aug 22 07:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 6284.575498] Aug 22 07:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 6284.576439] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 6284.577559] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 6284.578635] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 6284.579758] ? show_regs.part.0+0x23/0x29 Aug 22 07:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 6284.580807] ? show_regs.cold+0x8/0xd Aug 22 07:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 6284.581870] ? watchdog_timer_fn+0x1be/0x220 Aug 22 07:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 6284.582930] ? lockup_detector_update_enable+0x60/0x60 Aug 22 07:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 6284.584021] ? __hrtimer_run_queues+0x107/0x230 Aug 22 07:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 6284.585103] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 07:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 6284.586175] ? hrtimer_interrupt+0x101/0x220 Aug 22 07:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 6284.587265] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 07:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 6284.588409] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 07:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 6284.589592] Aug 22 07:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 6284.590466] Aug 22 07:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 6284.591324] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 07:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 6284.592433] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 6284.593552] ? _raw_spin_lock+0x22/0x30 Aug 22 07:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 6284.594528] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 6284.595560] direct_page_fault+0x206/0x310 [kvm] Aug 22 07:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 6284.596613] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 07:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 6284.597694] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 07:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 6284.598746] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 07:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 6284.599777] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 07:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 6284.600760] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 07:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 6284.601805] handle_exit+0x98/0x230 [kvm_amd] Aug 22 07:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 6284.602748] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 07:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 6284.603687] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 07:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 6284.604666] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 07:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 6284.605698] vcpu_run+0x62/0x2c0 [kvm] Aug 22 07:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 6284.606674] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 07:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 6284.607542] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 07:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 6284.608444] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 07:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 6284.609310] ? __seccomp_filter+0x4a/0x4a0 Aug 22 07:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 6284.610115] ? __fget_files+0x86/0xc0 Aug 22 07:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 6284.610873] __x64_sys_ioctl+0x95/0xd0 Aug 22 07:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 6284.611577] do_syscall_64+0x5c/0xc0 Aug 22 07:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 6284.612286] ? do_futex+0x162/0x1f0 Aug 22 07:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 6284.613021] ? __x64_sys_futex+0x78/0x1e0 Aug 22 07:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 6284.613720] ? __secure_computing+0xa9/0x120 Aug 22 07:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 6284.614453] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 07:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 6284.615250] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 6284.615981] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 6284.616752] ? do_syscall_64+0x69/0xc0 Aug 22 07:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 6284.617451] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 6284.618189] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 6284.618926] ? do_syscall_64+0x69/0xc0 Aug 22 07:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 6284.619569] ? do_syscall_64+0x69/0xc0 Aug 22 07:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 6284.620205] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 07:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 6284.620925] RIP: 0033:0x7faa5d0edaff Aug 22 07:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 6284.621630] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 07:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 6284.623756] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 07:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 6284.624711] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 07:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 6284.625647] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 07:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 6284.626561] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 07:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 6284.627483] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 07:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 6284.628421] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 07:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 6284.629365] Aug 22 07:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 6297.608709] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 07:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 6297.609766] rcu: 1-....: (1540282 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=749890 Aug 22 07:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 6297.610907] (t=1545102 jiffies g=23269 q=14990) Aug 22 07:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 6297.611716] NMI backtrace for cpu 1 Aug 22 07:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 6297.612455] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 07:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 6297.613588] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 07:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 6297.614658] Call Trace: Aug 22 07:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 6297.615338] Aug 22 07:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 6297.615983] show_stack+0x52/0x5c Aug 22 07:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 6297.616727] dump_stack_lvl+0x4a/0x63 Aug 22 07:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 6297.617524] dump_stack+0x10/0x16 Aug 22 07:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 6297.618249] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 07:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 6297.619052] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 07:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 6297.619852] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 07:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 6297.620677] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 07:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 6297.621516] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 07:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 6297.622374] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 07:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 6297.623167] print_cpu_stall.cold+0x2f/0xe2 Aug 22 07:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 6297.623938] ? timekeeping_update+0xf7/0x150 Aug 22 07:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 6297.624715] check_cpu_stall+0x109/0x270 Aug 22 07:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 6297.625491] rcu_sched_clock_irq+0x9a/0x250 Aug 22 07:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 6297.626253] update_process_times+0x94/0xd0 Aug 22 07:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 6297.627035] tick_sched_handle+0x29/0x70 Aug 22 07:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 6297.627815] tick_sched_timer+0x8c/0xc0 Aug 22 07:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 6297.628583] ? tick_nohz_handler+0xb0/0xb0 Aug 22 07:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 6297.629374] __hrtimer_run_queues+0x107/0x230 Aug 22 07:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 6297.630157] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 07:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 6297.630931] hrtimer_interrupt+0x101/0x220 Aug 22 07:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 6297.631688] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 07:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 6297.632542] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 07:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 6297.633412] Aug 22 07:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 6297.634120] Aug 22 07:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 6297.634799] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 07:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 6297.635718] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 6297.636715] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 07:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 6297.639280] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 07:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 6297.640255] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 07:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 6297.641404] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 07:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 6297.642526] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 07:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 6297.643625] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 07:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 6297.644715] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 07:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 6297.645828] ? _raw_spin_lock+0x22/0x30 Aug 22 07:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 6297.646680] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 6297.647607] direct_page_fault+0x206/0x310 [kvm] Aug 22 07:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 6297.648535] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 07:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 6297.649465] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 07:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 6297.650378] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 07:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 6297.651272] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 07:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 6297.652160] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 07:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 6297.653119] handle_exit+0x98/0x230 [kvm_amd] Aug 22 07:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 6297.653972] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 07:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 6297.654847] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 07:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 6297.655742] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 07:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 6297.656626] vcpu_run+0x62/0x2c0 [kvm] Aug 22 07:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 6297.657429] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 07:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 6297.658250] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 07:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 6297.659172] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 07:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 6297.660019] ? __seccomp_filter+0x4a/0x4a0 Aug 22 07:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 6297.660827] ? __fget_files+0x86/0xc0 Aug 22 07:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 6297.661607] __x64_sys_ioctl+0x95/0xd0 Aug 22 07:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 6297.662378] do_syscall_64+0x5c/0xc0 Aug 22 07:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 6297.663134] ? do_futex+0x162/0x1f0 Aug 22 07:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 6297.663887] ? __x64_sys_futex+0x78/0x1e0 Aug 22 07:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 6297.664668] ? __secure_computing+0xa9/0x120 Aug 22 07:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 6297.665502] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 07:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 6297.666407] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 6297.667259] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 6297.668110] ? do_syscall_64+0x69/0xc0 Aug 22 07:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 6297.668873] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 6297.669735] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 6297.670590] ? do_syscall_64+0x69/0xc0 Aug 22 07:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 6297.671360] ? do_syscall_64+0x69/0xc0 Aug 22 07:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 6297.672120] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 07:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 6297.673035] RIP: 0033:0x7faa5d0edaff Aug 22 07:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 6297.673925] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 07:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 6297.676374] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 07:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 6297.677688] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 07:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 6297.678772] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 07:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 6297.679851] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 07:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 6297.680986] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 07:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 6297.682224] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 07:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 6297.683285] Aug 22 07:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 6324.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 5782s! [qemu-system-x86:6715] Aug 22 07:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 6324.544221] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 07:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 6324.544544] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 07:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 6324.557427] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 07:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 6324.558693] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 07:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 6324.559941] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 6324.561102] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 07:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 6324.564009] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 07:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 6324.565152] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 07:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 6324.566425] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 07:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 6324.567714] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 07:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 6324.568932] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 07:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 6324.570118] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 07:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 6324.571346] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 07:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 6324.572686] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 07:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 6324.573797] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 07:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 6324.575032] Call Trace: Aug 22 07:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 6324.575973] Aug 22 07:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 6324.576902] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 6324.577939] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 6324.578964] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 6324.580105] ? show_regs.part.0+0x23/0x29 Aug 22 07:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 6324.581165] ? show_regs.cold+0x8/0xd Aug 22 07:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 6324.582159] ? watchdog_timer_fn+0x1be/0x220 Aug 22 07:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 6324.583180] ? lockup_detector_update_enable+0x60/0x60 Aug 22 07:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 6324.584246] ? __hrtimer_run_queues+0x107/0x230 Aug 22 07:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 6324.585289] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 07:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 6324.586314] ? hrtimer_interrupt+0x101/0x220 Aug 22 07:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 6324.587358] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 07:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 6324.588520] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 07:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 6324.589821] Aug 22 07:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 6324.590739] Aug 22 07:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 6324.591594] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 07:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 6324.592671] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 6324.593717] ? _raw_spin_lock+0x22/0x30 Aug 22 07:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 6324.594666] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 6324.595692] direct_page_fault+0x206/0x310 [kvm] Aug 22 07:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 6324.596739] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 07:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 6324.597759] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 07:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 6324.598786] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 07:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 6324.599838] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 07:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 6324.600821] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 07:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 6324.601837] handle_exit+0x98/0x230 [kvm_amd] Aug 22 07:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 6324.602736] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 07:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 6324.603656] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 07:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 6324.604585] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 07:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 6324.605513] vcpu_run+0x62/0x2c0 [kvm] Aug 22 07:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 6324.606343] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 07:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 6324.607156] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 07:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 6324.608014] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 07:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 6324.608849] ? __seccomp_filter+0x4a/0x4a0 Aug 22 07:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 6324.609603] ? __fget_files+0x86/0xc0 Aug 22 07:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 6324.610312] __x64_sys_ioctl+0x95/0xd0 Aug 22 07:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 6324.611030] do_syscall_64+0x5c/0xc0 Aug 22 07:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 6324.611706] ? do_futex+0x162/0x1f0 Aug 22 07:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 6324.612356] ? __x64_sys_futex+0x78/0x1e0 Aug 22 07:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 6324.613079] ? __secure_computing+0xa9/0x120 Aug 22 07:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 6324.613781] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 07:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 6324.614554] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 6324.615284] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 6324.616006] ? do_syscall_64+0x69/0xc0 Aug 22 07:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 6324.616682] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 6324.617392] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 6324.618095] ? do_syscall_64+0x69/0xc0 Aug 22 07:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 6324.618722] ? do_syscall_64+0x69/0xc0 Aug 22 07:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 6324.619347] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 07:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 6324.620062] RIP: 0033:0x7faa5d0edaff Aug 22 07:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 6324.620745] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 07:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 6324.622754] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 07:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 6324.623673] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 07:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 6324.624569] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 07:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 6324.625517] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 07:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 6324.626429] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 07:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 6324.627322] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 07:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 6324.628226] Aug 22 07:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 6352.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 5808s! [qemu-system-x86:6715] Aug 22 07:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 6352.543134] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 07:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 6352.543210] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 07:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 6352.555683] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 07:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 6352.556967] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 07:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 6352.558189] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 6352.559253] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 07:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 6352.561821] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 07:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 6352.562868] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 07:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 6352.564031] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 07:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 6352.565212] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 07:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 6352.566389] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 07:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 6352.567560] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 07:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 6352.568744] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 07:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 6352.569978] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 07:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 6352.571125] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 07:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 6352.572343] Call Trace: Aug 22 07:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 6352.573258] Aug 22 07:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 6352.574317] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 6352.575500] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 6352.576660] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 6352.577742] ? show_regs.part.0+0x23/0x29 Aug 22 07:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 6352.578740] ? show_regs.cold+0x8/0xd Aug 22 07:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 6352.579711] ? watchdog_timer_fn+0x1be/0x220 Aug 22 07:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 6352.580743] ? lockup_detector_update_enable+0x60/0x60 Aug 22 07:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 6352.581881] ? __hrtimer_run_queues+0x107/0x230 Aug 22 07:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 6352.583230] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 07:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 6352.584379] ? hrtimer_interrupt+0x101/0x220 Aug 22 07:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 6352.585500] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 07:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 6352.586686] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 07:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 6352.587832] Aug 22 07:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 6352.588754] Aug 22 07:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 6352.589644] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 07:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 6352.590780] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 6352.591921] ? _raw_spin_lock+0x22/0x30 Aug 22 07:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 6352.592964] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 6352.594079] direct_page_fault+0x206/0x310 [kvm] Aug 22 07:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 6352.595199] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 07:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 6352.596352] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 07:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 6352.597540] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 07:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 6352.598615] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 07:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 6352.599674] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 07:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 6352.600815] handle_exit+0x98/0x230 [kvm_amd] Aug 22 07:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 6352.601811] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 07:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 6352.602828] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 07:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 6352.603863] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 07:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 6352.604894] vcpu_run+0x62/0x2c0 [kvm] Aug 22 07:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 6352.605735] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 07:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 6352.606546] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 07:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 6352.607510] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 07:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 6352.608433] ? __seccomp_filter+0x4a/0x4a0 Aug 22 07:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 6352.609274] ? __fget_files+0x86/0xc0 Aug 22 07:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 6352.610061] __x64_sys_ioctl+0x95/0xd0 Aug 22 07:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 6352.610828] do_syscall_64+0x5c/0xc0 Aug 22 07:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 6352.611577] ? do_futex+0x162/0x1f0 Aug 22 07:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 6352.612321] ? __x64_sys_futex+0x78/0x1e0 Aug 22 07:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 6352.613079] ? __secure_computing+0xa9/0x120 Aug 22 07:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 6352.613868] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 07:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 6352.614930] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 6352.615744] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 6352.616586] ? do_syscall_64+0x69/0xc0 Aug 22 07:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 6352.617318] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 6352.618122] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 6352.618917] ? do_syscall_64+0x69/0xc0 Aug 22 07:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 6352.619619] ? do_syscall_64+0x69/0xc0 Aug 22 07:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 6352.620338] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 07:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 6352.621306] RIP: 0033:0x7faa5d0edaff Aug 22 07:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 6352.622008] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 07:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 6352.624346] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 07:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 6352.625398] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 07:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 6352.626420] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 07:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 6352.627455] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 07:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 6352.628576] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 07:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 6352.629625] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 07:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 6352.630663] Aug 22 07:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 6380.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 5834s! [qemu-system-x86:6715] Aug 22 07:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 6380.543783] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 07:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 6380.544085] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 07:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 6380.556346] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 07:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 6380.557617] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 07:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 6380.558838] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 6380.559941] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 07:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 6380.562519] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 07:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 6380.563561] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 07:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 6380.564748] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 07:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 6380.565932] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 07:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 6380.567104] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 07:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 6380.568289] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 07:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 6380.569514] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 07:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 6380.570772] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 07:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 6380.571926] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 07:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 6380.573124] Call Trace: Aug 22 07:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 6380.574037] Aug 22 07:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 6380.574942] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 6380.576003] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 6380.577039] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 6380.578135] ? show_regs.part.0+0x23/0x29 Aug 22 07:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 6380.579140] ? show_regs.cold+0x8/0xd Aug 22 07:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 6380.580147] ? watchdog_timer_fn+0x1be/0x220 Aug 22 07:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 6380.581169] ? lockup_detector_update_enable+0x60/0x60 Aug 22 07:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 6380.582261] ? __hrtimer_run_queues+0x107/0x230 Aug 22 07:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 6380.583291] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 07:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 6380.584336] ? hrtimer_interrupt+0x101/0x220 Aug 22 07:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 6380.585353] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 07:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 6380.586432] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 07:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 6380.587492] Aug 22 07:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 6380.588369] Aug 22 07:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 6380.589205] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 07:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 6380.590243] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 6380.591295] ? _raw_spin_lock+0x22/0x30 Aug 22 07:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 6380.592292] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 6380.593313] direct_page_fault+0x206/0x310 [kvm] Aug 22 07:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 6380.594336] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 07:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 6380.595344] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 07:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 6380.596369] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 07:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 6380.597382] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 07:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 6380.598330] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 07:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 6380.599319] handle_exit+0x98/0x230 [kvm_amd] Aug 22 07:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 6380.600233] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 07:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 6380.601165] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 07:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 6380.602106] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 07:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 6380.603030] vcpu_run+0x62/0x2c0 [kvm] Aug 22 07:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 6380.603846] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 07:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 6380.604670] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 07:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 6380.605543] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 07:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 6380.606352] ? __seccomp_filter+0x4a/0x4a0 Aug 22 07:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 6380.607096] ? __fget_files+0x86/0xc0 Aug 22 07:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 6380.607815] __x64_sys_ioctl+0x95/0xd0 Aug 22 07:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 6380.608527] do_syscall_64+0x5c/0xc0 Aug 22 07:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 6380.609220] ? do_futex+0x162/0x1f0 Aug 22 07:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 6380.609868] ? __x64_sys_futex+0x78/0x1e0 Aug 22 07:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 6380.610547] ? __secure_computing+0xa9/0x120 Aug 22 07:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 6380.611236] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 07:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 6380.612044] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 6380.612837] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 6380.613567] ? do_syscall_64+0x69/0xc0 Aug 22 07:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 6380.614211] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 6380.614912] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 6380.615773] ? do_syscall_64+0x69/0xc0 Aug 22 07:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 6380.616423] ? do_syscall_64+0x69/0xc0 Aug 22 07:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 6380.617066] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 07:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 6380.617781] RIP: 0033:0x7faa5d0edaff Aug 22 07:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 6380.618621] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 07:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 6380.620638] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 07:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 6380.621548] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 07:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 6380.622566] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 07:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 6380.623475] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 07:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 6380.624385] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 07:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 6380.625274] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 07:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 6380.626167] Aug 22 07:10:34 juju-e4d256-prod-github-runner-207 kernel: [ 6408.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 5860s! [qemu-system-x86:6715] Aug 22 07:10:34 juju-e4d256-prod-github-runner-207 kernel: [ 6408.543920] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 07:10:34 juju-e4d256-prod-github-runner-207 kernel: [ 6408.544227] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 07:10:34 juju-e4d256-prod-github-runner-207 kernel: [ 6408.556722] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 07:10:34 juju-e4d256-prod-github-runner-207 kernel: [ 6408.558032] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 07:10:34 juju-e4d256-prod-github-runner-207 kernel: [ 6408.559301] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:10:34 juju-e4d256-prod-github-runner-207 kernel: [ 6408.560377] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 07:10:34 juju-e4d256-prod-github-runner-207 kernel: [ 6408.562929] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 07:10:34 juju-e4d256-prod-github-runner-207 kernel: [ 6408.563983] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 07:10:34 juju-e4d256-prod-github-runner-207 kernel: [ 6408.565328] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 07:10:34 juju-e4d256-prod-github-runner-207 kernel: [ 6408.566485] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 07:10:34 juju-e4d256-prod-github-runner-207 kernel: [ 6408.567678] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 07:10:34 juju-e4d256-prod-github-runner-207 kernel: [ 6408.568844] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 07:10:34 juju-e4d256-prod-github-runner-207 kernel: [ 6408.570078] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 07:10:34 juju-e4d256-prod-github-runner-207 kernel: [ 6408.571644] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 07:10:34 juju-e4d256-prod-github-runner-207 kernel: [ 6408.572853] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 07:10:34 juju-e4d256-prod-github-runner-207 kernel: [ 6408.574222] Call Trace: Aug 22 07:10:34 juju-e4d256-prod-github-runner-207 kernel: [ 6408.575190] Aug 22 07:10:34 juju-e4d256-prod-github-runner-207 kernel: [ 6408.576206] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:10:34 juju-e4d256-prod-github-runner-207 kernel: [ 6408.577358] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:10:34 juju-e4d256-prod-github-runner-207 kernel: [ 6408.578502] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:10:34 juju-e4d256-prod-github-runner-207 kernel: [ 6408.579718] ? show_regs.part.0+0x23/0x29 Aug 22 07:10:34 juju-e4d256-prod-github-runner-207 kernel: [ 6408.580802] ? show_regs.cold+0x8/0xd Aug 22 07:10:34 juju-e4d256-prod-github-runner-207 kernel: [ 6408.581864] ? watchdog_timer_fn+0x1be/0x220 Aug 22 07:10:34 juju-e4d256-prod-github-runner-207 kernel: [ 6408.582960] ? lockup_detector_update_enable+0x60/0x60 Aug 22 07:10:34 juju-e4d256-prod-github-runner-207 kernel: [ 6408.584170] ? __hrtimer_run_queues+0x107/0x230 Aug 22 07:10:34 juju-e4d256-prod-github-runner-207 kernel: [ 6408.585333] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 07:10:34 juju-e4d256-prod-github-runner-207 kernel: [ 6408.586762] ? hrtimer_interrupt+0x101/0x220 Aug 22 07:10:34 juju-e4d256-prod-github-runner-207 kernel: [ 6408.588024] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 07:10:34 juju-e4d256-prod-github-runner-207 kernel: [ 6408.589105] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 07:10:34 juju-e4d256-prod-github-runner-207 kernel: [ 6408.590168] Aug 22 07:10:34 juju-e4d256-prod-github-runner-207 kernel: [ 6408.591025] Aug 22 07:10:34 juju-e4d256-prod-github-runner-207 kernel: [ 6408.591881] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 07:10:34 juju-e4d256-prod-github-runner-207 kernel: [ 6408.592913] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:10:34 juju-e4d256-prod-github-runner-207 kernel: [ 6408.593955] ? _raw_spin_lock+0x22/0x30 Aug 22 07:10:34 juju-e4d256-prod-github-runner-207 kernel: [ 6408.594935] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:10:34 juju-e4d256-prod-github-runner-207 kernel: [ 6408.595976] direct_page_fault+0x206/0x310 [kvm] Aug 22 07:10:34 juju-e4d256-prod-github-runner-207 kernel: [ 6408.597005] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 07:10:34 juju-e4d256-prod-github-runner-207 kernel: [ 6408.598013] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 07:10:34 juju-e4d256-prod-github-runner-207 kernel: [ 6408.599012] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 07:10:34 juju-e4d256-prod-github-runner-207 kernel: [ 6408.600058] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 07:10:34 juju-e4d256-prod-github-runner-207 kernel: [ 6408.601044] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 07:10:34 juju-e4d256-prod-github-runner-207 kernel: [ 6408.602024] handle_exit+0x98/0x230 [kvm_amd] Aug 22 07:10:34 juju-e4d256-prod-github-runner-207 kernel: [ 6408.602929] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 07:10:34 juju-e4d256-prod-github-runner-207 kernel: [ 6408.603862] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 07:10:34 juju-e4d256-prod-github-runner-207 kernel: [ 6408.604788] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 07:10:34 juju-e4d256-prod-github-runner-207 kernel: [ 6408.605691] vcpu_run+0x62/0x2c0 [kvm] Aug 22 07:10:34 juju-e4d256-prod-github-runner-207 kernel: [ 6408.606501] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 07:10:34 juju-e4d256-prod-github-runner-207 kernel: [ 6408.607306] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 07:10:34 juju-e4d256-prod-github-runner-207 kernel: [ 6408.608169] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 07:10:34 juju-e4d256-prod-github-runner-207 kernel: [ 6408.608964] ? __seccomp_filter+0x4a/0x4a0 Aug 22 07:10:34 juju-e4d256-prod-github-runner-207 kernel: [ 6408.609714] ? __fget_files+0x86/0xc0 Aug 22 07:10:34 juju-e4d256-prod-github-runner-207 kernel: [ 6408.610415] __x64_sys_ioctl+0x95/0xd0 Aug 22 07:10:34 juju-e4d256-prod-github-runner-207 kernel: [ 6408.611105] do_syscall_64+0x5c/0xc0 Aug 22 07:10:34 juju-e4d256-prod-github-runner-207 kernel: [ 6408.611820] ? do_futex+0x162/0x1f0 Aug 22 07:10:34 juju-e4d256-prod-github-runner-207 kernel: [ 6408.612470] ? __x64_sys_futex+0x78/0x1e0 Aug 22 07:10:34 juju-e4d256-prod-github-runner-207 kernel: [ 6408.613156] ? __secure_computing+0xa9/0x120 Aug 22 07:10:34 juju-e4d256-prod-github-runner-207 kernel: [ 6408.613869] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 07:10:34 juju-e4d256-prod-github-runner-207 kernel: [ 6408.614635] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:10:34 juju-e4d256-prod-github-runner-207 kernel: [ 6408.615356] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:10:34 juju-e4d256-prod-github-runner-207 kernel: [ 6408.616089] ? do_syscall_64+0x69/0xc0 Aug 22 07:10:34 juju-e4d256-prod-github-runner-207 kernel: [ 6408.616735] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:10:34 juju-e4d256-prod-github-runner-207 kernel: [ 6408.617437] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:10:34 juju-e4d256-prod-github-runner-207 kernel: [ 6408.618132] ? do_syscall_64+0x69/0xc0 Aug 22 07:10:34 juju-e4d256-prod-github-runner-207 kernel: [ 6408.618759] ? do_syscall_64+0x69/0xc0 Aug 22 07:10:34 juju-e4d256-prod-github-runner-207 kernel: [ 6408.619380] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 07:10:34 juju-e4d256-prod-github-runner-207 kernel: [ 6408.620100] RIP: 0033:0x7faa5d0edaff Aug 22 07:10:34 juju-e4d256-prod-github-runner-207 kernel: [ 6408.620759] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 07:10:34 juju-e4d256-prod-github-runner-207 kernel: [ 6408.622760] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 07:10:34 juju-e4d256-prod-github-runner-207 kernel: [ 6408.623684] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 07:10:34 juju-e4d256-prod-github-runner-207 kernel: [ 6408.624578] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 07:10:34 juju-e4d256-prod-github-runner-207 kernel: [ 6408.625465] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 07:10:34 juju-e4d256-prod-github-runner-207 kernel: [ 6408.626351] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 07:10:34 juju-e4d256-prod-github-runner-207 kernel: [ 6408.627239] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 07:10:34 juju-e4d256-prod-github-runner-207 kernel: [ 6408.628147] Aug 22 07:11:02 juju-e4d256-prod-github-runner-207 kernel: [ 6436.541976] watchdog: BUG: soft lockup - CPU#1 stuck for 5886s! [qemu-system-x86:6715] Aug 22 07:11:02 juju-e4d256-prod-github-runner-207 kernel: [ 6436.543093] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 07:11:02 juju-e4d256-prod-github-runner-207 kernel: [ 6436.543165] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 07:11:02 juju-e4d256-prod-github-runner-207 kernel: [ 6436.555282] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 07:11:02 juju-e4d256-prod-github-runner-207 kernel: [ 6436.556552] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 07:11:02 juju-e4d256-prod-github-runner-207 kernel: [ 6436.557789] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:11:02 juju-e4d256-prod-github-runner-207 kernel: [ 6436.559037] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 07:11:02 juju-e4d256-prod-github-runner-207 kernel: [ 6436.561624] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 07:11:02 juju-e4d256-prod-github-runner-207 kernel: [ 6436.562670] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 07:11:02 juju-e4d256-prod-github-runner-207 kernel: [ 6436.563849] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 07:11:02 juju-e4d256-prod-github-runner-207 kernel: [ 6436.565165] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 07:11:02 juju-e4d256-prod-github-runner-207 kernel: [ 6436.566331] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 07:11:02 juju-e4d256-prod-github-runner-207 kernel: [ 6436.567502] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 07:11:02 juju-e4d256-prod-github-runner-207 kernel: [ 6436.568695] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 07:11:02 juju-e4d256-prod-github-runner-207 kernel: [ 6436.569944] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 07:11:02 juju-e4d256-prod-github-runner-207 kernel: [ 6436.571047] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 07:11:02 juju-e4d256-prod-github-runner-207 kernel: [ 6436.572312] Call Trace: Aug 22 07:11:02 juju-e4d256-prod-github-runner-207 kernel: [ 6436.573245] Aug 22 07:11:02 juju-e4d256-prod-github-runner-207 kernel: [ 6436.574135] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:11:02 juju-e4d256-prod-github-runner-207 kernel: [ 6436.575173] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:11:02 juju-e4d256-prod-github-runner-207 kernel: [ 6436.576218] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:11:02 juju-e4d256-prod-github-runner-207 kernel: [ 6436.577300] ? show_regs.part.0+0x23/0x29 Aug 22 07:11:02 juju-e4d256-prod-github-runner-207 kernel: [ 6436.578302] ? show_regs.cold+0x8/0xd Aug 22 07:11:02 juju-e4d256-prod-github-runner-207 kernel: [ 6436.579301] ? watchdog_timer_fn+0x1be/0x220 Aug 22 07:11:02 juju-e4d256-prod-github-runner-207 kernel: [ 6436.580318] ? lockup_detector_update_enable+0x60/0x60 Aug 22 07:11:02 juju-e4d256-prod-github-runner-207 kernel: [ 6436.581406] ? __hrtimer_run_queues+0x107/0x230 Aug 22 07:11:02 juju-e4d256-prod-github-runner-207 kernel: [ 6436.582438] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 07:11:02 juju-e4d256-prod-github-runner-207 kernel: [ 6436.583494] ? hrtimer_interrupt+0x101/0x220 Aug 22 07:11:02 juju-e4d256-prod-github-runner-207 kernel: [ 6436.584517] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 07:11:02 juju-e4d256-prod-github-runner-207 kernel: [ 6436.585584] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 07:11:02 juju-e4d256-prod-github-runner-207 kernel: [ 6436.586641] Aug 22 07:11:02 juju-e4d256-prod-github-runner-207 kernel: [ 6436.587527] Aug 22 07:11:02 juju-e4d256-prod-github-runner-207 kernel: [ 6436.588363] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 07:11:02 juju-e4d256-prod-github-runner-207 kernel: [ 6436.589396] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:11:02 juju-e4d256-prod-github-runner-207 kernel: [ 6436.590435] ? _raw_spin_lock+0x22/0x30 Aug 22 07:11:02 juju-e4d256-prod-github-runner-207 kernel: [ 6436.591417] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:11:02 juju-e4d256-prod-github-runner-207 kernel: [ 6436.592594] direct_page_fault+0x206/0x310 [kvm] Aug 22 07:11:02 juju-e4d256-prod-github-runner-207 kernel: [ 6436.593650] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 07:11:02 juju-e4d256-prod-github-runner-207 kernel: [ 6436.594734] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 07:11:02 juju-e4d256-prod-github-runner-207 kernel: [ 6436.595847] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 07:11:02 juju-e4d256-prod-github-runner-207 kernel: [ 6436.596824] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 07:11:02 juju-e4d256-prod-github-runner-207 kernel: [ 6436.597820] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 07:11:02 juju-e4d256-prod-github-runner-207 kernel: [ 6436.598844] handle_exit+0x98/0x230 [kvm_amd] Aug 22 07:11:02 juju-e4d256-prod-github-runner-207 kernel: [ 6436.599768] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 07:11:02 juju-e4d256-prod-github-runner-207 kernel: [ 6436.600693] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 07:11:02 juju-e4d256-prod-github-runner-207 kernel: [ 6436.601620] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 07:11:02 juju-e4d256-prod-github-runner-207 kernel: [ 6436.602539] vcpu_run+0x62/0x2c0 [kvm] Aug 22 07:11:02 juju-e4d256-prod-github-runner-207 kernel: [ 6436.603359] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 07:11:02 juju-e4d256-prod-github-runner-207 kernel: [ 6436.604172] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 07:11:02 juju-e4d256-prod-github-runner-207 kernel: [ 6436.605032] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 07:11:02 juju-e4d256-prod-github-runner-207 kernel: [ 6436.605834] ? __seccomp_filter+0x4a/0x4a0 Aug 22 07:11:02 juju-e4d256-prod-github-runner-207 kernel: [ 6436.606577] ? __fget_files+0x86/0xc0 Aug 22 07:11:02 juju-e4d256-prod-github-runner-207 kernel: [ 6436.607300] __x64_sys_ioctl+0x95/0xd0 Aug 22 07:11:02 juju-e4d256-prod-github-runner-207 kernel: [ 6436.608034] do_syscall_64+0x5c/0xc0 Aug 22 07:11:02 juju-e4d256-prod-github-runner-207 kernel: [ 6436.608718] ? do_futex+0x162/0x1f0 Aug 22 07:11:02 juju-e4d256-prod-github-runner-207 kernel: [ 6436.609427] ? __x64_sys_futex+0x78/0x1e0 Aug 22 07:11:02 juju-e4d256-prod-github-runner-207 kernel: [ 6436.610119] ? __secure_computing+0xa9/0x120 Aug 22 07:11:02 juju-e4d256-prod-github-runner-207 kernel: [ 6436.610836] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 07:11:02 juju-e4d256-prod-github-runner-207 kernel: [ 6436.611653] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:11:02 juju-e4d256-prod-github-runner-207 kernel: [ 6436.612390] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:11:02 juju-e4d256-prod-github-runner-207 kernel: [ 6436.613137] ? do_syscall_64+0x69/0xc0 Aug 22 07:11:02 juju-e4d256-prod-github-runner-207 kernel: [ 6436.613782] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:11:02 juju-e4d256-prod-github-runner-207 kernel: [ 6436.614486] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:11:02 juju-e4d256-prod-github-runner-207 kernel: [ 6436.615181] ? do_syscall_64+0x69/0xc0 Aug 22 07:11:02 juju-e4d256-prod-github-runner-207 kernel: [ 6436.615830] ? do_syscall_64+0x69/0xc0 Aug 22 07:11:02 juju-e4d256-prod-github-runner-207 kernel: [ 6436.616453] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 07:11:02 juju-e4d256-prod-github-runner-207 kernel: [ 6436.617158] RIP: 0033:0x7faa5d0edaff Aug 22 07:11:02 juju-e4d256-prod-github-runner-207 kernel: [ 6436.617803] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 07:11:02 juju-e4d256-prod-github-runner-207 kernel: [ 6436.619809] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 07:11:02 juju-e4d256-prod-github-runner-207 kernel: [ 6436.620724] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 07:11:02 juju-e4d256-prod-github-runner-207 kernel: [ 6436.621629] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 07:11:02 juju-e4d256-prod-github-runner-207 kernel: [ 6436.622521] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 07:11:02 juju-e4d256-prod-github-runner-207 kernel: [ 6436.623432] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 07:11:02 juju-e4d256-prod-github-runner-207 kernel: [ 6436.624338] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 07:11:02 juju-e4d256-prod-github-runner-207 kernel: [ 6436.625231] Aug 22 07:11:30 juju-e4d256-prod-github-runner-207 kernel: [ 6464.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 5912s! [qemu-system-x86:6715] Aug 22 07:11:30 juju-e4d256-prod-github-runner-207 kernel: [ 6464.543876] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 07:11:30 juju-e4d256-prod-github-runner-207 kernel: [ 6464.544172] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 07:11:30 juju-e4d256-prod-github-runner-207 kernel: [ 6464.556345] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 07:11:30 juju-e4d256-prod-github-runner-207 kernel: [ 6464.557609] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 07:11:30 juju-e4d256-prod-github-runner-207 kernel: [ 6464.558952] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:11:30 juju-e4d256-prod-github-runner-207 kernel: [ 6464.560455] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 07:11:30 juju-e4d256-prod-github-runner-207 kernel: [ 6464.563623] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 07:11:30 juju-e4d256-prod-github-runner-207 kernel: [ 6464.564694] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 07:11:30 juju-e4d256-prod-github-runner-207 kernel: [ 6464.565857] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 07:11:30 juju-e4d256-prod-github-runner-207 kernel: [ 6464.567033] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 07:11:30 juju-e4d256-prod-github-runner-207 kernel: [ 6464.568203] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 07:11:30 juju-e4d256-prod-github-runner-207 kernel: [ 6464.569366] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 07:11:30 juju-e4d256-prod-github-runner-207 kernel: [ 6464.570539] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 07:11:30 juju-e4d256-prod-github-runner-207 kernel: [ 6464.571789] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 07:11:30 juju-e4d256-prod-github-runner-207 kernel: [ 6464.572899] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 07:11:30 juju-e4d256-prod-github-runner-207 kernel: [ 6464.574108] Call Trace: Aug 22 07:11:30 juju-e4d256-prod-github-runner-207 kernel: [ 6464.575055] Aug 22 07:11:30 juju-e4d256-prod-github-runner-207 kernel: [ 6464.575974] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:11:30 juju-e4d256-prod-github-runner-207 kernel: [ 6464.577014] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:11:30 juju-e4d256-prod-github-runner-207 kernel: [ 6464.578106] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:11:30 juju-e4d256-prod-github-runner-207 kernel: [ 6464.579248] ? show_regs.part.0+0x23/0x29 Aug 22 07:11:30 juju-e4d256-prod-github-runner-207 kernel: [ 6464.580252] ? show_regs.cold+0x8/0xd Aug 22 07:11:30 juju-e4d256-prod-github-runner-207 kernel: [ 6464.581226] ? watchdog_timer_fn+0x1be/0x220 Aug 22 07:11:30 juju-e4d256-prod-github-runner-207 kernel: [ 6464.582234] ? lockup_detector_update_enable+0x60/0x60 Aug 22 07:11:30 juju-e4d256-prod-github-runner-207 kernel: [ 6464.583321] ? __hrtimer_run_queues+0x107/0x230 Aug 22 07:11:30 juju-e4d256-prod-github-runner-207 kernel: [ 6464.584370] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 07:11:30 juju-e4d256-prod-github-runner-207 kernel: [ 6464.585648] ? hrtimer_interrupt+0x101/0x220 Aug 22 07:11:30 juju-e4d256-prod-github-runner-207 kernel: [ 6464.586749] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 07:11:30 juju-e4d256-prod-github-runner-207 kernel: [ 6464.587949] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 07:11:30 juju-e4d256-prod-github-runner-207 kernel: [ 6464.589100] Aug 22 07:11:30 juju-e4d256-prod-github-runner-207 kernel: [ 6464.589998] Aug 22 07:11:30 juju-e4d256-prod-github-runner-207 kernel: [ 6464.590904] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 07:11:30 juju-e4d256-prod-github-runner-207 kernel: [ 6464.592039] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:11:30 juju-e4d256-prod-github-runner-207 kernel: [ 6464.593191] ? _raw_spin_lock+0x22/0x30 Aug 22 07:11:30 juju-e4d256-prod-github-runner-207 kernel: [ 6464.594224] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:11:30 juju-e4d256-prod-github-runner-207 kernel: [ 6464.595365] direct_page_fault+0x206/0x310 [kvm] Aug 22 07:11:30 juju-e4d256-prod-github-runner-207 kernel: [ 6464.596485] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 07:11:30 juju-e4d256-prod-github-runner-207 kernel: [ 6464.597586] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 07:11:30 juju-e4d256-prod-github-runner-207 kernel: [ 6464.598693] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 07:11:30 juju-e4d256-prod-github-runner-207 kernel: [ 6464.599825] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 07:11:30 juju-e4d256-prod-github-runner-207 kernel: [ 6464.600865] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 07:11:30 juju-e4d256-prod-github-runner-207 kernel: [ 6464.601953] handle_exit+0x98/0x230 [kvm_amd] Aug 22 07:11:30 juju-e4d256-prod-github-runner-207 kernel: [ 6464.602960] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 07:11:30 juju-e4d256-prod-github-runner-207 kernel: [ 6464.603985] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 07:11:30 juju-e4d256-prod-github-runner-207 kernel: [ 6464.605124] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 07:11:30 juju-e4d256-prod-github-runner-207 kernel: [ 6464.606122] vcpu_run+0x62/0x2c0 [kvm] Aug 22 07:11:30 juju-e4d256-prod-github-runner-207 kernel: [ 6464.607071] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 07:11:30 juju-e4d256-prod-github-runner-207 kernel: [ 6464.608062] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 07:11:30 juju-e4d256-prod-github-runner-207 kernel: [ 6464.609031] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 07:11:30 juju-e4d256-prod-github-runner-207 kernel: [ 6464.609935] ? __seccomp_filter+0x4a/0x4a0 Aug 22 07:11:30 juju-e4d256-prod-github-runner-207 kernel: [ 6464.610762] ? __fget_files+0x86/0xc0 Aug 22 07:11:30 juju-e4d256-prod-github-runner-207 kernel: [ 6464.611563] __x64_sys_ioctl+0x95/0xd0 Aug 22 07:11:30 juju-e4d256-prod-github-runner-207 kernel: [ 6464.612331] do_syscall_64+0x5c/0xc0 Aug 22 07:11:30 juju-e4d256-prod-github-runner-207 kernel: [ 6464.613074] ? do_futex+0x162/0x1f0 Aug 22 07:11:30 juju-e4d256-prod-github-runner-207 kernel: [ 6464.613792] ? __x64_sys_futex+0x78/0x1e0 Aug 22 07:11:30 juju-e4d256-prod-github-runner-207 kernel: [ 6464.614544] ? __secure_computing+0xa9/0x120 Aug 22 07:11:30 juju-e4d256-prod-github-runner-207 kernel: [ 6464.615331] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 07:11:30 juju-e4d256-prod-github-runner-207 kernel: [ 6464.616192] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:11:30 juju-e4d256-prod-github-runner-207 kernel: [ 6464.617020] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:11:30 juju-e4d256-prod-github-runner-207 kernel: [ 6464.617839] ? do_syscall_64+0x69/0xc0 Aug 22 07:11:30 juju-e4d256-prod-github-runner-207 kernel: [ 6464.618562] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:11:30 juju-e4d256-prod-github-runner-207 kernel: [ 6464.619388] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:11:30 juju-e4d256-prod-github-runner-207 kernel: [ 6464.620188] ? do_syscall_64+0x69/0xc0 Aug 22 07:11:30 juju-e4d256-prod-github-runner-207 kernel: [ 6464.620888] ? do_syscall_64+0x69/0xc0 Aug 22 07:11:30 juju-e4d256-prod-github-runner-207 kernel: [ 6464.621590] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 07:11:30 juju-e4d256-prod-github-runner-207 kernel: [ 6464.622395] RIP: 0033:0x7faa5d0edaff Aug 22 07:11:30 juju-e4d256-prod-github-runner-207 kernel: [ 6464.623153] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 07:11:30 juju-e4d256-prod-github-runner-207 kernel: [ 6464.625541] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 07:11:30 juju-e4d256-prod-github-runner-207 kernel: [ 6464.626621] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 07:11:30 juju-e4d256-prod-github-runner-207 kernel: [ 6464.627699] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 07:11:30 juju-e4d256-prod-github-runner-207 kernel: [ 6464.628740] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 07:11:30 juju-e4d256-prod-github-runner-207 kernel: [ 6464.629766] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 07:11:30 juju-e4d256-prod-github-runner-207 kernel: [ 6464.630892] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 07:11:30 juju-e4d256-prod-github-runner-207 kernel: [ 6464.631925] Aug 22 07:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 6477.620708] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 07:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 6477.621692] rcu: 1-....: (1585143 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=771528 Aug 22 07:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 6477.622887] (t=1590105 jiffies g=23269 q=15282) Aug 22 07:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 6477.623703] NMI backtrace for cpu 1 Aug 22 07:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 6477.624484] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 07:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 6477.625688] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 07:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 6477.626786] Call Trace: Aug 22 07:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 6477.627466] Aug 22 07:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 6477.628113] show_stack+0x52/0x5c Aug 22 07:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 6477.628862] dump_stack_lvl+0x4a/0x63 Aug 22 07:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 6477.629626] dump_stack+0x10/0x16 Aug 22 07:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 6477.630366] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 07:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 6477.631173] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 07:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 6477.631963] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 07:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 6477.632796] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 07:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 6477.633627] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 07:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 6477.634455] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 07:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 6477.635367] print_cpu_stall.cold+0x2f/0xe2 Aug 22 07:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 6477.636163] ? timekeeping_update+0xf7/0x150 Aug 22 07:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 6477.636945] check_cpu_stall+0x109/0x270 Aug 22 07:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 6477.637714] rcu_sched_clock_irq+0x9a/0x250 Aug 22 07:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 6477.638502] update_process_times+0x94/0xd0 Aug 22 07:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 6477.639302] tick_sched_handle+0x29/0x70 Aug 22 07:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 6477.640056] tick_sched_timer+0x8c/0xc0 Aug 22 07:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 6477.640800] ? tick_nohz_handler+0xb0/0xb0 Aug 22 07:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 6477.641562] __hrtimer_run_queues+0x107/0x230 Aug 22 07:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 6477.642343] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 07:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 6477.643137] hrtimer_interrupt+0x101/0x220 Aug 22 07:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 6477.643906] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 07:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 6477.644729] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 07:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 6477.645598] Aug 22 07:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 6477.646428] Aug 22 07:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 6477.647099] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 07:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 6477.647935] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 6477.648829] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 07:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 6477.651106] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 07:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 6477.651994] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 07:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 6477.653006] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 07:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 6477.654006] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 07:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 6477.655096] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 07:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 6477.656074] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 07:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 6477.657045] ? _raw_spin_lock+0x22/0x30 Aug 22 07:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 6477.657812] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 6477.658658] direct_page_fault+0x206/0x310 [kvm] Aug 22 07:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 6477.659519] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 07:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 6477.660346] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 07:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 6477.661165] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 07:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 6477.661979] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 07:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 6477.662806] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 07:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 6477.663627] handle_exit+0x98/0x230 [kvm_amd] Aug 22 07:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 6477.664378] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 07:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 6477.665166] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 07:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 6477.665962] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 07:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 6477.666760] vcpu_run+0x62/0x2c0 [kvm] Aug 22 07:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 6477.667488] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 07:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 6477.668224] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 07:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 6477.669115] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 07:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 6477.669940] ? __seccomp_filter+0x4a/0x4a0 Aug 22 07:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 6477.670661] ? __fget_files+0x86/0xc0 Aug 22 07:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 6477.671386] __x64_sys_ioctl+0x95/0xd0 Aug 22 07:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 6477.672080] do_syscall_64+0x5c/0xc0 Aug 22 07:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 6477.672814] ? do_futex+0x162/0x1f0 Aug 22 07:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 6477.673485] ? __x64_sys_futex+0x78/0x1e0 Aug 22 07:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 6477.674189] ? __secure_computing+0xa9/0x120 Aug 22 07:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 6477.675114] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 07:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 6477.675909] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 6477.676662] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 6477.677419] ? do_syscall_64+0x69/0xc0 Aug 22 07:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 6477.678112] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 6477.678881] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 6477.679636] ? do_syscall_64+0x69/0xc0 Aug 22 07:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 6477.680329] ? do_syscall_64+0x69/0xc0 Aug 22 07:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 6477.681014] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 07:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 6477.681804] RIP: 0033:0x7faa5d0edaff Aug 22 07:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 6477.682510] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 07:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 6477.684625] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 07:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 6477.685592] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 07:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 6477.686552] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 07:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 6477.687511] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 07:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 6477.688450] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 07:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 6477.689393] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 07:11:43 juju-e4d256-prod-github-runner-207 kernel: [ 6477.690325] Aug 22 07:12:10 juju-e4d256-prod-github-runner-207 kernel: [ 6504.541976] watchdog: BUG: soft lockup - CPU#1 stuck for 5949s! [qemu-system-x86:6715] Aug 22 07:12:10 juju-e4d256-prod-github-runner-207 kernel: [ 6504.543288] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 07:12:10 juju-e4d256-prod-github-runner-207 kernel: [ 6504.543362] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 07:12:10 juju-e4d256-prod-github-runner-207 kernel: [ 6504.555670] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 07:12:10 juju-e4d256-prod-github-runner-207 kernel: [ 6504.556930] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 07:12:10 juju-e4d256-prod-github-runner-207 kernel: [ 6504.558143] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:12:10 juju-e4d256-prod-github-runner-207 kernel: [ 6504.559241] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 07:12:10 juju-e4d256-prod-github-runner-207 kernel: [ 6504.561851] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 07:12:10 juju-e4d256-prod-github-runner-207 kernel: [ 6504.562914] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 07:12:10 juju-e4d256-prod-github-runner-207 kernel: [ 6504.564075] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 07:12:10 juju-e4d256-prod-github-runner-207 kernel: [ 6504.565237] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 07:12:10 juju-e4d256-prod-github-runner-207 kernel: [ 6504.566415] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 07:12:10 juju-e4d256-prod-github-runner-207 kernel: [ 6504.567575] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 07:12:10 juju-e4d256-prod-github-runner-207 kernel: [ 6504.568738] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 07:12:10 juju-e4d256-prod-github-runner-207 kernel: [ 6504.569965] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 07:12:10 juju-e4d256-prod-github-runner-207 kernel: [ 6504.571079] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 07:12:10 juju-e4d256-prod-github-runner-207 kernel: [ 6504.572279] Call Trace: Aug 22 07:12:10 juju-e4d256-prod-github-runner-207 kernel: [ 6504.573190] Aug 22 07:12:10 juju-e4d256-prod-github-runner-207 kernel: [ 6504.574085] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:12:10 juju-e4d256-prod-github-runner-207 kernel: [ 6504.575136] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:12:10 juju-e4d256-prod-github-runner-207 kernel: [ 6504.576160] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:12:10 juju-e4d256-prod-github-runner-207 kernel: [ 6504.577232] ? show_regs.part.0+0x23/0x29 Aug 22 07:12:10 juju-e4d256-prod-github-runner-207 kernel: [ 6504.578225] ? show_regs.cold+0x8/0xd Aug 22 07:12:10 juju-e4d256-prod-github-runner-207 kernel: [ 6504.579209] ? watchdog_timer_fn+0x1be/0x220 Aug 22 07:12:10 juju-e4d256-prod-github-runner-207 kernel: [ 6504.580234] ? lockup_detector_update_enable+0x60/0x60 Aug 22 07:12:10 juju-e4d256-prod-github-runner-207 kernel: [ 6504.581331] ? __hrtimer_run_queues+0x107/0x230 Aug 22 07:12:10 juju-e4d256-prod-github-runner-207 kernel: [ 6504.582366] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 07:12:10 juju-e4d256-prod-github-runner-207 kernel: [ 6504.583431] ? hrtimer_interrupt+0x101/0x220 Aug 22 07:12:10 juju-e4d256-prod-github-runner-207 kernel: [ 6504.584453] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 07:12:10 juju-e4d256-prod-github-runner-207 kernel: [ 6504.585520] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 07:12:10 juju-e4d256-prod-github-runner-207 kernel: [ 6504.586581] Aug 22 07:12:10 juju-e4d256-prod-github-runner-207 kernel: [ 6504.587439] Aug 22 07:12:10 juju-e4d256-prod-github-runner-207 kernel: [ 6504.588297] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 07:12:10 juju-e4d256-prod-github-runner-207 kernel: [ 6504.589371] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:12:10 juju-e4d256-prod-github-runner-207 kernel: [ 6504.590440] ? _raw_spin_lock+0x22/0x30 Aug 22 07:12:10 juju-e4d256-prod-github-runner-207 kernel: [ 6504.591396] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:12:10 juju-e4d256-prod-github-runner-207 kernel: [ 6504.592455] direct_page_fault+0x206/0x310 [kvm] Aug 22 07:12:10 juju-e4d256-prod-github-runner-207 kernel: [ 6504.593502] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 07:12:10 juju-e4d256-prod-github-runner-207 kernel: [ 6504.594541] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 07:12:10 juju-e4d256-prod-github-runner-207 kernel: [ 6504.595546] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 07:12:10 juju-e4d256-prod-github-runner-207 kernel: [ 6504.596519] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 07:12:10 juju-e4d256-prod-github-runner-207 kernel: [ 6504.597468] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 07:12:10 juju-e4d256-prod-github-runner-207 kernel: [ 6504.598471] handle_exit+0x98/0x230 [kvm_amd] Aug 22 07:12:10 juju-e4d256-prod-github-runner-207 kernel: [ 6504.599367] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 07:12:10 juju-e4d256-prod-github-runner-207 kernel: [ 6504.600286] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 07:12:10 juju-e4d256-prod-github-runner-207 kernel: [ 6504.601214] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 07:12:10 juju-e4d256-prod-github-runner-207 kernel: [ 6504.602164] vcpu_run+0x62/0x2c0 [kvm] Aug 22 07:12:10 juju-e4d256-prod-github-runner-207 kernel: [ 6504.603010] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 07:12:10 juju-e4d256-prod-github-runner-207 kernel: [ 6504.603827] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 07:12:10 juju-e4d256-prod-github-runner-207 kernel: [ 6504.604705] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 07:12:10 juju-e4d256-prod-github-runner-207 kernel: [ 6504.605512] ? __seccomp_filter+0x4a/0x4a0 Aug 22 07:12:10 juju-e4d256-prod-github-runner-207 kernel: [ 6504.606288] ? __fget_files+0x86/0xc0 Aug 22 07:12:10 juju-e4d256-prod-github-runner-207 kernel: [ 6504.607057] __x64_sys_ioctl+0x95/0xd0 Aug 22 07:12:10 juju-e4d256-prod-github-runner-207 kernel: [ 6504.607772] do_syscall_64+0x5c/0xc0 Aug 22 07:12:10 juju-e4d256-prod-github-runner-207 kernel: [ 6504.608460] ? do_futex+0x162/0x1f0 Aug 22 07:12:10 juju-e4d256-prod-github-runner-207 kernel: [ 6504.609131] ? __x64_sys_futex+0x78/0x1e0 Aug 22 07:12:10 juju-e4d256-prod-github-runner-207 kernel: [ 6504.609839] ? __secure_computing+0xa9/0x120 Aug 22 07:12:10 juju-e4d256-prod-github-runner-207 kernel: [ 6504.610557] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 07:12:10 juju-e4d256-prod-github-runner-207 kernel: [ 6504.611339] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:12:10 juju-e4d256-prod-github-runner-207 kernel: [ 6504.612069] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:12:10 juju-e4d256-prod-github-runner-207 kernel: [ 6504.612796] ? do_syscall_64+0x69/0xc0 Aug 22 07:12:10 juju-e4d256-prod-github-runner-207 kernel: [ 6504.613446] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:12:10 juju-e4d256-prod-github-runner-207 kernel: [ 6504.614160] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:12:10 juju-e4d256-prod-github-runner-207 kernel: [ 6504.614895] ? do_syscall_64+0x69/0xc0 Aug 22 07:12:10 juju-e4d256-prod-github-runner-207 kernel: [ 6504.615559] ? do_syscall_64+0x69/0xc0 Aug 22 07:12:10 juju-e4d256-prod-github-runner-207 kernel: [ 6504.616226] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 07:12:10 juju-e4d256-prod-github-runner-207 kernel: [ 6504.616948] RIP: 0033:0x7faa5d0edaff Aug 22 07:12:10 juju-e4d256-prod-github-runner-207 kernel: [ 6504.617589] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 07:12:10 juju-e4d256-prod-github-runner-207 kernel: [ 6504.619688] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 07:12:10 juju-e4d256-prod-github-runner-207 kernel: [ 6504.620626] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 07:12:10 juju-e4d256-prod-github-runner-207 kernel: [ 6504.621553] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 07:12:10 juju-e4d256-prod-github-runner-207 kernel: [ 6504.622475] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 07:12:10 juju-e4d256-prod-github-runner-207 kernel: [ 6504.623440] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 07:12:10 juju-e4d256-prod-github-runner-207 kernel: [ 6504.624350] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 07:12:10 juju-e4d256-prod-github-runner-207 kernel: [ 6504.625255] Aug 22 07:12:38 juju-e4d256-prod-github-runner-207 kernel: [ 6532.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 5975s! [qemu-system-x86:6715] Aug 22 07:12:38 juju-e4d256-prod-github-runner-207 kernel: [ 6532.543877] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 07:12:38 juju-e4d256-prod-github-runner-207 kernel: [ 6532.544179] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 07:12:38 juju-e4d256-prod-github-runner-207 kernel: [ 6532.557058] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 07:12:38 juju-e4d256-prod-github-runner-207 kernel: [ 6532.558391] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 07:12:38 juju-e4d256-prod-github-runner-207 kernel: [ 6532.559655] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:12:38 juju-e4d256-prod-github-runner-207 kernel: [ 6532.560734] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 07:12:38 juju-e4d256-prod-github-runner-207 kernel: [ 6532.563326] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 07:12:38 juju-e4d256-prod-github-runner-207 kernel: [ 6532.564376] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 07:12:38 juju-e4d256-prod-github-runner-207 kernel: [ 6532.565554] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 07:12:38 juju-e4d256-prod-github-runner-207 kernel: [ 6532.566739] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 07:12:38 juju-e4d256-prod-github-runner-207 kernel: [ 6532.567914] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 07:12:38 juju-e4d256-prod-github-runner-207 kernel: [ 6532.569093] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 07:12:38 juju-e4d256-prod-github-runner-207 kernel: [ 6532.570302] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 07:12:38 juju-e4d256-prod-github-runner-207 kernel: [ 6532.571570] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 07:12:38 juju-e4d256-prod-github-runner-207 kernel: [ 6532.572676] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 07:12:38 juju-e4d256-prod-github-runner-207 kernel: [ 6532.573883] Call Trace: Aug 22 07:12:38 juju-e4d256-prod-github-runner-207 kernel: [ 6532.574807] Aug 22 07:12:38 juju-e4d256-prod-github-runner-207 kernel: [ 6532.575731] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:12:38 juju-e4d256-prod-github-runner-207 kernel: [ 6532.576805] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:12:38 juju-e4d256-prod-github-runner-207 kernel: [ 6532.577847] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:12:38 juju-e4d256-prod-github-runner-207 kernel: [ 6532.578998] ? show_regs.part.0+0x23/0x29 Aug 22 07:12:38 juju-e4d256-prod-github-runner-207 kernel: [ 6532.580027] ? show_regs.cold+0x8/0xd Aug 22 07:12:38 juju-e4d256-prod-github-runner-207 kernel: [ 6532.581013] ? watchdog_timer_fn+0x1be/0x220 Aug 22 07:12:38 juju-e4d256-prod-github-runner-207 kernel: [ 6532.582059] ? lockup_detector_update_enable+0x60/0x60 Aug 22 07:12:38 juju-e4d256-prod-github-runner-207 kernel: [ 6532.583162] ? __hrtimer_run_queues+0x107/0x230 Aug 22 07:12:38 juju-e4d256-prod-github-runner-207 kernel: [ 6532.584265] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 07:12:38 juju-e4d256-prod-github-runner-207 kernel: [ 6532.585803] ? hrtimer_interrupt+0x101/0x220 Aug 22 07:12:38 juju-e4d256-prod-github-runner-207 kernel: [ 6532.587555] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 07:12:38 juju-e4d256-prod-github-runner-207 kernel: [ 6532.588964] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 07:12:38 juju-e4d256-prod-github-runner-207 kernel: [ 6532.590270] Aug 22 07:12:38 juju-e4d256-prod-github-runner-207 kernel: [ 6532.591146] Aug 22 07:12:38 juju-e4d256-prod-github-runner-207 kernel: [ 6532.592019] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 07:12:38 juju-e4d256-prod-github-runner-207 kernel: [ 6532.593348] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:12:38 juju-e4d256-prod-github-runner-207 kernel: [ 6532.594484] ? _raw_spin_lock+0x22/0x30 Aug 22 07:12:38 juju-e4d256-prod-github-runner-207 kernel: [ 6532.595450] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:12:38 juju-e4d256-prod-github-runner-207 kernel: [ 6532.596837] direct_page_fault+0x206/0x310 [kvm] Aug 22 07:12:38 juju-e4d256-prod-github-runner-207 kernel: [ 6532.597958] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 07:12:38 juju-e4d256-prod-github-runner-207 kernel: [ 6532.599042] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 07:12:38 juju-e4d256-prod-github-runner-207 kernel: [ 6532.600116] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 07:12:38 juju-e4d256-prod-github-runner-207 kernel: [ 6532.601163] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 07:12:38 juju-e4d256-prod-github-runner-207 kernel: [ 6532.602170] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 07:12:38 juju-e4d256-prod-github-runner-207 kernel: [ 6532.603210] handle_exit+0x98/0x230 [kvm_amd] Aug 22 07:12:38 juju-e4d256-prod-github-runner-207 kernel: [ 6532.604170] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 07:12:38 juju-e4d256-prod-github-runner-207 kernel: [ 6532.605314] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 07:12:38 juju-e4d256-prod-github-runner-207 kernel: [ 6532.606419] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 07:12:38 juju-e4d256-prod-github-runner-207 kernel: [ 6532.607488] vcpu_run+0x62/0x2c0 [kvm] Aug 22 07:12:38 juju-e4d256-prod-github-runner-207 kernel: [ 6532.608339] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 07:12:38 juju-e4d256-prod-github-runner-207 kernel: [ 6532.609161] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 07:12:38 juju-e4d256-prod-github-runner-207 kernel: [ 6532.610025] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 07:12:38 juju-e4d256-prod-github-runner-207 kernel: [ 6532.610889] ? __seccomp_filter+0x4a/0x4a0 Aug 22 07:12:38 juju-e4d256-prod-github-runner-207 kernel: [ 6532.611654] ? __fget_files+0x86/0xc0 Aug 22 07:12:38 juju-e4d256-prod-github-runner-207 kernel: [ 6532.612365] __x64_sys_ioctl+0x95/0xd0 Aug 22 07:12:38 juju-e4d256-prod-github-runner-207 kernel: [ 6532.613076] do_syscall_64+0x5c/0xc0 Aug 22 07:12:38 juju-e4d256-prod-github-runner-207 kernel: [ 6532.613749] ? do_futex+0x162/0x1f0 Aug 22 07:12:38 juju-e4d256-prod-github-runner-207 kernel: [ 6532.614415] ? __x64_sys_futex+0x78/0x1e0 Aug 22 07:12:38 juju-e4d256-prod-github-runner-207 kernel: [ 6532.615105] ? __secure_computing+0xa9/0x120 Aug 22 07:12:38 juju-e4d256-prod-github-runner-207 kernel: [ 6532.615834] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 07:12:38 juju-e4d256-prod-github-runner-207 kernel: [ 6532.616612] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:12:38 juju-e4d256-prod-github-runner-207 kernel: [ 6532.617344] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:12:38 juju-e4d256-prod-github-runner-207 kernel: [ 6532.618077] ? do_syscall_64+0x69/0xc0 Aug 22 07:12:38 juju-e4d256-prod-github-runner-207 kernel: [ 6532.618730] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:12:38 juju-e4d256-prod-github-runner-207 kernel: [ 6532.619441] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:12:38 juju-e4d256-prod-github-runner-207 kernel: [ 6532.620181] ? do_syscall_64+0x69/0xc0 Aug 22 07:12:38 juju-e4d256-prod-github-runner-207 kernel: [ 6532.620858] ? do_syscall_64+0x69/0xc0 Aug 22 07:12:38 juju-e4d256-prod-github-runner-207 kernel: [ 6532.621518] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 07:12:38 juju-e4d256-prod-github-runner-207 kernel: [ 6532.622264] RIP: 0033:0x7faa5d0edaff Aug 22 07:12:38 juju-e4d256-prod-github-runner-207 kernel: [ 6532.622945] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 07:12:38 juju-e4d256-prod-github-runner-207 kernel: [ 6532.624980] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 07:12:38 juju-e4d256-prod-github-runner-207 kernel: [ 6532.625910] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 07:12:38 juju-e4d256-prod-github-runner-207 kernel: [ 6532.626904] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 07:12:38 juju-e4d256-prod-github-runner-207 kernel: [ 6532.627826] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 07:12:38 juju-e4d256-prod-github-runner-207 kernel: [ 6532.628739] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 07:12:38 juju-e4d256-prod-github-runner-207 kernel: [ 6532.629662] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 07:12:38 juju-e4d256-prod-github-runner-207 kernel: [ 6532.630587] Aug 22 07:13:06 juju-e4d256-prod-github-runner-207 kernel: [ 6560.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 6001s! [qemu-system-x86:6715] Aug 22 07:13:06 juju-e4d256-prod-github-runner-207 kernel: [ 6560.543091] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 07:13:06 juju-e4d256-prod-github-runner-207 kernel: [ 6560.543165] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 07:13:06 juju-e4d256-prod-github-runner-207 kernel: [ 6560.555588] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 07:13:06 juju-e4d256-prod-github-runner-207 kernel: [ 6560.556861] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 07:13:06 juju-e4d256-prod-github-runner-207 kernel: [ 6560.558098] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:13:06 juju-e4d256-prod-github-runner-207 kernel: [ 6560.559163] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 07:13:06 juju-e4d256-prod-github-runner-207 kernel: [ 6560.561729] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 07:13:06 juju-e4d256-prod-github-runner-207 kernel: [ 6560.562775] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 07:13:06 juju-e4d256-prod-github-runner-207 kernel: [ 6560.563955] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 07:13:06 juju-e4d256-prod-github-runner-207 kernel: [ 6560.565125] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 07:13:06 juju-e4d256-prod-github-runner-207 kernel: [ 6560.566292] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 07:13:06 juju-e4d256-prod-github-runner-207 kernel: [ 6560.567456] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 07:13:06 juju-e4d256-prod-github-runner-207 kernel: [ 6560.568623] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 07:13:06 juju-e4d256-prod-github-runner-207 kernel: [ 6560.569879] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 07:13:06 juju-e4d256-prod-github-runner-207 kernel: [ 6560.570976] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 07:13:06 juju-e4d256-prod-github-runner-207 kernel: [ 6560.572172] Call Trace: Aug 22 07:13:06 juju-e4d256-prod-github-runner-207 kernel: [ 6560.573090] Aug 22 07:13:06 juju-e4d256-prod-github-runner-207 kernel: [ 6560.574000] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:13:06 juju-e4d256-prod-github-runner-207 kernel: [ 6560.575032] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:13:06 juju-e4d256-prod-github-runner-207 kernel: [ 6560.576060] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:13:06 juju-e4d256-prod-github-runner-207 kernel: [ 6560.577150] ? show_regs.part.0+0x23/0x29 Aug 22 07:13:06 juju-e4d256-prod-github-runner-207 kernel: [ 6560.578170] ? show_regs.cold+0x8/0xd Aug 22 07:13:06 juju-e4d256-prod-github-runner-207 kernel: [ 6560.579144] ? watchdog_timer_fn+0x1be/0x220 Aug 22 07:13:06 juju-e4d256-prod-github-runner-207 kernel: [ 6560.580186] ? lockup_detector_update_enable+0x60/0x60 Aug 22 07:13:06 juju-e4d256-prod-github-runner-207 kernel: [ 6560.581252] ? __hrtimer_run_queues+0x107/0x230 Aug 22 07:13:06 juju-e4d256-prod-github-runner-207 kernel: [ 6560.582300] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 07:13:06 juju-e4d256-prod-github-runner-207 kernel: [ 6560.583323] ? hrtimer_interrupt+0x101/0x220 Aug 22 07:13:06 juju-e4d256-prod-github-runner-207 kernel: [ 6560.584336] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 07:13:06 juju-e4d256-prod-github-runner-207 kernel: [ 6560.585406] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 07:13:06 juju-e4d256-prod-github-runner-207 kernel: [ 6560.586779] Aug 22 07:13:06 juju-e4d256-prod-github-runner-207 kernel: [ 6560.587857] Aug 22 07:13:06 juju-e4d256-prod-github-runner-207 kernel: [ 6560.588708] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 07:13:06 juju-e4d256-prod-github-runner-207 kernel: [ 6560.590056] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:13:06 juju-e4d256-prod-github-runner-207 kernel: [ 6560.591493] ? _raw_spin_lock+0x22/0x30 Aug 22 07:13:06 juju-e4d256-prod-github-runner-207 kernel: [ 6560.592786] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:13:06 juju-e4d256-prod-github-runner-207 kernel: [ 6560.594009] direct_page_fault+0x206/0x310 [kvm] Aug 22 07:13:06 juju-e4d256-prod-github-runner-207 kernel: [ 6560.595067] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 07:13:06 juju-e4d256-prod-github-runner-207 kernel: [ 6560.596084] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 07:13:06 juju-e4d256-prod-github-runner-207 kernel: [ 6560.597157] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 07:13:06 juju-e4d256-prod-github-runner-207 kernel: [ 6560.598215] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 07:13:06 juju-e4d256-prod-github-runner-207 kernel: [ 6560.599187] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 07:13:06 juju-e4d256-prod-github-runner-207 kernel: [ 6560.600189] handle_exit+0x98/0x230 [kvm_amd] Aug 22 07:13:06 juju-e4d256-prod-github-runner-207 kernel: [ 6560.601100] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 07:13:06 juju-e4d256-prod-github-runner-207 kernel: [ 6560.602054] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 07:13:06 juju-e4d256-prod-github-runner-207 kernel: [ 6560.602981] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 07:13:06 juju-e4d256-prod-github-runner-207 kernel: [ 6560.603883] vcpu_run+0x62/0x2c0 [kvm] Aug 22 07:13:06 juju-e4d256-prod-github-runner-207 kernel: [ 6560.604700] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 07:13:06 juju-e4d256-prod-github-runner-207 kernel: [ 6560.605522] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 07:13:06 juju-e4d256-prod-github-runner-207 kernel: [ 6560.606414] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 07:13:06 juju-e4d256-prod-github-runner-207 kernel: [ 6560.607223] ? __seccomp_filter+0x4a/0x4a0 Aug 22 07:13:06 juju-e4d256-prod-github-runner-207 kernel: [ 6560.607986] ? __fget_files+0x86/0xc0 Aug 22 07:13:06 juju-e4d256-prod-github-runner-207 kernel: [ 6560.608702] __x64_sys_ioctl+0x95/0xd0 Aug 22 07:13:06 juju-e4d256-prod-github-runner-207 kernel: [ 6560.609423] do_syscall_64+0x5c/0xc0 Aug 22 07:13:06 juju-e4d256-prod-github-runner-207 kernel: [ 6560.610130] ? do_futex+0x162/0x1f0 Aug 22 07:13:06 juju-e4d256-prod-github-runner-207 kernel: [ 6560.610782] ? __x64_sys_futex+0x78/0x1e0 Aug 22 07:13:06 juju-e4d256-prod-github-runner-207 kernel: [ 6560.611458] ? __secure_computing+0xa9/0x120 Aug 22 07:13:06 juju-e4d256-prod-github-runner-207 kernel: [ 6560.612153] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 07:13:06 juju-e4d256-prod-github-runner-207 kernel: [ 6560.612915] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:13:06 juju-e4d256-prod-github-runner-207 kernel: [ 6560.613644] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:13:06 juju-e4d256-prod-github-runner-207 kernel: [ 6560.614383] ? do_syscall_64+0x69/0xc0 Aug 22 07:13:06 juju-e4d256-prod-github-runner-207 kernel: [ 6560.615029] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:13:06 juju-e4d256-prod-github-runner-207 kernel: [ 6560.615742] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:13:06 juju-e4d256-prod-github-runner-207 kernel: [ 6560.616441] ? do_syscall_64+0x69/0xc0 Aug 22 07:13:06 juju-e4d256-prod-github-runner-207 kernel: [ 6560.617073] ? do_syscall_64+0x69/0xc0 Aug 22 07:13:06 juju-e4d256-prod-github-runner-207 kernel: [ 6560.617710] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 07:13:06 juju-e4d256-prod-github-runner-207 kernel: [ 6560.618422] RIP: 0033:0x7faa5d0edaff Aug 22 07:13:06 juju-e4d256-prod-github-runner-207 kernel: [ 6560.619052] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 07:13:06 juju-e4d256-prod-github-runner-207 kernel: [ 6560.621059] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 07:13:06 juju-e4d256-prod-github-runner-207 kernel: [ 6560.621989] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 07:13:06 juju-e4d256-prod-github-runner-207 kernel: [ 6560.622885] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 07:13:06 juju-e4d256-prod-github-runner-207 kernel: [ 6560.623776] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 07:13:06 juju-e4d256-prod-github-runner-207 kernel: [ 6560.624671] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 07:13:06 juju-e4d256-prod-github-runner-207 kernel: [ 6560.625569] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 07:13:06 juju-e4d256-prod-github-runner-207 kernel: [ 6560.626488] Aug 22 07:13:34 juju-e4d256-prod-github-runner-207 kernel: [ 6588.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 6028s! [qemu-system-x86:6715] Aug 22 07:13:34 juju-e4d256-prod-github-runner-207 kernel: [ 6588.544070] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 07:13:34 juju-e4d256-prod-github-runner-207 kernel: [ 6588.544402] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 07:13:34 juju-e4d256-prod-github-runner-207 kernel: [ 6588.556768] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 07:13:34 juju-e4d256-prod-github-runner-207 kernel: [ 6588.558110] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 07:13:34 juju-e4d256-prod-github-runner-207 kernel: [ 6588.559348] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:13:34 juju-e4d256-prod-github-runner-207 kernel: [ 6588.560419] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 07:13:34 juju-e4d256-prod-github-runner-207 kernel: [ 6588.563561] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 07:13:34 juju-e4d256-prod-github-runner-207 kernel: [ 6588.564929] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 07:13:34 juju-e4d256-prod-github-runner-207 kernel: [ 6588.566195] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 07:13:34 juju-e4d256-prod-github-runner-207 kernel: [ 6588.567593] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 07:13:34 juju-e4d256-prod-github-runner-207 kernel: [ 6588.568773] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 07:13:34 juju-e4d256-prod-github-runner-207 kernel: [ 6588.569957] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 07:13:34 juju-e4d256-prod-github-runner-207 kernel: [ 6588.571138] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 07:13:34 juju-e4d256-prod-github-runner-207 kernel: [ 6588.572469] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 07:13:34 juju-e4d256-prod-github-runner-207 kernel: [ 6588.573607] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 07:13:34 juju-e4d256-prod-github-runner-207 kernel: [ 6588.574917] Call Trace: Aug 22 07:13:34 juju-e4d256-prod-github-runner-207 kernel: [ 6588.576065] Aug 22 07:13:34 juju-e4d256-prod-github-runner-207 kernel: [ 6588.577248] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:13:34 juju-e4d256-prod-github-runner-207 kernel: [ 6588.578329] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:13:34 juju-e4d256-prod-github-runner-207 kernel: [ 6588.579365] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:13:34 juju-e4d256-prod-github-runner-207 kernel: [ 6588.580490] ? show_regs.part.0+0x23/0x29 Aug 22 07:13:34 juju-e4d256-prod-github-runner-207 kernel: [ 6588.581522] ? show_regs.cold+0x8/0xd Aug 22 07:13:34 juju-e4d256-prod-github-runner-207 kernel: [ 6588.582523] ? watchdog_timer_fn+0x1be/0x220 Aug 22 07:13:34 juju-e4d256-prod-github-runner-207 kernel: [ 6588.583571] ? lockup_detector_update_enable+0x60/0x60 Aug 22 07:13:34 juju-e4d256-prod-github-runner-207 kernel: [ 6588.584640] ? __hrtimer_run_queues+0x107/0x230 Aug 22 07:13:34 juju-e4d256-prod-github-runner-207 kernel: [ 6588.585723] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 07:13:34 juju-e4d256-prod-github-runner-207 kernel: [ 6588.586780] ? hrtimer_interrupt+0x101/0x220 Aug 22 07:13:34 juju-e4d256-prod-github-runner-207 kernel: [ 6588.587834] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 07:13:34 juju-e4d256-prod-github-runner-207 kernel: [ 6588.588934] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 07:13:34 juju-e4d256-prod-github-runner-207 kernel: [ 6588.590009] Aug 22 07:13:34 juju-e4d256-prod-github-runner-207 kernel: [ 6588.590936] Aug 22 07:13:34 juju-e4d256-prod-github-runner-207 kernel: [ 6588.591991] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 07:13:34 juju-e4d256-prod-github-runner-207 kernel: [ 6588.593468] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:13:34 juju-e4d256-prod-github-runner-207 kernel: [ 6588.595156] ? _raw_spin_lock+0x22/0x30 Aug 22 07:13:34 juju-e4d256-prod-github-runner-207 kernel: [ 6588.596389] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:13:34 juju-e4d256-prod-github-runner-207 kernel: [ 6588.597469] direct_page_fault+0x206/0x310 [kvm] Aug 22 07:13:34 juju-e4d256-prod-github-runner-207 kernel: [ 6588.598507] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 07:13:34 juju-e4d256-prod-github-runner-207 kernel: [ 6588.599543] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 07:13:34 juju-e4d256-prod-github-runner-207 kernel: [ 6588.600552] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 07:13:34 juju-e4d256-prod-github-runner-207 kernel: [ 6588.601604] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 07:13:34 juju-e4d256-prod-github-runner-207 kernel: [ 6588.602589] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 07:13:34 juju-e4d256-prod-github-runner-207 kernel: [ 6588.603887] handle_exit+0x98/0x230 [kvm_amd] Aug 22 07:13:34 juju-e4d256-prod-github-runner-207 kernel: [ 6588.605319] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 07:13:34 juju-e4d256-prod-github-runner-207 kernel: [ 6588.606713] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 07:13:34 juju-e4d256-prod-github-runner-207 kernel: [ 6588.607660] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 07:13:34 juju-e4d256-prod-github-runner-207 kernel: [ 6588.608577] vcpu_run+0x62/0x2c0 [kvm] Aug 22 07:13:34 juju-e4d256-prod-github-runner-207 kernel: [ 6588.609430] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 07:13:34 juju-e4d256-prod-github-runner-207 kernel: [ 6588.610251] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 07:13:34 juju-e4d256-prod-github-runner-207 kernel: [ 6588.611131] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 07:13:34 juju-e4d256-prod-github-runner-207 kernel: [ 6588.611937] ? __seccomp_filter+0x4a/0x4a0 Aug 22 07:13:34 juju-e4d256-prod-github-runner-207 kernel: [ 6588.612689] ? __fget_files+0x86/0xc0 Aug 22 07:13:34 juju-e4d256-prod-github-runner-207 kernel: [ 6588.613419] __x64_sys_ioctl+0x95/0xd0 Aug 22 07:13:34 juju-e4d256-prod-github-runner-207 kernel: [ 6588.614119] do_syscall_64+0x5c/0xc0 Aug 22 07:13:34 juju-e4d256-prod-github-runner-207 kernel: [ 6588.614846] ? do_futex+0x162/0x1f0 Aug 22 07:13:34 juju-e4d256-prod-github-runner-207 kernel: [ 6588.615512] ? __x64_sys_futex+0x78/0x1e0 Aug 22 07:13:34 juju-e4d256-prod-github-runner-207 kernel: [ 6588.616206] ? __secure_computing+0xa9/0x120 Aug 22 07:13:34 juju-e4d256-prod-github-runner-207 kernel: [ 6588.616914] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 07:13:34 juju-e4d256-prod-github-runner-207 kernel: [ 6588.617703] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:13:34 juju-e4d256-prod-github-runner-207 kernel: [ 6588.618448] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:13:34 juju-e4d256-prod-github-runner-207 kernel: [ 6588.619192] ? do_syscall_64+0x69/0xc0 Aug 22 07:13:34 juju-e4d256-prod-github-runner-207 kernel: [ 6588.619840] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:13:34 juju-e4d256-prod-github-runner-207 kernel: [ 6588.620545] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:13:34 juju-e4d256-prod-github-runner-207 kernel: [ 6588.621244] ? do_syscall_64+0x69/0xc0 Aug 22 07:13:34 juju-e4d256-prod-github-runner-207 kernel: [ 6588.621884] ? do_syscall_64+0x69/0xc0 Aug 22 07:13:34 juju-e4d256-prod-github-runner-207 kernel: [ 6588.622515] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 07:13:34 juju-e4d256-prod-github-runner-207 kernel: [ 6588.623294] RIP: 0033:0x7faa5d0edaff Aug 22 07:13:34 juju-e4d256-prod-github-runner-207 kernel: [ 6588.624264] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 07:13:34 juju-e4d256-prod-github-runner-207 kernel: [ 6588.627319] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 07:13:34 juju-e4d256-prod-github-runner-207 kernel: [ 6588.628303] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 07:13:34 juju-e4d256-prod-github-runner-207 kernel: [ 6588.629245] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 07:13:34 juju-e4d256-prod-github-runner-207 kernel: [ 6588.630210] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 07:13:34 juju-e4d256-prod-github-runner-207 kernel: [ 6588.631146] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 07:13:34 juju-e4d256-prod-github-runner-207 kernel: [ 6588.632191] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 07:13:34 juju-e4d256-prod-github-runner-207 kernel: [ 6588.633244] Aug 22 07:14:02 juju-e4d256-prod-github-runner-207 kernel: [ 6616.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 6054s! [qemu-system-x86:6715] Aug 22 07:14:02 juju-e4d256-prod-github-runner-207 kernel: [ 6616.543109] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 07:14:02 juju-e4d256-prod-github-runner-207 kernel: [ 6616.543182] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 07:14:02 juju-e4d256-prod-github-runner-207 kernel: [ 6616.555816] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 07:14:02 juju-e4d256-prod-github-runner-207 kernel: [ 6616.557169] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 07:14:02 juju-e4d256-prod-github-runner-207 kernel: [ 6616.558408] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:14:02 juju-e4d256-prod-github-runner-207 kernel: [ 6616.559478] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 07:14:02 juju-e4d256-prod-github-runner-207 kernel: [ 6616.562136] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 07:14:02 juju-e4d256-prod-github-runner-207 kernel: [ 6616.563207] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 07:14:02 juju-e4d256-prod-github-runner-207 kernel: [ 6616.564392] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 07:14:02 juju-e4d256-prod-github-runner-207 kernel: [ 6616.565605] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 07:14:02 juju-e4d256-prod-github-runner-207 kernel: [ 6616.566790] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 07:14:02 juju-e4d256-prod-github-runner-207 kernel: [ 6616.567970] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 07:14:02 juju-e4d256-prod-github-runner-207 kernel: [ 6616.569169] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 07:14:02 juju-e4d256-prod-github-runner-207 kernel: [ 6616.570425] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 07:14:02 juju-e4d256-prod-github-runner-207 kernel: [ 6616.571530] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 07:14:02 juju-e4d256-prod-github-runner-207 kernel: [ 6616.572729] Call Trace: Aug 22 07:14:02 juju-e4d256-prod-github-runner-207 kernel: [ 6616.573667] Aug 22 07:14:02 juju-e4d256-prod-github-runner-207 kernel: [ 6616.574553] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:14:02 juju-e4d256-prod-github-runner-207 kernel: [ 6616.575590] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:14:02 juju-e4d256-prod-github-runner-207 kernel: [ 6616.576613] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:14:02 juju-e4d256-prod-github-runner-207 kernel: [ 6616.577918] ? show_regs.part.0+0x23/0x29 Aug 22 07:14:02 juju-e4d256-prod-github-runner-207 kernel: [ 6616.579036] ? show_regs.cold+0x8/0xd Aug 22 07:14:02 juju-e4d256-prod-github-runner-207 kernel: [ 6616.580080] ? watchdog_timer_fn+0x1be/0x220 Aug 22 07:14:02 juju-e4d256-prod-github-runner-207 kernel: [ 6616.581213] ? lockup_detector_update_enable+0x60/0x60 Aug 22 07:14:02 juju-e4d256-prod-github-runner-207 kernel: [ 6616.582392] ? __hrtimer_run_queues+0x107/0x230 Aug 22 07:14:02 juju-e4d256-prod-github-runner-207 kernel: [ 6616.583515] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 07:14:02 juju-e4d256-prod-github-runner-207 kernel: [ 6616.584626] ? hrtimer_interrupt+0x101/0x220 Aug 22 07:14:02 juju-e4d256-prod-github-runner-207 kernel: [ 6616.585763] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 07:14:02 juju-e4d256-prod-github-runner-207 kernel: [ 6616.586941] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 07:14:02 juju-e4d256-prod-github-runner-207 kernel: [ 6616.588119] Aug 22 07:14:02 juju-e4d256-prod-github-runner-207 kernel: [ 6616.589057] Aug 22 07:14:02 juju-e4d256-prod-github-runner-207 kernel: [ 6616.589948] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 07:14:02 juju-e4d256-prod-github-runner-207 kernel: [ 6616.591093] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:14:02 juju-e4d256-prod-github-runner-207 kernel: [ 6616.592243] ? _raw_spin_lock+0x22/0x30 Aug 22 07:14:02 juju-e4d256-prod-github-runner-207 kernel: [ 6616.593290] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:14:02 juju-e4d256-prod-github-runner-207 kernel: [ 6616.594400] direct_page_fault+0x206/0x310 [kvm] Aug 22 07:14:02 juju-e4d256-prod-github-runner-207 kernel: [ 6616.595514] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 07:14:02 juju-e4d256-prod-github-runner-207 kernel: [ 6616.596643] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 07:14:02 juju-e4d256-prod-github-runner-207 kernel: [ 6616.597754] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 07:14:02 juju-e4d256-prod-github-runner-207 kernel: [ 6616.598819] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 07:14:02 juju-e4d256-prod-github-runner-207 kernel: [ 6616.599872] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 07:14:02 juju-e4d256-prod-github-runner-207 kernel: [ 6616.601062] handle_exit+0x98/0x230 [kvm_amd] Aug 22 07:14:02 juju-e4d256-prod-github-runner-207 kernel: [ 6616.602065] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 07:14:02 juju-e4d256-prod-github-runner-207 kernel: [ 6616.603082] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 07:14:02 juju-e4d256-prod-github-runner-207 kernel: [ 6616.604126] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 07:14:02 juju-e4d256-prod-github-runner-207 kernel: [ 6616.605327] vcpu_run+0x62/0x2c0 [kvm] Aug 22 07:14:02 juju-e4d256-prod-github-runner-207 kernel: [ 6616.606229] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 07:14:02 juju-e4d256-prod-github-runner-207 kernel: [ 6616.607129] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 07:14:02 juju-e4d256-prod-github-runner-207 kernel: [ 6616.608090] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 07:14:02 juju-e4d256-prod-github-runner-207 kernel: [ 6616.609013] ? __seccomp_filter+0x4a/0x4a0 Aug 22 07:14:02 juju-e4d256-prod-github-runner-207 kernel: [ 6616.609843] ? __fget_files+0x86/0xc0 Aug 22 07:14:02 juju-e4d256-prod-github-runner-207 kernel: [ 6616.610623] __x64_sys_ioctl+0x95/0xd0 Aug 22 07:14:02 juju-e4d256-prod-github-runner-207 kernel: [ 6616.611390] do_syscall_64+0x5c/0xc0 Aug 22 07:14:02 juju-e4d256-prod-github-runner-207 kernel: [ 6616.612130] ? do_futex+0x162/0x1f0 Aug 22 07:14:02 juju-e4d256-prod-github-runner-207 kernel: [ 6616.612852] ? __x64_sys_futex+0x78/0x1e0 Aug 22 07:14:02 juju-e4d256-prod-github-runner-207 kernel: [ 6616.613633] ? __secure_computing+0xa9/0x120 Aug 22 07:14:02 juju-e4d256-prod-github-runner-207 kernel: [ 6616.614410] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 07:14:02 juju-e4d256-prod-github-runner-207 kernel: [ 6616.615276] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:14:02 juju-e4d256-prod-github-runner-207 kernel: [ 6616.616094] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:14:02 juju-e4d256-prod-github-runner-207 kernel: [ 6616.616905] ? do_syscall_64+0x69/0xc0 Aug 22 07:14:02 juju-e4d256-prod-github-runner-207 kernel: [ 6616.617646] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:14:02 juju-e4d256-prod-github-runner-207 kernel: [ 6616.618451] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:14:02 juju-e4d256-prod-github-runner-207 kernel: [ 6616.619274] ? do_syscall_64+0x69/0xc0 Aug 22 07:14:02 juju-e4d256-prod-github-runner-207 kernel: [ 6616.619994] ? do_syscall_64+0x69/0xc0 Aug 22 07:14:02 juju-e4d256-prod-github-runner-207 kernel: [ 6616.620691] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 07:14:02 juju-e4d256-prod-github-runner-207 kernel: [ 6616.621530] RIP: 0033:0x7faa5d0edaff Aug 22 07:14:02 juju-e4d256-prod-github-runner-207 kernel: [ 6616.622249] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 07:14:02 juju-e4d256-prod-github-runner-207 kernel: [ 6616.624580] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 07:14:02 juju-e4d256-prod-github-runner-207 kernel: [ 6616.625647] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 07:14:02 juju-e4d256-prod-github-runner-207 kernel: [ 6616.626673] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 07:14:02 juju-e4d256-prod-github-runner-207 kernel: [ 6616.627692] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 07:14:02 juju-e4d256-prod-github-runner-207 kernel: [ 6616.628717] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 07:14:02 juju-e4d256-prod-github-runner-207 kernel: [ 6616.629756] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 07:14:02 juju-e4d256-prod-github-runner-207 kernel: [ 6616.630786] Aug 22 07:14:30 juju-e4d256-prod-github-runner-207 kernel: [ 6644.541981] watchdog: BUG: soft lockup - CPU#1 stuck for 6080s! [qemu-system-x86:6715] Aug 22 07:14:30 juju-e4d256-prod-github-runner-207 kernel: [ 6644.543125] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 07:14:30 juju-e4d256-prod-github-runner-207 kernel: [ 6644.543198] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 07:14:30 juju-e4d256-prod-github-runner-207 kernel: [ 6644.555923] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 07:14:30 juju-e4d256-prod-github-runner-207 kernel: [ 6644.557267] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 07:14:30 juju-e4d256-prod-github-runner-207 kernel: [ 6644.558509] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:14:30 juju-e4d256-prod-github-runner-207 kernel: [ 6644.559584] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 07:14:30 juju-e4d256-prod-github-runner-207 kernel: [ 6644.562205] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 07:14:30 juju-e4d256-prod-github-runner-207 kernel: [ 6644.563249] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 07:14:30 juju-e4d256-prod-github-runner-207 kernel: [ 6644.564412] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 07:14:30 juju-e4d256-prod-github-runner-207 kernel: [ 6644.565595] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 07:14:30 juju-e4d256-prod-github-runner-207 kernel: [ 6644.566762] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 07:14:30 juju-e4d256-prod-github-runner-207 kernel: [ 6644.567927] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 07:14:30 juju-e4d256-prod-github-runner-207 kernel: [ 6644.569138] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 07:14:30 juju-e4d256-prod-github-runner-207 kernel: [ 6644.570434] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 07:14:30 juju-e4d256-prod-github-runner-207 kernel: [ 6644.571555] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 07:14:30 juju-e4d256-prod-github-runner-207 kernel: [ 6644.572833] Call Trace: Aug 22 07:14:30 juju-e4d256-prod-github-runner-207 kernel: [ 6644.573778] Aug 22 07:14:30 juju-e4d256-prod-github-runner-207 kernel: [ 6644.574681] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:14:30 juju-e4d256-prod-github-runner-207 kernel: [ 6644.575759] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:14:30 juju-e4d256-prod-github-runner-207 kernel: [ 6644.576811] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:14:30 juju-e4d256-prod-github-runner-207 kernel: [ 6644.577911] ? show_regs.part.0+0x23/0x29 Aug 22 07:14:30 juju-e4d256-prod-github-runner-207 kernel: [ 6644.578906] ? show_regs.cold+0x8/0xd Aug 22 07:14:30 juju-e4d256-prod-github-runner-207 kernel: [ 6644.579873] ? watchdog_timer_fn+0x1be/0x220 Aug 22 07:14:30 juju-e4d256-prod-github-runner-207 kernel: [ 6644.580908] ? lockup_detector_update_enable+0x60/0x60 Aug 22 07:14:30 juju-e4d256-prod-github-runner-207 kernel: [ 6644.581973] ? __hrtimer_run_queues+0x107/0x230 Aug 22 07:14:30 juju-e4d256-prod-github-runner-207 kernel: [ 6644.583002] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 07:14:30 juju-e4d256-prod-github-runner-207 kernel: [ 6644.584021] ? hrtimer_interrupt+0x101/0x220 Aug 22 07:14:30 juju-e4d256-prod-github-runner-207 kernel: [ 6644.585048] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 07:14:30 juju-e4d256-prod-github-runner-207 kernel: [ 6644.586189] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 07:14:30 juju-e4d256-prod-github-runner-207 kernel: [ 6644.587255] Aug 22 07:14:30 juju-e4d256-prod-github-runner-207 kernel: [ 6644.588109] Aug 22 07:14:30 juju-e4d256-prod-github-runner-207 kernel: [ 6644.588961] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 07:14:30 juju-e4d256-prod-github-runner-207 kernel: [ 6644.589995] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:14:30 juju-e4d256-prod-github-runner-207 kernel: [ 6644.591041] ? _raw_spin_lock+0x22/0x30 Aug 22 07:14:30 juju-e4d256-prod-github-runner-207 kernel: [ 6644.591985] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:14:30 juju-e4d256-prod-github-runner-207 kernel: [ 6644.593016] direct_page_fault+0x206/0x310 [kvm] Aug 22 07:14:30 juju-e4d256-prod-github-runner-207 kernel: [ 6644.594039] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 07:14:30 juju-e4d256-prod-github-runner-207 kernel: [ 6644.595046] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 07:14:30 juju-e4d256-prod-github-runner-207 kernel: [ 6644.596045] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 07:14:30 juju-e4d256-prod-github-runner-207 kernel: [ 6644.597041] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 07:14:30 juju-e4d256-prod-github-runner-207 kernel: [ 6644.597992] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 07:14:30 juju-e4d256-prod-github-runner-207 kernel: [ 6644.599036] handle_exit+0x98/0x230 [kvm_amd] Aug 22 07:14:30 juju-e4d256-prod-github-runner-207 kernel: [ 6644.599988] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 07:14:30 juju-e4d256-prod-github-runner-207 kernel: [ 6644.600946] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 07:14:30 juju-e4d256-prod-github-runner-207 kernel: [ 6644.601910] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 07:14:30 juju-e4d256-prod-github-runner-207 kernel: [ 6644.602819] vcpu_run+0x62/0x2c0 [kvm] Aug 22 07:14:30 juju-e4d256-prod-github-runner-207 kernel: [ 6644.603904] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 07:14:30 juju-e4d256-prod-github-runner-207 kernel: [ 6644.605244] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 07:14:30 juju-e4d256-prod-github-runner-207 kernel: [ 6644.606623] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 07:14:30 juju-e4d256-prod-github-runner-207 kernel: [ 6644.607891] ? __seccomp_filter+0x4a/0x4a0 Aug 22 07:14:30 juju-e4d256-prod-github-runner-207 kernel: [ 6644.609187] ? __fget_files+0x86/0xc0 Aug 22 07:14:30 juju-e4d256-prod-github-runner-207 kernel: [ 6644.610311] __x64_sys_ioctl+0x95/0xd0 Aug 22 07:14:30 juju-e4d256-prod-github-runner-207 kernel: [ 6644.611188] do_syscall_64+0x5c/0xc0 Aug 22 07:14:30 juju-e4d256-prod-github-runner-207 kernel: [ 6644.611924] ? do_futex+0x162/0x1f0 Aug 22 07:14:30 juju-e4d256-prod-github-runner-207 kernel: [ 6644.612580] ? __x64_sys_futex+0x78/0x1e0 Aug 22 07:14:30 juju-e4d256-prod-github-runner-207 kernel: [ 6644.613309] ? __secure_computing+0xa9/0x120 Aug 22 07:14:30 juju-e4d256-prod-github-runner-207 kernel: [ 6644.614125] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 07:14:30 juju-e4d256-prod-github-runner-207 kernel: [ 6644.615324] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:14:30 juju-e4d256-prod-github-runner-207 kernel: [ 6644.616561] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:14:30 juju-e4d256-prod-github-runner-207 kernel: [ 6644.617743] ? do_syscall_64+0x69/0xc0 Aug 22 07:14:30 juju-e4d256-prod-github-runner-207 kernel: [ 6644.618797] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:14:30 juju-e4d256-prod-github-runner-207 kernel: [ 6644.619883] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:14:30 juju-e4d256-prod-github-runner-207 kernel: [ 6644.620967] ? do_syscall_64+0x69/0xc0 Aug 22 07:14:30 juju-e4d256-prod-github-runner-207 kernel: [ 6644.621934] ? do_syscall_64+0x69/0xc0 Aug 22 07:14:30 juju-e4d256-prod-github-runner-207 kernel: [ 6644.622829] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 07:14:30 juju-e4d256-prod-github-runner-207 kernel: [ 6644.623591] RIP: 0033:0x7faa5d0edaff Aug 22 07:14:30 juju-e4d256-prod-github-runner-207 kernel: [ 6644.624235] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 07:14:30 juju-e4d256-prod-github-runner-207 kernel: [ 6644.626349] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 07:14:30 juju-e4d256-prod-github-runner-207 kernel: [ 6644.627319] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 07:14:30 juju-e4d256-prod-github-runner-207 kernel: [ 6644.628254] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 07:14:30 juju-e4d256-prod-github-runner-207 kernel: [ 6644.629217] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 07:14:30 juju-e4d256-prod-github-runner-207 kernel: [ 6644.630157] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 07:14:30 juju-e4d256-prod-github-runner-207 kernel: [ 6644.631079] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 07:14:30 juju-e4d256-prod-github-runner-207 kernel: [ 6644.632032] Aug 22 07:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 6657.632710] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 07:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 6657.633779] rcu: 1-....: (1630005 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=792864 Aug 22 07:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 6657.634954] (t=1635108 jiffies g=23269 q=15521) Aug 22 07:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 6657.635756] NMI backtrace for cpu 1 Aug 22 07:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 6657.636494] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 07:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 6657.637636] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 07:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 6657.638712] Call Trace: Aug 22 07:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 6657.639399] Aug 22 07:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 6657.640066] show_stack+0x52/0x5c Aug 22 07:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 6657.640828] dump_stack_lvl+0x4a/0x63 Aug 22 07:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 6657.641585] dump_stack+0x10/0x16 Aug 22 07:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 6657.642312] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 07:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 6657.643105] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 07:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 6657.643919] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 07:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 6657.644836] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 07:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 6657.645667] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 07:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 6657.646477] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 07:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 6657.647248] print_cpu_stall.cold+0x2f/0xe2 Aug 22 07:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 6657.648012] ? timekeeping_update+0xf7/0x150 Aug 22 07:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 6657.649064] check_cpu_stall+0x109/0x270 Aug 22 07:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 6657.649897] rcu_sched_clock_irq+0x9a/0x250 Aug 22 07:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 6657.650749] update_process_times+0x94/0xd0 Aug 22 07:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 6657.651597] tick_sched_handle+0x29/0x70 Aug 22 07:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 6657.652604] tick_sched_timer+0x8c/0xc0 Aug 22 07:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 6657.653588] ? tick_nohz_handler+0xb0/0xb0 Aug 22 07:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 6657.654418] __hrtimer_run_queues+0x107/0x230 Aug 22 07:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 6657.655280] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 07:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 6657.656142] hrtimer_interrupt+0x101/0x220 Aug 22 07:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 6657.656994] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 07:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 6657.657898] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 07:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 6657.658792] Aug 22 07:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 6657.659486] Aug 22 07:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 6657.660166] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 07:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 6657.661106] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 6657.662107] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 07:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 6657.664679] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 07:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 6657.665661] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 07:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 6657.666806] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 07:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 6657.667946] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 07:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 6657.669054] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 07:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 6657.670139] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 07:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 6657.671242] ? _raw_spin_lock+0x22/0x30 Aug 22 07:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 6657.672088] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 6657.673067] direct_page_fault+0x206/0x310 [kvm] Aug 22 07:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 6657.674003] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 07:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 6657.674923] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 07:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 6657.675862] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 07:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 6657.676813] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 07:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 6657.677689] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 07:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 6657.678626] handle_exit+0x98/0x230 [kvm_amd] Aug 22 07:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 6657.679467] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 07:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 6657.680340] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 07:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 6657.681254] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 07:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 6657.682136] vcpu_run+0x62/0x2c0 [kvm] Aug 22 07:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 6657.682934] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 07:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 6657.683761] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 07:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 6657.684685] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 07:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 6657.685535] ? __seccomp_filter+0x4a/0x4a0 Aug 22 07:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 6657.686336] ? __fget_files+0x86/0xc0 Aug 22 07:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 6657.687104] __x64_sys_ioctl+0x95/0xd0 Aug 22 07:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 6657.687871] do_syscall_64+0x5c/0xc0 Aug 22 07:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 6657.688641] ? do_futex+0x162/0x1f0 Aug 22 07:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 6657.689379] ? __x64_sys_futex+0x78/0x1e0 Aug 22 07:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 6657.690160] ? __secure_computing+0xa9/0x120 Aug 22 07:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 6657.690962] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 07:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 6657.691855] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 6657.692796] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 6657.693648] ? do_syscall_64+0x69/0xc0 Aug 22 07:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 6657.694408] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 6657.695262] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 6657.696118] ? do_syscall_64+0x69/0xc0 Aug 22 07:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 6657.696904] ? do_syscall_64+0x69/0xc0 Aug 22 07:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 6657.697672] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 07:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 6657.698545] RIP: 0033:0x7faa5d0edaff Aug 22 07:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 6657.699348] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 07:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 6657.701796] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 07:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 6657.702896] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 07:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 6657.703977] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 07:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 6657.705073] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 07:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 6657.706153] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 07:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 6657.707208] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 07:14:43 juju-e4d256-prod-github-runner-207 kernel: [ 6657.708255] Aug 22 07:15:10 juju-e4d256-prod-github-runner-207 kernel: [ 6684.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 6117s! [qemu-system-x86:6715] Aug 22 07:15:10 juju-e4d256-prod-github-runner-207 kernel: [ 6684.543873] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 07:15:10 juju-e4d256-prod-github-runner-207 kernel: [ 6684.544198] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 07:15:10 juju-e4d256-prod-github-runner-207 kernel: [ 6684.556827] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 07:15:10 juju-e4d256-prod-github-runner-207 kernel: [ 6684.558139] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 07:15:10 juju-e4d256-prod-github-runner-207 kernel: [ 6684.559511] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:15:10 juju-e4d256-prod-github-runner-207 kernel: [ 6684.560638] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 07:15:10 juju-e4d256-prod-github-runner-207 kernel: [ 6684.563446] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 07:15:10 juju-e4d256-prod-github-runner-207 kernel: [ 6684.564614] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 07:15:10 juju-e4d256-prod-github-runner-207 kernel: [ 6684.565850] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 07:15:10 juju-e4d256-prod-github-runner-207 kernel: [ 6684.567057] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 07:15:10 juju-e4d256-prod-github-runner-207 kernel: [ 6684.568260] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 07:15:10 juju-e4d256-prod-github-runner-207 kernel: [ 6684.569434] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 07:15:10 juju-e4d256-prod-github-runner-207 kernel: [ 6684.570616] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 07:15:10 juju-e4d256-prod-github-runner-207 kernel: [ 6684.571871] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 07:15:10 juju-e4d256-prod-github-runner-207 kernel: [ 6684.573020] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 07:15:10 juju-e4d256-prod-github-runner-207 kernel: [ 6684.574258] Call Trace: Aug 22 07:15:10 juju-e4d256-prod-github-runner-207 kernel: [ 6684.575193] Aug 22 07:15:10 juju-e4d256-prod-github-runner-207 kernel: [ 6684.576150] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:15:10 juju-e4d256-prod-github-runner-207 kernel: [ 6684.577236] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:15:10 juju-e4d256-prod-github-runner-207 kernel: [ 6684.578307] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:15:10 juju-e4d256-prod-github-runner-207 kernel: [ 6684.579420] ? show_regs.part.0+0x23/0x29 Aug 22 07:15:10 juju-e4d256-prod-github-runner-207 kernel: [ 6684.580456] ? show_regs.cold+0x8/0xd Aug 22 07:15:10 juju-e4d256-prod-github-runner-207 kernel: [ 6684.581463] ? watchdog_timer_fn+0x1be/0x220 Aug 22 07:15:10 juju-e4d256-prod-github-runner-207 kernel: [ 6684.582529] ? lockup_detector_update_enable+0x60/0x60 Aug 22 07:15:10 juju-e4d256-prod-github-runner-207 kernel: [ 6684.583791] ? __hrtimer_run_queues+0x107/0x230 Aug 22 07:15:10 juju-e4d256-prod-github-runner-207 kernel: [ 6684.585029] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 07:15:10 juju-e4d256-prod-github-runner-207 kernel: [ 6684.586097] ? hrtimer_interrupt+0x101/0x220 Aug 22 07:15:10 juju-e4d256-prod-github-runner-207 kernel: [ 6684.587153] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 07:15:10 juju-e4d256-prod-github-runner-207 kernel: [ 6684.588252] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 07:15:10 juju-e4d256-prod-github-runner-207 kernel: [ 6684.589310] Aug 22 07:15:10 juju-e4d256-prod-github-runner-207 kernel: [ 6684.590168] Aug 22 07:15:10 juju-e4d256-prod-github-runner-207 kernel: [ 6684.591019] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 07:15:10 juju-e4d256-prod-github-runner-207 kernel: [ 6684.592232] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:15:10 juju-e4d256-prod-github-runner-207 kernel: [ 6684.593393] ? _raw_spin_lock+0x22/0x30 Aug 22 07:15:10 juju-e4d256-prod-github-runner-207 kernel: [ 6684.594431] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:15:10 juju-e4d256-prod-github-runner-207 kernel: [ 6684.595561] direct_page_fault+0x206/0x310 [kvm] Aug 22 07:15:10 juju-e4d256-prod-github-runner-207 kernel: [ 6684.596710] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 07:15:10 juju-e4d256-prod-github-runner-207 kernel: [ 6684.597821] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 07:15:10 juju-e4d256-prod-github-runner-207 kernel: [ 6684.598916] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 07:15:10 juju-e4d256-prod-github-runner-207 kernel: [ 6684.600014] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 07:15:10 juju-e4d256-prod-github-runner-207 kernel: [ 6684.601100] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 07:15:10 juju-e4d256-prod-github-runner-207 kernel: [ 6684.602189] handle_exit+0x98/0x230 [kvm_amd] Aug 22 07:15:10 juju-e4d256-prod-github-runner-207 kernel: [ 6684.603175] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 07:15:10 juju-e4d256-prod-github-runner-207 kernel: [ 6684.604209] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 07:15:10 juju-e4d256-prod-github-runner-207 kernel: [ 6684.605242] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 07:15:10 juju-e4d256-prod-github-runner-207 kernel: [ 6684.606271] vcpu_run+0x62/0x2c0 [kvm] Aug 22 07:15:10 juju-e4d256-prod-github-runner-207 kernel: [ 6684.607170] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 07:15:10 juju-e4d256-prod-github-runner-207 kernel: [ 6684.608081] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 07:15:10 juju-e4d256-prod-github-runner-207 kernel: [ 6684.609092] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 07:15:10 juju-e4d256-prod-github-runner-207 kernel: [ 6684.610003] ? __seccomp_filter+0x4a/0x4a0 Aug 22 07:15:10 juju-e4d256-prod-github-runner-207 kernel: [ 6684.610840] ? __fget_files+0x86/0xc0 Aug 22 07:15:10 juju-e4d256-prod-github-runner-207 kernel: [ 6684.611631] __x64_sys_ioctl+0x95/0xd0 Aug 22 07:15:10 juju-e4d256-prod-github-runner-207 kernel: [ 6684.612447] do_syscall_64+0x5c/0xc0 Aug 22 07:15:10 juju-e4d256-prod-github-runner-207 kernel: [ 6684.613205] ? do_futex+0x162/0x1f0 Aug 22 07:15:10 juju-e4d256-prod-github-runner-207 kernel: [ 6684.613940] ? __x64_sys_futex+0x78/0x1e0 Aug 22 07:15:10 juju-e4d256-prod-github-runner-207 kernel: [ 6684.614710] ? __secure_computing+0xa9/0x120 Aug 22 07:15:10 juju-e4d256-prod-github-runner-207 kernel: [ 6684.615505] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 07:15:10 juju-e4d256-prod-github-runner-207 kernel: [ 6684.616424] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:15:10 juju-e4d256-prod-github-runner-207 kernel: [ 6684.617264] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:15:10 juju-e4d256-prod-github-runner-207 kernel: [ 6684.618091] ? do_syscall_64+0x69/0xc0 Aug 22 07:15:10 juju-e4d256-prod-github-runner-207 kernel: [ 6684.618839] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:15:10 juju-e4d256-prod-github-runner-207 kernel: [ 6684.619666] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:15:10 juju-e4d256-prod-github-runner-207 kernel: [ 6684.620489] ? do_syscall_64+0x69/0xc0 Aug 22 07:15:10 juju-e4d256-prod-github-runner-207 kernel: [ 6684.621210] ? do_syscall_64+0x69/0xc0 Aug 22 07:15:10 juju-e4d256-prod-github-runner-207 kernel: [ 6684.622013] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 07:15:10 juju-e4d256-prod-github-runner-207 kernel: [ 6684.622896] RIP: 0033:0x7faa5d0edaff Aug 22 07:15:10 juju-e4d256-prod-github-runner-207 kernel: [ 6684.623599] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 07:15:10 juju-e4d256-prod-github-runner-207 kernel: [ 6684.625996] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 07:15:10 juju-e4d256-prod-github-runner-207 kernel: [ 6684.627083] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 07:15:10 juju-e4d256-prod-github-runner-207 kernel: [ 6684.628147] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 07:15:10 juju-e4d256-prod-github-runner-207 kernel: [ 6684.629184] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 07:15:10 juju-e4d256-prod-github-runner-207 kernel: [ 6684.630219] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 07:15:10 juju-e4d256-prod-github-runner-207 kernel: [ 6684.631254] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 07:15:10 juju-e4d256-prod-github-runner-207 kernel: [ 6684.632312] Aug 22 07:15:38 juju-e4d256-prod-github-runner-207 kernel: [ 6712.541981] watchdog: BUG: soft lockup - CPU#1 stuck for 6143s! [qemu-system-x86:6715] Aug 22 07:15:38 juju-e4d256-prod-github-runner-207 kernel: [ 6712.545078] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 07:15:38 juju-e4d256-prod-github-runner-207 kernel: [ 6712.545153] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 07:15:38 juju-e4d256-prod-github-runner-207 kernel: [ 6712.574120] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 07:15:38 juju-e4d256-prod-github-runner-207 kernel: [ 6712.575410] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 07:15:38 juju-e4d256-prod-github-runner-207 kernel: [ 6712.578623] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:15:38 juju-e4d256-prod-github-runner-207 kernel: [ 6712.581679] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 07:15:38 juju-e4d256-prod-github-runner-207 kernel: [ 6712.588549] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 07:15:38 juju-e4d256-prod-github-runner-207 kernel: [ 6712.589664] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 07:15:38 juju-e4d256-prod-github-runner-207 kernel: [ 6712.592896] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 07:15:38 juju-e4d256-prod-github-runner-207 kernel: [ 6712.596058] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 07:15:38 juju-e4d256-prod-github-runner-207 kernel: [ 6712.597456] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 07:15:38 juju-e4d256-prod-github-runner-207 kernel: [ 6712.600752] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 07:15:38 juju-e4d256-prod-github-runner-207 kernel: [ 6712.604058] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 07:15:38 juju-e4d256-prod-github-runner-207 kernel: [ 6712.607433] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 07:15:38 juju-e4d256-prod-github-runner-207 kernel: [ 6712.608761] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 07:15:38 juju-e4d256-prod-github-runner-207 kernel: [ 6712.610187] Call Trace: Aug 22 07:15:38 juju-e4d256-prod-github-runner-207 kernel: [ 6712.611241] Aug 22 07:15:38 juju-e4d256-prod-github-runner-207 kernel: [ 6712.612280] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:15:38 juju-e4d256-prod-github-runner-207 kernel: [ 6712.613497] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:15:38 juju-e4d256-prod-github-runner-207 kernel: [ 6712.614735] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:15:38 juju-e4d256-prod-github-runner-207 kernel: [ 6712.616111] ? show_regs.part.0+0x23/0x29 Aug 22 07:15:38 juju-e4d256-prod-github-runner-207 kernel: [ 6712.617339] ? show_regs.cold+0x8/0xd Aug 22 07:15:38 juju-e4d256-prod-github-runner-207 kernel: [ 6712.618388] ? watchdog_timer_fn+0x1be/0x220 Aug 22 07:15:38 juju-e4d256-prod-github-runner-207 kernel: [ 6712.619484] ? lockup_detector_update_enable+0x60/0x60 Aug 22 07:15:38 juju-e4d256-prod-github-runner-207 kernel: [ 6712.620660] ? __hrtimer_run_queues+0x107/0x230 Aug 22 07:15:38 juju-e4d256-prod-github-runner-207 kernel: [ 6712.621783] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 07:15:38 juju-e4d256-prod-github-runner-207 kernel: [ 6712.622893] ? hrtimer_interrupt+0x101/0x220 Aug 22 07:15:38 juju-e4d256-prod-github-runner-207 kernel: [ 6712.624006] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 07:15:38 juju-e4d256-prod-github-runner-207 kernel: [ 6712.625179] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 07:15:38 juju-e4d256-prod-github-runner-207 kernel: [ 6712.626316] Aug 22 07:15:38 juju-e4d256-prod-github-runner-207 kernel: [ 6712.627222] Aug 22 07:15:38 juju-e4d256-prod-github-runner-207 kernel: [ 6712.628120] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 07:15:38 juju-e4d256-prod-github-runner-207 kernel: [ 6712.629263] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:15:38 juju-e4d256-prod-github-runner-207 kernel: [ 6712.630415] ? _raw_spin_lock+0x22/0x30 Aug 22 07:15:38 juju-e4d256-prod-github-runner-207 kernel: [ 6712.631451] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:15:38 juju-e4d256-prod-github-runner-207 kernel: [ 6712.632608] direct_page_fault+0x206/0x310 [kvm] Aug 22 07:15:38 juju-e4d256-prod-github-runner-207 kernel: [ 6712.633723] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 07:15:38 juju-e4d256-prod-github-runner-207 kernel: [ 6712.634823] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 07:15:38 juju-e4d256-prod-github-runner-207 kernel: [ 6712.635939] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 07:15:38 juju-e4d256-prod-github-runner-207 kernel: [ 6712.637002] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 07:15:38 juju-e4d256-prod-github-runner-207 kernel: [ 6712.638040] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 07:15:38 juju-e4d256-prod-github-runner-207 kernel: [ 6712.639122] handle_exit+0x98/0x230 [kvm_amd] Aug 22 07:15:38 juju-e4d256-prod-github-runner-207 kernel: [ 6712.640116] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 07:15:38 juju-e4d256-prod-github-runner-207 kernel: [ 6712.641120] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 07:15:38 juju-e4d256-prod-github-runner-207 kernel: [ 6712.642135] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 07:15:38 juju-e4d256-prod-github-runner-207 kernel: [ 6712.643132] vcpu_run+0x62/0x2c0 [kvm] Aug 22 07:15:38 juju-e4d256-prod-github-runner-207 kernel: [ 6712.644028] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 07:15:38 juju-e4d256-prod-github-runner-207 kernel: [ 6712.644922] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 07:15:38 juju-e4d256-prod-github-runner-207 kernel: [ 6712.645874] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 07:15:38 juju-e4d256-prod-github-runner-207 kernel: [ 6712.646759] ? __seccomp_filter+0x4a/0x4a0 Aug 22 07:15:38 juju-e4d256-prod-github-runner-207 kernel: [ 6712.647621] ? __fget_files+0x86/0xc0 Aug 22 07:15:38 juju-e4d256-prod-github-runner-207 kernel: [ 6712.648365] __x64_sys_ioctl+0x95/0xd0 Aug 22 07:15:38 juju-e4d256-prod-github-runner-207 kernel: [ 6712.649059] do_syscall_64+0x5c/0xc0 Aug 22 07:15:38 juju-e4d256-prod-github-runner-207 kernel: [ 6712.649729] ? do_futex+0x162/0x1f0 Aug 22 07:15:38 juju-e4d256-prod-github-runner-207 kernel: [ 6712.650381] ? __x64_sys_futex+0x78/0x1e0 Aug 22 07:15:38 juju-e4d256-prod-github-runner-207 kernel: [ 6712.651056] ? __secure_computing+0xa9/0x120 Aug 22 07:15:38 juju-e4d256-prod-github-runner-207 kernel: [ 6712.651769] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 07:15:38 juju-e4d256-prod-github-runner-207 kernel: [ 6712.652531] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:15:38 juju-e4d256-prod-github-runner-207 kernel: [ 6712.653271] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:15:38 juju-e4d256-prod-github-runner-207 kernel: [ 6712.654009] ? do_syscall_64+0x69/0xc0 Aug 22 07:15:38 juju-e4d256-prod-github-runner-207 kernel: [ 6712.654660] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:15:38 juju-e4d256-prod-github-runner-207 kernel: [ 6712.655363] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:15:38 juju-e4d256-prod-github-runner-207 kernel: [ 6712.656095] ? do_syscall_64+0x69/0xc0 Aug 22 07:15:38 juju-e4d256-prod-github-runner-207 kernel: [ 6712.656770] ? do_syscall_64+0x69/0xc0 Aug 22 07:15:38 juju-e4d256-prod-github-runner-207 kernel: [ 6712.657394] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 07:15:38 juju-e4d256-prod-github-runner-207 kernel: [ 6712.658095] RIP: 0033:0x7faa5d0edaff Aug 22 07:15:38 juju-e4d256-prod-github-runner-207 kernel: [ 6712.658721] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 07:15:38 juju-e4d256-prod-github-runner-207 kernel: [ 6712.660739] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 07:15:38 juju-e4d256-prod-github-runner-207 kernel: [ 6712.661648] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 07:15:38 juju-e4d256-prod-github-runner-207 kernel: [ 6712.662540] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 07:15:38 juju-e4d256-prod-github-runner-207 kernel: [ 6712.663424] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 07:15:38 juju-e4d256-prod-github-runner-207 kernel: [ 6712.664337] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 07:15:38 juju-e4d256-prod-github-runner-207 kernel: [ 6712.665230] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 07:15:38 juju-e4d256-prod-github-runner-207 kernel: [ 6712.666122] Aug 22 07:16:06 juju-e4d256-prod-github-runner-207 kernel: [ 6740.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 6169s! [qemu-system-x86:6715] Aug 22 07:16:06 juju-e4d256-prod-github-runner-207 kernel: [ 6740.543887] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 07:16:06 juju-e4d256-prod-github-runner-207 kernel: [ 6740.544205] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 07:16:06 juju-e4d256-prod-github-runner-207 kernel: [ 6740.556322] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 07:16:06 juju-e4d256-prod-github-runner-207 kernel: [ 6740.557592] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 07:16:06 juju-e4d256-prod-github-runner-207 kernel: [ 6740.558837] RIP: 0010:native_queued_spin_lock_slowpath+0xc/0x40 Aug 22 07:16:06 juju-e4d256-prod-github-runner-207 kernel: [ 6740.559903] Code: fe ff ff eb af 4c 89 fe 48 c7 c7 20 99 e9 89 e8 ca 69 55 00 e9 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 <8b> 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 eb Aug 22 07:16:06 juju-e4d256-prod-github-runner-207 kernel: [ 6740.562444] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 07:16:06 juju-e4d256-prod-github-runner-207 kernel: [ 6740.563495] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 07:16:06 juju-e4d256-prod-github-runner-207 kernel: [ 6740.564659] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 07:16:06 juju-e4d256-prod-github-runner-207 kernel: [ 6740.565874] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 07:16:06 juju-e4d256-prod-github-runner-207 kernel: [ 6740.567034] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 07:16:06 juju-e4d256-prod-github-runner-207 kernel: [ 6740.568216] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 07:16:06 juju-e4d256-prod-github-runner-207 kernel: [ 6740.569381] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 07:16:06 juju-e4d256-prod-github-runner-207 kernel: [ 6740.570641] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 07:16:06 juju-e4d256-prod-github-runner-207 kernel: [ 6740.571761] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 07:16:06 juju-e4d256-prod-github-runner-207 kernel: [ 6740.572979] Call Trace: Aug 22 07:16:06 juju-e4d256-prod-github-runner-207 kernel: [ 6740.573891] Aug 22 07:16:06 juju-e4d256-prod-github-runner-207 kernel: [ 6740.574795] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:16:06 juju-e4d256-prod-github-runner-207 kernel: [ 6740.575842] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:16:06 juju-e4d256-prod-github-runner-207 kernel: [ 6740.576865] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:16:06 juju-e4d256-prod-github-runner-207 kernel: [ 6740.577958] ? show_regs.part.0+0x23/0x29 Aug 22 07:16:06 juju-e4d256-prod-github-runner-207 kernel: [ 6740.578952] ? show_regs.cold+0x8/0xd Aug 22 07:16:06 juju-e4d256-prod-github-runner-207 kernel: [ 6740.580025] ? watchdog_timer_fn+0x1be/0x220 Aug 22 07:16:06 juju-e4d256-prod-github-runner-207 kernel: [ 6740.581125] ? lockup_detector_update_enable+0x60/0x60 Aug 22 07:16:06 juju-e4d256-prod-github-runner-207 kernel: [ 6740.582316] ? __hrtimer_run_queues+0x107/0x230 Aug 22 07:16:06 juju-e4d256-prod-github-runner-207 kernel: [ 6740.583455] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 07:16:06 juju-e4d256-prod-github-runner-207 kernel: [ 6740.584566] ? hrtimer_interrupt+0x101/0x220 Aug 22 07:16:06 juju-e4d256-prod-github-runner-207 kernel: [ 6740.585663] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 07:16:06 juju-e4d256-prod-github-runner-207 kernel: [ 6740.586828] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 07:16:06 juju-e4d256-prod-github-runner-207 kernel: [ 6740.587988] Aug 22 07:16:06 juju-e4d256-prod-github-runner-207 kernel: [ 6740.588887] Aug 22 07:16:06 juju-e4d256-prod-github-runner-207 kernel: [ 6740.589769] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 07:16:06 juju-e4d256-prod-github-runner-207 kernel: [ 6740.590915] ? native_queued_spin_lock_slowpath+0xc/0x40 Aug 22 07:16:06 juju-e4d256-prod-github-runner-207 kernel: [ 6740.592067] ? _raw_spin_lock+0x22/0x30 Aug 22 07:16:06 juju-e4d256-prod-github-runner-207 kernel: [ 6740.593095] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:16:06 juju-e4d256-prod-github-runner-207 kernel: [ 6740.594212] direct_page_fault+0x206/0x310 [kvm] Aug 22 07:16:06 juju-e4d256-prod-github-runner-207 kernel: [ 6740.595323] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 07:16:06 juju-e4d256-prod-github-runner-207 kernel: [ 6740.596450] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 07:16:06 juju-e4d256-prod-github-runner-207 kernel: [ 6740.597617] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 07:16:06 juju-e4d256-prod-github-runner-207 kernel: [ 6740.598865] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 07:16:06 juju-e4d256-prod-github-runner-207 kernel: [ 6740.599938] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 07:16:06 juju-e4d256-prod-github-runner-207 kernel: [ 6740.601027] handle_exit+0x98/0x230 [kvm_amd] Aug 22 07:16:06 juju-e4d256-prod-github-runner-207 kernel: [ 6740.602006] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 07:16:06 juju-e4d256-prod-github-runner-207 kernel: [ 6740.603061] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 07:16:06 juju-e4d256-prod-github-runner-207 kernel: [ 6740.604094] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 07:16:06 juju-e4d256-prod-github-runner-207 kernel: [ 6740.605107] vcpu_run+0x62/0x2c0 [kvm] Aug 22 07:16:06 juju-e4d256-prod-github-runner-207 kernel: [ 6740.606040] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 07:16:06 juju-e4d256-prod-github-runner-207 kernel: [ 6740.606942] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 07:16:06 juju-e4d256-prod-github-runner-207 kernel: [ 6740.607914] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 07:16:06 juju-e4d256-prod-github-runner-207 kernel: [ 6740.608799] ? __seccomp_filter+0x4a/0x4a0 Aug 22 07:16:06 juju-e4d256-prod-github-runner-207 kernel: [ 6740.609630] ? __fget_files+0x86/0xc0 Aug 22 07:16:06 juju-e4d256-prod-github-runner-207 kernel: [ 6740.610407] __x64_sys_ioctl+0x95/0xd0 Aug 22 07:16:06 juju-e4d256-prod-github-runner-207 kernel: [ 6740.611189] do_syscall_64+0x5c/0xc0 Aug 22 07:16:06 juju-e4d256-prod-github-runner-207 kernel: [ 6740.611963] ? do_futex+0x162/0x1f0 Aug 22 07:16:06 juju-e4d256-prod-github-runner-207 kernel: [ 6740.612728] ? __x64_sys_futex+0x78/0x1e0 Aug 22 07:16:06 juju-e4d256-prod-github-runner-207 kernel: [ 6740.613485] ? __secure_computing+0xa9/0x120 Aug 22 07:16:06 juju-e4d256-prod-github-runner-207 kernel: [ 6740.614256] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 07:16:06 juju-e4d256-prod-github-runner-207 kernel: [ 6740.615119] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:16:06 juju-e4d256-prod-github-runner-207 kernel: [ 6740.615958] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:16:06 juju-e4d256-prod-github-runner-207 kernel: [ 6740.616768] ? do_syscall_64+0x69/0xc0 Aug 22 07:16:06 juju-e4d256-prod-github-runner-207 kernel: [ 6740.617485] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:16:06 juju-e4d256-prod-github-runner-207 kernel: [ 6740.618280] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:16:06 juju-e4d256-prod-github-runner-207 kernel: [ 6740.619072] ? do_syscall_64+0x69/0xc0 Aug 22 07:16:06 juju-e4d256-prod-github-runner-207 kernel: [ 6740.619793] ? do_syscall_64+0x69/0xc0 Aug 22 07:16:06 juju-e4d256-prod-github-runner-207 kernel: [ 6740.620502] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 07:16:06 juju-e4d256-prod-github-runner-207 kernel: [ 6740.621362] RIP: 0033:0x7faa5d0edaff Aug 22 07:16:06 juju-e4d256-prod-github-runner-207 kernel: [ 6740.622052] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 07:16:06 juju-e4d256-prod-github-runner-207 kernel: [ 6740.624116] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 07:16:06 juju-e4d256-prod-github-runner-207 kernel: [ 6740.625146] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 07:16:06 juju-e4d256-prod-github-runner-207 kernel: [ 6740.626062] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 07:16:06 juju-e4d256-prod-github-runner-207 kernel: [ 6740.626952] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 07:16:06 juju-e4d256-prod-github-runner-207 kernel: [ 6740.627859] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 07:16:06 juju-e4d256-prod-github-runner-207 kernel: [ 6740.628746] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 07:16:06 juju-e4d256-prod-github-runner-207 kernel: [ 6740.629659] Aug 22 07:16:34 juju-e4d256-prod-github-runner-207 kernel: [ 6768.541980] watchdog: BUG: soft lockup - CPU#1 stuck for 6195s! [qemu-system-x86:6715] Aug 22 07:16:34 juju-e4d256-prod-github-runner-207 kernel: [ 6768.543182] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 07:16:34 juju-e4d256-prod-github-runner-207 kernel: [ 6768.543259] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 07:16:34 juju-e4d256-prod-github-runner-207 kernel: [ 6768.555554] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 07:16:34 juju-e4d256-prod-github-runner-207 kernel: [ 6768.556832] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 07:16:34 juju-e4d256-prod-github-runner-207 kernel: [ 6768.558056] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:16:34 juju-e4d256-prod-github-runner-207 kernel: [ 6768.559124] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 07:16:34 juju-e4d256-prod-github-runner-207 kernel: [ 6768.561681] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 07:16:34 juju-e4d256-prod-github-runner-207 kernel: [ 6768.562745] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 07:16:34 juju-e4d256-prod-github-runner-207 kernel: [ 6768.563956] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 07:16:34 juju-e4d256-prod-github-runner-207 kernel: [ 6768.565227] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 07:16:34 juju-e4d256-prod-github-runner-207 kernel: [ 6768.566393] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 07:16:34 juju-e4d256-prod-github-runner-207 kernel: [ 6768.567718] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 07:16:34 juju-e4d256-prod-github-runner-207 kernel: [ 6768.569031] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 07:16:34 juju-e4d256-prod-github-runner-207 kernel: [ 6768.570269] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 07:16:34 juju-e4d256-prod-github-runner-207 kernel: [ 6768.571379] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 07:16:34 juju-e4d256-prod-github-runner-207 kernel: [ 6768.572578] Call Trace: Aug 22 07:16:34 juju-e4d256-prod-github-runner-207 kernel: [ 6768.573490] Aug 22 07:16:34 juju-e4d256-prod-github-runner-207 kernel: [ 6768.574373] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:16:34 juju-e4d256-prod-github-runner-207 kernel: [ 6768.575419] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:16:34 juju-e4d256-prod-github-runner-207 kernel: [ 6768.576442] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:16:34 juju-e4d256-prod-github-runner-207 kernel: [ 6768.577517] ? show_regs.part.0+0x23/0x29 Aug 22 07:16:34 juju-e4d256-prod-github-runner-207 kernel: [ 6768.578513] ? show_regs.cold+0x8/0xd Aug 22 07:16:34 juju-e4d256-prod-github-runner-207 kernel: [ 6768.579502] ? watchdog_timer_fn+0x1be/0x220 Aug 22 07:16:34 juju-e4d256-prod-github-runner-207 kernel: [ 6768.580509] ? lockup_detector_update_enable+0x60/0x60 Aug 22 07:16:34 juju-e4d256-prod-github-runner-207 kernel: [ 6768.581571] ? __hrtimer_run_queues+0x107/0x230 Aug 22 07:16:34 juju-e4d256-prod-github-runner-207 kernel: [ 6768.582603] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 07:16:34 juju-e4d256-prod-github-runner-207 kernel: [ 6768.583642] ? hrtimer_interrupt+0x101/0x220 Aug 22 07:16:34 juju-e4d256-prod-github-runner-207 kernel: [ 6768.584657] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 07:16:34 juju-e4d256-prod-github-runner-207 kernel: [ 6768.585777] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 07:16:34 juju-e4d256-prod-github-runner-207 kernel: [ 6768.586825] Aug 22 07:16:34 juju-e4d256-prod-github-runner-207 kernel: [ 6768.587691] Aug 22 07:16:34 juju-e4d256-prod-github-runner-207 kernel: [ 6768.588526] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 07:16:34 juju-e4d256-prod-github-runner-207 kernel: [ 6768.589561] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:16:34 juju-e4d256-prod-github-runner-207 kernel: [ 6768.590610] ? _raw_spin_lock+0x22/0x30 Aug 22 07:16:34 juju-e4d256-prod-github-runner-207 kernel: [ 6768.591566] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:16:34 juju-e4d256-prod-github-runner-207 kernel: [ 6768.592590] direct_page_fault+0x206/0x310 [kvm] Aug 22 07:16:34 juju-e4d256-prod-github-runner-207 kernel: [ 6768.593668] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 07:16:34 juju-e4d256-prod-github-runner-207 kernel: [ 6768.594804] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 07:16:34 juju-e4d256-prod-github-runner-207 kernel: [ 6768.595851] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 07:16:34 juju-e4d256-prod-github-runner-207 kernel: [ 6768.596828] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 07:16:34 juju-e4d256-prod-github-runner-207 kernel: [ 6768.597804] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 07:16:34 juju-e4d256-prod-github-runner-207 kernel: [ 6768.598825] handle_exit+0x98/0x230 [kvm_amd] Aug 22 07:16:34 juju-e4d256-prod-github-runner-207 kernel: [ 6768.599763] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 07:16:34 juju-e4d256-prod-github-runner-207 kernel: [ 6768.600718] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 07:16:34 juju-e4d256-prod-github-runner-207 kernel: [ 6768.601648] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 07:16:34 juju-e4d256-prod-github-runner-207 kernel: [ 6768.602557] vcpu_run+0x62/0x2c0 [kvm] Aug 22 07:16:34 juju-e4d256-prod-github-runner-207 kernel: [ 6768.603394] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 07:16:34 juju-e4d256-prod-github-runner-207 kernel: [ 6768.604220] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 07:16:34 juju-e4d256-prod-github-runner-207 kernel: [ 6768.605082] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 07:16:34 juju-e4d256-prod-github-runner-207 kernel: [ 6768.605889] ? __seccomp_filter+0x4a/0x4a0 Aug 22 07:16:34 juju-e4d256-prod-github-runner-207 kernel: [ 6768.606635] ? __fget_files+0x86/0xc0 Aug 22 07:16:34 juju-e4d256-prod-github-runner-207 kernel: [ 6768.607358] __x64_sys_ioctl+0x95/0xd0 Aug 22 07:16:34 juju-e4d256-prod-github-runner-207 kernel: [ 6768.608071] do_syscall_64+0x5c/0xc0 Aug 22 07:16:34 juju-e4d256-prod-github-runner-207 kernel: [ 6768.608739] ? do_futex+0x162/0x1f0 Aug 22 07:16:34 juju-e4d256-prod-github-runner-207 kernel: [ 6768.609417] ? __x64_sys_futex+0x78/0x1e0 Aug 22 07:16:34 juju-e4d256-prod-github-runner-207 kernel: [ 6768.610102] ? __secure_computing+0xa9/0x120 Aug 22 07:16:34 juju-e4d256-prod-github-runner-207 kernel: [ 6768.610793] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 07:16:34 juju-e4d256-prod-github-runner-207 kernel: [ 6768.611569] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:16:34 juju-e4d256-prod-github-runner-207 kernel: [ 6768.612292] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:16:34 juju-e4d256-prod-github-runner-207 kernel: [ 6768.613137] ? do_syscall_64+0x69/0xc0 Aug 22 07:16:34 juju-e4d256-prod-github-runner-207 kernel: [ 6768.613857] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:16:34 juju-e4d256-prod-github-runner-207 kernel: [ 6768.614674] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:16:34 juju-e4d256-prod-github-runner-207 kernel: [ 6768.615493] ? do_syscall_64+0x69/0xc0 Aug 22 07:16:34 juju-e4d256-prod-github-runner-207 kernel: [ 6768.616195] ? do_syscall_64+0x69/0xc0 Aug 22 07:16:34 juju-e4d256-prod-github-runner-207 kernel: [ 6768.616898] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 07:16:34 juju-e4d256-prod-github-runner-207 kernel: [ 6768.617712] RIP: 0033:0x7faa5d0edaff Aug 22 07:16:34 juju-e4d256-prod-github-runner-207 kernel: [ 6768.618439] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 07:16:34 juju-e4d256-prod-github-runner-207 kernel: [ 6768.620783] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 07:16:34 juju-e4d256-prod-github-runner-207 kernel: [ 6768.621849] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 07:16:34 juju-e4d256-prod-github-runner-207 kernel: [ 6768.622883] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 07:16:34 juju-e4d256-prod-github-runner-207 kernel: [ 6768.623932] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 07:16:34 juju-e4d256-prod-github-runner-207 kernel: [ 6768.624949] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 07:16:34 juju-e4d256-prod-github-runner-207 kernel: [ 6768.625973] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 07:16:34 juju-e4d256-prod-github-runner-207 kernel: [ 6768.627000] Aug 22 07:17:02 juju-e4d256-prod-github-runner-207 kernel: [ 6796.541984] watchdog: BUG: soft lockup - CPU#1 stuck for 6221s! [qemu-system-x86:6715] Aug 22 07:17:02 juju-e4d256-prod-github-runner-207 kernel: [ 6796.543627] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 07:17:02 juju-e4d256-prod-github-runner-207 kernel: [ 6796.543718] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 07:17:02 juju-e4d256-prod-github-runner-207 kernel: [ 6796.561388] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 07:17:02 juju-e4d256-prod-github-runner-207 kernel: [ 6796.563315] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 07:17:02 juju-e4d256-prod-github-runner-207 kernel: [ 6796.565179] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:17:02 juju-e4d256-prod-github-runner-207 kernel: [ 6796.566822] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 07:17:02 juju-e4d256-prod-github-runner-207 kernel: [ 6796.570522] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 07:17:02 juju-e4d256-prod-github-runner-207 kernel: [ 6796.572071] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 07:17:02 juju-e4d256-prod-github-runner-207 kernel: [ 6796.573846] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 07:17:02 juju-e4d256-prod-github-runner-207 kernel: [ 6796.575534] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 07:17:02 juju-e4d256-prod-github-runner-207 kernel: [ 6796.577181] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 07:17:02 juju-e4d256-prod-github-runner-207 kernel: [ 6796.578834] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 07:17:02 juju-e4d256-prod-github-runner-207 kernel: [ 6796.580594] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 07:17:02 juju-e4d256-prod-github-runner-207 kernel: [ 6796.582378] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 07:17:02 juju-e4d256-prod-github-runner-207 kernel: [ 6796.584004] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 07:17:02 juju-e4d256-prod-github-runner-207 kernel: [ 6796.585703] Call Trace: Aug 22 07:17:02 juju-e4d256-prod-github-runner-207 kernel: [ 6796.586987] Aug 22 07:17:02 juju-e4d256-prod-github-runner-207 kernel: [ 6796.588218] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:17:02 juju-e4d256-prod-github-runner-207 kernel: [ 6796.589642] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:17:02 juju-e4d256-prod-github-runner-207 kernel: [ 6796.591069] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:17:02 juju-e4d256-prod-github-runner-207 kernel: [ 6796.592555] ? show_regs.part.0+0x23/0x29 Aug 22 07:17:02 juju-e4d256-prod-github-runner-207 kernel: [ 6796.593907] ? show_regs.cold+0x8/0xd Aug 22 07:17:02 juju-e4d256-prod-github-runner-207 kernel: [ 6796.595334] ? watchdog_timer_fn+0x1be/0x220 Aug 22 07:17:02 juju-e4d256-prod-github-runner-207 kernel: [ 6796.596885] ? lockup_detector_update_enable+0x60/0x60 Aug 22 07:17:02 juju-e4d256-prod-github-runner-207 kernel: [ 6796.598533] ? __hrtimer_run_queues+0x107/0x230 Aug 22 07:17:02 juju-e4d256-prod-github-runner-207 kernel: [ 6796.600222] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 07:17:02 juju-e4d256-prod-github-runner-207 kernel: [ 6796.601838] ? hrtimer_interrupt+0x101/0x220 Aug 22 07:17:02 juju-e4d256-prod-github-runner-207 kernel: [ 6796.603362] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 07:17:02 juju-e4d256-prod-github-runner-207 kernel: [ 6796.604864] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 07:17:02 juju-e4d256-prod-github-runner-207 kernel: [ 6796.606354] Aug 22 07:17:02 juju-e4d256-prod-github-runner-207 kernel: [ 6796.607590] Aug 22 07:17:02 juju-e4d256-prod-github-runner-207 kernel: [ 6796.608808] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 07:17:02 juju-e4d256-prod-github-runner-207 kernel: [ 6796.610292] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:17:02 juju-e4d256-prod-github-runner-207 kernel: [ 6796.611845] ? _raw_spin_lock+0x22/0x30 Aug 22 07:17:02 juju-e4d256-prod-github-runner-207 kernel: [ 6796.613130] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:17:02 juju-e4d256-prod-github-runner-207 kernel: [ 6796.614594] direct_page_fault+0x206/0x310 [kvm] Aug 22 07:17:02 juju-e4d256-prod-github-runner-207 kernel: [ 6796.616081] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 07:17:02 juju-e4d256-prod-github-runner-207 kernel: [ 6796.617504] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 07:17:02 juju-e4d256-prod-github-runner-207 kernel: [ 6796.618969] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 07:17:02 juju-e4d256-prod-github-runner-207 kernel: [ 6796.620344] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 07:17:02 juju-e4d256-prod-github-runner-207 kernel: [ 6796.621699] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 07:17:02 juju-e4d256-prod-github-runner-207 kernel: [ 6796.623265] handle_exit+0x98/0x230 [kvm_amd] Aug 22 07:17:02 juju-e4d256-prod-github-runner-207 kernel: [ 6796.624712] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 07:17:02 juju-e4d256-prod-github-runner-207 kernel: [ 6796.626038] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 07:17:02 juju-e4d256-prod-github-runner-207 kernel: [ 6796.627526] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 07:17:02 juju-e4d256-prod-github-runner-207 kernel: [ 6796.628842] vcpu_run+0x62/0x2c0 [kvm] Aug 22 07:17:02 juju-e4d256-prod-github-runner-207 kernel: [ 6796.630091] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 07:17:02 juju-e4d256-prod-github-runner-207 kernel: [ 6796.631394] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 07:17:02 juju-e4d256-prod-github-runner-207 kernel: [ 6796.632763] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 07:17:02 juju-e4d256-prod-github-runner-207 kernel: [ 6796.634064] ? __seccomp_filter+0x4a/0x4a0 Aug 22 07:17:02 juju-e4d256-prod-github-runner-207 kernel: [ 6796.635227] ? __fget_files+0x86/0xc0 Aug 22 07:17:02 juju-e4d256-prod-github-runner-207 kernel: [ 6796.636255] __x64_sys_ioctl+0x95/0xd0 Aug 22 07:17:02 juju-e4d256-prod-github-runner-207 kernel: [ 6796.637242] do_syscall_64+0x5c/0xc0 Aug 22 07:17:02 juju-e4d256-prod-github-runner-207 kernel: [ 6796.638220] ? do_futex+0x162/0x1f0 Aug 22 07:17:02 juju-e4d256-prod-github-runner-207 kernel: [ 6796.639467] ? __x64_sys_futex+0x78/0x1e0 Aug 22 07:17:02 juju-e4d256-prod-github-runner-207 kernel: [ 6796.640534] ? __secure_computing+0xa9/0x120 Aug 22 07:17:02 juju-e4d256-prod-github-runner-207 kernel: [ 6796.641607] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 07:17:02 juju-e4d256-prod-github-runner-207 kernel: [ 6796.642833] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:17:02 juju-e4d256-prod-github-runner-207 kernel: [ 6796.643963] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:17:02 juju-e4d256-prod-github-runner-207 kernel: [ 6796.645103] ? do_syscall_64+0x69/0xc0 Aug 22 07:17:02 juju-e4d256-prod-github-runner-207 kernel: [ 6796.646149] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:17:02 juju-e4d256-prod-github-runner-207 kernel: [ 6796.647190] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:17:02 juju-e4d256-prod-github-runner-207 kernel: [ 6796.648262] ? do_syscall_64+0x69/0xc0 Aug 22 07:17:02 juju-e4d256-prod-github-runner-207 kernel: [ 6796.649139] ? do_syscall_64+0x69/0xc0 Aug 22 07:17:02 juju-e4d256-prod-github-runner-207 kernel: [ 6796.650014] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 07:17:02 juju-e4d256-prod-github-runner-207 kernel: [ 6796.651040] RIP: 0033:0x7faa5d0edaff Aug 22 07:17:02 juju-e4d256-prod-github-runner-207 kernel: [ 6796.651874] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 07:17:02 juju-e4d256-prod-github-runner-207 kernel: [ 6796.654693] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 07:17:02 juju-e4d256-prod-github-runner-207 kernel: [ 6796.656054] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 07:17:02 juju-e4d256-prod-github-runner-207 kernel: [ 6796.657280] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 07:17:02 juju-e4d256-prod-github-runner-207 kernel: [ 6796.658541] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 07:17:02 juju-e4d256-prod-github-runner-207 kernel: [ 6796.659518] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 07:17:02 juju-e4d256-prod-github-runner-207 kernel: [ 6796.660418] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 07:17:02 juju-e4d256-prod-github-runner-207 kernel: [ 6796.661497] Aug 22 07:17:30 juju-e4d256-prod-github-runner-207 kernel: [ 6824.541982] watchdog: BUG: soft lockup - CPU#1 stuck for 6247s! [qemu-system-x86:6715] Aug 22 07:17:30 juju-e4d256-prod-github-runner-207 kernel: [ 6824.543633] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 07:17:30 juju-e4d256-prod-github-runner-207 kernel: [ 6824.543803] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 07:17:30 juju-e4d256-prod-github-runner-207 kernel: [ 6824.556644] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 07:17:30 juju-e4d256-prod-github-runner-207 kernel: [ 6824.558098] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 07:17:30 juju-e4d256-prod-github-runner-207 kernel: [ 6824.559630] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:17:30 juju-e4d256-prod-github-runner-207 kernel: [ 6824.560848] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 07:17:30 juju-e4d256-prod-github-runner-207 kernel: [ 6824.563457] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 07:17:30 juju-e4d256-prod-github-runner-207 kernel: [ 6824.564533] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 07:17:30 juju-e4d256-prod-github-runner-207 kernel: [ 6824.565764] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 07:17:30 juju-e4d256-prod-github-runner-207 kernel: [ 6824.566984] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 07:17:30 juju-e4d256-prod-github-runner-207 kernel: [ 6824.568149] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 07:17:30 juju-e4d256-prod-github-runner-207 kernel: [ 6824.569335] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 07:17:30 juju-e4d256-prod-github-runner-207 kernel: [ 6824.570863] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 07:17:30 juju-e4d256-prod-github-runner-207 kernel: [ 6824.574516] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 07:17:30 juju-e4d256-prod-github-runner-207 kernel: [ 6824.575643] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 07:17:30 juju-e4d256-prod-github-runner-207 kernel: [ 6824.576843] Call Trace: Aug 22 07:17:30 juju-e4d256-prod-github-runner-207 kernel: [ 6824.577765] Aug 22 07:17:30 juju-e4d256-prod-github-runner-207 kernel: [ 6824.578665] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:17:30 juju-e4d256-prod-github-runner-207 kernel: [ 6824.579704] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:17:30 juju-e4d256-prod-github-runner-207 kernel: [ 6824.580810] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:17:30 juju-e4d256-prod-github-runner-207 kernel: [ 6824.581931] ? show_regs.part.0+0x23/0x29 Aug 22 07:17:30 juju-e4d256-prod-github-runner-207 kernel: [ 6824.582962] ? show_regs.cold+0x8/0xd Aug 22 07:17:30 juju-e4d256-prod-github-runner-207 kernel: [ 6824.583949] ? watchdog_timer_fn+0x1be/0x220 Aug 22 07:17:30 juju-e4d256-prod-github-runner-207 kernel: [ 6824.584964] ? lockup_detector_update_enable+0x60/0x60 Aug 22 07:17:30 juju-e4d256-prod-github-runner-207 kernel: [ 6824.586072] ? __hrtimer_run_queues+0x107/0x230 Aug 22 07:17:30 juju-e4d256-prod-github-runner-207 kernel: [ 6824.587133] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 07:17:30 juju-e4d256-prod-github-runner-207 kernel: [ 6824.588157] ? hrtimer_interrupt+0x101/0x220 Aug 22 07:17:30 juju-e4d256-prod-github-runner-207 kernel: [ 6824.589174] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 07:17:30 juju-e4d256-prod-github-runner-207 kernel: [ 6824.590251] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 07:17:30 juju-e4d256-prod-github-runner-207 kernel: [ 6824.591374] Aug 22 07:17:30 juju-e4d256-prod-github-runner-207 kernel: [ 6824.592233] Aug 22 07:17:30 juju-e4d256-prod-github-runner-207 kernel: [ 6824.593382] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 07:17:30 juju-e4d256-prod-github-runner-207 kernel: [ 6824.594436] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:17:30 juju-e4d256-prod-github-runner-207 kernel: [ 6824.595493] ? _raw_spin_lock+0x22/0x30 Aug 22 07:17:30 juju-e4d256-prod-github-runner-207 kernel: [ 6824.596456] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:17:30 juju-e4d256-prod-github-runner-207 kernel: [ 6824.597483] direct_page_fault+0x206/0x310 [kvm] Aug 22 07:17:30 juju-e4d256-prod-github-runner-207 kernel: [ 6824.598529] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 07:17:30 juju-e4d256-prod-github-runner-207 kernel: [ 6824.599542] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 07:17:30 juju-e4d256-prod-github-runner-207 kernel: [ 6824.600545] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 07:17:30 juju-e4d256-prod-github-runner-207 kernel: [ 6824.601551] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 07:17:30 juju-e4d256-prod-github-runner-207 kernel: [ 6824.602534] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 07:17:30 juju-e4d256-prod-github-runner-207 kernel: [ 6824.603533] handle_exit+0x98/0x230 [kvm_amd] Aug 22 07:17:30 juju-e4d256-prod-github-runner-207 kernel: [ 6824.604741] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 07:17:30 juju-e4d256-prod-github-runner-207 kernel: [ 6824.605694] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 07:17:30 juju-e4d256-prod-github-runner-207 kernel: [ 6824.606814] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 07:17:30 juju-e4d256-prod-github-runner-207 kernel: [ 6824.607753] vcpu_run+0x62/0x2c0 [kvm] Aug 22 07:17:30 juju-e4d256-prod-github-runner-207 kernel: [ 6824.608564] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 07:17:30 juju-e4d256-prod-github-runner-207 kernel: [ 6824.609375] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 07:17:30 juju-e4d256-prod-github-runner-207 kernel: [ 6824.610332] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 07:17:30 juju-e4d256-prod-github-runner-207 kernel: [ 6824.611150] ? __seccomp_filter+0x4a/0x4a0 Aug 22 07:17:30 juju-e4d256-prod-github-runner-207 kernel: [ 6824.611895] ? __fget_files+0x86/0xc0 Aug 22 07:17:30 juju-e4d256-prod-github-runner-207 kernel: [ 6824.612599] __x64_sys_ioctl+0x95/0xd0 Aug 22 07:17:30 juju-e4d256-prod-github-runner-207 kernel: [ 6824.613294] do_syscall_64+0x5c/0xc0 Aug 22 07:17:30 juju-e4d256-prod-github-runner-207 kernel: [ 6824.614005] ? do_futex+0x162/0x1f0 Aug 22 07:17:30 juju-e4d256-prod-github-runner-207 kernel: [ 6824.614679] ? __x64_sys_futex+0x78/0x1e0 Aug 22 07:17:30 juju-e4d256-prod-github-runner-207 kernel: [ 6824.615358] ? __secure_computing+0xa9/0x120 Aug 22 07:17:30 juju-e4d256-prod-github-runner-207 kernel: [ 6824.616086] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 07:17:30 juju-e4d256-prod-github-runner-207 kernel: [ 6824.616846] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:17:30 juju-e4d256-prod-github-runner-207 kernel: [ 6824.617600] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:17:30 juju-e4d256-prod-github-runner-207 kernel: [ 6824.618379] ? do_syscall_64+0x69/0xc0 Aug 22 07:17:30 juju-e4d256-prod-github-runner-207 kernel: [ 6824.619033] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:17:30 juju-e4d256-prod-github-runner-207 kernel: [ 6824.619736] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:17:30 juju-e4d256-prod-github-runner-207 kernel: [ 6824.620437] ? do_syscall_64+0x69/0xc0 Aug 22 07:17:30 juju-e4d256-prod-github-runner-207 kernel: [ 6824.621092] ? do_syscall_64+0x69/0xc0 Aug 22 07:17:30 juju-e4d256-prod-github-runner-207 kernel: [ 6824.621804] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 07:17:30 juju-e4d256-prod-github-runner-207 kernel: [ 6824.622601] RIP: 0033:0x7faa5d0edaff Aug 22 07:17:30 juju-e4d256-prod-github-runner-207 kernel: [ 6824.623275] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 07:17:30 juju-e4d256-prod-github-runner-207 kernel: [ 6824.625348] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 07:17:30 juju-e4d256-prod-github-runner-207 kernel: [ 6824.626340] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 07:17:30 juju-e4d256-prod-github-runner-207 kernel: [ 6824.627266] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 07:17:30 juju-e4d256-prod-github-runner-207 kernel: [ 6824.628213] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 07:17:30 juju-e4d256-prod-github-runner-207 kernel: [ 6824.629171] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 07:17:30 juju-e4d256-prod-github-runner-207 kernel: [ 6824.630126] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 07:17:30 juju-e4d256-prod-github-runner-207 kernel: [ 6824.631214] Aug 22 07:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 6837.644706] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 07:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 6837.646521] rcu: 1-....: (1674845 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=814326 Aug 22 07:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 6837.647692] (t=1680111 jiffies g=23269 q=15819) Aug 22 07:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 6837.648484] NMI backtrace for cpu 1 Aug 22 07:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 6837.649196] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 07:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 6837.650350] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 07:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 6837.651445] Call Trace: Aug 22 07:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 6837.652130] Aug 22 07:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 6837.652802] show_stack+0x52/0x5c Aug 22 07:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 6837.653541] dump_stack_lvl+0x4a/0x63 Aug 22 07:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 6837.654307] dump_stack+0x10/0x16 Aug 22 07:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 6837.655028] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 07:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 6837.655814] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 07:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 6837.656600] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 07:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 6837.657430] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 07:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 6837.658271] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 07:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 6837.659093] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 07:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 6837.659880] print_cpu_stall.cold+0x2f/0xe2 Aug 22 07:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 6837.660808] ? timekeeping_update+0xf7/0x150 Aug 22 07:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 6837.661616] check_cpu_stall+0x109/0x270 Aug 22 07:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 6837.662403] rcu_sched_clock_irq+0x9a/0x250 Aug 22 07:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 6837.663175] update_process_times+0x94/0xd0 Aug 22 07:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 6837.663958] tick_sched_handle+0x29/0x70 Aug 22 07:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 6837.664711] tick_sched_timer+0x8c/0xc0 Aug 22 07:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 6837.665477] ? tick_nohz_handler+0xb0/0xb0 Aug 22 07:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 6837.666275] __hrtimer_run_queues+0x107/0x230 Aug 22 07:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 6837.667083] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 07:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 6837.667869] hrtimer_interrupt+0x101/0x220 Aug 22 07:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 6837.668640] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 07:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 6837.669466] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 07:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 6837.670405] Aug 22 07:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 6837.671048] Aug 22 07:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 6837.671687] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 07:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 6837.672517] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 6837.673411] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 07:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 6837.675690] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 07:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 6837.676570] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 07:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 6837.677582] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 07:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 6837.678589] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 07:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 6837.679562] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 07:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 6837.680526] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 07:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 6837.681493] ? _raw_spin_lock+0x22/0x30 Aug 22 07:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 6837.682276] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 6837.683143] direct_page_fault+0x206/0x310 [kvm] Aug 22 07:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 6837.683990] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 07:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 6837.684829] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 07:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 6837.685675] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 07:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 6837.686518] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 07:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 6837.687318] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 07:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 6837.688161] handle_exit+0x98/0x230 [kvm_amd] Aug 22 07:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 6837.688926] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 07:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 6837.689719] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 07:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 6837.690542] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 07:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 6837.691348] vcpu_run+0x62/0x2c0 [kvm] Aug 22 07:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 6837.692072] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 07:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 6837.692840] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 07:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 6837.693666] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 07:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 6837.694497] ? __seccomp_filter+0x4a/0x4a0 Aug 22 07:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 6837.695242] ? __fget_files+0x86/0xc0 Aug 22 07:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 6837.695944] __x64_sys_ioctl+0x95/0xd0 Aug 22 07:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 6837.696648] do_syscall_64+0x5c/0xc0 Aug 22 07:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 6837.697346] ? do_futex+0x162/0x1f0 Aug 22 07:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 6837.698129] ? __x64_sys_futex+0x78/0x1e0 Aug 22 07:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 6837.698877] ? __secure_computing+0xa9/0x120 Aug 22 07:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 6837.699601] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 07:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 6837.700402] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 6837.701163] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 6837.701932] ? do_syscall_64+0x69/0xc0 Aug 22 07:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 6837.702648] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 6837.703416] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 6837.704182] ? do_syscall_64+0x69/0xc0 Aug 22 07:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 6837.704888] ? do_syscall_64+0x69/0xc0 Aug 22 07:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 6837.705583] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 07:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 6837.706371] RIP: 0033:0x7faa5d0edaff Aug 22 07:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 6837.707102] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 07:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 6837.709244] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 07:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 6837.710243] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 07:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 6837.711204] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 07:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 6837.712173] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 07:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 6837.713138] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 07:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 6837.714083] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 07:17:43 juju-e4d256-prod-github-runner-207 kernel: [ 6837.715026] Aug 22 07:18:10 juju-e4d256-prod-github-runner-207 kernel: [ 6864.541984] watchdog: BUG: soft lockup - CPU#1 stuck for 6285s! [qemu-system-x86:6715] Aug 22 07:18:10 juju-e4d256-prod-github-runner-207 kernel: [ 6864.543990] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 07:18:10 juju-e4d256-prod-github-runner-207 kernel: [ 6864.544307] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 07:18:10 juju-e4d256-prod-github-runner-207 kernel: [ 6864.556912] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 07:18:10 juju-e4d256-prod-github-runner-207 kernel: [ 6864.558214] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 07:18:10 juju-e4d256-prod-github-runner-207 kernel: [ 6864.559442] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:18:10 juju-e4d256-prod-github-runner-207 kernel: [ 6864.560500] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 07:18:10 juju-e4d256-prod-github-runner-207 kernel: [ 6864.563099] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 07:18:10 juju-e4d256-prod-github-runner-207 kernel: [ 6864.564145] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 07:18:10 juju-e4d256-prod-github-runner-207 kernel: [ 6864.565315] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 07:18:10 juju-e4d256-prod-github-runner-207 kernel: [ 6864.566495] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 07:18:10 juju-e4d256-prod-github-runner-207 kernel: [ 6864.567674] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 07:18:10 juju-e4d256-prod-github-runner-207 kernel: [ 6864.568879] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 07:18:10 juju-e4d256-prod-github-runner-207 kernel: [ 6864.570078] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 07:18:10 juju-e4d256-prod-github-runner-207 kernel: [ 6864.571346] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 07:18:10 juju-e4d256-prod-github-runner-207 kernel: [ 6864.572479] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 07:18:10 juju-e4d256-prod-github-runner-207 kernel: [ 6864.573698] Call Trace: Aug 22 07:18:10 juju-e4d256-prod-github-runner-207 kernel: [ 6864.574624] Aug 22 07:18:10 juju-e4d256-prod-github-runner-207 kernel: [ 6864.575551] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:18:10 juju-e4d256-prod-github-runner-207 kernel: [ 6864.576591] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:18:10 juju-e4d256-prod-github-runner-207 kernel: [ 6864.577617] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:18:10 juju-e4d256-prod-github-runner-207 kernel: [ 6864.578745] ? show_regs.part.0+0x23/0x29 Aug 22 07:18:10 juju-e4d256-prod-github-runner-207 kernel: [ 6864.579768] ? show_regs.cold+0x8/0xd Aug 22 07:18:10 juju-e4d256-prod-github-runner-207 kernel: [ 6864.580745] ? watchdog_timer_fn+0x1be/0x220 Aug 22 07:18:10 juju-e4d256-prod-github-runner-207 kernel: [ 6864.581861] ? lockup_detector_update_enable+0x60/0x60 Aug 22 07:18:10 juju-e4d256-prod-github-runner-207 kernel: [ 6864.582925] ? __hrtimer_run_queues+0x107/0x230 Aug 22 07:18:10 juju-e4d256-prod-github-runner-207 kernel: [ 6864.583965] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 07:18:10 juju-e4d256-prod-github-runner-207 kernel: [ 6864.584990] ? hrtimer_interrupt+0x101/0x220 Aug 22 07:18:10 juju-e4d256-prod-github-runner-207 kernel: [ 6864.586016] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 07:18:10 juju-e4d256-prod-github-runner-207 kernel: [ 6864.587251] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 07:18:10 juju-e4d256-prod-github-runner-207 kernel: [ 6864.588295] Aug 22 07:18:10 juju-e4d256-prod-github-runner-207 kernel: [ 6864.589148] Aug 22 07:18:10 juju-e4d256-prod-github-runner-207 kernel: [ 6864.589994] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 07:18:10 juju-e4d256-prod-github-runner-207 kernel: [ 6864.591025] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:18:10 juju-e4d256-prod-github-runner-207 kernel: [ 6864.592072] ? _raw_spin_lock+0x22/0x30 Aug 22 07:18:10 juju-e4d256-prod-github-runner-207 kernel: [ 6864.593020] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:18:10 juju-e4d256-prod-github-runner-207 kernel: [ 6864.594055] direct_page_fault+0x206/0x310 [kvm] Aug 22 07:18:10 juju-e4d256-prod-github-runner-207 kernel: [ 6864.595082] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 07:18:10 juju-e4d256-prod-github-runner-207 kernel: [ 6864.596089] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 07:18:10 juju-e4d256-prod-github-runner-207 kernel: [ 6864.597087] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 07:18:10 juju-e4d256-prod-github-runner-207 kernel: [ 6864.598118] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 07:18:10 juju-e4d256-prod-github-runner-207 kernel: [ 6864.599064] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 07:18:10 juju-e4d256-prod-github-runner-207 kernel: [ 6864.600042] handle_exit+0x98/0x230 [kvm_amd] Aug 22 07:18:10 juju-e4d256-prod-github-runner-207 kernel: [ 6864.601135] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 07:18:10 juju-e4d256-prod-github-runner-207 kernel: [ 6864.602065] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 07:18:10 juju-e4d256-prod-github-runner-207 kernel: [ 6864.602990] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 07:18:10 juju-e4d256-prod-github-runner-207 kernel: [ 6864.603901] vcpu_run+0x62/0x2c0 [kvm] Aug 22 07:18:10 juju-e4d256-prod-github-runner-207 kernel: [ 6864.604718] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 07:18:10 juju-e4d256-prod-github-runner-207 kernel: [ 6864.605530] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 07:18:10 juju-e4d256-prod-github-runner-207 kernel: [ 6864.606410] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 07:18:10 juju-e4d256-prod-github-runner-207 kernel: [ 6864.607216] ? __seccomp_filter+0x4a/0x4a0 Aug 22 07:18:10 juju-e4d256-prod-github-runner-207 kernel: [ 6864.607968] ? __fget_files+0x86/0xc0 Aug 22 07:18:10 juju-e4d256-prod-github-runner-207 kernel: [ 6864.608671] __x64_sys_ioctl+0x95/0xd0 Aug 22 07:18:10 juju-e4d256-prod-github-runner-207 kernel: [ 6864.609373] do_syscall_64+0x5c/0xc0 Aug 22 07:18:10 juju-e4d256-prod-github-runner-207 kernel: [ 6864.610050] ? do_futex+0x162/0x1f0 Aug 22 07:18:10 juju-e4d256-prod-github-runner-207 kernel: [ 6864.610707] ? __x64_sys_futex+0x78/0x1e0 Aug 22 07:18:10 juju-e4d256-prod-github-runner-207 kernel: [ 6864.611386] ? __secure_computing+0xa9/0x120 Aug 22 07:18:10 juju-e4d256-prod-github-runner-207 kernel: [ 6864.612081] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 07:18:10 juju-e4d256-prod-github-runner-207 kernel: [ 6864.612843] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:18:10 juju-e4d256-prod-github-runner-207 kernel: [ 6864.613565] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:18:10 juju-e4d256-prod-github-runner-207 kernel: [ 6864.614308] ? do_syscall_64+0x69/0xc0 Aug 22 07:18:10 juju-e4d256-prod-github-runner-207 kernel: [ 6864.614963] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:18:10 juju-e4d256-prod-github-runner-207 kernel: [ 6864.615666] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:18:10 juju-e4d256-prod-github-runner-207 kernel: [ 6864.616370] ? do_syscall_64+0x69/0xc0 Aug 22 07:18:10 juju-e4d256-prod-github-runner-207 kernel: [ 6864.616997] ? do_syscall_64+0x69/0xc0 Aug 22 07:18:10 juju-e4d256-prod-github-runner-207 kernel: [ 6864.617624] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 07:18:10 juju-e4d256-prod-github-runner-207 kernel: [ 6864.618338] RIP: 0033:0x7faa5d0edaff Aug 22 07:18:10 juju-e4d256-prod-github-runner-207 kernel: [ 6864.619007] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 07:18:10 juju-e4d256-prod-github-runner-207 kernel: [ 6864.621004] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 07:18:10 juju-e4d256-prod-github-runner-207 kernel: [ 6864.621939] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 07:18:10 juju-e4d256-prod-github-runner-207 kernel: [ 6864.622841] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 07:18:10 juju-e4d256-prod-github-runner-207 kernel: [ 6864.623742] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 07:18:10 juju-e4d256-prod-github-runner-207 kernel: [ 6864.624631] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 07:18:10 juju-e4d256-prod-github-runner-207 kernel: [ 6864.625531] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 07:18:10 juju-e4d256-prod-github-runner-207 kernel: [ 6864.626449] Aug 22 07:18:38 juju-e4d256-prod-github-runner-207 kernel: [ 6892.541980] watchdog: BUG: soft lockup - CPU#1 stuck for 6311s! [qemu-system-x86:6715] Aug 22 07:18:38 juju-e4d256-prod-github-runner-207 kernel: [ 6892.543887] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 07:18:38 juju-e4d256-prod-github-runner-207 kernel: [ 6892.544201] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 07:18:38 juju-e4d256-prod-github-runner-207 kernel: [ 6892.557146] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 07:18:38 juju-e4d256-prod-github-runner-207 kernel: [ 6892.558433] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 07:18:38 juju-e4d256-prod-github-runner-207 kernel: [ 6892.559709] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:18:38 juju-e4d256-prod-github-runner-207 kernel: [ 6892.560858] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 07:18:38 juju-e4d256-prod-github-runner-207 kernel: [ 6892.563509] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 07:18:38 juju-e4d256-prod-github-runner-207 kernel: [ 6892.564558] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 07:18:38 juju-e4d256-prod-github-runner-207 kernel: [ 6892.565744] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 07:18:38 juju-e4d256-prod-github-runner-207 kernel: [ 6892.566945] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 07:18:38 juju-e4d256-prod-github-runner-207 kernel: [ 6892.568341] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 07:18:38 juju-e4d256-prod-github-runner-207 kernel: [ 6892.569602] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 07:18:38 juju-e4d256-prod-github-runner-207 kernel: [ 6892.571108] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 07:18:38 juju-e4d256-prod-github-runner-207 kernel: [ 6892.572763] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 07:18:38 juju-e4d256-prod-github-runner-207 kernel: [ 6892.573895] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 07:18:38 juju-e4d256-prod-github-runner-207 kernel: [ 6892.575092] Call Trace: Aug 22 07:18:38 juju-e4d256-prod-github-runner-207 kernel: [ 6892.576002] Aug 22 07:18:38 juju-e4d256-prod-github-runner-207 kernel: [ 6892.576912] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:18:38 juju-e4d256-prod-github-runner-207 kernel: [ 6892.577960] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:18:38 juju-e4d256-prod-github-runner-207 kernel: [ 6892.578983] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:18:38 juju-e4d256-prod-github-runner-207 kernel: [ 6892.580094] ? show_regs.part.0+0x23/0x29 Aug 22 07:18:38 juju-e4d256-prod-github-runner-207 kernel: [ 6892.581268] ? show_regs.cold+0x8/0xd Aug 22 07:18:38 juju-e4d256-prod-github-runner-207 kernel: [ 6892.582472] ? watchdog_timer_fn+0x1be/0x220 Aug 22 07:18:38 juju-e4d256-prod-github-runner-207 kernel: [ 6892.583646] ? lockup_detector_update_enable+0x60/0x60 Aug 22 07:18:38 juju-e4d256-prod-github-runner-207 kernel: [ 6892.584770] ? __hrtimer_run_queues+0x107/0x230 Aug 22 07:18:38 juju-e4d256-prod-github-runner-207 kernel: [ 6892.585834] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 07:18:38 juju-e4d256-prod-github-runner-207 kernel: [ 6892.586862] ? hrtimer_interrupt+0x101/0x220 Aug 22 07:18:38 juju-e4d256-prod-github-runner-207 kernel: [ 6892.587878] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 07:18:38 juju-e4d256-prod-github-runner-207 kernel: [ 6892.588949] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 07:18:38 juju-e4d256-prod-github-runner-207 kernel: [ 6892.590035] Aug 22 07:18:38 juju-e4d256-prod-github-runner-207 kernel: [ 6892.590888] Aug 22 07:18:38 juju-e4d256-prod-github-runner-207 kernel: [ 6892.591727] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 07:18:38 juju-e4d256-prod-github-runner-207 kernel: [ 6892.592768] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:18:38 juju-e4d256-prod-github-runner-207 kernel: [ 6892.593825] ? _raw_spin_lock+0x22/0x30 Aug 22 07:18:38 juju-e4d256-prod-github-runner-207 kernel: [ 6892.594771] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:18:38 juju-e4d256-prod-github-runner-207 kernel: [ 6892.595798] direct_page_fault+0x206/0x310 [kvm] Aug 22 07:18:38 juju-e4d256-prod-github-runner-207 kernel: [ 6892.596822] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 07:18:38 juju-e4d256-prod-github-runner-207 kernel: [ 6892.597844] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 07:18:38 juju-e4d256-prod-github-runner-207 kernel: [ 6892.598845] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 07:18:38 juju-e4d256-prod-github-runner-207 kernel: [ 6892.599906] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 07:18:38 juju-e4d256-prod-github-runner-207 kernel: [ 6892.601068] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 07:18:38 juju-e4d256-prod-github-runner-207 kernel: [ 6892.602258] handle_exit+0x98/0x230 [kvm_amd] Aug 22 07:18:38 juju-e4d256-prod-github-runner-207 kernel: [ 6892.603383] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 07:18:38 juju-e4d256-prod-github-runner-207 kernel: [ 6892.604390] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 07:18:38 juju-e4d256-prod-github-runner-207 kernel: [ 6892.605330] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 07:18:38 juju-e4d256-prod-github-runner-207 kernel: [ 6892.606269] vcpu_run+0x62/0x2c0 [kvm] Aug 22 07:18:38 juju-e4d256-prod-github-runner-207 kernel: [ 6892.607085] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 07:18:38 juju-e4d256-prod-github-runner-207 kernel: [ 6892.607964] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 07:18:38 juju-e4d256-prod-github-runner-207 kernel: [ 6892.608878] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 07:18:38 juju-e4d256-prod-github-runner-207 kernel: [ 6892.609801] ? __seccomp_filter+0x4a/0x4a0 Aug 22 07:18:38 juju-e4d256-prod-github-runner-207 kernel: [ 6892.610624] ? __fget_files+0x86/0xc0 Aug 22 07:18:38 juju-e4d256-prod-github-runner-207 kernel: [ 6892.611393] __x64_sys_ioctl+0x95/0xd0 Aug 22 07:18:38 juju-e4d256-prod-github-runner-207 kernel: [ 6892.612095] do_syscall_64+0x5c/0xc0 Aug 22 07:18:38 juju-e4d256-prod-github-runner-207 kernel: [ 6892.612765] ? do_futex+0x162/0x1f0 Aug 22 07:18:38 juju-e4d256-prod-github-runner-207 kernel: [ 6892.613423] ? __x64_sys_futex+0x78/0x1e0 Aug 22 07:18:38 juju-e4d256-prod-github-runner-207 kernel: [ 6892.614117] ? __secure_computing+0xa9/0x120 Aug 22 07:18:38 juju-e4d256-prod-github-runner-207 kernel: [ 6892.614818] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 07:18:38 juju-e4d256-prod-github-runner-207 kernel: [ 6892.615585] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:18:38 juju-e4d256-prod-github-runner-207 kernel: [ 6892.616316] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:18:38 juju-e4d256-prod-github-runner-207 kernel: [ 6892.617039] ? do_syscall_64+0x69/0xc0 Aug 22 07:18:38 juju-e4d256-prod-github-runner-207 kernel: [ 6892.617706] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:18:38 juju-e4d256-prod-github-runner-207 kernel: [ 6892.618413] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:18:38 juju-e4d256-prod-github-runner-207 kernel: [ 6892.619113] ? do_syscall_64+0x69/0xc0 Aug 22 07:18:38 juju-e4d256-prod-github-runner-207 kernel: [ 6892.619792] ? do_syscall_64+0x69/0xc0 Aug 22 07:18:38 juju-e4d256-prod-github-runner-207 kernel: [ 6892.620530] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 07:18:38 juju-e4d256-prod-github-runner-207 kernel: [ 6892.621422] RIP: 0033:0x7faa5d0edaff Aug 22 07:18:38 juju-e4d256-prod-github-runner-207 kernel: [ 6892.622277] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 07:18:38 juju-e4d256-prod-github-runner-207 kernel: [ 6892.624707] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 07:18:38 juju-e4d256-prod-github-runner-207 kernel: [ 6892.625798] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 07:18:38 juju-e4d256-prod-github-runner-207 kernel: [ 6892.626975] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 07:18:38 juju-e4d256-prod-github-runner-207 kernel: [ 6892.627997] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 07:18:38 juju-e4d256-prod-github-runner-207 kernel: [ 6892.628964] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 07:18:38 juju-e4d256-prod-github-runner-207 kernel: [ 6892.629955] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 07:18:38 juju-e4d256-prod-github-runner-207 kernel: [ 6892.630895] Aug 22 07:19:06 juju-e4d256-prod-github-runner-207 kernel: [ 6920.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 6337s! [qemu-system-x86:6715] Aug 22 07:19:06 juju-e4d256-prod-github-runner-207 kernel: [ 6920.543890] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 07:19:06 juju-e4d256-prod-github-runner-207 kernel: [ 6920.544205] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 07:19:06 juju-e4d256-prod-github-runner-207 kernel: [ 6920.556523] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 07:19:06 juju-e4d256-prod-github-runner-207 kernel: [ 6920.557821] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 07:19:06 juju-e4d256-prod-github-runner-207 kernel: [ 6920.559089] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:19:06 juju-e4d256-prod-github-runner-207 kernel: [ 6920.560170] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 07:19:06 juju-e4d256-prod-github-runner-207 kernel: [ 6920.562769] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 07:19:06 juju-e4d256-prod-github-runner-207 kernel: [ 6920.563822] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 07:19:06 juju-e4d256-prod-github-runner-207 kernel: [ 6920.565001] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 07:19:06 juju-e4d256-prod-github-runner-207 kernel: [ 6920.566185] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 07:19:06 juju-e4d256-prod-github-runner-207 kernel: [ 6920.567361] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 07:19:06 juju-e4d256-prod-github-runner-207 kernel: [ 6920.568541] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 07:19:06 juju-e4d256-prod-github-runner-207 kernel: [ 6920.569738] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 07:19:06 juju-e4d256-prod-github-runner-207 kernel: [ 6920.570991] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 07:19:06 juju-e4d256-prod-github-runner-207 kernel: [ 6920.572102] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 07:19:06 juju-e4d256-prod-github-runner-207 kernel: [ 6920.573321] Call Trace: Aug 22 07:19:06 juju-e4d256-prod-github-runner-207 kernel: [ 6920.574238] Aug 22 07:19:06 juju-e4d256-prod-github-runner-207 kernel: [ 6920.575136] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:19:06 juju-e4d256-prod-github-runner-207 kernel: [ 6920.576175] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:19:06 juju-e4d256-prod-github-runner-207 kernel: [ 6920.577221] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:19:06 juju-e4d256-prod-github-runner-207 kernel: [ 6920.578330] ? show_regs.part.0+0x23/0x29 Aug 22 07:19:06 juju-e4d256-prod-github-runner-207 kernel: [ 6920.579339] ? show_regs.cold+0x8/0xd Aug 22 07:19:06 juju-e4d256-prod-github-runner-207 kernel: [ 6920.580318] ? watchdog_timer_fn+0x1be/0x220 Aug 22 07:19:06 juju-e4d256-prod-github-runner-207 kernel: [ 6920.581343] ? lockup_detector_update_enable+0x60/0x60 Aug 22 07:19:06 juju-e4d256-prod-github-runner-207 kernel: [ 6920.582418] ? __hrtimer_run_queues+0x107/0x230 Aug 22 07:19:06 juju-e4d256-prod-github-runner-207 kernel: [ 6920.583469] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 07:19:06 juju-e4d256-prod-github-runner-207 kernel: [ 6920.584512] ? hrtimer_interrupt+0x101/0x220 Aug 22 07:19:06 juju-e4d256-prod-github-runner-207 kernel: [ 6920.585548] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 07:19:06 juju-e4d256-prod-github-runner-207 kernel: [ 6920.586625] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 07:19:06 juju-e4d256-prod-github-runner-207 kernel: [ 6920.587683] Aug 22 07:19:06 juju-e4d256-prod-github-runner-207 kernel: [ 6920.588540] Aug 22 07:19:06 juju-e4d256-prod-github-runner-207 kernel: [ 6920.589390] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 07:19:06 juju-e4d256-prod-github-runner-207 kernel: [ 6920.590432] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:19:06 juju-e4d256-prod-github-runner-207 kernel: [ 6920.591475] ? _raw_spin_lock+0x22/0x30 Aug 22 07:19:06 juju-e4d256-prod-github-runner-207 kernel: [ 6920.592430] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:19:06 juju-e4d256-prod-github-runner-207 kernel: [ 6920.593466] direct_page_fault+0x206/0x310 [kvm] Aug 22 07:19:06 juju-e4d256-prod-github-runner-207 kernel: [ 6920.594497] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 07:19:06 juju-e4d256-prod-github-runner-207 kernel: [ 6920.595510] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 07:19:06 juju-e4d256-prod-github-runner-207 kernel: [ 6920.596514] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 07:19:06 juju-e4d256-prod-github-runner-207 kernel: [ 6920.597565] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 07:19:06 juju-e4d256-prod-github-runner-207 kernel: [ 6920.598530] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 07:19:06 juju-e4d256-prod-github-runner-207 kernel: [ 6920.599530] handle_exit+0x98/0x230 [kvm_amd] Aug 22 07:19:06 juju-e4d256-prod-github-runner-207 kernel: [ 6920.600432] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 07:19:06 juju-e4d256-prod-github-runner-207 kernel: [ 6920.601392] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 07:19:06 juju-e4d256-prod-github-runner-207 kernel: [ 6920.602327] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 07:19:06 juju-e4d256-prod-github-runner-207 kernel: [ 6920.603238] vcpu_run+0x62/0x2c0 [kvm] Aug 22 07:19:06 juju-e4d256-prod-github-runner-207 kernel: [ 6920.604056] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 07:19:06 juju-e4d256-prod-github-runner-207 kernel: [ 6920.604872] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 07:19:06 juju-e4d256-prod-github-runner-207 kernel: [ 6920.605744] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 07:19:06 juju-e4d256-prod-github-runner-207 kernel: [ 6920.606574] ? __seccomp_filter+0x4a/0x4a0 Aug 22 07:19:06 juju-e4d256-prod-github-runner-207 kernel: [ 6920.607328] ? __fget_files+0x86/0xc0 Aug 22 07:19:06 juju-e4d256-prod-github-runner-207 kernel: [ 6920.608037] __x64_sys_ioctl+0x95/0xd0 Aug 22 07:19:06 juju-e4d256-prod-github-runner-207 kernel: [ 6920.608734] do_syscall_64+0x5c/0xc0 Aug 22 07:19:06 juju-e4d256-prod-github-runner-207 kernel: [ 6920.609412] ? do_futex+0x162/0x1f0 Aug 22 07:19:06 juju-e4d256-prod-github-runner-207 kernel: [ 6920.610070] ? __x64_sys_futex+0x78/0x1e0 Aug 22 07:19:06 juju-e4d256-prod-github-runner-207 kernel: [ 6920.610755] ? __secure_computing+0xa9/0x120 Aug 22 07:19:06 juju-e4d256-prod-github-runner-207 kernel: [ 6920.611452] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 07:19:06 juju-e4d256-prod-github-runner-207 kernel: [ 6920.612224] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:19:06 juju-e4d256-prod-github-runner-207 kernel: [ 6920.612978] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:19:06 juju-e4d256-prod-github-runner-207 kernel: [ 6920.613717] ? do_syscall_64+0x69/0xc0 Aug 22 07:19:06 juju-e4d256-prod-github-runner-207 kernel: [ 6920.614455] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:19:06 juju-e4d256-prod-github-runner-207 kernel: [ 6920.615174] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:19:06 juju-e4d256-prod-github-runner-207 kernel: [ 6920.615999] ? do_syscall_64+0x69/0xc0 Aug 22 07:19:06 juju-e4d256-prod-github-runner-207 kernel: [ 6920.616627] ? do_syscall_64+0x69/0xc0 Aug 22 07:19:06 juju-e4d256-prod-github-runner-207 kernel: [ 6920.617275] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 07:19:06 juju-e4d256-prod-github-runner-207 kernel: [ 6920.617988] RIP: 0033:0x7faa5d0edaff Aug 22 07:19:06 juju-e4d256-prod-github-runner-207 kernel: [ 6920.618635] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 07:19:06 juju-e4d256-prod-github-runner-207 kernel: [ 6920.620644] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 07:19:06 juju-e4d256-prod-github-runner-207 kernel: [ 6920.621579] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 07:19:06 juju-e4d256-prod-github-runner-207 kernel: [ 6920.622486] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 07:19:06 juju-e4d256-prod-github-runner-207 kernel: [ 6920.623390] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 07:19:06 juju-e4d256-prod-github-runner-207 kernel: [ 6920.624293] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 07:19:06 juju-e4d256-prod-github-runner-207 kernel: [ 6920.625207] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 07:19:06 juju-e4d256-prod-github-runner-207 kernel: [ 6920.626114] Aug 22 07:19:34 juju-e4d256-prod-github-runner-207 kernel: [ 6948.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 6363s! [qemu-system-x86:6715] Aug 22 07:19:34 juju-e4d256-prod-github-runner-207 kernel: [ 6948.543806] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 07:19:34 juju-e4d256-prod-github-runner-207 kernel: [ 6948.544098] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 07:19:34 juju-e4d256-prod-github-runner-207 kernel: [ 6948.556266] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 07:19:34 juju-e4d256-prod-github-runner-207 kernel: [ 6948.557576] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 07:19:34 juju-e4d256-prod-github-runner-207 kernel: [ 6948.558798] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:19:34 juju-e4d256-prod-github-runner-207 kernel: [ 6948.560092] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 07:19:34 juju-e4d256-prod-github-runner-207 kernel: [ 6948.563196] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 07:19:34 juju-e4d256-prod-github-runner-207 kernel: [ 6948.564465] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 07:19:34 juju-e4d256-prod-github-runner-207 kernel: [ 6948.565889] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 07:19:34 juju-e4d256-prod-github-runner-207 kernel: [ 6948.567268] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 07:19:34 juju-e4d256-prod-github-runner-207 kernel: [ 6948.568606] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 07:19:34 juju-e4d256-prod-github-runner-207 kernel: [ 6948.570042] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 07:19:34 juju-e4d256-prod-github-runner-207 kernel: [ 6948.571482] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 07:19:34 juju-e4d256-prod-github-runner-207 kernel: [ 6948.573038] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 07:19:34 juju-e4d256-prod-github-runner-207 kernel: [ 6948.574226] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 07:19:34 juju-e4d256-prod-github-runner-207 kernel: [ 6948.575473] Call Trace: Aug 22 07:19:34 juju-e4d256-prod-github-runner-207 kernel: [ 6948.576397] Aug 22 07:19:34 juju-e4d256-prod-github-runner-207 kernel: [ 6948.577331] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:19:34 juju-e4d256-prod-github-runner-207 kernel: [ 6948.578394] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:19:34 juju-e4d256-prod-github-runner-207 kernel: [ 6948.579425] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:19:34 juju-e4d256-prod-github-runner-207 kernel: [ 6948.580585] ? show_regs.part.0+0x23/0x29 Aug 22 07:19:34 juju-e4d256-prod-github-runner-207 kernel: [ 6948.581644] ? show_regs.cold+0x8/0xd Aug 22 07:19:34 juju-e4d256-prod-github-runner-207 kernel: [ 6948.582618] ? watchdog_timer_fn+0x1be/0x220 Aug 22 07:19:34 juju-e4d256-prod-github-runner-207 kernel: [ 6948.583631] ? lockup_detector_update_enable+0x60/0x60 Aug 22 07:19:34 juju-e4d256-prod-github-runner-207 kernel: [ 6948.584753] ? __hrtimer_run_queues+0x107/0x230 Aug 22 07:19:34 juju-e4d256-prod-github-runner-207 kernel: [ 6948.585985] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 07:19:34 juju-e4d256-prod-github-runner-207 kernel: [ 6948.587251] ? hrtimer_interrupt+0x101/0x220 Aug 22 07:19:34 juju-e4d256-prod-github-runner-207 kernel: [ 6948.588506] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 07:19:34 juju-e4d256-prod-github-runner-207 kernel: [ 6948.589901] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 07:19:34 juju-e4d256-prod-github-runner-207 kernel: [ 6948.591211] Aug 22 07:19:34 juju-e4d256-prod-github-runner-207 kernel: [ 6948.592304] Aug 22 07:19:34 juju-e4d256-prod-github-runner-207 kernel: [ 6948.593402] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 07:19:34 juju-e4d256-prod-github-runner-207 kernel: [ 6948.594733] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:19:34 juju-e4d256-prod-github-runner-207 kernel: [ 6948.596046] ? _raw_spin_lock+0x22/0x30 Aug 22 07:19:34 juju-e4d256-prod-github-runner-207 kernel: [ 6948.597273] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:19:34 juju-e4d256-prod-github-runner-207 kernel: [ 6948.598578] direct_page_fault+0x206/0x310 [kvm] Aug 22 07:19:34 juju-e4d256-prod-github-runner-207 kernel: [ 6948.599875] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 07:19:34 juju-e4d256-prod-github-runner-207 kernel: [ 6948.601177] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 07:19:34 juju-e4d256-prod-github-runner-207 kernel: [ 6948.602460] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 07:19:34 juju-e4d256-prod-github-runner-207 kernel: [ 6948.603626] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 07:19:34 juju-e4d256-prod-github-runner-207 kernel: [ 6948.604717] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 07:19:34 juju-e4d256-prod-github-runner-207 kernel: [ 6948.605933] handle_exit+0x98/0x230 [kvm_amd] Aug 22 07:19:34 juju-e4d256-prod-github-runner-207 kernel: [ 6948.607087] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 07:19:34 juju-e4d256-prod-github-runner-207 kernel: [ 6948.608207] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 07:19:34 juju-e4d256-prod-github-runner-207 kernel: [ 6948.609366] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 07:19:34 juju-e4d256-prod-github-runner-207 kernel: [ 6948.610384] vcpu_run+0x62/0x2c0 [kvm] Aug 22 07:19:34 juju-e4d256-prod-github-runner-207 kernel: [ 6948.611293] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 07:19:34 juju-e4d256-prod-github-runner-207 kernel: [ 6948.612292] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 07:19:34 juju-e4d256-prod-github-runner-207 kernel: [ 6948.613352] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 07:19:34 juju-e4d256-prod-github-runner-207 kernel: [ 6948.614252] ? __seccomp_filter+0x4a/0x4a0 Aug 22 07:19:34 juju-e4d256-prod-github-runner-207 kernel: [ 6948.615224] ? __fget_files+0x86/0xc0 Aug 22 07:19:34 juju-e4d256-prod-github-runner-207 kernel: [ 6948.616011] __x64_sys_ioctl+0x95/0xd0 Aug 22 07:19:34 juju-e4d256-prod-github-runner-207 kernel: [ 6948.616883] do_syscall_64+0x5c/0xc0 Aug 22 07:19:34 juju-e4d256-prod-github-runner-207 kernel: [ 6948.617744] ? do_futex+0x162/0x1f0 Aug 22 07:19:34 juju-e4d256-prod-github-runner-207 kernel: [ 6948.618538] ? __x64_sys_futex+0x78/0x1e0 Aug 22 07:19:34 juju-e4d256-prod-github-runner-207 kernel: [ 6948.619370] ? __secure_computing+0xa9/0x120 Aug 22 07:19:34 juju-e4d256-prod-github-runner-207 kernel: [ 6948.620150] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 07:19:34 juju-e4d256-prod-github-runner-207 kernel: [ 6948.621305] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:19:34 juju-e4d256-prod-github-runner-207 kernel: [ 6948.622127] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:19:34 juju-e4d256-prod-github-runner-207 kernel: [ 6948.622945] ? do_syscall_64+0x69/0xc0 Aug 22 07:19:34 juju-e4d256-prod-github-runner-207 kernel: [ 6948.623959] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:19:34 juju-e4d256-prod-github-runner-207 kernel: [ 6948.624756] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:19:34 juju-e4d256-prod-github-runner-207 kernel: [ 6948.625631] ? do_syscall_64+0x69/0xc0 Aug 22 07:19:34 juju-e4d256-prod-github-runner-207 kernel: [ 6948.626340] ? do_syscall_64+0x69/0xc0 Aug 22 07:19:34 juju-e4d256-prod-github-runner-207 kernel: [ 6948.627141] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 07:19:34 juju-e4d256-prod-github-runner-207 kernel: [ 6948.627954] RIP: 0033:0x7faa5d0edaff Aug 22 07:19:34 juju-e4d256-prod-github-runner-207 kernel: [ 6948.628721] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 07:19:34 juju-e4d256-prod-github-runner-207 kernel: [ 6948.631297] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 07:19:34 juju-e4d256-prod-github-runner-207 kernel: [ 6948.632373] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 07:19:34 juju-e4d256-prod-github-runner-207 kernel: [ 6948.633636] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 07:19:34 juju-e4d256-prod-github-runner-207 kernel: [ 6948.634675] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 07:19:34 juju-e4d256-prod-github-runner-207 kernel: [ 6948.635707] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 07:19:34 juju-e4d256-prod-github-runner-207 kernel: [ 6948.637051] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 07:19:34 juju-e4d256-prod-github-runner-207 kernel: [ 6948.638176] Aug 22 07:20:02 juju-e4d256-prod-github-runner-207 kernel: [ 6976.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 6389s! [qemu-system-x86:6715] Aug 22 07:20:02 juju-e4d256-prod-github-runner-207 kernel: [ 6976.543887] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 07:20:02 juju-e4d256-prod-github-runner-207 kernel: [ 6976.544207] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 07:20:02 juju-e4d256-prod-github-runner-207 kernel: [ 6976.557397] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 07:20:02 juju-e4d256-prod-github-runner-207 kernel: [ 6976.558713] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 07:20:02 juju-e4d256-prod-github-runner-207 kernel: [ 6976.559983] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:20:02 juju-e4d256-prod-github-runner-207 kernel: [ 6976.561119] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 07:20:02 juju-e4d256-prod-github-runner-207 kernel: [ 6976.564124] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 07:20:02 juju-e4d256-prod-github-runner-207 kernel: [ 6976.565287] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 07:20:02 juju-e4d256-prod-github-runner-207 kernel: [ 6976.566604] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 07:20:02 juju-e4d256-prod-github-runner-207 kernel: [ 6976.567834] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 07:20:02 juju-e4d256-prod-github-runner-207 kernel: [ 6976.569066] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 07:20:02 juju-e4d256-prod-github-runner-207 kernel: [ 6976.570303] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 07:20:02 juju-e4d256-prod-github-runner-207 kernel: [ 6976.571519] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 07:20:02 juju-e4d256-prod-github-runner-207 kernel: [ 6976.572923] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 07:20:02 juju-e4d256-prod-github-runner-207 kernel: [ 6976.574053] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 07:20:02 juju-e4d256-prod-github-runner-207 kernel: [ 6976.575349] Call Trace: Aug 22 07:20:02 juju-e4d256-prod-github-runner-207 kernel: [ 6976.576329] Aug 22 07:20:02 juju-e4d256-prod-github-runner-207 kernel: [ 6976.577282] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:20:02 juju-e4d256-prod-github-runner-207 kernel: [ 6976.578340] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:20:02 juju-e4d256-prod-github-runner-207 kernel: [ 6976.579390] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:20:02 juju-e4d256-prod-github-runner-207 kernel: [ 6976.580590] ? show_regs.part.0+0x23/0x29 Aug 22 07:20:02 juju-e4d256-prod-github-runner-207 kernel: [ 6976.581639] ? show_regs.cold+0x8/0xd Aug 22 07:20:02 juju-e4d256-prod-github-runner-207 kernel: [ 6976.582643] ? watchdog_timer_fn+0x1be/0x220 Aug 22 07:20:02 juju-e4d256-prod-github-runner-207 kernel: [ 6976.583695] ? lockup_detector_update_enable+0x60/0x60 Aug 22 07:20:02 juju-e4d256-prod-github-runner-207 kernel: [ 6976.584827] ? __hrtimer_run_queues+0x107/0x230 Aug 22 07:20:02 juju-e4d256-prod-github-runner-207 kernel: [ 6976.585928] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 07:20:02 juju-e4d256-prod-github-runner-207 kernel: [ 6976.587039] ? hrtimer_interrupt+0x101/0x220 Aug 22 07:20:02 juju-e4d256-prod-github-runner-207 kernel: [ 6976.588221] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 07:20:02 juju-e4d256-prod-github-runner-207 kernel: [ 6976.589364] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 07:20:02 juju-e4d256-prod-github-runner-207 kernel: [ 6976.590489] Aug 22 07:20:02 juju-e4d256-prod-github-runner-207 kernel: [ 6976.591420] Aug 22 07:20:02 juju-e4d256-prod-github-runner-207 kernel: [ 6976.592340] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 07:20:02 juju-e4d256-prod-github-runner-207 kernel: [ 6976.593474] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:20:02 juju-e4d256-prod-github-runner-207 kernel: [ 6976.594568] ? _raw_spin_lock+0x22/0x30 Aug 22 07:20:02 juju-e4d256-prod-github-runner-207 kernel: [ 6976.595545] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:20:02 juju-e4d256-prod-github-runner-207 kernel: [ 6976.596637] direct_page_fault+0x206/0x310 [kvm] Aug 22 07:20:02 juju-e4d256-prod-github-runner-207 kernel: [ 6976.597763] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 07:20:02 juju-e4d256-prod-github-runner-207 kernel: [ 6976.598854] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 07:20:02 juju-e4d256-prod-github-runner-207 kernel: [ 6976.599936] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 07:20:02 juju-e4d256-prod-github-runner-207 kernel: [ 6976.601032] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 07:20:02 juju-e4d256-prod-github-runner-207 kernel: [ 6976.602023] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 07:20:02 juju-e4d256-prod-github-runner-207 kernel: [ 6976.603056] handle_exit+0x98/0x230 [kvm_amd] Aug 22 07:20:02 juju-e4d256-prod-github-runner-207 kernel: [ 6976.603979] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 07:20:02 juju-e4d256-prod-github-runner-207 kernel: [ 6976.604950] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 07:20:02 juju-e4d256-prod-github-runner-207 kernel: [ 6976.605914] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 07:20:02 juju-e4d256-prod-github-runner-207 kernel: [ 6976.606949] vcpu_run+0x62/0x2c0 [kvm] Aug 22 07:20:02 juju-e4d256-prod-github-runner-207 kernel: [ 6976.607818] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 07:20:02 juju-e4d256-prod-github-runner-207 kernel: [ 6976.608670] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 07:20:02 juju-e4d256-prod-github-runner-207 kernel: [ 6976.609593] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 07:20:02 juju-e4d256-prod-github-runner-207 kernel: [ 6976.610475] ? __seccomp_filter+0x4a/0x4a0 Aug 22 07:20:02 juju-e4d256-prod-github-runner-207 kernel: [ 6976.611271] ? __fget_files+0x86/0xc0 Aug 22 07:20:02 juju-e4d256-prod-github-runner-207 kernel: [ 6976.612005] __x64_sys_ioctl+0x95/0xd0 Aug 22 07:20:02 juju-e4d256-prod-github-runner-207 kernel: [ 6976.612758] do_syscall_64+0x5c/0xc0 Aug 22 07:20:02 juju-e4d256-prod-github-runner-207 kernel: [ 6976.613637] ? do_futex+0x162/0x1f0 Aug 22 07:20:02 juju-e4d256-prod-github-runner-207 kernel: [ 6976.614354] ? __x64_sys_futex+0x78/0x1e0 Aug 22 07:20:02 juju-e4d256-prod-github-runner-207 kernel: [ 6976.615061] ? __secure_computing+0xa9/0x120 Aug 22 07:20:02 juju-e4d256-prod-github-runner-207 kernel: [ 6976.615786] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 07:20:02 juju-e4d256-prod-github-runner-207 kernel: [ 6976.616664] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:20:02 juju-e4d256-prod-github-runner-207 kernel: [ 6976.617449] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:20:02 juju-e4d256-prod-github-runner-207 kernel: [ 6976.618198] ? do_syscall_64+0x69/0xc0 Aug 22 07:20:02 juju-e4d256-prod-github-runner-207 kernel: [ 6976.618868] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:20:02 juju-e4d256-prod-github-runner-207 kernel: [ 6976.619628] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:20:02 juju-e4d256-prod-github-runner-207 kernel: [ 6976.620348] ? do_syscall_64+0x69/0xc0 Aug 22 07:20:02 juju-e4d256-prod-github-runner-207 kernel: [ 6976.621020] ? do_syscall_64+0x69/0xc0 Aug 22 07:20:02 juju-e4d256-prod-github-runner-207 kernel: [ 6976.621677] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 07:20:02 juju-e4d256-prod-github-runner-207 kernel: [ 6976.622484] RIP: 0033:0x7faa5d0edaff Aug 22 07:20:02 juju-e4d256-prod-github-runner-207 kernel: [ 6976.623193] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 07:20:02 juju-e4d256-prod-github-runner-207 kernel: [ 6976.625338] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 07:20:02 juju-e4d256-prod-github-runner-207 kernel: [ 6976.626446] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 07:20:02 juju-e4d256-prod-github-runner-207 kernel: [ 6976.627386] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 07:20:02 juju-e4d256-prod-github-runner-207 kernel: [ 6976.628331] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 07:20:02 juju-e4d256-prod-github-runner-207 kernel: [ 6976.629306] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 07:20:02 juju-e4d256-prod-github-runner-207 kernel: [ 6976.630234] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 07:20:02 juju-e4d256-prod-github-runner-207 kernel: [ 6976.631186] Aug 22 07:20:30 juju-e4d256-prod-github-runner-207 kernel: [ 7004.541980] watchdog: BUG: soft lockup - CPU#1 stuck for 6415s! [qemu-system-x86:6715] Aug 22 07:20:30 juju-e4d256-prod-github-runner-207 kernel: [ 7004.543885] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 07:20:30 juju-e4d256-prod-github-runner-207 kernel: [ 7004.544222] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 07:20:30 juju-e4d256-prod-github-runner-207 kernel: [ 7004.557069] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 07:20:30 juju-e4d256-prod-github-runner-207 kernel: [ 7004.558383] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 07:20:30 juju-e4d256-prod-github-runner-207 kernel: [ 7004.559607] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:20:30 juju-e4d256-prod-github-runner-207 kernel: [ 7004.560755] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 07:20:30 juju-e4d256-prod-github-runner-207 kernel: [ 7004.563328] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 07:20:30 juju-e4d256-prod-github-runner-207 kernel: [ 7004.564420] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 07:20:30 juju-e4d256-prod-github-runner-207 kernel: [ 7004.565601] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 07:20:30 juju-e4d256-prod-github-runner-207 kernel: [ 7004.566792] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 07:20:30 juju-e4d256-prod-github-runner-207 kernel: [ 7004.567963] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 07:20:30 juju-e4d256-prod-github-runner-207 kernel: [ 7004.569167] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 07:20:30 juju-e4d256-prod-github-runner-207 kernel: [ 7004.570357] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 07:20:30 juju-e4d256-prod-github-runner-207 kernel: [ 7004.571778] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 07:20:30 juju-e4d256-prod-github-runner-207 kernel: [ 7004.573175] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 07:20:30 juju-e4d256-prod-github-runner-207 kernel: [ 7004.574488] Call Trace: Aug 22 07:20:30 juju-e4d256-prod-github-runner-207 kernel: [ 7004.575470] Aug 22 07:20:30 juju-e4d256-prod-github-runner-207 kernel: [ 7004.576631] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:20:30 juju-e4d256-prod-github-runner-207 kernel: [ 7004.577691] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:20:30 juju-e4d256-prod-github-runner-207 kernel: [ 7004.578711] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:20:30 juju-e4d256-prod-github-runner-207 kernel: [ 7004.579829] ? show_regs.part.0+0x23/0x29 Aug 22 07:20:30 juju-e4d256-prod-github-runner-207 kernel: [ 7004.580846] ? show_regs.cold+0x8/0xd Aug 22 07:20:30 juju-e4d256-prod-github-runner-207 kernel: [ 7004.581945] ? watchdog_timer_fn+0x1be/0x220 Aug 22 07:20:30 juju-e4d256-prod-github-runner-207 kernel: [ 7004.582964] ? lockup_detector_update_enable+0x60/0x60 Aug 22 07:20:30 juju-e4d256-prod-github-runner-207 kernel: [ 7004.584064] ? __hrtimer_run_queues+0x107/0x230 Aug 22 07:20:30 juju-e4d256-prod-github-runner-207 kernel: [ 7004.585122] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 07:20:30 juju-e4d256-prod-github-runner-207 kernel: [ 7004.586149] ? hrtimer_interrupt+0x101/0x220 Aug 22 07:20:30 juju-e4d256-prod-github-runner-207 kernel: [ 7004.587183] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 07:20:30 juju-e4d256-prod-github-runner-207 kernel: [ 7004.588273] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 07:20:30 juju-e4d256-prod-github-runner-207 kernel: [ 7004.589329] Aug 22 07:20:30 juju-e4d256-prod-github-runner-207 kernel: [ 7004.590237] Aug 22 07:20:30 juju-e4d256-prod-github-runner-207 kernel: [ 7004.591091] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 07:20:30 juju-e4d256-prod-github-runner-207 kernel: [ 7004.592169] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:20:30 juju-e4d256-prod-github-runner-207 kernel: [ 7004.593410] ? _raw_spin_lock+0x22/0x30 Aug 22 07:20:30 juju-e4d256-prod-github-runner-207 kernel: [ 7004.594368] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:20:30 juju-e4d256-prod-github-runner-207 kernel: [ 7004.595423] direct_page_fault+0x206/0x310 [kvm] Aug 22 07:20:30 juju-e4d256-prod-github-runner-207 kernel: [ 7004.596550] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 07:20:30 juju-e4d256-prod-github-runner-207 kernel: [ 7004.597567] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 07:20:30 juju-e4d256-prod-github-runner-207 kernel: [ 7004.598565] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 07:20:30 juju-e4d256-prod-github-runner-207 kernel: [ 7004.599569] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 07:20:30 juju-e4d256-prod-github-runner-207 kernel: [ 7004.600547] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 07:20:30 juju-e4d256-prod-github-runner-207 kernel: [ 7004.601529] handle_exit+0x98/0x230 [kvm_amd] Aug 22 07:20:30 juju-e4d256-prod-github-runner-207 kernel: [ 7004.602426] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 07:20:30 juju-e4d256-prod-github-runner-207 kernel: [ 7004.603338] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 07:20:30 juju-e4d256-prod-github-runner-207 kernel: [ 7004.604373] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 07:20:30 juju-e4d256-prod-github-runner-207 kernel: [ 7004.605592] vcpu_run+0x62/0x2c0 [kvm] Aug 22 07:20:30 juju-e4d256-prod-github-runner-207 kernel: [ 7004.606494] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 07:20:30 juju-e4d256-prod-github-runner-207 kernel: [ 7004.607348] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 07:20:30 juju-e4d256-prod-github-runner-207 kernel: [ 7004.608244] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 07:20:30 juju-e4d256-prod-github-runner-207 kernel: [ 7004.609049] ? __seccomp_filter+0x4a/0x4a0 Aug 22 07:20:30 juju-e4d256-prod-github-runner-207 kernel: [ 7004.609809] ? __fget_files+0x86/0xc0 Aug 22 07:20:30 juju-e4d256-prod-github-runner-207 kernel: [ 7004.610512] __x64_sys_ioctl+0x95/0xd0 Aug 22 07:20:30 juju-e4d256-prod-github-runner-207 kernel: [ 7004.611202] do_syscall_64+0x5c/0xc0 Aug 22 07:20:30 juju-e4d256-prod-github-runner-207 kernel: [ 7004.611866] ? do_futex+0x162/0x1f0 Aug 22 07:20:30 juju-e4d256-prod-github-runner-207 kernel: [ 7004.612574] ? __x64_sys_futex+0x78/0x1e0 Aug 22 07:20:30 juju-e4d256-prod-github-runner-207 kernel: [ 7004.613571] ? __secure_computing+0xa9/0x120 Aug 22 07:20:30 juju-e4d256-prod-github-runner-207 kernel: [ 7004.614369] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 07:20:30 juju-e4d256-prod-github-runner-207 kernel: [ 7004.615131] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:20:30 juju-e4d256-prod-github-runner-207 kernel: [ 7004.615879] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:20:30 juju-e4d256-prod-github-runner-207 kernel: [ 7004.616611] ? do_syscall_64+0x69/0xc0 Aug 22 07:20:30 juju-e4d256-prod-github-runner-207 kernel: [ 7004.617265] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:20:30 juju-e4d256-prod-github-runner-207 kernel: [ 7004.617966] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:20:30 juju-e4d256-prod-github-runner-207 kernel: [ 7004.618715] ? do_syscall_64+0x69/0xc0 Aug 22 07:20:30 juju-e4d256-prod-github-runner-207 kernel: [ 7004.619338] ? do_syscall_64+0x69/0xc0 Aug 22 07:20:30 juju-e4d256-prod-github-runner-207 kernel: [ 7004.619958] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 07:20:30 juju-e4d256-prod-github-runner-207 kernel: [ 7004.620675] RIP: 0033:0x7faa5d0edaff Aug 22 07:20:30 juju-e4d256-prod-github-runner-207 kernel: [ 7004.621337] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 07:20:30 juju-e4d256-prod-github-runner-207 kernel: [ 7004.623339] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 07:20:30 juju-e4d256-prod-github-runner-207 kernel: [ 7004.624267] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 07:20:30 juju-e4d256-prod-github-runner-207 kernel: [ 7004.625182] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 07:20:30 juju-e4d256-prod-github-runner-207 kernel: [ 7004.626123] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 07:20:30 juju-e4d256-prod-github-runner-207 kernel: [ 7004.627029] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 07:20:30 juju-e4d256-prod-github-runner-207 kernel: [ 7004.627918] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 07:20:30 juju-e4d256-prod-github-runner-207 kernel: [ 7004.628833] Aug 22 07:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 7017.656707] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 07:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 7017.657663] rcu: 1-....: (1719704 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=835793 Aug 22 07:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 7017.658791] (t=1725114 jiffies g=23269 q=15953) Aug 22 07:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 7017.659576] NMI backtrace for cpu 1 Aug 22 07:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 7017.660314] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 07:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 7017.661476] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 07:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 7017.662551] Call Trace: Aug 22 07:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 7017.663227] Aug 22 07:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 7017.663870] show_stack+0x52/0x5c Aug 22 07:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 7017.664658] dump_stack_lvl+0x4a/0x63 Aug 22 07:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 7017.665411] dump_stack+0x10/0x16 Aug 22 07:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 7017.666164] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 07:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 7017.666982] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 07:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 7017.667878] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 07:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 7017.668761] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 07:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 7017.669624] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 07:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 7017.670447] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 07:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 7017.671231] print_cpu_stall.cold+0x2f/0xe2 Aug 22 07:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 7017.672016] ? timekeeping_update+0xf7/0x150 Aug 22 07:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 7017.672794] check_cpu_stall+0x109/0x270 Aug 22 07:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 7017.673555] rcu_sched_clock_irq+0x9a/0x250 Aug 22 07:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 7017.674363] update_process_times+0x94/0xd0 Aug 22 07:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 7017.675137] tick_sched_handle+0x29/0x70 Aug 22 07:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 7017.675892] tick_sched_timer+0x8c/0xc0 Aug 22 07:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 7017.676656] ? tick_nohz_handler+0xb0/0xb0 Aug 22 07:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 7017.677418] __hrtimer_run_queues+0x107/0x230 Aug 22 07:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 7017.678199] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 07:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 7017.678996] hrtimer_interrupt+0x101/0x220 Aug 22 07:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 7017.679775] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 07:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 7017.680606] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 07:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 7017.681419] Aug 22 07:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 7017.682061] Aug 22 07:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 7017.682695] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 07:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 7017.683536] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 7017.684469] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 07:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 7017.686748] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 07:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 7017.687637] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 07:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 7017.688717] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 07:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 7017.689733] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 07:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 7017.690706] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 07:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 7017.691673] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 07:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 7017.692652] ? _raw_spin_lock+0x22/0x30 Aug 22 07:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 7017.693419] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 7017.694345] direct_page_fault+0x206/0x310 [kvm] Aug 22 07:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 7017.695219] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 07:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 7017.696083] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 07:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 7017.696943] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 07:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 7017.697766] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 07:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 7017.698564] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 07:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 7017.699398] handle_exit+0x98/0x230 [kvm_amd] Aug 22 07:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 7017.700185] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 07:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 7017.700983] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 07:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 7017.701843] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 07:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 7017.702651] vcpu_run+0x62/0x2c0 [kvm] Aug 22 07:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 7017.703415] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 07:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 7017.704183] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 07:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 7017.705044] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 07:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 7017.705836] ? __seccomp_filter+0x4a/0x4a0 Aug 22 07:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 7017.706572] ? __fget_files+0x86/0xc0 Aug 22 07:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 7017.707275] __x64_sys_ioctl+0x95/0xd0 Aug 22 07:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 7017.708002] do_syscall_64+0x5c/0xc0 Aug 22 07:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 7017.708690] ? do_futex+0x162/0x1f0 Aug 22 07:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 7017.709369] ? __x64_sys_futex+0x78/0x1e0 Aug 22 07:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 7017.710079] ? __secure_computing+0xa9/0x120 Aug 22 07:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 7017.710802] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 07:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 7017.711607] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 7017.712385] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 7017.713157] ? do_syscall_64+0x69/0xc0 Aug 22 07:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 7017.713862] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 7017.714631] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 7017.715429] ? do_syscall_64+0x69/0xc0 Aug 22 07:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 7017.716143] ? do_syscall_64+0x69/0xc0 Aug 22 07:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 7017.716876] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 07:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 7017.717674] RIP: 0033:0x7faa5d0edaff Aug 22 07:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 7017.718402] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 07:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 7017.720555] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 07:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 7017.721535] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 07:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 7017.722491] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 07:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 7017.723443] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 07:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 7017.724403] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 07:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 7017.725403] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 07:20:43 juju-e4d256-prod-github-runner-207 kernel: [ 7017.726336] Aug 22 07:21:10 juju-e4d256-prod-github-runner-207 kernel: [ 7044.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 6452s! [qemu-system-x86:6715] Aug 22 07:21:10 juju-e4d256-prod-github-runner-207 kernel: [ 7044.543195] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 07:21:10 juju-e4d256-prod-github-runner-207 kernel: [ 7044.543426] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 07:21:10 juju-e4d256-prod-github-runner-207 kernel: [ 7044.557922] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 07:21:10 juju-e4d256-prod-github-runner-207 kernel: [ 7044.559216] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 07:21:10 juju-e4d256-prod-github-runner-207 kernel: [ 7044.560502] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:21:10 juju-e4d256-prod-github-runner-207 kernel: [ 7044.561575] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 07:21:10 juju-e4d256-prod-github-runner-207 kernel: [ 7044.564941] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 07:21:10 juju-e4d256-prod-github-runner-207 kernel: [ 7044.566116] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 07:21:10 juju-e4d256-prod-github-runner-207 kernel: [ 7044.567332] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 07:21:10 juju-e4d256-prod-github-runner-207 kernel: [ 7044.568570] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 07:21:10 juju-e4d256-prod-github-runner-207 kernel: [ 7044.570171] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 07:21:10 juju-e4d256-prod-github-runner-207 kernel: [ 7044.571810] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 07:21:10 juju-e4d256-prod-github-runner-207 kernel: [ 7044.573437] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 07:21:10 juju-e4d256-prod-github-runner-207 kernel: [ 7044.575248] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 07:21:10 juju-e4d256-prod-github-runner-207 kernel: [ 7044.576769] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 07:21:10 juju-e4d256-prod-github-runner-207 kernel: [ 7044.578167] Call Trace: Aug 22 07:21:10 juju-e4d256-prod-github-runner-207 kernel: [ 7044.579090] Aug 22 07:21:10 juju-e4d256-prod-github-runner-207 kernel: [ 7044.580059] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:21:10 juju-e4d256-prod-github-runner-207 kernel: [ 7044.581122] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:21:10 juju-e4d256-prod-github-runner-207 kernel: [ 7044.582208] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:21:10 juju-e4d256-prod-github-runner-207 kernel: [ 7044.583341] ? show_regs.part.0+0x23/0x29 Aug 22 07:21:10 juju-e4d256-prod-github-runner-207 kernel: [ 7044.584404] ? show_regs.cold+0x8/0xd Aug 22 07:21:10 juju-e4d256-prod-github-runner-207 kernel: [ 7044.585475] ? watchdog_timer_fn+0x1be/0x220 Aug 22 07:21:10 juju-e4d256-prod-github-runner-207 kernel: [ 7044.586531] ? lockup_detector_update_enable+0x60/0x60 Aug 22 07:21:10 juju-e4d256-prod-github-runner-207 kernel: [ 7044.587759] ? __hrtimer_run_queues+0x107/0x230 Aug 22 07:21:10 juju-e4d256-prod-github-runner-207 kernel: [ 7044.589028] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 07:21:10 juju-e4d256-prod-github-runner-207 kernel: [ 7044.590127] ? hrtimer_interrupt+0x101/0x220 Aug 22 07:21:10 juju-e4d256-prod-github-runner-207 kernel: [ 7044.591161] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 07:21:10 juju-e4d256-prod-github-runner-207 kernel: [ 7044.592279] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 07:21:10 juju-e4d256-prod-github-runner-207 kernel: [ 7044.593363] Aug 22 07:21:10 juju-e4d256-prod-github-runner-207 kernel: [ 7044.594254] Aug 22 07:21:10 juju-e4d256-prod-github-runner-207 kernel: [ 7044.595138] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 07:21:10 juju-e4d256-prod-github-runner-207 kernel: [ 7044.596261] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:21:10 juju-e4d256-prod-github-runner-207 kernel: [ 7044.597330] ? _raw_spin_lock+0x22/0x30 Aug 22 07:21:10 juju-e4d256-prod-github-runner-207 kernel: [ 7044.598293] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:21:10 juju-e4d256-prod-github-runner-207 kernel: [ 7044.599352] direct_page_fault+0x206/0x310 [kvm] Aug 22 07:21:10 juju-e4d256-prod-github-runner-207 kernel: [ 7044.600437] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 07:21:10 juju-e4d256-prod-github-runner-207 kernel: [ 7044.601474] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 07:21:10 juju-e4d256-prod-github-runner-207 kernel: [ 7044.602519] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 07:21:10 juju-e4d256-prod-github-runner-207 kernel: [ 7044.603545] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 07:21:10 juju-e4d256-prod-github-runner-207 kernel: [ 7044.604562] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 07:21:10 juju-e4d256-prod-github-runner-207 kernel: [ 7044.605559] handle_exit+0x98/0x230 [kvm_amd] Aug 22 07:21:10 juju-e4d256-prod-github-runner-207 kernel: [ 7044.606493] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 07:21:10 juju-e4d256-prod-github-runner-207 kernel: [ 7044.607455] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 07:21:10 juju-e4d256-prod-github-runner-207 kernel: [ 7044.608414] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 07:21:10 juju-e4d256-prod-github-runner-207 kernel: [ 7044.609326] vcpu_run+0x62/0x2c0 [kvm] Aug 22 07:21:10 juju-e4d256-prod-github-runner-207 kernel: [ 7044.610144] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 07:21:10 juju-e4d256-prod-github-runner-207 kernel: [ 7044.610983] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 07:21:10 juju-e4d256-prod-github-runner-207 kernel: [ 7044.611906] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 07:21:10 juju-e4d256-prod-github-runner-207 kernel: [ 7044.612725] ? __seccomp_filter+0x4a/0x4a0 Aug 22 07:21:10 juju-e4d256-prod-github-runner-207 kernel: [ 7044.613479] ? __fget_files+0x86/0xc0 Aug 22 07:21:10 juju-e4d256-prod-github-runner-207 kernel: [ 7044.614205] __x64_sys_ioctl+0x95/0xd0 Aug 22 07:21:10 juju-e4d256-prod-github-runner-207 kernel: [ 7044.614934] do_syscall_64+0x5c/0xc0 Aug 22 07:21:10 juju-e4d256-prod-github-runner-207 kernel: [ 7044.615636] ? do_futex+0x162/0x1f0 Aug 22 07:21:10 juju-e4d256-prod-github-runner-207 kernel: [ 7044.616298] ? __x64_sys_futex+0x78/0x1e0 Aug 22 07:21:10 juju-e4d256-prod-github-runner-207 kernel: [ 7044.616995] ? __secure_computing+0xa9/0x120 Aug 22 07:21:10 juju-e4d256-prod-github-runner-207 kernel: [ 7044.617700] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 07:21:10 juju-e4d256-prod-github-runner-207 kernel: [ 7044.618479] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:21:10 juju-e4d256-prod-github-runner-207 kernel: [ 7044.619214] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:21:10 juju-e4d256-prod-github-runner-207 kernel: [ 7044.619969] ? do_syscall_64+0x69/0xc0 Aug 22 07:21:10 juju-e4d256-prod-github-runner-207 kernel: [ 7044.620652] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:21:10 juju-e4d256-prod-github-runner-207 kernel: [ 7044.621369] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:21:10 juju-e4d256-prod-github-runner-207 kernel: [ 7044.622076] ? do_syscall_64+0x69/0xc0 Aug 22 07:21:10 juju-e4d256-prod-github-runner-207 kernel: [ 7044.622710] ? do_syscall_64+0x69/0xc0 Aug 22 07:21:10 juju-e4d256-prod-github-runner-207 kernel: [ 7044.623344] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 07:21:10 juju-e4d256-prod-github-runner-207 kernel: [ 7044.624087] RIP: 0033:0x7faa5d0edaff Aug 22 07:21:10 juju-e4d256-prod-github-runner-207 kernel: [ 7044.624804] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 07:21:10 juju-e4d256-prod-github-runner-207 kernel: [ 7044.626984] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 07:21:10 juju-e4d256-prod-github-runner-207 kernel: [ 7044.627970] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 07:21:10 juju-e4d256-prod-github-runner-207 kernel: [ 7044.628922] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 07:21:10 juju-e4d256-prod-github-runner-207 kernel: [ 7044.629838] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 07:21:10 juju-e4d256-prod-github-runner-207 kernel: [ 7044.630749] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 07:21:10 juju-e4d256-prod-github-runner-207 kernel: [ 7044.631689] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 07:21:10 juju-e4d256-prod-github-runner-207 kernel: [ 7044.632687] Aug 22 07:21:38 juju-e4d256-prod-github-runner-207 kernel: [ 7072.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 6478s! [qemu-system-x86:6715] Aug 22 07:21:38 juju-e4d256-prod-github-runner-207 kernel: [ 7072.543081] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 07:21:38 juju-e4d256-prod-github-runner-207 kernel: [ 7072.543354] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 07:21:38 juju-e4d256-prod-github-runner-207 kernel: [ 7072.557492] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 07:21:38 juju-e4d256-prod-github-runner-207 kernel: [ 7072.558958] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 07:21:38 juju-e4d256-prod-github-runner-207 kernel: [ 7072.560369] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:21:38 juju-e4d256-prod-github-runner-207 kernel: [ 7072.561557] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 07:21:38 juju-e4d256-prod-github-runner-207 kernel: [ 7072.564522] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 07:21:38 juju-e4d256-prod-github-runner-207 kernel: [ 7072.565740] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 07:21:38 juju-e4d256-prod-github-runner-207 kernel: [ 7072.567187] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 07:21:38 juju-e4d256-prod-github-runner-207 kernel: [ 7072.568548] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 07:21:38 juju-e4d256-prod-github-runner-207 kernel: [ 7072.569883] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 07:21:38 juju-e4d256-prod-github-runner-207 kernel: [ 7072.571227] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 07:21:38 juju-e4d256-prod-github-runner-207 kernel: [ 7072.572576] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 07:21:38 juju-e4d256-prod-github-runner-207 kernel: [ 7072.574158] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 07:21:38 juju-e4d256-prod-github-runner-207 kernel: [ 7072.575430] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 07:21:38 juju-e4d256-prod-github-runner-207 kernel: [ 7072.576778] Call Trace: Aug 22 07:21:38 juju-e4d256-prod-github-runner-207 kernel: [ 7072.577752] Aug 22 07:21:38 juju-e4d256-prod-github-runner-207 kernel: [ 7072.578712] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:21:38 juju-e4d256-prod-github-runner-207 kernel: [ 7072.579957] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:21:38 juju-e4d256-prod-github-runner-207 kernel: [ 7072.581117] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:21:38 juju-e4d256-prod-github-runner-207 kernel: [ 7072.582300] ? show_regs.part.0+0x23/0x29 Aug 22 07:21:38 juju-e4d256-prod-github-runner-207 kernel: [ 7072.583413] ? show_regs.cold+0x8/0xd Aug 22 07:21:38 juju-e4d256-prod-github-runner-207 kernel: [ 7072.584478] ? watchdog_timer_fn+0x1be/0x220 Aug 22 07:21:38 juju-e4d256-prod-github-runner-207 kernel: [ 7072.585586] ? lockup_detector_update_enable+0x60/0x60 Aug 22 07:21:38 juju-e4d256-prod-github-runner-207 kernel: [ 7072.587010] ? __hrtimer_run_queues+0x107/0x230 Aug 22 07:21:38 juju-e4d256-prod-github-runner-207 kernel: [ 7072.588182] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 07:21:38 juju-e4d256-prod-github-runner-207 kernel: [ 7072.589296] ? hrtimer_interrupt+0x101/0x220 Aug 22 07:21:38 juju-e4d256-prod-github-runner-207 kernel: [ 7072.590581] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 07:21:38 juju-e4d256-prod-github-runner-207 kernel: [ 7072.591934] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 07:21:38 juju-e4d256-prod-github-runner-207 kernel: [ 7072.593077] Aug 22 07:21:38 juju-e4d256-prod-github-runner-207 kernel: [ 7072.593982] Aug 22 07:21:38 juju-e4d256-prod-github-runner-207 kernel: [ 7072.594875] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 07:21:38 juju-e4d256-prod-github-runner-207 kernel: [ 7072.596022] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:21:38 juju-e4d256-prod-github-runner-207 kernel: [ 7072.597178] ? _raw_spin_lock+0x22/0x30 Aug 22 07:21:38 juju-e4d256-prod-github-runner-207 kernel: [ 7072.598206] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:21:38 juju-e4d256-prod-github-runner-207 kernel: [ 7072.599347] direct_page_fault+0x206/0x310 [kvm] Aug 22 07:21:38 juju-e4d256-prod-github-runner-207 kernel: [ 7072.600487] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 07:21:38 juju-e4d256-prod-github-runner-207 kernel: [ 7072.601764] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 07:21:38 juju-e4d256-prod-github-runner-207 kernel: [ 7072.602872] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 07:21:38 juju-e4d256-prod-github-runner-207 kernel: [ 7072.604159] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 07:21:38 juju-e4d256-prod-github-runner-207 kernel: [ 7072.605225] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 07:21:38 juju-e4d256-prod-github-runner-207 kernel: [ 7072.606386] handle_exit+0x98/0x230 [kvm_amd] Aug 22 07:21:38 juju-e4d256-prod-github-runner-207 kernel: [ 7072.607438] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 07:21:38 juju-e4d256-prod-github-runner-207 kernel: [ 7072.608464] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 07:21:38 juju-e4d256-prod-github-runner-207 kernel: [ 7072.609497] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 07:21:38 juju-e4d256-prod-github-runner-207 kernel: [ 7072.610509] vcpu_run+0x62/0x2c0 [kvm] Aug 22 07:21:38 juju-e4d256-prod-github-runner-207 kernel: [ 7072.611441] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 07:21:38 juju-e4d256-prod-github-runner-207 kernel: [ 7072.612349] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 07:21:38 juju-e4d256-prod-github-runner-207 kernel: [ 7072.613327] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 07:21:38 juju-e4d256-prod-github-runner-207 kernel: [ 7072.614221] ? __seccomp_filter+0x4a/0x4a0 Aug 22 07:21:38 juju-e4d256-prod-github-runner-207 kernel: [ 7072.615103] ? __fget_files+0x86/0xc0 Aug 22 07:21:38 juju-e4d256-prod-github-runner-207 kernel: [ 7072.615928] __x64_sys_ioctl+0x95/0xd0 Aug 22 07:21:38 juju-e4d256-prod-github-runner-207 kernel: [ 7072.616706] do_syscall_64+0x5c/0xc0 Aug 22 07:21:38 juju-e4d256-prod-github-runner-207 kernel: [ 7072.617450] ? do_futex+0x162/0x1f0 Aug 22 07:21:38 juju-e4d256-prod-github-runner-207 kernel: [ 7072.618191] ? __x64_sys_futex+0x78/0x1e0 Aug 22 07:21:38 juju-e4d256-prod-github-runner-207 kernel: [ 7072.618985] ? __secure_computing+0xa9/0x120 Aug 22 07:21:38 juju-e4d256-prod-github-runner-207 kernel: [ 7072.619787] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 07:21:38 juju-e4d256-prod-github-runner-207 kernel: [ 7072.620662] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:21:38 juju-e4d256-prod-github-runner-207 kernel: [ 7072.621484] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:21:38 juju-e4d256-prod-github-runner-207 kernel: [ 7072.622308] ? do_syscall_64+0x69/0xc0 Aug 22 07:21:38 juju-e4d256-prod-github-runner-207 kernel: [ 7072.623037] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:21:38 juju-e4d256-prod-github-runner-207 kernel: [ 7072.623861] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:21:38 juju-e4d256-prod-github-runner-207 kernel: [ 7072.624659] ? do_syscall_64+0x69/0xc0 Aug 22 07:21:38 juju-e4d256-prod-github-runner-207 kernel: [ 7072.625405] ? do_syscall_64+0x69/0xc0 Aug 22 07:21:38 juju-e4d256-prod-github-runner-207 kernel: [ 7072.626136] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 07:21:38 juju-e4d256-prod-github-runner-207 kernel: [ 7072.626953] RIP: 0033:0x7faa5d0edaff Aug 22 07:21:38 juju-e4d256-prod-github-runner-207 kernel: [ 7072.627678] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 07:21:38 juju-e4d256-prod-github-runner-207 kernel: [ 7072.630038] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 07:21:38 juju-e4d256-prod-github-runner-207 kernel: [ 7072.631108] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 07:21:38 juju-e4d256-prod-github-runner-207 kernel: [ 7072.632161] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 07:21:38 juju-e4d256-prod-github-runner-207 kernel: [ 7072.633195] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 07:21:38 juju-e4d256-prod-github-runner-207 kernel: [ 7072.634229] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 07:21:38 juju-e4d256-prod-github-runner-207 kernel: [ 7072.635280] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 07:21:38 juju-e4d256-prod-github-runner-207 kernel: [ 7072.636340] Aug 22 07:22:06 juju-e4d256-prod-github-runner-207 kernel: [ 7100.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 6504s! [qemu-system-x86:6715] Aug 22 07:22:06 juju-e4d256-prod-github-runner-207 kernel: [ 7100.543977] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 07:22:06 juju-e4d256-prod-github-runner-207 kernel: [ 7100.544302] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 07:22:06 juju-e4d256-prod-github-runner-207 kernel: [ 7100.556985] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 07:22:06 juju-e4d256-prod-github-runner-207 kernel: [ 7100.558373] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 07:22:06 juju-e4d256-prod-github-runner-207 kernel: [ 7100.559636] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:22:06 juju-e4d256-prod-github-runner-207 kernel: [ 7100.560694] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 07:22:06 juju-e4d256-prod-github-runner-207 kernel: [ 7100.563420] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 07:22:06 juju-e4d256-prod-github-runner-207 kernel: [ 7100.564683] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 07:22:06 juju-e4d256-prod-github-runner-207 kernel: [ 7100.565847] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 07:22:06 juju-e4d256-prod-github-runner-207 kernel: [ 7100.567042] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 07:22:06 juju-e4d256-prod-github-runner-207 kernel: [ 7100.568233] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 07:22:06 juju-e4d256-prod-github-runner-207 kernel: [ 7100.569432] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 07:22:06 juju-e4d256-prod-github-runner-207 kernel: [ 7100.570627] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 07:22:06 juju-e4d256-prod-github-runner-207 kernel: [ 7100.571891] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 07:22:06 juju-e4d256-prod-github-runner-207 kernel: [ 7100.573022] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 07:22:06 juju-e4d256-prod-github-runner-207 kernel: [ 7100.574268] Call Trace: Aug 22 07:22:06 juju-e4d256-prod-github-runner-207 kernel: [ 7100.575229] Aug 22 07:22:06 juju-e4d256-prod-github-runner-207 kernel: [ 7100.576142] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:22:06 juju-e4d256-prod-github-runner-207 kernel: [ 7100.577422] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:22:06 juju-e4d256-prod-github-runner-207 kernel: [ 7100.578500] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:22:06 juju-e4d256-prod-github-runner-207 kernel: [ 7100.579674] ? show_regs.part.0+0x23/0x29 Aug 22 07:22:06 juju-e4d256-prod-github-runner-207 kernel: [ 7100.580677] ? show_regs.cold+0x8/0xd Aug 22 07:22:06 juju-e4d256-prod-github-runner-207 kernel: [ 7100.581847] ? watchdog_timer_fn+0x1be/0x220 Aug 22 07:22:06 juju-e4d256-prod-github-runner-207 kernel: [ 7100.583091] ? lockup_detector_update_enable+0x60/0x60 Aug 22 07:22:06 juju-e4d256-prod-github-runner-207 kernel: [ 7100.584205] ? __hrtimer_run_queues+0x107/0x230 Aug 22 07:22:06 juju-e4d256-prod-github-runner-207 kernel: [ 7100.585247] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 07:22:06 juju-e4d256-prod-github-runner-207 kernel: [ 7100.586278] ? hrtimer_interrupt+0x101/0x220 Aug 22 07:22:06 juju-e4d256-prod-github-runner-207 kernel: [ 7100.587341] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 07:22:06 juju-e4d256-prod-github-runner-207 kernel: [ 7100.588494] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 07:22:06 juju-e4d256-prod-github-runner-207 kernel: [ 7100.589605] Aug 22 07:22:06 juju-e4d256-prod-github-runner-207 kernel: [ 7100.590479] Aug 22 07:22:06 juju-e4d256-prod-github-runner-207 kernel: [ 7100.591388] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 07:22:06 juju-e4d256-prod-github-runner-207 kernel: [ 7100.592477] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:22:06 juju-e4d256-prod-github-runner-207 kernel: [ 7100.593574] ? _raw_spin_lock+0x22/0x30 Aug 22 07:22:06 juju-e4d256-prod-github-runner-207 kernel: [ 7100.594600] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:22:06 juju-e4d256-prod-github-runner-207 kernel: [ 7100.595671] direct_page_fault+0x206/0x310 [kvm] Aug 22 07:22:06 juju-e4d256-prod-github-runner-207 kernel: [ 7100.596707] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 07:22:06 juju-e4d256-prod-github-runner-207 kernel: [ 7100.597725] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 07:22:06 juju-e4d256-prod-github-runner-207 kernel: [ 7100.598756] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 07:22:06 juju-e4d256-prod-github-runner-207 kernel: [ 7100.599808] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 07:22:06 juju-e4d256-prod-github-runner-207 kernel: [ 7100.600796] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 07:22:06 juju-e4d256-prod-github-runner-207 kernel: [ 7100.601797] handle_exit+0x98/0x230 [kvm_amd] Aug 22 07:22:06 juju-e4d256-prod-github-runner-207 kernel: [ 7100.602694] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 07:22:06 juju-e4d256-prod-github-runner-207 kernel: [ 7100.603664] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 07:22:06 juju-e4d256-prod-github-runner-207 kernel: [ 7100.604641] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 07:22:06 juju-e4d256-prod-github-runner-207 kernel: [ 7100.605564] vcpu_run+0x62/0x2c0 [kvm] Aug 22 07:22:06 juju-e4d256-prod-github-runner-207 kernel: [ 7100.606391] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 07:22:06 juju-e4d256-prod-github-runner-207 kernel: [ 7100.607233] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 07:22:06 juju-e4d256-prod-github-runner-207 kernel: [ 7100.608106] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 07:22:06 juju-e4d256-prod-github-runner-207 kernel: [ 7100.608931] ? __seccomp_filter+0x4a/0x4a0 Aug 22 07:22:06 juju-e4d256-prod-github-runner-207 kernel: [ 7100.609731] ? __fget_files+0x86/0xc0 Aug 22 07:22:06 juju-e4d256-prod-github-runner-207 kernel: [ 7100.610473] __x64_sys_ioctl+0x95/0xd0 Aug 22 07:22:06 juju-e4d256-prod-github-runner-207 kernel: [ 7100.611197] do_syscall_64+0x5c/0xc0 Aug 22 07:22:06 juju-e4d256-prod-github-runner-207 kernel: [ 7100.611874] ? do_futex+0x162/0x1f0 Aug 22 07:22:06 juju-e4d256-prod-github-runner-207 kernel: [ 7100.612528] ? __x64_sys_futex+0x78/0x1e0 Aug 22 07:22:06 juju-e4d256-prod-github-runner-207 kernel: [ 7100.613207] ? __secure_computing+0xa9/0x120 Aug 22 07:22:06 juju-e4d256-prod-github-runner-207 kernel: [ 7100.613914] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 07:22:06 juju-e4d256-prod-github-runner-207 kernel: [ 7100.614687] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:22:06 juju-e4d256-prod-github-runner-207 kernel: [ 7100.615442] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:22:06 juju-e4d256-prod-github-runner-207 kernel: [ 7100.616167] ? do_syscall_64+0x69/0xc0 Aug 22 07:22:06 juju-e4d256-prod-github-runner-207 kernel: [ 7100.616815] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:22:06 juju-e4d256-prod-github-runner-207 kernel: [ 7100.617528] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:22:06 juju-e4d256-prod-github-runner-207 kernel: [ 7100.618227] ? do_syscall_64+0x69/0xc0 Aug 22 07:22:06 juju-e4d256-prod-github-runner-207 kernel: [ 7100.618889] ? do_syscall_64+0x69/0xc0 Aug 22 07:22:06 juju-e4d256-prod-github-runner-207 kernel: [ 7100.619538] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 07:22:06 juju-e4d256-prod-github-runner-207 kernel: [ 7100.620272] RIP: 0033:0x7faa5d0edaff Aug 22 07:22:06 juju-e4d256-prod-github-runner-207 kernel: [ 7100.620982] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 07:22:06 juju-e4d256-prod-github-runner-207 kernel: [ 7100.623118] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 07:22:06 juju-e4d256-prod-github-runner-207 kernel: [ 7100.624047] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 07:22:06 juju-e4d256-prod-github-runner-207 kernel: [ 7100.624962] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 07:22:06 juju-e4d256-prod-github-runner-207 kernel: [ 7100.625885] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 07:22:06 juju-e4d256-prod-github-runner-207 kernel: [ 7100.626805] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 07:22:06 juju-e4d256-prod-github-runner-207 kernel: [ 7100.627721] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 07:22:06 juju-e4d256-prod-github-runner-207 kernel: [ 7100.628617] Aug 22 07:22:34 juju-e4d256-prod-github-runner-207 kernel: [ 7128.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 6530s! [qemu-system-x86:6715] Aug 22 07:22:34 juju-e4d256-prod-github-runner-207 kernel: [ 7128.543121] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 07:22:34 juju-e4d256-prod-github-runner-207 kernel: [ 7128.543195] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 07:22:34 juju-e4d256-prod-github-runner-207 kernel: [ 7128.555850] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 07:22:34 juju-e4d256-prod-github-runner-207 kernel: [ 7128.557160] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 07:22:34 juju-e4d256-prod-github-runner-207 kernel: [ 7128.558428] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:22:34 juju-e4d256-prod-github-runner-207 kernel: [ 7128.559500] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 07:22:34 juju-e4d256-prod-github-runner-207 kernel: [ 7128.562138] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 07:22:34 juju-e4d256-prod-github-runner-207 kernel: [ 7128.563212] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 07:22:34 juju-e4d256-prod-github-runner-207 kernel: [ 7128.564424] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 07:22:34 juju-e4d256-prod-github-runner-207 kernel: [ 7128.565617] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 07:22:34 juju-e4d256-prod-github-runner-207 kernel: [ 7128.566863] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 07:22:34 juju-e4d256-prod-github-runner-207 kernel: [ 7128.568095] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 07:22:34 juju-e4d256-prod-github-runner-207 kernel: [ 7128.569324] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 07:22:34 juju-e4d256-prod-github-runner-207 kernel: [ 7128.570658] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 07:22:34 juju-e4d256-prod-github-runner-207 kernel: [ 7128.571808] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 07:22:34 juju-e4d256-prod-github-runner-207 kernel: [ 7128.573150] Call Trace: Aug 22 07:22:34 juju-e4d256-prod-github-runner-207 kernel: [ 7128.574078] Aug 22 07:22:34 juju-e4d256-prod-github-runner-207 kernel: [ 7128.574998] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:22:34 juju-e4d256-prod-github-runner-207 kernel: [ 7128.576040] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:22:34 juju-e4d256-prod-github-runner-207 kernel: [ 7128.577100] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:22:34 juju-e4d256-prod-github-runner-207 kernel: [ 7128.578201] ? show_regs.part.0+0x23/0x29 Aug 22 07:22:34 juju-e4d256-prod-github-runner-207 kernel: [ 7128.579230] ? show_regs.cold+0x8/0xd Aug 22 07:22:34 juju-e4d256-prod-github-runner-207 kernel: [ 7128.580218] ? watchdog_timer_fn+0x1be/0x220 Aug 22 07:22:34 juju-e4d256-prod-github-runner-207 kernel: [ 7128.581246] ? lockup_detector_update_enable+0x60/0x60 Aug 22 07:22:34 juju-e4d256-prod-github-runner-207 kernel: [ 7128.582338] ? __hrtimer_run_queues+0x107/0x230 Aug 22 07:22:34 juju-e4d256-prod-github-runner-207 kernel: [ 7128.583416] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 07:22:34 juju-e4d256-prod-github-runner-207 kernel: [ 7128.584468] ? hrtimer_interrupt+0x101/0x220 Aug 22 07:22:34 juju-e4d256-prod-github-runner-207 kernel: [ 7128.585522] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 07:22:34 juju-e4d256-prod-github-runner-207 kernel: [ 7128.586635] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 07:22:34 juju-e4d256-prod-github-runner-207 kernel: [ 7128.587710] Aug 22 07:22:34 juju-e4d256-prod-github-runner-207 kernel: [ 7128.588574] Aug 22 07:22:34 juju-e4d256-prod-github-runner-207 kernel: [ 7128.589429] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 07:22:34 juju-e4d256-prod-github-runner-207 kernel: [ 7128.590497] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:22:34 juju-e4d256-prod-github-runner-207 kernel: [ 7128.591556] ? _raw_spin_lock+0x22/0x30 Aug 22 07:22:34 juju-e4d256-prod-github-runner-207 kernel: [ 7128.592528] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:22:34 juju-e4d256-prod-github-runner-207 kernel: [ 7128.593596] direct_page_fault+0x206/0x310 [kvm] Aug 22 07:22:34 juju-e4d256-prod-github-runner-207 kernel: [ 7128.594716] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 07:22:34 juju-e4d256-prod-github-runner-207 kernel: [ 7128.595823] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 07:22:34 juju-e4d256-prod-github-runner-207 kernel: [ 7128.596903] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 07:22:34 juju-e4d256-prod-github-runner-207 kernel: [ 7128.597919] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 07:22:34 juju-e4d256-prod-github-runner-207 kernel: [ 7128.598932] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 07:22:34 juju-e4d256-prod-github-runner-207 kernel: [ 7128.599968] handle_exit+0x98/0x230 [kvm_amd] Aug 22 07:22:34 juju-e4d256-prod-github-runner-207 kernel: [ 7128.600909] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 07:22:34 juju-e4d256-prod-github-runner-207 kernel: [ 7128.601904] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 07:22:34 juju-e4d256-prod-github-runner-207 kernel: [ 7128.602891] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 07:22:34 juju-e4d256-prod-github-runner-207 kernel: [ 7128.603836] vcpu_run+0x62/0x2c0 [kvm] Aug 22 07:22:34 juju-e4d256-prod-github-runner-207 kernel: [ 7128.604677] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 07:22:34 juju-e4d256-prod-github-runner-207 kernel: [ 7128.605527] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 07:22:34 juju-e4d256-prod-github-runner-207 kernel: [ 7128.606421] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 07:22:34 juju-e4d256-prod-github-runner-207 kernel: [ 7128.607242] ? __seccomp_filter+0x4a/0x4a0 Aug 22 07:22:34 juju-e4d256-prod-github-runner-207 kernel: [ 7128.608007] ? __fget_files+0x86/0xc0 Aug 22 07:22:34 juju-e4d256-prod-github-runner-207 kernel: [ 7128.608744] __x64_sys_ioctl+0x95/0xd0 Aug 22 07:22:34 juju-e4d256-prod-github-runner-207 kernel: [ 7128.609458] do_syscall_64+0x5c/0xc0 Aug 22 07:22:34 juju-e4d256-prod-github-runner-207 kernel: [ 7128.610136] ? do_futex+0x162/0x1f0 Aug 22 07:22:34 juju-e4d256-prod-github-runner-207 kernel: [ 7128.610818] ? __x64_sys_futex+0x78/0x1e0 Aug 22 07:22:34 juju-e4d256-prod-github-runner-207 kernel: [ 7128.611508] ? __secure_computing+0xa9/0x120 Aug 22 07:22:34 juju-e4d256-prod-github-runner-207 kernel: [ 7128.612216] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 07:22:34 juju-e4d256-prod-github-runner-207 kernel: [ 7128.613010] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:22:34 juju-e4d256-prod-github-runner-207 kernel: [ 7128.613787] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:22:34 juju-e4d256-prod-github-runner-207 kernel: [ 7128.614581] ? do_syscall_64+0x69/0xc0 Aug 22 07:22:34 juju-e4d256-prod-github-runner-207 kernel: [ 7128.615246] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:22:34 juju-e4d256-prod-github-runner-207 kernel: [ 7128.615966] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:22:34 juju-e4d256-prod-github-runner-207 kernel: [ 7128.616684] ? do_syscall_64+0x69/0xc0 Aug 22 07:22:34 juju-e4d256-prod-github-runner-207 kernel: [ 7128.617377] ? do_syscall_64+0x69/0xc0 Aug 22 07:22:34 juju-e4d256-prod-github-runner-207 kernel: [ 7128.618041] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 07:22:34 juju-e4d256-prod-github-runner-207 kernel: [ 7128.618790] RIP: 0033:0x7faa5d0edaff Aug 22 07:22:34 juju-e4d256-prod-github-runner-207 kernel: [ 7128.619437] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 07:22:34 juju-e4d256-prod-github-runner-207 kernel: [ 7128.621488] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 07:22:34 juju-e4d256-prod-github-runner-207 kernel: [ 7128.622658] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 07:22:34 juju-e4d256-prod-github-runner-207 kernel: [ 7128.623572] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 07:22:34 juju-e4d256-prod-github-runner-207 kernel: [ 7128.624480] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 07:22:34 juju-e4d256-prod-github-runner-207 kernel: [ 7128.625420] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 07:22:34 juju-e4d256-prod-github-runner-207 kernel: [ 7128.626334] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 07:22:34 juju-e4d256-prod-github-runner-207 kernel: [ 7128.627264] Aug 22 07:23:02 juju-e4d256-prod-github-runner-207 kernel: [ 7156.542020] watchdog: BUG: soft lockup - CPU#1 stuck for 6557s! [qemu-system-x86:6715] Aug 22 07:23:02 juju-e4d256-prod-github-runner-207 kernel: [ 7156.544172] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 07:23:02 juju-e4d256-prod-github-runner-207 kernel: [ 7156.544503] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 07:23:02 juju-e4d256-prod-github-runner-207 kernel: [ 7156.558988] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 07:23:02 juju-e4d256-prod-github-runner-207 kernel: [ 7156.560484] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 07:23:02 juju-e4d256-prod-github-runner-207 kernel: [ 7156.561932] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:23:02 juju-e4d256-prod-github-runner-207 kernel: [ 7156.563172] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 07:23:02 juju-e4d256-prod-github-runner-207 kernel: [ 7156.566169] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 07:23:02 juju-e4d256-prod-github-runner-207 kernel: [ 7156.567358] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 07:23:02 juju-e4d256-prod-github-runner-207 kernel: [ 7156.568733] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 07:23:02 juju-e4d256-prod-github-runner-207 kernel: [ 7156.570114] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 07:23:02 juju-e4d256-prod-github-runner-207 kernel: [ 7156.571389] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 07:23:02 juju-e4d256-prod-github-runner-207 kernel: [ 7156.572657] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 07:23:02 juju-e4d256-prod-github-runner-207 kernel: [ 7156.573946] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 07:23:02 juju-e4d256-prod-github-runner-207 kernel: [ 7156.575341] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 07:23:02 juju-e4d256-prod-github-runner-207 kernel: [ 7156.576589] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 07:23:02 juju-e4d256-prod-github-runner-207 kernel: [ 7156.577892] Call Trace: Aug 22 07:23:02 juju-e4d256-prod-github-runner-207 kernel: [ 7156.578940] Aug 22 07:23:02 juju-e4d256-prod-github-runner-207 kernel: [ 7156.579950] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:23:02 juju-e4d256-prod-github-runner-207 kernel: [ 7156.581080] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:23:02 juju-e4d256-prod-github-runner-207 kernel: [ 7156.582269] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:23:02 juju-e4d256-prod-github-runner-207 kernel: [ 7156.583544] ? show_regs.part.0+0x23/0x29 Aug 22 07:23:02 juju-e4d256-prod-github-runner-207 kernel: [ 7156.584633] ? show_regs.cold+0x8/0xd Aug 22 07:23:02 juju-e4d256-prod-github-runner-207 kernel: [ 7156.585750] ? watchdog_timer_fn+0x1be/0x220 Aug 22 07:23:02 juju-e4d256-prod-github-runner-207 kernel: [ 7156.586910] ? lockup_detector_update_enable+0x60/0x60 Aug 22 07:23:02 juju-e4d256-prod-github-runner-207 kernel: [ 7156.588115] ? __hrtimer_run_queues+0x107/0x230 Aug 22 07:23:02 juju-e4d256-prod-github-runner-207 kernel: [ 7156.589316] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 07:23:02 juju-e4d256-prod-github-runner-207 kernel: [ 7156.590514] ? hrtimer_interrupt+0x101/0x220 Aug 22 07:23:02 juju-e4d256-prod-github-runner-207 kernel: [ 7156.591668] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 07:23:02 juju-e4d256-prod-github-runner-207 kernel: [ 7156.593055] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 07:23:02 juju-e4d256-prod-github-runner-207 kernel: [ 7156.594404] Aug 22 07:23:02 juju-e4d256-prod-github-runner-207 kernel: [ 7156.595312] Aug 22 07:23:02 juju-e4d256-prod-github-runner-207 kernel: [ 7156.596203] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 07:23:02 juju-e4d256-prod-github-runner-207 kernel: [ 7156.597342] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:23:02 juju-e4d256-prod-github-runner-207 kernel: [ 7156.598529] ? _raw_spin_lock+0x22/0x30 Aug 22 07:23:02 juju-e4d256-prod-github-runner-207 kernel: [ 7156.599513] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:23:02 juju-e4d256-prod-github-runner-207 kernel: [ 7156.600614] direct_page_fault+0x206/0x310 [kvm] Aug 22 07:23:02 juju-e4d256-prod-github-runner-207 kernel: [ 7156.601693] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 07:23:02 juju-e4d256-prod-github-runner-207 kernel: [ 7156.602825] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 07:23:02 juju-e4d256-prod-github-runner-207 kernel: [ 7156.603899] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 07:23:02 juju-e4d256-prod-github-runner-207 kernel: [ 7156.604974] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 07:23:02 juju-e4d256-prod-github-runner-207 kernel: [ 7156.606016] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 07:23:02 juju-e4d256-prod-github-runner-207 kernel: [ 7156.607044] handle_exit+0x98/0x230 [kvm_amd] Aug 22 07:23:02 juju-e4d256-prod-github-runner-207 kernel: [ 7156.607985] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 07:23:02 juju-e4d256-prod-github-runner-207 kernel: [ 7156.608961] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 07:23:02 juju-e4d256-prod-github-runner-207 kernel: [ 7156.609938] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 07:23:02 juju-e4d256-prod-github-runner-207 kernel: [ 7156.610909] vcpu_run+0x62/0x2c0 [kvm] Aug 22 07:23:02 juju-e4d256-prod-github-runner-207 kernel: [ 7156.611782] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 07:23:02 juju-e4d256-prod-github-runner-207 kernel: [ 7156.612619] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 07:23:02 juju-e4d256-prod-github-runner-207 kernel: [ 7156.613525] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 07:23:02 juju-e4d256-prod-github-runner-207 kernel: [ 7156.614393] ? __seccomp_filter+0x4a/0x4a0 Aug 22 07:23:02 juju-e4d256-prod-github-runner-207 kernel: [ 7156.615182] ? __fget_files+0x86/0xc0 Aug 22 07:23:02 juju-e4d256-prod-github-runner-207 kernel: [ 7156.615937] __x64_sys_ioctl+0x95/0xd0 Aug 22 07:23:02 juju-e4d256-prod-github-runner-207 kernel: [ 7156.616668] do_syscall_64+0x5c/0xc0 Aug 22 07:23:02 juju-e4d256-prod-github-runner-207 kernel: [ 7156.617370] ? do_futex+0x162/0x1f0 Aug 22 07:23:02 juju-e4d256-prod-github-runner-207 kernel: [ 7156.618071] ? __x64_sys_futex+0x78/0x1e0 Aug 22 07:23:02 juju-e4d256-prod-github-runner-207 kernel: [ 7156.618779] ? __secure_computing+0xa9/0x120 Aug 22 07:23:02 juju-e4d256-prod-github-runner-207 kernel: [ 7156.619510] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 07:23:02 juju-e4d256-prod-github-runner-207 kernel: [ 7156.620366] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:23:02 juju-e4d256-prod-github-runner-207 kernel: [ 7156.621119] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:23:02 juju-e4d256-prod-github-runner-207 kernel: [ 7156.621925] ? do_syscall_64+0x69/0xc0 Aug 22 07:23:02 juju-e4d256-prod-github-runner-207 kernel: [ 7156.622618] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:23:02 juju-e4d256-prod-github-runner-207 kernel: [ 7156.623364] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:23:02 juju-e4d256-prod-github-runner-207 kernel: [ 7156.624117] ? do_syscall_64+0x69/0xc0 Aug 22 07:23:02 juju-e4d256-prod-github-runner-207 kernel: [ 7156.624775] ? do_syscall_64+0x69/0xc0 Aug 22 07:23:02 juju-e4d256-prod-github-runner-207 kernel: [ 7156.625457] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 07:23:02 juju-e4d256-prod-github-runner-207 kernel: [ 7156.626194] RIP: 0033:0x7faa5d0edaff Aug 22 07:23:02 juju-e4d256-prod-github-runner-207 kernel: [ 7156.626894] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 07:23:02 juju-e4d256-prod-github-runner-207 kernel: [ 7156.629054] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 07:23:02 juju-e4d256-prod-github-runner-207 kernel: [ 7156.630054] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 07:23:02 juju-e4d256-prod-github-runner-207 kernel: [ 7156.630956] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 07:23:02 juju-e4d256-prod-github-runner-207 kernel: [ 7156.631856] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 07:23:02 juju-e4d256-prod-github-runner-207 kernel: [ 7156.632783] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 07:23:02 juju-e4d256-prod-github-runner-207 kernel: [ 7156.633683] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 07:23:02 juju-e4d256-prod-github-runner-207 kernel: [ 7156.634626] Aug 22 07:23:30 juju-e4d256-prod-github-runner-207 kernel: [ 7184.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 6583s! [qemu-system-x86:6715] Aug 22 07:23:30 juju-e4d256-prod-github-runner-207 kernel: [ 7184.543334] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 07:23:30 juju-e4d256-prod-github-runner-207 kernel: [ 7184.543418] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 07:23:30 juju-e4d256-prod-github-runner-207 kernel: [ 7184.557399] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 07:23:30 juju-e4d256-prod-github-runner-207 kernel: [ 7184.558700] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 07:23:30 juju-e4d256-prod-github-runner-207 kernel: [ 7184.559971] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:23:30 juju-e4d256-prod-github-runner-207 kernel: [ 7184.561122] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 07:23:30 juju-e4d256-prod-github-runner-207 kernel: [ 7184.563760] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 07:23:30 juju-e4d256-prod-github-runner-207 kernel: [ 7184.564830] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 07:23:30 juju-e4d256-prod-github-runner-207 kernel: [ 7184.566009] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 07:23:30 juju-e4d256-prod-github-runner-207 kernel: [ 7184.567258] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 07:23:30 juju-e4d256-prod-github-runner-207 kernel: [ 7184.568449] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 07:23:30 juju-e4d256-prod-github-runner-207 kernel: [ 7184.569668] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 07:23:30 juju-e4d256-prod-github-runner-207 kernel: [ 7184.570876] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 07:23:30 juju-e4d256-prod-github-runner-207 kernel: [ 7184.572183] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 07:23:30 juju-e4d256-prod-github-runner-207 kernel: [ 7184.573360] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 07:23:30 juju-e4d256-prod-github-runner-207 kernel: [ 7184.574821] Call Trace: Aug 22 07:23:30 juju-e4d256-prod-github-runner-207 kernel: [ 7184.575782] Aug 22 07:23:30 juju-e4d256-prod-github-runner-207 kernel: [ 7184.576922] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:23:30 juju-e4d256-prod-github-runner-207 kernel: [ 7184.578259] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:23:30 juju-e4d256-prod-github-runner-207 kernel: [ 7184.579650] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:23:30 juju-e4d256-prod-github-runner-207 kernel: [ 7184.581068] ? show_regs.part.0+0x23/0x29 Aug 22 07:23:30 juju-e4d256-prod-github-runner-207 kernel: [ 7184.582454] ? show_regs.cold+0x8/0xd Aug 22 07:23:30 juju-e4d256-prod-github-runner-207 kernel: [ 7184.583524] ? watchdog_timer_fn+0x1be/0x220 Aug 22 07:23:30 juju-e4d256-prod-github-runner-207 kernel: [ 7184.584558] ? lockup_detector_update_enable+0x60/0x60 Aug 22 07:23:30 juju-e4d256-prod-github-runner-207 kernel: [ 7184.585661] ? __hrtimer_run_queues+0x107/0x230 Aug 22 07:23:30 juju-e4d256-prod-github-runner-207 kernel: [ 7184.586696] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 07:23:30 juju-e4d256-prod-github-runner-207 kernel: [ 7184.587757] ? hrtimer_interrupt+0x101/0x220 Aug 22 07:23:30 juju-e4d256-prod-github-runner-207 kernel: [ 7184.588813] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 07:23:30 juju-e4d256-prod-github-runner-207 kernel: [ 7184.589945] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 07:23:30 juju-e4d256-prod-github-runner-207 kernel: [ 7184.591025] Aug 22 07:23:30 juju-e4d256-prod-github-runner-207 kernel: [ 7184.591915] Aug 22 07:23:30 juju-e4d256-prod-github-runner-207 kernel: [ 7184.592801] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 07:23:30 juju-e4d256-prod-github-runner-207 kernel: [ 7184.593868] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:23:30 juju-e4d256-prod-github-runner-207 kernel: [ 7184.594920] ? _raw_spin_lock+0x22/0x30 Aug 22 07:23:30 juju-e4d256-prod-github-runner-207 kernel: [ 7184.595928] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:23:30 juju-e4d256-prod-github-runner-207 kernel: [ 7184.597001] direct_page_fault+0x206/0x310 [kvm] Aug 22 07:23:30 juju-e4d256-prod-github-runner-207 kernel: [ 7184.598075] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 07:23:30 juju-e4d256-prod-github-runner-207 kernel: [ 7184.599112] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 07:23:30 juju-e4d256-prod-github-runner-207 kernel: [ 7184.600168] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 07:23:30 juju-e4d256-prod-github-runner-207 kernel: [ 7184.601169] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 07:23:30 juju-e4d256-prod-github-runner-207 kernel: [ 7184.602151] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 07:23:30 juju-e4d256-prod-github-runner-207 kernel: [ 7184.603161] handle_exit+0x98/0x230 [kvm_amd] Aug 22 07:23:30 juju-e4d256-prod-github-runner-207 kernel: [ 7184.604087] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 07:23:30 juju-e4d256-prod-github-runner-207 kernel: [ 7184.605060] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 07:23:30 juju-e4d256-prod-github-runner-207 kernel: [ 7184.606021] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 07:23:30 juju-e4d256-prod-github-runner-207 kernel: [ 7184.606936] vcpu_run+0x62/0x2c0 [kvm] Aug 22 07:23:30 juju-e4d256-prod-github-runner-207 kernel: [ 7184.607781] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 07:23:30 juju-e4d256-prod-github-runner-207 kernel: [ 7184.608607] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 07:23:30 juju-e4d256-prod-github-runner-207 kernel: [ 7184.609576] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 07:23:30 juju-e4d256-prod-github-runner-207 kernel: [ 7184.610413] ? __seccomp_filter+0x4a/0x4a0 Aug 22 07:23:30 juju-e4d256-prod-github-runner-207 kernel: [ 7184.611162] ? __fget_files+0x86/0xc0 Aug 22 07:23:30 juju-e4d256-prod-github-runner-207 kernel: [ 7184.611883] __x64_sys_ioctl+0x95/0xd0 Aug 22 07:23:30 juju-e4d256-prod-github-runner-207 kernel: [ 7184.612589] do_syscall_64+0x5c/0xc0 Aug 22 07:23:30 juju-e4d256-prod-github-runner-207 kernel: [ 7184.613270] ? do_futex+0x162/0x1f0 Aug 22 07:23:30 juju-e4d256-prod-github-runner-207 kernel: [ 7184.613954] ? __x64_sys_futex+0x78/0x1e0 Aug 22 07:23:30 juju-e4d256-prod-github-runner-207 kernel: [ 7184.614693] ? __secure_computing+0xa9/0x120 Aug 22 07:23:30 juju-e4d256-prod-github-runner-207 kernel: [ 7184.615405] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 07:23:30 juju-e4d256-prod-github-runner-207 kernel: [ 7184.616188] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:23:30 juju-e4d256-prod-github-runner-207 kernel: [ 7184.616916] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:23:30 juju-e4d256-prod-github-runner-207 kernel: [ 7184.617658] ? do_syscall_64+0x69/0xc0 Aug 22 07:23:30 juju-e4d256-prod-github-runner-207 kernel: [ 7184.618312] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:23:30 juju-e4d256-prod-github-runner-207 kernel: [ 7184.619022] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:23:30 juju-e4d256-prod-github-runner-207 kernel: [ 7184.619754] ? do_syscall_64+0x69/0xc0 Aug 22 07:23:30 juju-e4d256-prod-github-runner-207 kernel: [ 7184.620399] ? do_syscall_64+0x69/0xc0 Aug 22 07:23:30 juju-e4d256-prod-github-runner-207 kernel: [ 7184.621032] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 07:23:30 juju-e4d256-prod-github-runner-207 kernel: [ 7184.621757] RIP: 0033:0x7faa5d0edaff Aug 22 07:23:30 juju-e4d256-prod-github-runner-207 kernel: [ 7184.622391] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 07:23:30 juju-e4d256-prod-github-runner-207 kernel: [ 7184.624494] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 07:23:30 juju-e4d256-prod-github-runner-207 kernel: [ 7184.625670] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 07:23:30 juju-e4d256-prod-github-runner-207 kernel: [ 7184.626587] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 07:23:30 juju-e4d256-prod-github-runner-207 kernel: [ 7184.627496] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 07:23:30 juju-e4d256-prod-github-runner-207 kernel: [ 7184.628395] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 07:23:30 juju-e4d256-prod-github-runner-207 kernel: [ 7184.629298] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 07:23:30 juju-e4d256-prod-github-runner-207 kernel: [ 7184.630227] Aug 22 07:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 7197.668709] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 07:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 7197.669936] rcu: 1-....: (1764561 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=857026 Aug 22 07:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 7197.671387] (t=1770117 jiffies g=23269 q=16123) Aug 22 07:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 7197.672368] NMI backtrace for cpu 1 Aug 22 07:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 7197.673087] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 07:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 7197.674212] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 07:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 7197.675270] Call Trace: Aug 22 07:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 7197.675955] Aug 22 07:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 7197.676608] show_stack+0x52/0x5c Aug 22 07:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 7197.677333] dump_stack_lvl+0x4a/0x63 Aug 22 07:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 7197.678099] dump_stack+0x10/0x16 Aug 22 07:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 7197.678829] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 07:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 7197.679631] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 07:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 7197.680417] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 07:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 7197.681240] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 07:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 7197.682078] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 07:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 7197.682891] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 07:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 7197.683702] print_cpu_stall.cold+0x2f/0xe2 Aug 22 07:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 7197.684909] ? timekeeping_update+0xf7/0x150 Aug 22 07:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 7197.685744] check_cpu_stall+0x109/0x270 Aug 22 07:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 7197.686503] rcu_sched_clock_irq+0x9a/0x250 Aug 22 07:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 7197.687268] update_process_times+0x94/0xd0 Aug 22 07:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 7197.688191] tick_sched_handle+0x29/0x70 Aug 22 07:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 7197.689134] tick_sched_timer+0x8c/0xc0 Aug 22 07:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 7197.689892] ? tick_nohz_handler+0xb0/0xb0 Aug 22 07:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 7197.690651] __hrtimer_run_queues+0x107/0x230 Aug 22 07:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 7197.691433] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 07:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 7197.692220] hrtimer_interrupt+0x101/0x220 Aug 22 07:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 7197.692987] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 07:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 7197.693824] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 07:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 7197.694669] Aug 22 07:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 7197.695328] Aug 22 07:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 7197.695994] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 07:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 7197.696832] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 7197.697739] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 07:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 7197.699984] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 07:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 7197.700991] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 07:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 7197.702037] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 07:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 7197.703013] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 07:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 7197.703986] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 07:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 7197.704947] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 07:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 7197.705915] ? _raw_spin_lock+0x22/0x30 Aug 22 07:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 7197.706675] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 7197.707515] direct_page_fault+0x206/0x310 [kvm] Aug 22 07:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 7197.708352] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 07:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 7197.709178] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 07:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 7197.710014] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 07:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 7197.710844] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 07:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 7197.711673] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 07:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 7197.712502] handle_exit+0x98/0x230 [kvm_amd] Aug 22 07:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 7197.713255] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 07:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 7197.714059] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 07:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 7197.714873] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 07:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 7197.715660] vcpu_run+0x62/0x2c0 [kvm] Aug 22 07:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 7197.716379] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 07:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 7197.717115] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 07:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 7197.717933] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 07:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 7197.718692] ? __seccomp_filter+0x4a/0x4a0 Aug 22 07:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 7197.719411] ? __fget_files+0x86/0xc0 Aug 22 07:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 7197.720112] __x64_sys_ioctl+0x95/0xd0 Aug 22 07:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 7197.720821] do_syscall_64+0x5c/0xc0 Aug 22 07:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 7197.721554] ? do_futex+0x162/0x1f0 Aug 22 07:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 7197.722228] ? __x64_sys_futex+0x78/0x1e0 Aug 22 07:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 7197.722929] ? __secure_computing+0xa9/0x120 Aug 22 07:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 7197.723657] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 07:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 7197.724448] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 7197.725201] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 7197.725976] ? do_syscall_64+0x69/0xc0 Aug 22 07:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 7197.726856] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 7197.727822] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 7197.728721] ? do_syscall_64+0x69/0xc0 Aug 22 07:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 7197.729475] ? do_syscall_64+0x69/0xc0 Aug 22 07:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 7197.730202] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 07:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 7197.730981] RIP: 0033:0x7faa5d0edaff Aug 22 07:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 7197.731672] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 07:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 7197.733846] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 07:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 7197.735041] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 07:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 7197.736023] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 07:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 7197.736988] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 07:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 7197.737952] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 07:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 7197.738880] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 07:23:43 juju-e4d256-prod-github-runner-207 kernel: [ 7197.739804] Aug 22 07:24:10 juju-e4d256-prod-github-runner-207 kernel: [ 7224.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 6620s! [qemu-system-x86:6715] Aug 22 07:24:10 juju-e4d256-prod-github-runner-207 kernel: [ 7224.543948] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 07:24:10 juju-e4d256-prod-github-runner-207 kernel: [ 7224.544262] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 07:24:10 juju-e4d256-prod-github-runner-207 kernel: [ 7224.556908] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 07:24:10 juju-e4d256-prod-github-runner-207 kernel: [ 7224.558217] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 07:24:10 juju-e4d256-prod-github-runner-207 kernel: [ 7224.559468] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:24:10 juju-e4d256-prod-github-runner-207 kernel: [ 7224.560548] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 07:24:10 juju-e4d256-prod-github-runner-207 kernel: [ 7224.563179] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 07:24:10 juju-e4d256-prod-github-runner-207 kernel: [ 7224.564251] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 07:24:10 juju-e4d256-prod-github-runner-207 kernel: [ 7224.565505] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 07:24:10 juju-e4d256-prod-github-runner-207 kernel: [ 7224.566697] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 07:24:10 juju-e4d256-prod-github-runner-207 kernel: [ 7224.567899] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 07:24:10 juju-e4d256-prod-github-runner-207 kernel: [ 7224.569109] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 07:24:10 juju-e4d256-prod-github-runner-207 kernel: [ 7224.570290] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 07:24:10 juju-e4d256-prod-github-runner-207 kernel: [ 7224.571656] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 07:24:10 juju-e4d256-prod-github-runner-207 kernel: [ 7224.573139] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 07:24:10 juju-e4d256-prod-github-runner-207 kernel: [ 7224.574355] Call Trace: Aug 22 07:24:10 juju-e4d256-prod-github-runner-207 kernel: [ 7224.575289] Aug 22 07:24:10 juju-e4d256-prod-github-runner-207 kernel: [ 7224.576197] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:24:10 juju-e4d256-prod-github-runner-207 kernel: [ 7224.577285] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:24:10 juju-e4d256-prod-github-runner-207 kernel: [ 7224.578387] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:24:10 juju-e4d256-prod-github-runner-207 kernel: [ 7224.579531] ? show_regs.part.0+0x23/0x29 Aug 22 07:24:10 juju-e4d256-prod-github-runner-207 kernel: [ 7224.580548] ? show_regs.cold+0x8/0xd Aug 22 07:24:10 juju-e4d256-prod-github-runner-207 kernel: [ 7224.581555] ? watchdog_timer_fn+0x1be/0x220 Aug 22 07:24:10 juju-e4d256-prod-github-runner-207 kernel: [ 7224.582584] ? lockup_detector_update_enable+0x60/0x60 Aug 22 07:24:10 juju-e4d256-prod-github-runner-207 kernel: [ 7224.583724] ? __hrtimer_run_queues+0x107/0x230 Aug 22 07:24:10 juju-e4d256-prod-github-runner-207 kernel: [ 7224.584889] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 07:24:10 juju-e4d256-prod-github-runner-207 kernel: [ 7224.585999] ? hrtimer_interrupt+0x101/0x220 Aug 22 07:24:10 juju-e4d256-prod-github-runner-207 kernel: [ 7224.587092] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 07:24:10 juju-e4d256-prod-github-runner-207 kernel: [ 7224.588211] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 07:24:10 juju-e4d256-prod-github-runner-207 kernel: [ 7224.589292] Aug 22 07:24:10 juju-e4d256-prod-github-runner-207 kernel: [ 7224.590158] Aug 22 07:24:10 juju-e4d256-prod-github-runner-207 kernel: [ 7224.591030] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 07:24:10 juju-e4d256-prod-github-runner-207 kernel: [ 7224.592242] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:24:10 juju-e4d256-prod-github-runner-207 kernel: [ 7224.593479] ? _raw_spin_lock+0x22/0x30 Aug 22 07:24:10 juju-e4d256-prod-github-runner-207 kernel: [ 7224.594687] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:24:10 juju-e4d256-prod-github-runner-207 kernel: [ 7224.595970] direct_page_fault+0x206/0x310 [kvm] Aug 22 07:24:10 juju-e4d256-prod-github-runner-207 kernel: [ 7224.597330] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 07:24:10 juju-e4d256-prod-github-runner-207 kernel: [ 7224.598638] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 07:24:10 juju-e4d256-prod-github-runner-207 kernel: [ 7224.599771] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 07:24:10 juju-e4d256-prod-github-runner-207 kernel: [ 7224.600838] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 07:24:10 juju-e4d256-prod-github-runner-207 kernel: [ 7224.601880] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 07:24:10 juju-e4d256-prod-github-runner-207 kernel: [ 7224.602953] handle_exit+0x98/0x230 [kvm_amd] Aug 22 07:24:10 juju-e4d256-prod-github-runner-207 kernel: [ 7224.603892] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 07:24:10 juju-e4d256-prod-github-runner-207 kernel: [ 7224.604828] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 07:24:10 juju-e4d256-prod-github-runner-207 kernel: [ 7224.605783] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 07:24:10 juju-e4d256-prod-github-runner-207 kernel: [ 7224.606699] vcpu_run+0x62/0x2c0 [kvm] Aug 22 07:24:10 juju-e4d256-prod-github-runner-207 kernel: [ 7224.607530] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 07:24:10 juju-e4d256-prod-github-runner-207 kernel: [ 7224.608359] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 07:24:10 juju-e4d256-prod-github-runner-207 kernel: [ 7224.609254] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 07:24:10 juju-e4d256-prod-github-runner-207 kernel: [ 7224.610064] ? __seccomp_filter+0x4a/0x4a0 Aug 22 07:24:10 juju-e4d256-prod-github-runner-207 kernel: [ 7224.610820] ? __fget_files+0x86/0xc0 Aug 22 07:24:10 juju-e4d256-prod-github-runner-207 kernel: [ 7224.611552] __x64_sys_ioctl+0x95/0xd0 Aug 22 07:24:10 juju-e4d256-prod-github-runner-207 kernel: [ 7224.612269] do_syscall_64+0x5c/0xc0 Aug 22 07:24:10 juju-e4d256-prod-github-runner-207 kernel: [ 7224.612987] ? do_futex+0x162/0x1f0 Aug 22 07:24:10 juju-e4d256-prod-github-runner-207 kernel: [ 7224.613737] ? __x64_sys_futex+0x78/0x1e0 Aug 22 07:24:10 juju-e4d256-prod-github-runner-207 kernel: [ 7224.614509] ? __secure_computing+0xa9/0x120 Aug 22 07:24:10 juju-e4d256-prod-github-runner-207 kernel: [ 7224.615447] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 07:24:10 juju-e4d256-prod-github-runner-207 kernel: [ 7224.616495] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:24:10 juju-e4d256-prod-github-runner-207 kernel: [ 7224.617490] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:24:10 juju-e4d256-prod-github-runner-207 kernel: [ 7224.618468] ? do_syscall_64+0x69/0xc0 Aug 22 07:24:10 juju-e4d256-prod-github-runner-207 kernel: [ 7224.619365] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:24:10 juju-e4d256-prod-github-runner-207 kernel: [ 7224.620167] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:24:10 juju-e4d256-prod-github-runner-207 kernel: [ 7224.620875] ? do_syscall_64+0x69/0xc0 Aug 22 07:24:10 juju-e4d256-prod-github-runner-207 kernel: [ 7224.621534] ? do_syscall_64+0x69/0xc0 Aug 22 07:24:10 juju-e4d256-prod-github-runner-207 kernel: [ 7224.622171] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 07:24:10 juju-e4d256-prod-github-runner-207 kernel: [ 7224.622892] RIP: 0033:0x7faa5d0edaff Aug 22 07:24:10 juju-e4d256-prod-github-runner-207 kernel: [ 7224.623597] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 07:24:10 juju-e4d256-prod-github-runner-207 kernel: [ 7224.625652] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 07:24:10 juju-e4d256-prod-github-runner-207 kernel: [ 7224.626591] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 07:24:10 juju-e4d256-prod-github-runner-207 kernel: [ 7224.627505] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 07:24:10 juju-e4d256-prod-github-runner-207 kernel: [ 7224.628419] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 07:24:10 juju-e4d256-prod-github-runner-207 kernel: [ 7224.629350] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 07:24:10 juju-e4d256-prod-github-runner-207 kernel: [ 7224.630256] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 07:24:10 juju-e4d256-prod-github-runner-207 kernel: [ 7224.631167] Aug 22 07:24:38 juju-e4d256-prod-github-runner-207 kernel: [ 7252.542188] watchdog: BUG: soft lockup - CPU#1 stuck for 6646s! [qemu-system-x86:6715] Aug 22 07:24:38 juju-e4d256-prod-github-runner-207 kernel: [ 7252.543504] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 07:24:38 juju-e4d256-prod-github-runner-207 kernel: [ 7252.543580] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 07:24:38 juju-e4d256-prod-github-runner-207 kernel: [ 7252.556017] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 07:24:38 juju-e4d256-prod-github-runner-207 kernel: [ 7252.557309] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 07:24:38 juju-e4d256-prod-github-runner-207 kernel: [ 7252.558548] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:24:38 juju-e4d256-prod-github-runner-207 kernel: [ 7252.559612] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 07:24:38 juju-e4d256-prod-github-runner-207 kernel: [ 7252.562219] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 07:24:38 juju-e4d256-prod-github-runner-207 kernel: [ 7252.563272] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 07:24:38 juju-e4d256-prod-github-runner-207 kernel: [ 7252.564469] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 07:24:38 juju-e4d256-prod-github-runner-207 kernel: [ 7252.565733] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 07:24:38 juju-e4d256-prod-github-runner-207 kernel: [ 7252.567072] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 07:24:38 juju-e4d256-prod-github-runner-207 kernel: [ 7252.568439] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 07:24:38 juju-e4d256-prod-github-runner-207 kernel: [ 7252.569654] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 07:24:38 juju-e4d256-prod-github-runner-207 kernel: [ 7252.570908] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 07:24:38 juju-e4d256-prod-github-runner-207 kernel: [ 7252.572065] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 07:24:38 juju-e4d256-prod-github-runner-207 kernel: [ 7252.573324] Call Trace: Aug 22 07:24:38 juju-e4d256-prod-github-runner-207 kernel: [ 7252.574246] Aug 22 07:24:38 juju-e4d256-prod-github-runner-207 kernel: [ 7252.575133] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:24:38 juju-e4d256-prod-github-runner-207 kernel: [ 7252.576218] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:24:38 juju-e4d256-prod-github-runner-207 kernel: [ 7252.577288] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:24:38 juju-e4d256-prod-github-runner-207 kernel: [ 7252.578373] ? show_regs.part.0+0x23/0x29 Aug 22 07:24:38 juju-e4d256-prod-github-runner-207 kernel: [ 7252.579377] ? show_regs.cold+0x8/0xd Aug 22 07:24:38 juju-e4d256-prod-github-runner-207 kernel: [ 7252.580356] ? watchdog_timer_fn+0x1be/0x220 Aug 22 07:24:38 juju-e4d256-prod-github-runner-207 kernel: [ 7252.581391] ? lockup_detector_update_enable+0x60/0x60 Aug 22 07:24:38 juju-e4d256-prod-github-runner-207 kernel: [ 7252.582497] ? __hrtimer_run_queues+0x107/0x230 Aug 22 07:24:38 juju-e4d256-prod-github-runner-207 kernel: [ 7252.583580] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 07:24:38 juju-e4d256-prod-github-runner-207 kernel: [ 7252.584643] ? hrtimer_interrupt+0x101/0x220 Aug 22 07:24:38 juju-e4d256-prod-github-runner-207 kernel: [ 7252.585695] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 07:24:38 juju-e4d256-prod-github-runner-207 kernel: [ 7252.586776] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 07:24:38 juju-e4d256-prod-github-runner-207 kernel: [ 7252.587846] Aug 22 07:24:38 juju-e4d256-prod-github-runner-207 kernel: [ 7252.588781] Aug 22 07:24:38 juju-e4d256-prod-github-runner-207 kernel: [ 7252.589627] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 07:24:38 juju-e4d256-prod-github-runner-207 kernel: [ 7252.590687] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:24:38 juju-e4d256-prod-github-runner-207 kernel: [ 7252.591744] ? _raw_spin_lock+0x22/0x30 Aug 22 07:24:38 juju-e4d256-prod-github-runner-207 kernel: [ 7252.592714] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:24:38 juju-e4d256-prod-github-runner-207 kernel: [ 7252.593746] direct_page_fault+0x206/0x310 [kvm] Aug 22 07:24:38 juju-e4d256-prod-github-runner-207 kernel: [ 7252.594792] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 07:24:38 juju-e4d256-prod-github-runner-207 kernel: [ 7252.595880] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 07:24:38 juju-e4d256-prod-github-runner-207 kernel: [ 7252.597098] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 07:24:38 juju-e4d256-prod-github-runner-207 kernel: [ 7252.598444] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 07:24:38 juju-e4d256-prod-github-runner-207 kernel: [ 7252.599492] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 07:24:38 juju-e4d256-prod-github-runner-207 kernel: [ 7252.600488] handle_exit+0x98/0x230 [kvm_amd] Aug 22 07:24:38 juju-e4d256-prod-github-runner-207 kernel: [ 7252.601462] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 07:24:38 juju-e4d256-prod-github-runner-207 kernel: [ 7252.602402] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 07:24:38 juju-e4d256-prod-github-runner-207 kernel: [ 7252.603353] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 07:24:38 juju-e4d256-prod-github-runner-207 kernel: [ 7252.604269] vcpu_run+0x62/0x2c0 [kvm] Aug 22 07:24:38 juju-e4d256-prod-github-runner-207 kernel: [ 7252.605105] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 07:24:38 juju-e4d256-prod-github-runner-207 kernel: [ 7252.605947] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 07:24:38 juju-e4d256-prod-github-runner-207 kernel: [ 7252.606816] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 07:24:38 juju-e4d256-prod-github-runner-207 kernel: [ 7252.607629] ? __seccomp_filter+0x4a/0x4a0 Aug 22 07:24:38 juju-e4d256-prod-github-runner-207 kernel: [ 7252.608391] ? __fget_files+0x86/0xc0 Aug 22 07:24:38 juju-e4d256-prod-github-runner-207 kernel: [ 7252.609132] __x64_sys_ioctl+0x95/0xd0 Aug 22 07:24:38 juju-e4d256-prod-github-runner-207 kernel: [ 7252.609874] do_syscall_64+0x5c/0xc0 Aug 22 07:24:38 juju-e4d256-prod-github-runner-207 kernel: [ 7252.610600] ? do_futex+0x162/0x1f0 Aug 22 07:24:38 juju-e4d256-prod-github-runner-207 kernel: [ 7252.611259] ? __x64_sys_futex+0x78/0x1e0 Aug 22 07:24:38 juju-e4d256-prod-github-runner-207 kernel: [ 7252.612016] ? __secure_computing+0xa9/0x120 Aug 22 07:24:38 juju-e4d256-prod-github-runner-207 kernel: [ 7252.612760] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 07:24:38 juju-e4d256-prod-github-runner-207 kernel: [ 7252.613593] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:24:38 juju-e4d256-prod-github-runner-207 kernel: [ 7252.614370] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:24:38 juju-e4d256-prod-github-runner-207 kernel: [ 7252.615110] ? do_syscall_64+0x69/0xc0 Aug 22 07:24:38 juju-e4d256-prod-github-runner-207 kernel: [ 7252.615876] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:24:38 juju-e4d256-prod-github-runner-207 kernel: [ 7252.616607] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:24:38 juju-e4d256-prod-github-runner-207 kernel: [ 7252.617344] ? do_syscall_64+0x69/0xc0 Aug 22 07:24:38 juju-e4d256-prod-github-runner-207 kernel: [ 7252.618032] ? do_syscall_64+0x69/0xc0 Aug 22 07:24:38 juju-e4d256-prod-github-runner-207 kernel: [ 7252.618666] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 07:24:38 juju-e4d256-prod-github-runner-207 kernel: [ 7252.619425] RIP: 0033:0x7faa5d0edaff Aug 22 07:24:38 juju-e4d256-prod-github-runner-207 kernel: [ 7252.620086] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 07:24:38 juju-e4d256-prod-github-runner-207 kernel: [ 7252.622181] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 07:24:38 juju-e4d256-prod-github-runner-207 kernel: [ 7252.623121] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 07:24:38 juju-e4d256-prod-github-runner-207 kernel: [ 7252.624031] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 07:24:38 juju-e4d256-prod-github-runner-207 kernel: [ 7252.624955] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 07:24:38 juju-e4d256-prod-github-runner-207 kernel: [ 7252.625862] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 07:24:38 juju-e4d256-prod-github-runner-207 kernel: [ 7252.626768] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 07:24:38 juju-e4d256-prod-github-runner-207 kernel: [ 7252.627680] Aug 22 07:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 7280.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 6672s! [qemu-system-x86:6715] Aug 22 07:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 7280.545399] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 07:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 7280.545473] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 07:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 7280.560754] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 07:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 7280.562044] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 07:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 7280.563302] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 7280.564434] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 07:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 7280.567091] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 07:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 7280.568153] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 07:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 7280.569360] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 07:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 7280.570535] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 07:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 7280.571736] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 07:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 7280.572945] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 07:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 7280.574138] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 07:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 7280.575387] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 07:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 7280.576518] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 07:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 7280.577770] Call Trace: Aug 22 07:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 7280.578725] Aug 22 07:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 7280.579654] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 7280.581027] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 7280.582358] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 7280.583861] ? show_regs.part.0+0x23/0x29 Aug 22 07:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 7280.584914] ? show_regs.cold+0x8/0xd Aug 22 07:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 7280.585897] ? watchdog_timer_fn+0x1be/0x220 Aug 22 07:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 7280.586917] ? lockup_detector_update_enable+0x60/0x60 Aug 22 07:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 7280.588023] ? __hrtimer_run_queues+0x107/0x230 Aug 22 07:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 7280.589104] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 07:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 7280.590145] ? hrtimer_interrupt+0x101/0x220 Aug 22 07:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 7280.591173] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 07:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 7280.592252] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 07:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 7280.593323] Aug 22 07:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 7280.594187] Aug 22 07:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 7280.595180] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 07:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 7280.596234] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 7280.597377] ? _raw_spin_lock+0x22/0x30 Aug 22 07:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 7280.598369] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 7280.599415] direct_page_fault+0x206/0x310 [kvm] Aug 22 07:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 7280.600464] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 07:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 7280.601494] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 07:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 7280.602508] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 07:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 7280.603490] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 07:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 7280.604523] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 07:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 7280.605517] handle_exit+0x98/0x230 [kvm_amd] Aug 22 07:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 7280.606421] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 07:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 7280.607347] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 07:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 7280.608296] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 07:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 7280.609231] vcpu_run+0x62/0x2c0 [kvm] Aug 22 07:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 7280.610052] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 07:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 7280.610907] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 07:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 7280.611774] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 07:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 7280.612625] ? __seccomp_filter+0x4a/0x4a0 Aug 22 07:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 7280.613379] ? __fget_files+0x86/0xc0 Aug 22 07:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 7280.614093] __x64_sys_ioctl+0x95/0xd0 Aug 22 07:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 7280.614804] do_syscall_64+0x5c/0xc0 Aug 22 07:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 7280.615485] ? do_futex+0x162/0x1f0 Aug 22 07:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 7280.616147] ? __x64_sys_futex+0x78/0x1e0 Aug 22 07:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 7280.616839] ? __secure_computing+0xa9/0x120 Aug 22 07:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 7280.617540] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 07:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 7280.618312] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 7280.619067] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 7280.619799] ? do_syscall_64+0x69/0xc0 Aug 22 07:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 7280.620471] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 7280.621188] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 7280.621896] ? do_syscall_64+0x69/0xc0 Aug 22 07:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 7280.622536] ? do_syscall_64+0x69/0xc0 Aug 22 07:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 7280.623177] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 07:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 7280.623895] RIP: 0033:0x7faa5d0edaff Aug 22 07:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 7280.624547] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 07:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 7280.626613] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 07:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 7280.627538] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 07:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 7280.628461] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 07:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 7280.629404] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 07:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 7280.630317] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 07:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 7280.631262] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 07:25:06 juju-e4d256-prod-github-runner-207 kernel: [ 7280.632278] Aug 22 07:25:34 juju-e4d256-prod-github-runner-207 kernel: [ 7308.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 6698s! [qemu-system-x86:6715] Aug 22 07:25:34 juju-e4d256-prod-github-runner-207 kernel: [ 7308.543872] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 07:25:34 juju-e4d256-prod-github-runner-207 kernel: [ 7308.544162] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 07:25:34 juju-e4d256-prod-github-runner-207 kernel: [ 7308.556665] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 07:25:34 juju-e4d256-prod-github-runner-207 kernel: [ 7308.557956] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 07:25:34 juju-e4d256-prod-github-runner-207 kernel: [ 7308.559319] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:25:34 juju-e4d256-prod-github-runner-207 kernel: [ 7308.560480] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 07:25:34 juju-e4d256-prod-github-runner-207 kernel: [ 7308.563276] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 07:25:34 juju-e4d256-prod-github-runner-207 kernel: [ 7308.564440] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 07:25:34 juju-e4d256-prod-github-runner-207 kernel: [ 7308.565817] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 07:25:34 juju-e4d256-prod-github-runner-207 kernel: [ 7308.566990] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 07:25:34 juju-e4d256-prod-github-runner-207 kernel: [ 7308.568214] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 07:25:34 juju-e4d256-prod-github-runner-207 kernel: [ 7308.569393] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 07:25:34 juju-e4d256-prod-github-runner-207 kernel: [ 7308.570581] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 07:25:34 juju-e4d256-prod-github-runner-207 kernel: [ 7308.571826] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 07:25:34 juju-e4d256-prod-github-runner-207 kernel: [ 7308.572960] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 07:25:34 juju-e4d256-prod-github-runner-207 kernel: [ 7308.574165] Call Trace: Aug 22 07:25:34 juju-e4d256-prod-github-runner-207 kernel: [ 7308.575090] Aug 22 07:25:34 juju-e4d256-prod-github-runner-207 kernel: [ 7308.576071] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:25:34 juju-e4d256-prod-github-runner-207 kernel: [ 7308.577108] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:25:34 juju-e4d256-prod-github-runner-207 kernel: [ 7308.578128] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:25:34 juju-e4d256-prod-github-runner-207 kernel: [ 7308.579246] ? show_regs.part.0+0x23/0x29 Aug 22 07:25:34 juju-e4d256-prod-github-runner-207 kernel: [ 7308.580302] ? show_regs.cold+0x8/0xd Aug 22 07:25:34 juju-e4d256-prod-github-runner-207 kernel: [ 7308.581301] ? watchdog_timer_fn+0x1be/0x220 Aug 22 07:25:34 juju-e4d256-prod-github-runner-207 kernel: [ 7308.582330] ? lockup_detector_update_enable+0x60/0x60 Aug 22 07:25:34 juju-e4d256-prod-github-runner-207 kernel: [ 7308.583423] ? __hrtimer_run_queues+0x107/0x230 Aug 22 07:25:34 juju-e4d256-prod-github-runner-207 kernel: [ 7308.584482] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 07:25:34 juju-e4d256-prod-github-runner-207 kernel: [ 7308.585525] ? hrtimer_interrupt+0x101/0x220 Aug 22 07:25:34 juju-e4d256-prod-github-runner-207 kernel: [ 7308.586583] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 07:25:34 juju-e4d256-prod-github-runner-207 kernel: [ 7308.587658] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 07:25:34 juju-e4d256-prod-github-runner-207 kernel: [ 7308.588720] Aug 22 07:25:34 juju-e4d256-prod-github-runner-207 kernel: [ 7308.589582] Aug 22 07:25:34 juju-e4d256-prod-github-runner-207 kernel: [ 7308.590431] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 07:25:34 juju-e4d256-prod-github-runner-207 kernel: [ 7308.591482] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:25:34 juju-e4d256-prod-github-runner-207 kernel: [ 7308.592540] ? _raw_spin_lock+0x22/0x30 Aug 22 07:25:34 juju-e4d256-prod-github-runner-207 kernel: [ 7308.593494] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:25:34 juju-e4d256-prod-github-runner-207 kernel: [ 7308.594518] direct_page_fault+0x206/0x310 [kvm] Aug 22 07:25:34 juju-e4d256-prod-github-runner-207 kernel: [ 7308.595557] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 07:25:34 juju-e4d256-prod-github-runner-207 kernel: [ 7308.596630] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 07:25:34 juju-e4d256-prod-github-runner-207 kernel: [ 7308.597658] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 07:25:34 juju-e4d256-prod-github-runner-207 kernel: [ 7308.598676] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 07:25:34 juju-e4d256-prod-github-runner-207 kernel: [ 7308.599627] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 07:25:34 juju-e4d256-prod-github-runner-207 kernel: [ 7308.600965] handle_exit+0x98/0x230 [kvm_amd] Aug 22 07:25:34 juju-e4d256-prod-github-runner-207 kernel: [ 7308.601872] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 07:25:34 juju-e4d256-prod-github-runner-207 kernel: [ 7308.602802] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 07:25:34 juju-e4d256-prod-github-runner-207 kernel: [ 7308.603768] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 07:25:34 juju-e4d256-prod-github-runner-207 kernel: [ 7308.604706] vcpu_run+0x62/0x2c0 [kvm] Aug 22 07:25:34 juju-e4d256-prod-github-runner-207 kernel: [ 7308.605530] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 07:25:34 juju-e4d256-prod-github-runner-207 kernel: [ 7308.606342] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 07:25:34 juju-e4d256-prod-github-runner-207 kernel: [ 7308.607213] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 07:25:34 juju-e4d256-prod-github-runner-207 kernel: [ 7308.608043] ? __seccomp_filter+0x4a/0x4a0 Aug 22 07:25:34 juju-e4d256-prod-github-runner-207 kernel: [ 7308.608805] ? __fget_files+0x86/0xc0 Aug 22 07:25:34 juju-e4d256-prod-github-runner-207 kernel: [ 7308.609522] __x64_sys_ioctl+0x95/0xd0 Aug 22 07:25:34 juju-e4d256-prod-github-runner-207 kernel: [ 7308.610223] do_syscall_64+0x5c/0xc0 Aug 22 07:25:34 juju-e4d256-prod-github-runner-207 kernel: [ 7308.610891] ? do_futex+0x162/0x1f0 Aug 22 07:25:34 juju-e4d256-prod-github-runner-207 kernel: [ 7308.611541] ? __x64_sys_futex+0x78/0x1e0 Aug 22 07:25:34 juju-e4d256-prod-github-runner-207 kernel: [ 7308.612236] ? __secure_computing+0xa9/0x120 Aug 22 07:25:34 juju-e4d256-prod-github-runner-207 kernel: [ 7308.612949] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 07:25:34 juju-e4d256-prod-github-runner-207 kernel: [ 7308.613722] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:25:34 juju-e4d256-prod-github-runner-207 kernel: [ 7308.614465] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:25:34 juju-e4d256-prod-github-runner-207 kernel: [ 7308.615204] ? do_syscall_64+0x69/0xc0 Aug 22 07:25:34 juju-e4d256-prod-github-runner-207 kernel: [ 7308.615854] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:25:34 juju-e4d256-prod-github-runner-207 kernel: [ 7308.616574] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:25:34 juju-e4d256-prod-github-runner-207 kernel: [ 7308.617268] ? do_syscall_64+0x69/0xc0 Aug 22 07:25:34 juju-e4d256-prod-github-runner-207 kernel: [ 7308.617906] ? do_syscall_64+0x69/0xc0 Aug 22 07:25:34 juju-e4d256-prod-github-runner-207 kernel: [ 7308.618533] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 07:25:34 juju-e4d256-prod-github-runner-207 kernel: [ 7308.619240] RIP: 0033:0x7faa5d0edaff Aug 22 07:25:34 juju-e4d256-prod-github-runner-207 kernel: [ 7308.619894] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 07:25:34 juju-e4d256-prod-github-runner-207 kernel: [ 7308.621885] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 07:25:34 juju-e4d256-prod-github-runner-207 kernel: [ 7308.622796] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 07:25:34 juju-e4d256-prod-github-runner-207 kernel: [ 7308.623690] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 07:25:34 juju-e4d256-prod-github-runner-207 kernel: [ 7308.624592] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 07:25:34 juju-e4d256-prod-github-runner-207 kernel: [ 7308.625483] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 07:25:34 juju-e4d256-prod-github-runner-207 kernel: [ 7308.626369] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 07:25:34 juju-e4d256-prod-github-runner-207 kernel: [ 7308.627264] Aug 22 07:26:02 juju-e4d256-prod-github-runner-207 kernel: [ 7336.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 6724s! [qemu-system-x86:6715] Aug 22 07:26:02 juju-e4d256-prod-github-runner-207 kernel: [ 7336.543102] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 07:26:02 juju-e4d256-prod-github-runner-207 kernel: [ 7336.543175] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 07:26:02 juju-e4d256-prod-github-runner-207 kernel: [ 7336.555559] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 07:26:02 juju-e4d256-prod-github-runner-207 kernel: [ 7336.556880] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 07:26:02 juju-e4d256-prod-github-runner-207 kernel: [ 7336.558117] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:26:02 juju-e4d256-prod-github-runner-207 kernel: [ 7336.559238] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 07:26:02 juju-e4d256-prod-github-runner-207 kernel: [ 7336.561816] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 07:26:02 juju-e4d256-prod-github-runner-207 kernel: [ 7336.562865] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 07:26:02 juju-e4d256-prod-github-runner-207 kernel: [ 7336.564051] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 07:26:02 juju-e4d256-prod-github-runner-207 kernel: [ 7336.565267] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 07:26:02 juju-e4d256-prod-github-runner-207 kernel: [ 7336.566429] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 07:26:02 juju-e4d256-prod-github-runner-207 kernel: [ 7336.567600] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 07:26:02 juju-e4d256-prod-github-runner-207 kernel: [ 7336.568817] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 07:26:02 juju-e4d256-prod-github-runner-207 kernel: [ 7336.570054] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 07:26:02 juju-e4d256-prod-github-runner-207 kernel: [ 7336.571160] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 07:26:02 juju-e4d256-prod-github-runner-207 kernel: [ 7336.572440] Call Trace: Aug 22 07:26:02 juju-e4d256-prod-github-runner-207 kernel: [ 7336.573366] Aug 22 07:26:02 juju-e4d256-prod-github-runner-207 kernel: [ 7336.574300] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:26:02 juju-e4d256-prod-github-runner-207 kernel: [ 7336.575372] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:26:02 juju-e4d256-prod-github-runner-207 kernel: [ 7336.576428] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:26:02 juju-e4d256-prod-github-runner-207 kernel: [ 7336.577510] ? show_regs.part.0+0x23/0x29 Aug 22 07:26:02 juju-e4d256-prod-github-runner-207 kernel: [ 7336.578507] ? show_regs.cold+0x8/0xd Aug 22 07:26:02 juju-e4d256-prod-github-runner-207 kernel: [ 7336.579478] ? watchdog_timer_fn+0x1be/0x220 Aug 22 07:26:02 juju-e4d256-prod-github-runner-207 kernel: [ 7336.580536] ? lockup_detector_update_enable+0x60/0x60 Aug 22 07:26:02 juju-e4d256-prod-github-runner-207 kernel: [ 7336.581608] ? __hrtimer_run_queues+0x107/0x230 Aug 22 07:26:02 juju-e4d256-prod-github-runner-207 kernel: [ 7336.582638] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 07:26:02 juju-e4d256-prod-github-runner-207 kernel: [ 7336.583692] ? hrtimer_interrupt+0x101/0x220 Aug 22 07:26:02 juju-e4d256-prod-github-runner-207 kernel: [ 7336.584739] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 07:26:02 juju-e4d256-prod-github-runner-207 kernel: [ 7336.585822] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 07:26:02 juju-e4d256-prod-github-runner-207 kernel: [ 7336.586905] Aug 22 07:26:02 juju-e4d256-prod-github-runner-207 kernel: [ 7336.587795] Aug 22 07:26:02 juju-e4d256-prod-github-runner-207 kernel: [ 7336.588693] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 07:26:02 juju-e4d256-prod-github-runner-207 kernel: [ 7336.589792] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:26:02 juju-e4d256-prod-github-runner-207 kernel: [ 7336.590845] ? _raw_spin_lock+0x22/0x30 Aug 22 07:26:02 juju-e4d256-prod-github-runner-207 kernel: [ 7336.591835] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:26:02 juju-e4d256-prod-github-runner-207 kernel: [ 7336.592919] direct_page_fault+0x206/0x310 [kvm] Aug 22 07:26:02 juju-e4d256-prod-github-runner-207 kernel: [ 7336.593950] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 07:26:02 juju-e4d256-prod-github-runner-207 kernel: [ 7336.594967] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 07:26:02 juju-e4d256-prod-github-runner-207 kernel: [ 7336.596018] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 07:26:02 juju-e4d256-prod-github-runner-207 kernel: [ 7336.597000] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 07:26:02 juju-e4d256-prod-github-runner-207 kernel: [ 7336.597948] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 07:26:02 juju-e4d256-prod-github-runner-207 kernel: [ 7336.598964] handle_exit+0x98/0x230 [kvm_amd] Aug 22 07:26:02 juju-e4d256-prod-github-runner-207 kernel: [ 7336.599918] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 07:26:02 juju-e4d256-prod-github-runner-207 kernel: [ 7336.600851] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 07:26:02 juju-e4d256-prod-github-runner-207 kernel: [ 7336.601793] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 07:26:02 juju-e4d256-prod-github-runner-207 kernel: [ 7336.602719] vcpu_run+0x62/0x2c0 [kvm] Aug 22 07:26:02 juju-e4d256-prod-github-runner-207 kernel: [ 7336.603544] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 07:26:02 juju-e4d256-prod-github-runner-207 kernel: [ 7336.604379] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 07:26:02 juju-e4d256-prod-github-runner-207 kernel: [ 7336.605234] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 07:26:02 juju-e4d256-prod-github-runner-207 kernel: [ 7336.606030] ? __seccomp_filter+0x4a/0x4a0 Aug 22 07:26:02 juju-e4d256-prod-github-runner-207 kernel: [ 7336.606778] ? __fget_files+0x86/0xc0 Aug 22 07:26:02 juju-e4d256-prod-github-runner-207 kernel: [ 7336.607480] __x64_sys_ioctl+0x95/0xd0 Aug 22 07:26:02 juju-e4d256-prod-github-runner-207 kernel: [ 7336.608192] do_syscall_64+0x5c/0xc0 Aug 22 07:26:02 juju-e4d256-prod-github-runner-207 kernel: [ 7336.608855] ? do_futex+0x162/0x1f0 Aug 22 07:26:02 juju-e4d256-prod-github-runner-207 kernel: [ 7336.609503] ? __x64_sys_futex+0x78/0x1e0 Aug 22 07:26:02 juju-e4d256-prod-github-runner-207 kernel: [ 7336.610199] ? __secure_computing+0xa9/0x120 Aug 22 07:26:02 juju-e4d256-prod-github-runner-207 kernel: [ 7336.610887] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 07:26:02 juju-e4d256-prod-github-runner-207 kernel: [ 7336.611680] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:26:02 juju-e4d256-prod-github-runner-207 kernel: [ 7336.612411] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:26:02 juju-e4d256-prod-github-runner-207 kernel: [ 7336.613135] ? do_syscall_64+0x69/0xc0 Aug 22 07:26:02 juju-e4d256-prod-github-runner-207 kernel: [ 7336.613778] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:26:02 juju-e4d256-prod-github-runner-207 kernel: [ 7336.614477] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:26:02 juju-e4d256-prod-github-runner-207 kernel: [ 7336.615214] ? do_syscall_64+0x69/0xc0 Aug 22 07:26:02 juju-e4d256-prod-github-runner-207 kernel: [ 7336.615872] ? do_syscall_64+0x69/0xc0 Aug 22 07:26:02 juju-e4d256-prod-github-runner-207 kernel: [ 7336.616494] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 07:26:02 juju-e4d256-prod-github-runner-207 kernel: [ 7336.617200] RIP: 0033:0x7faa5d0edaff Aug 22 07:26:02 juju-e4d256-prod-github-runner-207 kernel: [ 7336.617841] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 07:26:02 juju-e4d256-prod-github-runner-207 kernel: [ 7336.619834] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 07:26:02 juju-e4d256-prod-github-runner-207 kernel: [ 7336.620742] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 07:26:02 juju-e4d256-prod-github-runner-207 kernel: [ 7336.621630] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 07:26:02 juju-e4d256-prod-github-runner-207 kernel: [ 7336.622519] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 07:26:02 juju-e4d256-prod-github-runner-207 kernel: [ 7336.623405] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 07:26:02 juju-e4d256-prod-github-runner-207 kernel: [ 7336.624333] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 07:26:02 juju-e4d256-prod-github-runner-207 kernel: [ 7336.625230] Aug 22 07:26:30 juju-e4d256-prod-github-runner-207 kernel: [ 7364.541983] watchdog: BUG: soft lockup - CPU#1 stuck for 6750s! [qemu-system-x86:6715] Aug 22 07:26:30 juju-e4d256-prod-github-runner-207 kernel: [ 7364.543237] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 07:26:30 juju-e4d256-prod-github-runner-207 kernel: [ 7364.543339] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 07:26:30 juju-e4d256-prod-github-runner-207 kernel: [ 7364.555601] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 07:26:30 juju-e4d256-prod-github-runner-207 kernel: [ 7364.556977] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 07:26:30 juju-e4d256-prod-github-runner-207 kernel: [ 7364.558224] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:26:30 juju-e4d256-prod-github-runner-207 kernel: [ 7364.559321] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 07:26:30 juju-e4d256-prod-github-runner-207 kernel: [ 7364.561929] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 07:26:30 juju-e4d256-prod-github-runner-207 kernel: [ 7364.562987] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 07:26:30 juju-e4d256-prod-github-runner-207 kernel: [ 7364.564229] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 07:26:30 juju-e4d256-prod-github-runner-207 kernel: [ 7364.565480] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 07:26:30 juju-e4d256-prod-github-runner-207 kernel: [ 7364.566647] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 07:26:30 juju-e4d256-prod-github-runner-207 kernel: [ 7364.567846] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 07:26:30 juju-e4d256-prod-github-runner-207 kernel: [ 7364.569332] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 07:26:30 juju-e4d256-prod-github-runner-207 kernel: [ 7364.570578] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 07:26:30 juju-e4d256-prod-github-runner-207 kernel: [ 7364.571701] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 07:26:30 juju-e4d256-prod-github-runner-207 kernel: [ 7364.572901] Call Trace: Aug 22 07:26:30 juju-e4d256-prod-github-runner-207 kernel: [ 7364.573815] Aug 22 07:26:30 juju-e4d256-prod-github-runner-207 kernel: [ 7364.574742] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:26:30 juju-e4d256-prod-github-runner-207 kernel: [ 7364.575810] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:26:30 juju-e4d256-prod-github-runner-207 kernel: [ 7364.576878] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:26:30 juju-e4d256-prod-github-runner-207 kernel: [ 7364.577978] ? show_regs.part.0+0x23/0x29 Aug 22 07:26:30 juju-e4d256-prod-github-runner-207 kernel: [ 7364.578979] ? show_regs.cold+0x8/0xd Aug 22 07:26:30 juju-e4d256-prod-github-runner-207 kernel: [ 7364.579981] ? watchdog_timer_fn+0x1be/0x220 Aug 22 07:26:30 juju-e4d256-prod-github-runner-207 kernel: [ 7364.580994] ? lockup_detector_update_enable+0x60/0x60 Aug 22 07:26:30 juju-e4d256-prod-github-runner-207 kernel: [ 7364.582054] ? __hrtimer_run_queues+0x107/0x230 Aug 22 07:26:30 juju-e4d256-prod-github-runner-207 kernel: [ 7364.583083] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 07:26:30 juju-e4d256-prod-github-runner-207 kernel: [ 7364.584217] ? hrtimer_interrupt+0x101/0x220 Aug 22 07:26:30 juju-e4d256-prod-github-runner-207 kernel: [ 7364.585298] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 07:26:30 juju-e4d256-prod-github-runner-207 kernel: [ 7364.586388] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 07:26:30 juju-e4d256-prod-github-runner-207 kernel: [ 7364.587458] Aug 22 07:26:30 juju-e4d256-prod-github-runner-207 kernel: [ 7364.588317] Aug 22 07:26:30 juju-e4d256-prod-github-runner-207 kernel: [ 7364.589163] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 07:26:30 juju-e4d256-prod-github-runner-207 kernel: [ 7364.590266] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:26:30 juju-e4d256-prod-github-runner-207 kernel: [ 7364.591397] ? _raw_spin_lock+0x22/0x30 Aug 22 07:26:30 juju-e4d256-prod-github-runner-207 kernel: [ 7364.592515] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:26:30 juju-e4d256-prod-github-runner-207 kernel: [ 7364.593571] direct_page_fault+0x206/0x310 [kvm] Aug 22 07:26:30 juju-e4d256-prod-github-runner-207 kernel: [ 7364.594603] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 07:26:30 juju-e4d256-prod-github-runner-207 kernel: [ 7364.595650] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 07:26:30 juju-e4d256-prod-github-runner-207 kernel: [ 7364.596653] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 07:26:30 juju-e4d256-prod-github-runner-207 kernel: [ 7364.597626] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 07:26:30 juju-e4d256-prod-github-runner-207 kernel: [ 7364.598574] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 07:26:30 juju-e4d256-prod-github-runner-207 kernel: [ 7364.599570] handle_exit+0x98/0x230 [kvm_amd] Aug 22 07:26:30 juju-e4d256-prod-github-runner-207 kernel: [ 7364.600462] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 07:26:30 juju-e4d256-prod-github-runner-207 kernel: [ 7364.601376] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 07:26:30 juju-e4d256-prod-github-runner-207 kernel: [ 7364.602300] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 07:26:30 juju-e4d256-prod-github-runner-207 kernel: [ 7364.603208] vcpu_run+0x62/0x2c0 [kvm] Aug 22 07:26:30 juju-e4d256-prod-github-runner-207 kernel: [ 7364.604045] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 07:26:30 juju-e4d256-prod-github-runner-207 kernel: [ 7364.604852] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 07:26:30 juju-e4d256-prod-github-runner-207 kernel: [ 7364.605707] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 07:26:30 juju-e4d256-prod-github-runner-207 kernel: [ 7364.606501] ? __seccomp_filter+0x4a/0x4a0 Aug 22 07:26:30 juju-e4d256-prod-github-runner-207 kernel: [ 7364.607289] ? __fget_files+0x86/0xc0 Aug 22 07:26:30 juju-e4d256-prod-github-runner-207 kernel: [ 7364.608003] __x64_sys_ioctl+0x95/0xd0 Aug 22 07:26:30 juju-e4d256-prod-github-runner-207 kernel: [ 7364.608693] do_syscall_64+0x5c/0xc0 Aug 22 07:26:30 juju-e4d256-prod-github-runner-207 kernel: [ 7364.609377] ? do_futex+0x162/0x1f0 Aug 22 07:26:30 juju-e4d256-prod-github-runner-207 kernel: [ 7364.610074] ? __x64_sys_futex+0x78/0x1e0 Aug 22 07:26:30 juju-e4d256-prod-github-runner-207 kernel: [ 7364.610762] ? __secure_computing+0xa9/0x120 Aug 22 07:26:30 juju-e4d256-prod-github-runner-207 kernel: [ 7364.611504] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 07:26:30 juju-e4d256-prod-github-runner-207 kernel: [ 7364.612290] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:26:30 juju-e4d256-prod-github-runner-207 kernel: [ 7364.613089] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:26:30 juju-e4d256-prod-github-runner-207 kernel: [ 7364.613833] ? do_syscall_64+0x69/0xc0 Aug 22 07:26:30 juju-e4d256-prod-github-runner-207 kernel: [ 7364.614513] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:26:30 juju-e4d256-prod-github-runner-207 kernel: [ 7364.615234] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:26:30 juju-e4d256-prod-github-runner-207 kernel: [ 7364.615962] ? do_syscall_64+0x69/0xc0 Aug 22 07:26:30 juju-e4d256-prod-github-runner-207 kernel: [ 7364.616600] ? do_syscall_64+0x69/0xc0 Aug 22 07:26:30 juju-e4d256-prod-github-runner-207 kernel: [ 7364.617281] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 07:26:30 juju-e4d256-prod-github-runner-207 kernel: [ 7364.617991] RIP: 0033:0x7faa5d0edaff Aug 22 07:26:30 juju-e4d256-prod-github-runner-207 kernel: [ 7364.618616] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 07:26:30 juju-e4d256-prod-github-runner-207 kernel: [ 7364.620632] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 07:26:30 juju-e4d256-prod-github-runner-207 kernel: [ 7364.621547] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 07:26:30 juju-e4d256-prod-github-runner-207 kernel: [ 7364.622440] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 07:26:30 juju-e4d256-prod-github-runner-207 kernel: [ 7364.623404] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 07:26:30 juju-e4d256-prod-github-runner-207 kernel: [ 7364.624298] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 07:26:30 juju-e4d256-prod-github-runner-207 kernel: [ 7364.625194] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 07:26:30 juju-e4d256-prod-github-runner-207 kernel: [ 7364.626088] Aug 22 07:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 7377.680707] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 07:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 7377.681696] rcu: 1-....: (1809425 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=878535 Aug 22 07:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 7377.682847] (t=1815120 jiffies g=23269 q=16268) Aug 22 07:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 7377.683696] NMI backtrace for cpu 1 Aug 22 07:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 7377.684415] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 07:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 7377.685652] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 07:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 7377.686840] Call Trace: Aug 22 07:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 7377.687563] Aug 22 07:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 7377.688220] show_stack+0x52/0x5c Aug 22 07:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 7377.688989] dump_stack_lvl+0x4a/0x63 Aug 22 07:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 7377.689771] dump_stack+0x10/0x16 Aug 22 07:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 7377.690500] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 07:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 7377.691372] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 07:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 7377.692220] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 07:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 7377.693073] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 07:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 7377.693957] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 07:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 7377.694842] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 07:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 7377.695685] print_cpu_stall.cold+0x2f/0xe2 Aug 22 07:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 7377.696505] ? timekeeping_update+0xf7/0x150 Aug 22 07:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 7377.697320] check_cpu_stall+0x109/0x270 Aug 22 07:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 7377.698091] rcu_sched_clock_irq+0x9a/0x250 Aug 22 07:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 7377.698881] update_process_times+0x94/0xd0 Aug 22 07:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 7377.699690] tick_sched_handle+0x29/0x70 Aug 22 07:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 7377.700545] tick_sched_timer+0x8c/0xc0 Aug 22 07:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 7377.701636] ? tick_nohz_handler+0xb0/0xb0 Aug 22 07:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 7377.702757] __hrtimer_run_queues+0x107/0x230 Aug 22 07:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 7377.703685] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 07:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 7377.704486] hrtimer_interrupt+0x101/0x220 Aug 22 07:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 7377.705267] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 07:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 7377.706150] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 07:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 7377.707052] Aug 22 07:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 7377.707770] Aug 22 07:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 7377.708444] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 07:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 7377.709287] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 7377.710174] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 07:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 7377.712440] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 07:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 7377.713323] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 07:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 7377.714325] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 07:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 7377.715356] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 07:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 7377.716338] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 07:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 7377.717348] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 07:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 7377.718304] ? _raw_spin_lock+0x22/0x30 Aug 22 07:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 7377.719065] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 7377.719921] direct_page_fault+0x206/0x310 [kvm] Aug 22 07:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 7377.720773] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 07:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 7377.721634] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 07:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 7377.722474] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 07:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 7377.723327] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 07:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 7377.724258] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 07:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 7377.725241] handle_exit+0x98/0x230 [kvm_amd] Aug 22 07:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 7377.726154] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 07:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 7377.727062] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 07:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 7377.727993] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 07:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 7377.728875] vcpu_run+0x62/0x2c0 [kvm] Aug 22 07:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 7377.729670] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 07:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 7377.730497] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 07:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 7377.731422] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 07:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 7377.732273] ? __seccomp_filter+0x4a/0x4a0 Aug 22 07:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 7377.733076] ? __fget_files+0x86/0xc0 Aug 22 07:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 7377.733842] __x64_sys_ioctl+0x95/0xd0 Aug 22 07:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 7377.734618] do_syscall_64+0x5c/0xc0 Aug 22 07:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 7377.735389] ? do_futex+0x162/0x1f0 Aug 22 07:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 7377.736140] ? __x64_sys_futex+0x78/0x1e0 Aug 22 07:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 7377.736917] ? __secure_computing+0xa9/0x120 Aug 22 07:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 7377.737720] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 07:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 7377.738617] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 7377.739477] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 7377.740326] ? do_syscall_64+0x69/0xc0 Aug 22 07:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 7377.741096] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 7377.741977] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 7377.742834] ? do_syscall_64+0x69/0xc0 Aug 22 07:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 7377.743620] ? do_syscall_64+0x69/0xc0 Aug 22 07:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 7377.744385] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 07:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 7377.745259] RIP: 0033:0x7faa5d0edaff Aug 22 07:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 7377.746013] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 07:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 7377.748471] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 07:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 7377.749578] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 07:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 7377.750651] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 07:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 7377.751747] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 07:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 7377.752823] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 07:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 7377.753878] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 07:26:43 juju-e4d256-prod-github-runner-207 kernel: [ 7377.754921] Aug 22 07:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 7404.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 6788s! [qemu-system-x86:6715] Aug 22 07:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 7404.543915] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 07:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 7404.544215] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 07:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 7404.556551] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 07:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 7404.557838] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 07:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 7404.559090] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 7404.560165] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 07:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 7404.562768] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 07:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 7404.563823] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 07:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 7404.565000] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 07:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 7404.566176] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 07:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 7404.567361] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 07:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 7404.568546] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 07:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 7404.569728] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 07:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 7404.571017] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 07:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 7404.572147] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 07:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 7404.573370] Call Trace: Aug 22 07:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 7404.574292] Aug 22 07:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 7404.575250] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 7404.576307] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 7404.577355] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 7404.578466] ? show_regs.part.0+0x23/0x29 Aug 22 07:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 7404.579488] ? show_regs.cold+0x8/0xd Aug 22 07:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 7404.580466] ? watchdog_timer_fn+0x1be/0x220 Aug 22 07:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 7404.581483] ? lockup_detector_update_enable+0x60/0x60 Aug 22 07:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 7404.582556] ? __hrtimer_run_queues+0x107/0x230 Aug 22 07:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 7404.583607] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 07:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 7404.584642] ? hrtimer_interrupt+0x101/0x220 Aug 22 07:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 7404.585666] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 07:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 7404.586763] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 07:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 7404.587821] Aug 22 07:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 7404.588678] Aug 22 07:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 7404.589520] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 07:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 7404.590564] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 7404.591622] ? _raw_spin_lock+0x22/0x30 Aug 22 07:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 7404.592573] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 7404.593605] direct_page_fault+0x206/0x310 [kvm] Aug 22 07:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 7404.594638] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 07:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 7404.595662] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 07:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 7404.596677] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 07:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 7404.597690] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 07:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 7404.598650] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 07:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 7404.599658] handle_exit+0x98/0x230 [kvm_amd] Aug 22 07:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 7404.600555] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 07:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 7404.601481] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 07:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 7404.602420] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 07:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 7404.603342] vcpu_run+0x62/0x2c0 [kvm] Aug 22 07:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 7404.604162] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 07:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 7404.604994] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 07:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 7404.605868] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 07:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 7404.606673] ? __seccomp_filter+0x4a/0x4a0 Aug 22 07:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 7404.607436] ? __fget_files+0x86/0xc0 Aug 22 07:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 7404.608148] __x64_sys_ioctl+0x95/0xd0 Aug 22 07:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 7404.608849] do_syscall_64+0x5c/0xc0 Aug 22 07:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 7404.609526] ? do_futex+0x162/0x1f0 Aug 22 07:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 7404.610182] ? __x64_sys_futex+0x78/0x1e0 Aug 22 07:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 7404.610870] ? __secure_computing+0xa9/0x120 Aug 22 07:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 7404.611567] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 07:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 7404.612339] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 7404.613075] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 7404.613804] ? do_syscall_64+0x69/0xc0 Aug 22 07:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 7404.614464] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 7404.615189] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 7404.615899] ? do_syscall_64+0x69/0xc0 Aug 22 07:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 7404.616530] ? do_syscall_64+0x69/0xc0 Aug 22 07:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 7404.617161] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 07:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 7404.617876] RIP: 0033:0x7faa5d0edaff Aug 22 07:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 7404.618545] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 07:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 7404.620677] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 07:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 7404.621607] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 07:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 7404.622516] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 07:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 7404.623445] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 07:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 7404.624347] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 07:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 7404.625254] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 07:27:10 juju-e4d256-prod-github-runner-207 kernel: [ 7404.626167] Aug 22 07:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 7432.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 6814s! [qemu-system-x86:6715] Aug 22 07:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 7432.543128] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 07:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 7432.543200] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 07:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 7432.555607] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 07:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 7432.556893] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 07:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 7432.558157] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 7432.559257] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 07:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 7432.561878] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 07:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 7432.562956] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 07:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 7432.564147] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 07:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 7432.565338] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 07:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 7432.566542] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 07:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 7432.567747] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 07:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 7432.568949] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 07:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 7432.570209] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 07:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 7432.571340] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 07:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 7432.572612] Call Trace: Aug 22 07:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 7432.573533] Aug 22 07:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 7432.574452] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 7432.575497] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 7432.576529] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 7432.577646] ? show_regs.part.0+0x23/0x29 Aug 22 07:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 7432.578682] ? show_regs.cold+0x8/0xd Aug 22 07:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 7432.579668] ? watchdog_timer_fn+0x1be/0x220 Aug 22 07:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 7432.580686] ? lockup_detector_update_enable+0x60/0x60 Aug 22 07:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 7432.581760] ? __hrtimer_run_queues+0x107/0x230 Aug 22 07:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 7432.582812] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 07:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 7432.583849] ? hrtimer_interrupt+0x101/0x220 Aug 22 07:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 7432.584872] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 07:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 7432.585954] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 07:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 7432.587037] Aug 22 07:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 7432.587894] Aug 22 07:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 7432.588740] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 07:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 7432.589787] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 7432.590867] ? _raw_spin_lock+0x22/0x30 Aug 22 07:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 7432.591822] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 7432.592848] direct_page_fault+0x206/0x310 [kvm] Aug 22 07:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 7432.593883] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 07:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 7432.594928] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 07:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 7432.595946] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 07:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 7432.596925] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 07:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 7432.597880] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 07:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 7432.598891] handle_exit+0x98/0x230 [kvm_amd] Aug 22 07:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 7432.599798] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 07:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 7432.600723] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 07:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 7432.601669] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 07:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 7432.602612] vcpu_run+0x62/0x2c0 [kvm] Aug 22 07:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 7432.603442] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 07:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 7432.604264] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 07:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 7432.605133] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 07:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 7432.605949] ? __seccomp_filter+0x4a/0x4a0 Aug 22 07:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 7432.606724] ? __fget_files+0x86/0xc0 Aug 22 07:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 7432.607462] __x64_sys_ioctl+0x95/0xd0 Aug 22 07:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 7432.608166] do_syscall_64+0x5c/0xc0 Aug 22 07:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 7432.608846] ? do_futex+0x162/0x1f0 Aug 22 07:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 7432.609513] ? __x64_sys_futex+0x78/0x1e0 Aug 22 07:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 7432.610199] ? __secure_computing+0xa9/0x120 Aug 22 07:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 7432.610910] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 07:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 7432.611680] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 7432.612414] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 7432.613150] ? do_syscall_64+0x69/0xc0 Aug 22 07:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 7432.613806] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 7432.614549] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 7432.615270] ? do_syscall_64+0x69/0xc0 Aug 22 07:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 7432.615906] ? do_syscall_64+0x69/0xc0 Aug 22 07:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 7432.616538] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 07:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 7432.617256] RIP: 0033:0x7faa5d0edaff Aug 22 07:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 7432.617937] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 07:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 7432.620025] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 07:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 7432.620954] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 07:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 7432.621864] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 07:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 7432.622782] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 07:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 7432.623692] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 07:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 7432.624599] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 07:27:38 juju-e4d256-prod-github-runner-207 kernel: [ 7432.625507] Aug 22 07:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 7460.541994] watchdog: BUG: soft lockup - CPU#1 stuck for 6840s! [qemu-system-x86:6715] Aug 22 07:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 7460.543119] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 07:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 7460.543190] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 07:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 7460.555671] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 07:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 7460.556969] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 07:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 7460.558242] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 7460.559316] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 07:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 7460.561892] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 07:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 7460.562959] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 07:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 7460.564424] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 07:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 7460.565650] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 07:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 7460.566870] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 07:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 7460.568072] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 07:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 7460.569254] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 07:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 7460.570530] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 07:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 7460.571745] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 07:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 7460.572968] Call Trace: Aug 22 07:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 7460.573888] Aug 22 07:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 7460.574808] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 7460.575858] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 7460.576905] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 7460.578066] ? show_regs.part.0+0x23/0x29 Aug 22 07:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 7460.579111] ? show_regs.cold+0x8/0xd Aug 22 07:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 7460.580112] ? watchdog_timer_fn+0x1be/0x220 Aug 22 07:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 7460.581138] ? lockup_detector_update_enable+0x60/0x60 Aug 22 07:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 7460.582242] ? __hrtimer_run_queues+0x107/0x230 Aug 22 07:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 7460.583282] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 07:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 7460.584344] ? hrtimer_interrupt+0x101/0x220 Aug 22 07:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 7460.585373] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 07:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 7460.586490] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 07:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 7460.587552] Aug 22 07:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 7460.588412] Aug 22 07:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 7460.589254] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 07:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 7460.590324] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 7460.591374] ? _raw_spin_lock+0x22/0x30 Aug 22 07:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 7460.592329] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 7460.593354] direct_page_fault+0x206/0x310 [kvm] Aug 22 07:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 7460.594421] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 07:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 7460.595443] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 07:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 7460.596465] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 07:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 7460.597457] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 07:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 7460.598442] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 07:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 7460.599442] handle_exit+0x98/0x230 [kvm_amd] Aug 22 07:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 7460.600356] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 07:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 7460.601284] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 07:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 7460.602235] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 07:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 7460.603179] vcpu_run+0x62/0x2c0 [kvm] Aug 22 07:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 7460.604011] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 07:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 7460.604834] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 07:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 7460.605711] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 07:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 7460.606556] ? __seccomp_filter+0x4a/0x4a0 Aug 22 07:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 7460.607311] ? __fget_files+0x86/0xc0 Aug 22 07:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 7460.608023] __x64_sys_ioctl+0x95/0xd0 Aug 22 07:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 7460.608724] do_syscall_64+0x5c/0xc0 Aug 22 07:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 7460.609403] ? do_futex+0x162/0x1f0 Aug 22 07:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 7460.610083] ? __x64_sys_futex+0x78/0x1e0 Aug 22 07:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 7460.610763] ? __secure_computing+0xa9/0x120 Aug 22 07:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 7460.611476] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 07:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 7460.612289] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 7460.613029] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 7460.613760] ? do_syscall_64+0x69/0xc0 Aug 22 07:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 7460.614431] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 7460.615141] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 7460.615847] ? do_syscall_64+0x69/0xc0 Aug 22 07:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 7460.616486] ? do_syscall_64+0x69/0xc0 Aug 22 07:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 7460.617118] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 07:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 7460.617832] RIP: 0033:0x7faa5d0edaff Aug 22 07:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 7460.618482] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 07:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 7460.620535] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 07:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 7460.621463] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 07:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 7460.622380] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 07:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 7460.623320] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 07:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 7460.624227] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 07:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 7460.625150] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 07:28:06 juju-e4d256-prod-github-runner-207 kernel: [ 7460.626088] Aug 22 07:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 7488.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 6866s! [qemu-system-x86:6715] Aug 22 07:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 7488.543872] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 07:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 7488.544182] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 07:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 7488.556703] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 07:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 7488.558029] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 07:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 7488.559312] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 7488.560387] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 07:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 7488.563078] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 07:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 7488.564164] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 07:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 7488.565402] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 07:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 7488.566959] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 07:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 7488.568195] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 07:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 7488.569536] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 07:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 7488.570787] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 07:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 7488.572042] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 07:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 7488.573188] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 07:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 7488.574459] Call Trace: Aug 22 07:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 7488.575452] Aug 22 07:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 7488.576361] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 7488.577410] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 7488.578526] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 7488.579691] ? show_regs.part.0+0x23/0x29 Aug 22 07:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 7488.580718] ? show_regs.cold+0x8/0xd Aug 22 07:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 7488.581774] ? watchdog_timer_fn+0x1be/0x220 Aug 22 07:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 7488.582810] ? lockup_detector_update_enable+0x60/0x60 Aug 22 07:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 7488.583893] ? __hrtimer_run_queues+0x107/0x230 Aug 22 07:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 7488.584930] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 07:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 7488.586005] ? hrtimer_interrupt+0x101/0x220 Aug 22 07:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 7488.587038] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 07:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 7488.588122] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 07:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 7488.589208] Aug 22 07:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 7488.590160] Aug 22 07:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 7488.591051] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 07:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 7488.592183] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 7488.593336] ? _raw_spin_lock+0x22/0x30 Aug 22 07:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 7488.594409] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 7488.595527] direct_page_fault+0x206/0x310 [kvm] Aug 22 07:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 7488.596672] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 07:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 7488.597802] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 07:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 7488.598898] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 07:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 7488.600011] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 07:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 7488.601059] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 07:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 7488.602175] handle_exit+0x98/0x230 [kvm_amd] Aug 22 07:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 7488.603157] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 07:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 7488.604169] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 07:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 7488.605193] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 07:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 7488.606236] vcpu_run+0x62/0x2c0 [kvm] Aug 22 07:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 7488.607127] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 07:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 7488.608025] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 07:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 7488.608986] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 07:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 7488.609916] ? __seccomp_filter+0x4a/0x4a0 Aug 22 07:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 7488.610762] ? __fget_files+0x86/0xc0 Aug 22 07:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 7488.611548] __x64_sys_ioctl+0x95/0xd0 Aug 22 07:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 7488.612322] do_syscall_64+0x5c/0xc0 Aug 22 07:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 7488.613066] ? do_futex+0x162/0x1f0 Aug 22 07:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 7488.613821] ? __x64_sys_futex+0x78/0x1e0 Aug 22 07:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 7488.614582] ? __secure_computing+0xa9/0x120 Aug 22 07:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 7488.615362] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 07:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 7488.616241] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 7488.617061] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 7488.617898] ? do_syscall_64+0x69/0xc0 Aug 22 07:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 7488.618619] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 7488.619446] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 7488.620245] ? do_syscall_64+0x69/0xc0 Aug 22 07:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 7488.620953] ? do_syscall_64+0x69/0xc0 Aug 22 07:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 7488.621684] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 07:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 7488.622496] RIP: 0033:0x7faa5d0edaff Aug 22 07:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 7488.623241] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 07:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 7488.625571] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 07:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 7488.626648] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 07:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 7488.627676] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 07:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 7488.628703] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 07:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 7488.629774] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 07:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 7488.630808] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 07:28:34 juju-e4d256-prod-github-runner-207 kernel: [ 7488.631856] Aug 22 07:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 7516.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 6892s! [qemu-system-x86:6715] Aug 22 07:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 7516.543121] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 07:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 7516.543194] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 07:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 7516.557359] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 07:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 7516.558802] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 07:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 7516.560188] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 7516.561392] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 07:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 7516.564452] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 07:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 7516.565647] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 07:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 7516.567175] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 07:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 7516.568352] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 07:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 7516.569546] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 07:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 7516.570771] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 07:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 7516.572044] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 07:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 7516.573320] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 07:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 7516.574428] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 07:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 7516.575641] Call Trace: Aug 22 07:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 7516.576614] Aug 22 07:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 7516.577561] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 7516.578603] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 7516.579630] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 7516.580730] ? show_regs.part.0+0x23/0x29 Aug 22 07:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 7516.581831] ? show_regs.cold+0x8/0xd Aug 22 07:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 7516.582893] ? watchdog_timer_fn+0x1be/0x220 Aug 22 07:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 7516.583919] ? lockup_detector_update_enable+0x60/0x60 Aug 22 07:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 7516.585023] ? __hrtimer_run_queues+0x107/0x230 Aug 22 07:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 7516.586106] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 07:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 7516.587205] ? hrtimer_interrupt+0x101/0x220 Aug 22 07:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 7516.588247] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 07:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 7516.589374] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 07:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 7516.590428] Aug 22 07:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 7516.591335] Aug 22 07:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 7516.592191] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 07:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 7516.593346] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 7516.594395] ? _raw_spin_lock+0x22/0x30 Aug 22 07:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 7516.595362] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 7516.596395] direct_page_fault+0x206/0x310 [kvm] Aug 22 07:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 7516.597522] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 07:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 7516.598584] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 07:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 7516.599734] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 07:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 7516.600828] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 07:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 7516.601831] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 07:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 7516.602858] handle_exit+0x98/0x230 [kvm_amd] Aug 22 07:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 7516.603789] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 07:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 7516.604720] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 07:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 7516.605683] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 07:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 7516.606621] vcpu_run+0x62/0x2c0 [kvm] Aug 22 07:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 7516.607529] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 07:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 7516.608380] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 07:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 7516.609289] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 07:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 7516.610120] ? __seccomp_filter+0x4a/0x4a0 Aug 22 07:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 7516.610874] ? __fget_files+0x86/0xc0 Aug 22 07:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 7516.611594] __x64_sys_ioctl+0x95/0xd0 Aug 22 07:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 7516.612303] do_syscall_64+0x5c/0xc0 Aug 22 07:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 7516.612988] ? do_futex+0x162/0x1f0 Aug 22 07:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 7516.613675] ? __x64_sys_futex+0x78/0x1e0 Aug 22 07:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 7516.614357] ? __secure_computing+0xa9/0x120 Aug 22 07:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 7516.615055] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 07:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 7516.615822] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 7516.616549] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 7516.617303] ? do_syscall_64+0x69/0xc0 Aug 22 07:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 7516.617981] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 7516.618700] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 7516.619401] ? do_syscall_64+0x69/0xc0 Aug 22 07:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 7516.620036] ? do_syscall_64+0x69/0xc0 Aug 22 07:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 7516.620669] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 07:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 7516.621401] RIP: 0033:0x7faa5d0edaff Aug 22 07:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 7516.622046] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 07:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 7516.624069] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 07:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 7516.624995] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 07:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 7516.625958] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 07:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 7516.626943] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 07:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 7516.628034] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 07:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 7516.629035] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 07:29:02 juju-e4d256-prod-github-runner-207 kernel: [ 7516.629987] Aug 22 07:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 7544.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 6918s! [qemu-system-x86:6715] Aug 22 07:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 7544.543122] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 07:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 7544.543197] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 07:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 7544.555692] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 07:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 7544.557025] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 07:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 7544.558254] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 7544.559311] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 07:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 7544.561933] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 07:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 7544.562986] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 07:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 7544.564191] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 07:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 7544.565390] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 07:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 7544.566623] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 07:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 7544.567813] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 07:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 7544.568992] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 07:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 7544.570222] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 07:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 7544.571334] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 07:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 7544.572542] Call Trace: Aug 22 07:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 7544.573474] Aug 22 07:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 7544.574356] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 7544.575384] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 7544.576436] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 7544.577558] ? show_regs.part.0+0x23/0x29 Aug 22 07:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 7544.578564] ? show_regs.cold+0x8/0xd Aug 22 07:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 7544.579549] ? watchdog_timer_fn+0x1be/0x220 Aug 22 07:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 7544.580557] ? lockup_detector_update_enable+0x60/0x60 Aug 22 07:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 7544.581668] ? __hrtimer_run_queues+0x107/0x230 Aug 22 07:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 7544.582833] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 07:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 7544.583877] ? hrtimer_interrupt+0x101/0x220 Aug 22 07:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 7544.584928] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 07:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 7544.586018] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 07:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 7544.587138] Aug 22 07:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 7544.588023] Aug 22 07:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 7544.588871] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 07:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 7544.589917] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 7544.590957] ? _raw_spin_lock+0x22/0x30 Aug 22 07:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 7544.591926] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 7544.593006] direct_page_fault+0x206/0x310 [kvm] Aug 22 07:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 7544.594047] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 07:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 7544.595053] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 07:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 7544.596093] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 07:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 7544.597162] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 07:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 7544.598154] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 07:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 7544.599143] handle_exit+0x98/0x230 [kvm_amd] Aug 22 07:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 7544.600057] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 07:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 7544.601033] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 07:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 7544.601988] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 07:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 7544.602916] vcpu_run+0x62/0x2c0 [kvm] Aug 22 07:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 7544.603829] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 07:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 7544.604734] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 07:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 7544.605703] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 07:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 7544.606605] ? __seccomp_filter+0x4a/0x4a0 Aug 22 07:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 7544.607458] ? __fget_files+0x86/0xc0 Aug 22 07:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 7544.608253] __x64_sys_ioctl+0x95/0xd0 Aug 22 07:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 7544.609045] do_syscall_64+0x5c/0xc0 Aug 22 07:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 7544.609780] ? do_futex+0x162/0x1f0 Aug 22 07:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 7544.610497] ? __x64_sys_futex+0x78/0x1e0 Aug 22 07:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 7544.611250] ? __secure_computing+0xa9/0x120 Aug 22 07:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 7544.612020] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 07:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 7544.612928] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 7544.613751] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 7544.614572] ? do_syscall_64+0x69/0xc0 Aug 22 07:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 7544.615298] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 7544.616098] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 7544.616910] ? do_syscall_64+0x69/0xc0 Aug 22 07:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 7544.617630] ? do_syscall_64+0x69/0xc0 Aug 22 07:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 7544.618281] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 07:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 7544.618984] RIP: 0033:0x7faa5d0edaff Aug 22 07:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 7544.619606] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 07:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 7544.621603] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 07:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 7544.622514] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 07:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 7544.623430] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 07:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 7544.624324] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 07:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 7544.625228] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 07:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 7544.626121] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 07:29:30 juju-e4d256-prod-github-runner-207 kernel: [ 7544.627088] Aug 22 07:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 7557.692725] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 07:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 7557.693740] rcu: 1-....: (1854285 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=899750 Aug 22 07:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 7557.695064] (t=1860123 jiffies g=23269 q=16450) Aug 22 07:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 7557.695865] NMI backtrace for cpu 1 Aug 22 07:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 7557.696615] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 07:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 7557.697761] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 07:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 7557.698835] Call Trace: Aug 22 07:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 7557.699523] Aug 22 07:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 7557.700205] show_stack+0x52/0x5c Aug 22 07:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 7557.700980] dump_stack_lvl+0x4a/0x63 Aug 22 07:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 7557.701740] dump_stack+0x10/0x16 Aug 22 07:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 7557.702467] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 07:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 7557.703248] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 07:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 7557.704043] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 07:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 7557.704940] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 07:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 7557.705788] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 07:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 7557.706638] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 07:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 7557.707562] print_cpu_stall.cold+0x2f/0xe2 Aug 22 07:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 7557.708348] ? timekeeping_update+0xf7/0x150 Aug 22 07:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 7557.709310] check_cpu_stall+0x109/0x270 Aug 22 07:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 7557.710081] rcu_sched_clock_irq+0x9a/0x250 Aug 22 07:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 7557.710863] update_process_times+0x94/0xd0 Aug 22 07:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 7557.711634] tick_sched_handle+0x29/0x70 Aug 22 07:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 7557.712397] tick_sched_timer+0x8c/0xc0 Aug 22 07:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 7557.713156] ? tick_nohz_handler+0xb0/0xb0 Aug 22 07:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 7557.713913] __hrtimer_run_queues+0x107/0x230 Aug 22 07:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 7557.714713] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 07:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 7557.715528] hrtimer_interrupt+0x101/0x220 Aug 22 07:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 7557.716353] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 07:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 7557.717195] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 07:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 7557.718002] Aug 22 07:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 7557.718636] Aug 22 07:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 7557.719265] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 07:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 7557.720101] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 7557.721016] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 07:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 7557.723226] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 07:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 7557.724102] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 07:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 7557.725125] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 07:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 7557.726168] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 07:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 7557.727131] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 07:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 7557.728087] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 07:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 7557.729060] ? _raw_spin_lock+0x22/0x30 Aug 22 07:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 7557.729843] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 7557.730685] direct_page_fault+0x206/0x310 [kvm] Aug 22 07:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 7557.731543] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 07:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 7557.732380] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 07:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 7557.733218] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 07:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 7557.734027] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 07:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 7557.734901] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 07:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 7557.735736] handle_exit+0x98/0x230 [kvm_amd] Aug 22 07:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 7557.736517] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 07:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 7557.737366] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 07:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 7557.738213] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 07:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 7557.739007] vcpu_run+0x62/0x2c0 [kvm] Aug 22 07:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 7557.739727] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 07:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 7557.740518] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 07:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 7557.741378] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 07:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 7557.742147] ? __seccomp_filter+0x4a/0x4a0 Aug 22 07:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 7557.742880] ? __fget_files+0x86/0xc0 Aug 22 07:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 7557.743578] __x64_sys_ioctl+0x95/0xd0 Aug 22 07:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 7557.744274] do_syscall_64+0x5c/0xc0 Aug 22 07:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 7557.744974] ? do_futex+0x162/0x1f0 Aug 22 07:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 7557.745669] ? __x64_sys_futex+0x78/0x1e0 Aug 22 07:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 7557.746416] ? __secure_computing+0xa9/0x120 Aug 22 07:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 7557.747145] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 07:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 7557.747944] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 7557.748702] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 7557.749475] ? do_syscall_64+0x69/0xc0 Aug 22 07:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 7557.750168] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 7557.750936] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 7557.751707] ? do_syscall_64+0x69/0xc0 Aug 22 07:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 7557.752409] ? do_syscall_64+0x69/0xc0 Aug 22 07:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 7557.753143] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 07:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 7557.753926] RIP: 0033:0x7faa5d0edaff Aug 22 07:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 7557.754613] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 07:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 7557.756797] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 07:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 7557.757814] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 07:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 7557.758794] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 07:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 7557.759773] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 07:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 7557.760805] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 07:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 7557.761757] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 07:29:43 juju-e4d256-prod-github-runner-207 kernel: [ 7557.762717] Aug 22 07:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 7584.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 6955s! [qemu-system-x86:6715] Aug 22 07:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 7584.543828] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 07:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 7584.544118] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 07:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 7584.556512] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 07:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 7584.557792] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 07:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 7584.559032] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 7584.560089] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 07:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 7584.562772] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 07:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 7584.563828] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 07:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 7584.565099] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 07:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 7584.566266] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 07:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 7584.567450] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 07:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 7584.568642] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 07:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 7584.569815] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 07:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 7584.571056] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 07:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 7584.572168] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 07:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 7584.573403] Call Trace: Aug 22 07:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 7584.574326] Aug 22 07:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 7584.575237] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 7584.576309] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 7584.577515] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 7584.578714] ? show_regs.part.0+0x23/0x29 Aug 22 07:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 7584.579940] ? show_regs.cold+0x8/0xd Aug 22 07:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 7584.581014] ? watchdog_timer_fn+0x1be/0x220 Aug 22 07:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 7584.582052] ? lockup_detector_update_enable+0x60/0x60 Aug 22 07:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 7584.583138] ? __hrtimer_run_queues+0x107/0x230 Aug 22 07:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 7584.584175] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 07:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 7584.585224] ? hrtimer_interrupt+0x101/0x220 Aug 22 07:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 7584.586238] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 07:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 7584.587468] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 07:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 7584.588666] Aug 22 07:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 7584.589546] Aug 22 07:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 7584.590401] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 07:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 7584.591436] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 7584.592501] ? _raw_spin_lock+0x22/0x30 Aug 22 07:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 7584.593498] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 7584.594526] direct_page_fault+0x206/0x310 [kvm] Aug 22 07:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 7584.595548] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 07:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 7584.596584] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 07:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 7584.597616] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 07:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 7584.598656] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 07:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 7584.599622] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 07:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 7584.600662] handle_exit+0x98/0x230 [kvm_amd] Aug 22 07:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 7584.601562] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 07:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 7584.602485] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 07:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 7584.603412] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 07:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 7584.604316] vcpu_run+0x62/0x2c0 [kvm] Aug 22 07:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 7584.605157] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 07:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 7584.605967] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 07:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 7584.606823] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 07:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 7584.607627] ? __seccomp_filter+0x4a/0x4a0 Aug 22 07:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 7584.608391] ? __fget_files+0x86/0xc0 Aug 22 07:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 7584.609122] __x64_sys_ioctl+0x95/0xd0 Aug 22 07:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 7584.609818] do_syscall_64+0x5c/0xc0 Aug 22 07:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 7584.610484] ? do_futex+0x162/0x1f0 Aug 22 07:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 7584.611135] ? __x64_sys_futex+0x78/0x1e0 Aug 22 07:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 7584.611811] ? __secure_computing+0xa9/0x120 Aug 22 07:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 7584.612534] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 07:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 7584.613316] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 7584.614094] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 7584.614860] ? do_syscall_64+0x69/0xc0 Aug 22 07:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 7584.615521] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 7584.616230] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 7584.616962] ? do_syscall_64+0x69/0xc0 Aug 22 07:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 7584.617602] ? do_syscall_64+0x69/0xc0 Aug 22 07:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 7584.618231] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 07:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 7584.618975] RIP: 0033:0x7faa5d0edaff Aug 22 07:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 7584.619692] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 07:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 7584.622071] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 07:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 7584.622996] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 07:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 7584.623914] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 07:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 7584.624843] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 07:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 7584.625747] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 07:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 7584.626664] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 07:30:10 juju-e4d256-prod-github-runner-207 kernel: [ 7584.627586] Aug 22 07:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 7612.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 6981s! [qemu-system-x86:6715] Aug 22 07:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 7612.543084] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 07:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 7612.543157] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 07:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 7612.555539] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 07:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 7612.556815] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 07:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 7612.558032] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 7612.559086] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 07:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 7612.561643] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 07:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 7612.562684] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 07:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 7612.564057] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 07:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 7612.565410] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 07:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 7612.566573] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 07:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 7612.567734] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 07:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 7612.568928] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 07:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 7612.570168] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 07:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 7612.571304] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 07:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 7612.572518] Call Trace: Aug 22 07:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 7612.573432] Aug 22 07:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 7612.574325] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 7612.575362] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 7612.576430] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 7612.577508] ? show_regs.part.0+0x23/0x29 Aug 22 07:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 7612.578526] ? show_regs.cold+0x8/0xd Aug 22 07:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 7612.579506] ? watchdog_timer_fn+0x1be/0x220 Aug 22 07:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 7612.580567] ? lockup_detector_update_enable+0x60/0x60 Aug 22 07:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 7612.581762] ? __hrtimer_run_queues+0x107/0x230 Aug 22 07:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 7612.582890] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 07:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 7612.584043] ? hrtimer_interrupt+0x101/0x220 Aug 22 07:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 7612.585163] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 07:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 7612.586345] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 07:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 7612.587499] Aug 22 07:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 7612.588418] Aug 22 07:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 7612.589305] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 07:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 7612.590439] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 7612.591641] ? _raw_spin_lock+0x22/0x30 Aug 22 07:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 7612.592679] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 7612.593788] direct_page_fault+0x206/0x310 [kvm] Aug 22 07:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 7612.594905] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 07:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 7612.596025] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 07:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 7612.597134] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 07:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 7612.598194] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 07:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 7612.599236] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 07:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 7612.600353] handle_exit+0x98/0x230 [kvm_amd] Aug 22 07:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 7612.601339] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 07:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 7612.602346] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 07:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 7612.603362] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 07:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 7612.604372] vcpu_run+0x62/0x2c0 [kvm] Aug 22 07:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 7612.605270] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 07:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 7612.606176] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 07:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 7612.607128] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 07:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 7612.608113] ? __seccomp_filter+0x4a/0x4a0 Aug 22 07:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 7612.608940] ? __fget_files+0x86/0xc0 Aug 22 07:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 7612.609725] __x64_sys_ioctl+0x95/0xd0 Aug 22 07:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 7612.610492] do_syscall_64+0x5c/0xc0 Aug 22 07:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 7612.611232] ? do_futex+0x162/0x1f0 Aug 22 07:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 7612.611967] ? __x64_sys_futex+0x78/0x1e0 Aug 22 07:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 7612.612735] ? __secure_computing+0xa9/0x120 Aug 22 07:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 7612.613514] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 07:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 7612.614388] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 7612.615258] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 7612.616105] ? do_syscall_64+0x69/0xc0 Aug 22 07:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 7612.616829] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 7612.617623] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 7612.618414] ? do_syscall_64+0x69/0xc0 Aug 22 07:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 7612.619112] ? do_syscall_64+0x69/0xc0 Aug 22 07:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 7612.619810] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 07:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 7612.620627] RIP: 0033:0x7faa5d0edaff Aug 22 07:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 7612.621328] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 07:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 7612.623660] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 07:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 7612.624729] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 07:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 7612.625769] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 07:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 7612.626795] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 07:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 7612.627812] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 07:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 7612.628851] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 07:30:38 juju-e4d256-prod-github-runner-207 kernel: [ 7612.629883] Aug 22 07:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 7640.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 7007s! [qemu-system-x86:6715] Aug 22 07:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 7640.543302] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 07:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 7640.543381] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 07:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 7640.555941] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 07:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 7640.557239] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 07:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 7640.558483] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 7640.559552] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 07:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 7640.562244] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 07:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 7640.563302] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 07:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 7640.564488] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 07:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 7640.565660] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 07:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 7640.566847] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 07:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 7640.568043] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 07:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 7640.569228] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 07:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 7640.570497] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 07:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 7640.571610] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 07:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 7640.572834] Call Trace: Aug 22 07:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 7640.573752] Aug 22 07:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 7640.574638] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 7640.575688] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 7640.576741] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 7640.577823] ? show_regs.part.0+0x23/0x29 Aug 22 07:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 7640.578840] ? show_regs.cold+0x8/0xd Aug 22 07:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 7640.579829] ? watchdog_timer_fn+0x1be/0x220 Aug 22 07:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 7640.580875] ? lockup_detector_update_enable+0x60/0x60 Aug 22 07:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 7640.581947] ? __hrtimer_run_queues+0x107/0x230 Aug 22 07:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 7640.582981] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 07:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 7640.584022] ? hrtimer_interrupt+0x101/0x220 Aug 22 07:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 7640.585044] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 07:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 7640.586128] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 07:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 7640.587182] Aug 22 07:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 7640.588047] Aug 22 07:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 7640.588892] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 07:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 7640.589938] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 7640.590989] ? _raw_spin_lock+0x22/0x30 Aug 22 07:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 7640.591947] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 7640.592983] direct_page_fault+0x206/0x310 [kvm] Aug 22 07:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 7640.594028] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 07:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 7640.595044] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 07:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 7640.596068] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 07:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 7640.597051] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 07:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 7640.598005] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 07:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 7640.598997] handle_exit+0x98/0x230 [kvm_amd] Aug 22 07:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 7640.599907] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 07:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 7640.600828] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 07:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 7640.601760] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 07:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 7640.602671] vcpu_run+0x62/0x2c0 [kvm] Aug 22 07:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 7640.603493] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 07:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 7640.604320] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 07:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 7640.605185] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 07:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 7640.605990] ? __seccomp_filter+0x4a/0x4a0 Aug 22 07:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 7640.606741] ? __fget_files+0x86/0xc0 Aug 22 07:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 7640.607453] __x64_sys_ioctl+0x95/0xd0 Aug 22 07:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 7640.608158] do_syscall_64+0x5c/0xc0 Aug 22 07:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 7640.608831] ? do_futex+0x162/0x1f0 Aug 22 07:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 7640.609486] ? __x64_sys_futex+0x78/0x1e0 Aug 22 07:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 7640.610167] ? __secure_computing+0xa9/0x120 Aug 22 07:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 7640.610865] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 07:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 7640.611657] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 7640.612397] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 7640.613144] ? do_syscall_64+0x69/0xc0 Aug 22 07:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 7640.613811] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 7640.614522] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 7640.615225] ? do_syscall_64+0x69/0xc0 Aug 22 07:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 7640.615862] ? do_syscall_64+0x69/0xc0 Aug 22 07:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 7640.616492] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 07:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 7640.617206] RIP: 0033:0x7faa5d0edaff Aug 22 07:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 7640.617836] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 07:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 7640.619863] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 07:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 7640.620792] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 07:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 7640.621696] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 07:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 7640.622597] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 07:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 7640.623497] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 07:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 7640.624406] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 07:31:06 juju-e4d256-prod-github-runner-207 kernel: [ 7640.625313] Aug 22 07:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 7668.541980] watchdog: BUG: soft lockup - CPU#1 stuck for 7033s! [qemu-system-x86:6715] Aug 22 07:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 7668.544147] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 07:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 7668.544455] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 07:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 7668.556724] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 07:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 7668.558053] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 07:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 7668.559309] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 7668.560365] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 07:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 7668.562904] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 07:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 7668.563963] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 07:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 7668.565128] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 07:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 7668.566283] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 07:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 7668.567454] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 07:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 7668.568619] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 07:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 7668.569784] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 07:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 7668.571016] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 07:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 7668.572120] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 07:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 7668.573318] Call Trace: Aug 22 07:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 7668.574232] Aug 22 07:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 7668.575137] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 7668.576175] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 7668.577197] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 7668.578299] ? show_regs.part.0+0x23/0x29 Aug 22 07:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 7668.579315] ? show_regs.cold+0x8/0xd Aug 22 07:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 7668.580290] ? watchdog_timer_fn+0x1be/0x220 Aug 22 07:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 7668.581296] ? lockup_detector_update_enable+0x60/0x60 Aug 22 07:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 7668.582357] ? __hrtimer_run_queues+0x107/0x230 Aug 22 07:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 7668.583418] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 07:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 7668.584450] ? hrtimer_interrupt+0x101/0x220 Aug 22 07:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 7668.585462] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 07:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 7668.586531] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 07:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 7668.587586] Aug 22 07:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 7668.588443] Aug 22 07:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 7668.589278] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 07:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 7668.590312] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 7668.591360] ? _raw_spin_lock+0x22/0x30 Aug 22 07:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 7668.592363] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 7668.593416] direct_page_fault+0x206/0x310 [kvm] Aug 22 07:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 7668.594446] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 07:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 7668.595477] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 07:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 7668.596479] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 07:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 7668.597509] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 07:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 7668.598458] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 07:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 7668.599456] handle_exit+0x98/0x230 [kvm_amd] Aug 22 07:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 7668.600423] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 07:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 7668.601369] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 07:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 7668.602313] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 07:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 7668.603216] vcpu_run+0x62/0x2c0 [kvm] Aug 22 07:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 7668.604045] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 07:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 7668.604852] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 07:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 7668.605706] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 07:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 7668.606510] ? __seccomp_filter+0x4a/0x4a0 Aug 22 07:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 7668.607253] ? __fget_files+0x86/0xc0 Aug 22 07:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 7668.608031] __x64_sys_ioctl+0x95/0xd0 Aug 22 07:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 7668.608731] do_syscall_64+0x5c/0xc0 Aug 22 07:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 7668.609402] ? do_futex+0x162/0x1f0 Aug 22 07:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 7668.610055] ? __x64_sys_futex+0x78/0x1e0 Aug 22 07:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 7668.610733] ? __secure_computing+0xa9/0x120 Aug 22 07:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 7668.611469] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 07:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 7668.612237] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 7668.612960] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 7668.613736] ? do_syscall_64+0x69/0xc0 Aug 22 07:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 7668.614408] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 7668.615112] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 7668.615988] ? do_syscall_64+0x69/0xc0 Aug 22 07:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 7668.616894] ? do_syscall_64+0x69/0xc0 Aug 22 07:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 7668.617590] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 07:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 7668.618416] RIP: 0033:0x7faa5d0edaff Aug 22 07:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 7668.619163] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 07:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 7668.621535] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 07:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 7668.622650] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 07:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 7668.623773] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 07:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 7668.624807] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 07:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 7668.625826] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 07:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 7668.626847] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 07:31:34 juju-e4d256-prod-github-runner-207 kernel: [ 7668.627893] Aug 22 07:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 7696.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 7059s! [qemu-system-x86:6715] Aug 22 07:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 7696.543109] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 07:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 7696.543186] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 07:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 7696.555266] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 07:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 7696.556531] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 07:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 7696.557752] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 7696.558810] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 07:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 7696.561372] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 07:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 7696.562415] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 07:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 7696.563592] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 07:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 7696.564754] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 07:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 7696.565916] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 07:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 7696.567084] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 07:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 7696.568249] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 07:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 7696.569495] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 07:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 7696.570596] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 07:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 7696.571818] Call Trace: Aug 22 07:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 7696.572734] Aug 22 07:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 7696.573618] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 7696.574648] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 7696.575675] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 7696.576749] ? show_regs.part.0+0x23/0x29 Aug 22 07:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 7696.577744] ? show_regs.cold+0x8/0xd Aug 22 07:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 7696.578714] ? watchdog_timer_fn+0x1be/0x220 Aug 22 07:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 7696.579728] ? lockup_detector_update_enable+0x60/0x60 Aug 22 07:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 7696.580788] ? __hrtimer_run_queues+0x107/0x230 Aug 22 07:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 7696.581813] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 07:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 7696.582834] ? hrtimer_interrupt+0x101/0x220 Aug 22 07:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 7696.583867] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 07:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 7696.584935] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 07:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 7696.585977] Aug 22 07:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 7696.586826] Aug 22 07:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 7696.587669] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 07:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 7696.588702] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 7696.589743] ? _raw_spin_lock+0x22/0x30 Aug 22 07:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 7696.590686] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 7696.591708] direct_page_fault+0x206/0x310 [kvm] Aug 22 07:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 7696.592728] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 07:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 7696.593733] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 07:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 7696.594731] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 07:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 7696.595707] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 07:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 7696.596655] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 07:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 7696.597632] handle_exit+0x98/0x230 [kvm_amd] Aug 22 07:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 7696.598522] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 07:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 7696.599449] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 07:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 7696.600371] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 07:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 7696.601273] vcpu_run+0x62/0x2c0 [kvm] Aug 22 07:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 7696.602084] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 07:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 7696.602893] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 07:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 7696.603759] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 07:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 7696.604559] ? __seccomp_filter+0x4a/0x4a0 Aug 22 07:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 7696.605303] ? __fget_files+0x86/0xc0 Aug 22 07:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 7696.606007] __x64_sys_ioctl+0x95/0xd0 Aug 22 07:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 7696.606702] do_syscall_64+0x5c/0xc0 Aug 22 07:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 7696.607372] ? do_futex+0x162/0x1f0 Aug 22 07:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 7696.608019] ? __x64_sys_futex+0x78/0x1e0 Aug 22 07:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 7696.608693] ? __secure_computing+0xa9/0x120 Aug 22 07:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 7696.609384] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 07:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 7696.610146] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 7696.610867] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 7696.611593] ? do_syscall_64+0x69/0xc0 Aug 22 07:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 7696.612239] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 7696.612943] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 7696.613645] ? do_syscall_64+0x69/0xc0 Aug 22 07:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 7696.614273] ? do_syscall_64+0x69/0xc0 Aug 22 07:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 7696.614896] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 07:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 7696.615615] RIP: 0033:0x7faa5d0edaff Aug 22 07:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 7696.616279] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 07:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 7696.618273] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 07:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 7696.619196] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 07:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 7696.620091] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 07:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 7696.620983] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 07:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 7696.621965] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 07:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 7696.623058] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 07:32:02 juju-e4d256-prod-github-runner-207 kernel: [ 7696.623955] Aug 22 07:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 7724.541980] watchdog: BUG: soft lockup - CPU#1 stuck for 7086s! [qemu-system-x86:6715] Aug 22 07:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 7724.543501] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 07:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 7724.543583] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 07:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 7724.558389] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 07:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 7724.560361] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 07:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 7724.562053] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 7724.563207] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 07:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 7724.566153] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 07:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 7724.567835] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 07:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 7724.569663] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 07:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 7724.571024] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 07:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 7724.572270] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 07:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 7724.573513] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 07:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 7724.574805] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 07:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 7724.576283] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 07:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 7724.578079] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 07:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 7724.579997] Call Trace: Aug 22 07:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 7724.580982] Aug 22 07:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 7724.581916] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 7724.583274] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 7724.584680] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 7724.586405] ? show_regs.part.0+0x23/0x29 Aug 22 07:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 7724.588018] ? show_regs.cold+0x8/0xd Aug 22 07:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 7724.589099] ? watchdog_timer_fn+0x1be/0x220 Aug 22 07:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 7724.590180] ? lockup_detector_update_enable+0x60/0x60 Aug 22 07:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 7724.591348] ? __hrtimer_run_queues+0x107/0x230 Aug 22 07:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 7724.592444] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 07:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 7724.594036] ? hrtimer_interrupt+0x101/0x220 Aug 22 07:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 7724.595655] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 07:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 7724.596834] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 07:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 7724.598419] Aug 22 07:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 7724.599841] Aug 22 07:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 7724.601233] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 07:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 7724.602443] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 7724.603574] ? _raw_spin_lock+0x22/0x30 Aug 22 07:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 7724.604588] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 7724.605715] direct_page_fault+0x206/0x310 [kvm] Aug 22 07:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 7724.607214] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 07:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 7724.608845] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 07:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 7724.610473] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 07:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 7724.611608] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 07:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 7724.612646] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 07:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 7724.613721] handle_exit+0x98/0x230 [kvm_amd] Aug 22 07:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 7724.614986] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 07:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 7724.616479] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 07:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 7724.617991] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 07:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 7724.619188] vcpu_run+0x62/0x2c0 [kvm] Aug 22 07:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 7724.620067] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 07:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 7724.621198] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 07:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 7724.622243] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 07:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 7724.623080] ? __seccomp_filter+0x4a/0x4a0 Aug 22 07:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 7724.623841] ? __fget_files+0x86/0xc0 Aug 22 07:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 7724.624623] __x64_sys_ioctl+0x95/0xd0 Aug 22 07:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 7724.625351] do_syscall_64+0x5c/0xc0 Aug 22 07:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 7724.626062] ? do_futex+0x162/0x1f0 Aug 22 07:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 7724.626885] ? __x64_sys_futex+0x78/0x1e0 Aug 22 07:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 7724.627617] ? __secure_computing+0xa9/0x120 Aug 22 07:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 7724.628332] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 07:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 7724.629130] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 7724.629874] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 7724.630726] ? do_syscall_64+0x69/0xc0 Aug 22 07:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 7724.631491] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 7724.632592] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 7724.633681] ? do_syscall_64+0x69/0xc0 Aug 22 07:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 7724.634691] ? do_syscall_64+0x69/0xc0 Aug 22 07:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 7724.635457] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 07:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 7724.636223] RIP: 0033:0x7faa5d0edaff Aug 22 07:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 7724.636901] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 07:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 7724.639094] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 07:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 7724.640432] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 07:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 7724.641386] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 07:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 7724.642354] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 07:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 7724.643357] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 07:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 7724.644565] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 07:32:30 juju-e4d256-prod-github-runner-207 kernel: [ 7724.645930] Aug 22 07:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 7737.704710] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 07:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 7737.705961] rcu: 1-....: (1899147 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=921300 Aug 22 07:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 7737.707333] (t=1905126 jiffies g=23269 q=16574) Aug 22 07:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 7737.708134] NMI backtrace for cpu 1 Aug 22 07:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 7737.708856] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 07:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 7737.709964] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 07:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 7737.711050] Call Trace: Aug 22 07:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 7737.711726] Aug 22 07:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 7737.712366] show_stack+0x52/0x5c Aug 22 07:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 7737.713086] dump_stack_lvl+0x4a/0x63 Aug 22 07:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 7737.713830] dump_stack+0x10/0x16 Aug 22 07:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 7737.714555] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 07:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 7737.715332] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 07:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 7737.716125] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 07:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 7737.716963] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 07:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 7737.717785] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 07:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 7737.718602] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 07:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 7737.719372] print_cpu_stall.cold+0x2f/0xe2 Aug 22 07:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 7737.720223] ? timekeeping_update+0xf7/0x150 Aug 22 07:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 7737.721077] check_cpu_stall+0x109/0x270 Aug 22 07:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 7737.721916] rcu_sched_clock_irq+0x9a/0x250 Aug 22 07:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 7737.722800] update_process_times+0x94/0xd0 Aug 22 07:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 7737.723650] tick_sched_handle+0x29/0x70 Aug 22 07:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 7737.724486] tick_sched_timer+0x8c/0xc0 Aug 22 07:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 7737.725311] ? tick_nohz_handler+0xb0/0xb0 Aug 22 07:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 7737.726142] __hrtimer_run_queues+0x107/0x230 Aug 22 07:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 7737.727020] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 07:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 7737.727879] hrtimer_interrupt+0x101/0x220 Aug 22 07:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 7737.728717] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 07:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 7737.729620] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 07:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 7737.730546] Aug 22 07:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 7737.731248] Aug 22 07:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 7737.731922] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 07:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 7737.732842] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 7737.734160] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 07:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 7737.736724] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 07:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 7737.737708] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 07:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 7737.738863] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 07:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 7737.739997] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 07:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 7737.741103] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 07:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 7737.742194] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 07:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 7737.743311] ? _raw_spin_lock+0x22/0x30 Aug 22 07:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 7737.744162] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 7737.745142] direct_page_fault+0x206/0x310 [kvm] Aug 22 07:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 7737.746087] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 07:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 7737.747048] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 07:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 7737.747971] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 07:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 7737.748872] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 07:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 7737.749757] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 07:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 7737.750723] handle_exit+0x98/0x230 [kvm_amd] Aug 22 07:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 7737.751572] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 07:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 7737.752447] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 07:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 7737.753369] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 07:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 7737.754267] vcpu_run+0x62/0x2c0 [kvm] Aug 22 07:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 7737.755114] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 07:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 7737.755933] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 07:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 7737.756835] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 07:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 7737.757686] ? __seccomp_filter+0x4a/0x4a0 Aug 22 07:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 7737.758510] ? __fget_files+0x86/0xc0 Aug 22 07:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 7737.759284] __x64_sys_ioctl+0x95/0xd0 Aug 22 07:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 7737.760053] do_syscall_64+0x5c/0xc0 Aug 22 07:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 7737.760811] ? do_futex+0x162/0x1f0 Aug 22 07:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 7737.761623] ? __x64_sys_futex+0x78/0x1e0 Aug 22 07:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 7737.762466] ? __secure_computing+0xa9/0x120 Aug 22 07:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 7737.763334] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 07:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 7737.764283] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 7737.765146] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 7737.766000] ? do_syscall_64+0x69/0xc0 Aug 22 07:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 7737.766796] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 7737.767651] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 7737.768523] ? do_syscall_64+0x69/0xc0 Aug 22 07:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 7737.769314] ? do_syscall_64+0x69/0xc0 Aug 22 07:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 7737.770134] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 07:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 7737.771027] RIP: 0033:0x7faa5d0edaff Aug 22 07:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 7737.771790] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 07:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 7737.774267] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 07:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 7737.775415] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 07:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 7737.776497] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 07:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 7737.777607] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 07:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 7737.778741] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 07:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 7737.779809] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 07:32:43 juju-e4d256-prod-github-runner-207 kernel: [ 7737.780884] Aug 22 07:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 7764.541980] watchdog: BUG: soft lockup - CPU#1 stuck for 7123s! [qemu-system-x86:6715] Aug 22 07:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 7764.544096] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 07:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 7764.544387] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 07:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 7764.556924] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 07:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 7764.558276] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 07:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 7764.559715] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 7764.560824] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 07:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 7764.563468] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 07:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 7764.564571] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 07:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 7764.565799] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 07:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 7764.567096] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 07:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 7764.568310] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 07:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 7764.569582] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 07:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 7764.570796] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 07:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 7764.572052] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 07:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 7764.573172] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 07:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 7764.574428] Call Trace: Aug 22 07:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 7764.575367] Aug 22 07:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 7764.576283] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 7764.577327] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 7764.578385] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 7764.579506] ? show_regs.part.0+0x23/0x29 Aug 22 07:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 7764.580534] ? show_regs.cold+0x8/0xd Aug 22 07:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 7764.581518] ? watchdog_timer_fn+0x1be/0x220 Aug 22 07:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 7764.582547] ? lockup_detector_update_enable+0x60/0x60 Aug 22 07:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 7764.583627] ? __hrtimer_run_queues+0x107/0x230 Aug 22 07:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 7764.584677] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 07:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 7764.585725] ? hrtimer_interrupt+0x101/0x220 Aug 22 07:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 7764.586767] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 07:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 7764.587849] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 07:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 7764.588915] Aug 22 07:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 7764.589790] Aug 22 07:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 7764.590672] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 07:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 7764.591732] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 7764.592787] ? _raw_spin_lock+0x22/0x30 Aug 22 07:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 7764.593754] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 7764.594845] direct_page_fault+0x206/0x310 [kvm] Aug 22 07:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 7764.595898] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 07:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 7764.596923] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 07:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 7764.597935] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 07:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 7764.598980] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 07:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 7764.599949] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 07:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 7764.600955] handle_exit+0x98/0x230 [kvm_amd] Aug 22 07:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 7764.601868] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 07:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 7764.602816] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 07:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 7764.603762] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 07:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 7764.604691] vcpu_run+0x62/0x2c0 [kvm] Aug 22 07:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 7764.605527] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 07:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 7764.606392] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 07:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 7764.607269] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 07:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 7764.608081] ? __seccomp_filter+0x4a/0x4a0 Aug 22 07:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 7764.608838] ? __fget_files+0x86/0xc0 Aug 22 07:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 7764.609563] __x64_sys_ioctl+0x95/0xd0 Aug 22 07:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 7764.610286] do_syscall_64+0x5c/0xc0 Aug 22 07:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 7764.610975] ? do_futex+0x162/0x1f0 Aug 22 07:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 7764.611639] ? __x64_sys_futex+0x78/0x1e0 Aug 22 07:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 7764.612332] ? __secure_computing+0xa9/0x120 Aug 22 07:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 7764.613037] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 07:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 7764.613815] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 7764.614572] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 7764.615319] ? do_syscall_64+0x69/0xc0 Aug 22 07:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 7764.616005] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 7764.616733] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 7764.617444] ? do_syscall_64+0x69/0xc0 Aug 22 07:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 7764.618098] ? do_syscall_64+0x69/0xc0 Aug 22 07:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 7764.618732] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 07:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 7764.619471] RIP: 0033:0x7faa5d0edaff Aug 22 07:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 7764.620168] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 07:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 7764.622251] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 07:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 7764.623185] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 07:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 7764.624101] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 07:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 7764.625023] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 07:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 7764.625933] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 07:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 7764.626900] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 07:33:10 juju-e4d256-prod-github-runner-207 kernel: [ 7764.627812] Aug 22 07:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 7792.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 7149s! [qemu-system-x86:6715] Aug 22 07:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 7792.543112] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 07:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 7792.543188] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 07:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 7792.555608] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 07:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 7792.556898] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 07:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 7792.558153] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 7792.559224] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 07:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 7792.561830] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 07:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 7792.562884] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 07:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 7792.564068] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 07:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 7792.565252] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 07:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 7792.566445] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 07:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 7792.567627] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 07:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 7792.568839] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 07:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 7792.570112] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 07:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 7792.571223] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 07:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 7792.572432] Call Trace: Aug 22 07:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 7792.573349] Aug 22 07:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 7792.574255] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 7792.575300] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 7792.576334] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 7792.577595] ? show_regs.part.0+0x23/0x29 Aug 22 07:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 7792.578623] ? show_regs.cold+0x8/0xd Aug 22 07:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 7792.579603] ? watchdog_timer_fn+0x1be/0x220 Aug 22 07:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 7792.580621] ? lockup_detector_update_enable+0x60/0x60 Aug 22 07:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 7792.581713] ? __hrtimer_run_queues+0x107/0x230 Aug 22 07:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 7792.582755] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 07:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 7792.583788] ? hrtimer_interrupt+0x101/0x220 Aug 22 07:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 7792.584813] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 07:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 7792.585911] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 07:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 7792.587113] Aug 22 07:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 7792.587987] Aug 22 07:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 7792.588833] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 07:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 7792.589904] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 7792.590956] ? _raw_spin_lock+0x22/0x30 Aug 22 07:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 7792.591914] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 7792.592941] direct_page_fault+0x206/0x310 [kvm] Aug 22 07:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 7792.593986] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 07:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 7792.595006] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 07:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 7792.596027] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 07:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 7792.597011] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 07:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 7792.597988] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 07:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 7792.598979] handle_exit+0x98/0x230 [kvm_amd] Aug 22 07:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 7792.599879] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 07:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 7792.600801] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 07:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 7792.601761] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 07:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 7792.602771] vcpu_run+0x62/0x2c0 [kvm] Aug 22 07:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 7792.603759] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 07:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 7792.604578] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 07:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 7792.605445] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 07:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 7792.606266] ? __seccomp_filter+0x4a/0x4a0 Aug 22 07:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 7792.607016] ? __fget_files+0x86/0xc0 Aug 22 07:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 7792.607730] __x64_sys_ioctl+0x95/0xd0 Aug 22 07:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 7792.608435] do_syscall_64+0x5c/0xc0 Aug 22 07:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 7792.609130] ? do_futex+0x162/0x1f0 Aug 22 07:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 7792.609823] ? __x64_sys_futex+0x78/0x1e0 Aug 22 07:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 7792.610509] ? __secure_computing+0xa9/0x120 Aug 22 07:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 7792.611210] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 07:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 7792.611983] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 7792.612714] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 7792.613455] ? do_syscall_64+0x69/0xc0 Aug 22 07:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 7792.614124] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 7792.614838] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 7792.615541] ? do_syscall_64+0x69/0xc0 Aug 22 07:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 7792.616173] ? do_syscall_64+0x69/0xc0 Aug 22 07:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 7792.616801] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 07:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 7792.617519] RIP: 0033:0x7faa5d0edaff Aug 22 07:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 7792.618165] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 07:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 7792.620208] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 07:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 7792.621132] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 07:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 7792.622052] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 07:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 7792.622972] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 07:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 7792.623906] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 07:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 7792.624813] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 07:33:38 juju-e4d256-prod-github-runner-207 kernel: [ 7792.625746] Aug 22 07:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 7820.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 7175s! [qemu-system-x86:6715] Aug 22 07:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 7820.543089] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 07:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 7820.543164] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 07:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 7820.555284] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 07:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 7820.556576] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 07:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 7820.557826] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 7820.558888] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 07:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 7820.561462] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 07:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 7820.562540] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 07:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 7820.563697] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 07:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 7820.564856] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 07:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 7820.566051] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 07:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 7820.567229] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 07:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 7820.568414] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 07:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 7820.569668] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 07:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 7820.570774] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 07:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 7820.571976] Call Trace: Aug 22 07:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 7820.572896] Aug 22 07:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 7820.573805] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 7820.574837] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 7820.575906] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 7820.577023] ? show_regs.part.0+0x23/0x29 Aug 22 07:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 7820.578054] ? show_regs.cold+0x8/0xd Aug 22 07:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 7820.579025] ? watchdog_timer_fn+0x1be/0x220 Aug 22 07:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 7820.580034] ? lockup_detector_update_enable+0x60/0x60 Aug 22 07:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 7820.581109] ? __hrtimer_run_queues+0x107/0x230 Aug 22 07:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 7820.582273] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 07:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 7820.583379] ? hrtimer_interrupt+0x101/0x220 Aug 22 07:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 7820.584506] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 07:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 7820.585856] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 07:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 7820.587064] Aug 22 07:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 7820.587986] Aug 22 07:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 7820.588958] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 07:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 7820.590223] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 7820.591265] ? _raw_spin_lock+0x22/0x30 Aug 22 07:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 7820.592216] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 7820.593243] direct_page_fault+0x206/0x310 [kvm] Aug 22 07:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 7820.594297] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 07:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 7820.595311] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 07:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 7820.596321] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 07:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 7820.597294] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 07:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 7820.598257] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 07:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 7820.599242] handle_exit+0x98/0x230 [kvm_amd] Aug 22 07:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 7820.600151] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 07:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 7820.601069] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 07:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 7820.602009] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 07:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 7820.602906] vcpu_run+0x62/0x2c0 [kvm] Aug 22 07:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 7820.603712] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 07:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 7820.604517] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 07:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 7820.605385] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 07:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 7820.606180] ? __seccomp_filter+0x4a/0x4a0 Aug 22 07:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 7820.607002] ? __fget_files+0x86/0xc0 Aug 22 07:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 7820.607708] __x64_sys_ioctl+0x95/0xd0 Aug 22 07:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 7820.608404] do_syscall_64+0x5c/0xc0 Aug 22 07:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 7820.609076] ? do_futex+0x162/0x1f0 Aug 22 07:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 7820.609736] ? __x64_sys_futex+0x78/0x1e0 Aug 22 07:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 7820.610412] ? __secure_computing+0xa9/0x120 Aug 22 07:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 7820.611104] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 07:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 7820.611869] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 7820.612590] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 7820.613311] ? do_syscall_64+0x69/0xc0 Aug 22 07:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 7820.613980] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 7820.614729] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 7820.615451] ? do_syscall_64+0x69/0xc0 Aug 22 07:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 7820.616089] ? do_syscall_64+0x69/0xc0 Aug 22 07:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 7820.616722] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 07:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 7820.617453] RIP: 0033:0x7faa5d0edaff Aug 22 07:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 7820.618091] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 07:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 7820.620170] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 07:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 7820.621099] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 07:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 7820.622010] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 07:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 7820.622904] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 07:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 7820.623800] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 07:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 7820.624718] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 07:34:06 juju-e4d256-prod-github-runner-207 kernel: [ 7820.625647] Aug 22 07:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 7848.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 7201s! [qemu-system-x86:6715] Aug 22 07:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 7848.543868] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 07:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 7848.544183] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 07:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 7848.556273] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 07:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 7848.557552] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 07:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 7848.558769] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 7848.559832] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 07:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 7848.562443] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 07:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 7848.563482] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 07:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 7848.564639] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 07:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 7848.565814] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 07:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 7848.566970] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 07:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 7848.568145] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 07:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 7848.569353] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 07:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 7848.570593] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 07:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 7848.571704] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 07:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 7848.572903] Call Trace: Aug 22 07:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 7848.573832] Aug 22 07:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 7848.574748] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 7848.575822] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 7848.576860] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 7848.577978] ? show_regs.part.0+0x23/0x29 Aug 22 07:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 7848.578973] ? show_regs.cold+0x8/0xd Aug 22 07:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 7848.579946] ? watchdog_timer_fn+0x1be/0x220 Aug 22 07:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 7848.580951] ? lockup_detector_update_enable+0x60/0x60 Aug 22 07:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 7848.582024] ? __hrtimer_run_queues+0x107/0x230 Aug 22 07:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 7848.583058] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 07:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 7848.584077] ? hrtimer_interrupt+0x101/0x220 Aug 22 07:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 7848.585143] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 07:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 7848.586228] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 07:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 7848.587272] Aug 22 07:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 7848.588124] Aug 22 07:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 7848.588972] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 07:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 7848.590007] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 7848.591044] ? _raw_spin_lock+0x22/0x30 Aug 22 07:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 7848.591988] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 7848.593012] direct_page_fault+0x206/0x310 [kvm] Aug 22 07:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 7848.594039] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 07:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 7848.595043] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 07:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 7848.596040] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 07:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 7848.597047] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 07:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 7848.597991] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 07:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 7848.598965] handle_exit+0x98/0x230 [kvm_amd] Aug 22 07:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 7848.599854] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 07:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 7848.600765] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 07:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 7848.601704] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 07:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 7848.602632] vcpu_run+0x62/0x2c0 [kvm] Aug 22 07:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 7848.603455] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 07:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 7848.604262] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 07:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 7848.605169] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 07:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 7848.605969] ? __seccomp_filter+0x4a/0x4a0 Aug 22 07:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 7848.606709] ? __fget_files+0x86/0xc0 Aug 22 07:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 7848.607411] __x64_sys_ioctl+0x95/0xd0 Aug 22 07:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 7848.608105] do_syscall_64+0x5c/0xc0 Aug 22 07:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 7848.608767] ? do_futex+0x162/0x1f0 Aug 22 07:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 7848.609432] ? __x64_sys_futex+0x78/0x1e0 Aug 22 07:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 7848.610109] ? __secure_computing+0xa9/0x120 Aug 22 07:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 7848.610809] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 07:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 7848.611566] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 7848.612288] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 7848.613017] ? do_syscall_64+0x69/0xc0 Aug 22 07:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 7848.613658] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 7848.614356] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 7848.615068] ? do_syscall_64+0x69/0xc0 Aug 22 07:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 7848.615694] ? do_syscall_64+0x69/0xc0 Aug 22 07:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 7848.616319] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 07:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 7848.617029] RIP: 0033:0x7faa5d0edaff Aug 22 07:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 7848.617678] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 07:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 7848.619667] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 07:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 7848.620582] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 07:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 7848.621500] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 07:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 7848.622402] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 07:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 7848.623291] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 07:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 7848.624175] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 07:34:34 juju-e4d256-prod-github-runner-207 kernel: [ 7848.625078] Aug 22 07:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 7876.541983] watchdog: BUG: soft lockup - CPU#1 stuck for 7227s! [qemu-system-x86:6715] Aug 22 07:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 7876.543717] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 07:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 7876.543813] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 07:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 7876.557530] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 07:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 7876.558825] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 07:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 7876.560067] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 7876.561168] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 07:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 7876.563757] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 07:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 7876.564818] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 07:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 7876.565980] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 07:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 7876.567139] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 07:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 7876.568303] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 07:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 7876.569484] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 07:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 7876.570662] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 07:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 7876.571901] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 07:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 7876.573006] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 07:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 7876.574207] Call Trace: Aug 22 07:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 7876.575205] Aug 22 07:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 7876.576332] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 7876.577559] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 7876.578584] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 7876.579657] ? show_regs.part.0+0x23/0x29 Aug 22 07:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 7876.580668] ? show_regs.cold+0x8/0xd Aug 22 07:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 7876.581643] ? watchdog_timer_fn+0x1be/0x220 Aug 22 07:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 7876.582653] ? lockup_detector_update_enable+0x60/0x60 Aug 22 07:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 7876.583721] ? __hrtimer_run_queues+0x107/0x230 Aug 22 07:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 7876.584765] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 07:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 7876.585789] ? hrtimer_interrupt+0x101/0x220 Aug 22 07:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 7876.586804] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 07:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 7876.587874] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 07:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 7876.588925] Aug 22 07:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 7876.589783] Aug 22 07:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 7876.590620] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 07:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 7876.591655] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 7876.592708] ? _raw_spin_lock+0x22/0x30 Aug 22 07:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 7876.593660] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 7876.594677] direct_page_fault+0x206/0x310 [kvm] Aug 22 07:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 7876.595701] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 07:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 7876.596728] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 07:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 7876.597732] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 07:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 7876.598707] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 07:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 7876.599654] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 07:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 7876.600647] handle_exit+0x98/0x230 [kvm_amd] Aug 22 07:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 7876.601544] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 07:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 7876.602466] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 07:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 7876.603394] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 07:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 7876.604301] vcpu_run+0x62/0x2c0 [kvm] Aug 22 07:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 7876.605170] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 07:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 7876.606018] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 07:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 7876.606884] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 07:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 7876.607681] ? __seccomp_filter+0x4a/0x4a0 Aug 22 07:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 7876.608428] ? __fget_files+0x86/0xc0 Aug 22 07:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 7876.609142] __x64_sys_ioctl+0x95/0xd0 Aug 22 07:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 7876.609835] do_syscall_64+0x5c/0xc0 Aug 22 07:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 7876.610586] ? do_futex+0x162/0x1f0 Aug 22 07:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 7876.611300] ? __x64_sys_futex+0x78/0x1e0 Aug 22 07:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 7876.611978] ? __secure_computing+0xa9/0x120 Aug 22 07:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 7876.612694] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 07:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 7876.613471] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 7876.614213] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 7876.614941] ? do_syscall_64+0x69/0xc0 Aug 22 07:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 7876.615594] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 7876.616299] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 7876.617029] ? do_syscall_64+0x69/0xc0 Aug 22 07:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 7876.617666] ? do_syscall_64+0x69/0xc0 Aug 22 07:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 7876.618291] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 07:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 7876.619000] RIP: 0033:0x7faa5d0edaff Aug 22 07:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 7876.619646] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 07:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 7876.621678] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 07:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 7876.622588] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 07:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 7876.623477] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 07:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 7876.624368] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 07:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 7876.625266] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 07:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 7876.626152] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 07:35:02 juju-e4d256-prod-github-runner-207 kernel: [ 7876.627043] Aug 22 07:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 7904.541981] watchdog: BUG: soft lockup - CPU#1 stuck for 7253s! [qemu-system-x86:6715] Aug 22 07:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 7904.543117] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 07:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 7904.543190] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 07:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 7904.555624] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 07:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 7904.557004] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 07:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 7904.558303] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 7904.559544] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 07:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 7904.562808] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 07:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 7904.563920] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 07:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 7904.565108] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 07:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 7904.566266] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 07:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 7904.567424] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 07:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 7904.568598] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 07:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 7904.569762] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 07:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 7904.570995] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 07:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 7904.572098] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 07:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 7904.573298] Call Trace: Aug 22 07:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 7904.574212] Aug 22 07:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 7904.575093] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 7904.576125] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 7904.577155] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 7904.578231] ? show_regs.part.0+0x23/0x29 Aug 22 07:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 7904.579229] ? show_regs.cold+0x8/0xd Aug 22 07:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 7904.580201] ? watchdog_timer_fn+0x1be/0x220 Aug 22 07:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 7904.581211] ? lockup_detector_update_enable+0x60/0x60 Aug 22 07:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 7904.582270] ? __hrtimer_run_queues+0x107/0x230 Aug 22 07:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 7904.583332] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 07:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 7904.584389] ? hrtimer_interrupt+0x101/0x220 Aug 22 07:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 7904.585408] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 07:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 7904.586473] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 07:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 7904.587534] Aug 22 07:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 7904.588432] Aug 22 07:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 7904.589269] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 07:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 7904.590299] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 7904.591338] ? _raw_spin_lock+0x22/0x30 Aug 22 07:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 7904.592294] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 7904.593345] direct_page_fault+0x206/0x310 [kvm] Aug 22 07:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 7904.594372] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 07:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 7904.595394] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 07:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 7904.596450] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 07:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 7904.597480] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 07:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 7904.598447] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 07:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 7904.599433] handle_exit+0x98/0x230 [kvm_amd] Aug 22 07:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 7904.600341] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 07:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 7904.601267] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 07:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 7904.602212] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 07:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 7904.603133] vcpu_run+0x62/0x2c0 [kvm] Aug 22 07:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 7904.603961] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 07:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 7904.604799] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 07:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 7904.605695] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 07:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 7904.606497] ? __seccomp_filter+0x4a/0x4a0 Aug 22 07:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 7904.607244] ? __fget_files+0x86/0xc0 Aug 22 07:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 7904.607952] __x64_sys_ioctl+0x95/0xd0 Aug 22 07:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 7904.608874] do_syscall_64+0x5c/0xc0 Aug 22 07:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 7904.609541] ? do_futex+0x162/0x1f0 Aug 22 07:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 7904.610190] ? __x64_sys_futex+0x78/0x1e0 Aug 22 07:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 7904.610864] ? __secure_computing+0xa9/0x120 Aug 22 07:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 7904.611553] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 07:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 7904.612326] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 7904.613051] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 7904.613769] ? do_syscall_64+0x69/0xc0 Aug 22 07:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 7904.614414] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 7904.615115] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 7904.615815] ? do_syscall_64+0x69/0xc0 Aug 22 07:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 7904.616456] ? do_syscall_64+0x69/0xc0 Aug 22 07:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 7904.617078] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 07:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 7904.617785] RIP: 0033:0x7faa5d0edaff Aug 22 07:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 7904.618412] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 07:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 7904.620450] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 07:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 7904.621372] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 07:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 7904.622261] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 07:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 7904.623148] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 07:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 7904.624040] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 07:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 7904.624941] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 07:35:30 juju-e4d256-prod-github-runner-207 kernel: [ 7904.625833] Aug 22 07:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 7917.716711] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 07:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 7917.717770] rcu: 1-....: (1944012 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=942764 Aug 22 07:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 7917.719033] (t=1950129 jiffies g=23269 q=16715) Aug 22 07:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 7917.719867] NMI backtrace for cpu 1 Aug 22 07:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 7917.720596] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 07:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 7917.721761] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 07:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 7917.722830] Call Trace: Aug 22 07:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 7917.723509] Aug 22 07:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 7917.724178] show_stack+0x52/0x5c Aug 22 07:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 7917.724906] dump_stack_lvl+0x4a/0x63 Aug 22 07:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 7917.725652] dump_stack+0x10/0x16 Aug 22 07:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 7917.726365] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 07:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 7917.727357] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 07:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 7917.728170] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 07:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 7917.729003] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 07:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 7917.729876] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 07:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 7917.730688] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 07:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 7917.731460] print_cpu_stall.cold+0x2f/0xe2 Aug 22 07:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 7917.732248] ? timekeeping_update+0xf7/0x150 Aug 22 07:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 7917.733022] check_cpu_stall+0x109/0x270 Aug 22 07:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 7917.733795] rcu_sched_clock_irq+0x9a/0x250 Aug 22 07:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 7917.734558] update_process_times+0x94/0xd0 Aug 22 07:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 7917.735314] tick_sched_handle+0x29/0x70 Aug 22 07:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 7917.736086] tick_sched_timer+0x8c/0xc0 Aug 22 07:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 7917.736864] ? tick_nohz_handler+0xb0/0xb0 Aug 22 07:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 7917.737648] __hrtimer_run_queues+0x107/0x230 Aug 22 07:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 7917.738433] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 07:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 7917.739210] hrtimer_interrupt+0x101/0x220 Aug 22 07:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 7917.740240] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 07:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 7917.741062] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 07:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 7917.741897] Aug 22 07:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 7917.742534] Aug 22 07:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 7917.743173] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 07:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 7917.744014] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 7917.744921] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 07:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 7917.747183] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 07:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 7917.748115] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 07:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 7917.749116] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 07:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 7917.750118] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 07:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 7917.751177] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 07:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 7917.752506] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 07:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 7917.753801] ? _raw_spin_lock+0x22/0x30 Aug 22 07:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 7917.754865] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 7917.756174] direct_page_fault+0x206/0x310 [kvm] Aug 22 07:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 7917.757468] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 07:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 7917.758611] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 07:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 7917.759792] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 07:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 7917.760883] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 07:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 7917.761959] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 07:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 7917.762893] handle_exit+0x98/0x230 [kvm_amd] Aug 22 07:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 7917.763658] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 07:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 7917.764477] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 07:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 7917.765287] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 07:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 7917.766084] vcpu_run+0x62/0x2c0 [kvm] Aug 22 07:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 7917.766814] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 07:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 7917.767585] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 07:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 7917.768413] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 07:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 7917.769185] ? __seccomp_filter+0x4a/0x4a0 Aug 22 07:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 7917.770108] ? __fget_files+0x86/0xc0 Aug 22 07:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 7917.771119] __x64_sys_ioctl+0x95/0xd0 Aug 22 07:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 7917.772087] do_syscall_64+0x5c/0xc0 Aug 22 07:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 7917.772981] ? do_futex+0x162/0x1f0 Aug 22 07:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 7917.773874] ? __x64_sys_futex+0x78/0x1e0 Aug 22 07:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 7917.774806] ? __secure_computing+0xa9/0x120 Aug 22 07:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 7917.775767] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 07:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 7917.776833] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 7917.777838] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 7917.778842] ? do_syscall_64+0x69/0xc0 Aug 22 07:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 7917.779756] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 7917.780684] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 7917.781494] ? do_syscall_64+0x69/0xc0 Aug 22 07:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 7917.782215] ? do_syscall_64+0x69/0xc0 Aug 22 07:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 7917.782925] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 07:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 7917.783907] RIP: 0033:0x7faa5d0edaff Aug 22 07:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 7917.784884] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 07:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 7917.787049] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 07:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 7917.788024] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 07:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 7917.789043] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 07:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 7917.790012] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 07:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 7917.790991] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 07:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 7917.792043] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 07:35:43 juju-e4d256-prod-github-runner-207 kernel: [ 7917.793061] Aug 22 07:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 7944.541982] watchdog: BUG: soft lockup - CPU#1 stuck for 7290s! [qemu-system-x86:6715] Aug 22 07:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 7944.543915] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 07:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 7944.544194] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 07:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 7944.557485] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 07:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 7944.558949] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 07:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 7944.560346] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 7944.561471] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 07:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 7944.564229] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 07:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 7944.565317] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 07:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 7944.566567] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 07:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 7944.567834] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 07:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 7944.569061] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 07:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 7944.570278] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 07:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 7944.571525] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 07:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 7944.573456] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 07:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 7944.575358] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 07:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 7944.577324] Call Trace: Aug 22 07:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 7944.578824] Aug 22 07:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 7944.580282] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 7944.581986] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 7944.583670] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 7944.585656] ? show_regs.part.0+0x23/0x29 Aug 22 07:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 7944.587450] ? show_regs.cold+0x8/0xd Aug 22 07:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 7944.589014] ? watchdog_timer_fn+0x1be/0x220 Aug 22 07:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 7944.590598] ? lockup_detector_update_enable+0x60/0x60 Aug 22 07:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 7944.592290] ? __hrtimer_run_queues+0x107/0x230 Aug 22 07:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 7944.593915] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 07:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 7944.595560] ? hrtimer_interrupt+0x101/0x220 Aug 22 07:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 7944.597293] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 07:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 7944.599018] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 07:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 7944.600722] Aug 22 07:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 7944.602167] Aug 22 07:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 7944.603601] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 07:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 7944.605301] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 7944.606988] ? _raw_spin_lock+0x22/0x30 Aug 22 07:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 7944.608621] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 7944.610382] direct_page_fault+0x206/0x310 [kvm] Aug 22 07:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 7944.612216] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 07:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 7944.613871] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 07:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 7944.615628] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 07:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 7944.617287] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 07:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 7944.618721] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 07:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 7944.620294] handle_exit+0x98/0x230 [kvm_amd] Aug 22 07:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 7944.621705] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 07:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 7944.623168] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 07:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 7944.624683] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 07:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 7944.626077] vcpu_run+0x62/0x2c0 [kvm] Aug 22 07:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 7944.627374] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 07:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 7944.628631] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 07:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 7944.629956] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 07:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 7944.631194] ? __seccomp_filter+0x4a/0x4a0 Aug 22 07:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 7944.632436] ? __fget_files+0x86/0xc0 Aug 22 07:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 7944.633537] __x64_sys_ioctl+0x95/0xd0 Aug 22 07:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 7944.634399] do_syscall_64+0x5c/0xc0 Aug 22 07:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 7944.635210] ? do_futex+0x162/0x1f0 Aug 22 07:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 7944.636028] ? __x64_sys_futex+0x78/0x1e0 Aug 22 07:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 7944.636782] ? __secure_computing+0xa9/0x120 Aug 22 07:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 7944.637630] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 07:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 7944.638427] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 7944.639168] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 7944.639938] ? do_syscall_64+0x69/0xc0 Aug 22 07:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 7944.640603] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 7944.641324] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 7944.642039] ? do_syscall_64+0x69/0xc0 Aug 22 07:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 7944.642678] ? do_syscall_64+0x69/0xc0 Aug 22 07:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 7944.643316] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 07:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 7944.644168] RIP: 0033:0x7faa5d0edaff Aug 22 07:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 7944.644875] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 07:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 7944.646926] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 07:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 7944.647888] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 07:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 7944.648817] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 07:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 7944.649736] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 07:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 7944.650652] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 07:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 7944.651569] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 07:36:10 juju-e4d256-prod-github-runner-207 kernel: [ 7944.652549] Aug 22 07:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 7972.541976] watchdog: BUG: soft lockup - CPU#1 stuck for 7317s! [qemu-system-x86:6715] Aug 22 07:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 7972.543119] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 07:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 7972.543188] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 07:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 7972.555776] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 07:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 7972.557078] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 07:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 7972.558335] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 7972.559433] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 07:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 7972.562068] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 07:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 7972.563160] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 07:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 7972.564383] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 07:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 7972.565566] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 07:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 7972.566745] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 07:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 7972.567972] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 07:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 7972.569213] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 07:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 7972.570460] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 07:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 7972.571605] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 07:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 7972.572826] Call Trace: Aug 22 07:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 7972.573765] Aug 22 07:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 7972.574669] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 7972.575996] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 7972.577059] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 7972.578150] ? show_regs.part.0+0x23/0x29 Aug 22 07:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 7972.579163] ? show_regs.cold+0x8/0xd Aug 22 07:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 7972.580165] ? watchdog_timer_fn+0x1be/0x220 Aug 22 07:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 7972.581191] ? lockup_detector_update_enable+0x60/0x60 Aug 22 07:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 7972.582419] ? __hrtimer_run_queues+0x107/0x230 Aug 22 07:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 7972.583495] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 07:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 7972.584540] ? hrtimer_interrupt+0x101/0x220 Aug 22 07:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 7972.585572] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 07:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 7972.586653] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 07:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 7972.587927] Aug 22 07:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 7972.588793] Aug 22 07:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 7972.589641] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 07:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 7972.590698] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 7972.591783] ? _raw_spin_lock+0x22/0x30 Aug 22 07:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 7972.592750] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 7972.593797] direct_page_fault+0x206/0x310 [kvm] Aug 22 07:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 7972.595020] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 07:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 7972.596071] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 07:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 7972.597091] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 07:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 7972.598088] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 07:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 7972.599049] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 07:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 7972.600085] handle_exit+0x98/0x230 [kvm_amd] Aug 22 07:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 7972.600991] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 07:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 7972.601925] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 07:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 7972.602866] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 07:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 7972.603818] vcpu_run+0x62/0x2c0 [kvm] Aug 22 07:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 7972.604644] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 07:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 7972.605466] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 07:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 7972.606339] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 07:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 7972.607150] ? __seccomp_filter+0x4a/0x4a0 Aug 22 07:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 7972.607916] ? __fget_files+0x86/0xc0 Aug 22 07:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 7972.608637] __x64_sys_ioctl+0x95/0xd0 Aug 22 07:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 7972.609349] do_syscall_64+0x5c/0xc0 Aug 22 07:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 7972.610240] ? do_futex+0x162/0x1f0 Aug 22 07:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 7972.611138] ? __x64_sys_futex+0x78/0x1e0 Aug 22 07:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 7972.612078] ? __secure_computing+0xa9/0x120 Aug 22 07:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 7972.612854] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 07:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 7972.613633] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 7972.614375] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 7972.615115] ? do_syscall_64+0x69/0xc0 Aug 22 07:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 7972.615852] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 7972.616567] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 7972.617278] ? do_syscall_64+0x69/0xc0 Aug 22 07:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 7972.617912] ? do_syscall_64+0x69/0xc0 Aug 22 07:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 7972.618548] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 07:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 7972.619314] RIP: 0033:0x7faa5d0edaff Aug 22 07:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 7972.620079] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 07:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 7972.622226] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 07:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 7972.623196] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 07:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 7972.624149] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 07:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 7972.625138] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 07:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 7972.626058] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 07:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 7972.626970] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 07:36:38 juju-e4d256-prod-github-runner-207 kernel: [ 7972.627921] Aug 22 07:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 8000.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 7343s! [qemu-system-x86:6715] Aug 22 07:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 8000.543134] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 07:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 8000.543214] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 07:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 8000.555742] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 07:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 8000.557043] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 07:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 8000.558261] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 8000.559335] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 07:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 8000.561873] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 07:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 8000.562921] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 07:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 8000.564096] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 07:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 8000.565259] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 07:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 8000.566422] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 07:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 8000.567599] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 07:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 8000.568768] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 07:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 8000.569998] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 07:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 8000.571267] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 07:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 8000.572611] Call Trace: Aug 22 07:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 8000.573597] Aug 22 07:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 8000.574530] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 8000.575672] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 8000.576803] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 8000.577974] ? show_regs.part.0+0x23/0x29 Aug 22 07:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 8000.579073] ? show_regs.cold+0x8/0xd Aug 22 07:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 8000.580118] ? watchdog_timer_fn+0x1be/0x220 Aug 22 07:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 8000.581246] ? lockup_detector_update_enable+0x60/0x60 Aug 22 07:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 8000.582459] ? __hrtimer_run_queues+0x107/0x230 Aug 22 07:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 8000.583823] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 07:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 8000.584967] ? hrtimer_interrupt+0x101/0x220 Aug 22 07:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 8000.586095] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 07:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 8000.587329] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 07:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 8000.588475] Aug 22 07:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 8000.589381] Aug 22 07:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 8000.590267] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 07:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 8000.591432] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 8000.592576] ? _raw_spin_lock+0x22/0x30 Aug 22 07:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 8000.593604] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 8000.594727] direct_page_fault+0x206/0x310 [kvm] Aug 22 07:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 8000.595898] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 07:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 8000.597036] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 07:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 8000.598141] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 07:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 8000.599228] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 07:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 8000.600286] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 07:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 8000.601391] handle_exit+0x98/0x230 [kvm_amd] Aug 22 07:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 8000.602385] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 07:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 8000.603405] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 07:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 8000.604424] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 07:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 8000.605437] vcpu_run+0x62/0x2c0 [kvm] Aug 22 07:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 8000.606329] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 07:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 8000.607266] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 07:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 8000.608234] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 07:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 8000.609130] ? __seccomp_filter+0x4a/0x4a0 Aug 22 07:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 8000.609958] ? __fget_files+0x86/0xc0 Aug 22 07:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 8000.610741] __x64_sys_ioctl+0x95/0xd0 Aug 22 07:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 8000.611533] do_syscall_64+0x5c/0xc0 Aug 22 07:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 8000.612284] ? do_futex+0x162/0x1f0 Aug 22 07:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 8000.613010] ? __x64_sys_futex+0x78/0x1e0 Aug 22 07:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 8000.613773] ? __secure_computing+0xa9/0x120 Aug 22 07:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 8000.614551] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 07:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 8000.615436] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 8000.616259] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 8000.617082] ? do_syscall_64+0x69/0xc0 Aug 22 07:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 8000.617809] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 8000.618611] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 8000.619417] ? do_syscall_64+0x69/0xc0 Aug 22 07:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 8000.620129] ? do_syscall_64+0x69/0xc0 Aug 22 07:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 8000.620836] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 07:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 8000.621676] RIP: 0033:0x7faa5d0edaff Aug 22 07:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 8000.622388] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 07:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 8000.624923] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 07:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 8000.626001] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 07:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 8000.627047] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 07:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 8000.628101] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 07:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 8000.629140] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 07:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 8000.630240] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 07:37:06 juju-e4d256-prod-github-runner-207 kernel: [ 8000.631368] Aug 22 07:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 8028.541982] watchdog: BUG: soft lockup - CPU#1 stuck for 7369s! [qemu-system-x86:6715] Aug 22 07:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 8028.543341] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 07:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 8028.543517] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 07:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 8028.556341] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 07:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 8028.557645] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 07:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 8028.558942] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 8028.560099] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 07:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 8028.562812] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 07:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 8028.563975] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 07:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 8028.565348] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 07:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 8028.566737] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 07:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 8028.568140] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 07:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 8028.569451] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 07:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 8028.570852] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 07:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 8028.572435] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 07:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 8028.573639] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 07:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 8028.574993] Call Trace: Aug 22 07:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 8028.576061] Aug 22 07:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 8028.577049] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 8028.578201] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 8028.579377] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 8028.580620] ? show_regs.part.0+0x23/0x29 Aug 22 07:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 8028.581780] ? show_regs.cold+0x8/0xd Aug 22 07:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 8028.583006] ? watchdog_timer_fn+0x1be/0x220 Aug 22 07:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 8028.584148] ? lockup_detector_update_enable+0x60/0x60 Aug 22 07:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 8028.585288] ? __hrtimer_run_queues+0x107/0x230 Aug 22 07:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 8028.586443] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 07:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 8028.587620] ? hrtimer_interrupt+0x101/0x220 Aug 22 07:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 8028.588752] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 07:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 8028.589927] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 07:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 8028.591070] Aug 22 07:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 8028.592020] Aug 22 07:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 8028.592951] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 07:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 8028.594090] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 8028.595330] ? _raw_spin_lock+0x22/0x30 Aug 22 07:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 8028.596513] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 8028.597751] direct_page_fault+0x206/0x310 [kvm] Aug 22 07:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 8028.598909] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 07:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 8028.600023] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 07:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 8028.601165] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 07:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 8028.602259] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 07:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 8028.603317] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 07:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 8028.604374] handle_exit+0x98/0x230 [kvm_amd] Aug 22 07:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 8028.605317] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 07:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 8028.606290] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 07:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 8028.607268] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 07:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 8028.608204] vcpu_run+0x62/0x2c0 [kvm] Aug 22 07:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 8028.609055] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 07:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 8028.609912] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 07:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 8028.611015] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 07:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 8028.611970] ? __seccomp_filter+0x4a/0x4a0 Aug 22 07:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 8028.612860] ? __fget_files+0x86/0xc0 Aug 22 07:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 8028.613739] __x64_sys_ioctl+0x95/0xd0 Aug 22 07:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 8028.614604] do_syscall_64+0x5c/0xc0 Aug 22 07:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 8028.615435] ? do_futex+0x162/0x1f0 Aug 22 07:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 8028.616164] ? __x64_sys_futex+0x78/0x1e0 Aug 22 07:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 8028.617002] ? __secure_computing+0xa9/0x120 Aug 22 07:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 8028.617754] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 07:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 8028.618541] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 8028.619311] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 8028.620052] ? do_syscall_64+0x69/0xc0 Aug 22 07:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 8028.620717] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 8028.621458] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 8028.622181] ? do_syscall_64+0x69/0xc0 Aug 22 07:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 8028.622846] ? do_syscall_64+0x69/0xc0 Aug 22 07:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 8028.623487] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 07:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 8028.624250] RIP: 0033:0x7faa5d0edaff Aug 22 07:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 8028.624887] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 07:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 8028.626965] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 07:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 8028.627899] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 07:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 8028.628814] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 07:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 8028.629725] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 07:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 8028.630936] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 07:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 8028.632131] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 07:37:34 juju-e4d256-prod-github-runner-207 kernel: [ 8028.633127] Aug 22 07:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 8056.541990] watchdog: BUG: soft lockup - CPU#1 stuck for 7395s! [qemu-system-x86:6715] Aug 22 07:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 8056.544958] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 07:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 8056.545215] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 07:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 8056.558403] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 07:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 8056.559760] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 07:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 8056.561207] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 8056.562356] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 07:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 8056.565061] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 07:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 8056.566133] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 07:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 8056.567420] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 07:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 8056.568617] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 07:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 8056.569843] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 07:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 8056.571134] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 07:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 8056.572362] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 07:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 8056.573648] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 07:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 8056.574823] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 07:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 8056.576113] Call Trace: Aug 22 07:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 8056.577053] Aug 22 07:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 8056.577982] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 8056.579076] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 8056.580147] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 8056.581308] ? show_regs.part.0+0x23/0x29 Aug 22 07:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 8056.582346] ? show_regs.cold+0x8/0xd Aug 22 07:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 8056.583332] ? watchdog_timer_fn+0x1be/0x220 Aug 22 07:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 8056.584381] ? lockup_detector_update_enable+0x60/0x60 Aug 22 07:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 8056.585519] ? __hrtimer_run_queues+0x107/0x230 Aug 22 07:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 8056.586643] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 07:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 8056.587717] ? hrtimer_interrupt+0x101/0x220 Aug 22 07:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 8056.588759] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 07:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 8056.589901] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 07:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 8056.591072] Aug 22 07:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 8056.591980] Aug 22 07:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 8056.592845] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 07:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 8056.593948] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 8056.595067] ? _raw_spin_lock+0x22/0x30 Aug 22 07:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 8056.596066] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 8056.597247] direct_page_fault+0x206/0x310 [kvm] Aug 22 07:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 8056.598327] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 07:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 8056.599358] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 07:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 8056.600664] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 07:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 8056.601740] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 07:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 8056.602730] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 07:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 8056.603734] handle_exit+0x98/0x230 [kvm_amd] Aug 22 07:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 8056.604650] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 07:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 8056.605593] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 07:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 8056.606568] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 07:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 8056.607558] vcpu_run+0x62/0x2c0 [kvm] Aug 22 07:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 8056.608383] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 07:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 8056.609209] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 07:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 8056.610082] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 07:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 8056.610920] ? __seccomp_filter+0x4a/0x4a0 Aug 22 07:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 8056.611706] ? __fget_files+0x86/0xc0 Aug 22 07:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 8056.612443] __x64_sys_ioctl+0x95/0xd0 Aug 22 07:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 8056.613191] do_syscall_64+0x5c/0xc0 Aug 22 07:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 8056.613884] ? do_futex+0x162/0x1f0 Aug 22 07:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 8056.614629] ? __x64_sys_futex+0x78/0x1e0 Aug 22 07:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 8056.615341] ? __secure_computing+0xa9/0x120 Aug 22 07:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 8056.616060] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 07:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 8056.616848] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 8056.617612] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 8056.618411] ? do_syscall_64+0x69/0xc0 Aug 22 07:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 8056.619120] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 8056.619847] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 8056.620578] ? do_syscall_64+0x69/0xc0 Aug 22 07:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 8056.621254] ? do_syscall_64+0x69/0xc0 Aug 22 07:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 8056.621920] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 07:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 8056.622703] RIP: 0033:0x7faa5d0edaff Aug 22 07:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 8056.623398] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 07:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 8056.625467] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 07:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 8056.626430] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 07:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 8056.627357] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 07:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 8056.628298] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 07:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 8056.629226] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 07:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 8056.630166] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 07:38:02 juju-e4d256-prod-github-runner-207 kernel: [ 8056.631120] Aug 22 07:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 8084.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 7421s! [qemu-system-x86:6715] Aug 22 07:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 8084.543120] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 07:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 8084.543194] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 07:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 8084.555545] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 07:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 8084.556837] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 07:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 8084.558088] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 8084.559187] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 07:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 8084.561771] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 07:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 8084.562846] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 07:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 8084.564043] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 07:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 8084.565210] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 07:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 8084.566395] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 07:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 8084.567582] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 07:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 8084.568758] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 07:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 8084.570046] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 07:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 8084.571155] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 07:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 8084.572365] Call Trace: Aug 22 07:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 8084.573495] Aug 22 07:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 8084.574432] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 8084.575464] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 8084.576514] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 8084.577593] ? show_regs.part.0+0x23/0x29 Aug 22 07:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 8084.578610] ? show_regs.cold+0x8/0xd Aug 22 07:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 8084.579606] ? watchdog_timer_fn+0x1be/0x220 Aug 22 07:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 8084.580649] ? lockup_detector_update_enable+0x60/0x60 Aug 22 07:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 8084.581712] ? __hrtimer_run_queues+0x107/0x230 Aug 22 07:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 8084.582780] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 07:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 8084.583805] ? hrtimer_interrupt+0x101/0x220 Aug 22 07:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 8084.584849] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 07:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 8084.586011] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 07:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 8084.587065] Aug 22 07:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 8084.587922] Aug 22 07:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 8084.588781] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 07:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 8084.589825] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 8084.590918] ? _raw_spin_lock+0x22/0x30 Aug 22 07:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 8084.591892] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 8084.592930] direct_page_fault+0x206/0x310 [kvm] Aug 22 07:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 8084.593999] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 07:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 8084.595060] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 07:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 8084.596069] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 07:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 8084.597045] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 07:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 8084.598033] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 07:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 8084.599036] handle_exit+0x98/0x230 [kvm_amd] Aug 22 07:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 8084.599969] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 07:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 8084.600898] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 07:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 8084.601835] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 07:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 8084.602801] vcpu_run+0x62/0x2c0 [kvm] Aug 22 07:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 8084.603636] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 07:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 8084.604453] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 07:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 8084.605313] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 07:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 8084.606151] ? __seccomp_filter+0x4a/0x4a0 Aug 22 07:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 8084.606915] ? __fget_files+0x86/0xc0 Aug 22 07:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 8084.607631] __x64_sys_ioctl+0x95/0xd0 Aug 22 07:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 8084.608335] do_syscall_64+0x5c/0xc0 Aug 22 07:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 8084.609005] ? do_futex+0x162/0x1f0 Aug 22 07:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 8084.609658] ? __x64_sys_futex+0x78/0x1e0 Aug 22 07:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 8084.610390] ? __secure_computing+0xa9/0x120 Aug 22 07:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 8084.611083] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 07:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 8084.611843] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 8084.612564] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 8084.613300] ? do_syscall_64+0x69/0xc0 Aug 22 07:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 8084.613965] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 8084.614673] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 8084.615372] ? do_syscall_64+0x69/0xc0 Aug 22 07:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 8084.616010] ? do_syscall_64+0x69/0xc0 Aug 22 07:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 8084.616664] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 07:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 8084.617372] RIP: 0033:0x7faa5d0edaff Aug 22 07:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 8084.618099] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 07:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 8084.620122] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 07:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 8084.621043] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 07:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 8084.622077] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 07:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 8084.622979] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 07:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 8084.623883] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 07:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 8084.624892] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 07:38:30 juju-e4d256-prod-github-runner-207 kernel: [ 8084.625792] Aug 22 07:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 8097.728709] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 07:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 8097.729712] rcu: 1-....: (1988866 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=963927 Aug 22 07:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 8097.730941] (t=1995132 jiffies g=23269 q=16878) Aug 22 07:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 8097.731773] NMI backtrace for cpu 1 Aug 22 07:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 8097.732512] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 07:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 8097.733654] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 07:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 8097.734784] Call Trace: Aug 22 07:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 8097.735482] Aug 22 07:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 8097.736144] show_stack+0x52/0x5c Aug 22 07:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 8097.737104] dump_stack_lvl+0x4a/0x63 Aug 22 07:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 8097.738202] dump_stack+0x10/0x16 Aug 22 07:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 8097.738970] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 07:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 8097.739781] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 07:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 8097.740674] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 07:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 8097.741548] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 07:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 8097.742428] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 07:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 8097.743454] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 07:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 8097.744242] print_cpu_stall.cold+0x2f/0xe2 Aug 22 07:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 8097.745027] ? timekeeping_update+0xf7/0x150 Aug 22 07:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 8097.745985] check_cpu_stall+0x109/0x270 Aug 22 07:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 8097.746785] rcu_sched_clock_irq+0x9a/0x250 Aug 22 07:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 8097.747562] update_process_times+0x94/0xd0 Aug 22 07:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 8097.748342] tick_sched_handle+0x29/0x70 Aug 22 07:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 8097.749102] tick_sched_timer+0x8c/0xc0 Aug 22 07:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 8097.749908] ? tick_nohz_handler+0xb0/0xb0 Aug 22 07:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 8097.750720] __hrtimer_run_queues+0x107/0x230 Aug 22 07:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 8097.751516] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 07:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 8097.752309] hrtimer_interrupt+0x101/0x220 Aug 22 07:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 8097.753084] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 07:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 8097.753925] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 07:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 8097.754748] Aug 22 07:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 8097.755434] Aug 22 07:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 8097.756098] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 07:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 8097.756964] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 8097.757903] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 07:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 8097.760202] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 07:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 8097.761208] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 07:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 8097.762305] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 07:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 8097.763383] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 07:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 8097.764423] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 07:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 8097.765645] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 07:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 8097.766701] ? _raw_spin_lock+0x22/0x30 Aug 22 07:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 8097.767531] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 8097.768417] direct_page_fault+0x206/0x310 [kvm] Aug 22 07:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 8097.769297] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 07:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 8097.770180] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 07:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 8097.771087] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 07:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 8097.771977] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 07:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 8097.772815] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 07:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 8097.773681] handle_exit+0x98/0x230 [kvm_amd] Aug 22 07:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 8097.774492] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 07:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 8097.775352] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 07:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 8097.776246] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 07:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 8097.777083] vcpu_run+0x62/0x2c0 [kvm] Aug 22 07:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 8097.777862] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 07:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 8097.778643] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 07:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 8097.779487] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 07:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 8097.780319] ? __seccomp_filter+0x4a/0x4a0 Aug 22 07:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 8097.781084] ? __fget_files+0x86/0xc0 Aug 22 07:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 8097.781858] __x64_sys_ioctl+0x95/0xd0 Aug 22 07:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 8097.782605] do_syscall_64+0x5c/0xc0 Aug 22 07:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 8097.783332] ? do_futex+0x162/0x1f0 Aug 22 07:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 8097.784042] ? __x64_sys_futex+0x78/0x1e0 Aug 22 07:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 8097.784799] ? __secure_computing+0xa9/0x120 Aug 22 07:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 8097.785637] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 07:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 8097.786556] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 8097.787430] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 8097.788261] ? do_syscall_64+0x69/0xc0 Aug 22 07:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 8097.789009] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 8097.789879] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 8097.790732] ? do_syscall_64+0x69/0xc0 Aug 22 07:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 8097.791529] ? do_syscall_64+0x69/0xc0 Aug 22 07:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 8097.792328] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 07:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 8097.793186] RIP: 0033:0x7faa5d0edaff Aug 22 07:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 8097.793987] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 07:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 8097.796425] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 07:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 8097.797549] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 07:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 8097.798822] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 07:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 8097.799869] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 07:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 8097.801095] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 07:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 8097.802133] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 07:38:43 juju-e4d256-prod-github-runner-207 kernel: [ 8097.803125] Aug 22 07:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 8124.541981] watchdog: BUG: soft lockup - CPU#1 stuck for 7458s! [qemu-system-x86:6715] Aug 22 07:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 8124.544075] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 07:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 8124.544440] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 07:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 8124.558245] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 07:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 8124.559673] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 07:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 8124.560959] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 8124.562167] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 07:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 8124.565096] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 07:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 8124.566374] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 07:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 8124.567545] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 07:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 8124.568792] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 07:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 8124.570076] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 07:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 8124.571359] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 07:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 8124.572632] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 07:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 8124.573914] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 07:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 8124.575086] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 07:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 8124.576387] Call Trace: Aug 22 07:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 8124.577360] Aug 22 07:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 8124.578373] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 8124.579482] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 8124.580669] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 8124.581961] ? show_regs.part.0+0x23/0x29 Aug 22 07:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 8124.583024] ? show_regs.cold+0x8/0xd Aug 22 07:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 8124.584046] ? watchdog_timer_fn+0x1be/0x220 Aug 22 07:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 8124.585105] ? lockup_detector_update_enable+0x60/0x60 Aug 22 07:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 8124.586268] ? __hrtimer_run_queues+0x107/0x230 Aug 22 07:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 8124.587404] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 07:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 8124.588494] ? hrtimer_interrupt+0x101/0x220 Aug 22 07:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 8124.589727] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 07:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 8124.590870] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 07:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 8124.592148] Aug 22 07:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 8124.593108] Aug 22 07:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 8124.594038] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 07:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 8124.595175] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 8124.596268] ? _raw_spin_lock+0x22/0x30 Aug 22 07:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 8124.597356] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 8124.598474] direct_page_fault+0x206/0x310 [kvm] Aug 22 07:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 8124.599641] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 07:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 8124.600844] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 07:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 8124.601963] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 07:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 8124.603024] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 07:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 8124.604056] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 07:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 8124.605144] handle_exit+0x98/0x230 [kvm_amd] Aug 22 07:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 8124.606109] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 07:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 8124.607099] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 07:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 8124.608071] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 07:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 8124.609017] vcpu_run+0x62/0x2c0 [kvm] Aug 22 07:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 8124.609882] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 07:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 8124.610711] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 07:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 8124.611574] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 07:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 8124.612455] ? __seccomp_filter+0x4a/0x4a0 Aug 22 07:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 8124.613284] ? __fget_files+0x86/0xc0 Aug 22 07:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 8124.614089] __x64_sys_ioctl+0x95/0xd0 Aug 22 07:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 8124.614829] do_syscall_64+0x5c/0xc0 Aug 22 07:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 8124.615531] ? do_futex+0x162/0x1f0 Aug 22 07:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 8124.616256] ? __x64_sys_futex+0x78/0x1e0 Aug 22 07:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 8124.617016] ? __secure_computing+0xa9/0x120 Aug 22 07:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 8124.617807] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 07:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 8124.618630] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 8124.619375] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 8124.620117] ? do_syscall_64+0x69/0xc0 Aug 22 07:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 8124.620779] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 8124.621573] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 8124.622400] ? do_syscall_64+0x69/0xc0 Aug 22 07:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 8124.623139] ? do_syscall_64+0x69/0xc0 Aug 22 07:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 8124.623873] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 07:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 8124.624695] RIP: 0033:0x7faa5d0edaff Aug 22 07:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 8124.625493] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 07:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 8124.627879] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 07:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 8124.628994] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 07:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 8124.630095] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 07:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 8124.631149] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 07:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 8124.632218] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 07:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 8124.633236] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 07:39:10 juju-e4d256-prod-github-runner-207 kernel: [ 8124.634308] Aug 22 07:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 8152.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 7484s! [qemu-system-x86:6715] Aug 22 07:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 8152.543097] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 07:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 8152.543170] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 07:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 8152.555716] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 07:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 8152.556995] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 07:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 8152.558588] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 8152.559694] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 07:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 8152.562288] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 07:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 8152.563332] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 07:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 8152.564652] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 07:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 8152.566034] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 07:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 8152.567205] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 07:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 8152.568372] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 07:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 8152.569562] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 07:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 8152.570840] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 07:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 8152.571954] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 07:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 8152.573185] Call Trace: Aug 22 07:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 8152.574117] Aug 22 07:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 8152.575004] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 8152.576034] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 8152.577069] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 8152.578168] ? show_regs.part.0+0x23/0x29 Aug 22 07:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 8152.579182] ? show_regs.cold+0x8/0xd Aug 22 07:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 8152.580157] ? watchdog_timer_fn+0x1be/0x220 Aug 22 07:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 8152.581198] ? lockup_detector_update_enable+0x60/0x60 Aug 22 07:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 8152.582266] ? __hrtimer_run_queues+0x107/0x230 Aug 22 07:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 8152.583293] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 07:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 8152.584323] ? hrtimer_interrupt+0x101/0x220 Aug 22 07:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 8152.585360] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 07:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 8152.586424] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 07:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 8152.587470] Aug 22 07:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 8152.588321] Aug 22 07:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 8152.589204] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 07:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 8152.590251] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 8152.591319] ? _raw_spin_lock+0x22/0x30 Aug 22 07:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 8152.592280] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 8152.593326] direct_page_fault+0x206/0x310 [kvm] Aug 22 07:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 8152.594451] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 07:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 8152.595556] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 07:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 8152.596567] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 07:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 8152.597602] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 07:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 8152.598557] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 07:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 8152.599547] handle_exit+0x98/0x230 [kvm_amd] Aug 22 07:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 8152.600448] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 07:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 8152.601400] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 07:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 8152.602347] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 07:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 8152.603254] vcpu_run+0x62/0x2c0 [kvm] Aug 22 07:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 8152.604065] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 07:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 8152.604888] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 07:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 8152.605785] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 07:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 8152.606583] ? __seccomp_filter+0x4a/0x4a0 Aug 22 07:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 8152.607325] ? __fget_files+0x86/0xc0 Aug 22 07:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 8152.608028] __x64_sys_ioctl+0x95/0xd0 Aug 22 07:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 8152.608720] do_syscall_64+0x5c/0xc0 Aug 22 07:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 8152.609430] ? do_futex+0x162/0x1f0 Aug 22 07:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 8152.610088] ? __x64_sys_futex+0x78/0x1e0 Aug 22 07:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 8152.610760] ? __secure_computing+0xa9/0x120 Aug 22 07:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 8152.611450] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 07:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 8152.612215] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 8152.612949] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 8152.613693] ? do_syscall_64+0x69/0xc0 Aug 22 07:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 8152.614417] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 8152.615225] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 8152.616027] ? do_syscall_64+0x69/0xc0 Aug 22 07:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 8152.616702] ? do_syscall_64+0x69/0xc0 Aug 22 07:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 8152.617446] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 07:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 8152.618287] RIP: 0033:0x7faa5d0edaff Aug 22 07:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 8152.618984] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 07:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 8152.621316] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 07:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 8152.622362] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 07:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 8152.623368] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 07:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 8152.624409] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 07:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 8152.625496] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 07:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 8152.626583] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 07:39:38 juju-e4d256-prod-github-runner-207 kernel: [ 8152.627588] Aug 22 07:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 8180.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 7510s! [qemu-system-x86:6715] Aug 22 07:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 8180.543082] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 07:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 8180.543154] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 07:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 8180.555781] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 07:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 8180.557198] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 07:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 8180.558463] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 8180.559533] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 07:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 8180.562144] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 07:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 8180.563205] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 07:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 8180.564382] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 07:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 8180.565570] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 07:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 8180.566739] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 07:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 8180.567893] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 07:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 8180.569077] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 07:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 8180.570307] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 07:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 8180.571400] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 07:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 8180.572622] Call Trace: Aug 22 07:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 8180.573560] Aug 22 07:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 8180.574444] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 8180.575479] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 8180.576499] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 8180.577582] ? show_regs.part.0+0x23/0x29 Aug 22 07:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 8180.578576] ? show_regs.cold+0x8/0xd Aug 22 07:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 8180.579546] ? watchdog_timer_fn+0x1be/0x220 Aug 22 07:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 8180.580600] ? lockup_detector_update_enable+0x60/0x60 Aug 22 07:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 8180.581675] ? __hrtimer_run_queues+0x107/0x230 Aug 22 07:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 8180.582703] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 07:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 8180.583768] ? hrtimer_interrupt+0x101/0x220 Aug 22 07:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 8180.584821] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 07:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 8180.585894] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 07:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 8180.586937] Aug 22 07:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 8180.587787] Aug 22 07:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 8180.588621] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 07:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 8180.589676] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 8180.590712] ? _raw_spin_lock+0x22/0x30 Aug 22 07:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 8180.591658] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 8180.592672] direct_page_fault+0x206/0x310 [kvm] Aug 22 07:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 8180.593704] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 07:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 8180.594733] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 07:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 8180.595733] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 07:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 8180.596709] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 07:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 8180.597653] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 07:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 8180.598629] handle_exit+0x98/0x230 [kvm_amd] Aug 22 07:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 8180.599519] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 07:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 8180.600429] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 07:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 8180.601363] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 07:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 8180.602262] vcpu_run+0x62/0x2c0 [kvm] Aug 22 07:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 8180.603071] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 07:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 8180.603875] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 07:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 8180.604757] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 07:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 8180.605557] ? __seccomp_filter+0x4a/0x4a0 Aug 22 07:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 8180.606295] ? __fget_files+0x86/0xc0 Aug 22 07:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 8180.606995] __x64_sys_ioctl+0x95/0xd0 Aug 22 07:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 8180.607682] do_syscall_64+0x5c/0xc0 Aug 22 07:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 8180.608347] ? do_futex+0x162/0x1f0 Aug 22 07:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 8180.609004] ? __x64_sys_futex+0x78/0x1e0 Aug 22 07:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 8180.609677] ? __secure_computing+0xa9/0x120 Aug 22 07:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 8180.610366] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 07:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 8180.611124] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 8180.611844] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 8180.612615] ? do_syscall_64+0x69/0xc0 Aug 22 07:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 8180.613271] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 8180.613970] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 8180.614669] ? do_syscall_64+0x69/0xc0 Aug 22 07:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 8180.615291] ? do_syscall_64+0x69/0xc0 Aug 22 07:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 8180.615911] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 07:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 8180.616612] RIP: 0033:0x7faa5d0edaff Aug 22 07:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 8180.617247] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 07:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 8180.619225] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 07:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 8180.620140] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 07:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 8180.621038] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 07:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 8180.621925] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 07:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 8180.622839] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 07:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 8180.623732] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 07:40:06 juju-e4d256-prod-github-runner-207 kernel: [ 8180.624623] Aug 22 07:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 8208.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 7536s! [qemu-system-x86:6715] Aug 22 07:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 8208.543113] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 07:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 8208.543190] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 07:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 8208.555444] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 07:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 8208.556765] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 07:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 8208.557996] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 8208.559050] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 07:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 8208.561613] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 07:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 8208.562654] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 07:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 8208.563813] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 07:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 8208.564993] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 07:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 8208.566152] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 07:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 8208.567317] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 07:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 8208.568537] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 07:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 8208.569780] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 07:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 8208.570878] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 07:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 8208.572072] Call Trace: Aug 22 07:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 8208.573193] Aug 22 07:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 8208.574085] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 8208.575263] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 8208.576285] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 8208.577386] ? show_regs.part.0+0x23/0x29 Aug 22 07:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 8208.578386] ? show_regs.cold+0x8/0xd Aug 22 07:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 8208.579360] ? watchdog_timer_fn+0x1be/0x220 Aug 22 07:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 8208.580389] ? lockup_detector_update_enable+0x60/0x60 Aug 22 07:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 8208.581456] ? __hrtimer_run_queues+0x107/0x230 Aug 22 07:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 8208.582485] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 07:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 8208.583508] ? hrtimer_interrupt+0x101/0x220 Aug 22 07:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 8208.584544] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 07:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 8208.585620] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 07:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 8208.586668] Aug 22 07:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 8208.587523] Aug 22 07:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 8208.588376] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 07:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 8208.589417] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 8208.590458] ? _raw_spin_lock+0x22/0x30 Aug 22 07:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 8208.591405] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 8208.592463] direct_page_fault+0x206/0x310 [kvm] Aug 22 07:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 8208.593663] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 07:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 8208.594681] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 07:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 8208.595686] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 07:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 8208.596675] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 07:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 8208.597622] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 07:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 8208.598605] handle_exit+0x98/0x230 [kvm_amd] Aug 22 07:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 8208.599497] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 07:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 8208.600420] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 07:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 8208.601347] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 07:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 8208.602276] vcpu_run+0x62/0x2c0 [kvm] Aug 22 07:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 8208.603123] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 07:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 8208.603940] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 07:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 8208.604824] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 07:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 8208.605643] ? __seccomp_filter+0x4a/0x4a0 Aug 22 07:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 8208.606408] ? __fget_files+0x86/0xc0 Aug 22 07:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 8208.607110] __x64_sys_ioctl+0x95/0xd0 Aug 22 07:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 8208.607804] do_syscall_64+0x5c/0xc0 Aug 22 07:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 8208.608491] ? do_futex+0x162/0x1f0 Aug 22 07:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 8208.609138] ? __x64_sys_futex+0x78/0x1e0 Aug 22 07:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 8208.609809] ? __secure_computing+0xa9/0x120 Aug 22 07:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 8208.610519] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 07:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 8208.611294] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 8208.612038] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 8208.612818] ? do_syscall_64+0x69/0xc0 Aug 22 07:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 8208.613479] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 8208.614202] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 8208.614926] ? do_syscall_64+0x69/0xc0 Aug 22 07:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 8208.615564] ? do_syscall_64+0x69/0xc0 Aug 22 07:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 8208.616186] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 07:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 8208.616906] RIP: 0033:0x7faa5d0edaff Aug 22 07:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 8208.617535] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 07:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 8208.619557] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 07:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 8208.620490] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 07:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 8208.621544] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 07:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 8208.622570] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 07:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 8208.623595] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 07:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 8208.624638] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 07:40:34 juju-e4d256-prod-github-runner-207 kernel: [ 8208.625688] Aug 22 07:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 8236.541981] watchdog: BUG: soft lockup - CPU#1 stuck for 7562s! [qemu-system-x86:6715] Aug 22 07:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 8236.543799] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 07:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 8236.544084] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 07:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 8236.556511] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 07:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 8236.557819] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 07:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 8236.559061] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 8236.560196] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 07:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 8236.562799] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 07:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 8236.563866] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 07:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 8236.565054] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 07:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 8236.566263] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 07:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 8236.567429] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 07:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 8236.568646] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 07:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 8236.569824] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 07:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 8236.571387] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 07:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 8236.572618] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 07:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 8236.574038] Call Trace: Aug 22 07:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 8236.575006] Aug 22 07:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 8236.575939] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 8236.577032] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 8236.578084] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 8236.579198] ? show_regs.part.0+0x23/0x29 Aug 22 07:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 8236.580265] ? show_regs.cold+0x8/0xd Aug 22 07:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 8236.581262] ? watchdog_timer_fn+0x1be/0x220 Aug 22 07:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 8236.582275] ? lockup_detector_update_enable+0x60/0x60 Aug 22 07:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 8236.583353] ? __hrtimer_run_queues+0x107/0x230 Aug 22 07:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 8236.584477] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 07:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 8236.585547] ? hrtimer_interrupt+0x101/0x220 Aug 22 07:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 8236.586571] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 07:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 8236.587795] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 07:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 8236.588908] Aug 22 07:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 8236.589801] Aug 22 07:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 8236.590655] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 07:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 8236.591696] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 8236.592760] ? _raw_spin_lock+0x22/0x30 Aug 22 07:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 8236.593733] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 8236.594839] direct_page_fault+0x206/0x310 [kvm] Aug 22 07:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 8236.595872] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 07:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 8236.596927] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 07:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 8236.597962] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 07:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 8236.599111] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 07:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 8236.600210] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 07:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 8236.601328] handle_exit+0x98/0x230 [kvm_amd] Aug 22 07:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 8236.602313] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 07:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 8236.603319] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 07:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 8236.604378] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 07:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 8236.605398] vcpu_run+0x62/0x2c0 [kvm] Aug 22 07:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 8236.606303] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 07:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 8236.607249] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 07:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 8236.608220] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 07:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 8236.609104] ? __seccomp_filter+0x4a/0x4a0 Aug 22 07:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 8236.609933] ? __fget_files+0x86/0xc0 Aug 22 07:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 8236.610717] __x64_sys_ioctl+0x95/0xd0 Aug 22 07:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 8236.611484] do_syscall_64+0x5c/0xc0 Aug 22 07:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 8236.612266] ? do_futex+0x162/0x1f0 Aug 22 07:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 8236.613000] ? __x64_sys_futex+0x78/0x1e0 Aug 22 07:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 8236.613756] ? __secure_computing+0xa9/0x120 Aug 22 07:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 8236.614531] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 07:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 8236.615391] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 8236.616238] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 8236.616977] ? do_syscall_64+0x69/0xc0 Aug 22 07:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 8236.617623] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 8236.618327] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 8236.619022] ? do_syscall_64+0x69/0xc0 Aug 22 07:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 8236.619647] ? do_syscall_64+0x69/0xc0 Aug 22 07:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 8236.620290] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 07:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 8236.620998] RIP: 0033:0x7faa5d0edaff Aug 22 07:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 8236.621670] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 07:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 8236.623660] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 07:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 8236.624593] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 07:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 8236.625485] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 07:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 8236.626380] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 07:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 8236.627268] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 07:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 8236.628171] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 07:41:02 juju-e4d256-prod-github-runner-207 kernel: [ 8236.629072] Aug 22 07:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 8264.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 7588s! [qemu-system-x86:6715] Aug 22 07:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 8264.543112] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 07:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 8264.543188] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 07:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 8264.555547] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 07:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 8264.556822] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 07:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 8264.558049] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 8264.559142] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 07:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 8264.561723] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 07:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 8264.562765] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 07:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 8264.563955] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 07:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 8264.565158] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 07:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 8264.566328] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 07:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 8264.567483] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 07:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 8264.568695] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 07:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 8264.569974] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 07:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 8264.571077] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 07:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 8264.572290] Call Trace: Aug 22 07:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 8264.573246] Aug 22 07:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 8264.574127] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 8264.575198] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 8264.576241] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 8264.577350] ? show_regs.part.0+0x23/0x29 Aug 22 07:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 8264.578353] ? show_regs.cold+0x8/0xd Aug 22 07:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 8264.579327] ? watchdog_timer_fn+0x1be/0x220 Aug 22 07:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 8264.580349] ? lockup_detector_update_enable+0x60/0x60 Aug 22 07:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 8264.581460] ? __hrtimer_run_queues+0x107/0x230 Aug 22 07:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 8264.582520] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 07:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 8264.583542] ? hrtimer_interrupt+0x101/0x220 Aug 22 07:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 8264.584572] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 07:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 8264.585642] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 07:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 8264.586684] Aug 22 07:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 8264.587533] Aug 22 07:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 8264.588384] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 07:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 8264.589414] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 8264.590467] ? _raw_spin_lock+0x22/0x30 Aug 22 07:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 8264.591416] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 8264.592441] direct_page_fault+0x206/0x310 [kvm] Aug 22 07:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 8264.593471] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 07:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 8264.594477] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 07:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 8264.595484] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 07:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 8264.596462] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 07:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 8264.597404] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 07:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 8264.598427] handle_exit+0x98/0x230 [kvm_amd] Aug 22 07:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 8264.599322] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 07:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 8264.600248] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 07:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 8264.601207] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 07:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 8264.602108] vcpu_run+0x62/0x2c0 [kvm] Aug 22 07:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 8264.602916] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 07:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 8264.603737] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 07:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 8264.604590] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 07:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 8264.605384] ? __seccomp_filter+0x4a/0x4a0 Aug 22 07:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 8264.606127] ? __fget_files+0x86/0xc0 Aug 22 07:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 8264.606830] __x64_sys_ioctl+0x95/0xd0 Aug 22 07:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 8264.607523] do_syscall_64+0x5c/0xc0 Aug 22 07:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 8264.608200] ? do_futex+0x162/0x1f0 Aug 22 07:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 8264.608848] ? __x64_sys_futex+0x78/0x1e0 Aug 22 07:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 8264.609519] ? __secure_computing+0xa9/0x120 Aug 22 07:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 8264.610206] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 07:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 8264.610964] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 8264.611704] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 8264.612429] ? do_syscall_64+0x69/0xc0 Aug 22 07:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 8264.613077] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 8264.613779] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 8264.614474] ? do_syscall_64+0x69/0xc0 Aug 22 07:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 8264.615099] ? do_syscall_64+0x69/0xc0 Aug 22 07:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 8264.615725] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 07:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 8264.616438] RIP: 0033:0x7faa5d0edaff Aug 22 07:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 8264.617062] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 07:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 8264.619136] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 07:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 8264.620174] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 07:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 8264.621065] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 07:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 8264.621992] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 07:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 8264.622906] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 07:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 8264.623823] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 07:41:30 juju-e4d256-prod-github-runner-207 kernel: [ 8264.624857] Aug 22 07:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 8277.740708] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 07:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 8277.741678] rcu: 1-....: (2033729 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=985255 Aug 22 07:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 8277.742819] (t=2040135 jiffies g=23269 q=17022) Aug 22 07:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 8277.743629] NMI backtrace for cpu 1 Aug 22 07:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 8277.744345] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 07:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 8277.745468] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 07:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 8277.746519] Call Trace: Aug 22 07:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 8277.747194] Aug 22 07:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 8277.747854] show_stack+0x52/0x5c Aug 22 07:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 8277.748577] dump_stack_lvl+0x4a/0x63 Aug 22 07:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 8277.749325] dump_stack+0x10/0x16 Aug 22 07:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 8277.750039] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 07:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 8277.750815] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 07:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 8277.751603] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 07:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 8277.752420] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 07:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 8277.753235] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 07:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 8277.754059] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 07:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 8277.754875] print_cpu_stall.cold+0x2f/0xe2 Aug 22 07:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 8277.755663] ? timekeeping_update+0xf7/0x150 Aug 22 07:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 8277.756433] check_cpu_stall+0x109/0x270 Aug 22 07:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 8277.757178] rcu_sched_clock_irq+0x9a/0x250 Aug 22 07:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 8277.757936] update_process_times+0x94/0xd0 Aug 22 07:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 8277.758696] tick_sched_handle+0x29/0x70 Aug 22 07:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 8277.759460] tick_sched_timer+0x8c/0xc0 Aug 22 07:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 8277.760196] ? tick_nohz_handler+0xb0/0xb0 Aug 22 07:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 8277.760948] __hrtimer_run_queues+0x107/0x230 Aug 22 07:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 8277.761720] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 07:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 8277.762495] hrtimer_interrupt+0x101/0x220 Aug 22 07:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 8277.763273] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 07:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 8277.764116] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 07:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 8277.764918] Aug 22 07:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 8277.765553] Aug 22 07:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 8277.766182] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 07:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 8277.766997] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 8277.767883] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 07:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 8277.770089] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 07:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 8277.770961] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 07:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 8277.771970] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 07:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 8277.772945] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 07:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 8277.773905] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 07:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 8277.774856] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 07:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 8277.775818] ? _raw_spin_lock+0x22/0x30 Aug 22 07:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 8277.776579] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 8277.777412] direct_page_fault+0x206/0x310 [kvm] Aug 22 07:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 8277.778259] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 07:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 8277.779091] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 07:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 8277.779929] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 07:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 8277.780733] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 07:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 8277.781523] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 07:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 8277.782346] handle_exit+0x98/0x230 [kvm_amd] Aug 22 07:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 8277.783095] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 07:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 8277.783901] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 07:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 8277.784700] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 07:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 8277.785487] vcpu_run+0x62/0x2c0 [kvm] Aug 22 07:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 8277.786235] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 07:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 8277.786970] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 07:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 8277.787820] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 07:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 8277.788774] ? __seccomp_filter+0x4a/0x4a0 Aug 22 07:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 8277.789549] ? __fget_files+0x86/0xc0 Aug 22 07:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 8277.790448] __x64_sys_ioctl+0x95/0xd0 Aug 22 07:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 8277.791192] do_syscall_64+0x5c/0xc0 Aug 22 07:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 8277.791943] ? do_futex+0x162/0x1f0 Aug 22 07:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 8277.792629] ? __x64_sys_futex+0x78/0x1e0 Aug 22 07:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 8277.793343] ? __secure_computing+0xa9/0x120 Aug 22 07:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 8277.794066] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 07:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 8277.794859] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 8277.795646] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 8277.796399] ? do_syscall_64+0x69/0xc0 Aug 22 07:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 8277.797090] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 8277.797852] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 8277.798608] ? do_syscall_64+0x69/0xc0 Aug 22 07:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 8277.799313] ? do_syscall_64+0x69/0xc0 Aug 22 07:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 8277.800033] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 07:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 8277.800829] RIP: 0033:0x7faa5d0edaff Aug 22 07:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 8277.801527] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 07:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 8277.803640] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 07:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 8277.804640] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 07:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 8277.805609] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 07:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 8277.806553] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 07:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 8277.807518] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 07:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 8277.808470] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 07:41:43 juju-e4d256-prod-github-runner-207 kernel: [ 8277.809392] Aug 22 07:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 8304.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 7626s! [qemu-system-x86:6715] Aug 22 07:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 8304.543934] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 07:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 8304.544240] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 07:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 8304.556619] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 07:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 8304.557908] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 07:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 8304.559176] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 8304.560265] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 07:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 8304.562874] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 07:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 8304.564096] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 07:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 8304.565278] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 07:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 8304.566459] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 07:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 8304.567808] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 07:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 8304.568989] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 07:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 8304.570177] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 07:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 8304.571441] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 07:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 8304.572564] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 07:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 8304.573774] Call Trace: Aug 22 07:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 8304.574691] Aug 22 07:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 8304.575609] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 8304.576647] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 8304.577709] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 8304.578815] ? show_regs.part.0+0x23/0x29 Aug 22 07:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 8304.579845] ? show_regs.cold+0x8/0xd Aug 22 07:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 8304.580880] ? watchdog_timer_fn+0x1be/0x220 Aug 22 07:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 8304.581920] ? lockup_detector_update_enable+0x60/0x60 Aug 22 07:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 8304.583001] ? __hrtimer_run_queues+0x107/0x230 Aug 22 07:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 8304.584164] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 07:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 8304.585202] ? hrtimer_interrupt+0x101/0x220 Aug 22 07:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 8304.586225] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 07:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 8304.587362] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 07:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 8304.588424] Aug 22 07:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 8304.589281] Aug 22 07:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 8304.590155] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 07:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 8304.591230] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 8304.592287] ? _raw_spin_lock+0x22/0x30 Aug 22 07:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 8304.593247] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 8304.594278] direct_page_fault+0x206/0x310 [kvm] Aug 22 07:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 8304.595329] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 07:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 8304.596353] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 07:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 8304.597373] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 07:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 8304.598388] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 07:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 8304.599365] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 07:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 8304.600523] handle_exit+0x98/0x230 [kvm_amd] Aug 22 07:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 8304.601455] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 07:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 8304.602390] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 07:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 8304.603349] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 07:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 8304.604266] vcpu_run+0x62/0x2c0 [kvm] Aug 22 07:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 8304.605091] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 07:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 8304.605916] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 07:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 8304.606788] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 07:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 8304.607611] ? __seccomp_filter+0x4a/0x4a0 Aug 22 07:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 8304.608380] ? __fget_files+0x86/0xc0 Aug 22 07:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 8304.609093] __x64_sys_ioctl+0x95/0xd0 Aug 22 07:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 8304.609794] do_syscall_64+0x5c/0xc0 Aug 22 07:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 8304.610472] ? do_futex+0x162/0x1f0 Aug 22 07:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 8304.611152] ? __x64_sys_futex+0x78/0x1e0 Aug 22 07:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 8304.611835] ? __secure_computing+0xa9/0x120 Aug 22 07:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 8304.612534] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 07:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 8304.613307] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 8304.614039] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 8304.614767] ? do_syscall_64+0x69/0xc0 Aug 22 07:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 8304.615439] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 8304.616155] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 8304.616868] ? do_syscall_64+0x69/0xc0 Aug 22 07:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 8304.617513] ? do_syscall_64+0x69/0xc0 Aug 22 07:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 8304.618141] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 07:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 8304.618860] RIP: 0033:0x7faa5d0edaff Aug 22 07:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 8304.619553] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 07:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 8304.621608] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 07:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 8304.622556] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 07:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 8304.625907] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 07:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 8304.626836] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 07:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 8304.627757] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 07:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 8304.628663] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 07:42:10 juju-e4d256-prod-github-runner-207 kernel: [ 8304.629579] Aug 22 07:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 8332.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 7652s! [qemu-system-x86:6715] Aug 22 07:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 8332.543111] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 07:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 8332.543185] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 07:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 8332.555798] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 07:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 8332.557125] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 07:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 8332.558387] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 8332.559482] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 07:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 8332.562093] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 07:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 8332.563170] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 07:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 8332.564354] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 07:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 8332.565533] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 07:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 8332.566721] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 07:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 8332.568164] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 07:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 8332.569850] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 07:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 8332.571340] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 07:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 8332.572455] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 07:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 8332.573665] Call Trace: Aug 22 07:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 8332.574586] Aug 22 07:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 8332.575497] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 8332.576547] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 8332.577584] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 8332.578737] ? show_regs.part.0+0x23/0x29 Aug 22 07:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 8332.579975] ? show_regs.cold+0x8/0xd Aug 22 07:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 8332.580962] ? watchdog_timer_fn+0x1be/0x220 Aug 22 07:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 8332.581989] ? lockup_detector_update_enable+0x60/0x60 Aug 22 07:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 8332.583088] ? __hrtimer_run_queues+0x107/0x230 Aug 22 07:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 8332.584128] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 07:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 8332.585174] ? hrtimer_interrupt+0x101/0x220 Aug 22 07:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 8332.586201] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 07:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 8332.587299] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 07:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 8332.588355] Aug 22 07:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 8332.589218] Aug 22 07:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 8332.590063] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 07:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 8332.591120] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 8332.592176] ? _raw_spin_lock+0x22/0x30 Aug 22 07:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 8332.593134] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 8332.594162] direct_page_fault+0x206/0x310 [kvm] Aug 22 07:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 8332.595208] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 07:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 8332.596260] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 07:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 8332.597287] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 07:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 8332.598285] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 07:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 8332.599259] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 07:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 8332.600252] handle_exit+0x98/0x230 [kvm_amd] Aug 22 07:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 8332.601155] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 07:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 8332.602082] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 07:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 8332.603036] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 07:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 8332.603956] vcpu_run+0x62/0x2c0 [kvm] Aug 22 07:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 8332.604786] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 07:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 8332.605609] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 07:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 8332.606479] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 07:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 8332.607307] ? __seccomp_filter+0x4a/0x4a0 Aug 22 07:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 8332.608067] ? __fget_files+0x86/0xc0 Aug 22 07:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 8332.608782] __x64_sys_ioctl+0x95/0xd0 Aug 22 07:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 8332.609485] do_syscall_64+0x5c/0xc0 Aug 22 07:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 8332.610162] ? do_futex+0x162/0x1f0 Aug 22 07:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 8332.610845] ? __x64_sys_futex+0x78/0x1e0 Aug 22 07:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 8332.611529] ? __secure_computing+0xa9/0x120 Aug 22 07:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 8332.612229] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 07:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 8332.613001] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 8332.613738] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 8332.614464] ? do_syscall_64+0x69/0xc0 Aug 22 07:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 8332.615128] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 8332.615842] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 8332.616548] ? do_syscall_64+0x69/0xc0 Aug 22 07:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 8332.617184] ? do_syscall_64+0x69/0xc0 Aug 22 07:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 8332.617821] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 07:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 8332.618536] RIP: 0033:0x7faa5d0edaff Aug 22 07:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 8332.619193] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 07:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 8332.621256] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 07:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 8332.622185] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 07:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 8332.623104] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 07:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 8332.624007] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 07:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 8332.624907] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 07:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 8332.625813] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 07:42:38 juju-e4d256-prod-github-runner-207 kernel: [ 8332.626733] Aug 22 07:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 8360.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 7678s! [qemu-system-x86:6715] Aug 22 07:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 8360.543105] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 07:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 8360.543182] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 07:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 8360.555299] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 07:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 8360.556565] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 07:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 8360.557784] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 8360.558853] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 07:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 8360.561402] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 07:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 8360.562449] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 07:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 8360.563624] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 07:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 8360.564780] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 07:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 8360.565937] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 07:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 8360.567106] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 07:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 8360.568289] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 07:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 8360.569520] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 07:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 8360.570627] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 07:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 8360.571817] Call Trace: Aug 22 07:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 8360.572750] Aug 22 07:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 8360.573694] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 8360.574772] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 8360.575816] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 8360.576891] ? show_regs.part.0+0x23/0x29 Aug 22 07:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 8360.577923] ? show_regs.cold+0x8/0xd Aug 22 07:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 8360.578913] ? watchdog_timer_fn+0x1be/0x220 Aug 22 07:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 8360.579919] ? lockup_detector_update_enable+0x60/0x60 Aug 22 07:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 8360.580976] ? __hrtimer_run_queues+0x107/0x230 Aug 22 07:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 8360.581999] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 07:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 8360.583079] ? hrtimer_interrupt+0x101/0x220 Aug 22 07:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 8360.584119] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 07:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 8360.585224] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 07:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 8360.586268] Aug 22 07:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 8360.587147] Aug 22 07:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 8360.587983] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 07:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 8360.589015] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 8360.590049] ? _raw_spin_lock+0x22/0x30 Aug 22 07:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 8360.591015] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 8360.592036] direct_page_fault+0x206/0x310 [kvm] Aug 22 07:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 8360.593080] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 07:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 8360.594088] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 07:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 8360.595099] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 07:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 8360.596076] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 07:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 8360.597032] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 07:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 8360.598013] handle_exit+0x98/0x230 [kvm_amd] Aug 22 07:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 8360.598917] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 07:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 8360.599828] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 07:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 8360.600748] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 07:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 8360.601645] vcpu_run+0x62/0x2c0 [kvm] Aug 22 07:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 8360.602465] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 07:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 8360.603269] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 07:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 8360.604118] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 07:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 8360.604910] ? __seccomp_filter+0x4a/0x4a0 Aug 22 07:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 8360.605648] ? __fget_files+0x86/0xc0 Aug 22 07:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 8360.606357] __x64_sys_ioctl+0x95/0xd0 Aug 22 07:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 8360.607045] do_syscall_64+0x5c/0xc0 Aug 22 07:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 8360.607705] ? do_futex+0x162/0x1f0 Aug 22 07:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 8360.608353] ? __x64_sys_futex+0x78/0x1e0 Aug 22 07:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 8360.609021] ? __secure_computing+0xa9/0x120 Aug 22 07:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 8360.609704] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 07:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 8360.610465] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 8360.611186] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 8360.611898] ? do_syscall_64+0x69/0xc0 Aug 22 07:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 8360.612591] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 8360.613308] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 8360.614000] ? do_syscall_64+0x69/0xc0 Aug 22 07:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 8360.614638] ? do_syscall_64+0x69/0xc0 Aug 22 07:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 8360.615264] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 07:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 8360.615965] RIP: 0033:0x7faa5d0edaff Aug 22 07:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 8360.616586] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 07:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 8360.618592] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 07:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 8360.619653] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 07:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 8360.620544] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 07:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 8360.621434] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 07:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 8360.622318] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 07:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 8360.623213] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 07:43:06 juju-e4d256-prod-github-runner-207 kernel: [ 8360.624100] Aug 22 07:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 8388.541983] watchdog: BUG: soft lockup - CPU#1 stuck for 7704s! [qemu-system-x86:6715] Aug 22 07:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 8388.543134] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 07:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 8388.543210] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 07:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 8388.555494] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 07:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 8388.556761] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 07:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 8388.557996] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 8388.559051] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 07:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 8388.561738] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 07:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 8388.562837] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 07:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 8388.564034] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 07:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 8388.565194] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 07:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 8388.566383] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 07:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 8388.567556] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 07:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 8388.568727] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 07:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 8388.569978] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 07:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 8388.571085] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 07:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 8388.572316] Call Trace: Aug 22 07:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 8388.573261] Aug 22 07:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 8388.574220] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 8388.575254] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 8388.576295] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 8388.577396] ? show_regs.part.0+0x23/0x29 Aug 22 07:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 8388.578474] ? show_regs.cold+0x8/0xd Aug 22 07:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 8388.579458] ? watchdog_timer_fn+0x1be/0x220 Aug 22 07:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 8388.580465] ? lockup_detector_update_enable+0x60/0x60 Aug 22 07:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 8388.581527] ? __hrtimer_run_queues+0x107/0x230 Aug 22 07:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 8388.582667] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 07:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 8388.583702] ? hrtimer_interrupt+0x101/0x220 Aug 22 07:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 8388.584740] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 07:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 8388.585812] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 07:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 8388.586882] Aug 22 07:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 8388.587740] Aug 22 07:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 8388.588584] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 07:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 8388.589641] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 8388.590857] ? _raw_spin_lock+0x22/0x30 Aug 22 07:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 8388.591912] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 8388.592964] direct_page_fault+0x206/0x310 [kvm] Aug 22 07:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 8388.594024] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 07:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 8388.595038] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 07:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 8388.596047] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 07:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 8388.597019] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 07:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 8388.597985] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 07:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 8388.598973] handle_exit+0x98/0x230 [kvm_amd] Aug 22 07:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 8388.599871] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 07:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 8388.600972] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 07:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 8388.601898] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 07:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 8388.602826] vcpu_run+0x62/0x2c0 [kvm] Aug 22 07:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 8388.603657] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 07:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 8388.604481] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 07:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 8388.605340] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 07:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 8388.606151] ? __seccomp_filter+0x4a/0x4a0 Aug 22 07:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 8388.606896] ? __fget_files+0x86/0xc0 Aug 22 07:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 8388.607614] __x64_sys_ioctl+0x95/0xd0 Aug 22 07:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 8388.608316] do_syscall_64+0x5c/0xc0 Aug 22 07:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 8388.608985] ? do_futex+0x162/0x1f0 Aug 22 07:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 8388.609637] ? __x64_sys_futex+0x78/0x1e0 Aug 22 07:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 8388.610339] ? __secure_computing+0xa9/0x120 Aug 22 07:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 8388.611032] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 07:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 8388.611799] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 8388.612528] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 8388.613253] ? do_syscall_64+0x69/0xc0 Aug 22 07:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 8388.613924] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 8388.614663] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 8388.615364] ? do_syscall_64+0x69/0xc0 Aug 22 07:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 8388.615988] ? do_syscall_64+0x69/0xc0 Aug 22 07:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 8388.616610] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 07:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 8388.617316] RIP: 0033:0x7faa5d0edaff Aug 22 07:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 8388.617941] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 07:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 8388.619952] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 07:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 8388.620866] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 07:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 8388.621835] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 07:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 8388.622764] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 07:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 8388.623656] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 07:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 8388.624550] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 07:43:34 juju-e4d256-prod-github-runner-207 kernel: [ 8388.625448] Aug 22 07:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 8416.541986] watchdog: BUG: soft lockup - CPU#1 stuck for 7730s! [qemu-system-x86:6715] Aug 22 07:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 8416.544550] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 07:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 8416.544891] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 07:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 8416.557451] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 07:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 8416.558736] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 07:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 8416.559958] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 8416.561012] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 07:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 8416.563585] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 07:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 8416.564626] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 07:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 8416.565836] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 07:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 8416.567011] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 07:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 8416.568174] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 07:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 8416.569340] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 07:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 8416.570522] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 07:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 8416.571757] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 07:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 8416.572860] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 07:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 8416.574092] Call Trace: Aug 22 07:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 8416.575009] Aug 22 07:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 8416.575906] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 8416.576934] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 8416.577992] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 8416.579090] ? show_regs.part.0+0x23/0x29 Aug 22 07:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 8416.580087] ? show_regs.cold+0x8/0xd Aug 22 07:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 8416.581058] ? watchdog_timer_fn+0x1be/0x220 Aug 22 07:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 8416.582084] ? lockup_detector_update_enable+0x60/0x60 Aug 22 07:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 8416.583149] ? __hrtimer_run_queues+0x107/0x230 Aug 22 07:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 8416.584178] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 07:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 8416.585202] ? hrtimer_interrupt+0x101/0x220 Aug 22 07:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 8416.586236] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 07:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 8416.587304] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 07:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 8416.588351] Aug 22 07:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 8416.589205] Aug 22 07:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 8416.590059] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 07:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 8416.591097] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 8416.592136] ? _raw_spin_lock+0x22/0x30 Aug 22 07:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 8416.593080] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 8416.594114] direct_page_fault+0x206/0x310 [kvm] Aug 22 07:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 8416.595138] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 07:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 8416.596146] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 07:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 8416.597146] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 07:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 8416.598153] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 07:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 8416.599099] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 07:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 8416.600077] handle_exit+0x98/0x230 [kvm_amd] Aug 22 07:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 8416.600969] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 07:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 8416.601892] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 07:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 8416.602819] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 07:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 8416.603722] vcpu_run+0x62/0x2c0 [kvm] Aug 22 07:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 8416.604531] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 07:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 8416.605339] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 07:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 8416.606200] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 07:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 8416.606995] ? __seccomp_filter+0x4a/0x4a0 Aug 22 07:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 8416.607735] ? __fget_files+0x86/0xc0 Aug 22 07:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 8416.608436] __x64_sys_ioctl+0x95/0xd0 Aug 22 07:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 8416.609128] do_syscall_64+0x5c/0xc0 Aug 22 07:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 8416.609831] ? do_futex+0x162/0x1f0 Aug 22 07:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 8416.610478] ? __x64_sys_futex+0x78/0x1e0 Aug 22 07:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 8416.611154] ? __secure_computing+0xa9/0x120 Aug 22 07:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 8416.611850] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 07:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 8416.612619] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 8416.613344] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 8416.614071] ? do_syscall_64+0x69/0xc0 Aug 22 07:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 8416.614716] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 8416.615417] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 8416.616116] ? do_syscall_64+0x69/0xc0 Aug 22 07:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 8416.616749] ? do_syscall_64+0x69/0xc0 Aug 22 07:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 8416.617370] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 07:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 8416.618085] RIP: 0033:0x7faa5d0edaff Aug 22 07:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 8416.618749] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 07:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 8416.620732] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 07:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 8416.621660] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 07:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 8416.622554] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 07:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 8416.623440] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 07:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 8416.624334] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 07:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 8416.625223] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 07:44:02 juju-e4d256-prod-github-runner-207 kernel: [ 8416.626123] Aug 22 07:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 8444.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 7756s! [qemu-system-x86:6715] Aug 22 07:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 8444.543143] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 07:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 8444.543215] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 07:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 8444.556178] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 07:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 8444.557560] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 07:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 8444.558881] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 8444.559962] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 07:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 8444.562843] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 07:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 8444.563931] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 07:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 8444.565156] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 07:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 8444.566397] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 07:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 8444.567751] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 07:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 8444.569124] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 07:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 8444.570325] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 07:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 8444.571610] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 07:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 8444.572720] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 07:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 8444.573965] Call Trace: Aug 22 07:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 8444.574897] Aug 22 07:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 8444.575788] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 8444.576827] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 8444.577878] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 8444.578978] ? show_regs.part.0+0x23/0x29 Aug 22 07:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 8444.579995] ? show_regs.cold+0x8/0xd Aug 22 07:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 8444.580992] ? watchdog_timer_fn+0x1be/0x220 Aug 22 07:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 8444.582029] ? lockup_detector_update_enable+0x60/0x60 Aug 22 07:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 8444.583125] ? __hrtimer_run_queues+0x107/0x230 Aug 22 07:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 8444.584233] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 07:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 8444.585331] ? hrtimer_interrupt+0x101/0x220 Aug 22 07:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 8444.586365] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 07:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 8444.587441] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 07:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 8444.588503] Aug 22 07:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 8444.589396] Aug 22 07:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 8444.590256] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 07:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 8444.591305] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 8444.592373] ? _raw_spin_lock+0x22/0x30 Aug 22 07:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 8444.593368] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 8444.594469] direct_page_fault+0x206/0x310 [kvm] Aug 22 07:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 8444.595642] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 07:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 8444.596744] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 07:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 8444.597788] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 07:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 8444.598772] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 07:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 8444.599743] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 07:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 8444.600748] handle_exit+0x98/0x230 [kvm_amd] Aug 22 07:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 8444.601730] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 07:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 8444.602670] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 07:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 8444.603603] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 07:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 8444.604547] vcpu_run+0x62/0x2c0 [kvm] Aug 22 07:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 8444.605432] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 07:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 8444.606262] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 07:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 8444.607131] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 07:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 8444.607955] ? __seccomp_filter+0x4a/0x4a0 Aug 22 07:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 8444.608705] ? __fget_files+0x86/0xc0 Aug 22 07:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 8444.609458] __x64_sys_ioctl+0x95/0xd0 Aug 22 07:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 8444.610173] do_syscall_64+0x5c/0xc0 Aug 22 07:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 8444.610865] ? do_futex+0x162/0x1f0 Aug 22 07:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 8444.611526] ? __x64_sys_futex+0x78/0x1e0 Aug 22 07:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 8444.612224] ? __secure_computing+0xa9/0x120 Aug 22 07:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 8444.612928] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 07:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 8444.613715] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 8444.614443] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 8444.615230] ? do_syscall_64+0x69/0xc0 Aug 22 07:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 8444.615910] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 8444.616625] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 8444.617349] ? do_syscall_64+0x69/0xc0 Aug 22 07:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 8444.617984] ? do_syscall_64+0x69/0xc0 Aug 22 07:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 8444.618616] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 07:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 8444.619330] RIP: 0033:0x7faa5d0edaff Aug 22 07:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 8444.619977] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 07:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 8444.622049] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 07:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 8444.623003] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 07:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 8444.623951] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 07:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 8444.624911] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 07:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 8444.625866] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 07:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 8444.626792] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 07:44:30 juju-e4d256-prod-github-runner-207 kernel: [ 8444.627708] Aug 22 07:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 8457.752721] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 07:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 8457.753702] rcu: 1-....: (2078596 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=1006716 Aug 22 07:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 8457.754928] (t=2085138 jiffies g=23269 q=17195) Aug 22 07:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 8457.755726] NMI backtrace for cpu 1 Aug 22 07:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 8457.756445] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 07:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 8457.757578] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 07:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 8457.758712] Call Trace: Aug 22 07:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 8457.759453] Aug 22 07:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 8457.760109] show_stack+0x52/0x5c Aug 22 07:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 8457.760838] dump_stack_lvl+0x4a/0x63 Aug 22 07:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 8457.761612] dump_stack+0x10/0x16 Aug 22 07:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 8457.762357] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 07:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 8457.763194] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 07:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 8457.764010] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 07:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 8457.764883] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 07:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 8457.765744] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 07:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 8457.766579] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 07:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 8457.767356] print_cpu_stall.cold+0x2f/0xe2 Aug 22 07:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 8457.768124] ? timekeeping_update+0xf7/0x150 Aug 22 07:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 8457.768904] check_cpu_stall+0x109/0x270 Aug 22 07:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 8457.769721] rcu_sched_clock_irq+0x9a/0x250 Aug 22 07:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 8457.770489] update_process_times+0x94/0xd0 Aug 22 07:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 8457.771285] tick_sched_handle+0x29/0x70 Aug 22 07:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 8457.772065] tick_sched_timer+0x8c/0xc0 Aug 22 07:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 8457.772825] ? tick_nohz_handler+0xb0/0xb0 Aug 22 07:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 8457.773625] __hrtimer_run_queues+0x107/0x230 Aug 22 07:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 8457.774413] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 07:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 8457.775211] hrtimer_interrupt+0x101/0x220 Aug 22 07:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 8457.775996] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 07:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 8457.776838] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 07:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 8457.777674] Aug 22 07:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 8457.778318] Aug 22 07:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 8457.778966] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 07:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 8457.779980] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 8457.780900] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 07:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 8457.783164] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 07:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 8457.784098] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 07:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 8457.785125] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 07:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 8457.786146] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 07:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 8457.787122] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 07:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 8457.788093] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 07:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 8457.789083] ? _raw_spin_lock+0x22/0x30 Aug 22 07:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 8457.789948] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 8457.790803] direct_page_fault+0x206/0x310 [kvm] Aug 22 07:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 8457.791651] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 07:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 8457.792526] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 07:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 8457.793432] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 07:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 8457.794316] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 07:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 8457.795162] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 07:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 8457.795990] handle_exit+0x98/0x230 [kvm_amd] Aug 22 07:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 8457.796748] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 07:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 8457.797565] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 07:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 8457.798373] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 07:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 8457.799190] vcpu_run+0x62/0x2c0 [kvm] Aug 22 07:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 8457.799975] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 07:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 8457.800751] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 07:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 8457.801581] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 07:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 8457.802380] ? __seccomp_filter+0x4a/0x4a0 Aug 22 07:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 8457.803130] ? __fget_files+0x86/0xc0 Aug 22 07:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 8457.803830] __x64_sys_ioctl+0x95/0xd0 Aug 22 07:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 8457.804656] do_syscall_64+0x5c/0xc0 Aug 22 07:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 8457.805370] ? do_futex+0x162/0x1f0 Aug 22 07:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 8457.806058] ? __x64_sys_futex+0x78/0x1e0 Aug 22 07:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 8457.806774] ? __secure_computing+0xa9/0x120 Aug 22 07:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 8457.807503] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 07:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 8457.808327] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 8457.809143] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 8457.810121] ? do_syscall_64+0x69/0xc0 Aug 22 07:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 8457.810839] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 8457.811633] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 8457.812401] ? do_syscall_64+0x69/0xc0 Aug 22 07:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 8457.813170] ? do_syscall_64+0x69/0xc0 Aug 22 07:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 8457.813878] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 07:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 8457.814664] RIP: 0033:0x7faa5d0edaff Aug 22 07:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 8457.815490] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 07:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 8457.817649] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 07:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 8457.818658] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 07:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 8457.819676] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 07:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 8457.820650] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 07:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 8457.821627] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 07:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 8457.822562] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 07:44:43 juju-e4d256-prod-github-runner-207 kernel: [ 8457.823514] Aug 22 07:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 8484.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 7793s! [qemu-system-x86:6715] Aug 22 07:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 8484.543150] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 07:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 8484.543227] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 07:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 8484.555858] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 07:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 8484.557169] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 07:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 8484.558409] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 8484.559485] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 07:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 8484.562097] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 07:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 8484.563150] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 07:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 8484.564345] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 07:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 8484.565571] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 07:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 8484.566753] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 07:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 8484.567934] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 07:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 8484.569157] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 07:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 8484.570419] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 07:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 8484.571537] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 07:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 8484.572764] Call Trace: Aug 22 07:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 8484.573688] Aug 22 07:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 8484.574574] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 8484.575612] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 8484.577156] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 8484.578277] ? show_regs.part.0+0x23/0x29 Aug 22 07:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 8484.579280] ? show_regs.cold+0x8/0xd Aug 22 07:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 8484.580263] ? watchdog_timer_fn+0x1be/0x220 Aug 22 07:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 8484.581324] ? lockup_detector_update_enable+0x60/0x60 Aug 22 07:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 8484.582420] ? __hrtimer_run_queues+0x107/0x230 Aug 22 07:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 8484.583475] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 07:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 8484.584506] ? hrtimer_interrupt+0x101/0x220 Aug 22 07:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 8484.585563] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 07:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 8484.586745] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 07:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 8484.587818] Aug 22 07:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 8484.588677] Aug 22 07:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 8484.589536] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 07:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 8484.590583] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 8484.591676] ? _raw_spin_lock+0x22/0x30 Aug 22 07:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 8484.592635] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 8484.593677] direct_page_fault+0x206/0x310 [kvm] Aug 22 07:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 8484.594723] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 07:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 8484.595768] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 07:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 8484.596793] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 07:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 8484.597774] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 07:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 8484.598743] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 07:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 8484.599759] handle_exit+0x98/0x230 [kvm_amd] Aug 22 07:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 8484.600660] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 07:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 8484.601598] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 07:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 8484.602538] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 07:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 8484.603478] vcpu_run+0x62/0x2c0 [kvm] Aug 22 07:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 8484.604296] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 07:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 8484.605136] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 07:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 8484.606003] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 07:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 8484.606816] ? __seccomp_filter+0x4a/0x4a0 Aug 22 07:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 8484.607579] ? __fget_files+0x86/0xc0 Aug 22 07:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 8484.608301] __x64_sys_ioctl+0x95/0xd0 Aug 22 07:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 8484.609026] do_syscall_64+0x5c/0xc0 Aug 22 07:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 8484.609715] ? do_futex+0x162/0x1f0 Aug 22 07:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 8484.610371] ? __x64_sys_futex+0x78/0x1e0 Aug 22 07:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 8484.611056] ? __secure_computing+0xa9/0x120 Aug 22 07:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 8484.611757] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 07:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 8484.612527] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 8484.613270] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 8484.613995] ? do_syscall_64+0x69/0xc0 Aug 22 07:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 8484.614654] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 8484.615365] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 8484.616070] ? do_syscall_64+0x69/0xc0 Aug 22 07:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 8484.616728] ? do_syscall_64+0x69/0xc0 Aug 22 07:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 8484.617386] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 07:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 8484.618103] RIP: 0033:0x7faa5d0edaff Aug 22 07:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 8484.618750] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 07:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 8484.620793] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 07:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 8484.621725] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 07:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 8484.622633] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 07:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 8484.623544] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 07:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 8484.624452] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 07:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 8484.625367] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 07:45:10 juju-e4d256-prod-github-runner-207 kernel: [ 8484.626274] Aug 22 07:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 8512.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 7819s! [qemu-system-x86:6715] Aug 22 07:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 8512.543785] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 07:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 8512.544061] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 07:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 8512.556390] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 07:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 8512.557680] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 07:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 8512.558918] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 8512.559994] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 07:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 8512.562778] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 07:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 8512.563828] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 07:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 8512.565017] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 07:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 8512.566198] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 07:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 8512.567377] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 07:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 8512.568584] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 07:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 8512.569772] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 07:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 8512.571019] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 07:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 8512.572168] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 07:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 8512.573582] Call Trace: Aug 22 07:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 8512.574499] Aug 22 07:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 8512.575396] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 8512.576452] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 8512.577487] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 8512.578778] ? show_regs.part.0+0x23/0x29 Aug 22 07:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 8512.579797] ? show_regs.cold+0x8/0xd Aug 22 07:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 8512.580799] ? watchdog_timer_fn+0x1be/0x220 Aug 22 07:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 8512.581829] ? lockup_detector_update_enable+0x60/0x60 Aug 22 07:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 8512.582902] ? __hrtimer_run_queues+0x107/0x230 Aug 22 07:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 8512.583936] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 07:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 8512.584982] ? hrtimer_interrupt+0x101/0x220 Aug 22 07:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 8512.586018] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 07:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 8512.587117] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 07:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 8512.588178] Aug 22 07:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 8512.589054] Aug 22 07:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 8512.589900] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 07:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 8512.590941] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 8512.591990] ? _raw_spin_lock+0x22/0x30 Aug 22 07:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 8512.592954] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 8512.593980] direct_page_fault+0x206/0x310 [kvm] Aug 22 07:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 8512.595019] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 07:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 8512.596038] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 07:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 8512.597060] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 07:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 8512.598070] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 07:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 8512.599022] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 07:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 8512.600009] handle_exit+0x98/0x230 [kvm_amd] Aug 22 07:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 8512.600915] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 07:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 8512.601838] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 07:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 8512.602780] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 07:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 8512.603694] vcpu_run+0x62/0x2c0 [kvm] Aug 22 07:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 8512.604529] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 07:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 8512.605380] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 07:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 8512.606246] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 07:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 8512.607060] ? __seccomp_filter+0x4a/0x4a0 Aug 22 07:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 8512.607822] ? __fget_files+0x86/0xc0 Aug 22 07:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 8512.608545] __x64_sys_ioctl+0x95/0xd0 Aug 22 07:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 8512.609247] do_syscall_64+0x5c/0xc0 Aug 22 07:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 8512.609918] ? do_futex+0x162/0x1f0 Aug 22 07:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 8512.610580] ? __x64_sys_futex+0x78/0x1e0 Aug 22 07:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 8512.611264] ? __secure_computing+0xa9/0x120 Aug 22 07:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 8512.611963] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 07:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 8512.612796] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 8512.613537] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 8512.614263] ? do_syscall_64+0x69/0xc0 Aug 22 07:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 8512.614914] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 8512.615630] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 8512.616348] ? do_syscall_64+0x69/0xc0 Aug 22 07:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 8512.616989] ? do_syscall_64+0x69/0xc0 Aug 22 07:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 8512.617669] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 07:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 8512.618408] RIP: 0033:0x7faa5d0edaff Aug 22 07:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 8512.619096] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 07:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 8512.621176] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 07:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 8512.622124] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 07:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 8512.623031] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 07:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 8512.623934] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 07:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 8512.624849] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 07:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 8512.625755] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 07:45:38 juju-e4d256-prod-github-runner-207 kernel: [ 8512.626660] Aug 22 07:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 8540.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 7845s! [qemu-system-x86:6715] Aug 22 07:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 8540.543112] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 07:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 8540.543187] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 07:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 8540.555501] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 07:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 8540.556827] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 07:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 8540.558235] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 8540.559296] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 07:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 8540.562295] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 07:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 8540.563362] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 07:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 8540.564593] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 07:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 8540.565783] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 07:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 8540.567045] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 07:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 8540.568249] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 07:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 8540.569448] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 07:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 8540.570777] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 07:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 8540.571945] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 07:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 8540.573233] Call Trace: Aug 22 07:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 8540.574155] Aug 22 07:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 8540.575044] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 8540.576095] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 8540.577123] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 8540.578222] ? show_regs.part.0+0x23/0x29 Aug 22 07:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 8540.579276] ? show_regs.cold+0x8/0xd Aug 22 07:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 8540.580276] ? watchdog_timer_fn+0x1be/0x220 Aug 22 07:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 8540.581289] ? lockup_detector_update_enable+0x60/0x60 Aug 22 07:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 8540.582357] ? __hrtimer_run_queues+0x107/0x230 Aug 22 07:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 8540.583386] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 07:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 8540.584434] ? hrtimer_interrupt+0x101/0x220 Aug 22 07:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 8540.585458] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 07:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 8540.586529] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 07:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 8540.587581] Aug 22 07:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 8540.588446] Aug 22 07:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 8540.589287] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 07:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 8540.590417] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 8540.591600] ? _raw_spin_lock+0x22/0x30 Aug 22 07:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 8540.592634] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 8540.593669] direct_page_fault+0x206/0x310 [kvm] Aug 22 07:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 8540.594699] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 07:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 8540.595716] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 07:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 8540.596733] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 07:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 8540.597714] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 07:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 8540.598665] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 07:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 8540.599647] handle_exit+0x98/0x230 [kvm_amd] Aug 22 07:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 8540.600559] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 07:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 8540.601480] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 07:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 8540.602416] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 07:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 8540.603345] vcpu_run+0x62/0x2c0 [kvm] Aug 22 07:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 8540.604178] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 07:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 8540.605052] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 07:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 8540.605926] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 07:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 8540.606727] ? __seccomp_filter+0x4a/0x4a0 Aug 22 07:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 8540.607470] ? __fget_files+0x86/0xc0 Aug 22 07:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 8540.608212] __x64_sys_ioctl+0x95/0xd0 Aug 22 07:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 8540.608917] do_syscall_64+0x5c/0xc0 Aug 22 07:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 8540.609587] ? do_futex+0x162/0x1f0 Aug 22 07:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 8540.610235] ? __x64_sys_futex+0x78/0x1e0 Aug 22 07:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 8540.610910] ? __secure_computing+0xa9/0x120 Aug 22 07:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 8540.611606] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 07:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 8540.612392] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 8540.613158] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 8540.613890] ? do_syscall_64+0x69/0xc0 Aug 22 07:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 8540.614553] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 8540.615277] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 8540.616022] ? do_syscall_64+0x69/0xc0 Aug 22 07:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 8540.616657] ? do_syscall_64+0x69/0xc0 Aug 22 07:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 8540.617379] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 07:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 8540.618356] RIP: 0033:0x7faa5d0edaff Aug 22 07:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 8540.619254] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 07:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 8540.621288] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 07:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 8540.622254] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 07:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 8540.623203] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 07:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 8540.624148] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 07:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 8540.625049] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 07:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 8540.625946] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 07:46:06 juju-e4d256-prod-github-runner-207 kernel: [ 8540.626841] Aug 22 07:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 8568.541982] watchdog: BUG: soft lockup - CPU#1 stuck for 7872s! [qemu-system-x86:6715] Aug 22 07:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 8568.543106] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 07:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 8568.543185] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 07:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 8568.556432] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 07:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 8568.557863] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 07:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 8568.559125] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 8568.560214] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 07:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 8568.562799] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 07:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 8568.563884] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 07:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 8568.565052] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 07:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 8568.566224] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 07:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 8568.567394] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 07:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 8568.568578] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 07:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 8568.569759] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 07:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 8568.571002] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 07:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 8568.572133] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 07:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 8568.573353] Call Trace: Aug 22 07:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 8568.574290] Aug 22 07:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 8568.575176] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 8568.576247] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 8568.577793] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 8568.579392] ? show_regs.part.0+0x23/0x29 Aug 22 07:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 8568.580432] ? show_regs.cold+0x8/0xd Aug 22 07:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 8568.581424] ? watchdog_timer_fn+0x1be/0x220 Aug 22 07:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 8568.582478] ? lockup_detector_update_enable+0x60/0x60 Aug 22 07:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 8568.583554] ? __hrtimer_run_queues+0x107/0x230 Aug 22 07:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 8568.584621] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 07:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 8568.585660] ? hrtimer_interrupt+0x101/0x220 Aug 22 07:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 8568.586689] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 07:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 8568.587805] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 07:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 8568.588865] Aug 22 07:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 8568.589749] Aug 22 07:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 8568.590598] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 07:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 8568.591664] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 8568.592723] ? _raw_spin_lock+0x22/0x30 Aug 22 07:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 8568.593683] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 8568.594705] direct_page_fault+0x206/0x310 [kvm] Aug 22 07:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 8568.595757] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 07:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 8568.596820] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 07:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 8568.597879] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 07:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 8568.598865] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 07:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 8568.599839] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 07:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 8568.600856] handle_exit+0x98/0x230 [kvm_amd] Aug 22 07:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 8568.601791] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 07:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 8568.602738] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 07:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 8568.603703] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 07:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 8568.604619] vcpu_run+0x62/0x2c0 [kvm] Aug 22 07:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 8568.605433] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 07:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 8568.606251] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 07:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 8568.607115] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 07:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 8568.607945] ? __seccomp_filter+0x4a/0x4a0 Aug 22 07:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 8568.608707] ? __fget_files+0x86/0xc0 Aug 22 07:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 8568.609416] __x64_sys_ioctl+0x95/0xd0 Aug 22 07:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 8568.610148] do_syscall_64+0x5c/0xc0 Aug 22 07:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 8568.610857] ? do_futex+0x162/0x1f0 Aug 22 07:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 8568.611531] ? __x64_sys_futex+0x78/0x1e0 Aug 22 07:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 8568.612282] ? __secure_computing+0xa9/0x120 Aug 22 07:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 8568.613000] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 07:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 8568.613786] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 8568.614522] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 8568.615243] ? do_syscall_64+0x69/0xc0 Aug 22 07:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 8568.615910] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 8568.616618] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 8568.617322] ? do_syscall_64+0x69/0xc0 Aug 22 07:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 8568.617977] ? do_syscall_64+0x69/0xc0 Aug 22 07:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 8568.618633] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 07:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 8568.619536] RIP: 0033:0x7faa5d0edaff Aug 22 07:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 8568.620350] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 07:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 8568.623008] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 07:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 8568.624226] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 07:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 8568.625133] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 07:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 8568.626037] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 07:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 8568.626929] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 07:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 8568.627834] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 07:46:34 juju-e4d256-prod-github-runner-207 kernel: [ 8568.628744] Aug 22 07:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 8596.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 7898s! [qemu-system-x86:6715] Aug 22 07:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 8596.543860] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 07:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 8596.544143] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 07:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 8596.556351] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 07:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 8596.557615] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 07:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 8596.558893] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 8596.559982] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 07:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 8596.562548] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 07:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 8596.563604] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 07:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 8596.564763] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 07:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 8596.565921] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 07:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 8596.567079] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 07:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 8596.568246] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 07:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 8596.569407] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 07:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 8596.570701] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 07:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 8596.571809] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 07:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 8596.573009] Call Trace: Aug 22 07:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 8596.573919] Aug 22 07:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 8596.574812] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 8596.575856] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 8596.576888] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 8596.577997] ? show_regs.part.0+0x23/0x29 Aug 22 07:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 8596.578992] ? show_regs.cold+0x8/0xd Aug 22 07:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 8596.579982] ? watchdog_timer_fn+0x1be/0x220 Aug 22 07:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 8596.580987] ? lockup_detector_update_enable+0x60/0x60 Aug 22 07:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 8596.582047] ? __hrtimer_run_queues+0x107/0x230 Aug 22 07:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 8596.583076] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 07:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 8596.584110] ? hrtimer_interrupt+0x101/0x220 Aug 22 07:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 8596.585123] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 07:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 8596.586192] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 07:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 8596.587258] Aug 22 07:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 8596.588107] Aug 22 07:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 8596.588942] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 07:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 8596.589977] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 8596.591010] ? _raw_spin_lock+0x22/0x30 Aug 22 07:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 8596.591973] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 8596.593010] direct_page_fault+0x206/0x310 [kvm] Aug 22 07:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 8596.594045] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 07:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 8596.595051] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 07:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 8596.596074] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 07:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 8596.597072] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 07:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 8596.598014] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 07:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 8596.598993] handle_exit+0x98/0x230 [kvm_amd] Aug 22 07:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 8596.599902] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 07:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 8596.600815] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 07:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 8596.601742] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 07:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 8596.602645] vcpu_run+0x62/0x2c0 [kvm] Aug 22 07:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 8596.603613] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 07:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 8596.604537] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 07:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 8596.605402] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 07:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 8596.606202] ? __seccomp_filter+0x4a/0x4a0 Aug 22 07:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 8596.606949] ? __fget_files+0x86/0xc0 Aug 22 07:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 8596.607924] __x64_sys_ioctl+0x95/0xd0 Aug 22 07:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 8596.608815] do_syscall_64+0x5c/0xc0 Aug 22 07:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 8596.609483] ? do_futex+0x162/0x1f0 Aug 22 07:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 8596.610135] ? __x64_sys_futex+0x78/0x1e0 Aug 22 07:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 8596.610814] ? __secure_computing+0xa9/0x120 Aug 22 07:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 8596.611526] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 07:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 8596.612300] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 8596.613031] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 8596.613762] ? do_syscall_64+0x69/0xc0 Aug 22 07:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 8596.614420] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 8596.615131] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 8596.615845] ? do_syscall_64+0x69/0xc0 Aug 22 07:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 8596.616480] ? do_syscall_64+0x69/0xc0 Aug 22 07:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 8596.617109] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 07:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 8596.617827] RIP: 0033:0x7faa5d0edaff Aug 22 07:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 8596.618501] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 07:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 8596.620574] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 07:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 8596.621503] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 07:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 8596.622408] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 07:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 8596.623328] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 07:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 8596.624231] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 07:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 8596.625133] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 07:47:02 juju-e4d256-prod-github-runner-207 kernel: [ 8596.626041] Aug 22 07:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 8624.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 7924s! [qemu-system-x86:6715] Aug 22 07:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 8624.543131] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 07:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 8624.543207] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 07:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 8624.556003] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 07:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 8624.557296] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 07:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 8624.558539] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 8624.559629] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 07:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 8624.562232] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 07:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 8624.563301] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 07:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 8624.564485] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 07:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 8624.565737] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 07:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 8624.566961] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 07:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 8624.568155] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 07:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 8624.569342] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 07:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 8624.570603] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 07:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 8624.571745] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 07:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 8624.572959] Call Trace: Aug 22 07:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 8624.573879] Aug 22 07:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 8624.574781] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 8624.575832] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 8624.576866] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 8624.577956] ? show_regs.part.0+0x23/0x29 Aug 22 07:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 8624.578983] ? show_regs.cold+0x8/0xd Aug 22 07:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 8624.579989] ? watchdog_timer_fn+0x1be/0x220 Aug 22 07:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 8624.581017] ? lockup_detector_update_enable+0x60/0x60 Aug 22 07:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 8624.582098] ? __hrtimer_run_queues+0x107/0x230 Aug 22 07:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 8624.583150] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 07:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 8624.584191] ? hrtimer_interrupt+0x101/0x220 Aug 22 07:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 8624.585219] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 07:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 8624.586322] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 07:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 8624.587393] Aug 22 07:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 8624.588280] Aug 22 07:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 8624.589124] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 07:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 8624.590180] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 8624.591255] ? _raw_spin_lock+0x22/0x30 Aug 22 07:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 8624.592215] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 8624.593262] direct_page_fault+0x206/0x310 [kvm] Aug 22 07:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 8624.594303] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 07:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 8624.595337] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 07:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 8624.596356] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 07:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 8624.597339] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 07:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 8624.598296] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 07:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 8624.599303] handle_exit+0x98/0x230 [kvm_amd] Aug 22 07:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 8624.600248] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 07:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 8624.601182] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 07:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 8624.602132] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 07:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 8624.603070] vcpu_run+0x62/0x2c0 [kvm] Aug 22 07:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 8624.603896] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 07:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 8624.604724] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 07:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 8624.605672] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 07:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 8624.606515] ? __seccomp_filter+0x4a/0x4a0 Aug 22 07:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 8624.607290] ? __fget_files+0x86/0xc0 Aug 22 07:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 8624.608015] __x64_sys_ioctl+0x95/0xd0 Aug 22 07:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 8624.608752] do_syscall_64+0x5c/0xc0 Aug 22 07:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 8624.609434] ? do_futex+0x162/0x1f0 Aug 22 07:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 8624.610151] ? __x64_sys_futex+0x78/0x1e0 Aug 22 07:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 8624.610920] ? __secure_computing+0xa9/0x120 Aug 22 07:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 8624.611639] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 07:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 8624.612419] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 8624.613165] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 8624.613900] ? do_syscall_64+0x69/0xc0 Aug 22 07:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 8624.614562] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 8624.615294] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 8624.616010] ? do_syscall_64+0x69/0xc0 Aug 22 07:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 8624.616647] ? do_syscall_64+0x69/0xc0 Aug 22 07:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 8624.617288] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 07:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 8624.618068] RIP: 0033:0x7faa5d0edaff Aug 22 07:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 8624.618758] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 07:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 8624.620879] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 07:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 8624.621886] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 07:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 8624.622953] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 07:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 8624.623876] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 07:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 8624.624791] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 07:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 8624.625716] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 07:47:30 juju-e4d256-prod-github-runner-207 kernel: [ 8624.626640] Aug 22 07:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 8637.764708] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 07:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 8637.765683] rcu: 1-....: (2123462 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=1028343 Aug 22 07:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 8637.766821] (t=2130141 jiffies g=23269 q=17539) Aug 22 07:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 8637.767604] NMI backtrace for cpu 1 Aug 22 07:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 8637.768318] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 07:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 8637.769449] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 07:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 8637.770553] Call Trace: Aug 22 07:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 8637.771295] Aug 22 07:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 8637.772115] show_stack+0x52/0x5c Aug 22 07:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 8637.772883] dump_stack_lvl+0x4a/0x63 Aug 22 07:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 8637.773926] dump_stack+0x10/0x16 Aug 22 07:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 8637.774657] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 07:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 8637.775456] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 07:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 8637.776241] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 07:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 8637.777063] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 07:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 8637.777883] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 07:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 8637.778695] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 07:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 8637.779487] print_cpu_stall.cold+0x2f/0xe2 Aug 22 07:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 8637.780257] ? timekeeping_update+0xf7/0x150 Aug 22 07:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 8637.781037] check_cpu_stall+0x109/0x270 Aug 22 07:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 8637.781791] rcu_sched_clock_irq+0x9a/0x250 Aug 22 07:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 8637.782554] update_process_times+0x94/0xd0 Aug 22 07:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 8637.783341] tick_sched_handle+0x29/0x70 Aug 22 07:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 8637.784090] tick_sched_timer+0x8c/0xc0 Aug 22 07:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 8637.784827] ? tick_nohz_handler+0xb0/0xb0 Aug 22 07:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 8637.785581] __hrtimer_run_queues+0x107/0x230 Aug 22 07:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 8637.786358] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 07:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 8637.787193] hrtimer_interrupt+0x101/0x220 Aug 22 07:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 8637.787954] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 07:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 8637.788789] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 07:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 8637.789592] Aug 22 07:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 8637.790233] Aug 22 07:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 8637.790992] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 07:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 8637.791915] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 8637.792915] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 07:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 8637.795515] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 07:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 8637.796512] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 07:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 8637.797695] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 07:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 8637.798824] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 07:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 8637.799927] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 07:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 8637.801168] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 07:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 8637.802253] ? _raw_spin_lock+0x22/0x30 Aug 22 07:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 8637.803100] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 8637.804051] direct_page_fault+0x206/0x310 [kvm] Aug 22 07:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 8637.805009] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 07:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 8637.805929] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 07:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 8637.807032] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 07:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 8637.808059] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 07:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 8637.808932] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 07:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 8637.809856] handle_exit+0x98/0x230 [kvm_amd] Aug 22 07:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 8637.810691] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 07:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 8637.811574] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 07:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 8637.812464] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 07:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 8637.813345] vcpu_run+0x62/0x2c0 [kvm] Aug 22 07:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 8637.814135] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 07:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 8637.814990] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 07:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 8637.815897] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 07:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 8637.816737] ? __seccomp_filter+0x4a/0x4a0 Aug 22 07:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 8637.817531] ? __fget_files+0x86/0xc0 Aug 22 07:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 8637.818294] __x64_sys_ioctl+0x95/0xd0 Aug 22 07:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 8637.819078] do_syscall_64+0x5c/0xc0 Aug 22 07:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 8637.819828] ? do_futex+0x162/0x1f0 Aug 22 07:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 8637.820564] ? __x64_sys_futex+0x78/0x1e0 Aug 22 07:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 8637.821339] ? __secure_computing+0xa9/0x120 Aug 22 07:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 8637.822157] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 07:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 8637.823076] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 8637.823944] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 8637.824792] ? do_syscall_64+0x69/0xc0 Aug 22 07:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 8637.825552] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 8637.826399] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 8637.827267] ? do_syscall_64+0x69/0xc0 Aug 22 07:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 8637.828038] ? do_syscall_64+0x69/0xc0 Aug 22 07:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 8637.828812] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 07:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 8637.829676] RIP: 0033:0x7faa5d0edaff Aug 22 07:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 8637.830436] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 07:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 8637.832870] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 07:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 8637.833979] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 07:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 8637.835087] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 07:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 8637.836168] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 07:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 8637.837242] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 07:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 8637.838306] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 07:47:43 juju-e4d256-prod-github-runner-207 kernel: [ 8637.839364] Aug 22 07:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 8664.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 7961s! [qemu-system-x86:6715] Aug 22 07:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 8664.543224] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 07:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 8664.543522] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 07:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 8664.555991] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 07:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 8664.557275] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 07:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 8664.558533] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 8664.559603] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 07:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 8664.562178] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 07:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 8664.563278] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 07:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 8664.564456] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 07:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 8664.565702] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 07:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 8664.566909] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 07:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 8664.568124] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 07:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 8664.569305] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 07:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 8664.570631] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 07:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 8664.571816] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 07:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 8664.573073] Call Trace: Aug 22 07:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 8664.573999] Aug 22 07:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 8664.574940] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 8664.576026] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 8664.577080] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 8664.578215] ? show_regs.part.0+0x23/0x29 Aug 22 07:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 8664.579253] ? show_regs.cold+0x8/0xd Aug 22 07:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 8664.580247] ? watchdog_timer_fn+0x1be/0x220 Aug 22 07:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 8664.581324] ? lockup_detector_update_enable+0x60/0x60 Aug 22 07:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 8664.582452] ? __hrtimer_run_queues+0x107/0x230 Aug 22 07:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 8664.583526] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 07:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 8664.584568] ? hrtimer_interrupt+0x101/0x220 Aug 22 07:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 8664.585595] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 07:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 8664.586701] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 07:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 8664.587772] Aug 22 07:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 8664.588629] Aug 22 07:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 8664.589470] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 07:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 8664.590711] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 8664.591762] ? _raw_spin_lock+0x22/0x30 Aug 22 07:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 8664.593000] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 8664.594035] direct_page_fault+0x206/0x310 [kvm] Aug 22 07:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 8664.595098] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 07:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 8664.596124] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 07:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 8664.597136] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 07:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 8664.598140] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 07:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 8664.599115] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 07:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 8664.600106] handle_exit+0x98/0x230 [kvm_amd] Aug 22 07:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 8664.601012] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 07:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 8664.601938] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 07:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 8664.602899] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 07:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 8664.603819] vcpu_run+0x62/0x2c0 [kvm] Aug 22 07:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 8664.604643] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 07:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 8664.605464] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 07:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 8664.606332] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 07:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 8664.607171] ? __seccomp_filter+0x4a/0x4a0 Aug 22 07:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 8664.607924] ? __fget_files+0x86/0xc0 Aug 22 07:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 8664.608638] __x64_sys_ioctl+0x95/0xd0 Aug 22 07:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 8664.609344] do_syscall_64+0x5c/0xc0 Aug 22 07:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 8664.610019] ? do_futex+0x162/0x1f0 Aug 22 07:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 8664.610694] ? __x64_sys_futex+0x78/0x1e0 Aug 22 07:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 8664.611517] ? __secure_computing+0xa9/0x120 Aug 22 07:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 8664.612219] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 07:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 8664.612994] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 8664.613727] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 8664.614507] ? do_syscall_64+0x69/0xc0 Aug 22 07:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 8664.615178] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 8664.615896] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 8664.616623] ? do_syscall_64+0x69/0xc0 Aug 22 07:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 8664.617260] ? do_syscall_64+0x69/0xc0 Aug 22 07:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 8664.617893] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 07:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 8664.618629] RIP: 0033:0x7faa5d0edaff Aug 22 07:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 8664.619291] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 07:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 8664.621330] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 07:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 8664.622264] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 07:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 8664.623199] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 07:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 8664.624107] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 07:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 8664.625010] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 07:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 8664.625915] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 07:48:10 juju-e4d256-prod-github-runner-207 kernel: [ 8664.626855] Aug 22 07:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 8692.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 7987s! [qemu-system-x86:6715] Aug 22 07:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 8692.543809] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 07:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 8692.543979] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 07:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 8692.556537] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 07:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 8692.557826] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 07:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 8692.559094] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 8692.560175] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 07:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 8692.562784] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 07:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 8692.563845] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 07:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 8692.565020] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 07:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 8692.566209] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 07:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 8692.567418] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 07:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 8692.568589] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 07:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 8692.569767] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 07:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 8692.571032] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 07:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 8692.572149] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 07:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 8692.573416] Call Trace: Aug 22 07:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 8692.574357] Aug 22 07:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 8692.575308] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 8692.576346] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 8692.577380] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 8692.578480] ? show_regs.part.0+0x23/0x29 Aug 22 07:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 8692.579494] ? show_regs.cold+0x8/0xd Aug 22 07:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 8692.580471] ? watchdog_timer_fn+0x1be/0x220 Aug 22 07:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 8692.581486] ? lockup_detector_update_enable+0x60/0x60 Aug 22 07:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 8692.582580] ? __hrtimer_run_queues+0x107/0x230 Aug 22 07:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 8692.583648] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 07:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 8692.584694] ? hrtimer_interrupt+0x101/0x220 Aug 22 07:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 8692.585725] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 07:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 8692.586880] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 07:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 8692.588046] Aug 22 07:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 8692.588915] Aug 22 07:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 8692.589757] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 07:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 8692.590850] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 8692.591978] ? _raw_spin_lock+0x22/0x30 Aug 22 07:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 8692.593023] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 8692.594310] direct_page_fault+0x206/0x310 [kvm] Aug 22 07:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 8692.595552] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 07:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 8692.596630] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 07:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 8692.597640] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 07:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 8692.598649] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 07:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 8692.599604] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 07:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 8692.600624] handle_exit+0x98/0x230 [kvm_amd] Aug 22 07:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 8692.601547] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 07:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 8692.602487] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 07:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 8692.603421] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 07:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 8692.604331] vcpu_run+0x62/0x2c0 [kvm] Aug 22 07:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 8692.605145] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 07:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 8692.605960] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 07:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 8692.606841] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 07:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 8692.607660] ? __seccomp_filter+0x4a/0x4a0 Aug 22 07:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 8692.608409] ? __fget_files+0x86/0xc0 Aug 22 07:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 8692.609116] __x64_sys_ioctl+0x95/0xd0 Aug 22 07:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 8692.609818] do_syscall_64+0x5c/0xc0 Aug 22 07:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 8692.610509] ? do_futex+0x162/0x1f0 Aug 22 07:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 8692.611162] ? __x64_sys_futex+0x78/0x1e0 Aug 22 07:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 8692.611839] ? __secure_computing+0xa9/0x120 Aug 22 07:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 8692.612540] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 07:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 8692.613306] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 8692.614091] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 8692.614817] ? do_syscall_64+0x69/0xc0 Aug 22 07:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 8692.615472] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 8692.616183] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 8692.616884] ? do_syscall_64+0x69/0xc0 Aug 22 07:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 8692.617528] ? do_syscall_64+0x69/0xc0 Aug 22 07:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 8692.618179] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 07:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 8692.618893] RIP: 0033:0x7faa5d0edaff Aug 22 07:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 8692.619541] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 07:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 8692.621562] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 07:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 8692.622500] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 07:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 8692.623417] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 07:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 8692.624390] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 07:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 8692.625307] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 07:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 8692.626213] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 07:48:38 juju-e4d256-prod-github-runner-207 kernel: [ 8692.627140] Aug 22 07:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 8720.541981] watchdog: BUG: soft lockup - CPU#1 stuck for 8013s! [qemu-system-x86:6715] Aug 22 07:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 8720.543162] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 07:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 8720.543239] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 07:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 8720.556563] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 07:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 8720.557890] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 07:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 8720.559143] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 8720.560237] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 07:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 8720.562904] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 07:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 8720.563987] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 07:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 8720.565184] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 07:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 8720.566410] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 07:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 8720.567597] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 07:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 8720.568775] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 07:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 8720.570009] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 07:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 8720.571297] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 07:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 8720.572500] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 07:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 8720.573780] Call Trace: Aug 22 07:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 8720.574745] Aug 22 07:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 8720.575837] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 8720.576990] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 8720.578204] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 8720.579301] ? show_regs.part.0+0x23/0x29 Aug 22 07:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 8720.580309] ? show_regs.cold+0x8/0xd Aug 22 07:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 8720.581296] ? watchdog_timer_fn+0x1be/0x220 Aug 22 07:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 8720.582362] ? lockup_detector_update_enable+0x60/0x60 Aug 22 07:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 8720.583545] ? __hrtimer_run_queues+0x107/0x230 Aug 22 07:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 8720.584628] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 07:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 8720.585689] ? hrtimer_interrupt+0x101/0x220 Aug 22 07:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 8720.586968] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 07:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 8720.588161] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 07:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 8720.589320] Aug 22 07:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 8720.590264] Aug 22 07:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 8720.591174] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 07:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 8720.592318] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 8720.593487] ? _raw_spin_lock+0x22/0x30 Aug 22 07:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 8720.594549] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 8720.595673] direct_page_fault+0x206/0x310 [kvm] Aug 22 07:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 8720.596802] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 07:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 8720.597937] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 07:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 8720.599036] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 07:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 8720.600109] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 07:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 8720.601156] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 07:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 8720.602268] handle_exit+0x98/0x230 [kvm_amd] Aug 22 07:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 8720.603264] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 07:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 8720.604283] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 07:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 8720.605330] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 07:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 8720.606363] vcpu_run+0x62/0x2c0 [kvm] Aug 22 07:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 8720.607258] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 07:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 8720.608159] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 07:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 8720.609120] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 07:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 8720.610037] ? __seccomp_filter+0x4a/0x4a0 Aug 22 07:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 8720.610885] ? __fget_files+0x86/0xc0 Aug 22 07:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 8720.611668] __x64_sys_ioctl+0x95/0xd0 Aug 22 07:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 8720.612447] do_syscall_64+0x5c/0xc0 Aug 22 07:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 8720.613197] ? do_futex+0x162/0x1f0 Aug 22 07:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 8720.613942] ? __x64_sys_futex+0x78/0x1e0 Aug 22 07:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 8720.614729] ? __secure_computing+0xa9/0x120 Aug 22 07:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 8720.615529] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 07:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 8720.616397] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 8720.617216] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 8720.618053] ? do_syscall_64+0x69/0xc0 Aug 22 07:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 8720.618785] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 8720.619583] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 8720.620374] ? do_syscall_64+0x69/0xc0 Aug 22 07:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 8720.621085] ? do_syscall_64+0x69/0xc0 Aug 22 07:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 8720.621824] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 07:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 8720.622641] RIP: 0033:0x7faa5d0edaff Aug 22 07:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 8720.623345] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 07:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 8720.625749] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 07:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 8720.626881] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 07:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 8720.627923] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 07:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 8720.628954] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 07:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 8720.630011] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 07:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 8720.631040] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 07:49:06 juju-e4d256-prod-github-runner-207 kernel: [ 8720.632092] Aug 22 07:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 8748.541981] watchdog: BUG: soft lockup - CPU#1 stuck for 8039s! [qemu-system-x86:6715] Aug 22 07:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 8748.543149] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 07:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 8748.543231] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 07:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 8748.558009] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 07:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 8748.559391] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 07:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 8748.560698] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 8748.561882] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 07:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 8748.565047] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 07:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 8748.566174] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 07:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 8748.567529] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 07:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 8748.569094] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 07:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 8748.570581] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 07:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 8748.571955] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 07:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 8748.573186] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 07:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 8748.574491] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 07:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 8748.575743] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 07:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 8748.577213] Call Trace: Aug 22 07:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 8748.578410] Aug 22 07:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 8748.579380] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 8748.580757] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 8748.582110] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 8748.583449] ? show_regs.part.0+0x23/0x29 Aug 22 07:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 8748.584722] ? show_regs.cold+0x8/0xd Aug 22 07:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 8748.585853] ? watchdog_timer_fn+0x1be/0x220 Aug 22 07:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 8748.587092] ? lockup_detector_update_enable+0x60/0x60 Aug 22 07:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 8748.588233] ? __hrtimer_run_queues+0x107/0x230 Aug 22 07:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 8748.589346] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 07:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 8748.590462] ? hrtimer_interrupt+0x101/0x220 Aug 22 07:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 8748.591731] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 07:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 8748.592966] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 07:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 8748.594163] Aug 22 07:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 8748.595160] Aug 22 07:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 8748.596079] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 07:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 8748.597455] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 8748.598522] ? _raw_spin_lock+0x22/0x30 Aug 22 07:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 8748.599476] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 8748.600544] direct_page_fault+0x206/0x310 [kvm] Aug 22 07:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 8748.601786] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 07:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 8748.602816] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 07:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 8748.603825] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 07:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 8748.604809] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 07:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 8748.605786] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 07:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 8748.606768] handle_exit+0x98/0x230 [kvm_amd] Aug 22 07:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 8748.607664] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 07:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 8748.608581] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 07:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 8748.609524] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 07:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 8748.610431] vcpu_run+0x62/0x2c0 [kvm] Aug 22 07:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 8748.611248] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 07:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 8748.612064] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 07:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 8748.612921] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 07:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 8748.613736] ? __seccomp_filter+0x4a/0x4a0 Aug 22 07:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 8748.614488] ? __fget_files+0x86/0xc0 Aug 22 07:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 8748.615193] __x64_sys_ioctl+0x95/0xd0 Aug 22 07:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 8748.616004] do_syscall_64+0x5c/0xc0 Aug 22 07:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 8748.616913] ? do_futex+0x162/0x1f0 Aug 22 07:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 8748.617851] ? __x64_sys_futex+0x78/0x1e0 Aug 22 07:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 8748.618603] ? __secure_computing+0xa9/0x120 Aug 22 07:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 8748.619623] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 07:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 8748.620489] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 8748.621458] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 8748.622192] ? do_syscall_64+0x69/0xc0 Aug 22 07:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 8748.622845] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 8748.623689] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 8748.624638] ? do_syscall_64+0x69/0xc0 Aug 22 07:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 8748.625348] ? do_syscall_64+0x69/0xc0 Aug 22 07:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 8748.626009] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 07:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 8748.626954] RIP: 0033:0x7faa5d0edaff Aug 22 07:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 8748.627660] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 07:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 8748.630191] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 07:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 8748.631239] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 07:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 8748.632331] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 07:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 8748.633245] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 07:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 8748.634171] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 07:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 8748.635091] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 07:49:34 juju-e4d256-prod-github-runner-207 kernel: [ 8748.635996] Aug 22 07:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 8776.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 8065s! [qemu-system-x86:6715] Aug 22 07:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 8776.543834] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 07:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 8776.544120] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 07:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 8776.556525] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 07:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 8776.557813] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 07:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 8776.559043] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 8776.560212] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 07:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 8776.562822] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 07:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 8776.563874] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 07:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 8776.565050] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 07:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 8776.566208] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 07:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 8776.567401] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 07:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 8776.568589] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 07:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 8776.569786] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 07:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 8776.571022] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 07:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 8776.572142] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 07:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 8776.573351] Call Trace: Aug 22 07:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 8776.574282] Aug 22 07:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 8776.575226] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 8776.576257] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 8776.577310] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 8776.578410] ? show_regs.part.0+0x23/0x29 Aug 22 07:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 8776.579405] ? show_regs.cold+0x8/0xd Aug 22 07:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 8776.580407] ? watchdog_timer_fn+0x1be/0x220 Aug 22 07:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 8776.581443] ? lockup_detector_update_enable+0x60/0x60 Aug 22 07:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 8776.582511] ? __hrtimer_run_queues+0x107/0x230 Aug 22 07:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 8776.583542] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 07:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 8776.584562] ? hrtimer_interrupt+0x101/0x220 Aug 22 07:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 8776.585597] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 07:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 8776.586679] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 07:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 8776.587739] Aug 22 07:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 8776.588591] Aug 22 07:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 8776.589441] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 07:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 8776.590491] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 8776.591548] ? _raw_spin_lock+0x22/0x30 Aug 22 07:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 8776.592492] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 8776.593533] direct_page_fault+0x206/0x310 [kvm] Aug 22 07:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 8776.594556] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 07:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 8776.595562] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 07:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 8776.596565] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 07:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 8776.597601] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 07:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 8776.598552] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 07:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 8776.599533] handle_exit+0x98/0x230 [kvm_amd] Aug 22 07:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 8776.600426] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 07:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 8776.601359] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 07:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 8776.602288] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 07:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 8776.603201] vcpu_run+0x62/0x2c0 [kvm] Aug 22 07:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 8776.604078] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 07:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 8776.604903] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 07:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 8776.605848] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 07:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 8776.606668] ? __seccomp_filter+0x4a/0x4a0 Aug 22 07:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 8776.607439] ? __fget_files+0x86/0xc0 Aug 22 07:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 8776.608149] __x64_sys_ioctl+0x95/0xd0 Aug 22 07:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 8776.608843] do_syscall_64+0x5c/0xc0 Aug 22 07:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 8776.609533] ? do_futex+0x162/0x1f0 Aug 22 07:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 8776.610179] ? __x64_sys_futex+0x78/0x1e0 Aug 22 07:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 8776.610863] ? __secure_computing+0xa9/0x120 Aug 22 07:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 8776.611556] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 07:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 8776.612322] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 8776.613057] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 8776.613785] ? do_syscall_64+0x69/0xc0 Aug 22 07:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 8776.614428] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 8776.615136] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 8776.615849] ? do_syscall_64+0x69/0xc0 Aug 22 07:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 8776.616472] ? do_syscall_64+0x69/0xc0 Aug 22 07:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 8776.617106] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 07:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 8776.617853] RIP: 0033:0x7faa5d0edaff Aug 22 07:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 8776.618531] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 07:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 8776.620561] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 07:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 8776.621512] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 07:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 8776.622439] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 07:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 8776.623368] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 07:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 8776.624257] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 07:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 8776.625191] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 07:50:02 juju-e4d256-prod-github-runner-207 kernel: [ 8776.626093] Aug 22 07:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 8804.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 8091s! [qemu-system-x86:6715] Aug 22 07:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 8804.543096] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 07:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 8804.543166] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 07:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 8804.556119] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 07:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 8804.557549] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 07:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 8804.558873] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 8804.559959] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 07:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 8804.562588] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 07:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 8804.563773] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 07:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 8804.565125] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 07:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 8804.566412] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 07:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 8804.567712] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 07:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 8804.568956] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 07:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 8804.570222] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 07:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 8804.571588] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 07:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 8804.572838] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 07:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 8804.574140] Call Trace: Aug 22 07:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 8804.575072] Aug 22 07:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 8804.576046] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 8804.577216] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 8804.578292] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 8804.579535] ? show_regs.part.0+0x23/0x29 Aug 22 07:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 8804.580631] ? show_regs.cold+0x8/0xd Aug 22 07:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 8804.581663] ? watchdog_timer_fn+0x1be/0x220 Aug 22 07:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 8804.582723] ? lockup_detector_update_enable+0x60/0x60 Aug 22 07:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 8804.583923] ? __hrtimer_run_queues+0x107/0x230 Aug 22 07:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 8804.585270] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 07:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 8804.586555] ? hrtimer_interrupt+0x101/0x220 Aug 22 07:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 8804.587678] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 07:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 8804.588816] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 07:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 8804.589971] Aug 22 07:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 8804.590860] Aug 22 07:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 8804.591728] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 07:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 8804.592913] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 8804.594036] ? _raw_spin_lock+0x22/0x30 Aug 22 07:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 8804.595089] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 8804.596164] direct_page_fault+0x206/0x310 [kvm] Aug 22 07:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 8804.597305] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 07:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 8804.598522] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 07:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 8804.599717] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 07:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 8804.600916] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 07:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 8804.601897] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 07:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 8804.602895] handle_exit+0x98/0x230 [kvm_amd] Aug 22 07:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 8804.603811] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 07:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 8804.604772] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 07:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 8804.605774] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 07:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 8804.606724] vcpu_run+0x62/0x2c0 [kvm] Aug 22 07:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 8804.607552] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 07:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 8804.608407] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 07:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 8804.609348] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 07:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 8804.610164] ? __seccomp_filter+0x4a/0x4a0 Aug 22 07:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 8804.610927] ? __fget_files+0x86/0xc0 Aug 22 07:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 8804.611655] __x64_sys_ioctl+0x95/0xd0 Aug 22 07:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 8804.612375] do_syscall_64+0x5c/0xc0 Aug 22 07:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 8804.613091] ? do_futex+0x162/0x1f0 Aug 22 07:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 8804.613752] ? __x64_sys_futex+0x78/0x1e0 Aug 22 07:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 8804.614443] ? __secure_computing+0xa9/0x120 Aug 22 07:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 8804.615149] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 07:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 8804.615964] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 8804.616786] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 8804.617534] ? do_syscall_64+0x69/0xc0 Aug 22 07:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 8804.618201] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 8804.618918] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 8804.619628] ? do_syscall_64+0x69/0xc0 Aug 22 07:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 8804.620269] ? do_syscall_64+0x69/0xc0 Aug 22 07:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 8804.620955] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 07:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 8804.621690] RIP: 0033:0x7faa5d0edaff Aug 22 07:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 8804.622338] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 07:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 8804.624448] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 07:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 8804.625485] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 07:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 8804.626419] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 07:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 8804.627365] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 07:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 8804.628279] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 07:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 8804.629294] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 07:50:30 juju-e4d256-prod-github-runner-207 kernel: [ 8804.630219] Aug 22 07:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 8817.776707] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 07:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 8817.777881] rcu: 1-....: (2168323 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=1049855 Aug 22 07:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 8817.779039] (t=2175144 jiffies g=23269 q=17715) Aug 22 07:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 8817.779839] NMI backtrace for cpu 1 Aug 22 07:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 8817.780601] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 07:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 8817.781878] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 07:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 8817.783050] Call Trace: Aug 22 07:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 8817.783947] Aug 22 07:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 8817.784627] show_stack+0x52/0x5c Aug 22 07:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 8817.785375] dump_stack_lvl+0x4a/0x63 Aug 22 07:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 8817.786130] dump_stack+0x10/0x16 Aug 22 07:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 8817.786864] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 07:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 8817.787660] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 07:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 8817.788463] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 07:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 8817.789303] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 07:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 8817.790135] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 07:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 8817.790955] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 07:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 8817.791756] print_cpu_stall.cold+0x2f/0xe2 Aug 22 07:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 8817.792796] ? timekeeping_update+0xf7/0x150 Aug 22 07:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 8817.793583] check_cpu_stall+0x109/0x270 Aug 22 07:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 8817.794339] rcu_sched_clock_irq+0x9a/0x250 Aug 22 07:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 8817.795111] update_process_times+0x94/0xd0 Aug 22 07:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 8817.795882] tick_sched_handle+0x29/0x70 Aug 22 07:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 8817.796659] tick_sched_timer+0x8c/0xc0 Aug 22 07:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 8817.797416] ? tick_nohz_handler+0xb0/0xb0 Aug 22 07:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 8817.798185] __hrtimer_run_queues+0x107/0x230 Aug 22 07:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 8817.798968] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 07:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 8817.799753] hrtimer_interrupt+0x101/0x220 Aug 22 07:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 8817.800541] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 07:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 8817.801367] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 07:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 8817.802378] Aug 22 07:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 8817.803022] Aug 22 07:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 8817.803664] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 07:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 8817.804512] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 8817.805409] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 07:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 8817.807672] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 07:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 8817.808578] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 07:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 8817.809604] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 07:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 8817.810604] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 07:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 8817.811639] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 07:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 8817.812642] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 07:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 8817.813617] ? _raw_spin_lock+0x22/0x30 Aug 22 07:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 8817.814388] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 8817.815238] direct_page_fault+0x206/0x310 [kvm] Aug 22 07:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 8817.816312] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 07:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 8817.817381] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 07:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 8817.818246] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 07:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 8817.819065] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 07:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 8817.819894] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 07:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 8817.820765] handle_exit+0x98/0x230 [kvm_amd] Aug 22 07:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 8817.821551] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 07:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 8817.822362] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 07:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 8817.823212] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 07:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 8817.824073] vcpu_run+0x62/0x2c0 [kvm] Aug 22 07:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 8817.824822] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 07:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 8817.825580] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 07:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 8817.826398] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 07:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 8817.827247] ? __seccomp_filter+0x4a/0x4a0 Aug 22 07:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 8817.827992] ? __fget_files+0x86/0xc0 Aug 22 07:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 8817.828722] __x64_sys_ioctl+0x95/0xd0 Aug 22 07:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 8817.829435] do_syscall_64+0x5c/0xc0 Aug 22 07:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 8817.830152] ? do_futex+0x162/0x1f0 Aug 22 07:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 8817.830850] ? __x64_sys_futex+0x78/0x1e0 Aug 22 07:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 8817.831582] ? __secure_computing+0xa9/0x120 Aug 22 07:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 8817.832327] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 07:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 8817.833166] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 8817.833952] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 8817.834733] ? do_syscall_64+0x69/0xc0 Aug 22 07:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 8817.835463] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 8817.836252] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 8817.837046] ? do_syscall_64+0x69/0xc0 Aug 22 07:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 8817.837771] ? do_syscall_64+0x69/0xc0 Aug 22 07:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 8817.838484] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 07:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 8817.839294] RIP: 0033:0x7faa5d0edaff Aug 22 07:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 8817.840007] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 07:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 8817.842234] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 07:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 8817.843228] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 07:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 8817.844225] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 07:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 8817.845254] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 07:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 8817.846234] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 07:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 8817.847197] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 07:50:43 juju-e4d256-prod-github-runner-207 kernel: [ 8817.848163] Aug 22 07:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 8844.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 8129s! [qemu-system-x86:6715] Aug 22 07:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 8844.543109] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 07:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 8844.543181] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 07:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 8844.555729] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 07:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 8844.557014] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 07:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 8844.558233] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 8844.559295] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 07:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 8844.561864] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 07:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 8844.562927] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 07:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 8844.564104] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 07:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 8844.565276] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 07:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 8844.566440] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 07:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 8844.567599] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 07:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 8844.571373] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 07:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 8844.572650] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 07:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 8844.573751] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 07:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 8844.574951] Call Trace: Aug 22 07:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 8844.575867] Aug 22 07:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 8844.576762] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 8844.577794] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 8844.578815] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 8844.579926] ? show_regs.part.0+0x23/0x29 Aug 22 07:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 8844.580960] ? show_regs.cold+0x8/0xd Aug 22 07:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 8844.581938] ? watchdog_timer_fn+0x1be/0x220 Aug 22 07:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 8844.582945] ? lockup_detector_update_enable+0x60/0x60 Aug 22 07:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 8844.584011] ? __hrtimer_run_queues+0x107/0x230 Aug 22 07:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 8844.585047] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 07:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 8844.586070] ? hrtimer_interrupt+0x101/0x220 Aug 22 07:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 8844.587102] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 07:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 8844.588188] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 07:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 8844.589233] Aug 22 07:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 8844.590090] Aug 22 07:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 8844.590928] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 07:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 8844.591959] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 8844.593007] ? _raw_spin_lock+0x22/0x30 Aug 22 07:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 8844.593952] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 8844.594974] direct_page_fault+0x206/0x310 [kvm] Aug 22 07:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 8844.595996] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 07:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 8844.597028] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 07:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 8844.598175] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 07:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 8844.599149] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 07:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 8844.600128] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 07:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 8844.601117] handle_exit+0x98/0x230 [kvm_amd] Aug 22 07:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 8844.602022] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 07:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 8844.602947] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 07:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 8844.603934] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 07:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 8844.604873] vcpu_run+0x62/0x2c0 [kvm] Aug 22 07:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 8844.605684] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 07:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 8844.606505] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 07:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 8844.607368] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 07:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 8844.608182] ? __seccomp_filter+0x4a/0x4a0 Aug 22 07:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 8844.608931] ? __fget_files+0x86/0xc0 Aug 22 07:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 8844.609634] __x64_sys_ioctl+0x95/0xd0 Aug 22 07:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 8844.610385] do_syscall_64+0x5c/0xc0 Aug 22 07:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 8844.611091] ? do_futex+0x162/0x1f0 Aug 22 07:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 8844.611742] ? __x64_sys_futex+0x78/0x1e0 Aug 22 07:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 8844.612457] ? __secure_computing+0xa9/0x120 Aug 22 07:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 8844.613157] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 07:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 8844.613916] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 8844.614662] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 8844.615404] ? do_syscall_64+0x69/0xc0 Aug 22 07:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 8844.616152] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 8844.616880] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 8844.617576] ? do_syscall_64+0x69/0xc0 Aug 22 07:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 8844.618207] ? do_syscall_64+0x69/0xc0 Aug 22 07:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 8844.618832] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 07:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 8844.619555] RIP: 0033:0x7faa5d0edaff Aug 22 07:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 8844.620204] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 07:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 8844.622200] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 07:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 8844.623163] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 07:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 8844.624167] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 07:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 8844.625354] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 07:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 8844.626609] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 07:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 8844.627595] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 07:51:10 juju-e4d256-prod-github-runner-207 kernel: [ 8844.628628] Aug 22 07:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 8872.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 8155s! [qemu-system-x86:6715] Aug 22 07:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 8872.543859] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 07:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 8872.544166] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 07:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 8872.556385] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 07:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 8872.557674] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 07:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 8872.558897] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 8872.560056] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 07:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 8872.562597] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 07:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 8872.563642] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 07:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 8872.564818] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 07:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 8872.566001] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 07:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 8872.567165] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 07:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 8872.568337] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 07:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 8872.569502] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 07:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 8872.570733] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 07:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 8872.571853] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 07:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 8872.573061] Call Trace: Aug 22 07:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 8872.573972] Aug 22 07:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 8872.574868] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 8872.575909] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 8872.576939] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 8872.578038] ? show_regs.part.0+0x23/0x29 Aug 22 07:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 8872.579036] ? show_regs.cold+0x8/0xd Aug 22 07:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 8872.580020] ? watchdog_timer_fn+0x1be/0x220 Aug 22 07:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 8872.581031] ? lockup_detector_update_enable+0x60/0x60 Aug 22 07:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 8872.582098] ? __hrtimer_run_queues+0x107/0x230 Aug 22 07:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 8872.583125] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 07:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 8872.584162] ? hrtimer_interrupt+0x101/0x220 Aug 22 07:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 8872.585181] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 07:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 8872.586254] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 07:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 8872.587309] Aug 22 07:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 8872.588206] Aug 22 07:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 8872.589049] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 07:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 8872.590085] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 8872.591123] ? _raw_spin_lock+0x22/0x30 Aug 22 07:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 8872.592094] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 8872.593110] direct_page_fault+0x206/0x310 [kvm] Aug 22 07:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 8872.594133] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 07:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 8872.595146] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 07:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 8872.596159] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 07:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 8872.597162] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 07:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 8872.598107] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 07:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 8872.599095] handle_exit+0x98/0x230 [kvm_amd] Aug 22 07:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 8872.600000] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 07:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 8872.600916] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 07:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 8872.601846] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 07:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 8872.602748] vcpu_run+0x62/0x2c0 [kvm] Aug 22 07:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 8872.603563] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 07:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 8872.604433] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 07:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 8872.605296] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 07:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 8872.606103] ? __seccomp_filter+0x4a/0x4a0 Aug 22 07:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 8872.606897] ? __fget_files+0x86/0xc0 Aug 22 07:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 8872.607607] __x64_sys_ioctl+0x95/0xd0 Aug 22 07:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 8872.608317] do_syscall_64+0x5c/0xc0 Aug 22 07:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 8872.608982] ? do_futex+0x162/0x1f0 Aug 22 07:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 8872.609630] ? __x64_sys_futex+0x78/0x1e0 Aug 22 07:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 8872.610301] ? __secure_computing+0xa9/0x120 Aug 22 07:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 8872.610991] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 07:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 8872.611766] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 8872.612486] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 8872.613204] ? do_syscall_64+0x69/0xc0 Aug 22 07:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 8872.613848] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 8872.614554] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 8872.615250] ? do_syscall_64+0x69/0xc0 Aug 22 07:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 8872.615885] ? do_syscall_64+0x69/0xc0 Aug 22 07:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 8872.616507] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 07:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 8872.617217] RIP: 0033:0x7faa5d0edaff Aug 22 07:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 8872.617882] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 07:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 8872.619918] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 07:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 8872.620837] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 07:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 8872.621731] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 07:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 8872.622618] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 07:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 8872.623509] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 07:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 8872.624403] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 07:51:38 juju-e4d256-prod-github-runner-207 kernel: [ 8872.625293] Aug 22 07:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 8900.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 8181s! [qemu-system-x86:6715] Aug 22 07:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 8900.543095] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 07:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 8900.543168] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 07:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 8900.555938] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 07:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 8900.557236] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 07:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 8900.558470] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 8900.559554] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 07:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 8900.562168] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 07:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 8900.563216] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 07:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 8900.564407] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 07:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 8900.565783] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 07:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 8900.567071] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 07:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 8900.568254] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 07:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 8900.569439] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 07:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 8900.570681] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 07:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 8900.571797] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 07:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 8900.573126] Call Trace: Aug 22 07:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 8900.574066] Aug 22 07:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 8900.574966] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 8900.576036] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 8900.577063] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 8900.578178] ? show_regs.part.0+0x23/0x29 Aug 22 07:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 8900.579195] ? show_regs.cold+0x8/0xd Aug 22 07:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 8900.580209] ? watchdog_timer_fn+0x1be/0x220 Aug 22 07:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 8900.581223] ? lockup_detector_update_enable+0x60/0x60 Aug 22 07:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 8900.582292] ? __hrtimer_run_queues+0x107/0x230 Aug 22 07:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 8900.583326] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 07:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 8900.584368] ? hrtimer_interrupt+0x101/0x220 Aug 22 07:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 8900.585394] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 07:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 8900.586485] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 07:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 8900.587577] Aug 22 07:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 8900.588449] Aug 22 07:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 8900.589297] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 07:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 8900.590402] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 8900.591483] ? _raw_spin_lock+0x22/0x30 Aug 22 07:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 8900.592432] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 8900.593458] direct_page_fault+0x206/0x310 [kvm] Aug 22 07:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 8900.594490] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 07:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 8900.595520] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 07:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 8900.596528] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 07:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 8900.597563] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 07:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 8900.598516] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 07:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 8900.599566] handle_exit+0x98/0x230 [kvm_amd] Aug 22 07:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 8900.600474] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 07:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 8900.601468] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 07:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 8900.602403] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 07:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 8900.603312] vcpu_run+0x62/0x2c0 [kvm] Aug 22 07:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 8900.604145] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 07:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 8900.604973] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 07:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 8900.606058] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 07:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 8900.606870] ? __seccomp_filter+0x4a/0x4a0 Aug 22 07:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 8900.607824] ? __fget_files+0x86/0xc0 Aug 22 07:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 8900.608541] __x64_sys_ioctl+0x95/0xd0 Aug 22 07:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 8900.609249] do_syscall_64+0x5c/0xc0 Aug 22 07:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 8900.609929] ? do_futex+0x162/0x1f0 Aug 22 07:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 8900.610584] ? __x64_sys_futex+0x78/0x1e0 Aug 22 07:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 8900.611267] ? __secure_computing+0xa9/0x120 Aug 22 07:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 8900.611990] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 07:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 8900.612968] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 8900.613867] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 8900.614618] ? do_syscall_64+0x69/0xc0 Aug 22 07:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 8900.615269] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 8900.615994] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 8900.616702] ? do_syscall_64+0x69/0xc0 Aug 22 07:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 8900.617330] ? do_syscall_64+0x69/0xc0 Aug 22 07:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 8900.617958] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 07:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 8900.618671] RIP: 0033:0x7faa5d0edaff Aug 22 07:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 8900.619303] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 07:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 8900.621349] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 07:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 8900.622273] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 07:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 8900.623190] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 07:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 8900.624133] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 07:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 8900.625038] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 07:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 8900.625937] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 07:52:06 juju-e4d256-prod-github-runner-207 kernel: [ 8900.626840] Aug 22 07:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 8928.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 8207s! [qemu-system-x86:6715] Aug 22 07:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 8928.543124] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 07:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 8928.543200] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 07:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 8928.558693] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 07:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 8928.560561] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 07:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 8928.562351] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 8928.563912] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 07:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 8928.567232] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 07:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 8928.568314] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 07:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 8928.569498] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 07:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 8928.570664] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 07:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 8928.571856] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 07:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 8928.573027] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 07:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 8928.574199] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 07:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 8928.575445] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 07:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 8928.576544] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 07:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 8928.577760] Call Trace: Aug 22 07:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 8928.578675] Aug 22 07:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 8928.579580] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 8928.580618] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 8928.581655] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 8928.582753] ? show_regs.part.0+0x23/0x29 Aug 22 07:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 8928.583772] ? show_regs.cold+0x8/0xd Aug 22 07:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 8928.584804] ? watchdog_timer_fn+0x1be/0x220 Aug 22 07:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 8928.585844] ? lockup_detector_update_enable+0x60/0x60 Aug 22 07:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 8928.586925] ? __hrtimer_run_queues+0x107/0x230 Aug 22 07:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 8928.587983] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 07:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 8928.589023] ? hrtimer_interrupt+0x101/0x220 Aug 22 07:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 8928.590056] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 07:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 8928.591144] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 07:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 8928.592206] Aug 22 07:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 8928.593255] Aug 22 07:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 8928.594099] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 07:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 8928.595339] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 8928.596567] ? _raw_spin_lock+0x22/0x30 Aug 22 07:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 8928.597737] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 8928.599402] direct_page_fault+0x206/0x310 [kvm] Aug 22 07:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 8928.600559] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 07:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 8928.601810] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 07:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 8928.603313] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 07:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 8928.604423] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 07:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 8928.605479] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 07:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 8928.606593] handle_exit+0x98/0x230 [kvm_amd] Aug 22 07:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 8928.607642] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 07:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 8928.608671] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 07:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 8928.609698] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 07:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 8928.610703] vcpu_run+0x62/0x2c0 [kvm] Aug 22 07:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 8928.611619] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 07:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 8928.612534] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 07:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 8928.613514] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 07:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 8928.614457] ? __seccomp_filter+0x4a/0x4a0 Aug 22 07:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 8928.615483] ? __fget_files+0x86/0xc0 Aug 22 07:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 8928.616203] __x64_sys_ioctl+0x95/0xd0 Aug 22 07:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 8928.616903] do_syscall_64+0x5c/0xc0 Aug 22 07:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 8928.617573] ? do_futex+0x162/0x1f0 Aug 22 07:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 8928.618221] ? __x64_sys_futex+0x78/0x1e0 Aug 22 07:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 8928.618910] ? __secure_computing+0xa9/0x120 Aug 22 07:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 8928.619688] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 07:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 8928.620459] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 8928.621199] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 8928.621920] ? do_syscall_64+0x69/0xc0 Aug 22 07:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 8928.622577] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 8928.623438] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 8928.624312] ? do_syscall_64+0x69/0xc0 Aug 22 07:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 8928.625089] ? do_syscall_64+0x69/0xc0 Aug 22 07:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 8928.625889] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 07:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 8928.626827] RIP: 0033:0x7faa5d0edaff Aug 22 07:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 8928.627661] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 07:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 8928.630143] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 07:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 8928.631340] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 07:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 8928.632237] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 07:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 8928.633132] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 07:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 8928.634020] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 07:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 8928.634913] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 07:52:34 juju-e4d256-prod-github-runner-207 kernel: [ 8928.635834] Aug 22 07:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 8956.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 8233s! [qemu-system-x86:6715] Aug 22 07:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 8956.543828] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 07:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 8956.544130] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 07:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 8956.556439] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 07:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 8956.557717] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 07:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 8956.558961] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 8956.560039] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 07:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 8956.562578] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 07:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 8956.563633] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 07:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 8956.564791] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 07:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 8956.565950] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 07:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 8956.567111] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 07:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 8956.568273] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 07:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 8956.569433] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 07:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 8956.570662] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 07:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 8956.571766] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 07:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 8956.573002] Call Trace: Aug 22 07:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 8956.573946] Aug 22 07:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 8956.574940] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 8956.576003] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 8956.577048] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 8956.578147] ? show_regs.part.0+0x23/0x29 Aug 22 07:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 8956.579168] ? show_regs.cold+0x8/0xd Aug 22 07:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 8956.580137] ? watchdog_timer_fn+0x1be/0x220 Aug 22 07:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 8956.581174] ? lockup_detector_update_enable+0x60/0x60 Aug 22 07:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 8956.582260] ? __hrtimer_run_queues+0x107/0x230 Aug 22 07:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 8956.583319] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 07:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 8956.584346] ? hrtimer_interrupt+0x101/0x220 Aug 22 07:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 8956.585358] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 07:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 8956.586428] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 07:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 8956.587477] Aug 22 07:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 8956.588327] Aug 22 07:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 8956.589161] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 07:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 8956.590195] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 8956.591255] ? _raw_spin_lock+0x22/0x30 Aug 22 07:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 8956.592197] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 8956.593211] direct_page_fault+0x206/0x310 [kvm] Aug 22 07:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 8956.594236] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 07:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 8956.595252] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 07:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 8956.596252] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 07:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 8956.597253] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 07:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 8956.598206] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 07:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 8956.599187] handle_exit+0x98/0x230 [kvm_amd] Aug 22 07:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 8956.600077] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 07:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 8956.601084] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 07:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 8956.602013] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 07:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 8956.602925] vcpu_run+0x62/0x2c0 [kvm] Aug 22 07:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 8956.603732] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 07:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 8956.604534] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 07:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 8956.605383] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 07:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 8956.606176] ? __seccomp_filter+0x4a/0x4a0 Aug 22 07:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 8956.606924] ? __fget_files+0x86/0xc0 Aug 22 07:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 8956.607624] __x64_sys_ioctl+0x95/0xd0 Aug 22 07:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 8956.608312] do_syscall_64+0x5c/0xc0 Aug 22 07:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 8956.608977] ? do_futex+0x162/0x1f0 Aug 22 07:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 8956.609621] ? __x64_sys_futex+0x78/0x1e0 Aug 22 07:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 8956.610289] ? __secure_computing+0xa9/0x120 Aug 22 07:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 8956.610984] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 07:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 8956.611758] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 8956.612475] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 8956.613187] ? do_syscall_64+0x69/0xc0 Aug 22 07:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 8956.613831] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 8956.614534] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 8956.615234] ? do_syscall_64+0x69/0xc0 Aug 22 07:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 8956.615854] ? do_syscall_64+0x69/0xc0 Aug 22 07:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 8956.616549] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 07:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 8956.617383] RIP: 0033:0x7faa5d0edaff Aug 22 07:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 8956.618051] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 07:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 8956.620045] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 07:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 8956.620965] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 07:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 8956.621863] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 07:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 8956.622766] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 07:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 8956.623655] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 07:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 8956.624553] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 07:53:02 juju-e4d256-prod-github-runner-207 kernel: [ 8956.625446] Aug 22 07:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 8984.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 8259s! [qemu-system-x86:6715] Aug 22 07:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 8984.543091] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 07:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 8984.543163] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 07:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 8984.555247] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 07:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 8984.556515] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 07:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 8984.557734] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 8984.558798] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 07:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 8984.561344] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 07:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 8984.562389] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 07:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 8984.563554] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 07:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 8984.564711] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 07:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 8984.565874] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 07:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 8984.567069] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 07:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 8984.568441] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 07:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 8984.569709] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 07:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 8984.570834] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 07:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 8984.572027] Call Trace: Aug 22 07:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 8984.572944] Aug 22 07:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 8984.573827] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 8984.574897] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 8984.575923] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 8984.576995] ? show_regs.part.0+0x23/0x29 Aug 22 07:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 8984.578000] ? show_regs.cold+0x8/0xd Aug 22 07:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 8984.579008] ? watchdog_timer_fn+0x1be/0x220 Aug 22 07:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 8984.580024] ? lockup_detector_update_enable+0x60/0x60 Aug 22 07:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 8984.581086] ? __hrtimer_run_queues+0x107/0x230 Aug 22 07:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 8984.582118] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 07:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 8984.583159] ? hrtimer_interrupt+0x101/0x220 Aug 22 07:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 8984.584173] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 07:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 8984.585286] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 07:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 8984.586508] Aug 22 07:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 8984.587375] Aug 22 07:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 8984.588214] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 07:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 8984.589310] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 8984.590360] ? _raw_spin_lock+0x22/0x30 Aug 22 07:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 8984.591304] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 8984.592324] direct_page_fault+0x206/0x310 [kvm] Aug 22 07:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 8984.593345] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 07:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 8984.594403] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 07:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 8984.595429] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 07:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 8984.596400] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 07:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 8984.597342] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 07:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 8984.598323] handle_exit+0x98/0x230 [kvm_amd] Aug 22 07:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 8984.599235] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 07:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 8984.600149] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 07:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 8984.601085] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 07:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 8984.602095] vcpu_run+0x62/0x2c0 [kvm] Aug 22 07:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 8984.602999] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 07:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 8984.603856] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 07:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 8984.604748] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 07:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 8984.605552] ? __seccomp_filter+0x4a/0x4a0 Aug 22 07:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 8984.606300] ? __fget_files+0x86/0xc0 Aug 22 07:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 8984.607027] __x64_sys_ioctl+0x95/0xd0 Aug 22 07:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 8984.607767] do_syscall_64+0x5c/0xc0 Aug 22 07:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 8984.608514] ? do_futex+0x162/0x1f0 Aug 22 07:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 8984.609200] ? __x64_sys_futex+0x78/0x1e0 Aug 22 07:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 8984.609888] ? __secure_computing+0xa9/0x120 Aug 22 07:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 8984.610598] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 07:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 8984.611370] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 8984.612096] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 8984.612873] ? do_syscall_64+0x69/0xc0 Aug 22 07:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 8984.613552] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 8984.614277] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 8984.615034] ? do_syscall_64+0x69/0xc0 Aug 22 07:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 8984.615703] ? do_syscall_64+0x69/0xc0 Aug 22 07:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 8984.616333] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 07:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 8984.617041] RIP: 0033:0x7faa5d0edaff Aug 22 07:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 8984.617674] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 07:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 8984.619680] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 07:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 8984.620601] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 07:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 8984.621498] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 07:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 8984.622423] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 07:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 8984.623317] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 07:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 8984.624208] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 07:53:30 juju-e4d256-prod-github-runner-207 kernel: [ 8984.625104] Aug 22 07:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 8997.788713] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 07:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 8997.789711] rcu: 1-....: (2213186 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=1071362 Aug 22 07:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 8997.790863] (t=2220147 jiffies g=23269 q=17845) Aug 22 07:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 8997.791646] NMI backtrace for cpu 1 Aug 22 07:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 8997.792385] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 07:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 8997.793613] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 07:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 8997.794736] Call Trace: Aug 22 07:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 8997.795414] Aug 22 07:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 8997.796065] show_stack+0x52/0x5c Aug 22 07:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 8997.796790] dump_stack_lvl+0x4a/0x63 Aug 22 07:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 8997.797554] dump_stack+0x10/0x16 Aug 22 07:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 8997.798306] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 07:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 8997.799111] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 07:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 8997.799916] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 07:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 8997.800763] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 07:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 8997.801619] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 07:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 8997.802459] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 07:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 8997.803233] print_cpu_stall.cold+0x2f/0xe2 Aug 22 07:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 8997.804021] ? timekeeping_update+0xf7/0x150 Aug 22 07:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 8997.804804] check_cpu_stall+0x109/0x270 Aug 22 07:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 8997.805551] rcu_sched_clock_irq+0x9a/0x250 Aug 22 07:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 8997.806375] update_process_times+0x94/0xd0 Aug 22 07:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 8997.807168] tick_sched_handle+0x29/0x70 Aug 22 07:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 8997.807937] tick_sched_timer+0x8c/0xc0 Aug 22 07:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 8997.808682] ? tick_nohz_handler+0xb0/0xb0 Aug 22 07:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 8997.809448] __hrtimer_run_queues+0x107/0x230 Aug 22 07:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 8997.810252] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 07:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 8997.811042] hrtimer_interrupt+0x101/0x220 Aug 22 07:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 8997.811842] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 07:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 8997.812667] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 07:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 8997.813468] Aug 22 07:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 8997.814104] Aug 22 07:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 8997.814754] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 07:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 8997.815574] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 8997.816473] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 07:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 8997.818723] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 07:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 8997.819627] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 07:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 8997.820648] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 07:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 8997.821658] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 07:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 8997.822668] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 07:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 8997.823775] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 07:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 8997.825022] ? _raw_spin_lock+0x22/0x30 Aug 22 07:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 8997.826052] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 8997.826945] direct_page_fault+0x206/0x310 [kvm] Aug 22 07:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 8997.827799] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 07:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 8997.828635] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 07:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 8997.829464] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 07:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 8997.830340] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 07:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 8997.831137] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 07:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 8997.831986] handle_exit+0x98/0x230 [kvm_amd] Aug 22 07:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 8997.832748] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 07:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 8997.833574] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 07:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 8997.834500] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 07:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 8997.835295] vcpu_run+0x62/0x2c0 [kvm] Aug 22 07:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 8997.836024] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 07:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 8997.836768] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 07:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 8997.837569] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 07:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 8997.838351] ? __seccomp_filter+0x4a/0x4a0 Aug 22 07:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 8997.839071] ? __fget_files+0x86/0xc0 Aug 22 07:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 8997.839767] __x64_sys_ioctl+0x95/0xd0 Aug 22 07:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 8997.840475] do_syscall_64+0x5c/0xc0 Aug 22 07:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 8997.841163] ? do_futex+0x162/0x1f0 Aug 22 07:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 8997.841837] ? __x64_sys_futex+0x78/0x1e0 Aug 22 07:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 8997.842554] ? __secure_computing+0xa9/0x120 Aug 22 07:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 8997.843273] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 07:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 8997.844091] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 8997.844989] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 8997.845741] ? do_syscall_64+0x69/0xc0 Aug 22 07:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 8997.846460] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 8997.847217] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 8997.848007] ? do_syscall_64+0x69/0xc0 Aug 22 07:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 8997.848718] ? do_syscall_64+0x69/0xc0 Aug 22 07:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 8997.849411] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 07:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 8997.850209] RIP: 0033:0x7faa5d0edaff Aug 22 07:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 8997.850912] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 07:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 8997.853035] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 07:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 8997.853999] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 07:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 8997.854968] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 07:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 8997.855925] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 07:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 8997.856870] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 07:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 8997.857803] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 07:53:43 juju-e4d256-prod-github-runner-207 kernel: [ 8997.858858] Aug 22 07:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 9024.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 8296s! [qemu-system-x86:6715] Aug 22 07:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 9024.543079] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 07:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 9024.543151] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 07:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 9024.555277] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 07:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 9024.556551] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 07:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 9024.557777] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 9024.558844] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 07:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 9024.561410] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 07:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 9024.562472] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 07:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 9024.563638] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 07:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 9024.564801] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 07:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 9024.566001] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 07:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 9024.567186] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 07:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 9024.568348] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 07:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 9024.569581] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 07:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 9024.570695] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 07:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 9024.571924] Call Trace: Aug 22 07:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 9024.572836] Aug 22 07:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 9024.573744] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 9024.574789] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 9024.575808] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 9024.576893] ? show_regs.part.0+0x23/0x29 Aug 22 07:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 9024.577915] ? show_regs.cold+0x8/0xd Aug 22 07:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 9024.578888] ? watchdog_timer_fn+0x1be/0x220 Aug 22 07:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 9024.579918] ? lockup_detector_update_enable+0x60/0x60 Aug 22 07:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 9024.580991] ? __hrtimer_run_queues+0x107/0x230 Aug 22 07:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 9024.582074] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 07:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 9024.583104] ? hrtimer_interrupt+0x101/0x220 Aug 22 07:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 9024.584117] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 07:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 9024.585183] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 07:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 9024.586246] Aug 22 07:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 9024.587107] Aug 22 07:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 9024.587959] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 07:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 9024.588990] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 9024.590043] ? _raw_spin_lock+0x22/0x30 Aug 22 07:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 9024.590989] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 9024.592013] direct_page_fault+0x206/0x310 [kvm] Aug 22 07:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 9024.593049] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 07:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 9024.594069] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 07:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 9024.595074] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 07:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 9024.596043] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 07:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 9024.597013] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 07:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 9024.598020] handle_exit+0x98/0x230 [kvm_amd] Aug 22 07:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 9024.598912] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 07:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 9024.599821] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 07:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 9024.600745] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 07:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 9024.601644] vcpu_run+0x62/0x2c0 [kvm] Aug 22 07:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 9024.602481] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 07:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 9024.603294] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 07:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 9024.604149] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 07:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 9024.604951] ? __seccomp_filter+0x4a/0x4a0 Aug 22 07:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 9024.605695] ? __fget_files+0x86/0xc0 Aug 22 07:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 9024.606412] __x64_sys_ioctl+0x95/0xd0 Aug 22 07:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 9024.607102] do_syscall_64+0x5c/0xc0 Aug 22 07:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 9024.607779] ? do_futex+0x162/0x1f0 Aug 22 07:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 9024.608427] ? __x64_sys_futex+0x78/0x1e0 Aug 22 07:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 9024.609113] ? __secure_computing+0xa9/0x120 Aug 22 07:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 9024.609811] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 07:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 9024.610576] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 9024.611295] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 9024.612018] ? do_syscall_64+0x69/0xc0 Aug 22 07:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 9024.612675] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 9024.613420] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 9024.614142] ? do_syscall_64+0x69/0xc0 Aug 22 07:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 9024.614769] ? do_syscall_64+0x69/0xc0 Aug 22 07:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 9024.615392] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 07:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 9024.616096] RIP: 0033:0x7faa5d0edaff Aug 22 07:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 9024.616721] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 07:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 9024.618733] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 07:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 9024.619643] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 07:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 9024.620531] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 07:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 9024.621418] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 07:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 9024.622322] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 07:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 9024.623223] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 07:54:10 juju-e4d256-prod-github-runner-207 kernel: [ 9024.624113] Aug 22 07:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 9052.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 8322s! [qemu-system-x86:6715] Aug 22 07:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 9052.543895] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 07:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 9052.544190] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 07:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 9052.556534] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 07:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 9052.557815] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 07:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 9052.559034] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 9052.560089] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 07:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 9052.562935] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 07:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 9052.564415] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 07:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 9052.565829] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 07:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 9052.567023] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 07:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 9052.568229] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 07:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 9052.569387] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 07:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 9052.570573] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 07:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 9052.571813] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 07:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 9052.572913] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 07:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 9052.574121] Call Trace: Aug 22 07:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 9052.575102] Aug 22 07:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 9052.576098] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 9052.577202] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 9052.578241] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 9052.579469] ? show_regs.part.0+0x23/0x29 Aug 22 07:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 9052.580475] ? show_regs.cold+0x8/0xd Aug 22 07:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 9052.581449] ? watchdog_timer_fn+0x1be/0x220 Aug 22 07:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 9052.582481] ? lockup_detector_update_enable+0x60/0x60 Aug 22 07:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 9052.583558] ? __hrtimer_run_queues+0x107/0x230 Aug 22 07:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 9052.584593] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 07:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 9052.585637] ? hrtimer_interrupt+0x101/0x220 Aug 22 07:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 9052.586672] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 07:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 9052.587763] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 07:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 9052.588814] Aug 22 07:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 9052.589749] Aug 22 07:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 9052.590587] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 07:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 9052.591622] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 9052.592659] ? _raw_spin_lock+0x22/0x30 Aug 22 07:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 9052.593623] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 9052.594642] direct_page_fault+0x206/0x310 [kvm] Aug 22 07:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 9052.595669] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 07:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 9052.596699] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 07:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 9052.597718] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 07:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 9052.598734] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 07:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 9052.599682] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 07:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 9052.600694] handle_exit+0x98/0x230 [kvm_amd] Aug 22 07:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 9052.601854] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 07:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 9052.602780] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 07:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 9052.603707] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 07:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 9052.604612] vcpu_run+0x62/0x2c0 [kvm] Aug 22 07:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 9052.605425] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 07:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 9052.606250] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 07:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 9052.607136] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 07:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 9052.607972] ? __seccomp_filter+0x4a/0x4a0 Aug 22 07:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 9052.608721] ? __fget_files+0x86/0xc0 Aug 22 07:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 9052.609421] __x64_sys_ioctl+0x95/0xd0 Aug 22 07:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 9052.610192] do_syscall_64+0x5c/0xc0 Aug 22 07:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 9052.610855] ? do_futex+0x162/0x1f0 Aug 22 07:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 9052.611500] ? __x64_sys_futex+0x78/0x1e0 Aug 22 07:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 9052.612190] ? __secure_computing+0xa9/0x120 Aug 22 07:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 9052.612875] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 07:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 9052.613648] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 9052.614367] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 9052.615081] ? do_syscall_64+0x69/0xc0 Aug 22 07:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 9052.615722] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 9052.616420] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 9052.617149] ? do_syscall_64+0x69/0xc0 Aug 22 07:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 9052.617790] ? do_syscall_64+0x69/0xc0 Aug 22 07:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 9052.618454] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 07:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 9052.619160] RIP: 0033:0x7faa5d0edaff Aug 22 07:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 9052.619825] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 07:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 9052.621820] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 07:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 9052.622730] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 07:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 9052.623619] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 07:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 9052.624512] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 07:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 9052.625407] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 07:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 9052.626301] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 07:54:38 juju-e4d256-prod-github-runner-207 kernel: [ 9052.627190] Aug 22 07:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 9080.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 8348s! [qemu-system-x86:6715] Aug 22 07:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 9080.543086] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 07:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 9080.543158] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 07:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 9080.555461] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 07:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 9080.556742] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 07:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 9080.558000] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 9080.559082] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 07:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 9080.561668] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 07:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 9080.562713] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 07:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 9080.563871] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 07:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 9080.565046] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 07:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 9080.566239] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 07:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 9080.567491] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 07:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 9080.568691] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 07:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 9080.569947] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 07:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 9080.571056] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 07:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 9080.572257] Call Trace: Aug 22 07:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 9080.573182] Aug 22 07:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 9080.574065] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 9080.575100] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 9080.576122] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 9080.577212] ? show_regs.part.0+0x23/0x29 Aug 22 07:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 9080.578212] ? show_regs.cold+0x8/0xd Aug 22 07:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 9080.579182] ? watchdog_timer_fn+0x1be/0x220 Aug 22 07:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 9080.580189] ? lockup_detector_update_enable+0x60/0x60 Aug 22 07:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 9080.581269] ? __hrtimer_run_queues+0x107/0x230 Aug 22 07:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 9080.582310] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 07:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 9080.583333] ? hrtimer_interrupt+0x101/0x220 Aug 22 07:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 9080.584346] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 07:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 9080.585431] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 07:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 9080.586490] Aug 22 07:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 9080.587345] Aug 22 07:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 9080.588181] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 07:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 9080.589270] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 9080.590321] ? _raw_spin_lock+0x22/0x30 Aug 22 07:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 9080.591308] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 9080.592348] direct_page_fault+0x206/0x310 [kvm] Aug 22 07:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 9080.593396] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 07:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 9080.594412] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 07:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 9080.595415] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 07:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 9080.596390] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 07:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 9080.597347] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 07:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 9080.598333] handle_exit+0x98/0x230 [kvm_amd] Aug 22 07:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 9080.599231] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 07:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 9080.600144] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 07:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 9080.601068] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 07:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 9080.602000] vcpu_run+0x62/0x2c0 [kvm] Aug 22 07:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 9080.602815] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 07:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 9080.603629] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 07:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 9080.604484] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 07:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 9080.605293] ? __seccomp_filter+0x4a/0x4a0 Aug 22 07:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 9080.606036] ? __fget_files+0x86/0xc0 Aug 22 07:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 9080.606761] __x64_sys_ioctl+0x95/0xd0 Aug 22 07:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 9080.607502] do_syscall_64+0x5c/0xc0 Aug 22 07:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 9080.608195] ? do_futex+0x162/0x1f0 Aug 22 07:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 9080.608847] ? __x64_sys_futex+0x78/0x1e0 Aug 22 07:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 9080.609547] ? __secure_computing+0xa9/0x120 Aug 22 07:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 9080.610245] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 07:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 9080.611007] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 9080.611730] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 9080.612452] ? do_syscall_64+0x69/0xc0 Aug 22 07:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 9080.613095] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 9080.614052] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 9080.614907] ? do_syscall_64+0x69/0xc0 Aug 22 07:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 9080.615531] ? do_syscall_64+0x69/0xc0 Aug 22 07:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 9080.616157] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 07:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 9080.616862] RIP: 0033:0x7faa5d0edaff Aug 22 07:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 9080.617512] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 07:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 9080.619567] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 07:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 9080.620486] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 07:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 9080.621396] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 07:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 9080.622294] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 07:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 9080.623198] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 07:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 9080.624090] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 07:55:06 juju-e4d256-prod-github-runner-207 kernel: [ 9080.625025] Aug 22 07:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 9108.541982] watchdog: BUG: soft lockup - CPU#1 stuck for 8374s! [qemu-system-x86:6715] Aug 22 07:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 9108.543086] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 07:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 9108.543156] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 07:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 9108.555290] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 07:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 9108.556793] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 07:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 9108.558015] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 9108.559078] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 07:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 9108.561643] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 07:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 9108.562685] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 07:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 9108.563851] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 07:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 9108.565029] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 07:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 9108.566188] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 07:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 9108.567349] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 07:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 9108.568564] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 07:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 9108.569814] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 07:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 9108.570912] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 07:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 9108.572109] Call Trace: Aug 22 07:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 9108.573032] Aug 22 07:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 9108.573914] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 9108.574950] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 9108.576003] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 9108.577089] ? show_regs.part.0+0x23/0x29 Aug 22 07:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 9108.578084] ? show_regs.cold+0x8/0xd Aug 22 07:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 9108.579059] ? watchdog_timer_fn+0x1be/0x220 Aug 22 07:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 9108.580066] ? lockup_detector_update_enable+0x60/0x60 Aug 22 07:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 9108.581141] ? __hrtimer_run_queues+0x107/0x230 Aug 22 07:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 9108.582167] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 07:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 9108.583188] ? hrtimer_interrupt+0x101/0x220 Aug 22 07:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 9108.584200] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 07:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 9108.585280] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 07:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 9108.586324] Aug 22 07:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 9108.587174] Aug 22 07:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 9108.588013] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 07:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 9108.589058] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 9108.590097] ? _raw_spin_lock+0x22/0x30 Aug 22 07:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 9108.591066] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 9108.592080] direct_page_fault+0x206/0x310 [kvm] Aug 22 07:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 9108.593137] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 07:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 9108.594159] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 07:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 9108.595157] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 07:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 9108.596139] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 07:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 9108.597110] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 07:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 9108.598087] handle_exit+0x98/0x230 [kvm_amd] Aug 22 07:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 9108.598979] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 07:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 9108.599898] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 07:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 9108.600887] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 07:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 9108.601791] vcpu_run+0x62/0x2c0 [kvm] Aug 22 07:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 9108.602605] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 07:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 9108.603411] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 07:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 9108.604263] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 07:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 9108.605099] ? __seccomp_filter+0x4a/0x4a0 Aug 22 07:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 9108.605848] ? __fget_files+0x86/0xc0 Aug 22 07:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 9108.606555] __x64_sys_ioctl+0x95/0xd0 Aug 22 07:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 9108.607270] do_syscall_64+0x5c/0xc0 Aug 22 07:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 9108.607955] ? do_futex+0x162/0x1f0 Aug 22 07:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 9108.608610] ? __x64_sys_futex+0x78/0x1e0 Aug 22 07:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 9108.609296] ? __secure_computing+0xa9/0x120 Aug 22 07:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 9108.610203] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 07:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 9108.611155] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 9108.611879] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 9108.612604] ? do_syscall_64+0x69/0xc0 Aug 22 07:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 9108.613263] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 9108.614136] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 9108.614853] ? do_syscall_64+0x69/0xc0 Aug 22 07:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 9108.615482] ? do_syscall_64+0x69/0xc0 Aug 22 07:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 9108.616104] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 07:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 9108.616828] RIP: 0033:0x7faa5d0edaff Aug 22 07:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 9108.617455] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 07:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 9108.619441] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 07:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 9108.620353] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 07:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 9108.621262] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 07:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 9108.622155] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 07:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 9108.623043] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 07:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 9108.623960] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 07:55:34 juju-e4d256-prod-github-runner-207 kernel: [ 9108.624874] Aug 22 07:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 9136.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 8401s! [qemu-system-x86:6715] Aug 22 07:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 9136.543815] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 07:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 9136.544303] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 07:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 9136.556433] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 07:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 9136.557708] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 07:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 9136.558934] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 9136.559991] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 07:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 9136.562590] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 07:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 9136.563644] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 07:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 9136.564846] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 07:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 9136.566008] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 07:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 9136.567166] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 07:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 9136.568331] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 07:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 9136.569531] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 07:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 9136.570783] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 07:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 9136.571880] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 07:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 9136.573113] Call Trace: Aug 22 07:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 9136.574026] Aug 22 07:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 9136.574931] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 9136.575983] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 9136.577037] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 9136.578133] ? show_regs.part.0+0x23/0x29 Aug 22 07:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 9136.579126] ? show_regs.cold+0x8/0xd Aug 22 07:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 9136.580093] ? watchdog_timer_fn+0x1be/0x220 Aug 22 07:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 9136.581123] ? lockup_detector_update_enable+0x60/0x60 Aug 22 07:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 9136.582184] ? __hrtimer_run_queues+0x107/0x230 Aug 22 07:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 9136.583208] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 07:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 9136.584232] ? hrtimer_interrupt+0x101/0x220 Aug 22 07:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 9136.585277] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 07:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 9136.586350] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 07:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 9136.587394] Aug 22 07:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 9136.588244] Aug 22 07:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 9136.589099] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 07:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 9136.590128] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 9136.591167] ? _raw_spin_lock+0x22/0x30 Aug 22 07:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 9136.592108] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 9136.593131] direct_page_fault+0x206/0x310 [kvm] Aug 22 07:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 9136.594183] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 07:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 9136.595213] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 07:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 9136.596210] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 07:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 9136.597224] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 07:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 9136.598178] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 07:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 9136.599194] handle_exit+0x98/0x230 [kvm_amd] Aug 22 07:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 9136.600102] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 07:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 9136.601044] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 07:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 9136.601974] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 07:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 9136.602875] vcpu_run+0x62/0x2c0 [kvm] Aug 22 07:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 9136.603684] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 07:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 9136.604506] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 07:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 9136.605359] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 07:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 9136.606158] ? __seccomp_filter+0x4a/0x4a0 Aug 22 07:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 9136.606902] ? __fget_files+0x86/0xc0 Aug 22 07:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 9136.607602] __x64_sys_ioctl+0x95/0xd0 Aug 22 07:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 9136.608297] do_syscall_64+0x5c/0xc0 Aug 22 07:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 9136.608971] ? do_futex+0x162/0x1f0 Aug 22 07:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 9136.609616] ? __x64_sys_futex+0x78/0x1e0 Aug 22 07:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 9136.610294] ? __secure_computing+0xa9/0x120 Aug 22 07:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 9136.610994] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 07:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 9136.611755] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 9136.612492] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 9136.613213] ? do_syscall_64+0x69/0xc0 Aug 22 07:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 9136.613860] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 9136.614559] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 9136.615257] ? do_syscall_64+0x69/0xc0 Aug 22 07:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 9136.615878] ? do_syscall_64+0x69/0xc0 Aug 22 07:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 9136.616516] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 07:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 9136.617224] RIP: 0033:0x7faa5d0edaff Aug 22 07:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 9136.617870] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 07:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 9136.619858] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 07:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 9136.620786] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 07:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 9136.621674] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 07:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 9136.622561] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 07:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 9136.623445] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 07:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 9136.624342] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 07:56:02 juju-e4d256-prod-github-runner-207 kernel: [ 9136.625248] Aug 22 07:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 9164.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 8427s! [qemu-system-x86:6715] Aug 22 07:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 9164.543095] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 07:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 9164.543170] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 07:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 9164.555307] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 07:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 9164.556586] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 07:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 9164.557820] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 9164.558909] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 07:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 9164.561465] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 07:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 9164.562505] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 07:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 9164.563662] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 07:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 9164.564833] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 07:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 9164.565993] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 07:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 9164.567147] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 07:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 9164.568333] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 07:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 9164.569573] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 07:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 9164.570694] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 07:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 9164.571925] Call Trace: Aug 22 07:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 9164.572860] Aug 22 07:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 9164.573744] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 9164.574772] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 9164.575790] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 9164.576875] ? show_regs.part.0+0x23/0x29 Aug 22 07:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 9164.577887] ? show_regs.cold+0x8/0xd Aug 22 07:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 9164.578857] ? watchdog_timer_fn+0x1be/0x220 Aug 22 07:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 9164.579870] ? lockup_detector_update_enable+0x60/0x60 Aug 22 07:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 9164.580963] ? __hrtimer_run_queues+0x107/0x230 Aug 22 07:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 9164.582174] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 07:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 9164.583206] ? hrtimer_interrupt+0x101/0x220 Aug 22 07:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 9164.584262] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 07:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 9164.585378] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 07:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 9164.586431] Aug 22 07:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 9164.587446] Aug 22 07:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 9164.588305] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 07:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 9164.589516] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 9164.590593] ? _raw_spin_lock+0x22/0x30 Aug 22 07:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 9164.591575] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 9164.592648] direct_page_fault+0x206/0x310 [kvm] Aug 22 07:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 9164.593671] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 07:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 9164.594705] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 07:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 9164.595708] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 07:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 9164.596706] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 07:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 9164.597651] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 07:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 9164.598627] handle_exit+0x98/0x230 [kvm_amd] Aug 22 07:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 9164.599695] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 07:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 9164.600626] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 07:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 9164.601552] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 07:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 9164.602454] vcpu_run+0x62/0x2c0 [kvm] Aug 22 07:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 9164.603269] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 07:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 9164.604098] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 07:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 9164.604967] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 07:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 9164.605764] ? __seccomp_filter+0x4a/0x4a0 Aug 22 07:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 9164.606511] ? __fget_files+0x86/0xc0 Aug 22 07:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 9164.607214] __x64_sys_ioctl+0x95/0xd0 Aug 22 07:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 9164.607905] do_syscall_64+0x5c/0xc0 Aug 22 07:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 9164.608584] ? do_futex+0x162/0x1f0 Aug 22 07:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 9164.609239] ? __x64_sys_futex+0x78/0x1e0 Aug 22 07:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 9164.609911] ? __secure_computing+0xa9/0x120 Aug 22 07:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 9164.610600] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 07:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 9164.611379] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 9164.612133] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 9164.612850] ? do_syscall_64+0x69/0xc0 Aug 22 07:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 9164.613493] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 9164.614193] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 9164.614893] ? do_syscall_64+0x69/0xc0 Aug 22 07:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 9164.615521] ? do_syscall_64+0x69/0xc0 Aug 22 07:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 9164.616153] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 07:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 9164.616856] RIP: 0033:0x7faa5d0edaff Aug 22 07:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 9164.617479] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 07:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 9164.619465] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 07:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 9164.620389] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 07:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 9164.621278] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 07:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 9164.622199] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 07:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 9164.623085] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 07:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 9164.623993] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 07:56:30 juju-e4d256-prod-github-runner-207 kernel: [ 9164.624923] Aug 22 07:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 9177.800706] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 07:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 9177.801664] rcu: 1-....: (2258053 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=1092946 Aug 22 07:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 9177.802807] (t=2265150 jiffies g=23269 q=17986) Aug 22 07:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 9177.803597] NMI backtrace for cpu 1 Aug 22 07:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 9177.804327] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 07:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 9177.805454] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 07:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 9177.806531] Call Trace: Aug 22 07:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 9177.807210] Aug 22 07:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 9177.807856] show_stack+0x52/0x5c Aug 22 07:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 9177.808613] dump_stack_lvl+0x4a/0x63 Aug 22 07:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 9177.809363] dump_stack+0x10/0x16 Aug 22 07:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 9177.810086] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 07:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 9177.810878] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 07:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 9177.811661] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 07:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 9177.812511] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 07:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 9177.813347] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 07:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 9177.814167] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 07:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 9177.814945] print_cpu_stall.cold+0x2f/0xe2 Aug 22 07:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 9177.815717] ? timekeeping_update+0xf7/0x150 Aug 22 07:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 9177.816509] check_cpu_stall+0x109/0x270 Aug 22 07:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 9177.817268] rcu_sched_clock_irq+0x9a/0x250 Aug 22 07:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 9177.818027] update_process_times+0x94/0xd0 Aug 22 07:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 9177.818789] tick_sched_handle+0x29/0x70 Aug 22 07:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 9177.819542] tick_sched_timer+0x8c/0xc0 Aug 22 07:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 9177.820293] ? tick_nohz_handler+0xb0/0xb0 Aug 22 07:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 9177.821048] __hrtimer_run_queues+0x107/0x230 Aug 22 07:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 9177.821826] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 07:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 9177.822601] hrtimer_interrupt+0x101/0x220 Aug 22 07:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 9177.823357] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 07:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 9177.824248] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 07:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 9177.825080] Aug 22 07:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 9177.825726] Aug 22 07:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 9177.826356] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 07:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 9177.827173] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 9177.828071] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 07:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 9177.830284] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 07:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 9177.831161] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 07:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 9177.832165] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 07:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 9177.833286] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 07:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 9177.834386] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 07:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 9177.835476] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 07:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 9177.836577] ? _raw_spin_lock+0x22/0x30 Aug 22 07:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 9177.837426] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 9177.838344] direct_page_fault+0x206/0x310 [kvm] Aug 22 07:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 9177.839274] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 07:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 9177.840204] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 07:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 9177.841120] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 07:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 9177.842040] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 07:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 9177.842918] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 07:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 9177.843838] handle_exit+0x98/0x230 [kvm_amd] Aug 22 07:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 9177.844698] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 07:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 9177.845564] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 07:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 9177.846473] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 07:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 9177.847374] vcpu_run+0x62/0x2c0 [kvm] Aug 22 07:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 9177.848197] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 07:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 9177.849023] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 07:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 9177.849921] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 07:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 9177.850782] ? __seccomp_filter+0x4a/0x4a0 Aug 22 07:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 9177.851716] ? __fget_files+0x86/0xc0 Aug 22 07:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 9177.852508] __x64_sys_ioctl+0x95/0xd0 Aug 22 07:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 9177.853284] do_syscall_64+0x5c/0xc0 Aug 22 07:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 9177.854032] ? do_futex+0x162/0x1f0 Aug 22 07:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 9177.854777] ? __x64_sys_futex+0x78/0x1e0 Aug 22 07:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 9177.855551] ? __secure_computing+0xa9/0x120 Aug 22 07:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 9177.856351] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 07:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 9177.857241] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 9177.858090] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 9177.858978] ? do_syscall_64+0x69/0xc0 Aug 22 07:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 9177.859735] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 9177.860596] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 9177.861458] ? do_syscall_64+0x69/0xc0 Aug 22 07:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 9177.862229] ? do_syscall_64+0x69/0xc0 Aug 22 07:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 9177.862994] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 07:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 9177.863862] RIP: 0033:0x7faa5d0edaff Aug 22 07:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 9177.864626] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 07:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 9177.867045] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 07:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 9177.868165] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 07:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 9177.869239] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 07:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 9177.870316] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 07:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 9177.871383] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 07:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 9177.872453] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 07:56:43 juju-e4d256-prod-github-runner-207 kernel: [ 9177.873498] Aug 22 07:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 9204.541981] watchdog: BUG: soft lockup - CPU#1 stuck for 8464s! [qemu-system-x86:6715] Aug 22 07:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 9204.543113] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 07:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 9204.543186] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 07:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 9204.555344] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 07:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 9204.556636] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 07:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 9204.557856] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 9204.558948] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 07:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 9204.561542] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 07:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 9204.562598] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 07:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 9204.563779] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 07:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 9204.564941] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 07:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 9204.566137] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 07:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 9204.567329] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 07:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 9204.568519] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 07:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 9204.569749] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 07:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 9204.570845] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 07:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 9204.572070] Call Trace: Aug 22 07:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 9204.572987] Aug 22 07:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 9204.573873] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 9204.574934] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 9204.576168] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 9204.577727] ? show_regs.part.0+0x23/0x29 Aug 22 07:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 9204.579167] ? show_regs.cold+0x8/0xd Aug 22 07:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 9204.580256] ? watchdog_timer_fn+0x1be/0x220 Aug 22 07:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 9204.581265] ? lockup_detector_update_enable+0x60/0x60 Aug 22 07:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 9204.582325] ? __hrtimer_run_queues+0x107/0x230 Aug 22 07:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 9204.583355] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 07:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 9204.584390] ? hrtimer_interrupt+0x101/0x220 Aug 22 07:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 9204.585423] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 07:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 9204.586494] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 07:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 9204.587537] Aug 22 07:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 9204.588399] Aug 22 07:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 9204.589234] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 07:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 9204.590317] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 9204.591378] ? _raw_spin_lock+0x22/0x30 Aug 22 07:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 9204.592365] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 9204.593401] direct_page_fault+0x206/0x310 [kvm] Aug 22 07:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 9204.594427] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 07:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 9204.595463] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 07:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 9204.596509] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 07:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 9204.597482] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 07:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 9204.598551] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 07:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 9204.599683] handle_exit+0x98/0x230 [kvm_amd] Aug 22 07:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 9204.600682] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 07:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 9204.601696] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 07:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 9204.602749] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 07:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 9204.603797] vcpu_run+0x62/0x2c0 [kvm] Aug 22 07:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 9204.604692] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 07:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 9204.605639] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 07:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 9204.606597] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 07:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 9204.607498] ? __seccomp_filter+0x4a/0x4a0 Aug 22 07:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 9204.608355] ? __fget_files+0x86/0xc0 Aug 22 07:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 9204.609134] __x64_sys_ioctl+0x95/0xd0 Aug 22 07:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 9204.609904] do_syscall_64+0x5c/0xc0 Aug 22 07:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 9204.610644] ? do_futex+0x162/0x1f0 Aug 22 07:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 9204.611396] ? __x64_sys_futex+0x78/0x1e0 Aug 22 07:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 9204.612201] ? __secure_computing+0xa9/0x120 Aug 22 07:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 9204.612975] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 07:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 9204.613835] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 9204.614792] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 9204.615629] ? do_syscall_64+0x69/0xc0 Aug 22 07:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 9204.616348] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 9204.617144] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 9204.617935] ? do_syscall_64+0x69/0xc0 Aug 22 07:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 9204.618637] ? do_syscall_64+0x69/0xc0 Aug 22 07:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 9204.619336] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 07:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 9204.620149] RIP: 0033:0x7faa5d0edaff Aug 22 07:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 9204.620850] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 07:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 9204.623169] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 07:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 9204.624229] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 07:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 9204.625253] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 07:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 9204.626278] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 07:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 9204.627300] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 07:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 9204.628333] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 07:57:10 juju-e4d256-prod-github-runner-207 kernel: [ 9204.629361] Aug 22 07:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 9232.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 8490s! [qemu-system-x86:6715] Aug 22 07:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 9232.543904] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 07:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 9232.544213] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 07:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 9232.556946] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 07:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 9232.558223] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 07:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 9232.559789] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 9232.561119] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 07:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 9232.564122] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 07:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 9232.565325] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 07:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 9232.566647] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 07:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 9232.568046] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 07:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 9232.569532] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 07:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 9232.570897] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 07:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 9232.572375] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 07:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 9232.573633] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 07:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 9232.574750] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 07:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 9232.575973] Call Trace: Aug 22 07:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 9232.576887] Aug 22 07:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 9232.577789] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 9232.578828] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 9232.579862] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 9232.580959] ? show_regs.part.0+0x23/0x29 Aug 22 07:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 9232.582144] ? show_regs.cold+0x8/0xd Aug 22 07:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 9232.583114] ? watchdog_timer_fn+0x1be/0x220 Aug 22 07:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 9232.584134] ? lockup_detector_update_enable+0x60/0x60 Aug 22 07:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 9232.585195] ? __hrtimer_run_queues+0x107/0x230 Aug 22 07:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 9232.586229] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 07:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 9232.587267] ? hrtimer_interrupt+0x101/0x220 Aug 22 07:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 9232.588394] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 07:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 9232.589464] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 07:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 9232.590510] Aug 22 07:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 9232.591379] Aug 22 07:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 9232.592232] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 07:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 9232.593456] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 9232.594501] ? _raw_spin_lock+0x22/0x30 Aug 22 07:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 9232.595458] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 9232.596483] direct_page_fault+0x206/0x310 [kvm] Aug 22 07:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 9232.597507] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 07:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 9232.598515] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 07:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 9232.599536] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 07:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 9232.600550] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 07:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 9232.601498] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 07:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 9232.602483] handle_exit+0x98/0x230 [kvm_amd] Aug 22 07:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 9232.603388] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 07:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 9232.604495] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 07:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 9232.605445] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 07:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 9232.606360] vcpu_run+0x62/0x2c0 [kvm] Aug 22 07:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 9232.607378] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 07:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 9232.608197] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 07:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 9232.609249] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 07:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 9232.610048] ? __seccomp_filter+0x4a/0x4a0 Aug 22 07:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 9232.610812] ? __fget_files+0x86/0xc0 Aug 22 07:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 9232.611557] __x64_sys_ioctl+0x95/0xd0 Aug 22 07:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 9232.612314] do_syscall_64+0x5c/0xc0 Aug 22 07:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 9232.612997] ? do_futex+0x162/0x1f0 Aug 22 07:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 9232.613689] ? __x64_sys_futex+0x78/0x1e0 Aug 22 07:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 9232.614371] ? __secure_computing+0xa9/0x120 Aug 22 07:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 9232.615065] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 07:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 9232.615849] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 9232.616577] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 9232.617304] ? do_syscall_64+0x69/0xc0 Aug 22 07:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 9232.617953] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 9232.618657] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 9232.619372] ? do_syscall_64+0x69/0xc0 Aug 22 07:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 9232.620018] ? do_syscall_64+0x69/0xc0 Aug 22 07:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 9232.620657] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 07:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 9232.621366] RIP: 0033:0x7faa5d0edaff Aug 22 07:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 9232.622039] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 07:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 9232.624053] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 07:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 9232.624972] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 07:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 9232.625867] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 07:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 9232.626760] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 07:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 9232.627667] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 07:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 9232.628567] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 07:57:38 juju-e4d256-prod-github-runner-207 kernel: [ 9232.629463] Aug 22 07:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 9260.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 8516s! [qemu-system-x86:6715] Aug 22 07:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 9260.543108] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 07:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 9260.543180] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 07:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 9260.555254] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 07:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 9260.556519] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 07:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 9260.557877] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 9260.558961] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 07:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 9260.561524] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 07:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 9260.562591] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 07:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 9260.563779] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 07:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 9260.564939] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 07:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 9260.566324] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 07:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 9260.568161] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 07:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 9260.569349] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 07:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 9260.570606] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 07:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 9260.571745] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 07:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 9260.572935] Call Trace: Aug 22 07:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 9260.573844] Aug 22 07:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 9260.574725] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 9260.575779] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 9260.576870] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 9260.577951] ? show_regs.part.0+0x23/0x29 Aug 22 07:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 9260.578965] ? show_regs.cold+0x8/0xd Aug 22 07:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 9260.580005] ? watchdog_timer_fn+0x1be/0x220 Aug 22 07:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 9260.581029] ? lockup_detector_update_enable+0x60/0x60 Aug 22 07:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 9260.582113] ? __hrtimer_run_queues+0x107/0x230 Aug 22 07:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 9260.583158] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 07:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 9260.584184] ? hrtimer_interrupt+0x101/0x220 Aug 22 07:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 9260.585206] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 07:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 9260.586280] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 07:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 9260.587335] Aug 22 07:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 9260.588190] Aug 22 07:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 9260.589031] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 07:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 9260.590065] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 9260.591118] ? _raw_spin_lock+0x22/0x30 Aug 22 07:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 9260.592066] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 9260.593110] direct_page_fault+0x206/0x310 [kvm] Aug 22 07:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 9260.594142] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 07:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 9260.595247] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 07:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 9260.596274] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 07:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 9260.597300] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 07:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 9260.598293] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 07:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 9260.599314] handle_exit+0x98/0x230 [kvm_amd] Aug 22 07:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 9260.600213] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 07:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 9260.601174] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 07:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 9260.602104] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 07:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 9260.603030] vcpu_run+0x62/0x2c0 [kvm] Aug 22 07:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 9260.603873] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 07:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 9260.604709] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 07:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 9260.605629] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 07:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 9260.606440] ? __seccomp_filter+0x4a/0x4a0 Aug 22 07:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 9260.607200] ? __fget_files+0x86/0xc0 Aug 22 07:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 9260.607945] __x64_sys_ioctl+0x95/0xd0 Aug 22 07:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 9260.608641] do_syscall_64+0x5c/0xc0 Aug 22 07:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 9260.609318] ? do_futex+0x162/0x1f0 Aug 22 07:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 9260.610011] ? __x64_sys_futex+0x78/0x1e0 Aug 22 07:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 9260.610691] ? __secure_computing+0xa9/0x120 Aug 22 07:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 9260.611409] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 07:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 9260.612170] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 9260.612895] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 9260.613620] ? do_syscall_64+0x69/0xc0 Aug 22 07:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 9260.614272] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 9260.615010] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 9260.615712] ? do_syscall_64+0x69/0xc0 Aug 22 07:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 9260.616341] ? do_syscall_64+0x69/0xc0 Aug 22 07:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 9260.616967] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 07:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 9260.617676] RIP: 0033:0x7faa5d0edaff Aug 22 07:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 9260.618304] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 07:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 9260.620306] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 07:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 9260.621218] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 07:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 9260.622108] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 07:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 9260.623014] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 07:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 9260.623911] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 07:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 9260.624814] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 07:58:06 juju-e4d256-prod-github-runner-207 kernel: [ 9260.625708] Aug 22 07:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 9288.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 8542s! [qemu-system-x86:6715] Aug 22 07:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 9288.543129] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 07:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 9288.543204] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 07:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 9288.555359] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 07:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 9288.556657] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 07:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 9288.557888] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 9288.558960] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 07:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 9288.561660] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 07:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 9288.562728] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 07:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 9288.563886] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 07:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 9288.565056] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 07:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 9288.566249] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 07:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 9288.567451] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 07:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 9288.568726] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 07:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 9288.569957] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 07:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 9288.571082] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 07:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 9288.572286] Call Trace: Aug 22 07:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 9288.573199] Aug 22 07:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 9288.574082] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 9288.575122] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 9288.576145] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 9288.577227] ? show_regs.part.0+0x23/0x29 Aug 22 07:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 9288.578234] ? show_regs.cold+0x8/0xd Aug 22 07:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 9288.579217] ? watchdog_timer_fn+0x1be/0x220 Aug 22 07:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 9288.580236] ? lockup_detector_update_enable+0x60/0x60 Aug 22 07:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 9288.581321] ? __hrtimer_run_queues+0x107/0x230 Aug 22 07:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 9288.582351] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 07:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 9288.583390] ? hrtimer_interrupt+0x101/0x220 Aug 22 07:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 9288.584416] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 07:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 9288.585514] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 07:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 9288.586589] Aug 22 07:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 9288.587454] Aug 22 07:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 9288.588292] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 07:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 9288.589331] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 9288.590369] ? _raw_spin_lock+0x22/0x30 Aug 22 07:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 9288.591327] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 9288.592390] direct_page_fault+0x206/0x310 [kvm] Aug 22 07:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 9288.593434] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 07:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 9288.594443] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 07:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 9288.595483] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 07:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 9288.596488] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 07:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 9288.597432] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 07:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 9288.598406] handle_exit+0x98/0x230 [kvm_amd] Aug 22 07:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 9288.599319] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 07:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 9288.600229] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 07:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 9288.601149] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 07:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 9288.602064] vcpu_run+0x62/0x2c0 [kvm] Aug 22 07:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 9288.602941] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 07:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 9288.603942] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 07:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 9288.604798] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 07:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 9288.605595] ? __seccomp_filter+0x4a/0x4a0 Aug 22 07:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 9288.606340] ? __fget_files+0x86/0xc0 Aug 22 07:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 9288.607053] __x64_sys_ioctl+0x95/0xd0 Aug 22 07:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 9288.607743] do_syscall_64+0x5c/0xc0 Aug 22 07:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 9288.608408] ? do_futex+0x162/0x1f0 Aug 22 07:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 9288.609054] ? __x64_sys_futex+0x78/0x1e0 Aug 22 07:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 9288.609735] ? __secure_computing+0xa9/0x120 Aug 22 07:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 9288.610422] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 07:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 9288.611214] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 9288.611954] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 9288.612724] ? do_syscall_64+0x69/0xc0 Aug 22 07:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 9288.613408] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 9288.614175] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 9288.614950] ? do_syscall_64+0x69/0xc0 Aug 22 07:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 9288.615703] ? do_syscall_64+0x69/0xc0 Aug 22 07:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 9288.616350] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 07:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 9288.617087] RIP: 0033:0x7faa5d0edaff Aug 22 07:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 9288.617769] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 07:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 9288.619788] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 07:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 9288.620711] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 07:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 9288.621625] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 07:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 9288.622541] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 07:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 9288.623584] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 07:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 9288.624474] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 07:58:34 juju-e4d256-prod-github-runner-207 kernel: [ 9288.625383] Aug 22 07:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 9316.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 8568s! [qemu-system-x86:6715] Aug 22 07:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 9316.543848] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 07:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 9316.544149] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 07:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 9316.556652] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 07:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 9316.557931] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 07:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 9316.559177] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 9316.560244] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 07:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 9316.562824] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 07:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 9316.563869] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 07:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 9316.565033] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 07:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 9316.566238] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 07:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 9316.567425] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 07:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 9316.568601] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 07:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 9316.569777] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 07:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 9316.571039] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 07:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 9316.572143] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 07:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 9316.573345] Call Trace: Aug 22 07:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 9316.574289] Aug 22 07:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 9316.575201] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 9316.576250] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 9316.577308] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 9316.578449] ? show_regs.part.0+0x23/0x29 Aug 22 07:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 9316.579452] ? show_regs.cold+0x8/0xd Aug 22 07:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 9316.580426] ? watchdog_timer_fn+0x1be/0x220 Aug 22 07:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 9316.581482] ? lockup_detector_update_enable+0x60/0x60 Aug 22 07:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 9316.582623] ? __hrtimer_run_queues+0x107/0x230 Aug 22 07:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 9316.583665] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 07:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 9316.584691] ? hrtimer_interrupt+0x101/0x220 Aug 22 07:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 9316.585710] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 07:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 9316.586799] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 07:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 9316.587870] Aug 22 07:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 9316.588739] Aug 22 07:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 9316.589586] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 07:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 9316.590639] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 9316.591733] ? _raw_spin_lock+0x22/0x30 Aug 22 07:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 9316.592705] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 9316.593739] direct_page_fault+0x206/0x310 [kvm] Aug 22 07:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 9316.594840] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 07:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 9316.595867] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 07:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 9316.596907] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 07:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 9316.597960] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 07:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 9316.598951] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 07:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 9316.599934] handle_exit+0x98/0x230 [kvm_amd] Aug 22 07:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 9316.600868] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 07:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 9316.601799] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 07:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 9316.602765] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 07:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 9316.603704] vcpu_run+0x62/0x2c0 [kvm] Aug 22 07:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 9316.604514] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 07:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 9316.605324] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 07:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 9316.606228] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 07:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 9316.607077] ? __seccomp_filter+0x4a/0x4a0 Aug 22 07:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 9316.607842] ? __fget_files+0x86/0xc0 Aug 22 07:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 9316.608585] __x64_sys_ioctl+0x95/0xd0 Aug 22 07:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 9316.609289] do_syscall_64+0x5c/0xc0 Aug 22 07:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 9316.609959] ? do_futex+0x162/0x1f0 Aug 22 07:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 9316.610642] ? __x64_sys_futex+0x78/0x1e0 Aug 22 07:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 9316.611347] ? __secure_computing+0xa9/0x120 Aug 22 07:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 9316.612140] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 07:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 9316.612913] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 9316.613689] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 9316.614457] ? do_syscall_64+0x69/0xc0 Aug 22 07:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 9316.615121] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 9316.615833] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 9316.616529] ? do_syscall_64+0x69/0xc0 Aug 22 07:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 9316.617225] ? do_syscall_64+0x69/0xc0 Aug 22 07:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 9316.617858] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 07:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 9316.618603] RIP: 0033:0x7faa5d0edaff Aug 22 07:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 9316.619288] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 07:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 9316.621330] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 07:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 9316.622265] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 07:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 9316.623159] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 07:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 9316.624051] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 07:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 9316.624939] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 07:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 9316.625849] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 07:59:02 juju-e4d256-prod-github-runner-207 kernel: [ 9316.626803] Aug 22 07:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 9344.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 8594s! [qemu-system-x86:6715] Aug 22 07:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 9344.543108] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 07:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 9344.543184] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 07:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 9344.555457] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 07:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 9344.556720] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 07:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 9344.557951] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 9344.559014] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 07:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 9344.561545] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 07:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 9344.562602] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 07:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 9344.563765] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 07:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 9344.564920] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 07:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 9344.566096] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 07:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 9344.567253] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 07:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 9344.568417] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 07:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 9344.569652] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 07:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 9344.570763] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 07:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 9344.571959] Call Trace: Aug 22 07:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 9344.572869] Aug 22 07:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 9344.573751] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 9344.574816] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 07:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 9344.575840] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 9344.576911] ? show_regs.part.0+0x23/0x29 Aug 22 07:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 9344.577931] ? show_regs.cold+0x8/0xd Aug 22 07:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 9344.578904] ? watchdog_timer_fn+0x1be/0x220 Aug 22 07:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 9344.579909] ? lockup_detector_update_enable+0x60/0x60 Aug 22 07:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 9344.580974] ? __hrtimer_run_queues+0x107/0x230 Aug 22 07:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 9344.582018] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 07:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 9344.583040] ? hrtimer_interrupt+0x101/0x220 Aug 22 07:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 9344.584074] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 07:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 9344.585143] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 07:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 9344.586209] Aug 22 07:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 9344.587063] Aug 22 07:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 9344.587899] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 07:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 9344.588934] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 9344.589985] ? _raw_spin_lock+0x22/0x30 Aug 22 07:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 9344.590930] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 9344.591945] direct_page_fault+0x206/0x310 [kvm] Aug 22 07:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 9344.592966] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 07:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 9344.593994] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 07:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 9344.594995] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 07:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 9344.595966] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 07:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 9344.596923] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 07:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 9344.597920] handle_exit+0x98/0x230 [kvm_amd] Aug 22 07:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 9344.598813] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 07:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 9344.599726] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 07:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 9344.600655] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 07:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 9344.601564] vcpu_run+0x62/0x2c0 [kvm] Aug 22 07:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 9344.602391] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 07:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 9344.603203] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 07:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 9344.604060] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 07:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 9344.604856] ? __seccomp_filter+0x4a/0x4a0 Aug 22 07:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 9344.605598] ? __fget_files+0x86/0xc0 Aug 22 07:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 9344.606323] __x64_sys_ioctl+0x95/0xd0 Aug 22 07:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 9344.607019] do_syscall_64+0x5c/0xc0 Aug 22 07:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 9344.607694] ? do_futex+0x162/0x1f0 Aug 22 07:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 9344.608343] ? __x64_sys_futex+0x78/0x1e0 Aug 22 07:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 9344.609015] ? __secure_computing+0xa9/0x120 Aug 22 07:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 9344.609705] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 07:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 9344.610490] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 9344.611214] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 9344.611929] ? do_syscall_64+0x69/0xc0 Aug 22 07:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 9344.612570] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 9344.613276] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 9344.613984] ? do_syscall_64+0x69/0xc0 Aug 22 07:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 9344.614611] ? do_syscall_64+0x69/0xc0 Aug 22 07:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 9344.615232] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 07:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 9344.615940] RIP: 0033:0x7faa5d0edaff Aug 22 07:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 9344.616562] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 07:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 9344.618560] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 07:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 9344.619473] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 07:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 9344.620369] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 07:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 9344.621255] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 07:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 9344.622178] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 07:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 9344.623065] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 07:59:30 juju-e4d256-prod-github-runner-207 kernel: [ 9344.623954] Aug 22 07:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 9357.812709] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 07:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 9357.813740] rcu: 1-....: (2302918 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=1114492 Aug 22 07:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 9357.814879] (t=2310153 jiffies g=23269 q=18162) Aug 22 07:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 9357.815830] NMI backtrace for cpu 1 Aug 22 07:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 9357.816618] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 07:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 9357.817918] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 07:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 9357.819136] Call Trace: Aug 22 07:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 9357.819862] Aug 22 07:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 9357.820549] show_stack+0x52/0x5c Aug 22 07:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 9357.821338] dump_stack_lvl+0x4a/0x63 Aug 22 07:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 9357.822163] dump_stack+0x10/0x16 Aug 22 07:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 9357.822954] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 07:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 9357.823818] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 07:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 9357.824684] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 07:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 9357.825612] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 07:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 9357.826569] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 07:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 9357.827489] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 07:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 9357.828353] print_cpu_stall.cold+0x2f/0xe2 Aug 22 07:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 9357.829204] ? timekeeping_update+0xf7/0x150 Aug 22 07:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 9357.830067] check_cpu_stall+0x109/0x270 Aug 22 07:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 9357.830908] rcu_sched_clock_irq+0x9a/0x250 Aug 22 07:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 9357.831760] update_process_times+0x94/0xd0 Aug 22 07:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 9357.832612] tick_sched_handle+0x29/0x70 Aug 22 07:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 9357.833439] tick_sched_timer+0x8c/0xc0 Aug 22 07:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 9357.834260] ? tick_nohz_handler+0xb0/0xb0 Aug 22 07:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 9357.835108] __hrtimer_run_queues+0x107/0x230 Aug 22 07:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 9357.835974] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 07:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 9357.836837] hrtimer_interrupt+0x101/0x220 Aug 22 07:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 9357.837694] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 07:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 9357.838616] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 07:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 9357.839509] Aug 22 07:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 9357.840197] Aug 22 07:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 9357.840871] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 07:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 9357.841822] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 07:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 9357.842817] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 07:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 9357.845356] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 07:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 9357.846342] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 07:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 9357.847471] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 07:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 9357.848586] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 07:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 9357.849702] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 07:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 9357.850789] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 07:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 9357.851881] ? _raw_spin_lock+0x22/0x30 Aug 22 07:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 9357.852726] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 07:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 9357.853665] direct_page_fault+0x206/0x310 [kvm] Aug 22 07:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 9357.854594] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 07:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 9357.855510] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 07:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 9357.856427] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 07:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 9357.857324] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 07:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 9357.858218] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 07:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 9357.859158] handle_exit+0x98/0x230 [kvm_amd] Aug 22 07:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 9357.859999] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 07:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 9357.860870] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 07:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 9357.861813] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 07:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 9357.862702] vcpu_run+0x62/0x2c0 [kvm] Aug 22 07:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 9357.863626] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 07:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 9357.864606] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 07:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 9357.865510] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 07:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 9357.866397] ? __seccomp_filter+0x4a/0x4a0 Aug 22 07:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 9357.867214] ? __fget_files+0x86/0xc0 Aug 22 07:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 9357.867979] __x64_sys_ioctl+0x95/0xd0 Aug 22 07:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 9357.868760] do_syscall_64+0x5c/0xc0 Aug 22 07:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 9357.869518] ? do_futex+0x162/0x1f0 Aug 22 07:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 9357.870275] ? __x64_sys_futex+0x78/0x1e0 Aug 22 07:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 9357.871055] ? __secure_computing+0xa9/0x120 Aug 22 07:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 9357.871854] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 07:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 9357.872755] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 9357.873607] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 9357.874484] ? do_syscall_64+0x69/0xc0 Aug 22 07:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 9357.875265] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 07:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 9357.876113] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 07:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 9357.876963] ? do_syscall_64+0x69/0xc0 Aug 22 07:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 9357.877763] ? do_syscall_64+0x69/0xc0 Aug 22 07:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 9357.878532] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 07:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 9357.879406] RIP: 0033:0x7faa5d0edaff Aug 22 07:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 9357.880165] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 07:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 9357.882638] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 07:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 9357.883746] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 07:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 9357.884826] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 07:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 9357.885925] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 07:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 9357.887014] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 07:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 9357.888078] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 07:59:43 juju-e4d256-prod-github-runner-207 kernel: [ 9357.889131] Aug 22 08:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 9384.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 8632s! [qemu-system-x86:6715] Aug 22 08:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 9384.543127] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 08:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 9384.543205] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 08:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 9384.555580] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 08:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 9384.556886] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 08:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 9384.558152] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 9384.559232] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 08:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 9384.561845] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 08:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 9384.562910] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 08:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 9384.564097] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 08:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 9384.565270] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 08:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 9384.566463] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 08:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 9384.567652] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 08:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 9384.568860] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 08:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 9384.570164] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 08:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 9384.571363] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 08:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 9384.572830] Call Trace: Aug 22 08:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 9384.573767] Aug 22 08:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 9384.574654] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 9384.575723] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 9384.576760] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 9384.577861] ? show_regs.part.0+0x23/0x29 Aug 22 08:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 9384.578889] ? show_regs.cold+0x8/0xd Aug 22 08:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 9384.580011] ? watchdog_timer_fn+0x1be/0x220 Aug 22 08:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 9384.581232] ? lockup_detector_update_enable+0x60/0x60 Aug 22 08:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 9384.582433] ? __hrtimer_run_queues+0x107/0x230 Aug 22 08:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 9384.583479] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 08:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 9384.584536] ? hrtimer_interrupt+0x101/0x220 Aug 22 08:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 9384.585762] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 08:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 9384.586911] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 08:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 9384.588028] Aug 22 08:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 9384.589133] Aug 22 08:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 9384.589993] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 08:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 9384.591047] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 9384.592094] ? _raw_spin_lock+0x22/0x30 Aug 22 08:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 9384.593044] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 9384.594078] direct_page_fault+0x206/0x310 [kvm] Aug 22 08:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 9384.595110] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 08:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 9384.596131] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 08:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 9384.597145] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 08:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 9384.598133] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 08:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 9384.599087] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 08:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 9384.600080] handle_exit+0x98/0x230 [kvm_amd] Aug 22 08:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 9384.600982] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 08:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 9384.601910] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 08:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 9384.602850] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 08:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 9384.603768] vcpu_run+0x62/0x2c0 [kvm] Aug 22 08:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 9384.604584] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 08:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 9384.605409] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 08:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 9384.606277] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 08:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 9384.607081] ? __seccomp_filter+0x4a/0x4a0 Aug 22 08:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 9384.607832] ? __fget_files+0x86/0xc0 Aug 22 08:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 9384.608542] __x64_sys_ioctl+0x95/0xd0 Aug 22 08:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 9384.609248] do_syscall_64+0x5c/0xc0 Aug 22 08:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 9384.609932] ? do_futex+0x162/0x1f0 Aug 22 08:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 9384.610593] ? __x64_sys_futex+0x78/0x1e0 Aug 22 08:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 9384.611278] ? __secure_computing+0xa9/0x120 Aug 22 08:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 9384.611974] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 08:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 9384.612802] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 9384.613759] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 9384.614646] ? do_syscall_64+0x69/0xc0 Aug 22 08:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 9384.615310] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 9384.616029] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 9384.616927] ? do_syscall_64+0x69/0xc0 Aug 22 08:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 9384.617588] ? do_syscall_64+0x69/0xc0 Aug 22 08:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 9384.618249] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 08:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 9384.618967] RIP: 0033:0x7faa5d0edaff Aug 22 08:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 9384.619613] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 08:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 9384.621667] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 08:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 9384.622605] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 08:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 9384.623529] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 08:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 9384.624439] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 08:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 9384.625351] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 08:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 9384.626264] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 08:00:10 juju-e4d256-prod-github-runner-207 kernel: [ 9384.627264] Aug 22 08:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 9412.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 8658s! [qemu-system-x86:6715] Aug 22 08:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 9412.543835] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 08:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 9412.544131] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 08:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 9412.556459] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 08:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 9412.557757] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 08:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 9412.559000] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 9412.560098] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 08:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 9412.562727] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 08:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 9412.563830] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 08:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 9412.565085] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 08:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 9412.566338] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 08:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 9412.567551] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 08:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 9412.568764] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 08:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 9412.569987] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 08:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 9412.571245] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 08:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 9412.572384] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 08:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 9412.573615] Call Trace: Aug 22 08:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 9412.574531] Aug 22 08:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 9412.575428] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 9412.576486] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 9412.577550] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 9412.578674] ? show_regs.part.0+0x23/0x29 Aug 22 08:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 9412.579722] ? show_regs.cold+0x8/0xd Aug 22 08:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 9412.580716] ? watchdog_timer_fn+0x1be/0x220 Aug 22 08:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 9412.581811] ? lockup_detector_update_enable+0x60/0x60 Aug 22 08:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 9412.582894] ? __hrtimer_run_queues+0x107/0x230 Aug 22 08:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 9412.583936] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 08:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 9412.585075] ? hrtimer_interrupt+0x101/0x220 Aug 22 08:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 9412.586265] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 08:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 9412.587388] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 08:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 9412.588514] Aug 22 08:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 9412.589396] Aug 22 08:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 9412.590278] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 08:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 9412.591329] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 9412.592393] ? _raw_spin_lock+0x22/0x30 Aug 22 08:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 9412.593449] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 9412.594498] direct_page_fault+0x206/0x310 [kvm] Aug 22 08:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 9412.595552] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 08:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 9412.596581] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 08:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 9412.597775] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 08:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 9412.598783] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 08:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 9412.599748] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 08:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 9412.600737] handle_exit+0x98/0x230 [kvm_amd] Aug 22 08:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 9412.601653] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 08:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 9412.602630] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 08:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 9412.603640] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 08:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 9412.604572] vcpu_run+0x62/0x2c0 [kvm] Aug 22 08:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 9412.605435] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 08:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 9412.606257] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 08:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 9412.607130] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 08:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 9412.607940] ? __seccomp_filter+0x4a/0x4a0 Aug 22 08:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 9412.608705] ? __fget_files+0x86/0xc0 Aug 22 08:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 9412.609434] __x64_sys_ioctl+0x95/0xd0 Aug 22 08:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 9412.610149] do_syscall_64+0x5c/0xc0 Aug 22 08:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 9412.610838] ? do_futex+0x162/0x1f0 Aug 22 08:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 9412.611509] ? __x64_sys_futex+0x78/0x1e0 Aug 22 08:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 9412.612228] ? __secure_computing+0xa9/0x120 Aug 22 08:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 9412.612972] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 08:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 9412.613753] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 9412.614493] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 9412.615226] ? do_syscall_64+0x69/0xc0 Aug 22 08:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 9412.615886] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 9412.616597] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 9412.617322] ? do_syscall_64+0x69/0xc0 Aug 22 08:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 9412.617951] ? do_syscall_64+0x69/0xc0 Aug 22 08:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 9412.618591] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 08:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 9412.619316] RIP: 0033:0x7faa5d0edaff Aug 22 08:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 9412.619970] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 08:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 9412.621972] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 08:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 9412.622888] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 08:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 9412.623776] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 08:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 9412.624678] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 08:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 9412.625593] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 08:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 9412.626485] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 08:00:38 juju-e4d256-prod-github-runner-207 kernel: [ 9412.627386] Aug 22 08:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 9440.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 8684s! [qemu-system-x86:6715] Aug 22 08:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 9440.543088] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 08:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 9440.543161] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 08:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 9440.555280] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 08:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 9440.556544] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 08:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 9440.557794] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 9440.558858] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 08:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 9440.561422] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 08:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 9440.562480] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 08:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 9440.563639] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 08:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 9440.564830] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 08:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 9440.566007] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 08:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 9440.567174] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 08:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 9440.568361] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 08:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 9440.569644] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 08:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 9440.570748] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 08:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 9440.571945] Call Trace: Aug 22 08:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 9440.572910] Aug 22 08:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 9440.573813] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 9440.574842] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 9440.575872] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 9440.576975] ? show_regs.part.0+0x23/0x29 Aug 22 08:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 9440.577975] ? show_regs.cold+0x8/0xd Aug 22 08:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 9440.578944] ? watchdog_timer_fn+0x1be/0x220 Aug 22 08:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 9440.579948] ? lockup_detector_update_enable+0x60/0x60 Aug 22 08:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 9440.581056] ? __hrtimer_run_queues+0x107/0x230 Aug 22 08:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 9440.582300] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 08:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 9440.583422] ? hrtimer_interrupt+0x101/0x220 Aug 22 08:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 9440.584551] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 08:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 9440.585721] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 08:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 9440.586844] Aug 22 08:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 9440.587778] Aug 22 08:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 9440.588683] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 08:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 9440.589805] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 9440.590917] ? _raw_spin_lock+0x22/0x30 Aug 22 08:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 9440.591915] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 9440.593006] direct_page_fault+0x206/0x310 [kvm] Aug 22 08:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 9440.594092] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 08:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 9440.595166] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 08:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 9440.596258] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 08:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 9440.597312] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 08:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 9440.598313] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 08:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 9440.599348] handle_exit+0x98/0x230 [kvm_amd] Aug 22 08:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 9440.600292] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 08:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 9440.601277] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 08:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 9440.602250] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 08:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 9440.603249] vcpu_run+0x62/0x2c0 [kvm] Aug 22 08:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 9440.604112] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 08:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 9440.604992] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 08:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 9440.606061] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 08:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 9440.606909] ? __seccomp_filter+0x4a/0x4a0 Aug 22 08:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 9440.607719] ? __fget_files+0x86/0xc0 Aug 22 08:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 9440.608471] __x64_sys_ioctl+0x95/0xd0 Aug 22 08:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 9440.609232] do_syscall_64+0x5c/0xc0 Aug 22 08:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 9440.610085] ? do_futex+0x162/0x1f0 Aug 22 08:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 9440.610765] ? __x64_sys_futex+0x78/0x1e0 Aug 22 08:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 9440.611472] ? __secure_computing+0xa9/0x120 Aug 22 08:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 9440.612226] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 08:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 9440.613038] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 9440.613803] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 9440.614562] ? do_syscall_64+0x69/0xc0 Aug 22 08:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 9440.615267] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 9440.615998] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 9440.616768] ? do_syscall_64+0x69/0xc0 Aug 22 08:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 9440.617437] ? do_syscall_64+0x69/0xc0 Aug 22 08:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 9440.618098] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 08:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 9440.618847] RIP: 0033:0x7faa5d0edaff Aug 22 08:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 9440.619501] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 08:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 9440.621586] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 08:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 9440.622513] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 08:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 9440.623456] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 08:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 9440.624420] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 08:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 9440.625422] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 08:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 9440.626381] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 08:01:06 juju-e4d256-prod-github-runner-207 kernel: [ 9440.627331] Aug 22 08:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 9468.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 8710s! [qemu-system-x86:6715] Aug 22 08:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 9468.543123] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 08:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 9468.543197] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 08:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 9468.555800] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 08:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 9468.557135] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 08:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 9468.558409] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 9468.559468] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 08:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 9468.562027] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 08:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 9468.563248] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 08:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 9468.564450] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 08:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 9468.565627] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 08:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 9468.566805] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 08:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 9468.567962] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 08:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 9468.569161] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 08:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 9468.570401] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 08:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 9468.571495] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 08:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 9468.572707] Call Trace: Aug 22 08:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 9468.573677] Aug 22 08:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 9468.574568] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 9468.575596] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 9468.576736] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 9468.577820] ? show_regs.part.0+0x23/0x29 Aug 22 08:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 9468.578813] ? show_regs.cold+0x8/0xd Aug 22 08:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 9468.579780] ? watchdog_timer_fn+0x1be/0x220 Aug 22 08:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 9468.580811] ? lockup_detector_update_enable+0x60/0x60 Aug 22 08:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 9468.581908] ? __hrtimer_run_queues+0x107/0x230 Aug 22 08:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 9468.582963] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 08:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 9468.584044] ? hrtimer_interrupt+0x101/0x220 Aug 22 08:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 9468.585101] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 08:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 9468.586328] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 08:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 9468.587376] Aug 22 08:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 9468.588228] Aug 22 08:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 9468.589118] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 08:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 9468.590155] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 9468.591194] ? _raw_spin_lock+0x22/0x30 Aug 22 08:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 9468.592145] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 9468.593183] direct_page_fault+0x206/0x310 [kvm] Aug 22 08:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 9468.594216] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 08:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 9468.595232] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 08:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 9468.596276] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 08:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 9468.597254] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 08:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 9468.598198] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 08:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 9468.599180] handle_exit+0x98/0x230 [kvm_amd] Aug 22 08:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 9468.600070] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 08:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 9468.600995] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 08:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 9468.601919] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 08:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 9468.602825] vcpu_run+0x62/0x2c0 [kvm] Aug 22 08:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 9468.603642] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 08:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 9468.604487] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 08:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 9468.605387] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 08:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 9468.606198] ? __seccomp_filter+0x4a/0x4a0 Aug 22 08:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 9468.606940] ? __fget_files+0x86/0xc0 Aug 22 08:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 9468.607654] __x64_sys_ioctl+0x95/0xd0 Aug 22 08:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 9468.608378] do_syscall_64+0x5c/0xc0 Aug 22 08:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 9468.609048] ? do_futex+0x162/0x1f0 Aug 22 08:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 9468.609728] ? __x64_sys_futex+0x78/0x1e0 Aug 22 08:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 9468.610461] ? __secure_computing+0xa9/0x120 Aug 22 08:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 9468.611184] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 08:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 9468.612006] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 9468.612788] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 9468.613513] ? do_syscall_64+0x69/0xc0 Aug 22 08:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 9468.614163] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 9468.614887] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 9468.615613] ? do_syscall_64+0x69/0xc0 Aug 22 08:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 9468.616273] ? do_syscall_64+0x69/0xc0 Aug 22 08:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 9468.616900] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 08:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 9468.617611] RIP: 0033:0x7faa5d0edaff Aug 22 08:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 9468.618240] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 08:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 9468.620253] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 08:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 9468.621209] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 08:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 9468.622108] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 08:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 9468.623002] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 08:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 9468.623894] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 08:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 9468.624820] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 08:01:34 juju-e4d256-prod-github-runner-207 kernel: [ 9468.625754] Aug 22 08:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 9496.541983] watchdog: BUG: soft lockup - CPU#1 stuck for 8736s! [qemu-system-x86:6715] Aug 22 08:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 9496.544277] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 08:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 9496.544617] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 08:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 9496.559285] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 08:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 9496.560763] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 08:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 9496.562157] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 9496.563379] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 08:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 9496.566310] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 08:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 9496.567495] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 08:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 9496.568952] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 08:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 9496.570292] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 08:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 9496.571803] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 08:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 9496.573198] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 08:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 9496.574619] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 08:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 9496.576099] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 08:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 9496.577299] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 08:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 9496.578655] Call Trace: Aug 22 08:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 9496.579614] Aug 22 08:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 9496.580658] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 9496.581812] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 9496.582858] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 9496.584225] ? show_regs.part.0+0x23/0x29 Aug 22 08:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 9496.585515] ? show_regs.cold+0x8/0xd Aug 22 08:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 9496.586636] ? watchdog_timer_fn+0x1be/0x220 Aug 22 08:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 9496.587765] ? lockup_detector_update_enable+0x60/0x60 Aug 22 08:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 9496.588977] ? __hrtimer_run_queues+0x107/0x230 Aug 22 08:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 9496.590122] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 08:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 9496.591255] ? hrtimer_interrupt+0x101/0x220 Aug 22 08:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 9496.592467] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 08:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 9496.593689] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 08:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 9496.594871] Aug 22 08:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 9496.595792] Aug 22 08:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 9496.596716] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 08:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 9496.597891] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 9496.599102] ? _raw_spin_lock+0x22/0x30 Aug 22 08:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 9496.600300] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 9496.601480] direct_page_fault+0x206/0x310 [kvm] Aug 22 08:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 9496.602695] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 08:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 9496.603877] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 08:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 9496.605100] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 08:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 9496.606477] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 08:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 9496.607567] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 08:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 9496.608730] handle_exit+0x98/0x230 [kvm_amd] Aug 22 08:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 9496.609753] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 08:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 9496.610811] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 08:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 9496.611871] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 08:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 9496.612933] vcpu_run+0x62/0x2c0 [kvm] Aug 22 08:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 9496.613840] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 08:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 9496.614777] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 08:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 9496.615772] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 08:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 9496.616746] ? __seccomp_filter+0x4a/0x4a0 Aug 22 08:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 9496.617632] ? __fget_files+0x86/0xc0 Aug 22 08:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 9496.618443] __x64_sys_ioctl+0x95/0xd0 Aug 22 08:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 9496.619231] do_syscall_64+0x5c/0xc0 Aug 22 08:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 9496.620026] ? do_futex+0x162/0x1f0 Aug 22 08:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 9496.620769] ? __x64_sys_futex+0x78/0x1e0 Aug 22 08:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 9496.621535] ? __secure_computing+0xa9/0x120 Aug 22 08:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 9496.622389] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 08:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 9496.623319] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 9496.624179] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 9496.625005] ? do_syscall_64+0x69/0xc0 Aug 22 08:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 9496.625736] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 9496.626544] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 9496.627345] ? do_syscall_64+0x69/0xc0 Aug 22 08:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 9496.628064] ? do_syscall_64+0x69/0xc0 Aug 22 08:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 9496.628771] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 08:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 9496.629580] RIP: 0033:0x7faa5d0edaff Aug 22 08:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 9496.630332] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 08:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 9496.632711] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 08:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 9496.633798] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 08:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 9496.634909] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 08:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 9496.635963] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 08:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 9496.636992] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 08:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 9496.638024] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 08:02:02 juju-e4d256-prod-github-runner-207 kernel: [ 9496.639076] Aug 22 08:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 9524.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 8762s! [qemu-system-x86:6715] Aug 22 08:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 9524.543077] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 08:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 9524.543149] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 08:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 9524.555199] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 08:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 9524.556472] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 08:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 9524.557688] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 9524.558750] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 08:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 9524.561355] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 08:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 9524.562403] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 08:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 9524.563584] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 08:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 9524.564774] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 08:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 9524.565939] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 08:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 9524.567097] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 08:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 9524.568286] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 08:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 9524.569516] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 08:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 9524.570615] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 08:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 9524.571823] Call Trace: Aug 22 08:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 9524.572733] Aug 22 08:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 9524.573613] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 9524.574645] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 9524.575680] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 9524.576752] ? show_regs.part.0+0x23/0x29 Aug 22 08:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 9524.577764] ? show_regs.cold+0x8/0xd Aug 22 08:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 9524.578736] ? watchdog_timer_fn+0x1be/0x220 Aug 22 08:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 9524.579753] ? lockup_detector_update_enable+0x60/0x60 Aug 22 08:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 9524.580819] ? __hrtimer_run_queues+0x107/0x230 Aug 22 08:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 9524.581848] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 08:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 9524.582869] ? hrtimer_interrupt+0x101/0x220 Aug 22 08:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 9524.583899] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 08:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 9524.584966] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 08:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 9524.586015] Aug 22 08:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 9524.586874] Aug 22 08:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 9524.587724] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 08:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 9524.588756] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 9524.589810] ? _raw_spin_lock+0x22/0x30 Aug 22 08:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 9524.590753] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 9524.591987] direct_page_fault+0x206/0x310 [kvm] Aug 22 08:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 9524.593126] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 08:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 9524.594156] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 08:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 9524.595193] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 08:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 9524.596190] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 08:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 9524.597136] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 08:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 9524.598114] handle_exit+0x98/0x230 [kvm_amd] Aug 22 08:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 9524.599007] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 08:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 9524.599943] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 08:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 9524.600866] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 08:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 9524.601768] vcpu_run+0x62/0x2c0 [kvm] Aug 22 08:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 9524.602584] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 08:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 9524.603390] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 08:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 9524.604263] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 08:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 9524.605061] ? __seccomp_filter+0x4a/0x4a0 Aug 22 08:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 9524.605808] ? __fget_files+0x86/0xc0 Aug 22 08:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 9524.606514] __x64_sys_ioctl+0x95/0xd0 Aug 22 08:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 9524.607206] do_syscall_64+0x5c/0xc0 Aug 22 08:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 9524.607886] ? do_futex+0x162/0x1f0 Aug 22 08:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 9524.608535] ? __x64_sys_futex+0x78/0x1e0 Aug 22 08:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 9524.609214] ? __secure_computing+0xa9/0x120 Aug 22 08:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 9524.609904] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 08:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 9524.610679] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 9524.611532] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 9524.612436] ? do_syscall_64+0x69/0xc0 Aug 22 08:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 9524.613122] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 9524.613928] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 9524.614625] ? do_syscall_64+0x69/0xc0 Aug 22 08:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 9524.615253] ? do_syscall_64+0x69/0xc0 Aug 22 08:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 9524.615902] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 08:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 9524.616610] RIP: 0033:0x7faa5d0edaff Aug 22 08:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 9524.617261] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 08:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 9524.619265] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 08:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 9524.620200] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 08:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 9524.621093] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 08:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 9524.621992] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 08:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 9524.622885] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 08:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 9524.623797] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 08:02:30 juju-e4d256-prod-github-runner-207 kernel: [ 9524.624711] Aug 22 08:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 9537.824706] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 08:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 9537.825664] rcu: 1-....: (2347761 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=1136082 Aug 22 08:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 9537.826813] (t=2355156 jiffies g=23269 q=18279) Aug 22 08:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 9537.827625] NMI backtrace for cpu 1 Aug 22 08:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 9537.828333] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 08:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 9537.829433] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 08:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 9537.830493] Call Trace: Aug 22 08:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 9537.831171] Aug 22 08:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 9537.831837] show_stack+0x52/0x5c Aug 22 08:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 9537.832560] dump_stack_lvl+0x4a/0x63 Aug 22 08:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 9537.833304] dump_stack+0x10/0x16 Aug 22 08:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 9537.834022] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 08:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 9537.834818] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 08:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 9537.835609] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 08:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 9537.836429] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 08:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 9537.837298] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 08:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 9537.838110] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 08:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 9537.838884] print_cpu_stall.cold+0x2f/0xe2 Aug 22 08:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 9537.839657] ? timekeeping_update+0xf7/0x150 Aug 22 08:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 9537.840424] check_cpu_stall+0x109/0x270 Aug 22 08:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 9537.841168] rcu_sched_clock_irq+0x9a/0x250 Aug 22 08:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 9537.841932] update_process_times+0x94/0xd0 Aug 22 08:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 9537.842690] tick_sched_handle+0x29/0x70 Aug 22 08:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 9537.843449] tick_sched_timer+0x8c/0xc0 Aug 22 08:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 9537.844185] ? tick_nohz_handler+0xb0/0xb0 Aug 22 08:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 9537.844942] __hrtimer_run_queues+0x107/0x230 Aug 22 08:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 9537.845711] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 08:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 9537.846485] hrtimer_interrupt+0x101/0x220 Aug 22 08:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 9537.847424] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 08:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 9537.848238] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 08:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 9537.849038] Aug 22 08:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 9537.849672] Aug 22 08:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 9537.850298] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 08:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 9537.851114] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 9537.852001] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 08:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 9537.854212] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 08:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 9537.855087] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 08:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 9537.856093] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 08:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 9537.857070] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 08:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 9537.858032] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 08:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 9537.858984] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 08:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 9537.859947] ? _raw_spin_lock+0x22/0x30 Aug 22 08:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 9537.860704] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 9537.861539] direct_page_fault+0x206/0x310 [kvm] Aug 22 08:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 9537.862380] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 08:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 9537.863212] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 08:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 9537.864063] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 08:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 9537.864871] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 08:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 9537.865654] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 08:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 9537.866479] handle_exit+0x98/0x230 [kvm_amd] Aug 22 08:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 9537.867231] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 08:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 9537.868032] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 08:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 9537.868828] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 08:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 9537.869611] vcpu_run+0x62/0x2c0 [kvm] Aug 22 08:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 9537.870325] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 08:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 9537.871061] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 08:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 9537.871872] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 08:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 9537.872638] ? __seccomp_filter+0x4a/0x4a0 Aug 22 08:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 9537.873361] ? __fget_files+0x86/0xc0 Aug 22 08:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 9537.874058] __x64_sys_ioctl+0x95/0xd0 Aug 22 08:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 9537.874753] do_syscall_64+0x5c/0xc0 Aug 22 08:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 9537.875448] ? do_futex+0x162/0x1f0 Aug 22 08:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 9537.876126] ? __x64_sys_futex+0x78/0x1e0 Aug 22 08:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 9537.876844] ? __secure_computing+0xa9/0x120 Aug 22 08:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 9537.877563] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 08:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 9537.878354] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 9537.879118] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 9537.879890] ? do_syscall_64+0x69/0xc0 Aug 22 08:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 9537.880580] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 9537.881339] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 9537.882102] ? do_syscall_64+0x69/0xc0 Aug 22 08:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 9537.882794] ? do_syscall_64+0x69/0xc0 Aug 22 08:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 9537.883499] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 08:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 9537.884271] RIP: 0033:0x7faa5d0edaff Aug 22 08:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 9537.884960] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 08:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 9537.887065] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 08:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 9537.888046] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 08:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 9537.889018] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 08:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 9537.889965] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 08:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 9537.890911] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 08:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 9537.891857] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 08:02:43 juju-e4d256-prod-github-runner-207 kernel: [ 9537.892773] Aug 22 08:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 9564.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 8799s! [qemu-system-x86:6715] Aug 22 08:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 9564.543249] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 08:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 9564.543324] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 08:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 9564.555948] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 08:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 9564.557394] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 08:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 9564.558657] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 9564.559750] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 08:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 9564.562398] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 08:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 9564.563513] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 08:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 9564.564726] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 08:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 9564.565968] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 08:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 9564.567245] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 08:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 9564.568633] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 08:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 9564.569915] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 08:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 9564.571249] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 08:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 9564.572384] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 08:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 9564.573662] Call Trace: Aug 22 08:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 9564.574619] Aug 22 08:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 9564.575621] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 9564.576697] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 9564.577763] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 9564.579030] ? show_regs.part.0+0x23/0x29 Aug 22 08:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 9564.580341] ? show_regs.cold+0x8/0xd Aug 22 08:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 9564.581366] ? watchdog_timer_fn+0x1be/0x220 Aug 22 08:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 9564.582429] ? lockup_detector_update_enable+0x60/0x60 Aug 22 08:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 9564.583553] ? __hrtimer_run_queues+0x107/0x230 Aug 22 08:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 9564.584616] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 08:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 9564.585664] ? hrtimer_interrupt+0x101/0x220 Aug 22 08:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 9564.586700] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 08:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 9564.587817] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 08:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 9564.589109] Aug 22 08:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 9564.589997] Aug 22 08:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 9564.590851] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 08:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 9564.591925] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 9564.592979] ? _raw_spin_lock+0x22/0x30 Aug 22 08:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 9564.593937] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 9564.595012] direct_page_fault+0x206/0x310 [kvm] Aug 22 08:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 9564.596122] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 08:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 9564.597153] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 08:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 9564.598168] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 08:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 9564.599173] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 08:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 9564.600185] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 08:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 9564.601258] handle_exit+0x98/0x230 [kvm_amd] Aug 22 08:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 9564.602179] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 08:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 9564.603323] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 08:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 9564.604290] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 08:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 9564.605238] vcpu_run+0x62/0x2c0 [kvm] Aug 22 08:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 9564.606128] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 08:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 9564.606969] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 08:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 9564.607871] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 08:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 9564.608687] ? __seccomp_filter+0x4a/0x4a0 Aug 22 08:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 9564.609447] ? __fget_files+0x86/0xc0 Aug 22 08:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 9564.610188] __x64_sys_ioctl+0x95/0xd0 Aug 22 08:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 9564.610904] do_syscall_64+0x5c/0xc0 Aug 22 08:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 9564.611615] ? do_futex+0x162/0x1f0 Aug 22 08:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 9564.612304] ? __x64_sys_futex+0x78/0x1e0 Aug 22 08:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 9564.612995] ? __secure_computing+0xa9/0x120 Aug 22 08:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 9564.613698] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 08:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 9564.614556] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 9564.615466] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 9564.616341] ? do_syscall_64+0x69/0xc0 Aug 22 08:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 9564.617113] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 9564.617995] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 9564.618849] ? do_syscall_64+0x69/0xc0 Aug 22 08:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 9564.619624] ? do_syscall_64+0x69/0xc0 Aug 22 08:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 9564.620286] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 08:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 9564.621006] RIP: 0033:0x7faa5d0edaff Aug 22 08:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 9564.621640] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 08:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 9564.623677] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 08:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 9564.624608] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 08:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 9564.625517] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 08:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 9564.626425] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 08:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 9564.627348] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 08:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 9564.628258] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 08:03:10 juju-e4d256-prod-github-runner-207 kernel: [ 9564.629169] Aug 22 08:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 9592.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 8825s! [qemu-system-x86:6715] Aug 22 08:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 9592.543852] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 08:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 9592.544154] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 08:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 9592.556609] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 08:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 9592.557884] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 08:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 9592.559125] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 9592.560182] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 08:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 9592.562829] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 08:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 9592.563892] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 08:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 9592.565046] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 08:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 9592.566227] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 08:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 9592.567407] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 08:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 9592.568637] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 08:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 9592.569889] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 08:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 9592.571143] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 08:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 9592.572243] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 08:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 9592.573437] Call Trace: Aug 22 08:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 9592.574347] Aug 22 08:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 9592.575270] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 9592.576306] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 9592.577325] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 9592.578427] ? show_regs.part.0+0x23/0x29 Aug 22 08:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 9592.579439] ? show_regs.cold+0x8/0xd Aug 22 08:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 9592.580408] ? watchdog_timer_fn+0x1be/0x220 Aug 22 08:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 9592.581419] ? lockup_detector_update_enable+0x60/0x60 Aug 22 08:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 9592.582484] ? __hrtimer_run_queues+0x107/0x230 Aug 22 08:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 9592.583520] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 08:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 9592.584541] ? hrtimer_interrupt+0x101/0x220 Aug 22 08:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 9592.585552] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 08:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 9592.586615] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 08:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 9592.587671] Aug 22 08:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 9592.588525] Aug 22 08:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 9592.589368] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 08:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 9592.590402] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 9592.591459] ? _raw_spin_lock+0x22/0x30 Aug 22 08:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 9592.592855] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 9592.594154] direct_page_fault+0x206/0x310 [kvm] Aug 22 08:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 9592.595235] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 08:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 9592.596252] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 08:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 9592.597251] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 08:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 9592.598280] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 08:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 9592.599270] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 08:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 9592.600260] handle_exit+0x98/0x230 [kvm_amd] Aug 22 08:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 9592.601155] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 08:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 9592.602075] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 08:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 9592.603016] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 08:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 9592.603931] vcpu_run+0x62/0x2c0 [kvm] Aug 22 08:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 9592.604750] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 08:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 9592.605558] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 08:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 9592.606410] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 08:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 9592.607221] ? __seccomp_filter+0x4a/0x4a0 Aug 22 08:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 9592.607967] ? __fget_files+0x86/0xc0 Aug 22 08:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 9592.608940] __x64_sys_ioctl+0x95/0xd0 Aug 22 08:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 9592.609678] do_syscall_64+0x5c/0xc0 Aug 22 08:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 9592.610349] ? do_futex+0x162/0x1f0 Aug 22 08:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 9592.611017] ? __x64_sys_futex+0x78/0x1e0 Aug 22 08:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 9592.611751] ? __secure_computing+0xa9/0x120 Aug 22 08:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 9592.612611] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 08:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 9592.613390] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 9592.614114] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 9592.614977] ? do_syscall_64+0x69/0xc0 Aug 22 08:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 9592.615704] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 9592.616501] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 9592.617291] ? do_syscall_64+0x69/0xc0 Aug 22 08:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 9592.617989] ? do_syscall_64+0x69/0xc0 Aug 22 08:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 9592.618684] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 08:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 9592.619499] RIP: 0033:0x7faa5d0edaff Aug 22 08:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 9592.620236] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 08:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 9592.622566] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 08:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 9592.623661] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 08:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 9592.624688] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 08:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 9592.625736] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 08:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 9592.626785] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 08:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 9592.627814] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 08:03:38 juju-e4d256-prod-github-runner-207 kernel: [ 9592.628841] Aug 22 08:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 9620.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 8851s! [qemu-system-x86:6715] Aug 22 08:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 9620.543126] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 08:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 9620.543199] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 08:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 9620.555490] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 08:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 9620.556785] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 08:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 9620.558048] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 9620.559166] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 08:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 9620.561882] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 08:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 9620.562956] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 08:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 9620.564137] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 08:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 9620.565317] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 08:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 9620.566501] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 08:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 9620.567698] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 08:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 9620.568896] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 08:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 9620.570200] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 08:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 9620.571332] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 08:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 9620.572691] Call Trace: Aug 22 08:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 9620.573650] Aug 22 08:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 9620.574575] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 9620.575615] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 9620.576637] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 9620.577719] ? show_regs.part.0+0x23/0x29 Aug 22 08:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 9620.578742] ? show_regs.cold+0x8/0xd Aug 22 08:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 9620.579720] ? watchdog_timer_fn+0x1be/0x220 Aug 22 08:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 9620.580736] ? lockup_detector_update_enable+0x60/0x60 Aug 22 08:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 9620.581801] ? __hrtimer_run_queues+0x107/0x230 Aug 22 08:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 9620.582850] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 08:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 9620.583885] ? hrtimer_interrupt+0x101/0x220 Aug 22 08:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 9620.584908] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 08:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 9620.586138] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 08:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 9620.587223] Aug 22 08:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 9620.588079] Aug 22 08:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 9620.589091] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 08:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 9620.590132] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 9620.591290] ? _raw_spin_lock+0x22/0x30 Aug 22 08:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 9620.592238] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 9620.593261] direct_page_fault+0x206/0x310 [kvm] Aug 22 08:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 9620.594293] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 08:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 9620.595334] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 08:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 9620.596339] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 08:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 9620.597315] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 08:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 9620.598262] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 08:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 9620.599275] handle_exit+0x98/0x230 [kvm_amd] Aug 22 08:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 9620.600171] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 08:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 9620.601094] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 08:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 9620.602035] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 08:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 9620.602978] vcpu_run+0x62/0x2c0 [kvm] Aug 22 08:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 9620.603794] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 08:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 9620.604600] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 08:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 9620.605458] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 08:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 9620.606259] ? __seccomp_filter+0x4a/0x4a0 Aug 22 08:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 9620.607025] ? __fget_files+0x86/0xc0 Aug 22 08:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 9620.607729] __x64_sys_ioctl+0x95/0xd0 Aug 22 08:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 9620.608424] do_syscall_64+0x5c/0xc0 Aug 22 08:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 9620.609089] ? do_futex+0x162/0x1f0 Aug 22 08:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 9620.609742] ? __x64_sys_futex+0x78/0x1e0 Aug 22 08:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 9620.610432] ? __secure_computing+0xa9/0x120 Aug 22 08:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 9620.611121] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 08:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 9620.611880] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 9620.612616] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 9620.613334] ? do_syscall_64+0x69/0xc0 Aug 22 08:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 9620.613983] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 9620.614710] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 9620.615435] ? do_syscall_64+0x69/0xc0 Aug 22 08:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 9620.616069] ? do_syscall_64+0x69/0xc0 Aug 22 08:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 9620.616697] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 08:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 9620.617402] RIP: 0033:0x7faa5d0edaff Aug 22 08:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 9620.618166] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 08:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 9620.621287] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 08:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 9620.622205] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 08:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 9620.623132] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 08:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 9620.624017] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 08:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 9620.624901] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 08:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 9620.625796] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 08:04:06 juju-e4d256-prod-github-runner-207 kernel: [ 9620.626709] Aug 22 08:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 9648.541976] watchdog: BUG: soft lockup - CPU#1 stuck for 8877s! [qemu-system-x86:6715] Aug 22 08:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 9648.543100] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 08:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 9648.543168] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 08:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 9648.555553] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 08:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 9648.556843] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 08:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 9648.558105] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 9648.559178] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 08:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 9648.561769] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 08:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 9648.562852] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 08:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 9648.564035] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 08:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 9648.565226] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 08:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 9648.566438] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 08:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 9648.567618] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 08:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 9648.568807] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 08:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 9648.570084] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 08:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 9648.571359] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 08:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 9648.572792] Call Trace: Aug 22 08:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 9648.574003] Aug 22 08:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 9648.574945] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 9648.575988] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 9648.577018] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 9648.578135] ? show_regs.part.0+0x23/0x29 Aug 22 08:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 9648.579140] ? show_regs.cold+0x8/0xd Aug 22 08:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 9648.580125] ? watchdog_timer_fn+0x1be/0x220 Aug 22 08:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 9648.581142] ? lockup_detector_update_enable+0x60/0x60 Aug 22 08:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 9648.582266] ? __hrtimer_run_queues+0x107/0x230 Aug 22 08:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 9648.583315] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 08:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 9648.584357] ? hrtimer_interrupt+0x101/0x220 Aug 22 08:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 9648.585389] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 08:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 9648.586498] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 08:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 9648.587558] Aug 22 08:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 9648.588421] Aug 22 08:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 9648.589266] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 08:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 9648.590348] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 9648.591408] ? _raw_spin_lock+0x22/0x30 Aug 22 08:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 9648.592363] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 9648.593387] direct_page_fault+0x206/0x310 [kvm] Aug 22 08:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 9648.594428] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 08:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 9648.595443] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 08:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 9648.596449] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 08:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 9648.597420] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 08:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 9648.598384] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 08:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 9648.599363] handle_exit+0x98/0x230 [kvm_amd] Aug 22 08:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 9648.600255] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 08:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 9648.601205] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 08:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 9648.602152] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 08:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 9648.603168] vcpu_run+0x62/0x2c0 [kvm] Aug 22 08:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 9648.603978] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 08:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 9648.604783] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 08:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 9648.605635] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 08:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 9648.606456] ? __seccomp_filter+0x4a/0x4a0 Aug 22 08:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 9648.607199] ? __fget_files+0x86/0xc0 Aug 22 08:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 9648.607958] __x64_sys_ioctl+0x95/0xd0 Aug 22 08:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 9648.608650] do_syscall_64+0x5c/0xc0 Aug 22 08:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 9648.609314] ? do_futex+0x162/0x1f0 Aug 22 08:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 9648.609962] ? __x64_sys_futex+0x78/0x1e0 Aug 22 08:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 9648.610650] ? __secure_computing+0xa9/0x120 Aug 22 08:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 9648.611361] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 08:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 9648.612148] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 9648.612870] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 9648.613620] ? do_syscall_64+0x69/0xc0 Aug 22 08:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 9648.614282] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 9648.614983] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 9648.615705] ? do_syscall_64+0x69/0xc0 Aug 22 08:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 9648.616330] ? do_syscall_64+0x69/0xc0 Aug 22 08:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 9648.616949] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 08:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 9648.617663] RIP: 0033:0x7faa5d0edaff Aug 22 08:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 9648.618312] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 08:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 9648.620294] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 08:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 9648.621204] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 08:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 9648.622292] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 08:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 9648.623351] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 08:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 9648.624239] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 08:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 9648.625132] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 08:04:34 juju-e4d256-prod-github-runner-207 kernel: [ 9648.626042] Aug 22 08:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 9676.541981] watchdog: BUG: soft lockup - CPU#1 stuck for 8903s! [qemu-system-x86:6715] Aug 22 08:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 9676.543193] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 08:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 9676.543465] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 08:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 9676.555819] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 08:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 9676.557616] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 08:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 9676.559300] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 9676.560421] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 08:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 9676.563045] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 08:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 9676.564130] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 08:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 9676.565342] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 08:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 9676.566523] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 08:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 9676.567738] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 08:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 9676.568942] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 08:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 9676.570358] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 08:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 9676.571772] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 08:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 9676.573028] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 08:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 9676.574387] Call Trace: Aug 22 08:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 9676.575354] Aug 22 08:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 9676.576288] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 9676.577416] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 9676.578546] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 9676.579710] ? show_regs.part.0+0x23/0x29 Aug 22 08:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 9676.580798] ? show_regs.cold+0x8/0xd Aug 22 08:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 9676.581872] ? watchdog_timer_fn+0x1be/0x220 Aug 22 08:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 9676.582966] ? lockup_detector_update_enable+0x60/0x60 Aug 22 08:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 9676.584125] ? __hrtimer_run_queues+0x107/0x230 Aug 22 08:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 9676.585255] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 08:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 9676.586390] ? hrtimer_interrupt+0x101/0x220 Aug 22 08:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 9676.587492] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 08:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 9676.588668] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 08:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 9676.589839] Aug 22 08:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 9676.590737] Aug 22 08:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 9676.591618] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 08:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 9676.592775] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 9676.593955] ? _raw_spin_lock+0x22/0x30 Aug 22 08:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 9676.594996] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 9676.596118] direct_page_fault+0x206/0x310 [kvm] Aug 22 08:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 9676.597242] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 08:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 9676.598360] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 08:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 9676.599453] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 08:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 9676.600515] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 08:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 9676.601551] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 08:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 9676.602653] handle_exit+0x98/0x230 [kvm_amd] Aug 22 08:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 9676.603634] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 08:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 9676.604639] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 08:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 9676.605690] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 08:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 9676.606736] vcpu_run+0x62/0x2c0 [kvm] Aug 22 08:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 9676.607619] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 08:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 9676.608520] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 08:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 9676.609478] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 08:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 9676.610385] ? __seccomp_filter+0x4a/0x4a0 Aug 22 08:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 9676.611250] ? __fget_files+0x86/0xc0 Aug 22 08:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 9676.612025] __x64_sys_ioctl+0x95/0xd0 Aug 22 08:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 9676.612795] do_syscall_64+0x5c/0xc0 Aug 22 08:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 9676.613531] ? do_futex+0x162/0x1f0 Aug 22 08:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 9676.614276] ? __x64_sys_futex+0x78/0x1e0 Aug 22 08:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 9676.615026] ? __secure_computing+0xa9/0x120 Aug 22 08:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 9676.615797] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 08:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 9676.616658] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 9676.617480] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 9676.618310] ? do_syscall_64+0x69/0xc0 Aug 22 08:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 9676.619042] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 9676.619837] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 9676.620628] ? do_syscall_64+0x69/0xc0 Aug 22 08:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 9676.621331] ? do_syscall_64+0x69/0xc0 Aug 22 08:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 9676.622039] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 08:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 9676.622841] RIP: 0033:0x7faa5d0edaff Aug 22 08:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 9676.623537] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 08:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 9676.625887] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 08:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 9676.626935] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 08:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 9676.627957] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 08:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 9676.628976] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 08:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 9676.630020] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 08:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 9676.631044] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 08:05:02 juju-e4d256-prod-github-runner-207 kernel: [ 9676.632069] Aug 22 08:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 9704.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 8930s! [qemu-system-x86:6715] Aug 22 08:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 9704.543826] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 08:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 9704.544124] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 08:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 9704.556381] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 08:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 9704.557676] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 08:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 9704.558898] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 9704.559983] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 08:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 9704.562568] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 08:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 9704.563627] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 08:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 9704.564793] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 08:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 9704.565975] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 08:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 9704.567201] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 08:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 9704.568361] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 08:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 9704.569785] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 08:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 9704.571421] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 08:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 9704.572892] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 08:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 9704.574149] Call Trace: Aug 22 08:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 9704.575227] Aug 22 08:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 9704.576168] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 9704.577228] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 9704.578303] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 9704.579416] ? show_regs.part.0+0x23/0x29 Aug 22 08:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 9704.580413] ? show_regs.cold+0x8/0xd Aug 22 08:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 9704.581419] ? watchdog_timer_fn+0x1be/0x220 Aug 22 08:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 9704.582434] ? lockup_detector_update_enable+0x60/0x60 Aug 22 08:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 9704.583496] ? __hrtimer_run_queues+0x107/0x230 Aug 22 08:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 9704.584542] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 08:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 9704.585586] ? hrtimer_interrupt+0x101/0x220 Aug 22 08:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 9704.586607] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 08:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 9704.587688] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 08:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 9704.588968] Aug 22 08:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 9704.589842] Aug 22 08:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 9704.590722] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 08:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 9704.591773] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 9704.592856] ? _raw_spin_lock+0x22/0x30 Aug 22 08:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 9704.593863] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 9704.594984] direct_page_fault+0x206/0x310 [kvm] Aug 22 08:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 9704.596454] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 08:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 9704.597761] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 08:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 9704.598860] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 08:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 9704.599883] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 08:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 9704.601077] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 08:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 9704.602279] handle_exit+0x98/0x230 [kvm_amd] Aug 22 08:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 9704.603199] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 08:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 9704.604120] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 08:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 9704.605049] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 08:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 9704.605988] vcpu_run+0x62/0x2c0 [kvm] Aug 22 08:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 9704.606806] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 08:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 9704.607629] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 08:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 9704.608495] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 08:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 9704.609308] ? __seccomp_filter+0x4a/0x4a0 Aug 22 08:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 9704.610069] ? __fget_files+0x86/0xc0 Aug 22 08:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 9704.610780] __x64_sys_ioctl+0x95/0xd0 Aug 22 08:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 9704.611475] do_syscall_64+0x5c/0xc0 Aug 22 08:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 9704.612142] ? do_futex+0x162/0x1f0 Aug 22 08:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 9704.612804] ? __x64_sys_futex+0x78/0x1e0 Aug 22 08:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 9704.613499] ? __secure_computing+0xa9/0x120 Aug 22 08:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 9704.614197] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 08:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 9704.614958] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 9704.615682] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 9704.616403] ? do_syscall_64+0x69/0xc0 Aug 22 08:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 9704.617051] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 9704.617791] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 9704.618530] ? do_syscall_64+0x69/0xc0 Aug 22 08:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 9704.619156] ? do_syscall_64+0x69/0xc0 Aug 22 08:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 9704.619780] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 08:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 9704.620484] RIP: 0033:0x7faa5d0edaff Aug 22 08:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 9704.621143] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 08:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 9704.623146] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 08:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 9704.624058] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 08:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 9704.624978] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 08:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 9704.625885] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 08:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 9704.626779] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 08:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 9704.627669] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 08:05:30 juju-e4d256-prod-github-runner-207 kernel: [ 9704.628562] Aug 22 08:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 9717.836712] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 08:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 9717.837700] rcu: 1-....: (2392623 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=1157504 Aug 22 08:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 9717.838894] (t=2400159 jiffies g=23269 q=18427) Aug 22 08:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 9717.839746] NMI backtrace for cpu 1 Aug 22 08:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 9717.840558] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 08:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 9717.841757] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 08:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 9717.842937] Call Trace: Aug 22 08:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 9717.843614] Aug 22 08:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 9717.844274] show_stack+0x52/0x5c Aug 22 08:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 9717.845001] dump_stack_lvl+0x4a/0x63 Aug 22 08:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 9717.845766] dump_stack+0x10/0x16 Aug 22 08:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 9717.846545] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 08:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 9717.847340] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 08:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 9717.848113] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 08:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 9717.848927] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 08:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 9717.849793] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 08:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 9717.850661] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 08:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 9717.851446] print_cpu_stall.cold+0x2f/0xe2 Aug 22 08:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 9717.852224] ? timekeeping_update+0xf7/0x150 Aug 22 08:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 9717.853017] check_cpu_stall+0x109/0x270 Aug 22 08:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 9717.853784] rcu_sched_clock_irq+0x9a/0x250 Aug 22 08:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 9717.854586] update_process_times+0x94/0xd0 Aug 22 08:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 9717.855356] tick_sched_handle+0x29/0x70 Aug 22 08:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 9717.856110] tick_sched_timer+0x8c/0xc0 Aug 22 08:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 9717.856845] ? tick_nohz_handler+0xb0/0xb0 Aug 22 08:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 9717.857613] __hrtimer_run_queues+0x107/0x230 Aug 22 08:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 9717.858400] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 08:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 9717.859266] hrtimer_interrupt+0x101/0x220 Aug 22 08:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 9717.860052] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 08:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 9717.860914] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 08:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 9717.861745] Aug 22 08:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 9717.862396] Aug 22 08:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 9717.863040] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 08:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 9717.863882] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 9717.864775] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 08:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 9717.867024] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 08:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 9717.867903] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 08:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 9717.868890] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 08:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 9717.869882] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 08:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 9717.870873] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 08:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 9717.871888] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 08:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 9717.872854] ? _raw_spin_lock+0x22/0x30 Aug 22 08:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 9717.873673] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 9717.874511] direct_page_fault+0x206/0x310 [kvm] Aug 22 08:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 9717.875363] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 08:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 9717.876213] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 08:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 9717.877041] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 08:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 9717.877881] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 08:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 9717.878669] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 08:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 9717.879491] handle_exit+0x98/0x230 [kvm_amd] Aug 22 08:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 9717.880253] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 08:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 9717.881065] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 08:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 9717.881956] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 08:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 9717.882751] vcpu_run+0x62/0x2c0 [kvm] Aug 22 08:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 9717.883465] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 08:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 9717.884196] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 08:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 9717.885001] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 08:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 9717.885816] ? __seccomp_filter+0x4a/0x4a0 Aug 22 08:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 9717.886551] ? __fget_files+0x86/0xc0 Aug 22 08:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 9717.887245] __x64_sys_ioctl+0x95/0xd0 Aug 22 08:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 9717.887939] do_syscall_64+0x5c/0xc0 Aug 22 08:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 9717.888620] ? do_futex+0x162/0x1f0 Aug 22 08:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 9717.889314] ? __x64_sys_futex+0x78/0x1e0 Aug 22 08:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 9717.890130] ? __secure_computing+0xa9/0x120 Aug 22 08:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 9717.890866] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 08:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 9717.891690] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 9717.892455] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 9717.893233] ? do_syscall_64+0x69/0xc0 Aug 22 08:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 9717.893922] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 9717.894675] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 9717.895430] ? do_syscall_64+0x69/0xc0 Aug 22 08:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 9717.896136] ? do_syscall_64+0x69/0xc0 Aug 22 08:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 9717.896840] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 08:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 9717.897686] RIP: 0033:0x7faa5d0edaff Aug 22 08:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 9717.898371] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 08:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 9717.900526] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 08:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 9717.901518] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 08:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 9717.902561] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 08:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 9717.903654] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 08:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 9717.904674] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 08:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 9717.905628] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 08:05:43 juju-e4d256-prod-github-runner-207 kernel: [ 9717.906545] Aug 22 08:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 9744.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 8967s! [qemu-system-x86:6715] Aug 22 08:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 9744.543128] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 08:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 9744.543204] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 08:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 9744.555617] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 08:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 9744.556927] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 08:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 9744.558182] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 9744.559245] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 08:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 9744.561852] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 08:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 9744.562901] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 08:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 9744.564075] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 08:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 9744.565257] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 08:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 9744.566427] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 08:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 9744.567601] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 08:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 9744.568789] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 08:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 9744.570047] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 08:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 9744.571156] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 08:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 9744.572370] Call Trace: Aug 22 08:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 9744.573300] Aug 22 08:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 9744.574186] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 9744.575223] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 9744.576255] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 9744.577355] ? show_regs.part.0+0x23/0x29 Aug 22 08:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 9744.578366] ? show_regs.cold+0x8/0xd Aug 22 08:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 9744.579346] ? watchdog_timer_fn+0x1be/0x220 Aug 22 08:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 9744.580365] ? lockup_detector_update_enable+0x60/0x60 Aug 22 08:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 9744.581457] ? __hrtimer_run_queues+0x107/0x230 Aug 22 08:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 9744.582494] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 08:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 9744.583521] ? hrtimer_interrupt+0x101/0x220 Aug 22 08:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 9744.584542] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 08:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 9744.585655] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 08:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 9744.586709] Aug 22 08:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 9744.587564] Aug 22 08:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 9744.588402] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 08:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 9744.589460] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 9744.590507] ? _raw_spin_lock+0x22/0x30 Aug 22 08:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 9744.591462] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 9744.592489] direct_page_fault+0x206/0x310 [kvm] Aug 22 08:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 9744.593535] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 08:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 9744.594549] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 08:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 9744.595559] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 08:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 9744.596541] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 08:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 9744.597508] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 08:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 9744.598496] handle_exit+0x98/0x230 [kvm_amd] Aug 22 08:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 9744.599403] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 08:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 9744.600323] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 08:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 9744.601280] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 08:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 9744.602195] vcpu_run+0x62/0x2c0 [kvm] Aug 22 08:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 9744.603013] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 08:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 9744.603829] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 08:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 9744.604690] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 08:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 9744.605505] ? __seccomp_filter+0x4a/0x4a0 Aug 22 08:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 9744.606260] ? __fget_files+0x86/0xc0 Aug 22 08:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 9744.606979] __x64_sys_ioctl+0x95/0xd0 Aug 22 08:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 9744.607687] do_syscall_64+0x5c/0xc0 Aug 22 08:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 9744.608366] ? do_futex+0x162/0x1f0 Aug 22 08:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 9744.609030] ? __x64_sys_futex+0x78/0x1e0 Aug 22 08:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 9744.609729] ? __secure_computing+0xa9/0x120 Aug 22 08:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 9744.610429] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 08:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 9744.611205] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 9744.612071] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 9744.612801] ? do_syscall_64+0x69/0xc0 Aug 22 08:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 9744.613651] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 9744.614361] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 9744.615062] ? do_syscall_64+0x69/0xc0 Aug 22 08:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 9744.615734] ? do_syscall_64+0x69/0xc0 Aug 22 08:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 9744.616389] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 08:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 9744.617115] RIP: 0033:0x7faa5d0edaff Aug 22 08:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 9744.617749] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 08:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 9744.619780] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 08:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 9744.620703] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 08:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 9744.621619] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 08:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 9744.622555] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 08:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 9744.623461] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 08:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 9744.624362] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 08:06:10 juju-e4d256-prod-github-runner-207 kernel: [ 9744.625292] Aug 22 08:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 9772.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 8993s! [qemu-system-x86:6715] Aug 22 08:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 9772.543175] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 08:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 9772.543336] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 08:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 9772.556083] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 08:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 9772.557474] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 08:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 9772.558785] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 9772.559951] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 08:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 9772.562629] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 08:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 9772.563694] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 08:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 9772.564913] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 08:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 9772.566095] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 08:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 9772.567289] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 08:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 9772.568472] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 08:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 9772.569667] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 08:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 9772.570928] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 08:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 9772.572038] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 08:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 9772.573278] Call Trace: Aug 22 08:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 9772.574200] Aug 22 08:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 9772.575121] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 9772.576174] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 9772.577240] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 9772.578360] ? show_regs.part.0+0x23/0x29 Aug 22 08:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 9772.579367] ? show_regs.cold+0x8/0xd Aug 22 08:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 9772.580357] ? watchdog_timer_fn+0x1be/0x220 Aug 22 08:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 9772.581406] ? lockup_detector_update_enable+0x60/0x60 Aug 22 08:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 9772.582493] ? __hrtimer_run_queues+0x107/0x230 Aug 22 08:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 9772.583533] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 08:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 9772.584726] ? hrtimer_interrupt+0x101/0x220 Aug 22 08:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 9772.585932] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 08:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 9772.587018] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 08:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 9772.588091] Aug 22 08:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 9772.588961] Aug 22 08:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 9772.589808] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 08:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 9772.590860] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 9772.591935] ? _raw_spin_lock+0x22/0x30 Aug 22 08:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 9772.592911] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 9772.593945] direct_page_fault+0x206/0x310 [kvm] Aug 22 08:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 9772.594994] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 08:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 9772.596031] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 08:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 9772.597077] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 08:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 9772.598081] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 08:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 9772.599041] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 08:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 9772.600038] handle_exit+0x98/0x230 [kvm_amd] Aug 22 08:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 9772.600966] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 08:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 9772.601895] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 08:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 9772.602838] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 08:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 9772.603791] vcpu_run+0x62/0x2c0 [kvm] Aug 22 08:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 9772.604665] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 08:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 9772.605517] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 08:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 9772.606394] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 08:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 9772.607208] ? __seccomp_filter+0x4a/0x4a0 Aug 22 08:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 9772.607992] ? __fget_files+0x86/0xc0 Aug 22 08:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 9772.608758] __x64_sys_ioctl+0x95/0xd0 Aug 22 08:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 9772.609476] do_syscall_64+0x5c/0xc0 Aug 22 08:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 9772.610163] ? do_futex+0x162/0x1f0 Aug 22 08:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 9772.610846] ? __x64_sys_futex+0x78/0x1e0 Aug 22 08:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 9772.611550] ? __secure_computing+0xa9/0x120 Aug 22 08:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 9772.612266] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 08:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 9772.613079] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 9772.613816] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 9772.614548] ? do_syscall_64+0x69/0xc0 Aug 22 08:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 9772.615212] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 9772.615964] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 9772.616713] ? do_syscall_64+0x69/0xc0 Aug 22 08:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 9772.617356] ? do_syscall_64+0x69/0xc0 Aug 22 08:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 9772.617991] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 08:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 9772.618708] RIP: 0033:0x7faa5d0edaff Aug 22 08:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 9772.619345] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 08:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 9772.621419] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 08:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 9772.622377] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 08:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 9772.623303] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 08:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 9772.624222] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 08:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 9772.625153] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 08:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 9772.626059] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 08:06:38 juju-e4d256-prod-github-runner-207 kernel: [ 9772.627032] Aug 22 08:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 9800.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 9019s! [qemu-system-x86:6715] Aug 22 08:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 9800.543823] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 08:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 9800.544097] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 08:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 9800.559427] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 08:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 9800.560746] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 08:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 9800.562003] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 9800.563078] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 08:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 9800.566120] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 08:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 9800.567472] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 08:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 9800.568790] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 08:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 9800.570046] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 08:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 9800.571268] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 08:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 9800.572546] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 08:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 9800.573790] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 08:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 9800.575047] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 08:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 9800.576189] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 08:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 9800.577432] Call Trace: Aug 22 08:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 9800.578347] Aug 22 08:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 9800.579275] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 9800.580341] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 9800.581381] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 9800.582487] ? show_regs.part.0+0x23/0x29 Aug 22 08:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 9800.583528] ? show_regs.cold+0x8/0xd Aug 22 08:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 9800.584571] ? watchdog_timer_fn+0x1be/0x220 Aug 22 08:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 9800.585618] ? lockup_detector_update_enable+0x60/0x60 Aug 22 08:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 9800.586750] ? __hrtimer_run_queues+0x107/0x230 Aug 22 08:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 9800.587811] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 08:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 9800.588887] ? hrtimer_interrupt+0x101/0x220 Aug 22 08:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 9800.589919] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 08:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 9800.591020] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 08:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 9800.592073] Aug 22 08:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 9800.592949] Aug 22 08:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 9800.593817] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 08:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 9800.594875] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 9800.595923] ? _raw_spin_lock+0x22/0x30 Aug 22 08:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 9800.596986] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 9800.598050] direct_page_fault+0x206/0x310 [kvm] Aug 22 08:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 9800.599132] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 08:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 9800.600215] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 08:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 9800.601266] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 08:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 9800.602291] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 08:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 9800.603265] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 08:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 9800.604292] handle_exit+0x98/0x230 [kvm_amd] Aug 22 08:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 9800.605205] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 08:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 9800.606181] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 08:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 9800.607118] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 08:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 9800.608024] vcpu_run+0x62/0x2c0 [kvm] Aug 22 08:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 9800.608878] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 08:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 9800.609694] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 08:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 9800.610563] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 08:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 9800.611412] ? __seccomp_filter+0x4a/0x4a0 Aug 22 08:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 9800.612181] ? __fget_files+0x86/0xc0 Aug 22 08:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 9800.612900] __x64_sys_ioctl+0x95/0xd0 Aug 22 08:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 9800.613629] do_syscall_64+0x5c/0xc0 Aug 22 08:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 9800.614306] ? do_futex+0x162/0x1f0 Aug 22 08:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 9800.614959] ? __x64_sys_futex+0x78/0x1e0 Aug 22 08:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 9800.615647] ? __secure_computing+0xa9/0x120 Aug 22 08:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 9800.616385] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 08:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 9800.617154] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 9800.617903] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 9800.618639] ? do_syscall_64+0x69/0xc0 Aug 22 08:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 9800.619318] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 9800.620046] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 9800.620790] ? do_syscall_64+0x69/0xc0 Aug 22 08:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 9800.621461] ? do_syscall_64+0x69/0xc0 Aug 22 08:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 9800.622092] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 08:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 9800.622827] RIP: 0033:0x7faa5d0edaff Aug 22 08:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 9800.623502] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 08:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 9800.625578] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 08:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 9800.626541] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 08:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 9800.627454] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 08:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 9800.628483] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 08:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 9800.629399] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 08:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 9800.630332] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 08:07:06 juju-e4d256-prod-github-runner-207 kernel: [ 9800.631264] Aug 22 08:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 9828.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 9045s! [qemu-system-x86:6715] Aug 22 08:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 9828.543104] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 08:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 9828.543180] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 08:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 9828.555470] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 08:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 9828.556769] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 08:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 9828.558009] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 9828.559088] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 08:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 9828.561687] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 08:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 9828.562743] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 08:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 9828.563935] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 08:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 9828.565110] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 08:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 9828.566290] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 08:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 9828.567477] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 08:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 9828.568673] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 08:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 9828.569929] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 08:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 9828.571040] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 08:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 9828.572273] Call Trace: Aug 22 08:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 9828.573203] Aug 22 08:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 9828.574094] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 9828.575144] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 9828.576183] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 9828.577263] ? show_regs.part.0+0x23/0x29 Aug 22 08:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 9828.578267] ? show_regs.cold+0x8/0xd Aug 22 08:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 9828.579251] ? watchdog_timer_fn+0x1be/0x220 Aug 22 08:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 9828.580284] ? lockup_detector_update_enable+0x60/0x60 Aug 22 08:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 9828.581370] ? __hrtimer_run_queues+0x107/0x230 Aug 22 08:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 9828.582404] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 08:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 9828.583438] ? hrtimer_interrupt+0x101/0x220 Aug 22 08:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 9828.584473] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 08:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 9828.585551] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 08:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 9828.586608] Aug 22 08:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 9828.587466] Aug 22 08:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 9828.588326] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 08:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 9828.589375] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 9828.590423] ? _raw_spin_lock+0x22/0x30 Aug 22 08:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 9828.591385] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 9828.592453] direct_page_fault+0x206/0x310 [kvm] Aug 22 08:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 9828.593540] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 08:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 9828.594558] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 08:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 9828.595578] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 08:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 9828.596579] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 08:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 9828.597535] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 08:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 9828.598523] handle_exit+0x98/0x230 [kvm_amd] Aug 22 08:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 9828.599423] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 08:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 9828.600364] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 08:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 9828.601301] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 08:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 9828.602214] vcpu_run+0x62/0x2c0 [kvm] Aug 22 08:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 9828.603043] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 08:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 9828.603873] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 08:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 9828.604741] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 08:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 9828.605547] ? __seccomp_filter+0x4a/0x4a0 Aug 22 08:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 9828.606297] ? __fget_files+0x86/0xc0 Aug 22 08:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 9828.607014] __x64_sys_ioctl+0x95/0xd0 Aug 22 08:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 9828.607736] do_syscall_64+0x5c/0xc0 Aug 22 08:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 9828.608436] ? do_futex+0x162/0x1f0 Aug 22 08:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 9828.609097] ? __x64_sys_futex+0x78/0x1e0 Aug 22 08:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 9828.609937] ? __secure_computing+0xa9/0x120 Aug 22 08:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 9828.610693] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 08:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 9828.611482] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 9828.612234] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 9828.613083] ? do_syscall_64+0x69/0xc0 Aug 22 08:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 9828.613736] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 9828.614448] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 9828.615187] ? do_syscall_64+0x69/0xc0 Aug 22 08:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 9828.615845] ? do_syscall_64+0x69/0xc0 Aug 22 08:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 9828.616477] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 08:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 9828.617194] RIP: 0033:0x7faa5d0edaff Aug 22 08:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 9828.617831] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 08:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 9828.619890] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 08:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 9828.620813] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 08:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 9828.621721] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 08:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 9828.622634] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 08:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 9828.623564] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 08:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 9828.624490] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 08:07:34 juju-e4d256-prod-github-runner-207 kernel: [ 9828.625399] Aug 22 08:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 9856.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 9071s! [qemu-system-x86:6715] Aug 22 08:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 9856.543121] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 08:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 9856.543199] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 08:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 9856.556030] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 08:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 9856.557348] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 08:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 9856.558576] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 9856.559671] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 08:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 9856.562233] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 08:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 9856.563285] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 08:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 9856.564468] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 08:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 9856.565629] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 08:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 9856.566791] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 08:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 9856.567985] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 08:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 9856.569156] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 08:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 9856.570389] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 08:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 9856.571510] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 08:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 9856.572706] Call Trace: Aug 22 08:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 9856.573618] Aug 22 08:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 9856.574500] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 9856.575551] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 9856.576644] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 9856.577726] ? show_regs.part.0+0x23/0x29 Aug 22 08:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 9856.578750] ? show_regs.cold+0x8/0xd Aug 22 08:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 9856.579772] ? watchdog_timer_fn+0x1be/0x220 Aug 22 08:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 9856.580788] ? lockup_detector_update_enable+0x60/0x60 Aug 22 08:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 9856.581855] ? __hrtimer_run_queues+0x107/0x230 Aug 22 08:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 9856.582896] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 08:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 9856.583936] ? hrtimer_interrupt+0x101/0x220 Aug 22 08:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 9856.584950] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 08:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 9856.586016] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 08:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 9856.587064] Aug 22 08:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 9856.587938] Aug 22 08:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 9856.588789] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 08:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 9856.589824] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 9856.590866] ? _raw_spin_lock+0x22/0x30 Aug 22 08:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 9856.591821] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 9856.592853] direct_page_fault+0x206/0x310 [kvm] Aug 22 08:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 9856.593925] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 08:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 9856.595003] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 08:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 9856.596016] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 08:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 9856.597015] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 08:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 9856.597967] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 08:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 9856.598954] handle_exit+0x98/0x230 [kvm_amd] Aug 22 08:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 9856.599860] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 08:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 9856.600783] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 08:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 9856.601707] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 08:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 9856.602611] vcpu_run+0x62/0x2c0 [kvm] Aug 22 08:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 9856.603430] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 08:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 9856.604252] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 08:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 9856.605113] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 08:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 9856.605931] ? __seccomp_filter+0x4a/0x4a0 Aug 22 08:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 9856.606691] ? __fget_files+0x86/0xc0 Aug 22 08:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 9856.607416] __x64_sys_ioctl+0x95/0xd0 Aug 22 08:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 9856.608137] do_syscall_64+0x5c/0xc0 Aug 22 08:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 9856.608811] ? do_futex+0x162/0x1f0 Aug 22 08:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 9856.609472] ? __x64_sys_futex+0x78/0x1e0 Aug 22 08:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 9856.610184] ? __secure_computing+0xa9/0x120 Aug 22 08:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 9856.610882] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 08:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 9856.611669] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 9856.612430] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 9856.613164] ? do_syscall_64+0x69/0xc0 Aug 22 08:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 9856.613816] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 9856.614574] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 9856.615278] ? do_syscall_64+0x69/0xc0 Aug 22 08:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 9856.615925] ? do_syscall_64+0x69/0xc0 Aug 22 08:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 9856.616551] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 08:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 9856.617295] RIP: 0033:0x7faa5d0edaff Aug 22 08:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 9856.617925] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 08:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 9856.620010] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 08:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 9856.620937] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 08:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 9856.621846] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 08:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 9856.622732] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 08:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 9856.623637] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 08:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 9856.624533] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 08:08:02 juju-e4d256-prod-github-runner-207 kernel: [ 9856.625429] Aug 22 08:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 9884.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 9097s! [qemu-system-x86:6715] Aug 22 08:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 9884.543829] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 08:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 9884.544117] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 08:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 9884.557072] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 08:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 9884.558355] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 08:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 9884.559599] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 9884.560657] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 08:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 9884.563218] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 08:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 9884.564258] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 08:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 9884.565419] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 08:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 9884.566638] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 08:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 9884.567867] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 08:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 9884.569046] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 08:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 9884.570223] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 08:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 9884.571481] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 08:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 9884.572661] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 08:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 9884.574033] Call Trace: Aug 22 08:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 9884.575012] Aug 22 08:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 9884.576095] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 9884.577274] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 9884.578411] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 9884.579629] ? show_regs.part.0+0x23/0x29 Aug 22 08:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 9884.580718] ? show_regs.cold+0x8/0xd Aug 22 08:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 9884.581815] ? watchdog_timer_fn+0x1be/0x220 Aug 22 08:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 9884.582957] ? lockup_detector_update_enable+0x60/0x60 Aug 22 08:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 9884.584141] ? __hrtimer_run_queues+0x107/0x230 Aug 22 08:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 9884.585298] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 08:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 9884.586416] ? hrtimer_interrupt+0x101/0x220 Aug 22 08:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 9884.587542] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 08:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 9884.588813] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 08:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 9884.589969] Aug 22 08:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 9884.590875] Aug 22 08:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 9884.591774] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 08:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 9884.592917] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 9884.594107] ? _raw_spin_lock+0x22/0x30 Aug 22 08:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 9884.595212] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 9884.596334] direct_page_fault+0x206/0x310 [kvm] Aug 22 08:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 9884.597529] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 08:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 9884.598644] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 08:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 9884.599787] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 08:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 9884.600920] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 08:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 9884.601999] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 08:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 9884.603219] handle_exit+0x98/0x230 [kvm_amd] Aug 22 08:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 9884.604318] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 08:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 9884.605363] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 08:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 9884.606464] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 08:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 9884.607482] vcpu_run+0x62/0x2c0 [kvm] Aug 22 08:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 9884.608378] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 08:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 9884.609342] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 08:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 9884.610306] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 08:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 9884.611261] ? __seccomp_filter+0x4a/0x4a0 Aug 22 08:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 9884.612098] ? __fget_files+0x86/0xc0 Aug 22 08:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 9884.612881] __x64_sys_ioctl+0x95/0xd0 Aug 22 08:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 9884.613664] do_syscall_64+0x5c/0xc0 Aug 22 08:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 9884.614427] ? do_futex+0x162/0x1f0 Aug 22 08:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 9884.615184] ? __x64_sys_futex+0x78/0x1e0 Aug 22 08:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 9884.615950] ? __secure_computing+0xa9/0x120 Aug 22 08:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 9884.616834] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 08:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 9884.617712] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 9884.618543] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 9884.619378] ? do_syscall_64+0x69/0xc0 Aug 22 08:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 9884.620104] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 9884.620903] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 9884.621713] ? do_syscall_64+0x69/0xc0 Aug 22 08:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 9884.622412] ? do_syscall_64+0x69/0xc0 Aug 22 08:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 9884.623130] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 08:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 9884.623982] RIP: 0033:0x7faa5d0edaff Aug 22 08:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 9884.624740] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 08:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 9884.627237] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 08:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 9884.628325] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 08:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 9884.629369] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 08:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 9884.630399] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 08:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 9884.631440] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 08:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 9884.632464] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 08:08:30 juju-e4d256-prod-github-runner-207 kernel: [ 9884.633489] Aug 22 08:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 9897.848709] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 08:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 9897.849692] rcu: 1-....: (2437487 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=1179239 Aug 22 08:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 9897.850805] (t=2445162 jiffies g=23269 q=18529) Aug 22 08:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 9897.851612] NMI backtrace for cpu 1 Aug 22 08:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 9897.852328] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 08:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 9897.853450] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 08:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 9897.854523] Call Trace: Aug 22 08:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 9897.855222] Aug 22 08:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 9897.855884] show_stack+0x52/0x5c Aug 22 08:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 9897.856613] dump_stack_lvl+0x4a/0x63 Aug 22 08:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 9897.857356] dump_stack+0x10/0x16 Aug 22 08:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 9897.858072] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 08:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 9897.858861] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 08:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 9897.859663] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 08:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 9897.860491] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 08:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 9897.861321] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 08:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 9897.862126] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 08:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 9897.862897] print_cpu_stall.cold+0x2f/0xe2 Aug 22 08:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 9897.863687] ? timekeeping_update+0xf7/0x150 Aug 22 08:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 9897.864476] check_cpu_stall+0x109/0x270 Aug 22 08:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 9897.865233] rcu_sched_clock_irq+0x9a/0x250 Aug 22 08:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 9897.865998] update_process_times+0x94/0xd0 Aug 22 08:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 9897.866759] tick_sched_handle+0x29/0x70 Aug 22 08:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 9897.867534] tick_sched_timer+0x8c/0xc0 Aug 22 08:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 9897.868305] ? tick_nohz_handler+0xb0/0xb0 Aug 22 08:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 9897.869094] __hrtimer_run_queues+0x107/0x230 Aug 22 08:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 9897.870035] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 08:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 9897.871123] hrtimer_interrupt+0x101/0x220 Aug 22 08:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 9897.871927] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 08:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 9897.872792] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 08:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 9897.873595] Aug 22 08:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 9897.874229] Aug 22 08:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 9897.874856] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 08:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 9897.875686] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 9897.876562] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 08:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 9897.878771] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 08:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 9897.879744] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 08:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 9897.880751] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 08:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 9897.881735] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 08:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 9897.882706] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 08:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 9897.883702] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 08:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 9897.884657] ? _raw_spin_lock+0x22/0x30 Aug 22 08:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 9897.885417] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 9897.886253] direct_page_fault+0x206/0x310 [kvm] Aug 22 08:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 9897.887108] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 08:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 9897.887951] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 08:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 9897.888774] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 08:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 9897.889579] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 08:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 9897.890369] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 08:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 9897.891204] handle_exit+0x98/0x230 [kvm_amd] Aug 22 08:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 9897.891958] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 08:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 9897.892743] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 08:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 9897.893546] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 08:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 9897.894334] vcpu_run+0x62/0x2c0 [kvm] Aug 22 08:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 9897.895060] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 08:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 9897.895803] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 08:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 9897.896703] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 08:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 9897.897775] ? __seccomp_filter+0x4a/0x4a0 Aug 22 08:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 9897.898738] ? __fget_files+0x86/0xc0 Aug 22 08:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 9897.899580] __x64_sys_ioctl+0x95/0xd0 Aug 22 08:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 9897.900369] do_syscall_64+0x5c/0xc0 Aug 22 08:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 9897.901119] ? do_futex+0x162/0x1f0 Aug 22 08:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 9897.901790] ? __x64_sys_futex+0x78/0x1e0 Aug 22 08:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 9897.902498] ? __secure_computing+0xa9/0x120 Aug 22 08:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 9897.903239] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 08:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 9897.904071] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 9897.904825] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 9897.905583] ? do_syscall_64+0x69/0xc0 Aug 22 08:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 9897.906273] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 9897.907046] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 9897.907820] ? do_syscall_64+0x69/0xc0 Aug 22 08:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 9897.908696] ? do_syscall_64+0x69/0xc0 Aug 22 08:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 9897.909427] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 08:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 9897.910246] RIP: 0033:0x7faa5d0edaff Aug 22 08:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 9897.910980] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 08:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 9897.913087] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 08:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 9897.914054] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 08:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 9897.915026] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 08:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 9897.915975] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 08:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 9897.916921] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 08:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 9897.917849] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 08:08:43 juju-e4d256-prod-github-runner-207 kernel: [ 9897.918774] Aug 22 08:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 9924.541976] watchdog: BUG: soft lockup - CPU#1 stuck for 9134s! [qemu-system-x86:6715] Aug 22 08:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 9924.543106] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 08:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 9924.543177] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 08:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 9924.555330] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 08:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 9924.556605] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 08:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 9924.557843] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 9924.558913] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 08:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 9924.561462] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 08:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 9924.562500] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 08:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 9924.563710] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 08:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 9924.564903] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 08:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 9924.566108] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 08:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 9924.567322] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 08:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 9924.568489] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 08:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 9924.569752] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 08:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 9924.570865] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 08:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 9924.572053] Call Trace: Aug 22 08:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 9924.572963] Aug 22 08:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 9924.573847] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 9924.574882] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 9924.575904] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 9924.576975] ? show_regs.part.0+0x23/0x29 Aug 22 08:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 9924.578006] ? show_regs.cold+0x8/0xd Aug 22 08:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 9924.578995] ? watchdog_timer_fn+0x1be/0x220 Aug 22 08:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 9924.580017] ? lockup_detector_update_enable+0x60/0x60 Aug 22 08:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 9924.581083] ? __hrtimer_run_queues+0x107/0x230 Aug 22 08:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 9924.582107] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 08:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 9924.583139] ? hrtimer_interrupt+0x101/0x220 Aug 22 08:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 9924.584151] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 08:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 9924.585216] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 08:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 9924.586265] Aug 22 08:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 9924.587122] Aug 22 08:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 9924.587960] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 08:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 9924.588994] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 9924.590027] ? _raw_spin_lock+0x22/0x30 Aug 22 08:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 9924.590979] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 9924.591999] direct_page_fault+0x206/0x310 [kvm] Aug 22 08:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 9924.593028] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 08:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 9924.594042] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 08:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 9924.595052] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 08:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 9924.596037] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 08:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 9924.597004] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 08:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 9924.597983] handle_exit+0x98/0x230 [kvm_amd] Aug 22 08:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 9924.598903] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 08:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 9924.599826] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 08:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 9924.600752] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 08:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 9924.601652] vcpu_run+0x62/0x2c0 [kvm] Aug 22 08:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 9924.602482] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 08:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 9924.603351] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 08:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 9924.604325] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 08:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 9924.605166] ? __seccomp_filter+0x4a/0x4a0 Aug 22 08:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 9924.605929] ? __fget_files+0x86/0xc0 Aug 22 08:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 9924.606665] __x64_sys_ioctl+0x95/0xd0 Aug 22 08:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 9924.607409] do_syscall_64+0x5c/0xc0 Aug 22 08:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 9924.608107] ? do_futex+0x162/0x1f0 Aug 22 08:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 9924.608754] ? __x64_sys_futex+0x78/0x1e0 Aug 22 08:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 9924.609425] ? __secure_computing+0xa9/0x120 Aug 22 08:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 9924.610112] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 08:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 9924.610885] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 9924.611604] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 9924.612318] ? do_syscall_64+0x69/0xc0 Aug 22 08:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 9924.612960] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 9924.613669] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 9924.614361] ? do_syscall_64+0x69/0xc0 Aug 22 08:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 9924.614987] ? do_syscall_64+0x69/0xc0 Aug 22 08:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 9924.615607] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 08:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 9924.616337] RIP: 0033:0x7faa5d0edaff Aug 22 08:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 9924.616966] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 08:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 9924.619000] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 08:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 9924.619920] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 08:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 9924.620842] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 08:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 9924.621756] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 08:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 9924.622715] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 08:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 9924.623617] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 08:09:10 juju-e4d256-prod-github-runner-207 kernel: [ 9924.624508] Aug 22 08:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 9952.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 9161s! [qemu-system-x86:6715] Aug 22 08:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 9952.543198] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 08:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 9952.543366] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 08:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 9952.556104] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 08:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 9952.557390] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 08:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 9952.558634] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 9952.559691] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 08:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 9952.562303] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 08:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 9952.563349] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 08:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 9952.564511] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 08:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 9952.565682] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 08:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 9952.566869] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 08:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 9952.568055] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 08:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 9952.569221] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 08:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 9952.570491] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 08:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 9952.571597] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 08:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 9952.572805] Call Trace: Aug 22 08:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 9952.573732] Aug 22 08:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 9952.574638] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 9952.575701] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 9952.576731] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 9952.577840] ? show_regs.part.0+0x23/0x29 Aug 22 08:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 9952.578907] ? show_regs.cold+0x8/0xd Aug 22 08:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 9952.579883] ? watchdog_timer_fn+0x1be/0x220 Aug 22 08:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 9952.580891] ? lockup_detector_update_enable+0x60/0x60 Aug 22 08:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 9952.581954] ? __hrtimer_run_queues+0x107/0x230 Aug 22 08:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 9952.583000] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 08:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 9952.584027] ? hrtimer_interrupt+0x101/0x220 Aug 22 08:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 9952.585041] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 08:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 9952.586131] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 08:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 9952.587219] Aug 22 08:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 9952.588125] Aug 22 08:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 9952.589169] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 08:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 9952.590310] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 9952.591363] ? _raw_spin_lock+0x22/0x30 Aug 22 08:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 9952.592334] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 9952.593360] direct_page_fault+0x206/0x310 [kvm] Aug 22 08:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 9952.594395] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 08:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 9952.595404] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 08:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 9952.596402] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 08:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 9952.597461] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 08:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 9952.598446] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 08:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 9952.599450] handle_exit+0x98/0x230 [kvm_amd] Aug 22 08:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 9952.600344] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 08:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 9952.601259] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 08:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 9952.602196] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 08:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 9952.603130] vcpu_run+0x62/0x2c0 [kvm] Aug 22 08:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 9952.603945] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 08:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 9952.604916] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 08:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 9952.605780] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 08:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 9952.606615] ? __seccomp_filter+0x4a/0x4a0 Aug 22 08:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 9952.607360] ? __fget_files+0x86/0xc0 Aug 22 08:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 9952.608072] __x64_sys_ioctl+0x95/0xd0 Aug 22 08:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 9952.608765] do_syscall_64+0x5c/0xc0 Aug 22 08:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 9952.609450] ? do_futex+0x162/0x1f0 Aug 22 08:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 9952.610111] ? __x64_sys_futex+0x78/0x1e0 Aug 22 08:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 9952.610817] ? __secure_computing+0xa9/0x120 Aug 22 08:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 9952.611510] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 08:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 9952.612274] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 9952.613003] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 9952.613738] ? do_syscall_64+0x69/0xc0 Aug 22 08:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 9952.614418] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 9952.615120] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 9952.615813] ? do_syscall_64+0x69/0xc0 Aug 22 08:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 9952.616437] ? do_syscall_64+0x69/0xc0 Aug 22 08:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 9952.617096] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 08:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 9952.617820] RIP: 0033:0x7faa5d0edaff Aug 22 08:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 9952.618468] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 08:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 9952.620477] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 08:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 9952.621612] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 08:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 9952.622545] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 08:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 9952.623552] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 08:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 9952.624450] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 08:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 9952.625337] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 08:09:38 juju-e4d256-prod-github-runner-207 kernel: [ 9952.626262] Aug 22 08:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 9980.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 9187s! [qemu-system-x86:6715] Aug 22 08:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 9980.543836] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 08:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 9980.544079] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 08:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 9980.556244] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 08:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 9980.557514] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 08:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 9980.558739] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 9980.559810] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 08:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 9980.562520] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 08:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 9980.563573] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 08:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 9980.564742] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 08:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 9980.565905] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 08:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 9980.567087] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 08:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 9980.568247] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 08:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 9980.569409] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 08:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 9980.570857] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 08:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 9980.571955] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 08:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 9980.573146] Call Trace: Aug 22 08:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 9980.574071] Aug 22 08:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 9980.574968] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 9980.575995] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 9980.577028] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 9980.578121] ? show_regs.part.0+0x23/0x29 Aug 22 08:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 9980.579117] ? show_regs.cold+0x8/0xd Aug 22 08:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 9980.580091] ? watchdog_timer_fn+0x1be/0x220 Aug 22 08:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 9980.581113] ? lockup_detector_update_enable+0x60/0x60 Aug 22 08:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 9980.582190] ? __hrtimer_run_queues+0x107/0x230 Aug 22 08:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 9980.583219] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 08:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 9980.584241] ? hrtimer_interrupt+0x101/0x220 Aug 22 08:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 9980.585254] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 08:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 9980.586338] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 08:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 9980.587407] Aug 22 08:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 9980.588505] Aug 22 08:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 9980.589346] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 08:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 9980.590488] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 9980.591646] ? _raw_spin_lock+0x22/0x30 Aug 22 08:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 9980.592877] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 9980.594026] direct_page_fault+0x206/0x310 [kvm] Aug 22 08:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 9980.595179] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 08:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 9980.596543] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 08:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 9980.597642] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 08:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 9980.598753] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 08:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 9980.599830] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 08:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 9980.600917] handle_exit+0x98/0x230 [kvm_amd] Aug 22 08:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 9980.601969] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 08:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 9980.602981] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 08:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 9980.604006] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 08:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 9980.605026] vcpu_run+0x62/0x2c0 [kvm] Aug 22 08:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 9980.605909] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 08:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 9980.606821] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 08:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 9980.607768] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 08:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 9980.608653] ? __seccomp_filter+0x4a/0x4a0 Aug 22 08:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 9980.609476] ? __fget_files+0x86/0xc0 Aug 22 08:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 9980.610266] __x64_sys_ioctl+0x95/0xd0 Aug 22 08:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 9980.611037] do_syscall_64+0x5c/0xc0 Aug 22 08:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 9980.611777] ? do_futex+0x162/0x1f0 Aug 22 08:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 9980.612492] ? __x64_sys_futex+0x78/0x1e0 Aug 22 08:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 9980.613244] ? __secure_computing+0xa9/0x120 Aug 22 08:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 9980.614030] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 08:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 9980.614891] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 9980.615707] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 9980.616708] ? do_syscall_64+0x69/0xc0 Aug 22 08:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 9980.617439] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 9980.618341] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 9980.619132] ? do_syscall_64+0x69/0xc0 Aug 22 08:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 9980.619832] ? do_syscall_64+0x69/0xc0 Aug 22 08:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 9980.620532] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 08:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 9980.621329] RIP: 0033:0x7faa5d0edaff Aug 22 08:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 9980.622074] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 08:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 9980.624392] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 08:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 9980.625456] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 08:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 9980.626501] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 08:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 9980.627529] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 08:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 9980.628546] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 08:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 9980.629565] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 08:10:06 juju-e4d256-prod-github-runner-207 kernel: [ 9980.630605] Aug 22 08:10:34 juju-e4d256-prod-github-runner-207 kernel: [10008.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 9213s! [qemu-system-x86:6715] Aug 22 08:10:34 juju-e4d256-prod-github-runner-207 kernel: [10008.543110] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 08:10:34 juju-e4d256-prod-github-runner-207 kernel: [10008.543187] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 08:10:34 juju-e4d256-prod-github-runner-207 kernel: [10008.556016] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 08:10:34 juju-e4d256-prod-github-runner-207 kernel: [10008.557332] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 08:10:34 juju-e4d256-prod-github-runner-207 kernel: [10008.558580] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:10:34 juju-e4d256-prod-github-runner-207 kernel: [10008.559644] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 08:10:34 juju-e4d256-prod-github-runner-207 kernel: [10008.562206] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 08:10:34 juju-e4d256-prod-github-runner-207 kernel: [10008.563251] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 08:10:34 juju-e4d256-prod-github-runner-207 kernel: [10008.564414] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 08:10:34 juju-e4d256-prod-github-runner-207 kernel: [10008.565595] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 08:10:34 juju-e4d256-prod-github-runner-207 kernel: [10008.566765] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 08:10:34 juju-e4d256-prod-github-runner-207 kernel: [10008.567932] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 08:10:34 juju-e4d256-prod-github-runner-207 kernel: [10008.569239] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 08:10:34 juju-e4d256-prod-github-runner-207 kernel: [10008.570503] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 08:10:34 juju-e4d256-prod-github-runner-207 kernel: [10008.571602] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 08:10:34 juju-e4d256-prod-github-runner-207 kernel: [10008.572799] Call Trace: Aug 22 08:10:34 juju-e4d256-prod-github-runner-207 kernel: [10008.573740] Aug 22 08:10:34 juju-e4d256-prod-github-runner-207 kernel: [10008.574628] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:10:34 juju-e4d256-prod-github-runner-207 kernel: [10008.575661] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:10:34 juju-e4d256-prod-github-runner-207 kernel: [10008.576684] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:10:34 juju-e4d256-prod-github-runner-207 kernel: [10008.577787] ? show_regs.part.0+0x23/0x29 Aug 22 08:10:34 juju-e4d256-prod-github-runner-207 kernel: [10008.578790] ? show_regs.cold+0x8/0xd Aug 22 08:10:34 juju-e4d256-prod-github-runner-207 kernel: [10008.579769] ? watchdog_timer_fn+0x1be/0x220 Aug 22 08:10:34 juju-e4d256-prod-github-runner-207 kernel: [10008.580801] ? lockup_detector_update_enable+0x60/0x60 Aug 22 08:10:34 juju-e4d256-prod-github-runner-207 kernel: [10008.581894] ? __hrtimer_run_queues+0x107/0x230 Aug 22 08:10:34 juju-e4d256-prod-github-runner-207 kernel: [10008.582928] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 08:10:34 juju-e4d256-prod-github-runner-207 kernel: [10008.583955] ? hrtimer_interrupt+0x101/0x220 Aug 22 08:10:34 juju-e4d256-prod-github-runner-207 kernel: [10008.584974] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 08:10:34 juju-e4d256-prod-github-runner-207 kernel: [10008.586072] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 08:10:34 juju-e4d256-prod-github-runner-207 kernel: [10008.587139] Aug 22 08:10:34 juju-e4d256-prod-github-runner-207 kernel: [10008.588003] Aug 22 08:10:34 juju-e4d256-prod-github-runner-207 kernel: [10008.588846] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 08:10:34 juju-e4d256-prod-github-runner-207 kernel: [10008.589905] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:10:34 juju-e4d256-prod-github-runner-207 kernel: [10008.590948] ? _raw_spin_lock+0x22/0x30 Aug 22 08:10:34 juju-e4d256-prod-github-runner-207 kernel: [10008.591897] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:10:34 juju-e4d256-prod-github-runner-207 kernel: [10008.592977] direct_page_fault+0x206/0x310 [kvm] Aug 22 08:10:34 juju-e4d256-prod-github-runner-207 kernel: [10008.594027] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 08:10:34 juju-e4d256-prod-github-runner-207 kernel: [10008.595043] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 08:10:34 juju-e4d256-prod-github-runner-207 kernel: [10008.596049] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 08:10:34 juju-e4d256-prod-github-runner-207 kernel: [10008.597112] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 08:10:34 juju-e4d256-prod-github-runner-207 kernel: [10008.598081] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 08:10:34 juju-e4d256-prod-github-runner-207 kernel: [10008.599071] handle_exit+0x98/0x230 [kvm_amd] Aug 22 08:10:34 juju-e4d256-prod-github-runner-207 kernel: [10008.599968] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 08:10:34 juju-e4d256-prod-github-runner-207 kernel: [10008.600892] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 08:10:34 juju-e4d256-prod-github-runner-207 kernel: [10008.601851] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 08:10:34 juju-e4d256-prod-github-runner-207 kernel: [10008.602757] vcpu_run+0x62/0x2c0 [kvm] Aug 22 08:10:34 juju-e4d256-prod-github-runner-207 kernel: [10008.603568] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 08:10:34 juju-e4d256-prod-github-runner-207 kernel: [10008.604376] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 08:10:34 juju-e4d256-prod-github-runner-207 kernel: [10008.605242] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 08:10:34 juju-e4d256-prod-github-runner-207 kernel: [10008.606064] ? __seccomp_filter+0x4a/0x4a0 Aug 22 08:10:34 juju-e4d256-prod-github-runner-207 kernel: [10008.606808] ? __fget_files+0x86/0xc0 Aug 22 08:10:34 juju-e4d256-prod-github-runner-207 kernel: [10008.607513] __x64_sys_ioctl+0x95/0xd0 Aug 22 08:10:34 juju-e4d256-prod-github-runner-207 kernel: [10008.608254] do_syscall_64+0x5c/0xc0 Aug 22 08:10:34 juju-e4d256-prod-github-runner-207 kernel: [10008.608946] ? do_futex+0x162/0x1f0 Aug 22 08:10:34 juju-e4d256-prod-github-runner-207 kernel: [10008.609639] ? __x64_sys_futex+0x78/0x1e0 Aug 22 08:10:34 juju-e4d256-prod-github-runner-207 kernel: [10008.610315] ? __secure_computing+0xa9/0x120 Aug 22 08:10:34 juju-e4d256-prod-github-runner-207 kernel: [10008.611010] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 08:10:34 juju-e4d256-prod-github-runner-207 kernel: [10008.611817] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:10:34 juju-e4d256-prod-github-runner-207 kernel: [10008.612539] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:10:34 juju-e4d256-prod-github-runner-207 kernel: [10008.613260] ? do_syscall_64+0x69/0xc0 Aug 22 08:10:34 juju-e4d256-prod-github-runner-207 kernel: [10008.613932] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:10:34 juju-e4d256-prod-github-runner-207 kernel: [10008.614645] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:10:34 juju-e4d256-prod-github-runner-207 kernel: [10008.615341] ? do_syscall_64+0x69/0xc0 Aug 22 08:10:34 juju-e4d256-prod-github-runner-207 kernel: [10008.615965] ? do_syscall_64+0x69/0xc0 Aug 22 08:10:34 juju-e4d256-prod-github-runner-207 kernel: [10008.616594] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 08:10:34 juju-e4d256-prod-github-runner-207 kernel: [10008.617301] RIP: 0033:0x7faa5d0edaff Aug 22 08:10:34 juju-e4d256-prod-github-runner-207 kernel: [10008.617941] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 08:10:34 juju-e4d256-prod-github-runner-207 kernel: [10008.619942] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 08:10:34 juju-e4d256-prod-github-runner-207 kernel: [10008.620860] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 08:10:34 juju-e4d256-prod-github-runner-207 kernel: [10008.621767] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 08:10:34 juju-e4d256-prod-github-runner-207 kernel: [10008.622663] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 08:10:34 juju-e4d256-prod-github-runner-207 kernel: [10008.623555] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 08:10:34 juju-e4d256-prod-github-runner-207 kernel: [10008.624450] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 08:10:34 juju-e4d256-prod-github-runner-207 kernel: [10008.625346] Aug 22 08:11:02 juju-e4d256-prod-github-runner-207 kernel: [10036.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 9239s! [qemu-system-x86:6715] Aug 22 08:11:02 juju-e4d256-prod-github-runner-207 kernel: [10036.543173] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 08:11:02 juju-e4d256-prod-github-runner-207 kernel: [10036.543247] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 08:11:02 juju-e4d256-prod-github-runner-207 kernel: [10036.555551] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 08:11:02 juju-e4d256-prod-github-runner-207 kernel: [10036.557000] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 08:11:02 juju-e4d256-prod-github-runner-207 kernel: [10036.558400] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:11:02 juju-e4d256-prod-github-runner-207 kernel: [10036.559461] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 08:11:02 juju-e4d256-prod-github-runner-207 kernel: [10036.562049] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 08:11:02 juju-e4d256-prod-github-runner-207 kernel: [10036.563126] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 08:11:02 juju-e4d256-prod-github-runner-207 kernel: [10036.564288] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 08:11:02 juju-e4d256-prod-github-runner-207 kernel: [10036.565466] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 08:11:02 juju-e4d256-prod-github-runner-207 kernel: [10036.566682] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 08:11:02 juju-e4d256-prod-github-runner-207 kernel: [10036.567906] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 08:11:02 juju-e4d256-prod-github-runner-207 kernel: [10036.569103] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 08:11:02 juju-e4d256-prod-github-runner-207 kernel: [10036.570407] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 08:11:02 juju-e4d256-prod-github-runner-207 kernel: [10036.571697] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 08:11:02 juju-e4d256-prod-github-runner-207 kernel: [10036.572961] Call Trace: Aug 22 08:11:02 juju-e4d256-prod-github-runner-207 kernel: [10036.573917] Aug 22 08:11:02 juju-e4d256-prod-github-runner-207 kernel: [10036.574810] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:11:02 juju-e4d256-prod-github-runner-207 kernel: [10036.575840] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:11:02 juju-e4d256-prod-github-runner-207 kernel: [10036.576886] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:11:02 juju-e4d256-prod-github-runner-207 kernel: [10036.577985] ? show_regs.part.0+0x23/0x29 Aug 22 08:11:02 juju-e4d256-prod-github-runner-207 kernel: [10036.578994] ? show_regs.cold+0x8/0xd Aug 22 08:11:02 juju-e4d256-prod-github-runner-207 kernel: [10036.580008] ? watchdog_timer_fn+0x1be/0x220 Aug 22 08:11:02 juju-e4d256-prod-github-runner-207 kernel: [10036.581030] ? lockup_detector_update_enable+0x60/0x60 Aug 22 08:11:02 juju-e4d256-prod-github-runner-207 kernel: [10036.582137] ? __hrtimer_run_queues+0x107/0x230 Aug 22 08:11:02 juju-e4d256-prod-github-runner-207 kernel: [10036.583177] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 08:11:02 juju-e4d256-prod-github-runner-207 kernel: [10036.584247] ? hrtimer_interrupt+0x101/0x220 Aug 22 08:11:02 juju-e4d256-prod-github-runner-207 kernel: [10036.585295] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 08:11:02 juju-e4d256-prod-github-runner-207 kernel: [10036.586366] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 08:11:02 juju-e4d256-prod-github-runner-207 kernel: [10036.587415] Aug 22 08:11:02 juju-e4d256-prod-github-runner-207 kernel: [10036.588276] Aug 22 08:11:02 juju-e4d256-prod-github-runner-207 kernel: [10036.589148] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 08:11:02 juju-e4d256-prod-github-runner-207 kernel: [10036.590214] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:11:02 juju-e4d256-prod-github-runner-207 kernel: [10036.591254] ? _raw_spin_lock+0x22/0x30 Aug 22 08:11:02 juju-e4d256-prod-github-runner-207 kernel: [10036.592226] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:11:02 juju-e4d256-prod-github-runner-207 kernel: [10036.593278] direct_page_fault+0x206/0x310 [kvm] Aug 22 08:11:02 juju-e4d256-prod-github-runner-207 kernel: [10036.594330] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 08:11:02 juju-e4d256-prod-github-runner-207 kernel: [10036.595476] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 08:11:02 juju-e4d256-prod-github-runner-207 kernel: [10036.596511] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 08:11:02 juju-e4d256-prod-github-runner-207 kernel: [10036.597507] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 08:11:02 juju-e4d256-prod-github-runner-207 kernel: [10036.598471] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 08:11:02 juju-e4d256-prod-github-runner-207 kernel: [10036.599473] handle_exit+0x98/0x230 [kvm_amd] Aug 22 08:11:02 juju-e4d256-prod-github-runner-207 kernel: [10036.600437] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 08:11:02 juju-e4d256-prod-github-runner-207 kernel: [10036.601436] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 08:11:02 juju-e4d256-prod-github-runner-207 kernel: [10036.602376] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 08:11:02 juju-e4d256-prod-github-runner-207 kernel: [10036.603330] vcpu_run+0x62/0x2c0 [kvm] Aug 22 08:11:02 juju-e4d256-prod-github-runner-207 kernel: [10036.604167] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 08:11:02 juju-e4d256-prod-github-runner-207 kernel: [10036.604986] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 08:11:02 juju-e4d256-prod-github-runner-207 kernel: [10036.605855] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 08:11:02 juju-e4d256-prod-github-runner-207 kernel: [10036.606674] ? __seccomp_filter+0x4a/0x4a0 Aug 22 08:11:02 juju-e4d256-prod-github-runner-207 kernel: [10036.607427] ? __fget_files+0x86/0xc0 Aug 22 08:11:02 juju-e4d256-prod-github-runner-207 kernel: [10036.608148] __x64_sys_ioctl+0x95/0xd0 Aug 22 08:11:02 juju-e4d256-prod-github-runner-207 kernel: [10036.608846] do_syscall_64+0x5c/0xc0 Aug 22 08:11:02 juju-e4d256-prod-github-runner-207 kernel: [10036.609683] ? do_futex+0x162/0x1f0 Aug 22 08:11:02 juju-e4d256-prod-github-runner-207 kernel: [10036.610346] ? __x64_sys_futex+0x78/0x1e0 Aug 22 08:11:02 juju-e4d256-prod-github-runner-207 kernel: [10036.611050] ? __secure_computing+0xa9/0x120 Aug 22 08:11:02 juju-e4d256-prod-github-runner-207 kernel: [10036.611834] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 08:11:02 juju-e4d256-prod-github-runner-207 kernel: [10036.612715] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:11:02 juju-e4d256-prod-github-runner-207 kernel: [10036.613518] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:11:02 juju-e4d256-prod-github-runner-207 kernel: [10036.614264] ? do_syscall_64+0x69/0xc0 Aug 22 08:11:02 juju-e4d256-prod-github-runner-207 kernel: [10036.614936] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:11:02 juju-e4d256-prod-github-runner-207 kernel: [10036.615642] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:11:02 juju-e4d256-prod-github-runner-207 kernel: [10036.616353] ? do_syscall_64+0x69/0xc0 Aug 22 08:11:02 juju-e4d256-prod-github-runner-207 kernel: [10036.616989] ? do_syscall_64+0x69/0xc0 Aug 22 08:11:02 juju-e4d256-prod-github-runner-207 kernel: [10036.617635] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 08:11:02 juju-e4d256-prod-github-runner-207 kernel: [10036.618359] RIP: 0033:0x7faa5d0edaff Aug 22 08:11:02 juju-e4d256-prod-github-runner-207 kernel: [10036.618996] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 08:11:02 juju-e4d256-prod-github-runner-207 kernel: [10036.621016] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 08:11:02 juju-e4d256-prod-github-runner-207 kernel: [10036.621955] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 08:11:02 juju-e4d256-prod-github-runner-207 kernel: [10036.622862] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 08:11:02 juju-e4d256-prod-github-runner-207 kernel: [10036.623749] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 08:11:02 juju-e4d256-prod-github-runner-207 kernel: [10036.624648] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 08:11:02 juju-e4d256-prod-github-runner-207 kernel: [10036.625571] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 08:11:02 juju-e4d256-prod-github-runner-207 kernel: [10036.626464] Aug 22 08:11:30 juju-e4d256-prod-github-runner-207 kernel: [10064.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 9265s! [qemu-system-x86:6715] Aug 22 08:11:30 juju-e4d256-prod-github-runner-207 kernel: [10064.543829] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 08:11:30 juju-e4d256-prod-github-runner-207 kernel: [10064.544100] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 08:11:30 juju-e4d256-prod-github-runner-207 kernel: [10064.556344] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 08:11:30 juju-e4d256-prod-github-runner-207 kernel: [10064.557621] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 08:11:30 juju-e4d256-prod-github-runner-207 kernel: [10064.558844] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:11:30 juju-e4d256-prod-github-runner-207 kernel: [10064.559914] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 08:11:30 juju-e4d256-prod-github-runner-207 kernel: [10064.562476] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 08:11:30 juju-e4d256-prod-github-runner-207 kernel: [10064.563517] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 08:11:30 juju-e4d256-prod-github-runner-207 kernel: [10064.564678] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 08:11:30 juju-e4d256-prod-github-runner-207 kernel: [10064.565881] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 08:11:30 juju-e4d256-prod-github-runner-207 kernel: [10064.567040] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 08:11:30 juju-e4d256-prod-github-runner-207 kernel: [10064.568199] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 08:11:30 juju-e4d256-prod-github-runner-207 kernel: [10064.569384] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 08:11:30 juju-e4d256-prod-github-runner-207 kernel: [10064.570637] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 08:11:30 juju-e4d256-prod-github-runner-207 kernel: [10064.571746] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 08:11:30 juju-e4d256-prod-github-runner-207 kernel: [10064.573024] Call Trace: Aug 22 08:11:30 juju-e4d256-prod-github-runner-207 kernel: [10064.573969] Aug 22 08:11:30 juju-e4d256-prod-github-runner-207 kernel: [10064.574863] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:11:30 juju-e4d256-prod-github-runner-207 kernel: [10064.575914] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:11:30 juju-e4d256-prod-github-runner-207 kernel: [10064.576950] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:11:30 juju-e4d256-prod-github-runner-207 kernel: [10064.578043] ? show_regs.part.0+0x23/0x29 Aug 22 08:11:30 juju-e4d256-prod-github-runner-207 kernel: [10064.579038] ? show_regs.cold+0x8/0xd Aug 22 08:11:30 juju-e4d256-prod-github-runner-207 kernel: [10064.580007] ? watchdog_timer_fn+0x1be/0x220 Aug 22 08:11:30 juju-e4d256-prod-github-runner-207 kernel: [10064.581025] ? lockup_detector_update_enable+0x60/0x60 Aug 22 08:11:30 juju-e4d256-prod-github-runner-207 kernel: [10064.582092] ? __hrtimer_run_queues+0x107/0x230 Aug 22 08:11:30 juju-e4d256-prod-github-runner-207 kernel: [10064.583123] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 08:11:30 juju-e4d256-prod-github-runner-207 kernel: [10064.584146] ? hrtimer_interrupt+0x101/0x220 Aug 22 08:11:30 juju-e4d256-prod-github-runner-207 kernel: [10064.585177] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 08:11:30 juju-e4d256-prod-github-runner-207 kernel: [10064.586249] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 08:11:30 juju-e4d256-prod-github-runner-207 kernel: [10064.587298] Aug 22 08:11:30 juju-e4d256-prod-github-runner-207 kernel: [10064.588150] Aug 22 08:11:30 juju-e4d256-prod-github-runner-207 kernel: [10064.588994] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 08:11:30 juju-e4d256-prod-github-runner-207 kernel: [10064.590028] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:11:30 juju-e4d256-prod-github-runner-207 kernel: [10064.591072] ? _raw_spin_lock+0x22/0x30 Aug 22 08:11:30 juju-e4d256-prod-github-runner-207 kernel: [10064.592022] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:11:30 juju-e4d256-prod-github-runner-207 kernel: [10064.593064] direct_page_fault+0x206/0x310 [kvm] Aug 22 08:11:30 juju-e4d256-prod-github-runner-207 kernel: [10064.594095] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 08:11:30 juju-e4d256-prod-github-runner-207 kernel: [10064.595102] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 08:11:30 juju-e4d256-prod-github-runner-207 kernel: [10064.596102] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 08:11:30 juju-e4d256-prod-github-runner-207 kernel: [10064.597133] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 08:11:30 juju-e4d256-prod-github-runner-207 kernel: [10064.598078] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 08:11:30 juju-e4d256-prod-github-runner-207 kernel: [10064.599059] handle_exit+0x98/0x230 [kvm_amd] Aug 22 08:11:30 juju-e4d256-prod-github-runner-207 kernel: [10064.599953] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 08:11:30 juju-e4d256-prod-github-runner-207 kernel: [10064.600865] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 08:11:30 juju-e4d256-prod-github-runner-207 kernel: [10064.601802] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 08:11:30 juju-e4d256-prod-github-runner-207 kernel: [10064.602704] vcpu_run+0x62/0x2c0 [kvm] Aug 22 08:11:30 juju-e4d256-prod-github-runner-207 kernel: [10064.603530] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 08:11:30 juju-e4d256-prod-github-runner-207 kernel: [10064.604344] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 08:11:30 juju-e4d256-prod-github-runner-207 kernel: [10064.605216] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 08:11:30 juju-e4d256-prod-github-runner-207 kernel: [10064.606017] ? __seccomp_filter+0x4a/0x4a0 Aug 22 08:11:30 juju-e4d256-prod-github-runner-207 kernel: [10064.606759] ? __fget_files+0x86/0xc0 Aug 22 08:11:30 juju-e4d256-prod-github-runner-207 kernel: [10064.607461] __x64_sys_ioctl+0x95/0xd0 Aug 22 08:11:30 juju-e4d256-prod-github-runner-207 kernel: [10064.608152] do_syscall_64+0x5c/0xc0 Aug 22 08:11:30 juju-e4d256-prod-github-runner-207 kernel: [10064.608815] ? do_futex+0x162/0x1f0 Aug 22 08:11:30 juju-e4d256-prod-github-runner-207 kernel: [10064.609475] ? __x64_sys_futex+0x78/0x1e0 Aug 22 08:11:30 juju-e4d256-prod-github-runner-207 kernel: [10064.610153] ? __secure_computing+0xa9/0x120 Aug 22 08:11:30 juju-e4d256-prod-github-runner-207 kernel: [10064.610853] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 08:11:30 juju-e4d256-prod-github-runner-207 kernel: [10064.611671] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:11:30 juju-e4d256-prod-github-runner-207 kernel: [10064.612726] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:11:30 juju-e4d256-prod-github-runner-207 kernel: [10064.613491] ? do_syscall_64+0x69/0xc0 Aug 22 08:11:30 juju-e4d256-prod-github-runner-207 kernel: [10064.614144] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:11:30 juju-e4d256-prod-github-runner-207 kernel: [10064.614847] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:11:30 juju-e4d256-prod-github-runner-207 kernel: [10064.615543] ? do_syscall_64+0x69/0xc0 Aug 22 08:11:30 juju-e4d256-prod-github-runner-207 kernel: [10064.616171] ? do_syscall_64+0x69/0xc0 Aug 22 08:11:30 juju-e4d256-prod-github-runner-207 kernel: [10064.616795] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 08:11:30 juju-e4d256-prod-github-runner-207 kernel: [10064.617515] RIP: 0033:0x7faa5d0edaff Aug 22 08:11:30 juju-e4d256-prod-github-runner-207 kernel: [10064.618181] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 08:11:30 juju-e4d256-prod-github-runner-207 kernel: [10064.620166] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 08:11:30 juju-e4d256-prod-github-runner-207 kernel: [10064.621093] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 08:11:30 juju-e4d256-prod-github-runner-207 kernel: [10064.621987] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 08:11:30 juju-e4d256-prod-github-runner-207 kernel: [10064.622873] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 08:11:30 juju-e4d256-prod-github-runner-207 kernel: [10064.623762] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 08:11:30 juju-e4d256-prod-github-runner-207 kernel: [10064.624646] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 08:11:30 juju-e4d256-prod-github-runner-207 kernel: [10064.625562] Aug 22 08:11:43 juju-e4d256-prod-github-runner-207 kernel: [10077.860723] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 08:11:43 juju-e4d256-prod-github-runner-207 kernel: [10077.861716] rcu: 1-....: (2482352 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=1200664 Aug 22 08:11:43 juju-e4d256-prod-github-runner-207 kernel: [10077.862901] (t=2490165 jiffies g=23269 q=18678) Aug 22 08:11:43 juju-e4d256-prod-github-runner-207 kernel: [10077.863683] NMI backtrace for cpu 1 Aug 22 08:11:43 juju-e4d256-prod-github-runner-207 kernel: [10077.864390] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 08:11:43 juju-e4d256-prod-github-runner-207 kernel: [10077.865612] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 08:11:43 juju-e4d256-prod-github-runner-207 kernel: [10077.866676] Call Trace: Aug 22 08:11:43 juju-e4d256-prod-github-runner-207 kernel: [10077.867351] Aug 22 08:11:43 juju-e4d256-prod-github-runner-207 kernel: [10077.868014] show_stack+0x52/0x5c Aug 22 08:11:43 juju-e4d256-prod-github-runner-207 kernel: [10077.868793] dump_stack_lvl+0x4a/0x63 Aug 22 08:11:43 juju-e4d256-prod-github-runner-207 kernel: [10077.869593] dump_stack+0x10/0x16 Aug 22 08:11:43 juju-e4d256-prod-github-runner-207 kernel: [10077.870311] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 08:11:43 juju-e4d256-prod-github-runner-207 kernel: [10077.871090] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 08:11:43 juju-e4d256-prod-github-runner-207 kernel: [10077.871867] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 08:11:43 juju-e4d256-prod-github-runner-207 kernel: [10077.872686] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 08:11:43 juju-e4d256-prod-github-runner-207 kernel: [10077.873528] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 08:11:43 juju-e4d256-prod-github-runner-207 kernel: [10077.874366] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 08:11:43 juju-e4d256-prod-github-runner-207 kernel: [10077.875135] print_cpu_stall.cold+0x2f/0xe2 Aug 22 08:11:43 juju-e4d256-prod-github-runner-207 kernel: [10077.875908] ? timekeeping_update+0xf7/0x150 Aug 22 08:11:43 juju-e4d256-prod-github-runner-207 kernel: [10077.876680] check_cpu_stall+0x109/0x270 Aug 22 08:11:43 juju-e4d256-prod-github-runner-207 kernel: [10077.877456] rcu_sched_clock_irq+0x9a/0x250 Aug 22 08:11:43 juju-e4d256-prod-github-runner-207 kernel: [10077.878229] update_process_times+0x94/0xd0 Aug 22 08:11:43 juju-e4d256-prod-github-runner-207 kernel: [10077.878987] tick_sched_handle+0x29/0x70 Aug 22 08:11:43 juju-e4d256-prod-github-runner-207 kernel: [10077.879729] tick_sched_timer+0x8c/0xc0 Aug 22 08:11:43 juju-e4d256-prod-github-runner-207 kernel: [10077.880480] ? tick_nohz_handler+0xb0/0xb0 Aug 22 08:11:43 juju-e4d256-prod-github-runner-207 kernel: [10077.881252] __hrtimer_run_queues+0x107/0x230 Aug 22 08:11:43 juju-e4d256-prod-github-runner-207 kernel: [10077.882024] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 08:11:43 juju-e4d256-prod-github-runner-207 kernel: [10077.882800] hrtimer_interrupt+0x101/0x220 Aug 22 08:11:43 juju-e4d256-prod-github-runner-207 kernel: [10077.883555] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 08:11:43 juju-e4d256-prod-github-runner-207 kernel: [10077.884385] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 08:11:43 juju-e4d256-prod-github-runner-207 kernel: [10077.885211] Aug 22 08:11:43 juju-e4d256-prod-github-runner-207 kernel: [10077.885847] Aug 22 08:11:43 juju-e4d256-prod-github-runner-207 kernel: [10077.886483] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 08:11:43 juju-e4d256-prod-github-runner-207 kernel: [10077.887315] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:11:43 juju-e4d256-prod-github-runner-207 kernel: [10077.888189] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 08:11:43 juju-e4d256-prod-github-runner-207 kernel: [10077.890469] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 08:11:43 juju-e4d256-prod-github-runner-207 kernel: [10077.891358] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 08:11:43 juju-e4d256-prod-github-runner-207 kernel: [10077.892352] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 08:11:43 juju-e4d256-prod-github-runner-207 kernel: [10077.893359] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 08:11:43 juju-e4d256-prod-github-runner-207 kernel: [10077.894327] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 08:11:43 juju-e4d256-prod-github-runner-207 kernel: [10077.895283] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 08:11:43 juju-e4d256-prod-github-runner-207 kernel: [10077.896233] ? _raw_spin_lock+0x22/0x30 Aug 22 08:11:43 juju-e4d256-prod-github-runner-207 kernel: [10077.897008] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:11:43 juju-e4d256-prod-github-runner-207 kernel: [10077.897867] direct_page_fault+0x206/0x310 [kvm] Aug 22 08:11:43 juju-e4d256-prod-github-runner-207 kernel: [10077.898711] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 08:11:43 juju-e4d256-prod-github-runner-207 kernel: [10077.899537] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 08:11:43 juju-e4d256-prod-github-runner-207 kernel: [10077.900362] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 08:11:43 juju-e4d256-prod-github-runner-207 kernel: [10077.901200] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 08:11:43 juju-e4d256-prod-github-runner-207 kernel: [10077.901999] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 08:11:43 juju-e4d256-prod-github-runner-207 kernel: [10077.902835] handle_exit+0x98/0x230 [kvm_amd] Aug 22 08:11:43 juju-e4d256-prod-github-runner-207 kernel: [10077.903595] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 08:11:43 juju-e4d256-prod-github-runner-207 kernel: [10077.904376] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 08:11:43 juju-e4d256-prod-github-runner-207 kernel: [10077.905207] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 08:11:43 juju-e4d256-prod-github-runner-207 kernel: [10077.905993] vcpu_run+0x62/0x2c0 [kvm] Aug 22 08:11:43 juju-e4d256-prod-github-runner-207 kernel: [10077.906714] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 08:11:43 juju-e4d256-prod-github-runner-207 kernel: [10077.907448] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 08:11:43 juju-e4d256-prod-github-runner-207 kernel: [10077.908263] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 08:11:43 juju-e4d256-prod-github-runner-207 kernel: [10077.909041] ? __seccomp_filter+0x4a/0x4a0 Aug 22 08:11:43 juju-e4d256-prod-github-runner-207 kernel: [10077.909768] ? __fget_files+0x86/0xc0 Aug 22 08:11:43 juju-e4d256-prod-github-runner-207 kernel: [10077.910461] __x64_sys_ioctl+0x95/0xd0 Aug 22 08:11:43 juju-e4d256-prod-github-runner-207 kernel: [10077.911156] do_syscall_64+0x5c/0xc0 Aug 22 08:11:43 juju-e4d256-prod-github-runner-207 kernel: [10077.911898] ? do_futex+0x162/0x1f0 Aug 22 08:11:43 juju-e4d256-prod-github-runner-207 kernel: [10077.912630] ? __x64_sys_futex+0x78/0x1e0 Aug 22 08:11:43 juju-e4d256-prod-github-runner-207 kernel: [10077.913505] ? __secure_computing+0xa9/0x120 Aug 22 08:11:43 juju-e4d256-prod-github-runner-207 kernel: [10077.914274] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 08:11:43 juju-e4d256-prod-github-runner-207 kernel: [10077.915077] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:11:43 juju-e4d256-prod-github-runner-207 kernel: [10077.915832] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:11:43 juju-e4d256-prod-github-runner-207 kernel: [10077.916604] ? do_syscall_64+0x69/0xc0 Aug 22 08:11:43 juju-e4d256-prod-github-runner-207 kernel: [10077.917324] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:11:43 juju-e4d256-prod-github-runner-207 kernel: [10077.918082] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:11:43 juju-e4d256-prod-github-runner-207 kernel: [10077.918836] ? do_syscall_64+0x69/0xc0 Aug 22 08:11:43 juju-e4d256-prod-github-runner-207 kernel: [10077.919537] ? do_syscall_64+0x69/0xc0 Aug 22 08:11:43 juju-e4d256-prod-github-runner-207 kernel: [10077.920235] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 08:11:43 juju-e4d256-prod-github-runner-207 kernel: [10077.921032] RIP: 0033:0x7faa5d0edaff Aug 22 08:11:43 juju-e4d256-prod-github-runner-207 kernel: [10077.921721] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 08:11:43 juju-e4d256-prod-github-runner-207 kernel: [10077.923850] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 08:11:43 juju-e4d256-prod-github-runner-207 kernel: [10077.924846] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 08:11:43 juju-e4d256-prod-github-runner-207 kernel: [10077.925801] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 08:11:43 juju-e4d256-prod-github-runner-207 kernel: [10077.926761] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 08:11:43 juju-e4d256-prod-github-runner-207 kernel: [10077.927715] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 08:11:43 juju-e4d256-prod-github-runner-207 kernel: [10077.928682] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 08:11:43 juju-e4d256-prod-github-runner-207 kernel: [10077.929656] Aug 22 08:12:10 juju-e4d256-prod-github-runner-207 kernel: [10104.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 9302s! [qemu-system-x86:6715] Aug 22 08:12:10 juju-e4d256-prod-github-runner-207 kernel: [10104.543324] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 08:12:10 juju-e4d256-prod-github-runner-207 kernel: [10104.543397] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 08:12:10 juju-e4d256-prod-github-runner-207 kernel: [10104.556095] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 08:12:10 juju-e4d256-prod-github-runner-207 kernel: [10104.557377] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 08:12:10 juju-e4d256-prod-github-runner-207 kernel: [10104.558600] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:12:10 juju-e4d256-prod-github-runner-207 kernel: [10104.559660] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 08:12:10 juju-e4d256-prod-github-runner-207 kernel: [10104.562376] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 08:12:10 juju-e4d256-prod-github-runner-207 kernel: [10104.563465] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 08:12:10 juju-e4d256-prod-github-runner-207 kernel: [10104.564659] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 08:12:10 juju-e4d256-prod-github-runner-207 kernel: [10104.565830] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 08:12:10 juju-e4d256-prod-github-runner-207 kernel: [10104.567041] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 08:12:10 juju-e4d256-prod-github-runner-207 kernel: [10104.568216] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 08:12:10 juju-e4d256-prod-github-runner-207 kernel: [10104.569556] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 08:12:10 juju-e4d256-prod-github-runner-207 kernel: [10104.571185] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 08:12:10 juju-e4d256-prod-github-runner-207 kernel: [10104.572492] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 08:12:10 juju-e4d256-prod-github-runner-207 kernel: [10104.573985] Call Trace: Aug 22 08:12:10 juju-e4d256-prod-github-runner-207 kernel: [10104.574995] Aug 22 08:12:10 juju-e4d256-prod-github-runner-207 kernel: [10104.575908] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:12:10 juju-e4d256-prod-github-runner-207 kernel: [10104.576975] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:12:10 juju-e4d256-prod-github-runner-207 kernel: [10104.578038] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:12:10 juju-e4d256-prod-github-runner-207 kernel: [10104.579272] ? show_regs.part.0+0x23/0x29 Aug 22 08:12:10 juju-e4d256-prod-github-runner-207 kernel: [10104.580332] ? show_regs.cold+0x8/0xd Aug 22 08:12:10 juju-e4d256-prod-github-runner-207 kernel: [10104.581420] ? watchdog_timer_fn+0x1be/0x220 Aug 22 08:12:10 juju-e4d256-prod-github-runner-207 kernel: [10104.582471] ? lockup_detector_update_enable+0x60/0x60 Aug 22 08:12:10 juju-e4d256-prod-github-runner-207 kernel: [10104.583539] ? __hrtimer_run_queues+0x107/0x230 Aug 22 08:12:10 juju-e4d256-prod-github-runner-207 kernel: [10104.584599] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 08:12:10 juju-e4d256-prod-github-runner-207 kernel: [10104.585665] ? hrtimer_interrupt+0x101/0x220 Aug 22 08:12:10 juju-e4d256-prod-github-runner-207 kernel: [10104.586712] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 08:12:10 juju-e4d256-prod-github-runner-207 kernel: [10104.587798] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 08:12:10 juju-e4d256-prod-github-runner-207 kernel: [10104.588863] Aug 22 08:12:10 juju-e4d256-prod-github-runner-207 kernel: [10104.589854] Aug 22 08:12:10 juju-e4d256-prod-github-runner-207 kernel: [10104.590771] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 08:12:10 juju-e4d256-prod-github-runner-207 kernel: [10104.591891] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:12:10 juju-e4d256-prod-github-runner-207 kernel: [10104.592998] ? _raw_spin_lock+0x22/0x30 Aug 22 08:12:10 juju-e4d256-prod-github-runner-207 kernel: [10104.593966] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:12:10 juju-e4d256-prod-github-runner-207 kernel: [10104.595000] direct_page_fault+0x206/0x310 [kvm] Aug 22 08:12:10 juju-e4d256-prod-github-runner-207 kernel: [10104.596045] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 08:12:10 juju-e4d256-prod-github-runner-207 kernel: [10104.597088] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 08:12:10 juju-e4d256-prod-github-runner-207 kernel: [10104.598098] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 08:12:10 juju-e4d256-prod-github-runner-207 kernel: [10104.599073] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 08:12:10 juju-e4d256-prod-github-runner-207 kernel: [10104.600195] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 08:12:10 juju-e4d256-prod-github-runner-207 kernel: [10104.601279] handle_exit+0x98/0x230 [kvm_amd] Aug 22 08:12:10 juju-e4d256-prod-github-runner-207 kernel: [10104.602226] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 08:12:10 juju-e4d256-prod-github-runner-207 kernel: [10104.603151] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 08:12:10 juju-e4d256-prod-github-runner-207 kernel: [10104.604080] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 08:12:10 juju-e4d256-prod-github-runner-207 kernel: [10104.605002] vcpu_run+0x62/0x2c0 [kvm] Aug 22 08:12:10 juju-e4d256-prod-github-runner-207 kernel: [10104.605821] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 08:12:10 juju-e4d256-prod-github-runner-207 kernel: [10104.606664] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 08:12:10 juju-e4d256-prod-github-runner-207 kernel: [10104.607649] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 08:12:10 juju-e4d256-prod-github-runner-207 kernel: [10104.608541] ? __seccomp_filter+0x4a/0x4a0 Aug 22 08:12:10 juju-e4d256-prod-github-runner-207 kernel: [10104.609331] ? __fget_files+0x86/0xc0 Aug 22 08:12:10 juju-e4d256-prod-github-runner-207 kernel: [10104.610050] __x64_sys_ioctl+0x95/0xd0 Aug 22 08:12:10 juju-e4d256-prod-github-runner-207 kernel: [10104.610754] do_syscall_64+0x5c/0xc0 Aug 22 08:12:10 juju-e4d256-prod-github-runner-207 kernel: [10104.611461] ? do_futex+0x162/0x1f0 Aug 22 08:12:10 juju-e4d256-prod-github-runner-207 kernel: [10104.612120] ? __x64_sys_futex+0x78/0x1e0 Aug 22 08:12:10 juju-e4d256-prod-github-runner-207 kernel: [10104.612814] ? __secure_computing+0xa9/0x120 Aug 22 08:12:10 juju-e4d256-prod-github-runner-207 kernel: [10104.613510] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 08:12:10 juju-e4d256-prod-github-runner-207 kernel: [10104.614292] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:12:10 juju-e4d256-prod-github-runner-207 kernel: [10104.615027] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:12:10 juju-e4d256-prod-github-runner-207 kernel: [10104.615970] ? do_syscall_64+0x69/0xc0 Aug 22 08:12:10 juju-e4d256-prod-github-runner-207 kernel: [10104.616664] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:12:10 juju-e4d256-prod-github-runner-207 kernel: [10104.617375] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:12:10 juju-e4d256-prod-github-runner-207 kernel: [10104.618070] ? do_syscall_64+0x69/0xc0 Aug 22 08:12:10 juju-e4d256-prod-github-runner-207 kernel: [10104.618712] ? do_syscall_64+0x69/0xc0 Aug 22 08:12:10 juju-e4d256-prod-github-runner-207 kernel: [10104.619335] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 08:12:10 juju-e4d256-prod-github-runner-207 kernel: [10104.620041] RIP: 0033:0x7faa5d0edaff Aug 22 08:12:10 juju-e4d256-prod-github-runner-207 kernel: [10104.620674] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 08:12:10 juju-e4d256-prod-github-runner-207 kernel: [10104.622669] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 08:12:10 juju-e4d256-prod-github-runner-207 kernel: [10104.623588] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 08:12:10 juju-e4d256-prod-github-runner-207 kernel: [10104.624519] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 08:12:10 juju-e4d256-prod-github-runner-207 kernel: [10104.625447] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 08:12:10 juju-e4d256-prod-github-runner-207 kernel: [10104.626514] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 08:12:10 juju-e4d256-prod-github-runner-207 kernel: [10104.627584] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 08:12:10 juju-e4d256-prod-github-runner-207 kernel: [10104.628557] Aug 22 08:12:38 juju-e4d256-prod-github-runner-207 kernel: [10132.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 9328s! [qemu-system-x86:6715] Aug 22 08:12:38 juju-e4d256-prod-github-runner-207 kernel: [10132.543106] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 08:12:38 juju-e4d256-prod-github-runner-207 kernel: [10132.543178] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 08:12:38 juju-e4d256-prod-github-runner-207 kernel: [10132.555434] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 08:12:38 juju-e4d256-prod-github-runner-207 kernel: [10132.556717] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 08:12:38 juju-e4d256-prod-github-runner-207 kernel: [10132.557941] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:12:38 juju-e4d256-prod-github-runner-207 kernel: [10132.559068] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 08:12:38 juju-e4d256-prod-github-runner-207 kernel: [10132.561673] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 08:12:38 juju-e4d256-prod-github-runner-207 kernel: [10132.562737] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 08:12:38 juju-e4d256-prod-github-runner-207 kernel: [10132.563949] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 08:12:38 juju-e4d256-prod-github-runner-207 kernel: [10132.565151] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 08:12:38 juju-e4d256-prod-github-runner-207 kernel: [10132.566338] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 08:12:38 juju-e4d256-prod-github-runner-207 kernel: [10132.567537] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 08:12:38 juju-e4d256-prod-github-runner-207 kernel: [10132.568731] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 08:12:38 juju-e4d256-prod-github-runner-207 kernel: [10132.569996] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 08:12:38 juju-e4d256-prod-github-runner-207 kernel: [10132.571136] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 08:12:38 juju-e4d256-prod-github-runner-207 kernel: [10132.572373] Call Trace: Aug 22 08:12:38 juju-e4d256-prod-github-runner-207 kernel: [10132.573296] Aug 22 08:12:38 juju-e4d256-prod-github-runner-207 kernel: [10132.574185] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:12:38 juju-e4d256-prod-github-runner-207 kernel: [10132.575271] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:12:38 juju-e4d256-prod-github-runner-207 kernel: [10132.576340] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:12:38 juju-e4d256-prod-github-runner-207 kernel: [10132.577433] ? show_regs.part.0+0x23/0x29 Aug 22 08:12:38 juju-e4d256-prod-github-runner-207 kernel: [10132.578462] ? show_regs.cold+0x8/0xd Aug 22 08:12:38 juju-e4d256-prod-github-runner-207 kernel: [10132.579489] ? watchdog_timer_fn+0x1be/0x220 Aug 22 08:12:38 juju-e4d256-prod-github-runner-207 kernel: [10132.580518] ? lockup_detector_update_enable+0x60/0x60 Aug 22 08:12:38 juju-e4d256-prod-github-runner-207 kernel: [10132.581591] ? __hrtimer_run_queues+0x107/0x230 Aug 22 08:12:38 juju-e4d256-prod-github-runner-207 kernel: [10132.582668] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 08:12:38 juju-e4d256-prod-github-runner-207 kernel: [10132.583704] ? hrtimer_interrupt+0x101/0x220 Aug 22 08:12:38 juju-e4d256-prod-github-runner-207 kernel: [10132.584740] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 08:12:38 juju-e4d256-prod-github-runner-207 kernel: [10132.585860] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 08:12:38 juju-e4d256-prod-github-runner-207 kernel: [10132.586913] Aug 22 08:12:38 juju-e4d256-prod-github-runner-207 kernel: [10132.587801] Aug 22 08:12:38 juju-e4d256-prod-github-runner-207 kernel: [10132.588696] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 08:12:38 juju-e4d256-prod-github-runner-207 kernel: [10132.589748] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:12:38 juju-e4d256-prod-github-runner-207 kernel: [10132.590793] ? _raw_spin_lock+0x22/0x30 Aug 22 08:12:38 juju-e4d256-prod-github-runner-207 kernel: [10132.591741] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:12:38 juju-e4d256-prod-github-runner-207 kernel: [10132.592785] direct_page_fault+0x206/0x310 [kvm] Aug 22 08:12:38 juju-e4d256-prod-github-runner-207 kernel: [10132.593834] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 08:12:38 juju-e4d256-prod-github-runner-207 kernel: [10132.594914] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 08:12:38 juju-e4d256-prod-github-runner-207 kernel: [10132.595949] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 08:12:38 juju-e4d256-prod-github-runner-207 kernel: [10132.597002] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 08:12:38 juju-e4d256-prod-github-runner-207 kernel: [10132.597953] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 08:12:38 juju-e4d256-prod-github-runner-207 kernel: [10132.598938] handle_exit+0x98/0x230 [kvm_amd] Aug 22 08:12:38 juju-e4d256-prod-github-runner-207 kernel: [10132.599895] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 08:12:38 juju-e4d256-prod-github-runner-207 kernel: [10132.600929] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 08:12:38 juju-e4d256-prod-github-runner-207 kernel: [10132.601860] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 08:12:38 juju-e4d256-prod-github-runner-207 kernel: [10132.602825] vcpu_run+0x62/0x2c0 [kvm] Aug 22 08:12:38 juju-e4d256-prod-github-runner-207 kernel: [10132.603654] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 08:12:38 juju-e4d256-prod-github-runner-207 kernel: [10132.604483] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 08:12:38 juju-e4d256-prod-github-runner-207 kernel: [10132.605355] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 08:12:38 juju-e4d256-prod-github-runner-207 kernel: [10132.606183] ? __seccomp_filter+0x4a/0x4a0 Aug 22 08:12:38 juju-e4d256-prod-github-runner-207 kernel: [10132.606973] ? __fget_files+0x86/0xc0 Aug 22 08:12:38 juju-e4d256-prod-github-runner-207 kernel: [10132.607690] __x64_sys_ioctl+0x95/0xd0 Aug 22 08:12:38 juju-e4d256-prod-github-runner-207 kernel: [10132.608417] do_syscall_64+0x5c/0xc0 Aug 22 08:12:38 juju-e4d256-prod-github-runner-207 kernel: [10132.609124] ? do_futex+0x162/0x1f0 Aug 22 08:12:38 juju-e4d256-prod-github-runner-207 kernel: [10132.609782] ? __x64_sys_futex+0x78/0x1e0 Aug 22 08:12:38 juju-e4d256-prod-github-runner-207 kernel: [10132.610460] ? __secure_computing+0xa9/0x120 Aug 22 08:12:38 juju-e4d256-prod-github-runner-207 kernel: [10132.611156] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 08:12:38 juju-e4d256-prod-github-runner-207 kernel: [10132.611944] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:12:38 juju-e4d256-prod-github-runner-207 kernel: [10132.612714] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:12:38 juju-e4d256-prod-github-runner-207 kernel: [10132.613624] ? do_syscall_64+0x69/0xc0 Aug 22 08:12:38 juju-e4d256-prod-github-runner-207 kernel: [10132.614290] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:12:38 juju-e4d256-prod-github-runner-207 kernel: [10132.615026] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:12:38 juju-e4d256-prod-github-runner-207 kernel: [10132.615727] ? do_syscall_64+0x69/0xc0 Aug 22 08:12:38 juju-e4d256-prod-github-runner-207 kernel: [10132.616367] ? do_syscall_64+0x69/0xc0 Aug 22 08:12:38 juju-e4d256-prod-github-runner-207 kernel: [10132.617020] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 08:12:38 juju-e4d256-prod-github-runner-207 kernel: [10132.617754] RIP: 0033:0x7faa5d0edaff Aug 22 08:12:38 juju-e4d256-prod-github-runner-207 kernel: [10132.618386] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 08:12:38 juju-e4d256-prod-github-runner-207 kernel: [10132.620467] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 08:12:38 juju-e4d256-prod-github-runner-207 kernel: [10132.621406] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 08:12:38 juju-e4d256-prod-github-runner-207 kernel: [10132.622306] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 08:12:38 juju-e4d256-prod-github-runner-207 kernel: [10132.623236] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 08:12:38 juju-e4d256-prod-github-runner-207 kernel: [10132.624172] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 08:12:38 juju-e4d256-prod-github-runner-207 kernel: [10132.625098] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 08:12:38 juju-e4d256-prod-github-runner-207 kernel: [10132.626052] Aug 22 08:13:06 juju-e4d256-prod-github-runner-207 kernel: [10160.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 9354s! [qemu-system-x86:6715] Aug 22 08:13:06 juju-e4d256-prod-github-runner-207 kernel: [10160.543816] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 08:13:06 juju-e4d256-prod-github-runner-207 kernel: [10160.544097] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 08:13:06 juju-e4d256-prod-github-runner-207 kernel: [10160.556887] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 08:13:06 juju-e4d256-prod-github-runner-207 kernel: [10160.558170] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 08:13:06 juju-e4d256-prod-github-runner-207 kernel: [10160.559509] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:13:06 juju-e4d256-prod-github-runner-207 kernel: [10160.560804] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 08:13:06 juju-e4d256-prod-github-runner-207 kernel: [10160.563448] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 08:13:06 juju-e4d256-prod-github-runner-207 kernel: [10160.564532] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 08:13:06 juju-e4d256-prod-github-runner-207 kernel: [10160.565699] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 08:13:06 juju-e4d256-prod-github-runner-207 kernel: [10160.566924] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 08:13:06 juju-e4d256-prod-github-runner-207 kernel: [10160.568138] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 08:13:06 juju-e4d256-prod-github-runner-207 kernel: [10160.569335] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 08:13:06 juju-e4d256-prod-github-runner-207 kernel: [10160.570584] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 08:13:06 juju-e4d256-prod-github-runner-207 kernel: [10160.571884] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 08:13:06 juju-e4d256-prod-github-runner-207 kernel: [10160.573039] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 08:13:06 juju-e4d256-prod-github-runner-207 kernel: [10160.574256] Call Trace: Aug 22 08:13:06 juju-e4d256-prod-github-runner-207 kernel: [10160.575219] Aug 22 08:13:06 juju-e4d256-prod-github-runner-207 kernel: [10160.576179] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:13:06 juju-e4d256-prod-github-runner-207 kernel: [10160.577294] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:13:06 juju-e4d256-prod-github-runner-207 kernel: [10160.578317] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:13:06 juju-e4d256-prod-github-runner-207 kernel: [10160.579420] ? show_regs.part.0+0x23/0x29 Aug 22 08:13:06 juju-e4d256-prod-github-runner-207 kernel: [10160.580440] ? show_regs.cold+0x8/0xd Aug 22 08:13:06 juju-e4d256-prod-github-runner-207 kernel: [10160.581413] ? watchdog_timer_fn+0x1be/0x220 Aug 22 08:13:06 juju-e4d256-prod-github-runner-207 kernel: [10160.582416] ? lockup_detector_update_enable+0x60/0x60 Aug 22 08:13:06 juju-e4d256-prod-github-runner-207 kernel: [10160.583477] ? __hrtimer_run_queues+0x107/0x230 Aug 22 08:13:06 juju-e4d256-prod-github-runner-207 kernel: [10160.584532] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 08:13:06 juju-e4d256-prod-github-runner-207 kernel: [10160.585553] ? hrtimer_interrupt+0x101/0x220 Aug 22 08:13:06 juju-e4d256-prod-github-runner-207 kernel: [10160.586565] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 08:13:06 juju-e4d256-prod-github-runner-207 kernel: [10160.587635] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 08:13:06 juju-e4d256-prod-github-runner-207 kernel: [10160.588683] Aug 22 08:13:06 juju-e4d256-prod-github-runner-207 kernel: [10160.589538] Aug 22 08:13:06 juju-e4d256-prod-github-runner-207 kernel: [10160.590376] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 08:13:06 juju-e4d256-prod-github-runner-207 kernel: [10160.591405] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:13:06 juju-e4d256-prod-github-runner-207 kernel: [10160.592465] ? _raw_spin_lock+0x22/0x30 Aug 22 08:13:06 juju-e4d256-prod-github-runner-207 kernel: [10160.593429] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:13:06 juju-e4d256-prod-github-runner-207 kernel: [10160.594446] direct_page_fault+0x206/0x310 [kvm] Aug 22 08:13:06 juju-e4d256-prod-github-runner-207 kernel: [10160.595466] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 08:13:06 juju-e4d256-prod-github-runner-207 kernel: [10160.596485] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 08:13:06 juju-e4d256-prod-github-runner-207 kernel: [10160.597483] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 08:13:06 juju-e4d256-prod-github-runner-207 kernel: [10160.598487] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 08:13:06 juju-e4d256-prod-github-runner-207 kernel: [10160.599433] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 08:13:06 juju-e4d256-prod-github-runner-207 kernel: [10160.600435] handle_exit+0x98/0x230 [kvm_amd] Aug 22 08:13:06 juju-e4d256-prod-github-runner-207 kernel: [10160.601326] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 08:13:06 juju-e4d256-prod-github-runner-207 kernel: [10160.602239] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 08:13:06 juju-e4d256-prod-github-runner-207 kernel: [10160.603161] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 08:13:06 juju-e4d256-prod-github-runner-207 kernel: [10160.604073] vcpu_run+0x62/0x2c0 [kvm] Aug 22 08:13:06 juju-e4d256-prod-github-runner-207 kernel: [10160.604881] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 08:13:06 juju-e4d256-prod-github-runner-207 kernel: [10160.605690] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 08:13:06 juju-e4d256-prod-github-runner-207 kernel: [10160.606540] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 08:13:06 juju-e4d256-prod-github-runner-207 kernel: [10160.607337] ? __seccomp_filter+0x4a/0x4a0 Aug 22 08:13:06 juju-e4d256-prod-github-runner-207 kernel: [10160.608085] ? __fget_files+0x86/0xc0 Aug 22 08:13:06 juju-e4d256-prod-github-runner-207 kernel: [10160.608787] __x64_sys_ioctl+0x95/0xd0 Aug 22 08:13:06 juju-e4d256-prod-github-runner-207 kernel: [10160.609477] do_syscall_64+0x5c/0xc0 Aug 22 08:13:06 juju-e4d256-prod-github-runner-207 kernel: [10160.610136] ? do_futex+0x162/0x1f0 Aug 22 08:13:06 juju-e4d256-prod-github-runner-207 kernel: [10160.610782] ? __x64_sys_futex+0x78/0x1e0 Aug 22 08:13:06 juju-e4d256-prod-github-runner-207 kernel: [10160.611451] ? __secure_computing+0xa9/0x120 Aug 22 08:13:06 juju-e4d256-prod-github-runner-207 kernel: [10160.612145] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 08:13:06 juju-e4d256-prod-github-runner-207 kernel: [10160.612901] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:13:06 juju-e4d256-prod-github-runner-207 kernel: [10160.613619] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:13:06 juju-e4d256-prod-github-runner-207 kernel: [10160.614354] ? do_syscall_64+0x69/0xc0 Aug 22 08:13:06 juju-e4d256-prod-github-runner-207 kernel: [10160.615008] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:13:06 juju-e4d256-prod-github-runner-207 kernel: [10160.615716] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:13:06 juju-e4d256-prod-github-runner-207 kernel: [10160.616406] ? do_syscall_64+0x69/0xc0 Aug 22 08:13:06 juju-e4d256-prod-github-runner-207 kernel: [10160.617027] ? do_syscall_64+0x69/0xc0 Aug 22 08:13:06 juju-e4d256-prod-github-runner-207 kernel: [10160.617644] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 08:13:06 juju-e4d256-prod-github-runner-207 kernel: [10160.618342] RIP: 0033:0x7faa5d0edaff Aug 22 08:13:06 juju-e4d256-prod-github-runner-207 kernel: [10160.618988] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 08:13:06 juju-e4d256-prod-github-runner-207 kernel: [10160.620977] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 08:13:06 juju-e4d256-prod-github-runner-207 kernel: [10160.621886] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 08:13:06 juju-e4d256-prod-github-runner-207 kernel: [10160.622770] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 08:13:06 juju-e4d256-prod-github-runner-207 kernel: [10160.623652] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 08:13:06 juju-e4d256-prod-github-runner-207 kernel: [10160.624548] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 08:13:06 juju-e4d256-prod-github-runner-207 kernel: [10160.625432] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 08:13:06 juju-e4d256-prod-github-runner-207 kernel: [10160.626322] Aug 22 08:13:34 juju-e4d256-prod-github-runner-207 kernel: [10188.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 9380s! [qemu-system-x86:6715] Aug 22 08:13:34 juju-e4d256-prod-github-runner-207 kernel: [10188.543120] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 08:13:34 juju-e4d256-prod-github-runner-207 kernel: [10188.543199] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 08:13:34 juju-e4d256-prod-github-runner-207 kernel: [10188.556439] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 08:13:34 juju-e4d256-prod-github-runner-207 kernel: [10188.557734] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 08:13:34 juju-e4d256-prod-github-runner-207 kernel: [10188.558994] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:13:34 juju-e4d256-prod-github-runner-207 kernel: [10188.560084] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 08:13:34 juju-e4d256-prod-github-runner-207 kernel: [10188.562683] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 08:13:34 juju-e4d256-prod-github-runner-207 kernel: [10188.563758] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 08:13:34 juju-e4d256-prod-github-runner-207 kernel: [10188.564943] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 08:13:34 juju-e4d256-prod-github-runner-207 kernel: [10188.566123] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 08:13:34 juju-e4d256-prod-github-runner-207 kernel: [10188.567306] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 08:13:34 juju-e4d256-prod-github-runner-207 kernel: [10188.568500] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 08:13:34 juju-e4d256-prod-github-runner-207 kernel: [10188.569682] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 08:13:34 juju-e4d256-prod-github-runner-207 kernel: [10188.570939] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 08:13:34 juju-e4d256-prod-github-runner-207 kernel: [10188.572064] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 08:13:34 juju-e4d256-prod-github-runner-207 kernel: [10188.573277] Call Trace: Aug 22 08:13:34 juju-e4d256-prod-github-runner-207 kernel: [10188.574197] Aug 22 08:13:34 juju-e4d256-prod-github-runner-207 kernel: [10188.575087] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:13:34 juju-e4d256-prod-github-runner-207 kernel: [10188.576143] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:13:34 juju-e4d256-prod-github-runner-207 kernel: [10188.577185] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:13:34 juju-e4d256-prod-github-runner-207 kernel: [10188.578286] ? show_regs.part.0+0x23/0x29 Aug 22 08:13:34 juju-e4d256-prod-github-runner-207 kernel: [10188.579291] ? show_regs.cold+0x8/0xd Aug 22 08:13:34 juju-e4d256-prod-github-runner-207 kernel: [10188.580287] ? watchdog_timer_fn+0x1be/0x220 Aug 22 08:13:34 juju-e4d256-prod-github-runner-207 kernel: [10188.581307] ? lockup_detector_update_enable+0x60/0x60 Aug 22 08:13:34 juju-e4d256-prod-github-runner-207 kernel: [10188.582382] ? __hrtimer_run_queues+0x107/0x230 Aug 22 08:13:34 juju-e4d256-prod-github-runner-207 kernel: [10188.583448] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 08:13:34 juju-e4d256-prod-github-runner-207 kernel: [10188.584492] ? hrtimer_interrupt+0x101/0x220 Aug 22 08:13:34 juju-e4d256-prod-github-runner-207 kernel: [10188.585521] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 08:13:34 juju-e4d256-prod-github-runner-207 kernel: [10188.586610] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 08:13:34 juju-e4d256-prod-github-runner-207 kernel: [10188.587682] Aug 22 08:13:34 juju-e4d256-prod-github-runner-207 kernel: [10188.588549] Aug 22 08:13:34 juju-e4d256-prod-github-runner-207 kernel: [10188.589406] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 08:13:34 juju-e4d256-prod-github-runner-207 kernel: [10188.590451] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:13:34 juju-e4d256-prod-github-runner-207 kernel: [10188.591520] ? _raw_spin_lock+0x22/0x30 Aug 22 08:13:34 juju-e4d256-prod-github-runner-207 kernel: [10188.592474] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:13:34 juju-e4d256-prod-github-runner-207 kernel: [10188.593497] direct_page_fault+0x206/0x310 [kvm] Aug 22 08:13:34 juju-e4d256-prod-github-runner-207 kernel: [10188.594524] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 08:13:34 juju-e4d256-prod-github-runner-207 kernel: [10188.595562] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 08:13:34 juju-e4d256-prod-github-runner-207 kernel: [10188.596573] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 08:13:34 juju-e4d256-prod-github-runner-207 kernel: [10188.597557] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 08:13:34 juju-e4d256-prod-github-runner-207 kernel: [10188.598508] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 08:13:34 juju-e4d256-prod-github-runner-207 kernel: [10188.599508] handle_exit+0x98/0x230 [kvm_amd] Aug 22 08:13:34 juju-e4d256-prod-github-runner-207 kernel: [10188.600408] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 08:13:34 juju-e4d256-prod-github-runner-207 kernel: [10188.601329] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 08:13:34 juju-e4d256-prod-github-runner-207 kernel: [10188.602273] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 08:13:34 juju-e4d256-prod-github-runner-207 kernel: [10188.603184] vcpu_run+0x62/0x2c0 [kvm] Aug 22 08:13:34 juju-e4d256-prod-github-runner-207 kernel: [10188.604011] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 08:13:34 juju-e4d256-prod-github-runner-207 kernel: [10188.604832] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 08:13:34 juju-e4d256-prod-github-runner-207 kernel: [10188.605700] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 08:13:34 juju-e4d256-prod-github-runner-207 kernel: [10188.606503] ? __seccomp_filter+0x4a/0x4a0 Aug 22 08:13:34 juju-e4d256-prod-github-runner-207 kernel: [10188.607253] ? __fget_files+0x86/0xc0 Aug 22 08:13:34 juju-e4d256-prod-github-runner-207 kernel: [10188.607972] __x64_sys_ioctl+0x95/0xd0 Aug 22 08:13:34 juju-e4d256-prod-github-runner-207 kernel: [10188.608674] do_syscall_64+0x5c/0xc0 Aug 22 08:13:34 juju-e4d256-prod-github-runner-207 kernel: [10188.609346] ? do_futex+0x162/0x1f0 Aug 22 08:13:34 juju-e4d256-prod-github-runner-207 kernel: [10188.609999] ? __x64_sys_futex+0x78/0x1e0 Aug 22 08:13:34 juju-e4d256-prod-github-runner-207 kernel: [10188.610680] ? __secure_computing+0xa9/0x120 Aug 22 08:13:34 juju-e4d256-prod-github-runner-207 kernel: [10188.611433] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 08:13:34 juju-e4d256-prod-github-runner-207 kernel: [10188.612208] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:13:34 juju-e4d256-prod-github-runner-207 kernel: [10188.612938] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:13:34 juju-e4d256-prod-github-runner-207 kernel: [10188.613676] ? do_syscall_64+0x69/0xc0 Aug 22 08:13:34 juju-e4d256-prod-github-runner-207 kernel: [10188.614365] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:13:34 juju-e4d256-prod-github-runner-207 kernel: [10188.615081] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:13:34 juju-e4d256-prod-github-runner-207 kernel: [10188.615801] ? do_syscall_64+0x69/0xc0 Aug 22 08:13:34 juju-e4d256-prod-github-runner-207 kernel: [10188.616434] ? do_syscall_64+0x69/0xc0 Aug 22 08:13:34 juju-e4d256-prod-github-runner-207 kernel: [10188.617076] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 08:13:34 juju-e4d256-prod-github-runner-207 kernel: [10188.617793] RIP: 0033:0x7faa5d0edaff Aug 22 08:13:34 juju-e4d256-prod-github-runner-207 kernel: [10188.618432] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 08:13:34 juju-e4d256-prod-github-runner-207 kernel: [10188.620483] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 08:13:34 juju-e4d256-prod-github-runner-207 kernel: [10188.621446] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 08:13:34 juju-e4d256-prod-github-runner-207 kernel: [10188.622353] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 08:13:34 juju-e4d256-prod-github-runner-207 kernel: [10188.623261] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 08:13:34 juju-e4d256-prod-github-runner-207 kernel: [10188.624172] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 08:13:34 juju-e4d256-prod-github-runner-207 kernel: [10188.625076] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 08:13:34 juju-e4d256-prod-github-runner-207 kernel: [10188.625985] Aug 22 08:14:02 juju-e4d256-prod-github-runner-207 kernel: [10216.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 9406s! [qemu-system-x86:6715] Aug 22 08:14:02 juju-e4d256-prod-github-runner-207 kernel: [10216.543183] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 08:14:02 juju-e4d256-prod-github-runner-207 kernel: [10216.543259] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 08:14:02 juju-e4d256-prod-github-runner-207 kernel: [10216.555864] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 08:14:02 juju-e4d256-prod-github-runner-207 kernel: [10216.557159] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 08:14:02 juju-e4d256-prod-github-runner-207 kernel: [10216.558402] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:14:02 juju-e4d256-prod-github-runner-207 kernel: [10216.559510] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 08:14:02 juju-e4d256-prod-github-runner-207 kernel: [10216.562151] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 08:14:02 juju-e4d256-prod-github-runner-207 kernel: [10216.563232] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 08:14:02 juju-e4d256-prod-github-runner-207 kernel: [10216.564443] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 08:14:02 juju-e4d256-prod-github-runner-207 kernel: [10216.565635] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 08:14:02 juju-e4d256-prod-github-runner-207 kernel: [10216.566877] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 08:14:02 juju-e4d256-prod-github-runner-207 kernel: [10216.568113] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 08:14:02 juju-e4d256-prod-github-runner-207 kernel: [10216.569366] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 08:14:02 juju-e4d256-prod-github-runner-207 kernel: [10216.570639] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 08:14:02 juju-e4d256-prod-github-runner-207 kernel: [10216.571808] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 08:14:02 juju-e4d256-prod-github-runner-207 kernel: [10216.573070] Call Trace: Aug 22 08:14:02 juju-e4d256-prod-github-runner-207 kernel: [10216.574004] Aug 22 08:14:02 juju-e4d256-prod-github-runner-207 kernel: [10216.574995] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:14:02 juju-e4d256-prod-github-runner-207 kernel: [10216.576237] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:14:02 juju-e4d256-prod-github-runner-207 kernel: [10216.577289] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:14:02 juju-e4d256-prod-github-runner-207 kernel: [10216.578367] ? show_regs.part.0+0x23/0x29 Aug 22 08:14:02 juju-e4d256-prod-github-runner-207 kernel: [10216.579372] ? show_regs.cold+0x8/0xd Aug 22 08:14:02 juju-e4d256-prod-github-runner-207 kernel: [10216.580551] ? watchdog_timer_fn+0x1be/0x220 Aug 22 08:14:02 juju-e4d256-prod-github-runner-207 kernel: [10216.581575] ? lockup_detector_update_enable+0x60/0x60 Aug 22 08:14:02 juju-e4d256-prod-github-runner-207 kernel: [10216.582657] ? __hrtimer_run_queues+0x107/0x230 Aug 22 08:14:02 juju-e4d256-prod-github-runner-207 kernel: [10216.583803] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 08:14:02 juju-e4d256-prod-github-runner-207 kernel: [10216.584849] ? hrtimer_interrupt+0x101/0x220 Aug 22 08:14:02 juju-e4d256-prod-github-runner-207 kernel: [10216.585865] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 08:14:02 juju-e4d256-prod-github-runner-207 kernel: [10216.586943] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 08:14:02 juju-e4d256-prod-github-runner-207 kernel: [10216.588066] Aug 22 08:14:02 juju-e4d256-prod-github-runner-207 kernel: [10216.588926] Aug 22 08:14:02 juju-e4d256-prod-github-runner-207 kernel: [10216.589767] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 08:14:02 juju-e4d256-prod-github-runner-207 kernel: [10216.590889] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:14:02 juju-e4d256-prod-github-runner-207 kernel: [10216.591980] ? _raw_spin_lock+0x22/0x30 Aug 22 08:14:02 juju-e4d256-prod-github-runner-207 kernel: [10216.592939] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:14:02 juju-e4d256-prod-github-runner-207 kernel: [10216.593969] direct_page_fault+0x206/0x310 [kvm] Aug 22 08:14:02 juju-e4d256-prod-github-runner-207 kernel: [10216.595009] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 08:14:02 juju-e4d256-prod-github-runner-207 kernel: [10216.596028] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 08:14:02 juju-e4d256-prod-github-runner-207 kernel: [10216.597049] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 08:14:02 juju-e4d256-prod-github-runner-207 kernel: [10216.598030] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 08:14:02 juju-e4d256-prod-github-runner-207 kernel: [10216.599007] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 08:14:02 juju-e4d256-prod-github-runner-207 kernel: [10216.600167] handle_exit+0x98/0x230 [kvm_amd] Aug 22 08:14:02 juju-e4d256-prod-github-runner-207 kernel: [10216.601099] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 08:14:02 juju-e4d256-prod-github-runner-207 kernel: [10216.602014] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 08:14:02 juju-e4d256-prod-github-runner-207 kernel: [10216.602952] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 08:14:02 juju-e4d256-prod-github-runner-207 kernel: [10216.604078] vcpu_run+0x62/0x2c0 [kvm] Aug 22 08:14:02 juju-e4d256-prod-github-runner-207 kernel: [10216.604891] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 08:14:02 juju-e4d256-prod-github-runner-207 kernel: [10216.605712] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 08:14:02 juju-e4d256-prod-github-runner-207 kernel: [10216.606575] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 08:14:02 juju-e4d256-prod-github-runner-207 kernel: [10216.607384] ? __seccomp_filter+0x4a/0x4a0 Aug 22 08:14:02 juju-e4d256-prod-github-runner-207 kernel: [10216.608311] ? __fget_files+0x86/0xc0 Aug 22 08:14:02 juju-e4d256-prod-github-runner-207 kernel: [10216.609019] __x64_sys_ioctl+0x95/0xd0 Aug 22 08:14:02 juju-e4d256-prod-github-runner-207 kernel: [10216.609711] do_syscall_64+0x5c/0xc0 Aug 22 08:14:02 juju-e4d256-prod-github-runner-207 kernel: [10216.610373] ? do_futex+0x162/0x1f0 Aug 22 08:14:02 juju-e4d256-prod-github-runner-207 kernel: [10216.611034] ? __x64_sys_futex+0x78/0x1e0 Aug 22 08:14:02 juju-e4d256-prod-github-runner-207 kernel: [10216.611718] ? __secure_computing+0xa9/0x120 Aug 22 08:14:02 juju-e4d256-prod-github-runner-207 kernel: [10216.612421] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 08:14:02 juju-e4d256-prod-github-runner-207 kernel: [10216.613230] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:14:02 juju-e4d256-prod-github-runner-207 kernel: [10216.613967] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:14:02 juju-e4d256-prod-github-runner-207 kernel: [10216.614694] ? do_syscall_64+0x69/0xc0 Aug 22 08:14:02 juju-e4d256-prod-github-runner-207 kernel: [10216.615400] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:14:02 juju-e4d256-prod-github-runner-207 kernel: [10216.616116] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:14:02 juju-e4d256-prod-github-runner-207 kernel: [10216.616844] ? do_syscall_64+0x69/0xc0 Aug 22 08:14:02 juju-e4d256-prod-github-runner-207 kernel: [10216.617487] ? do_syscall_64+0x69/0xc0 Aug 22 08:14:02 juju-e4d256-prod-github-runner-207 kernel: [10216.618139] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 08:14:02 juju-e4d256-prod-github-runner-207 kernel: [10216.618852] RIP: 0033:0x7faa5d0edaff Aug 22 08:14:02 juju-e4d256-prod-github-runner-207 kernel: [10216.619503] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 08:14:02 juju-e4d256-prod-github-runner-207 kernel: [10216.621492] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 08:14:02 juju-e4d256-prod-github-runner-207 kernel: [10216.622422] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 08:14:02 juju-e4d256-prod-github-runner-207 kernel: [10216.623351] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 08:14:02 juju-e4d256-prod-github-runner-207 kernel: [10216.624256] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 08:14:02 juju-e4d256-prod-github-runner-207 kernel: [10216.625147] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 08:14:02 juju-e4d256-prod-github-runner-207 kernel: [10216.626045] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 08:14:02 juju-e4d256-prod-github-runner-207 kernel: [10216.627005] Aug 22 08:14:30 juju-e4d256-prod-github-runner-207 kernel: [10244.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 9432s! [qemu-system-x86:6715] Aug 22 08:14:30 juju-e4d256-prod-github-runner-207 kernel: [10244.543861] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 08:14:30 juju-e4d256-prod-github-runner-207 kernel: [10244.544147] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 08:14:30 juju-e4d256-prod-github-runner-207 kernel: [10244.556261] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 08:14:30 juju-e4d256-prod-github-runner-207 kernel: [10244.557533] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 08:14:30 juju-e4d256-prod-github-runner-207 kernel: [10244.558761] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:14:30 juju-e4d256-prod-github-runner-207 kernel: [10244.559819] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 08:14:30 juju-e4d256-prod-github-runner-207 kernel: [10244.562366] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 08:14:30 juju-e4d256-prod-github-runner-207 kernel: [10244.563443] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 08:14:30 juju-e4d256-prod-github-runner-207 kernel: [10244.564603] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 08:14:30 juju-e4d256-prod-github-runner-207 kernel: [10244.565760] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 08:14:30 juju-e4d256-prod-github-runner-207 kernel: [10244.566944] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 08:14:30 juju-e4d256-prod-github-runner-207 kernel: [10244.568103] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 08:14:30 juju-e4d256-prod-github-runner-207 kernel: [10244.569266] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 08:14:30 juju-e4d256-prod-github-runner-207 kernel: [10244.570501] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 08:14:30 juju-e4d256-prod-github-runner-207 kernel: [10244.571620] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 08:14:30 juju-e4d256-prod-github-runner-207 kernel: [10244.572850] Call Trace: Aug 22 08:14:30 juju-e4d256-prod-github-runner-207 kernel: [10244.573764] Aug 22 08:14:30 juju-e4d256-prod-github-runner-207 kernel: [10244.574677] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:14:30 juju-e4d256-prod-github-runner-207 kernel: [10244.575706] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:14:30 juju-e4d256-prod-github-runner-207 kernel: [10244.576731] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:14:30 juju-e4d256-prod-github-runner-207 kernel: [10244.577826] ? show_regs.part.0+0x23/0x29 Aug 22 08:14:30 juju-e4d256-prod-github-runner-207 kernel: [10244.578846] ? show_regs.cold+0x8/0xd Aug 22 08:14:30 juju-e4d256-prod-github-runner-207 kernel: [10244.579817] ? watchdog_timer_fn+0x1be/0x220 Aug 22 08:14:30 juju-e4d256-prod-github-runner-207 kernel: [10244.580860] ? lockup_detector_update_enable+0x60/0x60 Aug 22 08:14:30 juju-e4d256-prod-github-runner-207 kernel: [10244.581924] ? __hrtimer_run_queues+0x107/0x230 Aug 22 08:14:30 juju-e4d256-prod-github-runner-207 kernel: [10244.582974] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 08:14:30 juju-e4d256-prod-github-runner-207 kernel: [10244.584035] ? hrtimer_interrupt+0x101/0x220 Aug 22 08:14:30 juju-e4d256-prod-github-runner-207 kernel: [10244.585049] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 08:14:30 juju-e4d256-prod-github-runner-207 kernel: [10244.586115] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 08:14:30 juju-e4d256-prod-github-runner-207 kernel: [10244.587183] Aug 22 08:14:30 juju-e4d256-prod-github-runner-207 kernel: [10244.588044] Aug 22 08:14:30 juju-e4d256-prod-github-runner-207 kernel: [10244.588880] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 08:14:30 juju-e4d256-prod-github-runner-207 kernel: [10244.589912] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:14:30 juju-e4d256-prod-github-runner-207 kernel: [10244.590964] ? _raw_spin_lock+0x22/0x30 Aug 22 08:14:30 juju-e4d256-prod-github-runner-207 kernel: [10244.591908] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:14:30 juju-e4d256-prod-github-runner-207 kernel: [10244.592924] direct_page_fault+0x206/0x310 [kvm] Aug 22 08:14:30 juju-e4d256-prod-github-runner-207 kernel: [10244.593947] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 08:14:30 juju-e4d256-prod-github-runner-207 kernel: [10244.594970] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 08:14:30 juju-e4d256-prod-github-runner-207 kernel: [10244.595985] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 08:14:30 juju-e4d256-prod-github-runner-207 kernel: [10244.596982] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 08:14:30 juju-e4d256-prod-github-runner-207 kernel: [10244.597933] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 08:14:30 juju-e4d256-prod-github-runner-207 kernel: [10244.598931] handle_exit+0x98/0x230 [kvm_amd] Aug 22 08:14:30 juju-e4d256-prod-github-runner-207 kernel: [10244.599832] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 08:14:30 juju-e4d256-prod-github-runner-207 kernel: [10244.600743] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 08:14:30 juju-e4d256-prod-github-runner-207 kernel: [10244.601670] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 08:14:30 juju-e4d256-prod-github-runner-207 kernel: [10244.602589] vcpu_run+0x62/0x2c0 [kvm] Aug 22 08:14:30 juju-e4d256-prod-github-runner-207 kernel: [10244.603416] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 08:14:30 juju-e4d256-prod-github-runner-207 kernel: [10244.604229] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 08:14:30 juju-e4d256-prod-github-runner-207 kernel: [10244.605085] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 08:14:30 juju-e4d256-prod-github-runner-207 kernel: [10244.605881] ? __seccomp_filter+0x4a/0x4a0 Aug 22 08:14:30 juju-e4d256-prod-github-runner-207 kernel: [10244.606812] ? __fget_files+0x86/0xc0 Aug 22 08:14:30 juju-e4d256-prod-github-runner-207 kernel: [10244.607515] __x64_sys_ioctl+0x95/0xd0 Aug 22 08:14:30 juju-e4d256-prod-github-runner-207 kernel: [10244.608207] do_syscall_64+0x5c/0xc0 Aug 22 08:14:30 juju-e4d256-prod-github-runner-207 kernel: [10244.608888] ? do_futex+0x162/0x1f0 Aug 22 08:14:30 juju-e4d256-prod-github-runner-207 kernel: [10244.609536] ? __x64_sys_futex+0x78/0x1e0 Aug 22 08:14:30 juju-e4d256-prod-github-runner-207 kernel: [10244.610207] ? __secure_computing+0xa9/0x120 Aug 22 08:14:30 juju-e4d256-prod-github-runner-207 kernel: [10244.610913] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 08:14:30 juju-e4d256-prod-github-runner-207 kernel: [10244.611719] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:14:30 juju-e4d256-prod-github-runner-207 kernel: [10244.612446] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:14:30 juju-e4d256-prod-github-runner-207 kernel: [10244.613165] ? do_syscall_64+0x69/0xc0 Aug 22 08:14:30 juju-e4d256-prod-github-runner-207 kernel: [10244.613819] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:14:30 juju-e4d256-prod-github-runner-207 kernel: [10244.614523] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:14:30 juju-e4d256-prod-github-runner-207 kernel: [10244.615241] ? do_syscall_64+0x69/0xc0 Aug 22 08:14:30 juju-e4d256-prod-github-runner-207 kernel: [10244.615868] ? do_syscall_64+0x69/0xc0 Aug 22 08:14:30 juju-e4d256-prod-github-runner-207 kernel: [10244.616489] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 08:14:30 juju-e4d256-prod-github-runner-207 kernel: [10244.617200] RIP: 0033:0x7faa5d0edaff Aug 22 08:14:30 juju-e4d256-prod-github-runner-207 kernel: [10244.617860] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 08:14:30 juju-e4d256-prod-github-runner-207 kernel: [10244.619876] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 08:14:30 juju-e4d256-prod-github-runner-207 kernel: [10244.620789] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 08:14:30 juju-e4d256-prod-github-runner-207 kernel: [10244.621690] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 08:14:30 juju-e4d256-prod-github-runner-207 kernel: [10244.622577] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 08:14:30 juju-e4d256-prod-github-runner-207 kernel: [10244.623477] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 08:14:30 juju-e4d256-prod-github-runner-207 kernel: [10244.624371] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 08:14:30 juju-e4d256-prod-github-runner-207 kernel: [10244.625261] Aug 22 08:14:43 juju-e4d256-prod-github-runner-207 kernel: [10257.872706] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 08:14:43 juju-e4d256-prod-github-runner-207 kernel: [10257.873673] rcu: 1-....: (2527218 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=1222242 Aug 22 08:14:43 juju-e4d256-prod-github-runner-207 kernel: [10257.874802] (t=2535168 jiffies g=23269 q=18790) Aug 22 08:14:43 juju-e4d256-prod-github-runner-207 kernel: [10257.875588] NMI backtrace for cpu 1 Aug 22 08:14:43 juju-e4d256-prod-github-runner-207 kernel: [10257.876297] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 08:14:43 juju-e4d256-prod-github-runner-207 kernel: [10257.877403] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 08:14:43 juju-e4d256-prod-github-runner-207 kernel: [10257.878468] Call Trace: Aug 22 08:14:43 juju-e4d256-prod-github-runner-207 kernel: [10257.879150] Aug 22 08:14:43 juju-e4d256-prod-github-runner-207 kernel: [10257.879798] show_stack+0x52/0x5c Aug 22 08:14:43 juju-e4d256-prod-github-runner-207 kernel: [10257.880526] dump_stack_lvl+0x4a/0x63 Aug 22 08:14:43 juju-e4d256-prod-github-runner-207 kernel: [10257.881272] dump_stack+0x10/0x16 Aug 22 08:14:43 juju-e4d256-prod-github-runner-207 kernel: [10257.881989] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 08:14:43 juju-e4d256-prod-github-runner-207 kernel: [10257.882780] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 08:14:43 juju-e4d256-prod-github-runner-207 kernel: [10257.883568] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 08:14:43 juju-e4d256-prod-github-runner-207 kernel: [10257.884393] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 08:14:43 juju-e4d256-prod-github-runner-207 kernel: [10257.885214] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 08:14:43 juju-e4d256-prod-github-runner-207 kernel: [10257.886029] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 08:14:43 juju-e4d256-prod-github-runner-207 kernel: [10257.886822] print_cpu_stall.cold+0x2f/0xe2 Aug 22 08:14:43 juju-e4d256-prod-github-runner-207 kernel: [10257.887588] ? timekeeping_update+0xf7/0x150 Aug 22 08:14:43 juju-e4d256-prod-github-runner-207 kernel: [10257.888371] check_cpu_stall+0x109/0x270 Aug 22 08:14:43 juju-e4d256-prod-github-runner-207 kernel: [10257.889182] rcu_sched_clock_irq+0x9a/0x250 Aug 22 08:14:43 juju-e4d256-prod-github-runner-207 kernel: [10257.889971] update_process_times+0x94/0xd0 Aug 22 08:14:43 juju-e4d256-prod-github-runner-207 kernel: [10257.890758] tick_sched_handle+0x29/0x70 Aug 22 08:14:43 juju-e4d256-prod-github-runner-207 kernel: [10257.891503] tick_sched_timer+0x8c/0xc0 Aug 22 08:14:43 juju-e4d256-prod-github-runner-207 kernel: [10257.892243] ? tick_nohz_handler+0xb0/0xb0 Aug 22 08:14:43 juju-e4d256-prod-github-runner-207 kernel: [10257.892992] __hrtimer_run_queues+0x107/0x230 Aug 22 08:14:43 juju-e4d256-prod-github-runner-207 kernel: [10257.893761] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 08:14:43 juju-e4d256-prod-github-runner-207 kernel: [10257.894550] hrtimer_interrupt+0x101/0x220 Aug 22 08:14:43 juju-e4d256-prod-github-runner-207 kernel: [10257.895305] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 08:14:43 juju-e4d256-prod-github-runner-207 kernel: [10257.896114] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 08:14:43 juju-e4d256-prod-github-runner-207 kernel: [10257.896914] Aug 22 08:14:43 juju-e4d256-prod-github-runner-207 kernel: [10257.897549] Aug 22 08:14:43 juju-e4d256-prod-github-runner-207 kernel: [10257.898174] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 08:14:43 juju-e4d256-prod-github-runner-207 kernel: [10257.898994] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:14:43 juju-e4d256-prod-github-runner-207 kernel: [10257.899909] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 08:14:43 juju-e4d256-prod-github-runner-207 kernel: [10257.902130] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 08:14:43 juju-e4d256-prod-github-runner-207 kernel: [10257.903039] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 08:14:43 juju-e4d256-prod-github-runner-207 kernel: [10257.904033] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 08:14:43 juju-e4d256-prod-github-runner-207 kernel: [10257.905012] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 08:14:43 juju-e4d256-prod-github-runner-207 kernel: [10257.905972] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 08:14:43 juju-e4d256-prod-github-runner-207 kernel: [10257.906935] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 08:14:43 juju-e4d256-prod-github-runner-207 kernel: [10257.907885] ? _raw_spin_lock+0x22/0x30 Aug 22 08:14:43 juju-e4d256-prod-github-runner-207 kernel: [10257.908638] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:14:43 juju-e4d256-prod-github-runner-207 kernel: [10257.909471] direct_page_fault+0x206/0x310 [kvm] Aug 22 08:14:43 juju-e4d256-prod-github-runner-207 kernel: [10257.910309] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 08:14:43 juju-e4d256-prod-github-runner-207 kernel: [10257.911149] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 08:14:43 juju-e4d256-prod-github-runner-207 kernel: [10257.912113] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 08:14:43 juju-e4d256-prod-github-runner-207 kernel: [10257.913030] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 08:14:43 juju-e4d256-prod-github-runner-207 kernel: [10257.913914] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 08:14:43 juju-e4d256-prod-github-runner-207 kernel: [10257.914869] handle_exit+0x98/0x230 [kvm_amd] Aug 22 08:14:43 juju-e4d256-prod-github-runner-207 kernel: [10257.915714] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 08:14:43 juju-e4d256-prod-github-runner-207 kernel: [10257.916596] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 08:14:43 juju-e4d256-prod-github-runner-207 kernel: [10257.917495] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 08:14:43 juju-e4d256-prod-github-runner-207 kernel: [10257.918429] vcpu_run+0x62/0x2c0 [kvm] Aug 22 08:14:43 juju-e4d256-prod-github-runner-207 kernel: [10257.919214] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 08:14:43 juju-e4d256-prod-github-runner-207 kernel: [10257.919958] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 08:14:43 juju-e4d256-prod-github-runner-207 kernel: [10257.920757] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 08:14:43 juju-e4d256-prod-github-runner-207 kernel: [10257.921531] ? __seccomp_filter+0x4a/0x4a0 Aug 22 08:14:43 juju-e4d256-prod-github-runner-207 kernel: [10257.922248] ? __fget_files+0x86/0xc0 Aug 22 08:14:43 juju-e4d256-prod-github-runner-207 kernel: [10257.922951] __x64_sys_ioctl+0x95/0xd0 Aug 22 08:14:43 juju-e4d256-prod-github-runner-207 kernel: [10257.923641] do_syscall_64+0x5c/0xc0 Aug 22 08:14:43 juju-e4d256-prod-github-runner-207 kernel: [10257.924315] ? do_futex+0x162/0x1f0 Aug 22 08:14:43 juju-e4d256-prod-github-runner-207 kernel: [10257.924985] ? __x64_sys_futex+0x78/0x1e0 Aug 22 08:14:43 juju-e4d256-prod-github-runner-207 kernel: [10257.925680] ? __secure_computing+0xa9/0x120 Aug 22 08:14:43 juju-e4d256-prod-github-runner-207 kernel: [10257.926389] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 08:14:43 juju-e4d256-prod-github-runner-207 kernel: [10257.927189] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:14:43 juju-e4d256-prod-github-runner-207 kernel: [10257.927945] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:14:43 juju-e4d256-prod-github-runner-207 kernel: [10257.928692] ? do_syscall_64+0x69/0xc0 Aug 22 08:14:43 juju-e4d256-prod-github-runner-207 kernel: [10257.929382] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:14:43 juju-e4d256-prod-github-runner-207 kernel: [10257.930136] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:14:43 juju-e4d256-prod-github-runner-207 kernel: [10257.931192] ? do_syscall_64+0x69/0xc0 Aug 22 08:14:43 juju-e4d256-prod-github-runner-207 kernel: [10257.931932] ? do_syscall_64+0x69/0xc0 Aug 22 08:14:43 juju-e4d256-prod-github-runner-207 kernel: [10257.932658] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 08:14:43 juju-e4d256-prod-github-runner-207 kernel: [10257.933448] RIP: 0033:0x7faa5d0edaff Aug 22 08:14:43 juju-e4d256-prod-github-runner-207 kernel: [10257.934139] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 08:14:43 juju-e4d256-prod-github-runner-207 kernel: [10257.936510] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 08:14:43 juju-e4d256-prod-github-runner-207 kernel: [10257.937553] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 08:14:43 juju-e4d256-prod-github-runner-207 kernel: [10257.938586] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 08:14:43 juju-e4d256-prod-github-runner-207 kernel: [10257.939554] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 08:14:43 juju-e4d256-prod-github-runner-207 kernel: [10257.940545] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 08:14:43 juju-e4d256-prod-github-runner-207 kernel: [10257.941559] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 08:14:43 juju-e4d256-prod-github-runner-207 kernel: [10257.942517] Aug 22 08:15:10 juju-e4d256-prod-github-runner-207 kernel: [10284.541980] watchdog: BUG: soft lockup - CPU#1 stuck for 9470s! [qemu-system-x86:6715] Aug 22 08:15:10 juju-e4d256-prod-github-runner-207 kernel: [10284.543099] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 08:15:10 juju-e4d256-prod-github-runner-207 kernel: [10284.543172] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 08:15:10 juju-e4d256-prod-github-runner-207 kernel: [10284.555498] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 08:15:10 juju-e4d256-prod-github-runner-207 kernel: [10284.556828] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 08:15:10 juju-e4d256-prod-github-runner-207 kernel: [10284.558064] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:15:10 juju-e4d256-prod-github-runner-207 kernel: [10284.559163] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 08:15:10 juju-e4d256-prod-github-runner-207 kernel: [10284.561708] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 08:15:10 juju-e4d256-prod-github-runner-207 kernel: [10284.562789] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 08:15:10 juju-e4d256-prod-github-runner-207 kernel: [10284.563961] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 08:15:10 juju-e4d256-prod-github-runner-207 kernel: [10284.565116] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 08:15:10 juju-e4d256-prod-github-runner-207 kernel: [10284.566291] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 08:15:10 juju-e4d256-prod-github-runner-207 kernel: [10284.567464] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 08:15:10 juju-e4d256-prod-github-runner-207 kernel: [10284.568628] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 08:15:10 juju-e4d256-prod-github-runner-207 kernel: [10284.569858] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 08:15:10 juju-e4d256-prod-github-runner-207 kernel: [10284.570982] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 08:15:10 juju-e4d256-prod-github-runner-207 kernel: [10284.572174] Call Trace: Aug 22 08:15:10 juju-e4d256-prod-github-runner-207 kernel: [10284.573090] Aug 22 08:15:10 juju-e4d256-prod-github-runner-207 kernel: [10284.573978] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:15:10 juju-e4d256-prod-github-runner-207 kernel: [10284.575086] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:15:10 juju-e4d256-prod-github-runner-207 kernel: [10284.576119] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:15:10 juju-e4d256-prod-github-runner-207 kernel: [10284.577508] ? show_regs.part.0+0x23/0x29 Aug 22 08:15:10 juju-e4d256-prod-github-runner-207 kernel: [10284.578628] ? show_regs.cold+0x8/0xd Aug 22 08:15:10 juju-e4d256-prod-github-runner-207 kernel: [10284.579689] ? watchdog_timer_fn+0x1be/0x220 Aug 22 08:15:10 juju-e4d256-prod-github-runner-207 kernel: [10284.580897] ? lockup_detector_update_enable+0x60/0x60 Aug 22 08:15:10 juju-e4d256-prod-github-runner-207 kernel: [10284.582056] ? __hrtimer_run_queues+0x107/0x230 Aug 22 08:15:10 juju-e4d256-prod-github-runner-207 kernel: [10284.583198] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 08:15:10 juju-e4d256-prod-github-runner-207 kernel: [10284.584321] ? hrtimer_interrupt+0x101/0x220 Aug 22 08:15:10 juju-e4d256-prod-github-runner-207 kernel: [10284.585430] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 08:15:10 juju-e4d256-prod-github-runner-207 kernel: [10284.586625] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 08:15:10 juju-e4d256-prod-github-runner-207 kernel: [10284.587768] Aug 22 08:15:10 juju-e4d256-prod-github-runner-207 kernel: [10284.588669] Aug 22 08:15:10 juju-e4d256-prod-github-runner-207 kernel: [10284.589566] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 08:15:10 juju-e4d256-prod-github-runner-207 kernel: [10284.591033] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:15:10 juju-e4d256-prod-github-runner-207 kernel: [10284.592229] ? _raw_spin_lock+0x22/0x30 Aug 22 08:15:10 juju-e4d256-prod-github-runner-207 kernel: [10284.593254] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:15:10 juju-e4d256-prod-github-runner-207 kernel: [10284.594404] direct_page_fault+0x206/0x310 [kvm] Aug 22 08:15:10 juju-e4d256-prod-github-runner-207 kernel: [10284.595732] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 08:15:10 juju-e4d256-prod-github-runner-207 kernel: [10284.596892] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 08:15:10 juju-e4d256-prod-github-runner-207 kernel: [10284.598251] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 08:15:10 juju-e4d256-prod-github-runner-207 kernel: [10284.599333] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 08:15:10 juju-e4d256-prod-github-runner-207 kernel: [10284.600386] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 08:15:10 juju-e4d256-prod-github-runner-207 kernel: [10284.601469] handle_exit+0x98/0x230 [kvm_amd] Aug 22 08:15:10 juju-e4d256-prod-github-runner-207 kernel: [10284.602465] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 08:15:10 juju-e4d256-prod-github-runner-207 kernel: [10284.603476] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 08:15:10 juju-e4d256-prod-github-runner-207 kernel: [10284.604498] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 08:15:10 juju-e4d256-prod-github-runner-207 kernel: [10284.605491] vcpu_run+0x62/0x2c0 [kvm] Aug 22 08:15:10 juju-e4d256-prod-github-runner-207 kernel: [10284.606383] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 08:15:10 juju-e4d256-prod-github-runner-207 kernel: [10284.607277] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 08:15:10 juju-e4d256-prod-github-runner-207 kernel: [10284.608227] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 08:15:10 juju-e4d256-prod-github-runner-207 kernel: [10284.609103] ? __seccomp_filter+0x4a/0x4a0 Aug 22 08:15:10 juju-e4d256-prod-github-runner-207 kernel: [10284.609925] ? __fget_files+0x86/0xc0 Aug 22 08:15:10 juju-e4d256-prod-github-runner-207 kernel: [10284.610712] __x64_sys_ioctl+0x95/0xd0 Aug 22 08:15:10 juju-e4d256-prod-github-runner-207 kernel: [10284.611482] do_syscall_64+0x5c/0xc0 Aug 22 08:15:10 juju-e4d256-prod-github-runner-207 kernel: [10284.612220] ? do_futex+0x162/0x1f0 Aug 22 08:15:10 juju-e4d256-prod-github-runner-207 kernel: [10284.612943] ? __x64_sys_futex+0x78/0x1e0 Aug 22 08:15:10 juju-e4d256-prod-github-runner-207 kernel: [10284.613694] ? __secure_computing+0xa9/0x120 Aug 22 08:15:10 juju-e4d256-prod-github-runner-207 kernel: [10284.614484] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 08:15:10 juju-e4d256-prod-github-runner-207 kernel: [10284.615460] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:15:10 juju-e4d256-prod-github-runner-207 kernel: [10284.616282] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:15:10 juju-e4d256-prod-github-runner-207 kernel: [10284.617113] ? do_syscall_64+0x69/0xc0 Aug 22 08:15:10 juju-e4d256-prod-github-runner-207 kernel: [10284.617859] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:15:10 juju-e4d256-prod-github-runner-207 kernel: [10284.618667] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:15:10 juju-e4d256-prod-github-runner-207 kernel: [10284.619458] ? do_syscall_64+0x69/0xc0 Aug 22 08:15:10 juju-e4d256-prod-github-runner-207 kernel: [10284.620163] ? do_syscall_64+0x69/0xc0 Aug 22 08:15:10 juju-e4d256-prod-github-runner-207 kernel: [10284.620866] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 08:15:10 juju-e4d256-prod-github-runner-207 kernel: [10284.621681] RIP: 0033:0x7faa5d0edaff Aug 22 08:15:10 juju-e4d256-prod-github-runner-207 kernel: [10284.622403] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 08:15:10 juju-e4d256-prod-github-runner-207 kernel: [10284.624735] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 08:15:10 juju-e4d256-prod-github-runner-207 kernel: [10284.625794] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 08:15:10 juju-e4d256-prod-github-runner-207 kernel: [10284.626845] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 08:15:10 juju-e4d256-prod-github-runner-207 kernel: [10284.627867] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 08:15:10 juju-e4d256-prod-github-runner-207 kernel: [10284.628887] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 08:15:10 juju-e4d256-prod-github-runner-207 kernel: [10284.629911] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 08:15:10 juju-e4d256-prod-github-runner-207 kernel: [10284.630974] Aug 22 08:15:38 juju-e4d256-prod-github-runner-207 kernel: [10312.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 9496s! [qemu-system-x86:6715] Aug 22 08:15:38 juju-e4d256-prod-github-runner-207 kernel: [10312.543161] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 08:15:38 juju-e4d256-prod-github-runner-207 kernel: [10312.543237] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 08:15:38 juju-e4d256-prod-github-runner-207 kernel: [10312.555772] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 08:15:38 juju-e4d256-prod-github-runner-207 kernel: [10312.557077] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 08:15:38 juju-e4d256-prod-github-runner-207 kernel: [10312.558346] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:15:38 juju-e4d256-prod-github-runner-207 kernel: [10312.559459] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 08:15:38 juju-e4d256-prod-github-runner-207 kernel: [10312.562114] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 08:15:38 juju-e4d256-prod-github-runner-207 kernel: [10312.563176] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 08:15:38 juju-e4d256-prod-github-runner-207 kernel: [10312.564366] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 08:15:38 juju-e4d256-prod-github-runner-207 kernel: [10312.565571] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 08:15:38 juju-e4d256-prod-github-runner-207 kernel: [10312.566799] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 08:15:38 juju-e4d256-prod-github-runner-207 kernel: [10312.568021] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 08:15:38 juju-e4d256-prod-github-runner-207 kernel: [10312.569231] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 08:15:38 juju-e4d256-prod-github-runner-207 kernel: [10312.570581] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 08:15:38 juju-e4d256-prod-github-runner-207 kernel: [10312.571709] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 08:15:38 juju-e4d256-prod-github-runner-207 kernel: [10312.572943] Call Trace: Aug 22 08:15:38 juju-e4d256-prod-github-runner-207 kernel: [10312.573898] Aug 22 08:15:38 juju-e4d256-prod-github-runner-207 kernel: [10312.574801] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:15:38 juju-e4d256-prod-github-runner-207 kernel: [10312.575874] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:15:38 juju-e4d256-prod-github-runner-207 kernel: [10312.576915] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:15:38 juju-e4d256-prod-github-runner-207 kernel: [10312.578026] ? show_regs.part.0+0x23/0x29 Aug 22 08:15:38 juju-e4d256-prod-github-runner-207 kernel: [10312.579038] ? show_regs.cold+0x8/0xd Aug 22 08:15:38 juju-e4d256-prod-github-runner-207 kernel: [10312.580045] ? watchdog_timer_fn+0x1be/0x220 Aug 22 08:15:38 juju-e4d256-prod-github-runner-207 kernel: [10312.581099] ? lockup_detector_update_enable+0x60/0x60 Aug 22 08:15:38 juju-e4d256-prod-github-runner-207 kernel: [10312.582203] ? __hrtimer_run_queues+0x107/0x230 Aug 22 08:15:38 juju-e4d256-prod-github-runner-207 kernel: [10312.583251] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 08:15:38 juju-e4d256-prod-github-runner-207 kernel: [10312.584293] ? hrtimer_interrupt+0x101/0x220 Aug 22 08:15:38 juju-e4d256-prod-github-runner-207 kernel: [10312.585345] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 08:15:38 juju-e4d256-prod-github-runner-207 kernel: [10312.586469] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 08:15:38 juju-e4d256-prod-github-runner-207 kernel: [10312.587539] Aug 22 08:15:38 juju-e4d256-prod-github-runner-207 kernel: [10312.588401] Aug 22 08:15:38 juju-e4d256-prod-github-runner-207 kernel: [10312.589249] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 08:15:38 juju-e4d256-prod-github-runner-207 kernel: [10312.590329] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:15:38 juju-e4d256-prod-github-runner-207 kernel: [10312.591466] ? _raw_spin_lock+0x22/0x30 Aug 22 08:15:38 juju-e4d256-prod-github-runner-207 kernel: [10312.592440] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:15:38 juju-e4d256-prod-github-runner-207 kernel: [10312.593478] direct_page_fault+0x206/0x310 [kvm] Aug 22 08:15:38 juju-e4d256-prod-github-runner-207 kernel: [10312.594543] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 08:15:38 juju-e4d256-prod-github-runner-207 kernel: [10312.595581] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 08:15:38 juju-e4d256-prod-github-runner-207 kernel: [10312.596644] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 08:15:38 juju-e4d256-prod-github-runner-207 kernel: [10312.597648] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 08:15:38 juju-e4d256-prod-github-runner-207 kernel: [10312.598621] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 08:15:38 juju-e4d256-prod-github-runner-207 kernel: [10312.599648] handle_exit+0x98/0x230 [kvm_amd] Aug 22 08:15:38 juju-e4d256-prod-github-runner-207 kernel: [10312.600565] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 08:15:38 juju-e4d256-prod-github-runner-207 kernel: [10312.601544] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 08:15:38 juju-e4d256-prod-github-runner-207 kernel: [10312.602515] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 08:15:38 juju-e4d256-prod-github-runner-207 kernel: [10312.603438] vcpu_run+0x62/0x2c0 [kvm] Aug 22 08:15:38 juju-e4d256-prod-github-runner-207 kernel: [10312.604286] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 08:15:38 juju-e4d256-prod-github-runner-207 kernel: [10312.605100] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 08:15:38 juju-e4d256-prod-github-runner-207 kernel: [10312.605990] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 08:15:38 juju-e4d256-prod-github-runner-207 kernel: [10312.606811] ? __seccomp_filter+0x4a/0x4a0 Aug 22 08:15:38 juju-e4d256-prod-github-runner-207 kernel: [10312.607559] ? __fget_files+0x86/0xc0 Aug 22 08:15:38 juju-e4d256-prod-github-runner-207 kernel: [10312.608266] __x64_sys_ioctl+0x95/0xd0 Aug 22 08:15:38 juju-e4d256-prod-github-runner-207 kernel: [10312.608990] do_syscall_64+0x5c/0xc0 Aug 22 08:15:38 juju-e4d256-prod-github-runner-207 kernel: [10312.609670] ? do_futex+0x162/0x1f0 Aug 22 08:15:38 juju-e4d256-prod-github-runner-207 kernel: [10312.610337] ? __x64_sys_futex+0x78/0x1e0 Aug 22 08:15:38 juju-e4d256-prod-github-runner-207 kernel: [10312.611020] ? __secure_computing+0xa9/0x120 Aug 22 08:15:38 juju-e4d256-prod-github-runner-207 kernel: [10312.611737] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 08:15:38 juju-e4d256-prod-github-runner-207 kernel: [10312.612529] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:15:38 juju-e4d256-prod-github-runner-207 kernel: [10312.613271] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:15:38 juju-e4d256-prod-github-runner-207 kernel: [10312.614030] ? do_syscall_64+0x69/0xc0 Aug 22 08:15:38 juju-e4d256-prod-github-runner-207 kernel: [10312.614815] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:15:38 juju-e4d256-prod-github-runner-207 kernel: [10312.615520] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:15:38 juju-e4d256-prod-github-runner-207 kernel: [10312.616232] ? do_syscall_64+0x69/0xc0 Aug 22 08:15:38 juju-e4d256-prod-github-runner-207 kernel: [10312.616996] ? do_syscall_64+0x69/0xc0 Aug 22 08:15:38 juju-e4d256-prod-github-runner-207 kernel: [10312.617624] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 08:15:38 juju-e4d256-prod-github-runner-207 kernel: [10312.618345] RIP: 0033:0x7faa5d0edaff Aug 22 08:15:38 juju-e4d256-prod-github-runner-207 kernel: [10312.618975] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 08:15:38 juju-e4d256-prod-github-runner-207 kernel: [10312.620986] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 08:15:38 juju-e4d256-prod-github-runner-207 kernel: [10312.621924] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 08:15:38 juju-e4d256-prod-github-runner-207 kernel: [10312.622834] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 08:15:38 juju-e4d256-prod-github-runner-207 kernel: [10312.623721] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 08:15:38 juju-e4d256-prod-github-runner-207 kernel: [10312.624606] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 08:15:38 juju-e4d256-prod-github-runner-207 kernel: [10312.625498] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 08:15:38 juju-e4d256-prod-github-runner-207 kernel: [10312.626415] Aug 22 08:16:06 juju-e4d256-prod-github-runner-207 kernel: [10340.541980] watchdog: BUG: soft lockup - CPU#1 stuck for 9522s! [qemu-system-x86:6715] Aug 22 08:16:06 juju-e4d256-prod-github-runner-207 kernel: [10340.543803] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 08:16:06 juju-e4d256-prod-github-runner-207 kernel: [10340.544089] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 08:16:06 juju-e4d256-prod-github-runner-207 kernel: [10340.556539] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 08:16:06 juju-e4d256-prod-github-runner-207 kernel: [10340.557870] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 08:16:06 juju-e4d256-prod-github-runner-207 kernel: [10340.559099] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:16:06 juju-e4d256-prod-github-runner-207 kernel: [10340.560167] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 08:16:06 juju-e4d256-prod-github-runner-207 kernel: [10340.562848] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 08:16:06 juju-e4d256-prod-github-runner-207 kernel: [10340.564107] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 08:16:06 juju-e4d256-prod-github-runner-207 kernel: [10340.565490] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 08:16:06 juju-e4d256-prod-github-runner-207 kernel: [10340.566778] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 08:16:06 juju-e4d256-prod-github-runner-207 kernel: [10340.568008] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 08:16:06 juju-e4d256-prod-github-runner-207 kernel: [10340.569364] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 08:16:06 juju-e4d256-prod-github-runner-207 kernel: [10340.570679] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 08:16:06 juju-e4d256-prod-github-runner-207 kernel: [10340.572177] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 08:16:06 juju-e4d256-prod-github-runner-207 kernel: [10340.573420] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 08:16:06 juju-e4d256-prod-github-runner-207 kernel: [10340.574840] Call Trace: Aug 22 08:16:06 juju-e4d256-prod-github-runner-207 kernel: [10340.575905] Aug 22 08:16:06 juju-e4d256-prod-github-runner-207 kernel: [10340.576954] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:16:06 juju-e4d256-prod-github-runner-207 kernel: [10340.578197] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:16:06 juju-e4d256-prod-github-runner-207 kernel: [10340.579445] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:16:06 juju-e4d256-prod-github-runner-207 kernel: [10340.580685] ? show_regs.part.0+0x23/0x29 Aug 22 08:16:06 juju-e4d256-prod-github-runner-207 kernel: [10340.581836] ? show_regs.cold+0x8/0xd Aug 22 08:16:06 juju-e4d256-prod-github-runner-207 kernel: [10340.583002] ? watchdog_timer_fn+0x1be/0x220 Aug 22 08:16:06 juju-e4d256-prod-github-runner-207 kernel: [10340.584160] ? lockup_detector_update_enable+0x60/0x60 Aug 22 08:16:06 juju-e4d256-prod-github-runner-207 kernel: [10340.585459] ? __hrtimer_run_queues+0x107/0x230 Aug 22 08:16:06 juju-e4d256-prod-github-runner-207 kernel: [10340.586602] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 08:16:06 juju-e4d256-prod-github-runner-207 kernel: [10340.587753] ? hrtimer_interrupt+0x101/0x220 Aug 22 08:16:06 juju-e4d256-prod-github-runner-207 kernel: [10340.588922] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 08:16:06 juju-e4d256-prod-github-runner-207 kernel: [10340.590188] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 08:16:06 juju-e4d256-prod-github-runner-207 kernel: [10340.591390] Aug 22 08:16:06 juju-e4d256-prod-github-runner-207 kernel: [10340.592307] Aug 22 08:16:06 juju-e4d256-prod-github-runner-207 kernel: [10340.593217] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 08:16:06 juju-e4d256-prod-github-runner-207 kernel: [10340.594423] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:16:06 juju-e4d256-prod-github-runner-207 kernel: [10340.595626] ? _raw_spin_lock+0x22/0x30 Aug 22 08:16:06 juju-e4d256-prod-github-runner-207 kernel: [10340.596671] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:16:06 juju-e4d256-prod-github-runner-207 kernel: [10340.597811] direct_page_fault+0x206/0x310 [kvm] Aug 22 08:16:06 juju-e4d256-prod-github-runner-207 kernel: [10340.598959] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 08:16:06 juju-e4d256-prod-github-runner-207 kernel: [10340.600115] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 08:16:06 juju-e4d256-prod-github-runner-207 kernel: [10340.601215] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 08:16:06 juju-e4d256-prod-github-runner-207 kernel: [10340.602375] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 08:16:06 juju-e4d256-prod-github-runner-207 kernel: [10340.603415] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 08:16:06 juju-e4d256-prod-github-runner-207 kernel: [10340.604501] handle_exit+0x98/0x230 [kvm_amd] Aug 22 08:16:06 juju-e4d256-prod-github-runner-207 kernel: [10340.605519] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 08:16:06 juju-e4d256-prod-github-runner-207 kernel: [10340.606530] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 08:16:06 juju-e4d256-prod-github-runner-207 kernel: [10340.607553] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 08:16:06 juju-e4d256-prod-github-runner-207 kernel: [10340.608553] vcpu_run+0x62/0x2c0 [kvm] Aug 22 08:16:06 juju-e4d256-prod-github-runner-207 kernel: [10340.609462] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 08:16:06 juju-e4d256-prod-github-runner-207 kernel: [10340.610368] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 08:16:06 juju-e4d256-prod-github-runner-207 kernel: [10340.611324] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 08:16:06 juju-e4d256-prod-github-runner-207 kernel: [10340.612205] ? __seccomp_filter+0x4a/0x4a0 Aug 22 08:16:06 juju-e4d256-prod-github-runner-207 kernel: [10340.613032] ? __fget_files+0x86/0xc0 Aug 22 08:16:06 juju-e4d256-prod-github-runner-207 kernel: [10340.613830] __x64_sys_ioctl+0x95/0xd0 Aug 22 08:16:06 juju-e4d256-prod-github-runner-207 kernel: [10340.614603] do_syscall_64+0x5c/0xc0 Aug 22 08:16:06 juju-e4d256-prod-github-runner-207 kernel: [10340.615354] ? do_futex+0x162/0x1f0 Aug 22 08:16:06 juju-e4d256-prod-github-runner-207 kernel: [10340.616078] ? __x64_sys_futex+0x78/0x1e0 Aug 22 08:16:06 juju-e4d256-prod-github-runner-207 kernel: [10340.616833] ? __secure_computing+0xa9/0x120 Aug 22 08:16:06 juju-e4d256-prod-github-runner-207 kernel: [10340.617626] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 08:16:06 juju-e4d256-prod-github-runner-207 kernel: [10340.618509] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:16:06 juju-e4d256-prod-github-runner-207 kernel: [10340.619360] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:16:06 juju-e4d256-prod-github-runner-207 kernel: [10340.620190] ? do_syscall_64+0x69/0xc0 Aug 22 08:16:06 juju-e4d256-prod-github-runner-207 kernel: [10340.620912] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:16:06 juju-e4d256-prod-github-runner-207 kernel: [10340.621768] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:16:06 juju-e4d256-prod-github-runner-207 kernel: [10340.622565] ? do_syscall_64+0x69/0xc0 Aug 22 08:16:06 juju-e4d256-prod-github-runner-207 kernel: [10340.623262] ? do_syscall_64+0x69/0xc0 Aug 22 08:16:06 juju-e4d256-prod-github-runner-207 kernel: [10340.623989] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 08:16:06 juju-e4d256-prod-github-runner-207 kernel: [10340.624810] RIP: 0033:0x7faa5d0edaff Aug 22 08:16:06 juju-e4d256-prod-github-runner-207 kernel: [10340.625565] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 08:16:06 juju-e4d256-prod-github-runner-207 kernel: [10340.627912] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 08:16:06 juju-e4d256-prod-github-runner-207 kernel: [10340.628962] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 08:16:06 juju-e4d256-prod-github-runner-207 kernel: [10340.630014] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 08:16:06 juju-e4d256-prod-github-runner-207 kernel: [10340.631113] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 08:16:06 juju-e4d256-prod-github-runner-207 kernel: [10340.632138] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 08:16:06 juju-e4d256-prod-github-runner-207 kernel: [10340.633166] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 08:16:06 juju-e4d256-prod-github-runner-207 kernel: [10340.634325] Aug 22 08:16:34 juju-e4d256-prod-github-runner-207 kernel: [10368.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 9548s! [qemu-system-x86:6715] Aug 22 08:16:34 juju-e4d256-prod-github-runner-207 kernel: [10368.543087] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 08:16:34 juju-e4d256-prod-github-runner-207 kernel: [10368.543159] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 08:16:34 juju-e4d256-prod-github-runner-207 kernel: [10368.555421] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 08:16:34 juju-e4d256-prod-github-runner-207 kernel: [10368.556713] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 08:16:34 juju-e4d256-prod-github-runner-207 kernel: [10368.557964] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:16:34 juju-e4d256-prod-github-runner-207 kernel: [10368.559053] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 08:16:34 juju-e4d256-prod-github-runner-207 kernel: [10368.561707] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 08:16:34 juju-e4d256-prod-github-runner-207 kernel: [10368.562761] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 08:16:34 juju-e4d256-prod-github-runner-207 kernel: [10368.563925] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 08:16:34 juju-e4d256-prod-github-runner-207 kernel: [10368.565111] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 08:16:34 juju-e4d256-prod-github-runner-207 kernel: [10368.566290] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 08:16:34 juju-e4d256-prod-github-runner-207 kernel: [10368.567495] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 08:16:34 juju-e4d256-prod-github-runner-207 kernel: [10368.568708] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 08:16:34 juju-e4d256-prod-github-runner-207 kernel: [10368.570010] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 08:16:34 juju-e4d256-prod-github-runner-207 kernel: [10368.571181] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 08:16:34 juju-e4d256-prod-github-runner-207 kernel: [10368.572412] Call Trace: Aug 22 08:16:34 juju-e4d256-prod-github-runner-207 kernel: [10368.573366] Aug 22 08:16:34 juju-e4d256-prod-github-runner-207 kernel: [10368.574256] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:16:34 juju-e4d256-prod-github-runner-207 kernel: [10368.575290] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:16:34 juju-e4d256-prod-github-runner-207 kernel: [10368.576343] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:16:34 juju-e4d256-prod-github-runner-207 kernel: [10368.577436] ? show_regs.part.0+0x23/0x29 Aug 22 08:16:34 juju-e4d256-prod-github-runner-207 kernel: [10368.578451] ? show_regs.cold+0x8/0xd Aug 22 08:16:34 juju-e4d256-prod-github-runner-207 kernel: [10368.581693] ? watchdog_timer_fn+0x1be/0x220 Aug 22 08:16:34 juju-e4d256-prod-github-runner-207 kernel: [10368.582707] ? lockup_detector_update_enable+0x60/0x60 Aug 22 08:16:34 juju-e4d256-prod-github-runner-207 kernel: [10368.583766] ? __hrtimer_run_queues+0x107/0x230 Aug 22 08:16:34 juju-e4d256-prod-github-runner-207 kernel: [10368.584792] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 08:16:34 juju-e4d256-prod-github-runner-207 kernel: [10368.585896] ? hrtimer_interrupt+0x101/0x220 Aug 22 08:16:34 juju-e4d256-prod-github-runner-207 kernel: [10368.589054] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 08:16:34 juju-e4d256-prod-github-runner-207 kernel: [10368.590169] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 08:16:34 juju-e4d256-prod-github-runner-207 kernel: [10368.591272] Aug 22 08:16:34 juju-e4d256-prod-github-runner-207 kernel: [10368.592186] Aug 22 08:16:34 juju-e4d256-prod-github-runner-207 kernel: [10368.597223] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 08:16:34 juju-e4d256-prod-github-runner-207 kernel: [10368.598329] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:16:34 juju-e4d256-prod-github-runner-207 kernel: [10368.599375] ? _raw_spin_lock+0x22/0x30 Aug 22 08:16:34 juju-e4d256-prod-github-runner-207 kernel: [10368.600366] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:16:34 juju-e4d256-prod-github-runner-207 kernel: [10368.601445] direct_page_fault+0x206/0x310 [kvm] Aug 22 08:16:34 juju-e4d256-prod-github-runner-207 kernel: [10368.602528] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 08:16:34 juju-e4d256-prod-github-runner-207 kernel: [10368.603573] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 08:16:34 juju-e4d256-prod-github-runner-207 kernel: [10368.604572] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 08:16:34 juju-e4d256-prod-github-runner-207 kernel: [10368.605553] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 08:16:34 juju-e4d256-prod-github-runner-207 kernel: [10368.606502] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 08:16:34 juju-e4d256-prod-github-runner-207 kernel: [10368.607491] handle_exit+0x98/0x230 [kvm_amd] Aug 22 08:16:34 juju-e4d256-prod-github-runner-207 kernel: [10368.608393] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 08:16:34 juju-e4d256-prod-github-runner-207 kernel: [10368.609323] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 08:16:34 juju-e4d256-prod-github-runner-207 kernel: [10368.610252] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 08:16:34 juju-e4d256-prod-github-runner-207 kernel: [10368.611154] vcpu_run+0x62/0x2c0 [kvm] Aug 22 08:16:34 juju-e4d256-prod-github-runner-207 kernel: [10368.611963] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 08:16:34 juju-e4d256-prod-github-runner-207 kernel: [10368.612771] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 08:16:34 juju-e4d256-prod-github-runner-207 kernel: [10368.613636] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 08:16:34 juju-e4d256-prod-github-runner-207 kernel: [10368.614448] ? __seccomp_filter+0x4a/0x4a0 Aug 22 08:16:34 juju-e4d256-prod-github-runner-207 kernel: [10368.615200] ? __fget_files+0x86/0xc0 Aug 22 08:16:34 juju-e4d256-prod-github-runner-207 kernel: [10368.615903] __x64_sys_ioctl+0x95/0xd0 Aug 22 08:16:34 juju-e4d256-prod-github-runner-207 kernel: [10368.616619] do_syscall_64+0x5c/0xc0 Aug 22 08:16:34 juju-e4d256-prod-github-runner-207 kernel: [10368.617303] ? do_futex+0x162/0x1f0 Aug 22 08:16:34 juju-e4d256-prod-github-runner-207 kernel: [10368.617952] ? __x64_sys_futex+0x78/0x1e0 Aug 22 08:16:34 juju-e4d256-prod-github-runner-207 kernel: [10368.618624] ? __secure_computing+0xa9/0x120 Aug 22 08:16:34 juju-e4d256-prod-github-runner-207 kernel: [10368.619316] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 08:16:34 juju-e4d256-prod-github-runner-207 kernel: [10368.620113] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:16:34 juju-e4d256-prod-github-runner-207 kernel: [10368.620834] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:16:34 juju-e4d256-prod-github-runner-207 kernel: [10368.621561] ? do_syscall_64+0x69/0xc0 Aug 22 08:16:34 juju-e4d256-prod-github-runner-207 kernel: [10368.622206] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:16:34 juju-e4d256-prod-github-runner-207 kernel: [10368.622907] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:16:34 juju-e4d256-prod-github-runner-207 kernel: [10368.623601] ? do_syscall_64+0x69/0xc0 Aug 22 08:16:34 juju-e4d256-prod-github-runner-207 kernel: [10368.624225] ? do_syscall_64+0x69/0xc0 Aug 22 08:16:34 juju-e4d256-prod-github-runner-207 kernel: [10368.624846] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 08:16:34 juju-e4d256-prod-github-runner-207 kernel: [10368.625560] RIP: 0033:0x7faa5d0edaff Aug 22 08:16:34 juju-e4d256-prod-github-runner-207 kernel: [10368.626184] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 08:16:34 juju-e4d256-prod-github-runner-207 kernel: [10368.628185] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 08:16:34 juju-e4d256-prod-github-runner-207 kernel: [10368.629125] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 08:16:34 juju-e4d256-prod-github-runner-207 kernel: [10368.630202] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 08:16:34 juju-e4d256-prod-github-runner-207 kernel: [10368.631092] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 08:16:34 juju-e4d256-prod-github-runner-207 kernel: [10368.631980] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 08:16:34 juju-e4d256-prod-github-runner-207 kernel: [10368.632866] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 08:16:34 juju-e4d256-prod-github-runner-207 kernel: [10368.633763] Aug 22 08:17:02 juju-e4d256-prod-github-runner-207 kernel: [10396.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 9574s! [qemu-system-x86:6715] Aug 22 08:17:02 juju-e4d256-prod-github-runner-207 kernel: [10396.543094] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 08:17:02 juju-e4d256-prod-github-runner-207 kernel: [10396.543170] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 08:17:02 juju-e4d256-prod-github-runner-207 kernel: [10396.555458] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 08:17:02 juju-e4d256-prod-github-runner-207 kernel: [10396.556780] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 08:17:02 juju-e4d256-prod-github-runner-207 kernel: [10396.558004] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:17:02 juju-e4d256-prod-github-runner-207 kernel: [10396.559167] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 08:17:02 juju-e4d256-prod-github-runner-207 kernel: [10396.561845] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 08:17:02 juju-e4d256-prod-github-runner-207 kernel: [10396.562899] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 08:17:02 juju-e4d256-prod-github-runner-207 kernel: [10396.564059] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 08:17:02 juju-e4d256-prod-github-runner-207 kernel: [10396.565245] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 08:17:02 juju-e4d256-prod-github-runner-207 kernel: [10396.566424] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 08:17:02 juju-e4d256-prod-github-runner-207 kernel: [10396.567604] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 08:17:02 juju-e4d256-prod-github-runner-207 kernel: [10396.568788] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 08:17:02 juju-e4d256-prod-github-runner-207 kernel: [10396.570027] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 08:17:02 juju-e4d256-prod-github-runner-207 kernel: [10396.571140] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 08:17:02 juju-e4d256-prod-github-runner-207 kernel: [10396.572377] Call Trace: Aug 22 08:17:02 juju-e4d256-prod-github-runner-207 kernel: [10396.573317] Aug 22 08:17:02 juju-e4d256-prod-github-runner-207 kernel: [10396.574200] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:17:02 juju-e4d256-prod-github-runner-207 kernel: [10396.575246] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:17:02 juju-e4d256-prod-github-runner-207 kernel: [10396.576290] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:17:02 juju-e4d256-prod-github-runner-207 kernel: [10396.577429] ? show_regs.part.0+0x23/0x29 Aug 22 08:17:02 juju-e4d256-prod-github-runner-207 kernel: [10396.578463] ? show_regs.cold+0x8/0xd Aug 22 08:17:02 juju-e4d256-prod-github-runner-207 kernel: [10396.579477] ? watchdog_timer_fn+0x1be/0x220 Aug 22 08:17:02 juju-e4d256-prod-github-runner-207 kernel: [10396.580499] ? lockup_detector_update_enable+0x60/0x60 Aug 22 08:17:02 juju-e4d256-prod-github-runner-207 kernel: [10396.581766] ? __hrtimer_run_queues+0x107/0x230 Aug 22 08:17:02 juju-e4d256-prod-github-runner-207 kernel: [10396.582911] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 08:17:02 juju-e4d256-prod-github-runner-207 kernel: [10396.584028] ? hrtimer_interrupt+0x101/0x220 Aug 22 08:17:02 juju-e4d256-prod-github-runner-207 kernel: [10396.585159] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 08:17:02 juju-e4d256-prod-github-runner-207 kernel: [10396.586378] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 08:17:02 juju-e4d256-prod-github-runner-207 kernel: [10396.587526] Aug 22 08:17:02 juju-e4d256-prod-github-runner-207 kernel: [10396.588433] Aug 22 08:17:02 juju-e4d256-prod-github-runner-207 kernel: [10396.589334] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 08:17:02 juju-e4d256-prod-github-runner-207 kernel: [10396.590468] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:17:02 juju-e4d256-prod-github-runner-207 kernel: [10396.591615] ? _raw_spin_lock+0x22/0x30 Aug 22 08:17:02 juju-e4d256-prod-github-runner-207 kernel: [10396.592641] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:17:02 juju-e4d256-prod-github-runner-207 kernel: [10396.593786] direct_page_fault+0x206/0x310 [kvm] Aug 22 08:17:02 juju-e4d256-prod-github-runner-207 kernel: [10396.594910] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 08:17:02 juju-e4d256-prod-github-runner-207 kernel: [10396.596013] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 08:17:02 juju-e4d256-prod-github-runner-207 kernel: [10396.597127] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 08:17:02 juju-e4d256-prod-github-runner-207 kernel: [10396.598197] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 08:17:02 juju-e4d256-prod-github-runner-207 kernel: [10396.599253] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 08:17:02 juju-e4d256-prod-github-runner-207 kernel: [10396.600340] handle_exit+0x98/0x230 [kvm_amd] Aug 22 08:17:02 juju-e4d256-prod-github-runner-207 kernel: [10396.601346] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 08:17:02 juju-e4d256-prod-github-runner-207 kernel: [10396.602360] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 08:17:02 juju-e4d256-prod-github-runner-207 kernel: [10396.603399] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 08:17:02 juju-e4d256-prod-github-runner-207 kernel: [10396.604407] vcpu_run+0x62/0x2c0 [kvm] Aug 22 08:17:02 juju-e4d256-prod-github-runner-207 kernel: [10396.605325] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 08:17:02 juju-e4d256-prod-github-runner-207 kernel: [10396.606252] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 08:17:02 juju-e4d256-prod-github-runner-207 kernel: [10396.607238] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 08:17:02 juju-e4d256-prod-github-runner-207 kernel: [10396.608135] ? __seccomp_filter+0x4a/0x4a0 Aug 22 08:17:02 juju-e4d256-prod-github-runner-207 kernel: [10396.608988] ? __fget_files+0x86/0xc0 Aug 22 08:17:02 juju-e4d256-prod-github-runner-207 kernel: [10396.609773] __x64_sys_ioctl+0x95/0xd0 Aug 22 08:17:02 juju-e4d256-prod-github-runner-207 kernel: [10396.610547] do_syscall_64+0x5c/0xc0 Aug 22 08:17:02 juju-e4d256-prod-github-runner-207 kernel: [10396.611290] ? do_futex+0x162/0x1f0 Aug 22 08:17:02 juju-e4d256-prod-github-runner-207 kernel: [10396.612036] ? __x64_sys_futex+0x78/0x1e0 Aug 22 08:17:02 juju-e4d256-prod-github-runner-207 kernel: [10396.612826] ? __secure_computing+0xa9/0x120 Aug 22 08:17:02 juju-e4d256-prod-github-runner-207 kernel: [10396.613620] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 08:17:02 juju-e4d256-prod-github-runner-207 kernel: [10396.614498] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:17:02 juju-e4d256-prod-github-runner-207 kernel: [10396.615318] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:17:02 juju-e4d256-prod-github-runner-207 kernel: [10396.616135] ? do_syscall_64+0x69/0xc0 Aug 22 08:17:02 juju-e4d256-prod-github-runner-207 kernel: [10396.616886] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:17:02 juju-e4d256-prod-github-runner-207 kernel: [10396.617687] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:17:02 juju-e4d256-prod-github-runner-207 kernel: [10396.618482] ? do_syscall_64+0x69/0xc0 Aug 22 08:17:02 juju-e4d256-prod-github-runner-207 kernel: [10396.619181] ? do_syscall_64+0x69/0xc0 Aug 22 08:17:02 juju-e4d256-prod-github-runner-207 kernel: [10396.619876] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 08:17:02 juju-e4d256-prod-github-runner-207 kernel: [10396.620689] RIP: 0033:0x7faa5d0edaff Aug 22 08:17:02 juju-e4d256-prod-github-runner-207 kernel: [10396.621409] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 08:17:02 juju-e4d256-prod-github-runner-207 kernel: [10396.623926] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 08:17:02 juju-e4d256-prod-github-runner-207 kernel: [10396.625005] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 08:17:02 juju-e4d256-prod-github-runner-207 kernel: [10396.626038] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 08:17:02 juju-e4d256-prod-github-runner-207 kernel: [10396.627072] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 08:17:02 juju-e4d256-prod-github-runner-207 kernel: [10396.628105] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 08:17:02 juju-e4d256-prod-github-runner-207 kernel: [10396.629149] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 08:17:02 juju-e4d256-prod-github-runner-207 kernel: [10396.630183] Aug 22 08:17:30 juju-e4d256-prod-github-runner-207 kernel: [10424.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 9600s! [qemu-system-x86:6715] Aug 22 08:17:30 juju-e4d256-prod-github-runner-207 kernel: [10424.543826] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 08:17:30 juju-e4d256-prod-github-runner-207 kernel: [10424.544089] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 08:17:30 juju-e4d256-prod-github-runner-207 kernel: [10424.556284] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 08:17:30 juju-e4d256-prod-github-runner-207 kernel: [10424.557567] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 08:17:30 juju-e4d256-prod-github-runner-207 kernel: [10424.558788] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:17:30 juju-e4d256-prod-github-runner-207 kernel: [10424.559851] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 08:17:30 juju-e4d256-prod-github-runner-207 kernel: [10424.562402] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 08:17:30 juju-e4d256-prod-github-runner-207 kernel: [10424.563442] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 08:17:30 juju-e4d256-prod-github-runner-207 kernel: [10424.564610] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 08:17:30 juju-e4d256-prod-github-runner-207 kernel: [10424.565770] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 08:17:30 juju-e4d256-prod-github-runner-207 kernel: [10424.566928] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 08:17:30 juju-e4d256-prod-github-runner-207 kernel: [10424.568106] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 08:17:30 juju-e4d256-prod-github-runner-207 kernel: [10424.569331] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 08:17:30 juju-e4d256-prod-github-runner-207 kernel: [10424.570578] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 08:17:30 juju-e4d256-prod-github-runner-207 kernel: [10424.571676] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 08:17:30 juju-e4d256-prod-github-runner-207 kernel: [10424.572894] Call Trace: Aug 22 08:17:30 juju-e4d256-prod-github-runner-207 kernel: [10424.573806] Aug 22 08:17:30 juju-e4d256-prod-github-runner-207 kernel: [10424.574703] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:17:30 juju-e4d256-prod-github-runner-207 kernel: [10424.575740] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:17:30 juju-e4d256-prod-github-runner-207 kernel: [10424.576798] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:17:30 juju-e4d256-prod-github-runner-207 kernel: [10424.577923] ? show_regs.part.0+0x23/0x29 Aug 22 08:17:30 juju-e4d256-prod-github-runner-207 kernel: [10424.578932] ? show_regs.cold+0x8/0xd Aug 22 08:17:30 juju-e4d256-prod-github-runner-207 kernel: [10424.579904] ? watchdog_timer_fn+0x1be/0x220 Aug 22 08:17:30 juju-e4d256-prod-github-runner-207 kernel: [10424.580927] ? lockup_detector_update_enable+0x60/0x60 Aug 22 08:17:30 juju-e4d256-prod-github-runner-207 kernel: [10424.582006] ? __hrtimer_run_queues+0x107/0x230 Aug 22 08:17:30 juju-e4d256-prod-github-runner-207 kernel: [10424.583057] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 08:17:30 juju-e4d256-prod-github-runner-207 kernel: [10424.584089] ? hrtimer_interrupt+0x101/0x220 Aug 22 08:17:30 juju-e4d256-prod-github-runner-207 kernel: [10424.585123] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 08:17:30 juju-e4d256-prod-github-runner-207 kernel: [10424.586197] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 08:17:30 juju-e4d256-prod-github-runner-207 kernel: [10424.587249] Aug 22 08:17:30 juju-e4d256-prod-github-runner-207 kernel: [10424.588111] Aug 22 08:17:30 juju-e4d256-prod-github-runner-207 kernel: [10424.588962] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 08:17:30 juju-e4d256-prod-github-runner-207 kernel: [10424.589998] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:17:30 juju-e4d256-prod-github-runner-207 kernel: [10424.591049] ? _raw_spin_lock+0x22/0x30 Aug 22 08:17:30 juju-e4d256-prod-github-runner-207 kernel: [10424.592001] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:17:30 juju-e4d256-prod-github-runner-207 kernel: [10424.593036] direct_page_fault+0x206/0x310 [kvm] Aug 22 08:17:30 juju-e4d256-prod-github-runner-207 kernel: [10424.594114] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 08:17:30 juju-e4d256-prod-github-runner-207 kernel: [10424.595125] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 08:17:30 juju-e4d256-prod-github-runner-207 kernel: [10424.596127] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 08:17:30 juju-e4d256-prod-github-runner-207 kernel: [10424.597162] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 08:17:30 juju-e4d256-prod-github-runner-207 kernel: [10424.598107] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 08:17:30 juju-e4d256-prod-github-runner-207 kernel: [10424.599085] handle_exit+0x98/0x230 [kvm_amd] Aug 22 08:17:30 juju-e4d256-prod-github-runner-207 kernel: [10424.599976] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 08:17:30 juju-e4d256-prod-github-runner-207 kernel: [10424.600911] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 08:17:30 juju-e4d256-prod-github-runner-207 kernel: [10424.601851] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 08:17:30 juju-e4d256-prod-github-runner-207 kernel: [10424.602752] vcpu_run+0x62/0x2c0 [kvm] Aug 22 08:17:30 juju-e4d256-prod-github-runner-207 kernel: [10424.603565] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 08:17:30 juju-e4d256-prod-github-runner-207 kernel: [10424.604368] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 08:17:30 juju-e4d256-prod-github-runner-207 kernel: [10424.605288] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 08:17:30 juju-e4d256-prod-github-runner-207 kernel: [10424.606091] ? __seccomp_filter+0x4a/0x4a0 Aug 22 08:17:30 juju-e4d256-prod-github-runner-207 kernel: [10424.607082] ? __fget_files+0x86/0xc0 Aug 22 08:17:30 juju-e4d256-prod-github-runner-207 kernel: [10424.607808] __x64_sys_ioctl+0x95/0xd0 Aug 22 08:17:30 juju-e4d256-prod-github-runner-207 kernel: [10424.608520] do_syscall_64+0x5c/0xc0 Aug 22 08:17:30 juju-e4d256-prod-github-runner-207 kernel: [10424.609188] ? do_futex+0x162/0x1f0 Aug 22 08:17:30 juju-e4d256-prod-github-runner-207 kernel: [10424.609857] ? __x64_sys_futex+0x78/0x1e0 Aug 22 08:17:30 juju-e4d256-prod-github-runner-207 kernel: [10424.610546] ? __secure_computing+0xa9/0x120 Aug 22 08:17:30 juju-e4d256-prod-github-runner-207 kernel: [10424.611243] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 08:17:30 juju-e4d256-prod-github-runner-207 kernel: [10424.612035] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:17:30 juju-e4d256-prod-github-runner-207 kernel: [10424.612798] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:17:30 juju-e4d256-prod-github-runner-207 kernel: [10424.613521] ? do_syscall_64+0x69/0xc0 Aug 22 08:17:30 juju-e4d256-prod-github-runner-207 kernel: [10424.614284] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:17:30 juju-e4d256-prod-github-runner-207 kernel: [10424.615091] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:17:30 juju-e4d256-prod-github-runner-207 kernel: [10424.615885] ? do_syscall_64+0x69/0xc0 Aug 22 08:17:30 juju-e4d256-prod-github-runner-207 kernel: [10424.616614] ? do_syscall_64+0x69/0xc0 Aug 22 08:17:30 juju-e4d256-prod-github-runner-207 kernel: [10424.617347] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 08:17:30 juju-e4d256-prod-github-runner-207 kernel: [10424.618208] RIP: 0033:0x7faa5d0edaff Aug 22 08:17:30 juju-e4d256-prod-github-runner-207 kernel: [10424.618984] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 08:17:30 juju-e4d256-prod-github-runner-207 kernel: [10424.621391] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 08:17:30 juju-e4d256-prod-github-runner-207 kernel: [10424.622509] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 08:17:30 juju-e4d256-prod-github-runner-207 kernel: [10424.623557] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 08:17:30 juju-e4d256-prod-github-runner-207 kernel: [10424.624616] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 08:17:30 juju-e4d256-prod-github-runner-207 kernel: [10424.625658] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 08:17:30 juju-e4d256-prod-github-runner-207 kernel: [10424.626694] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 08:17:30 juju-e4d256-prod-github-runner-207 kernel: [10424.627726] Aug 22 08:17:43 juju-e4d256-prod-github-runner-207 kernel: [10437.884706] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 08:17:43 juju-e4d256-prod-github-runner-207 kernel: [10437.885683] rcu: 1-....: (2572079 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=1243859 Aug 22 08:17:43 juju-e4d256-prod-github-runner-207 kernel: [10437.886800] (t=2580171 jiffies g=23269 q=19057) Aug 22 08:17:43 juju-e4d256-prod-github-runner-207 kernel: [10437.887579] NMI backtrace for cpu 1 Aug 22 08:17:43 juju-e4d256-prod-github-runner-207 kernel: [10437.888304] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 08:17:43 juju-e4d256-prod-github-runner-207 kernel: [10437.889410] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 08:17:43 juju-e4d256-prod-github-runner-207 kernel: [10437.890650] Call Trace: Aug 22 08:17:43 juju-e4d256-prod-github-runner-207 kernel: [10437.891378] Aug 22 08:17:43 juju-e4d256-prod-github-runner-207 kernel: [10437.892068] show_stack+0x52/0x5c Aug 22 08:17:43 juju-e4d256-prod-github-runner-207 kernel: [10437.892871] dump_stack_lvl+0x4a/0x63 Aug 22 08:17:43 juju-e4d256-prod-github-runner-207 kernel: [10437.893690] dump_stack+0x10/0x16 Aug 22 08:17:43 juju-e4d256-prod-github-runner-207 kernel: [10437.894473] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 08:17:43 juju-e4d256-prod-github-runner-207 kernel: [10437.895333] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 08:17:43 juju-e4d256-prod-github-runner-207 kernel: [10437.896192] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 08:17:43 juju-e4d256-prod-github-runner-207 kernel: [10437.897133] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 08:17:43 juju-e4d256-prod-github-runner-207 kernel: [10437.898048] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 08:17:43 juju-e4d256-prod-github-runner-207 kernel: [10437.898946] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 08:17:43 juju-e4d256-prod-github-runner-207 kernel: [10437.899799] print_cpu_stall.cold+0x2f/0xe2 Aug 22 08:17:43 juju-e4d256-prod-github-runner-207 kernel: [10437.900657] ? timekeeping_update+0xf7/0x150 Aug 22 08:17:43 juju-e4d256-prod-github-runner-207 kernel: [10437.901637] check_cpu_stall+0x109/0x270 Aug 22 08:17:43 juju-e4d256-prod-github-runner-207 kernel: [10437.902465] rcu_sched_clock_irq+0x9a/0x250 Aug 22 08:17:43 juju-e4d256-prod-github-runner-207 kernel: [10437.903309] update_process_times+0x94/0xd0 Aug 22 08:17:43 juju-e4d256-prod-github-runner-207 kernel: [10437.904155] tick_sched_handle+0x29/0x70 Aug 22 08:17:43 juju-e4d256-prod-github-runner-207 kernel: [10437.904994] tick_sched_timer+0x8c/0xc0 Aug 22 08:17:43 juju-e4d256-prod-github-runner-207 kernel: [10437.905808] ? tick_nohz_handler+0xb0/0xb0 Aug 22 08:17:43 juju-e4d256-prod-github-runner-207 kernel: [10437.906646] __hrtimer_run_queues+0x107/0x230 Aug 22 08:17:43 juju-e4d256-prod-github-runner-207 kernel: [10437.907511] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 08:17:43 juju-e4d256-prod-github-runner-207 kernel: [10437.908398] hrtimer_interrupt+0x101/0x220 Aug 22 08:17:43 juju-e4d256-prod-github-runner-207 kernel: [10437.909238] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 08:17:43 juju-e4d256-prod-github-runner-207 kernel: [10437.910166] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 08:17:43 juju-e4d256-prod-github-runner-207 kernel: [10437.911059] Aug 22 08:17:43 juju-e4d256-prod-github-runner-207 kernel: [10437.911739] Aug 22 08:17:43 juju-e4d256-prod-github-runner-207 kernel: [10437.912446] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 08:17:43 juju-e4d256-prod-github-runner-207 kernel: [10437.913383] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:17:43 juju-e4d256-prod-github-runner-207 kernel: [10437.914386] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 08:17:43 juju-e4d256-prod-github-runner-207 kernel: [10437.916980] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 08:17:43 juju-e4d256-prod-github-runner-207 kernel: [10437.917957] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 08:17:43 juju-e4d256-prod-github-runner-207 kernel: [10437.919092] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 08:17:43 juju-e4d256-prod-github-runner-207 kernel: [10437.920199] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 08:17:43 juju-e4d256-prod-github-runner-207 kernel: [10437.921312] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 08:17:43 juju-e4d256-prod-github-runner-207 kernel: [10437.922398] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 08:17:43 juju-e4d256-prod-github-runner-207 kernel: [10437.923498] ? _raw_spin_lock+0x22/0x30 Aug 22 08:17:43 juju-e4d256-prod-github-runner-207 kernel: [10437.924373] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:17:43 juju-e4d256-prod-github-runner-207 kernel: [10437.925302] direct_page_fault+0x206/0x310 [kvm] Aug 22 08:17:43 juju-e4d256-prod-github-runner-207 kernel: [10437.926235] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 08:17:43 juju-e4d256-prod-github-runner-207 kernel: [10437.927154] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 08:17:43 juju-e4d256-prod-github-runner-207 kernel: [10437.928063] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 08:17:43 juju-e4d256-prod-github-runner-207 kernel: [10437.928988] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 08:17:43 juju-e4d256-prod-github-runner-207 kernel: [10437.929873] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 08:17:43 juju-e4d256-prod-github-runner-207 kernel: [10437.930809] handle_exit+0x98/0x230 [kvm_amd] Aug 22 08:17:43 juju-e4d256-prod-github-runner-207 kernel: [10437.931647] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 08:17:43 juju-e4d256-prod-github-runner-207 kernel: [10437.932533] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 08:17:43 juju-e4d256-prod-github-runner-207 kernel: [10437.933428] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 08:17:43 juju-e4d256-prod-github-runner-207 kernel: [10437.934316] vcpu_run+0x62/0x2c0 [kvm] Aug 22 08:17:43 juju-e4d256-prod-github-runner-207 kernel: [10437.935106] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 08:17:43 juju-e4d256-prod-github-runner-207 kernel: [10437.935935] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 08:17:43 juju-e4d256-prod-github-runner-207 kernel: [10437.936844] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 08:17:43 juju-e4d256-prod-github-runner-207 kernel: [10437.937714] ? __seccomp_filter+0x4a/0x4a0 Aug 22 08:17:43 juju-e4d256-prod-github-runner-207 kernel: [10437.938538] ? __fget_files+0x86/0xc0 Aug 22 08:17:43 juju-e4d256-prod-github-runner-207 kernel: [10437.939309] __x64_sys_ioctl+0x95/0xd0 Aug 22 08:17:43 juju-e4d256-prod-github-runner-207 kernel: [10437.940078] do_syscall_64+0x5c/0xc0 Aug 22 08:17:43 juju-e4d256-prod-github-runner-207 kernel: [10437.940858] ? do_futex+0x162/0x1f0 Aug 22 08:17:43 juju-e4d256-prod-github-runner-207 kernel: [10437.941603] ? __x64_sys_futex+0x78/0x1e0 Aug 22 08:17:43 juju-e4d256-prod-github-runner-207 kernel: [10437.942377] ? __secure_computing+0xa9/0x120 Aug 22 08:17:43 juju-e4d256-prod-github-runner-207 kernel: [10437.943172] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 08:17:43 juju-e4d256-prod-github-runner-207 kernel: [10437.944068] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:17:43 juju-e4d256-prod-github-runner-207 kernel: [10437.944934] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:17:43 juju-e4d256-prod-github-runner-207 kernel: [10437.945786] ? do_syscall_64+0x69/0xc0 Aug 22 08:17:43 juju-e4d256-prod-github-runner-207 kernel: [10437.946553] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:17:43 juju-e4d256-prod-github-runner-207 kernel: [10437.947397] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:17:43 juju-e4d256-prod-github-runner-207 kernel: [10437.948332] ? do_syscall_64+0x69/0xc0 Aug 22 08:17:43 juju-e4d256-prod-github-runner-207 kernel: [10437.949106] ? do_syscall_64+0x69/0xc0 Aug 22 08:17:43 juju-e4d256-prod-github-runner-207 kernel: [10437.949877] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 08:17:43 juju-e4d256-prod-github-runner-207 kernel: [10437.950757] RIP: 0033:0x7faa5d0edaff Aug 22 08:17:43 juju-e4d256-prod-github-runner-207 kernel: [10437.951514] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 08:17:43 juju-e4d256-prod-github-runner-207 kernel: [10437.954169] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 08:17:43 juju-e4d256-prod-github-runner-207 kernel: [10437.955271] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 08:17:43 juju-e4d256-prod-github-runner-207 kernel: [10437.956372] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 08:17:43 juju-e4d256-prod-github-runner-207 kernel: [10437.957455] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 08:17:43 juju-e4d256-prod-github-runner-207 kernel: [10437.958529] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 08:17:43 juju-e4d256-prod-github-runner-207 kernel: [10437.959597] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 08:17:43 juju-e4d256-prod-github-runner-207 kernel: [10437.960680] Aug 22 08:18:10 juju-e4d256-prod-github-runner-207 kernel: [10464.541981] watchdog: BUG: soft lockup - CPU#1 stuck for 9637s! [qemu-system-x86:6715] Aug 22 08:18:10 juju-e4d256-prod-github-runner-207 kernel: [10464.543101] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 08:18:10 juju-e4d256-prod-github-runner-207 kernel: [10464.543173] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 08:18:10 juju-e4d256-prod-github-runner-207 kernel: [10464.555350] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 08:18:10 juju-e4d256-prod-github-runner-207 kernel: [10464.556649] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 08:18:10 juju-e4d256-prod-github-runner-207 kernel: [10464.557865] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:18:10 juju-e4d256-prod-github-runner-207 kernel: [10464.558927] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 08:18:10 juju-e4d256-prod-github-runner-207 kernel: [10464.561516] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 08:18:10 juju-e4d256-prod-github-runner-207 kernel: [10464.562566] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 08:18:10 juju-e4d256-prod-github-runner-207 kernel: [10464.563726] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 08:18:10 juju-e4d256-prod-github-runner-207 kernel: [10464.564907] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 08:18:10 juju-e4d256-prod-github-runner-207 kernel: [10464.566078] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 08:18:10 juju-e4d256-prod-github-runner-207 kernel: [10464.567240] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 08:18:10 juju-e4d256-prod-github-runner-207 kernel: [10464.568430] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 08:18:10 juju-e4d256-prod-github-runner-207 kernel: [10464.569670] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 08:18:10 juju-e4d256-prod-github-runner-207 kernel: [10464.570783] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 08:18:10 juju-e4d256-prod-github-runner-207 kernel: [10464.572151] Call Trace: Aug 22 08:18:10 juju-e4d256-prod-github-runner-207 kernel: [10464.573085] Aug 22 08:18:10 juju-e4d256-prod-github-runner-207 kernel: [10464.573974] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:18:10 juju-e4d256-prod-github-runner-207 kernel: [10464.575069] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:18:10 juju-e4d256-prod-github-runner-207 kernel: [10464.576202] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:18:10 juju-e4d256-prod-github-runner-207 kernel: [10464.577446] ? show_regs.part.0+0x23/0x29 Aug 22 08:18:10 juju-e4d256-prod-github-runner-207 kernel: [10464.578587] ? show_regs.cold+0x8/0xd Aug 22 08:18:10 juju-e4d256-prod-github-runner-207 kernel: [10464.579813] ? watchdog_timer_fn+0x1be/0x220 Aug 22 08:18:10 juju-e4d256-prod-github-runner-207 kernel: [10464.581292] ? lockup_detector_update_enable+0x60/0x60 Aug 22 08:18:10 juju-e4d256-prod-github-runner-207 kernel: [10464.582500] ? __hrtimer_run_queues+0x107/0x230 Aug 22 08:18:10 juju-e4d256-prod-github-runner-207 kernel: [10464.583706] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 08:18:10 juju-e4d256-prod-github-runner-207 kernel: [10464.584835] ? hrtimer_interrupt+0x101/0x220 Aug 22 08:18:10 juju-e4d256-prod-github-runner-207 kernel: [10464.585976] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 08:18:10 juju-e4d256-prod-github-runner-207 kernel: [10464.587109] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 08:18:10 juju-e4d256-prod-github-runner-207 kernel: [10464.588316] Aug 22 08:18:10 juju-e4d256-prod-github-runner-207 kernel: [10464.589331] Aug 22 08:18:10 juju-e4d256-prod-github-runner-207 kernel: [10464.590314] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 08:18:10 juju-e4d256-prod-github-runner-207 kernel: [10464.591523] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:18:10 juju-e4d256-prod-github-runner-207 kernel: [10464.592785] ? _raw_spin_lock+0x22/0x30 Aug 22 08:18:10 juju-e4d256-prod-github-runner-207 kernel: [10464.593904] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:18:10 juju-e4d256-prod-github-runner-207 kernel: [10464.595017] direct_page_fault+0x206/0x310 [kvm] Aug 22 08:18:10 juju-e4d256-prod-github-runner-207 kernel: [10464.596171] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 08:18:10 juju-e4d256-prod-github-runner-207 kernel: [10464.597316] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 08:18:10 juju-e4d256-prod-github-runner-207 kernel: [10464.598461] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 08:18:10 juju-e4d256-prod-github-runner-207 kernel: [10464.599656] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 08:18:10 juju-e4d256-prod-github-runner-207 kernel: [10464.600705] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 08:18:10 juju-e4d256-prod-github-runner-207 kernel: [10464.601894] handle_exit+0x98/0x230 [kvm_amd] Aug 22 08:18:10 juju-e4d256-prod-github-runner-207 kernel: [10464.602940] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 08:18:10 juju-e4d256-prod-github-runner-207 kernel: [10464.604010] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 08:18:10 juju-e4d256-prod-github-runner-207 kernel: [10464.605007] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 08:18:10 juju-e4d256-prod-github-runner-207 kernel: [10464.606013] vcpu_run+0x62/0x2c0 [kvm] Aug 22 08:18:10 juju-e4d256-prod-github-runner-207 kernel: [10464.606976] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 08:18:10 juju-e4d256-prod-github-runner-207 kernel: [10464.607931] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 08:18:10 juju-e4d256-prod-github-runner-207 kernel: [10464.608858] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 08:18:10 juju-e4d256-prod-github-runner-207 kernel: [10464.609774] ? __seccomp_filter+0x4a/0x4a0 Aug 22 08:18:10 juju-e4d256-prod-github-runner-207 kernel: [10464.610646] ? __fget_files+0x86/0xc0 Aug 22 08:18:10 juju-e4d256-prod-github-runner-207 kernel: [10464.611460] __x64_sys_ioctl+0x95/0xd0 Aug 22 08:18:10 juju-e4d256-prod-github-runner-207 kernel: [10464.612177] do_syscall_64+0x5c/0xc0 Aug 22 08:18:10 juju-e4d256-prod-github-runner-207 kernel: [10464.612915] ? do_futex+0x162/0x1f0 Aug 22 08:18:10 juju-e4d256-prod-github-runner-207 kernel: [10464.613652] ? __x64_sys_futex+0x78/0x1e0 Aug 22 08:18:10 juju-e4d256-prod-github-runner-207 kernel: [10464.614395] ? __secure_computing+0xa9/0x120 Aug 22 08:18:10 juju-e4d256-prod-github-runner-207 kernel: [10464.615148] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 08:18:10 juju-e4d256-prod-github-runner-207 kernel: [10464.615982] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:18:10 juju-e4d256-prod-github-runner-207 kernel: [10464.616805] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:18:10 juju-e4d256-prod-github-runner-207 kernel: [10464.617589] ? do_syscall_64+0x69/0xc0 Aug 22 08:18:10 juju-e4d256-prod-github-runner-207 kernel: [10464.618357] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:18:10 juju-e4d256-prod-github-runner-207 kernel: [10464.619074] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:18:10 juju-e4d256-prod-github-runner-207 kernel: [10464.619812] ? do_syscall_64+0x69/0xc0 Aug 22 08:18:10 juju-e4d256-prod-github-runner-207 kernel: [10464.620527] ? do_syscall_64+0x69/0xc0 Aug 22 08:18:10 juju-e4d256-prod-github-runner-207 kernel: [10464.621247] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 08:18:10 juju-e4d256-prod-github-runner-207 kernel: [10464.622046] RIP: 0033:0x7faa5d0edaff Aug 22 08:18:10 juju-e4d256-prod-github-runner-207 kernel: [10464.622805] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 08:18:10 juju-e4d256-prod-github-runner-207 kernel: [10464.625204] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 08:18:10 juju-e4d256-prod-github-runner-207 kernel: [10464.626455] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 08:18:10 juju-e4d256-prod-github-runner-207 kernel: [10464.627500] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 08:18:10 juju-e4d256-prod-github-runner-207 kernel: [10464.628531] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 08:18:10 juju-e4d256-prod-github-runner-207 kernel: [10464.629553] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 08:18:10 juju-e4d256-prod-github-runner-207 kernel: [10464.630580] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 08:18:10 juju-e4d256-prod-github-runner-207 kernel: [10464.631647] Aug 22 08:18:38 juju-e4d256-prod-github-runner-207 kernel: [10492.541981] watchdog: BUG: soft lockup - CPU#1 stuck for 9663s! [qemu-system-x86:6715] Aug 22 08:18:38 juju-e4d256-prod-github-runner-207 kernel: [10492.543083] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 08:18:38 juju-e4d256-prod-github-runner-207 kernel: [10492.543155] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 08:18:38 juju-e4d256-prod-github-runner-207 kernel: [10492.555531] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 08:18:38 juju-e4d256-prod-github-runner-207 kernel: [10492.556862] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 08:18:38 juju-e4d256-prod-github-runner-207 kernel: [10492.558088] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:18:38 juju-e4d256-prod-github-runner-207 kernel: [10492.559144] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 08:18:38 juju-e4d256-prod-github-runner-207 kernel: [10492.561702] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 08:18:38 juju-e4d256-prod-github-runner-207 kernel: [10492.562771] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 08:18:38 juju-e4d256-prod-github-runner-207 kernel: [10492.563997] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 08:18:38 juju-e4d256-prod-github-runner-207 kernel: [10492.565167] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 08:18:38 juju-e4d256-prod-github-runner-207 kernel: [10492.566328] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 08:18:38 juju-e4d256-prod-github-runner-207 kernel: [10492.567510] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 08:18:38 juju-e4d256-prod-github-runner-207 kernel: [10492.568727] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 08:18:38 juju-e4d256-prod-github-runner-207 kernel: [10492.569998] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 08:18:38 juju-e4d256-prod-github-runner-207 kernel: [10492.571170] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 08:18:38 juju-e4d256-prod-github-runner-207 kernel: [10492.572409] Call Trace: Aug 22 08:18:38 juju-e4d256-prod-github-runner-207 kernel: [10492.573330] Aug 22 08:18:38 juju-e4d256-prod-github-runner-207 kernel: [10492.574237] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:18:38 juju-e4d256-prod-github-runner-207 kernel: [10492.575286] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:18:38 juju-e4d256-prod-github-runner-207 kernel: [10492.576343] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:18:38 juju-e4d256-prod-github-runner-207 kernel: [10492.577423] ? show_regs.part.0+0x23/0x29 Aug 22 08:18:38 juju-e4d256-prod-github-runner-207 kernel: [10492.578433] ? show_regs.cold+0x8/0xd Aug 22 08:18:38 juju-e4d256-prod-github-runner-207 kernel: [10492.579426] ? watchdog_timer_fn+0x1be/0x220 Aug 22 08:18:38 juju-e4d256-prod-github-runner-207 kernel: [10492.580457] ? lockup_detector_update_enable+0x60/0x60 Aug 22 08:18:38 juju-e4d256-prod-github-runner-207 kernel: [10492.581522] ? __hrtimer_run_queues+0x107/0x230 Aug 22 08:18:38 juju-e4d256-prod-github-runner-207 kernel: [10492.582567] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 08:18:38 juju-e4d256-prod-github-runner-207 kernel: [10492.583609] ? hrtimer_interrupt+0x101/0x220 Aug 22 08:18:38 juju-e4d256-prod-github-runner-207 kernel: [10492.584677] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 08:18:38 juju-e4d256-prod-github-runner-207 kernel: [10492.585810] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 08:18:38 juju-e4d256-prod-github-runner-207 kernel: [10492.586866] Aug 22 08:18:38 juju-e4d256-prod-github-runner-207 kernel: [10492.587736] Aug 22 08:18:38 juju-e4d256-prod-github-runner-207 kernel: [10492.588580] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 08:18:38 juju-e4d256-prod-github-runner-207 kernel: [10492.589648] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:18:38 juju-e4d256-prod-github-runner-207 kernel: [10492.590692] ? _raw_spin_lock+0x22/0x30 Aug 22 08:18:38 juju-e4d256-prod-github-runner-207 kernel: [10492.591666] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:18:38 juju-e4d256-prod-github-runner-207 kernel: [10492.592690] direct_page_fault+0x206/0x310 [kvm] Aug 22 08:18:38 juju-e4d256-prod-github-runner-207 kernel: [10492.593733] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 08:18:38 juju-e4d256-prod-github-runner-207 kernel: [10492.594782] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 08:18:38 juju-e4d256-prod-github-runner-207 kernel: [10492.595843] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 08:18:38 juju-e4d256-prod-github-runner-207 kernel: [10492.596845] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 08:18:38 juju-e4d256-prod-github-runner-207 kernel: [10492.597793] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 08:18:38 juju-e4d256-prod-github-runner-207 kernel: [10492.598787] handle_exit+0x98/0x230 [kvm_amd] Aug 22 08:18:38 juju-e4d256-prod-github-runner-207 kernel: [10492.599694] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 08:18:38 juju-e4d256-prod-github-runner-207 kernel: [10492.600608] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 08:18:38 juju-e4d256-prod-github-runner-207 kernel: [10492.601545] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 08:18:38 juju-e4d256-prod-github-runner-207 kernel: [10492.602510] vcpu_run+0x62/0x2c0 [kvm] Aug 22 08:18:38 juju-e4d256-prod-github-runner-207 kernel: [10492.603332] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 08:18:38 juju-e4d256-prod-github-runner-207 kernel: [10492.604171] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 08:18:38 juju-e4d256-prod-github-runner-207 kernel: [10492.605025] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 08:18:38 juju-e4d256-prod-github-runner-207 kernel: [10492.605828] ? __seccomp_filter+0x4a/0x4a0 Aug 22 08:18:38 juju-e4d256-prod-github-runner-207 kernel: [10492.606570] ? __fget_files+0x86/0xc0 Aug 22 08:18:38 juju-e4d256-prod-github-runner-207 kernel: [10492.607287] __x64_sys_ioctl+0x95/0xd0 Aug 22 08:18:38 juju-e4d256-prod-github-runner-207 kernel: [10492.608004] do_syscall_64+0x5c/0xc0 Aug 22 08:18:38 juju-e4d256-prod-github-runner-207 kernel: [10492.608680] ? do_futex+0x162/0x1f0 Aug 22 08:18:38 juju-e4d256-prod-github-runner-207 kernel: [10492.609335] ? __x64_sys_futex+0x78/0x1e0 Aug 22 08:18:38 juju-e4d256-prod-github-runner-207 kernel: [10492.610008] ? __secure_computing+0xa9/0x120 Aug 22 08:18:38 juju-e4d256-prod-github-runner-207 kernel: [10492.610699] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 08:18:38 juju-e4d256-prod-github-runner-207 kernel: [10492.611465] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:18:38 juju-e4d256-prod-github-runner-207 kernel: [10492.612202] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:18:38 juju-e4d256-prod-github-runner-207 kernel: [10492.612921] ? do_syscall_64+0x69/0xc0 Aug 22 08:18:38 juju-e4d256-prod-github-runner-207 kernel: [10492.613571] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:18:38 juju-e4d256-prod-github-runner-207 kernel: [10492.614276] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:18:38 juju-e4d256-prod-github-runner-207 kernel: [10492.614990] ? do_syscall_64+0x69/0xc0 Aug 22 08:18:38 juju-e4d256-prod-github-runner-207 kernel: [10492.615635] ? do_syscall_64+0x69/0xc0 Aug 22 08:18:38 juju-e4d256-prod-github-runner-207 kernel: [10492.616260] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 08:18:38 juju-e4d256-prod-github-runner-207 kernel: [10492.616966] RIP: 0033:0x7faa5d0edaff Aug 22 08:18:38 juju-e4d256-prod-github-runner-207 kernel: [10492.617600] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 08:18:38 juju-e4d256-prod-github-runner-207 kernel: [10492.619658] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 08:18:38 juju-e4d256-prod-github-runner-207 kernel: [10492.620595] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 08:18:38 juju-e4d256-prod-github-runner-207 kernel: [10492.621482] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 08:18:38 juju-e4d256-prod-github-runner-207 kernel: [10492.622365] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 08:18:38 juju-e4d256-prod-github-runner-207 kernel: [10492.623279] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 08:18:38 juju-e4d256-prod-github-runner-207 kernel: [10492.624195] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 08:18:38 juju-e4d256-prod-github-runner-207 kernel: [10492.625087] Aug 22 08:19:06 juju-e4d256-prod-github-runner-207 kernel: [10520.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 9690s! [qemu-system-x86:6715] Aug 22 08:19:06 juju-e4d256-prod-github-runner-207 kernel: [10520.543857] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 08:19:06 juju-e4d256-prod-github-runner-207 kernel: [10520.544146] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 08:19:06 juju-e4d256-prod-github-runner-207 kernel: [10520.556305] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 08:19:06 juju-e4d256-prod-github-runner-207 kernel: [10520.557582] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 08:19:06 juju-e4d256-prod-github-runner-207 kernel: [10520.558804] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:19:06 juju-e4d256-prod-github-runner-207 kernel: [10520.559873] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 08:19:06 juju-e4d256-prod-github-runner-207 kernel: [10520.562443] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 08:19:06 juju-e4d256-prod-github-runner-207 kernel: [10520.563509] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 08:19:06 juju-e4d256-prod-github-runner-207 kernel: [10520.564677] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 08:19:06 juju-e4d256-prod-github-runner-207 kernel: [10520.565836] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 08:19:06 juju-e4d256-prod-github-runner-207 kernel: [10520.566994] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 08:19:06 juju-e4d256-prod-github-runner-207 kernel: [10520.568171] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 08:19:06 juju-e4d256-prod-github-runner-207 kernel: [10520.569397] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 08:19:06 juju-e4d256-prod-github-runner-207 kernel: [10520.570635] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 08:19:06 juju-e4d256-prod-github-runner-207 kernel: [10520.571773] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 08:19:06 juju-e4d256-prod-github-runner-207 kernel: [10520.572976] Call Trace: Aug 22 08:19:06 juju-e4d256-prod-github-runner-207 kernel: [10520.574069] Aug 22 08:19:06 juju-e4d256-prod-github-runner-207 kernel: [10520.574970] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:19:06 juju-e4d256-prod-github-runner-207 kernel: [10520.576007] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:19:06 juju-e4d256-prod-github-runner-207 kernel: [10520.577027] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:19:06 juju-e4d256-prod-github-runner-207 kernel: [10520.578121] ? show_regs.part.0+0x23/0x29 Aug 22 08:19:06 juju-e4d256-prod-github-runner-207 kernel: [10520.579117] ? show_regs.cold+0x8/0xd Aug 22 08:19:06 juju-e4d256-prod-github-runner-207 kernel: [10520.580106] ? watchdog_timer_fn+0x1be/0x220 Aug 22 08:19:06 juju-e4d256-prod-github-runner-207 kernel: [10520.581118] ? lockup_detector_update_enable+0x60/0x60 Aug 22 08:19:06 juju-e4d256-prod-github-runner-207 kernel: [10520.582179] ? __hrtimer_run_queues+0x107/0x230 Aug 22 08:19:06 juju-e4d256-prod-github-runner-207 kernel: [10520.583209] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 08:19:06 juju-e4d256-prod-github-runner-207 kernel: [10520.584243] ? hrtimer_interrupt+0x101/0x220 Aug 22 08:19:06 juju-e4d256-prod-github-runner-207 kernel: [10520.585281] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 08:19:06 juju-e4d256-prod-github-runner-207 kernel: [10520.586353] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 08:19:06 juju-e4d256-prod-github-runner-207 kernel: [10520.587404] Aug 22 08:19:06 juju-e4d256-prod-github-runner-207 kernel: [10520.588257] Aug 22 08:19:06 juju-e4d256-prod-github-runner-207 kernel: [10520.589093] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 08:19:06 juju-e4d256-prod-github-runner-207 kernel: [10520.590126] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:19:06 juju-e4d256-prod-github-runner-207 kernel: [10520.591165] ? _raw_spin_lock+0x22/0x30 Aug 22 08:19:06 juju-e4d256-prod-github-runner-207 kernel: [10520.592118] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:19:06 juju-e4d256-prod-github-runner-207 kernel: [10520.593136] direct_page_fault+0x206/0x310 [kvm] Aug 22 08:19:06 juju-e4d256-prod-github-runner-207 kernel: [10520.594161] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 08:19:06 juju-e4d256-prod-github-runner-207 kernel: [10520.595170] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 08:19:06 juju-e4d256-prod-github-runner-207 kernel: [10520.596181] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 08:19:06 juju-e4d256-prod-github-runner-207 kernel: [10520.597357] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 08:19:06 juju-e4d256-prod-github-runner-207 kernel: [10520.598304] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 08:19:06 juju-e4d256-prod-github-runner-207 kernel: [10520.599292] handle_exit+0x98/0x230 [kvm_amd] Aug 22 08:19:06 juju-e4d256-prod-github-runner-207 kernel: [10520.600186] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 08:19:06 juju-e4d256-prod-github-runner-207 kernel: [10520.601102] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 08:19:06 juju-e4d256-prod-github-runner-207 kernel: [10520.602041] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 08:19:06 juju-e4d256-prod-github-runner-207 kernel: [10520.602947] vcpu_run+0x62/0x2c0 [kvm] Aug 22 08:19:06 juju-e4d256-prod-github-runner-207 kernel: [10520.603905] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 08:19:06 juju-e4d256-prod-github-runner-207 kernel: [10520.604726] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 08:19:06 juju-e4d256-prod-github-runner-207 kernel: [10520.605586] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 08:19:06 juju-e4d256-prod-github-runner-207 kernel: [10520.606384] ? __seccomp_filter+0x4a/0x4a0 Aug 22 08:19:06 juju-e4d256-prod-github-runner-207 kernel: [10520.607212] ? __fget_files+0x86/0xc0 Aug 22 08:19:06 juju-e4d256-prod-github-runner-207 kernel: [10520.607924] __x64_sys_ioctl+0x95/0xd0 Aug 22 08:19:06 juju-e4d256-prod-github-runner-207 kernel: [10520.608616] do_syscall_64+0x5c/0xc0 Aug 22 08:19:06 juju-e4d256-prod-github-runner-207 kernel: [10520.609282] ? do_futex+0x162/0x1f0 Aug 22 08:19:06 juju-e4d256-prod-github-runner-207 kernel: [10520.609931] ? __x64_sys_futex+0x78/0x1e0 Aug 22 08:19:06 juju-e4d256-prod-github-runner-207 kernel: [10520.610646] ? __secure_computing+0xa9/0x120 Aug 22 08:19:06 juju-e4d256-prod-github-runner-207 kernel: [10520.611358] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 08:19:06 juju-e4d256-prod-github-runner-207 kernel: [10520.612117] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:19:06 juju-e4d256-prod-github-runner-207 kernel: [10520.612839] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:19:06 juju-e4d256-prod-github-runner-207 kernel: [10520.613562] ? do_syscall_64+0x69/0xc0 Aug 22 08:19:06 juju-e4d256-prod-github-runner-207 kernel: [10520.614209] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:19:06 juju-e4d256-prod-github-runner-207 kernel: [10520.614912] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:19:06 juju-e4d256-prod-github-runner-207 kernel: [10520.615620] ? do_syscall_64+0x69/0xc0 Aug 22 08:19:06 juju-e4d256-prod-github-runner-207 kernel: [10520.616245] ? do_syscall_64+0x69/0xc0 Aug 22 08:19:06 juju-e4d256-prod-github-runner-207 kernel: [10520.616874] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 08:19:06 juju-e4d256-prod-github-runner-207 kernel: [10520.617585] RIP: 0033:0x7faa5d0edaff Aug 22 08:19:06 juju-e4d256-prod-github-runner-207 kernel: [10520.618234] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 08:19:06 juju-e4d256-prod-github-runner-207 kernel: [10520.620254] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 08:19:06 juju-e4d256-prod-github-runner-207 kernel: [10520.621173] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 08:19:06 juju-e4d256-prod-github-runner-207 kernel: [10520.622129] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 08:19:06 juju-e4d256-prod-github-runner-207 kernel: [10520.623043] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 08:19:06 juju-e4d256-prod-github-runner-207 kernel: [10520.623949] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 08:19:06 juju-e4d256-prod-github-runner-207 kernel: [10520.624905] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 08:19:06 juju-e4d256-prod-github-runner-207 kernel: [10520.625800] Aug 22 08:19:34 juju-e4d256-prod-github-runner-207 kernel: [10548.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 9716s! [qemu-system-x86:6715] Aug 22 08:19:34 juju-e4d256-prod-github-runner-207 kernel: [10548.543289] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 08:19:34 juju-e4d256-prod-github-runner-207 kernel: [10548.543364] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 08:19:34 juju-e4d256-prod-github-runner-207 kernel: [10548.555475] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 08:19:34 juju-e4d256-prod-github-runner-207 kernel: [10548.556737] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 08:19:34 juju-e4d256-prod-github-runner-207 kernel: [10548.557967] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:19:34 juju-e4d256-prod-github-runner-207 kernel: [10548.559035] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 08:19:34 juju-e4d256-prod-github-runner-207 kernel: [10548.561574] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 08:19:34 juju-e4d256-prod-github-runner-207 kernel: [10548.562621] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 08:19:34 juju-e4d256-prod-github-runner-207 kernel: [10548.563798] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 08:19:34 juju-e4d256-prod-github-runner-207 kernel: [10548.564956] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 08:19:34 juju-e4d256-prod-github-runner-207 kernel: [10548.566114] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 08:19:34 juju-e4d256-prod-github-runner-207 kernel: [10548.567285] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 08:19:34 juju-e4d256-prod-github-runner-207 kernel: [10548.568459] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 08:19:34 juju-e4d256-prod-github-runner-207 kernel: [10548.569693] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 08:19:34 juju-e4d256-prod-github-runner-207 kernel: [10548.570787] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 08:19:34 juju-e4d256-prod-github-runner-207 kernel: [10548.571988] Call Trace: Aug 22 08:19:34 juju-e4d256-prod-github-runner-207 kernel: [10548.572904] Aug 22 08:19:34 juju-e4d256-prod-github-runner-207 kernel: [10548.573787] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:19:34 juju-e4d256-prod-github-runner-207 kernel: [10548.574814] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:19:34 juju-e4d256-prod-github-runner-207 kernel: [10548.575875] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:19:34 juju-e4d256-prod-github-runner-207 kernel: [10548.576992] ? show_regs.part.0+0x23/0x29 Aug 22 08:19:34 juju-e4d256-prod-github-runner-207 kernel: [10548.578019] ? show_regs.cold+0x8/0xd Aug 22 08:19:34 juju-e4d256-prod-github-runner-207 kernel: [10548.579018] ? watchdog_timer_fn+0x1be/0x220 Aug 22 08:19:34 juju-e4d256-prod-github-runner-207 kernel: [10548.580038] ? lockup_detector_update_enable+0x60/0x60 Aug 22 08:19:34 juju-e4d256-prod-github-runner-207 kernel: [10548.581109] ? __hrtimer_run_queues+0x107/0x230 Aug 22 08:19:34 juju-e4d256-prod-github-runner-207 kernel: [10548.582136] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 08:19:34 juju-e4d256-prod-github-runner-207 kernel: [10548.583201] ? hrtimer_interrupt+0x101/0x220 Aug 22 08:19:34 juju-e4d256-prod-github-runner-207 kernel: [10548.584226] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 08:19:34 juju-e4d256-prod-github-runner-207 kernel: [10548.585322] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 08:19:34 juju-e4d256-prod-github-runner-207 kernel: [10548.586367] Aug 22 08:19:34 juju-e4d256-prod-github-runner-207 kernel: [10548.587236] Aug 22 08:19:34 juju-e4d256-prod-github-runner-207 kernel: [10548.588073] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 08:19:34 juju-e4d256-prod-github-runner-207 kernel: [10548.589113] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:19:34 juju-e4d256-prod-github-runner-207 kernel: [10548.590164] ? _raw_spin_lock+0x22/0x30 Aug 22 08:19:34 juju-e4d256-prod-github-runner-207 kernel: [10548.591122] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:19:34 juju-e4d256-prod-github-runner-207 kernel: [10548.592144] direct_page_fault+0x206/0x310 [kvm] Aug 22 08:19:34 juju-e4d256-prod-github-runner-207 kernel: [10548.593168] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 08:19:34 juju-e4d256-prod-github-runner-207 kernel: [10548.594186] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 08:19:34 juju-e4d256-prod-github-runner-207 kernel: [10548.595194] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 08:19:34 juju-e4d256-prod-github-runner-207 kernel: [10548.596176] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 08:19:34 juju-e4d256-prod-github-runner-207 kernel: [10548.597131] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 08:19:34 juju-e4d256-prod-github-runner-207 kernel: [10548.598114] handle_exit+0x98/0x230 [kvm_amd] Aug 22 08:19:34 juju-e4d256-prod-github-runner-207 kernel: [10548.599059] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 08:19:34 juju-e4d256-prod-github-runner-207 kernel: [10548.599981] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 08:19:34 juju-e4d256-prod-github-runner-207 kernel: [10548.600911] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 08:19:34 juju-e4d256-prod-github-runner-207 kernel: [10548.601826] vcpu_run+0x62/0x2c0 [kvm] Aug 22 08:19:34 juju-e4d256-prod-github-runner-207 kernel: [10548.602637] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 08:19:34 juju-e4d256-prod-github-runner-207 kernel: [10548.603453] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 08:19:34 juju-e4d256-prod-github-runner-207 kernel: [10548.604322] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 08:19:34 juju-e4d256-prod-github-runner-207 kernel: [10548.605119] ? __seccomp_filter+0x4a/0x4a0 Aug 22 08:19:34 juju-e4d256-prod-github-runner-207 kernel: [10548.605864] ? __fget_files+0x86/0xc0 Aug 22 08:19:34 juju-e4d256-prod-github-runner-207 kernel: [10548.606568] __x64_sys_ioctl+0x95/0xd0 Aug 22 08:19:34 juju-e4d256-prod-github-runner-207 kernel: [10548.607276] do_syscall_64+0x5c/0xc0 Aug 22 08:19:34 juju-e4d256-prod-github-runner-207 kernel: [10548.607941] ? do_futex+0x162/0x1f0 Aug 22 08:19:34 juju-e4d256-prod-github-runner-207 kernel: [10548.608589] ? __x64_sys_futex+0x78/0x1e0 Aug 22 08:19:34 juju-e4d256-prod-github-runner-207 kernel: [10548.609272] ? __secure_computing+0xa9/0x120 Aug 22 08:19:34 juju-e4d256-prod-github-runner-207 kernel: [10548.609986] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 08:19:34 juju-e4d256-prod-github-runner-207 kernel: [10548.610748] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:19:34 juju-e4d256-prod-github-runner-207 kernel: [10548.611490] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:19:34 juju-e4d256-prod-github-runner-207 kernel: [10548.612213] ? do_syscall_64+0x69/0xc0 Aug 22 08:19:34 juju-e4d256-prod-github-runner-207 kernel: [10548.612868] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:19:34 juju-e4d256-prod-github-runner-207 kernel: [10548.613579] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:19:34 juju-e4d256-prod-github-runner-207 kernel: [10548.614289] ? do_syscall_64+0x69/0xc0 Aug 22 08:19:34 juju-e4d256-prod-github-runner-207 kernel: [10548.614941] ? do_syscall_64+0x69/0xc0 Aug 22 08:19:34 juju-e4d256-prod-github-runner-207 kernel: [10548.615562] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 08:19:34 juju-e4d256-prod-github-runner-207 kernel: [10548.616264] RIP: 0033:0x7faa5d0edaff Aug 22 08:19:34 juju-e4d256-prod-github-runner-207 kernel: [10548.616892] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 08:19:34 juju-e4d256-prod-github-runner-207 kernel: [10548.618901] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 08:19:34 juju-e4d256-prod-github-runner-207 kernel: [10548.619989] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 08:19:34 juju-e4d256-prod-github-runner-207 kernel: [10548.620875] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 08:19:34 juju-e4d256-prod-github-runner-207 kernel: [10548.621761] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 08:19:34 juju-e4d256-prod-github-runner-207 kernel: [10548.622645] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 08:19:34 juju-e4d256-prod-github-runner-207 kernel: [10548.623548] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 08:19:34 juju-e4d256-prod-github-runner-207 kernel: [10548.624459] Aug 22 08:20:02 juju-e4d256-prod-github-runner-207 kernel: [10576.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 9742s! [qemu-system-x86:6715] Aug 22 08:20:02 juju-e4d256-prod-github-runner-207 kernel: [10576.543096] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 08:20:02 juju-e4d256-prod-github-runner-207 kernel: [10576.543168] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 08:20:02 juju-e4d256-prod-github-runner-207 kernel: [10576.555371] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 08:20:02 juju-e4d256-prod-github-runner-207 kernel: [10576.556640] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 08:20:02 juju-e4d256-prod-github-runner-207 kernel: [10576.557857] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:20:02 juju-e4d256-prod-github-runner-207 kernel: [10576.558930] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 08:20:02 juju-e4d256-prod-github-runner-207 kernel: [10576.561545] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 08:20:02 juju-e4d256-prod-github-runner-207 kernel: [10576.562615] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 08:20:02 juju-e4d256-prod-github-runner-207 kernel: [10576.563783] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 08:20:02 juju-e4d256-prod-github-runner-207 kernel: [10576.564947] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 08:20:02 juju-e4d256-prod-github-runner-207 kernel: [10576.566116] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 08:20:02 juju-e4d256-prod-github-runner-207 kernel: [10576.567301] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 08:20:02 juju-e4d256-prod-github-runner-207 kernel: [10576.568465] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 08:20:02 juju-e4d256-prod-github-runner-207 kernel: [10576.569701] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 08:20:02 juju-e4d256-prod-github-runner-207 kernel: [10576.570859] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 08:20:02 juju-e4d256-prod-github-runner-207 kernel: [10576.572068] Call Trace: Aug 22 08:20:02 juju-e4d256-prod-github-runner-207 kernel: [10576.573014] Aug 22 08:20:02 juju-e4d256-prod-github-runner-207 kernel: [10576.573904] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:20:02 juju-e4d256-prod-github-runner-207 kernel: [10576.574954] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:20:02 juju-e4d256-prod-github-runner-207 kernel: [10576.576002] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:20:02 juju-e4d256-prod-github-runner-207 kernel: [10576.577099] ? show_regs.part.0+0x23/0x29 Aug 22 08:20:02 juju-e4d256-prod-github-runner-207 kernel: [10576.578105] ? show_regs.cold+0x8/0xd Aug 22 08:20:02 juju-e4d256-prod-github-runner-207 kernel: [10576.579109] ? watchdog_timer_fn+0x1be/0x220 Aug 22 08:20:02 juju-e4d256-prod-github-runner-207 kernel: [10576.580125] ? lockup_detector_update_enable+0x60/0x60 Aug 22 08:20:02 juju-e4d256-prod-github-runner-207 kernel: [10576.581203] ? __hrtimer_run_queues+0x107/0x230 Aug 22 08:20:02 juju-e4d256-prod-github-runner-207 kernel: [10576.582246] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 08:20:02 juju-e4d256-prod-github-runner-207 kernel: [10576.583336] ? hrtimer_interrupt+0x101/0x220 Aug 22 08:20:02 juju-e4d256-prod-github-runner-207 kernel: [10576.584358] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 08:20:02 juju-e4d256-prod-github-runner-207 kernel: [10576.585445] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 08:20:02 juju-e4d256-prod-github-runner-207 kernel: [10576.586723] Aug 22 08:20:02 juju-e4d256-prod-github-runner-207 kernel: [10576.587773] Aug 22 08:20:02 juju-e4d256-prod-github-runner-207 kernel: [10576.588664] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 08:20:02 juju-e4d256-prod-github-runner-207 kernel: [10576.589711] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:20:02 juju-e4d256-prod-github-runner-207 kernel: [10576.590771] ? _raw_spin_lock+0x22/0x30 Aug 22 08:20:02 juju-e4d256-prod-github-runner-207 kernel: [10576.591774] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:20:02 juju-e4d256-prod-github-runner-207 kernel: [10576.592825] direct_page_fault+0x206/0x310 [kvm] Aug 22 08:20:02 juju-e4d256-prod-github-runner-207 kernel: [10576.593855] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 08:20:02 juju-e4d256-prod-github-runner-207 kernel: [10576.594890] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 08:20:02 juju-e4d256-prod-github-runner-207 kernel: [10576.595896] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 08:20:02 juju-e4d256-prod-github-runner-207 kernel: [10576.596867] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 08:20:02 juju-e4d256-prod-github-runner-207 kernel: [10576.597827] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 08:20:02 juju-e4d256-prod-github-runner-207 kernel: [10576.598842] handle_exit+0x98/0x230 [kvm_amd] Aug 22 08:20:02 juju-e4d256-prod-github-runner-207 kernel: [10576.599741] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 08:20:02 juju-e4d256-prod-github-runner-207 kernel: [10576.600713] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 08:20:02 juju-e4d256-prod-github-runner-207 kernel: [10576.601651] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 08:20:02 juju-e4d256-prod-github-runner-207 kernel: [10576.602580] vcpu_run+0x62/0x2c0 [kvm] Aug 22 08:20:02 juju-e4d256-prod-github-runner-207 kernel: [10576.603396] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 08:20:02 juju-e4d256-prod-github-runner-207 kernel: [10576.604252] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 08:20:02 juju-e4d256-prod-github-runner-207 kernel: [10576.605111] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 08:20:02 juju-e4d256-prod-github-runner-207 kernel: [10576.605937] ? __seccomp_filter+0x4a/0x4a0 Aug 22 08:20:02 juju-e4d256-prod-github-runner-207 kernel: [10576.606721] ? __fget_files+0x86/0xc0 Aug 22 08:20:02 juju-e4d256-prod-github-runner-207 kernel: [10576.607430] __x64_sys_ioctl+0x95/0xd0 Aug 22 08:20:02 juju-e4d256-prod-github-runner-207 kernel: [10576.608136] do_syscall_64+0x5c/0xc0 Aug 22 08:20:02 juju-e4d256-prod-github-runner-207 kernel: [10576.608808] ? do_futex+0x162/0x1f0 Aug 22 08:20:02 juju-e4d256-prod-github-runner-207 kernel: [10576.609459] ? __x64_sys_futex+0x78/0x1e0 Aug 22 08:20:02 juju-e4d256-prod-github-runner-207 kernel: [10576.610134] ? __secure_computing+0xa9/0x120 Aug 22 08:20:02 juju-e4d256-prod-github-runner-207 kernel: [10576.610849] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 08:20:02 juju-e4d256-prod-github-runner-207 kernel: [10576.611615] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:20:02 juju-e4d256-prod-github-runner-207 kernel: [10576.612344] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:20:02 juju-e4d256-prod-github-runner-207 kernel: [10576.613064] ? do_syscall_64+0x69/0xc0 Aug 22 08:20:02 juju-e4d256-prod-github-runner-207 kernel: [10576.613726] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:20:02 juju-e4d256-prod-github-runner-207 kernel: [10576.614433] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:20:02 juju-e4d256-prod-github-runner-207 kernel: [10576.615165] ? do_syscall_64+0x69/0xc0 Aug 22 08:20:02 juju-e4d256-prod-github-runner-207 kernel: [10576.615792] ? do_syscall_64+0x69/0xc0 Aug 22 08:20:02 juju-e4d256-prod-github-runner-207 kernel: [10576.616415] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 08:20:02 juju-e4d256-prod-github-runner-207 kernel: [10576.617123] RIP: 0033:0x7faa5d0edaff Aug 22 08:20:02 juju-e4d256-prod-github-runner-207 kernel: [10576.617749] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 08:20:02 juju-e4d256-prod-github-runner-207 kernel: [10576.619762] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 08:20:02 juju-e4d256-prod-github-runner-207 kernel: [10576.620700] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 08:20:02 juju-e4d256-prod-github-runner-207 kernel: [10576.621611] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 08:20:02 juju-e4d256-prod-github-runner-207 kernel: [10576.622558] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 08:20:02 juju-e4d256-prod-github-runner-207 kernel: [10576.623455] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 08:20:02 juju-e4d256-prod-github-runner-207 kernel: [10576.624360] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 08:20:02 juju-e4d256-prod-github-runner-207 kernel: [10576.625258] Aug 22 08:20:30 juju-e4d256-prod-github-runner-207 kernel: [10604.541982] watchdog: BUG: soft lockup - CPU#1 stuck for 9768s! [qemu-system-x86:6715] Aug 22 08:20:30 juju-e4d256-prod-github-runner-207 kernel: [10604.543945] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 08:20:30 juju-e4d256-prod-github-runner-207 kernel: [10604.544237] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 08:20:30 juju-e4d256-prod-github-runner-207 kernel: [10604.557091] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 08:20:30 juju-e4d256-prod-github-runner-207 kernel: [10604.558593] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 08:20:30 juju-e4d256-prod-github-runner-207 kernel: [10604.559982] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:20:30 juju-e4d256-prod-github-runner-207 kernel: [10604.561176] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 08:20:30 juju-e4d256-prod-github-runner-207 kernel: [10604.564111] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 08:20:30 juju-e4d256-prod-github-runner-207 kernel: [10604.565288] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 08:20:30 juju-e4d256-prod-github-runner-207 kernel: [10604.566656] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 08:20:30 juju-e4d256-prod-github-runner-207 kernel: [10604.567997] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 08:20:30 juju-e4d256-prod-github-runner-207 kernel: [10604.569310] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 08:20:30 juju-e4d256-prod-github-runner-207 kernel: [10604.570626] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 08:20:30 juju-e4d256-prod-github-runner-207 kernel: [10604.571928] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 08:20:30 juju-e4d256-prod-github-runner-207 kernel: [10604.573337] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 08:20:30 juju-e4d256-prod-github-runner-207 kernel: [10604.574555] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 08:20:30 juju-e4d256-prod-github-runner-207 kernel: [10604.575778] Call Trace: Aug 22 08:20:30 juju-e4d256-prod-github-runner-207 kernel: [10604.576735] Aug 22 08:20:30 juju-e4d256-prod-github-runner-207 kernel: [10604.577680] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:20:30 juju-e4d256-prod-github-runner-207 kernel: [10604.578785] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:20:30 juju-e4d256-prod-github-runner-207 kernel: [10604.579920] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:20:30 juju-e4d256-prod-github-runner-207 kernel: [10604.581060] ? show_regs.part.0+0x23/0x29 Aug 22 08:20:30 juju-e4d256-prod-github-runner-207 kernel: [10604.582060] ? show_regs.cold+0x8/0xd Aug 22 08:20:30 juju-e4d256-prod-github-runner-207 kernel: [10604.583055] ? watchdog_timer_fn+0x1be/0x220 Aug 22 08:20:30 juju-e4d256-prod-github-runner-207 kernel: [10604.584068] ? lockup_detector_update_enable+0x60/0x60 Aug 22 08:20:30 juju-e4d256-prod-github-runner-207 kernel: [10604.585286] ? __hrtimer_run_queues+0x107/0x230 Aug 22 08:20:30 juju-e4d256-prod-github-runner-207 kernel: [10604.586510] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 08:20:30 juju-e4d256-prod-github-runner-207 kernel: [10604.587589] ? hrtimer_interrupt+0x101/0x220 Aug 22 08:20:30 juju-e4d256-prod-github-runner-207 kernel: [10604.588662] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 08:20:30 juju-e4d256-prod-github-runner-207 kernel: [10604.589783] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 08:20:30 juju-e4d256-prod-github-runner-207 kernel: [10604.590937] Aug 22 08:20:30 juju-e4d256-prod-github-runner-207 kernel: [10604.591847] Aug 22 08:20:30 juju-e4d256-prod-github-runner-207 kernel: [10604.592693] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 08:20:30 juju-e4d256-prod-github-runner-207 kernel: [10604.593730] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:20:30 juju-e4d256-prod-github-runner-207 kernel: [10604.594805] ? _raw_spin_lock+0x22/0x30 Aug 22 08:20:30 juju-e4d256-prod-github-runner-207 kernel: [10604.595951] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:20:30 juju-e4d256-prod-github-runner-207 kernel: [10604.597279] direct_page_fault+0x206/0x310 [kvm] Aug 22 08:20:30 juju-e4d256-prod-github-runner-207 kernel: [10604.598705] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 08:20:30 juju-e4d256-prod-github-runner-207 kernel: [10604.599797] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 08:20:30 juju-e4d256-prod-github-runner-207 kernel: [10604.600815] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 08:20:30 juju-e4d256-prod-github-runner-207 kernel: [10604.601975] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 08:20:30 juju-e4d256-prod-github-runner-207 kernel: [10604.602967] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 08:20:30 juju-e4d256-prod-github-runner-207 kernel: [10604.603958] handle_exit+0x98/0x230 [kvm_amd] Aug 22 08:20:30 juju-e4d256-prod-github-runner-207 kernel: [10604.604860] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 08:20:30 juju-e4d256-prod-github-runner-207 kernel: [10604.605912] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 08:20:30 juju-e4d256-prod-github-runner-207 kernel: [10604.607095] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 08:20:30 juju-e4d256-prod-github-runner-207 kernel: [10604.608202] vcpu_run+0x62/0x2c0 [kvm] Aug 22 08:20:30 juju-e4d256-prod-github-runner-207 kernel: [10604.609121] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 08:20:30 juju-e4d256-prod-github-runner-207 kernel: [10604.610042] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 08:20:30 juju-e4d256-prod-github-runner-207 kernel: [10604.611052] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 08:20:30 juju-e4d256-prod-github-runner-207 kernel: [10604.612001] ? __seccomp_filter+0x4a/0x4a0 Aug 22 08:20:30 juju-e4d256-prod-github-runner-207 kernel: [10604.612835] ? __fget_files+0x86/0xc0 Aug 22 08:20:30 juju-e4d256-prod-github-runner-207 kernel: [10604.613615] __x64_sys_ioctl+0x95/0xd0 Aug 22 08:20:30 juju-e4d256-prod-github-runner-207 kernel: [10604.614414] do_syscall_64+0x5c/0xc0 Aug 22 08:20:30 juju-e4d256-prod-github-runner-207 kernel: [10604.615151] ? do_futex+0x162/0x1f0 Aug 22 08:20:30 juju-e4d256-prod-github-runner-207 kernel: [10604.615872] ? __x64_sys_futex+0x78/0x1e0 Aug 22 08:20:30 juju-e4d256-prod-github-runner-207 kernel: [10604.616656] ? __secure_computing+0xa9/0x120 Aug 22 08:20:30 juju-e4d256-prod-github-runner-207 kernel: [10604.617436] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 08:20:30 juju-e4d256-prod-github-runner-207 kernel: [10604.618362] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:20:30 juju-e4d256-prod-github-runner-207 kernel: [10604.619209] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:20:30 juju-e4d256-prod-github-runner-207 kernel: [10604.620027] ? do_syscall_64+0x69/0xc0 Aug 22 08:20:30 juju-e4d256-prod-github-runner-207 kernel: [10604.620756] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:20:30 juju-e4d256-prod-github-runner-207 kernel: [10604.621555] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:20:30 juju-e4d256-prod-github-runner-207 kernel: [10604.622376] ? do_syscall_64+0x69/0xc0 Aug 22 08:20:30 juju-e4d256-prod-github-runner-207 kernel: [10604.623075] ? do_syscall_64+0x69/0xc0 Aug 22 08:20:30 juju-e4d256-prod-github-runner-207 kernel: [10604.623776] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 08:20:30 juju-e4d256-prod-github-runner-207 kernel: [10604.624582] RIP: 0033:0x7faa5d0edaff Aug 22 08:20:30 juju-e4d256-prod-github-runner-207 kernel: [10604.625329] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 08:20:30 juju-e4d256-prod-github-runner-207 kernel: [10604.627696] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 08:20:30 juju-e4d256-prod-github-runner-207 kernel: [10604.628758] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 08:20:30 juju-e4d256-prod-github-runner-207 kernel: [10604.629788] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 08:20:30 juju-e4d256-prod-github-runner-207 kernel: [10604.630828] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 08:20:30 juju-e4d256-prod-github-runner-207 kernel: [10604.631858] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 08:20:30 juju-e4d256-prod-github-runner-207 kernel: [10604.632917] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 08:20:30 juju-e4d256-prod-github-runner-207 kernel: [10604.633964] Aug 22 08:20:43 juju-e4d256-prod-github-runner-207 kernel: [10617.896705] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 08:20:43 juju-e4d256-prod-github-runner-207 kernel: [10617.897663] rcu: 1-....: (2616941 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=1265443 Aug 22 08:20:43 juju-e4d256-prod-github-runner-207 kernel: [10617.898813] (t=2625174 jiffies g=23269 q=19170) Aug 22 08:20:43 juju-e4d256-prod-github-runner-207 kernel: [10617.899603] NMI backtrace for cpu 1 Aug 22 08:20:43 juju-e4d256-prod-github-runner-207 kernel: [10617.900314] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 08:20:43 juju-e4d256-prod-github-runner-207 kernel: [10617.901431] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 08:20:43 juju-e4d256-prod-github-runner-207 kernel: [10617.902528] Call Trace: Aug 22 08:20:43 juju-e4d256-prod-github-runner-207 kernel: [10617.903206] Aug 22 08:20:43 juju-e4d256-prod-github-runner-207 kernel: [10617.903853] show_stack+0x52/0x5c Aug 22 08:20:43 juju-e4d256-prod-github-runner-207 kernel: [10617.904581] dump_stack_lvl+0x4a/0x63 Aug 22 08:20:43 juju-e4d256-prod-github-runner-207 kernel: [10617.905328] dump_stack+0x10/0x16 Aug 22 08:20:43 juju-e4d256-prod-github-runner-207 kernel: [10617.906069] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 08:20:43 juju-e4d256-prod-github-runner-207 kernel: [10617.906861] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 08:20:43 juju-e4d256-prod-github-runner-207 kernel: [10617.907645] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 08:20:43 juju-e4d256-prod-github-runner-207 kernel: [10617.908472] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 08:20:43 juju-e4d256-prod-github-runner-207 kernel: [10617.909302] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 08:20:43 juju-e4d256-prod-github-runner-207 kernel: [10617.910128] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 08:20:43 juju-e4d256-prod-github-runner-207 kernel: [10617.910908] print_cpu_stall.cold+0x2f/0xe2 Aug 22 08:20:43 juju-e4d256-prod-github-runner-207 kernel: [10617.911684] ? timekeeping_update+0xf7/0x150 Aug 22 08:20:43 juju-e4d256-prod-github-runner-207 kernel: [10617.912462] check_cpu_stall+0x109/0x270 Aug 22 08:20:43 juju-e4d256-prod-github-runner-207 kernel: [10617.913214] rcu_sched_clock_irq+0x9a/0x250 Aug 22 08:20:43 juju-e4d256-prod-github-runner-207 kernel: [10617.913982] update_process_times+0x94/0xd0 Aug 22 08:20:43 juju-e4d256-prod-github-runner-207 kernel: [10617.914764] tick_sched_handle+0x29/0x70 Aug 22 08:20:43 juju-e4d256-prod-github-runner-207 kernel: [10617.915532] tick_sched_timer+0x8c/0xc0 Aug 22 08:20:43 juju-e4d256-prod-github-runner-207 kernel: [10617.916293] ? tick_nohz_handler+0xb0/0xb0 Aug 22 08:20:43 juju-e4d256-prod-github-runner-207 kernel: [10617.917054] __hrtimer_run_queues+0x107/0x230 Aug 22 08:20:43 juju-e4d256-prod-github-runner-207 kernel: [10617.917841] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 08:20:43 juju-e4d256-prod-github-runner-207 kernel: [10617.918643] hrtimer_interrupt+0x101/0x220 Aug 22 08:20:43 juju-e4d256-prod-github-runner-207 kernel: [10617.919407] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 08:20:43 juju-e4d256-prod-github-runner-207 kernel: [10617.920227] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 08:20:43 juju-e4d256-prod-github-runner-207 kernel: [10617.921219] Aug 22 08:20:43 juju-e4d256-prod-github-runner-207 kernel: [10617.921860] Aug 22 08:20:43 juju-e4d256-prod-github-runner-207 kernel: [10617.922502] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 08:20:43 juju-e4d256-prod-github-runner-207 kernel: [10617.923328] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:20:43 juju-e4d256-prod-github-runner-207 kernel: [10617.924217] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 08:20:43 juju-e4d256-prod-github-runner-207 kernel: [10617.926479] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 08:20:43 juju-e4d256-prod-github-runner-207 kernel: [10617.927365] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 08:20:43 juju-e4d256-prod-github-runner-207 kernel: [10617.928378] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 08:20:43 juju-e4d256-prod-github-runner-207 kernel: [10617.929377] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 08:20:43 juju-e4d256-prod-github-runner-207 kernel: [10617.930387] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 08:20:43 juju-e4d256-prod-github-runner-207 kernel: [10617.931465] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 08:20:43 juju-e4d256-prod-github-runner-207 kernel: [10617.932476] ? _raw_spin_lock+0x22/0x30 Aug 22 08:20:43 juju-e4d256-prod-github-runner-207 kernel: [10617.933429] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:20:43 juju-e4d256-prod-github-runner-207 kernel: [10617.934333] direct_page_fault+0x206/0x310 [kvm] Aug 22 08:20:43 juju-e4d256-prod-github-runner-207 kernel: [10617.935200] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 08:20:43 juju-e4d256-prod-github-runner-207 kernel: [10617.936056] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 08:20:43 juju-e4d256-prod-github-runner-207 kernel: [10617.936891] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 08:20:43 juju-e4d256-prod-github-runner-207 kernel: [10617.937705] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 08:20:43 juju-e4d256-prod-github-runner-207 kernel: [10617.938526] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 08:20:43 juju-e4d256-prod-github-runner-207 kernel: [10617.939365] handle_exit+0x98/0x230 [kvm_amd] Aug 22 08:20:43 juju-e4d256-prod-github-runner-207 kernel: [10617.940137] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 08:20:43 juju-e4d256-prod-github-runner-207 kernel: [10617.940929] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 08:20:43 juju-e4d256-prod-github-runner-207 kernel: [10617.941735] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 08:20:43 juju-e4d256-prod-github-runner-207 kernel: [10617.942540] vcpu_run+0x62/0x2c0 [kvm] Aug 22 08:20:43 juju-e4d256-prod-github-runner-207 kernel: [10617.943263] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 08:20:43 juju-e4d256-prod-github-runner-207 kernel: [10617.944005] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 08:20:43 juju-e4d256-prod-github-runner-207 kernel: [10617.944840] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 08:20:43 juju-e4d256-prod-github-runner-207 kernel: [10617.945644] ? __seccomp_filter+0x4a/0x4a0 Aug 22 08:20:43 juju-e4d256-prod-github-runner-207 kernel: [10617.946408] ? __fget_files+0x86/0xc0 Aug 22 08:20:43 juju-e4d256-prod-github-runner-207 kernel: [10617.947110] __x64_sys_ioctl+0x95/0xd0 Aug 22 08:20:43 juju-e4d256-prod-github-runner-207 kernel: [10617.947809] do_syscall_64+0x5c/0xc0 Aug 22 08:20:43 juju-e4d256-prod-github-runner-207 kernel: [10617.948495] ? do_futex+0x162/0x1f0 Aug 22 08:20:43 juju-e4d256-prod-github-runner-207 kernel: [10617.949174] ? __x64_sys_futex+0x78/0x1e0 Aug 22 08:20:43 juju-e4d256-prod-github-runner-207 kernel: [10617.949894] ? __secure_computing+0xa9/0x120 Aug 22 08:20:43 juju-e4d256-prod-github-runner-207 kernel: [10617.950636] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 08:20:43 juju-e4d256-prod-github-runner-207 kernel: [10617.951437] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:20:43 juju-e4d256-prod-github-runner-207 kernel: [10617.952199] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:20:43 juju-e4d256-prod-github-runner-207 kernel: [10617.952968] ? do_syscall_64+0x69/0xc0 Aug 22 08:20:43 juju-e4d256-prod-github-runner-207 kernel: [10617.953663] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:20:43 juju-e4d256-prod-github-runner-207 kernel: [10617.954487] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:20:43 juju-e4d256-prod-github-runner-207 kernel: [10617.955259] ? do_syscall_64+0x69/0xc0 Aug 22 08:20:43 juju-e4d256-prod-github-runner-207 kernel: [10617.955957] ? do_syscall_64+0x69/0xc0 Aug 22 08:20:43 juju-e4d256-prod-github-runner-207 kernel: [10617.956647] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 08:20:43 juju-e4d256-prod-github-runner-207 kernel: [10617.957427] RIP: 0033:0x7faa5d0edaff Aug 22 08:20:43 juju-e4d256-prod-github-runner-207 kernel: [10617.958131] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 08:20:43 juju-e4d256-prod-github-runner-207 kernel: [10617.960267] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 08:20:43 juju-e4d256-prod-github-runner-207 kernel: [10617.961241] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 08:20:43 juju-e4d256-prod-github-runner-207 kernel: [10617.962252] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 08:20:43 juju-e4d256-prod-github-runner-207 kernel: [10617.963210] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 08:20:43 juju-e4d256-prod-github-runner-207 kernel: [10617.964162] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 08:20:43 juju-e4d256-prod-github-runner-207 kernel: [10617.965118] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 08:20:43 juju-e4d256-prod-github-runner-207 kernel: [10617.966058] Aug 22 08:21:10 juju-e4d256-prod-github-runner-207 kernel: [10644.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 9805s! [qemu-system-x86:6715] Aug 22 08:21:10 juju-e4d256-prod-github-runner-207 kernel: [10644.543093] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 08:21:10 juju-e4d256-prod-github-runner-207 kernel: [10644.543165] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 08:21:10 juju-e4d256-prod-github-runner-207 kernel: [10644.555724] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 08:21:10 juju-e4d256-prod-github-runner-207 kernel: [10644.557028] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 08:21:10 juju-e4d256-prod-github-runner-207 kernel: [10644.558301] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:21:10 juju-e4d256-prod-github-runner-207 kernel: [10644.559380] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 08:21:10 juju-e4d256-prod-github-runner-207 kernel: [10644.561987] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 08:21:10 juju-e4d256-prod-github-runner-207 kernel: [10644.563042] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 08:21:10 juju-e4d256-prod-github-runner-207 kernel: [10644.564217] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 08:21:10 juju-e4d256-prod-github-runner-207 kernel: [10644.565388] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 08:21:10 juju-e4d256-prod-github-runner-207 kernel: [10644.566576] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 08:21:10 juju-e4d256-prod-github-runner-207 kernel: [10644.567857] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 08:21:10 juju-e4d256-prod-github-runner-207 kernel: [10644.569314] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 08:21:10 juju-e4d256-prod-github-runner-207 kernel: [10644.570703] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 08:21:10 juju-e4d256-prod-github-runner-207 kernel: [10644.571816] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 08:21:10 juju-e4d256-prod-github-runner-207 kernel: [10644.573032] Call Trace: Aug 22 08:21:10 juju-e4d256-prod-github-runner-207 kernel: [10644.573970] Aug 22 08:21:10 juju-e4d256-prod-github-runner-207 kernel: [10644.574867] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:21:10 juju-e4d256-prod-github-runner-207 kernel: [10644.575963] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:21:10 juju-e4d256-prod-github-runner-207 kernel: [10644.577014] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:21:10 juju-e4d256-prod-github-runner-207 kernel: [10644.578148] ? show_regs.part.0+0x23/0x29 Aug 22 08:21:10 juju-e4d256-prod-github-runner-207 kernel: [10644.579168] ? show_regs.cold+0x8/0xd Aug 22 08:21:10 juju-e4d256-prod-github-runner-207 kernel: [10644.580150] ? watchdog_timer_fn+0x1be/0x220 Aug 22 08:21:10 juju-e4d256-prod-github-runner-207 kernel: [10644.581165] ? lockup_detector_update_enable+0x60/0x60 Aug 22 08:21:10 juju-e4d256-prod-github-runner-207 kernel: [10644.582267] ? __hrtimer_run_queues+0x107/0x230 Aug 22 08:21:10 juju-e4d256-prod-github-runner-207 kernel: [10644.583310] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 08:21:10 juju-e4d256-prod-github-runner-207 kernel: [10644.584354] ? hrtimer_interrupt+0x101/0x220 Aug 22 08:21:10 juju-e4d256-prod-github-runner-207 kernel: [10644.585386] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 08:21:10 juju-e4d256-prod-github-runner-207 kernel: [10644.586482] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 08:21:10 juju-e4d256-prod-github-runner-207 kernel: [10644.587537] Aug 22 08:21:10 juju-e4d256-prod-github-runner-207 kernel: [10644.588395] Aug 22 08:21:10 juju-e4d256-prod-github-runner-207 kernel: [10644.589235] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 08:21:10 juju-e4d256-prod-github-runner-207 kernel: [10644.590296] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:21:10 juju-e4d256-prod-github-runner-207 kernel: [10644.591353] ? _raw_spin_lock+0x22/0x30 Aug 22 08:21:10 juju-e4d256-prod-github-runner-207 kernel: [10644.592313] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:21:10 juju-e4d256-prod-github-runner-207 kernel: [10644.593344] direct_page_fault+0x206/0x310 [kvm] Aug 22 08:21:10 juju-e4d256-prod-github-runner-207 kernel: [10644.594403] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 08:21:10 juju-e4d256-prod-github-runner-207 kernel: [10644.595428] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 08:21:10 juju-e4d256-prod-github-runner-207 kernel: [10644.596444] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 08:21:10 juju-e4d256-prod-github-runner-207 kernel: [10644.597436] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 08:21:10 juju-e4d256-prod-github-runner-207 kernel: [10644.598417] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 08:21:10 juju-e4d256-prod-github-runner-207 kernel: [10644.599409] handle_exit+0x98/0x230 [kvm_amd] Aug 22 08:21:10 juju-e4d256-prod-github-runner-207 kernel: [10644.600317] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 08:21:10 juju-e4d256-prod-github-runner-207 kernel: [10644.601244] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 08:21:10 juju-e4d256-prod-github-runner-207 kernel: [10644.602374] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 08:21:10 juju-e4d256-prod-github-runner-207 kernel: [10644.603294] vcpu_run+0x62/0x2c0 [kvm] Aug 22 08:21:10 juju-e4d256-prod-github-runner-207 kernel: [10644.604312] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 08:21:10 juju-e4d256-prod-github-runner-207 kernel: [10644.605382] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 08:21:10 juju-e4d256-prod-github-runner-207 kernel: [10644.606264] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 08:21:10 juju-e4d256-prod-github-runner-207 kernel: [10644.607074] ? __seccomp_filter+0x4a/0x4a0 Aug 22 08:21:10 juju-e4d256-prod-github-runner-207 kernel: [10644.607853] ? __fget_files+0x86/0xc0 Aug 22 08:21:10 juju-e4d256-prod-github-runner-207 kernel: [10644.608585] __x64_sys_ioctl+0x95/0xd0 Aug 22 08:21:10 juju-e4d256-prod-github-runner-207 kernel: [10644.609300] do_syscall_64+0x5c/0xc0 Aug 22 08:21:10 juju-e4d256-prod-github-runner-207 kernel: [10644.609997] ? do_futex+0x162/0x1f0 Aug 22 08:21:10 juju-e4d256-prod-github-runner-207 kernel: [10644.610662] ? __x64_sys_futex+0x78/0x1e0 Aug 22 08:21:10 juju-e4d256-prod-github-runner-207 kernel: [10644.611345] ? __secure_computing+0xa9/0x120 Aug 22 08:21:10 juju-e4d256-prod-github-runner-207 kernel: [10644.612055] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 08:21:10 juju-e4d256-prod-github-runner-207 kernel: [10644.612832] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:21:10 juju-e4d256-prod-github-runner-207 kernel: [10644.613562] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:21:10 juju-e4d256-prod-github-runner-207 kernel: [10644.614318] ? do_syscall_64+0x69/0xc0 Aug 22 08:21:10 juju-e4d256-prod-github-runner-207 kernel: [10644.614982] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:21:10 juju-e4d256-prod-github-runner-207 kernel: [10644.615694] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:21:10 juju-e4d256-prod-github-runner-207 kernel: [10644.616404] ? do_syscall_64+0x69/0xc0 Aug 22 08:21:10 juju-e4d256-prod-github-runner-207 kernel: [10644.617041] ? do_syscall_64+0x69/0xc0 Aug 22 08:21:10 juju-e4d256-prod-github-runner-207 kernel: [10644.617726] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 08:21:10 juju-e4d256-prod-github-runner-207 kernel: [10644.618533] RIP: 0033:0x7faa5d0edaff Aug 22 08:21:10 juju-e4d256-prod-github-runner-207 kernel: [10644.619171] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 08:21:10 juju-e4d256-prod-github-runner-207 kernel: [10644.621205] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 08:21:10 juju-e4d256-prod-github-runner-207 kernel: [10644.622149] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 08:21:10 juju-e4d256-prod-github-runner-207 kernel: [10644.623055] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 08:21:10 juju-e4d256-prod-github-runner-207 kernel: [10644.623954] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 08:21:10 juju-e4d256-prod-github-runner-207 kernel: [10644.624873] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 08:21:10 juju-e4d256-prod-github-runner-207 kernel: [10644.625813] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 08:21:10 juju-e4d256-prod-github-runner-207 kernel: [10644.626757] Aug 22 08:21:38 juju-e4d256-prod-github-runner-207 kernel: [10672.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 9831s! [qemu-system-x86:6715] Aug 22 08:21:38 juju-e4d256-prod-github-runner-207 kernel: [10672.543087] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 08:21:38 juju-e4d256-prod-github-runner-207 kernel: [10672.543161] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 08:21:38 juju-e4d256-prod-github-runner-207 kernel: [10672.555476] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 08:21:38 juju-e4d256-prod-github-runner-207 kernel: [10672.556760] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 08:21:38 juju-e4d256-prod-github-runner-207 kernel: [10672.558014] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:21:38 juju-e4d256-prod-github-runner-207 kernel: [10672.559077] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 08:21:38 juju-e4d256-prod-github-runner-207 kernel: [10672.561656] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 08:21:38 juju-e4d256-prod-github-runner-207 kernel: [10672.562718] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 08:21:38 juju-e4d256-prod-github-runner-207 kernel: [10672.563886] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 08:21:38 juju-e4d256-prod-github-runner-207 kernel: [10672.565049] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 08:21:38 juju-e4d256-prod-github-runner-207 kernel: [10672.566245] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 08:21:38 juju-e4d256-prod-github-runner-207 kernel: [10672.567477] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 08:21:38 juju-e4d256-prod-github-runner-207 kernel: [10672.568663] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 08:21:38 juju-e4d256-prod-github-runner-207 kernel: [10672.569960] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 08:21:38 juju-e4d256-prod-github-runner-207 kernel: [10672.571069] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 08:21:38 juju-e4d256-prod-github-runner-207 kernel: [10672.572290] Call Trace: Aug 22 08:21:38 juju-e4d256-prod-github-runner-207 kernel: [10672.573229] Aug 22 08:21:38 juju-e4d256-prod-github-runner-207 kernel: [10672.574183] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:21:38 juju-e4d256-prod-github-runner-207 kernel: [10672.575265] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:21:38 juju-e4d256-prod-github-runner-207 kernel: [10672.576303] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:21:38 juju-e4d256-prod-github-runner-207 kernel: [10672.577427] ? show_regs.part.0+0x23/0x29 Aug 22 08:21:38 juju-e4d256-prod-github-runner-207 kernel: [10672.578452] ? show_regs.cold+0x8/0xd Aug 22 08:21:38 juju-e4d256-prod-github-runner-207 kernel: [10672.579442] ? watchdog_timer_fn+0x1be/0x220 Aug 22 08:21:38 juju-e4d256-prod-github-runner-207 kernel: [10672.580457] ? lockup_detector_update_enable+0x60/0x60 Aug 22 08:21:38 juju-e4d256-prod-github-runner-207 kernel: [10672.581543] ? __hrtimer_run_queues+0x107/0x230 Aug 22 08:21:38 juju-e4d256-prod-github-runner-207 kernel: [10672.582579] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 08:21:38 juju-e4d256-prod-github-runner-207 kernel: [10672.583617] ? hrtimer_interrupt+0x101/0x220 Aug 22 08:21:38 juju-e4d256-prod-github-runner-207 kernel: [10672.584639] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 08:21:38 juju-e4d256-prod-github-runner-207 kernel: [10672.585748] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 08:21:38 juju-e4d256-prod-github-runner-207 kernel: [10672.586804] Aug 22 08:21:38 juju-e4d256-prod-github-runner-207 kernel: [10672.587659] Aug 22 08:21:38 juju-e4d256-prod-github-runner-207 kernel: [10672.588620] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 08:21:38 juju-e4d256-prod-github-runner-207 kernel: [10672.589681] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:21:38 juju-e4d256-prod-github-runner-207 kernel: [10672.590727] ? _raw_spin_lock+0x22/0x30 Aug 22 08:21:38 juju-e4d256-prod-github-runner-207 kernel: [10672.591717] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:21:38 juju-e4d256-prod-github-runner-207 kernel: [10672.592744] direct_page_fault+0x206/0x310 [kvm] Aug 22 08:21:38 juju-e4d256-prod-github-runner-207 kernel: [10672.593962] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 08:21:38 juju-e4d256-prod-github-runner-207 kernel: [10672.594978] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 08:21:38 juju-e4d256-prod-github-runner-207 kernel: [10672.595983] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 08:21:38 juju-e4d256-prod-github-runner-207 kernel: [10672.596971] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 08:21:38 juju-e4d256-prod-github-runner-207 kernel: [10672.597978] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 08:21:38 juju-e4d256-prod-github-runner-207 kernel: [10672.598983] handle_exit+0x98/0x230 [kvm_amd] Aug 22 08:21:38 juju-e4d256-prod-github-runner-207 kernel: [10672.599885] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 08:21:38 juju-e4d256-prod-github-runner-207 kernel: [10672.600804] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 08:21:38 juju-e4d256-prod-github-runner-207 kernel: [10672.601749] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 08:21:38 juju-e4d256-prod-github-runner-207 kernel: [10672.602663] vcpu_run+0x62/0x2c0 [kvm] Aug 22 08:21:38 juju-e4d256-prod-github-runner-207 kernel: [10672.603484] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 08:21:38 juju-e4d256-prod-github-runner-207 kernel: [10672.604300] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 08:21:38 juju-e4d256-prod-github-runner-207 kernel: [10672.605184] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 08:21:38 juju-e4d256-prod-github-runner-207 kernel: [10672.606008] ? __seccomp_filter+0x4a/0x4a0 Aug 22 08:21:38 juju-e4d256-prod-github-runner-207 kernel: [10672.606755] ? __fget_files+0x86/0xc0 Aug 22 08:21:38 juju-e4d256-prod-github-runner-207 kernel: [10672.607462] __x64_sys_ioctl+0x95/0xd0 Aug 22 08:21:38 juju-e4d256-prod-github-runner-207 kernel: [10672.608178] do_syscall_64+0x5c/0xc0 Aug 22 08:21:38 juju-e4d256-prod-github-runner-207 kernel: [10672.608852] ? do_futex+0x162/0x1f0 Aug 22 08:21:38 juju-e4d256-prod-github-runner-207 kernel: [10672.609531] ? __x64_sys_futex+0x78/0x1e0 Aug 22 08:21:38 juju-e4d256-prod-github-runner-207 kernel: [10672.610213] ? __secure_computing+0xa9/0x120 Aug 22 08:21:38 juju-e4d256-prod-github-runner-207 kernel: [10672.610910] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 08:21:38 juju-e4d256-prod-github-runner-207 kernel: [10672.611685] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:21:38 juju-e4d256-prod-github-runner-207 kernel: [10672.612475] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:21:38 juju-e4d256-prod-github-runner-207 kernel: [10672.613215] ? do_syscall_64+0x69/0xc0 Aug 22 08:21:38 juju-e4d256-prod-github-runner-207 kernel: [10672.613881] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:21:38 juju-e4d256-prod-github-runner-207 kernel: [10672.614590] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:21:38 juju-e4d256-prod-github-runner-207 kernel: [10672.615304] ? do_syscall_64+0x69/0xc0 Aug 22 08:21:38 juju-e4d256-prod-github-runner-207 kernel: [10672.615943] ? do_syscall_64+0x69/0xc0 Aug 22 08:21:38 juju-e4d256-prod-github-runner-207 kernel: [10672.616572] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 08:21:38 juju-e4d256-prod-github-runner-207 kernel: [10672.617285] RIP: 0033:0x7faa5d0edaff Aug 22 08:21:38 juju-e4d256-prod-github-runner-207 kernel: [10672.617994] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 08:21:38 juju-e4d256-prod-github-runner-207 kernel: [10672.620031] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 08:21:38 juju-e4d256-prod-github-runner-207 kernel: [10672.620959] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 08:21:38 juju-e4d256-prod-github-runner-207 kernel: [10672.621878] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 08:21:38 juju-e4d256-prod-github-runner-207 kernel: [10672.622779] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 08:21:38 juju-e4d256-prod-github-runner-207 kernel: [10672.623682] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 08:21:38 juju-e4d256-prod-github-runner-207 kernel: [10672.624583] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 08:21:38 juju-e4d256-prod-github-runner-207 kernel: [10672.625502] Aug 22 08:22:06 juju-e4d256-prod-github-runner-207 kernel: [10700.541976] watchdog: BUG: soft lockup - CPU#1 stuck for 9857s! [qemu-system-x86:6715] Aug 22 08:22:06 juju-e4d256-prod-github-runner-207 kernel: [10700.543837] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 08:22:06 juju-e4d256-prod-github-runner-207 kernel: [10700.544126] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 08:22:06 juju-e4d256-prod-github-runner-207 kernel: [10700.556176] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 08:22:06 juju-e4d256-prod-github-runner-207 kernel: [10700.557482] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 08:22:06 juju-e4d256-prod-github-runner-207 kernel: [10700.558703] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:22:06 juju-e4d256-prod-github-runner-207 kernel: [10700.559758] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 08:22:06 juju-e4d256-prod-github-runner-207 kernel: [10700.562306] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 08:22:06 juju-e4d256-prod-github-runner-207 kernel: [10700.563346] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 08:22:06 juju-e4d256-prod-github-runner-207 kernel: [10700.564503] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 08:22:06 juju-e4d256-prod-github-runner-207 kernel: [10700.565687] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 08:22:06 juju-e4d256-prod-github-runner-207 kernel: [10700.566903] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 08:22:06 juju-e4d256-prod-github-runner-207 kernel: [10700.568066] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 08:22:06 juju-e4d256-prod-github-runner-207 kernel: [10700.569247] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 08:22:06 juju-e4d256-prod-github-runner-207 kernel: [10700.570478] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 08:22:06 juju-e4d256-prod-github-runner-207 kernel: [10700.571573] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 08:22:06 juju-e4d256-prod-github-runner-207 kernel: [10700.572763] Call Trace: Aug 22 08:22:06 juju-e4d256-prod-github-runner-207 kernel: [10700.573686] Aug 22 08:22:06 juju-e4d256-prod-github-runner-207 kernel: [10700.574578] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:22:06 juju-e4d256-prod-github-runner-207 kernel: [10700.575607] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:22:06 juju-e4d256-prod-github-runner-207 kernel: [10700.576624] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:22:06 juju-e4d256-prod-github-runner-207 kernel: [10700.577723] ? show_regs.part.0+0x23/0x29 Aug 22 08:22:06 juju-e4d256-prod-github-runner-207 kernel: [10700.578718] ? show_regs.cold+0x8/0xd Aug 22 08:22:06 juju-e4d256-prod-github-runner-207 kernel: [10700.579687] ? watchdog_timer_fn+0x1be/0x220 Aug 22 08:22:06 juju-e4d256-prod-github-runner-207 kernel: [10700.580693] ? lockup_detector_update_enable+0x60/0x60 Aug 22 08:22:06 juju-e4d256-prod-github-runner-207 kernel: [10700.581765] ? __hrtimer_run_queues+0x107/0x230 Aug 22 08:22:06 juju-e4d256-prod-github-runner-207 kernel: [10700.582790] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 08:22:06 juju-e4d256-prod-github-runner-207 kernel: [10700.583816] ? hrtimer_interrupt+0x101/0x220 Aug 22 08:22:06 juju-e4d256-prod-github-runner-207 kernel: [10700.584828] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 08:22:06 juju-e4d256-prod-github-runner-207 kernel: [10700.586019] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 08:22:06 juju-e4d256-prod-github-runner-207 kernel: [10700.587067] Aug 22 08:22:06 juju-e4d256-prod-github-runner-207 kernel: [10700.588084] Aug 22 08:22:06 juju-e4d256-prod-github-runner-207 kernel: [10700.588922] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 08:22:06 juju-e4d256-prod-github-runner-207 kernel: [10700.589966] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:22:06 juju-e4d256-prod-github-runner-207 kernel: [10700.591008] ? _raw_spin_lock+0x22/0x30 Aug 22 08:22:06 juju-e4d256-prod-github-runner-207 kernel: [10700.591950] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:22:06 juju-e4d256-prod-github-runner-207 kernel: [10700.592963] direct_page_fault+0x206/0x310 [kvm] Aug 22 08:22:06 juju-e4d256-prod-github-runner-207 kernel: [10700.594001] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 08:22:06 juju-e4d256-prod-github-runner-207 kernel: [10700.595021] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 08:22:06 juju-e4d256-prod-github-runner-207 kernel: [10700.596021] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 08:22:06 juju-e4d256-prod-github-runner-207 kernel: [10700.597026] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 08:22:06 juju-e4d256-prod-github-runner-207 kernel: [10700.597970] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 08:22:06 juju-e4d256-prod-github-runner-207 kernel: [10700.598946] handle_exit+0x98/0x230 [kvm_amd] Aug 22 08:22:06 juju-e4d256-prod-github-runner-207 kernel: [10700.599837] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 08:22:06 juju-e4d256-prod-github-runner-207 kernel: [10700.600753] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 08:22:06 juju-e4d256-prod-github-runner-207 kernel: [10700.601687] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 08:22:06 juju-e4d256-prod-github-runner-207 kernel: [10700.602592] vcpu_run+0x62/0x2c0 [kvm] Aug 22 08:22:06 juju-e4d256-prod-github-runner-207 kernel: [10700.603446] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 08:22:06 juju-e4d256-prod-github-runner-207 kernel: [10700.604253] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 08:22:06 juju-e4d256-prod-github-runner-207 kernel: [10700.605115] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 08:22:06 juju-e4d256-prod-github-runner-207 kernel: [10700.605912] ? __seccomp_filter+0x4a/0x4a0 Aug 22 08:22:06 juju-e4d256-prod-github-runner-207 kernel: [10700.606652] ? __fget_files+0x86/0xc0 Aug 22 08:22:06 juju-e4d256-prod-github-runner-207 kernel: [10700.607354] __x64_sys_ioctl+0x95/0xd0 Aug 22 08:22:06 juju-e4d256-prod-github-runner-207 kernel: [10700.608048] do_syscall_64+0x5c/0xc0 Aug 22 08:22:06 juju-e4d256-prod-github-runner-207 kernel: [10700.608716] ? do_futex+0x162/0x1f0 Aug 22 08:22:06 juju-e4d256-prod-github-runner-207 kernel: [10700.609378] ? __x64_sys_futex+0x78/0x1e0 Aug 22 08:22:06 juju-e4d256-prod-github-runner-207 kernel: [10700.610052] ? __secure_computing+0xa9/0x120 Aug 22 08:22:06 juju-e4d256-prod-github-runner-207 kernel: [10700.610740] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 08:22:06 juju-e4d256-prod-github-runner-207 kernel: [10700.611499] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:22:06 juju-e4d256-prod-github-runner-207 kernel: [10700.612219] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:22:06 juju-e4d256-prod-github-runner-207 kernel: [10700.612935] ? do_syscall_64+0x69/0xc0 Aug 22 08:22:06 juju-e4d256-prod-github-runner-207 kernel: [10700.613583] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:22:06 juju-e4d256-prod-github-runner-207 kernel: [10700.614285] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:22:06 juju-e4d256-prod-github-runner-207 kernel: [10700.614983] ? do_syscall_64+0x69/0xc0 Aug 22 08:22:06 juju-e4d256-prod-github-runner-207 kernel: [10700.615612] ? do_syscall_64+0x69/0xc0 Aug 22 08:22:06 juju-e4d256-prod-github-runner-207 kernel: [10700.616233] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 08:22:06 juju-e4d256-prod-github-runner-207 kernel: [10700.616938] RIP: 0033:0x7faa5d0edaff Aug 22 08:22:06 juju-e4d256-prod-github-runner-207 kernel: [10700.617583] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 08:22:06 juju-e4d256-prod-github-runner-207 kernel: [10700.619562] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 08:22:06 juju-e4d256-prod-github-runner-207 kernel: [10700.620469] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 08:22:06 juju-e4d256-prod-github-runner-207 kernel: [10700.621367] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 08:22:06 juju-e4d256-prod-github-runner-207 kernel: [10700.622254] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 08:22:06 juju-e4d256-prod-github-runner-207 kernel: [10700.623138] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 08:22:06 juju-e4d256-prod-github-runner-207 kernel: [10700.624023] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 08:22:06 juju-e4d256-prod-github-runner-207 kernel: [10700.624911] Aug 22 08:22:34 juju-e4d256-prod-github-runner-207 kernel: [10728.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 9883s! [qemu-system-x86:6715] Aug 22 08:22:34 juju-e4d256-prod-github-runner-207 kernel: [10728.543069] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 08:22:34 juju-e4d256-prod-github-runner-207 kernel: [10728.543143] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 08:22:34 juju-e4d256-prod-github-runner-207 kernel: [10728.555230] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 08:22:34 juju-e4d256-prod-github-runner-207 kernel: [10728.556497] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 08:22:34 juju-e4d256-prod-github-runner-207 kernel: [10728.557749] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:22:34 juju-e4d256-prod-github-runner-207 kernel: [10728.558810] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 08:22:34 juju-e4d256-prod-github-runner-207 kernel: [10728.561357] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 08:22:34 juju-e4d256-prod-github-runner-207 kernel: [10728.562425] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 08:22:34 juju-e4d256-prod-github-runner-207 kernel: [10728.563603] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 08:22:34 juju-e4d256-prod-github-runner-207 kernel: [10728.564785] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 08:22:34 juju-e4d256-prod-github-runner-207 kernel: [10728.565944] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 08:22:34 juju-e4d256-prod-github-runner-207 kernel: [10728.567123] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 08:22:34 juju-e4d256-prod-github-runner-207 kernel: [10728.568292] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 08:22:34 juju-e4d256-prod-github-runner-207 kernel: [10728.569533] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 08:22:34 juju-e4d256-prod-github-runner-207 kernel: [10728.570634] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 08:22:34 juju-e4d256-prod-github-runner-207 kernel: [10728.571831] Call Trace: Aug 22 08:22:34 juju-e4d256-prod-github-runner-207 kernel: [10728.572758] Aug 22 08:22:34 juju-e4d256-prod-github-runner-207 kernel: [10728.573650] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:22:34 juju-e4d256-prod-github-runner-207 kernel: [10728.574683] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:22:34 juju-e4d256-prod-github-runner-207 kernel: [10728.575704] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:22:34 juju-e4d256-prod-github-runner-207 kernel: [10728.576793] ? show_regs.part.0+0x23/0x29 Aug 22 08:22:34 juju-e4d256-prod-github-runner-207 kernel: [10728.577789] ? show_regs.cold+0x8/0xd Aug 22 08:22:34 juju-e4d256-prod-github-runner-207 kernel: [10728.578759] ? watchdog_timer_fn+0x1be/0x220 Aug 22 08:22:34 juju-e4d256-prod-github-runner-207 kernel: [10728.579765] ? lockup_detector_update_enable+0x60/0x60 Aug 22 08:22:34 juju-e4d256-prod-github-runner-207 kernel: [10728.580838] ? __hrtimer_run_queues+0x107/0x230 Aug 22 08:22:34 juju-e4d256-prod-github-runner-207 kernel: [10728.581877] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 08:22:34 juju-e4d256-prod-github-runner-207 kernel: [10728.582914] ? hrtimer_interrupt+0x101/0x220 Aug 22 08:22:34 juju-e4d256-prod-github-runner-207 kernel: [10728.583968] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 08:22:34 juju-e4d256-prod-github-runner-207 kernel: [10728.585069] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 08:22:34 juju-e4d256-prod-github-runner-207 kernel: [10728.586118] Aug 22 08:22:34 juju-e4d256-prod-github-runner-207 kernel: [10728.586978] Aug 22 08:22:34 juju-e4d256-prod-github-runner-207 kernel: [10728.587820] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 08:22:34 juju-e4d256-prod-github-runner-207 kernel: [10728.588862] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:22:34 juju-e4d256-prod-github-runner-207 kernel: [10728.589908] ? _raw_spin_lock+0x22/0x30 Aug 22 08:22:34 juju-e4d256-prod-github-runner-207 kernel: [10728.590853] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:22:34 juju-e4d256-prod-github-runner-207 kernel: [10728.591877] direct_page_fault+0x206/0x310 [kvm] Aug 22 08:22:34 juju-e4d256-prod-github-runner-207 kernel: [10728.592912] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 08:22:34 juju-e4d256-prod-github-runner-207 kernel: [10728.593928] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 08:22:34 juju-e4d256-prod-github-runner-207 kernel: [10728.594929] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 08:22:34 juju-e4d256-prod-github-runner-207 kernel: [10728.595905] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 08:22:34 juju-e4d256-prod-github-runner-207 kernel: [10728.596865] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 08:22:34 juju-e4d256-prod-github-runner-207 kernel: [10728.597844] handle_exit+0x98/0x230 [kvm_amd] Aug 22 08:22:34 juju-e4d256-prod-github-runner-207 kernel: [10728.598737] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 08:22:34 juju-e4d256-prod-github-runner-207 kernel: [10728.599650] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 08:22:34 juju-e4d256-prod-github-runner-207 kernel: [10728.600573] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 08:22:34 juju-e4d256-prod-github-runner-207 kernel: [10728.601505] vcpu_run+0x62/0x2c0 [kvm] Aug 22 08:22:34 juju-e4d256-prod-github-runner-207 kernel: [10728.602324] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 08:22:34 juju-e4d256-prod-github-runner-207 kernel: [10728.603150] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 08:22:34 juju-e4d256-prod-github-runner-207 kernel: [10728.604036] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 08:22:34 juju-e4d256-prod-github-runner-207 kernel: [10728.604852] ? __seccomp_filter+0x4a/0x4a0 Aug 22 08:22:34 juju-e4d256-prod-github-runner-207 kernel: [10728.605596] ? __fget_files+0x86/0xc0 Aug 22 08:22:34 juju-e4d256-prod-github-runner-207 kernel: [10728.606381] __x64_sys_ioctl+0x95/0xd0 Aug 22 08:22:34 juju-e4d256-prod-github-runner-207 kernel: [10728.607075] do_syscall_64+0x5c/0xc0 Aug 22 08:22:34 juju-e4d256-prod-github-runner-207 kernel: [10728.607741] ? do_futex+0x162/0x1f0 Aug 22 08:22:34 juju-e4d256-prod-github-runner-207 kernel: [10728.608389] ? __x64_sys_futex+0x78/0x1e0 Aug 22 08:22:34 juju-e4d256-prod-github-runner-207 kernel: [10728.609238] ? __secure_computing+0xa9/0x120 Aug 22 08:22:34 juju-e4d256-prod-github-runner-207 kernel: [10728.610187] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 08:22:34 juju-e4d256-prod-github-runner-207 kernel: [10728.611059] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:22:34 juju-e4d256-prod-github-runner-207 kernel: [10728.611880] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:22:34 juju-e4d256-prod-github-runner-207 kernel: [10728.612719] ? do_syscall_64+0x69/0xc0 Aug 22 08:22:34 juju-e4d256-prod-github-runner-207 kernel: [10728.613458] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:22:34 juju-e4d256-prod-github-runner-207 kernel: [10728.614255] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:22:34 juju-e4d256-prod-github-runner-207 kernel: [10728.615075] ? do_syscall_64+0x69/0xc0 Aug 22 08:22:34 juju-e4d256-prod-github-runner-207 kernel: [10728.615788] ? do_syscall_64+0x69/0xc0 Aug 22 08:22:34 juju-e4d256-prod-github-runner-207 kernel: [10728.616492] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 08:22:34 juju-e4d256-prod-github-runner-207 kernel: [10728.617320] RIP: 0033:0x7faa5d0edaff Aug 22 08:22:34 juju-e4d256-prod-github-runner-207 kernel: [10728.618026] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 08:22:34 juju-e4d256-prod-github-runner-207 kernel: [10728.620362] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 08:22:34 juju-e4d256-prod-github-runner-207 kernel: [10728.621450] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 08:22:34 juju-e4d256-prod-github-runner-207 kernel: [10728.622479] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 08:22:34 juju-e4d256-prod-github-runner-207 kernel: [10728.623511] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 08:22:34 juju-e4d256-prod-github-runner-207 kernel: [10728.624538] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 08:22:34 juju-e4d256-prod-github-runner-207 kernel: [10728.625579] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 08:22:34 juju-e4d256-prod-github-runner-207 kernel: [10728.626622] Aug 22 08:23:02 juju-e4d256-prod-github-runner-207 kernel: [10756.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 9909s! [qemu-system-x86:6715] Aug 22 08:23:02 juju-e4d256-prod-github-runner-207 kernel: [10756.543286] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 08:23:02 juju-e4d256-prod-github-runner-207 kernel: [10756.543376] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 08:23:02 juju-e4d256-prod-github-runner-207 kernel: [10756.556343] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 08:23:02 juju-e4d256-prod-github-runner-207 kernel: [10756.557701] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 08:23:02 juju-e4d256-prod-github-runner-207 kernel: [10756.558998] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:23:02 juju-e4d256-prod-github-runner-207 kernel: [10756.560112] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 08:23:02 juju-e4d256-prod-github-runner-207 kernel: [10756.563014] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 08:23:02 juju-e4d256-prod-github-runner-207 kernel: [10756.564099] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 08:23:02 juju-e4d256-prod-github-runner-207 kernel: [10756.565309] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 08:23:02 juju-e4d256-prod-github-runner-207 kernel: [10756.566469] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 08:23:02 juju-e4d256-prod-github-runner-207 kernel: [10756.567659] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 08:23:02 juju-e4d256-prod-github-runner-207 kernel: [10756.568881] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 08:23:02 juju-e4d256-prod-github-runner-207 kernel: [10756.570285] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 08:23:02 juju-e4d256-prod-github-runner-207 kernel: [10756.571566] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 08:23:02 juju-e4d256-prod-github-runner-207 kernel: [10756.572726] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 08:23:02 juju-e4d256-prod-github-runner-207 kernel: [10756.573918] Call Trace: Aug 22 08:23:02 juju-e4d256-prod-github-runner-207 kernel: [10756.574854] Aug 22 08:23:02 juju-e4d256-prod-github-runner-207 kernel: [10756.575747] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:23:02 juju-e4d256-prod-github-runner-207 kernel: [10756.576786] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:23:02 juju-e4d256-prod-github-runner-207 kernel: [10756.577805] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:23:02 juju-e4d256-prod-github-runner-207 kernel: [10756.578892] ? show_regs.part.0+0x23/0x29 Aug 22 08:23:02 juju-e4d256-prod-github-runner-207 kernel: [10756.579936] ? show_regs.cold+0x8/0xd Aug 22 08:23:02 juju-e4d256-prod-github-runner-207 kernel: [10756.580944] ? watchdog_timer_fn+0x1be/0x220 Aug 22 08:23:02 juju-e4d256-prod-github-runner-207 kernel: [10756.581954] ? lockup_detector_update_enable+0x60/0x60 Aug 22 08:23:02 juju-e4d256-prod-github-runner-207 kernel: [10756.583059] ? __hrtimer_run_queues+0x107/0x230 Aug 22 08:23:02 juju-e4d256-prod-github-runner-207 kernel: [10756.584270] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 08:23:02 juju-e4d256-prod-github-runner-207 kernel: [10756.585338] ? hrtimer_interrupt+0x101/0x220 Aug 22 08:23:02 juju-e4d256-prod-github-runner-207 kernel: [10756.586466] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 08:23:02 juju-e4d256-prod-github-runner-207 kernel: [10756.587544] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 08:23:02 juju-e4d256-prod-github-runner-207 kernel: [10756.588609] Aug 22 08:23:02 juju-e4d256-prod-github-runner-207 kernel: [10756.589476] Aug 22 08:23:02 juju-e4d256-prod-github-runner-207 kernel: [10756.590332] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 08:23:02 juju-e4d256-prod-github-runner-207 kernel: [10756.591364] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:23:02 juju-e4d256-prod-github-runner-207 kernel: [10756.592412] ? _raw_spin_lock+0x22/0x30 Aug 22 08:23:02 juju-e4d256-prod-github-runner-207 kernel: [10756.593355] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:23:02 juju-e4d256-prod-github-runner-207 kernel: [10756.594381] direct_page_fault+0x206/0x310 [kvm] Aug 22 08:23:02 juju-e4d256-prod-github-runner-207 kernel: [10756.595448] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 08:23:02 juju-e4d256-prod-github-runner-207 kernel: [10756.596522] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 08:23:02 juju-e4d256-prod-github-runner-207 kernel: [10756.597696] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 08:23:02 juju-e4d256-prod-github-runner-207 kernel: [10756.598679] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 08:23:02 juju-e4d256-prod-github-runner-207 kernel: [10756.599711] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 08:23:02 juju-e4d256-prod-github-runner-207 kernel: [10756.600712] handle_exit+0x98/0x230 [kvm_amd] Aug 22 08:23:02 juju-e4d256-prod-github-runner-207 kernel: [10756.601624] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 08:23:02 juju-e4d256-prod-github-runner-207 kernel: [10756.602565] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 08:23:02 juju-e4d256-prod-github-runner-207 kernel: [10756.603553] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 08:23:02 juju-e4d256-prod-github-runner-207 kernel: [10756.604529] vcpu_run+0x62/0x2c0 [kvm] Aug 22 08:23:02 juju-e4d256-prod-github-runner-207 kernel: [10756.605361] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 08:23:02 juju-e4d256-prod-github-runner-207 kernel: [10756.606197] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 08:23:02 juju-e4d256-prod-github-runner-207 kernel: [10756.607127] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 08:23:02 juju-e4d256-prod-github-runner-207 kernel: [10756.607940] ? __seccomp_filter+0x4a/0x4a0 Aug 22 08:23:02 juju-e4d256-prod-github-runner-207 kernel: [10756.608815] ? __fget_files+0x86/0xc0 Aug 22 08:23:02 juju-e4d256-prod-github-runner-207 kernel: [10756.609700] __x64_sys_ioctl+0x95/0xd0 Aug 22 08:23:02 juju-e4d256-prod-github-runner-207 kernel: [10756.610485] do_syscall_64+0x5c/0xc0 Aug 22 08:23:02 juju-e4d256-prod-github-runner-207 kernel: [10756.611181] ? do_futex+0x162/0x1f0 Aug 22 08:23:02 juju-e4d256-prod-github-runner-207 kernel: [10756.611870] ? __x64_sys_futex+0x78/0x1e0 Aug 22 08:23:02 juju-e4d256-prod-github-runner-207 kernel: [10756.612568] ? __secure_computing+0xa9/0x120 Aug 22 08:23:02 juju-e4d256-prod-github-runner-207 kernel: [10756.613268] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 08:23:02 juju-e4d256-prod-github-runner-207 kernel: [10756.614039] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:23:02 juju-e4d256-prod-github-runner-207 kernel: [10756.614773] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:23:02 juju-e4d256-prod-github-runner-207 kernel: [10756.615494] ? do_syscall_64+0x69/0xc0 Aug 22 08:23:02 juju-e4d256-prod-github-runner-207 kernel: [10756.616147] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:23:02 juju-e4d256-prod-github-runner-207 kernel: [10756.616890] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:23:02 juju-e4d256-prod-github-runner-207 kernel: [10756.617586] ? do_syscall_64+0x69/0xc0 Aug 22 08:23:02 juju-e4d256-prod-github-runner-207 kernel: [10756.618215] ? do_syscall_64+0x69/0xc0 Aug 22 08:23:02 juju-e4d256-prod-github-runner-207 kernel: [10756.618835] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 08:23:02 juju-e4d256-prod-github-runner-207 kernel: [10756.619577] RIP: 0033:0x7faa5d0edaff Aug 22 08:23:02 juju-e4d256-prod-github-runner-207 kernel: [10756.620210] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 08:23:02 juju-e4d256-prod-github-runner-207 kernel: [10756.622272] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 08:23:02 juju-e4d256-prod-github-runner-207 kernel: [10756.623347] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 08:23:02 juju-e4d256-prod-github-runner-207 kernel: [10756.624305] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 08:23:02 juju-e4d256-prod-github-runner-207 kernel: [10756.625202] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 08:23:02 juju-e4d256-prod-github-runner-207 kernel: [10756.626150] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 08:23:02 juju-e4d256-prod-github-runner-207 kernel: [10756.627125] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 08:23:02 juju-e4d256-prod-github-runner-207 kernel: [10756.628170] Aug 22 08:23:30 juju-e4d256-prod-github-runner-207 kernel: [10784.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 9935s! [qemu-system-x86:6715] Aug 22 08:23:30 juju-e4d256-prod-github-runner-207 kernel: [10784.543881] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 08:23:30 juju-e4d256-prod-github-runner-207 kernel: [10784.544197] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 08:23:30 juju-e4d256-prod-github-runner-207 kernel: [10784.556314] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 08:23:30 juju-e4d256-prod-github-runner-207 kernel: [10784.557580] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 08:23:30 juju-e4d256-prod-github-runner-207 kernel: [10784.558805] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:23:30 juju-e4d256-prod-github-runner-207 kernel: [10784.559874] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 08:23:30 juju-e4d256-prod-github-runner-207 kernel: [10784.562458] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 08:23:30 juju-e4d256-prod-github-runner-207 kernel: [10784.563503] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 08:23:30 juju-e4d256-prod-github-runner-207 kernel: [10784.564678] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 08:23:30 juju-e4d256-prod-github-runner-207 kernel: [10784.565844] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 08:23:30 juju-e4d256-prod-github-runner-207 kernel: [10784.567006] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 08:23:30 juju-e4d256-prod-github-runner-207 kernel: [10784.568182] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 08:23:30 juju-e4d256-prod-github-runner-207 kernel: [10784.569357] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 08:23:30 juju-e4d256-prod-github-runner-207 kernel: [10784.570617] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 08:23:30 juju-e4d256-prod-github-runner-207 kernel: [10784.571718] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 08:23:30 juju-e4d256-prod-github-runner-207 kernel: [10784.572938] Call Trace: Aug 22 08:23:30 juju-e4d256-prod-github-runner-207 kernel: [10784.573867] Aug 22 08:23:30 juju-e4d256-prod-github-runner-207 kernel: [10784.574771] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:23:30 juju-e4d256-prod-github-runner-207 kernel: [10784.575821] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:23:30 juju-e4d256-prod-github-runner-207 kernel: [10784.576853] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:23:30 juju-e4d256-prod-github-runner-207 kernel: [10784.577956] ? show_regs.part.0+0x23/0x29 Aug 22 08:23:30 juju-e4d256-prod-github-runner-207 kernel: [10784.578953] ? show_regs.cold+0x8/0xd Aug 22 08:23:30 juju-e4d256-prod-github-runner-207 kernel: [10784.579926] ? watchdog_timer_fn+0x1be/0x220 Aug 22 08:23:30 juju-e4d256-prod-github-runner-207 kernel: [10784.580953] ? lockup_detector_update_enable+0x60/0x60 Aug 22 08:23:30 juju-e4d256-prod-github-runner-207 kernel: [10784.582019] ? __hrtimer_run_queues+0x107/0x230 Aug 22 08:23:30 juju-e4d256-prod-github-runner-207 kernel: [10784.583048] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 08:23:30 juju-e4d256-prod-github-runner-207 kernel: [10784.584086] ? hrtimer_interrupt+0x101/0x220 Aug 22 08:23:30 juju-e4d256-prod-github-runner-207 kernel: [10784.585102] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 08:23:30 juju-e4d256-prod-github-runner-207 kernel: [10784.586186] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 08:23:30 juju-e4d256-prod-github-runner-207 kernel: [10784.587232] Aug 22 08:23:30 juju-e4d256-prod-github-runner-207 kernel: [10784.588125] Aug 22 08:23:30 juju-e4d256-prod-github-runner-207 kernel: [10784.588964] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 08:23:30 juju-e4d256-prod-github-runner-207 kernel: [10784.590004] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:23:30 juju-e4d256-prod-github-runner-207 kernel: [10784.591065] ? _raw_spin_lock+0x22/0x30 Aug 22 08:23:30 juju-e4d256-prod-github-runner-207 kernel: [10784.592030] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:23:30 juju-e4d256-prod-github-runner-207 kernel: [10784.593056] direct_page_fault+0x206/0x310 [kvm] Aug 22 08:23:30 juju-e4d256-prod-github-runner-207 kernel: [10784.594081] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 08:23:30 juju-e4d256-prod-github-runner-207 kernel: [10784.595091] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 08:23:30 juju-e4d256-prod-github-runner-207 kernel: [10784.596109] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 08:23:30 juju-e4d256-prod-github-runner-207 kernel: [10784.597124] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 08:23:30 juju-e4d256-prod-github-runner-207 kernel: [10784.598074] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 08:23:30 juju-e4d256-prod-github-runner-207 kernel: [10784.599053] handle_exit+0x98/0x230 [kvm_amd] Aug 22 08:23:30 juju-e4d256-prod-github-runner-207 kernel: [10784.599961] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 08:23:30 juju-e4d256-prod-github-runner-207 kernel: [10784.600879] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 08:23:30 juju-e4d256-prod-github-runner-207 kernel: [10784.601821] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 08:23:30 juju-e4d256-prod-github-runner-207 kernel: [10784.602754] vcpu_run+0x62/0x2c0 [kvm] Aug 22 08:23:30 juju-e4d256-prod-github-runner-207 kernel: [10784.603581] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 08:23:30 juju-e4d256-prod-github-runner-207 kernel: [10784.604402] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 08:23:30 juju-e4d256-prod-github-runner-207 kernel: [10784.605262] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 08:23:30 juju-e4d256-prod-github-runner-207 kernel: [10784.606076] ? __seccomp_filter+0x4a/0x4a0 Aug 22 08:23:30 juju-e4d256-prod-github-runner-207 kernel: [10784.606825] ? __fget_files+0x86/0xc0 Aug 22 08:23:30 juju-e4d256-prod-github-runner-207 kernel: [10784.607527] __x64_sys_ioctl+0x95/0xd0 Aug 22 08:23:30 juju-e4d256-prod-github-runner-207 kernel: [10784.608231] do_syscall_64+0x5c/0xc0 Aug 22 08:23:30 juju-e4d256-prod-github-runner-207 kernel: [10784.608918] ? do_futex+0x162/0x1f0 Aug 22 08:23:30 juju-e4d256-prod-github-runner-207 kernel: [10784.609577] ? __x64_sys_futex+0x78/0x1e0 Aug 22 08:23:30 juju-e4d256-prod-github-runner-207 kernel: [10784.610253] ? __secure_computing+0xa9/0x120 Aug 22 08:23:30 juju-e4d256-prod-github-runner-207 kernel: [10784.610976] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 08:23:30 juju-e4d256-prod-github-runner-207 kernel: [10784.611734] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:23:30 juju-e4d256-prod-github-runner-207 kernel: [10784.612491] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:23:30 juju-e4d256-prod-github-runner-207 kernel: [10784.613227] ? do_syscall_64+0x69/0xc0 Aug 22 08:23:30 juju-e4d256-prod-github-runner-207 kernel: [10784.613871] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:23:30 juju-e4d256-prod-github-runner-207 kernel: [10784.614572] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:23:30 juju-e4d256-prod-github-runner-207 kernel: [10784.615264] ? do_syscall_64+0x69/0xc0 Aug 22 08:23:30 juju-e4d256-prod-github-runner-207 kernel: [10784.615888] ? do_syscall_64+0x69/0xc0 Aug 22 08:23:30 juju-e4d256-prod-github-runner-207 kernel: [10784.616513] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 08:23:30 juju-e4d256-prod-github-runner-207 kernel: [10784.617219] RIP: 0033:0x7faa5d0edaff Aug 22 08:23:30 juju-e4d256-prod-github-runner-207 kernel: [10784.617873] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 08:23:30 juju-e4d256-prod-github-runner-207 kernel: [10784.619858] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 08:23:30 juju-e4d256-prod-github-runner-207 kernel: [10784.620781] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 08:23:30 juju-e4d256-prod-github-runner-207 kernel: [10784.621680] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 08:23:30 juju-e4d256-prod-github-runner-207 kernel: [10784.622569] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 08:23:30 juju-e4d256-prod-github-runner-207 kernel: [10784.623462] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 08:23:30 juju-e4d256-prod-github-runner-207 kernel: [10784.624366] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 08:23:30 juju-e4d256-prod-github-runner-207 kernel: [10784.625258] Aug 22 08:23:44 juju-e4d256-prod-github-runner-207 kernel: [10797.908707] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 08:23:44 juju-e4d256-prod-github-runner-207 kernel: [10797.909692] rcu: 1-....: (2661807 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=1286989 Aug 22 08:23:44 juju-e4d256-prod-github-runner-207 kernel: [10797.910840] (t=2670177 jiffies g=23269 q=19309) Aug 22 08:23:44 juju-e4d256-prod-github-runner-207 kernel: [10797.911630] NMI backtrace for cpu 1 Aug 22 08:23:44 juju-e4d256-prod-github-runner-207 kernel: [10797.912367] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 08:23:44 juju-e4d256-prod-github-runner-207 kernel: [10797.913493] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 08:23:44 juju-e4d256-prod-github-runner-207 kernel: [10797.914574] Call Trace: Aug 22 08:23:44 juju-e4d256-prod-github-runner-207 kernel: [10797.915251] Aug 22 08:23:44 juju-e4d256-prod-github-runner-207 kernel: [10797.915928] show_stack+0x52/0x5c Aug 22 08:23:44 juju-e4d256-prod-github-runner-207 kernel: [10797.916693] dump_stack_lvl+0x4a/0x63 Aug 22 08:23:44 juju-e4d256-prod-github-runner-207 kernel: [10797.917449] dump_stack+0x10/0x16 Aug 22 08:23:44 juju-e4d256-prod-github-runner-207 kernel: [10797.918190] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 08:23:44 juju-e4d256-prod-github-runner-207 kernel: [10797.918978] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 08:23:44 juju-e4d256-prod-github-runner-207 kernel: [10797.919774] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 08:23:44 juju-e4d256-prod-github-runner-207 kernel: [10797.920620] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 08:23:44 juju-e4d256-prod-github-runner-207 kernel: [10797.921477] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 08:23:44 juju-e4d256-prod-github-runner-207 kernel: [10797.922341] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 08:23:44 juju-e4d256-prod-github-runner-207 kernel: [10797.923150] print_cpu_stall.cold+0x2f/0xe2 Aug 22 08:23:44 juju-e4d256-prod-github-runner-207 kernel: [10797.923960] ? timekeeping_update+0xf7/0x150 Aug 22 08:23:44 juju-e4d256-prod-github-runner-207 kernel: [10797.924742] check_cpu_stall+0x109/0x270 Aug 22 08:23:44 juju-e4d256-prod-github-runner-207 kernel: [10797.925501] rcu_sched_clock_irq+0x9a/0x250 Aug 22 08:23:44 juju-e4d256-prod-github-runner-207 kernel: [10797.926275] update_process_times+0x94/0xd0 Aug 22 08:23:44 juju-e4d256-prod-github-runner-207 kernel: [10797.927043] tick_sched_handle+0x29/0x70 Aug 22 08:23:44 juju-e4d256-prod-github-runner-207 kernel: [10797.927908] tick_sched_timer+0x8c/0xc0 Aug 22 08:23:44 juju-e4d256-prod-github-runner-207 kernel: [10797.928725] ? tick_nohz_handler+0xb0/0xb0 Aug 22 08:23:44 juju-e4d256-prod-github-runner-207 kernel: [10797.929525] __hrtimer_run_queues+0x107/0x230 Aug 22 08:23:44 juju-e4d256-prod-github-runner-207 kernel: [10797.930314] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 08:23:44 juju-e4d256-prod-github-runner-207 kernel: [10797.931101] hrtimer_interrupt+0x101/0x220 Aug 22 08:23:44 juju-e4d256-prod-github-runner-207 kernel: [10797.931892] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 08:23:44 juju-e4d256-prod-github-runner-207 kernel: [10797.932735] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 08:23:44 juju-e4d256-prod-github-runner-207 kernel: [10797.933560] Aug 22 08:23:44 juju-e4d256-prod-github-runner-207 kernel: [10797.934197] Aug 22 08:23:44 juju-e4d256-prod-github-runner-207 kernel: [10797.934831] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 08:23:44 juju-e4d256-prod-github-runner-207 kernel: [10797.935659] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:23:44 juju-e4d256-prod-github-runner-207 kernel: [10797.936573] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 08:23:44 juju-e4d256-prod-github-runner-207 kernel: [10797.938773] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 08:23:44 juju-e4d256-prod-github-runner-207 kernel: [10797.939644] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 08:23:44 juju-e4d256-prod-github-runner-207 kernel: [10797.940650] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 08:23:44 juju-e4d256-prod-github-runner-207 kernel: [10797.941648] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 08:23:44 juju-e4d256-prod-github-runner-207 kernel: [10797.942650] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 08:23:44 juju-e4d256-prod-github-runner-207 kernel: [10797.943607] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 08:23:44 juju-e4d256-prod-github-runner-207 kernel: [10797.944600] ? _raw_spin_lock+0x22/0x30 Aug 22 08:23:44 juju-e4d256-prod-github-runner-207 kernel: [10797.945366] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:23:44 juju-e4d256-prod-github-runner-207 kernel: [10797.946203] direct_page_fault+0x206/0x310 [kvm] Aug 22 08:23:44 juju-e4d256-prod-github-runner-207 kernel: [10797.947046] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 08:23:44 juju-e4d256-prod-github-runner-207 kernel: [10797.947901] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 08:23:44 juju-e4d256-prod-github-runner-207 kernel: [10797.948732] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 08:23:44 juju-e4d256-prod-github-runner-207 kernel: [10797.949534] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 08:23:44 juju-e4d256-prod-github-runner-207 kernel: [10797.950319] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 08:23:44 juju-e4d256-prod-github-runner-207 kernel: [10797.951140] handle_exit+0x98/0x230 [kvm_amd] Aug 22 08:23:44 juju-e4d256-prod-github-runner-207 kernel: [10797.951917] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 08:23:44 juju-e4d256-prod-github-runner-207 kernel: [10797.952703] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 08:23:44 juju-e4d256-prod-github-runner-207 kernel: [10797.953502] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 08:23:44 juju-e4d256-prod-github-runner-207 kernel: [10797.954287] vcpu_run+0x62/0x2c0 [kvm] Aug 22 08:23:44 juju-e4d256-prod-github-runner-207 kernel: [10797.955003] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 08:23:44 juju-e4d256-prod-github-runner-207 kernel: [10797.955751] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 08:23:44 juju-e4d256-prod-github-runner-207 kernel: [10797.956571] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 08:23:44 juju-e4d256-prod-github-runner-207 kernel: [10797.957334] ? __seccomp_filter+0x4a/0x4a0 Aug 22 08:23:44 juju-e4d256-prod-github-runner-207 kernel: [10797.958055] ? __fget_files+0x86/0xc0 Aug 22 08:23:44 juju-e4d256-prod-github-runner-207 kernel: [10797.958756] __x64_sys_ioctl+0x95/0xd0 Aug 22 08:23:44 juju-e4d256-prod-github-runner-207 kernel: [10797.959452] do_syscall_64+0x5c/0xc0 Aug 22 08:23:44 juju-e4d256-prod-github-runner-207 kernel: [10797.960148] ? do_futex+0x162/0x1f0 Aug 22 08:23:44 juju-e4d256-prod-github-runner-207 kernel: [10797.961012] ? __x64_sys_futex+0x78/0x1e0 Aug 22 08:23:44 juju-e4d256-prod-github-runner-207 kernel: [10797.961718] ? __secure_computing+0xa9/0x120 Aug 22 08:23:44 juju-e4d256-prod-github-runner-207 kernel: [10797.962434] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 08:23:44 juju-e4d256-prod-github-runner-207 kernel: [10797.963284] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:23:44 juju-e4d256-prod-github-runner-207 kernel: [10797.964051] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:23:44 juju-e4d256-prod-github-runner-207 kernel: [10797.964806] ? do_syscall_64+0x69/0xc0 Aug 22 08:23:44 juju-e4d256-prod-github-runner-207 kernel: [10797.965496] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:23:44 juju-e4d256-prod-github-runner-207 kernel: [10797.966252] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:23:44 juju-e4d256-prod-github-runner-207 kernel: [10797.967010] ? do_syscall_64+0x69/0xc0 Aug 22 08:23:44 juju-e4d256-prod-github-runner-207 kernel: [10797.967706] ? do_syscall_64+0x69/0xc0 Aug 22 08:23:44 juju-e4d256-prod-github-runner-207 kernel: [10797.968412] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 08:23:44 juju-e4d256-prod-github-runner-207 kernel: [10797.969183] RIP: 0033:0x7faa5d0edaff Aug 22 08:23:44 juju-e4d256-prod-github-runner-207 kernel: [10797.969887] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 08:23:44 juju-e4d256-prod-github-runner-207 kernel: [10797.972022] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 08:23:44 juju-e4d256-prod-github-runner-207 kernel: [10797.972991] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 08:23:44 juju-e4d256-prod-github-runner-207 kernel: [10797.973935] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 08:23:44 juju-e4d256-prod-github-runner-207 kernel: [10797.974884] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 08:23:44 juju-e4d256-prod-github-runner-207 kernel: [10797.975853] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 08:23:44 juju-e4d256-prod-github-runner-207 kernel: [10797.976796] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 08:23:44 juju-e4d256-prod-github-runner-207 kernel: [10797.977734] Aug 22 08:24:10 juju-e4d256-prod-github-runner-207 kernel: [10824.541981] watchdog: BUG: soft lockup - CPU#1 stuck for 9973s! [qemu-system-x86:6715] Aug 22 08:24:10 juju-e4d256-prod-github-runner-207 kernel: [10824.543173] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 08:24:10 juju-e4d256-prod-github-runner-207 kernel: [10824.543255] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 08:24:10 juju-e4d256-prod-github-runner-207 kernel: [10824.557373] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 08:24:10 juju-e4d256-prod-github-runner-207 kernel: [10824.558659] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 08:24:10 juju-e4d256-prod-github-runner-207 kernel: [10824.559905] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:24:10 juju-e4d256-prod-github-runner-207 kernel: [10824.560976] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 08:24:10 juju-e4d256-prod-github-runner-207 kernel: [10824.563583] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 08:24:10 juju-e4d256-prod-github-runner-207 kernel: [10824.564636] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 08:24:10 juju-e4d256-prod-github-runner-207 kernel: [10824.565800] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 08:24:10 juju-e4d256-prod-github-runner-207 kernel: [10824.566985] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 08:24:10 juju-e4d256-prod-github-runner-207 kernel: [10824.568226] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 08:24:10 juju-e4d256-prod-github-runner-207 kernel: [10824.569402] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 08:24:10 juju-e4d256-prod-github-runner-207 kernel: [10824.570576] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 08:24:10 juju-e4d256-prod-github-runner-207 kernel: [10824.571841] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 08:24:10 juju-e4d256-prod-github-runner-207 kernel: [10824.573144] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 08:24:10 juju-e4d256-prod-github-runner-207 kernel: [10824.574340] Call Trace: Aug 22 08:24:10 juju-e4d256-prod-github-runner-207 kernel: [10824.575259] Aug 22 08:24:10 juju-e4d256-prod-github-runner-207 kernel: [10824.576163] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:24:10 juju-e4d256-prod-github-runner-207 kernel: [10824.577206] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:24:10 juju-e4d256-prod-github-runner-207 kernel: [10824.578250] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:24:10 juju-e4d256-prod-github-runner-207 kernel: [10824.579330] ? show_regs.part.0+0x23/0x29 Aug 22 08:24:10 juju-e4d256-prod-github-runner-207 kernel: [10824.580345] ? show_regs.cold+0x8/0xd Aug 22 08:24:10 juju-e4d256-prod-github-runner-207 kernel: [10824.581322] ? watchdog_timer_fn+0x1be/0x220 Aug 22 08:24:10 juju-e4d256-prod-github-runner-207 kernel: [10824.582352] ? lockup_detector_update_enable+0x60/0x60 Aug 22 08:24:10 juju-e4d256-prod-github-runner-207 kernel: [10824.583429] ? __hrtimer_run_queues+0x107/0x230 Aug 22 08:24:10 juju-e4d256-prod-github-runner-207 kernel: [10824.584479] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 08:24:10 juju-e4d256-prod-github-runner-207 kernel: [10824.585507] ? hrtimer_interrupt+0x101/0x220 Aug 22 08:24:10 juju-e4d256-prod-github-runner-207 kernel: [10824.586549] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 08:24:10 juju-e4d256-prod-github-runner-207 kernel: [10824.587656] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 08:24:10 juju-e4d256-prod-github-runner-207 kernel: [10824.588712] Aug 22 08:24:10 juju-e4d256-prod-github-runner-207 kernel: [10824.589570] Aug 22 08:24:10 juju-e4d256-prod-github-runner-207 kernel: [10824.590423] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 08:24:10 juju-e4d256-prod-github-runner-207 kernel: [10824.591483] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:24:10 juju-e4d256-prod-github-runner-207 kernel: [10824.592547] ? _raw_spin_lock+0x22/0x30 Aug 22 08:24:10 juju-e4d256-prod-github-runner-207 kernel: [10824.593519] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:24:10 juju-e4d256-prod-github-runner-207 kernel: [10824.594545] direct_page_fault+0x206/0x310 [kvm] Aug 22 08:24:10 juju-e4d256-prod-github-runner-207 kernel: [10824.595598] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 08:24:10 juju-e4d256-prod-github-runner-207 kernel: [10824.596614] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 08:24:10 juju-e4d256-prod-github-runner-207 kernel: [10824.597631] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 08:24:10 juju-e4d256-prod-github-runner-207 kernel: [10824.598622] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 08:24:10 juju-e4d256-prod-github-runner-207 kernel: [10824.599592] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 08:24:10 juju-e4d256-prod-github-runner-207 kernel: [10824.600574] handle_exit+0x98/0x230 [kvm_amd] Aug 22 08:24:10 juju-e4d256-prod-github-runner-207 kernel: [10824.601474] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 08:24:10 juju-e4d256-prod-github-runner-207 kernel: [10824.602419] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 08:24:10 juju-e4d256-prod-github-runner-207 kernel: [10824.603379] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 08:24:10 juju-e4d256-prod-github-runner-207 kernel: [10824.604307] vcpu_run+0x62/0x2c0 [kvm] Aug 22 08:24:10 juju-e4d256-prod-github-runner-207 kernel: [10824.605127] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 08:24:10 juju-e4d256-prod-github-runner-207 kernel: [10824.605942] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 08:24:10 juju-e4d256-prod-github-runner-207 kernel: [10824.606800] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 08:24:10 juju-e4d256-prod-github-runner-207 kernel: [10824.607624] ? __seccomp_filter+0x4a/0x4a0 Aug 22 08:24:10 juju-e4d256-prod-github-runner-207 kernel: [10824.608384] ? __fget_files+0x86/0xc0 Aug 22 08:24:10 juju-e4d256-prod-github-runner-207 kernel: [10824.609095] __x64_sys_ioctl+0x95/0xd0 Aug 22 08:24:10 juju-e4d256-prod-github-runner-207 kernel: [10824.609791] do_syscall_64+0x5c/0xc0 Aug 22 08:24:10 juju-e4d256-prod-github-runner-207 kernel: [10824.610458] ? do_futex+0x162/0x1f0 Aug 22 08:24:10 juju-e4d256-prod-github-runner-207 kernel: [10824.611110] ? __x64_sys_futex+0x78/0x1e0 Aug 22 08:24:10 juju-e4d256-prod-github-runner-207 kernel: [10824.611804] ? __secure_computing+0xa9/0x120 Aug 22 08:24:10 juju-e4d256-prod-github-runner-207 kernel: [10824.612524] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 08:24:10 juju-e4d256-prod-github-runner-207 kernel: [10824.613302] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:24:10 juju-e4d256-prod-github-runner-207 kernel: [10824.614041] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:24:10 juju-e4d256-prod-github-runner-207 kernel: [10824.614766] ? do_syscall_64+0x69/0xc0 Aug 22 08:24:10 juju-e4d256-prod-github-runner-207 kernel: [10824.615413] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:24:10 juju-e4d256-prod-github-runner-207 kernel: [10824.616131] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:24:10 juju-e4d256-prod-github-runner-207 kernel: [10824.616835] ? do_syscall_64+0x69/0xc0 Aug 22 08:24:10 juju-e4d256-prod-github-runner-207 kernel: [10824.617465] ? do_syscall_64+0x69/0xc0 Aug 22 08:24:10 juju-e4d256-prod-github-runner-207 kernel: [10824.618103] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 08:24:10 juju-e4d256-prod-github-runner-207 kernel: [10824.618834] RIP: 0033:0x7faa5d0edaff Aug 22 08:24:10 juju-e4d256-prod-github-runner-207 kernel: [10824.619480] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 08:24:10 juju-e4d256-prod-github-runner-207 kernel: [10824.621474] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 08:24:10 juju-e4d256-prod-github-runner-207 kernel: [10824.622391] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 08:24:10 juju-e4d256-prod-github-runner-207 kernel: [10824.623530] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 08:24:10 juju-e4d256-prod-github-runner-207 kernel: [10824.624626] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 08:24:10 juju-e4d256-prod-github-runner-207 kernel: [10824.625677] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 08:24:10 juju-e4d256-prod-github-runner-207 kernel: [10824.626619] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 08:24:10 juju-e4d256-prod-github-runner-207 kernel: [10824.627599] Aug 22 08:24:38 juju-e4d256-prod-github-runner-207 kernel: [10852.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 9999s! [qemu-system-x86:6715] Aug 22 08:24:38 juju-e4d256-prod-github-runner-207 kernel: [10852.543125] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 08:24:38 juju-e4d256-prod-github-runner-207 kernel: [10852.543198] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 08:24:38 juju-e4d256-prod-github-runner-207 kernel: [10852.555523] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 08:24:38 juju-e4d256-prod-github-runner-207 kernel: [10852.556814] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 08:24:38 juju-e4d256-prod-github-runner-207 kernel: [10852.558075] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:24:38 juju-e4d256-prod-github-runner-207 kernel: [10852.559167] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 08:24:38 juju-e4d256-prod-github-runner-207 kernel: [10852.561752] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 08:24:38 juju-e4d256-prod-github-runner-207 kernel: [10852.562809] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 08:24:38 juju-e4d256-prod-github-runner-207 kernel: [10852.564009] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 08:24:38 juju-e4d256-prod-github-runner-207 kernel: [10852.565183] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 08:24:38 juju-e4d256-prod-github-runner-207 kernel: [10852.566361] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 08:24:38 juju-e4d256-prod-github-runner-207 kernel: [10852.567563] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 08:24:38 juju-e4d256-prod-github-runner-207 kernel: [10852.568744] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 08:24:38 juju-e4d256-prod-github-runner-207 kernel: [10852.569990] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 08:24:38 juju-e4d256-prod-github-runner-207 kernel: [10852.571112] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 08:24:38 juju-e4d256-prod-github-runner-207 kernel: [10852.572340] Call Trace: Aug 22 08:24:38 juju-e4d256-prod-github-runner-207 kernel: [10852.573259] Aug 22 08:24:38 juju-e4d256-prod-github-runner-207 kernel: [10852.574145] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:24:38 juju-e4d256-prod-github-runner-207 kernel: [10852.575240] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:24:38 juju-e4d256-prod-github-runner-207 kernel: [10852.576271] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:24:38 juju-e4d256-prod-github-runner-207 kernel: [10852.577361] ? show_regs.part.0+0x23/0x29 Aug 22 08:24:38 juju-e4d256-prod-github-runner-207 kernel: [10852.578375] ? show_regs.cold+0x8/0xd Aug 22 08:24:38 juju-e4d256-prod-github-runner-207 kernel: [10852.579378] ? watchdog_timer_fn+0x1be/0x220 Aug 22 08:24:38 juju-e4d256-prod-github-runner-207 kernel: [10852.580396] ? lockup_detector_update_enable+0x60/0x60 Aug 22 08:24:38 juju-e4d256-prod-github-runner-207 kernel: [10852.581467] ? __hrtimer_run_queues+0x107/0x230 Aug 22 08:24:38 juju-e4d256-prod-github-runner-207 kernel: [10852.582501] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 08:24:38 juju-e4d256-prod-github-runner-207 kernel: [10852.583542] ? hrtimer_interrupt+0x101/0x220 Aug 22 08:24:38 juju-e4d256-prod-github-runner-207 kernel: [10852.584563] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 08:24:38 juju-e4d256-prod-github-runner-207 kernel: [10852.585638] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 08:24:38 juju-e4d256-prod-github-runner-207 kernel: [10852.586693] Aug 22 08:24:38 juju-e4d256-prod-github-runner-207 kernel: [10852.587561] Aug 22 08:24:38 juju-e4d256-prod-github-runner-207 kernel: [10852.588476] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 08:24:38 juju-e4d256-prod-github-runner-207 kernel: [10852.589537] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:24:38 juju-e4d256-prod-github-runner-207 kernel: [10852.590586] ? _raw_spin_lock+0x22/0x30 Aug 22 08:24:38 juju-e4d256-prod-github-runner-207 kernel: [10852.591554] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:24:38 juju-e4d256-prod-github-runner-207 kernel: [10852.592587] direct_page_fault+0x206/0x310 [kvm] Aug 22 08:24:38 juju-e4d256-prod-github-runner-207 kernel: [10852.593618] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 08:24:38 juju-e4d256-prod-github-runner-207 kernel: [10852.594635] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 08:24:38 juju-e4d256-prod-github-runner-207 kernel: [10852.595654] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 08:24:38 juju-e4d256-prod-github-runner-207 kernel: [10852.596632] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 08:24:38 juju-e4d256-prod-github-runner-207 kernel: [10852.597584] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 08:24:38 juju-e4d256-prod-github-runner-207 kernel: [10852.598624] handle_exit+0x98/0x230 [kvm_amd] Aug 22 08:24:38 juju-e4d256-prod-github-runner-207 kernel: [10852.599558] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 08:24:38 juju-e4d256-prod-github-runner-207 kernel: [10852.600488] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 08:24:38 juju-e4d256-prod-github-runner-207 kernel: [10852.601421] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 08:24:38 juju-e4d256-prod-github-runner-207 kernel: [10852.602333] vcpu_run+0x62/0x2c0 [kvm] Aug 22 08:24:38 juju-e4d256-prod-github-runner-207 kernel: [10852.603169] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 08:24:38 juju-e4d256-prod-github-runner-207 kernel: [10852.603986] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 08:24:38 juju-e4d256-prod-github-runner-207 kernel: [10852.604850] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 08:24:38 juju-e4d256-prod-github-runner-207 kernel: [10852.605653] ? __seccomp_filter+0x4a/0x4a0 Aug 22 08:24:38 juju-e4d256-prod-github-runner-207 kernel: [10852.606407] ? __fget_files+0x86/0xc0 Aug 22 08:24:38 juju-e4d256-prod-github-runner-207 kernel: [10852.607140] __x64_sys_ioctl+0x95/0xd0 Aug 22 08:24:38 juju-e4d256-prod-github-runner-207 kernel: [10852.607842] do_syscall_64+0x5c/0xc0 Aug 22 08:24:38 juju-e4d256-prod-github-runner-207 kernel: [10852.608543] ? do_futex+0x162/0x1f0 Aug 22 08:24:38 juju-e4d256-prod-github-runner-207 kernel: [10852.609253] ? __x64_sys_futex+0x78/0x1e0 Aug 22 08:24:38 juju-e4d256-prod-github-runner-207 kernel: [10852.610024] ? __secure_computing+0xa9/0x120 Aug 22 08:24:38 juju-e4d256-prod-github-runner-207 kernel: [10852.610769] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 08:24:38 juju-e4d256-prod-github-runner-207 kernel: [10852.611562] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:24:38 juju-e4d256-prod-github-runner-207 kernel: [10852.612293] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:24:38 juju-e4d256-prod-github-runner-207 kernel: [10852.613064] ? do_syscall_64+0x69/0xc0 Aug 22 08:24:38 juju-e4d256-prod-github-runner-207 kernel: [10852.613733] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:24:38 juju-e4d256-prod-github-runner-207 kernel: [10852.614455] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:24:38 juju-e4d256-prod-github-runner-207 kernel: [10852.615177] ? do_syscall_64+0x69/0xc0 Aug 22 08:24:38 juju-e4d256-prod-github-runner-207 kernel: [10852.615812] ? do_syscall_64+0x69/0xc0 Aug 22 08:24:38 juju-e4d256-prod-github-runner-207 kernel: [10852.616443] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 08:24:38 juju-e4d256-prod-github-runner-207 kernel: [10852.617161] RIP: 0033:0x7faa5d0edaff Aug 22 08:24:38 juju-e4d256-prod-github-runner-207 kernel: [10852.617792] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 08:24:38 juju-e4d256-prod-github-runner-207 kernel: [10852.619835] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 08:24:38 juju-e4d256-prod-github-runner-207 kernel: [10852.620763] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 08:24:38 juju-e4d256-prod-github-runner-207 kernel: [10852.621716] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 08:24:38 juju-e4d256-prod-github-runner-207 kernel: [10852.622645] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 08:24:38 juju-e4d256-prod-github-runner-207 kernel: [10852.623579] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 08:24:38 juju-e4d256-prod-github-runner-207 kernel: [10852.624663] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 08:24:38 juju-e4d256-prod-github-runner-207 kernel: [10852.625659] Aug 22 08:25:06 juju-e4d256-prod-github-runner-207 kernel: [10880.542066] watchdog: BUG: soft lockup - CPU#1 stuck for 10025s! [qemu-system-x86:6715] Aug 22 08:25:06 juju-e4d256-prod-github-runner-207 kernel: [10880.545589] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 08:25:06 juju-e4d256-prod-github-runner-207 kernel: [10880.546974] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 08:25:06 juju-e4d256-prod-github-runner-207 kernel: [10880.573300] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 08:25:06 juju-e4d256-prod-github-runner-207 kernel: [10880.576867] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 08:25:06 juju-e4d256-prod-github-runner-207 kernel: [10880.578663] RIP: 0010:native_queued_spin_lock_slowpath+0xc/0x40 Aug 22 08:25:06 juju-e4d256-prod-github-runner-207 kernel: [10880.581425] Code: fe ff ff eb af 4c 89 fe 48 c7 c7 20 99 e9 89 e8 ca 69 55 00 e9 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 <8b> 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 eb Aug 22 08:25:06 juju-e4d256-prod-github-runner-207 kernel: [10880.586253] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 08:25:06 juju-e4d256-prod-github-runner-207 kernel: [10880.589468] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 08:25:06 juju-e4d256-prod-github-runner-207 kernel: [10880.590657] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 08:25:06 juju-e4d256-prod-github-runner-207 kernel: [10880.594125] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 08:25:06 juju-e4d256-prod-github-runner-207 kernel: [10880.595345] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 08:25:06 juju-e4d256-prod-github-runner-207 kernel: [10880.598716] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 08:25:06 juju-e4d256-prod-github-runner-207 kernel: [10880.599926] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 08:25:06 juju-e4d256-prod-github-runner-207 kernel: [10880.603330] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 08:25:06 juju-e4d256-prod-github-runner-207 kernel: [10880.606506] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 08:25:06 juju-e4d256-prod-github-runner-207 kernel: [10880.607729] Call Trace: Aug 22 08:25:06 juju-e4d256-prod-github-runner-207 kernel: [10880.610851] Aug 22 08:25:06 juju-e4d256-prod-github-runner-207 kernel: [10880.611774] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:25:06 juju-e4d256-prod-github-runner-207 kernel: [10880.614832] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:25:06 juju-e4d256-prod-github-runner-207 kernel: [10880.615867] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:25:06 juju-e4d256-prod-github-runner-207 kernel: [10880.618982] ? show_regs.part.0+0x23/0x29 Aug 22 08:25:06 juju-e4d256-prod-github-runner-207 kernel: [10880.622084] ? show_regs.cold+0x8/0xd Aug 22 08:25:06 juju-e4d256-prod-github-runner-207 kernel: [10880.623092] ? watchdog_timer_fn+0x1be/0x220 Aug 22 08:25:06 juju-e4d256-prod-github-runner-207 kernel: [10880.626275] ? lockup_detector_update_enable+0x60/0x60 Aug 22 08:25:06 juju-e4d256-prod-github-runner-207 kernel: [10880.629531] ? __hrtimer_run_queues+0x107/0x230 Aug 22 08:25:06 juju-e4d256-prod-github-runner-207 kernel: [10880.630593] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 08:25:06 juju-e4d256-prod-github-runner-207 kernel: [10880.633788] ? hrtimer_interrupt+0x101/0x220 Aug 22 08:25:06 juju-e4d256-prod-github-runner-207 kernel: [10880.637046] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 08:25:06 juju-e4d256-prod-github-runner-207 kernel: [10880.638187] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 08:25:06 juju-e4d256-prod-github-runner-207 kernel: [10880.639269] Aug 22 08:25:06 juju-e4d256-prod-github-runner-207 kernel: [10880.640127] Aug 22 08:25:06 juju-e4d256-prod-github-runner-207 kernel: [10880.640978] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 08:25:06 juju-e4d256-prod-github-runner-207 kernel: [10880.642023] ? native_queued_spin_lock_slowpath+0xc/0x40 Aug 22 08:25:06 juju-e4d256-prod-github-runner-207 kernel: [10880.643093] ? _raw_spin_lock+0x22/0x30 Aug 22 08:25:06 juju-e4d256-prod-github-runner-207 kernel: [10880.644057] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:25:06 juju-e4d256-prod-github-runner-207 kernel: [10880.645136] direct_page_fault+0x206/0x310 [kvm] Aug 22 08:25:06 juju-e4d256-prod-github-runner-207 kernel: [10880.646171] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 08:25:06 juju-e4d256-prod-github-runner-207 kernel: [10880.647206] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 08:25:06 juju-e4d256-prod-github-runner-207 kernel: [10880.648246] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 08:25:06 juju-e4d256-prod-github-runner-207 kernel: [10880.649277] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 08:25:06 juju-e4d256-prod-github-runner-207 kernel: [10880.650250] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 08:25:06 juju-e4d256-prod-github-runner-207 kernel: [10880.651296] handle_exit+0x98/0x230 [kvm_amd] Aug 22 08:25:06 juju-e4d256-prod-github-runner-207 kernel: [10880.652282] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 08:25:06 juju-e4d256-prod-github-runner-207 kernel: [10880.653221] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 08:25:06 juju-e4d256-prod-github-runner-207 kernel: [10880.654179] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 08:25:06 juju-e4d256-prod-github-runner-207 kernel: [10880.655104] vcpu_run+0x62/0x2c0 [kvm] Aug 22 08:25:06 juju-e4d256-prod-github-runner-207 kernel: [10880.655937] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 08:25:06 juju-e4d256-prod-github-runner-207 kernel: [10880.656827] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 08:25:06 juju-e4d256-prod-github-runner-207 kernel: [10880.657728] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 08:25:06 juju-e4d256-prod-github-runner-207 kernel: [10880.658572] ? __seccomp_filter+0x4a/0x4a0 Aug 22 08:25:06 juju-e4d256-prod-github-runner-207 kernel: [10880.659363] ? __fget_files+0x86/0xc0 Aug 22 08:25:06 juju-e4d256-prod-github-runner-207 kernel: [10880.660078] __x64_sys_ioctl+0x95/0xd0 Aug 22 08:25:06 juju-e4d256-prod-github-runner-207 kernel: [10880.660775] do_syscall_64+0x5c/0xc0 Aug 22 08:25:06 juju-e4d256-prod-github-runner-207 kernel: [10880.661447] ? do_futex+0x162/0x1f0 Aug 22 08:25:06 juju-e4d256-prod-github-runner-207 kernel: [10880.662104] ? __x64_sys_futex+0x78/0x1e0 Aug 22 08:25:06 juju-e4d256-prod-github-runner-207 kernel: [10880.662816] ? __secure_computing+0xa9/0x120 Aug 22 08:25:06 juju-e4d256-prod-github-runner-207 kernel: [10880.663518] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 08:25:06 juju-e4d256-prod-github-runner-207 kernel: [10880.664289] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:25:06 juju-e4d256-prod-github-runner-207 kernel: [10880.665012] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:25:06 juju-e4d256-prod-github-runner-207 kernel: [10880.665729] ? do_syscall_64+0x69/0xc0 Aug 22 08:25:06 juju-e4d256-prod-github-runner-207 kernel: [10880.666373] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:25:06 juju-e4d256-prod-github-runner-207 kernel: [10880.667121] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:25:06 juju-e4d256-prod-github-runner-207 kernel: [10880.667828] ? do_syscall_64+0x69/0xc0 Aug 22 08:25:06 juju-e4d256-prod-github-runner-207 kernel: [10880.668467] ? do_syscall_64+0x69/0xc0 Aug 22 08:25:06 juju-e4d256-prod-github-runner-207 kernel: [10880.669115] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 08:25:06 juju-e4d256-prod-github-runner-207 kernel: [10880.669825] RIP: 0033:0x7faa5d0edaff Aug 22 08:25:06 juju-e4d256-prod-github-runner-207 kernel: [10880.670477] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 08:25:06 juju-e4d256-prod-github-runner-207 kernel: [10880.672488] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 08:25:06 juju-e4d256-prod-github-runner-207 kernel: [10880.673466] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 08:25:06 juju-e4d256-prod-github-runner-207 kernel: [10880.674399] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 08:25:06 juju-e4d256-prod-github-runner-207 kernel: [10880.677398] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 08:25:06 juju-e4d256-prod-github-runner-207 kernel: [10880.678298] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 08:25:06 juju-e4d256-prod-github-runner-207 kernel: [10880.679245] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 08:25:06 juju-e4d256-prod-github-runner-207 kernel: [10880.680146] Aug 22 08:25:34 juju-e4d256-prod-github-runner-207 kernel: [10908.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 10051s! [qemu-system-x86:6715] Aug 22 08:25:34 juju-e4d256-prod-github-runner-207 kernel: [10908.543133] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 08:25:34 juju-e4d256-prod-github-runner-207 kernel: [10908.543204] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 08:25:34 juju-e4d256-prod-github-runner-207 kernel: [10908.555690] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 08:25:34 juju-e4d256-prod-github-runner-207 kernel: [10908.556953] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 08:25:34 juju-e4d256-prod-github-runner-207 kernel: [10908.558191] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:25:34 juju-e4d256-prod-github-runner-207 kernel: [10908.559317] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 08:25:34 juju-e4d256-prod-github-runner-207 kernel: [10908.561904] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 08:25:34 juju-e4d256-prod-github-runner-207 kernel: [10908.563008] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 08:25:34 juju-e4d256-prod-github-runner-207 kernel: [10908.564185] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 08:25:34 juju-e4d256-prod-github-runner-207 kernel: [10908.565343] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 08:25:34 juju-e4d256-prod-github-runner-207 kernel: [10908.566537] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 08:25:34 juju-e4d256-prod-github-runner-207 kernel: [10908.567719] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 08:25:34 juju-e4d256-prod-github-runner-207 kernel: [10908.568917] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 08:25:34 juju-e4d256-prod-github-runner-207 kernel: [10908.570176] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 08:25:34 juju-e4d256-prod-github-runner-207 kernel: [10908.571355] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 08:25:34 juju-e4d256-prod-github-runner-207 kernel: [10908.572564] Call Trace: Aug 22 08:25:34 juju-e4d256-prod-github-runner-207 kernel: [10908.573488] Aug 22 08:25:34 juju-e4d256-prod-github-runner-207 kernel: [10908.574522] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:25:34 juju-e4d256-prod-github-runner-207 kernel: [10908.575566] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:25:34 juju-e4d256-prod-github-runner-207 kernel: [10908.576779] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:25:34 juju-e4d256-prod-github-runner-207 kernel: [10908.577864] ? show_regs.part.0+0x23/0x29 Aug 22 08:25:34 juju-e4d256-prod-github-runner-207 kernel: [10908.578875] ? show_regs.cold+0x8/0xd Aug 22 08:25:34 juju-e4d256-prod-github-runner-207 kernel: [10908.580035] ? watchdog_timer_fn+0x1be/0x220 Aug 22 08:25:34 juju-e4d256-prod-github-runner-207 kernel: [10908.581044] ? lockup_detector_update_enable+0x60/0x60 Aug 22 08:25:34 juju-e4d256-prod-github-runner-207 kernel: [10908.582111] ? __hrtimer_run_queues+0x107/0x230 Aug 22 08:25:34 juju-e4d256-prod-github-runner-207 kernel: [10908.583251] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 08:25:34 juju-e4d256-prod-github-runner-207 kernel: [10908.585063] ? hrtimer_interrupt+0x101/0x220 Aug 22 08:25:34 juju-e4d256-prod-github-runner-207 kernel: [10908.586102] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 08:25:34 juju-e4d256-prod-github-runner-207 kernel: [10908.587244] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 08:25:34 juju-e4d256-prod-github-runner-207 kernel: [10908.588371] Aug 22 08:25:34 juju-e4d256-prod-github-runner-207 kernel: [10908.589245] Aug 22 08:25:34 juju-e4d256-prod-github-runner-207 kernel: [10908.590092] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 08:25:34 juju-e4d256-prod-github-runner-207 kernel: [10908.591236] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:25:34 juju-e4d256-prod-github-runner-207 kernel: [10908.592316] ? _raw_spin_lock+0x22/0x30 Aug 22 08:25:34 juju-e4d256-prod-github-runner-207 kernel: [10908.593293] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:25:34 juju-e4d256-prod-github-runner-207 kernel: [10908.594327] direct_page_fault+0x206/0x310 [kvm] Aug 22 08:25:34 juju-e4d256-prod-github-runner-207 kernel: [10908.595382] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 08:25:34 juju-e4d256-prod-github-runner-207 kernel: [10908.596417] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 08:25:34 juju-e4d256-prod-github-runner-207 kernel: [10908.597423] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 08:25:34 juju-e4d256-prod-github-runner-207 kernel: [10908.598475] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 08:25:34 juju-e4d256-prod-github-runner-207 kernel: [10908.599480] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 08:25:34 juju-e4d256-prod-github-runner-207 kernel: [10908.600455] handle_exit+0x98/0x230 [kvm_amd] Aug 22 08:25:34 juju-e4d256-prod-github-runner-207 kernel: [10908.601347] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 08:25:34 juju-e4d256-prod-github-runner-207 kernel: [10908.602260] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 08:25:34 juju-e4d256-prod-github-runner-207 kernel: [10908.603202] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 08:25:34 juju-e4d256-prod-github-runner-207 kernel: [10908.604140] vcpu_run+0x62/0x2c0 [kvm] Aug 22 08:25:34 juju-e4d256-prod-github-runner-207 kernel: [10908.604980] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 08:25:34 juju-e4d256-prod-github-runner-207 kernel: [10908.605846] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 08:25:34 juju-e4d256-prod-github-runner-207 kernel: [10908.606790] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 08:25:34 juju-e4d256-prod-github-runner-207 kernel: [10908.607606] ? __seccomp_filter+0x4a/0x4a0 Aug 22 08:25:34 juju-e4d256-prod-github-runner-207 kernel: [10908.608352] ? __fget_files+0x86/0xc0 Aug 22 08:25:34 juju-e4d256-prod-github-runner-207 kernel: [10908.609080] __x64_sys_ioctl+0x95/0xd0 Aug 22 08:25:34 juju-e4d256-prod-github-runner-207 kernel: [10908.609785] do_syscall_64+0x5c/0xc0 Aug 22 08:25:34 juju-e4d256-prod-github-runner-207 kernel: [10908.610478] ? do_futex+0x162/0x1f0 Aug 22 08:25:34 juju-e4d256-prod-github-runner-207 kernel: [10908.611132] ? __x64_sys_futex+0x78/0x1e0 Aug 22 08:25:34 juju-e4d256-prod-github-runner-207 kernel: [10908.611810] ? __secure_computing+0xa9/0x120 Aug 22 08:25:34 juju-e4d256-prod-github-runner-207 kernel: [10908.612508] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 08:25:34 juju-e4d256-prod-github-runner-207 kernel: [10908.613283] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:25:34 juju-e4d256-prod-github-runner-207 kernel: [10908.614012] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:25:34 juju-e4d256-prod-github-runner-207 kernel: [10908.614757] ? do_syscall_64+0x69/0xc0 Aug 22 08:25:34 juju-e4d256-prod-github-runner-207 kernel: [10908.615409] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:25:34 juju-e4d256-prod-github-runner-207 kernel: [10908.616112] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:25:34 juju-e4d256-prod-github-runner-207 kernel: [10908.616811] ? do_syscall_64+0x69/0xc0 Aug 22 08:25:34 juju-e4d256-prod-github-runner-207 kernel: [10908.617444] ? do_syscall_64+0x69/0xc0 Aug 22 08:25:34 juju-e4d256-prod-github-runner-207 kernel: [10908.618072] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 08:25:34 juju-e4d256-prod-github-runner-207 kernel: [10908.618808] RIP: 0033:0x7faa5d0edaff Aug 22 08:25:34 juju-e4d256-prod-github-runner-207 kernel: [10908.619440] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 08:25:34 juju-e4d256-prod-github-runner-207 kernel: [10908.621450] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 08:25:34 juju-e4d256-prod-github-runner-207 kernel: [10908.622385] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 08:25:34 juju-e4d256-prod-github-runner-207 kernel: [10908.623317] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 08:25:34 juju-e4d256-prod-github-runner-207 kernel: [10908.624212] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 08:25:34 juju-e4d256-prod-github-runner-207 kernel: [10908.625134] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 08:25:34 juju-e4d256-prod-github-runner-207 kernel: [10908.626034] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 08:25:34 juju-e4d256-prod-github-runner-207 kernel: [10908.626950] Aug 22 08:26:02 juju-e4d256-prod-github-runner-207 kernel: [10936.541980] watchdog: BUG: soft lockup - CPU#1 stuck for 10077s! [qemu-system-x86:6715] Aug 22 08:26:02 juju-e4d256-prod-github-runner-207 kernel: [10936.543160] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 08:26:02 juju-e4d256-prod-github-runner-207 kernel: [10936.543234] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 08:26:02 juju-e4d256-prod-github-runner-207 kernel: [10936.556000] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 08:26:02 juju-e4d256-prod-github-runner-207 kernel: [10936.557373] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 08:26:02 juju-e4d256-prod-github-runner-207 kernel: [10936.558621] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:26:02 juju-e4d256-prod-github-runner-207 kernel: [10936.559699] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 08:26:02 juju-e4d256-prod-github-runner-207 kernel: [10936.562330] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 08:26:02 juju-e4d256-prod-github-runner-207 kernel: [10936.563382] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 08:26:02 juju-e4d256-prod-github-runner-207 kernel: [10936.564542] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 08:26:02 juju-e4d256-prod-github-runner-207 kernel: [10936.565712] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 08:26:02 juju-e4d256-prod-github-runner-207 kernel: [10936.566897] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 08:26:02 juju-e4d256-prod-github-runner-207 kernel: [10936.568114] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 08:26:02 juju-e4d256-prod-github-runner-207 kernel: [10936.569407] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 08:26:02 juju-e4d256-prod-github-runner-207 kernel: [10936.570795] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 08:26:02 juju-e4d256-prod-github-runner-207 kernel: [10936.571938] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 08:26:02 juju-e4d256-prod-github-runner-207 kernel: [10936.573243] Call Trace: Aug 22 08:26:02 juju-e4d256-prod-github-runner-207 kernel: [10936.574313] Aug 22 08:26:02 juju-e4d256-prod-github-runner-207 kernel: [10936.575228] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:26:02 juju-e4d256-prod-github-runner-207 kernel: [10936.576268] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:26:02 juju-e4d256-prod-github-runner-207 kernel: [10936.577410] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:26:02 juju-e4d256-prod-github-runner-207 kernel: [10936.578741] ? show_regs.part.0+0x23/0x29 Aug 22 08:26:02 juju-e4d256-prod-github-runner-207 kernel: [10936.579795] ? show_regs.cold+0x8/0xd Aug 22 08:26:02 juju-e4d256-prod-github-runner-207 kernel: [10936.580783] ? watchdog_timer_fn+0x1be/0x220 Aug 22 08:26:02 juju-e4d256-prod-github-runner-207 kernel: [10936.581820] ? lockup_detector_update_enable+0x60/0x60 Aug 22 08:26:02 juju-e4d256-prod-github-runner-207 kernel: [10936.583193] ? __hrtimer_run_queues+0x107/0x230 Aug 22 08:26:02 juju-e4d256-prod-github-runner-207 kernel: [10936.584491] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 08:26:02 juju-e4d256-prod-github-runner-207 kernel: [10936.585869] ? hrtimer_interrupt+0x101/0x220 Aug 22 08:26:02 juju-e4d256-prod-github-runner-207 kernel: [10936.587200] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 08:26:02 juju-e4d256-prod-github-runner-207 kernel: [10936.588595] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 08:26:02 juju-e4d256-prod-github-runner-207 kernel: [10936.590039] Aug 22 08:26:02 juju-e4d256-prod-github-runner-207 kernel: [10936.590969] Aug 22 08:26:02 juju-e4d256-prod-github-runner-207 kernel: [10936.591823] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 08:26:02 juju-e4d256-prod-github-runner-207 kernel: [10936.592932] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:26:02 juju-e4d256-prod-github-runner-207 kernel: [10936.593996] ? _raw_spin_lock+0x22/0x30 Aug 22 08:26:02 juju-e4d256-prod-github-runner-207 kernel: [10936.595039] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:26:02 juju-e4d256-prod-github-runner-207 kernel: [10936.596115] direct_page_fault+0x206/0x310 [kvm] Aug 22 08:26:02 juju-e4d256-prod-github-runner-207 kernel: [10936.597173] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 08:26:02 juju-e4d256-prod-github-runner-207 kernel: [10936.598228] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 08:26:02 juju-e4d256-prod-github-runner-207 kernel: [10936.599257] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 08:26:02 juju-e4d256-prod-github-runner-207 kernel: [10936.600235] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 08:26:02 juju-e4d256-prod-github-runner-207 kernel: [10936.601216] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 08:26:02 juju-e4d256-prod-github-runner-207 kernel: [10936.602243] handle_exit+0x98/0x230 [kvm_amd] Aug 22 08:26:02 juju-e4d256-prod-github-runner-207 kernel: [10936.603143] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 08:26:02 juju-e4d256-prod-github-runner-207 kernel: [10936.604082] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 08:26:02 juju-e4d256-prod-github-runner-207 kernel: [10936.605047] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 08:26:02 juju-e4d256-prod-github-runner-207 kernel: [10936.605962] vcpu_run+0x62/0x2c0 [kvm] Aug 22 08:26:02 juju-e4d256-prod-github-runner-207 kernel: [10936.606806] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 08:26:02 juju-e4d256-prod-github-runner-207 kernel: [10936.607631] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 08:26:02 juju-e4d256-prod-github-runner-207 kernel: [10936.608525] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 08:26:02 juju-e4d256-prod-github-runner-207 kernel: [10936.609367] ? __seccomp_filter+0x4a/0x4a0 Aug 22 08:26:02 juju-e4d256-prod-github-runner-207 kernel: [10936.610146] ? __fget_files+0x86/0xc0 Aug 22 08:26:02 juju-e4d256-prod-github-runner-207 kernel: [10936.610859] __x64_sys_ioctl+0x95/0xd0 Aug 22 08:26:02 juju-e4d256-prod-github-runner-207 kernel: [10936.611555] do_syscall_64+0x5c/0xc0 Aug 22 08:26:02 juju-e4d256-prod-github-runner-207 kernel: [10936.612247] ? do_futex+0x162/0x1f0 Aug 22 08:26:02 juju-e4d256-prod-github-runner-207 kernel: [10936.612931] ? __x64_sys_futex+0x78/0x1e0 Aug 22 08:26:02 juju-e4d256-prod-github-runner-207 kernel: [10936.613652] ? __secure_computing+0xa9/0x120 Aug 22 08:26:02 juju-e4d256-prod-github-runner-207 kernel: [10936.614381] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 08:26:02 juju-e4d256-prod-github-runner-207 kernel: [10936.615149] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:26:02 juju-e4d256-prod-github-runner-207 kernel: [10936.615883] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:26:02 juju-e4d256-prod-github-runner-207 kernel: [10936.616604] ? do_syscall_64+0x69/0xc0 Aug 22 08:26:02 juju-e4d256-prod-github-runner-207 kernel: [10936.617259] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:26:02 juju-e4d256-prod-github-runner-207 kernel: [10936.617964] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:26:02 juju-e4d256-prod-github-runner-207 kernel: [10936.618682] ? do_syscall_64+0x69/0xc0 Aug 22 08:26:02 juju-e4d256-prod-github-runner-207 kernel: [10936.619311] ? do_syscall_64+0x69/0xc0 Aug 22 08:26:02 juju-e4d256-prod-github-runner-207 kernel: [10936.619942] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 08:26:02 juju-e4d256-prod-github-runner-207 kernel: [10936.620651] RIP: 0033:0x7faa5d0edaff Aug 22 08:26:02 juju-e4d256-prod-github-runner-207 kernel: [10936.621282] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 08:26:02 juju-e4d256-prod-github-runner-207 kernel: [10936.623292] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 08:26:02 juju-e4d256-prod-github-runner-207 kernel: [10936.624206] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 08:26:02 juju-e4d256-prod-github-runner-207 kernel: [10936.625100] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 08:26:02 juju-e4d256-prod-github-runner-207 kernel: [10936.625997] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 08:26:02 juju-e4d256-prod-github-runner-207 kernel: [10936.626920] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 08:26:02 juju-e4d256-prod-github-runner-207 kernel: [10936.627813] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 08:26:02 juju-e4d256-prod-github-runner-207 kernel: [10936.628714] Aug 22 08:26:30 juju-e4d256-prod-github-runner-207 kernel: [10964.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 10103s! [qemu-system-x86:6715] Aug 22 08:26:30 juju-e4d256-prod-github-runner-207 kernel: [10964.543921] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 08:26:30 juju-e4d256-prod-github-runner-207 kernel: [10964.544225] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 08:26:30 juju-e4d256-prod-github-runner-207 kernel: [10964.556355] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 08:26:30 juju-e4d256-prod-github-runner-207 kernel: [10964.557617] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 08:26:30 juju-e4d256-prod-github-runner-207 kernel: [10964.558849] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:26:30 juju-e4d256-prod-github-runner-207 kernel: [10964.559915] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 08:26:30 juju-e4d256-prod-github-runner-207 kernel: [10964.562463] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 08:26:30 juju-e4d256-prod-github-runner-207 kernel: [10964.563503] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 08:26:30 juju-e4d256-prod-github-runner-207 kernel: [10964.564663] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 08:26:30 juju-e4d256-prod-github-runner-207 kernel: [10964.565878] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 08:26:30 juju-e4d256-prod-github-runner-207 kernel: [10964.567037] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 08:26:30 juju-e4d256-prod-github-runner-207 kernel: [10964.568197] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 08:26:30 juju-e4d256-prod-github-runner-207 kernel: [10964.569367] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 08:26:30 juju-e4d256-prod-github-runner-207 kernel: [10964.570613] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 08:26:30 juju-e4d256-prod-github-runner-207 kernel: [10964.571708] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 08:26:30 juju-e4d256-prod-github-runner-207 kernel: [10964.572905] Call Trace: Aug 22 08:26:30 juju-e4d256-prod-github-runner-207 kernel: [10964.573820] Aug 22 08:26:30 juju-e4d256-prod-github-runner-207 kernel: [10964.574716] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:26:30 juju-e4d256-prod-github-runner-207 kernel: [10964.575749] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:26:30 juju-e4d256-prod-github-runner-207 kernel: [10964.576768] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:26:30 juju-e4d256-prod-github-runner-207 kernel: [10964.577868] ? show_regs.part.0+0x23/0x29 Aug 22 08:26:30 juju-e4d256-prod-github-runner-207 kernel: [10964.578867] ? show_regs.cold+0x8/0xd Aug 22 08:26:30 juju-e4d256-prod-github-runner-207 kernel: [10964.579868] ? watchdog_timer_fn+0x1be/0x220 Aug 22 08:26:30 juju-e4d256-prod-github-runner-207 kernel: [10964.580890] ? lockup_detector_update_enable+0x60/0x60 Aug 22 08:26:30 juju-e4d256-prod-github-runner-207 kernel: [10964.581973] ? __hrtimer_run_queues+0x107/0x230 Aug 22 08:26:30 juju-e4d256-prod-github-runner-207 kernel: [10964.583002] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 08:26:30 juju-e4d256-prod-github-runner-207 kernel: [10964.584028] ? hrtimer_interrupt+0x101/0x220 Aug 22 08:26:30 juju-e4d256-prod-github-runner-207 kernel: [10964.585045] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 08:26:30 juju-e4d256-prod-github-runner-207 kernel: [10964.586127] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 08:26:30 juju-e4d256-prod-github-runner-207 kernel: [10964.587178] Aug 22 08:26:30 juju-e4d256-prod-github-runner-207 kernel: [10964.588030] Aug 22 08:26:30 juju-e4d256-prod-github-runner-207 kernel: [10964.588866] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 08:26:30 juju-e4d256-prod-github-runner-207 kernel: [10964.589932] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:26:30 juju-e4d256-prod-github-runner-207 kernel: [10964.590973] ? _raw_spin_lock+0x22/0x30 Aug 22 08:26:30 juju-e4d256-prod-github-runner-207 kernel: [10964.591915] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:26:30 juju-e4d256-prod-github-runner-207 kernel: [10964.592929] direct_page_fault+0x206/0x310 [kvm] Aug 22 08:26:30 juju-e4d256-prod-github-runner-207 kernel: [10964.593966] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 08:26:30 juju-e4d256-prod-github-runner-207 kernel: [10964.594986] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 08:26:30 juju-e4d256-prod-github-runner-207 kernel: [10964.595985] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 08:26:30 juju-e4d256-prod-github-runner-207 kernel: [10964.596987] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 08:26:30 juju-e4d256-prod-github-runner-207 kernel: [10964.597957] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 08:26:30 juju-e4d256-prod-github-runner-207 kernel: [10964.598939] handle_exit+0x98/0x230 [kvm_amd] Aug 22 08:26:30 juju-e4d256-prod-github-runner-207 kernel: [10964.599834] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 08:26:30 juju-e4d256-prod-github-runner-207 kernel: [10964.600746] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 08:26:30 juju-e4d256-prod-github-runner-207 kernel: [10964.601667] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 08:26:30 juju-e4d256-prod-github-runner-207 kernel: [10964.602577] vcpu_run+0x62/0x2c0 [kvm] Aug 22 08:26:30 juju-e4d256-prod-github-runner-207 kernel: [10964.603387] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 08:26:30 juju-e4d256-prod-github-runner-207 kernel: [10964.604204] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 08:26:30 juju-e4d256-prod-github-runner-207 kernel: [10964.605063] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 08:26:30 juju-e4d256-prod-github-runner-207 kernel: [10964.605929] ? __seccomp_filter+0x4a/0x4a0 Aug 22 08:26:30 juju-e4d256-prod-github-runner-207 kernel: [10964.606677] ? __fget_files+0x86/0xc0 Aug 22 08:26:30 juju-e4d256-prod-github-runner-207 kernel: [10964.607378] __x64_sys_ioctl+0x95/0xd0 Aug 22 08:26:30 juju-e4d256-prod-github-runner-207 kernel: [10964.608085] do_syscall_64+0x5c/0xc0 Aug 22 08:26:30 juju-e4d256-prod-github-runner-207 kernel: [10964.608755] ? do_futex+0x162/0x1f0 Aug 22 08:26:30 juju-e4d256-prod-github-runner-207 kernel: [10964.609406] ? __x64_sys_futex+0x78/0x1e0 Aug 22 08:26:30 juju-e4d256-prod-github-runner-207 kernel: [10964.610095] ? __secure_computing+0xa9/0x120 Aug 22 08:26:30 juju-e4d256-prod-github-runner-207 kernel: [10964.610787] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 08:26:30 juju-e4d256-prod-github-runner-207 kernel: [10964.611547] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:26:30 juju-e4d256-prod-github-runner-207 kernel: [10964.612306] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:26:30 juju-e4d256-prod-github-runner-207 kernel: [10964.613053] ? do_syscall_64+0x69/0xc0 Aug 22 08:26:30 juju-e4d256-prod-github-runner-207 kernel: [10964.613698] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:26:30 juju-e4d256-prod-github-runner-207 kernel: [10964.614428] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:26:30 juju-e4d256-prod-github-runner-207 kernel: [10964.615285] ? do_syscall_64+0x69/0xc0 Aug 22 08:26:30 juju-e4d256-prod-github-runner-207 kernel: [10964.615908] ? do_syscall_64+0x69/0xc0 Aug 22 08:26:30 juju-e4d256-prod-github-runner-207 kernel: [10964.616687] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 08:26:30 juju-e4d256-prod-github-runner-207 kernel: [10964.617394] RIP: 0033:0x7faa5d0edaff Aug 22 08:26:30 juju-e4d256-prod-github-runner-207 kernel: [10964.618059] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 08:26:30 juju-e4d256-prod-github-runner-207 kernel: [10964.620062] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 08:26:30 juju-e4d256-prod-github-runner-207 kernel: [10964.620971] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 08:26:30 juju-e4d256-prod-github-runner-207 kernel: [10964.621875] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 08:26:30 juju-e4d256-prod-github-runner-207 kernel: [10964.622766] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 08:26:30 juju-e4d256-prod-github-runner-207 kernel: [10964.623649] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 08:26:30 juju-e4d256-prod-github-runner-207 kernel: [10964.624533] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 08:26:30 juju-e4d256-prod-github-runner-207 kernel: [10964.625421] Aug 22 08:26:44 juju-e4d256-prod-github-runner-207 kernel: [10977.920708] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 08:26:44 juju-e4d256-prod-github-runner-207 kernel: [10977.921688] rcu: 1-....: (2706659 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=1308542 Aug 22 08:26:44 juju-e4d256-prod-github-runner-207 kernel: [10977.922947] (t=2715180 jiffies g=23269 q=19421) Aug 22 08:26:44 juju-e4d256-prod-github-runner-207 kernel: [10977.923794] NMI backtrace for cpu 1 Aug 22 08:26:44 juju-e4d256-prod-github-runner-207 kernel: [10977.924531] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 08:26:44 juju-e4d256-prod-github-runner-207 kernel: [10977.925678] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 08:26:44 juju-e4d256-prod-github-runner-207 kernel: [10977.926787] Call Trace: Aug 22 08:26:44 juju-e4d256-prod-github-runner-207 kernel: [10977.927476] Aug 22 08:26:44 juju-e4d256-prod-github-runner-207 kernel: [10977.928123] show_stack+0x52/0x5c Aug 22 08:26:44 juju-e4d256-prod-github-runner-207 kernel: [10977.928854] dump_stack_lvl+0x4a/0x63 Aug 22 08:26:44 juju-e4d256-prod-github-runner-207 kernel: [10977.929627] dump_stack+0x10/0x16 Aug 22 08:26:44 juju-e4d256-prod-github-runner-207 kernel: [10977.930489] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 08:26:44 juju-e4d256-prod-github-runner-207 kernel: [10977.931284] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 08:26:44 juju-e4d256-prod-github-runner-207 kernel: [10977.932077] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 08:26:44 juju-e4d256-prod-github-runner-207 kernel: [10977.932903] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 08:26:44 juju-e4d256-prod-github-runner-207 kernel: [10977.933748] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 08:26:44 juju-e4d256-prod-github-runner-207 kernel: [10977.934587] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 08:26:44 juju-e4d256-prod-github-runner-207 kernel: [10977.935549] print_cpu_stall.cold+0x2f/0xe2 Aug 22 08:26:44 juju-e4d256-prod-github-runner-207 kernel: [10977.936329] ? timekeeping_update+0xf7/0x150 Aug 22 08:26:44 juju-e4d256-prod-github-runner-207 kernel: [10977.937112] check_cpu_stall+0x109/0x270 Aug 22 08:26:44 juju-e4d256-prod-github-runner-207 kernel: [10977.937983] rcu_sched_clock_irq+0x9a/0x250 Aug 22 08:26:44 juju-e4d256-prod-github-runner-207 kernel: [10977.938759] update_process_times+0x94/0xd0 Aug 22 08:26:44 juju-e4d256-prod-github-runner-207 kernel: [10977.939740] tick_sched_handle+0x29/0x70 Aug 22 08:26:44 juju-e4d256-prod-github-runner-207 kernel: [10977.940502] tick_sched_timer+0x8c/0xc0 Aug 22 08:26:44 juju-e4d256-prod-github-runner-207 kernel: [10977.941248] ? tick_nohz_handler+0xb0/0xb0 Aug 22 08:26:44 juju-e4d256-prod-github-runner-207 kernel: [10977.942030] __hrtimer_run_queues+0x107/0x230 Aug 22 08:26:44 juju-e4d256-prod-github-runner-207 kernel: [10977.942822] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 08:26:44 juju-e4d256-prod-github-runner-207 kernel: [10977.943656] hrtimer_interrupt+0x101/0x220 Aug 22 08:26:44 juju-e4d256-prod-github-runner-207 kernel: [10977.944430] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 08:26:44 juju-e4d256-prod-github-runner-207 kernel: [10977.945254] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 08:26:44 juju-e4d256-prod-github-runner-207 kernel: [10977.946099] Aug 22 08:26:44 juju-e4d256-prod-github-runner-207 kernel: [10977.946766] Aug 22 08:26:44 juju-e4d256-prod-github-runner-207 kernel: [10977.947398] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 08:26:44 juju-e4d256-prod-github-runner-207 kernel: [10977.948225] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:26:44 juju-e4d256-prod-github-runner-207 kernel: [10977.949113] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 08:26:44 juju-e4d256-prod-github-runner-207 kernel: [10977.951452] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 08:26:44 juju-e4d256-prod-github-runner-207 kernel: [10977.952371] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 08:26:44 juju-e4d256-prod-github-runner-207 kernel: [10977.953375] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 08:26:44 juju-e4d256-prod-github-runner-207 kernel: [10977.954398] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 08:26:44 juju-e4d256-prod-github-runner-207 kernel: [10977.955378] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 08:26:44 juju-e4d256-prod-github-runner-207 kernel: [10977.956345] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 08:26:44 juju-e4d256-prod-github-runner-207 kernel: [10977.957315] ? _raw_spin_lock+0x22/0x30 Aug 22 08:26:44 juju-e4d256-prod-github-runner-207 kernel: [10977.958108] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:26:44 juju-e4d256-prod-github-runner-207 kernel: [10977.958953] direct_page_fault+0x206/0x310 [kvm] Aug 22 08:26:44 juju-e4d256-prod-github-runner-207 kernel: [10977.959801] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 08:26:44 juju-e4d256-prod-github-runner-207 kernel: [10977.960639] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 08:26:44 juju-e4d256-prod-github-runner-207 kernel: [10977.961491] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 08:26:44 juju-e4d256-prod-github-runner-207 kernel: [10977.962339] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 08:26:44 juju-e4d256-prod-github-runner-207 kernel: [10977.963142] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 08:26:44 juju-e4d256-prod-github-runner-207 kernel: [10977.964009] handle_exit+0x98/0x230 [kvm_amd] Aug 22 08:26:44 juju-e4d256-prod-github-runner-207 kernel: [10977.964794] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 08:26:44 juju-e4d256-prod-github-runner-207 kernel: [10977.965645] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 08:26:44 juju-e4d256-prod-github-runner-207 kernel: [10977.966490] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 08:26:44 juju-e4d256-prod-github-runner-207 kernel: [10977.967291] vcpu_run+0x62/0x2c0 [kvm] Aug 22 08:26:44 juju-e4d256-prod-github-runner-207 kernel: [10977.968051] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 08:26:44 juju-e4d256-prod-github-runner-207 kernel: [10977.968799] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 08:26:44 juju-e4d256-prod-github-runner-207 kernel: [10977.969635] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 08:26:44 juju-e4d256-prod-github-runner-207 kernel: [10977.970414] ? __seccomp_filter+0x4a/0x4a0 Aug 22 08:26:44 juju-e4d256-prod-github-runner-207 kernel: [10977.971144] ? __fget_files+0x86/0xc0 Aug 22 08:26:44 juju-e4d256-prod-github-runner-207 kernel: [10977.971847] __x64_sys_ioctl+0x95/0xd0 Aug 22 08:26:44 juju-e4d256-prod-github-runner-207 kernel: [10977.972552] do_syscall_64+0x5c/0xc0 Aug 22 08:26:44 juju-e4d256-prod-github-runner-207 kernel: [10977.973271] ? do_futex+0x162/0x1f0 Aug 22 08:26:44 juju-e4d256-prod-github-runner-207 kernel: [10977.973991] ? __x64_sys_futex+0x78/0x1e0 Aug 22 08:26:44 juju-e4d256-prod-github-runner-207 kernel: [10977.974707] ? __secure_computing+0xa9/0x120 Aug 22 08:26:44 juju-e4d256-prod-github-runner-207 kernel: [10977.975478] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 08:26:44 juju-e4d256-prod-github-runner-207 kernel: [10977.976298] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:26:44 juju-e4d256-prod-github-runner-207 kernel: [10977.977066] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:26:44 juju-e4d256-prod-github-runner-207 kernel: [10977.977854] ? do_syscall_64+0x69/0xc0 Aug 22 08:26:44 juju-e4d256-prod-github-runner-207 kernel: [10977.978553] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:26:44 juju-e4d256-prod-github-runner-207 kernel: [10977.979316] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:26:44 juju-e4d256-prod-github-runner-207 kernel: [10977.980083] ? do_syscall_64+0x69/0xc0 Aug 22 08:26:44 juju-e4d256-prod-github-runner-207 kernel: [10977.980846] ? do_syscall_64+0x69/0xc0 Aug 22 08:26:44 juju-e4d256-prod-github-runner-207 kernel: [10977.981564] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 08:26:44 juju-e4d256-prod-github-runner-207 kernel: [10977.982345] RIP: 0033:0x7faa5d0edaff Aug 22 08:26:44 juju-e4d256-prod-github-runner-207 kernel: [10977.983053] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 08:26:44 juju-e4d256-prod-github-runner-207 kernel: [10977.985193] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 08:26:44 juju-e4d256-prod-github-runner-207 kernel: [10977.986188] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 08:26:44 juju-e4d256-prod-github-runner-207 kernel: [10977.987151] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 08:26:44 juju-e4d256-prod-github-runner-207 kernel: [10977.988105] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 08:26:44 juju-e4d256-prod-github-runner-207 kernel: [10977.989056] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 08:26:44 juju-e4d256-prod-github-runner-207 kernel: [10977.990013] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 08:26:44 juju-e4d256-prod-github-runner-207 kernel: [10977.990938] Aug 22 08:27:10 juju-e4d256-prod-github-runner-207 kernel: [11004.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 10140s! [qemu-system-x86:6715] Aug 22 08:27:10 juju-e4d256-prod-github-runner-207 kernel: [11004.543105] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 08:27:10 juju-e4d256-prod-github-runner-207 kernel: [11004.543176] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 08:27:10 juju-e4d256-prod-github-runner-207 kernel: [11004.555363] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 08:27:10 juju-e4d256-prod-github-runner-207 kernel: [11004.556640] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 08:27:10 juju-e4d256-prod-github-runner-207 kernel: [11004.557896] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:27:10 juju-e4d256-prod-github-runner-207 kernel: [11004.558961] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 08:27:10 juju-e4d256-prod-github-runner-207 kernel: [11004.561560] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 08:27:10 juju-e4d256-prod-github-runner-207 kernel: [11004.562613] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 08:27:10 juju-e4d256-prod-github-runner-207 kernel: [11004.563798] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 08:27:10 juju-e4d256-prod-github-runner-207 kernel: [11004.564967] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 08:27:10 juju-e4d256-prod-github-runner-207 kernel: [11004.566153] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 08:27:10 juju-e4d256-prod-github-runner-207 kernel: [11004.567328] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 08:27:10 juju-e4d256-prod-github-runner-207 kernel: [11004.568513] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 08:27:10 juju-e4d256-prod-github-runner-207 kernel: [11004.569781] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 08:27:10 juju-e4d256-prod-github-runner-207 kernel: [11004.570893] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 08:27:10 juju-e4d256-prod-github-runner-207 kernel: [11004.572103] Call Trace: Aug 22 08:27:10 juju-e4d256-prod-github-runner-207 kernel: [11004.573030] Aug 22 08:27:10 juju-e4d256-prod-github-runner-207 kernel: [11004.573946] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:27:10 juju-e4d256-prod-github-runner-207 kernel: [11004.574984] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:27:10 juju-e4d256-prod-github-runner-207 kernel: [11004.576016] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:27:10 juju-e4d256-prod-github-runner-207 kernel: [11004.577104] ? show_regs.part.0+0x23/0x29 Aug 22 08:27:10 juju-e4d256-prod-github-runner-207 kernel: [11004.578137] ? show_regs.cold+0x8/0xd Aug 22 08:27:10 juju-e4d256-prod-github-runner-207 kernel: [11004.579123] ? watchdog_timer_fn+0x1be/0x220 Aug 22 08:27:10 juju-e4d256-prod-github-runner-207 kernel: [11004.580153] ? lockup_detector_update_enable+0x60/0x60 Aug 22 08:27:10 juju-e4d256-prod-github-runner-207 kernel: [11004.581374] ? __hrtimer_run_queues+0x107/0x230 Aug 22 08:27:10 juju-e4d256-prod-github-runner-207 kernel: [11004.582604] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 08:27:10 juju-e4d256-prod-github-runner-207 kernel: [11004.583636] ? hrtimer_interrupt+0x101/0x220 Aug 22 08:27:10 juju-e4d256-prod-github-runner-207 kernel: [11004.584660] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 08:27:10 juju-e4d256-prod-github-runner-207 kernel: [11004.585759] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 08:27:10 juju-e4d256-prod-github-runner-207 kernel: [11004.586886] Aug 22 08:27:10 juju-e4d256-prod-github-runner-207 kernel: [11004.587748] Aug 22 08:27:10 juju-e4d256-prod-github-runner-207 kernel: [11004.588630] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 08:27:10 juju-e4d256-prod-github-runner-207 kernel: [11004.589692] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:27:10 juju-e4d256-prod-github-runner-207 kernel: [11004.590746] ? _raw_spin_lock+0x22/0x30 Aug 22 08:27:10 juju-e4d256-prod-github-runner-207 kernel: [11004.591700] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:27:10 juju-e4d256-prod-github-runner-207 kernel: [11004.592732] direct_page_fault+0x206/0x310 [kvm] Aug 22 08:27:10 juju-e4d256-prod-github-runner-207 kernel: [11004.593768] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 08:27:10 juju-e4d256-prod-github-runner-207 kernel: [11004.594798] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 08:27:10 juju-e4d256-prod-github-runner-207 kernel: [11004.595855] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 08:27:10 juju-e4d256-prod-github-runner-207 kernel: [11004.597057] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 08:27:10 juju-e4d256-prod-github-runner-207 kernel: [11004.598052] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 08:27:10 juju-e4d256-prod-github-runner-207 kernel: [11004.599267] handle_exit+0x98/0x230 [kvm_amd] Aug 22 08:27:10 juju-e4d256-prod-github-runner-207 kernel: [11004.600379] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 08:27:10 juju-e4d256-prod-github-runner-207 kernel: [11004.601544] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 08:27:10 juju-e4d256-prod-github-runner-207 kernel: [11004.602686] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 08:27:10 juju-e4d256-prod-github-runner-207 kernel: [11004.603692] vcpu_run+0x62/0x2c0 [kvm] Aug 22 08:27:10 juju-e4d256-prod-github-runner-207 kernel: [11004.604751] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 08:27:10 juju-e4d256-prod-github-runner-207 kernel: [11004.605595] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 08:27:10 juju-e4d256-prod-github-runner-207 kernel: [11004.606478] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 08:27:10 juju-e4d256-prod-github-runner-207 kernel: [11004.607292] ? __seccomp_filter+0x4a/0x4a0 Aug 22 08:27:10 juju-e4d256-prod-github-runner-207 kernel: [11004.608049] ? __fget_files+0x86/0xc0 Aug 22 08:27:10 juju-e4d256-prod-github-runner-207 kernel: [11004.608767] __x64_sys_ioctl+0x95/0xd0 Aug 22 08:27:10 juju-e4d256-prod-github-runner-207 kernel: [11004.609483] do_syscall_64+0x5c/0xc0 Aug 22 08:27:10 juju-e4d256-prod-github-runner-207 kernel: [11004.610166] ? do_futex+0x162/0x1f0 Aug 22 08:27:10 juju-e4d256-prod-github-runner-207 kernel: [11004.610832] ? __x64_sys_futex+0x78/0x1e0 Aug 22 08:27:10 juju-e4d256-prod-github-runner-207 kernel: [11004.611542] ? __secure_computing+0xa9/0x120 Aug 22 08:27:10 juju-e4d256-prod-github-runner-207 kernel: [11004.612246] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 08:27:10 juju-e4d256-prod-github-runner-207 kernel: [11004.613018] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:27:10 juju-e4d256-prod-github-runner-207 kernel: [11004.613759] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:27:10 juju-e4d256-prod-github-runner-207 kernel: [11004.614480] ? do_syscall_64+0x69/0xc0 Aug 22 08:27:10 juju-e4d256-prod-github-runner-207 kernel: [11004.615132] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:27:10 juju-e4d256-prod-github-runner-207 kernel: [11004.615865] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:27:10 juju-e4d256-prod-github-runner-207 kernel: [11004.616576] ? do_syscall_64+0x69/0xc0 Aug 22 08:27:10 juju-e4d256-prod-github-runner-207 kernel: [11004.617220] ? do_syscall_64+0x69/0xc0 Aug 22 08:27:10 juju-e4d256-prod-github-runner-207 kernel: [11004.617857] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 08:27:10 juju-e4d256-prod-github-runner-207 kernel: [11004.618567] RIP: 0033:0x7faa5d0edaff Aug 22 08:27:10 juju-e4d256-prod-github-runner-207 kernel: [11004.619196] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 08:27:10 juju-e4d256-prod-github-runner-207 kernel: [11004.621196] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 08:27:10 juju-e4d256-prod-github-runner-207 kernel: [11004.622150] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 08:27:10 juju-e4d256-prod-github-runner-207 kernel: [11004.623051] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 08:27:10 juju-e4d256-prod-github-runner-207 kernel: [11004.623947] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 08:27:10 juju-e4d256-prod-github-runner-207 kernel: [11004.624842] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 08:27:10 juju-e4d256-prod-github-runner-207 kernel: [11004.625754] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 08:27:10 juju-e4d256-prod-github-runner-207 kernel: [11004.626654] Aug 22 08:27:38 juju-e4d256-prod-github-runner-207 kernel: [11032.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 10166s! [qemu-system-x86:6715] Aug 22 08:27:38 juju-e4d256-prod-github-runner-207 kernel: [11032.543121] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 08:27:38 juju-e4d256-prod-github-runner-207 kernel: [11032.543195] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 08:27:38 juju-e4d256-prod-github-runner-207 kernel: [11032.555354] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 08:27:38 juju-e4d256-prod-github-runner-207 kernel: [11032.556615] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 08:27:38 juju-e4d256-prod-github-runner-207 kernel: [11032.557862] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:27:38 juju-e4d256-prod-github-runner-207 kernel: [11032.558929] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 08:27:38 juju-e4d256-prod-github-runner-207 kernel: [11032.561508] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 08:27:38 juju-e4d256-prod-github-runner-207 kernel: [11032.562557] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 08:27:38 juju-e4d256-prod-github-runner-207 kernel: [11032.563723] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 08:27:38 juju-e4d256-prod-github-runner-207 kernel: [11032.564895] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 08:27:38 juju-e4d256-prod-github-runner-207 kernel: [11032.566052] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 08:27:38 juju-e4d256-prod-github-runner-207 kernel: [11032.567216] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 08:27:38 juju-e4d256-prod-github-runner-207 kernel: [11032.568386] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 08:27:38 juju-e4d256-prod-github-runner-207 kernel: [11032.569660] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 08:27:38 juju-e4d256-prod-github-runner-207 kernel: [11032.570785] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 08:27:38 juju-e4d256-prod-github-runner-207 kernel: [11032.571997] Call Trace: Aug 22 08:27:38 juju-e4d256-prod-github-runner-207 kernel: [11032.572974] Aug 22 08:27:38 juju-e4d256-prod-github-runner-207 kernel: [11032.573866] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:27:38 juju-e4d256-prod-github-runner-207 kernel: [11032.574898] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:27:38 juju-e4d256-prod-github-runner-207 kernel: [11032.575917] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:27:38 juju-e4d256-prod-github-runner-207 kernel: [11032.577018] ? show_regs.part.0+0x23/0x29 Aug 22 08:27:38 juju-e4d256-prod-github-runner-207 kernel: [11032.578044] ? show_regs.cold+0x8/0xd Aug 22 08:27:38 juju-e4d256-prod-github-runner-207 kernel: [11032.579050] ? watchdog_timer_fn+0x1be/0x220 Aug 22 08:27:38 juju-e4d256-prod-github-runner-207 kernel: [11032.580078] ? lockup_detector_update_enable+0x60/0x60 Aug 22 08:27:38 juju-e4d256-prod-github-runner-207 kernel: [11032.581191] ? __hrtimer_run_queues+0x107/0x230 Aug 22 08:27:38 juju-e4d256-prod-github-runner-207 kernel: [11032.582221] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 08:27:38 juju-e4d256-prod-github-runner-207 kernel: [11032.583293] ? hrtimer_interrupt+0x101/0x220 Aug 22 08:27:38 juju-e4d256-prod-github-runner-207 kernel: [11032.584328] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 08:27:38 juju-e4d256-prod-github-runner-207 kernel: [11032.585415] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 08:27:38 juju-e4d256-prod-github-runner-207 kernel: [11032.586469] Aug 22 08:27:38 juju-e4d256-prod-github-runner-207 kernel: [11032.587329] Aug 22 08:27:38 juju-e4d256-prod-github-runner-207 kernel: [11032.588178] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 08:27:38 juju-e4d256-prod-github-runner-207 kernel: [11032.589237] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:27:38 juju-e4d256-prod-github-runner-207 kernel: [11032.590282] ? _raw_spin_lock+0x22/0x30 Aug 22 08:27:38 juju-e4d256-prod-github-runner-207 kernel: [11032.591229] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:27:38 juju-e4d256-prod-github-runner-207 kernel: [11032.592259] direct_page_fault+0x206/0x310 [kvm] Aug 22 08:27:38 juju-e4d256-prod-github-runner-207 kernel: [11032.593317] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 08:27:38 juju-e4d256-prod-github-runner-207 kernel: [11032.594363] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 08:27:38 juju-e4d256-prod-github-runner-207 kernel: [11032.595401] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 08:27:38 juju-e4d256-prod-github-runner-207 kernel: [11032.596405] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 08:27:38 juju-e4d256-prod-github-runner-207 kernel: [11032.597390] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 08:27:38 juju-e4d256-prod-github-runner-207 kernel: [11032.598419] handle_exit+0x98/0x230 [kvm_amd] Aug 22 08:27:38 juju-e4d256-prod-github-runner-207 kernel: [11032.599349] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 08:27:38 juju-e4d256-prod-github-runner-207 kernel: [11032.600276] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 08:27:38 juju-e4d256-prod-github-runner-207 kernel: [11032.601223] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 08:27:38 juju-e4d256-prod-github-runner-207 kernel: [11032.602135] vcpu_run+0x62/0x2c0 [kvm] Aug 22 08:27:38 juju-e4d256-prod-github-runner-207 kernel: [11032.602947] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 08:27:38 juju-e4d256-prod-github-runner-207 kernel: [11032.603771] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 08:27:38 juju-e4d256-prod-github-runner-207 kernel: [11032.604644] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 08:27:38 juju-e4d256-prod-github-runner-207 kernel: [11032.605463] ? __seccomp_filter+0x4a/0x4a0 Aug 22 08:27:38 juju-e4d256-prod-github-runner-207 kernel: [11032.606212] ? __fget_files+0x86/0xc0 Aug 22 08:27:38 juju-e4d256-prod-github-runner-207 kernel: [11032.606919] __x64_sys_ioctl+0x95/0xd0 Aug 22 08:27:38 juju-e4d256-prod-github-runner-207 kernel: [11032.607642] do_syscall_64+0x5c/0xc0 Aug 22 08:27:38 juju-e4d256-prod-github-runner-207 kernel: [11032.608325] ? do_futex+0x162/0x1f0 Aug 22 08:27:38 juju-e4d256-prod-github-runner-207 kernel: [11032.608999] ? __x64_sys_futex+0x78/0x1e0 Aug 22 08:27:38 juju-e4d256-prod-github-runner-207 kernel: [11032.609687] ? __secure_computing+0xa9/0x120 Aug 22 08:27:38 juju-e4d256-prod-github-runner-207 kernel: [11032.610379] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 08:27:38 juju-e4d256-prod-github-runner-207 kernel: [11032.611140] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:27:38 juju-e4d256-prod-github-runner-207 kernel: [11032.611867] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:27:38 juju-e4d256-prod-github-runner-207 kernel: [11032.612585] ? do_syscall_64+0x69/0xc0 Aug 22 08:27:38 juju-e4d256-prod-github-runner-207 kernel: [11032.613250] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:27:38 juju-e4d256-prod-github-runner-207 kernel: [11032.613965] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:27:38 juju-e4d256-prod-github-runner-207 kernel: [11032.614712] ? do_syscall_64+0x69/0xc0 Aug 22 08:27:38 juju-e4d256-prod-github-runner-207 kernel: [11032.615342] ? do_syscall_64+0x69/0xc0 Aug 22 08:27:38 juju-e4d256-prod-github-runner-207 kernel: [11032.615972] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 08:27:38 juju-e4d256-prod-github-runner-207 kernel: [11032.616679] RIP: 0033:0x7faa5d0edaff Aug 22 08:27:38 juju-e4d256-prod-github-runner-207 kernel: [11032.617318] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 08:27:38 juju-e4d256-prod-github-runner-207 kernel: [11032.619318] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 08:27:38 juju-e4d256-prod-github-runner-207 kernel: [11032.620254] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 08:27:38 juju-e4d256-prod-github-runner-207 kernel: [11032.621168] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 08:27:38 juju-e4d256-prod-github-runner-207 kernel: [11032.622058] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 08:27:38 juju-e4d256-prod-github-runner-207 kernel: [11032.622967] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 08:27:38 juju-e4d256-prod-github-runner-207 kernel: [11032.623884] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 08:27:38 juju-e4d256-prod-github-runner-207 kernel: [11032.624812] Aug 22 08:28:06 juju-e4d256-prod-github-runner-207 kernel: [11060.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 10192s! [qemu-system-x86:6715] Aug 22 08:28:06 juju-e4d256-prod-github-runner-207 kernel: [11060.544016] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 08:28:06 juju-e4d256-prod-github-runner-207 kernel: [11060.544305] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 08:28:06 juju-e4d256-prod-github-runner-207 kernel: [11060.557003] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 08:28:06 juju-e4d256-prod-github-runner-207 kernel: [11060.558273] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 08:28:06 juju-e4d256-prod-github-runner-207 kernel: [11060.559496] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:28:06 juju-e4d256-prod-github-runner-207 kernel: [11060.560597] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 08:28:06 juju-e4d256-prod-github-runner-207 kernel: [11060.563156] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 08:28:06 juju-e4d256-prod-github-runner-207 kernel: [11060.564194] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 08:28:06 juju-e4d256-prod-github-runner-207 kernel: [11060.565367] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 08:28:06 juju-e4d256-prod-github-runner-207 kernel: [11060.566522] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 08:28:06 juju-e4d256-prod-github-runner-207 kernel: [11060.567684] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 08:28:06 juju-e4d256-prod-github-runner-207 kernel: [11060.568866] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 08:28:06 juju-e4d256-prod-github-runner-207 kernel: [11060.570031] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 08:28:06 juju-e4d256-prod-github-runner-207 kernel: [11060.571266] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 08:28:06 juju-e4d256-prod-github-runner-207 kernel: [11060.572366] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 08:28:06 juju-e4d256-prod-github-runner-207 kernel: [11060.573562] Call Trace: Aug 22 08:28:06 juju-e4d256-prod-github-runner-207 kernel: [11060.574471] Aug 22 08:28:06 juju-e4d256-prod-github-runner-207 kernel: [11060.575370] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:28:06 juju-e4d256-prod-github-runner-207 kernel: [11060.576399] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:28:06 juju-e4d256-prod-github-runner-207 kernel: [11060.577429] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:28:06 juju-e4d256-prod-github-runner-207 kernel: [11060.578521] ? show_regs.part.0+0x23/0x29 Aug 22 08:28:06 juju-e4d256-prod-github-runner-207 kernel: [11060.579522] ? show_regs.cold+0x8/0xd Aug 22 08:28:06 juju-e4d256-prod-github-runner-207 kernel: [11060.580491] ? watchdog_timer_fn+0x1be/0x220 Aug 22 08:28:06 juju-e4d256-prod-github-runner-207 kernel: [11060.581504] ? lockup_detector_update_enable+0x60/0x60 Aug 22 08:28:06 juju-e4d256-prod-github-runner-207 kernel: [11060.582563] ? __hrtimer_run_queues+0x107/0x230 Aug 22 08:28:06 juju-e4d256-prod-github-runner-207 kernel: [11060.583606] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 08:28:06 juju-e4d256-prod-github-runner-207 kernel: [11060.584645] ? hrtimer_interrupt+0x101/0x220 Aug 22 08:28:06 juju-e4d256-prod-github-runner-207 kernel: [11060.585686] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 08:28:06 juju-e4d256-prod-github-runner-207 kernel: [11060.586772] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 08:28:06 juju-e4d256-prod-github-runner-207 kernel: [11060.588077] Aug 22 08:28:06 juju-e4d256-prod-github-runner-207 kernel: [11060.588973] Aug 22 08:28:06 juju-e4d256-prod-github-runner-207 kernel: [11060.589813] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 08:28:06 juju-e4d256-prod-github-runner-207 kernel: [11060.590865] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:28:06 juju-e4d256-prod-github-runner-207 kernel: [11060.591920] ? _raw_spin_lock+0x22/0x30 Aug 22 08:28:06 juju-e4d256-prod-github-runner-207 kernel: [11060.592877] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:28:06 juju-e4d256-prod-github-runner-207 kernel: [11060.593902] direct_page_fault+0x206/0x310 [kvm] Aug 22 08:28:06 juju-e4d256-prod-github-runner-207 kernel: [11060.594927] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 08:28:06 juju-e4d256-prod-github-runner-207 kernel: [11060.595964] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 08:28:06 juju-e4d256-prod-github-runner-207 kernel: [11060.596990] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 08:28:06 juju-e4d256-prod-github-runner-207 kernel: [11060.598016] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 08:28:06 juju-e4d256-prod-github-runner-207 kernel: [11060.598977] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 08:28:06 juju-e4d256-prod-github-runner-207 kernel: [11060.599960] handle_exit+0x98/0x230 [kvm_amd] Aug 22 08:28:06 juju-e4d256-prod-github-runner-207 kernel: [11060.600882] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 08:28:06 juju-e4d256-prod-github-runner-207 kernel: [11060.601870] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 08:28:06 juju-e4d256-prod-github-runner-207 kernel: [11060.602794] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 08:28:06 juju-e4d256-prod-github-runner-207 kernel: [11060.603702] vcpu_run+0x62/0x2c0 [kvm] Aug 22 08:28:06 juju-e4d256-prod-github-runner-207 kernel: [11060.604531] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 08:28:06 juju-e4d256-prod-github-runner-207 kernel: [11060.605345] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 08:28:06 juju-e4d256-prod-github-runner-207 kernel: [11060.606204] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 08:28:06 juju-e4d256-prod-github-runner-207 kernel: [11060.607003] ? __seccomp_filter+0x4a/0x4a0 Aug 22 08:28:06 juju-e4d256-prod-github-runner-207 kernel: [11060.607742] ? __fget_files+0x86/0xc0 Aug 22 08:28:06 juju-e4d256-prod-github-runner-207 kernel: [11060.608444] __x64_sys_ioctl+0x95/0xd0 Aug 22 08:28:06 juju-e4d256-prod-github-runner-207 kernel: [11060.609155] do_syscall_64+0x5c/0xc0 Aug 22 08:28:06 juju-e4d256-prod-github-runner-207 kernel: [11060.609820] ? do_futex+0x162/0x1f0 Aug 22 08:28:06 juju-e4d256-prod-github-runner-207 kernel: [11060.610473] ? __x64_sys_futex+0x78/0x1e0 Aug 22 08:28:06 juju-e4d256-prod-github-runner-207 kernel: [11060.611149] ? __secure_computing+0xa9/0x120 Aug 22 08:28:06 juju-e4d256-prod-github-runner-207 kernel: [11060.611842] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 08:28:06 juju-e4d256-prod-github-runner-207 kernel: [11060.612619] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:28:06 juju-e4d256-prod-github-runner-207 kernel: [11060.613358] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:28:06 juju-e4d256-prod-github-runner-207 kernel: [11060.614077] ? do_syscall_64+0x69/0xc0 Aug 22 08:28:06 juju-e4d256-prod-github-runner-207 kernel: [11060.614724] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:28:06 juju-e4d256-prod-github-runner-207 kernel: [11060.615470] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:28:06 juju-e4d256-prod-github-runner-207 kernel: [11060.616188] ? do_syscall_64+0x69/0xc0 Aug 22 08:28:06 juju-e4d256-prod-github-runner-207 kernel: [11060.616836] ? do_syscall_64+0x69/0xc0 Aug 22 08:28:06 juju-e4d256-prod-github-runner-207 kernel: [11060.617462] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 08:28:06 juju-e4d256-prod-github-runner-207 kernel: [11060.618174] RIP: 0033:0x7faa5d0edaff Aug 22 08:28:06 juju-e4d256-prod-github-runner-207 kernel: [11060.618827] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 08:28:06 juju-e4d256-prod-github-runner-207 kernel: [11060.620844] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 08:28:06 juju-e4d256-prod-github-runner-207 kernel: [11060.621764] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 08:28:06 juju-e4d256-prod-github-runner-207 kernel: [11060.622655] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 08:28:06 juju-e4d256-prod-github-runner-207 kernel: [11060.623547] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 08:28:06 juju-e4d256-prod-github-runner-207 kernel: [11060.624576] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 08:28:06 juju-e4d256-prod-github-runner-207 kernel: [11060.625642] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 08:28:06 juju-e4d256-prod-github-runner-207 kernel: [11060.626539] Aug 22 08:28:34 juju-e4d256-prod-github-runner-207 kernel: [11088.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 10219s! [qemu-system-x86:6715] Aug 22 08:28:34 juju-e4d256-prod-github-runner-207 kernel: [11088.543087] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 08:28:34 juju-e4d256-prod-github-runner-207 kernel: [11088.543159] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 08:28:34 juju-e4d256-prod-github-runner-207 kernel: [11088.555359] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 08:28:34 juju-e4d256-prod-github-runner-207 kernel: [11088.556647] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 08:28:34 juju-e4d256-prod-github-runner-207 kernel: [11088.557865] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:28:34 juju-e4d256-prod-github-runner-207 kernel: [11088.558919] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 08:28:34 juju-e4d256-prod-github-runner-207 kernel: [11088.561488] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 08:28:34 juju-e4d256-prod-github-runner-207 kernel: [11088.562530] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 08:28:34 juju-e4d256-prod-github-runner-207 kernel: [11088.563689] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 08:28:34 juju-e4d256-prod-github-runner-207 kernel: [11088.564853] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 08:28:34 juju-e4d256-prod-github-runner-207 kernel: [11088.566018] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 08:28:34 juju-e4d256-prod-github-runner-207 kernel: [11088.567275] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 08:28:34 juju-e4d256-prod-github-runner-207 kernel: [11088.568494] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 08:28:34 juju-e4d256-prod-github-runner-207 kernel: [11088.569731] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 08:28:34 juju-e4d256-prod-github-runner-207 kernel: [11088.570843] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 08:28:34 juju-e4d256-prod-github-runner-207 kernel: [11088.572053] Call Trace: Aug 22 08:28:34 juju-e4d256-prod-github-runner-207 kernel: [11088.573002] Aug 22 08:28:34 juju-e4d256-prod-github-runner-207 kernel: [11088.573896] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:28:34 juju-e4d256-prod-github-runner-207 kernel: [11088.574926] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:28:34 juju-e4d256-prod-github-runner-207 kernel: [11088.575957] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:28:34 juju-e4d256-prod-github-runner-207 kernel: [11088.577046] ? show_regs.part.0+0x23/0x29 Aug 22 08:28:34 juju-e4d256-prod-github-runner-207 kernel: [11088.578042] ? show_regs.cold+0x8/0xd Aug 22 08:28:34 juju-e4d256-prod-github-runner-207 kernel: [11088.579012] ? watchdog_timer_fn+0x1be/0x220 Aug 22 08:28:34 juju-e4d256-prod-github-runner-207 kernel: [11088.580027] ? lockup_detector_update_enable+0x60/0x60 Aug 22 08:28:34 juju-e4d256-prod-github-runner-207 kernel: [11088.581129] ? __hrtimer_run_queues+0x107/0x230 Aug 22 08:28:34 juju-e4d256-prod-github-runner-207 kernel: [11088.582185] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 08:28:34 juju-e4d256-prod-github-runner-207 kernel: [11088.583207] ? hrtimer_interrupt+0x101/0x220 Aug 22 08:28:34 juju-e4d256-prod-github-runner-207 kernel: [11088.584237] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 08:28:34 juju-e4d256-prod-github-runner-207 kernel: [11088.585302] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 08:28:34 juju-e4d256-prod-github-runner-207 kernel: [11088.586377] Aug 22 08:28:34 juju-e4d256-prod-github-runner-207 kernel: [11088.587251] Aug 22 08:28:34 juju-e4d256-prod-github-runner-207 kernel: [11088.588125] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 08:28:34 juju-e4d256-prod-github-runner-207 kernel: [11088.589194] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:28:34 juju-e4d256-prod-github-runner-207 kernel: [11088.590240] ? _raw_spin_lock+0x22/0x30 Aug 22 08:28:34 juju-e4d256-prod-github-runner-207 kernel: [11088.591223] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:28:34 juju-e4d256-prod-github-runner-207 kernel: [11088.592282] direct_page_fault+0x206/0x310 [kvm] Aug 22 08:28:34 juju-e4d256-prod-github-runner-207 kernel: [11088.593310] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 08:28:34 juju-e4d256-prod-github-runner-207 kernel: [11088.594319] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 08:28:34 juju-e4d256-prod-github-runner-207 kernel: [11088.595322] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 08:28:34 juju-e4d256-prod-github-runner-207 kernel: [11088.596313] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 08:28:34 juju-e4d256-prod-github-runner-207 kernel: [11088.597265] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 08:28:34 juju-e4d256-prod-github-runner-207 kernel: [11088.598252] handle_exit+0x98/0x230 [kvm_amd] Aug 22 08:28:34 juju-e4d256-prod-github-runner-207 kernel: [11088.599157] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 08:28:34 juju-e4d256-prod-github-runner-207 kernel: [11088.600085] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 08:28:34 juju-e4d256-prod-github-runner-207 kernel: [11088.601025] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 08:28:34 juju-e4d256-prod-github-runner-207 kernel: [11088.601958] vcpu_run+0x62/0x2c0 [kvm] Aug 22 08:28:34 juju-e4d256-prod-github-runner-207 kernel: [11088.602787] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 08:28:34 juju-e4d256-prod-github-runner-207 kernel: [11088.603598] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 08:28:34 juju-e4d256-prod-github-runner-207 kernel: [11088.604476] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 08:28:34 juju-e4d256-prod-github-runner-207 kernel: [11088.605411] ? __seccomp_filter+0x4a/0x4a0 Aug 22 08:28:34 juju-e4d256-prod-github-runner-207 kernel: [11088.606196] ? __fget_files+0x86/0xc0 Aug 22 08:28:34 juju-e4d256-prod-github-runner-207 kernel: [11088.606936] __x64_sys_ioctl+0x95/0xd0 Aug 22 08:28:34 juju-e4d256-prod-github-runner-207 kernel: [11088.607641] do_syscall_64+0x5c/0xc0 Aug 22 08:28:34 juju-e4d256-prod-github-runner-207 kernel: [11088.608337] ? do_futex+0x162/0x1f0 Aug 22 08:28:34 juju-e4d256-prod-github-runner-207 kernel: [11088.608992] ? __x64_sys_futex+0x78/0x1e0 Aug 22 08:28:34 juju-e4d256-prod-github-runner-207 kernel: [11088.609671] ? __secure_computing+0xa9/0x120 Aug 22 08:28:34 juju-e4d256-prod-github-runner-207 kernel: [11088.610367] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 08:28:34 juju-e4d256-prod-github-runner-207 kernel: [11088.611127] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:28:34 juju-e4d256-prod-github-runner-207 kernel: [11088.611885] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:28:34 juju-e4d256-prod-github-runner-207 kernel: [11088.612625] ? do_syscall_64+0x69/0xc0 Aug 22 08:28:34 juju-e4d256-prod-github-runner-207 kernel: [11088.613273] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:28:34 juju-e4d256-prod-github-runner-207 kernel: [11088.613983] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:28:34 juju-e4d256-prod-github-runner-207 kernel: [11088.614682] ? do_syscall_64+0x69/0xc0 Aug 22 08:28:34 juju-e4d256-prod-github-runner-207 kernel: [11088.615311] ? do_syscall_64+0x69/0xc0 Aug 22 08:28:34 juju-e4d256-prod-github-runner-207 kernel: [11088.615934] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 08:28:34 juju-e4d256-prod-github-runner-207 kernel: [11088.616650] RIP: 0033:0x7faa5d0edaff Aug 22 08:28:34 juju-e4d256-prod-github-runner-207 kernel: [11088.617305] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 08:28:34 juju-e4d256-prod-github-runner-207 kernel: [11088.619306] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 08:28:34 juju-e4d256-prod-github-runner-207 kernel: [11088.620248] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 08:28:34 juju-e4d256-prod-github-runner-207 kernel: [11088.621139] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 08:28:34 juju-e4d256-prod-github-runner-207 kernel: [11088.622041] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 08:28:34 juju-e4d256-prod-github-runner-207 kernel: [11088.622943] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 08:28:34 juju-e4d256-prod-github-runner-207 kernel: [11088.623841] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 08:28:34 juju-e4d256-prod-github-runner-207 kernel: [11088.624759] Aug 22 08:29:02 juju-e4d256-prod-github-runner-207 kernel: [11116.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 10245s! [qemu-system-x86:6715] Aug 22 08:29:02 juju-e4d256-prod-github-runner-207 kernel: [11116.543126] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 08:29:02 juju-e4d256-prod-github-runner-207 kernel: [11116.543198] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 08:29:02 juju-e4d256-prod-github-runner-207 kernel: [11116.555604] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 08:29:02 juju-e4d256-prod-github-runner-207 kernel: [11116.556892] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 08:29:02 juju-e4d256-prod-github-runner-207 kernel: [11116.558123] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:29:02 juju-e4d256-prod-github-runner-207 kernel: [11116.559199] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 08:29:02 juju-e4d256-prod-github-runner-207 kernel: [11116.561795] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 08:29:02 juju-e4d256-prod-github-runner-207 kernel: [11116.562873] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 08:29:02 juju-e4d256-prod-github-runner-207 kernel: [11116.564085] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 08:29:02 juju-e4d256-prod-github-runner-207 kernel: [11116.565280] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 08:29:02 juju-e4d256-prod-github-runner-207 kernel: [11116.566494] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 08:29:02 juju-e4d256-prod-github-runner-207 kernel: [11116.567682] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 08:29:02 juju-e4d256-prod-github-runner-207 kernel: [11116.568901] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 08:29:02 juju-e4d256-prod-github-runner-207 kernel: [11116.570169] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 08:29:02 juju-e4d256-prod-github-runner-207 kernel: [11116.571277] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 08:29:02 juju-e4d256-prod-github-runner-207 kernel: [11116.572484] Call Trace: Aug 22 08:29:02 juju-e4d256-prod-github-runner-207 kernel: [11116.573432] Aug 22 08:29:02 juju-e4d256-prod-github-runner-207 kernel: [11116.574333] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:29:02 juju-e4d256-prod-github-runner-207 kernel: [11116.575399] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:29:02 juju-e4d256-prod-github-runner-207 kernel: [11116.576445] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:29:02 juju-e4d256-prod-github-runner-207 kernel: [11116.577525] ? show_regs.part.0+0x23/0x29 Aug 22 08:29:02 juju-e4d256-prod-github-runner-207 kernel: [11116.578724] ? show_regs.cold+0x8/0xd Aug 22 08:29:02 juju-e4d256-prod-github-runner-207 kernel: [11116.579928] ? watchdog_timer_fn+0x1be/0x220 Aug 22 08:29:02 juju-e4d256-prod-github-runner-207 kernel: [11116.580945] ? lockup_detector_update_enable+0x60/0x60 Aug 22 08:29:02 juju-e4d256-prod-github-runner-207 kernel: [11116.582021] ? __hrtimer_run_queues+0x107/0x230 Aug 22 08:29:02 juju-e4d256-prod-github-runner-207 kernel: [11116.583055] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 08:29:02 juju-e4d256-prod-github-runner-207 kernel: [11116.584115] ? hrtimer_interrupt+0x101/0x220 Aug 22 08:29:02 juju-e4d256-prod-github-runner-207 kernel: [11116.585157] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 08:29:02 juju-e4d256-prod-github-runner-207 kernel: [11116.586239] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 08:29:02 juju-e4d256-prod-github-runner-207 kernel: [11116.587290] Aug 22 08:29:02 juju-e4d256-prod-github-runner-207 kernel: [11116.588199] Aug 22 08:29:02 juju-e4d256-prod-github-runner-207 kernel: [11116.589062] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 08:29:02 juju-e4d256-prod-github-runner-207 kernel: [11116.590127] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:29:02 juju-e4d256-prod-github-runner-207 kernel: [11116.591176] ? _raw_spin_lock+0x22/0x30 Aug 22 08:29:02 juju-e4d256-prod-github-runner-207 kernel: [11116.592151] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:29:02 juju-e4d256-prod-github-runner-207 kernel: [11116.593212] direct_page_fault+0x206/0x310 [kvm] Aug 22 08:29:02 juju-e4d256-prod-github-runner-207 kernel: [11116.594287] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 08:29:02 juju-e4d256-prod-github-runner-207 kernel: [11116.595328] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 08:29:02 juju-e4d256-prod-github-runner-207 kernel: [11116.596375] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 08:29:02 juju-e4d256-prod-github-runner-207 kernel: [11116.597383] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 08:29:02 juju-e4d256-prod-github-runner-207 kernel: [11116.598331] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 08:29:02 juju-e4d256-prod-github-runner-207 kernel: [11116.599310] handle_exit+0x98/0x230 [kvm_amd] Aug 22 08:29:02 juju-e4d256-prod-github-runner-207 kernel: [11116.600273] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 08:29:02 juju-e4d256-prod-github-runner-207 kernel: [11116.601250] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 08:29:02 juju-e4d256-prod-github-runner-207 kernel: [11116.602180] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 08:29:02 juju-e4d256-prod-github-runner-207 kernel: [11116.603084] vcpu_run+0x62/0x2c0 [kvm] Aug 22 08:29:02 juju-e4d256-prod-github-runner-207 kernel: [11116.603923] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 08:29:02 juju-e4d256-prod-github-runner-207 kernel: [11116.604750] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 08:29:02 juju-e4d256-prod-github-runner-207 kernel: [11116.605619] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 08:29:02 juju-e4d256-prod-github-runner-207 kernel: [11116.606439] ? __seccomp_filter+0x4a/0x4a0 Aug 22 08:29:02 juju-e4d256-prod-github-runner-207 kernel: [11116.607188] ? __fget_files+0x86/0xc0 Aug 22 08:29:02 juju-e4d256-prod-github-runner-207 kernel: [11116.607927] __x64_sys_ioctl+0x95/0xd0 Aug 22 08:29:02 juju-e4d256-prod-github-runner-207 kernel: [11116.608639] do_syscall_64+0x5c/0xc0 Aug 22 08:29:02 juju-e4d256-prod-github-runner-207 kernel: [11116.609308] ? do_futex+0x162/0x1f0 Aug 22 08:29:02 juju-e4d256-prod-github-runner-207 kernel: [11116.609976] ? __x64_sys_futex+0x78/0x1e0 Aug 22 08:29:02 juju-e4d256-prod-github-runner-207 kernel: [11116.610670] ? __secure_computing+0xa9/0x120 Aug 22 08:29:02 juju-e4d256-prod-github-runner-207 kernel: [11116.611381] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 08:29:02 juju-e4d256-prod-github-runner-207 kernel: [11116.612163] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:29:02 juju-e4d256-prod-github-runner-207 kernel: [11116.612889] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:29:02 juju-e4d256-prod-github-runner-207 kernel: [11116.613612] ? do_syscall_64+0x69/0xc0 Aug 22 08:29:02 juju-e4d256-prod-github-runner-207 kernel: [11116.614260] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:29:02 juju-e4d256-prod-github-runner-207 kernel: [11116.614966] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:29:02 juju-e4d256-prod-github-runner-207 kernel: [11116.615695] ? do_syscall_64+0x69/0xc0 Aug 22 08:29:02 juju-e4d256-prod-github-runner-207 kernel: [11116.616362] ? do_syscall_64+0x69/0xc0 Aug 22 08:29:02 juju-e4d256-prod-github-runner-207 kernel: [11116.617001] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 08:29:02 juju-e4d256-prod-github-runner-207 kernel: [11116.617708] RIP: 0033:0x7faa5d0edaff Aug 22 08:29:02 juju-e4d256-prod-github-runner-207 kernel: [11116.618336] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 08:29:02 juju-e4d256-prod-github-runner-207 kernel: [11116.620358] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 08:29:02 juju-e4d256-prod-github-runner-207 kernel: [11116.621293] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 08:29:02 juju-e4d256-prod-github-runner-207 kernel: [11116.622198] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 08:29:02 juju-e4d256-prod-github-runner-207 kernel: [11116.623111] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 08:29:02 juju-e4d256-prod-github-runner-207 kernel: [11116.624035] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 08:29:02 juju-e4d256-prod-github-runner-207 kernel: [11116.624928] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 08:29:02 juju-e4d256-prod-github-runner-207 kernel: [11116.625847] Aug 22 08:29:30 juju-e4d256-prod-github-runner-207 kernel: [11144.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 10271s! [qemu-system-x86:6715] Aug 22 08:29:30 juju-e4d256-prod-github-runner-207 kernel: [11144.543216] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 08:29:30 juju-e4d256-prod-github-runner-207 kernel: [11144.543385] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 08:29:30 juju-e4d256-prod-github-runner-207 kernel: [11144.556194] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 08:29:30 juju-e4d256-prod-github-runner-207 kernel: [11144.557576] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 08:29:30 juju-e4d256-prod-github-runner-207 kernel: [11144.558871] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:29:30 juju-e4d256-prod-github-runner-207 kernel: [11144.560004] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 08:29:30 juju-e4d256-prod-github-runner-207 kernel: [11144.562701] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 08:29:30 juju-e4d256-prod-github-runner-207 kernel: [11144.563856] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 08:29:30 juju-e4d256-prod-github-runner-207 kernel: [11144.565099] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 08:29:30 juju-e4d256-prod-github-runner-207 kernel: [11144.566310] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 08:29:30 juju-e4d256-prod-github-runner-207 kernel: [11144.567516] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 08:29:30 juju-e4d256-prod-github-runner-207 kernel: [11144.568733] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 08:29:30 juju-e4d256-prod-github-runner-207 kernel: [11144.569953] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 08:29:30 juju-e4d256-prod-github-runner-207 kernel: [11144.571243] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 08:29:30 juju-e4d256-prod-github-runner-207 kernel: [11144.572387] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 08:29:30 juju-e4d256-prod-github-runner-207 kernel: [11144.573634] Call Trace: Aug 22 08:29:30 juju-e4d256-prod-github-runner-207 kernel: [11144.574594] Aug 22 08:29:30 juju-e4d256-prod-github-runner-207 kernel: [11144.575531] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:29:30 juju-e4d256-prod-github-runner-207 kernel: [11144.576618] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:29:30 juju-e4d256-prod-github-runner-207 kernel: [11144.577685] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:29:30 juju-e4d256-prod-github-runner-207 kernel: [11144.578889] ? show_regs.part.0+0x23/0x29 Aug 22 08:29:30 juju-e4d256-prod-github-runner-207 kernel: [11144.579943] ? show_regs.cold+0x8/0xd Aug 22 08:29:30 juju-e4d256-prod-github-runner-207 kernel: [11144.580963] ? watchdog_timer_fn+0x1be/0x220 Aug 22 08:29:30 juju-e4d256-prod-github-runner-207 kernel: [11144.582007] ? lockup_detector_update_enable+0x60/0x60 Aug 22 08:29:30 juju-e4d256-prod-github-runner-207 kernel: [11144.583112] ? __hrtimer_run_queues+0x107/0x230 Aug 22 08:29:30 juju-e4d256-prod-github-runner-207 kernel: [11144.584187] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 08:29:30 juju-e4d256-prod-github-runner-207 kernel: [11144.585241] ? hrtimer_interrupt+0x101/0x220 Aug 22 08:29:30 juju-e4d256-prod-github-runner-207 kernel: [11144.586286] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 08:29:30 juju-e4d256-prod-github-runner-207 kernel: [11144.587393] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 08:29:30 juju-e4d256-prod-github-runner-207 kernel: [11144.588507] Aug 22 08:29:30 juju-e4d256-prod-github-runner-207 kernel: [11144.589375] Aug 22 08:29:30 juju-e4d256-prod-github-runner-207 kernel: [11144.590238] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 08:29:30 juju-e4d256-prod-github-runner-207 kernel: [11144.591319] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:29:30 juju-e4d256-prod-github-runner-207 kernel: [11144.592419] ? _raw_spin_lock+0x22/0x30 Aug 22 08:29:30 juju-e4d256-prod-github-runner-207 kernel: [11144.593399] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:29:30 juju-e4d256-prod-github-runner-207 kernel: [11144.594450] direct_page_fault+0x206/0x310 [kvm] Aug 22 08:29:30 juju-e4d256-prod-github-runner-207 kernel: [11144.595516] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 08:29:30 juju-e4d256-prod-github-runner-207 kernel: [11144.596557] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 08:29:30 juju-e4d256-prod-github-runner-207 kernel: [11144.597591] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 08:29:30 juju-e4d256-prod-github-runner-207 kernel: [11144.598625] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 08:29:30 juju-e4d256-prod-github-runner-207 kernel: [11144.599642] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 08:29:30 juju-e4d256-prod-github-runner-207 kernel: [11144.600668] handle_exit+0x98/0x230 [kvm_amd] Aug 22 08:29:30 juju-e4d256-prod-github-runner-207 kernel: [11144.601601] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 08:29:30 juju-e4d256-prod-github-runner-207 kernel: [11144.602551] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 08:29:30 juju-e4d256-prod-github-runner-207 kernel: [11144.603524] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 08:29:30 juju-e4d256-prod-github-runner-207 kernel: [11144.604498] vcpu_run+0x62/0x2c0 [kvm] Aug 22 08:29:30 juju-e4d256-prod-github-runner-207 kernel: [11144.605346] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 08:29:30 juju-e4d256-prod-github-runner-207 kernel: [11144.606199] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 08:29:30 juju-e4d256-prod-github-runner-207 kernel: [11144.607091] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 08:29:30 juju-e4d256-prod-github-runner-207 kernel: [11144.607908] ? __seccomp_filter+0x4a/0x4a0 Aug 22 08:29:30 juju-e4d256-prod-github-runner-207 kernel: [11144.608684] ? __fget_files+0x86/0xc0 Aug 22 08:29:30 juju-e4d256-prod-github-runner-207 kernel: [11144.609414] __x64_sys_ioctl+0x95/0xd0 Aug 22 08:29:30 juju-e4d256-prod-github-runner-207 kernel: [11144.610136] do_syscall_64+0x5c/0xc0 Aug 22 08:29:30 juju-e4d256-prod-github-runner-207 kernel: [11144.610824] ? do_futex+0x162/0x1f0 Aug 22 08:29:30 juju-e4d256-prod-github-runner-207 kernel: [11144.611506] ? __x64_sys_futex+0x78/0x1e0 Aug 22 08:29:30 juju-e4d256-prod-github-runner-207 kernel: [11144.612208] ? __secure_computing+0xa9/0x120 Aug 22 08:29:30 juju-e4d256-prod-github-runner-207 kernel: [11144.612931] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 08:29:30 juju-e4d256-prod-github-runner-207 kernel: [11144.613727] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:29:30 juju-e4d256-prod-github-runner-207 kernel: [11144.614483] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:29:30 juju-e4d256-prod-github-runner-207 kernel: [11144.615243] ? do_syscall_64+0x69/0xc0 Aug 22 08:29:30 juju-e4d256-prod-github-runner-207 kernel: [11144.615930] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:29:30 juju-e4d256-prod-github-runner-207 kernel: [11144.616687] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:29:30 juju-e4d256-prod-github-runner-207 kernel: [11144.617420] ? do_syscall_64+0x69/0xc0 Aug 22 08:29:30 juju-e4d256-prod-github-runner-207 kernel: [11144.618084] ? do_syscall_64+0x69/0xc0 Aug 22 08:29:30 juju-e4d256-prod-github-runner-207 kernel: [11144.618736] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 08:29:30 juju-e4d256-prod-github-runner-207 kernel: [11144.619491] RIP: 0033:0x7faa5d0edaff Aug 22 08:29:30 juju-e4d256-prod-github-runner-207 kernel: [11144.620151] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 08:29:30 juju-e4d256-prod-github-runner-207 kernel: [11144.622272] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 08:29:30 juju-e4d256-prod-github-runner-207 kernel: [11144.623240] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 08:29:30 juju-e4d256-prod-github-runner-207 kernel: [11144.624182] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 08:29:30 juju-e4d256-prod-github-runner-207 kernel: [11144.625283] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 08:29:30 juju-e4d256-prod-github-runner-207 kernel: [11144.626395] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 08:29:30 juju-e4d256-prod-github-runner-207 kernel: [11144.627325] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 08:29:30 juju-e4d256-prod-github-runner-207 kernel: [11144.628275] Aug 22 08:29:44 juju-e4d256-prod-github-runner-207 kernel: [11157.932709] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 08:29:44 juju-e4d256-prod-github-runner-207 kernel: [11157.934515] rcu: 1-....: (2751525 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=1330208 Aug 22 08:29:44 juju-e4d256-prod-github-runner-207 kernel: [11157.935705] (t=2760183 jiffies g=23269 q=19533) Aug 22 08:29:44 juju-e4d256-prod-github-runner-207 kernel: [11157.936530] NMI backtrace for cpu 1 Aug 22 08:29:44 juju-e4d256-prod-github-runner-207 kernel: [11157.937315] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 08:29:44 juju-e4d256-prod-github-runner-207 kernel: [11157.938476] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 08:29:44 juju-e4d256-prod-github-runner-207 kernel: [11157.939567] Call Trace: Aug 22 08:29:44 juju-e4d256-prod-github-runner-207 kernel: [11157.940252] Aug 22 08:29:44 juju-e4d256-prod-github-runner-207 kernel: [11157.941001] show_stack+0x52/0x5c Aug 22 08:29:44 juju-e4d256-prod-github-runner-207 kernel: [11157.941768] dump_stack_lvl+0x4a/0x63 Aug 22 08:29:44 juju-e4d256-prod-github-runner-207 kernel: [11157.942560] dump_stack+0x10/0x16 Aug 22 08:29:44 juju-e4d256-prod-github-runner-207 kernel: [11157.943345] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 08:29:44 juju-e4d256-prod-github-runner-207 kernel: [11157.944138] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 08:29:44 juju-e4d256-prod-github-runner-207 kernel: [11157.944940] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 08:29:44 juju-e4d256-prod-github-runner-207 kernel: [11157.945799] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 08:29:44 juju-e4d256-prod-github-runner-207 kernel: [11157.946657] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 08:29:44 juju-e4d256-prod-github-runner-207 kernel: [11157.947513] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 08:29:44 juju-e4d256-prod-github-runner-207 kernel: [11157.948368] print_cpu_stall.cold+0x2f/0xe2 Aug 22 08:29:44 juju-e4d256-prod-github-runner-207 kernel: [11157.949150] ? timekeeping_update+0xf7/0x150 Aug 22 08:29:44 juju-e4d256-prod-github-runner-207 kernel: [11157.949949] check_cpu_stall+0x109/0x270 Aug 22 08:29:44 juju-e4d256-prod-github-runner-207 kernel: [11157.950703] rcu_sched_clock_irq+0x9a/0x250 Aug 22 08:29:44 juju-e4d256-prod-github-runner-207 kernel: [11157.951529] update_process_times+0x94/0xd0 Aug 22 08:29:44 juju-e4d256-prod-github-runner-207 kernel: [11157.952372] tick_sched_handle+0x29/0x70 Aug 22 08:29:44 juju-e4d256-prod-github-runner-207 kernel: [11157.953139] tick_sched_timer+0x8c/0xc0 Aug 22 08:29:44 juju-e4d256-prod-github-runner-207 kernel: [11157.953905] ? tick_nohz_handler+0xb0/0xb0 Aug 22 08:29:44 juju-e4d256-prod-github-runner-207 kernel: [11157.954665] __hrtimer_run_queues+0x107/0x230 Aug 22 08:29:44 juju-e4d256-prod-github-runner-207 kernel: [11157.955460] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 08:29:44 juju-e4d256-prod-github-runner-207 kernel: [11157.956242] hrtimer_interrupt+0x101/0x220 Aug 22 08:29:44 juju-e4d256-prod-github-runner-207 kernel: [11157.957001] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 08:29:44 juju-e4d256-prod-github-runner-207 kernel: [11157.957819] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 08:29:44 juju-e4d256-prod-github-runner-207 kernel: [11157.958715] Aug 22 08:29:44 juju-e4d256-prod-github-runner-207 kernel: [11157.959371] Aug 22 08:29:44 juju-e4d256-prod-github-runner-207 kernel: [11157.959999] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 08:29:44 juju-e4d256-prod-github-runner-207 kernel: [11157.960814] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:29:44 juju-e4d256-prod-github-runner-207 kernel: [11157.961689] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 08:29:44 juju-e4d256-prod-github-runner-207 kernel: [11157.964012] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 08:29:44 juju-e4d256-prod-github-runner-207 kernel: [11157.964993] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 08:29:44 juju-e4d256-prod-github-runner-207 kernel: [11157.965983] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 08:29:44 juju-e4d256-prod-github-runner-207 kernel: [11157.966954] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 08:29:44 juju-e4d256-prod-github-runner-207 kernel: [11157.967938] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 08:29:44 juju-e4d256-prod-github-runner-207 kernel: [11157.968890] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 08:29:44 juju-e4d256-prod-github-runner-207 kernel: [11157.969839] ? _raw_spin_lock+0x22/0x30 Aug 22 08:29:44 juju-e4d256-prod-github-runner-207 kernel: [11157.970595] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:29:44 juju-e4d256-prod-github-runner-207 kernel: [11157.971441] direct_page_fault+0x206/0x310 [kvm] Aug 22 08:29:44 juju-e4d256-prod-github-runner-207 kernel: [11157.972277] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 08:29:44 juju-e4d256-prod-github-runner-207 kernel: [11157.973113] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 08:29:44 juju-e4d256-prod-github-runner-207 kernel: [11157.973956] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 08:29:44 juju-e4d256-prod-github-runner-207 kernel: [11157.974773] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 08:29:44 juju-e4d256-prod-github-runner-207 kernel: [11157.975573] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 08:29:44 juju-e4d256-prod-github-runner-207 kernel: [11157.976393] handle_exit+0x98/0x230 [kvm_amd] Aug 22 08:29:44 juju-e4d256-prod-github-runner-207 kernel: [11157.977152] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 08:29:44 juju-e4d256-prod-github-runner-207 kernel: [11157.977945] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 08:29:44 juju-e4d256-prod-github-runner-207 kernel: [11157.978742] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 08:29:44 juju-e4d256-prod-github-runner-207 kernel: [11157.979539] vcpu_run+0x62/0x2c0 [kvm] Aug 22 08:29:44 juju-e4d256-prod-github-runner-207 kernel: [11157.980311] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 08:29:44 juju-e4d256-prod-github-runner-207 kernel: [11157.981045] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 08:29:44 juju-e4d256-prod-github-runner-207 kernel: [11157.981844] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 08:29:44 juju-e4d256-prod-github-runner-207 kernel: [11157.982602] ? __seccomp_filter+0x4a/0x4a0 Aug 22 08:29:44 juju-e4d256-prod-github-runner-207 kernel: [11157.983336] ? __fget_files+0x86/0xc0 Aug 22 08:29:44 juju-e4d256-prod-github-runner-207 kernel: [11157.984031] __x64_sys_ioctl+0x95/0xd0 Aug 22 08:29:44 juju-e4d256-prod-github-runner-207 kernel: [11157.984723] do_syscall_64+0x5c/0xc0 Aug 22 08:29:44 juju-e4d256-prod-github-runner-207 kernel: [11157.985403] ? do_futex+0x162/0x1f0 Aug 22 08:29:44 juju-e4d256-prod-github-runner-207 kernel: [11157.986073] ? __x64_sys_futex+0x78/0x1e0 Aug 22 08:29:44 juju-e4d256-prod-github-runner-207 kernel: [11157.986771] ? __secure_computing+0xa9/0x120 Aug 22 08:29:44 juju-e4d256-prod-github-runner-207 kernel: [11157.987505] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 08:29:44 juju-e4d256-prod-github-runner-207 kernel: [11157.988305] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:29:44 juju-e4d256-prod-github-runner-207 kernel: [11157.989056] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:29:44 juju-e4d256-prod-github-runner-207 kernel: [11157.989806] ? do_syscall_64+0x69/0xc0 Aug 22 08:29:44 juju-e4d256-prod-github-runner-207 kernel: [11157.990494] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:29:44 juju-e4d256-prod-github-runner-207 kernel: [11157.991268] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:29:44 juju-e4d256-prod-github-runner-207 kernel: [11157.992049] ? do_syscall_64+0x69/0xc0 Aug 22 08:29:44 juju-e4d256-prod-github-runner-207 kernel: [11157.992741] ? do_syscall_64+0x69/0xc0 Aug 22 08:29:44 juju-e4d256-prod-github-runner-207 kernel: [11157.993434] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 08:29:44 juju-e4d256-prod-github-runner-207 kernel: [11157.994376] RIP: 0033:0x7faa5d0edaff Aug 22 08:29:44 juju-e4d256-prod-github-runner-207 kernel: [11157.995106] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 08:29:44 juju-e4d256-prod-github-runner-207 kernel: [11157.997254] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 08:29:44 juju-e4d256-prod-github-runner-207 kernel: [11157.998288] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 08:29:44 juju-e4d256-prod-github-runner-207 kernel: [11157.999246] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 08:29:44 juju-e4d256-prod-github-runner-207 kernel: [11158.000216] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 08:29:44 juju-e4d256-prod-github-runner-207 kernel: [11158.001150] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 08:29:44 juju-e4d256-prod-github-runner-207 kernel: [11158.002072] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 08:29:44 juju-e4d256-prod-github-runner-207 kernel: [11158.002985] Aug 22 08:30:10 juju-e4d256-prod-github-runner-207 kernel: [11184.541976] watchdog: BUG: soft lockup - CPU#1 stuck for 10308s! [qemu-system-x86:6715] Aug 22 08:30:10 juju-e4d256-prod-github-runner-207 kernel: [11184.543124] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 08:30:10 juju-e4d256-prod-github-runner-207 kernel: [11184.543439] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 08:30:10 juju-e4d256-prod-github-runner-207 kernel: [11184.555601] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 08:30:10 juju-e4d256-prod-github-runner-207 kernel: [11184.556863] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 08:30:10 juju-e4d256-prod-github-runner-207 kernel: [11184.558078] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:30:10 juju-e4d256-prod-github-runner-207 kernel: [11184.559145] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 08:30:10 juju-e4d256-prod-github-runner-207 kernel: [11184.561889] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 08:30:10 juju-e4d256-prod-github-runner-207 kernel: [11184.563077] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 08:30:10 juju-e4d256-prod-github-runner-207 kernel: [11184.564265] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 08:30:10 juju-e4d256-prod-github-runner-207 kernel: [11184.565429] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 08:30:10 juju-e4d256-prod-github-runner-207 kernel: [11184.566615] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 08:30:10 juju-e4d256-prod-github-runner-207 kernel: [11184.567797] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 08:30:10 juju-e4d256-prod-github-runner-207 kernel: [11184.568960] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 08:30:10 juju-e4d256-prod-github-runner-207 kernel: [11184.570197] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 08:30:10 juju-e4d256-prod-github-runner-207 kernel: [11184.571318] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 08:30:10 juju-e4d256-prod-github-runner-207 kernel: [11184.572517] Call Trace: Aug 22 08:30:10 juju-e4d256-prod-github-runner-207 kernel: [11184.573431] Aug 22 08:30:10 juju-e4d256-prod-github-runner-207 kernel: [11184.574317] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:30:10 juju-e4d256-prod-github-runner-207 kernel: [11184.575429] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:30:10 juju-e4d256-prod-github-runner-207 kernel: [11184.576527] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:30:10 juju-e4d256-prod-github-runner-207 kernel: [11184.577606] ? show_regs.part.0+0x23/0x29 Aug 22 08:30:10 juju-e4d256-prod-github-runner-207 kernel: [11184.578612] ? show_regs.cold+0x8/0xd Aug 22 08:30:10 juju-e4d256-prod-github-runner-207 kernel: [11184.579601] ? watchdog_timer_fn+0x1be/0x220 Aug 22 08:30:10 juju-e4d256-prod-github-runner-207 kernel: [11184.580626] ? lockup_detector_update_enable+0x60/0x60 Aug 22 08:30:10 juju-e4d256-prod-github-runner-207 kernel: [11184.581693] ? __hrtimer_run_queues+0x107/0x230 Aug 22 08:30:10 juju-e4d256-prod-github-runner-207 kernel: [11184.582723] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 08:30:10 juju-e4d256-prod-github-runner-207 kernel: [11184.583760] ? hrtimer_interrupt+0x101/0x220 Aug 22 08:30:10 juju-e4d256-prod-github-runner-207 kernel: [11184.584786] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 08:30:10 juju-e4d256-prod-github-runner-207 kernel: [11184.585852] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 08:30:10 juju-e4d256-prod-github-runner-207 kernel: [11184.586896] Aug 22 08:30:10 juju-e4d256-prod-github-runner-207 kernel: [11184.587813] Aug 22 08:30:10 juju-e4d256-prod-github-runner-207 kernel: [11184.588724] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 08:30:10 juju-e4d256-prod-github-runner-207 kernel: [11184.589783] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:30:10 juju-e4d256-prod-github-runner-207 kernel: [11184.590847] ? _raw_spin_lock+0x22/0x30 Aug 22 08:30:10 juju-e4d256-prod-github-runner-207 kernel: [11184.591823] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:30:10 juju-e4d256-prod-github-runner-207 kernel: [11184.593371] direct_page_fault+0x206/0x310 [kvm] Aug 22 08:30:10 juju-e4d256-prod-github-runner-207 kernel: [11184.596235] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 08:30:10 juju-e4d256-prod-github-runner-207 kernel: [11184.597272] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 08:30:10 juju-e4d256-prod-github-runner-207 kernel: [11184.599351] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 08:30:10 juju-e4d256-prod-github-runner-207 kernel: [11184.605801] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 08:30:10 juju-e4d256-prod-github-runner-207 kernel: [11184.609047] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 08:30:10 juju-e4d256-prod-github-runner-207 kernel: [11184.612202] handle_exit+0x98/0x230 [kvm_amd] Aug 22 08:30:10 juju-e4d256-prod-github-runner-207 kernel: [11184.616890] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 08:30:10 juju-e4d256-prod-github-runner-207 kernel: [11184.621267] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 08:30:10 juju-e4d256-prod-github-runner-207 kernel: [11184.628374] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 08:30:10 juju-e4d256-prod-github-runner-207 kernel: [11184.631618] vcpu_run+0x62/0x2c0 [kvm] Aug 22 08:30:10 juju-e4d256-prod-github-runner-207 kernel: [11184.634722] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 08:30:10 juju-e4d256-prod-github-runner-207 kernel: [11184.635590] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 08:30:10 juju-e4d256-prod-github-runner-207 kernel: [11184.645084] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 08:30:10 juju-e4d256-prod-github-runner-207 kernel: [11184.650249] ? __seccomp_filter+0x4a/0x4a0 Aug 22 08:30:10 juju-e4d256-prod-github-runner-207 kernel: [11184.653221] ? __fget_files+0x86/0xc0 Aug 22 08:30:10 juju-e4d256-prod-github-runner-207 kernel: [11184.653941] __x64_sys_ioctl+0x95/0xd0 Aug 22 08:30:10 juju-e4d256-prod-github-runner-207 kernel: [11184.654678] do_syscall_64+0x5c/0xc0 Aug 22 08:30:10 juju-e4d256-prod-github-runner-207 kernel: [11184.655389] ? do_futex+0x162/0x1f0 Aug 22 08:30:10 juju-e4d256-prod-github-runner-207 kernel: [11184.656074] ? __x64_sys_futex+0x78/0x1e0 Aug 22 08:30:10 juju-e4d256-prod-github-runner-207 kernel: [11184.656753] ? __secure_computing+0xa9/0x120 Aug 22 08:30:10 juju-e4d256-prod-github-runner-207 kernel: [11184.657454] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 08:30:10 juju-e4d256-prod-github-runner-207 kernel: [11184.658246] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:30:10 juju-e4d256-prod-github-runner-207 kernel: [11184.658996] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:30:10 juju-e4d256-prod-github-runner-207 kernel: [11184.659726] ? do_syscall_64+0x69/0xc0 Aug 22 08:30:10 juju-e4d256-prod-github-runner-207 kernel: [11184.660426] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:30:10 juju-e4d256-prod-github-runner-207 kernel: [11184.661153] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:30:10 juju-e4d256-prod-github-runner-207 kernel: [11184.661855] ? do_syscall_64+0x69/0xc0 Aug 22 08:30:10 juju-e4d256-prod-github-runner-207 kernel: [11184.662684] ? do_syscall_64+0x69/0xc0 Aug 22 08:30:10 juju-e4d256-prod-github-runner-207 kernel: [11184.663335] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 08:30:10 juju-e4d256-prod-github-runner-207 kernel: [11184.664051] RIP: 0033:0x7faa5d0edaff Aug 22 08:30:10 juju-e4d256-prod-github-runner-207 kernel: [11184.664692] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 08:30:10 juju-e4d256-prod-github-runner-207 kernel: [11184.666710] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 08:30:10 juju-e4d256-prod-github-runner-207 kernel: [11184.667638] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 08:30:10 juju-e4d256-prod-github-runner-207 kernel: [11184.668528] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 08:30:10 juju-e4d256-prod-github-runner-207 kernel: [11184.669449] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 08:30:10 juju-e4d256-prod-github-runner-207 kernel: [11184.670344] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 08:30:10 juju-e4d256-prod-github-runner-207 kernel: [11184.671571] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 08:30:10 juju-e4d256-prod-github-runner-207 kernel: [11184.672469] Aug 22 08:30:38 juju-e4d256-prod-github-runner-207 kernel: [11212.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 10334s! [qemu-system-x86:6715] Aug 22 08:30:38 juju-e4d256-prod-github-runner-207 kernel: [11212.543105] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 08:30:38 juju-e4d256-prod-github-runner-207 kernel: [11212.543177] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 08:30:38 juju-e4d256-prod-github-runner-207 kernel: [11212.555325] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 08:30:38 juju-e4d256-prod-github-runner-207 kernel: [11212.556594] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 08:30:38 juju-e4d256-prod-github-runner-207 kernel: [11212.557813] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:30:38 juju-e4d256-prod-github-runner-207 kernel: [11212.558887] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 08:30:38 juju-e4d256-prod-github-runner-207 kernel: [11212.561453] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 08:30:38 juju-e4d256-prod-github-runner-207 kernel: [11212.562493] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 08:30:38 juju-e4d256-prod-github-runner-207 kernel: [11212.563668] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 08:30:38 juju-e4d256-prod-github-runner-207 kernel: [11212.564831] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 08:30:38 juju-e4d256-prod-github-runner-207 kernel: [11212.566002] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 08:30:38 juju-e4d256-prod-github-runner-207 kernel: [11212.567176] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 08:30:38 juju-e4d256-prod-github-runner-207 kernel: [11212.568345] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 08:30:38 juju-e4d256-prod-github-runner-207 kernel: [11212.569597] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 08:30:38 juju-e4d256-prod-github-runner-207 kernel: [11212.570721] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 08:30:38 juju-e4d256-prod-github-runner-207 kernel: [11212.572103] Call Trace: Aug 22 08:30:38 juju-e4d256-prod-github-runner-207 kernel: [11212.573013] Aug 22 08:30:38 juju-e4d256-prod-github-runner-207 kernel: [11212.573895] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:30:38 juju-e4d256-prod-github-runner-207 kernel: [11212.574972] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:30:38 juju-e4d256-prod-github-runner-207 kernel: [11212.575996] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:30:38 juju-e4d256-prod-github-runner-207 kernel: [11212.577069] ? show_regs.part.0+0x23/0x29 Aug 22 08:30:38 juju-e4d256-prod-github-runner-207 kernel: [11212.578063] ? show_regs.cold+0x8/0xd Aug 22 08:30:38 juju-e4d256-prod-github-runner-207 kernel: [11212.579050] ? watchdog_timer_fn+0x1be/0x220 Aug 22 08:30:38 juju-e4d256-prod-github-runner-207 kernel: [11212.580134] ? lockup_detector_update_enable+0x60/0x60 Aug 22 08:30:38 juju-e4d256-prod-github-runner-207 kernel: [11212.581204] ? __hrtimer_run_queues+0x107/0x230 Aug 22 08:30:38 juju-e4d256-prod-github-runner-207 kernel: [11212.582418] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 08:30:38 juju-e4d256-prod-github-runner-207 kernel: [11212.583463] ? hrtimer_interrupt+0x101/0x220 Aug 22 08:30:38 juju-e4d256-prod-github-runner-207 kernel: [11212.584481] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 08:30:38 juju-e4d256-prod-github-runner-207 kernel: [11212.585547] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 08:30:38 juju-e4d256-prod-github-runner-207 kernel: [11212.586591] Aug 22 08:30:38 juju-e4d256-prod-github-runner-207 kernel: [11212.587482] Aug 22 08:30:38 juju-e4d256-prod-github-runner-207 kernel: [11212.588346] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 08:30:38 juju-e4d256-prod-github-runner-207 kernel: [11212.589385] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:30:38 juju-e4d256-prod-github-runner-207 kernel: [11212.590653] ? _raw_spin_lock+0x22/0x30 Aug 22 08:30:38 juju-e4d256-prod-github-runner-207 kernel: [11212.591599] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:30:38 juju-e4d256-prod-github-runner-207 kernel: [11212.592615] direct_page_fault+0x206/0x310 [kvm] Aug 22 08:30:38 juju-e4d256-prod-github-runner-207 kernel: [11212.593644] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 08:30:38 juju-e4d256-prod-github-runner-207 kernel: [11212.594671] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 08:30:38 juju-e4d256-prod-github-runner-207 kernel: [11212.595716] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 08:30:38 juju-e4d256-prod-github-runner-207 kernel: [11212.596688] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 08:30:38 juju-e4d256-prod-github-runner-207 kernel: [11212.597655] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 08:30:38 juju-e4d256-prod-github-runner-207 kernel: [11212.598649] handle_exit+0x98/0x230 [kvm_amd] Aug 22 08:30:38 juju-e4d256-prod-github-runner-207 kernel: [11212.599542] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 08:30:38 juju-e4d256-prod-github-runner-207 kernel: [11212.600483] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 08:30:38 juju-e4d256-prod-github-runner-207 kernel: [11212.601421] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 08:30:38 juju-e4d256-prod-github-runner-207 kernel: [11212.602326] vcpu_run+0x62/0x2c0 [kvm] Aug 22 08:30:38 juju-e4d256-prod-github-runner-207 kernel: [11212.603150] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 08:30:38 juju-e4d256-prod-github-runner-207 kernel: [11212.603961] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 08:30:38 juju-e4d256-prod-github-runner-207 kernel: [11212.604845] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 08:30:38 juju-e4d256-prod-github-runner-207 kernel: [11212.605645] ? __seccomp_filter+0x4a/0x4a0 Aug 22 08:30:38 juju-e4d256-prod-github-runner-207 kernel: [11212.606388] ? __fget_files+0x86/0xc0 Aug 22 08:30:38 juju-e4d256-prod-github-runner-207 kernel: [11212.607106] __x64_sys_ioctl+0x95/0xd0 Aug 22 08:30:38 juju-e4d256-prod-github-runner-207 kernel: [11212.607799] do_syscall_64+0x5c/0xc0 Aug 22 08:30:38 juju-e4d256-prod-github-runner-207 kernel: [11212.608464] ? do_futex+0x162/0x1f0 Aug 22 08:30:38 juju-e4d256-prod-github-runner-207 kernel: [11212.609113] ? __x64_sys_futex+0x78/0x1e0 Aug 22 08:30:38 juju-e4d256-prod-github-runner-207 kernel: [11212.609787] ? __secure_computing+0xa9/0x120 Aug 22 08:30:38 juju-e4d256-prod-github-runner-207 kernel: [11212.610550] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 08:30:38 juju-e4d256-prod-github-runner-207 kernel: [11212.611332] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:30:38 juju-e4d256-prod-github-runner-207 kernel: [11212.612143] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:30:38 juju-e4d256-prod-github-runner-207 kernel: [11212.612862] ? do_syscall_64+0x69/0xc0 Aug 22 08:30:38 juju-e4d256-prod-github-runner-207 kernel: [11212.613505] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:30:38 juju-e4d256-prod-github-runner-207 kernel: [11212.614233] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:30:38 juju-e4d256-prod-github-runner-207 kernel: [11212.614940] ? do_syscall_64+0x69/0xc0 Aug 22 08:30:38 juju-e4d256-prod-github-runner-207 kernel: [11212.615565] ? do_syscall_64+0x69/0xc0 Aug 22 08:30:38 juju-e4d256-prod-github-runner-207 kernel: [11212.616186] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 08:30:38 juju-e4d256-prod-github-runner-207 kernel: [11212.616949] RIP: 0033:0x7faa5d0edaff Aug 22 08:30:38 juju-e4d256-prod-github-runner-207 kernel: [11212.617600] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 08:30:38 juju-e4d256-prod-github-runner-207 kernel: [11212.619805] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 08:30:38 juju-e4d256-prod-github-runner-207 kernel: [11212.620736] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 08:30:38 juju-e4d256-prod-github-runner-207 kernel: [11212.621656] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 08:30:38 juju-e4d256-prod-github-runner-207 kernel: [11212.622562] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 08:30:38 juju-e4d256-prod-github-runner-207 kernel: [11212.623497] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 08:30:38 juju-e4d256-prod-github-runner-207 kernel: [11212.624404] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 08:30:38 juju-e4d256-prod-github-runner-207 kernel: [11212.625317] Aug 22 08:31:06 juju-e4d256-prod-github-runner-207 kernel: [11240.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 10360s! [qemu-system-x86:6715] Aug 22 08:31:06 juju-e4d256-prod-github-runner-207 kernel: [11240.543299] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 08:31:06 juju-e4d256-prod-github-runner-207 kernel: [11240.543518] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 08:31:06 juju-e4d256-prod-github-runner-207 kernel: [11240.556468] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 08:31:06 juju-e4d256-prod-github-runner-207 kernel: [11240.557741] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 08:31:06 juju-e4d256-prod-github-runner-207 kernel: [11240.558975] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:31:06 juju-e4d256-prod-github-runner-207 kernel: [11240.560036] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 08:31:06 juju-e4d256-prod-github-runner-207 kernel: [11240.562609] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 08:31:06 juju-e4d256-prod-github-runner-207 kernel: [11240.563652] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 08:31:06 juju-e4d256-prod-github-runner-207 kernel: [11240.564813] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 08:31:06 juju-e4d256-prod-github-runner-207 kernel: [11240.565976] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 08:31:06 juju-e4d256-prod-github-runner-207 kernel: [11240.567145] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 08:31:06 juju-e4d256-prod-github-runner-207 kernel: [11240.568306] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 08:31:06 juju-e4d256-prod-github-runner-207 kernel: [11240.569479] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 08:31:06 juju-e4d256-prod-github-runner-207 kernel: [11240.570739] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 08:31:06 juju-e4d256-prod-github-runner-207 kernel: [11240.571841] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 08:31:06 juju-e4d256-prod-github-runner-207 kernel: [11240.573035] Call Trace: Aug 22 08:31:06 juju-e4d256-prod-github-runner-207 kernel: [11240.573948] Aug 22 08:31:06 juju-e4d256-prod-github-runner-207 kernel: [11240.574845] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:31:06 juju-e4d256-prod-github-runner-207 kernel: [11240.575874] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:31:06 juju-e4d256-prod-github-runner-207 kernel: [11240.576902] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:31:06 juju-e4d256-prod-github-runner-207 kernel: [11240.578005] ? show_regs.part.0+0x23/0x29 Aug 22 08:31:06 juju-e4d256-prod-github-runner-207 kernel: [11240.579013] ? show_regs.cold+0x8/0xd Aug 22 08:31:06 juju-e4d256-prod-github-runner-207 kernel: [11240.580000] ? watchdog_timer_fn+0x1be/0x220 Aug 22 08:31:06 juju-e4d256-prod-github-runner-207 kernel: [11240.581039] ? lockup_detector_update_enable+0x60/0x60 Aug 22 08:31:06 juju-e4d256-prod-github-runner-207 kernel: [11240.582106] ? __hrtimer_run_queues+0x107/0x230 Aug 22 08:31:06 juju-e4d256-prod-github-runner-207 kernel: [11240.583158] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 08:31:06 juju-e4d256-prod-github-runner-207 kernel: [11240.584189] ? hrtimer_interrupt+0x101/0x220 Aug 22 08:31:06 juju-e4d256-prod-github-runner-207 kernel: [11240.585212] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 08:31:06 juju-e4d256-prod-github-runner-207 kernel: [11240.586302] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 08:31:06 juju-e4d256-prod-github-runner-207 kernel: [11240.587374] Aug 22 08:31:06 juju-e4d256-prod-github-runner-207 kernel: [11240.588227] Aug 22 08:31:06 juju-e4d256-prod-github-runner-207 kernel: [11240.589062] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 08:31:06 juju-e4d256-prod-github-runner-207 kernel: [11240.590093] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:31:06 juju-e4d256-prod-github-runner-207 kernel: [11240.591138] ? _raw_spin_lock+0x22/0x30 Aug 22 08:31:06 juju-e4d256-prod-github-runner-207 kernel: [11240.592082] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:31:06 juju-e4d256-prod-github-runner-207 kernel: [11240.593102] direct_page_fault+0x206/0x310 [kvm] Aug 22 08:31:06 juju-e4d256-prod-github-runner-207 kernel: [11240.594124] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 08:31:06 juju-e4d256-prod-github-runner-207 kernel: [11240.595150] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 08:31:06 juju-e4d256-prod-github-runner-207 kernel: [11240.596163] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 08:31:06 juju-e4d256-prod-github-runner-207 kernel: [11240.597152] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 08:31:06 juju-e4d256-prod-github-runner-207 kernel: [11240.598094] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 08:31:06 juju-e4d256-prod-github-runner-207 kernel: [11240.599140] handle_exit+0x98/0x230 [kvm_amd] Aug 22 08:31:06 juju-e4d256-prod-github-runner-207 kernel: [11240.600061] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 08:31:06 juju-e4d256-prod-github-runner-207 kernel: [11240.600983] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 08:31:06 juju-e4d256-prod-github-runner-207 kernel: [11240.601916] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 08:31:06 juju-e4d256-prod-github-runner-207 kernel: [11240.602832] vcpu_run+0x62/0x2c0 [kvm] Aug 22 08:31:06 juju-e4d256-prod-github-runner-207 kernel: [11240.603643] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 08:31:06 juju-e4d256-prod-github-runner-207 kernel: [11240.604450] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 08:31:06 juju-e4d256-prod-github-runner-207 kernel: [11240.605310] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 08:31:06 juju-e4d256-prod-github-runner-207 kernel: [11240.606113] ? __seccomp_filter+0x4a/0x4a0 Aug 22 08:31:06 juju-e4d256-prod-github-runner-207 kernel: [11240.606869] ? __fget_files+0x86/0xc0 Aug 22 08:31:06 juju-e4d256-prod-github-runner-207 kernel: [11240.607573] __x64_sys_ioctl+0x95/0xd0 Aug 22 08:31:06 juju-e4d256-prod-github-runner-207 kernel: [11240.608264] do_syscall_64+0x5c/0xc0 Aug 22 08:31:06 juju-e4d256-prod-github-runner-207 kernel: [11240.608927] ? do_futex+0x162/0x1f0 Aug 22 08:31:06 juju-e4d256-prod-github-runner-207 kernel: [11240.609602] ? __x64_sys_futex+0x78/0x1e0 Aug 22 08:31:06 juju-e4d256-prod-github-runner-207 kernel: [11240.610338] ? __secure_computing+0xa9/0x120 Aug 22 08:31:06 juju-e4d256-prod-github-runner-207 kernel: [11240.611047] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 08:31:06 juju-e4d256-prod-github-runner-207 kernel: [11240.611813] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:31:06 juju-e4d256-prod-github-runner-207 kernel: [11240.612533] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:31:06 juju-e4d256-prod-github-runner-207 kernel: [11240.613251] ? do_syscall_64+0x69/0xc0 Aug 22 08:31:06 juju-e4d256-prod-github-runner-207 kernel: [11240.613894] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:31:06 juju-e4d256-prod-github-runner-207 kernel: [11240.614608] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:31:06 juju-e4d256-prod-github-runner-207 kernel: [11240.615345] ? do_syscall_64+0x69/0xc0 Aug 22 08:31:06 juju-e4d256-prod-github-runner-207 kernel: [11240.615983] ? do_syscall_64+0x69/0xc0 Aug 22 08:31:06 juju-e4d256-prod-github-runner-207 kernel: [11240.616610] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 08:31:06 juju-e4d256-prod-github-runner-207 kernel: [11240.617317] RIP: 0033:0x7faa5d0edaff Aug 22 08:31:06 juju-e4d256-prod-github-runner-207 kernel: [11240.617965] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 08:31:06 juju-e4d256-prod-github-runner-207 kernel: [11240.619959] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 08:31:06 juju-e4d256-prod-github-runner-207 kernel: [11240.620866] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 08:31:06 juju-e4d256-prod-github-runner-207 kernel: [11240.621753] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 08:31:06 juju-e4d256-prod-github-runner-207 kernel: [11240.622653] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 08:31:06 juju-e4d256-prod-github-runner-207 kernel: [11240.623544] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 08:31:06 juju-e4d256-prod-github-runner-207 kernel: [11240.624439] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 08:31:06 juju-e4d256-prod-github-runner-207 kernel: [11240.625335] Aug 22 08:31:34 juju-e4d256-prod-github-runner-207 kernel: [11268.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 10386s! [qemu-system-x86:6715] Aug 22 08:31:34 juju-e4d256-prod-github-runner-207 kernel: [11268.543819] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 08:31:34 juju-e4d256-prod-github-runner-207 kernel: [11268.544029] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 08:31:34 juju-e4d256-prod-github-runner-207 kernel: [11268.556376] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 08:31:34 juju-e4d256-prod-github-runner-207 kernel: [11268.557667] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 08:31:34 juju-e4d256-prod-github-runner-207 kernel: [11268.558928] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:31:34 juju-e4d256-prod-github-runner-207 kernel: [11268.560008] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 08:31:34 juju-e4d256-prod-github-runner-207 kernel: [11268.562625] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 08:31:34 juju-e4d256-prod-github-runner-207 kernel: [11268.563716] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 08:31:34 juju-e4d256-prod-github-runner-207 kernel: [11268.564961] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 08:31:34 juju-e4d256-prod-github-runner-207 kernel: [11268.566169] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 08:31:34 juju-e4d256-prod-github-runner-207 kernel: [11268.567365] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 08:31:34 juju-e4d256-prod-github-runner-207 kernel: [11268.568548] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 08:31:34 juju-e4d256-prod-github-runner-207 kernel: [11268.569734] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 08:31:34 juju-e4d256-prod-github-runner-207 kernel: [11268.571013] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 08:31:34 juju-e4d256-prod-github-runner-207 kernel: [11268.572131] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 08:31:34 juju-e4d256-prod-github-runner-207 kernel: [11268.573342] Call Trace: Aug 22 08:31:34 juju-e4d256-prod-github-runner-207 kernel: [11268.574272] Aug 22 08:31:34 juju-e4d256-prod-github-runner-207 kernel: [11268.575177] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:31:34 juju-e4d256-prod-github-runner-207 kernel: [11268.576219] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:31:34 juju-e4d256-prod-github-runner-207 kernel: [11268.577250] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:31:34 juju-e4d256-prod-github-runner-207 kernel: [11268.578348] ? show_regs.part.0+0x23/0x29 Aug 22 08:31:34 juju-e4d256-prod-github-runner-207 kernel: [11268.579360] ? show_regs.cold+0x8/0xd Aug 22 08:31:34 juju-e4d256-prod-github-runner-207 kernel: [11268.580341] ? watchdog_timer_fn+0x1be/0x220 Aug 22 08:31:34 juju-e4d256-prod-github-runner-207 kernel: [11268.581367] ? lockup_detector_update_enable+0x60/0x60 Aug 22 08:31:34 juju-e4d256-prod-github-runner-207 kernel: [11268.582454] ? __hrtimer_run_queues+0x107/0x230 Aug 22 08:31:34 juju-e4d256-prod-github-runner-207 kernel: [11268.583497] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 08:31:34 juju-e4d256-prod-github-runner-207 kernel: [11268.584532] ? hrtimer_interrupt+0x101/0x220 Aug 22 08:31:34 juju-e4d256-prod-github-runner-207 kernel: [11268.585557] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 08:31:34 juju-e4d256-prod-github-runner-207 kernel: [11268.586654] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 08:31:34 juju-e4d256-prod-github-runner-207 kernel: [11268.587715] Aug 22 08:31:34 juju-e4d256-prod-github-runner-207 kernel: [11268.588575] Aug 22 08:31:34 juju-e4d256-prod-github-runner-207 kernel: [11268.589418] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 08:31:34 juju-e4d256-prod-github-runner-207 kernel: [11268.590477] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:31:34 juju-e4d256-prod-github-runner-207 kernel: [11268.591532] ? _raw_spin_lock+0x22/0x30 Aug 22 08:31:34 juju-e4d256-prod-github-runner-207 kernel: [11268.592484] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:31:34 juju-e4d256-prod-github-runner-207 kernel: [11268.593511] direct_page_fault+0x206/0x310 [kvm] Aug 22 08:31:34 juju-e4d256-prod-github-runner-207 kernel: [11268.594553] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 08:31:34 juju-e4d256-prod-github-runner-207 kernel: [11268.595579] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 08:31:34 juju-e4d256-prod-github-runner-207 kernel: [11268.596593] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 08:31:34 juju-e4d256-prod-github-runner-207 kernel: [11268.597590] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 08:31:34 juju-e4d256-prod-github-runner-207 kernel: [11268.598551] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 08:31:34 juju-e4d256-prod-github-runner-207 kernel: [11268.599545] handle_exit+0x98/0x230 [kvm_amd] Aug 22 08:31:34 juju-e4d256-prod-github-runner-207 kernel: [11268.600447] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 08:31:34 juju-e4d256-prod-github-runner-207 kernel: [11268.601373] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 08:31:34 juju-e4d256-prod-github-runner-207 kernel: [11268.602318] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 08:31:34 juju-e4d256-prod-github-runner-207 kernel: [11268.603240] vcpu_run+0x62/0x2c0 [kvm] Aug 22 08:31:34 juju-e4d256-prod-github-runner-207 kernel: [11268.604076] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 08:31:34 juju-e4d256-prod-github-runner-207 kernel: [11268.604898] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 08:31:34 juju-e4d256-prod-github-runner-207 kernel: [11268.605768] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 08:31:34 juju-e4d256-prod-github-runner-207 kernel: [11268.606591] ? __seccomp_filter+0x4a/0x4a0 Aug 22 08:31:34 juju-e4d256-prod-github-runner-207 kernel: [11268.607340] ? __fget_files+0x86/0xc0 Aug 22 08:31:34 juju-e4d256-prod-github-runner-207 kernel: [11268.608042] __x64_sys_ioctl+0x95/0xd0 Aug 22 08:31:34 juju-e4d256-prod-github-runner-207 kernel: [11268.608733] do_syscall_64+0x5c/0xc0 Aug 22 08:31:34 juju-e4d256-prod-github-runner-207 kernel: [11268.609395] ? do_futex+0x162/0x1f0 Aug 22 08:31:34 juju-e4d256-prod-github-runner-207 kernel: [11268.610057] ? __x64_sys_futex+0x78/0x1e0 Aug 22 08:31:34 juju-e4d256-prod-github-runner-207 kernel: [11268.610732] ? __secure_computing+0xa9/0x120 Aug 22 08:31:34 juju-e4d256-prod-github-runner-207 kernel: [11268.611423] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 08:31:34 juju-e4d256-prod-github-runner-207 kernel: [11268.612183] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:31:34 juju-e4d256-prod-github-runner-207 kernel: [11268.612905] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:31:34 juju-e4d256-prod-github-runner-207 kernel: [11268.613627] ? do_syscall_64+0x69/0xc0 Aug 22 08:31:34 juju-e4d256-prod-github-runner-207 kernel: [11268.614283] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:31:34 juju-e4d256-prod-github-runner-207 kernel: [11268.614986] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:31:34 juju-e4d256-prod-github-runner-207 kernel: [11268.615680] ? do_syscall_64+0x69/0xc0 Aug 22 08:31:34 juju-e4d256-prod-github-runner-207 kernel: [11268.616312] ? do_syscall_64+0x69/0xc0 Aug 22 08:31:34 juju-e4d256-prod-github-runner-207 kernel: [11268.616935] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 08:31:34 juju-e4d256-prod-github-runner-207 kernel: [11268.617641] RIP: 0033:0x7faa5d0edaff Aug 22 08:31:34 juju-e4d256-prod-github-runner-207 kernel: [11268.618304] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 08:31:34 juju-e4d256-prod-github-runner-207 kernel: [11268.620392] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 08:31:34 juju-e4d256-prod-github-runner-207 kernel: [11268.621305] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 08:31:34 juju-e4d256-prod-github-runner-207 kernel: [11268.622372] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 08:31:34 juju-e4d256-prod-github-runner-207 kernel: [11268.623263] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 08:31:34 juju-e4d256-prod-github-runner-207 kernel: [11268.624148] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 08:31:34 juju-e4d256-prod-github-runner-207 kernel: [11268.625040] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 08:31:34 juju-e4d256-prod-github-runner-207 kernel: [11268.625945] Aug 22 08:32:02 juju-e4d256-prod-github-runner-207 kernel: [11296.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 10412s! [qemu-system-x86:6715] Aug 22 08:32:02 juju-e4d256-prod-github-runner-207 kernel: [11296.543077] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 08:32:02 juju-e4d256-prod-github-runner-207 kernel: [11296.543147] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 08:32:02 juju-e4d256-prod-github-runner-207 kernel: [11296.555610] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 08:32:02 juju-e4d256-prod-github-runner-207 kernel: [11296.556876] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 08:32:02 juju-e4d256-prod-github-runner-207 kernel: [11296.558133] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:32:02 juju-e4d256-prod-github-runner-207 kernel: [11296.559191] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 08:32:02 juju-e4d256-prod-github-runner-207 kernel: [11296.561743] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 08:32:02 juju-e4d256-prod-github-runner-207 kernel: [11296.562791] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 08:32:02 juju-e4d256-prod-github-runner-207 kernel: [11296.563951] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 08:32:02 juju-e4d256-prod-github-runner-207 kernel: [11296.565108] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 08:32:02 juju-e4d256-prod-github-runner-207 kernel: [11296.566285] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 08:32:02 juju-e4d256-prod-github-runner-207 kernel: [11296.567515] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 08:32:02 juju-e4d256-prod-github-runner-207 kernel: [11296.568690] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 08:32:02 juju-e4d256-prod-github-runner-207 kernel: [11296.569936] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 08:32:02 juju-e4d256-prod-github-runner-207 kernel: [11296.571032] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 08:32:02 juju-e4d256-prod-github-runner-207 kernel: [11296.572222] Call Trace: Aug 22 08:32:02 juju-e4d256-prod-github-runner-207 kernel: [11296.573136] Aug 22 08:32:02 juju-e4d256-prod-github-runner-207 kernel: [11296.574026] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:32:02 juju-e4d256-prod-github-runner-207 kernel: [11296.575053] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:32:02 juju-e4d256-prod-github-runner-207 kernel: [11296.576140] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:32:02 juju-e4d256-prod-github-runner-207 kernel: [11296.577227] ? show_regs.part.0+0x23/0x29 Aug 22 08:32:02 juju-e4d256-prod-github-runner-207 kernel: [11296.578240] ? show_regs.cold+0x8/0xd Aug 22 08:32:02 juju-e4d256-prod-github-runner-207 kernel: [11296.579244] ? watchdog_timer_fn+0x1be/0x220 Aug 22 08:32:02 juju-e4d256-prod-github-runner-207 kernel: [11296.580251] ? lockup_detector_update_enable+0x60/0x60 Aug 22 08:32:02 juju-e4d256-prod-github-runner-207 kernel: [11296.581315] ? __hrtimer_run_queues+0x107/0x230 Aug 22 08:32:02 juju-e4d256-prod-github-runner-207 kernel: [11296.582359] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 08:32:02 juju-e4d256-prod-github-runner-207 kernel: [11296.583405] ? hrtimer_interrupt+0x101/0x220 Aug 22 08:32:02 juju-e4d256-prod-github-runner-207 kernel: [11296.584480] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 08:32:02 juju-e4d256-prod-github-runner-207 kernel: [11296.585652] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 08:32:02 juju-e4d256-prod-github-runner-207 kernel: [11296.586707] Aug 22 08:32:02 juju-e4d256-prod-github-runner-207 kernel: [11296.587559] Aug 22 08:32:02 juju-e4d256-prod-github-runner-207 kernel: [11296.588415] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 08:32:02 juju-e4d256-prod-github-runner-207 kernel: [11296.589471] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:32:02 juju-e4d256-prod-github-runner-207 kernel: [11296.590524] ? _raw_spin_lock+0x22/0x30 Aug 22 08:32:02 juju-e4d256-prod-github-runner-207 kernel: [11296.591469] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:32:02 juju-e4d256-prod-github-runner-207 kernel: [11296.592486] direct_page_fault+0x206/0x310 [kvm] Aug 22 08:32:02 juju-e4d256-prod-github-runner-207 kernel: [11296.593507] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 08:32:02 juju-e4d256-prod-github-runner-207 kernel: [11296.594531] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 08:32:02 juju-e4d256-prod-github-runner-207 kernel: [11296.595531] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 08:32:02 juju-e4d256-prod-github-runner-207 kernel: [11296.596503] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 08:32:02 juju-e4d256-prod-github-runner-207 kernel: [11296.597466] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 08:32:02 juju-e4d256-prod-github-runner-207 kernel: [11296.598483] handle_exit+0x98/0x230 [kvm_amd] Aug 22 08:32:02 juju-e4d256-prod-github-runner-207 kernel: [11296.599378] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 08:32:02 juju-e4d256-prod-github-runner-207 kernel: [11296.600303] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 08:32:02 juju-e4d256-prod-github-runner-207 kernel: [11296.601230] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 08:32:02 juju-e4d256-prod-github-runner-207 kernel: [11296.602162] vcpu_run+0x62/0x2c0 [kvm] Aug 22 08:32:02 juju-e4d256-prod-github-runner-207 kernel: [11296.602977] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 08:32:02 juju-e4d256-prod-github-runner-207 kernel: [11296.603787] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 08:32:02 juju-e4d256-prod-github-runner-207 kernel: [11296.604640] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 08:32:02 juju-e4d256-prod-github-runner-207 kernel: [11296.605437] ? __seccomp_filter+0x4a/0x4a0 Aug 22 08:32:02 juju-e4d256-prod-github-runner-207 kernel: [11296.606198] ? __fget_files+0x86/0xc0 Aug 22 08:32:02 juju-e4d256-prod-github-runner-207 kernel: [11296.606906] __x64_sys_ioctl+0x95/0xd0 Aug 22 08:32:02 juju-e4d256-prod-github-runner-207 kernel: [11296.607600] do_syscall_64+0x5c/0xc0 Aug 22 08:32:02 juju-e4d256-prod-github-runner-207 kernel: [11296.608263] ? do_futex+0x162/0x1f0 Aug 22 08:32:02 juju-e4d256-prod-github-runner-207 kernel: [11296.608913] ? __x64_sys_futex+0x78/0x1e0 Aug 22 08:32:02 juju-e4d256-prod-github-runner-207 kernel: [11296.609604] ? __secure_computing+0xa9/0x120 Aug 22 08:32:02 juju-e4d256-prod-github-runner-207 kernel: [11296.610301] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 08:32:02 juju-e4d256-prod-github-runner-207 kernel: [11296.611108] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:32:02 juju-e4d256-prod-github-runner-207 kernel: [11296.611847] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:32:02 juju-e4d256-prod-github-runner-207 kernel: [11296.612570] ? do_syscall_64+0x69/0xc0 Aug 22 08:32:02 juju-e4d256-prod-github-runner-207 kernel: [11296.613214] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:32:02 juju-e4d256-prod-github-runner-207 kernel: [11296.613941] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:32:02 juju-e4d256-prod-github-runner-207 kernel: [11296.614635] ? do_syscall_64+0x69/0xc0 Aug 22 08:32:02 juju-e4d256-prod-github-runner-207 kernel: [11296.615258] ? do_syscall_64+0x69/0xc0 Aug 22 08:32:02 juju-e4d256-prod-github-runner-207 kernel: [11296.615878] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 08:32:02 juju-e4d256-prod-github-runner-207 kernel: [11296.616622] RIP: 0033:0x7faa5d0edaff Aug 22 08:32:02 juju-e4d256-prod-github-runner-207 kernel: [11296.617248] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 08:32:02 juju-e4d256-prod-github-runner-207 kernel: [11296.619273] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 08:32:02 juju-e4d256-prod-github-runner-207 kernel: [11296.620182] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 08:32:02 juju-e4d256-prod-github-runner-207 kernel: [11296.621070] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 08:32:02 juju-e4d256-prod-github-runner-207 kernel: [11296.621975] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 08:32:02 juju-e4d256-prod-github-runner-207 kernel: [11296.622877] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 08:32:02 juju-e4d256-prod-github-runner-207 kernel: [11296.623768] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 08:32:02 juju-e4d256-prod-github-runner-207 kernel: [11296.624655] Aug 22 08:32:30 juju-e4d256-prod-github-runner-207 kernel: [11324.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 10438s! [qemu-system-x86:6715] Aug 22 08:32:30 juju-e4d256-prod-github-runner-207 kernel: [11324.543088] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 08:32:30 juju-e4d256-prod-github-runner-207 kernel: [11324.543161] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 08:32:30 juju-e4d256-prod-github-runner-207 kernel: [11324.555259] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 08:32:30 juju-e4d256-prod-github-runner-207 kernel: [11324.556529] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 08:32:30 juju-e4d256-prod-github-runner-207 kernel: [11324.557784] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:32:30 juju-e4d256-prod-github-runner-207 kernel: [11324.558847] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 08:32:30 juju-e4d256-prod-github-runner-207 kernel: [11324.561399] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 08:32:30 juju-e4d256-prod-github-runner-207 kernel: [11324.562447] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 08:32:30 juju-e4d256-prod-github-runner-207 kernel: [11324.563622] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 08:32:30 juju-e4d256-prod-github-runner-207 kernel: [11324.564789] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 08:32:30 juju-e4d256-prod-github-runner-207 kernel: [11324.565964] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 08:32:30 juju-e4d256-prod-github-runner-207 kernel: [11324.567127] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 08:32:30 juju-e4d256-prod-github-runner-207 kernel: [11324.568298] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 08:32:30 juju-e4d256-prod-github-runner-207 kernel: [11324.569543] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 08:32:30 juju-e4d256-prod-github-runner-207 kernel: [11324.570650] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 08:32:30 juju-e4d256-prod-github-runner-207 kernel: [11324.571849] Call Trace: Aug 22 08:32:30 juju-e4d256-prod-github-runner-207 kernel: [11324.572767] Aug 22 08:32:30 juju-e4d256-prod-github-runner-207 kernel: [11324.573662] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:32:30 juju-e4d256-prod-github-runner-207 kernel: [11324.574692] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:32:30 juju-e4d256-prod-github-runner-207 kernel: [11324.575715] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:32:30 juju-e4d256-prod-github-runner-207 kernel: [11324.576792] ? show_regs.part.0+0x23/0x29 Aug 22 08:32:30 juju-e4d256-prod-github-runner-207 kernel: [11324.577824] ? show_regs.cold+0x8/0xd Aug 22 08:32:30 juju-e4d256-prod-github-runner-207 kernel: [11324.578796] ? watchdog_timer_fn+0x1be/0x220 Aug 22 08:32:30 juju-e4d256-prod-github-runner-207 kernel: [11324.579804] ? lockup_detector_update_enable+0x60/0x60 Aug 22 08:32:30 juju-e4d256-prod-github-runner-207 kernel: [11324.580874] ? __hrtimer_run_queues+0x107/0x230 Aug 22 08:32:30 juju-e4d256-prod-github-runner-207 kernel: [11324.581910] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 08:32:30 juju-e4d256-prod-github-runner-207 kernel: [11324.582933] ? hrtimer_interrupt+0x101/0x220 Aug 22 08:32:30 juju-e4d256-prod-github-runner-207 kernel: [11324.583948] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 08:32:30 juju-e4d256-prod-github-runner-207 kernel: [11324.585040] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 08:32:30 juju-e4d256-prod-github-runner-207 kernel: [11324.586094] Aug 22 08:32:30 juju-e4d256-prod-github-runner-207 kernel: [11324.586947] Aug 22 08:32:30 juju-e4d256-prod-github-runner-207 kernel: [11324.587788] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 08:32:30 juju-e4d256-prod-github-runner-207 kernel: [11324.588820] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:32:30 juju-e4d256-prod-github-runner-207 kernel: [11324.589905] ? _raw_spin_lock+0x22/0x30 Aug 22 08:32:30 juju-e4d256-prod-github-runner-207 kernel: [11324.590851] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:32:30 juju-e4d256-prod-github-runner-207 kernel: [11324.591869] direct_page_fault+0x206/0x310 [kvm] Aug 22 08:32:30 juju-e4d256-prod-github-runner-207 kernel: [11324.592891] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 08:32:30 juju-e4d256-prod-github-runner-207 kernel: [11324.593919] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 08:32:30 juju-e4d256-prod-github-runner-207 kernel: [11324.594926] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 08:32:30 juju-e4d256-prod-github-runner-207 kernel: [11324.595899] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 08:32:30 juju-e4d256-prod-github-runner-207 kernel: [11324.596852] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 08:32:30 juju-e4d256-prod-github-runner-207 kernel: [11324.597838] handle_exit+0x98/0x230 [kvm_amd] Aug 22 08:32:30 juju-e4d256-prod-github-runner-207 kernel: [11324.598731] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 08:32:30 juju-e4d256-prod-github-runner-207 kernel: [11324.599645] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 08:32:30 juju-e4d256-prod-github-runner-207 kernel: [11324.600570] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 08:32:30 juju-e4d256-prod-github-runner-207 kernel: [11324.601482] vcpu_run+0x62/0x2c0 [kvm] Aug 22 08:32:30 juju-e4d256-prod-github-runner-207 kernel: [11324.602295] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 08:32:30 juju-e4d256-prod-github-runner-207 kernel: [11324.603105] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 08:32:30 juju-e4d256-prod-github-runner-207 kernel: [11324.603966] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 08:32:30 juju-e4d256-prod-github-runner-207 kernel: [11324.604764] ? __seccomp_filter+0x4a/0x4a0 Aug 22 08:32:30 juju-e4d256-prod-github-runner-207 kernel: [11324.605521] ? __fget_files+0x86/0xc0 Aug 22 08:32:30 juju-e4d256-prod-github-runner-207 kernel: [11324.606233] __x64_sys_ioctl+0x95/0xd0 Aug 22 08:32:30 juju-e4d256-prod-github-runner-207 kernel: [11324.606931] do_syscall_64+0x5c/0xc0 Aug 22 08:32:30 juju-e4d256-prod-github-runner-207 kernel: [11324.607597] ? do_futex+0x162/0x1f0 Aug 22 08:32:30 juju-e4d256-prod-github-runner-207 kernel: [11324.608247] ? __x64_sys_futex+0x78/0x1e0 Aug 22 08:32:30 juju-e4d256-prod-github-runner-207 kernel: [11324.608920] ? __secure_computing+0xa9/0x120 Aug 22 08:32:30 juju-e4d256-prod-github-runner-207 kernel: [11324.609625] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 08:32:30 juju-e4d256-prod-github-runner-207 kernel: [11324.610386] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:32:30 juju-e4d256-prod-github-runner-207 kernel: [11324.611108] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:32:30 juju-e4d256-prod-github-runner-207 kernel: [11324.611828] ? do_syscall_64+0x69/0xc0 Aug 22 08:32:30 juju-e4d256-prod-github-runner-207 kernel: [11324.612483] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:32:30 juju-e4d256-prod-github-runner-207 kernel: [11324.613187] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:32:30 juju-e4d256-prod-github-runner-207 kernel: [11324.613891] ? do_syscall_64+0x69/0xc0 Aug 22 08:32:30 juju-e4d256-prod-github-runner-207 kernel: [11324.614516] ? do_syscall_64+0x69/0xc0 Aug 22 08:32:30 juju-e4d256-prod-github-runner-207 kernel: [11324.615138] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 08:32:30 juju-e4d256-prod-github-runner-207 kernel: [11324.615843] RIP: 0033:0x7faa5d0edaff Aug 22 08:32:30 juju-e4d256-prod-github-runner-207 kernel: [11324.616469] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 08:32:30 juju-e4d256-prod-github-runner-207 kernel: [11324.618504] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 08:32:30 juju-e4d256-prod-github-runner-207 kernel: [11324.619438] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 08:32:30 juju-e4d256-prod-github-runner-207 kernel: [11324.620332] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 08:32:30 juju-e4d256-prod-github-runner-207 kernel: [11324.621224] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 08:32:30 juju-e4d256-prod-github-runner-207 kernel: [11324.622126] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 08:32:30 juju-e4d256-prod-github-runner-207 kernel: [11324.623012] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 08:32:30 juju-e4d256-prod-github-runner-207 kernel: [11324.623902] Aug 22 08:32:44 juju-e4d256-prod-github-runner-207 kernel: [11337.944711] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 08:32:44 juju-e4d256-prod-github-runner-207 kernel: [11337.945771] rcu: 1-....: (2796381 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=1351755 Aug 22 08:32:44 juju-e4d256-prod-github-runner-207 kernel: [11337.946927] (t=2805186 jiffies g=23269 q=19691) Aug 22 08:32:44 juju-e4d256-prod-github-runner-207 kernel: [11337.947716] NMI backtrace for cpu 1 Aug 22 08:32:44 juju-e4d256-prod-github-runner-207 kernel: [11337.948429] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 08:32:44 juju-e4d256-prod-github-runner-207 kernel: [11337.949563] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 08:32:44 juju-e4d256-prod-github-runner-207 kernel: [11337.950656] Call Trace: Aug 22 08:32:44 juju-e4d256-prod-github-runner-207 kernel: [11337.951333] Aug 22 08:32:44 juju-e4d256-prod-github-runner-207 kernel: [11337.951992] show_stack+0x52/0x5c Aug 22 08:32:44 juju-e4d256-prod-github-runner-207 kernel: [11337.952726] dump_stack_lvl+0x4a/0x63 Aug 22 08:32:44 juju-e4d256-prod-github-runner-207 kernel: [11337.953609] dump_stack+0x10/0x16 Aug 22 08:32:44 juju-e4d256-prod-github-runner-207 kernel: [11337.954681] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 08:32:44 juju-e4d256-prod-github-runner-207 kernel: [11337.955755] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 08:32:44 juju-e4d256-prod-github-runner-207 kernel: [11337.956679] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 08:32:44 juju-e4d256-prod-github-runner-207 kernel: [11337.957541] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 08:32:44 juju-e4d256-prod-github-runner-207 kernel: [11337.958375] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 08:32:44 juju-e4d256-prod-github-runner-207 kernel: [11337.959194] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 08:32:44 juju-e4d256-prod-github-runner-207 kernel: [11337.959977] print_cpu_stall.cold+0x2f/0xe2 Aug 22 08:32:44 juju-e4d256-prod-github-runner-207 kernel: [11337.960748] ? timekeeping_update+0xf7/0x150 Aug 22 08:32:44 juju-e4d256-prod-github-runner-207 kernel: [11337.961546] check_cpu_stall+0x109/0x270 Aug 22 08:32:44 juju-e4d256-prod-github-runner-207 kernel: [11337.962312] rcu_sched_clock_irq+0x9a/0x250 Aug 22 08:32:44 juju-e4d256-prod-github-runner-207 kernel: [11337.963088] update_process_times+0x94/0xd0 Aug 22 08:32:44 juju-e4d256-prod-github-runner-207 kernel: [11337.963850] tick_sched_handle+0x29/0x70 Aug 22 08:32:44 juju-e4d256-prod-github-runner-207 kernel: [11337.964600] tick_sched_timer+0x8c/0xc0 Aug 22 08:32:44 juju-e4d256-prod-github-runner-207 kernel: [11337.965359] ? tick_nohz_handler+0xb0/0xb0 Aug 22 08:32:44 juju-e4d256-prod-github-runner-207 kernel: [11337.966128] __hrtimer_run_queues+0x107/0x230 Aug 22 08:32:44 juju-e4d256-prod-github-runner-207 kernel: [11337.966910] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 08:32:44 juju-e4d256-prod-github-runner-207 kernel: [11337.967690] hrtimer_interrupt+0x101/0x220 Aug 22 08:32:44 juju-e4d256-prod-github-runner-207 kernel: [11337.968531] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 08:32:44 juju-e4d256-prod-github-runner-207 kernel: [11337.969380] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 08:32:44 juju-e4d256-prod-github-runner-207 kernel: [11337.970189] Aug 22 08:32:44 juju-e4d256-prod-github-runner-207 kernel: [11337.970824] Aug 22 08:32:44 juju-e4d256-prod-github-runner-207 kernel: [11337.971452] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 08:32:44 juju-e4d256-prod-github-runner-207 kernel: [11337.972280] RIP: 0010:native_queued_spin_lock_slowpath+0xc/0x40 Aug 22 08:32:44 juju-e4d256-prod-github-runner-207 kernel: [11337.973180] Code: fe ff ff eb af 4c 89 fe 48 c7 c7 20 99 e9 89 e8 ca 69 55 00 e9 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 <8b> 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 eb Aug 22 08:32:44 juju-e4d256-prod-github-runner-207 kernel: [11337.975409] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 08:32:44 juju-e4d256-prod-github-runner-207 kernel: [11337.976285] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 08:32:44 juju-e4d256-prod-github-runner-207 kernel: [11337.977289] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 08:32:44 juju-e4d256-prod-github-runner-207 kernel: [11337.978267] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 08:32:44 juju-e4d256-prod-github-runner-207 kernel: [11337.979234] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 08:32:44 juju-e4d256-prod-github-runner-207 kernel: [11337.980184] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 08:32:44 juju-e4d256-prod-github-runner-207 kernel: [11337.981173] ? _raw_spin_lock+0x22/0x30 Aug 22 08:32:44 juju-e4d256-prod-github-runner-207 kernel: [11337.981948] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:32:44 juju-e4d256-prod-github-runner-207 kernel: [11337.982802] direct_page_fault+0x206/0x310 [kvm] Aug 22 08:32:44 juju-e4d256-prod-github-runner-207 kernel: [11337.983636] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 08:32:44 juju-e4d256-prod-github-runner-207 kernel: [11337.984483] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 08:32:44 juju-e4d256-prod-github-runner-207 kernel: [11337.985357] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 08:32:44 juju-e4d256-prod-github-runner-207 kernel: [11337.986181] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 08:32:44 juju-e4d256-prod-github-runner-207 kernel: [11337.986963] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 08:32:44 juju-e4d256-prod-github-runner-207 kernel: [11337.987782] handle_exit+0x98/0x230 [kvm_amd] Aug 22 08:32:44 juju-e4d256-prod-github-runner-207 kernel: [11337.988533] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 08:32:44 juju-e4d256-prod-github-runner-207 kernel: [11337.989372] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 08:32:44 juju-e4d256-prod-github-runner-207 kernel: [11337.990183] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 08:32:44 juju-e4d256-prod-github-runner-207 kernel: [11337.990970] vcpu_run+0x62/0x2c0 [kvm] Aug 22 08:32:44 juju-e4d256-prod-github-runner-207 kernel: [11337.991683] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 08:32:44 juju-e4d256-prod-github-runner-207 kernel: [11337.992415] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 08:32:44 juju-e4d256-prod-github-runner-207 kernel: [11337.993234] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 08:32:44 juju-e4d256-prod-github-runner-207 kernel: [11337.993998] ? __seccomp_filter+0x4a/0x4a0 Aug 22 08:32:44 juju-e4d256-prod-github-runner-207 kernel: [11337.994748] ? __fget_files+0x86/0xc0 Aug 22 08:32:44 juju-e4d256-prod-github-runner-207 kernel: [11337.995482] __x64_sys_ioctl+0x95/0xd0 Aug 22 08:32:44 juju-e4d256-prod-github-runner-207 kernel: [11337.996190] do_syscall_64+0x5c/0xc0 Aug 22 08:32:44 juju-e4d256-prod-github-runner-207 kernel: [11337.996871] ? do_futex+0x162/0x1f0 Aug 22 08:32:44 juju-e4d256-prod-github-runner-207 kernel: [11337.997565] ? __x64_sys_futex+0x78/0x1e0 Aug 22 08:32:44 juju-e4d256-prod-github-runner-207 kernel: [11337.998264] ? __secure_computing+0xa9/0x120 Aug 22 08:32:44 juju-e4d256-prod-github-runner-207 kernel: [11337.998980] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 08:32:44 juju-e4d256-prod-github-runner-207 kernel: [11337.999778] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:32:44 juju-e4d256-prod-github-runner-207 kernel: [11338.000530] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:32:44 juju-e4d256-prod-github-runner-207 kernel: [11338.001310] ? do_syscall_64+0x69/0xc0 Aug 22 08:32:44 juju-e4d256-prod-github-runner-207 kernel: [11338.002000] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:32:44 juju-e4d256-prod-github-runner-207 kernel: [11338.002755] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:32:44 juju-e4d256-prod-github-runner-207 kernel: [11338.003514] ? do_syscall_64+0x69/0xc0 Aug 22 08:32:44 juju-e4d256-prod-github-runner-207 kernel: [11338.004206] ? do_syscall_64+0x69/0xc0 Aug 22 08:32:44 juju-e4d256-prod-github-runner-207 kernel: [11338.004891] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 08:32:44 juju-e4d256-prod-github-runner-207 kernel: [11338.005683] RIP: 0033:0x7faa5d0edaff Aug 22 08:32:44 juju-e4d256-prod-github-runner-207 kernel: [11338.006411] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 08:32:44 juju-e4d256-prod-github-runner-207 kernel: [11338.008508] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 08:32:44 juju-e4d256-prod-github-runner-207 kernel: [11338.009491] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 08:32:44 juju-e4d256-prod-github-runner-207 kernel: [11338.010435] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 08:32:44 juju-e4d256-prod-github-runner-207 kernel: [11338.011382] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 08:32:44 juju-e4d256-prod-github-runner-207 kernel: [11338.012342] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 08:32:44 juju-e4d256-prod-github-runner-207 kernel: [11338.013297] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 08:32:44 juju-e4d256-prod-github-runner-207 kernel: [11338.014211] Aug 22 08:33:10 juju-e4d256-prod-github-runner-207 kernel: [11364.541981] watchdog: BUG: soft lockup - CPU#1 stuck for 10476s! [qemu-system-x86:6715] Aug 22 08:33:10 juju-e4d256-prod-github-runner-207 kernel: [11364.543836] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 08:33:10 juju-e4d256-prod-github-runner-207 kernel: [11364.544127] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 08:33:10 juju-e4d256-prod-github-runner-207 kernel: [11364.556285] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 08:33:10 juju-e4d256-prod-github-runner-207 kernel: [11364.557572] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 08:33:10 juju-e4d256-prod-github-runner-207 kernel: [11364.558788] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:33:10 juju-e4d256-prod-github-runner-207 kernel: [11364.559842] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 08:33:10 juju-e4d256-prod-github-runner-207 kernel: [11364.562393] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 08:33:10 juju-e4d256-prod-github-runner-207 kernel: [11364.563437] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 08:33:10 juju-e4d256-prod-github-runner-207 kernel: [11364.564595] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 08:33:10 juju-e4d256-prod-github-runner-207 kernel: [11364.565765] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 08:33:10 juju-e4d256-prod-github-runner-207 kernel: [11364.566920] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 08:33:10 juju-e4d256-prod-github-runner-207 kernel: [11364.568076] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 08:33:10 juju-e4d256-prod-github-runner-207 kernel: [11364.569326] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 08:33:10 juju-e4d256-prod-github-runner-207 kernel: [11364.570649] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 08:33:10 juju-e4d256-prod-github-runner-207 kernel: [11364.571744] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 08:33:10 juju-e4d256-prod-github-runner-207 kernel: [11364.572949] Call Trace: Aug 22 08:33:10 juju-e4d256-prod-github-runner-207 kernel: [11364.573860] Aug 22 08:33:10 juju-e4d256-prod-github-runner-207 kernel: [11364.574741] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:33:10 juju-e4d256-prod-github-runner-207 kernel: [11364.575778] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:33:10 juju-e4d256-prod-github-runner-207 kernel: [11364.576843] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:33:10 juju-e4d256-prod-github-runner-207 kernel: [11364.577935] ? show_regs.part.0+0x23/0x29 Aug 22 08:33:10 juju-e4d256-prod-github-runner-207 kernel: [11364.578999] ? show_regs.cold+0x8/0xd Aug 22 08:33:10 juju-e4d256-prod-github-runner-207 kernel: [11364.580104] ? watchdog_timer_fn+0x1be/0x220 Aug 22 08:33:10 juju-e4d256-prod-github-runner-207 kernel: [11364.581126] ? lockup_detector_update_enable+0x60/0x60 Aug 22 08:33:10 juju-e4d256-prod-github-runner-207 kernel: [11364.582187] ? __hrtimer_run_queues+0x107/0x230 Aug 22 08:33:10 juju-e4d256-prod-github-runner-207 kernel: [11364.583286] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 08:33:10 juju-e4d256-prod-github-runner-207 kernel: [11364.584571] ? hrtimer_interrupt+0x101/0x220 Aug 22 08:33:10 juju-e4d256-prod-github-runner-207 kernel: [11364.585946] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 08:33:10 juju-e4d256-prod-github-runner-207 kernel: [11364.587294] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 08:33:10 juju-e4d256-prod-github-runner-207 kernel: [11364.588347] Aug 22 08:33:10 juju-e4d256-prod-github-runner-207 kernel: [11364.589214] Aug 22 08:33:10 juju-e4d256-prod-github-runner-207 kernel: [11364.590053] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 08:33:10 juju-e4d256-prod-github-runner-207 kernel: [11364.591102] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:33:10 juju-e4d256-prod-github-runner-207 kernel: [11364.592346] ? _raw_spin_lock+0x22/0x30 Aug 22 08:33:10 juju-e4d256-prod-github-runner-207 kernel: [11364.593324] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:33:10 juju-e4d256-prod-github-runner-207 kernel: [11364.594348] direct_page_fault+0x206/0x310 [kvm] Aug 22 08:33:10 juju-e4d256-prod-github-runner-207 kernel: [11364.595371] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 08:33:10 juju-e4d256-prod-github-runner-207 kernel: [11364.596380] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 08:33:10 juju-e4d256-prod-github-runner-207 kernel: [11364.597399] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 08:33:10 juju-e4d256-prod-github-runner-207 kernel: [11364.598394] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 08:33:10 juju-e4d256-prod-github-runner-207 kernel: [11364.599340] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 08:33:10 juju-e4d256-prod-github-runner-207 kernel: [11364.600318] handle_exit+0x98/0x230 [kvm_amd] Aug 22 08:33:10 juju-e4d256-prod-github-runner-207 kernel: [11364.601244] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 08:33:10 juju-e4d256-prod-github-runner-207 kernel: [11364.602175] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 08:33:10 juju-e4d256-prod-github-runner-207 kernel: [11364.603098] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 08:33:10 juju-e4d256-prod-github-runner-207 kernel: [11364.603999] vcpu_run+0x62/0x2c0 [kvm] Aug 22 08:33:10 juju-e4d256-prod-github-runner-207 kernel: [11364.604888] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 08:33:10 juju-e4d256-prod-github-runner-207 kernel: [11364.605712] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 08:33:10 juju-e4d256-prod-github-runner-207 kernel: [11364.606586] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 08:33:10 juju-e4d256-prod-github-runner-207 kernel: [11364.607397] ? __seccomp_filter+0x4a/0x4a0 Aug 22 08:33:10 juju-e4d256-prod-github-runner-207 kernel: [11364.608141] ? __fget_files+0x86/0xc0 Aug 22 08:33:10 juju-e4d256-prod-github-runner-207 kernel: [11364.608869] __x64_sys_ioctl+0x95/0xd0 Aug 22 08:33:10 juju-e4d256-prod-github-runner-207 kernel: [11364.609569] do_syscall_64+0x5c/0xc0 Aug 22 08:33:10 juju-e4d256-prod-github-runner-207 kernel: [11364.610240] ? do_futex+0x162/0x1f0 Aug 22 08:33:10 juju-e4d256-prod-github-runner-207 kernel: [11364.610896] ? __x64_sys_futex+0x78/0x1e0 Aug 22 08:33:10 juju-e4d256-prod-github-runner-207 kernel: [11364.611596] ? __secure_computing+0xa9/0x120 Aug 22 08:33:10 juju-e4d256-prod-github-runner-207 kernel: [11364.612291] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 08:33:10 juju-e4d256-prod-github-runner-207 kernel: [11364.613065] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:33:10 juju-e4d256-prod-github-runner-207 kernel: [11364.613790] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:33:10 juju-e4d256-prod-github-runner-207 kernel: [11364.614524] ? do_syscall_64+0x69/0xc0 Aug 22 08:33:10 juju-e4d256-prod-github-runner-207 kernel: [11364.615180] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:33:10 juju-e4d256-prod-github-runner-207 kernel: [11364.615884] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:33:10 juju-e4d256-prod-github-runner-207 kernel: [11364.616582] ? do_syscall_64+0x69/0xc0 Aug 22 08:33:10 juju-e4d256-prod-github-runner-207 kernel: [11364.617234] ? do_syscall_64+0x69/0xc0 Aug 22 08:33:10 juju-e4d256-prod-github-runner-207 kernel: [11364.617855] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 08:33:10 juju-e4d256-prod-github-runner-207 kernel: [11364.618559] RIP: 0033:0x7faa5d0edaff Aug 22 08:33:10 juju-e4d256-prod-github-runner-207 kernel: [11364.619180] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 08:33:10 juju-e4d256-prod-github-runner-207 kernel: [11364.621224] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 08:33:10 juju-e4d256-prod-github-runner-207 kernel: [11364.622143] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 08:33:10 juju-e4d256-prod-github-runner-207 kernel: [11364.623038] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 08:33:10 juju-e4d256-prod-github-runner-207 kernel: [11364.623928] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 08:33:10 juju-e4d256-prod-github-runner-207 kernel: [11364.624826] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 08:33:10 juju-e4d256-prod-github-runner-207 kernel: [11364.625715] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 08:33:10 juju-e4d256-prod-github-runner-207 kernel: [11364.626613] Aug 22 08:33:38 juju-e4d256-prod-github-runner-207 kernel: [11392.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 10502s! [qemu-system-x86:6715] Aug 22 08:33:38 juju-e4d256-prod-github-runner-207 kernel: [11392.543097] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 08:33:38 juju-e4d256-prod-github-runner-207 kernel: [11392.543172] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 08:33:38 juju-e4d256-prod-github-runner-207 kernel: [11392.555198] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 08:33:38 juju-e4d256-prod-github-runner-207 kernel: [11392.556476] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 08:33:38 juju-e4d256-prod-github-runner-207 kernel: [11392.557699] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:33:38 juju-e4d256-prod-github-runner-207 kernel: [11392.558753] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 08:33:38 juju-e4d256-prod-github-runner-207 kernel: [11392.561314] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 08:33:38 juju-e4d256-prod-github-runner-207 kernel: [11392.562353] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 08:33:38 juju-e4d256-prod-github-runner-207 kernel: [11392.563516] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 08:33:38 juju-e4d256-prod-github-runner-207 kernel: [11392.564697] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 08:33:38 juju-e4d256-prod-github-runner-207 kernel: [11392.565856] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 08:33:38 juju-e4d256-prod-github-runner-207 kernel: [11392.567013] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 08:33:38 juju-e4d256-prod-github-runner-207 kernel: [11392.568186] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 08:33:38 juju-e4d256-prod-github-runner-207 kernel: [11392.569433] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 08:33:38 juju-e4d256-prod-github-runner-207 kernel: [11392.570528] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 08:33:38 juju-e4d256-prod-github-runner-207 kernel: [11392.571723] Call Trace: Aug 22 08:33:38 juju-e4d256-prod-github-runner-207 kernel: [11392.572644] Aug 22 08:33:38 juju-e4d256-prod-github-runner-207 kernel: [11392.573532] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:33:38 juju-e4d256-prod-github-runner-207 kernel: [11392.574559] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:33:38 juju-e4d256-prod-github-runner-207 kernel: [11392.575576] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:33:38 juju-e4d256-prod-github-runner-207 kernel: [11392.576668] ? show_regs.part.0+0x23/0x29 Aug 22 08:33:38 juju-e4d256-prod-github-runner-207 kernel: [11392.577665] ? show_regs.cold+0x8/0xd Aug 22 08:33:38 juju-e4d256-prod-github-runner-207 kernel: [11392.578633] ? watchdog_timer_fn+0x1be/0x220 Aug 22 08:33:38 juju-e4d256-prod-github-runner-207 kernel: [11392.579678] ? lockup_detector_update_enable+0x60/0x60 Aug 22 08:33:38 juju-e4d256-prod-github-runner-207 kernel: [11392.580753] ? __hrtimer_run_queues+0x107/0x230 Aug 22 08:33:38 juju-e4d256-prod-github-runner-207 kernel: [11392.581784] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 08:33:38 juju-e4d256-prod-github-runner-207 kernel: [11392.582804] ? hrtimer_interrupt+0x101/0x220 Aug 22 08:33:38 juju-e4d256-prod-github-runner-207 kernel: [11392.583816] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 08:33:38 juju-e4d256-prod-github-runner-207 kernel: [11392.584890] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 08:33:38 juju-e4d256-prod-github-runner-207 kernel: [11392.585938] Aug 22 08:33:38 juju-e4d256-prod-github-runner-207 kernel: [11392.586787] Aug 22 08:33:38 juju-e4d256-prod-github-runner-207 kernel: [11392.587627] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 08:33:38 juju-e4d256-prod-github-runner-207 kernel: [11392.588669] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:33:38 juju-e4d256-prod-github-runner-207 kernel: [11392.589706] ? _raw_spin_lock+0x22/0x30 Aug 22 08:33:38 juju-e4d256-prod-github-runner-207 kernel: [11392.590650] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:33:38 juju-e4d256-prod-github-runner-207 kernel: [11392.591669] direct_page_fault+0x206/0x310 [kvm] Aug 22 08:33:38 juju-e4d256-prod-github-runner-207 kernel: [11392.592704] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 08:33:38 juju-e4d256-prod-github-runner-207 kernel: [11392.593717] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 08:33:38 juju-e4d256-prod-github-runner-207 kernel: [11392.594720] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 08:33:38 juju-e4d256-prod-github-runner-207 kernel: [11392.595694] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 08:33:38 juju-e4d256-prod-github-runner-207 kernel: [11392.596652] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 08:33:38 juju-e4d256-prod-github-runner-207 kernel: [11392.597634] handle_exit+0x98/0x230 [kvm_amd] Aug 22 08:33:38 juju-e4d256-prod-github-runner-207 kernel: [11392.598532] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 08:33:38 juju-e4d256-prod-github-runner-207 kernel: [11392.599446] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 08:33:38 juju-e4d256-prod-github-runner-207 kernel: [11392.600388] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 08:33:38 juju-e4d256-prod-github-runner-207 kernel: [11392.601403] vcpu_run+0x62/0x2c0 [kvm] Aug 22 08:33:38 juju-e4d256-prod-github-runner-207 kernel: [11392.602215] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 08:33:38 juju-e4d256-prod-github-runner-207 kernel: [11392.603021] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 08:33:38 juju-e4d256-prod-github-runner-207 kernel: [11392.603878] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 08:33:38 juju-e4d256-prod-github-runner-207 kernel: [11392.604691] ? __seccomp_filter+0x4a/0x4a0 Aug 22 08:33:38 juju-e4d256-prod-github-runner-207 kernel: [11392.605438] ? __fget_files+0x86/0xc0 Aug 22 08:33:38 juju-e4d256-prod-github-runner-207 kernel: [11392.606141] __x64_sys_ioctl+0x95/0xd0 Aug 22 08:33:38 juju-e4d256-prod-github-runner-207 kernel: [11392.606833] do_syscall_64+0x5c/0xc0 Aug 22 08:33:38 juju-e4d256-prod-github-runner-207 kernel: [11392.607499] ? do_futex+0x162/0x1f0 Aug 22 08:33:38 juju-e4d256-prod-github-runner-207 kernel: [11392.608148] ? __x64_sys_futex+0x78/0x1e0 Aug 22 08:33:38 juju-e4d256-prod-github-runner-207 kernel: [11392.608830] ? __secure_computing+0xa9/0x120 Aug 22 08:33:38 juju-e4d256-prod-github-runner-207 kernel: [11392.609521] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 08:33:38 juju-e4d256-prod-github-runner-207 kernel: [11392.610323] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:33:38 juju-e4d256-prod-github-runner-207 kernel: [11392.611045] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:33:38 juju-e4d256-prod-github-runner-207 kernel: [11392.611762] ? do_syscall_64+0x69/0xc0 Aug 22 08:33:38 juju-e4d256-prod-github-runner-207 kernel: [11392.612406] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:33:38 juju-e4d256-prod-github-runner-207 kernel: [11392.613114] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:33:38 juju-e4d256-prod-github-runner-207 kernel: [11392.613809] ? do_syscall_64+0x69/0xc0 Aug 22 08:33:38 juju-e4d256-prod-github-runner-207 kernel: [11392.614439] ? do_syscall_64+0x69/0xc0 Aug 22 08:33:38 juju-e4d256-prod-github-runner-207 kernel: [11392.615060] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 08:33:38 juju-e4d256-prod-github-runner-207 kernel: [11392.615769] RIP: 0033:0x7faa5d0edaff Aug 22 08:33:38 juju-e4d256-prod-github-runner-207 kernel: [11392.616392] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 08:33:38 juju-e4d256-prod-github-runner-207 kernel: [11392.618389] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 08:33:38 juju-e4d256-prod-github-runner-207 kernel: [11392.619300] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 08:33:38 juju-e4d256-prod-github-runner-207 kernel: [11392.620189] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 08:33:38 juju-e4d256-prod-github-runner-207 kernel: [11392.621087] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 08:33:38 juju-e4d256-prod-github-runner-207 kernel: [11392.621973] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 08:33:38 juju-e4d256-prod-github-runner-207 kernel: [11392.622860] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 08:33:38 juju-e4d256-prod-github-runner-207 kernel: [11392.623755] Aug 22 08:34:06 juju-e4d256-prod-github-runner-207 kernel: [11420.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 10528s! [qemu-system-x86:6715] Aug 22 08:34:06 juju-e4d256-prod-github-runner-207 kernel: [11420.543180] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 08:34:06 juju-e4d256-prod-github-runner-207 kernel: [11420.543254] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 08:34:06 juju-e4d256-prod-github-runner-207 kernel: [11420.555720] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 08:34:06 juju-e4d256-prod-github-runner-207 kernel: [11420.557053] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 08:34:06 juju-e4d256-prod-github-runner-207 kernel: [11420.558299] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:34:06 juju-e4d256-prod-github-runner-207 kernel: [11420.559417] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 08:34:06 juju-e4d256-prod-github-runner-207 kernel: [11420.562127] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 08:34:06 juju-e4d256-prod-github-runner-207 kernel: [11420.563185] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 08:34:06 juju-e4d256-prod-github-runner-207 kernel: [11420.564426] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 08:34:06 juju-e4d256-prod-github-runner-207 kernel: [11420.565678] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 08:34:06 juju-e4d256-prod-github-runner-207 kernel: [11420.566895] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 08:34:06 juju-e4d256-prod-github-runner-207 kernel: [11420.568140] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 08:34:06 juju-e4d256-prod-github-runner-207 kernel: [11420.569360] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 08:34:06 juju-e4d256-prod-github-runner-207 kernel: [11420.570726] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 08:34:06 juju-e4d256-prod-github-runner-207 kernel: [11420.571872] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 08:34:06 juju-e4d256-prod-github-runner-207 kernel: [11420.573146] Call Trace: Aug 22 08:34:06 juju-e4d256-prod-github-runner-207 kernel: [11420.574096] Aug 22 08:34:06 juju-e4d256-prod-github-runner-207 kernel: [11420.575018] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:34:06 juju-e4d256-prod-github-runner-207 kernel: [11420.576096] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:34:06 juju-e4d256-prod-github-runner-207 kernel: [11420.577172] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:34:06 juju-e4d256-prod-github-runner-207 kernel: [11420.578252] ? show_regs.part.0+0x23/0x29 Aug 22 08:34:06 juju-e4d256-prod-github-runner-207 kernel: [11420.579253] ? show_regs.cold+0x8/0xd Aug 22 08:34:06 juju-e4d256-prod-github-runner-207 kernel: [11420.580247] ? watchdog_timer_fn+0x1be/0x220 Aug 22 08:34:06 juju-e4d256-prod-github-runner-207 kernel: [11420.581271] ? lockup_detector_update_enable+0x60/0x60 Aug 22 08:34:06 juju-e4d256-prod-github-runner-207 kernel: [11420.582354] ? __hrtimer_run_queues+0x107/0x230 Aug 22 08:34:06 juju-e4d256-prod-github-runner-207 kernel: [11420.583393] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 08:34:06 juju-e4d256-prod-github-runner-207 kernel: [11420.584440] ? hrtimer_interrupt+0x101/0x220 Aug 22 08:34:06 juju-e4d256-prod-github-runner-207 kernel: [11420.585501] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 08:34:06 juju-e4d256-prod-github-runner-207 kernel: [11420.586592] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 08:34:06 juju-e4d256-prod-github-runner-207 kernel: [11420.587656] Aug 22 08:34:06 juju-e4d256-prod-github-runner-207 kernel: [11420.588561] Aug 22 08:34:06 juju-e4d256-prod-github-runner-207 kernel: [11420.589406] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 08:34:06 juju-e4d256-prod-github-runner-207 kernel: [11420.590493] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:34:06 juju-e4d256-prod-github-runner-207 kernel: [11420.591770] ? _raw_spin_lock+0x22/0x30 Aug 22 08:34:06 juju-e4d256-prod-github-runner-207 kernel: [11420.592739] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:34:06 juju-e4d256-prod-github-runner-207 kernel: [11420.593768] direct_page_fault+0x206/0x310 [kvm] Aug 22 08:34:06 juju-e4d256-prod-github-runner-207 kernel: [11420.594806] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 08:34:06 juju-e4d256-prod-github-runner-207 kernel: [11420.595850] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 08:34:06 juju-e4d256-prod-github-runner-207 kernel: [11420.596872] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 08:34:06 juju-e4d256-prod-github-runner-207 kernel: [11420.597859] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 08:34:06 juju-e4d256-prod-github-runner-207 kernel: [11420.598816] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 08:34:06 juju-e4d256-prod-github-runner-207 kernel: [11420.599827] handle_exit+0x98/0x230 [kvm_amd] Aug 22 08:34:06 juju-e4d256-prod-github-runner-207 kernel: [11420.600744] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 08:34:06 juju-e4d256-prod-github-runner-207 kernel: [11420.601820] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 08:34:06 juju-e4d256-prod-github-runner-207 kernel: [11420.602764] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 08:34:06 juju-e4d256-prod-github-runner-207 kernel: [11420.603686] vcpu_run+0x62/0x2c0 [kvm] Aug 22 08:34:06 juju-e4d256-prod-github-runner-207 kernel: [11420.604540] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 08:34:06 juju-e4d256-prod-github-runner-207 kernel: [11420.605561] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 08:34:06 juju-e4d256-prod-github-runner-207 kernel: [11420.606430] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 08:34:06 juju-e4d256-prod-github-runner-207 kernel: [11420.607237] ? __seccomp_filter+0x4a/0x4a0 Aug 22 08:34:06 juju-e4d256-prod-github-runner-207 kernel: [11420.607995] ? __fget_files+0x86/0xc0 Aug 22 08:34:06 juju-e4d256-prod-github-runner-207 kernel: [11420.608726] __x64_sys_ioctl+0x95/0xd0 Aug 22 08:34:06 juju-e4d256-prod-github-runner-207 kernel: [11420.609425] do_syscall_64+0x5c/0xc0 Aug 22 08:34:06 juju-e4d256-prod-github-runner-207 kernel: [11420.610109] ? do_futex+0x162/0x1f0 Aug 22 08:34:06 juju-e4d256-prod-github-runner-207 kernel: [11420.610767] ? __x64_sys_futex+0x78/0x1e0 Aug 22 08:34:06 juju-e4d256-prod-github-runner-207 kernel: [11420.611450] ? __secure_computing+0xa9/0x120 Aug 22 08:34:06 juju-e4d256-prod-github-runner-207 kernel: [11420.612372] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 08:34:06 juju-e4d256-prod-github-runner-207 kernel: [11420.613162] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:34:06 juju-e4d256-prod-github-runner-207 kernel: [11420.613945] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:34:06 juju-e4d256-prod-github-runner-207 kernel: [11420.614693] ? do_syscall_64+0x69/0xc0 Aug 22 08:34:06 juju-e4d256-prod-github-runner-207 kernel: [11420.615389] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:34:06 juju-e4d256-prod-github-runner-207 kernel: [11420.616211] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:34:06 juju-e4d256-prod-github-runner-207 kernel: [11420.617097] ? do_syscall_64+0x69/0xc0 Aug 22 08:34:06 juju-e4d256-prod-github-runner-207 kernel: [11420.617736] ? do_syscall_64+0x69/0xc0 Aug 22 08:34:06 juju-e4d256-prod-github-runner-207 kernel: [11420.618366] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 08:34:06 juju-e4d256-prod-github-runner-207 kernel: [11420.619087] RIP: 0033:0x7faa5d0edaff Aug 22 08:34:06 juju-e4d256-prod-github-runner-207 kernel: [11420.619726] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 08:34:06 juju-e4d256-prod-github-runner-207 kernel: [11420.622000] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 08:34:06 juju-e4d256-prod-github-runner-207 kernel: [11420.622925] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 08:34:06 juju-e4d256-prod-github-runner-207 kernel: [11420.623835] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 08:34:06 juju-e4d256-prod-github-runner-207 kernel: [11420.624743] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 08:34:06 juju-e4d256-prod-github-runner-207 kernel: [11420.625641] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 08:34:06 juju-e4d256-prod-github-runner-207 kernel: [11420.626548] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 08:34:06 juju-e4d256-prod-github-runner-207 kernel: [11420.627470] Aug 22 08:34:34 juju-e4d256-prod-github-runner-207 kernel: [11448.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 10554s! [qemu-system-x86:6715] Aug 22 08:34:34 juju-e4d256-prod-github-runner-207 kernel: [11448.543827] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 08:34:34 juju-e4d256-prod-github-runner-207 kernel: [11448.544114] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 08:34:34 juju-e4d256-prod-github-runner-207 kernel: [11448.556300] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 08:34:34 juju-e4d256-prod-github-runner-207 kernel: [11448.557595] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 08:34:34 juju-e4d256-prod-github-runner-207 kernel: [11448.558814] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:34:34 juju-e4d256-prod-github-runner-207 kernel: [11448.559884] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 08:34:34 juju-e4d256-prod-github-runner-207 kernel: [11448.562424] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 08:34:34 juju-e4d256-prod-github-runner-207 kernel: [11448.563469] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 08:34:34 juju-e4d256-prod-github-runner-207 kernel: [11448.564700] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 08:34:34 juju-e4d256-prod-github-runner-207 kernel: [11448.565857] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 08:34:34 juju-e4d256-prod-github-runner-207 kernel: [11448.567021] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 08:34:34 juju-e4d256-prod-github-runner-207 kernel: [11448.568193] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 08:34:34 juju-e4d256-prod-github-runner-207 kernel: [11448.569353] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 08:34:34 juju-e4d256-prod-github-runner-207 kernel: [11448.570580] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 08:34:34 juju-e4d256-prod-github-runner-207 kernel: [11448.571672] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 08:34:34 juju-e4d256-prod-github-runner-207 kernel: [11448.572882] Call Trace: Aug 22 08:34:34 juju-e4d256-prod-github-runner-207 kernel: [11448.573790] Aug 22 08:34:34 juju-e4d256-prod-github-runner-207 kernel: [11448.574680] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:34:34 juju-e4d256-prod-github-runner-207 kernel: [11448.575768] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:34:34 juju-e4d256-prod-github-runner-207 kernel: [11448.576792] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:34:34 juju-e4d256-prod-github-runner-207 kernel: [11448.577892] ? show_regs.part.0+0x23/0x29 Aug 22 08:34:34 juju-e4d256-prod-github-runner-207 kernel: [11448.578884] ? show_regs.cold+0x8/0xd Aug 22 08:34:34 juju-e4d256-prod-github-runner-207 kernel: [11448.579871] ? watchdog_timer_fn+0x1be/0x220 Aug 22 08:34:34 juju-e4d256-prod-github-runner-207 kernel: [11448.580897] ? lockup_detector_update_enable+0x60/0x60 Aug 22 08:34:34 juju-e4d256-prod-github-runner-207 kernel: [11448.581956] ? __hrtimer_run_queues+0x107/0x230 Aug 22 08:34:34 juju-e4d256-prod-github-runner-207 kernel: [11448.582978] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 08:34:34 juju-e4d256-prod-github-runner-207 kernel: [11448.584019] ? hrtimer_interrupt+0x101/0x220 Aug 22 08:34:34 juju-e4d256-prod-github-runner-207 kernel: [11448.585030] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 08:34:34 juju-e4d256-prod-github-runner-207 kernel: [11448.586099] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 08:34:34 juju-e4d256-prod-github-runner-207 kernel: [11448.587138] Aug 22 08:34:34 juju-e4d256-prod-github-runner-207 kernel: [11448.588004] Aug 22 08:34:34 juju-e4d256-prod-github-runner-207 kernel: [11448.588842] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 08:34:34 juju-e4d256-prod-github-runner-207 kernel: [11448.589873] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:34:34 juju-e4d256-prod-github-runner-207 kernel: [11448.590915] ? _raw_spin_lock+0x22/0x30 Aug 22 08:34:34 juju-e4d256-prod-github-runner-207 kernel: [11448.591871] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:34:34 juju-e4d256-prod-github-runner-207 kernel: [11448.592899] direct_page_fault+0x206/0x310 [kvm] Aug 22 08:34:34 juju-e4d256-prod-github-runner-207 kernel: [11448.593926] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 08:34:34 juju-e4d256-prod-github-runner-207 kernel: [11448.595124] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 08:34:34 juju-e4d256-prod-github-runner-207 kernel: [11448.596153] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 08:34:34 juju-e4d256-prod-github-runner-207 kernel: [11448.597238] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 08:34:34 juju-e4d256-prod-github-runner-207 kernel: [11448.598181] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 08:34:34 juju-e4d256-prod-github-runner-207 kernel: [11448.599161] handle_exit+0x98/0x230 [kvm_amd] Aug 22 08:34:34 juju-e4d256-prod-github-runner-207 kernel: [11448.600135] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 08:34:34 juju-e4d256-prod-github-runner-207 kernel: [11448.601054] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 08:34:34 juju-e4d256-prod-github-runner-207 kernel: [11448.601978] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 08:34:34 juju-e4d256-prod-github-runner-207 kernel: [11448.602878] vcpu_run+0x62/0x2c0 [kvm] Aug 22 08:34:34 juju-e4d256-prod-github-runner-207 kernel: [11448.603691] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 08:34:34 juju-e4d256-prod-github-runner-207 kernel: [11448.604524] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 08:34:34 juju-e4d256-prod-github-runner-207 kernel: [11448.605380] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 08:34:34 juju-e4d256-prod-github-runner-207 kernel: [11448.606187] ? __seccomp_filter+0x4a/0x4a0 Aug 22 08:34:34 juju-e4d256-prod-github-runner-207 kernel: [11448.606931] ? __fget_files+0x86/0xc0 Aug 22 08:34:34 juju-e4d256-prod-github-runner-207 kernel: [11448.607633] __x64_sys_ioctl+0x95/0xd0 Aug 22 08:34:34 juju-e4d256-prod-github-runner-207 kernel: [11448.608342] do_syscall_64+0x5c/0xc0 Aug 22 08:34:34 juju-e4d256-prod-github-runner-207 kernel: [11448.609006] ? do_futex+0x162/0x1f0 Aug 22 08:34:34 juju-e4d256-prod-github-runner-207 kernel: [11448.609651] ? __x64_sys_futex+0x78/0x1e0 Aug 22 08:34:34 juju-e4d256-prod-github-runner-207 kernel: [11448.610322] ? __secure_computing+0xa9/0x120 Aug 22 08:34:34 juju-e4d256-prod-github-runner-207 kernel: [11448.611045] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 08:34:34 juju-e4d256-prod-github-runner-207 kernel: [11448.611846] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:34:34 juju-e4d256-prod-github-runner-207 kernel: [11448.612567] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:34:34 juju-e4d256-prod-github-runner-207 kernel: [11448.613282] ? do_syscall_64+0x69/0xc0 Aug 22 08:34:34 juju-e4d256-prod-github-runner-207 kernel: [11448.613923] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:34:34 juju-e4d256-prod-github-runner-207 kernel: [11448.614631] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:34:34 juju-e4d256-prod-github-runner-207 kernel: [11448.615321] ? do_syscall_64+0x69/0xc0 Aug 22 08:34:34 juju-e4d256-prod-github-runner-207 kernel: [11448.615963] ? do_syscall_64+0x69/0xc0 Aug 22 08:34:34 juju-e4d256-prod-github-runner-207 kernel: [11448.616605] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 08:34:34 juju-e4d256-prod-github-runner-207 kernel: [11448.617332] RIP: 0033:0x7faa5d0edaff Aug 22 08:34:34 juju-e4d256-prod-github-runner-207 kernel: [11448.617983] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 08:34:34 juju-e4d256-prod-github-runner-207 kernel: [11448.619984] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 08:34:34 juju-e4d256-prod-github-runner-207 kernel: [11448.620894] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 08:34:34 juju-e4d256-prod-github-runner-207 kernel: [11448.621802] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 08:34:34 juju-e4d256-prod-github-runner-207 kernel: [11448.622695] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 08:34:34 juju-e4d256-prod-github-runner-207 kernel: [11448.623606] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 08:34:34 juju-e4d256-prod-github-runner-207 kernel: [11448.624509] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 08:34:34 juju-e4d256-prod-github-runner-207 kernel: [11448.625404] Aug 22 08:35:02 juju-e4d256-prod-github-runner-207 kernel: [11476.541981] watchdog: BUG: soft lockup - CPU#1 stuck for 10580s! [qemu-system-x86:6715] Aug 22 08:35:02 juju-e4d256-prod-github-runner-207 kernel: [11476.543114] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 08:35:02 juju-e4d256-prod-github-runner-207 kernel: [11476.543182] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 08:35:02 juju-e4d256-prod-github-runner-207 kernel: [11476.556373] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 08:35:02 juju-e4d256-prod-github-runner-207 kernel: [11476.557928] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 08:35:02 juju-e4d256-prod-github-runner-207 kernel: [11476.559458] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:35:02 juju-e4d256-prod-github-runner-207 kernel: [11476.560599] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 08:35:02 juju-e4d256-prod-github-runner-207 kernel: [11476.563324] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 08:35:02 juju-e4d256-prod-github-runner-207 kernel: [11476.564427] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 08:35:02 juju-e4d256-prod-github-runner-207 kernel: [11476.565647] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 08:35:02 juju-e4d256-prod-github-runner-207 kernel: [11476.566827] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 08:35:02 juju-e4d256-prod-github-runner-207 kernel: [11476.568021] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 08:35:02 juju-e4d256-prod-github-runner-207 kernel: [11476.569267] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 08:35:02 juju-e4d256-prod-github-runner-207 kernel: [11476.570540] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 08:35:02 juju-e4d256-prod-github-runner-207 kernel: [11476.571896] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 08:35:02 juju-e4d256-prod-github-runner-207 kernel: [11476.573035] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 08:35:02 juju-e4d256-prod-github-runner-207 kernel: [11476.574312] Call Trace: Aug 22 08:35:02 juju-e4d256-prod-github-runner-207 kernel: [11476.575325] Aug 22 08:35:02 juju-e4d256-prod-github-runner-207 kernel: [11476.576302] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:35:02 juju-e4d256-prod-github-runner-207 kernel: [11476.577472] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:35:02 juju-e4d256-prod-github-runner-207 kernel: [11476.578585] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:35:02 juju-e4d256-prod-github-runner-207 kernel: [11476.579731] ? show_regs.part.0+0x23/0x29 Aug 22 08:35:02 juju-e4d256-prod-github-runner-207 kernel: [11476.580765] ? show_regs.cold+0x8/0xd Aug 22 08:35:02 juju-e4d256-prod-github-runner-207 kernel: [11476.581761] ? watchdog_timer_fn+0x1be/0x220 Aug 22 08:35:02 juju-e4d256-prod-github-runner-207 kernel: [11476.582794] ? lockup_detector_update_enable+0x60/0x60 Aug 22 08:35:02 juju-e4d256-prod-github-runner-207 kernel: [11476.583897] ? __hrtimer_run_queues+0x107/0x230 Aug 22 08:35:02 juju-e4d256-prod-github-runner-207 kernel: [11476.584964] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 08:35:02 juju-e4d256-prod-github-runner-207 kernel: [11476.586061] ? hrtimer_interrupt+0x101/0x220 Aug 22 08:35:02 juju-e4d256-prod-github-runner-207 kernel: [11476.587087] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 08:35:02 juju-e4d256-prod-github-runner-207 kernel: [11476.588191] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 08:35:02 juju-e4d256-prod-github-runner-207 kernel: [11476.589261] Aug 22 08:35:02 juju-e4d256-prod-github-runner-207 kernel: [11476.590131] Aug 22 08:35:02 juju-e4d256-prod-github-runner-207 kernel: [11476.591013] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 08:35:02 juju-e4d256-prod-github-runner-207 kernel: [11476.592090] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:35:02 juju-e4d256-prod-github-runner-207 kernel: [11476.593154] ? _raw_spin_lock+0x22/0x30 Aug 22 08:35:02 juju-e4d256-prod-github-runner-207 kernel: [11476.594113] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:35:02 juju-e4d256-prod-github-runner-207 kernel: [11476.595183] direct_page_fault+0x206/0x310 [kvm] Aug 22 08:35:02 juju-e4d256-prod-github-runner-207 kernel: [11476.596268] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 08:35:02 juju-e4d256-prod-github-runner-207 kernel: [11476.597300] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 08:35:02 juju-e4d256-prod-github-runner-207 kernel: [11476.598313] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 08:35:02 juju-e4d256-prod-github-runner-207 kernel: [11476.599292] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 08:35:02 juju-e4d256-prod-github-runner-207 kernel: [11476.600296] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 08:35:02 juju-e4d256-prod-github-runner-207 kernel: [11476.601334] handle_exit+0x98/0x230 [kvm_amd] Aug 22 08:35:02 juju-e4d256-prod-github-runner-207 kernel: [11476.602259] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 08:35:02 juju-e4d256-prod-github-runner-207 kernel: [11476.603189] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 08:35:02 juju-e4d256-prod-github-runner-207 kernel: [11476.604171] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 08:35:02 juju-e4d256-prod-github-runner-207 kernel: [11476.605105] vcpu_run+0x62/0x2c0 [kvm] Aug 22 08:35:02 juju-e4d256-prod-github-runner-207 kernel: [11476.605957] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 08:35:02 juju-e4d256-prod-github-runner-207 kernel: [11476.606795] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 08:35:02 juju-e4d256-prod-github-runner-207 kernel: [11476.607684] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 08:35:02 juju-e4d256-prod-github-runner-207 kernel: [11476.608489] ? __seccomp_filter+0x4a/0x4a0 Aug 22 08:35:02 juju-e4d256-prod-github-runner-207 kernel: [11476.609246] ? __fget_files+0x86/0xc0 Aug 22 08:35:02 juju-e4d256-prod-github-runner-207 kernel: [11476.609976] __x64_sys_ioctl+0x95/0xd0 Aug 22 08:35:02 juju-e4d256-prod-github-runner-207 kernel: [11476.610702] do_syscall_64+0x5c/0xc0 Aug 22 08:35:02 juju-e4d256-prod-github-runner-207 kernel: [11476.611459] ? do_futex+0x162/0x1f0 Aug 22 08:35:02 juju-e4d256-prod-github-runner-207 kernel: [11476.612368] ? __x64_sys_futex+0x78/0x1e0 Aug 22 08:35:02 juju-e4d256-prod-github-runner-207 kernel: [11476.613339] ? __secure_computing+0xa9/0x120 Aug 22 08:35:02 juju-e4d256-prod-github-runner-207 kernel: [11476.614305] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 08:35:02 juju-e4d256-prod-github-runner-207 kernel: [11476.615360] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:35:02 juju-e4d256-prod-github-runner-207 kernel: [11476.616408] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:35:02 juju-e4d256-prod-github-runner-207 kernel: [11476.617396] ? do_syscall_64+0x69/0xc0 Aug 22 08:35:02 juju-e4d256-prod-github-runner-207 kernel: [11476.618286] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:35:02 juju-e4d256-prod-github-runner-207 kernel: [11476.619244] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:35:02 juju-e4d256-prod-github-runner-207 kernel: [11476.620201] ? do_syscall_64+0x69/0xc0 Aug 22 08:35:02 juju-e4d256-prod-github-runner-207 kernel: [11476.621067] ? do_syscall_64+0x69/0xc0 Aug 22 08:35:02 juju-e4d256-prod-github-runner-207 kernel: [11476.621938] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 08:35:02 juju-e4d256-prod-github-runner-207 kernel: [11476.622882] RIP: 0033:0x7faa5d0edaff Aug 22 08:35:02 juju-e4d256-prod-github-runner-207 kernel: [11476.623781] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 08:35:02 juju-e4d256-prod-github-runner-207 kernel: [11476.626521] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 08:35:02 juju-e4d256-prod-github-runner-207 kernel: [11476.627825] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 08:35:02 juju-e4d256-prod-github-runner-207 kernel: [11476.629047] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 08:35:02 juju-e4d256-prod-github-runner-207 kernel: [11476.630263] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 08:35:02 juju-e4d256-prod-github-runner-207 kernel: [11476.631555] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 08:35:02 juju-e4d256-prod-github-runner-207 kernel: [11476.632774] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 08:35:02 juju-e4d256-prod-github-runner-207 kernel: [11476.634011] Aug 22 08:35:30 juju-e4d256-prod-github-runner-207 kernel: [11504.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 10606s! [qemu-system-x86:6715] Aug 22 08:35:30 juju-e4d256-prod-github-runner-207 kernel: [11504.543090] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 08:35:30 juju-e4d256-prod-github-runner-207 kernel: [11504.543162] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 08:35:30 juju-e4d256-prod-github-runner-207 kernel: [11504.555294] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 08:35:30 juju-e4d256-prod-github-runner-207 kernel: [11504.556577] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 08:35:30 juju-e4d256-prod-github-runner-207 kernel: [11504.557800] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:35:30 juju-e4d256-prod-github-runner-207 kernel: [11504.558860] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 08:35:30 juju-e4d256-prod-github-runner-207 kernel: [11504.561446] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 08:35:30 juju-e4d256-prod-github-runner-207 kernel: [11504.562495] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 08:35:30 juju-e4d256-prod-github-runner-207 kernel: [11504.563669] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 08:35:30 juju-e4d256-prod-github-runner-207 kernel: [11504.564832] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 08:35:30 juju-e4d256-prod-github-runner-207 kernel: [11504.565994] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 08:35:30 juju-e4d256-prod-github-runner-207 kernel: [11504.567164] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 08:35:30 juju-e4d256-prod-github-runner-207 kernel: [11504.568336] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 08:35:30 juju-e4d256-prod-github-runner-207 kernel: [11504.569852] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 08:35:30 juju-e4d256-prod-github-runner-207 kernel: [11504.570954] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 08:35:30 juju-e4d256-prod-github-runner-207 kernel: [11504.572170] Call Trace: Aug 22 08:35:30 juju-e4d256-prod-github-runner-207 kernel: [11504.573107] Aug 22 08:35:30 juju-e4d256-prod-github-runner-207 kernel: [11504.574009] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:35:30 juju-e4d256-prod-github-runner-207 kernel: [11504.575039] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:35:30 juju-e4d256-prod-github-runner-207 kernel: [11504.576090] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:35:30 juju-e4d256-prod-github-runner-207 kernel: [11504.577164] ? show_regs.part.0+0x23/0x29 Aug 22 08:35:30 juju-e4d256-prod-github-runner-207 kernel: [11504.578173] ? show_regs.cold+0x8/0xd Aug 22 08:35:30 juju-e4d256-prod-github-runner-207 kernel: [11504.579156] ? watchdog_timer_fn+0x1be/0x220 Aug 22 08:35:30 juju-e4d256-prod-github-runner-207 kernel: [11504.580174] ? lockup_detector_update_enable+0x60/0x60 Aug 22 08:35:30 juju-e4d256-prod-github-runner-207 kernel: [11504.581274] ? __hrtimer_run_queues+0x107/0x230 Aug 22 08:35:30 juju-e4d256-prod-github-runner-207 kernel: [11504.582313] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 08:35:30 juju-e4d256-prod-github-runner-207 kernel: [11504.583349] ? hrtimer_interrupt+0x101/0x220 Aug 22 08:35:30 juju-e4d256-prod-github-runner-207 kernel: [11504.584462] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 08:35:30 juju-e4d256-prod-github-runner-207 kernel: [11504.585536] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 08:35:30 juju-e4d256-prod-github-runner-207 kernel: [11504.586601] Aug 22 08:35:30 juju-e4d256-prod-github-runner-207 kernel: [11504.587463] Aug 22 08:35:30 juju-e4d256-prod-github-runner-207 kernel: [11504.588301] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 08:35:30 juju-e4d256-prod-github-runner-207 kernel: [11504.589332] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:35:30 juju-e4d256-prod-github-runner-207 kernel: [11504.590375] ? _raw_spin_lock+0x22/0x30 Aug 22 08:35:30 juju-e4d256-prod-github-runner-207 kernel: [11504.591336] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:35:30 juju-e4d256-prod-github-runner-207 kernel: [11504.592362] direct_page_fault+0x206/0x310 [kvm] Aug 22 08:35:30 juju-e4d256-prod-github-runner-207 kernel: [11504.593386] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 08:35:30 juju-e4d256-prod-github-runner-207 kernel: [11504.594398] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 08:35:30 juju-e4d256-prod-github-runner-207 kernel: [11504.595406] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 08:35:30 juju-e4d256-prod-github-runner-207 kernel: [11504.596394] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 08:35:30 juju-e4d256-prod-github-runner-207 kernel: [11504.597340] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 08:35:30 juju-e4d256-prod-github-runner-207 kernel: [11504.598318] handle_exit+0x98/0x230 [kvm_amd] Aug 22 08:35:30 juju-e4d256-prod-github-runner-207 kernel: [11504.599224] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 08:35:30 juju-e4d256-prod-github-runner-207 kernel: [11504.600142] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 08:35:30 juju-e4d256-prod-github-runner-207 kernel: [11504.601065] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 08:35:30 juju-e4d256-prod-github-runner-207 kernel: [11504.601968] vcpu_run+0x62/0x2c0 [kvm] Aug 22 08:35:30 juju-e4d256-prod-github-runner-207 kernel: [11504.602810] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 08:35:30 juju-e4d256-prod-github-runner-207 kernel: [11504.603630] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 08:35:30 juju-e4d256-prod-github-runner-207 kernel: [11504.604482] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 08:35:30 juju-e4d256-prod-github-runner-207 kernel: [11504.605278] ? __seccomp_filter+0x4a/0x4a0 Aug 22 08:35:30 juju-e4d256-prod-github-runner-207 kernel: [11504.606019] ? __fget_files+0x86/0xc0 Aug 22 08:35:30 juju-e4d256-prod-github-runner-207 kernel: [11504.606723] __x64_sys_ioctl+0x95/0xd0 Aug 22 08:35:30 juju-e4d256-prod-github-runner-207 kernel: [11504.607427] do_syscall_64+0x5c/0xc0 Aug 22 08:35:30 juju-e4d256-prod-github-runner-207 kernel: [11504.608090] ? do_futex+0x162/0x1f0 Aug 22 08:35:30 juju-e4d256-prod-github-runner-207 kernel: [11504.608737] ? __x64_sys_futex+0x78/0x1e0 Aug 22 08:35:30 juju-e4d256-prod-github-runner-207 kernel: [11504.609409] ? __secure_computing+0xa9/0x120 Aug 22 08:35:30 juju-e4d256-prod-github-runner-207 kernel: [11504.610097] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 08:35:30 juju-e4d256-prod-github-runner-207 kernel: [11504.610876] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:35:30 juju-e4d256-prod-github-runner-207 kernel: [11504.611621] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:35:30 juju-e4d256-prod-github-runner-207 kernel: [11504.612339] ? do_syscall_64+0x69/0xc0 Aug 22 08:35:30 juju-e4d256-prod-github-runner-207 kernel: [11504.612998] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:35:30 juju-e4d256-prod-github-runner-207 kernel: [11504.613715] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:35:30 juju-e4d256-prod-github-runner-207 kernel: [11504.614416] ? do_syscall_64+0x69/0xc0 Aug 22 08:35:30 juju-e4d256-prod-github-runner-207 kernel: [11504.615042] ? do_syscall_64+0x69/0xc0 Aug 22 08:35:30 juju-e4d256-prod-github-runner-207 kernel: [11504.615696] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 08:35:30 juju-e4d256-prod-github-runner-207 kernel: [11504.616403] RIP: 0033:0x7faa5d0edaff Aug 22 08:35:30 juju-e4d256-prod-github-runner-207 kernel: [11504.617030] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 08:35:30 juju-e4d256-prod-github-runner-207 kernel: [11504.619016] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 08:35:30 juju-e4d256-prod-github-runner-207 kernel: [11504.619935] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 08:35:30 juju-e4d256-prod-github-runner-207 kernel: [11504.620834] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 08:35:30 juju-e4d256-prod-github-runner-207 kernel: [11504.621725] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 08:35:30 juju-e4d256-prod-github-runner-207 kernel: [11504.622646] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 08:35:30 juju-e4d256-prod-github-runner-207 kernel: [11504.623545] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 08:35:30 juju-e4d256-prod-github-runner-207 kernel: [11504.624439] Aug 22 08:35:44 juju-e4d256-prod-github-runner-207 kernel: [11517.956705] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 08:35:44 juju-e4d256-prod-github-runner-207 kernel: [11517.957739] rcu: 1-....: (2841247 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=1373599 Aug 22 08:35:44 juju-e4d256-prod-github-runner-207 kernel: [11517.958859] (t=2850189 jiffies g=23269 q=19803) Aug 22 08:35:44 juju-e4d256-prod-github-runner-207 kernel: [11517.959654] NMI backtrace for cpu 1 Aug 22 08:35:44 juju-e4d256-prod-github-runner-207 kernel: [11517.960366] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 08:35:44 juju-e4d256-prod-github-runner-207 kernel: [11517.961479] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 08:35:44 juju-e4d256-prod-github-runner-207 kernel: [11517.962556] Call Trace: Aug 22 08:35:44 juju-e4d256-prod-github-runner-207 kernel: [11517.963380] Aug 22 08:35:44 juju-e4d256-prod-github-runner-207 kernel: [11517.964046] show_stack+0x52/0x5c Aug 22 08:35:44 juju-e4d256-prod-github-runner-207 kernel: [11517.964778] dump_stack_lvl+0x4a/0x63 Aug 22 08:35:44 juju-e4d256-prod-github-runner-207 kernel: [11517.965523] dump_stack+0x10/0x16 Aug 22 08:35:44 juju-e4d256-prod-github-runner-207 kernel: [11517.966258] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 08:35:44 juju-e4d256-prod-github-runner-207 kernel: [11517.967066] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 08:35:44 juju-e4d256-prod-github-runner-207 kernel: [11517.967845] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 08:35:44 juju-e4d256-prod-github-runner-207 kernel: [11517.968673] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 08:35:44 juju-e4d256-prod-github-runner-207 kernel: [11517.969491] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 08:35:44 juju-e4d256-prod-github-runner-207 kernel: [11517.970301] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 08:35:44 juju-e4d256-prod-github-runner-207 kernel: [11517.971080] print_cpu_stall.cold+0x2f/0xe2 Aug 22 08:35:44 juju-e4d256-prod-github-runner-207 kernel: [11517.971849] ? timekeeping_update+0xf7/0x150 Aug 22 08:35:44 juju-e4d256-prod-github-runner-207 kernel: [11517.972618] check_cpu_stall+0x109/0x270 Aug 22 08:35:44 juju-e4d256-prod-github-runner-207 kernel: [11517.973364] rcu_sched_clock_irq+0x9a/0x250 Aug 22 08:35:44 juju-e4d256-prod-github-runner-207 kernel: [11517.974124] update_process_times+0x94/0xd0 Aug 22 08:35:44 juju-e4d256-prod-github-runner-207 kernel: [11517.974890] tick_sched_handle+0x29/0x70 Aug 22 08:35:44 juju-e4d256-prod-github-runner-207 kernel: [11517.975646] tick_sched_timer+0x8c/0xc0 Aug 22 08:35:44 juju-e4d256-prod-github-runner-207 kernel: [11517.976382] ? tick_nohz_handler+0xb0/0xb0 Aug 22 08:35:44 juju-e4d256-prod-github-runner-207 kernel: [11517.977134] __hrtimer_run_queues+0x107/0x230 Aug 22 08:35:44 juju-e4d256-prod-github-runner-207 kernel: [11517.977911] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 08:35:44 juju-e4d256-prod-github-runner-207 kernel: [11517.978869] hrtimer_interrupt+0x101/0x220 Aug 22 08:35:44 juju-e4d256-prod-github-runner-207 kernel: [11517.979635] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 08:35:44 juju-e4d256-prod-github-runner-207 kernel: [11517.980445] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 08:35:44 juju-e4d256-prod-github-runner-207 kernel: [11517.981249] Aug 22 08:35:44 juju-e4d256-prod-github-runner-207 kernel: [11517.981881] Aug 22 08:35:44 juju-e4d256-prod-github-runner-207 kernel: [11517.982515] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 08:35:44 juju-e4d256-prod-github-runner-207 kernel: [11517.983347] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:35:44 juju-e4d256-prod-github-runner-207 kernel: [11517.984344] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 08:35:44 juju-e4d256-prod-github-runner-207 kernel: [11517.986580] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 08:35:44 juju-e4d256-prod-github-runner-207 kernel: [11517.987496] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 08:35:44 juju-e4d256-prod-github-runner-207 kernel: [11517.988492] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 08:35:44 juju-e4d256-prod-github-runner-207 kernel: [11517.989469] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 08:35:44 juju-e4d256-prod-github-runner-207 kernel: [11517.990431] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 08:35:44 juju-e4d256-prod-github-runner-207 kernel: [11517.991396] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 08:35:44 juju-e4d256-prod-github-runner-207 kernel: [11517.992350] ? _raw_spin_lock+0x22/0x30 Aug 22 08:35:44 juju-e4d256-prod-github-runner-207 kernel: [11517.993115] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:35:44 juju-e4d256-prod-github-runner-207 kernel: [11517.993972] direct_page_fault+0x206/0x310 [kvm] Aug 22 08:35:44 juju-e4d256-prod-github-runner-207 kernel: [11517.994808] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 08:35:44 juju-e4d256-prod-github-runner-207 kernel: [11517.995644] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 08:35:44 juju-e4d256-prod-github-runner-207 kernel: [11517.996491] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 08:35:44 juju-e4d256-prod-github-runner-207 kernel: [11517.997310] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 08:35:44 juju-e4d256-prod-github-runner-207 kernel: [11517.998092] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 08:35:44 juju-e4d256-prod-github-runner-207 kernel: [11517.998920] handle_exit+0x98/0x230 [kvm_amd] Aug 22 08:35:44 juju-e4d256-prod-github-runner-207 kernel: [11517.999672] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 08:35:44 juju-e4d256-prod-github-runner-207 kernel: [11518.000456] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 08:35:44 juju-e4d256-prod-github-runner-207 kernel: [11518.001259] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 08:35:44 juju-e4d256-prod-github-runner-207 kernel: [11518.002044] vcpu_run+0x62/0x2c0 [kvm] Aug 22 08:35:44 juju-e4d256-prod-github-runner-207 kernel: [11518.002763] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 08:35:44 juju-e4d256-prod-github-runner-207 kernel: [11518.003508] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 08:35:44 juju-e4d256-prod-github-runner-207 kernel: [11518.004308] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 08:35:44 juju-e4d256-prod-github-runner-207 kernel: [11518.005068] ? __seccomp_filter+0x4a/0x4a0 Aug 22 08:35:44 juju-e4d256-prod-github-runner-207 kernel: [11518.005789] ? __fget_files+0x86/0xc0 Aug 22 08:35:44 juju-e4d256-prod-github-runner-207 kernel: [11518.006483] __x64_sys_ioctl+0x95/0xd0 Aug 22 08:35:44 juju-e4d256-prod-github-runner-207 kernel: [11518.007185] do_syscall_64+0x5c/0xc0 Aug 22 08:35:44 juju-e4d256-prod-github-runner-207 kernel: [11518.007865] ? do_futex+0x162/0x1f0 Aug 22 08:35:44 juju-e4d256-prod-github-runner-207 kernel: [11518.008561] ? __x64_sys_futex+0x78/0x1e0 Aug 22 08:35:44 juju-e4d256-prod-github-runner-207 kernel: [11518.009269] ? __secure_computing+0xa9/0x120 Aug 22 08:35:44 juju-e4d256-prod-github-runner-207 kernel: [11518.009988] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 08:35:44 juju-e4d256-prod-github-runner-207 kernel: [11518.010784] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:35:44 juju-e4d256-prod-github-runner-207 kernel: [11518.011550] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:35:44 juju-e4d256-prod-github-runner-207 kernel: [11518.012300] ? do_syscall_64+0x69/0xc0 Aug 22 08:35:44 juju-e4d256-prod-github-runner-207 kernel: [11518.012992] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:35:44 juju-e4d256-prod-github-runner-207 kernel: [11518.013744] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:35:44 juju-e4d256-prod-github-runner-207 kernel: [11518.014498] ? do_syscall_64+0x69/0xc0 Aug 22 08:35:44 juju-e4d256-prod-github-runner-207 kernel: [11518.015210] ? do_syscall_64+0x69/0xc0 Aug 22 08:35:44 juju-e4d256-prod-github-runner-207 kernel: [11518.015904] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 08:35:44 juju-e4d256-prod-github-runner-207 kernel: [11518.016671] RIP: 0033:0x7faa5d0edaff Aug 22 08:35:44 juju-e4d256-prod-github-runner-207 kernel: [11518.017380] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 08:35:44 juju-e4d256-prod-github-runner-207 kernel: [11518.019484] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 08:35:44 juju-e4d256-prod-github-runner-207 kernel: [11518.020447] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 08:35:44 juju-e4d256-prod-github-runner-207 kernel: [11518.021393] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 08:35:44 juju-e4d256-prod-github-runner-207 kernel: [11518.022336] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 08:35:44 juju-e4d256-prod-github-runner-207 kernel: [11518.023285] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 08:35:44 juju-e4d256-prod-github-runner-207 kernel: [11518.024211] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 08:35:44 juju-e4d256-prod-github-runner-207 kernel: [11518.025129] Aug 22 08:36:10 juju-e4d256-prod-github-runner-207 kernel: [11544.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 10643s! [qemu-system-x86:6715] Aug 22 08:36:10 juju-e4d256-prod-github-runner-207 kernel: [11544.543797] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 08:36:10 juju-e4d256-prod-github-runner-207 kernel: [11544.544071] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 08:36:10 juju-e4d256-prod-github-runner-207 kernel: [11544.556203] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 08:36:10 juju-e4d256-prod-github-runner-207 kernel: [11544.557473] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 08:36:10 juju-e4d256-prod-github-runner-207 kernel: [11544.558702] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:36:10 juju-e4d256-prod-github-runner-207 kernel: [11544.559763] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 08:36:10 juju-e4d256-prod-github-runner-207 kernel: [11544.562319] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 08:36:10 juju-e4d256-prod-github-runner-207 kernel: [11544.563386] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 08:36:10 juju-e4d256-prod-github-runner-207 kernel: [11544.564553] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 08:36:10 juju-e4d256-prod-github-runner-207 kernel: [11544.565716] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 08:36:10 juju-e4d256-prod-github-runner-207 kernel: [11544.566882] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 08:36:10 juju-e4d256-prod-github-runner-207 kernel: [11544.568049] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 08:36:10 juju-e4d256-prod-github-runner-207 kernel: [11544.569225] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 08:36:10 juju-e4d256-prod-github-runner-207 kernel: [11544.570514] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 08:36:10 juju-e4d256-prod-github-runner-207 kernel: [11544.571663] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 08:36:10 juju-e4d256-prod-github-runner-207 kernel: [11544.572860] Call Trace: Aug 22 08:36:10 juju-e4d256-prod-github-runner-207 kernel: [11544.573777] Aug 22 08:36:10 juju-e4d256-prod-github-runner-207 kernel: [11544.574670] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:36:10 juju-e4d256-prod-github-runner-207 kernel: [11544.575699] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:36:10 juju-e4d256-prod-github-runner-207 kernel: [11544.576723] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:36:10 juju-e4d256-prod-github-runner-207 kernel: [11544.577814] ? show_regs.part.0+0x23/0x29 Aug 22 08:36:10 juju-e4d256-prod-github-runner-207 kernel: [11544.578844] ? show_regs.cold+0x8/0xd Aug 22 08:36:10 juju-e4d256-prod-github-runner-207 kernel: [11544.579820] ? watchdog_timer_fn+0x1be/0x220 Aug 22 08:36:10 juju-e4d256-prod-github-runner-207 kernel: [11544.580826] ? lockup_detector_update_enable+0x60/0x60 Aug 22 08:36:10 juju-e4d256-prod-github-runner-207 kernel: [11544.581891] ? __hrtimer_run_queues+0x107/0x230 Aug 22 08:36:10 juju-e4d256-prod-github-runner-207 kernel: [11544.582926] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 08:36:10 juju-e4d256-prod-github-runner-207 kernel: [11544.583954] ? hrtimer_interrupt+0x101/0x220 Aug 22 08:36:10 juju-e4d256-prod-github-runner-207 kernel: [11544.584977] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 08:36:10 juju-e4d256-prod-github-runner-207 kernel: [11544.586050] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 08:36:10 juju-e4d256-prod-github-runner-207 kernel: [11544.587101] Aug 22 08:36:10 juju-e4d256-prod-github-runner-207 kernel: [11544.587959] Aug 22 08:36:10 juju-e4d256-prod-github-runner-207 kernel: [11544.588797] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 08:36:10 juju-e4d256-prod-github-runner-207 kernel: [11544.589837] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:36:10 juju-e4d256-prod-github-runner-207 kernel: [11544.590884] ? _raw_spin_lock+0x22/0x30 Aug 22 08:36:10 juju-e4d256-prod-github-runner-207 kernel: [11544.591826] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:36:10 juju-e4d256-prod-github-runner-207 kernel: [11544.592847] direct_page_fault+0x206/0x310 [kvm] Aug 22 08:36:10 juju-e4d256-prod-github-runner-207 kernel: [11544.593868] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 08:36:10 juju-e4d256-prod-github-runner-207 kernel: [11544.594887] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 08:36:10 juju-e4d256-prod-github-runner-207 kernel: [11544.595890] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 08:36:10 juju-e4d256-prod-github-runner-207 kernel: [11544.596884] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 08:36:10 juju-e4d256-prod-github-runner-207 kernel: [11544.597954] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 08:36:10 juju-e4d256-prod-github-runner-207 kernel: [11544.598977] handle_exit+0x98/0x230 [kvm_amd] Aug 22 08:36:10 juju-e4d256-prod-github-runner-207 kernel: [11544.599869] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 08:36:10 juju-e4d256-prod-github-runner-207 kernel: [11544.600781] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 08:36:10 juju-e4d256-prod-github-runner-207 kernel: [11544.601702] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 08:36:10 juju-e4d256-prod-github-runner-207 kernel: [11544.602618] vcpu_run+0x62/0x2c0 [kvm] Aug 22 08:36:10 juju-e4d256-prod-github-runner-207 kernel: [11544.603432] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 08:36:10 juju-e4d256-prod-github-runner-207 kernel: [11544.604237] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 08:36:10 juju-e4d256-prod-github-runner-207 kernel: [11544.605096] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 08:36:10 juju-e4d256-prod-github-runner-207 kernel: [11544.605900] ? __seccomp_filter+0x4a/0x4a0 Aug 22 08:36:10 juju-e4d256-prod-github-runner-207 kernel: [11544.606655] ? __fget_files+0x86/0xc0 Aug 22 08:36:10 juju-e4d256-prod-github-runner-207 kernel: [11544.607357] __x64_sys_ioctl+0x95/0xd0 Aug 22 08:36:10 juju-e4d256-prod-github-runner-207 kernel: [11544.608052] do_syscall_64+0x5c/0xc0 Aug 22 08:36:10 juju-e4d256-prod-github-runner-207 kernel: [11544.608715] ? do_futex+0x162/0x1f0 Aug 22 08:36:10 juju-e4d256-prod-github-runner-207 kernel: [11544.609371] ? __x64_sys_futex+0x78/0x1e0 Aug 22 08:36:10 juju-e4d256-prod-github-runner-207 kernel: [11544.610045] ? __secure_computing+0xa9/0x120 Aug 22 08:36:10 juju-e4d256-prod-github-runner-207 kernel: [11544.610741] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 08:36:10 juju-e4d256-prod-github-runner-207 kernel: [11544.611499] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:36:10 juju-e4d256-prod-github-runner-207 kernel: [11544.612219] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:36:10 juju-e4d256-prod-github-runner-207 kernel: [11544.612935] ? do_syscall_64+0x69/0xc0 Aug 22 08:36:10 juju-e4d256-prod-github-runner-207 kernel: [11544.613578] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:36:10 juju-e4d256-prod-github-runner-207 kernel: [11544.614279] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:36:10 juju-e4d256-prod-github-runner-207 kernel: [11544.614986] ? do_syscall_64+0x69/0xc0 Aug 22 08:36:10 juju-e4d256-prod-github-runner-207 kernel: [11544.615610] ? do_syscall_64+0x69/0xc0 Aug 22 08:36:10 juju-e4d256-prod-github-runner-207 kernel: [11544.616230] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 08:36:10 juju-e4d256-prod-github-runner-207 kernel: [11544.616933] RIP: 0033:0x7faa5d0edaff Aug 22 08:36:10 juju-e4d256-prod-github-runner-207 kernel: [11544.617556] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 08:36:10 juju-e4d256-prod-github-runner-207 kernel: [11544.619720] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 08:36:10 juju-e4d256-prod-github-runner-207 kernel: [11544.620630] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 08:36:10 juju-e4d256-prod-github-runner-207 kernel: [11544.621522] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 08:36:10 juju-e4d256-prod-github-runner-207 kernel: [11544.622412] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 08:36:10 juju-e4d256-prod-github-runner-207 kernel: [11544.623303] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 08:36:10 juju-e4d256-prod-github-runner-207 kernel: [11544.624192] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 08:36:10 juju-e4d256-prod-github-runner-207 kernel: [11544.625079] Aug 22 08:36:38 juju-e4d256-prod-github-runner-207 kernel: [11572.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 10669s! [qemu-system-x86:6715] Aug 22 08:36:38 juju-e4d256-prod-github-runner-207 kernel: [11572.543107] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 08:36:38 juju-e4d256-prod-github-runner-207 kernel: [11572.543178] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 08:36:38 juju-e4d256-prod-github-runner-207 kernel: [11572.555622] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 08:36:38 juju-e4d256-prod-github-runner-207 kernel: [11572.556907] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 08:36:38 juju-e4d256-prod-github-runner-207 kernel: [11572.558138] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:36:38 juju-e4d256-prod-github-runner-207 kernel: [11572.559222] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 08:36:38 juju-e4d256-prod-github-runner-207 kernel: [11572.561793] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 08:36:38 juju-e4d256-prod-github-runner-207 kernel: [11572.562858] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 08:36:38 juju-e4d256-prod-github-runner-207 kernel: [11572.564336] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 08:36:38 juju-e4d256-prod-github-runner-207 kernel: [11572.565721] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 08:36:38 juju-e4d256-prod-github-runner-207 kernel: [11572.567036] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 08:36:38 juju-e4d256-prod-github-runner-207 kernel: [11572.568447] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 08:36:38 juju-e4d256-prod-github-runner-207 kernel: [11572.569657] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 08:36:38 juju-e4d256-prod-github-runner-207 kernel: [11572.570915] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 08:36:38 juju-e4d256-prod-github-runner-207 kernel: [11572.572031] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 08:36:38 juju-e4d256-prod-github-runner-207 kernel: [11572.573238] Call Trace: Aug 22 08:36:38 juju-e4d256-prod-github-runner-207 kernel: [11572.574152] Aug 22 08:36:38 juju-e4d256-prod-github-runner-207 kernel: [11572.575051] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:36:38 juju-e4d256-prod-github-runner-207 kernel: [11572.576091] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:36:38 juju-e4d256-prod-github-runner-207 kernel: [11572.577119] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:36:38 juju-e4d256-prod-github-runner-207 kernel: [11572.578203] ? show_regs.part.0+0x23/0x29 Aug 22 08:36:38 juju-e4d256-prod-github-runner-207 kernel: [11572.579240] ? show_regs.cold+0x8/0xd Aug 22 08:36:38 juju-e4d256-prod-github-runner-207 kernel: [11572.580222] ? watchdog_timer_fn+0x1be/0x220 Aug 22 08:36:38 juju-e4d256-prod-github-runner-207 kernel: [11572.581272] ? lockup_detector_update_enable+0x60/0x60 Aug 22 08:36:38 juju-e4d256-prod-github-runner-207 kernel: [11572.582361] ? __hrtimer_run_queues+0x107/0x230 Aug 22 08:36:38 juju-e4d256-prod-github-runner-207 kernel: [11572.583398] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 08:36:38 juju-e4d256-prod-github-runner-207 kernel: [11572.584429] ? hrtimer_interrupt+0x101/0x220 Aug 22 08:36:38 juju-e4d256-prod-github-runner-207 kernel: [11572.585491] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 08:36:38 juju-e4d256-prod-github-runner-207 kernel: [11572.586587] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 08:36:38 juju-e4d256-prod-github-runner-207 kernel: [11572.587641] Aug 22 08:36:38 juju-e4d256-prod-github-runner-207 kernel: [11572.588495] Aug 22 08:36:38 juju-e4d256-prod-github-runner-207 kernel: [11572.589337] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 08:36:38 juju-e4d256-prod-github-runner-207 kernel: [11572.590393] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:36:38 juju-e4d256-prod-github-runner-207 kernel: [11572.591443] ? _raw_spin_lock+0x22/0x30 Aug 22 08:36:38 juju-e4d256-prod-github-runner-207 kernel: [11572.592393] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:36:38 juju-e4d256-prod-github-runner-207 kernel: [11572.593427] direct_page_fault+0x206/0x310 [kvm] Aug 22 08:36:38 juju-e4d256-prod-github-runner-207 kernel: [11572.594466] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 08:36:38 juju-e4d256-prod-github-runner-207 kernel: [11572.595479] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 08:36:38 juju-e4d256-prod-github-runner-207 kernel: [11572.596489] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 08:36:38 juju-e4d256-prod-github-runner-207 kernel: [11572.597465] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 08:36:38 juju-e4d256-prod-github-runner-207 kernel: [11572.598425] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 08:36:38 juju-e4d256-prod-github-runner-207 kernel: [11572.599409] handle_exit+0x98/0x230 [kvm_amd] Aug 22 08:36:38 juju-e4d256-prod-github-runner-207 kernel: [11572.600308] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 08:36:38 juju-e4d256-prod-github-runner-207 kernel: [11572.601275] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 08:36:38 juju-e4d256-prod-github-runner-207 kernel: [11572.602210] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 08:36:38 juju-e4d256-prod-github-runner-207 kernel: [11572.603137] vcpu_run+0x62/0x2c0 [kvm] Aug 22 08:36:38 juju-e4d256-prod-github-runner-207 kernel: [11572.603953] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 08:36:38 juju-e4d256-prod-github-runner-207 kernel: [11572.604769] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 08:36:38 juju-e4d256-prod-github-runner-207 kernel: [11572.605630] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 08:36:38 juju-e4d256-prod-github-runner-207 kernel: [11572.606442] ? __seccomp_filter+0x4a/0x4a0 Aug 22 08:36:38 juju-e4d256-prod-github-runner-207 kernel: [11572.607196] ? __fget_files+0x86/0xc0 Aug 22 08:36:38 juju-e4d256-prod-github-runner-207 kernel: [11572.607904] __x64_sys_ioctl+0x95/0xd0 Aug 22 08:36:38 juju-e4d256-prod-github-runner-207 kernel: [11572.608612] do_syscall_64+0x5c/0xc0 Aug 22 08:36:38 juju-e4d256-prod-github-runner-207 kernel: [11572.609281] ? do_futex+0x162/0x1f0 Aug 22 08:36:38 juju-e4d256-prod-github-runner-207 kernel: [11572.609934] ? __x64_sys_futex+0x78/0x1e0 Aug 22 08:36:38 juju-e4d256-prod-github-runner-207 kernel: [11572.610629] ? __secure_computing+0xa9/0x120 Aug 22 08:36:38 juju-e4d256-prod-github-runner-207 kernel: [11572.611326] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 08:36:38 juju-e4d256-prod-github-runner-207 kernel: [11572.612092] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:36:38 juju-e4d256-prod-github-runner-207 kernel: [11572.612821] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:36:38 juju-e4d256-prod-github-runner-207 kernel: [11572.613549] ? do_syscall_64+0x69/0xc0 Aug 22 08:36:38 juju-e4d256-prod-github-runner-207 kernel: [11572.614210] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:36:38 juju-e4d256-prod-github-runner-207 kernel: [11572.614938] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:36:38 juju-e4d256-prod-github-runner-207 kernel: [11572.615647] ? do_syscall_64+0x69/0xc0 Aug 22 08:36:38 juju-e4d256-prod-github-runner-207 kernel: [11572.616281] ? do_syscall_64+0x69/0xc0 Aug 22 08:36:38 juju-e4d256-prod-github-runner-207 kernel: [11572.616909] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 08:36:38 juju-e4d256-prod-github-runner-207 kernel: [11572.617622] RIP: 0033:0x7faa5d0edaff Aug 22 08:36:38 juju-e4d256-prod-github-runner-207 kernel: [11572.618262] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 08:36:38 juju-e4d256-prod-github-runner-207 kernel: [11572.620354] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 08:36:38 juju-e4d256-prod-github-runner-207 kernel: [11572.621331] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 08:36:38 juju-e4d256-prod-github-runner-207 kernel: [11572.622277] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 08:36:38 juju-e4d256-prod-github-runner-207 kernel: [11572.623178] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 08:36:38 juju-e4d256-prod-github-runner-207 kernel: [11572.624125] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 08:36:38 juju-e4d256-prod-github-runner-207 kernel: [11572.625025] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 08:36:38 juju-e4d256-prod-github-runner-207 kernel: [11572.625927] Aug 22 08:37:06 juju-e4d256-prod-github-runner-207 kernel: [11600.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 10695s! [qemu-system-x86:6715] Aug 22 08:37:06 juju-e4d256-prod-github-runner-207 kernel: [11600.543094] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 08:37:06 juju-e4d256-prod-github-runner-207 kernel: [11600.543167] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 08:37:06 juju-e4d256-prod-github-runner-207 kernel: [11600.555341] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 08:37:06 juju-e4d256-prod-github-runner-207 kernel: [11600.556617] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 08:37:06 juju-e4d256-prod-github-runner-207 kernel: [11600.557853] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:37:06 juju-e4d256-prod-github-runner-207 kernel: [11600.558929] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 08:37:06 juju-e4d256-prod-github-runner-207 kernel: [11600.561678] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 08:37:06 juju-e4d256-prod-github-runner-207 kernel: [11600.562756] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 08:37:06 juju-e4d256-prod-github-runner-207 kernel: [11600.563915] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 08:37:06 juju-e4d256-prod-github-runner-207 kernel: [11600.565070] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 08:37:06 juju-e4d256-prod-github-runner-207 kernel: [11600.566242] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 08:37:06 juju-e4d256-prod-github-runner-207 kernel: [11600.567401] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 08:37:06 juju-e4d256-prod-github-runner-207 kernel: [11600.568569] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 08:37:06 juju-e4d256-prod-github-runner-207 kernel: [11600.569799] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 08:37:06 juju-e4d256-prod-github-runner-207 kernel: [11600.570909] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 08:37:06 juju-e4d256-prod-github-runner-207 kernel: [11600.572105] Call Trace: Aug 22 08:37:06 juju-e4d256-prod-github-runner-207 kernel: [11600.573022] Aug 22 08:37:06 juju-e4d256-prod-github-runner-207 kernel: [11600.573937] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:37:06 juju-e4d256-prod-github-runner-207 kernel: [11600.574968] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:37:06 juju-e4d256-prod-github-runner-207 kernel: [11600.575987] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:37:06 juju-e4d256-prod-github-runner-207 kernel: [11600.577063] ? show_regs.part.0+0x23/0x29 Aug 22 08:37:06 juju-e4d256-prod-github-runner-207 kernel: [11600.578083] ? show_regs.cold+0x8/0xd Aug 22 08:37:06 juju-e4d256-prod-github-runner-207 kernel: [11600.579056] ? watchdog_timer_fn+0x1be/0x220 Aug 22 08:37:06 juju-e4d256-prod-github-runner-207 kernel: [11600.580060] ? lockup_detector_update_enable+0x60/0x60 Aug 22 08:37:06 juju-e4d256-prod-github-runner-207 kernel: [11600.581127] ? __hrtimer_run_queues+0x107/0x230 Aug 22 08:37:06 juju-e4d256-prod-github-runner-207 kernel: [11600.582186] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 08:37:06 juju-e4d256-prod-github-runner-207 kernel: [11600.583214] ? hrtimer_interrupt+0x101/0x220 Aug 22 08:37:06 juju-e4d256-prod-github-runner-207 kernel: [11600.584232] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 08:37:06 juju-e4d256-prod-github-runner-207 kernel: [11600.585314] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 08:37:06 juju-e4d256-prod-github-runner-207 kernel: [11600.586379] Aug 22 08:37:06 juju-e4d256-prod-github-runner-207 kernel: [11600.587235] Aug 22 08:37:06 juju-e4d256-prod-github-runner-207 kernel: [11600.588071] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 08:37:06 juju-e4d256-prod-github-runner-207 kernel: [11600.589101] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:37:06 juju-e4d256-prod-github-runner-207 kernel: [11600.590161] ? _raw_spin_lock+0x22/0x30 Aug 22 08:37:06 juju-e4d256-prod-github-runner-207 kernel: [11600.591107] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:37:06 juju-e4d256-prod-github-runner-207 kernel: [11600.592124] direct_page_fault+0x206/0x310 [kvm] Aug 22 08:37:06 juju-e4d256-prod-github-runner-207 kernel: [11600.593147] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 08:37:06 juju-e4d256-prod-github-runner-207 kernel: [11600.594190] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 08:37:06 juju-e4d256-prod-github-runner-207 kernel: [11600.595195] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 08:37:06 juju-e4d256-prod-github-runner-207 kernel: [11600.596175] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 08:37:06 juju-e4d256-prod-github-runner-207 kernel: [11600.597130] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 08:37:06 juju-e4d256-prod-github-runner-207 kernel: [11600.598123] handle_exit+0x98/0x230 [kvm_amd] Aug 22 08:37:06 juju-e4d256-prod-github-runner-207 kernel: [11600.599012] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 08:37:06 juju-e4d256-prod-github-runner-207 kernel: [11600.599922] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 08:37:06 juju-e4d256-prod-github-runner-207 kernel: [11600.600839] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 08:37:06 juju-e4d256-prod-github-runner-207 kernel: [11600.601739] vcpu_run+0x62/0x2c0 [kvm] Aug 22 08:37:06 juju-e4d256-prod-github-runner-207 kernel: [11600.602567] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 08:37:06 juju-e4d256-prod-github-runner-207 kernel: [11600.603406] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 08:37:06 juju-e4d256-prod-github-runner-207 kernel: [11600.604260] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 08:37:06 juju-e4d256-prod-github-runner-207 kernel: [11600.605053] ? __seccomp_filter+0x4a/0x4a0 Aug 22 08:37:06 juju-e4d256-prod-github-runner-207 kernel: [11600.605795] ? __fget_files+0x86/0xc0 Aug 22 08:37:06 juju-e4d256-prod-github-runner-207 kernel: [11600.606555] __x64_sys_ioctl+0x95/0xd0 Aug 22 08:37:06 juju-e4d256-prod-github-runner-207 kernel: [11600.607325] do_syscall_64+0x5c/0xc0 Aug 22 08:37:06 juju-e4d256-prod-github-runner-207 kernel: [11600.608017] ? do_futex+0x162/0x1f0 Aug 22 08:37:06 juju-e4d256-prod-github-runner-207 kernel: [11600.608679] ? __x64_sys_futex+0x78/0x1e0 Aug 22 08:37:06 juju-e4d256-prod-github-runner-207 kernel: [11600.609357] ? __secure_computing+0xa9/0x120 Aug 22 08:37:06 juju-e4d256-prod-github-runner-207 kernel: [11600.610071] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 08:37:06 juju-e4d256-prod-github-runner-207 kernel: [11600.610834] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:37:06 juju-e4d256-prod-github-runner-207 kernel: [11600.611572] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:37:06 juju-e4d256-prod-github-runner-207 kernel: [11600.612291] ? do_syscall_64+0x69/0xc0 Aug 22 08:37:06 juju-e4d256-prod-github-runner-207 kernel: [11600.612936] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:37:06 juju-e4d256-prod-github-runner-207 kernel: [11600.613642] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:37:06 juju-e4d256-prod-github-runner-207 kernel: [11600.614349] ? do_syscall_64+0x69/0xc0 Aug 22 08:37:06 juju-e4d256-prod-github-runner-207 kernel: [11600.614993] ? do_syscall_64+0x69/0xc0 Aug 22 08:37:06 juju-e4d256-prod-github-runner-207 kernel: [11600.615622] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 08:37:06 juju-e4d256-prod-github-runner-207 kernel: [11600.616325] RIP: 0033:0x7faa5d0edaff Aug 22 08:37:06 juju-e4d256-prod-github-runner-207 kernel: [11600.616950] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 08:37:06 juju-e4d256-prod-github-runner-207 kernel: [11600.618952] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 08:37:06 juju-e4d256-prod-github-runner-207 kernel: [11600.619859] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 08:37:06 juju-e4d256-prod-github-runner-207 kernel: [11600.620746] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 08:37:06 juju-e4d256-prod-github-runner-207 kernel: [11600.621631] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 08:37:06 juju-e4d256-prod-github-runner-207 kernel: [11600.622542] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 08:37:06 juju-e4d256-prod-github-runner-207 kernel: [11600.623427] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 08:37:06 juju-e4d256-prod-github-runner-207 kernel: [11600.624322] Aug 22 08:37:34 juju-e4d256-prod-github-runner-207 kernel: [11628.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 10721s! [qemu-system-x86:6715] Aug 22 08:37:34 juju-e4d256-prod-github-runner-207 kernel: [11628.543826] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 08:37:34 juju-e4d256-prod-github-runner-207 kernel: [11628.544099] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 08:37:34 juju-e4d256-prod-github-runner-207 kernel: [11628.557057] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 08:37:34 juju-e4d256-prod-github-runner-207 kernel: [11628.559218] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 08:37:34 juju-e4d256-prod-github-runner-207 kernel: [11628.561167] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:37:34 juju-e4d256-prod-github-runner-207 kernel: [11628.562928] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 08:37:34 juju-e4d256-prod-github-runner-207 kernel: [11628.567079] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 08:37:34 juju-e4d256-prod-github-runner-207 kernel: [11628.568336] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 08:37:34 juju-e4d256-prod-github-runner-207 kernel: [11628.569520] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 08:37:34 juju-e4d256-prod-github-runner-207 kernel: [11628.570709] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 08:37:34 juju-e4d256-prod-github-runner-207 kernel: [11628.571868] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 08:37:34 juju-e4d256-prod-github-runner-207 kernel: [11628.573050] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 08:37:34 juju-e4d256-prod-github-runner-207 kernel: [11628.574240] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 08:37:34 juju-e4d256-prod-github-runner-207 kernel: [11628.575476] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 08:37:34 juju-e4d256-prod-github-runner-207 kernel: [11628.576586] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 08:37:34 juju-e4d256-prod-github-runner-207 kernel: [11628.577809] Call Trace: Aug 22 08:37:34 juju-e4d256-prod-github-runner-207 kernel: [11628.578728] Aug 22 08:37:34 juju-e4d256-prod-github-runner-207 kernel: [11628.579636] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:37:34 juju-e4d256-prod-github-runner-207 kernel: [11628.580729] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:37:34 juju-e4d256-prod-github-runner-207 kernel: [11628.581783] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:37:34 juju-e4d256-prod-github-runner-207 kernel: [11628.582937] ? show_regs.part.0+0x23/0x29 Aug 22 08:37:34 juju-e4d256-prod-github-runner-207 kernel: [11628.583936] ? show_regs.cold+0x8/0xd Aug 22 08:37:34 juju-e4d256-prod-github-runner-207 kernel: [11628.585092] ? watchdog_timer_fn+0x1be/0x220 Aug 22 08:37:34 juju-e4d256-prod-github-runner-207 kernel: [11628.586814] ? lockup_detector_update_enable+0x60/0x60 Aug 22 08:37:34 juju-e4d256-prod-github-runner-207 kernel: [11628.588551] ? __hrtimer_run_queues+0x107/0x230 Aug 22 08:37:34 juju-e4d256-prod-github-runner-207 kernel: [11628.590233] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 08:37:34 juju-e4d256-prod-github-runner-207 kernel: [11628.592003] ? hrtimer_interrupt+0x101/0x220 Aug 22 08:37:34 juju-e4d256-prod-github-runner-207 kernel: [11628.593750] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 08:37:34 juju-e4d256-prod-github-runner-207 kernel: [11628.595545] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 08:37:34 juju-e4d256-prod-github-runner-207 kernel: [11628.597021] Aug 22 08:37:34 juju-e4d256-prod-github-runner-207 kernel: [11628.597915] Aug 22 08:37:34 juju-e4d256-prod-github-runner-207 kernel: [11628.598765] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 08:37:34 juju-e4d256-prod-github-runner-207 kernel: [11628.599805] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:37:34 juju-e4d256-prod-github-runner-207 kernel: [11628.600872] ? _raw_spin_lock+0x22/0x30 Aug 22 08:37:34 juju-e4d256-prod-github-runner-207 kernel: [11628.601845] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:37:34 juju-e4d256-prod-github-runner-207 kernel: [11628.602883] direct_page_fault+0x206/0x310 [kvm] Aug 22 08:37:34 juju-e4d256-prod-github-runner-207 kernel: [11628.603916] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 08:37:34 juju-e4d256-prod-github-runner-207 kernel: [11628.605138] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 08:37:34 juju-e4d256-prod-github-runner-207 kernel: [11628.606174] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 08:37:34 juju-e4d256-prod-github-runner-207 kernel: [11628.607195] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 08:37:34 juju-e4d256-prod-github-runner-207 kernel: [11628.608143] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 08:37:34 juju-e4d256-prod-github-runner-207 kernel: [11628.609136] handle_exit+0x98/0x230 [kvm_amd] Aug 22 08:37:34 juju-e4d256-prod-github-runner-207 kernel: [11628.610099] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 08:37:34 juju-e4d256-prod-github-runner-207 kernel: [11628.611027] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 08:37:34 juju-e4d256-prod-github-runner-207 kernel: [11628.611960] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 08:37:34 juju-e4d256-prod-github-runner-207 kernel: [11628.612873] vcpu_run+0x62/0x2c0 [kvm] Aug 22 08:37:34 juju-e4d256-prod-github-runner-207 kernel: [11628.613706] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 08:37:34 juju-e4d256-prod-github-runner-207 kernel: [11628.614538] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 08:37:34 juju-e4d256-prod-github-runner-207 kernel: [11628.615598] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 08:37:34 juju-e4d256-prod-github-runner-207 kernel: [11628.616892] ? __seccomp_filter+0x4a/0x4a0 Aug 22 08:37:34 juju-e4d256-prod-github-runner-207 kernel: [11628.618116] ? __fget_files+0x86/0xc0 Aug 22 08:37:34 juju-e4d256-prod-github-runner-207 kernel: [11628.619284] __x64_sys_ioctl+0x95/0xd0 Aug 22 08:37:34 juju-e4d256-prod-github-runner-207 kernel: [11628.620418] do_syscall_64+0x5c/0xc0 Aug 22 08:37:34 juju-e4d256-prod-github-runner-207 kernel: [11628.621487] ? do_futex+0x162/0x1f0 Aug 22 08:37:34 juju-e4d256-prod-github-runner-207 kernel: [11628.622591] ? __x64_sys_futex+0x78/0x1e0 Aug 22 08:37:34 juju-e4d256-prod-github-runner-207 kernel: [11628.623900] ? __secure_computing+0xa9/0x120 Aug 22 08:37:34 juju-e4d256-prod-github-runner-207 kernel: [11628.625020] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 08:37:34 juju-e4d256-prod-github-runner-207 kernel: [11628.626293] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:37:34 juju-e4d256-prod-github-runner-207 kernel: [11628.627704] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:37:34 juju-e4d256-prod-github-runner-207 kernel: [11628.628847] ? do_syscall_64+0x69/0xc0 Aug 22 08:37:34 juju-e4d256-prod-github-runner-207 kernel: [11628.629712] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:37:34 juju-e4d256-prod-github-runner-207 kernel: [11628.630433] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:37:34 juju-e4d256-prod-github-runner-207 kernel: [11628.631141] ? do_syscall_64+0x69/0xc0 Aug 22 08:37:34 juju-e4d256-prod-github-runner-207 kernel: [11628.631774] ? do_syscall_64+0x69/0xc0 Aug 22 08:37:34 juju-e4d256-prod-github-runner-207 kernel: [11628.632403] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 08:37:34 juju-e4d256-prod-github-runner-207 kernel: [11628.633126] RIP: 0033:0x7faa5d0edaff Aug 22 08:37:34 juju-e4d256-prod-github-runner-207 kernel: [11628.633855] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 08:37:34 juju-e4d256-prod-github-runner-207 kernel: [11628.635865] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 08:37:34 juju-e4d256-prod-github-runner-207 kernel: [11628.636798] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 08:37:34 juju-e4d256-prod-github-runner-207 kernel: [11628.637709] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 08:37:34 juju-e4d256-prod-github-runner-207 kernel: [11628.638614] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 08:37:34 juju-e4d256-prod-github-runner-207 kernel: [11628.639517] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 08:37:34 juju-e4d256-prod-github-runner-207 kernel: [11628.640415] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 08:37:34 juju-e4d256-prod-github-runner-207 kernel: [11628.641320] Aug 22 08:38:02 juju-e4d256-prod-github-runner-207 kernel: [11656.541980] watchdog: BUG: soft lockup - CPU#1 stuck for 10748s! [qemu-system-x86:6715] Aug 22 08:38:02 juju-e4d256-prod-github-runner-207 kernel: [11656.543126] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 08:38:02 juju-e4d256-prod-github-runner-207 kernel: [11656.543202] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 08:38:02 juju-e4d256-prod-github-runner-207 kernel: [11656.555401] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 08:38:02 juju-e4d256-prod-github-runner-207 kernel: [11656.556670] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 08:38:02 juju-e4d256-prod-github-runner-207 kernel: [11656.557934] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:38:02 juju-e4d256-prod-github-runner-207 kernel: [11656.558996] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 08:38:02 juju-e4d256-prod-github-runner-207 kernel: [11656.561642] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 08:38:02 juju-e4d256-prod-github-runner-207 kernel: [11656.562700] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 08:38:02 juju-e4d256-prod-github-runner-207 kernel: [11656.563882] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 08:38:02 juju-e4d256-prod-github-runner-207 kernel: [11656.565064] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 08:38:02 juju-e4d256-prod-github-runner-207 kernel: [11656.566342] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 08:38:02 juju-e4d256-prod-github-runner-207 kernel: [11656.567606] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 08:38:02 juju-e4d256-prod-github-runner-207 kernel: [11656.568821] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 08:38:02 juju-e4d256-prod-github-runner-207 kernel: [11656.570102] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 08:38:02 juju-e4d256-prod-github-runner-207 kernel: [11656.571220] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 08:38:02 juju-e4d256-prod-github-runner-207 kernel: [11656.572448] Call Trace: Aug 22 08:38:02 juju-e4d256-prod-github-runner-207 kernel: [11656.573402] Aug 22 08:38:02 juju-e4d256-prod-github-runner-207 kernel: [11656.574314] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:38:02 juju-e4d256-prod-github-runner-207 kernel: [11656.575361] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:38:02 juju-e4d256-prod-github-runner-207 kernel: [11656.576386] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:38:02 juju-e4d256-prod-github-runner-207 kernel: [11656.577493] ? show_regs.part.0+0x23/0x29 Aug 22 08:38:02 juju-e4d256-prod-github-runner-207 kernel: [11656.578497] ? show_regs.cold+0x8/0xd Aug 22 08:38:02 juju-e4d256-prod-github-runner-207 kernel: [11656.579467] ? watchdog_timer_fn+0x1be/0x220 Aug 22 08:38:02 juju-e4d256-prod-github-runner-207 kernel: [11656.580479] ? lockup_detector_update_enable+0x60/0x60 Aug 22 08:38:02 juju-e4d256-prod-github-runner-207 kernel: [11656.581566] ? __hrtimer_run_queues+0x107/0x230 Aug 22 08:38:02 juju-e4d256-prod-github-runner-207 kernel: [11656.582620] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 08:38:02 juju-e4d256-prod-github-runner-207 kernel: [11656.583647] ? hrtimer_interrupt+0x101/0x220 Aug 22 08:38:02 juju-e4d256-prod-github-runner-207 kernel: [11656.584684] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 08:38:02 juju-e4d256-prod-github-runner-207 kernel: [11656.585790] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 08:38:02 juju-e4d256-prod-github-runner-207 kernel: [11656.586839] Aug 22 08:38:02 juju-e4d256-prod-github-runner-207 kernel: [11656.587691] Aug 22 08:38:02 juju-e4d256-prod-github-runner-207 kernel: [11656.588527] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 08:38:02 juju-e4d256-prod-github-runner-207 kernel: [11656.589578] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:38:02 juju-e4d256-prod-github-runner-207 kernel: [11656.590618] ? _raw_spin_lock+0x22/0x30 Aug 22 08:38:02 juju-e4d256-prod-github-runner-207 kernel: [11656.591563] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:38:02 juju-e4d256-prod-github-runner-207 kernel: [11656.592609] direct_page_fault+0x206/0x310 [kvm] Aug 22 08:38:02 juju-e4d256-prod-github-runner-207 kernel: [11656.593656] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 08:38:02 juju-e4d256-prod-github-runner-207 kernel: [11656.594667] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 08:38:02 juju-e4d256-prod-github-runner-207 kernel: [11656.595704] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 08:38:02 juju-e4d256-prod-github-runner-207 kernel: [11656.596926] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 08:38:02 juju-e4d256-prod-github-runner-207 kernel: [11656.597890] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 08:38:02 juju-e4d256-prod-github-runner-207 kernel: [11656.598868] handle_exit+0x98/0x230 [kvm_amd] Aug 22 08:38:02 juju-e4d256-prod-github-runner-207 kernel: [11656.599760] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 08:38:02 juju-e4d256-prod-github-runner-207 kernel: [11656.600673] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 08:38:02 juju-e4d256-prod-github-runner-207 kernel: [11656.601612] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 08:38:02 juju-e4d256-prod-github-runner-207 kernel: [11656.602611] vcpu_run+0x62/0x2c0 [kvm] Aug 22 08:38:02 juju-e4d256-prod-github-runner-207 kernel: [11656.603440] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 08:38:02 juju-e4d256-prod-github-runner-207 kernel: [11656.604320] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 08:38:02 juju-e4d256-prod-github-runner-207 kernel: [11656.605263] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 08:38:02 juju-e4d256-prod-github-runner-207 kernel: [11656.606081] ? __seccomp_filter+0x4a/0x4a0 Aug 22 08:38:02 juju-e4d256-prod-github-runner-207 kernel: [11656.606828] ? __fget_files+0x86/0xc0 Aug 22 08:38:02 juju-e4d256-prod-github-runner-207 kernel: [11656.607534] __x64_sys_ioctl+0x95/0xd0 Aug 22 08:38:02 juju-e4d256-prod-github-runner-207 kernel: [11656.608240] do_syscall_64+0x5c/0xc0 Aug 22 08:38:02 juju-e4d256-prod-github-runner-207 kernel: [11656.608911] ? do_futex+0x162/0x1f0 Aug 22 08:38:02 juju-e4d256-prod-github-runner-207 kernel: [11656.609579] ? __x64_sys_futex+0x78/0x1e0 Aug 22 08:38:02 juju-e4d256-prod-github-runner-207 kernel: [11656.610259] ? __secure_computing+0xa9/0x120 Aug 22 08:38:02 juju-e4d256-prod-github-runner-207 kernel: [11656.610954] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 08:38:02 juju-e4d256-prod-github-runner-207 kernel: [11656.611715] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:38:02 juju-e4d256-prod-github-runner-207 kernel: [11656.612445] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:38:02 juju-e4d256-prod-github-runner-207 kernel: [11656.613233] ? do_syscall_64+0x69/0xc0 Aug 22 08:38:02 juju-e4d256-prod-github-runner-207 kernel: [11656.613883] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:38:02 juju-e4d256-prod-github-runner-207 kernel: [11656.614587] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:38:02 juju-e4d256-prod-github-runner-207 kernel: [11656.615282] ? do_syscall_64+0x69/0xc0 Aug 22 08:38:02 juju-e4d256-prod-github-runner-207 kernel: [11656.615936] ? do_syscall_64+0x69/0xc0 Aug 22 08:38:02 juju-e4d256-prod-github-runner-207 kernel: [11656.616565] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 08:38:02 juju-e4d256-prod-github-runner-207 kernel: [11656.617314] RIP: 0033:0x7faa5d0edaff Aug 22 08:38:02 juju-e4d256-prod-github-runner-207 kernel: [11656.617953] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 08:38:02 juju-e4d256-prod-github-runner-207 kernel: [11656.620028] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 08:38:02 juju-e4d256-prod-github-runner-207 kernel: [11656.620962] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 08:38:02 juju-e4d256-prod-github-runner-207 kernel: [11656.621864] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 08:38:02 juju-e4d256-prod-github-runner-207 kernel: [11656.622755] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 08:38:02 juju-e4d256-prod-github-runner-207 kernel: [11656.623678] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 08:38:02 juju-e4d256-prod-github-runner-207 kernel: [11656.624581] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 08:38:02 juju-e4d256-prod-github-runner-207 kernel: [11656.625496] Aug 22 08:38:30 juju-e4d256-prod-github-runner-207 kernel: [11684.541983] watchdog: BUG: soft lockup - CPU#1 stuck for 10774s! [qemu-system-x86:6715] Aug 22 08:38:30 juju-e4d256-prod-github-runner-207 kernel: [11684.543557] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 08:38:30 juju-e4d256-prod-github-runner-207 kernel: [11684.543648] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 08:38:30 juju-e4d256-prod-github-runner-207 kernel: [11684.556066] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 08:38:30 juju-e4d256-prod-github-runner-207 kernel: [11684.557383] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 08:38:30 juju-e4d256-prod-github-runner-207 kernel: [11684.558623] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:38:30 juju-e4d256-prod-github-runner-207 kernel: [11684.559728] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 08:38:30 juju-e4d256-prod-github-runner-207 kernel: [11684.562323] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 08:38:30 juju-e4d256-prod-github-runner-207 kernel: [11684.563378] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 08:38:30 juju-e4d256-prod-github-runner-207 kernel: [11684.564555] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 08:38:30 juju-e4d256-prod-github-runner-207 kernel: [11684.565767] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 08:38:30 juju-e4d256-prod-github-runner-207 kernel: [11684.566952] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 08:38:30 juju-e4d256-prod-github-runner-207 kernel: [11684.568128] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 08:38:30 juju-e4d256-prod-github-runner-207 kernel: [11684.569323] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 08:38:30 juju-e4d256-prod-github-runner-207 kernel: [11684.570577] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 08:38:30 juju-e4d256-prod-github-runner-207 kernel: [11684.571689] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 08:38:30 juju-e4d256-prod-github-runner-207 kernel: [11684.572937] Call Trace: Aug 22 08:38:30 juju-e4d256-prod-github-runner-207 kernel: [11684.573876] Aug 22 08:38:30 juju-e4d256-prod-github-runner-207 kernel: [11684.574775] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:38:30 juju-e4d256-prod-github-runner-207 kernel: [11684.575813] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:38:30 juju-e4d256-prod-github-runner-207 kernel: [11684.576871] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:38:30 juju-e4d256-prod-github-runner-207 kernel: [11684.578039] ? show_regs.part.0+0x23/0x29 Aug 22 08:38:30 juju-e4d256-prod-github-runner-207 kernel: [11684.579051] ? show_regs.cold+0x8/0xd Aug 22 08:38:30 juju-e4d256-prod-github-runner-207 kernel: [11684.580027] ? watchdog_timer_fn+0x1be/0x220 Aug 22 08:38:30 juju-e4d256-prod-github-runner-207 kernel: [11684.581062] ? lockup_detector_update_enable+0x60/0x60 Aug 22 08:38:30 juju-e4d256-prod-github-runner-207 kernel: [11684.582141] ? __hrtimer_run_queues+0x107/0x230 Aug 22 08:38:30 juju-e4d256-prod-github-runner-207 kernel: [11684.583172] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 08:38:30 juju-e4d256-prod-github-runner-207 kernel: [11684.584197] ? hrtimer_interrupt+0x101/0x220 Aug 22 08:38:30 juju-e4d256-prod-github-runner-207 kernel: [11684.585266] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 08:38:30 juju-e4d256-prod-github-runner-207 kernel: [11684.586481] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 08:38:30 juju-e4d256-prod-github-runner-207 kernel: [11684.587555] Aug 22 08:38:30 juju-e4d256-prod-github-runner-207 kernel: [11684.588423] Aug 22 08:38:30 juju-e4d256-prod-github-runner-207 kernel: [11684.589294] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 08:38:30 juju-e4d256-prod-github-runner-207 kernel: [11684.590348] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:38:30 juju-e4d256-prod-github-runner-207 kernel: [11684.591454] ? _raw_spin_lock+0x22/0x30 Aug 22 08:38:30 juju-e4d256-prod-github-runner-207 kernel: [11684.592421] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:38:30 juju-e4d256-prod-github-runner-207 kernel: [11684.593484] direct_page_fault+0x206/0x310 [kvm] Aug 22 08:38:30 juju-e4d256-prod-github-runner-207 kernel: [11684.594522] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 08:38:30 juju-e4d256-prod-github-runner-207 kernel: [11684.595548] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 08:38:30 juju-e4d256-prod-github-runner-207 kernel: [11684.596597] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 08:38:30 juju-e4d256-prod-github-runner-207 kernel: [11684.597603] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 08:38:30 juju-e4d256-prod-github-runner-207 kernel: [11684.598554] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 08:38:30 juju-e4d256-prod-github-runner-207 kernel: [11684.599537] handle_exit+0x98/0x230 [kvm_amd] Aug 22 08:38:30 juju-e4d256-prod-github-runner-207 kernel: [11684.600451] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 08:38:30 juju-e4d256-prod-github-runner-207 kernel: [11684.601412] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 08:38:30 juju-e4d256-prod-github-runner-207 kernel: [11684.602388] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 08:38:30 juju-e4d256-prod-github-runner-207 kernel: [11684.603297] vcpu_run+0x62/0x2c0 [kvm] Aug 22 08:38:30 juju-e4d256-prod-github-runner-207 kernel: [11684.604113] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 08:38:30 juju-e4d256-prod-github-runner-207 kernel: [11684.604948] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 08:38:30 juju-e4d256-prod-github-runner-207 kernel: [11684.605838] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 08:38:30 juju-e4d256-prod-github-runner-207 kernel: [11684.606663] ? __seccomp_filter+0x4a/0x4a0 Aug 22 08:38:30 juju-e4d256-prod-github-runner-207 kernel: [11684.607441] ? __fget_files+0x86/0xc0 Aug 22 08:38:30 juju-e4d256-prod-github-runner-207 kernel: [11684.608153] __x64_sys_ioctl+0x95/0xd0 Aug 22 08:38:30 juju-e4d256-prod-github-runner-207 kernel: [11684.608875] do_syscall_64+0x5c/0xc0 Aug 22 08:38:30 juju-e4d256-prod-github-runner-207 kernel: [11684.609548] ? do_futex+0x162/0x1f0 Aug 22 08:38:30 juju-e4d256-prod-github-runner-207 kernel: [11684.610204] ? __x64_sys_futex+0x78/0x1e0 Aug 22 08:38:30 juju-e4d256-prod-github-runner-207 kernel: [11684.610910] ? __secure_computing+0xa9/0x120 Aug 22 08:38:30 juju-e4d256-prod-github-runner-207 kernel: [11684.611615] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 08:38:30 juju-e4d256-prod-github-runner-207 kernel: [11684.612565] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:38:30 juju-e4d256-prod-github-runner-207 kernel: [11684.613766] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:38:30 juju-e4d256-prod-github-runner-207 kernel: [11684.614867] ? do_syscall_64+0x69/0xc0 Aug 22 08:38:30 juju-e4d256-prod-github-runner-207 kernel: [11684.615774] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:38:30 juju-e4d256-prod-github-runner-207 kernel: [11684.616606] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:38:30 juju-e4d256-prod-github-runner-207 kernel: [11684.617348] ? do_syscall_64+0x69/0xc0 Aug 22 08:38:30 juju-e4d256-prod-github-runner-207 kernel: [11684.617989] ? do_syscall_64+0x69/0xc0 Aug 22 08:38:30 juju-e4d256-prod-github-runner-207 kernel: [11684.618625] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 08:38:30 juju-e4d256-prod-github-runner-207 kernel: [11684.619341] RIP: 0033:0x7faa5d0edaff Aug 22 08:38:30 juju-e4d256-prod-github-runner-207 kernel: [11684.619972] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 08:38:30 juju-e4d256-prod-github-runner-207 kernel: [11684.621995] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 08:38:30 juju-e4d256-prod-github-runner-207 kernel: [11684.622917] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 08:38:30 juju-e4d256-prod-github-runner-207 kernel: [11684.623817] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 08:38:30 juju-e4d256-prod-github-runner-207 kernel: [11684.624713] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 08:38:30 juju-e4d256-prod-github-runner-207 kernel: [11684.625635] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 08:38:30 juju-e4d256-prod-github-runner-207 kernel: [11684.626531] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 08:38:30 juju-e4d256-prod-github-runner-207 kernel: [11684.627432] Aug 22 08:38:44 juju-e4d256-prod-github-runner-207 kernel: [11697.968705] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 08:38:44 juju-e4d256-prod-github-runner-207 kernel: [11697.969719] rcu: 1-....: (2886110 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=1394986 Aug 22 08:38:44 juju-e4d256-prod-github-runner-207 kernel: [11697.970837] (t=2895192 jiffies g=23269 q=19942) Aug 22 08:38:44 juju-e4d256-prod-github-runner-207 kernel: [11697.971621] NMI backtrace for cpu 1 Aug 22 08:38:44 juju-e4d256-prod-github-runner-207 kernel: [11697.972329] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 08:38:44 juju-e4d256-prod-github-runner-207 kernel: [11697.973542] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 08:38:44 juju-e4d256-prod-github-runner-207 kernel: [11697.974696] Call Trace: Aug 22 08:38:44 juju-e4d256-prod-github-runner-207 kernel: [11697.975371] Aug 22 08:38:44 juju-e4d256-prod-github-runner-207 kernel: [11697.976016] show_stack+0x52/0x5c Aug 22 08:38:44 juju-e4d256-prod-github-runner-207 kernel: [11697.976755] dump_stack_lvl+0x4a/0x63 Aug 22 08:38:44 juju-e4d256-prod-github-runner-207 kernel: [11697.977516] dump_stack+0x10/0x16 Aug 22 08:38:44 juju-e4d256-prod-github-runner-207 kernel: [11697.978231] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 08:38:44 juju-e4d256-prod-github-runner-207 kernel: [11697.979007] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 08:38:44 juju-e4d256-prod-github-runner-207 kernel: [11697.979780] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 08:38:44 juju-e4d256-prod-github-runner-207 kernel: [11697.980594] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 08:38:44 juju-e4d256-prod-github-runner-207 kernel: [11697.981425] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 08:38:44 juju-e4d256-prod-github-runner-207 kernel: [11697.982227] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 08:38:44 juju-e4d256-prod-github-runner-207 kernel: [11697.982993] print_cpu_stall.cold+0x2f/0xe2 Aug 22 08:38:44 juju-e4d256-prod-github-runner-207 kernel: [11697.983752] ? timekeeping_update+0xf7/0x150 Aug 22 08:38:44 juju-e4d256-prod-github-runner-207 kernel: [11697.984517] check_cpu_stall+0x109/0x270 Aug 22 08:38:44 juju-e4d256-prod-github-runner-207 kernel: [11697.985269] rcu_sched_clock_irq+0x9a/0x250 Aug 22 08:38:44 juju-e4d256-prod-github-runner-207 kernel: [11697.986026] update_process_times+0x94/0xd0 Aug 22 08:38:44 juju-e4d256-prod-github-runner-207 kernel: [11697.986782] tick_sched_handle+0x29/0x70 Aug 22 08:38:44 juju-e4d256-prod-github-runner-207 kernel: [11697.987524] tick_sched_timer+0x8c/0xc0 Aug 22 08:38:44 juju-e4d256-prod-github-runner-207 kernel: [11697.988258] ? tick_nohz_handler+0xb0/0xb0 Aug 22 08:38:44 juju-e4d256-prod-github-runner-207 kernel: [11697.989025] __hrtimer_run_queues+0x107/0x230 Aug 22 08:38:44 juju-e4d256-prod-github-runner-207 kernel: [11697.989795] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 08:38:44 juju-e4d256-prod-github-runner-207 kernel: [11697.990565] hrtimer_interrupt+0x101/0x220 Aug 22 08:38:44 juju-e4d256-prod-github-runner-207 kernel: [11697.991327] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 08:38:44 juju-e4d256-prod-github-runner-207 kernel: [11697.992134] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 08:38:44 juju-e4d256-prod-github-runner-207 kernel: [11697.992945] Aug 22 08:38:44 juju-e4d256-prod-github-runner-207 kernel: [11697.993579] Aug 22 08:38:44 juju-e4d256-prod-github-runner-207 kernel: [11697.994205] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 08:38:44 juju-e4d256-prod-github-runner-207 kernel: [11697.995019] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:38:44 juju-e4d256-prod-github-runner-207 kernel: [11697.995896] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 08:38:44 juju-e4d256-prod-github-runner-207 kernel: [11697.998121] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 08:38:44 juju-e4d256-prod-github-runner-207 kernel: [11697.998995] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 08:38:44 juju-e4d256-prod-github-runner-207 kernel: [11697.999986] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 08:38:44 juju-e4d256-prod-github-runner-207 kernel: [11698.000974] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 08:38:44 juju-e4d256-prod-github-runner-207 kernel: [11698.001949] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 08:38:44 juju-e4d256-prod-github-runner-207 kernel: [11698.002902] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 08:38:44 juju-e4d256-prod-github-runner-207 kernel: [11698.003853] ? _raw_spin_lock+0x22/0x30 Aug 22 08:38:44 juju-e4d256-prod-github-runner-207 kernel: [11698.004617] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:38:44 juju-e4d256-prod-github-runner-207 kernel: [11698.005463] direct_page_fault+0x206/0x310 [kvm] Aug 22 08:38:44 juju-e4d256-prod-github-runner-207 kernel: [11698.006299] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 08:38:44 juju-e4d256-prod-github-runner-207 kernel: [11698.007125] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 08:38:44 juju-e4d256-prod-github-runner-207 kernel: [11698.007947] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 08:38:44 juju-e4d256-prod-github-runner-207 kernel: [11698.008805] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 08:38:44 juju-e4d256-prod-github-runner-207 kernel: [11698.009590] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 08:38:44 juju-e4d256-prod-github-runner-207 kernel: [11698.010410] handle_exit+0x98/0x230 [kvm_amd] Aug 22 08:38:44 juju-e4d256-prod-github-runner-207 kernel: [11698.011169] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 08:38:44 juju-e4d256-prod-github-runner-207 kernel: [11698.011979] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 08:38:44 juju-e4d256-prod-github-runner-207 kernel: [11698.012804] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 08:38:44 juju-e4d256-prod-github-runner-207 kernel: [11698.013640] vcpu_run+0x62/0x2c0 [kvm] Aug 22 08:38:44 juju-e4d256-prod-github-runner-207 kernel: [11698.014403] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 08:38:44 juju-e4d256-prod-github-runner-207 kernel: [11698.015135] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 08:38:44 juju-e4d256-prod-github-runner-207 kernel: [11698.015965] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 08:38:44 juju-e4d256-prod-github-runner-207 kernel: [11698.016746] ? __seccomp_filter+0x4a/0x4a0 Aug 22 08:38:44 juju-e4d256-prod-github-runner-207 kernel: [11698.017490] ? __fget_files+0x86/0xc0 Aug 22 08:38:44 juju-e4d256-prod-github-runner-207 kernel: [11698.018195] __x64_sys_ioctl+0x95/0xd0 Aug 22 08:38:44 juju-e4d256-prod-github-runner-207 kernel: [11698.018917] do_syscall_64+0x5c/0xc0 Aug 22 08:38:44 juju-e4d256-prod-github-runner-207 kernel: [11698.019598] ? do_futex+0x162/0x1f0 Aug 22 08:38:44 juju-e4d256-prod-github-runner-207 kernel: [11698.020270] ? __x64_sys_futex+0x78/0x1e0 Aug 22 08:38:44 juju-e4d256-prod-github-runner-207 kernel: [11698.021011] ? __secure_computing+0xa9/0x120 Aug 22 08:38:44 juju-e4d256-prod-github-runner-207 kernel: [11698.021730] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 08:38:44 juju-e4d256-prod-github-runner-207 kernel: [11698.022519] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:38:44 juju-e4d256-prod-github-runner-207 kernel: [11698.023272] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:38:44 juju-e4d256-prod-github-runner-207 kernel: [11698.024024] ? do_syscall_64+0x69/0xc0 Aug 22 08:38:44 juju-e4d256-prod-github-runner-207 kernel: [11698.024722] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:38:44 juju-e4d256-prod-github-runner-207 kernel: [11698.025478] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:38:44 juju-e4d256-prod-github-runner-207 kernel: [11698.026235] ? do_syscall_64+0x69/0xc0 Aug 22 08:38:44 juju-e4d256-prod-github-runner-207 kernel: [11698.026927] ? do_syscall_64+0x69/0xc0 Aug 22 08:38:44 juju-e4d256-prod-github-runner-207 kernel: [11698.027613] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 08:38:44 juju-e4d256-prod-github-runner-207 kernel: [11698.028381] RIP: 0033:0x7faa5d0edaff Aug 22 08:38:44 juju-e4d256-prod-github-runner-207 kernel: [11698.029070] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 08:38:44 juju-e4d256-prod-github-runner-207 kernel: [11698.031163] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 08:38:44 juju-e4d256-prod-github-runner-207 kernel: [11698.032124] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 08:38:44 juju-e4d256-prod-github-runner-207 kernel: [11698.033114] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 08:38:44 juju-e4d256-prod-github-runner-207 kernel: [11698.034061] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 08:38:44 juju-e4d256-prod-github-runner-207 kernel: [11698.034999] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 08:38:44 juju-e4d256-prod-github-runner-207 kernel: [11698.035921] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 08:38:44 juju-e4d256-prod-github-runner-207 kernel: [11698.036843] Aug 22 08:39:10 juju-e4d256-prod-github-runner-207 kernel: [11724.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 10811s! [qemu-system-x86:6715] Aug 22 08:39:10 juju-e4d256-prod-github-runner-207 kernel: [11724.543789] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 08:39:10 juju-e4d256-prod-github-runner-207 kernel: [11724.544071] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 08:39:10 juju-e4d256-prod-github-runner-207 kernel: [11724.556607] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 08:39:10 juju-e4d256-prod-github-runner-207 kernel: [11724.557909] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 08:39:10 juju-e4d256-prod-github-runner-207 kernel: [11724.559150] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:39:10 juju-e4d256-prod-github-runner-207 kernel: [11724.560219] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 08:39:10 juju-e4d256-prod-github-runner-207 kernel: [11724.562805] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 08:39:10 juju-e4d256-prod-github-runner-207 kernel: [11724.563854] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 08:39:10 juju-e4d256-prod-github-runner-207 kernel: [11724.565042] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 08:39:10 juju-e4d256-prod-github-runner-207 kernel: [11724.566241] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 08:39:10 juju-e4d256-prod-github-runner-207 kernel: [11724.567439] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 08:39:10 juju-e4d256-prod-github-runner-207 kernel: [11724.568633] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 08:39:10 juju-e4d256-prod-github-runner-207 kernel: [11724.569841] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 08:39:10 juju-e4d256-prod-github-runner-207 kernel: [11724.571104] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 08:39:10 juju-e4d256-prod-github-runner-207 kernel: [11724.572209] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 08:39:10 juju-e4d256-prod-github-runner-207 kernel: [11724.573421] Call Trace: Aug 22 08:39:10 juju-e4d256-prod-github-runner-207 kernel: [11724.574335] Aug 22 08:39:10 juju-e4d256-prod-github-runner-207 kernel: [11724.575276] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:39:10 juju-e4d256-prod-github-runner-207 kernel: [11724.576381] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:39:10 juju-e4d256-prod-github-runner-207 kernel: [11724.577472] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:39:10 juju-e4d256-prod-github-runner-207 kernel: [11724.578588] ? show_regs.part.0+0x23/0x29 Aug 22 08:39:10 juju-e4d256-prod-github-runner-207 kernel: [11724.579626] ? show_regs.cold+0x8/0xd Aug 22 08:39:10 juju-e4d256-prod-github-runner-207 kernel: [11724.580660] ? watchdog_timer_fn+0x1be/0x220 Aug 22 08:39:10 juju-e4d256-prod-github-runner-207 kernel: [11724.581740] ? lockup_detector_update_enable+0x60/0x60 Aug 22 08:39:10 juju-e4d256-prod-github-runner-207 kernel: [11724.582814] ? __hrtimer_run_queues+0x107/0x230 Aug 22 08:39:10 juju-e4d256-prod-github-runner-207 kernel: [11724.583855] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 08:39:10 juju-e4d256-prod-github-runner-207 kernel: [11724.584904] ? hrtimer_interrupt+0x101/0x220 Aug 22 08:39:10 juju-e4d256-prod-github-runner-207 kernel: [11724.585926] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 08:39:10 juju-e4d256-prod-github-runner-207 kernel: [11724.587008] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 08:39:10 juju-e4d256-prod-github-runner-207 kernel: [11724.588089] Aug 22 08:39:10 juju-e4d256-prod-github-runner-207 kernel: [11724.588991] Aug 22 08:39:10 juju-e4d256-prod-github-runner-207 kernel: [11724.589869] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 08:39:10 juju-e4d256-prod-github-runner-207 kernel: [11724.590934] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:39:10 juju-e4d256-prod-github-runner-207 kernel: [11724.591990] ? _raw_spin_lock+0x22/0x30 Aug 22 08:39:10 juju-e4d256-prod-github-runner-207 kernel: [11724.592961] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:39:10 juju-e4d256-prod-github-runner-207 kernel: [11724.593989] direct_page_fault+0x206/0x310 [kvm] Aug 22 08:39:10 juju-e4d256-prod-github-runner-207 kernel: [11724.595019] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 08:39:10 juju-e4d256-prod-github-runner-207 kernel: [11724.596078] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 08:39:10 juju-e4d256-prod-github-runner-207 kernel: [11724.597104] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 08:39:10 juju-e4d256-prod-github-runner-207 kernel: [11724.598119] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 08:39:10 juju-e4d256-prod-github-runner-207 kernel: [11724.599074] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 08:39:10 juju-e4d256-prod-github-runner-207 kernel: [11724.600061] handle_exit+0x98/0x230 [kvm_amd] Aug 22 08:39:10 juju-e4d256-prod-github-runner-207 kernel: [11724.600985] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 08:39:10 juju-e4d256-prod-github-runner-207 kernel: [11724.601909] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 08:39:10 juju-e4d256-prod-github-runner-207 kernel: [11724.602848] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 08:39:10 juju-e4d256-prod-github-runner-207 kernel: [11724.603764] vcpu_run+0x62/0x2c0 [kvm] Aug 22 08:39:10 juju-e4d256-prod-github-runner-207 kernel: [11724.604598] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 08:39:10 juju-e4d256-prod-github-runner-207 kernel: [11724.605419] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 08:39:10 juju-e4d256-prod-github-runner-207 kernel: [11724.606282] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 08:39:10 juju-e4d256-prod-github-runner-207 kernel: [11724.607166] ? __seccomp_filter+0x4a/0x4a0 Aug 22 08:39:10 juju-e4d256-prod-github-runner-207 kernel: [11724.607959] ? __fget_files+0x86/0xc0 Aug 22 08:39:10 juju-e4d256-prod-github-runner-207 kernel: [11724.608741] __x64_sys_ioctl+0x95/0xd0 Aug 22 08:39:10 juju-e4d256-prod-github-runner-207 kernel: [11724.609450] do_syscall_64+0x5c/0xc0 Aug 22 08:39:10 juju-e4d256-prod-github-runner-207 kernel: [11724.610194] ? do_futex+0x162/0x1f0 Aug 22 08:39:10 juju-e4d256-prod-github-runner-207 kernel: [11724.610956] ? __x64_sys_futex+0x78/0x1e0 Aug 22 08:39:10 juju-e4d256-prod-github-runner-207 kernel: [11724.611724] ? __secure_computing+0xa9/0x120 Aug 22 08:39:10 juju-e4d256-prod-github-runner-207 kernel: [11724.612457] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 08:39:10 juju-e4d256-prod-github-runner-207 kernel: [11724.613373] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:39:10 juju-e4d256-prod-github-runner-207 kernel: [11724.614349] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:39:10 juju-e4d256-prod-github-runner-207 kernel: [11724.615209] ? do_syscall_64+0x69/0xc0 Aug 22 08:39:10 juju-e4d256-prod-github-runner-207 kernel: [11724.615990] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:39:10 juju-e4d256-prod-github-runner-207 kernel: [11724.616761] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:39:10 juju-e4d256-prod-github-runner-207 kernel: [11724.617550] ? do_syscall_64+0x69/0xc0 Aug 22 08:39:10 juju-e4d256-prod-github-runner-207 kernel: [11724.618191] ? do_syscall_64+0x69/0xc0 Aug 22 08:39:10 juju-e4d256-prod-github-runner-207 kernel: [11724.618823] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 08:39:10 juju-e4d256-prod-github-runner-207 kernel: [11724.619621] RIP: 0033:0x7faa5d0edaff Aug 22 08:39:10 juju-e4d256-prod-github-runner-207 kernel: [11724.620296] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 08:39:10 juju-e4d256-prod-github-runner-207 kernel: [11724.622604] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 08:39:10 juju-e4d256-prod-github-runner-207 kernel: [11724.623540] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 08:39:10 juju-e4d256-prod-github-runner-207 kernel: [11724.624465] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 08:39:10 juju-e4d256-prod-github-runner-207 kernel: [11724.625371] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 08:39:10 juju-e4d256-prod-github-runner-207 kernel: [11724.626273] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 08:39:10 juju-e4d256-prod-github-runner-207 kernel: [11724.627175] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 08:39:10 juju-e4d256-prod-github-runner-207 kernel: [11724.628123] Aug 22 08:39:38 juju-e4d256-prod-github-runner-207 kernel: [11752.542165] watchdog: BUG: soft lockup - CPU#1 stuck for 10837s! [qemu-system-x86:6715] Aug 22 08:39:38 juju-e4d256-prod-github-runner-207 kernel: [11752.543316] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 08:39:38 juju-e4d256-prod-github-runner-207 kernel: [11752.543393] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 08:39:38 juju-e4d256-prod-github-runner-207 kernel: [11752.555747] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 08:39:38 juju-e4d256-prod-github-runner-207 kernel: [11752.557068] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 08:39:38 juju-e4d256-prod-github-runner-207 kernel: [11752.558316] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:39:38 juju-e4d256-prod-github-runner-207 kernel: [11752.559388] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 08:39:38 juju-e4d256-prod-github-runner-207 kernel: [11752.562043] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 08:39:38 juju-e4d256-prod-github-runner-207 kernel: [11752.563098] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 08:39:38 juju-e4d256-prod-github-runner-207 kernel: [11752.564298] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 08:39:38 juju-e4d256-prod-github-runner-207 kernel: [11752.565479] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 08:39:38 juju-e4d256-prod-github-runner-207 kernel: [11752.566657] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 08:39:38 juju-e4d256-prod-github-runner-207 kernel: [11752.567851] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 08:39:38 juju-e4d256-prod-github-runner-207 kernel: [11752.569113] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 08:39:38 juju-e4d256-prod-github-runner-207 kernel: [11752.570373] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 08:39:38 juju-e4d256-prod-github-runner-207 kernel: [11752.571488] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 08:39:38 juju-e4d256-prod-github-runner-207 kernel: [11752.572708] Call Trace: Aug 22 08:39:38 juju-e4d256-prod-github-runner-207 kernel: [11752.573629] Aug 22 08:39:38 juju-e4d256-prod-github-runner-207 kernel: [11752.574517] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:39:38 juju-e4d256-prod-github-runner-207 kernel: [11752.575640] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:39:38 juju-e4d256-prod-github-runner-207 kernel: [11752.576710] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:39:38 juju-e4d256-prod-github-runner-207 kernel: [11752.577804] ? show_regs.part.0+0x23/0x29 Aug 22 08:39:38 juju-e4d256-prod-github-runner-207 kernel: [11752.578817] ? show_regs.cold+0x8/0xd Aug 22 08:39:38 juju-e4d256-prod-github-runner-207 kernel: [11752.579796] ? watchdog_timer_fn+0x1be/0x220 Aug 22 08:39:38 juju-e4d256-prod-github-runner-207 kernel: [11752.580820] ? lockup_detector_update_enable+0x60/0x60 Aug 22 08:39:38 juju-e4d256-prod-github-runner-207 kernel: [11752.581896] ? __hrtimer_run_queues+0x107/0x230 Aug 22 08:39:38 juju-e4d256-prod-github-runner-207 kernel: [11752.582934] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 08:39:38 juju-e4d256-prod-github-runner-207 kernel: [11752.583974] ? hrtimer_interrupt+0x101/0x220 Aug 22 08:39:38 juju-e4d256-prod-github-runner-207 kernel: [11752.585018] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 08:39:38 juju-e4d256-prod-github-runner-207 kernel: [11752.586101] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 08:39:38 juju-e4d256-prod-github-runner-207 kernel: [11752.587157] Aug 22 08:39:38 juju-e4d256-prod-github-runner-207 kernel: [11752.588035] Aug 22 08:39:38 juju-e4d256-prod-github-runner-207 kernel: [11752.588899] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 08:39:38 juju-e4d256-prod-github-runner-207 kernel: [11752.589948] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:39:38 juju-e4d256-prod-github-runner-207 kernel: [11752.590999] ? _raw_spin_lock+0x22/0x30 Aug 22 08:39:38 juju-e4d256-prod-github-runner-207 kernel: [11752.591957] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:39:38 juju-e4d256-prod-github-runner-207 kernel: [11752.592998] direct_page_fault+0x206/0x310 [kvm] Aug 22 08:39:38 juju-e4d256-prod-github-runner-207 kernel: [11752.594047] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 08:39:38 juju-e4d256-prod-github-runner-207 kernel: [11752.595070] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 08:39:38 juju-e4d256-prod-github-runner-207 kernel: [11752.596091] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 08:39:38 juju-e4d256-prod-github-runner-207 kernel: [11752.597071] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 08:39:38 juju-e4d256-prod-github-runner-207 kernel: [11752.598032] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 08:39:38 juju-e4d256-prod-github-runner-207 kernel: [11752.599021] handle_exit+0x98/0x230 [kvm_amd] Aug 22 08:39:38 juju-e4d256-prod-github-runner-207 kernel: [11752.599921] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 08:39:38 juju-e4d256-prod-github-runner-207 kernel: [11752.600857] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 08:39:38 juju-e4d256-prod-github-runner-207 kernel: [11752.601792] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 08:39:38 juju-e4d256-prod-github-runner-207 kernel: [11752.602702] vcpu_run+0x62/0x2c0 [kvm] Aug 22 08:39:38 juju-e4d256-prod-github-runner-207 kernel: [11752.603521] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 08:39:38 juju-e4d256-prod-github-runner-207 kernel: [11752.604351] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 08:39:38 juju-e4d256-prod-github-runner-207 kernel: [11752.605223] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 08:39:38 juju-e4d256-prod-github-runner-207 kernel: [11752.606026] ? __seccomp_filter+0x4a/0x4a0 Aug 22 08:39:38 juju-e4d256-prod-github-runner-207 kernel: [11752.606775] ? __fget_files+0x86/0xc0 Aug 22 08:39:38 juju-e4d256-prod-github-runner-207 kernel: [11752.607485] __x64_sys_ioctl+0x95/0xd0 Aug 22 08:39:38 juju-e4d256-prod-github-runner-207 kernel: [11752.608190] do_syscall_64+0x5c/0xc0 Aug 22 08:39:38 juju-e4d256-prod-github-runner-207 kernel: [11752.608862] ? do_futex+0x162/0x1f0 Aug 22 08:39:38 juju-e4d256-prod-github-runner-207 kernel: [11752.609525] ? __x64_sys_futex+0x78/0x1e0 Aug 22 08:39:38 juju-e4d256-prod-github-runner-207 kernel: [11752.610210] ? __secure_computing+0xa9/0x120 Aug 22 08:39:38 juju-e4d256-prod-github-runner-207 kernel: [11752.610940] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 08:39:38 juju-e4d256-prod-github-runner-207 kernel: [11752.611721] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:39:38 juju-e4d256-prod-github-runner-207 kernel: [11752.612461] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:39:38 juju-e4d256-prod-github-runner-207 kernel: [11752.613190] ? do_syscall_64+0x69/0xc0 Aug 22 08:39:38 juju-e4d256-prod-github-runner-207 kernel: [11752.613845] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:39:38 juju-e4d256-prod-github-runner-207 kernel: [11752.614562] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:39:38 juju-e4d256-prod-github-runner-207 kernel: [11752.615274] ? do_syscall_64+0x69/0xc0 Aug 22 08:39:38 juju-e4d256-prod-github-runner-207 kernel: [11752.615910] ? do_syscall_64+0x69/0xc0 Aug 22 08:39:38 juju-e4d256-prod-github-runner-207 kernel: [11752.616557] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 08:39:38 juju-e4d256-prod-github-runner-207 kernel: [11752.617277] RIP: 0033:0x7faa5d0edaff Aug 22 08:39:38 juju-e4d256-prod-github-runner-207 kernel: [11752.617911] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 08:39:38 juju-e4d256-prod-github-runner-207 kernel: [11752.619963] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 08:39:38 juju-e4d256-prod-github-runner-207 kernel: [11752.620904] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 08:39:38 juju-e4d256-prod-github-runner-207 kernel: [11752.621809] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 08:39:38 juju-e4d256-prod-github-runner-207 kernel: [11752.622710] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 08:39:38 juju-e4d256-prod-github-runner-207 kernel: [11752.623614] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 08:39:38 juju-e4d256-prod-github-runner-207 kernel: [11752.624528] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 08:39:38 juju-e4d256-prod-github-runner-207 kernel: [11752.625439] Aug 22 08:40:06 juju-e4d256-prod-github-runner-207 kernel: [11780.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 10863s! [qemu-system-x86:6715] Aug 22 08:40:06 juju-e4d256-prod-github-runner-207 kernel: [11780.543110] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 08:40:06 juju-e4d256-prod-github-runner-207 kernel: [11780.543185] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 08:40:06 juju-e4d256-prod-github-runner-207 kernel: [11780.555839] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 08:40:06 juju-e4d256-prod-github-runner-207 kernel: [11780.557107] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 08:40:06 juju-e4d256-prod-github-runner-207 kernel: [11780.558339] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:40:06 juju-e4d256-prod-github-runner-207 kernel: [11780.559400] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 08:40:06 juju-e4d256-prod-github-runner-207 kernel: [11780.561969] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 08:40:06 juju-e4d256-prod-github-runner-207 kernel: [11780.563007] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 08:40:06 juju-e4d256-prod-github-runner-207 kernel: [11780.564179] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 08:40:06 juju-e4d256-prod-github-runner-207 kernel: [11780.565341] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 08:40:06 juju-e4d256-prod-github-runner-207 kernel: [11780.566511] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 08:40:06 juju-e4d256-prod-github-runner-207 kernel: [11780.567698] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 08:40:06 juju-e4d256-prod-github-runner-207 kernel: [11780.568866] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 08:40:06 juju-e4d256-prod-github-runner-207 kernel: [11780.570099] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 08:40:06 juju-e4d256-prod-github-runner-207 kernel: [11780.571235] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 08:40:06 juju-e4d256-prod-github-runner-207 kernel: [11780.572463] Call Trace: Aug 22 08:40:06 juju-e4d256-prod-github-runner-207 kernel: [11780.573428] Aug 22 08:40:06 juju-e4d256-prod-github-runner-207 kernel: [11780.574367] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:40:06 juju-e4d256-prod-github-runner-207 kernel: [11780.575457] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:40:06 juju-e4d256-prod-github-runner-207 kernel: [11780.576558] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:40:06 juju-e4d256-prod-github-runner-207 kernel: [11780.577753] ? show_regs.part.0+0x23/0x29 Aug 22 08:40:06 juju-e4d256-prod-github-runner-207 kernel: [11780.578829] ? show_regs.cold+0x8/0xd Aug 22 08:40:06 juju-e4d256-prod-github-runner-207 kernel: [11780.579855] ? watchdog_timer_fn+0x1be/0x220 Aug 22 08:40:06 juju-e4d256-prod-github-runner-207 kernel: [11780.580918] ? lockup_detector_update_enable+0x60/0x60 Aug 22 08:40:06 juju-e4d256-prod-github-runner-207 kernel: [11780.582110] ? __hrtimer_run_queues+0x107/0x230 Aug 22 08:40:06 juju-e4d256-prod-github-runner-207 kernel: [11780.583174] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 08:40:06 juju-e4d256-prod-github-runner-207 kernel: [11780.584270] ? hrtimer_interrupt+0x101/0x220 Aug 22 08:40:06 juju-e4d256-prod-github-runner-207 kernel: [11780.585368] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 08:40:06 juju-e4d256-prod-github-runner-207 kernel: [11780.586462] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 08:40:06 juju-e4d256-prod-github-runner-207 kernel: [11780.587520] Aug 22 08:40:06 juju-e4d256-prod-github-runner-207 kernel: [11780.588394] Aug 22 08:40:06 juju-e4d256-prod-github-runner-207 kernel: [11780.589250] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 08:40:06 juju-e4d256-prod-github-runner-207 kernel: [11780.590288] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:40:06 juju-e4d256-prod-github-runner-207 kernel: [11780.591335] ? _raw_spin_lock+0x22/0x30 Aug 22 08:40:06 juju-e4d256-prod-github-runner-207 kernel: [11780.592300] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:40:06 juju-e4d256-prod-github-runner-207 kernel: [11780.593318] direct_page_fault+0x206/0x310 [kvm] Aug 22 08:40:06 juju-e4d256-prod-github-runner-207 kernel: [11780.594409] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 08:40:06 juju-e4d256-prod-github-runner-207 kernel: [11780.595421] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 08:40:06 juju-e4d256-prod-github-runner-207 kernel: [11780.596462] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 08:40:06 juju-e4d256-prod-github-runner-207 kernel: [11780.597440] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 08:40:06 juju-e4d256-prod-github-runner-207 kernel: [11780.598388] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 08:40:06 juju-e4d256-prod-github-runner-207 kernel: [11780.599404] handle_exit+0x98/0x230 [kvm_amd] Aug 22 08:40:06 juju-e4d256-prod-github-runner-207 kernel: [11780.600346] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 08:40:06 juju-e4d256-prod-github-runner-207 kernel: [11780.601362] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 08:40:06 juju-e4d256-prod-github-runner-207 kernel: [11780.602393] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 08:40:06 juju-e4d256-prod-github-runner-207 kernel: [11780.603346] vcpu_run+0x62/0x2c0 [kvm] Aug 22 08:40:06 juju-e4d256-prod-github-runner-207 kernel: [11780.604233] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 08:40:06 juju-e4d256-prod-github-runner-207 kernel: [11780.605104] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 08:40:06 juju-e4d256-prod-github-runner-207 kernel: [11780.606106] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 08:40:06 juju-e4d256-prod-github-runner-207 kernel: [11780.607028] ? __seccomp_filter+0x4a/0x4a0 Aug 22 08:40:06 juju-e4d256-prod-github-runner-207 kernel: [11780.607794] ? __fget_files+0x86/0xc0 Aug 22 08:40:06 juju-e4d256-prod-github-runner-207 kernel: [11780.608500] __x64_sys_ioctl+0x95/0xd0 Aug 22 08:40:06 juju-e4d256-prod-github-runner-207 kernel: [11780.609200] do_syscall_64+0x5c/0xc0 Aug 22 08:40:06 juju-e4d256-prod-github-runner-207 kernel: [11780.609868] ? do_futex+0x162/0x1f0 Aug 22 08:40:06 juju-e4d256-prod-github-runner-207 kernel: [11780.610537] ? __x64_sys_futex+0x78/0x1e0 Aug 22 08:40:06 juju-e4d256-prod-github-runner-207 kernel: [11780.611212] ? __secure_computing+0xa9/0x120 Aug 22 08:40:06 juju-e4d256-prod-github-runner-207 kernel: [11780.611935] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 08:40:06 juju-e4d256-prod-github-runner-207 kernel: [11780.612708] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:40:06 juju-e4d256-prod-github-runner-207 kernel: [11780.613564] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:40:06 juju-e4d256-prod-github-runner-207 kernel: [11780.614281] ? do_syscall_64+0x69/0xc0 Aug 22 08:40:06 juju-e4d256-prod-github-runner-207 kernel: [11780.614926] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:40:06 juju-e4d256-prod-github-runner-207 kernel: [11780.615636] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:40:06 juju-e4d256-prod-github-runner-207 kernel: [11780.616362] ? do_syscall_64+0x69/0xc0 Aug 22 08:40:06 juju-e4d256-prod-github-runner-207 kernel: [11780.616988] ? do_syscall_64+0x69/0xc0 Aug 22 08:40:06 juju-e4d256-prod-github-runner-207 kernel: [11780.617627] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 08:40:06 juju-e4d256-prod-github-runner-207 kernel: [11780.618333] RIP: 0033:0x7faa5d0edaff Aug 22 08:40:06 juju-e4d256-prod-github-runner-207 kernel: [11780.618970] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 08:40:06 juju-e4d256-prod-github-runner-207 kernel: [11780.621171] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 08:40:06 juju-e4d256-prod-github-runner-207 kernel: [11780.622265] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 08:40:06 juju-e4d256-prod-github-runner-207 kernel: [11780.623205] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 08:40:06 juju-e4d256-prod-github-runner-207 kernel: [11780.624147] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 08:40:06 juju-e4d256-prod-github-runner-207 kernel: [11780.625040] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 08:40:06 juju-e4d256-prod-github-runner-207 kernel: [11780.625929] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 08:40:06 juju-e4d256-prod-github-runner-207 kernel: [11780.626821] Aug 22 08:40:34 juju-e4d256-prod-github-runner-207 kernel: [11808.541976] watchdog: BUG: soft lockup - CPU#1 stuck for 10889s! [qemu-system-x86:6715] Aug 22 08:40:34 juju-e4d256-prod-github-runner-207 kernel: [11808.543852] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 08:40:34 juju-e4d256-prod-github-runner-207 kernel: [11808.544149] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 08:40:34 juju-e4d256-prod-github-runner-207 kernel: [11808.556348] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 08:40:34 juju-e4d256-prod-github-runner-207 kernel: [11808.557612] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 08:40:34 juju-e4d256-prod-github-runner-207 kernel: [11808.558830] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:40:34 juju-e4d256-prod-github-runner-207 kernel: [11808.559907] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 08:40:34 juju-e4d256-prod-github-runner-207 kernel: [11808.562469] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 08:40:34 juju-e4d256-prod-github-runner-207 kernel: [11808.563527] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 08:40:34 juju-e4d256-prod-github-runner-207 kernel: [11808.564693] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 08:40:34 juju-e4d256-prod-github-runner-207 kernel: [11808.565856] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 08:40:34 juju-e4d256-prod-github-runner-207 kernel: [11808.567014] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 08:40:34 juju-e4d256-prod-github-runner-207 kernel: [11808.568199] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 08:40:34 juju-e4d256-prod-github-runner-207 kernel: [11808.569364] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 08:40:34 juju-e4d256-prod-github-runner-207 kernel: [11808.570598] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 08:40:34 juju-e4d256-prod-github-runner-207 kernel: [11808.571713] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 08:40:34 juju-e4d256-prod-github-runner-207 kernel: [11808.572907] Call Trace: Aug 22 08:40:34 juju-e4d256-prod-github-runner-207 kernel: [11808.573817] Aug 22 08:40:34 juju-e4d256-prod-github-runner-207 kernel: [11808.574721] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:40:34 juju-e4d256-prod-github-runner-207 kernel: [11808.575770] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:40:34 juju-e4d256-prod-github-runner-207 kernel: [11808.576794] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:40:34 juju-e4d256-prod-github-runner-207 kernel: [11808.577905] ? show_regs.part.0+0x23/0x29 Aug 22 08:40:34 juju-e4d256-prod-github-runner-207 kernel: [11808.578900] ? show_regs.cold+0x8/0xd Aug 22 08:40:34 juju-e4d256-prod-github-runner-207 kernel: [11808.579921] ? watchdog_timer_fn+0x1be/0x220 Aug 22 08:40:34 juju-e4d256-prod-github-runner-207 kernel: [11808.580955] ? lockup_detector_update_enable+0x60/0x60 Aug 22 08:40:34 juju-e4d256-prod-github-runner-207 kernel: [11808.582024] ? __hrtimer_run_queues+0x107/0x230 Aug 22 08:40:34 juju-e4d256-prod-github-runner-207 kernel: [11808.583048] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 08:40:34 juju-e4d256-prod-github-runner-207 kernel: [11808.584090] ? hrtimer_interrupt+0x101/0x220 Aug 22 08:40:34 juju-e4d256-prod-github-runner-207 kernel: [11808.585126] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 08:40:34 juju-e4d256-prod-github-runner-207 kernel: [11808.586217] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 08:40:34 juju-e4d256-prod-github-runner-207 kernel: [11808.587266] Aug 22 08:40:34 juju-e4d256-prod-github-runner-207 kernel: [11808.588128] Aug 22 08:40:34 juju-e4d256-prod-github-runner-207 kernel: [11808.588963] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 08:40:34 juju-e4d256-prod-github-runner-207 kernel: [11808.589990] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:40:34 juju-e4d256-prod-github-runner-207 kernel: [11808.591024] ? _raw_spin_lock+0x22/0x30 Aug 22 08:40:34 juju-e4d256-prod-github-runner-207 kernel: [11808.591980] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:40:34 juju-e4d256-prod-github-runner-207 kernel: [11808.592996] direct_page_fault+0x206/0x310 [kvm] Aug 22 08:40:34 juju-e4d256-prod-github-runner-207 kernel: [11808.594025] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 08:40:34 juju-e4d256-prod-github-runner-207 kernel: [11808.595035] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 08:40:34 juju-e4d256-prod-github-runner-207 kernel: [11808.596049] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 08:40:34 juju-e4d256-prod-github-runner-207 kernel: [11808.597058] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 08:40:34 juju-e4d256-prod-github-runner-207 kernel: [11808.598011] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 08:40:34 juju-e4d256-prod-github-runner-207 kernel: [11808.599014] handle_exit+0x98/0x230 [kvm_amd] Aug 22 08:40:34 juju-e4d256-prod-github-runner-207 kernel: [11808.599954] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 08:40:34 juju-e4d256-prod-github-runner-207 kernel: [11808.601020] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 08:40:34 juju-e4d256-prod-github-runner-207 kernel: [11808.602123] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 08:40:34 juju-e4d256-prod-github-runner-207 kernel: [11808.603061] vcpu_run+0x62/0x2c0 [kvm] Aug 22 08:40:34 juju-e4d256-prod-github-runner-207 kernel: [11808.603939] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 08:40:34 juju-e4d256-prod-github-runner-207 kernel: [11808.604754] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 08:40:34 juju-e4d256-prod-github-runner-207 kernel: [11808.605610] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 08:40:34 juju-e4d256-prod-github-runner-207 kernel: [11808.606414] ? __seccomp_filter+0x4a/0x4a0 Aug 22 08:40:34 juju-e4d256-prod-github-runner-207 kernel: [11808.607159] ? __fget_files+0x86/0xc0 Aug 22 08:40:34 juju-e4d256-prod-github-runner-207 kernel: [11808.607885] __x64_sys_ioctl+0x95/0xd0 Aug 22 08:40:34 juju-e4d256-prod-github-runner-207 kernel: [11808.608575] do_syscall_64+0x5c/0xc0 Aug 22 08:40:34 juju-e4d256-prod-github-runner-207 kernel: [11808.609244] ? do_futex+0x162/0x1f0 Aug 22 08:40:34 juju-e4d256-prod-github-runner-207 kernel: [11808.609897] ? __x64_sys_futex+0x78/0x1e0 Aug 22 08:40:34 juju-e4d256-prod-github-runner-207 kernel: [11808.610573] ? __secure_computing+0xa9/0x120 Aug 22 08:40:34 juju-e4d256-prod-github-runner-207 kernel: [11808.611261] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 08:40:34 juju-e4d256-prod-github-runner-207 kernel: [11808.612030] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:40:34 juju-e4d256-prod-github-runner-207 kernel: [11808.612758] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:40:34 juju-e4d256-prod-github-runner-207 kernel: [11808.613475] ? do_syscall_64+0x69/0xc0 Aug 22 08:40:34 juju-e4d256-prod-github-runner-207 kernel: [11808.614117] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:40:34 juju-e4d256-prod-github-runner-207 kernel: [11808.614950] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:40:34 juju-e4d256-prod-github-runner-207 kernel: [11808.615709] ? do_syscall_64+0x69/0xc0 Aug 22 08:40:34 juju-e4d256-prod-github-runner-207 kernel: [11808.616412] ? do_syscall_64+0x69/0xc0 Aug 22 08:40:34 juju-e4d256-prod-github-runner-207 kernel: [11808.617036] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 08:40:34 juju-e4d256-prod-github-runner-207 kernel: [11808.617752] RIP: 0033:0x7faa5d0edaff Aug 22 08:40:34 juju-e4d256-prod-github-runner-207 kernel: [11808.618419] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 08:40:34 juju-e4d256-prod-github-runner-207 kernel: [11808.620494] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 08:40:34 juju-e4d256-prod-github-runner-207 kernel: [11808.621409] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 08:40:34 juju-e4d256-prod-github-runner-207 kernel: [11808.622301] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 08:40:34 juju-e4d256-prod-github-runner-207 kernel: [11808.623201] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 08:40:34 juju-e4d256-prod-github-runner-207 kernel: [11808.624115] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 08:40:34 juju-e4d256-prod-github-runner-207 kernel: [11808.625010] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 08:40:34 juju-e4d256-prod-github-runner-207 kernel: [11808.625901] Aug 22 08:41:02 juju-e4d256-prod-github-runner-207 kernel: [11836.541981] watchdog: BUG: soft lockup - CPU#1 stuck for 10915s! [qemu-system-x86:6715] Aug 22 08:41:02 juju-e4d256-prod-github-runner-207 kernel: [11836.543104] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 08:41:02 juju-e4d256-prod-github-runner-207 kernel: [11836.543177] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 08:41:02 juju-e4d256-prod-github-runner-207 kernel: [11836.555354] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 08:41:02 juju-e4d256-prod-github-runner-207 kernel: [11836.556665] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 08:41:02 juju-e4d256-prod-github-runner-207 kernel: [11836.557922] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:41:02 juju-e4d256-prod-github-runner-207 kernel: [11836.559018] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 08:41:02 juju-e4d256-prod-github-runner-207 kernel: [11836.561573] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 08:41:02 juju-e4d256-prod-github-runner-207 kernel: [11836.562623] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 08:41:02 juju-e4d256-prod-github-runner-207 kernel: [11836.563796] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 08:41:02 juju-e4d256-prod-github-runner-207 kernel: [11836.565158] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 08:41:02 juju-e4d256-prod-github-runner-207 kernel: [11836.566326] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 08:41:02 juju-e4d256-prod-github-runner-207 kernel: [11836.567503] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 08:41:02 juju-e4d256-prod-github-runner-207 kernel: [11836.568712] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 08:41:02 juju-e4d256-prod-github-runner-207 kernel: [11836.569955] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 08:41:02 juju-e4d256-prod-github-runner-207 kernel: [11836.571145] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 08:41:02 juju-e4d256-prod-github-runner-207 kernel: [11836.572438] Call Trace: Aug 22 08:41:02 juju-e4d256-prod-github-runner-207 kernel: [11836.573369] Aug 22 08:41:02 juju-e4d256-prod-github-runner-207 kernel: [11836.574293] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:41:02 juju-e4d256-prod-github-runner-207 kernel: [11836.575373] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:41:02 juju-e4d256-prod-github-runner-207 kernel: [11836.576408] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:41:02 juju-e4d256-prod-github-runner-207 kernel: [11836.577491] ? show_regs.part.0+0x23/0x29 Aug 22 08:41:02 juju-e4d256-prod-github-runner-207 kernel: [11836.578499] ? show_regs.cold+0x8/0xd Aug 22 08:41:02 juju-e4d256-prod-github-runner-207 kernel: [11836.579491] ? watchdog_timer_fn+0x1be/0x220 Aug 22 08:41:02 juju-e4d256-prod-github-runner-207 kernel: [11836.580519] ? lockup_detector_update_enable+0x60/0x60 Aug 22 08:41:02 juju-e4d256-prod-github-runner-207 kernel: [11836.581581] ? __hrtimer_run_queues+0x107/0x230 Aug 22 08:41:02 juju-e4d256-prod-github-runner-207 kernel: [11836.582606] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 08:41:02 juju-e4d256-prod-github-runner-207 kernel: [11836.583641] ? hrtimer_interrupt+0x101/0x220 Aug 22 08:41:02 juju-e4d256-prod-github-runner-207 kernel: [11836.584682] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 08:41:02 juju-e4d256-prod-github-runner-207 kernel: [11836.585806] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 08:41:02 juju-e4d256-prod-github-runner-207 kernel: [11836.586861] Aug 22 08:41:02 juju-e4d256-prod-github-runner-207 kernel: [11836.587736] Aug 22 08:41:02 juju-e4d256-prod-github-runner-207 kernel: [11836.588607] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 08:41:02 juju-e4d256-prod-github-runner-207 kernel: [11836.589685] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:41:02 juju-e4d256-prod-github-runner-207 kernel: [11836.590744] ? _raw_spin_lock+0x22/0x30 Aug 22 08:41:02 juju-e4d256-prod-github-runner-207 kernel: [11836.591703] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:41:02 juju-e4d256-prod-github-runner-207 kernel: [11836.592746] direct_page_fault+0x206/0x310 [kvm] Aug 22 08:41:02 juju-e4d256-prod-github-runner-207 kernel: [11836.593803] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 08:41:02 juju-e4d256-prod-github-runner-207 kernel: [11836.594834] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 08:41:02 juju-e4d256-prod-github-runner-207 kernel: [11836.595873] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 08:41:02 juju-e4d256-prod-github-runner-207 kernel: [11836.596844] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 08:41:02 juju-e4d256-prod-github-runner-207 kernel: [11836.597803] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 08:41:02 juju-e4d256-prod-github-runner-207 kernel: [11836.598828] handle_exit+0x98/0x230 [kvm_amd] Aug 22 08:41:02 juju-e4d256-prod-github-runner-207 kernel: [11836.599755] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 08:41:02 juju-e4d256-prod-github-runner-207 kernel: [11836.600884] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 08:41:02 juju-e4d256-prod-github-runner-207 kernel: [11836.601809] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 08:41:02 juju-e4d256-prod-github-runner-207 kernel: [11836.602728] vcpu_run+0x62/0x2c0 [kvm] Aug 22 08:41:02 juju-e4d256-prod-github-runner-207 kernel: [11836.603568] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 08:41:02 juju-e4d256-prod-github-runner-207 kernel: [11836.604382] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 08:41:02 juju-e4d256-prod-github-runner-207 kernel: [11836.605243] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 08:41:02 juju-e4d256-prod-github-runner-207 kernel: [11836.606079] ? __seccomp_filter+0x4a/0x4a0 Aug 22 08:41:02 juju-e4d256-prod-github-runner-207 kernel: [11836.606828] ? __fget_files+0x86/0xc0 Aug 22 08:41:02 juju-e4d256-prod-github-runner-207 kernel: [11836.607554] __x64_sys_ioctl+0x95/0xd0 Aug 22 08:41:02 juju-e4d256-prod-github-runner-207 kernel: [11836.608268] do_syscall_64+0x5c/0xc0 Aug 22 08:41:02 juju-e4d256-prod-github-runner-207 kernel: [11836.608948] ? do_futex+0x162/0x1f0 Aug 22 08:41:02 juju-e4d256-prod-github-runner-207 kernel: [11836.609597] ? __x64_sys_futex+0x78/0x1e0 Aug 22 08:41:02 juju-e4d256-prod-github-runner-207 kernel: [11836.610288] ? __secure_computing+0xa9/0x120 Aug 22 08:41:02 juju-e4d256-prod-github-runner-207 kernel: [11836.611016] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 08:41:02 juju-e4d256-prod-github-runner-207 kernel: [11836.611782] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:41:02 juju-e4d256-prod-github-runner-207 kernel: [11836.612517] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:41:02 juju-e4d256-prod-github-runner-207 kernel: [11836.613253] ? do_syscall_64+0x69/0xc0 Aug 22 08:41:02 juju-e4d256-prod-github-runner-207 kernel: [11836.613915] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:41:02 juju-e4d256-prod-github-runner-207 kernel: [11836.614620] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:41:02 juju-e4d256-prod-github-runner-207 kernel: [11836.615340] ? do_syscall_64+0x69/0xc0 Aug 22 08:41:02 juju-e4d256-prod-github-runner-207 kernel: [11836.616004] ? do_syscall_64+0x69/0xc0 Aug 22 08:41:02 juju-e4d256-prod-github-runner-207 kernel: [11836.616662] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 08:41:02 juju-e4d256-prod-github-runner-207 kernel: [11836.617371] RIP: 0033:0x7faa5d0edaff Aug 22 08:41:02 juju-e4d256-prod-github-runner-207 kernel: [11836.618002] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 08:41:02 juju-e4d256-prod-github-runner-207 kernel: [11836.620020] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 08:41:02 juju-e4d256-prod-github-runner-207 kernel: [11836.620946] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 08:41:02 juju-e4d256-prod-github-runner-207 kernel: [11836.621851] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 08:41:02 juju-e4d256-prod-github-runner-207 kernel: [11836.622762] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 08:41:02 juju-e4d256-prod-github-runner-207 kernel: [11836.623695] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 08:41:02 juju-e4d256-prod-github-runner-207 kernel: [11836.624597] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 08:41:02 juju-e4d256-prod-github-runner-207 kernel: [11836.625515] Aug 22 08:41:30 juju-e4d256-prod-github-runner-207 kernel: [11864.541981] watchdog: BUG: soft lockup - CPU#1 stuck for 10941s! [qemu-system-x86:6715] Aug 22 08:41:30 juju-e4d256-prod-github-runner-207 kernel: [11864.543106] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 08:41:30 juju-e4d256-prod-github-runner-207 kernel: [11864.543179] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 08:41:30 juju-e4d256-prod-github-runner-207 kernel: [11864.555246] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 08:41:30 juju-e4d256-prod-github-runner-207 kernel: [11864.556549] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 08:41:30 juju-e4d256-prod-github-runner-207 kernel: [11864.557778] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:41:30 juju-e4d256-prod-github-runner-207 kernel: [11864.558849] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 08:41:30 juju-e4d256-prod-github-runner-207 kernel: [11864.561405] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 08:41:30 juju-e4d256-prod-github-runner-207 kernel: [11864.562451] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 08:41:30 juju-e4d256-prod-github-runner-207 kernel: [11864.563627] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 08:41:30 juju-e4d256-prod-github-runner-207 kernel: [11864.564788] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 08:41:30 juju-e4d256-prod-github-runner-207 kernel: [11864.565958] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 08:41:30 juju-e4d256-prod-github-runner-207 kernel: [11864.567131] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 08:41:30 juju-e4d256-prod-github-runner-207 kernel: [11864.568363] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 08:41:30 juju-e4d256-prod-github-runner-207 kernel: [11864.569633] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 08:41:30 juju-e4d256-prod-github-runner-207 kernel: [11864.570743] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 08:41:30 juju-e4d256-prod-github-runner-207 kernel: [11864.571937] Call Trace: Aug 22 08:41:30 juju-e4d256-prod-github-runner-207 kernel: [11864.572847] Aug 22 08:41:30 juju-e4d256-prod-github-runner-207 kernel: [11864.573727] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:41:30 juju-e4d256-prod-github-runner-207 kernel: [11864.574813] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:41:30 juju-e4d256-prod-github-runner-207 kernel: [11864.575835] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:41:30 juju-e4d256-prod-github-runner-207 kernel: [11864.576908] ? show_regs.part.0+0x23/0x29 Aug 22 08:41:30 juju-e4d256-prod-github-runner-207 kernel: [11864.577903] ? show_regs.cold+0x8/0xd Aug 22 08:41:30 juju-e4d256-prod-github-runner-207 kernel: [11864.578887] ? watchdog_timer_fn+0x1be/0x220 Aug 22 08:41:30 juju-e4d256-prod-github-runner-207 kernel: [11864.579895] ? lockup_detector_update_enable+0x60/0x60 Aug 22 08:41:30 juju-e4d256-prod-github-runner-207 kernel: [11864.580955] ? __hrtimer_run_queues+0x107/0x230 Aug 22 08:41:30 juju-e4d256-prod-github-runner-207 kernel: [11864.581980] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 08:41:30 juju-e4d256-prod-github-runner-207 kernel: [11864.583020] ? hrtimer_interrupt+0x101/0x220 Aug 22 08:41:30 juju-e4d256-prod-github-runner-207 kernel: [11864.584035] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 08:41:30 juju-e4d256-prod-github-runner-207 kernel: [11864.585110] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 08:41:30 juju-e4d256-prod-github-runner-207 kernel: [11864.586156] Aug 22 08:41:30 juju-e4d256-prod-github-runner-207 kernel: [11864.587023] Aug 22 08:41:30 juju-e4d256-prod-github-runner-207 kernel: [11864.587859] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 08:41:30 juju-e4d256-prod-github-runner-207 kernel: [11864.588891] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:41:30 juju-e4d256-prod-github-runner-207 kernel: [11864.589968] ? _raw_spin_lock+0x22/0x30 Aug 22 08:41:30 juju-e4d256-prod-github-runner-207 kernel: [11864.590931] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:41:30 juju-e4d256-prod-github-runner-207 kernel: [11864.591959] direct_page_fault+0x206/0x310 [kvm] Aug 22 08:41:30 juju-e4d256-prod-github-runner-207 kernel: [11864.592985] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 08:41:30 juju-e4d256-prod-github-runner-207 kernel: [11864.593998] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 08:41:30 juju-e4d256-prod-github-runner-207 kernel: [11864.595010] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 08:41:30 juju-e4d256-prod-github-runner-207 kernel: [11864.595980] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 08:41:30 juju-e4d256-prod-github-runner-207 kernel: [11864.596924] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 08:41:30 juju-e4d256-prod-github-runner-207 kernel: [11864.597917] handle_exit+0x98/0x230 [kvm_amd] Aug 22 08:41:30 juju-e4d256-prod-github-runner-207 kernel: [11864.598835] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 08:41:30 juju-e4d256-prod-github-runner-207 kernel: [11864.599746] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 08:41:30 juju-e4d256-prod-github-runner-207 kernel: [11864.600686] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 08:41:30 juju-e4d256-prod-github-runner-207 kernel: [11864.601601] vcpu_run+0x62/0x2c0 [kvm] Aug 22 08:41:30 juju-e4d256-prod-github-runner-207 kernel: [11864.602409] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 08:41:30 juju-e4d256-prod-github-runner-207 kernel: [11864.603228] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 08:41:30 juju-e4d256-prod-github-runner-207 kernel: [11864.604080] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 08:41:30 juju-e4d256-prod-github-runner-207 kernel: [11864.604938] ? __seccomp_filter+0x4a/0x4a0 Aug 22 08:41:30 juju-e4d256-prod-github-runner-207 kernel: [11864.605680] ? __fget_files+0x86/0xc0 Aug 22 08:41:30 juju-e4d256-prod-github-runner-207 kernel: [11864.606385] __x64_sys_ioctl+0x95/0xd0 Aug 22 08:41:30 juju-e4d256-prod-github-runner-207 kernel: [11864.607082] do_syscall_64+0x5c/0xc0 Aug 22 08:41:30 juju-e4d256-prod-github-runner-207 kernel: [11864.607744] ? do_futex+0x162/0x1f0 Aug 22 08:41:30 juju-e4d256-prod-github-runner-207 kernel: [11864.608389] ? __x64_sys_futex+0x78/0x1e0 Aug 22 08:41:30 juju-e4d256-prod-github-runner-207 kernel: [11864.609063] ? __secure_computing+0xa9/0x120 Aug 22 08:41:30 juju-e4d256-prod-github-runner-207 kernel: [11864.609748] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 08:41:30 juju-e4d256-prod-github-runner-207 kernel: [11864.610504] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:41:30 juju-e4d256-prod-github-runner-207 kernel: [11864.611237] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:41:30 juju-e4d256-prod-github-runner-207 kernel: [11864.612066] ? do_syscall_64+0x69/0xc0 Aug 22 08:41:30 juju-e4d256-prod-github-runner-207 kernel: [11864.612720] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:41:30 juju-e4d256-prod-github-runner-207 kernel: [11864.613424] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:41:30 juju-e4d256-prod-github-runner-207 kernel: [11864.614119] ? do_syscall_64+0x69/0xc0 Aug 22 08:41:30 juju-e4d256-prod-github-runner-207 kernel: [11864.614762] ? do_syscall_64+0x69/0xc0 Aug 22 08:41:30 juju-e4d256-prod-github-runner-207 kernel: [11864.615390] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 08:41:30 juju-e4d256-prod-github-runner-207 kernel: [11864.616101] RIP: 0033:0x7faa5d0edaff Aug 22 08:41:30 juju-e4d256-prod-github-runner-207 kernel: [11864.616725] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 08:41:30 juju-e4d256-prod-github-runner-207 kernel: [11864.618733] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 08:41:30 juju-e4d256-prod-github-runner-207 kernel: [11864.619642] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 08:41:30 juju-e4d256-prod-github-runner-207 kernel: [11864.620531] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 08:41:30 juju-e4d256-prod-github-runner-207 kernel: [11864.621420] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 08:41:30 juju-e4d256-prod-github-runner-207 kernel: [11864.622328] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 08:41:30 juju-e4d256-prod-github-runner-207 kernel: [11864.623229] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 08:41:30 juju-e4d256-prod-github-runner-207 kernel: [11864.624121] Aug 22 08:41:44 juju-e4d256-prod-github-runner-207 kernel: [11877.980707] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 08:41:44 juju-e4d256-prod-github-runner-207 kernel: [11877.981675] rcu: 1-....: (2930976 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=1416736 Aug 22 08:41:44 juju-e4d256-prod-github-runner-207 kernel: [11877.982843] (t=2940195 jiffies g=23269 q=20054) Aug 22 08:41:44 juju-e4d256-prod-github-runner-207 kernel: [11877.983639] NMI backtrace for cpu 1 Aug 22 08:41:44 juju-e4d256-prod-github-runner-207 kernel: [11877.984366] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 08:41:44 juju-e4d256-prod-github-runner-207 kernel: [11877.985494] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 08:41:44 juju-e4d256-prod-github-runner-207 kernel: [11877.986585] Call Trace: Aug 22 08:41:44 juju-e4d256-prod-github-runner-207 kernel: [11877.987269] Aug 22 08:41:44 juju-e4d256-prod-github-runner-207 kernel: [11877.987921] show_stack+0x52/0x5c Aug 22 08:41:44 juju-e4d256-prod-github-runner-207 kernel: [11877.988675] dump_stack_lvl+0x4a/0x63 Aug 22 08:41:44 juju-e4d256-prod-github-runner-207 kernel: [11877.989443] dump_stack+0x10/0x16 Aug 22 08:41:44 juju-e4d256-prod-github-runner-207 kernel: [11877.990169] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 08:41:44 juju-e4d256-prod-github-runner-207 kernel: [11877.990971] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 08:41:44 juju-e4d256-prod-github-runner-207 kernel: [11877.991759] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 08:41:44 juju-e4d256-prod-github-runner-207 kernel: [11877.992590] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 08:41:44 juju-e4d256-prod-github-runner-207 kernel: [11877.993437] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 08:41:44 juju-e4d256-prod-github-runner-207 kernel: [11877.994268] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 08:41:44 juju-e4d256-prod-github-runner-207 kernel: [11877.995057] print_cpu_stall.cold+0x2f/0xe2 Aug 22 08:41:44 juju-e4d256-prod-github-runner-207 kernel: [11877.995827] ? timekeeping_update+0xf7/0x150 Aug 22 08:41:44 juju-e4d256-prod-github-runner-207 kernel: [11877.996603] check_cpu_stall+0x109/0x270 Aug 22 08:41:44 juju-e4d256-prod-github-runner-207 kernel: [11877.997405] rcu_sched_clock_irq+0x9a/0x250 Aug 22 08:41:44 juju-e4d256-prod-github-runner-207 kernel: [11877.998181] update_process_times+0x94/0xd0 Aug 22 08:41:44 juju-e4d256-prod-github-runner-207 kernel: [11877.998998] tick_sched_handle+0x29/0x70 Aug 22 08:41:44 juju-e4d256-prod-github-runner-207 kernel: [11877.999779] tick_sched_timer+0x8c/0xc0 Aug 22 08:41:44 juju-e4d256-prod-github-runner-207 kernel: [11878.000530] ? tick_nohz_handler+0xb0/0xb0 Aug 22 08:41:44 juju-e4d256-prod-github-runner-207 kernel: [11878.001292] __hrtimer_run_queues+0x107/0x230 Aug 22 08:41:44 juju-e4d256-prod-github-runner-207 kernel: [11878.002074] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 08:41:44 juju-e4d256-prod-github-runner-207 kernel: [11878.002894] hrtimer_interrupt+0x101/0x220 Aug 22 08:41:44 juju-e4d256-prod-github-runner-207 kernel: [11878.003681] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 08:41:44 juju-e4d256-prod-github-runner-207 kernel: [11878.004566] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 08:41:44 juju-e4d256-prod-github-runner-207 kernel: [11878.005397] Aug 22 08:41:44 juju-e4d256-prod-github-runner-207 kernel: [11878.006085] Aug 22 08:41:44 juju-e4d256-prod-github-runner-207 kernel: [11878.006746] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 08:41:44 juju-e4d256-prod-github-runner-207 kernel: [11878.007578] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:41:44 juju-e4d256-prod-github-runner-207 kernel: [11878.008469] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 08:41:44 juju-e4d256-prod-github-runner-207 kernel: [11878.010741] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 08:41:44 juju-e4d256-prod-github-runner-207 kernel: [11878.011628] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 08:41:44 juju-e4d256-prod-github-runner-207 kernel: [11878.012662] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 08:41:44 juju-e4d256-prod-github-runner-207 kernel: [11878.013664] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 08:41:44 juju-e4d256-prod-github-runner-207 kernel: [11878.014681] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 08:41:44 juju-e4d256-prod-github-runner-207 kernel: [11878.015704] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 08:41:44 juju-e4d256-prod-github-runner-207 kernel: [11878.016673] ? _raw_spin_lock+0x22/0x30 Aug 22 08:41:44 juju-e4d256-prod-github-runner-207 kernel: [11878.017439] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:41:44 juju-e4d256-prod-github-runner-207 kernel: [11878.018291] direct_page_fault+0x206/0x310 [kvm] Aug 22 08:41:44 juju-e4d256-prod-github-runner-207 kernel: [11878.019191] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 08:41:44 juju-e4d256-prod-github-runner-207 kernel: [11878.020088] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 08:41:44 juju-e4d256-prod-github-runner-207 kernel: [11878.020935] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 08:41:44 juju-e4d256-prod-github-runner-207 kernel: [11878.021765] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 08:41:44 juju-e4d256-prod-github-runner-207 kernel: [11878.022576] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 08:41:44 juju-e4d256-prod-github-runner-207 kernel: [11878.023408] handle_exit+0x98/0x230 [kvm_amd] Aug 22 08:41:44 juju-e4d256-prod-github-runner-207 kernel: [11878.024202] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 08:41:44 juju-e4d256-prod-github-runner-207 kernel: [11878.025005] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 08:41:44 juju-e4d256-prod-github-runner-207 kernel: [11878.025826] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 08:41:44 juju-e4d256-prod-github-runner-207 kernel: [11878.026645] vcpu_run+0x62/0x2c0 [kvm] Aug 22 08:41:44 juju-e4d256-prod-github-runner-207 kernel: [11878.027376] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 08:41:44 juju-e4d256-prod-github-runner-207 kernel: [11878.028117] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 08:41:44 juju-e4d256-prod-github-runner-207 kernel: [11878.028929] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 08:41:44 juju-e4d256-prod-github-runner-207 kernel: [11878.029713] ? __seccomp_filter+0x4a/0x4a0 Aug 22 08:41:44 juju-e4d256-prod-github-runner-207 kernel: [11878.030478] ? __fget_files+0x86/0xc0 Aug 22 08:41:44 juju-e4d256-prod-github-runner-207 kernel: [11878.031297] __x64_sys_ioctl+0x95/0xd0 Aug 22 08:41:44 juju-e4d256-prod-github-runner-207 kernel: [11878.032007] do_syscall_64+0x5c/0xc0 Aug 22 08:41:44 juju-e4d256-prod-github-runner-207 kernel: [11878.032698] ? do_futex+0x162/0x1f0 Aug 22 08:41:44 juju-e4d256-prod-github-runner-207 kernel: [11878.033382] ? __x64_sys_futex+0x78/0x1e0 Aug 22 08:41:44 juju-e4d256-prod-github-runner-207 kernel: [11878.034269] ? __secure_computing+0xa9/0x120 Aug 22 08:41:44 juju-e4d256-prod-github-runner-207 kernel: [11878.035074] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 08:41:44 juju-e4d256-prod-github-runner-207 kernel: [11878.036180] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:41:44 juju-e4d256-prod-github-runner-207 kernel: [11878.037214] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:41:44 juju-e4d256-prod-github-runner-207 kernel: [11878.037993] ? do_syscall_64+0x69/0xc0 Aug 22 08:41:44 juju-e4d256-prod-github-runner-207 kernel: [11878.038752] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:41:44 juju-e4d256-prod-github-runner-207 kernel: [11878.039523] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:41:44 juju-e4d256-prod-github-runner-207 kernel: [11878.040324] ? do_syscall_64+0x69/0xc0 Aug 22 08:41:44 juju-e4d256-prod-github-runner-207 kernel: [11878.041049] ? do_syscall_64+0x69/0xc0 Aug 22 08:41:44 juju-e4d256-prod-github-runner-207 kernel: [11878.041808] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 08:41:44 juju-e4d256-prod-github-runner-207 kernel: [11878.042617] RIP: 0033:0x7faa5d0edaff Aug 22 08:41:44 juju-e4d256-prod-github-runner-207 kernel: [11878.043310] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 08:41:44 juju-e4d256-prod-github-runner-207 kernel: [11878.045585] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 08:41:44 juju-e4d256-prod-github-runner-207 kernel: [11878.046673] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 08:41:44 juju-e4d256-prod-github-runner-207 kernel: [11878.047698] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 08:41:44 juju-e4d256-prod-github-runner-207 kernel: [11878.048692] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 08:41:44 juju-e4d256-prod-github-runner-207 kernel: [11878.049661] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 08:41:44 juju-e4d256-prod-github-runner-207 kernel: [11878.050685] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 08:41:44 juju-e4d256-prod-github-runner-207 kernel: [11878.051653] Aug 22 08:42:10 juju-e4d256-prod-github-runner-207 kernel: [11904.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 10978s! [qemu-system-x86:6715] Aug 22 08:42:10 juju-e4d256-prod-github-runner-207 kernel: [11904.543953] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 08:42:10 juju-e4d256-prod-github-runner-207 kernel: [11904.544222] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 08:42:10 juju-e4d256-prod-github-runner-207 kernel: [11904.557859] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 08:42:10 juju-e4d256-prod-github-runner-207 kernel: [11904.559201] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 08:42:10 juju-e4d256-prod-github-runner-207 kernel: [11904.560441] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:42:10 juju-e4d256-prod-github-runner-207 kernel: [11904.561632] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 08:42:10 juju-e4d256-prod-github-runner-207 kernel: [11904.564251] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 08:42:10 juju-e4d256-prod-github-runner-207 kernel: [11904.565311] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 08:42:10 juju-e4d256-prod-github-runner-207 kernel: [11904.566523] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 08:42:10 juju-e4d256-prod-github-runner-207 kernel: [11904.567910] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 08:42:10 juju-e4d256-prod-github-runner-207 kernel: [11904.569552] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 08:42:10 juju-e4d256-prod-github-runner-207 kernel: [11904.570789] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 08:42:10 juju-e4d256-prod-github-runner-207 kernel: [11904.571989] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 08:42:10 juju-e4d256-prod-github-runner-207 kernel: [11904.573255] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 08:42:10 juju-e4d256-prod-github-runner-207 kernel: [11904.574401] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 08:42:10 juju-e4d256-prod-github-runner-207 kernel: [11904.575654] Call Trace: Aug 22 08:42:10 juju-e4d256-prod-github-runner-207 kernel: [11904.576835] Aug 22 08:42:10 juju-e4d256-prod-github-runner-207 kernel: [11904.577752] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:42:10 juju-e4d256-prod-github-runner-207 kernel: [11904.578825] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:42:10 juju-e4d256-prod-github-runner-207 kernel: [11904.579882] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:42:10 juju-e4d256-prod-github-runner-207 kernel: [11904.581025] ? show_regs.part.0+0x23/0x29 Aug 22 08:42:10 juju-e4d256-prod-github-runner-207 kernel: [11904.582062] ? show_regs.cold+0x8/0xd Aug 22 08:42:10 juju-e4d256-prod-github-runner-207 kernel: [11904.583064] ? watchdog_timer_fn+0x1be/0x220 Aug 22 08:42:10 juju-e4d256-prod-github-runner-207 kernel: [11904.584109] ? lockup_detector_update_enable+0x60/0x60 Aug 22 08:42:10 juju-e4d256-prod-github-runner-207 kernel: [11904.585261] ? __hrtimer_run_queues+0x107/0x230 Aug 22 08:42:10 juju-e4d256-prod-github-runner-207 kernel: [11904.586430] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 08:42:10 juju-e4d256-prod-github-runner-207 kernel: [11904.587502] ? hrtimer_interrupt+0x101/0x220 Aug 22 08:42:10 juju-e4d256-prod-github-runner-207 kernel: [11904.588572] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 08:42:10 juju-e4d256-prod-github-runner-207 kernel: [11904.589668] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 08:42:10 juju-e4d256-prod-github-runner-207 kernel: [11904.590774] Aug 22 08:42:10 juju-e4d256-prod-github-runner-207 kernel: [11904.591642] Aug 22 08:42:10 juju-e4d256-prod-github-runner-207 kernel: [11904.592496] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 08:42:10 juju-e4d256-prod-github-runner-207 kernel: [11904.593571] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:42:10 juju-e4d256-prod-github-runner-207 kernel: [11904.594647] ? _raw_spin_lock+0x22/0x30 Aug 22 08:42:10 juju-e4d256-prod-github-runner-207 kernel: [11904.595632] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:42:10 juju-e4d256-prod-github-runner-207 kernel: [11904.596669] direct_page_fault+0x206/0x310 [kvm] Aug 22 08:42:10 juju-e4d256-prod-github-runner-207 kernel: [11904.597713] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 08:42:10 juju-e4d256-prod-github-runner-207 kernel: [11904.598752] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 08:42:10 juju-e4d256-prod-github-runner-207 kernel: [11904.599778] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 08:42:10 juju-e4d256-prod-github-runner-207 kernel: [11904.600843] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 08:42:10 juju-e4d256-prod-github-runner-207 kernel: [11904.601847] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 08:42:10 juju-e4d256-prod-github-runner-207 kernel: [11904.602936] handle_exit+0x98/0x230 [kvm_amd] Aug 22 08:42:10 juju-e4d256-prod-github-runner-207 kernel: [11904.603896] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 08:42:10 juju-e4d256-prod-github-runner-207 kernel: [11904.604917] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 08:42:10 juju-e4d256-prod-github-runner-207 kernel: [11904.605865] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 08:42:10 juju-e4d256-prod-github-runner-207 kernel: [11904.606838] vcpu_run+0x62/0x2c0 [kvm] Aug 22 08:42:10 juju-e4d256-prod-github-runner-207 kernel: [11904.607715] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 08:42:10 juju-e4d256-prod-github-runner-207 kernel: [11904.608560] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 08:42:10 juju-e4d256-prod-github-runner-207 kernel: [11904.609435] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 08:42:10 juju-e4d256-prod-github-runner-207 kernel: [11904.610280] ? __seccomp_filter+0x4a/0x4a0 Aug 22 08:42:10 juju-e4d256-prod-github-runner-207 kernel: [11904.611053] ? __fget_files+0x86/0xc0 Aug 22 08:42:10 juju-e4d256-prod-github-runner-207 kernel: [11904.611768] __x64_sys_ioctl+0x95/0xd0 Aug 22 08:42:10 juju-e4d256-prod-github-runner-207 kernel: [11904.612467] do_syscall_64+0x5c/0xc0 Aug 22 08:42:10 juju-e4d256-prod-github-runner-207 kernel: [11904.613140] ? do_futex+0x162/0x1f0 Aug 22 08:42:10 juju-e4d256-prod-github-runner-207 kernel: [11904.613821] ? __x64_sys_futex+0x78/0x1e0 Aug 22 08:42:10 juju-e4d256-prod-github-runner-207 kernel: [11904.614536] ? __secure_computing+0xa9/0x120 Aug 22 08:42:10 juju-e4d256-prod-github-runner-207 kernel: [11904.615268] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 08:42:10 juju-e4d256-prod-github-runner-207 kernel: [11904.616108] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:42:10 juju-e4d256-prod-github-runner-207 kernel: [11904.616858] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:42:10 juju-e4d256-prod-github-runner-207 kernel: [11904.617606] ? do_syscall_64+0x69/0xc0 Aug 22 08:42:10 juju-e4d256-prod-github-runner-207 kernel: [11904.618281] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:42:10 juju-e4d256-prod-github-runner-207 kernel: [11904.618994] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:42:10 juju-e4d256-prod-github-runner-207 kernel: [11904.619703] ? do_syscall_64+0x69/0xc0 Aug 22 08:42:10 juju-e4d256-prod-github-runner-207 kernel: [11904.620336] ? do_syscall_64+0x69/0xc0 Aug 22 08:42:10 juju-e4d256-prod-github-runner-207 kernel: [11904.620972] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 08:42:10 juju-e4d256-prod-github-runner-207 kernel: [11904.621699] RIP: 0033:0x7faa5d0edaff Aug 22 08:42:10 juju-e4d256-prod-github-runner-207 kernel: [11904.622420] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 08:42:10 juju-e4d256-prod-github-runner-207 kernel: [11904.624785] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 08:42:10 juju-e4d256-prod-github-runner-207 kernel: [11904.626031] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 08:42:10 juju-e4d256-prod-github-runner-207 kernel: [11904.626971] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 08:42:10 juju-e4d256-prod-github-runner-207 kernel: [11904.627935] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 08:42:10 juju-e4d256-prod-github-runner-207 kernel: [11904.628846] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 08:42:10 juju-e4d256-prod-github-runner-207 kernel: [11904.629757] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 08:42:10 juju-e4d256-prod-github-runner-207 kernel: [11904.630723] Aug 22 08:42:38 juju-e4d256-prod-github-runner-207 kernel: [11932.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 11005s! [qemu-system-x86:6715] Aug 22 08:42:38 juju-e4d256-prod-github-runner-207 kernel: [11932.543084] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 08:42:38 juju-e4d256-prod-github-runner-207 kernel: [11932.543155] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 08:42:38 juju-e4d256-prod-github-runner-207 kernel: [11932.555587] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 08:42:38 juju-e4d256-prod-github-runner-207 kernel: [11932.556884] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 08:42:38 juju-e4d256-prod-github-runner-207 kernel: [11932.558151] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:42:38 juju-e4d256-prod-github-runner-207 kernel: [11932.559225] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 08:42:38 juju-e4d256-prod-github-runner-207 kernel: [11932.561822] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 08:42:38 juju-e4d256-prod-github-runner-207 kernel: [11932.562875] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 08:42:38 juju-e4d256-prod-github-runner-207 kernel: [11932.564060] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 08:42:38 juju-e4d256-prod-github-runner-207 kernel: [11932.565232] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 08:42:38 juju-e4d256-prod-github-runner-207 kernel: [11932.566417] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 08:42:38 juju-e4d256-prod-github-runner-207 kernel: [11932.567598] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 08:42:38 juju-e4d256-prod-github-runner-207 kernel: [11932.568780] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 08:42:38 juju-e4d256-prod-github-runner-207 kernel: [11932.570038] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 08:42:38 juju-e4d256-prod-github-runner-207 kernel: [11932.571148] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 08:42:38 juju-e4d256-prod-github-runner-207 kernel: [11932.572350] Call Trace: Aug 22 08:42:38 juju-e4d256-prod-github-runner-207 kernel: [11932.573269] Aug 22 08:42:38 juju-e4d256-prod-github-runner-207 kernel: [11932.574168] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:42:38 juju-e4d256-prod-github-runner-207 kernel: [11932.575244] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:42:38 juju-e4d256-prod-github-runner-207 kernel: [11932.576274] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:42:38 juju-e4d256-prod-github-runner-207 kernel: [11932.577359] ? show_regs.part.0+0x23/0x29 Aug 22 08:42:38 juju-e4d256-prod-github-runner-207 kernel: [11932.578372] ? show_regs.cold+0x8/0xd Aug 22 08:42:38 juju-e4d256-prod-github-runner-207 kernel: [11932.579353] ? watchdog_timer_fn+0x1be/0x220 Aug 22 08:42:38 juju-e4d256-prod-github-runner-207 kernel: [11932.580384] ? lockup_detector_update_enable+0x60/0x60 Aug 22 08:42:38 juju-e4d256-prod-github-runner-207 kernel: [11932.581457] ? __hrtimer_run_queues+0x107/0x230 Aug 22 08:42:38 juju-e4d256-prod-github-runner-207 kernel: [11932.582500] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 08:42:38 juju-e4d256-prod-github-runner-207 kernel: [11932.583734] ? hrtimer_interrupt+0x101/0x220 Aug 22 08:42:38 juju-e4d256-prod-github-runner-207 kernel: [11932.584758] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 08:42:38 juju-e4d256-prod-github-runner-207 kernel: [11932.585844] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 08:42:38 juju-e4d256-prod-github-runner-207 kernel: [11932.586898] Aug 22 08:42:38 juju-e4d256-prod-github-runner-207 kernel: [11932.587754] Aug 22 08:42:38 juju-e4d256-prod-github-runner-207 kernel: [11932.588601] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 08:42:38 juju-e4d256-prod-github-runner-207 kernel: [11932.589644] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:42:38 juju-e4d256-prod-github-runner-207 kernel: [11932.590711] ? _raw_spin_lock+0x22/0x30 Aug 22 08:42:38 juju-e4d256-prod-github-runner-207 kernel: [11932.591660] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:42:38 juju-e4d256-prod-github-runner-207 kernel: [11932.592689] direct_page_fault+0x206/0x310 [kvm] Aug 22 08:42:38 juju-e4d256-prod-github-runner-207 kernel: [11932.593721] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 08:42:38 juju-e4d256-prod-github-runner-207 kernel: [11932.594754] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 08:42:38 juju-e4d256-prod-github-runner-207 kernel: [11932.595766] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 08:42:38 juju-e4d256-prod-github-runner-207 kernel: [11932.596762] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 08:42:38 juju-e4d256-prod-github-runner-207 kernel: [11932.597720] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 08:42:38 juju-e4d256-prod-github-runner-207 kernel: [11932.598714] handle_exit+0x98/0x230 [kvm_amd] Aug 22 08:42:38 juju-e4d256-prod-github-runner-207 kernel: [11932.599613] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 08:42:38 juju-e4d256-prod-github-runner-207 kernel: [11932.600537] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 08:42:38 juju-e4d256-prod-github-runner-207 kernel: [11932.601497] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 08:42:38 juju-e4d256-prod-github-runner-207 kernel: [11932.602427] vcpu_run+0x62/0x2c0 [kvm] Aug 22 08:42:38 juju-e4d256-prod-github-runner-207 kernel: [11932.603260] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 08:42:38 juju-e4d256-prod-github-runner-207 kernel: [11932.604074] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 08:42:38 juju-e4d256-prod-github-runner-207 kernel: [11932.604940] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 08:42:38 juju-e4d256-prod-github-runner-207 kernel: [11932.605742] ? __seccomp_filter+0x4a/0x4a0 Aug 22 08:42:38 juju-e4d256-prod-github-runner-207 kernel: [11932.606497] ? __fget_files+0x86/0xc0 Aug 22 08:42:38 juju-e4d256-prod-github-runner-207 kernel: [11932.607205] __x64_sys_ioctl+0x95/0xd0 Aug 22 08:42:38 juju-e4d256-prod-github-runner-207 kernel: [11932.607911] do_syscall_64+0x5c/0xc0 Aug 22 08:42:38 juju-e4d256-prod-github-runner-207 kernel: [11932.608590] ? do_futex+0x162/0x1f0 Aug 22 08:42:38 juju-e4d256-prod-github-runner-207 kernel: [11932.609516] ? __x64_sys_futex+0x78/0x1e0 Aug 22 08:42:38 juju-e4d256-prod-github-runner-207 kernel: [11932.610263] ? __secure_computing+0xa9/0x120 Aug 22 08:42:38 juju-e4d256-prod-github-runner-207 kernel: [11932.611086] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 08:42:38 juju-e4d256-prod-github-runner-207 kernel: [11932.611860] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:42:38 juju-e4d256-prod-github-runner-207 kernel: [11932.612587] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:42:38 juju-e4d256-prod-github-runner-207 kernel: [11932.613311] ? do_syscall_64+0x69/0xc0 Aug 22 08:42:38 juju-e4d256-prod-github-runner-207 kernel: [11932.613979] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:42:38 juju-e4d256-prod-github-runner-207 kernel: [11932.614714] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:42:38 juju-e4d256-prod-github-runner-207 kernel: [11932.615415] ? do_syscall_64+0x69/0xc0 Aug 22 08:42:38 juju-e4d256-prod-github-runner-207 kernel: [11932.616044] ? do_syscall_64+0x69/0xc0 Aug 22 08:42:38 juju-e4d256-prod-github-runner-207 kernel: [11932.616672] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 08:42:38 juju-e4d256-prod-github-runner-207 kernel: [11932.617383] RIP: 0033:0x7faa5d0edaff Aug 22 08:42:38 juju-e4d256-prod-github-runner-207 kernel: [11932.618018] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 08:42:38 juju-e4d256-prod-github-runner-207 kernel: [11932.620032] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 08:42:38 juju-e4d256-prod-github-runner-207 kernel: [11932.620959] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 08:42:38 juju-e4d256-prod-github-runner-207 kernel: [11932.621878] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 08:42:38 juju-e4d256-prod-github-runner-207 kernel: [11932.622776] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 08:42:38 juju-e4d256-prod-github-runner-207 kernel: [11932.623673] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 08:42:38 juju-e4d256-prod-github-runner-207 kernel: [11932.624584] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 08:42:38 juju-e4d256-prod-github-runner-207 kernel: [11932.625486] Aug 22 08:43:06 juju-e4d256-prod-github-runner-207 kernel: [11960.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 11031s! [qemu-system-x86:6715] Aug 22 08:43:06 juju-e4d256-prod-github-runner-207 kernel: [11960.543156] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 08:43:06 juju-e4d256-prod-github-runner-207 kernel: [11960.543247] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 08:43:06 juju-e4d256-prod-github-runner-207 kernel: [11960.556190] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 08:43:06 juju-e4d256-prod-github-runner-207 kernel: [11960.557455] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 08:43:06 juju-e4d256-prod-github-runner-207 kernel: [11960.558752] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:43:06 juju-e4d256-prod-github-runner-207 kernel: [11960.560104] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 08:43:06 juju-e4d256-prod-github-runner-207 kernel: [11960.562718] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 08:43:06 juju-e4d256-prod-github-runner-207 kernel: [11960.563796] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 08:43:06 juju-e4d256-prod-github-runner-207 kernel: [11960.565088] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 08:43:06 juju-e4d256-prod-github-runner-207 kernel: [11960.566365] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 08:43:06 juju-e4d256-prod-github-runner-207 kernel: [11960.567579] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 08:43:06 juju-e4d256-prod-github-runner-207 kernel: [11960.568793] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 08:43:06 juju-e4d256-prod-github-runner-207 kernel: [11960.570010] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 08:43:06 juju-e4d256-prod-github-runner-207 kernel: [11960.571252] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 08:43:06 juju-e4d256-prod-github-runner-207 kernel: [11960.572395] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 08:43:06 juju-e4d256-prod-github-runner-207 kernel: [11960.573666] Call Trace: Aug 22 08:43:06 juju-e4d256-prod-github-runner-207 kernel: [11960.574671] Aug 22 08:43:06 juju-e4d256-prod-github-runner-207 kernel: [11960.575592] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:43:06 juju-e4d256-prod-github-runner-207 kernel: [11960.576639] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:43:06 juju-e4d256-prod-github-runner-207 kernel: [11960.577686] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:43:06 juju-e4d256-prod-github-runner-207 kernel: [11960.578767] ? show_regs.part.0+0x23/0x29 Aug 22 08:43:06 juju-e4d256-prod-github-runner-207 kernel: [11960.579776] ? show_regs.cold+0x8/0xd Aug 22 08:43:06 juju-e4d256-prod-github-runner-207 kernel: [11960.580766] ? watchdog_timer_fn+0x1be/0x220 Aug 22 08:43:06 juju-e4d256-prod-github-runner-207 kernel: [11960.581806] ? lockup_detector_update_enable+0x60/0x60 Aug 22 08:43:06 juju-e4d256-prod-github-runner-207 kernel: [11960.582873] ? __hrtimer_run_queues+0x107/0x230 Aug 22 08:43:06 juju-e4d256-prod-github-runner-207 kernel: [11960.583909] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 08:43:06 juju-e4d256-prod-github-runner-207 kernel: [11960.584955] ? hrtimer_interrupt+0x101/0x220 Aug 22 08:43:06 juju-e4d256-prod-github-runner-207 kernel: [11960.586012] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 08:43:06 juju-e4d256-prod-github-runner-207 kernel: [11960.587088] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 08:43:06 juju-e4d256-prod-github-runner-207 kernel: [11960.588134] Aug 22 08:43:06 juju-e4d256-prod-github-runner-207 kernel: [11960.588987] Aug 22 08:43:06 juju-e4d256-prod-github-runner-207 kernel: [11960.589908] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 08:43:06 juju-e4d256-prod-github-runner-207 kernel: [11960.591178] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:43:06 juju-e4d256-prod-github-runner-207 kernel: [11960.592245] ? _raw_spin_lock+0x22/0x30 Aug 22 08:43:06 juju-e4d256-prod-github-runner-207 kernel: [11960.593199] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:43:06 juju-e4d256-prod-github-runner-207 kernel: [11960.594257] direct_page_fault+0x206/0x310 [kvm] Aug 22 08:43:06 juju-e4d256-prod-github-runner-207 kernel: [11960.595314] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 08:43:06 juju-e4d256-prod-github-runner-207 kernel: [11960.596366] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 08:43:06 juju-e4d256-prod-github-runner-207 kernel: [11960.597368] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 08:43:06 juju-e4d256-prod-github-runner-207 kernel: [11960.598365] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 08:43:06 juju-e4d256-prod-github-runner-207 kernel: [11960.599310] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 08:43:06 juju-e4d256-prod-github-runner-207 kernel: [11960.600304] handle_exit+0x98/0x230 [kvm_amd] Aug 22 08:43:06 juju-e4d256-prod-github-runner-207 kernel: [11960.601212] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 08:43:06 juju-e4d256-prod-github-runner-207 kernel: [11960.602150] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 08:43:06 juju-e4d256-prod-github-runner-207 kernel: [11960.603087] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 08:43:06 juju-e4d256-prod-github-runner-207 kernel: [11960.603992] vcpu_run+0x62/0x2c0 [kvm] Aug 22 08:43:06 juju-e4d256-prod-github-runner-207 kernel: [11960.604811] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 08:43:06 juju-e4d256-prod-github-runner-207 kernel: [11960.605680] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 08:43:06 juju-e4d256-prod-github-runner-207 kernel: [11960.606560] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 08:43:06 juju-e4d256-prod-github-runner-207 kernel: [11960.607369] ? __seccomp_filter+0x4a/0x4a0 Aug 22 08:43:06 juju-e4d256-prod-github-runner-207 kernel: [11960.608114] ? __fget_files+0x86/0xc0 Aug 22 08:43:06 juju-e4d256-prod-github-runner-207 kernel: [11960.608820] __x64_sys_ioctl+0x95/0xd0 Aug 22 08:43:06 juju-e4d256-prod-github-runner-207 kernel: [11960.609544] do_syscall_64+0x5c/0xc0 Aug 22 08:43:06 juju-e4d256-prod-github-runner-207 kernel: [11960.610230] ? do_futex+0x162/0x1f0 Aug 22 08:43:06 juju-e4d256-prod-github-runner-207 kernel: [11960.610885] ? __x64_sys_futex+0x78/0x1e0 Aug 22 08:43:06 juju-e4d256-prod-github-runner-207 kernel: [11960.611756] ? __secure_computing+0xa9/0x120 Aug 22 08:43:06 juju-e4d256-prod-github-runner-207 kernel: [11960.612597] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 08:43:06 juju-e4d256-prod-github-runner-207 kernel: [11960.613362] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:43:06 juju-e4d256-prod-github-runner-207 kernel: [11960.614111] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:43:06 juju-e4d256-prod-github-runner-207 kernel: [11960.614830] ? do_syscall_64+0x69/0xc0 Aug 22 08:43:06 juju-e4d256-prod-github-runner-207 kernel: [11960.615488] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:43:06 juju-e4d256-prod-github-runner-207 kernel: [11960.616210] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:43:06 juju-e4d256-prod-github-runner-207 kernel: [11960.616926] ? do_syscall_64+0x69/0xc0 Aug 22 08:43:06 juju-e4d256-prod-github-runner-207 kernel: [11960.617568] ? do_syscall_64+0x69/0xc0 Aug 22 08:43:06 juju-e4d256-prod-github-runner-207 kernel: [11960.618199] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 08:43:06 juju-e4d256-prod-github-runner-207 kernel: [11960.618911] RIP: 0033:0x7faa5d0edaff Aug 22 08:43:06 juju-e4d256-prod-github-runner-207 kernel: [11960.619540] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 08:43:06 juju-e4d256-prod-github-runner-207 kernel: [11960.621809] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 08:43:06 juju-e4d256-prod-github-runner-207 kernel: [11960.622760] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 08:43:06 juju-e4d256-prod-github-runner-207 kernel: [11960.623655] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 08:43:06 juju-e4d256-prod-github-runner-207 kernel: [11960.624587] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 08:43:06 juju-e4d256-prod-github-runner-207 kernel: [11960.625644] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 08:43:06 juju-e4d256-prod-github-runner-207 kernel: [11960.626574] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 08:43:06 juju-e4d256-prod-github-runner-207 kernel: [11960.627503] Aug 22 08:43:34 juju-e4d256-prod-github-runner-207 kernel: [11988.541981] watchdog: BUG: soft lockup - CPU#1 stuck for 11057s! [qemu-system-x86:6715] Aug 22 08:43:34 juju-e4d256-prod-github-runner-207 kernel: [11988.544389] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 08:43:34 juju-e4d256-prod-github-runner-207 kernel: [11988.544727] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 08:43:34 juju-e4d256-prod-github-runner-207 kernel: [11988.559434] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 08:43:34 juju-e4d256-prod-github-runner-207 kernel: [11988.560706] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 08:43:34 juju-e4d256-prod-github-runner-207 kernel: [11988.561956] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:43:34 juju-e4d256-prod-github-runner-207 kernel: [11988.563023] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 08:43:34 juju-e4d256-prod-github-runner-207 kernel: [11988.565586] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 08:43:34 juju-e4d256-prod-github-runner-207 kernel: [11988.566625] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 08:43:34 juju-e4d256-prod-github-runner-207 kernel: [11988.567787] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 08:43:34 juju-e4d256-prod-github-runner-207 kernel: [11988.568942] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 08:43:34 juju-e4d256-prod-github-runner-207 kernel: [11988.570103] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 08:43:34 juju-e4d256-prod-github-runner-207 kernel: [11988.571264] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 08:43:34 juju-e4d256-prod-github-runner-207 kernel: [11988.572456] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 08:43:34 juju-e4d256-prod-github-runner-207 kernel: [11988.573762] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 08:43:34 juju-e4d256-prod-github-runner-207 kernel: [11988.574875] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 08:43:34 juju-e4d256-prod-github-runner-207 kernel: [11988.576072] Call Trace: Aug 22 08:43:34 juju-e4d256-prod-github-runner-207 kernel: [11988.576993] Aug 22 08:43:34 juju-e4d256-prod-github-runner-207 kernel: [11988.577918] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:43:34 juju-e4d256-prod-github-runner-207 kernel: [11988.578953] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:43:34 juju-e4d256-prod-github-runner-207 kernel: [11988.579976] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:43:34 juju-e4d256-prod-github-runner-207 kernel: [11988.581070] ? show_regs.part.0+0x23/0x29 Aug 22 08:43:34 juju-e4d256-prod-github-runner-207 kernel: [11988.582171] ? show_regs.cold+0x8/0xd Aug 22 08:43:34 juju-e4d256-prod-github-runner-207 kernel: [11988.583162] ? watchdog_timer_fn+0x1be/0x220 Aug 22 08:43:34 juju-e4d256-prod-github-runner-207 kernel: [11988.584171] ? lockup_detector_update_enable+0x60/0x60 Aug 22 08:43:34 juju-e4d256-prod-github-runner-207 kernel: [11988.585248] ? __hrtimer_run_queues+0x107/0x230 Aug 22 08:43:34 juju-e4d256-prod-github-runner-207 kernel: [11988.586276] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 08:43:34 juju-e4d256-prod-github-runner-207 kernel: [11988.587299] ? hrtimer_interrupt+0x101/0x220 Aug 22 08:43:34 juju-e4d256-prod-github-runner-207 kernel: [11988.588333] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 08:43:34 juju-e4d256-prod-github-runner-207 kernel: [11988.589421] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 08:43:34 juju-e4d256-prod-github-runner-207 kernel: [11988.590469] Aug 22 08:43:34 juju-e4d256-prod-github-runner-207 kernel: [11988.591322] Aug 22 08:43:34 juju-e4d256-prod-github-runner-207 kernel: [11988.592159] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 08:43:34 juju-e4d256-prod-github-runner-207 kernel: [11988.593214] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:43:34 juju-e4d256-prod-github-runner-207 kernel: [11988.594254] ? _raw_spin_lock+0x22/0x30 Aug 22 08:43:34 juju-e4d256-prod-github-runner-207 kernel: [11988.595203] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:43:34 juju-e4d256-prod-github-runner-207 kernel: [11988.596221] direct_page_fault+0x206/0x310 [kvm] Aug 22 08:43:34 juju-e4d256-prod-github-runner-207 kernel: [11988.597255] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 08:43:34 juju-e4d256-prod-github-runner-207 kernel: [11988.598269] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 08:43:34 juju-e4d256-prod-github-runner-207 kernel: [11988.599270] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 08:43:34 juju-e4d256-prod-github-runner-207 kernel: [11988.600281] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 08:43:34 juju-e4d256-prod-github-runner-207 kernel: [11988.601313] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 08:43:34 juju-e4d256-prod-github-runner-207 kernel: [11988.602293] handle_exit+0x98/0x230 [kvm_amd] Aug 22 08:43:34 juju-e4d256-prod-github-runner-207 kernel: [11988.603186] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 08:43:34 juju-e4d256-prod-github-runner-207 kernel: [11988.604101] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 08:43:34 juju-e4d256-prod-github-runner-207 kernel: [11988.605026] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 08:43:34 juju-e4d256-prod-github-runner-207 kernel: [11988.605938] vcpu_run+0x62/0x2c0 [kvm] Aug 22 08:43:34 juju-e4d256-prod-github-runner-207 kernel: [11988.606747] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 08:43:34 juju-e4d256-prod-github-runner-207 kernel: [11988.607558] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 08:43:34 juju-e4d256-prod-github-runner-207 kernel: [11988.608416] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 08:43:34 juju-e4d256-prod-github-runner-207 kernel: [11988.609229] ? __seccomp_filter+0x4a/0x4a0 Aug 22 08:43:34 juju-e4d256-prod-github-runner-207 kernel: [11988.609976] ? __fget_files+0x86/0xc0 Aug 22 08:43:34 juju-e4d256-prod-github-runner-207 kernel: [11988.610684] __x64_sys_ioctl+0x95/0xd0 Aug 22 08:43:34 juju-e4d256-prod-github-runner-207 kernel: [11988.611382] do_syscall_64+0x5c/0xc0 Aug 22 08:43:34 juju-e4d256-prod-github-runner-207 kernel: [11988.612047] ? do_futex+0x162/0x1f0 Aug 22 08:43:34 juju-e4d256-prod-github-runner-207 kernel: [11988.612705] ? __x64_sys_futex+0x78/0x1e0 Aug 22 08:43:34 juju-e4d256-prod-github-runner-207 kernel: [11988.613427] ? __secure_computing+0xa9/0x120 Aug 22 08:43:34 juju-e4d256-prod-github-runner-207 kernel: [11988.614122] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 08:43:34 juju-e4d256-prod-github-runner-207 kernel: [11988.614882] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:43:34 juju-e4d256-prod-github-runner-207 kernel: [11988.615603] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:43:34 juju-e4d256-prod-github-runner-207 kernel: [11988.616320] ? do_syscall_64+0x69/0xc0 Aug 22 08:43:34 juju-e4d256-prod-github-runner-207 kernel: [11988.616965] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:43:34 juju-e4d256-prod-github-runner-207 kernel: [11988.617685] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:43:34 juju-e4d256-prod-github-runner-207 kernel: [11988.618378] ? do_syscall_64+0x69/0xc0 Aug 22 08:43:34 juju-e4d256-prod-github-runner-207 kernel: [11988.619003] ? do_syscall_64+0x69/0xc0 Aug 22 08:43:34 juju-e4d256-prod-github-runner-207 kernel: [11988.619625] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 08:43:34 juju-e4d256-prod-github-runner-207 kernel: [11988.620337] RIP: 0033:0x7faa5d0edaff Aug 22 08:43:34 juju-e4d256-prod-github-runner-207 kernel: [11988.620984] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 08:43:34 juju-e4d256-prod-github-runner-207 kernel: [11988.622983] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 08:43:34 juju-e4d256-prod-github-runner-207 kernel: [11988.623894] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 08:43:34 juju-e4d256-prod-github-runner-207 kernel: [11988.624784] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 08:43:34 juju-e4d256-prod-github-runner-207 kernel: [11988.625688] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 08:43:34 juju-e4d256-prod-github-runner-207 kernel: [11988.626583] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 08:43:34 juju-e4d256-prod-github-runner-207 kernel: [11988.627489] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 08:43:34 juju-e4d256-prod-github-runner-207 kernel: [11988.628380] Aug 22 08:44:02 juju-e4d256-prod-github-runner-207 kernel: [12016.541980] watchdog: BUG: soft lockup - CPU#1 stuck for 11083s! [qemu-system-x86:6715] Aug 22 08:44:02 juju-e4d256-prod-github-runner-207 kernel: [12016.543112] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 08:44:02 juju-e4d256-prod-github-runner-207 kernel: [12016.543186] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 08:44:02 juju-e4d256-prod-github-runner-207 kernel: [12016.555570] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 08:44:02 juju-e4d256-prod-github-runner-207 kernel: [12016.556883] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 08:44:02 juju-e4d256-prod-github-runner-207 kernel: [12016.558124] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:44:02 juju-e4d256-prod-github-runner-207 kernel: [12016.559252] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 08:44:02 juju-e4d256-prod-github-runner-207 kernel: [12016.562234] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 08:44:02 juju-e4d256-prod-github-runner-207 kernel: [12016.563405] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 08:44:02 juju-e4d256-prod-github-runner-207 kernel: [12016.564730] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 08:44:02 juju-e4d256-prod-github-runner-207 kernel: [12016.566055] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 08:44:02 juju-e4d256-prod-github-runner-207 kernel: [12016.567362] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 08:44:02 juju-e4d256-prod-github-runner-207 kernel: [12016.568684] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 08:44:02 juju-e4d256-prod-github-runner-207 kernel: [12016.570019] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 08:44:02 juju-e4d256-prod-github-runner-207 kernel: [12016.571411] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 08:44:02 juju-e4d256-prod-github-runner-207 kernel: [12016.572855] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 08:44:02 juju-e4d256-prod-github-runner-207 kernel: [12016.574411] Call Trace: Aug 22 08:44:02 juju-e4d256-prod-github-runner-207 kernel: [12016.575400] Aug 22 08:44:02 juju-e4d256-prod-github-runner-207 kernel: [12016.576347] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:44:02 juju-e4d256-prod-github-runner-207 kernel: [12016.577501] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:44:02 juju-e4d256-prod-github-runner-207 kernel: [12016.578620] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:44:02 juju-e4d256-prod-github-runner-207 kernel: [12016.579797] ? show_regs.part.0+0x23/0x29 Aug 22 08:44:02 juju-e4d256-prod-github-runner-207 kernel: [12016.580897] ? show_regs.cold+0x8/0xd Aug 22 08:44:02 juju-e4d256-prod-github-runner-207 kernel: [12016.581953] ? watchdog_timer_fn+0x1be/0x220 Aug 22 08:44:02 juju-e4d256-prod-github-runner-207 kernel: [12016.583056] ? lockup_detector_update_enable+0x60/0x60 Aug 22 08:44:02 juju-e4d256-prod-github-runner-207 kernel: [12016.584235] ? __hrtimer_run_queues+0x107/0x230 Aug 22 08:44:02 juju-e4d256-prod-github-runner-207 kernel: [12016.585396] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 08:44:02 juju-e4d256-prod-github-runner-207 kernel: [12016.586518] ? hrtimer_interrupt+0x101/0x220 Aug 22 08:44:02 juju-e4d256-prod-github-runner-207 kernel: [12016.587627] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 08:44:02 juju-e4d256-prod-github-runner-207 kernel: [12016.588823] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 08:44:02 juju-e4d256-prod-github-runner-207 kernel: [12016.589981] Aug 22 08:44:02 juju-e4d256-prod-github-runner-207 kernel: [12016.590892] Aug 22 08:44:02 juju-e4d256-prod-github-runner-207 kernel: [12016.591785] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 08:44:02 juju-e4d256-prod-github-runner-207 kernel: [12016.592968] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:44:02 juju-e4d256-prod-github-runner-207 kernel: [12016.594123] ? _raw_spin_lock+0x22/0x30 Aug 22 08:44:02 juju-e4d256-prod-github-runner-207 kernel: [12016.595162] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:44:02 juju-e4d256-prod-github-runner-207 kernel: [12016.596284] direct_page_fault+0x206/0x310 [kvm] Aug 22 08:44:02 juju-e4d256-prod-github-runner-207 kernel: [12016.597437] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 08:44:02 juju-e4d256-prod-github-runner-207 kernel: [12016.598562] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 08:44:02 juju-e4d256-prod-github-runner-207 kernel: [12016.599661] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 08:44:02 juju-e4d256-prod-github-runner-207 kernel: [12016.600734] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 08:44:02 juju-e4d256-prod-github-runner-207 kernel: [12016.601795] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 08:44:02 juju-e4d256-prod-github-runner-207 kernel: [12016.602889] handle_exit+0x98/0x230 [kvm_amd] Aug 22 08:44:02 juju-e4d256-prod-github-runner-207 kernel: [12016.603871] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 08:44:02 juju-e4d256-prod-github-runner-207 kernel: [12016.604906] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 08:44:02 juju-e4d256-prod-github-runner-207 kernel: [12016.605951] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 08:44:02 juju-e4d256-prod-github-runner-207 kernel: [12016.606960] vcpu_run+0x62/0x2c0 [kvm] Aug 22 08:44:02 juju-e4d256-prod-github-runner-207 kernel: [12016.607849] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 08:44:02 juju-e4d256-prod-github-runner-207 kernel: [12016.608753] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 08:44:02 juju-e4d256-prod-github-runner-207 kernel: [12016.609732] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 08:44:02 juju-e4d256-prod-github-runner-207 kernel: [12016.610627] ? __seccomp_filter+0x4a/0x4a0 Aug 22 08:44:02 juju-e4d256-prod-github-runner-207 kernel: [12016.611461] ? __fget_files+0x86/0xc0 Aug 22 08:44:02 juju-e4d256-prod-github-runner-207 kernel: [12016.612248] __x64_sys_ioctl+0x95/0xd0 Aug 22 08:44:02 juju-e4d256-prod-github-runner-207 kernel: [12016.612995] do_syscall_64+0x5c/0xc0 Aug 22 08:44:02 juju-e4d256-prod-github-runner-207 kernel: [12016.613677] ? do_futex+0x162/0x1f0 Aug 22 08:44:02 juju-e4d256-prod-github-runner-207 kernel: [12016.614332] ? __x64_sys_futex+0x78/0x1e0 Aug 22 08:44:02 juju-e4d256-prod-github-runner-207 kernel: [12016.615013] ? __secure_computing+0xa9/0x120 Aug 22 08:44:02 juju-e4d256-prod-github-runner-207 kernel: [12016.615709] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 08:44:02 juju-e4d256-prod-github-runner-207 kernel: [12016.616476] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:44:02 juju-e4d256-prod-github-runner-207 kernel: [12016.617224] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:44:02 juju-e4d256-prod-github-runner-207 kernel: [12016.617953] ? do_syscall_64+0x69/0xc0 Aug 22 08:44:02 juju-e4d256-prod-github-runner-207 kernel: [12016.618606] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:44:02 juju-e4d256-prod-github-runner-207 kernel: [12016.619341] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:44:02 juju-e4d256-prod-github-runner-207 kernel: [12016.620045] ? do_syscall_64+0x69/0xc0 Aug 22 08:44:02 juju-e4d256-prod-github-runner-207 kernel: [12016.620768] ? do_syscall_64+0x69/0xc0 Aug 22 08:44:02 juju-e4d256-prod-github-runner-207 kernel: [12016.621494] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 08:44:02 juju-e4d256-prod-github-runner-207 kernel: [12016.622314] RIP: 0033:0x7faa5d0edaff Aug 22 08:44:02 juju-e4d256-prod-github-runner-207 kernel: [12016.623044] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 08:44:02 juju-e4d256-prod-github-runner-207 kernel: [12016.625412] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 08:44:02 juju-e4d256-prod-github-runner-207 kernel: [12016.626479] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 08:44:02 juju-e4d256-prod-github-runner-207 kernel: [12016.627514] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 08:44:02 juju-e4d256-prod-github-runner-207 kernel: [12016.628557] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 08:44:02 juju-e4d256-prod-github-runner-207 kernel: [12016.629599] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 08:44:02 juju-e4d256-prod-github-runner-207 kernel: [12016.630629] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 08:44:02 juju-e4d256-prod-github-runner-207 kernel: [12016.631668] Aug 22 08:44:30 juju-e4d256-prod-github-runner-207 kernel: [12044.542007] watchdog: BUG: soft lockup - CPU#1 stuck for 11109s! [qemu-system-x86:6715] Aug 22 08:44:30 juju-e4d256-prod-github-runner-207 kernel: [12044.543161] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 08:44:30 juju-e4d256-prod-github-runner-207 kernel: [12044.543236] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 08:44:30 juju-e4d256-prod-github-runner-207 kernel: [12044.556095] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 08:44:30 juju-e4d256-prod-github-runner-207 kernel: [12044.557438] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 08:44:30 juju-e4d256-prod-github-runner-207 kernel: [12044.558706] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:44:30 juju-e4d256-prod-github-runner-207 kernel: [12044.559809] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 08:44:30 juju-e4d256-prod-github-runner-207 kernel: [12044.562517] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 08:44:30 juju-e4d256-prod-github-runner-207 kernel: [12044.563598] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 08:44:30 juju-e4d256-prod-github-runner-207 kernel: [12044.564801] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 08:44:30 juju-e4d256-prod-github-runner-207 kernel: [12044.566038] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 08:44:30 juju-e4d256-prod-github-runner-207 kernel: [12044.567258] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 08:44:30 juju-e4d256-prod-github-runner-207 kernel: [12044.568450] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 08:44:30 juju-e4d256-prod-github-runner-207 kernel: [12044.569672] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 08:44:30 juju-e4d256-prod-github-runner-207 kernel: [12044.571016] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 08:44:30 juju-e4d256-prod-github-runner-207 kernel: [12044.572190] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 08:44:30 juju-e4d256-prod-github-runner-207 kernel: [12044.573479] Call Trace: Aug 22 08:44:30 juju-e4d256-prod-github-runner-207 kernel: [12044.574622] Aug 22 08:44:30 juju-e4d256-prod-github-runner-207 kernel: [12044.575581] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:44:30 juju-e4d256-prod-github-runner-207 kernel: [12044.576839] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:44:30 juju-e4d256-prod-github-runner-207 kernel: [12044.577882] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:44:30 juju-e4d256-prod-github-runner-207 kernel: [12044.578966] ? show_regs.part.0+0x23/0x29 Aug 22 08:44:30 juju-e4d256-prod-github-runner-207 kernel: [12044.579992] ? show_regs.cold+0x8/0xd Aug 22 08:44:30 juju-e4d256-prod-github-runner-207 kernel: [12044.581017] ? watchdog_timer_fn+0x1be/0x220 Aug 22 08:44:30 juju-e4d256-prod-github-runner-207 kernel: [12044.582083] ? lockup_detector_update_enable+0x60/0x60 Aug 22 08:44:30 juju-e4d256-prod-github-runner-207 kernel: [12044.583359] ? __hrtimer_run_queues+0x107/0x230 Aug 22 08:44:30 juju-e4d256-prod-github-runner-207 kernel: [12044.584401] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 08:44:30 juju-e4d256-prod-github-runner-207 kernel: [12044.585533] ? hrtimer_interrupt+0x101/0x220 Aug 22 08:44:30 juju-e4d256-prod-github-runner-207 kernel: [12044.586611] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 08:44:30 juju-e4d256-prod-github-runner-207 kernel: [12044.587713] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 08:44:30 juju-e4d256-prod-github-runner-207 kernel: [12044.588796] Aug 22 08:44:30 juju-e4d256-prod-github-runner-207 kernel: [12044.589716] Aug 22 08:44:30 juju-e4d256-prod-github-runner-207 kernel: [12044.590568] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 08:44:30 juju-e4d256-prod-github-runner-207 kernel: [12044.591616] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:44:30 juju-e4d256-prod-github-runner-207 kernel: [12044.592702] ? _raw_spin_lock+0x22/0x30 Aug 22 08:44:30 juju-e4d256-prod-github-runner-207 kernel: [12044.593656] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:44:30 juju-e4d256-prod-github-runner-207 kernel: [12044.594687] direct_page_fault+0x206/0x310 [kvm] Aug 22 08:44:30 juju-e4d256-prod-github-runner-207 kernel: [12044.595779] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 08:44:30 juju-e4d256-prod-github-runner-207 kernel: [12044.596863] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 08:44:30 juju-e4d256-prod-github-runner-207 kernel: [12044.597951] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 08:44:30 juju-e4d256-prod-github-runner-207 kernel: [12044.598930] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 08:44:30 juju-e4d256-prod-github-runner-207 kernel: [12044.599889] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 08:44:30 juju-e4d256-prod-github-runner-207 kernel: [12044.600905] handle_exit+0x98/0x230 [kvm_amd] Aug 22 08:44:30 juju-e4d256-prod-github-runner-207 kernel: [12044.601825] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 08:44:30 juju-e4d256-prod-github-runner-207 kernel: [12044.602762] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 08:44:30 juju-e4d256-prod-github-runner-207 kernel: [12044.603776] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 08:44:30 juju-e4d256-prod-github-runner-207 kernel: [12044.604802] vcpu_run+0x62/0x2c0 [kvm] Aug 22 08:44:30 juju-e4d256-prod-github-runner-207 kernel: [12044.605637] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 08:44:30 juju-e4d256-prod-github-runner-207 kernel: [12044.606466] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 08:44:30 juju-e4d256-prod-github-runner-207 kernel: [12044.607346] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 08:44:30 juju-e4d256-prod-github-runner-207 kernel: [12044.608208] ? __seccomp_filter+0x4a/0x4a0 Aug 22 08:44:30 juju-e4d256-prod-github-runner-207 kernel: [12044.609006] ? __fget_files+0x86/0xc0 Aug 22 08:44:30 juju-e4d256-prod-github-runner-207 kernel: [12044.609730] __x64_sys_ioctl+0x95/0xd0 Aug 22 08:44:30 juju-e4d256-prod-github-runner-207 kernel: [12044.610429] do_syscall_64+0x5c/0xc0 Aug 22 08:44:30 juju-e4d256-prod-github-runner-207 kernel: [12044.611103] ? do_futex+0x162/0x1f0 Aug 22 08:44:30 juju-e4d256-prod-github-runner-207 kernel: [12044.611783] ? __x64_sys_futex+0x78/0x1e0 Aug 22 08:44:30 juju-e4d256-prod-github-runner-207 kernel: [12044.612517] ? __secure_computing+0xa9/0x120 Aug 22 08:44:30 juju-e4d256-prod-github-runner-207 kernel: [12044.613257] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 08:44:30 juju-e4d256-prod-github-runner-207 kernel: [12044.614028] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:44:30 juju-e4d256-prod-github-runner-207 kernel: [12044.614754] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:44:30 juju-e4d256-prod-github-runner-207 kernel: [12044.615478] ? do_syscall_64+0x69/0xc0 Aug 22 08:44:30 juju-e4d256-prod-github-runner-207 kernel: [12044.616128] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:44:30 juju-e4d256-prod-github-runner-207 kernel: [12044.616868] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:44:30 juju-e4d256-prod-github-runner-207 kernel: [12044.617585] ? do_syscall_64+0x69/0xc0 Aug 22 08:44:30 juju-e4d256-prod-github-runner-207 kernel: [12044.618236] ? do_syscall_64+0x69/0xc0 Aug 22 08:44:30 juju-e4d256-prod-github-runner-207 kernel: [12044.618868] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 08:44:30 juju-e4d256-prod-github-runner-207 kernel: [12044.619585] RIP: 0033:0x7faa5d0edaff Aug 22 08:44:30 juju-e4d256-prod-github-runner-207 kernel: [12044.620223] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 08:44:30 juju-e4d256-prod-github-runner-207 kernel: [12044.622359] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 08:44:30 juju-e4d256-prod-github-runner-207 kernel: [12044.623301] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 08:44:30 juju-e4d256-prod-github-runner-207 kernel: [12044.624251] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 08:44:30 juju-e4d256-prod-github-runner-207 kernel: [12044.625173] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 08:44:30 juju-e4d256-prod-github-runner-207 kernel: [12044.626073] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 08:44:30 juju-e4d256-prod-github-runner-207 kernel: [12044.626963] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 08:44:30 juju-e4d256-prod-github-runner-207 kernel: [12044.627902] Aug 22 08:44:44 juju-e4d256-prod-github-runner-207 kernel: [12057.992706] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 08:44:44 juju-e4d256-prod-github-runner-207 kernel: [12057.993668] rcu: 1-....: (2975840 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=1438323 Aug 22 08:44:44 juju-e4d256-prod-github-runner-207 kernel: [12057.994780] (t=2985198 jiffies g=23269 q=20202) Aug 22 08:44:44 juju-e4d256-prod-github-runner-207 kernel: [12057.995565] NMI backtrace for cpu 1 Aug 22 08:44:44 juju-e4d256-prod-github-runner-207 kernel: [12057.996272] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 08:44:44 juju-e4d256-prod-github-runner-207 kernel: [12057.997382] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 08:44:44 juju-e4d256-prod-github-runner-207 kernel: [12057.998450] Call Trace: Aug 22 08:44:44 juju-e4d256-prod-github-runner-207 kernel: [12057.999121] Aug 22 08:44:44 juju-e4d256-prod-github-runner-207 kernel: [12057.999761] show_stack+0x52/0x5c Aug 22 08:44:44 juju-e4d256-prod-github-runner-207 kernel: [12058.000518] dump_stack_lvl+0x4a/0x63 Aug 22 08:44:44 juju-e4d256-prod-github-runner-207 kernel: [12058.001268] dump_stack+0x10/0x16 Aug 22 08:44:44 juju-e4d256-prod-github-runner-207 kernel: [12058.001997] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 08:44:44 juju-e4d256-prod-github-runner-207 kernel: [12058.002779] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 08:44:44 juju-e4d256-prod-github-runner-207 kernel: [12058.003566] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 08:44:44 juju-e4d256-prod-github-runner-207 kernel: [12058.004406] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 08:44:44 juju-e4d256-prod-github-runner-207 kernel: [12058.005236] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 08:44:44 juju-e4d256-prod-github-runner-207 kernel: [12058.006044] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 08:44:44 juju-e4d256-prod-github-runner-207 kernel: [12058.006813] print_cpu_stall.cold+0x2f/0xe2 Aug 22 08:44:44 juju-e4d256-prod-github-runner-207 kernel: [12058.007579] ? timekeeping_update+0xf7/0x150 Aug 22 08:44:44 juju-e4d256-prod-github-runner-207 kernel: [12058.008381] check_cpu_stall+0x109/0x270 Aug 22 08:44:44 juju-e4d256-prod-github-runner-207 kernel: [12058.009186] rcu_sched_clock_irq+0x9a/0x250 Aug 22 08:44:44 juju-e4d256-prod-github-runner-207 kernel: [12058.009948] update_process_times+0x94/0xd0 Aug 22 08:44:44 juju-e4d256-prod-github-runner-207 kernel: [12058.010705] tick_sched_handle+0x29/0x70 Aug 22 08:44:44 juju-e4d256-prod-github-runner-207 kernel: [12058.011466] tick_sched_timer+0x8c/0xc0 Aug 22 08:44:44 juju-e4d256-prod-github-runner-207 kernel: [12058.012206] ? tick_nohz_handler+0xb0/0xb0 Aug 22 08:44:44 juju-e4d256-prod-github-runner-207 kernel: [12058.013002] __hrtimer_run_queues+0x107/0x230 Aug 22 08:44:44 juju-e4d256-prod-github-runner-207 kernel: [12058.013786] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 08:44:44 juju-e4d256-prod-github-runner-207 kernel: [12058.014557] hrtimer_interrupt+0x101/0x220 Aug 22 08:44:44 juju-e4d256-prod-github-runner-207 kernel: [12058.015336] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 08:44:44 juju-e4d256-prod-github-runner-207 kernel: [12058.016158] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 08:44:44 juju-e4d256-prod-github-runner-207 kernel: [12058.017008] Aug 22 08:44:44 juju-e4d256-prod-github-runner-207 kernel: [12058.017641] Aug 22 08:44:44 juju-e4d256-prod-github-runner-207 kernel: [12058.018265] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 08:44:44 juju-e4d256-prod-github-runner-207 kernel: [12058.019077] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:44:44 juju-e4d256-prod-github-runner-207 kernel: [12058.019949] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 08:44:44 juju-e4d256-prod-github-runner-207 kernel: [12058.022163] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 08:44:44 juju-e4d256-prod-github-runner-207 kernel: [12058.023034] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 08:44:44 juju-e4d256-prod-github-runner-207 kernel: [12058.024018] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 08:44:44 juju-e4d256-prod-github-runner-207 kernel: [12058.024996] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 08:44:44 juju-e4d256-prod-github-runner-207 kernel: [12058.025966] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 08:44:44 juju-e4d256-prod-github-runner-207 kernel: [12058.026932] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 08:44:44 juju-e4d256-prod-github-runner-207 kernel: [12058.027884] ? _raw_spin_lock+0x22/0x30 Aug 22 08:44:44 juju-e4d256-prod-github-runner-207 kernel: [12058.028660] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:44:44 juju-e4d256-prod-github-runner-207 kernel: [12058.029507] direct_page_fault+0x206/0x310 [kvm] Aug 22 08:44:44 juju-e4d256-prod-github-runner-207 kernel: [12058.030348] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 08:44:44 juju-e4d256-prod-github-runner-207 kernel: [12058.031176] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 08:44:44 juju-e4d256-prod-github-runner-207 kernel: [12058.031996] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 08:44:44 juju-e4d256-prod-github-runner-207 kernel: [12058.032820] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 08:44:44 juju-e4d256-prod-github-runner-207 kernel: [12058.033605] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 08:44:44 juju-e4d256-prod-github-runner-207 kernel: [12058.034428] handle_exit+0x98/0x230 [kvm_amd] Aug 22 08:44:44 juju-e4d256-prod-github-runner-207 kernel: [12058.035179] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 08:44:44 juju-e4d256-prod-github-runner-207 kernel: [12058.036000] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 08:44:44 juju-e4d256-prod-github-runner-207 kernel: [12058.036841] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 08:44:44 juju-e4d256-prod-github-runner-207 kernel: [12058.037647] vcpu_run+0x62/0x2c0 [kvm] Aug 22 08:44:44 juju-e4d256-prod-github-runner-207 kernel: [12058.038369] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 08:44:44 juju-e4d256-prod-github-runner-207 kernel: [12058.039099] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 08:44:44 juju-e4d256-prod-github-runner-207 kernel: [12058.039897] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 08:44:44 juju-e4d256-prod-github-runner-207 kernel: [12058.040679] ? __seccomp_filter+0x4a/0x4a0 Aug 22 08:44:44 juju-e4d256-prod-github-runner-207 kernel: [12058.041407] ? __fget_files+0x86/0xc0 Aug 22 08:44:44 juju-e4d256-prod-github-runner-207 kernel: [12058.042099] __x64_sys_ioctl+0x95/0xd0 Aug 22 08:44:44 juju-e4d256-prod-github-runner-207 kernel: [12058.042795] do_syscall_64+0x5c/0xc0 Aug 22 08:44:44 juju-e4d256-prod-github-runner-207 kernel: [12058.043515] ? do_futex+0x162/0x1f0 Aug 22 08:44:44 juju-e4d256-prod-github-runner-207 kernel: [12058.044196] ? __x64_sys_futex+0x78/0x1e0 Aug 22 08:44:44 juju-e4d256-prod-github-runner-207 kernel: [12058.044914] ? __secure_computing+0xa9/0x120 Aug 22 08:44:44 juju-e4d256-prod-github-runner-207 kernel: [12058.045631] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 08:44:44 juju-e4d256-prod-github-runner-207 kernel: [12058.046436] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:44:44 juju-e4d256-prod-github-runner-207 kernel: [12058.047195] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:44:44 juju-e4d256-prod-github-runner-207 kernel: [12058.047966] ? do_syscall_64+0x69/0xc0 Aug 22 08:44:44 juju-e4d256-prod-github-runner-207 kernel: [12058.048680] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:44:44 juju-e4d256-prod-github-runner-207 kernel: [12058.049440] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:44:44 juju-e4d256-prod-github-runner-207 kernel: [12058.050238] ? do_syscall_64+0x69/0xc0 Aug 22 08:44:44 juju-e4d256-prod-github-runner-207 kernel: [12058.050928] ? do_syscall_64+0x69/0xc0 Aug 22 08:44:44 juju-e4d256-prod-github-runner-207 kernel: [12058.051612] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 08:44:44 juju-e4d256-prod-github-runner-207 kernel: [12058.052396] RIP: 0033:0x7faa5d0edaff Aug 22 08:44:44 juju-e4d256-prod-github-runner-207 kernel: [12058.053077] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 08:44:44 juju-e4d256-prod-github-runner-207 kernel: [12058.055159] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 08:44:44 juju-e4d256-prod-github-runner-207 kernel: [12058.056121] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 08:44:44 juju-e4d256-prod-github-runner-207 kernel: [12058.057074] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 08:44:44 juju-e4d256-prod-github-runner-207 kernel: [12058.058013] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 08:44:44 juju-e4d256-prod-github-runner-207 kernel: [12058.058952] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 08:44:44 juju-e4d256-prod-github-runner-207 kernel: [12058.059874] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 08:44:44 juju-e4d256-prod-github-runner-207 kernel: [12058.060792] Aug 22 08:45:10 juju-e4d256-prod-github-runner-207 kernel: [12084.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 11146s! [qemu-system-x86:6715] Aug 22 08:45:10 juju-e4d256-prod-github-runner-207 kernel: [12084.543885] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 08:45:10 juju-e4d256-prod-github-runner-207 kernel: [12084.544209] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 08:45:10 juju-e4d256-prod-github-runner-207 kernel: [12084.556676] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 08:45:10 juju-e4d256-prod-github-runner-207 kernel: [12084.557940] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 08:45:10 juju-e4d256-prod-github-runner-207 kernel: [12084.559153] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:45:10 juju-e4d256-prod-github-runner-207 kernel: [12084.560231] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 08:45:10 juju-e4d256-prod-github-runner-207 kernel: [12084.562775] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 08:45:10 juju-e4d256-prod-github-runner-207 kernel: [12084.563820] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 08:45:10 juju-e4d256-prod-github-runner-207 kernel: [12084.564986] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 08:45:10 juju-e4d256-prod-github-runner-207 kernel: [12084.566142] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 08:45:10 juju-e4d256-prod-github-runner-207 kernel: [12084.567325] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 08:45:10 juju-e4d256-prod-github-runner-207 kernel: [12084.568527] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 08:45:10 juju-e4d256-prod-github-runner-207 kernel: [12084.569738] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 08:45:10 juju-e4d256-prod-github-runner-207 kernel: [12084.570972] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 08:45:10 juju-e4d256-prod-github-runner-207 kernel: [12084.572081] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 08:45:10 juju-e4d256-prod-github-runner-207 kernel: [12084.573288] Call Trace: Aug 22 08:45:10 juju-e4d256-prod-github-runner-207 kernel: [12084.574223] Aug 22 08:45:10 juju-e4d256-prod-github-runner-207 kernel: [12084.575160] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:45:10 juju-e4d256-prod-github-runner-207 kernel: [12084.576219] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:45:10 juju-e4d256-prod-github-runner-207 kernel: [12084.577245] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:45:10 juju-e4d256-prod-github-runner-207 kernel: [12084.578373] ? show_regs.part.0+0x23/0x29 Aug 22 08:45:10 juju-e4d256-prod-github-runner-207 kernel: [12084.579406] ? show_regs.cold+0x8/0xd Aug 22 08:45:10 juju-e4d256-prod-github-runner-207 kernel: [12084.580401] ? watchdog_timer_fn+0x1be/0x220 Aug 22 08:45:10 juju-e4d256-prod-github-runner-207 kernel: [12084.581421] ? lockup_detector_update_enable+0x60/0x60 Aug 22 08:45:10 juju-e4d256-prod-github-runner-207 kernel: [12084.582494] ? __hrtimer_run_queues+0x107/0x230 Aug 22 08:45:10 juju-e4d256-prod-github-runner-207 kernel: [12084.583532] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 08:45:10 juju-e4d256-prod-github-runner-207 kernel: [12084.584578] ? hrtimer_interrupt+0x101/0x220 Aug 22 08:45:10 juju-e4d256-prod-github-runner-207 kernel: [12084.585712] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 08:45:10 juju-e4d256-prod-github-runner-207 kernel: [12084.586906] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 08:45:10 juju-e4d256-prod-github-runner-207 kernel: [12084.588127] Aug 22 08:45:10 juju-e4d256-prod-github-runner-207 kernel: [12084.589046] Aug 22 08:45:10 juju-e4d256-prod-github-runner-207 kernel: [12084.589946] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 08:45:10 juju-e4d256-prod-github-runner-207 kernel: [12084.591089] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:45:10 juju-e4d256-prod-github-runner-207 kernel: [12084.592272] ? _raw_spin_lock+0x22/0x30 Aug 22 08:45:10 juju-e4d256-prod-github-runner-207 kernel: [12084.593311] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:45:10 juju-e4d256-prod-github-runner-207 kernel: [12084.594416] direct_page_fault+0x206/0x310 [kvm] Aug 22 08:45:10 juju-e4d256-prod-github-runner-207 kernel: [12084.595529] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 08:45:10 juju-e4d256-prod-github-runner-207 kernel: [12084.596640] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 08:45:10 juju-e4d256-prod-github-runner-207 kernel: [12084.597733] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 08:45:10 juju-e4d256-prod-github-runner-207 kernel: [12084.598770] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 08:45:10 juju-e4d256-prod-github-runner-207 kernel: [12084.599805] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 08:45:10 juju-e4d256-prod-github-runner-207 kernel: [12084.600903] handle_exit+0x98/0x230 [kvm_amd] Aug 22 08:45:10 juju-e4d256-prod-github-runner-207 kernel: [12084.601879] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 08:45:10 juju-e4d256-prod-github-runner-207 kernel: [12084.602884] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 08:45:10 juju-e4d256-prod-github-runner-207 kernel: [12084.603923] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 08:45:10 juju-e4d256-prod-github-runner-207 kernel: [12084.604938] vcpu_run+0x62/0x2c0 [kvm] Aug 22 08:45:10 juju-e4d256-prod-github-runner-207 kernel: [12084.605837] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 08:45:10 juju-e4d256-prod-github-runner-207 kernel: [12084.606736] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 08:45:10 juju-e4d256-prod-github-runner-207 kernel: [12084.607695] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 08:45:10 juju-e4d256-prod-github-runner-207 kernel: [12084.608616] ? __seccomp_filter+0x4a/0x4a0 Aug 22 08:45:10 juju-e4d256-prod-github-runner-207 kernel: [12084.609649] ? __fget_files+0x86/0xc0 Aug 22 08:45:10 juju-e4d256-prod-github-runner-207 kernel: [12084.610430] __x64_sys_ioctl+0x95/0xd0 Aug 22 08:45:10 juju-e4d256-prod-github-runner-207 kernel: [12084.611211] do_syscall_64+0x5c/0xc0 Aug 22 08:45:10 juju-e4d256-prod-github-runner-207 kernel: [12084.611951] ? do_futex+0x162/0x1f0 Aug 22 08:45:10 juju-e4d256-prod-github-runner-207 kernel: [12084.612705] ? __x64_sys_futex+0x78/0x1e0 Aug 22 08:45:10 juju-e4d256-prod-github-runner-207 kernel: [12084.613473] ? __secure_computing+0xa9/0x120 Aug 22 08:45:10 juju-e4d256-prod-github-runner-207 kernel: [12084.614254] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 08:45:10 juju-e4d256-prod-github-runner-207 kernel: [12084.615131] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:45:10 juju-e4d256-prod-github-runner-207 kernel: [12084.616009] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:45:10 juju-e4d256-prod-github-runner-207 kernel: [12084.616821] ? do_syscall_64+0x69/0xc0 Aug 22 08:45:10 juju-e4d256-prod-github-runner-207 kernel: [12084.617555] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:45:10 juju-e4d256-prod-github-runner-207 kernel: [12084.618353] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:45:10 juju-e4d256-prod-github-runner-207 kernel: [12084.619141] ? do_syscall_64+0x69/0xc0 Aug 22 08:45:10 juju-e4d256-prod-github-runner-207 kernel: [12084.619838] ? do_syscall_64+0x69/0xc0 Aug 22 08:45:10 juju-e4d256-prod-github-runner-207 kernel: [12084.620549] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 08:45:10 juju-e4d256-prod-github-runner-207 kernel: [12084.621361] RIP: 0033:0x7faa5d0edaff Aug 22 08:45:10 juju-e4d256-prod-github-runner-207 kernel: [12084.622115] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 08:45:10 juju-e4d256-prod-github-runner-207 kernel: [12084.624460] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 08:45:10 juju-e4d256-prod-github-runner-207 kernel: [12084.625513] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 08:45:10 juju-e4d256-prod-github-runner-207 kernel: [12084.626532] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 08:45:10 juju-e4d256-prod-github-runner-207 kernel: [12084.627550] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 08:45:10 juju-e4d256-prod-github-runner-207 kernel: [12084.628580] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 08:45:10 juju-e4d256-prod-github-runner-207 kernel: [12084.629599] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 08:45:10 juju-e4d256-prod-github-runner-207 kernel: [12084.630625] Aug 22 08:45:38 juju-e4d256-prod-github-runner-207 kernel: [12112.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 11172s! [qemu-system-x86:6715] Aug 22 08:45:38 juju-e4d256-prod-github-runner-207 kernel: [12112.543090] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 08:45:38 juju-e4d256-prod-github-runner-207 kernel: [12112.543161] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 08:45:38 juju-e4d256-prod-github-runner-207 kernel: [12112.555815] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 08:45:38 juju-e4d256-prod-github-runner-207 kernel: [12112.557110] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 08:45:38 juju-e4d256-prod-github-runner-207 kernel: [12112.558372] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:45:38 juju-e4d256-prod-github-runner-207 kernel: [12112.559447] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 08:45:38 juju-e4d256-prod-github-runner-207 kernel: [12112.562195] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 08:45:38 juju-e4d256-prod-github-runner-207 kernel: [12112.563258] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 08:45:38 juju-e4d256-prod-github-runner-207 kernel: [12112.564436] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 08:45:38 juju-e4d256-prod-github-runner-207 kernel: [12112.565606] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 08:45:38 juju-e4d256-prod-github-runner-207 kernel: [12112.566774] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 08:45:38 juju-e4d256-prod-github-runner-207 kernel: [12112.568001] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 08:45:38 juju-e4d256-prod-github-runner-207 kernel: [12112.569194] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 08:45:38 juju-e4d256-prod-github-runner-207 kernel: [12112.570462] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 08:45:38 juju-e4d256-prod-github-runner-207 kernel: [12112.571625] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 08:45:38 juju-e4d256-prod-github-runner-207 kernel: [12112.572887] Call Trace: Aug 22 08:45:38 juju-e4d256-prod-github-runner-207 kernel: [12112.573821] Aug 22 08:45:38 juju-e4d256-prod-github-runner-207 kernel: [12112.574714] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:45:38 juju-e4d256-prod-github-runner-207 kernel: [12112.575780] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:45:38 juju-e4d256-prod-github-runner-207 kernel: [12112.576827] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:45:38 juju-e4d256-prod-github-runner-207 kernel: [12112.578008] ? show_regs.part.0+0x23/0x29 Aug 22 08:45:38 juju-e4d256-prod-github-runner-207 kernel: [12112.579048] ? show_regs.cold+0x8/0xd Aug 22 08:45:38 juju-e4d256-prod-github-runner-207 kernel: [12112.580052] ? watchdog_timer_fn+0x1be/0x220 Aug 22 08:45:38 juju-e4d256-prod-github-runner-207 kernel: [12112.581067] ? lockup_detector_update_enable+0x60/0x60 Aug 22 08:45:38 juju-e4d256-prod-github-runner-207 kernel: [12112.582184] ? __hrtimer_run_queues+0x107/0x230 Aug 22 08:45:38 juju-e4d256-prod-github-runner-207 kernel: [12112.583248] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 08:45:38 juju-e4d256-prod-github-runner-207 kernel: [12112.584304] ? hrtimer_interrupt+0x101/0x220 Aug 22 08:45:38 juju-e4d256-prod-github-runner-207 kernel: [12112.585335] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 08:45:38 juju-e4d256-prod-github-runner-207 kernel: [12112.586472] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 08:45:38 juju-e4d256-prod-github-runner-207 kernel: [12112.587669] Aug 22 08:45:38 juju-e4d256-prod-github-runner-207 kernel: [12112.588637] Aug 22 08:45:38 juju-e4d256-prod-github-runner-207 kernel: [12112.589560] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 08:45:38 juju-e4d256-prod-github-runner-207 kernel: [12112.590599] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:45:38 juju-e4d256-prod-github-runner-207 kernel: [12112.591668] ? _raw_spin_lock+0x22/0x30 Aug 22 08:45:38 juju-e4d256-prod-github-runner-207 kernel: [12112.592631] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:45:38 juju-e4d256-prod-github-runner-207 kernel: [12112.593688] direct_page_fault+0x206/0x310 [kvm] Aug 22 08:45:38 juju-e4d256-prod-github-runner-207 kernel: [12112.594820] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 08:45:38 juju-e4d256-prod-github-runner-207 kernel: [12112.595958] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 08:45:38 juju-e4d256-prod-github-runner-207 kernel: [12112.597171] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 08:45:38 juju-e4d256-prod-github-runner-207 kernel: [12112.598318] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 08:45:38 juju-e4d256-prod-github-runner-207 kernel: [12112.599405] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 08:45:38 juju-e4d256-prod-github-runner-207 kernel: [12112.600591] handle_exit+0x98/0x230 [kvm_amd] Aug 22 08:45:38 juju-e4d256-prod-github-runner-207 kernel: [12112.601613] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 08:45:38 juju-e4d256-prod-github-runner-207 kernel: [12112.602655] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 08:45:38 juju-e4d256-prod-github-runner-207 kernel: [12112.603880] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 08:45:38 juju-e4d256-prod-github-runner-207 kernel: [12112.604904] vcpu_run+0x62/0x2c0 [kvm] Aug 22 08:45:38 juju-e4d256-prod-github-runner-207 kernel: [12112.605793] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 08:45:38 juju-e4d256-prod-github-runner-207 kernel: [12112.606696] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 08:45:38 juju-e4d256-prod-github-runner-207 kernel: [12112.607668] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 08:45:38 juju-e4d256-prod-github-runner-207 kernel: [12112.608628] ? __seccomp_filter+0x4a/0x4a0 Aug 22 08:45:38 juju-e4d256-prod-github-runner-207 kernel: [12112.609498] ? __fget_files+0x86/0xc0 Aug 22 08:45:38 juju-e4d256-prod-github-runner-207 kernel: [12112.610281] __x64_sys_ioctl+0x95/0xd0 Aug 22 08:45:38 juju-e4d256-prod-github-runner-207 kernel: [12112.611055] do_syscall_64+0x5c/0xc0 Aug 22 08:45:38 juju-e4d256-prod-github-runner-207 kernel: [12112.611814] ? do_futex+0x162/0x1f0 Aug 22 08:45:38 juju-e4d256-prod-github-runner-207 kernel: [12112.612553] ? __x64_sys_futex+0x78/0x1e0 Aug 22 08:45:38 juju-e4d256-prod-github-runner-207 kernel: [12112.613309] ? __secure_computing+0xa9/0x120 Aug 22 08:45:38 juju-e4d256-prod-github-runner-207 kernel: [12112.614088] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 08:45:38 juju-e4d256-prod-github-runner-207 kernel: [12112.614954] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:45:38 juju-e4d256-prod-github-runner-207 kernel: [12112.615788] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:45:38 juju-e4d256-prod-github-runner-207 kernel: [12112.616603] ? do_syscall_64+0x69/0xc0 Aug 22 08:45:38 juju-e4d256-prod-github-runner-207 kernel: [12112.617324] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:45:38 juju-e4d256-prod-github-runner-207 kernel: [12112.618136] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:45:38 juju-e4d256-prod-github-runner-207 kernel: [12112.618927] ? do_syscall_64+0x69/0xc0 Aug 22 08:45:38 juju-e4d256-prod-github-runner-207 kernel: [12112.619655] ? do_syscall_64+0x69/0xc0 Aug 22 08:45:38 juju-e4d256-prod-github-runner-207 kernel: [12112.620355] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 08:45:38 juju-e4d256-prod-github-runner-207 kernel: [12112.621156] RIP: 0033:0x7faa5d0edaff Aug 22 08:45:38 juju-e4d256-prod-github-runner-207 kernel: [12112.621860] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 08:45:38 juju-e4d256-prod-github-runner-207 kernel: [12112.624259] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 08:45:38 juju-e4d256-prod-github-runner-207 kernel: [12112.625339] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 08:45:38 juju-e4d256-prod-github-runner-207 kernel: [12112.626427] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 08:45:38 juju-e4d256-prod-github-runner-207 kernel: [12112.627484] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 08:45:38 juju-e4d256-prod-github-runner-207 kernel: [12112.628537] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 08:45:38 juju-e4d256-prod-github-runner-207 kernel: [12112.629575] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 08:45:38 juju-e4d256-prod-github-runner-207 kernel: [12112.630629] Aug 22 08:46:06 juju-e4d256-prod-github-runner-207 kernel: [12140.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 11198s! [qemu-system-x86:6715] Aug 22 08:46:06 juju-e4d256-prod-github-runner-207 kernel: [12140.543104] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 08:46:06 juju-e4d256-prod-github-runner-207 kernel: [12140.543178] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 08:46:06 juju-e4d256-prod-github-runner-207 kernel: [12140.555259] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 08:46:06 juju-e4d256-prod-github-runner-207 kernel: [12140.556553] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 08:46:06 juju-e4d256-prod-github-runner-207 kernel: [12140.557777] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:46:06 juju-e4d256-prod-github-runner-207 kernel: [12140.558833] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 08:46:06 juju-e4d256-prod-github-runner-207 kernel: [12140.561401] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 08:46:06 juju-e4d256-prod-github-runner-207 kernel: [12140.562480] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 08:46:06 juju-e4d256-prod-github-runner-207 kernel: [12140.563693] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 08:46:06 juju-e4d256-prod-github-runner-207 kernel: [12140.564856] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 08:46:06 juju-e4d256-prod-github-runner-207 kernel: [12140.566019] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 08:46:06 juju-e4d256-prod-github-runner-207 kernel: [12140.567215] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 08:46:06 juju-e4d256-prod-github-runner-207 kernel: [12140.568407] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 08:46:06 juju-e4d256-prod-github-runner-207 kernel: [12140.569645] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 08:46:06 juju-e4d256-prod-github-runner-207 kernel: [12140.570742] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 08:46:06 juju-e4d256-prod-github-runner-207 kernel: [12140.571952] Call Trace: Aug 22 08:46:06 juju-e4d256-prod-github-runner-207 kernel: [12140.572862] Aug 22 08:46:06 juju-e4d256-prod-github-runner-207 kernel: [12140.573748] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:46:06 juju-e4d256-prod-github-runner-207 kernel: [12140.574787] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:46:06 juju-e4d256-prod-github-runner-207 kernel: [12140.575864] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:46:06 juju-e4d256-prod-github-runner-207 kernel: [12140.576965] ? show_regs.part.0+0x23/0x29 Aug 22 08:46:06 juju-e4d256-prod-github-runner-207 kernel: [12140.577990] ? show_regs.cold+0x8/0xd Aug 22 08:46:06 juju-e4d256-prod-github-runner-207 kernel: [12140.579012] ? watchdog_timer_fn+0x1be/0x220 Aug 22 08:46:06 juju-e4d256-prod-github-runner-207 kernel: [12140.580072] ? lockup_detector_update_enable+0x60/0x60 Aug 22 08:46:06 juju-e4d256-prod-github-runner-207 kernel: [12140.581146] ? __hrtimer_run_queues+0x107/0x230 Aug 22 08:46:06 juju-e4d256-prod-github-runner-207 kernel: [12140.582200] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 08:46:06 juju-e4d256-prod-github-runner-207 kernel: [12140.583253] ? hrtimer_interrupt+0x101/0x220 Aug 22 08:46:06 juju-e4d256-prod-github-runner-207 kernel: [12140.584304] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 08:46:06 juju-e4d256-prod-github-runner-207 kernel: [12140.585386] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 08:46:06 juju-e4d256-prod-github-runner-207 kernel: [12140.586436] Aug 22 08:46:06 juju-e4d256-prod-github-runner-207 kernel: [12140.587317] Aug 22 08:46:06 juju-e4d256-prod-github-runner-207 kernel: [12140.588171] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 08:46:06 juju-e4d256-prod-github-runner-207 kernel: [12140.589209] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:46:06 juju-e4d256-prod-github-runner-207 kernel: [12140.590402] ? _raw_spin_lock+0x22/0x30 Aug 22 08:46:06 juju-e4d256-prod-github-runner-207 kernel: [12140.591387] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:46:06 juju-e4d256-prod-github-runner-207 kernel: [12140.592435] direct_page_fault+0x206/0x310 [kvm] Aug 22 08:46:06 juju-e4d256-prod-github-runner-207 kernel: [12140.593473] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 08:46:06 juju-e4d256-prod-github-runner-207 kernel: [12140.594496] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 08:46:06 juju-e4d256-prod-github-runner-207 kernel: [12140.595524] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 08:46:06 juju-e4d256-prod-github-runner-207 kernel: [12140.596563] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 08:46:06 juju-e4d256-prod-github-runner-207 kernel: [12140.597588] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 08:46:06 juju-e4d256-prod-github-runner-207 kernel: [12140.598589] handle_exit+0x98/0x230 [kvm_amd] Aug 22 08:46:06 juju-e4d256-prod-github-runner-207 kernel: [12140.599537] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 08:46:06 juju-e4d256-prod-github-runner-207 kernel: [12140.600524] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 08:46:06 juju-e4d256-prod-github-runner-207 kernel: [12140.601709] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 08:46:06 juju-e4d256-prod-github-runner-207 kernel: [12140.602638] vcpu_run+0x62/0x2c0 [kvm] Aug 22 08:46:06 juju-e4d256-prod-github-runner-207 kernel: [12140.603472] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 08:46:06 juju-e4d256-prod-github-runner-207 kernel: [12140.604303] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 08:46:06 juju-e4d256-prod-github-runner-207 kernel: [12140.605174] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 08:46:06 juju-e4d256-prod-github-runner-207 kernel: [12140.605988] ? __seccomp_filter+0x4a/0x4a0 Aug 22 08:46:06 juju-e4d256-prod-github-runner-207 kernel: [12140.606753] ? __fget_files+0x86/0xc0 Aug 22 08:46:06 juju-e4d256-prod-github-runner-207 kernel: [12140.607503] __x64_sys_ioctl+0x95/0xd0 Aug 22 08:46:06 juju-e4d256-prod-github-runner-207 kernel: [12140.608204] do_syscall_64+0x5c/0xc0 Aug 22 08:46:06 juju-e4d256-prod-github-runner-207 kernel: [12140.608873] ? do_futex+0x162/0x1f0 Aug 22 08:46:06 juju-e4d256-prod-github-runner-207 kernel: [12140.609529] ? __x64_sys_futex+0x78/0x1e0 Aug 22 08:46:06 juju-e4d256-prod-github-runner-207 kernel: [12140.610215] ? __secure_computing+0xa9/0x120 Aug 22 08:46:06 juju-e4d256-prod-github-runner-207 kernel: [12140.610921] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 08:46:06 juju-e4d256-prod-github-runner-207 kernel: [12140.611722] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:46:06 juju-e4d256-prod-github-runner-207 kernel: [12140.612461] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:46:06 juju-e4d256-prod-github-runner-207 kernel: [12140.613189] ? do_syscall_64+0x69/0xc0 Aug 22 08:46:06 juju-e4d256-prod-github-runner-207 kernel: [12140.613846] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:46:06 juju-e4d256-prod-github-runner-207 kernel: [12140.614558] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:46:06 juju-e4d256-prod-github-runner-207 kernel: [12140.615473] ? do_syscall_64+0x69/0xc0 Aug 22 08:46:06 juju-e4d256-prod-github-runner-207 kernel: [12140.616107] ? do_syscall_64+0x69/0xc0 Aug 22 08:46:06 juju-e4d256-prod-github-runner-207 kernel: [12140.616785] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 08:46:06 juju-e4d256-prod-github-runner-207 kernel: [12140.617567] RIP: 0033:0x7faa5d0edaff Aug 22 08:46:06 juju-e4d256-prod-github-runner-207 kernel: [12140.618214] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 08:46:06 juju-e4d256-prod-github-runner-207 kernel: [12140.620238] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 08:46:06 juju-e4d256-prod-github-runner-207 kernel: [12140.621157] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 08:46:06 juju-e4d256-prod-github-runner-207 kernel: [12140.622066] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 08:46:06 juju-e4d256-prod-github-runner-207 kernel: [12140.622989] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 08:46:06 juju-e4d256-prod-github-runner-207 kernel: [12140.623902] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 08:46:06 juju-e4d256-prod-github-runner-207 kernel: [12140.624802] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 08:46:06 juju-e4d256-prod-github-runner-207 kernel: [12140.625703] Aug 22 08:46:34 juju-e4d256-prod-github-runner-207 kernel: [12168.541980] watchdog: BUG: soft lockup - CPU#1 stuck for 11224s! [qemu-system-x86:6715] Aug 22 08:46:34 juju-e4d256-prod-github-runner-207 kernel: [12168.543879] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 08:46:34 juju-e4d256-prod-github-runner-207 kernel: [12168.544162] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 08:46:34 juju-e4d256-prod-github-runner-207 kernel: [12168.557170] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 08:46:34 juju-e4d256-prod-github-runner-207 kernel: [12168.558443] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 08:46:34 juju-e4d256-prod-github-runner-207 kernel: [12168.559710] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:46:34 juju-e4d256-prod-github-runner-207 kernel: [12168.560768] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 08:46:34 juju-e4d256-prod-github-runner-207 kernel: [12168.563728] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 08:46:34 juju-e4d256-prod-github-runner-207 kernel: [12168.564941] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 08:46:34 juju-e4d256-prod-github-runner-207 kernel: [12168.566124] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 08:46:34 juju-e4d256-prod-github-runner-207 kernel: [12168.567394] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 08:46:34 juju-e4d256-prod-github-runner-207 kernel: [12168.568582] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 08:46:34 juju-e4d256-prod-github-runner-207 kernel: [12168.569803] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 08:46:34 juju-e4d256-prod-github-runner-207 kernel: [12168.571250] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 08:46:34 juju-e4d256-prod-github-runner-207 kernel: [12168.572501] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 08:46:34 juju-e4d256-prod-github-runner-207 kernel: [12168.573619] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 08:46:34 juju-e4d256-prod-github-runner-207 kernel: [12168.574840] Call Trace: Aug 22 08:46:34 juju-e4d256-prod-github-runner-207 kernel: [12168.575792] Aug 22 08:46:34 juju-e4d256-prod-github-runner-207 kernel: [12168.576732] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:46:34 juju-e4d256-prod-github-runner-207 kernel: [12168.577800] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:46:34 juju-e4d256-prod-github-runner-207 kernel: [12168.578852] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:46:34 juju-e4d256-prod-github-runner-207 kernel: [12168.580011] ? show_regs.part.0+0x23/0x29 Aug 22 08:46:34 juju-e4d256-prod-github-runner-207 kernel: [12168.581014] ? show_regs.cold+0x8/0xd Aug 22 08:46:34 juju-e4d256-prod-github-runner-207 kernel: [12168.581992] ? watchdog_timer_fn+0x1be/0x220 Aug 22 08:46:34 juju-e4d256-prod-github-runner-207 kernel: [12168.583029] ? lockup_detector_update_enable+0x60/0x60 Aug 22 08:46:34 juju-e4d256-prod-github-runner-207 kernel: [12168.584094] ? __hrtimer_run_queues+0x107/0x230 Aug 22 08:46:34 juju-e4d256-prod-github-runner-207 kernel: [12168.585123] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 08:46:34 juju-e4d256-prod-github-runner-207 kernel: [12168.586147] ? hrtimer_interrupt+0x101/0x220 Aug 22 08:46:34 juju-e4d256-prod-github-runner-207 kernel: [12168.587322] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 08:46:34 juju-e4d256-prod-github-runner-207 kernel: [12168.588425] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 08:46:34 juju-e4d256-prod-github-runner-207 kernel: [12168.589518] Aug 22 08:46:34 juju-e4d256-prod-github-runner-207 kernel: [12168.590388] Aug 22 08:46:34 juju-e4d256-prod-github-runner-207 kernel: [12168.591261] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 08:46:34 juju-e4d256-prod-github-runner-207 kernel: [12168.592297] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:46:34 juju-e4d256-prod-github-runner-207 kernel: [12168.593360] ? _raw_spin_lock+0x22/0x30 Aug 22 08:46:34 juju-e4d256-prod-github-runner-207 kernel: [12168.594340] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:46:34 juju-e4d256-prod-github-runner-207 kernel: [12168.595450] direct_page_fault+0x206/0x310 [kvm] Aug 22 08:46:34 juju-e4d256-prod-github-runner-207 kernel: [12168.596593] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 08:46:34 juju-e4d256-prod-github-runner-207 kernel: [12168.597632] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 08:46:34 juju-e4d256-prod-github-runner-207 kernel: [12168.598659] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 08:46:34 juju-e4d256-prod-github-runner-207 kernel: [12168.599712] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 08:46:34 juju-e4d256-prod-github-runner-207 kernel: [12168.600696] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 08:46:34 juju-e4d256-prod-github-runner-207 kernel: [12168.601682] handle_exit+0x98/0x230 [kvm_amd] Aug 22 08:46:34 juju-e4d256-prod-github-runner-207 kernel: [12168.602579] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 08:46:34 juju-e4d256-prod-github-runner-207 kernel: [12168.603521] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 08:46:34 juju-e4d256-prod-github-runner-207 kernel: [12168.604451] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 08:46:34 juju-e4d256-prod-github-runner-207 kernel: [12168.605385] vcpu_run+0x62/0x2c0 [kvm] Aug 22 08:46:34 juju-e4d256-prod-github-runner-207 kernel: [12168.606221] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 08:46:34 juju-e4d256-prod-github-runner-207 kernel: [12168.607065] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 08:46:34 juju-e4d256-prod-github-runner-207 kernel: [12168.607943] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 08:46:34 juju-e4d256-prod-github-runner-207 kernel: [12168.608754] ? __seccomp_filter+0x4a/0x4a0 Aug 22 08:46:34 juju-e4d256-prod-github-runner-207 kernel: [12168.609519] ? __fget_files+0x86/0xc0 Aug 22 08:46:34 juju-e4d256-prod-github-runner-207 kernel: [12168.610241] __x64_sys_ioctl+0x95/0xd0 Aug 22 08:46:34 juju-e4d256-prod-github-runner-207 kernel: [12168.610969] do_syscall_64+0x5c/0xc0 Aug 22 08:46:34 juju-e4d256-prod-github-runner-207 kernel: [12168.611659] ? do_futex+0x162/0x1f0 Aug 22 08:46:34 juju-e4d256-prod-github-runner-207 kernel: [12168.612330] ? __x64_sys_futex+0x78/0x1e0 Aug 22 08:46:34 juju-e4d256-prod-github-runner-207 kernel: [12168.613057] ? __secure_computing+0xa9/0x120 Aug 22 08:46:34 juju-e4d256-prod-github-runner-207 kernel: [12168.613766] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 08:46:34 juju-e4d256-prod-github-runner-207 kernel: [12168.614555] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:46:34 juju-e4d256-prod-github-runner-207 kernel: [12168.615342] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:46:34 juju-e4d256-prod-github-runner-207 kernel: [12168.616077] ? do_syscall_64+0x69/0xc0 Aug 22 08:46:34 juju-e4d256-prod-github-runner-207 kernel: [12168.616734] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:46:34 juju-e4d256-prod-github-runner-207 kernel: [12168.617452] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:46:34 juju-e4d256-prod-github-runner-207 kernel: [12168.618161] ? do_syscall_64+0x69/0xc0 Aug 22 08:46:34 juju-e4d256-prod-github-runner-207 kernel: [12168.618798] ? do_syscall_64+0x69/0xc0 Aug 22 08:46:34 juju-e4d256-prod-github-runner-207 kernel: [12168.619471] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 08:46:34 juju-e4d256-prod-github-runner-207 kernel: [12168.620288] RIP: 0033:0x7faa5d0edaff Aug 22 08:46:34 juju-e4d256-prod-github-runner-207 kernel: [12168.620956] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 08:46:34 juju-e4d256-prod-github-runner-207 kernel: [12168.623035] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 08:46:34 juju-e4d256-prod-github-runner-207 kernel: [12168.623976] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 08:46:34 juju-e4d256-prod-github-runner-207 kernel: [12168.624886] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 08:46:34 juju-e4d256-prod-github-runner-207 kernel: [12168.625810] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 08:46:34 juju-e4d256-prod-github-runner-207 kernel: [12168.626723] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 08:46:34 juju-e4d256-prod-github-runner-207 kernel: [12168.627664] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 08:46:34 juju-e4d256-prod-github-runner-207 kernel: [12168.628703] Aug 22 08:47:02 juju-e4d256-prod-github-runner-207 kernel: [12196.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 11250s! [qemu-system-x86:6715] Aug 22 08:47:02 juju-e4d256-prod-github-runner-207 kernel: [12196.543148] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 08:47:02 juju-e4d256-prod-github-runner-207 kernel: [12196.543225] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 08:47:02 juju-e4d256-prod-github-runner-207 kernel: [12196.556007] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 08:47:02 juju-e4d256-prod-github-runner-207 kernel: [12196.557334] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 08:47:02 juju-e4d256-prod-github-runner-207 kernel: [12196.558580] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:47:02 juju-e4d256-prod-github-runner-207 kernel: [12196.559675] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 08:47:02 juju-e4d256-prod-github-runner-207 kernel: [12196.562323] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 08:47:02 juju-e4d256-prod-github-runner-207 kernel: [12196.563420] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 08:47:02 juju-e4d256-prod-github-runner-207 kernel: [12196.564641] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 08:47:02 juju-e4d256-prod-github-runner-207 kernel: [12196.566099] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 08:47:02 juju-e4d256-prod-github-runner-207 kernel: [12196.567357] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 08:47:02 juju-e4d256-prod-github-runner-207 kernel: [12196.568548] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 08:47:02 juju-e4d256-prod-github-runner-207 kernel: [12196.569742] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 08:47:02 juju-e4d256-prod-github-runner-207 kernel: [12196.571038] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 08:47:02 juju-e4d256-prod-github-runner-207 kernel: [12196.572173] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 08:47:02 juju-e4d256-prod-github-runner-207 kernel: [12196.573396] Call Trace: Aug 22 08:47:02 juju-e4d256-prod-github-runner-207 kernel: [12196.574317] Aug 22 08:47:02 juju-e4d256-prod-github-runner-207 kernel: [12196.575226] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:47:02 juju-e4d256-prod-github-runner-207 kernel: [12196.576281] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:47:02 juju-e4d256-prod-github-runner-207 kernel: [12196.577343] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:47:02 juju-e4d256-prod-github-runner-207 kernel: [12196.578449] ? show_regs.part.0+0x23/0x29 Aug 22 08:47:02 juju-e4d256-prod-github-runner-207 kernel: [12196.579490] ? show_regs.cold+0x8/0xd Aug 22 08:47:02 juju-e4d256-prod-github-runner-207 kernel: [12196.580477] ? watchdog_timer_fn+0x1be/0x220 Aug 22 08:47:02 juju-e4d256-prod-github-runner-207 kernel: [12196.581518] ? lockup_detector_update_enable+0x60/0x60 Aug 22 08:47:02 juju-e4d256-prod-github-runner-207 kernel: [12196.582647] ? __hrtimer_run_queues+0x107/0x230 Aug 22 08:47:02 juju-e4d256-prod-github-runner-207 kernel: [12196.583712] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 08:47:02 juju-e4d256-prod-github-runner-207 kernel: [12196.584754] ? hrtimer_interrupt+0x101/0x220 Aug 22 08:47:02 juju-e4d256-prod-github-runner-207 kernel: [12196.585791] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 08:47:02 juju-e4d256-prod-github-runner-207 kernel: [12196.586910] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 08:47:02 juju-e4d256-prod-github-runner-207 kernel: [12196.588021] Aug 22 08:47:02 juju-e4d256-prod-github-runner-207 kernel: [12196.588888] Aug 22 08:47:02 juju-e4d256-prod-github-runner-207 kernel: [12196.589741] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 08:47:02 juju-e4d256-prod-github-runner-207 kernel: [12196.590834] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:47:02 juju-e4d256-prod-github-runner-207 kernel: [12196.591953] ? _raw_spin_lock+0x22/0x30 Aug 22 08:47:02 juju-e4d256-prod-github-runner-207 kernel: [12196.592937] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:47:02 juju-e4d256-prod-github-runner-207 kernel: [12196.593985] direct_page_fault+0x206/0x310 [kvm] Aug 22 08:47:02 juju-e4d256-prod-github-runner-207 kernel: [12196.595054] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 08:47:02 juju-e4d256-prod-github-runner-207 kernel: [12196.596127] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 08:47:02 juju-e4d256-prod-github-runner-207 kernel: [12196.597163] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 08:47:02 juju-e4d256-prod-github-runner-207 kernel: [12196.598174] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 08:47:02 juju-e4d256-prod-github-runner-207 kernel: [12196.599166] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 08:47:02 juju-e4d256-prod-github-runner-207 kernel: [12196.600171] handle_exit+0x98/0x230 [kvm_amd] Aug 22 08:47:02 juju-e4d256-prod-github-runner-207 kernel: [12196.601089] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 08:47:02 juju-e4d256-prod-github-runner-207 kernel: [12196.602035] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 08:47:02 juju-e4d256-prod-github-runner-207 kernel: [12196.603008] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 08:47:02 juju-e4d256-prod-github-runner-207 kernel: [12196.603955] vcpu_run+0x62/0x2c0 [kvm] Aug 22 08:47:02 juju-e4d256-prod-github-runner-207 kernel: [12196.604808] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 08:47:02 juju-e4d256-prod-github-runner-207 kernel: [12196.605667] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 08:47:02 juju-e4d256-prod-github-runner-207 kernel: [12196.606577] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 08:47:02 juju-e4d256-prod-github-runner-207 kernel: [12196.607462] ? __seccomp_filter+0x4a/0x4a0 Aug 22 08:47:02 juju-e4d256-prod-github-runner-207 kernel: [12196.608261] ? __fget_files+0x86/0xc0 Aug 22 08:47:02 juju-e4d256-prod-github-runner-207 kernel: [12196.608988] __x64_sys_ioctl+0x95/0xd0 Aug 22 08:47:02 juju-e4d256-prod-github-runner-207 kernel: [12196.609704] do_syscall_64+0x5c/0xc0 Aug 22 08:47:02 juju-e4d256-prod-github-runner-207 kernel: [12196.610385] ? do_futex+0x162/0x1f0 Aug 22 08:47:02 juju-e4d256-prod-github-runner-207 kernel: [12196.611062] ? __x64_sys_futex+0x78/0x1e0 Aug 22 08:47:02 juju-e4d256-prod-github-runner-207 kernel: [12196.611756] ? __secure_computing+0xa9/0x120 Aug 22 08:47:02 juju-e4d256-prod-github-runner-207 kernel: [12196.612707] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 08:47:02 juju-e4d256-prod-github-runner-207 kernel: [12196.613489] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:47:02 juju-e4d256-prod-github-runner-207 kernel: [12196.614233] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:47:02 juju-e4d256-prod-github-runner-207 kernel: [12196.614989] ? do_syscall_64+0x69/0xc0 Aug 22 08:47:02 juju-e4d256-prod-github-runner-207 kernel: [12196.615647] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:47:02 juju-e4d256-prod-github-runner-207 kernel: [12196.616396] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:47:02 juju-e4d256-prod-github-runner-207 kernel: [12196.617127] ? do_syscall_64+0x69/0xc0 Aug 22 08:47:02 juju-e4d256-prod-github-runner-207 kernel: [12196.617783] ? do_syscall_64+0x69/0xc0 Aug 22 08:47:02 juju-e4d256-prod-github-runner-207 kernel: [12196.618444] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 08:47:02 juju-e4d256-prod-github-runner-207 kernel: [12196.619207] RIP: 0033:0x7faa5d0edaff Aug 22 08:47:02 juju-e4d256-prod-github-runner-207 kernel: [12196.619890] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 08:47:02 juju-e4d256-prod-github-runner-207 kernel: [12196.621968] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 08:47:02 juju-e4d256-prod-github-runner-207 kernel: [12196.622928] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 08:47:02 juju-e4d256-prod-github-runner-207 kernel: [12196.623845] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 08:47:02 juju-e4d256-prod-github-runner-207 kernel: [12196.624756] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 08:47:02 juju-e4d256-prod-github-runner-207 kernel: [12196.625667] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 08:47:02 juju-e4d256-prod-github-runner-207 kernel: [12196.626580] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 08:47:02 juju-e4d256-prod-github-runner-207 kernel: [12196.627504] Aug 22 08:47:30 juju-e4d256-prod-github-runner-207 kernel: [12224.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 11276s! [qemu-system-x86:6715] Aug 22 08:47:30 juju-e4d256-prod-github-runner-207 kernel: [12224.543152] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 08:47:30 juju-e4d256-prod-github-runner-207 kernel: [12224.543228] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 08:47:30 juju-e4d256-prod-github-runner-207 kernel: [12224.555421] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 08:47:30 juju-e4d256-prod-github-runner-207 kernel: [12224.556696] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 08:47:30 juju-e4d256-prod-github-runner-207 kernel: [12224.557922] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:47:30 juju-e4d256-prod-github-runner-207 kernel: [12224.559001] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 08:47:30 juju-e4d256-prod-github-runner-207 kernel: [12224.561577] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 08:47:30 juju-e4d256-prod-github-runner-207 kernel: [12224.562648] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 08:47:30 juju-e4d256-prod-github-runner-207 kernel: [12224.563825] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 08:47:30 juju-e4d256-prod-github-runner-207 kernel: [12224.565011] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 08:47:30 juju-e4d256-prod-github-runner-207 kernel: [12224.566191] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 08:47:30 juju-e4d256-prod-github-runner-207 kernel: [12224.567381] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 08:47:30 juju-e4d256-prod-github-runner-207 kernel: [12224.568559] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 08:47:30 juju-e4d256-prod-github-runner-207 kernel: [12224.569820] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 08:47:30 juju-e4d256-prod-github-runner-207 kernel: [12224.570952] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 08:47:30 juju-e4d256-prod-github-runner-207 kernel: [12224.572153] Call Trace: Aug 22 08:47:30 juju-e4d256-prod-github-runner-207 kernel: [12224.573064] Aug 22 08:47:30 juju-e4d256-prod-github-runner-207 kernel: [12224.573957] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:47:30 juju-e4d256-prod-github-runner-207 kernel: [12224.575029] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:47:30 juju-e4d256-prod-github-runner-207 kernel: [12224.576067] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:47:30 juju-e4d256-prod-github-runner-207 kernel: [12224.577141] ? show_regs.part.0+0x23/0x29 Aug 22 08:47:30 juju-e4d256-prod-github-runner-207 kernel: [12224.578137] ? show_regs.cold+0x8/0xd Aug 22 08:47:30 juju-e4d256-prod-github-runner-207 kernel: [12224.579122] ? watchdog_timer_fn+0x1be/0x220 Aug 22 08:47:30 juju-e4d256-prod-github-runner-207 kernel: [12224.580141] ? lockup_detector_update_enable+0x60/0x60 Aug 22 08:47:30 juju-e4d256-prod-github-runner-207 kernel: [12224.581222] ? __hrtimer_run_queues+0x107/0x230 Aug 22 08:47:30 juju-e4d256-prod-github-runner-207 kernel: [12224.582248] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 08:47:30 juju-e4d256-prod-github-runner-207 kernel: [12224.583301] ? hrtimer_interrupt+0x101/0x220 Aug 22 08:47:30 juju-e4d256-prod-github-runner-207 kernel: [12224.584323] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 08:47:30 juju-e4d256-prod-github-runner-207 kernel: [12224.585403] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 08:47:30 juju-e4d256-prod-github-runner-207 kernel: [12224.586478] Aug 22 08:47:30 juju-e4d256-prod-github-runner-207 kernel: [12224.587337] Aug 22 08:47:30 juju-e4d256-prod-github-runner-207 kernel: [12224.588183] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 08:47:30 juju-e4d256-prod-github-runner-207 kernel: [12224.589219] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:47:30 juju-e4d256-prod-github-runner-207 kernel: [12224.590283] ? _raw_spin_lock+0x22/0x30 Aug 22 08:47:30 juju-e4d256-prod-github-runner-207 kernel: [12224.591251] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:47:30 juju-e4d256-prod-github-runner-207 kernel: [12224.592282] direct_page_fault+0x206/0x310 [kvm] Aug 22 08:47:30 juju-e4d256-prod-github-runner-207 kernel: [12224.593311] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 08:47:30 juju-e4d256-prod-github-runner-207 kernel: [12224.594377] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 08:47:30 juju-e4d256-prod-github-runner-207 kernel: [12224.595399] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 08:47:30 juju-e4d256-prod-github-runner-207 kernel: [12224.596425] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 08:47:30 juju-e4d256-prod-github-runner-207 kernel: [12224.597612] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 08:47:30 juju-e4d256-prod-github-runner-207 kernel: [12224.598750] handle_exit+0x98/0x230 [kvm_amd] Aug 22 08:47:30 juju-e4d256-prod-github-runner-207 kernel: [12224.599656] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 08:47:30 juju-e4d256-prod-github-runner-207 kernel: [12224.600576] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 08:47:30 juju-e4d256-prod-github-runner-207 kernel: [12224.601505] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 08:47:30 juju-e4d256-prod-github-runner-207 kernel: [12224.602433] vcpu_run+0x62/0x2c0 [kvm] Aug 22 08:47:30 juju-e4d256-prod-github-runner-207 kernel: [12224.603282] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 08:47:30 juju-e4d256-prod-github-runner-207 kernel: [12224.604109] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 08:47:30 juju-e4d256-prod-github-runner-207 kernel: [12224.604967] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 08:47:30 juju-e4d256-prod-github-runner-207 kernel: [12224.605767] ? __seccomp_filter+0x4a/0x4a0 Aug 22 08:47:30 juju-e4d256-prod-github-runner-207 kernel: [12224.606525] ? __fget_files+0x86/0xc0 Aug 22 08:47:30 juju-e4d256-prod-github-runner-207 kernel: [12224.607237] __x64_sys_ioctl+0x95/0xd0 Aug 22 08:47:30 juju-e4d256-prod-github-runner-207 kernel: [12224.607941] do_syscall_64+0x5c/0xc0 Aug 22 08:47:30 juju-e4d256-prod-github-runner-207 kernel: [12224.608627] ? do_futex+0x162/0x1f0 Aug 22 08:47:30 juju-e4d256-prod-github-runner-207 kernel: [12224.609283] ? __x64_sys_futex+0x78/0x1e0 Aug 22 08:47:30 juju-e4d256-prod-github-runner-207 kernel: [12224.609959] ? __secure_computing+0xa9/0x120 Aug 22 08:47:30 juju-e4d256-prod-github-runner-207 kernel: [12224.610658] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 08:47:30 juju-e4d256-prod-github-runner-207 kernel: [12224.611421] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:47:30 juju-e4d256-prod-github-runner-207 kernel: [12224.612149] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:47:30 juju-e4d256-prod-github-runner-207 kernel: [12224.612886] ? do_syscall_64+0x69/0xc0 Aug 22 08:47:30 juju-e4d256-prod-github-runner-207 kernel: [12224.613535] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:47:30 juju-e4d256-prod-github-runner-207 kernel: [12224.614248] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:47:30 juju-e4d256-prod-github-runner-207 kernel: [12224.614969] ? do_syscall_64+0x69/0xc0 Aug 22 08:47:30 juju-e4d256-prod-github-runner-207 kernel: [12224.615603] ? do_syscall_64+0x69/0xc0 Aug 22 08:47:30 juju-e4d256-prod-github-runner-207 kernel: [12224.616227] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 08:47:30 juju-e4d256-prod-github-runner-207 kernel: [12224.616935] RIP: 0033:0x7faa5d0edaff Aug 22 08:47:30 juju-e4d256-prod-github-runner-207 kernel: [12224.617568] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 08:47:30 juju-e4d256-prod-github-runner-207 kernel: [12224.619596] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 08:47:30 juju-e4d256-prod-github-runner-207 kernel: [12224.620509] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 08:47:30 juju-e4d256-prod-github-runner-207 kernel: [12224.621402] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 08:47:30 juju-e4d256-prod-github-runner-207 kernel: [12224.622311] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 08:47:30 juju-e4d256-prod-github-runner-207 kernel: [12224.623216] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 08:47:30 juju-e4d256-prod-github-runner-207 kernel: [12224.624127] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 08:47:30 juju-e4d256-prod-github-runner-207 kernel: [12224.625070] Aug 22 08:47:44 juju-e4d256-prod-github-runner-207 kernel: [12238.004709] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 08:47:44 juju-e4d256-prod-github-runner-207 kernel: [12238.005686] rcu: 1-....: (3020704 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=1459949 Aug 22 08:47:44 juju-e4d256-prod-github-runner-207 kernel: [12238.006880] (t=3030201 jiffies g=23269 q=20304) Aug 22 08:47:44 juju-e4d256-prod-github-runner-207 kernel: [12238.007677] NMI backtrace for cpu 1 Aug 22 08:47:44 juju-e4d256-prod-github-runner-207 kernel: [12238.008412] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 08:47:44 juju-e4d256-prod-github-runner-207 kernel: [12238.009582] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 08:47:44 juju-e4d256-prod-github-runner-207 kernel: [12238.010741] Call Trace: Aug 22 08:47:44 juju-e4d256-prod-github-runner-207 kernel: [12238.011429] Aug 22 08:47:44 juju-e4d256-prod-github-runner-207 kernel: [12238.012224] show_stack+0x52/0x5c Aug 22 08:47:44 juju-e4d256-prod-github-runner-207 kernel: [12238.013119] dump_stack_lvl+0x4a/0x63 Aug 22 08:47:44 juju-e4d256-prod-github-runner-207 kernel: [12238.013870] dump_stack+0x10/0x16 Aug 22 08:47:44 juju-e4d256-prod-github-runner-207 kernel: [12238.014615] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 08:47:44 juju-e4d256-prod-github-runner-207 kernel: [12238.015419] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 08:47:44 juju-e4d256-prod-github-runner-207 kernel: [12238.016211] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 08:47:44 juju-e4d256-prod-github-runner-207 kernel: [12238.017034] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 08:47:44 juju-e4d256-prod-github-runner-207 kernel: [12238.017857] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 08:47:44 juju-e4d256-prod-github-runner-207 kernel: [12238.018689] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 08:47:44 juju-e4d256-prod-github-runner-207 kernel: [12238.019462] print_cpu_stall.cold+0x2f/0xe2 Aug 22 08:47:44 juju-e4d256-prod-github-runner-207 kernel: [12238.020223] ? timekeeping_update+0xf7/0x150 Aug 22 08:47:44 juju-e4d256-prod-github-runner-207 kernel: [12238.020992] check_cpu_stall+0x109/0x270 Aug 22 08:47:44 juju-e4d256-prod-github-runner-207 kernel: [12238.021737] rcu_sched_clock_irq+0x9a/0x250 Aug 22 08:47:44 juju-e4d256-prod-github-runner-207 kernel: [12238.022541] update_process_times+0x94/0xd0 Aug 22 08:47:44 juju-e4d256-prod-github-runner-207 kernel: [12238.023329] tick_sched_handle+0x29/0x70 Aug 22 08:47:44 juju-e4d256-prod-github-runner-207 kernel: [12238.024076] tick_sched_timer+0x8c/0xc0 Aug 22 08:47:44 juju-e4d256-prod-github-runner-207 kernel: [12238.024815] ? tick_nohz_handler+0xb0/0xb0 Aug 22 08:47:44 juju-e4d256-prod-github-runner-207 kernel: [12238.025614] __hrtimer_run_queues+0x107/0x230 Aug 22 08:47:44 juju-e4d256-prod-github-runner-207 kernel: [12238.026410] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 08:47:44 juju-e4d256-prod-github-runner-207 kernel: [12238.027190] hrtimer_interrupt+0x101/0x220 Aug 22 08:47:44 juju-e4d256-prod-github-runner-207 kernel: [12238.027948] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 08:47:44 juju-e4d256-prod-github-runner-207 kernel: [12238.028758] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 08:47:44 juju-e4d256-prod-github-runner-207 kernel: [12238.029556] Aug 22 08:47:44 juju-e4d256-prod-github-runner-207 kernel: [12238.030216] Aug 22 08:47:44 juju-e4d256-prod-github-runner-207 kernel: [12238.030851] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 08:47:44 juju-e4d256-prod-github-runner-207 kernel: [12238.031667] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:47:44 juju-e4d256-prod-github-runner-207 kernel: [12238.032543] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 08:47:44 juju-e4d256-prod-github-runner-207 kernel: [12238.034788] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 08:47:44 juju-e4d256-prod-github-runner-207 kernel: [12238.035692] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 08:47:44 juju-e4d256-prod-github-runner-207 kernel: [12238.036690] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 08:47:44 juju-e4d256-prod-github-runner-207 kernel: [12238.037665] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 08:47:44 juju-e4d256-prod-github-runner-207 kernel: [12238.038647] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 08:47:44 juju-e4d256-prod-github-runner-207 kernel: [12238.039819] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 08:47:44 juju-e4d256-prod-github-runner-207 kernel: [12238.040928] ? _raw_spin_lock+0x22/0x30 Aug 22 08:47:44 juju-e4d256-prod-github-runner-207 kernel: [12238.041771] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:47:44 juju-e4d256-prod-github-runner-207 kernel: [12238.042725] direct_page_fault+0x206/0x310 [kvm] Aug 22 08:47:44 juju-e4d256-prod-github-runner-207 kernel: [12238.043655] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 08:47:44 juju-e4d256-prod-github-runner-207 kernel: [12238.044575] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 08:47:44 juju-e4d256-prod-github-runner-207 kernel: [12238.045499] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 08:47:44 juju-e4d256-prod-github-runner-207 kernel: [12238.046386] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 08:47:44 juju-e4d256-prod-github-runner-207 kernel: [12238.047187] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 08:47:44 juju-e4d256-prod-github-runner-207 kernel: [12238.048013] handle_exit+0x98/0x230 [kvm_amd] Aug 22 08:47:44 juju-e4d256-prod-github-runner-207 kernel: [12238.048790] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 08:47:44 juju-e4d256-prod-github-runner-207 kernel: [12238.049838] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 08:47:44 juju-e4d256-prod-github-runner-207 kernel: [12238.050679] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 08:47:44 juju-e4d256-prod-github-runner-207 kernel: [12238.051556] vcpu_run+0x62/0x2c0 [kvm] Aug 22 08:47:44 juju-e4d256-prod-github-runner-207 kernel: [12238.052282] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 08:47:44 juju-e4d256-prod-github-runner-207 kernel: [12238.053058] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 08:47:44 juju-e4d256-prod-github-runner-207 kernel: [12238.053863] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 08:47:44 juju-e4d256-prod-github-runner-207 kernel: [12238.054647] ? __seccomp_filter+0x4a/0x4a0 Aug 22 08:47:44 juju-e4d256-prod-github-runner-207 kernel: [12238.055374] ? __fget_files+0x86/0xc0 Aug 22 08:47:44 juju-e4d256-prod-github-runner-207 kernel: [12238.056081] __x64_sys_ioctl+0x95/0xd0 Aug 22 08:47:44 juju-e4d256-prod-github-runner-207 kernel: [12238.056805] do_syscall_64+0x5c/0xc0 Aug 22 08:47:44 juju-e4d256-prod-github-runner-207 kernel: [12238.057524] ? do_futex+0x162/0x1f0 Aug 22 08:47:44 juju-e4d256-prod-github-runner-207 kernel: [12238.058222] ? __x64_sys_futex+0x78/0x1e0 Aug 22 08:47:44 juju-e4d256-prod-github-runner-207 kernel: [12238.058926] ? __secure_computing+0xa9/0x120 Aug 22 08:47:44 juju-e4d256-prod-github-runner-207 kernel: [12238.059659] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 08:47:44 juju-e4d256-prod-github-runner-207 kernel: [12238.060455] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:47:44 juju-e4d256-prod-github-runner-207 kernel: [12238.061222] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:47:44 juju-e4d256-prod-github-runner-207 kernel: [12238.061992] ? do_syscall_64+0x69/0xc0 Aug 22 08:47:44 juju-e4d256-prod-github-runner-207 kernel: [12238.062704] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:47:44 juju-e4d256-prod-github-runner-207 kernel: [12238.063484] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:47:44 juju-e4d256-prod-github-runner-207 kernel: [12238.064253] ? do_syscall_64+0x69/0xc0 Aug 22 08:47:44 juju-e4d256-prod-github-runner-207 kernel: [12238.064950] ? do_syscall_64+0x69/0xc0 Aug 22 08:47:44 juju-e4d256-prod-github-runner-207 kernel: [12238.065638] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 08:47:44 juju-e4d256-prod-github-runner-207 kernel: [12238.066455] RIP: 0033:0x7faa5d0edaff Aug 22 08:47:44 juju-e4d256-prod-github-runner-207 kernel: [12238.067198] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 08:47:44 juju-e4d256-prod-github-runner-207 kernel: [12238.069606] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 08:47:44 juju-e4d256-prod-github-runner-207 kernel: [12238.070986] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 08:47:44 juju-e4d256-prod-github-runner-207 kernel: [12238.071940] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 08:47:44 juju-e4d256-prod-github-runner-207 kernel: [12238.072889] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 08:47:44 juju-e4d256-prod-github-runner-207 kernel: [12238.073845] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 08:47:44 juju-e4d256-prod-github-runner-207 kernel: [12238.074829] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 08:47:44 juju-e4d256-prod-github-runner-207 kernel: [12238.075753] Aug 22 08:48:10 juju-e4d256-prod-github-runner-207 kernel: [12264.541981] watchdog: BUG: soft lockup - CPU#1 stuck for 11314s! [qemu-system-x86:6715] Aug 22 08:48:10 juju-e4d256-prod-github-runner-207 kernel: [12264.543832] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 08:48:10 juju-e4d256-prod-github-runner-207 kernel: [12264.544126] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 08:48:10 juju-e4d256-prod-github-runner-207 kernel: [12264.556530] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 08:48:10 juju-e4d256-prod-github-runner-207 kernel: [12264.557858] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 08:48:10 juju-e4d256-prod-github-runner-207 kernel: [12264.559110] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:48:10 juju-e4d256-prod-github-runner-207 kernel: [12264.560180] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 08:48:10 juju-e4d256-prod-github-runner-207 kernel: [12264.562815] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 08:48:10 juju-e4d256-prod-github-runner-207 kernel: [12264.563890] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 08:48:10 juju-e4d256-prod-github-runner-207 kernel: [12264.565091] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 08:48:10 juju-e4d256-prod-github-runner-207 kernel: [12264.566293] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 08:48:10 juju-e4d256-prod-github-runner-207 kernel: [12264.567490] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 08:48:10 juju-e4d256-prod-github-runner-207 kernel: [12264.568681] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 08:48:10 juju-e4d256-prod-github-runner-207 kernel: [12264.570243] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 08:48:10 juju-e4d256-prod-github-runner-207 kernel: [12264.571481] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 08:48:10 juju-e4d256-prod-github-runner-207 kernel: [12264.572625] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 08:48:10 juju-e4d256-prod-github-runner-207 kernel: [12264.573923] Call Trace: Aug 22 08:48:10 juju-e4d256-prod-github-runner-207 kernel: [12264.574869] Aug 22 08:48:10 juju-e4d256-prod-github-runner-207 kernel: [12264.575797] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:48:10 juju-e4d256-prod-github-runner-207 kernel: [12264.576966] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:48:10 juju-e4d256-prod-github-runner-207 kernel: [12264.578042] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:48:10 juju-e4d256-prod-github-runner-207 kernel: [12264.579182] ? show_regs.part.0+0x23/0x29 Aug 22 08:48:10 juju-e4d256-prod-github-runner-207 kernel: [12264.580194] ? show_regs.cold+0x8/0xd Aug 22 08:48:10 juju-e4d256-prod-github-runner-207 kernel: [12264.581170] ? watchdog_timer_fn+0x1be/0x220 Aug 22 08:48:10 juju-e4d256-prod-github-runner-207 kernel: [12264.582305] ? lockup_detector_update_enable+0x60/0x60 Aug 22 08:48:10 juju-e4d256-prod-github-runner-207 kernel: [12264.583408] ? __hrtimer_run_queues+0x107/0x230 Aug 22 08:48:10 juju-e4d256-prod-github-runner-207 kernel: [12264.584462] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 08:48:10 juju-e4d256-prod-github-runner-207 kernel: [12264.585528] ? hrtimer_interrupt+0x101/0x220 Aug 22 08:48:10 juju-e4d256-prod-github-runner-207 kernel: [12264.586575] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 08:48:10 juju-e4d256-prod-github-runner-207 kernel: [12264.587662] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 08:48:10 juju-e4d256-prod-github-runner-207 kernel: [12264.588730] Aug 22 08:48:10 juju-e4d256-prod-github-runner-207 kernel: [12264.589610] Aug 22 08:48:10 juju-e4d256-prod-github-runner-207 kernel: [12264.590587] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 08:48:10 juju-e4d256-prod-github-runner-207 kernel: [12264.591743] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:48:10 juju-e4d256-prod-github-runner-207 kernel: [12264.592923] ? _raw_spin_lock+0x22/0x30 Aug 22 08:48:10 juju-e4d256-prod-github-runner-207 kernel: [12264.594054] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:48:10 juju-e4d256-prod-github-runner-207 kernel: [12264.595177] direct_page_fault+0x206/0x310 [kvm] Aug 22 08:48:10 juju-e4d256-prod-github-runner-207 kernel: [12264.596387] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 08:48:10 juju-e4d256-prod-github-runner-207 kernel: [12264.597624] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 08:48:10 juju-e4d256-prod-github-runner-207 kernel: [12264.598761] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 08:48:10 juju-e4d256-prod-github-runner-207 kernel: [12264.599777] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 08:48:10 juju-e4d256-prod-github-runner-207 kernel: [12264.600733] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 08:48:10 juju-e4d256-prod-github-runner-207 kernel: [12264.601724] handle_exit+0x98/0x230 [kvm_amd] Aug 22 08:48:10 juju-e4d256-prod-github-runner-207 kernel: [12264.602638] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 08:48:10 juju-e4d256-prod-github-runner-207 kernel: [12264.603565] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 08:48:10 juju-e4d256-prod-github-runner-207 kernel: [12264.604501] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 08:48:10 juju-e4d256-prod-github-runner-207 kernel: [12264.605406] vcpu_run+0x62/0x2c0 [kvm] Aug 22 08:48:10 juju-e4d256-prod-github-runner-207 kernel: [12264.606247] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 08:48:10 juju-e4d256-prod-github-runner-207 kernel: [12264.607068] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 08:48:10 juju-e4d256-prod-github-runner-207 kernel: [12264.607966] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 08:48:10 juju-e4d256-prod-github-runner-207 kernel: [12264.608794] ? __seccomp_filter+0x4a/0x4a0 Aug 22 08:48:10 juju-e4d256-prod-github-runner-207 kernel: [12264.609541] ? __fget_files+0x86/0xc0 Aug 22 08:48:10 juju-e4d256-prod-github-runner-207 kernel: [12264.610270] __x64_sys_ioctl+0x95/0xd0 Aug 22 08:48:10 juju-e4d256-prod-github-runner-207 kernel: [12264.610967] do_syscall_64+0x5c/0xc0 Aug 22 08:48:10 juju-e4d256-prod-github-runner-207 kernel: [12264.611647] ? do_futex+0x162/0x1f0 Aug 22 08:48:10 juju-e4d256-prod-github-runner-207 kernel: [12264.612299] ? __x64_sys_futex+0x78/0x1e0 Aug 22 08:48:10 juju-e4d256-prod-github-runner-207 kernel: [12264.612975] ? __secure_computing+0xa9/0x120 Aug 22 08:48:10 juju-e4d256-prod-github-runner-207 kernel: [12264.613678] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 08:48:10 juju-e4d256-prod-github-runner-207 kernel: [12264.614464] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:48:10 juju-e4d256-prod-github-runner-207 kernel: [12264.615189] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:48:10 juju-e4d256-prod-github-runner-207 kernel: [12264.615909] ? do_syscall_64+0x69/0xc0 Aug 22 08:48:10 juju-e4d256-prod-github-runner-207 kernel: [12264.616555] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:48:10 juju-e4d256-prod-github-runner-207 kernel: [12264.617260] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:48:10 juju-e4d256-prod-github-runner-207 kernel: [12264.617978] ? do_syscall_64+0x69/0xc0 Aug 22 08:48:10 juju-e4d256-prod-github-runner-207 kernel: [12264.618634] ? do_syscall_64+0x69/0xc0 Aug 22 08:48:10 juju-e4d256-prod-github-runner-207 kernel: [12264.619263] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 08:48:10 juju-e4d256-prod-github-runner-207 kernel: [12264.619970] RIP: 0033:0x7faa5d0edaff Aug 22 08:48:10 juju-e4d256-prod-github-runner-207 kernel: [12264.620637] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 08:48:10 juju-e4d256-prod-github-runner-207 kernel: [12264.622641] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 08:48:10 juju-e4d256-prod-github-runner-207 kernel: [12264.623551] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 08:48:10 juju-e4d256-prod-github-runner-207 kernel: [12264.624451] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 08:48:10 juju-e4d256-prod-github-runner-207 kernel: [12264.625338] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 08:48:10 juju-e4d256-prod-github-runner-207 kernel: [12264.626244] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 08:48:10 juju-e4d256-prod-github-runner-207 kernel: [12264.627135] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 08:48:10 juju-e4d256-prod-github-runner-207 kernel: [12264.628033] Aug 22 08:48:38 juju-e4d256-prod-github-runner-207 kernel: [12292.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 11340s! [qemu-system-x86:6715] Aug 22 08:48:38 juju-e4d256-prod-github-runner-207 kernel: [12292.543109] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 08:48:38 juju-e4d256-prod-github-runner-207 kernel: [12292.543184] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 08:48:38 juju-e4d256-prod-github-runner-207 kernel: [12292.555366] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 08:48:38 juju-e4d256-prod-github-runner-207 kernel: [12292.556624] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 08:48:38 juju-e4d256-prod-github-runner-207 kernel: [12292.557865] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:48:38 juju-e4d256-prod-github-runner-207 kernel: [12292.558924] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 08:48:38 juju-e4d256-prod-github-runner-207 kernel: [12292.561493] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 08:48:38 juju-e4d256-prod-github-runner-207 kernel: [12292.562555] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 08:48:38 juju-e4d256-prod-github-runner-207 kernel: [12292.563723] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 08:48:38 juju-e4d256-prod-github-runner-207 kernel: [12292.564879] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 08:48:38 juju-e4d256-prod-github-runner-207 kernel: [12292.566056] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 08:48:38 juju-e4d256-prod-github-runner-207 kernel: [12292.567217] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 08:48:38 juju-e4d256-prod-github-runner-207 kernel: [12292.568382] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 08:48:38 juju-e4d256-prod-github-runner-207 kernel: [12292.569630] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 08:48:38 juju-e4d256-prod-github-runner-207 kernel: [12292.570738] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 08:48:38 juju-e4d256-prod-github-runner-207 kernel: [12292.571941] Call Trace: Aug 22 08:48:38 juju-e4d256-prod-github-runner-207 kernel: [12292.572851] Aug 22 08:48:38 juju-e4d256-prod-github-runner-207 kernel: [12292.573746] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:48:38 juju-e4d256-prod-github-runner-207 kernel: [12292.574778] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:48:38 juju-e4d256-prod-github-runner-207 kernel: [12292.575795] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:48:38 juju-e4d256-prod-github-runner-207 kernel: [12292.576870] ? show_regs.part.0+0x23/0x29 Aug 22 08:48:38 juju-e4d256-prod-github-runner-207 kernel: [12292.577881] ? show_regs.cold+0x8/0xd Aug 22 08:48:38 juju-e4d256-prod-github-runner-207 kernel: [12292.578885] ? watchdog_timer_fn+0x1be/0x220 Aug 22 08:48:38 juju-e4d256-prod-github-runner-207 kernel: [12292.579902] ? lockup_detector_update_enable+0x60/0x60 Aug 22 08:48:38 juju-e4d256-prod-github-runner-207 kernel: [12292.580965] ? __hrtimer_run_queues+0x107/0x230 Aug 22 08:48:38 juju-e4d256-prod-github-runner-207 kernel: [12292.582006] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 08:48:38 juju-e4d256-prod-github-runner-207 kernel: [12292.583030] ? hrtimer_interrupt+0x101/0x220 Aug 22 08:48:38 juju-e4d256-prod-github-runner-207 kernel: [12292.584043] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 08:48:38 juju-e4d256-prod-github-runner-207 kernel: [12292.585110] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 08:48:38 juju-e4d256-prod-github-runner-207 kernel: [12292.586162] Aug 22 08:48:38 juju-e4d256-prod-github-runner-207 kernel: [12292.587018] Aug 22 08:48:38 juju-e4d256-prod-github-runner-207 kernel: [12292.587871] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 08:48:38 juju-e4d256-prod-github-runner-207 kernel: [12292.588949] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:48:38 juju-e4d256-prod-github-runner-207 kernel: [12292.590016] ? _raw_spin_lock+0x22/0x30 Aug 22 08:48:38 juju-e4d256-prod-github-runner-207 kernel: [12292.590960] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:48:38 juju-e4d256-prod-github-runner-207 kernel: [12292.591991] direct_page_fault+0x206/0x310 [kvm] Aug 22 08:48:38 juju-e4d256-prod-github-runner-207 kernel: [12292.593015] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 08:48:38 juju-e4d256-prod-github-runner-207 kernel: [12292.594030] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 08:48:38 juju-e4d256-prod-github-runner-207 kernel: [12292.595046] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 08:48:38 juju-e4d256-prod-github-runner-207 kernel: [12292.596013] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 08:48:38 juju-e4d256-prod-github-runner-207 kernel: [12292.596957] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 08:48:38 juju-e4d256-prod-github-runner-207 kernel: [12292.597980] handle_exit+0x98/0x230 [kvm_amd] Aug 22 08:48:38 juju-e4d256-prod-github-runner-207 kernel: [12292.598904] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 08:48:38 juju-e4d256-prod-github-runner-207 kernel: [12292.599817] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 08:48:38 juju-e4d256-prod-github-runner-207 kernel: [12292.600744] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 08:48:38 juju-e4d256-prod-github-runner-207 kernel: [12292.601661] vcpu_run+0x62/0x2c0 [kvm] Aug 22 08:48:38 juju-e4d256-prod-github-runner-207 kernel: [12292.602478] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 08:48:38 juju-e4d256-prod-github-runner-207 kernel: [12292.603288] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 08:48:38 juju-e4d256-prod-github-runner-207 kernel: [12292.604154] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 08:48:38 juju-e4d256-prod-github-runner-207 kernel: [12292.604960] ? __seccomp_filter+0x4a/0x4a0 Aug 22 08:48:38 juju-e4d256-prod-github-runner-207 kernel: [12292.605721] ? __fget_files+0x86/0xc0 Aug 22 08:48:38 juju-e4d256-prod-github-runner-207 kernel: [12292.606424] __x64_sys_ioctl+0x95/0xd0 Aug 22 08:48:38 juju-e4d256-prod-github-runner-207 kernel: [12292.607114] do_syscall_64+0x5c/0xc0 Aug 22 08:48:38 juju-e4d256-prod-github-runner-207 kernel: [12292.607775] ? do_futex+0x162/0x1f0 Aug 22 08:48:38 juju-e4d256-prod-github-runner-207 kernel: [12292.608432] ? __x64_sys_futex+0x78/0x1e0 Aug 22 08:48:38 juju-e4d256-prod-github-runner-207 kernel: [12292.609114] ? __secure_computing+0xa9/0x120 Aug 22 08:48:38 juju-e4d256-prod-github-runner-207 kernel: [12292.609828] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 08:48:38 juju-e4d256-prod-github-runner-207 kernel: [12292.610592] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:48:38 juju-e4d256-prod-github-runner-207 kernel: [12292.611310] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:48:38 juju-e4d256-prod-github-runner-207 kernel: [12292.612025] ? do_syscall_64+0x69/0xc0 Aug 22 08:48:38 juju-e4d256-prod-github-runner-207 kernel: [12292.612672] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:48:38 juju-e4d256-prod-github-runner-207 kernel: [12292.613373] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:48:38 juju-e4d256-prod-github-runner-207 kernel: [12292.614084] ? do_syscall_64+0x69/0xc0 Aug 22 08:48:38 juju-e4d256-prod-github-runner-207 kernel: [12292.614710] ? do_syscall_64+0x69/0xc0 Aug 22 08:48:38 juju-e4d256-prod-github-runner-207 kernel: [12292.615329] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 08:48:38 juju-e4d256-prod-github-runner-207 kernel: [12292.616031] RIP: 0033:0x7faa5d0edaff Aug 22 08:48:38 juju-e4d256-prod-github-runner-207 kernel: [12292.616661] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 08:48:38 juju-e4d256-prod-github-runner-207 kernel: [12292.618837] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 08:48:38 juju-e4d256-prod-github-runner-207 kernel: [12292.619823] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 08:48:38 juju-e4d256-prod-github-runner-207 kernel: [12292.620715] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 08:48:38 juju-e4d256-prod-github-runner-207 kernel: [12292.621684] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 08:48:38 juju-e4d256-prod-github-runner-207 kernel: [12292.622574] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 08:48:38 juju-e4d256-prod-github-runner-207 kernel: [12292.623467] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 08:48:38 juju-e4d256-prod-github-runner-207 kernel: [12292.624363] Aug 22 08:49:06 juju-e4d256-prod-github-runner-207 kernel: [12320.541980] watchdog: BUG: soft lockup - CPU#1 stuck for 11366s! [qemu-system-x86:6715] Aug 22 08:49:06 juju-e4d256-prod-github-runner-207 kernel: [12320.543120] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 08:49:06 juju-e4d256-prod-github-runner-207 kernel: [12320.543195] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 08:49:06 juju-e4d256-prod-github-runner-207 kernel: [12320.555539] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 08:49:06 juju-e4d256-prod-github-runner-207 kernel: [12320.556836] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 08:49:06 juju-e4d256-prod-github-runner-207 kernel: [12320.558107] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:49:06 juju-e4d256-prod-github-runner-207 kernel: [12320.559223] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 08:49:06 juju-e4d256-prod-github-runner-207 kernel: [12320.561828] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 08:49:06 juju-e4d256-prod-github-runner-207 kernel: [12320.562914] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 08:49:06 juju-e4d256-prod-github-runner-207 kernel: [12320.564126] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 08:49:06 juju-e4d256-prod-github-runner-207 kernel: [12320.565325] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 08:49:06 juju-e4d256-prod-github-runner-207 kernel: [12320.566505] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 08:49:06 juju-e4d256-prod-github-runner-207 kernel: [12320.567682] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 08:49:06 juju-e4d256-prod-github-runner-207 kernel: [12320.568858] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 08:49:06 juju-e4d256-prod-github-runner-207 kernel: [12320.570124] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 08:49:06 juju-e4d256-prod-github-runner-207 kernel: [12320.571319] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 08:49:06 juju-e4d256-prod-github-runner-207 kernel: [12320.572572] Call Trace: Aug 22 08:49:06 juju-e4d256-prod-github-runner-207 kernel: [12320.573554] Aug 22 08:49:06 juju-e4d256-prod-github-runner-207 kernel: [12320.574441] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:49:06 juju-e4d256-prod-github-runner-207 kernel: [12320.575492] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:49:06 juju-e4d256-prod-github-runner-207 kernel: [12320.576541] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:49:06 juju-e4d256-prod-github-runner-207 kernel: [12320.577652] ? show_regs.part.0+0x23/0x29 Aug 22 08:49:06 juju-e4d256-prod-github-runner-207 kernel: [12320.578656] ? show_regs.cold+0x8/0xd Aug 22 08:49:06 juju-e4d256-prod-github-runner-207 kernel: [12320.579629] ? watchdog_timer_fn+0x1be/0x220 Aug 22 08:49:06 juju-e4d256-prod-github-runner-207 kernel: [12320.580655] ? lockup_detector_update_enable+0x60/0x60 Aug 22 08:49:06 juju-e4d256-prod-github-runner-207 kernel: [12320.581777] ? __hrtimer_run_queues+0x107/0x230 Aug 22 08:49:06 juju-e4d256-prod-github-runner-207 kernel: [12320.582831] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 08:49:06 juju-e4d256-prod-github-runner-207 kernel: [12320.583956] ? hrtimer_interrupt+0x101/0x220 Aug 22 08:49:06 juju-e4d256-prod-github-runner-207 kernel: [12320.584978] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 08:49:06 juju-e4d256-prod-github-runner-207 kernel: [12320.586088] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 08:49:06 juju-e4d256-prod-github-runner-207 kernel: [12320.587159] Aug 22 08:49:06 juju-e4d256-prod-github-runner-207 kernel: [12320.588025] Aug 22 08:49:06 juju-e4d256-prod-github-runner-207 kernel: [12320.588876] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 08:49:06 juju-e4d256-prod-github-runner-207 kernel: [12320.589950] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:49:06 juju-e4d256-prod-github-runner-207 kernel: [12320.591008] ? _raw_spin_lock+0x22/0x30 Aug 22 08:49:06 juju-e4d256-prod-github-runner-207 kernel: [12320.591976] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:49:06 juju-e4d256-prod-github-runner-207 kernel: [12320.593086] direct_page_fault+0x206/0x310 [kvm] Aug 22 08:49:06 juju-e4d256-prod-github-runner-207 kernel: [12320.594174] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 08:49:06 juju-e4d256-prod-github-runner-207 kernel: [12320.595190] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 08:49:06 juju-e4d256-prod-github-runner-207 kernel: [12320.596208] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 08:49:06 juju-e4d256-prod-github-runner-207 kernel: [12320.597225] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 08:49:06 juju-e4d256-prod-github-runner-207 kernel: [12320.598180] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 08:49:06 juju-e4d256-prod-github-runner-207 kernel: [12320.599184] handle_exit+0x98/0x230 [kvm_amd] Aug 22 08:49:06 juju-e4d256-prod-github-runner-207 kernel: [12320.600087] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 08:49:06 juju-e4d256-prod-github-runner-207 kernel: [12320.601008] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 08:49:06 juju-e4d256-prod-github-runner-207 kernel: [12320.602004] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 08:49:06 juju-e4d256-prod-github-runner-207 kernel: [12320.602933] vcpu_run+0x62/0x2c0 [kvm] Aug 22 08:49:06 juju-e4d256-prod-github-runner-207 kernel: [12320.603756] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 08:49:06 juju-e4d256-prod-github-runner-207 kernel: [12320.604568] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 08:49:06 juju-e4d256-prod-github-runner-207 kernel: [12320.605453] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 08:49:06 juju-e4d256-prod-github-runner-207 kernel: [12320.606257] ? __seccomp_filter+0x4a/0x4a0 Aug 22 08:49:06 juju-e4d256-prod-github-runner-207 kernel: [12320.607029] ? __fget_files+0x86/0xc0 Aug 22 08:49:06 juju-e4d256-prod-github-runner-207 kernel: [12320.607751] __x64_sys_ioctl+0x95/0xd0 Aug 22 08:49:06 juju-e4d256-prod-github-runner-207 kernel: [12320.608453] do_syscall_64+0x5c/0xc0 Aug 22 08:49:06 juju-e4d256-prod-github-runner-207 kernel: [12320.609236] ? do_futex+0x162/0x1f0 Aug 22 08:49:06 juju-e4d256-prod-github-runner-207 kernel: [12320.609970] ? __x64_sys_futex+0x78/0x1e0 Aug 22 08:49:06 juju-e4d256-prod-github-runner-207 kernel: [12320.610651] ? __secure_computing+0xa9/0x120 Aug 22 08:49:06 juju-e4d256-prod-github-runner-207 kernel: [12320.611409] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 08:49:06 juju-e4d256-prod-github-runner-207 kernel: [12320.612177] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:49:06 juju-e4d256-prod-github-runner-207 kernel: [12320.612919] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:49:06 juju-e4d256-prod-github-runner-207 kernel: [12320.613678] ? do_syscall_64+0x69/0xc0 Aug 22 08:49:06 juju-e4d256-prod-github-runner-207 kernel: [12320.614359] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:49:06 juju-e4d256-prod-github-runner-207 kernel: [12320.615117] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:49:06 juju-e4d256-prod-github-runner-207 kernel: [12320.615822] ? do_syscall_64+0x69/0xc0 Aug 22 08:49:06 juju-e4d256-prod-github-runner-207 kernel: [12320.616466] ? do_syscall_64+0x69/0xc0 Aug 22 08:49:06 juju-e4d256-prod-github-runner-207 kernel: [12320.617175] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 08:49:06 juju-e4d256-prod-github-runner-207 kernel: [12320.617964] RIP: 0033:0x7faa5d0edaff Aug 22 08:49:06 juju-e4d256-prod-github-runner-207 kernel: [12320.618602] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 08:49:06 juju-e4d256-prod-github-runner-207 kernel: [12320.620634] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 08:49:06 juju-e4d256-prod-github-runner-207 kernel: [12320.621605] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 08:49:06 juju-e4d256-prod-github-runner-207 kernel: [12320.622499] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 08:49:06 juju-e4d256-prod-github-runner-207 kernel: [12320.623520] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 08:49:06 juju-e4d256-prod-github-runner-207 kernel: [12320.624574] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 08:49:06 juju-e4d256-prod-github-runner-207 kernel: [12320.625538] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 08:49:06 juju-e4d256-prod-github-runner-207 kernel: [12320.626464] Aug 22 08:49:34 juju-e4d256-prod-github-runner-207 kernel: [12348.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 11392s! [qemu-system-x86:6715] Aug 22 08:49:34 juju-e4d256-prod-github-runner-207 kernel: [12348.543904] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 08:49:34 juju-e4d256-prod-github-runner-207 kernel: [12348.544226] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 08:49:34 juju-e4d256-prod-github-runner-207 kernel: [12348.556446] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 08:49:34 juju-e4d256-prod-github-runner-207 kernel: [12348.557729] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 08:49:34 juju-e4d256-prod-github-runner-207 kernel: [12348.558953] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:49:34 juju-e4d256-prod-github-runner-207 kernel: [12348.560010] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 08:49:34 juju-e4d256-prod-github-runner-207 kernel: [12348.562580] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 08:49:34 juju-e4d256-prod-github-runner-207 kernel: [12348.563621] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 08:49:34 juju-e4d256-prod-github-runner-207 kernel: [12348.564802] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 08:49:34 juju-e4d256-prod-github-runner-207 kernel: [12348.565963] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 08:49:34 juju-e4d256-prod-github-runner-207 kernel: [12348.567128] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 08:49:34 juju-e4d256-prod-github-runner-207 kernel: [12348.568291] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 08:49:34 juju-e4d256-prod-github-runner-207 kernel: [12348.569472] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 08:49:34 juju-e4d256-prod-github-runner-207 kernel: [12348.570710] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 08:49:34 juju-e4d256-prod-github-runner-207 kernel: [12348.571809] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 08:49:34 juju-e4d256-prod-github-runner-207 kernel: [12348.573026] Call Trace: Aug 22 08:49:34 juju-e4d256-prod-github-runner-207 kernel: [12348.573982] Aug 22 08:49:34 juju-e4d256-prod-github-runner-207 kernel: [12348.574898] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:49:34 juju-e4d256-prod-github-runner-207 kernel: [12348.575930] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:49:34 juju-e4d256-prod-github-runner-207 kernel: [12348.576972] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:49:34 juju-e4d256-prod-github-runner-207 kernel: [12348.578086] ? show_regs.part.0+0x23/0x29 Aug 22 08:49:34 juju-e4d256-prod-github-runner-207 kernel: [12348.579083] ? show_regs.cold+0x8/0xd Aug 22 08:49:34 juju-e4d256-prod-github-runner-207 kernel: [12348.580052] ? watchdog_timer_fn+0x1be/0x220 Aug 22 08:49:34 juju-e4d256-prod-github-runner-207 kernel: [12348.581070] ? lockup_detector_update_enable+0x60/0x60 Aug 22 08:49:34 juju-e4d256-prod-github-runner-207 kernel: [12348.582134] ? __hrtimer_run_queues+0x107/0x230 Aug 22 08:49:34 juju-e4d256-prod-github-runner-207 kernel: [12348.583161] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 08:49:34 juju-e4d256-prod-github-runner-207 kernel: [12348.584258] ? hrtimer_interrupt+0x101/0x220 Aug 22 08:49:34 juju-e4d256-prod-github-runner-207 kernel: [12348.586538] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 08:49:34 juju-e4d256-prod-github-runner-207 kernel: [12348.587622] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 08:49:34 juju-e4d256-prod-github-runner-207 kernel: [12348.588667] Aug 22 08:49:34 juju-e4d256-prod-github-runner-207 kernel: [12348.589547] Aug 22 08:49:34 juju-e4d256-prod-github-runner-207 kernel: [12348.590383] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 08:49:34 juju-e4d256-prod-github-runner-207 kernel: [12348.591423] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:49:34 juju-e4d256-prod-github-runner-207 kernel: [12348.592467] ? _raw_spin_lock+0x22/0x30 Aug 22 08:49:34 juju-e4d256-prod-github-runner-207 kernel: [12348.593425] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:49:34 juju-e4d256-prod-github-runner-207 kernel: [12348.594442] direct_page_fault+0x206/0x310 [kvm] Aug 22 08:49:34 juju-e4d256-prod-github-runner-207 kernel: [12348.595464] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 08:49:34 juju-e4d256-prod-github-runner-207 kernel: [12348.596471] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 08:49:34 juju-e4d256-prod-github-runner-207 kernel: [12348.597496] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 08:49:34 juju-e4d256-prod-github-runner-207 kernel: [12348.598504] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 08:49:34 juju-e4d256-prod-github-runner-207 kernel: [12348.599542] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 08:49:34 juju-e4d256-prod-github-runner-207 kernel: [12348.600751] handle_exit+0x98/0x230 [kvm_amd] Aug 22 08:49:34 juju-e4d256-prod-github-runner-207 kernel: [12348.601753] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 08:49:34 juju-e4d256-prod-github-runner-207 kernel: [12348.602762] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 08:49:34 juju-e4d256-prod-github-runner-207 kernel: [12348.603779] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 08:49:34 juju-e4d256-prod-github-runner-207 kernel: [12348.604865] vcpu_run+0x62/0x2c0 [kvm] Aug 22 08:49:34 juju-e4d256-prod-github-runner-207 kernel: [12348.605751] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 08:49:34 juju-e4d256-prod-github-runner-207 kernel: [12348.606645] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 08:49:34 juju-e4d256-prod-github-runner-207 kernel: [12348.607596] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 08:49:34 juju-e4d256-prod-github-runner-207 kernel: [12348.608475] ? __seccomp_filter+0x4a/0x4a0 Aug 22 08:49:34 juju-e4d256-prod-github-runner-207 kernel: [12348.609315] ? __fget_files+0x86/0xc0 Aug 22 08:49:34 juju-e4d256-prod-github-runner-207 kernel: [12348.610087] __x64_sys_ioctl+0x95/0xd0 Aug 22 08:49:34 juju-e4d256-prod-github-runner-207 kernel: [12348.610866] do_syscall_64+0x5c/0xc0 Aug 22 08:49:34 juju-e4d256-prod-github-runner-207 kernel: [12348.611599] ? do_futex+0x162/0x1f0 Aug 22 08:49:34 juju-e4d256-prod-github-runner-207 kernel: [12348.612318] ? __x64_sys_futex+0x78/0x1e0 Aug 22 08:49:34 juju-e4d256-prod-github-runner-207 kernel: [12348.613090] ? __secure_computing+0xa9/0x120 Aug 22 08:49:34 juju-e4d256-prod-github-runner-207 kernel: [12348.613865] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 08:49:34 juju-e4d256-prod-github-runner-207 kernel: [12348.614737] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:49:34 juju-e4d256-prod-github-runner-207 kernel: [12348.615550] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:49:34 juju-e4d256-prod-github-runner-207 kernel: [12348.616358] ? do_syscall_64+0x69/0xc0 Aug 22 08:49:34 juju-e4d256-prod-github-runner-207 kernel: [12348.617102] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:49:34 juju-e4d256-prod-github-runner-207 kernel: [12348.617905] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:49:34 juju-e4d256-prod-github-runner-207 kernel: [12348.618692] ? do_syscall_64+0x69/0xc0 Aug 22 08:49:34 juju-e4d256-prod-github-runner-207 kernel: [12348.619388] ? do_syscall_64+0x69/0xc0 Aug 22 08:49:34 juju-e4d256-prod-github-runner-207 kernel: [12348.620080] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 08:49:34 juju-e4d256-prod-github-runner-207 kernel: [12348.620908] RIP: 0033:0x7faa5d0edaff Aug 22 08:49:34 juju-e4d256-prod-github-runner-207 kernel: [12348.621740] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 08:49:34 juju-e4d256-prod-github-runner-207 kernel: [12348.624123] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 08:49:34 juju-e4d256-prod-github-runner-207 kernel: [12348.625191] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 08:49:34 juju-e4d256-prod-github-runner-207 kernel: [12348.626213] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 08:49:34 juju-e4d256-prod-github-runner-207 kernel: [12348.627235] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 08:49:34 juju-e4d256-prod-github-runner-207 kernel: [12348.628247] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 08:49:34 juju-e4d256-prod-github-runner-207 kernel: [12348.629281] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 08:49:34 juju-e4d256-prod-github-runner-207 kernel: [12348.630303] Aug 22 08:50:02 juju-e4d256-prod-github-runner-207 kernel: [12376.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 11418s! [qemu-system-x86:6715] Aug 22 08:50:02 juju-e4d256-prod-github-runner-207 kernel: [12376.543103] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 08:50:02 juju-e4d256-prod-github-runner-207 kernel: [12376.543177] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 08:50:02 juju-e4d256-prod-github-runner-207 kernel: [12376.555425] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 08:50:02 juju-e4d256-prod-github-runner-207 kernel: [12376.556706] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 08:50:02 juju-e4d256-prod-github-runner-207 kernel: [12376.557922] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:50:02 juju-e4d256-prod-github-runner-207 kernel: [12376.558977] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 08:50:02 juju-e4d256-prod-github-runner-207 kernel: [12376.561530] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 08:50:02 juju-e4d256-prod-github-runner-207 kernel: [12376.562573] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 08:50:02 juju-e4d256-prod-github-runner-207 kernel: [12376.563740] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 08:50:02 juju-e4d256-prod-github-runner-207 kernel: [12376.564910] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 08:50:02 juju-e4d256-prod-github-runner-207 kernel: [12376.566076] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 08:50:02 juju-e4d256-prod-github-runner-207 kernel: [12376.567237] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 08:50:02 juju-e4d256-prod-github-runner-207 kernel: [12376.568402] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 08:50:02 juju-e4d256-prod-github-runner-207 kernel: [12376.569652] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 08:50:02 juju-e4d256-prod-github-runner-207 kernel: [12376.570748] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 08:50:02 juju-e4d256-prod-github-runner-207 kernel: [12376.571938] Call Trace: Aug 22 08:50:02 juju-e4d256-prod-github-runner-207 kernel: [12376.572867] Aug 22 08:50:02 juju-e4d256-prod-github-runner-207 kernel: [12376.573757] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:50:02 juju-e4d256-prod-github-runner-207 kernel: [12376.574785] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:50:02 juju-e4d256-prod-github-runner-207 kernel: [12376.575843] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:50:02 juju-e4d256-prod-github-runner-207 kernel: [12376.576937] ? show_regs.part.0+0x23/0x29 Aug 22 08:50:02 juju-e4d256-prod-github-runner-207 kernel: [12376.577942] ? show_regs.cold+0x8/0xd Aug 22 08:50:02 juju-e4d256-prod-github-runner-207 kernel: [12376.578916] ? watchdog_timer_fn+0x1be/0x220 Aug 22 08:50:02 juju-e4d256-prod-github-runner-207 kernel: [12376.579924] ? lockup_detector_update_enable+0x60/0x60 Aug 22 08:50:02 juju-e4d256-prod-github-runner-207 kernel: [12376.581030] ? __hrtimer_run_queues+0x107/0x230 Aug 22 08:50:02 juju-e4d256-prod-github-runner-207 kernel: [12376.582065] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 08:50:02 juju-e4d256-prod-github-runner-207 kernel: [12376.583106] ? hrtimer_interrupt+0x101/0x220 Aug 22 08:50:02 juju-e4d256-prod-github-runner-207 kernel: [12376.584128] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 08:50:02 juju-e4d256-prod-github-runner-207 kernel: [12376.585210] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 08:50:02 juju-e4d256-prod-github-runner-207 kernel: [12376.586256] Aug 22 08:50:02 juju-e4d256-prod-github-runner-207 kernel: [12376.587232] Aug 22 08:50:02 juju-e4d256-prod-github-runner-207 kernel: [12376.588093] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 08:50:02 juju-e4d256-prod-github-runner-207 kernel: [12376.589139] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:50:02 juju-e4d256-prod-github-runner-207 kernel: [12376.590183] ? _raw_spin_lock+0x22/0x30 Aug 22 08:50:02 juju-e4d256-prod-github-runner-207 kernel: [12376.591128] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:50:02 juju-e4d256-prod-github-runner-207 kernel: [12376.592147] direct_page_fault+0x206/0x310 [kvm] Aug 22 08:50:02 juju-e4d256-prod-github-runner-207 kernel: [12376.593198] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 08:50:02 juju-e4d256-prod-github-runner-207 kernel: [12376.594214] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 08:50:02 juju-e4d256-prod-github-runner-207 kernel: [12376.595216] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 08:50:02 juju-e4d256-prod-github-runner-207 kernel: [12376.596189] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 08:50:02 juju-e4d256-prod-github-runner-207 kernel: [12376.597149] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 08:50:02 juju-e4d256-prod-github-runner-207 kernel: [12376.598132] handle_exit+0x98/0x230 [kvm_amd] Aug 22 08:50:02 juju-e4d256-prod-github-runner-207 kernel: [12376.599030] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 08:50:02 juju-e4d256-prod-github-runner-207 kernel: [12376.599944] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 08:50:02 juju-e4d256-prod-github-runner-207 kernel: [12376.600892] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 08:50:02 juju-e4d256-prod-github-runner-207 kernel: [12376.601799] vcpu_run+0x62/0x2c0 [kvm] Aug 22 08:50:02 juju-e4d256-prod-github-runner-207 kernel: [12376.602612] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 08:50:02 juju-e4d256-prod-github-runner-207 kernel: [12376.603421] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 08:50:02 juju-e4d256-prod-github-runner-207 kernel: [12376.604275] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 08:50:02 juju-e4d256-prod-github-runner-207 kernel: [12376.605085] ? __seccomp_filter+0x4a/0x4a0 Aug 22 08:50:02 juju-e4d256-prod-github-runner-207 kernel: [12376.605826] ? __fget_files+0x86/0xc0 Aug 22 08:50:02 juju-e4d256-prod-github-runner-207 kernel: [12376.606533] __x64_sys_ioctl+0x95/0xd0 Aug 22 08:50:02 juju-e4d256-prod-github-runner-207 kernel: [12376.607257] do_syscall_64+0x5c/0xc0 Aug 22 08:50:02 juju-e4d256-prod-github-runner-207 kernel: [12376.607926] ? do_futex+0x162/0x1f0 Aug 22 08:50:02 juju-e4d256-prod-github-runner-207 kernel: [12376.608590] ? __x64_sys_futex+0x78/0x1e0 Aug 22 08:50:02 juju-e4d256-prod-github-runner-207 kernel: [12376.609284] ? __secure_computing+0xa9/0x120 Aug 22 08:50:02 juju-e4d256-prod-github-runner-207 kernel: [12376.609985] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 08:50:02 juju-e4d256-prod-github-runner-207 kernel: [12376.610750] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:50:02 juju-e4d256-prod-github-runner-207 kernel: [12376.611489] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:50:02 juju-e4d256-prod-github-runner-207 kernel: [12376.612221] ? do_syscall_64+0x69/0xc0 Aug 22 08:50:02 juju-e4d256-prod-github-runner-207 kernel: [12376.612889] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:50:02 juju-e4d256-prod-github-runner-207 kernel: [12376.613598] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:50:02 juju-e4d256-prod-github-runner-207 kernel: [12376.614295] ? do_syscall_64+0x69/0xc0 Aug 22 08:50:02 juju-e4d256-prod-github-runner-207 kernel: [12376.614919] ? do_syscall_64+0x69/0xc0 Aug 22 08:50:02 juju-e4d256-prod-github-runner-207 kernel: [12376.615541] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 08:50:02 juju-e4d256-prod-github-runner-207 kernel: [12376.616251] RIP: 0033:0x7faa5d0edaff Aug 22 08:50:02 juju-e4d256-prod-github-runner-207 kernel: [12376.616908] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 08:50:02 juju-e4d256-prod-github-runner-207 kernel: [12376.618918] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 08:50:02 juju-e4d256-prod-github-runner-207 kernel: [12376.619865] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 08:50:02 juju-e4d256-prod-github-runner-207 kernel: [12376.620771] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 08:50:02 juju-e4d256-prod-github-runner-207 kernel: [12376.621664] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 08:50:02 juju-e4d256-prod-github-runner-207 kernel: [12376.622563] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 08:50:02 juju-e4d256-prod-github-runner-207 kernel: [12376.623454] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 08:50:02 juju-e4d256-prod-github-runner-207 kernel: [12376.624349] Aug 22 08:50:30 juju-e4d256-prod-github-runner-207 kernel: [12404.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 11444s! [qemu-system-x86:6715] Aug 22 08:50:30 juju-e4d256-prod-github-runner-207 kernel: [12404.543099] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 08:50:30 juju-e4d256-prod-github-runner-207 kernel: [12404.543173] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 08:50:30 juju-e4d256-prod-github-runner-207 kernel: [12404.555219] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 08:50:30 juju-e4d256-prod-github-runner-207 kernel: [12404.556492] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 08:50:30 juju-e4d256-prod-github-runner-207 kernel: [12404.557718] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:50:30 juju-e4d256-prod-github-runner-207 kernel: [12404.558777] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 08:50:30 juju-e4d256-prod-github-runner-207 kernel: [12404.561358] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 08:50:30 juju-e4d256-prod-github-runner-207 kernel: [12404.562404] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 08:50:30 juju-e4d256-prod-github-runner-207 kernel: [12404.563566] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 08:50:30 juju-e4d256-prod-github-runner-207 kernel: [12404.564739] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 08:50:30 juju-e4d256-prod-github-runner-207 kernel: [12404.565901] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 08:50:30 juju-e4d256-prod-github-runner-207 kernel: [12404.567065] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 08:50:30 juju-e4d256-prod-github-runner-207 kernel: [12404.568245] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 08:50:30 juju-e4d256-prod-github-runner-207 kernel: [12404.569489] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 08:50:30 juju-e4d256-prod-github-runner-207 kernel: [12404.570603] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 08:50:30 juju-e4d256-prod-github-runner-207 kernel: [12404.571800] Call Trace: Aug 22 08:50:30 juju-e4d256-prod-github-runner-207 kernel: [12404.572722] Aug 22 08:50:30 juju-e4d256-prod-github-runner-207 kernel: [12404.573607] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:50:30 juju-e4d256-prod-github-runner-207 kernel: [12404.574666] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:50:30 juju-e4d256-prod-github-runner-207 kernel: [12404.575691] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:50:30 juju-e4d256-prod-github-runner-207 kernel: [12404.576814] ? show_regs.part.0+0x23/0x29 Aug 22 08:50:30 juju-e4d256-prod-github-runner-207 kernel: [12404.577816] ? show_regs.cold+0x8/0xd Aug 22 08:50:30 juju-e4d256-prod-github-runner-207 kernel: [12404.578788] ? watchdog_timer_fn+0x1be/0x220 Aug 22 08:50:30 juju-e4d256-prod-github-runner-207 kernel: [12404.579802] ? lockup_detector_update_enable+0x60/0x60 Aug 22 08:50:30 juju-e4d256-prod-github-runner-207 kernel: [12404.580880] ? __hrtimer_run_queues+0x107/0x230 Aug 22 08:50:30 juju-e4d256-prod-github-runner-207 kernel: [12404.581912] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 08:50:30 juju-e4d256-prod-github-runner-207 kernel: [12404.582955] ? hrtimer_interrupt+0x101/0x220 Aug 22 08:50:30 juju-e4d256-prod-github-runner-207 kernel: [12404.583975] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 08:50:30 juju-e4d256-prod-github-runner-207 kernel: [12404.585057] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 08:50:30 juju-e4d256-prod-github-runner-207 kernel: [12404.586103] Aug 22 08:50:30 juju-e4d256-prod-github-runner-207 kernel: [12404.586955] Aug 22 08:50:30 juju-e4d256-prod-github-runner-207 kernel: [12404.587798] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 08:50:30 juju-e4d256-prod-github-runner-207 kernel: [12404.588845] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:50:30 juju-e4d256-prod-github-runner-207 kernel: [12404.589883] ? _raw_spin_lock+0x22/0x30 Aug 22 08:50:30 juju-e4d256-prod-github-runner-207 kernel: [12404.590831] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:50:30 juju-e4d256-prod-github-runner-207 kernel: [12404.591845] direct_page_fault+0x206/0x310 [kvm] Aug 22 08:50:30 juju-e4d256-prod-github-runner-207 kernel: [12404.592873] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 08:50:30 juju-e4d256-prod-github-runner-207 kernel: [12404.593885] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 08:50:30 juju-e4d256-prod-github-runner-207 kernel: [12404.594889] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 08:50:30 juju-e4d256-prod-github-runner-207 kernel: [12404.595863] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 08:50:30 juju-e4d256-prod-github-runner-207 kernel: [12404.596815] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 08:50:30 juju-e4d256-prod-github-runner-207 kernel: [12404.597794] handle_exit+0x98/0x230 [kvm_amd] Aug 22 08:50:30 juju-e4d256-prod-github-runner-207 kernel: [12404.598688] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 08:50:30 juju-e4d256-prod-github-runner-207 kernel: [12404.599650] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 08:50:30 juju-e4d256-prod-github-runner-207 kernel: [12404.600584] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 08:50:30 juju-e4d256-prod-github-runner-207 kernel: [12404.601517] vcpu_run+0x62/0x2c0 [kvm] Aug 22 08:50:30 juju-e4d256-prod-github-runner-207 kernel: [12404.602328] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 08:50:30 juju-e4d256-prod-github-runner-207 kernel: [12404.603135] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 08:50:30 juju-e4d256-prod-github-runner-207 kernel: [12404.604000] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 08:50:30 juju-e4d256-prod-github-runner-207 kernel: [12404.604804] ? __seccomp_filter+0x4a/0x4a0 Aug 22 08:50:30 juju-e4d256-prod-github-runner-207 kernel: [12404.605557] ? __fget_files+0x86/0xc0 Aug 22 08:50:30 juju-e4d256-prod-github-runner-207 kernel: [12404.606320] __x64_sys_ioctl+0x95/0xd0 Aug 22 08:50:30 juju-e4d256-prod-github-runner-207 kernel: [12404.607011] do_syscall_64+0x5c/0xc0 Aug 22 08:50:30 juju-e4d256-prod-github-runner-207 kernel: [12404.607695] ? do_futex+0x162/0x1f0 Aug 22 08:50:30 juju-e4d256-prod-github-runner-207 kernel: [12404.608384] ? __x64_sys_futex+0x78/0x1e0 Aug 22 08:50:30 juju-e4d256-prod-github-runner-207 kernel: [12404.609059] ? __secure_computing+0xa9/0x120 Aug 22 08:50:30 juju-e4d256-prod-github-runner-207 kernel: [12404.609746] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 08:50:30 juju-e4d256-prod-github-runner-207 kernel: [12404.610503] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:50:30 juju-e4d256-prod-github-runner-207 kernel: [12404.611223] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:50:30 juju-e4d256-prod-github-runner-207 kernel: [12404.611938] ? do_syscall_64+0x69/0xc0 Aug 22 08:50:30 juju-e4d256-prod-github-runner-207 kernel: [12404.612735] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:50:30 juju-e4d256-prod-github-runner-207 kernel: [12404.613442] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:50:30 juju-e4d256-prod-github-runner-207 kernel: [12404.614134] ? do_syscall_64+0x69/0xc0 Aug 22 08:50:30 juju-e4d256-prod-github-runner-207 kernel: [12404.614755] ? do_syscall_64+0x69/0xc0 Aug 22 08:50:30 juju-e4d256-prod-github-runner-207 kernel: [12404.615380] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 08:50:30 juju-e4d256-prod-github-runner-207 kernel: [12404.616111] RIP: 0033:0x7faa5d0edaff Aug 22 08:50:30 juju-e4d256-prod-github-runner-207 kernel: [12404.616738] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 08:50:30 juju-e4d256-prod-github-runner-207 kernel: [12404.618711] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 08:50:30 juju-e4d256-prod-github-runner-207 kernel: [12404.619615] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 08:50:30 juju-e4d256-prod-github-runner-207 kernel: [12404.620516] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 08:50:30 juju-e4d256-prod-github-runner-207 kernel: [12404.621401] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 08:50:30 juju-e4d256-prod-github-runner-207 kernel: [12404.622304] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 08:50:30 juju-e4d256-prod-github-runner-207 kernel: [12404.623190] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 08:50:30 juju-e4d256-prod-github-runner-207 kernel: [12404.624094] Aug 22 08:50:44 juju-e4d256-prod-github-runner-207 kernel: [12418.016705] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 08:50:44 juju-e4d256-prod-github-runner-207 kernel: [12418.017686] rcu: 1-....: (3065571 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=1481580 Aug 22 08:50:44 juju-e4d256-prod-github-runner-207 kernel: [12418.018864] (t=3075204 jiffies g=23269 q=20452) Aug 22 08:50:44 juju-e4d256-prod-github-runner-207 kernel: [12418.019652] NMI backtrace for cpu 1 Aug 22 08:50:44 juju-e4d256-prod-github-runner-207 kernel: [12418.020385] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 08:50:44 juju-e4d256-prod-github-runner-207 kernel: [12418.021580] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 08:50:44 juju-e4d256-prod-github-runner-207 kernel: [12418.022721] Call Trace: Aug 22 08:50:44 juju-e4d256-prod-github-runner-207 kernel: [12418.023459] Aug 22 08:50:44 juju-e4d256-prod-github-runner-207 kernel: [12418.024156] show_stack+0x52/0x5c Aug 22 08:50:44 juju-e4d256-prod-github-runner-207 kernel: [12418.024928] dump_stack_lvl+0x4a/0x63 Aug 22 08:50:44 juju-e4d256-prod-github-runner-207 kernel: [12418.025701] dump_stack+0x10/0x16 Aug 22 08:50:44 juju-e4d256-prod-github-runner-207 kernel: [12418.026473] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 08:50:44 juju-e4d256-prod-github-runner-207 kernel: [12418.027274] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 08:50:44 juju-e4d256-prod-github-runner-207 kernel: [12418.028144] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 08:50:44 juju-e4d256-prod-github-runner-207 kernel: [12418.028973] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 08:50:44 juju-e4d256-prod-github-runner-207 kernel: [12418.029824] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 08:50:44 juju-e4d256-prod-github-runner-207 kernel: [12418.030654] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 08:50:44 juju-e4d256-prod-github-runner-207 kernel: [12418.031462] print_cpu_stall.cold+0x2f/0xe2 Aug 22 08:50:44 juju-e4d256-prod-github-runner-207 kernel: [12418.032322] ? timekeeping_update+0xf7/0x150 Aug 22 08:50:44 juju-e4d256-prod-github-runner-207 kernel: [12418.033143] check_cpu_stall+0x109/0x270 Aug 22 08:50:44 juju-e4d256-prod-github-runner-207 kernel: [12418.033952] rcu_sched_clock_irq+0x9a/0x250 Aug 22 08:50:44 juju-e4d256-prod-github-runner-207 kernel: [12418.034797] update_process_times+0x94/0xd0 Aug 22 08:50:44 juju-e4d256-prod-github-runner-207 kernel: [12418.035569] tick_sched_handle+0x29/0x70 Aug 22 08:50:44 juju-e4d256-prod-github-runner-207 kernel: [12418.036347] tick_sched_timer+0x8c/0xc0 Aug 22 08:50:44 juju-e4d256-prod-github-runner-207 kernel: [12418.037098] ? tick_nohz_handler+0xb0/0xb0 Aug 22 08:50:44 juju-e4d256-prod-github-runner-207 kernel: [12418.037877] __hrtimer_run_queues+0x107/0x230 Aug 22 08:50:44 juju-e4d256-prod-github-runner-207 kernel: [12418.038655] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 08:50:44 juju-e4d256-prod-github-runner-207 kernel: [12418.039430] hrtimer_interrupt+0x101/0x220 Aug 22 08:50:44 juju-e4d256-prod-github-runner-207 kernel: [12418.040203] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 08:50:44 juju-e4d256-prod-github-runner-207 kernel: [12418.041018] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 08:50:44 juju-e4d256-prod-github-runner-207 kernel: [12418.041957] Aug 22 08:50:44 juju-e4d256-prod-github-runner-207 kernel: [12418.042766] Aug 22 08:50:44 juju-e4d256-prod-github-runner-207 kernel: [12418.043404] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 08:50:44 juju-e4d256-prod-github-runner-207 kernel: [12418.044239] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:50:44 juju-e4d256-prod-github-runner-207 kernel: [12418.045166] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 08:50:44 juju-e4d256-prod-github-runner-207 kernel: [12418.047486] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 08:50:44 juju-e4d256-prod-github-runner-207 kernel: [12418.048395] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 08:50:44 juju-e4d256-prod-github-runner-207 kernel: [12418.049411] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 08:50:44 juju-e4d256-prod-github-runner-207 kernel: [12418.050468] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 08:50:44 juju-e4d256-prod-github-runner-207 kernel: [12418.051445] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 08:50:44 juju-e4d256-prod-github-runner-207 kernel: [12418.052436] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 08:50:44 juju-e4d256-prod-github-runner-207 kernel: [12418.053408] ? _raw_spin_lock+0x22/0x30 Aug 22 08:50:44 juju-e4d256-prod-github-runner-207 kernel: [12418.054177] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:50:44 juju-e4d256-prod-github-runner-207 kernel: [12418.055045] direct_page_fault+0x206/0x310 [kvm] Aug 22 08:50:44 juju-e4d256-prod-github-runner-207 kernel: [12418.055939] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 08:50:44 juju-e4d256-prod-github-runner-207 kernel: [12418.056790] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 08:50:44 juju-e4d256-prod-github-runner-207 kernel: [12418.057631] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 08:50:44 juju-e4d256-prod-github-runner-207 kernel: [12418.058459] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 08:50:44 juju-e4d256-prod-github-runner-207 kernel: [12418.059265] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 08:50:44 juju-e4d256-prod-github-runner-207 kernel: [12418.060138] handle_exit+0x98/0x230 [kvm_amd] Aug 22 08:50:44 juju-e4d256-prod-github-runner-207 kernel: [12418.060917] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 08:50:44 juju-e4d256-prod-github-runner-207 kernel: [12418.061725] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 08:50:44 juju-e4d256-prod-github-runner-207 kernel: [12418.062549] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 08:50:44 juju-e4d256-prod-github-runner-207 kernel: [12418.063363] vcpu_run+0x62/0x2c0 [kvm] Aug 22 08:50:44 juju-e4d256-prod-github-runner-207 kernel: [12418.064123] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 08:50:44 juju-e4d256-prod-github-runner-207 kernel: [12418.064878] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 08:50:44 juju-e4d256-prod-github-runner-207 kernel: [12418.065709] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 08:50:44 juju-e4d256-prod-github-runner-207 kernel: [12418.066496] ? __seccomp_filter+0x4a/0x4a0 Aug 22 08:50:44 juju-e4d256-prod-github-runner-207 kernel: [12418.067225] ? __fget_files+0x86/0xc0 Aug 22 08:50:44 juju-e4d256-prod-github-runner-207 kernel: [12418.067945] __x64_sys_ioctl+0x95/0xd0 Aug 22 08:50:44 juju-e4d256-prod-github-runner-207 kernel: [12418.068651] do_syscall_64+0x5c/0xc0 Aug 22 08:50:44 juju-e4d256-prod-github-runner-207 kernel: [12418.069351] ? do_futex+0x162/0x1f0 Aug 22 08:50:44 juju-e4d256-prod-github-runner-207 kernel: [12418.070044] ? __x64_sys_futex+0x78/0x1e0 Aug 22 08:50:44 juju-e4d256-prod-github-runner-207 kernel: [12418.070777] ? __secure_computing+0xa9/0x120 Aug 22 08:50:44 juju-e4d256-prod-github-runner-207 kernel: [12418.071520] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 08:50:44 juju-e4d256-prod-github-runner-207 kernel: [12418.072392] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:50:44 juju-e4d256-prod-github-runner-207 kernel: [12418.073168] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:50:44 juju-e4d256-prod-github-runner-207 kernel: [12418.073942] ? do_syscall_64+0x69/0xc0 Aug 22 08:50:44 juju-e4d256-prod-github-runner-207 kernel: [12418.074651] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:50:44 juju-e4d256-prod-github-runner-207 kernel: [12418.075418] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:50:44 juju-e4d256-prod-github-runner-207 kernel: [12418.076214] ? do_syscall_64+0x69/0xc0 Aug 22 08:50:44 juju-e4d256-prod-github-runner-207 kernel: [12418.076946] ? do_syscall_64+0x69/0xc0 Aug 22 08:50:44 juju-e4d256-prod-github-runner-207 kernel: [12418.077650] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 08:50:44 juju-e4d256-prod-github-runner-207 kernel: [12418.078442] RIP: 0033:0x7faa5d0edaff Aug 22 08:50:44 juju-e4d256-prod-github-runner-207 kernel: [12418.079327] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 08:50:44 juju-e4d256-prod-github-runner-207 kernel: [12418.081521] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 08:50:44 juju-e4d256-prod-github-runner-207 kernel: [12418.082507] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 08:50:44 juju-e4d256-prod-github-runner-207 kernel: [12418.083474] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 08:50:44 juju-e4d256-prod-github-runner-207 kernel: [12418.084465] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 08:50:44 juju-e4d256-prod-github-runner-207 kernel: [12418.085429] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 08:50:44 juju-e4d256-prod-github-runner-207 kernel: [12418.086398] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 08:50:44 juju-e4d256-prod-github-runner-207 kernel: [12418.087375] Aug 22 08:51:10 juju-e4d256-prod-github-runner-207 kernel: [12444.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 11481s! [qemu-system-x86:6715] Aug 22 08:51:10 juju-e4d256-prod-github-runner-207 kernel: [12444.543955] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 08:51:10 juju-e4d256-prod-github-runner-207 kernel: [12444.544270] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 08:51:10 juju-e4d256-prod-github-runner-207 kernel: [12444.556459] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 08:51:10 juju-e4d256-prod-github-runner-207 kernel: [12444.557768] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 08:51:10 juju-e4d256-prod-github-runner-207 kernel: [12444.559165] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:51:10 juju-e4d256-prod-github-runner-207 kernel: [12444.560243] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 08:51:10 juju-e4d256-prod-github-runner-207 kernel: [12444.562841] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 08:51:10 juju-e4d256-prod-github-runner-207 kernel: [12444.563949] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 08:51:10 juju-e4d256-prod-github-runner-207 kernel: [12444.565187] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 08:51:10 juju-e4d256-prod-github-runner-207 kernel: [12444.566367] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 08:51:10 juju-e4d256-prod-github-runner-207 kernel: [12444.567544] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 08:51:10 juju-e4d256-prod-github-runner-207 kernel: [12444.568751] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 08:51:10 juju-e4d256-prod-github-runner-207 kernel: [12444.569926] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 08:51:10 juju-e4d256-prod-github-runner-207 kernel: [12444.571166] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 08:51:10 juju-e4d256-prod-github-runner-207 kernel: [12444.572461] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 08:51:10 juju-e4d256-prod-github-runner-207 kernel: [12444.573675] Call Trace: Aug 22 08:51:10 juju-e4d256-prod-github-runner-207 kernel: [12444.574596] Aug 22 08:51:10 juju-e4d256-prod-github-runner-207 kernel: [12444.575673] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:51:10 juju-e4d256-prod-github-runner-207 kernel: [12444.576708] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:51:10 juju-e4d256-prod-github-runner-207 kernel: [12444.577739] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:51:10 juju-e4d256-prod-github-runner-207 kernel: [12444.578838] ? show_regs.part.0+0x23/0x29 Aug 22 08:51:10 juju-e4d256-prod-github-runner-207 kernel: [12444.579866] ? show_regs.cold+0x8/0xd Aug 22 08:51:10 juju-e4d256-prod-github-runner-207 kernel: [12444.580840] ? watchdog_timer_fn+0x1be/0x220 Aug 22 08:51:10 juju-e4d256-prod-github-runner-207 kernel: [12444.581851] ? lockup_detector_update_enable+0x60/0x60 Aug 22 08:51:10 juju-e4d256-prod-github-runner-207 kernel: [12444.582922] ? __hrtimer_run_queues+0x107/0x230 Aug 22 08:51:10 juju-e4d256-prod-github-runner-207 kernel: [12444.583974] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 08:51:10 juju-e4d256-prod-github-runner-207 kernel: [12444.585006] ? hrtimer_interrupt+0x101/0x220 Aug 22 08:51:10 juju-e4d256-prod-github-runner-207 kernel: [12444.586053] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 08:51:10 juju-e4d256-prod-github-runner-207 kernel: [12444.587126] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 08:51:10 juju-e4d256-prod-github-runner-207 kernel: [12444.588214] Aug 22 08:51:10 juju-e4d256-prod-github-runner-207 kernel: [12444.589082] Aug 22 08:51:10 juju-e4d256-prod-github-runner-207 kernel: [12444.589939] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 08:51:10 juju-e4d256-prod-github-runner-207 kernel: [12444.590981] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:51:10 juju-e4d256-prod-github-runner-207 kernel: [12444.592122] ? _raw_spin_lock+0x22/0x30 Aug 22 08:51:10 juju-e4d256-prod-github-runner-207 kernel: [12444.593079] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:51:10 juju-e4d256-prod-github-runner-207 kernel: [12444.594103] direct_page_fault+0x206/0x310 [kvm] Aug 22 08:51:10 juju-e4d256-prod-github-runner-207 kernel: [12444.595135] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 08:51:10 juju-e4d256-prod-github-runner-207 kernel: [12444.596186] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 08:51:10 juju-e4d256-prod-github-runner-207 kernel: [12444.597206] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 08:51:10 juju-e4d256-prod-github-runner-207 kernel: [12444.598222] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 08:51:10 juju-e4d256-prod-github-runner-207 kernel: [12444.599180] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 08:51:10 juju-e4d256-prod-github-runner-207 kernel: [12444.600194] handle_exit+0x98/0x230 [kvm_amd] Aug 22 08:51:10 juju-e4d256-prod-github-runner-207 kernel: [12444.601096] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 08:51:10 juju-e4d256-prod-github-runner-207 kernel: [12444.602018] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 08:51:10 juju-e4d256-prod-github-runner-207 kernel: [12444.602944] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 08:51:10 juju-e4d256-prod-github-runner-207 kernel: [12444.603871] vcpu_run+0x62/0x2c0 [kvm] Aug 22 08:51:10 juju-e4d256-prod-github-runner-207 kernel: [12444.604693] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 08:51:10 juju-e4d256-prod-github-runner-207 kernel: [12444.605505] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 08:51:10 juju-e4d256-prod-github-runner-207 kernel: [12444.606361] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 08:51:10 juju-e4d256-prod-github-runner-207 kernel: [12444.607169] ? __seccomp_filter+0x4a/0x4a0 Aug 22 08:51:10 juju-e4d256-prod-github-runner-207 kernel: [12444.607936] ? __fget_files+0x86/0xc0 Aug 22 08:51:10 juju-e4d256-prod-github-runner-207 kernel: [12444.608650] __x64_sys_ioctl+0x95/0xd0 Aug 22 08:51:10 juju-e4d256-prod-github-runner-207 kernel: [12444.609343] do_syscall_64+0x5c/0xc0 Aug 22 08:51:10 juju-e4d256-prod-github-runner-207 kernel: [12444.610009] ? do_futex+0x162/0x1f0 Aug 22 08:51:10 juju-e4d256-prod-github-runner-207 kernel: [12444.610659] ? __x64_sys_futex+0x78/0x1e0 Aug 22 08:51:10 juju-e4d256-prod-github-runner-207 kernel: [12444.611333] ? __secure_computing+0xa9/0x120 Aug 22 08:51:10 juju-e4d256-prod-github-runner-207 kernel: [12444.612037] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 08:51:10 juju-e4d256-prod-github-runner-207 kernel: [12444.612797] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:51:10 juju-e4d256-prod-github-runner-207 kernel: [12444.613520] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:51:10 juju-e4d256-prod-github-runner-207 kernel: [12444.614242] ? do_syscall_64+0x69/0xc0 Aug 22 08:51:10 juju-e4d256-prod-github-runner-207 kernel: [12444.614889] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:51:10 juju-e4d256-prod-github-runner-207 kernel: [12444.615610] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:51:10 juju-e4d256-prod-github-runner-207 kernel: [12444.616304] ? do_syscall_64+0x69/0xc0 Aug 22 08:51:10 juju-e4d256-prod-github-runner-207 kernel: [12444.616932] ? do_syscall_64+0x69/0xc0 Aug 22 08:51:10 juju-e4d256-prod-github-runner-207 kernel: [12444.617554] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 08:51:10 juju-e4d256-prod-github-runner-207 kernel: [12444.618264] RIP: 0033:0x7faa5d0edaff Aug 22 08:51:10 juju-e4d256-prod-github-runner-207 kernel: [12444.618915] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 08:51:10 juju-e4d256-prod-github-runner-207 kernel: [12444.620971] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 08:51:10 juju-e4d256-prod-github-runner-207 kernel: [12444.621882] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 08:51:10 juju-e4d256-prod-github-runner-207 kernel: [12444.622772] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 08:51:10 juju-e4d256-prod-github-runner-207 kernel: [12444.623777] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 08:51:10 juju-e4d256-prod-github-runner-207 kernel: [12444.624880] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 08:51:10 juju-e4d256-prod-github-runner-207 kernel: [12444.625777] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 08:51:10 juju-e4d256-prod-github-runner-207 kernel: [12444.626670] Aug 22 08:51:38 juju-e4d256-prod-github-runner-207 kernel: [12472.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 11507s! [qemu-system-x86:6715] Aug 22 08:51:38 juju-e4d256-prod-github-runner-207 kernel: [12472.543123] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 08:51:38 juju-e4d256-prod-github-runner-207 kernel: [12472.543198] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 08:51:38 juju-e4d256-prod-github-runner-207 kernel: [12472.555500] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 08:51:38 juju-e4d256-prod-github-runner-207 kernel: [12472.556808] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 08:51:38 juju-e4d256-prod-github-runner-207 kernel: [12472.558062] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:51:38 juju-e4d256-prod-github-runner-207 kernel: [12472.559135] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 08:51:38 juju-e4d256-prod-github-runner-207 kernel: [12472.561740] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 08:51:38 juju-e4d256-prod-github-runner-207 kernel: [12472.562802] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 08:51:38 juju-e4d256-prod-github-runner-207 kernel: [12472.563998] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 08:51:38 juju-e4d256-prod-github-runner-207 kernel: [12472.565165] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 08:51:38 juju-e4d256-prod-github-runner-207 kernel: [12472.566335] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 08:51:38 juju-e4d256-prod-github-runner-207 kernel: [12472.567529] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 08:51:38 juju-e4d256-prod-github-runner-207 kernel: [12472.568715] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 08:51:38 juju-e4d256-prod-github-runner-207 kernel: [12472.570066] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 08:51:38 juju-e4d256-prod-github-runner-207 kernel: [12472.571459] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 08:51:38 juju-e4d256-prod-github-runner-207 kernel: [12472.572668] Call Trace: Aug 22 08:51:38 juju-e4d256-prod-github-runner-207 kernel: [12472.573584] Aug 22 08:51:38 juju-e4d256-prod-github-runner-207 kernel: [12472.574486] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:51:38 juju-e4d256-prod-github-runner-207 kernel: [12472.575544] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:51:38 juju-e4d256-prod-github-runner-207 kernel: [12472.576576] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:51:38 juju-e4d256-prod-github-runner-207 kernel: [12472.577660] ? show_regs.part.0+0x23/0x29 Aug 22 08:51:38 juju-e4d256-prod-github-runner-207 kernel: [12472.578679] ? show_regs.cold+0x8/0xd Aug 22 08:51:38 juju-e4d256-prod-github-runner-207 kernel: [12472.579686] ? watchdog_timer_fn+0x1be/0x220 Aug 22 08:51:38 juju-e4d256-prod-github-runner-207 kernel: [12472.580702] ? lockup_detector_update_enable+0x60/0x60 Aug 22 08:51:38 juju-e4d256-prod-github-runner-207 kernel: [12472.581771] ? __hrtimer_run_queues+0x107/0x230 Aug 22 08:51:38 juju-e4d256-prod-github-runner-207 kernel: [12472.582816] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 08:51:38 juju-e4d256-prod-github-runner-207 kernel: [12472.583873] ? hrtimer_interrupt+0x101/0x220 Aug 22 08:51:38 juju-e4d256-prod-github-runner-207 kernel: [12472.584892] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 08:51:38 juju-e4d256-prod-github-runner-207 kernel: [12472.585968] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 08:51:38 juju-e4d256-prod-github-runner-207 kernel: [12472.587046] Aug 22 08:51:38 juju-e4d256-prod-github-runner-207 kernel: [12472.587923] Aug 22 08:51:38 juju-e4d256-prod-github-runner-207 kernel: [12472.588784] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 08:51:38 juju-e4d256-prod-github-runner-207 kernel: [12472.589835] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:51:38 juju-e4d256-prod-github-runner-207 kernel: [12472.590892] ? _raw_spin_lock+0x22/0x30 Aug 22 08:51:38 juju-e4d256-prod-github-runner-207 kernel: [12472.591870] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:51:38 juju-e4d256-prod-github-runner-207 kernel: [12472.592893] direct_page_fault+0x206/0x310 [kvm] Aug 22 08:51:38 juju-e4d256-prod-github-runner-207 kernel: [12472.593923] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 08:51:38 juju-e4d256-prod-github-runner-207 kernel: [12472.594947] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 08:51:38 juju-e4d256-prod-github-runner-207 kernel: [12472.595985] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 08:51:38 juju-e4d256-prod-github-runner-207 kernel: [12472.596961] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 08:51:38 juju-e4d256-prod-github-runner-207 kernel: [12472.597916] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 08:51:38 juju-e4d256-prod-github-runner-207 kernel: [12472.598918] handle_exit+0x98/0x230 [kvm_amd] Aug 22 08:51:38 juju-e4d256-prod-github-runner-207 kernel: [12472.599997] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 08:51:38 juju-e4d256-prod-github-runner-207 kernel: [12472.601194] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 08:51:38 juju-e4d256-prod-github-runner-207 kernel: [12472.602444] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 08:51:38 juju-e4d256-prod-github-runner-207 kernel: [12472.603741] vcpu_run+0x62/0x2c0 [kvm] Aug 22 08:51:38 juju-e4d256-prod-github-runner-207 kernel: [12472.604882] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 08:51:38 juju-e4d256-prod-github-runner-207 kernel: [12472.606012] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 08:51:38 juju-e4d256-prod-github-runner-207 kernel: [12472.607428] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 08:51:38 juju-e4d256-prod-github-runner-207 kernel: [12472.608560] ? __seccomp_filter+0x4a/0x4a0 Aug 22 08:51:38 juju-e4d256-prod-github-runner-207 kernel: [12472.609592] ? __fget_files+0x86/0xc0 Aug 22 08:51:38 juju-e4d256-prod-github-runner-207 kernel: [12472.610574] __x64_sys_ioctl+0x95/0xd0 Aug 22 08:51:38 juju-e4d256-prod-github-runner-207 kernel: [12472.611775] do_syscall_64+0x5c/0xc0 Aug 22 08:51:38 juju-e4d256-prod-github-runner-207 kernel: [12472.612708] ? do_futex+0x162/0x1f0 Aug 22 08:51:38 juju-e4d256-prod-github-runner-207 kernel: [12472.613630] ? __x64_sys_futex+0x78/0x1e0 Aug 22 08:51:38 juju-e4d256-prod-github-runner-207 kernel: [12472.614559] ? __secure_computing+0xa9/0x120 Aug 22 08:51:38 juju-e4d256-prod-github-runner-207 kernel: [12472.615549] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 08:51:38 juju-e4d256-prod-github-runner-207 kernel: [12472.616519] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:51:38 juju-e4d256-prod-github-runner-207 kernel: [12472.617451] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:51:38 juju-e4d256-prod-github-runner-207 kernel: [12472.618418] ? do_syscall_64+0x69/0xc0 Aug 22 08:51:38 juju-e4d256-prod-github-runner-207 kernel: [12472.619229] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:51:38 juju-e4d256-prod-github-runner-207 kernel: [12472.620170] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:51:38 juju-e4d256-prod-github-runner-207 kernel: [12472.621093] ? do_syscall_64+0x69/0xc0 Aug 22 08:51:38 juju-e4d256-prod-github-runner-207 kernel: [12472.621902] ? do_syscall_64+0x69/0xc0 Aug 22 08:51:38 juju-e4d256-prod-github-runner-207 kernel: [12472.622752] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 08:51:38 juju-e4d256-prod-github-runner-207 kernel: [12472.623638] RIP: 0033:0x7faa5d0edaff Aug 22 08:51:38 juju-e4d256-prod-github-runner-207 kernel: [12472.624280] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 08:51:38 juju-e4d256-prod-github-runner-207 kernel: [12472.626362] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 08:51:38 juju-e4d256-prod-github-runner-207 kernel: [12472.627378] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 08:51:38 juju-e4d256-prod-github-runner-207 kernel: [12472.628279] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 08:51:38 juju-e4d256-prod-github-runner-207 kernel: [12472.629179] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 08:51:38 juju-e4d256-prod-github-runner-207 kernel: [12472.630084] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 08:51:38 juju-e4d256-prod-github-runner-207 kernel: [12472.631004] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 08:51:38 juju-e4d256-prod-github-runner-207 kernel: [12472.631936] Aug 22 08:52:06 juju-e4d256-prod-github-runner-207 kernel: [12500.541980] watchdog: BUG: soft lockup - CPU#1 stuck for 11534s! [qemu-system-x86:6715] Aug 22 08:52:06 juju-e4d256-prod-github-runner-207 kernel: [12500.543101] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 08:52:06 juju-e4d256-prod-github-runner-207 kernel: [12500.543171] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 08:52:06 juju-e4d256-prod-github-runner-207 kernel: [12500.555938] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 08:52:06 juju-e4d256-prod-github-runner-207 kernel: [12500.557232] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 08:52:06 juju-e4d256-prod-github-runner-207 kernel: [12500.558517] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:52:06 juju-e4d256-prod-github-runner-207 kernel: [12500.559873] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 08:52:06 juju-e4d256-prod-github-runner-207 kernel: [12500.562439] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 08:52:06 juju-e4d256-prod-github-runner-207 kernel: [12500.563737] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 08:52:06 juju-e4d256-prod-github-runner-207 kernel: [12500.565587] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 08:52:06 juju-e4d256-prod-github-runner-207 kernel: [12500.567361] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 08:52:06 juju-e4d256-prod-github-runner-207 kernel: [12500.569140] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 08:52:06 juju-e4d256-prod-github-runner-207 kernel: [12500.571027] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 08:52:06 juju-e4d256-prod-github-runner-207 kernel: [12500.572439] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 08:52:06 juju-e4d256-prod-github-runner-207 kernel: [12500.573708] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 08:52:06 juju-e4d256-prod-github-runner-207 kernel: [12500.574947] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 08:52:06 juju-e4d256-prod-github-runner-207 kernel: [12500.576467] Call Trace: Aug 22 08:52:06 juju-e4d256-prod-github-runner-207 kernel: [12500.577440] Aug 22 08:52:06 juju-e4d256-prod-github-runner-207 kernel: [12500.578325] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:52:06 juju-e4d256-prod-github-runner-207 kernel: [12500.579391] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:52:06 juju-e4d256-prod-github-runner-207 kernel: [12500.580429] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:52:06 juju-e4d256-prod-github-runner-207 kernel: [12500.581682] ? show_regs.part.0+0x23/0x29 Aug 22 08:52:06 juju-e4d256-prod-github-runner-207 kernel: [12500.582709] ? show_regs.cold+0x8/0xd Aug 22 08:52:06 juju-e4d256-prod-github-runner-207 kernel: [12500.583700] ? watchdog_timer_fn+0x1be/0x220 Aug 22 08:52:06 juju-e4d256-prod-github-runner-207 kernel: [12500.584710] ? lockup_detector_update_enable+0x60/0x60 Aug 22 08:52:06 juju-e4d256-prod-github-runner-207 kernel: [12500.585799] ? __hrtimer_run_queues+0x107/0x230 Aug 22 08:52:06 juju-e4d256-prod-github-runner-207 kernel: [12500.586856] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 08:52:06 juju-e4d256-prod-github-runner-207 kernel: [12500.587927] ? hrtimer_interrupt+0x101/0x220 Aug 22 08:52:06 juju-e4d256-prod-github-runner-207 kernel: [12500.588942] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 08:52:06 juju-e4d256-prod-github-runner-207 kernel: [12500.590180] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 08:52:06 juju-e4d256-prod-github-runner-207 kernel: [12500.591357] Aug 22 08:52:06 juju-e4d256-prod-github-runner-207 kernel: [12500.592248] Aug 22 08:52:06 juju-e4d256-prod-github-runner-207 kernel: [12500.593104] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 08:52:06 juju-e4d256-prod-github-runner-207 kernel: [12500.594145] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:52:06 juju-e4d256-prod-github-runner-207 kernel: [12500.595218] ? _raw_spin_lock+0x22/0x30 Aug 22 08:52:06 juju-e4d256-prod-github-runner-207 kernel: [12500.596177] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:52:06 juju-e4d256-prod-github-runner-207 kernel: [12500.597212] direct_page_fault+0x206/0x310 [kvm] Aug 22 08:52:06 juju-e4d256-prod-github-runner-207 kernel: [12500.598263] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 08:52:06 juju-e4d256-prod-github-runner-207 kernel: [12500.599370] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 08:52:06 juju-e4d256-prod-github-runner-207 kernel: [12500.600383] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 08:52:06 juju-e4d256-prod-github-runner-207 kernel: [12500.601374] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 08:52:06 juju-e4d256-prod-github-runner-207 kernel: [12500.602354] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 08:52:06 juju-e4d256-prod-github-runner-207 kernel: [12500.603387] handle_exit+0x98/0x230 [kvm_amd] Aug 22 08:52:06 juju-e4d256-prod-github-runner-207 kernel: [12500.604286] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 08:52:06 juju-e4d256-prod-github-runner-207 kernel: [12500.605203] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 08:52:06 juju-e4d256-prod-github-runner-207 kernel: [12500.606244] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 08:52:06 juju-e4d256-prod-github-runner-207 kernel: [12500.607339] vcpu_run+0x62/0x2c0 [kvm] Aug 22 08:52:06 juju-e4d256-prod-github-runner-207 kernel: [12500.608178] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 08:52:06 juju-e4d256-prod-github-runner-207 kernel: [12500.609000] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 08:52:06 juju-e4d256-prod-github-runner-207 kernel: [12500.609857] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 08:52:06 juju-e4d256-prod-github-runner-207 kernel: [12500.610657] ? __seccomp_filter+0x4a/0x4a0 Aug 22 08:52:06 juju-e4d256-prod-github-runner-207 kernel: [12500.611460] ? __fget_files+0x86/0xc0 Aug 22 08:52:06 juju-e4d256-prod-github-runner-207 kernel: [12500.612178] __x64_sys_ioctl+0x95/0xd0 Aug 22 08:52:06 juju-e4d256-prod-github-runner-207 kernel: [12500.612900] do_syscall_64+0x5c/0xc0 Aug 22 08:52:06 juju-e4d256-prod-github-runner-207 kernel: [12500.613599] ? do_futex+0x162/0x1f0 Aug 22 08:52:06 juju-e4d256-prod-github-runner-207 kernel: [12500.614250] ? __x64_sys_futex+0x78/0x1e0 Aug 22 08:52:06 juju-e4d256-prod-github-runner-207 kernel: [12500.615006] ? __secure_computing+0xa9/0x120 Aug 22 08:52:06 juju-e4d256-prod-github-runner-207 kernel: [12500.615749] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 08:52:06 juju-e4d256-prod-github-runner-207 kernel: [12500.616639] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:52:06 juju-e4d256-prod-github-runner-207 kernel: [12500.617379] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:52:06 juju-e4d256-prod-github-runner-207 kernel: [12500.618201] ? do_syscall_64+0x69/0xc0 Aug 22 08:52:06 juju-e4d256-prod-github-runner-207 kernel: [12500.618959] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:52:06 juju-e4d256-prod-github-runner-207 kernel: [12500.619767] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:52:06 juju-e4d256-prod-github-runner-207 kernel: [12500.620554] ? do_syscall_64+0x69/0xc0 Aug 22 08:52:06 juju-e4d256-prod-github-runner-207 kernel: [12500.621255] ? do_syscall_64+0x69/0xc0 Aug 22 08:52:06 juju-e4d256-prod-github-runner-207 kernel: [12500.621973] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 08:52:06 juju-e4d256-prod-github-runner-207 kernel: [12500.622796] RIP: 0033:0x7faa5d0edaff Aug 22 08:52:06 juju-e4d256-prod-github-runner-207 kernel: [12500.623507] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 08:52:06 juju-e4d256-prod-github-runner-207 kernel: [12500.625831] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 08:52:06 juju-e4d256-prod-github-runner-207 kernel: [12500.626895] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 08:52:06 juju-e4d256-prod-github-runner-207 kernel: [12500.627954] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 08:52:06 juju-e4d256-prod-github-runner-207 kernel: [12500.628974] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 08:52:06 juju-e4d256-prod-github-runner-207 kernel: [12500.629991] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 08:52:06 juju-e4d256-prod-github-runner-207 kernel: [12500.631030] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 08:52:06 juju-e4d256-prod-github-runner-207 kernel: [12500.632067] Aug 22 08:52:34 juju-e4d256-prod-github-runner-207 kernel: [12528.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 11560s! [qemu-system-x86:6715] Aug 22 08:52:34 juju-e4d256-prod-github-runner-207 kernel: [12528.543435] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 08:52:34 juju-e4d256-prod-github-runner-207 kernel: [12528.543612] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 08:52:34 juju-e4d256-prod-github-runner-207 kernel: [12528.556219] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 08:52:34 juju-e4d256-prod-github-runner-207 kernel: [12528.557525] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 08:52:34 juju-e4d256-prod-github-runner-207 kernel: [12528.558798] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:52:34 juju-e4d256-prod-github-runner-207 kernel: [12528.559874] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 08:52:34 juju-e4d256-prod-github-runner-207 kernel: [12528.562473] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 08:52:34 juju-e4d256-prod-github-runner-207 kernel: [12528.563550] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 08:52:34 juju-e4d256-prod-github-runner-207 kernel: [12528.564728] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 08:52:34 juju-e4d256-prod-github-runner-207 kernel: [12528.565917] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 08:52:34 juju-e4d256-prod-github-runner-207 kernel: [12528.567124] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 08:52:34 juju-e4d256-prod-github-runner-207 kernel: [12528.568302] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 08:52:34 juju-e4d256-prod-github-runner-207 kernel: [12528.569483] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 08:52:34 juju-e4d256-prod-github-runner-207 kernel: [12528.570742] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 08:52:34 juju-e4d256-prod-github-runner-207 kernel: [12528.571852] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 08:52:34 juju-e4d256-prod-github-runner-207 kernel: [12528.573040] Call Trace: Aug 22 08:52:34 juju-e4d256-prod-github-runner-207 kernel: [12528.573949] Aug 22 08:52:34 juju-e4d256-prod-github-runner-207 kernel: [12528.574847] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:52:34 juju-e4d256-prod-github-runner-207 kernel: [12528.575877] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:52:34 juju-e4d256-prod-github-runner-207 kernel: [12528.576897] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:52:34 juju-e4d256-prod-github-runner-207 kernel: [12528.578000] ? show_regs.part.0+0x23/0x29 Aug 22 08:52:34 juju-e4d256-prod-github-runner-207 kernel: [12528.579017] ? show_regs.cold+0x8/0xd Aug 22 08:52:34 juju-e4d256-prod-github-runner-207 kernel: [12528.579987] ? watchdog_timer_fn+0x1be/0x220 Aug 22 08:52:34 juju-e4d256-prod-github-runner-207 kernel: [12528.581012] ? lockup_detector_update_enable+0x60/0x60 Aug 22 08:52:34 juju-e4d256-prod-github-runner-207 kernel: [12528.582092] ? __hrtimer_run_queues+0x107/0x230 Aug 22 08:52:34 juju-e4d256-prod-github-runner-207 kernel: [12528.583151] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 08:52:34 juju-e4d256-prod-github-runner-207 kernel: [12528.584180] ? hrtimer_interrupt+0x101/0x220 Aug 22 08:52:34 juju-e4d256-prod-github-runner-207 kernel: [12528.585194] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 08:52:34 juju-e4d256-prod-github-runner-207 kernel: [12528.586268] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 08:52:34 juju-e4d256-prod-github-runner-207 kernel: [12528.587326] Aug 22 08:52:34 juju-e4d256-prod-github-runner-207 kernel: [12528.588179] Aug 22 08:52:34 juju-e4d256-prod-github-runner-207 kernel: [12528.589020] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 08:52:34 juju-e4d256-prod-github-runner-207 kernel: [12528.590052] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:52:34 juju-e4d256-prod-github-runner-207 kernel: [12528.591122] ? _raw_spin_lock+0x22/0x30 Aug 22 08:52:34 juju-e4d256-prod-github-runner-207 kernel: [12528.592068] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:52:34 juju-e4d256-prod-github-runner-207 kernel: [12528.593102] direct_page_fault+0x206/0x310 [kvm] Aug 22 08:52:34 juju-e4d256-prod-github-runner-207 kernel: [12528.594126] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 08:52:34 juju-e4d256-prod-github-runner-207 kernel: [12528.595199] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 08:52:34 juju-e4d256-prod-github-runner-207 kernel: [12528.596209] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 08:52:34 juju-e4d256-prod-github-runner-207 kernel: [12528.597218] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 08:52:34 juju-e4d256-prod-github-runner-207 kernel: [12528.598175] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 08:52:34 juju-e4d256-prod-github-runner-207 kernel: [12528.599180] handle_exit+0x98/0x230 [kvm_amd] Aug 22 08:52:34 juju-e4d256-prod-github-runner-207 kernel: [12528.600097] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 08:52:34 juju-e4d256-prod-github-runner-207 kernel: [12528.601024] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 08:52:34 juju-e4d256-prod-github-runner-207 kernel: [12528.601963] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 08:52:34 juju-e4d256-prod-github-runner-207 kernel: [12528.603001] vcpu_run+0x62/0x2c0 [kvm] Aug 22 08:52:34 juju-e4d256-prod-github-runner-207 kernel: [12528.603897] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 08:52:34 juju-e4d256-prod-github-runner-207 kernel: [12528.604796] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 08:52:34 juju-e4d256-prod-github-runner-207 kernel: [12528.605747] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 08:52:34 juju-e4d256-prod-github-runner-207 kernel: [12528.606672] ? __seccomp_filter+0x4a/0x4a0 Aug 22 08:52:34 juju-e4d256-prod-github-runner-207 kernel: [12528.607498] ? __fget_files+0x86/0xc0 Aug 22 08:52:34 juju-e4d256-prod-github-runner-207 kernel: [12528.608322] __x64_sys_ioctl+0x95/0xd0 Aug 22 08:52:34 juju-e4d256-prod-github-runner-207 kernel: [12528.609091] do_syscall_64+0x5c/0xc0 Aug 22 08:52:34 juju-e4d256-prod-github-runner-207 kernel: [12528.609881] ? do_futex+0x162/0x1f0 Aug 22 08:52:34 juju-e4d256-prod-github-runner-207 kernel: [12528.610637] ? __x64_sys_futex+0x78/0x1e0 Aug 22 08:52:34 juju-e4d256-prod-github-runner-207 kernel: [12528.611392] ? __secure_computing+0xa9/0x120 Aug 22 08:52:34 juju-e4d256-prod-github-runner-207 kernel: [12528.612166] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 08:52:34 juju-e4d256-prod-github-runner-207 kernel: [12528.613032] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:52:34 juju-e4d256-prod-github-runner-207 kernel: [12528.613859] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:52:34 juju-e4d256-prod-github-runner-207 kernel: [12528.614689] ? do_syscall_64+0x69/0xc0 Aug 22 08:52:34 juju-e4d256-prod-github-runner-207 kernel: [12528.615408] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:52:34 juju-e4d256-prod-github-runner-207 kernel: [12528.616203] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:52:34 juju-e4d256-prod-github-runner-207 kernel: [12528.616995] ? do_syscall_64+0x69/0xc0 Aug 22 08:52:34 juju-e4d256-prod-github-runner-207 kernel: [12528.617697] ? do_syscall_64+0x69/0xc0 Aug 22 08:52:34 juju-e4d256-prod-github-runner-207 kernel: [12528.618395] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 08:52:34 juju-e4d256-prod-github-runner-207 kernel: [12528.619225] RIP: 0033:0x7faa5d0edaff Aug 22 08:52:34 juju-e4d256-prod-github-runner-207 kernel: [12528.619921] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 08:52:34 juju-e4d256-prod-github-runner-207 kernel: [12528.622245] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 08:52:34 juju-e4d256-prod-github-runner-207 kernel: [12528.623331] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 08:52:34 juju-e4d256-prod-github-runner-207 kernel: [12528.624358] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 08:52:34 juju-e4d256-prod-github-runner-207 kernel: [12528.625387] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 08:52:34 juju-e4d256-prod-github-runner-207 kernel: [12528.626426] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 08:52:34 juju-e4d256-prod-github-runner-207 kernel: [12528.627455] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 08:52:34 juju-e4d256-prod-github-runner-207 kernel: [12528.628488] Aug 22 08:53:02 juju-e4d256-prod-github-runner-207 kernel: [12556.541980] watchdog: BUG: soft lockup - CPU#1 stuck for 11586s! [qemu-system-x86:6715] Aug 22 08:53:02 juju-e4d256-prod-github-runner-207 kernel: [12556.544034] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 08:53:02 juju-e4d256-prod-github-runner-207 kernel: [12556.544294] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 08:53:02 juju-e4d256-prod-github-runner-207 kernel: [12556.557424] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 08:53:02 juju-e4d256-prod-github-runner-207 kernel: [12556.558721] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 08:53:02 juju-e4d256-prod-github-runner-207 kernel: [12556.559950] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:53:02 juju-e4d256-prod-github-runner-207 kernel: [12556.561012] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 08:53:02 juju-e4d256-prod-github-runner-207 kernel: [12556.563609] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 08:53:02 juju-e4d256-prod-github-runner-207 kernel: [12556.564676] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 08:53:02 juju-e4d256-prod-github-runner-207 kernel: [12556.565864] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 08:53:02 juju-e4d256-prod-github-runner-207 kernel: [12556.567053] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 08:53:02 juju-e4d256-prod-github-runner-207 kernel: [12556.568226] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 08:53:02 juju-e4d256-prod-github-runner-207 kernel: [12556.569396] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 08:53:02 juju-e4d256-prod-github-runner-207 kernel: [12556.570586] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 08:53:02 juju-e4d256-prod-github-runner-207 kernel: [12556.571827] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 08:53:02 juju-e4d256-prod-github-runner-207 kernel: [12556.572938] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 08:53:02 juju-e4d256-prod-github-runner-207 kernel: [12556.574145] Call Trace: Aug 22 08:53:02 juju-e4d256-prod-github-runner-207 kernel: [12556.575094] Aug 22 08:53:02 juju-e4d256-prod-github-runner-207 kernel: [12556.576027] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:53:02 juju-e4d256-prod-github-runner-207 kernel: [12556.577086] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:53:02 juju-e4d256-prod-github-runner-207 kernel: [12556.578112] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:53:02 juju-e4d256-prod-github-runner-207 kernel: [12556.579216] ? show_regs.part.0+0x23/0x29 Aug 22 08:53:02 juju-e4d256-prod-github-runner-207 kernel: [12556.580236] ? show_regs.cold+0x8/0xd Aug 22 08:53:02 juju-e4d256-prod-github-runner-207 kernel: [12556.581221] ? watchdog_timer_fn+0x1be/0x220 Aug 22 08:53:02 juju-e4d256-prod-github-runner-207 kernel: [12556.582229] ? lockup_detector_update_enable+0x60/0x60 Aug 22 08:53:02 juju-e4d256-prod-github-runner-207 kernel: [12556.583323] ? __hrtimer_run_queues+0x107/0x230 Aug 22 08:53:02 juju-e4d256-prod-github-runner-207 kernel: [12556.584361] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 08:53:02 juju-e4d256-prod-github-runner-207 kernel: [12556.585391] ? hrtimer_interrupt+0x101/0x220 Aug 22 08:53:02 juju-e4d256-prod-github-runner-207 kernel: [12556.586428] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 08:53:02 juju-e4d256-prod-github-runner-207 kernel: [12556.587504] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 08:53:02 juju-e4d256-prod-github-runner-207 kernel: [12556.588559] Aug 22 08:53:02 juju-e4d256-prod-github-runner-207 kernel: [12556.589428] Aug 22 08:53:02 juju-e4d256-prod-github-runner-207 kernel: [12556.590322] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 08:53:02 juju-e4d256-prod-github-runner-207 kernel: [12556.591450] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:53:02 juju-e4d256-prod-github-runner-207 kernel: [12556.592511] ? _raw_spin_lock+0x22/0x30 Aug 22 08:53:02 juju-e4d256-prod-github-runner-207 kernel: [12556.593478] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:53:02 juju-e4d256-prod-github-runner-207 kernel: [12556.594549] direct_page_fault+0x206/0x310 [kvm] Aug 22 08:53:02 juju-e4d256-prod-github-runner-207 kernel: [12556.595593] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 08:53:02 juju-e4d256-prod-github-runner-207 kernel: [12556.596620] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 08:53:02 juju-e4d256-prod-github-runner-207 kernel: [12556.597641] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 08:53:02 juju-e4d256-prod-github-runner-207 kernel: [12556.598691] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 08:53:02 juju-e4d256-prod-github-runner-207 kernel: [12556.599663] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 08:53:02 juju-e4d256-prod-github-runner-207 kernel: [12556.600654] handle_exit+0x98/0x230 [kvm_amd] Aug 22 08:53:02 juju-e4d256-prod-github-runner-207 kernel: [12556.601554] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 08:53:02 juju-e4d256-prod-github-runner-207 kernel: [12556.602508] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 08:53:02 juju-e4d256-prod-github-runner-207 kernel: [12556.603446] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 08:53:02 juju-e4d256-prod-github-runner-207 kernel: [12556.604422] vcpu_run+0x62/0x2c0 [kvm] Aug 22 08:53:02 juju-e4d256-prod-github-runner-207 kernel: [12556.605295] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 08:53:02 juju-e4d256-prod-github-runner-207 kernel: [12556.606124] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 08:53:02 juju-e4d256-prod-github-runner-207 kernel: [12556.607086] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 08:53:02 juju-e4d256-prod-github-runner-207 kernel: [12556.607917] ? __seccomp_filter+0x4a/0x4a0 Aug 22 08:53:02 juju-e4d256-prod-github-runner-207 kernel: [12556.608666] ? __fget_files+0x86/0xc0 Aug 22 08:53:02 juju-e4d256-prod-github-runner-207 kernel: [12556.609379] __x64_sys_ioctl+0x95/0xd0 Aug 22 08:53:02 juju-e4d256-prod-github-runner-207 kernel: [12556.610106] do_syscall_64+0x5c/0xc0 Aug 22 08:53:02 juju-e4d256-prod-github-runner-207 kernel: [12556.610797] ? do_futex+0x162/0x1f0 Aug 22 08:53:02 juju-e4d256-prod-github-runner-207 kernel: [12556.611453] ? __x64_sys_futex+0x78/0x1e0 Aug 22 08:53:02 juju-e4d256-prod-github-runner-207 kernel: [12556.612127] ? __secure_computing+0xa9/0x120 Aug 22 08:53:02 juju-e4d256-prod-github-runner-207 kernel: [12556.612904] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 08:53:02 juju-e4d256-prod-github-runner-207 kernel: [12556.613710] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:53:02 juju-e4d256-prod-github-runner-207 kernel: [12556.614468] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:53:02 juju-e4d256-prod-github-runner-207 kernel: [12556.615197] ? do_syscall_64+0x69/0xc0 Aug 22 08:53:02 juju-e4d256-prod-github-runner-207 kernel: [12556.615842] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:53:02 juju-e4d256-prod-github-runner-207 kernel: [12556.616612] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:53:02 juju-e4d256-prod-github-runner-207 kernel: [12556.617403] ? do_syscall_64+0x69/0xc0 Aug 22 08:53:02 juju-e4d256-prod-github-runner-207 kernel: [12556.618066] ? do_syscall_64+0x69/0xc0 Aug 22 08:53:02 juju-e4d256-prod-github-runner-207 kernel: [12556.618736] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 08:53:02 juju-e4d256-prod-github-runner-207 kernel: [12556.619445] RIP: 0033:0x7faa5d0edaff Aug 22 08:53:02 juju-e4d256-prod-github-runner-207 kernel: [12556.620118] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 08:53:02 juju-e4d256-prod-github-runner-207 kernel: [12556.622114] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 08:53:02 juju-e4d256-prod-github-runner-207 kernel: [12556.623061] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 08:53:02 juju-e4d256-prod-github-runner-207 kernel: [12556.623952] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 08:53:02 juju-e4d256-prod-github-runner-207 kernel: [12556.624861] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 08:53:02 juju-e4d256-prod-github-runner-207 kernel: [12556.625775] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 08:53:02 juju-e4d256-prod-github-runner-207 kernel: [12556.626701] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 08:53:02 juju-e4d256-prod-github-runner-207 kernel: [12556.627595] Aug 22 08:53:30 juju-e4d256-prod-github-runner-207 kernel: [12584.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 11612s! [qemu-system-x86:6715] Aug 22 08:53:30 juju-e4d256-prod-github-runner-207 kernel: [12584.543120] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 08:53:30 juju-e4d256-prod-github-runner-207 kernel: [12584.543197] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 08:53:30 juju-e4d256-prod-github-runner-207 kernel: [12584.555731] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 08:53:30 juju-e4d256-prod-github-runner-207 kernel: [12584.557020] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 08:53:30 juju-e4d256-prod-github-runner-207 kernel: [12584.558291] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:53:30 juju-e4d256-prod-github-runner-207 kernel: [12584.559355] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 08:53:30 juju-e4d256-prod-github-runner-207 kernel: [12584.561930] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 08:53:30 juju-e4d256-prod-github-runner-207 kernel: [12584.562999] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 08:53:30 juju-e4d256-prod-github-runner-207 kernel: [12584.564183] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 08:53:30 juju-e4d256-prod-github-runner-207 kernel: [12584.565372] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 08:53:30 juju-e4d256-prod-github-runner-207 kernel: [12584.566554] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 08:53:30 juju-e4d256-prod-github-runner-207 kernel: [12584.567735] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 08:53:30 juju-e4d256-prod-github-runner-207 kernel: [12584.568923] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 08:53:30 juju-e4d256-prod-github-runner-207 kernel: [12584.570177] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 08:53:30 juju-e4d256-prod-github-runner-207 kernel: [12584.571296] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 08:53:30 juju-e4d256-prod-github-runner-207 kernel: [12584.572516] Call Trace: Aug 22 08:53:30 juju-e4d256-prod-github-runner-207 kernel: [12584.573453] Aug 22 08:53:30 juju-e4d256-prod-github-runner-207 kernel: [12584.574362] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:53:30 juju-e4d256-prod-github-runner-207 kernel: [12584.575399] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:53:30 juju-e4d256-prod-github-runner-207 kernel: [12584.576423] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:53:30 juju-e4d256-prod-github-runner-207 kernel: [12584.577503] ? show_regs.part.0+0x23/0x29 Aug 22 08:53:30 juju-e4d256-prod-github-runner-207 kernel: [12584.578527] ? show_regs.cold+0x8/0xd Aug 22 08:53:30 juju-e4d256-prod-github-runner-207 kernel: [12584.579514] ? watchdog_timer_fn+0x1be/0x220 Aug 22 08:53:30 juju-e4d256-prod-github-runner-207 kernel: [12584.580525] ? lockup_detector_update_enable+0x60/0x60 Aug 22 08:53:30 juju-e4d256-prod-github-runner-207 kernel: [12584.581684] ? __hrtimer_run_queues+0x107/0x230 Aug 22 08:53:30 juju-e4d256-prod-github-runner-207 kernel: [12584.582765] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 08:53:30 juju-e4d256-prod-github-runner-207 kernel: [12584.583813] ? hrtimer_interrupt+0x101/0x220 Aug 22 08:53:30 juju-e4d256-prod-github-runner-207 kernel: [12584.584837] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 08:53:30 juju-e4d256-prod-github-runner-207 kernel: [12584.585992] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 08:53:30 juju-e4d256-prod-github-runner-207 kernel: [12584.587047] Aug 22 08:53:30 juju-e4d256-prod-github-runner-207 kernel: [12584.587929] Aug 22 08:53:30 juju-e4d256-prod-github-runner-207 kernel: [12584.588781] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 08:53:30 juju-e4d256-prod-github-runner-207 kernel: [12584.589830] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:53:30 juju-e4d256-prod-github-runner-207 kernel: [12584.590886] ? _raw_spin_lock+0x22/0x30 Aug 22 08:53:30 juju-e4d256-prod-github-runner-207 kernel: [12584.591835] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:53:30 juju-e4d256-prod-github-runner-207 kernel: [12584.592860] direct_page_fault+0x206/0x310 [kvm] Aug 22 08:53:30 juju-e4d256-prod-github-runner-207 kernel: [12584.593943] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 08:53:30 juju-e4d256-prod-github-runner-207 kernel: [12584.594985] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 08:53:30 juju-e4d256-prod-github-runner-207 kernel: [12584.595999] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 08:53:30 juju-e4d256-prod-github-runner-207 kernel: [12584.596972] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 08:53:30 juju-e4d256-prod-github-runner-207 kernel: [12584.597949] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 08:53:30 juju-e4d256-prod-github-runner-207 kernel: [12584.598958] handle_exit+0x98/0x230 [kvm_amd] Aug 22 08:53:30 juju-e4d256-prod-github-runner-207 kernel: [12584.599872] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 08:53:30 juju-e4d256-prod-github-runner-207 kernel: [12584.600793] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 08:53:30 juju-e4d256-prod-github-runner-207 kernel: [12584.601760] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 08:53:30 juju-e4d256-prod-github-runner-207 kernel: [12584.602719] vcpu_run+0x62/0x2c0 [kvm] Aug 22 08:53:30 juju-e4d256-prod-github-runner-207 kernel: [12584.603559] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 08:53:30 juju-e4d256-prod-github-runner-207 kernel: [12584.604381] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 08:53:30 juju-e4d256-prod-github-runner-207 kernel: [12584.605249] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 08:53:30 juju-e4d256-prod-github-runner-207 kernel: [12584.606076] ? __seccomp_filter+0x4a/0x4a0 Aug 22 08:53:30 juju-e4d256-prod-github-runner-207 kernel: [12584.606829] ? __fget_files+0x86/0xc0 Aug 22 08:53:30 juju-e4d256-prod-github-runner-207 kernel: [12584.607533] __x64_sys_ioctl+0x95/0xd0 Aug 22 08:53:30 juju-e4d256-prod-github-runner-207 kernel: [12584.608231] do_syscall_64+0x5c/0xc0 Aug 22 08:53:30 juju-e4d256-prod-github-runner-207 kernel: [12584.608910] ? do_futex+0x162/0x1f0 Aug 22 08:53:30 juju-e4d256-prod-github-runner-207 kernel: [12584.609569] ? __x64_sys_futex+0x78/0x1e0 Aug 22 08:53:30 juju-e4d256-prod-github-runner-207 kernel: [12584.610275] ? __secure_computing+0xa9/0x120 Aug 22 08:53:30 juju-e4d256-prod-github-runner-207 kernel: [12584.610970] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 08:53:30 juju-e4d256-prod-github-runner-207 kernel: [12584.611737] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:53:30 juju-e4d256-prod-github-runner-207 kernel: [12584.612467] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:53:30 juju-e4d256-prod-github-runner-207 kernel: [12584.613188] ? do_syscall_64+0x69/0xc0 Aug 22 08:53:30 juju-e4d256-prod-github-runner-207 kernel: [12584.613870] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:53:30 juju-e4d256-prod-github-runner-207 kernel: [12584.614601] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:53:30 juju-e4d256-prod-github-runner-207 kernel: [12584.615324] ? do_syscall_64+0x69/0xc0 Aug 22 08:53:30 juju-e4d256-prod-github-runner-207 kernel: [12584.615962] ? do_syscall_64+0x69/0xc0 Aug 22 08:53:30 juju-e4d256-prod-github-runner-207 kernel: [12584.616588] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 08:53:30 juju-e4d256-prod-github-runner-207 kernel: [12584.617295] RIP: 0033:0x7faa5d0edaff Aug 22 08:53:30 juju-e4d256-prod-github-runner-207 kernel: [12584.617942] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 08:53:30 juju-e4d256-prod-github-runner-207 kernel: [12584.619973] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 08:53:30 juju-e4d256-prod-github-runner-207 kernel: [12584.620902] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 08:53:30 juju-e4d256-prod-github-runner-207 kernel: [12584.621795] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 08:53:30 juju-e4d256-prod-github-runner-207 kernel: [12584.622717] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 08:53:30 juju-e4d256-prod-github-runner-207 kernel: [12584.623605] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 08:53:30 juju-e4d256-prod-github-runner-207 kernel: [12584.624511] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 08:53:30 juju-e4d256-prod-github-runner-207 kernel: [12584.625417] Aug 22 08:53:44 juju-e4d256-prod-github-runner-207 kernel: [12598.028709] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 08:53:44 juju-e4d256-prod-github-runner-207 kernel: [12598.029901] rcu: 1-....: (3110434 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=1503083 Aug 22 08:53:44 juju-e4d256-prod-github-runner-207 kernel: [12598.031042] (t=3120207 jiffies g=23269 q=20554) Aug 22 08:53:44 juju-e4d256-prod-github-runner-207 kernel: [12598.031866] NMI backtrace for cpu 1 Aug 22 08:53:44 juju-e4d256-prod-github-runner-207 kernel: [12598.032584] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 08:53:44 juju-e4d256-prod-github-runner-207 kernel: [12598.033756] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 08:53:44 juju-e4d256-prod-github-runner-207 kernel: [12598.034850] Call Trace: Aug 22 08:53:44 juju-e4d256-prod-github-runner-207 kernel: [12598.035537] Aug 22 08:53:44 juju-e4d256-prod-github-runner-207 kernel: [12598.036206] show_stack+0x52/0x5c Aug 22 08:53:44 juju-e4d256-prod-github-runner-207 kernel: [12598.036991] dump_stack_lvl+0x4a/0x63 Aug 22 08:53:44 juju-e4d256-prod-github-runner-207 kernel: [12598.037946] dump_stack+0x10/0x16 Aug 22 08:53:44 juju-e4d256-prod-github-runner-207 kernel: [12598.038675] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 08:53:44 juju-e4d256-prod-github-runner-207 kernel: [12598.039470] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 08:53:44 juju-e4d256-prod-github-runner-207 kernel: [12598.040248] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 08:53:44 juju-e4d256-prod-github-runner-207 kernel: [12598.041105] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 08:53:44 juju-e4d256-prod-github-runner-207 kernel: [12598.041946] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 08:53:44 juju-e4d256-prod-github-runner-207 kernel: [12598.042760] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 08:53:44 juju-e4d256-prod-github-runner-207 kernel: [12598.043531] print_cpu_stall.cold+0x2f/0xe2 Aug 22 08:53:44 juju-e4d256-prod-github-runner-207 kernel: [12598.044299] ? timekeeping_update+0xf7/0x150 Aug 22 08:53:44 juju-e4d256-prod-github-runner-207 kernel: [12598.045070] check_cpu_stall+0x109/0x270 Aug 22 08:53:44 juju-e4d256-prod-github-runner-207 kernel: [12598.045846] rcu_sched_clock_irq+0x9a/0x250 Aug 22 08:53:44 juju-e4d256-prod-github-runner-207 kernel: [12598.046608] update_process_times+0x94/0xd0 Aug 22 08:53:44 juju-e4d256-prod-github-runner-207 kernel: [12598.047368] tick_sched_handle+0x29/0x70 Aug 22 08:53:44 juju-e4d256-prod-github-runner-207 kernel: [12598.048149] tick_sched_timer+0x8c/0xc0 Aug 22 08:53:44 juju-e4d256-prod-github-runner-207 kernel: [12598.048885] ? tick_nohz_handler+0xb0/0xb0 Aug 22 08:53:44 juju-e4d256-prod-github-runner-207 kernel: [12598.049643] __hrtimer_run_queues+0x107/0x230 Aug 22 08:53:44 juju-e4d256-prod-github-runner-207 kernel: [12598.050435] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 08:53:44 juju-e4d256-prod-github-runner-207 kernel: [12598.051212] hrtimer_interrupt+0x101/0x220 Aug 22 08:53:44 juju-e4d256-prod-github-runner-207 kernel: [12598.051967] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 08:53:44 juju-e4d256-prod-github-runner-207 kernel: [12598.052775] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 08:53:44 juju-e4d256-prod-github-runner-207 kernel: [12598.053580] Aug 22 08:53:44 juju-e4d256-prod-github-runner-207 kernel: [12598.054224] Aug 22 08:53:44 juju-e4d256-prod-github-runner-207 kernel: [12598.054859] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 08:53:44 juju-e4d256-prod-github-runner-207 kernel: [12598.055678] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:53:44 juju-e4d256-prod-github-runner-207 kernel: [12598.056607] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 08:53:44 juju-e4d256-prod-github-runner-207 kernel: [12598.059378] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 08:53:44 juju-e4d256-prod-github-runner-207 kernel: [12598.060251] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 08:53:44 juju-e4d256-prod-github-runner-207 kernel: [12598.061245] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 08:53:44 juju-e4d256-prod-github-runner-207 kernel: [12598.062236] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 08:53:44 juju-e4d256-prod-github-runner-207 kernel: [12598.063198] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 08:53:44 juju-e4d256-prod-github-runner-207 kernel: [12598.064160] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 08:53:44 juju-e4d256-prod-github-runner-207 kernel: [12598.065125] ? _raw_spin_lock+0x22/0x30 Aug 22 08:53:44 juju-e4d256-prod-github-runner-207 kernel: [12598.066093] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:53:44 juju-e4d256-prod-github-runner-207 kernel: [12598.066952] direct_page_fault+0x206/0x310 [kvm] Aug 22 08:53:44 juju-e4d256-prod-github-runner-207 kernel: [12598.067793] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 08:53:44 juju-e4d256-prod-github-runner-207 kernel: [12598.068618] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 08:53:44 juju-e4d256-prod-github-runner-207 kernel: [12598.069439] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 08:53:44 juju-e4d256-prod-github-runner-207 kernel: [12598.070273] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 08:53:44 juju-e4d256-prod-github-runner-207 kernel: [12598.071062] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 08:53:44 juju-e4d256-prod-github-runner-207 kernel: [12598.071954] handle_exit+0x98/0x230 [kvm_amd] Aug 22 08:53:44 juju-e4d256-prod-github-runner-207 kernel: [12598.072718] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 08:53:44 juju-e4d256-prod-github-runner-207 kernel: [12598.073530] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 08:53:44 juju-e4d256-prod-github-runner-207 kernel: [12598.074372] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 08:53:44 juju-e4d256-prod-github-runner-207 kernel: [12598.075163] vcpu_run+0x62/0x2c0 [kvm] Aug 22 08:53:44 juju-e4d256-prod-github-runner-207 kernel: [12598.075897] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 08:53:44 juju-e4d256-prod-github-runner-207 kernel: [12598.076646] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 08:53:44 juju-e4d256-prod-github-runner-207 kernel: [12598.077457] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 08:53:44 juju-e4d256-prod-github-runner-207 kernel: [12598.078228] ? __seccomp_filter+0x4a/0x4a0 Aug 22 08:53:44 juju-e4d256-prod-github-runner-207 kernel: [12598.078949] ? __fget_files+0x86/0xc0 Aug 22 08:53:44 juju-e4d256-prod-github-runner-207 kernel: [12598.079651] __x64_sys_ioctl+0x95/0xd0 Aug 22 08:53:44 juju-e4d256-prod-github-runner-207 kernel: [12598.080352] do_syscall_64+0x5c/0xc0 Aug 22 08:53:44 juju-e4d256-prod-github-runner-207 kernel: [12598.081039] ? do_futex+0x162/0x1f0 Aug 22 08:53:44 juju-e4d256-prod-github-runner-207 kernel: [12598.081716] ? __x64_sys_futex+0x78/0x1e0 Aug 22 08:53:44 juju-e4d256-prod-github-runner-207 kernel: [12598.082442] ? __secure_computing+0xa9/0x120 Aug 22 08:53:44 juju-e4d256-prod-github-runner-207 kernel: [12598.083162] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 08:53:44 juju-e4d256-prod-github-runner-207 kernel: [12598.083964] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:53:44 juju-e4d256-prod-github-runner-207 kernel: [12598.084720] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:53:44 juju-e4d256-prod-github-runner-207 kernel: [12598.085478] ? do_syscall_64+0x69/0xc0 Aug 22 08:53:44 juju-e4d256-prod-github-runner-207 kernel: [12598.086183] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:53:44 juju-e4d256-prod-github-runner-207 kernel: [12598.086941] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:53:44 juju-e4d256-prod-github-runner-207 kernel: [12598.087698] ? do_syscall_64+0x69/0xc0 Aug 22 08:53:44 juju-e4d256-prod-github-runner-207 kernel: [12598.088399] ? do_syscall_64+0x69/0xc0 Aug 22 08:53:44 juju-e4d256-prod-github-runner-207 kernel: [12598.089093] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 08:53:44 juju-e4d256-prod-github-runner-207 kernel: [12598.089888] RIP: 0033:0x7faa5d0edaff Aug 22 08:53:44 juju-e4d256-prod-github-runner-207 kernel: [12598.090577] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 08:53:44 juju-e4d256-prod-github-runner-207 kernel: [12598.092694] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 08:53:44 juju-e4d256-prod-github-runner-207 kernel: [12598.093674] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 08:53:44 juju-e4d256-prod-github-runner-207 kernel: [12598.094635] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 08:53:44 juju-e4d256-prod-github-runner-207 kernel: [12598.095584] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 08:53:44 juju-e4d256-prod-github-runner-207 kernel: [12598.096567] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 08:53:44 juju-e4d256-prod-github-runner-207 kernel: [12598.097497] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 08:53:44 juju-e4d256-prod-github-runner-207 kernel: [12598.098438] Aug 22 08:54:10 juju-e4d256-prod-github-runner-207 kernel: [12624.541980] watchdog: BUG: soft lockup - CPU#1 stuck for 11649s! [qemu-system-x86:6715] Aug 22 08:54:10 juju-e4d256-prod-github-runner-207 kernel: [12624.543944] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 08:54:10 juju-e4d256-prod-github-runner-207 kernel: [12624.544264] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 08:54:10 juju-e4d256-prod-github-runner-207 kernel: [12624.557010] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 08:54:10 juju-e4d256-prod-github-runner-207 kernel: [12624.558311] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 08:54:10 juju-e4d256-prod-github-runner-207 kernel: [12624.559548] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:54:10 juju-e4d256-prod-github-runner-207 kernel: [12624.560710] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 08:54:10 juju-e4d256-prod-github-runner-207 kernel: [12624.563426] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 08:54:10 juju-e4d256-prod-github-runner-207 kernel: [12624.564491] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 08:54:10 juju-e4d256-prod-github-runner-207 kernel: [12624.565802] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 08:54:10 juju-e4d256-prod-github-runner-207 kernel: [12624.567019] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 08:54:10 juju-e4d256-prod-github-runner-207 kernel: [12624.568238] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 08:54:10 juju-e4d256-prod-github-runner-207 kernel: [12624.569562] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 08:54:10 juju-e4d256-prod-github-runner-207 kernel: [12624.570842] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 08:54:10 juju-e4d256-prod-github-runner-207 kernel: [12624.572209] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 08:54:10 juju-e4d256-prod-github-runner-207 kernel: [12624.573351] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 08:54:10 juju-e4d256-prod-github-runner-207 kernel: [12624.574654] Call Trace: Aug 22 08:54:10 juju-e4d256-prod-github-runner-207 kernel: [12624.575721] Aug 22 08:54:10 juju-e4d256-prod-github-runner-207 kernel: [12624.576886] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:54:10 juju-e4d256-prod-github-runner-207 kernel: [12624.578000] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:54:10 juju-e4d256-prod-github-runner-207 kernel: [12624.579166] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:54:10 juju-e4d256-prod-github-runner-207 kernel: [12624.580492] ? show_regs.part.0+0x23/0x29 Aug 22 08:54:10 juju-e4d256-prod-github-runner-207 kernel: [12624.581541] ? show_regs.cold+0x8/0xd Aug 22 08:54:10 juju-e4d256-prod-github-runner-207 kernel: [12624.582530] ? watchdog_timer_fn+0x1be/0x220 Aug 22 08:54:10 juju-e4d256-prod-github-runner-207 kernel: [12624.583567] ? lockup_detector_update_enable+0x60/0x60 Aug 22 08:54:10 juju-e4d256-prod-github-runner-207 kernel: [12624.584682] ? __hrtimer_run_queues+0x107/0x230 Aug 22 08:54:10 juju-e4d256-prod-github-runner-207 kernel: [12624.585797] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 08:54:10 juju-e4d256-prod-github-runner-207 kernel: [12624.586849] ? hrtimer_interrupt+0x101/0x220 Aug 22 08:54:10 juju-e4d256-prod-github-runner-207 kernel: [12624.587918] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 08:54:10 juju-e4d256-prod-github-runner-207 kernel: [12624.588995] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 08:54:10 juju-e4d256-prod-github-runner-207 kernel: [12624.590082] Aug 22 08:54:10 juju-e4d256-prod-github-runner-207 kernel: [12624.590975] Aug 22 08:54:10 juju-e4d256-prod-github-runner-207 kernel: [12624.591851] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 08:54:10 juju-e4d256-prod-github-runner-207 kernel: [12624.592906] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:54:10 juju-e4d256-prod-github-runner-207 kernel: [12624.593990] ? _raw_spin_lock+0x22/0x30 Aug 22 08:54:10 juju-e4d256-prod-github-runner-207 kernel: [12624.595018] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:54:10 juju-e4d256-prod-github-runner-207 kernel: [12624.596076] direct_page_fault+0x206/0x310 [kvm] Aug 22 08:54:10 juju-e4d256-prod-github-runner-207 kernel: [12624.597116] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 08:54:10 juju-e4d256-prod-github-runner-207 kernel: [12624.598251] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 08:54:10 juju-e4d256-prod-github-runner-207 kernel: [12624.599270] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 08:54:10 juju-e4d256-prod-github-runner-207 kernel: [12624.600317] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 08:54:10 juju-e4d256-prod-github-runner-207 kernel: [12624.601272] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 08:54:10 juju-e4d256-prod-github-runner-207 kernel: [12624.602284] handle_exit+0x98/0x230 [kvm_amd] Aug 22 08:54:10 juju-e4d256-prod-github-runner-207 kernel: [12624.603289] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 08:54:10 juju-e4d256-prod-github-runner-207 kernel: [12624.604395] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 08:54:10 juju-e4d256-prod-github-runner-207 kernel: [12624.605548] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 08:54:10 juju-e4d256-prod-github-runner-207 kernel: [12624.606476] vcpu_run+0x62/0x2c0 [kvm] Aug 22 08:54:10 juju-e4d256-prod-github-runner-207 kernel: [12624.607296] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 08:54:10 juju-e4d256-prod-github-runner-207 kernel: [12624.608110] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 08:54:10 juju-e4d256-prod-github-runner-207 kernel: [12624.608971] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 08:54:10 juju-e4d256-prod-github-runner-207 kernel: [12624.609826] ? __seccomp_filter+0x4a/0x4a0 Aug 22 08:54:10 juju-e4d256-prod-github-runner-207 kernel: [12624.610592] ? __fget_files+0x86/0xc0 Aug 22 08:54:10 juju-e4d256-prod-github-runner-207 kernel: [12624.611303] __x64_sys_ioctl+0x95/0xd0 Aug 22 08:54:10 juju-e4d256-prod-github-runner-207 kernel: [12624.612000] do_syscall_64+0x5c/0xc0 Aug 22 08:54:10 juju-e4d256-prod-github-runner-207 kernel: [12624.612704] ? do_futex+0x162/0x1f0 Aug 22 08:54:10 juju-e4d256-prod-github-runner-207 kernel: [12624.613383] ? __x64_sys_futex+0x78/0x1e0 Aug 22 08:54:10 juju-e4d256-prod-github-runner-207 kernel: [12624.614081] ? __secure_computing+0xa9/0x120 Aug 22 08:54:10 juju-e4d256-prod-github-runner-207 kernel: [12624.614934] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 08:54:10 juju-e4d256-prod-github-runner-207 kernel: [12624.615697] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:54:10 juju-e4d256-prod-github-runner-207 kernel: [12624.616420] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:54:10 juju-e4d256-prod-github-runner-207 kernel: [12624.617140] ? do_syscall_64+0x69/0xc0 Aug 22 08:54:10 juju-e4d256-prod-github-runner-207 kernel: [12624.617800] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:54:10 juju-e4d256-prod-github-runner-207 kernel: [12624.618503] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:54:10 juju-e4d256-prod-github-runner-207 kernel: [12624.619298] ? do_syscall_64+0x69/0xc0 Aug 22 08:54:10 juju-e4d256-prod-github-runner-207 kernel: [12624.619971] ? do_syscall_64+0x69/0xc0 Aug 22 08:54:10 juju-e4d256-prod-github-runner-207 kernel: [12624.620612] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 08:54:10 juju-e4d256-prod-github-runner-207 kernel: [12624.621320] RIP: 0033:0x7faa5d0edaff Aug 22 08:54:10 juju-e4d256-prod-github-runner-207 kernel: [12624.622001] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 08:54:10 juju-e4d256-prod-github-runner-207 kernel: [12624.624001] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 08:54:10 juju-e4d256-prod-github-runner-207 kernel: [12624.624944] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 08:54:10 juju-e4d256-prod-github-runner-207 kernel: [12624.625870] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 08:54:10 juju-e4d256-prod-github-runner-207 kernel: [12624.626764] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 08:54:10 juju-e4d256-prod-github-runner-207 kernel: [12624.627655] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 08:54:10 juju-e4d256-prod-github-runner-207 kernel: [12624.628545] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 08:54:10 juju-e4d256-prod-github-runner-207 kernel: [12624.629462] Aug 22 08:54:38 juju-e4d256-prod-github-runner-207 kernel: [12652.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 11675s! [qemu-system-x86:6715] Aug 22 08:54:38 juju-e4d256-prod-github-runner-207 kernel: [12652.543106] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 08:54:38 juju-e4d256-prod-github-runner-207 kernel: [12652.543181] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 08:54:38 juju-e4d256-prod-github-runner-207 kernel: [12652.555393] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 08:54:38 juju-e4d256-prod-github-runner-207 kernel: [12652.556658] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 08:54:38 juju-e4d256-prod-github-runner-207 kernel: [12652.557916] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:54:38 juju-e4d256-prod-github-runner-207 kernel: [12652.558984] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 08:54:38 juju-e4d256-prod-github-runner-207 kernel: [12652.561554] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 08:54:38 juju-e4d256-prod-github-runner-207 kernel: [12652.562598] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 08:54:38 juju-e4d256-prod-github-runner-207 kernel: [12652.563811] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 08:54:38 juju-e4d256-prod-github-runner-207 kernel: [12652.564985] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 08:54:38 juju-e4d256-prod-github-runner-207 kernel: [12652.566164] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 08:54:38 juju-e4d256-prod-github-runner-207 kernel: [12652.567323] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 08:54:38 juju-e4d256-prod-github-runner-207 kernel: [12652.568491] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 08:54:38 juju-e4d256-prod-github-runner-207 kernel: [12652.569737] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 08:54:38 juju-e4d256-prod-github-runner-207 kernel: [12652.571027] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 08:54:38 juju-e4d256-prod-github-runner-207 kernel: [12652.572232] Call Trace: Aug 22 08:54:38 juju-e4d256-prod-github-runner-207 kernel: [12652.573299] Aug 22 08:54:38 juju-e4d256-prod-github-runner-207 kernel: [12652.574185] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:54:38 juju-e4d256-prod-github-runner-207 kernel: [12652.575217] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:54:38 juju-e4d256-prod-github-runner-207 kernel: [12652.576242] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:54:38 juju-e4d256-prod-github-runner-207 kernel: [12652.577335] ? show_regs.part.0+0x23/0x29 Aug 22 08:54:38 juju-e4d256-prod-github-runner-207 kernel: [12652.578332] ? show_regs.cold+0x8/0xd Aug 22 08:54:38 juju-e4d256-prod-github-runner-207 kernel: [12652.579303] ? watchdog_timer_fn+0x1be/0x220 Aug 22 08:54:38 juju-e4d256-prod-github-runner-207 kernel: [12652.580312] ? lockup_detector_update_enable+0x60/0x60 Aug 22 08:54:38 juju-e4d256-prod-github-runner-207 kernel: [12652.581388] ? __hrtimer_run_queues+0x107/0x230 Aug 22 08:54:38 juju-e4d256-prod-github-runner-207 kernel: [12652.582417] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 08:54:38 juju-e4d256-prod-github-runner-207 kernel: [12652.583440] ? hrtimer_interrupt+0x101/0x220 Aug 22 08:54:38 juju-e4d256-prod-github-runner-207 kernel: [12652.584455] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 08:54:38 juju-e4d256-prod-github-runner-207 kernel: [12652.585545] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 08:54:38 juju-e4d256-prod-github-runner-207 kernel: [12652.586593] Aug 22 08:54:38 juju-e4d256-prod-github-runner-207 kernel: [12652.587448] Aug 22 08:54:38 juju-e4d256-prod-github-runner-207 kernel: [12652.588284] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 08:54:38 juju-e4d256-prod-github-runner-207 kernel: [12652.589328] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:54:38 juju-e4d256-prod-github-runner-207 kernel: [12652.590365] ? _raw_spin_lock+0x22/0x30 Aug 22 08:54:38 juju-e4d256-prod-github-runner-207 kernel: [12652.591308] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:54:38 juju-e4d256-prod-github-runner-207 kernel: [12652.592329] direct_page_fault+0x206/0x310 [kvm] Aug 22 08:54:38 juju-e4d256-prod-github-runner-207 kernel: [12652.593366] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 08:54:38 juju-e4d256-prod-github-runner-207 kernel: [12652.594375] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 08:54:38 juju-e4d256-prod-github-runner-207 kernel: [12652.595377] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 08:54:38 juju-e4d256-prod-github-runner-207 kernel: [12652.596368] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 08:54:38 juju-e4d256-prod-github-runner-207 kernel: [12652.597358] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 08:54:38 juju-e4d256-prod-github-runner-207 kernel: [12652.598337] handle_exit+0x98/0x230 [kvm_amd] Aug 22 08:54:38 juju-e4d256-prod-github-runner-207 kernel: [12652.599229] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 08:54:38 juju-e4d256-prod-github-runner-207 kernel: [12652.600159] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 08:54:38 juju-e4d256-prod-github-runner-207 kernel: [12652.601112] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 08:54:38 juju-e4d256-prod-github-runner-207 kernel: [12652.602015] vcpu_run+0x62/0x2c0 [kvm] Aug 22 08:54:38 juju-e4d256-prod-github-runner-207 kernel: [12652.602834] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 08:54:38 juju-e4d256-prod-github-runner-207 kernel: [12652.603646] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 08:54:38 juju-e4d256-prod-github-runner-207 kernel: [12652.604515] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 08:54:38 juju-e4d256-prod-github-runner-207 kernel: [12652.605333] ? __seccomp_filter+0x4a/0x4a0 Aug 22 08:54:38 juju-e4d256-prod-github-runner-207 kernel: [12652.606076] ? __fget_files+0x86/0xc0 Aug 22 08:54:38 juju-e4d256-prod-github-runner-207 kernel: [12652.606779] __x64_sys_ioctl+0x95/0xd0 Aug 22 08:54:38 juju-e4d256-prod-github-runner-207 kernel: [12652.607477] do_syscall_64+0x5c/0xc0 Aug 22 08:54:38 juju-e4d256-prod-github-runner-207 kernel: [12652.608143] ? do_futex+0x162/0x1f0 Aug 22 08:54:38 juju-e4d256-prod-github-runner-207 kernel: [12652.608792] ? __x64_sys_futex+0x78/0x1e0 Aug 22 08:54:38 juju-e4d256-prod-github-runner-207 kernel: [12652.609485] ? __secure_computing+0xa9/0x120 Aug 22 08:54:38 juju-e4d256-prod-github-runner-207 kernel: [12652.610176] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 08:54:38 juju-e4d256-prod-github-runner-207 kernel: [12652.610936] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:54:38 juju-e4d256-prod-github-runner-207 kernel: [12652.611658] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:54:38 juju-e4d256-prod-github-runner-207 kernel: [12652.612395] ? do_syscall_64+0x69/0xc0 Aug 22 08:54:38 juju-e4d256-prod-github-runner-207 kernel: [12652.613045] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:54:38 juju-e4d256-prod-github-runner-207 kernel: [12652.613766] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:54:38 juju-e4d256-prod-github-runner-207 kernel: [12652.614461] ? do_syscall_64+0x69/0xc0 Aug 22 08:54:38 juju-e4d256-prod-github-runner-207 kernel: [12652.615085] ? do_syscall_64+0x69/0xc0 Aug 22 08:54:38 juju-e4d256-prod-github-runner-207 kernel: [12652.615707] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 08:54:38 juju-e4d256-prod-github-runner-207 kernel: [12652.616416] RIP: 0033:0x7faa5d0edaff Aug 22 08:54:38 juju-e4d256-prod-github-runner-207 kernel: [12652.617084] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 08:54:38 juju-e4d256-prod-github-runner-207 kernel: [12652.619069] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 08:54:38 juju-e4d256-prod-github-runner-207 kernel: [12652.619979] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 08:54:38 juju-e4d256-prod-github-runner-207 kernel: [12652.620870] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 08:54:38 juju-e4d256-prod-github-runner-207 kernel: [12652.621775] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 08:54:38 juju-e4d256-prod-github-runner-207 kernel: [12652.622662] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 08:54:38 juju-e4d256-prod-github-runner-207 kernel: [12652.623550] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 08:54:38 juju-e4d256-prod-github-runner-207 kernel: [12652.624442] Aug 22 08:55:06 juju-e4d256-prod-github-runner-207 kernel: [12680.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 11701s! [qemu-system-x86:6715] Aug 22 08:55:06 juju-e4d256-prod-github-runner-207 kernel: [12680.543113] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 08:55:06 juju-e4d256-prod-github-runner-207 kernel: [12680.543189] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 08:55:06 juju-e4d256-prod-github-runner-207 kernel: [12680.555872] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 08:55:06 juju-e4d256-prod-github-runner-207 kernel: [12680.557166] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 08:55:06 juju-e4d256-prod-github-runner-207 kernel: [12680.558383] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:55:06 juju-e4d256-prod-github-runner-207 kernel: [12680.559445] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 08:55:06 juju-e4d256-prod-github-runner-207 kernel: [12680.561993] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 08:55:06 juju-e4d256-prod-github-runner-207 kernel: [12680.563033] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 08:55:06 juju-e4d256-prod-github-runner-207 kernel: [12680.564191] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 08:55:06 juju-e4d256-prod-github-runner-207 kernel: [12680.565375] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 08:55:06 juju-e4d256-prod-github-runner-207 kernel: [12680.566556] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 08:55:06 juju-e4d256-prod-github-runner-207 kernel: [12680.567772] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 08:55:06 juju-e4d256-prod-github-runner-207 kernel: [12680.568992] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 08:55:06 juju-e4d256-prod-github-runner-207 kernel: [12680.570244] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 08:55:06 juju-e4d256-prod-github-runner-207 kernel: [12680.571353] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 08:55:06 juju-e4d256-prod-github-runner-207 kernel: [12680.572552] Call Trace: Aug 22 08:55:06 juju-e4d256-prod-github-runner-207 kernel: [12680.573474] Aug 22 08:55:06 juju-e4d256-prod-github-runner-207 kernel: [12680.574362] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:55:06 juju-e4d256-prod-github-runner-207 kernel: [12680.575396] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:55:06 juju-e4d256-prod-github-runner-207 kernel: [12680.576416] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:55:06 juju-e4d256-prod-github-runner-207 kernel: [12680.577530] ? show_regs.part.0+0x23/0x29 Aug 22 08:55:06 juju-e4d256-prod-github-runner-207 kernel: [12680.578534] ? show_regs.cold+0x8/0xd Aug 22 08:55:06 juju-e4d256-prod-github-runner-207 kernel: [12680.579504] ? watchdog_timer_fn+0x1be/0x220 Aug 22 08:55:06 juju-e4d256-prod-github-runner-207 kernel: [12680.580517] ? lockup_detector_update_enable+0x60/0x60 Aug 22 08:55:06 juju-e4d256-prod-github-runner-207 kernel: [12680.581596] ? __hrtimer_run_queues+0x107/0x230 Aug 22 08:55:06 juju-e4d256-prod-github-runner-207 kernel: [12680.582625] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 08:55:06 juju-e4d256-prod-github-runner-207 kernel: [12680.583649] ? hrtimer_interrupt+0x101/0x220 Aug 22 08:55:06 juju-e4d256-prod-github-runner-207 kernel: [12680.584668] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 08:55:06 juju-e4d256-prod-github-runner-207 kernel: [12680.585748] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 08:55:06 juju-e4d256-prod-github-runner-207 kernel: [12680.586792] Aug 22 08:55:06 juju-e4d256-prod-github-runner-207 kernel: [12680.587643] Aug 22 08:55:06 juju-e4d256-prod-github-runner-207 kernel: [12680.588480] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 08:55:06 juju-e4d256-prod-github-runner-207 kernel: [12680.589519] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:55:06 juju-e4d256-prod-github-runner-207 kernel: [12680.590582] ? _raw_spin_lock+0x22/0x30 Aug 22 08:55:06 juju-e4d256-prod-github-runner-207 kernel: [12680.591536] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:55:06 juju-e4d256-prod-github-runner-207 kernel: [12680.592552] direct_page_fault+0x206/0x310 [kvm] Aug 22 08:55:06 juju-e4d256-prod-github-runner-207 kernel: [12680.593587] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 08:55:06 juju-e4d256-prod-github-runner-207 kernel: [12680.594600] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 08:55:06 juju-e4d256-prod-github-runner-207 kernel: [12680.595600] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 08:55:06 juju-e4d256-prod-github-runner-207 kernel: [12680.596576] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 08:55:06 juju-e4d256-prod-github-runner-207 kernel: [12680.597537] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 08:55:06 juju-e4d256-prod-github-runner-207 kernel: [12680.598514] handle_exit+0x98/0x230 [kvm_amd] Aug 22 08:55:06 juju-e4d256-prod-github-runner-207 kernel: [12680.599404] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 08:55:06 juju-e4d256-prod-github-runner-207 kernel: [12680.600319] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 08:55:06 juju-e4d256-prod-github-runner-207 kernel: [12680.601250] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 08:55:06 juju-e4d256-prod-github-runner-207 kernel: [12680.602151] vcpu_run+0x62/0x2c0 [kvm] Aug 22 08:55:06 juju-e4d256-prod-github-runner-207 kernel: [12680.602961] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 08:55:06 juju-e4d256-prod-github-runner-207 kernel: [12680.603785] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 08:55:06 juju-e4d256-prod-github-runner-207 kernel: [12680.604654] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 08:55:06 juju-e4d256-prod-github-runner-207 kernel: [12680.605460] ? __seccomp_filter+0x4a/0x4a0 Aug 22 08:55:06 juju-e4d256-prod-github-runner-207 kernel: [12680.606238] ? __fget_files+0x86/0xc0 Aug 22 08:55:06 juju-e4d256-prod-github-runner-207 kernel: [12680.606939] __x64_sys_ioctl+0x95/0xd0 Aug 22 08:55:06 juju-e4d256-prod-github-runner-207 kernel: [12680.607640] do_syscall_64+0x5c/0xc0 Aug 22 08:55:06 juju-e4d256-prod-github-runner-207 kernel: [12680.608300] ? do_futex+0x162/0x1f0 Aug 22 08:55:06 juju-e4d256-prod-github-runner-207 kernel: [12680.608962] ? __x64_sys_futex+0x78/0x1e0 Aug 22 08:55:06 juju-e4d256-prod-github-runner-207 kernel: [12680.609631] ? __secure_computing+0xa9/0x120 Aug 22 08:55:06 juju-e4d256-prod-github-runner-207 kernel: [12680.610343] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 08:55:06 juju-e4d256-prod-github-runner-207 kernel: [12680.611099] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:55:06 juju-e4d256-prod-github-runner-207 kernel: [12680.611820] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:55:06 juju-e4d256-prod-github-runner-207 kernel: [12680.612532] ? do_syscall_64+0x69/0xc0 Aug 22 08:55:06 juju-e4d256-prod-github-runner-207 kernel: [12680.613184] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:55:06 juju-e4d256-prod-github-runner-207 kernel: [12680.613890] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:55:06 juju-e4d256-prod-github-runner-207 kernel: [12680.614590] ? do_syscall_64+0x69/0xc0 Aug 22 08:55:06 juju-e4d256-prod-github-runner-207 kernel: [12680.615213] ? do_syscall_64+0x69/0xc0 Aug 22 08:55:06 juju-e4d256-prod-github-runner-207 kernel: [12680.615833] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 08:55:06 juju-e4d256-prod-github-runner-207 kernel: [12680.616537] RIP: 0033:0x7faa5d0edaff Aug 22 08:55:06 juju-e4d256-prod-github-runner-207 kernel: [12680.617173] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 08:55:06 juju-e4d256-prod-github-runner-207 kernel: [12680.619148] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 08:55:06 juju-e4d256-prod-github-runner-207 kernel: [12680.620052] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 08:55:06 juju-e4d256-prod-github-runner-207 kernel: [12680.620954] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 08:55:06 juju-e4d256-prod-github-runner-207 kernel: [12680.621839] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 08:55:06 juju-e4d256-prod-github-runner-207 kernel: [12680.622732] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 08:55:06 juju-e4d256-prod-github-runner-207 kernel: [12680.623628] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 08:55:06 juju-e4d256-prod-github-runner-207 kernel: [12680.624522] Aug 22 08:55:34 juju-e4d256-prod-github-runner-207 kernel: [12708.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 11727s! [qemu-system-x86:6715] Aug 22 08:55:34 juju-e4d256-prod-github-runner-207 kernel: [12708.543201] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 08:55:34 juju-e4d256-prod-github-runner-207 kernel: [12708.543368] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 08:55:34 juju-e4d256-prod-github-runner-207 kernel: [12708.555720] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 08:55:34 juju-e4d256-prod-github-runner-207 kernel: [12708.557015] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 08:55:34 juju-e4d256-prod-github-runner-207 kernel: [12708.558261] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:55:34 juju-e4d256-prod-github-runner-207 kernel: [12708.559316] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 08:55:34 juju-e4d256-prod-github-runner-207 kernel: [12708.561923] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 08:55:34 juju-e4d256-prod-github-runner-207 kernel: [12708.562967] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 08:55:34 juju-e4d256-prod-github-runner-207 kernel: [12708.564126] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 08:55:34 juju-e4d256-prod-github-runner-207 kernel: [12708.565295] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 08:55:34 juju-e4d256-prod-github-runner-207 kernel: [12708.566463] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 08:55:34 juju-e4d256-prod-github-runner-207 kernel: [12708.567626] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 08:55:34 juju-e4d256-prod-github-runner-207 kernel: [12708.568826] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 08:55:34 juju-e4d256-prod-github-runner-207 kernel: [12708.570060] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 08:55:34 juju-e4d256-prod-github-runner-207 kernel: [12708.571159] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 08:55:34 juju-e4d256-prod-github-runner-207 kernel: [12708.572347] Call Trace: Aug 22 08:55:34 juju-e4d256-prod-github-runner-207 kernel: [12708.573266] Aug 22 08:55:34 juju-e4d256-prod-github-runner-207 kernel: [12708.574148] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:55:34 juju-e4d256-prod-github-runner-207 kernel: [12708.575177] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:55:34 juju-e4d256-prod-github-runner-207 kernel: [12708.576195] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:55:34 juju-e4d256-prod-github-runner-207 kernel: [12708.577307] ? show_regs.part.0+0x23/0x29 Aug 22 08:55:34 juju-e4d256-prod-github-runner-207 kernel: [12708.578301] ? show_regs.cold+0x8/0xd Aug 22 08:55:34 juju-e4d256-prod-github-runner-207 kernel: [12708.579271] ? watchdog_timer_fn+0x1be/0x220 Aug 22 08:55:34 juju-e4d256-prod-github-runner-207 kernel: [12708.580281] ? lockup_detector_update_enable+0x60/0x60 Aug 22 08:55:34 juju-e4d256-prod-github-runner-207 kernel: [12708.581352] ? __hrtimer_run_queues+0x107/0x230 Aug 22 08:55:34 juju-e4d256-prod-github-runner-207 kernel: [12708.582422] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 08:55:34 juju-e4d256-prod-github-runner-207 kernel: [12708.583447] ? hrtimer_interrupt+0x101/0x220 Aug 22 08:55:34 juju-e4d256-prod-github-runner-207 kernel: [12708.584487] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 08:55:34 juju-e4d256-prod-github-runner-207 kernel: [12708.585558] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 08:55:34 juju-e4d256-prod-github-runner-207 kernel: [12708.586601] Aug 22 08:55:34 juju-e4d256-prod-github-runner-207 kernel: [12708.587452] Aug 22 08:55:34 juju-e4d256-prod-github-runner-207 kernel: [12708.588287] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 08:55:34 juju-e4d256-prod-github-runner-207 kernel: [12708.589333] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:55:34 juju-e4d256-prod-github-runner-207 kernel: [12708.590368] ? _raw_spin_lock+0x22/0x30 Aug 22 08:55:34 juju-e4d256-prod-github-runner-207 kernel: [12708.591324] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:55:34 juju-e4d256-prod-github-runner-207 kernel: [12708.592337] direct_page_fault+0x206/0x310 [kvm] Aug 22 08:55:34 juju-e4d256-prod-github-runner-207 kernel: [12708.593374] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 08:55:34 juju-e4d256-prod-github-runner-207 kernel: [12708.594379] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 08:55:34 juju-e4d256-prod-github-runner-207 kernel: [12708.595376] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 08:55:34 juju-e4d256-prod-github-runner-207 kernel: [12708.596375] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 08:55:34 juju-e4d256-prod-github-runner-207 kernel: [12708.597347] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 08:55:34 juju-e4d256-prod-github-runner-207 kernel: [12708.598324] handle_exit+0x98/0x230 [kvm_amd] Aug 22 08:55:34 juju-e4d256-prod-github-runner-207 kernel: [12708.599213] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 08:55:34 juju-e4d256-prod-github-runner-207 kernel: [12708.600122] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 08:55:34 juju-e4d256-prod-github-runner-207 kernel: [12708.601064] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 08:55:34 juju-e4d256-prod-github-runner-207 kernel: [12708.601963] vcpu_run+0x62/0x2c0 [kvm] Aug 22 08:55:34 juju-e4d256-prod-github-runner-207 kernel: [12708.602771] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 08:55:34 juju-e4d256-prod-github-runner-207 kernel: [12708.603577] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 08:55:34 juju-e4d256-prod-github-runner-207 kernel: [12708.604446] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 08:55:34 juju-e4d256-prod-github-runner-207 kernel: [12708.605242] ? __seccomp_filter+0x4a/0x4a0 Aug 22 08:55:34 juju-e4d256-prod-github-runner-207 kernel: [12708.605982] ? __fget_files+0x86/0xc0 Aug 22 08:55:34 juju-e4d256-prod-github-runner-207 kernel: [12708.606684] __x64_sys_ioctl+0x95/0xd0 Aug 22 08:55:34 juju-e4d256-prod-github-runner-207 kernel: [12708.607373] do_syscall_64+0x5c/0xc0 Aug 22 08:55:34 juju-e4d256-prod-github-runner-207 kernel: [12708.608035] ? do_futex+0x162/0x1f0 Aug 22 08:55:34 juju-e4d256-prod-github-runner-207 kernel: [12708.608688] ? __x64_sys_futex+0x78/0x1e0 Aug 22 08:55:34 juju-e4d256-prod-github-runner-207 kernel: [12708.609360] ? __secure_computing+0xa9/0x120 Aug 22 08:55:34 juju-e4d256-prod-github-runner-207 kernel: [12708.610046] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 08:55:34 juju-e4d256-prod-github-runner-207 kernel: [12708.610804] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:55:34 juju-e4d256-prod-github-runner-207 kernel: [12708.611524] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:55:34 juju-e4d256-prod-github-runner-207 kernel: [12708.612241] ? do_syscall_64+0x69/0xc0 Aug 22 08:55:34 juju-e4d256-prod-github-runner-207 kernel: [12708.612892] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:55:34 juju-e4d256-prod-github-runner-207 kernel: [12708.613593] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:55:34 juju-e4d256-prod-github-runner-207 kernel: [12708.614294] ? do_syscall_64+0x69/0xc0 Aug 22 08:55:34 juju-e4d256-prod-github-runner-207 kernel: [12708.614917] ? do_syscall_64+0x69/0xc0 Aug 22 08:55:34 juju-e4d256-prod-github-runner-207 kernel: [12708.615537] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 08:55:34 juju-e4d256-prod-github-runner-207 kernel: [12708.616240] RIP: 0033:0x7faa5d0edaff Aug 22 08:55:34 juju-e4d256-prod-github-runner-207 kernel: [12708.616868] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 08:55:34 juju-e4d256-prod-github-runner-207 kernel: [12708.618875] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 08:55:34 juju-e4d256-prod-github-runner-207 kernel: [12708.619783] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 08:55:34 juju-e4d256-prod-github-runner-207 kernel: [12708.620683] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 08:55:34 juju-e4d256-prod-github-runner-207 kernel: [12708.621571] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 08:55:34 juju-e4d256-prod-github-runner-207 kernel: [12708.622454] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 08:55:34 juju-e4d256-prod-github-runner-207 kernel: [12708.623340] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 08:55:34 juju-e4d256-prod-github-runner-207 kernel: [12708.624236] Aug 22 08:56:02 juju-e4d256-prod-github-runner-207 kernel: [12736.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 11753s! [qemu-system-x86:6715] Aug 22 08:56:02 juju-e4d256-prod-github-runner-207 kernel: [12736.543764] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 08:56:02 juju-e4d256-prod-github-runner-207 kernel: [12736.544005] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 08:56:02 juju-e4d256-prod-github-runner-207 kernel: [12736.556147] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 08:56:02 juju-e4d256-prod-github-runner-207 kernel: [12736.557411] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 08:56:02 juju-e4d256-prod-github-runner-207 kernel: [12736.558629] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:56:02 juju-e4d256-prod-github-runner-207 kernel: [12736.559695] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 08:56:02 juju-e4d256-prod-github-runner-207 kernel: [12736.562249] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 08:56:02 juju-e4d256-prod-github-runner-207 kernel: [12736.563287] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 08:56:02 juju-e4d256-prod-github-runner-207 kernel: [12736.564483] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 08:56:02 juju-e4d256-prod-github-runner-207 kernel: [12736.565642] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 08:56:02 juju-e4d256-prod-github-runner-207 kernel: [12736.566799] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 08:56:02 juju-e4d256-prod-github-runner-207 kernel: [12736.567961] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 08:56:02 juju-e4d256-prod-github-runner-207 kernel: [12736.570825] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 08:56:02 juju-e4d256-prod-github-runner-207 kernel: [12736.572069] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 08:56:02 juju-e4d256-prod-github-runner-207 kernel: [12736.573167] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 08:56:02 juju-e4d256-prod-github-runner-207 kernel: [12736.574363] Call Trace: Aug 22 08:56:02 juju-e4d256-prod-github-runner-207 kernel: [12736.575284] Aug 22 08:56:02 juju-e4d256-prod-github-runner-207 kernel: [12736.576190] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:56:02 juju-e4d256-prod-github-runner-207 kernel: [12736.577219] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:56:02 juju-e4d256-prod-github-runner-207 kernel: [12736.578243] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:56:02 juju-e4d256-prod-github-runner-207 kernel: [12736.579331] ? show_regs.part.0+0x23/0x29 Aug 22 08:56:02 juju-e4d256-prod-github-runner-207 kernel: [12736.580357] ? show_regs.cold+0x8/0xd Aug 22 08:56:02 juju-e4d256-prod-github-runner-207 kernel: [12736.581330] ? watchdog_timer_fn+0x1be/0x220 Aug 22 08:56:02 juju-e4d256-prod-github-runner-207 kernel: [12736.582337] ? lockup_detector_update_enable+0x60/0x60 Aug 22 08:56:02 juju-e4d256-prod-github-runner-207 kernel: [12736.583410] ? __hrtimer_run_queues+0x107/0x230 Aug 22 08:56:02 juju-e4d256-prod-github-runner-207 kernel: [12736.584452] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 08:56:02 juju-e4d256-prod-github-runner-207 kernel: [12736.585499] ? hrtimer_interrupt+0x101/0x220 Aug 22 08:56:02 juju-e4d256-prod-github-runner-207 kernel: [12736.586557] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 08:56:02 juju-e4d256-prod-github-runner-207 kernel: [12736.587629] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 08:56:02 juju-e4d256-prod-github-runner-207 kernel: [12736.588713] Aug 22 08:56:02 juju-e4d256-prod-github-runner-207 kernel: [12736.589575] Aug 22 08:56:02 juju-e4d256-prod-github-runner-207 kernel: [12736.590416] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 08:56:02 juju-e4d256-prod-github-runner-207 kernel: [12736.591465] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:56:02 juju-e4d256-prod-github-runner-207 kernel: [12736.592513] ? _raw_spin_lock+0x22/0x30 Aug 22 08:56:02 juju-e4d256-prod-github-runner-207 kernel: [12736.593463] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:56:02 juju-e4d256-prod-github-runner-207 kernel: [12736.594481] direct_page_fault+0x206/0x310 [kvm] Aug 22 08:56:02 juju-e4d256-prod-github-runner-207 kernel: [12736.595522] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 08:56:02 juju-e4d256-prod-github-runner-207 kernel: [12736.596554] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 08:56:02 juju-e4d256-prod-github-runner-207 kernel: [12736.597598] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 08:56:02 juju-e4d256-prod-github-runner-207 kernel: [12736.598593] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 08:56:02 juju-e4d256-prod-github-runner-207 kernel: [12736.599816] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 08:56:02 juju-e4d256-prod-github-runner-207 kernel: [12736.601026] handle_exit+0x98/0x230 [kvm_amd] Aug 22 08:56:02 juju-e4d256-prod-github-runner-207 kernel: [12736.601926] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 08:56:02 juju-e4d256-prod-github-runner-207 kernel: [12736.602852] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 08:56:02 juju-e4d256-prod-github-runner-207 kernel: [12736.603784] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 08:56:02 juju-e4d256-prod-github-runner-207 kernel: [12736.604701] vcpu_run+0x62/0x2c0 [kvm] Aug 22 08:56:02 juju-e4d256-prod-github-runner-207 kernel: [12736.605517] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 08:56:02 juju-e4d256-prod-github-runner-207 kernel: [12736.606333] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 08:56:02 juju-e4d256-prod-github-runner-207 kernel: [12736.607191] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 08:56:02 juju-e4d256-prod-github-runner-207 kernel: [12736.607991] ? __seccomp_filter+0x4a/0x4a0 Aug 22 08:56:02 juju-e4d256-prod-github-runner-207 kernel: [12736.608753] ? __fget_files+0x86/0xc0 Aug 22 08:56:02 juju-e4d256-prod-github-runner-207 kernel: [12736.609460] __x64_sys_ioctl+0x95/0xd0 Aug 22 08:56:02 juju-e4d256-prod-github-runner-207 kernel: [12736.610157] do_syscall_64+0x5c/0xc0 Aug 22 08:56:02 juju-e4d256-prod-github-runner-207 kernel: [12736.610826] ? do_futex+0x162/0x1f0 Aug 22 08:56:02 juju-e4d256-prod-github-runner-207 kernel: [12736.611477] ? __x64_sys_futex+0x78/0x1e0 Aug 22 08:56:02 juju-e4d256-prod-github-runner-207 kernel: [12736.612185] ? __secure_computing+0xa9/0x120 Aug 22 08:56:02 juju-e4d256-prod-github-runner-207 kernel: [12736.612881] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 08:56:02 juju-e4d256-prod-github-runner-207 kernel: [12736.613651] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:56:02 juju-e4d256-prod-github-runner-207 kernel: [12736.614376] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:56:02 juju-e4d256-prod-github-runner-207 kernel: [12736.615098] ? do_syscall_64+0x69/0xc0 Aug 22 08:56:02 juju-e4d256-prod-github-runner-207 kernel: [12736.615745] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:56:02 juju-e4d256-prod-github-runner-207 kernel: [12736.616471] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:56:02 juju-e4d256-prod-github-runner-207 kernel: [12736.617171] ? do_syscall_64+0x69/0xc0 Aug 22 08:56:02 juju-e4d256-prod-github-runner-207 kernel: [12736.617800] ? do_syscall_64+0x69/0xc0 Aug 22 08:56:02 juju-e4d256-prod-github-runner-207 kernel: [12736.618423] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 08:56:02 juju-e4d256-prod-github-runner-207 kernel: [12736.619135] RIP: 0033:0x7faa5d0edaff Aug 22 08:56:02 juju-e4d256-prod-github-runner-207 kernel: [12736.619803] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 08:56:02 juju-e4d256-prod-github-runner-207 kernel: [12736.621823] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 08:56:02 juju-e4d256-prod-github-runner-207 kernel: [12736.622737] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 08:56:02 juju-e4d256-prod-github-runner-207 kernel: [12736.623628] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 08:56:02 juju-e4d256-prod-github-runner-207 kernel: [12736.624571] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 08:56:02 juju-e4d256-prod-github-runner-207 kernel: [12736.625502] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 08:56:02 juju-e4d256-prod-github-runner-207 kernel: [12736.626401] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 08:56:02 juju-e4d256-prod-github-runner-207 kernel: [12736.627312] Aug 22 08:56:30 juju-e4d256-prod-github-runner-207 kernel: [12764.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 11779s! [qemu-system-x86:6715] Aug 22 08:56:30 juju-e4d256-prod-github-runner-207 kernel: [12764.543101] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 08:56:30 juju-e4d256-prod-github-runner-207 kernel: [12764.543177] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 08:56:30 juju-e4d256-prod-github-runner-207 kernel: [12764.556029] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 08:56:30 juju-e4d256-prod-github-runner-207 kernel: [12764.557319] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 08:56:30 juju-e4d256-prod-github-runner-207 kernel: [12764.558534] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:56:30 juju-e4d256-prod-github-runner-207 kernel: [12764.559584] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 08:56:30 juju-e4d256-prod-github-runner-207 kernel: [12764.562173] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 08:56:30 juju-e4d256-prod-github-runner-207 kernel: [12764.563218] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 08:56:30 juju-e4d256-prod-github-runner-207 kernel: [12764.564385] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 08:56:30 juju-e4d256-prod-github-runner-207 kernel: [12764.565543] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 08:56:30 juju-e4d256-prod-github-runner-207 kernel: [12764.566697] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 08:56:30 juju-e4d256-prod-github-runner-207 kernel: [12764.567865] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 08:56:30 juju-e4d256-prod-github-runner-207 kernel: [12764.569028] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 08:56:30 juju-e4d256-prod-github-runner-207 kernel: [12764.570258] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 08:56:30 juju-e4d256-prod-github-runner-207 kernel: [12764.571362] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 08:56:30 juju-e4d256-prod-github-runner-207 kernel: [12764.572566] Call Trace: Aug 22 08:56:30 juju-e4d256-prod-github-runner-207 kernel: [12764.573475] Aug 22 08:56:30 juju-e4d256-prod-github-runner-207 kernel: [12764.574386] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:56:30 juju-e4d256-prod-github-runner-207 kernel: [12764.575444] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:56:30 juju-e4d256-prod-github-runner-207 kernel: [12764.576532] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:56:30 juju-e4d256-prod-github-runner-207 kernel: [12764.577669] ? show_regs.part.0+0x23/0x29 Aug 22 08:56:30 juju-e4d256-prod-github-runner-207 kernel: [12764.578847] ? show_regs.cold+0x8/0xd Aug 22 08:56:30 juju-e4d256-prod-github-runner-207 kernel: [12764.579953] ? watchdog_timer_fn+0x1be/0x220 Aug 22 08:56:30 juju-e4d256-prod-github-runner-207 kernel: [12764.580978] ? lockup_detector_update_enable+0x60/0x60 Aug 22 08:56:30 juju-e4d256-prod-github-runner-207 kernel: [12764.582049] ? __hrtimer_run_queues+0x107/0x230 Aug 22 08:56:30 juju-e4d256-prod-github-runner-207 kernel: [12764.583091] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 08:56:30 juju-e4d256-prod-github-runner-207 kernel: [12764.584173] ? hrtimer_interrupt+0x101/0x220 Aug 22 08:56:30 juju-e4d256-prod-github-runner-207 kernel: [12764.585201] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 08:56:30 juju-e4d256-prod-github-runner-207 kernel: [12764.586280] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 08:56:30 juju-e4d256-prod-github-runner-207 kernel: [12764.587343] Aug 22 08:56:30 juju-e4d256-prod-github-runner-207 kernel: [12764.588209] Aug 22 08:56:30 juju-e4d256-prod-github-runner-207 kernel: [12764.589045] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 08:56:30 juju-e4d256-prod-github-runner-207 kernel: [12764.590182] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:56:30 juju-e4d256-prod-github-runner-207 kernel: [12764.591243] ? _raw_spin_lock+0x22/0x30 Aug 22 08:56:30 juju-e4d256-prod-github-runner-207 kernel: [12764.592223] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:56:30 juju-e4d256-prod-github-runner-207 kernel: [12764.593291] direct_page_fault+0x206/0x310 [kvm] Aug 22 08:56:30 juju-e4d256-prod-github-runner-207 kernel: [12764.594328] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 08:56:30 juju-e4d256-prod-github-runner-207 kernel: [12764.595355] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 08:56:30 juju-e4d256-prod-github-runner-207 kernel: [12764.596428] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 08:56:30 juju-e4d256-prod-github-runner-207 kernel: [12764.597423] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 08:56:30 juju-e4d256-prod-github-runner-207 kernel: [12764.598390] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 08:56:30 juju-e4d256-prod-github-runner-207 kernel: [12764.599509] handle_exit+0x98/0x230 [kvm_amd] Aug 22 08:56:30 juju-e4d256-prod-github-runner-207 kernel: [12764.600498] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 08:56:30 juju-e4d256-prod-github-runner-207 kernel: [12764.601553] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 08:56:30 juju-e4d256-prod-github-runner-207 kernel: [12764.602747] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 08:56:30 juju-e4d256-prod-github-runner-207 kernel: [12764.603822] vcpu_run+0x62/0x2c0 [kvm] Aug 22 08:56:30 juju-e4d256-prod-github-runner-207 kernel: [12764.604818] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 08:56:30 juju-e4d256-prod-github-runner-207 kernel: [12764.605680] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 08:56:30 juju-e4d256-prod-github-runner-207 kernel: [12764.606764] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 08:56:30 juju-e4d256-prod-github-runner-207 kernel: [12764.607636] ? __seccomp_filter+0x4a/0x4a0 Aug 22 08:56:30 juju-e4d256-prod-github-runner-207 kernel: [12764.608483] ? __fget_files+0x86/0xc0 Aug 22 08:56:30 juju-e4d256-prod-github-runner-207 kernel: [12764.609556] __x64_sys_ioctl+0x95/0xd0 Aug 22 08:56:30 juju-e4d256-prod-github-runner-207 kernel: [12764.610302] do_syscall_64+0x5c/0xc0 Aug 22 08:56:30 juju-e4d256-prod-github-runner-207 kernel: [12764.610978] ? do_futex+0x162/0x1f0 Aug 22 08:56:30 juju-e4d256-prod-github-runner-207 kernel: [12764.611643] ? __x64_sys_futex+0x78/0x1e0 Aug 22 08:56:30 juju-e4d256-prod-github-runner-207 kernel: [12764.612369] ? __secure_computing+0xa9/0x120 Aug 22 08:56:30 juju-e4d256-prod-github-runner-207 kernel: [12764.613111] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 08:56:30 juju-e4d256-prod-github-runner-207 kernel: [12764.613889] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:56:30 juju-e4d256-prod-github-runner-207 kernel: [12764.614633] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:56:30 juju-e4d256-prod-github-runner-207 kernel: [12764.615373] ? do_syscall_64+0x69/0xc0 Aug 22 08:56:30 juju-e4d256-prod-github-runner-207 kernel: [12764.616045] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:56:30 juju-e4d256-prod-github-runner-207 kernel: [12764.616760] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:56:30 juju-e4d256-prod-github-runner-207 kernel: [12764.617466] ? do_syscall_64+0x69/0xc0 Aug 22 08:56:30 juju-e4d256-prod-github-runner-207 kernel: [12764.618114] ? do_syscall_64+0x69/0xc0 Aug 22 08:56:30 juju-e4d256-prod-github-runner-207 kernel: [12764.618750] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 08:56:30 juju-e4d256-prod-github-runner-207 kernel: [12764.619471] RIP: 0033:0x7faa5d0edaff Aug 22 08:56:30 juju-e4d256-prod-github-runner-207 kernel: [12764.620121] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 08:56:30 juju-e4d256-prod-github-runner-207 kernel: [12764.622122] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 08:56:30 juju-e4d256-prod-github-runner-207 kernel: [12764.623055] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 08:56:30 juju-e4d256-prod-github-runner-207 kernel: [12764.623982] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 08:56:30 juju-e4d256-prod-github-runner-207 kernel: [12764.624885] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 08:56:30 juju-e4d256-prod-github-runner-207 kernel: [12764.625776] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 08:56:30 juju-e4d256-prod-github-runner-207 kernel: [12764.626675] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 08:56:30 juju-e4d256-prod-github-runner-207 kernel: [12764.627572] Aug 22 08:56:44 juju-e4d256-prod-github-runner-207 kernel: [12778.040709] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 08:56:44 juju-e4d256-prod-github-runner-207 kernel: [12778.041667] rcu: 1-....: (3155300 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=1524773 Aug 22 08:56:44 juju-e4d256-prod-github-runner-207 kernel: [12778.042785] (t=3165210 jiffies g=23269 q=20666) Aug 22 08:56:44 juju-e4d256-prod-github-runner-207 kernel: [12778.043581] NMI backtrace for cpu 1 Aug 22 08:56:44 juju-e4d256-prod-github-runner-207 kernel: [12778.044296] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 08:56:44 juju-e4d256-prod-github-runner-207 kernel: [12778.045410] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 08:56:44 juju-e4d256-prod-github-runner-207 kernel: [12778.046473] Call Trace: Aug 22 08:56:44 juju-e4d256-prod-github-runner-207 kernel: [12778.047149] Aug 22 08:56:44 juju-e4d256-prod-github-runner-207 kernel: [12778.047805] show_stack+0x52/0x5c Aug 22 08:56:44 juju-e4d256-prod-github-runner-207 kernel: [12778.048539] dump_stack_lvl+0x4a/0x63 Aug 22 08:56:44 juju-e4d256-prod-github-runner-207 kernel: [12778.049288] dump_stack+0x10/0x16 Aug 22 08:56:44 juju-e4d256-prod-github-runner-207 kernel: [12778.050004] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 08:56:44 juju-e4d256-prod-github-runner-207 kernel: [12778.050787] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 08:56:44 juju-e4d256-prod-github-runner-207 kernel: [12778.051590] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 08:56:44 juju-e4d256-prod-github-runner-207 kernel: [12778.052525] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 08:56:44 juju-e4d256-prod-github-runner-207 kernel: [12778.053354] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 08:56:44 juju-e4d256-prod-github-runner-207 kernel: [12778.054162] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 08:56:44 juju-e4d256-prod-github-runner-207 kernel: [12778.054934] print_cpu_stall.cold+0x2f/0xe2 Aug 22 08:56:44 juju-e4d256-prod-github-runner-207 kernel: [12778.055737] ? timekeeping_update+0xf7/0x150 Aug 22 08:56:44 juju-e4d256-prod-github-runner-207 kernel: [12778.056526] check_cpu_stall+0x109/0x270 Aug 22 08:56:44 juju-e4d256-prod-github-runner-207 kernel: [12778.057274] rcu_sched_clock_irq+0x9a/0x250 Aug 22 08:56:44 juju-e4d256-prod-github-runner-207 kernel: [12778.058037] update_process_times+0x94/0xd0 Aug 22 08:56:44 juju-e4d256-prod-github-runner-207 kernel: [12778.058821] tick_sched_handle+0x29/0x70 Aug 22 08:56:44 juju-e4d256-prod-github-runner-207 kernel: [12778.059586] tick_sched_timer+0x8c/0xc0 Aug 22 08:56:44 juju-e4d256-prod-github-runner-207 kernel: [12778.060327] ? tick_nohz_handler+0xb0/0xb0 Aug 22 08:56:44 juju-e4d256-prod-github-runner-207 kernel: [12778.061098] __hrtimer_run_queues+0x107/0x230 Aug 22 08:56:44 juju-e4d256-prod-github-runner-207 kernel: [12778.061870] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 08:56:44 juju-e4d256-prod-github-runner-207 kernel: [12778.062644] hrtimer_interrupt+0x101/0x220 Aug 22 08:56:44 juju-e4d256-prod-github-runner-207 kernel: [12778.063427] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 08:56:44 juju-e4d256-prod-github-runner-207 kernel: [12778.064265] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 08:56:44 juju-e4d256-prod-github-runner-207 kernel: [12778.065081] Aug 22 08:56:44 juju-e4d256-prod-github-runner-207 kernel: [12778.065729] Aug 22 08:56:44 juju-e4d256-prod-github-runner-207 kernel: [12778.066359] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 08:56:44 juju-e4d256-prod-github-runner-207 kernel: [12778.067187] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:56:44 juju-e4d256-prod-github-runner-207 kernel: [12778.068217] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 08:56:44 juju-e4d256-prod-github-runner-207 kernel: [12778.070498] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 08:56:44 juju-e4d256-prod-github-runner-207 kernel: [12778.071379] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 08:56:44 juju-e4d256-prod-github-runner-207 kernel: [12778.072408] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 08:56:44 juju-e4d256-prod-github-runner-207 kernel: [12778.073392] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 08:56:44 juju-e4d256-prod-github-runner-207 kernel: [12778.074366] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 08:56:44 juju-e4d256-prod-github-runner-207 kernel: [12778.075325] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 08:56:44 juju-e4d256-prod-github-runner-207 kernel: [12778.076304] ? _raw_spin_lock+0x22/0x30 Aug 22 08:56:44 juju-e4d256-prod-github-runner-207 kernel: [12778.077066] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:56:44 juju-e4d256-prod-github-runner-207 kernel: [12778.077906] direct_page_fault+0x206/0x310 [kvm] Aug 22 08:56:44 juju-e4d256-prod-github-runner-207 kernel: [12778.078794] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 08:56:44 juju-e4d256-prod-github-runner-207 kernel: [12778.079835] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 08:56:44 juju-e4d256-prod-github-runner-207 kernel: [12778.080667] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 08:56:44 juju-e4d256-prod-github-runner-207 kernel: [12778.081657] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 08:56:44 juju-e4d256-prod-github-runner-207 kernel: [12778.082450] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 08:56:44 juju-e4d256-prod-github-runner-207 kernel: [12778.083279] handle_exit+0x98/0x230 [kvm_amd] Aug 22 08:56:44 juju-e4d256-prod-github-runner-207 kernel: [12778.084044] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 08:56:44 juju-e4d256-prod-github-runner-207 kernel: [12778.084831] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 08:56:44 juju-e4d256-prod-github-runner-207 kernel: [12778.085630] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 08:56:44 juju-e4d256-prod-github-runner-207 kernel: [12778.086439] vcpu_run+0x62/0x2c0 [kvm] Aug 22 08:56:44 juju-e4d256-prod-github-runner-207 kernel: [12778.087189] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 08:56:44 juju-e4d256-prod-github-runner-207 kernel: [12778.088037] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 08:56:44 juju-e4d256-prod-github-runner-207 kernel: [12778.088945] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 08:56:44 juju-e4d256-prod-github-runner-207 kernel: [12778.089709] ? __seccomp_filter+0x4a/0x4a0 Aug 22 08:56:44 juju-e4d256-prod-github-runner-207 kernel: [12778.090424] ? __fget_files+0x86/0xc0 Aug 22 08:56:44 juju-e4d256-prod-github-runner-207 kernel: [12778.091113] __x64_sys_ioctl+0x95/0xd0 Aug 22 08:56:44 juju-e4d256-prod-github-runner-207 kernel: [12778.091823] do_syscall_64+0x5c/0xc0 Aug 22 08:56:44 juju-e4d256-prod-github-runner-207 kernel: [12778.092586] ? do_futex+0x162/0x1f0 Aug 22 08:56:44 juju-e4d256-prod-github-runner-207 kernel: [12778.093332] ? __x64_sys_futex+0x78/0x1e0 Aug 22 08:56:44 juju-e4d256-prod-github-runner-207 kernel: [12778.094111] ? __secure_computing+0xa9/0x120 Aug 22 08:56:44 juju-e4d256-prod-github-runner-207 kernel: [12778.094916] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 08:56:44 juju-e4d256-prod-github-runner-207 kernel: [12778.095841] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:56:44 juju-e4d256-prod-github-runner-207 kernel: [12778.096700] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:56:44 juju-e4d256-prod-github-runner-207 kernel: [12778.097542] ? do_syscall_64+0x69/0xc0 Aug 22 08:56:44 juju-e4d256-prod-github-runner-207 kernel: [12778.098304] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:56:44 juju-e4d256-prod-github-runner-207 kernel: [12778.099158] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:56:44 juju-e4d256-prod-github-runner-207 kernel: [12778.100035] ? do_syscall_64+0x69/0xc0 Aug 22 08:56:44 juju-e4d256-prod-github-runner-207 kernel: [12778.100813] ? do_syscall_64+0x69/0xc0 Aug 22 08:56:44 juju-e4d256-prod-github-runner-207 kernel: [12778.101574] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 08:56:44 juju-e4d256-prod-github-runner-207 kernel: [12778.102454] RIP: 0033:0x7faa5d0edaff Aug 22 08:56:44 juju-e4d256-prod-github-runner-207 kernel: [12778.103209] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 08:56:44 juju-e4d256-prod-github-runner-207 kernel: [12778.105692] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 08:56:44 juju-e4d256-prod-github-runner-207 kernel: [12778.106803] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 08:56:44 juju-e4d256-prod-github-runner-207 kernel: [12778.107905] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 08:56:44 juju-e4d256-prod-github-runner-207 kernel: [12778.108991] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 08:56:44 juju-e4d256-prod-github-runner-207 kernel: [12778.110066] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 08:56:44 juju-e4d256-prod-github-runner-207 kernel: [12778.111127] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 08:56:44 juju-e4d256-prod-github-runner-207 kernel: [12778.112189] Aug 22 08:57:10 juju-e4d256-prod-github-runner-207 kernel: [12804.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 11817s! [qemu-system-x86:6715] Aug 22 08:57:10 juju-e4d256-prod-github-runner-207 kernel: [12804.543879] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 08:57:10 juju-e4d256-prod-github-runner-207 kernel: [12804.544211] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 08:57:10 juju-e4d256-prod-github-runner-207 kernel: [12804.557090] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 08:57:10 juju-e4d256-prod-github-runner-207 kernel: [12804.558376] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 08:57:10 juju-e4d256-prod-github-runner-207 kernel: [12804.559633] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:57:10 juju-e4d256-prod-github-runner-207 kernel: [12804.560693] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 08:57:10 juju-e4d256-prod-github-runner-207 kernel: [12804.563254] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 08:57:10 juju-e4d256-prod-github-runner-207 kernel: [12804.564296] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 08:57:10 juju-e4d256-prod-github-runner-207 kernel: [12804.565463] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 08:57:10 juju-e4d256-prod-github-runner-207 kernel: [12804.566622] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 08:57:10 juju-e4d256-prod-github-runner-207 kernel: [12804.567791] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 08:57:10 juju-e4d256-prod-github-runner-207 kernel: [12804.568952] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 08:57:10 juju-e4d256-prod-github-runner-207 kernel: [12804.570117] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 08:57:10 juju-e4d256-prod-github-runner-207 kernel: [12804.571373] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 08:57:10 juju-e4d256-prod-github-runner-207 kernel: [12804.572479] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 08:57:10 juju-e4d256-prod-github-runner-207 kernel: [12804.573672] Call Trace: Aug 22 08:57:10 juju-e4d256-prod-github-runner-207 kernel: [12804.574635] Aug 22 08:57:10 juju-e4d256-prod-github-runner-207 kernel: [12804.575666] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:57:10 juju-e4d256-prod-github-runner-207 kernel: [12804.576709] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:57:10 juju-e4d256-prod-github-runner-207 kernel: [12804.577735] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:57:10 juju-e4d256-prod-github-runner-207 kernel: [12804.578853] ? show_regs.part.0+0x23/0x29 Aug 22 08:57:10 juju-e4d256-prod-github-runner-207 kernel: [12804.579891] ? show_regs.cold+0x8/0xd Aug 22 08:57:10 juju-e4d256-prod-github-runner-207 kernel: [12804.580868] ? watchdog_timer_fn+0x1be/0x220 Aug 22 08:57:10 juju-e4d256-prod-github-runner-207 kernel: [12804.581880] ? lockup_detector_update_enable+0x60/0x60 Aug 22 08:57:10 juju-e4d256-prod-github-runner-207 kernel: [12804.582968] ? __hrtimer_run_queues+0x107/0x230 Aug 22 08:57:10 juju-e4d256-prod-github-runner-207 kernel: [12804.584024] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 08:57:10 juju-e4d256-prod-github-runner-207 kernel: [12804.585169] ? hrtimer_interrupt+0x101/0x220 Aug 22 08:57:10 juju-e4d256-prod-github-runner-207 kernel: [12804.586232] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 08:57:10 juju-e4d256-prod-github-runner-207 kernel: [12804.587336] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 08:57:10 juju-e4d256-prod-github-runner-207 kernel: [12804.588430] Aug 22 08:57:10 juju-e4d256-prod-github-runner-207 kernel: [12804.589285] Aug 22 08:57:10 juju-e4d256-prod-github-runner-207 kernel: [12804.590125] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 08:57:10 juju-e4d256-prod-github-runner-207 kernel: [12804.591177] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:57:10 juju-e4d256-prod-github-runner-207 kernel: [12804.592373] ? _raw_spin_lock+0x22/0x30 Aug 22 08:57:10 juju-e4d256-prod-github-runner-207 kernel: [12804.593323] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:57:10 juju-e4d256-prod-github-runner-207 kernel: [12804.594390] direct_page_fault+0x206/0x310 [kvm] Aug 22 08:57:10 juju-e4d256-prod-github-runner-207 kernel: [12804.595427] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 08:57:10 juju-e4d256-prod-github-runner-207 kernel: [12804.596439] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 08:57:10 juju-e4d256-prod-github-runner-207 kernel: [12804.597474] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 08:57:10 juju-e4d256-prod-github-runner-207 kernel: [12804.598482] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 08:57:10 juju-e4d256-prod-github-runner-207 kernel: [12804.599438] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 08:57:10 juju-e4d256-prod-github-runner-207 kernel: [12804.600414] handle_exit+0x98/0x230 [kvm_amd] Aug 22 08:57:10 juju-e4d256-prod-github-runner-207 kernel: [12804.601307] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 08:57:10 juju-e4d256-prod-github-runner-207 kernel: [12804.602221] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 08:57:10 juju-e4d256-prod-github-runner-207 kernel: [12804.603145] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 08:57:10 juju-e4d256-prod-github-runner-207 kernel: [12804.604057] vcpu_run+0x62/0x2c0 [kvm] Aug 22 08:57:10 juju-e4d256-prod-github-runner-207 kernel: [12804.604872] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 08:57:10 juju-e4d256-prod-github-runner-207 kernel: [12804.605682] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 08:57:10 juju-e4d256-prod-github-runner-207 kernel: [12804.606540] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 08:57:10 juju-e4d256-prod-github-runner-207 kernel: [12804.607343] ? __seccomp_filter+0x4a/0x4a0 Aug 22 08:57:10 juju-e4d256-prod-github-runner-207 kernel: [12804.608085] ? __fget_files+0x86/0xc0 Aug 22 08:57:10 juju-e4d256-prod-github-runner-207 kernel: [12804.608786] __x64_sys_ioctl+0x95/0xd0 Aug 22 08:57:10 juju-e4d256-prod-github-runner-207 kernel: [12804.609482] do_syscall_64+0x5c/0xc0 Aug 22 08:57:10 juju-e4d256-prod-github-runner-207 kernel: [12804.610145] ? do_futex+0x162/0x1f0 Aug 22 08:57:10 juju-e4d256-prod-github-runner-207 kernel: [12804.610791] ? __x64_sys_futex+0x78/0x1e0 Aug 22 08:57:10 juju-e4d256-prod-github-runner-207 kernel: [12804.611470] ? __secure_computing+0xa9/0x120 Aug 22 08:57:10 juju-e4d256-prod-github-runner-207 kernel: [12804.612159] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 08:57:10 juju-e4d256-prod-github-runner-207 kernel: [12804.612952] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:57:10 juju-e4d256-prod-github-runner-207 kernel: [12804.613680] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:57:10 juju-e4d256-prod-github-runner-207 kernel: [12804.614393] ? do_syscall_64+0x69/0xc0 Aug 22 08:57:10 juju-e4d256-prod-github-runner-207 kernel: [12804.615034] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:57:10 juju-e4d256-prod-github-runner-207 kernel: [12804.615741] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:57:10 juju-e4d256-prod-github-runner-207 kernel: [12804.616431] ? do_syscall_64+0x69/0xc0 Aug 22 08:57:10 juju-e4d256-prod-github-runner-207 kernel: [12804.617064] ? do_syscall_64+0x69/0xc0 Aug 22 08:57:10 juju-e4d256-prod-github-runner-207 kernel: [12804.617694] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 08:57:10 juju-e4d256-prod-github-runner-207 kernel: [12804.618415] RIP: 0033:0x7faa5d0edaff Aug 22 08:57:10 juju-e4d256-prod-github-runner-207 kernel: [12804.619219] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 08:57:10 juju-e4d256-prod-github-runner-207 kernel: [12804.621208] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 08:57:10 juju-e4d256-prod-github-runner-207 kernel: [12804.622118] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 08:57:10 juju-e4d256-prod-github-runner-207 kernel: [12804.623008] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 08:57:10 juju-e4d256-prod-github-runner-207 kernel: [12804.623924] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 08:57:10 juju-e4d256-prod-github-runner-207 kernel: [12804.624807] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 08:57:10 juju-e4d256-prod-github-runner-207 kernel: [12804.625699] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 08:57:10 juju-e4d256-prod-github-runner-207 kernel: [12804.626605] Aug 22 08:57:38 juju-e4d256-prod-github-runner-207 kernel: [12832.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 11843s! [qemu-system-x86:6715] Aug 22 08:57:38 juju-e4d256-prod-github-runner-207 kernel: [12832.543113] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 08:57:38 juju-e4d256-prod-github-runner-207 kernel: [12832.543191] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 08:57:38 juju-e4d256-prod-github-runner-207 kernel: [12832.555283] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 08:57:38 juju-e4d256-prod-github-runner-207 kernel: [12832.556570] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 08:57:38 juju-e4d256-prod-github-runner-207 kernel: [12832.557800] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:57:38 juju-e4d256-prod-github-runner-207 kernel: [12832.558854] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 08:57:38 juju-e4d256-prod-github-runner-207 kernel: [12832.561406] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 08:57:38 juju-e4d256-prod-github-runner-207 kernel: [12832.562447] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 08:57:38 juju-e4d256-prod-github-runner-207 kernel: [12832.563622] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 08:57:38 juju-e4d256-prod-github-runner-207 kernel: [12832.564789] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 08:57:38 juju-e4d256-prod-github-runner-207 kernel: [12832.565952] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 08:57:38 juju-e4d256-prod-github-runner-207 kernel: [12832.567135] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 08:57:38 juju-e4d256-prod-github-runner-207 kernel: [12832.568302] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 08:57:38 juju-e4d256-prod-github-runner-207 kernel: [12832.569534] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 08:57:38 juju-e4d256-prod-github-runner-207 kernel: [12832.570638] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 08:57:38 juju-e4d256-prod-github-runner-207 kernel: [12832.571842] Call Trace: Aug 22 08:57:38 juju-e4d256-prod-github-runner-207 kernel: [12832.572751] Aug 22 08:57:38 juju-e4d256-prod-github-runner-207 kernel: [12832.573636] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:57:38 juju-e4d256-prod-github-runner-207 kernel: [12832.574668] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:57:38 juju-e4d256-prod-github-runner-207 kernel: [12832.575785] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:57:38 juju-e4d256-prod-github-runner-207 kernel: [12832.576858] ? show_regs.part.0+0x23/0x29 Aug 22 08:57:38 juju-e4d256-prod-github-runner-207 kernel: [12832.577868] ? show_regs.cold+0x8/0xd Aug 22 08:57:38 juju-e4d256-prod-github-runner-207 kernel: [12832.578843] ? watchdog_timer_fn+0x1be/0x220 Aug 22 08:57:38 juju-e4d256-prod-github-runner-207 kernel: [12832.579860] ? lockup_detector_update_enable+0x60/0x60 Aug 22 08:57:38 juju-e4d256-prod-github-runner-207 kernel: [12832.580920] ? __hrtimer_run_queues+0x107/0x230 Aug 22 08:57:38 juju-e4d256-prod-github-runner-207 kernel: [12832.581944] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 08:57:38 juju-e4d256-prod-github-runner-207 kernel: [12832.582972] ? hrtimer_interrupt+0x101/0x220 Aug 22 08:57:38 juju-e4d256-prod-github-runner-207 kernel: [12832.583992] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 08:57:38 juju-e4d256-prod-github-runner-207 kernel: [12832.585058] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 08:57:38 juju-e4d256-prod-github-runner-207 kernel: [12832.586106] Aug 22 08:57:38 juju-e4d256-prod-github-runner-207 kernel: [12832.586966] Aug 22 08:57:38 juju-e4d256-prod-github-runner-207 kernel: [12832.587803] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 08:57:38 juju-e4d256-prod-github-runner-207 kernel: [12832.588839] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:57:38 juju-e4d256-prod-github-runner-207 kernel: [12832.589882] ? _raw_spin_lock+0x22/0x30 Aug 22 08:57:38 juju-e4d256-prod-github-runner-207 kernel: [12832.590825] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:57:38 juju-e4d256-prod-github-runner-207 kernel: [12832.591851] direct_page_fault+0x206/0x310 [kvm] Aug 22 08:57:38 juju-e4d256-prod-github-runner-207 kernel: [12832.592882] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 08:57:38 juju-e4d256-prod-github-runner-207 kernel: [12832.593891] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 08:57:38 juju-e4d256-prod-github-runner-207 kernel: [12832.594902] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 08:57:38 juju-e4d256-prod-github-runner-207 kernel: [12832.595877] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 08:57:38 juju-e4d256-prod-github-runner-207 kernel: [12832.596824] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 08:57:38 juju-e4d256-prod-github-runner-207 kernel: [12832.597806] handle_exit+0x98/0x230 [kvm_amd] Aug 22 08:57:38 juju-e4d256-prod-github-runner-207 kernel: [12832.598703] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 08:57:38 juju-e4d256-prod-github-runner-207 kernel: [12832.599624] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 08:57:38 juju-e4d256-prod-github-runner-207 kernel: [12832.600547] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 08:57:38 juju-e4d256-prod-github-runner-207 kernel: [12832.601451] vcpu_run+0x62/0x2c0 [kvm] Aug 22 08:57:38 juju-e4d256-prod-github-runner-207 kernel: [12832.602261] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 08:57:38 juju-e4d256-prod-github-runner-207 kernel: [12832.603083] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 08:57:38 juju-e4d256-prod-github-runner-207 kernel: [12832.603937] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 08:57:38 juju-e4d256-prod-github-runner-207 kernel: [12832.604731] ? __seccomp_filter+0x4a/0x4a0 Aug 22 08:57:38 juju-e4d256-prod-github-runner-207 kernel: [12832.605479] ? __fget_files+0x86/0xc0 Aug 22 08:57:38 juju-e4d256-prod-github-runner-207 kernel: [12832.606184] __x64_sys_ioctl+0x95/0xd0 Aug 22 08:57:38 juju-e4d256-prod-github-runner-207 kernel: [12832.606887] do_syscall_64+0x5c/0xc0 Aug 22 08:57:38 juju-e4d256-prod-github-runner-207 kernel: [12832.607556] ? do_futex+0x162/0x1f0 Aug 22 08:57:38 juju-e4d256-prod-github-runner-207 kernel: [12832.608206] ? __x64_sys_futex+0x78/0x1e0 Aug 22 08:57:38 juju-e4d256-prod-github-runner-207 kernel: [12832.608878] ? __secure_computing+0xa9/0x120 Aug 22 08:57:38 juju-e4d256-prod-github-runner-207 kernel: [12832.609567] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 08:57:38 juju-e4d256-prod-github-runner-207 kernel: [12832.610326] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:57:38 juju-e4d256-prod-github-runner-207 kernel: [12832.611059] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:57:38 juju-e4d256-prod-github-runner-207 kernel: [12832.611785] ? do_syscall_64+0x69/0xc0 Aug 22 08:57:38 juju-e4d256-prod-github-runner-207 kernel: [12832.612429] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:57:38 juju-e4d256-prod-github-runner-207 kernel: [12832.613141] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:57:38 juju-e4d256-prod-github-runner-207 kernel: [12832.613837] ? do_syscall_64+0x69/0xc0 Aug 22 08:57:38 juju-e4d256-prod-github-runner-207 kernel: [12832.614460] ? do_syscall_64+0x69/0xc0 Aug 22 08:57:38 juju-e4d256-prod-github-runner-207 kernel: [12832.615089] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 08:57:38 juju-e4d256-prod-github-runner-207 kernel: [12832.615793] RIP: 0033:0x7faa5d0edaff Aug 22 08:57:38 juju-e4d256-prod-github-runner-207 kernel: [12832.616418] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 08:57:38 juju-e4d256-prod-github-runner-207 kernel: [12832.618425] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 08:57:38 juju-e4d256-prod-github-runner-207 kernel: [12832.619349] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 08:57:38 juju-e4d256-prod-github-runner-207 kernel: [12832.620238] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 08:57:38 juju-e4d256-prod-github-runner-207 kernel: [12832.621133] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 08:57:38 juju-e4d256-prod-github-runner-207 kernel: [12832.622027] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 08:57:38 juju-e4d256-prod-github-runner-207 kernel: [12832.622924] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 08:57:38 juju-e4d256-prod-github-runner-207 kernel: [12832.623817] Aug 22 08:58:06 juju-e4d256-prod-github-runner-207 kernel: [12860.541981] watchdog: BUG: soft lockup - CPU#1 stuck for 11869s! [qemu-system-x86:6715] Aug 22 08:58:06 juju-e4d256-prod-github-runner-207 kernel: [12860.543089] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 08:58:06 juju-e4d256-prod-github-runner-207 kernel: [12860.543160] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 08:58:06 juju-e4d256-prod-github-runner-207 kernel: [12860.555307] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 08:58:06 juju-e4d256-prod-github-runner-207 kernel: [12860.556604] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 08:58:06 juju-e4d256-prod-github-runner-207 kernel: [12860.557846] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:58:06 juju-e4d256-prod-github-runner-207 kernel: [12860.558928] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 08:58:06 juju-e4d256-prod-github-runner-207 kernel: [12860.561556] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 08:58:06 juju-e4d256-prod-github-runner-207 kernel: [12860.562639] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 08:58:06 juju-e4d256-prod-github-runner-207 kernel: [12860.563812] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 08:58:06 juju-e4d256-prod-github-runner-207 kernel: [12860.564979] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 08:58:06 juju-e4d256-prod-github-runner-207 kernel: [12860.566164] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 08:58:06 juju-e4d256-prod-github-runner-207 kernel: [12860.567347] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 08:58:06 juju-e4d256-prod-github-runner-207 kernel: [12860.568512] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 08:58:06 juju-e4d256-prod-github-runner-207 kernel: [12860.569753] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 08:58:06 juju-e4d256-prod-github-runner-207 kernel: [12860.570973] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 08:58:06 juju-e4d256-prod-github-runner-207 kernel: [12860.572173] Call Trace: Aug 22 08:58:06 juju-e4d256-prod-github-runner-207 kernel: [12860.573119] Aug 22 08:58:06 juju-e4d256-prod-github-runner-207 kernel: [12860.574016] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:58:06 juju-e4d256-prod-github-runner-207 kernel: [12860.575076] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:58:06 juju-e4d256-prod-github-runner-207 kernel: [12860.576105] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:58:06 juju-e4d256-prod-github-runner-207 kernel: [12860.577195] ? show_regs.part.0+0x23/0x29 Aug 22 08:58:06 juju-e4d256-prod-github-runner-207 kernel: [12860.578194] ? show_regs.cold+0x8/0xd Aug 22 08:58:06 juju-e4d256-prod-github-runner-207 kernel: [12860.579175] ? watchdog_timer_fn+0x1be/0x220 Aug 22 08:58:06 juju-e4d256-prod-github-runner-207 kernel: [12860.580197] ? lockup_detector_update_enable+0x60/0x60 Aug 22 08:58:06 juju-e4d256-prod-github-runner-207 kernel: [12860.581267] ? __hrtimer_run_queues+0x107/0x230 Aug 22 08:58:06 juju-e4d256-prod-github-runner-207 kernel: [12860.582503] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 08:58:06 juju-e4d256-prod-github-runner-207 kernel: [12860.583856] ? hrtimer_interrupt+0x101/0x220 Aug 22 08:58:06 juju-e4d256-prod-github-runner-207 kernel: [12860.585194] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 08:58:06 juju-e4d256-prod-github-runner-207 kernel: [12860.586600] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 08:58:06 juju-e4d256-prod-github-runner-207 kernel: [12860.587980] Aug 22 08:58:06 juju-e4d256-prod-github-runner-207 kernel: [12860.589074] Aug 22 08:58:06 juju-e4d256-prod-github-runner-207 kernel: [12860.589997] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 08:58:06 juju-e4d256-prod-github-runner-207 kernel: [12860.591060] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:58:06 juju-e4d256-prod-github-runner-207 kernel: [12860.592113] ? _raw_spin_lock+0x22/0x30 Aug 22 08:58:06 juju-e4d256-prod-github-runner-207 kernel: [12860.593058] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:58:06 juju-e4d256-prod-github-runner-207 kernel: [12860.594167] direct_page_fault+0x206/0x310 [kvm] Aug 22 08:58:06 juju-e4d256-prod-github-runner-207 kernel: [12860.595215] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 08:58:06 juju-e4d256-prod-github-runner-207 kernel: [12860.596233] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 08:58:06 juju-e4d256-prod-github-runner-207 kernel: [12860.597233] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 08:58:06 juju-e4d256-prod-github-runner-207 kernel: [12860.598205] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 08:58:06 juju-e4d256-prod-github-runner-207 kernel: [12860.599174] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 08:58:06 juju-e4d256-prod-github-runner-207 kernel: [12860.600152] handle_exit+0x98/0x230 [kvm_amd] Aug 22 08:58:06 juju-e4d256-prod-github-runner-207 kernel: [12860.601129] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 08:58:06 juju-e4d256-prod-github-runner-207 kernel: [12860.602223] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 08:58:06 juju-e4d256-prod-github-runner-207 kernel: [12860.603172] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 08:58:06 juju-e4d256-prod-github-runner-207 kernel: [12860.604073] vcpu_run+0x62/0x2c0 [kvm] Aug 22 08:58:06 juju-e4d256-prod-github-runner-207 kernel: [12860.604900] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 08:58:06 juju-e4d256-prod-github-runner-207 kernel: [12860.605793] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 08:58:06 juju-e4d256-prod-github-runner-207 kernel: [12860.606669] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 08:58:06 juju-e4d256-prod-github-runner-207 kernel: [12860.607475] ? __seccomp_filter+0x4a/0x4a0 Aug 22 08:58:06 juju-e4d256-prod-github-runner-207 kernel: [12860.608225] ? __fget_files+0x86/0xc0 Aug 22 08:58:06 juju-e4d256-prod-github-runner-207 kernel: [12860.608937] __x64_sys_ioctl+0x95/0xd0 Aug 22 08:58:06 juju-e4d256-prod-github-runner-207 kernel: [12860.609653] do_syscall_64+0x5c/0xc0 Aug 22 08:58:06 juju-e4d256-prod-github-runner-207 kernel: [12860.610329] ? do_futex+0x162/0x1f0 Aug 22 08:58:06 juju-e4d256-prod-github-runner-207 kernel: [12860.611033] ? __x64_sys_futex+0x78/0x1e0 Aug 22 08:58:06 juju-e4d256-prod-github-runner-207 kernel: [12860.611718] ? __secure_computing+0xa9/0x120 Aug 22 08:58:06 juju-e4d256-prod-github-runner-207 kernel: [12860.612408] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 08:58:06 juju-e4d256-prod-github-runner-207 kernel: [12860.613286] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:58:06 juju-e4d256-prod-github-runner-207 kernel: [12860.614007] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:58:06 juju-e4d256-prod-github-runner-207 kernel: [12860.614749] ? do_syscall_64+0x69/0xc0 Aug 22 08:58:06 juju-e4d256-prod-github-runner-207 kernel: [12860.615410] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:58:06 juju-e4d256-prod-github-runner-207 kernel: [12860.616117] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:58:06 juju-e4d256-prod-github-runner-207 kernel: [12860.616885] ? do_syscall_64+0x69/0xc0 Aug 22 08:58:06 juju-e4d256-prod-github-runner-207 kernel: [12860.617512] ? do_syscall_64+0x69/0xc0 Aug 22 08:58:06 juju-e4d256-prod-github-runner-207 kernel: [12860.618136] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 08:58:06 juju-e4d256-prod-github-runner-207 kernel: [12860.618858] RIP: 0033:0x7faa5d0edaff Aug 22 08:58:06 juju-e4d256-prod-github-runner-207 kernel: [12860.619486] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 08:58:06 juju-e4d256-prod-github-runner-207 kernel: [12860.621499] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 08:58:06 juju-e4d256-prod-github-runner-207 kernel: [12860.622416] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 08:58:06 juju-e4d256-prod-github-runner-207 kernel: [12860.623320] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 08:58:06 juju-e4d256-prod-github-runner-207 kernel: [12860.624213] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 08:58:06 juju-e4d256-prod-github-runner-207 kernel: [12860.625101] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 08:58:06 juju-e4d256-prod-github-runner-207 kernel: [12860.626012] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 08:58:06 juju-e4d256-prod-github-runner-207 kernel: [12860.626927] Aug 22 08:58:34 juju-e4d256-prod-github-runner-207 kernel: [12888.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 11895s! [qemu-system-x86:6715] Aug 22 08:58:34 juju-e4d256-prod-github-runner-207 kernel: [12888.543177] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 08:58:34 juju-e4d256-prod-github-runner-207 kernel: [12888.543252] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 08:58:34 juju-e4d256-prod-github-runner-207 kernel: [12888.555334] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 08:58:34 juju-e4d256-prod-github-runner-207 kernel: [12888.556607] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 08:58:34 juju-e4d256-prod-github-runner-207 kernel: [12888.557849] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:58:34 juju-e4d256-prod-github-runner-207 kernel: [12888.558917] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 08:58:34 juju-e4d256-prod-github-runner-207 kernel: [12888.561462] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 08:58:34 juju-e4d256-prod-github-runner-207 kernel: [12888.562525] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 08:58:34 juju-e4d256-prod-github-runner-207 kernel: [12888.563687] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 08:58:34 juju-e4d256-prod-github-runner-207 kernel: [12888.564846] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 08:58:34 juju-e4d256-prod-github-runner-207 kernel: [12888.566013] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 08:58:34 juju-e4d256-prod-github-runner-207 kernel: [12888.567203] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 08:58:34 juju-e4d256-prod-github-runner-207 kernel: [12888.568496] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 08:58:34 juju-e4d256-prod-github-runner-207 kernel: [12888.569723] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 08:58:34 juju-e4d256-prod-github-runner-207 kernel: [12888.570830] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 08:58:34 juju-e4d256-prod-github-runner-207 kernel: [12888.572024] Call Trace: Aug 22 08:58:34 juju-e4d256-prod-github-runner-207 kernel: [12888.572941] Aug 22 08:58:34 juju-e4d256-prod-github-runner-207 kernel: [12888.573828] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:58:34 juju-e4d256-prod-github-runner-207 kernel: [12888.574889] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:58:34 juju-e4d256-prod-github-runner-207 kernel: [12888.575928] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:58:34 juju-e4d256-prod-github-runner-207 kernel: [12888.577006] ? show_regs.part.0+0x23/0x29 Aug 22 08:58:34 juju-e4d256-prod-github-runner-207 kernel: [12888.578009] ? show_regs.cold+0x8/0xd Aug 22 08:58:34 juju-e4d256-prod-github-runner-207 kernel: [12888.578998] ? watchdog_timer_fn+0x1be/0x220 Aug 22 08:58:34 juju-e4d256-prod-github-runner-207 kernel: [12888.580006] ? lockup_detector_update_enable+0x60/0x60 Aug 22 08:58:34 juju-e4d256-prod-github-runner-207 kernel: [12888.581070] ? __hrtimer_run_queues+0x107/0x230 Aug 22 08:58:34 juju-e4d256-prod-github-runner-207 kernel: [12888.582095] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 08:58:34 juju-e4d256-prod-github-runner-207 kernel: [12888.583126] ? hrtimer_interrupt+0x101/0x220 Aug 22 08:58:34 juju-e4d256-prod-github-runner-207 kernel: [12888.584139] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 08:58:34 juju-e4d256-prod-github-runner-207 kernel: [12888.585220] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 08:58:34 juju-e4d256-prod-github-runner-207 kernel: [12888.586303] Aug 22 08:58:34 juju-e4d256-prod-github-runner-207 kernel: [12888.587170] Aug 22 08:58:34 juju-e4d256-prod-github-runner-207 kernel: [12888.588044] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 08:58:34 juju-e4d256-prod-github-runner-207 kernel: [12888.589076] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:58:34 juju-e4d256-prod-github-runner-207 kernel: [12888.590114] ? _raw_spin_lock+0x22/0x30 Aug 22 08:58:34 juju-e4d256-prod-github-runner-207 kernel: [12888.591078] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:58:34 juju-e4d256-prod-github-runner-207 kernel: [12888.592097] direct_page_fault+0x206/0x310 [kvm] Aug 22 08:58:34 juju-e4d256-prod-github-runner-207 kernel: [12888.593260] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 08:58:34 juju-e4d256-prod-github-runner-207 kernel: [12888.594280] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 08:58:34 juju-e4d256-prod-github-runner-207 kernel: [12888.595279] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 08:58:34 juju-e4d256-prod-github-runner-207 kernel: [12888.596248] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 08:58:34 juju-e4d256-prod-github-runner-207 kernel: [12888.597192] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 08:58:34 juju-e4d256-prod-github-runner-207 kernel: [12888.598217] handle_exit+0x98/0x230 [kvm_amd] Aug 22 08:58:34 juju-e4d256-prod-github-runner-207 kernel: [12888.599110] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 08:58:34 juju-e4d256-prod-github-runner-207 kernel: [12888.600027] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 08:58:34 juju-e4d256-prod-github-runner-207 kernel: [12888.600952] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 08:58:34 juju-e4d256-prod-github-runner-207 kernel: [12888.601861] vcpu_run+0x62/0x2c0 [kvm] Aug 22 08:58:34 juju-e4d256-prod-github-runner-207 kernel: [12888.602688] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 08:58:34 juju-e4d256-prod-github-runner-207 kernel: [12888.603510] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 08:58:34 juju-e4d256-prod-github-runner-207 kernel: [12888.604369] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 08:58:34 juju-e4d256-prod-github-runner-207 kernel: [12888.605164] ? __seccomp_filter+0x4a/0x4a0 Aug 22 08:58:34 juju-e4d256-prod-github-runner-207 kernel: [12888.605910] ? __fget_files+0x86/0xc0 Aug 22 08:58:34 juju-e4d256-prod-github-runner-207 kernel: [12888.606629] __x64_sys_ioctl+0x95/0xd0 Aug 22 08:58:34 juju-e4d256-prod-github-runner-207 kernel: [12888.607330] do_syscall_64+0x5c/0xc0 Aug 22 08:58:34 juju-e4d256-prod-github-runner-207 kernel: [12888.607995] ? do_futex+0x162/0x1f0 Aug 22 08:58:34 juju-e4d256-prod-github-runner-207 kernel: [12888.608650] ? __x64_sys_futex+0x78/0x1e0 Aug 22 08:58:34 juju-e4d256-prod-github-runner-207 kernel: [12888.609329] ? __secure_computing+0xa9/0x120 Aug 22 08:58:34 juju-e4d256-prod-github-runner-207 kernel: [12888.610017] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 08:58:34 juju-e4d256-prod-github-runner-207 kernel: [12888.610787] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:58:34 juju-e4d256-prod-github-runner-207 kernel: [12888.611508] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:58:34 juju-e4d256-prod-github-runner-207 kernel: [12888.612241] ? do_syscall_64+0x69/0xc0 Aug 22 08:58:34 juju-e4d256-prod-github-runner-207 kernel: [12888.612889] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:58:34 juju-e4d256-prod-github-runner-207 kernel: [12888.613597] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:58:34 juju-e4d256-prod-github-runner-207 kernel: [12888.614302] ? do_syscall_64+0x69/0xc0 Aug 22 08:58:34 juju-e4d256-prod-github-runner-207 kernel: [12888.614926] ? do_syscall_64+0x69/0xc0 Aug 22 08:58:34 juju-e4d256-prod-github-runner-207 kernel: [12888.615553] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 08:58:34 juju-e4d256-prod-github-runner-207 kernel: [12888.616285] RIP: 0033:0x7faa5d0edaff Aug 22 08:58:34 juju-e4d256-prod-github-runner-207 kernel: [12888.617006] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 08:58:34 juju-e4d256-prod-github-runner-207 kernel: [12888.619135] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 08:58:34 juju-e4d256-prod-github-runner-207 kernel: [12888.620051] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 08:58:34 juju-e4d256-prod-github-runner-207 kernel: [12888.620959] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 08:58:34 juju-e4d256-prod-github-runner-207 kernel: [12888.621855] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 08:58:34 juju-e4d256-prod-github-runner-207 kernel: [12888.622769] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 08:58:34 juju-e4d256-prod-github-runner-207 kernel: [12888.623655] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 08:58:34 juju-e4d256-prod-github-runner-207 kernel: [12888.624559] Aug 22 08:59:02 juju-e4d256-prod-github-runner-207 kernel: [12916.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 11921s! [qemu-system-x86:6715] Aug 22 08:59:02 juju-e4d256-prod-github-runner-207 kernel: [12916.543864] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 08:59:02 juju-e4d256-prod-github-runner-207 kernel: [12916.544145] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 08:59:02 juju-e4d256-prod-github-runner-207 kernel: [12916.556244] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 08:59:02 juju-e4d256-prod-github-runner-207 kernel: [12916.557516] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 08:59:02 juju-e4d256-prod-github-runner-207 kernel: [12916.558769] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:59:02 juju-e4d256-prod-github-runner-207 kernel: [12916.559834] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 08:59:02 juju-e4d256-prod-github-runner-207 kernel: [12916.562393] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 08:59:02 juju-e4d256-prod-github-runner-207 kernel: [12916.563441] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 08:59:02 juju-e4d256-prod-github-runner-207 kernel: [12916.564608] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 08:59:02 juju-e4d256-prod-github-runner-207 kernel: [12916.565764] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 08:59:02 juju-e4d256-prod-github-runner-207 kernel: [12916.566940] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 08:59:02 juju-e4d256-prod-github-runner-207 kernel: [12916.568114] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 08:59:02 juju-e4d256-prod-github-runner-207 kernel: [12916.569281] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 08:59:02 juju-e4d256-prod-github-runner-207 kernel: [12916.570536] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 08:59:02 juju-e4d256-prod-github-runner-207 kernel: [12916.571640] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 08:59:02 juju-e4d256-prod-github-runner-207 kernel: [12916.572833] Call Trace: Aug 22 08:59:02 juju-e4d256-prod-github-runner-207 kernel: [12916.573796] Aug 22 08:59:02 juju-e4d256-prod-github-runner-207 kernel: [12916.574706] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:59:02 juju-e4d256-prod-github-runner-207 kernel: [12916.575748] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:59:02 juju-e4d256-prod-github-runner-207 kernel: [12916.576772] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:59:02 juju-e4d256-prod-github-runner-207 kernel: [12916.577900] ? show_regs.part.0+0x23/0x29 Aug 22 08:59:02 juju-e4d256-prod-github-runner-207 kernel: [12916.578908] ? show_regs.cold+0x8/0xd Aug 22 08:59:02 juju-e4d256-prod-github-runner-207 kernel: [12916.579878] ? watchdog_timer_fn+0x1be/0x220 Aug 22 08:59:02 juju-e4d256-prod-github-runner-207 kernel: [12916.580883] ? lockup_detector_update_enable+0x60/0x60 Aug 22 08:59:02 juju-e4d256-prod-github-runner-207 kernel: [12916.581966] ? __hrtimer_run_queues+0x107/0x230 Aug 22 08:59:02 juju-e4d256-prod-github-runner-207 kernel: [12916.583000] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 08:59:02 juju-e4d256-prod-github-runner-207 kernel: [12916.584022] ? hrtimer_interrupt+0x101/0x220 Aug 22 08:59:02 juju-e4d256-prod-github-runner-207 kernel: [12916.585037] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 08:59:02 juju-e4d256-prod-github-runner-207 kernel: [12916.586115] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 08:59:02 juju-e4d256-prod-github-runner-207 kernel: [12916.587181] Aug 22 08:59:02 juju-e4d256-prod-github-runner-207 kernel: [12916.588034] Aug 22 08:59:02 juju-e4d256-prod-github-runner-207 kernel: [12916.588874] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 08:59:02 juju-e4d256-prod-github-runner-207 kernel: [12916.589917] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:59:02 juju-e4d256-prod-github-runner-207 kernel: [12916.590955] ? _raw_spin_lock+0x22/0x30 Aug 22 08:59:02 juju-e4d256-prod-github-runner-207 kernel: [12916.591994] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:59:02 juju-e4d256-prod-github-runner-207 kernel: [12916.593017] direct_page_fault+0x206/0x310 [kvm] Aug 22 08:59:02 juju-e4d256-prod-github-runner-207 kernel: [12916.594055] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 08:59:02 juju-e4d256-prod-github-runner-207 kernel: [12916.595063] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 08:59:02 juju-e4d256-prod-github-runner-207 kernel: [12916.596063] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 08:59:02 juju-e4d256-prod-github-runner-207 kernel: [12916.597056] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 08:59:02 juju-e4d256-prod-github-runner-207 kernel: [12916.598045] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 08:59:02 juju-e4d256-prod-github-runner-207 kernel: [12916.599024] handle_exit+0x98/0x230 [kvm_amd] Aug 22 08:59:02 juju-e4d256-prod-github-runner-207 kernel: [12916.599916] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 08:59:02 juju-e4d256-prod-github-runner-207 kernel: [12916.600833] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 08:59:02 juju-e4d256-prod-github-runner-207 kernel: [12916.601755] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 08:59:02 juju-e4d256-prod-github-runner-207 kernel: [12916.602680] vcpu_run+0x62/0x2c0 [kvm] Aug 22 08:59:02 juju-e4d256-prod-github-runner-207 kernel: [12916.603496] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 08:59:02 juju-e4d256-prod-github-runner-207 kernel: [12916.604301] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 08:59:02 juju-e4d256-prod-github-runner-207 kernel: [12916.605154] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 08:59:02 juju-e4d256-prod-github-runner-207 kernel: [12916.605959] ? __seccomp_filter+0x4a/0x4a0 Aug 22 08:59:02 juju-e4d256-prod-github-runner-207 kernel: [12916.606698] ? __fget_files+0x86/0xc0 Aug 22 08:59:02 juju-e4d256-prod-github-runner-207 kernel: [12916.607402] __x64_sys_ioctl+0x95/0xd0 Aug 22 08:59:02 juju-e4d256-prod-github-runner-207 kernel: [12916.608092] do_syscall_64+0x5c/0xc0 Aug 22 08:59:02 juju-e4d256-prod-github-runner-207 kernel: [12916.608760] ? do_futex+0x162/0x1f0 Aug 22 08:59:02 juju-e4d256-prod-github-runner-207 kernel: [12916.609413] ? __x64_sys_futex+0x78/0x1e0 Aug 22 08:59:02 juju-e4d256-prod-github-runner-207 kernel: [12916.610102] ? __secure_computing+0xa9/0x120 Aug 22 08:59:02 juju-e4d256-prod-github-runner-207 kernel: [12916.610790] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 08:59:02 juju-e4d256-prod-github-runner-207 kernel: [12916.611557] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:59:02 juju-e4d256-prod-github-runner-207 kernel: [12916.612277] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:59:02 juju-e4d256-prod-github-runner-207 kernel: [12916.612994] ? do_syscall_64+0x69/0xc0 Aug 22 08:59:02 juju-e4d256-prod-github-runner-207 kernel: [12916.613636] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:59:02 juju-e4d256-prod-github-runner-207 kernel: [12916.614351] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:59:02 juju-e4d256-prod-github-runner-207 kernel: [12916.615046] ? do_syscall_64+0x69/0xc0 Aug 22 08:59:02 juju-e4d256-prod-github-runner-207 kernel: [12916.615667] ? do_syscall_64+0x69/0xc0 Aug 22 08:59:02 juju-e4d256-prod-github-runner-207 kernel: [12916.616288] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 08:59:02 juju-e4d256-prod-github-runner-207 kernel: [12916.617015] RIP: 0033:0x7faa5d0edaff Aug 22 08:59:02 juju-e4d256-prod-github-runner-207 kernel: [12916.617697] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 08:59:02 juju-e4d256-prod-github-runner-207 kernel: [12916.619703] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 08:59:02 juju-e4d256-prod-github-runner-207 kernel: [12916.620612] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 08:59:02 juju-e4d256-prod-github-runner-207 kernel: [12916.621505] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 08:59:02 juju-e4d256-prod-github-runner-207 kernel: [12916.622406] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 08:59:02 juju-e4d256-prod-github-runner-207 kernel: [12916.623298] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 08:59:02 juju-e4d256-prod-github-runner-207 kernel: [12916.624182] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 08:59:02 juju-e4d256-prod-github-runner-207 kernel: [12916.625076] Aug 22 08:59:30 juju-e4d256-prod-github-runner-207 kernel: [12944.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 11947s! [qemu-system-x86:6715] Aug 22 08:59:30 juju-e4d256-prod-github-runner-207 kernel: [12944.543109] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 08:59:30 juju-e4d256-prod-github-runner-207 kernel: [12944.543185] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 08:59:30 juju-e4d256-prod-github-runner-207 kernel: [12944.556351] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 08:59:30 juju-e4d256-prod-github-runner-207 kernel: [12944.557647] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 08:59:30 juju-e4d256-prod-github-runner-207 kernel: [12944.558881] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:59:30 juju-e4d256-prod-github-runner-207 kernel: [12944.560020] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 08:59:30 juju-e4d256-prod-github-runner-207 kernel: [12944.562731] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 08:59:30 juju-e4d256-prod-github-runner-207 kernel: [12944.563778] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 08:59:30 juju-e4d256-prod-github-runner-207 kernel: [12944.565019] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 08:59:30 juju-e4d256-prod-github-runner-207 kernel: [12944.566639] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 08:59:30 juju-e4d256-prod-github-runner-207 kernel: [12944.567837] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 08:59:30 juju-e4d256-prod-github-runner-207 kernel: [12944.569022] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 08:59:30 juju-e4d256-prod-github-runner-207 kernel: [12944.570230] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 08:59:30 juju-e4d256-prod-github-runner-207 kernel: [12944.571471] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 08:59:30 juju-e4d256-prod-github-runner-207 kernel: [12944.572596] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 08:59:30 juju-e4d256-prod-github-runner-207 kernel: [12944.573832] Call Trace: Aug 22 08:59:30 juju-e4d256-prod-github-runner-207 kernel: [12944.574817] Aug 22 08:59:30 juju-e4d256-prod-github-runner-207 kernel: [12944.575715] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:59:30 juju-e4d256-prod-github-runner-207 kernel: [12944.576771] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 08:59:30 juju-e4d256-prod-github-runner-207 kernel: [12944.577835] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:59:30 juju-e4d256-prod-github-runner-207 kernel: [12944.578956] ? show_regs.part.0+0x23/0x29 Aug 22 08:59:30 juju-e4d256-prod-github-runner-207 kernel: [12944.579972] ? show_regs.cold+0x8/0xd Aug 22 08:59:30 juju-e4d256-prod-github-runner-207 kernel: [12944.580962] ? watchdog_timer_fn+0x1be/0x220 Aug 22 08:59:30 juju-e4d256-prod-github-runner-207 kernel: [12944.581995] ? lockup_detector_update_enable+0x60/0x60 Aug 22 08:59:30 juju-e4d256-prod-github-runner-207 kernel: [12944.583079] ? __hrtimer_run_queues+0x107/0x230 Aug 22 08:59:30 juju-e4d256-prod-github-runner-207 kernel: [12944.584122] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 08:59:30 juju-e4d256-prod-github-runner-207 kernel: [12944.585204] ? hrtimer_interrupt+0x101/0x220 Aug 22 08:59:30 juju-e4d256-prod-github-runner-207 kernel: [12944.586253] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 08:59:30 juju-e4d256-prod-github-runner-207 kernel: [12944.587351] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 08:59:30 juju-e4d256-prod-github-runner-207 kernel: [12944.588427] Aug 22 08:59:30 juju-e4d256-prod-github-runner-207 kernel: [12944.589286] Aug 22 08:59:30 juju-e4d256-prod-github-runner-207 kernel: [12944.590176] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 08:59:30 juju-e4d256-prod-github-runner-207 kernel: [12944.591224] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:59:30 juju-e4d256-prod-github-runner-207 kernel: [12944.592277] ? _raw_spin_lock+0x22/0x30 Aug 22 08:59:30 juju-e4d256-prod-github-runner-207 kernel: [12944.593248] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:59:30 juju-e4d256-prod-github-runner-207 kernel: [12944.594301] direct_page_fault+0x206/0x310 [kvm] Aug 22 08:59:30 juju-e4d256-prod-github-runner-207 kernel: [12944.595351] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 08:59:30 juju-e4d256-prod-github-runner-207 kernel: [12944.596370] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 08:59:30 juju-e4d256-prod-github-runner-207 kernel: [12944.597378] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 08:59:30 juju-e4d256-prod-github-runner-207 kernel: [12944.598387] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 08:59:30 juju-e4d256-prod-github-runner-207 kernel: [12944.599348] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 08:59:30 juju-e4d256-prod-github-runner-207 kernel: [12944.600347] handle_exit+0x98/0x230 [kvm_amd] Aug 22 08:59:30 juju-e4d256-prod-github-runner-207 kernel: [12944.601250] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 08:59:30 juju-e4d256-prod-github-runner-207 kernel: [12944.602183] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 08:59:30 juju-e4d256-prod-github-runner-207 kernel: [12944.603243] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 08:59:30 juju-e4d256-prod-github-runner-207 kernel: [12944.604172] vcpu_run+0x62/0x2c0 [kvm] Aug 22 08:59:30 juju-e4d256-prod-github-runner-207 kernel: [12944.604987] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 08:59:30 juju-e4d256-prod-github-runner-207 kernel: [12944.605838] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 08:59:30 juju-e4d256-prod-github-runner-207 kernel: [12944.606695] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 08:59:30 juju-e4d256-prod-github-runner-207 kernel: [12944.607500] ? __seccomp_filter+0x4a/0x4a0 Aug 22 08:59:30 juju-e4d256-prod-github-runner-207 kernel: [12944.608273] ? __fget_files+0x86/0xc0 Aug 22 08:59:30 juju-e4d256-prod-github-runner-207 kernel: [12944.608998] __x64_sys_ioctl+0x95/0xd0 Aug 22 08:59:30 juju-e4d256-prod-github-runner-207 kernel: [12944.609724] do_syscall_64+0x5c/0xc0 Aug 22 08:59:30 juju-e4d256-prod-github-runner-207 kernel: [12944.610408] ? do_futex+0x162/0x1f0 Aug 22 08:59:30 juju-e4d256-prod-github-runner-207 kernel: [12944.611066] ? __x64_sys_futex+0x78/0x1e0 Aug 22 08:59:30 juju-e4d256-prod-github-runner-207 kernel: [12944.611738] ? __secure_computing+0xa9/0x120 Aug 22 08:59:30 juju-e4d256-prod-github-runner-207 kernel: [12944.612427] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 08:59:30 juju-e4d256-prod-github-runner-207 kernel: [12944.613204] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:59:30 juju-e4d256-prod-github-runner-207 kernel: [12944.613945] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:59:30 juju-e4d256-prod-github-runner-207 kernel: [12944.614674] ? do_syscall_64+0x69/0xc0 Aug 22 08:59:30 juju-e4d256-prod-github-runner-207 kernel: [12944.615353] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:59:30 juju-e4d256-prod-github-runner-207 kernel: [12944.616072] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:59:30 juju-e4d256-prod-github-runner-207 kernel: [12944.616766] ? do_syscall_64+0x69/0xc0 Aug 22 08:59:30 juju-e4d256-prod-github-runner-207 kernel: [12944.617392] ? do_syscall_64+0x69/0xc0 Aug 22 08:59:30 juju-e4d256-prod-github-runner-207 kernel: [12944.618028] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 08:59:30 juju-e4d256-prod-github-runner-207 kernel: [12944.618762] RIP: 0033:0x7faa5d0edaff Aug 22 08:59:30 juju-e4d256-prod-github-runner-207 kernel: [12944.619404] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 08:59:30 juju-e4d256-prod-github-runner-207 kernel: [12944.621422] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 08:59:30 juju-e4d256-prod-github-runner-207 kernel: [12944.622344] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 08:59:30 juju-e4d256-prod-github-runner-207 kernel: [12944.623232] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 08:59:30 juju-e4d256-prod-github-runner-207 kernel: [12944.624134] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 08:59:30 juju-e4d256-prod-github-runner-207 kernel: [12944.625030] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 08:59:30 juju-e4d256-prod-github-runner-207 kernel: [12944.625953] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 08:59:30 juju-e4d256-prod-github-runner-207 kernel: [12944.626858] Aug 22 08:59:44 juju-e4d256-prod-github-runner-207 kernel: [12958.052706] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 08:59:44 juju-e4d256-prod-github-runner-207 kernel: [12958.053693] rcu: 1-....: (3200167 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=1546276 Aug 22 08:59:44 juju-e4d256-prod-github-runner-207 kernel: [12958.054843] (t=3210213 jiffies g=23269 q=20814) Aug 22 08:59:44 juju-e4d256-prod-github-runner-207 kernel: [12958.055643] NMI backtrace for cpu 1 Aug 22 08:59:44 juju-e4d256-prod-github-runner-207 kernel: [12958.056358] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 08:59:44 juju-e4d256-prod-github-runner-207 kernel: [12958.057494] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 08:59:44 juju-e4d256-prod-github-runner-207 kernel: [12958.058579] Call Trace: Aug 22 08:59:44 juju-e4d256-prod-github-runner-207 kernel: [12958.059284] Aug 22 08:59:44 juju-e4d256-prod-github-runner-207 kernel: [12958.059929] show_stack+0x52/0x5c Aug 22 08:59:44 juju-e4d256-prod-github-runner-207 kernel: [12958.060652] dump_stack_lvl+0x4a/0x63 Aug 22 08:59:44 juju-e4d256-prod-github-runner-207 kernel: [12958.061419] dump_stack+0x10/0x16 Aug 22 08:59:44 juju-e4d256-prod-github-runner-207 kernel: [12958.062135] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 08:59:44 juju-e4d256-prod-github-runner-207 kernel: [12958.062920] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 08:59:44 juju-e4d256-prod-github-runner-207 kernel: [12958.063697] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 08:59:44 juju-e4d256-prod-github-runner-207 kernel: [12958.064518] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 08:59:44 juju-e4d256-prod-github-runner-207 kernel: [12958.065347] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 08:59:44 juju-e4d256-prod-github-runner-207 kernel: [12958.066154] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 08:59:44 juju-e4d256-prod-github-runner-207 kernel: [12958.066927] print_cpu_stall.cold+0x2f/0xe2 Aug 22 08:59:44 juju-e4d256-prod-github-runner-207 kernel: [12958.067694] ? timekeeping_update+0xf7/0x150 Aug 22 08:59:44 juju-e4d256-prod-github-runner-207 kernel: [12958.068469] check_cpu_stall+0x109/0x270 Aug 22 08:59:44 juju-e4d256-prod-github-runner-207 kernel: [12958.069216] rcu_sched_clock_irq+0x9a/0x250 Aug 22 08:59:44 juju-e4d256-prod-github-runner-207 kernel: [12958.069994] update_process_times+0x94/0xd0 Aug 22 08:59:44 juju-e4d256-prod-github-runner-207 kernel: [12958.070750] tick_sched_handle+0x29/0x70 Aug 22 08:59:44 juju-e4d256-prod-github-runner-207 kernel: [12958.071503] tick_sched_timer+0x8c/0xc0 Aug 22 08:59:44 juju-e4d256-prod-github-runner-207 kernel: [12958.072240] ? tick_nohz_handler+0xb0/0xb0 Aug 22 08:59:44 juju-e4d256-prod-github-runner-207 kernel: [12958.072994] __hrtimer_run_queues+0x107/0x230 Aug 22 08:59:44 juju-e4d256-prod-github-runner-207 kernel: [12958.073772] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 08:59:44 juju-e4d256-prod-github-runner-207 kernel: [12958.074551] hrtimer_interrupt+0x101/0x220 Aug 22 08:59:44 juju-e4d256-prod-github-runner-207 kernel: [12958.075311] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 08:59:44 juju-e4d256-prod-github-runner-207 kernel: [12958.076125] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 08:59:44 juju-e4d256-prod-github-runner-207 kernel: [12958.076923] Aug 22 08:59:44 juju-e4d256-prod-github-runner-207 kernel: [12958.077565] Aug 22 08:59:44 juju-e4d256-prod-github-runner-207 kernel: [12958.078192] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 08:59:44 juju-e4d256-prod-github-runner-207 kernel: [12958.079017] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 08:59:44 juju-e4d256-prod-github-runner-207 kernel: [12958.079897] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 08:59:44 juju-e4d256-prod-github-runner-207 kernel: [12958.082102] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 08:59:44 juju-e4d256-prod-github-runner-207 kernel: [12958.083010] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 08:59:44 juju-e4d256-prod-github-runner-207 kernel: [12958.084028] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 08:59:44 juju-e4d256-prod-github-runner-207 kernel: [12958.085004] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 08:59:44 juju-e4d256-prod-github-runner-207 kernel: [12958.085989] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 08:59:44 juju-e4d256-prod-github-runner-207 kernel: [12958.086953] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 08:59:44 juju-e4d256-prod-github-runner-207 kernel: [12958.087913] ? _raw_spin_lock+0x22/0x30 Aug 22 08:59:44 juju-e4d256-prod-github-runner-207 kernel: [12958.088675] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 08:59:44 juju-e4d256-prod-github-runner-207 kernel: [12958.089531] direct_page_fault+0x206/0x310 [kvm] Aug 22 08:59:44 juju-e4d256-prod-github-runner-207 kernel: [12958.090368] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 08:59:44 juju-e4d256-prod-github-runner-207 kernel: [12958.091191] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 08:59:44 juju-e4d256-prod-github-runner-207 kernel: [12958.092011] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 08:59:44 juju-e4d256-prod-github-runner-207 kernel: [12958.092816] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 08:59:44 juju-e4d256-prod-github-runner-207 kernel: [12958.093640] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 08:59:44 juju-e4d256-prod-github-runner-207 kernel: [12958.094462] handle_exit+0x98/0x230 [kvm_amd] Aug 22 08:59:44 juju-e4d256-prod-github-runner-207 kernel: [12958.095212] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 08:59:44 juju-e4d256-prod-github-runner-207 kernel: [12958.095993] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 08:59:44 juju-e4d256-prod-github-runner-207 kernel: [12958.096788] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 08:59:44 juju-e4d256-prod-github-runner-207 kernel: [12958.097588] vcpu_run+0x62/0x2c0 [kvm] Aug 22 08:59:44 juju-e4d256-prod-github-runner-207 kernel: [12958.098302] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 08:59:44 juju-e4d256-prod-github-runner-207 kernel: [12958.099037] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 08:59:44 juju-e4d256-prod-github-runner-207 kernel: [12958.099859] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 08:59:44 juju-e4d256-prod-github-runner-207 kernel: [12958.100620] ? __seccomp_filter+0x4a/0x4a0 Aug 22 08:59:44 juju-e4d256-prod-github-runner-207 kernel: [12958.101347] ? __fget_files+0x86/0xc0 Aug 22 08:59:44 juju-e4d256-prod-github-runner-207 kernel: [12958.102039] __x64_sys_ioctl+0x95/0xd0 Aug 22 08:59:44 juju-e4d256-prod-github-runner-207 kernel: [12958.102732] do_syscall_64+0x5c/0xc0 Aug 22 08:59:44 juju-e4d256-prod-github-runner-207 kernel: [12958.103450] ? do_futex+0x162/0x1f0 Aug 22 08:59:44 juju-e4d256-prod-github-runner-207 kernel: [12958.104135] ? __x64_sys_futex+0x78/0x1e0 Aug 22 08:59:44 juju-e4d256-prod-github-runner-207 kernel: [12958.104850] ? __secure_computing+0xa9/0x120 Aug 22 08:59:44 juju-e4d256-prod-github-runner-207 kernel: [12958.105595] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 08:59:44 juju-e4d256-prod-github-runner-207 kernel: [12958.106402] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:59:44 juju-e4d256-prod-github-runner-207 kernel: [12958.107160] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:59:44 juju-e4d256-prod-github-runner-207 kernel: [12958.107927] ? do_syscall_64+0x69/0xc0 Aug 22 08:59:44 juju-e4d256-prod-github-runner-207 kernel: [12958.108617] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 08:59:44 juju-e4d256-prod-github-runner-207 kernel: [12958.109403] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 08:59:44 juju-e4d256-prod-github-runner-207 kernel: [12958.110162] ? do_syscall_64+0x69/0xc0 Aug 22 08:59:44 juju-e4d256-prod-github-runner-207 kernel: [12958.110854] ? do_syscall_64+0x69/0xc0 Aug 22 08:59:44 juju-e4d256-prod-github-runner-207 kernel: [12958.111544] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 08:59:44 juju-e4d256-prod-github-runner-207 kernel: [12958.112313] RIP: 0033:0x7faa5d0edaff Aug 22 08:59:44 juju-e4d256-prod-github-runner-207 kernel: [12958.112998] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 08:59:44 juju-e4d256-prod-github-runner-207 kernel: [12958.115119] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 08:59:44 juju-e4d256-prod-github-runner-207 kernel: [12958.116084] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 08:59:44 juju-e4d256-prod-github-runner-207 kernel: [12958.117094] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 08:59:44 juju-e4d256-prod-github-runner-207 kernel: [12958.118128] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 08:59:44 juju-e4d256-prod-github-runner-207 kernel: [12958.119156] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 08:59:44 juju-e4d256-prod-github-runner-207 kernel: [12958.120104] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 08:59:44 juju-e4d256-prod-github-runner-207 kernel: [12958.121062] Aug 22 09:00:10 juju-e4d256-prod-github-runner-207 kernel: [12984.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 11984s! [qemu-system-x86:6715] Aug 22 09:00:10 juju-e4d256-prod-github-runner-207 kernel: [12984.543191] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 09:00:10 juju-e4d256-prod-github-runner-207 kernel: [12984.543268] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 09:00:10 juju-e4d256-prod-github-runner-207 kernel: [12984.556057] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 09:00:10 juju-e4d256-prod-github-runner-207 kernel: [12984.557371] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 09:00:10 juju-e4d256-prod-github-runner-207 kernel: [12984.558636] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:00:10 juju-e4d256-prod-github-runner-207 kernel: [12984.559706] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 09:00:10 juju-e4d256-prod-github-runner-207 kernel: [12984.562578] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 09:00:10 juju-e4d256-prod-github-runner-207 kernel: [12984.563647] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 09:00:10 juju-e4d256-prod-github-runner-207 kernel: [12984.564829] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 09:00:10 juju-e4d256-prod-github-runner-207 kernel: [12984.566036] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 09:00:10 juju-e4d256-prod-github-runner-207 kernel: [12984.567297] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 09:00:10 juju-e4d256-prod-github-runner-207 kernel: [12984.568521] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 09:00:10 juju-e4d256-prod-github-runner-207 kernel: [12984.569740] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 09:00:10 juju-e4d256-prod-github-runner-207 kernel: [12984.571028] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 09:00:10 juju-e4d256-prod-github-runner-207 kernel: [12984.572178] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 09:00:10 juju-e4d256-prod-github-runner-207 kernel: [12984.573422] Call Trace: Aug 22 09:00:10 juju-e4d256-prod-github-runner-207 kernel: [12984.574341] Aug 22 09:00:10 juju-e4d256-prod-github-runner-207 kernel: [12984.575227] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:00:10 juju-e4d256-prod-github-runner-207 kernel: [12984.576355] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:00:10 juju-e4d256-prod-github-runner-207 kernel: [12984.577503] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:00:10 juju-e4d256-prod-github-runner-207 kernel: [12984.578715] ? show_regs.part.0+0x23/0x29 Aug 22 09:00:10 juju-e4d256-prod-github-runner-207 kernel: [12984.579744] ? show_regs.cold+0x8/0xd Aug 22 09:00:10 juju-e4d256-prod-github-runner-207 kernel: [12984.580765] ? watchdog_timer_fn+0x1be/0x220 Aug 22 09:00:10 juju-e4d256-prod-github-runner-207 kernel: [12984.581897] ? lockup_detector_update_enable+0x60/0x60 Aug 22 09:00:10 juju-e4d256-prod-github-runner-207 kernel: [12984.583081] ? __hrtimer_run_queues+0x107/0x230 Aug 22 09:00:10 juju-e4d256-prod-github-runner-207 kernel: [12984.584246] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 09:00:10 juju-e4d256-prod-github-runner-207 kernel: [12984.585375] ? hrtimer_interrupt+0x101/0x220 Aug 22 09:00:10 juju-e4d256-prod-github-runner-207 kernel: [12984.586448] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 09:00:10 juju-e4d256-prod-github-runner-207 kernel: [12984.587610] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 09:00:10 juju-e4d256-prod-github-runner-207 kernel: [12984.588838] Aug 22 09:00:10 juju-e4d256-prod-github-runner-207 kernel: [12984.589747] Aug 22 09:00:10 juju-e4d256-prod-github-runner-207 kernel: [12984.590615] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 09:00:10 juju-e4d256-prod-github-runner-207 kernel: [12984.591805] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:00:10 juju-e4d256-prod-github-runner-207 kernel: [12984.592919] ? _raw_spin_lock+0x22/0x30 Aug 22 09:00:10 juju-e4d256-prod-github-runner-207 kernel: [12984.594037] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:00:10 juju-e4d256-prod-github-runner-207 kernel: [12984.595197] direct_page_fault+0x206/0x310 [kvm] Aug 22 09:00:10 juju-e4d256-prod-github-runner-207 kernel: [12984.596291] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 09:00:10 juju-e4d256-prod-github-runner-207 kernel: [12984.597461] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 09:00:10 juju-e4d256-prod-github-runner-207 kernel: [12984.598523] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 09:00:10 juju-e4d256-prod-github-runner-207 kernel: [12984.599632] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 09:00:10 juju-e4d256-prod-github-runner-207 kernel: [12984.600637] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 09:00:10 juju-e4d256-prod-github-runner-207 kernel: [12984.601764] handle_exit+0x98/0x230 [kvm_amd] Aug 22 09:00:10 juju-e4d256-prod-github-runner-207 kernel: [12984.602754] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 09:00:10 juju-e4d256-prod-github-runner-207 kernel: [12984.603779] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 09:00:10 juju-e4d256-prod-github-runner-207 kernel: [12984.604845] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 09:00:10 juju-e4d256-prod-github-runner-207 kernel: [12984.605827] vcpu_run+0x62/0x2c0 [kvm] Aug 22 09:00:10 juju-e4d256-prod-github-runner-207 kernel: [12984.606657] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 09:00:10 juju-e4d256-prod-github-runner-207 kernel: [12984.607531] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 09:00:10 juju-e4d256-prod-github-runner-207 kernel: [12984.608421] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 09:00:10 juju-e4d256-prod-github-runner-207 kernel: [12984.609279] ? __seccomp_filter+0x4a/0x4a0 Aug 22 09:00:10 juju-e4d256-prod-github-runner-207 kernel: [12984.610094] ? __fget_files+0x86/0xc0 Aug 22 09:00:10 juju-e4d256-prod-github-runner-207 kernel: [12984.610846] __x64_sys_ioctl+0x95/0xd0 Aug 22 09:00:10 juju-e4d256-prod-github-runner-207 kernel: [12984.611600] do_syscall_64+0x5c/0xc0 Aug 22 09:00:10 juju-e4d256-prod-github-runner-207 kernel: [12984.612341] ? do_futex+0x162/0x1f0 Aug 22 09:00:10 juju-e4d256-prod-github-runner-207 kernel: [12984.613096] ? __x64_sys_futex+0x78/0x1e0 Aug 22 09:00:10 juju-e4d256-prod-github-runner-207 kernel: [12984.613799] ? __secure_computing+0xa9/0x120 Aug 22 09:00:10 juju-e4d256-prod-github-runner-207 kernel: [12984.614608] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 09:00:10 juju-e4d256-prod-github-runner-207 kernel: [12984.615463] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:00:10 juju-e4d256-prod-github-runner-207 kernel: [12984.616220] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:00:10 juju-e4d256-prod-github-runner-207 kernel: [12984.616954] ? do_syscall_64+0x69/0xc0 Aug 22 09:00:10 juju-e4d256-prod-github-runner-207 kernel: [12984.617681] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:00:10 juju-e4d256-prod-github-runner-207 kernel: [12984.618459] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:00:10 juju-e4d256-prod-github-runner-207 kernel: [12984.619205] ? do_syscall_64+0x69/0xc0 Aug 22 09:00:10 juju-e4d256-prod-github-runner-207 kernel: [12984.619845] ? do_syscall_64+0x69/0xc0 Aug 22 09:00:10 juju-e4d256-prod-github-runner-207 kernel: [12984.620505] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 09:00:10 juju-e4d256-prod-github-runner-207 kernel: [12984.621318] RIP: 0033:0x7faa5d0edaff Aug 22 09:00:10 juju-e4d256-prod-github-runner-207 kernel: [12984.621962] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 09:00:10 juju-e4d256-prod-github-runner-207 kernel: [12984.624017] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 09:00:10 juju-e4d256-prod-github-runner-207 kernel: [12984.624959] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 09:00:10 juju-e4d256-prod-github-runner-207 kernel: [12984.625941] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 09:00:10 juju-e4d256-prod-github-runner-207 kernel: [12984.626870] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 09:00:10 juju-e4d256-prod-github-runner-207 kernel: [12984.627817] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 09:00:10 juju-e4d256-prod-github-runner-207 kernel: [12984.628749] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 09:00:10 juju-e4d256-prod-github-runner-207 kernel: [12984.629699] Aug 22 09:00:38 juju-e4d256-prod-github-runner-207 kernel: [13012.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 12010s! [qemu-system-x86:6715] Aug 22 09:00:38 juju-e4d256-prod-github-runner-207 kernel: [13012.543920] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 09:00:38 juju-e4d256-prod-github-runner-207 kernel: [13012.544238] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 09:00:38 juju-e4d256-prod-github-runner-207 kernel: [13012.556625] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 09:00:38 juju-e4d256-prod-github-runner-207 kernel: [13012.557929] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 09:00:38 juju-e4d256-prod-github-runner-207 kernel: [13012.559174] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:00:38 juju-e4d256-prod-github-runner-207 kernel: [13012.560271] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 09:00:38 juju-e4d256-prod-github-runner-207 kernel: [13012.563003] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 09:00:38 juju-e4d256-prod-github-runner-207 kernel: [13012.564095] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 09:00:38 juju-e4d256-prod-github-runner-207 kernel: [13012.565318] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 09:00:38 juju-e4d256-prod-github-runner-207 kernel: [13012.566507] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 09:00:38 juju-e4d256-prod-github-runner-207 kernel: [13012.567712] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 09:00:38 juju-e4d256-prod-github-runner-207 kernel: [13012.568907] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 09:00:38 juju-e4d256-prod-github-runner-207 kernel: [13012.570092] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 09:00:38 juju-e4d256-prod-github-runner-207 kernel: [13012.571349] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 09:00:38 juju-e4d256-prod-github-runner-207 kernel: [13012.572471] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 09:00:38 juju-e4d256-prod-github-runner-207 kernel: [13012.573883] Call Trace: Aug 22 09:00:38 juju-e4d256-prod-github-runner-207 kernel: [13012.574798] Aug 22 09:00:38 juju-e4d256-prod-github-runner-207 kernel: [13012.575712] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:00:38 juju-e4d256-prod-github-runner-207 kernel: [13012.576778] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:00:38 juju-e4d256-prod-github-runner-207 kernel: [13012.577818] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:00:38 juju-e4d256-prod-github-runner-207 kernel: [13012.578934] ? show_regs.part.0+0x23/0x29 Aug 22 09:00:38 juju-e4d256-prod-github-runner-207 kernel: [13012.579948] ? show_regs.cold+0x8/0xd Aug 22 09:00:38 juju-e4d256-prod-github-runner-207 kernel: [13012.580944] ? watchdog_timer_fn+0x1be/0x220 Aug 22 09:00:38 juju-e4d256-prod-github-runner-207 kernel: [13012.581966] ? lockup_detector_update_enable+0x60/0x60 Aug 22 09:00:38 juju-e4d256-prod-github-runner-207 kernel: [13012.583046] ? __hrtimer_run_queues+0x107/0x230 Aug 22 09:00:38 juju-e4d256-prod-github-runner-207 kernel: [13012.584113] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 09:00:38 juju-e4d256-prod-github-runner-207 kernel: [13012.585205] ? hrtimer_interrupt+0x101/0x220 Aug 22 09:00:38 juju-e4d256-prod-github-runner-207 kernel: [13012.586242] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 09:00:38 juju-e4d256-prod-github-runner-207 kernel: [13012.587338] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 09:00:38 juju-e4d256-prod-github-runner-207 kernel: [13012.588407] Aug 22 09:00:38 juju-e4d256-prod-github-runner-207 kernel: [13012.589289] Aug 22 09:00:38 juju-e4d256-prod-github-runner-207 kernel: [13012.590147] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 09:00:38 juju-e4d256-prod-github-runner-207 kernel: [13012.591200] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:00:38 juju-e4d256-prod-github-runner-207 kernel: [13012.592355] ? _raw_spin_lock+0x22/0x30 Aug 22 09:00:38 juju-e4d256-prod-github-runner-207 kernel: [13012.593358] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:00:38 juju-e4d256-prod-github-runner-207 kernel: [13012.594429] direct_page_fault+0x206/0x310 [kvm] Aug 22 09:00:38 juju-e4d256-prod-github-runner-207 kernel: [13012.595478] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 09:00:38 juju-e4d256-prod-github-runner-207 kernel: [13012.596497] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 09:00:38 juju-e4d256-prod-github-runner-207 kernel: [13012.597520] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 09:00:38 juju-e4d256-prod-github-runner-207 kernel: [13012.598539] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 09:00:38 juju-e4d256-prod-github-runner-207 kernel: [13012.599483] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 09:00:38 juju-e4d256-prod-github-runner-207 kernel: [13012.600458] handle_exit+0x98/0x230 [kvm_amd] Aug 22 09:00:38 juju-e4d256-prod-github-runner-207 kernel: [13012.601366] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 09:00:38 juju-e4d256-prod-github-runner-207 kernel: [13012.602284] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 09:00:38 juju-e4d256-prod-github-runner-207 kernel: [13012.603212] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 09:00:38 juju-e4d256-prod-github-runner-207 kernel: [13012.604115] vcpu_run+0x62/0x2c0 [kvm] Aug 22 09:00:38 juju-e4d256-prod-github-runner-207 kernel: [13012.604934] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 09:00:38 juju-e4d256-prod-github-runner-207 kernel: [13012.605748] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 09:00:38 juju-e4d256-prod-github-runner-207 kernel: [13012.606602] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 09:00:38 juju-e4d256-prod-github-runner-207 kernel: [13012.607403] ? __seccomp_filter+0x4a/0x4a0 Aug 22 09:00:38 juju-e4d256-prod-github-runner-207 kernel: [13012.608153] ? __fget_files+0x86/0xc0 Aug 22 09:00:38 juju-e4d256-prod-github-runner-207 kernel: [13012.608878] __x64_sys_ioctl+0x95/0xd0 Aug 22 09:00:38 juju-e4d256-prod-github-runner-207 kernel: [13012.609570] do_syscall_64+0x5c/0xc0 Aug 22 09:00:38 juju-e4d256-prod-github-runner-207 kernel: [13012.610235] ? do_futex+0x162/0x1f0 Aug 22 09:00:38 juju-e4d256-prod-github-runner-207 kernel: [13012.610884] ? __x64_sys_futex+0x78/0x1e0 Aug 22 09:00:38 juju-e4d256-prod-github-runner-207 kernel: [13012.611557] ? __secure_computing+0xa9/0x120 Aug 22 09:00:38 juju-e4d256-prod-github-runner-207 kernel: [13012.612248] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 09:00:38 juju-e4d256-prod-github-runner-207 kernel: [13012.613028] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:00:38 juju-e4d256-prod-github-runner-207 kernel: [13012.613751] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:00:38 juju-e4d256-prod-github-runner-207 kernel: [13012.614467] ? do_syscall_64+0x69/0xc0 Aug 22 09:00:38 juju-e4d256-prod-github-runner-207 kernel: [13012.615109] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:00:38 juju-e4d256-prod-github-runner-207 kernel: [13012.615810] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:00:38 juju-e4d256-prod-github-runner-207 kernel: [13012.616504] ? do_syscall_64+0x69/0xc0 Aug 22 09:00:38 juju-e4d256-prod-github-runner-207 kernel: [13012.617217] ? do_syscall_64+0x69/0xc0 Aug 22 09:00:38 juju-e4d256-prod-github-runner-207 kernel: [13012.617862] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 09:00:38 juju-e4d256-prod-github-runner-207 kernel: [13012.618593] RIP: 0033:0x7faa5d0edaff Aug 22 09:00:38 juju-e4d256-prod-github-runner-207 kernel: [13012.619268] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 09:00:38 juju-e4d256-prod-github-runner-207 kernel: [13012.621266] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 09:00:38 juju-e4d256-prod-github-runner-207 kernel: [13012.622182] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 09:00:38 juju-e4d256-prod-github-runner-207 kernel: [13012.623073] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 09:00:38 juju-e4d256-prod-github-runner-207 kernel: [13012.623971] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 09:00:38 juju-e4d256-prod-github-runner-207 kernel: [13012.624873] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 09:00:38 juju-e4d256-prod-github-runner-207 kernel: [13012.625763] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 09:00:38 juju-e4d256-prod-github-runner-207 kernel: [13012.626671] Aug 22 09:01:06 juju-e4d256-prod-github-runner-207 kernel: [13040.541976] watchdog: BUG: soft lockup - CPU#1 stuck for 12036s! [qemu-system-x86:6715] Aug 22 09:01:06 juju-e4d256-prod-github-runner-207 kernel: [13040.543899] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 09:01:06 juju-e4d256-prod-github-runner-207 kernel: [13040.544227] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 09:01:06 juju-e4d256-prod-github-runner-207 kernel: [13040.556426] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 09:01:06 juju-e4d256-prod-github-runner-207 kernel: [13040.557703] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 09:01:06 juju-e4d256-prod-github-runner-207 kernel: [13040.558931] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:01:06 juju-e4d256-prod-github-runner-207 kernel: [13040.559991] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 09:01:06 juju-e4d256-prod-github-runner-207 kernel: [13040.562554] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 09:01:06 juju-e4d256-prod-github-runner-207 kernel: [13040.563595] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 09:01:06 juju-e4d256-prod-github-runner-207 kernel: [13040.564781] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 09:01:06 juju-e4d256-prod-github-runner-207 kernel: [13040.565968] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 09:01:06 juju-e4d256-prod-github-runner-207 kernel: [13040.567181] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 09:01:06 juju-e4d256-prod-github-runner-207 kernel: [13040.568391] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 09:01:06 juju-e4d256-prod-github-runner-207 kernel: [13040.569557] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 09:01:06 juju-e4d256-prod-github-runner-207 kernel: [13040.570792] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 09:01:06 juju-e4d256-prod-github-runner-207 kernel: [13040.572079] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 09:01:06 juju-e4d256-prod-github-runner-207 kernel: [13040.573326] Call Trace: Aug 22 09:01:06 juju-e4d256-prod-github-runner-207 kernel: [13040.574276] Aug 22 09:01:06 juju-e4d256-prod-github-runner-207 kernel: [13040.575282] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:01:06 juju-e4d256-prod-github-runner-207 kernel: [13040.576372] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:01:06 juju-e4d256-prod-github-runner-207 kernel: [13040.577401] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:01:06 juju-e4d256-prod-github-runner-207 kernel: [13040.578495] ? show_regs.part.0+0x23/0x29 Aug 22 09:01:06 juju-e4d256-prod-github-runner-207 kernel: [13040.579490] ? show_regs.cold+0x8/0xd Aug 22 09:01:06 juju-e4d256-prod-github-runner-207 kernel: [13040.580471] ? watchdog_timer_fn+0x1be/0x220 Aug 22 09:01:06 juju-e4d256-prod-github-runner-207 kernel: [13040.581511] ? lockup_detector_update_enable+0x60/0x60 Aug 22 09:01:06 juju-e4d256-prod-github-runner-207 kernel: [13040.582583] ? __hrtimer_run_queues+0x107/0x230 Aug 22 09:01:06 juju-e4d256-prod-github-runner-207 kernel: [13040.583619] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 09:01:06 juju-e4d256-prod-github-runner-207 kernel: [13040.584688] ? hrtimer_interrupt+0x101/0x220 Aug 22 09:01:06 juju-e4d256-prod-github-runner-207 kernel: [13040.585719] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 09:01:06 juju-e4d256-prod-github-runner-207 kernel: [13040.586785] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 09:01:06 juju-e4d256-prod-github-runner-207 kernel: [13040.587830] Aug 22 09:01:06 juju-e4d256-prod-github-runner-207 kernel: [13040.588694] Aug 22 09:01:06 juju-e4d256-prod-github-runner-207 kernel: [13040.589530] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 09:01:06 juju-e4d256-prod-github-runner-207 kernel: [13040.590583] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:01:06 juju-e4d256-prod-github-runner-207 kernel: [13040.591627] ? _raw_spin_lock+0x22/0x30 Aug 22 09:01:06 juju-e4d256-prod-github-runner-207 kernel: [13040.592599] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:01:06 juju-e4d256-prod-github-runner-207 kernel: [13040.593657] direct_page_fault+0x206/0x310 [kvm] Aug 22 09:01:06 juju-e4d256-prod-github-runner-207 kernel: [13040.594681] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 09:01:06 juju-e4d256-prod-github-runner-207 kernel: [13040.595689] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 09:01:06 juju-e4d256-prod-github-runner-207 kernel: [13040.596705] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 09:01:06 juju-e4d256-prod-github-runner-207 kernel: [13040.597714] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 09:01:06 juju-e4d256-prod-github-runner-207 kernel: [13040.598688] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 09:01:06 juju-e4d256-prod-github-runner-207 kernel: [13040.599683] handle_exit+0x98/0x230 [kvm_amd] Aug 22 09:01:06 juju-e4d256-prod-github-runner-207 kernel: [13040.600598] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 09:01:06 juju-e4d256-prod-github-runner-207 kernel: [13040.601575] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 09:01:06 juju-e4d256-prod-github-runner-207 kernel: [13040.602501] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 09:01:06 juju-e4d256-prod-github-runner-207 kernel: [13040.603403] vcpu_run+0x62/0x2c0 [kvm] Aug 22 09:01:06 juju-e4d256-prod-github-runner-207 kernel: [13040.604218] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 09:01:06 juju-e4d256-prod-github-runner-207 kernel: [13040.605039] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 09:01:06 juju-e4d256-prod-github-runner-207 kernel: [13040.605899] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 09:01:06 juju-e4d256-prod-github-runner-207 kernel: [13040.606697] ? __seccomp_filter+0x4a/0x4a0 Aug 22 09:01:06 juju-e4d256-prod-github-runner-207 kernel: [13040.607442] ? __fget_files+0x86/0xc0 Aug 22 09:01:06 juju-e4d256-prod-github-runner-207 kernel: [13040.608146] __x64_sys_ioctl+0x95/0xd0 Aug 22 09:01:06 juju-e4d256-prod-github-runner-207 kernel: [13040.608851] do_syscall_64+0x5c/0xc0 Aug 22 09:01:06 juju-e4d256-prod-github-runner-207 kernel: [13040.609515] ? do_futex+0x162/0x1f0 Aug 22 09:01:06 juju-e4d256-prod-github-runner-207 kernel: [13040.610161] ? __x64_sys_futex+0x78/0x1e0 Aug 22 09:01:06 juju-e4d256-prod-github-runner-207 kernel: [13040.610865] ? __secure_computing+0xa9/0x120 Aug 22 09:01:06 juju-e4d256-prod-github-runner-207 kernel: [13040.611553] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 09:01:06 juju-e4d256-prod-github-runner-207 kernel: [13040.612329] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:01:06 juju-e4d256-prod-github-runner-207 kernel: [13040.613055] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:01:06 juju-e4d256-prod-github-runner-207 kernel: [13040.613777] ? do_syscall_64+0x69/0xc0 Aug 22 09:01:06 juju-e4d256-prod-github-runner-207 kernel: [13040.614422] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:01:06 juju-e4d256-prod-github-runner-207 kernel: [13040.615123] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:01:06 juju-e4d256-prod-github-runner-207 kernel: [13040.615819] ? do_syscall_64+0x69/0xc0 Aug 22 09:01:06 juju-e4d256-prod-github-runner-207 kernel: [13040.616465] ? do_syscall_64+0x69/0xc0 Aug 22 09:01:06 juju-e4d256-prod-github-runner-207 kernel: [13040.617093] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 09:01:06 juju-e4d256-prod-github-runner-207 kernel: [13040.617797] RIP: 0033:0x7faa5d0edaff Aug 22 09:01:06 juju-e4d256-prod-github-runner-207 kernel: [13040.618447] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 09:01:06 juju-e4d256-prod-github-runner-207 kernel: [13040.620506] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 09:01:06 juju-e4d256-prod-github-runner-207 kernel: [13040.621443] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 09:01:06 juju-e4d256-prod-github-runner-207 kernel: [13040.622341] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 09:01:06 juju-e4d256-prod-github-runner-207 kernel: [13040.623231] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 09:01:06 juju-e4d256-prod-github-runner-207 kernel: [13040.624124] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 09:01:06 juju-e4d256-prod-github-runner-207 kernel: [13040.625030] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 09:01:06 juju-e4d256-prod-github-runner-207 kernel: [13040.625925] Aug 22 09:01:34 juju-e4d256-prod-github-runner-207 kernel: [13068.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 12063s! [qemu-system-x86:6715] Aug 22 09:01:34 juju-e4d256-prod-github-runner-207 kernel: [13068.543859] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 09:01:34 juju-e4d256-prod-github-runner-207 kernel: [13068.544209] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 09:01:34 juju-e4d256-prod-github-runner-207 kernel: [13068.556536] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 09:01:34 juju-e4d256-prod-github-runner-207 kernel: [13068.557801] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 09:01:34 juju-e4d256-prod-github-runner-207 kernel: [13068.559030] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:01:34 juju-e4d256-prod-github-runner-207 kernel: [13068.560125] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 09:01:34 juju-e4d256-prod-github-runner-207 kernel: [13068.562681] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 09:01:34 juju-e4d256-prod-github-runner-207 kernel: [13068.563728] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 09:01:34 juju-e4d256-prod-github-runner-207 kernel: [13068.564895] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 09:01:34 juju-e4d256-prod-github-runner-207 kernel: [13068.566056] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 09:01:34 juju-e4d256-prod-github-runner-207 kernel: [13068.567253] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 09:01:34 juju-e4d256-prod-github-runner-207 kernel: [13068.569289] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 09:01:34 juju-e4d256-prod-github-runner-207 kernel: [13068.570459] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 09:01:34 juju-e4d256-prod-github-runner-207 kernel: [13068.571688] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 09:01:34 juju-e4d256-prod-github-runner-207 kernel: [13068.572928] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 09:01:34 juju-e4d256-prod-github-runner-207 kernel: [13068.574275] Call Trace: Aug 22 09:01:34 juju-e4d256-prod-github-runner-207 kernel: [13068.575193] Aug 22 09:01:34 juju-e4d256-prod-github-runner-207 kernel: [13068.576142] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:01:34 juju-e4d256-prod-github-runner-207 kernel: [13068.577178] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:01:34 juju-e4d256-prod-github-runner-207 kernel: [13068.578221] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:01:34 juju-e4d256-prod-github-runner-207 kernel: [13068.579315] ? show_regs.part.0+0x23/0x29 Aug 22 09:01:34 juju-e4d256-prod-github-runner-207 kernel: [13068.580327] ? show_regs.cold+0x8/0xd Aug 22 09:01:34 juju-e4d256-prod-github-runner-207 kernel: [13068.581302] ? watchdog_timer_fn+0x1be/0x220 Aug 22 09:01:34 juju-e4d256-prod-github-runner-207 kernel: [13068.582309] ? lockup_detector_update_enable+0x60/0x60 Aug 22 09:01:34 juju-e4d256-prod-github-runner-207 kernel: [13068.583383] ? __hrtimer_run_queues+0x107/0x230 Aug 22 09:01:34 juju-e4d256-prod-github-runner-207 kernel: [13068.584431] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 09:01:34 juju-e4d256-prod-github-runner-207 kernel: [13068.585701] ? hrtimer_interrupt+0x101/0x220 Aug 22 09:01:34 juju-e4d256-prod-github-runner-207 kernel: [13068.586725] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 09:01:34 juju-e4d256-prod-github-runner-207 kernel: [13068.587818] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 09:01:34 juju-e4d256-prod-github-runner-207 kernel: [13068.588883] Aug 22 09:01:34 juju-e4d256-prod-github-runner-207 kernel: [13068.589734] Aug 22 09:01:34 juju-e4d256-prod-github-runner-207 kernel: [13068.590575] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 09:01:34 juju-e4d256-prod-github-runner-207 kernel: [13068.591611] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:01:34 juju-e4d256-prod-github-runner-207 kernel: [13068.592667] ? _raw_spin_lock+0x22/0x30 Aug 22 09:01:34 juju-e4d256-prod-github-runner-207 kernel: [13068.593659] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:01:34 juju-e4d256-prod-github-runner-207 kernel: [13068.594682] direct_page_fault+0x206/0x310 [kvm] Aug 22 09:01:34 juju-e4d256-prod-github-runner-207 kernel: [13068.595711] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 09:01:34 juju-e4d256-prod-github-runner-207 kernel: [13068.596730] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 09:01:34 juju-e4d256-prod-github-runner-207 kernel: [13068.597745] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 09:01:34 juju-e4d256-prod-github-runner-207 kernel: [13068.598776] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 09:01:34 juju-e4d256-prod-github-runner-207 kernel: [13068.599729] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 09:01:34 juju-e4d256-prod-github-runner-207 kernel: [13068.600746] handle_exit+0x98/0x230 [kvm_amd] Aug 22 09:01:34 juju-e4d256-prod-github-runner-207 kernel: [13068.601656] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 09:01:34 juju-e4d256-prod-github-runner-207 kernel: [13068.602580] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 09:01:34 juju-e4d256-prod-github-runner-207 kernel: [13068.603515] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 09:01:34 juju-e4d256-prod-github-runner-207 kernel: [13068.604440] vcpu_run+0x62/0x2c0 [kvm] Aug 22 09:01:34 juju-e4d256-prod-github-runner-207 kernel: [13068.605253] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 09:01:34 juju-e4d256-prod-github-runner-207 kernel: [13068.606066] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 09:01:34 juju-e4d256-prod-github-runner-207 kernel: [13068.606920] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 09:01:34 juju-e4d256-prod-github-runner-207 kernel: [13068.607821] ? __seccomp_filter+0x4a/0x4a0 Aug 22 09:01:34 juju-e4d256-prod-github-runner-207 kernel: [13068.608587] ? __fget_files+0x86/0xc0 Aug 22 09:01:34 juju-e4d256-prod-github-runner-207 kernel: [13068.609300] __x64_sys_ioctl+0x95/0xd0 Aug 22 09:01:34 juju-e4d256-prod-github-runner-207 kernel: [13068.609994] do_syscall_64+0x5c/0xc0 Aug 22 09:01:34 juju-e4d256-prod-github-runner-207 kernel: [13068.610659] ? do_futex+0x162/0x1f0 Aug 22 09:01:34 juju-e4d256-prod-github-runner-207 kernel: [13068.611306] ? __x64_sys_futex+0x78/0x1e0 Aug 22 09:01:34 juju-e4d256-prod-github-runner-207 kernel: [13068.612035] ? __secure_computing+0xa9/0x120 Aug 22 09:01:34 juju-e4d256-prod-github-runner-207 kernel: [13068.612732] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 09:01:34 juju-e4d256-prod-github-runner-207 kernel: [13068.613496] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:01:34 juju-e4d256-prod-github-runner-207 kernel: [13068.614241] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:01:34 juju-e4d256-prod-github-runner-207 kernel: [13068.614959] ? do_syscall_64+0x69/0xc0 Aug 22 09:01:34 juju-e4d256-prod-github-runner-207 kernel: [13068.615606] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:01:34 juju-e4d256-prod-github-runner-207 kernel: [13068.616324] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:01:34 juju-e4d256-prod-github-runner-207 kernel: [13068.617019] ? do_syscall_64+0x69/0xc0 Aug 22 09:01:34 juju-e4d256-prod-github-runner-207 kernel: [13068.617642] ? do_syscall_64+0x69/0xc0 Aug 22 09:01:34 juju-e4d256-prod-github-runner-207 kernel: [13068.618268] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 09:01:34 juju-e4d256-prod-github-runner-207 kernel: [13068.618991] RIP: 0033:0x7faa5d0edaff Aug 22 09:01:34 juju-e4d256-prod-github-runner-207 kernel: [13068.619662] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 09:01:34 juju-e4d256-prod-github-runner-207 kernel: [13068.621664] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 09:01:34 juju-e4d256-prod-github-runner-207 kernel: [13068.622596] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 09:01:34 juju-e4d256-prod-github-runner-207 kernel: [13068.623498] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 09:01:34 juju-e4d256-prod-github-runner-207 kernel: [13068.624455] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 09:01:34 juju-e4d256-prod-github-runner-207 kernel: [13068.625362] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 09:01:34 juju-e4d256-prod-github-runner-207 kernel: [13068.626250] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 09:01:34 juju-e4d256-prod-github-runner-207 kernel: [13068.627140] Aug 22 09:02:02 juju-e4d256-prod-github-runner-207 kernel: [13096.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 12089s! [qemu-system-x86:6715] Aug 22 09:02:02 juju-e4d256-prod-github-runner-207 kernel: [13096.543855] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 09:02:02 juju-e4d256-prod-github-runner-207 kernel: [13096.544169] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 09:02:02 juju-e4d256-prod-github-runner-207 kernel: [13096.556740] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 09:02:02 juju-e4d256-prod-github-runner-207 kernel: [13096.558004] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 09:02:02 juju-e4d256-prod-github-runner-207 kernel: [13096.559230] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:02:02 juju-e4d256-prod-github-runner-207 kernel: [13096.560304] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 09:02:02 juju-e4d256-prod-github-runner-207 kernel: [13096.562854] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 09:02:02 juju-e4d256-prod-github-runner-207 kernel: [13096.563907] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 09:02:02 juju-e4d256-prod-github-runner-207 kernel: [13096.565075] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 09:02:02 juju-e4d256-prod-github-runner-207 kernel: [13096.566291] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 09:02:02 juju-e4d256-prod-github-runner-207 kernel: [13096.567456] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 09:02:02 juju-e4d256-prod-github-runner-207 kernel: [13096.568633] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 09:02:02 juju-e4d256-prod-github-runner-207 kernel: [13096.569801] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 09:02:02 juju-e4d256-prod-github-runner-207 kernel: [13096.571033] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 09:02:02 juju-e4d256-prod-github-runner-207 kernel: [13096.572153] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 09:02:02 juju-e4d256-prod-github-runner-207 kernel: [13096.573351] Call Trace: Aug 22 09:02:02 juju-e4d256-prod-github-runner-207 kernel: [13096.574261] Aug 22 09:02:02 juju-e4d256-prod-github-runner-207 kernel: [13096.575161] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:02:02 juju-e4d256-prod-github-runner-207 kernel: [13096.576214] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:02:02 juju-e4d256-prod-github-runner-207 kernel: [13096.577244] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:02:02 juju-e4d256-prod-github-runner-207 kernel: [13096.578347] ? show_regs.part.0+0x23/0x29 Aug 22 09:02:02 juju-e4d256-prod-github-runner-207 kernel: [13096.579345] ? show_regs.cold+0x8/0xd Aug 22 09:02:02 juju-e4d256-prod-github-runner-207 kernel: [13096.580336] ? watchdog_timer_fn+0x1be/0x220 Aug 22 09:02:02 juju-e4d256-prod-github-runner-207 kernel: [13096.581345] ? lockup_detector_update_enable+0x60/0x60 Aug 22 09:02:02 juju-e4d256-prod-github-runner-207 kernel: [13096.582406] ? __hrtimer_run_queues+0x107/0x230 Aug 22 09:02:02 juju-e4d256-prod-github-runner-207 kernel: [13096.583436] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 09:02:02 juju-e4d256-prod-github-runner-207 kernel: [13096.584466] ? hrtimer_interrupt+0x101/0x220 Aug 22 09:02:02 juju-e4d256-prod-github-runner-207 kernel: [13096.585480] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 09:02:02 juju-e4d256-prod-github-runner-207 kernel: [13096.586565] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 09:02:02 juju-e4d256-prod-github-runner-207 kernel: [13096.587612] Aug 22 09:02:02 juju-e4d256-prod-github-runner-207 kernel: [13096.588477] Aug 22 09:02:02 juju-e4d256-prod-github-runner-207 kernel: [13096.589313] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 09:02:02 juju-e4d256-prod-github-runner-207 kernel: [13096.590350] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:02:02 juju-e4d256-prod-github-runner-207 kernel: [13096.591388] ? _raw_spin_lock+0x22/0x30 Aug 22 09:02:02 juju-e4d256-prod-github-runner-207 kernel: [13096.592339] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:02:02 juju-e4d256-prod-github-runner-207 kernel: [13096.593363] direct_page_fault+0x206/0x310 [kvm] Aug 22 09:02:02 juju-e4d256-prod-github-runner-207 kernel: [13096.594387] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 09:02:02 juju-e4d256-prod-github-runner-207 kernel: [13096.595395] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 09:02:02 juju-e4d256-prod-github-runner-207 kernel: [13096.596414] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 09:02:02 juju-e4d256-prod-github-runner-207 kernel: [13096.597427] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 09:02:02 juju-e4d256-prod-github-runner-207 kernel: [13096.598376] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 09:02:02 juju-e4d256-prod-github-runner-207 kernel: [13096.599352] handle_exit+0x98/0x230 [kvm_amd] Aug 22 09:02:02 juju-e4d256-prod-github-runner-207 kernel: [13096.600261] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 09:02:02 juju-e4d256-prod-github-runner-207 kernel: [13096.601178] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 09:02:02 juju-e4d256-prod-github-runner-207 kernel: [13096.602104] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 09:02:02 juju-e4d256-prod-github-runner-207 kernel: [13096.603012] vcpu_run+0x62/0x2c0 [kvm] Aug 22 09:02:02 juju-e4d256-prod-github-runner-207 kernel: [13096.603839] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 09:02:02 juju-e4d256-prod-github-runner-207 kernel: [13096.604646] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 09:02:02 juju-e4d256-prod-github-runner-207 kernel: [13096.605501] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 09:02:02 juju-e4d256-prod-github-runner-207 kernel: [13096.606303] ? __seccomp_filter+0x4a/0x4a0 Aug 22 09:02:02 juju-e4d256-prod-github-runner-207 kernel: [13096.607046] ? __fget_files+0x86/0xc0 Aug 22 09:02:02 juju-e4d256-prod-github-runner-207 kernel: [13096.607770] __x64_sys_ioctl+0x95/0xd0 Aug 22 09:02:02 juju-e4d256-prod-github-runner-207 kernel: [13096.608463] do_syscall_64+0x5c/0xc0 Aug 22 09:02:02 juju-e4d256-prod-github-runner-207 kernel: [13096.609129] ? do_futex+0x162/0x1f0 Aug 22 09:02:02 juju-e4d256-prod-github-runner-207 kernel: [13096.609778] ? __x64_sys_futex+0x78/0x1e0 Aug 22 09:02:02 juju-e4d256-prod-github-runner-207 kernel: [13096.610450] ? __secure_computing+0xa9/0x120 Aug 22 09:02:02 juju-e4d256-prod-github-runner-207 kernel: [13096.611140] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 09:02:02 juju-e4d256-prod-github-runner-207 kernel: [13096.611913] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:02:02 juju-e4d256-prod-github-runner-207 kernel: [13096.612639] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:02:02 juju-e4d256-prod-github-runner-207 kernel: [13096.613358] ? do_syscall_64+0x69/0xc0 Aug 22 09:02:02 juju-e4d256-prod-github-runner-207 kernel: [13096.614001] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:02:02 juju-e4d256-prod-github-runner-207 kernel: [13096.614704] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:02:02 juju-e4d256-prod-github-runner-207 kernel: [13096.615404] ? do_syscall_64+0x69/0xc0 Aug 22 09:02:02 juju-e4d256-prod-github-runner-207 kernel: [13096.616038] ? do_syscall_64+0x69/0xc0 Aug 22 09:02:02 juju-e4d256-prod-github-runner-207 kernel: [13096.616664] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 09:02:02 juju-e4d256-prod-github-runner-207 kernel: [13096.617370] RIP: 0033:0x7faa5d0edaff Aug 22 09:02:02 juju-e4d256-prod-github-runner-207 kernel: [13096.618030] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 09:02:02 juju-e4d256-prod-github-runner-207 kernel: [13096.620080] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 09:02:02 juju-e4d256-prod-github-runner-207 kernel: [13096.621016] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 09:02:02 juju-e4d256-prod-github-runner-207 kernel: [13096.621941] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 09:02:02 juju-e4d256-prod-github-runner-207 kernel: [13096.622851] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 09:02:02 juju-e4d256-prod-github-runner-207 kernel: [13096.623770] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 09:02:02 juju-e4d256-prod-github-runner-207 kernel: [13096.624663] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 09:02:02 juju-e4d256-prod-github-runner-207 kernel: [13096.625562] Aug 22 09:02:30 juju-e4d256-prod-github-runner-207 kernel: [13124.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 12115s! [qemu-system-x86:6715] Aug 22 09:02:30 juju-e4d256-prod-github-runner-207 kernel: [13124.543883] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 09:02:30 juju-e4d256-prod-github-runner-207 kernel: [13124.544199] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 09:02:30 juju-e4d256-prod-github-runner-207 kernel: [13124.556328] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 09:02:30 juju-e4d256-prod-github-runner-207 kernel: [13124.557612] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 09:02:30 juju-e4d256-prod-github-runner-207 kernel: [13124.558852] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:02:30 juju-e4d256-prod-github-runner-207 kernel: [13124.559979] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 09:02:30 juju-e4d256-prod-github-runner-207 kernel: [13124.562534] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 09:02:30 juju-e4d256-prod-github-runner-207 kernel: [13124.563605] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 09:02:30 juju-e4d256-prod-github-runner-207 kernel: [13124.564762] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 09:02:30 juju-e4d256-prod-github-runner-207 kernel: [13124.565920] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 09:02:30 juju-e4d256-prod-github-runner-207 kernel: [13124.567078] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 09:02:30 juju-e4d256-prod-github-runner-207 kernel: [13124.568255] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 09:02:30 juju-e4d256-prod-github-runner-207 kernel: [13124.569554] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 09:02:30 juju-e4d256-prod-github-runner-207 kernel: [13124.570808] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 09:02:30 juju-e4d256-prod-github-runner-207 kernel: [13124.571938] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 09:02:30 juju-e4d256-prod-github-runner-207 kernel: [13124.573131] Call Trace: Aug 22 09:02:30 juju-e4d256-prod-github-runner-207 kernel: [13124.574047] Aug 22 09:02:30 juju-e4d256-prod-github-runner-207 kernel: [13124.574950] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:02:30 juju-e4d256-prod-github-runner-207 kernel: [13124.576000] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:02:30 juju-e4d256-prod-github-runner-207 kernel: [13124.577163] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:02:30 juju-e4d256-prod-github-runner-207 kernel: [13124.578258] ? show_regs.part.0+0x23/0x29 Aug 22 09:02:30 juju-e4d256-prod-github-runner-207 kernel: [13124.579251] ? show_regs.cold+0x8/0xd Aug 22 09:02:30 juju-e4d256-prod-github-runner-207 kernel: [13124.580243] ? watchdog_timer_fn+0x1be/0x220 Aug 22 09:02:30 juju-e4d256-prod-github-runner-207 kernel: [13124.581249] ? lockup_detector_update_enable+0x60/0x60 Aug 22 09:02:30 juju-e4d256-prod-github-runner-207 kernel: [13124.582309] ? __hrtimer_run_queues+0x107/0x230 Aug 22 09:02:30 juju-e4d256-prod-github-runner-207 kernel: [13124.583352] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 09:02:30 juju-e4d256-prod-github-runner-207 kernel: [13124.584383] ? hrtimer_interrupt+0x101/0x220 Aug 22 09:02:30 juju-e4d256-prod-github-runner-207 kernel: [13124.585405] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 09:02:30 juju-e4d256-prod-github-runner-207 kernel: [13124.586475] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 09:02:30 juju-e4d256-prod-github-runner-207 kernel: [13124.587611] Aug 22 09:02:30 juju-e4d256-prod-github-runner-207 kernel: [13124.588504] Aug 22 09:02:30 juju-e4d256-prod-github-runner-207 kernel: [13124.589343] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 09:02:30 juju-e4d256-prod-github-runner-207 kernel: [13124.590440] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:02:30 juju-e4d256-prod-github-runner-207 kernel: [13124.591527] ? _raw_spin_lock+0x22/0x30 Aug 22 09:02:30 juju-e4d256-prod-github-runner-207 kernel: [13124.592481] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:02:30 juju-e4d256-prod-github-runner-207 kernel: [13124.593549] direct_page_fault+0x206/0x310 [kvm] Aug 22 09:02:30 juju-e4d256-prod-github-runner-207 kernel: [13124.594600] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 09:02:30 juju-e4d256-prod-github-runner-207 kernel: [13124.595632] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 09:02:30 juju-e4d256-prod-github-runner-207 kernel: [13124.596642] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 09:02:30 juju-e4d256-prod-github-runner-207 kernel: [13124.597661] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 09:02:30 juju-e4d256-prod-github-runner-207 kernel: [13124.598614] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 09:02:30 juju-e4d256-prod-github-runner-207 kernel: [13124.599604] handle_exit+0x98/0x230 [kvm_amd] Aug 22 09:02:30 juju-e4d256-prod-github-runner-207 kernel: [13124.600506] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 09:02:30 juju-e4d256-prod-github-runner-207 kernel: [13124.601510] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 09:02:30 juju-e4d256-prod-github-runner-207 kernel: [13124.602453] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 09:02:30 juju-e4d256-prod-github-runner-207 kernel: [13124.603401] vcpu_run+0x62/0x2c0 [kvm] Aug 22 09:02:30 juju-e4d256-prod-github-runner-207 kernel: [13124.604268] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 09:02:30 juju-e4d256-prod-github-runner-207 kernel: [13124.605079] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 09:02:30 juju-e4d256-prod-github-runner-207 kernel: [13124.605933] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 09:02:30 juju-e4d256-prod-github-runner-207 kernel: [13124.606728] ? __seccomp_filter+0x4a/0x4a0 Aug 22 09:02:30 juju-e4d256-prod-github-runner-207 kernel: [13124.607484] ? __fget_files+0x86/0xc0 Aug 22 09:02:30 juju-e4d256-prod-github-runner-207 kernel: [13124.608188] __x64_sys_ioctl+0x95/0xd0 Aug 22 09:02:30 juju-e4d256-prod-github-runner-207 kernel: [13124.608879] do_syscall_64+0x5c/0xc0 Aug 22 09:02:30 juju-e4d256-prod-github-runner-207 kernel: [13124.609542] ? do_futex+0x162/0x1f0 Aug 22 09:02:30 juju-e4d256-prod-github-runner-207 kernel: [13124.610218] ? __x64_sys_futex+0x78/0x1e0 Aug 22 09:02:30 juju-e4d256-prod-github-runner-207 kernel: [13124.610950] ? __secure_computing+0xa9/0x120 Aug 22 09:02:30 juju-e4d256-prod-github-runner-207 kernel: [13124.611664] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 09:02:30 juju-e4d256-prod-github-runner-207 kernel: [13124.612425] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:02:30 juju-e4d256-prod-github-runner-207 kernel: [13124.613181] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:02:30 juju-e4d256-prod-github-runner-207 kernel: [13124.613912] ? do_syscall_64+0x69/0xc0 Aug 22 09:02:30 juju-e4d256-prod-github-runner-207 kernel: [13124.614629] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:02:30 juju-e4d256-prod-github-runner-207 kernel: [13124.615385] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:02:30 juju-e4d256-prod-github-runner-207 kernel: [13124.616086] ? do_syscall_64+0x69/0xc0 Aug 22 09:02:30 juju-e4d256-prod-github-runner-207 kernel: [13124.616730] ? do_syscall_64+0x69/0xc0 Aug 22 09:02:30 juju-e4d256-prod-github-runner-207 kernel: [13124.617400] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 09:02:30 juju-e4d256-prod-github-runner-207 kernel: [13124.618117] RIP: 0033:0x7faa5d0edaff Aug 22 09:02:30 juju-e4d256-prod-github-runner-207 kernel: [13124.618793] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 09:02:30 juju-e4d256-prod-github-runner-207 kernel: [13124.620881] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 09:02:30 juju-e4d256-prod-github-runner-207 kernel: [13124.621808] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 09:02:30 juju-e4d256-prod-github-runner-207 kernel: [13124.622714] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 09:02:30 juju-e4d256-prod-github-runner-207 kernel: [13124.623641] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 09:02:30 juju-e4d256-prod-github-runner-207 kernel: [13124.624538] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 09:02:30 juju-e4d256-prod-github-runner-207 kernel: [13124.625447] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 09:02:30 juju-e4d256-prod-github-runner-207 kernel: [13124.626346] Aug 22 09:02:44 juju-e4d256-prod-github-runner-207 kernel: [13138.064711] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 09:02:44 juju-e4d256-prod-github-runner-207 kernel: [13138.066644] rcu: 1-....: (3245016 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=1567798 Aug 22 09:02:44 juju-e4d256-prod-github-runner-207 kernel: [13138.067965] (t=3255216 jiffies g=23269 q=20916) Aug 22 09:02:44 juju-e4d256-prod-github-runner-207 kernel: [13138.068753] NMI backtrace for cpu 1 Aug 22 09:02:44 juju-e4d256-prod-github-runner-207 kernel: [13138.069461] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 09:02:44 juju-e4d256-prod-github-runner-207 kernel: [13138.070567] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 09:02:44 juju-e4d256-prod-github-runner-207 kernel: [13138.071653] Call Trace: Aug 22 09:02:44 juju-e4d256-prod-github-runner-207 kernel: [13138.072337] Aug 22 09:02:44 juju-e4d256-prod-github-runner-207 kernel: [13138.072994] show_stack+0x52/0x5c Aug 22 09:02:44 juju-e4d256-prod-github-runner-207 kernel: [13138.073744] dump_stack_lvl+0x4a/0x63 Aug 22 09:02:44 juju-e4d256-prod-github-runner-207 kernel: [13138.074694] dump_stack+0x10/0x16 Aug 22 09:02:44 juju-e4d256-prod-github-runner-207 kernel: [13138.075422] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 09:02:44 juju-e4d256-prod-github-runner-207 kernel: [13138.076206] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 09:02:44 juju-e4d256-prod-github-runner-207 kernel: [13138.076988] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 09:02:44 juju-e4d256-prod-github-runner-207 kernel: [13138.077848] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 09:02:44 juju-e4d256-prod-github-runner-207 kernel: [13138.078664] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 09:02:44 juju-e4d256-prod-github-runner-207 kernel: [13138.079482] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 09:02:44 juju-e4d256-prod-github-runner-207 kernel: [13138.080265] print_cpu_stall.cold+0x2f/0xe2 Aug 22 09:02:44 juju-e4d256-prod-github-runner-207 kernel: [13138.081045] ? timekeeping_update+0xf7/0x150 Aug 22 09:02:44 juju-e4d256-prod-github-runner-207 kernel: [13138.081820] check_cpu_stall+0x109/0x270 Aug 22 09:02:44 juju-e4d256-prod-github-runner-207 kernel: [13138.082565] rcu_sched_clock_irq+0x9a/0x250 Aug 22 09:02:44 juju-e4d256-prod-github-runner-207 kernel: [13138.083339] update_process_times+0x94/0xd0 Aug 22 09:02:44 juju-e4d256-prod-github-runner-207 kernel: [13138.084099] tick_sched_handle+0x29/0x70 Aug 22 09:02:44 juju-e4d256-prod-github-runner-207 kernel: [13138.084841] tick_sched_timer+0x8c/0xc0 Aug 22 09:02:44 juju-e4d256-prod-github-runner-207 kernel: [13138.085577] ? tick_nohz_handler+0xb0/0xb0 Aug 22 09:02:44 juju-e4d256-prod-github-runner-207 kernel: [13138.086329] __hrtimer_run_queues+0x107/0x230 Aug 22 09:02:44 juju-e4d256-prod-github-runner-207 kernel: [13138.087098] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 09:02:44 juju-e4d256-prod-github-runner-207 kernel: [13138.087891] hrtimer_interrupt+0x101/0x220 Aug 22 09:02:44 juju-e4d256-prod-github-runner-207 kernel: [13138.088646] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 09:02:44 juju-e4d256-prod-github-runner-207 kernel: [13138.089459] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 09:02:44 juju-e4d256-prod-github-runner-207 kernel: [13138.090264] Aug 22 09:02:44 juju-e4d256-prod-github-runner-207 kernel: [13138.090898] Aug 22 09:02:44 juju-e4d256-prod-github-runner-207 kernel: [13138.091547] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 09:02:44 juju-e4d256-prod-github-runner-207 kernel: [13138.092365] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:02:44 juju-e4d256-prod-github-runner-207 kernel: [13138.093243] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 09:02:44 juju-e4d256-prod-github-runner-207 kernel: [13138.095467] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 09:02:44 juju-e4d256-prod-github-runner-207 kernel: [13138.096339] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 09:02:44 juju-e4d256-prod-github-runner-207 kernel: [13138.097362] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 09:02:44 juju-e4d256-prod-github-runner-207 kernel: [13138.098367] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 09:02:44 juju-e4d256-prod-github-runner-207 kernel: [13138.099337] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 09:02:44 juju-e4d256-prod-github-runner-207 kernel: [13138.100308] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 09:02:44 juju-e4d256-prod-github-runner-207 kernel: [13138.101258] ? _raw_spin_lock+0x22/0x30 Aug 22 09:02:44 juju-e4d256-prod-github-runner-207 kernel: [13138.102072] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:02:44 juju-e4d256-prod-github-runner-207 kernel: [13138.102940] direct_page_fault+0x206/0x310 [kvm] Aug 22 09:02:44 juju-e4d256-prod-github-runner-207 kernel: [13138.103801] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 09:02:44 juju-e4d256-prod-github-runner-207 kernel: [13138.104631] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 09:02:44 juju-e4d256-prod-github-runner-207 kernel: [13138.105467] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 09:02:44 juju-e4d256-prod-github-runner-207 kernel: [13138.106305] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 09:02:44 juju-e4d256-prod-github-runner-207 kernel: [13138.107102] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 09:02:44 juju-e4d256-prod-github-runner-207 kernel: [13138.107944] handle_exit+0x98/0x230 [kvm_amd] Aug 22 09:02:44 juju-e4d256-prod-github-runner-207 kernel: [13138.108712] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 09:02:44 juju-e4d256-prod-github-runner-207 kernel: [13138.109499] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 09:02:44 juju-e4d256-prod-github-runner-207 kernel: [13138.110296] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 09:02:44 juju-e4d256-prod-github-runner-207 kernel: [13138.111078] vcpu_run+0x62/0x2c0 [kvm] Aug 22 09:02:44 juju-e4d256-prod-github-runner-207 kernel: [13138.111811] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 09:02:44 juju-e4d256-prod-github-runner-207 kernel: [13138.112542] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 09:02:44 juju-e4d256-prod-github-runner-207 kernel: [13138.113381] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 09:02:44 juju-e4d256-prod-github-runner-207 kernel: [13138.114139] ? __seccomp_filter+0x4a/0x4a0 Aug 22 09:02:44 juju-e4d256-prod-github-runner-207 kernel: [13138.114854] ? __fget_files+0x86/0xc0 Aug 22 09:02:44 juju-e4d256-prod-github-runner-207 kernel: [13138.115594] __x64_sys_ioctl+0x95/0xd0 Aug 22 09:02:44 juju-e4d256-prod-github-runner-207 kernel: [13138.116311] do_syscall_64+0x5c/0xc0 Aug 22 09:02:44 juju-e4d256-prod-github-runner-207 kernel: [13138.116987] ? do_futex+0x162/0x1f0 Aug 22 09:02:44 juju-e4d256-prod-github-runner-207 kernel: [13138.117655] ? __x64_sys_futex+0x78/0x1e0 Aug 22 09:02:44 juju-e4d256-prod-github-runner-207 kernel: [13138.118385] ? __secure_computing+0xa9/0x120 Aug 22 09:02:44 juju-e4d256-prod-github-runner-207 kernel: [13138.119103] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 09:02:44 juju-e4d256-prod-github-runner-207 kernel: [13138.119911] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:02:44 juju-e4d256-prod-github-runner-207 kernel: [13138.120683] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:02:44 juju-e4d256-prod-github-runner-207 kernel: [13138.121434] ? do_syscall_64+0x69/0xc0 Aug 22 09:02:44 juju-e4d256-prod-github-runner-207 kernel: [13138.122120] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:02:44 juju-e4d256-prod-github-runner-207 kernel: [13138.122878] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:02:44 juju-e4d256-prod-github-runner-207 kernel: [13138.123669] ? do_syscall_64+0x69/0xc0 Aug 22 09:02:44 juju-e4d256-prod-github-runner-207 kernel: [13138.124360] ? do_syscall_64+0x69/0xc0 Aug 22 09:02:44 juju-e4d256-prod-github-runner-207 kernel: [13138.125043] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 09:02:44 juju-e4d256-prod-github-runner-207 kernel: [13138.125810] RIP: 0033:0x7faa5d0edaff Aug 22 09:02:44 juju-e4d256-prod-github-runner-207 kernel: [13138.126530] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 09:02:44 juju-e4d256-prod-github-runner-207 kernel: [13138.128630] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 09:02:44 juju-e4d256-prod-github-runner-207 kernel: [13138.129589] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 09:02:44 juju-e4d256-prod-github-runner-207 kernel: [13138.130542] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 09:02:44 juju-e4d256-prod-github-runner-207 kernel: [13138.131492] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 09:02:44 juju-e4d256-prod-github-runner-207 kernel: [13138.132436] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 09:02:44 juju-e4d256-prod-github-runner-207 kernel: [13138.133364] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 09:02:44 juju-e4d256-prod-github-runner-207 kernel: [13138.134276] Aug 22 09:03:10 juju-e4d256-prod-github-runner-207 kernel: [13164.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 12152s! [qemu-system-x86:6715] Aug 22 09:03:10 juju-e4d256-prod-github-runner-207 kernel: [13164.543897] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 09:03:10 juju-e4d256-prod-github-runner-207 kernel: [13164.544211] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 09:03:10 juju-e4d256-prod-github-runner-207 kernel: [13164.556302] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 09:03:10 juju-e4d256-prod-github-runner-207 kernel: [13164.557566] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 09:03:10 juju-e4d256-prod-github-runner-207 kernel: [13164.558786] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:03:10 juju-e4d256-prod-github-runner-207 kernel: [13164.559847] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 09:03:10 juju-e4d256-prod-github-runner-207 kernel: [13164.562406] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 09:03:10 juju-e4d256-prod-github-runner-207 kernel: [13164.563465] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 09:03:10 juju-e4d256-prod-github-runner-207 kernel: [13164.564626] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 09:03:10 juju-e4d256-prod-github-runner-207 kernel: [13164.565789] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 09:03:10 juju-e4d256-prod-github-runner-207 kernel: [13164.566964] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 09:03:10 juju-e4d256-prod-github-runner-207 kernel: [13164.568142] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 09:03:10 juju-e4d256-prod-github-runner-207 kernel: [13164.569308] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 09:03:10 juju-e4d256-prod-github-runner-207 kernel: [13164.570537] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 09:03:10 juju-e4d256-prod-github-runner-207 kernel: [13164.571645] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 09:03:10 juju-e4d256-prod-github-runner-207 kernel: [13164.572836] Call Trace: Aug 22 09:03:10 juju-e4d256-prod-github-runner-207 kernel: [13164.573752] Aug 22 09:03:10 juju-e4d256-prod-github-runner-207 kernel: [13164.574653] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:03:10 juju-e4d256-prod-github-runner-207 kernel: [13164.575699] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:03:10 juju-e4d256-prod-github-runner-207 kernel: [13164.576717] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:03:10 juju-e4d256-prod-github-runner-207 kernel: [13164.577807] ? show_regs.part.0+0x23/0x29 Aug 22 09:03:10 juju-e4d256-prod-github-runner-207 kernel: [13164.578816] ? show_regs.cold+0x8/0xd Aug 22 09:03:10 juju-e4d256-prod-github-runner-207 kernel: [13164.579879] ? watchdog_timer_fn+0x1be/0x220 Aug 22 09:03:10 juju-e4d256-prod-github-runner-207 kernel: [13164.581004] ? lockup_detector_update_enable+0x60/0x60 Aug 22 09:03:10 juju-e4d256-prod-github-runner-207 kernel: [13164.582079] ? __hrtimer_run_queues+0x107/0x230 Aug 22 09:03:10 juju-e4d256-prod-github-runner-207 kernel: [13164.583118] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 09:03:10 juju-e4d256-prod-github-runner-207 kernel: [13164.584141] ? hrtimer_interrupt+0x101/0x220 Aug 22 09:03:10 juju-e4d256-prod-github-runner-207 kernel: [13164.585160] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 09:03:10 juju-e4d256-prod-github-runner-207 kernel: [13164.586226] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 09:03:10 juju-e4d256-prod-github-runner-207 kernel: [13164.587281] Aug 22 09:03:10 juju-e4d256-prod-github-runner-207 kernel: [13164.588159] Aug 22 09:03:10 juju-e4d256-prod-github-runner-207 kernel: [13164.588998] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 09:03:10 juju-e4d256-prod-github-runner-207 kernel: [13164.590029] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:03:10 juju-e4d256-prod-github-runner-207 kernel: [13164.591105] ? _raw_spin_lock+0x22/0x30 Aug 22 09:03:10 juju-e4d256-prod-github-runner-207 kernel: [13164.592051] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:03:10 juju-e4d256-prod-github-runner-207 kernel: [13164.593066] direct_page_fault+0x206/0x310 [kvm] Aug 22 09:03:10 juju-e4d256-prod-github-runner-207 kernel: [13164.594088] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 09:03:10 juju-e4d256-prod-github-runner-207 kernel: [13164.595106] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 09:03:10 juju-e4d256-prod-github-runner-207 kernel: [13164.596117] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 09:03:10 juju-e4d256-prod-github-runner-207 kernel: [13164.597122] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 09:03:10 juju-e4d256-prod-github-runner-207 kernel: [13164.598081] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 09:03:10 juju-e4d256-prod-github-runner-207 kernel: [13164.599072] handle_exit+0x98/0x230 [kvm_amd] Aug 22 09:03:10 juju-e4d256-prod-github-runner-207 kernel: [13164.599962] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 09:03:10 juju-e4d256-prod-github-runner-207 kernel: [13164.600874] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 09:03:10 juju-e4d256-prod-github-runner-207 kernel: [13164.601793] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 09:03:10 juju-e4d256-prod-github-runner-207 kernel: [13164.602699] vcpu_run+0x62/0x2c0 [kvm] Aug 22 09:03:10 juju-e4d256-prod-github-runner-207 kernel: [13164.603517] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 09:03:10 juju-e4d256-prod-github-runner-207 kernel: [13164.604322] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 09:03:10 juju-e4d256-prod-github-runner-207 kernel: [13164.605183] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 09:03:10 juju-e4d256-prod-github-runner-207 kernel: [13164.605977] ? __seccomp_filter+0x4a/0x4a0 Aug 22 09:03:10 juju-e4d256-prod-github-runner-207 kernel: [13164.606716] ? __fget_files+0x86/0xc0 Aug 22 09:03:10 juju-e4d256-prod-github-runner-207 kernel: [13164.607443] __x64_sys_ioctl+0x95/0xd0 Aug 22 09:03:10 juju-e4d256-prod-github-runner-207 kernel: [13164.608143] do_syscall_64+0x5c/0xc0 Aug 22 09:03:10 juju-e4d256-prod-github-runner-207 kernel: [13164.608805] ? do_futex+0x162/0x1f0 Aug 22 09:03:10 juju-e4d256-prod-github-runner-207 kernel: [13164.609457] ? __x64_sys_futex+0x78/0x1e0 Aug 22 09:03:10 juju-e4d256-prod-github-runner-207 kernel: [13164.610127] ? __secure_computing+0xa9/0x120 Aug 22 09:03:10 juju-e4d256-prod-github-runner-207 kernel: [13164.610852] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 09:03:10 juju-e4d256-prod-github-runner-207 kernel: [13164.611624] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:03:10 juju-e4d256-prod-github-runner-207 kernel: [13164.612342] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:03:10 juju-e4d256-prod-github-runner-207 kernel: [13164.613061] ? do_syscall_64+0x69/0xc0 Aug 22 09:03:10 juju-e4d256-prod-github-runner-207 kernel: [13164.613704] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:03:10 juju-e4d256-prod-github-runner-207 kernel: [13164.614403] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:03:10 juju-e4d256-prod-github-runner-207 kernel: [13164.615128] ? do_syscall_64+0x69/0xc0 Aug 22 09:03:10 juju-e4d256-prod-github-runner-207 kernel: [13164.615774] ? do_syscall_64+0x69/0xc0 Aug 22 09:03:10 juju-e4d256-prod-github-runner-207 kernel: [13164.616408] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 09:03:10 juju-e4d256-prod-github-runner-207 kernel: [13164.617110] RIP: 0033:0x7faa5d0edaff Aug 22 09:03:10 juju-e4d256-prod-github-runner-207 kernel: [13164.617767] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 09:03:10 juju-e4d256-prod-github-runner-207 kernel: [13164.619761] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 09:03:10 juju-e4d256-prod-github-runner-207 kernel: [13164.620673] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 09:03:10 juju-e4d256-prod-github-runner-207 kernel: [13164.621565] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 09:03:10 juju-e4d256-prod-github-runner-207 kernel: [13164.622454] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 09:03:10 juju-e4d256-prod-github-runner-207 kernel: [13164.623364] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 09:03:10 juju-e4d256-prod-github-runner-207 kernel: [13164.624250] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 09:03:10 juju-e4d256-prod-github-runner-207 kernel: [13164.625139] Aug 22 09:03:38 juju-e4d256-prod-github-runner-207 kernel: [13192.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 12178s! [qemu-system-x86:6715] Aug 22 09:03:38 juju-e4d256-prod-github-runner-207 kernel: [13192.543920] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 09:03:38 juju-e4d256-prod-github-runner-207 kernel: [13192.544237] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 09:03:38 juju-e4d256-prod-github-runner-207 kernel: [13192.556367] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 09:03:38 juju-e4d256-prod-github-runner-207 kernel: [13192.557626] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 09:03:38 juju-e4d256-prod-github-runner-207 kernel: [13192.558873] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:03:38 juju-e4d256-prod-github-runner-207 kernel: [13192.559932] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 09:03:38 juju-e4d256-prod-github-runner-207 kernel: [13192.562484] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 09:03:38 juju-e4d256-prod-github-runner-207 kernel: [13192.563525] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 09:03:38 juju-e4d256-prod-github-runner-207 kernel: [13192.564699] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 09:03:38 juju-e4d256-prod-github-runner-207 kernel: [13192.565855] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 09:03:38 juju-e4d256-prod-github-runner-207 kernel: [13192.567027] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 09:03:38 juju-e4d256-prod-github-runner-207 kernel: [13192.568187] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 09:03:38 juju-e4d256-prod-github-runner-207 kernel: [13192.569354] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 09:03:38 juju-e4d256-prod-github-runner-207 kernel: [13192.570598] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 09:03:38 juju-e4d256-prod-github-runner-207 kernel: [13192.571711] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 09:03:38 juju-e4d256-prod-github-runner-207 kernel: [13192.572899] Call Trace: Aug 22 09:03:38 juju-e4d256-prod-github-runner-207 kernel: [13192.573810] Aug 22 09:03:38 juju-e4d256-prod-github-runner-207 kernel: [13192.574744] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:03:38 juju-e4d256-prod-github-runner-207 kernel: [13192.575781] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:03:38 juju-e4d256-prod-github-runner-207 kernel: [13192.576801] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:03:38 juju-e4d256-prod-github-runner-207 kernel: [13192.577896] ? show_regs.part.0+0x23/0x29 Aug 22 09:03:38 juju-e4d256-prod-github-runner-207 kernel: [13192.578905] ? show_regs.cold+0x8/0xd Aug 22 09:03:38 juju-e4d256-prod-github-runner-207 kernel: [13192.579928] ? watchdog_timer_fn+0x1be/0x220 Aug 22 09:03:38 juju-e4d256-prod-github-runner-207 kernel: [13192.580944] ? lockup_detector_update_enable+0x60/0x60 Aug 22 09:03:38 juju-e4d256-prod-github-runner-207 kernel: [13192.582021] ? __hrtimer_run_queues+0x107/0x230 Aug 22 09:03:38 juju-e4d256-prod-github-runner-207 kernel: [13192.583071] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 09:03:38 juju-e4d256-prod-github-runner-207 kernel: [13192.584115] ? hrtimer_interrupt+0x101/0x220 Aug 22 09:03:38 juju-e4d256-prod-github-runner-207 kernel: [13192.585152] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 09:03:38 juju-e4d256-prod-github-runner-207 kernel: [13192.586255] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 09:03:38 juju-e4d256-prod-github-runner-207 kernel: [13192.587533] Aug 22 09:03:38 juju-e4d256-prod-github-runner-207 kernel: [13192.588406] Aug 22 09:03:38 juju-e4d256-prod-github-runner-207 kernel: [13192.589260] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 09:03:38 juju-e4d256-prod-github-runner-207 kernel: [13192.590315] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:03:38 juju-e4d256-prod-github-runner-207 kernel: [13192.591399] ? _raw_spin_lock+0x22/0x30 Aug 22 09:03:38 juju-e4d256-prod-github-runner-207 kernel: [13192.592370] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:03:38 juju-e4d256-prod-github-runner-207 kernel: [13192.593390] direct_page_fault+0x206/0x310 [kvm] Aug 22 09:03:38 juju-e4d256-prod-github-runner-207 kernel: [13192.594432] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 09:03:38 juju-e4d256-prod-github-runner-207 kernel: [13192.595487] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 09:03:38 juju-e4d256-prod-github-runner-207 kernel: [13192.596496] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 09:03:38 juju-e4d256-prod-github-runner-207 kernel: [13192.597691] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 09:03:38 juju-e4d256-prod-github-runner-207 kernel: [13192.598682] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 09:03:38 juju-e4d256-prod-github-runner-207 kernel: [13192.599705] handle_exit+0x98/0x230 [kvm_amd] Aug 22 09:03:38 juju-e4d256-prod-github-runner-207 kernel: [13192.600640] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 09:03:38 juju-e4d256-prod-github-runner-207 kernel: [13192.601558] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 09:03:38 juju-e4d256-prod-github-runner-207 kernel: [13192.602514] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 09:03:38 juju-e4d256-prod-github-runner-207 kernel: [13192.603429] vcpu_run+0x62/0x2c0 [kvm] Aug 22 09:03:38 juju-e4d256-prod-github-runner-207 kernel: [13192.604271] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 09:03:38 juju-e4d256-prod-github-runner-207 kernel: [13192.605108] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 09:03:38 juju-e4d256-prod-github-runner-207 kernel: [13192.605970] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 09:03:38 juju-e4d256-prod-github-runner-207 kernel: [13192.606789] ? __seccomp_filter+0x4a/0x4a0 Aug 22 09:03:38 juju-e4d256-prod-github-runner-207 kernel: [13192.607536] ? __fget_files+0x86/0xc0 Aug 22 09:03:38 juju-e4d256-prod-github-runner-207 kernel: [13192.608241] __x64_sys_ioctl+0x95/0xd0 Aug 22 09:03:38 juju-e4d256-prod-github-runner-207 kernel: [13192.608936] do_syscall_64+0x5c/0xc0 Aug 22 09:03:38 juju-e4d256-prod-github-runner-207 kernel: [13192.609616] ? do_futex+0x162/0x1f0 Aug 22 09:03:38 juju-e4d256-prod-github-runner-207 kernel: [13192.610302] ? __x64_sys_futex+0x78/0x1e0 Aug 22 09:03:38 juju-e4d256-prod-github-runner-207 kernel: [13192.611029] ? __secure_computing+0xa9/0x120 Aug 22 09:03:38 juju-e4d256-prod-github-runner-207 kernel: [13192.611763] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 09:03:38 juju-e4d256-prod-github-runner-207 kernel: [13192.612540] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:03:38 juju-e4d256-prod-github-runner-207 kernel: [13192.613328] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:03:38 juju-e4d256-prod-github-runner-207 kernel: [13192.614053] ? do_syscall_64+0x69/0xc0 Aug 22 09:03:38 juju-e4d256-prod-github-runner-207 kernel: [13192.614754] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:03:38 juju-e4d256-prod-github-runner-207 kernel: [13192.615493] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:03:38 juju-e4d256-prod-github-runner-207 kernel: [13192.616202] ? do_syscall_64+0x69/0xc0 Aug 22 09:03:38 juju-e4d256-prod-github-runner-207 kernel: [13192.616827] ? do_syscall_64+0x69/0xc0 Aug 22 09:03:38 juju-e4d256-prod-github-runner-207 kernel: [13192.617482] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 09:03:38 juju-e4d256-prod-github-runner-207 kernel: [13192.618205] RIP: 0033:0x7faa5d0edaff Aug 22 09:03:38 juju-e4d256-prod-github-runner-207 kernel: [13192.618889] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 09:03:38 juju-e4d256-prod-github-runner-207 kernel: [13192.620918] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 09:03:38 juju-e4d256-prod-github-runner-207 kernel: [13192.621843] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 09:03:38 juju-e4d256-prod-github-runner-207 kernel: [13192.622779] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 09:03:38 juju-e4d256-prod-github-runner-207 kernel: [13192.623687] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 09:03:38 juju-e4d256-prod-github-runner-207 kernel: [13192.624621] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 09:03:38 juju-e4d256-prod-github-runner-207 kernel: [13192.625540] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 09:03:38 juju-e4d256-prod-github-runner-207 kernel: [13192.626507] Aug 22 09:04:06 juju-e4d256-prod-github-runner-207 kernel: [13220.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 12204s! [qemu-system-x86:6715] Aug 22 09:04:06 juju-e4d256-prod-github-runner-207 kernel: [13220.543887] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 09:04:06 juju-e4d256-prod-github-runner-207 kernel: [13220.544189] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 09:04:06 juju-e4d256-prod-github-runner-207 kernel: [13220.556549] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 09:04:06 juju-e4d256-prod-github-runner-207 kernel: [13220.557842] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 09:04:06 juju-e4d256-prod-github-runner-207 kernel: [13220.559095] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:04:06 juju-e4d256-prod-github-runner-207 kernel: [13220.560227] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 09:04:06 juju-e4d256-prod-github-runner-207 kernel: [13220.562838] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 09:04:06 juju-e4d256-prod-github-runner-207 kernel: [13220.563900] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 09:04:06 juju-e4d256-prod-github-runner-207 kernel: [13220.565112] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 09:04:06 juju-e4d256-prod-github-runner-207 kernel: [13220.566329] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 09:04:06 juju-e4d256-prod-github-runner-207 kernel: [13220.567515] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 09:04:06 juju-e4d256-prod-github-runner-207 kernel: [13220.568702] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 09:04:06 juju-e4d256-prod-github-runner-207 kernel: [13220.569920] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 09:04:06 juju-e4d256-prod-github-runner-207 kernel: [13220.571192] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 09:04:06 juju-e4d256-prod-github-runner-207 kernel: [13220.572311] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 09:04:06 juju-e4d256-prod-github-runner-207 kernel: [13220.573526] Call Trace: Aug 22 09:04:06 juju-e4d256-prod-github-runner-207 kernel: [13220.574454] Aug 22 09:04:06 juju-e4d256-prod-github-runner-207 kernel: [13220.575362] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:04:06 juju-e4d256-prod-github-runner-207 kernel: [13220.576403] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:04:06 juju-e4d256-prod-github-runner-207 kernel: [13220.577439] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:04:06 juju-e4d256-prod-github-runner-207 kernel: [13220.578564] ? show_regs.part.0+0x23/0x29 Aug 22 09:04:06 juju-e4d256-prod-github-runner-207 kernel: [13220.579571] ? show_regs.cold+0x8/0xd Aug 22 09:04:06 juju-e4d256-prod-github-runner-207 kernel: [13220.580550] ? watchdog_timer_fn+0x1be/0x220 Aug 22 09:04:06 juju-e4d256-prod-github-runner-207 kernel: [13220.581568] ? lockup_detector_update_enable+0x60/0x60 Aug 22 09:04:06 juju-e4d256-prod-github-runner-207 kernel: [13220.582656] ? __hrtimer_run_queues+0x107/0x230 Aug 22 09:04:06 juju-e4d256-prod-github-runner-207 kernel: [13220.583718] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 09:04:06 juju-e4d256-prod-github-runner-207 kernel: [13220.584762] ? hrtimer_interrupt+0x101/0x220 Aug 22 09:04:06 juju-e4d256-prod-github-runner-207 kernel: [13220.585788] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 09:04:06 juju-e4d256-prod-github-runner-207 kernel: [13220.586887] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 09:04:06 juju-e4d256-prod-github-runner-207 kernel: [13220.587950] Aug 22 09:04:06 juju-e4d256-prod-github-runner-207 kernel: [13220.588808] Aug 22 09:04:06 juju-e4d256-prod-github-runner-207 kernel: [13220.589650] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 09:04:06 juju-e4d256-prod-github-runner-207 kernel: [13220.590716] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:04:06 juju-e4d256-prod-github-runner-207 kernel: [13220.591773] ? _raw_spin_lock+0x22/0x30 Aug 22 09:04:06 juju-e4d256-prod-github-runner-207 kernel: [13220.592735] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:04:06 juju-e4d256-prod-github-runner-207 kernel: [13220.593778] direct_page_fault+0x206/0x310 [kvm] Aug 22 09:04:06 juju-e4d256-prod-github-runner-207 kernel: [13220.594832] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 09:04:06 juju-e4d256-prod-github-runner-207 kernel: [13220.595852] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 09:04:06 juju-e4d256-prod-github-runner-207 kernel: [13220.596870] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 09:04:06 juju-e4d256-prod-github-runner-207 kernel: [13220.597880] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 09:04:06 juju-e4d256-prod-github-runner-207 kernel: [13220.598860] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 09:04:06 juju-e4d256-prod-github-runner-207 kernel: [13220.599853] handle_exit+0x98/0x230 [kvm_amd] Aug 22 09:04:06 juju-e4d256-prod-github-runner-207 kernel: [13220.600755] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 09:04:06 juju-e4d256-prod-github-runner-207 kernel: [13220.601674] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 09:04:06 juju-e4d256-prod-github-runner-207 kernel: [13220.602623] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 09:04:06 juju-e4d256-prod-github-runner-207 kernel: [13220.603536] vcpu_run+0x62/0x2c0 [kvm] Aug 22 09:04:06 juju-e4d256-prod-github-runner-207 kernel: [13220.604355] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 09:04:06 juju-e4d256-prod-github-runner-207 kernel: [13220.605172] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 09:04:06 juju-e4d256-prod-github-runner-207 kernel: [13220.606051] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 09:04:06 juju-e4d256-prod-github-runner-207 kernel: [13220.606868] ? __seccomp_filter+0x4a/0x4a0 Aug 22 09:04:06 juju-e4d256-prod-github-runner-207 kernel: [13220.607623] ? __fget_files+0x86/0xc0 Aug 22 09:04:06 juju-e4d256-prod-github-runner-207 kernel: [13220.608335] __x64_sys_ioctl+0x95/0xd0 Aug 22 09:04:06 juju-e4d256-prod-github-runner-207 kernel: [13220.609041] do_syscall_64+0x5c/0xc0 Aug 22 09:04:06 juju-e4d256-prod-github-runner-207 kernel: [13220.609715] ? do_futex+0x162/0x1f0 Aug 22 09:04:06 juju-e4d256-prod-github-runner-207 kernel: [13220.610378] ? __x64_sys_futex+0x78/0x1e0 Aug 22 09:04:06 juju-e4d256-prod-github-runner-207 kernel: [13220.611062] ? __secure_computing+0xa9/0x120 Aug 22 09:04:06 juju-e4d256-prod-github-runner-207 kernel: [13220.611758] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 09:04:06 juju-e4d256-prod-github-runner-207 kernel: [13220.612534] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:04:06 juju-e4d256-prod-github-runner-207 kernel: [13220.613267] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:04:06 juju-e4d256-prod-github-runner-207 kernel: [13220.613994] ? do_syscall_64+0x69/0xc0 Aug 22 09:04:06 juju-e4d256-prod-github-runner-207 kernel: [13220.614669] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:04:06 juju-e4d256-prod-github-runner-207 kernel: [13220.615557] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:04:06 juju-e4d256-prod-github-runner-207 kernel: [13220.616280] ? do_syscall_64+0x69/0xc0 Aug 22 09:04:06 juju-e4d256-prod-github-runner-207 kernel: [13220.616918] ? do_syscall_64+0x69/0xc0 Aug 22 09:04:06 juju-e4d256-prod-github-runner-207 kernel: [13220.617551] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 09:04:06 juju-e4d256-prod-github-runner-207 kernel: [13220.618277] RIP: 0033:0x7faa5d0edaff Aug 22 09:04:06 juju-e4d256-prod-github-runner-207 kernel: [13220.618935] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 09:04:06 juju-e4d256-prod-github-runner-207 kernel: [13220.620963] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 09:04:06 juju-e4d256-prod-github-runner-207 kernel: [13220.621892] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 09:04:06 juju-e4d256-prod-github-runner-207 kernel: [13220.622809] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 09:04:06 juju-e4d256-prod-github-runner-207 kernel: [13220.623713] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 09:04:06 juju-e4d256-prod-github-runner-207 kernel: [13220.624624] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 09:04:06 juju-e4d256-prod-github-runner-207 kernel: [13220.625529] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 09:04:06 juju-e4d256-prod-github-runner-207 kernel: [13220.626452] Aug 22 09:04:34 juju-e4d256-prod-github-runner-207 kernel: [13248.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 12230s! [qemu-system-x86:6715] Aug 22 09:04:34 juju-e4d256-prod-github-runner-207 kernel: [13248.543848] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 09:04:34 juju-e4d256-prod-github-runner-207 kernel: [13248.544151] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 09:04:34 juju-e4d256-prod-github-runner-207 kernel: [13248.556302] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 09:04:34 juju-e4d256-prod-github-runner-207 kernel: [13248.557593] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 09:04:34 juju-e4d256-prod-github-runner-207 kernel: [13248.558855] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:04:34 juju-e4d256-prod-github-runner-207 kernel: [13248.559916] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 09:04:34 juju-e4d256-prod-github-runner-207 kernel: [13248.562517] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 09:04:34 juju-e4d256-prod-github-runner-207 kernel: [13248.563568] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 09:04:34 juju-e4d256-prod-github-runner-207 kernel: [13248.564728] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 09:04:34 juju-e4d256-prod-github-runner-207 kernel: [13248.565910] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 09:04:34 juju-e4d256-prod-github-runner-207 kernel: [13248.567093] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 09:04:34 juju-e4d256-prod-github-runner-207 kernel: [13248.568312] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 09:04:34 juju-e4d256-prod-github-runner-207 kernel: [13248.569479] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 09:04:34 juju-e4d256-prod-github-runner-207 kernel: [13248.570738] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 09:04:34 juju-e4d256-prod-github-runner-207 kernel: [13248.571841] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 09:04:34 juju-e4d256-prod-github-runner-207 kernel: [13248.573031] Call Trace: Aug 22 09:04:34 juju-e4d256-prod-github-runner-207 kernel: [13248.573966] Aug 22 09:04:34 juju-e4d256-prod-github-runner-207 kernel: [13248.574884] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:04:34 juju-e4d256-prod-github-runner-207 kernel: [13248.575919] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:04:34 juju-e4d256-prod-github-runner-207 kernel: [13248.576946] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:04:34 juju-e4d256-prod-github-runner-207 kernel: [13248.578103] ? show_regs.part.0+0x23/0x29 Aug 22 09:04:34 juju-e4d256-prod-github-runner-207 kernel: [13248.579110] ? show_regs.cold+0x8/0xd Aug 22 09:04:34 juju-e4d256-prod-github-runner-207 kernel: [13248.580087] ? watchdog_timer_fn+0x1be/0x220 Aug 22 09:04:34 juju-e4d256-prod-github-runner-207 kernel: [13248.581135] ? lockup_detector_update_enable+0x60/0x60 Aug 22 09:04:34 juju-e4d256-prod-github-runner-207 kernel: [13248.582225] ? __hrtimer_run_queues+0x107/0x230 Aug 22 09:04:34 juju-e4d256-prod-github-runner-207 kernel: [13248.583260] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 09:04:34 juju-e4d256-prod-github-runner-207 kernel: [13248.584306] ? hrtimer_interrupt+0x101/0x220 Aug 22 09:04:34 juju-e4d256-prod-github-runner-207 kernel: [13248.585348] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 09:04:34 juju-e4d256-prod-github-runner-207 kernel: [13248.586467] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 09:04:34 juju-e4d256-prod-github-runner-207 kernel: [13248.587550] Aug 22 09:04:34 juju-e4d256-prod-github-runner-207 kernel: [13248.588427] Aug 22 09:04:34 juju-e4d256-prod-github-runner-207 kernel: [13248.589279] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 09:04:34 juju-e4d256-prod-github-runner-207 kernel: [13248.590333] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:04:34 juju-e4d256-prod-github-runner-207 kernel: [13248.591373] ? _raw_spin_lock+0x22/0x30 Aug 22 09:04:34 juju-e4d256-prod-github-runner-207 kernel: [13248.592333] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:04:34 juju-e4d256-prod-github-runner-207 kernel: [13248.593353] direct_page_fault+0x206/0x310 [kvm] Aug 22 09:04:34 juju-e4d256-prod-github-runner-207 kernel: [13248.594473] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 09:04:34 juju-e4d256-prod-github-runner-207 kernel: [13248.595482] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 09:04:34 juju-e4d256-prod-github-runner-207 kernel: [13248.596519] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 09:04:34 juju-e4d256-prod-github-runner-207 kernel: [13248.597529] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 09:04:34 juju-e4d256-prod-github-runner-207 kernel: [13248.598522] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 09:04:34 juju-e4d256-prod-github-runner-207 kernel: [13248.599525] handle_exit+0x98/0x230 [kvm_amd] Aug 22 09:04:34 juju-e4d256-prod-github-runner-207 kernel: [13248.600472] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 09:04:34 juju-e4d256-prod-github-runner-207 kernel: [13248.601417] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 09:04:34 juju-e4d256-prod-github-runner-207 kernel: [13248.602374] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 09:04:34 juju-e4d256-prod-github-runner-207 kernel: [13248.603296] vcpu_run+0x62/0x2c0 [kvm] Aug 22 09:04:34 juju-e4d256-prod-github-runner-207 kernel: [13248.604126] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 09:04:34 juju-e4d256-prod-github-runner-207 kernel: [13248.605011] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 09:04:34 juju-e4d256-prod-github-runner-207 kernel: [13248.605921] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 09:04:34 juju-e4d256-prod-github-runner-207 kernel: [13248.606735] ? __seccomp_filter+0x4a/0x4a0 Aug 22 09:04:34 juju-e4d256-prod-github-runner-207 kernel: [13248.607500] ? __fget_files+0x86/0xc0 Aug 22 09:04:34 juju-e4d256-prod-github-runner-207 kernel: [13248.608204] __x64_sys_ioctl+0x95/0xd0 Aug 22 09:04:34 juju-e4d256-prod-github-runner-207 kernel: [13248.608897] do_syscall_64+0x5c/0xc0 Aug 22 09:04:34 juju-e4d256-prod-github-runner-207 kernel: [13248.609573] ? do_futex+0x162/0x1f0 Aug 22 09:04:34 juju-e4d256-prod-github-runner-207 kernel: [13248.610244] ? __x64_sys_futex+0x78/0x1e0 Aug 22 09:04:34 juju-e4d256-prod-github-runner-207 kernel: [13248.610954] ? __secure_computing+0xa9/0x120 Aug 22 09:04:34 juju-e4d256-prod-github-runner-207 kernel: [13248.611648] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 09:04:34 juju-e4d256-prod-github-runner-207 kernel: [13248.612408] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:04:34 juju-e4d256-prod-github-runner-207 kernel: [13248.613129] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:04:34 juju-e4d256-prod-github-runner-207 kernel: [13248.613866] ? do_syscall_64+0x69/0xc0 Aug 22 09:04:34 juju-e4d256-prod-github-runner-207 kernel: [13248.614522] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:04:34 juju-e4d256-prod-github-runner-207 kernel: [13248.615222] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:04:34 juju-e4d256-prod-github-runner-207 kernel: [13248.615915] ? do_syscall_64+0x69/0xc0 Aug 22 09:04:34 juju-e4d256-prod-github-runner-207 kernel: [13248.616536] ? do_syscall_64+0x69/0xc0 Aug 22 09:04:34 juju-e4d256-prod-github-runner-207 kernel: [13248.617157] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 09:04:34 juju-e4d256-prod-github-runner-207 kernel: [13248.617887] RIP: 0033:0x7faa5d0edaff Aug 22 09:04:34 juju-e4d256-prod-github-runner-207 kernel: [13248.618546] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 09:04:34 juju-e4d256-prod-github-runner-207 kernel: [13248.620537] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 09:04:34 juju-e4d256-prod-github-runner-207 kernel: [13248.621451] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 09:04:34 juju-e4d256-prod-github-runner-207 kernel: [13248.622354] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 09:04:34 juju-e4d256-prod-github-runner-207 kernel: [13248.623240] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 09:04:34 juju-e4d256-prod-github-runner-207 kernel: [13248.624124] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 09:04:34 juju-e4d256-prod-github-runner-207 kernel: [13248.625010] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 09:04:34 juju-e4d256-prod-github-runner-207 kernel: [13248.625912] Aug 22 09:05:02 juju-e4d256-prod-github-runner-207 kernel: [13276.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 12256s! [qemu-system-x86:6715] Aug 22 09:05:02 juju-e4d256-prod-github-runner-207 kernel: [13276.543867] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 09:05:02 juju-e4d256-prod-github-runner-207 kernel: [13276.544148] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 09:05:02 juju-e4d256-prod-github-runner-207 kernel: [13276.557416] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 09:05:02 juju-e4d256-prod-github-runner-207 kernel: [13276.558731] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 09:05:02 juju-e4d256-prod-github-runner-207 kernel: [13276.559977] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:05:02 juju-e4d256-prod-github-runner-207 kernel: [13276.561046] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 09:05:02 juju-e4d256-prod-github-runner-207 kernel: [13276.563662] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 09:05:02 juju-e4d256-prod-github-runner-207 kernel: [13276.564716] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 09:05:02 juju-e4d256-prod-github-runner-207 kernel: [13276.565913] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 09:05:02 juju-e4d256-prod-github-runner-207 kernel: [13276.567111] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 09:05:02 juju-e4d256-prod-github-runner-207 kernel: [13276.568288] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 09:05:02 juju-e4d256-prod-github-runner-207 kernel: [13276.569489] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 09:05:02 juju-e4d256-prod-github-runner-207 kernel: [13276.570874] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 09:05:02 juju-e4d256-prod-github-runner-207 kernel: [13276.572157] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 09:05:02 juju-e4d256-prod-github-runner-207 kernel: [13276.573267] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 09:05:02 juju-e4d256-prod-github-runner-207 kernel: [13276.574502] Call Trace: Aug 22 09:05:02 juju-e4d256-prod-github-runner-207 kernel: [13276.575420] Aug 22 09:05:02 juju-e4d256-prod-github-runner-207 kernel: [13276.576318] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:05:02 juju-e4d256-prod-github-runner-207 kernel: [13276.577346] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:05:02 juju-e4d256-prod-github-runner-207 kernel: [13276.578390] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:05:02 juju-e4d256-prod-github-runner-207 kernel: [13276.579488] ? show_regs.part.0+0x23/0x29 Aug 22 09:05:02 juju-e4d256-prod-github-runner-207 kernel: [13276.580488] ? show_regs.cold+0x8/0xd Aug 22 09:05:02 juju-e4d256-prod-github-runner-207 kernel: [13276.581480] ? watchdog_timer_fn+0x1be/0x220 Aug 22 09:05:02 juju-e4d256-prod-github-runner-207 kernel: [13276.582500] ? lockup_detector_update_enable+0x60/0x60 Aug 22 09:05:02 juju-e4d256-prod-github-runner-207 kernel: [13276.583562] ? __hrtimer_run_queues+0x107/0x230 Aug 22 09:05:02 juju-e4d256-prod-github-runner-207 kernel: [13276.584588] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 09:05:02 juju-e4d256-prod-github-runner-207 kernel: [13276.585644] ? hrtimer_interrupt+0x101/0x220 Aug 22 09:05:02 juju-e4d256-prod-github-runner-207 kernel: [13276.586666] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 09:05:02 juju-e4d256-prod-github-runner-207 kernel: [13276.587733] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 09:05:02 juju-e4d256-prod-github-runner-207 kernel: [13276.588779] Aug 22 09:05:02 juju-e4d256-prod-github-runner-207 kernel: [13276.589650] Aug 22 09:05:02 juju-e4d256-prod-github-runner-207 kernel: [13276.590497] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 09:05:02 juju-e4d256-prod-github-runner-207 kernel: [13276.591537] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:05:02 juju-e4d256-prod-github-runner-207 kernel: [13276.592574] ? _raw_spin_lock+0x22/0x30 Aug 22 09:05:02 juju-e4d256-prod-github-runner-207 kernel: [13276.593561] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:05:02 juju-e4d256-prod-github-runner-207 kernel: [13276.594582] direct_page_fault+0x206/0x310 [kvm] Aug 22 09:05:02 juju-e4d256-prod-github-runner-207 kernel: [13276.595619] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 09:05:02 juju-e4d256-prod-github-runner-207 kernel: [13276.596633] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 09:05:02 juju-e4d256-prod-github-runner-207 kernel: [13276.597650] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 09:05:02 juju-e4d256-prod-github-runner-207 kernel: [13276.598656] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 09:05:02 juju-e4d256-prod-github-runner-207 kernel: [13276.599601] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 09:05:02 juju-e4d256-prod-github-runner-207 kernel: [13276.600579] handle_exit+0x98/0x230 [kvm_amd] Aug 22 09:05:02 juju-e4d256-prod-github-runner-207 kernel: [13276.601544] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 09:05:02 juju-e4d256-prod-github-runner-207 kernel: [13276.602578] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 09:05:02 juju-e4d256-prod-github-runner-207 kernel: [13276.603523] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 09:05:02 juju-e4d256-prod-github-runner-207 kernel: [13276.604431] vcpu_run+0x62/0x2c0 [kvm] Aug 22 09:05:02 juju-e4d256-prod-github-runner-207 kernel: [13276.605243] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 09:05:02 juju-e4d256-prod-github-runner-207 kernel: [13276.606060] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 09:05:02 juju-e4d256-prod-github-runner-207 kernel: [13276.606912] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 09:05:02 juju-e4d256-prod-github-runner-207 kernel: [13276.607720] ? __seccomp_filter+0x4a/0x4a0 Aug 22 09:05:02 juju-e4d256-prod-github-runner-207 kernel: [13276.608481] ? __fget_files+0x86/0xc0 Aug 22 09:05:02 juju-e4d256-prod-github-runner-207 kernel: [13276.609184] __x64_sys_ioctl+0x95/0xd0 Aug 22 09:05:02 juju-e4d256-prod-github-runner-207 kernel: [13276.609881] do_syscall_64+0x5c/0xc0 Aug 22 09:05:02 juju-e4d256-prod-github-runner-207 kernel: [13276.610582] ? do_futex+0x162/0x1f0 Aug 22 09:05:02 juju-e4d256-prod-github-runner-207 kernel: [13276.611234] ? __x64_sys_futex+0x78/0x1e0 Aug 22 09:05:02 juju-e4d256-prod-github-runner-207 kernel: [13276.611909] ? __secure_computing+0xa9/0x120 Aug 22 09:05:02 juju-e4d256-prod-github-runner-207 kernel: [13276.612595] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 09:05:02 juju-e4d256-prod-github-runner-207 kernel: [13276.613362] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:05:02 juju-e4d256-prod-github-runner-207 kernel: [13276.614095] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:05:02 juju-e4d256-prod-github-runner-207 kernel: [13276.614812] ? do_syscall_64+0x69/0xc0 Aug 22 09:05:02 juju-e4d256-prod-github-runner-207 kernel: [13276.615455] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:05:02 juju-e4d256-prod-github-runner-207 kernel: [13276.616157] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:05:02 juju-e4d256-prod-github-runner-207 kernel: [13276.616849] ? do_syscall_64+0x69/0xc0 Aug 22 09:05:02 juju-e4d256-prod-github-runner-207 kernel: [13276.617496] ? do_syscall_64+0x69/0xc0 Aug 22 09:05:02 juju-e4d256-prod-github-runner-207 kernel: [13276.618117] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 09:05:02 juju-e4d256-prod-github-runner-207 kernel: [13276.618823] RIP: 0033:0x7faa5d0edaff Aug 22 09:05:02 juju-e4d256-prod-github-runner-207 kernel: [13276.619506] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 09:05:02 juju-e4d256-prod-github-runner-207 kernel: [13276.621530] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 09:05:02 juju-e4d256-prod-github-runner-207 kernel: [13276.622441] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 09:05:02 juju-e4d256-prod-github-runner-207 kernel: [13276.623332] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 09:05:02 juju-e4d256-prod-github-runner-207 kernel: [13276.624220] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 09:05:02 juju-e4d256-prod-github-runner-207 kernel: [13276.625114] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 09:05:02 juju-e4d256-prod-github-runner-207 kernel: [13276.626018] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 09:05:02 juju-e4d256-prod-github-runner-207 kernel: [13276.626913] Aug 22 09:05:30 juju-e4d256-prod-github-runner-207 kernel: [13304.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 12282s! [qemu-system-x86:6715] Aug 22 09:05:30 juju-e4d256-prod-github-runner-207 kernel: [13304.543879] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 09:05:30 juju-e4d256-prod-github-runner-207 kernel: [13304.544185] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 09:05:30 juju-e4d256-prod-github-runner-207 kernel: [13304.556574] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 09:05:30 juju-e4d256-prod-github-runner-207 kernel: [13304.557867] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 09:05:30 juju-e4d256-prod-github-runner-207 kernel: [13304.559157] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:05:30 juju-e4d256-prod-github-runner-207 kernel: [13304.560227] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 09:05:30 juju-e4d256-prod-github-runner-207 kernel: [13304.562824] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 09:05:30 juju-e4d256-prod-github-runner-207 kernel: [13304.563890] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 09:05:30 juju-e4d256-prod-github-runner-207 kernel: [13304.565080] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 09:05:30 juju-e4d256-prod-github-runner-207 kernel: [13304.566269] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 09:05:30 juju-e4d256-prod-github-runner-207 kernel: [13304.567439] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 09:05:30 juju-e4d256-prod-github-runner-207 kernel: [13304.568613] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 09:05:30 juju-e4d256-prod-github-runner-207 kernel: [13304.569811] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 09:05:30 juju-e4d256-prod-github-runner-207 kernel: [13304.571082] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 09:05:30 juju-e4d256-prod-github-runner-207 kernel: [13304.572227] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 09:05:30 juju-e4d256-prod-github-runner-207 kernel: [13304.573455] Call Trace: Aug 22 09:05:30 juju-e4d256-prod-github-runner-207 kernel: [13304.574370] Aug 22 09:05:30 juju-e4d256-prod-github-runner-207 kernel: [13304.575281] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:05:30 juju-e4d256-prod-github-runner-207 kernel: [13304.576335] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:05:30 juju-e4d256-prod-github-runner-207 kernel: [13304.577388] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:05:30 juju-e4d256-prod-github-runner-207 kernel: [13304.578496] ? show_regs.part.0+0x23/0x29 Aug 22 09:05:30 juju-e4d256-prod-github-runner-207 kernel: [13304.579518] ? show_regs.cold+0x8/0xd Aug 22 09:05:30 juju-e4d256-prod-github-runner-207 kernel: [13304.580511] ? watchdog_timer_fn+0x1be/0x220 Aug 22 09:05:30 juju-e4d256-prod-github-runner-207 kernel: [13304.581554] ? lockup_detector_update_enable+0x60/0x60 Aug 22 09:05:30 juju-e4d256-prod-github-runner-207 kernel: [13304.582629] ? __hrtimer_run_queues+0x107/0x230 Aug 22 09:05:30 juju-e4d256-prod-github-runner-207 kernel: [13304.583665] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 09:05:30 juju-e4d256-prod-github-runner-207 kernel: [13304.584694] ? hrtimer_interrupt+0x101/0x220 Aug 22 09:05:30 juju-e4d256-prod-github-runner-207 kernel: [13304.585720] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 09:05:30 juju-e4d256-prod-github-runner-207 kernel: [13304.586838] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 09:05:30 juju-e4d256-prod-github-runner-207 kernel: [13304.587886] Aug 22 09:05:30 juju-e4d256-prod-github-runner-207 kernel: [13304.588737] Aug 22 09:05:30 juju-e4d256-prod-github-runner-207 kernel: [13304.589593] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 09:05:30 juju-e4d256-prod-github-runner-207 kernel: [13304.590625] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:05:30 juju-e4d256-prod-github-runner-207 kernel: [13304.591780] ? _raw_spin_lock+0x22/0x30 Aug 22 09:05:30 juju-e4d256-prod-github-runner-207 kernel: [13304.592806] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:05:30 juju-e4d256-prod-github-runner-207 kernel: [13304.593947] direct_page_fault+0x206/0x310 [kvm] Aug 22 09:05:30 juju-e4d256-prod-github-runner-207 kernel: [13304.595058] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 09:05:30 juju-e4d256-prod-github-runner-207 kernel: [13304.596154] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 09:05:30 juju-e4d256-prod-github-runner-207 kernel: [13304.597268] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 09:05:30 juju-e4d256-prod-github-runner-207 kernel: [13304.598377] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 09:05:30 juju-e4d256-prod-github-runner-207 kernel: [13304.599439] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 09:05:30 juju-e4d256-prod-github-runner-207 kernel: [13304.600527] handle_exit+0x98/0x230 [kvm_amd] Aug 22 09:05:30 juju-e4d256-prod-github-runner-207 kernel: [13304.601531] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 09:05:30 juju-e4d256-prod-github-runner-207 kernel: [13304.602548] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 09:05:30 juju-e4d256-prod-github-runner-207 kernel: [13304.603576] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 09:05:30 juju-e4d256-prod-github-runner-207 kernel: [13304.604595] vcpu_run+0x62/0x2c0 [kvm] Aug 22 09:05:30 juju-e4d256-prod-github-runner-207 kernel: [13304.605525] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 09:05:30 juju-e4d256-prod-github-runner-207 kernel: [13304.606427] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 09:05:30 juju-e4d256-prod-github-runner-207 kernel: [13304.607400] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 09:05:30 juju-e4d256-prod-github-runner-207 kernel: [13304.608284] ? __seccomp_filter+0x4a/0x4a0 Aug 22 09:05:30 juju-e4d256-prod-github-runner-207 kernel: [13304.609130] ? __fget_files+0x86/0xc0 Aug 22 09:05:30 juju-e4d256-prod-github-runner-207 kernel: [13304.609910] __x64_sys_ioctl+0x95/0xd0 Aug 22 09:05:30 juju-e4d256-prod-github-runner-207 kernel: [13304.610684] do_syscall_64+0x5c/0xc0 Aug 22 09:05:30 juju-e4d256-prod-github-runner-207 kernel: [13304.611436] ? do_futex+0x162/0x1f0 Aug 22 09:05:30 juju-e4d256-prod-github-runner-207 kernel: [13304.612159] ? __x64_sys_futex+0x78/0x1e0 Aug 22 09:05:30 juju-e4d256-prod-github-runner-207 kernel: [13304.612925] ? __secure_computing+0xa9/0x120 Aug 22 09:05:30 juju-e4d256-prod-github-runner-207 kernel: [13304.613730] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 09:05:30 juju-e4d256-prod-github-runner-207 kernel: [13304.614596] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:05:30 juju-e4d256-prod-github-runner-207 kernel: [13304.615426] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:05:30 juju-e4d256-prod-github-runner-207 kernel: [13304.616254] ? do_syscall_64+0x69/0xc0 Aug 22 09:05:30 juju-e4d256-prod-github-runner-207 kernel: [13304.616995] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:05:30 juju-e4d256-prod-github-runner-207 kernel: [13304.617819] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:05:30 juju-e4d256-prod-github-runner-207 kernel: [13304.618643] ? do_syscall_64+0x69/0xc0 Aug 22 09:05:30 juju-e4d256-prod-github-runner-207 kernel: [13304.619347] ? do_syscall_64+0x69/0xc0 Aug 22 09:05:30 juju-e4d256-prod-github-runner-207 kernel: [13304.620049] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 09:05:30 juju-e4d256-prod-github-runner-207 kernel: [13304.620860] RIP: 0033:0x7faa5d0edaff Aug 22 09:05:30 juju-e4d256-prod-github-runner-207 kernel: [13304.621620] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 09:05:30 juju-e4d256-prod-github-runner-207 kernel: [13304.623947] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 09:05:30 juju-e4d256-prod-github-runner-207 kernel: [13304.625005] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 09:05:30 juju-e4d256-prod-github-runner-207 kernel: [13304.626046] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 09:05:30 juju-e4d256-prod-github-runner-207 kernel: [13304.627081] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 09:05:30 juju-e4d256-prod-github-runner-207 kernel: [13304.628104] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 09:05:30 juju-e4d256-prod-github-runner-207 kernel: [13304.629318] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 09:05:30 juju-e4d256-prod-github-runner-207 kernel: [13304.630352] Aug 22 09:05:44 juju-e4d256-prod-github-runner-207 kernel: [13318.076709] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 09:05:44 juju-e4d256-prod-github-runner-207 kernel: [13318.077692] rcu: 1-....: (3289879 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=1589476 Aug 22 09:05:44 juju-e4d256-prod-github-runner-207 kernel: [13318.078801] (t=3300219 jiffies g=23269 q=21074) Aug 22 09:05:44 juju-e4d256-prod-github-runner-207 kernel: [13318.079580] NMI backtrace for cpu 1 Aug 22 09:05:44 juju-e4d256-prod-github-runner-207 kernel: [13318.080286] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 09:05:44 juju-e4d256-prod-github-runner-207 kernel: [13318.081410] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 09:05:44 juju-e4d256-prod-github-runner-207 kernel: [13318.082510] Call Trace: Aug 22 09:05:44 juju-e4d256-prod-github-runner-207 kernel: [13318.083189] Aug 22 09:05:44 juju-e4d256-prod-github-runner-207 kernel: [13318.083839] show_stack+0x52/0x5c Aug 22 09:05:44 juju-e4d256-prod-github-runner-207 kernel: [13318.084570] dump_stack_lvl+0x4a/0x63 Aug 22 09:05:44 juju-e4d256-prod-github-runner-207 kernel: [13318.085378] dump_stack+0x10/0x16 Aug 22 09:05:44 juju-e4d256-prod-github-runner-207 kernel: [13318.086122] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 09:05:44 juju-e4d256-prod-github-runner-207 kernel: [13318.086929] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 09:05:44 juju-e4d256-prod-github-runner-207 kernel: [13318.087753] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 09:05:44 juju-e4d256-prod-github-runner-207 kernel: [13318.088575] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 09:05:44 juju-e4d256-prod-github-runner-207 kernel: [13318.089614] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 09:05:44 juju-e4d256-prod-github-runner-207 kernel: [13318.090467] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 09:05:44 juju-e4d256-prod-github-runner-207 kernel: [13318.091261] print_cpu_stall.cold+0x2f/0xe2 Aug 22 09:05:44 juju-e4d256-prod-github-runner-207 kernel: [13318.092031] ? timekeeping_update+0xf7/0x150 Aug 22 09:05:44 juju-e4d256-prod-github-runner-207 kernel: [13318.092800] check_cpu_stall+0x109/0x270 Aug 22 09:05:44 juju-e4d256-prod-github-runner-207 kernel: [13318.093602] rcu_sched_clock_irq+0x9a/0x250 Aug 22 09:05:44 juju-e4d256-prod-github-runner-207 kernel: [13318.094384] update_process_times+0x94/0xd0 Aug 22 09:05:44 juju-e4d256-prod-github-runner-207 kernel: [13318.095142] tick_sched_handle+0x29/0x70 Aug 22 09:05:44 juju-e4d256-prod-github-runner-207 kernel: [13318.095889] tick_sched_timer+0x8c/0xc0 Aug 22 09:05:44 juju-e4d256-prod-github-runner-207 kernel: [13318.096624] ? tick_nohz_handler+0xb0/0xb0 Aug 22 09:05:44 juju-e4d256-prod-github-runner-207 kernel: [13318.097405] __hrtimer_run_queues+0x107/0x230 Aug 22 09:05:44 juju-e4d256-prod-github-runner-207 kernel: [13318.098232] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 09:05:44 juju-e4d256-prod-github-runner-207 kernel: [13318.099042] hrtimer_interrupt+0x101/0x220 Aug 22 09:05:44 juju-e4d256-prod-github-runner-207 kernel: [13318.099827] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 09:05:44 juju-e4d256-prod-github-runner-207 kernel: [13318.100646] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 09:05:44 juju-e4d256-prod-github-runner-207 kernel: [13318.101468] Aug 22 09:05:44 juju-e4d256-prod-github-runner-207 kernel: [13318.102187] Aug 22 09:05:44 juju-e4d256-prod-github-runner-207 kernel: [13318.103145] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 09:05:44 juju-e4d256-prod-github-runner-207 kernel: [13318.104064] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:05:44 juju-e4d256-prod-github-runner-207 kernel: [13318.104986] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 09:05:44 juju-e4d256-prod-github-runner-207 kernel: [13318.107206] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 09:05:44 juju-e4d256-prod-github-runner-207 kernel: [13318.108136] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 09:05:44 juju-e4d256-prod-github-runner-207 kernel: [13318.109184] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 09:05:44 juju-e4d256-prod-github-runner-207 kernel: [13318.110190] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 09:05:44 juju-e4d256-prod-github-runner-207 kernel: [13318.111198] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 09:05:44 juju-e4d256-prod-github-runner-207 kernel: [13318.112182] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 09:05:44 juju-e4d256-prod-github-runner-207 kernel: [13318.113166] ? _raw_spin_lock+0x22/0x30 Aug 22 09:05:44 juju-e4d256-prod-github-runner-207 kernel: [13318.113952] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:05:44 juju-e4d256-prod-github-runner-207 kernel: [13318.114792] direct_page_fault+0x206/0x310 [kvm] Aug 22 09:05:44 juju-e4d256-prod-github-runner-207 kernel: [13318.115644] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 09:05:44 juju-e4d256-prod-github-runner-207 kernel: [13318.116469] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 09:05:44 juju-e4d256-prod-github-runner-207 kernel: [13318.117315] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 09:05:44 juju-e4d256-prod-github-runner-207 kernel: [13318.118142] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 09:05:44 juju-e4d256-prod-github-runner-207 kernel: [13318.118938] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 09:05:44 juju-e4d256-prod-github-runner-207 kernel: [13318.119782] handle_exit+0x98/0x230 [kvm_amd] Aug 22 09:05:44 juju-e4d256-prod-github-runner-207 kernel: [13318.120542] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 09:05:44 juju-e4d256-prod-github-runner-207 kernel: [13318.121339] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 09:05:44 juju-e4d256-prod-github-runner-207 kernel: [13318.122148] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 09:05:44 juju-e4d256-prod-github-runner-207 kernel: [13318.122938] vcpu_run+0x62/0x2c0 [kvm] Aug 22 09:05:44 juju-e4d256-prod-github-runner-207 kernel: [13318.123655] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 09:05:44 juju-e4d256-prod-github-runner-207 kernel: [13318.124392] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 09:05:44 juju-e4d256-prod-github-runner-207 kernel: [13318.125218] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 09:05:44 juju-e4d256-prod-github-runner-207 kernel: [13318.125980] ? __seccomp_filter+0x4a/0x4a0 Aug 22 09:05:44 juju-e4d256-prod-github-runner-207 kernel: [13318.126751] ? __fget_files+0x86/0xc0 Aug 22 09:05:44 juju-e4d256-prod-github-runner-207 kernel: [13318.127516] __x64_sys_ioctl+0x95/0xd0 Aug 22 09:05:44 juju-e4d256-prod-github-runner-207 kernel: [13318.128257] do_syscall_64+0x5c/0xc0 Aug 22 09:05:44 juju-e4d256-prod-github-runner-207 kernel: [13318.128999] ? do_futex+0x162/0x1f0 Aug 22 09:05:44 juju-e4d256-prod-github-runner-207 kernel: [13318.129755] ? __x64_sys_futex+0x78/0x1e0 Aug 22 09:05:44 juju-e4d256-prod-github-runner-207 kernel: [13318.130462] ? __secure_computing+0xa9/0x120 Aug 22 09:05:44 juju-e4d256-prod-github-runner-207 kernel: [13318.131197] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 09:05:44 juju-e4d256-prod-github-runner-207 kernel: [13318.132017] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:05:44 juju-e4d256-prod-github-runner-207 kernel: [13318.132790] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:05:44 juju-e4d256-prod-github-runner-207 kernel: [13318.133587] ? do_syscall_64+0x69/0xc0 Aug 22 09:05:44 juju-e4d256-prod-github-runner-207 kernel: [13318.134280] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:05:44 juju-e4d256-prod-github-runner-207 kernel: [13318.135056] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:05:44 juju-e4d256-prod-github-runner-207 kernel: [13318.135817] ? do_syscall_64+0x69/0xc0 Aug 22 09:05:44 juju-e4d256-prod-github-runner-207 kernel: [13318.136515] ? do_syscall_64+0x69/0xc0 Aug 22 09:05:44 juju-e4d256-prod-github-runner-207 kernel: [13318.137227] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 09:05:44 juju-e4d256-prod-github-runner-207 kernel: [13318.138002] RIP: 0033:0x7faa5d0edaff Aug 22 09:05:44 juju-e4d256-prod-github-runner-207 kernel: [13318.138683] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 09:05:44 juju-e4d256-prod-github-runner-207 kernel: [13318.140789] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 09:05:44 juju-e4d256-prod-github-runner-207 kernel: [13318.141773] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 09:05:44 juju-e4d256-prod-github-runner-207 kernel: [13318.142723] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 09:05:44 juju-e4d256-prod-github-runner-207 kernel: [13318.143683] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 09:05:44 juju-e4d256-prod-github-runner-207 kernel: [13318.144630] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 09:05:44 juju-e4d256-prod-github-runner-207 kernel: [13318.145572] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 09:05:44 juju-e4d256-prod-github-runner-207 kernel: [13318.146486] Aug 22 09:06:10 juju-e4d256-prod-github-runner-207 kernel: [13344.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 12320s! [qemu-system-x86:6715] Aug 22 09:06:10 juju-e4d256-prod-github-runner-207 kernel: [13344.543884] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 09:06:10 juju-e4d256-prod-github-runner-207 kernel: [13344.544190] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 09:06:10 juju-e4d256-prod-github-runner-207 kernel: [13344.556342] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 09:06:10 juju-e4d256-prod-github-runner-207 kernel: [13344.557641] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 09:06:10 juju-e4d256-prod-github-runner-207 kernel: [13344.558858] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:06:10 juju-e4d256-prod-github-runner-207 kernel: [13344.559911] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 09:06:10 juju-e4d256-prod-github-runner-207 kernel: [13344.562473] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 09:06:10 juju-e4d256-prod-github-runner-207 kernel: [13344.563522] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 09:06:10 juju-e4d256-prod-github-runner-207 kernel: [13344.564733] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 09:06:10 juju-e4d256-prod-github-runner-207 kernel: [13344.565898] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 09:06:10 juju-e4d256-prod-github-runner-207 kernel: [13344.567056] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 09:06:10 juju-e4d256-prod-github-runner-207 kernel: [13344.568214] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 09:06:10 juju-e4d256-prod-github-runner-207 kernel: [13344.569392] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 09:06:10 juju-e4d256-prod-github-runner-207 kernel: [13344.571244] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 09:06:10 juju-e4d256-prod-github-runner-207 kernel: [13344.572346] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 09:06:10 juju-e4d256-prod-github-runner-207 kernel: [13344.573554] Call Trace: Aug 22 09:06:10 juju-e4d256-prod-github-runner-207 kernel: [13344.574486] Aug 22 09:06:10 juju-e4d256-prod-github-runner-207 kernel: [13344.575560] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:06:10 juju-e4d256-prod-github-runner-207 kernel: [13344.576654] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:06:10 juju-e4d256-prod-github-runner-207 kernel: [13344.577684] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:06:10 juju-e4d256-prod-github-runner-207 kernel: [13344.578776] ? show_regs.part.0+0x23/0x29 Aug 22 09:06:10 juju-e4d256-prod-github-runner-207 kernel: [13344.579781] ? show_regs.cold+0x8/0xd Aug 22 09:06:10 juju-e4d256-prod-github-runner-207 kernel: [13344.580775] ? watchdog_timer_fn+0x1be/0x220 Aug 22 09:06:10 juju-e4d256-prod-github-runner-207 kernel: [13344.581788] ? lockup_detector_update_enable+0x60/0x60 Aug 22 09:06:10 juju-e4d256-prod-github-runner-207 kernel: [13344.582851] ? __hrtimer_run_queues+0x107/0x230 Aug 22 09:06:10 juju-e4d256-prod-github-runner-207 kernel: [13344.583878] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 09:06:10 juju-e4d256-prod-github-runner-207 kernel: [13344.584962] ? hrtimer_interrupt+0x101/0x220 Aug 22 09:06:10 juju-e4d256-prod-github-runner-207 kernel: [13344.585982] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 09:06:10 juju-e4d256-prod-github-runner-207 kernel: [13344.587048] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 09:06:10 juju-e4d256-prod-github-runner-207 kernel: [13344.588092] Aug 22 09:06:10 juju-e4d256-prod-github-runner-207 kernel: [13344.588959] Aug 22 09:06:10 juju-e4d256-prod-github-runner-207 kernel: [13344.589851] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 09:06:10 juju-e4d256-prod-github-runner-207 kernel: [13344.590986] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:06:10 juju-e4d256-prod-github-runner-207 kernel: [13344.592048] ? _raw_spin_lock+0x22/0x30 Aug 22 09:06:10 juju-e4d256-prod-github-runner-207 kernel: [13344.593048] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:06:10 juju-e4d256-prod-github-runner-207 kernel: [13344.594067] direct_page_fault+0x206/0x310 [kvm] Aug 22 09:06:10 juju-e4d256-prod-github-runner-207 kernel: [13344.595093] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 09:06:10 juju-e4d256-prod-github-runner-207 kernel: [13344.596098] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 09:06:10 juju-e4d256-prod-github-runner-207 kernel: [13344.597113] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 09:06:10 juju-e4d256-prod-github-runner-207 kernel: [13344.598131] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 09:06:10 juju-e4d256-prod-github-runner-207 kernel: [13344.599074] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 09:06:10 juju-e4d256-prod-github-runner-207 kernel: [13344.600051] handle_exit+0x98/0x230 [kvm_amd] Aug 22 09:06:10 juju-e4d256-prod-github-runner-207 kernel: [13344.600960] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 09:06:10 juju-e4d256-prod-github-runner-207 kernel: [13344.601874] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 09:06:10 juju-e4d256-prod-github-runner-207 kernel: [13344.602796] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 09:06:10 juju-e4d256-prod-github-runner-207 kernel: [13344.603698] vcpu_run+0x62/0x2c0 [kvm] Aug 22 09:06:10 juju-e4d256-prod-github-runner-207 kernel: [13344.604511] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 09:06:10 juju-e4d256-prod-github-runner-207 kernel: [13344.605331] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 09:06:10 juju-e4d256-prod-github-runner-207 kernel: [13344.606181] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 09:06:10 juju-e4d256-prod-github-runner-207 kernel: [13344.606974] ? __seccomp_filter+0x4a/0x4a0 Aug 22 09:06:10 juju-e4d256-prod-github-runner-207 kernel: [13344.607732] ? __fget_files+0x86/0xc0 Aug 22 09:06:10 juju-e4d256-prod-github-runner-207 kernel: [13344.608432] __x64_sys_ioctl+0x95/0xd0 Aug 22 09:06:10 juju-e4d256-prod-github-runner-207 kernel: [13344.609146] do_syscall_64+0x5c/0xc0 Aug 22 09:06:10 juju-e4d256-prod-github-runner-207 kernel: [13344.609807] ? do_futex+0x162/0x1f0 Aug 22 09:06:10 juju-e4d256-prod-github-runner-207 kernel: [13344.610450] ? __x64_sys_futex+0x78/0x1e0 Aug 22 09:06:10 juju-e4d256-prod-github-runner-207 kernel: [13344.611119] ? __secure_computing+0xa9/0x120 Aug 22 09:06:10 juju-e4d256-prod-github-runner-207 kernel: [13344.611804] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 09:06:10 juju-e4d256-prod-github-runner-207 kernel: [13344.612560] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:06:10 juju-e4d256-prod-github-runner-207 kernel: [13344.613296] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:06:10 juju-e4d256-prod-github-runner-207 kernel: [13344.614011] ? do_syscall_64+0x69/0xc0 Aug 22 09:06:10 juju-e4d256-prod-github-runner-207 kernel: [13344.614652] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:06:10 juju-e4d256-prod-github-runner-207 kernel: [13344.615352] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:06:10 juju-e4d256-prod-github-runner-207 kernel: [13344.616062] ? do_syscall_64+0x69/0xc0 Aug 22 09:06:10 juju-e4d256-prod-github-runner-207 kernel: [13344.616703] ? do_syscall_64+0x69/0xc0 Aug 22 09:06:10 juju-e4d256-prod-github-runner-207 kernel: [13344.617350] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 09:06:10 juju-e4d256-prod-github-runner-207 kernel: [13344.618052] RIP: 0033:0x7faa5d0edaff Aug 22 09:06:10 juju-e4d256-prod-github-runner-207 kernel: [13344.618745] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 09:06:10 juju-e4d256-prod-github-runner-207 kernel: [13344.620771] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 09:06:10 juju-e4d256-prod-github-runner-207 kernel: [13344.621683] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 09:06:10 juju-e4d256-prod-github-runner-207 kernel: [13344.622579] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 09:06:10 juju-e4d256-prod-github-runner-207 kernel: [13344.623578] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 09:06:10 juju-e4d256-prod-github-runner-207 kernel: [13344.624466] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 09:06:10 juju-e4d256-prod-github-runner-207 kernel: [13344.625509] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 09:06:10 juju-e4d256-prod-github-runner-207 kernel: [13344.626419] Aug 22 09:06:38 juju-e4d256-prod-github-runner-207 kernel: [13372.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 12346s! [qemu-system-x86:6715] Aug 22 09:06:38 juju-e4d256-prod-github-runner-207 kernel: [13372.543120] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 09:06:38 juju-e4d256-prod-github-runner-207 kernel: [13372.543194] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 09:06:38 juju-e4d256-prod-github-runner-207 kernel: [13372.555613] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 09:06:38 juju-e4d256-prod-github-runner-207 kernel: [13372.556947] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 09:06:38 juju-e4d256-prod-github-runner-207 kernel: [13372.558228] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:06:38 juju-e4d256-prod-github-runner-207 kernel: [13372.559340] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 09:06:38 juju-e4d256-prod-github-runner-207 kernel: [13372.561962] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 09:06:38 juju-e4d256-prod-github-runner-207 kernel: [13372.563055] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 09:06:38 juju-e4d256-prod-github-runner-207 kernel: [13372.564243] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 09:06:38 juju-e4d256-prod-github-runner-207 kernel: [13372.565447] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 09:06:38 juju-e4d256-prod-github-runner-207 kernel: [13372.566635] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 09:06:38 juju-e4d256-prod-github-runner-207 kernel: [13372.567795] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 09:06:38 juju-e4d256-prod-github-runner-207 kernel: [13372.568981] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 09:06:38 juju-e4d256-prod-github-runner-207 kernel: [13372.570213] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 09:06:38 juju-e4d256-prod-github-runner-207 kernel: [13372.571315] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 09:06:38 juju-e4d256-prod-github-runner-207 kernel: [13372.572572] Call Trace: Aug 22 09:06:38 juju-e4d256-prod-github-runner-207 kernel: [13372.573522] Aug 22 09:06:38 juju-e4d256-prod-github-runner-207 kernel: [13372.574406] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:06:38 juju-e4d256-prod-github-runner-207 kernel: [13372.575437] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:06:38 juju-e4d256-prod-github-runner-207 kernel: [13372.576476] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:06:38 juju-e4d256-prod-github-runner-207 kernel: [13372.577554] ? show_regs.part.0+0x23/0x29 Aug 22 09:06:38 juju-e4d256-prod-github-runner-207 kernel: [13372.578553] ? show_regs.cold+0x8/0xd Aug 22 09:06:38 juju-e4d256-prod-github-runner-207 kernel: [13372.579524] ? watchdog_timer_fn+0x1be/0x220 Aug 22 09:06:38 juju-e4d256-prod-github-runner-207 kernel: [13372.580547] ? lockup_detector_update_enable+0x60/0x60 Aug 22 09:06:38 juju-e4d256-prod-github-runner-207 kernel: [13372.581616] ? __hrtimer_run_queues+0x107/0x230 Aug 22 09:06:38 juju-e4d256-prod-github-runner-207 kernel: [13372.582644] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 09:06:38 juju-e4d256-prod-github-runner-207 kernel: [13372.583699] ? hrtimer_interrupt+0x101/0x220 Aug 22 09:06:38 juju-e4d256-prod-github-runner-207 kernel: [13372.584787] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 09:06:38 juju-e4d256-prod-github-runner-207 kernel: [13372.586026] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 09:06:38 juju-e4d256-prod-github-runner-207 kernel: [13372.587200] Aug 22 09:06:38 juju-e4d256-prod-github-runner-207 kernel: [13372.588179] Aug 22 09:06:38 juju-e4d256-prod-github-runner-207 kernel: [13372.589170] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 09:06:38 juju-e4d256-prod-github-runner-207 kernel: [13372.590364] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:06:38 juju-e4d256-prod-github-runner-207 kernel: [13372.591564] ? _raw_spin_lock+0x22/0x30 Aug 22 09:06:38 juju-e4d256-prod-github-runner-207 kernel: [13372.592614] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:06:38 juju-e4d256-prod-github-runner-207 kernel: [13372.593802] direct_page_fault+0x206/0x310 [kvm] Aug 22 09:06:38 juju-e4d256-prod-github-runner-207 kernel: [13372.594962] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 09:06:38 juju-e4d256-prod-github-runner-207 kernel: [13372.596097] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 09:06:38 juju-e4d256-prod-github-runner-207 kernel: [13372.597223] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 09:06:38 juju-e4d256-prod-github-runner-207 kernel: [13372.598340] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 09:06:38 juju-e4d256-prod-github-runner-207 kernel: [13372.599379] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 09:06:38 juju-e4d256-prod-github-runner-207 kernel: [13372.600486] handle_exit+0x98/0x230 [kvm_amd] Aug 22 09:06:38 juju-e4d256-prod-github-runner-207 kernel: [13372.601480] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 09:06:38 juju-e4d256-prod-github-runner-207 kernel: [13372.602483] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 09:06:38 juju-e4d256-prod-github-runner-207 kernel: [13372.603505] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 09:06:38 juju-e4d256-prod-github-runner-207 kernel: [13372.604524] vcpu_run+0x62/0x2c0 [kvm] Aug 22 09:06:38 juju-e4d256-prod-github-runner-207 kernel: [13372.605410] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 09:06:38 juju-e4d256-prod-github-runner-207 kernel: [13372.606309] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 09:06:38 juju-e4d256-prod-github-runner-207 kernel: [13372.607257] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 09:06:38 juju-e4d256-prod-github-runner-207 kernel: [13372.608142] ? __seccomp_filter+0x4a/0x4a0 Aug 22 09:06:38 juju-e4d256-prod-github-runner-207 kernel: [13372.608987] ? __fget_files+0x86/0xc0 Aug 22 09:06:38 juju-e4d256-prod-github-runner-207 kernel: [13372.609772] __x64_sys_ioctl+0x95/0xd0 Aug 22 09:06:38 juju-e4d256-prod-github-runner-207 kernel: [13372.610539] do_syscall_64+0x5c/0xc0 Aug 22 09:06:38 juju-e4d256-prod-github-runner-207 kernel: [13372.611272] ? do_futex+0x162/0x1f0 Aug 22 09:06:38 juju-e4d256-prod-github-runner-207 kernel: [13372.612001] ? __x64_sys_futex+0x78/0x1e0 Aug 22 09:06:38 juju-e4d256-prod-github-runner-207 kernel: [13372.612796] ? __secure_computing+0xa9/0x120 Aug 22 09:06:38 juju-e4d256-prod-github-runner-207 kernel: [13372.613565] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 09:06:38 juju-e4d256-prod-github-runner-207 kernel: [13372.614424] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:06:38 juju-e4d256-prod-github-runner-207 kernel: [13372.615233] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:06:38 juju-e4d256-prod-github-runner-207 kernel: [13372.616055] ? do_syscall_64+0x69/0xc0 Aug 22 09:06:38 juju-e4d256-prod-github-runner-207 kernel: [13372.616811] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:06:38 juju-e4d256-prod-github-runner-207 kernel: [13372.617563] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:06:38 juju-e4d256-prod-github-runner-207 kernel: [13372.618263] ? do_syscall_64+0x69/0xc0 Aug 22 09:06:38 juju-e4d256-prod-github-runner-207 kernel: [13372.618888] ? do_syscall_64+0x69/0xc0 Aug 22 09:06:38 juju-e4d256-prod-github-runner-207 kernel: [13372.619517] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 09:06:38 juju-e4d256-prod-github-runner-207 kernel: [13372.620240] RIP: 0033:0x7faa5d0edaff Aug 22 09:06:38 juju-e4d256-prod-github-runner-207 kernel: [13372.620931] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 09:06:38 juju-e4d256-prod-github-runner-207 kernel: [13372.622939] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 09:06:38 juju-e4d256-prod-github-runner-207 kernel: [13372.623862] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 09:06:38 juju-e4d256-prod-github-runner-207 kernel: [13372.624787] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 09:06:38 juju-e4d256-prod-github-runner-207 kernel: [13372.625750] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 09:06:38 juju-e4d256-prod-github-runner-207 kernel: [13372.626647] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 09:06:38 juju-e4d256-prod-github-runner-207 kernel: [13372.627535] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 09:06:38 juju-e4d256-prod-github-runner-207 kernel: [13372.628466] Aug 22 09:07:06 juju-e4d256-prod-github-runner-207 kernel: [13400.541976] watchdog: BUG: soft lockup - CPU#1 stuck for 12372s! [qemu-system-x86:6715] Aug 22 09:07:06 juju-e4d256-prod-github-runner-207 kernel: [13400.543837] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 09:07:06 juju-e4d256-prod-github-runner-207 kernel: [13400.544133] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 09:07:06 juju-e4d256-prod-github-runner-207 kernel: [13400.556289] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 09:07:06 juju-e4d256-prod-github-runner-207 kernel: [13400.557564] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 09:07:06 juju-e4d256-prod-github-runner-207 kernel: [13400.558804] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:07:06 juju-e4d256-prod-github-runner-207 kernel: [13400.559878] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 09:07:06 juju-e4d256-prod-github-runner-207 kernel: [13400.562434] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 09:07:06 juju-e4d256-prod-github-runner-207 kernel: [13400.563475] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 09:07:06 juju-e4d256-prod-github-runner-207 kernel: [13400.564641] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 09:07:06 juju-e4d256-prod-github-runner-207 kernel: [13400.565801] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 09:07:06 juju-e4d256-prod-github-runner-207 kernel: [13400.566961] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 09:07:06 juju-e4d256-prod-github-runner-207 kernel: [13400.568130] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 09:07:06 juju-e4d256-prod-github-runner-207 kernel: [13400.569303] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 09:07:06 juju-e4d256-prod-github-runner-207 kernel: [13400.570536] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 09:07:06 juju-e4d256-prod-github-runner-207 kernel: [13400.571650] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 09:07:06 juju-e4d256-prod-github-runner-207 kernel: [13400.572884] Call Trace: Aug 22 09:07:06 juju-e4d256-prod-github-runner-207 kernel: [13400.573796] Aug 22 09:07:06 juju-e4d256-prod-github-runner-207 kernel: [13400.574718] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:07:06 juju-e4d256-prod-github-runner-207 kernel: [13400.575774] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:07:06 juju-e4d256-prod-github-runner-207 kernel: [13400.576827] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:07:06 juju-e4d256-prod-github-runner-207 kernel: [13400.577925] ? show_regs.part.0+0x23/0x29 Aug 22 09:07:06 juju-e4d256-prod-github-runner-207 kernel: [13400.578939] ? show_regs.cold+0x8/0xd Aug 22 09:07:06 juju-e4d256-prod-github-runner-207 kernel: [13400.579921] ? watchdog_timer_fn+0x1be/0x220 Aug 22 09:07:06 juju-e4d256-prod-github-runner-207 kernel: [13400.580946] ? lockup_detector_update_enable+0x60/0x60 Aug 22 09:07:06 juju-e4d256-prod-github-runner-207 kernel: [13400.582022] ? __hrtimer_run_queues+0x107/0x230 Aug 22 09:07:06 juju-e4d256-prod-github-runner-207 kernel: [13400.583051] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 09:07:06 juju-e4d256-prod-github-runner-207 kernel: [13400.584094] ? hrtimer_interrupt+0x101/0x220 Aug 22 09:07:06 juju-e4d256-prod-github-runner-207 kernel: [13400.585116] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 09:07:06 juju-e4d256-prod-github-runner-207 kernel: [13400.586190] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 09:07:06 juju-e4d256-prod-github-runner-207 kernel: [13400.587255] Aug 22 09:07:06 juju-e4d256-prod-github-runner-207 kernel: [13400.588129] Aug 22 09:07:06 juju-e4d256-prod-github-runner-207 kernel: [13400.588965] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 09:07:06 juju-e4d256-prod-github-runner-207 kernel: [13400.589994] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:07:06 juju-e4d256-prod-github-runner-207 kernel: [13400.591041] ? _raw_spin_lock+0x22/0x30 Aug 22 09:07:06 juju-e4d256-prod-github-runner-207 kernel: [13400.592065] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:07:06 juju-e4d256-prod-github-runner-207 kernel: [13400.593224] direct_page_fault+0x206/0x310 [kvm] Aug 22 09:07:06 juju-e4d256-prod-github-runner-207 kernel: [13400.594251] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 09:07:06 juju-e4d256-prod-github-runner-207 kernel: [13400.595261] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 09:07:06 juju-e4d256-prod-github-runner-207 kernel: [13400.596292] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 09:07:06 juju-e4d256-prod-github-runner-207 kernel: [13400.597300] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 09:07:06 juju-e4d256-prod-github-runner-207 kernel: [13400.598251] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 09:07:06 juju-e4d256-prod-github-runner-207 kernel: [13400.599229] handle_exit+0x98/0x230 [kvm_amd] Aug 22 09:07:06 juju-e4d256-prod-github-runner-207 kernel: [13400.600136] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 09:07:06 juju-e4d256-prod-github-runner-207 kernel: [13400.601055] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 09:07:06 juju-e4d256-prod-github-runner-207 kernel: [13400.601983] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 09:07:06 juju-e4d256-prod-github-runner-207 kernel: [13400.602893] vcpu_run+0x62/0x2c0 [kvm] Aug 22 09:07:06 juju-e4d256-prod-github-runner-207 kernel: [13400.603706] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 09:07:06 juju-e4d256-prod-github-runner-207 kernel: [13400.604522] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 09:07:06 juju-e4d256-prod-github-runner-207 kernel: [13400.605378] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 09:07:06 juju-e4d256-prod-github-runner-207 kernel: [13400.606231] ? __seccomp_filter+0x4a/0x4a0 Aug 22 09:07:06 juju-e4d256-prod-github-runner-207 kernel: [13400.606996] ? __fget_files+0x86/0xc0 Aug 22 09:07:06 juju-e4d256-prod-github-runner-207 kernel: [13400.607730] __x64_sys_ioctl+0x95/0xd0 Aug 22 09:07:06 juju-e4d256-prod-github-runner-207 kernel: [13400.608458] do_syscall_64+0x5c/0xc0 Aug 22 09:07:06 juju-e4d256-prod-github-runner-207 kernel: [13400.609151] ? do_futex+0x162/0x1f0 Aug 22 09:07:06 juju-e4d256-prod-github-runner-207 kernel: [13400.609816] ? __x64_sys_futex+0x78/0x1e0 Aug 22 09:07:06 juju-e4d256-prod-github-runner-207 kernel: [13400.610501] ? __secure_computing+0xa9/0x120 Aug 22 09:07:06 juju-e4d256-prod-github-runner-207 kernel: [13400.611199] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 09:07:06 juju-e4d256-prod-github-runner-207 kernel: [13400.611990] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:07:06 juju-e4d256-prod-github-runner-207 kernel: [13400.612718] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:07:06 juju-e4d256-prod-github-runner-207 kernel: [13400.613473] ? do_syscall_64+0x69/0xc0 Aug 22 09:07:06 juju-e4d256-prod-github-runner-207 kernel: [13400.614123] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:07:06 juju-e4d256-prod-github-runner-207 kernel: [13400.614828] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:07:06 juju-e4d256-prod-github-runner-207 kernel: [13400.615550] ? do_syscall_64+0x69/0xc0 Aug 22 09:07:06 juju-e4d256-prod-github-runner-207 kernel: [13400.616307] ? do_syscall_64+0x69/0xc0 Aug 22 09:07:06 juju-e4d256-prod-github-runner-207 kernel: [13400.616968] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 09:07:06 juju-e4d256-prod-github-runner-207 kernel: [13400.617681] RIP: 0033:0x7faa5d0edaff Aug 22 09:07:06 juju-e4d256-prod-github-runner-207 kernel: [13400.618443] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 09:07:06 juju-e4d256-prod-github-runner-207 kernel: [13400.620675] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 09:07:06 juju-e4d256-prod-github-runner-207 kernel: [13400.621602] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 09:07:06 juju-e4d256-prod-github-runner-207 kernel: [13400.622507] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 09:07:06 juju-e4d256-prod-github-runner-207 kernel: [13400.623413] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 09:07:06 juju-e4d256-prod-github-runner-207 kernel: [13400.624449] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 09:07:06 juju-e4d256-prod-github-runner-207 kernel: [13400.625520] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 09:07:06 juju-e4d256-prod-github-runner-207 kernel: [13400.626572] Aug 22 09:07:34 juju-e4d256-prod-github-runner-207 kernel: [13428.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 12398s! [qemu-system-x86:6715] Aug 22 09:07:34 juju-e4d256-prod-github-runner-207 kernel: [13428.543142] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 09:07:34 juju-e4d256-prod-github-runner-207 kernel: [13428.543217] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 09:07:34 juju-e4d256-prod-github-runner-207 kernel: [13428.556426] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 09:07:34 juju-e4d256-prod-github-runner-207 kernel: [13428.557724] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 09:07:34 juju-e4d256-prod-github-runner-207 kernel: [13428.558974] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:07:34 juju-e4d256-prod-github-runner-207 kernel: [13428.560046] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 09:07:34 juju-e4d256-prod-github-runner-207 kernel: [13428.562587] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 09:07:34 juju-e4d256-prod-github-runner-207 kernel: [13428.563638] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 09:07:34 juju-e4d256-prod-github-runner-207 kernel: [13428.564797] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 09:07:34 juju-e4d256-prod-github-runner-207 kernel: [13428.565953] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 09:07:34 juju-e4d256-prod-github-runner-207 kernel: [13428.567195] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 09:07:34 juju-e4d256-prod-github-runner-207 kernel: [13428.568695] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 09:07:34 juju-e4d256-prod-github-runner-207 kernel: [13428.569893] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 09:07:34 juju-e4d256-prod-github-runner-207 kernel: [13428.571140] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 09:07:34 juju-e4d256-prod-github-runner-207 kernel: [13428.572264] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 09:07:34 juju-e4d256-prod-github-runner-207 kernel: [13428.573461] Call Trace: Aug 22 09:07:34 juju-e4d256-prod-github-runner-207 kernel: [13428.574377] Aug 22 09:07:34 juju-e4d256-prod-github-runner-207 kernel: [13428.575259] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:07:34 juju-e4d256-prod-github-runner-207 kernel: [13428.576300] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:07:34 juju-e4d256-prod-github-runner-207 kernel: [13428.577327] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:07:34 juju-e4d256-prod-github-runner-207 kernel: [13428.578408] ? show_regs.part.0+0x23/0x29 Aug 22 09:07:34 juju-e4d256-prod-github-runner-207 kernel: [13428.579421] ? show_regs.cold+0x8/0xd Aug 22 09:07:34 juju-e4d256-prod-github-runner-207 kernel: [13428.580405] ? watchdog_timer_fn+0x1be/0x220 Aug 22 09:07:34 juju-e4d256-prod-github-runner-207 kernel: [13428.581411] ? lockup_detector_update_enable+0x60/0x60 Aug 22 09:07:34 juju-e4d256-prod-github-runner-207 kernel: [13428.582472] ? __hrtimer_run_queues+0x107/0x230 Aug 22 09:07:34 juju-e4d256-prod-github-runner-207 kernel: [13428.583499] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 09:07:34 juju-e4d256-prod-github-runner-207 kernel: [13428.584573] ? hrtimer_interrupt+0x101/0x220 Aug 22 09:07:34 juju-e4d256-prod-github-runner-207 kernel: [13428.585615] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 09:07:34 juju-e4d256-prod-github-runner-207 kernel: [13428.586685] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 09:07:34 juju-e4d256-prod-github-runner-207 kernel: [13428.587750] Aug 22 09:07:34 juju-e4d256-prod-github-runner-207 kernel: [13428.588628] Aug 22 09:07:34 juju-e4d256-prod-github-runner-207 kernel: [13428.589488] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 09:07:34 juju-e4d256-prod-github-runner-207 kernel: [13428.590528] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:07:34 juju-e4d256-prod-github-runner-207 kernel: [13428.591570] ? _raw_spin_lock+0x22/0x30 Aug 22 09:07:34 juju-e4d256-prod-github-runner-207 kernel: [13428.592538] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:07:34 juju-e4d256-prod-github-runner-207 kernel: [13428.593564] direct_page_fault+0x206/0x310 [kvm] Aug 22 09:07:34 juju-e4d256-prod-github-runner-207 kernel: [13428.594587] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 09:07:34 juju-e4d256-prod-github-runner-207 kernel: [13428.595594] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 09:07:34 juju-e4d256-prod-github-runner-207 kernel: [13428.596632] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 09:07:34 juju-e4d256-prod-github-runner-207 kernel: [13428.597604] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 09:07:34 juju-e4d256-prod-github-runner-207 kernel: [13428.598555] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 09:07:34 juju-e4d256-prod-github-runner-207 kernel: [13428.599537] handle_exit+0x98/0x230 [kvm_amd] Aug 22 09:07:34 juju-e4d256-prod-github-runner-207 kernel: [13428.600445] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 09:07:34 juju-e4d256-prod-github-runner-207 kernel: [13428.601359] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 09:07:34 juju-e4d256-prod-github-runner-207 kernel: [13428.602282] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 09:07:34 juju-e4d256-prod-github-runner-207 kernel: [13428.603197] vcpu_run+0x62/0x2c0 [kvm] Aug 22 09:07:34 juju-e4d256-prod-github-runner-207 kernel: [13428.604021] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 09:07:34 juju-e4d256-prod-github-runner-207 kernel: [13428.604839] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 09:07:34 juju-e4d256-prod-github-runner-207 kernel: [13428.605694] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 09:07:34 juju-e4d256-prod-github-runner-207 kernel: [13428.606491] ? __seccomp_filter+0x4a/0x4a0 Aug 22 09:07:34 juju-e4d256-prod-github-runner-207 kernel: [13428.607239] ? __fget_files+0x86/0xc0 Aug 22 09:07:34 juju-e4d256-prod-github-runner-207 kernel: [13428.607969] __x64_sys_ioctl+0x95/0xd0 Aug 22 09:07:34 juju-e4d256-prod-github-runner-207 kernel: [13428.608666] do_syscall_64+0x5c/0xc0 Aug 22 09:07:34 juju-e4d256-prod-github-runner-207 kernel: [13428.609332] ? do_futex+0x162/0x1f0 Aug 22 09:07:34 juju-e4d256-prod-github-runner-207 kernel: [13428.609986] ? __x64_sys_futex+0x78/0x1e0 Aug 22 09:07:34 juju-e4d256-prod-github-runner-207 kernel: [13428.610658] ? __secure_computing+0xa9/0x120 Aug 22 09:07:34 juju-e4d256-prod-github-runner-207 kernel: [13428.611352] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 09:07:34 juju-e4d256-prod-github-runner-207 kernel: [13428.612129] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:07:34 juju-e4d256-prod-github-runner-207 kernel: [13428.612849] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:07:34 juju-e4d256-prod-github-runner-207 kernel: [13428.613566] ? do_syscall_64+0x69/0xc0 Aug 22 09:07:34 juju-e4d256-prod-github-runner-207 kernel: [13428.614211] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:07:34 juju-e4d256-prod-github-runner-207 kernel: [13428.614916] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:07:34 juju-e4d256-prod-github-runner-207 kernel: [13428.615624] ? do_syscall_64+0x69/0xc0 Aug 22 09:07:34 juju-e4d256-prod-github-runner-207 kernel: [13428.616249] ? do_syscall_64+0x69/0xc0 Aug 22 09:07:34 juju-e4d256-prod-github-runner-207 kernel: [13428.616884] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 09:07:34 juju-e4d256-prod-github-runner-207 kernel: [13428.617593] RIP: 0033:0x7faa5d0edaff Aug 22 09:07:34 juju-e4d256-prod-github-runner-207 kernel: [13428.618218] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 09:07:34 juju-e4d256-prod-github-runner-207 kernel: [13428.620212] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 09:07:34 juju-e4d256-prod-github-runner-207 kernel: [13428.621128] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 09:07:34 juju-e4d256-prod-github-runner-207 kernel: [13428.622016] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 09:07:34 juju-e4d256-prod-github-runner-207 kernel: [13428.622904] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 09:07:34 juju-e4d256-prod-github-runner-207 kernel: [13428.623806] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 09:07:34 juju-e4d256-prod-github-runner-207 kernel: [13428.624694] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 09:07:34 juju-e4d256-prod-github-runner-207 kernel: [13428.625587] Aug 22 09:08:02 juju-e4d256-prod-github-runner-207 kernel: [13456.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 12424s! [qemu-system-x86:6715] Aug 22 09:08:02 juju-e4d256-prod-github-runner-207 kernel: [13456.543845] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 09:08:02 juju-e4d256-prod-github-runner-207 kernel: [13456.544143] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 09:08:02 juju-e4d256-prod-github-runner-207 kernel: [13456.556282] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 09:08:02 juju-e4d256-prod-github-runner-207 kernel: [13456.557561] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 09:08:02 juju-e4d256-prod-github-runner-207 kernel: [13456.558781] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:08:02 juju-e4d256-prod-github-runner-207 kernel: [13456.559871] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 09:08:02 juju-e4d256-prod-github-runner-207 kernel: [13456.562408] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 09:08:02 juju-e4d256-prod-github-runner-207 kernel: [13456.563468] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 09:08:02 juju-e4d256-prod-github-runner-207 kernel: [13456.564659] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 09:08:02 juju-e4d256-prod-github-runner-207 kernel: [13456.565947] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 09:08:02 juju-e4d256-prod-github-runner-207 kernel: [13456.567148] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 09:08:02 juju-e4d256-prod-github-runner-207 kernel: [13456.568325] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 09:08:02 juju-e4d256-prod-github-runner-207 kernel: [13456.569492] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 09:08:02 juju-e4d256-prod-github-runner-207 kernel: [13456.570723] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 09:08:02 juju-e4d256-prod-github-runner-207 kernel: [13456.571835] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 09:08:02 juju-e4d256-prod-github-runner-207 kernel: [13456.573028] Call Trace: Aug 22 09:08:02 juju-e4d256-prod-github-runner-207 kernel: [13456.573937] Aug 22 09:08:02 juju-e4d256-prod-github-runner-207 kernel: [13456.574831] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:08:02 juju-e4d256-prod-github-runner-207 kernel: [13456.575885] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:08:02 juju-e4d256-prod-github-runner-207 kernel: [13456.576910] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:08:02 juju-e4d256-prod-github-runner-207 kernel: [13456.578002] ? show_regs.part.0+0x23/0x29 Aug 22 09:08:02 juju-e4d256-prod-github-runner-207 kernel: [13456.578995] ? show_regs.cold+0x8/0xd Aug 22 09:08:02 juju-e4d256-prod-github-runner-207 kernel: [13456.579984] ? watchdog_timer_fn+0x1be/0x220 Aug 22 09:08:02 juju-e4d256-prod-github-runner-207 kernel: [13456.580990] ? lockup_detector_update_enable+0x60/0x60 Aug 22 09:08:02 juju-e4d256-prod-github-runner-207 kernel: [13456.582050] ? __hrtimer_run_queues+0x107/0x230 Aug 22 09:08:02 juju-e4d256-prod-github-runner-207 kernel: [13456.583074] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 09:08:02 juju-e4d256-prod-github-runner-207 kernel: [13456.584123] ? hrtimer_interrupt+0x101/0x220 Aug 22 09:08:02 juju-e4d256-prod-github-runner-207 kernel: [13456.585144] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 09:08:02 juju-e4d256-prod-github-runner-207 kernel: [13456.586402] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 09:08:02 juju-e4d256-prod-github-runner-207 kernel: [13456.587465] Aug 22 09:08:02 juju-e4d256-prod-github-runner-207 kernel: [13456.588320] Aug 22 09:08:02 juju-e4d256-prod-github-runner-207 kernel: [13456.589180] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 09:08:02 juju-e4d256-prod-github-runner-207 kernel: [13456.590226] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:08:02 juju-e4d256-prod-github-runner-207 kernel: [13456.591292] ? _raw_spin_lock+0x22/0x30 Aug 22 09:08:02 juju-e4d256-prod-github-runner-207 kernel: [13456.592239] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:08:02 juju-e4d256-prod-github-runner-207 kernel: [13456.593292] direct_page_fault+0x206/0x310 [kvm] Aug 22 09:08:02 juju-e4d256-prod-github-runner-207 kernel: [13456.594349] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 09:08:02 juju-e4d256-prod-github-runner-207 kernel: [13456.595394] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 09:08:02 juju-e4d256-prod-github-runner-207 kernel: [13456.596410] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 09:08:02 juju-e4d256-prod-github-runner-207 kernel: [13456.597428] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 09:08:02 juju-e4d256-prod-github-runner-207 kernel: [13456.598551] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 09:08:02 juju-e4d256-prod-github-runner-207 kernel: [13456.599550] handle_exit+0x98/0x230 [kvm_amd] Aug 22 09:08:02 juju-e4d256-prod-github-runner-207 kernel: [13456.600444] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 09:08:02 juju-e4d256-prod-github-runner-207 kernel: [13456.601364] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 09:08:02 juju-e4d256-prod-github-runner-207 kernel: [13456.602286] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 09:08:02 juju-e4d256-prod-github-runner-207 kernel: [13456.603192] vcpu_run+0x62/0x2c0 [kvm] Aug 22 09:08:02 juju-e4d256-prod-github-runner-207 kernel: [13456.604023] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 09:08:02 juju-e4d256-prod-github-runner-207 kernel: [13456.604831] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 09:08:02 juju-e4d256-prod-github-runner-207 kernel: [13456.605689] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 09:08:02 juju-e4d256-prod-github-runner-207 kernel: [13456.606490] ? __seccomp_filter+0x4a/0x4a0 Aug 22 09:08:02 juju-e4d256-prod-github-runner-207 kernel: [13456.607434] ? __fget_files+0x86/0xc0 Aug 22 09:08:02 juju-e4d256-prod-github-runner-207 kernel: [13456.608142] __x64_sys_ioctl+0x95/0xd0 Aug 22 09:08:02 juju-e4d256-prod-github-runner-207 kernel: [13456.608835] do_syscall_64+0x5c/0xc0 Aug 22 09:08:02 juju-e4d256-prod-github-runner-207 kernel: [13456.609505] ? do_futex+0x162/0x1f0 Aug 22 09:08:02 juju-e4d256-prod-github-runner-207 kernel: [13456.610158] ? __x64_sys_futex+0x78/0x1e0 Aug 22 09:08:02 juju-e4d256-prod-github-runner-207 kernel: [13456.610831] ? __secure_computing+0xa9/0x120 Aug 22 09:08:02 juju-e4d256-prod-github-runner-207 kernel: [13456.611543] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 09:08:02 juju-e4d256-prod-github-runner-207 kernel: [13456.612303] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:08:02 juju-e4d256-prod-github-runner-207 kernel: [13456.613028] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:08:02 juju-e4d256-prod-github-runner-207 kernel: [13456.613743] ? do_syscall_64+0x69/0xc0 Aug 22 09:08:02 juju-e4d256-prod-github-runner-207 kernel: [13456.614387] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:08:02 juju-e4d256-prod-github-runner-207 kernel: [13456.615096] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:08:02 juju-e4d256-prod-github-runner-207 kernel: [13456.615819] ? do_syscall_64+0x69/0xc0 Aug 22 09:08:02 juju-e4d256-prod-github-runner-207 kernel: [13456.616442] ? do_syscall_64+0x69/0xc0 Aug 22 09:08:02 juju-e4d256-prod-github-runner-207 kernel: [13456.617063] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 09:08:02 juju-e4d256-prod-github-runner-207 kernel: [13456.617764] RIP: 0033:0x7faa5d0edaff Aug 22 09:08:02 juju-e4d256-prod-github-runner-207 kernel: [13456.618428] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 09:08:02 juju-e4d256-prod-github-runner-207 kernel: [13456.620449] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 09:08:02 juju-e4d256-prod-github-runner-207 kernel: [13456.621359] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 09:08:02 juju-e4d256-prod-github-runner-207 kernel: [13456.622242] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 09:08:02 juju-e4d256-prod-github-runner-207 kernel: [13456.623126] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 09:08:02 juju-e4d256-prod-github-runner-207 kernel: [13456.624019] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 09:08:02 juju-e4d256-prod-github-runner-207 kernel: [13456.624902] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 09:08:02 juju-e4d256-prod-github-runner-207 kernel: [13456.625790] Aug 22 09:08:30 juju-e4d256-prod-github-runner-207 kernel: [13484.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 12450s! [qemu-system-x86:6715] Aug 22 09:08:30 juju-e4d256-prod-github-runner-207 kernel: [13484.543173] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 09:08:30 juju-e4d256-prod-github-runner-207 kernel: [13484.543249] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 09:08:30 juju-e4d256-prod-github-runner-207 kernel: [13484.555917] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 09:08:30 juju-e4d256-prod-github-runner-207 kernel: [13484.557205] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 09:08:30 juju-e4d256-prod-github-runner-207 kernel: [13484.558448] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:08:30 juju-e4d256-prod-github-runner-207 kernel: [13484.559783] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 09:08:30 juju-e4d256-prod-github-runner-207 kernel: [13484.562398] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 09:08:30 juju-e4d256-prod-github-runner-207 kernel: [13484.563487] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 09:08:30 juju-e4d256-prod-github-runner-207 kernel: [13484.564673] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 09:08:30 juju-e4d256-prod-github-runner-207 kernel: [13484.565854] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 09:08:30 juju-e4d256-prod-github-runner-207 kernel: [13484.567043] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 09:08:30 juju-e4d256-prod-github-runner-207 kernel: [13484.568237] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 09:08:30 juju-e4d256-prod-github-runner-207 kernel: [13484.569417] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 09:08:30 juju-e4d256-prod-github-runner-207 kernel: [13484.570656] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 09:08:30 juju-e4d256-prod-github-runner-207 kernel: [13484.571758] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 09:08:30 juju-e4d256-prod-github-runner-207 kernel: [13484.572961] Call Trace: Aug 22 09:08:30 juju-e4d256-prod-github-runner-207 kernel: [13484.573888] Aug 22 09:08:30 juju-e4d256-prod-github-runner-207 kernel: [13484.574773] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:08:30 juju-e4d256-prod-github-runner-207 kernel: [13484.575858] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:08:30 juju-e4d256-prod-github-runner-207 kernel: [13484.576957] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:08:30 juju-e4d256-prod-github-runner-207 kernel: [13484.578154] ? show_regs.part.0+0x23/0x29 Aug 22 09:08:30 juju-e4d256-prod-github-runner-207 kernel: [13484.579216] ? show_regs.cold+0x8/0xd Aug 22 09:08:30 juju-e4d256-prod-github-runner-207 kernel: [13484.580286] ? watchdog_timer_fn+0x1be/0x220 Aug 22 09:08:30 juju-e4d256-prod-github-runner-207 kernel: [13484.581359] ? lockup_detector_update_enable+0x60/0x60 Aug 22 09:08:30 juju-e4d256-prod-github-runner-207 kernel: [13484.582423] ? __hrtimer_run_queues+0x107/0x230 Aug 22 09:08:30 juju-e4d256-prod-github-runner-207 kernel: [13484.583566] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 09:08:30 juju-e4d256-prod-github-runner-207 kernel: [13484.584596] ? hrtimer_interrupt+0x101/0x220 Aug 22 09:08:30 juju-e4d256-prod-github-runner-207 kernel: [13484.585611] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 09:08:30 juju-e4d256-prod-github-runner-207 kernel: [13484.586677] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 09:08:30 juju-e4d256-prod-github-runner-207 kernel: [13484.587731] Aug 22 09:08:30 juju-e4d256-prod-github-runner-207 kernel: [13484.588581] Aug 22 09:08:30 juju-e4d256-prod-github-runner-207 kernel: [13484.589511] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 09:08:30 juju-e4d256-prod-github-runner-207 kernel: [13484.590568] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:08:30 juju-e4d256-prod-github-runner-207 kernel: [13484.591644] ? _raw_spin_lock+0x22/0x30 Aug 22 09:08:30 juju-e4d256-prod-github-runner-207 kernel: [13484.592640] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:08:30 juju-e4d256-prod-github-runner-207 kernel: [13484.593741] direct_page_fault+0x206/0x310 [kvm] Aug 22 09:08:30 juju-e4d256-prod-github-runner-207 kernel: [13484.594767] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 09:08:30 juju-e4d256-prod-github-runner-207 kernel: [13484.595796] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 09:08:30 juju-e4d256-prod-github-runner-207 kernel: [13484.596805] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 09:08:30 juju-e4d256-prod-github-runner-207 kernel: [13484.597782] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 09:08:30 juju-e4d256-prod-github-runner-207 kernel: [13484.598732] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 09:08:30 juju-e4d256-prod-github-runner-207 kernel: [13484.599729] handle_exit+0x98/0x230 [kvm_amd] Aug 22 09:08:30 juju-e4d256-prod-github-runner-207 kernel: [13484.600620] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 09:08:30 juju-e4d256-prod-github-runner-207 kernel: [13484.601532] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 09:08:30 juju-e4d256-prod-github-runner-207 kernel: [13484.602454] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 09:08:30 juju-e4d256-prod-github-runner-207 kernel: [13484.603360] vcpu_run+0x62/0x2c0 [kvm] Aug 22 09:08:30 juju-e4d256-prod-github-runner-207 kernel: [13484.604170] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 09:08:30 juju-e4d256-prod-github-runner-207 kernel: [13484.604974] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 09:08:30 juju-e4d256-prod-github-runner-207 kernel: [13484.605830] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 09:08:30 juju-e4d256-prod-github-runner-207 kernel: [13484.606623] ? __seccomp_filter+0x4a/0x4a0 Aug 22 09:08:30 juju-e4d256-prod-github-runner-207 kernel: [13484.607372] ? __fget_files+0x86/0xc0 Aug 22 09:08:30 juju-e4d256-prod-github-runner-207 kernel: [13484.608074] __x64_sys_ioctl+0x95/0xd0 Aug 22 09:08:30 juju-e4d256-prod-github-runner-207 kernel: [13484.608764] do_syscall_64+0x5c/0xc0 Aug 22 09:08:30 juju-e4d256-prod-github-runner-207 kernel: [13484.609432] ? do_futex+0x162/0x1f0 Aug 22 09:08:30 juju-e4d256-prod-github-runner-207 kernel: [13484.610130] ? __x64_sys_futex+0x78/0x1e0 Aug 22 09:08:30 juju-e4d256-prod-github-runner-207 kernel: [13484.610818] ? __secure_computing+0xa9/0x120 Aug 22 09:08:30 juju-e4d256-prod-github-runner-207 kernel: [13484.611541] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 09:08:30 juju-e4d256-prod-github-runner-207 kernel: [13484.612341] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:08:30 juju-e4d256-prod-github-runner-207 kernel: [13484.613084] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:08:30 juju-e4d256-prod-github-runner-207 kernel: [13484.613893] ? do_syscall_64+0x69/0xc0 Aug 22 09:08:30 juju-e4d256-prod-github-runner-207 kernel: [13484.614561] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:08:30 juju-e4d256-prod-github-runner-207 kernel: [13484.615332] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:08:30 juju-e4d256-prod-github-runner-207 kernel: [13484.616080] ? do_syscall_64+0x69/0xc0 Aug 22 09:08:30 juju-e4d256-prod-github-runner-207 kernel: [13484.616752] ? do_syscall_64+0x69/0xc0 Aug 22 09:08:30 juju-e4d256-prod-github-runner-207 kernel: [13484.617443] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 09:08:30 juju-e4d256-prod-github-runner-207 kernel: [13484.618213] RIP: 0033:0x7faa5d0edaff Aug 22 09:08:30 juju-e4d256-prod-github-runner-207 kernel: [13484.618856] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 09:08:30 juju-e4d256-prod-github-runner-207 kernel: [13484.621001] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 09:08:30 juju-e4d256-prod-github-runner-207 kernel: [13484.621973] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 09:08:30 juju-e4d256-prod-github-runner-207 kernel: [13484.622917] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 09:08:30 juju-e4d256-prod-github-runner-207 kernel: [13484.623854] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 09:08:30 juju-e4d256-prod-github-runner-207 kernel: [13484.624864] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 09:08:30 juju-e4d256-prod-github-runner-207 kernel: [13484.625839] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 09:08:30 juju-e4d256-prod-github-runner-207 kernel: [13484.626776] Aug 22 09:08:44 juju-e4d256-prod-github-runner-207 kernel: [13498.088707] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 09:08:44 juju-e4d256-prod-github-runner-207 kernel: [13498.089910] rcu: 1-....: (3334743 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=1611246 Aug 22 09:08:44 juju-e4d256-prod-github-runner-207 kernel: [13498.091123] (t=3345222 jiffies g=23269 q=21176) Aug 22 09:08:44 juju-e4d256-prod-github-runner-207 kernel: [13498.091913] NMI backtrace for cpu 1 Aug 22 09:08:44 juju-e4d256-prod-github-runner-207 kernel: [13498.092626] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 09:08:44 juju-e4d256-prod-github-runner-207 kernel: [13498.093748] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 09:08:44 juju-e4d256-prod-github-runner-207 kernel: [13498.094854] Call Trace: Aug 22 09:08:44 juju-e4d256-prod-github-runner-207 kernel: [13498.095538] Aug 22 09:08:44 juju-e4d256-prod-github-runner-207 kernel: [13498.096185] show_stack+0x52/0x5c Aug 22 09:08:44 juju-e4d256-prod-github-runner-207 kernel: [13498.096913] dump_stack_lvl+0x4a/0x63 Aug 22 09:08:44 juju-e4d256-prod-github-runner-207 kernel: [13498.097663] dump_stack+0x10/0x16 Aug 22 09:08:44 juju-e4d256-prod-github-runner-207 kernel: [13498.098385] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 09:08:44 juju-e4d256-prod-github-runner-207 kernel: [13498.099190] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 09:08:44 juju-e4d256-prod-github-runner-207 kernel: [13498.099978] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 09:08:44 juju-e4d256-prod-github-runner-207 kernel: [13498.100859] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 09:08:44 juju-e4d256-prod-github-runner-207 kernel: [13498.101694] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 09:08:44 juju-e4d256-prod-github-runner-207 kernel: [13498.102508] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 09:08:44 juju-e4d256-prod-github-runner-207 kernel: [13498.103309] print_cpu_stall.cold+0x2f/0xe2 Aug 22 09:08:44 juju-e4d256-prod-github-runner-207 kernel: [13498.104079] ? timekeeping_update+0xf7/0x150 Aug 22 09:08:44 juju-e4d256-prod-github-runner-207 kernel: [13498.104861] check_cpu_stall+0x109/0x270 Aug 22 09:08:44 juju-e4d256-prod-github-runner-207 kernel: [13498.105613] rcu_sched_clock_irq+0x9a/0x250 Aug 22 09:08:44 juju-e4d256-prod-github-runner-207 kernel: [13498.106380] update_process_times+0x94/0xd0 Aug 22 09:08:44 juju-e4d256-prod-github-runner-207 kernel: [13498.107162] tick_sched_handle+0x29/0x70 Aug 22 09:08:44 juju-e4d256-prod-github-runner-207 kernel: [13498.107912] tick_sched_timer+0x8c/0xc0 Aug 22 09:08:44 juju-e4d256-prod-github-runner-207 kernel: [13498.108658] ? tick_nohz_handler+0xb0/0xb0 Aug 22 09:08:44 juju-e4d256-prod-github-runner-207 kernel: [13498.109419] __hrtimer_run_queues+0x107/0x230 Aug 22 09:08:44 juju-e4d256-prod-github-runner-207 kernel: [13498.110198] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 09:08:44 juju-e4d256-prod-github-runner-207 kernel: [13498.110992] hrtimer_interrupt+0x101/0x220 Aug 22 09:08:44 juju-e4d256-prod-github-runner-207 kernel: [13498.111761] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 09:08:44 juju-e4d256-prod-github-runner-207 kernel: [13498.112578] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 09:08:44 juju-e4d256-prod-github-runner-207 kernel: [13498.113390] Aug 22 09:08:44 juju-e4d256-prod-github-runner-207 kernel: [13498.114039] Aug 22 09:08:44 juju-e4d256-prod-github-runner-207 kernel: [13498.114887] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 09:08:44 juju-e4d256-prod-github-runner-207 kernel: [13498.115742] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:08:44 juju-e4d256-prod-github-runner-207 kernel: [13498.116636] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 09:08:44 juju-e4d256-prod-github-runner-207 kernel: [13498.118937] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 09:08:44 juju-e4d256-prod-github-runner-207 kernel: [13498.119819] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 09:08:44 juju-e4d256-prod-github-runner-207 kernel: [13498.120834] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 09:08:44 juju-e4d256-prod-github-runner-207 kernel: [13498.121830] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 09:08:44 juju-e4d256-prod-github-runner-207 kernel: [13498.122830] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 09:08:44 juju-e4d256-prod-github-runner-207 kernel: [13498.123799] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 09:08:44 juju-e4d256-prod-github-runner-207 kernel: [13498.124768] ? _raw_spin_lock+0x22/0x30 Aug 22 09:08:44 juju-e4d256-prod-github-runner-207 kernel: [13498.125534] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:08:44 juju-e4d256-prod-github-runner-207 kernel: [13498.126424] direct_page_fault+0x206/0x310 [kvm] Aug 22 09:08:44 juju-e4d256-prod-github-runner-207 kernel: [13498.127286] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 09:08:44 juju-e4d256-prod-github-runner-207 kernel: [13498.128118] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 09:08:44 juju-e4d256-prod-github-runner-207 kernel: [13498.128952] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 09:08:44 juju-e4d256-prod-github-runner-207 kernel: [13498.129770] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 09:08:44 juju-e4d256-prod-github-runner-207 kernel: [13498.130561] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 09:08:44 juju-e4d256-prod-github-runner-207 kernel: [13498.131411] handle_exit+0x98/0x230 [kvm_amd] Aug 22 09:08:44 juju-e4d256-prod-github-runner-207 kernel: [13498.132173] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 09:08:44 juju-e4d256-prod-github-runner-207 kernel: [13498.132968] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 09:08:44 juju-e4d256-prod-github-runner-207 kernel: [13498.133789] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 09:08:44 juju-e4d256-prod-github-runner-207 kernel: [13498.134583] vcpu_run+0x62/0x2c0 [kvm] Aug 22 09:08:44 juju-e4d256-prod-github-runner-207 kernel: [13498.135327] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 09:08:44 juju-e4d256-prod-github-runner-207 kernel: [13498.136068] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 09:08:44 juju-e4d256-prod-github-runner-207 kernel: [13498.136883] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 09:08:44 juju-e4d256-prod-github-runner-207 kernel: [13498.137651] ? __seccomp_filter+0x4a/0x4a0 Aug 22 09:08:44 juju-e4d256-prod-github-runner-207 kernel: [13498.138383] ? __fget_files+0x86/0xc0 Aug 22 09:08:44 juju-e4d256-prod-github-runner-207 kernel: [13498.139098] __x64_sys_ioctl+0x95/0xd0 Aug 22 09:08:44 juju-e4d256-prod-github-runner-207 kernel: [13498.139808] do_syscall_64+0x5c/0xc0 Aug 22 09:08:44 juju-e4d256-prod-github-runner-207 kernel: [13498.140496] ? do_futex+0x162/0x1f0 Aug 22 09:08:44 juju-e4d256-prod-github-runner-207 kernel: [13498.141176] ? __x64_sys_futex+0x78/0x1e0 Aug 22 09:08:44 juju-e4d256-prod-github-runner-207 kernel: [13498.141889] ? __secure_computing+0xa9/0x120 Aug 22 09:08:44 juju-e4d256-prod-github-runner-207 kernel: [13498.142615] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 09:08:44 juju-e4d256-prod-github-runner-207 kernel: [13498.143432] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:08:44 juju-e4d256-prod-github-runner-207 kernel: [13498.144195] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:08:44 juju-e4d256-prod-github-runner-207 kernel: [13498.144958] ? do_syscall_64+0x69/0xc0 Aug 22 09:08:44 juju-e4d256-prod-github-runner-207 kernel: [13498.145653] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:08:44 juju-e4d256-prod-github-runner-207 kernel: [13498.146422] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:08:44 juju-e4d256-prod-github-runner-207 kernel: [13498.147211] ? do_syscall_64+0x69/0xc0 Aug 22 09:08:44 juju-e4d256-prod-github-runner-207 kernel: [13498.147916] ? do_syscall_64+0x69/0xc0 Aug 22 09:08:44 juju-e4d256-prod-github-runner-207 kernel: [13498.148608] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 09:08:44 juju-e4d256-prod-github-runner-207 kernel: [13498.149377] RIP: 0033:0x7faa5d0edaff Aug 22 09:08:44 juju-e4d256-prod-github-runner-207 kernel: [13498.150057] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 09:08:44 juju-e4d256-prod-github-runner-207 kernel: [13498.152200] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 09:08:44 juju-e4d256-prod-github-runner-207 kernel: [13498.153169] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 09:08:44 juju-e4d256-prod-github-runner-207 kernel: [13498.154112] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 09:08:44 juju-e4d256-prod-github-runner-207 kernel: [13498.155123] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 09:08:44 juju-e4d256-prod-github-runner-207 kernel: [13498.156063] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 09:08:44 juju-e4d256-prod-github-runner-207 kernel: [13498.156993] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 09:08:44 juju-e4d256-prod-github-runner-207 kernel: [13498.157920] Aug 22 09:09:10 juju-e4d256-prod-github-runner-207 kernel: [13524.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 12487s! [qemu-system-x86:6715] Aug 22 09:09:10 juju-e4d256-prod-github-runner-207 kernel: [13524.543877] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 09:09:10 juju-e4d256-prod-github-runner-207 kernel: [13524.544185] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 09:09:10 juju-e4d256-prod-github-runner-207 kernel: [13524.556318] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 09:09:10 juju-e4d256-prod-github-runner-207 kernel: [13524.557594] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 09:09:10 juju-e4d256-prod-github-runner-207 kernel: [13524.558848] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:09:10 juju-e4d256-prod-github-runner-207 kernel: [13524.559909] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 09:09:10 juju-e4d256-prod-github-runner-207 kernel: [13524.562468] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 09:09:10 juju-e4d256-prod-github-runner-207 kernel: [13524.563513] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 09:09:10 juju-e4d256-prod-github-runner-207 kernel: [13524.564678] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 09:09:10 juju-e4d256-prod-github-runner-207 kernel: [13524.565841] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 09:09:10 juju-e4d256-prod-github-runner-207 kernel: [13524.567121] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 09:09:10 juju-e4d256-prod-github-runner-207 kernel: [13524.568438] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 09:09:10 juju-e4d256-prod-github-runner-207 kernel: [13524.569608] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 09:09:10 juju-e4d256-prod-github-runner-207 kernel: [13524.570857] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 09:09:10 juju-e4d256-prod-github-runner-207 kernel: [13524.571974] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 09:09:10 juju-e4d256-prod-github-runner-207 kernel: [13524.573209] Call Trace: Aug 22 09:09:10 juju-e4d256-prod-github-runner-207 kernel: [13524.574125] Aug 22 09:09:10 juju-e4d256-prod-github-runner-207 kernel: [13524.575079] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:09:10 juju-e4d256-prod-github-runner-207 kernel: [13524.576174] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:09:10 juju-e4d256-prod-github-runner-207 kernel: [13524.577200] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:09:10 juju-e4d256-prod-github-runner-207 kernel: [13524.578326] ? show_regs.part.0+0x23/0x29 Aug 22 09:09:10 juju-e4d256-prod-github-runner-207 kernel: [13524.579333] ? show_regs.cold+0x8/0xd Aug 22 09:09:10 juju-e4d256-prod-github-runner-207 kernel: [13524.580304] ? watchdog_timer_fn+0x1be/0x220 Aug 22 09:09:10 juju-e4d256-prod-github-runner-207 kernel: [13524.581323] ? lockup_detector_update_enable+0x60/0x60 Aug 22 09:09:10 juju-e4d256-prod-github-runner-207 kernel: [13524.582397] ? __hrtimer_run_queues+0x107/0x230 Aug 22 09:09:10 juju-e4d256-prod-github-runner-207 kernel: [13524.583434] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 09:09:10 juju-e4d256-prod-github-runner-207 kernel: [13524.584455] ? hrtimer_interrupt+0x101/0x220 Aug 22 09:09:10 juju-e4d256-prod-github-runner-207 kernel: [13524.585474] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 09:09:10 juju-e4d256-prod-github-runner-207 kernel: [13524.586550] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 09:09:10 juju-e4d256-prod-github-runner-207 kernel: [13524.587592] Aug 22 09:09:10 juju-e4d256-prod-github-runner-207 kernel: [13524.588443] Aug 22 09:09:10 juju-e4d256-prod-github-runner-207 kernel: [13524.589347] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 09:09:10 juju-e4d256-prod-github-runner-207 kernel: [13524.590408] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:09:10 juju-e4d256-prod-github-runner-207 kernel: [13524.591514] ? _raw_spin_lock+0x22/0x30 Aug 22 09:09:10 juju-e4d256-prod-github-runner-207 kernel: [13524.592476] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:09:10 juju-e4d256-prod-github-runner-207 kernel: [13524.593507] direct_page_fault+0x206/0x310 [kvm] Aug 22 09:09:10 juju-e4d256-prod-github-runner-207 kernel: [13524.594556] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 09:09:10 juju-e4d256-prod-github-runner-207 kernel: [13524.595572] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 09:09:10 juju-e4d256-prod-github-runner-207 kernel: [13524.596577] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 09:09:10 juju-e4d256-prod-github-runner-207 kernel: [13524.597593] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 09:09:10 juju-e4d256-prod-github-runner-207 kernel: [13524.598551] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 09:09:10 juju-e4d256-prod-github-runner-207 kernel: [13524.599539] handle_exit+0x98/0x230 [kvm_amd] Aug 22 09:09:10 juju-e4d256-prod-github-runner-207 kernel: [13524.600437] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 09:09:10 juju-e4d256-prod-github-runner-207 kernel: [13524.601353] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 09:09:10 juju-e4d256-prod-github-runner-207 kernel: [13524.602278] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 09:09:10 juju-e4d256-prod-github-runner-207 kernel: [13524.603246] vcpu_run+0x62/0x2c0 [kvm] Aug 22 09:09:10 juju-e4d256-prod-github-runner-207 kernel: [13524.604204] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 09:09:10 juju-e4d256-prod-github-runner-207 kernel: [13524.605130] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 09:09:10 juju-e4d256-prod-github-runner-207 kernel: [13524.606020] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 09:09:10 juju-e4d256-prod-github-runner-207 kernel: [13524.606857] ? __seccomp_filter+0x4a/0x4a0 Aug 22 09:09:10 juju-e4d256-prod-github-runner-207 kernel: [13524.607632] ? __fget_files+0x86/0xc0 Aug 22 09:09:10 juju-e4d256-prod-github-runner-207 kernel: [13524.608397] __x64_sys_ioctl+0x95/0xd0 Aug 22 09:09:10 juju-e4d256-prod-github-runner-207 kernel: [13524.609145] do_syscall_64+0x5c/0xc0 Aug 22 09:09:10 juju-e4d256-prod-github-runner-207 kernel: [13524.609889] ? do_futex+0x162/0x1f0 Aug 22 09:09:10 juju-e4d256-prod-github-runner-207 kernel: [13524.610588] ? __x64_sys_futex+0x78/0x1e0 Aug 22 09:09:10 juju-e4d256-prod-github-runner-207 kernel: [13524.611298] ? __secure_computing+0xa9/0x120 Aug 22 09:09:10 juju-e4d256-prod-github-runner-207 kernel: [13524.612003] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 09:09:10 juju-e4d256-prod-github-runner-207 kernel: [13524.612822] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:09:10 juju-e4d256-prod-github-runner-207 kernel: [13524.613565] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:09:10 juju-e4d256-prod-github-runner-207 kernel: [13524.614284] ? do_syscall_64+0x69/0xc0 Aug 22 09:09:10 juju-e4d256-prod-github-runner-207 kernel: [13524.614957] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:09:10 juju-e4d256-prod-github-runner-207 kernel: [13524.615684] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:09:10 juju-e4d256-prod-github-runner-207 kernel: [13524.616437] ? do_syscall_64+0x69/0xc0 Aug 22 09:09:10 juju-e4d256-prod-github-runner-207 kernel: [13524.617095] ? do_syscall_64+0x69/0xc0 Aug 22 09:09:10 juju-e4d256-prod-github-runner-207 kernel: [13524.617720] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 09:09:10 juju-e4d256-prod-github-runner-207 kernel: [13524.618501] RIP: 0033:0x7faa5d0edaff Aug 22 09:09:10 juju-e4d256-prod-github-runner-207 kernel: [13524.619218] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 09:09:10 juju-e4d256-prod-github-runner-207 kernel: [13524.621240] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 09:09:10 juju-e4d256-prod-github-runner-207 kernel: [13524.622159] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 09:09:10 juju-e4d256-prod-github-runner-207 kernel: [13524.623074] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 09:09:10 juju-e4d256-prod-github-runner-207 kernel: [13524.623972] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 09:09:10 juju-e4d256-prod-github-runner-207 kernel: [13524.624928] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 09:09:10 juju-e4d256-prod-github-runner-207 kernel: [13524.625843] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 09:09:10 juju-e4d256-prod-github-runner-207 kernel: [13524.626787] Aug 22 09:09:38 juju-e4d256-prod-github-runner-207 kernel: [13552.541984] watchdog: BUG: soft lockup - CPU#1 stuck for 12513s! [qemu-system-x86:6715] Aug 22 09:09:38 juju-e4d256-prod-github-runner-207 kernel: [13552.543190] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 09:09:38 juju-e4d256-prod-github-runner-207 kernel: [13552.543266] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 09:09:38 juju-e4d256-prod-github-runner-207 kernel: [13552.556205] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 09:09:38 juju-e4d256-prod-github-runner-207 kernel: [13552.557505] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 09:09:38 juju-e4d256-prod-github-runner-207 kernel: [13552.558808] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:09:38 juju-e4d256-prod-github-runner-207 kernel: [13552.559897] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 09:09:38 juju-e4d256-prod-github-runner-207 kernel: [13552.562539] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 09:09:38 juju-e4d256-prod-github-runner-207 kernel: [13552.563609] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 09:09:38 juju-e4d256-prod-github-runner-207 kernel: [13552.564802] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 09:09:38 juju-e4d256-prod-github-runner-207 kernel: [13552.565990] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 09:09:38 juju-e4d256-prod-github-runner-207 kernel: [13552.567184] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 09:09:38 juju-e4d256-prod-github-runner-207 kernel: [13552.568369] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 09:09:38 juju-e4d256-prod-github-runner-207 kernel: [13552.569561] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 09:09:38 juju-e4d256-prod-github-runner-207 kernel: [13552.570825] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 09:09:38 juju-e4d256-prod-github-runner-207 kernel: [13552.571949] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 09:09:38 juju-e4d256-prod-github-runner-207 kernel: [13552.573166] Call Trace: Aug 22 09:09:38 juju-e4d256-prod-github-runner-207 kernel: [13552.574091] Aug 22 09:09:38 juju-e4d256-prod-github-runner-207 kernel: [13552.575241] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:09:38 juju-e4d256-prod-github-runner-207 kernel: [13552.576292] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:09:38 juju-e4d256-prod-github-runner-207 kernel: [13552.577327] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:09:38 juju-e4d256-prod-github-runner-207 kernel: [13552.578436] ? show_regs.part.0+0x23/0x29 Aug 22 09:09:38 juju-e4d256-prod-github-runner-207 kernel: [13552.579480] ? show_regs.cold+0x8/0xd Aug 22 09:09:38 juju-e4d256-prod-github-runner-207 kernel: [13552.580499] ? watchdog_timer_fn+0x1be/0x220 Aug 22 09:09:38 juju-e4d256-prod-github-runner-207 kernel: [13552.581525] ? lockup_detector_update_enable+0x60/0x60 Aug 22 09:09:38 juju-e4d256-prod-github-runner-207 kernel: [13552.582694] ? __hrtimer_run_queues+0x107/0x230 Aug 22 09:09:38 juju-e4d256-prod-github-runner-207 kernel: [13552.583736] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 09:09:38 juju-e4d256-prod-github-runner-207 kernel: [13552.584836] ? hrtimer_interrupt+0x101/0x220 Aug 22 09:09:38 juju-e4d256-prod-github-runner-207 kernel: [13552.585867] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 09:09:38 juju-e4d256-prod-github-runner-207 kernel: [13552.587106] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 09:09:38 juju-e4d256-prod-github-runner-207 kernel: [13552.588302] Aug 22 09:09:38 juju-e4d256-prod-github-runner-207 kernel: [13552.589162] Aug 22 09:09:38 juju-e4d256-prod-github-runner-207 kernel: [13552.590017] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 09:09:38 juju-e4d256-prod-github-runner-207 kernel: [13552.591082] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:09:38 juju-e4d256-prod-github-runner-207 kernel: [13552.592178] ? _raw_spin_lock+0x22/0x30 Aug 22 09:09:38 juju-e4d256-prod-github-runner-207 kernel: [13552.593137] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:09:38 juju-e4d256-prod-github-runner-207 kernel: [13552.594205] direct_page_fault+0x206/0x310 [kvm] Aug 22 09:09:38 juju-e4d256-prod-github-runner-207 kernel: [13552.595255] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 09:09:38 juju-e4d256-prod-github-runner-207 kernel: [13552.596282] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 09:09:38 juju-e4d256-prod-github-runner-207 kernel: [13552.597302] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 09:09:38 juju-e4d256-prod-github-runner-207 kernel: [13552.598299] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 09:09:38 juju-e4d256-prod-github-runner-207 kernel: [13552.599276] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 09:09:38 juju-e4d256-prod-github-runner-207 kernel: [13552.600282] handle_exit+0x98/0x230 [kvm_amd] Aug 22 09:09:38 juju-e4d256-prod-github-runner-207 kernel: [13552.601189] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 09:09:38 juju-e4d256-prod-github-runner-207 kernel: [13552.602137] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 09:09:38 juju-e4d256-prod-github-runner-207 kernel: [13552.603080] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 09:09:38 juju-e4d256-prod-github-runner-207 kernel: [13552.604000] vcpu_run+0x62/0x2c0 [kvm] Aug 22 09:09:38 juju-e4d256-prod-github-runner-207 kernel: [13552.604826] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 09:09:38 juju-e4d256-prod-github-runner-207 kernel: [13552.605649] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 09:09:38 juju-e4d256-prod-github-runner-207 kernel: [13552.606567] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 09:09:38 juju-e4d256-prod-github-runner-207 kernel: [13552.607390] ? __seccomp_filter+0x4a/0x4a0 Aug 22 09:09:38 juju-e4d256-prod-github-runner-207 kernel: [13552.608146] ? __fget_files+0x86/0xc0 Aug 22 09:09:38 juju-e4d256-prod-github-runner-207 kernel: [13552.608866] __x64_sys_ioctl+0x95/0xd0 Aug 22 09:09:38 juju-e4d256-prod-github-runner-207 kernel: [13552.609575] do_syscall_64+0x5c/0xc0 Aug 22 09:09:38 juju-e4d256-prod-github-runner-207 kernel: [13552.610282] ? do_futex+0x162/0x1f0 Aug 22 09:09:38 juju-e4d256-prod-github-runner-207 kernel: [13552.610951] ? __x64_sys_futex+0x78/0x1e0 Aug 22 09:09:38 juju-e4d256-prod-github-runner-207 kernel: [13552.611636] ? __secure_computing+0xa9/0x120 Aug 22 09:09:38 juju-e4d256-prod-github-runner-207 kernel: [13552.612346] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 09:09:38 juju-e4d256-prod-github-runner-207 kernel: [13552.613120] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:09:38 juju-e4d256-prod-github-runner-207 kernel: [13552.613861] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:09:38 juju-e4d256-prod-github-runner-207 kernel: [13552.614605] ? do_syscall_64+0x69/0xc0 Aug 22 09:09:38 juju-e4d256-prod-github-runner-207 kernel: [13552.615268] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:09:38 juju-e4d256-prod-github-runner-207 kernel: [13552.615987] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:09:38 juju-e4d256-prod-github-runner-207 kernel: [13552.616699] ? do_syscall_64+0x69/0xc0 Aug 22 09:09:38 juju-e4d256-prod-github-runner-207 kernel: [13552.617338] ? do_syscall_64+0x69/0xc0 Aug 22 09:09:38 juju-e4d256-prod-github-runner-207 kernel: [13552.617972] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 09:09:38 juju-e4d256-prod-github-runner-207 kernel: [13552.618709] RIP: 0033:0x7faa5d0edaff Aug 22 09:09:38 juju-e4d256-prod-github-runner-207 kernel: [13552.619347] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 09:09:38 juju-e4d256-prod-github-runner-207 kernel: [13552.621399] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 09:09:38 juju-e4d256-prod-github-runner-207 kernel: [13552.622349] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 09:09:38 juju-e4d256-prod-github-runner-207 kernel: [13552.623261] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 09:09:38 juju-e4d256-prod-github-runner-207 kernel: [13552.624169] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 09:09:38 juju-e4d256-prod-github-runner-207 kernel: [13552.625076] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 09:09:38 juju-e4d256-prod-github-runner-207 kernel: [13552.625993] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 09:09:38 juju-e4d256-prod-github-runner-207 kernel: [13552.626946] Aug 22 09:10:06 juju-e4d256-prod-github-runner-207 kernel: [13580.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 12539s! [qemu-system-x86:6715] Aug 22 09:10:06 juju-e4d256-prod-github-runner-207 kernel: [13580.543118] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 09:10:06 juju-e4d256-prod-github-runner-207 kernel: [13580.543192] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 09:10:06 juju-e4d256-prod-github-runner-207 kernel: [13580.555997] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 09:10:06 juju-e4d256-prod-github-runner-207 kernel: [13580.557307] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 09:10:06 juju-e4d256-prod-github-runner-207 kernel: [13580.558588] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:10:06 juju-e4d256-prod-github-runner-207 kernel: [13580.559664] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 09:10:06 juju-e4d256-prod-github-runner-207 kernel: [13580.562318] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 09:10:06 juju-e4d256-prod-github-runner-207 kernel: [13580.563374] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 09:10:06 juju-e4d256-prod-github-runner-207 kernel: [13580.564556] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 09:10:06 juju-e4d256-prod-github-runner-207 kernel: [13580.565737] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 09:10:06 juju-e4d256-prod-github-runner-207 kernel: [13580.566928] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 09:10:06 juju-e4d256-prod-github-runner-207 kernel: [13580.568108] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 09:10:06 juju-e4d256-prod-github-runner-207 kernel: [13580.569307] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 09:10:06 juju-e4d256-prod-github-runner-207 kernel: [13580.570834] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 09:10:06 juju-e4d256-prod-github-runner-207 kernel: [13580.571952] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 09:10:06 juju-e4d256-prod-github-runner-207 kernel: [13580.573159] Call Trace: Aug 22 09:10:06 juju-e4d256-prod-github-runner-207 kernel: [13580.574093] Aug 22 09:10:06 juju-e4d256-prod-github-runner-207 kernel: [13580.574983] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:10:06 juju-e4d256-prod-github-runner-207 kernel: [13580.576276] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:10:06 juju-e4d256-prod-github-runner-207 kernel: [13580.577374] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:10:06 juju-e4d256-prod-github-runner-207 kernel: [13580.578501] ? show_regs.part.0+0x23/0x29 Aug 22 09:10:06 juju-e4d256-prod-github-runner-207 kernel: [13580.579512] ? show_regs.cold+0x8/0xd Aug 22 09:10:06 juju-e4d256-prod-github-runner-207 kernel: [13580.580498] ? watchdog_timer_fn+0x1be/0x220 Aug 22 09:10:06 juju-e4d256-prod-github-runner-207 kernel: [13580.581533] ? lockup_detector_update_enable+0x60/0x60 Aug 22 09:10:06 juju-e4d256-prod-github-runner-207 kernel: [13580.582630] ? __hrtimer_run_queues+0x107/0x230 Aug 22 09:10:06 juju-e4d256-prod-github-runner-207 kernel: [13580.583836] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 09:10:06 juju-e4d256-prod-github-runner-207 kernel: [13580.584885] ? hrtimer_interrupt+0x101/0x220 Aug 22 09:10:06 juju-e4d256-prod-github-runner-207 kernel: [13580.585957] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 09:10:06 juju-e4d256-prod-github-runner-207 kernel: [13580.587041] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 09:10:06 juju-e4d256-prod-github-runner-207 kernel: [13580.588101] Aug 22 09:10:06 juju-e4d256-prod-github-runner-207 kernel: [13580.588969] Aug 22 09:10:06 juju-e4d256-prod-github-runner-207 kernel: [13580.589836] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 09:10:06 juju-e4d256-prod-github-runner-207 kernel: [13580.591115] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:10:06 juju-e4d256-prod-github-runner-207 kernel: [13580.592237] ? _raw_spin_lock+0x22/0x30 Aug 22 09:10:06 juju-e4d256-prod-github-runner-207 kernel: [13580.593193] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:10:06 juju-e4d256-prod-github-runner-207 kernel: [13580.594240] direct_page_fault+0x206/0x310 [kvm] Aug 22 09:10:06 juju-e4d256-prod-github-runner-207 kernel: [13580.595278] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 09:10:06 juju-e4d256-prod-github-runner-207 kernel: [13580.596306] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 09:10:06 juju-e4d256-prod-github-runner-207 kernel: [13580.597347] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 09:10:06 juju-e4d256-prod-github-runner-207 kernel: [13580.598354] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 09:10:06 juju-e4d256-prod-github-runner-207 kernel: [13580.599312] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 09:10:06 juju-e4d256-prod-github-runner-207 kernel: [13580.600300] handle_exit+0x98/0x230 [kvm_amd] Aug 22 09:10:06 juju-e4d256-prod-github-runner-207 kernel: [13580.601202] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 09:10:06 juju-e4d256-prod-github-runner-207 kernel: [13580.602147] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 09:10:06 juju-e4d256-prod-github-runner-207 kernel: [13580.603084] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 09:10:06 juju-e4d256-prod-github-runner-207 kernel: [13580.604011] vcpu_run+0x62/0x2c0 [kvm] Aug 22 09:10:06 juju-e4d256-prod-github-runner-207 kernel: [13580.604836] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 09:10:06 juju-e4d256-prod-github-runner-207 kernel: [13580.605874] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 09:10:06 juju-e4d256-prod-github-runner-207 kernel: [13580.606827] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 09:10:06 juju-e4d256-prod-github-runner-207 kernel: [13580.607654] ? __seccomp_filter+0x4a/0x4a0 Aug 22 09:10:06 juju-e4d256-prod-github-runner-207 kernel: [13580.608412] ? __fget_files+0x86/0xc0 Aug 22 09:10:06 juju-e4d256-prod-github-runner-207 kernel: [13580.609184] __x64_sys_ioctl+0x95/0xd0 Aug 22 09:10:06 juju-e4d256-prod-github-runner-207 kernel: [13580.609917] do_syscall_64+0x5c/0xc0 Aug 22 09:10:06 juju-e4d256-prod-github-runner-207 kernel: [13580.610621] ? do_futex+0x162/0x1f0 Aug 22 09:10:06 juju-e4d256-prod-github-runner-207 kernel: [13580.611283] ? __x64_sys_futex+0x78/0x1e0 Aug 22 09:10:06 juju-e4d256-prod-github-runner-207 kernel: [13580.611989] ? __secure_computing+0xa9/0x120 Aug 22 09:10:06 juju-e4d256-prod-github-runner-207 kernel: [13580.612695] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 09:10:06 juju-e4d256-prod-github-runner-207 kernel: [13580.613502] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:10:06 juju-e4d256-prod-github-runner-207 kernel: [13580.614265] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:10:06 juju-e4d256-prod-github-runner-207 kernel: [13580.615016] ? do_syscall_64+0x69/0xc0 Aug 22 09:10:06 juju-e4d256-prod-github-runner-207 kernel: [13580.615697] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:10:06 juju-e4d256-prod-github-runner-207 kernel: [13580.616422] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:10:06 juju-e4d256-prod-github-runner-207 kernel: [13580.617156] ? do_syscall_64+0x69/0xc0 Aug 22 09:10:06 juju-e4d256-prod-github-runner-207 kernel: [13580.617830] ? do_syscall_64+0x69/0xc0 Aug 22 09:10:06 juju-e4d256-prod-github-runner-207 kernel: [13580.618471] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 09:10:06 juju-e4d256-prod-github-runner-207 kernel: [13580.619212] RIP: 0033:0x7faa5d0edaff Aug 22 09:10:06 juju-e4d256-prod-github-runner-207 kernel: [13580.619852] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 09:10:06 juju-e4d256-prod-github-runner-207 kernel: [13580.621914] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 09:10:06 juju-e4d256-prod-github-runner-207 kernel: [13580.622842] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 09:10:06 juju-e4d256-prod-github-runner-207 kernel: [13580.623759] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 09:10:06 juju-e4d256-prod-github-runner-207 kernel: [13580.624668] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 09:10:06 juju-e4d256-prod-github-runner-207 kernel: [13580.625572] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 09:10:06 juju-e4d256-prod-github-runner-207 kernel: [13580.626493] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 09:10:06 juju-e4d256-prod-github-runner-207 kernel: [13580.627403] Aug 22 09:10:34 juju-e4d256-prod-github-runner-207 kernel: [13608.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 12565s! [qemu-system-x86:6715] Aug 22 09:10:34 juju-e4d256-prod-github-runner-207 kernel: [13608.543167] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 09:10:34 juju-e4d256-prod-github-runner-207 kernel: [13608.543374] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 09:10:34 juju-e4d256-prod-github-runner-207 kernel: [13608.555777] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 09:10:34 juju-e4d256-prod-github-runner-207 kernel: [13608.557051] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 09:10:34 juju-e4d256-prod-github-runner-207 kernel: [13608.558285] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:10:34 juju-e4d256-prod-github-runner-207 kernel: [13608.559357] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 09:10:34 juju-e4d256-prod-github-runner-207 kernel: [13608.561964] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 09:10:34 juju-e4d256-prod-github-runner-207 kernel: [13608.563010] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 09:10:34 juju-e4d256-prod-github-runner-207 kernel: [13608.564176] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 09:10:34 juju-e4d256-prod-github-runner-207 kernel: [13608.565339] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 09:10:34 juju-e4d256-prod-github-runner-207 kernel: [13608.566522] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 09:10:34 juju-e4d256-prod-github-runner-207 kernel: [13608.567717] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 09:10:34 juju-e4d256-prod-github-runner-207 kernel: [13608.568903] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 09:10:34 juju-e4d256-prod-github-runner-207 kernel: [13608.570159] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 09:10:34 juju-e4d256-prod-github-runner-207 kernel: [13608.571272] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 09:10:34 juju-e4d256-prod-github-runner-207 kernel: [13608.572491] Call Trace: Aug 22 09:10:34 juju-e4d256-prod-github-runner-207 kernel: [13608.573421] Aug 22 09:10:34 juju-e4d256-prod-github-runner-207 kernel: [13608.574329] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:10:34 juju-e4d256-prod-github-runner-207 kernel: [13608.575362] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:10:34 juju-e4d256-prod-github-runner-207 kernel: [13608.576386] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:10:34 juju-e4d256-prod-github-runner-207 kernel: [13608.577522] ? show_regs.part.0+0x23/0x29 Aug 22 09:10:34 juju-e4d256-prod-github-runner-207 kernel: [13608.578561] ? show_regs.cold+0x8/0xd Aug 22 09:10:34 juju-e4d256-prod-github-runner-207 kernel: [13608.579553] ? watchdog_timer_fn+0x1be/0x220 Aug 22 09:10:34 juju-e4d256-prod-github-runner-207 kernel: [13608.580567] ? lockup_detector_update_enable+0x60/0x60 Aug 22 09:10:34 juju-e4d256-prod-github-runner-207 kernel: [13608.581648] ? __hrtimer_run_queues+0x107/0x230 Aug 22 09:10:34 juju-e4d256-prod-github-runner-207 kernel: [13608.582807] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 09:10:34 juju-e4d256-prod-github-runner-207 kernel: [13608.583841] ? hrtimer_interrupt+0x101/0x220 Aug 22 09:10:34 juju-e4d256-prod-github-runner-207 kernel: [13608.584860] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 09:10:34 juju-e4d256-prod-github-runner-207 kernel: [13608.585959] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 09:10:34 juju-e4d256-prod-github-runner-207 kernel: [13608.587028] Aug 22 09:10:34 juju-e4d256-prod-github-runner-207 kernel: [13608.587886] Aug 22 09:10:34 juju-e4d256-prod-github-runner-207 kernel: [13608.588742] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 09:10:34 juju-e4d256-prod-github-runner-207 kernel: [13608.590068] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:10:34 juju-e4d256-prod-github-runner-207 kernel: [13608.591419] ? _raw_spin_lock+0x22/0x30 Aug 22 09:10:34 juju-e4d256-prod-github-runner-207 kernel: [13608.592528] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:10:34 juju-e4d256-prod-github-runner-207 kernel: [13608.593587] direct_page_fault+0x206/0x310 [kvm] Aug 22 09:10:34 juju-e4d256-prod-github-runner-207 kernel: [13608.594618] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 09:10:34 juju-e4d256-prod-github-runner-207 kernel: [13608.595753] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 09:10:34 juju-e4d256-prod-github-runner-207 kernel: [13608.596850] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 09:10:34 juju-e4d256-prod-github-runner-207 kernel: [13608.597975] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 09:10:34 juju-e4d256-prod-github-runner-207 kernel: [13608.599028] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 09:10:34 juju-e4d256-prod-github-runner-207 kernel: [13608.600127] handle_exit+0x98/0x230 [kvm_amd] Aug 22 09:10:34 juju-e4d256-prod-github-runner-207 kernel: [13608.601142] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 09:10:34 juju-e4d256-prod-github-runner-207 kernel: [13608.602167] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 09:10:34 juju-e4d256-prod-github-runner-207 kernel: [13608.603196] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 09:10:34 juju-e4d256-prod-github-runner-207 kernel: [13608.604210] vcpu_run+0x62/0x2c0 [kvm] Aug 22 09:10:34 juju-e4d256-prod-github-runner-207 kernel: [13608.605098] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 09:10:34 juju-e4d256-prod-github-runner-207 kernel: [13608.606016] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 09:10:34 juju-e4d256-prod-github-runner-207 kernel: [13608.606973] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 09:10:34 juju-e4d256-prod-github-runner-207 kernel: [13608.607867] ? __seccomp_filter+0x4a/0x4a0 Aug 22 09:10:34 juju-e4d256-prod-github-runner-207 kernel: [13608.608698] ? __fget_files+0x86/0xc0 Aug 22 09:10:34 juju-e4d256-prod-github-runner-207 kernel: [13608.609499] __x64_sys_ioctl+0x95/0xd0 Aug 22 09:10:34 juju-e4d256-prod-github-runner-207 kernel: [13608.610270] do_syscall_64+0x5c/0xc0 Aug 22 09:10:34 juju-e4d256-prod-github-runner-207 kernel: [13608.611007] ? do_futex+0x162/0x1f0 Aug 22 09:10:34 juju-e4d256-prod-github-runner-207 kernel: [13608.611731] ? __x64_sys_futex+0x78/0x1e0 Aug 22 09:10:34 juju-e4d256-prod-github-runner-207 kernel: [13608.612487] ? __secure_computing+0xa9/0x120 Aug 22 09:10:34 juju-e4d256-prod-github-runner-207 kernel: [13608.613276] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 09:10:34 juju-e4d256-prod-github-runner-207 kernel: [13608.614166] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:10:34 juju-e4d256-prod-github-runner-207 kernel: [13608.614990] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:10:34 juju-e4d256-prod-github-runner-207 kernel: [13608.615805] ? do_syscall_64+0x69/0xc0 Aug 22 09:10:34 juju-e4d256-prod-github-runner-207 kernel: [13608.616534] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:10:34 juju-e4d256-prod-github-runner-207 kernel: [13608.617330] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:10:34 juju-e4d256-prod-github-runner-207 kernel: [13608.618127] ? do_syscall_64+0x69/0xc0 Aug 22 09:10:34 juju-e4d256-prod-github-runner-207 kernel: [13608.618838] ? do_syscall_64+0x69/0xc0 Aug 22 09:10:34 juju-e4d256-prod-github-runner-207 kernel: [13608.619539] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 09:10:34 juju-e4d256-prod-github-runner-207 kernel: [13608.620254] RIP: 0033:0x7faa5d0edaff Aug 22 09:10:34 juju-e4d256-prod-github-runner-207 kernel: [13608.620900] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 09:10:34 juju-e4d256-prod-github-runner-207 kernel: [13608.622906] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 09:10:34 juju-e4d256-prod-github-runner-207 kernel: [13608.623818] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 09:10:34 juju-e4d256-prod-github-runner-207 kernel: [13608.624715] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 09:10:34 juju-e4d256-prod-github-runner-207 kernel: [13608.625624] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 09:10:34 juju-e4d256-prod-github-runner-207 kernel: [13608.626539] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 09:10:34 juju-e4d256-prod-github-runner-207 kernel: [13608.627436] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 09:10:34 juju-e4d256-prod-github-runner-207 kernel: [13608.628329] Aug 22 09:11:02 juju-e4d256-prod-github-runner-207 kernel: [13636.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 12592s! [qemu-system-x86:6715] Aug 22 09:11:02 juju-e4d256-prod-github-runner-207 kernel: [13636.543842] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 09:11:02 juju-e4d256-prod-github-runner-207 kernel: [13636.544056] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 09:11:02 juju-e4d256-prod-github-runner-207 kernel: [13636.556187] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 09:11:02 juju-e4d256-prod-github-runner-207 kernel: [13636.557461] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 09:11:02 juju-e4d256-prod-github-runner-207 kernel: [13636.558681] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:11:02 juju-e4d256-prod-github-runner-207 kernel: [13636.559766] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 09:11:02 juju-e4d256-prod-github-runner-207 kernel: [13636.562308] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 09:11:02 juju-e4d256-prod-github-runner-207 kernel: [13636.563351] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 09:11:02 juju-e4d256-prod-github-runner-207 kernel: [13636.564513] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 09:11:02 juju-e4d256-prod-github-runner-207 kernel: [13636.565689] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 09:11:02 juju-e4d256-prod-github-runner-207 kernel: [13636.566852] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 09:11:02 juju-e4d256-prod-github-runner-207 kernel: [13636.568011] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 09:11:02 juju-e4d256-prod-github-runner-207 kernel: [13636.569205] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 09:11:02 juju-e4d256-prod-github-runner-207 kernel: [13636.570445] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 09:11:02 juju-e4d256-prod-github-runner-207 kernel: [13636.571540] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 09:11:02 juju-e4d256-prod-github-runner-207 kernel: [13636.572737] Call Trace: Aug 22 09:11:02 juju-e4d256-prod-github-runner-207 kernel: [13636.573664] Aug 22 09:11:02 juju-e4d256-prod-github-runner-207 kernel: [13636.574577] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:11:02 juju-e4d256-prod-github-runner-207 kernel: [13636.575610] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:11:02 juju-e4d256-prod-github-runner-207 kernel: [13636.576632] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:11:02 juju-e4d256-prod-github-runner-207 kernel: [13636.577726] ? show_regs.part.0+0x23/0x29 Aug 22 09:11:02 juju-e4d256-prod-github-runner-207 kernel: [13636.578727] ? show_regs.cold+0x8/0xd Aug 22 09:11:02 juju-e4d256-prod-github-runner-207 kernel: [13636.579696] ? watchdog_timer_fn+0x1be/0x220 Aug 22 09:11:02 juju-e4d256-prod-github-runner-207 kernel: [13636.580709] ? lockup_detector_update_enable+0x60/0x60 Aug 22 09:11:02 juju-e4d256-prod-github-runner-207 kernel: [13636.581794] ? __hrtimer_run_queues+0x107/0x230 Aug 22 09:11:02 juju-e4d256-prod-github-runner-207 kernel: [13636.582826] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 09:11:02 juju-e4d256-prod-github-runner-207 kernel: [13636.583854] ? hrtimer_interrupt+0x101/0x220 Aug 22 09:11:02 juju-e4d256-prod-github-runner-207 kernel: [13636.584867] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 09:11:02 juju-e4d256-prod-github-runner-207 kernel: [13636.585954] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 09:11:02 juju-e4d256-prod-github-runner-207 kernel: [13636.587002] Aug 22 09:11:02 juju-e4d256-prod-github-runner-207 kernel: [13636.587866] Aug 22 09:11:02 juju-e4d256-prod-github-runner-207 kernel: [13636.588703] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 09:11:02 juju-e4d256-prod-github-runner-207 kernel: [13636.589772] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:11:02 juju-e4d256-prod-github-runner-207 kernel: [13636.590819] ? _raw_spin_lock+0x22/0x30 Aug 22 09:11:02 juju-e4d256-prod-github-runner-207 kernel: [13636.591769] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:11:02 juju-e4d256-prod-github-runner-207 kernel: [13636.592787] direct_page_fault+0x206/0x310 [kvm] Aug 22 09:11:02 juju-e4d256-prod-github-runner-207 kernel: [13636.593819] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 09:11:02 juju-e4d256-prod-github-runner-207 kernel: [13636.594831] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 09:11:02 juju-e4d256-prod-github-runner-207 kernel: [13636.595836] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 09:11:02 juju-e4d256-prod-github-runner-207 kernel: [13636.596824] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 09:11:02 juju-e4d256-prod-github-runner-207 kernel: [13636.597821] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 09:11:02 juju-e4d256-prod-github-runner-207 kernel: [13636.598834] handle_exit+0x98/0x230 [kvm_amd] Aug 22 09:11:02 juju-e4d256-prod-github-runner-207 kernel: [13636.599737] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 09:11:02 juju-e4d256-prod-github-runner-207 kernel: [13636.600665] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 09:11:02 juju-e4d256-prod-github-runner-207 kernel: [13636.601617] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 09:11:02 juju-e4d256-prod-github-runner-207 kernel: [13636.602535] vcpu_run+0x62/0x2c0 [kvm] Aug 22 09:11:02 juju-e4d256-prod-github-runner-207 kernel: [13636.603372] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 09:11:02 juju-e4d256-prod-github-runner-207 kernel: [13636.604185] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 09:11:02 juju-e4d256-prod-github-runner-207 kernel: [13636.605044] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 09:11:02 juju-e4d256-prod-github-runner-207 kernel: [13636.605857] ? __seccomp_filter+0x4a/0x4a0 Aug 22 09:11:02 juju-e4d256-prod-github-runner-207 kernel: [13636.606600] ? __fget_files+0x86/0xc0 Aug 22 09:11:02 juju-e4d256-prod-github-runner-207 kernel: [13636.607310] __x64_sys_ioctl+0x95/0xd0 Aug 22 09:11:02 juju-e4d256-prod-github-runner-207 kernel: [13636.608016] do_syscall_64+0x5c/0xc0 Aug 22 09:11:02 juju-e4d256-prod-github-runner-207 kernel: [13636.608688] ? do_futex+0x162/0x1f0 Aug 22 09:11:02 juju-e4d256-prod-github-runner-207 kernel: [13636.609355] ? __x64_sys_futex+0x78/0x1e0 Aug 22 09:11:02 juju-e4d256-prod-github-runner-207 kernel: [13636.610030] ? __secure_computing+0xa9/0x120 Aug 22 09:11:02 juju-e4d256-prod-github-runner-207 kernel: [13636.610728] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 09:11:02 juju-e4d256-prod-github-runner-207 kernel: [13636.611488] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:11:02 juju-e4d256-prod-github-runner-207 kernel: [13636.612210] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:11:02 juju-e4d256-prod-github-runner-207 kernel: [13636.612941] ? do_syscall_64+0x69/0xc0 Aug 22 09:11:02 juju-e4d256-prod-github-runner-207 kernel: [13636.613597] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:11:02 juju-e4d256-prod-github-runner-207 kernel: [13636.614300] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:11:02 juju-e4d256-prod-github-runner-207 kernel: [13636.614998] ? do_syscall_64+0x69/0xc0 Aug 22 09:11:02 juju-e4d256-prod-github-runner-207 kernel: [13636.615622] ? do_syscall_64+0x69/0xc0 Aug 22 09:11:02 juju-e4d256-prod-github-runner-207 kernel: [13636.616243] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 09:11:02 juju-e4d256-prod-github-runner-207 kernel: [13636.616950] RIP: 0033:0x7faa5d0edaff Aug 22 09:11:02 juju-e4d256-prod-github-runner-207 kernel: [13636.617613] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 09:11:02 juju-e4d256-prod-github-runner-207 kernel: [13636.619622] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 09:11:02 juju-e4d256-prod-github-runner-207 kernel: [13636.620540] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 09:11:02 juju-e4d256-prod-github-runner-207 kernel: [13636.621447] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 09:11:02 juju-e4d256-prod-github-runner-207 kernel: [13636.622333] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 09:11:02 juju-e4d256-prod-github-runner-207 kernel: [13636.623240] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 09:11:02 juju-e4d256-prod-github-runner-207 kernel: [13636.624150] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 09:11:02 juju-e4d256-prod-github-runner-207 kernel: [13636.625042] Aug 22 09:11:30 juju-e4d256-prod-github-runner-207 kernel: [13664.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 12618s! [qemu-system-x86:6715] Aug 22 09:11:30 juju-e4d256-prod-github-runner-207 kernel: [13664.543114] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 09:11:30 juju-e4d256-prod-github-runner-207 kernel: [13664.543188] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 09:11:30 juju-e4d256-prod-github-runner-207 kernel: [13664.555298] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 09:11:30 juju-e4d256-prod-github-runner-207 kernel: [13664.556558] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 09:11:30 juju-e4d256-prod-github-runner-207 kernel: [13664.557792] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:11:30 juju-e4d256-prod-github-runner-207 kernel: [13664.558850] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 09:11:30 juju-e4d256-prod-github-runner-207 kernel: [13664.561404] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 09:11:30 juju-e4d256-prod-github-runner-207 kernel: [13664.562450] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 09:11:30 juju-e4d256-prod-github-runner-207 kernel: [13664.563611] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 09:11:30 juju-e4d256-prod-github-runner-207 kernel: [13664.564771] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 09:11:30 juju-e4d256-prod-github-runner-207 kernel: [13664.565940] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 09:11:30 juju-e4d256-prod-github-runner-207 kernel: [13664.567114] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 09:11:30 juju-e4d256-prod-github-runner-207 kernel: [13664.568332] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 09:11:30 juju-e4d256-prod-github-runner-207 kernel: [13664.569696] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 09:11:30 juju-e4d256-prod-github-runner-207 kernel: [13664.570832] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 09:11:30 juju-e4d256-prod-github-runner-207 kernel: [13664.572059] Call Trace: Aug 22 09:11:30 juju-e4d256-prod-github-runner-207 kernel: [13664.572995] Aug 22 09:11:30 juju-e4d256-prod-github-runner-207 kernel: [13664.573879] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:11:30 juju-e4d256-prod-github-runner-207 kernel: [13664.574905] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:11:30 juju-e4d256-prod-github-runner-207 kernel: [13664.575927] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:11:30 juju-e4d256-prod-github-runner-207 kernel: [13664.577013] ? show_regs.part.0+0x23/0x29 Aug 22 09:11:30 juju-e4d256-prod-github-runner-207 kernel: [13664.578007] ? show_regs.cold+0x8/0xd Aug 22 09:11:30 juju-e4d256-prod-github-runner-207 kernel: [13664.578976] ? watchdog_timer_fn+0x1be/0x220 Aug 22 09:11:30 juju-e4d256-prod-github-runner-207 kernel: [13664.580040] ? lockup_detector_update_enable+0x60/0x60 Aug 22 09:11:30 juju-e4d256-prod-github-runner-207 kernel: [13664.581156] ? __hrtimer_run_queues+0x107/0x230 Aug 22 09:11:30 juju-e4d256-prod-github-runner-207 kernel: [13664.582188] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 09:11:30 juju-e4d256-prod-github-runner-207 kernel: [13664.583211] ? hrtimer_interrupt+0x101/0x220 Aug 22 09:11:30 juju-e4d256-prod-github-runner-207 kernel: [13664.584233] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 09:11:30 juju-e4d256-prod-github-runner-207 kernel: [13664.585325] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 09:11:30 juju-e4d256-prod-github-runner-207 kernel: [13664.586372] Aug 22 09:11:30 juju-e4d256-prod-github-runner-207 kernel: [13664.587230] Aug 22 09:11:30 juju-e4d256-prod-github-runner-207 kernel: [13664.588065] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 09:11:30 juju-e4d256-prod-github-runner-207 kernel: [13664.589121] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:11:30 juju-e4d256-prod-github-runner-207 kernel: [13664.590210] ? _raw_spin_lock+0x22/0x30 Aug 22 09:11:30 juju-e4d256-prod-github-runner-207 kernel: [13664.591188] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:11:30 juju-e4d256-prod-github-runner-207 kernel: [13664.592217] direct_page_fault+0x206/0x310 [kvm] Aug 22 09:11:30 juju-e4d256-prod-github-runner-207 kernel: [13664.593267] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 09:11:30 juju-e4d256-prod-github-runner-207 kernel: [13664.594292] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 09:11:30 juju-e4d256-prod-github-runner-207 kernel: [13664.595298] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 09:11:30 juju-e4d256-prod-github-runner-207 kernel: [13664.596273] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 09:11:30 juju-e4d256-prod-github-runner-207 kernel: [13664.597238] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 09:11:30 juju-e4d256-prod-github-runner-207 kernel: [13664.598224] handle_exit+0x98/0x230 [kvm_amd] Aug 22 09:11:30 juju-e4d256-prod-github-runner-207 kernel: [13664.599122] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 09:11:30 juju-e4d256-prod-github-runner-207 kernel: [13664.600044] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 09:11:30 juju-e4d256-prod-github-runner-207 kernel: [13664.600985] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 09:11:30 juju-e4d256-prod-github-runner-207 kernel: [13664.601938] vcpu_run+0x62/0x2c0 [kvm] Aug 22 09:11:30 juju-e4d256-prod-github-runner-207 kernel: [13664.602773] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 09:11:30 juju-e4d256-prod-github-runner-207 kernel: [13664.603716] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 09:11:30 juju-e4d256-prod-github-runner-207 kernel: [13664.604619] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 09:11:30 juju-e4d256-prod-github-runner-207 kernel: [13664.605457] ? __seccomp_filter+0x4a/0x4a0 Aug 22 09:11:30 juju-e4d256-prod-github-runner-207 kernel: [13664.606206] ? __fget_files+0x86/0xc0 Aug 22 09:11:30 juju-e4d256-prod-github-runner-207 kernel: [13664.606915] __x64_sys_ioctl+0x95/0xd0 Aug 22 09:11:30 juju-e4d256-prod-github-runner-207 kernel: [13664.607614] do_syscall_64+0x5c/0xc0 Aug 22 09:11:30 juju-e4d256-prod-github-runner-207 kernel: [13664.608280] ? do_futex+0x162/0x1f0 Aug 22 09:11:30 juju-e4d256-prod-github-runner-207 kernel: [13664.608952] ? __x64_sys_futex+0x78/0x1e0 Aug 22 09:11:30 juju-e4d256-prod-github-runner-207 kernel: [13664.609628] ? __secure_computing+0xa9/0x120 Aug 22 09:11:30 juju-e4d256-prod-github-runner-207 kernel: [13664.610327] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 09:11:30 juju-e4d256-prod-github-runner-207 kernel: [13664.611091] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:11:30 juju-e4d256-prod-github-runner-207 kernel: [13664.611978] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:11:30 juju-e4d256-prod-github-runner-207 kernel: [13664.612697] ? do_syscall_64+0x69/0xc0 Aug 22 09:11:30 juju-e4d256-prod-github-runner-207 kernel: [13664.613359] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:11:30 juju-e4d256-prod-github-runner-207 kernel: [13664.614069] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:11:30 juju-e4d256-prod-github-runner-207 kernel: [13664.614769] ? do_syscall_64+0x69/0xc0 Aug 22 09:11:30 juju-e4d256-prod-github-runner-207 kernel: [13664.615406] ? do_syscall_64+0x69/0xc0 Aug 22 09:11:30 juju-e4d256-prod-github-runner-207 kernel: [13664.616033] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 09:11:30 juju-e4d256-prod-github-runner-207 kernel: [13664.616749] RIP: 0033:0x7faa5d0edaff Aug 22 09:11:30 juju-e4d256-prod-github-runner-207 kernel: [13664.617399] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 09:11:30 juju-e4d256-prod-github-runner-207 kernel: [13664.619377] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 09:11:30 juju-e4d256-prod-github-runner-207 kernel: [13664.620299] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 09:11:30 juju-e4d256-prod-github-runner-207 kernel: [13664.621212] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 09:11:30 juju-e4d256-prod-github-runner-207 kernel: [13664.622108] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 09:11:30 juju-e4d256-prod-github-runner-207 kernel: [13664.622997] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 09:11:30 juju-e4d256-prod-github-runner-207 kernel: [13664.623889] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 09:11:30 juju-e4d256-prod-github-runner-207 kernel: [13664.624811] Aug 22 09:11:44 juju-e4d256-prod-github-runner-207 kernel: [13678.100707] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 09:11:44 juju-e4d256-prod-github-runner-207 kernel: [13678.101857] rcu: 1-....: (3379609 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=1632690 Aug 22 09:11:44 juju-e4d256-prod-github-runner-207 kernel: [13678.103008] (t=3390225 jiffies g=23269 q=21324) Aug 22 09:11:44 juju-e4d256-prod-github-runner-207 kernel: [13678.103802] NMI backtrace for cpu 1 Aug 22 09:11:44 juju-e4d256-prod-github-runner-207 kernel: [13678.104528] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 09:11:44 juju-e4d256-prod-github-runner-207 kernel: [13678.105723] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 09:11:44 juju-e4d256-prod-github-runner-207 kernel: [13678.106793] Call Trace: Aug 22 09:11:44 juju-e4d256-prod-github-runner-207 kernel: [13678.107469] Aug 22 09:11:44 juju-e4d256-prod-github-runner-207 kernel: [13678.108117] show_stack+0x52/0x5c Aug 22 09:11:44 juju-e4d256-prod-github-runner-207 kernel: [13678.108940] dump_stack_lvl+0x4a/0x63 Aug 22 09:11:44 juju-e4d256-prod-github-runner-207 kernel: [13678.109706] dump_stack+0x10/0x16 Aug 22 09:11:44 juju-e4d256-prod-github-runner-207 kernel: [13678.110433] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 09:11:44 juju-e4d256-prod-github-runner-207 kernel: [13678.111225] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 09:11:44 juju-e4d256-prod-github-runner-207 kernel: [13678.112004] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 09:11:44 juju-e4d256-prod-github-runner-207 kernel: [13678.112839] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 09:11:44 juju-e4d256-prod-github-runner-207 kernel: [13678.113672] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 09:11:44 juju-e4d256-prod-github-runner-207 kernel: [13678.114486] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 09:11:44 juju-e4d256-prod-github-runner-207 kernel: [13678.115294] print_cpu_stall.cold+0x2f/0xe2 Aug 22 09:11:44 juju-e4d256-prod-github-runner-207 kernel: [13678.116205] ? timekeeping_update+0xf7/0x150 Aug 22 09:11:44 juju-e4d256-prod-github-runner-207 kernel: [13678.116992] check_cpu_stall+0x109/0x270 Aug 22 09:11:44 juju-e4d256-prod-github-runner-207 kernel: [13678.117744] rcu_sched_clock_irq+0x9a/0x250 Aug 22 09:11:44 juju-e4d256-prod-github-runner-207 kernel: [13678.118504] update_process_times+0x94/0xd0 Aug 22 09:11:44 juju-e4d256-prod-github-runner-207 kernel: [13678.119298] tick_sched_handle+0x29/0x70 Aug 22 09:11:44 juju-e4d256-prod-github-runner-207 kernel: [13678.120049] tick_sched_timer+0x8c/0xc0 Aug 22 09:11:44 juju-e4d256-prod-github-runner-207 kernel: [13678.120874] ? tick_nohz_handler+0xb0/0xb0 Aug 22 09:11:44 juju-e4d256-prod-github-runner-207 kernel: [13678.121644] __hrtimer_run_queues+0x107/0x230 Aug 22 09:11:44 juju-e4d256-prod-github-runner-207 kernel: [13678.122421] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 09:11:44 juju-e4d256-prod-github-runner-207 kernel: [13678.123193] hrtimer_interrupt+0x101/0x220 Aug 22 09:11:44 juju-e4d256-prod-github-runner-207 kernel: [13678.123948] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 09:11:44 juju-e4d256-prod-github-runner-207 kernel: [13678.124784] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 09:11:44 juju-e4d256-prod-github-runner-207 kernel: [13678.125602] Aug 22 09:11:44 juju-e4d256-prod-github-runner-207 kernel: [13678.126264] Aug 22 09:11:44 juju-e4d256-prod-github-runner-207 kernel: [13678.126894] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 09:11:44 juju-e4d256-prod-github-runner-207 kernel: [13678.127710] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:11:44 juju-e4d256-prod-github-runner-207 kernel: [13678.128622] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 09:11:44 juju-e4d256-prod-github-runner-207 kernel: [13678.130846] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 09:11:44 juju-e4d256-prod-github-runner-207 kernel: [13678.131738] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 09:11:44 juju-e4d256-prod-github-runner-207 kernel: [13678.132757] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 09:11:44 juju-e4d256-prod-github-runner-207 kernel: [13678.133737] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 09:11:44 juju-e4d256-prod-github-runner-207 kernel: [13678.134702] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 09:11:44 juju-e4d256-prod-github-runner-207 kernel: [13678.135670] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 09:11:44 juju-e4d256-prod-github-runner-207 kernel: [13678.136666] ? _raw_spin_lock+0x22/0x30 Aug 22 09:11:44 juju-e4d256-prod-github-runner-207 kernel: [13678.137437] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:11:44 juju-e4d256-prod-github-runner-207 kernel: [13678.138277] direct_page_fault+0x206/0x310 [kvm] Aug 22 09:11:44 juju-e4d256-prod-github-runner-207 kernel: [13678.139122] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 09:11:44 juju-e4d256-prod-github-runner-207 kernel: [13678.139952] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 09:11:44 juju-e4d256-prod-github-runner-207 kernel: [13678.140820] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 09:11:44 juju-e4d256-prod-github-runner-207 kernel: [13678.141639] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 09:11:44 juju-e4d256-prod-github-runner-207 kernel: [13678.142435] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 09:11:44 juju-e4d256-prod-github-runner-207 kernel: [13678.143271] handle_exit+0x98/0x230 [kvm_amd] Aug 22 09:11:44 juju-e4d256-prod-github-runner-207 kernel: [13678.144037] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 09:11:44 juju-e4d256-prod-github-runner-207 kernel: [13678.144848] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 09:11:44 juju-e4d256-prod-github-runner-207 kernel: [13678.145678] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 09:11:44 juju-e4d256-prod-github-runner-207 kernel: [13678.146497] vcpu_run+0x62/0x2c0 [kvm] Aug 22 09:11:44 juju-e4d256-prod-github-runner-207 kernel: [13678.147219] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 09:11:44 juju-e4d256-prod-github-runner-207 kernel: [13678.147955] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 09:11:44 juju-e4d256-prod-github-runner-207 kernel: [13678.148788] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 09:11:44 juju-e4d256-prod-github-runner-207 kernel: [13678.149560] ? __seccomp_filter+0x4a/0x4a0 Aug 22 09:11:44 juju-e4d256-prod-github-runner-207 kernel: [13678.150281] ? __fget_files+0x86/0xc0 Aug 22 09:11:44 juju-e4d256-prod-github-runner-207 kernel: [13678.150983] __x64_sys_ioctl+0x95/0xd0 Aug 22 09:11:44 juju-e4d256-prod-github-runner-207 kernel: [13678.151690] do_syscall_64+0x5c/0xc0 Aug 22 09:11:44 juju-e4d256-prod-github-runner-207 kernel: [13678.152375] ? do_futex+0x162/0x1f0 Aug 22 09:11:44 juju-e4d256-prod-github-runner-207 kernel: [13678.153064] ? __x64_sys_futex+0x78/0x1e0 Aug 22 09:11:44 juju-e4d256-prod-github-runner-207 kernel: [13678.153769] ? __secure_computing+0xa9/0x120 Aug 22 09:11:44 juju-e4d256-prod-github-runner-207 kernel: [13678.154487] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 09:11:44 juju-e4d256-prod-github-runner-207 kernel: [13678.155280] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:11:44 juju-e4d256-prod-github-runner-207 kernel: [13678.156043] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:11:44 juju-e4d256-prod-github-runner-207 kernel: [13678.156843] ? do_syscall_64+0x69/0xc0 Aug 22 09:11:44 juju-e4d256-prod-github-runner-207 kernel: [13678.157545] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:11:44 juju-e4d256-prod-github-runner-207 kernel: [13678.158301] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:11:44 juju-e4d256-prod-github-runner-207 kernel: [13678.159059] ? do_syscall_64+0x69/0xc0 Aug 22 09:11:44 juju-e4d256-prod-github-runner-207 kernel: [13678.159754] ? do_syscall_64+0x69/0xc0 Aug 22 09:11:44 juju-e4d256-prod-github-runner-207 kernel: [13678.160447] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 09:11:44 juju-e4d256-prod-github-runner-207 kernel: [13678.161243] RIP: 0033:0x7faa5d0edaff Aug 22 09:11:44 juju-e4d256-prod-github-runner-207 kernel: [13678.161939] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 09:11:44 juju-e4d256-prod-github-runner-207 kernel: [13678.164043] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 09:11:44 juju-e4d256-prod-github-runner-207 kernel: [13678.165029] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 09:11:44 juju-e4d256-prod-github-runner-207 kernel: [13678.165986] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 09:11:44 juju-e4d256-prod-github-runner-207 kernel: [13678.166954] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 09:11:44 juju-e4d256-prod-github-runner-207 kernel: [13678.167912] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 09:11:44 juju-e4d256-prod-github-runner-207 kernel: [13678.168860] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 09:11:44 juju-e4d256-prod-github-runner-207 kernel: [13678.169778] Aug 22 09:12:10 juju-e4d256-prod-github-runner-207 kernel: [13704.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 12655s! [qemu-system-x86:6715] Aug 22 09:12:10 juju-e4d256-prod-github-runner-207 kernel: [13704.543917] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 09:12:10 juju-e4d256-prod-github-runner-207 kernel: [13704.544252] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 09:12:10 juju-e4d256-prod-github-runner-207 kernel: [13704.556383] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 09:12:10 juju-e4d256-prod-github-runner-207 kernel: [13704.557643] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 09:12:10 juju-e4d256-prod-github-runner-207 kernel: [13704.558858] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:12:10 juju-e4d256-prod-github-runner-207 kernel: [13704.559919] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 09:12:10 juju-e4d256-prod-github-runner-207 kernel: [13704.562492] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 09:12:10 juju-e4d256-prod-github-runner-207 kernel: [13704.563535] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 09:12:10 juju-e4d256-prod-github-runner-207 kernel: [13704.564764] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 09:12:10 juju-e4d256-prod-github-runner-207 kernel: [13704.565926] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 09:12:10 juju-e4d256-prod-github-runner-207 kernel: [13704.567092] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 09:12:10 juju-e4d256-prod-github-runner-207 kernel: [13704.568255] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 09:12:10 juju-e4d256-prod-github-runner-207 kernel: [13704.569428] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 09:12:10 juju-e4d256-prod-github-runner-207 kernel: [13704.570657] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 09:12:10 juju-e4d256-prod-github-runner-207 kernel: [13704.571750] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 09:12:10 juju-e4d256-prod-github-runner-207 kernel: [13704.572979] Call Trace: Aug 22 09:12:10 juju-e4d256-prod-github-runner-207 kernel: [13704.573891] Aug 22 09:12:10 juju-e4d256-prod-github-runner-207 kernel: [13704.574790] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:12:10 juju-e4d256-prod-github-runner-207 kernel: [13704.575819] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:12:10 juju-e4d256-prod-github-runner-207 kernel: [13704.576863] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:12:10 juju-e4d256-prod-github-runner-207 kernel: [13704.577961] ? show_regs.part.0+0x23/0x29 Aug 22 09:12:10 juju-e4d256-prod-github-runner-207 kernel: [13704.578955] ? show_regs.cold+0x8/0xd Aug 22 09:12:10 juju-e4d256-prod-github-runner-207 kernel: [13704.579924] ? watchdog_timer_fn+0x1be/0x220 Aug 22 09:12:10 juju-e4d256-prod-github-runner-207 kernel: [13704.580945] ? lockup_detector_update_enable+0x60/0x60 Aug 22 09:12:10 juju-e4d256-prod-github-runner-207 kernel: [13704.582006] ? __hrtimer_run_queues+0x107/0x230 Aug 22 09:12:10 juju-e4d256-prod-github-runner-207 kernel: [13704.583031] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 09:12:10 juju-e4d256-prod-github-runner-207 kernel: [13704.584053] ? hrtimer_interrupt+0x101/0x220 Aug 22 09:12:10 juju-e4d256-prod-github-runner-207 kernel: [13704.585077] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 09:12:10 juju-e4d256-prod-github-runner-207 kernel: [13704.586144] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 09:12:10 juju-e4d256-prod-github-runner-207 kernel: [13704.587186] Aug 22 09:12:10 juju-e4d256-prod-github-runner-207 kernel: [13704.588037] Aug 22 09:12:10 juju-e4d256-prod-github-runner-207 kernel: [13704.588897] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 09:12:10 juju-e4d256-prod-github-runner-207 kernel: [13704.589927] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:12:10 juju-e4d256-prod-github-runner-207 kernel: [13704.590967] ? _raw_spin_lock+0x22/0x30 Aug 22 09:12:10 juju-e4d256-prod-github-runner-207 kernel: [13704.591909] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:12:10 juju-e4d256-prod-github-runner-207 kernel: [13704.592936] direct_page_fault+0x206/0x310 [kvm] Aug 22 09:12:10 juju-e4d256-prod-github-runner-207 kernel: [13704.593958] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 09:12:10 juju-e4d256-prod-github-runner-207 kernel: [13704.594990] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 09:12:10 juju-e4d256-prod-github-runner-207 kernel: [13704.596004] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 09:12:10 juju-e4d256-prod-github-runner-207 kernel: [13704.597056] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 09:12:10 juju-e4d256-prod-github-runner-207 kernel: [13704.598004] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 09:12:10 juju-e4d256-prod-github-runner-207 kernel: [13704.598987] handle_exit+0x98/0x230 [kvm_amd] Aug 22 09:12:10 juju-e4d256-prod-github-runner-207 kernel: [13704.599886] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 09:12:10 juju-e4d256-prod-github-runner-207 kernel: [13704.600813] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 09:12:10 juju-e4d256-prod-github-runner-207 kernel: [13704.601767] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 09:12:10 juju-e4d256-prod-github-runner-207 kernel: [13704.602669] vcpu_run+0x62/0x2c0 [kvm] Aug 22 09:12:10 juju-e4d256-prod-github-runner-207 kernel: [13704.603478] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 09:12:10 juju-e4d256-prod-github-runner-207 kernel: [13704.604285] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 09:12:10 juju-e4d256-prod-github-runner-207 kernel: [13704.605161] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 09:12:10 juju-e4d256-prod-github-runner-207 kernel: [13704.605960] ? __seccomp_filter+0x4a/0x4a0 Aug 22 09:12:10 juju-e4d256-prod-github-runner-207 kernel: [13704.606700] ? __fget_files+0x86/0xc0 Aug 22 09:12:10 juju-e4d256-prod-github-runner-207 kernel: [13704.607403] __x64_sys_ioctl+0x95/0xd0 Aug 22 09:12:10 juju-e4d256-prod-github-runner-207 kernel: [13704.608099] do_syscall_64+0x5c/0xc0 Aug 22 09:12:10 juju-e4d256-prod-github-runner-207 kernel: [13704.608793] ? do_futex+0x162/0x1f0 Aug 22 09:12:10 juju-e4d256-prod-github-runner-207 kernel: [13704.609437] ? __x64_sys_futex+0x78/0x1e0 Aug 22 09:12:10 juju-e4d256-prod-github-runner-207 kernel: [13704.610106] ? __secure_computing+0xa9/0x120 Aug 22 09:12:10 juju-e4d256-prod-github-runner-207 kernel: [13704.610795] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 09:12:10 juju-e4d256-prod-github-runner-207 kernel: [13704.611555] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:12:10 juju-e4d256-prod-github-runner-207 kernel: [13704.612271] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:12:10 juju-e4d256-prod-github-runner-207 kernel: [13704.613023] ? do_syscall_64+0x69/0xc0 Aug 22 09:12:10 juju-e4d256-prod-github-runner-207 kernel: [13704.613671] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:12:10 juju-e4d256-prod-github-runner-207 kernel: [13704.614368] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:12:10 juju-e4d256-prod-github-runner-207 kernel: [13704.615059] ? do_syscall_64+0x69/0xc0 Aug 22 09:12:10 juju-e4d256-prod-github-runner-207 kernel: [13704.615678] ? do_syscall_64+0x69/0xc0 Aug 22 09:12:10 juju-e4d256-prod-github-runner-207 kernel: [13704.616295] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 09:12:10 juju-e4d256-prod-github-runner-207 kernel: [13704.617015] RIP: 0033:0x7faa5d0edaff Aug 22 09:12:10 juju-e4d256-prod-github-runner-207 kernel: [13704.617666] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 09:12:10 juju-e4d256-prod-github-runner-207 kernel: [13704.619647] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 09:12:10 juju-e4d256-prod-github-runner-207 kernel: [13704.620558] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 09:12:10 juju-e4d256-prod-github-runner-207 kernel: [13704.621447] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 09:12:10 juju-e4d256-prod-github-runner-207 kernel: [13704.622337] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 09:12:10 juju-e4d256-prod-github-runner-207 kernel: [13704.623219] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 09:12:10 juju-e4d256-prod-github-runner-207 kernel: [13704.624103] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 09:12:10 juju-e4d256-prod-github-runner-207 kernel: [13704.625010] Aug 22 09:12:38 juju-e4d256-prod-github-runner-207 kernel: [13732.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 12681s! [qemu-system-x86:6715] Aug 22 09:12:38 juju-e4d256-prod-github-runner-207 kernel: [13732.543101] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 09:12:38 juju-e4d256-prod-github-runner-207 kernel: [13732.543174] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 09:12:38 juju-e4d256-prod-github-runner-207 kernel: [13732.555480] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 09:12:38 juju-e4d256-prod-github-runner-207 kernel: [13732.556780] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 09:12:38 juju-e4d256-prod-github-runner-207 kernel: [13732.558149] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:12:38 juju-e4d256-prod-github-runner-207 kernel: [13732.559395] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 09:12:38 juju-e4d256-prod-github-runner-207 kernel: [13732.561951] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 09:12:38 juju-e4d256-prod-github-runner-207 kernel: [13732.563008] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 09:12:38 juju-e4d256-prod-github-runner-207 kernel: [13732.564219] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 09:12:38 juju-e4d256-prod-github-runner-207 kernel: [13732.565432] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 09:12:38 juju-e4d256-prod-github-runner-207 kernel: [13732.566587] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 09:12:38 juju-e4d256-prod-github-runner-207 kernel: [13732.567765] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 09:12:38 juju-e4d256-prod-github-runner-207 kernel: [13732.568990] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 09:12:38 juju-e4d256-prod-github-runner-207 kernel: [13732.570224] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 09:12:38 juju-e4d256-prod-github-runner-207 kernel: [13732.571321] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 09:12:38 juju-e4d256-prod-github-runner-207 kernel: [13732.572548] Call Trace: Aug 22 09:12:38 juju-e4d256-prod-github-runner-207 kernel: [13732.573489] Aug 22 09:12:38 juju-e4d256-prod-github-runner-207 kernel: [13732.574413] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:12:38 juju-e4d256-prod-github-runner-207 kernel: [13732.575442] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:12:38 juju-e4d256-prod-github-runner-207 kernel: [13732.576488] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:12:38 juju-e4d256-prod-github-runner-207 kernel: [13732.577580] ? show_regs.part.0+0x23/0x29 Aug 22 09:12:38 juju-e4d256-prod-github-runner-207 kernel: [13732.578603] ? show_regs.cold+0x8/0xd Aug 22 09:12:38 juju-e4d256-prod-github-runner-207 kernel: [13732.579609] ? watchdog_timer_fn+0x1be/0x220 Aug 22 09:12:38 juju-e4d256-prod-github-runner-207 kernel: [13732.580631] ? lockup_detector_update_enable+0x60/0x60 Aug 22 09:12:38 juju-e4d256-prod-github-runner-207 kernel: [13732.581694] ? __hrtimer_run_queues+0x107/0x230 Aug 22 09:12:38 juju-e4d256-prod-github-runner-207 kernel: [13732.582736] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 09:12:38 juju-e4d256-prod-github-runner-207 kernel: [13732.583776] ? hrtimer_interrupt+0x101/0x220 Aug 22 09:12:38 juju-e4d256-prod-github-runner-207 kernel: [13732.584809] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 09:12:38 juju-e4d256-prod-github-runner-207 kernel: [13732.585876] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 09:12:38 juju-e4d256-prod-github-runner-207 kernel: [13732.586920] Aug 22 09:12:38 juju-e4d256-prod-github-runner-207 kernel: [13732.587773] Aug 22 09:12:38 juju-e4d256-prod-github-runner-207 kernel: [13732.588658] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 09:12:38 juju-e4d256-prod-github-runner-207 kernel: [13732.589722] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:12:38 juju-e4d256-prod-github-runner-207 kernel: [13732.590782] ? _raw_spin_lock+0x22/0x30 Aug 22 09:12:38 juju-e4d256-prod-github-runner-207 kernel: [13732.591746] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:12:38 juju-e4d256-prod-github-runner-207 kernel: [13732.592806] direct_page_fault+0x206/0x310 [kvm] Aug 22 09:12:38 juju-e4d256-prod-github-runner-207 kernel: [13732.593842] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 09:12:38 juju-e4d256-prod-github-runner-207 kernel: [13732.594875] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 09:12:38 juju-e4d256-prod-github-runner-207 kernel: [13732.595874] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 09:12:38 juju-e4d256-prod-github-runner-207 kernel: [13732.596859] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 09:12:38 juju-e4d256-prod-github-runner-207 kernel: [13732.597804] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 09:12:38 juju-e4d256-prod-github-runner-207 kernel: [13732.598794] handle_exit+0x98/0x230 [kvm_amd] Aug 22 09:12:38 juju-e4d256-prod-github-runner-207 kernel: [13732.599709] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 09:12:38 juju-e4d256-prod-github-runner-207 kernel: [13732.600638] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 09:12:38 juju-e4d256-prod-github-runner-207 kernel: [13732.601573] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 09:12:38 juju-e4d256-prod-github-runner-207 kernel: [13732.602479] vcpu_run+0x62/0x2c0 [kvm] Aug 22 09:12:38 juju-e4d256-prod-github-runner-207 kernel: [13732.603308] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 09:12:38 juju-e4d256-prod-github-runner-207 kernel: [13732.604137] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 09:12:38 juju-e4d256-prod-github-runner-207 kernel: [13732.605009] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 09:12:38 juju-e4d256-prod-github-runner-207 kernel: [13732.605807] ? __seccomp_filter+0x4a/0x4a0 Aug 22 09:12:38 juju-e4d256-prod-github-runner-207 kernel: [13732.606548] ? __fget_files+0x86/0xc0 Aug 22 09:12:38 juju-e4d256-prod-github-runner-207 kernel: [13732.607255] __x64_sys_ioctl+0x95/0xd0 Aug 22 09:12:38 juju-e4d256-prod-github-runner-207 kernel: [13732.607948] do_syscall_64+0x5c/0xc0 Aug 22 09:12:38 juju-e4d256-prod-github-runner-207 kernel: [13732.608635] ? do_futex+0x162/0x1f0 Aug 22 09:12:38 juju-e4d256-prod-github-runner-207 kernel: [13732.609294] ? __x64_sys_futex+0x78/0x1e0 Aug 22 09:12:38 juju-e4d256-prod-github-runner-207 kernel: [13732.609984] ? __secure_computing+0xa9/0x120 Aug 22 09:12:38 juju-e4d256-prod-github-runner-207 kernel: [13732.610674] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 09:12:38 juju-e4d256-prod-github-runner-207 kernel: [13732.611431] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:12:38 juju-e4d256-prod-github-runner-207 kernel: [13732.612172] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:12:38 juju-e4d256-prod-github-runner-207 kernel: [13732.612896] ? do_syscall_64+0x69/0xc0 Aug 22 09:12:38 juju-e4d256-prod-github-runner-207 kernel: [13732.613540] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:12:38 juju-e4d256-prod-github-runner-207 kernel: [13732.614254] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:12:38 juju-e4d256-prod-github-runner-207 kernel: [13732.614966] ? do_syscall_64+0x69/0xc0 Aug 22 09:12:38 juju-e4d256-prod-github-runner-207 kernel: [13732.615596] ? do_syscall_64+0x69/0xc0 Aug 22 09:12:38 juju-e4d256-prod-github-runner-207 kernel: [13732.616233] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 09:12:38 juju-e4d256-prod-github-runner-207 kernel: [13732.617046] RIP: 0033:0x7faa5d0edaff Aug 22 09:12:38 juju-e4d256-prod-github-runner-207 kernel: [13732.617686] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 09:12:38 juju-e4d256-prod-github-runner-207 kernel: [13732.619709] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 09:12:38 juju-e4d256-prod-github-runner-207 kernel: [13732.620659] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 09:12:38 juju-e4d256-prod-github-runner-207 kernel: [13732.621550] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 09:12:38 juju-e4d256-prod-github-runner-207 kernel: [13732.622436] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 09:12:38 juju-e4d256-prod-github-runner-207 kernel: [13732.623345] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 09:12:38 juju-e4d256-prod-github-runner-207 kernel: [13732.624277] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 09:12:38 juju-e4d256-prod-github-runner-207 kernel: [13732.625188] Aug 22 09:13:06 juju-e4d256-prod-github-runner-207 kernel: [13760.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 12707s! [qemu-system-x86:6715] Aug 22 09:13:06 juju-e4d256-prod-github-runner-207 kernel: [13760.543118] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 09:13:06 juju-e4d256-prod-github-runner-207 kernel: [13760.543192] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 09:13:06 juju-e4d256-prod-github-runner-207 kernel: [13760.555322] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 09:13:06 juju-e4d256-prod-github-runner-207 kernel: [13760.556607] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 09:13:06 juju-e4d256-prod-github-runner-207 kernel: [13760.557832] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:13:06 juju-e4d256-prod-github-runner-207 kernel: [13760.558890] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 09:13:06 juju-e4d256-prod-github-runner-207 kernel: [13760.561486] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 09:13:06 juju-e4d256-prod-github-runner-207 kernel: [13760.562630] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 09:13:06 juju-e4d256-prod-github-runner-207 kernel: [13760.563815] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 09:13:06 juju-e4d256-prod-github-runner-207 kernel: [13760.565007] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 09:13:06 juju-e4d256-prod-github-runner-207 kernel: [13760.566166] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 09:13:06 juju-e4d256-prod-github-runner-207 kernel: [13760.567333] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 09:13:06 juju-e4d256-prod-github-runner-207 kernel: [13760.568519] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 09:13:06 juju-e4d256-prod-github-runner-207 kernel: [13760.569884] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 09:13:06 juju-e4d256-prod-github-runner-207 kernel: [13760.570982] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 09:13:06 juju-e4d256-prod-github-runner-207 kernel: [13760.572351] Call Trace: Aug 22 09:13:06 juju-e4d256-prod-github-runner-207 kernel: [13760.573270] Aug 22 09:13:06 juju-e4d256-prod-github-runner-207 kernel: [13760.574152] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:13:06 juju-e4d256-prod-github-runner-207 kernel: [13760.575182] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:13:06 juju-e4d256-prod-github-runner-207 kernel: [13760.576213] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:13:06 juju-e4d256-prod-github-runner-207 kernel: [13760.577288] ? show_regs.part.0+0x23/0x29 Aug 22 09:13:06 juju-e4d256-prod-github-runner-207 kernel: [13760.578284] ? show_regs.cold+0x8/0xd Aug 22 09:13:06 juju-e4d256-prod-github-runner-207 kernel: [13760.579254] ? watchdog_timer_fn+0x1be/0x220 Aug 22 09:13:06 juju-e4d256-prod-github-runner-207 kernel: [13760.580274] ? lockup_detector_update_enable+0x60/0x60 Aug 22 09:13:06 juju-e4d256-prod-github-runner-207 kernel: [13760.581335] ? __hrtimer_run_queues+0x107/0x230 Aug 22 09:13:06 juju-e4d256-prod-github-runner-207 kernel: [13760.582370] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 09:13:06 juju-e4d256-prod-github-runner-207 kernel: [13760.583407] ? hrtimer_interrupt+0x101/0x220 Aug 22 09:13:06 juju-e4d256-prod-github-runner-207 kernel: [13760.584441] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 09:13:06 juju-e4d256-prod-github-runner-207 kernel: [13760.585513] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 09:13:06 juju-e4d256-prod-github-runner-207 kernel: [13760.586580] Aug 22 09:13:06 juju-e4d256-prod-github-runner-207 kernel: [13760.587448] Aug 22 09:13:06 juju-e4d256-prod-github-runner-207 kernel: [13760.588335] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 09:13:06 juju-e4d256-prod-github-runner-207 kernel: [13760.589382] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:13:06 juju-e4d256-prod-github-runner-207 kernel: [13760.590425] ? _raw_spin_lock+0x22/0x30 Aug 22 09:13:06 juju-e4d256-prod-github-runner-207 kernel: [13760.591370] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:13:06 juju-e4d256-prod-github-runner-207 kernel: [13760.592408] direct_page_fault+0x206/0x310 [kvm] Aug 22 09:13:06 juju-e4d256-prod-github-runner-207 kernel: [13760.593473] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 09:13:06 juju-e4d256-prod-github-runner-207 kernel: [13760.594494] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 09:13:06 juju-e4d256-prod-github-runner-207 kernel: [13760.595503] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 09:13:06 juju-e4d256-prod-github-runner-207 kernel: [13760.596498] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 09:13:06 juju-e4d256-prod-github-runner-207 kernel: [13760.597535] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 09:13:06 juju-e4d256-prod-github-runner-207 kernel: [13760.598528] handle_exit+0x98/0x230 [kvm_amd] Aug 22 09:13:06 juju-e4d256-prod-github-runner-207 kernel: [13760.599444] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 09:13:06 juju-e4d256-prod-github-runner-207 kernel: [13760.600376] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 09:13:06 juju-e4d256-prod-github-runner-207 kernel: [13760.601304] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 09:13:06 juju-e4d256-prod-github-runner-207 kernel: [13760.602217] vcpu_run+0x62/0x2c0 [kvm] Aug 22 09:13:06 juju-e4d256-prod-github-runner-207 kernel: [13760.603032] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 09:13:06 juju-e4d256-prod-github-runner-207 kernel: [13760.603888] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 09:13:06 juju-e4d256-prod-github-runner-207 kernel: [13760.604760] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 09:13:06 juju-e4d256-prod-github-runner-207 kernel: [13760.605560] ? __seccomp_filter+0x4a/0x4a0 Aug 22 09:13:06 juju-e4d256-prod-github-runner-207 kernel: [13760.606308] ? __fget_files+0x86/0xc0 Aug 22 09:13:06 juju-e4d256-prod-github-runner-207 kernel: [13760.607019] __x64_sys_ioctl+0x95/0xd0 Aug 22 09:13:06 juju-e4d256-prod-github-runner-207 kernel: [13760.607726] do_syscall_64+0x5c/0xc0 Aug 22 09:13:06 juju-e4d256-prod-github-runner-207 kernel: [13760.608396] ? do_futex+0x162/0x1f0 Aug 22 09:13:06 juju-e4d256-prod-github-runner-207 kernel: [13760.609049] ? __x64_sys_futex+0x78/0x1e0 Aug 22 09:13:06 juju-e4d256-prod-github-runner-207 kernel: [13760.609733] ? __secure_computing+0xa9/0x120 Aug 22 09:13:06 juju-e4d256-prod-github-runner-207 kernel: [13760.610423] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 09:13:06 juju-e4d256-prod-github-runner-207 kernel: [13760.611186] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:13:06 juju-e4d256-prod-github-runner-207 kernel: [13760.611984] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:13:06 juju-e4d256-prod-github-runner-207 kernel: [13760.612709] ? do_syscall_64+0x69/0xc0 Aug 22 09:13:06 juju-e4d256-prod-github-runner-207 kernel: [13760.613357] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:13:06 juju-e4d256-prod-github-runner-207 kernel: [13760.614079] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:13:06 juju-e4d256-prod-github-runner-207 kernel: [13760.614787] ? do_syscall_64+0x69/0xc0 Aug 22 09:13:06 juju-e4d256-prod-github-runner-207 kernel: [13760.615415] ? do_syscall_64+0x69/0xc0 Aug 22 09:13:06 juju-e4d256-prod-github-runner-207 kernel: [13760.616060] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 09:13:06 juju-e4d256-prod-github-runner-207 kernel: [13760.616765] RIP: 0033:0x7faa5d0edaff Aug 22 09:13:06 juju-e4d256-prod-github-runner-207 kernel: [13760.617390] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 09:13:06 juju-e4d256-prod-github-runner-207 kernel: [13760.619399] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 09:13:06 juju-e4d256-prod-github-runner-207 kernel: [13760.620451] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 09:13:06 juju-e4d256-prod-github-runner-207 kernel: [13760.621383] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 09:13:06 juju-e4d256-prod-github-runner-207 kernel: [13760.622270] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 09:13:06 juju-e4d256-prod-github-runner-207 kernel: [13760.623167] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 09:13:06 juju-e4d256-prod-github-runner-207 kernel: [13760.624065] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 09:13:06 juju-e4d256-prod-github-runner-207 kernel: [13760.624990] Aug 22 09:13:34 juju-e4d256-prod-github-runner-207 kernel: [13788.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 12733s! [qemu-system-x86:6715] Aug 22 09:13:34 juju-e4d256-prod-github-runner-207 kernel: [13788.543162] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 09:13:34 juju-e4d256-prod-github-runner-207 kernel: [13788.543237] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 09:13:34 juju-e4d256-prod-github-runner-207 kernel: [13788.555698] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 09:13:34 juju-e4d256-prod-github-runner-207 kernel: [13788.556985] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 09:13:34 juju-e4d256-prod-github-runner-207 kernel: [13788.558220] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:13:34 juju-e4d256-prod-github-runner-207 kernel: [13788.559286] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 09:13:34 juju-e4d256-prod-github-runner-207 kernel: [13788.561878] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 09:13:34 juju-e4d256-prod-github-runner-207 kernel: [13788.562927] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 09:13:34 juju-e4d256-prod-github-runner-207 kernel: [13788.564120] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 09:13:34 juju-e4d256-prod-github-runner-207 kernel: [13788.565340] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 09:13:34 juju-e4d256-prod-github-runner-207 kernel: [13788.566514] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 09:13:34 juju-e4d256-prod-github-runner-207 kernel: [13788.567700] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 09:13:34 juju-e4d256-prod-github-runner-207 kernel: [13788.568878] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 09:13:34 juju-e4d256-prod-github-runner-207 kernel: [13788.570124] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 09:13:34 juju-e4d256-prod-github-runner-207 kernel: [13788.571230] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 09:13:34 juju-e4d256-prod-github-runner-207 kernel: [13788.572455] Call Trace: Aug 22 09:13:34 juju-e4d256-prod-github-runner-207 kernel: [13788.573373] Aug 22 09:13:34 juju-e4d256-prod-github-runner-207 kernel: [13788.574258] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:13:34 juju-e4d256-prod-github-runner-207 kernel: [13788.575306] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:13:34 juju-e4d256-prod-github-runner-207 kernel: [13788.576355] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:13:34 juju-e4d256-prod-github-runner-207 kernel: [13788.577452] ? show_regs.part.0+0x23/0x29 Aug 22 09:13:34 juju-e4d256-prod-github-runner-207 kernel: [13788.578465] ? show_regs.cold+0x8/0xd Aug 22 09:13:34 juju-e4d256-prod-github-runner-207 kernel: [13788.579467] ? watchdog_timer_fn+0x1be/0x220 Aug 22 09:13:34 juju-e4d256-prod-github-runner-207 kernel: [13788.580484] ? lockup_detector_update_enable+0x60/0x60 Aug 22 09:13:34 juju-e4d256-prod-github-runner-207 kernel: [13788.581557] ? __hrtimer_run_queues+0x107/0x230 Aug 22 09:13:34 juju-e4d256-prod-github-runner-207 kernel: [13788.582599] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 09:13:34 juju-e4d256-prod-github-runner-207 kernel: [13788.583641] ? hrtimer_interrupt+0x101/0x220 Aug 22 09:13:34 juju-e4d256-prod-github-runner-207 kernel: [13788.584660] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 09:13:34 juju-e4d256-prod-github-runner-207 kernel: [13788.585736] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 09:13:34 juju-e4d256-prod-github-runner-207 kernel: [13788.586794] Aug 22 09:13:34 juju-e4d256-prod-github-runner-207 kernel: [13788.587667] Aug 22 09:13:34 juju-e4d256-prod-github-runner-207 kernel: [13788.588546] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 09:13:34 juju-e4d256-prod-github-runner-207 kernel: [13788.589589] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:13:34 juju-e4d256-prod-github-runner-207 kernel: [13788.590635] ? _raw_spin_lock+0x22/0x30 Aug 22 09:13:34 juju-e4d256-prod-github-runner-207 kernel: [13788.591629] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:13:34 juju-e4d256-prod-github-runner-207 kernel: [13788.592702] direct_page_fault+0x206/0x310 [kvm] Aug 22 09:13:34 juju-e4d256-prod-github-runner-207 kernel: [13788.593736] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 09:13:34 juju-e4d256-prod-github-runner-207 kernel: [13788.594750] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 09:13:34 juju-e4d256-prod-github-runner-207 kernel: [13788.595781] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 09:13:34 juju-e4d256-prod-github-runner-207 kernel: [13788.596762] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 09:13:34 juju-e4d256-prod-github-runner-207 kernel: [13788.597719] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 09:13:34 juju-e4d256-prod-github-runner-207 kernel: [13788.598709] handle_exit+0x98/0x230 [kvm_amd] Aug 22 09:13:34 juju-e4d256-prod-github-runner-207 kernel: [13788.599626] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 09:13:34 juju-e4d256-prod-github-runner-207 kernel: [13788.600545] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 09:13:34 juju-e4d256-prod-github-runner-207 kernel: [13788.601481] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 09:13:34 juju-e4d256-prod-github-runner-207 kernel: [13788.602393] vcpu_run+0x62/0x2c0 [kvm] Aug 22 09:13:34 juju-e4d256-prod-github-runner-207 kernel: [13788.603232] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 09:13:34 juju-e4d256-prod-github-runner-207 kernel: [13788.604087] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 09:13:34 juju-e4d256-prod-github-runner-207 kernel: [13788.604955] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 09:13:34 juju-e4d256-prod-github-runner-207 kernel: [13788.605760] ? __seccomp_filter+0x4a/0x4a0 Aug 22 09:13:34 juju-e4d256-prod-github-runner-207 kernel: [13788.606509] ? __fget_files+0x86/0xc0 Aug 22 09:13:34 juju-e4d256-prod-github-runner-207 kernel: [13788.607221] __x64_sys_ioctl+0x95/0xd0 Aug 22 09:13:34 juju-e4d256-prod-github-runner-207 kernel: [13788.607933] do_syscall_64+0x5c/0xc0 Aug 22 09:13:34 juju-e4d256-prod-github-runner-207 kernel: [13788.608613] ? do_futex+0x162/0x1f0 Aug 22 09:13:34 juju-e4d256-prod-github-runner-207 kernel: [13788.609302] ? __x64_sys_futex+0x78/0x1e0 Aug 22 09:13:34 juju-e4d256-prod-github-runner-207 kernel: [13788.609986] ? __secure_computing+0xa9/0x120 Aug 22 09:13:34 juju-e4d256-prod-github-runner-207 kernel: [13788.610685] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 09:13:34 juju-e4d256-prod-github-runner-207 kernel: [13788.611510] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:13:34 juju-e4d256-prod-github-runner-207 kernel: [13788.612263] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:13:34 juju-e4d256-prod-github-runner-207 kernel: [13788.613001] ? do_syscall_64+0x69/0xc0 Aug 22 09:13:34 juju-e4d256-prod-github-runner-207 kernel: [13788.613660] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:13:34 juju-e4d256-prod-github-runner-207 kernel: [13788.614377] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:13:34 juju-e4d256-prod-github-runner-207 kernel: [13788.615085] ? do_syscall_64+0x69/0xc0 Aug 22 09:13:34 juju-e4d256-prod-github-runner-207 kernel: [13788.615741] ? do_syscall_64+0x69/0xc0 Aug 22 09:13:34 juju-e4d256-prod-github-runner-207 kernel: [13788.616379] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 09:13:34 juju-e4d256-prod-github-runner-207 kernel: [13788.617095] RIP: 0033:0x7faa5d0edaff Aug 22 09:13:34 juju-e4d256-prod-github-runner-207 kernel: [13788.617728] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 09:13:34 juju-e4d256-prod-github-runner-207 kernel: [13788.619783] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 09:13:34 juju-e4d256-prod-github-runner-207 kernel: [13788.620732] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 09:13:34 juju-e4d256-prod-github-runner-207 kernel: [13788.621643] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 09:13:34 juju-e4d256-prod-github-runner-207 kernel: [13788.622558] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 09:13:34 juju-e4d256-prod-github-runner-207 kernel: [13788.623486] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 09:13:34 juju-e4d256-prod-github-runner-207 kernel: [13788.624395] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 09:13:34 juju-e4d256-prod-github-runner-207 kernel: [13788.625333] Aug 22 09:14:02 juju-e4d256-prod-github-runner-207 kernel: [13816.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 12759s! [qemu-system-x86:6715] Aug 22 09:14:02 juju-e4d256-prod-github-runner-207 kernel: [13816.544092] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 09:14:02 juju-e4d256-prod-github-runner-207 kernel: [13816.544408] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 09:14:02 juju-e4d256-prod-github-runner-207 kernel: [13816.556757] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 09:14:02 juju-e4d256-prod-github-runner-207 kernel: [13816.558100] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 09:14:02 juju-e4d256-prod-github-runner-207 kernel: [13816.559362] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:14:02 juju-e4d256-prod-github-runner-207 kernel: [13816.560428] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 09:14:02 juju-e4d256-prod-github-runner-207 kernel: [13816.563021] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 09:14:02 juju-e4d256-prod-github-runner-207 kernel: [13816.564078] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 09:14:02 juju-e4d256-prod-github-runner-207 kernel: [13816.565247] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 09:14:02 juju-e4d256-prod-github-runner-207 kernel: [13816.566406] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 09:14:02 juju-e4d256-prod-github-runner-207 kernel: [13816.567687] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 09:14:02 juju-e4d256-prod-github-runner-207 kernel: [13816.568887] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 09:14:02 juju-e4d256-prod-github-runner-207 kernel: [13816.570076] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 09:14:02 juju-e4d256-prod-github-runner-207 kernel: [13816.571371] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 09:14:02 juju-e4d256-prod-github-runner-207 kernel: [13816.572501] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 09:14:02 juju-e4d256-prod-github-runner-207 kernel: [13816.573729] Call Trace: Aug 22 09:14:02 juju-e4d256-prod-github-runner-207 kernel: [13816.574652] Aug 22 09:14:02 juju-e4d256-prod-github-runner-207 kernel: [13816.575598] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:14:02 juju-e4d256-prod-github-runner-207 kernel: [13816.576641] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:14:02 juju-e4d256-prod-github-runner-207 kernel: [13816.577702] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:14:02 juju-e4d256-prod-github-runner-207 kernel: [13816.578851] ? show_regs.part.0+0x23/0x29 Aug 22 09:14:02 juju-e4d256-prod-github-runner-207 kernel: [13816.579895] ? show_regs.cold+0x8/0xd Aug 22 09:14:02 juju-e4d256-prod-github-runner-207 kernel: [13816.580868] ? watchdog_timer_fn+0x1be/0x220 Aug 22 09:14:02 juju-e4d256-prod-github-runner-207 kernel: [13816.581877] ? lockup_detector_update_enable+0x60/0x60 Aug 22 09:14:02 juju-e4d256-prod-github-runner-207 kernel: [13816.582951] ? __hrtimer_run_queues+0x107/0x230 Aug 22 09:14:02 juju-e4d256-prod-github-runner-207 kernel: [13816.584053] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 09:14:02 juju-e4d256-prod-github-runner-207 kernel: [13816.585093] ? hrtimer_interrupt+0x101/0x220 Aug 22 09:14:02 juju-e4d256-prod-github-runner-207 kernel: [13816.586109] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 09:14:02 juju-e4d256-prod-github-runner-207 kernel: [13816.587213] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 09:14:02 juju-e4d256-prod-github-runner-207 kernel: [13816.588279] Aug 22 09:14:02 juju-e4d256-prod-github-runner-207 kernel: [13816.589218] Aug 22 09:14:02 juju-e4d256-prod-github-runner-207 kernel: [13816.590106] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 09:14:02 juju-e4d256-prod-github-runner-207 kernel: [13816.591196] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:14:02 juju-e4d256-prod-github-runner-207 kernel: [13816.592274] ? _raw_spin_lock+0x22/0x30 Aug 22 09:14:02 juju-e4d256-prod-github-runner-207 kernel: [13816.593263] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:14:02 juju-e4d256-prod-github-runner-207 kernel: [13816.594316] direct_page_fault+0x206/0x310 [kvm] Aug 22 09:14:02 juju-e4d256-prod-github-runner-207 kernel: [13816.595388] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 09:14:02 juju-e4d256-prod-github-runner-207 kernel: [13816.596410] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 09:14:02 juju-e4d256-prod-github-runner-207 kernel: [13816.597416] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 09:14:02 juju-e4d256-prod-github-runner-207 kernel: [13816.598454] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 09:14:02 juju-e4d256-prod-github-runner-207 kernel: [13816.599490] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 09:14:02 juju-e4d256-prod-github-runner-207 kernel: [13816.600509] handle_exit+0x98/0x230 [kvm_amd] Aug 22 09:14:02 juju-e4d256-prod-github-runner-207 kernel: [13816.601586] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 09:14:02 juju-e4d256-prod-github-runner-207 kernel: [13816.602646] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 09:14:02 juju-e4d256-prod-github-runner-207 kernel: [13816.603648] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 09:14:02 juju-e4d256-prod-github-runner-207 kernel: [13816.604591] vcpu_run+0x62/0x2c0 [kvm] Aug 22 09:14:02 juju-e4d256-prod-github-runner-207 kernel: [13816.605426] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 09:14:02 juju-e4d256-prod-github-runner-207 kernel: [13816.606430] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 09:14:02 juju-e4d256-prod-github-runner-207 kernel: [13816.607315] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 09:14:02 juju-e4d256-prod-github-runner-207 kernel: [13816.608155] ? __seccomp_filter+0x4a/0x4a0 Aug 22 09:14:02 juju-e4d256-prod-github-runner-207 kernel: [13816.609136] ? __fget_files+0x86/0xc0 Aug 22 09:14:02 juju-e4d256-prod-github-runner-207 kernel: [13816.609879] __x64_sys_ioctl+0x95/0xd0 Aug 22 09:14:02 juju-e4d256-prod-github-runner-207 kernel: [13816.610601] do_syscall_64+0x5c/0xc0 Aug 22 09:14:02 juju-e4d256-prod-github-runner-207 kernel: [13816.611302] ? do_futex+0x162/0x1f0 Aug 22 09:14:02 juju-e4d256-prod-github-runner-207 kernel: [13816.612022] ? __x64_sys_futex+0x78/0x1e0 Aug 22 09:14:02 juju-e4d256-prod-github-runner-207 kernel: [13816.612731] ? __secure_computing+0xa9/0x120 Aug 22 09:14:02 juju-e4d256-prod-github-runner-207 kernel: [13816.613436] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 09:14:02 juju-e4d256-prod-github-runner-207 kernel: [13816.614244] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:14:02 juju-e4d256-prod-github-runner-207 kernel: [13816.615360] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:14:02 juju-e4d256-prod-github-runner-207 kernel: [13816.616126] ? do_syscall_64+0x69/0xc0 Aug 22 09:14:02 juju-e4d256-prod-github-runner-207 kernel: [13816.616788] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:14:02 juju-e4d256-prod-github-runner-207 kernel: [13816.617509] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:14:02 juju-e4d256-prod-github-runner-207 kernel: [13816.618222] ? do_syscall_64+0x69/0xc0 Aug 22 09:14:02 juju-e4d256-prod-github-runner-207 kernel: [13816.618850] ? do_syscall_64+0x69/0xc0 Aug 22 09:14:02 juju-e4d256-prod-github-runner-207 kernel: [13816.619520] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 09:14:02 juju-e4d256-prod-github-runner-207 kernel: [13816.620301] RIP: 0033:0x7faa5d0edaff Aug 22 09:14:02 juju-e4d256-prod-github-runner-207 kernel: [13816.621026] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 09:14:02 juju-e4d256-prod-github-runner-207 kernel: [13816.623060] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 09:14:02 juju-e4d256-prod-github-runner-207 kernel: [13816.623986] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 09:14:02 juju-e4d256-prod-github-runner-207 kernel: [13816.624905] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 09:14:02 juju-e4d256-prod-github-runner-207 kernel: [13816.625836] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 09:14:02 juju-e4d256-prod-github-runner-207 kernel: [13816.626751] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 09:14:02 juju-e4d256-prod-github-runner-207 kernel: [13816.627697] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 09:14:02 juju-e4d256-prod-github-runner-207 kernel: [13816.628620] Aug 22 09:14:30 juju-e4d256-prod-github-runner-207 kernel: [13844.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 12785s! [qemu-system-x86:6715] Aug 22 09:14:30 juju-e4d256-prod-github-runner-207 kernel: [13844.543094] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 09:14:30 juju-e4d256-prod-github-runner-207 kernel: [13844.543168] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 09:14:30 juju-e4d256-prod-github-runner-207 kernel: [13844.555501] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 09:14:30 juju-e4d256-prod-github-runner-207 kernel: [13844.556780] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 09:14:30 juju-e4d256-prod-github-runner-207 kernel: [13844.558000] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:14:30 juju-e4d256-prod-github-runner-207 kernel: [13844.559066] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 09:14:30 juju-e4d256-prod-github-runner-207 kernel: [13844.561616] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 09:14:30 juju-e4d256-prod-github-runner-207 kernel: [13844.562689] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 09:14:30 juju-e4d256-prod-github-runner-207 kernel: [13844.563853] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 09:14:30 juju-e4d256-prod-github-runner-207 kernel: [13844.565050] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 09:14:30 juju-e4d256-prod-github-runner-207 kernel: [13844.566218] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 09:14:30 juju-e4d256-prod-github-runner-207 kernel: [13844.567433] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 09:14:30 juju-e4d256-prod-github-runner-207 kernel: [13844.568605] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 09:14:30 juju-e4d256-prod-github-runner-207 kernel: [13844.569843] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 09:14:30 juju-e4d256-prod-github-runner-207 kernel: [13844.570978] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 09:14:30 juju-e4d256-prod-github-runner-207 kernel: [13844.572177] Call Trace: Aug 22 09:14:30 juju-e4d256-prod-github-runner-207 kernel: [13844.573101] Aug 22 09:14:30 juju-e4d256-prod-github-runner-207 kernel: [13844.573984] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:14:30 juju-e4d256-prod-github-runner-207 kernel: [13844.575031] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:14:30 juju-e4d256-prod-github-runner-207 kernel: [13844.576053] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:14:30 juju-e4d256-prod-github-runner-207 kernel: [13844.577134] ? show_regs.part.0+0x23/0x29 Aug 22 09:14:30 juju-e4d256-prod-github-runner-207 kernel: [13844.578135] ? show_regs.cold+0x8/0xd Aug 22 09:14:30 juju-e4d256-prod-github-runner-207 kernel: [13844.579116] ? watchdog_timer_fn+0x1be/0x220 Aug 22 09:14:30 juju-e4d256-prod-github-runner-207 kernel: [13844.580123] ? lockup_detector_update_enable+0x60/0x60 Aug 22 09:14:30 juju-e4d256-prod-github-runner-207 kernel: [13844.581318] ? __hrtimer_run_queues+0x107/0x230 Aug 22 09:14:30 juju-e4d256-prod-github-runner-207 kernel: [13844.582364] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 09:14:30 juju-e4d256-prod-github-runner-207 kernel: [13844.583402] ? hrtimer_interrupt+0x101/0x220 Aug 22 09:14:30 juju-e4d256-prod-github-runner-207 kernel: [13844.584645] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 09:14:30 juju-e4d256-prod-github-runner-207 kernel: [13844.585854] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 09:14:30 juju-e4d256-prod-github-runner-207 kernel: [13844.586957] Aug 22 09:14:30 juju-e4d256-prod-github-runner-207 kernel: [13844.587819] Aug 22 09:14:30 juju-e4d256-prod-github-runner-207 kernel: [13844.588657] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 09:14:30 juju-e4d256-prod-github-runner-207 kernel: [13844.589821] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:14:30 juju-e4d256-prod-github-runner-207 kernel: [13844.590946] ? _raw_spin_lock+0x22/0x30 Aug 22 09:14:30 juju-e4d256-prod-github-runner-207 kernel: [13844.591895] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:14:30 juju-e4d256-prod-github-runner-207 kernel: [13844.592926] direct_page_fault+0x206/0x310 [kvm] Aug 22 09:14:30 juju-e4d256-prod-github-runner-207 kernel: [13844.593951] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 09:14:30 juju-e4d256-prod-github-runner-207 kernel: [13844.594977] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 09:14:30 juju-e4d256-prod-github-runner-207 kernel: [13844.595983] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 09:14:30 juju-e4d256-prod-github-runner-207 kernel: [13844.596961] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 09:14:30 juju-e4d256-prod-github-runner-207 kernel: [13844.597916] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 09:14:30 juju-e4d256-prod-github-runner-207 kernel: [13844.598914] handle_exit+0x98/0x230 [kvm_amd] Aug 22 09:14:30 juju-e4d256-prod-github-runner-207 kernel: [13844.599859] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 09:14:30 juju-e4d256-prod-github-runner-207 kernel: [13844.600774] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 09:14:30 juju-e4d256-prod-github-runner-207 kernel: [13844.601701] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 09:14:30 juju-e4d256-prod-github-runner-207 kernel: [13844.602610] vcpu_run+0x62/0x2c0 [kvm] Aug 22 09:14:30 juju-e4d256-prod-github-runner-207 kernel: [13844.603431] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 09:14:30 juju-e4d256-prod-github-runner-207 kernel: [13844.604239] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 09:14:30 juju-e4d256-prod-github-runner-207 kernel: [13844.605099] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 09:14:30 juju-e4d256-prod-github-runner-207 kernel: [13844.605896] ? __seccomp_filter+0x4a/0x4a0 Aug 22 09:14:30 juju-e4d256-prod-github-runner-207 kernel: [13844.606641] ? __fget_files+0x86/0xc0 Aug 22 09:14:30 juju-e4d256-prod-github-runner-207 kernel: [13844.607354] __x64_sys_ioctl+0x95/0xd0 Aug 22 09:14:30 juju-e4d256-prod-github-runner-207 kernel: [13844.608196] do_syscall_64+0x5c/0xc0 Aug 22 09:14:30 juju-e4d256-prod-github-runner-207 kernel: [13844.608974] ? do_futex+0x162/0x1f0 Aug 22 09:14:30 juju-e4d256-prod-github-runner-207 kernel: [13844.609625] ? __x64_sys_futex+0x78/0x1e0 Aug 22 09:14:30 juju-e4d256-prod-github-runner-207 kernel: [13844.610299] ? __secure_computing+0xa9/0x120 Aug 22 09:14:30 juju-e4d256-prod-github-runner-207 kernel: [13844.611029] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 09:14:30 juju-e4d256-prod-github-runner-207 kernel: [13844.611810] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:14:30 juju-e4d256-prod-github-runner-207 kernel: [13844.612533] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:14:30 juju-e4d256-prod-github-runner-207 kernel: [13844.613251] ? do_syscall_64+0x69/0xc0 Aug 22 09:14:30 juju-e4d256-prod-github-runner-207 kernel: [13844.613901] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:14:30 juju-e4d256-prod-github-runner-207 kernel: [13844.614627] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:14:30 juju-e4d256-prod-github-runner-207 kernel: [13844.615338] ? do_syscall_64+0x69/0xc0 Aug 22 09:14:30 juju-e4d256-prod-github-runner-207 kernel: [13844.615966] ? do_syscall_64+0x69/0xc0 Aug 22 09:14:30 juju-e4d256-prod-github-runner-207 kernel: [13844.616587] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 09:14:30 juju-e4d256-prod-github-runner-207 kernel: [13844.617297] RIP: 0033:0x7faa5d0edaff Aug 22 09:14:30 juju-e4d256-prod-github-runner-207 kernel: [13844.617982] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 09:14:30 juju-e4d256-prod-github-runner-207 kernel: [13844.620089] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 09:14:30 juju-e4d256-prod-github-runner-207 kernel: [13844.621088] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 09:14:30 juju-e4d256-prod-github-runner-207 kernel: [13844.622051] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 09:14:30 juju-e4d256-prod-github-runner-207 kernel: [13844.623023] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 09:14:30 juju-e4d256-prod-github-runner-207 kernel: [13844.624102] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 09:14:30 juju-e4d256-prod-github-runner-207 kernel: [13844.625048] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 09:14:30 juju-e4d256-prod-github-runner-207 kernel: [13844.625992] Aug 22 09:14:44 juju-e4d256-prod-github-runner-207 kernel: [13858.112712] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 09:14:44 juju-e4d256-prod-github-runner-207 kernel: [13858.113740] rcu: 1-....: (3424475 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=1654488 Aug 22 09:14:44 juju-e4d256-prod-github-runner-207 kernel: [13858.114912] (t=3435228 jiffies g=23269 q=21436) Aug 22 09:14:44 juju-e4d256-prod-github-runner-207 kernel: [13858.115696] NMI backtrace for cpu 1 Aug 22 09:14:44 juju-e4d256-prod-github-runner-207 kernel: [13858.116405] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 09:14:44 juju-e4d256-prod-github-runner-207 kernel: [13858.117516] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 09:14:44 juju-e4d256-prod-github-runner-207 kernel: [13858.118609] Call Trace: Aug 22 09:14:44 juju-e4d256-prod-github-runner-207 kernel: [13858.119284] Aug 22 09:14:44 juju-e4d256-prod-github-runner-207 kernel: [13858.119933] show_stack+0x52/0x5c Aug 22 09:14:44 juju-e4d256-prod-github-runner-207 kernel: [13858.120656] dump_stack_lvl+0x4a/0x63 Aug 22 09:14:44 juju-e4d256-prod-github-runner-207 kernel: [13858.121403] dump_stack+0x10/0x16 Aug 22 09:14:44 juju-e4d256-prod-github-runner-207 kernel: [13858.122124] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 09:14:44 juju-e4d256-prod-github-runner-207 kernel: [13858.122917] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 09:14:44 juju-e4d256-prod-github-runner-207 kernel: [13858.123696] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 09:14:44 juju-e4d256-prod-github-runner-207 kernel: [13858.124516] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 09:14:44 juju-e4d256-prod-github-runner-207 kernel: [13858.125344] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 09:14:44 juju-e4d256-prod-github-runner-207 kernel: [13858.126149] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 09:14:44 juju-e4d256-prod-github-runner-207 kernel: [13858.126935] print_cpu_stall.cold+0x2f/0xe2 Aug 22 09:14:44 juju-e4d256-prod-github-runner-207 kernel: [13858.127701] ? timekeeping_update+0xf7/0x150 Aug 22 09:14:44 juju-e4d256-prod-github-runner-207 kernel: [13858.128474] check_cpu_stall+0x109/0x270 Aug 22 09:14:44 juju-e4d256-prod-github-runner-207 kernel: [13858.129225] rcu_sched_clock_irq+0x9a/0x250 Aug 22 09:14:44 juju-e4d256-prod-github-runner-207 kernel: [13858.130081] update_process_times+0x94/0xd0 Aug 22 09:14:44 juju-e4d256-prod-github-runner-207 kernel: [13858.130961] tick_sched_handle+0x29/0x70 Aug 22 09:14:44 juju-e4d256-prod-github-runner-207 kernel: [13858.131824] tick_sched_timer+0x8c/0xc0 Aug 22 09:14:44 juju-e4d256-prod-github-runner-207 kernel: [13858.132664] ? tick_nohz_handler+0xb0/0xb0 Aug 22 09:14:44 juju-e4d256-prod-github-runner-207 kernel: [13858.133555] __hrtimer_run_queues+0x107/0x230 Aug 22 09:14:44 juju-e4d256-prod-github-runner-207 kernel: [13858.134420] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 09:14:44 juju-e4d256-prod-github-runner-207 kernel: [13858.135325] hrtimer_interrupt+0x101/0x220 Aug 22 09:14:44 juju-e4d256-prod-github-runner-207 kernel: [13858.136186] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 09:14:44 juju-e4d256-prod-github-runner-207 kernel: [13858.137091] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 09:14:44 juju-e4d256-prod-github-runner-207 kernel: [13858.137988] Aug 22 09:14:44 juju-e4d256-prod-github-runner-207 kernel: [13858.138688] Aug 22 09:14:44 juju-e4d256-prod-github-runner-207 kernel: [13858.139360] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 09:14:44 juju-e4d256-prod-github-runner-207 kernel: [13858.140279] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:14:44 juju-e4d256-prod-github-runner-207 kernel: [13858.141266] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 09:14:44 juju-e4d256-prod-github-runner-207 kernel: [13858.143826] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 09:14:44 juju-e4d256-prod-github-runner-207 kernel: [13858.144793] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 09:14:44 juju-e4d256-prod-github-runner-207 kernel: [13858.145913] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 09:14:44 juju-e4d256-prod-github-runner-207 kernel: [13858.147040] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 09:14:44 juju-e4d256-prod-github-runner-207 kernel: [13858.148139] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 09:14:44 juju-e4d256-prod-github-runner-207 kernel: [13858.149232] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 09:14:44 juju-e4d256-prod-github-runner-207 kernel: [13858.150319] ? _raw_spin_lock+0x22/0x30 Aug 22 09:14:44 juju-e4d256-prod-github-runner-207 kernel: [13858.151191] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:14:44 juju-e4d256-prod-github-runner-207 kernel: [13858.152144] direct_page_fault+0x206/0x310 [kvm] Aug 22 09:14:44 juju-e4d256-prod-github-runner-207 kernel: [13858.153094] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 09:14:44 juju-e4d256-prod-github-runner-207 kernel: [13858.154028] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 09:14:44 juju-e4d256-prod-github-runner-207 kernel: [13858.154973] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 09:14:44 juju-e4d256-prod-github-runner-207 kernel: [13858.155866] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 09:14:44 juju-e4d256-prod-github-runner-207 kernel: [13858.156874] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 09:14:44 juju-e4d256-prod-github-runner-207 kernel: [13858.157930] handle_exit+0x98/0x230 [kvm_amd] Aug 22 09:14:44 juju-e4d256-prod-github-runner-207 kernel: [13858.158784] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 09:14:44 juju-e4d256-prod-github-runner-207 kernel: [13858.159704] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 09:14:44 juju-e4d256-prod-github-runner-207 kernel: [13858.160616] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 09:14:44 juju-e4d256-prod-github-runner-207 kernel: [13858.161510] vcpu_run+0x62/0x2c0 [kvm] Aug 22 09:14:44 juju-e4d256-prod-github-runner-207 kernel: [13858.162300] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 09:14:44 juju-e4d256-prod-github-runner-207 kernel: [13858.163141] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 09:14:44 juju-e4d256-prod-github-runner-207 kernel: [13858.164049] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 09:14:44 juju-e4d256-prod-github-runner-207 kernel: [13858.164931] ? __seccomp_filter+0x4a/0x4a0 Aug 22 09:14:44 juju-e4d256-prod-github-runner-207 kernel: [13858.165746] ? __fget_files+0x86/0xc0 Aug 22 09:14:44 juju-e4d256-prod-github-runner-207 kernel: [13858.166536] __x64_sys_ioctl+0x95/0xd0 Aug 22 09:14:44 juju-e4d256-prod-github-runner-207 kernel: [13858.167307] do_syscall_64+0x5c/0xc0 Aug 22 09:14:44 juju-e4d256-prod-github-runner-207 kernel: [13858.168072] ? do_futex+0x162/0x1f0 Aug 22 09:14:44 juju-e4d256-prod-github-runner-207 kernel: [13858.168823] ? __x64_sys_futex+0x78/0x1e0 Aug 22 09:14:44 juju-e4d256-prod-github-runner-207 kernel: [13858.169635] ? __secure_computing+0xa9/0x120 Aug 22 09:14:44 juju-e4d256-prod-github-runner-207 kernel: [13858.170447] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 09:14:44 juju-e4d256-prod-github-runner-207 kernel: [13858.171359] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:14:44 juju-e4d256-prod-github-runner-207 kernel: [13858.172205] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:14:44 juju-e4d256-prod-github-runner-207 kernel: [13858.173048] ? do_syscall_64+0x69/0xc0 Aug 22 09:14:44 juju-e4d256-prod-github-runner-207 kernel: [13858.173809] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:14:44 juju-e4d256-prod-github-runner-207 kernel: [13858.174689] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:14:44 juju-e4d256-prod-github-runner-207 kernel: [13858.175541] ? do_syscall_64+0x69/0xc0 Aug 22 09:14:44 juju-e4d256-prod-github-runner-207 kernel: [13858.176314] ? do_syscall_64+0x69/0xc0 Aug 22 09:14:44 juju-e4d256-prod-github-runner-207 kernel: [13858.177080] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 09:14:44 juju-e4d256-prod-github-runner-207 kernel: [13858.177958] RIP: 0033:0x7faa5d0edaff Aug 22 09:14:44 juju-e4d256-prod-github-runner-207 kernel: [13858.178736] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 09:14:44 juju-e4d256-prod-github-runner-207 kernel: [13858.181167] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 09:14:44 juju-e4d256-prod-github-runner-207 kernel: [13858.182268] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 09:14:44 juju-e4d256-prod-github-runner-207 kernel: [13858.183371] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 09:14:44 juju-e4d256-prod-github-runner-207 kernel: [13858.184456] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 09:14:44 juju-e4d256-prod-github-runner-207 kernel: [13858.185538] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 09:14:44 juju-e4d256-prod-github-runner-207 kernel: [13858.186622] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 09:14:44 juju-e4d256-prod-github-runner-207 kernel: [13858.187675] Aug 22 09:15:10 juju-e4d256-prod-github-runner-207 kernel: [13884.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 12822s! [qemu-system-x86:6715] Aug 22 09:15:10 juju-e4d256-prod-github-runner-207 kernel: [13884.543179] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 09:15:10 juju-e4d256-prod-github-runner-207 kernel: [13884.543254] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 09:15:10 juju-e4d256-prod-github-runner-207 kernel: [13884.555799] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 09:15:10 juju-e4d256-prod-github-runner-207 kernel: [13884.557153] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 09:15:10 juju-e4d256-prod-github-runner-207 kernel: [13884.558433] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:15:10 juju-e4d256-prod-github-runner-207 kernel: [13884.559512] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 09:15:10 juju-e4d256-prod-github-runner-207 kernel: [13884.562124] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 09:15:10 juju-e4d256-prod-github-runner-207 kernel: [13884.563200] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 09:15:10 juju-e4d256-prod-github-runner-207 kernel: [13884.564382] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 09:15:10 juju-e4d256-prod-github-runner-207 kernel: [13884.565571] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 09:15:10 juju-e4d256-prod-github-runner-207 kernel: [13884.566976] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 09:15:10 juju-e4d256-prod-github-runner-207 kernel: [13884.568207] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 09:15:10 juju-e4d256-prod-github-runner-207 kernel: [13884.569406] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 09:15:10 juju-e4d256-prod-github-runner-207 kernel: [13884.570695] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 09:15:10 juju-e4d256-prod-github-runner-207 kernel: [13884.571890] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 09:15:10 juju-e4d256-prod-github-runner-207 kernel: [13884.573168] Call Trace: Aug 22 09:15:10 juju-e4d256-prod-github-runner-207 kernel: [13884.574100] Aug 22 09:15:10 juju-e4d256-prod-github-runner-207 kernel: [13884.575023] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:15:10 juju-e4d256-prod-github-runner-207 kernel: [13884.576174] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:15:10 juju-e4d256-prod-github-runner-207 kernel: [13884.577235] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:15:10 juju-e4d256-prod-github-runner-207 kernel: [13884.578375] ? show_regs.part.0+0x23/0x29 Aug 22 09:15:10 juju-e4d256-prod-github-runner-207 kernel: [13884.579394] ? show_regs.cold+0x8/0xd Aug 22 09:15:10 juju-e4d256-prod-github-runner-207 kernel: [13884.580387] ? watchdog_timer_fn+0x1be/0x220 Aug 22 09:15:10 juju-e4d256-prod-github-runner-207 kernel: [13884.581422] ? lockup_detector_update_enable+0x60/0x60 Aug 22 09:15:10 juju-e4d256-prod-github-runner-207 kernel: [13884.585155] ? __hrtimer_run_queues+0x107/0x230 Aug 22 09:15:10 juju-e4d256-prod-github-runner-207 kernel: [13884.586290] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 09:15:10 juju-e4d256-prod-github-runner-207 kernel: [13884.587351] ? hrtimer_interrupt+0x101/0x220 Aug 22 09:15:10 juju-e4d256-prod-github-runner-207 kernel: [13884.588405] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 09:15:10 juju-e4d256-prod-github-runner-207 kernel: [13884.589494] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 09:15:10 juju-e4d256-prod-github-runner-207 kernel: [13884.590582] Aug 22 09:15:10 juju-e4d256-prod-github-runner-207 kernel: [13884.591446] Aug 22 09:15:10 juju-e4d256-prod-github-runner-207 kernel: [13884.592301] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 09:15:10 juju-e4d256-prod-github-runner-207 kernel: [13884.593361] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:15:10 juju-e4d256-prod-github-runner-207 kernel: [13884.594504] ? _raw_spin_lock+0x22/0x30 Aug 22 09:15:10 juju-e4d256-prod-github-runner-207 kernel: [13884.595540] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:15:10 juju-e4d256-prod-github-runner-207 kernel: [13884.596648] direct_page_fault+0x206/0x310 [kvm] Aug 22 09:15:10 juju-e4d256-prod-github-runner-207 kernel: [13884.597723] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 09:15:10 juju-e4d256-prod-github-runner-207 kernel: [13884.598829] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 09:15:10 juju-e4d256-prod-github-runner-207 kernel: [13884.599862] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 09:15:10 juju-e4d256-prod-github-runner-207 kernel: [13884.600880] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 09:15:10 juju-e4d256-prod-github-runner-207 kernel: [13884.601922] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 09:15:10 juju-e4d256-prod-github-runner-207 kernel: [13884.602985] handle_exit+0x98/0x230 [kvm_amd] Aug 22 09:15:10 juju-e4d256-prod-github-runner-207 kernel: [13884.603905] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 09:15:10 juju-e4d256-prod-github-runner-207 kernel: [13884.604885] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 09:15:10 juju-e4d256-prod-github-runner-207 kernel: [13884.605881] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 09:15:10 juju-e4d256-prod-github-runner-207 kernel: [13884.606856] vcpu_run+0x62/0x2c0 [kvm] Aug 22 09:15:10 juju-e4d256-prod-github-runner-207 kernel: [13884.607704] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 09:15:10 juju-e4d256-prod-github-runner-207 kernel: [13884.608564] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 09:15:10 juju-e4d256-prod-github-runner-207 kernel: [13884.609446] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 09:15:10 juju-e4d256-prod-github-runner-207 kernel: [13884.610289] ? __seccomp_filter+0x4a/0x4a0 Aug 22 09:15:10 juju-e4d256-prod-github-runner-207 kernel: [13884.611051] ? __fget_files+0x86/0xc0 Aug 22 09:15:10 juju-e4d256-prod-github-runner-207 kernel: [13884.611767] __x64_sys_ioctl+0x95/0xd0 Aug 22 09:15:10 juju-e4d256-prod-github-runner-207 kernel: [13884.612482] do_syscall_64+0x5c/0xc0 Aug 22 09:15:10 juju-e4d256-prod-github-runner-207 kernel: [13884.613171] ? do_futex+0x162/0x1f0 Aug 22 09:15:10 juju-e4d256-prod-github-runner-207 kernel: [13884.613846] ? __x64_sys_futex+0x78/0x1e0 Aug 22 09:15:10 juju-e4d256-prod-github-runner-207 kernel: [13884.614565] ? __secure_computing+0xa9/0x120 Aug 22 09:15:10 juju-e4d256-prod-github-runner-207 kernel: [13884.615282] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 09:15:10 juju-e4d256-prod-github-runner-207 kernel: [13884.616057] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:15:10 juju-e4d256-prod-github-runner-207 kernel: [13884.616789] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:15:10 juju-e4d256-prod-github-runner-207 kernel: [13884.617719] ? do_syscall_64+0x69/0xc0 Aug 22 09:15:10 juju-e4d256-prod-github-runner-207 kernel: [13884.618414] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:15:10 juju-e4d256-prod-github-runner-207 kernel: [13884.619152] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:15:10 juju-e4d256-prod-github-runner-207 kernel: [13884.619865] ? do_syscall_64+0x69/0xc0 Aug 22 09:15:10 juju-e4d256-prod-github-runner-207 kernel: [13884.620501] ? do_syscall_64+0x69/0xc0 Aug 22 09:15:10 juju-e4d256-prod-github-runner-207 kernel: [13884.621134] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 09:15:10 juju-e4d256-prod-github-runner-207 kernel: [13884.621859] RIP: 0033:0x7faa5d0edaff Aug 22 09:15:10 juju-e4d256-prod-github-runner-207 kernel: [13884.622515] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 09:15:10 juju-e4d256-prod-github-runner-207 kernel: [13884.624599] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 09:15:10 juju-e4d256-prod-github-runner-207 kernel: [13884.625530] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 09:15:10 juju-e4d256-prod-github-runner-207 kernel: [13884.626489] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 09:15:10 juju-e4d256-prod-github-runner-207 kernel: [13884.627495] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 09:15:10 juju-e4d256-prod-github-runner-207 kernel: [13884.628631] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 09:15:10 juju-e4d256-prod-github-runner-207 kernel: [13884.629583] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 09:15:10 juju-e4d256-prod-github-runner-207 kernel: [13884.630520] Aug 22 09:15:38 juju-e4d256-prod-github-runner-207 kernel: [13912.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 12849s! [qemu-system-x86:6715] Aug 22 09:15:38 juju-e4d256-prod-github-runner-207 kernel: [13912.543826] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 09:15:38 juju-e4d256-prod-github-runner-207 kernel: [13912.544118] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 09:15:38 juju-e4d256-prod-github-runner-207 kernel: [13912.556335] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 09:15:38 juju-e4d256-prod-github-runner-207 kernel: [13912.557663] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 09:15:38 juju-e4d256-prod-github-runner-207 kernel: [13912.558929] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:15:38 juju-e4d256-prod-github-runner-207 kernel: [13912.560013] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 09:15:38 juju-e4d256-prod-github-runner-207 kernel: [13912.562587] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 09:15:38 juju-e4d256-prod-github-runner-207 kernel: [13912.563641] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 09:15:38 juju-e4d256-prod-github-runner-207 kernel: [13912.564817] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 09:15:38 juju-e4d256-prod-github-runner-207 kernel: [13912.565998] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 09:15:38 juju-e4d256-prod-github-runner-207 kernel: [13912.567162] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 09:15:38 juju-e4d256-prod-github-runner-207 kernel: [13912.568326] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 09:15:38 juju-e4d256-prod-github-runner-207 kernel: [13912.569492] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 09:15:38 juju-e4d256-prod-github-runner-207 kernel: [13912.570746] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 09:15:38 juju-e4d256-prod-github-runner-207 kernel: [13912.571852] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 09:15:38 juju-e4d256-prod-github-runner-207 kernel: [13912.573053] Call Trace: Aug 22 09:15:38 juju-e4d256-prod-github-runner-207 kernel: [13912.573993] Aug 22 09:15:38 juju-e4d256-prod-github-runner-207 kernel: [13912.574908] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:15:38 juju-e4d256-prod-github-runner-207 kernel: [13912.575944] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:15:38 juju-e4d256-prod-github-runner-207 kernel: [13912.576972] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:15:38 juju-e4d256-prod-github-runner-207 kernel: [13912.578116] ? show_regs.part.0+0x23/0x29 Aug 22 09:15:38 juju-e4d256-prod-github-runner-207 kernel: [13912.579119] ? show_regs.cold+0x8/0xd Aug 22 09:15:38 juju-e4d256-prod-github-runner-207 kernel: [13912.580100] ? watchdog_timer_fn+0x1be/0x220 Aug 22 09:15:38 juju-e4d256-prod-github-runner-207 kernel: [13912.581142] ? lockup_detector_update_enable+0x60/0x60 Aug 22 09:15:38 juju-e4d256-prod-github-runner-207 kernel: [13912.582234] ? __hrtimer_run_queues+0x107/0x230 Aug 22 09:15:38 juju-e4d256-prod-github-runner-207 kernel: [13912.583268] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 09:15:38 juju-e4d256-prod-github-runner-207 kernel: [13912.584336] ? hrtimer_interrupt+0x101/0x220 Aug 22 09:15:38 juju-e4d256-prod-github-runner-207 kernel: [13912.585375] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 09:15:38 juju-e4d256-prod-github-runner-207 kernel: [13912.586519] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 09:15:38 juju-e4d256-prod-github-runner-207 kernel: [13912.587571] Aug 22 09:15:38 juju-e4d256-prod-github-runner-207 kernel: [13912.588425] Aug 22 09:15:38 juju-e4d256-prod-github-runner-207 kernel: [13912.589266] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 09:15:38 juju-e4d256-prod-github-runner-207 kernel: [13912.590322] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:15:38 juju-e4d256-prod-github-runner-207 kernel: [13912.591366] ? _raw_spin_lock+0x22/0x30 Aug 22 09:15:38 juju-e4d256-prod-github-runner-207 kernel: [13912.592312] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:15:38 juju-e4d256-prod-github-runner-207 kernel: [13912.593332] direct_page_fault+0x206/0x310 [kvm] Aug 22 09:15:38 juju-e4d256-prod-github-runner-207 kernel: [13912.594372] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 09:15:38 juju-e4d256-prod-github-runner-207 kernel: [13912.595383] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 09:15:38 juju-e4d256-prod-github-runner-207 kernel: [13912.596380] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 09:15:38 juju-e4d256-prod-github-runner-207 kernel: [13912.597414] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 09:15:38 juju-e4d256-prod-github-runner-207 kernel: [13912.598402] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 09:15:38 juju-e4d256-prod-github-runner-207 kernel: [13912.599406] handle_exit+0x98/0x230 [kvm_amd] Aug 22 09:15:38 juju-e4d256-prod-github-runner-207 kernel: [13912.600311] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 09:15:38 juju-e4d256-prod-github-runner-207 kernel: [13912.601230] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 09:15:38 juju-e4d256-prod-github-runner-207 kernel: [13912.602177] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 09:15:38 juju-e4d256-prod-github-runner-207 kernel: [13912.603182] vcpu_run+0x62/0x2c0 [kvm] Aug 22 09:15:38 juju-e4d256-prod-github-runner-207 kernel: [13912.604024] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 09:15:38 juju-e4d256-prod-github-runner-207 kernel: [13912.604861] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 09:15:38 juju-e4d256-prod-github-runner-207 kernel: [13912.605729] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 09:15:38 juju-e4d256-prod-github-runner-207 kernel: [13912.606562] ? __seccomp_filter+0x4a/0x4a0 Aug 22 09:15:38 juju-e4d256-prod-github-runner-207 kernel: [13912.607345] ? __fget_files+0x86/0xc0 Aug 22 09:15:38 juju-e4d256-prod-github-runner-207 kernel: [13912.608057] __x64_sys_ioctl+0x95/0xd0 Aug 22 09:15:38 juju-e4d256-prod-github-runner-207 kernel: [13912.608800] do_syscall_64+0x5c/0xc0 Aug 22 09:15:38 juju-e4d256-prod-github-runner-207 kernel: [13912.609493] ? do_futex+0x162/0x1f0 Aug 22 09:15:38 juju-e4d256-prod-github-runner-207 kernel: [13912.610314] ? __x64_sys_futex+0x78/0x1e0 Aug 22 09:15:38 juju-e4d256-prod-github-runner-207 kernel: [13912.611048] ? __secure_computing+0xa9/0x120 Aug 22 09:15:38 juju-e4d256-prod-github-runner-207 kernel: [13912.611738] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 09:15:38 juju-e4d256-prod-github-runner-207 kernel: [13912.612521] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:15:38 juju-e4d256-prod-github-runner-207 kernel: [13912.613252] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:15:38 juju-e4d256-prod-github-runner-207 kernel: [13912.614029] ? do_syscall_64+0x69/0xc0 Aug 22 09:15:38 juju-e4d256-prod-github-runner-207 kernel: [13912.614838] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:15:38 juju-e4d256-prod-github-runner-207 kernel: [13912.615549] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:15:38 juju-e4d256-prod-github-runner-207 kernel: [13912.616250] ? do_syscall_64+0x69/0xc0 Aug 22 09:15:38 juju-e4d256-prod-github-runner-207 kernel: [13912.616876] ? do_syscall_64+0x69/0xc0 Aug 22 09:15:38 juju-e4d256-prod-github-runner-207 kernel: [13912.617522] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 09:15:38 juju-e4d256-prod-github-runner-207 kernel: [13912.618255] RIP: 0033:0x7faa5d0edaff Aug 22 09:15:38 juju-e4d256-prod-github-runner-207 kernel: [13912.618941] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 09:15:38 juju-e4d256-prod-github-runner-207 kernel: [13912.621042] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 09:15:38 juju-e4d256-prod-github-runner-207 kernel: [13912.621977] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 09:15:38 juju-e4d256-prod-github-runner-207 kernel: [13912.622874] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 09:15:38 juju-e4d256-prod-github-runner-207 kernel: [13912.623767] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 09:15:38 juju-e4d256-prod-github-runner-207 kernel: [13912.624662] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 09:15:38 juju-e4d256-prod-github-runner-207 kernel: [13912.625593] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 09:15:38 juju-e4d256-prod-github-runner-207 kernel: [13912.626511] Aug 22 09:16:06 juju-e4d256-prod-github-runner-207 kernel: [13940.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 12875s! [qemu-system-x86:6715] Aug 22 09:16:06 juju-e4d256-prod-github-runner-207 kernel: [13940.543107] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 09:16:06 juju-e4d256-prod-github-runner-207 kernel: [13940.543181] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 09:16:06 juju-e4d256-prod-github-runner-207 kernel: [13940.555477] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 09:16:06 juju-e4d256-prod-github-runner-207 kernel: [13940.556770] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 09:16:06 juju-e4d256-prod-github-runner-207 kernel: [13940.558032] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:16:06 juju-e4d256-prod-github-runner-207 kernel: [13940.559095] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 09:16:06 juju-e4d256-prod-github-runner-207 kernel: [13940.561679] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 09:16:06 juju-e4d256-prod-github-runner-207 kernel: [13940.562734] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 09:16:06 juju-e4d256-prod-github-runner-207 kernel: [13940.563897] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 09:16:06 juju-e4d256-prod-github-runner-207 kernel: [13940.565059] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 09:16:06 juju-e4d256-prod-github-runner-207 kernel: [13940.566248] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 09:16:06 juju-e4d256-prod-github-runner-207 kernel: [13940.567418] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 09:16:06 juju-e4d256-prod-github-runner-207 kernel: [13940.568615] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 09:16:06 juju-e4d256-prod-github-runner-207 kernel: [13940.569877] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 09:16:06 juju-e4d256-prod-github-runner-207 kernel: [13940.570994] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 09:16:06 juju-e4d256-prod-github-runner-207 kernel: [13940.572224] Call Trace: Aug 22 09:16:06 juju-e4d256-prod-github-runner-207 kernel: [13940.573148] Aug 22 09:16:06 juju-e4d256-prod-github-runner-207 kernel: [13940.574060] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:16:06 juju-e4d256-prod-github-runner-207 kernel: [13940.575105] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:16:06 juju-e4d256-prod-github-runner-207 kernel: [13940.576145] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:16:06 juju-e4d256-prod-github-runner-207 kernel: [13940.577236] ? show_regs.part.0+0x23/0x29 Aug 22 09:16:06 juju-e4d256-prod-github-runner-207 kernel: [13940.578251] ? show_regs.cold+0x8/0xd Aug 22 09:16:06 juju-e4d256-prod-github-runner-207 kernel: [13940.579269] ? watchdog_timer_fn+0x1be/0x220 Aug 22 09:16:06 juju-e4d256-prod-github-runner-207 kernel: [13940.580294] ? lockup_detector_update_enable+0x60/0x60 Aug 22 09:16:06 juju-e4d256-prod-github-runner-207 kernel: [13940.581369] ? __hrtimer_run_queues+0x107/0x230 Aug 22 09:16:06 juju-e4d256-prod-github-runner-207 kernel: [13940.582489] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 09:16:06 juju-e4d256-prod-github-runner-207 kernel: [13940.583523] ? hrtimer_interrupt+0x101/0x220 Aug 22 09:16:06 juju-e4d256-prod-github-runner-207 kernel: [13940.584550] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 09:16:06 juju-e4d256-prod-github-runner-207 kernel: [13940.585640] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 09:16:06 juju-e4d256-prod-github-runner-207 kernel: [13940.586705] Aug 22 09:16:06 juju-e4d256-prod-github-runner-207 kernel: [13940.587563] Aug 22 09:16:06 juju-e4d256-prod-github-runner-207 kernel: [13940.588401] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 09:16:06 juju-e4d256-prod-github-runner-207 kernel: [13940.589463] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:16:06 juju-e4d256-prod-github-runner-207 kernel: [13940.590552] ? _raw_spin_lock+0x22/0x30 Aug 22 09:16:06 juju-e4d256-prod-github-runner-207 kernel: [13940.591528] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:16:06 juju-e4d256-prod-github-runner-207 kernel: [13940.592552] direct_page_fault+0x206/0x310 [kvm] Aug 22 09:16:06 juju-e4d256-prod-github-runner-207 kernel: [13940.593624] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 09:16:06 juju-e4d256-prod-github-runner-207 kernel: [13940.594652] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 09:16:06 juju-e4d256-prod-github-runner-207 kernel: [13940.595662] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 09:16:06 juju-e4d256-prod-github-runner-207 kernel: [13940.596639] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 09:16:06 juju-e4d256-prod-github-runner-207 kernel: [13940.597613] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 09:16:06 juju-e4d256-prod-github-runner-207 kernel: [13940.598587] handle_exit+0x98/0x230 [kvm_amd] Aug 22 09:16:06 juju-e4d256-prod-github-runner-207 kernel: [13940.599529] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 09:16:06 juju-e4d256-prod-github-runner-207 kernel: [13940.600457] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 09:16:06 juju-e4d256-prod-github-runner-207 kernel: [13940.601385] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 09:16:06 juju-e4d256-prod-github-runner-207 kernel: [13940.602317] vcpu_run+0x62/0x2c0 [kvm] Aug 22 09:16:06 juju-e4d256-prod-github-runner-207 kernel: [13940.603140] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 09:16:06 juju-e4d256-prod-github-runner-207 kernel: [13940.603993] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 09:16:06 juju-e4d256-prod-github-runner-207 kernel: [13940.604898] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 09:16:06 juju-e4d256-prod-github-runner-207 kernel: [13940.605727] ? __seccomp_filter+0x4a/0x4a0 Aug 22 09:16:06 juju-e4d256-prod-github-runner-207 kernel: [13940.606470] ? __fget_files+0x86/0xc0 Aug 22 09:16:06 juju-e4d256-prod-github-runner-207 kernel: [13940.607180] __x64_sys_ioctl+0x95/0xd0 Aug 22 09:16:06 juju-e4d256-prod-github-runner-207 kernel: [13940.607876] do_syscall_64+0x5c/0xc0 Aug 22 09:16:06 juju-e4d256-prod-github-runner-207 kernel: [13940.608580] ? do_futex+0x162/0x1f0 Aug 22 09:16:06 juju-e4d256-prod-github-runner-207 kernel: [13940.609234] ? __x64_sys_futex+0x78/0x1e0 Aug 22 09:16:06 juju-e4d256-prod-github-runner-207 kernel: [13940.609939] ? __secure_computing+0xa9/0x120 Aug 22 09:16:06 juju-e4d256-prod-github-runner-207 kernel: [13940.610649] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 09:16:06 juju-e4d256-prod-github-runner-207 kernel: [13940.611432] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:16:06 juju-e4d256-prod-github-runner-207 kernel: [13940.612151] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:16:06 juju-e4d256-prod-github-runner-207 kernel: [13940.612877] ? do_syscall_64+0x69/0xc0 Aug 22 09:16:06 juju-e4d256-prod-github-runner-207 kernel: [13940.613540] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:16:06 juju-e4d256-prod-github-runner-207 kernel: [13940.614247] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:16:06 juju-e4d256-prod-github-runner-207 kernel: [13940.614946] ? do_syscall_64+0x69/0xc0 Aug 22 09:16:06 juju-e4d256-prod-github-runner-207 kernel: [13940.615585] ? do_syscall_64+0x69/0xc0 Aug 22 09:16:06 juju-e4d256-prod-github-runner-207 kernel: [13940.616213] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 09:16:06 juju-e4d256-prod-github-runner-207 kernel: [13940.616940] RIP: 0033:0x7faa5d0edaff Aug 22 09:16:06 juju-e4d256-prod-github-runner-207 kernel: [13940.617599] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 09:16:06 juju-e4d256-prod-github-runner-207 kernel: [13940.619611] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 09:16:06 juju-e4d256-prod-github-runner-207 kernel: [13940.620565] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 09:16:06 juju-e4d256-prod-github-runner-207 kernel: [13940.621501] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 09:16:06 juju-e4d256-prod-github-runner-207 kernel: [13940.622414] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 09:16:06 juju-e4d256-prod-github-runner-207 kernel: [13940.623308] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 09:16:06 juju-e4d256-prod-github-runner-207 kernel: [13940.624219] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 09:16:06 juju-e4d256-prod-github-runner-207 kernel: [13940.625122] Aug 22 09:16:34 juju-e4d256-prod-github-runner-207 kernel: [13968.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 12901s! [qemu-system-x86:6715] Aug 22 09:16:34 juju-e4d256-prod-github-runner-207 kernel: [13968.543105] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 09:16:34 juju-e4d256-prod-github-runner-207 kernel: [13968.543180] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 09:16:34 juju-e4d256-prod-github-runner-207 kernel: [13968.555341] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 09:16:34 juju-e4d256-prod-github-runner-207 kernel: [13968.556625] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 09:16:34 juju-e4d256-prod-github-runner-207 kernel: [13968.557864] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:16:34 juju-e4d256-prod-github-runner-207 kernel: [13968.558927] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 09:16:34 juju-e4d256-prod-github-runner-207 kernel: [13968.561506] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 09:16:34 juju-e4d256-prod-github-runner-207 kernel: [13968.562546] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 09:16:34 juju-e4d256-prod-github-runner-207 kernel: [13968.563769] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 09:16:34 juju-e4d256-prod-github-runner-207 kernel: [13968.564960] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 09:16:34 juju-e4d256-prod-github-runner-207 kernel: [13968.566157] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 09:16:34 juju-e4d256-prod-github-runner-207 kernel: [13968.567320] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 09:16:34 juju-e4d256-prod-github-runner-207 kernel: [13968.568487] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 09:16:34 juju-e4d256-prod-github-runner-207 kernel: [13968.569774] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 09:16:34 juju-e4d256-prod-github-runner-207 kernel: [13968.570883] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 09:16:34 juju-e4d256-prod-github-runner-207 kernel: [13968.572081] Call Trace: Aug 22 09:16:34 juju-e4d256-prod-github-runner-207 kernel: [13968.572995] Aug 22 09:16:34 juju-e4d256-prod-github-runner-207 kernel: [13968.573900] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:16:34 juju-e4d256-prod-github-runner-207 kernel: [13968.574932] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:16:34 juju-e4d256-prod-github-runner-207 kernel: [13968.575953] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:16:34 juju-e4d256-prod-github-runner-207 kernel: [13968.577029] ? show_regs.part.0+0x23/0x29 Aug 22 09:16:34 juju-e4d256-prod-github-runner-207 kernel: [13968.578048] ? show_regs.cold+0x8/0xd Aug 22 09:16:34 juju-e4d256-prod-github-runner-207 kernel: [13968.579025] ? watchdog_timer_fn+0x1be/0x220 Aug 22 09:16:34 juju-e4d256-prod-github-runner-207 kernel: [13968.580037] ? lockup_detector_update_enable+0x60/0x60 Aug 22 09:16:34 juju-e4d256-prod-github-runner-207 kernel: [13968.581147] ? __hrtimer_run_queues+0x107/0x230 Aug 22 09:16:34 juju-e4d256-prod-github-runner-207 kernel: [13968.582210] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 09:16:34 juju-e4d256-prod-github-runner-207 kernel: [13968.583241] ? hrtimer_interrupt+0x101/0x220 Aug 22 09:16:34 juju-e4d256-prod-github-runner-207 kernel: [13968.584259] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 09:16:34 juju-e4d256-prod-github-runner-207 kernel: [13968.585354] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 09:16:34 juju-e4d256-prod-github-runner-207 kernel: [13968.586418] Aug 22 09:16:34 juju-e4d256-prod-github-runner-207 kernel: [13968.587287] Aug 22 09:16:34 juju-e4d256-prod-github-runner-207 kernel: [13968.588126] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 09:16:34 juju-e4d256-prod-github-runner-207 kernel: [13968.589166] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:16:34 juju-e4d256-prod-github-runner-207 kernel: [13968.590232] ? _raw_spin_lock+0x22/0x30 Aug 22 09:16:34 juju-e4d256-prod-github-runner-207 kernel: [13968.591183] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:16:34 juju-e4d256-prod-github-runner-207 kernel: [13968.592203] direct_page_fault+0x206/0x310 [kvm] Aug 22 09:16:34 juju-e4d256-prod-github-runner-207 kernel: [13968.593244] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 09:16:34 juju-e4d256-prod-github-runner-207 kernel: [13968.594255] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 09:16:34 juju-e4d256-prod-github-runner-207 kernel: [13968.595258] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 09:16:34 juju-e4d256-prod-github-runner-207 kernel: [13968.596232] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 09:16:34 juju-e4d256-prod-github-runner-207 kernel: [13968.597200] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 09:16:34 juju-e4d256-prod-github-runner-207 kernel: [13968.598184] handle_exit+0x98/0x230 [kvm_amd] Aug 22 09:16:34 juju-e4d256-prod-github-runner-207 kernel: [13968.599079] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 09:16:34 juju-e4d256-prod-github-runner-207 kernel: [13968.599989] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 09:16:34 juju-e4d256-prod-github-runner-207 kernel: [13968.600909] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 09:16:34 juju-e4d256-prod-github-runner-207 kernel: [13968.601823] vcpu_run+0x62/0x2c0 [kvm] Aug 22 09:16:34 juju-e4d256-prod-github-runner-207 kernel: [13968.602639] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 09:16:34 juju-e4d256-prod-github-runner-207 kernel: [13968.603444] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 09:16:34 juju-e4d256-prod-github-runner-207 kernel: [13968.604369] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 09:16:34 juju-e4d256-prod-github-runner-207 kernel: [13968.605251] ? __seccomp_filter+0x4a/0x4a0 Aug 22 09:16:34 juju-e4d256-prod-github-runner-207 kernel: [13968.606024] ? __fget_files+0x86/0xc0 Aug 22 09:16:34 juju-e4d256-prod-github-runner-207 kernel: [13968.606757] __x64_sys_ioctl+0x95/0xd0 Aug 22 09:16:34 juju-e4d256-prod-github-runner-207 kernel: [13968.607464] do_syscall_64+0x5c/0xc0 Aug 22 09:16:34 juju-e4d256-prod-github-runner-207 kernel: [13968.608148] ? do_futex+0x162/0x1f0 Aug 22 09:16:34 juju-e4d256-prod-github-runner-207 kernel: [13968.608799] ? __x64_sys_futex+0x78/0x1e0 Aug 22 09:16:34 juju-e4d256-prod-github-runner-207 kernel: [13968.609555] ? __secure_computing+0xa9/0x120 Aug 22 09:16:34 juju-e4d256-prod-github-runner-207 kernel: [13968.610281] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 09:16:34 juju-e4d256-prod-github-runner-207 kernel: [13968.611063] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:16:34 juju-e4d256-prod-github-runner-207 kernel: [13968.611831] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:16:34 juju-e4d256-prod-github-runner-207 kernel: [13968.612580] ? do_syscall_64+0x69/0xc0 Aug 22 09:16:34 juju-e4d256-prod-github-runner-207 kernel: [13968.613252] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:16:34 juju-e4d256-prod-github-runner-207 kernel: [13968.613973] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:16:34 juju-e4d256-prod-github-runner-207 kernel: [13968.614677] ? do_syscall_64+0x69/0xc0 Aug 22 09:16:34 juju-e4d256-prod-github-runner-207 kernel: [13968.615302] ? do_syscall_64+0x69/0xc0 Aug 22 09:16:34 juju-e4d256-prod-github-runner-207 kernel: [13968.615934] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 09:16:34 juju-e4d256-prod-github-runner-207 kernel: [13968.616657] RIP: 0033:0x7faa5d0edaff Aug 22 09:16:34 juju-e4d256-prod-github-runner-207 kernel: [13968.617321] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 09:16:34 juju-e4d256-prod-github-runner-207 kernel: [13968.619315] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 09:16:34 juju-e4d256-prod-github-runner-207 kernel: [13968.620223] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 09:16:34 juju-e4d256-prod-github-runner-207 kernel: [13968.621115] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 09:16:34 juju-e4d256-prod-github-runner-207 kernel: [13968.622017] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 09:16:34 juju-e4d256-prod-github-runner-207 kernel: [13968.622901] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 09:16:34 juju-e4d256-prod-github-runner-207 kernel: [13968.623795] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 09:16:34 juju-e4d256-prod-github-runner-207 kernel: [13968.624688] Aug 22 09:17:02 juju-e4d256-prod-github-runner-207 kernel: [13996.541983] watchdog: BUG: soft lockup - CPU#1 stuck for 12927s! [qemu-system-x86:6715] Aug 22 09:17:02 juju-e4d256-prod-github-runner-207 kernel: [13996.544109] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 09:17:02 juju-e4d256-prod-github-runner-207 kernel: [13996.544396] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 09:17:02 juju-e4d256-prod-github-runner-207 kernel: [13996.557307] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 09:17:02 juju-e4d256-prod-github-runner-207 kernel: [13996.558630] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 09:17:02 juju-e4d256-prod-github-runner-207 kernel: [13996.559891] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:17:02 juju-e4d256-prod-github-runner-207 kernel: [13996.561015] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 09:17:02 juju-e4d256-prod-github-runner-207 kernel: [13996.563937] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 09:17:02 juju-e4d256-prod-github-runner-207 kernel: [13996.565035] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 09:17:02 juju-e4d256-prod-github-runner-207 kernel: [13996.566229] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 09:17:02 juju-e4d256-prod-github-runner-207 kernel: [13996.567454] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 09:17:02 juju-e4d256-prod-github-runner-207 kernel: [13996.568655] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 09:17:02 juju-e4d256-prod-github-runner-207 kernel: [13996.569864] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 09:17:02 juju-e4d256-prod-github-runner-207 kernel: [13996.571036] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 09:17:02 juju-e4d256-prod-github-runner-207 kernel: [13996.572285] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 09:17:02 juju-e4d256-prod-github-runner-207 kernel: [13996.573414] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 09:17:02 juju-e4d256-prod-github-runner-207 kernel: [13996.574618] Call Trace: Aug 22 09:17:02 juju-e4d256-prod-github-runner-207 kernel: [13996.575537] Aug 22 09:17:02 juju-e4d256-prod-github-runner-207 kernel: [13996.576446] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:17:02 juju-e4d256-prod-github-runner-207 kernel: [13996.577497] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:17:02 juju-e4d256-prod-github-runner-207 kernel: [13996.578556] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:17:02 juju-e4d256-prod-github-runner-207 kernel: [13996.579671] ? show_regs.part.0+0x23/0x29 Aug 22 09:17:02 juju-e4d256-prod-github-runner-207 kernel: [13996.580669] ? show_regs.cold+0x8/0xd Aug 22 09:17:02 juju-e4d256-prod-github-runner-207 kernel: [13996.581672] ? watchdog_timer_fn+0x1be/0x220 Aug 22 09:17:02 juju-e4d256-prod-github-runner-207 kernel: [13996.582683] ? lockup_detector_update_enable+0x60/0x60 Aug 22 09:17:02 juju-e4d256-prod-github-runner-207 kernel: [13996.583744] ? __hrtimer_run_queues+0x107/0x230 Aug 22 09:17:02 juju-e4d256-prod-github-runner-207 kernel: [13996.584771] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 09:17:02 juju-e4d256-prod-github-runner-207 kernel: [13996.585813] ? hrtimer_interrupt+0x101/0x220 Aug 22 09:17:02 juju-e4d256-prod-github-runner-207 kernel: [13996.586829] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 09:17:02 juju-e4d256-prod-github-runner-207 kernel: [13996.587907] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 09:17:02 juju-e4d256-prod-github-runner-207 kernel: [13996.589084] Aug 22 09:17:02 juju-e4d256-prod-github-runner-207 kernel: [13996.590166] Aug 22 09:17:02 juju-e4d256-prod-github-runner-207 kernel: [13996.591314] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 09:17:02 juju-e4d256-prod-github-runner-207 kernel: [13996.592667] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:17:02 juju-e4d256-prod-github-runner-207 kernel: [13996.594045] ? _raw_spin_lock+0x22/0x30 Aug 22 09:17:02 juju-e4d256-prod-github-runner-207 kernel: [13996.595295] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:17:02 juju-e4d256-prod-github-runner-207 kernel: [13996.596621] direct_page_fault+0x206/0x310 [kvm] Aug 22 09:17:02 juju-e4d256-prod-github-runner-207 kernel: [13996.597904] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 09:17:02 juju-e4d256-prod-github-runner-207 kernel: [13996.598949] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 09:17:02 juju-e4d256-prod-github-runner-207 kernel: [13996.599960] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 09:17:02 juju-e4d256-prod-github-runner-207 kernel: [13996.601019] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 09:17:02 juju-e4d256-prod-github-runner-207 kernel: [13996.601981] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 09:17:02 juju-e4d256-prod-github-runner-207 kernel: [13996.603026] handle_exit+0x98/0x230 [kvm_amd] Aug 22 09:17:02 juju-e4d256-prod-github-runner-207 kernel: [13996.603956] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 09:17:02 juju-e4d256-prod-github-runner-207 kernel: [13996.604939] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 09:17:02 juju-e4d256-prod-github-runner-207 kernel: [13996.605882] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 09:17:02 juju-e4d256-prod-github-runner-207 kernel: [13996.606799] vcpu_run+0x62/0x2c0 [kvm] Aug 22 09:17:02 juju-e4d256-prod-github-runner-207 kernel: [13996.607614] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 09:17:02 juju-e4d256-prod-github-runner-207 kernel: [13996.608443] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 09:17:02 juju-e4d256-prod-github-runner-207 kernel: [13996.609356] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 09:17:02 juju-e4d256-prod-github-runner-207 kernel: [13996.610164] ? __seccomp_filter+0x4a/0x4a0 Aug 22 09:17:02 juju-e4d256-prod-github-runner-207 kernel: [13996.610916] ? __fget_files+0x86/0xc0 Aug 22 09:17:02 juju-e4d256-prod-github-runner-207 kernel: [13996.611792] __x64_sys_ioctl+0x95/0xd0 Aug 22 09:17:02 juju-e4d256-prod-github-runner-207 kernel: [13996.612516] do_syscall_64+0x5c/0xc0 Aug 22 09:17:02 juju-e4d256-prod-github-runner-207 kernel: [13996.613205] ? do_futex+0x162/0x1f0 Aug 22 09:17:02 juju-e4d256-prod-github-runner-207 kernel: [13996.613881] ? __x64_sys_futex+0x78/0x1e0 Aug 22 09:17:02 juju-e4d256-prod-github-runner-207 kernel: [13996.614562] ? __secure_computing+0xa9/0x120 Aug 22 09:17:02 juju-e4d256-prod-github-runner-207 kernel: [13996.615252] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 09:17:02 juju-e4d256-prod-github-runner-207 kernel: [13996.616013] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:17:02 juju-e4d256-prod-github-runner-207 kernel: [13996.616736] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:17:02 juju-e4d256-prod-github-runner-207 kernel: [13996.617496] ? do_syscall_64+0x69/0xc0 Aug 22 09:17:02 juju-e4d256-prod-github-runner-207 kernel: [13996.618156] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:17:02 juju-e4d256-prod-github-runner-207 kernel: [13996.618889] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:17:02 juju-e4d256-prod-github-runner-207 kernel: [13996.619598] ? do_syscall_64+0x69/0xc0 Aug 22 09:17:02 juju-e4d256-prod-github-runner-207 kernel: [13996.620226] ? do_syscall_64+0x69/0xc0 Aug 22 09:17:02 juju-e4d256-prod-github-runner-207 kernel: [13996.620873] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 09:17:02 juju-e4d256-prod-github-runner-207 kernel: [13996.621581] RIP: 0033:0x7faa5d0edaff Aug 22 09:17:02 juju-e4d256-prod-github-runner-207 kernel: [13996.622243] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 09:17:02 juju-e4d256-prod-github-runner-207 kernel: [13996.624249] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 09:17:02 juju-e4d256-prod-github-runner-207 kernel: [13996.625184] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 09:17:02 juju-e4d256-prod-github-runner-207 kernel: [13996.626086] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 09:17:02 juju-e4d256-prod-github-runner-207 kernel: [13996.626978] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 09:17:02 juju-e4d256-prod-github-runner-207 kernel: [13996.627868] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 09:17:02 juju-e4d256-prod-github-runner-207 kernel: [13996.628765] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 09:17:02 juju-e4d256-prod-github-runner-207 kernel: [13996.629724] Aug 22 09:17:30 juju-e4d256-prod-github-runner-207 kernel: [14024.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 12953s! [qemu-system-x86:6715] Aug 22 09:17:30 juju-e4d256-prod-github-runner-207 kernel: [14024.543104] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 09:17:30 juju-e4d256-prod-github-runner-207 kernel: [14024.543179] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 09:17:30 juju-e4d256-prod-github-runner-207 kernel: [14024.555404] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 09:17:30 juju-e4d256-prod-github-runner-207 kernel: [14024.556772] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 09:17:30 juju-e4d256-prod-github-runner-207 kernel: [14024.558030] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:17:30 juju-e4d256-prod-github-runner-207 kernel: [14024.559085] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 09:17:30 juju-e4d256-prod-github-runner-207 kernel: [14024.561644] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 09:17:30 juju-e4d256-prod-github-runner-207 kernel: [14024.562692] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 09:17:30 juju-e4d256-prod-github-runner-207 kernel: [14024.563864] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 09:17:30 juju-e4d256-prod-github-runner-207 kernel: [14024.565049] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 09:17:30 juju-e4d256-prod-github-runner-207 kernel: [14024.566213] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 09:17:30 juju-e4d256-prod-github-runner-207 kernel: [14024.567375] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 09:17:30 juju-e4d256-prod-github-runner-207 kernel: [14024.568552] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 09:17:30 juju-e4d256-prod-github-runner-207 kernel: [14024.569896] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 09:17:30 juju-e4d256-prod-github-runner-207 kernel: [14024.571101] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 09:17:30 juju-e4d256-prod-github-runner-207 kernel: [14024.572299] Call Trace: Aug 22 09:17:30 juju-e4d256-prod-github-runner-207 kernel: [14024.573224] Aug 22 09:17:30 juju-e4d256-prod-github-runner-207 kernel: [14024.574114] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:17:30 juju-e4d256-prod-github-runner-207 kernel: [14024.575149] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:17:30 juju-e4d256-prod-github-runner-207 kernel: [14024.576173] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:17:30 juju-e4d256-prod-github-runner-207 kernel: [14024.577265] ? show_regs.part.0+0x23/0x29 Aug 22 09:17:30 juju-e4d256-prod-github-runner-207 kernel: [14024.578270] ? show_regs.cold+0x8/0xd Aug 22 09:17:30 juju-e4d256-prod-github-runner-207 kernel: [14024.579241] ? watchdog_timer_fn+0x1be/0x220 Aug 22 09:17:30 juju-e4d256-prod-github-runner-207 kernel: [14024.580254] ? lockup_detector_update_enable+0x60/0x60 Aug 22 09:17:30 juju-e4d256-prod-github-runner-207 kernel: [14024.581330] ? __hrtimer_run_queues+0x107/0x230 Aug 22 09:17:30 juju-e4d256-prod-github-runner-207 kernel: [14024.582359] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 09:17:30 juju-e4d256-prod-github-runner-207 kernel: [14024.583387] ? hrtimer_interrupt+0x101/0x220 Aug 22 09:17:30 juju-e4d256-prod-github-runner-207 kernel: [14024.584402] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 09:17:30 juju-e4d256-prod-github-runner-207 kernel: [14024.585505] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 09:17:30 juju-e4d256-prod-github-runner-207 kernel: [14024.586550] Aug 22 09:17:30 juju-e4d256-prod-github-runner-207 kernel: [14024.587403] Aug 22 09:17:30 juju-e4d256-prod-github-runner-207 kernel: [14024.588239] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 09:17:30 juju-e4d256-prod-github-runner-207 kernel: [14024.589283] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:17:30 juju-e4d256-prod-github-runner-207 kernel: [14024.590325] ? _raw_spin_lock+0x22/0x30 Aug 22 09:17:30 juju-e4d256-prod-github-runner-207 kernel: [14024.591268] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:17:30 juju-e4d256-prod-github-runner-207 kernel: [14024.592285] direct_page_fault+0x206/0x310 [kvm] Aug 22 09:17:30 juju-e4d256-prod-github-runner-207 kernel: [14024.593324] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 09:17:30 juju-e4d256-prod-github-runner-207 kernel: [14024.594332] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 09:17:30 juju-e4d256-prod-github-runner-207 kernel: [14024.595329] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 09:17:30 juju-e4d256-prod-github-runner-207 kernel: [14024.596303] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 09:17:30 juju-e4d256-prod-github-runner-207 kernel: [14024.597262] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 09:17:30 juju-e4d256-prod-github-runner-207 kernel: [14024.598265] handle_exit+0x98/0x230 [kvm_amd] Aug 22 09:17:30 juju-e4d256-prod-github-runner-207 kernel: [14024.599178] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 09:17:30 juju-e4d256-prod-github-runner-207 kernel: [14024.600148] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 09:17:30 juju-e4d256-prod-github-runner-207 kernel: [14024.601089] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 09:17:30 juju-e4d256-prod-github-runner-207 kernel: [14024.602019] vcpu_run+0x62/0x2c0 [kvm] Aug 22 09:17:30 juju-e4d256-prod-github-runner-207 kernel: [14024.602830] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 09:17:30 juju-e4d256-prod-github-runner-207 kernel: [14024.603637] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 09:17:30 juju-e4d256-prod-github-runner-207 kernel: [14024.604490] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 09:17:30 juju-e4d256-prod-github-runner-207 kernel: [14024.605326] ? __seccomp_filter+0x4a/0x4a0 Aug 22 09:17:30 juju-e4d256-prod-github-runner-207 kernel: [14024.606192] ? __fget_files+0x86/0xc0 Aug 22 09:17:30 juju-e4d256-prod-github-runner-207 kernel: [14024.606900] __x64_sys_ioctl+0x95/0xd0 Aug 22 09:17:30 juju-e4d256-prod-github-runner-207 kernel: [14024.607597] do_syscall_64+0x5c/0xc0 Aug 22 09:17:30 juju-e4d256-prod-github-runner-207 kernel: [14024.608276] ? do_futex+0x162/0x1f0 Aug 22 09:17:30 juju-e4d256-prod-github-runner-207 kernel: [14024.609248] ? __x64_sys_futex+0x78/0x1e0 Aug 22 09:17:30 juju-e4d256-prod-github-runner-207 kernel: [14024.609986] ? __secure_computing+0xa9/0x120 Aug 22 09:17:30 juju-e4d256-prod-github-runner-207 kernel: [14024.610677] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 09:17:30 juju-e4d256-prod-github-runner-207 kernel: [14024.611436] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:17:30 juju-e4d256-prod-github-runner-207 kernel: [14024.612156] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:17:30 juju-e4d256-prod-github-runner-207 kernel: [14024.612885] ? do_syscall_64+0x69/0xc0 Aug 22 09:17:30 juju-e4d256-prod-github-runner-207 kernel: [14024.613535] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:17:30 juju-e4d256-prod-github-runner-207 kernel: [14024.614248] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:17:30 juju-e4d256-prod-github-runner-207 kernel: [14024.614947] ? do_syscall_64+0x69/0xc0 Aug 22 09:17:30 juju-e4d256-prod-github-runner-207 kernel: [14024.615575] ? do_syscall_64+0x69/0xc0 Aug 22 09:17:30 juju-e4d256-prod-github-runner-207 kernel: [14024.616197] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 09:17:30 juju-e4d256-prod-github-runner-207 kernel: [14024.616912] RIP: 0033:0x7faa5d0edaff Aug 22 09:17:30 juju-e4d256-prod-github-runner-207 kernel: [14024.617537] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 09:17:30 juju-e4d256-prod-github-runner-207 kernel: [14024.619672] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 09:17:30 juju-e4d256-prod-github-runner-207 kernel: [14024.620720] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 09:17:30 juju-e4d256-prod-github-runner-207 kernel: [14024.621671] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 09:17:30 juju-e4d256-prod-github-runner-207 kernel: [14024.622609] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 09:17:30 juju-e4d256-prod-github-runner-207 kernel: [14024.623561] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 09:17:30 juju-e4d256-prod-github-runner-207 kernel: [14024.624487] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 09:17:30 juju-e4d256-prod-github-runner-207 kernel: [14024.625432] Aug 22 09:17:44 juju-e4d256-prod-github-runner-207 kernel: [14038.124705] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 09:17:44 juju-e4d256-prod-github-runner-207 kernel: [14038.125665] rcu: 1-....: (3469338 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=1676024 Aug 22 09:17:44 juju-e4d256-prod-github-runner-207 kernel: [14038.126780] (t=3480231 jiffies g=23269 q=21703) Aug 22 09:17:44 juju-e4d256-prod-github-runner-207 kernel: [14038.127558] NMI backtrace for cpu 1 Aug 22 09:17:44 juju-e4d256-prod-github-runner-207 kernel: [14038.128270] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 09:17:44 juju-e4d256-prod-github-runner-207 kernel: [14038.129392] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 09:17:44 juju-e4d256-prod-github-runner-207 kernel: [14038.130444] Call Trace: Aug 22 09:17:44 juju-e4d256-prod-github-runner-207 kernel: [14038.131115] Aug 22 09:17:44 juju-e4d256-prod-github-runner-207 kernel: [14038.131758] show_stack+0x52/0x5c Aug 22 09:17:44 juju-e4d256-prod-github-runner-207 kernel: [14038.132490] dump_stack_lvl+0x4a/0x63 Aug 22 09:17:44 juju-e4d256-prod-github-runner-207 kernel: [14038.133234] dump_stack+0x10/0x16 Aug 22 09:17:44 juju-e4d256-prod-github-runner-207 kernel: [14038.133956] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 09:17:44 juju-e4d256-prod-github-runner-207 kernel: [14038.134733] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 09:17:44 juju-e4d256-prod-github-runner-207 kernel: [14038.135509] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 09:17:44 juju-e4d256-prod-github-runner-207 kernel: [14038.136325] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 09:17:44 juju-e4d256-prod-github-runner-207 kernel: [14038.137152] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 09:17:44 juju-e4d256-prod-github-runner-207 kernel: [14038.137957] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 09:17:44 juju-e4d256-prod-github-runner-207 kernel: [14038.138725] print_cpu_stall.cold+0x2f/0xe2 Aug 22 09:17:44 juju-e4d256-prod-github-runner-207 kernel: [14038.139491] ? timekeeping_update+0xf7/0x150 Aug 22 09:17:44 juju-e4d256-prod-github-runner-207 kernel: [14038.140264] check_cpu_stall+0x109/0x270 Aug 22 09:17:44 juju-e4d256-prod-github-runner-207 kernel: [14038.141123] rcu_sched_clock_irq+0x9a/0x250 Aug 22 09:17:44 juju-e4d256-prod-github-runner-207 kernel: [14038.141972] update_process_times+0x94/0xd0 Aug 22 09:17:44 juju-e4d256-prod-github-runner-207 kernel: [14038.142811] tick_sched_handle+0x29/0x70 Aug 22 09:17:44 juju-e4d256-prod-github-runner-207 kernel: [14038.143631] tick_sched_timer+0x8c/0xc0 Aug 22 09:17:44 juju-e4d256-prod-github-runner-207 kernel: [14038.144465] ? tick_nohz_handler+0xb0/0xb0 Aug 22 09:17:44 juju-e4d256-prod-github-runner-207 kernel: [14038.145303] __hrtimer_run_queues+0x107/0x230 Aug 22 09:17:44 juju-e4d256-prod-github-runner-207 kernel: [14038.146163] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 09:17:44 juju-e4d256-prod-github-runner-207 kernel: [14038.147021] hrtimer_interrupt+0x101/0x220 Aug 22 09:17:44 juju-e4d256-prod-github-runner-207 kernel: [14038.147857] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 09:17:44 juju-e4d256-prod-github-runner-207 kernel: [14038.148789] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 09:17:44 juju-e4d256-prod-github-runner-207 kernel: [14038.149685] Aug 22 09:17:44 juju-e4d256-prod-github-runner-207 kernel: [14038.150375] Aug 22 09:17:44 juju-e4d256-prod-github-runner-207 kernel: [14038.151046] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 09:17:44 juju-e4d256-prod-github-runner-207 kernel: [14038.151966] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:17:44 juju-e4d256-prod-github-runner-207 kernel: [14038.152967] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 09:17:44 juju-e4d256-prod-github-runner-207 kernel: [14038.155491] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 09:17:44 juju-e4d256-prod-github-runner-207 kernel: [14038.156484] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 09:17:44 juju-e4d256-prod-github-runner-207 kernel: [14038.157620] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 09:17:44 juju-e4d256-prod-github-runner-207 kernel: [14038.158727] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 09:17:44 juju-e4d256-prod-github-runner-207 kernel: [14038.159817] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 09:17:44 juju-e4d256-prod-github-runner-207 kernel: [14038.160960] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 09:17:44 juju-e4d256-prod-github-runner-207 kernel: [14038.162044] ? _raw_spin_lock+0x22/0x30 Aug 22 09:17:44 juju-e4d256-prod-github-runner-207 kernel: [14038.162875] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:17:44 juju-e4d256-prod-github-runner-207 kernel: [14038.163812] direct_page_fault+0x206/0x310 [kvm] Aug 22 09:17:44 juju-e4d256-prod-github-runner-207 kernel: [14038.164759] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 09:17:44 juju-e4d256-prod-github-runner-207 kernel: [14038.165673] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 09:17:44 juju-e4d256-prod-github-runner-207 kernel: [14038.166584] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 09:17:44 juju-e4d256-prod-github-runner-207 kernel: [14038.167477] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 09:17:44 juju-e4d256-prod-github-runner-207 kernel: [14038.168354] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 09:17:44 juju-e4d256-prod-github-runner-207 kernel: [14038.169296] handle_exit+0x98/0x230 [kvm_amd] Aug 22 09:17:44 juju-e4d256-prod-github-runner-207 kernel: [14038.170140] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 09:17:44 juju-e4d256-prod-github-runner-207 kernel: [14038.171009] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 09:17:44 juju-e4d256-prod-github-runner-207 kernel: [14038.171917] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 09:17:44 juju-e4d256-prod-github-runner-207 kernel: [14038.172816] vcpu_run+0x62/0x2c0 [kvm] Aug 22 09:17:44 juju-e4d256-prod-github-runner-207 kernel: [14038.173608] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 09:17:44 juju-e4d256-prod-github-runner-207 kernel: [14038.174429] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 09:17:44 juju-e4d256-prod-github-runner-207 kernel: [14038.175323] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 09:17:44 juju-e4d256-prod-github-runner-207 kernel: [14038.176170] ? __seccomp_filter+0x4a/0x4a0 Aug 22 09:17:44 juju-e4d256-prod-github-runner-207 kernel: [14038.176988] ? __fget_files+0x86/0xc0 Aug 22 09:17:44 juju-e4d256-prod-github-runner-207 kernel: [14038.177763] __x64_sys_ioctl+0x95/0xd0 Aug 22 09:17:44 juju-e4d256-prod-github-runner-207 kernel: [14038.178559] do_syscall_64+0x5c/0xc0 Aug 22 09:17:44 juju-e4d256-prod-github-runner-207 kernel: [14038.179311] ? do_futex+0x162/0x1f0 Aug 22 09:17:44 juju-e4d256-prod-github-runner-207 kernel: [14038.180055] ? __x64_sys_futex+0x78/0x1e0 Aug 22 09:17:44 juju-e4d256-prod-github-runner-207 kernel: [14038.180861] ? __secure_computing+0xa9/0x120 Aug 22 09:17:44 juju-e4d256-prod-github-runner-207 kernel: [14038.181667] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 09:17:44 juju-e4d256-prod-github-runner-207 kernel: [14038.182559] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:17:44 juju-e4d256-prod-github-runner-207 kernel: [14038.183407] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:17:44 juju-e4d256-prod-github-runner-207 kernel: [14038.184252] ? do_syscall_64+0x69/0xc0 Aug 22 09:17:44 juju-e4d256-prod-github-runner-207 kernel: [14038.185031] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:17:44 juju-e4d256-prod-github-runner-207 kernel: [14038.185879] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:17:44 juju-e4d256-prod-github-runner-207 kernel: [14038.186728] ? do_syscall_64+0x69/0xc0 Aug 22 09:17:44 juju-e4d256-prod-github-runner-207 kernel: [14038.187497] ? do_syscall_64+0x69/0xc0 Aug 22 09:17:44 juju-e4d256-prod-github-runner-207 kernel: [14038.188264] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 09:17:44 juju-e4d256-prod-github-runner-207 kernel: [14038.189145] RIP: 0033:0x7faa5d0edaff Aug 22 09:17:44 juju-e4d256-prod-github-runner-207 kernel: [14038.189902] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 09:17:44 juju-e4d256-prod-github-runner-207 kernel: [14038.192341] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 09:17:44 juju-e4d256-prod-github-runner-207 kernel: [14038.193461] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 09:17:44 juju-e4d256-prod-github-runner-207 kernel: [14038.194546] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 09:17:44 juju-e4d256-prod-github-runner-207 kernel: [14038.195624] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 09:17:44 juju-e4d256-prod-github-runner-207 kernel: [14038.196725] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 09:17:44 juju-e4d256-prod-github-runner-207 kernel: [14038.197790] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 09:17:44 juju-e4d256-prod-github-runner-207 kernel: [14038.198838] Aug 22 09:18:10 juju-e4d256-prod-github-runner-207 kernel: [14064.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 12990s! [qemu-system-x86:6715] Aug 22 09:18:10 juju-e4d256-prod-github-runner-207 kernel: [14064.543128] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 09:18:10 juju-e4d256-prod-github-runner-207 kernel: [14064.543203] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 09:18:10 juju-e4d256-prod-github-runner-207 kernel: [14064.555682] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 09:18:10 juju-e4d256-prod-github-runner-207 kernel: [14064.556984] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 09:18:10 juju-e4d256-prod-github-runner-207 kernel: [14064.558226] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:18:10 juju-e4d256-prod-github-runner-207 kernel: [14064.559312] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 09:18:10 juju-e4d256-prod-github-runner-207 kernel: [14064.561897] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 09:18:10 juju-e4d256-prod-github-runner-207 kernel: [14064.562946] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 09:18:10 juju-e4d256-prod-github-runner-207 kernel: [14064.564129] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 09:18:10 juju-e4d256-prod-github-runner-207 kernel: [14064.565328] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 09:18:10 juju-e4d256-prod-github-runner-207 kernel: [14064.566513] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 09:18:10 juju-e4d256-prod-github-runner-207 kernel: [14064.567691] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 09:18:10 juju-e4d256-prod-github-runner-207 kernel: [14064.568886] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 09:18:10 juju-e4d256-prod-github-runner-207 kernel: [14064.570181] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 09:18:10 juju-e4d256-prod-github-runner-207 kernel: [14064.571315] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 09:18:10 juju-e4d256-prod-github-runner-207 kernel: [14064.572560] Call Trace: Aug 22 09:18:10 juju-e4d256-prod-github-runner-207 kernel: [14064.573502] Aug 22 09:18:10 juju-e4d256-prod-github-runner-207 kernel: [14064.574430] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:18:10 juju-e4d256-prod-github-runner-207 kernel: [14064.575477] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:18:10 juju-e4d256-prod-github-runner-207 kernel: [14064.576579] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:18:10 juju-e4d256-prod-github-runner-207 kernel: [14064.577673] ? show_regs.part.0+0x23/0x29 Aug 22 09:18:10 juju-e4d256-prod-github-runner-207 kernel: [14064.578681] ? show_regs.cold+0x8/0xd Aug 22 09:18:10 juju-e4d256-prod-github-runner-207 kernel: [14064.579664] ? watchdog_timer_fn+0x1be/0x220 Aug 22 09:18:10 juju-e4d256-prod-github-runner-207 kernel: [14064.580714] ? lockup_detector_update_enable+0x60/0x60 Aug 22 09:18:10 juju-e4d256-prod-github-runner-207 kernel: [14064.581823] ? __hrtimer_run_queues+0x107/0x230 Aug 22 09:18:10 juju-e4d256-prod-github-runner-207 kernel: [14064.582864] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 09:18:10 juju-e4d256-prod-github-runner-207 kernel: [14064.583900] ? hrtimer_interrupt+0x101/0x220 Aug 22 09:18:10 juju-e4d256-prod-github-runner-207 kernel: [14064.584943] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 09:18:10 juju-e4d256-prod-github-runner-207 kernel: [14064.586029] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 09:18:10 juju-e4d256-prod-github-runner-207 kernel: [14064.587090] Aug 22 09:18:10 juju-e4d256-prod-github-runner-207 kernel: [14064.587951] Aug 22 09:18:10 juju-e4d256-prod-github-runner-207 kernel: [14064.588805] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 09:18:10 juju-e4d256-prod-github-runner-207 kernel: [14064.589851] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:18:10 juju-e4d256-prod-github-runner-207 kernel: [14064.590908] ? _raw_spin_lock+0x22/0x30 Aug 22 09:18:10 juju-e4d256-prod-github-runner-207 kernel: [14064.591874] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:18:10 juju-e4d256-prod-github-runner-207 kernel: [14064.592953] direct_page_fault+0x206/0x310 [kvm] Aug 22 09:18:10 juju-e4d256-prod-github-runner-207 kernel: [14064.594016] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 09:18:10 juju-e4d256-prod-github-runner-207 kernel: [14064.595057] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 09:18:10 juju-e4d256-prod-github-runner-207 kernel: [14064.596094] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 09:18:10 juju-e4d256-prod-github-runner-207 kernel: [14064.597087] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 09:18:10 juju-e4d256-prod-github-runner-207 kernel: [14064.598043] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 09:18:10 juju-e4d256-prod-github-runner-207 kernel: [14064.599036] handle_exit+0x98/0x230 [kvm_amd] Aug 22 09:18:10 juju-e4d256-prod-github-runner-207 kernel: [14064.599935] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 09:18:10 juju-e4d256-prod-github-runner-207 kernel: [14064.600888] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 09:18:10 juju-e4d256-prod-github-runner-207 kernel: [14064.601849] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 09:18:10 juju-e4d256-prod-github-runner-207 kernel: [14064.602774] vcpu_run+0x62/0x2c0 [kvm] Aug 22 09:18:10 juju-e4d256-prod-github-runner-207 kernel: [14064.603640] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 09:18:10 juju-e4d256-prod-github-runner-207 kernel: [14064.604659] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 09:18:10 juju-e4d256-prod-github-runner-207 kernel: [14064.605534] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 09:18:10 juju-e4d256-prod-github-runner-207 kernel: [14064.606348] ? __seccomp_filter+0x4a/0x4a0 Aug 22 09:18:10 juju-e4d256-prod-github-runner-207 kernel: [14064.607106] ? __fget_files+0x86/0xc0 Aug 22 09:18:10 juju-e4d256-prod-github-runner-207 kernel: [14064.607831] __x64_sys_ioctl+0x95/0xd0 Aug 22 09:18:10 juju-e4d256-prod-github-runner-207 kernel: [14064.608562] do_syscall_64+0x5c/0xc0 Aug 22 09:18:10 juju-e4d256-prod-github-runner-207 kernel: [14064.609249] ? do_futex+0x162/0x1f0 Aug 22 09:18:10 juju-e4d256-prod-github-runner-207 kernel: [14064.609913] ? __x64_sys_futex+0x78/0x1e0 Aug 22 09:18:10 juju-e4d256-prod-github-runner-207 kernel: [14064.610598] ? __secure_computing+0xa9/0x120 Aug 22 09:18:10 juju-e4d256-prod-github-runner-207 kernel: [14064.611301] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 09:18:10 juju-e4d256-prod-github-runner-207 kernel: [14064.612186] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:18:10 juju-e4d256-prod-github-runner-207 kernel: [14064.612927] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:18:10 juju-e4d256-prod-github-runner-207 kernel: [14064.613758] ? do_syscall_64+0x69/0xc0 Aug 22 09:18:10 juju-e4d256-prod-github-runner-207 kernel: [14064.614427] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:18:10 juju-e4d256-prod-github-runner-207 kernel: [14064.615154] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:18:10 juju-e4d256-prod-github-runner-207 kernel: [14064.615893] ? do_syscall_64+0x69/0xc0 Aug 22 09:18:10 juju-e4d256-prod-github-runner-207 kernel: [14064.616589] ? do_syscall_64+0x69/0xc0 Aug 22 09:18:10 juju-e4d256-prod-github-runner-207 kernel: [14064.617225] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 09:18:10 juju-e4d256-prod-github-runner-207 kernel: [14064.617941] RIP: 0033:0x7faa5d0edaff Aug 22 09:18:10 juju-e4d256-prod-github-runner-207 kernel: [14064.618576] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 09:18:10 juju-e4d256-prod-github-runner-207 kernel: [14064.620616] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 09:18:10 juju-e4d256-prod-github-runner-207 kernel: [14064.621581] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 09:18:10 juju-e4d256-prod-github-runner-207 kernel: [14064.622490] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 09:18:10 juju-e4d256-prod-github-runner-207 kernel: [14064.623431] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 09:18:10 juju-e4d256-prod-github-runner-207 kernel: [14064.624431] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 09:18:10 juju-e4d256-prod-github-runner-207 kernel: [14064.625461] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 09:18:10 juju-e4d256-prod-github-runner-207 kernel: [14064.626398] Aug 22 09:18:38 juju-e4d256-prod-github-runner-207 kernel: [14092.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 13016s! [qemu-system-x86:6715] Aug 22 09:18:38 juju-e4d256-prod-github-runner-207 kernel: [14092.543888] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 09:18:38 juju-e4d256-prod-github-runner-207 kernel: [14092.544181] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 09:18:38 juju-e4d256-prod-github-runner-207 kernel: [14092.556384] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 09:18:38 juju-e4d256-prod-github-runner-207 kernel: [14092.557663] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 09:18:38 juju-e4d256-prod-github-runner-207 kernel: [14092.558895] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:18:38 juju-e4d256-prod-github-runner-207 kernel: [14092.559986] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 09:18:38 juju-e4d256-prod-github-runner-207 kernel: [14092.562552] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 09:18:38 juju-e4d256-prod-github-runner-207 kernel: [14092.563597] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 09:18:38 juju-e4d256-prod-github-runner-207 kernel: [14092.564778] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 09:18:38 juju-e4d256-prod-github-runner-207 kernel: [14092.565955] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 09:18:38 juju-e4d256-prod-github-runner-207 kernel: [14092.567124] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 09:18:38 juju-e4d256-prod-github-runner-207 kernel: [14092.568298] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 09:18:38 juju-e4d256-prod-github-runner-207 kernel: [14092.569480] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 09:18:38 juju-e4d256-prod-github-runner-207 kernel: [14092.570878] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 09:18:38 juju-e4d256-prod-github-runner-207 kernel: [14092.572068] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 09:18:38 juju-e4d256-prod-github-runner-207 kernel: [14092.573281] Call Trace: Aug 22 09:18:38 juju-e4d256-prod-github-runner-207 kernel: [14092.574201] Aug 22 09:18:38 juju-e4d256-prod-github-runner-207 kernel: [14092.575105] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:18:38 juju-e4d256-prod-github-runner-207 kernel: [14092.576165] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:18:38 juju-e4d256-prod-github-runner-207 kernel: [14092.577198] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:18:38 juju-e4d256-prod-github-runner-207 kernel: [14092.578296] ? show_regs.part.0+0x23/0x29 Aug 22 09:18:38 juju-e4d256-prod-github-runner-207 kernel: [14092.579296] ? show_regs.cold+0x8/0xd Aug 22 09:18:38 juju-e4d256-prod-github-runner-207 kernel: [14092.580486] ? watchdog_timer_fn+0x1be/0x220 Aug 22 09:18:38 juju-e4d256-prod-github-runner-207 kernel: [14092.582366] ? lockup_detector_update_enable+0x60/0x60 Aug 22 09:18:38 juju-e4d256-prod-github-runner-207 kernel: [14092.583580] ? __hrtimer_run_queues+0x107/0x230 Aug 22 09:18:38 juju-e4d256-prod-github-runner-207 kernel: [14092.584629] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 09:18:38 juju-e4d256-prod-github-runner-207 kernel: [14092.585672] ? hrtimer_interrupt+0x101/0x220 Aug 22 09:18:38 juju-e4d256-prod-github-runner-207 kernel: [14092.586690] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 09:18:38 juju-e4d256-prod-github-runner-207 kernel: [14092.587774] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 09:18:38 juju-e4d256-prod-github-runner-207 kernel: [14092.588825] Aug 22 09:18:38 juju-e4d256-prod-github-runner-207 kernel: [14092.589677] Aug 22 09:18:38 juju-e4d256-prod-github-runner-207 kernel: [14092.590520] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 09:18:38 juju-e4d256-prod-github-runner-207 kernel: [14092.591562] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:18:38 juju-e4d256-prod-github-runner-207 kernel: [14092.592617] ? _raw_spin_lock+0x22/0x30 Aug 22 09:18:38 juju-e4d256-prod-github-runner-207 kernel: [14092.593560] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:18:38 juju-e4d256-prod-github-runner-207 kernel: [14092.594577] direct_page_fault+0x206/0x310 [kvm] Aug 22 09:18:38 juju-e4d256-prod-github-runner-207 kernel: [14092.595599] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 09:18:38 juju-e4d256-prod-github-runner-207 kernel: [14092.596626] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 09:18:38 juju-e4d256-prod-github-runner-207 kernel: [14092.597628] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 09:18:38 juju-e4d256-prod-github-runner-207 kernel: [14092.598630] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 09:18:38 juju-e4d256-prod-github-runner-207 kernel: [14092.599830] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 09:18:38 juju-e4d256-prod-github-runner-207 kernel: [14092.600838] handle_exit+0x98/0x230 [kvm_amd] Aug 22 09:18:38 juju-e4d256-prod-github-runner-207 kernel: [14092.601729] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 09:18:38 juju-e4d256-prod-github-runner-207 kernel: [14092.602638] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 09:18:38 juju-e4d256-prod-github-runner-207 kernel: [14092.603560] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 09:18:38 juju-e4d256-prod-github-runner-207 kernel: [14092.604479] vcpu_run+0x62/0x2c0 [kvm] Aug 22 09:18:38 juju-e4d256-prod-github-runner-207 kernel: [14092.605304] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 09:18:38 juju-e4d256-prod-github-runner-207 kernel: [14092.606127] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 09:18:38 juju-e4d256-prod-github-runner-207 kernel: [14092.607002] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 09:18:38 juju-e4d256-prod-github-runner-207 kernel: [14092.607838] ? __seccomp_filter+0x4a/0x4a0 Aug 22 09:18:38 juju-e4d256-prod-github-runner-207 kernel: [14092.608585] ? __fget_files+0x86/0xc0 Aug 22 09:18:38 juju-e4d256-prod-github-runner-207 kernel: [14092.609290] __x64_sys_ioctl+0x95/0xd0 Aug 22 09:18:38 juju-e4d256-prod-github-runner-207 kernel: [14092.609998] do_syscall_64+0x5c/0xc0 Aug 22 09:18:38 juju-e4d256-prod-github-runner-207 kernel: [14092.610691] ? do_futex+0x162/0x1f0 Aug 22 09:18:38 juju-e4d256-prod-github-runner-207 kernel: [14092.611344] ? __x64_sys_futex+0x78/0x1e0 Aug 22 09:18:38 juju-e4d256-prod-github-runner-207 kernel: [14092.612053] ? __secure_computing+0xa9/0x120 Aug 22 09:18:38 juju-e4d256-prod-github-runner-207 kernel: [14092.612760] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 09:18:38 juju-e4d256-prod-github-runner-207 kernel: [14092.613526] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:18:38 juju-e4d256-prod-github-runner-207 kernel: [14092.614251] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:18:38 juju-e4d256-prod-github-runner-207 kernel: [14092.614985] ? do_syscall_64+0x69/0xc0 Aug 22 09:18:38 juju-e4d256-prod-github-runner-207 kernel: [14092.615645] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:18:38 juju-e4d256-prod-github-runner-207 kernel: [14092.616366] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:18:38 juju-e4d256-prod-github-runner-207 kernel: [14092.617079] ? do_syscall_64+0x69/0xc0 Aug 22 09:18:38 juju-e4d256-prod-github-runner-207 kernel: [14092.617716] ? do_syscall_64+0x69/0xc0 Aug 22 09:18:38 juju-e4d256-prod-github-runner-207 kernel: [14092.618339] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 09:18:38 juju-e4d256-prod-github-runner-207 kernel: [14092.619043] RIP: 0033:0x7faa5d0edaff Aug 22 09:18:38 juju-e4d256-prod-github-runner-207 kernel: [14092.619711] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 09:18:38 juju-e4d256-prod-github-runner-207 kernel: [14092.621718] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 09:18:38 juju-e4d256-prod-github-runner-207 kernel: [14092.622676] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 09:18:38 juju-e4d256-prod-github-runner-207 kernel: [14092.623584] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 09:18:38 juju-e4d256-prod-github-runner-207 kernel: [14092.624491] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 09:18:38 juju-e4d256-prod-github-runner-207 kernel: [14092.625402] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 09:18:38 juju-e4d256-prod-github-runner-207 kernel: [14092.626302] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 09:18:38 juju-e4d256-prod-github-runner-207 kernel: [14092.627222] Aug 22 09:19:06 juju-e4d256-prod-github-runner-207 kernel: [14120.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 13042s! [qemu-system-x86:6715] Aug 22 09:19:06 juju-e4d256-prod-github-runner-207 kernel: [14120.543102] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 09:19:06 juju-e4d256-prod-github-runner-207 kernel: [14120.543176] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 09:19:06 juju-e4d256-prod-github-runner-207 kernel: [14120.555300] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 09:19:06 juju-e4d256-prod-github-runner-207 kernel: [14120.556575] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 09:19:06 juju-e4d256-prod-github-runner-207 kernel: [14120.557802] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:19:06 juju-e4d256-prod-github-runner-207 kernel: [14120.558860] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 09:19:06 juju-e4d256-prod-github-runner-207 kernel: [14120.561435] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 09:19:06 juju-e4d256-prod-github-runner-207 kernel: [14120.562474] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 09:19:06 juju-e4d256-prod-github-runner-207 kernel: [14120.563650] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 09:19:06 juju-e4d256-prod-github-runner-207 kernel: [14120.564806] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 09:19:06 juju-e4d256-prod-github-runner-207 kernel: [14120.565964] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 09:19:06 juju-e4d256-prod-github-runner-207 kernel: [14120.567123] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 09:19:06 juju-e4d256-prod-github-runner-207 kernel: [14120.568303] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 09:19:06 juju-e4d256-prod-github-runner-207 kernel: [14120.569532] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 09:19:06 juju-e4d256-prod-github-runner-207 kernel: [14120.570626] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 09:19:06 juju-e4d256-prod-github-runner-207 kernel: [14120.571835] Call Trace: Aug 22 09:19:06 juju-e4d256-prod-github-runner-207 kernel: [14120.572747] Aug 22 09:19:06 juju-e4d256-prod-github-runner-207 kernel: [14120.573629] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:19:06 juju-e4d256-prod-github-runner-207 kernel: [14120.574659] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:19:06 juju-e4d256-prod-github-runner-207 kernel: [14120.575750] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:19:06 juju-e4d256-prod-github-runner-207 kernel: [14120.576839] ? show_regs.part.0+0x23/0x29 Aug 22 09:19:06 juju-e4d256-prod-github-runner-207 kernel: [14120.577839] ? show_regs.cold+0x8/0xd Aug 22 09:19:06 juju-e4d256-prod-github-runner-207 kernel: [14120.578809] ? watchdog_timer_fn+0x1be/0x220 Aug 22 09:19:06 juju-e4d256-prod-github-runner-207 kernel: [14120.579838] ? lockup_detector_update_enable+0x60/0x60 Aug 22 09:19:06 juju-e4d256-prod-github-runner-207 kernel: [14120.580907] ? __hrtimer_run_queues+0x107/0x230 Aug 22 09:19:06 juju-e4d256-prod-github-runner-207 kernel: [14120.581938] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 09:19:06 juju-e4d256-prod-github-runner-207 kernel: [14120.582958] ? hrtimer_interrupt+0x101/0x220 Aug 22 09:19:06 juju-e4d256-prod-github-runner-207 kernel: [14120.583981] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 09:19:06 juju-e4d256-prod-github-runner-207 kernel: [14120.585061] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 09:19:06 juju-e4d256-prod-github-runner-207 kernel: [14120.586105] Aug 22 09:19:06 juju-e4d256-prod-github-runner-207 kernel: [14120.586956] Aug 22 09:19:06 juju-e4d256-prod-github-runner-207 kernel: [14120.587806] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 09:19:06 juju-e4d256-prod-github-runner-207 kernel: [14120.588837] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:19:06 juju-e4d256-prod-github-runner-207 kernel: [14120.589872] ? _raw_spin_lock+0x22/0x30 Aug 22 09:19:06 juju-e4d256-prod-github-runner-207 kernel: [14120.590815] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:19:06 juju-e4d256-prod-github-runner-207 kernel: [14120.591853] direct_page_fault+0x206/0x310 [kvm] Aug 22 09:19:06 juju-e4d256-prod-github-runner-207 kernel: [14120.592885] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 09:19:06 juju-e4d256-prod-github-runner-207 kernel: [14120.593901] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 09:19:06 juju-e4d256-prod-github-runner-207 kernel: [14120.594896] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 09:19:06 juju-e4d256-prod-github-runner-207 kernel: [14120.595881] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 09:19:06 juju-e4d256-prod-github-runner-207 kernel: [14120.596835] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 09:19:06 juju-e4d256-prod-github-runner-207 kernel: [14120.597809] handle_exit+0x98/0x230 [kvm_amd] Aug 22 09:19:06 juju-e4d256-prod-github-runner-207 kernel: [14120.598697] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 09:19:06 juju-e4d256-prod-github-runner-207 kernel: [14120.599639] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 09:19:06 juju-e4d256-prod-github-runner-207 kernel: [14120.600574] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 09:19:06 juju-e4d256-prod-github-runner-207 kernel: [14120.601476] vcpu_run+0x62/0x2c0 [kvm] Aug 22 09:19:06 juju-e4d256-prod-github-runner-207 kernel: [14120.602290] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 09:19:06 juju-e4d256-prod-github-runner-207 kernel: [14120.603099] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 09:19:06 juju-e4d256-prod-github-runner-207 kernel: [14120.603965] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 09:19:06 juju-e4d256-prod-github-runner-207 kernel: [14120.604765] ? __seccomp_filter+0x4a/0x4a0 Aug 22 09:19:06 juju-e4d256-prod-github-runner-207 kernel: [14120.605508] ? __fget_files+0x86/0xc0 Aug 22 09:19:06 juju-e4d256-prod-github-runner-207 kernel: [14120.606210] __x64_sys_ioctl+0x95/0xd0 Aug 22 09:19:06 juju-e4d256-prod-github-runner-207 kernel: [14120.606905] do_syscall_64+0x5c/0xc0 Aug 22 09:19:06 juju-e4d256-prod-github-runner-207 kernel: [14120.607589] ? do_futex+0x162/0x1f0 Aug 22 09:19:06 juju-e4d256-prod-github-runner-207 kernel: [14120.608239] ? __x64_sys_futex+0x78/0x1e0 Aug 22 09:19:06 juju-e4d256-prod-github-runner-207 kernel: [14120.608917] ? __secure_computing+0xa9/0x120 Aug 22 09:19:06 juju-e4d256-prod-github-runner-207 kernel: [14120.609604] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 09:19:06 juju-e4d256-prod-github-runner-207 kernel: [14120.610362] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:19:06 juju-e4d256-prod-github-runner-207 kernel: [14120.611085] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:19:06 juju-e4d256-prod-github-runner-207 kernel: [14120.611814] ? do_syscall_64+0x69/0xc0 Aug 22 09:19:06 juju-e4d256-prod-github-runner-207 kernel: [14120.612461] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:19:06 juju-e4d256-prod-github-runner-207 kernel: [14120.613361] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:19:06 juju-e4d256-prod-github-runner-207 kernel: [14120.614055] ? do_syscall_64+0x69/0xc0 Aug 22 09:19:06 juju-e4d256-prod-github-runner-207 kernel: [14120.614681] ? do_syscall_64+0x69/0xc0 Aug 22 09:19:06 juju-e4d256-prod-github-runner-207 kernel: [14120.615300] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 09:19:06 juju-e4d256-prod-github-runner-207 kernel: [14120.616023] RIP: 0033:0x7faa5d0edaff Aug 22 09:19:06 juju-e4d256-prod-github-runner-207 kernel: [14120.616647] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 09:19:06 juju-e4d256-prod-github-runner-207 kernel: [14120.618626] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 09:19:06 juju-e4d256-prod-github-runner-207 kernel: [14120.619545] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 09:19:06 juju-e4d256-prod-github-runner-207 kernel: [14120.620431] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 09:19:06 juju-e4d256-prod-github-runner-207 kernel: [14120.621317] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 09:19:06 juju-e4d256-prod-github-runner-207 kernel: [14120.622203] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 09:19:06 juju-e4d256-prod-github-runner-207 kernel: [14120.623085] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 09:19:06 juju-e4d256-prod-github-runner-207 kernel: [14120.623981] Aug 22 09:19:34 juju-e4d256-prod-github-runner-207 kernel: [14148.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 13068s! [qemu-system-x86:6715] Aug 22 09:19:34 juju-e4d256-prod-github-runner-207 kernel: [14148.543124] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 09:19:34 juju-e4d256-prod-github-runner-207 kernel: [14148.543198] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 09:19:34 juju-e4d256-prod-github-runner-207 kernel: [14148.555386] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 09:19:34 juju-e4d256-prod-github-runner-207 kernel: [14148.556664] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 09:19:34 juju-e4d256-prod-github-runner-207 kernel: [14148.557878] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:19:34 juju-e4d256-prod-github-runner-207 kernel: [14148.558937] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 09:19:34 juju-e4d256-prod-github-runner-207 kernel: [14148.561505] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 09:19:34 juju-e4d256-prod-github-runner-207 kernel: [14148.562549] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 09:19:34 juju-e4d256-prod-github-runner-207 kernel: [14148.563737] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 09:19:34 juju-e4d256-prod-github-runner-207 kernel: [14148.564914] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 09:19:34 juju-e4d256-prod-github-runner-207 kernel: [14148.566070] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 09:19:34 juju-e4d256-prod-github-runner-207 kernel: [14148.567245] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 09:19:34 juju-e4d256-prod-github-runner-207 kernel: [14148.568455] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 09:19:34 juju-e4d256-prod-github-runner-207 kernel: [14148.569722] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 09:19:34 juju-e4d256-prod-github-runner-207 kernel: [14148.570837] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 09:19:34 juju-e4d256-prod-github-runner-207 kernel: [14148.572135] Call Trace: Aug 22 09:19:34 juju-e4d256-prod-github-runner-207 kernel: [14148.573058] Aug 22 09:19:34 juju-e4d256-prod-github-runner-207 kernel: [14148.573989] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:19:34 juju-e4d256-prod-github-runner-207 kernel: [14148.575071] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:19:34 juju-e4d256-prod-github-runner-207 kernel: [14148.576113] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:19:34 juju-e4d256-prod-github-runner-207 kernel: [14148.577213] ? show_regs.part.0+0x23/0x29 Aug 22 09:19:34 juju-e4d256-prod-github-runner-207 kernel: [14148.578213] ? show_regs.cold+0x8/0xd Aug 22 09:19:34 juju-e4d256-prod-github-runner-207 kernel: [14148.579199] ? watchdog_timer_fn+0x1be/0x220 Aug 22 09:19:34 juju-e4d256-prod-github-runner-207 kernel: [14148.580206] ? lockup_detector_update_enable+0x60/0x60 Aug 22 09:19:34 juju-e4d256-prod-github-runner-207 kernel: [14148.581265] ? __hrtimer_run_queues+0x107/0x230 Aug 22 09:19:34 juju-e4d256-prod-github-runner-207 kernel: [14148.582290] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 09:19:34 juju-e4d256-prod-github-runner-207 kernel: [14148.583319] ? hrtimer_interrupt+0x101/0x220 Aug 22 09:19:34 juju-e4d256-prod-github-runner-207 kernel: [14148.584422] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 09:19:34 juju-e4d256-prod-github-runner-207 kernel: [14148.585490] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 09:19:34 juju-e4d256-prod-github-runner-207 kernel: [14148.586534] Aug 22 09:19:34 juju-e4d256-prod-github-runner-207 kernel: [14148.587399] Aug 22 09:19:34 juju-e4d256-prod-github-runner-207 kernel: [14148.588236] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 09:19:34 juju-e4d256-prod-github-runner-207 kernel: [14148.589284] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:19:34 juju-e4d256-prod-github-runner-207 kernel: [14148.590334] ? _raw_spin_lock+0x22/0x30 Aug 22 09:19:34 juju-e4d256-prod-github-runner-207 kernel: [14148.591293] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:19:34 juju-e4d256-prod-github-runner-207 kernel: [14148.592308] direct_page_fault+0x206/0x310 [kvm] Aug 22 09:19:34 juju-e4d256-prod-github-runner-207 kernel: [14148.593335] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 09:19:34 juju-e4d256-prod-github-runner-207 kernel: [14148.594349] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 09:19:34 juju-e4d256-prod-github-runner-207 kernel: [14148.595392] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 09:19:34 juju-e4d256-prod-github-runner-207 kernel: [14148.596377] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 09:19:34 juju-e4d256-prod-github-runner-207 kernel: [14148.597329] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 09:19:34 juju-e4d256-prod-github-runner-207 kernel: [14148.598313] handle_exit+0x98/0x230 [kvm_amd] Aug 22 09:19:34 juju-e4d256-prod-github-runner-207 kernel: [14148.599244] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 09:19:34 juju-e4d256-prod-github-runner-207 kernel: [14148.600162] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 09:19:34 juju-e4d256-prod-github-runner-207 kernel: [14148.601104] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 09:19:34 juju-e4d256-prod-github-runner-207 kernel: [14148.602013] vcpu_run+0x62/0x2c0 [kvm] Aug 22 09:19:34 juju-e4d256-prod-github-runner-207 kernel: [14148.602823] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 09:19:34 juju-e4d256-prod-github-runner-207 kernel: [14148.603639] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 09:19:34 juju-e4d256-prod-github-runner-207 kernel: [14148.604498] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 09:19:34 juju-e4d256-prod-github-runner-207 kernel: [14148.605353] ? __seccomp_filter+0x4a/0x4a0 Aug 22 09:19:34 juju-e4d256-prod-github-runner-207 kernel: [14148.606125] ? __fget_files+0x86/0xc0 Aug 22 09:19:34 juju-e4d256-prod-github-runner-207 kernel: [14148.606829] __x64_sys_ioctl+0x95/0xd0 Aug 22 09:19:34 juju-e4d256-prod-github-runner-207 kernel: [14148.607552] do_syscall_64+0x5c/0xc0 Aug 22 09:19:34 juju-e4d256-prod-github-runner-207 kernel: [14148.608216] ? do_futex+0x162/0x1f0 Aug 22 09:19:34 juju-e4d256-prod-github-runner-207 kernel: [14148.608864] ? __x64_sys_futex+0x78/0x1e0 Aug 22 09:19:34 juju-e4d256-prod-github-runner-207 kernel: [14148.609537] ? __secure_computing+0xa9/0x120 Aug 22 09:19:34 juju-e4d256-prod-github-runner-207 kernel: [14148.610226] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 09:19:34 juju-e4d256-prod-github-runner-207 kernel: [14148.610984] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:19:34 juju-e4d256-prod-github-runner-207 kernel: [14148.611712] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:19:34 juju-e4d256-prod-github-runner-207 kernel: [14148.612428] ? do_syscall_64+0x69/0xc0 Aug 22 09:19:34 juju-e4d256-prod-github-runner-207 kernel: [14148.613072] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:19:34 juju-e4d256-prod-github-runner-207 kernel: [14148.613774] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:19:34 juju-e4d256-prod-github-runner-207 kernel: [14148.614470] ? do_syscall_64+0x69/0xc0 Aug 22 09:19:34 juju-e4d256-prod-github-runner-207 kernel: [14148.615111] ? do_syscall_64+0x69/0xc0 Aug 22 09:19:34 juju-e4d256-prod-github-runner-207 kernel: [14148.615744] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 09:19:34 juju-e4d256-prod-github-runner-207 kernel: [14148.616449] RIP: 0033:0x7faa5d0edaff Aug 22 09:19:34 juju-e4d256-prod-github-runner-207 kernel: [14148.617077] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 09:19:34 juju-e4d256-prod-github-runner-207 kernel: [14148.619078] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 09:19:34 juju-e4d256-prod-github-runner-207 kernel: [14148.619986] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 09:19:34 juju-e4d256-prod-github-runner-207 kernel: [14148.620877] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 09:19:34 juju-e4d256-prod-github-runner-207 kernel: [14148.621763] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 09:19:34 juju-e4d256-prod-github-runner-207 kernel: [14148.622651] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 09:19:34 juju-e4d256-prod-github-runner-207 kernel: [14148.623546] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 09:19:34 juju-e4d256-prod-github-runner-207 kernel: [14148.624446] Aug 22 09:20:02 juju-e4d256-prod-github-runner-207 kernel: [14176.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 13094s! [qemu-system-x86:6715] Aug 22 09:20:02 juju-e4d256-prod-github-runner-207 kernel: [14176.543859] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 09:20:02 juju-e4d256-prod-github-runner-207 kernel: [14176.544162] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 09:20:02 juju-e4d256-prod-github-runner-207 kernel: [14176.556296] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 09:20:02 juju-e4d256-prod-github-runner-207 kernel: [14176.557572] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 09:20:02 juju-e4d256-prod-github-runner-207 kernel: [14176.558809] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:20:02 juju-e4d256-prod-github-runner-207 kernel: [14176.559869] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 09:20:02 juju-e4d256-prod-github-runner-207 kernel: [14176.562427] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 09:20:02 juju-e4d256-prod-github-runner-207 kernel: [14176.563479] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 09:20:02 juju-e4d256-prod-github-runner-207 kernel: [14176.564647] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 09:20:02 juju-e4d256-prod-github-runner-207 kernel: [14176.565808] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 09:20:02 juju-e4d256-prod-github-runner-207 kernel: [14176.566982] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 09:20:02 juju-e4d256-prod-github-runner-207 kernel: [14176.568159] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 09:20:02 juju-e4d256-prod-github-runner-207 kernel: [14176.569329] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 09:20:02 juju-e4d256-prod-github-runner-207 kernel: [14176.570599] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 09:20:02 juju-e4d256-prod-github-runner-207 kernel: [14176.571752] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 09:20:02 juju-e4d256-prod-github-runner-207 kernel: [14176.573010] Call Trace: Aug 22 09:20:02 juju-e4d256-prod-github-runner-207 kernel: [14176.573969] Aug 22 09:20:02 juju-e4d256-prod-github-runner-207 kernel: [14176.574924] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:20:02 juju-e4d256-prod-github-runner-207 kernel: [14176.575966] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:20:02 juju-e4d256-prod-github-runner-207 kernel: [14176.576993] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:20:02 juju-e4d256-prod-github-runner-207 kernel: [14176.578092] ? show_regs.part.0+0x23/0x29 Aug 22 09:20:02 juju-e4d256-prod-github-runner-207 kernel: [14176.579109] ? show_regs.cold+0x8/0xd Aug 22 09:20:02 juju-e4d256-prod-github-runner-207 kernel: [14176.580177] ? watchdog_timer_fn+0x1be/0x220 Aug 22 09:20:02 juju-e4d256-prod-github-runner-207 kernel: [14176.581191] ? lockup_detector_update_enable+0x60/0x60 Aug 22 09:20:02 juju-e4d256-prod-github-runner-207 kernel: [14176.582261] ? __hrtimer_run_queues+0x107/0x230 Aug 22 09:20:02 juju-e4d256-prod-github-runner-207 kernel: [14176.583311] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 09:20:02 juju-e4d256-prod-github-runner-207 kernel: [14176.584335] ? hrtimer_interrupt+0x101/0x220 Aug 22 09:20:02 juju-e4d256-prod-github-runner-207 kernel: [14176.585348] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 09:20:02 juju-e4d256-prod-github-runner-207 kernel: [14176.586445] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 09:20:02 juju-e4d256-prod-github-runner-207 kernel: [14176.587522] Aug 22 09:20:02 juju-e4d256-prod-github-runner-207 kernel: [14176.588375] Aug 22 09:20:02 juju-e4d256-prod-github-runner-207 kernel: [14176.589218] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 09:20:02 juju-e4d256-prod-github-runner-207 kernel: [14176.590252] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:20:02 juju-e4d256-prod-github-runner-207 kernel: [14176.591301] ? _raw_spin_lock+0x22/0x30 Aug 22 09:20:02 juju-e4d256-prod-github-runner-207 kernel: [14176.592254] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:20:02 juju-e4d256-prod-github-runner-207 kernel: [14176.593273] direct_page_fault+0x206/0x310 [kvm] Aug 22 09:20:02 juju-e4d256-prod-github-runner-207 kernel: [14176.594594] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 09:20:02 juju-e4d256-prod-github-runner-207 kernel: [14176.595633] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 09:20:02 juju-e4d256-prod-github-runner-207 kernel: [14176.596646] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 09:20:02 juju-e4d256-prod-github-runner-207 kernel: [14176.597778] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 09:20:02 juju-e4d256-prod-github-runner-207 kernel: [14176.598851] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 09:20:02 juju-e4d256-prod-github-runner-207 kernel: [14176.599933] handle_exit+0x98/0x230 [kvm_amd] Aug 22 09:20:02 juju-e4d256-prod-github-runner-207 kernel: [14176.600909] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 09:20:02 juju-e4d256-prod-github-runner-207 kernel: [14176.601915] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 09:20:02 juju-e4d256-prod-github-runner-207 kernel: [14176.602970] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 09:20:02 juju-e4d256-prod-github-runner-207 kernel: [14176.603976] vcpu_run+0x62/0x2c0 [kvm] Aug 22 09:20:02 juju-e4d256-prod-github-runner-207 kernel: [14176.604799] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 09:20:02 juju-e4d256-prod-github-runner-207 kernel: [14176.605607] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 09:20:02 juju-e4d256-prod-github-runner-207 kernel: [14176.606462] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 09:20:02 juju-e4d256-prod-github-runner-207 kernel: [14176.607272] ? __seccomp_filter+0x4a/0x4a0 Aug 22 09:20:02 juju-e4d256-prod-github-runner-207 kernel: [14176.608015] ? __fget_files+0x86/0xc0 Aug 22 09:20:02 juju-e4d256-prod-github-runner-207 kernel: [14176.608724] __x64_sys_ioctl+0x95/0xd0 Aug 22 09:20:02 juju-e4d256-prod-github-runner-207 kernel: [14176.609417] do_syscall_64+0x5c/0xc0 Aug 22 09:20:02 juju-e4d256-prod-github-runner-207 kernel: [14176.610082] ? do_futex+0x162/0x1f0 Aug 22 09:20:02 juju-e4d256-prod-github-runner-207 kernel: [14176.610743] ? __x64_sys_futex+0x78/0x1e0 Aug 22 09:20:02 juju-e4d256-prod-github-runner-207 kernel: [14176.611422] ? __secure_computing+0xa9/0x120 Aug 22 09:20:02 juju-e4d256-prod-github-runner-207 kernel: [14176.612200] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 09:20:02 juju-e4d256-prod-github-runner-207 kernel: [14176.613065] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:20:02 juju-e4d256-prod-github-runner-207 kernel: [14176.613902] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:20:02 juju-e4d256-prod-github-runner-207 kernel: [14176.614749] ? do_syscall_64+0x69/0xc0 Aug 22 09:20:02 juju-e4d256-prod-github-runner-207 kernel: [14176.615474] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:20:02 juju-e4d256-prod-github-runner-207 kernel: [14176.616273] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:20:02 juju-e4d256-prod-github-runner-207 kernel: [14176.617066] ? do_syscall_64+0x69/0xc0 Aug 22 09:20:02 juju-e4d256-prod-github-runner-207 kernel: [14176.617889] ? do_syscall_64+0x69/0xc0 Aug 22 09:20:02 juju-e4d256-prod-github-runner-207 kernel: [14176.618792] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 09:20:02 juju-e4d256-prod-github-runner-207 kernel: [14176.619605] RIP: 0033:0x7faa5d0edaff Aug 22 09:20:02 juju-e4d256-prod-github-runner-207 kernel: [14176.620333] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 09:20:02 juju-e4d256-prod-github-runner-207 kernel: [14176.622738] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 09:20:02 juju-e4d256-prod-github-runner-207 kernel: [14176.623806] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 09:20:02 juju-e4d256-prod-github-runner-207 kernel: [14176.624843] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 09:20:02 juju-e4d256-prod-github-runner-207 kernel: [14176.625866] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 09:20:02 juju-e4d256-prod-github-runner-207 kernel: [14176.626906] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 09:20:02 juju-e4d256-prod-github-runner-207 kernel: [14176.627933] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 09:20:02 juju-e4d256-prod-github-runner-207 kernel: [14176.628960] Aug 22 09:20:30 juju-e4d256-prod-github-runner-207 kernel: [14204.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 13121s! [qemu-system-x86:6715] Aug 22 09:20:30 juju-e4d256-prod-github-runner-207 kernel: [14204.543126] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 09:20:30 juju-e4d256-prod-github-runner-207 kernel: [14204.543200] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 09:20:30 juju-e4d256-prod-github-runner-207 kernel: [14204.555376] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 09:20:30 juju-e4d256-prod-github-runner-207 kernel: [14204.556657] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 09:20:30 juju-e4d256-prod-github-runner-207 kernel: [14204.557889] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:20:30 juju-e4d256-prod-github-runner-207 kernel: [14204.558979] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 09:20:30 juju-e4d256-prod-github-runner-207 kernel: [14204.561555] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 09:20:30 juju-e4d256-prod-github-runner-207 kernel: [14204.562614] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 09:20:30 juju-e4d256-prod-github-runner-207 kernel: [14204.563780] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 09:20:30 juju-e4d256-prod-github-runner-207 kernel: [14204.564938] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 09:20:30 juju-e4d256-prod-github-runner-207 kernel: [14204.566102] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 09:20:30 juju-e4d256-prod-github-runner-207 kernel: [14204.567271] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 09:20:30 juju-e4d256-prod-github-runner-207 kernel: [14204.568437] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 09:20:30 juju-e4d256-prod-github-runner-207 kernel: [14204.569677] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 09:20:30 juju-e4d256-prod-github-runner-207 kernel: [14204.570782] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 09:20:30 juju-e4d256-prod-github-runner-207 kernel: [14204.571975] Call Trace: Aug 22 09:20:30 juju-e4d256-prod-github-runner-207 kernel: [14204.572905] Aug 22 09:20:30 juju-e4d256-prod-github-runner-207 kernel: [14204.573795] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:20:30 juju-e4d256-prod-github-runner-207 kernel: [14204.574840] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:20:30 juju-e4d256-prod-github-runner-207 kernel: [14204.575912] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:20:30 juju-e4d256-prod-github-runner-207 kernel: [14204.576987] ? show_regs.part.0+0x23/0x29 Aug 22 09:20:30 juju-e4d256-prod-github-runner-207 kernel: [14204.577987] ? show_regs.cold+0x8/0xd Aug 22 09:20:30 juju-e4d256-prod-github-runner-207 kernel: [14204.578981] ? watchdog_timer_fn+0x1be/0x220 Aug 22 09:20:30 juju-e4d256-prod-github-runner-207 kernel: [14204.579994] ? lockup_detector_update_enable+0x60/0x60 Aug 22 09:20:30 juju-e4d256-prod-github-runner-207 kernel: [14204.581058] ? __hrtimer_run_queues+0x107/0x230 Aug 22 09:20:30 juju-e4d256-prod-github-runner-207 kernel: [14204.582094] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 09:20:30 juju-e4d256-prod-github-runner-207 kernel: [14204.583133] ? hrtimer_interrupt+0x101/0x220 Aug 22 09:20:30 juju-e4d256-prod-github-runner-207 kernel: [14204.584148] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 09:20:30 juju-e4d256-prod-github-runner-207 kernel: [14204.585216] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 09:20:30 juju-e4d256-prod-github-runner-207 kernel: [14204.586268] Aug 22 09:20:30 juju-e4d256-prod-github-runner-207 kernel: [14204.587132] Aug 22 09:20:30 juju-e4d256-prod-github-runner-207 kernel: [14204.587970] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 09:20:30 juju-e4d256-prod-github-runner-207 kernel: [14204.589005] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:20:30 juju-e4d256-prod-github-runner-207 kernel: [14204.590056] ? _raw_spin_lock+0x22/0x30 Aug 22 09:20:30 juju-e4d256-prod-github-runner-207 kernel: [14204.591014] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:20:30 juju-e4d256-prod-github-runner-207 kernel: [14204.592033] direct_page_fault+0x206/0x310 [kvm] Aug 22 09:20:30 juju-e4d256-prod-github-runner-207 kernel: [14204.593053] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 09:20:30 juju-e4d256-prod-github-runner-207 kernel: [14204.594061] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 09:20:30 juju-e4d256-prod-github-runner-207 kernel: [14204.595089] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 09:20:30 juju-e4d256-prod-github-runner-207 kernel: [14204.596061] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 09:20:30 juju-e4d256-prod-github-runner-207 kernel: [14204.597015] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 09:20:30 juju-e4d256-prod-github-runner-207 kernel: [14204.598002] handle_exit+0x98/0x230 [kvm_amd] Aug 22 09:20:30 juju-e4d256-prod-github-runner-207 kernel: [14204.598916] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 09:20:30 juju-e4d256-prod-github-runner-207 kernel: [14204.599828] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 09:20:30 juju-e4d256-prod-github-runner-207 kernel: [14204.600751] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 09:20:30 juju-e4d256-prod-github-runner-207 kernel: [14204.601708] vcpu_run+0x62/0x2c0 [kvm] Aug 22 09:20:30 juju-e4d256-prod-github-runner-207 kernel: [14204.602560] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 09:20:30 juju-e4d256-prod-github-runner-207 kernel: [14204.603402] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 09:20:30 juju-e4d256-prod-github-runner-207 kernel: [14204.604261] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 09:20:30 juju-e4d256-prod-github-runner-207 kernel: [14204.605080] ? __seccomp_filter+0x4a/0x4a0 Aug 22 09:20:30 juju-e4d256-prod-github-runner-207 kernel: [14204.605830] ? __fget_files+0x86/0xc0 Aug 22 09:20:30 juju-e4d256-prod-github-runner-207 kernel: [14204.606547] __x64_sys_ioctl+0x95/0xd0 Aug 22 09:20:30 juju-e4d256-prod-github-runner-207 kernel: [14204.607240] do_syscall_64+0x5c/0xc0 Aug 22 09:20:30 juju-e4d256-prod-github-runner-207 kernel: [14204.607909] ? do_futex+0x162/0x1f0 Aug 22 09:20:30 juju-e4d256-prod-github-runner-207 kernel: [14204.608557] ? __x64_sys_futex+0x78/0x1e0 Aug 22 09:20:30 juju-e4d256-prod-github-runner-207 kernel: [14204.609230] ? __secure_computing+0xa9/0x120 Aug 22 09:20:30 juju-e4d256-prod-github-runner-207 kernel: [14204.609920] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 09:20:30 juju-e4d256-prod-github-runner-207 kernel: [14204.610703] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:20:30 juju-e4d256-prod-github-runner-207 kernel: [14204.611434] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:20:30 juju-e4d256-prod-github-runner-207 kernel: [14204.612171] ? do_syscall_64+0x69/0xc0 Aug 22 09:20:30 juju-e4d256-prod-github-runner-207 kernel: [14204.612827] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:20:30 juju-e4d256-prod-github-runner-207 kernel: [14204.613540] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:20:30 juju-e4d256-prod-github-runner-207 kernel: [14204.616452] ? do_syscall_64+0x69/0xc0 Aug 22 09:20:30 juju-e4d256-prod-github-runner-207 kernel: [14204.617078] ? do_syscall_64+0x69/0xc0 Aug 22 09:20:30 juju-e4d256-prod-github-runner-207 kernel: [14204.617701] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 09:20:30 juju-e4d256-prod-github-runner-207 kernel: [14204.618422] RIP: 0033:0x7faa5d0edaff Aug 22 09:20:30 juju-e4d256-prod-github-runner-207 kernel: [14204.619078] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 09:20:30 juju-e4d256-prod-github-runner-207 kernel: [14204.621067] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 09:20:30 juju-e4d256-prod-github-runner-207 kernel: [14204.621977] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 09:20:30 juju-e4d256-prod-github-runner-207 kernel: [14204.622892] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 09:20:30 juju-e4d256-prod-github-runner-207 kernel: [14204.623777] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 09:20:30 juju-e4d256-prod-github-runner-207 kernel: [14204.624662] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 09:20:30 juju-e4d256-prod-github-runner-207 kernel: [14204.625549] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 09:20:30 juju-e4d256-prod-github-runner-207 kernel: [14204.626455] Aug 22 09:20:44 juju-e4d256-prod-github-runner-207 kernel: [14218.136706] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 09:20:44 juju-e4d256-prod-github-runner-207 kernel: [14218.137679] rcu: 1-....: (3514204 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=1697746 Aug 22 09:20:44 juju-e4d256-prod-github-runner-207 kernel: [14218.138812] (t=3525234 jiffies g=23269 q=21815) Aug 22 09:20:44 juju-e4d256-prod-github-runner-207 kernel: [14218.139598] NMI backtrace for cpu 1 Aug 22 09:20:44 juju-e4d256-prod-github-runner-207 kernel: [14218.140306] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 09:20:44 juju-e4d256-prod-github-runner-207 kernel: [14218.141407] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 09:20:44 juju-e4d256-prod-github-runner-207 kernel: [14218.142489] Call Trace: Aug 22 09:20:44 juju-e4d256-prod-github-runner-207 kernel: [14218.143166] Aug 22 09:20:44 juju-e4d256-prod-github-runner-207 kernel: [14218.143810] show_stack+0x52/0x5c Aug 22 09:20:44 juju-e4d256-prod-github-runner-207 kernel: [14218.144539] dump_stack_lvl+0x4a/0x63 Aug 22 09:20:44 juju-e4d256-prod-github-runner-207 kernel: [14218.145285] dump_stack+0x10/0x16 Aug 22 09:20:44 juju-e4d256-prod-github-runner-207 kernel: [14218.146012] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 09:20:44 juju-e4d256-prod-github-runner-207 kernel: [14218.146807] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 09:20:44 juju-e4d256-prod-github-runner-207 kernel: [14218.147621] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 09:20:44 juju-e4d256-prod-github-runner-207 kernel: [14218.148449] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 09:20:44 juju-e4d256-prod-github-runner-207 kernel: [14218.149269] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 09:20:44 juju-e4d256-prod-github-runner-207 kernel: [14218.150081] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 09:20:44 juju-e4d256-prod-github-runner-207 kernel: [14218.150875] print_cpu_stall.cold+0x2f/0xe2 Aug 22 09:20:44 juju-e4d256-prod-github-runner-207 kernel: [14218.151635] ? timekeeping_update+0xf7/0x150 Aug 22 09:20:44 juju-e4d256-prod-github-runner-207 kernel: [14218.152401] check_cpu_stall+0x109/0x270 Aug 22 09:20:44 juju-e4d256-prod-github-runner-207 kernel: [14218.153143] rcu_sched_clock_irq+0x9a/0x250 Aug 22 09:20:44 juju-e4d256-prod-github-runner-207 kernel: [14218.153900] update_process_times+0x94/0xd0 Aug 22 09:20:44 juju-e4d256-prod-github-runner-207 kernel: [14218.154676] tick_sched_handle+0x29/0x70 Aug 22 09:20:44 juju-e4d256-prod-github-runner-207 kernel: [14218.155419] tick_sched_timer+0x8c/0xc0 Aug 22 09:20:44 juju-e4d256-prod-github-runner-207 kernel: [14218.156159] ? tick_nohz_handler+0xb0/0xb0 Aug 22 09:20:44 juju-e4d256-prod-github-runner-207 kernel: [14218.156909] __hrtimer_run_queues+0x107/0x230 Aug 22 09:20:44 juju-e4d256-prod-github-runner-207 kernel: [14218.157683] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 09:20:44 juju-e4d256-prod-github-runner-207 kernel: [14218.158479] hrtimer_interrupt+0x101/0x220 Aug 22 09:20:44 juju-e4d256-prod-github-runner-207 kernel: [14218.159247] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 09:20:44 juju-e4d256-prod-github-runner-207 kernel: [14218.160055] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 09:20:44 juju-e4d256-prod-github-runner-207 kernel: [14218.160854] Aug 22 09:20:44 juju-e4d256-prod-github-runner-207 kernel: [14218.161487] Aug 22 09:20:44 juju-e4d256-prod-github-runner-207 kernel: [14218.162113] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 09:20:44 juju-e4d256-prod-github-runner-207 kernel: [14218.162938] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:20:44 juju-e4d256-prod-github-runner-207 kernel: [14218.163825] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 09:20:44 juju-e4d256-prod-github-runner-207 kernel: [14218.166029] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 09:20:44 juju-e4d256-prod-github-runner-207 kernel: [14218.166912] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 09:20:44 juju-e4d256-prod-github-runner-207 kernel: [14218.167907] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 09:20:44 juju-e4d256-prod-github-runner-207 kernel: [14218.168917] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 09:20:44 juju-e4d256-prod-github-runner-207 kernel: [14218.169877] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 09:20:44 juju-e4d256-prod-github-runner-207 kernel: [14218.170840] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 09:20:44 juju-e4d256-prod-github-runner-207 kernel: [14218.171790] ? _raw_spin_lock+0x22/0x30 Aug 22 09:20:44 juju-e4d256-prod-github-runner-207 kernel: [14218.172615] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:20:44 juju-e4d256-prod-github-runner-207 kernel: [14218.173461] direct_page_fault+0x206/0x310 [kvm] Aug 22 09:20:44 juju-e4d256-prod-github-runner-207 kernel: [14218.174327] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 09:20:44 juju-e4d256-prod-github-runner-207 kernel: [14218.175157] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 09:20:44 juju-e4d256-prod-github-runner-207 kernel: [14218.175980] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 09:20:44 juju-e4d256-prod-github-runner-207 kernel: [14218.176789] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 09:20:44 juju-e4d256-prod-github-runner-207 kernel: [14218.177595] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 09:20:44 juju-e4d256-prod-github-runner-207 kernel: [14218.178507] handle_exit+0x98/0x230 [kvm_amd] Aug 22 09:20:44 juju-e4d256-prod-github-runner-207 kernel: [14218.179428] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 09:20:44 juju-e4d256-prod-github-runner-207 kernel: [14218.180226] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 09:20:44 juju-e4d256-prod-github-runner-207 kernel: [14218.181033] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 09:20:44 juju-e4d256-prod-github-runner-207 kernel: [14218.181820] vcpu_run+0x62/0x2c0 [kvm] Aug 22 09:20:44 juju-e4d256-prod-github-runner-207 kernel: [14218.182564] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 09:20:44 juju-e4d256-prod-github-runner-207 kernel: [14218.183331] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 09:20:44 juju-e4d256-prod-github-runner-207 kernel: [14218.184213] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 09:20:44 juju-e4d256-prod-github-runner-207 kernel: [14218.184986] ? __seccomp_filter+0x4a/0x4a0 Aug 22 09:20:44 juju-e4d256-prod-github-runner-207 kernel: [14218.185709] ? __fget_files+0x86/0xc0 Aug 22 09:20:44 juju-e4d256-prod-github-runner-207 kernel: [14218.186420] __x64_sys_ioctl+0x95/0xd0 Aug 22 09:20:44 juju-e4d256-prod-github-runner-207 kernel: [14218.187120] do_syscall_64+0x5c/0xc0 Aug 22 09:20:44 juju-e4d256-prod-github-runner-207 kernel: [14218.187802] ? do_futex+0x162/0x1f0 Aug 22 09:20:44 juju-e4d256-prod-github-runner-207 kernel: [14218.188485] ? __x64_sys_futex+0x78/0x1e0 Aug 22 09:20:44 juju-e4d256-prod-github-runner-207 kernel: [14218.189188] ? __secure_computing+0xa9/0x120 Aug 22 09:20:44 juju-e4d256-prod-github-runner-207 kernel: [14218.189902] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 09:20:44 juju-e4d256-prod-github-runner-207 kernel: [14218.190713] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:20:44 juju-e4d256-prod-github-runner-207 kernel: [14218.191468] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:20:44 juju-e4d256-prod-github-runner-207 kernel: [14218.192228] ? do_syscall_64+0x69/0xc0 Aug 22 09:20:44 juju-e4d256-prod-github-runner-207 kernel: [14218.192918] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:20:44 juju-e4d256-prod-github-runner-207 kernel: [14218.193672] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:20:44 juju-e4d256-prod-github-runner-207 kernel: [14218.194505] ? do_syscall_64+0x69/0xc0 Aug 22 09:20:44 juju-e4d256-prod-github-runner-207 kernel: [14218.195211] ? do_syscall_64+0x69/0xc0 Aug 22 09:20:44 juju-e4d256-prod-github-runner-207 kernel: [14218.195898] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 09:20:44 juju-e4d256-prod-github-runner-207 kernel: [14218.196670] RIP: 0033:0x7faa5d0edaff Aug 22 09:20:44 juju-e4d256-prod-github-runner-207 kernel: [14218.197356] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 09:20:44 juju-e4d256-prod-github-runner-207 kernel: [14218.199552] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 09:20:44 juju-e4d256-prod-github-runner-207 kernel: [14218.200536] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 09:20:44 juju-e4d256-prod-github-runner-207 kernel: [14218.201484] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 09:20:44 juju-e4d256-prod-github-runner-207 kernel: [14218.202444] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 09:20:44 juju-e4d256-prod-github-runner-207 kernel: [14218.203392] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 09:20:44 juju-e4d256-prod-github-runner-207 kernel: [14218.204347] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 09:20:44 juju-e4d256-prod-github-runner-207 kernel: [14218.205291] Aug 22 09:21:10 juju-e4d256-prod-github-runner-207 kernel: [14244.541981] watchdog: BUG: soft lockup - CPU#1 stuck for 13158s! [qemu-system-x86:6715] Aug 22 09:21:10 juju-e4d256-prod-github-runner-207 kernel: [14244.543473] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 09:21:10 juju-e4d256-prod-github-runner-207 kernel: [14244.543546] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 09:21:10 juju-e4d256-prod-github-runner-207 kernel: [14244.556217] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 09:21:10 juju-e4d256-prod-github-runner-207 kernel: [14244.557542] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 09:21:10 juju-e4d256-prod-github-runner-207 kernel: [14244.558819] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:21:10 juju-e4d256-prod-github-runner-207 kernel: [14244.559937] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 09:21:10 juju-e4d256-prod-github-runner-207 kernel: [14244.562588] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 09:21:10 juju-e4d256-prod-github-runner-207 kernel: [14244.563664] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 09:21:10 juju-e4d256-prod-github-runner-207 kernel: [14244.564957] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 09:21:10 juju-e4d256-prod-github-runner-207 kernel: [14244.566396] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 09:21:10 juju-e4d256-prod-github-runner-207 kernel: [14244.567592] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 09:21:10 juju-e4d256-prod-github-runner-207 kernel: [14244.568800] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 09:21:10 juju-e4d256-prod-github-runner-207 kernel: [14244.570060] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 09:21:10 juju-e4d256-prod-github-runner-207 kernel: [14244.571359] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 09:21:10 juju-e4d256-prod-github-runner-207 kernel: [14244.572472] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 09:21:10 juju-e4d256-prod-github-runner-207 kernel: [14244.573727] Call Trace: Aug 22 09:21:10 juju-e4d256-prod-github-runner-207 kernel: [14244.574692] Aug 22 09:21:10 juju-e4d256-prod-github-runner-207 kernel: [14244.575611] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:21:10 juju-e4d256-prod-github-runner-207 kernel: [14244.576660] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:21:10 juju-e4d256-prod-github-runner-207 kernel: [14244.577706] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:21:10 juju-e4d256-prod-github-runner-207 kernel: [14244.578812] ? show_regs.part.0+0x23/0x29 Aug 22 09:21:10 juju-e4d256-prod-github-runner-207 kernel: [14244.579864] ? show_regs.cold+0x8/0xd Aug 22 09:21:10 juju-e4d256-prod-github-runner-207 kernel: [14244.580970] ? watchdog_timer_fn+0x1be/0x220 Aug 22 09:21:10 juju-e4d256-prod-github-runner-207 kernel: [14244.582193] ? lockup_detector_update_enable+0x60/0x60 Aug 22 09:21:10 juju-e4d256-prod-github-runner-207 kernel: [14244.583303] ? __hrtimer_run_queues+0x107/0x230 Aug 22 09:21:10 juju-e4d256-prod-github-runner-207 kernel: [14244.584390] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 09:21:10 juju-e4d256-prod-github-runner-207 kernel: [14244.585443] ? hrtimer_interrupt+0x101/0x220 Aug 22 09:21:10 juju-e4d256-prod-github-runner-207 kernel: [14244.586505] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 09:21:10 juju-e4d256-prod-github-runner-207 kernel: [14244.587599] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 09:21:10 juju-e4d256-prod-github-runner-207 kernel: [14244.588666] Aug 22 09:21:10 juju-e4d256-prod-github-runner-207 kernel: [14244.589561] Aug 22 09:21:10 juju-e4d256-prod-github-runner-207 kernel: [14244.590469] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 09:21:10 juju-e4d256-prod-github-runner-207 kernel: [14244.591562] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:21:10 juju-e4d256-prod-github-runner-207 kernel: [14244.592631] ? _raw_spin_lock+0x22/0x30 Aug 22 09:21:10 juju-e4d256-prod-github-runner-207 kernel: [14244.593609] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:21:10 juju-e4d256-prod-github-runner-207 kernel: [14244.594693] direct_page_fault+0x206/0x310 [kvm] Aug 22 09:21:10 juju-e4d256-prod-github-runner-207 kernel: [14244.595774] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 09:21:10 juju-e4d256-prod-github-runner-207 kernel: [14244.596859] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 09:21:10 juju-e4d256-prod-github-runner-207 kernel: [14244.597936] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 09:21:10 juju-e4d256-prod-github-runner-207 kernel: [14244.598938] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 09:21:10 juju-e4d256-prod-github-runner-207 kernel: [14244.599893] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 09:21:10 juju-e4d256-prod-github-runner-207 kernel: [14244.600890] handle_exit+0x98/0x230 [kvm_amd] Aug 22 09:21:10 juju-e4d256-prod-github-runner-207 kernel: [14244.601837] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 09:21:10 juju-e4d256-prod-github-runner-207 kernel: [14244.602933] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 09:21:10 juju-e4d256-prod-github-runner-207 kernel: [14244.603986] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 09:21:10 juju-e4d256-prod-github-runner-207 kernel: [14244.604984] vcpu_run+0x62/0x2c0 [kvm] Aug 22 09:21:10 juju-e4d256-prod-github-runner-207 kernel: [14244.605854] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 09:21:10 juju-e4d256-prod-github-runner-207 kernel: [14244.606734] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 09:21:10 juju-e4d256-prod-github-runner-207 kernel: [14244.607614] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 09:21:10 juju-e4d256-prod-github-runner-207 kernel: [14244.608426] ? __seccomp_filter+0x4a/0x4a0 Aug 22 09:21:10 juju-e4d256-prod-github-runner-207 kernel: [14244.609190] ? __fget_files+0x86/0xc0 Aug 22 09:21:10 juju-e4d256-prod-github-runner-207 kernel: [14244.609953] __x64_sys_ioctl+0x95/0xd0 Aug 22 09:21:10 juju-e4d256-prod-github-runner-207 kernel: [14244.610662] do_syscall_64+0x5c/0xc0 Aug 22 09:21:10 juju-e4d256-prod-github-runner-207 kernel: [14244.611347] ? do_futex+0x162/0x1f0 Aug 22 09:21:10 juju-e4d256-prod-github-runner-207 kernel: [14244.612064] ? __x64_sys_futex+0x78/0x1e0 Aug 22 09:21:10 juju-e4d256-prod-github-runner-207 kernel: [14244.612958] ? __secure_computing+0xa9/0x120 Aug 22 09:21:10 juju-e4d256-prod-github-runner-207 kernel: [14244.613749] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 09:21:10 juju-e4d256-prod-github-runner-207 kernel: [14244.614683] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:21:10 juju-e4d256-prod-github-runner-207 kernel: [14244.615531] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:21:10 juju-e4d256-prod-github-runner-207 kernel: [14244.616372] ? do_syscall_64+0x69/0xc0 Aug 22 09:21:10 juju-e4d256-prod-github-runner-207 kernel: [14244.617049] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:21:10 juju-e4d256-prod-github-runner-207 kernel: [14244.617771] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:21:10 juju-e4d256-prod-github-runner-207 kernel: [14244.618502] ? do_syscall_64+0x69/0xc0 Aug 22 09:21:10 juju-e4d256-prod-github-runner-207 kernel: [14244.619135] ? do_syscall_64+0x69/0xc0 Aug 22 09:21:10 juju-e4d256-prod-github-runner-207 kernel: [14244.619904] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 09:21:10 juju-e4d256-prod-github-runner-207 kernel: [14244.620792] RIP: 0033:0x7faa5d0edaff Aug 22 09:21:10 juju-e4d256-prod-github-runner-207 kernel: [14244.621624] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 09:21:10 juju-e4d256-prod-github-runner-207 kernel: [14244.624253] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 09:21:10 juju-e4d256-prod-github-runner-207 kernel: [14244.625361] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 09:21:10 juju-e4d256-prod-github-runner-207 kernel: [14244.626544] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 09:21:10 juju-e4d256-prod-github-runner-207 kernel: [14244.627716] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 09:21:10 juju-e4d256-prod-github-runner-207 kernel: [14244.628766] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 09:21:10 juju-e4d256-prod-github-runner-207 kernel: [14244.629825] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 09:21:10 juju-e4d256-prod-github-runner-207 kernel: [14244.630927] Aug 22 09:21:38 juju-e4d256-prod-github-runner-207 kernel: [14272.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 13184s! [qemu-system-x86:6715] Aug 22 09:21:38 juju-e4d256-prod-github-runner-207 kernel: [14272.543848] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 09:21:38 juju-e4d256-prod-github-runner-207 kernel: [14272.544158] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 09:21:38 juju-e4d256-prod-github-runner-207 kernel: [14272.556303] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 09:21:38 juju-e4d256-prod-github-runner-207 kernel: [14272.557601] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 09:21:38 juju-e4d256-prod-github-runner-207 kernel: [14272.558813] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:21:38 juju-e4d256-prod-github-runner-207 kernel: [14272.560067] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 09:21:38 juju-e4d256-prod-github-runner-207 kernel: [14272.562715] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 09:21:38 juju-e4d256-prod-github-runner-207 kernel: [14272.563755] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 09:21:38 juju-e4d256-prod-github-runner-207 kernel: [14272.564908] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 09:21:38 juju-e4d256-prod-github-runner-207 kernel: [14272.566071] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 09:21:38 juju-e4d256-prod-github-runner-207 kernel: [14272.567230] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 09:21:38 juju-e4d256-prod-github-runner-207 kernel: [14272.568386] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 09:21:38 juju-e4d256-prod-github-runner-207 kernel: [14272.569547] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 09:21:38 juju-e4d256-prod-github-runner-207 kernel: [14272.570805] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 09:21:38 juju-e4d256-prod-github-runner-207 kernel: [14272.571906] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 09:21:38 juju-e4d256-prod-github-runner-207 kernel: [14272.573140] Call Trace: Aug 22 09:21:38 juju-e4d256-prod-github-runner-207 kernel: [14272.574069] Aug 22 09:21:38 juju-e4d256-prod-github-runner-207 kernel: [14272.574967] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:21:38 juju-e4d256-prod-github-runner-207 kernel: [14272.576015] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:21:38 juju-e4d256-prod-github-runner-207 kernel: [14272.577069] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:21:38 juju-e4d256-prod-github-runner-207 kernel: [14272.578193] ? show_regs.part.0+0x23/0x29 Aug 22 09:21:38 juju-e4d256-prod-github-runner-207 kernel: [14272.579194] ? show_regs.cold+0x8/0xd Aug 22 09:21:38 juju-e4d256-prod-github-runner-207 kernel: [14272.580363] ? watchdog_timer_fn+0x1be/0x220 Aug 22 09:21:38 juju-e4d256-prod-github-runner-207 kernel: [14272.581392] ? lockup_detector_update_enable+0x60/0x60 Aug 22 09:21:38 juju-e4d256-prod-github-runner-207 kernel: [14272.582476] ? __hrtimer_run_queues+0x107/0x230 Aug 22 09:21:38 juju-e4d256-prod-github-runner-207 kernel: [14272.583502] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 09:21:38 juju-e4d256-prod-github-runner-207 kernel: [14272.584527] ? hrtimer_interrupt+0x101/0x220 Aug 22 09:21:38 juju-e4d256-prod-github-runner-207 kernel: [14272.585571] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 09:21:38 juju-e4d256-prod-github-runner-207 kernel: [14272.586668] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 09:21:38 juju-e4d256-prod-github-runner-207 kernel: [14272.587715] Aug 22 09:21:38 juju-e4d256-prod-github-runner-207 kernel: [14272.588566] Aug 22 09:21:38 juju-e4d256-prod-github-runner-207 kernel: [14272.589416] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 09:21:38 juju-e4d256-prod-github-runner-207 kernel: [14272.590514] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:21:38 juju-e4d256-prod-github-runner-207 kernel: [14272.591629] ? _raw_spin_lock+0x22/0x30 Aug 22 09:21:38 juju-e4d256-prod-github-runner-207 kernel: [14272.592582] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:21:38 juju-e4d256-prod-github-runner-207 kernel: [14272.593610] direct_page_fault+0x206/0x310 [kvm] Aug 22 09:21:38 juju-e4d256-prod-github-runner-207 kernel: [14272.594637] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 09:21:38 juju-e4d256-prod-github-runner-207 kernel: [14272.595648] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 09:21:38 juju-e4d256-prod-github-runner-207 kernel: [14272.596647] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 09:21:38 juju-e4d256-prod-github-runner-207 kernel: [14272.597659] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 09:21:38 juju-e4d256-prod-github-runner-207 kernel: [14272.598609] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 09:21:38 juju-e4d256-prod-github-runner-207 kernel: [14272.599585] handle_exit+0x98/0x230 [kvm_amd] Aug 22 09:21:38 juju-e4d256-prod-github-runner-207 kernel: [14272.600479] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 09:21:38 juju-e4d256-prod-github-runner-207 kernel: [14272.601424] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 09:21:38 juju-e4d256-prod-github-runner-207 kernel: [14272.602379] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 09:21:38 juju-e4d256-prod-github-runner-207 kernel: [14272.603296] vcpu_run+0x62/0x2c0 [kvm] Aug 22 09:21:38 juju-e4d256-prod-github-runner-207 kernel: [14272.604139] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 09:21:38 juju-e4d256-prod-github-runner-207 kernel: [14272.604946] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 09:21:38 juju-e4d256-prod-github-runner-207 kernel: [14272.605823] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 09:21:38 juju-e4d256-prod-github-runner-207 kernel: [14272.606636] ? __seccomp_filter+0x4a/0x4a0 Aug 22 09:21:38 juju-e4d256-prod-github-runner-207 kernel: [14272.607390] ? __fget_files+0x86/0xc0 Aug 22 09:21:38 juju-e4d256-prod-github-runner-207 kernel: [14272.608108] __x64_sys_ioctl+0x95/0xd0 Aug 22 09:21:38 juju-e4d256-prod-github-runner-207 kernel: [14272.608808] do_syscall_64+0x5c/0xc0 Aug 22 09:21:38 juju-e4d256-prod-github-runner-207 kernel: [14272.609475] ? do_futex+0x162/0x1f0 Aug 22 09:21:38 juju-e4d256-prod-github-runner-207 kernel: [14272.610205] ? __x64_sys_futex+0x78/0x1e0 Aug 22 09:21:38 juju-e4d256-prod-github-runner-207 kernel: [14272.610888] ? __secure_computing+0xa9/0x120 Aug 22 09:21:38 juju-e4d256-prod-github-runner-207 kernel: [14272.611823] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 09:21:38 juju-e4d256-prod-github-runner-207 kernel: [14272.612619] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:21:38 juju-e4d256-prod-github-runner-207 kernel: [14272.613340] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:21:38 juju-e4d256-prod-github-runner-207 kernel: [14272.614086] ? do_syscall_64+0x69/0xc0 Aug 22 09:21:38 juju-e4d256-prod-github-runner-207 kernel: [14272.614731] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:21:38 juju-e4d256-prod-github-runner-207 kernel: [14272.615437] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:21:38 juju-e4d256-prod-github-runner-207 kernel: [14272.616129] ? do_syscall_64+0x69/0xc0 Aug 22 09:21:38 juju-e4d256-prod-github-runner-207 kernel: [14272.616757] ? do_syscall_64+0x69/0xc0 Aug 22 09:21:38 juju-e4d256-prod-github-runner-207 kernel: [14272.617384] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 09:21:38 juju-e4d256-prod-github-runner-207 kernel: [14272.618105] RIP: 0033:0x7faa5d0edaff Aug 22 09:21:38 juju-e4d256-prod-github-runner-207 kernel: [14272.618756] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 09:21:38 juju-e4d256-prod-github-runner-207 kernel: [14272.620781] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 09:21:38 juju-e4d256-prod-github-runner-207 kernel: [14272.621731] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 09:21:38 juju-e4d256-prod-github-runner-207 kernel: [14272.622647] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 09:21:38 juju-e4d256-prod-github-runner-207 kernel: [14272.623543] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 09:21:38 juju-e4d256-prod-github-runner-207 kernel: [14272.624432] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 09:21:38 juju-e4d256-prod-github-runner-207 kernel: [14272.625321] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 09:21:38 juju-e4d256-prod-github-runner-207 kernel: [14272.626234] Aug 22 09:22:06 juju-e4d256-prod-github-runner-207 kernel: [14300.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 13210s! [qemu-system-x86:6715] Aug 22 09:22:06 juju-e4d256-prod-github-runner-207 kernel: [14300.543139] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 09:22:06 juju-e4d256-prod-github-runner-207 kernel: [14300.543214] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 09:22:06 juju-e4d256-prod-github-runner-207 kernel: [14300.556199] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 09:22:06 juju-e4d256-prod-github-runner-207 kernel: [14300.557564] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 09:22:06 juju-e4d256-prod-github-runner-207 kernel: [14300.558806] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:22:06 juju-e4d256-prod-github-runner-207 kernel: [14300.559905] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 09:22:06 juju-e4d256-prod-github-runner-207 kernel: [14300.562661] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 09:22:06 juju-e4d256-prod-github-runner-207 kernel: [14300.563731] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 09:22:06 juju-e4d256-prod-github-runner-207 kernel: [14300.564907] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 09:22:06 juju-e4d256-prod-github-runner-207 kernel: [14300.566096] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 09:22:06 juju-e4d256-prod-github-runner-207 kernel: [14300.567274] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 09:22:06 juju-e4d256-prod-github-runner-207 kernel: [14300.568456] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 09:22:06 juju-e4d256-prod-github-runner-207 kernel: [14300.569665] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 09:22:06 juju-e4d256-prod-github-runner-207 kernel: [14300.570903] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 09:22:06 juju-e4d256-prod-github-runner-207 kernel: [14300.572008] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 09:22:06 juju-e4d256-prod-github-runner-207 kernel: [14300.573204] Call Trace: Aug 22 09:22:06 juju-e4d256-prod-github-runner-207 kernel: [14300.574132] Aug 22 09:22:06 juju-e4d256-prod-github-runner-207 kernel: [14300.575023] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:22:06 juju-e4d256-prod-github-runner-207 kernel: [14300.576056] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:22:06 juju-e4d256-prod-github-runner-207 kernel: [14300.577085] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:22:06 juju-e4d256-prod-github-runner-207 kernel: [14300.578180] ? show_regs.part.0+0x23/0x29 Aug 22 09:22:06 juju-e4d256-prod-github-runner-207 kernel: [14300.579176] ? show_regs.cold+0x8/0xd Aug 22 09:22:06 juju-e4d256-prod-github-runner-207 kernel: [14300.580146] ? watchdog_timer_fn+0x1be/0x220 Aug 22 09:22:06 juju-e4d256-prod-github-runner-207 kernel: [14300.581153] ? lockup_detector_update_enable+0x60/0x60 Aug 22 09:22:06 juju-e4d256-prod-github-runner-207 kernel: [14300.582230] ? __hrtimer_run_queues+0x107/0x230 Aug 22 09:22:06 juju-e4d256-prod-github-runner-207 kernel: [14300.583257] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 09:22:06 juju-e4d256-prod-github-runner-207 kernel: [14300.584281] ? hrtimer_interrupt+0x101/0x220 Aug 22 09:22:06 juju-e4d256-prod-github-runner-207 kernel: [14300.585310] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 09:22:06 juju-e4d256-prod-github-runner-207 kernel: [14300.586384] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 09:22:06 juju-e4d256-prod-github-runner-207 kernel: [14300.587431] Aug 22 09:22:06 juju-e4d256-prod-github-runner-207 kernel: [14300.588289] Aug 22 09:22:06 juju-e4d256-prod-github-runner-207 kernel: [14300.589127] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 09:22:06 juju-e4d256-prod-github-runner-207 kernel: [14300.590174] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:22:06 juju-e4d256-prod-github-runner-207 kernel: [14300.591215] ? _raw_spin_lock+0x22/0x30 Aug 22 09:22:06 juju-e4d256-prod-github-runner-207 kernel: [14300.592162] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:22:06 juju-e4d256-prod-github-runner-207 kernel: [14300.593183] direct_page_fault+0x206/0x310 [kvm] Aug 22 09:22:06 juju-e4d256-prod-github-runner-207 kernel: [14300.594228] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 09:22:06 juju-e4d256-prod-github-runner-207 kernel: [14300.595242] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 09:22:06 juju-e4d256-prod-github-runner-207 kernel: [14300.596245] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 09:22:06 juju-e4d256-prod-github-runner-207 kernel: [14300.597277] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 09:22:06 juju-e4d256-prod-github-runner-207 kernel: [14300.598273] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 09:22:06 juju-e4d256-prod-github-runner-207 kernel: [14300.599282] handle_exit+0x98/0x230 [kvm_amd] Aug 22 09:22:06 juju-e4d256-prod-github-runner-207 kernel: [14300.600222] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 09:22:06 juju-e4d256-prod-github-runner-207 kernel: [14300.601169] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 09:22:06 juju-e4d256-prod-github-runner-207 kernel: [14300.602126] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 09:22:06 juju-e4d256-prod-github-runner-207 kernel: [14300.603033] vcpu_run+0x62/0x2c0 [kvm] Aug 22 09:22:06 juju-e4d256-prod-github-runner-207 kernel: [14300.603846] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 09:22:06 juju-e4d256-prod-github-runner-207 kernel: [14300.604680] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 09:22:06 juju-e4d256-prod-github-runner-207 kernel: [14300.605555] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 09:22:06 juju-e4d256-prod-github-runner-207 kernel: [14300.606353] ? __seccomp_filter+0x4a/0x4a0 Aug 22 09:22:06 juju-e4d256-prod-github-runner-207 kernel: [14300.607096] ? __fget_files+0x86/0xc0 Aug 22 09:22:06 juju-e4d256-prod-github-runner-207 kernel: [14300.607804] __x64_sys_ioctl+0x95/0xd0 Aug 22 09:22:06 juju-e4d256-prod-github-runner-207 kernel: [14300.608497] do_syscall_64+0x5c/0xc0 Aug 22 09:22:06 juju-e4d256-prod-github-runner-207 kernel: [14300.609163] ? do_futex+0x162/0x1f0 Aug 22 09:22:06 juju-e4d256-prod-github-runner-207 kernel: [14300.609849] ? __x64_sys_futex+0x78/0x1e0 Aug 22 09:22:06 juju-e4d256-prod-github-runner-207 kernel: [14300.610524] ? __secure_computing+0xa9/0x120 Aug 22 09:22:06 juju-e4d256-prod-github-runner-207 kernel: [14300.611213] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 09:22:06 juju-e4d256-prod-github-runner-207 kernel: [14300.611971] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:22:06 juju-e4d256-prod-github-runner-207 kernel: [14300.612691] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:22:06 juju-e4d256-prod-github-runner-207 kernel: [14300.613480] ? do_syscall_64+0x69/0xc0 Aug 22 09:22:06 juju-e4d256-prod-github-runner-207 kernel: [14300.614150] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:22:06 juju-e4d256-prod-github-runner-207 kernel: [14300.614887] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:22:06 juju-e4d256-prod-github-runner-207 kernel: [14300.615666] ? do_syscall_64+0x69/0xc0 Aug 22 09:22:06 juju-e4d256-prod-github-runner-207 kernel: [14300.616293] ? do_syscall_64+0x69/0xc0 Aug 22 09:22:06 juju-e4d256-prod-github-runner-207 kernel: [14300.616916] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 09:22:06 juju-e4d256-prod-github-runner-207 kernel: [14300.617681] RIP: 0033:0x7faa5d0edaff Aug 22 09:22:06 juju-e4d256-prod-github-runner-207 kernel: [14300.618316] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 09:22:06 juju-e4d256-prod-github-runner-207 kernel: [14300.620357] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 09:22:06 juju-e4d256-prod-github-runner-207 kernel: [14300.621283] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 09:22:06 juju-e4d256-prod-github-runner-207 kernel: [14300.622180] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 09:22:06 juju-e4d256-prod-github-runner-207 kernel: [14300.623069] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 09:22:06 juju-e4d256-prod-github-runner-207 kernel: [14300.623957] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 09:22:06 juju-e4d256-prod-github-runner-207 kernel: [14300.624874] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 09:22:06 juju-e4d256-prod-github-runner-207 kernel: [14300.625804] Aug 22 09:22:34 juju-e4d256-prod-github-runner-207 kernel: [14328.541981] watchdog: BUG: soft lockup - CPU#1 stuck for 13236s! [qemu-system-x86:6715] Aug 22 09:22:34 juju-e4d256-prod-github-runner-207 kernel: [14328.543137] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 09:22:34 juju-e4d256-prod-github-runner-207 kernel: [14328.543212] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 09:22:34 juju-e4d256-prod-github-runner-207 kernel: [14328.555512] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 09:22:34 juju-e4d256-prod-github-runner-207 kernel: [14328.556791] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 09:22:34 juju-e4d256-prod-github-runner-207 kernel: [14328.558057] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:22:34 juju-e4d256-prod-github-runner-207 kernel: [14328.559124] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 09:22:34 juju-e4d256-prod-github-runner-207 kernel: [14328.561722] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 09:22:34 juju-e4d256-prod-github-runner-207 kernel: [14328.562779] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 09:22:34 juju-e4d256-prod-github-runner-207 kernel: [14328.563973] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 09:22:34 juju-e4d256-prod-github-runner-207 kernel: [14328.565167] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 09:22:34 juju-e4d256-prod-github-runner-207 kernel: [14328.566328] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 09:22:34 juju-e4d256-prod-github-runner-207 kernel: [14328.567482] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 09:22:34 juju-e4d256-prod-github-runner-207 kernel: [14328.568642] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 09:22:34 juju-e4d256-prod-github-runner-207 kernel: [14328.570102] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 09:22:34 juju-e4d256-prod-github-runner-207 kernel: [14328.571382] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 09:22:34 juju-e4d256-prod-github-runner-207 kernel: [14328.572624] Call Trace: Aug 22 09:22:34 juju-e4d256-prod-github-runner-207 kernel: [14328.573572] Aug 22 09:22:34 juju-e4d256-prod-github-runner-207 kernel: [14328.574476] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:22:34 juju-e4d256-prod-github-runner-207 kernel: [14328.575507] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:22:34 juju-e4d256-prod-github-runner-207 kernel: [14328.576561] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:22:34 juju-e4d256-prod-github-runner-207 kernel: [14328.577809] ? show_regs.part.0+0x23/0x29 Aug 22 09:22:34 juju-e4d256-prod-github-runner-207 kernel: [14328.578823] ? show_regs.cold+0x8/0xd Aug 22 09:22:34 juju-e4d256-prod-github-runner-207 kernel: [14328.579796] ? watchdog_timer_fn+0x1be/0x220 Aug 22 09:22:34 juju-e4d256-prod-github-runner-207 kernel: [14328.580844] ? lockup_detector_update_enable+0x60/0x60 Aug 22 09:22:34 juju-e4d256-prod-github-runner-207 kernel: [14328.581965] ? __hrtimer_run_queues+0x107/0x230 Aug 22 09:22:34 juju-e4d256-prod-github-runner-207 kernel: [14328.583038] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 09:22:34 juju-e4d256-prod-github-runner-207 kernel: [14328.584063] ? hrtimer_interrupt+0x101/0x220 Aug 22 09:22:34 juju-e4d256-prod-github-runner-207 kernel: [14328.585118] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 09:22:34 juju-e4d256-prod-github-runner-207 kernel: [14328.586190] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 09:22:34 juju-e4d256-prod-github-runner-207 kernel: [14328.587235] Aug 22 09:22:34 juju-e4d256-prod-github-runner-207 kernel: [14328.588091] Aug 22 09:22:34 juju-e4d256-prod-github-runner-207 kernel: [14328.588947] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 09:22:34 juju-e4d256-prod-github-runner-207 kernel: [14328.589983] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:22:34 juju-e4d256-prod-github-runner-207 kernel: [14328.591030] ? _raw_spin_lock+0x22/0x30 Aug 22 09:22:34 juju-e4d256-prod-github-runner-207 kernel: [14328.591976] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:22:34 juju-e4d256-prod-github-runner-207 kernel: [14328.593041] direct_page_fault+0x206/0x310 [kvm] Aug 22 09:22:34 juju-e4d256-prod-github-runner-207 kernel: [14328.594077] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 09:22:34 juju-e4d256-prod-github-runner-207 kernel: [14328.595089] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 09:22:34 juju-e4d256-prod-github-runner-207 kernel: [14328.596088] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 09:22:34 juju-e4d256-prod-github-runner-207 kernel: [14328.597069] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 09:22:34 juju-e4d256-prod-github-runner-207 kernel: [14328.598015] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 09:22:34 juju-e4d256-prod-github-runner-207 kernel: [14328.599010] handle_exit+0x98/0x230 [kvm_amd] Aug 22 09:22:34 juju-e4d256-prod-github-runner-207 kernel: [14328.599905] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 09:22:34 juju-e4d256-prod-github-runner-207 kernel: [14328.600818] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 09:22:34 juju-e4d256-prod-github-runner-207 kernel: [14328.601818] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 09:22:34 juju-e4d256-prod-github-runner-207 kernel: [14328.602741] vcpu_run+0x62/0x2c0 [kvm] Aug 22 09:22:34 juju-e4d256-prod-github-runner-207 kernel: [14328.603571] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 09:22:34 juju-e4d256-prod-github-runner-207 kernel: [14328.604384] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 09:22:34 juju-e4d256-prod-github-runner-207 kernel: [14328.605408] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 09:22:34 juju-e4d256-prod-github-runner-207 kernel: [14328.606220] ? __seccomp_filter+0x4a/0x4a0 Aug 22 09:22:34 juju-e4d256-prod-github-runner-207 kernel: [14328.606966] ? __fget_files+0x86/0xc0 Aug 22 09:22:34 juju-e4d256-prod-github-runner-207 kernel: [14328.607713] __x64_sys_ioctl+0x95/0xd0 Aug 22 09:22:34 juju-e4d256-prod-github-runner-207 kernel: [14328.608420] do_syscall_64+0x5c/0xc0 Aug 22 09:22:34 juju-e4d256-prod-github-runner-207 kernel: [14328.609107] ? do_futex+0x162/0x1f0 Aug 22 09:22:34 juju-e4d256-prod-github-runner-207 kernel: [14328.609758] ? __x64_sys_futex+0x78/0x1e0 Aug 22 09:22:34 juju-e4d256-prod-github-runner-207 kernel: [14328.610433] ? __secure_computing+0xa9/0x120 Aug 22 09:22:34 juju-e4d256-prod-github-runner-207 kernel: [14328.611149] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 09:22:34 juju-e4d256-prod-github-runner-207 kernel: [14328.611923] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:22:34 juju-e4d256-prod-github-runner-207 kernel: [14328.612644] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:22:34 juju-e4d256-prod-github-runner-207 kernel: [14328.613390] ? do_syscall_64+0x69/0xc0 Aug 22 09:22:34 juju-e4d256-prod-github-runner-207 kernel: [14328.614034] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:22:34 juju-e4d256-prod-github-runner-207 kernel: [14328.614757] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:22:34 juju-e4d256-prod-github-runner-207 kernel: [14328.615455] ? do_syscall_64+0x69/0xc0 Aug 22 09:22:34 juju-e4d256-prod-github-runner-207 kernel: [14328.616079] ? do_syscall_64+0x69/0xc0 Aug 22 09:22:34 juju-e4d256-prod-github-runner-207 kernel: [14328.616701] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 09:22:34 juju-e4d256-prod-github-runner-207 kernel: [14328.617427] RIP: 0033:0x7faa5d0edaff Aug 22 09:22:34 juju-e4d256-prod-github-runner-207 kernel: [14328.618053] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 09:22:34 juju-e4d256-prod-github-runner-207 kernel: [14328.620045] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 09:22:34 juju-e4d256-prod-github-runner-207 kernel: [14328.620976] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 09:22:34 juju-e4d256-prod-github-runner-207 kernel: [14328.621867] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 09:22:34 juju-e4d256-prod-github-runner-207 kernel: [14328.622769] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 09:22:34 juju-e4d256-prod-github-runner-207 kernel: [14328.623662] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 09:22:34 juju-e4d256-prod-github-runner-207 kernel: [14328.624815] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 09:22:34 juju-e4d256-prod-github-runner-207 kernel: [14328.625871] Aug 22 09:23:02 juju-e4d256-prod-github-runner-207 kernel: [14356.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 13262s! [qemu-system-x86:6715] Aug 22 09:23:02 juju-e4d256-prod-github-runner-207 kernel: [14356.543184] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 09:23:02 juju-e4d256-prod-github-runner-207 kernel: [14356.543439] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 09:23:02 juju-e4d256-prod-github-runner-207 kernel: [14356.556128] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 09:23:02 juju-e4d256-prod-github-runner-207 kernel: [14356.557603] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 09:23:02 juju-e4d256-prod-github-runner-207 kernel: [14356.558838] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:23:02 juju-e4d256-prod-github-runner-207 kernel: [14356.559900] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 09:23:02 juju-e4d256-prod-github-runner-207 kernel: [14356.562521] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 09:23:02 juju-e4d256-prod-github-runner-207 kernel: [14356.563602] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 09:23:02 juju-e4d256-prod-github-runner-207 kernel: [14356.564959] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 09:23:02 juju-e4d256-prod-github-runner-207 kernel: [14356.566133] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 09:23:02 juju-e4d256-prod-github-runner-207 kernel: [14356.567307] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 09:23:02 juju-e4d256-prod-github-runner-207 kernel: [14356.568483] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 09:23:02 juju-e4d256-prod-github-runner-207 kernel: [14356.569667] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 09:23:02 juju-e4d256-prod-github-runner-207 kernel: [14356.570898] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 09:23:02 juju-e4d256-prod-github-runner-207 kernel: [14356.572002] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 09:23:02 juju-e4d256-prod-github-runner-207 kernel: [14356.573219] Call Trace: Aug 22 09:23:02 juju-e4d256-prod-github-runner-207 kernel: [14356.574136] Aug 22 09:23:02 juju-e4d256-prod-github-runner-207 kernel: [14356.575042] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:23:02 juju-e4d256-prod-github-runner-207 kernel: [14356.576261] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:23:02 juju-e4d256-prod-github-runner-207 kernel: [14356.577345] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:23:02 juju-e4d256-prod-github-runner-207 kernel: [14356.578461] ? show_regs.part.0+0x23/0x29 Aug 22 09:23:02 juju-e4d256-prod-github-runner-207 kernel: [14356.579462] ? show_regs.cold+0x8/0xd Aug 22 09:23:02 juju-e4d256-prod-github-runner-207 kernel: [14356.580438] ? watchdog_timer_fn+0x1be/0x220 Aug 22 09:23:02 juju-e4d256-prod-github-runner-207 kernel: [14356.581457] ? lockup_detector_update_enable+0x60/0x60 Aug 22 09:23:02 juju-e4d256-prod-github-runner-207 kernel: [14356.582526] ? __hrtimer_run_queues+0x107/0x230 Aug 22 09:23:02 juju-e4d256-prod-github-runner-207 kernel: [14356.583557] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 09:23:02 juju-e4d256-prod-github-runner-207 kernel: [14356.584774] ? hrtimer_interrupt+0x101/0x220 Aug 22 09:23:02 juju-e4d256-prod-github-runner-207 kernel: [14356.585795] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 09:23:02 juju-e4d256-prod-github-runner-207 kernel: [14356.586867] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 09:23:02 juju-e4d256-prod-github-runner-207 kernel: [14356.587912] Aug 22 09:23:02 juju-e4d256-prod-github-runner-207 kernel: [14356.588810] Aug 22 09:23:02 juju-e4d256-prod-github-runner-207 kernel: [14356.589683] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 09:23:02 juju-e4d256-prod-github-runner-207 kernel: [14356.590818] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:23:02 juju-e4d256-prod-github-runner-207 kernel: [14356.591904] ? _raw_spin_lock+0x22/0x30 Aug 22 09:23:02 juju-e4d256-prod-github-runner-207 kernel: [14356.592867] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:23:02 juju-e4d256-prod-github-runner-207 kernel: [14356.593886] direct_page_fault+0x206/0x310 [kvm] Aug 22 09:23:02 juju-e4d256-prod-github-runner-207 kernel: [14356.594908] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 09:23:02 juju-e4d256-prod-github-runner-207 kernel: [14356.595940] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 09:23:02 juju-e4d256-prod-github-runner-207 kernel: [14356.596980] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 09:23:02 juju-e4d256-prod-github-runner-207 kernel: [14356.598049] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 09:23:02 juju-e4d256-prod-github-runner-207 kernel: [14356.599006] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 09:23:02 juju-e4d256-prod-github-runner-207 kernel: [14356.599989] handle_exit+0x98/0x230 [kvm_amd] Aug 22 09:23:02 juju-e4d256-prod-github-runner-207 kernel: [14356.600904] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 09:23:02 juju-e4d256-prod-github-runner-207 kernel: [14356.601852] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 09:23:02 juju-e4d256-prod-github-runner-207 kernel: [14356.602786] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 09:23:02 juju-e4d256-prod-github-runner-207 kernel: [14356.603694] vcpu_run+0x62/0x2c0 [kvm] Aug 22 09:23:02 juju-e4d256-prod-github-runner-207 kernel: [14356.604524] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 09:23:02 juju-e4d256-prod-github-runner-207 kernel: [14356.605375] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 09:23:02 juju-e4d256-prod-github-runner-207 kernel: [14356.606235] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 09:23:02 juju-e4d256-prod-github-runner-207 kernel: [14356.607164] ? __seccomp_filter+0x4a/0x4a0 Aug 22 09:23:02 juju-e4d256-prod-github-runner-207 kernel: [14356.607989] ? __fget_files+0x86/0xc0 Aug 22 09:23:02 juju-e4d256-prod-github-runner-207 kernel: [14356.608732] __x64_sys_ioctl+0x95/0xd0 Aug 22 09:23:02 juju-e4d256-prod-github-runner-207 kernel: [14356.609447] do_syscall_64+0x5c/0xc0 Aug 22 09:23:02 juju-e4d256-prod-github-runner-207 kernel: [14356.610124] ? do_futex+0x162/0x1f0 Aug 22 09:23:02 juju-e4d256-prod-github-runner-207 kernel: [14356.610775] ? __x64_sys_futex+0x78/0x1e0 Aug 22 09:23:02 juju-e4d256-prod-github-runner-207 kernel: [14356.611452] ? __secure_computing+0xa9/0x120 Aug 22 09:23:02 juju-e4d256-prod-github-runner-207 kernel: [14356.612144] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 09:23:02 juju-e4d256-prod-github-runner-207 kernel: [14356.612917] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:23:02 juju-e4d256-prod-github-runner-207 kernel: [14356.613640] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:23:02 juju-e4d256-prod-github-runner-207 kernel: [14356.614365] ? do_syscall_64+0x69/0xc0 Aug 22 09:23:02 juju-e4d256-prod-github-runner-207 kernel: [14356.615032] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:23:02 juju-e4d256-prod-github-runner-207 kernel: [14356.615749] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:23:02 juju-e4d256-prod-github-runner-207 kernel: [14356.616452] ? do_syscall_64+0x69/0xc0 Aug 22 09:23:02 juju-e4d256-prod-github-runner-207 kernel: [14356.617110] ? do_syscall_64+0x69/0xc0 Aug 22 09:23:02 juju-e4d256-prod-github-runner-207 kernel: [14356.617732] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 09:23:02 juju-e4d256-prod-github-runner-207 kernel: [14356.618453] RIP: 0033:0x7faa5d0edaff Aug 22 09:23:02 juju-e4d256-prod-github-runner-207 kernel: [14356.619121] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 09:23:02 juju-e4d256-prod-github-runner-207 kernel: [14356.621143] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 09:23:02 juju-e4d256-prod-github-runner-207 kernel: [14356.622076] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 09:23:02 juju-e4d256-prod-github-runner-207 kernel: [14356.623040] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 09:23:02 juju-e4d256-prod-github-runner-207 kernel: [14356.623938] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 09:23:02 juju-e4d256-prod-github-runner-207 kernel: [14356.624839] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 09:23:02 juju-e4d256-prod-github-runner-207 kernel: [14356.625841] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 09:23:02 juju-e4d256-prod-github-runner-207 kernel: [14356.626777] Aug 22 09:23:30 juju-e4d256-prod-github-runner-207 kernel: [14384.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 13288s! [qemu-system-x86:6715] Aug 22 09:23:30 juju-e4d256-prod-github-runner-207 kernel: [14384.543750] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 09:23:30 juju-e4d256-prod-github-runner-207 kernel: [14384.543918] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 09:23:30 juju-e4d256-prod-github-runner-207 kernel: [14384.557010] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 09:23:30 juju-e4d256-prod-github-runner-207 kernel: [14384.558342] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 09:23:30 juju-e4d256-prod-github-runner-207 kernel: [14384.559573] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:23:30 juju-e4d256-prod-github-runner-207 kernel: [14384.560649] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 09:23:30 juju-e4d256-prod-github-runner-207 kernel: [14384.563206] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 09:23:30 juju-e4d256-prod-github-runner-207 kernel: [14384.564278] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 09:23:30 juju-e4d256-prod-github-runner-207 kernel: [14384.565513] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 09:23:30 juju-e4d256-prod-github-runner-207 kernel: [14384.566732] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 09:23:30 juju-e4d256-prod-github-runner-207 kernel: [14384.567982] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 09:23:30 juju-e4d256-prod-github-runner-207 kernel: [14384.569179] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 09:23:30 juju-e4d256-prod-github-runner-207 kernel: [14384.570364] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 09:23:30 juju-e4d256-prod-github-runner-207 kernel: [14384.571596] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 09:23:30 juju-e4d256-prod-github-runner-207 kernel: [14384.572926] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 09:23:30 juju-e4d256-prod-github-runner-207 kernel: [14384.574228] Call Trace: Aug 22 09:23:30 juju-e4d256-prod-github-runner-207 kernel: [14384.575278] Aug 22 09:23:30 juju-e4d256-prod-github-runner-207 kernel: [14384.576278] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:23:30 juju-e4d256-prod-github-runner-207 kernel: [14384.577320] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:23:30 juju-e4d256-prod-github-runner-207 kernel: [14384.578348] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:23:30 juju-e4d256-prod-github-runner-207 kernel: [14384.579427] ? show_regs.part.0+0x23/0x29 Aug 22 09:23:30 juju-e4d256-prod-github-runner-207 kernel: [14384.580453] ? show_regs.cold+0x8/0xd Aug 22 09:23:30 juju-e4d256-prod-github-runner-207 kernel: [14384.581434] ? watchdog_timer_fn+0x1be/0x220 Aug 22 09:23:30 juju-e4d256-prod-github-runner-207 kernel: [14384.582487] ? lockup_detector_update_enable+0x60/0x60 Aug 22 09:23:30 juju-e4d256-prod-github-runner-207 kernel: [14384.583715] ? __hrtimer_run_queues+0x107/0x230 Aug 22 09:23:30 juju-e4d256-prod-github-runner-207 kernel: [14384.584893] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 09:23:30 juju-e4d256-prod-github-runner-207 kernel: [14384.586149] ? hrtimer_interrupt+0x101/0x220 Aug 22 09:23:30 juju-e4d256-prod-github-runner-207 kernel: [14384.587207] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 09:23:30 juju-e4d256-prod-github-runner-207 kernel: [14384.588300] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 09:23:30 juju-e4d256-prod-github-runner-207 kernel: [14384.589351] Aug 22 09:23:30 juju-e4d256-prod-github-runner-207 kernel: [14384.590206] Aug 22 09:23:30 juju-e4d256-prod-github-runner-207 kernel: [14384.591045] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 09:23:30 juju-e4d256-prod-github-runner-207 kernel: [14384.592171] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:23:30 juju-e4d256-prod-github-runner-207 kernel: [14384.593384] ? _raw_spin_lock+0x22/0x30 Aug 22 09:23:30 juju-e4d256-prod-github-runner-207 kernel: [14384.594440] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:23:30 juju-e4d256-prod-github-runner-207 kernel: [14384.595624] direct_page_fault+0x206/0x310 [kvm] Aug 22 09:23:30 juju-e4d256-prod-github-runner-207 kernel: [14384.596867] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 09:23:30 juju-e4d256-prod-github-runner-207 kernel: [14384.597931] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 09:23:30 juju-e4d256-prod-github-runner-207 kernel: [14384.598990] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 09:23:30 juju-e4d256-prod-github-runner-207 kernel: [14384.600033] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 09:23:30 juju-e4d256-prod-github-runner-207 kernel: [14384.601042] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 09:23:30 juju-e4d256-prod-github-runner-207 kernel: [14384.602070] handle_exit+0x98/0x230 [kvm_amd] Aug 22 09:23:30 juju-e4d256-prod-github-runner-207 kernel: [14384.602971] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 09:23:30 juju-e4d256-prod-github-runner-207 kernel: [14384.603942] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 09:23:30 juju-e4d256-prod-github-runner-207 kernel: [14384.604918] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 09:23:30 juju-e4d256-prod-github-runner-207 kernel: [14384.605859] vcpu_run+0x62/0x2c0 [kvm] Aug 22 09:23:30 juju-e4d256-prod-github-runner-207 kernel: [14384.606765] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 09:23:30 juju-e4d256-prod-github-runner-207 kernel: [14384.607629] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 09:23:30 juju-e4d256-prod-github-runner-207 kernel: [14384.608510] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 09:23:30 juju-e4d256-prod-github-runner-207 kernel: [14384.609404] ? __seccomp_filter+0x4a/0x4a0 Aug 22 09:23:30 juju-e4d256-prod-github-runner-207 kernel: [14384.610160] ? __fget_files+0x86/0xc0 Aug 22 09:23:30 juju-e4d256-prod-github-runner-207 kernel: [14384.610873] __x64_sys_ioctl+0x95/0xd0 Aug 22 09:23:30 juju-e4d256-prod-github-runner-207 kernel: [14384.611571] do_syscall_64+0x5c/0xc0 Aug 22 09:23:30 juju-e4d256-prod-github-runner-207 kernel: [14384.612266] ? do_futex+0x162/0x1f0 Aug 22 09:23:30 juju-e4d256-prod-github-runner-207 kernel: [14384.612919] ? __x64_sys_futex+0x78/0x1e0 Aug 22 09:23:30 juju-e4d256-prod-github-runner-207 kernel: [14384.613597] ? __secure_computing+0xa9/0x120 Aug 22 09:23:30 juju-e4d256-prod-github-runner-207 kernel: [14384.614289] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 09:23:30 juju-e4d256-prod-github-runner-207 kernel: [14384.615053] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:23:30 juju-e4d256-prod-github-runner-207 kernel: [14384.615781] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:23:30 juju-e4d256-prod-github-runner-207 kernel: [14384.616533] ? do_syscall_64+0x69/0xc0 Aug 22 09:23:30 juju-e4d256-prod-github-runner-207 kernel: [14384.617193] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:23:30 juju-e4d256-prod-github-runner-207 kernel: [14384.617898] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:23:30 juju-e4d256-prod-github-runner-207 kernel: [14384.618596] ? do_syscall_64+0x69/0xc0 Aug 22 09:23:30 juju-e4d256-prod-github-runner-207 kernel: [14384.619222] ? do_syscall_64+0x69/0xc0 Aug 22 09:23:30 juju-e4d256-prod-github-runner-207 kernel: [14384.619866] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 09:23:30 juju-e4d256-prod-github-runner-207 kernel: [14384.620601] RIP: 0033:0x7faa5d0edaff Aug 22 09:23:30 juju-e4d256-prod-github-runner-207 kernel: [14384.621230] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 09:23:30 juju-e4d256-prod-github-runner-207 kernel: [14384.623222] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 09:23:30 juju-e4d256-prod-github-runner-207 kernel: [14384.624133] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 09:23:30 juju-e4d256-prod-github-runner-207 kernel: [14384.625065] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 09:23:30 juju-e4d256-prod-github-runner-207 kernel: [14384.626009] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 09:23:30 juju-e4d256-prod-github-runner-207 kernel: [14384.626917] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 09:23:30 juju-e4d256-prod-github-runner-207 kernel: [14384.627818] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 09:23:30 juju-e4d256-prod-github-runner-207 kernel: [14384.628739] Aug 22 09:23:44 juju-e4d256-prod-github-runner-207 kernel: [14398.148708] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 09:23:44 juju-e4d256-prod-github-runner-207 kernel: [14398.149857] rcu: 1-....: (3559069 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=1719309 Aug 22 09:23:44 juju-e4d256-prod-github-runner-207 kernel: [14398.151000] (t=3570237 jiffies g=23269 q=21954) Aug 22 09:23:44 juju-e4d256-prod-github-runner-207 kernel: [14398.151825] NMI backtrace for cpu 1 Aug 22 09:23:44 juju-e4d256-prod-github-runner-207 kernel: [14398.152556] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 09:23:44 juju-e4d256-prod-github-runner-207 kernel: [14398.153661] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 09:23:44 juju-e4d256-prod-github-runner-207 kernel: [14398.154716] Call Trace: Aug 22 09:23:44 juju-e4d256-prod-github-runner-207 kernel: [14398.155390] Aug 22 09:23:44 juju-e4d256-prod-github-runner-207 kernel: [14398.156033] show_stack+0x52/0x5c Aug 22 09:23:44 juju-e4d256-prod-github-runner-207 kernel: [14398.156778] dump_stack_lvl+0x4a/0x63 Aug 22 09:23:44 juju-e4d256-prod-github-runner-207 kernel: [14398.157578] dump_stack+0x10/0x16 Aug 22 09:23:44 juju-e4d256-prod-github-runner-207 kernel: [14398.158306] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 09:23:44 juju-e4d256-prod-github-runner-207 kernel: [14398.159113] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 09:23:44 juju-e4d256-prod-github-runner-207 kernel: [14398.159906] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 09:23:44 juju-e4d256-prod-github-runner-207 kernel: [14398.160759] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 09:23:44 juju-e4d256-prod-github-runner-207 kernel: [14398.161612] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 09:23:44 juju-e4d256-prod-github-runner-207 kernel: [14398.162423] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 09:23:44 juju-e4d256-prod-github-runner-207 kernel: [14398.163194] print_cpu_stall.cold+0x2f/0xe2 Aug 22 09:23:44 juju-e4d256-prod-github-runner-207 kernel: [14398.163956] ? timekeeping_update+0xf7/0x150 Aug 22 09:23:44 juju-e4d256-prod-github-runner-207 kernel: [14398.164745] check_cpu_stall+0x109/0x270 Aug 22 09:23:44 juju-e4d256-prod-github-runner-207 kernel: [14398.165494] rcu_sched_clock_irq+0x9a/0x250 Aug 22 09:23:44 juju-e4d256-prod-github-runner-207 kernel: [14398.166252] update_process_times+0x94/0xd0 Aug 22 09:23:44 juju-e4d256-prod-github-runner-207 kernel: [14398.167014] tick_sched_handle+0x29/0x70 Aug 22 09:23:44 juju-e4d256-prod-github-runner-207 kernel: [14398.167756] tick_sched_timer+0x8c/0xc0 Aug 22 09:23:44 juju-e4d256-prod-github-runner-207 kernel: [14398.168510] ? tick_nohz_handler+0xb0/0xb0 Aug 22 09:23:44 juju-e4d256-prod-github-runner-207 kernel: [14398.169266] __hrtimer_run_queues+0x107/0x230 Aug 22 09:23:44 juju-e4d256-prod-github-runner-207 kernel: [14398.170039] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 09:23:44 juju-e4d256-prod-github-runner-207 kernel: [14398.170813] hrtimer_interrupt+0x101/0x220 Aug 22 09:23:44 juju-e4d256-prod-github-runner-207 kernel: [14398.171570] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 09:23:44 juju-e4d256-prod-github-runner-207 kernel: [14398.172389] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 09:23:44 juju-e4d256-prod-github-runner-207 kernel: [14398.173189] Aug 22 09:23:44 juju-e4d256-prod-github-runner-207 kernel: [14398.173821] Aug 22 09:23:44 juju-e4d256-prod-github-runner-207 kernel: [14398.174448] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 09:23:44 juju-e4d256-prod-github-runner-207 kernel: [14398.175265] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:23:44 juju-e4d256-prod-github-runner-207 kernel: [14398.176170] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 09:23:44 juju-e4d256-prod-github-runner-207 kernel: [14398.178467] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 09:23:44 juju-e4d256-prod-github-runner-207 kernel: [14398.179357] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 09:23:44 juju-e4d256-prod-github-runner-207 kernel: [14398.180380] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 09:23:44 juju-e4d256-prod-github-runner-207 kernel: [14398.181368] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 09:23:44 juju-e4d256-prod-github-runner-207 kernel: [14398.182351] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 09:23:44 juju-e4d256-prod-github-runner-207 kernel: [14398.183333] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 09:23:44 juju-e4d256-prod-github-runner-207 kernel: [14398.184316] ? _raw_spin_lock+0x22/0x30 Aug 22 09:23:44 juju-e4d256-prod-github-runner-207 kernel: [14398.185079] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:23:44 juju-e4d256-prod-github-runner-207 kernel: [14398.185925] direct_page_fault+0x206/0x310 [kvm] Aug 22 09:23:44 juju-e4d256-prod-github-runner-207 kernel: [14398.186787] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 09:23:44 juju-e4d256-prod-github-runner-207 kernel: [14398.187658] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 09:23:44 juju-e4d256-prod-github-runner-207 kernel: [14398.188500] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 09:23:44 juju-e4d256-prod-github-runner-207 kernel: [14398.189307] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 09:23:44 juju-e4d256-prod-github-runner-207 kernel: [14398.190106] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 09:23:44 juju-e4d256-prod-github-runner-207 kernel: [14398.190938] handle_exit+0x98/0x230 [kvm_amd] Aug 22 09:23:44 juju-e4d256-prod-github-runner-207 kernel: [14398.191692] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 09:23:44 juju-e4d256-prod-github-runner-207 kernel: [14398.192489] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 09:23:44 juju-e4d256-prod-github-runner-207 kernel: [14398.193289] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 09:23:44 juju-e4d256-prod-github-runner-207 kernel: [14398.194107] vcpu_run+0x62/0x2c0 [kvm] Aug 22 09:23:44 juju-e4d256-prod-github-runner-207 kernel: [14398.194837] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 09:23:44 juju-e4d256-prod-github-runner-207 kernel: [14398.195578] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 09:23:44 juju-e4d256-prod-github-runner-207 kernel: [14398.196397] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 09:23:44 juju-e4d256-prod-github-runner-207 kernel: [14398.197158] ? __seccomp_filter+0x4a/0x4a0 Aug 22 09:23:44 juju-e4d256-prod-github-runner-207 kernel: [14398.197875] ? __fget_files+0x86/0xc0 Aug 22 09:23:44 juju-e4d256-prod-github-runner-207 kernel: [14398.198563] __x64_sys_ioctl+0x95/0xd0 Aug 22 09:23:44 juju-e4d256-prod-github-runner-207 kernel: [14398.199309] do_syscall_64+0x5c/0xc0 Aug 22 09:23:44 juju-e4d256-prod-github-runner-207 kernel: [14398.199998] ? do_futex+0x162/0x1f0 Aug 22 09:23:44 juju-e4d256-prod-github-runner-207 kernel: [14398.200689] ? __x64_sys_futex+0x78/0x1e0 Aug 22 09:23:44 juju-e4d256-prod-github-runner-207 kernel: [14398.201391] ? __secure_computing+0xa9/0x120 Aug 22 09:23:44 juju-e4d256-prod-github-runner-207 kernel: [14398.202106] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 09:23:44 juju-e4d256-prod-github-runner-207 kernel: [14398.202906] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:23:44 juju-e4d256-prod-github-runner-207 kernel: [14398.203738] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:23:44 juju-e4d256-prod-github-runner-207 kernel: [14398.204512] ? do_syscall_64+0x69/0xc0 Aug 22 09:23:44 juju-e4d256-prod-github-runner-207 kernel: [14398.205208] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:23:44 juju-e4d256-prod-github-runner-207 kernel: [14398.205989] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:23:44 juju-e4d256-prod-github-runner-207 kernel: [14398.206804] ? do_syscall_64+0x69/0xc0 Aug 22 09:23:44 juju-e4d256-prod-github-runner-207 kernel: [14398.207527] ? do_syscall_64+0x69/0xc0 Aug 22 09:23:44 juju-e4d256-prod-github-runner-207 kernel: [14398.208253] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 09:23:44 juju-e4d256-prod-github-runner-207 kernel: [14398.209027] RIP: 0033:0x7faa5d0edaff Aug 22 09:23:44 juju-e4d256-prod-github-runner-207 kernel: [14398.209733] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 09:23:44 juju-e4d256-prod-github-runner-207 kernel: [14398.211817] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 09:23:44 juju-e4d256-prod-github-runner-207 kernel: [14398.212822] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 09:23:44 juju-e4d256-prod-github-runner-207 kernel: [14398.213829] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 09:23:44 juju-e4d256-prod-github-runner-207 kernel: [14398.214906] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 09:23:44 juju-e4d256-prod-github-runner-207 kernel: [14398.215942] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 09:23:44 juju-e4d256-prod-github-runner-207 kernel: [14398.217146] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 09:23:44 juju-e4d256-prod-github-runner-207 kernel: [14398.218312] Aug 22 09:24:10 juju-e4d256-prod-github-runner-207 kernel: [14424.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 13325s! [qemu-system-x86:6715] Aug 22 09:24:10 juju-e4d256-prod-github-runner-207 kernel: [14424.543160] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 09:24:10 juju-e4d256-prod-github-runner-207 kernel: [14424.543236] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 09:24:10 juju-e4d256-prod-github-runner-207 kernel: [14424.557392] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 09:24:10 juju-e4d256-prod-github-runner-207 kernel: [14424.559032] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 09:24:10 juju-e4d256-prod-github-runner-207 kernel: [14424.560508] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:24:10 juju-e4d256-prod-github-runner-207 kernel: [14424.561609] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 09:24:10 juju-e4d256-prod-github-runner-207 kernel: [14424.564253] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 09:24:10 juju-e4d256-prod-github-runner-207 kernel: [14424.565312] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 09:24:10 juju-e4d256-prod-github-runner-207 kernel: [14424.566478] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 09:24:10 juju-e4d256-prod-github-runner-207 kernel: [14424.567648] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 09:24:10 juju-e4d256-prod-github-runner-207 kernel: [14424.568833] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 09:24:10 juju-e4d256-prod-github-runner-207 kernel: [14424.570045] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 09:24:10 juju-e4d256-prod-github-runner-207 kernel: [14424.571253] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 09:24:10 juju-e4d256-prod-github-runner-207 kernel: [14424.572537] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 09:24:10 juju-e4d256-prod-github-runner-207 kernel: [14424.573643] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 09:24:10 juju-e4d256-prod-github-runner-207 kernel: [14424.574856] Call Trace: Aug 22 09:24:10 juju-e4d256-prod-github-runner-207 kernel: [14424.575807] Aug 22 09:24:10 juju-e4d256-prod-github-runner-207 kernel: [14424.576690] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:24:10 juju-e4d256-prod-github-runner-207 kernel: [14424.577726] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:24:10 juju-e4d256-prod-github-runner-207 kernel: [14424.578759] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:24:10 juju-e4d256-prod-github-runner-207 kernel: [14424.579946] ? show_regs.part.0+0x23/0x29 Aug 22 09:24:10 juju-e4d256-prod-github-runner-207 kernel: [14424.580967] ? show_regs.cold+0x8/0xd Aug 22 09:24:10 juju-e4d256-prod-github-runner-207 kernel: [14424.581947] ? watchdog_timer_fn+0x1be/0x220 Aug 22 09:24:10 juju-e4d256-prod-github-runner-207 kernel: [14424.582956] ? lockup_detector_update_enable+0x60/0x60 Aug 22 09:24:10 juju-e4d256-prod-github-runner-207 kernel: [14424.584040] ? __hrtimer_run_queues+0x107/0x230 Aug 22 09:24:10 juju-e4d256-prod-github-runner-207 kernel: [14424.585105] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 09:24:10 juju-e4d256-prod-github-runner-207 kernel: [14424.586155] ? hrtimer_interrupt+0x101/0x220 Aug 22 09:24:10 juju-e4d256-prod-github-runner-207 kernel: [14424.587173] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 09:24:10 juju-e4d256-prod-github-runner-207 kernel: [14424.588270] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 09:24:10 juju-e4d256-prod-github-runner-207 kernel: [14424.589330] Aug 22 09:24:10 juju-e4d256-prod-github-runner-207 kernel: [14424.590245] Aug 22 09:24:10 juju-e4d256-prod-github-runner-207 kernel: [14424.591096] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 09:24:10 juju-e4d256-prod-github-runner-207 kernel: [14424.592146] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:24:10 juju-e4d256-prod-github-runner-207 kernel: [14424.593243] ? _raw_spin_lock+0x22/0x30 Aug 22 09:24:10 juju-e4d256-prod-github-runner-207 kernel: [14424.594207] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:24:10 juju-e4d256-prod-github-runner-207 kernel: [14424.595277] direct_page_fault+0x206/0x310 [kvm] Aug 22 09:24:10 juju-e4d256-prod-github-runner-207 kernel: [14424.596325] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 09:24:10 juju-e4d256-prod-github-runner-207 kernel: [14424.597361] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 09:24:10 juju-e4d256-prod-github-runner-207 kernel: [14424.598367] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 09:24:10 juju-e4d256-prod-github-runner-207 kernel: [14424.599347] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 09:24:10 juju-e4d256-prod-github-runner-207 kernel: [14424.600319] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 09:24:10 juju-e4d256-prod-github-runner-207 kernel: [14424.601309] handle_exit+0x98/0x230 [kvm_amd] Aug 22 09:24:10 juju-e4d256-prod-github-runner-207 kernel: [14424.602211] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 09:24:10 juju-e4d256-prod-github-runner-207 kernel: [14424.603136] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 09:24:10 juju-e4d256-prod-github-runner-207 kernel: [14424.604077] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 09:24:10 juju-e4d256-prod-github-runner-207 kernel: [14424.605249] vcpu_run+0x62/0x2c0 [kvm] Aug 22 09:24:10 juju-e4d256-prod-github-runner-207 kernel: [14424.606102] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 09:24:10 juju-e4d256-prod-github-runner-207 kernel: [14424.606917] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 09:24:10 juju-e4d256-prod-github-runner-207 kernel: [14424.607800] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 09:24:10 juju-e4d256-prod-github-runner-207 kernel: [14424.608601] ? __seccomp_filter+0x4a/0x4a0 Aug 22 09:24:10 juju-e4d256-prod-github-runner-207 kernel: [14424.609363] ? __fget_files+0x86/0xc0 Aug 22 09:24:10 juju-e4d256-prod-github-runner-207 kernel: [14424.610080] __x64_sys_ioctl+0x95/0xd0 Aug 22 09:24:10 juju-e4d256-prod-github-runner-207 kernel: [14424.610773] do_syscall_64+0x5c/0xc0 Aug 22 09:24:10 juju-e4d256-prod-github-runner-207 kernel: [14424.611439] ? do_futex+0x162/0x1f0 Aug 22 09:24:10 juju-e4d256-prod-github-runner-207 kernel: [14424.612111] ? __x64_sys_futex+0x78/0x1e0 Aug 22 09:24:10 juju-e4d256-prod-github-runner-207 kernel: [14424.612792] ? __secure_computing+0xa9/0x120 Aug 22 09:24:10 juju-e4d256-prod-github-runner-207 kernel: [14424.613483] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 09:24:10 juju-e4d256-prod-github-runner-207 kernel: [14424.614250] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:24:10 juju-e4d256-prod-github-runner-207 kernel: [14424.614980] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:24:10 juju-e4d256-prod-github-runner-207 kernel: [14424.615719] ? do_syscall_64+0x69/0xc0 Aug 22 09:24:10 juju-e4d256-prod-github-runner-207 kernel: [14424.616381] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:24:10 juju-e4d256-prod-github-runner-207 kernel: [14424.617088] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:24:10 juju-e4d256-prod-github-runner-207 kernel: [14424.617791] ? do_syscall_64+0x69/0xc0 Aug 22 09:24:10 juju-e4d256-prod-github-runner-207 kernel: [14424.618417] ? do_syscall_64+0x69/0xc0 Aug 22 09:24:10 juju-e4d256-prod-github-runner-207 kernel: [14424.619041] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 09:24:10 juju-e4d256-prod-github-runner-207 kernel: [14424.619791] RIP: 0033:0x7faa5d0edaff Aug 22 09:24:10 juju-e4d256-prod-github-runner-207 kernel: [14424.620422] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 09:24:10 juju-e4d256-prod-github-runner-207 kernel: [14424.622456] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 09:24:10 juju-e4d256-prod-github-runner-207 kernel: [14424.623461] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 09:24:10 juju-e4d256-prod-github-runner-207 kernel: [14424.624370] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 09:24:10 juju-e4d256-prod-github-runner-207 kernel: [14424.625305] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 09:24:10 juju-e4d256-prod-github-runner-207 kernel: [14424.626211] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 09:24:10 juju-e4d256-prod-github-runner-207 kernel: [14424.627195] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 09:24:10 juju-e4d256-prod-github-runner-207 kernel: [14424.628276] Aug 22 09:24:38 juju-e4d256-prod-github-runner-207 kernel: [14452.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 13351s! [qemu-system-x86:6715] Aug 22 09:24:38 juju-e4d256-prod-github-runner-207 kernel: [14452.543896] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 09:24:38 juju-e4d256-prod-github-runner-207 kernel: [14452.544209] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 09:24:38 juju-e4d256-prod-github-runner-207 kernel: [14452.556645] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 09:24:38 juju-e4d256-prod-github-runner-207 kernel: [14452.557953] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 09:24:38 juju-e4d256-prod-github-runner-207 kernel: [14452.559183] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:24:38 juju-e4d256-prod-github-runner-207 kernel: [14452.560256] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 09:24:38 juju-e4d256-prod-github-runner-207 kernel: [14452.562792] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 09:24:38 juju-e4d256-prod-github-runner-207 kernel: [14452.563850] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 09:24:38 juju-e4d256-prod-github-runner-207 kernel: [14452.565010] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 09:24:38 juju-e4d256-prod-github-runner-207 kernel: [14452.566178] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 09:24:38 juju-e4d256-prod-github-runner-207 kernel: [14452.567340] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 09:24:38 juju-e4d256-prod-github-runner-207 kernel: [14452.568513] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 09:24:38 juju-e4d256-prod-github-runner-207 kernel: [14452.569676] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 09:24:38 juju-e4d256-prod-github-runner-207 kernel: [14452.570910] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 09:24:38 juju-e4d256-prod-github-runner-207 kernel: [14452.572017] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 09:24:38 juju-e4d256-prod-github-runner-207 kernel: [14452.573215] Call Trace: Aug 22 09:24:38 juju-e4d256-prod-github-runner-207 kernel: [14452.574126] Aug 22 09:24:38 juju-e4d256-prod-github-runner-207 kernel: [14452.575029] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:24:38 juju-e4d256-prod-github-runner-207 kernel: [14452.576075] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:24:38 juju-e4d256-prod-github-runner-207 kernel: [14452.577101] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:24:38 juju-e4d256-prod-github-runner-207 kernel: [14452.578203] ? show_regs.part.0+0x23/0x29 Aug 22 09:24:38 juju-e4d256-prod-github-runner-207 kernel: [14452.579203] ? show_regs.cold+0x8/0xd Aug 22 09:24:38 juju-e4d256-prod-github-runner-207 kernel: [14452.580189] ? watchdog_timer_fn+0x1be/0x220 Aug 22 09:24:38 juju-e4d256-prod-github-runner-207 kernel: [14452.581198] ? lockup_detector_update_enable+0x60/0x60 Aug 22 09:24:38 juju-e4d256-prod-github-runner-207 kernel: [14452.582317] ? __hrtimer_run_queues+0x107/0x230 Aug 22 09:24:38 juju-e4d256-prod-github-runner-207 kernel: [14452.583352] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 09:24:38 juju-e4d256-prod-github-runner-207 kernel: [14452.584383] ? hrtimer_interrupt+0x101/0x220 Aug 22 09:24:38 juju-e4d256-prod-github-runner-207 kernel: [14452.585397] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 09:24:38 juju-e4d256-prod-github-runner-207 kernel: [14452.586468] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 09:24:38 juju-e4d256-prod-github-runner-207 kernel: [14452.587519] Aug 22 09:24:38 juju-e4d256-prod-github-runner-207 kernel: [14452.588403] Aug 22 09:24:38 juju-e4d256-prod-github-runner-207 kernel: [14452.589276] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 09:24:38 juju-e4d256-prod-github-runner-207 kernel: [14452.590310] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:24:38 juju-e4d256-prod-github-runner-207 kernel: [14452.591355] ? _raw_spin_lock+0x22/0x30 Aug 22 09:24:38 juju-e4d256-prod-github-runner-207 kernel: [14452.592323] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:24:38 juju-e4d256-prod-github-runner-207 kernel: [14452.593342] direct_page_fault+0x206/0x310 [kvm] Aug 22 09:24:38 juju-e4d256-prod-github-runner-207 kernel: [14452.594370] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 09:24:38 juju-e4d256-prod-github-runner-207 kernel: [14452.595378] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 09:24:38 juju-e4d256-prod-github-runner-207 kernel: [14452.596391] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 09:24:38 juju-e4d256-prod-github-runner-207 kernel: [14452.597402] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 09:24:38 juju-e4d256-prod-github-runner-207 kernel: [14452.598346] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 09:24:38 juju-e4d256-prod-github-runner-207 kernel: [14452.599323] handle_exit+0x98/0x230 [kvm_amd] Aug 22 09:24:38 juju-e4d256-prod-github-runner-207 kernel: [14452.600223] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 09:24:38 juju-e4d256-prod-github-runner-207 kernel: [14452.601173] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 09:24:38 juju-e4d256-prod-github-runner-207 kernel: [14452.602129] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 09:24:38 juju-e4d256-prod-github-runner-207 kernel: [14452.603041] vcpu_run+0x62/0x2c0 [kvm] Aug 22 09:24:38 juju-e4d256-prod-github-runner-207 kernel: [14452.603863] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 09:24:38 juju-e4d256-prod-github-runner-207 kernel: [14452.604673] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 09:24:38 juju-e4d256-prod-github-runner-207 kernel: [14452.605531] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 09:24:38 juju-e4d256-prod-github-runner-207 kernel: [14452.606329] ? __seccomp_filter+0x4a/0x4a0 Aug 22 09:24:38 juju-e4d256-prod-github-runner-207 kernel: [14452.607072] ? __fget_files+0x86/0xc0 Aug 22 09:24:38 juju-e4d256-prod-github-runner-207 kernel: [14452.607789] __x64_sys_ioctl+0x95/0xd0 Aug 22 09:24:38 juju-e4d256-prod-github-runner-207 kernel: [14452.608488] do_syscall_64+0x5c/0xc0 Aug 22 09:24:38 juju-e4d256-prod-github-runner-207 kernel: [14452.609162] ? do_futex+0x162/0x1f0 Aug 22 09:24:38 juju-e4d256-prod-github-runner-207 kernel: [14452.609830] ? __x64_sys_futex+0x78/0x1e0 Aug 22 09:24:38 juju-e4d256-prod-github-runner-207 kernel: [14452.610505] ? __secure_computing+0xa9/0x120 Aug 22 09:24:38 juju-e4d256-prod-github-runner-207 kernel: [14452.611226] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 09:24:38 juju-e4d256-prod-github-runner-207 kernel: [14452.612002] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:24:38 juju-e4d256-prod-github-runner-207 kernel: [14452.612735] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:24:38 juju-e4d256-prod-github-runner-207 kernel: [14452.613492] ? do_syscall_64+0x69/0xc0 Aug 22 09:24:38 juju-e4d256-prod-github-runner-207 kernel: [14452.614185] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:24:38 juju-e4d256-prod-github-runner-207 kernel: [14452.614894] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:24:38 juju-e4d256-prod-github-runner-207 kernel: [14452.615602] ? do_syscall_64+0x69/0xc0 Aug 22 09:24:38 juju-e4d256-prod-github-runner-207 kernel: [14452.616228] ? do_syscall_64+0x69/0xc0 Aug 22 09:24:38 juju-e4d256-prod-github-runner-207 kernel: [14452.616854] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 09:24:38 juju-e4d256-prod-github-runner-207 kernel: [14452.617559] RIP: 0033:0x7faa5d0edaff Aug 22 09:24:38 juju-e4d256-prod-github-runner-207 kernel: [14452.618216] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 09:24:38 juju-e4d256-prod-github-runner-207 kernel: [14452.620260] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 09:24:38 juju-e4d256-prod-github-runner-207 kernel: [14452.621190] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 09:24:38 juju-e4d256-prod-github-runner-207 kernel: [14452.622082] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 09:24:38 juju-e4d256-prod-github-runner-207 kernel: [14452.622967] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 09:24:38 juju-e4d256-prod-github-runner-207 kernel: [14452.623896] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 09:24:38 juju-e4d256-prod-github-runner-207 kernel: [14452.624825] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 09:24:38 juju-e4d256-prod-github-runner-207 kernel: [14452.625721] Aug 22 09:25:06 juju-e4d256-prod-github-runner-207 kernel: [14480.541976] watchdog: BUG: soft lockup - CPU#1 stuck for 13378s! [qemu-system-x86:6715] Aug 22 09:25:06 juju-e4d256-prod-github-runner-207 kernel: [14480.543138] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 09:25:06 juju-e4d256-prod-github-runner-207 kernel: [14480.543211] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 09:25:06 juju-e4d256-prod-github-runner-207 kernel: [14480.555372] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 09:25:06 juju-e4d256-prod-github-runner-207 kernel: [14480.556659] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 09:25:06 juju-e4d256-prod-github-runner-207 kernel: [14480.557890] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:25:06 juju-e4d256-prod-github-runner-207 kernel: [14480.558947] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 09:25:06 juju-e4d256-prod-github-runner-207 kernel: [14480.561536] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 09:25:06 juju-e4d256-prod-github-runner-207 kernel: [14480.562738] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 09:25:06 juju-e4d256-prod-github-runner-207 kernel: [14480.563930] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 09:25:06 juju-e4d256-prod-github-runner-207 kernel: [14480.565104] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 09:25:06 juju-e4d256-prod-github-runner-207 kernel: [14480.566286] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 09:25:06 juju-e4d256-prod-github-runner-207 kernel: [14480.567690] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 09:25:06 juju-e4d256-prod-github-runner-207 kernel: [14480.568872] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 09:25:06 juju-e4d256-prod-github-runner-207 kernel: [14480.570110] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 09:25:06 juju-e4d256-prod-github-runner-207 kernel: [14480.571252] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 09:25:06 juju-e4d256-prod-github-runner-207 kernel: [14480.572458] Call Trace: Aug 22 09:25:06 juju-e4d256-prod-github-runner-207 kernel: [14480.573377] Aug 22 09:25:06 juju-e4d256-prod-github-runner-207 kernel: [14480.574291] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:25:06 juju-e4d256-prod-github-runner-207 kernel: [14480.575364] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:25:06 juju-e4d256-prod-github-runner-207 kernel: [14480.576393] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:25:06 juju-e4d256-prod-github-runner-207 kernel: [14480.577474] ? show_regs.part.0+0x23/0x29 Aug 22 09:25:06 juju-e4d256-prod-github-runner-207 kernel: [14480.578470] ? show_regs.cold+0x8/0xd Aug 22 09:25:06 juju-e4d256-prod-github-runner-207 kernel: [14480.579454] ? watchdog_timer_fn+0x1be/0x220 Aug 22 09:25:06 juju-e4d256-prod-github-runner-207 kernel: [14480.580467] ? lockup_detector_update_enable+0x60/0x60 Aug 22 09:25:06 juju-e4d256-prod-github-runner-207 kernel: [14480.581531] ? __hrtimer_run_queues+0x107/0x230 Aug 22 09:25:06 juju-e4d256-prod-github-runner-207 kernel: [14480.582568] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 09:25:06 juju-e4d256-prod-github-runner-207 kernel: [14480.583605] ? hrtimer_interrupt+0x101/0x220 Aug 22 09:25:06 juju-e4d256-prod-github-runner-207 kernel: [14480.584650] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 09:25:06 juju-e4d256-prod-github-runner-207 kernel: [14480.585747] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 09:25:06 juju-e4d256-prod-github-runner-207 kernel: [14480.586803] Aug 22 09:25:06 juju-e4d256-prod-github-runner-207 kernel: [14480.587676] Aug 22 09:25:06 juju-e4d256-prod-github-runner-207 kernel: [14480.588522] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 09:25:06 juju-e4d256-prod-github-runner-207 kernel: [14480.589560] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:25:06 juju-e4d256-prod-github-runner-207 kernel: [14480.590607] ? _raw_spin_lock+0x22/0x30 Aug 22 09:25:06 juju-e4d256-prod-github-runner-207 kernel: [14480.591562] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:25:06 juju-e4d256-prod-github-runner-207 kernel: [14480.592585] direct_page_fault+0x206/0x310 [kvm] Aug 22 09:25:06 juju-e4d256-prod-github-runner-207 kernel: [14480.593644] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 09:25:06 juju-e4d256-prod-github-runner-207 kernel: [14480.594667] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 09:25:06 juju-e4d256-prod-github-runner-207 kernel: [14480.595730] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 09:25:06 juju-e4d256-prod-github-runner-207 kernel: [14480.596731] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 09:25:06 juju-e4d256-prod-github-runner-207 kernel: [14480.597692] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 09:25:06 juju-e4d256-prod-github-runner-207 kernel: [14480.598676] handle_exit+0x98/0x230 [kvm_amd] Aug 22 09:25:06 juju-e4d256-prod-github-runner-207 kernel: [14480.599587] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 09:25:06 juju-e4d256-prod-github-runner-207 kernel: [14480.600508] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 09:25:06 juju-e4d256-prod-github-runner-207 kernel: [14480.601497] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 09:25:06 juju-e4d256-prod-github-runner-207 kernel: [14480.602561] vcpu_run+0x62/0x2c0 [kvm] Aug 22 09:25:06 juju-e4d256-prod-github-runner-207 kernel: [14480.603432] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 09:25:06 juju-e4d256-prod-github-runner-207 kernel: [14480.604293] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 09:25:06 juju-e4d256-prod-github-runner-207 kernel: [14480.605179] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 09:25:06 juju-e4d256-prod-github-runner-207 kernel: [14480.605998] ? __seccomp_filter+0x4a/0x4a0 Aug 22 09:25:06 juju-e4d256-prod-github-runner-207 kernel: [14480.606746] ? __fget_files+0x86/0xc0 Aug 22 09:25:06 juju-e4d256-prod-github-runner-207 kernel: [14480.607467] __x64_sys_ioctl+0x95/0xd0 Aug 22 09:25:06 juju-e4d256-prod-github-runner-207 kernel: [14480.608194] do_syscall_64+0x5c/0xc0 Aug 22 09:25:06 juju-e4d256-prod-github-runner-207 kernel: [14480.608879] ? do_futex+0x162/0x1f0 Aug 22 09:25:06 juju-e4d256-prod-github-runner-207 kernel: [14480.609595] ? __x64_sys_futex+0x78/0x1e0 Aug 22 09:25:06 juju-e4d256-prod-github-runner-207 kernel: [14480.610317] ? __secure_computing+0xa9/0x120 Aug 22 09:25:06 juju-e4d256-prod-github-runner-207 kernel: [14480.611023] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 09:25:06 juju-e4d256-prod-github-runner-207 kernel: [14480.611814] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:25:06 juju-e4d256-prod-github-runner-207 kernel: [14480.612540] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:25:06 juju-e4d256-prod-github-runner-207 kernel: [14480.613319] ? do_syscall_64+0x69/0xc0 Aug 22 09:25:06 juju-e4d256-prod-github-runner-207 kernel: [14480.613987] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:25:06 juju-e4d256-prod-github-runner-207 kernel: [14480.614718] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:25:06 juju-e4d256-prod-github-runner-207 kernel: [14480.615446] ? do_syscall_64+0x69/0xc0 Aug 22 09:25:06 juju-e4d256-prod-github-runner-207 kernel: [14480.616094] ? do_syscall_64+0x69/0xc0 Aug 22 09:25:06 juju-e4d256-prod-github-runner-207 kernel: [14480.616727] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 09:25:06 juju-e4d256-prod-github-runner-207 kernel: [14480.617511] RIP: 0033:0x7faa5d0edaff Aug 22 09:25:06 juju-e4d256-prod-github-runner-207 kernel: [14480.618167] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 09:25:06 juju-e4d256-prod-github-runner-207 kernel: [14480.620221] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 09:25:06 juju-e4d256-prod-github-runner-207 kernel: [14480.621137] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 09:25:06 juju-e4d256-prod-github-runner-207 kernel: [14480.622030] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 09:25:06 juju-e4d256-prod-github-runner-207 kernel: [14480.623080] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 09:25:06 juju-e4d256-prod-github-runner-207 kernel: [14480.624028] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 09:25:06 juju-e4d256-prod-github-runner-207 kernel: [14480.625187] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 09:25:06 juju-e4d256-prod-github-runner-207 kernel: [14480.626111] Aug 22 09:25:34 juju-e4d256-prod-github-runner-207 kernel: [14508.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 13404s! [qemu-system-x86:6715] Aug 22 09:25:34 juju-e4d256-prod-github-runner-207 kernel: [14508.543099] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 09:25:34 juju-e4d256-prod-github-runner-207 kernel: [14508.543169] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 09:25:34 juju-e4d256-prod-github-runner-207 kernel: [14508.555553] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 09:25:34 juju-e4d256-prod-github-runner-207 kernel: [14508.556850] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 09:25:34 juju-e4d256-prod-github-runner-207 kernel: [14508.558072] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:25:34 juju-e4d256-prod-github-runner-207 kernel: [14508.559176] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 09:25:34 juju-e4d256-prod-github-runner-207 kernel: [14508.561890] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 09:25:34 juju-e4d256-prod-github-runner-207 kernel: [14508.563094] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 09:25:34 juju-e4d256-prod-github-runner-207 kernel: [14508.564342] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 09:25:34 juju-e4d256-prod-github-runner-207 kernel: [14508.565600] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 09:25:34 juju-e4d256-prod-github-runner-207 kernel: [14508.566810] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 09:25:34 juju-e4d256-prod-github-runner-207 kernel: [14508.567989] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 09:25:34 juju-e4d256-prod-github-runner-207 kernel: [14508.569197] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 09:25:34 juju-e4d256-prod-github-runner-207 kernel: [14508.570460] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 09:25:34 juju-e4d256-prod-github-runner-207 kernel: [14508.571610] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 09:25:34 juju-e4d256-prod-github-runner-207 kernel: [14508.572828] Call Trace: Aug 22 09:25:34 juju-e4d256-prod-github-runner-207 kernel: [14508.573822] Aug 22 09:25:34 juju-e4d256-prod-github-runner-207 kernel: [14508.574748] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:25:34 juju-e4d256-prod-github-runner-207 kernel: [14508.575854] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:25:34 juju-e4d256-prod-github-runner-207 kernel: [14508.576908] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:25:34 juju-e4d256-prod-github-runner-207 kernel: [14508.577990] ? show_regs.part.0+0x23/0x29 Aug 22 09:25:34 juju-e4d256-prod-github-runner-207 kernel: [14508.579038] ? show_regs.cold+0x8/0xd Aug 22 09:25:34 juju-e4d256-prod-github-runner-207 kernel: [14508.580024] ? watchdog_timer_fn+0x1be/0x220 Aug 22 09:25:34 juju-e4d256-prod-github-runner-207 kernel: [14508.581063] ? lockup_detector_update_enable+0x60/0x60 Aug 22 09:25:34 juju-e4d256-prod-github-runner-207 kernel: [14508.582163] ? __hrtimer_run_queues+0x107/0x230 Aug 22 09:25:34 juju-e4d256-prod-github-runner-207 kernel: [14508.583287] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 09:25:34 juju-e4d256-prod-github-runner-207 kernel: [14508.584509] ? hrtimer_interrupt+0x101/0x220 Aug 22 09:25:34 juju-e4d256-prod-github-runner-207 kernel: [14508.585549] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 09:25:34 juju-e4d256-prod-github-runner-207 kernel: [14508.586652] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 09:25:34 juju-e4d256-prod-github-runner-207 kernel: [14508.587980] Aug 22 09:25:34 juju-e4d256-prod-github-runner-207 kernel: [14508.588856] Aug 22 09:25:34 juju-e4d256-prod-github-runner-207 kernel: [14508.589707] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 09:25:34 juju-e4d256-prod-github-runner-207 kernel: [14508.590776] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:25:34 juju-e4d256-prod-github-runner-207 kernel: [14508.591847] ? _raw_spin_lock+0x22/0x30 Aug 22 09:25:34 juju-e4d256-prod-github-runner-207 kernel: [14508.592901] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:25:34 juju-e4d256-prod-github-runner-207 kernel: [14508.593951] direct_page_fault+0x206/0x310 [kvm] Aug 22 09:25:34 juju-e4d256-prod-github-runner-207 kernel: [14508.595003] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 09:25:34 juju-e4d256-prod-github-runner-207 kernel: [14508.596026] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 09:25:34 juju-e4d256-prod-github-runner-207 kernel: [14508.597057] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 09:25:34 juju-e4d256-prod-github-runner-207 kernel: [14508.598046] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 09:25:34 juju-e4d256-prod-github-runner-207 kernel: [14508.599028] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 09:25:34 juju-e4d256-prod-github-runner-207 kernel: [14508.600191] handle_exit+0x98/0x230 [kvm_amd] Aug 22 09:25:34 juju-e4d256-prod-github-runner-207 kernel: [14508.601270] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 09:25:34 juju-e4d256-prod-github-runner-207 kernel: [14508.602219] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 09:25:34 juju-e4d256-prod-github-runner-207 kernel: [14508.603197] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 09:25:34 juju-e4d256-prod-github-runner-207 kernel: [14508.604119] vcpu_run+0x62/0x2c0 [kvm] Aug 22 09:25:34 juju-e4d256-prod-github-runner-207 kernel: [14508.604935] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 09:25:34 juju-e4d256-prod-github-runner-207 kernel: [14508.605755] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 09:25:34 juju-e4d256-prod-github-runner-207 kernel: [14508.606765] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 09:25:34 juju-e4d256-prod-github-runner-207 kernel: [14508.607646] ? __seccomp_filter+0x4a/0x4a0 Aug 22 09:25:34 juju-e4d256-prod-github-runner-207 kernel: [14508.608509] ? __fget_files+0x86/0xc0 Aug 22 09:25:34 juju-e4d256-prod-github-runner-207 kernel: [14508.609227] __x64_sys_ioctl+0x95/0xd0 Aug 22 09:25:34 juju-e4d256-prod-github-runner-207 kernel: [14508.609926] do_syscall_64+0x5c/0xc0 Aug 22 09:25:34 juju-e4d256-prod-github-runner-207 kernel: [14508.610602] ? do_futex+0x162/0x1f0 Aug 22 09:25:34 juju-e4d256-prod-github-runner-207 kernel: [14508.611313] ? __x64_sys_futex+0x78/0x1e0 Aug 22 09:25:34 juju-e4d256-prod-github-runner-207 kernel: [14508.612090] ? __secure_computing+0xa9/0x120 Aug 22 09:25:34 juju-e4d256-prod-github-runner-207 kernel: [14508.612795] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 09:25:34 juju-e4d256-prod-github-runner-207 kernel: [14508.613827] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:25:34 juju-e4d256-prod-github-runner-207 kernel: [14508.614752] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:25:34 juju-e4d256-prod-github-runner-207 kernel: [14508.615639] ? do_syscall_64+0x69/0xc0 Aug 22 09:25:34 juju-e4d256-prod-github-runner-207 kernel: [14508.616574] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:25:34 juju-e4d256-prod-github-runner-207 kernel: [14508.617575] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:25:34 juju-e4d256-prod-github-runner-207 kernel: [14508.618510] ? do_syscall_64+0x69/0xc0 Aug 22 09:25:34 juju-e4d256-prod-github-runner-207 kernel: [14508.619324] ? do_syscall_64+0x69/0xc0 Aug 22 09:25:34 juju-e4d256-prod-github-runner-207 kernel: [14508.620162] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 09:25:34 juju-e4d256-prod-github-runner-207 kernel: [14508.620873] RIP: 0033:0x7faa5d0edaff Aug 22 09:25:34 juju-e4d256-prod-github-runner-207 kernel: [14508.621499] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 09:25:34 juju-e4d256-prod-github-runner-207 kernel: [14508.623543] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 09:25:34 juju-e4d256-prod-github-runner-207 kernel: [14508.624489] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 09:25:34 juju-e4d256-prod-github-runner-207 kernel: [14508.625387] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 09:25:34 juju-e4d256-prod-github-runner-207 kernel: [14508.626384] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 09:25:34 juju-e4d256-prod-github-runner-207 kernel: [14508.627302] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 09:25:34 juju-e4d256-prod-github-runner-207 kernel: [14508.628217] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 09:25:34 juju-e4d256-prod-github-runner-207 kernel: [14508.629133] Aug 22 09:26:02 juju-e4d256-prod-github-runner-207 kernel: [14536.541981] watchdog: BUG: soft lockup - CPU#1 stuck for 13430s! [qemu-system-x86:6715] Aug 22 09:26:02 juju-e4d256-prod-github-runner-207 kernel: [14536.543227] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 09:26:02 juju-e4d256-prod-github-runner-207 kernel: [14536.543509] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 09:26:02 juju-e4d256-prod-github-runner-207 kernel: [14536.556762] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 09:26:02 juju-e4d256-prod-github-runner-207 kernel: [14536.558049] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 09:26:02 juju-e4d256-prod-github-runner-207 kernel: [14536.559296] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:26:02 juju-e4d256-prod-github-runner-207 kernel: [14536.560359] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 09:26:02 juju-e4d256-prod-github-runner-207 kernel: [14536.562967] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 09:26:02 juju-e4d256-prod-github-runner-207 kernel: [14536.564150] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 09:26:02 juju-e4d256-prod-github-runner-207 kernel: [14536.565538] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 09:26:02 juju-e4d256-prod-github-runner-207 kernel: [14536.566736] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 09:26:02 juju-e4d256-prod-github-runner-207 kernel: [14536.567901] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 09:26:02 juju-e4d256-prod-github-runner-207 kernel: [14536.569077] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 09:26:02 juju-e4d256-prod-github-runner-207 kernel: [14536.570292] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 09:26:02 juju-e4d256-prod-github-runner-207 kernel: [14536.571553] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 09:26:02 juju-e4d256-prod-github-runner-207 kernel: [14536.572743] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 09:26:02 juju-e4d256-prod-github-runner-207 kernel: [14536.573974] Call Trace: Aug 22 09:26:02 juju-e4d256-prod-github-runner-207 kernel: [14536.575062] Aug 22 09:26:02 juju-e4d256-prod-github-runner-207 kernel: [14536.576172] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:26:02 juju-e4d256-prod-github-runner-207 kernel: [14536.577235] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:26:02 juju-e4d256-prod-github-runner-207 kernel: [14536.578333] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:26:02 juju-e4d256-prod-github-runner-207 kernel: [14536.579576] ? show_regs.part.0+0x23/0x29 Aug 22 09:26:02 juju-e4d256-prod-github-runner-207 kernel: [14536.580751] ? show_regs.cold+0x8/0xd Aug 22 09:26:02 juju-e4d256-prod-github-runner-207 kernel: [14536.582162] ? watchdog_timer_fn+0x1be/0x220 Aug 22 09:26:02 juju-e4d256-prod-github-runner-207 kernel: [14536.583230] ? lockup_detector_update_enable+0x60/0x60 Aug 22 09:26:02 juju-e4d256-prod-github-runner-207 kernel: [14536.584519] ? __hrtimer_run_queues+0x107/0x230 Aug 22 09:26:02 juju-e4d256-prod-github-runner-207 kernel: [14536.585655] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 09:26:02 juju-e4d256-prod-github-runner-207 kernel: [14536.586807] ? hrtimer_interrupt+0x101/0x220 Aug 22 09:26:02 juju-e4d256-prod-github-runner-207 kernel: [14536.587967] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 09:26:02 juju-e4d256-prod-github-runner-207 kernel: [14536.589057] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 09:26:02 juju-e4d256-prod-github-runner-207 kernel: [14536.590233] Aug 22 09:26:02 juju-e4d256-prod-github-runner-207 kernel: [14536.591122] Aug 22 09:26:02 juju-e4d256-prod-github-runner-207 kernel: [14536.592078] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 09:26:02 juju-e4d256-prod-github-runner-207 kernel: [14536.593157] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:26:02 juju-e4d256-prod-github-runner-207 kernel: [14536.594398] ? _raw_spin_lock+0x22/0x30 Aug 22 09:26:02 juju-e4d256-prod-github-runner-207 kernel: [14536.595462] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:26:02 juju-e4d256-prod-github-runner-207 kernel: [14536.596542] direct_page_fault+0x206/0x310 [kvm] Aug 22 09:26:02 juju-e4d256-prod-github-runner-207 kernel: [14536.597701] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 09:26:02 juju-e4d256-prod-github-runner-207 kernel: [14536.598782] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 09:26:02 juju-e4d256-prod-github-runner-207 kernel: [14536.600010] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 09:26:02 juju-e4d256-prod-github-runner-207 kernel: [14536.601043] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 09:26:02 juju-e4d256-prod-github-runner-207 kernel: [14536.602175] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 09:26:02 juju-e4d256-prod-github-runner-207 kernel: [14536.603212] handle_exit+0x98/0x230 [kvm_amd] Aug 22 09:26:02 juju-e4d256-prod-github-runner-207 kernel: [14536.604253] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 09:26:02 juju-e4d256-prod-github-runner-207 kernel: [14536.605232] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 09:26:02 juju-e4d256-prod-github-runner-207 kernel: [14536.606329] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 09:26:02 juju-e4d256-prod-github-runner-207 kernel: [14536.607311] vcpu_run+0x62/0x2c0 [kvm] Aug 22 09:26:02 juju-e4d256-prod-github-runner-207 kernel: [14536.608263] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 09:26:02 juju-e4d256-prod-github-runner-207 kernel: [14536.609081] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 09:26:02 juju-e4d256-prod-github-runner-207 kernel: [14536.610201] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 09:26:02 juju-e4d256-prod-github-runner-207 kernel: [14536.611184] ? __seccomp_filter+0x4a/0x4a0 Aug 22 09:26:02 juju-e4d256-prod-github-runner-207 kernel: [14536.612079] ? __fget_files+0x86/0xc0 Aug 22 09:26:02 juju-e4d256-prod-github-runner-207 kernel: [14536.612919] __x64_sys_ioctl+0x95/0xd0 Aug 22 09:26:02 juju-e4d256-prod-github-runner-207 kernel: [14536.613744] do_syscall_64+0x5c/0xc0 Aug 22 09:26:02 juju-e4d256-prod-github-runner-207 kernel: [14536.614555] ? do_futex+0x162/0x1f0 Aug 22 09:26:02 juju-e4d256-prod-github-runner-207 kernel: [14536.615328] ? __x64_sys_futex+0x78/0x1e0 Aug 22 09:26:02 juju-e4d256-prod-github-runner-207 kernel: [14536.616129] ? __secure_computing+0xa9/0x120 Aug 22 09:26:02 juju-e4d256-prod-github-runner-207 kernel: [14536.616965] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 09:26:02 juju-e4d256-prod-github-runner-207 kernel: [14536.617873] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:26:02 juju-e4d256-prod-github-runner-207 kernel: [14536.618741] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:26:02 juju-e4d256-prod-github-runner-207 kernel: [14536.619594] ? do_syscall_64+0x69/0xc0 Aug 22 09:26:02 juju-e4d256-prod-github-runner-207 kernel: [14536.620391] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:26:02 juju-e4d256-prod-github-runner-207 kernel: [14536.621305] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:26:02 juju-e4d256-prod-github-runner-207 kernel: [14536.622082] ? do_syscall_64+0x69/0xc0 Aug 22 09:26:02 juju-e4d256-prod-github-runner-207 kernel: [14536.622732] ? do_syscall_64+0x69/0xc0 Aug 22 09:26:02 juju-e4d256-prod-github-runner-207 kernel: [14536.623418] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 09:26:02 juju-e4d256-prod-github-runner-207 kernel: [14536.624145] RIP: 0033:0x7faa5d0edaff Aug 22 09:26:02 juju-e4d256-prod-github-runner-207 kernel: [14536.624826] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 09:26:02 juju-e4d256-prod-github-runner-207 kernel: [14536.626912] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 09:26:02 juju-e4d256-prod-github-runner-207 kernel: [14536.628009] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 09:26:02 juju-e4d256-prod-github-runner-207 kernel: [14536.629082] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 09:26:02 juju-e4d256-prod-github-runner-207 kernel: [14536.630150] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 09:26:02 juju-e4d256-prod-github-runner-207 kernel: [14536.631227] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 09:26:02 juju-e4d256-prod-github-runner-207 kernel: [14536.632284] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 09:26:02 juju-e4d256-prod-github-runner-207 kernel: [14536.633349] Aug 22 09:26:30 juju-e4d256-prod-github-runner-207 kernel: [14564.541976] watchdog: BUG: soft lockup - CPU#1 stuck for 13456s! [qemu-system-x86:6715] Aug 22 09:26:30 juju-e4d256-prod-github-runner-207 kernel: [14564.543805] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 09:26:30 juju-e4d256-prod-github-runner-207 kernel: [14564.543981] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 09:26:30 juju-e4d256-prod-github-runner-207 kernel: [14564.556186] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 09:26:30 juju-e4d256-prod-github-runner-207 kernel: [14564.557444] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 09:26:30 juju-e4d256-prod-github-runner-207 kernel: [14564.558674] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:26:30 juju-e4d256-prod-github-runner-207 kernel: [14564.559728] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 09:26:30 juju-e4d256-prod-github-runner-207 kernel: [14564.562286] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 09:26:30 juju-e4d256-prod-github-runner-207 kernel: [14564.563324] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 09:26:30 juju-e4d256-prod-github-runner-207 kernel: [14564.564483] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 09:26:30 juju-e4d256-prod-github-runner-207 kernel: [14564.565656] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 09:26:30 juju-e4d256-prod-github-runner-207 kernel: [14564.566834] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 09:26:30 juju-e4d256-prod-github-runner-207 kernel: [14564.567998] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 09:26:30 juju-e4d256-prod-github-runner-207 kernel: [14564.569162] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 09:26:30 juju-e4d256-prod-github-runner-207 kernel: [14564.570409] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 09:26:30 juju-e4d256-prod-github-runner-207 kernel: [14564.571512] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 09:26:30 juju-e4d256-prod-github-runner-207 kernel: [14564.572724] Call Trace: Aug 22 09:26:30 juju-e4d256-prod-github-runner-207 kernel: [14564.573693] Aug 22 09:26:30 juju-e4d256-prod-github-runner-207 kernel: [14564.574608] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:26:30 juju-e4d256-prod-github-runner-207 kernel: [14564.575714] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:26:30 juju-e4d256-prod-github-runner-207 kernel: [14564.576753] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:26:30 juju-e4d256-prod-github-runner-207 kernel: [14564.577833] ? show_regs.part.0+0x23/0x29 Aug 22 09:26:30 juju-e4d256-prod-github-runner-207 kernel: [14564.578850] ? show_regs.cold+0x8/0xd Aug 22 09:26:30 juju-e4d256-prod-github-runner-207 kernel: [14564.579820] ? watchdog_timer_fn+0x1be/0x220 Aug 22 09:26:30 juju-e4d256-prod-github-runner-207 kernel: [14564.580825] ? lockup_detector_update_enable+0x60/0x60 Aug 22 09:26:30 juju-e4d256-prod-github-runner-207 kernel: [14564.581889] ? __hrtimer_run_queues+0x107/0x230 Aug 22 09:26:30 juju-e4d256-prod-github-runner-207 kernel: [14564.582990] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 09:26:30 juju-e4d256-prod-github-runner-207 kernel: [14564.584066] ? hrtimer_interrupt+0x101/0x220 Aug 22 09:26:30 juju-e4d256-prod-github-runner-207 kernel: [14564.585081] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 09:26:30 juju-e4d256-prod-github-runner-207 kernel: [14564.586157] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 09:26:30 juju-e4d256-prod-github-runner-207 kernel: [14564.587203] Aug 22 09:26:30 juju-e4d256-prod-github-runner-207 kernel: [14564.588056] Aug 22 09:26:30 juju-e4d256-prod-github-runner-207 kernel: [14564.588891] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 09:26:30 juju-e4d256-prod-github-runner-207 kernel: [14564.589921] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:26:30 juju-e4d256-prod-github-runner-207 kernel: [14564.590981] ? _raw_spin_lock+0x22/0x30 Aug 22 09:26:30 juju-e4d256-prod-github-runner-207 kernel: [14564.591925] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:26:30 juju-e4d256-prod-github-runner-207 kernel: [14564.592945] direct_page_fault+0x206/0x310 [kvm] Aug 22 09:26:30 juju-e4d256-prod-github-runner-207 kernel: [14564.593972] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 09:26:30 juju-e4d256-prod-github-runner-207 kernel: [14564.595005] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 09:26:30 juju-e4d256-prod-github-runner-207 kernel: [14564.596008] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 09:26:30 juju-e4d256-prod-github-runner-207 kernel: [14564.597000] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 09:26:30 juju-e4d256-prod-github-runner-207 kernel: [14564.597969] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 09:26:30 juju-e4d256-prod-github-runner-207 kernel: [14564.598968] handle_exit+0x98/0x230 [kvm_amd] Aug 22 09:26:30 juju-e4d256-prod-github-runner-207 kernel: [14564.599858] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 09:26:30 juju-e4d256-prod-github-runner-207 kernel: [14564.600770] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 09:26:30 juju-e4d256-prod-github-runner-207 kernel: [14564.601694] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 09:26:30 juju-e4d256-prod-github-runner-207 kernel: [14564.602607] vcpu_run+0x62/0x2c0 [kvm] Aug 22 09:26:30 juju-e4d256-prod-github-runner-207 kernel: [14564.603415] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 09:26:30 juju-e4d256-prod-github-runner-207 kernel: [14564.604220] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 09:26:30 juju-e4d256-prod-github-runner-207 kernel: [14564.605109] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 09:26:30 juju-e4d256-prod-github-runner-207 kernel: [14564.605977] ? __seccomp_filter+0x4a/0x4a0 Aug 22 09:26:30 juju-e4d256-prod-github-runner-207 kernel: [14564.606760] ? __fget_files+0x86/0xc0 Aug 22 09:26:30 juju-e4d256-prod-github-runner-207 kernel: [14564.607473] __x64_sys_ioctl+0x95/0xd0 Aug 22 09:26:30 juju-e4d256-prod-github-runner-207 kernel: [14564.608168] do_syscall_64+0x5c/0xc0 Aug 22 09:26:30 juju-e4d256-prod-github-runner-207 kernel: [14564.608832] ? do_futex+0x162/0x1f0 Aug 22 09:26:30 juju-e4d256-prod-github-runner-207 kernel: [14564.609483] ? __x64_sys_futex+0x78/0x1e0 Aug 22 09:26:30 juju-e4d256-prod-github-runner-207 kernel: [14564.610193] ? __secure_computing+0xa9/0x120 Aug 22 09:26:30 juju-e4d256-prod-github-runner-207 kernel: [14564.610890] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 09:26:30 juju-e4d256-prod-github-runner-207 kernel: [14564.611661] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:26:30 juju-e4d256-prod-github-runner-207 kernel: [14564.612379] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:26:30 juju-e4d256-prod-github-runner-207 kernel: [14564.613095] ? do_syscall_64+0x69/0xc0 Aug 22 09:26:30 juju-e4d256-prod-github-runner-207 kernel: [14564.613735] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:26:30 juju-e4d256-prod-github-runner-207 kernel: [14564.614446] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:26:30 juju-e4d256-prod-github-runner-207 kernel: [14564.615138] ? do_syscall_64+0x69/0xc0 Aug 22 09:26:30 juju-e4d256-prod-github-runner-207 kernel: [14564.615760] ? do_syscall_64+0x69/0xc0 Aug 22 09:26:30 juju-e4d256-prod-github-runner-207 kernel: [14564.616379] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 09:26:30 juju-e4d256-prod-github-runner-207 kernel: [14564.617091] RIP: 0033:0x7faa5d0edaff Aug 22 09:26:30 juju-e4d256-prod-github-runner-207 kernel: [14564.617730] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 09:26:30 juju-e4d256-prod-github-runner-207 kernel: [14564.619718] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 09:26:30 juju-e4d256-prod-github-runner-207 kernel: [14564.620631] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 09:26:30 juju-e4d256-prod-github-runner-207 kernel: [14564.621524] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 09:26:30 juju-e4d256-prod-github-runner-207 kernel: [14564.622432] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 09:26:30 juju-e4d256-prod-github-runner-207 kernel: [14564.623322] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 09:26:30 juju-e4d256-prod-github-runner-207 kernel: [14564.624206] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 09:26:30 juju-e4d256-prod-github-runner-207 kernel: [14564.625094] Aug 22 09:26:44 juju-e4d256-prod-github-runner-207 kernel: [14578.160705] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 09:26:44 juju-e4d256-prod-github-runner-207 kernel: [14578.161684] rcu: 1-....: (3603932 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=1740857 Aug 22 09:26:44 juju-e4d256-prod-github-runner-207 kernel: [14578.162912] (t=3615240 jiffies g=23269 q=22066) Aug 22 09:26:44 juju-e4d256-prod-github-runner-207 kernel: [14578.163871] NMI backtrace for cpu 1 Aug 22 09:26:44 juju-e4d256-prod-github-runner-207 kernel: [14578.164670] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 09:26:44 juju-e4d256-prod-github-runner-207 kernel: [14578.165993] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 09:26:44 juju-e4d256-prod-github-runner-207 kernel: [14578.167099] Call Trace: Aug 22 09:26:44 juju-e4d256-prod-github-runner-207 kernel: [14578.167780] Aug 22 09:26:44 juju-e4d256-prod-github-runner-207 kernel: [14578.168429] show_stack+0x52/0x5c Aug 22 09:26:44 juju-e4d256-prod-github-runner-207 kernel: [14578.169167] dump_stack_lvl+0x4a/0x63 Aug 22 09:26:44 juju-e4d256-prod-github-runner-207 kernel: [14578.169970] dump_stack+0x10/0x16 Aug 22 09:26:44 juju-e4d256-prod-github-runner-207 kernel: [14578.170719] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 09:26:44 juju-e4d256-prod-github-runner-207 kernel: [14578.171529] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 09:26:44 juju-e4d256-prod-github-runner-207 kernel: [14578.172325] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 09:26:44 juju-e4d256-prod-github-runner-207 kernel: [14578.173162] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 09:26:44 juju-e4d256-prod-github-runner-207 kernel: [14578.174090] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 09:26:44 juju-e4d256-prod-github-runner-207 kernel: [14578.174970] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 09:26:44 juju-e4d256-prod-github-runner-207 kernel: [14578.175782] print_cpu_stall.cold+0x2f/0xe2 Aug 22 09:26:44 juju-e4d256-prod-github-runner-207 kernel: [14578.176570] ? timekeeping_update+0xf7/0x150 Aug 22 09:26:44 juju-e4d256-prod-github-runner-207 kernel: [14578.177358] check_cpu_stall+0x109/0x270 Aug 22 09:26:44 juju-e4d256-prod-github-runner-207 kernel: [14578.178141] rcu_sched_clock_irq+0x9a/0x250 Aug 22 09:26:44 juju-e4d256-prod-github-runner-207 kernel: [14578.178915] update_process_times+0x94/0xd0 Aug 22 09:26:44 juju-e4d256-prod-github-runner-207 kernel: [14578.179691] tick_sched_handle+0x29/0x70 Aug 22 09:26:44 juju-e4d256-prod-github-runner-207 kernel: [14578.180455] tick_sched_timer+0x8c/0xc0 Aug 22 09:26:44 juju-e4d256-prod-github-runner-207 kernel: [14578.181205] ? tick_nohz_handler+0xb0/0xb0 Aug 22 09:26:44 juju-e4d256-prod-github-runner-207 kernel: [14578.182008] __hrtimer_run_queues+0x107/0x230 Aug 22 09:26:44 juju-e4d256-prod-github-runner-207 kernel: [14578.182798] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 09:26:44 juju-e4d256-prod-github-runner-207 kernel: [14578.183583] hrtimer_interrupt+0x101/0x220 Aug 22 09:26:44 juju-e4d256-prod-github-runner-207 kernel: [14578.184350] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 09:26:44 juju-e4d256-prod-github-runner-207 kernel: [14578.185204] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 09:26:44 juju-e4d256-prod-github-runner-207 kernel: [14578.186053] Aug 22 09:26:44 juju-e4d256-prod-github-runner-207 kernel: [14578.186708] Aug 22 09:26:44 juju-e4d256-prod-github-runner-207 kernel: [14578.187342] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 09:26:44 juju-e4d256-prod-github-runner-207 kernel: [14578.188178] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:26:44 juju-e4d256-prod-github-runner-207 kernel: [14578.189070] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 09:26:44 juju-e4d256-prod-github-runner-207 kernel: [14578.191393] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 09:26:44 juju-e4d256-prod-github-runner-207 kernel: [14578.192309] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 09:26:44 juju-e4d256-prod-github-runner-207 kernel: [14578.193322] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 09:26:44 juju-e4d256-prod-github-runner-207 kernel: [14578.194337] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 09:26:44 juju-e4d256-prod-github-runner-207 kernel: [14578.195339] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 09:26:44 juju-e4d256-prod-github-runner-207 kernel: [14578.196347] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 09:26:44 juju-e4d256-prod-github-runner-207 kernel: [14578.197316] ? _raw_spin_lock+0x22/0x30 Aug 22 09:26:44 juju-e4d256-prod-github-runner-207 kernel: [14578.198108] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:26:44 juju-e4d256-prod-github-runner-207 kernel: [14578.198944] direct_page_fault+0x206/0x310 [kvm] Aug 22 09:26:44 juju-e4d256-prod-github-runner-207 kernel: [14578.199797] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 09:26:44 juju-e4d256-prod-github-runner-207 kernel: [14578.200650] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 09:26:44 juju-e4d256-prod-github-runner-207 kernel: [14578.201510] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 09:26:44 juju-e4d256-prod-github-runner-207 kernel: [14578.202375] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 09:26:44 juju-e4d256-prod-github-runner-207 kernel: [14578.203166] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 09:26:44 juju-e4d256-prod-github-runner-207 kernel: [14578.203988] handle_exit+0x98/0x230 [kvm_amd] Aug 22 09:26:44 juju-e4d256-prod-github-runner-207 kernel: [14578.204745] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 09:26:44 juju-e4d256-prod-github-runner-207 kernel: [14578.205528] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 09:26:44 juju-e4d256-prod-github-runner-207 kernel: [14578.206355] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 09:26:44 juju-e4d256-prod-github-runner-207 kernel: [14578.207148] vcpu_run+0x62/0x2c0 [kvm] Aug 22 09:26:44 juju-e4d256-prod-github-runner-207 kernel: [14578.207881] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 09:26:44 juju-e4d256-prod-github-runner-207 kernel: [14578.208614] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 09:26:44 juju-e4d256-prod-github-runner-207 kernel: [14578.209414] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 09:26:44 juju-e4d256-prod-github-runner-207 kernel: [14578.210197] ? __seccomp_filter+0x4a/0x4a0 Aug 22 09:26:44 juju-e4d256-prod-github-runner-207 kernel: [14578.210917] ? __fget_files+0x86/0xc0 Aug 22 09:26:44 juju-e4d256-prod-github-runner-207 kernel: [14578.211620] __x64_sys_ioctl+0x95/0xd0 Aug 22 09:26:44 juju-e4d256-prod-github-runner-207 kernel: [14578.212326] do_syscall_64+0x5c/0xc0 Aug 22 09:26:44 juju-e4d256-prod-github-runner-207 kernel: [14578.213010] ? do_futex+0x162/0x1f0 Aug 22 09:26:44 juju-e4d256-prod-github-runner-207 kernel: [14578.213687] ? __x64_sys_futex+0x78/0x1e0 Aug 22 09:26:44 juju-e4d256-prod-github-runner-207 kernel: [14578.214410] ? __secure_computing+0xa9/0x120 Aug 22 09:26:44 juju-e4d256-prod-github-runner-207 kernel: [14578.215125] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 09:26:44 juju-e4d256-prod-github-runner-207 kernel: [14578.215914] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:26:44 juju-e4d256-prod-github-runner-207 kernel: [14578.216689] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:26:44 juju-e4d256-prod-github-runner-207 kernel: [14578.217541] ? do_syscall_64+0x69/0xc0 Aug 22 09:26:44 juju-e4d256-prod-github-runner-207 kernel: [14578.218306] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:26:44 juju-e4d256-prod-github-runner-207 kernel: [14578.219113] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:26:44 juju-e4d256-prod-github-runner-207 kernel: [14578.219889] ? do_syscall_64+0x69/0xc0 Aug 22 09:26:44 juju-e4d256-prod-github-runner-207 kernel: [14578.220593] ? do_syscall_64+0x69/0xc0 Aug 22 09:26:44 juju-e4d256-prod-github-runner-207 kernel: [14578.221293] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 09:26:44 juju-e4d256-prod-github-runner-207 kernel: [14578.222121] RIP: 0033:0x7faa5d0edaff Aug 22 09:26:44 juju-e4d256-prod-github-runner-207 kernel: [14578.222835] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 09:26:44 juju-e4d256-prod-github-runner-207 kernel: [14578.227239] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 09:26:44 juju-e4d256-prod-github-runner-207 kernel: [14578.228229] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 09:26:44 juju-e4d256-prod-github-runner-207 kernel: [14578.229185] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 09:26:44 juju-e4d256-prod-github-runner-207 kernel: [14578.230153] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 09:26:44 juju-e4d256-prod-github-runner-207 kernel: [14578.231097] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 09:26:44 juju-e4d256-prod-github-runner-207 kernel: [14578.232057] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 09:26:44 juju-e4d256-prod-github-runner-207 kernel: [14578.232991] Aug 22 09:27:10 juju-e4d256-prod-github-runner-207 kernel: [14604.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 13493s! [qemu-system-x86:6715] Aug 22 09:27:10 juju-e4d256-prod-github-runner-207 kernel: [14604.543113] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 09:27:10 juju-e4d256-prod-github-runner-207 kernel: [14604.543185] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 09:27:10 juju-e4d256-prod-github-runner-207 kernel: [14604.557298] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 09:27:10 juju-e4d256-prod-github-runner-207 kernel: [14604.558991] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 09:27:10 juju-e4d256-prod-github-runner-207 kernel: [14604.560657] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:27:10 juju-e4d256-prod-github-runner-207 kernel: [14604.561780] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 09:27:10 juju-e4d256-prod-github-runner-207 kernel: [14604.564323] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 09:27:10 juju-e4d256-prod-github-runner-207 kernel: [14604.565395] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 09:27:10 juju-e4d256-prod-github-runner-207 kernel: [14604.566581] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 09:27:10 juju-e4d256-prod-github-runner-207 kernel: [14604.567965] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 09:27:10 juju-e4d256-prod-github-runner-207 kernel: [14604.569552] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 09:27:10 juju-e4d256-prod-github-runner-207 kernel: [14604.570738] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 09:27:10 juju-e4d256-prod-github-runner-207 kernel: [14604.572201] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 09:27:10 juju-e4d256-prod-github-runner-207 kernel: [14604.573930] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 09:27:10 juju-e4d256-prod-github-runner-207 kernel: [14604.575403] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 09:27:10 juju-e4d256-prod-github-runner-207 kernel: [14604.576731] Call Trace: Aug 22 09:27:10 juju-e4d256-prod-github-runner-207 kernel: [14604.577663] Aug 22 09:27:10 juju-e4d256-prod-github-runner-207 kernel: [14604.578546] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:27:10 juju-e4d256-prod-github-runner-207 kernel: [14604.579692] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:27:10 juju-e4d256-prod-github-runner-207 kernel: [14604.581094] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:27:10 juju-e4d256-prod-github-runner-207 kernel: [14604.582526] ? show_regs.part.0+0x23/0x29 Aug 22 09:27:10 juju-e4d256-prod-github-runner-207 kernel: [14604.584054] ? show_regs.cold+0x8/0xd Aug 22 09:27:10 juju-e4d256-prod-github-runner-207 kernel: [14604.585039] ? watchdog_timer_fn+0x1be/0x220 Aug 22 09:27:10 juju-e4d256-prod-github-runner-207 kernel: [14604.586080] ? lockup_detector_update_enable+0x60/0x60 Aug 22 09:27:10 juju-e4d256-prod-github-runner-207 kernel: [14604.587171] ? __hrtimer_run_queues+0x107/0x230 Aug 22 09:27:10 juju-e4d256-prod-github-runner-207 kernel: [14604.588548] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 09:27:10 juju-e4d256-prod-github-runner-207 kernel: [14604.590022] ? hrtimer_interrupt+0x101/0x220 Aug 22 09:27:10 juju-e4d256-prod-github-runner-207 kernel: [14604.591392] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 09:27:10 juju-e4d256-prod-github-runner-207 kernel: [14604.592842] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 09:27:10 juju-e4d256-prod-github-runner-207 kernel: [14604.594286] Aug 22 09:27:10 juju-e4d256-prod-github-runner-207 kernel: [14604.595325] Aug 22 09:27:10 juju-e4d256-prod-github-runner-207 kernel: [14604.596173] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 09:27:10 juju-e4d256-prod-github-runner-207 kernel: [14604.597227] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:27:10 juju-e4d256-prod-github-runner-207 kernel: [14604.598307] ? _raw_spin_lock+0x22/0x30 Aug 22 09:27:10 juju-e4d256-prod-github-runner-207 kernel: [14604.599255] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:27:10 juju-e4d256-prod-github-runner-207 kernel: [14604.600274] direct_page_fault+0x206/0x310 [kvm] Aug 22 09:27:10 juju-e4d256-prod-github-runner-207 kernel: [14604.601303] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 09:27:10 juju-e4d256-prod-github-runner-207 kernel: [14604.602417] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 09:27:10 juju-e4d256-prod-github-runner-207 kernel: [14604.603439] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 09:27:10 juju-e4d256-prod-github-runner-207 kernel: [14604.604412] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 09:27:10 juju-e4d256-prod-github-runner-207 kernel: [14604.605414] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 09:27:10 juju-e4d256-prod-github-runner-207 kernel: [14604.606477] handle_exit+0x98/0x230 [kvm_amd] Aug 22 09:27:10 juju-e4d256-prod-github-runner-207 kernel: [14604.607419] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 09:27:10 juju-e4d256-prod-github-runner-207 kernel: [14604.608372] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 09:27:10 juju-e4d256-prod-github-runner-207 kernel: [14604.609346] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 09:27:10 juju-e4d256-prod-github-runner-207 kernel: [14604.610279] vcpu_run+0x62/0x2c0 [kvm] Aug 22 09:27:10 juju-e4d256-prod-github-runner-207 kernel: [14604.611099] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 09:27:10 juju-e4d256-prod-github-runner-207 kernel: [14604.611944] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 09:27:10 juju-e4d256-prod-github-runner-207 kernel: [14604.612818] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 09:27:10 juju-e4d256-prod-github-runner-207 kernel: [14604.613676] ? __seccomp_filter+0x4a/0x4a0 Aug 22 09:27:10 juju-e4d256-prod-github-runner-207 kernel: [14604.614423] ? __fget_files+0x86/0xc0 Aug 22 09:27:10 juju-e4d256-prod-github-runner-207 kernel: [14604.615131] __x64_sys_ioctl+0x95/0xd0 Aug 22 09:27:10 juju-e4d256-prod-github-runner-207 kernel: [14604.615833] do_syscall_64+0x5c/0xc0 Aug 22 09:27:10 juju-e4d256-prod-github-runner-207 kernel: [14604.616505] ? do_futex+0x162/0x1f0 Aug 22 09:27:10 juju-e4d256-prod-github-runner-207 kernel: [14604.617163] ? __x64_sys_futex+0x78/0x1e0 Aug 22 09:27:10 juju-e4d256-prod-github-runner-207 kernel: [14604.617857] ? __secure_computing+0xa9/0x120 Aug 22 09:27:10 juju-e4d256-prod-github-runner-207 kernel: [14604.618573] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 09:27:10 juju-e4d256-prod-github-runner-207 kernel: [14604.619378] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:27:10 juju-e4d256-prod-github-runner-207 kernel: [14604.620150] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:27:10 juju-e4d256-prod-github-runner-207 kernel: [14604.620903] ? do_syscall_64+0x69/0xc0 Aug 22 09:27:10 juju-e4d256-prod-github-runner-207 kernel: [14604.621576] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:27:10 juju-e4d256-prod-github-runner-207 kernel: [14604.622284] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:27:10 juju-e4d256-prod-github-runner-207 kernel: [14604.622986] ? do_syscall_64+0x69/0xc0 Aug 22 09:27:10 juju-e4d256-prod-github-runner-207 kernel: [14604.623615] ? do_syscall_64+0x69/0xc0 Aug 22 09:27:10 juju-e4d256-prod-github-runner-207 kernel: [14604.624254] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 09:27:10 juju-e4d256-prod-github-runner-207 kernel: [14604.624996] RIP: 0033:0x7faa5d0edaff Aug 22 09:27:10 juju-e4d256-prod-github-runner-207 kernel: [14604.625640] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 09:27:10 juju-e4d256-prod-github-runner-207 kernel: [14604.627658] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 09:27:10 juju-e4d256-prod-github-runner-207 kernel: [14604.628569] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 09:27:10 juju-e4d256-prod-github-runner-207 kernel: [14604.629467] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 09:27:10 juju-e4d256-prod-github-runner-207 kernel: [14604.630365] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 09:27:10 juju-e4d256-prod-github-runner-207 kernel: [14604.631254] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 09:27:10 juju-e4d256-prod-github-runner-207 kernel: [14604.632143] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 09:27:10 juju-e4d256-prod-github-runner-207 kernel: [14604.633059] Aug 22 09:27:38 juju-e4d256-prod-github-runner-207 kernel: [14632.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 13519s! [qemu-system-x86:6715] Aug 22 09:27:38 juju-e4d256-prod-github-runner-207 kernel: [14632.543942] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 09:27:38 juju-e4d256-prod-github-runner-207 kernel: [14632.544279] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 09:27:38 juju-e4d256-prod-github-runner-207 kernel: [14632.558541] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 09:27:38 juju-e4d256-prod-github-runner-207 kernel: [14632.559921] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 09:27:38 juju-e4d256-prod-github-runner-207 kernel: [14632.561142] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:27:38 juju-e4d256-prod-github-runner-207 kernel: [14632.562290] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 09:27:38 juju-e4d256-prod-github-runner-207 kernel: [14632.564998] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 09:27:38 juju-e4d256-prod-github-runner-207 kernel: [14632.566080] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 09:27:38 juju-e4d256-prod-github-runner-207 kernel: [14632.567259] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 09:27:38 juju-e4d256-prod-github-runner-207 kernel: [14632.568430] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 09:27:38 juju-e4d256-prod-github-runner-207 kernel: [14632.569610] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 09:27:38 juju-e4d256-prod-github-runner-207 kernel: [14632.570774] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 09:27:38 juju-e4d256-prod-github-runner-207 kernel: [14632.572189] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 09:27:38 juju-e4d256-prod-github-runner-207 kernel: [14632.573437] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 09:27:38 juju-e4d256-prod-github-runner-207 kernel: [14632.574543] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 09:27:38 juju-e4d256-prod-github-runner-207 kernel: [14632.575740] Call Trace: Aug 22 09:27:38 juju-e4d256-prod-github-runner-207 kernel: [14632.576715] Aug 22 09:27:38 juju-e4d256-prod-github-runner-207 kernel: [14632.577657] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:27:38 juju-e4d256-prod-github-runner-207 kernel: [14632.578803] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:27:38 juju-e4d256-prod-github-runner-207 kernel: [14632.580016] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:27:38 juju-e4d256-prod-github-runner-207 kernel: [14632.581162] ? show_regs.part.0+0x23/0x29 Aug 22 09:27:38 juju-e4d256-prod-github-runner-207 kernel: [14632.582225] ? show_regs.cold+0x8/0xd Aug 22 09:27:38 juju-e4d256-prod-github-runner-207 kernel: [14632.583251] ? watchdog_timer_fn+0x1be/0x220 Aug 22 09:27:38 juju-e4d256-prod-github-runner-207 kernel: [14632.584264] ? lockup_detector_update_enable+0x60/0x60 Aug 22 09:27:38 juju-e4d256-prod-github-runner-207 kernel: [14632.585458] ? __hrtimer_run_queues+0x107/0x230 Aug 22 09:27:38 juju-e4d256-prod-github-runner-207 kernel: [14632.586508] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 09:27:38 juju-e4d256-prod-github-runner-207 kernel: [14632.587586] ? hrtimer_interrupt+0x101/0x220 Aug 22 09:27:38 juju-e4d256-prod-github-runner-207 kernel: [14632.588645] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 09:27:38 juju-e4d256-prod-github-runner-207 kernel: [14632.589824] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 09:27:38 juju-e4d256-prod-github-runner-207 kernel: [14632.590882] Aug 22 09:27:38 juju-e4d256-prod-github-runner-207 kernel: [14632.591795] Aug 22 09:27:38 juju-e4d256-prod-github-runner-207 kernel: [14632.592634] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 09:27:38 juju-e4d256-prod-github-runner-207 kernel: [14632.593724] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:27:38 juju-e4d256-prod-github-runner-207 kernel: [14632.594866] ? _raw_spin_lock+0x22/0x30 Aug 22 09:27:38 juju-e4d256-prod-github-runner-207 kernel: [14632.595871] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:27:38 juju-e4d256-prod-github-runner-207 kernel: [14632.597292] direct_page_fault+0x206/0x310 [kvm] Aug 22 09:27:38 juju-e4d256-prod-github-runner-207 kernel: [14632.598898] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 09:27:38 juju-e4d256-prod-github-runner-207 kernel: [14632.600509] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 09:27:38 juju-e4d256-prod-github-runner-207 kernel: [14632.602167] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 09:27:38 juju-e4d256-prod-github-runner-207 kernel: [14632.603717] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 09:27:38 juju-e4d256-prod-github-runner-207 kernel: [14632.604805] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 09:27:38 juju-e4d256-prod-github-runner-207 kernel: [14632.605908] handle_exit+0x98/0x230 [kvm_amd] Aug 22 09:27:38 juju-e4d256-prod-github-runner-207 kernel: [14632.606840] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 09:27:38 juju-e4d256-prod-github-runner-207 kernel: [14632.607773] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 09:27:38 juju-e4d256-prod-github-runner-207 kernel: [14632.608708] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 09:27:38 juju-e4d256-prod-github-runner-207 kernel: [14632.609635] vcpu_run+0x62/0x2c0 [kvm] Aug 22 09:27:38 juju-e4d256-prod-github-runner-207 kernel: [14632.610478] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 09:27:38 juju-e4d256-prod-github-runner-207 kernel: [14632.611316] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 09:27:38 juju-e4d256-prod-github-runner-207 kernel: [14632.612201] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 09:27:38 juju-e4d256-prod-github-runner-207 kernel: [14632.613007] ? __seccomp_filter+0x4a/0x4a0 Aug 22 09:27:38 juju-e4d256-prod-github-runner-207 kernel: [14632.613776] ? __fget_files+0x86/0xc0 Aug 22 09:27:38 juju-e4d256-prod-github-runner-207 kernel: [14632.614589] __x64_sys_ioctl+0x95/0xd0 Aug 22 09:27:38 juju-e4d256-prod-github-runner-207 kernel: [14632.615379] do_syscall_64+0x5c/0xc0 Aug 22 09:27:38 juju-e4d256-prod-github-runner-207 kernel: [14632.616194] ? do_futex+0x162/0x1f0 Aug 22 09:27:38 juju-e4d256-prod-github-runner-207 kernel: [14632.616932] ? __x64_sys_futex+0x78/0x1e0 Aug 22 09:27:38 juju-e4d256-prod-github-runner-207 kernel: [14632.617783] ? __secure_computing+0xa9/0x120 Aug 22 09:27:38 juju-e4d256-prod-github-runner-207 kernel: [14632.618701] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 09:27:38 juju-e4d256-prod-github-runner-207 kernel: [14632.619684] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:27:38 juju-e4d256-prod-github-runner-207 kernel: [14632.620457] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:27:38 juju-e4d256-prod-github-runner-207 kernel: [14632.621232] ? do_syscall_64+0x69/0xc0 Aug 22 09:27:38 juju-e4d256-prod-github-runner-207 kernel: [14632.621965] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:27:38 juju-e4d256-prod-github-runner-207 kernel: [14632.622782] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:27:38 juju-e4d256-prod-github-runner-207 kernel: [14632.623587] ? do_syscall_64+0x69/0xc0 Aug 22 09:27:38 juju-e4d256-prod-github-runner-207 kernel: [14632.624297] ? do_syscall_64+0x69/0xc0 Aug 22 09:27:38 juju-e4d256-prod-github-runner-207 kernel: [14632.625008] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 09:27:38 juju-e4d256-prod-github-runner-207 kernel: [14632.625847] RIP: 0033:0x7faa5d0edaff Aug 22 09:27:38 juju-e4d256-prod-github-runner-207 kernel: [14632.626581] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 09:27:38 juju-e4d256-prod-github-runner-207 kernel: [14632.628904] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 09:27:38 juju-e4d256-prod-github-runner-207 kernel: [14632.629973] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 09:27:38 juju-e4d256-prod-github-runner-207 kernel: [14632.631000] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 09:27:38 juju-e4d256-prod-github-runner-207 kernel: [14632.632025] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 09:27:38 juju-e4d256-prod-github-runner-207 kernel: [14632.633050] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 09:27:38 juju-e4d256-prod-github-runner-207 kernel: [14632.634092] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 09:27:38 juju-e4d256-prod-github-runner-207 kernel: [14632.635127] Aug 22 09:28:06 juju-e4d256-prod-github-runner-207 kernel: [14660.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 13545s! [qemu-system-x86:6715] Aug 22 09:28:06 juju-e4d256-prod-github-runner-207 kernel: [14660.543109] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 09:28:06 juju-e4d256-prod-github-runner-207 kernel: [14660.543185] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 09:28:06 juju-e4d256-prod-github-runner-207 kernel: [14660.555688] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 09:28:06 juju-e4d256-prod-github-runner-207 kernel: [14660.556962] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 09:28:06 juju-e4d256-prod-github-runner-207 kernel: [14660.558188] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:28:06 juju-e4d256-prod-github-runner-207 kernel: [14660.559249] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 09:28:06 juju-e4d256-prod-github-runner-207 kernel: [14660.561817] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 09:28:06 juju-e4d256-prod-github-runner-207 kernel: [14660.562863] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 09:28:06 juju-e4d256-prod-github-runner-207 kernel: [14660.564030] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 09:28:06 juju-e4d256-prod-github-runner-207 kernel: [14660.565219] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 09:28:06 juju-e4d256-prod-github-runner-207 kernel: [14660.566388] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 09:28:06 juju-e4d256-prod-github-runner-207 kernel: [14660.567565] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 09:28:06 juju-e4d256-prod-github-runner-207 kernel: [14660.568750] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 09:28:06 juju-e4d256-prod-github-runner-207 kernel: [14660.570014] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 09:28:06 juju-e4d256-prod-github-runner-207 kernel: [14660.571118] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 09:28:06 juju-e4d256-prod-github-runner-207 kernel: [14660.572317] Call Trace: Aug 22 09:28:06 juju-e4d256-prod-github-runner-207 kernel: [14660.573341] Aug 22 09:28:06 juju-e4d256-prod-github-runner-207 kernel: [14660.574235] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:28:06 juju-e4d256-prod-github-runner-207 kernel: [14660.575266] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:28:06 juju-e4d256-prod-github-runner-207 kernel: [14660.576289] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:28:06 juju-e4d256-prod-github-runner-207 kernel: [14660.577388] ? show_regs.part.0+0x23/0x29 Aug 22 09:28:06 juju-e4d256-prod-github-runner-207 kernel: [14660.578385] ? show_regs.cold+0x8/0xd Aug 22 09:28:06 juju-e4d256-prod-github-runner-207 kernel: [14660.579451] ? watchdog_timer_fn+0x1be/0x220 Aug 22 09:28:06 juju-e4d256-prod-github-runner-207 kernel: [14660.580459] ? lockup_detector_update_enable+0x60/0x60 Aug 22 09:28:06 juju-e4d256-prod-github-runner-207 kernel: [14660.581533] ? __hrtimer_run_queues+0x107/0x230 Aug 22 09:28:06 juju-e4d256-prod-github-runner-207 kernel: [14660.582567] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 09:28:06 juju-e4d256-prod-github-runner-207 kernel: [14660.583589] ? hrtimer_interrupt+0x101/0x220 Aug 22 09:28:06 juju-e4d256-prod-github-runner-207 kernel: [14660.584604] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 09:28:06 juju-e4d256-prod-github-runner-207 kernel: [14660.585680] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 09:28:06 juju-e4d256-prod-github-runner-207 kernel: [14660.586722] Aug 22 09:28:06 juju-e4d256-prod-github-runner-207 kernel: [14660.587572] Aug 22 09:28:06 juju-e4d256-prod-github-runner-207 kernel: [14660.588413] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 09:28:06 juju-e4d256-prod-github-runner-207 kernel: [14660.589459] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:28:06 juju-e4d256-prod-github-runner-207 kernel: [14660.590496] ? _raw_spin_lock+0x22/0x30 Aug 22 09:28:06 juju-e4d256-prod-github-runner-207 kernel: [14660.591440] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:28:06 juju-e4d256-prod-github-runner-207 kernel: [14660.592463] direct_page_fault+0x206/0x310 [kvm] Aug 22 09:28:06 juju-e4d256-prod-github-runner-207 kernel: [14660.593504] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 09:28:06 juju-e4d256-prod-github-runner-207 kernel: [14660.594515] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 09:28:06 juju-e4d256-prod-github-runner-207 kernel: [14660.595519] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 09:28:06 juju-e4d256-prod-github-runner-207 kernel: [14660.596490] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 09:28:06 juju-e4d256-prod-github-runner-207 kernel: [14660.597449] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 09:28:06 juju-e4d256-prod-github-runner-207 kernel: [14660.598432] handle_exit+0x98/0x230 [kvm_amd] Aug 22 09:28:06 juju-e4d256-prod-github-runner-207 kernel: [14660.599325] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 09:28:06 juju-e4d256-prod-github-runner-207 kernel: [14660.600242] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 09:28:06 juju-e4d256-prod-github-runner-207 kernel: [14660.601181] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 09:28:06 juju-e4d256-prod-github-runner-207 kernel: [14660.602115] vcpu_run+0x62/0x2c0 [kvm] Aug 22 09:28:06 juju-e4d256-prod-github-runner-207 kernel: [14660.602943] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 09:28:06 juju-e4d256-prod-github-runner-207 kernel: [14660.603757] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 09:28:06 juju-e4d256-prod-github-runner-207 kernel: [14660.604665] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 09:28:06 juju-e4d256-prod-github-runner-207 kernel: [14660.605514] ? __seccomp_filter+0x4a/0x4a0 Aug 22 09:28:06 juju-e4d256-prod-github-runner-207 kernel: [14660.606262] ? __fget_files+0x86/0xc0 Aug 22 09:28:06 juju-e4d256-prod-github-runner-207 kernel: [14660.606988] __x64_sys_ioctl+0x95/0xd0 Aug 22 09:28:06 juju-e4d256-prod-github-runner-207 kernel: [14660.607703] do_syscall_64+0x5c/0xc0 Aug 22 09:28:06 juju-e4d256-prod-github-runner-207 kernel: [14660.608373] ? do_futex+0x162/0x1f0 Aug 22 09:28:06 juju-e4d256-prod-github-runner-207 kernel: [14660.609039] ? __x64_sys_futex+0x78/0x1e0 Aug 22 09:28:06 juju-e4d256-prod-github-runner-207 kernel: [14660.609717] ? __secure_computing+0xa9/0x120 Aug 22 09:28:06 juju-e4d256-prod-github-runner-207 kernel: [14660.610406] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 09:28:06 juju-e4d256-prod-github-runner-207 kernel: [14660.611174] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:28:06 juju-e4d256-prod-github-runner-207 kernel: [14660.611905] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:28:06 juju-e4d256-prod-github-runner-207 kernel: [14660.612626] ? do_syscall_64+0x69/0xc0 Aug 22 09:28:06 juju-e4d256-prod-github-runner-207 kernel: [14660.613311] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:28:06 juju-e4d256-prod-github-runner-207 kernel: [14660.614045] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:28:06 juju-e4d256-prod-github-runner-207 kernel: [14660.614791] ? do_syscall_64+0x69/0xc0 Aug 22 09:28:06 juju-e4d256-prod-github-runner-207 kernel: [14660.615421] ? do_syscall_64+0x69/0xc0 Aug 22 09:28:06 juju-e4d256-prod-github-runner-207 kernel: [14660.616045] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 09:28:06 juju-e4d256-prod-github-runner-207 kernel: [14660.616748] RIP: 0033:0x7faa5d0edaff Aug 22 09:28:06 juju-e4d256-prod-github-runner-207 kernel: [14660.617422] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 09:28:06 juju-e4d256-prod-github-runner-207 kernel: [14660.619419] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 09:28:06 juju-e4d256-prod-github-runner-207 kernel: [14660.620339] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 09:28:06 juju-e4d256-prod-github-runner-207 kernel: [14660.621243] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 09:28:06 juju-e4d256-prod-github-runner-207 kernel: [14660.622146] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 09:28:06 juju-e4d256-prod-github-runner-207 kernel: [14660.623044] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 09:28:06 juju-e4d256-prod-github-runner-207 kernel: [14660.623942] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 09:28:06 juju-e4d256-prod-github-runner-207 kernel: [14660.624845] Aug 22 09:28:34 juju-e4d256-prod-github-runner-207 kernel: [14688.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 13571s! [qemu-system-x86:6715] Aug 22 09:28:34 juju-e4d256-prod-github-runner-207 kernel: [14688.543111] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 09:28:34 juju-e4d256-prod-github-runner-207 kernel: [14688.543186] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 09:28:34 juju-e4d256-prod-github-runner-207 kernel: [14688.555550] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 09:28:34 juju-e4d256-prod-github-runner-207 kernel: [14688.556841] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 09:28:34 juju-e4d256-prod-github-runner-207 kernel: [14688.558070] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:28:34 juju-e4d256-prod-github-runner-207 kernel: [14688.559332] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 09:28:34 juju-e4d256-prod-github-runner-207 kernel: [14688.561945] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 09:28:34 juju-e4d256-prod-github-runner-207 kernel: [14688.562995] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 09:28:34 juju-e4d256-prod-github-runner-207 kernel: [14688.564189] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 09:28:34 juju-e4d256-prod-github-runner-207 kernel: [14688.565450] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 09:28:34 juju-e4d256-prod-github-runner-207 kernel: [14688.566615] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 09:28:34 juju-e4d256-prod-github-runner-207 kernel: [14688.567773] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 09:28:34 juju-e4d256-prod-github-runner-207 kernel: [14688.568965] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 09:28:34 juju-e4d256-prod-github-runner-207 kernel: [14688.570308] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 09:28:34 juju-e4d256-prod-github-runner-207 kernel: [14688.571429] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 09:28:34 juju-e4d256-prod-github-runner-207 kernel: [14688.572692] Call Trace: Aug 22 09:28:34 juju-e4d256-prod-github-runner-207 kernel: [14688.573613] Aug 22 09:28:34 juju-e4d256-prod-github-runner-207 kernel: [14688.574558] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:28:34 juju-e4d256-prod-github-runner-207 kernel: [14688.575600] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:28:34 juju-e4d256-prod-github-runner-207 kernel: [14688.576644] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:28:34 juju-e4d256-prod-github-runner-207 kernel: [14688.577725] ? show_regs.part.0+0x23/0x29 Aug 22 09:28:34 juju-e4d256-prod-github-runner-207 kernel: [14688.578722] ? show_regs.cold+0x8/0xd Aug 22 09:28:34 juju-e4d256-prod-github-runner-207 kernel: [14688.579732] ? watchdog_timer_fn+0x1be/0x220 Aug 22 09:28:34 juju-e4d256-prod-github-runner-207 kernel: [14688.580783] ? lockup_detector_update_enable+0x60/0x60 Aug 22 09:28:34 juju-e4d256-prod-github-runner-207 kernel: [14688.581845] ? __hrtimer_run_queues+0x107/0x230 Aug 22 09:28:34 juju-e4d256-prod-github-runner-207 kernel: [14688.582874] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 09:28:34 juju-e4d256-prod-github-runner-207 kernel: [14688.583895] ? hrtimer_interrupt+0x101/0x220 Aug 22 09:28:34 juju-e4d256-prod-github-runner-207 kernel: [14688.584970] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 09:28:34 juju-e4d256-prod-github-runner-207 kernel: [14688.586054] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 09:28:34 juju-e4d256-prod-github-runner-207 kernel: [14688.587097] Aug 22 09:28:34 juju-e4d256-prod-github-runner-207 kernel: [14688.587954] Aug 22 09:28:34 juju-e4d256-prod-github-runner-207 kernel: [14688.588852] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 09:28:34 juju-e4d256-prod-github-runner-207 kernel: [14688.589901] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:28:34 juju-e4d256-prod-github-runner-207 kernel: [14688.590956] ? _raw_spin_lock+0x22/0x30 Aug 22 09:28:34 juju-e4d256-prod-github-runner-207 kernel: [14688.591906] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:28:34 juju-e4d256-prod-github-runner-207 kernel: [14688.592945] direct_page_fault+0x206/0x310 [kvm] Aug 22 09:28:34 juju-e4d256-prod-github-runner-207 kernel: [14688.593973] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 09:28:34 juju-e4d256-prod-github-runner-207 kernel: [14688.594995] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 09:28:34 juju-e4d256-prod-github-runner-207 kernel: [14688.596000] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 09:28:34 juju-e4d256-prod-github-runner-207 kernel: [14688.596993] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 09:28:34 juju-e4d256-prod-github-runner-207 kernel: [14688.597938] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 09:28:34 juju-e4d256-prod-github-runner-207 kernel: [14688.598920] handle_exit+0x98/0x230 [kvm_amd] Aug 22 09:28:34 juju-e4d256-prod-github-runner-207 kernel: [14688.599834] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 09:28:34 juju-e4d256-prod-github-runner-207 kernel: [14688.600785] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 09:28:34 juju-e4d256-prod-github-runner-207 kernel: [14688.601713] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 09:28:34 juju-e4d256-prod-github-runner-207 kernel: [14688.602617] vcpu_run+0x62/0x2c0 [kvm] Aug 22 09:28:34 juju-e4d256-prod-github-runner-207 kernel: [14688.603428] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 09:28:34 juju-e4d256-prod-github-runner-207 kernel: [14688.604241] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 09:28:34 juju-e4d256-prod-github-runner-207 kernel: [14688.605164] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 09:28:34 juju-e4d256-prod-github-runner-207 kernel: [14688.605965] ? __seccomp_filter+0x4a/0x4a0 Aug 22 09:28:34 juju-e4d256-prod-github-runner-207 kernel: [14688.606722] ? __fget_files+0x86/0xc0 Aug 22 09:28:34 juju-e4d256-prod-github-runner-207 kernel: [14688.607430] __x64_sys_ioctl+0x95/0xd0 Aug 22 09:28:34 juju-e4d256-prod-github-runner-207 kernel: [14688.608120] do_syscall_64+0x5c/0xc0 Aug 22 09:28:34 juju-e4d256-prod-github-runner-207 kernel: [14688.608801] ? do_futex+0x162/0x1f0 Aug 22 09:28:34 juju-e4d256-prod-github-runner-207 kernel: [14688.609454] ? __x64_sys_futex+0x78/0x1e0 Aug 22 09:28:34 juju-e4d256-prod-github-runner-207 kernel: [14688.610148] ? __secure_computing+0xa9/0x120 Aug 22 09:28:34 juju-e4d256-prod-github-runner-207 kernel: [14688.610847] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 09:28:34 juju-e4d256-prod-github-runner-207 kernel: [14688.611606] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:28:34 juju-e4d256-prod-github-runner-207 kernel: [14688.612328] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:28:34 juju-e4d256-prod-github-runner-207 kernel: [14688.613093] ? do_syscall_64+0x69/0xc0 Aug 22 09:28:34 juju-e4d256-prod-github-runner-207 kernel: [14688.613746] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:28:34 juju-e4d256-prod-github-runner-207 kernel: [14688.614453] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:28:34 juju-e4d256-prod-github-runner-207 kernel: [14688.615155] ? do_syscall_64+0x69/0xc0 Aug 22 09:28:34 juju-e4d256-prod-github-runner-207 kernel: [14688.615794] ? do_syscall_64+0x69/0xc0 Aug 22 09:28:34 juju-e4d256-prod-github-runner-207 kernel: [14688.616424] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 09:28:34 juju-e4d256-prod-github-runner-207 kernel: [14688.617146] RIP: 0033:0x7faa5d0edaff Aug 22 09:28:34 juju-e4d256-prod-github-runner-207 kernel: [14688.617768] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 09:28:34 juju-e4d256-prod-github-runner-207 kernel: [14688.619752] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 09:28:34 juju-e4d256-prod-github-runner-207 kernel: [14688.620689] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 09:28:34 juju-e4d256-prod-github-runner-207 kernel: [14688.621581] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 09:28:34 juju-e4d256-prod-github-runner-207 kernel: [14688.622470] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 09:28:34 juju-e4d256-prod-github-runner-207 kernel: [14688.623362] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 09:28:34 juju-e4d256-prod-github-runner-207 kernel: [14688.624281] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 09:28:34 juju-e4d256-prod-github-runner-207 kernel: [14688.625186] Aug 22 09:29:02 juju-e4d256-prod-github-runner-207 kernel: [14716.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 13597s! [qemu-system-x86:6715] Aug 22 09:29:02 juju-e4d256-prod-github-runner-207 kernel: [14716.543213] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 09:29:02 juju-e4d256-prod-github-runner-207 kernel: [14716.543288] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 09:29:02 juju-e4d256-prod-github-runner-207 kernel: [14716.556035] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 09:29:02 juju-e4d256-prod-github-runner-207 kernel: [14716.557365] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 09:29:02 juju-e4d256-prod-github-runner-207 kernel: [14716.558580] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:29:02 juju-e4d256-prod-github-runner-207 kernel: [14716.559646] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 09:29:02 juju-e4d256-prod-github-runner-207 kernel: [14716.562221] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 09:29:02 juju-e4d256-prod-github-runner-207 kernel: [14716.563282] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 09:29:02 juju-e4d256-prod-github-runner-207 kernel: [14716.564463] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 09:29:02 juju-e4d256-prod-github-runner-207 kernel: [14716.565621] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 09:29:02 juju-e4d256-prod-github-runner-207 kernel: [14716.566798] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 09:29:02 juju-e4d256-prod-github-runner-207 kernel: [14716.568001] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 09:29:02 juju-e4d256-prod-github-runner-207 kernel: [14716.569191] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 09:29:02 juju-e4d256-prod-github-runner-207 kernel: [14716.570428] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 09:29:02 juju-e4d256-prod-github-runner-207 kernel: [14716.571524] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 09:29:02 juju-e4d256-prod-github-runner-207 kernel: [14716.572736] Call Trace: Aug 22 09:29:02 juju-e4d256-prod-github-runner-207 kernel: [14716.573656] Aug 22 09:29:02 juju-e4d256-prod-github-runner-207 kernel: [14716.574539] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:29:02 juju-e4d256-prod-github-runner-207 kernel: [14716.575575] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:29:02 juju-e4d256-prod-github-runner-207 kernel: [14716.576619] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:29:02 juju-e4d256-prod-github-runner-207 kernel: [14716.577714] ? show_regs.part.0+0x23/0x29 Aug 22 09:29:02 juju-e4d256-prod-github-runner-207 kernel: [14716.578729] ? show_regs.cold+0x8/0xd Aug 22 09:29:02 juju-e4d256-prod-github-runner-207 kernel: [14716.579705] ? watchdog_timer_fn+0x1be/0x220 Aug 22 09:29:02 juju-e4d256-prod-github-runner-207 kernel: [14716.580748] ? lockup_detector_update_enable+0x60/0x60 Aug 22 09:29:02 juju-e4d256-prod-github-runner-207 kernel: [14716.581818] ? __hrtimer_run_queues+0x107/0x230 Aug 22 09:29:02 juju-e4d256-prod-github-runner-207 kernel: [14716.582861] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 09:29:02 juju-e4d256-prod-github-runner-207 kernel: [14716.583895] ? hrtimer_interrupt+0x101/0x220 Aug 22 09:29:02 juju-e4d256-prod-github-runner-207 kernel: [14716.584939] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 09:29:02 juju-e4d256-prod-github-runner-207 kernel: [14716.586063] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 09:29:02 juju-e4d256-prod-github-runner-207 kernel: [14716.587131] Aug 22 09:29:02 juju-e4d256-prod-github-runner-207 kernel: [14716.588017] Aug 22 09:29:02 juju-e4d256-prod-github-runner-207 kernel: [14716.588901] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 09:29:02 juju-e4d256-prod-github-runner-207 kernel: [14716.589958] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:29:02 juju-e4d256-prod-github-runner-207 kernel: [14716.591013] ? _raw_spin_lock+0x22/0x30 Aug 22 09:29:02 juju-e4d256-prod-github-runner-207 kernel: [14716.592006] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:29:02 juju-e4d256-prod-github-runner-207 kernel: [14716.593055] direct_page_fault+0x206/0x310 [kvm] Aug 22 09:29:02 juju-e4d256-prod-github-runner-207 kernel: [14716.594098] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 09:29:02 juju-e4d256-prod-github-runner-207 kernel: [14716.595108] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 09:29:02 juju-e4d256-prod-github-runner-207 kernel: [14716.596105] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 09:29:02 juju-e4d256-prod-github-runner-207 kernel: [14716.597089] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 09:29:02 juju-e4d256-prod-github-runner-207 kernel: [14716.598032] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 09:29:02 juju-e4d256-prod-github-runner-207 kernel: [14716.599008] handle_exit+0x98/0x230 [kvm_amd] Aug 22 09:29:02 juju-e4d256-prod-github-runner-207 kernel: [14716.599899] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 09:29:02 juju-e4d256-prod-github-runner-207 kernel: [14716.600842] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 09:29:02 juju-e4d256-prod-github-runner-207 kernel: [14716.601780] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 09:29:02 juju-e4d256-prod-github-runner-207 kernel: [14716.602682] vcpu_run+0x62/0x2c0 [kvm] Aug 22 09:29:02 juju-e4d256-prod-github-runner-207 kernel: [14716.603491] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 09:29:02 juju-e4d256-prod-github-runner-207 kernel: [14716.604320] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 09:29:02 juju-e4d256-prod-github-runner-207 kernel: [14716.605181] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 09:29:02 juju-e4d256-prod-github-runner-207 kernel: [14716.605994] ? __seccomp_filter+0x4a/0x4a0 Aug 22 09:29:02 juju-e4d256-prod-github-runner-207 kernel: [14716.606759] ? __fget_files+0x86/0xc0 Aug 22 09:29:02 juju-e4d256-prod-github-runner-207 kernel: [14716.607486] __x64_sys_ioctl+0x95/0xd0 Aug 22 09:29:02 juju-e4d256-prod-github-runner-207 kernel: [14716.608203] do_syscall_64+0x5c/0xc0 Aug 22 09:29:02 juju-e4d256-prod-github-runner-207 kernel: [14716.608870] ? do_futex+0x162/0x1f0 Aug 22 09:29:02 juju-e4d256-prod-github-runner-207 kernel: [14716.609530] ? __x64_sys_futex+0x78/0x1e0 Aug 22 09:29:02 juju-e4d256-prod-github-runner-207 kernel: [14716.610204] ? __secure_computing+0xa9/0x120 Aug 22 09:29:02 juju-e4d256-prod-github-runner-207 kernel: [14716.610904] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 09:29:02 juju-e4d256-prod-github-runner-207 kernel: [14716.611667] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:29:02 juju-e4d256-prod-github-runner-207 kernel: [14716.612408] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:29:02 juju-e4d256-prod-github-runner-207 kernel: [14716.613129] ? do_syscall_64+0x69/0xc0 Aug 22 09:29:02 juju-e4d256-prod-github-runner-207 kernel: [14716.613777] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:29:02 juju-e4d256-prod-github-runner-207 kernel: [14716.614488] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:29:02 juju-e4d256-prod-github-runner-207 kernel: [14716.615186] ? do_syscall_64+0x69/0xc0 Aug 22 09:29:02 juju-e4d256-prod-github-runner-207 kernel: [14716.615813] ? do_syscall_64+0x69/0xc0 Aug 22 09:29:02 juju-e4d256-prod-github-runner-207 kernel: [14716.616446] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 09:29:02 juju-e4d256-prod-github-runner-207 kernel: [14716.617158] RIP: 0033:0x7faa5d0edaff Aug 22 09:29:02 juju-e4d256-prod-github-runner-207 kernel: [14716.617805] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 09:29:02 juju-e4d256-prod-github-runner-207 kernel: [14716.619854] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 09:29:02 juju-e4d256-prod-github-runner-207 kernel: [14716.620789] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 09:29:02 juju-e4d256-prod-github-runner-207 kernel: [14716.621688] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 09:29:02 juju-e4d256-prod-github-runner-207 kernel: [14716.622605] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 09:29:02 juju-e4d256-prod-github-runner-207 kernel: [14716.623493] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 09:29:02 juju-e4d256-prod-github-runner-207 kernel: [14716.624400] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 09:29:02 juju-e4d256-prod-github-runner-207 kernel: [14716.625312] Aug 22 09:29:30 juju-e4d256-prod-github-runner-207 kernel: [14744.541980] watchdog: BUG: soft lockup - CPU#1 stuck for 13623s! [qemu-system-x86:6715] Aug 22 09:29:30 juju-e4d256-prod-github-runner-207 kernel: [14744.543841] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 09:29:30 juju-e4d256-prod-github-runner-207 kernel: [14744.544116] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 09:29:30 juju-e4d256-prod-github-runner-207 kernel: [14744.556361] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 09:29:30 juju-e4d256-prod-github-runner-207 kernel: [14744.557645] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 09:29:30 juju-e4d256-prod-github-runner-207 kernel: [14744.558901] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:29:30 juju-e4d256-prod-github-runner-207 kernel: [14744.559973] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 09:29:30 juju-e4d256-prod-github-runner-207 kernel: [14744.562650] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 09:29:30 juju-e4d256-prod-github-runner-207 kernel: [14744.563727] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 09:29:30 juju-e4d256-prod-github-runner-207 kernel: [14744.564956] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 09:29:30 juju-e4d256-prod-github-runner-207 kernel: [14744.566124] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 09:29:30 juju-e4d256-prod-github-runner-207 kernel: [14744.567492] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 09:29:30 juju-e4d256-prod-github-runner-207 kernel: [14744.568849] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 09:29:30 juju-e4d256-prod-github-runner-207 kernel: [14744.570162] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 09:29:30 juju-e4d256-prod-github-runner-207 kernel: [14744.571572] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 09:29:30 juju-e4d256-prod-github-runner-207 kernel: [14744.572804] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 09:29:30 juju-e4d256-prod-github-runner-207 kernel: [14744.574134] Call Trace: Aug 22 09:29:30 juju-e4d256-prod-github-runner-207 kernel: [14744.575133] Aug 22 09:29:30 juju-e4d256-prod-github-runner-207 kernel: [14744.576134] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:29:30 juju-e4d256-prod-github-runner-207 kernel: [14744.577325] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:29:30 juju-e4d256-prod-github-runner-207 kernel: [14744.578535] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:29:30 juju-e4d256-prod-github-runner-207 kernel: [14744.579744] ? show_regs.part.0+0x23/0x29 Aug 22 09:29:30 juju-e4d256-prod-github-runner-207 kernel: [14744.580840] ? show_regs.cold+0x8/0xd Aug 22 09:29:30 juju-e4d256-prod-github-runner-207 kernel: [14744.581885] ? watchdog_timer_fn+0x1be/0x220 Aug 22 09:29:30 juju-e4d256-prod-github-runner-207 kernel: [14744.582979] ? lockup_detector_update_enable+0x60/0x60 Aug 22 09:29:30 juju-e4d256-prod-github-runner-207 kernel: [14744.584167] ? __hrtimer_run_queues+0x107/0x230 Aug 22 09:29:30 juju-e4d256-prod-github-runner-207 kernel: [14744.585287] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 09:29:30 juju-e4d256-prod-github-runner-207 kernel: [14744.586401] ? hrtimer_interrupt+0x101/0x220 Aug 22 09:29:30 juju-e4d256-prod-github-runner-207 kernel: [14744.587504] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 09:29:30 juju-e4d256-prod-github-runner-207 kernel: [14744.588684] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 09:29:30 juju-e4d256-prod-github-runner-207 kernel: [14744.589844] Aug 22 09:29:30 juju-e4d256-prod-github-runner-207 kernel: [14744.590743] Aug 22 09:29:30 juju-e4d256-prod-github-runner-207 kernel: [14744.591653] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 09:29:30 juju-e4d256-prod-github-runner-207 kernel: [14744.592843] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:29:30 juju-e4d256-prod-github-runner-207 kernel: [14744.593990] ? _raw_spin_lock+0x22/0x30 Aug 22 09:29:30 juju-e4d256-prod-github-runner-207 kernel: [14744.595015] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:29:30 juju-e4d256-prod-github-runner-207 kernel: [14744.596146] direct_page_fault+0x206/0x310 [kvm] Aug 22 09:29:30 juju-e4d256-prod-github-runner-207 kernel: [14744.597257] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 09:29:30 juju-e4d256-prod-github-runner-207 kernel: [14744.598348] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 09:29:30 juju-e4d256-prod-github-runner-207 kernel: [14744.599442] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 09:29:30 juju-e4d256-prod-github-runner-207 kernel: [14744.600578] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 09:29:30 juju-e4d256-prod-github-runner-207 kernel: [14744.601620] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 09:29:30 juju-e4d256-prod-github-runner-207 kernel: [14744.602706] handle_exit+0x98/0x230 [kvm_amd] Aug 22 09:29:30 juju-e4d256-prod-github-runner-207 kernel: [14744.603686] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 09:29:30 juju-e4d256-prod-github-runner-207 kernel: [14744.604709] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 09:29:30 juju-e4d256-prod-github-runner-207 kernel: [14744.605742] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 09:29:30 juju-e4d256-prod-github-runner-207 kernel: [14744.606756] vcpu_run+0x62/0x2c0 [kvm] Aug 22 09:29:30 juju-e4d256-prod-github-runner-207 kernel: [14744.607650] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 09:29:30 juju-e4d256-prod-github-runner-207 kernel: [14744.608561] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 09:29:30 juju-e4d256-prod-github-runner-207 kernel: [14744.609579] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 09:29:30 juju-e4d256-prod-github-runner-207 kernel: [14744.610490] ? __seccomp_filter+0x4a/0x4a0 Aug 22 09:29:30 juju-e4d256-prod-github-runner-207 kernel: [14744.611326] ? __fget_files+0x86/0xc0 Aug 22 09:29:30 juju-e4d256-prod-github-runner-207 kernel: [14744.612131] __x64_sys_ioctl+0x95/0xd0 Aug 22 09:29:30 juju-e4d256-prod-github-runner-207 kernel: [14744.612926] do_syscall_64+0x5c/0xc0 Aug 22 09:29:30 juju-e4d256-prod-github-runner-207 kernel: [14744.613687] ? do_futex+0x162/0x1f0 Aug 22 09:29:30 juju-e4d256-prod-github-runner-207 kernel: [14744.614411] ? __x64_sys_futex+0x78/0x1e0 Aug 22 09:29:30 juju-e4d256-prod-github-runner-207 kernel: [14744.615172] ? __secure_computing+0xa9/0x120 Aug 22 09:29:30 juju-e4d256-prod-github-runner-207 kernel: [14744.615980] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 09:29:30 juju-e4d256-prod-github-runner-207 kernel: [14744.616857] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:29:30 juju-e4d256-prod-github-runner-207 kernel: [14744.617674] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:29:30 juju-e4d256-prod-github-runner-207 kernel: [14744.618490] ? do_syscall_64+0x69/0xc0 Aug 22 09:29:30 juju-e4d256-prod-github-runner-207 kernel: [14744.619389] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:29:30 juju-e4d256-prod-github-runner-207 kernel: [14744.620394] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:29:30 juju-e4d256-prod-github-runner-207 kernel: [14744.621211] ? do_syscall_64+0x69/0xc0 Aug 22 09:29:30 juju-e4d256-prod-github-runner-207 kernel: [14744.621926] ? do_syscall_64+0x69/0xc0 Aug 22 09:29:30 juju-e4d256-prod-github-runner-207 kernel: [14744.622630] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 09:29:30 juju-e4d256-prod-github-runner-207 kernel: [14744.623446] RIP: 0033:0x7faa5d0edaff Aug 22 09:29:30 juju-e4d256-prod-github-runner-207 kernel: [14744.624210] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 09:29:30 juju-e4d256-prod-github-runner-207 kernel: [14744.626608] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 09:29:30 juju-e4d256-prod-github-runner-207 kernel: [14744.627716] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 09:29:30 juju-e4d256-prod-github-runner-207 kernel: [14744.628800] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 09:29:30 juju-e4d256-prod-github-runner-207 kernel: [14744.629850] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 09:29:30 juju-e4d256-prod-github-runner-207 kernel: [14744.630891] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 09:29:30 juju-e4d256-prod-github-runner-207 kernel: [14744.631981] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 09:29:30 juju-e4d256-prod-github-runner-207 kernel: [14744.633039] Aug 22 09:29:44 juju-e4d256-prod-github-runner-207 kernel: [14758.172709] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 09:29:44 juju-e4d256-prod-github-runner-207 kernel: [14758.173668] rcu: 1-....: (3648792 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=1762506 Aug 22 09:29:44 juju-e4d256-prod-github-runner-207 kernel: [14758.174806] (t=3660243 jiffies g=23269 q=22214) Aug 22 09:29:44 juju-e4d256-prod-github-runner-207 kernel: [14758.175609] NMI backtrace for cpu 1 Aug 22 09:29:44 juju-e4d256-prod-github-runner-207 kernel: [14758.176555] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 09:29:44 juju-e4d256-prod-github-runner-207 kernel: [14758.177658] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 09:29:44 juju-e4d256-prod-github-runner-207 kernel: [14758.178717] Call Trace: Aug 22 09:29:44 juju-e4d256-prod-github-runner-207 kernel: [14758.179391] Aug 22 09:29:44 juju-e4d256-prod-github-runner-207 kernel: [14758.180056] show_stack+0x52/0x5c Aug 22 09:29:44 juju-e4d256-prod-github-runner-207 kernel: [14758.180783] dump_stack_lvl+0x4a/0x63 Aug 22 09:29:44 juju-e4d256-prod-github-runner-207 kernel: [14758.181534] dump_stack+0x10/0x16 Aug 22 09:29:44 juju-e4d256-prod-github-runner-207 kernel: [14758.182267] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 09:29:44 juju-e4d256-prod-github-runner-207 kernel: [14758.183064] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 09:29:44 juju-e4d256-prod-github-runner-207 kernel: [14758.183869] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 09:29:44 juju-e4d256-prod-github-runner-207 kernel: [14758.184690] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 09:29:44 juju-e4d256-prod-github-runner-207 kernel: [14758.185506] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 09:29:44 juju-e4d256-prod-github-runner-207 kernel: [14758.186312] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 09:29:44 juju-e4d256-prod-github-runner-207 kernel: [14758.187083] print_cpu_stall.cold+0x2f/0xe2 Aug 22 09:29:44 juju-e4d256-prod-github-runner-207 kernel: [14758.187861] ? timekeeping_update+0xf7/0x150 Aug 22 09:29:44 juju-e4d256-prod-github-runner-207 kernel: [14758.188633] check_cpu_stall+0x109/0x270 Aug 22 09:29:44 juju-e4d256-prod-github-runner-207 kernel: [14758.189379] rcu_sched_clock_irq+0x9a/0x250 Aug 22 09:29:44 juju-e4d256-prod-github-runner-207 kernel: [14758.190160] update_process_times+0x94/0xd0 Aug 22 09:29:44 juju-e4d256-prod-github-runner-207 kernel: [14758.190930] tick_sched_handle+0x29/0x70 Aug 22 09:29:44 juju-e4d256-prod-github-runner-207 kernel: [14758.191695] tick_sched_timer+0x8c/0xc0 Aug 22 09:29:44 juju-e4d256-prod-github-runner-207 kernel: [14758.192434] ? tick_nohz_handler+0xb0/0xb0 Aug 22 09:29:44 juju-e4d256-prod-github-runner-207 kernel: [14758.193189] __hrtimer_run_queues+0x107/0x230 Aug 22 09:29:44 juju-e4d256-prod-github-runner-207 kernel: [14758.193962] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 09:29:44 juju-e4d256-prod-github-runner-207 kernel: [14758.194738] hrtimer_interrupt+0x101/0x220 Aug 22 09:29:44 juju-e4d256-prod-github-runner-207 kernel: [14758.195496] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 09:29:44 juju-e4d256-prod-github-runner-207 kernel: [14758.196327] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 09:29:44 juju-e4d256-prod-github-runner-207 kernel: [14758.197128] Aug 22 09:29:44 juju-e4d256-prod-github-runner-207 kernel: [14758.197762] Aug 22 09:29:44 juju-e4d256-prod-github-runner-207 kernel: [14758.198408] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 09:29:44 juju-e4d256-prod-github-runner-207 kernel: [14758.199237] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:29:44 juju-e4d256-prod-github-runner-207 kernel: [14758.200327] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 09:29:44 juju-e4d256-prod-github-runner-207 kernel: [14758.202717] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 09:29:44 juju-e4d256-prod-github-runner-207 kernel: [14758.203660] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 09:29:44 juju-e4d256-prod-github-runner-207 kernel: [14758.204660] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 09:29:44 juju-e4d256-prod-github-runner-207 kernel: [14758.205665] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 09:29:44 juju-e4d256-prod-github-runner-207 kernel: [14758.206673] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 09:29:44 juju-e4d256-prod-github-runner-207 kernel: [14758.207628] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 09:29:44 juju-e4d256-prod-github-runner-207 kernel: [14758.208614] ? _raw_spin_lock+0x22/0x30 Aug 22 09:29:44 juju-e4d256-prod-github-runner-207 kernel: [14758.209382] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:29:44 juju-e4d256-prod-github-runner-207 kernel: [14758.210268] direct_page_fault+0x206/0x310 [kvm] Aug 22 09:29:44 juju-e4d256-prod-github-runner-207 kernel: [14758.211138] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 09:29:44 juju-e4d256-prod-github-runner-207 kernel: [14758.211998] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 09:29:44 juju-e4d256-prod-github-runner-207 kernel: [14758.212825] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 09:29:44 juju-e4d256-prod-github-runner-207 kernel: [14758.213671] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 09:29:44 juju-e4d256-prod-github-runner-207 kernel: [14758.214468] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 09:29:44 juju-e4d256-prod-github-runner-207 kernel: [14758.215320] handle_exit+0x98/0x230 [kvm_amd] Aug 22 09:29:44 juju-e4d256-prod-github-runner-207 kernel: [14758.216121] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 09:29:44 juju-e4d256-prod-github-runner-207 kernel: [14758.216928] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 09:29:44 juju-e4d256-prod-github-runner-207 kernel: [14758.217728] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 09:29:44 juju-e4d256-prod-github-runner-207 kernel: [14758.218514] vcpu_run+0x62/0x2c0 [kvm] Aug 22 09:29:44 juju-e4d256-prod-github-runner-207 kernel: [14758.219307] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 09:29:44 juju-e4d256-prod-github-runner-207 kernel: [14758.220064] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 09:29:44 juju-e4d256-prod-github-runner-207 kernel: [14758.220868] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 09:29:44 juju-e4d256-prod-github-runner-207 kernel: [14758.221635] ? __seccomp_filter+0x4a/0x4a0 Aug 22 09:29:44 juju-e4d256-prod-github-runner-207 kernel: [14758.222359] ? __fget_files+0x86/0xc0 Aug 22 09:29:44 juju-e4d256-prod-github-runner-207 kernel: [14758.223051] __x64_sys_ioctl+0x95/0xd0 Aug 22 09:29:44 juju-e4d256-prod-github-runner-207 kernel: [14758.223771] do_syscall_64+0x5c/0xc0 Aug 22 09:29:44 juju-e4d256-prod-github-runner-207 kernel: [14758.224452] ? do_futex+0x162/0x1f0 Aug 22 09:29:44 juju-e4d256-prod-github-runner-207 kernel: [14758.225132] ? __x64_sys_futex+0x78/0x1e0 Aug 22 09:29:44 juju-e4d256-prod-github-runner-207 kernel: [14758.225854] ? __secure_computing+0xa9/0x120 Aug 22 09:29:44 juju-e4d256-prod-github-runner-207 kernel: [14758.226570] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 09:29:44 juju-e4d256-prod-github-runner-207 kernel: [14758.227357] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:29:44 juju-e4d256-prod-github-runner-207 kernel: [14758.228136] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:29:44 juju-e4d256-prod-github-runner-207 kernel: [14758.228891] ? do_syscall_64+0x69/0xc0 Aug 22 09:29:44 juju-e4d256-prod-github-runner-207 kernel: [14758.229580] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:29:44 juju-e4d256-prod-github-runner-207 kernel: [14758.230334] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:29:44 juju-e4d256-prod-github-runner-207 kernel: [14758.231090] ? do_syscall_64+0x69/0xc0 Aug 22 09:29:44 juju-e4d256-prod-github-runner-207 kernel: [14758.231804] ? do_syscall_64+0x69/0xc0 Aug 22 09:29:44 juju-e4d256-prod-github-runner-207 kernel: [14758.232492] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 09:29:44 juju-e4d256-prod-github-runner-207 kernel: [14758.233288] RIP: 0033:0x7faa5d0edaff Aug 22 09:29:44 juju-e4d256-prod-github-runner-207 kernel: [14758.233975] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 09:29:44 juju-e4d256-prod-github-runner-207 kernel: [14758.236123] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 09:29:44 juju-e4d256-prod-github-runner-207 kernel: [14758.237103] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 09:29:44 juju-e4d256-prod-github-runner-207 kernel: [14758.238052] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 09:29:44 juju-e4d256-prod-github-runner-207 kernel: [14758.238993] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 09:29:44 juju-e4d256-prod-github-runner-207 kernel: [14758.239946] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 09:29:44 juju-e4d256-prod-github-runner-207 kernel: [14758.240868] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 09:29:44 juju-e4d256-prod-github-runner-207 kernel: [14758.241785] Aug 22 09:30:10 juju-e4d256-prod-github-runner-207 kernel: [14784.541981] watchdog: BUG: soft lockup - CPU#1 stuck for 13661s! [qemu-system-x86:6715] Aug 22 09:30:10 juju-e4d256-prod-github-runner-207 kernel: [14784.543121] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 09:30:10 juju-e4d256-prod-github-runner-207 kernel: [14784.543197] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 09:30:10 juju-e4d256-prod-github-runner-207 kernel: [14784.555508] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 09:30:10 juju-e4d256-prod-github-runner-207 kernel: [14784.556774] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 09:30:10 juju-e4d256-prod-github-runner-207 kernel: [14784.557991] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:30:10 juju-e4d256-prod-github-runner-207 kernel: [14784.559055] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 09:30:10 juju-e4d256-prod-github-runner-207 kernel: [14784.561650] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 09:30:10 juju-e4d256-prod-github-runner-207 kernel: [14784.562695] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 09:30:10 juju-e4d256-prod-github-runner-207 kernel: [14784.563882] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 09:30:10 juju-e4d256-prod-github-runner-207 kernel: [14784.565048] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 09:30:10 juju-e4d256-prod-github-runner-207 kernel: [14784.566213] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 09:30:10 juju-e4d256-prod-github-runner-207 kernel: [14784.567388] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 09:30:10 juju-e4d256-prod-github-runner-207 kernel: [14784.568555] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 09:30:10 juju-e4d256-prod-github-runner-207 kernel: [14784.569787] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 09:30:10 juju-e4d256-prod-github-runner-207 kernel: [14784.570905] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 09:30:10 juju-e4d256-prod-github-runner-207 kernel: [14784.572139] Call Trace: Aug 22 09:30:10 juju-e4d256-prod-github-runner-207 kernel: [14784.573052] Aug 22 09:30:10 juju-e4d256-prod-github-runner-207 kernel: [14784.573935] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:30:10 juju-e4d256-prod-github-runner-207 kernel: [14784.574965] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:30:10 juju-e4d256-prod-github-runner-207 kernel: [14784.576275] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:30:10 juju-e4d256-prod-github-runner-207 kernel: [14784.577551] ? show_regs.part.0+0x23/0x29 Aug 22 09:30:10 juju-e4d256-prod-github-runner-207 kernel: [14784.578578] ? show_regs.cold+0x8/0xd Aug 22 09:30:10 juju-e4d256-prod-github-runner-207 kernel: [14784.579583] ? watchdog_timer_fn+0x1be/0x220 Aug 22 09:30:10 juju-e4d256-prod-github-runner-207 kernel: [14784.580622] ? lockup_detector_update_enable+0x60/0x60 Aug 22 09:30:10 juju-e4d256-prod-github-runner-207 kernel: [14784.581737] ? __hrtimer_run_queues+0x107/0x230 Aug 22 09:30:10 juju-e4d256-prod-github-runner-207 kernel: [14784.582777] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 09:30:10 juju-e4d256-prod-github-runner-207 kernel: [14784.583832] ? hrtimer_interrupt+0x101/0x220 Aug 22 09:30:10 juju-e4d256-prod-github-runner-207 kernel: [14784.584847] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 09:30:10 juju-e4d256-prod-github-runner-207 kernel: [14784.585922] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 09:30:10 juju-e4d256-prod-github-runner-207 kernel: [14784.586972] Aug 22 09:30:10 juju-e4d256-prod-github-runner-207 kernel: [14784.587844] Aug 22 09:30:10 juju-e4d256-prod-github-runner-207 kernel: [14784.588689] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 09:30:10 juju-e4d256-prod-github-runner-207 kernel: [14784.589721] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:30:10 juju-e4d256-prod-github-runner-207 kernel: [14784.590761] ? _raw_spin_lock+0x22/0x30 Aug 22 09:30:10 juju-e4d256-prod-github-runner-207 kernel: [14784.591726] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:30:10 juju-e4d256-prod-github-runner-207 kernel: [14784.592752] direct_page_fault+0x206/0x310 [kvm] Aug 22 09:30:10 juju-e4d256-prod-github-runner-207 kernel: [14784.593802] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 09:30:10 juju-e4d256-prod-github-runner-207 kernel: [14784.594822] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 09:30:10 juju-e4d256-prod-github-runner-207 kernel: [14784.595844] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 09:30:10 juju-e4d256-prod-github-runner-207 kernel: [14784.596816] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 09:30:10 juju-e4d256-prod-github-runner-207 kernel: [14784.597760] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 09:30:10 juju-e4d256-prod-github-runner-207 kernel: [14784.598737] handle_exit+0x98/0x230 [kvm_amd] Aug 22 09:30:10 juju-e4d256-prod-github-runner-207 kernel: [14784.599645] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 09:30:10 juju-e4d256-prod-github-runner-207 kernel: [14784.600639] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 09:30:10 juju-e4d256-prod-github-runner-207 kernel: [14784.601577] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 09:30:10 juju-e4d256-prod-github-runner-207 kernel: [14784.602495] vcpu_run+0x62/0x2c0 [kvm] Aug 22 09:30:10 juju-e4d256-prod-github-runner-207 kernel: [14784.603334] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 09:30:10 juju-e4d256-prod-github-runner-207 kernel: [14784.604150] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 09:30:10 juju-e4d256-prod-github-runner-207 kernel: [14784.605007] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 09:30:10 juju-e4d256-prod-github-runner-207 kernel: [14784.605811] ? __seccomp_filter+0x4a/0x4a0 Aug 22 09:30:10 juju-e4d256-prod-github-runner-207 kernel: [14784.606555] ? __fget_files+0x86/0xc0 Aug 22 09:30:10 juju-e4d256-prod-github-runner-207 kernel: [14784.607286] __x64_sys_ioctl+0x95/0xd0 Aug 22 09:30:10 juju-e4d256-prod-github-runner-207 kernel: [14784.608012] do_syscall_64+0x5c/0xc0 Aug 22 09:30:10 juju-e4d256-prod-github-runner-207 kernel: [14784.608679] ? do_futex+0x162/0x1f0 Aug 22 09:30:10 juju-e4d256-prod-github-runner-207 kernel: [14784.609327] ? __x64_sys_futex+0x78/0x1e0 Aug 22 09:30:10 juju-e4d256-prod-github-runner-207 kernel: [14784.609999] ? __secure_computing+0xa9/0x120 Aug 22 09:30:10 juju-e4d256-prod-github-runner-207 kernel: [14784.610687] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 09:30:10 juju-e4d256-prod-github-runner-207 kernel: [14784.611464] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:30:10 juju-e4d256-prod-github-runner-207 kernel: [14784.612187] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:30:10 juju-e4d256-prod-github-runner-207 kernel: [14784.612918] ? do_syscall_64+0x69/0xc0 Aug 22 09:30:10 juju-e4d256-prod-github-runner-207 kernel: [14784.613564] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:30:10 juju-e4d256-prod-github-runner-207 kernel: [14784.614264] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:30:10 juju-e4d256-prod-github-runner-207 kernel: [14784.614957] ? do_syscall_64+0x69/0xc0 Aug 22 09:30:10 juju-e4d256-prod-github-runner-207 kernel: [14784.615601] ? do_syscall_64+0x69/0xc0 Aug 22 09:30:10 juju-e4d256-prod-github-runner-207 kernel: [14784.616230] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 09:30:10 juju-e4d256-prod-github-runner-207 kernel: [14784.616934] RIP: 0033:0x7faa5d0edaff Aug 22 09:30:10 juju-e4d256-prod-github-runner-207 kernel: [14784.617563] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 09:30:10 juju-e4d256-prod-github-runner-207 kernel: [14784.619565] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 09:30:10 juju-e4d256-prod-github-runner-207 kernel: [14784.620483] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 09:30:10 juju-e4d256-prod-github-runner-207 kernel: [14784.621373] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 09:30:10 juju-e4d256-prod-github-runner-207 kernel: [14784.622264] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 09:30:10 juju-e4d256-prod-github-runner-207 kernel: [14784.623152] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 09:30:10 juju-e4d256-prod-github-runner-207 kernel: [14784.624056] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 09:30:10 juju-e4d256-prod-github-runner-207 kernel: [14784.624949] Aug 22 09:30:38 juju-e4d256-prod-github-runner-207 kernel: [14812.541982] watchdog: BUG: soft lockup - CPU#1 stuck for 13687s! [qemu-system-x86:6715] Aug 22 09:30:38 juju-e4d256-prod-github-runner-207 kernel: [14812.543180] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 09:30:38 juju-e4d256-prod-github-runner-207 kernel: [14812.543254] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 09:30:38 juju-e4d256-prod-github-runner-207 kernel: [14812.555720] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 09:30:38 juju-e4d256-prod-github-runner-207 kernel: [14812.557281] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 09:30:38 juju-e4d256-prod-github-runner-207 kernel: [14812.558622] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:30:38 juju-e4d256-prod-github-runner-207 kernel: [14812.559773] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 09:30:38 juju-e4d256-prod-github-runner-207 kernel: [14812.562340] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 09:30:38 juju-e4d256-prod-github-runner-207 kernel: [14812.563425] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 09:30:38 juju-e4d256-prod-github-runner-207 kernel: [14812.564608] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 09:30:38 juju-e4d256-prod-github-runner-207 kernel: [14812.565799] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 09:30:38 juju-e4d256-prod-github-runner-207 kernel: [14812.567005] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 09:30:38 juju-e4d256-prod-github-runner-207 kernel: [14812.568182] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 09:30:38 juju-e4d256-prod-github-runner-207 kernel: [14812.569367] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 09:30:38 juju-e4d256-prod-github-runner-207 kernel: [14812.570604] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 09:30:38 juju-e4d256-prod-github-runner-207 kernel: [14812.571729] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 09:30:38 juju-e4d256-prod-github-runner-207 kernel: [14812.572924] Call Trace: Aug 22 09:30:38 juju-e4d256-prod-github-runner-207 kernel: [14812.573854] Aug 22 09:30:38 juju-e4d256-prod-github-runner-207 kernel: [14812.574774] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:30:38 juju-e4d256-prod-github-runner-207 kernel: [14812.575836] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:30:38 juju-e4d256-prod-github-runner-207 kernel: [14812.576857] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:30:38 juju-e4d256-prod-github-runner-207 kernel: [14812.577932] ? show_regs.part.0+0x23/0x29 Aug 22 09:30:38 juju-e4d256-prod-github-runner-207 kernel: [14812.578943] ? show_regs.cold+0x8/0xd Aug 22 09:30:38 juju-e4d256-prod-github-runner-207 kernel: [14812.579941] ? watchdog_timer_fn+0x1be/0x220 Aug 22 09:30:38 juju-e4d256-prod-github-runner-207 kernel: [14812.580958] ? lockup_detector_update_enable+0x60/0x60 Aug 22 09:30:38 juju-e4d256-prod-github-runner-207 kernel: [14812.582022] ? __hrtimer_run_queues+0x107/0x230 Aug 22 09:30:38 juju-e4d256-prod-github-runner-207 kernel: [14812.583093] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 09:30:38 juju-e4d256-prod-github-runner-207 kernel: [14812.584146] ? hrtimer_interrupt+0x101/0x220 Aug 22 09:30:38 juju-e4d256-prod-github-runner-207 kernel: [14812.585183] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 09:30:38 juju-e4d256-prod-github-runner-207 kernel: [14812.586258] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 09:30:38 juju-e4d256-prod-github-runner-207 kernel: [14812.587478] Aug 22 09:30:38 juju-e4d256-prod-github-runner-207 kernel: [14812.588333] Aug 22 09:30:38 juju-e4d256-prod-github-runner-207 kernel: [14812.589222] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 09:30:38 juju-e4d256-prod-github-runner-207 kernel: [14812.590379] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:30:38 juju-e4d256-prod-github-runner-207 kernel: [14812.591457] ? _raw_spin_lock+0x22/0x30 Aug 22 09:30:38 juju-e4d256-prod-github-runner-207 kernel: [14812.592405] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:30:38 juju-e4d256-prod-github-runner-207 kernel: [14812.593461] direct_page_fault+0x206/0x310 [kvm] Aug 22 09:30:38 juju-e4d256-prod-github-runner-207 kernel: [14812.594527] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 09:30:38 juju-e4d256-prod-github-runner-207 kernel: [14812.595589] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 09:30:38 juju-e4d256-prod-github-runner-207 kernel: [14812.596794] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 09:30:38 juju-e4d256-prod-github-runner-207 kernel: [14812.597838] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 09:30:38 juju-e4d256-prod-github-runner-207 kernel: [14812.598796] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 09:30:38 juju-e4d256-prod-github-runner-207 kernel: [14812.599931] handle_exit+0x98/0x230 [kvm_amd] Aug 22 09:30:38 juju-e4d256-prod-github-runner-207 kernel: [14812.600858] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 09:30:38 juju-e4d256-prod-github-runner-207 kernel: [14812.601837] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 09:30:38 juju-e4d256-prod-github-runner-207 kernel: [14812.602785] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 09:30:38 juju-e4d256-prod-github-runner-207 kernel: [14812.603734] vcpu_run+0x62/0x2c0 [kvm] Aug 22 09:30:38 juju-e4d256-prod-github-runner-207 kernel: [14812.604586] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 09:30:38 juju-e4d256-prod-github-runner-207 kernel: [14812.605411] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 09:30:38 juju-e4d256-prod-github-runner-207 kernel: [14812.606282] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 09:30:38 juju-e4d256-prod-github-runner-207 kernel: [14812.607108] ? __seccomp_filter+0x4a/0x4a0 Aug 22 09:30:38 juju-e4d256-prod-github-runner-207 kernel: [14812.607856] ? __fget_files+0x86/0xc0 Aug 22 09:30:38 juju-e4d256-prod-github-runner-207 kernel: [14812.608582] __x64_sys_ioctl+0x95/0xd0 Aug 22 09:30:38 juju-e4d256-prod-github-runner-207 kernel: [14812.609307] do_syscall_64+0x5c/0xc0 Aug 22 09:30:38 juju-e4d256-prod-github-runner-207 kernel: [14812.609995] ? do_futex+0x162/0x1f0 Aug 22 09:30:38 juju-e4d256-prod-github-runner-207 kernel: [14812.610682] ? __x64_sys_futex+0x78/0x1e0 Aug 22 09:30:38 juju-e4d256-prod-github-runner-207 kernel: [14812.611398] ? __secure_computing+0xa9/0x120 Aug 22 09:30:38 juju-e4d256-prod-github-runner-207 kernel: [14812.612103] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 09:30:38 juju-e4d256-prod-github-runner-207 kernel: [14812.612869] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:30:38 juju-e4d256-prod-github-runner-207 kernel: [14812.613608] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:30:38 juju-e4d256-prod-github-runner-207 kernel: [14812.614349] ? do_syscall_64+0x69/0xc0 Aug 22 09:30:38 juju-e4d256-prod-github-runner-207 kernel: [14812.615042] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:30:38 juju-e4d256-prod-github-runner-207 kernel: [14812.615778] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:30:38 juju-e4d256-prod-github-runner-207 kernel: [14812.616488] ? do_syscall_64+0x69/0xc0 Aug 22 09:30:38 juju-e4d256-prod-github-runner-207 kernel: [14812.617115] ? do_syscall_64+0x69/0xc0 Aug 22 09:30:38 juju-e4d256-prod-github-runner-207 kernel: [14812.617736] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 09:30:38 juju-e4d256-prod-github-runner-207 kernel: [14812.618456] RIP: 0033:0x7faa5d0edaff Aug 22 09:30:38 juju-e4d256-prod-github-runner-207 kernel: [14812.619122] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 09:30:38 juju-e4d256-prod-github-runner-207 kernel: [14812.621157] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 09:30:38 juju-e4d256-prod-github-runner-207 kernel: [14812.622084] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 09:30:38 juju-e4d256-prod-github-runner-207 kernel: [14812.622996] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 09:30:38 juju-e4d256-prod-github-runner-207 kernel: [14812.623913] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 09:30:38 juju-e4d256-prod-github-runner-207 kernel: [14812.624846] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 09:30:38 juju-e4d256-prod-github-runner-207 kernel: [14812.625766] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 09:30:38 juju-e4d256-prod-github-runner-207 kernel: [14812.626695] Aug 22 09:31:06 juju-e4d256-prod-github-runner-207 kernel: [14840.541981] watchdog: BUG: soft lockup - CPU#1 stuck for 13713s! [qemu-system-x86:6715] Aug 22 09:31:06 juju-e4d256-prod-github-runner-207 kernel: [14840.543865] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 09:31:06 juju-e4d256-prod-github-runner-207 kernel: [14840.544150] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 09:31:06 juju-e4d256-prod-github-runner-207 kernel: [14840.556597] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 09:31:06 juju-e4d256-prod-github-runner-207 kernel: [14840.557879] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 09:31:06 juju-e4d256-prod-github-runner-207 kernel: [14840.559145] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:31:06 juju-e4d256-prod-github-runner-207 kernel: [14840.560235] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 09:31:06 juju-e4d256-prod-github-runner-207 kernel: [14840.562860] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 09:31:06 juju-e4d256-prod-github-runner-207 kernel: [14840.563933] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 09:31:06 juju-e4d256-prod-github-runner-207 kernel: [14840.565123] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 09:31:06 juju-e4d256-prod-github-runner-207 kernel: [14840.566280] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 09:31:06 juju-e4d256-prod-github-runner-207 kernel: [14840.567476] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 09:31:06 juju-e4d256-prod-github-runner-207 kernel: [14840.568711] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 09:31:06 juju-e4d256-prod-github-runner-207 kernel: [14840.569893] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 09:31:06 juju-e4d256-prod-github-runner-207 kernel: [14840.571173] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 09:31:06 juju-e4d256-prod-github-runner-207 kernel: [14840.572455] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 09:31:06 juju-e4d256-prod-github-runner-207 kernel: [14840.573682] Call Trace: Aug 22 09:31:06 juju-e4d256-prod-github-runner-207 kernel: [14840.574630] Aug 22 09:31:06 juju-e4d256-prod-github-runner-207 kernel: [14840.575567] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:31:06 juju-e4d256-prod-github-runner-207 kernel: [14840.576604] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:31:06 juju-e4d256-prod-github-runner-207 kernel: [14840.577628] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:31:06 juju-e4d256-prod-github-runner-207 kernel: [14840.578751] ? show_regs.part.0+0x23/0x29 Aug 22 09:31:06 juju-e4d256-prod-github-runner-207 kernel: [14840.579763] ? show_regs.cold+0x8/0xd Aug 22 09:31:06 juju-e4d256-prod-github-runner-207 kernel: [14840.580742] ? watchdog_timer_fn+0x1be/0x220 Aug 22 09:31:06 juju-e4d256-prod-github-runner-207 kernel: [14840.581767] ? lockup_detector_update_enable+0x60/0x60 Aug 22 09:31:06 juju-e4d256-prod-github-runner-207 kernel: [14840.583135] ? __hrtimer_run_queues+0x107/0x230 Aug 22 09:31:06 juju-e4d256-prod-github-runner-207 kernel: [14840.584197] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 09:31:06 juju-e4d256-prod-github-runner-207 kernel: [14840.585251] ? hrtimer_interrupt+0x101/0x220 Aug 22 09:31:06 juju-e4d256-prod-github-runner-207 kernel: [14840.586278] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 09:31:06 juju-e4d256-prod-github-runner-207 kernel: [14840.587361] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 09:31:06 juju-e4d256-prod-github-runner-207 kernel: [14840.588419] Aug 22 09:31:06 juju-e4d256-prod-github-runner-207 kernel: [14840.589286] Aug 22 09:31:06 juju-e4d256-prod-github-runner-207 kernel: [14840.590138] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 09:31:06 juju-e4d256-prod-github-runner-207 kernel: [14840.591190] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:31:06 juju-e4d256-prod-github-runner-207 kernel: [14840.592249] ? _raw_spin_lock+0x22/0x30 Aug 22 09:31:06 juju-e4d256-prod-github-runner-207 kernel: [14840.593203] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:31:06 juju-e4d256-prod-github-runner-207 kernel: [14840.594260] direct_page_fault+0x206/0x310 [kvm] Aug 22 09:31:06 juju-e4d256-prod-github-runner-207 kernel: [14840.595310] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 09:31:06 juju-e4d256-prod-github-runner-207 kernel: [14840.596353] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 09:31:06 juju-e4d256-prod-github-runner-207 kernel: [14840.597376] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 09:31:06 juju-e4d256-prod-github-runner-207 kernel: [14840.598386] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 09:31:06 juju-e4d256-prod-github-runner-207 kernel: [14840.599483] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 09:31:06 juju-e4d256-prod-github-runner-207 kernel: [14840.600571] handle_exit+0x98/0x230 [kvm_amd] Aug 22 09:31:06 juju-e4d256-prod-github-runner-207 kernel: [14840.601601] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 09:31:06 juju-e4d256-prod-github-runner-207 kernel: [14840.602662] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 09:31:06 juju-e4d256-prod-github-runner-207 kernel: [14840.603687] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 09:31:06 juju-e4d256-prod-github-runner-207 kernel: [14840.604702] vcpu_run+0x62/0x2c0 [kvm] Aug 22 09:31:06 juju-e4d256-prod-github-runner-207 kernel: [14840.605668] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 09:31:06 juju-e4d256-prod-github-runner-207 kernel: [14840.606645] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 09:31:06 juju-e4d256-prod-github-runner-207 kernel: [14840.607619] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 09:31:06 juju-e4d256-prod-github-runner-207 kernel: [14840.608504] ? __seccomp_filter+0x4a/0x4a0 Aug 22 09:31:06 juju-e4d256-prod-github-runner-207 kernel: [14840.609335] ? __fget_files+0x86/0xc0 Aug 22 09:31:06 juju-e4d256-prod-github-runner-207 kernel: [14840.610121] __x64_sys_ioctl+0x95/0xd0 Aug 22 09:31:06 juju-e4d256-prod-github-runner-207 kernel: [14840.610911] do_syscall_64+0x5c/0xc0 Aug 22 09:31:06 juju-e4d256-prod-github-runner-207 kernel: [14840.611649] ? do_futex+0x162/0x1f0 Aug 22 09:31:06 juju-e4d256-prod-github-runner-207 kernel: [14840.612372] ? __x64_sys_futex+0x78/0x1e0 Aug 22 09:31:06 juju-e4d256-prod-github-runner-207 kernel: [14840.613125] ? __secure_computing+0xa9/0x120 Aug 22 09:31:06 juju-e4d256-prod-github-runner-207 kernel: [14840.613900] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 09:31:06 juju-e4d256-prod-github-runner-207 kernel: [14840.614783] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:31:06 juju-e4d256-prod-github-runner-207 kernel: [14840.615596] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:31:06 juju-e4d256-prod-github-runner-207 kernel: [14840.616405] ? do_syscall_64+0x69/0xc0 Aug 22 09:31:06 juju-e4d256-prod-github-runner-207 kernel: [14840.617128] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:31:06 juju-e4d256-prod-github-runner-207 kernel: [14840.617922] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:31:06 juju-e4d256-prod-github-runner-207 kernel: [14840.618715] ? do_syscall_64+0x69/0xc0 Aug 22 09:31:06 juju-e4d256-prod-github-runner-207 kernel: [14840.619459] ? do_syscall_64+0x69/0xc0 Aug 22 09:31:06 juju-e4d256-prod-github-runner-207 kernel: [14840.620165] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 09:31:06 juju-e4d256-prod-github-runner-207 kernel: [14840.620973] RIP: 0033:0x7faa5d0edaff Aug 22 09:31:06 juju-e4d256-prod-github-runner-207 kernel: [14840.621736] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 09:31:06 juju-e4d256-prod-github-runner-207 kernel: [14840.624072] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 09:31:06 juju-e4d256-prod-github-runner-207 kernel: [14840.625139] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 09:31:06 juju-e4d256-prod-github-runner-207 kernel: [14840.626175] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 09:31:06 juju-e4d256-prod-github-runner-207 kernel: [14840.627218] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 09:31:06 juju-e4d256-prod-github-runner-207 kernel: [14840.628428] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 09:31:06 juju-e4d256-prod-github-runner-207 kernel: [14840.629466] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 09:31:06 juju-e4d256-prod-github-runner-207 kernel: [14840.630499] Aug 22 09:31:34 juju-e4d256-prod-github-runner-207 kernel: [14868.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 13739s! [qemu-system-x86:6715] Aug 22 09:31:34 juju-e4d256-prod-github-runner-207 kernel: [14868.543107] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 09:31:34 juju-e4d256-prod-github-runner-207 kernel: [14868.543182] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 09:31:34 juju-e4d256-prod-github-runner-207 kernel: [14868.555414] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 09:31:34 juju-e4d256-prod-github-runner-207 kernel: [14868.556694] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 09:31:34 juju-e4d256-prod-github-runner-207 kernel: [14868.557914] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:31:34 juju-e4d256-prod-github-runner-207 kernel: [14868.558988] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 09:31:34 juju-e4d256-prod-github-runner-207 kernel: [14868.561532] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 09:31:34 juju-e4d256-prod-github-runner-207 kernel: [14868.562607] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 09:31:34 juju-e4d256-prod-github-runner-207 kernel: [14868.563776] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 09:31:34 juju-e4d256-prod-github-runner-207 kernel: [14868.564932] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 09:31:34 juju-e4d256-prod-github-runner-207 kernel: [14868.566099] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 09:31:34 juju-e4d256-prod-github-runner-207 kernel: [14868.567274] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 09:31:34 juju-e4d256-prod-github-runner-207 kernel: [14868.568443] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 09:31:34 juju-e4d256-prod-github-runner-207 kernel: [14868.569674] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 09:31:34 juju-e4d256-prod-github-runner-207 kernel: [14868.570805] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 09:31:34 juju-e4d256-prod-github-runner-207 kernel: [14868.572006] Call Trace: Aug 22 09:31:34 juju-e4d256-prod-github-runner-207 kernel: [14868.572916] Aug 22 09:31:34 juju-e4d256-prod-github-runner-207 kernel: [14868.573800] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:31:34 juju-e4d256-prod-github-runner-207 kernel: [14868.575032] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:31:34 juju-e4d256-prod-github-runner-207 kernel: [14868.576055] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:31:34 juju-e4d256-prod-github-runner-207 kernel: [14868.577132] ? show_regs.part.0+0x23/0x29 Aug 22 09:31:34 juju-e4d256-prod-github-runner-207 kernel: [14868.578126] ? show_regs.cold+0x8/0xd Aug 22 09:31:34 juju-e4d256-prod-github-runner-207 kernel: [14868.579166] ? watchdog_timer_fn+0x1be/0x220 Aug 22 09:31:34 juju-e4d256-prod-github-runner-207 kernel: [14868.580373] ? lockup_detector_update_enable+0x60/0x60 Aug 22 09:31:34 juju-e4d256-prod-github-runner-207 kernel: [14868.581434] ? __hrtimer_run_queues+0x107/0x230 Aug 22 09:31:34 juju-e4d256-prod-github-runner-207 kernel: [14868.582476] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 09:31:34 juju-e4d256-prod-github-runner-207 kernel: [14868.583498] ? hrtimer_interrupt+0x101/0x220 Aug 22 09:31:34 juju-e4d256-prod-github-runner-207 kernel: [14868.584514] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 09:31:34 juju-e4d256-prod-github-runner-207 kernel: [14868.585580] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 09:31:34 juju-e4d256-prod-github-runner-207 kernel: [14868.586905] Aug 22 09:31:34 juju-e4d256-prod-github-runner-207 kernel: [14868.587821] Aug 22 09:31:34 juju-e4d256-prod-github-runner-207 kernel: [14868.588672] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 09:31:34 juju-e4d256-prod-github-runner-207 kernel: [14868.589710] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:31:34 juju-e4d256-prod-github-runner-207 kernel: [14868.591014] ? _raw_spin_lock+0x22/0x30 Aug 22 09:31:34 juju-e4d256-prod-github-runner-207 kernel: [14868.591968] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:31:34 juju-e4d256-prod-github-runner-207 kernel: [14868.592999] direct_page_fault+0x206/0x310 [kvm] Aug 22 09:31:34 juju-e4d256-prod-github-runner-207 kernel: [14868.594028] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 09:31:34 juju-e4d256-prod-github-runner-207 kernel: [14868.595055] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 09:31:34 juju-e4d256-prod-github-runner-207 kernel: [14868.596062] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 09:31:34 juju-e4d256-prod-github-runner-207 kernel: [14868.597042] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 09:31:34 juju-e4d256-prod-github-runner-207 kernel: [14868.597988] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 09:31:34 juju-e4d256-prod-github-runner-207 kernel: [14868.598984] handle_exit+0x98/0x230 [kvm_amd] Aug 22 09:31:34 juju-e4d256-prod-github-runner-207 kernel: [14868.599883] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 09:31:34 juju-e4d256-prod-github-runner-207 kernel: [14868.600813] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 09:31:34 juju-e4d256-prod-github-runner-207 kernel: [14868.601745] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 09:31:34 juju-e4d256-prod-github-runner-207 kernel: [14868.602730] vcpu_run+0x62/0x2c0 [kvm] Aug 22 09:31:34 juju-e4d256-prod-github-runner-207 kernel: [14868.603546] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 09:31:34 juju-e4d256-prod-github-runner-207 kernel: [14868.604353] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 09:31:34 juju-e4d256-prod-github-runner-207 kernel: [14868.605205] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 09:31:34 juju-e4d256-prod-github-runner-207 kernel: [14868.606006] ? __seccomp_filter+0x4a/0x4a0 Aug 22 09:31:34 juju-e4d256-prod-github-runner-207 kernel: [14868.606760] ? __fget_files+0x86/0xc0 Aug 22 09:31:34 juju-e4d256-prod-github-runner-207 kernel: [14868.607469] __x64_sys_ioctl+0x95/0xd0 Aug 22 09:31:34 juju-e4d256-prod-github-runner-207 kernel: [14868.608163] do_syscall_64+0x5c/0xc0 Aug 22 09:31:34 juju-e4d256-prod-github-runner-207 kernel: [14868.608834] ? do_futex+0x162/0x1f0 Aug 22 09:31:34 juju-e4d256-prod-github-runner-207 kernel: [14868.609484] ? __x64_sys_futex+0x78/0x1e0 Aug 22 09:31:34 juju-e4d256-prod-github-runner-207 kernel: [14868.610161] ? __secure_computing+0xa9/0x120 Aug 22 09:31:34 juju-e4d256-prod-github-runner-207 kernel: [14868.610871] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 09:31:34 juju-e4d256-prod-github-runner-207 kernel: [14868.611634] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:31:34 juju-e4d256-prod-github-runner-207 kernel: [14868.612357] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:31:34 juju-e4d256-prod-github-runner-207 kernel: [14868.613075] ? do_syscall_64+0x69/0xc0 Aug 22 09:31:34 juju-e4d256-prod-github-runner-207 kernel: [14868.613720] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:31:34 juju-e4d256-prod-github-runner-207 kernel: [14868.614473] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:31:34 juju-e4d256-prod-github-runner-207 kernel: [14868.615232] ? do_syscall_64+0x69/0xc0 Aug 22 09:31:34 juju-e4d256-prod-github-runner-207 kernel: [14868.615857] ? do_syscall_64+0x69/0xc0 Aug 22 09:31:34 juju-e4d256-prod-github-runner-207 kernel: [14868.616477] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 09:31:34 juju-e4d256-prod-github-runner-207 kernel: [14868.617180] RIP: 0033:0x7faa5d0edaff Aug 22 09:31:34 juju-e4d256-prod-github-runner-207 kernel: [14868.617800] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 09:31:34 juju-e4d256-prod-github-runner-207 kernel: [14868.619809] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 09:31:34 juju-e4d256-prod-github-runner-207 kernel: [14868.620717] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 09:31:34 juju-e4d256-prod-github-runner-207 kernel: [14868.621609] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 09:31:34 juju-e4d256-prod-github-runner-207 kernel: [14868.622511] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 09:31:34 juju-e4d256-prod-github-runner-207 kernel: [14868.623407] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 09:31:34 juju-e4d256-prod-github-runner-207 kernel: [14868.624302] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 09:31:34 juju-e4d256-prod-github-runner-207 kernel: [14868.625202] Aug 22 09:32:02 juju-e4d256-prod-github-runner-207 kernel: [14896.541981] watchdog: BUG: soft lockup - CPU#1 stuck for 13765s! [qemu-system-x86:6715] Aug 22 09:32:02 juju-e4d256-prod-github-runner-207 kernel: [14896.543112] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 09:32:02 juju-e4d256-prod-github-runner-207 kernel: [14896.543184] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 09:32:02 juju-e4d256-prod-github-runner-207 kernel: [14896.555610] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 09:32:02 juju-e4d256-prod-github-runner-207 kernel: [14896.556886] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 09:32:02 juju-e4d256-prod-github-runner-207 kernel: [14896.558135] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:32:02 juju-e4d256-prod-github-runner-207 kernel: [14896.559208] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 09:32:02 juju-e4d256-prod-github-runner-207 kernel: [14896.561892] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 09:32:02 juju-e4d256-prod-github-runner-207 kernel: [14896.563005] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 09:32:02 juju-e4d256-prod-github-runner-207 kernel: [14896.564327] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 09:32:02 juju-e4d256-prod-github-runner-207 kernel: [14896.565587] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 09:32:02 juju-e4d256-prod-github-runner-207 kernel: [14896.566800] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 09:32:02 juju-e4d256-prod-github-runner-207 kernel: [14896.568002] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 09:32:02 juju-e4d256-prod-github-runner-207 kernel: [14896.569301] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 09:32:02 juju-e4d256-prod-github-runner-207 kernel: [14896.570588] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 09:32:02 juju-e4d256-prod-github-runner-207 kernel: [14896.571719] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 09:32:02 juju-e4d256-prod-github-runner-207 kernel: [14896.572937] Call Trace: Aug 22 09:32:02 juju-e4d256-prod-github-runner-207 kernel: [14896.573884] Aug 22 09:32:02 juju-e4d256-prod-github-runner-207 kernel: [14896.574832] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:32:02 juju-e4d256-prod-github-runner-207 kernel: [14896.575901] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:32:02 juju-e4d256-prod-github-runner-207 kernel: [14896.576941] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:32:02 juju-e4d256-prod-github-runner-207 kernel: [14896.578116] ? show_regs.part.0+0x23/0x29 Aug 22 09:32:02 juju-e4d256-prod-github-runner-207 kernel: [14896.579160] ? show_regs.cold+0x8/0xd Aug 22 09:32:02 juju-e4d256-prod-github-runner-207 kernel: [14896.580195] ? watchdog_timer_fn+0x1be/0x220 Aug 22 09:32:02 juju-e4d256-prod-github-runner-207 kernel: [14896.581220] ? lockup_detector_update_enable+0x60/0x60 Aug 22 09:32:02 juju-e4d256-prod-github-runner-207 kernel: [14896.582316] ? __hrtimer_run_queues+0x107/0x230 Aug 22 09:32:02 juju-e4d256-prod-github-runner-207 kernel: [14896.583388] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 09:32:02 juju-e4d256-prod-github-runner-207 kernel: [14896.584438] ? hrtimer_interrupt+0x101/0x220 Aug 22 09:32:02 juju-e4d256-prod-github-runner-207 kernel: [14896.585461] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 09:32:02 juju-e4d256-prod-github-runner-207 kernel: [14896.586561] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 09:32:02 juju-e4d256-prod-github-runner-207 kernel: [14896.587676] Aug 22 09:32:02 juju-e4d256-prod-github-runner-207 kernel: [14896.588605] Aug 22 09:32:02 juju-e4d256-prod-github-runner-207 kernel: [14896.589463] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 09:32:02 juju-e4d256-prod-github-runner-207 kernel: [14896.590532] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:32:02 juju-e4d256-prod-github-runner-207 kernel: [14896.591587] ? _raw_spin_lock+0x22/0x30 Aug 22 09:32:02 juju-e4d256-prod-github-runner-207 kernel: [14896.592537] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:32:02 juju-e4d256-prod-github-runner-207 kernel: [14896.593595] direct_page_fault+0x206/0x310 [kvm] Aug 22 09:32:02 juju-e4d256-prod-github-runner-207 kernel: [14896.594683] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 09:32:02 juju-e4d256-prod-github-runner-207 kernel: [14896.595722] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 09:32:02 juju-e4d256-prod-github-runner-207 kernel: [14896.596748] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 09:32:02 juju-e4d256-prod-github-runner-207 kernel: [14896.597760] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 09:32:02 juju-e4d256-prod-github-runner-207 kernel: [14896.598753] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 09:32:02 juju-e4d256-prod-github-runner-207 kernel: [14896.599749] handle_exit+0x98/0x230 [kvm_amd] Aug 22 09:32:02 juju-e4d256-prod-github-runner-207 kernel: [14896.600650] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 09:32:02 juju-e4d256-prod-github-runner-207 kernel: [14896.601590] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 09:32:02 juju-e4d256-prod-github-runner-207 kernel: [14896.602558] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 09:32:02 juju-e4d256-prod-github-runner-207 kernel: [14896.603499] vcpu_run+0x62/0x2c0 [kvm] Aug 22 09:32:02 juju-e4d256-prod-github-runner-207 kernel: [14896.604330] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 09:32:02 juju-e4d256-prod-github-runner-207 kernel: [14896.605142] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 09:32:02 juju-e4d256-prod-github-runner-207 kernel: [14896.606068] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 09:32:02 juju-e4d256-prod-github-runner-207 kernel: [14896.606902] ? __seccomp_filter+0x4a/0x4a0 Aug 22 09:32:02 juju-e4d256-prod-github-runner-207 kernel: [14896.607669] ? __fget_files+0x86/0xc0 Aug 22 09:32:02 juju-e4d256-prod-github-runner-207 kernel: [14896.608452] __x64_sys_ioctl+0x95/0xd0 Aug 22 09:32:02 juju-e4d256-prod-github-runner-207 kernel: [14896.609186] do_syscall_64+0x5c/0xc0 Aug 22 09:32:02 juju-e4d256-prod-github-runner-207 kernel: [14896.609899] ? do_futex+0x162/0x1f0 Aug 22 09:32:02 juju-e4d256-prod-github-runner-207 kernel: [14896.610668] ? __x64_sys_futex+0x78/0x1e0 Aug 22 09:32:02 juju-e4d256-prod-github-runner-207 kernel: [14896.611383] ? __secure_computing+0xa9/0x120 Aug 22 09:32:02 juju-e4d256-prod-github-runner-207 kernel: [14896.612082] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 09:32:02 juju-e4d256-prod-github-runner-207 kernel: [14896.612859] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:32:02 juju-e4d256-prod-github-runner-207 kernel: [14896.613592] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:32:02 juju-e4d256-prod-github-runner-207 kernel: [14896.614331] ? do_syscall_64+0x69/0xc0 Aug 22 09:32:02 juju-e4d256-prod-github-runner-207 kernel: [14896.614978] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:32:02 juju-e4d256-prod-github-runner-207 kernel: [14896.615694] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:32:02 juju-e4d256-prod-github-runner-207 kernel: [14896.616395] ? do_syscall_64+0x69/0xc0 Aug 22 09:32:02 juju-e4d256-prod-github-runner-207 kernel: [14896.617109] ? do_syscall_64+0x69/0xc0 Aug 22 09:32:02 juju-e4d256-prod-github-runner-207 kernel: [14896.617759] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 09:32:02 juju-e4d256-prod-github-runner-207 kernel: [14896.618570] RIP: 0033:0x7faa5d0edaff Aug 22 09:32:02 juju-e4d256-prod-github-runner-207 kernel: [14896.619215] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 09:32:02 juju-e4d256-prod-github-runner-207 kernel: [14896.621242] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 09:32:02 juju-e4d256-prod-github-runner-207 kernel: [14896.622225] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 09:32:02 juju-e4d256-prod-github-runner-207 kernel: [14896.623144] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 09:32:02 juju-e4d256-prod-github-runner-207 kernel: [14896.624051] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 09:32:02 juju-e4d256-prod-github-runner-207 kernel: [14896.624965] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 09:32:02 juju-e4d256-prod-github-runner-207 kernel: [14896.625859] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 09:32:02 juju-e4d256-prod-github-runner-207 kernel: [14896.626841] Aug 22 09:32:30 juju-e4d256-prod-github-runner-207 kernel: [14924.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 13791s! [qemu-system-x86:6715] Aug 22 09:32:30 juju-e4d256-prod-github-runner-207 kernel: [14924.543819] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 09:32:30 juju-e4d256-prod-github-runner-207 kernel: [14924.544099] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 09:32:30 juju-e4d256-prod-github-runner-207 kernel: [14924.556260] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 09:32:30 juju-e4d256-prod-github-runner-207 kernel: [14924.557530] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 09:32:30 juju-e4d256-prod-github-runner-207 kernel: [14924.558764] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:32:30 juju-e4d256-prod-github-runner-207 kernel: [14924.559826] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 09:32:30 juju-e4d256-prod-github-runner-207 kernel: [14924.562564] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 09:32:30 juju-e4d256-prod-github-runner-207 kernel: [14924.563612] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 09:32:30 juju-e4d256-prod-github-runner-207 kernel: [14924.564773] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 09:32:30 juju-e4d256-prod-github-runner-207 kernel: [14924.565990] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 09:32:30 juju-e4d256-prod-github-runner-207 kernel: [14924.567166] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 09:32:30 juju-e4d256-prod-github-runner-207 kernel: [14924.568344] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 09:32:30 juju-e4d256-prod-github-runner-207 kernel: [14924.569514] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 09:32:30 juju-e4d256-prod-github-runner-207 kernel: [14924.570816] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 09:32:30 juju-e4d256-prod-github-runner-207 kernel: [14924.572006] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 09:32:30 juju-e4d256-prod-github-runner-207 kernel: [14924.573253] Call Trace: Aug 22 09:32:30 juju-e4d256-prod-github-runner-207 kernel: [14924.574187] Aug 22 09:32:30 juju-e4d256-prod-github-runner-207 kernel: [14924.575106] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:32:30 juju-e4d256-prod-github-runner-207 kernel: [14924.576257] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:32:30 juju-e4d256-prod-github-runner-207 kernel: [14924.577430] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:32:30 juju-e4d256-prod-github-runner-207 kernel: [14924.578621] ? show_regs.part.0+0x23/0x29 Aug 22 09:32:30 juju-e4d256-prod-github-runner-207 kernel: [14924.579626] ? show_regs.cold+0x8/0xd Aug 22 09:32:30 juju-e4d256-prod-github-runner-207 kernel: [14924.580594] ? watchdog_timer_fn+0x1be/0x220 Aug 22 09:32:30 juju-e4d256-prod-github-runner-207 kernel: [14924.581622] ? lockup_detector_update_enable+0x60/0x60 Aug 22 09:32:30 juju-e4d256-prod-github-runner-207 kernel: [14924.582685] ? __hrtimer_run_queues+0x107/0x230 Aug 22 09:32:30 juju-e4d256-prod-github-runner-207 kernel: [14924.583712] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 09:32:30 juju-e4d256-prod-github-runner-207 kernel: [14924.584742] ? hrtimer_interrupt+0x101/0x220 Aug 22 09:32:30 juju-e4d256-prod-github-runner-207 kernel: [14924.585775] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 09:32:30 juju-e4d256-prod-github-runner-207 kernel: [14924.586842] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 09:32:30 juju-e4d256-prod-github-runner-207 kernel: [14924.587885] Aug 22 09:32:30 juju-e4d256-prod-github-runner-207 kernel: [14924.588742] Aug 22 09:32:30 juju-e4d256-prod-github-runner-207 kernel: [14924.589588] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 09:32:30 juju-e4d256-prod-github-runner-207 kernel: [14924.590624] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:32:30 juju-e4d256-prod-github-runner-207 kernel: [14924.591677] ? _raw_spin_lock+0x22/0x30 Aug 22 09:32:30 juju-e4d256-prod-github-runner-207 kernel: [14924.592628] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:32:30 juju-e4d256-prod-github-runner-207 kernel: [14924.593666] direct_page_fault+0x206/0x310 [kvm] Aug 22 09:32:30 juju-e4d256-prod-github-runner-207 kernel: [14924.594694] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 09:32:30 juju-e4d256-prod-github-runner-207 kernel: [14924.595709] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 09:32:30 juju-e4d256-prod-github-runner-207 kernel: [14924.596717] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 09:32:30 juju-e4d256-prod-github-runner-207 kernel: [14924.597736] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 09:32:30 juju-e4d256-prod-github-runner-207 kernel: [14924.598685] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 09:32:30 juju-e4d256-prod-github-runner-207 kernel: [14924.599663] handle_exit+0x98/0x230 [kvm_amd] Aug 22 09:32:30 juju-e4d256-prod-github-runner-207 kernel: [14924.600560] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 09:32:30 juju-e4d256-prod-github-runner-207 kernel: [14924.601477] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 09:32:30 juju-e4d256-prod-github-runner-207 kernel: [14924.602418] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 09:32:30 juju-e4d256-prod-github-runner-207 kernel: [14924.603368] vcpu_run+0x62/0x2c0 [kvm] Aug 22 09:32:30 juju-e4d256-prod-github-runner-207 kernel: [14924.604202] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 09:32:30 juju-e4d256-prod-github-runner-207 kernel: [14924.605023] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 09:32:30 juju-e4d256-prod-github-runner-207 kernel: [14924.605898] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 09:32:30 juju-e4d256-prod-github-runner-207 kernel: [14924.606696] ? __seccomp_filter+0x4a/0x4a0 Aug 22 09:32:30 juju-e4d256-prod-github-runner-207 kernel: [14924.607440] ? __fget_files+0x86/0xc0 Aug 22 09:32:30 juju-e4d256-prod-github-runner-207 kernel: [14924.608151] __x64_sys_ioctl+0x95/0xd0 Aug 22 09:32:30 juju-e4d256-prod-github-runner-207 kernel: [14924.608846] do_syscall_64+0x5c/0xc0 Aug 22 09:32:30 juju-e4d256-prod-github-runner-207 kernel: [14924.609540] ? do_futex+0x162/0x1f0 Aug 22 09:32:30 juju-e4d256-prod-github-runner-207 kernel: [14924.610209] ? __x64_sys_futex+0x78/0x1e0 Aug 22 09:32:30 juju-e4d256-prod-github-runner-207 kernel: [14924.610890] ? __secure_computing+0xa9/0x120 Aug 22 09:32:30 juju-e4d256-prod-github-runner-207 kernel: [14924.611585] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 09:32:30 juju-e4d256-prod-github-runner-207 kernel: [14924.612351] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:32:30 juju-e4d256-prod-github-runner-207 kernel: [14924.613083] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:32:30 juju-e4d256-prod-github-runner-207 kernel: [14924.613823] ? do_syscall_64+0x69/0xc0 Aug 22 09:32:30 juju-e4d256-prod-github-runner-207 kernel: [14924.614470] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:32:30 juju-e4d256-prod-github-runner-207 kernel: [14924.615178] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:32:30 juju-e4d256-prod-github-runner-207 kernel: [14924.615878] ? do_syscall_64+0x69/0xc0 Aug 22 09:32:30 juju-e4d256-prod-github-runner-207 kernel: [14924.616507] ? do_syscall_64+0x69/0xc0 Aug 22 09:32:30 juju-e4d256-prod-github-runner-207 kernel: [14924.617132] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 09:32:30 juju-e4d256-prod-github-runner-207 kernel: [14924.617850] RIP: 0033:0x7faa5d0edaff Aug 22 09:32:30 juju-e4d256-prod-github-runner-207 kernel: [14924.618513] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 09:32:30 juju-e4d256-prod-github-runner-207 kernel: [14924.620502] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 09:32:30 juju-e4d256-prod-github-runner-207 kernel: [14924.621412] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 09:32:30 juju-e4d256-prod-github-runner-207 kernel: [14924.622312] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 09:32:30 juju-e4d256-prod-github-runner-207 kernel: [14924.623226] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 09:32:30 juju-e4d256-prod-github-runner-207 kernel: [14924.624117] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 09:32:30 juju-e4d256-prod-github-runner-207 kernel: [14924.625005] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 09:32:30 juju-e4d256-prod-github-runner-207 kernel: [14924.625915] Aug 22 09:32:44 juju-e4d256-prod-github-runner-207 kernel: [14938.184706] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 09:32:44 juju-e4d256-prod-github-runner-207 kernel: [14938.185703] rcu: 1-....: (3693658 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=1783949 Aug 22 09:32:44 juju-e4d256-prod-github-runner-207 kernel: [14938.186835] (t=3705246 jiffies g=23269 q=22318) Aug 22 09:32:44 juju-e4d256-prod-github-runner-207 kernel: [14938.187614] NMI backtrace for cpu 1 Aug 22 09:32:44 juju-e4d256-prod-github-runner-207 kernel: [14938.188326] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 09:32:44 juju-e4d256-prod-github-runner-207 kernel: [14938.189441] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 09:32:44 juju-e4d256-prod-github-runner-207 kernel: [14938.190500] Call Trace: Aug 22 09:32:44 juju-e4d256-prod-github-runner-207 kernel: [14938.191173] Aug 22 09:32:44 juju-e4d256-prod-github-runner-207 kernel: [14938.191817] show_stack+0x52/0x5c Aug 22 09:32:44 juju-e4d256-prod-github-runner-207 kernel: [14938.192547] dump_stack_lvl+0x4a/0x63 Aug 22 09:32:44 juju-e4d256-prod-github-runner-207 kernel: [14938.193294] dump_stack+0x10/0x16 Aug 22 09:32:44 juju-e4d256-prod-github-runner-207 kernel: [14938.194035] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 09:32:44 juju-e4d256-prod-github-runner-207 kernel: [14938.194814] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 09:32:44 juju-e4d256-prod-github-runner-207 kernel: [14938.195589] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 09:32:44 juju-e4d256-prod-github-runner-207 kernel: [14938.196405] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 09:32:44 juju-e4d256-prod-github-runner-207 kernel: [14938.197225] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 09:32:44 juju-e4d256-prod-github-runner-207 kernel: [14938.198052] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 09:32:44 juju-e4d256-prod-github-runner-207 kernel: [14938.198902] print_cpu_stall.cold+0x2f/0xe2 Aug 22 09:32:44 juju-e4d256-prod-github-runner-207 kernel: [14938.199744] ? timekeeping_update+0xf7/0x150 Aug 22 09:32:44 juju-e4d256-prod-github-runner-207 kernel: [14938.200517] check_cpu_stall+0x109/0x270 Aug 22 09:32:44 juju-e4d256-prod-github-runner-207 kernel: [14938.201263] rcu_sched_clock_irq+0x9a/0x250 Aug 22 09:32:44 juju-e4d256-prod-github-runner-207 kernel: [14938.202043] update_process_times+0x94/0xd0 Aug 22 09:32:44 juju-e4d256-prod-github-runner-207 kernel: [14938.202812] tick_sched_handle+0x29/0x70 Aug 22 09:32:44 juju-e4d256-prod-github-runner-207 kernel: [14938.203599] tick_sched_timer+0x8c/0xc0 Aug 22 09:32:44 juju-e4d256-prod-github-runner-207 kernel: [14938.204349] ? tick_nohz_handler+0xb0/0xb0 Aug 22 09:32:44 juju-e4d256-prod-github-runner-207 kernel: [14938.205125] __hrtimer_run_queues+0x107/0x230 Aug 22 09:32:44 juju-e4d256-prod-github-runner-207 kernel: [14938.205921] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 09:32:44 juju-e4d256-prod-github-runner-207 kernel: [14938.206716] hrtimer_interrupt+0x101/0x220 Aug 22 09:32:44 juju-e4d256-prod-github-runner-207 kernel: [14938.207533] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 09:32:44 juju-e4d256-prod-github-runner-207 kernel: [14938.208353] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 09:32:44 juju-e4d256-prod-github-runner-207 kernel: [14938.209386] Aug 22 09:32:44 juju-e4d256-prod-github-runner-207 kernel: [14938.210216] Aug 22 09:32:44 juju-e4d256-prod-github-runner-207 kernel: [14938.210845] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 09:32:44 juju-e4d256-prod-github-runner-207 kernel: [14938.211748] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:32:44 juju-e4d256-prod-github-runner-207 kernel: [14938.212747] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 09:32:44 juju-e4d256-prod-github-runner-207 kernel: [14938.215337] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 09:32:44 juju-e4d256-prod-github-runner-207 kernel: [14938.216325] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 09:32:44 juju-e4d256-prod-github-runner-207 kernel: [14938.217463] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 09:32:44 juju-e4d256-prod-github-runner-207 kernel: [14938.218576] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 09:32:44 juju-e4d256-prod-github-runner-207 kernel: [14938.219681] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 09:32:44 juju-e4d256-prod-github-runner-207 kernel: [14938.220968] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 09:32:44 juju-e4d256-prod-github-runner-207 kernel: [14938.222106] ? _raw_spin_lock+0x22/0x30 Aug 22 09:32:44 juju-e4d256-prod-github-runner-207 kernel: [14938.222969] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:32:44 juju-e4d256-prod-github-runner-207 kernel: [14938.223901] direct_page_fault+0x206/0x310 [kvm] Aug 22 09:32:44 juju-e4d256-prod-github-runner-207 kernel: [14938.224902] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 09:32:44 juju-e4d256-prod-github-runner-207 kernel: [14938.225874] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 09:32:44 juju-e4d256-prod-github-runner-207 kernel: [14938.226787] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 09:32:44 juju-e4d256-prod-github-runner-207 kernel: [14938.227599] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 09:32:44 juju-e4d256-prod-github-runner-207 kernel: [14938.228568] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 09:32:44 juju-e4d256-prod-github-runner-207 kernel: [14938.229519] handle_exit+0x98/0x230 [kvm_amd] Aug 22 09:32:44 juju-e4d256-prod-github-runner-207 kernel: [14938.230357] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 09:32:44 juju-e4d256-prod-github-runner-207 kernel: [14938.231263] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 09:32:44 juju-e4d256-prod-github-runner-207 kernel: [14938.232083] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 09:32:44 juju-e4d256-prod-github-runner-207 kernel: [14938.233042] vcpu_run+0x62/0x2c0 [kvm] Aug 22 09:32:44 juju-e4d256-prod-github-runner-207 kernel: [14938.233826] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 09:32:44 juju-e4d256-prod-github-runner-207 kernel: [14938.234573] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 09:32:44 juju-e4d256-prod-github-runner-207 kernel: [14938.235493] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 09:32:44 juju-e4d256-prod-github-runner-207 kernel: [14938.236350] ? __seccomp_filter+0x4a/0x4a0 Aug 22 09:32:44 juju-e4d256-prod-github-runner-207 kernel: [14938.237094] ? __fget_files+0x86/0xc0 Aug 22 09:32:44 juju-e4d256-prod-github-runner-207 kernel: [14938.237894] __x64_sys_ioctl+0x95/0xd0 Aug 22 09:32:44 juju-e4d256-prod-github-runner-207 kernel: [14938.238665] do_syscall_64+0x5c/0xc0 Aug 22 09:32:44 juju-e4d256-prod-github-runner-207 kernel: [14938.239486] ? do_futex+0x162/0x1f0 Aug 22 09:32:44 juju-e4d256-prod-github-runner-207 kernel: [14938.240231] ? __x64_sys_futex+0x78/0x1e0 Aug 22 09:32:44 juju-e4d256-prod-github-runner-207 kernel: [14938.241108] ? __secure_computing+0xa9/0x120 Aug 22 09:32:44 juju-e4d256-prod-github-runner-207 kernel: [14938.241921] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 09:32:44 juju-e4d256-prod-github-runner-207 kernel: [14938.242810] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:32:44 juju-e4d256-prod-github-runner-207 kernel: [14938.243675] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:32:44 juju-e4d256-prod-github-runner-207 kernel: [14938.244531] ? do_syscall_64+0x69/0xc0 Aug 22 09:32:44 juju-e4d256-prod-github-runner-207 kernel: [14938.245305] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:32:44 juju-e4d256-prod-github-runner-207 kernel: [14938.246207] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:32:44 juju-e4d256-prod-github-runner-207 kernel: [14938.247084] ? do_syscall_64+0x69/0xc0 Aug 22 09:32:44 juju-e4d256-prod-github-runner-207 kernel: [14938.247859] ? do_syscall_64+0x69/0xc0 Aug 22 09:32:44 juju-e4d256-prod-github-runner-207 kernel: [14938.248621] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 09:32:44 juju-e4d256-prod-github-runner-207 kernel: [14938.249517] RIP: 0033:0x7faa5d0edaff Aug 22 09:32:44 juju-e4d256-prod-github-runner-207 kernel: [14938.250288] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 09:32:44 juju-e4d256-prod-github-runner-207 kernel: [14938.252739] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 09:32:44 juju-e4d256-prod-github-runner-207 kernel: [14938.253856] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 09:32:44 juju-e4d256-prod-github-runner-207 kernel: [14938.254946] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 09:32:44 juju-e4d256-prod-github-runner-207 kernel: [14938.256062] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 09:32:44 juju-e4d256-prod-github-runner-207 kernel: [14938.257148] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 09:32:44 juju-e4d256-prod-github-runner-207 kernel: [14938.258219] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 09:32:44 juju-e4d256-prod-github-runner-207 kernel: [14938.259274] Aug 22 09:33:10 juju-e4d256-prod-github-runner-207 kernel: [14964.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 13828s! [qemu-system-x86:6715] Aug 22 09:33:10 juju-e4d256-prod-github-runner-207 kernel: [14964.543126] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 09:33:10 juju-e4d256-prod-github-runner-207 kernel: [14964.543199] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 09:33:10 juju-e4d256-prod-github-runner-207 kernel: [14964.558671] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 09:33:10 juju-e4d256-prod-github-runner-207 kernel: [14964.559957] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 09:33:10 juju-e4d256-prod-github-runner-207 kernel: [14964.561197] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:33:10 juju-e4d256-prod-github-runner-207 kernel: [14964.562266] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 09:33:10 juju-e4d256-prod-github-runner-207 kernel: [14964.564849] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 09:33:10 juju-e4d256-prod-github-runner-207 kernel: [14964.565928] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 09:33:10 juju-e4d256-prod-github-runner-207 kernel: [14964.567109] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 09:33:10 juju-e4d256-prod-github-runner-207 kernel: [14964.568287] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 09:33:10 juju-e4d256-prod-github-runner-207 kernel: [14964.569468] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 09:33:10 juju-e4d256-prod-github-runner-207 kernel: [14964.570648] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 09:33:10 juju-e4d256-prod-github-runner-207 kernel: [14964.571837] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 09:33:10 juju-e4d256-prod-github-runner-207 kernel: [14964.573111] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 09:33:10 juju-e4d256-prod-github-runner-207 kernel: [14964.574232] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 09:33:10 juju-e4d256-prod-github-runner-207 kernel: [14964.575476] Call Trace: Aug 22 09:33:10 juju-e4d256-prod-github-runner-207 kernel: [14964.576394] Aug 22 09:33:10 juju-e4d256-prod-github-runner-207 kernel: [14964.577299] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:33:10 juju-e4d256-prod-github-runner-207 kernel: [14964.578338] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:33:10 juju-e4d256-prod-github-runner-207 kernel: [14964.579369] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:33:10 juju-e4d256-prod-github-runner-207 kernel: [14964.580475] ? show_regs.part.0+0x23/0x29 Aug 22 09:33:10 juju-e4d256-prod-github-runner-207 kernel: [14964.581498] ? show_regs.cold+0x8/0xd Aug 22 09:33:10 juju-e4d256-prod-github-runner-207 kernel: [14964.582478] ? watchdog_timer_fn+0x1be/0x220 Aug 22 09:33:10 juju-e4d256-prod-github-runner-207 kernel: [14964.583495] ? lockup_detector_update_enable+0x60/0x60 Aug 22 09:33:10 juju-e4d256-prod-github-runner-207 kernel: [14964.584569] ? __hrtimer_run_queues+0x107/0x230 Aug 22 09:33:10 juju-e4d256-prod-github-runner-207 kernel: [14964.585618] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 09:33:10 juju-e4d256-prod-github-runner-207 kernel: [14964.586683] ? hrtimer_interrupt+0x101/0x220 Aug 22 09:33:10 juju-e4d256-prod-github-runner-207 kernel: [14964.587711] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 09:33:10 juju-e4d256-prod-github-runner-207 kernel: [14964.588803] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 09:33:10 juju-e4d256-prod-github-runner-207 kernel: [14964.589880] Aug 22 09:33:10 juju-e4d256-prod-github-runner-207 kernel: [14964.590748] Aug 22 09:33:10 juju-e4d256-prod-github-runner-207 kernel: [14964.591590] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 09:33:10 juju-e4d256-prod-github-runner-207 kernel: [14964.592635] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:33:10 juju-e4d256-prod-github-runner-207 kernel: [14964.593700] ? _raw_spin_lock+0x22/0x30 Aug 22 09:33:10 juju-e4d256-prod-github-runner-207 kernel: [14964.594655] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:33:10 juju-e4d256-prod-github-runner-207 kernel: [14964.595702] direct_page_fault+0x206/0x310 [kvm] Aug 22 09:33:10 juju-e4d256-prod-github-runner-207 kernel: [14964.596745] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 09:33:10 juju-e4d256-prod-github-runner-207 kernel: [14964.597784] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 09:33:10 juju-e4d256-prod-github-runner-207 kernel: [14964.598809] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 09:33:10 juju-e4d256-prod-github-runner-207 kernel: [14964.599792] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 09:33:10 juju-e4d256-prod-github-runner-207 kernel: [14964.600755] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 09:33:10 juju-e4d256-prod-github-runner-207 kernel: [14964.601760] handle_exit+0x98/0x230 [kvm_amd] Aug 22 09:33:10 juju-e4d256-prod-github-runner-207 kernel: [14964.602688] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 09:33:10 juju-e4d256-prod-github-runner-207 kernel: [14964.603627] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 09:33:10 juju-e4d256-prod-github-runner-207 kernel: [14964.604566] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 09:33:10 juju-e4d256-prod-github-runner-207 kernel: [14964.605500] vcpu_run+0x62/0x2c0 [kvm] Aug 22 09:33:10 juju-e4d256-prod-github-runner-207 kernel: [14964.606328] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 09:33:10 juju-e4d256-prod-github-runner-207 kernel: [14964.607145] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 09:33:10 juju-e4d256-prod-github-runner-207 kernel: [14964.608013] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 09:33:10 juju-e4d256-prod-github-runner-207 kernel: [14964.608821] ? __seccomp_filter+0x4a/0x4a0 Aug 22 09:33:10 juju-e4d256-prod-github-runner-207 kernel: [14964.609745] ? __fget_files+0x86/0xc0 Aug 22 09:33:10 juju-e4d256-prod-github-runner-207 kernel: [14964.610464] __x64_sys_ioctl+0x95/0xd0 Aug 22 09:33:10 juju-e4d256-prod-github-runner-207 kernel: [14964.611208] do_syscall_64+0x5c/0xc0 Aug 22 09:33:10 juju-e4d256-prod-github-runner-207 kernel: [14964.611888] ? do_futex+0x162/0x1f0 Aug 22 09:33:10 juju-e4d256-prod-github-runner-207 kernel: [14964.612570] ? __x64_sys_futex+0x78/0x1e0 Aug 22 09:33:10 juju-e4d256-prod-github-runner-207 kernel: [14964.613273] ? __secure_computing+0xa9/0x120 Aug 22 09:33:10 juju-e4d256-prod-github-runner-207 kernel: [14964.613966] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 09:33:10 juju-e4d256-prod-github-runner-207 kernel: [14964.614725] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:33:10 juju-e4d256-prod-github-runner-207 kernel: [14964.615446] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:33:10 juju-e4d256-prod-github-runner-207 kernel: [14964.616164] ? do_syscall_64+0x69/0xc0 Aug 22 09:33:10 juju-e4d256-prod-github-runner-207 kernel: [14964.616813] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:33:10 juju-e4d256-prod-github-runner-207 kernel: [14964.617524] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:33:10 juju-e4d256-prod-github-runner-207 kernel: [14964.618224] ? do_syscall_64+0x69/0xc0 Aug 22 09:33:10 juju-e4d256-prod-github-runner-207 kernel: [14964.618848] ? do_syscall_64+0x69/0xc0 Aug 22 09:33:10 juju-e4d256-prod-github-runner-207 kernel: [14964.619469] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 09:33:10 juju-e4d256-prod-github-runner-207 kernel: [14964.620173] RIP: 0033:0x7faa5d0edaff Aug 22 09:33:10 juju-e4d256-prod-github-runner-207 kernel: [14964.620797] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 09:33:10 juju-e4d256-prod-github-runner-207 kernel: [14964.622809] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 09:33:10 juju-e4d256-prod-github-runner-207 kernel: [14964.623719] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 09:33:10 juju-e4d256-prod-github-runner-207 kernel: [14964.624607] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 09:33:10 juju-e4d256-prod-github-runner-207 kernel: [14964.625555] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 09:33:10 juju-e4d256-prod-github-runner-207 kernel: [14964.626455] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 09:33:10 juju-e4d256-prod-github-runner-207 kernel: [14964.627345] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 09:33:10 juju-e4d256-prod-github-runner-207 kernel: [14964.628233] Aug 22 09:33:38 juju-e4d256-prod-github-runner-207 kernel: [14992.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 13854s! [qemu-system-x86:6715] Aug 22 09:33:38 juju-e4d256-prod-github-runner-207 kernel: [14992.543091] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 09:33:38 juju-e4d256-prod-github-runner-207 kernel: [14992.543166] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 09:33:38 juju-e4d256-prod-github-runner-207 kernel: [14992.555277] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 09:33:38 juju-e4d256-prod-github-runner-207 kernel: [14992.556551] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 09:33:38 juju-e4d256-prod-github-runner-207 kernel: [14992.557782] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:33:38 juju-e4d256-prod-github-runner-207 kernel: [14992.558835] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 09:33:38 juju-e4d256-prod-github-runner-207 kernel: [14992.561387] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 09:33:38 juju-e4d256-prod-github-runner-207 kernel: [14992.562428] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 09:33:38 juju-e4d256-prod-github-runner-207 kernel: [14992.563634] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 09:33:38 juju-e4d256-prod-github-runner-207 kernel: [14992.564827] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 09:33:38 juju-e4d256-prod-github-runner-207 kernel: [14992.565990] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 09:33:38 juju-e4d256-prod-github-runner-207 kernel: [14992.567309] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 09:33:38 juju-e4d256-prod-github-runner-207 kernel: [14992.568535] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 09:33:38 juju-e4d256-prod-github-runner-207 kernel: [14992.569787] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 09:33:38 juju-e4d256-prod-github-runner-207 kernel: [14992.570933] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 09:33:38 juju-e4d256-prod-github-runner-207 kernel: [14992.572132] Call Trace: Aug 22 09:33:38 juju-e4d256-prod-github-runner-207 kernel: [14992.573053] Aug 22 09:33:38 juju-e4d256-prod-github-runner-207 kernel: [14992.573936] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:33:38 juju-e4d256-prod-github-runner-207 kernel: [14992.574963] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:33:38 juju-e4d256-prod-github-runner-207 kernel: [14992.575982] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:33:38 juju-e4d256-prod-github-runner-207 kernel: [14992.577071] ? show_regs.part.0+0x23/0x29 Aug 22 09:33:38 juju-e4d256-prod-github-runner-207 kernel: [14992.578066] ? show_regs.cold+0x8/0xd Aug 22 09:33:38 juju-e4d256-prod-github-runner-207 kernel: [14992.579047] ? watchdog_timer_fn+0x1be/0x220 Aug 22 09:33:38 juju-e4d256-prod-github-runner-207 kernel: [14992.580054] ? lockup_detector_update_enable+0x60/0x60 Aug 22 09:33:38 juju-e4d256-prod-github-runner-207 kernel: [14992.581124] ? __hrtimer_run_queues+0x107/0x230 Aug 22 09:33:38 juju-e4d256-prod-github-runner-207 kernel: [14992.582153] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 09:33:38 juju-e4d256-prod-github-runner-207 kernel: [14992.583175] ? hrtimer_interrupt+0x101/0x220 Aug 22 09:33:38 juju-e4d256-prod-github-runner-207 kernel: [14992.584206] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 09:33:38 juju-e4d256-prod-github-runner-207 kernel: [14992.585300] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 09:33:38 juju-e4d256-prod-github-runner-207 kernel: [14992.586346] Aug 22 09:33:38 juju-e4d256-prod-github-runner-207 kernel: [14992.587196] Aug 22 09:33:38 juju-e4d256-prod-github-runner-207 kernel: [14992.588032] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 09:33:38 juju-e4d256-prod-github-runner-207 kernel: [14992.589073] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:33:38 juju-e4d256-prod-github-runner-207 kernel: [14992.590113] ? _raw_spin_lock+0x22/0x30 Aug 22 09:33:38 juju-e4d256-prod-github-runner-207 kernel: [14992.591055] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:33:38 juju-e4d256-prod-github-runner-207 kernel: [14992.592069] direct_page_fault+0x206/0x310 [kvm] Aug 22 09:33:38 juju-e4d256-prod-github-runner-207 kernel: [14992.593106] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 09:33:38 juju-e4d256-prod-github-runner-207 kernel: [14992.594116] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 09:33:38 juju-e4d256-prod-github-runner-207 kernel: [14992.595113] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 09:33:38 juju-e4d256-prod-github-runner-207 kernel: [14992.596081] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 09:33:38 juju-e4d256-prod-github-runner-207 kernel: [14992.597038] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 09:33:38 juju-e4d256-prod-github-runner-207 kernel: [14992.598015] handle_exit+0x98/0x230 [kvm_amd] Aug 22 09:33:38 juju-e4d256-prod-github-runner-207 kernel: [14992.598905] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 09:33:38 juju-e4d256-prod-github-runner-207 kernel: [14992.599816] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 09:33:38 juju-e4d256-prod-github-runner-207 kernel: [14992.600749] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 09:33:38 juju-e4d256-prod-github-runner-207 kernel: [14992.601659] vcpu_run+0x62/0x2c0 [kvm] Aug 22 09:33:38 juju-e4d256-prod-github-runner-207 kernel: [14992.602470] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 09:33:38 juju-e4d256-prod-github-runner-207 kernel: [14992.603276] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 09:33:38 juju-e4d256-prod-github-runner-207 kernel: [14992.604128] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 09:33:38 juju-e4d256-prod-github-runner-207 kernel: [14992.604943] ? __seccomp_filter+0x4a/0x4a0 Aug 22 09:33:38 juju-e4d256-prod-github-runner-207 kernel: [14992.605685] ? __fget_files+0x86/0xc0 Aug 22 09:33:38 juju-e4d256-prod-github-runner-207 kernel: [14992.606393] __x64_sys_ioctl+0x95/0xd0 Aug 22 09:33:38 juju-e4d256-prod-github-runner-207 kernel: [14992.607085] do_syscall_64+0x5c/0xc0 Aug 22 09:33:38 juju-e4d256-prod-github-runner-207 kernel: [14992.607751] ? do_futex+0x162/0x1f0 Aug 22 09:33:38 juju-e4d256-prod-github-runner-207 kernel: [14992.608414] ? __x64_sys_futex+0x78/0x1e0 Aug 22 09:33:38 juju-e4d256-prod-github-runner-207 kernel: [14992.609100] ? __secure_computing+0xa9/0x120 Aug 22 09:33:38 juju-e4d256-prod-github-runner-207 kernel: [14992.609790] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 09:33:38 juju-e4d256-prod-github-runner-207 kernel: [14992.610547] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:33:38 juju-e4d256-prod-github-runner-207 kernel: [14992.611267] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:33:38 juju-e4d256-prod-github-runner-207 kernel: [14992.611982] ? do_syscall_64+0x69/0xc0 Aug 22 09:33:38 juju-e4d256-prod-github-runner-207 kernel: [14992.612624] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:33:38 juju-e4d256-prod-github-runner-207 kernel: [14992.613340] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:33:38 juju-e4d256-prod-github-runner-207 kernel: [14992.614031] ? do_syscall_64+0x69/0xc0 Aug 22 09:33:38 juju-e4d256-prod-github-runner-207 kernel: [14992.614651] ? do_syscall_64+0x69/0xc0 Aug 22 09:33:38 juju-e4d256-prod-github-runner-207 kernel: [14992.615270] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 09:33:38 juju-e4d256-prod-github-runner-207 kernel: [14992.615972] RIP: 0033:0x7faa5d0edaff Aug 22 09:33:38 juju-e4d256-prod-github-runner-207 kernel: [14992.616593] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 09:33:38 juju-e4d256-prod-github-runner-207 kernel: [14992.618594] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 09:33:38 juju-e4d256-prod-github-runner-207 kernel: [14992.619498] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 09:33:38 juju-e4d256-prod-github-runner-207 kernel: [14992.620387] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 09:33:38 juju-e4d256-prod-github-runner-207 kernel: [14992.621283] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 09:33:38 juju-e4d256-prod-github-runner-207 kernel: [14992.622167] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 09:33:38 juju-e4d256-prod-github-runner-207 kernel: [14992.623051] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 09:33:38 juju-e4d256-prod-github-runner-207 kernel: [14992.623944] Aug 22 09:34:06 juju-e4d256-prod-github-runner-207 kernel: [15020.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 13880s! [qemu-system-x86:6715] Aug 22 09:34:06 juju-e4d256-prod-github-runner-207 kernel: [15020.543851] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 09:34:06 juju-e4d256-prod-github-runner-207 kernel: [15020.544147] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 09:34:06 juju-e4d256-prod-github-runner-207 kernel: [15020.557101] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 09:34:06 juju-e4d256-prod-github-runner-207 kernel: [15020.558483] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 09:34:06 juju-e4d256-prod-github-runner-207 kernel: [15020.559835] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:34:06 juju-e4d256-prod-github-runner-207 kernel: [15020.560941] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 09:34:06 juju-e4d256-prod-github-runner-207 kernel: [15020.563595] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 09:34:06 juju-e4d256-prod-github-runner-207 kernel: [15020.564715] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 09:34:06 juju-e4d256-prod-github-runner-207 kernel: [15020.565958] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 09:34:06 juju-e4d256-prod-github-runner-207 kernel: [15020.567188] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 09:34:06 juju-e4d256-prod-github-runner-207 kernel: [15020.568443] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 09:34:06 juju-e4d256-prod-github-runner-207 kernel: [15020.569655] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 09:34:06 juju-e4d256-prod-github-runner-207 kernel: [15020.570849] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 09:34:06 juju-e4d256-prod-github-runner-207 kernel: [15020.572111] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 09:34:06 juju-e4d256-prod-github-runner-207 kernel: [15020.573262] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 09:34:06 juju-e4d256-prod-github-runner-207 kernel: [15020.574480] Call Trace: Aug 22 09:34:06 juju-e4d256-prod-github-runner-207 kernel: [15020.575425] Aug 22 09:34:06 juju-e4d256-prod-github-runner-207 kernel: [15020.576341] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:34:06 juju-e4d256-prod-github-runner-207 kernel: [15020.577438] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:34:06 juju-e4d256-prod-github-runner-207 kernel: [15020.578474] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:34:06 juju-e4d256-prod-github-runner-207 kernel: [15020.579589] ? show_regs.part.0+0x23/0x29 Aug 22 09:34:06 juju-e4d256-prod-github-runner-207 kernel: [15020.580613] ? show_regs.cold+0x8/0xd Aug 22 09:34:06 juju-e4d256-prod-github-runner-207 kernel: [15020.581603] ? watchdog_timer_fn+0x1be/0x220 Aug 22 09:34:06 juju-e4d256-prod-github-runner-207 kernel: [15020.582627] ? lockup_detector_update_enable+0x60/0x60 Aug 22 09:34:06 juju-e4d256-prod-github-runner-207 kernel: [15020.583706] ? __hrtimer_run_queues+0x107/0x230 Aug 22 09:34:06 juju-e4d256-prod-github-runner-207 kernel: [15020.584806] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 09:34:06 juju-e4d256-prod-github-runner-207 kernel: [15020.585856] ? hrtimer_interrupt+0x101/0x220 Aug 22 09:34:06 juju-e4d256-prod-github-runner-207 kernel: [15020.586915] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 09:34:06 juju-e4d256-prod-github-runner-207 kernel: [15020.588029] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 09:34:06 juju-e4d256-prod-github-runner-207 kernel: [15020.589112] Aug 22 09:34:06 juju-e4d256-prod-github-runner-207 kernel: [15020.589974] Aug 22 09:34:06 juju-e4d256-prod-github-runner-207 kernel: [15020.590815] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 09:34:06 juju-e4d256-prod-github-runner-207 kernel: [15020.591858] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:34:06 juju-e4d256-prod-github-runner-207 kernel: [15020.592920] ? _raw_spin_lock+0x22/0x30 Aug 22 09:34:06 juju-e4d256-prod-github-runner-207 kernel: [15020.593877] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:34:06 juju-e4d256-prod-github-runner-207 kernel: [15020.594914] direct_page_fault+0x206/0x310 [kvm] Aug 22 09:34:06 juju-e4d256-prod-github-runner-207 kernel: [15020.595951] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 09:34:06 juju-e4d256-prod-github-runner-207 kernel: [15020.597009] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 09:34:06 juju-e4d256-prod-github-runner-207 kernel: [15020.598040] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 09:34:06 juju-e4d256-prod-github-runner-207 kernel: [15020.599099] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 09:34:06 juju-e4d256-prod-github-runner-207 kernel: [15020.600101] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 09:34:06 juju-e4d256-prod-github-runner-207 kernel: [15020.601122] handle_exit+0x98/0x230 [kvm_amd] Aug 22 09:34:06 juju-e4d256-prod-github-runner-207 kernel: [15020.602029] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 09:34:06 juju-e4d256-prod-github-runner-207 kernel: [15020.602957] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 09:34:06 juju-e4d256-prod-github-runner-207 kernel: [15020.603925] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 09:34:06 juju-e4d256-prod-github-runner-207 kernel: [15020.604871] vcpu_run+0x62/0x2c0 [kvm] Aug 22 09:34:06 juju-e4d256-prod-github-runner-207 kernel: [15020.605698] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 09:34:06 juju-e4d256-prod-github-runner-207 kernel: [15020.606665] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 09:34:06 juju-e4d256-prod-github-runner-207 kernel: [15020.607535] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 09:34:06 juju-e4d256-prod-github-runner-207 kernel: [15020.608368] ? __seccomp_filter+0x4a/0x4a0 Aug 22 09:34:06 juju-e4d256-prod-github-runner-207 kernel: [15020.609134] ? __fget_files+0x86/0xc0 Aug 22 09:34:06 juju-e4d256-prod-github-runner-207 kernel: [15020.609854] __x64_sys_ioctl+0x95/0xd0 Aug 22 09:34:06 juju-e4d256-prod-github-runner-207 kernel: [15020.610562] do_syscall_64+0x5c/0xc0 Aug 22 09:34:06 juju-e4d256-prod-github-runner-207 kernel: [15020.611237] ? do_futex+0x162/0x1f0 Aug 22 09:34:06 juju-e4d256-prod-github-runner-207 kernel: [15020.611896] ? __x64_sys_futex+0x78/0x1e0 Aug 22 09:34:06 juju-e4d256-prod-github-runner-207 kernel: [15020.612617] ? __secure_computing+0xa9/0x120 Aug 22 09:34:06 juju-e4d256-prod-github-runner-207 kernel: [15020.613322] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 09:34:06 juju-e4d256-prod-github-runner-207 kernel: [15020.614106] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:34:06 juju-e4d256-prod-github-runner-207 kernel: [15020.614975] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:34:06 juju-e4d256-prod-github-runner-207 kernel: [15020.615702] ? do_syscall_64+0x69/0xc0 Aug 22 09:34:06 juju-e4d256-prod-github-runner-207 kernel: [15020.616355] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:34:06 juju-e4d256-prod-github-runner-207 kernel: [15020.617084] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:34:06 juju-e4d256-prod-github-runner-207 kernel: [15020.617791] ? do_syscall_64+0x69/0xc0 Aug 22 09:34:06 juju-e4d256-prod-github-runner-207 kernel: [15020.618425] ? do_syscall_64+0x69/0xc0 Aug 22 09:34:06 juju-e4d256-prod-github-runner-207 kernel: [15020.619059] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 09:34:06 juju-e4d256-prod-github-runner-207 kernel: [15020.619776] RIP: 0033:0x7faa5d0edaff Aug 22 09:34:06 juju-e4d256-prod-github-runner-207 kernel: [15020.620454] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 09:34:06 juju-e4d256-prod-github-runner-207 kernel: [15020.622480] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 09:34:06 juju-e4d256-prod-github-runner-207 kernel: [15020.623405] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 09:34:06 juju-e4d256-prod-github-runner-207 kernel: [15020.624338] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 09:34:06 juju-e4d256-prod-github-runner-207 kernel: [15020.625294] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 09:34:06 juju-e4d256-prod-github-runner-207 kernel: [15020.626201] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 09:34:06 juju-e4d256-prod-github-runner-207 kernel: [15020.627115] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 09:34:06 juju-e4d256-prod-github-runner-207 kernel: [15020.628168] Aug 22 09:34:34 juju-e4d256-prod-github-runner-207 kernel: [15048.541980] watchdog: BUG: soft lockup - CPU#1 stuck for 13907s! [qemu-system-x86:6715] Aug 22 09:34:34 juju-e4d256-prod-github-runner-207 kernel: [15048.544346] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 09:34:34 juju-e4d256-prod-github-runner-207 kernel: [15048.544421] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 09:34:34 juju-e4d256-prod-github-runner-207 kernel: [15048.570648] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 09:34:34 juju-e4d256-prod-github-runner-207 kernel: [15048.574291] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 09:34:34 juju-e4d256-prod-github-runner-207 kernel: [15048.577862] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:34:34 juju-e4d256-prod-github-runner-207 kernel: [15048.578950] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 09:34:34 juju-e4d256-prod-github-runner-207 kernel: [15048.583910] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 09:34:34 juju-e4d256-prod-github-runner-207 kernel: [15048.585005] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 09:34:34 juju-e4d256-prod-github-runner-207 kernel: [15048.588730] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 09:34:34 juju-e4d256-prod-github-runner-207 kernel: [15048.592386] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 09:34:34 juju-e4d256-prod-github-runner-207 kernel: [15048.595980] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 09:34:34 juju-e4d256-prod-github-runner-207 kernel: [15048.597269] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 09:34:34 juju-e4d256-prod-github-runner-207 kernel: [15048.600884] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 09:34:34 juju-e4d256-prod-github-runner-207 kernel: [15048.602161] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 09:34:34 juju-e4d256-prod-github-runner-207 kernel: [15048.605786] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 09:34:34 juju-e4d256-prod-github-runner-207 kernel: [15048.607247] Call Trace: Aug 22 09:34:34 juju-e4d256-prod-github-runner-207 kernel: [15048.610497] Aug 22 09:34:34 juju-e4d256-prod-github-runner-207 kernel: [15048.611396] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:34:34 juju-e4d256-prod-github-runner-207 kernel: [15048.614727] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:34:34 juju-e4d256-prod-github-runner-207 kernel: [15048.618091] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:34:34 juju-e4d256-prod-github-runner-207 kernel: [15048.619187] ? show_regs.part.0+0x23/0x29 Aug 22 09:34:34 juju-e4d256-prod-github-runner-207 kernel: [15048.622414] ? show_regs.cold+0x8/0xd Aug 22 09:34:34 juju-e4d256-prod-github-runner-207 kernel: [15048.623441] ? watchdog_timer_fn+0x1be/0x220 Aug 22 09:34:34 juju-e4d256-prod-github-runner-207 kernel: [15048.626800] ? lockup_detector_update_enable+0x60/0x60 Aug 22 09:34:34 juju-e4d256-prod-github-runner-207 kernel: [15048.627920] ? __hrtimer_run_queues+0x107/0x230 Aug 22 09:34:34 juju-e4d256-prod-github-runner-207 kernel: [15048.629078] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 09:34:34 juju-e4d256-prod-github-runner-207 kernel: [15048.632508] ? hrtimer_interrupt+0x101/0x220 Aug 22 09:34:34 juju-e4d256-prod-github-runner-207 kernel: [15048.633543] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 09:34:34 juju-e4d256-prod-github-runner-207 kernel: [15048.635161] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 09:34:34 juju-e4d256-prod-github-runner-207 kernel: [15048.637895] Aug 22 09:34:34 juju-e4d256-prod-github-runner-207 kernel: [15048.638753] Aug 22 09:34:34 juju-e4d256-prod-github-runner-207 kernel: [15048.641829] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 09:34:34 juju-e4d256-prod-github-runner-207 kernel: [15048.642879] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:34:34 juju-e4d256-prod-github-runner-207 kernel: [15048.646197] ? _raw_spin_lock+0x22/0x30 Aug 22 09:34:34 juju-e4d256-prod-github-runner-207 kernel: [15048.647159] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:34:34 juju-e4d256-prod-github-runner-207 kernel: [15048.648210] direct_page_fault+0x206/0x310 [kvm] Aug 22 09:34:34 juju-e4d256-prod-github-runner-207 kernel: [15048.651560] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 09:34:34 juju-e4d256-prod-github-runner-207 kernel: [15048.652605] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 09:34:34 juju-e4d256-prod-github-runner-207 kernel: [15048.655350] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 09:34:34 juju-e4d256-prod-github-runner-207 kernel: [15048.656949] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 09:34:34 juju-e4d256-prod-github-runner-207 kernel: [15048.657959] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 09:34:34 juju-e4d256-prod-github-runner-207 kernel: [15048.661285] handle_exit+0x98/0x230 [kvm_amd] Aug 22 09:34:34 juju-e4d256-prod-github-runner-207 kernel: [15048.662211] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 09:34:34 juju-e4d256-prod-github-runner-207 kernel: [15048.663137] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 09:34:34 juju-e4d256-prod-github-runner-207 kernel: [15048.664184] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 09:34:34 juju-e4d256-prod-github-runner-207 kernel: [15048.665138] vcpu_run+0x62/0x2c0 [kvm] Aug 22 09:34:34 juju-e4d256-prod-github-runner-207 kernel: [15048.666001] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 09:34:34 juju-e4d256-prod-github-runner-207 kernel: [15048.666906] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 09:34:34 juju-e4d256-prod-github-runner-207 kernel: [15048.667895] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 09:34:34 juju-e4d256-prod-github-runner-207 kernel: [15048.668828] ? __seccomp_filter+0x4a/0x4a0 Aug 22 09:34:34 juju-e4d256-prod-github-runner-207 kernel: [15048.669580] ? __fget_files+0x86/0xc0 Aug 22 09:34:34 juju-e4d256-prod-github-runner-207 kernel: [15048.670311] __x64_sys_ioctl+0x95/0xd0 Aug 22 09:34:34 juju-e4d256-prod-github-runner-207 kernel: [15048.671028] do_syscall_64+0x5c/0xc0 Aug 22 09:34:34 juju-e4d256-prod-github-runner-207 kernel: [15048.671721] ? do_futex+0x162/0x1f0 Aug 22 09:34:34 juju-e4d256-prod-github-runner-207 kernel: [15048.672402] ? __x64_sys_futex+0x78/0x1e0 Aug 22 09:34:34 juju-e4d256-prod-github-runner-207 kernel: [15048.673096] ? __secure_computing+0xa9/0x120 Aug 22 09:34:34 juju-e4d256-prod-github-runner-207 kernel: [15048.673808] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 09:34:34 juju-e4d256-prod-github-runner-207 kernel: [15048.674578] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:34:34 juju-e4d256-prod-github-runner-207 kernel: [15048.675344] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:34:34 juju-e4d256-prod-github-runner-207 kernel: [15048.676127] ? do_syscall_64+0x69/0xc0 Aug 22 09:34:34 juju-e4d256-prod-github-runner-207 kernel: [15048.676797] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:34:34 juju-e4d256-prod-github-runner-207 kernel: [15048.677520] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:34:34 juju-e4d256-prod-github-runner-207 kernel: [15048.678235] ? do_syscall_64+0x69/0xc0 Aug 22 09:34:34 juju-e4d256-prod-github-runner-207 kernel: [15048.678876] ? do_syscall_64+0x69/0xc0 Aug 22 09:34:34 juju-e4d256-prod-github-runner-207 kernel: [15048.679505] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 09:34:34 juju-e4d256-prod-github-runner-207 kernel: [15048.680251] RIP: 0033:0x7faa5d0edaff Aug 22 09:34:34 juju-e4d256-prod-github-runner-207 kernel: [15048.680913] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 09:34:34 juju-e4d256-prod-github-runner-207 kernel: [15048.682992] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 09:34:34 juju-e4d256-prod-github-runner-207 kernel: [15048.683923] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 09:34:34 juju-e4d256-prod-github-runner-207 kernel: [15048.684848] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 09:34:34 juju-e4d256-prod-github-runner-207 kernel: [15048.685768] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 09:34:34 juju-e4d256-prod-github-runner-207 kernel: [15048.686782] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 09:34:34 juju-e4d256-prod-github-runner-207 kernel: [15048.687700] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 09:34:34 juju-e4d256-prod-github-runner-207 kernel: [15048.688640] Aug 22 09:35:02 juju-e4d256-prod-github-runner-207 kernel: [15076.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 13933s! [qemu-system-x86:6715] Aug 22 09:35:02 juju-e4d256-prod-github-runner-207 kernel: [15076.543141] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 09:35:02 juju-e4d256-prod-github-runner-207 kernel: [15076.543216] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 09:35:02 juju-e4d256-prod-github-runner-207 kernel: [15076.555391] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 09:35:02 juju-e4d256-prod-github-runner-207 kernel: [15076.556673] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 09:35:02 juju-e4d256-prod-github-runner-207 kernel: [15076.557945] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:35:02 juju-e4d256-prod-github-runner-207 kernel: [15076.559153] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 09:35:02 juju-e4d256-prod-github-runner-207 kernel: [15076.561737] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 09:35:02 juju-e4d256-prod-github-runner-207 kernel: [15076.562787] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 09:35:02 juju-e4d256-prod-github-runner-207 kernel: [15076.563993] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 09:35:02 juju-e4d256-prod-github-runner-207 kernel: [15076.565163] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 09:35:02 juju-e4d256-prod-github-runner-207 kernel: [15076.566331] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 09:35:02 juju-e4d256-prod-github-runner-207 kernel: [15076.567534] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 09:35:02 juju-e4d256-prod-github-runner-207 kernel: [15076.568770] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 09:35:02 juju-e4d256-prod-github-runner-207 kernel: [15076.570025] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 09:35:02 juju-e4d256-prod-github-runner-207 kernel: [15076.571131] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 09:35:02 juju-e4d256-prod-github-runner-207 kernel: [15076.572341] Call Trace: Aug 22 09:35:02 juju-e4d256-prod-github-runner-207 kernel: [15076.573288] Aug 22 09:35:02 juju-e4d256-prod-github-runner-207 kernel: [15076.574189] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:35:02 juju-e4d256-prod-github-runner-207 kernel: [15076.575245] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:35:02 juju-e4d256-prod-github-runner-207 kernel: [15076.576298] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:35:02 juju-e4d256-prod-github-runner-207 kernel: [15076.577383] ? show_regs.part.0+0x23/0x29 Aug 22 09:35:02 juju-e4d256-prod-github-runner-207 kernel: [15076.578383] ? show_regs.cold+0x8/0xd Aug 22 09:35:02 juju-e4d256-prod-github-runner-207 kernel: [15076.579367] ? watchdog_timer_fn+0x1be/0x220 Aug 22 09:35:02 juju-e4d256-prod-github-runner-207 kernel: [15076.580414] ? lockup_detector_update_enable+0x60/0x60 Aug 22 09:35:02 juju-e4d256-prod-github-runner-207 kernel: [15076.581496] ? __hrtimer_run_queues+0x107/0x230 Aug 22 09:35:02 juju-e4d256-prod-github-runner-207 kernel: [15076.582525] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 09:35:02 juju-e4d256-prod-github-runner-207 kernel: [15076.583582] ? hrtimer_interrupt+0x101/0x220 Aug 22 09:35:02 juju-e4d256-prod-github-runner-207 kernel: [15076.584628] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 09:35:02 juju-e4d256-prod-github-runner-207 kernel: [15076.585791] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 09:35:02 juju-e4d256-prod-github-runner-207 kernel: [15076.586858] Aug 22 09:35:02 juju-e4d256-prod-github-runner-207 kernel: [15076.587771] Aug 22 09:35:02 juju-e4d256-prod-github-runner-207 kernel: [15076.588650] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 09:35:02 juju-e4d256-prod-github-runner-207 kernel: [15076.589748] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:35:02 juju-e4d256-prod-github-runner-207 kernel: [15076.590823] ? _raw_spin_lock+0x22/0x30 Aug 22 09:35:02 juju-e4d256-prod-github-runner-207 kernel: [15076.591796] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:35:02 juju-e4d256-prod-github-runner-207 kernel: [15076.592824] direct_page_fault+0x206/0x310 [kvm] Aug 22 09:35:02 juju-e4d256-prod-github-runner-207 kernel: [15076.593868] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 09:35:02 juju-e4d256-prod-github-runner-207 kernel: [15076.594887] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 09:35:02 juju-e4d256-prod-github-runner-207 kernel: [15076.595918] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 09:35:02 juju-e4d256-prod-github-runner-207 kernel: [15076.596900] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 09:35:02 juju-e4d256-prod-github-runner-207 kernel: [15076.597849] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 09:35:02 juju-e4d256-prod-github-runner-207 kernel: [15076.598838] handle_exit+0x98/0x230 [kvm_amd] Aug 22 09:35:02 juju-e4d256-prod-github-runner-207 kernel: [15076.599759] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 09:35:02 juju-e4d256-prod-github-runner-207 kernel: [15076.600706] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 09:35:02 juju-e4d256-prod-github-runner-207 kernel: [15076.601648] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 09:35:02 juju-e4d256-prod-github-runner-207 kernel: [15076.602553] vcpu_run+0x62/0x2c0 [kvm] Aug 22 09:35:02 juju-e4d256-prod-github-runner-207 kernel: [15076.603371] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 09:35:02 juju-e4d256-prod-github-runner-207 kernel: [15076.604212] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 09:35:02 juju-e4d256-prod-github-runner-207 kernel: [15076.605073] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 09:35:02 juju-e4d256-prod-github-runner-207 kernel: [15076.605875] ? __seccomp_filter+0x4a/0x4a0 Aug 22 09:35:02 juju-e4d256-prod-github-runner-207 kernel: [15076.606625] ? __fget_files+0x86/0xc0 Aug 22 09:35:02 juju-e4d256-prod-github-runner-207 kernel: [15076.607335] __x64_sys_ioctl+0x95/0xd0 Aug 22 09:35:02 juju-e4d256-prod-github-runner-207 kernel: [15076.608043] do_syscall_64+0x5c/0xc0 Aug 22 09:35:02 juju-e4d256-prod-github-runner-207 kernel: [15076.608712] ? do_futex+0x162/0x1f0 Aug 22 09:35:02 juju-e4d256-prod-github-runner-207 kernel: [15076.609364] ? __x64_sys_futex+0x78/0x1e0 Aug 22 09:35:02 juju-e4d256-prod-github-runner-207 kernel: [15076.610038] ? __secure_computing+0xa9/0x120 Aug 22 09:35:02 juju-e4d256-prod-github-runner-207 kernel: [15076.610735] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 09:35:02 juju-e4d256-prod-github-runner-207 kernel: [15076.611512] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:35:02 juju-e4d256-prod-github-runner-207 kernel: [15076.612252] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:35:02 juju-e4d256-prod-github-runner-207 kernel: [15076.612970] ? do_syscall_64+0x69/0xc0 Aug 22 09:35:02 juju-e4d256-prod-github-runner-207 kernel: [15076.613620] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:35:02 juju-e4d256-prod-github-runner-207 kernel: [15076.614322] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:35:02 juju-e4d256-prod-github-runner-207 kernel: [15076.615040] ? do_syscall_64+0x69/0xc0 Aug 22 09:35:02 juju-e4d256-prod-github-runner-207 kernel: [15076.615705] ? do_syscall_64+0x69/0xc0 Aug 22 09:35:02 juju-e4d256-prod-github-runner-207 kernel: [15076.616351] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 09:35:02 juju-e4d256-prod-github-runner-207 kernel: [15076.617064] RIP: 0033:0x7faa5d0edaff Aug 22 09:35:02 juju-e4d256-prod-github-runner-207 kernel: [15076.617695] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 09:35:02 juju-e4d256-prod-github-runner-207 kernel: [15076.619861] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 09:35:02 juju-e4d256-prod-github-runner-207 kernel: [15076.620933] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 09:35:02 juju-e4d256-prod-github-runner-207 kernel: [15076.621835] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 09:35:02 juju-e4d256-prod-github-runner-207 kernel: [15076.622731] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 09:35:02 juju-e4d256-prod-github-runner-207 kernel: [15076.623626] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 09:35:02 juju-e4d256-prod-github-runner-207 kernel: [15076.624578] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 09:35:02 juju-e4d256-prod-github-runner-207 kernel: [15076.625487] Aug 22 09:35:30 juju-e4d256-prod-github-runner-207 kernel: [15104.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 13959s! [qemu-system-x86:6715] Aug 22 09:35:30 juju-e4d256-prod-github-runner-207 kernel: [15104.543875] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 09:35:30 juju-e4d256-prod-github-runner-207 kernel: [15104.544165] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 09:35:30 juju-e4d256-prod-github-runner-207 kernel: [15104.556261] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 09:35:30 juju-e4d256-prod-github-runner-207 kernel: [15104.557535] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 09:35:30 juju-e4d256-prod-github-runner-207 kernel: [15104.558768] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:35:30 juju-e4d256-prod-github-runner-207 kernel: [15104.559839] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 09:35:30 juju-e4d256-prod-github-runner-207 kernel: [15104.562387] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 09:35:30 juju-e4d256-prod-github-runner-207 kernel: [15104.563463] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 09:35:30 juju-e4d256-prod-github-runner-207 kernel: [15104.564627] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 09:35:30 juju-e4d256-prod-github-runner-207 kernel: [15104.565787] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 09:35:30 juju-e4d256-prod-github-runner-207 kernel: [15104.566978] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 09:35:30 juju-e4d256-prod-github-runner-207 kernel: [15104.568150] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 09:35:30 juju-e4d256-prod-github-runner-207 kernel: [15104.569310] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 09:35:30 juju-e4d256-prod-github-runner-207 kernel: [15104.570536] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 09:35:30 juju-e4d256-prod-github-runner-207 kernel: [15104.571639] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 09:35:30 juju-e4d256-prod-github-runner-207 kernel: [15104.572827] Call Trace: Aug 22 09:35:30 juju-e4d256-prod-github-runner-207 kernel: [15104.573736] Aug 22 09:35:30 juju-e4d256-prod-github-runner-207 kernel: [15104.574642] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:35:30 juju-e4d256-prod-github-runner-207 kernel: [15104.575718] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:35:30 juju-e4d256-prod-github-runner-207 kernel: [15104.576746] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:35:30 juju-e4d256-prod-github-runner-207 kernel: [15104.577839] ? show_regs.part.0+0x23/0x29 Aug 22 09:35:30 juju-e4d256-prod-github-runner-207 kernel: [15104.578939] ? show_regs.cold+0x8/0xd Aug 22 09:35:30 juju-e4d256-prod-github-runner-207 kernel: [15104.580004] ? watchdog_timer_fn+0x1be/0x220 Aug 22 09:35:30 juju-e4d256-prod-github-runner-207 kernel: [15104.581018] ? lockup_detector_update_enable+0x60/0x60 Aug 22 09:35:30 juju-e4d256-prod-github-runner-207 kernel: [15104.582086] ? __hrtimer_run_queues+0x107/0x230 Aug 22 09:35:30 juju-e4d256-prod-github-runner-207 kernel: [15104.583113] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 09:35:30 juju-e4d256-prod-github-runner-207 kernel: [15104.584157] ? hrtimer_interrupt+0x101/0x220 Aug 22 09:35:30 juju-e4d256-prod-github-runner-207 kernel: [15104.585177] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 09:35:30 juju-e4d256-prod-github-runner-207 kernel: [15104.586267] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 09:35:30 juju-e4d256-prod-github-runner-207 kernel: [15104.587337] Aug 22 09:35:30 juju-e4d256-prod-github-runner-207 kernel: [15104.588191] Aug 22 09:35:30 juju-e4d256-prod-github-runner-207 kernel: [15104.589031] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 09:35:30 juju-e4d256-prod-github-runner-207 kernel: [15104.590068] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:35:30 juju-e4d256-prod-github-runner-207 kernel: [15104.591126] ? _raw_spin_lock+0x22/0x30 Aug 22 09:35:30 juju-e4d256-prod-github-runner-207 kernel: [15104.592092] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:35:30 juju-e4d256-prod-github-runner-207 kernel: [15104.593113] direct_page_fault+0x206/0x310 [kvm] Aug 22 09:35:30 juju-e4d256-prod-github-runner-207 kernel: [15104.594294] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 09:35:30 juju-e4d256-prod-github-runner-207 kernel: [15104.595464] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 09:35:30 juju-e4d256-prod-github-runner-207 kernel: [15104.596472] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 09:35:30 juju-e4d256-prod-github-runner-207 kernel: [15104.597481] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 09:35:30 juju-e4d256-prod-github-runner-207 kernel: [15104.598424] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 09:35:30 juju-e4d256-prod-github-runner-207 kernel: [15104.599418] handle_exit+0x98/0x230 [kvm_amd] Aug 22 09:35:30 juju-e4d256-prod-github-runner-207 kernel: [15104.600324] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 09:35:30 juju-e4d256-prod-github-runner-207 kernel: [15104.601279] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 09:35:30 juju-e4d256-prod-github-runner-207 kernel: [15104.602224] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 09:35:30 juju-e4d256-prod-github-runner-207 kernel: [15104.603132] vcpu_run+0x62/0x2c0 [kvm] Aug 22 09:35:30 juju-e4d256-prod-github-runner-207 kernel: [15104.603963] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 09:35:30 juju-e4d256-prod-github-runner-207 kernel: [15104.604797] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 09:35:30 juju-e4d256-prod-github-runner-207 kernel: [15104.605675] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 09:35:30 juju-e4d256-prod-github-runner-207 kernel: [15104.606519] ? __seccomp_filter+0x4a/0x4a0 Aug 22 09:35:30 juju-e4d256-prod-github-runner-207 kernel: [15104.607269] ? __fget_files+0x86/0xc0 Aug 22 09:35:30 juju-e4d256-prod-github-runner-207 kernel: [15104.608002] __x64_sys_ioctl+0x95/0xd0 Aug 22 09:35:30 juju-e4d256-prod-github-runner-207 kernel: [15104.608717] do_syscall_64+0x5c/0xc0 Aug 22 09:35:30 juju-e4d256-prod-github-runner-207 kernel: [15104.609414] ? do_futex+0x162/0x1f0 Aug 22 09:35:30 juju-e4d256-prod-github-runner-207 kernel: [15104.610086] ? __x64_sys_futex+0x78/0x1e0 Aug 22 09:35:30 juju-e4d256-prod-github-runner-207 kernel: [15104.610779] ? __secure_computing+0xa9/0x120 Aug 22 09:35:30 juju-e4d256-prod-github-runner-207 kernel: [15104.611517] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 09:35:30 juju-e4d256-prod-github-runner-207 kernel: [15104.612292] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:35:30 juju-e4d256-prod-github-runner-207 kernel: [15104.613022] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:35:30 juju-e4d256-prod-github-runner-207 kernel: [15104.613748] ? do_syscall_64+0x69/0xc0 Aug 22 09:35:30 juju-e4d256-prod-github-runner-207 kernel: [15104.614393] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:35:30 juju-e4d256-prod-github-runner-207 kernel: [15104.615118] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:35:30 juju-e4d256-prod-github-runner-207 kernel: [15104.615832] ? do_syscall_64+0x69/0xc0 Aug 22 09:35:30 juju-e4d256-prod-github-runner-207 kernel: [15104.616484] ? do_syscall_64+0x69/0xc0 Aug 22 09:35:30 juju-e4d256-prod-github-runner-207 kernel: [15104.617113] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 09:35:30 juju-e4d256-prod-github-runner-207 kernel: [15104.617822] RIP: 0033:0x7faa5d0edaff Aug 22 09:35:30 juju-e4d256-prod-github-runner-207 kernel: [15104.618480] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 09:35:30 juju-e4d256-prod-github-runner-207 kernel: [15104.620693] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 09:35:30 juju-e4d256-prod-github-runner-207 kernel: [15104.621932] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 09:35:30 juju-e4d256-prod-github-runner-207 kernel: [15104.622840] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 09:35:30 juju-e4d256-prod-github-runner-207 kernel: [15104.623746] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 09:35:30 juju-e4d256-prod-github-runner-207 kernel: [15104.624644] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 09:35:30 juju-e4d256-prod-github-runner-207 kernel: [15104.625543] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 09:35:30 juju-e4d256-prod-github-runner-207 kernel: [15104.626458] Aug 22 09:35:44 juju-e4d256-prod-github-runner-207 kernel: [15118.196705] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 09:35:44 juju-e4d256-prod-github-runner-207 kernel: [15118.197678] rcu: 1-....: (3738507 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=1805593 Aug 22 09:35:44 juju-e4d256-prod-github-runner-207 kernel: [15118.198802] (t=3750249 jiffies g=23269 q=22466) Aug 22 09:35:44 juju-e4d256-prod-github-runner-207 kernel: [15118.199605] NMI backtrace for cpu 1 Aug 22 09:35:44 juju-e4d256-prod-github-runner-207 kernel: [15118.200350] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 09:35:44 juju-e4d256-prod-github-runner-207 kernel: [15118.201506] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 09:35:44 juju-e4d256-prod-github-runner-207 kernel: [15118.202714] Call Trace: Aug 22 09:35:44 juju-e4d256-prod-github-runner-207 kernel: [15118.203421] Aug 22 09:35:44 juju-e4d256-prod-github-runner-207 kernel: [15118.204133] show_stack+0x52/0x5c Aug 22 09:35:44 juju-e4d256-prod-github-runner-207 kernel: [15118.204869] dump_stack_lvl+0x4a/0x63 Aug 22 09:35:44 juju-e4d256-prod-github-runner-207 kernel: [15118.205619] dump_stack+0x10/0x16 Aug 22 09:35:44 juju-e4d256-prod-github-runner-207 kernel: [15118.206334] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 09:35:44 juju-e4d256-prod-github-runner-207 kernel: [15118.207112] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 09:35:44 juju-e4d256-prod-github-runner-207 kernel: [15118.207904] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 09:35:44 juju-e4d256-prod-github-runner-207 kernel: [15118.208726] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 09:35:44 juju-e4d256-prod-github-runner-207 kernel: [15118.209544] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 09:35:44 juju-e4d256-prod-github-runner-207 kernel: [15118.210371] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 09:35:44 juju-e4d256-prod-github-runner-207 kernel: [15118.211141] print_cpu_stall.cold+0x2f/0xe2 Aug 22 09:35:44 juju-e4d256-prod-github-runner-207 kernel: [15118.211928] ? timekeeping_update+0xf7/0x150 Aug 22 09:35:44 juju-e4d256-prod-github-runner-207 kernel: [15118.212704] check_cpu_stall+0x109/0x270 Aug 22 09:35:44 juju-e4d256-prod-github-runner-207 kernel: [15118.213447] rcu_sched_clock_irq+0x9a/0x250 Aug 22 09:35:44 juju-e4d256-prod-github-runner-207 kernel: [15118.214203] update_process_times+0x94/0xd0 Aug 22 09:35:44 juju-e4d256-prod-github-runner-207 kernel: [15118.214964] tick_sched_handle+0x29/0x70 Aug 22 09:35:44 juju-e4d256-prod-github-runner-207 kernel: [15118.215729] tick_sched_timer+0x8c/0xc0 Aug 22 09:35:44 juju-e4d256-prod-github-runner-207 kernel: [15118.216466] ? tick_nohz_handler+0xb0/0xb0 Aug 22 09:35:44 juju-e4d256-prod-github-runner-207 kernel: [15118.217216] __hrtimer_run_queues+0x107/0x230 Aug 22 09:35:44 juju-e4d256-prod-github-runner-207 kernel: [15118.217984] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 09:35:44 juju-e4d256-prod-github-runner-207 kernel: [15118.218758] hrtimer_interrupt+0x101/0x220 Aug 22 09:35:44 juju-e4d256-prod-github-runner-207 kernel: [15118.219530] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 09:35:44 juju-e4d256-prod-github-runner-207 kernel: [15118.220337] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 09:35:44 juju-e4d256-prod-github-runner-207 kernel: [15118.221139] Aug 22 09:35:44 juju-e4d256-prod-github-runner-207 kernel: [15118.221791] Aug 22 09:35:44 juju-e4d256-prod-github-runner-207 kernel: [15118.222420] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 09:35:44 juju-e4d256-prod-github-runner-207 kernel: [15118.223257] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:35:44 juju-e4d256-prod-github-runner-207 kernel: [15118.224136] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 09:35:44 juju-e4d256-prod-github-runner-207 kernel: [15118.226328] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 09:35:44 juju-e4d256-prod-github-runner-207 kernel: [15118.227233] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 09:35:44 juju-e4d256-prod-github-runner-207 kernel: [15118.228230] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 09:35:44 juju-e4d256-prod-github-runner-207 kernel: [15118.229210] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 09:35:44 juju-e4d256-prod-github-runner-207 kernel: [15118.230216] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 09:35:44 juju-e4d256-prod-github-runner-207 kernel: [15118.231207] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 09:35:44 juju-e4d256-prod-github-runner-207 kernel: [15118.232166] ? _raw_spin_lock+0x22/0x30 Aug 22 09:35:44 juju-e4d256-prod-github-runner-207 kernel: [15118.232928] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:35:44 juju-e4d256-prod-github-runner-207 kernel: [15118.233794] direct_page_fault+0x206/0x310 [kvm] Aug 22 09:35:44 juju-e4d256-prod-github-runner-207 kernel: [15118.234646] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 09:35:44 juju-e4d256-prod-github-runner-207 kernel: [15118.235492] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 09:35:44 juju-e4d256-prod-github-runner-207 kernel: [15118.236321] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 09:35:44 juju-e4d256-prod-github-runner-207 kernel: [15118.237126] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 09:35:44 juju-e4d256-prod-github-runner-207 kernel: [15118.237916] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 09:35:44 juju-e4d256-prod-github-runner-207 kernel: [15118.238736] handle_exit+0x98/0x230 [kvm_amd] Aug 22 09:35:44 juju-e4d256-prod-github-runner-207 kernel: [15118.239510] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 09:35:44 juju-e4d256-prod-github-runner-207 kernel: [15118.240293] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 09:35:44 juju-e4d256-prod-github-runner-207 kernel: [15118.241089] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 09:35:44 juju-e4d256-prod-github-runner-207 kernel: [15118.241875] vcpu_run+0x62/0x2c0 [kvm] Aug 22 09:35:44 juju-e4d256-prod-github-runner-207 kernel: [15118.242592] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 09:35:44 juju-e4d256-prod-github-runner-207 kernel: [15118.243340] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 09:35:44 juju-e4d256-prod-github-runner-207 kernel: [15118.244137] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 09:35:44 juju-e4d256-prod-github-runner-207 kernel: [15118.244895] ? __seccomp_filter+0x4a/0x4a0 Aug 22 09:35:44 juju-e4d256-prod-github-runner-207 kernel: [15118.245611] ? __fget_files+0x86/0xc0 Aug 22 09:35:44 juju-e4d256-prod-github-runner-207 kernel: [15118.246301] __x64_sys_ioctl+0x95/0xd0 Aug 22 09:35:44 juju-e4d256-prod-github-runner-207 kernel: [15118.246997] do_syscall_64+0x5c/0xc0 Aug 22 09:35:44 juju-e4d256-prod-github-runner-207 kernel: [15118.247689] ? do_futex+0x162/0x1f0 Aug 22 09:35:44 juju-e4d256-prod-github-runner-207 kernel: [15118.248358] ? __x64_sys_futex+0x78/0x1e0 Aug 22 09:35:44 juju-e4d256-prod-github-runner-207 kernel: [15118.249056] ? __secure_computing+0xa9/0x120 Aug 22 09:35:44 juju-e4d256-prod-github-runner-207 kernel: [15118.249771] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 09:35:44 juju-e4d256-prod-github-runner-207 kernel: [15118.250577] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:35:44 juju-e4d256-prod-github-runner-207 kernel: [15118.251365] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:35:44 juju-e4d256-prod-github-runner-207 kernel: [15118.252118] ? do_syscall_64+0x69/0xc0 Aug 22 09:35:44 juju-e4d256-prod-github-runner-207 kernel: [15118.252804] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:35:44 juju-e4d256-prod-github-runner-207 kernel: [15118.253553] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:35:44 juju-e4d256-prod-github-runner-207 kernel: [15118.254319] ? do_syscall_64+0x69/0xc0 Aug 22 09:35:44 juju-e4d256-prod-github-runner-207 kernel: [15118.255059] ? do_syscall_64+0x69/0xc0 Aug 22 09:35:44 juju-e4d256-prod-github-runner-207 kernel: [15118.255765] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 09:35:44 juju-e4d256-prod-github-runner-207 kernel: [15118.256565] RIP: 0033:0x7faa5d0edaff Aug 22 09:35:44 juju-e4d256-prod-github-runner-207 kernel: [15118.257269] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 09:35:44 juju-e4d256-prod-github-runner-207 kernel: [15118.259429] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 09:35:44 juju-e4d256-prod-github-runner-207 kernel: [15118.260432] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 09:35:44 juju-e4d256-prod-github-runner-207 kernel: [15118.261381] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 09:35:44 juju-e4d256-prod-github-runner-207 kernel: [15118.262322] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 09:35:44 juju-e4d256-prod-github-runner-207 kernel: [15118.263279] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 09:35:44 juju-e4d256-prod-github-runner-207 kernel: [15118.264254] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 09:35:44 juju-e4d256-prod-github-runner-207 kernel: [15118.265181] Aug 22 09:36:10 juju-e4d256-prod-github-runner-207 kernel: [15144.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 13996s! [qemu-system-x86:6715] Aug 22 09:36:10 juju-e4d256-prod-github-runner-207 kernel: [15144.543155] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 09:36:10 juju-e4d256-prod-github-runner-207 kernel: [15144.543231] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 09:36:10 juju-e4d256-prod-github-runner-207 kernel: [15144.555676] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 09:36:10 juju-e4d256-prod-github-runner-207 kernel: [15144.556983] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 09:36:10 juju-e4d256-prod-github-runner-207 kernel: [15144.558247] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:36:10 juju-e4d256-prod-github-runner-207 kernel: [15144.559383] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 09:36:10 juju-e4d256-prod-github-runner-207 kernel: [15144.562017] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 09:36:10 juju-e4d256-prod-github-runner-207 kernel: [15144.563091] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 09:36:10 juju-e4d256-prod-github-runner-207 kernel: [15144.564274] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 09:36:10 juju-e4d256-prod-github-runner-207 kernel: [15144.565454] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 09:36:10 juju-e4d256-prod-github-runner-207 kernel: [15144.566663] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 09:36:10 juju-e4d256-prod-github-runner-207 kernel: [15144.567871] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 09:36:10 juju-e4d256-prod-github-runner-207 kernel: [15144.569064] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 09:36:10 juju-e4d256-prod-github-runner-207 kernel: [15144.570325] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 09:36:10 juju-e4d256-prod-github-runner-207 kernel: [15144.571455] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 09:36:10 juju-e4d256-prod-github-runner-207 kernel: [15144.572676] Call Trace: Aug 22 09:36:10 juju-e4d256-prod-github-runner-207 kernel: [15144.573602] Aug 22 09:36:10 juju-e4d256-prod-github-runner-207 kernel: [15144.574496] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:36:10 juju-e4d256-prod-github-runner-207 kernel: [15144.575558] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:36:10 juju-e4d256-prod-github-runner-207 kernel: [15144.576632] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:36:10 juju-e4d256-prod-github-runner-207 kernel: [15144.577735] ? show_regs.part.0+0x23/0x29 Aug 22 09:36:10 juju-e4d256-prod-github-runner-207 kernel: [15144.578746] ? show_regs.cold+0x8/0xd Aug 22 09:36:10 juju-e4d256-prod-github-runner-207 kernel: [15144.579743] ? watchdog_timer_fn+0x1be/0x220 Aug 22 09:36:10 juju-e4d256-prod-github-runner-207 kernel: [15144.580853] ? lockup_detector_update_enable+0x60/0x60 Aug 22 09:36:10 juju-e4d256-prod-github-runner-207 kernel: [15144.581941] ? __hrtimer_run_queues+0x107/0x230 Aug 22 09:36:10 juju-e4d256-prod-github-runner-207 kernel: [15144.583013] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 09:36:10 juju-e4d256-prod-github-runner-207 kernel: [15144.584052] ? hrtimer_interrupt+0x101/0x220 Aug 22 09:36:10 juju-e4d256-prod-github-runner-207 kernel: [15144.585086] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 09:36:10 juju-e4d256-prod-github-runner-207 kernel: [15144.586166] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 09:36:10 juju-e4d256-prod-github-runner-207 kernel: [15144.587251] Aug 22 09:36:10 juju-e4d256-prod-github-runner-207 kernel: [15144.588126] Aug 22 09:36:10 juju-e4d256-prod-github-runner-207 kernel: [15144.588978] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 09:36:10 juju-e4d256-prod-github-runner-207 kernel: [15144.590017] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:36:10 juju-e4d256-prod-github-runner-207 kernel: [15144.591097] ? _raw_spin_lock+0x22/0x30 Aug 22 09:36:10 juju-e4d256-prod-github-runner-207 kernel: [15144.592048] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:36:10 juju-e4d256-prod-github-runner-207 kernel: [15144.593067] direct_page_fault+0x206/0x310 [kvm] Aug 22 09:36:10 juju-e4d256-prod-github-runner-207 kernel: [15144.594095] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 09:36:10 juju-e4d256-prod-github-runner-207 kernel: [15144.595118] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 09:36:10 juju-e4d256-prod-github-runner-207 kernel: [15144.596125] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 09:36:10 juju-e4d256-prod-github-runner-207 kernel: [15144.597097] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 09:36:10 juju-e4d256-prod-github-runner-207 kernel: [15144.598047] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 09:36:10 juju-e4d256-prod-github-runner-207 kernel: [15144.599037] handle_exit+0x98/0x230 [kvm_amd] Aug 22 09:36:10 juju-e4d256-prod-github-runner-207 kernel: [15144.600105] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 09:36:10 juju-e4d256-prod-github-runner-207 kernel: [15144.601020] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 09:36:10 juju-e4d256-prod-github-runner-207 kernel: [15144.601949] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 09:36:10 juju-e4d256-prod-github-runner-207 kernel: [15144.602863] vcpu_run+0x62/0x2c0 [kvm] Aug 22 09:36:10 juju-e4d256-prod-github-runner-207 kernel: [15144.603676] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 09:36:10 juju-e4d256-prod-github-runner-207 kernel: [15144.604487] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 09:36:10 juju-e4d256-prod-github-runner-207 kernel: [15144.605347] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 09:36:10 juju-e4d256-prod-github-runner-207 kernel: [15144.606159] ? __seccomp_filter+0x4a/0x4a0 Aug 22 09:36:10 juju-e4d256-prod-github-runner-207 kernel: [15144.606920] ? __fget_files+0x86/0xc0 Aug 22 09:36:10 juju-e4d256-prod-github-runner-207 kernel: [15144.607701] __x64_sys_ioctl+0x95/0xd0 Aug 22 09:36:10 juju-e4d256-prod-github-runner-207 kernel: [15144.608431] do_syscall_64+0x5c/0xc0 Aug 22 09:36:10 juju-e4d256-prod-github-runner-207 kernel: [15144.609160] ? do_futex+0x162/0x1f0 Aug 22 09:36:10 juju-e4d256-prod-github-runner-207 kernel: [15144.609903] ? __x64_sys_futex+0x78/0x1e0 Aug 22 09:36:10 juju-e4d256-prod-github-runner-207 kernel: [15144.610586] ? __secure_computing+0xa9/0x120 Aug 22 09:36:10 juju-e4d256-prod-github-runner-207 kernel: [15144.611299] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 09:36:10 juju-e4d256-prod-github-runner-207 kernel: [15144.612061] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:36:10 juju-e4d256-prod-github-runner-207 kernel: [15144.612812] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:36:10 juju-e4d256-prod-github-runner-207 kernel: [15144.613547] ? do_syscall_64+0x69/0xc0 Aug 22 09:36:10 juju-e4d256-prod-github-runner-207 kernel: [15144.614205] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:36:10 juju-e4d256-prod-github-runner-207 kernel: [15144.614935] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:36:10 juju-e4d256-prod-github-runner-207 kernel: [15144.615637] ? do_syscall_64+0x69/0xc0 Aug 22 09:36:10 juju-e4d256-prod-github-runner-207 kernel: [15144.616262] ? do_syscall_64+0x69/0xc0 Aug 22 09:36:10 juju-e4d256-prod-github-runner-207 kernel: [15144.616885] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 09:36:10 juju-e4d256-prod-github-runner-207 kernel: [15144.617596] RIP: 0033:0x7faa5d0edaff Aug 22 09:36:10 juju-e4d256-prod-github-runner-207 kernel: [15144.618235] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 09:36:10 juju-e4d256-prod-github-runner-207 kernel: [15144.620265] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 09:36:10 juju-e4d256-prod-github-runner-207 kernel: [15144.621185] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 09:36:10 juju-e4d256-prod-github-runner-207 kernel: [15144.622251] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 09:36:10 juju-e4d256-prod-github-runner-207 kernel: [15144.623239] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 09:36:10 juju-e4d256-prod-github-runner-207 kernel: [15144.624175] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 09:36:10 juju-e4d256-prod-github-runner-207 kernel: [15144.625074] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 09:36:10 juju-e4d256-prod-github-runner-207 kernel: [15144.625976] Aug 22 09:36:38 juju-e4d256-prod-github-runner-207 kernel: [15172.541981] watchdog: BUG: soft lockup - CPU#1 stuck for 14022s! [qemu-system-x86:6715] Aug 22 09:36:38 juju-e4d256-prod-github-runner-207 kernel: [15172.543148] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 09:36:38 juju-e4d256-prod-github-runner-207 kernel: [15172.543220] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 09:36:38 juju-e4d256-prod-github-runner-207 kernel: [15172.555736] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 09:36:38 juju-e4d256-prod-github-runner-207 kernel: [15172.557077] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 09:36:38 juju-e4d256-prod-github-runner-207 kernel: [15172.558320] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:36:38 juju-e4d256-prod-github-runner-207 kernel: [15172.559424] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 09:36:38 juju-e4d256-prod-github-runner-207 kernel: [15172.562067] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 09:36:38 juju-e4d256-prod-github-runner-207 kernel: [15172.563155] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 09:36:38 juju-e4d256-prod-github-runner-207 kernel: [15172.564329] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 09:36:38 juju-e4d256-prod-github-runner-207 kernel: [15172.565501] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 09:36:38 juju-e4d256-prod-github-runner-207 kernel: [15172.566726] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 09:36:38 juju-e4d256-prod-github-runner-207 kernel: [15172.567919] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 09:36:38 juju-e4d256-prod-github-runner-207 kernel: [15172.569155] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 09:36:38 juju-e4d256-prod-github-runner-207 kernel: [15172.570440] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 09:36:38 juju-e4d256-prod-github-runner-207 kernel: [15172.571677] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 09:36:38 juju-e4d256-prod-github-runner-207 kernel: [15172.572930] Call Trace: Aug 22 09:36:38 juju-e4d256-prod-github-runner-207 kernel: [15172.573851] Aug 22 09:36:38 juju-e4d256-prod-github-runner-207 kernel: [15172.574762] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:36:38 juju-e4d256-prod-github-runner-207 kernel: [15172.575802] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:36:38 juju-e4d256-prod-github-runner-207 kernel: [15172.576843] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:36:38 juju-e4d256-prod-github-runner-207 kernel: [15172.577944] ? show_regs.part.0+0x23/0x29 Aug 22 09:36:38 juju-e4d256-prod-github-runner-207 kernel: [15172.578969] ? show_regs.cold+0x8/0xd Aug 22 09:36:38 juju-e4d256-prod-github-runner-207 kernel: [15172.579953] ? watchdog_timer_fn+0x1be/0x220 Aug 22 09:36:38 juju-e4d256-prod-github-runner-207 kernel: [15172.580974] ? lockup_detector_update_enable+0x60/0x60 Aug 22 09:36:38 juju-e4d256-prod-github-runner-207 kernel: [15172.582088] ? __hrtimer_run_queues+0x107/0x230 Aug 22 09:36:38 juju-e4d256-prod-github-runner-207 kernel: [15172.583161] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 09:36:38 juju-e4d256-prod-github-runner-207 kernel: [15172.584198] ? hrtimer_interrupt+0x101/0x220 Aug 22 09:36:38 juju-e4d256-prod-github-runner-207 kernel: [15172.585225] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 09:36:38 juju-e4d256-prod-github-runner-207 kernel: [15172.586318] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 09:36:38 juju-e4d256-prod-github-runner-207 kernel: [15172.587416] Aug 22 09:36:38 juju-e4d256-prod-github-runner-207 kernel: [15172.588278] Aug 22 09:36:38 juju-e4d256-prod-github-runner-207 kernel: [15172.589127] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 09:36:38 juju-e4d256-prod-github-runner-207 kernel: [15172.590175] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:36:38 juju-e4d256-prod-github-runner-207 kernel: [15172.591249] ? _raw_spin_lock+0x22/0x30 Aug 22 09:36:38 juju-e4d256-prod-github-runner-207 kernel: [15172.592248] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:36:38 juju-e4d256-prod-github-runner-207 kernel: [15172.593303] direct_page_fault+0x206/0x310 [kvm] Aug 22 09:36:38 juju-e4d256-prod-github-runner-207 kernel: [15172.594352] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 09:36:38 juju-e4d256-prod-github-runner-207 kernel: [15172.595386] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 09:36:38 juju-e4d256-prod-github-runner-207 kernel: [15172.596399] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 09:36:38 juju-e4d256-prod-github-runner-207 kernel: [15172.597400] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 09:36:38 juju-e4d256-prod-github-runner-207 kernel: [15172.598370] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 09:36:38 juju-e4d256-prod-github-runner-207 kernel: [15172.599374] handle_exit+0x98/0x230 [kvm_amd] Aug 22 09:36:38 juju-e4d256-prod-github-runner-207 kernel: [15172.600290] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 09:36:38 juju-e4d256-prod-github-runner-207 kernel: [15172.601224] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 09:36:38 juju-e4d256-prod-github-runner-207 kernel: [15172.602196] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 09:36:38 juju-e4d256-prod-github-runner-207 kernel: [15172.603134] vcpu_run+0x62/0x2c0 [kvm] Aug 22 09:36:38 juju-e4d256-prod-github-runner-207 kernel: [15172.603960] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 09:36:38 juju-e4d256-prod-github-runner-207 kernel: [15172.604780] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 09:36:38 juju-e4d256-prod-github-runner-207 kernel: [15172.605734] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 09:36:38 juju-e4d256-prod-github-runner-207 kernel: [15172.606554] ? __seccomp_filter+0x4a/0x4a0 Aug 22 09:36:38 juju-e4d256-prod-github-runner-207 kernel: [15172.607313] ? __fget_files+0x86/0xc0 Aug 22 09:36:38 juju-e4d256-prod-github-runner-207 kernel: [15172.608037] __x64_sys_ioctl+0x95/0xd0 Aug 22 09:36:38 juju-e4d256-prod-github-runner-207 kernel: [15172.608745] do_syscall_64+0x5c/0xc0 Aug 22 09:36:38 juju-e4d256-prod-github-runner-207 kernel: [15172.609425] ? do_futex+0x162/0x1f0 Aug 22 09:36:38 juju-e4d256-prod-github-runner-207 kernel: [15172.610081] ? __x64_sys_futex+0x78/0x1e0 Aug 22 09:36:38 juju-e4d256-prod-github-runner-207 kernel: [15172.610790] ? __secure_computing+0xa9/0x120 Aug 22 09:36:38 juju-e4d256-prod-github-runner-207 kernel: [15172.611502] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 09:36:38 juju-e4d256-prod-github-runner-207 kernel: [15172.612340] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:36:38 juju-e4d256-prod-github-runner-207 kernel: [15172.613085] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:36:38 juju-e4d256-prod-github-runner-207 kernel: [15172.613811] ? do_syscall_64+0x69/0xc0 Aug 22 09:36:38 juju-e4d256-prod-github-runner-207 kernel: [15172.614482] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:36:38 juju-e4d256-prod-github-runner-207 kernel: [15172.615188] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:36:38 juju-e4d256-prod-github-runner-207 kernel: [15172.615886] ? do_syscall_64+0x69/0xc0 Aug 22 09:36:38 juju-e4d256-prod-github-runner-207 kernel: [15172.616510] ? do_syscall_64+0x69/0xc0 Aug 22 09:36:38 juju-e4d256-prod-github-runner-207 kernel: [15172.617145] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 09:36:38 juju-e4d256-prod-github-runner-207 kernel: [15172.617847] RIP: 0033:0x7faa5d0edaff Aug 22 09:36:38 juju-e4d256-prod-github-runner-207 kernel: [15172.618494] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 09:36:38 juju-e4d256-prod-github-runner-207 kernel: [15172.620490] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 09:36:38 juju-e4d256-prod-github-runner-207 kernel: [15172.621410] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 09:36:38 juju-e4d256-prod-github-runner-207 kernel: [15172.622299] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 09:36:38 juju-e4d256-prod-github-runner-207 kernel: [15172.623243] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 09:36:38 juju-e4d256-prod-github-runner-207 kernel: [15172.624142] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 09:36:38 juju-e4d256-prod-github-runner-207 kernel: [15172.625029] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 09:36:38 juju-e4d256-prod-github-runner-207 kernel: [15172.625926] Aug 22 09:37:06 juju-e4d256-prod-github-runner-207 kernel: [15200.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 14048s! [qemu-system-x86:6715] Aug 22 09:37:06 juju-e4d256-prod-github-runner-207 kernel: [15200.543975] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 09:37:06 juju-e4d256-prod-github-runner-207 kernel: [15200.544289] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 09:37:06 juju-e4d256-prod-github-runner-207 kernel: [15200.556888] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 09:37:06 juju-e4d256-prod-github-runner-207 kernel: [15200.558294] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 09:37:06 juju-e4d256-prod-github-runner-207 kernel: [15200.559569] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:37:06 juju-e4d256-prod-github-runner-207 kernel: [15200.560654] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 09:37:06 juju-e4d256-prod-github-runner-207 kernel: [15200.563285] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 09:37:06 juju-e4d256-prod-github-runner-207 kernel: [15200.564401] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 09:37:06 juju-e4d256-prod-github-runner-207 kernel: [15200.565594] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 09:37:06 juju-e4d256-prod-github-runner-207 kernel: [15200.566824] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 09:37:06 juju-e4d256-prod-github-runner-207 kernel: [15200.568012] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 09:37:06 juju-e4d256-prod-github-runner-207 kernel: [15200.569195] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 09:37:06 juju-e4d256-prod-github-runner-207 kernel: [15200.570398] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 09:37:06 juju-e4d256-prod-github-runner-207 kernel: [15200.571655] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 09:37:06 juju-e4d256-prod-github-runner-207 kernel: [15200.572770] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 09:37:06 juju-e4d256-prod-github-runner-207 kernel: [15200.573987] Call Trace: Aug 22 09:37:06 juju-e4d256-prod-github-runner-207 kernel: [15200.574944] Aug 22 09:37:06 juju-e4d256-prod-github-runner-207 kernel: [15200.575876] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:37:06 juju-e4d256-prod-github-runner-207 kernel: [15200.576924] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:37:06 juju-e4d256-prod-github-runner-207 kernel: [15200.577964] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:37:06 juju-e4d256-prod-github-runner-207 kernel: [15200.579102] ? show_regs.part.0+0x23/0x29 Aug 22 09:37:06 juju-e4d256-prod-github-runner-207 kernel: [15200.580119] ? show_regs.cold+0x8/0xd Aug 22 09:37:06 juju-e4d256-prod-github-runner-207 kernel: [15200.581221] ? watchdog_timer_fn+0x1be/0x220 Aug 22 09:37:06 juju-e4d256-prod-github-runner-207 kernel: [15200.582276] ? lockup_detector_update_enable+0x60/0x60 Aug 22 09:37:06 juju-e4d256-prod-github-runner-207 kernel: [15200.583353] ? __hrtimer_run_queues+0x107/0x230 Aug 22 09:37:06 juju-e4d256-prod-github-runner-207 kernel: [15200.584404] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 09:37:06 juju-e4d256-prod-github-runner-207 kernel: [15200.585451] ? hrtimer_interrupt+0x101/0x220 Aug 22 09:37:06 juju-e4d256-prod-github-runner-207 kernel: [15200.586511] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 09:37:06 juju-e4d256-prod-github-runner-207 kernel: [15200.587605] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 09:37:06 juju-e4d256-prod-github-runner-207 kernel: [15200.588669] Aug 22 09:37:06 juju-e4d256-prod-github-runner-207 kernel: [15200.589542] Aug 22 09:37:06 juju-e4d256-prod-github-runner-207 kernel: [15200.590429] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 09:37:06 juju-e4d256-prod-github-runner-207 kernel: [15200.591504] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:37:06 juju-e4d256-prod-github-runner-207 kernel: [15200.592602] ? _raw_spin_lock+0x22/0x30 Aug 22 09:37:06 juju-e4d256-prod-github-runner-207 kernel: [15200.593570] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:37:06 juju-e4d256-prod-github-runner-207 kernel: [15200.594640] direct_page_fault+0x206/0x310 [kvm] Aug 22 09:37:06 juju-e4d256-prod-github-runner-207 kernel: [15200.595696] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 09:37:06 juju-e4d256-prod-github-runner-207 kernel: [15200.596718] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 09:37:06 juju-e4d256-prod-github-runner-207 kernel: [15200.597746] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 09:37:06 juju-e4d256-prod-github-runner-207 kernel: [15200.598809] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 09:37:06 juju-e4d256-prod-github-runner-207 kernel: [15200.599786] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 09:37:06 juju-e4d256-prod-github-runner-207 kernel: [15200.600789] handle_exit+0x98/0x230 [kvm_amd] Aug 22 09:37:06 juju-e4d256-prod-github-runner-207 kernel: [15200.601692] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 09:37:06 juju-e4d256-prod-github-runner-207 kernel: [15200.602635] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 09:37:06 juju-e4d256-prod-github-runner-207 kernel: [15200.603569] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 09:37:06 juju-e4d256-prod-github-runner-207 kernel: [15200.604488] vcpu_run+0x62/0x2c0 [kvm] Aug 22 09:37:06 juju-e4d256-prod-github-runner-207 kernel: [15200.605338] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 09:37:06 juju-e4d256-prod-github-runner-207 kernel: [15200.606198] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 09:37:06 juju-e4d256-prod-github-runner-207 kernel: [15200.607076] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 09:37:06 juju-e4d256-prod-github-runner-207 kernel: [15200.607888] ? __seccomp_filter+0x4a/0x4a0 Aug 22 09:37:06 juju-e4d256-prod-github-runner-207 kernel: [15200.608662] ? __fget_files+0x86/0xc0 Aug 22 09:37:06 juju-e4d256-prod-github-runner-207 kernel: [15200.609393] __x64_sys_ioctl+0x95/0xd0 Aug 22 09:37:06 juju-e4d256-prod-github-runner-207 kernel: [15200.610127] do_syscall_64+0x5c/0xc0 Aug 22 09:37:06 juju-e4d256-prod-github-runner-207 kernel: [15200.610815] ? do_futex+0x162/0x1f0 Aug 22 09:37:06 juju-e4d256-prod-github-runner-207 kernel: [15200.611482] ? __x64_sys_futex+0x78/0x1e0 Aug 22 09:37:06 juju-e4d256-prod-github-runner-207 kernel: [15200.612171] ? __secure_computing+0xa9/0x120 Aug 22 09:37:06 juju-e4d256-prod-github-runner-207 kernel: [15200.612891] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 09:37:06 juju-e4d256-prod-github-runner-207 kernel: [15200.613679] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:37:06 juju-e4d256-prod-github-runner-207 kernel: [15200.614441] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:37:06 juju-e4d256-prod-github-runner-207 kernel: [15200.615192] ? do_syscall_64+0x69/0xc0 Aug 22 09:37:06 juju-e4d256-prod-github-runner-207 kernel: [15200.615868] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:37:06 juju-e4d256-prod-github-runner-207 kernel: [15200.616595] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:37:06 juju-e4d256-prod-github-runner-207 kernel: [15200.617305] ? do_syscall_64+0x69/0xc0 Aug 22 09:37:06 juju-e4d256-prod-github-runner-207 kernel: [15200.617939] ? do_syscall_64+0x69/0xc0 Aug 22 09:37:06 juju-e4d256-prod-github-runner-207 kernel: [15200.618620] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 09:37:06 juju-e4d256-prod-github-runner-207 kernel: [15200.619351] RIP: 0033:0x7faa5d0edaff Aug 22 09:37:06 juju-e4d256-prod-github-runner-207 kernel: [15200.620043] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 09:37:06 juju-e4d256-prod-github-runner-207 kernel: [15200.622118] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 09:37:06 juju-e4d256-prod-github-runner-207 kernel: [15200.623068] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 09:37:06 juju-e4d256-prod-github-runner-207 kernel: [15200.623995] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 09:37:06 juju-e4d256-prod-github-runner-207 kernel: [15200.624900] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 09:37:06 juju-e4d256-prod-github-runner-207 kernel: [15200.625860] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 09:37:06 juju-e4d256-prod-github-runner-207 kernel: [15200.626852] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 09:37:06 juju-e4d256-prod-github-runner-207 kernel: [15200.627929] Aug 22 09:37:34 juju-e4d256-prod-github-runner-207 kernel: [15228.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 14074s! [qemu-system-x86:6715] Aug 22 09:37:34 juju-e4d256-prod-github-runner-207 kernel: [15228.543096] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 09:37:34 juju-e4d256-prod-github-runner-207 kernel: [15228.543169] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 09:37:34 juju-e4d256-prod-github-runner-207 kernel: [15228.555785] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 09:37:34 juju-e4d256-prod-github-runner-207 kernel: [15228.557064] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 09:37:34 juju-e4d256-prod-github-runner-207 kernel: [15228.558319] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:37:34 juju-e4d256-prod-github-runner-207 kernel: [15228.559391] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 09:37:34 juju-e4d256-prod-github-runner-207 kernel: [15228.561997] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 09:37:34 juju-e4d256-prod-github-runner-207 kernel: [15228.563052] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 09:37:34 juju-e4d256-prod-github-runner-207 kernel: [15228.564230] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 09:37:34 juju-e4d256-prod-github-runner-207 kernel: [15228.565402] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 09:37:34 juju-e4d256-prod-github-runner-207 kernel: [15228.566594] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 09:37:34 juju-e4d256-prod-github-runner-207 kernel: [15228.567777] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 09:37:34 juju-e4d256-prod-github-runner-207 kernel: [15228.568957] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 09:37:34 juju-e4d256-prod-github-runner-207 kernel: [15228.570224] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 09:37:34 juju-e4d256-prod-github-runner-207 kernel: [15228.571341] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 09:37:34 juju-e4d256-prod-github-runner-207 kernel: [15228.572553] Call Trace: Aug 22 09:37:34 juju-e4d256-prod-github-runner-207 kernel: [15228.573473] Aug 22 09:37:34 juju-e4d256-prod-github-runner-207 kernel: [15228.574382] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:37:34 juju-e4d256-prod-github-runner-207 kernel: [15228.575430] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:37:34 juju-e4d256-prod-github-runner-207 kernel: [15228.576458] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:37:34 juju-e4d256-prod-github-runner-207 kernel: [15228.577543] ? show_regs.part.0+0x23/0x29 Aug 22 09:37:34 juju-e4d256-prod-github-runner-207 kernel: [15228.578568] ? show_regs.cold+0x8/0xd Aug 22 09:37:34 juju-e4d256-prod-github-runner-207 kernel: [15228.579553] ? watchdog_timer_fn+0x1be/0x220 Aug 22 09:37:34 juju-e4d256-prod-github-runner-207 kernel: [15228.580571] ? lockup_detector_update_enable+0x60/0x60 Aug 22 09:37:34 juju-e4d256-prod-github-runner-207 kernel: [15228.581647] ? __hrtimer_run_queues+0x107/0x230 Aug 22 09:37:34 juju-e4d256-prod-github-runner-207 kernel: [15228.582704] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 09:37:34 juju-e4d256-prod-github-runner-207 kernel: [15228.583740] ? hrtimer_interrupt+0x101/0x220 Aug 22 09:37:34 juju-e4d256-prod-github-runner-207 kernel: [15228.584770] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 09:37:34 juju-e4d256-prod-github-runner-207 kernel: [15228.585869] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 09:37:34 juju-e4d256-prod-github-runner-207 kernel: [15228.586923] Aug 22 09:37:34 juju-e4d256-prod-github-runner-207 kernel: [15228.587784] Aug 22 09:37:34 juju-e4d256-prod-github-runner-207 kernel: [15228.588623] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 09:37:34 juju-e4d256-prod-github-runner-207 kernel: [15228.589670] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:37:34 juju-e4d256-prod-github-runner-207 kernel: [15228.590758] ? _raw_spin_lock+0x22/0x30 Aug 22 09:37:34 juju-e4d256-prod-github-runner-207 kernel: [15228.591712] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:37:34 juju-e4d256-prod-github-runner-207 kernel: [15228.592741] direct_page_fault+0x206/0x310 [kvm] Aug 22 09:37:34 juju-e4d256-prod-github-runner-207 kernel: [15228.593797] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 09:37:34 juju-e4d256-prod-github-runner-207 kernel: [15228.594890] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 09:37:34 juju-e4d256-prod-github-runner-207 kernel: [15228.595906] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 09:37:34 juju-e4d256-prod-github-runner-207 kernel: [15228.596893] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 09:37:34 juju-e4d256-prod-github-runner-207 kernel: [15228.597873] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 09:37:34 juju-e4d256-prod-github-runner-207 kernel: [15228.598870] handle_exit+0x98/0x230 [kvm_amd] Aug 22 09:37:34 juju-e4d256-prod-github-runner-207 kernel: [15228.599773] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 09:37:34 juju-e4d256-prod-github-runner-207 kernel: [15228.600699] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 09:37:34 juju-e4d256-prod-github-runner-207 kernel: [15228.601635] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 09:37:34 juju-e4d256-prod-github-runner-207 kernel: [15228.602575] vcpu_run+0x62/0x2c0 [kvm] Aug 22 09:37:34 juju-e4d256-prod-github-runner-207 kernel: [15228.603400] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 09:37:34 juju-e4d256-prod-github-runner-207 kernel: [15228.604227] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 09:37:34 juju-e4d256-prod-github-runner-207 kernel: [15228.605091] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 09:37:34 juju-e4d256-prod-github-runner-207 kernel: [15228.605978] ? __seccomp_filter+0x4a/0x4a0 Aug 22 09:37:34 juju-e4d256-prod-github-runner-207 kernel: [15228.606812] ? __fget_files+0x86/0xc0 Aug 22 09:37:34 juju-e4d256-prod-github-runner-207 kernel: [15228.607588] __x64_sys_ioctl+0x95/0xd0 Aug 22 09:37:34 juju-e4d256-prod-github-runner-207 kernel: [15228.608311] do_syscall_64+0x5c/0xc0 Aug 22 09:37:34 juju-e4d256-prod-github-runner-207 kernel: [15228.608999] ? do_futex+0x162/0x1f0 Aug 22 09:37:34 juju-e4d256-prod-github-runner-207 kernel: [15228.609725] ? __x64_sys_futex+0x78/0x1e0 Aug 22 09:37:34 juju-e4d256-prod-github-runner-207 kernel: [15228.610442] ? __secure_computing+0xa9/0x120 Aug 22 09:37:34 juju-e4d256-prod-github-runner-207 kernel: [15228.611168] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 09:37:34 juju-e4d256-prod-github-runner-207 kernel: [15228.612060] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:37:34 juju-e4d256-prod-github-runner-207 kernel: [15228.612855] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:37:34 juju-e4d256-prod-github-runner-207 kernel: [15228.613611] ? do_syscall_64+0x69/0xc0 Aug 22 09:37:34 juju-e4d256-prod-github-runner-207 kernel: [15228.614315] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:37:34 juju-e4d256-prod-github-runner-207 kernel: [15228.615068] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:37:34 juju-e4d256-prod-github-runner-207 kernel: [15228.615805] ? do_syscall_64+0x69/0xc0 Aug 22 09:37:34 juju-e4d256-prod-github-runner-207 kernel: [15228.616448] ? do_syscall_64+0x69/0xc0 Aug 22 09:37:34 juju-e4d256-prod-github-runner-207 kernel: [15228.617081] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 09:37:34 juju-e4d256-prod-github-runner-207 kernel: [15228.617827] RIP: 0033:0x7faa5d0edaff Aug 22 09:37:34 juju-e4d256-prod-github-runner-207 kernel: [15228.618468] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 09:37:34 juju-e4d256-prod-github-runner-207 kernel: [15228.620589] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 09:37:34 juju-e4d256-prod-github-runner-207 kernel: [15228.621529] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 09:37:34 juju-e4d256-prod-github-runner-207 kernel: [15228.622463] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 09:37:34 juju-e4d256-prod-github-runner-207 kernel: [15228.623418] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 09:37:34 juju-e4d256-prod-github-runner-207 kernel: [15228.624351] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 09:37:34 juju-e4d256-prod-github-runner-207 kernel: [15228.625262] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 09:37:34 juju-e4d256-prod-github-runner-207 kernel: [15228.626196] Aug 22 09:38:02 juju-e4d256-prod-github-runner-207 kernel: [15256.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 14100s! [qemu-system-x86:6715] Aug 22 09:38:02 juju-e4d256-prod-github-runner-207 kernel: [15256.543095] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 09:38:02 juju-e4d256-prod-github-runner-207 kernel: [15256.543170] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 09:38:02 juju-e4d256-prod-github-runner-207 kernel: [15256.555350] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 09:38:02 juju-e4d256-prod-github-runner-207 kernel: [15256.556616] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 09:38:02 juju-e4d256-prod-github-runner-207 kernel: [15256.557883] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:38:02 juju-e4d256-prod-github-runner-207 kernel: [15256.558958] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 09:38:02 juju-e4d256-prod-github-runner-207 kernel: [15256.561530] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 09:38:02 juju-e4d256-prod-github-runner-207 kernel: [15256.562600] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 09:38:02 juju-e4d256-prod-github-runner-207 kernel: [15256.563764] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 09:38:02 juju-e4d256-prod-github-runner-207 kernel: [15256.564931] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 09:38:02 juju-e4d256-prod-github-runner-207 kernel: [15256.566112] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 09:38:02 juju-e4d256-prod-github-runner-207 kernel: [15256.567278] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 09:38:02 juju-e4d256-prod-github-runner-207 kernel: [15256.568468] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 09:38:02 juju-e4d256-prod-github-runner-207 kernel: [15256.569757] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 09:38:02 juju-e4d256-prod-github-runner-207 kernel: [15256.570861] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 09:38:02 juju-e4d256-prod-github-runner-207 kernel: [15256.572081] Call Trace: Aug 22 09:38:02 juju-e4d256-prod-github-runner-207 kernel: [15256.573030] Aug 22 09:38:02 juju-e4d256-prod-github-runner-207 kernel: [15256.573957] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:38:02 juju-e4d256-prod-github-runner-207 kernel: [15256.575026] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:38:02 juju-e4d256-prod-github-runner-207 kernel: [15256.576098] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:38:02 juju-e4d256-prod-github-runner-207 kernel: [15256.577227] ? show_regs.part.0+0x23/0x29 Aug 22 09:38:02 juju-e4d256-prod-github-runner-207 kernel: [15256.578260] ? show_regs.cold+0x8/0xd Aug 22 09:38:02 juju-e4d256-prod-github-runner-207 kernel: [15256.579249] ? watchdog_timer_fn+0x1be/0x220 Aug 22 09:38:02 juju-e4d256-prod-github-runner-207 kernel: [15256.580313] ? lockup_detector_update_enable+0x60/0x60 Aug 22 09:38:02 juju-e4d256-prod-github-runner-207 kernel: [15256.581421] ? __hrtimer_run_queues+0x107/0x230 Aug 22 09:38:02 juju-e4d256-prod-github-runner-207 kernel: [15256.582461] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 09:38:02 juju-e4d256-prod-github-runner-207 kernel: [15256.583570] ? hrtimer_interrupt+0x101/0x220 Aug 22 09:38:02 juju-e4d256-prod-github-runner-207 kernel: [15256.584617] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 09:38:02 juju-e4d256-prod-github-runner-207 kernel: [15256.585719] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 09:38:02 juju-e4d256-prod-github-runner-207 kernel: [15256.586770] Aug 22 09:38:02 juju-e4d256-prod-github-runner-207 kernel: [15256.587624] Aug 22 09:38:02 juju-e4d256-prod-github-runner-207 kernel: [15256.588474] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 09:38:02 juju-e4d256-prod-github-runner-207 kernel: [15256.589589] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:38:02 juju-e4d256-prod-github-runner-207 kernel: [15256.590635] ? _raw_spin_lock+0x22/0x30 Aug 22 09:38:02 juju-e4d256-prod-github-runner-207 kernel: [15256.591584] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:38:02 juju-e4d256-prod-github-runner-207 kernel: [15256.592610] direct_page_fault+0x206/0x310 [kvm] Aug 22 09:38:02 juju-e4d256-prod-github-runner-207 kernel: [15256.593688] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 09:38:02 juju-e4d256-prod-github-runner-207 kernel: [15256.594707] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 09:38:02 juju-e4d256-prod-github-runner-207 kernel: [15256.595716] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 09:38:02 juju-e4d256-prod-github-runner-207 kernel: [15256.596693] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 09:38:02 juju-e4d256-prod-github-runner-207 kernel: [15256.597704] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 09:38:02 juju-e4d256-prod-github-runner-207 kernel: [15256.598777] handle_exit+0x98/0x230 [kvm_amd] Aug 22 09:38:02 juju-e4d256-prod-github-runner-207 kernel: [15256.599998] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 09:38:02 juju-e4d256-prod-github-runner-207 kernel: [15256.601204] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 09:38:02 juju-e4d256-prod-github-runner-207 kernel: [15256.602423] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 09:38:02 juju-e4d256-prod-github-runner-207 kernel: [15256.603609] vcpu_run+0x62/0x2c0 [kvm] Aug 22 09:38:02 juju-e4d256-prod-github-runner-207 kernel: [15256.604733] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 09:38:02 juju-e4d256-prod-github-runner-207 kernel: [15256.605829] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 09:38:02 juju-e4d256-prod-github-runner-207 kernel: [15256.606958] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 09:38:02 juju-e4d256-prod-github-runner-207 kernel: [15256.608007] ? __seccomp_filter+0x4a/0x4a0 Aug 22 09:38:02 juju-e4d256-prod-github-runner-207 kernel: [15256.608986] ? __fget_files+0x86/0xc0 Aug 22 09:38:02 juju-e4d256-prod-github-runner-207 kernel: [15256.610070] __x64_sys_ioctl+0x95/0xd0 Aug 22 09:38:02 juju-e4d256-prod-github-runner-207 kernel: [15256.612241] do_syscall_64+0x5c/0xc0 Aug 22 09:38:02 juju-e4d256-prod-github-runner-207 kernel: [15256.613160] ? do_futex+0x162/0x1f0 Aug 22 09:38:02 juju-e4d256-prod-github-runner-207 kernel: [15256.614023] ? __x64_sys_futex+0x78/0x1e0 Aug 22 09:38:02 juju-e4d256-prod-github-runner-207 kernel: [15256.614962] ? __secure_computing+0xa9/0x120 Aug 22 09:38:02 juju-e4d256-prod-github-runner-207 kernel: [15256.615878] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 09:38:02 juju-e4d256-prod-github-runner-207 kernel: [15256.616919] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:38:02 juju-e4d256-prod-github-runner-207 kernel: [15256.617847] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:38:02 juju-e4d256-prod-github-runner-207 kernel: [15256.618718] ? do_syscall_64+0x69/0xc0 Aug 22 09:38:02 juju-e4d256-prod-github-runner-207 kernel: [15256.619472] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:38:02 juju-e4d256-prod-github-runner-207 kernel: [15256.620448] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:38:02 juju-e4d256-prod-github-runner-207 kernel: [15256.621513] ? do_syscall_64+0x69/0xc0 Aug 22 09:38:02 juju-e4d256-prod-github-runner-207 kernel: [15256.622268] ? do_syscall_64+0x69/0xc0 Aug 22 09:38:02 juju-e4d256-prod-github-runner-207 kernel: [15256.623026] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 09:38:02 juju-e4d256-prod-github-runner-207 kernel: [15256.623902] RIP: 0033:0x7faa5d0edaff Aug 22 09:38:02 juju-e4d256-prod-github-runner-207 kernel: [15256.624635] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 09:38:02 juju-e4d256-prod-github-runner-207 kernel: [15256.626724] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 09:38:02 juju-e4d256-prod-github-runner-207 kernel: [15256.627653] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 09:38:02 juju-e4d256-prod-github-runner-207 kernel: [15256.628700] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 09:38:02 juju-e4d256-prod-github-runner-207 kernel: [15256.629764] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 09:38:02 juju-e4d256-prod-github-runner-207 kernel: [15256.630793] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 09:38:02 juju-e4d256-prod-github-runner-207 kernel: [15256.631840] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 09:38:02 juju-e4d256-prod-github-runner-207 kernel: [15256.632898] Aug 22 09:38:30 juju-e4d256-prod-github-runner-207 kernel: [15284.541980] watchdog: BUG: soft lockup - CPU#1 stuck for 14126s! [qemu-system-x86:6715] Aug 22 09:38:30 juju-e4d256-prod-github-runner-207 kernel: [15284.544270] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 09:38:30 juju-e4d256-prod-github-runner-207 kernel: [15284.544611] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 09:38:30 juju-e4d256-prod-github-runner-207 kernel: [15284.559787] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 09:38:30 juju-e4d256-prod-github-runner-207 kernel: [15284.561375] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 09:38:30 juju-e4d256-prod-github-runner-207 kernel: [15284.562702] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:38:30 juju-e4d256-prod-github-runner-207 kernel: [15284.563955] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 09:38:30 juju-e4d256-prod-github-runner-207 kernel: [15284.567492] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 09:38:30 juju-e4d256-prod-github-runner-207 kernel: [15284.568807] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 09:38:30 juju-e4d256-prod-github-runner-207 kernel: [15284.570176] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 09:38:30 juju-e4d256-prod-github-runner-207 kernel: [15284.571868] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 09:38:30 juju-e4d256-prod-github-runner-207 kernel: [15284.573348] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 09:38:30 juju-e4d256-prod-github-runner-207 kernel: [15284.574517] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 09:38:30 juju-e4d256-prod-github-runner-207 kernel: [15284.575715] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 09:38:30 juju-e4d256-prod-github-runner-207 kernel: [15284.577065] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 09:38:30 juju-e4d256-prod-github-runner-207 kernel: [15284.578202] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 09:38:30 juju-e4d256-prod-github-runner-207 kernel: [15284.579425] Call Trace: Aug 22 09:38:30 juju-e4d256-prod-github-runner-207 kernel: [15284.580371] Aug 22 09:38:30 juju-e4d256-prod-github-runner-207 kernel: [15284.581343] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:38:30 juju-e4d256-prod-github-runner-207 kernel: [15284.582401] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:38:30 juju-e4d256-prod-github-runner-207 kernel: [15284.583464] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:38:30 juju-e4d256-prod-github-runner-207 kernel: [15284.584634] ? show_regs.part.0+0x23/0x29 Aug 22 09:38:30 juju-e4d256-prod-github-runner-207 kernel: [15284.585668] ? show_regs.cold+0x8/0xd Aug 22 09:38:30 juju-e4d256-prod-github-runner-207 kernel: [15284.586734] ? watchdog_timer_fn+0x1be/0x220 Aug 22 09:38:30 juju-e4d256-prod-github-runner-207 kernel: [15284.587832] ? lockup_detector_update_enable+0x60/0x60 Aug 22 09:38:30 juju-e4d256-prod-github-runner-207 kernel: [15284.589012] ? __hrtimer_run_queues+0x107/0x230 Aug 22 09:38:30 juju-e4d256-prod-github-runner-207 kernel: [15284.590128] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 09:38:30 juju-e4d256-prod-github-runner-207 kernel: [15284.591242] ? hrtimer_interrupt+0x101/0x220 Aug 22 09:38:30 juju-e4d256-prod-github-runner-207 kernel: [15284.592340] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 09:38:30 juju-e4d256-prod-github-runner-207 kernel: [15284.593538] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 09:38:30 juju-e4d256-prod-github-runner-207 kernel: [15284.594693] Aug 22 09:38:30 juju-e4d256-prod-github-runner-207 kernel: [15284.595604] Aug 22 09:38:30 juju-e4d256-prod-github-runner-207 kernel: [15284.596491] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 09:38:30 juju-e4d256-prod-github-runner-207 kernel: [15284.597645] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:38:30 juju-e4d256-prod-github-runner-207 kernel: [15284.598789] ? _raw_spin_lock+0x22/0x30 Aug 22 09:38:30 juju-e4d256-prod-github-runner-207 kernel: [15284.599831] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:38:30 juju-e4d256-prod-github-runner-207 kernel: [15284.600947] direct_page_fault+0x206/0x310 [kvm] Aug 22 09:38:30 juju-e4d256-prod-github-runner-207 kernel: [15284.602313] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 09:38:30 juju-e4d256-prod-github-runner-207 kernel: [15284.603429] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 09:38:30 juju-e4d256-prod-github-runner-207 kernel: [15284.604529] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 09:38:30 juju-e4d256-prod-github-runner-207 kernel: [15284.605676] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 09:38:30 juju-e4d256-prod-github-runner-207 kernel: [15284.606733] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 09:38:30 juju-e4d256-prod-github-runner-207 kernel: [15284.607853] handle_exit+0x98/0x230 [kvm_amd] Aug 22 09:38:30 juju-e4d256-prod-github-runner-207 kernel: [15284.608848] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 09:38:30 juju-e4d256-prod-github-runner-207 kernel: [15284.609887] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 09:38:30 juju-e4d256-prod-github-runner-207 kernel: [15284.610933] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 09:38:30 juju-e4d256-prod-github-runner-207 kernel: [15284.611972] vcpu_run+0x62/0x2c0 [kvm] Aug 22 09:38:30 juju-e4d256-prod-github-runner-207 kernel: [15284.612872] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 09:38:30 juju-e4d256-prod-github-runner-207 kernel: [15284.613793] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 09:38:30 juju-e4d256-prod-github-runner-207 kernel: [15284.614779] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 09:38:30 juju-e4d256-prod-github-runner-207 kernel: [15284.615690] ? __seccomp_filter+0x4a/0x4a0 Aug 22 09:38:30 juju-e4d256-prod-github-runner-207 kernel: [15284.616521] ? __fget_files+0x86/0xc0 Aug 22 09:38:30 juju-e4d256-prod-github-runner-207 kernel: [15284.617332] __x64_sys_ioctl+0x95/0xd0 Aug 22 09:38:30 juju-e4d256-prod-github-runner-207 kernel: [15284.618107] do_syscall_64+0x5c/0xc0 Aug 22 09:38:30 juju-e4d256-prod-github-runner-207 kernel: [15284.618846] ? do_futex+0x162/0x1f0 Aug 22 09:38:30 juju-e4d256-prod-github-runner-207 kernel: [15284.619573] ? __x64_sys_futex+0x78/0x1e0 Aug 22 09:38:30 juju-e4d256-prod-github-runner-207 kernel: [15284.620329] ? __secure_computing+0xa9/0x120 Aug 22 09:38:30 juju-e4d256-prod-github-runner-207 kernel: [15284.621136] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 09:38:30 juju-e4d256-prod-github-runner-207 kernel: [15284.622003] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:38:30 juju-e4d256-prod-github-runner-207 kernel: [15284.622829] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:38:30 juju-e4d256-prod-github-runner-207 kernel: [15284.623648] ? do_syscall_64+0x69/0xc0 Aug 22 09:38:30 juju-e4d256-prod-github-runner-207 kernel: [15284.624376] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:38:30 juju-e4d256-prod-github-runner-207 kernel: [15284.625226] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:38:30 juju-e4d256-prod-github-runner-207 kernel: [15284.625947] ? do_syscall_64+0x69/0xc0 Aug 22 09:38:30 juju-e4d256-prod-github-runner-207 kernel: [15284.626587] ? do_syscall_64+0x69/0xc0 Aug 22 09:38:30 juju-e4d256-prod-github-runner-207 kernel: [15284.627213] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 09:38:30 juju-e4d256-prod-github-runner-207 kernel: [15284.628106] RIP: 0033:0x7faa5d0edaff Aug 22 09:38:30 juju-e4d256-prod-github-runner-207 kernel: [15284.628771] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 09:38:30 juju-e4d256-prod-github-runner-207 kernel: [15284.630797] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 09:38:30 juju-e4d256-prod-github-runner-207 kernel: [15284.631719] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 09:38:30 juju-e4d256-prod-github-runner-207 kernel: [15284.632621] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 09:38:30 juju-e4d256-prod-github-runner-207 kernel: [15284.633530] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 09:38:30 juju-e4d256-prod-github-runner-207 kernel: [15284.634434] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 09:38:30 juju-e4d256-prod-github-runner-207 kernel: [15284.635332] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 09:38:30 juju-e4d256-prod-github-runner-207 kernel: [15284.636230] Aug 22 09:38:44 juju-e4d256-prod-github-runner-207 kernel: [15298.208707] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 09:38:44 juju-e4d256-prod-github-runner-207 kernel: [15298.209677] rcu: 1-....: (3783369 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=1826986 Aug 22 09:38:44 juju-e4d256-prod-github-runner-207 kernel: [15298.210811] (t=3795252 jiffies g=23269 q=22568) Aug 22 09:38:44 juju-e4d256-prod-github-runner-207 kernel: [15298.211604] NMI backtrace for cpu 1 Aug 22 09:38:44 juju-e4d256-prod-github-runner-207 kernel: [15298.212320] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 09:38:44 juju-e4d256-prod-github-runner-207 kernel: [15298.213467] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 09:38:44 juju-e4d256-prod-github-runner-207 kernel: [15298.214532] Call Trace: Aug 22 09:38:44 juju-e4d256-prod-github-runner-207 kernel: [15298.215206] Aug 22 09:38:44 juju-e4d256-prod-github-runner-207 kernel: [15298.215848] show_stack+0x52/0x5c Aug 22 09:38:44 juju-e4d256-prod-github-runner-207 kernel: [15298.216574] dump_stack_lvl+0x4a/0x63 Aug 22 09:38:44 juju-e4d256-prod-github-runner-207 kernel: [15298.217328] dump_stack+0x10/0x16 Aug 22 09:38:44 juju-e4d256-prod-github-runner-207 kernel: [15298.218045] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 09:38:44 juju-e4d256-prod-github-runner-207 kernel: [15298.218828] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 09:38:44 juju-e4d256-prod-github-runner-207 kernel: [15298.219608] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 09:38:44 juju-e4d256-prod-github-runner-207 kernel: [15298.220424] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 09:38:44 juju-e4d256-prod-github-runner-207 kernel: [15298.221297] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 09:38:44 juju-e4d256-prod-github-runner-207 kernel: [15298.222141] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 09:38:44 juju-e4d256-prod-github-runner-207 kernel: [15298.222915] print_cpu_stall.cold+0x2f/0xe2 Aug 22 09:38:44 juju-e4d256-prod-github-runner-207 kernel: [15298.223690] ? timekeeping_update+0xf7/0x150 Aug 22 09:38:44 juju-e4d256-prod-github-runner-207 kernel: [15298.224478] check_cpu_stall+0x109/0x270 Aug 22 09:38:44 juju-e4d256-prod-github-runner-207 kernel: [15298.225271] rcu_sched_clock_irq+0x9a/0x250 Aug 22 09:38:44 juju-e4d256-prod-github-runner-207 kernel: [15298.226037] update_process_times+0x94/0xd0 Aug 22 09:38:44 juju-e4d256-prod-github-runner-207 kernel: [15298.226797] tick_sched_handle+0x29/0x70 Aug 22 09:38:44 juju-e4d256-prod-github-runner-207 kernel: [15298.227546] tick_sched_timer+0x8c/0xc0 Aug 22 09:38:44 juju-e4d256-prod-github-runner-207 kernel: [15298.228281] ? tick_nohz_handler+0xb0/0xb0 Aug 22 09:38:44 juju-e4d256-prod-github-runner-207 kernel: [15298.229044] __hrtimer_run_queues+0x107/0x230 Aug 22 09:38:44 juju-e4d256-prod-github-runner-207 kernel: [15298.229816] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 09:38:44 juju-e4d256-prod-github-runner-207 kernel: [15298.230595] hrtimer_interrupt+0x101/0x220 Aug 22 09:38:44 juju-e4d256-prod-github-runner-207 kernel: [15298.231380] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 09:38:44 juju-e4d256-prod-github-runner-207 kernel: [15298.232197] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 09:38:44 juju-e4d256-prod-github-runner-207 kernel: [15298.233015] Aug 22 09:38:44 juju-e4d256-prod-github-runner-207 kernel: [15298.233659] Aug 22 09:38:44 juju-e4d256-prod-github-runner-207 kernel: [15298.234286] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 09:38:44 juju-e4d256-prod-github-runner-207 kernel: [15298.235101] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:38:44 juju-e4d256-prod-github-runner-207 kernel: [15298.235982] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 09:38:44 juju-e4d256-prod-github-runner-207 kernel: [15298.238202] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 09:38:44 juju-e4d256-prod-github-runner-207 kernel: [15298.239088] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 09:38:44 juju-e4d256-prod-github-runner-207 kernel: [15298.240080] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 09:38:44 juju-e4d256-prod-github-runner-207 kernel: [15298.241078] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 09:38:44 juju-e4d256-prod-github-runner-207 kernel: [15298.242039] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 09:38:44 juju-e4d256-prod-github-runner-207 kernel: [15298.242996] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 09:38:44 juju-e4d256-prod-github-runner-207 kernel: [15298.243955] ? _raw_spin_lock+0x22/0x30 Aug 22 09:38:44 juju-e4d256-prod-github-runner-207 kernel: [15298.244712] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:38:44 juju-e4d256-prod-github-runner-207 kernel: [15298.245568] direct_page_fault+0x206/0x310 [kvm] Aug 22 09:38:44 juju-e4d256-prod-github-runner-207 kernel: [15298.246419] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 09:38:44 juju-e4d256-prod-github-runner-207 kernel: [15298.247245] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 09:38:44 juju-e4d256-prod-github-runner-207 kernel: [15298.248068] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 09:38:44 juju-e4d256-prod-github-runner-207 kernel: [15298.248892] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 09:38:44 juju-e4d256-prod-github-runner-207 kernel: [15298.249680] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 09:38:44 juju-e4d256-prod-github-runner-207 kernel: [15298.250500] handle_exit+0x98/0x230 [kvm_amd] Aug 22 09:38:44 juju-e4d256-prod-github-runner-207 kernel: [15298.251253] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 09:38:44 juju-e4d256-prod-github-runner-207 kernel: [15298.252037] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 09:38:44 juju-e4d256-prod-github-runner-207 kernel: [15298.252848] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 09:38:44 juju-e4d256-prod-github-runner-207 kernel: [15298.253650] vcpu_run+0x62/0x2c0 [kvm] Aug 22 09:38:44 juju-e4d256-prod-github-runner-207 kernel: [15298.254376] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 09:38:44 juju-e4d256-prod-github-runner-207 kernel: [15298.255126] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 09:38:44 juju-e4d256-prod-github-runner-207 kernel: [15298.255924] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 09:38:44 juju-e4d256-prod-github-runner-207 kernel: [15298.256685] ? __seccomp_filter+0x4a/0x4a0 Aug 22 09:38:44 juju-e4d256-prod-github-runner-207 kernel: [15298.257425] ? __fget_files+0x86/0xc0 Aug 22 09:38:44 juju-e4d256-prod-github-runner-207 kernel: [15298.258114] __x64_sys_ioctl+0x95/0xd0 Aug 22 09:38:44 juju-e4d256-prod-github-runner-207 kernel: [15298.258814] do_syscall_64+0x5c/0xc0 Aug 22 09:38:44 juju-e4d256-prod-github-runner-207 kernel: [15298.259556] ? do_futex+0x162/0x1f0 Aug 22 09:38:44 juju-e4d256-prod-github-runner-207 kernel: [15298.260231] ? __x64_sys_futex+0x78/0x1e0 Aug 22 09:38:44 juju-e4d256-prod-github-runner-207 kernel: [15298.260950] ? __secure_computing+0xa9/0x120 Aug 22 09:38:44 juju-e4d256-prod-github-runner-207 kernel: [15298.261667] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 09:38:44 juju-e4d256-prod-github-runner-207 kernel: [15298.262459] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:38:44 juju-e4d256-prod-github-runner-207 kernel: [15298.263211] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:38:44 juju-e4d256-prod-github-runner-207 kernel: [15298.263964] ? do_syscall_64+0x69/0xc0 Aug 22 09:38:44 juju-e4d256-prod-github-runner-207 kernel: [15298.264654] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:38:44 juju-e4d256-prod-github-runner-207 kernel: [15298.265425] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:38:44 juju-e4d256-prod-github-runner-207 kernel: [15298.266191] ? do_syscall_64+0x69/0xc0 Aug 22 09:38:44 juju-e4d256-prod-github-runner-207 kernel: [15298.266889] ? do_syscall_64+0x69/0xc0 Aug 22 09:38:44 juju-e4d256-prod-github-runner-207 kernel: [15298.267588] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 09:38:44 juju-e4d256-prod-github-runner-207 kernel: [15298.268353] RIP: 0033:0x7faa5d0edaff Aug 22 09:38:44 juju-e4d256-prod-github-runner-207 kernel: [15298.269061] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 09:38:44 juju-e4d256-prod-github-runner-207 kernel: [15298.271156] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 09:38:44 juju-e4d256-prod-github-runner-207 kernel: [15298.272111] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 09:38:44 juju-e4d256-prod-github-runner-207 kernel: [15298.273075] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 09:38:44 juju-e4d256-prod-github-runner-207 kernel: [15298.274029] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 09:38:44 juju-e4d256-prod-github-runner-207 kernel: [15298.274972] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 09:38:44 juju-e4d256-prod-github-runner-207 kernel: [15298.275896] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 09:38:44 juju-e4d256-prod-github-runner-207 kernel: [15298.276816] Aug 22 09:39:10 juju-e4d256-prod-github-runner-207 kernel: [15324.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 14164s! [qemu-system-x86:6715] Aug 22 09:39:10 juju-e4d256-prod-github-runner-207 kernel: [15324.543446] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 09:39:10 juju-e4d256-prod-github-runner-207 kernel: [15324.543528] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 09:39:10 juju-e4d256-prod-github-runner-207 kernel: [15324.556237] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 09:39:10 juju-e4d256-prod-github-runner-207 kernel: [15324.557537] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 09:39:10 juju-e4d256-prod-github-runner-207 kernel: [15324.558780] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:39:10 juju-e4d256-prod-github-runner-207 kernel: [15324.559847] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 09:39:10 juju-e4d256-prod-github-runner-207 kernel: [15324.562449] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 09:39:10 juju-e4d256-prod-github-runner-207 kernel: [15324.563508] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 09:39:10 juju-e4d256-prod-github-runner-207 kernel: [15324.564733] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 09:39:10 juju-e4d256-prod-github-runner-207 kernel: [15324.565906] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 09:39:10 juju-e4d256-prod-github-runner-207 kernel: [15324.567127] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 09:39:10 juju-e4d256-prod-github-runner-207 kernel: [15324.568325] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 09:39:10 juju-e4d256-prod-github-runner-207 kernel: [15324.569518] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 09:39:10 juju-e4d256-prod-github-runner-207 kernel: [15324.570768] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 09:39:10 juju-e4d256-prod-github-runner-207 kernel: [15324.571883] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 09:39:10 juju-e4d256-prod-github-runner-207 kernel: [15324.573101] Call Trace: Aug 22 09:39:10 juju-e4d256-prod-github-runner-207 kernel: [15324.574019] Aug 22 09:39:10 juju-e4d256-prod-github-runner-207 kernel: [15324.574907] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:39:10 juju-e4d256-prod-github-runner-207 kernel: [15324.575946] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:39:10 juju-e4d256-prod-github-runner-207 kernel: [15324.576984] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:39:10 juju-e4d256-prod-github-runner-207 kernel: [15324.578067] ? show_regs.part.0+0x23/0x29 Aug 22 09:39:10 juju-e4d256-prod-github-runner-207 kernel: [15324.579071] ? show_regs.cold+0x8/0xd Aug 22 09:39:10 juju-e4d256-prod-github-runner-207 kernel: [15324.580049] ? watchdog_timer_fn+0x1be/0x220 Aug 22 09:39:10 juju-e4d256-prod-github-runner-207 kernel: [15324.581075] ? lockup_detector_update_enable+0x60/0x60 Aug 22 09:39:10 juju-e4d256-prod-github-runner-207 kernel: [15324.582154] ? __hrtimer_run_queues+0x107/0x230 Aug 22 09:39:10 juju-e4d256-prod-github-runner-207 kernel: [15324.583190] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 09:39:10 juju-e4d256-prod-github-runner-207 kernel: [15324.584223] ? hrtimer_interrupt+0x101/0x220 Aug 22 09:39:10 juju-e4d256-prod-github-runner-207 kernel: [15324.585259] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 09:39:10 juju-e4d256-prod-github-runner-207 kernel: [15324.586338] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 09:39:10 juju-e4d256-prod-github-runner-207 kernel: [15324.587398] Aug 22 09:39:10 juju-e4d256-prod-github-runner-207 kernel: [15324.588255] Aug 22 09:39:10 juju-e4d256-prod-github-runner-207 kernel: [15324.589100] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 09:39:10 juju-e4d256-prod-github-runner-207 kernel: [15324.590177] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:39:10 juju-e4d256-prod-github-runner-207 kernel: [15324.591233] ? _raw_spin_lock+0x22/0x30 Aug 22 09:39:10 juju-e4d256-prod-github-runner-207 kernel: [15324.592207] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:39:10 juju-e4d256-prod-github-runner-207 kernel: [15324.593275] direct_page_fault+0x206/0x310 [kvm] Aug 22 09:39:10 juju-e4d256-prod-github-runner-207 kernel: [15324.594307] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 09:39:10 juju-e4d256-prod-github-runner-207 kernel: [15324.595323] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 09:39:10 juju-e4d256-prod-github-runner-207 kernel: [15324.596335] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 09:39:10 juju-e4d256-prod-github-runner-207 kernel: [15324.597329] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 09:39:10 juju-e4d256-prod-github-runner-207 kernel: [15324.598283] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 09:39:10 juju-e4d256-prod-github-runner-207 kernel: [15324.599273] handle_exit+0x98/0x230 [kvm_amd] Aug 22 09:39:10 juju-e4d256-prod-github-runner-207 kernel: [15324.600193] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 09:39:10 juju-e4d256-prod-github-runner-207 kernel: [15324.601141] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 09:39:10 juju-e4d256-prod-github-runner-207 kernel: [15324.602087] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 09:39:10 juju-e4d256-prod-github-runner-207 kernel: [15324.603027] vcpu_run+0x62/0x2c0 [kvm] Aug 22 09:39:10 juju-e4d256-prod-github-runner-207 kernel: [15324.603847] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 09:39:10 juju-e4d256-prod-github-runner-207 kernel: [15324.604682] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 09:39:10 juju-e4d256-prod-github-runner-207 kernel: [15324.605551] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 09:39:10 juju-e4d256-prod-github-runner-207 kernel: [15324.606362] ? __seccomp_filter+0x4a/0x4a0 Aug 22 09:39:10 juju-e4d256-prod-github-runner-207 kernel: [15324.607113] ? __fget_files+0x86/0xc0 Aug 22 09:39:10 juju-e4d256-prod-github-runner-207 kernel: [15324.607825] __x64_sys_ioctl+0x95/0xd0 Aug 22 09:39:10 juju-e4d256-prod-github-runner-207 kernel: [15324.608542] do_syscall_64+0x5c/0xc0 Aug 22 09:39:10 juju-e4d256-prod-github-runner-207 kernel: [15324.609218] ? do_futex+0x162/0x1f0 Aug 22 09:39:10 juju-e4d256-prod-github-runner-207 kernel: [15324.609875] ? __x64_sys_futex+0x78/0x1e0 Aug 22 09:39:10 juju-e4d256-prod-github-runner-207 kernel: [15324.610556] ? __secure_computing+0xa9/0x120 Aug 22 09:39:10 juju-e4d256-prod-github-runner-207 kernel: [15324.611252] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 09:39:10 juju-e4d256-prod-github-runner-207 kernel: [15324.612018] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:39:10 juju-e4d256-prod-github-runner-207 kernel: [15324.612772] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:39:10 juju-e4d256-prod-github-runner-207 kernel: [15324.613499] ? do_syscall_64+0x69/0xc0 Aug 22 09:39:10 juju-e4d256-prod-github-runner-207 kernel: [15324.614150] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:39:10 juju-e4d256-prod-github-runner-207 kernel: [15324.614860] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:39:10 juju-e4d256-prod-github-runner-207 kernel: [15324.615560] ? do_syscall_64+0x69/0xc0 Aug 22 09:39:10 juju-e4d256-prod-github-runner-207 kernel: [15324.616190] ? do_syscall_64+0x69/0xc0 Aug 22 09:39:10 juju-e4d256-prod-github-runner-207 kernel: [15324.616837] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 09:39:10 juju-e4d256-prod-github-runner-207 kernel: [15324.617549] RIP: 0033:0x7faa5d0edaff Aug 22 09:39:10 juju-e4d256-prod-github-runner-207 kernel: [15324.618183] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 09:39:10 juju-e4d256-prod-github-runner-207 kernel: [15324.620210] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 09:39:10 juju-e4d256-prod-github-runner-207 kernel: [15324.621142] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 09:39:10 juju-e4d256-prod-github-runner-207 kernel: [15324.622060] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 09:39:10 juju-e4d256-prod-github-runner-207 kernel: [15324.622968] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 09:39:10 juju-e4d256-prod-github-runner-207 kernel: [15324.623865] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 09:39:10 juju-e4d256-prod-github-runner-207 kernel: [15324.624788] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 09:39:10 juju-e4d256-prod-github-runner-207 kernel: [15324.625697] Aug 22 09:39:38 juju-e4d256-prod-github-runner-207 kernel: [15352.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 14190s! [qemu-system-x86:6715] Aug 22 09:39:38 juju-e4d256-prod-github-runner-207 kernel: [15352.543098] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 09:39:38 juju-e4d256-prod-github-runner-207 kernel: [15352.543173] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 09:39:38 juju-e4d256-prod-github-runner-207 kernel: [15352.555281] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 09:39:38 juju-e4d256-prod-github-runner-207 kernel: [15352.556554] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 09:39:38 juju-e4d256-prod-github-runner-207 kernel: [15352.557770] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:39:38 juju-e4d256-prod-github-runner-207 kernel: [15352.558833] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 09:39:38 juju-e4d256-prod-github-runner-207 kernel: [15352.561399] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 09:39:38 juju-e4d256-prod-github-runner-207 kernel: [15352.562444] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 09:39:38 juju-e4d256-prod-github-runner-207 kernel: [15352.563608] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 09:39:38 juju-e4d256-prod-github-runner-207 kernel: [15352.564774] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 09:39:38 juju-e4d256-prod-github-runner-207 kernel: [15352.565937] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 09:39:38 juju-e4d256-prod-github-runner-207 kernel: [15352.567095] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 09:39:38 juju-e4d256-prod-github-runner-207 kernel: [15352.568267] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 09:39:38 juju-e4d256-prod-github-runner-207 kernel: [15352.569497] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 09:39:38 juju-e4d256-prod-github-runner-207 kernel: [15352.570593] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 09:39:38 juju-e4d256-prod-github-runner-207 kernel: [15352.571783] Call Trace: Aug 22 09:39:38 juju-e4d256-prod-github-runner-207 kernel: [15352.572701] Aug 22 09:39:38 juju-e4d256-prod-github-runner-207 kernel: [15352.573584] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:39:38 juju-e4d256-prod-github-runner-207 kernel: [15352.574617] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:39:38 juju-e4d256-prod-github-runner-207 kernel: [15352.575635] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:39:38 juju-e4d256-prod-github-runner-207 kernel: [15352.576726] ? show_regs.part.0+0x23/0x29 Aug 22 09:39:38 juju-e4d256-prod-github-runner-207 kernel: [15352.577722] ? show_regs.cold+0x8/0xd Aug 22 09:39:38 juju-e4d256-prod-github-runner-207 kernel: [15352.578690] ? watchdog_timer_fn+0x1be/0x220 Aug 22 09:39:38 juju-e4d256-prod-github-runner-207 kernel: [15352.579724] ? lockup_detector_update_enable+0x60/0x60 Aug 22 09:39:38 juju-e4d256-prod-github-runner-207 kernel: [15352.580810] ? __hrtimer_run_queues+0x107/0x230 Aug 22 09:39:38 juju-e4d256-prod-github-runner-207 kernel: [15352.581856] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 09:39:38 juju-e4d256-prod-github-runner-207 kernel: [15352.582893] ? hrtimer_interrupt+0x101/0x220 Aug 22 09:39:38 juju-e4d256-prod-github-runner-207 kernel: [15352.583907] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 09:39:38 juju-e4d256-prod-github-runner-207 kernel: [15352.584985] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 09:39:38 juju-e4d256-prod-github-runner-207 kernel: [15352.586033] Aug 22 09:39:38 juju-e4d256-prod-github-runner-207 kernel: [15352.586887] Aug 22 09:39:38 juju-e4d256-prod-github-runner-207 kernel: [15352.587723] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 09:39:38 juju-e4d256-prod-github-runner-207 kernel: [15352.588767] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:39:38 juju-e4d256-prod-github-runner-207 kernel: [15352.589811] ? _raw_spin_lock+0x22/0x30 Aug 22 09:39:38 juju-e4d256-prod-github-runner-207 kernel: [15352.590759] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:39:38 juju-e4d256-prod-github-runner-207 kernel: [15352.591778] direct_page_fault+0x206/0x310 [kvm] Aug 22 09:39:38 juju-e4d256-prod-github-runner-207 kernel: [15352.592816] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 09:39:38 juju-e4d256-prod-github-runner-207 kernel: [15352.593828] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 09:39:38 juju-e4d256-prod-github-runner-207 kernel: [15352.594826] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 09:39:38 juju-e4d256-prod-github-runner-207 kernel: [15352.595809] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 09:39:38 juju-e4d256-prod-github-runner-207 kernel: [15352.596767] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 09:39:38 juju-e4d256-prod-github-runner-207 kernel: [15352.597747] handle_exit+0x98/0x230 [kvm_amd] Aug 22 09:39:38 juju-e4d256-prod-github-runner-207 kernel: [15352.598643] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 09:39:38 juju-e4d256-prod-github-runner-207 kernel: [15352.599556] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 09:39:38 juju-e4d256-prod-github-runner-207 kernel: [15352.600494] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 09:39:38 juju-e4d256-prod-github-runner-207 kernel: [15352.601397] vcpu_run+0x62/0x2c0 [kvm] Aug 22 09:39:38 juju-e4d256-prod-github-runner-207 kernel: [15352.602214] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 09:39:38 juju-e4d256-prod-github-runner-207 kernel: [15352.603028] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 09:39:38 juju-e4d256-prod-github-runner-207 kernel: [15352.603897] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 09:39:38 juju-e4d256-prod-github-runner-207 kernel: [15352.604710] ? __seccomp_filter+0x4a/0x4a0 Aug 22 09:39:38 juju-e4d256-prod-github-runner-207 kernel: [15352.605451] ? __fget_files+0x86/0xc0 Aug 22 09:39:38 juju-e4d256-prod-github-runner-207 kernel: [15352.606162] __x64_sys_ioctl+0x95/0xd0 Aug 22 09:39:38 juju-e4d256-prod-github-runner-207 kernel: [15352.606853] do_syscall_64+0x5c/0xc0 Aug 22 09:39:38 juju-e4d256-prod-github-runner-207 kernel: [15352.607535] ? do_futex+0x162/0x1f0 Aug 22 09:39:38 juju-e4d256-prod-github-runner-207 kernel: [15352.608228] ? __x64_sys_futex+0x78/0x1e0 Aug 22 09:39:38 juju-e4d256-prod-github-runner-207 kernel: [15352.608905] ? __secure_computing+0xa9/0x120 Aug 22 09:39:38 juju-e4d256-prod-github-runner-207 kernel: [15352.609596] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 09:39:38 juju-e4d256-prod-github-runner-207 kernel: [15352.610387] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:39:38 juju-e4d256-prod-github-runner-207 kernel: [15352.611109] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:39:38 juju-e4d256-prod-github-runner-207 kernel: [15352.611836] ? do_syscall_64+0x69/0xc0 Aug 22 09:39:38 juju-e4d256-prod-github-runner-207 kernel: [15352.612510] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:39:38 juju-e4d256-prod-github-runner-207 kernel: [15352.613216] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:39:38 juju-e4d256-prod-github-runner-207 kernel: [15352.613921] ? do_syscall_64+0x69/0xc0 Aug 22 09:39:38 juju-e4d256-prod-github-runner-207 kernel: [15352.614555] ? do_syscall_64+0x69/0xc0 Aug 22 09:39:38 juju-e4d256-prod-github-runner-207 kernel: [15352.615186] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 09:39:38 juju-e4d256-prod-github-runner-207 kernel: [15352.615891] RIP: 0033:0x7faa5d0edaff Aug 22 09:39:38 juju-e4d256-prod-github-runner-207 kernel: [15352.616529] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 09:39:38 juju-e4d256-prod-github-runner-207 kernel: [15352.618513] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 09:39:38 juju-e4d256-prod-github-runner-207 kernel: [15352.619421] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 09:39:38 juju-e4d256-prod-github-runner-207 kernel: [15352.620321] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 09:39:38 juju-e4d256-prod-github-runner-207 kernel: [15352.621213] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 09:39:38 juju-e4d256-prod-github-runner-207 kernel: [15352.622098] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 09:39:38 juju-e4d256-prod-github-runner-207 kernel: [15352.622988] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 09:39:38 juju-e4d256-prod-github-runner-207 kernel: [15352.623874] Aug 22 09:40:06 juju-e4d256-prod-github-runner-207 kernel: [15380.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 14216s! [qemu-system-x86:6715] Aug 22 09:40:06 juju-e4d256-prod-github-runner-207 kernel: [15380.544399] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 09:40:06 juju-e4d256-prod-github-runner-207 kernel: [15380.544696] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 09:40:06 juju-e4d256-prod-github-runner-207 kernel: [15380.563029] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 09:40:06 juju-e4d256-prod-github-runner-207 kernel: [15380.564328] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 09:40:06 juju-e4d256-prod-github-runner-207 kernel: [15380.565540] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:40:06 juju-e4d256-prod-github-runner-207 kernel: [15380.566584] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 09:40:06 juju-e4d256-prod-github-runner-207 kernel: [15380.569122] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 09:40:06 juju-e4d256-prod-github-runner-207 kernel: [15380.570160] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 09:40:06 juju-e4d256-prod-github-runner-207 kernel: [15380.571296] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 09:40:06 juju-e4d256-prod-github-runner-207 kernel: [15380.572448] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 09:40:06 juju-e4d256-prod-github-runner-207 kernel: [15380.573581] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 09:40:06 juju-e4d256-prod-github-runner-207 kernel: [15380.574722] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 09:40:06 juju-e4d256-prod-github-runner-207 kernel: [15380.575897] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 09:40:06 juju-e4d256-prod-github-runner-207 kernel: [15380.577110] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 09:40:06 juju-e4d256-prod-github-runner-207 kernel: [15380.578199] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 09:40:06 juju-e4d256-prod-github-runner-207 kernel: [15380.579380] Call Trace: Aug 22 09:40:06 juju-e4d256-prod-github-runner-207 kernel: [15380.580306] Aug 22 09:40:06 juju-e4d256-prod-github-runner-207 kernel: [15380.581203] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:40:06 juju-e4d256-prod-github-runner-207 kernel: [15380.582219] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:40:06 juju-e4d256-prod-github-runner-207 kernel: [15380.583221] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:40:06 juju-e4d256-prod-github-runner-207 kernel: [15380.584321] ? show_regs.part.0+0x23/0x29 Aug 22 09:40:06 juju-e4d256-prod-github-runner-207 kernel: [15380.585342] ? show_regs.cold+0x8/0xd Aug 22 09:40:06 juju-e4d256-prod-github-runner-207 kernel: [15380.586302] ? watchdog_timer_fn+0x1be/0x220 Aug 22 09:40:06 juju-e4d256-prod-github-runner-207 kernel: [15380.587316] ? lockup_detector_update_enable+0x60/0x60 Aug 22 09:40:06 juju-e4d256-prod-github-runner-207 kernel: [15380.588388] ? __hrtimer_run_queues+0x107/0x230 Aug 22 09:40:06 juju-e4d256-prod-github-runner-207 kernel: [15380.589416] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 09:40:06 juju-e4d256-prod-github-runner-207 kernel: [15380.590475] ? hrtimer_interrupt+0x101/0x220 Aug 22 09:40:06 juju-e4d256-prod-github-runner-207 kernel: [15380.591485] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 09:40:06 juju-e4d256-prod-github-runner-207 kernel: [15380.592568] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 09:40:06 juju-e4d256-prod-github-runner-207 kernel: [15380.593597] Aug 22 09:40:06 juju-e4d256-prod-github-runner-207 kernel: [15380.594442] Aug 22 09:40:06 juju-e4d256-prod-github-runner-207 kernel: [15380.595300] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 09:40:06 juju-e4d256-prod-github-runner-207 kernel: [15380.596338] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:40:06 juju-e4d256-prod-github-runner-207 kernel: [15380.597355] ? _raw_spin_lock+0x22/0x30 Aug 22 09:40:06 juju-e4d256-prod-github-runner-207 kernel: [15380.598299] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:40:06 juju-e4d256-prod-github-runner-207 kernel: [15380.599306] direct_page_fault+0x206/0x310 [kvm] Aug 22 09:40:06 juju-e4d256-prod-github-runner-207 kernel: [15380.600365] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 09:40:06 juju-e4d256-prod-github-runner-207 kernel: [15380.601392] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 09:40:06 juju-e4d256-prod-github-runner-207 kernel: [15380.602379] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 09:40:06 juju-e4d256-prod-github-runner-207 kernel: [15380.603372] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 09:40:06 juju-e4d256-prod-github-runner-207 kernel: [15380.604325] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 09:40:06 juju-e4d256-prod-github-runner-207 kernel: [15380.605302] handle_exit+0x98/0x230 [kvm_amd] Aug 22 09:40:06 juju-e4d256-prod-github-runner-207 kernel: [15380.606224] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 09:40:06 juju-e4d256-prod-github-runner-207 kernel: [15380.607134] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 09:40:06 juju-e4d256-prod-github-runner-207 kernel: [15380.608061] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 09:40:06 juju-e4d256-prod-github-runner-207 kernel: [15380.608945] vcpu_run+0x62/0x2c0 [kvm] Aug 22 09:40:06 juju-e4d256-prod-github-runner-207 kernel: [15380.609747] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 09:40:06 juju-e4d256-prod-github-runner-207 kernel: [15380.610580] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 09:40:06 juju-e4d256-prod-github-runner-207 kernel: [15380.611419] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 09:40:06 juju-e4d256-prod-github-runner-207 kernel: [15380.612217] ? __seccomp_filter+0x4a/0x4a0 Aug 22 09:40:06 juju-e4d256-prod-github-runner-207 kernel: [15380.612953] ? __fget_files+0x86/0xc0 Aug 22 09:40:06 juju-e4d256-prod-github-runner-207 kernel: [15380.613649] __x64_sys_ioctl+0x95/0xd0 Aug 22 09:40:06 juju-e4d256-prod-github-runner-207 kernel: [15380.614468] do_syscall_64+0x5c/0xc0 Aug 22 09:40:06 juju-e4d256-prod-github-runner-207 kernel: [15380.615136] ? do_futex+0x162/0x1f0 Aug 22 09:40:06 juju-e4d256-prod-github-runner-207 kernel: [15380.615793] ? __x64_sys_futex+0x78/0x1e0 Aug 22 09:40:06 juju-e4d256-prod-github-runner-207 kernel: [15380.616455] ? __secure_computing+0xa9/0x120 Aug 22 09:40:06 juju-e4d256-prod-github-runner-207 kernel: [15380.617131] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 09:40:06 juju-e4d256-prod-github-runner-207 kernel: [15380.617893] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:40:06 juju-e4d256-prod-github-runner-207 kernel: [15380.618600] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:40:06 juju-e4d256-prod-github-runner-207 kernel: [15380.619301] ? do_syscall_64+0x69/0xc0 Aug 22 09:40:06 juju-e4d256-prod-github-runner-207 kernel: [15380.619959] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:40:06 juju-e4d256-prod-github-runner-207 kernel: [15380.620684] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:40:06 juju-e4d256-prod-github-runner-207 kernel: [15380.621371] ? do_syscall_64+0x69/0xc0 Aug 22 09:40:06 juju-e4d256-prod-github-runner-207 kernel: [15380.621987] ? do_syscall_64+0x69/0xc0 Aug 22 09:40:06 juju-e4d256-prod-github-runner-207 kernel: [15380.622601] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 09:40:06 juju-e4d256-prod-github-runner-207 kernel: [15380.623318] RIP: 0033:0x7faa5d0edaff Aug 22 09:40:06 juju-e4d256-prod-github-runner-207 kernel: [15380.624462] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 09:40:06 juju-e4d256-prod-github-runner-207 kernel: [15380.626420] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 09:40:06 juju-e4d256-prod-github-runner-207 kernel: [15380.627314] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 09:40:06 juju-e4d256-prod-github-runner-207 kernel: [15380.628270] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 09:40:06 juju-e4d256-prod-github-runner-207 kernel: [15380.629147] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 09:40:06 juju-e4d256-prod-github-runner-207 kernel: [15380.630031] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 09:40:06 juju-e4d256-prod-github-runner-207 kernel: [15380.630904] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 09:40:06 juju-e4d256-prod-github-runner-207 kernel: [15380.631801] Aug 22 09:40:34 juju-e4d256-prod-github-runner-207 kernel: [15408.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 14242s! [qemu-system-x86:6715] Aug 22 09:40:34 juju-e4d256-prod-github-runner-207 kernel: [15408.544213] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 09:40:34 juju-e4d256-prod-github-runner-207 kernel: [15408.544882] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 09:40:34 juju-e4d256-prod-github-runner-207 kernel: [15408.556994] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 09:40:34 juju-e4d256-prod-github-runner-207 kernel: [15408.558265] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 09:40:34 juju-e4d256-prod-github-runner-207 kernel: [15408.559500] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:40:34 juju-e4d256-prod-github-runner-207 kernel: [15408.560564] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 09:40:34 juju-e4d256-prod-github-runner-207 kernel: [15408.563276] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 09:40:34 juju-e4d256-prod-github-runner-207 kernel: [15408.564334] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 09:40:34 juju-e4d256-prod-github-runner-207 kernel: [15408.565497] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 09:40:34 juju-e4d256-prod-github-runner-207 kernel: [15408.566656] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 09:40:34 juju-e4d256-prod-github-runner-207 kernel: [15408.567824] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 09:40:34 juju-e4d256-prod-github-runner-207 kernel: [15408.568988] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 09:40:34 juju-e4d256-prod-github-runner-207 kernel: [15408.570155] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 09:40:34 juju-e4d256-prod-github-runner-207 kernel: [15408.571398] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 09:40:34 juju-e4d256-prod-github-runner-207 kernel: [15408.572497] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 09:40:34 juju-e4d256-prod-github-runner-207 kernel: [15408.573697] Call Trace: Aug 22 09:40:34 juju-e4d256-prod-github-runner-207 kernel: [15408.574615] Aug 22 09:40:34 juju-e4d256-prod-github-runner-207 kernel: [15408.575521] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:40:34 juju-e4d256-prod-github-runner-207 kernel: [15408.576553] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:40:34 juju-e4d256-prod-github-runner-207 kernel: [15408.577582] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:40:34 juju-e4d256-prod-github-runner-207 kernel: [15408.578678] ? show_regs.part.0+0x23/0x29 Aug 22 09:40:34 juju-e4d256-prod-github-runner-207 kernel: [15408.579689] ? show_regs.cold+0x8/0xd Aug 22 09:40:34 juju-e4d256-prod-github-runner-207 kernel: [15408.580666] ? watchdog_timer_fn+0x1be/0x220 Aug 22 09:40:34 juju-e4d256-prod-github-runner-207 kernel: [15408.581682] ? lockup_detector_update_enable+0x60/0x60 Aug 22 09:40:34 juju-e4d256-prod-github-runner-207 kernel: [15408.582746] ? __hrtimer_run_queues+0x107/0x230 Aug 22 09:40:34 juju-e4d256-prod-github-runner-207 kernel: [15408.583789] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 09:40:34 juju-e4d256-prod-github-runner-207 kernel: [15408.584821] ? hrtimer_interrupt+0x101/0x220 Aug 22 09:40:34 juju-e4d256-prod-github-runner-207 kernel: [15408.585997] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 09:40:34 juju-e4d256-prod-github-runner-207 kernel: [15408.587071] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 09:40:34 juju-e4d256-prod-github-runner-207 kernel: [15408.588133] Aug 22 09:40:34 juju-e4d256-prod-github-runner-207 kernel: [15408.588986] Aug 22 09:40:34 juju-e4d256-prod-github-runner-207 kernel: [15408.589829] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 09:40:34 juju-e4d256-prod-github-runner-207 kernel: [15408.590862] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:40:34 juju-e4d256-prod-github-runner-207 kernel: [15408.591906] ? _raw_spin_lock+0x22/0x30 Aug 22 09:40:34 juju-e4d256-prod-github-runner-207 kernel: [15408.592856] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:40:34 juju-e4d256-prod-github-runner-207 kernel: [15408.593878] direct_page_fault+0x206/0x310 [kvm] Aug 22 09:40:34 juju-e4d256-prod-github-runner-207 kernel: [15408.594901] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 09:40:34 juju-e4d256-prod-github-runner-207 kernel: [15408.596796] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 09:40:34 juju-e4d256-prod-github-runner-207 kernel: [15408.597806] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 09:40:34 juju-e4d256-prod-github-runner-207 kernel: [15408.598811] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 09:40:34 juju-e4d256-prod-github-runner-207 kernel: [15408.599768] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 09:40:34 juju-e4d256-prod-github-runner-207 kernel: [15408.600753] handle_exit+0x98/0x230 [kvm_amd] Aug 22 09:40:34 juju-e4d256-prod-github-runner-207 kernel: [15408.601647] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 09:40:34 juju-e4d256-prod-github-runner-207 kernel: [15408.602568] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 09:40:34 juju-e4d256-prod-github-runner-207 kernel: [15408.603505] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 09:40:34 juju-e4d256-prod-github-runner-207 kernel: [15408.604416] vcpu_run+0x62/0x2c0 [kvm] Aug 22 09:40:34 juju-e4d256-prod-github-runner-207 kernel: [15408.605232] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 09:40:34 juju-e4d256-prod-github-runner-207 kernel: [15408.606045] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 09:40:34 juju-e4d256-prod-github-runner-207 kernel: [15408.606905] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 09:40:34 juju-e4d256-prod-github-runner-207 kernel: [15408.607710] ? __seccomp_filter+0x4a/0x4a0 Aug 22 09:40:34 juju-e4d256-prod-github-runner-207 kernel: [15408.608461] ? __fget_files+0x86/0xc0 Aug 22 09:40:34 juju-e4d256-prod-github-runner-207 kernel: [15408.609167] __x64_sys_ioctl+0x95/0xd0 Aug 22 09:40:34 juju-e4d256-prod-github-runner-207 kernel: [15408.609861] do_syscall_64+0x5c/0xc0 Aug 22 09:40:34 juju-e4d256-prod-github-runner-207 kernel: [15408.610526] ? do_futex+0x162/0x1f0 Aug 22 09:40:34 juju-e4d256-prod-github-runner-207 kernel: [15408.611174] ? __x64_sys_futex+0x78/0x1e0 Aug 22 09:40:34 juju-e4d256-prod-github-runner-207 kernel: [15408.611862] ? __secure_computing+0xa9/0x120 Aug 22 09:40:34 juju-e4d256-prod-github-runner-207 kernel: [15408.612553] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 09:40:34 juju-e4d256-prod-github-runner-207 kernel: [15408.613315] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:40:34 juju-e4d256-prod-github-runner-207 kernel: [15408.614037] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:40:34 juju-e4d256-prod-github-runner-207 kernel: [15408.614761] ? do_syscall_64+0x69/0xc0 Aug 22 09:40:34 juju-e4d256-prod-github-runner-207 kernel: [15408.615417] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:40:34 juju-e4d256-prod-github-runner-207 kernel: [15408.616128] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:40:34 juju-e4d256-prod-github-runner-207 kernel: [15408.616824] ? do_syscall_64+0x69/0xc0 Aug 22 09:40:34 juju-e4d256-prod-github-runner-207 kernel: [15408.617454] ? do_syscall_64+0x69/0xc0 Aug 22 09:40:34 juju-e4d256-prod-github-runner-207 kernel: [15408.618077] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 09:40:34 juju-e4d256-prod-github-runner-207 kernel: [15408.618784] RIP: 0033:0x7faa5d0edaff Aug 22 09:40:34 juju-e4d256-prod-github-runner-207 kernel: [15408.619452] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 09:40:34 juju-e4d256-prod-github-runner-207 kernel: [15408.621443] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 09:40:34 juju-e4d256-prod-github-runner-207 kernel: [15408.622360] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 09:40:34 juju-e4d256-prod-github-runner-207 kernel: [15408.623250] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 09:40:34 juju-e4d256-prod-github-runner-207 kernel: [15408.624153] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 09:40:34 juju-e4d256-prod-github-runner-207 kernel: [15408.625043] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 09:40:34 juju-e4d256-prod-github-runner-207 kernel: [15408.625931] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 09:40:34 juju-e4d256-prod-github-runner-207 kernel: [15408.626830] Aug 22 09:41:02 juju-e4d256-prod-github-runner-207 kernel: [15436.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 14268s! [qemu-system-x86:6715] Aug 22 09:41:02 juju-e4d256-prod-github-runner-207 kernel: [15436.543789] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 09:41:02 juju-e4d256-prod-github-runner-207 kernel: [15436.544074] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 09:41:02 juju-e4d256-prod-github-runner-207 kernel: [15436.556648] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 09:41:02 juju-e4d256-prod-github-runner-207 kernel: [15436.557924] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 09:41:02 juju-e4d256-prod-github-runner-207 kernel: [15436.559177] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:41:02 juju-e4d256-prod-github-runner-207 kernel: [15436.560237] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 09:41:02 juju-e4d256-prod-github-runner-207 kernel: [15436.562785] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 09:41:02 juju-e4d256-prod-github-runner-207 kernel: [15436.563846] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 09:41:02 juju-e4d256-prod-github-runner-207 kernel: [15436.565010] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 09:41:02 juju-e4d256-prod-github-runner-207 kernel: [15436.566166] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 09:41:02 juju-e4d256-prod-github-runner-207 kernel: [15436.567334] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 09:41:02 juju-e4d256-prod-github-runner-207 kernel: [15436.568494] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 09:41:02 juju-e4d256-prod-github-runner-207 kernel: [15436.569660] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 09:41:02 juju-e4d256-prod-github-runner-207 kernel: [15436.570896] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 09:41:02 juju-e4d256-prod-github-runner-207 kernel: [15436.572010] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 09:41:02 juju-e4d256-prod-github-runner-207 kernel: [15436.573199] Call Trace: Aug 22 09:41:02 juju-e4d256-prod-github-runner-207 kernel: [15436.574110] Aug 22 09:41:02 juju-e4d256-prod-github-runner-207 kernel: [15436.575004] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:41:02 juju-e4d256-prod-github-runner-207 kernel: [15436.576039] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:41:02 juju-e4d256-prod-github-runner-207 kernel: [15436.577063] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:41:02 juju-e4d256-prod-github-runner-207 kernel: [15436.578150] ? show_regs.part.0+0x23/0x29 Aug 22 09:41:02 juju-e4d256-prod-github-runner-207 kernel: [15436.579159] ? show_regs.cold+0x8/0xd Aug 22 09:41:02 juju-e4d256-prod-github-runner-207 kernel: [15436.580130] ? watchdog_timer_fn+0x1be/0x220 Aug 22 09:41:02 juju-e4d256-prod-github-runner-207 kernel: [15436.581135] ? lockup_detector_update_enable+0x60/0x60 Aug 22 09:41:02 juju-e4d256-prod-github-runner-207 kernel: [15436.582197] ? __hrtimer_run_queues+0x107/0x230 Aug 22 09:41:02 juju-e4d256-prod-github-runner-207 kernel: [15436.583238] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 09:41:02 juju-e4d256-prod-github-runner-207 kernel: [15436.584259] ? hrtimer_interrupt+0x101/0x220 Aug 22 09:41:02 juju-e4d256-prod-github-runner-207 kernel: [15436.585272] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 09:41:02 juju-e4d256-prod-github-runner-207 kernel: [15436.586340] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 09:41:02 juju-e4d256-prod-github-runner-207 kernel: [15436.587403] Aug 22 09:41:02 juju-e4d256-prod-github-runner-207 kernel: [15436.588257] Aug 22 09:41:02 juju-e4d256-prod-github-runner-207 kernel: [15436.589092] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 09:41:02 juju-e4d256-prod-github-runner-207 kernel: [15436.590134] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:41:02 juju-e4d256-prod-github-runner-207 kernel: [15436.591194] ? _raw_spin_lock+0x22/0x30 Aug 22 09:41:02 juju-e4d256-prod-github-runner-207 kernel: [15436.592138] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:41:02 juju-e4d256-prod-github-runner-207 kernel: [15436.593154] direct_page_fault+0x206/0x310 [kvm] Aug 22 09:41:02 juju-e4d256-prod-github-runner-207 kernel: [15436.594178] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 09:41:02 juju-e4d256-prod-github-runner-207 kernel: [15436.595201] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 09:41:02 juju-e4d256-prod-github-runner-207 kernel: [15436.596209] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 09:41:02 juju-e4d256-prod-github-runner-207 kernel: [15436.597202] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 09:41:02 juju-e4d256-prod-github-runner-207 kernel: [15436.598149] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 09:41:02 juju-e4d256-prod-github-runner-207 kernel: [15436.599141] handle_exit+0x98/0x230 [kvm_amd] Aug 22 09:41:02 juju-e4d256-prod-github-runner-207 kernel: [15436.600032] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 09:41:02 juju-e4d256-prod-github-runner-207 kernel: [15436.600944] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 09:41:02 juju-e4d256-prod-github-runner-207 kernel: [15436.601869] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 09:41:02 juju-e4d256-prod-github-runner-207 kernel: [15436.602776] vcpu_run+0x62/0x2c0 [kvm] Aug 22 09:41:02 juju-e4d256-prod-github-runner-207 kernel: [15436.603601] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 09:41:02 juju-e4d256-prod-github-runner-207 kernel: [15436.604407] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 09:41:02 juju-e4d256-prod-github-runner-207 kernel: [15436.605267] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 09:41:02 juju-e4d256-prod-github-runner-207 kernel: [15436.606070] ? __seccomp_filter+0x4a/0x4a0 Aug 22 09:41:02 juju-e4d256-prod-github-runner-207 kernel: [15436.606810] ? __fget_files+0x86/0xc0 Aug 22 09:41:02 juju-e4d256-prod-github-runner-207 kernel: [15436.607527] __x64_sys_ioctl+0x95/0xd0 Aug 22 09:41:02 juju-e4d256-prod-github-runner-207 kernel: [15436.608224] do_syscall_64+0x5c/0xc0 Aug 22 09:41:02 juju-e4d256-prod-github-runner-207 kernel: [15436.608886] ? do_futex+0x162/0x1f0 Aug 22 09:41:02 juju-e4d256-prod-github-runner-207 kernel: [15436.609533] ? __x64_sys_futex+0x78/0x1e0 Aug 22 09:41:02 juju-e4d256-prod-github-runner-207 kernel: [15436.610204] ? __secure_computing+0xa9/0x120 Aug 22 09:41:02 juju-e4d256-prod-github-runner-207 kernel: [15436.610892] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 09:41:02 juju-e4d256-prod-github-runner-207 kernel: [15436.611664] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:41:02 juju-e4d256-prod-github-runner-207 kernel: [15436.612387] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:41:02 juju-e4d256-prod-github-runner-207 kernel: [15436.613104] ? do_syscall_64+0x69/0xc0 Aug 22 09:41:02 juju-e4d256-prod-github-runner-207 kernel: [15436.613754] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:41:02 juju-e4d256-prod-github-runner-207 kernel: [15436.614457] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:41:02 juju-e4d256-prod-github-runner-207 kernel: [15436.615172] ? do_syscall_64+0x69/0xc0 Aug 22 09:41:02 juju-e4d256-prod-github-runner-207 kernel: [15436.615796] ? do_syscall_64+0x69/0xc0 Aug 22 09:41:02 juju-e4d256-prod-github-runner-207 kernel: [15436.616421] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 09:41:02 juju-e4d256-prod-github-runner-207 kernel: [15436.617127] RIP: 0033:0x7faa5d0edaff Aug 22 09:41:02 juju-e4d256-prod-github-runner-207 kernel: [15436.617784] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 09:41:02 juju-e4d256-prod-github-runner-207 kernel: [15436.619785] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 09:41:02 juju-e4d256-prod-github-runner-207 kernel: [15436.620697] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 09:41:02 juju-e4d256-prod-github-runner-207 kernel: [15436.621587] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 09:41:02 juju-e4d256-prod-github-runner-207 kernel: [15436.622480] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 09:41:02 juju-e4d256-prod-github-runner-207 kernel: [15436.623381] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 09:41:02 juju-e4d256-prod-github-runner-207 kernel: [15436.624271] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 09:41:02 juju-e4d256-prod-github-runner-207 kernel: [15436.625163] Aug 22 09:41:30 juju-e4d256-prod-github-runner-207 kernel: [15464.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 14294s! [qemu-system-x86:6715] Aug 22 09:41:30 juju-e4d256-prod-github-runner-207 kernel: [15464.543768] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 09:41:30 juju-e4d256-prod-github-runner-207 kernel: [15464.544033] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 09:41:30 juju-e4d256-prod-github-runner-207 kernel: [15464.556184] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 09:41:30 juju-e4d256-prod-github-runner-207 kernel: [15464.557450] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 09:41:30 juju-e4d256-prod-github-runner-207 kernel: [15464.558681] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:41:30 juju-e4d256-prod-github-runner-207 kernel: [15464.559735] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 09:41:30 juju-e4d256-prod-github-runner-207 kernel: [15464.562275] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 09:41:30 juju-e4d256-prod-github-runner-207 kernel: [15464.563337] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 09:41:30 juju-e4d256-prod-github-runner-207 kernel: [15464.564501] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 09:41:30 juju-e4d256-prod-github-runner-207 kernel: [15464.565658] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 09:41:30 juju-e4d256-prod-github-runner-207 kernel: [15464.566833] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 09:41:30 juju-e4d256-prod-github-runner-207 kernel: [15464.567995] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 09:41:30 juju-e4d256-prod-github-runner-207 kernel: [15464.569156] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 09:41:30 juju-e4d256-prod-github-runner-207 kernel: [15464.570392] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 09:41:30 juju-e4d256-prod-github-runner-207 kernel: [15464.571500] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 09:41:30 juju-e4d256-prod-github-runner-207 kernel: [15464.572693] Call Trace: Aug 22 09:41:30 juju-e4d256-prod-github-runner-207 kernel: [15464.573609] Aug 22 09:41:30 juju-e4d256-prod-github-runner-207 kernel: [15464.574502] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:41:30 juju-e4d256-prod-github-runner-207 kernel: [15464.575536] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:41:30 juju-e4d256-prod-github-runner-207 kernel: [15464.576555] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:41:30 juju-e4d256-prod-github-runner-207 kernel: [15464.577646] ? show_regs.part.0+0x23/0x29 Aug 22 09:41:30 juju-e4d256-prod-github-runner-207 kernel: [15464.578640] ? show_regs.cold+0x8/0xd Aug 22 09:41:30 juju-e4d256-prod-github-runner-207 kernel: [15464.579622] ? watchdog_timer_fn+0x1be/0x220 Aug 22 09:41:30 juju-e4d256-prod-github-runner-207 kernel: [15464.580630] ? lockup_detector_update_enable+0x60/0x60 Aug 22 09:41:30 juju-e4d256-prod-github-runner-207 kernel: [15464.581693] ? __hrtimer_run_queues+0x107/0x230 Aug 22 09:41:30 juju-e4d256-prod-github-runner-207 kernel: [15464.582735] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 09:41:30 juju-e4d256-prod-github-runner-207 kernel: [15464.583757] ? hrtimer_interrupt+0x101/0x220 Aug 22 09:41:30 juju-e4d256-prod-github-runner-207 kernel: [15464.584770] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 09:41:30 juju-e4d256-prod-github-runner-207 kernel: [15464.585836] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 09:41:30 juju-e4d256-prod-github-runner-207 kernel: [15464.586897] Aug 22 09:41:30 juju-e4d256-prod-github-runner-207 kernel: [15464.587755] Aug 22 09:41:30 juju-e4d256-prod-github-runner-207 kernel: [15464.588596] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 09:41:30 juju-e4d256-prod-github-runner-207 kernel: [15464.589634] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:41:30 juju-e4d256-prod-github-runner-207 kernel: [15464.590688] ? _raw_spin_lock+0x22/0x30 Aug 22 09:41:30 juju-e4d256-prod-github-runner-207 kernel: [15464.591636] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:41:30 juju-e4d256-prod-github-runner-207 kernel: [15464.592649] direct_page_fault+0x206/0x310 [kvm] Aug 22 09:41:30 juju-e4d256-prod-github-runner-207 kernel: [15464.593673] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 09:41:30 juju-e4d256-prod-github-runner-207 kernel: [15464.594696] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 09:41:30 juju-e4d256-prod-github-runner-207 kernel: [15464.595701] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 09:41:30 juju-e4d256-prod-github-runner-207 kernel: [15464.596686] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 09:41:30 juju-e4d256-prod-github-runner-207 kernel: [15464.597631] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 09:41:30 juju-e4d256-prod-github-runner-207 kernel: [15464.598608] handle_exit+0x98/0x230 [kvm_amd] Aug 22 09:41:30 juju-e4d256-prod-github-runner-207 kernel: [15464.599510] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 09:41:30 juju-e4d256-prod-github-runner-207 kernel: [15464.600422] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 09:41:30 juju-e4d256-prod-github-runner-207 kernel: [15464.601347] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 09:41:30 juju-e4d256-prod-github-runner-207 kernel: [15464.602254] vcpu_run+0x62/0x2c0 [kvm] Aug 22 09:41:30 juju-e4d256-prod-github-runner-207 kernel: [15464.603085] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 09:41:30 juju-e4d256-prod-github-runner-207 kernel: [15464.603907] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 09:41:30 juju-e4d256-prod-github-runner-207 kernel: [15464.604773] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 09:41:30 juju-e4d256-prod-github-runner-207 kernel: [15464.605577] ? __seccomp_filter+0x4a/0x4a0 Aug 22 09:41:30 juju-e4d256-prod-github-runner-207 kernel: [15464.606320] ? __fget_files+0x86/0xc0 Aug 22 09:41:30 juju-e4d256-prod-github-runner-207 kernel: [15464.607051] __x64_sys_ioctl+0x95/0xd0 Aug 22 09:41:30 juju-e4d256-prod-github-runner-207 kernel: [15464.607744] do_syscall_64+0x5c/0xc0 Aug 22 09:41:30 juju-e4d256-prod-github-runner-207 kernel: [15464.608414] ? do_futex+0x162/0x1f0 Aug 22 09:41:30 juju-e4d256-prod-github-runner-207 kernel: [15464.609062] ? __x64_sys_futex+0x78/0x1e0 Aug 22 09:41:30 juju-e4d256-prod-github-runner-207 kernel: [15464.609735] ? __secure_computing+0xa9/0x120 Aug 22 09:41:30 juju-e4d256-prod-github-runner-207 kernel: [15464.610423] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 09:41:30 juju-e4d256-prod-github-runner-207 kernel: [15464.611196] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:41:30 juju-e4d256-prod-github-runner-207 kernel: [15464.611923] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:41:30 juju-e4d256-prod-github-runner-207 kernel: [15464.612640] ? do_syscall_64+0x69/0xc0 Aug 22 09:41:30 juju-e4d256-prod-github-runner-207 kernel: [15464.613285] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:41:30 juju-e4d256-prod-github-runner-207 kernel: [15464.613991] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:41:30 juju-e4d256-prod-github-runner-207 kernel: [15464.614697] ? do_syscall_64+0x69/0xc0 Aug 22 09:41:30 juju-e4d256-prod-github-runner-207 kernel: [15464.615322] ? do_syscall_64+0x69/0xc0 Aug 22 09:41:30 juju-e4d256-prod-github-runner-207 kernel: [15464.615942] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 09:41:30 juju-e4d256-prod-github-runner-207 kernel: [15464.616652] RIP: 0033:0x7faa5d0edaff Aug 22 09:41:30 juju-e4d256-prod-github-runner-207 kernel: [15464.617292] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 09:41:30 juju-e4d256-prod-github-runner-207 kernel: [15464.619289] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 09:41:30 juju-e4d256-prod-github-runner-207 kernel: [15464.620197] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 09:41:30 juju-e4d256-prod-github-runner-207 kernel: [15464.621085] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 09:41:30 juju-e4d256-prod-github-runner-207 kernel: [15464.621982] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 09:41:30 juju-e4d256-prod-github-runner-207 kernel: [15464.622881] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 09:41:30 juju-e4d256-prod-github-runner-207 kernel: [15464.623769] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 09:41:30 juju-e4d256-prod-github-runner-207 kernel: [15464.624659] Aug 22 09:41:44 juju-e4d256-prod-github-runner-207 kernel: [15478.220705] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 09:41:44 juju-e4d256-prod-github-runner-207 kernel: [15478.222323] rcu: 1-....: (3828219 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=1848703 Aug 22 09:41:44 juju-e4d256-prod-github-runner-207 kernel: [15478.223508] (t=3840255 jiffies g=23269 q=22717) Aug 22 09:41:44 juju-e4d256-prod-github-runner-207 kernel: [15478.224289] NMI backtrace for cpu 1 Aug 22 09:41:44 juju-e4d256-prod-github-runner-207 kernel: [15478.224996] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 09:41:44 juju-e4d256-prod-github-runner-207 kernel: [15478.226105] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 09:41:44 juju-e4d256-prod-github-runner-207 kernel: [15478.227183] Call Trace: Aug 22 09:41:44 juju-e4d256-prod-github-runner-207 kernel: [15478.227855] Aug 22 09:41:44 juju-e4d256-prod-github-runner-207 kernel: [15478.228511] show_stack+0x52/0x5c Aug 22 09:41:44 juju-e4d256-prod-github-runner-207 kernel: [15478.229248] dump_stack_lvl+0x4a/0x63 Aug 22 09:41:44 juju-e4d256-prod-github-runner-207 kernel: [15478.230005] dump_stack+0x10/0x16 Aug 22 09:41:44 juju-e4d256-prod-github-runner-207 kernel: [15478.230737] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 09:41:44 juju-e4d256-prod-github-runner-207 kernel: [15478.231518] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 09:41:44 juju-e4d256-prod-github-runner-207 kernel: [15478.232299] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 09:41:44 juju-e4d256-prod-github-runner-207 kernel: [15478.233121] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 09:41:44 juju-e4d256-prod-github-runner-207 kernel: [15478.233939] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 09:41:44 juju-e4d256-prod-github-runner-207 kernel: [15478.234760] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 09:41:44 juju-e4d256-prod-github-runner-207 kernel: [15478.235535] print_cpu_stall.cold+0x2f/0xe2 Aug 22 09:41:44 juju-e4d256-prod-github-runner-207 kernel: [15478.236297] ? timekeeping_update+0xf7/0x150 Aug 22 09:41:44 juju-e4d256-prod-github-runner-207 kernel: [15478.237068] check_cpu_stall+0x109/0x270 Aug 22 09:41:44 juju-e4d256-prod-github-runner-207 kernel: [15478.237818] rcu_sched_clock_irq+0x9a/0x250 Aug 22 09:41:44 juju-e4d256-prod-github-runner-207 kernel: [15478.238595] update_process_times+0x94/0xd0 Aug 22 09:41:44 juju-e4d256-prod-github-runner-207 kernel: [15478.239363] tick_sched_handle+0x29/0x70 Aug 22 09:41:44 juju-e4d256-prod-github-runner-207 kernel: [15478.240107] tick_sched_timer+0x8c/0xc0 Aug 22 09:41:44 juju-e4d256-prod-github-runner-207 kernel: [15478.240841] ? tick_nohz_handler+0xb0/0xb0 Aug 22 09:41:44 juju-e4d256-prod-github-runner-207 kernel: [15478.241599] __hrtimer_run_queues+0x107/0x230 Aug 22 09:41:44 juju-e4d256-prod-github-runner-207 kernel: [15478.242370] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 09:41:44 juju-e4d256-prod-github-runner-207 kernel: [15478.243157] hrtimer_interrupt+0x101/0x220 Aug 22 09:41:44 juju-e4d256-prod-github-runner-207 kernel: [15478.243913] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 09:41:44 juju-e4d256-prod-github-runner-207 kernel: [15478.244721] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 09:41:44 juju-e4d256-prod-github-runner-207 kernel: [15478.245520] Aug 22 09:41:44 juju-e4d256-prod-github-runner-207 kernel: [15478.246152] Aug 22 09:41:44 juju-e4d256-prod-github-runner-207 kernel: [15478.246794] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 09:41:44 juju-e4d256-prod-github-runner-207 kernel: [15478.247612] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:41:44 juju-e4d256-prod-github-runner-207 kernel: [15478.248488] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 09:41:44 juju-e4d256-prod-github-runner-207 kernel: [15478.250709] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 09:41:44 juju-e4d256-prod-github-runner-207 kernel: [15478.251580] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 09:41:44 juju-e4d256-prod-github-runner-207 kernel: [15478.252575] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 09:41:44 juju-e4d256-prod-github-runner-207 kernel: [15478.253550] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 09:41:44 juju-e4d256-prod-github-runner-207 kernel: [15478.254527] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 09:41:44 juju-e4d256-prod-github-runner-207 kernel: [15478.255480] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 09:41:44 juju-e4d256-prod-github-runner-207 kernel: [15478.256472] ? _raw_spin_lock+0x22/0x30 Aug 22 09:41:44 juju-e4d256-prod-github-runner-207 kernel: [15478.257246] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:41:44 juju-e4d256-prod-github-runner-207 kernel: [15478.258099] direct_page_fault+0x206/0x310 [kvm] Aug 22 09:41:44 juju-e4d256-prod-github-runner-207 kernel: [15478.258951] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 09:41:44 juju-e4d256-prod-github-runner-207 kernel: [15478.259795] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 09:41:44 juju-e4d256-prod-github-runner-207 kernel: [15478.260645] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 09:41:44 juju-e4d256-prod-github-runner-207 kernel: [15478.261471] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 09:41:44 juju-e4d256-prod-github-runner-207 kernel: [15478.262255] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 09:41:44 juju-e4d256-prod-github-runner-207 kernel: [15478.263101] handle_exit+0x98/0x230 [kvm_amd] Aug 22 09:41:44 juju-e4d256-prod-github-runner-207 kernel: [15478.263865] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 09:41:44 juju-e4d256-prod-github-runner-207 kernel: [15478.264664] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 09:41:44 juju-e4d256-prod-github-runner-207 kernel: [15478.265461] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 09:41:44 juju-e4d256-prod-github-runner-207 kernel: [15478.266240] vcpu_run+0x62/0x2c0 [kvm] Aug 22 09:41:44 juju-e4d256-prod-github-runner-207 kernel: [15478.266966] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 09:41:44 juju-e4d256-prod-github-runner-207 kernel: [15478.267701] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 09:41:44 juju-e4d256-prod-github-runner-207 kernel: [15478.268500] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 09:41:44 juju-e4d256-prod-github-runner-207 kernel: [15478.269257] ? __seccomp_filter+0x4a/0x4a0 Aug 22 09:41:44 juju-e4d256-prod-github-runner-207 kernel: [15478.269973] ? __fget_files+0x86/0xc0 Aug 22 09:41:44 juju-e4d256-prod-github-runner-207 kernel: [15478.270679] __x64_sys_ioctl+0x95/0xd0 Aug 22 09:41:44 juju-e4d256-prod-github-runner-207 kernel: [15478.271373] do_syscall_64+0x5c/0xc0 Aug 22 09:41:44 juju-e4d256-prod-github-runner-207 kernel: [15478.272051] ? do_futex+0x162/0x1f0 Aug 22 09:41:44 juju-e4d256-prod-github-runner-207 kernel: [15478.272721] ? __x64_sys_futex+0x78/0x1e0 Aug 22 09:41:44 juju-e4d256-prod-github-runner-207 kernel: [15478.273424] ? __secure_computing+0xa9/0x120 Aug 22 09:41:44 juju-e4d256-prod-github-runner-207 kernel: [15478.274137] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 09:41:44 juju-e4d256-prod-github-runner-207 kernel: [15478.274931] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:41:44 juju-e4d256-prod-github-runner-207 kernel: [15478.275681] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:41:44 juju-e4d256-prod-github-runner-207 kernel: [15478.276436] ? do_syscall_64+0x69/0xc0 Aug 22 09:41:44 juju-e4d256-prod-github-runner-207 kernel: [15478.277122] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:41:44 juju-e4d256-prod-github-runner-207 kernel: [15478.277873] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:41:44 juju-e4d256-prod-github-runner-207 kernel: [15478.278640] ? do_syscall_64+0x69/0xc0 Aug 22 09:41:44 juju-e4d256-prod-github-runner-207 kernel: [15478.279338] ? do_syscall_64+0x69/0xc0 Aug 22 09:41:44 juju-e4d256-prod-github-runner-207 kernel: [15478.280022] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 09:41:44 juju-e4d256-prod-github-runner-207 kernel: [15478.280790] RIP: 0033:0x7faa5d0edaff Aug 22 09:41:44 juju-e4d256-prod-github-runner-207 kernel: [15478.281513] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 09:41:44 juju-e4d256-prod-github-runner-207 kernel: [15478.283623] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 09:41:44 juju-e4d256-prod-github-runner-207 kernel: [15478.284587] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 09:41:44 juju-e4d256-prod-github-runner-207 kernel: [15478.285529] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 09:41:44 juju-e4d256-prod-github-runner-207 kernel: [15478.286475] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 09:41:44 juju-e4d256-prod-github-runner-207 kernel: [15478.287420] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 09:41:44 juju-e4d256-prod-github-runner-207 kernel: [15478.288354] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 09:41:44 juju-e4d256-prod-github-runner-207 kernel: [15478.289281] Aug 22 09:42:10 juju-e4d256-prod-github-runner-207 kernel: [15504.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 14331s! [qemu-system-x86:6715] Aug 22 09:42:10 juju-e4d256-prod-github-runner-207 kernel: [15504.543818] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 09:42:10 juju-e4d256-prod-github-runner-207 kernel: [15504.544079] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 09:42:10 juju-e4d256-prod-github-runner-207 kernel: [15504.556232] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 09:42:10 juju-e4d256-prod-github-runner-207 kernel: [15504.557501] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 09:42:10 juju-e4d256-prod-github-runner-207 kernel: [15504.558779] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:42:10 juju-e4d256-prod-github-runner-207 kernel: [15504.559872] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 09:42:10 juju-e4d256-prod-github-runner-207 kernel: [15504.562466] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 09:42:10 juju-e4d256-prod-github-runner-207 kernel: [15504.563508] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 09:42:10 juju-e4d256-prod-github-runner-207 kernel: [15504.564664] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 09:42:10 juju-e4d256-prod-github-runner-207 kernel: [15504.565820] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 09:42:10 juju-e4d256-prod-github-runner-207 kernel: [15504.566983] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 09:42:10 juju-e4d256-prod-github-runner-207 kernel: [15504.568141] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 09:42:10 juju-e4d256-prod-github-runner-207 kernel: [15504.569304] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 09:42:10 juju-e4d256-prod-github-runner-207 kernel: [15504.570552] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 09:42:10 juju-e4d256-prod-github-runner-207 kernel: [15504.571647] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 09:42:10 juju-e4d256-prod-github-runner-207 kernel: [15504.572835] Call Trace: Aug 22 09:42:10 juju-e4d256-prod-github-runner-207 kernel: [15504.573797] Aug 22 09:42:10 juju-e4d256-prod-github-runner-207 kernel: [15504.574735] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:42:10 juju-e4d256-prod-github-runner-207 kernel: [15504.575779] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:42:10 juju-e4d256-prod-github-runner-207 kernel: [15504.576819] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:42:10 juju-e4d256-prod-github-runner-207 kernel: [15504.577913] ? show_regs.part.0+0x23/0x29 Aug 22 09:42:10 juju-e4d256-prod-github-runner-207 kernel: [15504.578933] ? show_regs.cold+0x8/0xd Aug 22 09:42:10 juju-e4d256-prod-github-runner-207 kernel: [15504.579909] ? watchdog_timer_fn+0x1be/0x220 Aug 22 09:42:10 juju-e4d256-prod-github-runner-207 kernel: [15504.580916] ? lockup_detector_update_enable+0x60/0x60 Aug 22 09:42:10 juju-e4d256-prod-github-runner-207 kernel: [15504.581978] ? __hrtimer_run_queues+0x107/0x230 Aug 22 09:42:10 juju-e4d256-prod-github-runner-207 kernel: [15504.583015] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 09:42:10 juju-e4d256-prod-github-runner-207 kernel: [15504.584038] ? hrtimer_interrupt+0x101/0x220 Aug 22 09:42:10 juju-e4d256-prod-github-runner-207 kernel: [15504.585052] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 09:42:10 juju-e4d256-prod-github-runner-207 kernel: [15504.586126] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 09:42:10 juju-e4d256-prod-github-runner-207 kernel: [15504.587181] Aug 22 09:42:10 juju-e4d256-prod-github-runner-207 kernel: [15504.588033] Aug 22 09:42:10 juju-e4d256-prod-github-runner-207 kernel: [15504.588876] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 09:42:10 juju-e4d256-prod-github-runner-207 kernel: [15504.589908] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:42:10 juju-e4d256-prod-github-runner-207 kernel: [15504.590982] ? _raw_spin_lock+0x22/0x30 Aug 22 09:42:10 juju-e4d256-prod-github-runner-207 kernel: [15504.591937] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:42:10 juju-e4d256-prod-github-runner-207 kernel: [15504.592971] direct_page_fault+0x206/0x310 [kvm] Aug 22 09:42:10 juju-e4d256-prod-github-runner-207 kernel: [15504.594005] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 09:42:10 juju-e4d256-prod-github-runner-207 kernel: [15504.595032] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 09:42:10 juju-e4d256-prod-github-runner-207 kernel: [15504.596033] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 09:42:10 juju-e4d256-prod-github-runner-207 kernel: [15504.597022] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 09:42:10 juju-e4d256-prod-github-runner-207 kernel: [15504.597964] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 09:42:10 juju-e4d256-prod-github-runner-207 kernel: [15504.598949] handle_exit+0x98/0x230 [kvm_amd] Aug 22 09:42:10 juju-e4d256-prod-github-runner-207 kernel: [15504.599844] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 09:42:10 juju-e4d256-prod-github-runner-207 kernel: [15504.600755] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 09:42:10 juju-e4d256-prod-github-runner-207 kernel: [15504.601681] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 09:42:10 juju-e4d256-prod-github-runner-207 kernel: [15504.602601] vcpu_run+0x62/0x2c0 [kvm] Aug 22 09:42:10 juju-e4d256-prod-github-runner-207 kernel: [15504.603428] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 09:42:10 juju-e4d256-prod-github-runner-207 kernel: [15504.604267] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 09:42:10 juju-e4d256-prod-github-runner-207 kernel: [15504.605127] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 09:42:10 juju-e4d256-prod-github-runner-207 kernel: [15504.605921] ? __seccomp_filter+0x4a/0x4a0 Aug 22 09:42:10 juju-e4d256-prod-github-runner-207 kernel: [15504.606679] ? __fget_files+0x86/0xc0 Aug 22 09:42:10 juju-e4d256-prod-github-runner-207 kernel: [15504.607386] __x64_sys_ioctl+0x95/0xd0 Aug 22 09:42:10 juju-e4d256-prod-github-runner-207 kernel: [15504.608076] do_syscall_64+0x5c/0xc0 Aug 22 09:42:10 juju-e4d256-prod-github-runner-207 kernel: [15504.608742] ? do_futex+0x162/0x1f0 Aug 22 09:42:10 juju-e4d256-prod-github-runner-207 kernel: [15504.609395] ? __x64_sys_futex+0x78/0x1e0 Aug 22 09:42:10 juju-e4d256-prod-github-runner-207 kernel: [15504.610066] ? __secure_computing+0xa9/0x120 Aug 22 09:42:10 juju-e4d256-prod-github-runner-207 kernel: [15504.610774] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 09:42:10 juju-e4d256-prod-github-runner-207 kernel: [15504.611531] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:42:10 juju-e4d256-prod-github-runner-207 kernel: [15504.612250] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:42:10 juju-e4d256-prod-github-runner-207 kernel: [15504.612965] ? do_syscall_64+0x69/0xc0 Aug 22 09:42:10 juju-e4d256-prod-github-runner-207 kernel: [15504.613608] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:42:10 juju-e4d256-prod-github-runner-207 kernel: [15504.614323] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:42:10 juju-e4d256-prod-github-runner-207 kernel: [15504.615023] ? do_syscall_64+0x69/0xc0 Aug 22 09:42:10 juju-e4d256-prod-github-runner-207 kernel: [15504.615650] ? do_syscall_64+0x69/0xc0 Aug 22 09:42:10 juju-e4d256-prod-github-runner-207 kernel: [15504.616269] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 09:42:10 juju-e4d256-prod-github-runner-207 kernel: [15504.616974] RIP: 0033:0x7faa5d0edaff Aug 22 09:42:10 juju-e4d256-prod-github-runner-207 kernel: [15504.617632] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 09:42:10 juju-e4d256-prod-github-runner-207 kernel: [15504.619623] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 09:42:10 juju-e4d256-prod-github-runner-207 kernel: [15504.620539] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 09:42:10 juju-e4d256-prod-github-runner-207 kernel: [15504.621452] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 09:42:10 juju-e4d256-prod-github-runner-207 kernel: [15504.622367] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 09:42:10 juju-e4d256-prod-github-runner-207 kernel: [15504.623252] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 09:42:10 juju-e4d256-prod-github-runner-207 kernel: [15504.624142] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 09:42:10 juju-e4d256-prod-github-runner-207 kernel: [15504.625032] Aug 22 09:42:38 juju-e4d256-prod-github-runner-207 kernel: [15532.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 14357s! [qemu-system-x86:6715] Aug 22 09:42:38 juju-e4d256-prod-github-runner-207 kernel: [15532.543750] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 09:42:38 juju-e4d256-prod-github-runner-207 kernel: [15532.544001] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 09:42:38 juju-e4d256-prod-github-runner-207 kernel: [15532.556136] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 09:42:38 juju-e4d256-prod-github-runner-207 kernel: [15532.557398] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 09:42:38 juju-e4d256-prod-github-runner-207 kernel: [15532.558637] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:42:38 juju-e4d256-prod-github-runner-207 kernel: [15532.559701] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 09:42:38 juju-e4d256-prod-github-runner-207 kernel: [15532.562336] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 09:42:38 juju-e4d256-prod-github-runner-207 kernel: [15532.563429] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 09:42:38 juju-e4d256-prod-github-runner-207 kernel: [15532.564589] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 09:42:38 juju-e4d256-prod-github-runner-207 kernel: [15532.565750] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 09:42:38 juju-e4d256-prod-github-runner-207 kernel: [15532.566984] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 09:42:38 juju-e4d256-prod-github-runner-207 kernel: [15532.568155] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 09:42:38 juju-e4d256-prod-github-runner-207 kernel: [15532.569322] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 09:42:38 juju-e4d256-prod-github-runner-207 kernel: [15532.570587] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 09:42:38 juju-e4d256-prod-github-runner-207 kernel: [15532.571709] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 09:42:38 juju-e4d256-prod-github-runner-207 kernel: [15532.572911] Call Trace: Aug 22 09:42:38 juju-e4d256-prod-github-runner-207 kernel: [15532.573847] Aug 22 09:42:38 juju-e4d256-prod-github-runner-207 kernel: [15532.574763] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:42:38 juju-e4d256-prod-github-runner-207 kernel: [15532.575813] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:42:38 juju-e4d256-prod-github-runner-207 kernel: [15532.576866] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:42:38 juju-e4d256-prod-github-runner-207 kernel: [15532.578026] ? show_regs.part.0+0x23/0x29 Aug 22 09:42:38 juju-e4d256-prod-github-runner-207 kernel: [15532.579028] ? show_regs.cold+0x8/0xd Aug 22 09:42:38 juju-e4d256-prod-github-runner-207 kernel: [15532.580001] ? watchdog_timer_fn+0x1be/0x220 Aug 22 09:42:38 juju-e4d256-prod-github-runner-207 kernel: [15532.581026] ? lockup_detector_update_enable+0x60/0x60 Aug 22 09:42:38 juju-e4d256-prod-github-runner-207 kernel: [15532.582106] ? __hrtimer_run_queues+0x107/0x230 Aug 22 09:42:38 juju-e4d256-prod-github-runner-207 kernel: [15532.583142] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 09:42:38 juju-e4d256-prod-github-runner-207 kernel: [15532.584171] ? hrtimer_interrupt+0x101/0x220 Aug 22 09:42:38 juju-e4d256-prod-github-runner-207 kernel: [15532.585200] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 09:42:38 juju-e4d256-prod-github-runner-207 kernel: [15532.586292] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 09:42:38 juju-e4d256-prod-github-runner-207 kernel: [15532.587346] Aug 22 09:42:38 juju-e4d256-prod-github-runner-207 kernel: [15532.588212] Aug 22 09:42:38 juju-e4d256-prod-github-runner-207 kernel: [15532.589054] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 09:42:38 juju-e4d256-prod-github-runner-207 kernel: [15532.590115] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:42:38 juju-e4d256-prod-github-runner-207 kernel: [15532.591168] ? _raw_spin_lock+0x22/0x30 Aug 22 09:42:38 juju-e4d256-prod-github-runner-207 kernel: [15532.592117] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:42:38 juju-e4d256-prod-github-runner-207 kernel: [15532.593193] direct_page_fault+0x206/0x310 [kvm] Aug 22 09:42:38 juju-e4d256-prod-github-runner-207 kernel: [15532.594264] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 09:42:38 juju-e4d256-prod-github-runner-207 kernel: [15532.595284] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 09:42:38 juju-e4d256-prod-github-runner-207 kernel: [15532.596310] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 09:42:38 juju-e4d256-prod-github-runner-207 kernel: [15532.597326] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 09:42:38 juju-e4d256-prod-github-runner-207 kernel: [15532.598296] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 09:42:38 juju-e4d256-prod-github-runner-207 kernel: [15532.599291] handle_exit+0x98/0x230 [kvm_amd] Aug 22 09:42:38 juju-e4d256-prod-github-runner-207 kernel: [15532.600198] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 09:42:38 juju-e4d256-prod-github-runner-207 kernel: [15532.601127] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 09:42:38 juju-e4d256-prod-github-runner-207 kernel: [15532.602069] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 09:42:38 juju-e4d256-prod-github-runner-207 kernel: [15532.602980] vcpu_run+0x62/0x2c0 [kvm] Aug 22 09:42:38 juju-e4d256-prod-github-runner-207 kernel: [15532.603796] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 09:42:38 juju-e4d256-prod-github-runner-207 kernel: [15532.604633] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 09:42:38 juju-e4d256-prod-github-runner-207 kernel: [15532.605502] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 09:42:38 juju-e4d256-prod-github-runner-207 kernel: [15532.606324] ? __seccomp_filter+0x4a/0x4a0 Aug 22 09:42:38 juju-e4d256-prod-github-runner-207 kernel: [15532.607073] ? __fget_files+0x86/0xc0 Aug 22 09:42:38 juju-e4d256-prod-github-runner-207 kernel: [15532.607781] __x64_sys_ioctl+0x95/0xd0 Aug 22 09:42:38 juju-e4d256-prod-github-runner-207 kernel: [15532.608477] do_syscall_64+0x5c/0xc0 Aug 22 09:42:38 juju-e4d256-prod-github-runner-207 kernel: [15532.609152] ? do_futex+0x162/0x1f0 Aug 22 09:42:38 juju-e4d256-prod-github-runner-207 kernel: [15532.609852] ? __x64_sys_futex+0x78/0x1e0 Aug 22 09:42:38 juju-e4d256-prod-github-runner-207 kernel: [15532.610532] ? __secure_computing+0xa9/0x120 Aug 22 09:42:38 juju-e4d256-prod-github-runner-207 kernel: [15532.611227] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 09:42:38 juju-e4d256-prod-github-runner-207 kernel: [15532.612011] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:42:38 juju-e4d256-prod-github-runner-207 kernel: [15532.612738] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:42:38 juju-e4d256-prod-github-runner-207 kernel: [15532.613461] ? do_syscall_64+0x69/0xc0 Aug 22 09:42:38 juju-e4d256-prod-github-runner-207 kernel: [15532.614126] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:42:38 juju-e4d256-prod-github-runner-207 kernel: [15532.614833] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:42:38 juju-e4d256-prod-github-runner-207 kernel: [15532.615542] ? do_syscall_64+0x69/0xc0 Aug 22 09:42:38 juju-e4d256-prod-github-runner-207 kernel: [15532.616171] ? do_syscall_64+0x69/0xc0 Aug 22 09:42:38 juju-e4d256-prod-github-runner-207 kernel: [15532.616795] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 09:42:38 juju-e4d256-prod-github-runner-207 kernel: [15532.617505] RIP: 0033:0x7faa5d0edaff Aug 22 09:42:38 juju-e4d256-prod-github-runner-207 kernel: [15532.618205] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 09:42:38 juju-e4d256-prod-github-runner-207 kernel: [15532.620247] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 09:42:38 juju-e4d256-prod-github-runner-207 kernel: [15532.621185] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 09:42:38 juju-e4d256-prod-github-runner-207 kernel: [15532.622103] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 09:42:38 juju-e4d256-prod-github-runner-207 kernel: [15532.623044] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 09:42:38 juju-e4d256-prod-github-runner-207 kernel: [15532.623938] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 09:42:38 juju-e4d256-prod-github-runner-207 kernel: [15532.624829] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 09:42:38 juju-e4d256-prod-github-runner-207 kernel: [15532.625745] Aug 22 09:43:06 juju-e4d256-prod-github-runner-207 kernel: [15560.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 14383s! [qemu-system-x86:6715] Aug 22 09:43:06 juju-e4d256-prod-github-runner-207 kernel: [15560.543745] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 09:43:06 juju-e4d256-prod-github-runner-207 kernel: [15560.544004] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 09:43:06 juju-e4d256-prod-github-runner-207 kernel: [15560.556124] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 09:43:06 juju-e4d256-prod-github-runner-207 kernel: [15560.557410] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 09:43:06 juju-e4d256-prod-github-runner-207 kernel: [15560.558659] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:43:06 juju-e4d256-prod-github-runner-207 kernel: [15560.559715] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 09:43:06 juju-e4d256-prod-github-runner-207 kernel: [15560.562291] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 09:43:06 juju-e4d256-prod-github-runner-207 kernel: [15560.563354] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 09:43:06 juju-e4d256-prod-github-runner-207 kernel: [15560.564519] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 09:43:06 juju-e4d256-prod-github-runner-207 kernel: [15560.565700] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 09:43:06 juju-e4d256-prod-github-runner-207 kernel: [15560.566887] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 09:43:06 juju-e4d256-prod-github-runner-207 kernel: [15560.568075] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 09:43:06 juju-e4d256-prod-github-runner-207 kernel: [15560.569250] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 09:43:06 juju-e4d256-prod-github-runner-207 kernel: [15560.570500] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 09:43:06 juju-e4d256-prod-github-runner-207 kernel: [15560.571603] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 09:43:06 juju-e4d256-prod-github-runner-207 kernel: [15560.572811] Call Trace: Aug 22 09:43:06 juju-e4d256-prod-github-runner-207 kernel: [15560.573748] Aug 22 09:43:06 juju-e4d256-prod-github-runner-207 kernel: [15560.574641] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:43:06 juju-e4d256-prod-github-runner-207 kernel: [15560.575671] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:43:06 juju-e4d256-prod-github-runner-207 kernel: [15560.576699] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:43:06 juju-e4d256-prod-github-runner-207 kernel: [15560.577827] ? show_regs.part.0+0x23/0x29 Aug 22 09:43:06 juju-e4d256-prod-github-runner-207 kernel: [15560.578851] ? show_regs.cold+0x8/0xd Aug 22 09:43:06 juju-e4d256-prod-github-runner-207 kernel: [15560.579825] ? watchdog_timer_fn+0x1be/0x220 Aug 22 09:43:06 juju-e4d256-prod-github-runner-207 kernel: [15560.580833] ? lockup_detector_update_enable+0x60/0x60 Aug 22 09:43:06 juju-e4d256-prod-github-runner-207 kernel: [15560.581919] ? __hrtimer_run_queues+0x107/0x230 Aug 22 09:43:06 juju-e4d256-prod-github-runner-207 kernel: [15560.582977] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 09:43:06 juju-e4d256-prod-github-runner-207 kernel: [15560.584031] ? hrtimer_interrupt+0x101/0x220 Aug 22 09:43:06 juju-e4d256-prod-github-runner-207 kernel: [15560.585045] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 09:43:06 juju-e4d256-prod-github-runner-207 kernel: [15560.586130] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 09:43:06 juju-e4d256-prod-github-runner-207 kernel: [15560.587176] Aug 22 09:43:06 juju-e4d256-prod-github-runner-207 kernel: [15560.588047] Aug 22 09:43:06 juju-e4d256-prod-github-runner-207 kernel: [15560.588896] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 09:43:06 juju-e4d256-prod-github-runner-207 kernel: [15560.589944] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:43:06 juju-e4d256-prod-github-runner-207 kernel: [15560.590989] ? _raw_spin_lock+0x22/0x30 Aug 22 09:43:06 juju-e4d256-prod-github-runner-207 kernel: [15560.591938] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:43:06 juju-e4d256-prod-github-runner-207 kernel: [15560.592972] direct_page_fault+0x206/0x310 [kvm] Aug 22 09:43:06 juju-e4d256-prod-github-runner-207 kernel: [15560.594040] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 09:43:06 juju-e4d256-prod-github-runner-207 kernel: [15560.595053] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 09:43:06 juju-e4d256-prod-github-runner-207 kernel: [15560.596054] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 09:43:06 juju-e4d256-prod-github-runner-207 kernel: [15560.597055] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 09:43:06 juju-e4d256-prod-github-runner-207 kernel: [15560.598030] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 09:43:06 juju-e4d256-prod-github-runner-207 kernel: [15560.599022] handle_exit+0x98/0x230 [kvm_amd] Aug 22 09:43:06 juju-e4d256-prod-github-runner-207 kernel: [15560.599917] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 09:43:06 juju-e4d256-prod-github-runner-207 kernel: [15560.600830] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 09:43:06 juju-e4d256-prod-github-runner-207 kernel: [15560.601770] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 09:43:06 juju-e4d256-prod-github-runner-207 kernel: [15560.602684] vcpu_run+0x62/0x2c0 [kvm] Aug 22 09:43:06 juju-e4d256-prod-github-runner-207 kernel: [15560.603520] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 09:43:06 juju-e4d256-prod-github-runner-207 kernel: [15560.604338] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 09:43:06 juju-e4d256-prod-github-runner-207 kernel: [15560.605194] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 09:43:06 juju-e4d256-prod-github-runner-207 kernel: [15560.606004] ? __seccomp_filter+0x4a/0x4a0 Aug 22 09:43:06 juju-e4d256-prod-github-runner-207 kernel: [15560.606746] ? __fget_files+0x86/0xc0 Aug 22 09:43:06 juju-e4d256-prod-github-runner-207 kernel: [15560.607452] __x64_sys_ioctl+0x95/0xd0 Aug 22 09:43:06 juju-e4d256-prod-github-runner-207 kernel: [15560.608154] do_syscall_64+0x5c/0xc0 Aug 22 09:43:06 juju-e4d256-prod-github-runner-207 kernel: [15560.608822] ? do_futex+0x162/0x1f0 Aug 22 09:43:06 juju-e4d256-prod-github-runner-207 kernel: [15560.609496] ? __x64_sys_futex+0x78/0x1e0 Aug 22 09:43:06 juju-e4d256-prod-github-runner-207 kernel: [15560.610174] ? __secure_computing+0xa9/0x120 Aug 22 09:43:06 juju-e4d256-prod-github-runner-207 kernel: [15560.610862] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 09:43:06 juju-e4d256-prod-github-runner-207 kernel: [15560.611620] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:43:06 juju-e4d256-prod-github-runner-207 kernel: [15560.612344] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:43:06 juju-e4d256-prod-github-runner-207 kernel: [15560.613078] ? do_syscall_64+0x69/0xc0 Aug 22 09:43:06 juju-e4d256-prod-github-runner-207 kernel: [15560.613737] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:43:06 juju-e4d256-prod-github-runner-207 kernel: [15560.614457] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:43:06 juju-e4d256-prod-github-runner-207 kernel: [15560.615153] ? do_syscall_64+0x69/0xc0 Aug 22 09:43:06 juju-e4d256-prod-github-runner-207 kernel: [15560.615776] ? do_syscall_64+0x69/0xc0 Aug 22 09:43:06 juju-e4d256-prod-github-runner-207 kernel: [15560.616402] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 09:43:06 juju-e4d256-prod-github-runner-207 kernel: [15560.617105] RIP: 0033:0x7faa5d0edaff Aug 22 09:43:06 juju-e4d256-prod-github-runner-207 kernel: [15560.617757] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 09:43:06 juju-e4d256-prod-github-runner-207 kernel: [15560.619771] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 09:43:06 juju-e4d256-prod-github-runner-207 kernel: [15560.620684] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 09:43:06 juju-e4d256-prod-github-runner-207 kernel: [15560.621588] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 09:43:06 juju-e4d256-prod-github-runner-207 kernel: [15560.622479] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 09:43:06 juju-e4d256-prod-github-runner-207 kernel: [15560.623380] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 09:43:06 juju-e4d256-prod-github-runner-207 kernel: [15560.624271] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 09:43:06 juju-e4d256-prod-github-runner-207 kernel: [15560.625177] Aug 22 09:43:34 juju-e4d256-prod-github-runner-207 kernel: [15588.541983] watchdog: BUG: soft lockup - CPU#1 stuck for 14409s! [qemu-system-x86:6715] Aug 22 09:43:34 juju-e4d256-prod-github-runner-207 kernel: [15588.543935] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 09:43:34 juju-e4d256-prod-github-runner-207 kernel: [15588.544208] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 09:43:34 juju-e4d256-prod-github-runner-207 kernel: [15588.556462] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 09:43:34 juju-e4d256-prod-github-runner-207 kernel: [15588.557776] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 09:43:34 juju-e4d256-prod-github-runner-207 kernel: [15588.559016] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:43:34 juju-e4d256-prod-github-runner-207 kernel: [15588.560079] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 09:43:34 juju-e4d256-prod-github-runner-207 kernel: [15588.562678] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 09:43:34 juju-e4d256-prod-github-runner-207 kernel: [15588.563752] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 09:43:34 juju-e4d256-prod-github-runner-207 kernel: [15588.564947] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 09:43:34 juju-e4d256-prod-github-runner-207 kernel: [15588.566126] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 09:43:34 juju-e4d256-prod-github-runner-207 kernel: [15588.567288] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 09:43:34 juju-e4d256-prod-github-runner-207 kernel: [15588.568457] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 09:43:34 juju-e4d256-prod-github-runner-207 kernel: [15588.569667] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 09:43:34 juju-e4d256-prod-github-runner-207 kernel: [15588.570911] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 09:43:34 juju-e4d256-prod-github-runner-207 kernel: [15588.572015] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 09:43:34 juju-e4d256-prod-github-runner-207 kernel: [15588.573232] Call Trace: Aug 22 09:43:34 juju-e4d256-prod-github-runner-207 kernel: [15588.574162] Aug 22 09:43:34 juju-e4d256-prod-github-runner-207 kernel: [15588.575086] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:43:34 juju-e4d256-prod-github-runner-207 kernel: [15588.576119] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:43:34 juju-e4d256-prod-github-runner-207 kernel: [15588.577157] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:43:34 juju-e4d256-prod-github-runner-207 kernel: [15588.578253] ? show_regs.part.0+0x23/0x29 Aug 22 09:43:34 juju-e4d256-prod-github-runner-207 kernel: [15588.579266] ? show_regs.cold+0x8/0xd Aug 22 09:43:34 juju-e4d256-prod-github-runner-207 kernel: [15588.580260] ? watchdog_timer_fn+0x1be/0x220 Aug 22 09:43:34 juju-e4d256-prod-github-runner-207 kernel: [15588.581292] ? lockup_detector_update_enable+0x60/0x60 Aug 22 09:43:34 juju-e4d256-prod-github-runner-207 kernel: [15588.582368] ? __hrtimer_run_queues+0x107/0x230 Aug 22 09:43:34 juju-e4d256-prod-github-runner-207 kernel: [15588.583399] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 09:43:34 juju-e4d256-prod-github-runner-207 kernel: [15588.584442] ? hrtimer_interrupt+0x101/0x220 Aug 22 09:43:34 juju-e4d256-prod-github-runner-207 kernel: [15588.585498] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 09:43:34 juju-e4d256-prod-github-runner-207 kernel: [15588.586571] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 09:43:34 juju-e4d256-prod-github-runner-207 kernel: [15588.587618] Aug 22 09:43:34 juju-e4d256-prod-github-runner-207 kernel: [15588.588479] Aug 22 09:43:34 juju-e4d256-prod-github-runner-207 kernel: [15588.589348] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 09:43:34 juju-e4d256-prod-github-runner-207 kernel: [15588.590408] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:43:34 juju-e4d256-prod-github-runner-207 kernel: [15588.591457] ? _raw_spin_lock+0x22/0x30 Aug 22 09:43:34 juju-e4d256-prod-github-runner-207 kernel: [15588.592405] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:43:34 juju-e4d256-prod-github-runner-207 kernel: [15588.594328] direct_page_fault+0x206/0x310 [kvm] Aug 22 09:43:34 juju-e4d256-prod-github-runner-207 kernel: [15588.595392] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 09:43:34 juju-e4d256-prod-github-runner-207 kernel: [15588.596404] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 09:43:34 juju-e4d256-prod-github-runner-207 kernel: [15588.597435] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 09:43:34 juju-e4d256-prod-github-runner-207 kernel: [15588.598447] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 09:43:34 juju-e4d256-prod-github-runner-207 kernel: [15588.599404] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 09:43:34 juju-e4d256-prod-github-runner-207 kernel: [15588.600405] handle_exit+0x98/0x230 [kvm_amd] Aug 22 09:43:34 juju-e4d256-prod-github-runner-207 kernel: [15588.601321] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 09:43:34 juju-e4d256-prod-github-runner-207 kernel: [15588.602245] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 09:43:34 juju-e4d256-prod-github-runner-207 kernel: [15588.603175] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 09:43:34 juju-e4d256-prod-github-runner-207 kernel: [15588.604082] vcpu_run+0x62/0x2c0 [kvm] Aug 22 09:43:34 juju-e4d256-prod-github-runner-207 kernel: [15588.604915] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 09:43:34 juju-e4d256-prod-github-runner-207 kernel: [15588.605774] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 09:43:34 juju-e4d256-prod-github-runner-207 kernel: [15588.606648] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 09:43:34 juju-e4d256-prod-github-runner-207 kernel: [15588.607450] ? __seccomp_filter+0x4a/0x4a0 Aug 22 09:43:34 juju-e4d256-prod-github-runner-207 kernel: [15588.608197] ? __fget_files+0x86/0xc0 Aug 22 09:43:34 juju-e4d256-prod-github-runner-207 kernel: [15588.608905] __x64_sys_ioctl+0x95/0xd0 Aug 22 09:43:34 juju-e4d256-prod-github-runner-207 kernel: [15588.609636] do_syscall_64+0x5c/0xc0 Aug 22 09:43:34 juju-e4d256-prod-github-runner-207 kernel: [15588.610311] ? do_futex+0x162/0x1f0 Aug 22 09:43:34 juju-e4d256-prod-github-runner-207 kernel: [15588.610983] ? __x64_sys_futex+0x78/0x1e0 Aug 22 09:43:34 juju-e4d256-prod-github-runner-207 kernel: [15588.611666] ? __secure_computing+0xa9/0x120 Aug 22 09:43:34 juju-e4d256-prod-github-runner-207 kernel: [15588.612360] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 09:43:34 juju-e4d256-prod-github-runner-207 kernel: [15588.613141] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:43:34 juju-e4d256-prod-github-runner-207 kernel: [15588.613869] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:43:34 juju-e4d256-prod-github-runner-207 kernel: [15588.614597] ? do_syscall_64+0x69/0xc0 Aug 22 09:43:34 juju-e4d256-prod-github-runner-207 kernel: [15588.615257] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:43:34 juju-e4d256-prod-github-runner-207 kernel: [15588.615982] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:43:34 juju-e4d256-prod-github-runner-207 kernel: [15588.616690] ? do_syscall_64+0x69/0xc0 Aug 22 09:43:34 juju-e4d256-prod-github-runner-207 kernel: [15588.617336] ? do_syscall_64+0x69/0xc0 Aug 22 09:43:34 juju-e4d256-prod-github-runner-207 kernel: [15588.617963] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 09:43:34 juju-e4d256-prod-github-runner-207 kernel: [15588.618672] RIP: 0033:0x7faa5d0edaff Aug 22 09:43:34 juju-e4d256-prod-github-runner-207 kernel: [15588.619345] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 09:43:34 juju-e4d256-prod-github-runner-207 kernel: [15588.621382] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 09:43:34 juju-e4d256-prod-github-runner-207 kernel: [15588.622305] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 09:43:34 juju-e4d256-prod-github-runner-207 kernel: [15588.623199] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 09:43:34 juju-e4d256-prod-github-runner-207 kernel: [15588.624091] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 09:43:34 juju-e4d256-prod-github-runner-207 kernel: [15588.624992] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 09:43:34 juju-e4d256-prod-github-runner-207 kernel: [15588.625916] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 09:43:34 juju-e4d256-prod-github-runner-207 kernel: [15588.626831] Aug 22 09:44:02 juju-e4d256-prod-github-runner-207 kernel: [15616.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 14436s! [qemu-system-x86:6715] Aug 22 09:44:02 juju-e4d256-prod-github-runner-207 kernel: [15616.543773] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 09:44:02 juju-e4d256-prod-github-runner-207 kernel: [15616.544040] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 09:44:02 juju-e4d256-prod-github-runner-207 kernel: [15616.556109] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 09:44:02 juju-e4d256-prod-github-runner-207 kernel: [15616.557398] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 09:44:02 juju-e4d256-prod-github-runner-207 kernel: [15616.558623] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:44:02 juju-e4d256-prod-github-runner-207 kernel: [15616.559678] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 09:44:02 juju-e4d256-prod-github-runner-207 kernel: [15616.562243] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 09:44:02 juju-e4d256-prod-github-runner-207 kernel: [15616.563289] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 09:44:02 juju-e4d256-prod-github-runner-207 kernel: [15616.564449] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 09:44:02 juju-e4d256-prod-github-runner-207 kernel: [15616.565627] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 09:44:02 juju-e4d256-prod-github-runner-207 kernel: [15616.566785] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 09:44:02 juju-e4d256-prod-github-runner-207 kernel: [15616.567960] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 09:44:02 juju-e4d256-prod-github-runner-207 kernel: [15616.569142] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 09:44:02 juju-e4d256-prod-github-runner-207 kernel: [15616.570374] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 09:44:02 juju-e4d256-prod-github-runner-207 kernel: [15616.571482] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 09:44:02 juju-e4d256-prod-github-runner-207 kernel: [15616.572677] Call Trace: Aug 22 09:44:02 juju-e4d256-prod-github-runner-207 kernel: [15616.573605] Aug 22 09:44:02 juju-e4d256-prod-github-runner-207 kernel: [15616.574504] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:44:02 juju-e4d256-prod-github-runner-207 kernel: [15616.575533] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:44:02 juju-e4d256-prod-github-runner-207 kernel: [15616.576558] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:44:02 juju-e4d256-prod-github-runner-207 kernel: [15616.577673] ? show_regs.part.0+0x23/0x29 Aug 22 09:44:02 juju-e4d256-prod-github-runner-207 kernel: [15616.578671] ? show_regs.cold+0x8/0xd Aug 22 09:44:02 juju-e4d256-prod-github-runner-207 kernel: [15616.579645] ? watchdog_timer_fn+0x1be/0x220 Aug 22 09:44:02 juju-e4d256-prod-github-runner-207 kernel: [15616.580656] ? lockup_detector_update_enable+0x60/0x60 Aug 22 09:44:02 juju-e4d256-prod-github-runner-207 kernel: [15616.581737] ? __hrtimer_run_queues+0x107/0x230 Aug 22 09:44:02 juju-e4d256-prod-github-runner-207 kernel: [15616.582764] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 09:44:02 juju-e4d256-prod-github-runner-207 kernel: [15616.583791] ? hrtimer_interrupt+0x101/0x220 Aug 22 09:44:02 juju-e4d256-prod-github-runner-207 kernel: [15616.584818] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 09:44:02 juju-e4d256-prod-github-runner-207 kernel: [15616.585888] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 09:44:02 juju-e4d256-prod-github-runner-207 kernel: [15616.586934] Aug 22 09:44:02 juju-e4d256-prod-github-runner-207 kernel: [15616.587803] Aug 22 09:44:02 juju-e4d256-prod-github-runner-207 kernel: [15616.588642] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 09:44:02 juju-e4d256-prod-github-runner-207 kernel: [15616.589699] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:44:02 juju-e4d256-prod-github-runner-207 kernel: [15616.590739] ? _raw_spin_lock+0x22/0x30 Aug 22 09:44:02 juju-e4d256-prod-github-runner-207 kernel: [15616.591687] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:44:02 juju-e4d256-prod-github-runner-207 kernel: [15616.592706] direct_page_fault+0x206/0x310 [kvm] Aug 22 09:44:02 juju-e4d256-prod-github-runner-207 kernel: [15616.593746] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 09:44:02 juju-e4d256-prod-github-runner-207 kernel: [15616.594753] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 09:44:02 juju-e4d256-prod-github-runner-207 kernel: [15616.595761] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 09:44:02 juju-e4d256-prod-github-runner-207 kernel: [15616.596784] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 09:44:02 juju-e4d256-prod-github-runner-207 kernel: [15616.597733] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 09:44:02 juju-e4d256-prod-github-runner-207 kernel: [15616.598718] handle_exit+0x98/0x230 [kvm_amd] Aug 22 09:44:02 juju-e4d256-prod-github-runner-207 kernel: [15616.599608] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 09:44:02 juju-e4d256-prod-github-runner-207 kernel: [15616.600519] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 09:44:02 juju-e4d256-prod-github-runner-207 kernel: [15616.601459] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 09:44:02 juju-e4d256-prod-github-runner-207 kernel: [15616.602363] vcpu_run+0x62/0x2c0 [kvm] Aug 22 09:44:02 juju-e4d256-prod-github-runner-207 kernel: [15616.603179] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 09:44:02 juju-e4d256-prod-github-runner-207 kernel: [15616.603985] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 09:44:02 juju-e4d256-prod-github-runner-207 kernel: [15616.604855] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 09:44:02 juju-e4d256-prod-github-runner-207 kernel: [15616.605652] ? __seccomp_filter+0x4a/0x4a0 Aug 22 09:44:02 juju-e4d256-prod-github-runner-207 kernel: [15616.606394] ? __fget_files+0x86/0xc0 Aug 22 09:44:02 juju-e4d256-prod-github-runner-207 kernel: [15616.607099] __x64_sys_ioctl+0x95/0xd0 Aug 22 09:44:02 juju-e4d256-prod-github-runner-207 kernel: [15616.607793] do_syscall_64+0x5c/0xc0 Aug 22 09:44:02 juju-e4d256-prod-github-runner-207 kernel: [15616.608478] ? do_futex+0x162/0x1f0 Aug 22 09:44:02 juju-e4d256-prod-github-runner-207 kernel: [15616.609143] ? __x64_sys_futex+0x78/0x1e0 Aug 22 09:44:02 juju-e4d256-prod-github-runner-207 kernel: [15616.609823] ? __secure_computing+0xa9/0x120 Aug 22 09:44:02 juju-e4d256-prod-github-runner-207 kernel: [15616.610512] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 09:44:02 juju-e4d256-prod-github-runner-207 kernel: [15616.611273] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:44:02 juju-e4d256-prod-github-runner-207 kernel: [15616.612004] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:44:02 juju-e4d256-prod-github-runner-207 kernel: [15616.612722] ? do_syscall_64+0x69/0xc0 Aug 22 09:44:02 juju-e4d256-prod-github-runner-207 kernel: [15616.613383] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:44:02 juju-e4d256-prod-github-runner-207 kernel: [15616.614085] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:44:02 juju-e4d256-prod-github-runner-207 kernel: [15616.614784] ? do_syscall_64+0x69/0xc0 Aug 22 09:44:02 juju-e4d256-prod-github-runner-207 kernel: [15616.615407] ? do_syscall_64+0x69/0xc0 Aug 22 09:44:02 juju-e4d256-prod-github-runner-207 kernel: [15616.616029] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 09:44:02 juju-e4d256-prod-github-runner-207 kernel: [15616.616736] RIP: 0033:0x7faa5d0edaff Aug 22 09:44:02 juju-e4d256-prod-github-runner-207 kernel: [15616.617426] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 09:44:02 juju-e4d256-prod-github-runner-207 kernel: [15616.619423] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 09:44:02 juju-e4d256-prod-github-runner-207 kernel: [15616.620331] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 09:44:02 juju-e4d256-prod-github-runner-207 kernel: [15616.621240] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 09:44:02 juju-e4d256-prod-github-runner-207 kernel: [15616.622126] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 09:44:02 juju-e4d256-prod-github-runner-207 kernel: [15616.623017] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 09:44:02 juju-e4d256-prod-github-runner-207 kernel: [15616.623903] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 09:44:02 juju-e4d256-prod-github-runner-207 kernel: [15616.624808] Aug 22 09:44:30 juju-e4d256-prod-github-runner-207 kernel: [15644.541981] watchdog: BUG: soft lockup - CPU#1 stuck for 14462s! [qemu-system-x86:6715] Aug 22 09:44:30 juju-e4d256-prod-github-runner-207 kernel: [15644.543779] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 09:44:30 juju-e4d256-prod-github-runner-207 kernel: [15644.544069] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 09:44:30 juju-e4d256-prod-github-runner-207 kernel: [15644.557297] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 09:44:30 juju-e4d256-prod-github-runner-207 kernel: [15644.558658] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 09:44:30 juju-e4d256-prod-github-runner-207 kernel: [15644.560000] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:44:30 juju-e4d256-prod-github-runner-207 kernel: [15644.561235] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 09:44:30 juju-e4d256-prod-github-runner-207 kernel: [15644.564053] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 09:44:30 juju-e4d256-prod-github-runner-207 kernel: [15644.565126] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 09:44:30 juju-e4d256-prod-github-runner-207 kernel: [15644.566491] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 09:44:30 juju-e4d256-prod-github-runner-207 kernel: [15644.567651] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 09:44:30 juju-e4d256-prod-github-runner-207 kernel: [15644.569026] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 09:44:30 juju-e4d256-prod-github-runner-207 kernel: [15644.570195] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 09:44:30 juju-e4d256-prod-github-runner-207 kernel: [15644.571361] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 09:44:30 juju-e4d256-prod-github-runner-207 kernel: [15644.572619] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 09:44:30 juju-e4d256-prod-github-runner-207 kernel: [15644.573721] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 09:44:30 juju-e4d256-prod-github-runner-207 kernel: [15644.574923] Call Trace: Aug 22 09:44:30 juju-e4d256-prod-github-runner-207 kernel: [15644.575837] Aug 22 09:44:30 juju-e4d256-prod-github-runner-207 kernel: [15644.576761] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:44:30 juju-e4d256-prod-github-runner-207 kernel: [15644.577801] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:44:30 juju-e4d256-prod-github-runner-207 kernel: [15644.578829] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:44:30 juju-e4d256-prod-github-runner-207 kernel: [15644.579923] ? show_regs.part.0+0x23/0x29 Aug 22 09:44:30 juju-e4d256-prod-github-runner-207 kernel: [15644.580937] ? show_regs.cold+0x8/0xd Aug 22 09:44:30 juju-e4d256-prod-github-runner-207 kernel: [15644.581910] ? watchdog_timer_fn+0x1be/0x220 Aug 22 09:44:30 juju-e4d256-prod-github-runner-207 kernel: [15644.582916] ? lockup_detector_update_enable+0x60/0x60 Aug 22 09:44:30 juju-e4d256-prod-github-runner-207 kernel: [15644.583980] ? __hrtimer_run_queues+0x107/0x230 Aug 22 09:44:30 juju-e4d256-prod-github-runner-207 kernel: [15644.585032] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 09:44:30 juju-e4d256-prod-github-runner-207 kernel: [15644.586065] ? hrtimer_interrupt+0x101/0x220 Aug 22 09:44:30 juju-e4d256-prod-github-runner-207 kernel: [15644.587079] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 09:44:30 juju-e4d256-prod-github-runner-207 kernel: [15644.588147] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 09:44:30 juju-e4d256-prod-github-runner-207 kernel: [15644.589500] Aug 22 09:44:30 juju-e4d256-prod-github-runner-207 kernel: [15644.590373] Aug 22 09:44:30 juju-e4d256-prod-github-runner-207 kernel: [15644.591217] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 09:44:30 juju-e4d256-prod-github-runner-207 kernel: [15644.592251] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:44:30 juju-e4d256-prod-github-runner-207 kernel: [15644.593314] ? _raw_spin_lock+0x22/0x30 Aug 22 09:44:30 juju-e4d256-prod-github-runner-207 kernel: [15644.594334] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:44:30 juju-e4d256-prod-github-runner-207 kernel: [15644.595411] direct_page_fault+0x206/0x310 [kvm] Aug 22 09:44:30 juju-e4d256-prod-github-runner-207 kernel: [15644.596458] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 09:44:30 juju-e4d256-prod-github-runner-207 kernel: [15644.597473] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 09:44:30 juju-e4d256-prod-github-runner-207 kernel: [15644.598474] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 09:44:30 juju-e4d256-prod-github-runner-207 kernel: [15644.599479] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 09:44:30 juju-e4d256-prod-github-runner-207 kernel: [15644.600452] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 09:44:30 juju-e4d256-prod-github-runner-207 kernel: [15644.601433] handle_exit+0x98/0x230 [kvm_amd] Aug 22 09:44:30 juju-e4d256-prod-github-runner-207 kernel: [15644.602328] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 09:44:30 juju-e4d256-prod-github-runner-207 kernel: [15644.603246] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 09:44:30 juju-e4d256-prod-github-runner-207 kernel: [15644.604173] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 09:44:30 juju-e4d256-prod-github-runner-207 kernel: [15644.605105] vcpu_run+0x62/0x2c0 [kvm] Aug 22 09:44:30 juju-e4d256-prod-github-runner-207 kernel: [15644.605919] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 09:44:30 juju-e4d256-prod-github-runner-207 kernel: [15644.606732] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 09:44:30 juju-e4d256-prod-github-runner-207 kernel: [15644.607588] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 09:44:30 juju-e4d256-prod-github-runner-207 kernel: [15644.608387] ? __seccomp_filter+0x4a/0x4a0 Aug 22 09:44:30 juju-e4d256-prod-github-runner-207 kernel: [15644.609150] ? __fget_files+0x86/0xc0 Aug 22 09:44:30 juju-e4d256-prod-github-runner-207 kernel: [15644.609862] __x64_sys_ioctl+0x95/0xd0 Aug 22 09:44:30 juju-e4d256-prod-github-runner-207 kernel: [15644.610556] do_syscall_64+0x5c/0xc0 Aug 22 09:44:30 juju-e4d256-prod-github-runner-207 kernel: [15644.611225] ? do_futex+0x162/0x1f0 Aug 22 09:44:30 juju-e4d256-prod-github-runner-207 kernel: [15644.611875] ? __x64_sys_futex+0x78/0x1e0 Aug 22 09:44:30 juju-e4d256-prod-github-runner-207 kernel: [15644.612568] ? __secure_computing+0xa9/0x120 Aug 22 09:44:30 juju-e4d256-prod-github-runner-207 kernel: [15644.613263] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 09:44:30 juju-e4d256-prod-github-runner-207 kernel: [15644.614029] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:44:30 juju-e4d256-prod-github-runner-207 kernel: [15644.614756] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:44:30 juju-e4d256-prod-github-runner-207 kernel: [15644.615481] ? do_syscall_64+0x69/0xc0 Aug 22 09:44:30 juju-e4d256-prod-github-runner-207 kernel: [15644.616132] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:44:30 juju-e4d256-prod-github-runner-207 kernel: [15644.616854] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:44:30 juju-e4d256-prod-github-runner-207 kernel: [15644.617552] ? do_syscall_64+0x69/0xc0 Aug 22 09:44:30 juju-e4d256-prod-github-runner-207 kernel: [15644.618179] ? do_syscall_64+0x69/0xc0 Aug 22 09:44:30 juju-e4d256-prod-github-runner-207 kernel: [15644.618801] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 09:44:30 juju-e4d256-prod-github-runner-207 kernel: [15644.619511] RIP: 0033:0x7faa5d0edaff Aug 22 09:44:30 juju-e4d256-prod-github-runner-207 kernel: [15644.620182] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 09:44:30 juju-e4d256-prod-github-runner-207 kernel: [15644.622198] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 09:44:30 juju-e4d256-prod-github-runner-207 kernel: [15644.623118] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 09:44:30 juju-e4d256-prod-github-runner-207 kernel: [15644.624009] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 09:44:30 juju-e4d256-prod-github-runner-207 kernel: [15644.624931] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 09:44:30 juju-e4d256-prod-github-runner-207 kernel: [15644.625827] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 09:44:30 juju-e4d256-prod-github-runner-207 kernel: [15644.626714] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 09:44:30 juju-e4d256-prod-github-runner-207 kernel: [15644.627612] Aug 22 09:44:44 juju-e4d256-prod-github-runner-207 kernel: [15658.232706] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 09:44:44 juju-e4d256-prod-github-runner-207 kernel: [15658.234066] rcu: 1-....: (3873083 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=1870671 Aug 22 09:44:44 juju-e4d256-prod-github-runner-207 kernel: [15658.235184] (t=3885258 jiffies g=23269 q=22839) Aug 22 09:44:44 juju-e4d256-prod-github-runner-207 kernel: [15658.235963] NMI backtrace for cpu 1 Aug 22 09:44:44 juju-e4d256-prod-github-runner-207 kernel: [15658.236692] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 09:44:44 juju-e4d256-prod-github-runner-207 kernel: [15658.237791] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 09:44:44 juju-e4d256-prod-github-runner-207 kernel: [15658.238849] Call Trace: Aug 22 09:44:44 juju-e4d256-prod-github-runner-207 kernel: [15658.239521] Aug 22 09:44:44 juju-e4d256-prod-github-runner-207 kernel: [15658.240162] show_stack+0x52/0x5c Aug 22 09:44:44 juju-e4d256-prod-github-runner-207 kernel: [15658.240903] dump_stack_lvl+0x4a/0x63 Aug 22 09:44:44 juju-e4d256-prod-github-runner-207 kernel: [15658.241644] dump_stack+0x10/0x16 Aug 22 09:44:44 juju-e4d256-prod-github-runner-207 kernel: [15658.242358] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 09:44:44 juju-e4d256-prod-github-runner-207 kernel: [15658.243135] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 09:44:44 juju-e4d256-prod-github-runner-207 kernel: [15658.243910] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 09:44:44 juju-e4d256-prod-github-runner-207 kernel: [15658.244737] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 09:44:44 juju-e4d256-prod-github-runner-207 kernel: [15658.245556] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 09:44:44 juju-e4d256-prod-github-runner-207 kernel: [15658.246361] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 09:44:44 juju-e4d256-prod-github-runner-207 kernel: [15658.247135] print_cpu_stall.cold+0x2f/0xe2 Aug 22 09:44:44 juju-e4d256-prod-github-runner-207 kernel: [15658.247896] ? timekeeping_update+0xf7/0x150 Aug 22 09:44:44 juju-e4d256-prod-github-runner-207 kernel: [15658.248674] check_cpu_stall+0x109/0x270 Aug 22 09:44:44 juju-e4d256-prod-github-runner-207 kernel: [15658.249427] rcu_sched_clock_irq+0x9a/0x250 Aug 22 09:44:44 juju-e4d256-prod-github-runner-207 kernel: [15658.250186] update_process_times+0x94/0xd0 Aug 22 09:44:44 juju-e4d256-prod-github-runner-207 kernel: [15658.250948] tick_sched_handle+0x29/0x70 Aug 22 09:44:44 juju-e4d256-prod-github-runner-207 kernel: [15658.251691] tick_sched_timer+0x8c/0xc0 Aug 22 09:44:44 juju-e4d256-prod-github-runner-207 kernel: [15658.252559] ? tick_nohz_handler+0xb0/0xb0 Aug 22 09:44:44 juju-e4d256-prod-github-runner-207 kernel: [15658.253514] __hrtimer_run_queues+0x107/0x230 Aug 22 09:44:44 juju-e4d256-prod-github-runner-207 kernel: [15658.254307] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 09:44:44 juju-e4d256-prod-github-runner-207 kernel: [15658.255085] hrtimer_interrupt+0x101/0x220 Aug 22 09:44:44 juju-e4d256-prod-github-runner-207 kernel: [15658.255844] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 09:44:44 juju-e4d256-prod-github-runner-207 kernel: [15658.256678] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 09:44:44 juju-e4d256-prod-github-runner-207 kernel: [15658.257480] Aug 22 09:44:44 juju-e4d256-prod-github-runner-207 kernel: [15658.258113] Aug 22 09:44:44 juju-e4d256-prod-github-runner-207 kernel: [15658.258746] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 09:44:44 juju-e4d256-prod-github-runner-207 kernel: [15658.259565] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:44:44 juju-e4d256-prod-github-runner-207 kernel: [15658.260455] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 09:44:44 juju-e4d256-prod-github-runner-207 kernel: [15658.262672] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 09:44:44 juju-e4d256-prod-github-runner-207 kernel: [15658.263544] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 09:44:44 juju-e4d256-prod-github-runner-207 kernel: [15658.264546] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 09:44:44 juju-e4d256-prod-github-runner-207 kernel: [15658.265527] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 09:44:44 juju-e4d256-prod-github-runner-207 kernel: [15658.266512] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 09:44:44 juju-e4d256-prod-github-runner-207 kernel: [15658.267466] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 09:44:44 juju-e4d256-prod-github-runner-207 kernel: [15658.268440] ? _raw_spin_lock+0x22/0x30 Aug 22 09:44:44 juju-e4d256-prod-github-runner-207 kernel: [15658.269205] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:44:44 juju-e4d256-prod-github-runner-207 kernel: [15658.270041] direct_page_fault+0x206/0x310 [kvm] Aug 22 09:44:44 juju-e4d256-prod-github-runner-207 kernel: [15658.270886] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 09:44:44 juju-e4d256-prod-github-runner-207 kernel: [15658.271720] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 09:44:44 juju-e4d256-prod-github-runner-207 kernel: [15658.272559] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 09:44:44 juju-e4d256-prod-github-runner-207 kernel: [15658.273363] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 09:44:44 juju-e4d256-prod-github-runner-207 kernel: [15658.274148] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 09:44:44 juju-e4d256-prod-github-runner-207 kernel: [15658.274968] handle_exit+0x98/0x230 [kvm_amd] Aug 22 09:44:44 juju-e4d256-prod-github-runner-207 kernel: [15658.275722] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 09:44:44 juju-e4d256-prod-github-runner-207 kernel: [15658.276519] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 09:44:44 juju-e4d256-prod-github-runner-207 kernel: [15658.277318] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 09:44:44 juju-e4d256-prod-github-runner-207 kernel: [15658.278107] vcpu_run+0x62/0x2c0 [kvm] Aug 22 09:44:44 juju-e4d256-prod-github-runner-207 kernel: [15658.278820] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 09:44:44 juju-e4d256-prod-github-runner-207 kernel: [15658.279551] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 09:44:44 juju-e4d256-prod-github-runner-207 kernel: [15658.280362] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 09:44:44 juju-e4d256-prod-github-runner-207 kernel: [15658.281123] ? __seccomp_filter+0x4a/0x4a0 Aug 22 09:44:44 juju-e4d256-prod-github-runner-207 kernel: [15658.281846] ? __fget_files+0x86/0xc0 Aug 22 09:44:44 juju-e4d256-prod-github-runner-207 kernel: [15658.282538] __x64_sys_ioctl+0x95/0xd0 Aug 22 09:44:44 juju-e4d256-prod-github-runner-207 kernel: [15658.283231] do_syscall_64+0x5c/0xc0 Aug 22 09:44:44 juju-e4d256-prod-github-runner-207 kernel: [15658.283916] ? do_futex+0x162/0x1f0 Aug 22 09:44:44 juju-e4d256-prod-github-runner-207 kernel: [15658.284600] ? __x64_sys_futex+0x78/0x1e0 Aug 22 09:44:44 juju-e4d256-prod-github-runner-207 kernel: [15658.285307] ? __secure_computing+0xa9/0x120 Aug 22 09:44:44 juju-e4d256-prod-github-runner-207 kernel: [15658.286021] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 09:44:44 juju-e4d256-prod-github-runner-207 kernel: [15658.286809] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:44:44 juju-e4d256-prod-github-runner-207 kernel: [15658.287567] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:44:44 juju-e4d256-prod-github-runner-207 kernel: [15658.288329] ? do_syscall_64+0x69/0xc0 Aug 22 09:44:44 juju-e4d256-prod-github-runner-207 kernel: [15658.289018] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:44:44 juju-e4d256-prod-github-runner-207 kernel: [15658.289792] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:44:44 juju-e4d256-prod-github-runner-207 kernel: [15658.290557] ? do_syscall_64+0x69/0xc0 Aug 22 09:44:44 juju-e4d256-prod-github-runner-207 kernel: [15658.291249] ? do_syscall_64+0x69/0xc0 Aug 22 09:44:44 juju-e4d256-prod-github-runner-207 kernel: [15658.291934] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 09:44:44 juju-e4d256-prod-github-runner-207 kernel: [15658.292713] RIP: 0033:0x7faa5d0edaff Aug 22 09:44:44 juju-e4d256-prod-github-runner-207 kernel: [15658.293428] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 09:44:44 juju-e4d256-prod-github-runner-207 kernel: [15658.295537] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 09:44:44 juju-e4d256-prod-github-runner-207 kernel: [15658.296524] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 09:44:44 juju-e4d256-prod-github-runner-207 kernel: [15658.297473] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 09:44:44 juju-e4d256-prod-github-runner-207 kernel: [15658.298420] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 09:44:44 juju-e4d256-prod-github-runner-207 kernel: [15658.299363] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 09:44:44 juju-e4d256-prod-github-runner-207 kernel: [15658.300302] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 09:44:44 juju-e4d256-prod-github-runner-207 kernel: [15658.301220] Aug 22 09:45:10 juju-e4d256-prod-github-runner-207 kernel: [15684.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 14499s! [qemu-system-x86:6715] Aug 22 09:45:10 juju-e4d256-prod-github-runner-207 kernel: [15684.543758] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 09:45:10 juju-e4d256-prod-github-runner-207 kernel: [15684.544017] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 09:45:10 juju-e4d256-prod-github-runner-207 kernel: [15684.556155] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 09:45:10 juju-e4d256-prod-github-runner-207 kernel: [15684.557426] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 09:45:10 juju-e4d256-prod-github-runner-207 kernel: [15684.558644] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:45:10 juju-e4d256-prod-github-runner-207 kernel: [15684.559699] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 09:45:10 juju-e4d256-prod-github-runner-207 kernel: [15684.562263] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 09:45:10 juju-e4d256-prod-github-runner-207 kernel: [15684.563313] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 09:45:10 juju-e4d256-prod-github-runner-207 kernel: [15684.564488] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 09:45:10 juju-e4d256-prod-github-runner-207 kernel: [15684.565650] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 09:45:10 juju-e4d256-prod-github-runner-207 kernel: [15684.566811] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 09:45:10 juju-e4d256-prod-github-runner-207 kernel: [15684.567977] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 09:45:10 juju-e4d256-prod-github-runner-207 kernel: [15684.569157] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 09:45:10 juju-e4d256-prod-github-runner-207 kernel: [15684.570396] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 09:45:10 juju-e4d256-prod-github-runner-207 kernel: [15684.571493] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 09:45:10 juju-e4d256-prod-github-runner-207 kernel: [15684.572705] Call Trace: Aug 22 09:45:10 juju-e4d256-prod-github-runner-207 kernel: [15684.573624] Aug 22 09:45:10 juju-e4d256-prod-github-runner-207 kernel: [15684.574518] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:45:10 juju-e4d256-prod-github-runner-207 kernel: [15684.575546] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:45:10 juju-e4d256-prod-github-runner-207 kernel: [15684.576581] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:45:10 juju-e4d256-prod-github-runner-207 kernel: [15684.577780] ? show_regs.part.0+0x23/0x29 Aug 22 09:45:10 juju-e4d256-prod-github-runner-207 kernel: [15684.578777] ? show_regs.cold+0x8/0xd Aug 22 09:45:10 juju-e4d256-prod-github-runner-207 kernel: [15684.579748] ? watchdog_timer_fn+0x1be/0x220 Aug 22 09:45:10 juju-e4d256-prod-github-runner-207 kernel: [15684.580769] ? lockup_detector_update_enable+0x60/0x60 Aug 22 09:45:10 juju-e4d256-prod-github-runner-207 kernel: [15684.581832] ? __hrtimer_run_queues+0x107/0x230 Aug 22 09:45:10 juju-e4d256-prod-github-runner-207 kernel: [15684.582867] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 09:45:10 juju-e4d256-prod-github-runner-207 kernel: [15684.583889] ? hrtimer_interrupt+0x101/0x220 Aug 22 09:45:10 juju-e4d256-prod-github-runner-207 kernel: [15684.584924] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 09:45:10 juju-e4d256-prod-github-runner-207 kernel: [15684.585992] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 09:45:10 juju-e4d256-prod-github-runner-207 kernel: [15684.587049] Aug 22 09:45:10 juju-e4d256-prod-github-runner-207 kernel: [15684.587902] Aug 22 09:45:10 juju-e4d256-prod-github-runner-207 kernel: [15684.588756] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 09:45:10 juju-e4d256-prod-github-runner-207 kernel: [15684.589799] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:45:10 juju-e4d256-prod-github-runner-207 kernel: [15684.590837] ? _raw_spin_lock+0x22/0x30 Aug 22 09:45:10 juju-e4d256-prod-github-runner-207 kernel: [15684.591781] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:45:10 juju-e4d256-prod-github-runner-207 kernel: [15684.592817] direct_page_fault+0x206/0x310 [kvm] Aug 22 09:45:10 juju-e4d256-prod-github-runner-207 kernel: [15684.593847] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 09:45:10 juju-e4d256-prod-github-runner-207 kernel: [15684.594859] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 09:45:10 juju-e4d256-prod-github-runner-207 kernel: [15684.595857] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 09:45:10 juju-e4d256-prod-github-runner-207 kernel: [15684.596856] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 09:45:10 juju-e4d256-prod-github-runner-207 kernel: [15684.597802] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 09:45:10 juju-e4d256-prod-github-runner-207 kernel: [15684.598779] handle_exit+0x98/0x230 [kvm_amd] Aug 22 09:45:10 juju-e4d256-prod-github-runner-207 kernel: [15684.599669] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 09:45:10 juju-e4d256-prod-github-runner-207 kernel: [15684.600598] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 09:45:10 juju-e4d256-prod-github-runner-207 kernel: [15684.601523] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 09:45:10 juju-e4d256-prod-github-runner-207 kernel: [15684.602430] vcpu_run+0x62/0x2c0 [kvm] Aug 22 09:45:10 juju-e4d256-prod-github-runner-207 kernel: [15684.603243] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 09:45:10 juju-e4d256-prod-github-runner-207 kernel: [15684.604067] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 09:45:10 juju-e4d256-prod-github-runner-207 kernel: [15684.604920] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 09:45:10 juju-e4d256-prod-github-runner-207 kernel: [15684.605722] ? __seccomp_filter+0x4a/0x4a0 Aug 22 09:45:10 juju-e4d256-prod-github-runner-207 kernel: [15684.606461] ? __fget_files+0x86/0xc0 Aug 22 09:45:10 juju-e4d256-prod-github-runner-207 kernel: [15684.607163] __x64_sys_ioctl+0x95/0xd0 Aug 22 09:45:10 juju-e4d256-prod-github-runner-207 kernel: [15684.607856] do_syscall_64+0x5c/0xc0 Aug 22 09:45:10 juju-e4d256-prod-github-runner-207 kernel: [15684.608539] ? do_futex+0x162/0x1f0 Aug 22 09:45:10 juju-e4d256-prod-github-runner-207 kernel: [15684.609192] ? __x64_sys_futex+0x78/0x1e0 Aug 22 09:45:10 juju-e4d256-prod-github-runner-207 kernel: [15684.609862] ? __secure_computing+0xa9/0x120 Aug 22 09:45:10 juju-e4d256-prod-github-runner-207 kernel: [15684.610549] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 09:45:10 juju-e4d256-prod-github-runner-207 kernel: [15684.611312] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:45:10 juju-e4d256-prod-github-runner-207 kernel: [15684.612042] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:45:10 juju-e4d256-prod-github-runner-207 kernel: [15684.612757] ? do_syscall_64+0x69/0xc0 Aug 22 09:45:10 juju-e4d256-prod-github-runner-207 kernel: [15684.613404] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:45:10 juju-e4d256-prod-github-runner-207 kernel: [15684.614106] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:45:10 juju-e4d256-prod-github-runner-207 kernel: [15684.614801] ? do_syscall_64+0x69/0xc0 Aug 22 09:45:10 juju-e4d256-prod-github-runner-207 kernel: [15684.615425] ? do_syscall_64+0x69/0xc0 Aug 22 09:45:10 juju-e4d256-prod-github-runner-207 kernel: [15684.616075] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 09:45:10 juju-e4d256-prod-github-runner-207 kernel: [15684.616779] RIP: 0033:0x7faa5d0edaff Aug 22 09:45:10 juju-e4d256-prod-github-runner-207 kernel: [15684.617512] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 09:45:10 juju-e4d256-prod-github-runner-207 kernel: [15684.619492] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 09:45:10 juju-e4d256-prod-github-runner-207 kernel: [15684.620410] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 09:45:10 juju-e4d256-prod-github-runner-207 kernel: [15684.621307] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 09:45:10 juju-e4d256-prod-github-runner-207 kernel: [15684.622192] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 09:45:10 juju-e4d256-prod-github-runner-207 kernel: [15684.623088] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 09:45:10 juju-e4d256-prod-github-runner-207 kernel: [15684.623986] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 09:45:10 juju-e4d256-prod-github-runner-207 kernel: [15684.624886] Aug 22 09:45:38 juju-e4d256-prod-github-runner-207 kernel: [15712.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 14525s! [qemu-system-x86:6715] Aug 22 09:45:38 juju-e4d256-prod-github-runner-207 kernel: [15712.543744] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 09:45:38 juju-e4d256-prod-github-runner-207 kernel: [15712.543977] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 09:45:38 juju-e4d256-prod-github-runner-207 kernel: [15712.556068] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 09:45:38 juju-e4d256-prod-github-runner-207 kernel: [15712.557335] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 09:45:38 juju-e4d256-prod-github-runner-207 kernel: [15712.558553] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:45:38 juju-e4d256-prod-github-runner-207 kernel: [15712.559619] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 09:45:38 juju-e4d256-prod-github-runner-207 kernel: [15712.562179] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 09:45:38 juju-e4d256-prod-github-runner-207 kernel: [15712.563226] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 09:45:38 juju-e4d256-prod-github-runner-207 kernel: [15712.564398] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 09:45:38 juju-e4d256-prod-github-runner-207 kernel: [15712.565600] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 09:45:38 juju-e4d256-prod-github-runner-207 kernel: [15712.566774] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 09:45:38 juju-e4d256-prod-github-runner-207 kernel: [15712.567944] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 09:45:38 juju-e4d256-prod-github-runner-207 kernel: [15712.569142] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 09:45:38 juju-e4d256-prod-github-runner-207 kernel: [15712.570376] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 09:45:38 juju-e4d256-prod-github-runner-207 kernel: [15712.571472] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 09:45:38 juju-e4d256-prod-github-runner-207 kernel: [15712.572675] Call Trace: Aug 22 09:45:38 juju-e4d256-prod-github-runner-207 kernel: [15712.573585] Aug 22 09:45:38 juju-e4d256-prod-github-runner-207 kernel: [15712.574486] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:45:38 juju-e4d256-prod-github-runner-207 kernel: [15712.575519] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:45:38 juju-e4d256-prod-github-runner-207 kernel: [15712.576555] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:45:38 juju-e4d256-prod-github-runner-207 kernel: [15712.577650] ? show_regs.part.0+0x23/0x29 Aug 22 09:45:38 juju-e4d256-prod-github-runner-207 kernel: [15712.578682] ? show_regs.cold+0x8/0xd Aug 22 09:45:38 juju-e4d256-prod-github-runner-207 kernel: [15712.579697] ? watchdog_timer_fn+0x1be/0x220 Aug 22 09:45:38 juju-e4d256-prod-github-runner-207 kernel: [15712.580707] ? lockup_detector_update_enable+0x60/0x60 Aug 22 09:45:38 juju-e4d256-prod-github-runner-207 kernel: [15712.581772] ? __hrtimer_run_queues+0x107/0x230 Aug 22 09:45:38 juju-e4d256-prod-github-runner-207 kernel: [15712.582801] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 09:45:38 juju-e4d256-prod-github-runner-207 kernel: [15712.583838] ? hrtimer_interrupt+0x101/0x220 Aug 22 09:45:38 juju-e4d256-prod-github-runner-207 kernel: [15712.584856] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 09:45:38 juju-e4d256-prod-github-runner-207 kernel: [15712.585922] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 09:45:38 juju-e4d256-prod-github-runner-207 kernel: [15712.586969] Aug 22 09:45:38 juju-e4d256-prod-github-runner-207 kernel: [15712.587842] Aug 22 09:45:38 juju-e4d256-prod-github-runner-207 kernel: [15712.588680] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 09:45:38 juju-e4d256-prod-github-runner-207 kernel: [15712.589722] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:45:38 juju-e4d256-prod-github-runner-207 kernel: [15712.590780] ? _raw_spin_lock+0x22/0x30 Aug 22 09:45:38 juju-e4d256-prod-github-runner-207 kernel: [15712.591734] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:45:38 juju-e4d256-prod-github-runner-207 kernel: [15712.592756] direct_page_fault+0x206/0x310 [kvm] Aug 22 09:45:38 juju-e4d256-prod-github-runner-207 kernel: [15712.593778] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 09:45:38 juju-e4d256-prod-github-runner-207 kernel: [15712.594814] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 09:45:38 juju-e4d256-prod-github-runner-207 kernel: [15712.595825] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 09:45:38 juju-e4d256-prod-github-runner-207 kernel: [15712.596820] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 09:45:38 juju-e4d256-prod-github-runner-207 kernel: [15712.597765] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 09:45:38 juju-e4d256-prod-github-runner-207 kernel: [15712.598748] handle_exit+0x98/0x230 [kvm_amd] Aug 22 09:45:38 juju-e4d256-prod-github-runner-207 kernel: [15712.599644] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 09:45:38 juju-e4d256-prod-github-runner-207 kernel: [15712.600565] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 09:45:38 juju-e4d256-prod-github-runner-207 kernel: [15712.601489] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 09:45:38 juju-e4d256-prod-github-runner-207 kernel: [15712.602392] vcpu_run+0x62/0x2c0 [kvm] Aug 22 09:45:38 juju-e4d256-prod-github-runner-207 kernel: [15712.603200] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 09:45:38 juju-e4d256-prod-github-runner-207 kernel: [15712.604015] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 09:45:38 juju-e4d256-prod-github-runner-207 kernel: [15712.604868] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 09:45:38 juju-e4d256-prod-github-runner-207 kernel: [15712.605662] ? __seccomp_filter+0x4a/0x4a0 Aug 22 09:45:38 juju-e4d256-prod-github-runner-207 kernel: [15712.606402] ? __fget_files+0x86/0xc0 Aug 22 09:45:38 juju-e4d256-prod-github-runner-207 kernel: [15712.607104] __x64_sys_ioctl+0x95/0xd0 Aug 22 09:45:38 juju-e4d256-prod-github-runner-207 kernel: [15712.607802] do_syscall_64+0x5c/0xc0 Aug 22 09:45:38 juju-e4d256-prod-github-runner-207 kernel: [15712.608467] ? do_futex+0x162/0x1f0 Aug 22 09:45:38 juju-e4d256-prod-github-runner-207 kernel: [15712.609112] ? __x64_sys_futex+0x78/0x1e0 Aug 22 09:45:38 juju-e4d256-prod-github-runner-207 kernel: [15712.609784] ? __secure_computing+0xa9/0x120 Aug 22 09:45:38 juju-e4d256-prod-github-runner-207 kernel: [15712.610474] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 09:45:38 juju-e4d256-prod-github-runner-207 kernel: [15712.611231] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:45:38 juju-e4d256-prod-github-runner-207 kernel: [15712.611957] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:45:38 juju-e4d256-prod-github-runner-207 kernel: [15712.612685] ? do_syscall_64+0x69/0xc0 Aug 22 09:45:38 juju-e4d256-prod-github-runner-207 kernel: [15712.613329] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:45:38 juju-e4d256-prod-github-runner-207 kernel: [15712.614029] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:45:38 juju-e4d256-prod-github-runner-207 kernel: [15712.614723] ? do_syscall_64+0x69/0xc0 Aug 22 09:45:38 juju-e4d256-prod-github-runner-207 kernel: [15712.615344] ? do_syscall_64+0x69/0xc0 Aug 22 09:45:38 juju-e4d256-prod-github-runner-207 kernel: [15712.615979] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 09:45:38 juju-e4d256-prod-github-runner-207 kernel: [15712.616681] RIP: 0033:0x7faa5d0edaff Aug 22 09:45:38 juju-e4d256-prod-github-runner-207 kernel: [15712.617322] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 09:45:38 juju-e4d256-prod-github-runner-207 kernel: [15712.619359] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 09:45:38 juju-e4d256-prod-github-runner-207 kernel: [15712.620282] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 09:45:38 juju-e4d256-prod-github-runner-207 kernel: [15712.621168] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 09:45:38 juju-e4d256-prod-github-runner-207 kernel: [15712.622053] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 09:45:38 juju-e4d256-prod-github-runner-207 kernel: [15712.622947] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 09:45:38 juju-e4d256-prod-github-runner-207 kernel: [15712.624631] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 09:45:38 juju-e4d256-prod-github-runner-207 kernel: [15712.625536] Aug 22 09:46:06 juju-e4d256-prod-github-runner-207 kernel: [15740.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 14551s! [qemu-system-x86:6715] Aug 22 09:46:06 juju-e4d256-prod-github-runner-207 kernel: [15740.543742] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 09:46:06 juju-e4d256-prod-github-runner-207 kernel: [15740.543995] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 09:46:06 juju-e4d256-prod-github-runner-207 kernel: [15740.556087] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 09:46:06 juju-e4d256-prod-github-runner-207 kernel: [15740.557353] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 09:46:06 juju-e4d256-prod-github-runner-207 kernel: [15740.558578] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:46:06 juju-e4d256-prod-github-runner-207 kernel: [15740.559651] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 09:46:06 juju-e4d256-prod-github-runner-207 kernel: [15740.562222] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 09:46:06 juju-e4d256-prod-github-runner-207 kernel: [15740.563267] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 09:46:06 juju-e4d256-prod-github-runner-207 kernel: [15740.564453] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 09:46:06 juju-e4d256-prod-github-runner-207 kernel: [15740.565617] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 09:46:06 juju-e4d256-prod-github-runner-207 kernel: [15740.566851] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 09:46:06 juju-e4d256-prod-github-runner-207 kernel: [15740.568031] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 09:46:06 juju-e4d256-prod-github-runner-207 kernel: [15740.569195] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 09:46:06 juju-e4d256-prod-github-runner-207 kernel: [15740.570433] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 09:46:06 juju-e4d256-prod-github-runner-207 kernel: [15740.571547] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 09:46:06 juju-e4d256-prod-github-runner-207 kernel: [15740.572738] Call Trace: Aug 22 09:46:06 juju-e4d256-prod-github-runner-207 kernel: [15740.573649] Aug 22 09:46:06 juju-e4d256-prod-github-runner-207 kernel: [15740.574547] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:46:06 juju-e4d256-prod-github-runner-207 kernel: [15740.575605] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:46:06 juju-e4d256-prod-github-runner-207 kernel: [15740.576707] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:46:06 juju-e4d256-prod-github-runner-207 kernel: [15740.577810] ? show_regs.part.0+0x23/0x29 Aug 22 09:46:06 juju-e4d256-prod-github-runner-207 kernel: [15740.578808] ? show_regs.cold+0x8/0xd Aug 22 09:46:06 juju-e4d256-prod-github-runner-207 kernel: [15740.579814] ? watchdog_timer_fn+0x1be/0x220 Aug 22 09:46:06 juju-e4d256-prod-github-runner-207 kernel: [15740.580995] ? lockup_detector_update_enable+0x60/0x60 Aug 22 09:46:06 juju-e4d256-prod-github-runner-207 kernel: [15740.582060] ? __hrtimer_run_queues+0x107/0x230 Aug 22 09:46:06 juju-e4d256-prod-github-runner-207 kernel: [15740.583087] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 09:46:06 juju-e4d256-prod-github-runner-207 kernel: [15740.584129] ? hrtimer_interrupt+0x101/0x220 Aug 22 09:46:06 juju-e4d256-prod-github-runner-207 kernel: [15740.585144] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 09:46:06 juju-e4d256-prod-github-runner-207 kernel: [15740.586227] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 09:46:06 juju-e4d256-prod-github-runner-207 kernel: [15740.587292] Aug 22 09:46:06 juju-e4d256-prod-github-runner-207 kernel: [15740.588162] Aug 22 09:46:06 juju-e4d256-prod-github-runner-207 kernel: [15740.589014] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 09:46:06 juju-e4d256-prod-github-runner-207 kernel: [15740.590049] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:46:06 juju-e4d256-prod-github-runner-207 kernel: [15740.591088] ? _raw_spin_lock+0x22/0x30 Aug 22 09:46:06 juju-e4d256-prod-github-runner-207 kernel: [15740.592063] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:46:06 juju-e4d256-prod-github-runner-207 kernel: [15740.593190] direct_page_fault+0x206/0x310 [kvm] Aug 22 09:46:06 juju-e4d256-prod-github-runner-207 kernel: [15740.594230] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 09:46:06 juju-e4d256-prod-github-runner-207 kernel: [15740.595248] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 09:46:06 juju-e4d256-prod-github-runner-207 kernel: [15740.596303] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 09:46:06 juju-e4d256-prod-github-runner-207 kernel: [15740.597360] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 09:46:06 juju-e4d256-prod-github-runner-207 kernel: [15740.598322] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 09:46:06 juju-e4d256-prod-github-runner-207 kernel: [15740.599332] handle_exit+0x98/0x230 [kvm_amd] Aug 22 09:46:06 juju-e4d256-prod-github-runner-207 kernel: [15740.600229] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 09:46:06 juju-e4d256-prod-github-runner-207 kernel: [15740.601146] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 09:46:06 juju-e4d256-prod-github-runner-207 kernel: [15740.602153] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 09:46:06 juju-e4d256-prod-github-runner-207 kernel: [15740.603075] vcpu_run+0x62/0x2c0 [kvm] Aug 22 09:46:06 juju-e4d256-prod-github-runner-207 kernel: [15740.603921] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 09:46:06 juju-e4d256-prod-github-runner-207 kernel: [15740.604787] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 09:46:06 juju-e4d256-prod-github-runner-207 kernel: [15740.605666] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 09:46:06 juju-e4d256-prod-github-runner-207 kernel: [15740.606517] ? __seccomp_filter+0x4a/0x4a0 Aug 22 09:46:06 juju-e4d256-prod-github-runner-207 kernel: [15740.607280] ? __fget_files+0x86/0xc0 Aug 22 09:46:06 juju-e4d256-prod-github-runner-207 kernel: [15740.608010] __x64_sys_ioctl+0x95/0xd0 Aug 22 09:46:06 juju-e4d256-prod-github-runner-207 kernel: [15740.608710] do_syscall_64+0x5c/0xc0 Aug 22 09:46:06 juju-e4d256-prod-github-runner-207 kernel: [15740.609391] ? do_futex+0x162/0x1f0 Aug 22 09:46:06 juju-e4d256-prod-github-runner-207 kernel: [15740.610157] ? __x64_sys_futex+0x78/0x1e0 Aug 22 09:46:06 juju-e4d256-prod-github-runner-207 kernel: [15740.610853] ? __secure_computing+0xa9/0x120 Aug 22 09:46:06 juju-e4d256-prod-github-runner-207 kernel: [15740.611792] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 09:46:06 juju-e4d256-prod-github-runner-207 kernel: [15740.612598] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:46:06 juju-e4d256-prod-github-runner-207 kernel: [15740.613346] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:46:06 juju-e4d256-prod-github-runner-207 kernel: [15740.614078] ? do_syscall_64+0x69/0xc0 Aug 22 09:46:06 juju-e4d256-prod-github-runner-207 kernel: [15740.614743] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:46:06 juju-e4d256-prod-github-runner-207 kernel: [15740.615482] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:46:06 juju-e4d256-prod-github-runner-207 kernel: [15740.616193] ? do_syscall_64+0x69/0xc0 Aug 22 09:46:06 juju-e4d256-prod-github-runner-207 kernel: [15740.616828] ? do_syscall_64+0x69/0xc0 Aug 22 09:46:06 juju-e4d256-prod-github-runner-207 kernel: [15740.617451] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 09:46:06 juju-e4d256-prod-github-runner-207 kernel: [15740.618224] RIP: 0033:0x7faa5d0edaff Aug 22 09:46:06 juju-e4d256-prod-github-runner-207 kernel: [15740.618897] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 09:46:06 juju-e4d256-prod-github-runner-207 kernel: [15740.620958] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 09:46:06 juju-e4d256-prod-github-runner-207 kernel: [15740.621886] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 09:46:06 juju-e4d256-prod-github-runner-207 kernel: [15740.622777] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 09:46:06 juju-e4d256-prod-github-runner-207 kernel: [15740.623692] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 09:46:06 juju-e4d256-prod-github-runner-207 kernel: [15740.624601] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 09:46:06 juju-e4d256-prod-github-runner-207 kernel: [15740.625520] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 09:46:06 juju-e4d256-prod-github-runner-207 kernel: [15740.626434] Aug 22 09:46:34 juju-e4d256-prod-github-runner-207 kernel: [15768.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 14577s! [qemu-system-x86:6715] Aug 22 09:46:34 juju-e4d256-prod-github-runner-207 kernel: [15768.543756] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 09:46:34 juju-e4d256-prod-github-runner-207 kernel: [15768.544012] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 09:46:34 juju-e4d256-prod-github-runner-207 kernel: [15768.556176] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 09:46:34 juju-e4d256-prod-github-runner-207 kernel: [15768.557440] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 09:46:34 juju-e4d256-prod-github-runner-207 kernel: [15768.558656] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:46:34 juju-e4d256-prod-github-runner-207 kernel: [15768.559726] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 09:46:34 juju-e4d256-prod-github-runner-207 kernel: [15768.562259] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 09:46:34 juju-e4d256-prod-github-runner-207 kernel: [15768.563327] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 09:46:34 juju-e4d256-prod-github-runner-207 kernel: [15768.564494] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 09:46:34 juju-e4d256-prod-github-runner-207 kernel: [15768.565684] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 09:46:34 juju-e4d256-prod-github-runner-207 kernel: [15768.566839] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 09:46:34 juju-e4d256-prod-github-runner-207 kernel: [15768.568016] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 09:46:34 juju-e4d256-prod-github-runner-207 kernel: [15768.569179] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 09:46:34 juju-e4d256-prod-github-runner-207 kernel: [15768.570406] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 09:46:34 juju-e4d256-prod-github-runner-207 kernel: [15768.571527] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 09:46:34 juju-e4d256-prod-github-runner-207 kernel: [15768.572716] Call Trace: Aug 22 09:46:34 juju-e4d256-prod-github-runner-207 kernel: [15768.573627] Aug 22 09:46:34 juju-e4d256-prod-github-runner-207 kernel: [15768.574556] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:46:34 juju-e4d256-prod-github-runner-207 kernel: [15768.575621] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:46:34 juju-e4d256-prod-github-runner-207 kernel: [15768.576705] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:46:34 juju-e4d256-prod-github-runner-207 kernel: [15768.577815] ? show_regs.part.0+0x23/0x29 Aug 22 09:46:34 juju-e4d256-prod-github-runner-207 kernel: [15768.578818] ? show_regs.cold+0x8/0xd Aug 22 09:46:34 juju-e4d256-prod-github-runner-207 kernel: [15768.579835] ? watchdog_timer_fn+0x1be/0x220 Aug 22 09:46:34 juju-e4d256-prod-github-runner-207 kernel: [15768.580843] ? lockup_detector_update_enable+0x60/0x60 Aug 22 09:46:34 juju-e4d256-prod-github-runner-207 kernel: [15768.581911] ? __hrtimer_run_queues+0x107/0x230 Aug 22 09:46:34 juju-e4d256-prod-github-runner-207 kernel: [15768.582937] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 09:46:34 juju-e4d256-prod-github-runner-207 kernel: [15768.584002] ? hrtimer_interrupt+0x101/0x220 Aug 22 09:46:34 juju-e4d256-prod-github-runner-207 kernel: [15768.585028] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 09:46:34 juju-e4d256-prod-github-runner-207 kernel: [15768.586094] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 09:46:34 juju-e4d256-prod-github-runner-207 kernel: [15768.587153] Aug 22 09:46:34 juju-e4d256-prod-github-runner-207 kernel: [15768.588005] Aug 22 09:46:34 juju-e4d256-prod-github-runner-207 kernel: [15768.588841] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 09:46:34 juju-e4d256-prod-github-runner-207 kernel: [15768.589874] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:46:34 juju-e4d256-prod-github-runner-207 kernel: [15768.590913] ? _raw_spin_lock+0x22/0x30 Aug 22 09:46:34 juju-e4d256-prod-github-runner-207 kernel: [15768.591879] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:46:34 juju-e4d256-prod-github-runner-207 kernel: [15768.592940] direct_page_fault+0x206/0x310 [kvm] Aug 22 09:46:34 juju-e4d256-prod-github-runner-207 kernel: [15768.593967] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 09:46:34 juju-e4d256-prod-github-runner-207 kernel: [15768.595003] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 09:46:34 juju-e4d256-prod-github-runner-207 kernel: [15768.596003] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 09:46:34 juju-e4d256-prod-github-runner-207 kernel: [15768.596991] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 09:46:34 juju-e4d256-prod-github-runner-207 kernel: [15768.597934] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 09:46:34 juju-e4d256-prod-github-runner-207 kernel: [15768.598909] handle_exit+0x98/0x230 [kvm_amd] Aug 22 09:46:34 juju-e4d256-prod-github-runner-207 kernel: [15768.599814] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 09:46:34 juju-e4d256-prod-github-runner-207 kernel: [15768.600726] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 09:46:34 juju-e4d256-prod-github-runner-207 kernel: [15768.601647] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 09:46:34 juju-e4d256-prod-github-runner-207 kernel: [15768.602583] vcpu_run+0x62/0x2c0 [kvm] Aug 22 09:46:34 juju-e4d256-prod-github-runner-207 kernel: [15768.603512] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 09:46:34 juju-e4d256-prod-github-runner-207 kernel: [15768.604330] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 09:46:34 juju-e4d256-prod-github-runner-207 kernel: [15768.605186] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 09:46:34 juju-e4d256-prod-github-runner-207 kernel: [15768.605984] ? __seccomp_filter+0x4a/0x4a0 Aug 22 09:46:34 juju-e4d256-prod-github-runner-207 kernel: [15768.606726] ? __fget_files+0x86/0xc0 Aug 22 09:46:34 juju-e4d256-prod-github-runner-207 kernel: [15768.607453] __x64_sys_ioctl+0x95/0xd0 Aug 22 09:46:34 juju-e4d256-prod-github-runner-207 kernel: [15768.608147] do_syscall_64+0x5c/0xc0 Aug 22 09:46:34 juju-e4d256-prod-github-runner-207 kernel: [15768.608812] ? do_futex+0x162/0x1f0 Aug 22 09:46:34 juju-e4d256-prod-github-runner-207 kernel: [15768.609470] ? __x64_sys_futex+0x78/0x1e0 Aug 22 09:46:34 juju-e4d256-prod-github-runner-207 kernel: [15768.610148] ? __secure_computing+0xa9/0x120 Aug 22 09:46:34 juju-e4d256-prod-github-runner-207 kernel: [15768.610837] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 09:46:34 juju-e4d256-prod-github-runner-207 kernel: [15768.611614] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:46:34 juju-e4d256-prod-github-runner-207 kernel: [15768.612336] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:46:34 juju-e4d256-prod-github-runner-207 kernel: [15768.613059] ? do_syscall_64+0x69/0xc0 Aug 22 09:46:34 juju-e4d256-prod-github-runner-207 kernel: [15768.613734] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:46:34 juju-e4d256-prod-github-runner-207 kernel: [15768.614447] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:46:34 juju-e4d256-prod-github-runner-207 kernel: [15768.615160] ? do_syscall_64+0x69/0xc0 Aug 22 09:46:34 juju-e4d256-prod-github-runner-207 kernel: [15768.615786] ? do_syscall_64+0x69/0xc0 Aug 22 09:46:34 juju-e4d256-prod-github-runner-207 kernel: [15768.616408] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 09:46:34 juju-e4d256-prod-github-runner-207 kernel: [15768.617115] RIP: 0033:0x7faa5d0edaff Aug 22 09:46:34 juju-e4d256-prod-github-runner-207 kernel: [15768.617767] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 09:46:34 juju-e4d256-prod-github-runner-207 kernel: [15768.619765] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 09:46:34 juju-e4d256-prod-github-runner-207 kernel: [15768.620685] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 09:46:34 juju-e4d256-prod-github-runner-207 kernel: [15768.621572] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 09:46:34 juju-e4d256-prod-github-runner-207 kernel: [15768.622463] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 09:46:34 juju-e4d256-prod-github-runner-207 kernel: [15768.623360] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 09:46:34 juju-e4d256-prod-github-runner-207 kernel: [15768.624247] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 09:46:34 juju-e4d256-prod-github-runner-207 kernel: [15768.625148] Aug 22 09:47:02 juju-e4d256-prod-github-runner-207 kernel: [15796.541976] watchdog: BUG: soft lockup - CPU#1 stuck for 14603s! [qemu-system-x86:6715] Aug 22 09:47:02 juju-e4d256-prod-github-runner-207 kernel: [15796.543127] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 09:47:02 juju-e4d256-prod-github-runner-207 kernel: [15796.543195] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 09:47:02 juju-e4d256-prod-github-runner-207 kernel: [15796.555280] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 09:47:02 juju-e4d256-prod-github-runner-207 kernel: [15796.556542] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 09:47:02 juju-e4d256-prod-github-runner-207 kernel: [15796.557760] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:47:02 juju-e4d256-prod-github-runner-207 kernel: [15796.558840] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 09:47:02 juju-e4d256-prod-github-runner-207 kernel: [15796.561391] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 09:47:02 juju-e4d256-prod-github-runner-207 kernel: [15796.562431] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 09:47:02 juju-e4d256-prod-github-runner-207 kernel: [15796.563611] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 09:47:02 juju-e4d256-prod-github-runner-207 kernel: [15796.564766] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 09:47:02 juju-e4d256-prod-github-runner-207 kernel: [15796.565919] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 09:47:02 juju-e4d256-prod-github-runner-207 kernel: [15796.567090] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 09:47:02 juju-e4d256-prod-github-runner-207 kernel: [15796.568254] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 09:47:02 juju-e4d256-prod-github-runner-207 kernel: [15796.569628] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 09:47:02 juju-e4d256-prod-github-runner-207 kernel: [15796.570740] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 09:47:02 juju-e4d256-prod-github-runner-207 kernel: [15796.571938] Call Trace: Aug 22 09:47:02 juju-e4d256-prod-github-runner-207 kernel: [15796.573032] Aug 22 09:47:02 juju-e4d256-prod-github-runner-207 kernel: [15796.573919] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:47:02 juju-e4d256-prod-github-runner-207 kernel: [15796.574971] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:47:02 juju-e4d256-prod-github-runner-207 kernel: [15796.575988] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:47:02 juju-e4d256-prod-github-runner-207 kernel: [15796.577061] ? show_regs.part.0+0x23/0x29 Aug 22 09:47:02 juju-e4d256-prod-github-runner-207 kernel: [15796.578055] ? show_regs.cold+0x8/0xd Aug 22 09:47:02 juju-e4d256-prod-github-runner-207 kernel: [15796.579040] ? watchdog_timer_fn+0x1be/0x220 Aug 22 09:47:02 juju-e4d256-prod-github-runner-207 kernel: [15796.580046] ? lockup_detector_update_enable+0x60/0x60 Aug 22 09:47:02 juju-e4d256-prod-github-runner-207 kernel: [15796.581107] ? __hrtimer_run_queues+0x107/0x230 Aug 22 09:47:02 juju-e4d256-prod-github-runner-207 kernel: [15796.582131] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 09:47:02 juju-e4d256-prod-github-runner-207 kernel: [15796.583167] ? hrtimer_interrupt+0x101/0x220 Aug 22 09:47:02 juju-e4d256-prod-github-runner-207 kernel: [15796.584180] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 09:47:02 juju-e4d256-prod-github-runner-207 kernel: [15796.585244] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 09:47:02 juju-e4d256-prod-github-runner-207 kernel: [15796.586291] Aug 22 09:47:02 juju-e4d256-prod-github-runner-207 kernel: [15796.587156] Aug 22 09:47:02 juju-e4d256-prod-github-runner-207 kernel: [15796.587992] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 09:47:02 juju-e4d256-prod-github-runner-207 kernel: [15796.589021] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:47:02 juju-e4d256-prod-github-runner-207 kernel: [15796.590058] ? _raw_spin_lock+0x22/0x30 Aug 22 09:47:02 juju-e4d256-prod-github-runner-207 kernel: [15796.591027] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:47:02 juju-e4d256-prod-github-runner-207 kernel: [15796.592046] direct_page_fault+0x206/0x310 [kvm] Aug 22 09:47:02 juju-e4d256-prod-github-runner-207 kernel: [15796.593066] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 09:47:02 juju-e4d256-prod-github-runner-207 kernel: [15796.594073] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 09:47:02 juju-e4d256-prod-github-runner-207 kernel: [15796.595091] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 09:47:02 juju-e4d256-prod-github-runner-207 kernel: [15796.596063] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 09:47:02 juju-e4d256-prod-github-runner-207 kernel: [15796.597007] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 09:47:02 juju-e4d256-prod-github-runner-207 kernel: [15796.597981] handle_exit+0x98/0x230 [kvm_amd] Aug 22 09:47:02 juju-e4d256-prod-github-runner-207 kernel: [15796.598914] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 09:47:02 juju-e4d256-prod-github-runner-207 kernel: [15796.599848] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 09:47:02 juju-e4d256-prod-github-runner-207 kernel: [15796.600770] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 09:47:02 juju-e4d256-prod-github-runner-207 kernel: [15796.601673] vcpu_run+0x62/0x2c0 [kvm] Aug 22 09:47:02 juju-e4d256-prod-github-runner-207 kernel: [15796.602483] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 09:47:02 juju-e4d256-prod-github-runner-207 kernel: [15796.603303] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 09:47:02 juju-e4d256-prod-github-runner-207 kernel: [15796.604156] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 09:47:02 juju-e4d256-prod-github-runner-207 kernel: [15796.604957] ? __seccomp_filter+0x4a/0x4a0 Aug 22 09:47:02 juju-e4d256-prod-github-runner-207 kernel: [15796.605699] ? __fget_files+0x86/0xc0 Aug 22 09:47:02 juju-e4d256-prod-github-runner-207 kernel: [15796.606404] __x64_sys_ioctl+0x95/0xd0 Aug 22 09:47:02 juju-e4d256-prod-github-runner-207 kernel: [15796.607122] do_syscall_64+0x5c/0xc0 Aug 22 09:47:02 juju-e4d256-prod-github-runner-207 kernel: [15796.607787] ? do_futex+0x162/0x1f0 Aug 22 09:47:02 juju-e4d256-prod-github-runner-207 kernel: [15796.608435] ? __x64_sys_futex+0x78/0x1e0 Aug 22 09:47:02 juju-e4d256-prod-github-runner-207 kernel: [15796.609108] ? __secure_computing+0xa9/0x120 Aug 22 09:47:02 juju-e4d256-prod-github-runner-207 kernel: [15796.609798] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 09:47:02 juju-e4d256-prod-github-runner-207 kernel: [15796.610556] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:47:02 juju-e4d256-prod-github-runner-207 kernel: [15796.611291] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:47:02 juju-e4d256-prod-github-runner-207 kernel: [15796.612014] ? do_syscall_64+0x69/0xc0 Aug 22 09:47:02 juju-e4d256-prod-github-runner-207 kernel: [15796.612658] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:47:02 juju-e4d256-prod-github-runner-207 kernel: [15796.613361] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:47:02 juju-e4d256-prod-github-runner-207 kernel: [15796.614055] ? do_syscall_64+0x69/0xc0 Aug 22 09:47:02 juju-e4d256-prod-github-runner-207 kernel: [15796.614703] ? do_syscall_64+0x69/0xc0 Aug 22 09:47:02 juju-e4d256-prod-github-runner-207 kernel: [15796.615326] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 09:47:02 juju-e4d256-prod-github-runner-207 kernel: [15796.616031] RIP: 0033:0x7faa5d0edaff Aug 22 09:47:02 juju-e4d256-prod-github-runner-207 kernel: [15796.616663] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 09:47:02 juju-e4d256-prod-github-runner-207 kernel: [15796.618660] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 09:47:02 juju-e4d256-prod-github-runner-207 kernel: [15796.619571] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 09:47:02 juju-e4d256-prod-github-runner-207 kernel: [15796.620459] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 09:47:02 juju-e4d256-prod-github-runner-207 kernel: [15796.621346] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 09:47:02 juju-e4d256-prod-github-runner-207 kernel: [15796.622232] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 09:47:02 juju-e4d256-prod-github-runner-207 kernel: [15796.623137] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 09:47:02 juju-e4d256-prod-github-runner-207 kernel: [15796.624028] Aug 22 09:47:30 juju-e4d256-prod-github-runner-207 kernel: [15824.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 14629s! [qemu-system-x86:6715] Aug 22 09:47:30 juju-e4d256-prod-github-runner-207 kernel: [15824.543735] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 09:47:30 juju-e4d256-prod-github-runner-207 kernel: [15824.543971] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 09:47:30 juju-e4d256-prod-github-runner-207 kernel: [15824.556133] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 09:47:30 juju-e4d256-prod-github-runner-207 kernel: [15824.557407] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 09:47:30 juju-e4d256-prod-github-runner-207 kernel: [15824.558644] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:47:30 juju-e4d256-prod-github-runner-207 kernel: [15824.559703] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 09:47:30 juju-e4d256-prod-github-runner-207 kernel: [15824.562254] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 09:47:30 juju-e4d256-prod-github-runner-207 kernel: [15824.563311] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 09:47:30 juju-e4d256-prod-github-runner-207 kernel: [15824.564476] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 09:47:30 juju-e4d256-prod-github-runner-207 kernel: [15824.565641] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 09:47:30 juju-e4d256-prod-github-runner-207 kernel: [15824.566809] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 09:47:30 juju-e4d256-prod-github-runner-207 kernel: [15824.567971] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 09:47:30 juju-e4d256-prod-github-runner-207 kernel: [15824.569139] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 09:47:30 juju-e4d256-prod-github-runner-207 kernel: [15824.570383] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 09:47:30 juju-e4d256-prod-github-runner-207 kernel: [15824.571484] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 09:47:30 juju-e4d256-prod-github-runner-207 kernel: [15824.572685] Call Trace: Aug 22 09:47:30 juju-e4d256-prod-github-runner-207 kernel: [15824.573599] Aug 22 09:47:30 juju-e4d256-prod-github-runner-207 kernel: [15824.574509] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:47:30 juju-e4d256-prod-github-runner-207 kernel: [15824.575541] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:47:30 juju-e4d256-prod-github-runner-207 kernel: [15824.576562] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:47:30 juju-e4d256-prod-github-runner-207 kernel: [15824.577663] ? show_regs.part.0+0x23/0x29 Aug 22 09:47:30 juju-e4d256-prod-github-runner-207 kernel: [15824.578671] ? show_regs.cold+0x8/0xd Aug 22 09:47:30 juju-e4d256-prod-github-runner-207 kernel: [15824.579651] ? watchdog_timer_fn+0x1be/0x220 Aug 22 09:47:30 juju-e4d256-prod-github-runner-207 kernel: [15824.580664] ? lockup_detector_update_enable+0x60/0x60 Aug 22 09:47:30 juju-e4d256-prod-github-runner-207 kernel: [15824.581734] ? __hrtimer_run_queues+0x107/0x230 Aug 22 09:47:30 juju-e4d256-prod-github-runner-207 kernel: [15824.582775] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 09:47:30 juju-e4d256-prod-github-runner-207 kernel: [15824.583810] ? hrtimer_interrupt+0x101/0x220 Aug 22 09:47:30 juju-e4d256-prod-github-runner-207 kernel: [15824.584845] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 09:47:30 juju-e4d256-prod-github-runner-207 kernel: [15824.585927] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 09:47:30 juju-e4d256-prod-github-runner-207 kernel: [15824.586989] Aug 22 09:47:30 juju-e4d256-prod-github-runner-207 kernel: [15824.587852] Aug 22 09:47:30 juju-e4d256-prod-github-runner-207 kernel: [15824.588689] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 09:47:30 juju-e4d256-prod-github-runner-207 kernel: [15824.589727] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:47:30 juju-e4d256-prod-github-runner-207 kernel: [15824.590785] ? _raw_spin_lock+0x22/0x30 Aug 22 09:47:30 juju-e4d256-prod-github-runner-207 kernel: [15824.591733] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:47:30 juju-e4d256-prod-github-runner-207 kernel: [15824.592754] direct_page_fault+0x206/0x310 [kvm] Aug 22 09:47:30 juju-e4d256-prod-github-runner-207 kernel: [15824.593784] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 09:47:30 juju-e4d256-prod-github-runner-207 kernel: [15824.594807] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 09:47:30 juju-e4d256-prod-github-runner-207 kernel: [15824.595810] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 09:47:30 juju-e4d256-prod-github-runner-207 kernel: [15824.596820] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 09:47:30 juju-e4d256-prod-github-runner-207 kernel: [15824.597766] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 09:47:30 juju-e4d256-prod-github-runner-207 kernel: [15824.598755] handle_exit+0x98/0x230 [kvm_amd] Aug 22 09:47:30 juju-e4d256-prod-github-runner-207 kernel: [15824.599647] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 09:47:30 juju-e4d256-prod-github-runner-207 kernel: [15824.600560] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 09:47:30 juju-e4d256-prod-github-runner-207 kernel: [15824.601487] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 09:47:30 juju-e4d256-prod-github-runner-207 kernel: [15824.602410] vcpu_run+0x62/0x2c0 [kvm] Aug 22 09:47:30 juju-e4d256-prod-github-runner-207 kernel: [15824.603225] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 09:47:30 juju-e4d256-prod-github-runner-207 kernel: [15824.604035] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 09:47:30 juju-e4d256-prod-github-runner-207 kernel: [15824.604894] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 09:47:30 juju-e4d256-prod-github-runner-207 kernel: [15824.605695] ? __seccomp_filter+0x4a/0x4a0 Aug 22 09:47:30 juju-e4d256-prod-github-runner-207 kernel: [15824.606449] ? __fget_files+0x86/0xc0 Aug 22 09:47:30 juju-e4d256-prod-github-runner-207 kernel: [15824.607154] __x64_sys_ioctl+0x95/0xd0 Aug 22 09:47:30 juju-e4d256-prod-github-runner-207 kernel: [15824.607852] do_syscall_64+0x5c/0xc0 Aug 22 09:47:30 juju-e4d256-prod-github-runner-207 kernel: [15824.608517] ? do_futex+0x162/0x1f0 Aug 22 09:47:30 juju-e4d256-prod-github-runner-207 kernel: [15824.609167] ? __x64_sys_futex+0x78/0x1e0 Aug 22 09:47:30 juju-e4d256-prod-github-runner-207 kernel: [15824.609846] ? __secure_computing+0xa9/0x120 Aug 22 09:47:30 juju-e4d256-prod-github-runner-207 kernel: [15824.610548] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 09:47:30 juju-e4d256-prod-github-runner-207 kernel: [15824.611310] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:47:30 juju-e4d256-prod-github-runner-207 kernel: [15824.612032] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:47:30 juju-e4d256-prod-github-runner-207 kernel: [15824.612756] ? do_syscall_64+0x69/0xc0 Aug 22 09:47:30 juju-e4d256-prod-github-runner-207 kernel: [15824.613404] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:47:30 juju-e4d256-prod-github-runner-207 kernel: [15824.614108] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:47:30 juju-e4d256-prod-github-runner-207 kernel: [15824.614812] ? do_syscall_64+0x69/0xc0 Aug 22 09:47:30 juju-e4d256-prod-github-runner-207 kernel: [15824.615436] ? do_syscall_64+0x69/0xc0 Aug 22 09:47:30 juju-e4d256-prod-github-runner-207 kernel: [15824.616064] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 09:47:30 juju-e4d256-prod-github-runner-207 kernel: [15824.616776] RIP: 0033:0x7faa5d0edaff Aug 22 09:47:30 juju-e4d256-prod-github-runner-207 kernel: [15824.617481] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 09:47:30 juju-e4d256-prod-github-runner-207 kernel: [15824.619535] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 09:47:30 juju-e4d256-prod-github-runner-207 kernel: [15824.620470] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 09:47:30 juju-e4d256-prod-github-runner-207 kernel: [15824.621364] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 09:47:30 juju-e4d256-prod-github-runner-207 kernel: [15824.622262] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 09:47:30 juju-e4d256-prod-github-runner-207 kernel: [15824.623168] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 09:47:30 juju-e4d256-prod-github-runner-207 kernel: [15824.624061] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 09:47:30 juju-e4d256-prod-github-runner-207 kernel: [15824.624963] Aug 22 09:47:44 juju-e4d256-prod-github-runner-207 kernel: [15838.244707] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 09:47:44 juju-e4d256-prod-github-runner-207 kernel: [15838.245662] rcu: 1-....: (3917949 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=1892613 Aug 22 09:47:44 juju-e4d256-prod-github-runner-207 kernel: [15838.246794] (t=3930261 jiffies g=23269 q=22977) Aug 22 09:47:44 juju-e4d256-prod-github-runner-207 kernel: [15838.247722] NMI backtrace for cpu 1 Aug 22 09:47:44 juju-e4d256-prod-github-runner-207 kernel: [15838.248437] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 09:47:44 juju-e4d256-prod-github-runner-207 kernel: [15838.249543] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 09:47:44 juju-e4d256-prod-github-runner-207 kernel: [15838.250614] Call Trace: Aug 22 09:47:44 juju-e4d256-prod-github-runner-207 kernel: [15838.251289] Aug 22 09:47:44 juju-e4d256-prod-github-runner-207 kernel: [15838.251933] show_stack+0x52/0x5c Aug 22 09:47:44 juju-e4d256-prod-github-runner-207 kernel: [15838.252658] dump_stack_lvl+0x4a/0x63 Aug 22 09:47:44 juju-e4d256-prod-github-runner-207 kernel: [15838.253412] dump_stack+0x10/0x16 Aug 22 09:47:44 juju-e4d256-prod-github-runner-207 kernel: [15838.254135] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 09:47:44 juju-e4d256-prod-github-runner-207 kernel: [15838.254931] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 09:47:44 juju-e4d256-prod-github-runner-207 kernel: [15838.255717] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 09:47:44 juju-e4d256-prod-github-runner-207 kernel: [15838.256538] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 09:47:44 juju-e4d256-prod-github-runner-207 kernel: [15838.257360] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 09:47:44 juju-e4d256-prod-github-runner-207 kernel: [15838.258167] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 09:47:44 juju-e4d256-prod-github-runner-207 kernel: [15838.258956] print_cpu_stall.cold+0x2f/0xe2 Aug 22 09:47:44 juju-e4d256-prod-github-runner-207 kernel: [15838.259742] ? timekeeping_update+0xf7/0x150 Aug 22 09:47:44 juju-e4d256-prod-github-runner-207 kernel: [15838.260529] check_cpu_stall+0x109/0x270 Aug 22 09:47:44 juju-e4d256-prod-github-runner-207 kernel: [15838.261451] rcu_sched_clock_irq+0x9a/0x250 Aug 22 09:47:44 juju-e4d256-prod-github-runner-207 kernel: [15838.262459] update_process_times+0x94/0xd0 Aug 22 09:47:44 juju-e4d256-prod-github-runner-207 kernel: [15838.263447] tick_sched_handle+0x29/0x70 Aug 22 09:47:44 juju-e4d256-prod-github-runner-207 kernel: [15838.264410] tick_sched_timer+0x8c/0xc0 Aug 22 09:47:44 juju-e4d256-prod-github-runner-207 kernel: [15838.265367] ? tick_nohz_handler+0xb0/0xb0 Aug 22 09:47:44 juju-e4d256-prod-github-runner-207 kernel: [15838.266357] __hrtimer_run_queues+0x107/0x230 Aug 22 09:47:44 juju-e4d256-prod-github-runner-207 kernel: [15838.267352] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 09:47:44 juju-e4d256-prod-github-runner-207 kernel: [15838.268364] hrtimer_interrupt+0x101/0x220 Aug 22 09:47:44 juju-e4d256-prod-github-runner-207 kernel: [15838.269297] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 09:47:44 juju-e4d256-prod-github-runner-207 kernel: [15838.270432] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 09:47:44 juju-e4d256-prod-github-runner-207 kernel: [15838.271565] Aug 22 09:47:44 juju-e4d256-prod-github-runner-207 kernel: [15838.272501] Aug 22 09:47:44 juju-e4d256-prod-github-runner-207 kernel: [15838.273376] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 09:47:44 juju-e4d256-prod-github-runner-207 kernel: [15838.274583] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:47:44 juju-e4d256-prod-github-runner-207 kernel: [15838.275894] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 09:47:44 juju-e4d256-prod-github-runner-207 kernel: [15838.279157] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 09:47:44 juju-e4d256-prod-github-runner-207 kernel: [15838.280505] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 09:47:44 juju-e4d256-prod-github-runner-207 kernel: [15838.281840] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 09:47:44 juju-e4d256-prod-github-runner-207 kernel: [15838.283501] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 09:47:44 juju-e4d256-prod-github-runner-207 kernel: [15838.284943] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 09:47:44 juju-e4d256-prod-github-runner-207 kernel: [15838.286376] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 09:47:44 juju-e4d256-prod-github-runner-207 kernel: [15838.287809] ? _raw_spin_lock+0x22/0x30 Aug 22 09:47:44 juju-e4d256-prod-github-runner-207 kernel: [15838.288954] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:47:44 juju-e4d256-prod-github-runner-207 kernel: [15838.290384] direct_page_fault+0x206/0x310 [kvm] Aug 22 09:47:44 juju-e4d256-prod-github-runner-207 kernel: [15838.291247] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 09:47:44 juju-e4d256-prod-github-runner-207 kernel: [15838.292090] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 09:47:44 juju-e4d256-prod-github-runner-207 kernel: [15838.292975] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 09:47:44 juju-e4d256-prod-github-runner-207 kernel: [15838.293834] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 09:47:44 juju-e4d256-prod-github-runner-207 kernel: [15838.294665] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 09:47:44 juju-e4d256-prod-github-runner-207 kernel: [15838.295490] handle_exit+0x98/0x230 [kvm_amd] Aug 22 09:47:44 juju-e4d256-prod-github-runner-207 kernel: [15838.296245] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 09:47:44 juju-e4d256-prod-github-runner-207 kernel: [15838.297035] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 09:47:44 juju-e4d256-prod-github-runner-207 kernel: [15838.297834] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 09:47:44 juju-e4d256-prod-github-runner-207 kernel: [15838.298647] vcpu_run+0x62/0x2c0 [kvm] Aug 22 09:47:44 juju-e4d256-prod-github-runner-207 kernel: [15838.299369] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 09:47:44 juju-e4d256-prod-github-runner-207 kernel: [15838.300118] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 09:47:44 juju-e4d256-prod-github-runner-207 kernel: [15838.301096] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 09:47:44 juju-e4d256-prod-github-runner-207 kernel: [15838.301858] ? __seccomp_filter+0x4a/0x4a0 Aug 22 09:47:44 juju-e4d256-prod-github-runner-207 kernel: [15838.302594] ? __fget_files+0x86/0xc0 Aug 22 09:47:44 juju-e4d256-prod-github-runner-207 kernel: [15838.303289] __x64_sys_ioctl+0x95/0xd0 Aug 22 09:47:44 juju-e4d256-prod-github-runner-207 kernel: [15838.304007] do_syscall_64+0x5c/0xc0 Aug 22 09:47:44 juju-e4d256-prod-github-runner-207 kernel: [15838.304700] ? do_futex+0x162/0x1f0 Aug 22 09:47:44 juju-e4d256-prod-github-runner-207 kernel: [15838.305375] ? __x64_sys_futex+0x78/0x1e0 Aug 22 09:47:44 juju-e4d256-prod-github-runner-207 kernel: [15838.306077] ? __secure_computing+0xa9/0x120 Aug 22 09:47:44 juju-e4d256-prod-github-runner-207 kernel: [15838.306817] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 09:47:44 juju-e4d256-prod-github-runner-207 kernel: [15838.307610] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:47:44 juju-e4d256-prod-github-runner-207 kernel: [15838.308415] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:47:44 juju-e4d256-prod-github-runner-207 kernel: [15838.309369] ? do_syscall_64+0x69/0xc0 Aug 22 09:47:44 juju-e4d256-prod-github-runner-207 kernel: [15838.310062] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:47:44 juju-e4d256-prod-github-runner-207 kernel: [15838.310849] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:47:44 juju-e4d256-prod-github-runner-207 kernel: [15838.311610] ? do_syscall_64+0x69/0xc0 Aug 22 09:47:44 juju-e4d256-prod-github-runner-207 kernel: [15838.312344] ? do_syscall_64+0x69/0xc0 Aug 22 09:47:44 juju-e4d256-prod-github-runner-207 kernel: [15838.313039] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 09:47:44 juju-e4d256-prod-github-runner-207 kernel: [15838.313813] RIP: 0033:0x7faa5d0edaff Aug 22 09:47:44 juju-e4d256-prod-github-runner-207 kernel: [15838.314564] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 09:47:44 juju-e4d256-prod-github-runner-207 kernel: [15838.316759] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 09:47:44 juju-e4d256-prod-github-runner-207 kernel: [15838.317734] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 09:47:44 juju-e4d256-prod-github-runner-207 kernel: [15838.318700] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 09:47:44 juju-e4d256-prod-github-runner-207 kernel: [15838.319645] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 09:47:44 juju-e4d256-prod-github-runner-207 kernel: [15838.320586] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 09:47:44 juju-e4d256-prod-github-runner-207 kernel: [15838.321519] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 09:47:44 juju-e4d256-prod-github-runner-207 kernel: [15838.322492] Aug 22 09:48:10 juju-e4d256-prod-github-runner-207 kernel: [15864.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 14667s! [qemu-system-x86:6715] Aug 22 09:48:10 juju-e4d256-prod-github-runner-207 kernel: [15864.543778] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 09:48:10 juju-e4d256-prod-github-runner-207 kernel: [15864.544056] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 09:48:10 juju-e4d256-prod-github-runner-207 kernel: [15864.556559] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 09:48:10 juju-e4d256-prod-github-runner-207 kernel: [15864.557912] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 09:48:10 juju-e4d256-prod-github-runner-207 kernel: [15864.559164] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:48:10 juju-e4d256-prod-github-runner-207 kernel: [15864.560257] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 09:48:10 juju-e4d256-prod-github-runner-207 kernel: [15864.562860] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 09:48:10 juju-e4d256-prod-github-runner-207 kernel: [15864.563915] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 09:48:10 juju-e4d256-prod-github-runner-207 kernel: [15864.565074] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 09:48:10 juju-e4d256-prod-github-runner-207 kernel: [15864.566261] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 09:48:10 juju-e4d256-prod-github-runner-207 kernel: [15864.567419] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 09:48:10 juju-e4d256-prod-github-runner-207 kernel: [15864.568599] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 09:48:10 juju-e4d256-prod-github-runner-207 kernel: [15864.569813] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 09:48:10 juju-e4d256-prod-github-runner-207 kernel: [15864.571088] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 09:48:10 juju-e4d256-prod-github-runner-207 kernel: [15864.572240] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 09:48:10 juju-e4d256-prod-github-runner-207 kernel: [15864.573493] Call Trace: Aug 22 09:48:10 juju-e4d256-prod-github-runner-207 kernel: [15864.574468] Aug 22 09:48:10 juju-e4d256-prod-github-runner-207 kernel: [15864.575399] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:48:10 juju-e4d256-prod-github-runner-207 kernel: [15864.576435] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:48:10 juju-e4d256-prod-github-runner-207 kernel: [15864.577469] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:48:10 juju-e4d256-prod-github-runner-207 kernel: [15864.578613] ? show_regs.part.0+0x23/0x29 Aug 22 09:48:10 juju-e4d256-prod-github-runner-207 kernel: [15864.579621] ? show_regs.cold+0x8/0xd Aug 22 09:48:10 juju-e4d256-prod-github-runner-207 kernel: [15864.580604] ? watchdog_timer_fn+0x1be/0x220 Aug 22 09:48:10 juju-e4d256-prod-github-runner-207 kernel: [15864.581674] ? lockup_detector_update_enable+0x60/0x60 Aug 22 09:48:10 juju-e4d256-prod-github-runner-207 kernel: [15864.582790] ? __hrtimer_run_queues+0x107/0x230 Aug 22 09:48:10 juju-e4d256-prod-github-runner-207 kernel: [15864.583881] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 09:48:10 juju-e4d256-prod-github-runner-207 kernel: [15864.584939] ? hrtimer_interrupt+0x101/0x220 Aug 22 09:48:10 juju-e4d256-prod-github-runner-207 kernel: [15864.586044] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 09:48:10 juju-e4d256-prod-github-runner-207 kernel: [15864.587327] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 09:48:10 juju-e4d256-prod-github-runner-207 kernel: [15864.588396] Aug 22 09:48:10 juju-e4d256-prod-github-runner-207 kernel: [15864.589280] Aug 22 09:48:10 juju-e4d256-prod-github-runner-207 kernel: [15864.590152] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 09:48:10 juju-e4d256-prod-github-runner-207 kernel: [15864.591309] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:48:10 juju-e4d256-prod-github-runner-207 kernel: [15864.592357] ? _raw_spin_lock+0x22/0x30 Aug 22 09:48:10 juju-e4d256-prod-github-runner-207 kernel: [15864.593306] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:48:10 juju-e4d256-prod-github-runner-207 kernel: [15864.594355] direct_page_fault+0x206/0x310 [kvm] Aug 22 09:48:10 juju-e4d256-prod-github-runner-207 kernel: [15864.595384] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 09:48:10 juju-e4d256-prod-github-runner-207 kernel: [15864.596404] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 09:48:10 juju-e4d256-prod-github-runner-207 kernel: [15864.597414] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 09:48:10 juju-e4d256-prod-github-runner-207 kernel: [15864.598459] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 09:48:10 juju-e4d256-prod-github-runner-207 kernel: [15864.599411] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 09:48:10 juju-e4d256-prod-github-runner-207 kernel: [15864.600397] handle_exit+0x98/0x230 [kvm_amd] Aug 22 09:48:10 juju-e4d256-prod-github-runner-207 kernel: [15864.601318] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 09:48:10 juju-e4d256-prod-github-runner-207 kernel: [15864.602282] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 09:48:10 juju-e4d256-prod-github-runner-207 kernel: [15864.603217] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 09:48:10 juju-e4d256-prod-github-runner-207 kernel: [15864.604126] vcpu_run+0x62/0x2c0 [kvm] Aug 22 09:48:10 juju-e4d256-prod-github-runner-207 kernel: [15864.604942] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 09:48:10 juju-e4d256-prod-github-runner-207 kernel: [15864.605759] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 09:48:10 juju-e4d256-prod-github-runner-207 kernel: [15864.606683] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 09:48:10 juju-e4d256-prod-github-runner-207 kernel: [15864.607484] ? __seccomp_filter+0x4a/0x4a0 Aug 22 09:48:10 juju-e4d256-prod-github-runner-207 kernel: [15864.608232] ? __fget_files+0x86/0xc0 Aug 22 09:48:10 juju-e4d256-prod-github-runner-207 kernel: [15864.609050] __x64_sys_ioctl+0x95/0xd0 Aug 22 09:48:10 juju-e4d256-prod-github-runner-207 kernel: [15864.609744] do_syscall_64+0x5c/0xc0 Aug 22 09:48:10 juju-e4d256-prod-github-runner-207 kernel: [15864.610436] ? do_futex+0x162/0x1f0 Aug 22 09:48:10 juju-e4d256-prod-github-runner-207 kernel: [15864.611100] ? __x64_sys_futex+0x78/0x1e0 Aug 22 09:48:10 juju-e4d256-prod-github-runner-207 kernel: [15864.611781] ? __secure_computing+0xa9/0x120 Aug 22 09:48:10 juju-e4d256-prod-github-runner-207 kernel: [15864.612473] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 09:48:10 juju-e4d256-prod-github-runner-207 kernel: [15864.613239] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:48:10 juju-e4d256-prod-github-runner-207 kernel: [15864.613985] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:48:10 juju-e4d256-prod-github-runner-207 kernel: [15864.614719] ? do_syscall_64+0x69/0xc0 Aug 22 09:48:10 juju-e4d256-prod-github-runner-207 kernel: [15864.615365] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:48:10 juju-e4d256-prod-github-runner-207 kernel: [15864.616069] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:48:10 juju-e4d256-prod-github-runner-207 kernel: [15864.616776] ? do_syscall_64+0x69/0xc0 Aug 22 09:48:10 juju-e4d256-prod-github-runner-207 kernel: [15864.617406] ? do_syscall_64+0x69/0xc0 Aug 22 09:48:10 juju-e4d256-prod-github-runner-207 kernel: [15864.618056] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 09:48:10 juju-e4d256-prod-github-runner-207 kernel: [15864.618765] RIP: 0033:0x7faa5d0edaff Aug 22 09:48:10 juju-e4d256-prod-github-runner-207 kernel: [15864.619414] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 09:48:10 juju-e4d256-prod-github-runner-207 kernel: [15864.621430] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 09:48:10 juju-e4d256-prod-github-runner-207 kernel: [15864.622367] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 09:48:10 juju-e4d256-prod-github-runner-207 kernel: [15864.623262] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 09:48:10 juju-e4d256-prod-github-runner-207 kernel: [15864.624165] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 09:48:10 juju-e4d256-prod-github-runner-207 kernel: [15864.625064] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 09:48:10 juju-e4d256-prod-github-runner-207 kernel: [15864.625974] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 09:48:10 juju-e4d256-prod-github-runner-207 kernel: [15864.626870] Aug 22 09:48:38 juju-e4d256-prod-github-runner-207 kernel: [15892.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 14693s! [qemu-system-x86:6715] Aug 22 09:48:38 juju-e4d256-prod-github-runner-207 kernel: [15892.543096] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 09:48:38 juju-e4d256-prod-github-runner-207 kernel: [15892.543162] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 09:48:38 juju-e4d256-prod-github-runner-207 kernel: [15892.555256] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 09:48:38 juju-e4d256-prod-github-runner-207 kernel: [15892.556516] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 09:48:38 juju-e4d256-prod-github-runner-207 kernel: [15892.557750] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:48:38 juju-e4d256-prod-github-runner-207 kernel: [15892.558803] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 09:48:38 juju-e4d256-prod-github-runner-207 kernel: [15892.561346] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 09:48:38 juju-e4d256-prod-github-runner-207 kernel: [15892.562403] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 09:48:38 juju-e4d256-prod-github-runner-207 kernel: [15892.563571] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 09:48:38 juju-e4d256-prod-github-runner-207 kernel: [15892.564731] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 09:48:38 juju-e4d256-prod-github-runner-207 kernel: [15892.565903] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 09:48:38 juju-e4d256-prod-github-runner-207 kernel: [15892.567064] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 09:48:38 juju-e4d256-prod-github-runner-207 kernel: [15892.568234] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 09:48:38 juju-e4d256-prod-github-runner-207 kernel: [15892.569471] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 09:48:38 juju-e4d256-prod-github-runner-207 kernel: [15892.570589] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 09:48:38 juju-e4d256-prod-github-runner-207 kernel: [15892.571902] Call Trace: Aug 22 09:48:38 juju-e4d256-prod-github-runner-207 kernel: [15892.572917] Aug 22 09:48:38 juju-e4d256-prod-github-runner-207 kernel: [15892.573820] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:48:38 juju-e4d256-prod-github-runner-207 kernel: [15892.574850] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:48:38 juju-e4d256-prod-github-runner-207 kernel: [15892.575884] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:48:38 juju-e4d256-prod-github-runner-207 kernel: [15892.576963] ? show_regs.part.0+0x23/0x29 Aug 22 09:48:38 juju-e4d256-prod-github-runner-207 kernel: [15892.578147] ? show_regs.cold+0x8/0xd Aug 22 09:48:38 juju-e4d256-prod-github-runner-207 kernel: [15892.579117] ? watchdog_timer_fn+0x1be/0x220 Aug 22 09:48:38 juju-e4d256-prod-github-runner-207 kernel: [15892.580258] ? lockup_detector_update_enable+0x60/0x60 Aug 22 09:48:38 juju-e4d256-prod-github-runner-207 kernel: [15892.581317] ? __hrtimer_run_queues+0x107/0x230 Aug 22 09:48:38 juju-e4d256-prod-github-runner-207 kernel: [15892.582356] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 09:48:38 juju-e4d256-prod-github-runner-207 kernel: [15892.583377] ? hrtimer_interrupt+0x101/0x220 Aug 22 09:48:38 juju-e4d256-prod-github-runner-207 kernel: [15892.584403] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 09:48:38 juju-e4d256-prod-github-runner-207 kernel: [15892.585481] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 09:48:38 juju-e4d256-prod-github-runner-207 kernel: [15892.586548] Aug 22 09:48:38 juju-e4d256-prod-github-runner-207 kernel: [15892.587405] Aug 22 09:48:38 juju-e4d256-prod-github-runner-207 kernel: [15892.588245] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 09:48:38 juju-e4d256-prod-github-runner-207 kernel: [15892.589286] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:48:38 juju-e4d256-prod-github-runner-207 kernel: [15892.590344] ? _raw_spin_lock+0x22/0x30 Aug 22 09:48:38 juju-e4d256-prod-github-runner-207 kernel: [15892.591433] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:48:38 juju-e4d256-prod-github-runner-207 kernel: [15892.592698] direct_page_fault+0x206/0x310 [kvm] Aug 22 09:48:38 juju-e4d256-prod-github-runner-207 kernel: [15892.593963] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 09:48:38 juju-e4d256-prod-github-runner-207 kernel: [15892.595210] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 09:48:38 juju-e4d256-prod-github-runner-207 kernel: [15892.596496] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 09:48:38 juju-e4d256-prod-github-runner-207 kernel: [15892.597767] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 09:48:38 juju-e4d256-prod-github-runner-207 kernel: [15892.598854] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 09:48:38 juju-e4d256-prod-github-runner-207 kernel: [15892.599892] handle_exit+0x98/0x230 [kvm_amd] Aug 22 09:48:38 juju-e4d256-prod-github-runner-207 kernel: [15892.600796] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 09:48:38 juju-e4d256-prod-github-runner-207 kernel: [15892.601752] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 09:48:38 juju-e4d256-prod-github-runner-207 kernel: [15892.602684] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 09:48:38 juju-e4d256-prod-github-runner-207 kernel: [15892.603594] vcpu_run+0x62/0x2c0 [kvm] Aug 22 09:48:38 juju-e4d256-prod-github-runner-207 kernel: [15892.604416] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 09:48:38 juju-e4d256-prod-github-runner-207 kernel: [15892.605241] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 09:48:38 juju-e4d256-prod-github-runner-207 kernel: [15892.606134] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 09:48:38 juju-e4d256-prod-github-runner-207 kernel: [15892.606937] ? __seccomp_filter+0x4a/0x4a0 Aug 22 09:48:38 juju-e4d256-prod-github-runner-207 kernel: [15892.607687] ? __fget_files+0x86/0xc0 Aug 22 09:48:38 juju-e4d256-prod-github-runner-207 kernel: [15892.608403] __x64_sys_ioctl+0x95/0xd0 Aug 22 09:48:38 juju-e4d256-prod-github-runner-207 kernel: [15892.609101] do_syscall_64+0x5c/0xc0 Aug 22 09:48:38 juju-e4d256-prod-github-runner-207 kernel: [15892.609785] ? do_futex+0x162/0x1f0 Aug 22 09:48:38 juju-e4d256-prod-github-runner-207 kernel: [15892.610441] ? __x64_sys_futex+0x78/0x1e0 Aug 22 09:48:38 juju-e4d256-prod-github-runner-207 kernel: [15892.611118] ? __secure_computing+0xa9/0x120 Aug 22 09:48:38 juju-e4d256-prod-github-runner-207 kernel: [15892.611814] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 09:48:38 juju-e4d256-prod-github-runner-207 kernel: [15892.612584] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:48:38 juju-e4d256-prod-github-runner-207 kernel: [15892.613312] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:48:38 juju-e4d256-prod-github-runner-207 kernel: [15892.614052] ? do_syscall_64+0x69/0xc0 Aug 22 09:48:38 juju-e4d256-prod-github-runner-207 kernel: [15892.614708] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:48:38 juju-e4d256-prod-github-runner-207 kernel: [15892.615415] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:48:38 juju-e4d256-prod-github-runner-207 kernel: [15892.616114] ? do_syscall_64+0x69/0xc0 Aug 22 09:48:38 juju-e4d256-prod-github-runner-207 kernel: [15892.616748] ? do_syscall_64+0x69/0xc0 Aug 22 09:48:38 juju-e4d256-prod-github-runner-207 kernel: [15892.617389] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 09:48:38 juju-e4d256-prod-github-runner-207 kernel: [15892.618118] RIP: 0033:0x7faa5d0edaff Aug 22 09:48:38 juju-e4d256-prod-github-runner-207 kernel: [15892.618767] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 09:48:38 juju-e4d256-prod-github-runner-207 kernel: [15892.620765] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 09:48:38 juju-e4d256-prod-github-runner-207 kernel: [15892.621703] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 09:48:38 juju-e4d256-prod-github-runner-207 kernel: [15892.622605] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 09:48:38 juju-e4d256-prod-github-runner-207 kernel: [15892.623505] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 09:48:38 juju-e4d256-prod-github-runner-207 kernel: [15892.624397] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 09:48:38 juju-e4d256-prod-github-runner-207 kernel: [15892.625293] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 09:48:38 juju-e4d256-prod-github-runner-207 kernel: [15892.626208] Aug 22 09:49:06 juju-e4d256-prod-github-runner-207 kernel: [15920.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 14719s! [qemu-system-x86:6715] Aug 22 09:49:06 juju-e4d256-prod-github-runner-207 kernel: [15920.543087] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 09:49:06 juju-e4d256-prod-github-runner-207 kernel: [15920.543154] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 09:49:06 juju-e4d256-prod-github-runner-207 kernel: [15920.555238] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 09:49:06 juju-e4d256-prod-github-runner-207 kernel: [15920.556511] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 09:49:06 juju-e4d256-prod-github-runner-207 kernel: [15920.557753] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:49:06 juju-e4d256-prod-github-runner-207 kernel: [15920.558809] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 09:49:06 juju-e4d256-prod-github-runner-207 kernel: [15920.561362] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 09:49:06 juju-e4d256-prod-github-runner-207 kernel: [15920.562404] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 09:49:06 juju-e4d256-prod-github-runner-207 kernel: [15920.563565] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 09:49:06 juju-e4d256-prod-github-runner-207 kernel: [15920.564726] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 09:49:06 juju-e4d256-prod-github-runner-207 kernel: [15920.565955] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 09:49:06 juju-e4d256-prod-github-runner-207 kernel: [15920.567126] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 09:49:06 juju-e4d256-prod-github-runner-207 kernel: [15920.568289] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 09:49:06 juju-e4d256-prod-github-runner-207 kernel: [15920.569531] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 09:49:06 juju-e4d256-prod-github-runner-207 kernel: [15920.570641] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 09:49:06 juju-e4d256-prod-github-runner-207 kernel: [15920.572018] Call Trace: Aug 22 09:49:06 juju-e4d256-prod-github-runner-207 kernel: [15920.572932] Aug 22 09:49:06 juju-e4d256-prod-github-runner-207 kernel: [15920.573836] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:49:06 juju-e4d256-prod-github-runner-207 kernel: [15920.574866] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:49:06 juju-e4d256-prod-github-runner-207 kernel: [15920.575888] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:49:06 juju-e4d256-prod-github-runner-207 kernel: [15920.576963] ? show_regs.part.0+0x23/0x29 Aug 22 09:49:06 juju-e4d256-prod-github-runner-207 kernel: [15920.577967] ? show_regs.cold+0x8/0xd Aug 22 09:49:06 juju-e4d256-prod-github-runner-207 kernel: [15920.578940] ? watchdog_timer_fn+0x1be/0x220 Aug 22 09:49:06 juju-e4d256-prod-github-runner-207 kernel: [15920.579946] ? lockup_detector_update_enable+0x60/0x60 Aug 22 09:49:06 juju-e4d256-prod-github-runner-207 kernel: [15920.581006] ? __hrtimer_run_queues+0x107/0x230 Aug 22 09:49:06 juju-e4d256-prod-github-runner-207 kernel: [15920.582048] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 09:49:06 juju-e4d256-prod-github-runner-207 kernel: [15920.583069] ? hrtimer_interrupt+0x101/0x220 Aug 22 09:49:06 juju-e4d256-prod-github-runner-207 kernel: [15920.584081] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 09:49:06 juju-e4d256-prod-github-runner-207 kernel: [15920.585153] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 09:49:06 juju-e4d256-prod-github-runner-207 kernel: [15920.586222] Aug 22 09:49:06 juju-e4d256-prod-github-runner-207 kernel: [15920.587084] Aug 22 09:49:06 juju-e4d256-prod-github-runner-207 kernel: [15920.587925] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 09:49:06 juju-e4d256-prod-github-runner-207 kernel: [15920.588955] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:49:06 juju-e4d256-prod-github-runner-207 kernel: [15920.590010] ? _raw_spin_lock+0x22/0x30 Aug 22 09:49:06 juju-e4d256-prod-github-runner-207 kernel: [15920.590952] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:49:06 juju-e4d256-prod-github-runner-207 kernel: [15920.591972] direct_page_fault+0x206/0x310 [kvm] Aug 22 09:49:06 juju-e4d256-prod-github-runner-207 kernel: [15920.592992] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 09:49:06 juju-e4d256-prod-github-runner-207 kernel: [15920.594007] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 09:49:06 juju-e4d256-prod-github-runner-207 kernel: [15920.595004] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 09:49:06 juju-e4d256-prod-github-runner-207 kernel: [15920.595973] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 09:49:06 juju-e4d256-prod-github-runner-207 kernel: [15920.596916] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 09:49:06 juju-e4d256-prod-github-runner-207 kernel: [15920.597914] handle_exit+0x98/0x230 [kvm_amd] Aug 22 09:49:06 juju-e4d256-prod-github-runner-207 kernel: [15920.598803] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 09:49:06 juju-e4d256-prod-github-runner-207 kernel: [15920.599719] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 09:49:06 juju-e4d256-prod-github-runner-207 kernel: [15920.600640] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 09:49:06 juju-e4d256-prod-github-runner-207 kernel: [15920.601579] vcpu_run+0x62/0x2c0 [kvm] Aug 22 09:49:06 juju-e4d256-prod-github-runner-207 kernel: [15920.602395] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 09:49:06 juju-e4d256-prod-github-runner-207 kernel: [15920.603202] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 09:49:06 juju-e4d256-prod-github-runner-207 kernel: [15920.604056] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 09:49:06 juju-e4d256-prod-github-runner-207 kernel: [15920.604852] ? __seccomp_filter+0x4a/0x4a0 Aug 22 09:49:06 juju-e4d256-prod-github-runner-207 kernel: [15920.605614] ? __fget_files+0x86/0xc0 Aug 22 09:49:06 juju-e4d256-prod-github-runner-207 kernel: [15920.606317] __x64_sys_ioctl+0x95/0xd0 Aug 22 09:49:06 juju-e4d256-prod-github-runner-207 kernel: [15920.607013] do_syscall_64+0x5c/0xc0 Aug 22 09:49:06 juju-e4d256-prod-github-runner-207 kernel: [15920.607681] ? do_futex+0x162/0x1f0 Aug 22 09:49:06 juju-e4d256-prod-github-runner-207 kernel: [15920.608328] ? __x64_sys_futex+0x78/0x1e0 Aug 22 09:49:06 juju-e4d256-prod-github-runner-207 kernel: [15920.609001] ? __secure_computing+0xa9/0x120 Aug 22 09:49:06 juju-e4d256-prod-github-runner-207 kernel: [15920.609707] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 09:49:06 juju-e4d256-prod-github-runner-207 kernel: [15920.610465] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:49:06 juju-e4d256-prod-github-runner-207 kernel: [15920.611185] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:49:06 juju-e4d256-prod-github-runner-207 kernel: [15920.611902] ? do_syscall_64+0x69/0xc0 Aug 22 09:49:06 juju-e4d256-prod-github-runner-207 kernel: [15920.612544] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:49:06 juju-e4d256-prod-github-runner-207 kernel: [15920.613263] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:49:06 juju-e4d256-prod-github-runner-207 kernel: [15920.613962] ? do_syscall_64+0x69/0xc0 Aug 22 09:49:06 juju-e4d256-prod-github-runner-207 kernel: [15920.614586] ? do_syscall_64+0x69/0xc0 Aug 22 09:49:06 juju-e4d256-prod-github-runner-207 kernel: [15920.615218] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 09:49:06 juju-e4d256-prod-github-runner-207 kernel: [15920.615929] RIP: 0033:0x7faa5d0edaff Aug 22 09:49:06 juju-e4d256-prod-github-runner-207 kernel: [15920.616559] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 09:49:06 juju-e4d256-prod-github-runner-207 kernel: [15920.618609] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 09:49:06 juju-e4d256-prod-github-runner-207 kernel: [15920.619527] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 09:49:06 juju-e4d256-prod-github-runner-207 kernel: [15920.620417] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 09:49:06 juju-e4d256-prod-github-runner-207 kernel: [15920.621318] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 09:49:06 juju-e4d256-prod-github-runner-207 kernel: [15920.622207] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 09:49:06 juju-e4d256-prod-github-runner-207 kernel: [15920.623100] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 09:49:06 juju-e4d256-prod-github-runner-207 kernel: [15920.624003] Aug 22 09:49:34 juju-e4d256-prod-github-runner-207 kernel: [15948.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 14745s! [qemu-system-x86:6715] Aug 22 09:49:34 juju-e4d256-prod-github-runner-207 kernel: [15948.543725] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 09:49:34 juju-e4d256-prod-github-runner-207 kernel: [15948.543984] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 09:49:34 juju-e4d256-prod-github-runner-207 kernel: [15948.556130] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 09:49:34 juju-e4d256-prod-github-runner-207 kernel: [15948.557434] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 09:49:34 juju-e4d256-prod-github-runner-207 kernel: [15948.558663] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:49:34 juju-e4d256-prod-github-runner-207 kernel: [15948.559723] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 09:49:34 juju-e4d256-prod-github-runner-207 kernel: [15948.562403] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 09:49:34 juju-e4d256-prod-github-runner-207 kernel: [15948.563590] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 09:49:34 juju-e4d256-prod-github-runner-207 kernel: [15948.564750] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 09:49:34 juju-e4d256-prod-github-runner-207 kernel: [15948.565938] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 09:49:34 juju-e4d256-prod-github-runner-207 kernel: [15948.567096] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 09:49:34 juju-e4d256-prod-github-runner-207 kernel: [15948.568256] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 09:49:34 juju-e4d256-prod-github-runner-207 kernel: [15948.569437] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 09:49:34 juju-e4d256-prod-github-runner-207 kernel: [15948.570671] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 09:49:34 juju-e4d256-prod-github-runner-207 kernel: [15948.571773] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 09:49:34 juju-e4d256-prod-github-runner-207 kernel: [15948.572979] Call Trace: Aug 22 09:49:34 juju-e4d256-prod-github-runner-207 kernel: [15948.573890] Aug 22 09:49:34 juju-e4d256-prod-github-runner-207 kernel: [15948.574798] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:49:34 juju-e4d256-prod-github-runner-207 kernel: [15948.575839] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:49:34 juju-e4d256-prod-github-runner-207 kernel: [15948.576943] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:49:34 juju-e4d256-prod-github-runner-207 kernel: [15948.578115] ? show_regs.part.0+0x23/0x29 Aug 22 09:49:34 juju-e4d256-prod-github-runner-207 kernel: [15948.579126] ? show_regs.cold+0x8/0xd Aug 22 09:49:34 juju-e4d256-prod-github-runner-207 kernel: [15948.580097] ? watchdog_timer_fn+0x1be/0x220 Aug 22 09:49:34 juju-e4d256-prod-github-runner-207 kernel: [15948.581132] ? lockup_detector_update_enable+0x60/0x60 Aug 22 09:49:34 juju-e4d256-prod-github-runner-207 kernel: [15948.582204] ? __hrtimer_run_queues+0x107/0x230 Aug 22 09:49:34 juju-e4d256-prod-github-runner-207 kernel: [15948.583233] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 09:49:34 juju-e4d256-prod-github-runner-207 kernel: [15948.584262] ? hrtimer_interrupt+0x101/0x220 Aug 22 09:49:34 juju-e4d256-prod-github-runner-207 kernel: [15948.585293] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 09:49:34 juju-e4d256-prod-github-runner-207 kernel: [15948.586363] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 09:49:34 juju-e4d256-prod-github-runner-207 kernel: [15948.587413] Aug 22 09:49:34 juju-e4d256-prod-github-runner-207 kernel: [15948.588265] Aug 22 09:49:34 juju-e4d256-prod-github-runner-207 kernel: [15948.589134] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 09:49:34 juju-e4d256-prod-github-runner-207 kernel: [15948.590168] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:49:34 juju-e4d256-prod-github-runner-207 kernel: [15948.591213] ? _raw_spin_lock+0x22/0x30 Aug 22 09:49:34 juju-e4d256-prod-github-runner-207 kernel: [15948.592157] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:49:34 juju-e4d256-prod-github-runner-207 kernel: [15948.593196] direct_page_fault+0x206/0x310 [kvm] Aug 22 09:49:34 juju-e4d256-prod-github-runner-207 kernel: [15948.594222] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 09:49:34 juju-e4d256-prod-github-runner-207 kernel: [15948.595233] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 09:49:34 juju-e4d256-prod-github-runner-207 kernel: [15948.596245] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 09:49:34 juju-e4d256-prod-github-runner-207 kernel: [15948.597306] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 09:49:34 juju-e4d256-prod-github-runner-207 kernel: [15948.598263] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 09:49:34 juju-e4d256-prod-github-runner-207 kernel: [15948.599241] handle_exit+0x98/0x230 [kvm_amd] Aug 22 09:49:34 juju-e4d256-prod-github-runner-207 kernel: [15948.600139] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 09:49:34 juju-e4d256-prod-github-runner-207 kernel: [15948.601074] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 09:49:34 juju-e4d256-prod-github-runner-207 kernel: [15948.601999] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 09:49:34 juju-e4d256-prod-github-runner-207 kernel: [15948.602907] vcpu_run+0x62/0x2c0 [kvm] Aug 22 09:49:34 juju-e4d256-prod-github-runner-207 kernel: [15948.603716] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 09:49:34 juju-e4d256-prod-github-runner-207 kernel: [15948.604522] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 09:49:34 juju-e4d256-prod-github-runner-207 kernel: [15948.605406] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 09:49:34 juju-e4d256-prod-github-runner-207 kernel: [15948.606209] ? __seccomp_filter+0x4a/0x4a0 Aug 22 09:49:34 juju-e4d256-prod-github-runner-207 kernel: [15948.606951] ? __fget_files+0x86/0xc0 Aug 22 09:49:34 juju-e4d256-prod-github-runner-207 kernel: [15948.607657] __x64_sys_ioctl+0x95/0xd0 Aug 22 09:49:34 juju-e4d256-prod-github-runner-207 kernel: [15948.608350] do_syscall_64+0x5c/0xc0 Aug 22 09:49:34 juju-e4d256-prod-github-runner-207 kernel: [15948.609033] ? do_futex+0x162/0x1f0 Aug 22 09:49:34 juju-e4d256-prod-github-runner-207 kernel: [15948.609686] ? __x64_sys_futex+0x78/0x1e0 Aug 22 09:49:34 juju-e4d256-prod-github-runner-207 kernel: [15948.610359] ? __secure_computing+0xa9/0x120 Aug 22 09:49:34 juju-e4d256-prod-github-runner-207 kernel: [15948.611049] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 09:49:34 juju-e4d256-prod-github-runner-207 kernel: [15948.611824] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:49:34 juju-e4d256-prod-github-runner-207 kernel: [15948.612549] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:49:34 juju-e4d256-prod-github-runner-207 kernel: [15948.613286] ? do_syscall_64+0x69/0xc0 Aug 22 09:49:34 juju-e4d256-prod-github-runner-207 kernel: [15948.613932] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:49:34 juju-e4d256-prod-github-runner-207 kernel: [15948.614635] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:49:34 juju-e4d256-prod-github-runner-207 kernel: [15948.615331] ? do_syscall_64+0x69/0xc0 Aug 22 09:49:34 juju-e4d256-prod-github-runner-207 kernel: [15948.615957] ? do_syscall_64+0x69/0xc0 Aug 22 09:49:34 juju-e4d256-prod-github-runner-207 kernel: [15948.616580] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 09:49:34 juju-e4d256-prod-github-runner-207 kernel: [15948.617297] RIP: 0033:0x7faa5d0edaff Aug 22 09:49:34 juju-e4d256-prod-github-runner-207 kernel: [15948.617948] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 09:49:34 juju-e4d256-prod-github-runner-207 kernel: [15948.619932] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 09:49:34 juju-e4d256-prod-github-runner-207 kernel: [15948.620843] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 09:49:34 juju-e4d256-prod-github-runner-207 kernel: [15948.621748] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 09:49:34 juju-e4d256-prod-github-runner-207 kernel: [15948.622639] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 09:49:34 juju-e4d256-prod-github-runner-207 kernel: [15948.623528] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 09:49:34 juju-e4d256-prod-github-runner-207 kernel: [15948.624416] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 09:49:34 juju-e4d256-prod-github-runner-207 kernel: [15948.625327] Aug 22 09:50:02 juju-e4d256-prod-github-runner-207 kernel: [15976.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 14771s! [qemu-system-x86:6715] Aug 22 09:50:02 juju-e4d256-prod-github-runner-207 kernel: [15976.543095] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 09:50:02 juju-e4d256-prod-github-runner-207 kernel: [15976.543163] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 09:50:02 juju-e4d256-prod-github-runner-207 kernel: [15976.555196] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 09:50:02 juju-e4d256-prod-github-runner-207 kernel: [15976.556457] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 09:50:02 juju-e4d256-prod-github-runner-207 kernel: [15976.557685] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:50:02 juju-e4d256-prod-github-runner-207 kernel: [15976.558759] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 09:50:02 juju-e4d256-prod-github-runner-207 kernel: [15976.561318] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 09:50:02 juju-e4d256-prod-github-runner-207 kernel: [15976.562360] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 09:50:02 juju-e4d256-prod-github-runner-207 kernel: [15976.563532] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 09:50:02 juju-e4d256-prod-github-runner-207 kernel: [15976.564712] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 09:50:02 juju-e4d256-prod-github-runner-207 kernel: [15976.565872] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 09:50:02 juju-e4d256-prod-github-runner-207 kernel: [15976.567097] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 09:50:02 juju-e4d256-prod-github-runner-207 kernel: [15976.568261] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 09:50:02 juju-e4d256-prod-github-runner-207 kernel: [15976.569499] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 09:50:02 juju-e4d256-prod-github-runner-207 kernel: [15976.570596] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 09:50:02 juju-e4d256-prod-github-runner-207 kernel: [15976.571783] Call Trace: Aug 22 09:50:02 juju-e4d256-prod-github-runner-207 kernel: [15976.572705] Aug 22 09:50:02 juju-e4d256-prod-github-runner-207 kernel: [15976.573593] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:50:02 juju-e4d256-prod-github-runner-207 kernel: [15976.574620] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:50:02 juju-e4d256-prod-github-runner-207 kernel: [15976.575640] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:50:02 juju-e4d256-prod-github-runner-207 kernel: [15976.576716] ? show_regs.part.0+0x23/0x29 Aug 22 09:50:02 juju-e4d256-prod-github-runner-207 kernel: [15976.577711] ? show_regs.cold+0x8/0xd Aug 22 09:50:02 juju-e4d256-prod-github-runner-207 kernel: [15976.578681] ? watchdog_timer_fn+0x1be/0x220 Aug 22 09:50:02 juju-e4d256-prod-github-runner-207 kernel: [15976.579685] ? lockup_detector_update_enable+0x60/0x60 Aug 22 09:50:02 juju-e4d256-prod-github-runner-207 kernel: [15976.580759] ? __hrtimer_run_queues+0x107/0x230 Aug 22 09:50:02 juju-e4d256-prod-github-runner-207 kernel: [15976.581785] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 09:50:02 juju-e4d256-prod-github-runner-207 kernel: [15976.582804] ? hrtimer_interrupt+0x101/0x220 Aug 22 09:50:02 juju-e4d256-prod-github-runner-207 kernel: [15976.583822] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 09:50:02 juju-e4d256-prod-github-runner-207 kernel: [15976.584898] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 09:50:02 juju-e4d256-prod-github-runner-207 kernel: [15976.585940] Aug 22 09:50:02 juju-e4d256-prod-github-runner-207 kernel: [15976.586794] Aug 22 09:50:02 juju-e4d256-prod-github-runner-207 kernel: [15976.587628] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 09:50:02 juju-e4d256-prod-github-runner-207 kernel: [15976.588684] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:50:02 juju-e4d256-prod-github-runner-207 kernel: [15976.589732] ? _raw_spin_lock+0x22/0x30 Aug 22 09:50:02 juju-e4d256-prod-github-runner-207 kernel: [15976.590678] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:50:02 juju-e4d256-prod-github-runner-207 kernel: [15976.591694] direct_page_fault+0x206/0x310 [kvm] Aug 22 09:50:02 juju-e4d256-prod-github-runner-207 kernel: [15976.592753] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 09:50:02 juju-e4d256-prod-github-runner-207 kernel: [15976.593774] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 09:50:02 juju-e4d256-prod-github-runner-207 kernel: [15976.594772] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 09:50:02 juju-e4d256-prod-github-runner-207 kernel: [15976.595744] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 09:50:02 juju-e4d256-prod-github-runner-207 kernel: [15976.596695] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 09:50:02 juju-e4d256-prod-github-runner-207 kernel: [15976.597670] handle_exit+0x98/0x230 [kvm_amd] Aug 22 09:50:02 juju-e4d256-prod-github-runner-207 kernel: [15976.598561] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 09:50:02 juju-e4d256-prod-github-runner-207 kernel: [15976.599471] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 09:50:02 juju-e4d256-prod-github-runner-207 kernel: [15976.600390] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 09:50:02 juju-e4d256-prod-github-runner-207 kernel: [15976.601298] vcpu_run+0x62/0x2c0 [kvm] Aug 22 09:50:02 juju-e4d256-prod-github-runner-207 kernel: [15976.602105] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 09:50:02 juju-e4d256-prod-github-runner-207 kernel: [15976.602909] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 09:50:02 juju-e4d256-prod-github-runner-207 kernel: [15976.603760] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 09:50:02 juju-e4d256-prod-github-runner-207 kernel: [15976.604563] ? __seccomp_filter+0x4a/0x4a0 Aug 22 09:50:02 juju-e4d256-prod-github-runner-207 kernel: [15976.605303] ? __fget_files+0x86/0xc0 Aug 22 09:50:02 juju-e4d256-prod-github-runner-207 kernel: [15976.606121] __x64_sys_ioctl+0x95/0xd0 Aug 22 09:50:02 juju-e4d256-prod-github-runner-207 kernel: [15976.606809] do_syscall_64+0x5c/0xc0 Aug 22 09:50:02 juju-e4d256-prod-github-runner-207 kernel: [15976.607470] ? do_futex+0x162/0x1f0 Aug 22 09:50:02 juju-e4d256-prod-github-runner-207 kernel: [15976.608119] ? __x64_sys_futex+0x78/0x1e0 Aug 22 09:50:02 juju-e4d256-prod-github-runner-207 kernel: [15976.608795] ? __secure_computing+0xa9/0x120 Aug 22 09:50:02 juju-e4d256-prod-github-runner-207 kernel: [15976.609482] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 09:50:02 juju-e4d256-prod-github-runner-207 kernel: [15976.610239] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:50:02 juju-e4d256-prod-github-runner-207 kernel: [15976.610956] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:50:02 juju-e4d256-prod-github-runner-207 kernel: [15976.611669] ? do_syscall_64+0x69/0xc0 Aug 22 09:50:02 juju-e4d256-prod-github-runner-207 kernel: [15976.612315] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:50:02 juju-e4d256-prod-github-runner-207 kernel: [15976.613025] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:50:02 juju-e4d256-prod-github-runner-207 kernel: [15976.613719] ? do_syscall_64+0x69/0xc0 Aug 22 09:50:02 juju-e4d256-prod-github-runner-207 kernel: [15976.614342] ? do_syscall_64+0x69/0xc0 Aug 22 09:50:02 juju-e4d256-prod-github-runner-207 kernel: [15976.614961] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 09:50:02 juju-e4d256-prod-github-runner-207 kernel: [15976.615661] RIP: 0033:0x7faa5d0edaff Aug 22 09:50:02 juju-e4d256-prod-github-runner-207 kernel: [15976.616297] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 09:50:02 juju-e4d256-prod-github-runner-207 kernel: [15976.618300] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 09:50:02 juju-e4d256-prod-github-runner-207 kernel: [15976.619216] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 09:50:02 juju-e4d256-prod-github-runner-207 kernel: [15976.620104] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 09:50:02 juju-e4d256-prod-github-runner-207 kernel: [15976.620994] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 09:50:02 juju-e4d256-prod-github-runner-207 kernel: [15976.621883] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 09:50:02 juju-e4d256-prod-github-runner-207 kernel: [15976.622767] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 09:50:02 juju-e4d256-prod-github-runner-207 kernel: [15976.623659] Aug 22 09:50:30 juju-e4d256-prod-github-runner-207 kernel: [16004.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 14797s! [qemu-system-x86:6715] Aug 22 09:50:30 juju-e4d256-prod-github-runner-207 kernel: [16004.543318] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 09:50:30 juju-e4d256-prod-github-runner-207 kernel: [16004.543394] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 09:50:30 juju-e4d256-prod-github-runner-207 kernel: [16004.558087] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 09:50:30 juju-e4d256-prod-github-runner-207 kernel: [16004.559548] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 09:50:30 juju-e4d256-prod-github-runner-207 kernel: [16004.560977] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:50:30 juju-e4d256-prod-github-runner-207 kernel: [16004.562157] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 09:50:30 juju-e4d256-prod-github-runner-207 kernel: [16004.565222] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 09:50:30 juju-e4d256-prod-github-runner-207 kernel: [16004.566401] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 09:50:30 juju-e4d256-prod-github-runner-207 kernel: [16004.567710] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 09:50:30 juju-e4d256-prod-github-runner-207 kernel: [16004.569040] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 09:50:30 juju-e4d256-prod-github-runner-207 kernel: [16004.570351] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 09:50:30 juju-e4d256-prod-github-runner-207 kernel: [16004.571661] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 09:50:30 juju-e4d256-prod-github-runner-207 kernel: [16004.573004] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 09:50:30 juju-e4d256-prod-github-runner-207 kernel: [16004.574405] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 09:50:30 juju-e4d256-prod-github-runner-207 kernel: [16004.575613] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 09:50:30 juju-e4d256-prod-github-runner-207 kernel: [16004.576976] Call Trace: Aug 22 09:50:30 juju-e4d256-prod-github-runner-207 kernel: [16004.577943] Aug 22 09:50:30 juju-e4d256-prod-github-runner-207 kernel: [16004.578885] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:50:30 juju-e4d256-prod-github-runner-207 kernel: [16004.580017] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:50:30 juju-e4d256-prod-github-runner-207 kernel: [16004.581165] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:50:30 juju-e4d256-prod-github-runner-207 kernel: [16004.582345] ? show_regs.part.0+0x23/0x29 Aug 22 09:50:30 juju-e4d256-prod-github-runner-207 kernel: [16004.583431] ? show_regs.cold+0x8/0xd Aug 22 09:50:30 juju-e4d256-prod-github-runner-207 kernel: [16004.584501] ? watchdog_timer_fn+0x1be/0x220 Aug 22 09:50:30 juju-e4d256-prod-github-runner-207 kernel: [16004.585605] ? lockup_detector_update_enable+0x60/0x60 Aug 22 09:50:30 juju-e4d256-prod-github-runner-207 kernel: [16004.586782] ? __hrtimer_run_queues+0x107/0x230 Aug 22 09:50:30 juju-e4d256-prod-github-runner-207 kernel: [16004.587911] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 09:50:30 juju-e4d256-prod-github-runner-207 kernel: [16004.589058] ? hrtimer_interrupt+0x101/0x220 Aug 22 09:50:30 juju-e4d256-prod-github-runner-207 kernel: [16004.590173] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 09:50:30 juju-e4d256-prod-github-runner-207 kernel: [16004.591347] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 09:50:30 juju-e4d256-prod-github-runner-207 kernel: [16004.592529] Aug 22 09:50:30 juju-e4d256-prod-github-runner-207 kernel: [16004.593439] Aug 22 09:50:30 juju-e4d256-prod-github-runner-207 kernel: [16004.594325] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 09:50:30 juju-e4d256-prod-github-runner-207 kernel: [16004.595467] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:50:30 juju-e4d256-prod-github-runner-207 kernel: [16004.596795] ? _raw_spin_lock+0x22/0x30 Aug 22 09:50:30 juju-e4d256-prod-github-runner-207 kernel: [16004.597856] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:50:30 juju-e4d256-prod-github-runner-207 kernel: [16004.598979] direct_page_fault+0x206/0x310 [kvm] Aug 22 09:50:30 juju-e4d256-prod-github-runner-207 kernel: [16004.600107] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 09:50:30 juju-e4d256-prod-github-runner-207 kernel: [16004.601233] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 09:50:30 juju-e4d256-prod-github-runner-207 kernel: [16004.602336] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 09:50:30 juju-e4d256-prod-github-runner-207 kernel: [16004.603414] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 09:50:30 juju-e4d256-prod-github-runner-207 kernel: [16004.604482] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 09:50:30 juju-e4d256-prod-github-runner-207 kernel: [16004.605570] handle_exit+0x98/0x230 [kvm_amd] Aug 22 09:50:30 juju-e4d256-prod-github-runner-207 kernel: [16004.606563] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 09:50:30 juju-e4d256-prod-github-runner-207 kernel: [16004.607570] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 09:50:30 juju-e4d256-prod-github-runner-207 kernel: [16004.608711] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 09:50:30 juju-e4d256-prod-github-runner-207 kernel: [16004.609738] vcpu_run+0x62/0x2c0 [kvm] Aug 22 09:50:30 juju-e4d256-prod-github-runner-207 kernel: [16004.610640] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 09:50:30 juju-e4d256-prod-github-runner-207 kernel: [16004.611541] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 09:50:30 juju-e4d256-prod-github-runner-207 kernel: [16004.612518] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 09:50:30 juju-e4d256-prod-github-runner-207 kernel: [16004.613408] ? __seccomp_filter+0x4a/0x4a0 Aug 22 09:50:30 juju-e4d256-prod-github-runner-207 kernel: [16004.614241] ? __fget_files+0x86/0xc0 Aug 22 09:50:30 juju-e4d256-prod-github-runner-207 kernel: [16004.615023] __x64_sys_ioctl+0x95/0xd0 Aug 22 09:50:30 juju-e4d256-prod-github-runner-207 kernel: [16004.615798] do_syscall_64+0x5c/0xc0 Aug 22 09:50:30 juju-e4d256-prod-github-runner-207 kernel: [16004.616561] ? do_futex+0x162/0x1f0 Aug 22 09:50:30 juju-e4d256-prod-github-runner-207 kernel: [16004.617293] ? __x64_sys_futex+0x78/0x1e0 Aug 22 09:50:30 juju-e4d256-prod-github-runner-207 kernel: [16004.618054] ? __secure_computing+0xa9/0x120 Aug 22 09:50:30 juju-e4d256-prod-github-runner-207 kernel: [16004.618832] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 09:50:30 juju-e4d256-prod-github-runner-207 kernel: [16004.619701] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:50:30 juju-e4d256-prod-github-runner-207 kernel: [16004.620543] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:50:30 juju-e4d256-prod-github-runner-207 kernel: [16004.621363] ? do_syscall_64+0x69/0xc0 Aug 22 09:50:30 juju-e4d256-prod-github-runner-207 kernel: [16004.622092] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:50:30 juju-e4d256-prod-github-runner-207 kernel: [16004.622893] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:50:30 juju-e4d256-prod-github-runner-207 kernel: [16004.623686] ? do_syscall_64+0x69/0xc0 Aug 22 09:50:30 juju-e4d256-prod-github-runner-207 kernel: [16004.624408] ? do_syscall_64+0x69/0xc0 Aug 22 09:50:30 juju-e4d256-prod-github-runner-207 kernel: [16004.625108] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 09:50:30 juju-e4d256-prod-github-runner-207 kernel: [16004.625918] RIP: 0033:0x7faa5d0edaff Aug 22 09:50:30 juju-e4d256-prod-github-runner-207 kernel: [16004.626617] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 09:50:30 juju-e4d256-prod-github-runner-207 kernel: [16004.628967] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 09:50:30 juju-e4d256-prod-github-runner-207 kernel: [16004.630033] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 09:50:30 juju-e4d256-prod-github-runner-207 kernel: [16004.631066] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 09:50:30 juju-e4d256-prod-github-runner-207 kernel: [16004.632100] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 09:50:30 juju-e4d256-prod-github-runner-207 kernel: [16004.633148] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 09:50:30 juju-e4d256-prod-github-runner-207 kernel: [16004.634179] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 09:50:30 juju-e4d256-prod-github-runner-207 kernel: [16004.635217] Aug 22 09:50:44 juju-e4d256-prod-github-runner-207 kernel: [16018.256705] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 09:50:44 juju-e4d256-prod-github-runner-207 kernel: [16018.257681] rcu: 1-....: (3962814 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=1914573 Aug 22 09:50:44 juju-e4d256-prod-github-runner-207 kernel: [16018.258804] (t=3975264 jiffies g=23269 q=23089) Aug 22 09:50:44 juju-e4d256-prod-github-runner-207 kernel: [16018.259586] NMI backtrace for cpu 1 Aug 22 09:50:44 juju-e4d256-prod-github-runner-207 kernel: [16018.260305] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 09:50:44 juju-e4d256-prod-github-runner-207 kernel: [16018.261415] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 09:50:44 juju-e4d256-prod-github-runner-207 kernel: [16018.262481] Call Trace: Aug 22 09:50:44 juju-e4d256-prod-github-runner-207 kernel: [16018.263161] Aug 22 09:50:44 juju-e4d256-prod-github-runner-207 kernel: [16018.263856] show_stack+0x52/0x5c Aug 22 09:50:44 juju-e4d256-prod-github-runner-207 kernel: [16018.264641] dump_stack_lvl+0x4a/0x63 Aug 22 09:50:44 juju-e4d256-prod-github-runner-207 kernel: [16018.265391] dump_stack+0x10/0x16 Aug 22 09:50:44 juju-e4d256-prod-github-runner-207 kernel: [16018.266106] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 09:50:44 juju-e4d256-prod-github-runner-207 kernel: [16018.266913] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 09:50:44 juju-e4d256-prod-github-runner-207 kernel: [16018.267700] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 09:50:44 juju-e4d256-prod-github-runner-207 kernel: [16018.268538] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 09:50:44 juju-e4d256-prod-github-runner-207 kernel: [16018.269360] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 09:50:44 juju-e4d256-prod-github-runner-207 kernel: [16018.270170] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 09:50:44 juju-e4d256-prod-github-runner-207 kernel: [16018.270946] print_cpu_stall.cold+0x2f/0xe2 Aug 22 09:50:44 juju-e4d256-prod-github-runner-207 kernel: [16018.271714] ? timekeeping_update+0xf7/0x150 Aug 22 09:50:44 juju-e4d256-prod-github-runner-207 kernel: [16018.272492] check_cpu_stall+0x109/0x270 Aug 22 09:50:44 juju-e4d256-prod-github-runner-207 kernel: [16018.273248] rcu_sched_clock_irq+0x9a/0x250 Aug 22 09:50:44 juju-e4d256-prod-github-runner-207 kernel: [16018.274015] update_process_times+0x94/0xd0 Aug 22 09:50:44 juju-e4d256-prod-github-runner-207 kernel: [16018.274781] tick_sched_handle+0x29/0x70 Aug 22 09:50:44 juju-e4d256-prod-github-runner-207 kernel: [16018.275526] tick_sched_timer+0x8c/0xc0 Aug 22 09:50:44 juju-e4d256-prod-github-runner-207 kernel: [16018.276281] ? tick_nohz_handler+0xb0/0xb0 Aug 22 09:50:44 juju-e4d256-prod-github-runner-207 kernel: [16018.277040] __hrtimer_run_queues+0x107/0x230 Aug 22 09:50:44 juju-e4d256-prod-github-runner-207 kernel: [16018.277818] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 09:50:44 juju-e4d256-prod-github-runner-207 kernel: [16018.278602] hrtimer_interrupt+0x101/0x220 Aug 22 09:50:44 juju-e4d256-prod-github-runner-207 kernel: [16018.279360] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 09:50:44 juju-e4d256-prod-github-runner-207 kernel: [16018.280189] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 09:50:44 juju-e4d256-prod-github-runner-207 kernel: [16018.280997] Aug 22 09:50:44 juju-e4d256-prod-github-runner-207 kernel: [16018.281631] Aug 22 09:50:44 juju-e4d256-prod-github-runner-207 kernel: [16018.282264] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 09:50:44 juju-e4d256-prod-github-runner-207 kernel: [16018.283094] RIP: 0010:native_queued_spin_lock_slowpath+0xc/0x40 Aug 22 09:50:44 juju-e4d256-prod-github-runner-207 kernel: [16018.283976] Code: fe ff ff eb af 4c 89 fe 48 c7 c7 20 99 e9 89 e8 ca 69 55 00 e9 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 <8b> 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 eb Aug 22 09:50:44 juju-e4d256-prod-github-runner-207 kernel: [16018.286209] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 09:50:44 juju-e4d256-prod-github-runner-207 kernel: [16018.287084] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 09:50:44 juju-e4d256-prod-github-runner-207 kernel: [16018.288124] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 09:50:44 juju-e4d256-prod-github-runner-207 kernel: [16018.289143] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 09:50:44 juju-e4d256-prod-github-runner-207 kernel: [16018.290105] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 09:50:44 juju-e4d256-prod-github-runner-207 kernel: [16018.291063] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 09:50:44 juju-e4d256-prod-github-runner-207 kernel: [16018.292033] ? _raw_spin_lock+0x22/0x30 Aug 22 09:50:44 juju-e4d256-prod-github-runner-207 kernel: [16018.292801] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:50:44 juju-e4d256-prod-github-runner-207 kernel: [16018.293649] direct_page_fault+0x206/0x310 [kvm] Aug 22 09:50:44 juju-e4d256-prod-github-runner-207 kernel: [16018.294493] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 09:50:44 juju-e4d256-prod-github-runner-207 kernel: [16018.295322] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 09:50:44 juju-e4d256-prod-github-runner-207 kernel: [16018.296166] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 09:50:44 juju-e4d256-prod-github-runner-207 kernel: [16018.296978] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 09:50:44 juju-e4d256-prod-github-runner-207 kernel: [16018.297771] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 09:50:44 juju-e4d256-prod-github-runner-207 kernel: [16018.298604] handle_exit+0x98/0x230 [kvm_amd] Aug 22 09:50:44 juju-e4d256-prod-github-runner-207 kernel: [16018.299359] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 09:50:44 juju-e4d256-prod-github-runner-207 kernel: [16018.300153] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 09:50:44 juju-e4d256-prod-github-runner-207 kernel: [16018.300960] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 09:50:44 juju-e4d256-prod-github-runner-207 kernel: [16018.301747] vcpu_run+0x62/0x2c0 [kvm] Aug 22 09:50:44 juju-e4d256-prod-github-runner-207 kernel: [16018.302463] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 09:50:44 juju-e4d256-prod-github-runner-207 kernel: [16018.303202] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 09:50:44 juju-e4d256-prod-github-runner-207 kernel: [16018.304025] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 09:50:44 juju-e4d256-prod-github-runner-207 kernel: [16018.304796] ? __seccomp_filter+0x4a/0x4a0 Aug 22 09:50:44 juju-e4d256-prod-github-runner-207 kernel: [16018.305519] ? __fget_files+0x86/0xc0 Aug 22 09:50:44 juju-e4d256-prod-github-runner-207 kernel: [16018.306218] __x64_sys_ioctl+0x95/0xd0 Aug 22 09:50:44 juju-e4d256-prod-github-runner-207 kernel: [16018.306921] do_syscall_64+0x5c/0xc0 Aug 22 09:50:44 juju-e4d256-prod-github-runner-207 kernel: [16018.307609] ? do_futex+0x162/0x1f0 Aug 22 09:50:44 juju-e4d256-prod-github-runner-207 kernel: [16018.308293] ? __x64_sys_futex+0x78/0x1e0 Aug 22 09:50:44 juju-e4d256-prod-github-runner-207 kernel: [16018.309007] ? __secure_computing+0xa9/0x120 Aug 22 09:50:44 juju-e4d256-prod-github-runner-207 kernel: [16018.309732] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 09:50:44 juju-e4d256-prod-github-runner-207 kernel: [16018.310525] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:50:44 juju-e4d256-prod-github-runner-207 kernel: [16018.311282] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:50:44 juju-e4d256-prod-github-runner-207 kernel: [16018.312061] ? do_syscall_64+0x69/0xc0 Aug 22 09:50:44 juju-e4d256-prod-github-runner-207 kernel: [16018.312916] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:50:44 juju-e4d256-prod-github-runner-207 kernel: [16018.313681] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:50:44 juju-e4d256-prod-github-runner-207 kernel: [16018.314444] ? do_syscall_64+0x69/0xc0 Aug 22 09:50:44 juju-e4d256-prod-github-runner-207 kernel: [16018.315145] ? do_syscall_64+0x69/0xc0 Aug 22 09:50:44 juju-e4d256-prod-github-runner-207 kernel: [16018.315837] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 09:50:44 juju-e4d256-prod-github-runner-207 kernel: [16018.316625] RIP: 0033:0x7faa5d0edaff Aug 22 09:50:44 juju-e4d256-prod-github-runner-207 kernel: [16018.317311] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 09:50:44 juju-e4d256-prod-github-runner-207 kernel: [16018.319444] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 09:50:44 juju-e4d256-prod-github-runner-207 kernel: [16018.320427] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 09:50:44 juju-e4d256-prod-github-runner-207 kernel: [16018.321384] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 09:50:44 juju-e4d256-prod-github-runner-207 kernel: [16018.322338] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 09:50:44 juju-e4d256-prod-github-runner-207 kernel: [16018.323288] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 09:50:44 juju-e4d256-prod-github-runner-207 kernel: [16018.324247] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 09:50:44 juju-e4d256-prod-github-runner-207 kernel: [16018.325174] Aug 22 09:51:10 juju-e4d256-prod-github-runner-207 kernel: [16044.541981] watchdog: BUG: soft lockup - CPU#1 stuck for 14834s! [qemu-system-x86:6715] Aug 22 09:51:10 juju-e4d256-prod-github-runner-207 kernel: [16044.543785] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 09:51:10 juju-e4d256-prod-github-runner-207 kernel: [16044.544050] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 09:51:10 juju-e4d256-prod-github-runner-207 kernel: [16044.556233] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 09:51:10 juju-e4d256-prod-github-runner-207 kernel: [16044.557508] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 09:51:10 juju-e4d256-prod-github-runner-207 kernel: [16044.558782] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:51:10 juju-e4d256-prod-github-runner-207 kernel: [16044.559870] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 09:51:10 juju-e4d256-prod-github-runner-207 kernel: [16044.562444] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 09:51:10 juju-e4d256-prod-github-runner-207 kernel: [16044.563494] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 09:51:10 juju-e4d256-prod-github-runner-207 kernel: [16044.564682] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 09:51:10 juju-e4d256-prod-github-runner-207 kernel: [16044.565869] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 09:51:10 juju-e4d256-prod-github-runner-207 kernel: [16044.567035] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 09:51:10 juju-e4d256-prod-github-runner-207 kernel: [16044.568220] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 09:51:10 juju-e4d256-prod-github-runner-207 kernel: [16044.569406] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 09:51:10 juju-e4d256-prod-github-runner-207 kernel: [16044.570661] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 09:51:10 juju-e4d256-prod-github-runner-207 kernel: [16044.571938] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 09:51:10 juju-e4d256-prod-github-runner-207 kernel: [16044.573176] Call Trace: Aug 22 09:51:10 juju-e4d256-prod-github-runner-207 kernel: [16044.574124] Aug 22 09:51:10 juju-e4d256-prod-github-runner-207 kernel: [16044.575037] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:51:10 juju-e4d256-prod-github-runner-207 kernel: [16044.576097] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:51:10 juju-e4d256-prod-github-runner-207 kernel: [16044.577121] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:51:10 juju-e4d256-prod-github-runner-207 kernel: [16044.578221] ? show_regs.part.0+0x23/0x29 Aug 22 09:51:10 juju-e4d256-prod-github-runner-207 kernel: [16044.579221] ? show_regs.cold+0x8/0xd Aug 22 09:51:10 juju-e4d256-prod-github-runner-207 kernel: [16044.580335] ? watchdog_timer_fn+0x1be/0x220 Aug 22 09:51:10 juju-e4d256-prod-github-runner-207 kernel: [16044.581520] ? lockup_detector_update_enable+0x60/0x60 Aug 22 09:51:10 juju-e4d256-prod-github-runner-207 kernel: [16044.582598] ? __hrtimer_run_queues+0x107/0x230 Aug 22 09:51:10 juju-e4d256-prod-github-runner-207 kernel: [16044.583652] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 09:51:10 juju-e4d256-prod-github-runner-207 kernel: [16044.584691] ? hrtimer_interrupt+0x101/0x220 Aug 22 09:51:10 juju-e4d256-prod-github-runner-207 kernel: [16044.585707] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 09:51:10 juju-e4d256-prod-github-runner-207 kernel: [16044.586798] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 09:51:10 juju-e4d256-prod-github-runner-207 kernel: [16044.587864] Aug 22 09:51:10 juju-e4d256-prod-github-runner-207 kernel: [16044.588720] Aug 22 09:51:10 juju-e4d256-prod-github-runner-207 kernel: [16044.589558] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 09:51:10 juju-e4d256-prod-github-runner-207 kernel: [16044.590596] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:51:10 juju-e4d256-prod-github-runner-207 kernel: [16044.591634] ? _raw_spin_lock+0x22/0x30 Aug 22 09:51:10 juju-e4d256-prod-github-runner-207 kernel: [16044.592595] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:51:10 juju-e4d256-prod-github-runner-207 kernel: [16044.593634] direct_page_fault+0x206/0x310 [kvm] Aug 22 09:51:10 juju-e4d256-prod-github-runner-207 kernel: [16044.594685] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 09:51:10 juju-e4d256-prod-github-runner-207 kernel: [16044.595717] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 09:51:10 juju-e4d256-prod-github-runner-207 kernel: [16044.596721] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 09:51:10 juju-e4d256-prod-github-runner-207 kernel: [16044.597724] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 09:51:10 juju-e4d256-prod-github-runner-207 kernel: [16044.598675] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 09:51:10 juju-e4d256-prod-github-runner-207 kernel: [16044.599657] handle_exit+0x98/0x230 [kvm_amd] Aug 22 09:51:10 juju-e4d256-prod-github-runner-207 kernel: [16044.600560] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 09:51:10 juju-e4d256-prod-github-runner-207 kernel: [16044.601477] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 09:51:10 juju-e4d256-prod-github-runner-207 kernel: [16044.602421] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 09:51:10 juju-e4d256-prod-github-runner-207 kernel: [16044.603349] vcpu_run+0x62/0x2c0 [kvm] Aug 22 09:51:10 juju-e4d256-prod-github-runner-207 kernel: [16044.604188] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 09:51:10 juju-e4d256-prod-github-runner-207 kernel: [16044.605001] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 09:51:10 juju-e4d256-prod-github-runner-207 kernel: [16044.605866] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 09:51:10 juju-e4d256-prod-github-runner-207 kernel: [16044.606674] ? __seccomp_filter+0x4a/0x4a0 Aug 22 09:51:10 juju-e4d256-prod-github-runner-207 kernel: [16044.607417] ? __fget_files+0x86/0xc0 Aug 22 09:51:10 juju-e4d256-prod-github-runner-207 kernel: [16044.608140] __x64_sys_ioctl+0x95/0xd0 Aug 22 09:51:10 juju-e4d256-prod-github-runner-207 kernel: [16044.608835] do_syscall_64+0x5c/0xc0 Aug 22 09:51:10 juju-e4d256-prod-github-runner-207 kernel: [16044.609502] ? do_futex+0x162/0x1f0 Aug 22 09:51:10 juju-e4d256-prod-github-runner-207 kernel: [16044.610172] ? __x64_sys_futex+0x78/0x1e0 Aug 22 09:51:10 juju-e4d256-prod-github-runner-207 kernel: [16044.610851] ? __secure_computing+0xa9/0x120 Aug 22 09:51:10 juju-e4d256-prod-github-runner-207 kernel: [16044.611540] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 09:51:10 juju-e4d256-prod-github-runner-207 kernel: [16044.612320] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:51:10 juju-e4d256-prod-github-runner-207 kernel: [16044.613047] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:51:10 juju-e4d256-prod-github-runner-207 kernel: [16044.613782] ? do_syscall_64+0x69/0xc0 Aug 22 09:51:10 juju-e4d256-prod-github-runner-207 kernel: [16044.614442] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:51:10 juju-e4d256-prod-github-runner-207 kernel: [16044.615149] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:51:10 juju-e4d256-prod-github-runner-207 kernel: [16044.615856] ? do_syscall_64+0x69/0xc0 Aug 22 09:51:10 juju-e4d256-prod-github-runner-207 kernel: [16044.616482] ? do_syscall_64+0x69/0xc0 Aug 22 09:51:10 juju-e4d256-prod-github-runner-207 kernel: [16044.617110] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 09:51:10 juju-e4d256-prod-github-runner-207 kernel: [16044.617824] RIP: 0033:0x7faa5d0edaff Aug 22 09:51:10 juju-e4d256-prod-github-runner-207 kernel: [16044.618476] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 09:51:10 juju-e4d256-prod-github-runner-207 kernel: [16044.620477] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 09:51:10 juju-e4d256-prod-github-runner-207 kernel: [16044.621399] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 09:51:10 juju-e4d256-prod-github-runner-207 kernel: [16044.622314] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 09:51:10 juju-e4d256-prod-github-runner-207 kernel: [16044.623206] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 09:51:10 juju-e4d256-prod-github-runner-207 kernel: [16044.624135] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 09:51:10 juju-e4d256-prod-github-runner-207 kernel: [16044.625033] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 09:51:10 juju-e4d256-prod-github-runner-207 kernel: [16044.625942] Aug 22 09:51:38 juju-e4d256-prod-github-runner-207 kernel: [16072.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 14860s! [qemu-system-x86:6715] Aug 22 09:51:38 juju-e4d256-prod-github-runner-207 kernel: [16072.543101] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 09:51:38 juju-e4d256-prod-github-runner-207 kernel: [16072.543170] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 09:51:38 juju-e4d256-prod-github-runner-207 kernel: [16072.555210] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 09:51:38 juju-e4d256-prod-github-runner-207 kernel: [16072.556489] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 09:51:38 juju-e4d256-prod-github-runner-207 kernel: [16072.557713] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:51:38 juju-e4d256-prod-github-runner-207 kernel: [16072.558774] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 09:51:38 juju-e4d256-prod-github-runner-207 kernel: [16072.561354] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 09:51:38 juju-e4d256-prod-github-runner-207 kernel: [16072.562398] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 09:51:38 juju-e4d256-prod-github-runner-207 kernel: [16072.563575] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 09:51:38 juju-e4d256-prod-github-runner-207 kernel: [16072.564735] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 09:51:38 juju-e4d256-prod-github-runner-207 kernel: [16072.565901] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 09:51:38 juju-e4d256-prod-github-runner-207 kernel: [16072.567072] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 09:51:38 juju-e4d256-prod-github-runner-207 kernel: [16072.568242] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 09:51:38 juju-e4d256-prod-github-runner-207 kernel: [16072.569471] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 09:51:38 juju-e4d256-prod-github-runner-207 kernel: [16072.570569] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 09:51:38 juju-e4d256-prod-github-runner-207 kernel: [16072.571775] Call Trace: Aug 22 09:51:38 juju-e4d256-prod-github-runner-207 kernel: [16072.572686] Aug 22 09:51:38 juju-e4d256-prod-github-runner-207 kernel: [16072.573569] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:51:38 juju-e4d256-prod-github-runner-207 kernel: [16072.574597] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:51:38 juju-e4d256-prod-github-runner-207 kernel: [16072.575623] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:51:38 juju-e4d256-prod-github-runner-207 kernel: [16072.576699] ? show_regs.part.0+0x23/0x29 Aug 22 09:51:38 juju-e4d256-prod-github-runner-207 kernel: [16072.577696] ? show_regs.cold+0x8/0xd Aug 22 09:51:38 juju-e4d256-prod-github-runner-207 kernel: [16072.578664] ? watchdog_timer_fn+0x1be/0x220 Aug 22 09:51:38 juju-e4d256-prod-github-runner-207 kernel: [16072.579677] ? lockup_detector_update_enable+0x60/0x60 Aug 22 09:51:38 juju-e4d256-prod-github-runner-207 kernel: [16072.580743] ? __hrtimer_run_queues+0x107/0x230 Aug 22 09:51:38 juju-e4d256-prod-github-runner-207 kernel: [16072.581767] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 09:51:38 juju-e4d256-prod-github-runner-207 kernel: [16072.582787] ? hrtimer_interrupt+0x101/0x220 Aug 22 09:51:38 juju-e4d256-prod-github-runner-207 kernel: [16072.583817] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 09:51:38 juju-e4d256-prod-github-runner-207 kernel: [16072.584892] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 09:51:38 juju-e4d256-prod-github-runner-207 kernel: [16072.585933] Aug 22 09:51:38 juju-e4d256-prod-github-runner-207 kernel: [16072.586788] Aug 22 09:51:38 juju-e4d256-prod-github-runner-207 kernel: [16072.587652] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 09:51:38 juju-e4d256-prod-github-runner-207 kernel: [16072.588696] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:51:38 juju-e4d256-prod-github-runner-207 kernel: [16072.589737] ? _raw_spin_lock+0x22/0x30 Aug 22 09:51:38 juju-e4d256-prod-github-runner-207 kernel: [16072.590705] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:51:38 juju-e4d256-prod-github-runner-207 kernel: [16072.591732] direct_page_fault+0x206/0x310 [kvm] Aug 22 09:51:38 juju-e4d256-prod-github-runner-207 kernel: [16072.592754] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 09:51:38 juju-e4d256-prod-github-runner-207 kernel: [16072.593763] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 09:51:38 juju-e4d256-prod-github-runner-207 kernel: [16072.594765] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 09:51:38 juju-e4d256-prod-github-runner-207 kernel: [16072.595743] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 09:51:38 juju-e4d256-prod-github-runner-207 kernel: [16072.596684] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 09:51:38 juju-e4d256-prod-github-runner-207 kernel: [16072.597664] handle_exit+0x98/0x230 [kvm_amd] Aug 22 09:51:38 juju-e4d256-prod-github-runner-207 kernel: [16072.598558] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 09:51:38 juju-e4d256-prod-github-runner-207 kernel: [16072.599484] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 09:51:38 juju-e4d256-prod-github-runner-207 kernel: [16072.600406] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 09:51:38 juju-e4d256-prod-github-runner-207 kernel: [16072.601306] vcpu_run+0x62/0x2c0 [kvm] Aug 22 09:51:38 juju-e4d256-prod-github-runner-207 kernel: [16072.602118] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 09:51:38 juju-e4d256-prod-github-runner-207 kernel: [16072.602922] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 09:51:38 juju-e4d256-prod-github-runner-207 kernel: [16072.603785] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 09:51:38 juju-e4d256-prod-github-runner-207 kernel: [16072.604586] ? __seccomp_filter+0x4a/0x4a0 Aug 22 09:51:38 juju-e4d256-prod-github-runner-207 kernel: [16072.605331] ? __fget_files+0x86/0xc0 Aug 22 09:51:38 juju-e4d256-prod-github-runner-207 kernel: [16072.606033] __x64_sys_ioctl+0x95/0xd0 Aug 22 09:51:38 juju-e4d256-prod-github-runner-207 kernel: [16072.606723] do_syscall_64+0x5c/0xc0 Aug 22 09:51:38 juju-e4d256-prod-github-runner-207 kernel: [16072.607391] ? do_futex+0x162/0x1f0 Aug 22 09:51:38 juju-e4d256-prod-github-runner-207 kernel: [16072.608037] ? __x64_sys_futex+0x78/0x1e0 Aug 22 09:51:38 juju-e4d256-prod-github-runner-207 kernel: [16072.608708] ? __secure_computing+0xa9/0x120 Aug 22 09:51:38 juju-e4d256-prod-github-runner-207 kernel: [16072.609397] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 09:51:38 juju-e4d256-prod-github-runner-207 kernel: [16072.610154] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:51:38 juju-e4d256-prod-github-runner-207 kernel: [16072.610874] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:51:38 juju-e4d256-prod-github-runner-207 kernel: [16072.611593] ? do_syscall_64+0x69/0xc0 Aug 22 09:51:38 juju-e4d256-prod-github-runner-207 kernel: [16072.612242] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:51:38 juju-e4d256-prod-github-runner-207 kernel: [16072.612942] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:51:38 juju-e4d256-prod-github-runner-207 kernel: [16072.613633] ? do_syscall_64+0x69/0xc0 Aug 22 09:51:38 juju-e4d256-prod-github-runner-207 kernel: [16072.614259] ? do_syscall_64+0x69/0xc0 Aug 22 09:51:38 juju-e4d256-prod-github-runner-207 kernel: [16072.614879] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 09:51:38 juju-e4d256-prod-github-runner-207 kernel: [16072.615591] RIP: 0033:0x7faa5d0edaff Aug 22 09:51:38 juju-e4d256-prod-github-runner-207 kernel: [16072.616213] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 09:51:38 juju-e4d256-prod-github-runner-207 kernel: [16072.618195] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 09:51:38 juju-e4d256-prod-github-runner-207 kernel: [16072.619103] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 09:51:38 juju-e4d256-prod-github-runner-207 kernel: [16072.620014] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 09:51:38 juju-e4d256-prod-github-runner-207 kernel: [16072.620918] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 09:51:38 juju-e4d256-prod-github-runner-207 kernel: [16072.621810] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 09:51:38 juju-e4d256-prod-github-runner-207 kernel: [16072.622693] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 09:51:38 juju-e4d256-prod-github-runner-207 kernel: [16072.623593] Aug 22 09:52:06 juju-e4d256-prod-github-runner-207 kernel: [16100.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 14886s! [qemu-system-x86:6715] Aug 22 09:52:06 juju-e4d256-prod-github-runner-207 kernel: [16100.543106] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 09:52:06 juju-e4d256-prod-github-runner-207 kernel: [16100.543176] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 09:52:06 juju-e4d256-prod-github-runner-207 kernel: [16100.555222] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 09:52:06 juju-e4d256-prod-github-runner-207 kernel: [16100.556484] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 09:52:06 juju-e4d256-prod-github-runner-207 kernel: [16100.557696] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:52:06 juju-e4d256-prod-github-runner-207 kernel: [16100.558753] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 09:52:06 juju-e4d256-prod-github-runner-207 kernel: [16100.561301] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 09:52:06 juju-e4d256-prod-github-runner-207 kernel: [16100.562347] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 09:52:06 juju-e4d256-prod-github-runner-207 kernel: [16100.563515] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 09:52:06 juju-e4d256-prod-github-runner-207 kernel: [16100.564672] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 09:52:06 juju-e4d256-prod-github-runner-207 kernel: [16100.565827] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 09:52:06 juju-e4d256-prod-github-runner-207 kernel: [16100.567047] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 09:52:06 juju-e4d256-prod-github-runner-207 kernel: [16100.568263] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 09:52:06 juju-e4d256-prod-github-runner-207 kernel: [16100.569494] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 09:52:06 juju-e4d256-prod-github-runner-207 kernel: [16100.570585] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 09:52:06 juju-e4d256-prod-github-runner-207 kernel: [16100.571792] Call Trace: Aug 22 09:52:06 juju-e4d256-prod-github-runner-207 kernel: [16100.572701] Aug 22 09:52:06 juju-e4d256-prod-github-runner-207 kernel: [16100.573583] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:52:06 juju-e4d256-prod-github-runner-207 kernel: [16100.574616] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:52:06 juju-e4d256-prod-github-runner-207 kernel: [16100.575647] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:52:06 juju-e4d256-prod-github-runner-207 kernel: [16100.576718] ? show_regs.part.0+0x23/0x29 Aug 22 09:52:06 juju-e4d256-prod-github-runner-207 kernel: [16100.577713] ? show_regs.cold+0x8/0xd Aug 22 09:52:06 juju-e4d256-prod-github-runner-207 kernel: [16100.578680] ? watchdog_timer_fn+0x1be/0x220 Aug 22 09:52:06 juju-e4d256-prod-github-runner-207 kernel: [16100.579701] ? lockup_detector_update_enable+0x60/0x60 Aug 22 09:52:06 juju-e4d256-prod-github-runner-207 kernel: [16100.580763] ? __hrtimer_run_queues+0x107/0x230 Aug 22 09:52:06 juju-e4d256-prod-github-runner-207 kernel: [16100.581807] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 09:52:06 juju-e4d256-prod-github-runner-207 kernel: [16100.582840] ? hrtimer_interrupt+0x101/0x220 Aug 22 09:52:06 juju-e4d256-prod-github-runner-207 kernel: [16100.583880] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 09:52:06 juju-e4d256-prod-github-runner-207 kernel: [16100.585013] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 09:52:06 juju-e4d256-prod-github-runner-207 kernel: [16100.586097] Aug 22 09:52:06 juju-e4d256-prod-github-runner-207 kernel: [16100.586950] Aug 22 09:52:06 juju-e4d256-prod-github-runner-207 kernel: [16100.587810] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 09:52:06 juju-e4d256-prod-github-runner-207 kernel: [16100.588842] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:52:06 juju-e4d256-prod-github-runner-207 kernel: [16100.589880] ? _raw_spin_lock+0x22/0x30 Aug 22 09:52:06 juju-e4d256-prod-github-runner-207 kernel: [16100.590831] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:52:06 juju-e4d256-prod-github-runner-207 kernel: [16100.591861] direct_page_fault+0x206/0x310 [kvm] Aug 22 09:52:06 juju-e4d256-prod-github-runner-207 kernel: [16100.592885] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 09:52:06 juju-e4d256-prod-github-runner-207 kernel: [16100.593907] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 09:52:06 juju-e4d256-prod-github-runner-207 kernel: [16100.594915] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 09:52:06 juju-e4d256-prod-github-runner-207 kernel: [16100.595951] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 09:52:06 juju-e4d256-prod-github-runner-207 kernel: [16100.596933] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 09:52:06 juju-e4d256-prod-github-runner-207 kernel: [16100.598125] handle_exit+0x98/0x230 [kvm_amd] Aug 22 09:52:06 juju-e4d256-prod-github-runner-207 kernel: [16100.599083] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 09:52:06 juju-e4d256-prod-github-runner-207 kernel: [16100.600034] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 09:52:06 juju-e4d256-prod-github-runner-207 kernel: [16100.600963] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 09:52:06 juju-e4d256-prod-github-runner-207 kernel: [16100.601874] vcpu_run+0x62/0x2c0 [kvm] Aug 22 09:52:06 juju-e4d256-prod-github-runner-207 kernel: [16100.602697] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 09:52:06 juju-e4d256-prod-github-runner-207 kernel: [16100.603536] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 09:52:06 juju-e4d256-prod-github-runner-207 kernel: [16100.604431] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 09:52:06 juju-e4d256-prod-github-runner-207 kernel: [16100.605375] ? __seccomp_filter+0x4a/0x4a0 Aug 22 09:52:06 juju-e4d256-prod-github-runner-207 kernel: [16100.606171] ? __fget_files+0x86/0xc0 Aug 22 09:52:06 juju-e4d256-prod-github-runner-207 kernel: [16100.606882] __x64_sys_ioctl+0x95/0xd0 Aug 22 09:52:06 juju-e4d256-prod-github-runner-207 kernel: [16100.607590] do_syscall_64+0x5c/0xc0 Aug 22 09:52:06 juju-e4d256-prod-github-runner-207 kernel: [16100.608254] ? do_futex+0x162/0x1f0 Aug 22 09:52:06 juju-e4d256-prod-github-runner-207 kernel: [16100.608900] ? __x64_sys_futex+0x78/0x1e0 Aug 22 09:52:06 juju-e4d256-prod-github-runner-207 kernel: [16100.609576] ? __secure_computing+0xa9/0x120 Aug 22 09:52:06 juju-e4d256-prod-github-runner-207 kernel: [16100.610264] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 09:52:06 juju-e4d256-prod-github-runner-207 kernel: [16100.611038] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:52:06 juju-e4d256-prod-github-runner-207 kernel: [16100.611762] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:52:06 juju-e4d256-prod-github-runner-207 kernel: [16100.612478] ? do_syscall_64+0x69/0xc0 Aug 22 09:52:06 juju-e4d256-prod-github-runner-207 kernel: [16100.613121] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:52:06 juju-e4d256-prod-github-runner-207 kernel: [16100.613822] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:52:06 juju-e4d256-prod-github-runner-207 kernel: [16100.614515] ? do_syscall_64+0x69/0xc0 Aug 22 09:52:06 juju-e4d256-prod-github-runner-207 kernel: [16100.615150] ? do_syscall_64+0x69/0xc0 Aug 22 09:52:06 juju-e4d256-prod-github-runner-207 kernel: [16100.615773] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 09:52:06 juju-e4d256-prod-github-runner-207 kernel: [16100.616481] RIP: 0033:0x7faa5d0edaff Aug 22 09:52:06 juju-e4d256-prod-github-runner-207 kernel: [16100.617103] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 09:52:06 juju-e4d256-prod-github-runner-207 kernel: [16100.619091] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 09:52:06 juju-e4d256-prod-github-runner-207 kernel: [16100.619999] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 09:52:06 juju-e4d256-prod-github-runner-207 kernel: [16100.620885] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 09:52:06 juju-e4d256-prod-github-runner-207 kernel: [16100.621784] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 09:52:06 juju-e4d256-prod-github-runner-207 kernel: [16100.622670] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 09:52:06 juju-e4d256-prod-github-runner-207 kernel: [16100.623580] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 09:52:06 juju-e4d256-prod-github-runner-207 kernel: [16100.624474] Aug 22 09:52:34 juju-e4d256-prod-github-runner-207 kernel: [16128.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 14912s! [qemu-system-x86:6715] Aug 22 09:52:34 juju-e4d256-prod-github-runner-207 kernel: [16128.543200] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 09:52:34 juju-e4d256-prod-github-runner-207 kernel: [16128.543345] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 09:52:34 juju-e4d256-prod-github-runner-207 kernel: [16128.555399] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 09:52:34 juju-e4d256-prod-github-runner-207 kernel: [16128.556667] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 09:52:34 juju-e4d256-prod-github-runner-207 kernel: [16128.557885] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:52:34 juju-e4d256-prod-github-runner-207 kernel: [16128.558950] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 09:52:34 juju-e4d256-prod-github-runner-207 kernel: [16128.561715] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 09:52:34 juju-e4d256-prod-github-runner-207 kernel: [16128.563397] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 09:52:34 juju-e4d256-prod-github-runner-207 kernel: [16128.564990] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 09:52:34 juju-e4d256-prod-github-runner-207 kernel: [16128.566615] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 09:52:34 juju-e4d256-prod-github-runner-207 kernel: [16128.568194] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 09:52:34 juju-e4d256-prod-github-runner-207 kernel: [16128.569558] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 09:52:34 juju-e4d256-prod-github-runner-207 kernel: [16128.570749] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 09:52:34 juju-e4d256-prod-github-runner-207 kernel: [16128.571993] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 09:52:34 juju-e4d256-prod-github-runner-207 kernel: [16128.573095] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 09:52:34 juju-e4d256-prod-github-runner-207 kernel: [16128.574289] Call Trace: Aug 22 09:52:34 juju-e4d256-prod-github-runner-207 kernel: [16128.575212] Aug 22 09:52:34 juju-e4d256-prod-github-runner-207 kernel: [16128.576113] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:52:34 juju-e4d256-prod-github-runner-207 kernel: [16128.577145] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:52:34 juju-e4d256-prod-github-runner-207 kernel: [16128.578170] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:52:34 juju-e4d256-prod-github-runner-207 kernel: [16128.579281] ? show_regs.part.0+0x23/0x29 Aug 22 09:52:34 juju-e4d256-prod-github-runner-207 kernel: [16128.580279] ? show_regs.cold+0x8/0xd Aug 22 09:52:34 juju-e4d256-prod-github-runner-207 kernel: [16128.581254] ? watchdog_timer_fn+0x1be/0x220 Aug 22 09:52:34 juju-e4d256-prod-github-runner-207 kernel: [16128.582261] ? lockup_detector_update_enable+0x60/0x60 Aug 22 09:52:34 juju-e4d256-prod-github-runner-207 kernel: [16128.583330] ? __hrtimer_run_queues+0x107/0x230 Aug 22 09:52:34 juju-e4d256-prod-github-runner-207 kernel: [16128.584359] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 09:52:34 juju-e4d256-prod-github-runner-207 kernel: [16128.585383] ? hrtimer_interrupt+0x101/0x220 Aug 22 09:52:34 juju-e4d256-prod-github-runner-207 kernel: [16128.586399] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 09:52:34 juju-e4d256-prod-github-runner-207 kernel: [16128.587476] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 09:52:34 juju-e4d256-prod-github-runner-207 kernel: [16128.588688] Aug 22 09:52:34 juju-e4d256-prod-github-runner-207 kernel: [16128.589607] Aug 22 09:52:34 juju-e4d256-prod-github-runner-207 kernel: [16128.590498] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 09:52:34 juju-e4d256-prod-github-runner-207 kernel: [16128.591668] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:52:34 juju-e4d256-prod-github-runner-207 kernel: [16128.592829] ? _raw_spin_lock+0x22/0x30 Aug 22 09:52:34 juju-e4d256-prod-github-runner-207 kernel: [16128.593864] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:52:34 juju-e4d256-prod-github-runner-207 kernel: [16128.595006] direct_page_fault+0x206/0x310 [kvm] Aug 22 09:52:34 juju-e4d256-prod-github-runner-207 kernel: [16128.596127] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 09:52:34 juju-e4d256-prod-github-runner-207 kernel: [16128.597240] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 09:52:34 juju-e4d256-prod-github-runner-207 kernel: [16128.598335] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 09:52:34 juju-e4d256-prod-github-runner-207 kernel: [16128.599446] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 09:52:34 juju-e4d256-prod-github-runner-207 kernel: [16128.600495] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 09:52:34 juju-e4d256-prod-github-runner-207 kernel: [16128.601586] handle_exit+0x98/0x230 [kvm_amd] Aug 22 09:52:34 juju-e4d256-prod-github-runner-207 kernel: [16128.602578] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 09:52:34 juju-e4d256-prod-github-runner-207 kernel: [16128.603612] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 09:52:34 juju-e4d256-prod-github-runner-207 kernel: [16128.604634] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 09:52:34 juju-e4d256-prod-github-runner-207 kernel: [16128.605649] vcpu_run+0x62/0x2c0 [kvm] Aug 22 09:52:34 juju-e4d256-prod-github-runner-207 kernel: [16128.606560] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 09:52:34 juju-e4d256-prod-github-runner-207 kernel: [16128.607498] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 09:52:34 juju-e4d256-prod-github-runner-207 kernel: [16128.608453] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 09:52:34 juju-e4d256-prod-github-runner-207 kernel: [16128.609352] ? __seccomp_filter+0x4a/0x4a0 Aug 22 09:52:34 juju-e4d256-prod-github-runner-207 kernel: [16128.610188] ? __fget_files+0x86/0xc0 Aug 22 09:52:34 juju-e4d256-prod-github-runner-207 kernel: [16128.610978] __x64_sys_ioctl+0x95/0xd0 Aug 22 09:52:34 juju-e4d256-prod-github-runner-207 kernel: [16128.611754] do_syscall_64+0x5c/0xc0 Aug 22 09:52:34 juju-e4d256-prod-github-runner-207 kernel: [16128.612498] ? do_futex+0x162/0x1f0 Aug 22 09:52:34 juju-e4d256-prod-github-runner-207 kernel: [16128.613234] ? __x64_sys_futex+0x78/0x1e0 Aug 22 09:52:34 juju-e4d256-prod-github-runner-207 kernel: [16128.613989] ? __secure_computing+0xa9/0x120 Aug 22 09:52:34 juju-e4d256-prod-github-runner-207 kernel: [16128.614781] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 09:52:34 juju-e4d256-prod-github-runner-207 kernel: [16128.615656] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:52:34 juju-e4d256-prod-github-runner-207 kernel: [16128.616486] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:52:34 juju-e4d256-prod-github-runner-207 kernel: [16128.617304] ? do_syscall_64+0x69/0xc0 Aug 22 09:52:34 juju-e4d256-prod-github-runner-207 kernel: [16128.618026] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:52:34 juju-e4d256-prod-github-runner-207 kernel: [16128.618864] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:52:34 juju-e4d256-prod-github-runner-207 kernel: [16128.619664] ? do_syscall_64+0x69/0xc0 Aug 22 09:52:34 juju-e4d256-prod-github-runner-207 kernel: [16128.620377] ? do_syscall_64+0x69/0xc0 Aug 22 09:52:34 juju-e4d256-prod-github-runner-207 kernel: [16128.621080] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 09:52:34 juju-e4d256-prod-github-runner-207 kernel: [16128.621894] RIP: 0033:0x7faa5d0edaff Aug 22 09:52:34 juju-e4d256-prod-github-runner-207 kernel: [16128.622598] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 09:52:34 juju-e4d256-prod-github-runner-207 kernel: [16128.624959] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 09:52:34 juju-e4d256-prod-github-runner-207 kernel: [16128.626023] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 09:52:34 juju-e4d256-prod-github-runner-207 kernel: [16128.627073] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 09:52:34 juju-e4d256-prod-github-runner-207 kernel: [16128.628100] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 09:52:34 juju-e4d256-prod-github-runner-207 kernel: [16128.629122] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 09:52:34 juju-e4d256-prod-github-runner-207 kernel: [16128.630147] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 09:52:34 juju-e4d256-prod-github-runner-207 kernel: [16128.631194] Aug 22 09:53:02 juju-e4d256-prod-github-runner-207 kernel: [16156.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 14938s! [qemu-system-x86:6715] Aug 22 09:53:02 juju-e4d256-prod-github-runner-207 kernel: [16156.543726] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 09:53:02 juju-e4d256-prod-github-runner-207 kernel: [16156.543922] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 09:53:02 juju-e4d256-prod-github-runner-207 kernel: [16156.556065] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 09:53:02 juju-e4d256-prod-github-runner-207 kernel: [16156.557337] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 09:53:02 juju-e4d256-prod-github-runner-207 kernel: [16156.558575] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:53:02 juju-e4d256-prod-github-runner-207 kernel: [16156.559642] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 09:53:02 juju-e4d256-prod-github-runner-207 kernel: [16156.562622] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 09:53:02 juju-e4d256-prod-github-runner-207 kernel: [16156.563666] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 09:53:02 juju-e4d256-prod-github-runner-207 kernel: [16156.564830] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 09:53:02 juju-e4d256-prod-github-runner-207 kernel: [16156.565987] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 09:53:02 juju-e4d256-prod-github-runner-207 kernel: [16156.567203] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 09:53:02 juju-e4d256-prod-github-runner-207 kernel: [16156.568413] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 09:53:02 juju-e4d256-prod-github-runner-207 kernel: [16156.569605] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 09:53:02 juju-e4d256-prod-github-runner-207 kernel: [16156.570909] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 09:53:02 juju-e4d256-prod-github-runner-207 kernel: [16156.572073] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 09:53:02 juju-e4d256-prod-github-runner-207 kernel: [16156.573377] Call Trace: Aug 22 09:53:02 juju-e4d256-prod-github-runner-207 kernel: [16156.574335] Aug 22 09:53:02 juju-e4d256-prod-github-runner-207 kernel: [16156.575321] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:53:02 juju-e4d256-prod-github-runner-207 kernel: [16156.576429] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:53:02 juju-e4d256-prod-github-runner-207 kernel: [16156.577501] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:53:02 juju-e4d256-prod-github-runner-207 kernel: [16156.578658] ? show_regs.part.0+0x23/0x29 Aug 22 09:53:02 juju-e4d256-prod-github-runner-207 kernel: [16156.579671] ? show_regs.cold+0x8/0xd Aug 22 09:53:02 juju-e4d256-prod-github-runner-207 kernel: [16156.580678] ? watchdog_timer_fn+0x1be/0x220 Aug 22 09:53:02 juju-e4d256-prod-github-runner-207 kernel: [16156.581724] ? lockup_detector_update_enable+0x60/0x60 Aug 22 09:53:02 juju-e4d256-prod-github-runner-207 kernel: [16156.582848] ? __hrtimer_run_queues+0x107/0x230 Aug 22 09:53:02 juju-e4d256-prod-github-runner-207 kernel: [16156.583926] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 09:53:02 juju-e4d256-prod-github-runner-207 kernel: [16156.584967] ? hrtimer_interrupt+0x101/0x220 Aug 22 09:53:02 juju-e4d256-prod-github-runner-207 kernel: [16156.586019] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 09:53:02 juju-e4d256-prod-github-runner-207 kernel: [16156.587159] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 09:53:02 juju-e4d256-prod-github-runner-207 kernel: [16156.588317] Aug 22 09:53:02 juju-e4d256-prod-github-runner-207 kernel: [16156.589247] Aug 22 09:53:02 juju-e4d256-prod-github-runner-207 kernel: [16156.590139] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 09:53:02 juju-e4d256-prod-github-runner-207 kernel: [16156.591295] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:53:02 juju-e4d256-prod-github-runner-207 kernel: [16156.592384] ? _raw_spin_lock+0x22/0x30 Aug 22 09:53:02 juju-e4d256-prod-github-runner-207 kernel: [16156.593359] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:53:02 juju-e4d256-prod-github-runner-207 kernel: [16156.594419] direct_page_fault+0x206/0x310 [kvm] Aug 22 09:53:02 juju-e4d256-prod-github-runner-207 kernel: [16156.595474] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 09:53:02 juju-e4d256-prod-github-runner-207 kernel: [16156.596511] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 09:53:02 juju-e4d256-prod-github-runner-207 kernel: [16156.597541] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 09:53:02 juju-e4d256-prod-github-runner-207 kernel: [16156.598569] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 09:53:02 juju-e4d256-prod-github-runner-207 kernel: [16156.599561] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 09:53:02 juju-e4d256-prod-github-runner-207 kernel: [16156.600557] handle_exit+0x98/0x230 [kvm_amd] Aug 22 09:53:02 juju-e4d256-prod-github-runner-207 kernel: [16156.602117] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 09:53:02 juju-e4d256-prod-github-runner-207 kernel: [16156.603400] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 09:53:02 juju-e4d256-prod-github-runner-207 kernel: [16156.604731] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 09:53:02 juju-e4d256-prod-github-runner-207 kernel: [16156.606072] vcpu_run+0x62/0x2c0 [kvm] Aug 22 09:53:02 juju-e4d256-prod-github-runner-207 kernel: [16156.607094] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 09:53:02 juju-e4d256-prod-github-runner-207 kernel: [16156.607910] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 09:53:02 juju-e4d256-prod-github-runner-207 kernel: [16156.608772] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 09:53:02 juju-e4d256-prod-github-runner-207 kernel: [16156.609574] ? __seccomp_filter+0x4a/0x4a0 Aug 22 09:53:02 juju-e4d256-prod-github-runner-207 kernel: [16156.610319] ? __fget_files+0x86/0xc0 Aug 22 09:53:02 juju-e4d256-prod-github-runner-207 kernel: [16156.611043] __x64_sys_ioctl+0x95/0xd0 Aug 22 09:53:02 juju-e4d256-prod-github-runner-207 kernel: [16156.611742] do_syscall_64+0x5c/0xc0 Aug 22 09:53:02 juju-e4d256-prod-github-runner-207 kernel: [16156.612443] ? do_futex+0x162/0x1f0 Aug 22 09:53:02 juju-e4d256-prod-github-runner-207 kernel: [16156.613107] ? __x64_sys_futex+0x78/0x1e0 Aug 22 09:53:02 juju-e4d256-prod-github-runner-207 kernel: [16156.613816] ? __secure_computing+0xa9/0x120 Aug 22 09:53:02 juju-e4d256-prod-github-runner-207 kernel: [16156.614587] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 09:53:02 juju-e4d256-prod-github-runner-207 kernel: [16156.615460] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:53:02 juju-e4d256-prod-github-runner-207 kernel: [16156.616321] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:53:02 juju-e4d256-prod-github-runner-207 kernel: [16156.617297] ? do_syscall_64+0x69/0xc0 Aug 22 09:53:02 juju-e4d256-prod-github-runner-207 kernel: [16156.618172] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:53:02 juju-e4d256-prod-github-runner-207 kernel: [16156.619448] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:53:02 juju-e4d256-prod-github-runner-207 kernel: [16156.620230] ? do_syscall_64+0x69/0xc0 Aug 22 09:53:02 juju-e4d256-prod-github-runner-207 kernel: [16156.621061] ? do_syscall_64+0x69/0xc0 Aug 22 09:53:02 juju-e4d256-prod-github-runner-207 kernel: [16156.621832] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 09:53:02 juju-e4d256-prod-github-runner-207 kernel: [16156.622708] RIP: 0033:0x7faa5d0edaff Aug 22 09:53:02 juju-e4d256-prod-github-runner-207 kernel: [16156.623608] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 09:53:02 juju-e4d256-prod-github-runner-207 kernel: [16156.626576] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 09:53:02 juju-e4d256-prod-github-runner-207 kernel: [16156.627703] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 09:53:02 juju-e4d256-prod-github-runner-207 kernel: [16156.628798] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 09:53:02 juju-e4d256-prod-github-runner-207 kernel: [16156.629925] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 09:53:02 juju-e4d256-prod-github-runner-207 kernel: [16156.631032] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 09:53:02 juju-e4d256-prod-github-runner-207 kernel: [16156.632104] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 09:53:02 juju-e4d256-prod-github-runner-207 kernel: [16156.633143] Aug 22 09:53:30 juju-e4d256-prod-github-runner-207 kernel: [16184.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 14965s! [qemu-system-x86:6715] Aug 22 09:53:30 juju-e4d256-prod-github-runner-207 kernel: [16184.543144] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 09:53:30 juju-e4d256-prod-github-runner-207 kernel: [16184.543214] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 09:53:30 juju-e4d256-prod-github-runner-207 kernel: [16184.555386] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 09:53:30 juju-e4d256-prod-github-runner-207 kernel: [16184.556657] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 09:53:30 juju-e4d256-prod-github-runner-207 kernel: [16184.557882] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:53:30 juju-e4d256-prod-github-runner-207 kernel: [16184.558960] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 09:53:30 juju-e4d256-prod-github-runner-207 kernel: [16184.561505] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 09:53:30 juju-e4d256-prod-github-runner-207 kernel: [16184.562568] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 09:53:30 juju-e4d256-prod-github-runner-207 kernel: [16184.564864] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 09:53:30 juju-e4d256-prod-github-runner-207 kernel: [16184.567168] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 09:53:30 juju-e4d256-prod-github-runner-207 kernel: [16184.568334] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 09:53:30 juju-e4d256-prod-github-runner-207 kernel: [16184.570039] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 09:53:30 juju-e4d256-prod-github-runner-207 kernel: [16184.572789] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 09:53:30 juju-e4d256-prod-github-runner-207 kernel: [16184.574089] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 09:53:30 juju-e4d256-prod-github-runner-207 kernel: [16184.575194] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 09:53:30 juju-e4d256-prod-github-runner-207 kernel: [16184.576489] Call Trace: Aug 22 09:53:30 juju-e4d256-prod-github-runner-207 kernel: [16184.579467] Aug 22 09:53:30 juju-e4d256-prod-github-runner-207 kernel: [16184.580360] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:53:30 juju-e4d256-prod-github-runner-207 kernel: [16184.581396] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:53:30 juju-e4d256-prod-github-runner-207 kernel: [16184.582532] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:53:30 juju-e4d256-prod-github-runner-207 kernel: [16184.583945] ? show_regs.part.0+0x23/0x29 Aug 22 09:53:30 juju-e4d256-prod-github-runner-207 kernel: [16184.584973] ? show_regs.cold+0x8/0xd Aug 22 09:53:30 juju-e4d256-prod-github-runner-207 kernel: [16184.585955] ? watchdog_timer_fn+0x1be/0x220 Aug 22 09:53:30 juju-e4d256-prod-github-runner-207 kernel: [16184.586989] ? lockup_detector_update_enable+0x60/0x60 Aug 22 09:53:30 juju-e4d256-prod-github-runner-207 kernel: [16184.588057] ? __hrtimer_run_queues+0x107/0x230 Aug 22 09:53:30 juju-e4d256-prod-github-runner-207 kernel: [16184.589084] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 09:53:30 juju-e4d256-prod-github-runner-207 kernel: [16184.590134] ? hrtimer_interrupt+0x101/0x220 Aug 22 09:53:30 juju-e4d256-prod-github-runner-207 kernel: [16184.591157] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 09:53:30 juju-e4d256-prod-github-runner-207 kernel: [16184.592225] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 09:53:30 juju-e4d256-prod-github-runner-207 kernel: [16184.593272] Aug 22 09:53:30 juju-e4d256-prod-github-runner-207 kernel: [16184.594183] Aug 22 09:53:30 juju-e4d256-prod-github-runner-207 kernel: [16184.595036] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 09:53:30 juju-e4d256-prod-github-runner-207 kernel: [16184.596072] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:53:30 juju-e4d256-prod-github-runner-207 kernel: [16184.597120] ? _raw_spin_lock+0x22/0x30 Aug 22 09:53:30 juju-e4d256-prod-github-runner-207 kernel: [16184.598086] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:53:30 juju-e4d256-prod-github-runner-207 kernel: [16184.599115] direct_page_fault+0x206/0x310 [kvm] Aug 22 09:53:30 juju-e4d256-prod-github-runner-207 kernel: [16184.600142] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 09:53:30 juju-e4d256-prod-github-runner-207 kernel: [16184.601156] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 09:53:30 juju-e4d256-prod-github-runner-207 kernel: [16184.602179] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 09:53:30 juju-e4d256-prod-github-runner-207 kernel: [16184.603155] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 09:53:30 juju-e4d256-prod-github-runner-207 kernel: [16184.604105] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 09:53:30 juju-e4d256-prod-github-runner-207 kernel: [16184.605113] handle_exit+0x98/0x230 [kvm_amd] Aug 22 09:53:30 juju-e4d256-prod-github-runner-207 kernel: [16184.606035] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 09:53:30 juju-e4d256-prod-github-runner-207 kernel: [16184.606957] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 09:53:30 juju-e4d256-prod-github-runner-207 kernel: [16184.607885] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 09:53:30 juju-e4d256-prod-github-runner-207 kernel: [16184.608792] vcpu_run+0x62/0x2c0 [kvm] Aug 22 09:53:30 juju-e4d256-prod-github-runner-207 kernel: [16184.609610] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 09:53:30 juju-e4d256-prod-github-runner-207 kernel: [16184.610436] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 09:53:30 juju-e4d256-prod-github-runner-207 kernel: [16184.611296] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 09:53:30 juju-e4d256-prod-github-runner-207 kernel: [16184.612096] ? __seccomp_filter+0x4a/0x4a0 Aug 22 09:53:30 juju-e4d256-prod-github-runner-207 kernel: [16184.612848] ? __fget_files+0x86/0xc0 Aug 22 09:53:30 juju-e4d256-prod-github-runner-207 kernel: [16184.613554] __x64_sys_ioctl+0x95/0xd0 Aug 22 09:53:30 juju-e4d256-prod-github-runner-207 kernel: [16184.614271] do_syscall_64+0x5c/0xc0 Aug 22 09:53:30 juju-e4d256-prod-github-runner-207 kernel: [16184.614971] ? do_futex+0x162/0x1f0 Aug 22 09:53:30 juju-e4d256-prod-github-runner-207 kernel: [16184.615633] ? __x64_sys_futex+0x78/0x1e0 Aug 22 09:53:30 juju-e4d256-prod-github-runner-207 kernel: [16184.616310] ? __secure_computing+0xa9/0x120 Aug 22 09:53:30 juju-e4d256-prod-github-runner-207 kernel: [16184.617003] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 09:53:30 juju-e4d256-prod-github-runner-207 kernel: [16184.617772] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:53:30 juju-e4d256-prod-github-runner-207 kernel: [16184.618517] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:53:30 juju-e4d256-prod-github-runner-207 kernel: [16184.619247] ? do_syscall_64+0x69/0xc0 Aug 22 09:53:30 juju-e4d256-prod-github-runner-207 kernel: [16184.619896] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:53:30 juju-e4d256-prod-github-runner-207 kernel: [16184.620609] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:53:30 juju-e4d256-prod-github-runner-207 kernel: [16184.621309] ? do_syscall_64+0x69/0xc0 Aug 22 09:53:30 juju-e4d256-prod-github-runner-207 kernel: [16184.621938] ? do_syscall_64+0x69/0xc0 Aug 22 09:53:30 juju-e4d256-prod-github-runner-207 kernel: [16184.622582] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 09:53:30 juju-e4d256-prod-github-runner-207 kernel: [16184.623291] RIP: 0033:0x7faa5d0edaff Aug 22 09:53:30 juju-e4d256-prod-github-runner-207 kernel: [16184.623918] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 09:53:30 juju-e4d256-prod-github-runner-207 kernel: [16184.625936] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 09:53:30 juju-e4d256-prod-github-runner-207 kernel: [16184.626863] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 09:53:30 juju-e4d256-prod-github-runner-207 kernel: [16184.627758] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 09:53:30 juju-e4d256-prod-github-runner-207 kernel: [16184.628657] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 09:53:30 juju-e4d256-prod-github-runner-207 kernel: [16184.629557] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 09:53:30 juju-e4d256-prod-github-runner-207 kernel: [16184.630457] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 09:53:30 juju-e4d256-prod-github-runner-207 kernel: [16184.631368] Aug 22 09:53:44 juju-e4d256-prod-github-runner-207 kernel: [16198.268709] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 09:53:44 juju-e4d256-prod-github-runner-207 kernel: [16198.269673] rcu: 1-....: (4007678 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=1936387 Aug 22 09:53:44 juju-e4d256-prod-github-runner-207 kernel: [16198.270840] (t=4020267 jiffies g=23269 q=23191) Aug 22 09:53:44 juju-e4d256-prod-github-runner-207 kernel: [16198.271654] NMI backtrace for cpu 1 Aug 22 09:53:44 juju-e4d256-prod-github-runner-207 kernel: [16198.272377] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 09:53:44 juju-e4d256-prod-github-runner-207 kernel: [16198.273505] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 09:53:44 juju-e4d256-prod-github-runner-207 kernel: [16198.274609] Call Trace: Aug 22 09:53:44 juju-e4d256-prod-github-runner-207 kernel: [16198.275318] Aug 22 09:53:44 juju-e4d256-prod-github-runner-207 kernel: [16198.275995] show_stack+0x52/0x5c Aug 22 09:53:44 juju-e4d256-prod-github-runner-207 kernel: [16198.276733] dump_stack_lvl+0x4a/0x63 Aug 22 09:53:44 juju-e4d256-prod-github-runner-207 kernel: [16198.277485] dump_stack+0x10/0x16 Aug 22 09:53:44 juju-e4d256-prod-github-runner-207 kernel: [16198.278252] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 09:53:44 juju-e4d256-prod-github-runner-207 kernel: [16198.279251] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 09:53:44 juju-e4d256-prod-github-runner-207 kernel: [16198.280035] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 09:53:44 juju-e4d256-prod-github-runner-207 kernel: [16198.280877] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 09:53:44 juju-e4d256-prod-github-runner-207 kernel: [16198.281718] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 09:53:44 juju-e4d256-prod-github-runner-207 kernel: [16198.282556] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 09:53:44 juju-e4d256-prod-github-runner-207 kernel: [16198.283338] print_cpu_stall.cold+0x2f/0xe2 Aug 22 09:53:44 juju-e4d256-prod-github-runner-207 kernel: [16198.284286] ? timekeeping_update+0xf7/0x150 Aug 22 09:53:44 juju-e4d256-prod-github-runner-207 kernel: [16198.285062] check_cpu_stall+0x109/0x270 Aug 22 09:53:44 juju-e4d256-prod-github-runner-207 kernel: [16198.285824] rcu_sched_clock_irq+0x9a/0x250 Aug 22 09:53:44 juju-e4d256-prod-github-runner-207 kernel: [16198.286626] update_process_times+0x94/0xd0 Aug 22 09:53:44 juju-e4d256-prod-github-runner-207 kernel: [16198.287394] tick_sched_handle+0x29/0x70 Aug 22 09:53:44 juju-e4d256-prod-github-runner-207 kernel: [16198.288141] tick_sched_timer+0x8c/0xc0 Aug 22 09:53:44 juju-e4d256-prod-github-runner-207 kernel: [16198.288880] ? tick_nohz_handler+0xb0/0xb0 Aug 22 09:53:44 juju-e4d256-prod-github-runner-207 kernel: [16198.289676] __hrtimer_run_queues+0x107/0x230 Aug 22 09:53:44 juju-e4d256-prod-github-runner-207 kernel: [16198.290481] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 09:53:44 juju-e4d256-prod-github-runner-207 kernel: [16198.291253] hrtimer_interrupt+0x101/0x220 Aug 22 09:53:44 juju-e4d256-prod-github-runner-207 kernel: [16198.292011] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 09:53:44 juju-e4d256-prod-github-runner-207 kernel: [16198.292842] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 09:53:44 juju-e4d256-prod-github-runner-207 kernel: [16198.293659] Aug 22 09:53:44 juju-e4d256-prod-github-runner-207 kernel: [16198.294324] Aug 22 09:53:44 juju-e4d256-prod-github-runner-207 kernel: [16198.294954] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 09:53:44 juju-e4d256-prod-github-runner-207 kernel: [16198.295773] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:53:44 juju-e4d256-prod-github-runner-207 kernel: [16198.296647] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 09:53:44 juju-e4d256-prod-github-runner-207 kernel: [16198.298884] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 09:53:44 juju-e4d256-prod-github-runner-207 kernel: [16198.299766] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 09:53:44 juju-e4d256-prod-github-runner-207 kernel: [16198.300768] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 09:53:44 juju-e4d256-prod-github-runner-207 kernel: [16198.301760] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 09:53:44 juju-e4d256-prod-github-runner-207 kernel: [16198.302755] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 09:53:44 juju-e4d256-prod-github-runner-207 kernel: [16198.303809] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 09:53:44 juju-e4d256-prod-github-runner-207 kernel: [16198.304781] ? _raw_spin_lock+0x22/0x30 Aug 22 09:53:44 juju-e4d256-prod-github-runner-207 kernel: [16198.305547] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:53:44 juju-e4d256-prod-github-runner-207 kernel: [16198.306423] direct_page_fault+0x206/0x310 [kvm] Aug 22 09:53:44 juju-e4d256-prod-github-runner-207 kernel: [16198.307285] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 09:53:44 juju-e4d256-prod-github-runner-207 kernel: [16198.308113] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 09:53:44 juju-e4d256-prod-github-runner-207 kernel: [16198.308934] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 09:53:44 juju-e4d256-prod-github-runner-207 kernel: [16198.309739] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 09:53:44 juju-e4d256-prod-github-runner-207 kernel: [16198.310568] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 09:53:44 juju-e4d256-prod-github-runner-207 kernel: [16198.311410] handle_exit+0x98/0x230 [kvm_amd] Aug 22 09:53:44 juju-e4d256-prod-github-runner-207 kernel: [16198.312165] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 09:53:44 juju-e4d256-prod-github-runner-207 kernel: [16198.312948] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 09:53:44 juju-e4d256-prod-github-runner-207 kernel: [16198.313746] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 09:53:44 juju-e4d256-prod-github-runner-207 kernel: [16198.314540] vcpu_run+0x62/0x2c0 [kvm] Aug 22 09:53:44 juju-e4d256-prod-github-runner-207 kernel: [16198.315294] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 09:53:44 juju-e4d256-prod-github-runner-207 kernel: [16198.316042] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 09:53:44 juju-e4d256-prod-github-runner-207 kernel: [16198.316842] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 09:53:44 juju-e4d256-prod-github-runner-207 kernel: [16198.317601] ? __seccomp_filter+0x4a/0x4a0 Aug 22 09:53:44 juju-e4d256-prod-github-runner-207 kernel: [16198.318338] ? __fget_files+0x86/0xc0 Aug 22 09:53:44 juju-e4d256-prod-github-runner-207 kernel: [16198.319041] __x64_sys_ioctl+0x95/0xd0 Aug 22 09:53:44 juju-e4d256-prod-github-runner-207 kernel: [16198.319744] do_syscall_64+0x5c/0xc0 Aug 22 09:53:44 juju-e4d256-prod-github-runner-207 kernel: [16198.320425] ? do_futex+0x162/0x1f0 Aug 22 09:53:44 juju-e4d256-prod-github-runner-207 kernel: [16198.321125] ? __x64_sys_futex+0x78/0x1e0 Aug 22 09:53:44 juju-e4d256-prod-github-runner-207 kernel: [16198.321858] ? __secure_computing+0xa9/0x120 Aug 22 09:53:44 juju-e4d256-prod-github-runner-207 kernel: [16198.322580] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 09:53:44 juju-e4d256-prod-github-runner-207 kernel: [16198.323373] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:53:44 juju-e4d256-prod-github-runner-207 kernel: [16198.324132] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:53:44 juju-e4d256-prod-github-runner-207 kernel: [16198.324912] ? do_syscall_64+0x69/0xc0 Aug 22 09:53:44 juju-e4d256-prod-github-runner-207 kernel: [16198.325612] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:53:44 juju-e4d256-prod-github-runner-207 kernel: [16198.326389] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:53:44 juju-e4d256-prod-github-runner-207 kernel: [16198.327182] ? do_syscall_64+0x69/0xc0 Aug 22 09:53:44 juju-e4d256-prod-github-runner-207 kernel: [16198.327884] ? do_syscall_64+0x69/0xc0 Aug 22 09:53:44 juju-e4d256-prod-github-runner-207 kernel: [16198.328572] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 09:53:44 juju-e4d256-prod-github-runner-207 kernel: [16198.329344] RIP: 0033:0x7faa5d0edaff Aug 22 09:53:44 juju-e4d256-prod-github-runner-207 kernel: [16198.330047] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 09:53:44 juju-e4d256-prod-github-runner-207 kernel: [16198.332157] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 09:53:44 juju-e4d256-prod-github-runner-207 kernel: [16198.333133] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 09:53:44 juju-e4d256-prod-github-runner-207 kernel: [16198.334094] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 09:53:44 juju-e4d256-prod-github-runner-207 kernel: [16198.335044] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 09:53:44 juju-e4d256-prod-github-runner-207 kernel: [16198.335994] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 09:53:44 juju-e4d256-prod-github-runner-207 kernel: [16198.336938] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 09:53:44 juju-e4d256-prod-github-runner-207 kernel: [16198.337901] Aug 22 09:54:10 juju-e4d256-prod-github-runner-207 kernel: [16224.541995] watchdog: BUG: soft lockup - CPU#1 stuck for 15002s! [qemu-system-x86:6715] Aug 22 09:54:10 juju-e4d256-prod-github-runner-207 kernel: [16224.545773] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 09:54:10 juju-e4d256-prod-github-runner-207 kernel: [16224.546018] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 09:54:10 juju-e4d256-prod-github-runner-207 kernel: [16224.558048] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 09:54:10 juju-e4d256-prod-github-runner-207 kernel: [16224.559328] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 09:54:10 juju-e4d256-prod-github-runner-207 kernel: [16224.560615] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:54:10 juju-e4d256-prod-github-runner-207 kernel: [16224.561682] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 09:54:10 juju-e4d256-prod-github-runner-207 kernel: [16224.564224] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 09:54:10 juju-e4d256-prod-github-runner-207 kernel: [16224.565263] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 09:54:10 juju-e4d256-prod-github-runner-207 kernel: [16224.566427] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 09:54:10 juju-e4d256-prod-github-runner-207 kernel: [16224.567587] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 09:54:10 juju-e4d256-prod-github-runner-207 kernel: [16224.568745] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 09:54:10 juju-e4d256-prod-github-runner-207 kernel: [16224.569922] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 09:54:10 juju-e4d256-prod-github-runner-207 kernel: [16224.571086] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 09:54:10 juju-e4d256-prod-github-runner-207 kernel: [16224.572314] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 09:54:10 juju-e4d256-prod-github-runner-207 kernel: [16224.573410] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 09:54:10 juju-e4d256-prod-github-runner-207 kernel: [16224.574610] Call Trace: Aug 22 09:54:10 juju-e4d256-prod-github-runner-207 kernel: [16224.575520] Aug 22 09:54:10 juju-e4d256-prod-github-runner-207 kernel: [16224.576409] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:54:10 juju-e4d256-prod-github-runner-207 kernel: [16224.577435] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:54:10 juju-e4d256-prod-github-runner-207 kernel: [16224.578464] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:54:10 juju-e4d256-prod-github-runner-207 kernel: [16224.579553] ? show_regs.part.0+0x23/0x29 Aug 22 09:54:10 juju-e4d256-prod-github-runner-207 kernel: [16224.580546] ? show_regs.cold+0x8/0xd Aug 22 09:54:10 juju-e4d256-prod-github-runner-207 kernel: [16224.581523] ? watchdog_timer_fn+0x1be/0x220 Aug 22 09:54:10 juju-e4d256-prod-github-runner-207 kernel: [16224.582531] ? lockup_detector_update_enable+0x60/0x60 Aug 22 09:54:10 juju-e4d256-prod-github-runner-207 kernel: [16224.583594] ? __hrtimer_run_queues+0x107/0x230 Aug 22 09:54:10 juju-e4d256-prod-github-runner-207 kernel: [16224.584619] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 09:54:10 juju-e4d256-prod-github-runner-207 kernel: [16224.585656] ? hrtimer_interrupt+0x101/0x220 Aug 22 09:54:10 juju-e4d256-prod-github-runner-207 kernel: [16224.586669] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 09:54:10 juju-e4d256-prod-github-runner-207 kernel: [16224.587734] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 09:54:10 juju-e4d256-prod-github-runner-207 kernel: [16224.588785] Aug 22 09:54:10 juju-e4d256-prod-github-runner-207 kernel: [16224.589650] Aug 22 09:54:10 juju-e4d256-prod-github-runner-207 kernel: [16224.590487] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 09:54:10 juju-e4d256-prod-github-runner-207 kernel: [16224.591519] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:54:10 juju-e4d256-prod-github-runner-207 kernel: [16224.592555] ? _raw_spin_lock+0x22/0x30 Aug 22 09:54:10 juju-e4d256-prod-github-runner-207 kernel: [16224.593499] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:54:10 juju-e4d256-prod-github-runner-207 kernel: [16224.594522] direct_page_fault+0x206/0x310 [kvm] Aug 22 09:54:10 juju-e4d256-prod-github-runner-207 kernel: [16224.595545] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 09:54:10 juju-e4d256-prod-github-runner-207 kernel: [16224.596553] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 09:54:10 juju-e4d256-prod-github-runner-207 kernel: [16224.597565] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 09:54:10 juju-e4d256-prod-github-runner-207 kernel: [16224.598556] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 09:54:10 juju-e4d256-prod-github-runner-207 kernel: [16224.599501] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 09:54:10 juju-e4d256-prod-github-runner-207 kernel: [16224.600478] handle_exit+0x98/0x230 [kvm_amd] Aug 22 09:54:10 juju-e4d256-prod-github-runner-207 kernel: [16224.601372] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 09:54:10 juju-e4d256-prod-github-runner-207 kernel: [16224.602295] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 09:54:10 juju-e4d256-prod-github-runner-207 kernel: [16224.603219] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 09:54:10 juju-e4d256-prod-github-runner-207 kernel: [16224.604123] vcpu_run+0x62/0x2c0 [kvm] Aug 22 09:54:10 juju-e4d256-prod-github-runner-207 kernel: [16224.604933] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 09:54:10 juju-e4d256-prod-github-runner-207 kernel: [16224.605864] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 09:54:10 juju-e4d256-prod-github-runner-207 kernel: [16224.606720] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 09:54:10 juju-e4d256-prod-github-runner-207 kernel: [16224.607516] ? __seccomp_filter+0x4a/0x4a0 Aug 22 09:54:10 juju-e4d256-prod-github-runner-207 kernel: [16224.608285] ? __fget_files+0x86/0xc0 Aug 22 09:54:10 juju-e4d256-prod-github-runner-207 kernel: [16224.608989] __x64_sys_ioctl+0x95/0xd0 Aug 22 09:54:10 juju-e4d256-prod-github-runner-207 kernel: [16224.609700] do_syscall_64+0x5c/0xc0 Aug 22 09:54:10 juju-e4d256-prod-github-runner-207 kernel: [16224.610367] ? do_futex+0x162/0x1f0 Aug 22 09:54:10 juju-e4d256-prod-github-runner-207 kernel: [16224.611019] ? __x64_sys_futex+0x78/0x1e0 Aug 22 09:54:10 juju-e4d256-prod-github-runner-207 kernel: [16224.611691] ? __secure_computing+0xa9/0x120 Aug 22 09:54:10 juju-e4d256-prod-github-runner-207 kernel: [16224.612379] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 09:54:10 juju-e4d256-prod-github-runner-207 kernel: [16224.613148] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:54:10 juju-e4d256-prod-github-runner-207 kernel: [16224.613883] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:54:10 juju-e4d256-prod-github-runner-207 kernel: [16224.614599] ? do_syscall_64+0x69/0xc0 Aug 22 09:54:10 juju-e4d256-prod-github-runner-207 kernel: [16224.615242] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:54:10 juju-e4d256-prod-github-runner-207 kernel: [16224.615942] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:54:10 juju-e4d256-prod-github-runner-207 kernel: [16224.616634] ? do_syscall_64+0x69/0xc0 Aug 22 09:54:10 juju-e4d256-prod-github-runner-207 kernel: [16224.617258] ? do_syscall_64+0x69/0xc0 Aug 22 09:54:10 juju-e4d256-prod-github-runner-207 kernel: [16224.617887] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 09:54:10 juju-e4d256-prod-github-runner-207 kernel: [16224.618681] RIP: 0033:0x7faa5d0edaff Aug 22 09:54:10 juju-e4d256-prod-github-runner-207 kernel: [16224.619359] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 09:54:10 juju-e4d256-prod-github-runner-207 kernel: [16224.621606] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 09:54:10 juju-e4d256-prod-github-runner-207 kernel: [16224.622916] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 09:54:10 juju-e4d256-prod-github-runner-207 kernel: [16224.623922] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 09:54:10 juju-e4d256-prod-github-runner-207 kernel: [16224.624918] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 09:54:10 juju-e4d256-prod-github-runner-207 kernel: [16224.625851] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 09:54:10 juju-e4d256-prod-github-runner-207 kernel: [16224.626743] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 09:54:10 juju-e4d256-prod-github-runner-207 kernel: [16224.627638] Aug 22 09:54:38 juju-e4d256-prod-github-runner-207 kernel: [16252.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 15028s! [qemu-system-x86:6715] Aug 22 09:54:38 juju-e4d256-prod-github-runner-207 kernel: [16252.543101] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 09:54:38 juju-e4d256-prod-github-runner-207 kernel: [16252.543169] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 09:54:38 juju-e4d256-prod-github-runner-207 kernel: [16252.555303] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 09:54:38 juju-e4d256-prod-github-runner-207 kernel: [16252.556567] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 09:54:38 juju-e4d256-prod-github-runner-207 kernel: [16252.557800] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:54:38 juju-e4d256-prod-github-runner-207 kernel: [16252.558902] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 09:54:38 juju-e4d256-prod-github-runner-207 kernel: [16252.561467] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 09:54:38 juju-e4d256-prod-github-runner-207 kernel: [16252.562514] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 09:54:38 juju-e4d256-prod-github-runner-207 kernel: [16252.563675] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 09:54:38 juju-e4d256-prod-github-runner-207 kernel: [16252.564840] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 09:54:38 juju-e4d256-prod-github-runner-207 kernel: [16252.566011] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 09:54:38 juju-e4d256-prod-github-runner-207 kernel: [16252.567174] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 09:54:38 juju-e4d256-prod-github-runner-207 kernel: [16252.568335] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 09:54:38 juju-e4d256-prod-github-runner-207 kernel: [16252.569577] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 09:54:38 juju-e4d256-prod-github-runner-207 kernel: [16252.570678] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 09:54:38 juju-e4d256-prod-github-runner-207 kernel: [16252.571872] Call Trace: Aug 22 09:54:38 juju-e4d256-prod-github-runner-207 kernel: [16252.572782] Aug 22 09:54:38 juju-e4d256-prod-github-runner-207 kernel: [16252.573686] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:54:38 juju-e4d256-prod-github-runner-207 kernel: [16252.574715] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:54:38 juju-e4d256-prod-github-runner-207 kernel: [16252.575737] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:54:38 juju-e4d256-prod-github-runner-207 kernel: [16252.576810] ? show_regs.part.0+0x23/0x29 Aug 22 09:54:38 juju-e4d256-prod-github-runner-207 kernel: [16252.577826] ? show_regs.cold+0x8/0xd Aug 22 09:54:38 juju-e4d256-prod-github-runner-207 kernel: [16252.578795] ? watchdog_timer_fn+0x1be/0x220 Aug 22 09:54:38 juju-e4d256-prod-github-runner-207 kernel: [16252.579799] ? lockup_detector_update_enable+0x60/0x60 Aug 22 09:54:38 juju-e4d256-prod-github-runner-207 kernel: [16252.580859] ? __hrtimer_run_queues+0x107/0x230 Aug 22 09:54:38 juju-e4d256-prod-github-runner-207 kernel: [16252.581896] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 09:54:38 juju-e4d256-prod-github-runner-207 kernel: [16252.582917] ? hrtimer_interrupt+0x101/0x220 Aug 22 09:54:38 juju-e4d256-prod-github-runner-207 kernel: [16252.583929] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 09:54:38 juju-e4d256-prod-github-runner-207 kernel: [16252.584994] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 09:54:38 juju-e4d256-prod-github-runner-207 kernel: [16252.586054] Aug 22 09:54:38 juju-e4d256-prod-github-runner-207 kernel: [16252.586904] Aug 22 09:54:38 juju-e4d256-prod-github-runner-207 kernel: [16252.587739] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 09:54:38 juju-e4d256-prod-github-runner-207 kernel: [16252.588783] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:54:38 juju-e4d256-prod-github-runner-207 kernel: [16252.589844] ? _raw_spin_lock+0x22/0x30 Aug 22 09:54:38 juju-e4d256-prod-github-runner-207 kernel: [16252.590797] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:54:38 juju-e4d256-prod-github-runner-207 kernel: [16252.591817] direct_page_fault+0x206/0x310 [kvm] Aug 22 09:54:38 juju-e4d256-prod-github-runner-207 kernel: [16252.592836] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 09:54:38 juju-e4d256-prod-github-runner-207 kernel: [16252.593855] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 09:54:38 juju-e4d256-prod-github-runner-207 kernel: [16252.594855] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 09:54:38 juju-e4d256-prod-github-runner-207 kernel: [16252.595826] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 09:54:38 juju-e4d256-prod-github-runner-207 kernel: [16252.596768] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 09:54:38 juju-e4d256-prod-github-runner-207 kernel: [16252.597756] handle_exit+0x98/0x230 [kvm_amd] Aug 22 09:54:38 juju-e4d256-prod-github-runner-207 kernel: [16252.598646] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 09:54:38 juju-e4d256-prod-github-runner-207 kernel: [16252.599556] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 09:54:38 juju-e4d256-prod-github-runner-207 kernel: [16252.600475] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 09:54:38 juju-e4d256-prod-github-runner-207 kernel: [16252.601398] vcpu_run+0x62/0x2c0 [kvm] Aug 22 09:54:38 juju-e4d256-prod-github-runner-207 kernel: [16252.602209] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 09:54:38 juju-e4d256-prod-github-runner-207 kernel: [16252.603019] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 09:54:38 juju-e4d256-prod-github-runner-207 kernel: [16252.603871] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 09:54:38 juju-e4d256-prod-github-runner-207 kernel: [16252.604665] ? __seccomp_filter+0x4a/0x4a0 Aug 22 09:54:38 juju-e4d256-prod-github-runner-207 kernel: [16252.605423] ? __fget_files+0x86/0xc0 Aug 22 09:54:38 juju-e4d256-prod-github-runner-207 kernel: [16252.606131] __x64_sys_ioctl+0x95/0xd0 Aug 22 09:54:38 juju-e4d256-prod-github-runner-207 kernel: [16252.606823] do_syscall_64+0x5c/0xc0 Aug 22 09:54:38 juju-e4d256-prod-github-runner-207 kernel: [16252.607486] ? do_futex+0x162/0x1f0 Aug 22 09:54:38 juju-e4d256-prod-github-runner-207 kernel: [16252.608138] ? __x64_sys_futex+0x78/0x1e0 Aug 22 09:54:38 juju-e4d256-prod-github-runner-207 kernel: [16252.608809] ? __secure_computing+0xa9/0x120 Aug 22 09:54:38 juju-e4d256-prod-github-runner-207 kernel: [16252.609528] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 09:54:38 juju-e4d256-prod-github-runner-207 kernel: [16252.610298] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:54:38 juju-e4d256-prod-github-runner-207 kernel: [16252.611020] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:54:38 juju-e4d256-prod-github-runner-207 kernel: [16252.611736] ? do_syscall_64+0x69/0xc0 Aug 22 09:54:38 juju-e4d256-prod-github-runner-207 kernel: [16252.612379] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:54:38 juju-e4d256-prod-github-runner-207 kernel: [16252.613077] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:54:38 juju-e4d256-prod-github-runner-207 kernel: [16252.613796] ? do_syscall_64+0x69/0xc0 Aug 22 09:54:38 juju-e4d256-prod-github-runner-207 kernel: [16252.614418] ? do_syscall_64+0x69/0xc0 Aug 22 09:54:38 juju-e4d256-prod-github-runner-207 kernel: [16252.615041] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 09:54:38 juju-e4d256-prod-github-runner-207 kernel: [16252.615743] RIP: 0033:0x7faa5d0edaff Aug 22 09:54:38 juju-e4d256-prod-github-runner-207 kernel: [16252.616398] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 09:54:38 juju-e4d256-prod-github-runner-207 kernel: [16252.618409] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 09:54:38 juju-e4d256-prod-github-runner-207 kernel: [16252.619327] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 09:54:38 juju-e4d256-prod-github-runner-207 kernel: [16252.620214] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 09:54:38 juju-e4d256-prod-github-runner-207 kernel: [16252.621105] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 09:54:38 juju-e4d256-prod-github-runner-207 kernel: [16252.622010] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 09:54:38 juju-e4d256-prod-github-runner-207 kernel: [16252.622896] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 09:54:38 juju-e4d256-prod-github-runner-207 kernel: [16252.623785] Aug 22 09:55:06 juju-e4d256-prod-github-runner-207 kernel: [16280.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 15054s! [qemu-system-x86:6715] Aug 22 09:55:06 juju-e4d256-prod-github-runner-207 kernel: [16280.543095] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 09:55:06 juju-e4d256-prod-github-runner-207 kernel: [16280.543164] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 09:55:06 juju-e4d256-prod-github-runner-207 kernel: [16280.555644] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 09:55:06 juju-e4d256-prod-github-runner-207 kernel: [16280.556920] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 09:55:06 juju-e4d256-prod-github-runner-207 kernel: [16280.558136] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:55:06 juju-e4d256-prod-github-runner-207 kernel: [16280.559190] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 09:55:06 juju-e4d256-prod-github-runner-207 kernel: [16280.561740] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 09:55:06 juju-e4d256-prod-github-runner-207 kernel: [16280.562786] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 09:55:06 juju-e4d256-prod-github-runner-207 kernel: [16280.563943] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 09:55:06 juju-e4d256-prod-github-runner-207 kernel: [16280.565113] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 09:55:06 juju-e4d256-prod-github-runner-207 kernel: [16280.566271] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 09:55:06 juju-e4d256-prod-github-runner-207 kernel: [16280.567427] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 09:55:06 juju-e4d256-prod-github-runner-207 kernel: [16280.568598] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 09:55:06 juju-e4d256-prod-github-runner-207 kernel: [16280.569845] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 09:55:06 juju-e4d256-prod-github-runner-207 kernel: [16280.570940] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 09:55:06 juju-e4d256-prod-github-runner-207 kernel: [16280.572140] Call Trace: Aug 22 09:55:06 juju-e4d256-prod-github-runner-207 kernel: [16280.573067] Aug 22 09:55:06 juju-e4d256-prod-github-runner-207 kernel: [16280.573955] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:55:06 juju-e4d256-prod-github-runner-207 kernel: [16280.574995] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:55:06 juju-e4d256-prod-github-runner-207 kernel: [16280.576018] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:55:06 juju-e4d256-prod-github-runner-207 kernel: [16280.577118] ? show_regs.part.0+0x23/0x29 Aug 22 09:55:06 juju-e4d256-prod-github-runner-207 kernel: [16280.578126] ? show_regs.cold+0x8/0xd Aug 22 09:55:06 juju-e4d256-prod-github-runner-207 kernel: [16280.579106] ? watchdog_timer_fn+0x1be/0x220 Aug 22 09:55:06 juju-e4d256-prod-github-runner-207 kernel: [16280.580122] ? lockup_detector_update_enable+0x60/0x60 Aug 22 09:55:06 juju-e4d256-prod-github-runner-207 kernel: [16280.581207] ? __hrtimer_run_queues+0x107/0x230 Aug 22 09:55:06 juju-e4d256-prod-github-runner-207 kernel: [16280.582246] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 09:55:06 juju-e4d256-prod-github-runner-207 kernel: [16280.583334] ? hrtimer_interrupt+0x101/0x220 Aug 22 09:55:06 juju-e4d256-prod-github-runner-207 kernel: [16280.584363] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 09:55:06 juju-e4d256-prod-github-runner-207 kernel: [16280.585457] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 09:55:06 juju-e4d256-prod-github-runner-207 kernel: [16280.586515] Aug 22 09:55:06 juju-e4d256-prod-github-runner-207 kernel: [16280.587378] Aug 22 09:55:06 juju-e4d256-prod-github-runner-207 kernel: [16280.588213] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 09:55:06 juju-e4d256-prod-github-runner-207 kernel: [16280.589256] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:55:06 juju-e4d256-prod-github-runner-207 kernel: [16280.590294] ? _raw_spin_lock+0x22/0x30 Aug 22 09:55:06 juju-e4d256-prod-github-runner-207 kernel: [16280.591241] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:55:06 juju-e4d256-prod-github-runner-207 kernel: [16280.592261] direct_page_fault+0x206/0x310 [kvm] Aug 22 09:55:06 juju-e4d256-prod-github-runner-207 kernel: [16280.593294] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 09:55:06 juju-e4d256-prod-github-runner-207 kernel: [16280.594304] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 09:55:06 juju-e4d256-prod-github-runner-207 kernel: [16280.595300] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 09:55:06 juju-e4d256-prod-github-runner-207 kernel: [16280.596265] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 09:55:06 juju-e4d256-prod-github-runner-207 kernel: [16280.597223] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 09:55:06 juju-e4d256-prod-github-runner-207 kernel: [16280.598206] handle_exit+0x98/0x230 [kvm_amd] Aug 22 09:55:06 juju-e4d256-prod-github-runner-207 kernel: [16280.599096] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 09:55:06 juju-e4d256-prod-github-runner-207 kernel: [16280.600007] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 09:55:06 juju-e4d256-prod-github-runner-207 kernel: [16280.600957] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 09:55:06 juju-e4d256-prod-github-runner-207 kernel: [16280.601859] vcpu_run+0x62/0x2c0 [kvm] Aug 22 09:55:06 juju-e4d256-prod-github-runner-207 kernel: [16280.602669] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 09:55:06 juju-e4d256-prod-github-runner-207 kernel: [16280.603474] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 09:55:06 juju-e4d256-prod-github-runner-207 kernel: [16280.604324] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 09:55:06 juju-e4d256-prod-github-runner-207 kernel: [16280.605127] ? __seccomp_filter+0x4a/0x4a0 Aug 22 09:55:06 juju-e4d256-prod-github-runner-207 kernel: [16280.605867] ? __fget_files+0x86/0xc0 Aug 22 09:55:06 juju-e4d256-prod-github-runner-207 kernel: [16280.606567] __x64_sys_ioctl+0x95/0xd0 Aug 22 09:55:06 juju-e4d256-prod-github-runner-207 kernel: [16280.607259] do_syscall_64+0x5c/0xc0 Aug 22 09:55:06 juju-e4d256-prod-github-runner-207 kernel: [16280.608048] ? do_futex+0x162/0x1f0 Aug 22 09:55:06 juju-e4d256-prod-github-runner-207 kernel: [16280.608782] ? __x64_sys_futex+0x78/0x1e0 Aug 22 09:55:06 juju-e4d256-prod-github-runner-207 kernel: [16280.609548] ? __secure_computing+0xa9/0x120 Aug 22 09:55:06 juju-e4d256-prod-github-runner-207 kernel: [16280.610324] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 09:55:06 juju-e4d256-prod-github-runner-207 kernel: [16280.611193] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:55:06 juju-e4d256-prod-github-runner-207 kernel: [16280.612012] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:55:06 juju-e4d256-prod-github-runner-207 kernel: [16280.612852] ? do_syscall_64+0x69/0xc0 Aug 22 09:55:06 juju-e4d256-prod-github-runner-207 kernel: [16280.613576] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:55:06 juju-e4d256-prod-github-runner-207 kernel: [16280.614378] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:55:06 juju-e4d256-prod-github-runner-207 kernel: [16280.615171] ? do_syscall_64+0x69/0xc0 Aug 22 09:55:06 juju-e4d256-prod-github-runner-207 kernel: [16280.615870] ? do_syscall_64+0x69/0xc0 Aug 22 09:55:06 juju-e4d256-prod-github-runner-207 kernel: [16280.616569] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 09:55:06 juju-e4d256-prod-github-runner-207 kernel: [16280.617389] RIP: 0033:0x7faa5d0edaff Aug 22 09:55:06 juju-e4d256-prod-github-runner-207 kernel: [16280.618089] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 09:55:06 juju-e4d256-prod-github-runner-207 kernel: [16280.620412] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 09:55:06 juju-e4d256-prod-github-runner-207 kernel: [16280.621482] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 09:55:06 juju-e4d256-prod-github-runner-207 kernel: [16280.622506] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 09:55:06 juju-e4d256-prod-github-runner-207 kernel: [16280.623532] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 09:55:06 juju-e4d256-prod-github-runner-207 kernel: [16280.624558] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 09:55:06 juju-e4d256-prod-github-runner-207 kernel: [16280.625605] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 09:55:06 juju-e4d256-prod-github-runner-207 kernel: [16280.626636] Aug 22 09:55:34 juju-e4d256-prod-github-runner-207 kernel: [16308.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 15080s! [qemu-system-x86:6715] Aug 22 09:55:34 juju-e4d256-prod-github-runner-207 kernel: [16308.543125] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 09:55:34 juju-e4d256-prod-github-runner-207 kernel: [16308.543191] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 09:55:34 juju-e4d256-prod-github-runner-207 kernel: [16308.555589] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 09:55:34 juju-e4d256-prod-github-runner-207 kernel: [16308.556904] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 09:55:34 juju-e4d256-prod-github-runner-207 kernel: [16308.558153] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:55:34 juju-e4d256-prod-github-runner-207 kernel: [16308.559233] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 09:55:34 juju-e4d256-prod-github-runner-207 kernel: [16308.561845] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 09:55:34 juju-e4d256-prod-github-runner-207 kernel: [16308.562905] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 09:55:34 juju-e4d256-prod-github-runner-207 kernel: [16308.564090] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 09:55:34 juju-e4d256-prod-github-runner-207 kernel: [16308.565292] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 09:55:34 juju-e4d256-prod-github-runner-207 kernel: [16308.566485] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 09:55:34 juju-e4d256-prod-github-runner-207 kernel: [16308.567662] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 09:55:34 juju-e4d256-prod-github-runner-207 kernel: [16308.568871] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 09:55:34 juju-e4d256-prod-github-runner-207 kernel: [16308.570137] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 09:55:34 juju-e4d256-prod-github-runner-207 kernel: [16308.571250] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 09:55:34 juju-e4d256-prod-github-runner-207 kernel: [16308.572464] Call Trace: Aug 22 09:55:34 juju-e4d256-prod-github-runner-207 kernel: [16308.573397] Aug 22 09:55:34 juju-e4d256-prod-github-runner-207 kernel: [16308.574286] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:55:34 juju-e4d256-prod-github-runner-207 kernel: [16308.575339] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:55:34 juju-e4d256-prod-github-runner-207 kernel: [16308.576375] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:55:34 juju-e4d256-prod-github-runner-207 kernel: [16308.577475] ? show_regs.part.0+0x23/0x29 Aug 22 09:55:34 juju-e4d256-prod-github-runner-207 kernel: [16308.578486] ? show_regs.cold+0x8/0xd Aug 22 09:55:34 juju-e4d256-prod-github-runner-207 kernel: [16308.579465] ? watchdog_timer_fn+0x1be/0x220 Aug 22 09:55:34 juju-e4d256-prod-github-runner-207 kernel: [16308.580501] ? lockup_detector_update_enable+0x60/0x60 Aug 22 09:55:34 juju-e4d256-prod-github-runner-207 kernel: [16308.581592] ? __hrtimer_run_queues+0x107/0x230 Aug 22 09:55:34 juju-e4d256-prod-github-runner-207 kernel: [16308.582630] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 09:55:34 juju-e4d256-prod-github-runner-207 kernel: [16308.583672] ? hrtimer_interrupt+0x101/0x220 Aug 22 09:55:34 juju-e4d256-prod-github-runner-207 kernel: [16308.584748] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 09:55:34 juju-e4d256-prod-github-runner-207 kernel: [16308.585890] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 09:55:34 juju-e4d256-prod-github-runner-207 kernel: [16308.586967] Aug 22 09:55:34 juju-e4d256-prod-github-runner-207 kernel: [16308.587826] Aug 22 09:55:34 juju-e4d256-prod-github-runner-207 kernel: [16308.588700] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 09:55:34 juju-e4d256-prod-github-runner-207 kernel: [16308.589771] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:55:34 juju-e4d256-prod-github-runner-207 kernel: [16308.590829] ? _raw_spin_lock+0x22/0x30 Aug 22 09:55:34 juju-e4d256-prod-github-runner-207 kernel: [16308.591783] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:55:34 juju-e4d256-prod-github-runner-207 kernel: [16308.592847] direct_page_fault+0x206/0x310 [kvm] Aug 22 09:55:34 juju-e4d256-prod-github-runner-207 kernel: [16308.593903] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 09:55:34 juju-e4d256-prod-github-runner-207 kernel: [16308.594933] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 09:55:34 juju-e4d256-prod-github-runner-207 kernel: [16308.595953] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 09:55:34 juju-e4d256-prod-github-runner-207 kernel: [16308.596959] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 09:55:34 juju-e4d256-prod-github-runner-207 kernel: [16308.597925] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 09:55:34 juju-e4d256-prod-github-runner-207 kernel: [16308.598928] handle_exit+0x98/0x230 [kvm_amd] Aug 22 09:55:34 juju-e4d256-prod-github-runner-207 kernel: [16308.599835] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 09:55:34 juju-e4d256-prod-github-runner-207 kernel: [16308.600784] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 09:55:34 juju-e4d256-prod-github-runner-207 kernel: [16308.601727] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 09:55:34 juju-e4d256-prod-github-runner-207 kernel: [16308.602652] vcpu_run+0x62/0x2c0 [kvm] Aug 22 09:55:34 juju-e4d256-prod-github-runner-207 kernel: [16308.603476] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 09:55:34 juju-e4d256-prod-github-runner-207 kernel: [16308.604297] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 09:55:34 juju-e4d256-prod-github-runner-207 kernel: [16308.605179] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 09:55:34 juju-e4d256-prod-github-runner-207 kernel: [16308.605991] ? __seccomp_filter+0x4a/0x4a0 Aug 22 09:55:34 juju-e4d256-prod-github-runner-207 kernel: [16308.606746] ? __fget_files+0x86/0xc0 Aug 22 09:55:34 juju-e4d256-prod-github-runner-207 kernel: [16308.607462] __x64_sys_ioctl+0x95/0xd0 Aug 22 09:55:34 juju-e4d256-prod-github-runner-207 kernel: [16308.608165] do_syscall_64+0x5c/0xc0 Aug 22 09:55:34 juju-e4d256-prod-github-runner-207 kernel: [16308.609047] ? do_futex+0x162/0x1f0 Aug 22 09:55:34 juju-e4d256-prod-github-runner-207 kernel: [16308.609706] ? __x64_sys_futex+0x78/0x1e0 Aug 22 09:55:34 juju-e4d256-prod-github-runner-207 kernel: [16308.610392] ? __secure_computing+0xa9/0x120 Aug 22 09:55:34 juju-e4d256-prod-github-runner-207 kernel: [16308.611113] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 09:55:34 juju-e4d256-prod-github-runner-207 kernel: [16308.611896] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:55:34 juju-e4d256-prod-github-runner-207 kernel: [16308.612651] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:55:34 juju-e4d256-prod-github-runner-207 kernel: [16308.613396] ? do_syscall_64+0x69/0xc0 Aug 22 09:55:34 juju-e4d256-prod-github-runner-207 kernel: [16308.614055] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:55:34 juju-e4d256-prod-github-runner-207 kernel: [16308.614774] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:55:34 juju-e4d256-prod-github-runner-207 kernel: [16308.615522] ? do_syscall_64+0x69/0xc0 Aug 22 09:55:34 juju-e4d256-prod-github-runner-207 kernel: [16308.616204] ? do_syscall_64+0x69/0xc0 Aug 22 09:55:34 juju-e4d256-prod-github-runner-207 kernel: [16308.617102] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 09:55:34 juju-e4d256-prod-github-runner-207 kernel: [16308.617830] RIP: 0033:0x7faa5d0edaff Aug 22 09:55:34 juju-e4d256-prod-github-runner-207 kernel: [16308.618470] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 09:55:34 juju-e4d256-prod-github-runner-207 kernel: [16308.620529] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 09:55:34 juju-e4d256-prod-github-runner-207 kernel: [16308.621477] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 09:55:34 juju-e4d256-prod-github-runner-207 kernel: [16308.622385] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 09:55:34 juju-e4d256-prod-github-runner-207 kernel: [16308.623296] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 09:55:34 juju-e4d256-prod-github-runner-207 kernel: [16308.624204] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 09:55:34 juju-e4d256-prod-github-runner-207 kernel: [16308.625135] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 09:55:34 juju-e4d256-prod-github-runner-207 kernel: [16308.626052] Aug 22 09:56:02 juju-e4d256-prod-github-runner-207 kernel: [16336.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 15106s! [qemu-system-x86:6715] Aug 22 09:56:02 juju-e4d256-prod-github-runner-207 kernel: [16336.543688] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 09:56:02 juju-e4d256-prod-github-runner-207 kernel: [16336.543925] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 09:56:02 juju-e4d256-prod-github-runner-207 kernel: [16336.556177] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 09:56:02 juju-e4d256-prod-github-runner-207 kernel: [16336.557442] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 09:56:02 juju-e4d256-prod-github-runner-207 kernel: [16336.558662] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:56:02 juju-e4d256-prod-github-runner-207 kernel: [16336.559718] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 09:56:02 juju-e4d256-prod-github-runner-207 kernel: [16336.562344] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 09:56:02 juju-e4d256-prod-github-runner-207 kernel: [16336.563385] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 09:56:02 juju-e4d256-prod-github-runner-207 kernel: [16336.564549] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 09:56:02 juju-e4d256-prod-github-runner-207 kernel: [16336.565711] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 09:56:02 juju-e4d256-prod-github-runner-207 kernel: [16336.566881] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 09:56:02 juju-e4d256-prod-github-runner-207 kernel: [16336.568041] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 09:56:02 juju-e4d256-prod-github-runner-207 kernel: [16336.569219] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 09:56:02 juju-e4d256-prod-github-runner-207 kernel: [16336.570449] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 09:56:02 juju-e4d256-prod-github-runner-207 kernel: [16336.571546] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 09:56:02 juju-e4d256-prod-github-runner-207 kernel: [16336.572745] Call Trace: Aug 22 09:56:02 juju-e4d256-prod-github-runner-207 kernel: [16336.573657] Aug 22 09:56:02 juju-e4d256-prod-github-runner-207 kernel: [16336.574549] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:56:02 juju-e4d256-prod-github-runner-207 kernel: [16336.575575] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:56:02 juju-e4d256-prod-github-runner-207 kernel: [16336.576618] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:56:02 juju-e4d256-prod-github-runner-207 kernel: [16336.577709] ? show_regs.part.0+0x23/0x29 Aug 22 09:56:02 juju-e4d256-prod-github-runner-207 kernel: [16336.578703] ? show_regs.cold+0x8/0xd Aug 22 09:56:02 juju-e4d256-prod-github-runner-207 kernel: [16336.579672] ? watchdog_timer_fn+0x1be/0x220 Aug 22 09:56:02 juju-e4d256-prod-github-runner-207 kernel: [16336.580691] ? lockup_detector_update_enable+0x60/0x60 Aug 22 09:56:02 juju-e4d256-prod-github-runner-207 kernel: [16336.581759] ? __hrtimer_run_queues+0x107/0x230 Aug 22 09:56:02 juju-e4d256-prod-github-runner-207 kernel: [16336.582808] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 09:56:02 juju-e4d256-prod-github-runner-207 kernel: [16336.583978] ? hrtimer_interrupt+0x101/0x220 Aug 22 09:56:02 juju-e4d256-prod-github-runner-207 kernel: [16336.585005] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 09:56:02 juju-e4d256-prod-github-runner-207 kernel: [16336.586074] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 09:56:02 juju-e4d256-prod-github-runner-207 kernel: [16336.587136] Aug 22 09:56:02 juju-e4d256-prod-github-runner-207 kernel: [16336.587997] Aug 22 09:56:02 juju-e4d256-prod-github-runner-207 kernel: [16336.588842] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 09:56:02 juju-e4d256-prod-github-runner-207 kernel: [16336.589877] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:56:02 juju-e4d256-prod-github-runner-207 kernel: [16336.590916] ? _raw_spin_lock+0x22/0x30 Aug 22 09:56:02 juju-e4d256-prod-github-runner-207 kernel: [16336.591867] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:56:02 juju-e4d256-prod-github-runner-207 kernel: [16336.592889] direct_page_fault+0x206/0x310 [kvm] Aug 22 09:56:02 juju-e4d256-prod-github-runner-207 kernel: [16336.593918] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 09:56:02 juju-e4d256-prod-github-runner-207 kernel: [16336.594926] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 09:56:02 juju-e4d256-prod-github-runner-207 kernel: [16336.595926] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 09:56:02 juju-e4d256-prod-github-runner-207 kernel: [16336.596926] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 09:56:02 juju-e4d256-prod-github-runner-207 kernel: [16336.597879] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 09:56:02 juju-e4d256-prod-github-runner-207 kernel: [16336.598854] handle_exit+0x98/0x230 [kvm_amd] Aug 22 09:56:02 juju-e4d256-prod-github-runner-207 kernel: [16336.599745] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 09:56:02 juju-e4d256-prod-github-runner-207 kernel: [16336.600663] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 09:56:02 juju-e4d256-prod-github-runner-207 kernel: [16336.601592] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 09:56:02 juju-e4d256-prod-github-runner-207 kernel: [16336.602495] vcpu_run+0x62/0x2c0 [kvm] Aug 22 09:56:02 juju-e4d256-prod-github-runner-207 kernel: [16336.603303] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 09:56:02 juju-e4d256-prod-github-runner-207 kernel: [16336.604114] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 09:56:02 juju-e4d256-prod-github-runner-207 kernel: [16336.604976] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 09:56:02 juju-e4d256-prod-github-runner-207 kernel: [16336.605774] ? __seccomp_filter+0x4a/0x4a0 Aug 22 09:56:02 juju-e4d256-prod-github-runner-207 kernel: [16336.606514] ? __fget_files+0x86/0xc0 Aug 22 09:56:02 juju-e4d256-prod-github-runner-207 kernel: [16336.607226] __x64_sys_ioctl+0x95/0xd0 Aug 22 09:56:02 juju-e4d256-prod-github-runner-207 kernel: [16336.607922] do_syscall_64+0x5c/0xc0 Aug 22 09:56:02 juju-e4d256-prod-github-runner-207 kernel: [16336.608593] ? do_futex+0x162/0x1f0 Aug 22 09:56:02 juju-e4d256-prod-github-runner-207 kernel: [16336.609243] ? __x64_sys_futex+0x78/0x1e0 Aug 22 09:56:02 juju-e4d256-prod-github-runner-207 kernel: [16336.609920] ? __secure_computing+0xa9/0x120 Aug 22 09:56:02 juju-e4d256-prod-github-runner-207 kernel: [16336.610608] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 09:56:02 juju-e4d256-prod-github-runner-207 kernel: [16336.611365] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:56:02 juju-e4d256-prod-github-runner-207 kernel: [16336.612092] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:56:02 juju-e4d256-prod-github-runner-207 kernel: [16336.612828] ? do_syscall_64+0x69/0xc0 Aug 22 09:56:02 juju-e4d256-prod-github-runner-207 kernel: [16336.613472] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:56:02 juju-e4d256-prod-github-runner-207 kernel: [16336.614180] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:56:02 juju-e4d256-prod-github-runner-207 kernel: [16336.614875] ? do_syscall_64+0x69/0xc0 Aug 22 09:56:02 juju-e4d256-prod-github-runner-207 kernel: [16336.615499] ? do_syscall_64+0x69/0xc0 Aug 22 09:56:02 juju-e4d256-prod-github-runner-207 kernel: [16336.616121] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 09:56:02 juju-e4d256-prod-github-runner-207 kernel: [16336.616847] RIP: 0033:0x7faa5d0edaff Aug 22 09:56:02 juju-e4d256-prod-github-runner-207 kernel: [16336.617502] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 09:56:02 juju-e4d256-prod-github-runner-207 kernel: [16336.619498] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 09:56:02 juju-e4d256-prod-github-runner-207 kernel: [16336.620425] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 09:56:02 juju-e4d256-prod-github-runner-207 kernel: [16336.621318] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 09:56:02 juju-e4d256-prod-github-runner-207 kernel: [16336.622213] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 09:56:02 juju-e4d256-prod-github-runner-207 kernel: [16336.623100] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 09:56:02 juju-e4d256-prod-github-runner-207 kernel: [16336.623986] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 09:56:02 juju-e4d256-prod-github-runner-207 kernel: [16336.624887] Aug 22 09:56:30 juju-e4d256-prod-github-runner-207 kernel: [16364.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 15132s! [qemu-system-x86:6715] Aug 22 09:56:30 juju-e4d256-prod-github-runner-207 kernel: [16364.543103] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 09:56:30 juju-e4d256-prod-github-runner-207 kernel: [16364.543169] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 09:56:30 juju-e4d256-prod-github-runner-207 kernel: [16364.555489] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 09:56:30 juju-e4d256-prod-github-runner-207 kernel: [16364.556777] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 09:56:30 juju-e4d256-prod-github-runner-207 kernel: [16364.557996] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:56:30 juju-e4d256-prod-github-runner-207 kernel: [16364.559051] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 09:56:30 juju-e4d256-prod-github-runner-207 kernel: [16364.561600] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 09:56:30 juju-e4d256-prod-github-runner-207 kernel: [16364.562644] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 09:56:30 juju-e4d256-prod-github-runner-207 kernel: [16364.563812] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 09:56:30 juju-e4d256-prod-github-runner-207 kernel: [16364.564969] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 09:56:30 juju-e4d256-prod-github-runner-207 kernel: [16364.566126] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 09:56:30 juju-e4d256-prod-github-runner-207 kernel: [16364.567285] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 09:56:30 juju-e4d256-prod-github-runner-207 kernel: [16364.568461] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 09:56:30 juju-e4d256-prod-github-runner-207 kernel: [16364.569694] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 09:56:30 juju-e4d256-prod-github-runner-207 kernel: [16364.570795] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 09:56:30 juju-e4d256-prod-github-runner-207 kernel: [16364.572010] Call Trace: Aug 22 09:56:30 juju-e4d256-prod-github-runner-207 kernel: [16364.572926] Aug 22 09:56:30 juju-e4d256-prod-github-runner-207 kernel: [16364.573813] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:56:30 juju-e4d256-prod-github-runner-207 kernel: [16364.574840] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:56:30 juju-e4d256-prod-github-runner-207 kernel: [16364.575871] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:56:30 juju-e4d256-prod-github-runner-207 kernel: [16364.576944] ? show_regs.part.0+0x23/0x29 Aug 22 09:56:30 juju-e4d256-prod-github-runner-207 kernel: [16364.577943] ? show_regs.cold+0x8/0xd Aug 22 09:56:30 juju-e4d256-prod-github-runner-207 kernel: [16364.578917] ? watchdog_timer_fn+0x1be/0x220 Aug 22 09:56:30 juju-e4d256-prod-github-runner-207 kernel: [16364.579942] ? lockup_detector_update_enable+0x60/0x60 Aug 22 09:56:30 juju-e4d256-prod-github-runner-207 kernel: [16364.581003] ? __hrtimer_run_queues+0x107/0x230 Aug 22 09:56:30 juju-e4d256-prod-github-runner-207 kernel: [16364.582034] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 09:56:30 juju-e4d256-prod-github-runner-207 kernel: [16364.583055] ? hrtimer_interrupt+0x101/0x220 Aug 22 09:56:30 juju-e4d256-prod-github-runner-207 kernel: [16364.584086] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 09:56:30 juju-e4d256-prod-github-runner-207 kernel: [16364.585157] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 09:56:30 juju-e4d256-prod-github-runner-207 kernel: [16364.586200] Aug 22 09:56:30 juju-e4d256-prod-github-runner-207 kernel: [16364.587051] Aug 22 09:56:30 juju-e4d256-prod-github-runner-207 kernel: [16364.587904] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 09:56:30 juju-e4d256-prod-github-runner-207 kernel: [16364.588943] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:56:30 juju-e4d256-prod-github-runner-207 kernel: [16364.590167] ? _raw_spin_lock+0x22/0x30 Aug 22 09:56:30 juju-e4d256-prod-github-runner-207 kernel: [16364.591109] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:56:30 juju-e4d256-prod-github-runner-207 kernel: [16364.592138] direct_page_fault+0x206/0x310 [kvm] Aug 22 09:56:30 juju-e4d256-prod-github-runner-207 kernel: [16364.593161] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 09:56:30 juju-e4d256-prod-github-runner-207 kernel: [16364.594171] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 09:56:30 juju-e4d256-prod-github-runner-207 kernel: [16364.595175] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 09:56:30 juju-e4d256-prod-github-runner-207 kernel: [16364.596165] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 09:56:30 juju-e4d256-prod-github-runner-207 kernel: [16364.597113] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 09:56:30 juju-e4d256-prod-github-runner-207 kernel: [16364.598092] handle_exit+0x98/0x230 [kvm_amd] Aug 22 09:56:30 juju-e4d256-prod-github-runner-207 kernel: [16364.598981] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 09:56:30 juju-e4d256-prod-github-runner-207 kernel: [16364.599911] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 09:56:30 juju-e4d256-prod-github-runner-207 kernel: [16364.600832] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 09:56:30 juju-e4d256-prod-github-runner-207 kernel: [16364.601733] vcpu_run+0x62/0x2c0 [kvm] Aug 22 09:56:30 juju-e4d256-prod-github-runner-207 kernel: [16364.602542] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 09:56:30 juju-e4d256-prod-github-runner-207 kernel: [16364.603346] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 09:56:30 juju-e4d256-prod-github-runner-207 kernel: [16364.604210] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 09:56:30 juju-e4d256-prod-github-runner-207 kernel: [16364.605005] ? __seccomp_filter+0x4a/0x4a0 Aug 22 09:56:30 juju-e4d256-prod-github-runner-207 kernel: [16364.605744] ? __fget_files+0x86/0xc0 Aug 22 09:56:30 juju-e4d256-prod-github-runner-207 kernel: [16364.606446] __x64_sys_ioctl+0x95/0xd0 Aug 22 09:56:30 juju-e4d256-prod-github-runner-207 kernel: [16364.607135] do_syscall_64+0x5c/0xc0 Aug 22 09:56:30 juju-e4d256-prod-github-runner-207 kernel: [16364.607810] ? do_futex+0x162/0x1f0 Aug 22 09:56:30 juju-e4d256-prod-github-runner-207 kernel: [16364.608460] ? __x64_sys_futex+0x78/0x1e0 Aug 22 09:56:30 juju-e4d256-prod-github-runner-207 kernel: [16364.609136] ? __secure_computing+0xa9/0x120 Aug 22 09:56:30 juju-e4d256-prod-github-runner-207 kernel: [16364.609821] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 09:56:30 juju-e4d256-prod-github-runner-207 kernel: [16364.610582] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:56:30 juju-e4d256-prod-github-runner-207 kernel: [16364.611301] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:56:30 juju-e4d256-prod-github-runner-207 kernel: [16364.612030] ? do_syscall_64+0x69/0xc0 Aug 22 09:56:30 juju-e4d256-prod-github-runner-207 kernel: [16364.612672] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:56:30 juju-e4d256-prod-github-runner-207 kernel: [16364.613372] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:56:30 juju-e4d256-prod-github-runner-207 kernel: [16364.614074] ? do_syscall_64+0x69/0xc0 Aug 22 09:56:30 juju-e4d256-prod-github-runner-207 kernel: [16364.614695] ? do_syscall_64+0x69/0xc0 Aug 22 09:56:30 juju-e4d256-prod-github-runner-207 kernel: [16364.615314] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 09:56:30 juju-e4d256-prod-github-runner-207 kernel: [16364.616029] RIP: 0033:0x7faa5d0edaff Aug 22 09:56:30 juju-e4d256-prod-github-runner-207 kernel: [16364.616650] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 09:56:30 juju-e4d256-prod-github-runner-207 kernel: [16364.618628] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 09:56:30 juju-e4d256-prod-github-runner-207 kernel: [16364.619534] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 09:56:30 juju-e4d256-prod-github-runner-207 kernel: [16364.620441] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 09:56:30 juju-e4d256-prod-github-runner-207 kernel: [16364.621334] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 09:56:30 juju-e4d256-prod-github-runner-207 kernel: [16364.622226] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 09:56:30 juju-e4d256-prod-github-runner-207 kernel: [16364.623111] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 09:56:30 juju-e4d256-prod-github-runner-207 kernel: [16364.624016] Aug 22 09:56:44 juju-e4d256-prod-github-runner-207 kernel: [16378.280706] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 09:56:44 juju-e4d256-prod-github-runner-207 kernel: [16378.281666] rcu: 1-....: (4052547 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=1958263 Aug 22 09:56:44 juju-e4d256-prod-github-runner-207 kernel: [16378.282809] (t=4065270 jiffies g=23269 q=23339) Aug 22 09:56:44 juju-e4d256-prod-github-runner-207 kernel: [16378.283599] NMI backtrace for cpu 1 Aug 22 09:56:44 juju-e4d256-prod-github-runner-207 kernel: [16378.284341] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 09:56:44 juju-e4d256-prod-github-runner-207 kernel: [16378.285474] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 09:56:44 juju-e4d256-prod-github-runner-207 kernel: [16378.286563] Call Trace: Aug 22 09:56:44 juju-e4d256-prod-github-runner-207 kernel: [16378.287268] Aug 22 09:56:44 juju-e4d256-prod-github-runner-207 kernel: [16378.287942] show_stack+0x52/0x5c Aug 22 09:56:44 juju-e4d256-prod-github-runner-207 kernel: [16378.288680] dump_stack_lvl+0x4a/0x63 Aug 22 09:56:44 juju-e4d256-prod-github-runner-207 kernel: [16378.289455] dump_stack+0x10/0x16 Aug 22 09:56:44 juju-e4d256-prod-github-runner-207 kernel: [16378.290183] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 09:56:44 juju-e4d256-prod-github-runner-207 kernel: [16378.290972] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 09:56:44 juju-e4d256-prod-github-runner-207 kernel: [16378.291967] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 09:56:44 juju-e4d256-prod-github-runner-207 kernel: [16378.292805] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 09:56:44 juju-e4d256-prod-github-runner-207 kernel: [16378.293649] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 09:56:44 juju-e4d256-prod-github-runner-207 kernel: [16378.294488] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 09:56:44 juju-e4d256-prod-github-runner-207 kernel: [16378.295300] print_cpu_stall.cold+0x2f/0xe2 Aug 22 09:56:44 juju-e4d256-prod-github-runner-207 kernel: [16378.296100] ? timekeeping_update+0xf7/0x150 Aug 22 09:56:44 juju-e4d256-prod-github-runner-207 kernel: [16378.296885] check_cpu_stall+0x109/0x270 Aug 22 09:56:44 juju-e4d256-prod-github-runner-207 kernel: [16378.297674] rcu_sched_clock_irq+0x9a/0x250 Aug 22 09:56:44 juju-e4d256-prod-github-runner-207 kernel: [16378.298452] update_process_times+0x94/0xd0 Aug 22 09:56:44 juju-e4d256-prod-github-runner-207 kernel: [16378.299220] tick_sched_handle+0x29/0x70 Aug 22 09:56:44 juju-e4d256-prod-github-runner-207 kernel: [16378.299985] tick_sched_timer+0x8c/0xc0 Aug 22 09:56:44 juju-e4d256-prod-github-runner-207 kernel: [16378.300760] ? tick_nohz_handler+0xb0/0xb0 Aug 22 09:56:44 juju-e4d256-prod-github-runner-207 kernel: [16378.301528] __hrtimer_run_queues+0x107/0x230 Aug 22 09:56:44 juju-e4d256-prod-github-runner-207 kernel: [16378.302314] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 09:56:44 juju-e4d256-prod-github-runner-207 kernel: [16378.303113] hrtimer_interrupt+0x101/0x220 Aug 22 09:56:44 juju-e4d256-prod-github-runner-207 kernel: [16378.303930] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 09:56:44 juju-e4d256-prod-github-runner-207 kernel: [16378.304758] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 09:56:44 juju-e4d256-prod-github-runner-207 kernel: [16378.305571] Aug 22 09:56:44 juju-e4d256-prod-github-runner-207 kernel: [16378.306214] Aug 22 09:56:44 juju-e4d256-prod-github-runner-207 kernel: [16378.306883] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 09:56:44 juju-e4d256-prod-github-runner-207 kernel: [16378.307736] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:56:44 juju-e4d256-prod-github-runner-207 kernel: [16378.308652] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 09:56:44 juju-e4d256-prod-github-runner-207 kernel: [16378.310941] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 09:56:44 juju-e4d256-prod-github-runner-207 kernel: [16378.311860] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 09:56:44 juju-e4d256-prod-github-runner-207 kernel: [16378.312877] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 09:56:44 juju-e4d256-prod-github-runner-207 kernel: [16378.313875] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 09:56:44 juju-e4d256-prod-github-runner-207 kernel: [16378.314858] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 09:56:44 juju-e4d256-prod-github-runner-207 kernel: [16378.315870] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 09:56:44 juju-e4d256-prod-github-runner-207 kernel: [16378.316839] ? _raw_spin_lock+0x22/0x30 Aug 22 09:56:44 juju-e4d256-prod-github-runner-207 kernel: [16378.317611] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:56:44 juju-e4d256-prod-github-runner-207 kernel: [16378.318463] direct_page_fault+0x206/0x310 [kvm] Aug 22 09:56:44 juju-e4d256-prod-github-runner-207 kernel: [16378.319340] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 09:56:44 juju-e4d256-prod-github-runner-207 kernel: [16378.320188] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 09:56:44 juju-e4d256-prod-github-runner-207 kernel: [16378.321025] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 09:56:44 juju-e4d256-prod-github-runner-207 kernel: [16378.321864] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 09:56:44 juju-e4d256-prod-github-runner-207 kernel: [16378.322663] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 09:56:44 juju-e4d256-prod-github-runner-207 kernel: [16378.323506] handle_exit+0x98/0x230 [kvm_amd] Aug 22 09:56:44 juju-e4d256-prod-github-runner-207 kernel: [16378.324820] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 09:56:44 juju-e4d256-prod-github-runner-207 kernel: [16378.326021] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 09:56:44 juju-e4d256-prod-github-runner-207 kernel: [16378.327140] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 09:56:44 juju-e4d256-prod-github-runner-207 kernel: [16378.328249] vcpu_run+0x62/0x2c0 [kvm] Aug 22 09:56:44 juju-e4d256-prod-github-runner-207 kernel: [16378.329243] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 09:56:44 juju-e4d256-prod-github-runner-207 kernel: [16378.330219] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 09:56:44 juju-e4d256-prod-github-runner-207 kernel: [16378.331302] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 09:56:44 juju-e4d256-prod-github-runner-207 kernel: [16378.332347] ? __seccomp_filter+0x4a/0x4a0 Aug 22 09:56:44 juju-e4d256-prod-github-runner-207 kernel: [16378.333325] ? __fget_files+0x86/0xc0 Aug 22 09:56:44 juju-e4d256-prod-github-runner-207 kernel: [16378.334250] __x64_sys_ioctl+0x95/0xd0 Aug 22 09:56:44 juju-e4d256-prod-github-runner-207 kernel: [16378.335185] do_syscall_64+0x5c/0xc0 Aug 22 09:56:44 juju-e4d256-prod-github-runner-207 kernel: [16378.336119] ? do_futex+0x162/0x1f0 Aug 22 09:56:44 juju-e4d256-prod-github-runner-207 kernel: [16378.337036] ? __x64_sys_futex+0x78/0x1e0 Aug 22 09:56:44 juju-e4d256-prod-github-runner-207 kernel: [16378.338005] ? __secure_computing+0xa9/0x120 Aug 22 09:56:44 juju-e4d256-prod-github-runner-207 kernel: [16378.338969] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 09:56:44 juju-e4d256-prod-github-runner-207 kernel: [16378.340047] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:56:44 juju-e4d256-prod-github-runner-207 kernel: [16378.341069] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:56:44 juju-e4d256-prod-github-runner-207 kernel: [16378.342086] ? do_syscall_64+0x69/0xc0 Aug 22 09:56:44 juju-e4d256-prod-github-runner-207 kernel: [16378.343030] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:56:44 juju-e4d256-prod-github-runner-207 kernel: [16378.344057] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:56:44 juju-e4d256-prod-github-runner-207 kernel: [16378.345078] ? do_syscall_64+0x69/0xc0 Aug 22 09:56:44 juju-e4d256-prod-github-runner-207 kernel: [16378.346024] ? do_syscall_64+0x69/0xc0 Aug 22 09:56:44 juju-e4d256-prod-github-runner-207 kernel: [16378.346937] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 09:56:44 juju-e4d256-prod-github-runner-207 kernel: [16378.347932] RIP: 0033:0x7faa5d0edaff Aug 22 09:56:44 juju-e4d256-prod-github-runner-207 kernel: [16378.348684] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 09:56:44 juju-e4d256-prod-github-runner-207 kernel: [16378.350881] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 09:56:44 juju-e4d256-prod-github-runner-207 kernel: [16378.351960] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 09:56:44 juju-e4d256-prod-github-runner-207 kernel: [16378.352954] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 09:56:44 juju-e4d256-prod-github-runner-207 kernel: [16378.353945] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 09:56:44 juju-e4d256-prod-github-runner-207 kernel: [16378.354917] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 09:56:44 juju-e4d256-prod-github-runner-207 kernel: [16378.355895] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 09:56:44 juju-e4d256-prod-github-runner-207 kernel: [16378.356836] Aug 22 09:57:10 juju-e4d256-prod-github-runner-207 kernel: [16404.541976] watchdog: BUG: soft lockup - CPU#1 stuck for 15169s! [qemu-system-x86:6715] Aug 22 09:57:10 juju-e4d256-prod-github-runner-207 kernel: [16404.543189] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 09:57:10 juju-e4d256-prod-github-runner-207 kernel: [16404.543373] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 09:57:10 juju-e4d256-prod-github-runner-207 kernel: [16404.555482] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 09:57:10 juju-e4d256-prod-github-runner-207 kernel: [16404.556746] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 09:57:10 juju-e4d256-prod-github-runner-207 kernel: [16404.557970] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:57:10 juju-e4d256-prod-github-runner-207 kernel: [16404.559025] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 09:57:10 juju-e4d256-prod-github-runner-207 kernel: [16404.561589] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 09:57:10 juju-e4d256-prod-github-runner-207 kernel: [16404.562634] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 09:57:10 juju-e4d256-prod-github-runner-207 kernel: [16404.563805] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 09:57:10 juju-e4d256-prod-github-runner-207 kernel: [16404.564963] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 09:57:10 juju-e4d256-prod-github-runner-207 kernel: [16404.566127] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 09:57:10 juju-e4d256-prod-github-runner-207 kernel: [16404.567288] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 09:57:10 juju-e4d256-prod-github-runner-207 kernel: [16404.568480] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 09:57:10 juju-e4d256-prod-github-runner-207 kernel: [16404.569721] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 09:57:10 juju-e4d256-prod-github-runner-207 kernel: [16404.570819] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 09:57:10 juju-e4d256-prod-github-runner-207 kernel: [16404.572027] Call Trace: Aug 22 09:57:10 juju-e4d256-prod-github-runner-207 kernel: [16404.572944] Aug 22 09:57:10 juju-e4d256-prod-github-runner-207 kernel: [16404.573829] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:57:10 juju-e4d256-prod-github-runner-207 kernel: [16404.574864] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:57:10 juju-e4d256-prod-github-runner-207 kernel: [16404.575899] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:57:10 juju-e4d256-prod-github-runner-207 kernel: [16404.577008] ? show_regs.part.0+0x23/0x29 Aug 22 09:57:10 juju-e4d256-prod-github-runner-207 kernel: [16404.578003] ? show_regs.cold+0x8/0xd Aug 22 09:57:10 juju-e4d256-prod-github-runner-207 kernel: [16404.578977] ? watchdog_timer_fn+0x1be/0x220 Aug 22 09:57:10 juju-e4d256-prod-github-runner-207 kernel: [16404.579995] ? lockup_detector_update_enable+0x60/0x60 Aug 22 09:57:10 juju-e4d256-prod-github-runner-207 kernel: [16404.581057] ? __hrtimer_run_queues+0x107/0x230 Aug 22 09:57:10 juju-e4d256-prod-github-runner-207 kernel: [16404.582092] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 09:57:10 juju-e4d256-prod-github-runner-207 kernel: [16404.583115] ? hrtimer_interrupt+0x101/0x220 Aug 22 09:57:10 juju-e4d256-prod-github-runner-207 kernel: [16404.584141] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 09:57:10 juju-e4d256-prod-github-runner-207 kernel: [16404.585211] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 09:57:10 juju-e4d256-prod-github-runner-207 kernel: [16404.586258] Aug 22 09:57:10 juju-e4d256-prod-github-runner-207 kernel: [16404.587110] Aug 22 09:57:10 juju-e4d256-prod-github-runner-207 kernel: [16404.587955] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 09:57:10 juju-e4d256-prod-github-runner-207 kernel: [16404.588991] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:57:10 juju-e4d256-prod-github-runner-207 kernel: [16404.590027] ? _raw_spin_lock+0x22/0x30 Aug 22 09:57:10 juju-e4d256-prod-github-runner-207 kernel: [16404.590977] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:57:10 juju-e4d256-prod-github-runner-207 kernel: [16404.592004] direct_page_fault+0x206/0x310 [kvm] Aug 22 09:57:10 juju-e4d256-prod-github-runner-207 kernel: [16404.593028] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 09:57:10 juju-e4d256-prod-github-runner-207 kernel: [16404.594034] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 09:57:10 juju-e4d256-prod-github-runner-207 kernel: [16404.595043] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 09:57:10 juju-e4d256-prod-github-runner-207 kernel: [16404.596042] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 09:57:10 juju-e4d256-prod-github-runner-207 kernel: [16404.596992] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 09:57:10 juju-e4d256-prod-github-runner-207 kernel: [16404.597974] handle_exit+0x98/0x230 [kvm_amd] Aug 22 09:57:10 juju-e4d256-prod-github-runner-207 kernel: [16404.598866] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 09:57:10 juju-e4d256-prod-github-runner-207 kernel: [16404.599790] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 09:57:10 juju-e4d256-prod-github-runner-207 kernel: [16404.600714] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 09:57:10 juju-e4d256-prod-github-runner-207 kernel: [16404.601616] vcpu_run+0x62/0x2c0 [kvm] Aug 22 09:57:10 juju-e4d256-prod-github-runner-207 kernel: [16404.602425] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 09:57:10 juju-e4d256-prod-github-runner-207 kernel: [16404.603233] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 09:57:10 juju-e4d256-prod-github-runner-207 kernel: [16404.604101] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 09:57:10 juju-e4d256-prod-github-runner-207 kernel: [16404.604896] ? __seccomp_filter+0x4a/0x4a0 Aug 22 09:57:10 juju-e4d256-prod-github-runner-207 kernel: [16404.605644] ? __fget_files+0x86/0xc0 Aug 22 09:57:10 juju-e4d256-prod-github-runner-207 kernel: [16404.606347] __x64_sys_ioctl+0x95/0xd0 Aug 22 09:57:10 juju-e4d256-prod-github-runner-207 kernel: [16404.607052] do_syscall_64+0x5c/0xc0 Aug 22 09:57:10 juju-e4d256-prod-github-runner-207 kernel: [16404.607736] ? do_futex+0x162/0x1f0 Aug 22 09:57:10 juju-e4d256-prod-github-runner-207 kernel: [16404.608384] ? __x64_sys_futex+0x78/0x1e0 Aug 22 09:57:10 juju-e4d256-prod-github-runner-207 kernel: [16404.609058] ? __secure_computing+0xa9/0x120 Aug 22 09:57:10 juju-e4d256-prod-github-runner-207 kernel: [16404.609750] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 09:57:10 juju-e4d256-prod-github-runner-207 kernel: [16404.610508] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:57:10 juju-e4d256-prod-github-runner-207 kernel: [16404.611227] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:57:10 juju-e4d256-prod-github-runner-207 kernel: [16404.611957] ? do_syscall_64+0x69/0xc0 Aug 22 09:57:10 juju-e4d256-prod-github-runner-207 kernel: [16404.612605] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:57:10 juju-e4d256-prod-github-runner-207 kernel: [16404.613304] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:57:10 juju-e4d256-prod-github-runner-207 kernel: [16404.613996] ? do_syscall_64+0x69/0xc0 Aug 22 09:57:10 juju-e4d256-prod-github-runner-207 kernel: [16404.614626] ? do_syscall_64+0x69/0xc0 Aug 22 09:57:10 juju-e4d256-prod-github-runner-207 kernel: [16404.615247] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 09:57:10 juju-e4d256-prod-github-runner-207 kernel: [16404.616047] RIP: 0033:0x7faa5d0edaff Aug 22 09:57:10 juju-e4d256-prod-github-runner-207 kernel: [16404.616682] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 09:57:10 juju-e4d256-prod-github-runner-207 kernel: [16404.618667] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 09:57:10 juju-e4d256-prod-github-runner-207 kernel: [16404.619602] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 09:57:10 juju-e4d256-prod-github-runner-207 kernel: [16404.620493] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 09:57:10 juju-e4d256-prod-github-runner-207 kernel: [16404.621383] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 09:57:10 juju-e4d256-prod-github-runner-207 kernel: [16404.622267] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 09:57:10 juju-e4d256-prod-github-runner-207 kernel: [16404.623158] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 09:57:10 juju-e4d256-prod-github-runner-207 kernel: [16404.624064] Aug 22 09:57:38 juju-e4d256-prod-github-runner-207 kernel: [16432.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 15195s! [qemu-system-x86:6715] Aug 22 09:57:38 juju-e4d256-prod-github-runner-207 kernel: [16432.543710] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 09:57:38 juju-e4d256-prod-github-runner-207 kernel: [16432.543897] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 09:57:38 juju-e4d256-prod-github-runner-207 kernel: [16432.558528] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 09:57:38 juju-e4d256-prod-github-runner-207 kernel: [16432.559809] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 09:57:38 juju-e4d256-prod-github-runner-207 kernel: [16432.561031] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:57:38 juju-e4d256-prod-github-runner-207 kernel: [16432.562094] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 09:57:38 juju-e4d256-prod-github-runner-207 kernel: [16432.564660] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 09:57:38 juju-e4d256-prod-github-runner-207 kernel: [16432.565706] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 09:57:38 juju-e4d256-prod-github-runner-207 kernel: [16432.566871] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 09:57:38 juju-e4d256-prod-github-runner-207 kernel: [16432.568042] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 09:57:38 juju-e4d256-prod-github-runner-207 kernel: [16432.569199] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 09:57:38 juju-e4d256-prod-github-runner-207 kernel: [16432.570364] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 09:57:38 juju-e4d256-prod-github-runner-207 kernel: [16432.571544] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 09:57:38 juju-e4d256-prod-github-runner-207 kernel: [16432.572779] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 09:57:38 juju-e4d256-prod-github-runner-207 kernel: [16432.573877] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 09:57:38 juju-e4d256-prod-github-runner-207 kernel: [16432.575084] Call Trace: Aug 22 09:57:38 juju-e4d256-prod-github-runner-207 kernel: [16432.576000] Aug 22 09:57:38 juju-e4d256-prod-github-runner-207 kernel: [16432.576891] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:57:38 juju-e4d256-prod-github-runner-207 kernel: [16432.577926] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:57:38 juju-e4d256-prod-github-runner-207 kernel: [16432.578947] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:57:38 juju-e4d256-prod-github-runner-207 kernel: [16432.580035] ? show_regs.part.0+0x23/0x29 Aug 22 09:57:38 juju-e4d256-prod-github-runner-207 kernel: [16432.581031] ? show_regs.cold+0x8/0xd Aug 22 09:57:38 juju-e4d256-prod-github-runner-207 kernel: [16432.582004] ? watchdog_timer_fn+0x1be/0x220 Aug 22 09:57:38 juju-e4d256-prod-github-runner-207 kernel: [16432.583030] ? lockup_detector_update_enable+0x60/0x60 Aug 22 09:57:38 juju-e4d256-prod-github-runner-207 kernel: [16432.584099] ? __hrtimer_run_queues+0x107/0x230 Aug 22 09:57:38 juju-e4d256-prod-github-runner-207 kernel: [16432.585127] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 09:57:38 juju-e4d256-prod-github-runner-207 kernel: [16432.586152] ? hrtimer_interrupt+0x101/0x220 Aug 22 09:57:38 juju-e4d256-prod-github-runner-207 kernel: [16432.587187] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 09:57:38 juju-e4d256-prod-github-runner-207 kernel: [16432.588258] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 09:57:38 juju-e4d256-prod-github-runner-207 kernel: [16432.589307] Aug 22 09:57:38 juju-e4d256-prod-github-runner-207 kernel: [16432.590161] Aug 22 09:57:38 juju-e4d256-prod-github-runner-207 kernel: [16432.591011] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 09:57:38 juju-e4d256-prod-github-runner-207 kernel: [16432.592057] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:57:38 juju-e4d256-prod-github-runner-207 kernel: [16432.593099] ? _raw_spin_lock+0x22/0x30 Aug 22 09:57:38 juju-e4d256-prod-github-runner-207 kernel: [16432.594056] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:57:38 juju-e4d256-prod-github-runner-207 kernel: [16432.595095] direct_page_fault+0x206/0x310 [kvm] Aug 22 09:57:38 juju-e4d256-prod-github-runner-207 kernel: [16432.596121] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 09:57:38 juju-e4d256-prod-github-runner-207 kernel: [16432.597130] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 09:57:38 juju-e4d256-prod-github-runner-207 kernel: [16432.598130] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 09:57:38 juju-e4d256-prod-github-runner-207 kernel: [16432.599131] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 09:57:38 juju-e4d256-prod-github-runner-207 kernel: [16432.600075] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 09:57:38 juju-e4d256-prod-github-runner-207 kernel: [16432.601050] handle_exit+0x98/0x230 [kvm_amd] Aug 22 09:57:38 juju-e4d256-prod-github-runner-207 kernel: [16432.601943] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 09:57:38 juju-e4d256-prod-github-runner-207 kernel: [16432.602854] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 09:57:38 juju-e4d256-prod-github-runner-207 kernel: [16432.603798] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 09:57:38 juju-e4d256-prod-github-runner-207 kernel: [16432.604698] vcpu_run+0x62/0x2c0 [kvm] Aug 22 09:57:38 juju-e4d256-prod-github-runner-207 kernel: [16432.605506] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 09:57:38 juju-e4d256-prod-github-runner-207 kernel: [16432.606311] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 09:57:38 juju-e4d256-prod-github-runner-207 kernel: [16432.607177] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 09:57:38 juju-e4d256-prod-github-runner-207 kernel: [16432.607972] ? __seccomp_filter+0x4a/0x4a0 Aug 22 09:57:38 juju-e4d256-prod-github-runner-207 kernel: [16432.608713] ? __fget_files+0x86/0xc0 Aug 22 09:57:38 juju-e4d256-prod-github-runner-207 kernel: [16432.609415] __x64_sys_ioctl+0x95/0xd0 Aug 22 09:57:38 juju-e4d256-prod-github-runner-207 kernel: [16432.610105] do_syscall_64+0x5c/0xc0 Aug 22 09:57:38 juju-e4d256-prod-github-runner-207 kernel: [16432.610766] ? do_futex+0x162/0x1f0 Aug 22 09:57:38 juju-e4d256-prod-github-runner-207 kernel: [16432.611422] ? __x64_sys_futex+0x78/0x1e0 Aug 22 09:57:38 juju-e4d256-prod-github-runner-207 kernel: [16432.612093] ? __secure_computing+0xa9/0x120 Aug 22 09:57:38 juju-e4d256-prod-github-runner-207 kernel: [16432.612780] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 09:57:38 juju-e4d256-prod-github-runner-207 kernel: [16432.613537] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:57:38 juju-e4d256-prod-github-runner-207 kernel: [16432.614256] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:57:38 juju-e4d256-prod-github-runner-207 kernel: [16432.614981] ? do_syscall_64+0x69/0xc0 Aug 22 09:57:38 juju-e4d256-prod-github-runner-207 kernel: [16432.615623] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:57:38 juju-e4d256-prod-github-runner-207 kernel: [16432.616323] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:57:38 juju-e4d256-prod-github-runner-207 kernel: [16432.617014] ? do_syscall_64+0x69/0xc0 Aug 22 09:57:38 juju-e4d256-prod-github-runner-207 kernel: [16432.617637] ? do_syscall_64+0x69/0xc0 Aug 22 09:57:38 juju-e4d256-prod-github-runner-207 kernel: [16432.618256] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 09:57:38 juju-e4d256-prod-github-runner-207 kernel: [16432.618979] RIP: 0033:0x7faa5d0edaff Aug 22 09:57:38 juju-e4d256-prod-github-runner-207 kernel: [16432.619608] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 09:57:38 juju-e4d256-prod-github-runner-207 kernel: [16432.621599] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 09:57:38 juju-e4d256-prod-github-runner-207 kernel: [16432.622513] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 09:57:38 juju-e4d256-prod-github-runner-207 kernel: [16432.623416] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 09:57:38 juju-e4d256-prod-github-runner-207 kernel: [16432.624299] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 09:57:38 juju-e4d256-prod-github-runner-207 kernel: [16432.625185] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 09:57:38 juju-e4d256-prod-github-runner-207 kernel: [16432.626068] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 09:57:38 juju-e4d256-prod-github-runner-207 kernel: [16432.626954] Aug 22 09:58:06 juju-e4d256-prod-github-runner-207 kernel: [16460.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 15222s! [qemu-system-x86:6715] Aug 22 09:58:06 juju-e4d256-prod-github-runner-207 kernel: [16460.543098] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 09:58:06 juju-e4d256-prod-github-runner-207 kernel: [16460.543163] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 09:58:06 juju-e4d256-prod-github-runner-207 kernel: [16460.555259] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 09:58:06 juju-e4d256-prod-github-runner-207 kernel: [16460.556541] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 09:58:06 juju-e4d256-prod-github-runner-207 kernel: [16460.557762] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:58:06 juju-e4d256-prod-github-runner-207 kernel: [16460.558827] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 09:58:06 juju-e4d256-prod-github-runner-207 kernel: [16460.561390] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 09:58:06 juju-e4d256-prod-github-runner-207 kernel: [16460.562443] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 09:58:06 juju-e4d256-prod-github-runner-207 kernel: [16460.563619] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 09:58:06 juju-e4d256-prod-github-runner-207 kernel: [16460.564790] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 09:58:06 juju-e4d256-prod-github-runner-207 kernel: [16460.565956] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 09:58:06 juju-e4d256-prod-github-runner-207 kernel: [16460.567155] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 09:58:06 juju-e4d256-prod-github-runner-207 kernel: [16460.568327] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 09:58:06 juju-e4d256-prod-github-runner-207 kernel: [16460.569558] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 09:58:06 juju-e4d256-prod-github-runner-207 kernel: [16460.570674] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 09:58:06 juju-e4d256-prod-github-runner-207 kernel: [16460.571870] Call Trace: Aug 22 09:58:06 juju-e4d256-prod-github-runner-207 kernel: [16460.572918] Aug 22 09:58:06 juju-e4d256-prod-github-runner-207 kernel: [16460.573802] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:58:06 juju-e4d256-prod-github-runner-207 kernel: [16460.574871] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:58:06 juju-e4d256-prod-github-runner-207 kernel: [16460.575899] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:58:06 juju-e4d256-prod-github-runner-207 kernel: [16460.576983] ? show_regs.part.0+0x23/0x29 Aug 22 09:58:06 juju-e4d256-prod-github-runner-207 kernel: [16460.577979] ? show_regs.cold+0x8/0xd Aug 22 09:58:06 juju-e4d256-prod-github-runner-207 kernel: [16460.578960] ? watchdog_timer_fn+0x1be/0x220 Aug 22 09:58:06 juju-e4d256-prod-github-runner-207 kernel: [16460.579981] ? lockup_detector_update_enable+0x60/0x60 Aug 22 09:58:06 juju-e4d256-prod-github-runner-207 kernel: [16460.581052] ? __hrtimer_run_queues+0x107/0x230 Aug 22 09:58:06 juju-e4d256-prod-github-runner-207 kernel: [16460.582083] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 09:58:06 juju-e4d256-prod-github-runner-207 kernel: [16460.583129] ? hrtimer_interrupt+0x101/0x220 Aug 22 09:58:06 juju-e4d256-prod-github-runner-207 kernel: [16460.584170] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 09:58:06 juju-e4d256-prod-github-runner-207 kernel: [16460.585247] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 09:58:06 juju-e4d256-prod-github-runner-207 kernel: [16460.586298] Aug 22 09:58:06 juju-e4d256-prod-github-runner-207 kernel: [16460.587171] Aug 22 09:58:06 juju-e4d256-prod-github-runner-207 kernel: [16460.588027] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 09:58:06 juju-e4d256-prod-github-runner-207 kernel: [16460.589066] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:58:06 juju-e4d256-prod-github-runner-207 kernel: [16460.590123] ? _raw_spin_lock+0x22/0x30 Aug 22 09:58:06 juju-e4d256-prod-github-runner-207 kernel: [16460.591085] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:58:06 juju-e4d256-prod-github-runner-207 kernel: [16460.592111] direct_page_fault+0x206/0x310 [kvm] Aug 22 09:58:06 juju-e4d256-prod-github-runner-207 kernel: [16460.593136] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 09:58:06 juju-e4d256-prod-github-runner-207 kernel: [16460.594166] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 09:58:06 juju-e4d256-prod-github-runner-207 kernel: [16460.595184] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 09:58:06 juju-e4d256-prod-github-runner-207 kernel: [16460.596155] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 09:58:06 juju-e4d256-prod-github-runner-207 kernel: [16460.597117] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 09:58:06 juju-e4d256-prod-github-runner-207 kernel: [16460.598104] handle_exit+0x98/0x230 [kvm_amd] Aug 22 09:58:06 juju-e4d256-prod-github-runner-207 kernel: [16460.599052] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 09:58:06 juju-e4d256-prod-github-runner-207 kernel: [16460.599981] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 09:58:06 juju-e4d256-prod-github-runner-207 kernel: [16460.600917] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 09:58:06 juju-e4d256-prod-github-runner-207 kernel: [16460.601825] vcpu_run+0x62/0x2c0 [kvm] Aug 22 09:58:06 juju-e4d256-prod-github-runner-207 kernel: [16460.602644] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 09:58:06 juju-e4d256-prod-github-runner-207 kernel: [16460.603456] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 09:58:06 juju-e4d256-prod-github-runner-207 kernel: [16460.604322] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 09:58:06 juju-e4d256-prod-github-runner-207 kernel: [16460.605137] ? __seccomp_filter+0x4a/0x4a0 Aug 22 09:58:06 juju-e4d256-prod-github-runner-207 kernel: [16460.605885] ? __fget_files+0x86/0xc0 Aug 22 09:58:06 juju-e4d256-prod-github-runner-207 kernel: [16460.606595] __x64_sys_ioctl+0x95/0xd0 Aug 22 09:58:06 juju-e4d256-prod-github-runner-207 kernel: [16460.607307] do_syscall_64+0x5c/0xc0 Aug 22 09:58:06 juju-e4d256-prod-github-runner-207 kernel: [16460.607972] ? do_futex+0x162/0x1f0 Aug 22 09:58:06 juju-e4d256-prod-github-runner-207 kernel: [16460.608634] ? __x64_sys_futex+0x78/0x1e0 Aug 22 09:58:06 juju-e4d256-prod-github-runner-207 kernel: [16460.609317] ? __secure_computing+0xa9/0x120 Aug 22 09:58:06 juju-e4d256-prod-github-runner-207 kernel: [16460.610012] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 09:58:06 juju-e4d256-prod-github-runner-207 kernel: [16460.610809] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:58:06 juju-e4d256-prod-github-runner-207 kernel: [16460.611535] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:58:06 juju-e4d256-prod-github-runner-207 kernel: [16460.612265] ? do_syscall_64+0x69/0xc0 Aug 22 09:58:06 juju-e4d256-prod-github-runner-207 kernel: [16460.612913] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:58:06 juju-e4d256-prod-github-runner-207 kernel: [16460.613637] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:58:06 juju-e4d256-prod-github-runner-207 kernel: [16460.614333] ? do_syscall_64+0x69/0xc0 Aug 22 09:58:06 juju-e4d256-prod-github-runner-207 kernel: [16460.614974] ? do_syscall_64+0x69/0xc0 Aug 22 09:58:06 juju-e4d256-prod-github-runner-207 kernel: [16460.615597] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 09:58:06 juju-e4d256-prod-github-runner-207 kernel: [16460.616316] RIP: 0033:0x7faa5d0edaff Aug 22 09:58:06 juju-e4d256-prod-github-runner-207 kernel: [16460.616942] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 09:58:06 juju-e4d256-prod-github-runner-207 kernel: [16460.618964] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 09:58:06 juju-e4d256-prod-github-runner-207 kernel: [16460.619881] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 09:58:06 juju-e4d256-prod-github-runner-207 kernel: [16460.620775] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 09:58:06 juju-e4d256-prod-github-runner-207 kernel: [16460.621680] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 09:58:06 juju-e4d256-prod-github-runner-207 kernel: [16460.622582] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 09:58:06 juju-e4d256-prod-github-runner-207 kernel: [16460.623493] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 09:58:06 juju-e4d256-prod-github-runner-207 kernel: [16460.624389] Aug 22 09:58:34 juju-e4d256-prod-github-runner-207 kernel: [16488.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 15248s! [qemu-system-x86:6715] Aug 22 09:58:34 juju-e4d256-prod-github-runner-207 kernel: [16488.543159] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 09:58:34 juju-e4d256-prod-github-runner-207 kernel: [16488.543229] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 09:58:34 juju-e4d256-prod-github-runner-207 kernel: [16488.555503] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 09:58:34 juju-e4d256-prod-github-runner-207 kernel: [16488.556799] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 09:58:34 juju-e4d256-prod-github-runner-207 kernel: [16488.558013] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:58:34 juju-e4d256-prod-github-runner-207 kernel: [16488.559146] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 09:58:34 juju-e4d256-prod-github-runner-207 kernel: [16488.561711] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 09:58:34 juju-e4d256-prod-github-runner-207 kernel: [16488.562818] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 09:58:34 juju-e4d256-prod-github-runner-207 kernel: [16488.564061] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 09:58:34 juju-e4d256-prod-github-runner-207 kernel: [16488.565234] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 09:58:34 juju-e4d256-prod-github-runner-207 kernel: [16488.566451] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 09:58:34 juju-e4d256-prod-github-runner-207 kernel: [16488.567652] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 09:58:34 juju-e4d256-prod-github-runner-207 kernel: [16488.568819] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 09:58:34 juju-e4d256-prod-github-runner-207 kernel: [16488.570047] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 09:58:34 juju-e4d256-prod-github-runner-207 kernel: [16488.571194] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 09:58:34 juju-e4d256-prod-github-runner-207 kernel: [16488.572391] Call Trace: Aug 22 09:58:34 juju-e4d256-prod-github-runner-207 kernel: [16488.573302] Aug 22 09:58:34 juju-e4d256-prod-github-runner-207 kernel: [16488.574185] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:58:34 juju-e4d256-prod-github-runner-207 kernel: [16488.575253] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:58:34 juju-e4d256-prod-github-runner-207 kernel: [16488.576280] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:58:34 juju-e4d256-prod-github-runner-207 kernel: [16488.577352] ? show_regs.part.0+0x23/0x29 Aug 22 09:58:34 juju-e4d256-prod-github-runner-207 kernel: [16488.578369] ? show_regs.cold+0x8/0xd Aug 22 09:58:34 juju-e4d256-prod-github-runner-207 kernel: [16488.579358] ? watchdog_timer_fn+0x1be/0x220 Aug 22 09:58:34 juju-e4d256-prod-github-runner-207 kernel: [16488.580371] ? lockup_detector_update_enable+0x60/0x60 Aug 22 09:58:34 juju-e4d256-prod-github-runner-207 kernel: [16488.581431] ? __hrtimer_run_queues+0x107/0x230 Aug 22 09:58:34 juju-e4d256-prod-github-runner-207 kernel: [16488.582512] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 09:58:34 juju-e4d256-prod-github-runner-207 kernel: [16488.583575] ? hrtimer_interrupt+0x101/0x220 Aug 22 09:58:34 juju-e4d256-prod-github-runner-207 kernel: [16488.584606] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 09:58:34 juju-e4d256-prod-github-runner-207 kernel: [16488.585675] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 09:58:34 juju-e4d256-prod-github-runner-207 kernel: [16488.586751] Aug 22 09:58:34 juju-e4d256-prod-github-runner-207 kernel: [16488.587641] Aug 22 09:58:34 juju-e4d256-prod-github-runner-207 kernel: [16488.588481] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 09:58:34 juju-e4d256-prod-github-runner-207 kernel: [16488.589519] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:58:34 juju-e4d256-prod-github-runner-207 kernel: [16488.590602] ? _raw_spin_lock+0x22/0x30 Aug 22 09:58:34 juju-e4d256-prod-github-runner-207 kernel: [16488.591556] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:58:34 juju-e4d256-prod-github-runner-207 kernel: [16488.592621] direct_page_fault+0x206/0x310 [kvm] Aug 22 09:58:34 juju-e4d256-prod-github-runner-207 kernel: [16488.593783] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 09:58:34 juju-e4d256-prod-github-runner-207 kernel: [16488.594829] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 09:58:34 juju-e4d256-prod-github-runner-207 kernel: [16488.595881] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 09:58:34 juju-e4d256-prod-github-runner-207 kernel: [16488.596869] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 09:58:34 juju-e4d256-prod-github-runner-207 kernel: [16488.597827] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 09:58:34 juju-e4d256-prod-github-runner-207 kernel: [16488.598852] handle_exit+0x98/0x230 [kvm_amd] Aug 22 09:58:34 juju-e4d256-prod-github-runner-207 kernel: [16488.599794] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 09:58:34 juju-e4d256-prod-github-runner-207 kernel: [16488.600726] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 09:58:34 juju-e4d256-prod-github-runner-207 kernel: [16488.601668] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 09:58:34 juju-e4d256-prod-github-runner-207 kernel: [16488.602605] vcpu_run+0x62/0x2c0 [kvm] Aug 22 09:58:34 juju-e4d256-prod-github-runner-207 kernel: [16488.603449] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 09:58:34 juju-e4d256-prod-github-runner-207 kernel: [16488.604293] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 09:58:34 juju-e4d256-prod-github-runner-207 kernel: [16488.605159] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 09:58:34 juju-e4d256-prod-github-runner-207 kernel: [16488.605975] ? __seccomp_filter+0x4a/0x4a0 Aug 22 09:58:34 juju-e4d256-prod-github-runner-207 kernel: [16488.606773] ? __fget_files+0x86/0xc0 Aug 22 09:58:34 juju-e4d256-prod-github-runner-207 kernel: [16488.607488] __x64_sys_ioctl+0x95/0xd0 Aug 22 09:58:34 juju-e4d256-prod-github-runner-207 kernel: [16488.608207] do_syscall_64+0x5c/0xc0 Aug 22 09:58:34 juju-e4d256-prod-github-runner-207 kernel: [16488.608886] ? do_futex+0x162/0x1f0 Aug 22 09:58:34 juju-e4d256-prod-github-runner-207 kernel: [16488.609542] ? __x64_sys_futex+0x78/0x1e0 Aug 22 09:58:34 juju-e4d256-prod-github-runner-207 kernel: [16488.610236] ? __secure_computing+0xa9/0x120 Aug 22 09:58:34 juju-e4d256-prod-github-runner-207 kernel: [16488.610950] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 09:58:34 juju-e4d256-prod-github-runner-207 kernel: [16488.611768] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:58:34 juju-e4d256-prod-github-runner-207 kernel: [16488.612525] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:58:34 juju-e4d256-prod-github-runner-207 kernel: [16488.613260] ? do_syscall_64+0x69/0xc0 Aug 22 09:58:34 juju-e4d256-prod-github-runner-207 kernel: [16488.613920] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:58:34 juju-e4d256-prod-github-runner-207 kernel: [16488.614689] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:58:34 juju-e4d256-prod-github-runner-207 kernel: [16488.615396] ? do_syscall_64+0x69/0xc0 Aug 22 09:58:34 juju-e4d256-prod-github-runner-207 kernel: [16488.616036] ? do_syscall_64+0x69/0xc0 Aug 22 09:58:34 juju-e4d256-prod-github-runner-207 kernel: [16488.616673] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 09:58:34 juju-e4d256-prod-github-runner-207 kernel: [16488.617388] RIP: 0033:0x7faa5d0edaff Aug 22 09:58:34 juju-e4d256-prod-github-runner-207 kernel: [16488.618010] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 09:58:34 juju-e4d256-prod-github-runner-207 kernel: [16488.620048] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 09:58:34 juju-e4d256-prod-github-runner-207 kernel: [16488.620977] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 09:58:34 juju-e4d256-prod-github-runner-207 kernel: [16488.621872] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 09:58:34 juju-e4d256-prod-github-runner-207 kernel: [16488.622798] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 09:58:34 juju-e4d256-prod-github-runner-207 kernel: [16488.623715] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 09:58:34 juju-e4d256-prod-github-runner-207 kernel: [16488.624615] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 09:58:34 juju-e4d256-prod-github-runner-207 kernel: [16488.625535] Aug 22 09:59:02 juju-e4d256-prod-github-runner-207 kernel: [16516.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 15274s! [qemu-system-x86:6715] Aug 22 09:59:02 juju-e4d256-prod-github-runner-207 kernel: [16516.543809] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 09:59:02 juju-e4d256-prod-github-runner-207 kernel: [16516.544070] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 09:59:02 juju-e4d256-prod-github-runner-207 kernel: [16516.556449] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 09:59:02 juju-e4d256-prod-github-runner-207 kernel: [16516.557717] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 09:59:02 juju-e4d256-prod-github-runner-207 kernel: [16516.558946] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:59:02 juju-e4d256-prod-github-runner-207 kernel: [16516.560004] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 09:59:02 juju-e4d256-prod-github-runner-207 kernel: [16516.562564] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 09:59:02 juju-e4d256-prod-github-runner-207 kernel: [16516.563604] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 09:59:02 juju-e4d256-prod-github-runner-207 kernel: [16516.564770] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 09:59:02 juju-e4d256-prod-github-runner-207 kernel: [16516.565956] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 09:59:02 juju-e4d256-prod-github-runner-207 kernel: [16516.567143] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 09:59:02 juju-e4d256-prod-github-runner-207 kernel: [16516.568312] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 09:59:02 juju-e4d256-prod-github-runner-207 kernel: [16516.569481] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 09:59:02 juju-e4d256-prod-github-runner-207 kernel: [16516.570727] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 09:59:02 juju-e4d256-prod-github-runner-207 kernel: [16516.571828] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 09:59:02 juju-e4d256-prod-github-runner-207 kernel: [16516.573017] Call Trace: Aug 22 09:59:02 juju-e4d256-prod-github-runner-207 kernel: [16516.573948] Aug 22 09:59:02 juju-e4d256-prod-github-runner-207 kernel: [16516.574849] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:59:02 juju-e4d256-prod-github-runner-207 kernel: [16516.575876] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:59:02 juju-e4d256-prod-github-runner-207 kernel: [16516.576895] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:59:02 juju-e4d256-prod-github-runner-207 kernel: [16516.578010] ? show_regs.part.0+0x23/0x29 Aug 22 09:59:02 juju-e4d256-prod-github-runner-207 kernel: [16516.579005] ? show_regs.cold+0x8/0xd Aug 22 09:59:02 juju-e4d256-prod-github-runner-207 kernel: [16516.579974] ? watchdog_timer_fn+0x1be/0x220 Aug 22 09:59:02 juju-e4d256-prod-github-runner-207 kernel: [16516.580979] ? lockup_detector_update_enable+0x60/0x60 Aug 22 09:59:02 juju-e4d256-prod-github-runner-207 kernel: [16516.582069] ? __hrtimer_run_queues+0x107/0x230 Aug 22 09:59:02 juju-e4d256-prod-github-runner-207 kernel: [16516.583092] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 09:59:02 juju-e4d256-prod-github-runner-207 kernel: [16516.584113] ? hrtimer_interrupt+0x101/0x220 Aug 22 09:59:02 juju-e4d256-prod-github-runner-207 kernel: [16516.585129] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 09:59:02 juju-e4d256-prod-github-runner-207 kernel: [16516.586219] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 09:59:02 juju-e4d256-prod-github-runner-207 kernel: [16516.587269] Aug 22 09:59:02 juju-e4d256-prod-github-runner-207 kernel: [16516.588118] Aug 22 09:59:02 juju-e4d256-prod-github-runner-207 kernel: [16516.588951] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 09:59:02 juju-e4d256-prod-github-runner-207 kernel: [16516.590006] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:59:02 juju-e4d256-prod-github-runner-207 kernel: [16516.591050] ? _raw_spin_lock+0x22/0x30 Aug 22 09:59:02 juju-e4d256-prod-github-runner-207 kernel: [16516.591994] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:59:02 juju-e4d256-prod-github-runner-207 kernel: [16516.593033] direct_page_fault+0x206/0x310 [kvm] Aug 22 09:59:02 juju-e4d256-prod-github-runner-207 kernel: [16516.594075] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 09:59:02 juju-e4d256-prod-github-runner-207 kernel: [16516.595089] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 09:59:02 juju-e4d256-prod-github-runner-207 kernel: [16516.596088] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 09:59:02 juju-e4d256-prod-github-runner-207 kernel: [16516.597097] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 09:59:02 juju-e4d256-prod-github-runner-207 kernel: [16516.598068] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 09:59:02 juju-e4d256-prod-github-runner-207 kernel: [16516.599046] handle_exit+0x98/0x230 [kvm_amd] Aug 22 09:59:02 juju-e4d256-prod-github-runner-207 kernel: [16516.599938] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 09:59:02 juju-e4d256-prod-github-runner-207 kernel: [16516.600848] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 09:59:02 juju-e4d256-prod-github-runner-207 kernel: [16516.601775] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 09:59:02 juju-e4d256-prod-github-runner-207 kernel: [16516.602699] vcpu_run+0x62/0x2c0 [kvm] Aug 22 09:59:02 juju-e4d256-prod-github-runner-207 kernel: [16516.603513] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 09:59:02 juju-e4d256-prod-github-runner-207 kernel: [16516.604318] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 09:59:02 juju-e4d256-prod-github-runner-207 kernel: [16516.605173] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 09:59:02 juju-e4d256-prod-github-runner-207 kernel: [16516.605988] ? __seccomp_filter+0x4a/0x4a0 Aug 22 09:59:02 juju-e4d256-prod-github-runner-207 kernel: [16516.606733] ? __fget_files+0x86/0xc0 Aug 22 09:59:02 juju-e4d256-prod-github-runner-207 kernel: [16516.607433] __x64_sys_ioctl+0x95/0xd0 Aug 22 09:59:02 juju-e4d256-prod-github-runner-207 kernel: [16516.608126] do_syscall_64+0x5c/0xc0 Aug 22 09:59:02 juju-e4d256-prod-github-runner-207 kernel: [16516.608788] ? do_futex+0x162/0x1f0 Aug 22 09:59:02 juju-e4d256-prod-github-runner-207 kernel: [16516.609433] ? __x64_sys_futex+0x78/0x1e0 Aug 22 09:59:02 juju-e4d256-prod-github-runner-207 kernel: [16516.610120] ? __secure_computing+0xa9/0x120 Aug 22 09:59:02 juju-e4d256-prod-github-runner-207 kernel: [16516.610811] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 09:59:02 juju-e4d256-prod-github-runner-207 kernel: [16516.611568] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:59:02 juju-e4d256-prod-github-runner-207 kernel: [16516.612286] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:59:02 juju-e4d256-prod-github-runner-207 kernel: [16516.612999] ? do_syscall_64+0x69/0xc0 Aug 22 09:59:02 juju-e4d256-prod-github-runner-207 kernel: [16516.613641] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:59:02 juju-e4d256-prod-github-runner-207 kernel: [16516.614352] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:59:02 juju-e4d256-prod-github-runner-207 kernel: [16516.615044] ? do_syscall_64+0x69/0xc0 Aug 22 09:59:02 juju-e4d256-prod-github-runner-207 kernel: [16516.615667] ? do_syscall_64+0x69/0xc0 Aug 22 09:59:02 juju-e4d256-prod-github-runner-207 kernel: [16516.616291] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 09:59:02 juju-e4d256-prod-github-runner-207 kernel: [16516.616997] RIP: 0033:0x7faa5d0edaff Aug 22 09:59:02 juju-e4d256-prod-github-runner-207 kernel: [16516.617640] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 09:59:02 juju-e4d256-prod-github-runner-207 kernel: [16516.619635] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 09:59:02 juju-e4d256-prod-github-runner-207 kernel: [16516.620543] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 09:59:02 juju-e4d256-prod-github-runner-207 kernel: [16516.621427] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 09:59:02 juju-e4d256-prod-github-runner-207 kernel: [16516.622333] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 09:59:02 juju-e4d256-prod-github-runner-207 kernel: [16516.623226] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 09:59:02 juju-e4d256-prod-github-runner-207 kernel: [16516.624111] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 09:59:02 juju-e4d256-prod-github-runner-207 kernel: [16516.625011] Aug 22 09:59:30 juju-e4d256-prod-github-runner-207 kernel: [16544.541980] watchdog: BUG: soft lockup - CPU#1 stuck for 15300s! [qemu-system-x86:6715] Aug 22 09:59:30 juju-e4d256-prod-github-runner-207 kernel: [16544.543097] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 09:59:30 juju-e4d256-prod-github-runner-207 kernel: [16544.543165] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 09:59:30 juju-e4d256-prod-github-runner-207 kernel: [16544.555370] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 09:59:30 juju-e4d256-prod-github-runner-207 kernel: [16544.556654] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 09:59:30 juju-e4d256-prod-github-runner-207 kernel: [16544.557903] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:59:30 juju-e4d256-prod-github-runner-207 kernel: [16544.558978] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 09:59:30 juju-e4d256-prod-github-runner-207 kernel: [16544.561554] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 09:59:30 juju-e4d256-prod-github-runner-207 kernel: [16544.562633] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 09:59:30 juju-e4d256-prod-github-runner-207 kernel: [16544.563800] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 09:59:30 juju-e4d256-prod-github-runner-207 kernel: [16544.564966] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 09:59:30 juju-e4d256-prod-github-runner-207 kernel: [16544.566154] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 09:59:30 juju-e4d256-prod-github-runner-207 kernel: [16544.567326] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 09:59:30 juju-e4d256-prod-github-runner-207 kernel: [16544.568497] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 09:59:30 juju-e4d256-prod-github-runner-207 kernel: [16544.569756] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 09:59:30 juju-e4d256-prod-github-runner-207 kernel: [16544.570861] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 09:59:30 juju-e4d256-prod-github-runner-207 kernel: [16544.572059] Call Trace: Aug 22 09:59:30 juju-e4d256-prod-github-runner-207 kernel: [16544.572982] Aug 22 09:59:30 juju-e4d256-prod-github-runner-207 kernel: [16544.573888] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:59:30 juju-e4d256-prod-github-runner-207 kernel: [16544.574949] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 09:59:30 juju-e4d256-prod-github-runner-207 kernel: [16544.575994] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:59:30 juju-e4d256-prod-github-runner-207 kernel: [16544.577096] ? show_regs.part.0+0x23/0x29 Aug 22 09:59:30 juju-e4d256-prod-github-runner-207 kernel: [16544.578162] ? show_regs.cold+0x8/0xd Aug 22 09:59:30 juju-e4d256-prod-github-runner-207 kernel: [16544.579164] ? watchdog_timer_fn+0x1be/0x220 Aug 22 09:59:30 juju-e4d256-prod-github-runner-207 kernel: [16544.580190] ? lockup_detector_update_enable+0x60/0x60 Aug 22 09:59:30 juju-e4d256-prod-github-runner-207 kernel: [16544.581267] ? __hrtimer_run_queues+0x107/0x230 Aug 22 09:59:30 juju-e4d256-prod-github-runner-207 kernel: [16544.582330] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 09:59:30 juju-e4d256-prod-github-runner-207 kernel: [16544.583391] ? hrtimer_interrupt+0x101/0x220 Aug 22 09:59:30 juju-e4d256-prod-github-runner-207 kernel: [16544.584427] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 09:59:30 juju-e4d256-prod-github-runner-207 kernel: [16544.585511] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 09:59:30 juju-e4d256-prod-github-runner-207 kernel: [16544.586587] Aug 22 09:59:30 juju-e4d256-prod-github-runner-207 kernel: [16544.587445] Aug 22 09:59:30 juju-e4d256-prod-github-runner-207 kernel: [16544.588295] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 09:59:30 juju-e4d256-prod-github-runner-207 kernel: [16544.589349] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:59:30 juju-e4d256-prod-github-runner-207 kernel: [16544.590411] ? _raw_spin_lock+0x22/0x30 Aug 22 09:59:30 juju-e4d256-prod-github-runner-207 kernel: [16544.591369] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:59:30 juju-e4d256-prod-github-runner-207 kernel: [16544.592440] direct_page_fault+0x206/0x310 [kvm] Aug 22 09:59:30 juju-e4d256-prod-github-runner-207 kernel: [16544.593486] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 09:59:30 juju-e4d256-prod-github-runner-207 kernel: [16544.594526] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 09:59:30 juju-e4d256-prod-github-runner-207 kernel: [16544.595539] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 09:59:30 juju-e4d256-prod-github-runner-207 kernel: [16544.596516] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 09:59:30 juju-e4d256-prod-github-runner-207 kernel: [16544.597473] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 09:59:30 juju-e4d256-prod-github-runner-207 kernel: [16544.598480] handle_exit+0x98/0x230 [kvm_amd] Aug 22 09:59:30 juju-e4d256-prod-github-runner-207 kernel: [16544.599384] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 09:59:30 juju-e4d256-prod-github-runner-207 kernel: [16544.600317] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 09:59:30 juju-e4d256-prod-github-runner-207 kernel: [16544.601263] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 09:59:30 juju-e4d256-prod-github-runner-207 kernel: [16544.602210] vcpu_run+0x62/0x2c0 [kvm] Aug 22 09:59:30 juju-e4d256-prod-github-runner-207 kernel: [16544.603041] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 09:59:30 juju-e4d256-prod-github-runner-207 kernel: [16544.603870] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 09:59:30 juju-e4d256-prod-github-runner-207 kernel: [16544.604730] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 09:59:30 juju-e4d256-prod-github-runner-207 kernel: [16544.605550] ? __seccomp_filter+0x4a/0x4a0 Aug 22 09:59:30 juju-e4d256-prod-github-runner-207 kernel: [16544.606329] ? __fget_files+0x86/0xc0 Aug 22 09:59:30 juju-e4d256-prod-github-runner-207 kernel: [16544.607042] __x64_sys_ioctl+0x95/0xd0 Aug 22 09:59:30 juju-e4d256-prod-github-runner-207 kernel: [16544.607741] do_syscall_64+0x5c/0xc0 Aug 22 09:59:30 juju-e4d256-prod-github-runner-207 kernel: [16544.608408] ? do_futex+0x162/0x1f0 Aug 22 09:59:30 juju-e4d256-prod-github-runner-207 kernel: [16544.609058] ? __x64_sys_futex+0x78/0x1e0 Aug 22 09:59:30 juju-e4d256-prod-github-runner-207 kernel: [16544.609750] ? __secure_computing+0xa9/0x120 Aug 22 09:59:30 juju-e4d256-prod-github-runner-207 kernel: [16544.610448] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 09:59:30 juju-e4d256-prod-github-runner-207 kernel: [16544.611340] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:59:30 juju-e4d256-prod-github-runner-207 kernel: [16544.612081] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:59:30 juju-e4d256-prod-github-runner-207 kernel: [16544.612809] ? do_syscall_64+0x69/0xc0 Aug 22 09:59:30 juju-e4d256-prod-github-runner-207 kernel: [16544.613473] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:59:30 juju-e4d256-prod-github-runner-207 kernel: [16544.614225] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:59:30 juju-e4d256-prod-github-runner-207 kernel: [16544.614950] ? do_syscall_64+0x69/0xc0 Aug 22 09:59:30 juju-e4d256-prod-github-runner-207 kernel: [16544.615584] ? do_syscall_64+0x69/0xc0 Aug 22 09:59:30 juju-e4d256-prod-github-runner-207 kernel: [16544.616220] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 09:59:30 juju-e4d256-prod-github-runner-207 kernel: [16544.616931] RIP: 0033:0x7faa5d0edaff Aug 22 09:59:30 juju-e4d256-prod-github-runner-207 kernel: [16544.617565] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 09:59:30 juju-e4d256-prod-github-runner-207 kernel: [16544.619599] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 09:59:30 juju-e4d256-prod-github-runner-207 kernel: [16544.620519] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 09:59:30 juju-e4d256-prod-github-runner-207 kernel: [16544.621425] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 09:59:30 juju-e4d256-prod-github-runner-207 kernel: [16544.622337] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 09:59:30 juju-e4d256-prod-github-runner-207 kernel: [16544.623236] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 09:59:30 juju-e4d256-prod-github-runner-207 kernel: [16544.624139] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 09:59:30 juju-e4d256-prod-github-runner-207 kernel: [16544.625041] Aug 22 09:59:44 juju-e4d256-prod-github-runner-207 kernel: [16558.292705] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 09:59:44 juju-e4d256-prod-github-runner-207 kernel: [16558.293666] rcu: 1-....: (4097413 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=1980204 Aug 22 09:59:44 juju-e4d256-prod-github-runner-207 kernel: [16558.294784] (t=4110273 jiffies g=23269 q=23451) Aug 22 09:59:44 juju-e4d256-prod-github-runner-207 kernel: [16558.295570] NMI backtrace for cpu 1 Aug 22 09:59:44 juju-e4d256-prod-github-runner-207 kernel: [16558.296279] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 09:59:44 juju-e4d256-prod-github-runner-207 kernel: [16558.297386] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 09:59:44 juju-e4d256-prod-github-runner-207 kernel: [16558.298483] Call Trace: Aug 22 09:59:44 juju-e4d256-prod-github-runner-207 kernel: [16558.299162] Aug 22 09:59:44 juju-e4d256-prod-github-runner-207 kernel: [16558.299804] show_stack+0x52/0x5c Aug 22 09:59:44 juju-e4d256-prod-github-runner-207 kernel: [16558.300532] dump_stack_lvl+0x4a/0x63 Aug 22 09:59:44 juju-e4d256-prod-github-runner-207 kernel: [16558.301278] dump_stack+0x10/0x16 Aug 22 09:59:44 juju-e4d256-prod-github-runner-207 kernel: [16558.302003] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 09:59:44 juju-e4d256-prod-github-runner-207 kernel: [16558.302783] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 09:59:44 juju-e4d256-prod-github-runner-207 kernel: [16558.303561] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 09:59:44 juju-e4d256-prod-github-runner-207 kernel: [16558.304383] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 09:59:44 juju-e4d256-prod-github-runner-207 kernel: [16558.305199] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 09:59:44 juju-e4d256-prod-github-runner-207 kernel: [16558.306015] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 09:59:44 juju-e4d256-prod-github-runner-207 kernel: [16558.306785] print_cpu_stall.cold+0x2f/0xe2 Aug 22 09:59:44 juju-e4d256-prod-github-runner-207 kernel: [16558.307551] ? timekeeping_update+0xf7/0x150 Aug 22 09:59:44 juju-e4d256-prod-github-runner-207 kernel: [16558.308342] check_cpu_stall+0x109/0x270 Aug 22 09:59:44 juju-e4d256-prod-github-runner-207 kernel: [16558.309091] rcu_sched_clock_irq+0x9a/0x250 Aug 22 09:59:44 juju-e4d256-prod-github-runner-207 kernel: [16558.309863] update_process_times+0x94/0xd0 Aug 22 09:59:44 juju-e4d256-prod-github-runner-207 kernel: [16558.310623] tick_sched_handle+0x29/0x70 Aug 22 09:59:44 juju-e4d256-prod-github-runner-207 kernel: [16558.311371] tick_sched_timer+0x8c/0xc0 Aug 22 09:59:44 juju-e4d256-prod-github-runner-207 kernel: [16558.312107] ? tick_nohz_handler+0xb0/0xb0 Aug 22 09:59:44 juju-e4d256-prod-github-runner-207 kernel: [16558.312860] __hrtimer_run_queues+0x107/0x230 Aug 22 09:59:44 juju-e4d256-prod-github-runner-207 kernel: [16558.313637] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 09:59:44 juju-e4d256-prod-github-runner-207 kernel: [16558.314411] hrtimer_interrupt+0x101/0x220 Aug 22 09:59:44 juju-e4d256-prod-github-runner-207 kernel: [16558.315169] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 09:59:44 juju-e4d256-prod-github-runner-207 kernel: [16558.315985] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 09:59:44 juju-e4d256-prod-github-runner-207 kernel: [16558.316784] Aug 22 09:59:44 juju-e4d256-prod-github-runner-207 kernel: [16558.317430] Aug 22 09:59:44 juju-e4d256-prod-github-runner-207 kernel: [16558.318058] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 09:59:44 juju-e4d256-prod-github-runner-207 kernel: [16558.318915] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 09:59:44 juju-e4d256-prod-github-runner-207 kernel: [16558.319797] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 09:59:44 juju-e4d256-prod-github-runner-207 kernel: [16558.322014] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 09:59:44 juju-e4d256-prod-github-runner-207 kernel: [16558.322888] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 09:59:44 juju-e4d256-prod-github-runner-207 kernel: [16558.323881] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 09:59:44 juju-e4d256-prod-github-runner-207 kernel: [16558.324856] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 09:59:44 juju-e4d256-prod-github-runner-207 kernel: [16558.325827] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 09:59:44 juju-e4d256-prod-github-runner-207 kernel: [16558.326782] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 09:59:44 juju-e4d256-prod-github-runner-207 kernel: [16558.327736] ? _raw_spin_lock+0x22/0x30 Aug 22 09:59:44 juju-e4d256-prod-github-runner-207 kernel: [16558.328493] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 09:59:44 juju-e4d256-prod-github-runner-207 kernel: [16558.329348] direct_page_fault+0x206/0x310 [kvm] Aug 22 09:59:44 juju-e4d256-prod-github-runner-207 kernel: [16558.330199] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 09:59:44 juju-e4d256-prod-github-runner-207 kernel: [16558.331025] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 09:59:44 juju-e4d256-prod-github-runner-207 kernel: [16558.331847] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 09:59:44 juju-e4d256-prod-github-runner-207 kernel: [16558.332654] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 09:59:44 juju-e4d256-prod-github-runner-207 kernel: [16558.333448] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 09:59:44 juju-e4d256-prod-github-runner-207 kernel: [16558.334270] handle_exit+0x98/0x230 [kvm_amd] Aug 22 09:59:44 juju-e4d256-prod-github-runner-207 kernel: [16558.335022] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 09:59:44 juju-e4d256-prod-github-runner-207 kernel: [16558.335804] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 09:59:44 juju-e4d256-prod-github-runner-207 kernel: [16558.336600] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 09:59:44 juju-e4d256-prod-github-runner-207 kernel: [16558.337384] vcpu_run+0x62/0x2c0 [kvm] Aug 22 09:59:44 juju-e4d256-prod-github-runner-207 kernel: [16558.338110] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 09:59:44 juju-e4d256-prod-github-runner-207 kernel: [16558.338840] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 09:59:44 juju-e4d256-prod-github-runner-207 kernel: [16558.339661] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 09:59:44 juju-e4d256-prod-github-runner-207 kernel: [16558.340422] ? __seccomp_filter+0x4a/0x4a0 Aug 22 09:59:44 juju-e4d256-prod-github-runner-207 kernel: [16558.341139] ? __fget_files+0x86/0xc0 Aug 22 09:59:44 juju-e4d256-prod-github-runner-207 kernel: [16558.341846] __x64_sys_ioctl+0x95/0xd0 Aug 22 09:59:44 juju-e4d256-prod-github-runner-207 kernel: [16558.342540] do_syscall_64+0x5c/0xc0 Aug 22 09:59:44 juju-e4d256-prod-github-runner-207 kernel: [16558.343219] ? do_futex+0x162/0x1f0 Aug 22 09:59:44 juju-e4d256-prod-github-runner-207 kernel: [16558.343888] ? __x64_sys_futex+0x78/0x1e0 Aug 22 09:59:44 juju-e4d256-prod-github-runner-207 kernel: [16558.344587] ? __secure_computing+0xa9/0x120 Aug 22 09:59:44 juju-e4d256-prod-github-runner-207 kernel: [16558.345301] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 09:59:44 juju-e4d256-prod-github-runner-207 kernel: [16558.346098] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:59:44 juju-e4d256-prod-github-runner-207 kernel: [16558.346850] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:59:44 juju-e4d256-prod-github-runner-207 kernel: [16558.347601] ? do_syscall_64+0x69/0xc0 Aug 22 09:59:44 juju-e4d256-prod-github-runner-207 kernel: [16558.348289] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 09:59:44 juju-e4d256-prod-github-runner-207 kernel: [16558.349042] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 09:59:44 juju-e4d256-prod-github-runner-207 kernel: [16558.349829] ? do_syscall_64+0x69/0xc0 Aug 22 09:59:44 juju-e4d256-prod-github-runner-207 kernel: [16558.350524] ? do_syscall_64+0x69/0xc0 Aug 22 09:59:44 juju-e4d256-prod-github-runner-207 kernel: [16558.351211] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 09:59:44 juju-e4d256-prod-github-runner-207 kernel: [16558.351981] RIP: 0033:0x7faa5d0edaff Aug 22 09:59:44 juju-e4d256-prod-github-runner-207 kernel: [16558.352661] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 09:59:44 juju-e4d256-prod-github-runner-207 kernel: [16558.354767] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 09:59:44 juju-e4d256-prod-github-runner-207 kernel: [16558.355727] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 09:59:44 juju-e4d256-prod-github-runner-207 kernel: [16558.356668] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 09:59:44 juju-e4d256-prod-github-runner-207 kernel: [16558.357627] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 09:59:44 juju-e4d256-prod-github-runner-207 kernel: [16558.358566] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 09:59:44 juju-e4d256-prod-github-runner-207 kernel: [16558.359491] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 09:59:44 juju-e4d256-prod-github-runner-207 kernel: [16558.360438] Aug 22 10:00:10 juju-e4d256-prod-github-runner-207 kernel: [16584.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 15337s! [qemu-system-x86:6715] Aug 22 10:00:10 juju-e4d256-prod-github-runner-207 kernel: [16584.543104] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 10:00:10 juju-e4d256-prod-github-runner-207 kernel: [16584.543174] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 10:00:10 juju-e4d256-prod-github-runner-207 kernel: [16584.555276] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 10:00:10 juju-e4d256-prod-github-runner-207 kernel: [16584.556537] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 10:00:10 juju-e4d256-prod-github-runner-207 kernel: [16584.557769] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:00:10 juju-e4d256-prod-github-runner-207 kernel: [16584.558825] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 10:00:10 juju-e4d256-prod-github-runner-207 kernel: [16584.561400] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 10:00:10 juju-e4d256-prod-github-runner-207 kernel: [16584.562445] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 10:00:10 juju-e4d256-prod-github-runner-207 kernel: [16584.563604] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 10:00:10 juju-e4d256-prod-github-runner-207 kernel: [16584.564771] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 10:00:10 juju-e4d256-prod-github-runner-207 kernel: [16584.565955] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 10:00:10 juju-e4d256-prod-github-runner-207 kernel: [16584.567116] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 10:00:10 juju-e4d256-prod-github-runner-207 kernel: [16584.568491] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 10:00:10 juju-e4d256-prod-github-runner-207 kernel: [16584.570057] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 10:00:10 juju-e4d256-prod-github-runner-207 kernel: [16584.571458] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 10:00:10 juju-e4d256-prod-github-runner-207 kernel: [16584.572962] Call Trace: Aug 22 10:00:10 juju-e4d256-prod-github-runner-207 kernel: [16584.574142] Aug 22 10:00:10 juju-e4d256-prod-github-runner-207 kernel: [16584.575122] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:00:10 juju-e4d256-prod-github-runner-207 kernel: [16584.576170] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:00:10 juju-e4d256-prod-github-runner-207 kernel: [16584.577218] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:00:10 juju-e4d256-prod-github-runner-207 kernel: [16584.578292] ? show_regs.part.0+0x23/0x29 Aug 22 10:00:10 juju-e4d256-prod-github-runner-207 kernel: [16584.579287] ? show_regs.cold+0x8/0xd Aug 22 10:00:10 juju-e4d256-prod-github-runner-207 kernel: [16584.580261] ? watchdog_timer_fn+0x1be/0x220 Aug 22 10:00:10 juju-e4d256-prod-github-runner-207 kernel: [16584.581298] ? lockup_detector_update_enable+0x60/0x60 Aug 22 10:00:10 juju-e4d256-prod-github-runner-207 kernel: [16584.582361] ? __hrtimer_run_queues+0x107/0x230 Aug 22 10:00:10 juju-e4d256-prod-github-runner-207 kernel: [16584.583387] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 10:00:10 juju-e4d256-prod-github-runner-207 kernel: [16584.584408] ? hrtimer_interrupt+0x101/0x220 Aug 22 10:00:10 juju-e4d256-prod-github-runner-207 kernel: [16584.585445] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 10:00:10 juju-e4d256-prod-github-runner-207 kernel: [16584.586519] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 10:00:10 juju-e4d256-prod-github-runner-207 kernel: [16584.587564] Aug 22 10:00:10 juju-e4d256-prod-github-runner-207 kernel: [16584.588415] Aug 22 10:00:10 juju-e4d256-prod-github-runner-207 kernel: [16584.589271] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 10:00:10 juju-e4d256-prod-github-runner-207 kernel: [16584.590306] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:00:10 juju-e4d256-prod-github-runner-207 kernel: [16584.591352] ? _raw_spin_lock+0x22/0x30 Aug 22 10:00:10 juju-e4d256-prod-github-runner-207 kernel: [16584.592298] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:00:10 juju-e4d256-prod-github-runner-207 kernel: [16584.593334] direct_page_fault+0x206/0x310 [kvm] Aug 22 10:00:10 juju-e4d256-prod-github-runner-207 kernel: [16584.594366] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 10:00:10 juju-e4d256-prod-github-runner-207 kernel: [16584.595375] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 10:00:10 juju-e4d256-prod-github-runner-207 kernel: [16584.596377] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 10:00:10 juju-e4d256-prod-github-runner-207 kernel: [16584.597368] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 10:00:10 juju-e4d256-prod-github-runner-207 kernel: [16584.598314] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 10:00:10 juju-e4d256-prod-github-runner-207 kernel: [16584.599297] handle_exit+0x98/0x230 [kvm_amd] Aug 22 10:00:10 juju-e4d256-prod-github-runner-207 kernel: [16584.600190] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 10:00:10 juju-e4d256-prod-github-runner-207 kernel: [16584.601230] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 10:00:10 juju-e4d256-prod-github-runner-207 kernel: [16584.602161] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 10:00:10 juju-e4d256-prod-github-runner-207 kernel: [16584.603071] vcpu_run+0x62/0x2c0 [kvm] Aug 22 10:00:10 juju-e4d256-prod-github-runner-207 kernel: [16584.603888] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 10:00:10 juju-e4d256-prod-github-runner-207 kernel: [16584.604695] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 10:00:10 juju-e4d256-prod-github-runner-207 kernel: [16584.605563] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 10:00:10 juju-e4d256-prod-github-runner-207 kernel: [16584.606368] ? __seccomp_filter+0x4a/0x4a0 Aug 22 10:00:10 juju-e4d256-prod-github-runner-207 kernel: [16584.607112] ? __fget_files+0x86/0xc0 Aug 22 10:00:10 juju-e4d256-prod-github-runner-207 kernel: [16584.607816] __x64_sys_ioctl+0x95/0xd0 Aug 22 10:00:10 juju-e4d256-prod-github-runner-207 kernel: [16584.608508] do_syscall_64+0x5c/0xc0 Aug 22 10:00:10 juju-e4d256-prod-github-runner-207 kernel: [16584.609196] ? do_futex+0x162/0x1f0 Aug 22 10:00:10 juju-e4d256-prod-github-runner-207 kernel: [16584.609847] ? __x64_sys_futex+0x78/0x1e0 Aug 22 10:00:10 juju-e4d256-prod-github-runner-207 kernel: [16584.610527] ? __secure_computing+0xa9/0x120 Aug 22 10:00:10 juju-e4d256-prod-github-runner-207 kernel: [16584.611217] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 10:00:10 juju-e4d256-prod-github-runner-207 kernel: [16584.611985] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:00:10 juju-e4d256-prod-github-runner-207 kernel: [16584.612706] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:00:10 juju-e4d256-prod-github-runner-207 kernel: [16584.613446] ? do_syscall_64+0x69/0xc0 Aug 22 10:00:10 juju-e4d256-prod-github-runner-207 kernel: [16584.614094] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:00:10 juju-e4d256-prod-github-runner-207 kernel: [16584.614805] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:00:10 juju-e4d256-prod-github-runner-207 kernel: [16584.615510] ? do_syscall_64+0x69/0xc0 Aug 22 10:00:10 juju-e4d256-prod-github-runner-207 kernel: [16584.616139] ? do_syscall_64+0x69/0xc0 Aug 22 10:00:10 juju-e4d256-prod-github-runner-207 kernel: [16584.616770] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 10:00:10 juju-e4d256-prod-github-runner-207 kernel: [16584.617495] RIP: 0033:0x7faa5d0edaff Aug 22 10:00:10 juju-e4d256-prod-github-runner-207 kernel: [16584.618123] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 10:00:10 juju-e4d256-prod-github-runner-207 kernel: [16584.620121] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 10:00:10 juju-e4d256-prod-github-runner-207 kernel: [16584.621042] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 10:00:10 juju-e4d256-prod-github-runner-207 kernel: [16584.621961] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 10:00:10 juju-e4d256-prod-github-runner-207 kernel: [16584.622860] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 10:00:10 juju-e4d256-prod-github-runner-207 kernel: [16584.623751] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 10:00:10 juju-e4d256-prod-github-runner-207 kernel: [16584.624642] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 10:00:10 juju-e4d256-prod-github-runner-207 kernel: [16584.625673] Aug 22 10:00:38 juju-e4d256-prod-github-runner-207 kernel: [16612.541980] watchdog: BUG: soft lockup - CPU#1 stuck for 15363s! [qemu-system-x86:6715] Aug 22 10:00:38 juju-e4d256-prod-github-runner-207 kernel: [16612.544202] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 10:00:38 juju-e4d256-prod-github-runner-207 kernel: [16612.544449] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 10:00:38 juju-e4d256-prod-github-runner-207 kernel: [16612.557417] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 10:00:38 juju-e4d256-prod-github-runner-207 kernel: [16612.558688] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 10:00:38 juju-e4d256-prod-github-runner-207 kernel: [16612.559915] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:00:38 juju-e4d256-prod-github-runner-207 kernel: [16612.560990] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 10:00:38 juju-e4d256-prod-github-runner-207 kernel: [16612.563562] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 10:00:38 juju-e4d256-prod-github-runner-207 kernel: [16612.564672] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 10:00:38 juju-e4d256-prod-github-runner-207 kernel: [16612.565931] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 10:00:38 juju-e4d256-prod-github-runner-207 kernel: [16612.567199] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 10:00:38 juju-e4d256-prod-github-runner-207 kernel: [16612.568377] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 10:00:38 juju-e4d256-prod-github-runner-207 kernel: [16612.569569] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 10:00:38 juju-e4d256-prod-github-runner-207 kernel: [16612.570745] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 10:00:38 juju-e4d256-prod-github-runner-207 kernel: [16612.571984] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 10:00:38 juju-e4d256-prod-github-runner-207 kernel: [16612.573110] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 10:00:38 juju-e4d256-prod-github-runner-207 kernel: [16612.574304] Call Trace: Aug 22 10:00:38 juju-e4d256-prod-github-runner-207 kernel: [16612.575229] Aug 22 10:00:38 juju-e4d256-prod-github-runner-207 kernel: [16612.576143] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:00:38 juju-e4d256-prod-github-runner-207 kernel: [16612.577200] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:00:38 juju-e4d256-prod-github-runner-207 kernel: [16612.578223] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:00:38 juju-e4d256-prod-github-runner-207 kernel: [16612.579392] ? show_regs.part.0+0x23/0x29 Aug 22 10:00:38 juju-e4d256-prod-github-runner-207 kernel: [16612.580445] ? show_regs.cold+0x8/0xd Aug 22 10:00:38 juju-e4d256-prod-github-runner-207 kernel: [16612.581536] ? watchdog_timer_fn+0x1be/0x220 Aug 22 10:00:38 juju-e4d256-prod-github-runner-207 kernel: [16612.582558] ? lockup_detector_update_enable+0x60/0x60 Aug 22 10:00:38 juju-e4d256-prod-github-runner-207 kernel: [16612.583633] ? __hrtimer_run_queues+0x107/0x230 Aug 22 10:00:38 juju-e4d256-prod-github-runner-207 kernel: [16612.584662] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 10:00:38 juju-e4d256-prod-github-runner-207 kernel: [16612.585713] ? hrtimer_interrupt+0x101/0x220 Aug 22 10:00:38 juju-e4d256-prod-github-runner-207 kernel: [16612.586749] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 10:00:38 juju-e4d256-prod-github-runner-207 kernel: [16612.587826] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 10:00:38 juju-e4d256-prod-github-runner-207 kernel: [16612.588893] Aug 22 10:00:38 juju-e4d256-prod-github-runner-207 kernel: [16612.589750] Aug 22 10:00:38 juju-e4d256-prod-github-runner-207 kernel: [16612.590589] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 10:00:38 juju-e4d256-prod-github-runner-207 kernel: [16612.591635] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:00:38 juju-e4d256-prod-github-runner-207 kernel: [16612.593151] ? _raw_spin_lock+0x22/0x30 Aug 22 10:00:38 juju-e4d256-prod-github-runner-207 kernel: [16612.594724] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:00:38 juju-e4d256-prod-github-runner-207 kernel: [16612.595791] direct_page_fault+0x206/0x310 [kvm] Aug 22 10:00:38 juju-e4d256-prod-github-runner-207 kernel: [16612.596841] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 10:00:38 juju-e4d256-prod-github-runner-207 kernel: [16612.597859] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 10:00:38 juju-e4d256-prod-github-runner-207 kernel: [16612.598868] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 10:00:38 juju-e4d256-prod-github-runner-207 kernel: [16612.599873] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 10:00:38 juju-e4d256-prod-github-runner-207 kernel: [16612.600840] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 10:00:38 juju-e4d256-prod-github-runner-207 kernel: [16612.601822] handle_exit+0x98/0x230 [kvm_amd] Aug 22 10:00:38 juju-e4d256-prod-github-runner-207 kernel: [16612.602725] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 10:00:38 juju-e4d256-prod-github-runner-207 kernel: [16612.603652] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 10:00:38 juju-e4d256-prod-github-runner-207 kernel: [16612.604579] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 10:00:38 juju-e4d256-prod-github-runner-207 kernel: [16612.605524] vcpu_run+0x62/0x2c0 [kvm] Aug 22 10:00:38 juju-e4d256-prod-github-runner-207 kernel: [16612.606346] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 10:00:38 juju-e4d256-prod-github-runner-207 kernel: [16612.607531] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 10:00:38 juju-e4d256-prod-github-runner-207 kernel: [16612.608728] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 10:00:38 juju-e4d256-prod-github-runner-207 kernel: [16612.609734] ? __seccomp_filter+0x4a/0x4a0 Aug 22 10:00:38 juju-e4d256-prod-github-runner-207 kernel: [16612.610485] ? __fget_files+0x86/0xc0 Aug 22 10:00:38 juju-e4d256-prod-github-runner-207 kernel: [16612.611197] __x64_sys_ioctl+0x95/0xd0 Aug 22 10:00:38 juju-e4d256-prod-github-runner-207 kernel: [16612.611891] do_syscall_64+0x5c/0xc0 Aug 22 10:00:38 juju-e4d256-prod-github-runner-207 kernel: [16612.612558] ? do_futex+0x162/0x1f0 Aug 22 10:00:38 juju-e4d256-prod-github-runner-207 kernel: [16612.613234] ? __x64_sys_futex+0x78/0x1e0 Aug 22 10:00:38 juju-e4d256-prod-github-runner-207 kernel: [16612.613920] ? __secure_computing+0xa9/0x120 Aug 22 10:00:38 juju-e4d256-prod-github-runner-207 kernel: [16612.614615] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 10:00:38 juju-e4d256-prod-github-runner-207 kernel: [16612.615379] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:00:38 juju-e4d256-prod-github-runner-207 kernel: [16612.616102] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:00:38 juju-e4d256-prod-github-runner-207 kernel: [16612.616847] ? do_syscall_64+0x69/0xc0 Aug 22 10:00:38 juju-e4d256-prod-github-runner-207 kernel: [16612.617496] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:00:38 juju-e4d256-prod-github-runner-207 kernel: [16612.618200] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:00:38 juju-e4d256-prod-github-runner-207 kernel: [16612.618906] ? do_syscall_64+0x69/0xc0 Aug 22 10:00:38 juju-e4d256-prod-github-runner-207 kernel: [16612.619540] ? do_syscall_64+0x69/0xc0 Aug 22 10:00:38 juju-e4d256-prod-github-runner-207 kernel: [16612.620164] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 10:00:38 juju-e4d256-prod-github-runner-207 kernel: [16612.620896] RIP: 0033:0x7faa5d0edaff Aug 22 10:00:38 juju-e4d256-prod-github-runner-207 kernel: [16612.621559] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 10:00:38 juju-e4d256-prod-github-runner-207 kernel: [16612.624196] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 10:00:38 juju-e4d256-prod-github-runner-207 kernel: [16612.625258] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 10:00:38 juju-e4d256-prod-github-runner-207 kernel: [16612.626157] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 10:00:38 juju-e4d256-prod-github-runner-207 kernel: [16612.627054] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 10:00:38 juju-e4d256-prod-github-runner-207 kernel: [16612.627951] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 10:00:38 juju-e4d256-prod-github-runner-207 kernel: [16612.628859] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 10:00:38 juju-e4d256-prod-github-runner-207 kernel: [16612.629761] Aug 22 10:01:06 juju-e4d256-prod-github-runner-207 kernel: [16640.541976] watchdog: BUG: soft lockup - CPU#1 stuck for 15389s! [qemu-system-x86:6715] Aug 22 10:01:06 juju-e4d256-prod-github-runner-207 kernel: [16640.543096] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 10:01:06 juju-e4d256-prod-github-runner-207 kernel: [16640.543164] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 10:01:06 juju-e4d256-prod-github-runner-207 kernel: [16640.555762] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 10:01:06 juju-e4d256-prod-github-runner-207 kernel: [16640.557128] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 10:01:06 juju-e4d256-prod-github-runner-207 kernel: [16640.558367] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:01:06 juju-e4d256-prod-github-runner-207 kernel: [16640.559500] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 10:01:06 juju-e4d256-prod-github-runner-207 kernel: [16640.562304] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 10:01:06 juju-e4d256-prod-github-runner-207 kernel: [16640.563560] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 10:01:06 juju-e4d256-prod-github-runner-207 kernel: [16640.564764] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 10:01:06 juju-e4d256-prod-github-runner-207 kernel: [16640.566084] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 10:01:06 juju-e4d256-prod-github-runner-207 kernel: [16640.567248] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 10:01:06 juju-e4d256-prod-github-runner-207 kernel: [16640.568421] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 10:01:06 juju-e4d256-prod-github-runner-207 kernel: [16640.569585] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 10:01:06 juju-e4d256-prod-github-runner-207 kernel: [16640.570817] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 10:01:06 juju-e4d256-prod-github-runner-207 kernel: [16640.571914] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 10:01:06 juju-e4d256-prod-github-runner-207 kernel: [16640.573125] Call Trace: Aug 22 10:01:06 juju-e4d256-prod-github-runner-207 kernel: [16640.574036] Aug 22 10:01:06 juju-e4d256-prod-github-runner-207 kernel: [16640.574922] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:01:06 juju-e4d256-prod-github-runner-207 kernel: [16640.575955] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:01:06 juju-e4d256-prod-github-runner-207 kernel: [16640.576996] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:01:06 juju-e4d256-prod-github-runner-207 kernel: [16640.578075] ? show_regs.part.0+0x23/0x29 Aug 22 10:01:06 juju-e4d256-prod-github-runner-207 kernel: [16640.579069] ? show_regs.cold+0x8/0xd Aug 22 10:01:06 juju-e4d256-prod-github-runner-207 kernel: [16640.580047] ? watchdog_timer_fn+0x1be/0x220 Aug 22 10:01:06 juju-e4d256-prod-github-runner-207 kernel: [16640.581071] ? lockup_detector_update_enable+0x60/0x60 Aug 22 10:01:06 juju-e4d256-prod-github-runner-207 kernel: [16640.582134] ? __hrtimer_run_queues+0x107/0x230 Aug 22 10:01:06 juju-e4d256-prod-github-runner-207 kernel: [16640.583176] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 10:01:06 juju-e4d256-prod-github-runner-207 kernel: [16640.584198] ? hrtimer_interrupt+0x101/0x220 Aug 22 10:01:06 juju-e4d256-prod-github-runner-207 kernel: [16640.585222] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 10:01:06 juju-e4d256-prod-github-runner-207 kernel: [16640.586289] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 10:01:06 juju-e4d256-prod-github-runner-207 kernel: [16640.587340] Aug 22 10:01:06 juju-e4d256-prod-github-runner-207 kernel: [16640.588194] Aug 22 10:01:06 juju-e4d256-prod-github-runner-207 kernel: [16640.589050] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 10:01:06 juju-e4d256-prod-github-runner-207 kernel: [16640.590084] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:01:06 juju-e4d256-prod-github-runner-207 kernel: [16640.591122] ? _raw_spin_lock+0x22/0x30 Aug 22 10:01:06 juju-e4d256-prod-github-runner-207 kernel: [16640.592066] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:01:06 juju-e4d256-prod-github-runner-207 kernel: [16640.593098] direct_page_fault+0x206/0x310 [kvm] Aug 22 10:01:06 juju-e4d256-prod-github-runner-207 kernel: [16640.594123] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 10:01:06 juju-e4d256-prod-github-runner-207 kernel: [16640.595132] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 10:01:06 juju-e4d256-prod-github-runner-207 kernel: [16640.596136] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 10:01:06 juju-e4d256-prod-github-runner-207 kernel: [16640.597120] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 10:01:06 juju-e4d256-prod-github-runner-207 kernel: [16640.598066] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 10:01:06 juju-e4d256-prod-github-runner-207 kernel: [16640.599044] handle_exit+0x98/0x230 [kvm_amd] Aug 22 10:01:06 juju-e4d256-prod-github-runner-207 kernel: [16640.599942] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 10:01:06 juju-e4d256-prod-github-runner-207 kernel: [16640.600872] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 10:01:06 juju-e4d256-prod-github-runner-207 kernel: [16640.601797] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 10:01:06 juju-e4d256-prod-github-runner-207 kernel: [16640.602699] vcpu_run+0x62/0x2c0 [kvm] Aug 22 10:01:06 juju-e4d256-prod-github-runner-207 kernel: [16640.603510] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 10:01:06 juju-e4d256-prod-github-runner-207 kernel: [16640.604316] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 10:01:06 juju-e4d256-prod-github-runner-207 kernel: [16640.605179] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 10:01:06 juju-e4d256-prod-github-runner-207 kernel: [16640.605975] ? __seccomp_filter+0x4a/0x4a0 Aug 22 10:01:06 juju-e4d256-prod-github-runner-207 kernel: [16640.606717] ? __fget_files+0x86/0xc0 Aug 22 10:01:06 juju-e4d256-prod-github-runner-207 kernel: [16640.607420] __x64_sys_ioctl+0x95/0xd0 Aug 22 10:01:06 juju-e4d256-prod-github-runner-207 kernel: [16640.608112] do_syscall_64+0x5c/0xc0 Aug 22 10:01:06 juju-e4d256-prod-github-runner-207 kernel: [16640.608792] ? do_futex+0x162/0x1f0 Aug 22 10:01:06 juju-e4d256-prod-github-runner-207 kernel: [16640.609440] ? __x64_sys_futex+0x78/0x1e0 Aug 22 10:01:06 juju-e4d256-prod-github-runner-207 kernel: [16640.610112] ? __secure_computing+0xa9/0x120 Aug 22 10:01:06 juju-e4d256-prod-github-runner-207 kernel: [16640.610801] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 10:01:06 juju-e4d256-prod-github-runner-207 kernel: [16640.611559] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:01:06 juju-e4d256-prod-github-runner-207 kernel: [16640.612280] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:01:06 juju-e4d256-prod-github-runner-207 kernel: [16640.613011] ? do_syscall_64+0x69/0xc0 Aug 22 10:01:06 juju-e4d256-prod-github-runner-207 kernel: [16640.613655] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:01:06 juju-e4d256-prod-github-runner-207 kernel: [16640.614356] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:01:06 juju-e4d256-prod-github-runner-207 kernel: [16640.615048] ? do_syscall_64+0x69/0xc0 Aug 22 10:01:06 juju-e4d256-prod-github-runner-207 kernel: [16640.615677] ? do_syscall_64+0x69/0xc0 Aug 22 10:01:06 juju-e4d256-prod-github-runner-207 kernel: [16640.616310] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 10:01:06 juju-e4d256-prod-github-runner-207 kernel: [16640.617027] RIP: 0033:0x7faa5d0edaff Aug 22 10:01:06 juju-e4d256-prod-github-runner-207 kernel: [16640.617650] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 10:01:06 juju-e4d256-prod-github-runner-207 kernel: [16640.619713] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 10:01:06 juju-e4d256-prod-github-runner-207 kernel: [16640.620764] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 10:01:06 juju-e4d256-prod-github-runner-207 kernel: [16640.621761] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 10:01:06 juju-e4d256-prod-github-runner-207 kernel: [16640.622753] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 10:01:06 juju-e4d256-prod-github-runner-207 kernel: [16640.623732] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 10:01:06 juju-e4d256-prod-github-runner-207 kernel: [16640.624646] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 10:01:06 juju-e4d256-prod-github-runner-207 kernel: [16640.625557] Aug 22 10:01:34 juju-e4d256-prod-github-runner-207 kernel: [16668.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 15415s! [qemu-system-x86:6715] Aug 22 10:01:34 juju-e4d256-prod-github-runner-207 kernel: [16668.543089] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 10:01:34 juju-e4d256-prod-github-runner-207 kernel: [16668.543158] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 10:01:34 juju-e4d256-prod-github-runner-207 kernel: [16668.555176] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 10:01:34 juju-e4d256-prod-github-runner-207 kernel: [16668.556455] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 10:01:34 juju-e4d256-prod-github-runner-207 kernel: [16668.557719] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:01:34 juju-e4d256-prod-github-runner-207 kernel: [16668.558788] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 10:01:34 juju-e4d256-prod-github-runner-207 kernel: [16668.561358] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 10:01:34 juju-e4d256-prod-github-runner-207 kernel: [16668.562402] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 10:01:34 juju-e4d256-prod-github-runner-207 kernel: [16668.563562] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 10:01:34 juju-e4d256-prod-github-runner-207 kernel: [16668.564736] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 10:01:34 juju-e4d256-prod-github-runner-207 kernel: [16668.565897] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 10:01:34 juju-e4d256-prod-github-runner-207 kernel: [16668.567068] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 10:01:34 juju-e4d256-prod-github-runner-207 kernel: [16668.568248] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 10:01:34 juju-e4d256-prod-github-runner-207 kernel: [16668.569491] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 10:01:34 juju-e4d256-prod-github-runner-207 kernel: [16668.570592] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 10:01:34 juju-e4d256-prod-github-runner-207 kernel: [16668.571779] Call Trace: Aug 22 10:01:34 juju-e4d256-prod-github-runner-207 kernel: [16668.572709] Aug 22 10:01:34 juju-e4d256-prod-github-runner-207 kernel: [16668.573779] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:01:34 juju-e4d256-prod-github-runner-207 kernel: [16668.575005] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:01:34 juju-e4d256-prod-github-runner-207 kernel: [16668.576033] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:01:34 juju-e4d256-prod-github-runner-207 kernel: [16668.577132] ? show_regs.part.0+0x23/0x29 Aug 22 10:01:34 juju-e4d256-prod-github-runner-207 kernel: [16668.578127] ? show_regs.cold+0x8/0xd Aug 22 10:01:34 juju-e4d256-prod-github-runner-207 kernel: [16668.579097] ? watchdog_timer_fn+0x1be/0x220 Aug 22 10:01:34 juju-e4d256-prod-github-runner-207 kernel: [16668.580123] ? lockup_detector_update_enable+0x60/0x60 Aug 22 10:01:34 juju-e4d256-prod-github-runner-207 kernel: [16668.581184] ? __hrtimer_run_queues+0x107/0x230 Aug 22 10:01:34 juju-e4d256-prod-github-runner-207 kernel: [16668.582208] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 10:01:34 juju-e4d256-prod-github-runner-207 kernel: [16668.583231] ? hrtimer_interrupt+0x101/0x220 Aug 22 10:01:34 juju-e4d256-prod-github-runner-207 kernel: [16668.584252] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 10:01:34 juju-e4d256-prod-github-runner-207 kernel: [16668.585316] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 10:01:34 juju-e4d256-prod-github-runner-207 kernel: [16668.586362] Aug 22 10:01:34 juju-e4d256-prod-github-runner-207 kernel: [16668.587215] Aug 22 10:01:34 juju-e4d256-prod-github-runner-207 kernel: [16668.588128] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 10:01:34 juju-e4d256-prod-github-runner-207 kernel: [16668.589172] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:01:34 juju-e4d256-prod-github-runner-207 kernel: [16668.590212] ? _raw_spin_lock+0x22/0x30 Aug 22 10:01:34 juju-e4d256-prod-github-runner-207 kernel: [16668.591161] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:01:34 juju-e4d256-prod-github-runner-207 kernel: [16668.592198] direct_page_fault+0x206/0x310 [kvm] Aug 22 10:01:34 juju-e4d256-prod-github-runner-207 kernel: [16668.593223] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 10:01:34 juju-e4d256-prod-github-runner-207 kernel: [16668.594241] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 10:01:34 juju-e4d256-prod-github-runner-207 kernel: [16668.595241] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 10:01:34 juju-e4d256-prod-github-runner-207 kernel: [16668.596225] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 10:01:34 juju-e4d256-prod-github-runner-207 kernel: [16668.597170] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 10:01:34 juju-e4d256-prod-github-runner-207 kernel: [16668.598152] handle_exit+0x98/0x230 [kvm_amd] Aug 22 10:01:34 juju-e4d256-prod-github-runner-207 kernel: [16668.599045] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 10:01:34 juju-e4d256-prod-github-runner-207 kernel: [16668.599956] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 10:01:34 juju-e4d256-prod-github-runner-207 kernel: [16668.600900] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 10:01:34 juju-e4d256-prod-github-runner-207 kernel: [16668.601808] vcpu_run+0x62/0x2c0 [kvm] Aug 22 10:01:34 juju-e4d256-prod-github-runner-207 kernel: [16668.602620] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 10:01:34 juju-e4d256-prod-github-runner-207 kernel: [16668.603433] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 10:01:34 juju-e4d256-prod-github-runner-207 kernel: [16668.604306] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 10:01:34 juju-e4d256-prod-github-runner-207 kernel: [16668.605117] ? __seccomp_filter+0x4a/0x4a0 Aug 22 10:01:34 juju-e4d256-prod-github-runner-207 kernel: [16668.605869] ? __fget_files+0x86/0xc0 Aug 22 10:01:34 juju-e4d256-prod-github-runner-207 kernel: [16668.606570] __x64_sys_ioctl+0x95/0xd0 Aug 22 10:01:34 juju-e4d256-prod-github-runner-207 kernel: [16668.607265] do_syscall_64+0x5c/0xc0 Aug 22 10:01:34 juju-e4d256-prod-github-runner-207 kernel: [16668.607933] ? do_futex+0x162/0x1f0 Aug 22 10:01:34 juju-e4d256-prod-github-runner-207 kernel: [16668.608609] ? __x64_sys_futex+0x78/0x1e0 Aug 22 10:01:34 juju-e4d256-prod-github-runner-207 kernel: [16668.609287] ? __secure_computing+0xa9/0x120 Aug 22 10:01:34 juju-e4d256-prod-github-runner-207 kernel: [16668.609974] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 10:01:34 juju-e4d256-prod-github-runner-207 kernel: [16668.610735] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:01:34 juju-e4d256-prod-github-runner-207 kernel: [16668.611462] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:01:34 juju-e4d256-prod-github-runner-207 kernel: [16668.612200] ? do_syscall_64+0x69/0xc0 Aug 22 10:01:34 juju-e4d256-prod-github-runner-207 kernel: [16668.612849] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:01:34 juju-e4d256-prod-github-runner-207 kernel: [16668.613558] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:01:34 juju-e4d256-prod-github-runner-207 kernel: [16668.614266] ? do_syscall_64+0x69/0xc0 Aug 22 10:01:34 juju-e4d256-prod-github-runner-207 kernel: [16668.614890] ? do_syscall_64+0x69/0xc0 Aug 22 10:01:34 juju-e4d256-prod-github-runner-207 kernel: [16668.615512] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 10:01:34 juju-e4d256-prod-github-runner-207 kernel: [16668.616241] RIP: 0033:0x7faa5d0edaff Aug 22 10:01:34 juju-e4d256-prod-github-runner-207 kernel: [16668.616867] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 10:01:34 juju-e4d256-prod-github-runner-207 kernel: [16668.618981] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 10:01:34 juju-e4d256-prod-github-runner-207 kernel: [16668.619913] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 10:01:34 juju-e4d256-prod-github-runner-207 kernel: [16668.620846] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 10:01:34 juju-e4d256-prod-github-runner-207 kernel: [16668.621761] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 10:01:34 juju-e4d256-prod-github-runner-207 kernel: [16668.622662] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 10:01:34 juju-e4d256-prod-github-runner-207 kernel: [16668.623569] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 10:01:34 juju-e4d256-prod-github-runner-207 kernel: [16668.624510] Aug 22 10:02:02 juju-e4d256-prod-github-runner-207 kernel: [16696.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 15441s! [qemu-system-x86:6715] Aug 22 10:02:02 juju-e4d256-prod-github-runner-207 kernel: [16696.543773] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 10:02:02 juju-e4d256-prod-github-runner-207 kernel: [16696.544032] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 10:02:02 juju-e4d256-prod-github-runner-207 kernel: [16696.556492] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 10:02:02 juju-e4d256-prod-github-runner-207 kernel: [16696.558017] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 10:02:02 juju-e4d256-prod-github-runner-207 kernel: [16696.559366] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:02:02 juju-e4d256-prod-github-runner-207 kernel: [16696.560535] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 10:02:02 juju-e4d256-prod-github-runner-207 kernel: [16696.563332] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 10:02:02 juju-e4d256-prod-github-runner-207 kernel: [16696.564405] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 10:02:02 juju-e4d256-prod-github-runner-207 kernel: [16696.565682] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 10:02:02 juju-e4d256-prod-github-runner-207 kernel: [16696.567014] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 10:02:02 juju-e4d256-prod-github-runner-207 kernel: [16696.568443] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 10:02:02 juju-e4d256-prod-github-runner-207 kernel: [16696.569696] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 10:02:02 juju-e4d256-prod-github-runner-207 kernel: [16696.571051] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 10:02:02 juju-e4d256-prod-github-runner-207 kernel: [16696.572792] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 10:02:02 juju-e4d256-prod-github-runner-207 kernel: [16696.574040] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 10:02:02 juju-e4d256-prod-github-runner-207 kernel: [16696.575509] Call Trace: Aug 22 10:02:02 juju-e4d256-prod-github-runner-207 kernel: [16696.576685] Aug 22 10:02:02 juju-e4d256-prod-github-runner-207 kernel: [16696.577726] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:02:02 juju-e4d256-prod-github-runner-207 kernel: [16696.578921] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:02:02 juju-e4d256-prod-github-runner-207 kernel: [16696.580076] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:02:02 juju-e4d256-prod-github-runner-207 kernel: [16696.581285] ? show_regs.part.0+0x23/0x29 Aug 22 10:02:02 juju-e4d256-prod-github-runner-207 kernel: [16696.582320] ? show_regs.cold+0x8/0xd Aug 22 10:02:02 juju-e4d256-prod-github-runner-207 kernel: [16696.583300] ? watchdog_timer_fn+0x1be/0x220 Aug 22 10:02:02 juju-e4d256-prod-github-runner-207 kernel: [16696.584359] ? lockup_detector_update_enable+0x60/0x60 Aug 22 10:02:02 juju-e4d256-prod-github-runner-207 kernel: [16696.585579] ? __hrtimer_run_queues+0x107/0x230 Aug 22 10:02:02 juju-e4d256-prod-github-runner-207 kernel: [16696.586661] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 10:02:02 juju-e4d256-prod-github-runner-207 kernel: [16696.587842] ? hrtimer_interrupt+0x101/0x220 Aug 22 10:02:02 juju-e4d256-prod-github-runner-207 kernel: [16696.588868] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 10:02:02 juju-e4d256-prod-github-runner-207 kernel: [16696.590026] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 10:02:02 juju-e4d256-prod-github-runner-207 kernel: [16696.591101] Aug 22 10:02:02 juju-e4d256-prod-github-runner-207 kernel: [16696.592125] Aug 22 10:02:02 juju-e4d256-prod-github-runner-207 kernel: [16696.593131] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 10:02:02 juju-e4d256-prod-github-runner-207 kernel: [16696.594173] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:02:02 juju-e4d256-prod-github-runner-207 kernel: [16696.595273] ? _raw_spin_lock+0x22/0x30 Aug 22 10:02:02 juju-e4d256-prod-github-runner-207 kernel: [16696.596422] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:02:02 juju-e4d256-prod-github-runner-207 kernel: [16696.597766] direct_page_fault+0x206/0x310 [kvm] Aug 22 10:02:02 juju-e4d256-prod-github-runner-207 kernel: [16696.598874] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 10:02:02 juju-e4d256-prod-github-runner-207 kernel: [16696.600065] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 10:02:02 juju-e4d256-prod-github-runner-207 kernel: [16696.601267] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 10:02:02 juju-e4d256-prod-github-runner-207 kernel: [16696.602491] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 10:02:02 juju-e4d256-prod-github-runner-207 kernel: [16696.603551] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 10:02:02 juju-e4d256-prod-github-runner-207 kernel: [16696.604734] handle_exit+0x98/0x230 [kvm_amd] Aug 22 10:02:02 juju-e4d256-prod-github-runner-207 kernel: [16696.605803] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 10:02:02 juju-e4d256-prod-github-runner-207 kernel: [16696.606722] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 10:02:02 juju-e4d256-prod-github-runner-207 kernel: [16696.607650] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 10:02:02 juju-e4d256-prod-github-runner-207 kernel: [16696.608564] vcpu_run+0x62/0x2c0 [kvm] Aug 22 10:02:02 juju-e4d256-prod-github-runner-207 kernel: [16696.609382] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 10:02:02 juju-e4d256-prod-github-runner-207 kernel: [16696.610193] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 10:02:02 juju-e4d256-prod-github-runner-207 kernel: [16696.611049] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 10:02:02 juju-e4d256-prod-github-runner-207 kernel: [16696.611867] ? __seccomp_filter+0x4a/0x4a0 Aug 22 10:02:02 juju-e4d256-prod-github-runner-207 kernel: [16696.612620] ? __fget_files+0x86/0xc0 Aug 22 10:02:02 juju-e4d256-prod-github-runner-207 kernel: [16696.613337] __x64_sys_ioctl+0x95/0xd0 Aug 22 10:02:02 juju-e4d256-prod-github-runner-207 kernel: [16696.614032] do_syscall_64+0x5c/0xc0 Aug 22 10:02:02 juju-e4d256-prod-github-runner-207 kernel: [16696.614706] ? do_futex+0x162/0x1f0 Aug 22 10:02:02 juju-e4d256-prod-github-runner-207 kernel: [16696.615359] ? __x64_sys_futex+0x78/0x1e0 Aug 22 10:02:02 juju-e4d256-prod-github-runner-207 kernel: [16696.616051] ? __secure_computing+0xa9/0x120 Aug 22 10:02:02 juju-e4d256-prod-github-runner-207 kernel: [16696.616745] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 10:02:02 juju-e4d256-prod-github-runner-207 kernel: [16696.617524] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:02:02 juju-e4d256-prod-github-runner-207 kernel: [16696.618248] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:02:02 juju-e4d256-prod-github-runner-207 kernel: [16696.618969] ? do_syscall_64+0x69/0xc0 Aug 22 10:02:02 juju-e4d256-prod-github-runner-207 kernel: [16696.619625] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:02:02 juju-e4d256-prod-github-runner-207 kernel: [16696.620343] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:02:02 juju-e4d256-prod-github-runner-207 kernel: [16696.621041] ? do_syscall_64+0x69/0xc0 Aug 22 10:02:02 juju-e4d256-prod-github-runner-207 kernel: [16696.621673] ? do_syscall_64+0x69/0xc0 Aug 22 10:02:02 juju-e4d256-prod-github-runner-207 kernel: [16696.622297] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 10:02:02 juju-e4d256-prod-github-runner-207 kernel: [16696.623007] RIP: 0033:0x7faa5d0edaff Aug 22 10:02:02 juju-e4d256-prod-github-runner-207 kernel: [16696.623659] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 10:02:02 juju-e4d256-prod-github-runner-207 kernel: [16696.625659] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 10:02:02 juju-e4d256-prod-github-runner-207 kernel: [16696.626572] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 10:02:02 juju-e4d256-prod-github-runner-207 kernel: [16696.627482] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 10:02:02 juju-e4d256-prod-github-runner-207 kernel: [16696.628407] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 10:02:02 juju-e4d256-prod-github-runner-207 kernel: [16696.629340] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 10:02:02 juju-e4d256-prod-github-runner-207 kernel: [16696.630238] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 10:02:02 juju-e4d256-prod-github-runner-207 kernel: [16696.631162] Aug 22 10:02:30 juju-e4d256-prod-github-runner-207 kernel: [16724.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 15467s! [qemu-system-x86:6715] Aug 22 10:02:30 juju-e4d256-prod-github-runner-207 kernel: [16724.543094] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 10:02:30 juju-e4d256-prod-github-runner-207 kernel: [16724.543163] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 10:02:30 juju-e4d256-prod-github-runner-207 kernel: [16724.555203] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 10:02:30 juju-e4d256-prod-github-runner-207 kernel: [16724.556477] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 10:02:30 juju-e4d256-prod-github-runner-207 kernel: [16724.557696] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:02:30 juju-e4d256-prod-github-runner-207 kernel: [16724.558753] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 10:02:30 juju-e4d256-prod-github-runner-207 kernel: [16724.561312] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 10:02:30 juju-e4d256-prod-github-runner-207 kernel: [16724.562377] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 10:02:30 juju-e4d256-prod-github-runner-207 kernel: [16724.563556] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 10:02:30 juju-e4d256-prod-github-runner-207 kernel: [16724.564739] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 10:02:30 juju-e4d256-prod-github-runner-207 kernel: [16724.565901] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 10:02:30 juju-e4d256-prod-github-runner-207 kernel: [16724.567063] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 10:02:30 juju-e4d256-prod-github-runner-207 kernel: [16724.568244] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 10:02:30 juju-e4d256-prod-github-runner-207 kernel: [16724.569475] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 10:02:30 juju-e4d256-prod-github-runner-207 kernel: [16724.570617] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 10:02:30 juju-e4d256-prod-github-runner-207 kernel: [16724.571850] Call Trace: Aug 22 10:02:30 juju-e4d256-prod-github-runner-207 kernel: [16724.572764] Aug 22 10:02:30 juju-e4d256-prod-github-runner-207 kernel: [16724.573652] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:02:30 juju-e4d256-prod-github-runner-207 kernel: [16724.574684] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:02:30 juju-e4d256-prod-github-runner-207 kernel: [16724.575715] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:02:30 juju-e4d256-prod-github-runner-207 kernel: [16724.576805] ? show_regs.part.0+0x23/0x29 Aug 22 10:02:30 juju-e4d256-prod-github-runner-207 kernel: [16724.577801] ? show_regs.cold+0x8/0xd Aug 22 10:02:30 juju-e4d256-prod-github-runner-207 kernel: [16724.578770] ? watchdog_timer_fn+0x1be/0x220 Aug 22 10:02:30 juju-e4d256-prod-github-runner-207 kernel: [16724.579921] ? lockup_detector_update_enable+0x60/0x60 Aug 22 10:02:30 juju-e4d256-prod-github-runner-207 kernel: [16724.580981] ? __hrtimer_run_queues+0x107/0x230 Aug 22 10:02:30 juju-e4d256-prod-github-runner-207 kernel: [16724.582005] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 10:02:30 juju-e4d256-prod-github-runner-207 kernel: [16724.583025] ? hrtimer_interrupt+0x101/0x220 Aug 22 10:02:30 juju-e4d256-prod-github-runner-207 kernel: [16724.584051] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 10:02:30 juju-e4d256-prod-github-runner-207 kernel: [16724.585114] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 10:02:30 juju-e4d256-prod-github-runner-207 kernel: [16724.586156] Aug 22 10:02:30 juju-e4d256-prod-github-runner-207 kernel: [16724.587008] Aug 22 10:02:30 juju-e4d256-prod-github-runner-207 kernel: [16724.587863] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 10:02:30 juju-e4d256-prod-github-runner-207 kernel: [16724.588893] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:02:30 juju-e4d256-prod-github-runner-207 kernel: [16724.589931] ? _raw_spin_lock+0x22/0x30 Aug 22 10:02:30 juju-e4d256-prod-github-runner-207 kernel: [16724.590873] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:02:30 juju-e4d256-prod-github-runner-207 kernel: [16724.591904] direct_page_fault+0x206/0x310 [kvm] Aug 22 10:02:30 juju-e4d256-prod-github-runner-207 kernel: [16724.592962] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 10:02:30 juju-e4d256-prod-github-runner-207 kernel: [16724.594008] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 10:02:30 juju-e4d256-prod-github-runner-207 kernel: [16724.595020] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 10:02:30 juju-e4d256-prod-github-runner-207 kernel: [16724.596012] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 10:02:30 juju-e4d256-prod-github-runner-207 kernel: [16724.596955] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 10:02:30 juju-e4d256-prod-github-runner-207 kernel: [16724.597933] handle_exit+0x98/0x230 [kvm_amd] Aug 22 10:02:30 juju-e4d256-prod-github-runner-207 kernel: [16724.598823] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 10:02:30 juju-e4d256-prod-github-runner-207 kernel: [16724.599749] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 10:02:30 juju-e4d256-prod-github-runner-207 kernel: [16724.600671] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 10:02:30 juju-e4d256-prod-github-runner-207 kernel: [16724.601656] vcpu_run+0x62/0x2c0 [kvm] Aug 22 10:02:30 juju-e4d256-prod-github-runner-207 kernel: [16724.602475] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 10:02:30 juju-e4d256-prod-github-runner-207 kernel: [16724.603326] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 10:02:30 juju-e4d256-prod-github-runner-207 kernel: [16724.604218] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 10:02:30 juju-e4d256-prod-github-runner-207 kernel: [16724.605016] ? __seccomp_filter+0x4a/0x4a0 Aug 22 10:02:30 juju-e4d256-prod-github-runner-207 kernel: [16724.605764] ? __fget_files+0x86/0xc0 Aug 22 10:02:30 juju-e4d256-prod-github-runner-207 kernel: [16724.606466] __x64_sys_ioctl+0x95/0xd0 Aug 22 10:02:30 juju-e4d256-prod-github-runner-207 kernel: [16724.607159] do_syscall_64+0x5c/0xc0 Aug 22 10:02:30 juju-e4d256-prod-github-runner-207 kernel: [16724.607836] ? do_futex+0x162/0x1f0 Aug 22 10:02:30 juju-e4d256-prod-github-runner-207 kernel: [16724.608485] ? __x64_sys_futex+0x78/0x1e0 Aug 22 10:02:30 juju-e4d256-prod-github-runner-207 kernel: [16724.609165] ? __secure_computing+0xa9/0x120 Aug 22 10:02:30 juju-e4d256-prod-github-runner-207 kernel: [16724.609854] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 10:02:30 juju-e4d256-prod-github-runner-207 kernel: [16724.610613] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:02:30 juju-e4d256-prod-github-runner-207 kernel: [16724.611334] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:02:30 juju-e4d256-prod-github-runner-207 kernel: [16724.612085] ? do_syscall_64+0x69/0xc0 Aug 22 10:02:30 juju-e4d256-prod-github-runner-207 kernel: [16724.612730] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:02:30 juju-e4d256-prod-github-runner-207 kernel: [16724.613431] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:02:30 juju-e4d256-prod-github-runner-207 kernel: [16724.614124] ? do_syscall_64+0x69/0xc0 Aug 22 10:02:30 juju-e4d256-prod-github-runner-207 kernel: [16724.614746] ? do_syscall_64+0x69/0xc0 Aug 22 10:02:30 juju-e4d256-prod-github-runner-207 kernel: [16724.615367] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 10:02:30 juju-e4d256-prod-github-runner-207 kernel: [16724.616095] RIP: 0033:0x7faa5d0edaff Aug 22 10:02:30 juju-e4d256-prod-github-runner-207 kernel: [16724.616731] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 10:02:30 juju-e4d256-prod-github-runner-207 kernel: [16724.618722] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 10:02:30 juju-e4d256-prod-github-runner-207 kernel: [16724.619653] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 10:02:30 juju-e4d256-prod-github-runner-207 kernel: [16724.620561] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 10:02:30 juju-e4d256-prod-github-runner-207 kernel: [16724.621447] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 10:02:30 juju-e4d256-prod-github-runner-207 kernel: [16724.622328] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 10:02:30 juju-e4d256-prod-github-runner-207 kernel: [16724.623210] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 10:02:30 juju-e4d256-prod-github-runner-207 kernel: [16724.624121] Aug 22 10:02:44 juju-e4d256-prod-github-runner-207 kernel: [16738.304707] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 10:02:44 juju-e4d256-prod-github-runner-207 kernel: [16738.305673] rcu: 1-....: (4142278 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=2002114 Aug 22 10:02:44 juju-e4d256-prod-github-runner-207 kernel: [16738.306787] (t=4155276 jiffies g=23269 q=23589) Aug 22 10:02:44 juju-e4d256-prod-github-runner-207 kernel: [16738.307591] NMI backtrace for cpu 1 Aug 22 10:02:44 juju-e4d256-prod-github-runner-207 kernel: [16738.308302] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 10:02:44 juju-e4d256-prod-github-runner-207 kernel: [16738.309410] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 10:02:44 juju-e4d256-prod-github-runner-207 kernel: [16738.310467] Call Trace: Aug 22 10:02:44 juju-e4d256-prod-github-runner-207 kernel: [16738.311142] Aug 22 10:02:44 juju-e4d256-prod-github-runner-207 kernel: [16738.311807] show_stack+0x52/0x5c Aug 22 10:02:44 juju-e4d256-prod-github-runner-207 kernel: [16738.312538] dump_stack_lvl+0x4a/0x63 Aug 22 10:02:44 juju-e4d256-prod-github-runner-207 kernel: [16738.313286] dump_stack+0x10/0x16 Aug 22 10:02:44 juju-e4d256-prod-github-runner-207 kernel: [16738.314025] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 10:02:44 juju-e4d256-prod-github-runner-207 kernel: [16738.314812] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 10:02:44 juju-e4d256-prod-github-runner-207 kernel: [16738.315612] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 10:02:44 juju-e4d256-prod-github-runner-207 kernel: [16738.316430] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 10:02:44 juju-e4d256-prod-github-runner-207 kernel: [16738.317248] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 10:02:44 juju-e4d256-prod-github-runner-207 kernel: [16738.318060] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 10:02:44 juju-e4d256-prod-github-runner-207 kernel: [16738.318836] print_cpu_stall.cold+0x2f/0xe2 Aug 22 10:02:44 juju-e4d256-prod-github-runner-207 kernel: [16738.319619] ? timekeeping_update+0xf7/0x150 Aug 22 10:02:44 juju-e4d256-prod-github-runner-207 kernel: [16738.320396] check_cpu_stall+0x109/0x270 Aug 22 10:02:44 juju-e4d256-prod-github-runner-207 kernel: [16738.321143] rcu_sched_clock_irq+0x9a/0x250 Aug 22 10:02:44 juju-e4d256-prod-github-runner-207 kernel: [16738.321902] update_process_times+0x94/0xd0 Aug 22 10:02:44 juju-e4d256-prod-github-runner-207 kernel: [16738.322667] tick_sched_handle+0x29/0x70 Aug 22 10:02:44 juju-e4d256-prod-github-runner-207 kernel: [16738.323430] tick_sched_timer+0x8c/0xc0 Aug 22 10:02:44 juju-e4d256-prod-github-runner-207 kernel: [16738.324174] ? tick_nohz_handler+0xb0/0xb0 Aug 22 10:02:44 juju-e4d256-prod-github-runner-207 kernel: [16738.324947] __hrtimer_run_queues+0x107/0x230 Aug 22 10:02:44 juju-e4d256-prod-github-runner-207 kernel: [16738.325732] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 10:02:44 juju-e4d256-prod-github-runner-207 kernel: [16738.326510] hrtimer_interrupt+0x101/0x220 Aug 22 10:02:44 juju-e4d256-prod-github-runner-207 kernel: [16738.327281] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 10:02:44 juju-e4d256-prod-github-runner-207 kernel: [16738.328091] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 10:02:44 juju-e4d256-prod-github-runner-207 kernel: [16738.328891] Aug 22 10:02:44 juju-e4d256-prod-github-runner-207 kernel: [16738.329543] Aug 22 10:02:44 juju-e4d256-prod-github-runner-207 kernel: [16738.330189] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 10:02:44 juju-e4d256-prod-github-runner-207 kernel: [16738.331008] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:02:44 juju-e4d256-prod-github-runner-207 kernel: [16738.331896] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 10:02:44 juju-e4d256-prod-github-runner-207 kernel: [16738.334109] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 10:02:44 juju-e4d256-prod-github-runner-207 kernel: [16738.334993] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 10:02:44 juju-e4d256-prod-github-runner-207 kernel: [16738.336007] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 10:02:44 juju-e4d256-prod-github-runner-207 kernel: [16738.336989] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 10:02:44 juju-e4d256-prod-github-runner-207 kernel: [16738.337964] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 10:02:44 juju-e4d256-prod-github-runner-207 kernel: [16738.338917] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 10:02:44 juju-e4d256-prod-github-runner-207 kernel: [16738.339899] ? _raw_spin_lock+0x22/0x30 Aug 22 10:02:44 juju-e4d256-prod-github-runner-207 kernel: [16738.340656] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:02:44 juju-e4d256-prod-github-runner-207 kernel: [16738.341506] direct_page_fault+0x206/0x310 [kvm] Aug 22 10:02:44 juju-e4d256-prod-github-runner-207 kernel: [16738.342342] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 10:02:44 juju-e4d256-prod-github-runner-207 kernel: [16738.343167] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 10:02:44 juju-e4d256-prod-github-runner-207 kernel: [16738.344072] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 10:02:44 juju-e4d256-prod-github-runner-207 kernel: [16738.344939] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 10:02:44 juju-e4d256-prod-github-runner-207 kernel: [16738.345741] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 10:02:44 juju-e4d256-prod-github-runner-207 kernel: [16738.346561] handle_exit+0x98/0x230 [kvm_amd] Aug 22 10:02:44 juju-e4d256-prod-github-runner-207 kernel: [16738.347361] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 10:02:44 juju-e4d256-prod-github-runner-207 kernel: [16738.348153] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 10:02:44 juju-e4d256-prod-github-runner-207 kernel: [16738.348949] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 10:02:44 juju-e4d256-prod-github-runner-207 kernel: [16738.349737] vcpu_run+0x62/0x2c0 [kvm] Aug 22 10:02:44 juju-e4d256-prod-github-runner-207 kernel: [16738.350457] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 10:02:44 juju-e4d256-prod-github-runner-207 kernel: [16738.351187] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 10:02:44 juju-e4d256-prod-github-runner-207 kernel: [16738.352038] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 10:02:44 juju-e4d256-prod-github-runner-207 kernel: [16738.352811] ? __seccomp_filter+0x4a/0x4a0 Aug 22 10:02:44 juju-e4d256-prod-github-runner-207 kernel: [16738.353528] ? __fget_files+0x86/0xc0 Aug 22 10:02:44 juju-e4d256-prod-github-runner-207 kernel: [16738.354399] __x64_sys_ioctl+0x95/0xd0 Aug 22 10:02:44 juju-e4d256-prod-github-runner-207 kernel: [16738.355095] do_syscall_64+0x5c/0xc0 Aug 22 10:02:44 juju-e4d256-prod-github-runner-207 kernel: [16738.355832] ? do_futex+0x162/0x1f0 Aug 22 10:02:44 juju-e4d256-prod-github-runner-207 kernel: [16738.356517] ? __x64_sys_futex+0x78/0x1e0 Aug 22 10:02:44 juju-e4d256-prod-github-runner-207 kernel: [16738.357217] ? __secure_computing+0xa9/0x120 Aug 22 10:02:44 juju-e4d256-prod-github-runner-207 kernel: [16738.357946] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 10:02:44 juju-e4d256-prod-github-runner-207 kernel: [16738.358739] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:02:44 juju-e4d256-prod-github-runner-207 kernel: [16738.359528] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:02:44 juju-e4d256-prod-github-runner-207 kernel: [16738.360294] ? do_syscall_64+0x69/0xc0 Aug 22 10:02:44 juju-e4d256-prod-github-runner-207 kernel: [16738.360990] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:02:44 juju-e4d256-prod-github-runner-207 kernel: [16738.361743] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:02:44 juju-e4d256-prod-github-runner-207 kernel: [16738.362498] ? do_syscall_64+0x69/0xc0 Aug 22 10:02:44 juju-e4d256-prod-github-runner-207 kernel: [16738.363213] ? do_syscall_64+0x69/0xc0 Aug 22 10:02:44 juju-e4d256-prod-github-runner-207 kernel: [16738.363925] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 10:02:44 juju-e4d256-prod-github-runner-207 kernel: [16738.364704] RIP: 0033:0x7faa5d0edaff Aug 22 10:02:44 juju-e4d256-prod-github-runner-207 kernel: [16738.365387] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 10:02:44 juju-e4d256-prod-github-runner-207 kernel: [16738.367515] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 10:02:44 juju-e4d256-prod-github-runner-207 kernel: [16738.368514] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 10:02:44 juju-e4d256-prod-github-runner-207 kernel: [16738.369466] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 10:02:44 juju-e4d256-prod-github-runner-207 kernel: [16738.370414] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 10:02:44 juju-e4d256-prod-github-runner-207 kernel: [16738.371388] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 10:02:44 juju-e4d256-prod-github-runner-207 kernel: [16738.372364] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 10:02:44 juju-e4d256-prod-github-runner-207 kernel: [16738.373280] Aug 22 10:03:10 juju-e4d256-prod-github-runner-207 kernel: [16764.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 15505s! [qemu-system-x86:6715] Aug 22 10:03:10 juju-e4d256-prod-github-runner-207 kernel: [16764.543132] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 10:03:10 juju-e4d256-prod-github-runner-207 kernel: [16764.543203] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 10:03:10 juju-e4d256-prod-github-runner-207 kernel: [16764.555532] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 10:03:10 juju-e4d256-prod-github-runner-207 kernel: [16764.556790] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 10:03:10 juju-e4d256-prod-github-runner-207 kernel: [16764.558016] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:03:10 juju-e4d256-prod-github-runner-207 kernel: [16764.559087] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 10:03:10 juju-e4d256-prod-github-runner-207 kernel: [16764.561630] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 10:03:10 juju-e4d256-prod-github-runner-207 kernel: [16764.562669] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 10:03:10 juju-e4d256-prod-github-runner-207 kernel: [16764.563972] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 10:03:10 juju-e4d256-prod-github-runner-207 kernel: [16764.565137] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 10:03:10 juju-e4d256-prod-github-runner-207 kernel: [16764.566304] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 10:03:10 juju-e4d256-prod-github-runner-207 kernel: [16764.567493] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 10:03:10 juju-e4d256-prod-github-runner-207 kernel: [16764.568851] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 10:03:10 juju-e4d256-prod-github-runner-207 kernel: [16764.570099] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 10:03:10 juju-e4d256-prod-github-runner-207 kernel: [16764.571217] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 10:03:10 juju-e4d256-prod-github-runner-207 kernel: [16764.572418] Call Trace: Aug 22 10:03:10 juju-e4d256-prod-github-runner-207 kernel: [16764.573336] Aug 22 10:03:10 juju-e4d256-prod-github-runner-207 kernel: [16764.574227] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:03:10 juju-e4d256-prod-github-runner-207 kernel: [16764.575278] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:03:10 juju-e4d256-prod-github-runner-207 kernel: [16764.576308] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:03:10 juju-e4d256-prod-github-runner-207 kernel: [16764.577390] ? show_regs.part.0+0x23/0x29 Aug 22 10:03:10 juju-e4d256-prod-github-runner-207 kernel: [16764.578385] ? show_regs.cold+0x8/0xd Aug 22 10:03:10 juju-e4d256-prod-github-runner-207 kernel: [16764.579373] ? watchdog_timer_fn+0x1be/0x220 Aug 22 10:03:10 juju-e4d256-prod-github-runner-207 kernel: [16764.580386] ? lockup_detector_update_enable+0x60/0x60 Aug 22 10:03:10 juju-e4d256-prod-github-runner-207 kernel: [16764.581446] ? __hrtimer_run_queues+0x107/0x230 Aug 22 10:03:10 juju-e4d256-prod-github-runner-207 kernel: [16764.582477] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 10:03:10 juju-e4d256-prod-github-runner-207 kernel: [16764.583513] ? hrtimer_interrupt+0x101/0x220 Aug 22 10:03:10 juju-e4d256-prod-github-runner-207 kernel: [16764.584532] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 10:03:10 juju-e4d256-prod-github-runner-207 kernel: [16764.585603] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 10:03:10 juju-e4d256-prod-github-runner-207 kernel: [16764.586651] Aug 22 10:03:10 juju-e4d256-prod-github-runner-207 kernel: [16764.587547] Aug 22 10:03:10 juju-e4d256-prod-github-runner-207 kernel: [16764.588417] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 10:03:10 juju-e4d256-prod-github-runner-207 kernel: [16764.589487] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:03:10 juju-e4d256-prod-github-runner-207 kernel: [16764.590522] ? _raw_spin_lock+0x22/0x30 Aug 22 10:03:10 juju-e4d256-prod-github-runner-207 kernel: [16764.591480] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:03:10 juju-e4d256-prod-github-runner-207 kernel: [16764.592535] direct_page_fault+0x206/0x310 [kvm] Aug 22 10:03:10 juju-e4d256-prod-github-runner-207 kernel: [16764.593558] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 10:03:10 juju-e4d256-prod-github-runner-207 kernel: [16764.594564] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 10:03:10 juju-e4d256-prod-github-runner-207 kernel: [16764.595579] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 10:03:10 juju-e4d256-prod-github-runner-207 kernel: [16764.596583] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 10:03:10 juju-e4d256-prod-github-runner-207 kernel: [16764.597573] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 10:03:10 juju-e4d256-prod-github-runner-207 kernel: [16764.598546] handle_exit+0x98/0x230 [kvm_amd] Aug 22 10:03:10 juju-e4d256-prod-github-runner-207 kernel: [16764.599445] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 10:03:10 juju-e4d256-prod-github-runner-207 kernel: [16764.600392] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 10:03:10 juju-e4d256-prod-github-runner-207 kernel: [16764.601317] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 10:03:10 juju-e4d256-prod-github-runner-207 kernel: [16764.602231] vcpu_run+0x62/0x2c0 [kvm] Aug 22 10:03:10 juju-e4d256-prod-github-runner-207 kernel: [16764.603061] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 10:03:10 juju-e4d256-prod-github-runner-207 kernel: [16764.603868] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 10:03:10 juju-e4d256-prod-github-runner-207 kernel: [16764.604721] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 10:03:10 juju-e4d256-prod-github-runner-207 kernel: [16764.605515] ? __seccomp_filter+0x4a/0x4a0 Aug 22 10:03:10 juju-e4d256-prod-github-runner-207 kernel: [16764.606255] ? __fget_files+0x86/0xc0 Aug 22 10:03:10 juju-e4d256-prod-github-runner-207 kernel: [16764.606969] __x64_sys_ioctl+0x95/0xd0 Aug 22 10:03:10 juju-e4d256-prod-github-runner-207 kernel: [16764.607665] do_syscall_64+0x5c/0xc0 Aug 22 10:03:10 juju-e4d256-prod-github-runner-207 kernel: [16764.608334] ? do_futex+0x162/0x1f0 Aug 22 10:03:10 juju-e4d256-prod-github-runner-207 kernel: [16764.608980] ? __x64_sys_futex+0x78/0x1e0 Aug 22 10:03:10 juju-e4d256-prod-github-runner-207 kernel: [16764.609657] ? __secure_computing+0xa9/0x120 Aug 22 10:03:10 juju-e4d256-prod-github-runner-207 kernel: [16764.610350] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 10:03:10 juju-e4d256-prod-github-runner-207 kernel: [16764.611125] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:03:10 juju-e4d256-prod-github-runner-207 kernel: [16764.611844] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:03:10 juju-e4d256-prod-github-runner-207 kernel: [16764.612559] ? do_syscall_64+0x69/0xc0 Aug 22 10:03:10 juju-e4d256-prod-github-runner-207 kernel: [16764.613238] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:03:10 juju-e4d256-prod-github-runner-207 kernel: [16764.613937] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:03:10 juju-e4d256-prod-github-runner-207 kernel: [16764.614630] ? do_syscall_64+0x69/0xc0 Aug 22 10:03:10 juju-e4d256-prod-github-runner-207 kernel: [16764.615274] ? do_syscall_64+0x69/0xc0 Aug 22 10:03:10 juju-e4d256-prod-github-runner-207 kernel: [16764.615893] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 10:03:10 juju-e4d256-prod-github-runner-207 kernel: [16764.616595] RIP: 0033:0x7faa5d0edaff Aug 22 10:03:10 juju-e4d256-prod-github-runner-207 kernel: [16764.617223] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 10:03:10 juju-e4d256-prod-github-runner-207 kernel: [16764.619217] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 10:03:10 juju-e4d256-prod-github-runner-207 kernel: [16764.620130] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 10:03:10 juju-e4d256-prod-github-runner-207 kernel: [16764.621015] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 10:03:10 juju-e4d256-prod-github-runner-207 kernel: [16764.621900] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 10:03:10 juju-e4d256-prod-github-runner-207 kernel: [16764.622783] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 10:03:10 juju-e4d256-prod-github-runner-207 kernel: [16764.623680] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 10:03:10 juju-e4d256-prod-github-runner-207 kernel: [16764.624565] Aug 22 10:03:38 juju-e4d256-prod-github-runner-207 kernel: [16792.541976] watchdog: BUG: soft lockup - CPU#1 stuck for 15531s! [qemu-system-x86:6715] Aug 22 10:03:38 juju-e4d256-prod-github-runner-207 kernel: [16792.543699] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 10:03:38 juju-e4d256-prod-github-runner-207 kernel: [16792.543950] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 10:03:38 juju-e4d256-prod-github-runner-207 kernel: [16792.556064] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 10:03:38 juju-e4d256-prod-github-runner-207 kernel: [16792.557334] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 10:03:38 juju-e4d256-prod-github-runner-207 kernel: [16792.558549] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:03:38 juju-e4d256-prod-github-runner-207 kernel: [16792.559606] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 10:03:38 juju-e4d256-prod-github-runner-207 kernel: [16792.562149] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 10:03:38 juju-e4d256-prod-github-runner-207 kernel: [16792.563195] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 10:03:38 juju-e4d256-prod-github-runner-207 kernel: [16792.564359] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 10:03:38 juju-e4d256-prod-github-runner-207 kernel: [16792.565517] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 10:03:38 juju-e4d256-prod-github-runner-207 kernel: [16792.566687] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 10:03:38 juju-e4d256-prod-github-runner-207 kernel: [16792.567851] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 10:03:38 juju-e4d256-prod-github-runner-207 kernel: [16792.569018] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 10:03:38 juju-e4d256-prod-github-runner-207 kernel: [16792.570254] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 10:03:38 juju-e4d256-prod-github-runner-207 kernel: [16792.571361] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 10:03:38 juju-e4d256-prod-github-runner-207 kernel: [16792.572585] Call Trace: Aug 22 10:03:38 juju-e4d256-prod-github-runner-207 kernel: [16792.573500] Aug 22 10:03:38 juju-e4d256-prod-github-runner-207 kernel: [16792.574394] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:03:38 juju-e4d256-prod-github-runner-207 kernel: [16792.575430] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:03:38 juju-e4d256-prod-github-runner-207 kernel: [16792.576449] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:03:38 juju-e4d256-prod-github-runner-207 kernel: [16792.577534] ? show_regs.part.0+0x23/0x29 Aug 22 10:03:38 juju-e4d256-prod-github-runner-207 kernel: [16792.578542] ? show_regs.cold+0x8/0xd Aug 22 10:03:38 juju-e4d256-prod-github-runner-207 kernel: [16792.579532] ? watchdog_timer_fn+0x1be/0x220 Aug 22 10:03:38 juju-e4d256-prod-github-runner-207 kernel: [16792.580543] ? lockup_detector_update_enable+0x60/0x60 Aug 22 10:03:38 juju-e4d256-prod-github-runner-207 kernel: [16792.581608] ? __hrtimer_run_queues+0x107/0x230 Aug 22 10:03:38 juju-e4d256-prod-github-runner-207 kernel: [16792.582646] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 10:03:38 juju-e4d256-prod-github-runner-207 kernel: [16792.583681] ? hrtimer_interrupt+0x101/0x220 Aug 22 10:03:38 juju-e4d256-prod-github-runner-207 kernel: [16792.584710] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 10:03:38 juju-e4d256-prod-github-runner-207 kernel: [16792.585815] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 10:03:38 juju-e4d256-prod-github-runner-207 kernel: [16792.586871] Aug 22 10:03:38 juju-e4d256-prod-github-runner-207 kernel: [16792.587724] Aug 22 10:03:38 juju-e4d256-prod-github-runner-207 kernel: [16792.588607] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 10:03:38 juju-e4d256-prod-github-runner-207 kernel: [16792.589644] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:03:38 juju-e4d256-prod-github-runner-207 kernel: [16792.590692] ? _raw_spin_lock+0x22/0x30 Aug 22 10:03:38 juju-e4d256-prod-github-runner-207 kernel: [16792.591637] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:03:38 juju-e4d256-prod-github-runner-207 kernel: [16792.592658] direct_page_fault+0x206/0x310 [kvm] Aug 22 10:03:38 juju-e4d256-prod-github-runner-207 kernel: [16792.593680] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 10:03:38 juju-e4d256-prod-github-runner-207 kernel: [16792.594704] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 10:03:38 juju-e4d256-prod-github-runner-207 kernel: [16792.595708] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 10:03:38 juju-e4d256-prod-github-runner-207 kernel: [16792.596742] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 10:03:38 juju-e4d256-prod-github-runner-207 kernel: [16792.597715] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 10:03:38 juju-e4d256-prod-github-runner-207 kernel: [16792.598697] handle_exit+0x98/0x230 [kvm_amd] Aug 22 10:03:38 juju-e4d256-prod-github-runner-207 kernel: [16792.599588] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 10:03:38 juju-e4d256-prod-github-runner-207 kernel: [16792.600499] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 10:03:38 juju-e4d256-prod-github-runner-207 kernel: [16792.601459] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 10:03:38 juju-e4d256-prod-github-runner-207 kernel: [16792.602398] vcpu_run+0x62/0x2c0 [kvm] Aug 22 10:03:38 juju-e4d256-prod-github-runner-207 kernel: [16792.603217] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 10:03:38 juju-e4d256-prod-github-runner-207 kernel: [16792.604027] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 10:03:38 juju-e4d256-prod-github-runner-207 kernel: [16792.604914] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 10:03:38 juju-e4d256-prod-github-runner-207 kernel: [16792.605748] ? __seccomp_filter+0x4a/0x4a0 Aug 22 10:03:38 juju-e4d256-prod-github-runner-207 kernel: [16792.606492] ? __fget_files+0x86/0xc0 Aug 22 10:03:38 juju-e4d256-prod-github-runner-207 kernel: [16792.607203] __x64_sys_ioctl+0x95/0xd0 Aug 22 10:03:38 juju-e4d256-prod-github-runner-207 kernel: [16792.607899] do_syscall_64+0x5c/0xc0 Aug 22 10:03:38 juju-e4d256-prod-github-runner-207 kernel: [16792.608579] ? do_futex+0x162/0x1f0 Aug 22 10:03:38 juju-e4d256-prod-github-runner-207 kernel: [16792.609234] ? __x64_sys_futex+0x78/0x1e0 Aug 22 10:03:38 juju-e4d256-prod-github-runner-207 kernel: [16792.609906] ? __secure_computing+0xa9/0x120 Aug 22 10:03:38 juju-e4d256-prod-github-runner-207 kernel: [16792.610601] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 10:03:38 juju-e4d256-prod-github-runner-207 kernel: [16792.611369] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:03:38 juju-e4d256-prod-github-runner-207 kernel: [16792.612089] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:03:38 juju-e4d256-prod-github-runner-207 kernel: [16792.612837] ? do_syscall_64+0x69/0xc0 Aug 22 10:03:38 juju-e4d256-prod-github-runner-207 kernel: [16792.613490] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:03:38 juju-e4d256-prod-github-runner-207 kernel: [16792.614203] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:03:38 juju-e4d256-prod-github-runner-207 kernel: [16792.614944] ? do_syscall_64+0x69/0xc0 Aug 22 10:03:38 juju-e4d256-prod-github-runner-207 kernel: [16792.615572] ? do_syscall_64+0x69/0xc0 Aug 22 10:03:38 juju-e4d256-prod-github-runner-207 kernel: [16792.616192] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 10:03:38 juju-e4d256-prod-github-runner-207 kernel: [16792.616898] RIP: 0033:0x7faa5d0edaff Aug 22 10:03:38 juju-e4d256-prod-github-runner-207 kernel: [16792.617575] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 10:03:38 juju-e4d256-prod-github-runner-207 kernel: [16792.619563] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 10:03:38 juju-e4d256-prod-github-runner-207 kernel: [16792.620479] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 10:03:38 juju-e4d256-prod-github-runner-207 kernel: [16792.621376] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 10:03:38 juju-e4d256-prod-github-runner-207 kernel: [16792.622267] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 10:03:38 juju-e4d256-prod-github-runner-207 kernel: [16792.623162] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 10:03:38 juju-e4d256-prod-github-runner-207 kernel: [16792.624050] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 10:03:38 juju-e4d256-prod-github-runner-207 kernel: [16792.624938] Aug 22 10:04:06 juju-e4d256-prod-github-runner-207 kernel: [16820.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 15557s! [qemu-system-x86:6715] Aug 22 10:04:06 juju-e4d256-prod-github-runner-207 kernel: [16820.543098] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 10:04:06 juju-e4d256-prod-github-runner-207 kernel: [16820.543164] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 10:04:06 juju-e4d256-prod-github-runner-207 kernel: [16820.555214] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 10:04:06 juju-e4d256-prod-github-runner-207 kernel: [16820.556482] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 10:04:06 juju-e4d256-prod-github-runner-207 kernel: [16820.557708] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:04:06 juju-e4d256-prod-github-runner-207 kernel: [16820.558778] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 10:04:06 juju-e4d256-prod-github-runner-207 kernel: [16820.561326] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 10:04:06 juju-e4d256-prod-github-runner-207 kernel: [16820.562386] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 10:04:06 juju-e4d256-prod-github-runner-207 kernel: [16820.563554] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 10:04:06 juju-e4d256-prod-github-runner-207 kernel: [16820.564713] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 10:04:06 juju-e4d256-prod-github-runner-207 kernel: [16820.565869] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 10:04:06 juju-e4d256-prod-github-runner-207 kernel: [16820.567040] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 10:04:06 juju-e4d256-prod-github-runner-207 kernel: [16820.568203] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 10:04:06 juju-e4d256-prod-github-runner-207 kernel: [16820.569432] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 10:04:06 juju-e4d256-prod-github-runner-207 kernel: [16820.570535] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 10:04:06 juju-e4d256-prod-github-runner-207 kernel: [16820.571866] Call Trace: Aug 22 10:04:06 juju-e4d256-prod-github-runner-207 kernel: [16820.572845] Aug 22 10:04:06 juju-e4d256-prod-github-runner-207 kernel: [16820.573780] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:04:06 juju-e4d256-prod-github-runner-207 kernel: [16820.574908] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:04:06 juju-e4d256-prod-github-runner-207 kernel: [16820.576010] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:04:06 juju-e4d256-prod-github-runner-207 kernel: [16820.577174] ? show_regs.part.0+0x23/0x29 Aug 22 10:04:06 juju-e4d256-prod-github-runner-207 kernel: [16820.578271] ? show_regs.cold+0x8/0xd Aug 22 10:04:06 juju-e4d256-prod-github-runner-207 kernel: [16820.579331] ? watchdog_timer_fn+0x1be/0x220 Aug 22 10:04:06 juju-e4d256-prod-github-runner-207 kernel: [16820.580469] ? lockup_detector_update_enable+0x60/0x60 Aug 22 10:04:06 juju-e4d256-prod-github-runner-207 kernel: [16820.581695] ? __hrtimer_run_queues+0x107/0x230 Aug 22 10:04:06 juju-e4d256-prod-github-runner-207 kernel: [16820.582861] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 10:04:06 juju-e4d256-prod-github-runner-207 kernel: [16820.584004] ? hrtimer_interrupt+0x101/0x220 Aug 22 10:04:06 juju-e4d256-prod-github-runner-207 kernel: [16820.585137] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 10:04:06 juju-e4d256-prod-github-runner-207 kernel: [16820.586355] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 10:04:06 juju-e4d256-prod-github-runner-207 kernel: [16820.587494] Aug 22 10:04:06 juju-e4d256-prod-github-runner-207 kernel: [16820.588393] Aug 22 10:04:06 juju-e4d256-prod-github-runner-207 kernel: [16820.589310] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 10:04:06 juju-e4d256-prod-github-runner-207 kernel: [16820.590461] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:04:06 juju-e4d256-prod-github-runner-207 kernel: [16820.591607] ? _raw_spin_lock+0x22/0x30 Aug 22 10:04:06 juju-e4d256-prod-github-runner-207 kernel: [16820.592634] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:04:06 juju-e4d256-prod-github-runner-207 kernel: [16820.593738] direct_page_fault+0x206/0x310 [kvm] Aug 22 10:04:06 juju-e4d256-prod-github-runner-207 kernel: [16820.594862] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 10:04:06 juju-e4d256-prod-github-runner-207 kernel: [16820.595958] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 10:04:06 juju-e4d256-prod-github-runner-207 kernel: [16820.597043] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 10:04:06 juju-e4d256-prod-github-runner-207 kernel: [16820.598107] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 10:04:06 juju-e4d256-prod-github-runner-207 kernel: [16820.599150] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 10:04:06 juju-e4d256-prod-github-runner-207 kernel: [16820.600229] handle_exit+0x98/0x230 [kvm_amd] Aug 22 10:04:06 juju-e4d256-prod-github-runner-207 kernel: [16820.601202] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 10:04:06 juju-e4d256-prod-github-runner-207 kernel: [16820.602207] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 10:04:06 juju-e4d256-prod-github-runner-207 kernel: [16820.603238] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 10:04:06 juju-e4d256-prod-github-runner-207 kernel: [16820.604231] vcpu_run+0x62/0x2c0 [kvm] Aug 22 10:04:06 juju-e4d256-prod-github-runner-207 kernel: [16820.605117] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 10:04:06 juju-e4d256-prod-github-runner-207 kernel: [16820.606010] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 10:04:06 juju-e4d256-prod-github-runner-207 kernel: [16820.606972] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 10:04:06 juju-e4d256-prod-github-runner-207 kernel: [16820.607850] ? __seccomp_filter+0x4a/0x4a0 Aug 22 10:04:06 juju-e4d256-prod-github-runner-207 kernel: [16820.608678] ? __fget_files+0x86/0xc0 Aug 22 10:04:06 juju-e4d256-prod-github-runner-207 kernel: [16820.609453] __x64_sys_ioctl+0x95/0xd0 Aug 22 10:04:06 juju-e4d256-prod-github-runner-207 kernel: [16820.610233] do_syscall_64+0x5c/0xc0 Aug 22 10:04:06 juju-e4d256-prod-github-runner-207 kernel: [16820.610977] ? do_futex+0x162/0x1f0 Aug 22 10:04:06 juju-e4d256-prod-github-runner-207 kernel: [16820.611696] ? __x64_sys_futex+0x78/0x1e0 Aug 22 10:04:06 juju-e4d256-prod-github-runner-207 kernel: [16820.612447] ? __secure_computing+0xa9/0x120 Aug 22 10:04:06 juju-e4d256-prod-github-runner-207 kernel: [16820.613224] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 10:04:06 juju-e4d256-prod-github-runner-207 kernel: [16820.614093] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:04:06 juju-e4d256-prod-github-runner-207 kernel: [16820.614922] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:04:06 juju-e4d256-prod-github-runner-207 kernel: [16820.615734] ? do_syscall_64+0x69/0xc0 Aug 22 10:04:06 juju-e4d256-prod-github-runner-207 kernel: [16820.616450] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:04:06 juju-e4d256-prod-github-runner-207 kernel: [16820.617246] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:04:06 juju-e4d256-prod-github-runner-207 kernel: [16820.618037] ? do_syscall_64+0x69/0xc0 Aug 22 10:04:06 juju-e4d256-prod-github-runner-207 kernel: [16820.618745] ? do_syscall_64+0x69/0xc0 Aug 22 10:04:06 juju-e4d256-prod-github-runner-207 kernel: [16820.619443] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 10:04:06 juju-e4d256-prod-github-runner-207 kernel: [16820.620251] RIP: 0033:0x7faa5d0edaff Aug 22 10:04:06 juju-e4d256-prod-github-runner-207 kernel: [16820.620983] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 10:04:06 juju-e4d256-prod-github-runner-207 kernel: [16820.623307] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 10:04:06 juju-e4d256-prod-github-runner-207 kernel: [16820.624387] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 10:04:06 juju-e4d256-prod-github-runner-207 kernel: [16820.625444] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 10:04:06 juju-e4d256-prod-github-runner-207 kernel: [16820.626482] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 10:04:06 juju-e4d256-prod-github-runner-207 kernel: [16820.627504] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 10:04:06 juju-e4d256-prod-github-runner-207 kernel: [16820.628526] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 10:04:06 juju-e4d256-prod-github-runner-207 kernel: [16820.629549] Aug 22 10:04:34 juju-e4d256-prod-github-runner-207 kernel: [16848.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 15583s! [qemu-system-x86:6715] Aug 22 10:04:34 juju-e4d256-prod-github-runner-207 kernel: [16848.543100] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 10:04:34 juju-e4d256-prod-github-runner-207 kernel: [16848.543165] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 10:04:34 juju-e4d256-prod-github-runner-207 kernel: [16848.555218] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 10:04:34 juju-e4d256-prod-github-runner-207 kernel: [16848.556628] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 10:04:34 juju-e4d256-prod-github-runner-207 kernel: [16848.557847] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:04:34 juju-e4d256-prod-github-runner-207 kernel: [16848.558910] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 10:04:34 juju-e4d256-prod-github-runner-207 kernel: [16848.561453] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 10:04:34 juju-e4d256-prod-github-runner-207 kernel: [16848.562536] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 10:04:34 juju-e4d256-prod-github-runner-207 kernel: [16848.563700] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 10:04:34 juju-e4d256-prod-github-runner-207 kernel: [16848.564867] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 10:04:34 juju-e4d256-prod-github-runner-207 kernel: [16848.566036] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 10:04:34 juju-e4d256-prod-github-runner-207 kernel: [16848.567205] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 10:04:34 juju-e4d256-prod-github-runner-207 kernel: [16848.568373] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 10:04:34 juju-e4d256-prod-github-runner-207 kernel: [16848.569613] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 10:04:34 juju-e4d256-prod-github-runner-207 kernel: [16848.570719] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 10:04:34 juju-e4d256-prod-github-runner-207 kernel: [16848.571910] Call Trace: Aug 22 10:04:34 juju-e4d256-prod-github-runner-207 kernel: [16848.572850] Aug 22 10:04:34 juju-e4d256-prod-github-runner-207 kernel: [16848.573735] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:04:34 juju-e4d256-prod-github-runner-207 kernel: [16848.574778] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:04:34 juju-e4d256-prod-github-runner-207 kernel: [16848.575798] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:04:34 juju-e4d256-prod-github-runner-207 kernel: [16848.576871] ? show_regs.part.0+0x23/0x29 Aug 22 10:04:34 juju-e4d256-prod-github-runner-207 kernel: [16848.577870] ? show_regs.cold+0x8/0xd Aug 22 10:04:34 juju-e4d256-prod-github-runner-207 kernel: [16848.578894] ? watchdog_timer_fn+0x1be/0x220 Aug 22 10:04:34 juju-e4d256-prod-github-runner-207 kernel: [16848.579902] ? lockup_detector_update_enable+0x60/0x60 Aug 22 10:04:34 juju-e4d256-prod-github-runner-207 kernel: [16848.580965] ? __hrtimer_run_queues+0x107/0x230 Aug 22 10:04:34 juju-e4d256-prod-github-runner-207 kernel: [16848.582000] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 10:04:34 juju-e4d256-prod-github-runner-207 kernel: [16848.583061] ? hrtimer_interrupt+0x101/0x220 Aug 22 10:04:34 juju-e4d256-prod-github-runner-207 kernel: [16848.584081] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 10:04:34 juju-e4d256-prod-github-runner-207 kernel: [16848.585151] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 10:04:34 juju-e4d256-prod-github-runner-207 kernel: [16848.586205] Aug 22 10:04:34 juju-e4d256-prod-github-runner-207 kernel: [16848.587062] Aug 22 10:04:34 juju-e4d256-prod-github-runner-207 kernel: [16848.587898] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 10:04:34 juju-e4d256-prod-github-runner-207 kernel: [16848.588928] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:04:34 juju-e4d256-prod-github-runner-207 kernel: [16848.589977] ? _raw_spin_lock+0x22/0x30 Aug 22 10:04:34 juju-e4d256-prod-github-runner-207 kernel: [16848.590932] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:04:34 juju-e4d256-prod-github-runner-207 kernel: [16848.591952] direct_page_fault+0x206/0x310 [kvm] Aug 22 10:04:34 juju-e4d256-prod-github-runner-207 kernel: [16848.592989] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 10:04:34 juju-e4d256-prod-github-runner-207 kernel: [16848.594017] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 10:04:34 juju-e4d256-prod-github-runner-207 kernel: [16848.595029] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 10:04:34 juju-e4d256-prod-github-runner-207 kernel: [16848.596000] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 10:04:34 juju-e4d256-prod-github-runner-207 kernel: [16848.596946] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 10:04:34 juju-e4d256-prod-github-runner-207 kernel: [16848.597936] handle_exit+0x98/0x230 [kvm_amd] Aug 22 10:04:34 juju-e4d256-prod-github-runner-207 kernel: [16848.598827] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 10:04:34 juju-e4d256-prod-github-runner-207 kernel: [16848.599738] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 10:04:34 juju-e4d256-prod-github-runner-207 kernel: [16848.600663] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 10:04:34 juju-e4d256-prod-github-runner-207 kernel: [16848.601570] vcpu_run+0x62/0x2c0 [kvm] Aug 22 10:04:34 juju-e4d256-prod-github-runner-207 kernel: [16848.602387] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 10:04:34 juju-e4d256-prod-github-runner-207 kernel: [16848.603209] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 10:04:34 juju-e4d256-prod-github-runner-207 kernel: [16848.604072] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 10:04:34 juju-e4d256-prod-github-runner-207 kernel: [16848.604867] ? __seccomp_filter+0x4a/0x4a0 Aug 22 10:04:34 juju-e4d256-prod-github-runner-207 kernel: [16848.605610] ? __fget_files+0x86/0xc0 Aug 22 10:04:34 juju-e4d256-prod-github-runner-207 kernel: [16848.606322] __x64_sys_ioctl+0x95/0xd0 Aug 22 10:04:34 juju-e4d256-prod-github-runner-207 kernel: [16848.607020] do_syscall_64+0x5c/0xc0 Aug 22 10:04:34 juju-e4d256-prod-github-runner-207 kernel: [16848.607684] ? do_futex+0x162/0x1f0 Aug 22 10:04:34 juju-e4d256-prod-github-runner-207 kernel: [16848.608332] ? __x64_sys_futex+0x78/0x1e0 Aug 22 10:04:34 juju-e4d256-prod-github-runner-207 kernel: [16848.609004] ? __secure_computing+0xa9/0x120 Aug 22 10:04:34 juju-e4d256-prod-github-runner-207 kernel: [16848.609693] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 10:04:34 juju-e4d256-prod-github-runner-207 kernel: [16848.610461] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:04:34 juju-e4d256-prod-github-runner-207 kernel: [16848.611183] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:04:34 juju-e4d256-prod-github-runner-207 kernel: [16848.611903] ? do_syscall_64+0x69/0xc0 Aug 22 10:04:34 juju-e4d256-prod-github-runner-207 kernel: [16848.612547] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:04:34 juju-e4d256-prod-github-runner-207 kernel: [16848.613250] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:04:34 juju-e4d256-prod-github-runner-207 kernel: [16848.613976] ? do_syscall_64+0x69/0xc0 Aug 22 10:04:34 juju-e4d256-prod-github-runner-207 kernel: [16848.614604] ? do_syscall_64+0x69/0xc0 Aug 22 10:04:34 juju-e4d256-prod-github-runner-207 kernel: [16848.615231] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 10:04:34 juju-e4d256-prod-github-runner-207 kernel: [16848.615936] RIP: 0033:0x7faa5d0edaff Aug 22 10:04:34 juju-e4d256-prod-github-runner-207 kernel: [16848.616560] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 10:04:34 juju-e4d256-prod-github-runner-207 kernel: [16848.618570] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 10:04:34 juju-e4d256-prod-github-runner-207 kernel: [16848.619487] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 10:04:34 juju-e4d256-prod-github-runner-207 kernel: [16848.620377] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 10:04:34 juju-e4d256-prod-github-runner-207 kernel: [16848.621268] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 10:04:34 juju-e4d256-prod-github-runner-207 kernel: [16848.622172] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 10:04:34 juju-e4d256-prod-github-runner-207 kernel: [16848.623066] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 10:04:34 juju-e4d256-prod-github-runner-207 kernel: [16848.623968] Aug 22 10:05:02 juju-e4d256-prod-github-runner-207 kernel: [16876.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 15609s! [qemu-system-x86:6715] Aug 22 10:05:02 juju-e4d256-prod-github-runner-207 kernel: [16876.543732] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 10:05:02 juju-e4d256-prod-github-runner-207 kernel: [16876.544002] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 10:05:02 juju-e4d256-prod-github-runner-207 kernel: [16876.556420] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 10:05:02 juju-e4d256-prod-github-runner-207 kernel: [16876.557748] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 10:05:02 juju-e4d256-prod-github-runner-207 kernel: [16876.558998] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:05:02 juju-e4d256-prod-github-runner-207 kernel: [16876.560096] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 10:05:02 juju-e4d256-prod-github-runner-207 kernel: [16876.562678] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 10:05:02 juju-e4d256-prod-github-runner-207 kernel: [16876.563734] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 10:05:02 juju-e4d256-prod-github-runner-207 kernel: [16876.564911] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 10:05:02 juju-e4d256-prod-github-runner-207 kernel: [16876.566113] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 10:05:02 juju-e4d256-prod-github-runner-207 kernel: [16876.567295] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 10:05:02 juju-e4d256-prod-github-runner-207 kernel: [16876.568475] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 10:05:02 juju-e4d256-prod-github-runner-207 kernel: [16876.569676] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 10:05:02 juju-e4d256-prod-github-runner-207 kernel: [16876.570927] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 10:05:02 juju-e4d256-prod-github-runner-207 kernel: [16876.572041] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 10:05:02 juju-e4d256-prod-github-runner-207 kernel: [16876.573259] Call Trace: Aug 22 10:05:02 juju-e4d256-prod-github-runner-207 kernel: [16876.574231] Aug 22 10:05:02 juju-e4d256-prod-github-runner-207 kernel: [16876.575153] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:05:02 juju-e4d256-prod-github-runner-207 kernel: [16876.576198] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:05:02 juju-e4d256-prod-github-runner-207 kernel: [16876.577229] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:05:02 juju-e4d256-prod-github-runner-207 kernel: [16876.578351] ? show_regs.part.0+0x23/0x29 Aug 22 10:05:02 juju-e4d256-prod-github-runner-207 kernel: [16876.579361] ? show_regs.cold+0x8/0xd Aug 22 10:05:02 juju-e4d256-prod-github-runner-207 kernel: [16876.580390] ? watchdog_timer_fn+0x1be/0x220 Aug 22 10:05:02 juju-e4d256-prod-github-runner-207 kernel: [16876.581427] ? lockup_detector_update_enable+0x60/0x60 Aug 22 10:05:02 juju-e4d256-prod-github-runner-207 kernel: [16876.582529] ? __hrtimer_run_queues+0x107/0x230 Aug 22 10:05:02 juju-e4d256-prod-github-runner-207 kernel: [16876.583558] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 10:05:02 juju-e4d256-prod-github-runner-207 kernel: [16876.584602] ? hrtimer_interrupt+0x101/0x220 Aug 22 10:05:02 juju-e4d256-prod-github-runner-207 kernel: [16876.585645] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 10:05:02 juju-e4d256-prod-github-runner-207 kernel: [16876.586714] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 10:05:02 juju-e4d256-prod-github-runner-207 kernel: [16876.587761] Aug 22 10:05:02 juju-e4d256-prod-github-runner-207 kernel: [16876.588618] Aug 22 10:05:02 juju-e4d256-prod-github-runner-207 kernel: [16876.589455] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 10:05:02 juju-e4d256-prod-github-runner-207 kernel: [16876.590510] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:05:02 juju-e4d256-prod-github-runner-207 kernel: [16876.591558] ? _raw_spin_lock+0x22/0x30 Aug 22 10:05:02 juju-e4d256-prod-github-runner-207 kernel: [16876.592510] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:05:02 juju-e4d256-prod-github-runner-207 kernel: [16876.593535] direct_page_fault+0x206/0x310 [kvm] Aug 22 10:05:02 juju-e4d256-prod-github-runner-207 kernel: [16876.594601] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 10:05:02 juju-e4d256-prod-github-runner-207 kernel: [16876.595621] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 10:05:02 juju-e4d256-prod-github-runner-207 kernel: [16876.596624] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 10:05:02 juju-e4d256-prod-github-runner-207 kernel: [16876.597650] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 10:05:02 juju-e4d256-prod-github-runner-207 kernel: [16876.598631] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 10:05:02 juju-e4d256-prod-github-runner-207 kernel: [16876.599621] handle_exit+0x98/0x230 [kvm_amd] Aug 22 10:05:02 juju-e4d256-prod-github-runner-207 kernel: [16876.600511] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 10:05:02 juju-e4d256-prod-github-runner-207 kernel: [16876.601430] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 10:05:02 juju-e4d256-prod-github-runner-207 kernel: [16876.602377] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 10:05:02 juju-e4d256-prod-github-runner-207 kernel: [16876.603283] vcpu_run+0x62/0x2c0 [kvm] Aug 22 10:05:02 juju-e4d256-prod-github-runner-207 kernel: [16876.604102] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 10:05:02 juju-e4d256-prod-github-runner-207 kernel: [16876.604928] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 10:05:02 juju-e4d256-prod-github-runner-207 kernel: [16876.605809] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 10:05:02 juju-e4d256-prod-github-runner-207 kernel: [16876.606606] ? __seccomp_filter+0x4a/0x4a0 Aug 22 10:05:02 juju-e4d256-prod-github-runner-207 kernel: [16876.607355] ? __fget_files+0x86/0xc0 Aug 22 10:05:02 juju-e4d256-prod-github-runner-207 kernel: [16876.608060] __x64_sys_ioctl+0x95/0xd0 Aug 22 10:05:02 juju-e4d256-prod-github-runner-207 kernel: [16876.608755] do_syscall_64+0x5c/0xc0 Aug 22 10:05:02 juju-e4d256-prod-github-runner-207 kernel: [16876.609422] ? do_futex+0x162/0x1f0 Aug 22 10:05:02 juju-e4d256-prod-github-runner-207 kernel: [16876.610099] ? __x64_sys_futex+0x78/0x1e0 Aug 22 10:05:02 juju-e4d256-prod-github-runner-207 kernel: [16876.610773] ? __secure_computing+0xa9/0x120 Aug 22 10:05:02 juju-e4d256-prod-github-runner-207 kernel: [16876.611475] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 10:05:02 juju-e4d256-prod-github-runner-207 kernel: [16876.612248] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:05:02 juju-e4d256-prod-github-runner-207 kernel: [16876.612971] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:05:02 juju-e4d256-prod-github-runner-207 kernel: [16876.613712] ? do_syscall_64+0x69/0xc0 Aug 22 10:05:02 juju-e4d256-prod-github-runner-207 kernel: [16876.614359] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:05:02 juju-e4d256-prod-github-runner-207 kernel: [16876.615075] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:05:02 juju-e4d256-prod-github-runner-207 kernel: [16876.615784] ? do_syscall_64+0x69/0xc0 Aug 22 10:05:02 juju-e4d256-prod-github-runner-207 kernel: [16876.616431] ? do_syscall_64+0x69/0xc0 Aug 22 10:05:02 juju-e4d256-prod-github-runner-207 kernel: [16876.617054] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 10:05:02 juju-e4d256-prod-github-runner-207 kernel: [16876.617783] RIP: 0033:0x7faa5d0edaff Aug 22 10:05:02 juju-e4d256-prod-github-runner-207 kernel: [16876.618445] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 10:05:02 juju-e4d256-prod-github-runner-207 kernel: [16876.620439] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 10:05:02 juju-e4d256-prod-github-runner-207 kernel: [16876.621353] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 10:05:02 juju-e4d256-prod-github-runner-207 kernel: [16876.622272] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 10:05:02 juju-e4d256-prod-github-runner-207 kernel: [16876.623164] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 10:05:02 juju-e4d256-prod-github-runner-207 kernel: [16876.624241] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 10:05:02 juju-e4d256-prod-github-runner-207 kernel: [16876.625142] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 10:05:02 juju-e4d256-prod-github-runner-207 kernel: [16876.626093] Aug 22 10:05:30 juju-e4d256-prod-github-runner-207 kernel: [16904.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 15635s! [qemu-system-x86:6715] Aug 22 10:05:30 juju-e4d256-prod-github-runner-207 kernel: [16904.543098] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 10:05:30 juju-e4d256-prod-github-runner-207 kernel: [16904.543168] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 10:05:30 juju-e4d256-prod-github-runner-207 kernel: [16904.555221] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 10:05:30 juju-e4d256-prod-github-runner-207 kernel: [16904.556486] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 10:05:30 juju-e4d256-prod-github-runner-207 kernel: [16904.557713] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:05:30 juju-e4d256-prod-github-runner-207 kernel: [16904.558770] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 10:05:30 juju-e4d256-prod-github-runner-207 kernel: [16904.561336] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 10:05:30 juju-e4d256-prod-github-runner-207 kernel: [16904.562378] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 10:05:30 juju-e4d256-prod-github-runner-207 kernel: [16904.563539] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 10:05:30 juju-e4d256-prod-github-runner-207 kernel: [16904.564694] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 10:05:30 juju-e4d256-prod-github-runner-207 kernel: [16904.565858] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 10:05:30 juju-e4d256-prod-github-runner-207 kernel: [16904.567015] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 10:05:30 juju-e4d256-prod-github-runner-207 kernel: [16904.568202] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 10:05:30 juju-e4d256-prod-github-runner-207 kernel: [16904.569454] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 10:05:30 juju-e4d256-prod-github-runner-207 kernel: [16904.570551] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 10:05:30 juju-e4d256-prod-github-runner-207 kernel: [16904.571741] Call Trace: Aug 22 10:05:30 juju-e4d256-prod-github-runner-207 kernel: [16904.572652] Aug 22 10:05:30 juju-e4d256-prod-github-runner-207 kernel: [16904.573545] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:05:30 juju-e4d256-prod-github-runner-207 kernel: [16904.574575] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:05:30 juju-e4d256-prod-github-runner-207 kernel: [16904.575595] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:05:30 juju-e4d256-prod-github-runner-207 kernel: [16904.576683] ? show_regs.part.0+0x23/0x29 Aug 22 10:05:30 juju-e4d256-prod-github-runner-207 kernel: [16904.577695] ? show_regs.cold+0x8/0xd Aug 22 10:05:30 juju-e4d256-prod-github-runner-207 kernel: [16904.578668] ? watchdog_timer_fn+0x1be/0x220 Aug 22 10:05:30 juju-e4d256-prod-github-runner-207 kernel: [16904.579675] ? lockup_detector_update_enable+0x60/0x60 Aug 22 10:05:30 juju-e4d256-prod-github-runner-207 kernel: [16904.580736] ? __hrtimer_run_queues+0x107/0x230 Aug 22 10:05:30 juju-e4d256-prod-github-runner-207 kernel: [16904.581768] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 10:05:30 juju-e4d256-prod-github-runner-207 kernel: [16904.582793] ? hrtimer_interrupt+0x101/0x220 Aug 22 10:05:30 juju-e4d256-prod-github-runner-207 kernel: [16904.583807] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 10:05:30 juju-e4d256-prod-github-runner-207 kernel: [16904.584873] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 10:05:30 juju-e4d256-prod-github-runner-207 kernel: [16904.585923] Aug 22 10:05:30 juju-e4d256-prod-github-runner-207 kernel: [16904.586775] Aug 22 10:05:30 juju-e4d256-prod-github-runner-207 kernel: [16904.587611] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 10:05:30 juju-e4d256-prod-github-runner-207 kernel: [16904.588643] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:05:30 juju-e4d256-prod-github-runner-207 kernel: [16904.589691] ? _raw_spin_lock+0x22/0x30 Aug 22 10:05:30 juju-e4d256-prod-github-runner-207 kernel: [16904.590658] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:05:30 juju-e4d256-prod-github-runner-207 kernel: [16904.591673] direct_page_fault+0x206/0x310 [kvm] Aug 22 10:05:30 juju-e4d256-prod-github-runner-207 kernel: [16904.592700] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 10:05:30 juju-e4d256-prod-github-runner-207 kernel: [16904.593719] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 10:05:30 juju-e4d256-prod-github-runner-207 kernel: [16904.594723] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 10:05:30 juju-e4d256-prod-github-runner-207 kernel: [16904.595690] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 10:05:30 juju-e4d256-prod-github-runner-207 kernel: [16904.596632] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 10:05:30 juju-e4d256-prod-github-runner-207 kernel: [16904.597618] handle_exit+0x98/0x230 [kvm_amd] Aug 22 10:05:30 juju-e4d256-prod-github-runner-207 kernel: [16904.598545] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 10:05:30 juju-e4d256-prod-github-runner-207 kernel: [16904.599460] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 10:05:30 juju-e4d256-prod-github-runner-207 kernel: [16904.600381] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 10:05:30 juju-e4d256-prod-github-runner-207 kernel: [16904.601291] vcpu_run+0x62/0x2c0 [kvm] Aug 22 10:05:30 juju-e4d256-prod-github-runner-207 kernel: [16904.602100] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 10:05:30 juju-e4d256-prod-github-runner-207 kernel: [16904.602940] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 10:05:30 juju-e4d256-prod-github-runner-207 kernel: [16904.603795] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 10:05:30 juju-e4d256-prod-github-runner-207 kernel: [16904.604593] ? __seccomp_filter+0x4a/0x4a0 Aug 22 10:05:30 juju-e4d256-prod-github-runner-207 kernel: [16904.605349] ? __fget_files+0x86/0xc0 Aug 22 10:05:30 juju-e4d256-prod-github-runner-207 kernel: [16904.606054] __x64_sys_ioctl+0x95/0xd0 Aug 22 10:05:30 juju-e4d256-prod-github-runner-207 kernel: [16904.606747] do_syscall_64+0x5c/0xc0 Aug 22 10:05:30 juju-e4d256-prod-github-runner-207 kernel: [16904.607412] ? do_futex+0x162/0x1f0 Aug 22 10:05:30 juju-e4d256-prod-github-runner-207 kernel: [16904.608064] ? __x64_sys_futex+0x78/0x1e0 Aug 22 10:05:30 juju-e4d256-prod-github-runner-207 kernel: [16904.608738] ? __secure_computing+0xa9/0x120 Aug 22 10:05:30 juju-e4d256-prod-github-runner-207 kernel: [16904.609439] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 10:05:30 juju-e4d256-prod-github-runner-207 kernel: [16904.610211] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:05:30 juju-e4d256-prod-github-runner-207 kernel: [16904.610932] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:05:30 juju-e4d256-prod-github-runner-207 kernel: [16904.611652] ? do_syscall_64+0x69/0xc0 Aug 22 10:05:30 juju-e4d256-prod-github-runner-207 kernel: [16904.612296] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:05:30 juju-e4d256-prod-github-runner-207 kernel: [16904.613002] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:05:30 juju-e4d256-prod-github-runner-207 kernel: [16904.613704] ? do_syscall_64+0x69/0xc0 Aug 22 10:05:30 juju-e4d256-prod-github-runner-207 kernel: [16904.614330] ? do_syscall_64+0x69/0xc0 Aug 22 10:05:30 juju-e4d256-prod-github-runner-207 kernel: [16904.614951] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 10:05:30 juju-e4d256-prod-github-runner-207 kernel: [16904.615656] RIP: 0033:0x7faa5d0edaff Aug 22 10:05:30 juju-e4d256-prod-github-runner-207 kernel: [16904.616281] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 10:05:30 juju-e4d256-prod-github-runner-207 kernel: [16904.618274] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 10:05:30 juju-e4d256-prod-github-runner-207 kernel: [16904.619193] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 10:05:30 juju-e4d256-prod-github-runner-207 kernel: [16904.620093] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 10:05:30 juju-e4d256-prod-github-runner-207 kernel: [16904.621023] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 10:05:30 juju-e4d256-prod-github-runner-207 kernel: [16904.621993] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 10:05:30 juju-e4d256-prod-github-runner-207 kernel: [16904.622906] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 10:05:30 juju-e4d256-prod-github-runner-207 kernel: [16904.623951] Aug 22 10:05:44 juju-e4d256-prod-github-runner-207 kernel: [16918.316704] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 10:05:44 juju-e4d256-prod-github-runner-207 kernel: [16918.317683] rcu: 1-....: (4187145 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=2023976 Aug 22 10:05:44 juju-e4d256-prod-github-runner-207 kernel: [16918.318829] (t=4200279 jiffies g=23269 q=23701) Aug 22 10:05:44 juju-e4d256-prod-github-runner-207 kernel: [16918.319609] NMI backtrace for cpu 1 Aug 22 10:05:44 juju-e4d256-prod-github-runner-207 kernel: [16918.320314] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 10:05:44 juju-e4d256-prod-github-runner-207 kernel: [16918.321442] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 10:05:44 juju-e4d256-prod-github-runner-207 kernel: [16918.322499] Call Trace: Aug 22 10:05:44 juju-e4d256-prod-github-runner-207 kernel: [16918.323171] Aug 22 10:05:44 juju-e4d256-prod-github-runner-207 kernel: [16918.323829] show_stack+0x52/0x5c Aug 22 10:05:44 juju-e4d256-prod-github-runner-207 kernel: [16918.324552] dump_stack_lvl+0x4a/0x63 Aug 22 10:05:44 juju-e4d256-prod-github-runner-207 kernel: [16918.325305] dump_stack+0x10/0x16 Aug 22 10:05:44 juju-e4d256-prod-github-runner-207 kernel: [16918.326020] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 10:05:44 juju-e4d256-prod-github-runner-207 kernel: [16918.326802] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 10:05:44 juju-e4d256-prod-github-runner-207 kernel: [16918.327578] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 10:05:44 juju-e4d256-prod-github-runner-207 kernel: [16918.328395] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 10:05:44 juju-e4d256-prod-github-runner-207 kernel: [16918.329233] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 10:05:44 juju-e4d256-prod-github-runner-207 kernel: [16918.330060] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 10:05:44 juju-e4d256-prod-github-runner-207 kernel: [16918.330836] print_cpu_stall.cold+0x2f/0xe2 Aug 22 10:05:44 juju-e4d256-prod-github-runner-207 kernel: [16918.331596] ? timekeeping_update+0xf7/0x150 Aug 22 10:05:44 juju-e4d256-prod-github-runner-207 kernel: [16918.332362] check_cpu_stall+0x109/0x270 Aug 22 10:05:44 juju-e4d256-prod-github-runner-207 kernel: [16918.333132] rcu_sched_clock_irq+0x9a/0x250 Aug 22 10:05:44 juju-e4d256-prod-github-runner-207 kernel: [16918.333913] update_process_times+0x94/0xd0 Aug 22 10:05:44 juju-e4d256-prod-github-runner-207 kernel: [16918.334682] tick_sched_handle+0x29/0x70 Aug 22 10:05:44 juju-e4d256-prod-github-runner-207 kernel: [16918.335423] tick_sched_timer+0x8c/0xc0 Aug 22 10:05:44 juju-e4d256-prod-github-runner-207 kernel: [16918.336157] ? tick_nohz_handler+0xb0/0xb0 Aug 22 10:05:44 juju-e4d256-prod-github-runner-207 kernel: [16918.336941] __hrtimer_run_queues+0x107/0x230 Aug 22 10:05:44 juju-e4d256-prod-github-runner-207 kernel: [16918.337747] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 10:05:44 juju-e4d256-prod-github-runner-207 kernel: [16918.338530] hrtimer_interrupt+0x101/0x220 Aug 22 10:05:44 juju-e4d256-prod-github-runner-207 kernel: [16918.339300] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 10:05:44 juju-e4d256-prod-github-runner-207 kernel: [16918.340109] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 10:05:44 juju-e4d256-prod-github-runner-207 kernel: [16918.340907] Aug 22 10:05:44 juju-e4d256-prod-github-runner-207 kernel: [16918.341553] Aug 22 10:05:44 juju-e4d256-prod-github-runner-207 kernel: [16918.342179] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 10:05:44 juju-e4d256-prod-github-runner-207 kernel: [16918.342991] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:05:44 juju-e4d256-prod-github-runner-207 kernel: [16918.343882] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 10:05:44 juju-e4d256-prod-github-runner-207 kernel: [16918.346110] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 10:05:44 juju-e4d256-prod-github-runner-207 kernel: [16918.346989] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 10:05:44 juju-e4d256-prod-github-runner-207 kernel: [16918.347976] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 10:05:44 juju-e4d256-prod-github-runner-207 kernel: [16918.348958] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 10:05:44 juju-e4d256-prod-github-runner-207 kernel: [16918.349945] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 10:05:44 juju-e4d256-prod-github-runner-207 kernel: [16918.350896] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 10:05:44 juju-e4d256-prod-github-runner-207 kernel: [16918.351843] ? _raw_spin_lock+0x22/0x30 Aug 22 10:05:44 juju-e4d256-prod-github-runner-207 kernel: [16918.352604] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:05:44 juju-e4d256-prod-github-runner-207 kernel: [16918.353446] direct_page_fault+0x206/0x310 [kvm] Aug 22 10:05:44 juju-e4d256-prod-github-runner-207 kernel: [16918.354301] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 10:05:44 juju-e4d256-prod-github-runner-207 kernel: [16918.355132] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 10:05:44 juju-e4d256-prod-github-runner-207 kernel: [16918.355958] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 10:05:44 juju-e4d256-prod-github-runner-207 kernel: [16918.356763] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 10:05:44 juju-e4d256-prod-github-runner-207 kernel: [16918.357554] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 10:05:44 juju-e4d256-prod-github-runner-207 kernel: [16918.358374] handle_exit+0x98/0x230 [kvm_amd] Aug 22 10:05:44 juju-e4d256-prod-github-runner-207 kernel: [16918.359131] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 10:05:44 juju-e4d256-prod-github-runner-207 kernel: [16918.359918] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 10:05:44 juju-e4d256-prod-github-runner-207 kernel: [16918.360723] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 10:05:44 juju-e4d256-prod-github-runner-207 kernel: [16918.361515] vcpu_run+0x62/0x2c0 [kvm] Aug 22 10:05:44 juju-e4d256-prod-github-runner-207 kernel: [16918.362228] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 10:05:44 juju-e4d256-prod-github-runner-207 kernel: [16918.362960] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 10:05:44 juju-e4d256-prod-github-runner-207 kernel: [16918.363759] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 10:05:44 juju-e4d256-prod-github-runner-207 kernel: [16918.364529] ? __seccomp_filter+0x4a/0x4a0 Aug 22 10:05:44 juju-e4d256-prod-github-runner-207 kernel: [16918.365264] ? __fget_files+0x86/0xc0 Aug 22 10:05:44 juju-e4d256-prod-github-runner-207 kernel: [16918.365958] __x64_sys_ioctl+0x95/0xd0 Aug 22 10:05:44 juju-e4d256-prod-github-runner-207 kernel: [16918.366656] do_syscall_64+0x5c/0xc0 Aug 22 10:05:44 juju-e4d256-prod-github-runner-207 kernel: [16918.367335] ? do_futex+0x162/0x1f0 Aug 22 10:05:44 juju-e4d256-prod-github-runner-207 kernel: [16918.368005] ? __x64_sys_futex+0x78/0x1e0 Aug 22 10:05:44 juju-e4d256-prod-github-runner-207 kernel: [16918.368705] ? __secure_computing+0xa9/0x120 Aug 22 10:05:44 juju-e4d256-prod-github-runner-207 kernel: [16918.369439] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 10:05:44 juju-e4d256-prod-github-runner-207 kernel: [16918.370233] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:05:44 juju-e4d256-prod-github-runner-207 kernel: [16918.370985] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:05:44 juju-e4d256-prod-github-runner-207 kernel: [16918.371741] ? do_syscall_64+0x69/0xc0 Aug 22 10:05:44 juju-e4d256-prod-github-runner-207 kernel: [16918.372428] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:05:44 juju-e4d256-prod-github-runner-207 kernel: [16918.373194] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:05:44 juju-e4d256-prod-github-runner-207 kernel: [16918.373952] ? do_syscall_64+0x69/0xc0 Aug 22 10:05:44 juju-e4d256-prod-github-runner-207 kernel: [16918.374654] ? do_syscall_64+0x69/0xc0 Aug 22 10:05:44 juju-e4d256-prod-github-runner-207 kernel: [16918.375343] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 10:05:44 juju-e4d256-prod-github-runner-207 kernel: [16918.376113] RIP: 0033:0x7faa5d0edaff Aug 22 10:05:44 juju-e4d256-prod-github-runner-207 kernel: [16918.376795] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 10:05:44 juju-e4d256-prod-github-runner-207 kernel: [16918.378926] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 10:05:44 juju-e4d256-prod-github-runner-207 kernel: [16918.379901] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 10:05:44 juju-e4d256-prod-github-runner-207 kernel: [16918.380858] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 10:05:44 juju-e4d256-prod-github-runner-207 kernel: [16918.381818] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 10:05:44 juju-e4d256-prod-github-runner-207 kernel: [16918.382754] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 10:05:44 juju-e4d256-prod-github-runner-207 kernel: [16918.383677] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 10:05:44 juju-e4d256-prod-github-runner-207 kernel: [16918.384583] Aug 22 10:06:10 juju-e4d256-prod-github-runner-207 kernel: [16944.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 15672s! [qemu-system-x86:6715] Aug 22 10:06:10 juju-e4d256-prod-github-runner-207 kernel: [16944.543122] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 10:06:10 juju-e4d256-prod-github-runner-207 kernel: [16944.543192] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 10:06:10 juju-e4d256-prod-github-runner-207 kernel: [16944.555273] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 10:06:10 juju-e4d256-prod-github-runner-207 kernel: [16944.556539] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 10:06:10 juju-e4d256-prod-github-runner-207 kernel: [16944.557770] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:06:10 juju-e4d256-prod-github-runner-207 kernel: [16944.558830] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 10:06:10 juju-e4d256-prod-github-runner-207 kernel: [16944.561396] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 10:06:10 juju-e4d256-prod-github-runner-207 kernel: [16944.562443] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 10:06:10 juju-e4d256-prod-github-runner-207 kernel: [16944.563609] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 10:06:10 juju-e4d256-prod-github-runner-207 kernel: [16944.564782] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 10:06:10 juju-e4d256-prod-github-runner-207 kernel: [16944.565945] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 10:06:10 juju-e4d256-prod-github-runner-207 kernel: [16944.567106] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 10:06:10 juju-e4d256-prod-github-runner-207 kernel: [16944.568275] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 10:06:10 juju-e4d256-prod-github-runner-207 kernel: [16944.569517] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 10:06:10 juju-e4d256-prod-github-runner-207 kernel: [16944.570613] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 10:06:10 juju-e4d256-prod-github-runner-207 kernel: [16944.571808] Call Trace: Aug 22 10:06:10 juju-e4d256-prod-github-runner-207 kernel: [16944.572719] Aug 22 10:06:10 juju-e4d256-prod-github-runner-207 kernel: [16944.573608] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:06:10 juju-e4d256-prod-github-runner-207 kernel: [16944.574636] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:06:10 juju-e4d256-prod-github-runner-207 kernel: [16944.575782] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:06:10 juju-e4d256-prod-github-runner-207 kernel: [16944.576867] ? show_regs.part.0+0x23/0x29 Aug 22 10:06:10 juju-e4d256-prod-github-runner-207 kernel: [16944.577870] ? show_regs.cold+0x8/0xd Aug 22 10:06:10 juju-e4d256-prod-github-runner-207 kernel: [16944.578841] ? watchdog_timer_fn+0x1be/0x220 Aug 22 10:06:10 juju-e4d256-prod-github-runner-207 kernel: [16944.579848] ? lockup_detector_update_enable+0x60/0x60 Aug 22 10:06:10 juju-e4d256-prod-github-runner-207 kernel: [16944.580920] ? __hrtimer_run_queues+0x107/0x230 Aug 22 10:06:10 juju-e4d256-prod-github-runner-207 kernel: [16944.582085] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 10:06:10 juju-e4d256-prod-github-runner-207 kernel: [16944.583108] ? hrtimer_interrupt+0x101/0x220 Aug 22 10:06:10 juju-e4d256-prod-github-runner-207 kernel: [16944.584127] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 10:06:10 juju-e4d256-prod-github-runner-207 kernel: [16944.585202] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 10:06:10 juju-e4d256-prod-github-runner-207 kernel: [16944.586247] Aug 22 10:06:10 juju-e4d256-prod-github-runner-207 kernel: [16944.587105] Aug 22 10:06:10 juju-e4d256-prod-github-runner-207 kernel: [16944.587942] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 10:06:10 juju-e4d256-prod-github-runner-207 kernel: [16944.588985] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:06:10 juju-e4d256-prod-github-runner-207 kernel: [16944.590024] ? _raw_spin_lock+0x22/0x30 Aug 22 10:06:10 juju-e4d256-prod-github-runner-207 kernel: [16944.590967] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:06:10 juju-e4d256-prod-github-runner-207 kernel: [16944.591981] direct_page_fault+0x206/0x310 [kvm] Aug 22 10:06:10 juju-e4d256-prod-github-runner-207 kernel: [16944.593023] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 10:06:10 juju-e4d256-prod-github-runner-207 kernel: [16944.594033] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 10:06:10 juju-e4d256-prod-github-runner-207 kernel: [16944.595031] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 10:06:10 juju-e4d256-prod-github-runner-207 kernel: [16944.595999] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 10:06:10 juju-e4d256-prod-github-runner-207 kernel: [16944.596951] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 10:06:10 juju-e4d256-prod-github-runner-207 kernel: [16944.597996] handle_exit+0x98/0x230 [kvm_amd] Aug 22 10:06:10 juju-e4d256-prod-github-runner-207 kernel: [16944.598938] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 10:06:10 juju-e4d256-prod-github-runner-207 kernel: [16944.599874] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 10:06:10 juju-e4d256-prod-github-runner-207 kernel: [16944.600818] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 10:06:10 juju-e4d256-prod-github-runner-207 kernel: [16944.601727] vcpu_run+0x62/0x2c0 [kvm] Aug 22 10:06:10 juju-e4d256-prod-github-runner-207 kernel: [16944.602557] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 10:06:10 juju-e4d256-prod-github-runner-207 kernel: [16944.603364] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 10:06:10 juju-e4d256-prod-github-runner-207 kernel: [16944.604218] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 10:06:10 juju-e4d256-prod-github-runner-207 kernel: [16944.605023] ? __seccomp_filter+0x4a/0x4a0 Aug 22 10:06:10 juju-e4d256-prod-github-runner-207 kernel: [16944.605766] ? __fget_files+0x86/0xc0 Aug 22 10:06:10 juju-e4d256-prod-github-runner-207 kernel: [16944.606466] __x64_sys_ioctl+0x95/0xd0 Aug 22 10:06:10 juju-e4d256-prod-github-runner-207 kernel: [16944.607160] do_syscall_64+0x5c/0xc0 Aug 22 10:06:10 juju-e4d256-prod-github-runner-207 kernel: [16944.607823] ? do_futex+0x162/0x1f0 Aug 22 10:06:10 juju-e4d256-prod-github-runner-207 kernel: [16944.608500] ? __x64_sys_futex+0x78/0x1e0 Aug 22 10:06:10 juju-e4d256-prod-github-runner-207 kernel: [16944.609206] ? __secure_computing+0xa9/0x120 Aug 22 10:06:10 juju-e4d256-prod-github-runner-207 kernel: [16944.609893] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 10:06:10 juju-e4d256-prod-github-runner-207 kernel: [16944.610651] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:06:10 juju-e4d256-prod-github-runner-207 kernel: [16944.611369] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:06:10 juju-e4d256-prod-github-runner-207 kernel: [16944.612083] ? do_syscall_64+0x69/0xc0 Aug 22 10:06:10 juju-e4d256-prod-github-runner-207 kernel: [16944.612725] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:06:10 juju-e4d256-prod-github-runner-207 kernel: [16944.613453] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:06:10 juju-e4d256-prod-github-runner-207 kernel: [16944.614148] ? do_syscall_64+0x69/0xc0 Aug 22 10:06:10 juju-e4d256-prod-github-runner-207 kernel: [16944.614780] ? do_syscall_64+0x69/0xc0 Aug 22 10:06:10 juju-e4d256-prod-github-runner-207 kernel: [16944.615414] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 10:06:10 juju-e4d256-prod-github-runner-207 kernel: [16944.616117] RIP: 0033:0x7faa5d0edaff Aug 22 10:06:10 juju-e4d256-prod-github-runner-207 kernel: [16944.616757] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 10:06:10 juju-e4d256-prod-github-runner-207 kernel: [16944.618762] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 10:06:10 juju-e4d256-prod-github-runner-207 kernel: [16944.619676] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 10:06:10 juju-e4d256-prod-github-runner-207 kernel: [16944.620561] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 10:06:10 juju-e4d256-prod-github-runner-207 kernel: [16944.621457] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 10:06:10 juju-e4d256-prod-github-runner-207 kernel: [16944.622340] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 10:06:10 juju-e4d256-prod-github-runner-207 kernel: [16944.623228] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 10:06:10 juju-e4d256-prod-github-runner-207 kernel: [16944.624115] Aug 22 10:06:38 juju-e4d256-prod-github-runner-207 kernel: [16972.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 15698s! [qemu-system-x86:6715] Aug 22 10:06:38 juju-e4d256-prod-github-runner-207 kernel: [16972.543762] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 10:06:38 juju-e4d256-prod-github-runner-207 kernel: [16972.544002] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 10:06:38 juju-e4d256-prod-github-runner-207 kernel: [16972.556054] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 10:06:38 juju-e4d256-prod-github-runner-207 kernel: [16972.557326] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 10:06:38 juju-e4d256-prod-github-runner-207 kernel: [16972.558554] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:06:38 juju-e4d256-prod-github-runner-207 kernel: [16972.559617] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 10:06:38 juju-e4d256-prod-github-runner-207 kernel: [16972.562322] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 10:06:38 juju-e4d256-prod-github-runner-207 kernel: [16972.563488] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 10:06:38 juju-e4d256-prod-github-runner-207 kernel: [16972.564657] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 10:06:38 juju-e4d256-prod-github-runner-207 kernel: [16972.565816] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 10:06:38 juju-e4d256-prod-github-runner-207 kernel: [16972.566979] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 10:06:38 juju-e4d256-prod-github-runner-207 kernel: [16972.568141] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 10:06:38 juju-e4d256-prod-github-runner-207 kernel: [16972.569325] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 10:06:38 juju-e4d256-prod-github-runner-207 kernel: [16972.570561] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 10:06:38 juju-e4d256-prod-github-runner-207 kernel: [16972.571661] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 10:06:38 juju-e4d256-prod-github-runner-207 kernel: [16972.572863] Call Trace: Aug 22 10:06:38 juju-e4d256-prod-github-runner-207 kernel: [16972.573782] Aug 22 10:06:38 juju-e4d256-prod-github-runner-207 kernel: [16972.574679] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:06:38 juju-e4d256-prod-github-runner-207 kernel: [16972.575712] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:06:38 juju-e4d256-prod-github-runner-207 kernel: [16972.576749] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:06:38 juju-e4d256-prod-github-runner-207 kernel: [16972.577837] ? show_regs.part.0+0x23/0x29 Aug 22 10:06:38 juju-e4d256-prod-github-runner-207 kernel: [16972.578838] ? show_regs.cold+0x8/0xd Aug 22 10:06:38 juju-e4d256-prod-github-runner-207 kernel: [16972.579812] ? watchdog_timer_fn+0x1be/0x220 Aug 22 10:06:38 juju-e4d256-prod-github-runner-207 kernel: [16972.580833] ? lockup_detector_update_enable+0x60/0x60 Aug 22 10:06:38 juju-e4d256-prod-github-runner-207 kernel: [16972.581894] ? __hrtimer_run_queues+0x107/0x230 Aug 22 10:06:38 juju-e4d256-prod-github-runner-207 kernel: [16972.582925] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 10:06:38 juju-e4d256-prod-github-runner-207 kernel: [16972.583948] ? hrtimer_interrupt+0x101/0x220 Aug 22 10:06:38 juju-e4d256-prod-github-runner-207 kernel: [16972.584975] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 10:06:38 juju-e4d256-prod-github-runner-207 kernel: [16972.586044] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 10:06:38 juju-e4d256-prod-github-runner-207 kernel: [16972.587088] Aug 22 10:06:38 juju-e4d256-prod-github-runner-207 kernel: [16972.587942] Aug 22 10:06:38 juju-e4d256-prod-github-runner-207 kernel: [16972.588784] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 10:06:38 juju-e4d256-prod-github-runner-207 kernel: [16972.589816] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:06:38 juju-e4d256-prod-github-runner-207 kernel: [16972.590859] ? _raw_spin_lock+0x22/0x30 Aug 22 10:06:38 juju-e4d256-prod-github-runner-207 kernel: [16972.591806] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:06:38 juju-e4d256-prod-github-runner-207 kernel: [16972.592831] direct_page_fault+0x206/0x310 [kvm] Aug 22 10:06:38 juju-e4d256-prod-github-runner-207 kernel: [16972.593855] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 10:06:38 juju-e4d256-prod-github-runner-207 kernel: [16972.594868] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 10:06:38 juju-e4d256-prod-github-runner-207 kernel: [16972.595873] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 10:06:38 juju-e4d256-prod-github-runner-207 kernel: [16972.596964] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 10:06:38 juju-e4d256-prod-github-runner-207 kernel: [16972.597911] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 10:06:38 juju-e4d256-prod-github-runner-207 kernel: [16972.598925] handle_exit+0x98/0x230 [kvm_amd] Aug 22 10:06:38 juju-e4d256-prod-github-runner-207 kernel: [16972.599819] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 10:06:38 juju-e4d256-prod-github-runner-207 kernel: [16972.600745] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 10:06:38 juju-e4d256-prod-github-runner-207 kernel: [16972.601668] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 10:06:38 juju-e4d256-prod-github-runner-207 kernel: [16972.602568] vcpu_run+0x62/0x2c0 [kvm] Aug 22 10:06:38 juju-e4d256-prod-github-runner-207 kernel: [16972.603376] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 10:06:38 juju-e4d256-prod-github-runner-207 kernel: [16972.604187] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 10:06:38 juju-e4d256-prod-github-runner-207 kernel: [16972.605046] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 10:06:38 juju-e4d256-prod-github-runner-207 kernel: [16972.605842] ? __seccomp_filter+0x4a/0x4a0 Aug 22 10:06:38 juju-e4d256-prod-github-runner-207 kernel: [16972.606583] ? __fget_files+0x86/0xc0 Aug 22 10:06:38 juju-e4d256-prod-github-runner-207 kernel: [16972.607287] __x64_sys_ioctl+0x95/0xd0 Aug 22 10:06:38 juju-e4d256-prod-github-runner-207 kernel: [16972.608028] do_syscall_64+0x5c/0xc0 Aug 22 10:06:38 juju-e4d256-prod-github-runner-207 kernel: [16972.608747] ? do_futex+0x162/0x1f0 Aug 22 10:06:38 juju-e4d256-prod-github-runner-207 kernel: [16972.609398] ? __x64_sys_futex+0x78/0x1e0 Aug 22 10:06:38 juju-e4d256-prod-github-runner-207 kernel: [16972.610073] ? __secure_computing+0xa9/0x120 Aug 22 10:06:38 juju-e4d256-prod-github-runner-207 kernel: [16972.610762] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 10:06:38 juju-e4d256-prod-github-runner-207 kernel: [16972.611526] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:06:38 juju-e4d256-prod-github-runner-207 kernel: [16972.612245] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:06:38 juju-e4d256-prod-github-runner-207 kernel: [16972.612969] ? do_syscall_64+0x69/0xc0 Aug 22 10:06:38 juju-e4d256-prod-github-runner-207 kernel: [16972.613617] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:06:38 juju-e4d256-prod-github-runner-207 kernel: [16972.614323] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:06:38 juju-e4d256-prod-github-runner-207 kernel: [16972.615023] ? do_syscall_64+0x69/0xc0 Aug 22 10:06:38 juju-e4d256-prod-github-runner-207 kernel: [16972.615646] ? do_syscall_64+0x69/0xc0 Aug 22 10:06:38 juju-e4d256-prod-github-runner-207 kernel: [16972.616271] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 10:06:38 juju-e4d256-prod-github-runner-207 kernel: [16972.616979] RIP: 0033:0x7faa5d0edaff Aug 22 10:06:38 juju-e4d256-prod-github-runner-207 kernel: [16972.617617] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 10:06:38 juju-e4d256-prod-github-runner-207 kernel: [16972.619600] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 10:06:38 juju-e4d256-prod-github-runner-207 kernel: [16972.620518] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 10:06:38 juju-e4d256-prod-github-runner-207 kernel: [16972.621410] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 10:06:38 juju-e4d256-prod-github-runner-207 kernel: [16972.622298] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 10:06:38 juju-e4d256-prod-github-runner-207 kernel: [16972.623184] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 10:06:38 juju-e4d256-prod-github-runner-207 kernel: [16972.624080] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 10:06:38 juju-e4d256-prod-github-runner-207 kernel: [16972.624981] Aug 22 10:07:06 juju-e4d256-prod-github-runner-207 kernel: [17000.541976] watchdog: BUG: soft lockup - CPU#1 stuck for 15724s! [qemu-system-x86:6715] Aug 22 10:07:06 juju-e4d256-prod-github-runner-207 kernel: [17000.543076] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 10:07:06 juju-e4d256-prod-github-runner-207 kernel: [17000.543142] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 10:07:06 juju-e4d256-prod-github-runner-207 kernel: [17000.555169] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 10:07:06 juju-e4d256-prod-github-runner-207 kernel: [17000.556436] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 10:07:06 juju-e4d256-prod-github-runner-207 kernel: [17000.557655] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:07:06 juju-e4d256-prod-github-runner-207 kernel: [17000.558710] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 10:07:06 juju-e4d256-prod-github-runner-207 kernel: [17000.561260] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 10:07:06 juju-e4d256-prod-github-runner-207 kernel: [17000.562300] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 10:07:06 juju-e4d256-prod-github-runner-207 kernel: [17000.563460] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 10:07:06 juju-e4d256-prod-github-runner-207 kernel: [17000.564636] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 10:07:06 juju-e4d256-prod-github-runner-207 kernel: [17000.565986] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 10:07:06 juju-e4d256-prod-github-runner-207 kernel: [17000.567145] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 10:07:06 juju-e4d256-prod-github-runner-207 kernel: [17000.568325] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 10:07:06 juju-e4d256-prod-github-runner-207 kernel: [17000.569561] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 10:07:06 juju-e4d256-prod-github-runner-207 kernel: [17000.570657] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 10:07:06 juju-e4d256-prod-github-runner-207 kernel: [17000.571911] Call Trace: Aug 22 10:07:06 juju-e4d256-prod-github-runner-207 kernel: [17000.572840] Aug 22 10:07:06 juju-e4d256-prod-github-runner-207 kernel: [17000.573727] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:07:06 juju-e4d256-prod-github-runner-207 kernel: [17000.574757] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:07:06 juju-e4d256-prod-github-runner-207 kernel: [17000.575775] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:07:06 juju-e4d256-prod-github-runner-207 kernel: [17000.576859] ? show_regs.part.0+0x23/0x29 Aug 22 10:07:06 juju-e4d256-prod-github-runner-207 kernel: [17000.577856] ? show_regs.cold+0x8/0xd Aug 22 10:07:06 juju-e4d256-prod-github-runner-207 kernel: [17000.578824] ? watchdog_timer_fn+0x1be/0x220 Aug 22 10:07:06 juju-e4d256-prod-github-runner-207 kernel: [17000.579828] ? lockup_detector_update_enable+0x60/0x60 Aug 22 10:07:06 juju-e4d256-prod-github-runner-207 kernel: [17000.580907] ? __hrtimer_run_queues+0x107/0x230 Aug 22 10:07:06 juju-e4d256-prod-github-runner-207 kernel: [17000.581936] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 10:07:06 juju-e4d256-prod-github-runner-207 kernel: [17000.582956] ? hrtimer_interrupt+0x101/0x220 Aug 22 10:07:06 juju-e4d256-prod-github-runner-207 kernel: [17000.583969] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 10:07:06 juju-e4d256-prod-github-runner-207 kernel: [17000.585053] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 10:07:06 juju-e4d256-prod-github-runner-207 kernel: [17000.586096] Aug 22 10:07:06 juju-e4d256-prod-github-runner-207 kernel: [17000.586947] Aug 22 10:07:06 juju-e4d256-prod-github-runner-207 kernel: [17000.587782] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 10:07:06 juju-e4d256-prod-github-runner-207 kernel: [17000.588833] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:07:06 juju-e4d256-prod-github-runner-207 kernel: [17000.589878] ? _raw_spin_lock+0x22/0x30 Aug 22 10:07:06 juju-e4d256-prod-github-runner-207 kernel: [17000.590818] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:07:06 juju-e4d256-prod-github-runner-207 kernel: [17000.591830] direct_page_fault+0x206/0x310 [kvm] Aug 22 10:07:06 juju-e4d256-prod-github-runner-207 kernel: [17000.592871] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 10:07:06 juju-e4d256-prod-github-runner-207 kernel: [17000.593881] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 10:07:06 juju-e4d256-prod-github-runner-207 kernel: [17000.594880] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 10:07:06 juju-e4d256-prod-github-runner-207 kernel: [17000.595847] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 10:07:06 juju-e4d256-prod-github-runner-207 kernel: [17000.596801] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 10:07:06 juju-e4d256-prod-github-runner-207 kernel: [17000.597775] handle_exit+0x98/0x230 [kvm_amd] Aug 22 10:07:06 juju-e4d256-prod-github-runner-207 kernel: [17000.598664] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 10:07:06 juju-e4d256-prod-github-runner-207 kernel: [17000.599574] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 10:07:06 juju-e4d256-prod-github-runner-207 kernel: [17000.600511] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 10:07:06 juju-e4d256-prod-github-runner-207 kernel: [17000.601411] vcpu_run+0x62/0x2c0 [kvm] Aug 22 10:07:06 juju-e4d256-prod-github-runner-207 kernel: [17000.602218] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 10:07:06 juju-e4d256-prod-github-runner-207 kernel: [17000.603027] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 10:07:06 juju-e4d256-prod-github-runner-207 kernel: [17000.603876] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 10:07:06 juju-e4d256-prod-github-runner-207 kernel: [17000.604682] ? __seccomp_filter+0x4a/0x4a0 Aug 22 10:07:06 juju-e4d256-prod-github-runner-207 kernel: [17000.605420] ? __fget_files+0x86/0xc0 Aug 22 10:07:06 juju-e4d256-prod-github-runner-207 kernel: [17000.606119] __x64_sys_ioctl+0x95/0xd0 Aug 22 10:07:06 juju-e4d256-prod-github-runner-207 kernel: [17000.606806] do_syscall_64+0x5c/0xc0 Aug 22 10:07:06 juju-e4d256-prod-github-runner-207 kernel: [17000.607466] ? do_futex+0x162/0x1f0 Aug 22 10:07:06 juju-e4d256-prod-github-runner-207 kernel: [17000.608120] ? __x64_sys_futex+0x78/0x1e0 Aug 22 10:07:06 juju-e4d256-prod-github-runner-207 kernel: [17000.608790] ? __secure_computing+0xa9/0x120 Aug 22 10:07:06 juju-e4d256-prod-github-runner-207 kernel: [17000.609475] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 10:07:06 juju-e4d256-prod-github-runner-207 kernel: [17000.610235] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:07:06 juju-e4d256-prod-github-runner-207 kernel: [17000.610954] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:07:06 juju-e4d256-prod-github-runner-207 kernel: [17000.611668] ? do_syscall_64+0x69/0xc0 Aug 22 10:07:06 juju-e4d256-prod-github-runner-207 kernel: [17000.612324] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:07:06 juju-e4d256-prod-github-runner-207 kernel: [17000.613025] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:07:06 juju-e4d256-prod-github-runner-207 kernel: [17000.613716] ? do_syscall_64+0x69/0xc0 Aug 22 10:07:06 juju-e4d256-prod-github-runner-207 kernel: [17000.614344] ? do_syscall_64+0x69/0xc0 Aug 22 10:07:06 juju-e4d256-prod-github-runner-207 kernel: [17000.614962] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 10:07:06 juju-e4d256-prod-github-runner-207 kernel: [17000.615663] RIP: 0033:0x7faa5d0edaff Aug 22 10:07:06 juju-e4d256-prod-github-runner-207 kernel: [17000.616294] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 10:07:06 juju-e4d256-prod-github-runner-207 kernel: [17000.618276] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 10:07:06 juju-e4d256-prod-github-runner-207 kernel: [17000.619182] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 10:07:06 juju-e4d256-prod-github-runner-207 kernel: [17000.620085] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 10:07:06 juju-e4d256-prod-github-runner-207 kernel: [17000.620970] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 10:07:06 juju-e4d256-prod-github-runner-207 kernel: [17000.621858] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 10:07:06 juju-e4d256-prod-github-runner-207 kernel: [17000.622740] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 10:07:06 juju-e4d256-prod-github-runner-207 kernel: [17000.623628] Aug 22 10:07:34 juju-e4d256-prod-github-runner-207 kernel: [17028.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 15751s! [qemu-system-x86:6715] Aug 22 10:07:34 juju-e4d256-prod-github-runner-207 kernel: [17028.543106] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 10:07:34 juju-e4d256-prod-github-runner-207 kernel: [17028.543173] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 10:07:34 juju-e4d256-prod-github-runner-207 kernel: [17028.555218] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 10:07:34 juju-e4d256-prod-github-runner-207 kernel: [17028.556499] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 10:07:34 juju-e4d256-prod-github-runner-207 kernel: [17028.557722] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:07:34 juju-e4d256-prod-github-runner-207 kernel: [17028.558773] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 10:07:34 juju-e4d256-prod-github-runner-207 kernel: [17028.561317] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 10:07:34 juju-e4d256-prod-github-runner-207 kernel: [17028.562354] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 10:07:34 juju-e4d256-prod-github-runner-207 kernel: [17028.563509] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 10:07:34 juju-e4d256-prod-github-runner-207 kernel: [17028.564677] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 10:07:34 juju-e4d256-prod-github-runner-207 kernel: [17028.565834] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 10:07:34 juju-e4d256-prod-github-runner-207 kernel: [17028.566990] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 10:07:34 juju-e4d256-prod-github-runner-207 kernel: [17028.568159] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 10:07:34 juju-e4d256-prod-github-runner-207 kernel: [17028.569392] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 10:07:34 juju-e4d256-prod-github-runner-207 kernel: [17028.570487] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 10:07:34 juju-e4d256-prod-github-runner-207 kernel: [17028.571675] Call Trace: Aug 22 10:07:34 juju-e4d256-prod-github-runner-207 kernel: [17028.572596] Aug 22 10:07:34 juju-e4d256-prod-github-runner-207 kernel: [17028.573478] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:07:34 juju-e4d256-prod-github-runner-207 kernel: [17028.574509] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:07:34 juju-e4d256-prod-github-runner-207 kernel: [17028.575532] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:07:34 juju-e4d256-prod-github-runner-207 kernel: [17028.576611] ? show_regs.part.0+0x23/0x29 Aug 22 10:07:34 juju-e4d256-prod-github-runner-207 kernel: [17028.577605] ? show_regs.cold+0x8/0xd Aug 22 10:07:34 juju-e4d256-prod-github-runner-207 kernel: [17028.578573] ? watchdog_timer_fn+0x1be/0x220 Aug 22 10:07:34 juju-e4d256-prod-github-runner-207 kernel: [17028.579580] ? lockup_detector_update_enable+0x60/0x60 Aug 22 10:07:34 juju-e4d256-prod-github-runner-207 kernel: [17028.580653] ? __hrtimer_run_queues+0x107/0x230 Aug 22 10:07:34 juju-e4d256-prod-github-runner-207 kernel: [17028.581678] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 10:07:34 juju-e4d256-prod-github-runner-207 kernel: [17028.582699] ? hrtimer_interrupt+0x101/0x220 Aug 22 10:07:34 juju-e4d256-prod-github-runner-207 kernel: [17028.583710] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 10:07:34 juju-e4d256-prod-github-runner-207 kernel: [17028.584788] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 10:07:34 juju-e4d256-prod-github-runner-207 kernel: [17028.585831] Aug 22 10:07:34 juju-e4d256-prod-github-runner-207 kernel: [17028.586709] Aug 22 10:07:34 juju-e4d256-prod-github-runner-207 kernel: [17028.587559] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 10:07:34 juju-e4d256-prod-github-runner-207 kernel: [17028.588602] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:07:34 juju-e4d256-prod-github-runner-207 kernel: [17028.589645] ? _raw_spin_lock+0x22/0x30 Aug 22 10:07:34 juju-e4d256-prod-github-runner-207 kernel: [17028.590589] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:07:34 juju-e4d256-prod-github-runner-207 kernel: [17028.591602] direct_page_fault+0x206/0x310 [kvm] Aug 22 10:07:34 juju-e4d256-prod-github-runner-207 kernel: [17028.592640] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 10:07:34 juju-e4d256-prod-github-runner-207 kernel: [17028.593648] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 10:07:34 juju-e4d256-prod-github-runner-207 kernel: [17028.594648] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 10:07:34 juju-e4d256-prod-github-runner-207 kernel: [17028.595622] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 10:07:34 juju-e4d256-prod-github-runner-207 kernel: [17028.596581] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 10:07:34 juju-e4d256-prod-github-runner-207 kernel: [17028.597558] handle_exit+0x98/0x230 [kvm_amd] Aug 22 10:07:34 juju-e4d256-prod-github-runner-207 kernel: [17028.598455] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 10:07:34 juju-e4d256-prod-github-runner-207 kernel: [17028.599365] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 10:07:34 juju-e4d256-prod-github-runner-207 kernel: [17028.600298] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 10:07:34 juju-e4d256-prod-github-runner-207 kernel: [17028.601201] vcpu_run+0x62/0x2c0 [kvm] Aug 22 10:07:34 juju-e4d256-prod-github-runner-207 kernel: [17028.602016] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 10:07:34 juju-e4d256-prod-github-runner-207 kernel: [17028.602819] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 10:07:34 juju-e4d256-prod-github-runner-207 kernel: [17028.603670] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 10:07:34 juju-e4d256-prod-github-runner-207 kernel: [17028.604481] ? __seccomp_filter+0x4a/0x4a0 Aug 22 10:07:34 juju-e4d256-prod-github-runner-207 kernel: [17028.605224] ? __fget_files+0x86/0xc0 Aug 22 10:07:34 juju-e4d256-prod-github-runner-207 kernel: [17028.605932] __x64_sys_ioctl+0x95/0xd0 Aug 22 10:07:34 juju-e4d256-prod-github-runner-207 kernel: [17028.606621] do_syscall_64+0x5c/0xc0 Aug 22 10:07:34 juju-e4d256-prod-github-runner-207 kernel: [17028.607281] ? do_futex+0x162/0x1f0 Aug 22 10:07:34 juju-e4d256-prod-github-runner-207 kernel: [17028.607935] ? __x64_sys_futex+0x78/0x1e0 Aug 22 10:07:34 juju-e4d256-prod-github-runner-207 kernel: [17028.608607] ? __secure_computing+0xa9/0x120 Aug 22 10:07:34 juju-e4d256-prod-github-runner-207 kernel: [17028.609294] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 10:07:34 juju-e4d256-prod-github-runner-207 kernel: [17028.610050] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:07:34 juju-e4d256-prod-github-runner-207 kernel: [17028.610771] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:07:34 juju-e4d256-prod-github-runner-207 kernel: [17028.611652] ? do_syscall_64+0x69/0xc0 Aug 22 10:07:34 juju-e4d256-prod-github-runner-207 kernel: [17028.612302] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:07:34 juju-e4d256-prod-github-runner-207 kernel: [17028.613002] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:07:34 juju-e4d256-prod-github-runner-207 kernel: [17028.613696] ? do_syscall_64+0x69/0xc0 Aug 22 10:07:34 juju-e4d256-prod-github-runner-207 kernel: [17028.614318] ? do_syscall_64+0x69/0xc0 Aug 22 10:07:34 juju-e4d256-prod-github-runner-207 kernel: [17028.614942] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 10:07:34 juju-e4d256-prod-github-runner-207 kernel: [17028.615643] RIP: 0033:0x7faa5d0edaff Aug 22 10:07:34 juju-e4d256-prod-github-runner-207 kernel: [17028.616275] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 10:07:34 juju-e4d256-prod-github-runner-207 kernel: [17028.618252] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 10:07:34 juju-e4d256-prod-github-runner-207 kernel: [17028.619162] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 10:07:34 juju-e4d256-prod-github-runner-207 kernel: [17028.620056] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 10:07:34 juju-e4d256-prod-github-runner-207 kernel: [17028.620946] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 10:07:34 juju-e4d256-prod-github-runner-207 kernel: [17028.621829] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 10:07:34 juju-e4d256-prod-github-runner-207 kernel: [17028.622711] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 10:07:34 juju-e4d256-prod-github-runner-207 kernel: [17028.623597] Aug 22 10:08:02 juju-e4d256-prod-github-runner-207 kernel: [17056.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 15777s! [qemu-system-x86:6715] Aug 22 10:08:02 juju-e4d256-prod-github-runner-207 kernel: [17056.543804] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 10:08:02 juju-e4d256-prod-github-runner-207 kernel: [17056.544054] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 10:08:02 juju-e4d256-prod-github-runner-207 kernel: [17056.556119] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 10:08:02 juju-e4d256-prod-github-runner-207 kernel: [17056.557381] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 10:08:02 juju-e4d256-prod-github-runner-207 kernel: [17056.558596] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:08:02 juju-e4d256-prod-github-runner-207 kernel: [17056.559661] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 10:08:02 juju-e4d256-prod-github-runner-207 kernel: [17056.562207] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 10:08:02 juju-e4d256-prod-github-runner-207 kernel: [17056.563245] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 10:08:02 juju-e4d256-prod-github-runner-207 kernel: [17056.564417] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 10:08:02 juju-e4d256-prod-github-runner-207 kernel: [17056.565573] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 10:08:02 juju-e4d256-prod-github-runner-207 kernel: [17056.566728] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 10:08:02 juju-e4d256-prod-github-runner-207 kernel: [17056.567891] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 10:08:02 juju-e4d256-prod-github-runner-207 kernel: [17056.569055] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 10:08:02 juju-e4d256-prod-github-runner-207 kernel: [17056.570284] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 10:08:02 juju-e4d256-prod-github-runner-207 kernel: [17056.571378] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 10:08:02 juju-e4d256-prod-github-runner-207 kernel: [17056.572579] Call Trace: Aug 22 10:08:02 juju-e4d256-prod-github-runner-207 kernel: [17056.573490] Aug 22 10:08:02 juju-e4d256-prod-github-runner-207 kernel: [17056.574385] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:08:02 juju-e4d256-prod-github-runner-207 kernel: [17056.575422] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:08:02 juju-e4d256-prod-github-runner-207 kernel: [17056.576443] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:08:02 juju-e4d256-prod-github-runner-207 kernel: [17056.577543] ? show_regs.part.0+0x23/0x29 Aug 22 10:08:02 juju-e4d256-prod-github-runner-207 kernel: [17056.578543] ? show_regs.cold+0x8/0xd Aug 22 10:08:02 juju-e4d256-prod-github-runner-207 kernel: [17056.579555] ? watchdog_timer_fn+0x1be/0x220 Aug 22 10:08:02 juju-e4d256-prod-github-runner-207 kernel: [17056.580561] ? lockup_detector_update_enable+0x60/0x60 Aug 22 10:08:02 juju-e4d256-prod-github-runner-207 kernel: [17056.581620] ? __hrtimer_run_queues+0x107/0x230 Aug 22 10:08:02 juju-e4d256-prod-github-runner-207 kernel: [17056.582643] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 10:08:02 juju-e4d256-prod-github-runner-207 kernel: [17056.583672] ? hrtimer_interrupt+0x101/0x220 Aug 22 10:08:02 juju-e4d256-prod-github-runner-207 kernel: [17056.584685] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 10:08:02 juju-e4d256-prod-github-runner-207 kernel: [17056.585752] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 10:08:02 juju-e4d256-prod-github-runner-207 kernel: [17056.586796] Aug 22 10:08:02 juju-e4d256-prod-github-runner-207 kernel: [17056.587652] Aug 22 10:08:02 juju-e4d256-prod-github-runner-207 kernel: [17056.588487] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 10:08:02 juju-e4d256-prod-github-runner-207 kernel: [17056.589516] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:08:02 juju-e4d256-prod-github-runner-207 kernel: [17056.590549] ? _raw_spin_lock+0x22/0x30 Aug 22 10:08:02 juju-e4d256-prod-github-runner-207 kernel: [17056.591498] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:08:02 juju-e4d256-prod-github-runner-207 kernel: [17056.592562] direct_page_fault+0x206/0x310 [kvm] Aug 22 10:08:02 juju-e4d256-prod-github-runner-207 kernel: [17056.593591] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 10:08:02 juju-e4d256-prod-github-runner-207 kernel: [17056.594598] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 10:08:02 juju-e4d256-prod-github-runner-207 kernel: [17056.595603] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 10:08:02 juju-e4d256-prod-github-runner-207 kernel: [17056.596593] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 10:08:02 juju-e4d256-prod-github-runner-207 kernel: [17056.597538] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 10:08:02 juju-e4d256-prod-github-runner-207 kernel: [17056.598511] handle_exit+0x98/0x230 [kvm_amd] Aug 22 10:08:02 juju-e4d256-prod-github-runner-207 kernel: [17056.599414] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 10:08:02 juju-e4d256-prod-github-runner-207 kernel: [17056.600325] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 10:08:02 juju-e4d256-prod-github-runner-207 kernel: [17056.601246] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 10:08:02 juju-e4d256-prod-github-runner-207 kernel: [17056.602153] vcpu_run+0x62/0x2c0 [kvm] Aug 22 10:08:02 juju-e4d256-prod-github-runner-207 kernel: [17056.602961] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 10:08:02 juju-e4d256-prod-github-runner-207 kernel: [17056.603769] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 10:08:02 juju-e4d256-prod-github-runner-207 kernel: [17056.604621] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 10:08:02 juju-e4d256-prod-github-runner-207 kernel: [17056.605420] ? __seccomp_filter+0x4a/0x4a0 Aug 22 10:08:02 juju-e4d256-prod-github-runner-207 kernel: [17056.606160] ? __fget_files+0x86/0xc0 Aug 22 10:08:02 juju-e4d256-prod-github-runner-207 kernel: [17056.606862] __x64_sys_ioctl+0x95/0xd0 Aug 22 10:08:02 juju-e4d256-prod-github-runner-207 kernel: [17056.607562] do_syscall_64+0x5c/0xc0 Aug 22 10:08:02 juju-e4d256-prod-github-runner-207 kernel: [17056.608223] ? do_futex+0x162/0x1f0 Aug 22 10:08:02 juju-e4d256-prod-github-runner-207 kernel: [17056.608869] ? __x64_sys_futex+0x78/0x1e0 Aug 22 10:08:02 juju-e4d256-prod-github-runner-207 kernel: [17056.609542] ? __secure_computing+0xa9/0x120 Aug 22 10:08:02 juju-e4d256-prod-github-runner-207 kernel: [17056.610227] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 10:08:02 juju-e4d256-prod-github-runner-207 kernel: [17056.610984] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:08:02 juju-e4d256-prod-github-runner-207 kernel: [17056.611710] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:08:02 juju-e4d256-prod-github-runner-207 kernel: [17056.612429] ? do_syscall_64+0x69/0xc0 Aug 22 10:08:02 juju-e4d256-prod-github-runner-207 kernel: [17056.613069] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:08:02 juju-e4d256-prod-github-runner-207 kernel: [17056.613768] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:08:02 juju-e4d256-prod-github-runner-207 kernel: [17056.614459] ? do_syscall_64+0x69/0xc0 Aug 22 10:08:02 juju-e4d256-prod-github-runner-207 kernel: [17056.615084] ? do_syscall_64+0x69/0xc0 Aug 22 10:08:02 juju-e4d256-prod-github-runner-207 kernel: [17056.615709] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 10:08:02 juju-e4d256-prod-github-runner-207 kernel: [17056.616409] RIP: 0033:0x7faa5d0edaff Aug 22 10:08:02 juju-e4d256-prod-github-runner-207 kernel: [17056.617041] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 10:08:02 juju-e4d256-prod-github-runner-207 kernel: [17056.619022] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 10:08:02 juju-e4d256-prod-github-runner-207 kernel: [17056.619934] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 10:08:02 juju-e4d256-prod-github-runner-207 kernel: [17056.620819] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 10:08:02 juju-e4d256-prod-github-runner-207 kernel: [17056.621709] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 10:08:02 juju-e4d256-prod-github-runner-207 kernel: [17056.622592] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 10:08:02 juju-e4d256-prod-github-runner-207 kernel: [17056.623483] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 10:08:02 juju-e4d256-prod-github-runner-207 kernel: [17056.624372] Aug 22 10:08:30 juju-e4d256-prod-github-runner-207 kernel: [17084.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 15803s! [qemu-system-x86:6715] Aug 22 10:08:30 juju-e4d256-prod-github-runner-207 kernel: [17084.543104] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 10:08:30 juju-e4d256-prod-github-runner-207 kernel: [17084.543173] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 10:08:30 juju-e4d256-prod-github-runner-207 kernel: [17084.555364] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 10:08:30 juju-e4d256-prod-github-runner-207 kernel: [17084.556648] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 10:08:30 juju-e4d256-prod-github-runner-207 kernel: [17084.557865] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:08:30 juju-e4d256-prod-github-runner-207 kernel: [17084.558924] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 10:08:30 juju-e4d256-prod-github-runner-207 kernel: [17084.561495] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 10:08:30 juju-e4d256-prod-github-runner-207 kernel: [17084.562533] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 10:08:30 juju-e4d256-prod-github-runner-207 kernel: [17084.563710] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 10:08:30 juju-e4d256-prod-github-runner-207 kernel: [17084.564865] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 10:08:30 juju-e4d256-prod-github-runner-207 kernel: [17084.566019] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 10:08:30 juju-e4d256-prod-github-runner-207 kernel: [17084.567184] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 10:08:30 juju-e4d256-prod-github-runner-207 kernel: [17084.568345] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 10:08:30 juju-e4d256-prod-github-runner-207 kernel: [17084.569586] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 10:08:30 juju-e4d256-prod-github-runner-207 kernel: [17084.570687] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 10:08:30 juju-e4d256-prod-github-runner-207 kernel: [17084.571885] Call Trace: Aug 22 10:08:30 juju-e4d256-prod-github-runner-207 kernel: [17084.572800] Aug 22 10:08:30 juju-e4d256-prod-github-runner-207 kernel: [17084.573688] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:08:30 juju-e4d256-prod-github-runner-207 kernel: [17084.574715] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:08:30 juju-e4d256-prod-github-runner-207 kernel: [17084.575747] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:08:30 juju-e4d256-prod-github-runner-207 kernel: [17084.576838] ? show_regs.part.0+0x23/0x29 Aug 22 10:08:30 juju-e4d256-prod-github-runner-207 kernel: [17084.577848] ? show_regs.cold+0x8/0xd Aug 22 10:08:30 juju-e4d256-prod-github-runner-207 kernel: [17084.578829] ? watchdog_timer_fn+0x1be/0x220 Aug 22 10:08:30 juju-e4d256-prod-github-runner-207 kernel: [17084.579864] ? lockup_detector_update_enable+0x60/0x60 Aug 22 10:08:30 juju-e4d256-prod-github-runner-207 kernel: [17084.580940] ? __hrtimer_run_queues+0x107/0x230 Aug 22 10:08:30 juju-e4d256-prod-github-runner-207 kernel: [17084.581981] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 10:08:30 juju-e4d256-prod-github-runner-207 kernel: [17084.583028] ? hrtimer_interrupt+0x101/0x220 Aug 22 10:08:30 juju-e4d256-prod-github-runner-207 kernel: [17084.584074] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 10:08:30 juju-e4d256-prod-github-runner-207 kernel: [17084.585163] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 10:08:30 juju-e4d256-prod-github-runner-207 kernel: [17084.586242] Aug 22 10:08:30 juju-e4d256-prod-github-runner-207 kernel: [17084.587132] Aug 22 10:08:30 juju-e4d256-prod-github-runner-207 kernel: [17084.587975] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 10:08:30 juju-e4d256-prod-github-runner-207 kernel: [17084.589029] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:08:30 juju-e4d256-prod-github-runner-207 kernel: [17084.590087] ? _raw_spin_lock+0x22/0x30 Aug 22 10:08:30 juju-e4d256-prod-github-runner-207 kernel: [17084.591043] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:08:30 juju-e4d256-prod-github-runner-207 kernel: [17084.592107] direct_page_fault+0x206/0x310 [kvm] Aug 22 10:08:30 juju-e4d256-prod-github-runner-207 kernel: [17084.593138] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 10:08:30 juju-e4d256-prod-github-runner-207 kernel: [17084.594162] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 10:08:30 juju-e4d256-prod-github-runner-207 kernel: [17084.595190] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 10:08:30 juju-e4d256-prod-github-runner-207 kernel: [17084.596180] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 10:08:30 juju-e4d256-prod-github-runner-207 kernel: [17084.597138] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 10:08:30 juju-e4d256-prod-github-runner-207 kernel: [17084.598132] handle_exit+0x98/0x230 [kvm_amd] Aug 22 10:08:30 juju-e4d256-prod-github-runner-207 kernel: [17084.599064] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 10:08:30 juju-e4d256-prod-github-runner-207 kernel: [17084.600001] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 10:08:30 juju-e4d256-prod-github-runner-207 kernel: [17084.600942] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 10:08:30 juju-e4d256-prod-github-runner-207 kernel: [17084.601862] vcpu_run+0x62/0x2c0 [kvm] Aug 22 10:08:30 juju-e4d256-prod-github-runner-207 kernel: [17084.602680] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 10:08:30 juju-e4d256-prod-github-runner-207 kernel: [17084.603533] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 10:08:30 juju-e4d256-prod-github-runner-207 kernel: [17084.604404] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 10:08:30 juju-e4d256-prod-github-runner-207 kernel: [17084.605204] ? __seccomp_filter+0x4a/0x4a0 Aug 22 10:08:30 juju-e4d256-prod-github-runner-207 kernel: [17084.605946] ? __fget_files+0x86/0xc0 Aug 22 10:08:30 juju-e4d256-prod-github-runner-207 kernel: [17084.606646] __x64_sys_ioctl+0x95/0xd0 Aug 22 10:08:30 juju-e4d256-prod-github-runner-207 kernel: [17084.607348] do_syscall_64+0x5c/0xc0 Aug 22 10:08:30 juju-e4d256-prod-github-runner-207 kernel: [17084.608010] ? do_futex+0x162/0x1f0 Aug 22 10:08:30 juju-e4d256-prod-github-runner-207 kernel: [17084.608656] ? __x64_sys_futex+0x78/0x1e0 Aug 22 10:08:30 juju-e4d256-prod-github-runner-207 kernel: [17084.609332] ? __secure_computing+0xa9/0x120 Aug 22 10:08:30 juju-e4d256-prod-github-runner-207 kernel: [17084.610017] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 10:08:30 juju-e4d256-prod-github-runner-207 kernel: [17084.610778] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:08:30 juju-e4d256-prod-github-runner-207 kernel: [17084.611507] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:08:30 juju-e4d256-prod-github-runner-207 kernel: [17084.612238] ? do_syscall_64+0x69/0xc0 Aug 22 10:08:30 juju-e4d256-prod-github-runner-207 kernel: [17084.612909] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:08:30 juju-e4d256-prod-github-runner-207 kernel: [17084.613633] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:08:30 juju-e4d256-prod-github-runner-207 kernel: [17084.614340] ? do_syscall_64+0x69/0xc0 Aug 22 10:08:30 juju-e4d256-prod-github-runner-207 kernel: [17084.614969] ? do_syscall_64+0x69/0xc0 Aug 22 10:08:30 juju-e4d256-prod-github-runner-207 kernel: [17084.615613] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 10:08:30 juju-e4d256-prod-github-runner-207 kernel: [17084.616333] RIP: 0033:0x7faa5d0edaff Aug 22 10:08:30 juju-e4d256-prod-github-runner-207 kernel: [17084.616993] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 10:08:30 juju-e4d256-prod-github-runner-207 kernel: [17084.619088] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 10:08:30 juju-e4d256-prod-github-runner-207 kernel: [17084.620021] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 10:08:30 juju-e4d256-prod-github-runner-207 kernel: [17084.620918] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 10:08:30 juju-e4d256-prod-github-runner-207 kernel: [17084.621814] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 10:08:30 juju-e4d256-prod-github-runner-207 kernel: [17084.622770] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 10:08:30 juju-e4d256-prod-github-runner-207 kernel: [17084.623682] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 10:08:30 juju-e4d256-prod-github-runner-207 kernel: [17084.624572] Aug 22 10:08:44 juju-e4d256-prod-github-runner-207 kernel: [17098.328703] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 10:08:44 juju-e4d256-prod-github-runner-207 kernel: [17098.329641] rcu: 1-....: (4232014 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=2046090 Aug 22 10:08:44 juju-e4d256-prod-github-runner-207 kernel: [17098.330766] (t=4245282 jiffies g=23269 q=23839) Aug 22 10:08:44 juju-e4d256-prod-github-runner-207 kernel: [17098.331562] NMI backtrace for cpu 1 Aug 22 10:08:44 juju-e4d256-prod-github-runner-207 kernel: [17098.332273] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 10:08:44 juju-e4d256-prod-github-runner-207 kernel: [17098.333376] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 10:08:44 juju-e4d256-prod-github-runner-207 kernel: [17098.334446] Call Trace: Aug 22 10:08:44 juju-e4d256-prod-github-runner-207 kernel: [17098.335128] Aug 22 10:08:44 juju-e4d256-prod-github-runner-207 kernel: [17098.335775] show_stack+0x52/0x5c Aug 22 10:08:44 juju-e4d256-prod-github-runner-207 kernel: [17098.336496] dump_stack_lvl+0x4a/0x63 Aug 22 10:08:44 juju-e4d256-prod-github-runner-207 kernel: [17098.337234] dump_stack+0x10/0x16 Aug 22 10:08:44 juju-e4d256-prod-github-runner-207 kernel: [17098.338000] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 10:08:44 juju-e4d256-prod-github-runner-207 kernel: [17098.338776] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 10:08:44 juju-e4d256-prod-github-runner-207 kernel: [17098.339570] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 10:08:44 juju-e4d256-prod-github-runner-207 kernel: [17098.340385] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 10:08:44 juju-e4d256-prod-github-runner-207 kernel: [17098.341205] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 10:08:44 juju-e4d256-prod-github-runner-207 kernel: [17098.342013] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 10:08:44 juju-e4d256-prod-github-runner-207 kernel: [17098.342787] print_cpu_stall.cold+0x2f/0xe2 Aug 22 10:08:44 juju-e4d256-prod-github-runner-207 kernel: [17098.343556] ? timekeeping_update+0xf7/0x150 Aug 22 10:08:44 juju-e4d256-prod-github-runner-207 kernel: [17098.344321] check_cpu_stall+0x109/0x270 Aug 22 10:08:44 juju-e4d256-prod-github-runner-207 kernel: [17098.345070] rcu_sched_clock_irq+0x9a/0x250 Aug 22 10:08:44 juju-e4d256-prod-github-runner-207 kernel: [17098.345828] update_process_times+0x94/0xd0 Aug 22 10:08:44 juju-e4d256-prod-github-runner-207 kernel: [17098.346588] tick_sched_handle+0x29/0x70 Aug 22 10:08:44 juju-e4d256-prod-github-runner-207 kernel: [17098.347344] tick_sched_timer+0x8c/0xc0 Aug 22 10:08:44 juju-e4d256-prod-github-runner-207 kernel: [17098.348083] ? tick_nohz_handler+0xb0/0xb0 Aug 22 10:08:44 juju-e4d256-prod-github-runner-207 kernel: [17098.348842] __hrtimer_run_queues+0x107/0x230 Aug 22 10:08:44 juju-e4d256-prod-github-runner-207 kernel: [17098.349611] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 10:08:44 juju-e4d256-prod-github-runner-207 kernel: [17098.350382] hrtimer_interrupt+0x101/0x220 Aug 22 10:08:44 juju-e4d256-prod-github-runner-207 kernel: [17098.351152] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 10:08:44 juju-e4d256-prod-github-runner-207 kernel: [17098.351959] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 10:08:44 juju-e4d256-prod-github-runner-207 kernel: [17098.352764] Aug 22 10:08:44 juju-e4d256-prod-github-runner-207 kernel: [17098.353400] Aug 22 10:08:44 juju-e4d256-prod-github-runner-207 kernel: [17098.354025] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 10:08:44 juju-e4d256-prod-github-runner-207 kernel: [17098.354839] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:08:44 juju-e4d256-prod-github-runner-207 kernel: [17098.355730] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 10:08:44 juju-e4d256-prod-github-runner-207 kernel: [17098.357918] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 10:08:44 juju-e4d256-prod-github-runner-207 kernel: [17098.358785] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 10:08:44 juju-e4d256-prod-github-runner-207 kernel: [17098.359788] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 10:08:44 juju-e4d256-prod-github-runner-207 kernel: [17098.360768] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 10:08:44 juju-e4d256-prod-github-runner-207 kernel: [17098.361732] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 10:08:44 juju-e4d256-prod-github-runner-207 kernel: [17098.362692] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 10:08:44 juju-e4d256-prod-github-runner-207 kernel: [17098.363667] ? _raw_spin_lock+0x22/0x30 Aug 22 10:08:44 juju-e4d256-prod-github-runner-207 kernel: [17098.364439] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:08:44 juju-e4d256-prod-github-runner-207 kernel: [17098.365270] direct_page_fault+0x206/0x310 [kvm] Aug 22 10:08:44 juju-e4d256-prod-github-runner-207 kernel: [17098.366115] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 10:08:44 juju-e4d256-prod-github-runner-207 kernel: [17098.366954] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 10:08:44 juju-e4d256-prod-github-runner-207 kernel: [17098.367774] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 10:08:44 juju-e4d256-prod-github-runner-207 kernel: [17098.368575] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 10:08:44 juju-e4d256-prod-github-runner-207 kernel: [17098.369366] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 10:08:44 juju-e4d256-prod-github-runner-207 kernel: [17098.370184] handle_exit+0x98/0x230 [kvm_amd] Aug 22 10:08:44 juju-e4d256-prod-github-runner-207 kernel: [17098.370944] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 10:08:44 juju-e4d256-prod-github-runner-207 kernel: [17098.371765] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 10:08:44 juju-e4d256-prod-github-runner-207 kernel: [17098.372569] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 10:08:44 juju-e4d256-prod-github-runner-207 kernel: [17098.373359] vcpu_run+0x62/0x2c0 [kvm] Aug 22 10:08:44 juju-e4d256-prod-github-runner-207 kernel: [17098.374077] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 10:08:44 juju-e4d256-prod-github-runner-207 kernel: [17098.374805] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 10:08:44 juju-e4d256-prod-github-runner-207 kernel: [17098.375615] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 10:08:44 juju-e4d256-prod-github-runner-207 kernel: [17098.376392] ? __seccomp_filter+0x4a/0x4a0 Aug 22 10:08:44 juju-e4d256-prod-github-runner-207 kernel: [17098.377109] ? __fget_files+0x86/0xc0 Aug 22 10:08:44 juju-e4d256-prod-github-runner-207 kernel: [17098.377798] __x64_sys_ioctl+0x95/0xd0 Aug 22 10:08:44 juju-e4d256-prod-github-runner-207 kernel: [17098.378489] do_syscall_64+0x5c/0xc0 Aug 22 10:08:44 juju-e4d256-prod-github-runner-207 kernel: [17098.379177] ? do_futex+0x162/0x1f0 Aug 22 10:08:44 juju-e4d256-prod-github-runner-207 kernel: [17098.379853] ? __x64_sys_futex+0x78/0x1e0 Aug 22 10:08:44 juju-e4d256-prod-github-runner-207 kernel: [17098.380550] ? __secure_computing+0xa9/0x120 Aug 22 10:08:44 juju-e4d256-prod-github-runner-207 kernel: [17098.381263] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 10:08:44 juju-e4d256-prod-github-runner-207 kernel: [17098.382053] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:08:44 juju-e4d256-prod-github-runner-207 kernel: [17098.382803] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:08:44 juju-e4d256-prod-github-runner-207 kernel: [17098.383560] ? do_syscall_64+0x69/0xc0 Aug 22 10:08:44 juju-e4d256-prod-github-runner-207 kernel: [17098.384246] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:08:44 juju-e4d256-prod-github-runner-207 kernel: [17098.385009] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:08:44 juju-e4d256-prod-github-runner-207 kernel: [17098.385769] ? do_syscall_64+0x69/0xc0 Aug 22 10:08:44 juju-e4d256-prod-github-runner-207 kernel: [17098.386459] ? do_syscall_64+0x69/0xc0 Aug 22 10:08:44 juju-e4d256-prod-github-runner-207 kernel: [17098.387155] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 10:08:44 juju-e4d256-prod-github-runner-207 kernel: [17098.387922] RIP: 0033:0x7faa5d0edaff Aug 22 10:08:44 juju-e4d256-prod-github-runner-207 kernel: [17098.388600] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 10:08:44 juju-e4d256-prod-github-runner-207 kernel: [17098.390690] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 10:08:44 juju-e4d256-prod-github-runner-207 kernel: [17098.391658] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 10:08:44 juju-e4d256-prod-github-runner-207 kernel: [17098.392599] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 10:08:44 juju-e4d256-prod-github-runner-207 kernel: [17098.393544] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 10:08:44 juju-e4d256-prod-github-runner-207 kernel: [17098.394477] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 10:08:44 juju-e4d256-prod-github-runner-207 kernel: [17098.395416] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 10:08:44 juju-e4d256-prod-github-runner-207 kernel: [17098.396328] Aug 22 10:09:10 juju-e4d256-prod-github-runner-207 kernel: [17124.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 15840s! [qemu-system-x86:6715] Aug 22 10:09:10 juju-e4d256-prod-github-runner-207 kernel: [17124.543134] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 10:09:10 juju-e4d256-prod-github-runner-207 kernel: [17124.543203] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 10:09:10 juju-e4d256-prod-github-runner-207 kernel: [17124.555287] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 10:09:10 juju-e4d256-prod-github-runner-207 kernel: [17124.556559] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 10:09:10 juju-e4d256-prod-github-runner-207 kernel: [17124.557778] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:09:10 juju-e4d256-prod-github-runner-207 kernel: [17124.558847] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 10:09:10 juju-e4d256-prod-github-runner-207 kernel: [17124.561387] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 10:09:10 juju-e4d256-prod-github-runner-207 kernel: [17124.562428] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 10:09:10 juju-e4d256-prod-github-runner-207 kernel: [17124.563602] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 10:09:10 juju-e4d256-prod-github-runner-207 kernel: [17124.564761] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 10:09:10 juju-e4d256-prod-github-runner-207 kernel: [17124.565921] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 10:09:10 juju-e4d256-prod-github-runner-207 kernel: [17124.567096] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 10:09:10 juju-e4d256-prod-github-runner-207 kernel: [17124.568263] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 10:09:10 juju-e4d256-prod-github-runner-207 kernel: [17124.569495] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 10:09:10 juju-e4d256-prod-github-runner-207 kernel: [17124.570612] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 10:09:10 juju-e4d256-prod-github-runner-207 kernel: [17124.571804] Call Trace: Aug 22 10:09:10 juju-e4d256-prod-github-runner-207 kernel: [17124.572716] Aug 22 10:09:10 juju-e4d256-prod-github-runner-207 kernel: [17124.573601] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:09:10 juju-e4d256-prod-github-runner-207 kernel: [17124.574664] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:09:10 juju-e4d256-prod-github-runner-207 kernel: [17124.575687] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:09:10 juju-e4d256-prod-github-runner-207 kernel: [17124.576779] ? show_regs.part.0+0x23/0x29 Aug 22 10:09:10 juju-e4d256-prod-github-runner-207 kernel: [17124.577777] ? show_regs.cold+0x8/0xd Aug 22 10:09:10 juju-e4d256-prod-github-runner-207 kernel: [17124.578762] ? watchdog_timer_fn+0x1be/0x220 Aug 22 10:09:10 juju-e4d256-prod-github-runner-207 kernel: [17124.579772] ? lockup_detector_update_enable+0x60/0x60 Aug 22 10:09:10 juju-e4d256-prod-github-runner-207 kernel: [17124.580834] ? __hrtimer_run_queues+0x107/0x230 Aug 22 10:09:10 juju-e4d256-prod-github-runner-207 kernel: [17124.581863] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 10:09:10 juju-e4d256-prod-github-runner-207 kernel: [17124.582906] ? hrtimer_interrupt+0x101/0x220 Aug 22 10:09:10 juju-e4d256-prod-github-runner-207 kernel: [17124.583923] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 10:09:10 juju-e4d256-prod-github-runner-207 kernel: [17124.584997] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 10:09:10 juju-e4d256-prod-github-runner-207 kernel: [17124.586044] Aug 22 10:09:10 juju-e4d256-prod-github-runner-207 kernel: [17124.586914] Aug 22 10:09:10 juju-e4d256-prod-github-runner-207 kernel: [17124.587758] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 10:09:10 juju-e4d256-prod-github-runner-207 kernel: [17124.588798] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:09:10 juju-e4d256-prod-github-runner-207 kernel: [17124.589841] ? _raw_spin_lock+0x22/0x30 Aug 22 10:09:10 juju-e4d256-prod-github-runner-207 kernel: [17124.590799] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:09:10 juju-e4d256-prod-github-runner-207 kernel: [17124.591812] direct_page_fault+0x206/0x310 [kvm] Aug 22 10:09:10 juju-e4d256-prod-github-runner-207 kernel: [17124.592834] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 10:09:10 juju-e4d256-prod-github-runner-207 kernel: [17124.593842] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 10:09:10 juju-e4d256-prod-github-runner-207 kernel: [17124.594862] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 10:09:10 juju-e4d256-prod-github-runner-207 kernel: [17124.595836] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 10:09:10 juju-e4d256-prod-github-runner-207 kernel: [17124.596783] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 10:09:10 juju-e4d256-prod-github-runner-207 kernel: [17124.597760] handle_exit+0x98/0x230 [kvm_amd] Aug 22 10:09:10 juju-e4d256-prod-github-runner-207 kernel: [17124.598665] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 10:09:10 juju-e4d256-prod-github-runner-207 kernel: [17124.599578] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 10:09:10 juju-e4d256-prod-github-runner-207 kernel: [17124.600549] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 10:09:10 juju-e4d256-prod-github-runner-207 kernel: [17124.601452] vcpu_run+0x62/0x2c0 [kvm] Aug 22 10:09:10 juju-e4d256-prod-github-runner-207 kernel: [17124.602261] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 10:09:10 juju-e4d256-prod-github-runner-207 kernel: [17124.603086] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 10:09:10 juju-e4d256-prod-github-runner-207 kernel: [17124.603943] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 10:09:10 juju-e4d256-prod-github-runner-207 kernel: [17124.604739] ? __seccomp_filter+0x4a/0x4a0 Aug 22 10:09:10 juju-e4d256-prod-github-runner-207 kernel: [17124.605480] ? __fget_files+0x86/0xc0 Aug 22 10:09:10 juju-e4d256-prod-github-runner-207 kernel: [17124.606184] __x64_sys_ioctl+0x95/0xd0 Aug 22 10:09:10 juju-e4d256-prod-github-runner-207 kernel: [17124.606886] do_syscall_64+0x5c/0xc0 Aug 22 10:09:10 juju-e4d256-prod-github-runner-207 kernel: [17124.607550] ? do_futex+0x162/0x1f0 Aug 22 10:09:10 juju-e4d256-prod-github-runner-207 kernel: [17124.608205] ? __x64_sys_futex+0x78/0x1e0 Aug 22 10:09:10 juju-e4d256-prod-github-runner-207 kernel: [17124.608883] ? __secure_computing+0xa9/0x120 Aug 22 10:09:10 juju-e4d256-prod-github-runner-207 kernel: [17124.609571] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 10:09:10 juju-e4d256-prod-github-runner-207 kernel: [17124.610330] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:09:10 juju-e4d256-prod-github-runner-207 kernel: [17124.611064] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:09:10 juju-e4d256-prod-github-runner-207 kernel: [17124.611782] ? do_syscall_64+0x69/0xc0 Aug 22 10:09:10 juju-e4d256-prod-github-runner-207 kernel: [17124.612425] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:09:10 juju-e4d256-prod-github-runner-207 kernel: [17124.613129] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:09:10 juju-e4d256-prod-github-runner-207 kernel: [17124.613830] ? do_syscall_64+0x69/0xc0 Aug 22 10:09:10 juju-e4d256-prod-github-runner-207 kernel: [17124.614454] ? do_syscall_64+0x69/0xc0 Aug 22 10:09:10 juju-e4d256-prod-github-runner-207 kernel: [17124.615087] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 10:09:10 juju-e4d256-prod-github-runner-207 kernel: [17124.615789] RIP: 0033:0x7faa5d0edaff Aug 22 10:09:10 juju-e4d256-prod-github-runner-207 kernel: [17124.616411] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 10:09:10 juju-e4d256-prod-github-runner-207 kernel: [17124.618395] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 10:09:10 juju-e4d256-prod-github-runner-207 kernel: [17124.619322] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 10:09:10 juju-e4d256-prod-github-runner-207 kernel: [17124.620215] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 10:09:10 juju-e4d256-prod-github-runner-207 kernel: [17124.621102] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 10:09:10 juju-e4d256-prod-github-runner-207 kernel: [17124.621993] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 10:09:10 juju-e4d256-prod-github-runner-207 kernel: [17124.622893] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 10:09:10 juju-e4d256-prod-github-runner-207 kernel: [17124.623792] Aug 22 10:09:38 juju-e4d256-prod-github-runner-207 kernel: [17152.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 15866s! [qemu-system-x86:6715] Aug 22 10:09:38 juju-e4d256-prod-github-runner-207 kernel: [17152.543779] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 10:09:38 juju-e4d256-prod-github-runner-207 kernel: [17152.544044] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 10:09:38 juju-e4d256-prod-github-runner-207 kernel: [17152.556380] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 10:09:38 juju-e4d256-prod-github-runner-207 kernel: [17152.557650] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 10:09:38 juju-e4d256-prod-github-runner-207 kernel: [17152.558898] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:09:38 juju-e4d256-prod-github-runner-207 kernel: [17152.559987] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 10:09:38 juju-e4d256-prod-github-runner-207 kernel: [17152.562559] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 10:09:38 juju-e4d256-prod-github-runner-207 kernel: [17152.563606] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 10:09:38 juju-e4d256-prod-github-runner-207 kernel: [17152.564809] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 10:09:38 juju-e4d256-prod-github-runner-207 kernel: [17152.565996] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 10:09:38 juju-e4d256-prod-github-runner-207 kernel: [17152.567173] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 10:09:38 juju-e4d256-prod-github-runner-207 kernel: [17152.568332] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 10:09:38 juju-e4d256-prod-github-runner-207 kernel: [17152.569498] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 10:09:38 juju-e4d256-prod-github-runner-207 kernel: [17152.570754] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 10:09:38 juju-e4d256-prod-github-runner-207 kernel: [17152.571857] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 10:09:38 juju-e4d256-prod-github-runner-207 kernel: [17152.573042] Call Trace: Aug 22 10:09:38 juju-e4d256-prod-github-runner-207 kernel: [17152.573956] Aug 22 10:09:38 juju-e4d256-prod-github-runner-207 kernel: [17152.574879] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:09:38 juju-e4d256-prod-github-runner-207 kernel: [17152.575941] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:09:38 juju-e4d256-prod-github-runner-207 kernel: [17152.576977] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:09:38 juju-e4d256-prod-github-runner-207 kernel: [17152.578086] ? show_regs.part.0+0x23/0x29 Aug 22 10:09:38 juju-e4d256-prod-github-runner-207 kernel: [17152.579100] ? show_regs.cold+0x8/0xd Aug 22 10:09:38 juju-e4d256-prod-github-runner-207 kernel: [17152.580076] ? watchdog_timer_fn+0x1be/0x220 Aug 22 10:09:38 juju-e4d256-prod-github-runner-207 kernel: [17152.581084] ? lockup_detector_update_enable+0x60/0x60 Aug 22 10:09:38 juju-e4d256-prod-github-runner-207 kernel: [17152.582146] ? __hrtimer_run_queues+0x107/0x230 Aug 22 10:09:38 juju-e4d256-prod-github-runner-207 kernel: [17152.583192] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 10:09:38 juju-e4d256-prod-github-runner-207 kernel: [17152.584219] ? hrtimer_interrupt+0x101/0x220 Aug 22 10:09:38 juju-e4d256-prod-github-runner-207 kernel: [17152.585235] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 10:09:38 juju-e4d256-prod-github-runner-207 kernel: [17152.586356] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 10:09:38 juju-e4d256-prod-github-runner-207 kernel: [17152.587403] Aug 22 10:09:38 juju-e4d256-prod-github-runner-207 kernel: [17152.588254] Aug 22 10:09:38 juju-e4d256-prod-github-runner-207 kernel: [17152.589090] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 10:09:38 juju-e4d256-prod-github-runner-207 kernel: [17152.590123] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:09:38 juju-e4d256-prod-github-runner-207 kernel: [17152.591172] ? _raw_spin_lock+0x22/0x30 Aug 22 10:09:38 juju-e4d256-prod-github-runner-207 kernel: [17152.592116] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:09:38 juju-e4d256-prod-github-runner-207 kernel: [17152.593144] direct_page_fault+0x206/0x310 [kvm] Aug 22 10:09:38 juju-e4d256-prod-github-runner-207 kernel: [17152.594169] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 10:09:38 juju-e4d256-prod-github-runner-207 kernel: [17152.595183] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 10:09:38 juju-e4d256-prod-github-runner-207 kernel: [17152.596202] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 10:09:38 juju-e4d256-prod-github-runner-207 kernel: [17152.597208] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 10:09:38 juju-e4d256-prod-github-runner-207 kernel: [17152.598155] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 10:09:38 juju-e4d256-prod-github-runner-207 kernel: [17152.599153] handle_exit+0x98/0x230 [kvm_amd] Aug 22 10:09:38 juju-e4d256-prod-github-runner-207 kernel: [17152.600047] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 10:09:38 juju-e4d256-prod-github-runner-207 kernel: [17152.600968] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 10:09:38 juju-e4d256-prod-github-runner-207 kernel: [17152.601900] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 10:09:38 juju-e4d256-prod-github-runner-207 kernel: [17152.602827] vcpu_run+0x62/0x2c0 [kvm] Aug 22 10:09:38 juju-e4d256-prod-github-runner-207 kernel: [17152.603640] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 10:09:38 juju-e4d256-prod-github-runner-207 kernel: [17152.604450] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 10:09:38 juju-e4d256-prod-github-runner-207 kernel: [17152.605312] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 10:09:38 juju-e4d256-prod-github-runner-207 kernel: [17152.606123] ? __seccomp_filter+0x4a/0x4a0 Aug 22 10:09:38 juju-e4d256-prod-github-runner-207 kernel: [17152.606903] ? __fget_files+0x86/0xc0 Aug 22 10:09:38 juju-e4d256-prod-github-runner-207 kernel: [17152.607622] __x64_sys_ioctl+0x95/0xd0 Aug 22 10:09:38 juju-e4d256-prod-github-runner-207 kernel: [17152.608315] do_syscall_64+0x5c/0xc0 Aug 22 10:09:38 juju-e4d256-prod-github-runner-207 kernel: [17152.608979] ? do_futex+0x162/0x1f0 Aug 22 10:09:38 juju-e4d256-prod-github-runner-207 kernel: [17152.609628] ? __x64_sys_futex+0x78/0x1e0 Aug 22 10:09:38 juju-e4d256-prod-github-runner-207 kernel: [17152.610322] ? __secure_computing+0xa9/0x120 Aug 22 10:09:38 juju-e4d256-prod-github-runner-207 kernel: [17152.611017] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 10:09:38 juju-e4d256-prod-github-runner-207 kernel: [17152.611778] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:09:38 juju-e4d256-prod-github-runner-207 kernel: [17152.612498] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:09:38 juju-e4d256-prod-github-runner-207 kernel: [17152.613216] ? do_syscall_64+0x69/0xc0 Aug 22 10:09:38 juju-e4d256-prod-github-runner-207 kernel: [17152.613860] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:09:38 juju-e4d256-prod-github-runner-207 kernel: [17152.614572] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:09:38 juju-e4d256-prod-github-runner-207 kernel: [17152.615273] ? do_syscall_64+0x69/0xc0 Aug 22 10:09:38 juju-e4d256-prod-github-runner-207 kernel: [17152.615896] ? do_syscall_64+0x69/0xc0 Aug 22 10:09:38 juju-e4d256-prod-github-runner-207 kernel: [17152.616542] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 10:09:38 juju-e4d256-prod-github-runner-207 kernel: [17152.617261] RIP: 0033:0x7faa5d0edaff Aug 22 10:09:38 juju-e4d256-prod-github-runner-207 kernel: [17152.617923] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 10:09:38 juju-e4d256-prod-github-runner-207 kernel: [17152.619929] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 10:09:38 juju-e4d256-prod-github-runner-207 kernel: [17152.620847] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 10:09:38 juju-e4d256-prod-github-runner-207 kernel: [17152.621737] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 10:09:38 juju-e4d256-prod-github-runner-207 kernel: [17152.622651] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 10:09:38 juju-e4d256-prod-github-runner-207 kernel: [17152.623542] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 10:09:38 juju-e4d256-prod-github-runner-207 kernel: [17152.624432] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 10:09:38 juju-e4d256-prod-github-runner-207 kernel: [17152.625327] Aug 22 10:10:06 juju-e4d256-prod-github-runner-207 kernel: [17180.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 15892s! [qemu-system-x86:6715] Aug 22 10:10:06 juju-e4d256-prod-github-runner-207 kernel: [17180.543102] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 10:10:06 juju-e4d256-prod-github-runner-207 kernel: [17180.543181] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 10:10:06 juju-e4d256-prod-github-runner-207 kernel: [17180.555616] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 10:10:06 juju-e4d256-prod-github-runner-207 kernel: [17180.556887] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 10:10:06 juju-e4d256-prod-github-runner-207 kernel: [17180.558159] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:10:06 juju-e4d256-prod-github-runner-207 kernel: [17180.559239] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 10:10:06 juju-e4d256-prod-github-runner-207 kernel: [17180.561798] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 10:10:06 juju-e4d256-prod-github-runner-207 kernel: [17180.562882] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 10:10:06 juju-e4d256-prod-github-runner-207 kernel: [17180.564046] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 10:10:06 juju-e4d256-prod-github-runner-207 kernel: [17180.565200] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 10:10:06 juju-e4d256-prod-github-runner-207 kernel: [17180.566386] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 10:10:06 juju-e4d256-prod-github-runner-207 kernel: [17180.567577] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 10:10:06 juju-e4d256-prod-github-runner-207 kernel: [17180.568774] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 10:10:06 juju-e4d256-prod-github-runner-207 kernel: [17180.570023] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 10:10:06 juju-e4d256-prod-github-runner-207 kernel: [17180.571127] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 10:10:06 juju-e4d256-prod-github-runner-207 kernel: [17180.572360] Call Trace: Aug 22 10:10:06 juju-e4d256-prod-github-runner-207 kernel: [17180.573276] Aug 22 10:10:06 juju-e4d256-prod-github-runner-207 kernel: [17180.574195] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:10:06 juju-e4d256-prod-github-runner-207 kernel: [17180.575233] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:10:06 juju-e4d256-prod-github-runner-207 kernel: [17180.576289] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:10:06 juju-e4d256-prod-github-runner-207 kernel: [17180.577375] ? show_regs.part.0+0x23/0x29 Aug 22 10:10:06 juju-e4d256-prod-github-runner-207 kernel: [17180.578400] ? show_regs.cold+0x8/0xd Aug 22 10:10:06 juju-e4d256-prod-github-runner-207 kernel: [17180.579370] ? watchdog_timer_fn+0x1be/0x220 Aug 22 10:10:06 juju-e4d256-prod-github-runner-207 kernel: [17180.580376] ? lockup_detector_update_enable+0x60/0x60 Aug 22 10:10:06 juju-e4d256-prod-github-runner-207 kernel: [17180.581436] ? __hrtimer_run_queues+0x107/0x230 Aug 22 10:10:06 juju-e4d256-prod-github-runner-207 kernel: [17180.582482] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 10:10:06 juju-e4d256-prod-github-runner-207 kernel: [17180.583546] ? hrtimer_interrupt+0x101/0x220 Aug 22 10:10:06 juju-e4d256-prod-github-runner-207 kernel: [17180.584559] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 10:10:06 juju-e4d256-prod-github-runner-207 kernel: [17180.585653] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 10:10:06 juju-e4d256-prod-github-runner-207 kernel: [17180.586756] Aug 22 10:10:06 juju-e4d256-prod-github-runner-207 kernel: [17180.587608] Aug 22 10:10:06 juju-e4d256-prod-github-runner-207 kernel: [17180.588482] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 10:10:06 juju-e4d256-prod-github-runner-207 kernel: [17180.589512] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:10:06 juju-e4d256-prod-github-runner-207 kernel: [17180.590561] ? _raw_spin_lock+0x22/0x30 Aug 22 10:10:06 juju-e4d256-prod-github-runner-207 kernel: [17180.591547] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:10:06 juju-e4d256-prod-github-runner-207 kernel: [17180.592607] direct_page_fault+0x206/0x310 [kvm] Aug 22 10:10:06 juju-e4d256-prod-github-runner-207 kernel: [17180.593636] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 10:10:06 juju-e4d256-prod-github-runner-207 kernel: [17180.594656] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 10:10:06 juju-e4d256-prod-github-runner-207 kernel: [17180.595653] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 10:10:06 juju-e4d256-prod-github-runner-207 kernel: [17180.596624] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 10:10:06 juju-e4d256-prod-github-runner-207 kernel: [17180.597567] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 10:10:06 juju-e4d256-prod-github-runner-207 kernel: [17180.598562] handle_exit+0x98/0x230 [kvm_amd] Aug 22 10:10:06 juju-e4d256-prod-github-runner-207 kernel: [17180.599476] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 10:10:06 juju-e4d256-prod-github-runner-207 kernel: [17180.600388] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 10:10:06 juju-e4d256-prod-github-runner-207 kernel: [17180.601346] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 10:10:06 juju-e4d256-prod-github-runner-207 kernel: [17180.602308] vcpu_run+0x62/0x2c0 [kvm] Aug 22 10:10:06 juju-e4d256-prod-github-runner-207 kernel: [17180.603120] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 10:10:06 juju-e4d256-prod-github-runner-207 kernel: [17180.603924] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 10:10:06 juju-e4d256-prod-github-runner-207 kernel: [17180.604817] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 10:10:06 juju-e4d256-prod-github-runner-207 kernel: [17180.605650] ? __seccomp_filter+0x4a/0x4a0 Aug 22 10:10:06 juju-e4d256-prod-github-runner-207 kernel: [17180.606411] ? __fget_files+0x86/0xc0 Aug 22 10:10:06 juju-e4d256-prod-github-runner-207 kernel: [17180.607112] __x64_sys_ioctl+0x95/0xd0 Aug 22 10:10:06 juju-e4d256-prod-github-runner-207 kernel: [17180.607806] do_syscall_64+0x5c/0xc0 Aug 22 10:10:06 juju-e4d256-prod-github-runner-207 kernel: [17180.608506] ? do_futex+0x162/0x1f0 Aug 22 10:10:06 juju-e4d256-prod-github-runner-207 kernel: [17180.609151] ? __x64_sys_futex+0x78/0x1e0 Aug 22 10:10:06 juju-e4d256-prod-github-runner-207 kernel: [17180.609819] ? __secure_computing+0xa9/0x120 Aug 22 10:10:06 juju-e4d256-prod-github-runner-207 kernel: [17180.610536] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 10:10:06 juju-e4d256-prod-github-runner-207 kernel: [17180.611293] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:10:06 juju-e4d256-prod-github-runner-207 kernel: [17180.612011] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:10:06 juju-e4d256-prod-github-runner-207 kernel: [17180.612728] ? do_syscall_64+0x69/0xc0 Aug 22 10:10:06 juju-e4d256-prod-github-runner-207 kernel: [17180.613375] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:10:06 juju-e4d256-prod-github-runner-207 kernel: [17180.614089] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:10:06 juju-e4d256-prod-github-runner-207 kernel: [17180.614787] ? do_syscall_64+0x69/0xc0 Aug 22 10:10:06 juju-e4d256-prod-github-runner-207 kernel: [17180.615413] ? do_syscall_64+0x69/0xc0 Aug 22 10:10:06 juju-e4d256-prod-github-runner-207 kernel: [17180.616032] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 10:10:06 juju-e4d256-prod-github-runner-207 kernel: [17180.616734] RIP: 0033:0x7faa5d0edaff Aug 22 10:10:06 juju-e4d256-prod-github-runner-207 kernel: [17180.617389] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 10:10:06 juju-e4d256-prod-github-runner-207 kernel: [17180.619416] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 10:10:06 juju-e4d256-prod-github-runner-207 kernel: [17180.620361] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 10:10:06 juju-e4d256-prod-github-runner-207 kernel: [17180.621253] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 10:10:06 juju-e4d256-prod-github-runner-207 kernel: [17180.622162] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 10:10:06 juju-e4d256-prod-github-runner-207 kernel: [17180.623049] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 10:10:06 juju-e4d256-prod-github-runner-207 kernel: [17180.623983] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 10:10:06 juju-e4d256-prod-github-runner-207 kernel: [17180.624924] Aug 22 10:10:34 juju-e4d256-prod-github-runner-207 kernel: [17208.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 15918s! [qemu-system-x86:6715] Aug 22 10:10:34 juju-e4d256-prod-github-runner-207 kernel: [17208.543093] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 10:10:34 juju-e4d256-prod-github-runner-207 kernel: [17208.543163] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 10:10:34 juju-e4d256-prod-github-runner-207 kernel: [17208.555226] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 10:10:34 juju-e4d256-prod-github-runner-207 kernel: [17208.556490] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 10:10:34 juju-e4d256-prod-github-runner-207 kernel: [17208.557730] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:10:34 juju-e4d256-prod-github-runner-207 kernel: [17208.558786] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 10:10:34 juju-e4d256-prod-github-runner-207 kernel: [17208.561324] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 10:10:34 juju-e4d256-prod-github-runner-207 kernel: [17208.562380] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 10:10:34 juju-e4d256-prod-github-runner-207 kernel: [17208.563543] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 10:10:34 juju-e4d256-prod-github-runner-207 kernel: [17208.564699] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 10:10:34 juju-e4d256-prod-github-runner-207 kernel: [17208.565875] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 10:10:34 juju-e4d256-prod-github-runner-207 kernel: [17208.567036] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 10:10:34 juju-e4d256-prod-github-runner-207 kernel: [17208.568206] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 10:10:34 juju-e4d256-prod-github-runner-207 kernel: [17208.569435] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 10:10:34 juju-e4d256-prod-github-runner-207 kernel: [17208.570546] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 10:10:34 juju-e4d256-prod-github-runner-207 kernel: [17208.571735] Call Trace: Aug 22 10:10:34 juju-e4d256-prod-github-runner-207 kernel: [17208.572646] Aug 22 10:10:34 juju-e4d256-prod-github-runner-207 kernel: [17208.573543] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:10:34 juju-e4d256-prod-github-runner-207 kernel: [17208.574595] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:10:34 juju-e4d256-prod-github-runner-207 kernel: [17208.575699] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:10:34 juju-e4d256-prod-github-runner-207 kernel: [17208.576941] ? show_regs.part.0+0x23/0x29 Aug 22 10:10:34 juju-e4d256-prod-github-runner-207 kernel: [17208.577954] ? show_regs.cold+0x8/0xd Aug 22 10:10:34 juju-e4d256-prod-github-runner-207 kernel: [17208.578925] ? watchdog_timer_fn+0x1be/0x220 Aug 22 10:10:34 juju-e4d256-prod-github-runner-207 kernel: [17208.579938] ? lockup_detector_update_enable+0x60/0x60 Aug 22 10:10:34 juju-e4d256-prod-github-runner-207 kernel: [17208.580999] ? __hrtimer_run_queues+0x107/0x230 Aug 22 10:10:34 juju-e4d256-prod-github-runner-207 kernel: [17208.582041] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 10:10:34 juju-e4d256-prod-github-runner-207 kernel: [17208.583070] ? hrtimer_interrupt+0x101/0x220 Aug 22 10:10:34 juju-e4d256-prod-github-runner-207 kernel: [17208.584084] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 10:10:34 juju-e4d256-prod-github-runner-207 kernel: [17208.585164] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 10:10:34 juju-e4d256-prod-github-runner-207 kernel: [17208.586256] Aug 22 10:10:34 juju-e4d256-prod-github-runner-207 kernel: [17208.587112] Aug 22 10:10:34 juju-e4d256-prod-github-runner-207 kernel: [17208.587980] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 10:10:34 juju-e4d256-prod-github-runner-207 kernel: [17208.589012] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:10:34 juju-e4d256-prod-github-runner-207 kernel: [17208.590087] ? _raw_spin_lock+0x22/0x30 Aug 22 10:10:34 juju-e4d256-prod-github-runner-207 kernel: [17208.591035] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:10:34 juju-e4d256-prod-github-runner-207 kernel: [17208.592054] direct_page_fault+0x206/0x310 [kvm] Aug 22 10:10:34 juju-e4d256-prod-github-runner-207 kernel: [17208.593078] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 10:10:34 juju-e4d256-prod-github-runner-207 kernel: [17208.594110] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 10:10:34 juju-e4d256-prod-github-runner-207 kernel: [17208.595147] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 10:10:34 juju-e4d256-prod-github-runner-207 kernel: [17208.596120] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 10:10:34 juju-e4d256-prod-github-runner-207 kernel: [17208.597063] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 10:10:34 juju-e4d256-prod-github-runner-207 kernel: [17208.598055] handle_exit+0x98/0x230 [kvm_amd] Aug 22 10:10:34 juju-e4d256-prod-github-runner-207 kernel: [17208.598952] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 10:10:34 juju-e4d256-prod-github-runner-207 kernel: [17208.599862] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 10:10:34 juju-e4d256-prod-github-runner-207 kernel: [17208.600781] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 10:10:34 juju-e4d256-prod-github-runner-207 kernel: [17208.601704] vcpu_run+0x62/0x2c0 [kvm] Aug 22 10:10:34 juju-e4d256-prod-github-runner-207 kernel: [17208.602514] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 10:10:34 juju-e4d256-prod-github-runner-207 kernel: [17208.603318] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 10:10:34 juju-e4d256-prod-github-runner-207 kernel: [17208.604169] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 10:10:34 juju-e4d256-prod-github-runner-207 kernel: [17208.604961] ? __seccomp_filter+0x4a/0x4a0 Aug 22 10:10:34 juju-e4d256-prod-github-runner-207 kernel: [17208.605730] ? __fget_files+0x86/0xc0 Aug 22 10:10:34 juju-e4d256-prod-github-runner-207 kernel: [17208.606432] __x64_sys_ioctl+0x95/0xd0 Aug 22 10:10:34 juju-e4d256-prod-github-runner-207 kernel: [17208.607123] do_syscall_64+0x5c/0xc0 Aug 22 10:10:34 juju-e4d256-prod-github-runner-207 kernel: [17208.607790] ? do_futex+0x162/0x1f0 Aug 22 10:10:34 juju-e4d256-prod-github-runner-207 kernel: [17208.608441] ? __x64_sys_futex+0x78/0x1e0 Aug 22 10:10:34 juju-e4d256-prod-github-runner-207 kernel: [17208.609111] ? __secure_computing+0xa9/0x120 Aug 22 10:10:34 juju-e4d256-prod-github-runner-207 kernel: [17208.609816] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 10:10:34 juju-e4d256-prod-github-runner-207 kernel: [17208.610572] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:10:34 juju-e4d256-prod-github-runner-207 kernel: [17208.611290] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:10:34 juju-e4d256-prod-github-runner-207 kernel: [17208.612004] ? do_syscall_64+0x69/0xc0 Aug 22 10:10:34 juju-e4d256-prod-github-runner-207 kernel: [17208.612651] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:10:34 juju-e4d256-prod-github-runner-207 kernel: [17208.613353] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:10:34 juju-e4d256-prod-github-runner-207 kernel: [17208.614064] ? do_syscall_64+0x69/0xc0 Aug 22 10:10:34 juju-e4d256-prod-github-runner-207 kernel: [17208.614693] ? do_syscall_64+0x69/0xc0 Aug 22 10:10:34 juju-e4d256-prod-github-runner-207 kernel: [17208.615311] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 10:10:34 juju-e4d256-prod-github-runner-207 kernel: [17208.616012] RIP: 0033:0x7faa5d0edaff Aug 22 10:10:34 juju-e4d256-prod-github-runner-207 kernel: [17208.616634] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 10:10:34 juju-e4d256-prod-github-runner-207 kernel: [17208.618637] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 10:10:34 juju-e4d256-prod-github-runner-207 kernel: [17208.619547] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 10:10:34 juju-e4d256-prod-github-runner-207 kernel: [17208.620437] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 10:10:34 juju-e4d256-prod-github-runner-207 kernel: [17208.621322] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 10:10:34 juju-e4d256-prod-github-runner-207 kernel: [17208.622227] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 10:10:34 juju-e4d256-prod-github-runner-207 kernel: [17208.623121] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 10:10:34 juju-e4d256-prod-github-runner-207 kernel: [17208.624008] Aug 22 10:11:02 juju-e4d256-prod-github-runner-207 kernel: [17236.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 15944s! [qemu-system-x86:6715] Aug 22 10:11:02 juju-e4d256-prod-github-runner-207 kernel: [17236.543166] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 10:11:02 juju-e4d256-prod-github-runner-207 kernel: [17236.543236] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 10:11:02 juju-e4d256-prod-github-runner-207 kernel: [17236.555601] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 10:11:02 juju-e4d256-prod-github-runner-207 kernel: [17236.556878] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 10:11:02 juju-e4d256-prod-github-runner-207 kernel: [17236.558130] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:11:02 juju-e4d256-prod-github-runner-207 kernel: [17236.559215] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 10:11:02 juju-e4d256-prod-github-runner-207 kernel: [17236.561885] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 10:11:02 juju-e4d256-prod-github-runner-207 kernel: [17236.562982] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 10:11:02 juju-e4d256-prod-github-runner-207 kernel: [17236.564192] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 10:11:02 juju-e4d256-prod-github-runner-207 kernel: [17236.565426] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 10:11:02 juju-e4d256-prod-github-runner-207 kernel: [17236.566622] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 10:11:02 juju-e4d256-prod-github-runner-207 kernel: [17236.567768] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 10:11:02 juju-e4d256-prod-github-runner-207 kernel: [17236.568901] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 10:11:02 juju-e4d256-prod-github-runner-207 kernel: [17236.570206] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 10:11:02 juju-e4d256-prod-github-runner-207 kernel: [17236.571347] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 10:11:02 juju-e4d256-prod-github-runner-207 kernel: [17236.572602] Call Trace: Aug 22 10:11:02 juju-e4d256-prod-github-runner-207 kernel: [17236.573566] Aug 22 10:11:02 juju-e4d256-prod-github-runner-207 kernel: [17236.574446] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:11:02 juju-e4d256-prod-github-runner-207 kernel: [17236.575496] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:11:02 juju-e4d256-prod-github-runner-207 kernel: [17236.576583] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:11:02 juju-e4d256-prod-github-runner-207 kernel: [17236.577740] ? show_regs.part.0+0x23/0x29 Aug 22 10:11:02 juju-e4d256-prod-github-runner-207 kernel: [17236.578723] ? show_regs.cold+0x8/0xd Aug 22 10:11:02 juju-e4d256-prod-github-runner-207 kernel: [17236.579699] ? watchdog_timer_fn+0x1be/0x220 Aug 22 10:11:02 juju-e4d256-prod-github-runner-207 kernel: [17236.580691] ? lockup_detector_update_enable+0x60/0x60 Aug 22 10:11:02 juju-e4d256-prod-github-runner-207 kernel: [17236.581749] ? __hrtimer_run_queues+0x107/0x230 Aug 22 10:11:02 juju-e4d256-prod-github-runner-207 kernel: [17236.582757] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 10:11:02 juju-e4d256-prod-github-runner-207 kernel: [17236.583761] ? hrtimer_interrupt+0x101/0x220 Aug 22 10:11:02 juju-e4d256-prod-github-runner-207 kernel: [17236.584834] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 10:11:02 juju-e4d256-prod-github-runner-207 kernel: [17236.585924] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 10:11:02 juju-e4d256-prod-github-runner-207 kernel: [17236.587049] Aug 22 10:11:02 juju-e4d256-prod-github-runner-207 kernel: [17236.587928] Aug 22 10:11:02 juju-e4d256-prod-github-runner-207 kernel: [17236.588761] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 10:11:02 juju-e4d256-prod-github-runner-207 kernel: [17236.589789] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:11:02 juju-e4d256-prod-github-runner-207 kernel: [17236.590806] ? _raw_spin_lock+0x22/0x30 Aug 22 10:11:02 juju-e4d256-prod-github-runner-207 kernel: [17236.591732] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:11:02 juju-e4d256-prod-github-runner-207 kernel: [17236.592732] direct_page_fault+0x206/0x310 [kvm] Aug 22 10:11:02 juju-e4d256-prod-github-runner-207 kernel: [17236.593742] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 10:11:02 juju-e4d256-prod-github-runner-207 kernel: [17236.594728] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 10:11:02 juju-e4d256-prod-github-runner-207 kernel: [17236.595712] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 10:11:02 juju-e4d256-prod-github-runner-207 kernel: [17236.596659] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 10:11:02 juju-e4d256-prod-github-runner-207 kernel: [17236.597599] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 10:11:02 juju-e4d256-prod-github-runner-207 kernel: [17236.598551] handle_exit+0x98/0x230 [kvm_amd] Aug 22 10:11:02 juju-e4d256-prod-github-runner-207 kernel: [17236.599421] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 10:11:02 juju-e4d256-prod-github-runner-207 kernel: [17236.600322] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 10:11:02 juju-e4d256-prod-github-runner-207 kernel: [17236.601238] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 10:11:02 juju-e4d256-prod-github-runner-207 kernel: [17236.602125] vcpu_run+0x62/0x2c0 [kvm] Aug 22 10:11:02 juju-e4d256-prod-github-runner-207 kernel: [17236.602924] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 10:11:02 juju-e4d256-prod-github-runner-207 kernel: [17236.603711] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 10:11:02 juju-e4d256-prod-github-runner-207 kernel: [17236.604540] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 10:11:02 juju-e4d256-prod-github-runner-207 kernel: [17236.605345] ? __seccomp_filter+0x4a/0x4a0 Aug 22 10:11:02 juju-e4d256-prod-github-runner-207 kernel: [17236.606069] ? __fget_files+0x86/0xc0 Aug 22 10:11:02 juju-e4d256-prod-github-runner-207 kernel: [17236.606761] __x64_sys_ioctl+0x95/0xd0 Aug 22 10:11:02 juju-e4d256-prod-github-runner-207 kernel: [17236.607434] do_syscall_64+0x5c/0xc0 Aug 22 10:11:02 juju-e4d256-prod-github-runner-207 kernel: [17236.608084] ? do_futex+0x162/0x1f0 Aug 22 10:11:02 juju-e4d256-prod-github-runner-207 kernel: [17236.608720] ? __x64_sys_futex+0x78/0x1e0 Aug 22 10:11:02 juju-e4d256-prod-github-runner-207 kernel: [17236.609384] ? __secure_computing+0xa9/0x120 Aug 22 10:11:02 juju-e4d256-prod-github-runner-207 kernel: [17236.610057] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 10:11:02 juju-e4d256-prod-github-runner-207 kernel: [17236.610796] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:11:02 juju-e4d256-prod-github-runner-207 kernel: [17236.611500] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:11:02 juju-e4d256-prod-github-runner-207 kernel: [17236.612194] ? do_syscall_64+0x69/0xc0 Aug 22 10:11:02 juju-e4d256-prod-github-runner-207 kernel: [17236.612819] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:11:02 juju-e4d256-prod-github-runner-207 kernel: [17236.613506] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:11:02 juju-e4d256-prod-github-runner-207 kernel: [17236.614178] ? do_syscall_64+0x69/0xc0 Aug 22 10:11:02 juju-e4d256-prod-github-runner-207 kernel: [17236.614785] ? do_syscall_64+0x69/0xc0 Aug 22 10:11:02 juju-e4d256-prod-github-runner-207 kernel: [17236.615388] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 10:11:02 juju-e4d256-prod-github-runner-207 kernel: [17236.616082] RIP: 0033:0x7faa5d0edaff Aug 22 10:11:02 juju-e4d256-prod-github-runner-207 kernel: [17236.616709] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 10:11:02 juju-e4d256-prod-github-runner-207 kernel: [17236.618629] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 10:11:02 juju-e4d256-prod-github-runner-207 kernel: [17236.619640] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 10:11:02 juju-e4d256-prod-github-runner-207 kernel: [17236.620513] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 10:11:02 juju-e4d256-prod-github-runner-207 kernel: [17236.621397] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 10:11:02 juju-e4d256-prod-github-runner-207 kernel: [17236.622254] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 10:11:02 juju-e4d256-prod-github-runner-207 kernel: [17236.623108] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 10:11:02 juju-e4d256-prod-github-runner-207 kernel: [17236.623966] Aug 22 10:11:30 juju-e4d256-prod-github-runner-207 kernel: [17264.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 15970s! [qemu-system-x86:6715] Aug 22 10:11:30 juju-e4d256-prod-github-runner-207 kernel: [17264.543652] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 10:11:30 juju-e4d256-prod-github-runner-207 kernel: [17264.543878] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 10:11:30 juju-e4d256-prod-github-runner-207 kernel: [17264.555951] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 10:11:30 juju-e4d256-prod-github-runner-207 kernel: [17264.557231] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 10:11:30 juju-e4d256-prod-github-runner-207 kernel: [17264.558453] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:11:30 juju-e4d256-prod-github-runner-207 kernel: [17264.559510] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 10:11:30 juju-e4d256-prod-github-runner-207 kernel: [17264.562089] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 10:11:30 juju-e4d256-prod-github-runner-207 kernel: [17264.563138] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 10:11:30 juju-e4d256-prod-github-runner-207 kernel: [17264.564295] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 10:11:30 juju-e4d256-prod-github-runner-207 kernel: [17264.565466] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 10:11:30 juju-e4d256-prod-github-runner-207 kernel: [17264.566627] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 10:11:30 juju-e4d256-prod-github-runner-207 kernel: [17264.567797] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 10:11:30 juju-e4d256-prod-github-runner-207 kernel: [17264.568990] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 10:11:30 juju-e4d256-prod-github-runner-207 kernel: [17264.570223] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 10:11:30 juju-e4d256-prod-github-runner-207 kernel: [17264.571319] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 10:11:30 juju-e4d256-prod-github-runner-207 kernel: [17264.572507] Call Trace: Aug 22 10:11:30 juju-e4d256-prod-github-runner-207 kernel: [17264.573440] Aug 22 10:11:30 juju-e4d256-prod-github-runner-207 kernel: [17264.574352] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:11:30 juju-e4d256-prod-github-runner-207 kernel: [17264.575389] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:11:30 juju-e4d256-prod-github-runner-207 kernel: [17264.576414] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:11:30 juju-e4d256-prod-github-runner-207 kernel: [17264.577534] ? show_regs.part.0+0x23/0x29 Aug 22 10:11:30 juju-e4d256-prod-github-runner-207 kernel: [17264.578531] ? show_regs.cold+0x8/0xd Aug 22 10:11:30 juju-e4d256-prod-github-runner-207 kernel: [17264.579502] ? watchdog_timer_fn+0x1be/0x220 Aug 22 10:11:30 juju-e4d256-prod-github-runner-207 kernel: [17264.580510] ? lockup_detector_update_enable+0x60/0x60 Aug 22 10:11:30 juju-e4d256-prod-github-runner-207 kernel: [17264.581596] ? __hrtimer_run_queues+0x107/0x230 Aug 22 10:11:30 juju-e4d256-prod-github-runner-207 kernel: [17264.582630] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 10:11:30 juju-e4d256-prod-github-runner-207 kernel: [17264.583652] ? hrtimer_interrupt+0x101/0x220 Aug 22 10:11:30 juju-e4d256-prod-github-runner-207 kernel: [17264.584743] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 10:11:30 juju-e4d256-prod-github-runner-207 kernel: [17264.585862] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 10:11:30 juju-e4d256-prod-github-runner-207 kernel: [17264.586930] Aug 22 10:11:30 juju-e4d256-prod-github-runner-207 kernel: [17264.587792] Aug 22 10:11:30 juju-e4d256-prod-github-runner-207 kernel: [17264.588633] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 10:11:30 juju-e4d256-prod-github-runner-207 kernel: [17264.589690] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:11:30 juju-e4d256-prod-github-runner-207 kernel: [17264.590741] ? _raw_spin_lock+0x22/0x30 Aug 22 10:11:30 juju-e4d256-prod-github-runner-207 kernel: [17264.591685] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:11:30 juju-e4d256-prod-github-runner-207 kernel: [17264.592702] direct_page_fault+0x206/0x310 [kvm] Aug 22 10:11:30 juju-e4d256-prod-github-runner-207 kernel: [17264.593750] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 10:11:30 juju-e4d256-prod-github-runner-207 kernel: [17264.594756] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 10:11:30 juju-e4d256-prod-github-runner-207 kernel: [17264.595759] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 10:11:30 juju-e4d256-prod-github-runner-207 kernel: [17264.596760] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 10:11:30 juju-e4d256-prod-github-runner-207 kernel: [17264.597740] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 10:11:30 juju-e4d256-prod-github-runner-207 kernel: [17264.598735] handle_exit+0x98/0x230 [kvm_amd] Aug 22 10:11:30 juju-e4d256-prod-github-runner-207 kernel: [17264.599631] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 10:11:30 juju-e4d256-prod-github-runner-207 kernel: [17264.600543] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 10:11:30 juju-e4d256-prod-github-runner-207 kernel: [17264.601494] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 10:11:30 juju-e4d256-prod-github-runner-207 kernel: [17264.602397] vcpu_run+0x62/0x2c0 [kvm] Aug 22 10:11:30 juju-e4d256-prod-github-runner-207 kernel: [17264.603207] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 10:11:30 juju-e4d256-prod-github-runner-207 kernel: [17264.604013] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 10:11:30 juju-e4d256-prod-github-runner-207 kernel: [17264.604865] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 10:11:30 juju-e4d256-prod-github-runner-207 kernel: [17264.605681] ? __seccomp_filter+0x4a/0x4a0 Aug 22 10:11:30 juju-e4d256-prod-github-runner-207 kernel: [17264.606422] ? __fget_files+0x86/0xc0 Aug 22 10:11:30 juju-e4d256-prod-github-runner-207 kernel: [17264.607131] __x64_sys_ioctl+0x95/0xd0 Aug 22 10:11:30 juju-e4d256-prod-github-runner-207 kernel: [17264.607823] do_syscall_64+0x5c/0xc0 Aug 22 10:11:30 juju-e4d256-prod-github-runner-207 kernel: [17264.608489] ? do_futex+0x162/0x1f0 Aug 22 10:11:30 juju-e4d256-prod-github-runner-207 kernel: [17264.609153] ? __x64_sys_futex+0x78/0x1e0 Aug 22 10:11:30 juju-e4d256-prod-github-runner-207 kernel: [17264.609828] ? __secure_computing+0xa9/0x120 Aug 22 10:11:30 juju-e4d256-prod-github-runner-207 kernel: [17264.610518] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 10:11:30 juju-e4d256-prod-github-runner-207 kernel: [17264.611283] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:11:30 juju-e4d256-prod-github-runner-207 kernel: [17264.612015] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:11:30 juju-e4d256-prod-github-runner-207 kernel: [17264.612736] ? do_syscall_64+0x69/0xc0 Aug 22 10:11:30 juju-e4d256-prod-github-runner-207 kernel: [17264.613404] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:11:30 juju-e4d256-prod-github-runner-207 kernel: [17264.614109] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:11:30 juju-e4d256-prod-github-runner-207 kernel: [17264.614801] ? do_syscall_64+0x69/0xc0 Aug 22 10:11:30 juju-e4d256-prod-github-runner-207 kernel: [17264.615429] ? do_syscall_64+0x69/0xc0 Aug 22 10:11:30 juju-e4d256-prod-github-runner-207 kernel: [17264.616055] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 10:11:30 juju-e4d256-prod-github-runner-207 kernel: [17264.616760] RIP: 0033:0x7faa5d0edaff Aug 22 10:11:30 juju-e4d256-prod-github-runner-207 kernel: [17264.617434] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 10:11:30 juju-e4d256-prod-github-runner-207 kernel: [17264.619462] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 10:11:30 juju-e4d256-prod-github-runner-207 kernel: [17264.620386] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 10:11:30 juju-e4d256-prod-github-runner-207 kernel: [17264.621299] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 10:11:30 juju-e4d256-prod-github-runner-207 kernel: [17264.622190] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 10:11:30 juju-e4d256-prod-github-runner-207 kernel: [17264.623083] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 10:11:30 juju-e4d256-prod-github-runner-207 kernel: [17264.623971] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 10:11:30 juju-e4d256-prod-github-runner-207 kernel: [17264.624863] Aug 22 10:11:44 juju-e4d256-prod-github-runner-207 kernel: [17278.340728] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 10:11:44 juju-e4d256-prod-github-runner-207 kernel: [17278.341703] rcu: 1-....: (4276884 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=2068035 Aug 22 10:11:44 juju-e4d256-prod-github-runner-207 kernel: [17278.342827] (t=4290285 jiffies g=23269 q=23951) Aug 22 10:11:44 juju-e4d256-prod-github-runner-207 kernel: [17278.343613] NMI backtrace for cpu 1 Aug 22 10:11:44 juju-e4d256-prod-github-runner-207 kernel: [17278.344321] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 10:11:44 juju-e4d256-prod-github-runner-207 kernel: [17278.345451] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 10:11:44 juju-e4d256-prod-github-runner-207 kernel: [17278.346511] Call Trace: Aug 22 10:11:44 juju-e4d256-prod-github-runner-207 kernel: [17278.347190] Aug 22 10:11:44 juju-e4d256-prod-github-runner-207 kernel: [17278.347835] show_stack+0x52/0x5c Aug 22 10:11:44 juju-e4d256-prod-github-runner-207 kernel: [17278.348559] dump_stack_lvl+0x4a/0x63 Aug 22 10:11:44 juju-e4d256-prod-github-runner-207 kernel: [17278.349395] dump_stack+0x10/0x16 Aug 22 10:11:44 juju-e4d256-prod-github-runner-207 kernel: [17278.350111] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 10:11:44 juju-e4d256-prod-github-runner-207 kernel: [17278.350890] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 10:11:44 juju-e4d256-prod-github-runner-207 kernel: [17278.351673] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 10:11:44 juju-e4d256-prod-github-runner-207 kernel: [17278.352651] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 10:11:44 juju-e4d256-prod-github-runner-207 kernel: [17278.353483] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 10:11:44 juju-e4d256-prod-github-runner-207 kernel: [17278.354289] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 10:11:44 juju-e4d256-prod-github-runner-207 kernel: [17278.355059] print_cpu_stall.cold+0x2f/0xe2 Aug 22 10:11:44 juju-e4d256-prod-github-runner-207 kernel: [17278.355821] ? timekeeping_update+0xf7/0x150 Aug 22 10:11:44 juju-e4d256-prod-github-runner-207 kernel: [17278.356590] check_cpu_stall+0x109/0x270 Aug 22 10:11:44 juju-e4d256-prod-github-runner-207 kernel: [17278.357354] rcu_sched_clock_irq+0x9a/0x250 Aug 22 10:11:44 juju-e4d256-prod-github-runner-207 kernel: [17278.358115] update_process_times+0x94/0xd0 Aug 22 10:11:44 juju-e4d256-prod-github-runner-207 kernel: [17278.358879] tick_sched_handle+0x29/0x70 Aug 22 10:11:44 juju-e4d256-prod-github-runner-207 kernel: [17278.359628] tick_sched_timer+0x8c/0xc0 Aug 22 10:11:44 juju-e4d256-prod-github-runner-207 kernel: [17278.360364] ? tick_nohz_handler+0xb0/0xb0 Aug 22 10:11:44 juju-e4d256-prod-github-runner-207 kernel: [17278.361132] __hrtimer_run_queues+0x107/0x230 Aug 22 10:11:44 juju-e4d256-prod-github-runner-207 kernel: [17278.361932] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 10:11:44 juju-e4d256-prod-github-runner-207 kernel: [17278.362708] hrtimer_interrupt+0x101/0x220 Aug 22 10:11:44 juju-e4d256-prod-github-runner-207 kernel: [17278.363464] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 10:11:44 juju-e4d256-prod-github-runner-207 kernel: [17278.364279] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 10:11:44 juju-e4d256-prod-github-runner-207 kernel: [17278.365094] Aug 22 10:11:44 juju-e4d256-prod-github-runner-207 kernel: [17278.365733] Aug 22 10:11:44 juju-e4d256-prod-github-runner-207 kernel: [17278.366364] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 10:11:44 juju-e4d256-prod-github-runner-207 kernel: [17278.367181] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:11:44 juju-e4d256-prod-github-runner-207 kernel: [17278.368058] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 10:11:44 juju-e4d256-prod-github-runner-207 kernel: [17278.370281] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 10:11:44 juju-e4d256-prod-github-runner-207 kernel: [17278.371151] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 10:11:44 juju-e4d256-prod-github-runner-207 kernel: [17278.372147] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 10:11:44 juju-e4d256-prod-github-runner-207 kernel: [17278.373137] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 10:11:44 juju-e4d256-prod-github-runner-207 kernel: [17278.374103] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 10:11:44 juju-e4d256-prod-github-runner-207 kernel: [17278.375054] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 10:11:44 juju-e4d256-prod-github-runner-207 kernel: [17278.376008] ? _raw_spin_lock+0x22/0x30 Aug 22 10:11:44 juju-e4d256-prod-github-runner-207 kernel: [17278.376781] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:11:44 juju-e4d256-prod-github-runner-207 kernel: [17278.377621] direct_page_fault+0x206/0x310 [kvm] Aug 22 10:11:44 juju-e4d256-prod-github-runner-207 kernel: [17278.378456] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 10:11:44 juju-e4d256-prod-github-runner-207 kernel: [17278.379281] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 10:11:44 juju-e4d256-prod-github-runner-207 kernel: [17278.380100] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 10:11:44 juju-e4d256-prod-github-runner-207 kernel: [17278.380915] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 10:11:44 juju-e4d256-prod-github-runner-207 kernel: [17278.381698] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 10:11:44 juju-e4d256-prod-github-runner-207 kernel: [17278.382523] handle_exit+0x98/0x230 [kvm_amd] Aug 22 10:11:44 juju-e4d256-prod-github-runner-207 kernel: [17278.383281] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 10:11:44 juju-e4d256-prod-github-runner-207 kernel: [17278.384062] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 10:11:44 juju-e4d256-prod-github-runner-207 kernel: [17278.384874] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 10:11:44 juju-e4d256-prod-github-runner-207 kernel: [17278.385664] vcpu_run+0x62/0x2c0 [kvm] Aug 22 10:11:44 juju-e4d256-prod-github-runner-207 kernel: [17278.386376] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 10:11:44 juju-e4d256-prod-github-runner-207 kernel: [17278.387109] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 10:11:44 juju-e4d256-prod-github-runner-207 kernel: [17278.387932] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 10:11:44 juju-e4d256-prod-github-runner-207 kernel: [17278.388692] ? __seccomp_filter+0x4a/0x4a0 Aug 22 10:11:44 juju-e4d256-prod-github-runner-207 kernel: [17278.389427] ? __fget_files+0x86/0xc0 Aug 22 10:11:44 juju-e4d256-prod-github-runner-207 kernel: [17278.390118] __x64_sys_ioctl+0x95/0xd0 Aug 22 10:11:44 juju-e4d256-prod-github-runner-207 kernel: [17278.390810] do_syscall_64+0x5c/0xc0 Aug 22 10:11:44 juju-e4d256-prod-github-runner-207 kernel: [17278.391509] ? do_futex+0x162/0x1f0 Aug 22 10:11:44 juju-e4d256-prod-github-runner-207 kernel: [17278.392186] ? __x64_sys_futex+0x78/0x1e0 Aug 22 10:11:44 juju-e4d256-prod-github-runner-207 kernel: [17278.392902] ? __secure_computing+0xa9/0x120 Aug 22 10:11:44 juju-e4d256-prod-github-runner-207 kernel: [17278.393618] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 10:11:44 juju-e4d256-prod-github-runner-207 kernel: [17278.394404] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:11:44 juju-e4d256-prod-github-runner-207 kernel: [17278.395170] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:11:44 juju-e4d256-prod-github-runner-207 kernel: [17278.395920] ? do_syscall_64+0x69/0xc0 Aug 22 10:11:44 juju-e4d256-prod-github-runner-207 kernel: [17278.396608] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:11:44 juju-e4d256-prod-github-runner-207 kernel: [17278.397379] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:11:44 juju-e4d256-prod-github-runner-207 kernel: [17278.398139] ? do_syscall_64+0x69/0xc0 Aug 22 10:11:44 juju-e4d256-prod-github-runner-207 kernel: [17278.398830] ? do_syscall_64+0x69/0xc0 Aug 22 10:11:44 juju-e4d256-prod-github-runner-207 kernel: [17278.399513] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 10:11:44 juju-e4d256-prod-github-runner-207 kernel: [17278.400279] RIP: 0033:0x7faa5d0edaff Aug 22 10:11:44 juju-e4d256-prod-github-runner-207 kernel: [17278.400975] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 10:11:44 juju-e4d256-prod-github-runner-207 kernel: [17278.403068] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 10:11:44 juju-e4d256-prod-github-runner-207 kernel: [17278.404029] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 10:11:44 juju-e4d256-prod-github-runner-207 kernel: [17278.404982] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 10:11:44 juju-e4d256-prod-github-runner-207 kernel: [17278.405925] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 10:11:44 juju-e4d256-prod-github-runner-207 kernel: [17278.406866] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 10:11:44 juju-e4d256-prod-github-runner-207 kernel: [17278.407794] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 10:11:44 juju-e4d256-prod-github-runner-207 kernel: [17278.408728] Aug 22 10:12:10 juju-e4d256-prod-github-runner-207 kernel: [17304.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 16008s! [qemu-system-x86:6715] Aug 22 10:12:10 juju-e4d256-prod-github-runner-207 kernel: [17304.543118] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 10:12:10 juju-e4d256-prod-github-runner-207 kernel: [17304.543187] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 10:12:10 juju-e4d256-prod-github-runner-207 kernel: [17304.555307] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 10:12:10 juju-e4d256-prod-github-runner-207 kernel: [17304.556593] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 10:12:10 juju-e4d256-prod-github-runner-207 kernel: [17304.557815] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:12:10 juju-e4d256-prod-github-runner-207 kernel: [17304.558877] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 10:12:10 juju-e4d256-prod-github-runner-207 kernel: [17304.561451] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 10:12:10 juju-e4d256-prod-github-runner-207 kernel: [17304.562500] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 10:12:10 juju-e4d256-prod-github-runner-207 kernel: [17304.563668] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 10:12:10 juju-e4d256-prod-github-runner-207 kernel: [17304.564845] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 10:12:10 juju-e4d256-prod-github-runner-207 kernel: [17304.566014] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 10:12:10 juju-e4d256-prod-github-runner-207 kernel: [17304.567177] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 10:12:10 juju-e4d256-prod-github-runner-207 kernel: [17304.568347] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 10:12:10 juju-e4d256-prod-github-runner-207 kernel: [17304.569605] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 10:12:10 juju-e4d256-prod-github-runner-207 kernel: [17304.570712] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 10:12:10 juju-e4d256-prod-github-runner-207 kernel: [17304.571910] Call Trace: Aug 22 10:12:10 juju-e4d256-prod-github-runner-207 kernel: [17304.572842] Aug 22 10:12:10 juju-e4d256-prod-github-runner-207 kernel: [17304.573727] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:12:10 juju-e4d256-prod-github-runner-207 kernel: [17304.574763] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:12:10 juju-e4d256-prod-github-runner-207 kernel: [17304.575789] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:12:10 juju-e4d256-prod-github-runner-207 kernel: [17304.576875] ? show_regs.part.0+0x23/0x29 Aug 22 10:12:10 juju-e4d256-prod-github-runner-207 kernel: [17304.577879] ? show_regs.cold+0x8/0xd Aug 22 10:12:10 juju-e4d256-prod-github-runner-207 kernel: [17304.578857] ? watchdog_timer_fn+0x1be/0x220 Aug 22 10:12:10 juju-e4d256-prod-github-runner-207 kernel: [17304.579865] ? lockup_detector_update_enable+0x60/0x60 Aug 22 10:12:10 juju-e4d256-prod-github-runner-207 kernel: [17304.580944] ? __hrtimer_run_queues+0x107/0x230 Aug 22 10:12:10 juju-e4d256-prod-github-runner-207 kernel: [17304.581978] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 10:12:10 juju-e4d256-prod-github-runner-207 kernel: [17304.583008] ? hrtimer_interrupt+0x101/0x220 Aug 22 10:12:10 juju-e4d256-prod-github-runner-207 kernel: [17304.584024] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 10:12:10 juju-e4d256-prod-github-runner-207 kernel: [17304.585123] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 10:12:10 juju-e4d256-prod-github-runner-207 kernel: [17304.586173] Aug 22 10:12:10 juju-e4d256-prod-github-runner-207 kernel: [17304.587024] Aug 22 10:12:10 juju-e4d256-prod-github-runner-207 kernel: [17304.587861] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 10:12:10 juju-e4d256-prod-github-runner-207 kernel: [17304.588910] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:12:10 juju-e4d256-prod-github-runner-207 kernel: [17304.589953] ? _raw_spin_lock+0x22/0x30 Aug 22 10:12:10 juju-e4d256-prod-github-runner-207 kernel: [17304.590899] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:12:10 juju-e4d256-prod-github-runner-207 kernel: [17304.591919] direct_page_fault+0x206/0x310 [kvm] Aug 22 10:12:10 juju-e4d256-prod-github-runner-207 kernel: [17304.592954] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 10:12:10 juju-e4d256-prod-github-runner-207 kernel: [17304.593965] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 10:12:10 juju-e4d256-prod-github-runner-207 kernel: [17304.594972] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 10:12:10 juju-e4d256-prod-github-runner-207 kernel: [17304.595946] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 10:12:10 juju-e4d256-prod-github-runner-207 kernel: [17304.596914] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 10:12:10 juju-e4d256-prod-github-runner-207 kernel: [17304.597892] handle_exit+0x98/0x230 [kvm_amd] Aug 22 10:12:10 juju-e4d256-prod-github-runner-207 kernel: [17304.598784] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 10:12:10 juju-e4d256-prod-github-runner-207 kernel: [17304.599701] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 10:12:10 juju-e4d256-prod-github-runner-207 kernel: [17304.600644] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 10:12:10 juju-e4d256-prod-github-runner-207 kernel: [17304.601556] vcpu_run+0x62/0x2c0 [kvm] Aug 22 10:12:10 juju-e4d256-prod-github-runner-207 kernel: [17304.602365] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 10:12:10 juju-e4d256-prod-github-runner-207 kernel: [17304.603170] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 10:12:10 juju-e4d256-prod-github-runner-207 kernel: [17304.604027] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 10:12:10 juju-e4d256-prod-github-runner-207 kernel: [17304.604842] ? __seccomp_filter+0x4a/0x4a0 Aug 22 10:12:10 juju-e4d256-prod-github-runner-207 kernel: [17304.605588] ? __fget_files+0x86/0xc0 Aug 22 10:12:10 juju-e4d256-prod-github-runner-207 kernel: [17304.606288] __x64_sys_ioctl+0x95/0xd0 Aug 22 10:12:10 juju-e4d256-prod-github-runner-207 kernel: [17304.606983] do_syscall_64+0x5c/0xc0 Aug 22 10:12:10 juju-e4d256-prod-github-runner-207 kernel: [17304.607649] ? do_futex+0x162/0x1f0 Aug 22 10:12:10 juju-e4d256-prod-github-runner-207 kernel: [17304.608294] ? __x64_sys_futex+0x78/0x1e0 Aug 22 10:12:10 juju-e4d256-prod-github-runner-207 kernel: [17304.608980] ? __secure_computing+0xa9/0x120 Aug 22 10:12:10 juju-e4d256-prod-github-runner-207 kernel: [17304.609672] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 10:12:10 juju-e4d256-prod-github-runner-207 kernel: [17304.610428] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:12:10 juju-e4d256-prod-github-runner-207 kernel: [17304.611147] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:12:10 juju-e4d256-prod-github-runner-207 kernel: [17304.611865] ? do_syscall_64+0x69/0xc0 Aug 22 10:12:10 juju-e4d256-prod-github-runner-207 kernel: [17304.612524] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:12:10 juju-e4d256-prod-github-runner-207 kernel: [17304.613226] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:12:10 juju-e4d256-prod-github-runner-207 kernel: [17304.613919] ? do_syscall_64+0x69/0xc0 Aug 22 10:12:10 juju-e4d256-prod-github-runner-207 kernel: [17304.614546] ? do_syscall_64+0x69/0xc0 Aug 22 10:12:10 juju-e4d256-prod-github-runner-207 kernel: [17304.615166] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 10:12:10 juju-e4d256-prod-github-runner-207 kernel: [17304.615867] RIP: 0033:0x7faa5d0edaff Aug 22 10:12:10 juju-e4d256-prod-github-runner-207 kernel: [17304.616515] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 10:12:10 juju-e4d256-prod-github-runner-207 kernel: [17304.618632] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 10:12:10 juju-e4d256-prod-github-runner-207 kernel: [17304.619548] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 10:12:10 juju-e4d256-prod-github-runner-207 kernel: [17304.620450] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 10:12:10 juju-e4d256-prod-github-runner-207 kernel: [17304.621337] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 10:12:10 juju-e4d256-prod-github-runner-207 kernel: [17304.622233] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 10:12:10 juju-e4d256-prod-github-runner-207 kernel: [17304.623243] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 10:12:10 juju-e4d256-prod-github-runner-207 kernel: [17304.624173] Aug 22 10:12:38 juju-e4d256-prod-github-runner-207 kernel: [17332.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 16034s! [qemu-system-x86:6715] Aug 22 10:12:38 juju-e4d256-prod-github-runner-207 kernel: [17332.543169] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 10:12:38 juju-e4d256-prod-github-runner-207 kernel: [17332.543302] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 10:12:38 juju-e4d256-prod-github-runner-207 kernel: [17332.555370] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 10:12:38 juju-e4d256-prod-github-runner-207 kernel: [17332.556649] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 10:12:38 juju-e4d256-prod-github-runner-207 kernel: [17332.557876] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:12:38 juju-e4d256-prod-github-runner-207 kernel: [17332.558948] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 10:12:38 juju-e4d256-prod-github-runner-207 kernel: [17332.561504] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 10:12:38 juju-e4d256-prod-github-runner-207 kernel: [17332.562548] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 10:12:38 juju-e4d256-prod-github-runner-207 kernel: [17332.563714] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 10:12:38 juju-e4d256-prod-github-runner-207 kernel: [17332.564888] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 10:12:38 juju-e4d256-prod-github-runner-207 kernel: [17332.566044] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 10:12:38 juju-e4d256-prod-github-runner-207 kernel: [17332.567205] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 10:12:38 juju-e4d256-prod-github-runner-207 kernel: [17332.568382] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 10:12:38 juju-e4d256-prod-github-runner-207 kernel: [17332.569625] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 10:12:38 juju-e4d256-prod-github-runner-207 kernel: [17332.570740] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 10:12:38 juju-e4d256-prod-github-runner-207 kernel: [17332.571932] Call Trace: Aug 22 10:12:38 juju-e4d256-prod-github-runner-207 kernel: [17332.572855] Aug 22 10:12:38 juju-e4d256-prod-github-runner-207 kernel: [17332.573747] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:12:38 juju-e4d256-prod-github-runner-207 kernel: [17332.574787] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:12:38 juju-e4d256-prod-github-runner-207 kernel: [17332.575805] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:12:38 juju-e4d256-prod-github-runner-207 kernel: [17332.577064] ? show_regs.part.0+0x23/0x29 Aug 22 10:12:38 juju-e4d256-prod-github-runner-207 kernel: [17332.578059] ? show_regs.cold+0x8/0xd Aug 22 10:12:38 juju-e4d256-prod-github-runner-207 kernel: [17332.579035] ? watchdog_timer_fn+0x1be/0x220 Aug 22 10:12:38 juju-e4d256-prod-github-runner-207 kernel: [17332.580064] ? lockup_detector_update_enable+0x60/0x60 Aug 22 10:12:38 juju-e4d256-prod-github-runner-207 kernel: [17332.581127] ? __hrtimer_run_queues+0x107/0x230 Aug 22 10:12:38 juju-e4d256-prod-github-runner-207 kernel: [17332.582159] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 10:12:38 juju-e4d256-prod-github-runner-207 kernel: [17332.583180] ? hrtimer_interrupt+0x101/0x220 Aug 22 10:12:38 juju-e4d256-prod-github-runner-207 kernel: [17332.584213] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 10:12:38 juju-e4d256-prod-github-runner-207 kernel: [17332.585286] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 10:12:38 juju-e4d256-prod-github-runner-207 kernel: [17332.586331] Aug 22 10:12:38 juju-e4d256-prod-github-runner-207 kernel: [17332.587183] Aug 22 10:12:38 juju-e4d256-prod-github-runner-207 kernel: [17332.588019] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 10:12:38 juju-e4d256-prod-github-runner-207 kernel: [17332.589069] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:12:38 juju-e4d256-prod-github-runner-207 kernel: [17332.590113] ? _raw_spin_lock+0x22/0x30 Aug 22 10:12:38 juju-e4d256-prod-github-runner-207 kernel: [17332.591055] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:12:38 juju-e4d256-prod-github-runner-207 kernel: [17332.592094] direct_page_fault+0x206/0x310 [kvm] Aug 22 10:12:38 juju-e4d256-prod-github-runner-207 kernel: [17332.593117] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 10:12:38 juju-e4d256-prod-github-runner-207 kernel: [17332.594130] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 10:12:38 juju-e4d256-prod-github-runner-207 kernel: [17332.595136] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 10:12:38 juju-e4d256-prod-github-runner-207 kernel: [17332.596138] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 10:12:38 juju-e4d256-prod-github-runner-207 kernel: [17332.597083] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 10:12:38 juju-e4d256-prod-github-runner-207 kernel: [17332.598059] handle_exit+0x98/0x230 [kvm_amd] Aug 22 10:12:38 juju-e4d256-prod-github-runner-207 kernel: [17332.598952] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 10:12:38 juju-e4d256-prod-github-runner-207 kernel: [17332.599863] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 10:12:38 juju-e4d256-prod-github-runner-207 kernel: [17332.600800] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 10:12:38 juju-e4d256-prod-github-runner-207 kernel: [17332.601707] vcpu_run+0x62/0x2c0 [kvm] Aug 22 10:12:38 juju-e4d256-prod-github-runner-207 kernel: [17332.602516] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 10:12:38 juju-e4d256-prod-github-runner-207 kernel: [17332.603323] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 10:12:38 juju-e4d256-prod-github-runner-207 kernel: [17332.604188] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 10:12:38 juju-e4d256-prod-github-runner-207 kernel: [17332.604984] ? __seccomp_filter+0x4a/0x4a0 Aug 22 10:12:38 juju-e4d256-prod-github-runner-207 kernel: [17332.605725] ? __fget_files+0x86/0xc0 Aug 22 10:12:38 juju-e4d256-prod-github-runner-207 kernel: [17332.606430] __x64_sys_ioctl+0x95/0xd0 Aug 22 10:12:38 juju-e4d256-prod-github-runner-207 kernel: [17332.607121] do_syscall_64+0x5c/0xc0 Aug 22 10:12:38 juju-e4d256-prod-github-runner-207 kernel: [17332.607783] ? do_futex+0x162/0x1f0 Aug 22 10:12:38 juju-e4d256-prod-github-runner-207 kernel: [17332.608439] ? __x64_sys_futex+0x78/0x1e0 Aug 22 10:12:38 juju-e4d256-prod-github-runner-207 kernel: [17332.609117] ? __secure_computing+0xa9/0x120 Aug 22 10:12:38 juju-e4d256-prod-github-runner-207 kernel: [17332.609805] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 10:12:38 juju-e4d256-prod-github-runner-207 kernel: [17332.610568] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:12:38 juju-e4d256-prod-github-runner-207 kernel: [17332.611298] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:12:38 juju-e4d256-prod-github-runner-207 kernel: [17332.612019] ? do_syscall_64+0x69/0xc0 Aug 22 10:12:38 juju-e4d256-prod-github-runner-207 kernel: [17332.612675] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:12:38 juju-e4d256-prod-github-runner-207 kernel: [17332.613379] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:12:38 juju-e4d256-prod-github-runner-207 kernel: [17332.614073] ? do_syscall_64+0x69/0xc0 Aug 22 10:12:38 juju-e4d256-prod-github-runner-207 kernel: [17332.614695] ? do_syscall_64+0x69/0xc0 Aug 22 10:12:38 juju-e4d256-prod-github-runner-207 kernel: [17332.615314] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 10:12:38 juju-e4d256-prod-github-runner-207 kernel: [17332.616015] RIP: 0033:0x7faa5d0edaff Aug 22 10:12:38 juju-e4d256-prod-github-runner-207 kernel: [17332.616652] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 10:12:38 juju-e4d256-prod-github-runner-207 kernel: [17332.618630] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 10:12:38 juju-e4d256-prod-github-runner-207 kernel: [17332.619537] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 10:12:38 juju-e4d256-prod-github-runner-207 kernel: [17332.620435] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 10:12:38 juju-e4d256-prod-github-runner-207 kernel: [17332.621326] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 10:12:38 juju-e4d256-prod-github-runner-207 kernel: [17332.622212] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 10:12:38 juju-e4d256-prod-github-runner-207 kernel: [17332.623098] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 10:12:38 juju-e4d256-prod-github-runner-207 kernel: [17332.623987] Aug 22 10:13:06 juju-e4d256-prod-github-runner-207 kernel: [17360.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 16060s! [qemu-system-x86:6715] Aug 22 10:13:06 juju-e4d256-prod-github-runner-207 kernel: [17360.543692] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 10:13:06 juju-e4d256-prod-github-runner-207 kernel: [17360.543919] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 10:13:06 juju-e4d256-prod-github-runner-207 kernel: [17360.555984] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 10:13:06 juju-e4d256-prod-github-runner-207 kernel: [17360.557247] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 10:13:06 juju-e4d256-prod-github-runner-207 kernel: [17360.558467] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:13:06 juju-e4d256-prod-github-runner-207 kernel: [17360.559530] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 10:13:06 juju-e4d256-prod-github-runner-207 kernel: [17360.562094] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 10:13:06 juju-e4d256-prod-github-runner-207 kernel: [17360.563140] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 10:13:06 juju-e4d256-prod-github-runner-207 kernel: [17360.564316] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 10:13:06 juju-e4d256-prod-github-runner-207 kernel: [17360.565477] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 10:13:06 juju-e4d256-prod-github-runner-207 kernel: [17360.566640] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 10:13:06 juju-e4d256-prod-github-runner-207 kernel: [17360.567813] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 10:13:06 juju-e4d256-prod-github-runner-207 kernel: [17360.568985] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 10:13:06 juju-e4d256-prod-github-runner-207 kernel: [17360.570218] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 10:13:06 juju-e4d256-prod-github-runner-207 kernel: [17360.571315] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 10:13:06 juju-e4d256-prod-github-runner-207 kernel: [17360.572523] Call Trace: Aug 22 10:13:06 juju-e4d256-prod-github-runner-207 kernel: [17360.573445] Aug 22 10:13:06 juju-e4d256-prod-github-runner-207 kernel: [17360.574336] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:13:06 juju-e4d256-prod-github-runner-207 kernel: [17360.575369] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:13:06 juju-e4d256-prod-github-runner-207 kernel: [17360.576410] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:13:06 juju-e4d256-prod-github-runner-207 kernel: [17360.577487] ? show_regs.part.0+0x23/0x29 Aug 22 10:13:06 juju-e4d256-prod-github-runner-207 kernel: [17360.578488] ? show_regs.cold+0x8/0xd Aug 22 10:13:06 juju-e4d256-prod-github-runner-207 kernel: [17360.579458] ? watchdog_timer_fn+0x1be/0x220 Aug 22 10:13:06 juju-e4d256-prod-github-runner-207 kernel: [17360.580474] ? lockup_detector_update_enable+0x60/0x60 Aug 22 10:13:06 juju-e4d256-prod-github-runner-207 kernel: [17360.581539] ? __hrtimer_run_queues+0x107/0x230 Aug 22 10:13:06 juju-e4d256-prod-github-runner-207 kernel: [17360.582570] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 10:13:06 juju-e4d256-prod-github-runner-207 kernel: [17360.583591] ? hrtimer_interrupt+0x101/0x220 Aug 22 10:13:06 juju-e4d256-prod-github-runner-207 kernel: [17360.584621] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 10:13:06 juju-e4d256-prod-github-runner-207 kernel: [17360.585689] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 10:13:06 juju-e4d256-prod-github-runner-207 kernel: [17360.586733] Aug 22 10:13:06 juju-e4d256-prod-github-runner-207 kernel: [17360.587584] Aug 22 10:13:06 juju-e4d256-prod-github-runner-207 kernel: [17360.588438] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 10:13:06 juju-e4d256-prod-github-runner-207 kernel: [17360.589471] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:13:06 juju-e4d256-prod-github-runner-207 kernel: [17360.590508] ? _raw_spin_lock+0x22/0x30 Aug 22 10:13:06 juju-e4d256-prod-github-runner-207 kernel: [17360.591458] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:13:06 juju-e4d256-prod-github-runner-207 kernel: [17360.592483] direct_page_fault+0x206/0x310 [kvm] Aug 22 10:13:06 juju-e4d256-prod-github-runner-207 kernel: [17360.593522] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 10:13:06 juju-e4d256-prod-github-runner-207 kernel: [17360.594536] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 10:13:06 juju-e4d256-prod-github-runner-207 kernel: [17360.595535] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 10:13:06 juju-e4d256-prod-github-runner-207 kernel: [17360.596526] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 10:13:06 juju-e4d256-prod-github-runner-207 kernel: [17360.597474] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 10:13:06 juju-e4d256-prod-github-runner-207 kernel: [17360.598452] handle_exit+0x98/0x230 [kvm_amd] Aug 22 10:13:06 juju-e4d256-prod-github-runner-207 kernel: [17360.599344] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 10:13:06 juju-e4d256-prod-github-runner-207 kernel: [17360.600274] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 10:13:06 juju-e4d256-prod-github-runner-207 kernel: [17360.601202] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 10:13:06 juju-e4d256-prod-github-runner-207 kernel: [17360.602110] vcpu_run+0x62/0x2c0 [kvm] Aug 22 10:13:06 juju-e4d256-prod-github-runner-207 kernel: [17360.602932] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 10:13:06 juju-e4d256-prod-github-runner-207 kernel: [17360.603761] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 10:13:06 juju-e4d256-prod-github-runner-207 kernel: [17360.604614] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 10:13:06 juju-e4d256-prod-github-runner-207 kernel: [17360.605416] ? __seccomp_filter+0x4a/0x4a0 Aug 22 10:13:06 juju-e4d256-prod-github-runner-207 kernel: [17360.606162] ? __fget_files+0x86/0xc0 Aug 22 10:13:06 juju-e4d256-prod-github-runner-207 kernel: [17360.606865] __x64_sys_ioctl+0x95/0xd0 Aug 22 10:13:06 juju-e4d256-prod-github-runner-207 kernel: [17360.607562] do_syscall_64+0x5c/0xc0 Aug 22 10:13:06 juju-e4d256-prod-github-runner-207 kernel: [17360.608243] ? do_futex+0x162/0x1f0 Aug 22 10:13:06 juju-e4d256-prod-github-runner-207 kernel: [17360.608890] ? __x64_sys_futex+0x78/0x1e0 Aug 22 10:13:06 juju-e4d256-prod-github-runner-207 kernel: [17360.609562] ? __secure_computing+0xa9/0x120 Aug 22 10:13:06 juju-e4d256-prod-github-runner-207 kernel: [17360.610259] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 10:13:06 juju-e4d256-prod-github-runner-207 kernel: [17360.611018] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:13:06 juju-e4d256-prod-github-runner-207 kernel: [17360.611757] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:13:06 juju-e4d256-prod-github-runner-207 kernel: [17360.612485] ? do_syscall_64+0x69/0xc0 Aug 22 10:13:06 juju-e4d256-prod-github-runner-207 kernel: [17360.613142] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:13:06 juju-e4d256-prod-github-runner-207 kernel: [17360.613845] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:13:06 juju-e4d256-prod-github-runner-207 kernel: [17360.614539] ? do_syscall_64+0x69/0xc0 Aug 22 10:13:06 juju-e4d256-prod-github-runner-207 kernel: [17360.615169] ? do_syscall_64+0x69/0xc0 Aug 22 10:13:06 juju-e4d256-prod-github-runner-207 kernel: [17360.615803] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 10:13:06 juju-e4d256-prod-github-runner-207 kernel: [17360.616513] RIP: 0033:0x7faa5d0edaff Aug 22 10:13:06 juju-e4d256-prod-github-runner-207 kernel: [17360.617155] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 10:13:06 juju-e4d256-prod-github-runner-207 kernel: [17360.619143] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 10:13:06 juju-e4d256-prod-github-runner-207 kernel: [17360.620073] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 10:13:06 juju-e4d256-prod-github-runner-207 kernel: [17360.620977] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 10:13:06 juju-e4d256-prod-github-runner-207 kernel: [17360.621872] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 10:13:06 juju-e4d256-prod-github-runner-207 kernel: [17360.622764] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 10:13:06 juju-e4d256-prod-github-runner-207 kernel: [17360.623648] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 10:13:06 juju-e4d256-prod-github-runner-207 kernel: [17360.624545] Aug 22 10:13:34 juju-e4d256-prod-github-runner-207 kernel: [17388.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 16086s! [qemu-system-x86:6715] Aug 22 10:13:34 juju-e4d256-prod-github-runner-207 kernel: [17388.543095] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 10:13:34 juju-e4d256-prod-github-runner-207 kernel: [17388.543163] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 10:13:34 juju-e4d256-prod-github-runner-207 kernel: [17388.555308] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 10:13:34 juju-e4d256-prod-github-runner-207 kernel: [17388.556601] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 10:13:34 juju-e4d256-prod-github-runner-207 kernel: [17388.557822] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:13:34 juju-e4d256-prod-github-runner-207 kernel: [17388.558876] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 10:13:34 juju-e4d256-prod-github-runner-207 kernel: [17388.561423] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 10:13:34 juju-e4d256-prod-github-runner-207 kernel: [17388.562496] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 10:13:34 juju-e4d256-prod-github-runner-207 kernel: [17388.563700] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 10:13:34 juju-e4d256-prod-github-runner-207 kernel: [17388.564874] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 10:13:34 juju-e4d256-prod-github-runner-207 kernel: [17388.566033] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 10:13:34 juju-e4d256-prod-github-runner-207 kernel: [17388.567197] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 10:13:34 juju-e4d256-prod-github-runner-207 kernel: [17388.568368] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 10:13:34 juju-e4d256-prod-github-runner-207 kernel: [17388.569599] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 10:13:34 juju-e4d256-prod-github-runner-207 kernel: [17388.570693] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 10:13:34 juju-e4d256-prod-github-runner-207 kernel: [17388.571894] Call Trace: Aug 22 10:13:34 juju-e4d256-prod-github-runner-207 kernel: [17388.572803] Aug 22 10:13:34 juju-e4d256-prod-github-runner-207 kernel: [17388.573684] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:13:34 juju-e4d256-prod-github-runner-207 kernel: [17388.574713] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:13:34 juju-e4d256-prod-github-runner-207 kernel: [17388.575778] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:13:34 juju-e4d256-prod-github-runner-207 kernel: [17388.576861] ? show_regs.part.0+0x23/0x29 Aug 22 10:13:34 juju-e4d256-prod-github-runner-207 kernel: [17388.577860] ? show_regs.cold+0x8/0xd Aug 22 10:13:34 juju-e4d256-prod-github-runner-207 kernel: [17388.578829] ? watchdog_timer_fn+0x1be/0x220 Aug 22 10:13:34 juju-e4d256-prod-github-runner-207 kernel: [17388.579852] ? lockup_detector_update_enable+0x60/0x60 Aug 22 10:13:34 juju-e4d256-prod-github-runner-207 kernel: [17388.580914] ? __hrtimer_run_queues+0x107/0x230 Aug 22 10:13:34 juju-e4d256-prod-github-runner-207 kernel: [17388.581949] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 10:13:34 juju-e4d256-prod-github-runner-207 kernel: [17388.582985] ? hrtimer_interrupt+0x101/0x220 Aug 22 10:13:34 juju-e4d256-prod-github-runner-207 kernel: [17388.584015] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 10:13:34 juju-e4d256-prod-github-runner-207 kernel: [17388.585246] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 10:13:34 juju-e4d256-prod-github-runner-207 kernel: [17388.586321] Aug 22 10:13:34 juju-e4d256-prod-github-runner-207 kernel: [17388.587183] Aug 22 10:13:34 juju-e4d256-prod-github-runner-207 kernel: [17388.588040] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 10:13:34 juju-e4d256-prod-github-runner-207 kernel: [17388.589226] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:13:34 juju-e4d256-prod-github-runner-207 kernel: [17388.590265] ? _raw_spin_lock+0x22/0x30 Aug 22 10:13:34 juju-e4d256-prod-github-runner-207 kernel: [17388.591215] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:13:34 juju-e4d256-prod-github-runner-207 kernel: [17388.592241] direct_page_fault+0x206/0x310 [kvm] Aug 22 10:13:34 juju-e4d256-prod-github-runner-207 kernel: [17388.593264] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 10:13:34 juju-e4d256-prod-github-runner-207 kernel: [17388.594272] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 10:13:34 juju-e4d256-prod-github-runner-207 kernel: [17388.595277] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 10:13:34 juju-e4d256-prod-github-runner-207 kernel: [17388.596261] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 10:13:34 juju-e4d256-prod-github-runner-207 kernel: [17388.597225] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 10:13:34 juju-e4d256-prod-github-runner-207 kernel: [17388.598205] handle_exit+0x98/0x230 [kvm_amd] Aug 22 10:13:34 juju-e4d256-prod-github-runner-207 kernel: [17388.599098] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 10:13:34 juju-e4d256-prod-github-runner-207 kernel: [17388.600025] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 10:13:34 juju-e4d256-prod-github-runner-207 kernel: [17388.600950] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 10:13:34 juju-e4d256-prod-github-runner-207 kernel: [17388.601936] vcpu_run+0x62/0x2c0 [kvm] Aug 22 10:13:34 juju-e4d256-prod-github-runner-207 kernel: [17388.602758] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 10:13:34 juju-e4d256-prod-github-runner-207 kernel: [17388.603598] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 10:13:34 juju-e4d256-prod-github-runner-207 kernel: [17388.604451] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 10:13:34 juju-e4d256-prod-github-runner-207 kernel: [17388.605250] ? __seccomp_filter+0x4a/0x4a0 Aug 22 10:13:34 juju-e4d256-prod-github-runner-207 kernel: [17388.605990] ? __fget_files+0x86/0xc0 Aug 22 10:13:34 juju-e4d256-prod-github-runner-207 kernel: [17388.606691] __x64_sys_ioctl+0x95/0xd0 Aug 22 10:13:34 juju-e4d256-prod-github-runner-207 kernel: [17388.607399] do_syscall_64+0x5c/0xc0 Aug 22 10:13:34 juju-e4d256-prod-github-runner-207 kernel: [17388.608061] ? do_futex+0x162/0x1f0 Aug 22 10:13:34 juju-e4d256-prod-github-runner-207 kernel: [17388.608731] ? __x64_sys_futex+0x78/0x1e0 Aug 22 10:13:34 juju-e4d256-prod-github-runner-207 kernel: [17388.609407] ? __secure_computing+0xa9/0x120 Aug 22 10:13:34 juju-e4d256-prod-github-runner-207 kernel: [17388.610095] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 10:13:34 juju-e4d256-prod-github-runner-207 kernel: [17388.610859] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:13:34 juju-e4d256-prod-github-runner-207 kernel: [17388.611598] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:13:34 juju-e4d256-prod-github-runner-207 kernel: [17388.612313] ? do_syscall_64+0x69/0xc0 Aug 22 10:13:34 juju-e4d256-prod-github-runner-207 kernel: [17388.612956] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:13:34 juju-e4d256-prod-github-runner-207 kernel: [17388.613657] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:13:34 juju-e4d256-prod-github-runner-207 kernel: [17388.614355] ? do_syscall_64+0x69/0xc0 Aug 22 10:13:34 juju-e4d256-prod-github-runner-207 kernel: [17388.614989] ? do_syscall_64+0x69/0xc0 Aug 22 10:13:34 juju-e4d256-prod-github-runner-207 kernel: [17388.615636] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 10:13:34 juju-e4d256-prod-github-runner-207 kernel: [17388.616345] RIP: 0033:0x7faa5d0edaff Aug 22 10:13:34 juju-e4d256-prod-github-runner-207 kernel: [17388.616968] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 10:13:34 juju-e4d256-prod-github-runner-207 kernel: [17388.618946] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 10:13:34 juju-e4d256-prod-github-runner-207 kernel: [17388.619881] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 10:13:34 juju-e4d256-prod-github-runner-207 kernel: [17388.620767] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 10:13:34 juju-e4d256-prod-github-runner-207 kernel: [17388.621652] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 10:13:34 juju-e4d256-prod-github-runner-207 kernel: [17388.622557] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 10:13:34 juju-e4d256-prod-github-runner-207 kernel: [17388.623464] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 10:13:34 juju-e4d256-prod-github-runner-207 kernel: [17388.624352] Aug 22 10:14:02 juju-e4d256-prod-github-runner-207 kernel: [17416.541976] watchdog: BUG: soft lockup - CPU#1 stuck for 16112s! [qemu-system-x86:6715] Aug 22 10:14:02 juju-e4d256-prod-github-runner-207 kernel: [17416.543117] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 10:14:02 juju-e4d256-prod-github-runner-207 kernel: [17416.543183] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 10:14:02 juju-e4d256-prod-github-runner-207 kernel: [17416.555239] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 10:14:02 juju-e4d256-prod-github-runner-207 kernel: [17416.556513] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 10:14:02 juju-e4d256-prod-github-runner-207 kernel: [17416.557732] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:14:02 juju-e4d256-prod-github-runner-207 kernel: [17416.558789] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 10:14:02 juju-e4d256-prod-github-runner-207 kernel: [17416.561349] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 10:14:02 juju-e4d256-prod-github-runner-207 kernel: [17416.562390] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 10:14:02 juju-e4d256-prod-github-runner-207 kernel: [17416.563566] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 10:14:02 juju-e4d256-prod-github-runner-207 kernel: [17416.564873] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 10:14:02 juju-e4d256-prod-github-runner-207 kernel: [17416.566039] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 10:14:02 juju-e4d256-prod-github-runner-207 kernel: [17416.567215] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 10:14:02 juju-e4d256-prod-github-runner-207 kernel: [17416.568388] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 10:14:02 juju-e4d256-prod-github-runner-207 kernel: [17416.569621] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 10:14:02 juju-e4d256-prod-github-runner-207 kernel: [17416.570723] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 10:14:02 juju-e4d256-prod-github-runner-207 kernel: [17416.571931] Call Trace: Aug 22 10:14:02 juju-e4d256-prod-github-runner-207 kernel: [17416.572842] Aug 22 10:14:02 juju-e4d256-prod-github-runner-207 kernel: [17416.573725] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:14:02 juju-e4d256-prod-github-runner-207 kernel: [17416.574755] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:14:02 juju-e4d256-prod-github-runner-207 kernel: [17416.575780] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:14:02 juju-e4d256-prod-github-runner-207 kernel: [17416.576853] ? show_regs.part.0+0x23/0x29 Aug 22 10:14:02 juju-e4d256-prod-github-runner-207 kernel: [17416.577854] ? show_regs.cold+0x8/0xd Aug 22 10:14:02 juju-e4d256-prod-github-runner-207 kernel: [17416.578828] ? watchdog_timer_fn+0x1be/0x220 Aug 22 10:14:02 juju-e4d256-prod-github-runner-207 kernel: [17416.579844] ? lockup_detector_update_enable+0x60/0x60 Aug 22 10:14:02 juju-e4d256-prod-github-runner-207 kernel: [17416.580906] ? __hrtimer_run_queues+0x107/0x230 Aug 22 10:14:02 juju-e4d256-prod-github-runner-207 kernel: [17416.581933] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 10:14:02 juju-e4d256-prod-github-runner-207 kernel: [17416.582956] ? hrtimer_interrupt+0x101/0x220 Aug 22 10:14:02 juju-e4d256-prod-github-runner-207 kernel: [17416.583981] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 10:14:02 juju-e4d256-prod-github-runner-207 kernel: [17416.585048] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 10:14:02 juju-e4d256-prod-github-runner-207 kernel: [17416.586098] Aug 22 10:14:02 juju-e4d256-prod-github-runner-207 kernel: [17416.586956] Aug 22 10:14:02 juju-e4d256-prod-github-runner-207 kernel: [17416.587799] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 10:14:02 juju-e4d256-prod-github-runner-207 kernel: [17416.588830] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:14:02 juju-e4d256-prod-github-runner-207 kernel: [17416.589866] ? _raw_spin_lock+0x22/0x30 Aug 22 10:14:02 juju-e4d256-prod-github-runner-207 kernel: [17416.590809] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:14:02 juju-e4d256-prod-github-runner-207 kernel: [17416.591828] direct_page_fault+0x206/0x310 [kvm] Aug 22 10:14:02 juju-e4d256-prod-github-runner-207 kernel: [17416.592850] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 10:14:02 juju-e4d256-prod-github-runner-207 kernel: [17416.593857] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 10:14:02 juju-e4d256-prod-github-runner-207 kernel: [17416.594860] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 10:14:02 juju-e4d256-prod-github-runner-207 kernel: [17416.595845] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 10:14:02 juju-e4d256-prod-github-runner-207 kernel: [17416.596789] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 10:14:02 juju-e4d256-prod-github-runner-207 kernel: [17416.597769] handle_exit+0x98/0x230 [kvm_amd] Aug 22 10:14:02 juju-e4d256-prod-github-runner-207 kernel: [17416.598663] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 10:14:02 juju-e4d256-prod-github-runner-207 kernel: [17416.599588] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 10:14:02 juju-e4d256-prod-github-runner-207 kernel: [17416.600511] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 10:14:02 juju-e4d256-prod-github-runner-207 kernel: [17416.601417] vcpu_run+0x62/0x2c0 [kvm] Aug 22 10:14:02 juju-e4d256-prod-github-runner-207 kernel: [17416.602226] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 10:14:02 juju-e4d256-prod-github-runner-207 kernel: [17416.603038] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 10:14:02 juju-e4d256-prod-github-runner-207 kernel: [17416.603903] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 10:14:02 juju-e4d256-prod-github-runner-207 kernel: [17416.604698] ? __seccomp_filter+0x4a/0x4a0 Aug 22 10:14:02 juju-e4d256-prod-github-runner-207 kernel: [17416.605439] ? __fget_files+0x86/0xc0 Aug 22 10:14:02 juju-e4d256-prod-github-runner-207 kernel: [17416.606140] __x64_sys_ioctl+0x95/0xd0 Aug 22 10:14:02 juju-e4d256-prod-github-runner-207 kernel: [17416.606830] do_syscall_64+0x5c/0xc0 Aug 22 10:14:02 juju-e4d256-prod-github-runner-207 kernel: [17416.607501] ? do_futex+0x162/0x1f0 Aug 22 10:14:02 juju-e4d256-prod-github-runner-207 kernel: [17416.608149] ? __x64_sys_futex+0x78/0x1e0 Aug 22 10:14:02 juju-e4d256-prod-github-runner-207 kernel: [17416.608820] ? __secure_computing+0xa9/0x120 Aug 22 10:14:02 juju-e4d256-prod-github-runner-207 kernel: [17416.609508] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 10:14:02 juju-e4d256-prod-github-runner-207 kernel: [17416.610270] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:14:02 juju-e4d256-prod-github-runner-207 kernel: [17416.610995] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:14:02 juju-e4d256-prod-github-runner-207 kernel: [17416.611724] ? do_syscall_64+0x69/0xc0 Aug 22 10:14:02 juju-e4d256-prod-github-runner-207 kernel: [17416.612366] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:14:02 juju-e4d256-prod-github-runner-207 kernel: [17416.613070] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:14:02 juju-e4d256-prod-github-runner-207 kernel: [17416.613763] ? do_syscall_64+0x69/0xc0 Aug 22 10:14:02 juju-e4d256-prod-github-runner-207 kernel: [17416.614385] ? do_syscall_64+0x69/0xc0 Aug 22 10:14:02 juju-e4d256-prod-github-runner-207 kernel: [17416.615010] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 10:14:02 juju-e4d256-prod-github-runner-207 kernel: [17416.615723] RIP: 0033:0x7faa5d0edaff Aug 22 10:14:02 juju-e4d256-prod-github-runner-207 kernel: [17416.616344] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 10:14:02 juju-e4d256-prod-github-runner-207 kernel: [17416.618327] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 10:14:02 juju-e4d256-prod-github-runner-207 kernel: [17416.619240] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 10:14:02 juju-e4d256-prod-github-runner-207 kernel: [17416.620135] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 10:14:02 juju-e4d256-prod-github-runner-207 kernel: [17416.621026] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 10:14:02 juju-e4d256-prod-github-runner-207 kernel: [17416.621915] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 10:14:02 juju-e4d256-prod-github-runner-207 kernel: [17416.622806] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 10:14:02 juju-e4d256-prod-github-runner-207 kernel: [17416.623707] Aug 22 10:14:30 juju-e4d256-prod-github-runner-207 kernel: [17444.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 16138s! [qemu-system-x86:6715] Aug 22 10:14:30 juju-e4d256-prod-github-runner-207 kernel: [17444.543866] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 10:14:30 juju-e4d256-prod-github-runner-207 kernel: [17444.544117] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 10:14:30 juju-e4d256-prod-github-runner-207 kernel: [17444.556361] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 10:14:30 juju-e4d256-prod-github-runner-207 kernel: [17444.557627] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 10:14:30 juju-e4d256-prod-github-runner-207 kernel: [17444.558874] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:14:30 juju-e4d256-prod-github-runner-207 kernel: [17444.560020] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 10:14:30 juju-e4d256-prod-github-runner-207 kernel: [17444.562580] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 10:14:30 juju-e4d256-prod-github-runner-207 kernel: [17444.563651] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 10:14:30 juju-e4d256-prod-github-runner-207 kernel: [17444.564820] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 10:14:30 juju-e4d256-prod-github-runner-207 kernel: [17444.565984] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 10:14:30 juju-e4d256-prod-github-runner-207 kernel: [17444.567162] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 10:14:30 juju-e4d256-prod-github-runner-207 kernel: [17444.568334] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 10:14:30 juju-e4d256-prod-github-runner-207 kernel: [17444.569513] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 10:14:30 juju-e4d256-prod-github-runner-207 kernel: [17444.570764] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 10:14:30 juju-e4d256-prod-github-runner-207 kernel: [17444.571868] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 10:14:30 juju-e4d256-prod-github-runner-207 kernel: [17444.573064] Call Trace: Aug 22 10:14:30 juju-e4d256-prod-github-runner-207 kernel: [17444.573988] Aug 22 10:14:30 juju-e4d256-prod-github-runner-207 kernel: [17444.574905] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:14:30 juju-e4d256-prod-github-runner-207 kernel: [17444.575943] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:14:30 juju-e4d256-prod-github-runner-207 kernel: [17444.576973] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:14:30 juju-e4d256-prod-github-runner-207 kernel: [17444.578065] ? show_regs.part.0+0x23/0x29 Aug 22 10:14:30 juju-e4d256-prod-github-runner-207 kernel: [17444.579088] ? show_regs.cold+0x8/0xd Aug 22 10:14:30 juju-e4d256-prod-github-runner-207 kernel: [17444.580065] ? watchdog_timer_fn+0x1be/0x220 Aug 22 10:14:30 juju-e4d256-prod-github-runner-207 kernel: [17444.581075] ? lockup_detector_update_enable+0x60/0x60 Aug 22 10:14:30 juju-e4d256-prod-github-runner-207 kernel: [17444.582140] ? __hrtimer_run_queues+0x107/0x230 Aug 22 10:14:30 juju-e4d256-prod-github-runner-207 kernel: [17444.583193] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 10:14:30 juju-e4d256-prod-github-runner-207 kernel: [17444.584223] ? hrtimer_interrupt+0x101/0x220 Aug 22 10:14:30 juju-e4d256-prod-github-runner-207 kernel: [17444.585245] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 10:14:30 juju-e4d256-prod-github-runner-207 kernel: [17444.586321] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 10:14:30 juju-e4d256-prod-github-runner-207 kernel: [17444.587375] Aug 22 10:14:30 juju-e4d256-prod-github-runner-207 kernel: [17444.588227] Aug 22 10:14:30 juju-e4d256-prod-github-runner-207 kernel: [17444.589067] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 10:14:30 juju-e4d256-prod-github-runner-207 kernel: [17444.590101] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:14:30 juju-e4d256-prod-github-runner-207 kernel: [17444.591157] ? _raw_spin_lock+0x22/0x30 Aug 22 10:14:30 juju-e4d256-prod-github-runner-207 kernel: [17444.592104] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:14:30 juju-e4d256-prod-github-runner-207 kernel: [17444.593132] direct_page_fault+0x206/0x310 [kvm] Aug 22 10:14:30 juju-e4d256-prod-github-runner-207 kernel: [17444.594157] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 10:14:30 juju-e4d256-prod-github-runner-207 kernel: [17444.595190] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 10:14:30 juju-e4d256-prod-github-runner-207 kernel: [17444.596193] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 10:14:30 juju-e4d256-prod-github-runner-207 kernel: [17444.597194] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 10:14:30 juju-e4d256-prod-github-runner-207 kernel: [17444.598141] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 10:14:30 juju-e4d256-prod-github-runner-207 kernel: [17444.599136] handle_exit+0x98/0x230 [kvm_amd] Aug 22 10:14:30 juju-e4d256-prod-github-runner-207 kernel: [17444.600036] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 10:14:30 juju-e4d256-prod-github-runner-207 kernel: [17444.600952] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 10:14:30 juju-e4d256-prod-github-runner-207 kernel: [17444.601904] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 10:14:30 juju-e4d256-prod-github-runner-207 kernel: [17444.602849] vcpu_run+0x62/0x2c0 [kvm] Aug 22 10:14:30 juju-e4d256-prod-github-runner-207 kernel: [17444.603672] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 10:14:30 juju-e4d256-prod-github-runner-207 kernel: [17444.604517] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 10:14:30 juju-e4d256-prod-github-runner-207 kernel: [17444.605385] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 10:14:30 juju-e4d256-prod-github-runner-207 kernel: [17444.606186] ? __seccomp_filter+0x4a/0x4a0 Aug 22 10:14:30 juju-e4d256-prod-github-runner-207 kernel: [17444.606949] ? __fget_files+0x86/0xc0 Aug 22 10:14:30 juju-e4d256-prod-github-runner-207 kernel: [17444.607664] __x64_sys_ioctl+0x95/0xd0 Aug 22 10:14:30 juju-e4d256-prod-github-runner-207 kernel: [17444.608355] do_syscall_64+0x5c/0xc0 Aug 22 10:14:30 juju-e4d256-prod-github-runner-207 kernel: [17444.609019] ? do_futex+0x162/0x1f0 Aug 22 10:14:30 juju-e4d256-prod-github-runner-207 kernel: [17444.609671] ? __x64_sys_futex+0x78/0x1e0 Aug 22 10:14:30 juju-e4d256-prod-github-runner-207 kernel: [17444.610343] ? __secure_computing+0xa9/0x120 Aug 22 10:14:30 juju-e4d256-prod-github-runner-207 kernel: [17444.611047] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 10:14:30 juju-e4d256-prod-github-runner-207 kernel: [17444.611813] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:14:30 juju-e4d256-prod-github-runner-207 kernel: [17444.612536] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:14:30 juju-e4d256-prod-github-runner-207 kernel: [17444.613257] ? do_syscall_64+0x69/0xc0 Aug 22 10:14:30 juju-e4d256-prod-github-runner-207 kernel: [17444.613908] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:14:30 juju-e4d256-prod-github-runner-207 kernel: [17444.614630] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:14:30 juju-e4d256-prod-github-runner-207 kernel: [17444.615350] ? do_syscall_64+0x69/0xc0 Aug 22 10:14:30 juju-e4d256-prod-github-runner-207 kernel: [17444.615973] ? do_syscall_64+0x69/0xc0 Aug 22 10:14:30 juju-e4d256-prod-github-runner-207 kernel: [17444.616595] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 10:14:30 juju-e4d256-prod-github-runner-207 kernel: [17444.617301] RIP: 0033:0x7faa5d0edaff Aug 22 10:14:30 juju-e4d256-prod-github-runner-207 kernel: [17444.617964] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 10:14:30 juju-e4d256-prod-github-runner-207 kernel: [17444.619968] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 10:14:30 juju-e4d256-prod-github-runner-207 kernel: [17444.620881] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 10:14:30 juju-e4d256-prod-github-runner-207 kernel: [17444.621779] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 10:14:30 juju-e4d256-prod-github-runner-207 kernel: [17444.622668] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 10:14:30 juju-e4d256-prod-github-runner-207 kernel: [17444.623625] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 10:14:30 juju-e4d256-prod-github-runner-207 kernel: [17444.624535] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 10:14:30 juju-e4d256-prod-github-runner-207 kernel: [17444.625433] Aug 22 10:14:44 juju-e4d256-prod-github-runner-207 kernel: [17458.352706] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 10:14:44 juju-e4d256-prod-github-runner-207 kernel: [17458.353664] rcu: 1-....: (4321753 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=2090153 Aug 22 10:14:44 juju-e4d256-prod-github-runner-207 kernel: [17458.354794] (t=4335288 jiffies g=23269 q=24099) Aug 22 10:14:44 juju-e4d256-prod-github-runner-207 kernel: [17458.355582] NMI backtrace for cpu 1 Aug 22 10:14:44 juju-e4d256-prod-github-runner-207 kernel: [17458.356290] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 10:14:44 juju-e4d256-prod-github-runner-207 kernel: [17458.357389] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 10:14:44 juju-e4d256-prod-github-runner-207 kernel: [17458.358451] Call Trace: Aug 22 10:14:44 juju-e4d256-prod-github-runner-207 kernel: [17458.359150] Aug 22 10:14:44 juju-e4d256-prod-github-runner-207 kernel: [17458.359793] show_stack+0x52/0x5c Aug 22 10:14:44 juju-e4d256-prod-github-runner-207 kernel: [17458.360517] dump_stack_lvl+0x4a/0x63 Aug 22 10:14:44 juju-e4d256-prod-github-runner-207 kernel: [17458.361262] dump_stack+0x10/0x16 Aug 22 10:14:44 juju-e4d256-prod-github-runner-207 kernel: [17458.361977] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 10:14:44 juju-e4d256-prod-github-runner-207 kernel: [17458.362771] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 10:14:44 juju-e4d256-prod-github-runner-207 kernel: [17458.363548] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 10:14:44 juju-e4d256-prod-github-runner-207 kernel: [17458.364366] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 10:14:44 juju-e4d256-prod-github-runner-207 kernel: [17458.365182] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 10:14:44 juju-e4d256-prod-github-runner-207 kernel: [17458.365989] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 10:14:44 juju-e4d256-prod-github-runner-207 kernel: [17458.366772] print_cpu_stall.cold+0x2f/0xe2 Aug 22 10:14:44 juju-e4d256-prod-github-runner-207 kernel: [17458.367535] ? timekeeping_update+0xf7/0x150 Aug 22 10:14:44 juju-e4d256-prod-github-runner-207 kernel: [17458.368304] check_cpu_stall+0x109/0x270 Aug 22 10:14:44 juju-e4d256-prod-github-runner-207 kernel: [17458.369048] rcu_sched_clock_irq+0x9a/0x250 Aug 22 10:14:44 juju-e4d256-prod-github-runner-207 kernel: [17458.369838] update_process_times+0x94/0xd0 Aug 22 10:14:44 juju-e4d256-prod-github-runner-207 kernel: [17458.370613] tick_sched_handle+0x29/0x70 Aug 22 10:14:44 juju-e4d256-prod-github-runner-207 kernel: [17458.371357] tick_sched_timer+0x8c/0xc0 Aug 22 10:14:44 juju-e4d256-prod-github-runner-207 kernel: [17458.372093] ? tick_nohz_handler+0xb0/0xb0 Aug 22 10:14:44 juju-e4d256-prod-github-runner-207 kernel: [17458.372845] __hrtimer_run_queues+0x107/0x230 Aug 22 10:14:44 juju-e4d256-prod-github-runner-207 kernel: [17458.373614] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 10:14:44 juju-e4d256-prod-github-runner-207 kernel: [17458.374387] hrtimer_interrupt+0x101/0x220 Aug 22 10:14:44 juju-e4d256-prod-github-runner-207 kernel: [17458.375153] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 10:14:44 juju-e4d256-prod-github-runner-207 kernel: [17458.375961] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 10:14:44 juju-e4d256-prod-github-runner-207 kernel: [17458.376759] Aug 22 10:14:44 juju-e4d256-prod-github-runner-207 kernel: [17458.377392] Aug 22 10:14:44 juju-e4d256-prod-github-runner-207 kernel: [17458.378019] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 10:14:44 juju-e4d256-prod-github-runner-207 kernel: [17458.378858] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:14:44 juju-e4d256-prod-github-runner-207 kernel: [17458.379734] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 10:14:44 juju-e4d256-prod-github-runner-207 kernel: [17458.381939] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 10:14:44 juju-e4d256-prod-github-runner-207 kernel: [17458.382828] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 10:14:44 juju-e4d256-prod-github-runner-207 kernel: [17458.383819] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 10:14:44 juju-e4d256-prod-github-runner-207 kernel: [17458.384794] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 10:14:44 juju-e4d256-prod-github-runner-207 kernel: [17458.385755] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 10:14:44 juju-e4d256-prod-github-runner-207 kernel: [17458.386724] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 10:14:44 juju-e4d256-prod-github-runner-207 kernel: [17458.387678] ? _raw_spin_lock+0x22/0x30 Aug 22 10:14:44 juju-e4d256-prod-github-runner-207 kernel: [17458.388438] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:14:44 juju-e4d256-prod-github-runner-207 kernel: [17458.389274] direct_page_fault+0x206/0x310 [kvm] Aug 22 10:14:44 juju-e4d256-prod-github-runner-207 kernel: [17458.390115] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 10:14:44 juju-e4d256-prod-github-runner-207 kernel: [17458.390954] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 10:14:44 juju-e4d256-prod-github-runner-207 kernel: [17458.391777] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 10:14:44 juju-e4d256-prod-github-runner-207 kernel: [17458.392581] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 10:14:44 juju-e4d256-prod-github-runner-207 kernel: [17458.393376] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 10:14:44 juju-e4d256-prod-github-runner-207 kernel: [17458.394198] handle_exit+0x98/0x230 [kvm_amd] Aug 22 10:14:44 juju-e4d256-prod-github-runner-207 kernel: [17458.394965] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 10:14:44 juju-e4d256-prod-github-runner-207 kernel: [17458.395748] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 10:14:44 juju-e4d256-prod-github-runner-207 kernel: [17458.396547] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 10:14:44 juju-e4d256-prod-github-runner-207 kernel: [17458.397348] vcpu_run+0x62/0x2c0 [kvm] Aug 22 10:14:44 juju-e4d256-prod-github-runner-207 kernel: [17458.398065] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 10:14:44 juju-e4d256-prod-github-runner-207 kernel: [17458.398828] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 10:14:44 juju-e4d256-prod-github-runner-207 kernel: [17458.399654] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 10:14:44 juju-e4d256-prod-github-runner-207 kernel: [17458.400420] ? __seccomp_filter+0x4a/0x4a0 Aug 22 10:14:44 juju-e4d256-prod-github-runner-207 kernel: [17458.401140] ? __fget_files+0x86/0xc0 Aug 22 10:14:44 juju-e4d256-prod-github-runner-207 kernel: [17458.401836] __x64_sys_ioctl+0x95/0xd0 Aug 22 10:14:44 juju-e4d256-prod-github-runner-207 kernel: [17458.402531] do_syscall_64+0x5c/0xc0 Aug 22 10:14:44 juju-e4d256-prod-github-runner-207 kernel: [17458.403230] ? do_futex+0x162/0x1f0 Aug 22 10:14:44 juju-e4d256-prod-github-runner-207 kernel: [17458.403901] ? __x64_sys_futex+0x78/0x1e0 Aug 22 10:14:44 juju-e4d256-prod-github-runner-207 kernel: [17458.404600] ? __secure_computing+0xa9/0x120 Aug 22 10:14:44 juju-e4d256-prod-github-runner-207 kernel: [17458.405315] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 10:14:44 juju-e4d256-prod-github-runner-207 kernel: [17458.406108] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:14:44 juju-e4d256-prod-github-runner-207 kernel: [17458.406871] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:14:44 juju-e4d256-prod-github-runner-207 kernel: [17458.407623] ? do_syscall_64+0x69/0xc0 Aug 22 10:14:44 juju-e4d256-prod-github-runner-207 kernel: [17458.408311] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:14:44 juju-e4d256-prod-github-runner-207 kernel: [17458.409072] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:14:44 juju-e4d256-prod-github-runner-207 kernel: [17458.409827] ? do_syscall_64+0x69/0xc0 Aug 22 10:14:44 juju-e4d256-prod-github-runner-207 kernel: [17458.410518] ? do_syscall_64+0x69/0xc0 Aug 22 10:14:44 juju-e4d256-prod-github-runner-207 kernel: [17458.411220] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 10:14:44 juju-e4d256-prod-github-runner-207 kernel: [17458.411998] RIP: 0033:0x7faa5d0edaff Aug 22 10:14:44 juju-e4d256-prod-github-runner-207 kernel: [17458.412679] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 10:14:44 juju-e4d256-prod-github-runner-207 kernel: [17458.414785] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 10:14:44 juju-e4d256-prod-github-runner-207 kernel: [17458.415744] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 10:14:44 juju-e4d256-prod-github-runner-207 kernel: [17458.416697] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 10:14:44 juju-e4d256-prod-github-runner-207 kernel: [17458.417650] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 10:14:44 juju-e4d256-prod-github-runner-207 kernel: [17458.418607] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 10:14:44 juju-e4d256-prod-github-runner-207 kernel: [17458.419535] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 10:14:44 juju-e4d256-prod-github-runner-207 kernel: [17458.420450] Aug 22 10:15:10 juju-e4d256-prod-github-runner-207 kernel: [17484.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 16175s! [qemu-system-x86:6715] Aug 22 10:15:10 juju-e4d256-prod-github-runner-207 kernel: [17484.543106] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 10:15:10 juju-e4d256-prod-github-runner-207 kernel: [17484.543172] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 10:15:10 juju-e4d256-prod-github-runner-207 kernel: [17484.556289] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 10:15:10 juju-e4d256-prod-github-runner-207 kernel: [17484.557580] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 10:15:10 juju-e4d256-prod-github-runner-207 kernel: [17484.558818] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:15:10 juju-e4d256-prod-github-runner-207 kernel: [17484.559876] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 10:15:10 juju-e4d256-prod-github-runner-207 kernel: [17484.562461] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 10:15:10 juju-e4d256-prod-github-runner-207 kernel: [17484.563510] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 10:15:10 juju-e4d256-prod-github-runner-207 kernel: [17484.564671] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 10:15:10 juju-e4d256-prod-github-runner-207 kernel: [17484.565840] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 10:15:10 juju-e4d256-prod-github-runner-207 kernel: [17484.567014] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 10:15:10 juju-e4d256-prod-github-runner-207 kernel: [17484.568174] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 10:15:10 juju-e4d256-prod-github-runner-207 kernel: [17484.569338] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 10:15:10 juju-e4d256-prod-github-runner-207 kernel: [17484.570595] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 10:15:10 juju-e4d256-prod-github-runner-207 kernel: [17484.571747] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 10:15:10 juju-e4d256-prod-github-runner-207 kernel: [17484.573010] Call Trace: Aug 22 10:15:10 juju-e4d256-prod-github-runner-207 kernel: [17484.573929] Aug 22 10:15:10 juju-e4d256-prod-github-runner-207 kernel: [17484.574825] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:15:10 juju-e4d256-prod-github-runner-207 kernel: [17484.575864] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:15:10 juju-e4d256-prod-github-runner-207 kernel: [17484.577113] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:15:10 juju-e4d256-prod-github-runner-207 kernel: [17484.578351] ? show_regs.part.0+0x23/0x29 Aug 22 10:15:10 juju-e4d256-prod-github-runner-207 kernel: [17484.579481] ? show_regs.cold+0x8/0xd Aug 22 10:15:10 juju-e4d256-prod-github-runner-207 kernel: [17484.580549] ? watchdog_timer_fn+0x1be/0x220 Aug 22 10:15:10 juju-e4d256-prod-github-runner-207 kernel: [17484.581617] ? lockup_detector_update_enable+0x60/0x60 Aug 22 10:15:10 juju-e4d256-prod-github-runner-207 kernel: [17484.582798] ? __hrtimer_run_queues+0x107/0x230 Aug 22 10:15:10 juju-e4d256-prod-github-runner-207 kernel: [17484.583881] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 10:15:10 juju-e4d256-prod-github-runner-207 kernel: [17484.585036] ? hrtimer_interrupt+0x101/0x220 Aug 22 10:15:10 juju-e4d256-prod-github-runner-207 kernel: [17484.586052] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 10:15:10 juju-e4d256-prod-github-runner-207 kernel: [17484.587134] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 10:15:10 juju-e4d256-prod-github-runner-207 kernel: [17484.588182] Aug 22 10:15:10 juju-e4d256-prod-github-runner-207 kernel: [17484.589034] Aug 22 10:15:10 juju-e4d256-prod-github-runner-207 kernel: [17484.589876] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 10:15:10 juju-e4d256-prod-github-runner-207 kernel: [17484.590944] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:15:10 juju-e4d256-prod-github-runner-207 kernel: [17484.592101] ? _raw_spin_lock+0x22/0x30 Aug 22 10:15:10 juju-e4d256-prod-github-runner-207 kernel: [17484.593175] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:15:10 juju-e4d256-prod-github-runner-207 kernel: [17484.594303] direct_page_fault+0x206/0x310 [kvm] Aug 22 10:15:10 juju-e4d256-prod-github-runner-207 kernel: [17484.595559] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 10:15:10 juju-e4d256-prod-github-runner-207 kernel: [17484.596729] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 10:15:10 juju-e4d256-prod-github-runner-207 kernel: [17484.597843] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 10:15:10 juju-e4d256-prod-github-runner-207 kernel: [17484.598981] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 10:15:10 juju-e4d256-prod-github-runner-207 kernel: [17484.600020] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 10:15:10 juju-e4d256-prod-github-runner-207 kernel: [17484.601082] handle_exit+0x98/0x230 [kvm_amd] Aug 22 10:15:10 juju-e4d256-prod-github-runner-207 kernel: [17484.601984] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 10:15:10 juju-e4d256-prod-github-runner-207 kernel: [17484.603077] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 10:15:10 juju-e4d256-prod-github-runner-207 kernel: [17484.604233] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 10:15:10 juju-e4d256-prod-github-runner-207 kernel: [17484.605257] vcpu_run+0x62/0x2c0 [kvm] Aug 22 10:15:10 juju-e4d256-prod-github-runner-207 kernel: [17484.606167] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 10:15:10 juju-e4d256-prod-github-runner-207 kernel: [17484.607099] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 10:15:10 juju-e4d256-prod-github-runner-207 kernel: [17484.608205] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 10:15:10 juju-e4d256-prod-github-runner-207 kernel: [17484.609160] ? __seccomp_filter+0x4a/0x4a0 Aug 22 10:15:10 juju-e4d256-prod-github-runner-207 kernel: [17484.609993] ? __fget_files+0x86/0xc0 Aug 22 10:15:10 juju-e4d256-prod-github-runner-207 kernel: [17484.610831] __x64_sys_ioctl+0x95/0xd0 Aug 22 10:15:10 juju-e4d256-prod-github-runner-207 kernel: [17484.611608] do_syscall_64+0x5c/0xc0 Aug 22 10:15:10 juju-e4d256-prod-github-runner-207 kernel: [17484.612369] ? do_futex+0x162/0x1f0 Aug 22 10:15:10 juju-e4d256-prod-github-runner-207 kernel: [17484.613020] ? __x64_sys_futex+0x78/0x1e0 Aug 22 10:15:10 juju-e4d256-prod-github-runner-207 kernel: [17484.613758] ? __secure_computing+0xa9/0x120 Aug 22 10:15:10 juju-e4d256-prod-github-runner-207 kernel: [17484.614561] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 10:15:10 juju-e4d256-prod-github-runner-207 kernel: [17484.615389] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:15:10 juju-e4d256-prod-github-runner-207 kernel: [17484.616114] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:15:10 juju-e4d256-prod-github-runner-207 kernel: [17484.616837] ? do_syscall_64+0x69/0xc0 Aug 22 10:15:10 juju-e4d256-prod-github-runner-207 kernel: [17484.617483] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:15:10 juju-e4d256-prod-github-runner-207 kernel: [17484.618210] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:15:10 juju-e4d256-prod-github-runner-207 kernel: [17484.618979] ? do_syscall_64+0x69/0xc0 Aug 22 10:15:10 juju-e4d256-prod-github-runner-207 kernel: [17484.619693] ? do_syscall_64+0x69/0xc0 Aug 22 10:15:10 juju-e4d256-prod-github-runner-207 kernel: [17484.620342] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 10:15:10 juju-e4d256-prod-github-runner-207 kernel: [17484.621057] RIP: 0033:0x7faa5d0edaff Aug 22 10:15:10 juju-e4d256-prod-github-runner-207 kernel: [17484.621835] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 10:15:10 juju-e4d256-prod-github-runner-207 kernel: [17484.623837] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 10:15:10 juju-e4d256-prod-github-runner-207 kernel: [17484.624747] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 10:15:10 juju-e4d256-prod-github-runner-207 kernel: [17484.625639] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 10:15:10 juju-e4d256-prod-github-runner-207 kernel: [17484.626532] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 10:15:10 juju-e4d256-prod-github-runner-207 kernel: [17484.627420] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 10:15:10 juju-e4d256-prod-github-runner-207 kernel: [17484.628313] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 10:15:10 juju-e4d256-prod-github-runner-207 kernel: [17484.629206] Aug 22 10:15:38 juju-e4d256-prod-github-runner-207 kernel: [17512.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 16201s! [qemu-system-x86:6715] Aug 22 10:15:38 juju-e4d256-prod-github-runner-207 kernel: [17512.543142] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 10:15:38 juju-e4d256-prod-github-runner-207 kernel: [17512.543209] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 10:15:38 juju-e4d256-prod-github-runner-207 kernel: [17512.555289] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 10:15:38 juju-e4d256-prod-github-runner-207 kernel: [17512.556556] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 10:15:38 juju-e4d256-prod-github-runner-207 kernel: [17512.557782] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:15:38 juju-e4d256-prod-github-runner-207 kernel: [17512.558869] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 10:15:38 juju-e4d256-prod-github-runner-207 kernel: [17512.561426] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 10:15:38 juju-e4d256-prod-github-runner-207 kernel: [17512.562490] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 10:15:38 juju-e4d256-prod-github-runner-207 kernel: [17512.563655] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 10:15:38 juju-e4d256-prod-github-runner-207 kernel: [17512.564825] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 10:15:38 juju-e4d256-prod-github-runner-207 kernel: [17512.566019] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 10:15:38 juju-e4d256-prod-github-runner-207 kernel: [17512.567221] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 10:15:38 juju-e4d256-prod-github-runner-207 kernel: [17512.568399] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 10:15:38 juju-e4d256-prod-github-runner-207 kernel: [17512.569639] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 10:15:38 juju-e4d256-prod-github-runner-207 kernel: [17512.570758] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 10:15:38 juju-e4d256-prod-github-runner-207 kernel: [17512.571952] Call Trace: Aug 22 10:15:38 juju-e4d256-prod-github-runner-207 kernel: [17512.572864] Aug 22 10:15:38 juju-e4d256-prod-github-runner-207 kernel: [17512.573753] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:15:38 juju-e4d256-prod-github-runner-207 kernel: [17512.574797] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:15:38 juju-e4d256-prod-github-runner-207 kernel: [17512.575824] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:15:38 juju-e4d256-prod-github-runner-207 kernel: [17512.576925] ? show_regs.part.0+0x23/0x29 Aug 22 10:15:38 juju-e4d256-prod-github-runner-207 kernel: [17512.577936] ? show_regs.cold+0x8/0xd Aug 22 10:15:38 juju-e4d256-prod-github-runner-207 kernel: [17512.578946] ? watchdog_timer_fn+0x1be/0x220 Aug 22 10:15:38 juju-e4d256-prod-github-runner-207 kernel: [17512.579955] ? lockup_detector_update_enable+0x60/0x60 Aug 22 10:15:38 juju-e4d256-prod-github-runner-207 kernel: [17512.581018] ? __hrtimer_run_queues+0x107/0x230 Aug 22 10:15:38 juju-e4d256-prod-github-runner-207 kernel: [17512.582056] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 10:15:38 juju-e4d256-prod-github-runner-207 kernel: [17512.583088] ? hrtimer_interrupt+0x101/0x220 Aug 22 10:15:38 juju-e4d256-prod-github-runner-207 kernel: [17512.584137] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 10:15:38 juju-e4d256-prod-github-runner-207 kernel: [17512.585221] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 10:15:38 juju-e4d256-prod-github-runner-207 kernel: [17512.586283] Aug 22 10:15:38 juju-e4d256-prod-github-runner-207 kernel: [17512.587141] Aug 22 10:15:38 juju-e4d256-prod-github-runner-207 kernel: [17512.587976] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 10:15:38 juju-e4d256-prod-github-runner-207 kernel: [17512.589006] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:15:38 juju-e4d256-prod-github-runner-207 kernel: [17512.590061] ? _raw_spin_lock+0x22/0x30 Aug 22 10:15:38 juju-e4d256-prod-github-runner-207 kernel: [17512.591008] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:15:38 juju-e4d256-prod-github-runner-207 kernel: [17512.592032] direct_page_fault+0x206/0x310 [kvm] Aug 22 10:15:38 juju-e4d256-prod-github-runner-207 kernel: [17512.593058] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 10:15:38 juju-e4d256-prod-github-runner-207 kernel: [17512.594077] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 10:15:38 juju-e4d256-prod-github-runner-207 kernel: [17512.595080] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 10:15:38 juju-e4d256-prod-github-runner-207 kernel: [17512.596057] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 10:15:38 juju-e4d256-prod-github-runner-207 kernel: [17512.597002] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 10:15:38 juju-e4d256-prod-github-runner-207 kernel: [17512.597991] handle_exit+0x98/0x230 [kvm_amd] Aug 22 10:15:38 juju-e4d256-prod-github-runner-207 kernel: [17512.598887] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 10:15:38 juju-e4d256-prod-github-runner-207 kernel: [17512.599799] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 10:15:38 juju-e4d256-prod-github-runner-207 kernel: [17512.600728] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 10:15:38 juju-e4d256-prod-github-runner-207 kernel: [17512.601633] vcpu_run+0x62/0x2c0 [kvm] Aug 22 10:15:38 juju-e4d256-prod-github-runner-207 kernel: [17512.602454] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 10:15:38 juju-e4d256-prod-github-runner-207 kernel: [17512.603263] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 10:15:38 juju-e4d256-prod-github-runner-207 kernel: [17512.604114] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 10:15:38 juju-e4d256-prod-github-runner-207 kernel: [17512.604908] ? __seccomp_filter+0x4a/0x4a0 Aug 22 10:15:38 juju-e4d256-prod-github-runner-207 kernel: [17512.605655] ? __fget_files+0x86/0xc0 Aug 22 10:15:38 juju-e4d256-prod-github-runner-207 kernel: [17512.606379] __x64_sys_ioctl+0x95/0xd0 Aug 22 10:15:38 juju-e4d256-prod-github-runner-207 kernel: [17512.607070] do_syscall_64+0x5c/0xc0 Aug 22 10:15:38 juju-e4d256-prod-github-runner-207 kernel: [17512.607732] ? do_futex+0x162/0x1f0 Aug 22 10:15:38 juju-e4d256-prod-github-runner-207 kernel: [17512.608379] ? __x64_sys_futex+0x78/0x1e0 Aug 22 10:15:38 juju-e4d256-prod-github-runner-207 kernel: [17512.609051] ? __secure_computing+0xa9/0x120 Aug 22 10:15:38 juju-e4d256-prod-github-runner-207 kernel: [17512.609738] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 10:15:38 juju-e4d256-prod-github-runner-207 kernel: [17512.610518] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:15:38 juju-e4d256-prod-github-runner-207 kernel: [17512.611238] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:15:38 juju-e4d256-prod-github-runner-207 kernel: [17512.611960] ? do_syscall_64+0x69/0xc0 Aug 22 10:15:38 juju-e4d256-prod-github-runner-207 kernel: [17512.612603] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:15:38 juju-e4d256-prod-github-runner-207 kernel: [17512.613308] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:15:38 juju-e4d256-prod-github-runner-207 kernel: [17512.614013] ? do_syscall_64+0x69/0xc0 Aug 22 10:15:38 juju-e4d256-prod-github-runner-207 kernel: [17512.614641] ? do_syscall_64+0x69/0xc0 Aug 22 10:15:38 juju-e4d256-prod-github-runner-207 kernel: [17512.615264] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 10:15:38 juju-e4d256-prod-github-runner-207 kernel: [17512.615966] RIP: 0033:0x7faa5d0edaff Aug 22 10:15:38 juju-e4d256-prod-github-runner-207 kernel: [17512.616593] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 10:15:38 juju-e4d256-prod-github-runner-207 kernel: [17512.618582] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 10:15:38 juju-e4d256-prod-github-runner-207 kernel: [17512.619489] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 10:15:38 juju-e4d256-prod-github-runner-207 kernel: [17512.620375] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 10:15:38 juju-e4d256-prod-github-runner-207 kernel: [17512.621261] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 10:15:38 juju-e4d256-prod-github-runner-207 kernel: [17512.622154] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 10:15:38 juju-e4d256-prod-github-runner-207 kernel: [17512.623042] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 10:15:38 juju-e4d256-prod-github-runner-207 kernel: [17512.623932] Aug 22 10:16:06 juju-e4d256-prod-github-runner-207 kernel: [17540.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 16227s! [qemu-system-x86:6715] Aug 22 10:16:06 juju-e4d256-prod-github-runner-207 kernel: [17540.543747] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 10:16:06 juju-e4d256-prod-github-runner-207 kernel: [17540.543995] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 10:16:06 juju-e4d256-prod-github-runner-207 kernel: [17540.556352] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 10:16:06 juju-e4d256-prod-github-runner-207 kernel: [17540.557670] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 10:16:06 juju-e4d256-prod-github-runner-207 kernel: [17540.558919] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:16:06 juju-e4d256-prod-github-runner-207 kernel: [17540.559992] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 10:16:06 juju-e4d256-prod-github-runner-207 kernel: [17540.562611] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 10:16:06 juju-e4d256-prod-github-runner-207 kernel: [17540.563675] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 10:16:06 juju-e4d256-prod-github-runner-207 kernel: [17540.564863] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 10:16:06 juju-e4d256-prod-github-runner-207 kernel: [17540.566070] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 10:16:06 juju-e4d256-prod-github-runner-207 kernel: [17540.567249] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 10:16:06 juju-e4d256-prod-github-runner-207 kernel: [17540.568421] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 10:16:06 juju-e4d256-prod-github-runner-207 kernel: [17540.569630] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 10:16:06 juju-e4d256-prod-github-runner-207 kernel: [17540.570896] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 10:16:06 juju-e4d256-prod-github-runner-207 kernel: [17540.572021] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 10:16:06 juju-e4d256-prod-github-runner-207 kernel: [17540.573233] Call Trace: Aug 22 10:16:06 juju-e4d256-prod-github-runner-207 kernel: [17540.574174] Aug 22 10:16:06 juju-e4d256-prod-github-runner-207 kernel: [17540.575076] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:16:06 juju-e4d256-prod-github-runner-207 kernel: [17540.576117] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:16:06 juju-e4d256-prod-github-runner-207 kernel: [17540.577152] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:16:06 juju-e4d256-prod-github-runner-207 kernel: [17540.578264] ? show_regs.part.0+0x23/0x29 Aug 22 10:16:06 juju-e4d256-prod-github-runner-207 kernel: [17540.579285] ? show_regs.cold+0x8/0xd Aug 22 10:16:06 juju-e4d256-prod-github-runner-207 kernel: [17540.580260] ? watchdog_timer_fn+0x1be/0x220 Aug 22 10:16:06 juju-e4d256-prod-github-runner-207 kernel: [17540.581279] ? lockup_detector_update_enable+0x60/0x60 Aug 22 10:16:06 juju-e4d256-prod-github-runner-207 kernel: [17540.582364] ? __hrtimer_run_queues+0x107/0x230 Aug 22 10:16:06 juju-e4d256-prod-github-runner-207 kernel: [17540.583403] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 10:16:06 juju-e4d256-prod-github-runner-207 kernel: [17540.584429] ? hrtimer_interrupt+0x101/0x220 Aug 22 10:16:06 juju-e4d256-prod-github-runner-207 kernel: [17540.585453] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 10:16:06 juju-e4d256-prod-github-runner-207 kernel: [17540.586546] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 10:16:06 juju-e4d256-prod-github-runner-207 kernel: [17540.587626] Aug 22 10:16:06 juju-e4d256-prod-github-runner-207 kernel: [17540.588486] Aug 22 10:16:06 juju-e4d256-prod-github-runner-207 kernel: [17540.589324] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 10:16:06 juju-e4d256-prod-github-runner-207 kernel: [17540.590401] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:16:06 juju-e4d256-prod-github-runner-207 kernel: [17540.591455] ? _raw_spin_lock+0x22/0x30 Aug 22 10:16:06 juju-e4d256-prod-github-runner-207 kernel: [17540.592402] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:16:06 juju-e4d256-prod-github-runner-207 kernel: [17540.593435] direct_page_fault+0x206/0x310 [kvm] Aug 22 10:16:06 juju-e4d256-prod-github-runner-207 kernel: [17540.594485] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 10:16:06 juju-e4d256-prod-github-runner-207 kernel: [17540.595512] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 10:16:06 juju-e4d256-prod-github-runner-207 kernel: [17540.596532] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 10:16:06 juju-e4d256-prod-github-runner-207 kernel: [17540.597532] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 10:16:06 juju-e4d256-prod-github-runner-207 kernel: [17540.598499] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 10:16:06 juju-e4d256-prod-github-runner-207 kernel: [17540.599492] handle_exit+0x98/0x230 [kvm_amd] Aug 22 10:16:06 juju-e4d256-prod-github-runner-207 kernel: [17540.600390] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 10:16:06 juju-e4d256-prod-github-runner-207 kernel: [17540.601316] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 10:16:06 juju-e4d256-prod-github-runner-207 kernel: [17540.602260] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 10:16:06 juju-e4d256-prod-github-runner-207 kernel: [17540.603180] vcpu_run+0x62/0x2c0 [kvm] Aug 22 10:16:06 juju-e4d256-prod-github-runner-207 kernel: [17540.604009] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 10:16:06 juju-e4d256-prod-github-runner-207 kernel: [17540.604825] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 10:16:06 juju-e4d256-prod-github-runner-207 kernel: [17540.605700] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 10:16:06 juju-e4d256-prod-github-runner-207 kernel: [17540.606501] ? __seccomp_filter+0x4a/0x4a0 Aug 22 10:16:06 juju-e4d256-prod-github-runner-207 kernel: [17540.607250] ? __fget_files+0x86/0xc0 Aug 22 10:16:06 juju-e4d256-prod-github-runner-207 kernel: [17540.607959] __x64_sys_ioctl+0x95/0xd0 Aug 22 10:16:06 juju-e4d256-prod-github-runner-207 kernel: [17540.608656] do_syscall_64+0x5c/0xc0 Aug 22 10:16:06 juju-e4d256-prod-github-runner-207 kernel: [17540.609327] ? do_futex+0x162/0x1f0 Aug 22 10:16:06 juju-e4d256-prod-github-runner-207 kernel: [17540.610002] ? __x64_sys_futex+0x78/0x1e0 Aug 22 10:16:06 juju-e4d256-prod-github-runner-207 kernel: [17540.610690] ? __secure_computing+0xa9/0x120 Aug 22 10:16:06 juju-e4d256-prod-github-runner-207 kernel: [17540.611394] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 10:16:06 juju-e4d256-prod-github-runner-207 kernel: [17540.612235] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:16:06 juju-e4d256-prod-github-runner-207 kernel: [17540.612968] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:16:06 juju-e4d256-prod-github-runner-207 kernel: [17540.613714] ? do_syscall_64+0x69/0xc0 Aug 22 10:16:06 juju-e4d256-prod-github-runner-207 kernel: [17540.614367] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:16:06 juju-e4d256-prod-github-runner-207 kernel: [17540.615080] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:16:06 juju-e4d256-prod-github-runner-207 kernel: [17540.615789] ? do_syscall_64+0x69/0xc0 Aug 22 10:16:06 juju-e4d256-prod-github-runner-207 kernel: [17540.616416] ? do_syscall_64+0x69/0xc0 Aug 22 10:16:06 juju-e4d256-prod-github-runner-207 kernel: [17540.617053] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 10:16:06 juju-e4d256-prod-github-runner-207 kernel: [17540.617792] RIP: 0033:0x7faa5d0edaff Aug 22 10:16:06 juju-e4d256-prod-github-runner-207 kernel: [17540.618456] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 10:16:06 juju-e4d256-prod-github-runner-207 kernel: [17540.620479] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 10:16:06 juju-e4d256-prod-github-runner-207 kernel: [17540.621403] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 10:16:06 juju-e4d256-prod-github-runner-207 kernel: [17540.622330] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 10:16:06 juju-e4d256-prod-github-runner-207 kernel: [17540.623225] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 10:16:06 juju-e4d256-prod-github-runner-207 kernel: [17540.624120] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 10:16:06 juju-e4d256-prod-github-runner-207 kernel: [17540.625017] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 10:16:06 juju-e4d256-prod-github-runner-207 kernel: [17540.625944] Aug 22 10:16:34 juju-e4d256-prod-github-runner-207 kernel: [17568.541980] watchdog: BUG: soft lockup - CPU#1 stuck for 16253s! [qemu-system-x86:6715] Aug 22 10:16:34 juju-e4d256-prod-github-runner-207 kernel: [17568.543088] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 10:16:34 juju-e4d256-prod-github-runner-207 kernel: [17568.543157] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 10:16:34 juju-e4d256-prod-github-runner-207 kernel: [17568.555381] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 10:16:34 juju-e4d256-prod-github-runner-207 kernel: [17568.556645] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 10:16:34 juju-e4d256-prod-github-runner-207 kernel: [17568.557897] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:16:34 juju-e4d256-prod-github-runner-207 kernel: [17568.558964] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 10:16:34 juju-e4d256-prod-github-runner-207 kernel: [17568.561517] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 10:16:34 juju-e4d256-prod-github-runner-207 kernel: [17568.562559] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 10:16:34 juju-e4d256-prod-github-runner-207 kernel: [17568.563721] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 10:16:34 juju-e4d256-prod-github-runner-207 kernel: [17568.564886] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 10:16:34 juju-e4d256-prod-github-runner-207 kernel: [17568.566086] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 10:16:34 juju-e4d256-prod-github-runner-207 kernel: [17568.567249] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 10:16:34 juju-e4d256-prod-github-runner-207 kernel: [17568.568419] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 10:16:34 juju-e4d256-prod-github-runner-207 kernel: [17568.569675] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 10:16:34 juju-e4d256-prod-github-runner-207 kernel: [17568.570771] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 10:16:34 juju-e4d256-prod-github-runner-207 kernel: [17568.571969] Call Trace: Aug 22 10:16:34 juju-e4d256-prod-github-runner-207 kernel: [17568.572879] Aug 22 10:16:34 juju-e4d256-prod-github-runner-207 kernel: [17568.573771] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:16:34 juju-e4d256-prod-github-runner-207 kernel: [17568.574811] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:16:34 juju-e4d256-prod-github-runner-207 kernel: [17568.575837] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:16:34 juju-e4d256-prod-github-runner-207 kernel: [17568.576906] ? show_regs.part.0+0x23/0x29 Aug 22 10:16:34 juju-e4d256-prod-github-runner-207 kernel: [17568.577921] ? show_regs.cold+0x8/0xd Aug 22 10:16:34 juju-e4d256-prod-github-runner-207 kernel: [17568.578888] ? watchdog_timer_fn+0x1be/0x220 Aug 22 10:16:34 juju-e4d256-prod-github-runner-207 kernel: [17568.579892] ? lockup_detector_update_enable+0x60/0x60 Aug 22 10:16:34 juju-e4d256-prod-github-runner-207 kernel: [17568.580950] ? __hrtimer_run_queues+0x107/0x230 Aug 22 10:16:34 juju-e4d256-prod-github-runner-207 kernel: [17568.581987] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 10:16:34 juju-e4d256-prod-github-runner-207 kernel: [17568.583008] ? hrtimer_interrupt+0x101/0x220 Aug 22 10:16:34 juju-e4d256-prod-github-runner-207 kernel: [17568.584019] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 10:16:34 juju-e4d256-prod-github-runner-207 kernel: [17568.585083] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 10:16:34 juju-e4d256-prod-github-runner-207 kernel: [17568.586134] Aug 22 10:16:34 juju-e4d256-prod-github-runner-207 kernel: [17568.586989] Aug 22 10:16:34 juju-e4d256-prod-github-runner-207 kernel: [17568.587824] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 10:16:34 juju-e4d256-prod-github-runner-207 kernel: [17568.588855] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:16:34 juju-e4d256-prod-github-runner-207 kernel: [17568.589946] ? _raw_spin_lock+0x22/0x30 Aug 22 10:16:34 juju-e4d256-prod-github-runner-207 kernel: [17568.590908] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:16:34 juju-e4d256-prod-github-runner-207 kernel: [17568.591932] direct_page_fault+0x206/0x310 [kvm] Aug 22 10:16:34 juju-e4d256-prod-github-runner-207 kernel: [17568.592956] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 10:16:34 juju-e4d256-prod-github-runner-207 kernel: [17568.593980] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 10:16:34 juju-e4d256-prod-github-runner-207 kernel: [17568.594977] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 10:16:34 juju-e4d256-prod-github-runner-207 kernel: [17568.595944] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 10:16:34 juju-e4d256-prod-github-runner-207 kernel: [17568.596888] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 10:16:34 juju-e4d256-prod-github-runner-207 kernel: [17568.597884] handle_exit+0x98/0x230 [kvm_amd] Aug 22 10:16:34 juju-e4d256-prod-github-runner-207 kernel: [17568.598774] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 10:16:34 juju-e4d256-prod-github-runner-207 kernel: [17568.599683] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 10:16:34 juju-e4d256-prod-github-runner-207 kernel: [17568.600607] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 10:16:34 juju-e4d256-prod-github-runner-207 kernel: [17568.601535] vcpu_run+0x62/0x2c0 [kvm] Aug 22 10:16:34 juju-e4d256-prod-github-runner-207 kernel: [17568.602355] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 10:16:34 juju-e4d256-prod-github-runner-207 kernel: [17568.603167] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 10:16:34 juju-e4d256-prod-github-runner-207 kernel: [17568.604019] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 10:16:34 juju-e4d256-prod-github-runner-207 kernel: [17568.604812] ? __seccomp_filter+0x4a/0x4a0 Aug 22 10:16:34 juju-e4d256-prod-github-runner-207 kernel: [17568.605569] ? __fget_files+0x86/0xc0 Aug 22 10:16:34 juju-e4d256-prod-github-runner-207 kernel: [17568.606276] __x64_sys_ioctl+0x95/0xd0 Aug 22 10:16:34 juju-e4d256-prod-github-runner-207 kernel: [17568.606965] do_syscall_64+0x5c/0xc0 Aug 22 10:16:34 juju-e4d256-prod-github-runner-207 kernel: [17568.607628] ? do_futex+0x162/0x1f0 Aug 22 10:16:34 juju-e4d256-prod-github-runner-207 kernel: [17568.608276] ? __x64_sys_futex+0x78/0x1e0 Aug 22 10:16:34 juju-e4d256-prod-github-runner-207 kernel: [17568.608946] ? __secure_computing+0xa9/0x120 Aug 22 10:16:34 juju-e4d256-prod-github-runner-207 kernel: [17568.609652] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 10:16:34 juju-e4d256-prod-github-runner-207 kernel: [17568.610410] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:16:34 juju-e4d256-prod-github-runner-207 kernel: [17568.611129] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:16:34 juju-e4d256-prod-github-runner-207 kernel: [17568.611844] ? do_syscall_64+0x69/0xc0 Aug 22 10:16:34 juju-e4d256-prod-github-runner-207 kernel: [17568.612493] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:16:34 juju-e4d256-prod-github-runner-207 kernel: [17568.613197] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:16:34 juju-e4d256-prod-github-runner-207 kernel: [17568.613903] ? do_syscall_64+0x69/0xc0 Aug 22 10:16:34 juju-e4d256-prod-github-runner-207 kernel: [17568.614526] ? do_syscall_64+0x69/0xc0 Aug 22 10:16:34 juju-e4d256-prod-github-runner-207 kernel: [17568.615173] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 10:16:34 juju-e4d256-prod-github-runner-207 kernel: [17568.615896] RIP: 0033:0x7faa5d0edaff Aug 22 10:16:34 juju-e4d256-prod-github-runner-207 kernel: [17568.616523] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 10:16:34 juju-e4d256-prod-github-runner-207 kernel: [17568.618525] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 10:16:34 juju-e4d256-prod-github-runner-207 kernel: [17568.619440] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 10:16:34 juju-e4d256-prod-github-runner-207 kernel: [17568.620328] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 10:16:34 juju-e4d256-prod-github-runner-207 kernel: [17568.621221] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 10:16:34 juju-e4d256-prod-github-runner-207 kernel: [17568.622121] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 10:16:34 juju-e4d256-prod-github-runner-207 kernel: [17568.623013] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 10:16:34 juju-e4d256-prod-github-runner-207 kernel: [17568.623905] Aug 22 10:17:02 juju-e4d256-prod-github-runner-207 kernel: [17596.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 16280s! [qemu-system-x86:6715] Aug 22 10:17:02 juju-e4d256-prod-github-runner-207 kernel: [17596.543094] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 10:17:02 juju-e4d256-prod-github-runner-207 kernel: [17596.543164] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 10:17:02 juju-e4d256-prod-github-runner-207 kernel: [17596.555272] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 10:17:02 juju-e4d256-prod-github-runner-207 kernel: [17596.556542] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 10:17:02 juju-e4d256-prod-github-runner-207 kernel: [17596.557780] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:17:02 juju-e4d256-prod-github-runner-207 kernel: [17596.558837] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 10:17:02 juju-e4d256-prod-github-runner-207 kernel: [17596.561393] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 10:17:02 juju-e4d256-prod-github-runner-207 kernel: [17596.562434] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 10:17:02 juju-e4d256-prod-github-runner-207 kernel: [17596.563594] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 10:17:02 juju-e4d256-prod-github-runner-207 kernel: [17596.564751] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 10:17:02 juju-e4d256-prod-github-runner-207 kernel: [17596.565926] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 10:17:02 juju-e4d256-prod-github-runner-207 kernel: [17596.567085] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 10:17:02 juju-e4d256-prod-github-runner-207 kernel: [17596.568327] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 10:17:02 juju-e4d256-prod-github-runner-207 kernel: [17596.569676] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 10:17:02 juju-e4d256-prod-github-runner-207 kernel: [17596.570783] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 10:17:02 juju-e4d256-prod-github-runner-207 kernel: [17596.572038] Call Trace: Aug 22 10:17:02 juju-e4d256-prod-github-runner-207 kernel: [17596.573014] Aug 22 10:17:02 juju-e4d256-prod-github-runner-207 kernel: [17596.573906] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:17:02 juju-e4d256-prod-github-runner-207 kernel: [17596.574933] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:17:02 juju-e4d256-prod-github-runner-207 kernel: [17596.575966] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:17:02 juju-e4d256-prod-github-runner-207 kernel: [17596.577069] ? show_regs.part.0+0x23/0x29 Aug 22 10:17:02 juju-e4d256-prod-github-runner-207 kernel: [17596.578064] ? show_regs.cold+0x8/0xd Aug 22 10:17:02 juju-e4d256-prod-github-runner-207 kernel: [17596.579032] ? watchdog_timer_fn+0x1be/0x220 Aug 22 10:17:02 juju-e4d256-prod-github-runner-207 kernel: [17596.580042] ? lockup_detector_update_enable+0x60/0x60 Aug 22 10:17:02 juju-e4d256-prod-github-runner-207 kernel: [17596.581123] ? __hrtimer_run_queues+0x107/0x230 Aug 22 10:17:02 juju-e4d256-prod-github-runner-207 kernel: [17596.582171] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 10:17:02 juju-e4d256-prod-github-runner-207 kernel: [17596.583202] ? hrtimer_interrupt+0x101/0x220 Aug 22 10:17:02 juju-e4d256-prod-github-runner-207 kernel: [17596.584227] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 10:17:02 juju-e4d256-prod-github-runner-207 kernel: [17596.585314] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 10:17:02 juju-e4d256-prod-github-runner-207 kernel: [17596.586357] Aug 22 10:17:02 juju-e4d256-prod-github-runner-207 kernel: [17596.587207] Aug 22 10:17:02 juju-e4d256-prod-github-runner-207 kernel: [17596.588041] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 10:17:02 juju-e4d256-prod-github-runner-207 kernel: [17596.589088] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:17:02 juju-e4d256-prod-github-runner-207 kernel: [17596.590162] ? _raw_spin_lock+0x22/0x30 Aug 22 10:17:02 juju-e4d256-prod-github-runner-207 kernel: [17596.591110] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:17:02 juju-e4d256-prod-github-runner-207 kernel: [17596.592125] direct_page_fault+0x206/0x310 [kvm] Aug 22 10:17:02 juju-e4d256-prod-github-runner-207 kernel: [17596.593158] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 10:17:02 juju-e4d256-prod-github-runner-207 kernel: [17596.594182] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 10:17:02 juju-e4d256-prod-github-runner-207 kernel: [17596.595179] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 10:17:02 juju-e4d256-prod-github-runner-207 kernel: [17596.596152] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 10:17:02 juju-e4d256-prod-github-runner-207 kernel: [17596.597109] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 10:17:02 juju-e4d256-prod-github-runner-207 kernel: [17596.598085] handle_exit+0x98/0x230 [kvm_amd] Aug 22 10:17:02 juju-e4d256-prod-github-runner-207 kernel: [17596.598976] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 10:17:02 juju-e4d256-prod-github-runner-207 kernel: [17596.599887] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 10:17:02 juju-e4d256-prod-github-runner-207 kernel: [17596.600808] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 10:17:02 juju-e4d256-prod-github-runner-207 kernel: [17596.601720] vcpu_run+0x62/0x2c0 [kvm] Aug 22 10:17:02 juju-e4d256-prod-github-runner-207 kernel: [17596.602533] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 10:17:02 juju-e4d256-prod-github-runner-207 kernel: [17596.603336] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 10:17:02 juju-e4d256-prod-github-runner-207 kernel: [17596.604187] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 10:17:02 juju-e4d256-prod-github-runner-207 kernel: [17596.604993] ? __seccomp_filter+0x4a/0x4a0 Aug 22 10:17:02 juju-e4d256-prod-github-runner-207 kernel: [17596.605735] ? __fget_files+0x86/0xc0 Aug 22 10:17:02 juju-e4d256-prod-github-runner-207 kernel: [17596.606441] __x64_sys_ioctl+0x95/0xd0 Aug 22 10:17:02 juju-e4d256-prod-github-runner-207 kernel: [17596.607132] do_syscall_64+0x5c/0xc0 Aug 22 10:17:02 juju-e4d256-prod-github-runner-207 kernel: [17596.607793] ? do_futex+0x162/0x1f0 Aug 22 10:17:02 juju-e4d256-prod-github-runner-207 kernel: [17596.608448] ? __x64_sys_futex+0x78/0x1e0 Aug 22 10:17:02 juju-e4d256-prod-github-runner-207 kernel: [17596.609145] ? __secure_computing+0xa9/0x120 Aug 22 10:17:02 juju-e4d256-prod-github-runner-207 kernel: [17596.609838] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 10:17:02 juju-e4d256-prod-github-runner-207 kernel: [17596.610593] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:17:02 juju-e4d256-prod-github-runner-207 kernel: [17596.611312] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:17:02 juju-e4d256-prod-github-runner-207 kernel: [17596.612027] ? do_syscall_64+0x69/0xc0 Aug 22 10:17:02 juju-e4d256-prod-github-runner-207 kernel: [17596.612674] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:17:02 juju-e4d256-prod-github-runner-207 kernel: [17596.613384] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:17:02 juju-e4d256-prod-github-runner-207 kernel: [17596.614084] ? do_syscall_64+0x69/0xc0 Aug 22 10:17:02 juju-e4d256-prod-github-runner-207 kernel: [17596.614705] ? do_syscall_64+0x69/0xc0 Aug 22 10:17:02 juju-e4d256-prod-github-runner-207 kernel: [17596.615327] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 10:17:02 juju-e4d256-prod-github-runner-207 kernel: [17596.616026] RIP: 0033:0x7faa5d0edaff Aug 22 10:17:02 juju-e4d256-prod-github-runner-207 kernel: [17596.616646] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 10:17:02 juju-e4d256-prod-github-runner-207 kernel: [17596.618630] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 10:17:02 juju-e4d256-prod-github-runner-207 kernel: [17596.619533] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 10:17:02 juju-e4d256-prod-github-runner-207 kernel: [17596.620412] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 10:17:02 juju-e4d256-prod-github-runner-207 kernel: [17596.621306] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 10:17:02 juju-e4d256-prod-github-runner-207 kernel: [17596.622189] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 10:17:02 juju-e4d256-prod-github-runner-207 kernel: [17596.623070] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 10:17:02 juju-e4d256-prod-github-runner-207 kernel: [17596.623954] Aug 22 10:17:30 juju-e4d256-prod-github-runner-207 kernel: [17624.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 16306s! [qemu-system-x86:6715] Aug 22 10:17:30 juju-e4d256-prod-github-runner-207 kernel: [17624.543787] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 10:17:30 juju-e4d256-prod-github-runner-207 kernel: [17624.544048] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 10:17:30 juju-e4d256-prod-github-runner-207 kernel: [17624.556268] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 10:17:30 juju-e4d256-prod-github-runner-207 kernel: [17624.557551] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 10:17:30 juju-e4d256-prod-github-runner-207 kernel: [17624.558779] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:17:30 juju-e4d256-prod-github-runner-207 kernel: [17624.559835] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 10:17:30 juju-e4d256-prod-github-runner-207 kernel: [17624.562387] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 10:17:30 juju-e4d256-prod-github-runner-207 kernel: [17624.563433] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 10:17:30 juju-e4d256-prod-github-runner-207 kernel: [17624.564607] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 10:17:30 juju-e4d256-prod-github-runner-207 kernel: [17624.565765] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 10:17:30 juju-e4d256-prod-github-runner-207 kernel: [17624.566923] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 10:17:30 juju-e4d256-prod-github-runner-207 kernel: [17624.568092] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 10:17:30 juju-e4d256-prod-github-runner-207 kernel: [17624.569266] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 10:17:30 juju-e4d256-prod-github-runner-207 kernel: [17624.570498] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 10:17:30 juju-e4d256-prod-github-runner-207 kernel: [17624.571593] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 10:17:30 juju-e4d256-prod-github-runner-207 kernel: [17624.572793] Call Trace: Aug 22 10:17:30 juju-e4d256-prod-github-runner-207 kernel: [17624.573705] Aug 22 10:17:30 juju-e4d256-prod-github-runner-207 kernel: [17624.574598] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:17:30 juju-e4d256-prod-github-runner-207 kernel: [17624.575626] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:17:30 juju-e4d256-prod-github-runner-207 kernel: [17624.576652] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:17:30 juju-e4d256-prod-github-runner-207 kernel: [17624.577745] ? show_regs.part.0+0x23/0x29 Aug 22 10:17:30 juju-e4d256-prod-github-runner-207 kernel: [17624.578744] ? show_regs.cold+0x8/0xd Aug 22 10:17:30 juju-e4d256-prod-github-runner-207 kernel: [17624.579719] ? watchdog_timer_fn+0x1be/0x220 Aug 22 10:17:30 juju-e4d256-prod-github-runner-207 kernel: [17624.580737] ? lockup_detector_update_enable+0x60/0x60 Aug 22 10:17:30 juju-e4d256-prod-github-runner-207 kernel: [17624.581804] ? __hrtimer_run_queues+0x107/0x230 Aug 22 10:17:30 juju-e4d256-prod-github-runner-207 kernel: [17624.582833] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 10:17:30 juju-e4d256-prod-github-runner-207 kernel: [17624.583865] ? hrtimer_interrupt+0x101/0x220 Aug 22 10:17:30 juju-e4d256-prod-github-runner-207 kernel: [17624.584898] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 10:17:30 juju-e4d256-prod-github-runner-207 kernel: [17624.585968] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 10:17:30 juju-e4d256-prod-github-runner-207 kernel: [17624.587015] Aug 22 10:17:30 juju-e4d256-prod-github-runner-207 kernel: [17624.587868] Aug 22 10:17:30 juju-e4d256-prod-github-runner-207 kernel: [17624.588732] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 10:17:30 juju-e4d256-prod-github-runner-207 kernel: [17624.589768] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:17:30 juju-e4d256-prod-github-runner-207 kernel: [17624.590806] ? _raw_spin_lock+0x22/0x30 Aug 22 10:17:30 juju-e4d256-prod-github-runner-207 kernel: [17624.591750] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:17:30 juju-e4d256-prod-github-runner-207 kernel: [17624.592784] direct_page_fault+0x206/0x310 [kvm] Aug 22 10:17:30 juju-e4d256-prod-github-runner-207 kernel: [17624.593820] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 10:17:30 juju-e4d256-prod-github-runner-207 kernel: [17624.594831] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 10:17:30 juju-e4d256-prod-github-runner-207 kernel: [17624.595833] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 10:17:30 juju-e4d256-prod-github-runner-207 kernel: [17624.596836] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 10:17:30 juju-e4d256-prod-github-runner-207 kernel: [17624.597783] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 10:17:30 juju-e4d256-prod-github-runner-207 kernel: [17624.598767] handle_exit+0x98/0x230 [kvm_amd] Aug 22 10:17:30 juju-e4d256-prod-github-runner-207 kernel: [17624.599660] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 10:17:30 juju-e4d256-prod-github-runner-207 kernel: [17624.600585] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 10:17:30 juju-e4d256-prod-github-runner-207 kernel: [17624.601511] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 10:17:30 juju-e4d256-prod-github-runner-207 kernel: [17624.602414] vcpu_run+0x62/0x2c0 [kvm] Aug 22 10:17:30 juju-e4d256-prod-github-runner-207 kernel: [17624.603224] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 10:17:30 juju-e4d256-prod-github-runner-207 kernel: [17624.604035] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 10:17:30 juju-e4d256-prod-github-runner-207 kernel: [17624.604896] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 10:17:30 juju-e4d256-prod-github-runner-207 kernel: [17624.605694] ? __seccomp_filter+0x4a/0x4a0 Aug 22 10:17:30 juju-e4d256-prod-github-runner-207 kernel: [17624.606436] ? __fget_files+0x86/0xc0 Aug 22 10:17:30 juju-e4d256-prod-github-runner-207 kernel: [17624.607138] __x64_sys_ioctl+0x95/0xd0 Aug 22 10:17:30 juju-e4d256-prod-github-runner-207 kernel: [17624.607829] do_syscall_64+0x5c/0xc0 Aug 22 10:17:30 juju-e4d256-prod-github-runner-207 kernel: [17624.608492] ? do_futex+0x162/0x1f0 Aug 22 10:17:30 juju-e4d256-prod-github-runner-207 kernel: [17624.609156] ? __x64_sys_futex+0x78/0x1e0 Aug 22 10:17:30 juju-e4d256-prod-github-runner-207 kernel: [17624.609830] ? __secure_computing+0xa9/0x120 Aug 22 10:17:30 juju-e4d256-prod-github-runner-207 kernel: [17624.610523] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 10:17:30 juju-e4d256-prod-github-runner-207 kernel: [17624.611282] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:17:30 juju-e4d256-prod-github-runner-207 kernel: [17624.612003] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:17:30 juju-e4d256-prod-github-runner-207 kernel: [17624.612729] ? do_syscall_64+0x69/0xc0 Aug 22 10:17:30 juju-e4d256-prod-github-runner-207 kernel: [17624.613375] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:17:30 juju-e4d256-prod-github-runner-207 kernel: [17624.614081] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:17:30 juju-e4d256-prod-github-runner-207 kernel: [17624.614780] ? do_syscall_64+0x69/0xc0 Aug 22 10:17:30 juju-e4d256-prod-github-runner-207 kernel: [17624.615407] ? do_syscall_64+0x69/0xc0 Aug 22 10:17:30 juju-e4d256-prod-github-runner-207 kernel: [17624.616029] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 10:17:30 juju-e4d256-prod-github-runner-207 kernel: [17624.616742] RIP: 0033:0x7faa5d0edaff Aug 22 10:17:30 juju-e4d256-prod-github-runner-207 kernel: [17624.617386] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 10:17:30 juju-e4d256-prod-github-runner-207 kernel: [17624.619378] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 10:17:30 juju-e4d256-prod-github-runner-207 kernel: [17624.620295] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 10:17:30 juju-e4d256-prod-github-runner-207 kernel: [17624.621192] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 10:17:30 juju-e4d256-prod-github-runner-207 kernel: [17624.622086] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 10:17:30 juju-e4d256-prod-github-runner-207 kernel: [17624.622972] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 10:17:30 juju-e4d256-prod-github-runner-207 kernel: [17624.623861] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 10:17:30 juju-e4d256-prod-github-runner-207 kernel: [17624.624784] Aug 22 10:17:44 juju-e4d256-prod-github-runner-207 kernel: [17638.364706] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 10:17:44 juju-e4d256-prod-github-runner-207 kernel: [17638.366331] rcu: 1-....: (4366619 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=2111938 Aug 22 10:17:44 juju-e4d256-prod-github-runner-207 kernel: [17638.367460] (t=4380291 jiffies g=23269 q=24330) Aug 22 10:17:44 juju-e4d256-prod-github-runner-207 kernel: [17638.368241] NMI backtrace for cpu 1 Aug 22 10:17:44 juju-e4d256-prod-github-runner-207 kernel: [17638.368965] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 10:17:44 juju-e4d256-prod-github-runner-207 kernel: [17638.370067] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 10:17:44 juju-e4d256-prod-github-runner-207 kernel: [17638.371125] Call Trace: Aug 22 10:17:44 juju-e4d256-prod-github-runner-207 kernel: [17638.371798] Aug 22 10:17:44 juju-e4d256-prod-github-runner-207 kernel: [17638.372464] show_stack+0x52/0x5c Aug 22 10:17:44 juju-e4d256-prod-github-runner-207 kernel: [17638.373187] dump_stack_lvl+0x4a/0x63 Aug 22 10:17:44 juju-e4d256-prod-github-runner-207 kernel: [17638.373937] dump_stack+0x10/0x16 Aug 22 10:17:44 juju-e4d256-prod-github-runner-207 kernel: [17638.374654] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 10:17:44 juju-e4d256-prod-github-runner-207 kernel: [17638.375437] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 10:17:44 juju-e4d256-prod-github-runner-207 kernel: [17638.376214] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 10:17:44 juju-e4d256-prod-github-runner-207 kernel: [17638.377053] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 10:17:44 juju-e4d256-prod-github-runner-207 kernel: [17638.377896] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 10:17:44 juju-e4d256-prod-github-runner-207 kernel: [17638.378711] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 10:17:44 juju-e4d256-prod-github-runner-207 kernel: [17638.379505] print_cpu_stall.cold+0x2f/0xe2 Aug 22 10:17:44 juju-e4d256-prod-github-runner-207 kernel: [17638.380282] ? timekeeping_update+0xf7/0x150 Aug 22 10:17:44 juju-e4d256-prod-github-runner-207 kernel: [17638.381072] check_cpu_stall+0x109/0x270 Aug 22 10:17:44 juju-e4d256-prod-github-runner-207 kernel: [17638.381817] rcu_sched_clock_irq+0x9a/0x250 Aug 22 10:17:44 juju-e4d256-prod-github-runner-207 kernel: [17638.382575] update_process_times+0x94/0xd0 Aug 22 10:17:44 juju-e4d256-prod-github-runner-207 kernel: [17638.383332] tick_sched_handle+0x29/0x70 Aug 22 10:17:44 juju-e4d256-prod-github-runner-207 kernel: [17638.384078] tick_sched_timer+0x8c/0xc0 Aug 22 10:17:44 juju-e4d256-prod-github-runner-207 kernel: [17638.384835] ? tick_nohz_handler+0xb0/0xb0 Aug 22 10:17:44 juju-e4d256-prod-github-runner-207 kernel: [17638.385589] __hrtimer_run_queues+0x107/0x230 Aug 22 10:17:44 juju-e4d256-prod-github-runner-207 kernel: [17638.386524] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 10:17:44 juju-e4d256-prod-github-runner-207 kernel: [17638.387296] hrtimer_interrupt+0x101/0x220 Aug 22 10:17:44 juju-e4d256-prod-github-runner-207 kernel: [17638.388053] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 10:17:44 juju-e4d256-prod-github-runner-207 kernel: [17638.388886] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 10:17:44 juju-e4d256-prod-github-runner-207 kernel: [17638.389688] Aug 22 10:17:44 juju-e4d256-prod-github-runner-207 kernel: [17638.390321] Aug 22 10:17:44 juju-e4d256-prod-github-runner-207 kernel: [17638.390948] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 10:17:44 juju-e4d256-prod-github-runner-207 kernel: [17638.391764] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:17:44 juju-e4d256-prod-github-runner-207 kernel: [17638.392666] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 10:17:44 juju-e4d256-prod-github-runner-207 kernel: [17638.394882] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 10:17:44 juju-e4d256-prod-github-runner-207 kernel: [17638.395754] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 10:17:44 juju-e4d256-prod-github-runner-207 kernel: [17638.396759] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 10:17:44 juju-e4d256-prod-github-runner-207 kernel: [17638.397733] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 10:17:44 juju-e4d256-prod-github-runner-207 kernel: [17638.398743] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 10:17:44 juju-e4d256-prod-github-runner-207 kernel: [17638.399697] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 10:17:44 juju-e4d256-prod-github-runner-207 kernel: [17638.400673] ? _raw_spin_lock+0x22/0x30 Aug 22 10:17:44 juju-e4d256-prod-github-runner-207 kernel: [17638.401445] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:17:44 juju-e4d256-prod-github-runner-207 kernel: [17638.402305] direct_page_fault+0x206/0x310 [kvm] Aug 22 10:17:44 juju-e4d256-prod-github-runner-207 kernel: [17638.403156] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 10:17:44 juju-e4d256-prod-github-runner-207 kernel: [17638.403988] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 10:17:44 juju-e4d256-prod-github-runner-207 kernel: [17638.404847] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 10:17:44 juju-e4d256-prod-github-runner-207 kernel: [17638.405678] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 10:17:44 juju-e4d256-prod-github-runner-207 kernel: [17638.406463] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 10:17:44 juju-e4d256-prod-github-runner-207 kernel: [17638.407280] handle_exit+0x98/0x230 [kvm_amd] Aug 22 10:17:44 juju-e4d256-prod-github-runner-207 kernel: [17638.408031] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 10:17:44 juju-e4d256-prod-github-runner-207 kernel: [17638.408821] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 10:17:44 juju-e4d256-prod-github-runner-207 kernel: [17638.409616] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 10:17:44 juju-e4d256-prod-github-runner-207 kernel: [17638.410397] vcpu_run+0x62/0x2c0 [kvm] Aug 22 10:17:44 juju-e4d256-prod-github-runner-207 kernel: [17638.411108] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 10:17:44 juju-e4d256-prod-github-runner-207 kernel: [17638.411837] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 10:17:44 juju-e4d256-prod-github-runner-207 kernel: [17638.412647] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 10:17:44 juju-e4d256-prod-github-runner-207 kernel: [17638.413406] ? __seccomp_filter+0x4a/0x4a0 Aug 22 10:17:44 juju-e4d256-prod-github-runner-207 kernel: [17638.414135] ? __fget_files+0x86/0xc0 Aug 22 10:17:44 juju-e4d256-prod-github-runner-207 kernel: [17638.414826] __x64_sys_ioctl+0x95/0xd0 Aug 22 10:17:44 juju-e4d256-prod-github-runner-207 kernel: [17638.415517] do_syscall_64+0x5c/0xc0 Aug 22 10:17:44 juju-e4d256-prod-github-runner-207 kernel: [17638.416197] ? do_futex+0x162/0x1f0 Aug 22 10:17:44 juju-e4d256-prod-github-runner-207 kernel: [17638.416882] ? __x64_sys_futex+0x78/0x1e0 Aug 22 10:17:44 juju-e4d256-prod-github-runner-207 kernel: [17638.417581] ? __secure_computing+0xa9/0x120 Aug 22 10:17:44 juju-e4d256-prod-github-runner-207 kernel: [17638.418321] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 10:17:44 juju-e4d256-prod-github-runner-207 kernel: [17638.419120] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:17:44 juju-e4d256-prod-github-runner-207 kernel: [17638.419871] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:17:44 juju-e4d256-prod-github-runner-207 kernel: [17638.420644] ? do_syscall_64+0x69/0xc0 Aug 22 10:17:44 juju-e4d256-prod-github-runner-207 kernel: [17638.421336] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:17:44 juju-e4d256-prod-github-runner-207 kernel: [17638.422089] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:17:44 juju-e4d256-prod-github-runner-207 kernel: [17638.422845] ? do_syscall_64+0x69/0xc0 Aug 22 10:17:44 juju-e4d256-prod-github-runner-207 kernel: [17638.423539] ? do_syscall_64+0x69/0xc0 Aug 22 10:17:44 juju-e4d256-prod-github-runner-207 kernel: [17638.424231] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 10:17:44 juju-e4d256-prod-github-runner-207 kernel: [17638.425025] RIP: 0033:0x7faa5d0edaff Aug 22 10:17:44 juju-e4d256-prod-github-runner-207 kernel: [17638.425766] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 10:17:44 juju-e4d256-prod-github-runner-207 kernel: [17638.427872] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 10:17:44 juju-e4d256-prod-github-runner-207 kernel: [17638.428854] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 10:17:44 juju-e4d256-prod-github-runner-207 kernel: [17638.429836] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 10:17:44 juju-e4d256-prod-github-runner-207 kernel: [17638.430784] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 10:17:44 juju-e4d256-prod-github-runner-207 kernel: [17638.431719] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 10:17:44 juju-e4d256-prod-github-runner-207 kernel: [17638.432658] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 10:17:44 juju-e4d256-prod-github-runner-207 kernel: [17638.433571] Aug 22 10:18:10 juju-e4d256-prod-github-runner-207 kernel: [17664.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 16343s! [qemu-system-x86:6715] Aug 22 10:18:10 juju-e4d256-prod-github-runner-207 kernel: [17664.543765] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 10:18:10 juju-e4d256-prod-github-runner-207 kernel: [17664.544029] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 10:18:10 juju-e4d256-prod-github-runner-207 kernel: [17664.556148] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 10:18:10 juju-e4d256-prod-github-runner-207 kernel: [17664.557410] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 10:18:10 juju-e4d256-prod-github-runner-207 kernel: [17664.558639] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:18:10 juju-e4d256-prod-github-runner-207 kernel: [17664.559700] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 10:18:10 juju-e4d256-prod-github-runner-207 kernel: [17664.562253] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 10:18:10 juju-e4d256-prod-github-runner-207 kernel: [17664.563300] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 10:18:10 juju-e4d256-prod-github-runner-207 kernel: [17664.564514] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 10:18:10 juju-e4d256-prod-github-runner-207 kernel: [17664.565677] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 10:18:10 juju-e4d256-prod-github-runner-207 kernel: [17664.566834] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 10:18:10 juju-e4d256-prod-github-runner-207 kernel: [17664.567998] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 10:18:10 juju-e4d256-prod-github-runner-207 kernel: [17664.569194] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 10:18:10 juju-e4d256-prod-github-runner-207 kernel: [17664.570438] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 10:18:10 juju-e4d256-prod-github-runner-207 kernel: [17664.571533] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 10:18:10 juju-e4d256-prod-github-runner-207 kernel: [17664.572730] Call Trace: Aug 22 10:18:10 juju-e4d256-prod-github-runner-207 kernel: [17664.573641] Aug 22 10:18:10 juju-e4d256-prod-github-runner-207 kernel: [17664.574533] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:18:10 juju-e4d256-prod-github-runner-207 kernel: [17664.575560] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:18:10 juju-e4d256-prod-github-runner-207 kernel: [17664.576586] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:18:10 juju-e4d256-prod-github-runner-207 kernel: [17664.577680] ? show_regs.part.0+0x23/0x29 Aug 22 10:18:10 juju-e4d256-prod-github-runner-207 kernel: [17664.578675] ? show_regs.cold+0x8/0xd Aug 22 10:18:10 juju-e4d256-prod-github-runner-207 kernel: [17664.579665] ? watchdog_timer_fn+0x1be/0x220 Aug 22 10:18:10 juju-e4d256-prod-github-runner-207 kernel: [17664.580855] ? lockup_detector_update_enable+0x60/0x60 Aug 22 10:18:10 juju-e4d256-prod-github-runner-207 kernel: [17664.581918] ? __hrtimer_run_queues+0x107/0x230 Aug 22 10:18:10 juju-e4d256-prod-github-runner-207 kernel: [17664.582945] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 10:18:10 juju-e4d256-prod-github-runner-207 kernel: [17664.583973] ? hrtimer_interrupt+0x101/0x220 Aug 22 10:18:10 juju-e4d256-prod-github-runner-207 kernel: [17664.584998] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 10:18:10 juju-e4d256-prod-github-runner-207 kernel: [17664.586070] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 10:18:10 juju-e4d256-prod-github-runner-207 kernel: [17664.587120] Aug 22 10:18:10 juju-e4d256-prod-github-runner-207 kernel: [17664.587970] Aug 22 10:18:10 juju-e4d256-prod-github-runner-207 kernel: [17664.588811] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 10:18:10 juju-e4d256-prod-github-runner-207 kernel: [17664.589857] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:18:10 juju-e4d256-prod-github-runner-207 kernel: [17664.590895] ? _raw_spin_lock+0x22/0x30 Aug 22 10:18:10 juju-e4d256-prod-github-runner-207 kernel: [17664.591948] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:18:10 juju-e4d256-prod-github-runner-207 kernel: [17664.592974] direct_page_fault+0x206/0x310 [kvm] Aug 22 10:18:10 juju-e4d256-prod-github-runner-207 kernel: [17664.593997] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 10:18:10 juju-e4d256-prod-github-runner-207 kernel: [17664.595003] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 10:18:10 juju-e4d256-prod-github-runner-207 kernel: [17664.596006] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 10:18:10 juju-e4d256-prod-github-runner-207 kernel: [17664.596999] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 10:18:10 juju-e4d256-prod-github-runner-207 kernel: [17664.597943] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 10:18:10 juju-e4d256-prod-github-runner-207 kernel: [17664.598918] handle_exit+0x98/0x230 [kvm_amd] Aug 22 10:18:10 juju-e4d256-prod-github-runner-207 kernel: [17664.599815] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 10:18:10 juju-e4d256-prod-github-runner-207 kernel: [17664.600738] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 10:18:10 juju-e4d256-prod-github-runner-207 kernel: [17664.601660] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 10:18:10 juju-e4d256-prod-github-runner-207 kernel: [17664.602560] vcpu_run+0x62/0x2c0 [kvm] Aug 22 10:18:10 juju-e4d256-prod-github-runner-207 kernel: [17664.603372] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 10:18:10 juju-e4d256-prod-github-runner-207 kernel: [17664.604185] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 10:18:10 juju-e4d256-prod-github-runner-207 kernel: [17664.605043] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 10:18:10 juju-e4d256-prod-github-runner-207 kernel: [17664.605842] ? __seccomp_filter+0x4a/0x4a0 Aug 22 10:18:10 juju-e4d256-prod-github-runner-207 kernel: [17664.606582] ? __fget_files+0x86/0xc0 Aug 22 10:18:10 juju-e4d256-prod-github-runner-207 kernel: [17664.607283] __x64_sys_ioctl+0x95/0xd0 Aug 22 10:18:10 juju-e4d256-prod-github-runner-207 kernel: [17664.607972] do_syscall_64+0x5c/0xc0 Aug 22 10:18:10 juju-e4d256-prod-github-runner-207 kernel: [17664.608649] ? do_futex+0x162/0x1f0 Aug 22 10:18:10 juju-e4d256-prod-github-runner-207 kernel: [17664.609296] ? __x64_sys_futex+0x78/0x1e0 Aug 22 10:18:10 juju-e4d256-prod-github-runner-207 kernel: [17664.609974] ? __secure_computing+0xa9/0x120 Aug 22 10:18:10 juju-e4d256-prod-github-runner-207 kernel: [17664.610662] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 10:18:10 juju-e4d256-prod-github-runner-207 kernel: [17664.611418] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:18:10 juju-e4d256-prod-github-runner-207 kernel: [17664.612153] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:18:10 juju-e4d256-prod-github-runner-207 kernel: [17664.612868] ? do_syscall_64+0x69/0xc0 Aug 22 10:18:10 juju-e4d256-prod-github-runner-207 kernel: [17664.613512] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:18:10 juju-e4d256-prod-github-runner-207 kernel: [17664.614212] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:18:10 juju-e4d256-prod-github-runner-207 kernel: [17664.614905] ? do_syscall_64+0x69/0xc0 Aug 22 10:18:10 juju-e4d256-prod-github-runner-207 kernel: [17664.615532] ? do_syscall_64+0x69/0xc0 Aug 22 10:18:10 juju-e4d256-prod-github-runner-207 kernel: [17664.616166] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 10:18:10 juju-e4d256-prod-github-runner-207 kernel: [17664.616869] RIP: 0033:0x7faa5d0edaff Aug 22 10:18:10 juju-e4d256-prod-github-runner-207 kernel: [17664.617510] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 10:18:10 juju-e4d256-prod-github-runner-207 kernel: [17664.619493] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 10:18:10 juju-e4d256-prod-github-runner-207 kernel: [17664.620418] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 10:18:10 juju-e4d256-prod-github-runner-207 kernel: [17664.621316] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 10:18:10 juju-e4d256-prod-github-runner-207 kernel: [17664.622201] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 10:18:10 juju-e4d256-prod-github-runner-207 kernel: [17664.623090] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 10:18:10 juju-e4d256-prod-github-runner-207 kernel: [17664.623978] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 10:18:10 juju-e4d256-prod-github-runner-207 kernel: [17664.624880] Aug 22 10:18:38 juju-e4d256-prod-github-runner-207 kernel: [17692.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 16369s! [qemu-system-x86:6715] Aug 22 10:18:38 juju-e4d256-prod-github-runner-207 kernel: [17692.543729] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 10:18:38 juju-e4d256-prod-github-runner-207 kernel: [17692.544003] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 10:18:38 juju-e4d256-prod-github-runner-207 kernel: [17692.556069] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 10:18:38 juju-e4d256-prod-github-runner-207 kernel: [17692.557331] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 10:18:38 juju-e4d256-prod-github-runner-207 kernel: [17692.558554] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:18:38 juju-e4d256-prod-github-runner-207 kernel: [17692.559615] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 10:18:38 juju-e4d256-prod-github-runner-207 kernel: [17692.562165] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 10:18:38 juju-e4d256-prod-github-runner-207 kernel: [17692.563205] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 10:18:38 juju-e4d256-prod-github-runner-207 kernel: [17692.564378] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 10:18:38 juju-e4d256-prod-github-runner-207 kernel: [17692.565539] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 10:18:38 juju-e4d256-prod-github-runner-207 kernel: [17692.566697] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 10:18:38 juju-e4d256-prod-github-runner-207 kernel: [17692.567907] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 10:18:38 juju-e4d256-prod-github-runner-207 kernel: [17692.569122] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 10:18:38 juju-e4d256-prod-github-runner-207 kernel: [17692.570526] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 10:18:38 juju-e4d256-prod-github-runner-207 kernel: [17692.571635] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 10:18:38 juju-e4d256-prod-github-runner-207 kernel: [17692.572835] Call Trace: Aug 22 10:18:38 juju-e4d256-prod-github-runner-207 kernel: [17692.573746] Aug 22 10:18:38 juju-e4d256-prod-github-runner-207 kernel: [17692.574639] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:18:38 juju-e4d256-prod-github-runner-207 kernel: [17692.575669] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:18:38 juju-e4d256-prod-github-runner-207 kernel: [17692.576692] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:18:38 juju-e4d256-prod-github-runner-207 kernel: [17692.577777] ? show_regs.part.0+0x23/0x29 Aug 22 10:18:38 juju-e4d256-prod-github-runner-207 kernel: [17692.578800] ? show_regs.cold+0x8/0xd Aug 22 10:18:38 juju-e4d256-prod-github-runner-207 kernel: [17692.579777] ? watchdog_timer_fn+0x1be/0x220 Aug 22 10:18:38 juju-e4d256-prod-github-runner-207 kernel: [17692.580783] ? lockup_detector_update_enable+0x60/0x60 Aug 22 10:18:38 juju-e4d256-prod-github-runner-207 kernel: [17692.581848] ? __hrtimer_run_queues+0x107/0x230 Aug 22 10:18:38 juju-e4d256-prod-github-runner-207 kernel: [17692.582879] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 10:18:38 juju-e4d256-prod-github-runner-207 kernel: [17692.583905] ? hrtimer_interrupt+0x101/0x220 Aug 22 10:18:38 juju-e4d256-prod-github-runner-207 kernel: [17692.584926] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 10:18:38 juju-e4d256-prod-github-runner-207 kernel: [17692.585994] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 10:18:38 juju-e4d256-prod-github-runner-207 kernel: [17692.587043] Aug 22 10:18:38 juju-e4d256-prod-github-runner-207 kernel: [17692.587906] Aug 22 10:18:38 juju-e4d256-prod-github-runner-207 kernel: [17692.588801] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 10:18:38 juju-e4d256-prod-github-runner-207 kernel: [17692.589854] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:18:38 juju-e4d256-prod-github-runner-207 kernel: [17692.590896] ? _raw_spin_lock+0x22/0x30 Aug 22 10:18:38 juju-e4d256-prod-github-runner-207 kernel: [17692.591855] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:18:38 juju-e4d256-prod-github-runner-207 kernel: [17692.592871] direct_page_fault+0x206/0x310 [kvm] Aug 22 10:18:38 juju-e4d256-prod-github-runner-207 kernel: [17692.593904] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 10:18:38 juju-e4d256-prod-github-runner-207 kernel: [17692.594915] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 10:18:38 juju-e4d256-prod-github-runner-207 kernel: [17692.595929] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 10:18:38 juju-e4d256-prod-github-runner-207 kernel: [17692.596917] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 10:18:38 juju-e4d256-prod-github-runner-207 kernel: [17692.597865] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 10:18:38 juju-e4d256-prod-github-runner-207 kernel: [17692.598848] handle_exit+0x98/0x230 [kvm_amd] Aug 22 10:18:38 juju-e4d256-prod-github-runner-207 kernel: [17692.599742] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 10:18:38 juju-e4d256-prod-github-runner-207 kernel: [17692.600676] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 10:18:38 juju-e4d256-prod-github-runner-207 kernel: [17692.601646] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 10:18:38 juju-e4d256-prod-github-runner-207 kernel: [17692.602551] vcpu_run+0x62/0x2c0 [kvm] Aug 22 10:18:38 juju-e4d256-prod-github-runner-207 kernel: [17692.603359] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 10:18:38 juju-e4d256-prod-github-runner-207 kernel: [17692.604176] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 10:18:38 juju-e4d256-prod-github-runner-207 kernel: [17692.605033] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 10:18:38 juju-e4d256-prod-github-runner-207 kernel: [17692.605827] ? __seccomp_filter+0x4a/0x4a0 Aug 22 10:18:38 juju-e4d256-prod-github-runner-207 kernel: [17692.606572] ? __fget_files+0x86/0xc0 Aug 22 10:18:38 juju-e4d256-prod-github-runner-207 kernel: [17692.607272] __x64_sys_ioctl+0x95/0xd0 Aug 22 10:18:38 juju-e4d256-prod-github-runner-207 kernel: [17692.607965] do_syscall_64+0x5c/0xc0 Aug 22 10:18:38 juju-e4d256-prod-github-runner-207 kernel: [17692.608632] ? do_futex+0x162/0x1f0 Aug 22 10:18:38 juju-e4d256-prod-github-runner-207 kernel: [17692.609279] ? __x64_sys_futex+0x78/0x1e0 Aug 22 10:18:38 juju-e4d256-prod-github-runner-207 kernel: [17692.609954] ? __secure_computing+0xa9/0x120 Aug 22 10:18:38 juju-e4d256-prod-github-runner-207 kernel: [17692.610676] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 10:18:38 juju-e4d256-prod-github-runner-207 kernel: [17692.611438] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:18:38 juju-e4d256-prod-github-runner-207 kernel: [17692.612168] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:18:38 juju-e4d256-prod-github-runner-207 kernel: [17692.612883] ? do_syscall_64+0x69/0xc0 Aug 22 10:18:38 juju-e4d256-prod-github-runner-207 kernel: [17692.613531] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:18:38 juju-e4d256-prod-github-runner-207 kernel: [17692.614235] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:18:38 juju-e4d256-prod-github-runner-207 kernel: [17692.614929] ? do_syscall_64+0x69/0xc0 Aug 22 10:18:38 juju-e4d256-prod-github-runner-207 kernel: [17692.615557] ? do_syscall_64+0x69/0xc0 Aug 22 10:18:38 juju-e4d256-prod-github-runner-207 kernel: [17692.616184] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 10:18:38 juju-e4d256-prod-github-runner-207 kernel: [17692.616892] RIP: 0033:0x7faa5d0edaff Aug 22 10:18:38 juju-e4d256-prod-github-runner-207 kernel: [17692.617539] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 10:18:38 juju-e4d256-prod-github-runner-207 kernel: [17692.619527] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 10:18:38 juju-e4d256-prod-github-runner-207 kernel: [17692.620450] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 10:18:38 juju-e4d256-prod-github-runner-207 kernel: [17692.621337] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 10:18:38 juju-e4d256-prod-github-runner-207 kernel: [17692.622232] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 10:18:38 juju-e4d256-prod-github-runner-207 kernel: [17692.623145] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 10:18:38 juju-e4d256-prod-github-runner-207 kernel: [17692.624036] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 10:18:38 juju-e4d256-prod-github-runner-207 kernel: [17692.624931] Aug 22 10:19:06 juju-e4d256-prod-github-runner-207 kernel: [17720.541980] watchdog: BUG: soft lockup - CPU#1 stuck for 16395s! [qemu-system-x86:6715] Aug 22 10:19:06 juju-e4d256-prod-github-runner-207 kernel: [17720.543824] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 10:19:06 juju-e4d256-prod-github-runner-207 kernel: [17720.544078] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 10:19:06 juju-e4d256-prod-github-runner-207 kernel: [17720.556287] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 10:19:06 juju-e4d256-prod-github-runner-207 kernel: [17720.557563] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 10:19:06 juju-e4d256-prod-github-runner-207 kernel: [17720.558782] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:19:06 juju-e4d256-prod-github-runner-207 kernel: [17720.559852] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 10:19:06 juju-e4d256-prod-github-runner-207 kernel: [17720.562405] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 10:19:06 juju-e4d256-prod-github-runner-207 kernel: [17720.563457] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 10:19:06 juju-e4d256-prod-github-runner-207 kernel: [17720.564617] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 10:19:06 juju-e4d256-prod-github-runner-207 kernel: [17720.565783] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 10:19:06 juju-e4d256-prod-github-runner-207 kernel: [17720.566947] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 10:19:06 juju-e4d256-prod-github-runner-207 kernel: [17720.568119] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 10:19:06 juju-e4d256-prod-github-runner-207 kernel: [17720.569288] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 10:19:06 juju-e4d256-prod-github-runner-207 kernel: [17720.570538] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 10:19:06 juju-e4d256-prod-github-runner-207 kernel: [17720.571658] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 10:19:06 juju-e4d256-prod-github-runner-207 kernel: [17720.572854] Call Trace: Aug 22 10:19:06 juju-e4d256-prod-github-runner-207 kernel: [17720.573766] Aug 22 10:19:06 juju-e4d256-prod-github-runner-207 kernel: [17720.574661] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:19:06 juju-e4d256-prod-github-runner-207 kernel: [17720.575713] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:19:06 juju-e4d256-prod-github-runner-207 kernel: [17720.576733] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:19:06 juju-e4d256-prod-github-runner-207 kernel: [17720.577817] ? show_regs.part.0+0x23/0x29 Aug 22 10:19:06 juju-e4d256-prod-github-runner-207 kernel: [17720.578812] ? show_regs.cold+0x8/0xd Aug 22 10:19:06 juju-e4d256-prod-github-runner-207 kernel: [17720.579800] ? watchdog_timer_fn+0x1be/0x220 Aug 22 10:19:06 juju-e4d256-prod-github-runner-207 kernel: [17720.580809] ? lockup_detector_update_enable+0x60/0x60 Aug 22 10:19:06 juju-e4d256-prod-github-runner-207 kernel: [17720.581869] ? __hrtimer_run_queues+0x107/0x230 Aug 22 10:19:06 juju-e4d256-prod-github-runner-207 kernel: [17720.582899] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 10:19:06 juju-e4d256-prod-github-runner-207 kernel: [17720.583927] ? hrtimer_interrupt+0x101/0x220 Aug 22 10:19:06 juju-e4d256-prod-github-runner-207 kernel: [17720.584940] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 10:19:06 juju-e4d256-prod-github-runner-207 kernel: [17720.586006] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 10:19:06 juju-e4d256-prod-github-runner-207 kernel: [17720.587049] Aug 22 10:19:06 juju-e4d256-prod-github-runner-207 kernel: [17720.587906] Aug 22 10:19:06 juju-e4d256-prod-github-runner-207 kernel: [17720.588747] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 10:19:06 juju-e4d256-prod-github-runner-207 kernel: [17720.589783] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:19:06 juju-e4d256-prod-github-runner-207 kernel: [17720.590822] ? _raw_spin_lock+0x22/0x30 Aug 22 10:19:06 juju-e4d256-prod-github-runner-207 kernel: [17720.591772] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:19:06 juju-e4d256-prod-github-runner-207 kernel: [17720.592785] direct_page_fault+0x206/0x310 [kvm] Aug 22 10:19:06 juju-e4d256-prod-github-runner-207 kernel: [17720.593806] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 10:19:06 juju-e4d256-prod-github-runner-207 kernel: [17720.594816] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 10:19:06 juju-e4d256-prod-github-runner-207 kernel: [17720.595820] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 10:19:06 juju-e4d256-prod-github-runner-207 kernel: [17720.596810] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 10:19:06 juju-e4d256-prod-github-runner-207 kernel: [17720.597752] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 10:19:06 juju-e4d256-prod-github-runner-207 kernel: [17720.598727] handle_exit+0x98/0x230 [kvm_amd] Aug 22 10:19:06 juju-e4d256-prod-github-runner-207 kernel: [17720.599623] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 10:19:06 juju-e4d256-prod-github-runner-207 kernel: [17720.600534] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 10:19:06 juju-e4d256-prod-github-runner-207 kernel: [17720.601455] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 10:19:06 juju-e4d256-prod-github-runner-207 kernel: [17720.602356] vcpu_run+0x62/0x2c0 [kvm] Aug 22 10:19:06 juju-e4d256-prod-github-runner-207 kernel: [17720.603164] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 10:19:06 juju-e4d256-prod-github-runner-207 kernel: [17720.603981] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 10:19:06 juju-e4d256-prod-github-runner-207 kernel: [17720.604831] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 10:19:06 juju-e4d256-prod-github-runner-207 kernel: [17720.605624] ? __seccomp_filter+0x4a/0x4a0 Aug 22 10:19:06 juju-e4d256-prod-github-runner-207 kernel: [17720.606362] ? __fget_files+0x86/0xc0 Aug 22 10:19:06 juju-e4d256-prod-github-runner-207 kernel: [17720.607063] __x64_sys_ioctl+0x95/0xd0 Aug 22 10:19:06 juju-e4d256-prod-github-runner-207 kernel: [17720.607761] do_syscall_64+0x5c/0xc0 Aug 22 10:19:06 juju-e4d256-prod-github-runner-207 kernel: [17720.608424] ? do_futex+0x162/0x1f0 Aug 22 10:19:06 juju-e4d256-prod-github-runner-207 kernel: [17720.609076] ? __x64_sys_futex+0x78/0x1e0 Aug 22 10:19:06 juju-e4d256-prod-github-runner-207 kernel: [17720.609746] ? __secure_computing+0xa9/0x120 Aug 22 10:19:06 juju-e4d256-prod-github-runner-207 kernel: [17720.610433] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 10:19:06 juju-e4d256-prod-github-runner-207 kernel: [17720.611194] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:19:06 juju-e4d256-prod-github-runner-207 kernel: [17720.611928] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:19:06 juju-e4d256-prod-github-runner-207 kernel: [17720.612641] ? do_syscall_64+0x69/0xc0 Aug 22 10:19:06 juju-e4d256-prod-github-runner-207 kernel: [17720.613283] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:19:06 juju-e4d256-prod-github-runner-207 kernel: [17720.613988] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:19:06 juju-e4d256-prod-github-runner-207 kernel: [17720.614684] ? do_syscall_64+0x69/0xc0 Aug 22 10:19:06 juju-e4d256-prod-github-runner-207 kernel: [17720.615307] ? do_syscall_64+0x69/0xc0 Aug 22 10:19:06 juju-e4d256-prod-github-runner-207 kernel: [17720.615933] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 10:19:06 juju-e4d256-prod-github-runner-207 kernel: [17720.616640] RIP: 0033:0x7faa5d0edaff Aug 22 10:19:06 juju-e4d256-prod-github-runner-207 kernel: [17720.617279] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 10:19:06 juju-e4d256-prod-github-runner-207 kernel: [17720.619261] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 10:19:06 juju-e4d256-prod-github-runner-207 kernel: [17720.620181] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 10:19:06 juju-e4d256-prod-github-runner-207 kernel: [17720.621067] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 10:19:06 juju-e4d256-prod-github-runner-207 kernel: [17720.621953] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 10:19:06 juju-e4d256-prod-github-runner-207 kernel: [17720.622841] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 10:19:06 juju-e4d256-prod-github-runner-207 kernel: [17720.623749] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 10:19:06 juju-e4d256-prod-github-runner-207 kernel: [17720.624647] Aug 22 10:19:34 juju-e4d256-prod-github-runner-207 kernel: [17748.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 16421s! [qemu-system-x86:6715] Aug 22 10:19:34 juju-e4d256-prod-github-runner-207 kernel: [17748.543753] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 10:19:34 juju-e4d256-prod-github-runner-207 kernel: [17748.544017] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 10:19:34 juju-e4d256-prod-github-runner-207 kernel: [17748.556571] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 10:19:34 juju-e4d256-prod-github-runner-207 kernel: [17748.558022] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 10:19:34 juju-e4d256-prod-github-runner-207 kernel: [17748.559438] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:19:34 juju-e4d256-prod-github-runner-207 kernel: [17748.560620] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 10:19:34 juju-e4d256-prod-github-runner-207 kernel: [17748.563549] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 10:19:34 juju-e4d256-prod-github-runner-207 kernel: [17748.564697] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 10:19:34 juju-e4d256-prod-github-runner-207 kernel: [17748.566003] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 10:19:34 juju-e4d256-prod-github-runner-207 kernel: [17748.567336] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 10:19:34 juju-e4d256-prod-github-runner-207 kernel: [17748.568633] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 10:19:34 juju-e4d256-prod-github-runner-207 kernel: [17748.569936] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 10:19:34 juju-e4d256-prod-github-runner-207 kernel: [17748.571263] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 10:19:34 juju-e4d256-prod-github-runner-207 kernel: [17748.572659] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 10:19:34 juju-e4d256-prod-github-runner-207 kernel: [17748.573878] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 10:19:34 juju-e4d256-prod-github-runner-207 kernel: [17748.575235] Call Trace: Aug 22 10:19:34 juju-e4d256-prod-github-runner-207 kernel: [17748.576201] Aug 22 10:19:34 juju-e4d256-prod-github-runner-207 kernel: [17748.577155] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:19:34 juju-e4d256-prod-github-runner-207 kernel: [17748.578277] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:19:34 juju-e4d256-prod-github-runner-207 kernel: [17748.579409] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:19:34 juju-e4d256-prod-github-runner-207 kernel: [17748.580595] ? show_regs.part.0+0x23/0x29 Aug 22 10:19:34 juju-e4d256-prod-github-runner-207 kernel: [17748.581676] ? show_regs.cold+0x8/0xd Aug 22 10:19:34 juju-e4d256-prod-github-runner-207 kernel: [17748.582731] ? watchdog_timer_fn+0x1be/0x220 Aug 22 10:19:34 juju-e4d256-prod-github-runner-207 kernel: [17748.583855] ? lockup_detector_update_enable+0x60/0x60 Aug 22 10:19:34 juju-e4d256-prod-github-runner-207 kernel: [17748.585028] ? __hrtimer_run_queues+0x107/0x230 Aug 22 10:19:34 juju-e4d256-prod-github-runner-207 kernel: [17748.586151] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 10:19:34 juju-e4d256-prod-github-runner-207 kernel: [17748.587310] ? hrtimer_interrupt+0x101/0x220 Aug 22 10:19:34 juju-e4d256-prod-github-runner-207 kernel: [17748.588417] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 10:19:34 juju-e4d256-prod-github-runner-207 kernel: [17748.589591] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 10:19:34 juju-e4d256-prod-github-runner-207 kernel: [17748.590735] Aug 22 10:19:34 juju-e4d256-prod-github-runner-207 kernel: [17748.591654] Aug 22 10:19:34 juju-e4d256-prod-github-runner-207 kernel: [17748.592539] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 10:19:34 juju-e4d256-prod-github-runner-207 kernel: [17748.593682] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:19:34 juju-e4d256-prod-github-runner-207 kernel: [17748.594847] ? _raw_spin_lock+0x22/0x30 Aug 22 10:19:34 juju-e4d256-prod-github-runner-207 kernel: [17748.595907] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:19:34 juju-e4d256-prod-github-runner-207 kernel: [17748.597010] direct_page_fault+0x206/0x310 [kvm] Aug 22 10:19:34 juju-e4d256-prod-github-runner-207 kernel: [17748.598151] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 10:19:34 juju-e4d256-prod-github-runner-207 kernel: [17748.599272] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 10:19:34 juju-e4d256-prod-github-runner-207 kernel: [17748.600369] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 10:19:34 juju-e4d256-prod-github-runner-207 kernel: [17748.601479] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 10:19:34 juju-e4d256-prod-github-runner-207 kernel: [17748.602527] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 10:19:34 juju-e4d256-prod-github-runner-207 kernel: [17748.603638] handle_exit+0x98/0x230 [kvm_amd] Aug 22 10:19:34 juju-e4d256-prod-github-runner-207 kernel: [17748.604624] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 10:19:34 juju-e4d256-prod-github-runner-207 kernel: [17748.605635] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 10:19:34 juju-e4d256-prod-github-runner-207 kernel: [17748.606664] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 10:19:34 juju-e4d256-prod-github-runner-207 kernel: [17748.607695] vcpu_run+0x62/0x2c0 [kvm] Aug 22 10:19:34 juju-e4d256-prod-github-runner-207 kernel: [17748.608592] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 10:19:34 juju-e4d256-prod-github-runner-207 kernel: [17748.609490] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 10:19:34 juju-e4d256-prod-github-runner-207 kernel: [17748.610448] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 10:19:34 juju-e4d256-prod-github-runner-207 kernel: [17748.611362] ? __seccomp_filter+0x4a/0x4a0 Aug 22 10:19:34 juju-e4d256-prod-github-runner-207 kernel: [17748.612198] ? __fget_files+0x86/0xc0 Aug 22 10:19:34 juju-e4d256-prod-github-runner-207 kernel: [17748.612978] __x64_sys_ioctl+0x95/0xd0 Aug 22 10:19:34 juju-e4d256-prod-github-runner-207 kernel: [17748.613753] do_syscall_64+0x5c/0xc0 Aug 22 10:19:34 juju-e4d256-prod-github-runner-207 kernel: [17748.614513] ? do_futex+0x162/0x1f0 Aug 22 10:19:34 juju-e4d256-prod-github-runner-207 kernel: [17748.615264] ? __x64_sys_futex+0x78/0x1e0 Aug 22 10:19:34 juju-e4d256-prod-github-runner-207 kernel: [17748.616018] ? __secure_computing+0xa9/0x120 Aug 22 10:19:34 juju-e4d256-prod-github-runner-207 kernel: [17748.616797] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 10:19:34 juju-e4d256-prod-github-runner-207 kernel: [17748.617672] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:19:34 juju-e4d256-prod-github-runner-207 kernel: [17748.618500] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:19:34 juju-e4d256-prod-github-runner-207 kernel: [17748.619347] ? do_syscall_64+0x69/0xc0 Aug 22 10:19:34 juju-e4d256-prod-github-runner-207 kernel: [17748.620077] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:19:34 juju-e4d256-prod-github-runner-207 kernel: [17748.620883] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:19:34 juju-e4d256-prod-github-runner-207 kernel: [17748.621683] ? do_syscall_64+0x69/0xc0 Aug 22 10:19:34 juju-e4d256-prod-github-runner-207 kernel: [17748.622398] ? do_syscall_64+0x69/0xc0 Aug 22 10:19:34 juju-e4d256-prod-github-runner-207 kernel: [17748.623135] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 10:19:34 juju-e4d256-prod-github-runner-207 kernel: [17748.623963] RIP: 0033:0x7faa5d0edaff Aug 22 10:19:34 juju-e4d256-prod-github-runner-207 kernel: [17748.624900] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 10:19:34 juju-e4d256-prod-github-runner-207 kernel: [17748.627297] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 10:19:34 juju-e4d256-prod-github-runner-207 kernel: [17748.628370] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 10:19:34 juju-e4d256-prod-github-runner-207 kernel: [17748.629411] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 10:19:34 juju-e4d256-prod-github-runner-207 kernel: [17748.630443] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 10:19:34 juju-e4d256-prod-github-runner-207 kernel: [17748.631492] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 10:19:34 juju-e4d256-prod-github-runner-207 kernel: [17748.632529] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 10:19:34 juju-e4d256-prod-github-runner-207 kernel: [17748.633571] Aug 22 10:20:02 juju-e4d256-prod-github-runner-207 kernel: [17776.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 16447s! [qemu-system-x86:6715] Aug 22 10:20:02 juju-e4d256-prod-github-runner-207 kernel: [17776.543731] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 10:20:02 juju-e4d256-prod-github-runner-207 kernel: [17776.543918] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 10:20:02 juju-e4d256-prod-github-runner-207 kernel: [17776.556067] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 10:20:02 juju-e4d256-prod-github-runner-207 kernel: [17776.557355] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 10:20:02 juju-e4d256-prod-github-runner-207 kernel: [17776.558578] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:20:02 juju-e4d256-prod-github-runner-207 kernel: [17776.559654] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 10:20:02 juju-e4d256-prod-github-runner-207 kernel: [17776.562222] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 10:20:02 juju-e4d256-prod-github-runner-207 kernel: [17776.563286] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 10:20:02 juju-e4d256-prod-github-runner-207 kernel: [17776.564458] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 10:20:02 juju-e4d256-prod-github-runner-207 kernel: [17776.565709] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 10:20:02 juju-e4d256-prod-github-runner-207 kernel: [17776.566965] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 10:20:02 juju-e4d256-prod-github-runner-207 kernel: [17776.568239] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 10:20:02 juju-e4d256-prod-github-runner-207 kernel: [17776.569498] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 10:20:02 juju-e4d256-prod-github-runner-207 kernel: [17776.570795] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 10:20:02 juju-e4d256-prod-github-runner-207 kernel: [17776.571953] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 10:20:02 juju-e4d256-prod-github-runner-207 kernel: [17776.573233] Call Trace: Aug 22 10:20:02 juju-e4d256-prod-github-runner-207 kernel: [17776.574203] Aug 22 10:20:02 juju-e4d256-prod-github-runner-207 kernel: [17776.575162] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:20:02 juju-e4d256-prod-github-runner-207 kernel: [17776.576275] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:20:02 juju-e4d256-prod-github-runner-207 kernel: [17776.577360] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:20:02 juju-e4d256-prod-github-runner-207 kernel: [17776.578514] ? show_regs.part.0+0x23/0x29 Aug 22 10:20:02 juju-e4d256-prod-github-runner-207 kernel: [17776.579600] ? show_regs.cold+0x8/0xd Aug 22 10:20:02 juju-e4d256-prod-github-runner-207 kernel: [17776.580640] ? watchdog_timer_fn+0x1be/0x220 Aug 22 10:20:02 juju-e4d256-prod-github-runner-207 kernel: [17776.581744] ? lockup_detector_update_enable+0x60/0x60 Aug 22 10:20:02 juju-e4d256-prod-github-runner-207 kernel: [17776.582916] ? __hrtimer_run_queues+0x107/0x230 Aug 22 10:20:02 juju-e4d256-prod-github-runner-207 kernel: [17776.584027] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 10:20:02 juju-e4d256-prod-github-runner-207 kernel: [17776.585140] ? hrtimer_interrupt+0x101/0x220 Aug 22 10:20:02 juju-e4d256-prod-github-runner-207 kernel: [17776.586222] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 10:20:02 juju-e4d256-prod-github-runner-207 kernel: [17776.587375] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 10:20:02 juju-e4d256-prod-github-runner-207 kernel: [17776.588528] Aug 22 10:20:02 juju-e4d256-prod-github-runner-207 kernel: [17776.589455] Aug 22 10:20:02 juju-e4d256-prod-github-runner-207 kernel: [17776.590343] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 10:20:02 juju-e4d256-prod-github-runner-207 kernel: [17776.591497] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:20:02 juju-e4d256-prod-github-runner-207 kernel: [17776.592645] ? _raw_spin_lock+0x22/0x30 Aug 22 10:20:02 juju-e4d256-prod-github-runner-207 kernel: [17776.593688] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:20:02 juju-e4d256-prod-github-runner-207 kernel: [17776.594797] direct_page_fault+0x206/0x310 [kvm] Aug 22 10:20:02 juju-e4d256-prod-github-runner-207 kernel: [17776.595852] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 10:20:02 juju-e4d256-prod-github-runner-207 kernel: [17776.596921] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 10:20:02 juju-e4d256-prod-github-runner-207 kernel: [17776.597994] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 10:20:02 juju-e4d256-prod-github-runner-207 kernel: [17776.599081] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 10:20:02 juju-e4d256-prod-github-runner-207 kernel: [17776.600079] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 10:20:02 juju-e4d256-prod-github-runner-207 kernel: [17776.601115] handle_exit+0x98/0x230 [kvm_amd] Aug 22 10:20:02 juju-e4d256-prod-github-runner-207 kernel: [17776.602085] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 10:20:02 juju-e4d256-prod-github-runner-207 kernel: [17776.603077] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 10:20:02 juju-e4d256-prod-github-runner-207 kernel: [17776.604072] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 10:20:02 juju-e4d256-prod-github-runner-207 kernel: [17776.605075] vcpu_run+0x62/0x2c0 [kvm] Aug 22 10:20:02 juju-e4d256-prod-github-runner-207 kernel: [17776.605977] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 10:20:02 juju-e4d256-prod-github-runner-207 kernel: [17776.606848] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 10:20:02 juju-e4d256-prod-github-runner-207 kernel: [17776.607749] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 10:20:02 juju-e4d256-prod-github-runner-207 kernel: [17776.608606] ? __seccomp_filter+0x4a/0x4a0 Aug 22 10:20:02 juju-e4d256-prod-github-runner-207 kernel: [17776.609404] ? __fget_files+0x86/0xc0 Aug 22 10:20:02 juju-e4d256-prod-github-runner-207 kernel: [17776.610156] __x64_sys_ioctl+0x95/0xd0 Aug 22 10:20:02 juju-e4d256-prod-github-runner-207 kernel: [17776.610908] do_syscall_64+0x5c/0xc0 Aug 22 10:20:02 juju-e4d256-prod-github-runner-207 kernel: [17776.611619] ? do_futex+0x162/0x1f0 Aug 22 10:20:02 juju-e4d256-prod-github-runner-207 kernel: [17776.612322] ? __x64_sys_futex+0x78/0x1e0 Aug 22 10:20:02 juju-e4d256-prod-github-runner-207 kernel: [17776.613039] ? __secure_computing+0xa9/0x120 Aug 22 10:20:02 juju-e4d256-prod-github-runner-207 kernel: [17776.613768] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 10:20:02 juju-e4d256-prod-github-runner-207 kernel: [17776.614585] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:20:02 juju-e4d256-prod-github-runner-207 kernel: [17776.615360] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:20:02 juju-e4d256-prod-github-runner-207 kernel: [17776.616107] ? do_syscall_64+0x69/0xc0 Aug 22 10:20:02 juju-e4d256-prod-github-runner-207 kernel: [17776.616804] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:20:02 juju-e4d256-prod-github-runner-207 kernel: [17776.617573] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:20:02 juju-e4d256-prod-github-runner-207 kernel: [17776.618337] ? do_syscall_64+0x69/0xc0 Aug 22 10:20:02 juju-e4d256-prod-github-runner-207 kernel: [17776.619022] ? do_syscall_64+0x69/0xc0 Aug 22 10:20:02 juju-e4d256-prod-github-runner-207 kernel: [17776.619684] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 10:20:02 juju-e4d256-prod-github-runner-207 kernel: [17776.620437] RIP: 0033:0x7faa5d0edaff Aug 22 10:20:02 juju-e4d256-prod-github-runner-207 kernel: [17776.621143] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 10:20:02 juju-e4d256-prod-github-runner-207 kernel: [17776.625873] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 10:20:02 juju-e4d256-prod-github-runner-207 kernel: [17776.626914] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 10:20:02 juju-e4d256-prod-github-runner-207 kernel: [17776.627866] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 10:20:02 juju-e4d256-prod-github-runner-207 kernel: [17776.628822] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 10:20:02 juju-e4d256-prod-github-runner-207 kernel: [17776.629760] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 10:20:02 juju-e4d256-prod-github-runner-207 kernel: [17776.630707] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 10:20:02 juju-e4d256-prod-github-runner-207 kernel: [17776.631655] Aug 22 10:20:30 juju-e4d256-prod-github-runner-207 kernel: [17804.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 16473s! [qemu-system-x86:6715] Aug 22 10:20:30 juju-e4d256-prod-github-runner-207 kernel: [17804.543755] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 10:20:30 juju-e4d256-prod-github-runner-207 kernel: [17804.544017] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 10:20:30 juju-e4d256-prod-github-runner-207 kernel: [17804.556387] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 10:20:30 juju-e4d256-prod-github-runner-207 kernel: [17804.557657] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 10:20:30 juju-e4d256-prod-github-runner-207 kernel: [17804.558918] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:20:30 juju-e4d256-prod-github-runner-207 kernel: [17804.559974] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 10:20:30 juju-e4d256-prod-github-runner-207 kernel: [17804.562531] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 10:20:30 juju-e4d256-prod-github-runner-207 kernel: [17804.563577] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 10:20:30 juju-e4d256-prod-github-runner-207 kernel: [17804.564768] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 10:20:30 juju-e4d256-prod-github-runner-207 kernel: [17804.565974] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 10:20:30 juju-e4d256-prod-github-runner-207 kernel: [17804.567205] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 10:20:30 juju-e4d256-prod-github-runner-207 kernel: [17804.568383] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 10:20:30 juju-e4d256-prod-github-runner-207 kernel: [17804.569560] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 10:20:30 juju-e4d256-prod-github-runner-207 kernel: [17804.570815] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 10:20:30 juju-e4d256-prod-github-runner-207 kernel: [17804.571918] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 10:20:30 juju-e4d256-prod-github-runner-207 kernel: [17804.573121] Call Trace: Aug 22 10:20:30 juju-e4d256-prod-github-runner-207 kernel: [17804.574039] Aug 22 10:20:30 juju-e4d256-prod-github-runner-207 kernel: [17804.574958] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:20:30 juju-e4d256-prod-github-runner-207 kernel: [17804.575988] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:20:30 juju-e4d256-prod-github-runner-207 kernel: [17804.577014] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:20:30 juju-e4d256-prod-github-runner-207 kernel: [17804.578114] ? show_regs.part.0+0x23/0x29 Aug 22 10:20:30 juju-e4d256-prod-github-runner-207 kernel: [17804.579136] ? show_regs.cold+0x8/0xd Aug 22 10:20:30 juju-e4d256-prod-github-runner-207 kernel: [17804.580116] ? watchdog_timer_fn+0x1be/0x220 Aug 22 10:20:30 juju-e4d256-prod-github-runner-207 kernel: [17804.581123] ? lockup_detector_update_enable+0x60/0x60 Aug 22 10:20:30 juju-e4d256-prod-github-runner-207 kernel: [17804.582187] ? __hrtimer_run_queues+0x107/0x230 Aug 22 10:20:30 juju-e4d256-prod-github-runner-207 kernel: [17804.583243] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 10:20:30 juju-e4d256-prod-github-runner-207 kernel: [17804.584282] ? hrtimer_interrupt+0x101/0x220 Aug 22 10:20:30 juju-e4d256-prod-github-runner-207 kernel: [17804.585299] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 10:20:30 juju-e4d256-prod-github-runner-207 kernel: [17804.586407] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 10:20:30 juju-e4d256-prod-github-runner-207 kernel: [17804.587469] Aug 22 10:20:30 juju-e4d256-prod-github-runner-207 kernel: [17804.588322] Aug 22 10:20:30 juju-e4d256-prod-github-runner-207 kernel: [17804.589164] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 10:20:30 juju-e4d256-prod-github-runner-207 kernel: [17804.590196] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:20:30 juju-e4d256-prod-github-runner-207 kernel: [17804.591254] ? _raw_spin_lock+0x22/0x30 Aug 22 10:20:30 juju-e4d256-prod-github-runner-207 kernel: [17804.592199] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:20:30 juju-e4d256-prod-github-runner-207 kernel: [17804.593227] direct_page_fault+0x206/0x310 [kvm] Aug 22 10:20:30 juju-e4d256-prod-github-runner-207 kernel: [17804.594258] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 10:20:30 juju-e4d256-prod-github-runner-207 kernel: [17804.595326] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 10:20:30 juju-e4d256-prod-github-runner-207 kernel: [17804.596335] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 10:20:30 juju-e4d256-prod-github-runner-207 kernel: [17804.597334] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 10:20:30 juju-e4d256-prod-github-runner-207 kernel: [17804.598281] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 10:20:30 juju-e4d256-prod-github-runner-207 kernel: [17804.599269] handle_exit+0x98/0x230 [kvm_amd] Aug 22 10:20:30 juju-e4d256-prod-github-runner-207 kernel: [17804.600177] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 10:20:30 juju-e4d256-prod-github-runner-207 kernel: [17804.601095] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 10:20:30 juju-e4d256-prod-github-runner-207 kernel: [17804.602115] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 10:20:30 juju-e4d256-prod-github-runner-207 kernel: [17804.603036] vcpu_run+0x62/0x2c0 [kvm] Aug 22 10:20:30 juju-e4d256-prod-github-runner-207 kernel: [17804.603848] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 10:20:30 juju-e4d256-prod-github-runner-207 kernel: [17804.604655] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 10:20:30 juju-e4d256-prod-github-runner-207 kernel: [17804.605515] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 10:20:30 juju-e4d256-prod-github-runner-207 kernel: [17804.606311] ? __seccomp_filter+0x4a/0x4a0 Aug 22 10:20:30 juju-e4d256-prod-github-runner-207 kernel: [17804.607069] ? __fget_files+0x86/0xc0 Aug 22 10:20:30 juju-e4d256-prod-github-runner-207 kernel: [17804.607772] __x64_sys_ioctl+0x95/0xd0 Aug 22 10:20:30 juju-e4d256-prod-github-runner-207 kernel: [17804.608469] do_syscall_64+0x5c/0xc0 Aug 22 10:20:30 juju-e4d256-prod-github-runner-207 kernel: [17804.609133] ? do_futex+0x162/0x1f0 Aug 22 10:20:30 juju-e4d256-prod-github-runner-207 kernel: [17804.609780] ? __x64_sys_futex+0x78/0x1e0 Aug 22 10:20:30 juju-e4d256-prod-github-runner-207 kernel: [17804.610472] ? __secure_computing+0xa9/0x120 Aug 22 10:20:30 juju-e4d256-prod-github-runner-207 kernel: [17804.611163] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 10:20:30 juju-e4d256-prod-github-runner-207 kernel: [17804.611923] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:20:30 juju-e4d256-prod-github-runner-207 kernel: [17804.612646] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:20:30 juju-e4d256-prod-github-runner-207 kernel: [17804.613366] ? do_syscall_64+0x69/0xc0 Aug 22 10:20:30 juju-e4d256-prod-github-runner-207 kernel: [17804.614010] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:20:30 juju-e4d256-prod-github-runner-207 kernel: [17804.614726] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:20:30 juju-e4d256-prod-github-runner-207 kernel: [17804.615428] ? do_syscall_64+0x69/0xc0 Aug 22 10:20:30 juju-e4d256-prod-github-runner-207 kernel: [17804.616053] ? do_syscall_64+0x69/0xc0 Aug 22 10:20:30 juju-e4d256-prod-github-runner-207 kernel: [17804.616675] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 10:20:30 juju-e4d256-prod-github-runner-207 kernel: [17804.617386] RIP: 0033:0x7faa5d0edaff Aug 22 10:20:30 juju-e4d256-prod-github-runner-207 kernel: [17804.618049] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 10:20:30 juju-e4d256-prod-github-runner-207 kernel: [17804.620064] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 10:20:30 juju-e4d256-prod-github-runner-207 kernel: [17804.620981] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 10:20:30 juju-e4d256-prod-github-runner-207 kernel: [17804.621868] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 10:20:30 juju-e4d256-prod-github-runner-207 kernel: [17804.622768] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 10:20:30 juju-e4d256-prod-github-runner-207 kernel: [17804.623657] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 10:20:30 juju-e4d256-prod-github-runner-207 kernel: [17804.624543] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 10:20:30 juju-e4d256-prod-github-runner-207 kernel: [17804.625435] Aug 22 10:20:44 juju-e4d256-prod-github-runner-207 kernel: [17818.376708] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 10:20:44 juju-e4d256-prod-github-runner-207 kernel: [17818.378454] rcu: 1-....: (4411475 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=2134020 Aug 22 10:20:44 juju-e4d256-prod-github-runner-207 kernel: [17818.379620] (t=4425294 jiffies g=23269 q=24442) Aug 22 10:20:44 juju-e4d256-prod-github-runner-207 kernel: [17818.380425] NMI backtrace for cpu 1 Aug 22 10:20:44 juju-e4d256-prod-github-runner-207 kernel: [17818.381140] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 10:20:44 juju-e4d256-prod-github-runner-207 kernel: [17818.382265] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 10:20:44 juju-e4d256-prod-github-runner-207 kernel: [17818.383407] Call Trace: Aug 22 10:20:44 juju-e4d256-prod-github-runner-207 kernel: [17818.384092] Aug 22 10:20:44 juju-e4d256-prod-github-runner-207 kernel: [17818.384751] show_stack+0x52/0x5c Aug 22 10:20:44 juju-e4d256-prod-github-runner-207 kernel: [17818.385747] dump_stack_lvl+0x4a/0x63 Aug 22 10:20:44 juju-e4d256-prod-github-runner-207 kernel: [17818.386526] dump_stack+0x10/0x16 Aug 22 10:20:44 juju-e4d256-prod-github-runner-207 kernel: [17818.387279] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 10:20:44 juju-e4d256-prod-github-runner-207 kernel: [17818.388150] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 10:20:44 juju-e4d256-prod-github-runner-207 kernel: [17818.388930] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 10:20:44 juju-e4d256-prod-github-runner-207 kernel: [17818.389750] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 10:20:44 juju-e4d256-prod-github-runner-207 kernel: [17818.390607] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 10:20:44 juju-e4d256-prod-github-runner-207 kernel: [17818.391420] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 10:20:44 juju-e4d256-prod-github-runner-207 kernel: [17818.392203] print_cpu_stall.cold+0x2f/0xe2 Aug 22 10:20:44 juju-e4d256-prod-github-runner-207 kernel: [17818.392969] ? timekeeping_update+0xf7/0x150 Aug 22 10:20:44 juju-e4d256-prod-github-runner-207 kernel: [17818.393773] check_cpu_stall+0x109/0x270 Aug 22 10:20:44 juju-e4d256-prod-github-runner-207 kernel: [17818.394541] rcu_sched_clock_irq+0x9a/0x250 Aug 22 10:20:44 juju-e4d256-prod-github-runner-207 kernel: [17818.395305] update_process_times+0x94/0xd0 Aug 22 10:20:44 juju-e4d256-prod-github-runner-207 kernel: [17818.396086] tick_sched_handle+0x29/0x70 Aug 22 10:20:44 juju-e4d256-prod-github-runner-207 kernel: [17818.396848] tick_sched_timer+0x8c/0xc0 Aug 22 10:20:44 juju-e4d256-prod-github-runner-207 kernel: [17818.397594] ? tick_nohz_handler+0xb0/0xb0 Aug 22 10:20:44 juju-e4d256-prod-github-runner-207 kernel: [17818.398362] __hrtimer_run_queues+0x107/0x230 Aug 22 10:20:44 juju-e4d256-prod-github-runner-207 kernel: [17818.399135] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 10:20:44 juju-e4d256-prod-github-runner-207 kernel: [17818.399909] hrtimer_interrupt+0x101/0x220 Aug 22 10:20:44 juju-e4d256-prod-github-runner-207 kernel: [17818.400673] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 10:20:44 juju-e4d256-prod-github-runner-207 kernel: [17818.401539] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 10:20:44 juju-e4d256-prod-github-runner-207 kernel: [17818.402450] Aug 22 10:20:44 juju-e4d256-prod-github-runner-207 kernel: [17818.403086] Aug 22 10:20:44 juju-e4d256-prod-github-runner-207 kernel: [17818.403718] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 10:20:44 juju-e4d256-prod-github-runner-207 kernel: [17818.404536] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:20:44 juju-e4d256-prod-github-runner-207 kernel: [17818.405412] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 10:20:44 juju-e4d256-prod-github-runner-207 kernel: [17818.407667] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 10:20:44 juju-e4d256-prod-github-runner-207 kernel: [17818.408550] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 10:20:44 juju-e4d256-prod-github-runner-207 kernel: [17818.409543] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 10:20:44 juju-e4d256-prod-github-runner-207 kernel: [17818.410538] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 10:20:44 juju-e4d256-prod-github-runner-207 kernel: [17818.411525] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 10:20:44 juju-e4d256-prod-github-runner-207 kernel: [17818.412495] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 10:20:44 juju-e4d256-prod-github-runner-207 kernel: [17818.413460] ? _raw_spin_lock+0x22/0x30 Aug 22 10:20:44 juju-e4d256-prod-github-runner-207 kernel: [17818.414228] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:20:44 juju-e4d256-prod-github-runner-207 kernel: [17818.415086] direct_page_fault+0x206/0x310 [kvm] Aug 22 10:20:44 juju-e4d256-prod-github-runner-207 kernel: [17818.415927] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 10:20:44 juju-e4d256-prod-github-runner-207 kernel: [17818.416769] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 10:20:44 juju-e4d256-prod-github-runner-207 kernel: [17818.417614] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 10:20:44 juju-e4d256-prod-github-runner-207 kernel: [17818.418458] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 10:20:44 juju-e4d256-prod-github-runner-207 kernel: [17818.419288] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 10:20:44 juju-e4d256-prod-github-runner-207 kernel: [17818.420119] handle_exit+0x98/0x230 [kvm_amd] Aug 22 10:20:44 juju-e4d256-prod-github-runner-207 kernel: [17818.420881] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 10:20:44 juju-e4d256-prod-github-runner-207 kernel: [17818.421677] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 10:20:44 juju-e4d256-prod-github-runner-207 kernel: [17818.422507] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 10:20:44 juju-e4d256-prod-github-runner-207 kernel: [17818.423307] vcpu_run+0x62/0x2c0 [kvm] Aug 22 10:20:44 juju-e4d256-prod-github-runner-207 kernel: [17818.424023] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 10:20:44 juju-e4d256-prod-github-runner-207 kernel: [17818.424760] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 10:20:44 juju-e4d256-prod-github-runner-207 kernel: [17818.425563] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 10:20:44 juju-e4d256-prod-github-runner-207 kernel: [17818.426353] ? __seccomp_filter+0x4a/0x4a0 Aug 22 10:20:44 juju-e4d256-prod-github-runner-207 kernel: [17818.427094] ? __fget_files+0x86/0xc0 Aug 22 10:20:44 juju-e4d256-prod-github-runner-207 kernel: [17818.427800] __x64_sys_ioctl+0x95/0xd0 Aug 22 10:20:44 juju-e4d256-prod-github-runner-207 kernel: [17818.428506] do_syscall_64+0x5c/0xc0 Aug 22 10:20:44 juju-e4d256-prod-github-runner-207 kernel: [17818.429215] ? do_futex+0x162/0x1f0 Aug 22 10:20:44 juju-e4d256-prod-github-runner-207 kernel: [17818.429897] ? __x64_sys_futex+0x78/0x1e0 Aug 22 10:20:44 juju-e4d256-prod-github-runner-207 kernel: [17818.430610] ? __secure_computing+0xa9/0x120 Aug 22 10:20:44 juju-e4d256-prod-github-runner-207 kernel: [17818.431329] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 10:20:44 juju-e4d256-prod-github-runner-207 kernel: [17818.432135] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:20:44 juju-e4d256-prod-github-runner-207 kernel: [17818.433025] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:20:44 juju-e4d256-prod-github-runner-207 kernel: [17818.433796] ? do_syscall_64+0x69/0xc0 Aug 22 10:20:44 juju-e4d256-prod-github-runner-207 kernel: [17818.434502] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:20:44 juju-e4d256-prod-github-runner-207 kernel: [17818.435260] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:20:44 juju-e4d256-prod-github-runner-207 kernel: [17818.436025] ? do_syscall_64+0x69/0xc0 Aug 22 10:20:44 juju-e4d256-prod-github-runner-207 kernel: [17818.436720] ? do_syscall_64+0x69/0xc0 Aug 22 10:20:44 juju-e4d256-prod-github-runner-207 kernel: [17818.437418] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 10:20:44 juju-e4d256-prod-github-runner-207 kernel: [17818.438199] RIP: 0033:0x7faa5d0edaff Aug 22 10:20:44 juju-e4d256-prod-github-runner-207 kernel: [17818.438918] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 10:20:44 juju-e4d256-prod-github-runner-207 kernel: [17818.441104] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 10:20:44 juju-e4d256-prod-github-runner-207 kernel: [17818.442106] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 10:20:44 juju-e4d256-prod-github-runner-207 kernel: [17818.443071] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 10:20:44 juju-e4d256-prod-github-runner-207 kernel: [17818.444034] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 10:20:44 juju-e4d256-prod-github-runner-207 kernel: [17818.444982] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 10:20:44 juju-e4d256-prod-github-runner-207 kernel: [17818.445909] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 10:20:44 juju-e4d256-prod-github-runner-207 kernel: [17818.446835] Aug 22 10:21:10 juju-e4d256-prod-github-runner-207 kernel: [17844.541980] watchdog: BUG: soft lockup - CPU#1 stuck for 16511s! [qemu-system-x86:6715] Aug 22 10:21:10 juju-e4d256-prod-github-runner-207 kernel: [17844.543684] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 10:21:10 juju-e4d256-prod-github-runner-207 kernel: [17844.543911] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 10:21:10 juju-e4d256-prod-github-runner-207 kernel: [17844.555971] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 10:21:10 juju-e4d256-prod-github-runner-207 kernel: [17844.557230] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 10:21:10 juju-e4d256-prod-github-runner-207 kernel: [17844.558470] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:21:10 juju-e4d256-prod-github-runner-207 kernel: [17844.559531] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 10:21:10 juju-e4d256-prod-github-runner-207 kernel: [17844.562091] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 10:21:10 juju-e4d256-prod-github-runner-207 kernel: [17844.563132] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 10:21:10 juju-e4d256-prod-github-runner-207 kernel: [17844.564298] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 10:21:10 juju-e4d256-prod-github-runner-207 kernel: [17844.565459] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 10:21:10 juju-e4d256-prod-github-runner-207 kernel: [17844.566631] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 10:21:10 juju-e4d256-prod-github-runner-207 kernel: [17844.567805] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 10:21:10 juju-e4d256-prod-github-runner-207 kernel: [17844.568981] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 10:21:10 juju-e4d256-prod-github-runner-207 kernel: [17844.570231] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 10:21:10 juju-e4d256-prod-github-runner-207 kernel: [17844.571344] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 10:21:10 juju-e4d256-prod-github-runner-207 kernel: [17844.572738] Call Trace: Aug 22 10:21:10 juju-e4d256-prod-github-runner-207 kernel: [17844.573765] Aug 22 10:21:10 juju-e4d256-prod-github-runner-207 kernel: [17844.574671] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:21:10 juju-e4d256-prod-github-runner-207 kernel: [17844.575702] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:21:10 juju-e4d256-prod-github-runner-207 kernel: [17844.576727] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:21:10 juju-e4d256-prod-github-runner-207 kernel: [17844.577826] ? show_regs.part.0+0x23/0x29 Aug 22 10:21:10 juju-e4d256-prod-github-runner-207 kernel: [17844.578834] ? show_regs.cold+0x8/0xd Aug 22 10:21:10 juju-e4d256-prod-github-runner-207 kernel: [17844.579813] ? watchdog_timer_fn+0x1be/0x220 Aug 22 10:21:10 juju-e4d256-prod-github-runner-207 kernel: [17844.580818] ? lockup_detector_update_enable+0x60/0x60 Aug 22 10:21:10 juju-e4d256-prod-github-runner-207 kernel: [17844.581878] ? __hrtimer_run_queues+0x107/0x230 Aug 22 10:21:10 juju-e4d256-prod-github-runner-207 kernel: [17844.582925] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 10:21:10 juju-e4d256-prod-github-runner-207 kernel: [17844.583946] ? hrtimer_interrupt+0x101/0x220 Aug 22 10:21:10 juju-e4d256-prod-github-runner-207 kernel: [17844.584958] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 10:21:10 juju-e4d256-prod-github-runner-207 kernel: [17844.586043] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 10:21:10 juju-e4d256-prod-github-runner-207 kernel: [17844.587089] Aug 22 10:21:10 juju-e4d256-prod-github-runner-207 kernel: [17844.587942] Aug 22 10:21:10 juju-e4d256-prod-github-runner-207 kernel: [17844.588784] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 10:21:10 juju-e4d256-prod-github-runner-207 kernel: [17844.589814] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:21:10 juju-e4d256-prod-github-runner-207 kernel: [17844.590894] ? _raw_spin_lock+0x22/0x30 Aug 22 10:21:10 juju-e4d256-prod-github-runner-207 kernel: [17844.591837] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:21:10 juju-e4d256-prod-github-runner-207 kernel: [17844.592851] direct_page_fault+0x206/0x310 [kvm] Aug 22 10:21:10 juju-e4d256-prod-github-runner-207 kernel: [17844.593871] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 10:21:10 juju-e4d256-prod-github-runner-207 kernel: [17844.594887] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 10:21:10 juju-e4d256-prod-github-runner-207 kernel: [17844.595888] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 10:21:10 juju-e4d256-prod-github-runner-207 kernel: [17844.596884] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 10:21:10 juju-e4d256-prod-github-runner-207 kernel: [17844.597828] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 10:21:10 juju-e4d256-prod-github-runner-207 kernel: [17844.598825] handle_exit+0x98/0x230 [kvm_amd] Aug 22 10:21:10 juju-e4d256-prod-github-runner-207 kernel: [17844.599714] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 10:21:10 juju-e4d256-prod-github-runner-207 kernel: [17844.600627] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 10:21:10 juju-e4d256-prod-github-runner-207 kernel: [17844.601550] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 10:21:10 juju-e4d256-prod-github-runner-207 kernel: [17844.602473] vcpu_run+0x62/0x2c0 [kvm] Aug 22 10:21:10 juju-e4d256-prod-github-runner-207 kernel: [17844.603289] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 10:21:10 juju-e4d256-prod-github-runner-207 kernel: [17844.604095] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 10:21:10 juju-e4d256-prod-github-runner-207 kernel: [17844.604952] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 10:21:10 juju-e4d256-prod-github-runner-207 kernel: [17844.605755] ? __seccomp_filter+0x4a/0x4a0 Aug 22 10:21:10 juju-e4d256-prod-github-runner-207 kernel: [17844.606508] ? __fget_files+0x86/0xc0 Aug 22 10:21:10 juju-e4d256-prod-github-runner-207 kernel: [17844.607209] __x64_sys_ioctl+0x95/0xd0 Aug 22 10:21:10 juju-e4d256-prod-github-runner-207 kernel: [17844.607898] do_syscall_64+0x5c/0xc0 Aug 22 10:21:10 juju-e4d256-prod-github-runner-207 kernel: [17844.608560] ? do_futex+0x162/0x1f0 Aug 22 10:21:10 juju-e4d256-prod-github-runner-207 kernel: [17844.609211] ? __x64_sys_futex+0x78/0x1e0 Aug 22 10:21:10 juju-e4d256-prod-github-runner-207 kernel: [17844.609882] ? __secure_computing+0xa9/0x120 Aug 22 10:21:10 juju-e4d256-prod-github-runner-207 kernel: [17844.610583] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 10:21:10 juju-e4d256-prod-github-runner-207 kernel: [17844.611340] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:21:10 juju-e4d256-prod-github-runner-207 kernel: [17844.612058] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:21:10 juju-e4d256-prod-github-runner-207 kernel: [17844.612778] ? do_syscall_64+0x69/0xc0 Aug 22 10:21:10 juju-e4d256-prod-github-runner-207 kernel: [17844.613420] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:21:10 juju-e4d256-prod-github-runner-207 kernel: [17844.614135] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:21:10 juju-e4d256-prod-github-runner-207 kernel: [17844.614834] ? do_syscall_64+0x69/0xc0 Aug 22 10:21:10 juju-e4d256-prod-github-runner-207 kernel: [17844.615455] ? do_syscall_64+0x69/0xc0 Aug 22 10:21:10 juju-e4d256-prod-github-runner-207 kernel: [17844.616080] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 10:21:10 juju-e4d256-prod-github-runner-207 kernel: [17844.616782] RIP: 0033:0x7faa5d0edaff Aug 22 10:21:10 juju-e4d256-prod-github-runner-207 kernel: [17844.617436] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 10:21:10 juju-e4d256-prod-github-runner-207 kernel: [17844.619430] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 10:21:10 juju-e4d256-prod-github-runner-207 kernel: [17844.620334] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 10:21:10 juju-e4d256-prod-github-runner-207 kernel: [17844.621225] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 10:21:10 juju-e4d256-prod-github-runner-207 kernel: [17844.622124] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 10:21:10 juju-e4d256-prod-github-runner-207 kernel: [17844.623013] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 10:21:10 juju-e4d256-prod-github-runner-207 kernel: [17844.623902] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 10:21:10 juju-e4d256-prod-github-runner-207 kernel: [17844.624789] Aug 22 10:21:38 juju-e4d256-prod-github-runner-207 kernel: [17872.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 16537s! [qemu-system-x86:6715] Aug 22 10:21:38 juju-e4d256-prod-github-runner-207 kernel: [17872.543746] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 10:21:38 juju-e4d256-prod-github-runner-207 kernel: [17872.544010] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 10:21:38 juju-e4d256-prod-github-runner-207 kernel: [17872.556078] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 10:21:38 juju-e4d256-prod-github-runner-207 kernel: [17872.557345] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 10:21:38 juju-e4d256-prod-github-runner-207 kernel: [17872.558573] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:21:38 juju-e4d256-prod-github-runner-207 kernel: [17872.559628] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 10:21:38 juju-e4d256-prod-github-runner-207 kernel: [17872.562194] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 10:21:38 juju-e4d256-prod-github-runner-207 kernel: [17872.563234] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 10:21:38 juju-e4d256-prod-github-runner-207 kernel: [17872.564399] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 10:21:38 juju-e4d256-prod-github-runner-207 kernel: [17872.565556] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 10:21:38 juju-e4d256-prod-github-runner-207 kernel: [17872.566720] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 10:21:38 juju-e4d256-prod-github-runner-207 kernel: [17872.567878] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 10:21:38 juju-e4d256-prod-github-runner-207 kernel: [17872.569043] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 10:21:38 juju-e4d256-prod-github-runner-207 kernel: [17872.570283] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 10:21:38 juju-e4d256-prod-github-runner-207 kernel: [17872.571382] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 10:21:38 juju-e4d256-prod-github-runner-207 kernel: [17872.572571] Call Trace: Aug 22 10:21:38 juju-e4d256-prod-github-runner-207 kernel: [17872.573483] Aug 22 10:21:38 juju-e4d256-prod-github-runner-207 kernel: [17872.574386] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:21:38 juju-e4d256-prod-github-runner-207 kernel: [17872.575413] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:21:38 juju-e4d256-prod-github-runner-207 kernel: [17872.576442] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:21:38 juju-e4d256-prod-github-runner-207 kernel: [17872.577526] ? show_regs.part.0+0x23/0x29 Aug 22 10:21:38 juju-e4d256-prod-github-runner-207 kernel: [17872.578529] ? show_regs.cold+0x8/0xd Aug 22 10:21:38 juju-e4d256-prod-github-runner-207 kernel: [17872.579504] ? watchdog_timer_fn+0x1be/0x220 Aug 22 10:21:38 juju-e4d256-prod-github-runner-207 kernel: [17872.580508] ? lockup_detector_update_enable+0x60/0x60 Aug 22 10:21:38 juju-e4d256-prod-github-runner-207 kernel: [17872.581570] ? __hrtimer_run_queues+0x107/0x230 Aug 22 10:21:38 juju-e4d256-prod-github-runner-207 kernel: [17872.582606] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 10:21:38 juju-e4d256-prod-github-runner-207 kernel: [17872.583629] ? hrtimer_interrupt+0x101/0x220 Aug 22 10:21:38 juju-e4d256-prod-github-runner-207 kernel: [17872.584640] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 10:21:38 juju-e4d256-prod-github-runner-207 kernel: [17872.585713] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 10:21:38 juju-e4d256-prod-github-runner-207 kernel: [17872.586769] Aug 22 10:21:38 juju-e4d256-prod-github-runner-207 kernel: [17872.587620] Aug 22 10:21:38 juju-e4d256-prod-github-runner-207 kernel: [17872.588455] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 10:21:38 juju-e4d256-prod-github-runner-207 kernel: [17872.589492] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:21:38 juju-e4d256-prod-github-runner-207 kernel: [17872.590539] ? _raw_spin_lock+0x22/0x30 Aug 22 10:21:38 juju-e4d256-prod-github-runner-207 kernel: [17872.591480] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:21:38 juju-e4d256-prod-github-runner-207 kernel: [17872.592497] direct_page_fault+0x206/0x310 [kvm] Aug 22 10:21:38 juju-e4d256-prod-github-runner-207 kernel: [17872.593517] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 10:21:38 juju-e4d256-prod-github-runner-207 kernel: [17872.594529] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 10:21:38 juju-e4d256-prod-github-runner-207 kernel: [17872.595531] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 10:21:38 juju-e4d256-prod-github-runner-207 kernel: [17872.596518] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 10:21:38 juju-e4d256-prod-github-runner-207 kernel: [17872.597462] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 10:21:38 juju-e4d256-prod-github-runner-207 kernel: [17872.598451] handle_exit+0x98/0x230 [kvm_amd] Aug 22 10:21:38 juju-e4d256-prod-github-runner-207 kernel: [17872.599451] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 10:21:38 juju-e4d256-prod-github-runner-207 kernel: [17872.600362] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 10:21:38 juju-e4d256-prod-github-runner-207 kernel: [17872.601287] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 10:21:38 juju-e4d256-prod-github-runner-207 kernel: [17872.602196] vcpu_run+0x62/0x2c0 [kvm] Aug 22 10:21:38 juju-e4d256-prod-github-runner-207 kernel: [17872.603005] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 10:21:38 juju-e4d256-prod-github-runner-207 kernel: [17872.603814] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 10:21:38 juju-e4d256-prod-github-runner-207 kernel: [17872.604665] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 10:21:38 juju-e4d256-prod-github-runner-207 kernel: [17872.605460] ? __seccomp_filter+0x4a/0x4a0 Aug 22 10:21:38 juju-e4d256-prod-github-runner-207 kernel: [17872.606213] ? __fget_files+0x86/0xc0 Aug 22 10:21:38 juju-e4d256-prod-github-runner-207 kernel: [17872.606917] __x64_sys_ioctl+0x95/0xd0 Aug 22 10:21:38 juju-e4d256-prod-github-runner-207 kernel: [17872.607608] do_syscall_64+0x5c/0xc0 Aug 22 10:21:38 juju-e4d256-prod-github-runner-207 kernel: [17872.608276] ? do_futex+0x162/0x1f0 Aug 22 10:21:38 juju-e4d256-prod-github-runner-207 kernel: [17872.608923] ? __x64_sys_futex+0x78/0x1e0 Aug 22 10:21:38 juju-e4d256-prod-github-runner-207 kernel: [17872.609596] ? __secure_computing+0xa9/0x120 Aug 22 10:21:38 juju-e4d256-prod-github-runner-207 kernel: [17872.610292] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 10:21:38 juju-e4d256-prod-github-runner-207 kernel: [17872.611049] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:21:38 juju-e4d256-prod-github-runner-207 kernel: [17872.611767] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:21:38 juju-e4d256-prod-github-runner-207 kernel: [17872.612483] ? do_syscall_64+0x69/0xc0 Aug 22 10:21:38 juju-e4d256-prod-github-runner-207 kernel: [17872.613130] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:21:38 juju-e4d256-prod-github-runner-207 kernel: [17872.613844] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:21:38 juju-e4d256-prod-github-runner-207 kernel: [17872.614542] ? do_syscall_64+0x69/0xc0 Aug 22 10:21:38 juju-e4d256-prod-github-runner-207 kernel: [17872.615165] ? do_syscall_64+0x69/0xc0 Aug 22 10:21:38 juju-e4d256-prod-github-runner-207 kernel: [17872.615784] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 10:21:38 juju-e4d256-prod-github-runner-207 kernel: [17872.616485] RIP: 0033:0x7faa5d0edaff Aug 22 10:21:38 juju-e4d256-prod-github-runner-207 kernel: [17872.617127] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 10:21:38 juju-e4d256-prod-github-runner-207 kernel: [17872.619112] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 10:21:38 juju-e4d256-prod-github-runner-207 kernel: [17872.620021] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 10:21:38 juju-e4d256-prod-github-runner-207 kernel: [17872.620913] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 10:21:38 juju-e4d256-prod-github-runner-207 kernel: [17872.621806] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 10:21:38 juju-e4d256-prod-github-runner-207 kernel: [17872.622694] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 10:21:38 juju-e4d256-prod-github-runner-207 kernel: [17872.623610] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 10:21:38 juju-e4d256-prod-github-runner-207 kernel: [17872.624512] Aug 22 10:22:06 juju-e4d256-prod-github-runner-207 kernel: [17900.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 16563s! [qemu-system-x86:6715] Aug 22 10:22:06 juju-e4d256-prod-github-runner-207 kernel: [17900.543099] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 10:22:06 juju-e4d256-prod-github-runner-207 kernel: [17900.543168] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 10:22:06 juju-e4d256-prod-github-runner-207 kernel: [17900.555303] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 10:22:06 juju-e4d256-prod-github-runner-207 kernel: [17900.556568] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 10:22:06 juju-e4d256-prod-github-runner-207 kernel: [17900.557802] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:22:06 juju-e4d256-prod-github-runner-207 kernel: [17900.558860] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 10:22:06 juju-e4d256-prod-github-runner-207 kernel: [17900.561423] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 10:22:06 juju-e4d256-prod-github-runner-207 kernel: [17900.562472] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 10:22:06 juju-e4d256-prod-github-runner-207 kernel: [17900.563669] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 10:22:06 juju-e4d256-prod-github-runner-207 kernel: [17900.564827] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 10:22:06 juju-e4d256-prod-github-runner-207 kernel: [17900.565994] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 10:22:06 juju-e4d256-prod-github-runner-207 kernel: [17900.567154] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 10:22:06 juju-e4d256-prod-github-runner-207 kernel: [17900.568325] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 10:22:06 juju-e4d256-prod-github-runner-207 kernel: [17900.569576] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 10:22:06 juju-e4d256-prod-github-runner-207 kernel: [17900.570671] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 10:22:06 juju-e4d256-prod-github-runner-207 kernel: [17900.571867] Call Trace: Aug 22 10:22:06 juju-e4d256-prod-github-runner-207 kernel: [17900.572778] Aug 22 10:22:06 juju-e4d256-prod-github-runner-207 kernel: [17900.573679] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:22:06 juju-e4d256-prod-github-runner-207 kernel: [17900.574707] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:22:06 juju-e4d256-prod-github-runner-207 kernel: [17900.575724] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:22:06 juju-e4d256-prod-github-runner-207 kernel: [17900.576797] ? show_regs.part.0+0x23/0x29 Aug 22 10:22:06 juju-e4d256-prod-github-runner-207 kernel: [17900.577809] ? show_regs.cold+0x8/0xd Aug 22 10:22:06 juju-e4d256-prod-github-runner-207 kernel: [17900.578780] ? watchdog_timer_fn+0x1be/0x220 Aug 22 10:22:06 juju-e4d256-prod-github-runner-207 kernel: [17900.579786] ? lockup_detector_update_enable+0x60/0x60 Aug 22 10:22:06 juju-e4d256-prod-github-runner-207 kernel: [17900.580851] ? __hrtimer_run_queues+0x107/0x230 Aug 22 10:22:06 juju-e4d256-prod-github-runner-207 kernel: [17900.581888] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 10:22:06 juju-e4d256-prod-github-runner-207 kernel: [17900.582914] ? hrtimer_interrupt+0x101/0x220 Aug 22 10:22:06 juju-e4d256-prod-github-runner-207 kernel: [17900.583928] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 10:22:06 juju-e4d256-prod-github-runner-207 kernel: [17900.584994] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 10:22:06 juju-e4d256-prod-github-runner-207 kernel: [17900.586046] Aug 22 10:22:06 juju-e4d256-prod-github-runner-207 kernel: [17900.586898] Aug 22 10:22:06 juju-e4d256-prod-github-runner-207 kernel: [17900.587733] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 10:22:06 juju-e4d256-prod-github-runner-207 kernel: [17900.588767] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:22:06 juju-e4d256-prod-github-runner-207 kernel: [17900.589815] ? _raw_spin_lock+0x22/0x30 Aug 22 10:22:06 juju-e4d256-prod-github-runner-207 kernel: [17900.590758] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:22:06 juju-e4d256-prod-github-runner-207 kernel: [17900.591794] direct_page_fault+0x206/0x310 [kvm] Aug 22 10:22:06 juju-e4d256-prod-github-runner-207 kernel: [17900.592821] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 10:22:06 juju-e4d256-prod-github-runner-207 kernel: [17900.593839] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 10:22:06 juju-e4d256-prod-github-runner-207 kernel: [17900.594839] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 10:22:06 juju-e4d256-prod-github-runner-207 kernel: [17900.595812] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 10:22:06 juju-e4d256-prod-github-runner-207 kernel: [17900.596754] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 10:22:06 juju-e4d256-prod-github-runner-207 kernel: [17900.597742] handle_exit+0x98/0x230 [kvm_amd] Aug 22 10:22:06 juju-e4d256-prod-github-runner-207 kernel: [17900.598638] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 10:22:06 juju-e4d256-prod-github-runner-207 kernel: [17900.599556] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 10:22:06 juju-e4d256-prod-github-runner-207 kernel: [17900.600483] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 10:22:06 juju-e4d256-prod-github-runner-207 kernel: [17900.601400] vcpu_run+0x62/0x2c0 [kvm] Aug 22 10:22:06 juju-e4d256-prod-github-runner-207 kernel: [17900.602209] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 10:22:06 juju-e4d256-prod-github-runner-207 kernel: [17900.603013] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 10:22:06 juju-e4d256-prod-github-runner-207 kernel: [17900.603864] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 10:22:06 juju-e4d256-prod-github-runner-207 kernel: [17900.604664] ? __seccomp_filter+0x4a/0x4a0 Aug 22 10:22:06 juju-e4d256-prod-github-runner-207 kernel: [17900.605414] ? __fget_files+0x86/0xc0 Aug 22 10:22:06 juju-e4d256-prod-github-runner-207 kernel: [17900.606114] __x64_sys_ioctl+0x95/0xd0 Aug 22 10:22:06 juju-e4d256-prod-github-runner-207 kernel: [17900.606807] do_syscall_64+0x5c/0xc0 Aug 22 10:22:06 juju-e4d256-prod-github-runner-207 kernel: [17900.607466] ? do_futex+0x162/0x1f0 Aug 22 10:22:06 juju-e4d256-prod-github-runner-207 kernel: [17900.608112] ? __x64_sys_futex+0x78/0x1e0 Aug 22 10:22:06 juju-e4d256-prod-github-runner-207 kernel: [17900.608785] ? __secure_computing+0xa9/0x120 Aug 22 10:22:06 juju-e4d256-prod-github-runner-207 kernel: [17900.609479] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 10:22:06 juju-e4d256-prod-github-runner-207 kernel: [17900.610237] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:22:06 juju-e4d256-prod-github-runner-207 kernel: [17900.610953] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:22:06 juju-e4d256-prod-github-runner-207 kernel: [17900.611666] ? do_syscall_64+0x69/0xc0 Aug 22 10:22:06 juju-e4d256-prod-github-runner-207 kernel: [17900.612307] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:22:06 juju-e4d256-prod-github-runner-207 kernel: [17900.613005] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:22:06 juju-e4d256-prod-github-runner-207 kernel: [17900.613706] ? do_syscall_64+0x69/0xc0 Aug 22 10:22:06 juju-e4d256-prod-github-runner-207 kernel: [17900.614329] ? do_syscall_64+0x69/0xc0 Aug 22 10:22:06 juju-e4d256-prod-github-runner-207 kernel: [17900.614946] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 10:22:06 juju-e4d256-prod-github-runner-207 kernel: [17900.615647] RIP: 0033:0x7faa5d0edaff Aug 22 10:22:06 juju-e4d256-prod-github-runner-207 kernel: [17900.616268] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 10:22:06 juju-e4d256-prod-github-runner-207 kernel: [17900.618247] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 10:22:06 juju-e4d256-prod-github-runner-207 kernel: [17900.619151] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 10:22:06 juju-e4d256-prod-github-runner-207 kernel: [17900.620039] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 10:22:06 juju-e4d256-prod-github-runner-207 kernel: [17900.620944] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 10:22:06 juju-e4d256-prod-github-runner-207 kernel: [17900.621872] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 10:22:06 juju-e4d256-prod-github-runner-207 kernel: [17900.622761] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 10:22:06 juju-e4d256-prod-github-runner-207 kernel: [17900.623684] Aug 22 10:22:34 juju-e4d256-prod-github-runner-207 kernel: [17928.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 16589s! [qemu-system-x86:6715] Aug 22 10:22:34 juju-e4d256-prod-github-runner-207 kernel: [17928.543873] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 10:22:34 juju-e4d256-prod-github-runner-207 kernel: [17928.544121] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 10:22:34 juju-e4d256-prod-github-runner-207 kernel: [17928.556390] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 10:22:34 juju-e4d256-prod-github-runner-207 kernel: [17928.557672] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 10:22:34 juju-e4d256-prod-github-runner-207 kernel: [17928.558888] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:22:34 juju-e4d256-prod-github-runner-207 kernel: [17928.559942] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 10:22:34 juju-e4d256-prod-github-runner-207 kernel: [17928.562512] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 10:22:34 juju-e4d256-prod-github-runner-207 kernel: [17928.563552] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 10:22:34 juju-e4d256-prod-github-runner-207 kernel: [17928.564708] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 10:22:34 juju-e4d256-prod-github-runner-207 kernel: [17928.565874] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 10:22:34 juju-e4d256-prod-github-runner-207 kernel: [17928.567030] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 10:22:34 juju-e4d256-prod-github-runner-207 kernel: [17928.568548] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 10:22:34 juju-e4d256-prod-github-runner-207 kernel: [17928.569786] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 10:22:34 juju-e4d256-prod-github-runner-207 kernel: [17928.571020] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 10:22:34 juju-e4d256-prod-github-runner-207 kernel: [17928.572116] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 10:22:34 juju-e4d256-prod-github-runner-207 kernel: [17928.573316] Call Trace: Aug 22 10:22:34 juju-e4d256-prod-github-runner-207 kernel: [17928.574233] Aug 22 10:22:34 juju-e4d256-prod-github-runner-207 kernel: [17928.575124] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:22:34 juju-e4d256-prod-github-runner-207 kernel: [17928.576151] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:22:34 juju-e4d256-prod-github-runner-207 kernel: [17928.577183] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:22:34 juju-e4d256-prod-github-runner-207 kernel: [17928.578275] ? show_regs.part.0+0x23/0x29 Aug 22 10:22:34 juju-e4d256-prod-github-runner-207 kernel: [17928.579269] ? show_regs.cold+0x8/0xd Aug 22 10:22:34 juju-e4d256-prod-github-runner-207 kernel: [17928.580238] ? watchdog_timer_fn+0x1be/0x220 Aug 22 10:22:34 juju-e4d256-prod-github-runner-207 kernel: [17928.581363] ? lockup_detector_update_enable+0x60/0x60 Aug 22 10:22:34 juju-e4d256-prod-github-runner-207 kernel: [17928.582426] ? __hrtimer_run_queues+0x107/0x230 Aug 22 10:22:34 juju-e4d256-prod-github-runner-207 kernel: [17928.583648] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 10:22:34 juju-e4d256-prod-github-runner-207 kernel: [17928.584691] ? hrtimer_interrupt+0x101/0x220 Aug 22 10:22:34 juju-e4d256-prod-github-runner-207 kernel: [17928.585721] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 10:22:34 juju-e4d256-prod-github-runner-207 kernel: [17928.586789] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 10:22:34 juju-e4d256-prod-github-runner-207 kernel: [17928.587835] Aug 22 10:22:34 juju-e4d256-prod-github-runner-207 kernel: [17928.588692] Aug 22 10:22:34 juju-e4d256-prod-github-runner-207 kernel: [17928.589543] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 10:22:34 juju-e4d256-prod-github-runner-207 kernel: [17928.590575] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:22:34 juju-e4d256-prod-github-runner-207 kernel: [17928.591630] ? _raw_spin_lock+0x22/0x30 Aug 22 10:22:34 juju-e4d256-prod-github-runner-207 kernel: [17928.592579] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:22:34 juju-e4d256-prod-github-runner-207 kernel: [17928.593610] direct_page_fault+0x206/0x310 [kvm] Aug 22 10:22:34 juju-e4d256-prod-github-runner-207 kernel: [17928.594644] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 10:22:34 juju-e4d256-prod-github-runner-207 kernel: [17928.595788] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 10:22:34 juju-e4d256-prod-github-runner-207 kernel: [17928.596790] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 10:22:34 juju-e4d256-prod-github-runner-207 kernel: [17928.597800] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 10:22:34 juju-e4d256-prod-github-runner-207 kernel: [17928.598745] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 10:22:34 juju-e4d256-prod-github-runner-207 kernel: [17928.599721] handle_exit+0x98/0x230 [kvm_amd] Aug 22 10:22:34 juju-e4d256-prod-github-runner-207 kernel: [17928.600613] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 10:22:34 juju-e4d256-prod-github-runner-207 kernel: [17928.601541] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 10:22:34 juju-e4d256-prod-github-runner-207 kernel: [17928.602466] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 10:22:34 juju-e4d256-prod-github-runner-207 kernel: [17928.603370] vcpu_run+0x62/0x2c0 [kvm] Aug 22 10:22:34 juju-e4d256-prod-github-runner-207 kernel: [17928.604181] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 10:22:34 juju-e4d256-prod-github-runner-207 kernel: [17928.605007] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 10:22:34 juju-e4d256-prod-github-runner-207 kernel: [17928.605885] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 10:22:34 juju-e4d256-prod-github-runner-207 kernel: [17928.606682] ? __seccomp_filter+0x4a/0x4a0 Aug 22 10:22:34 juju-e4d256-prod-github-runner-207 kernel: [17928.607427] ? __fget_files+0x86/0xc0 Aug 22 10:22:34 juju-e4d256-prod-github-runner-207 kernel: [17928.608132] __x64_sys_ioctl+0x95/0xd0 Aug 22 10:22:34 juju-e4d256-prod-github-runner-207 kernel: [17928.608826] do_syscall_64+0x5c/0xc0 Aug 22 10:22:34 juju-e4d256-prod-github-runner-207 kernel: [17928.609504] ? do_futex+0x162/0x1f0 Aug 22 10:22:34 juju-e4d256-prod-github-runner-207 kernel: [17928.610153] ? __x64_sys_futex+0x78/0x1e0 Aug 22 10:22:34 juju-e4d256-prod-github-runner-207 kernel: [17928.610834] ? __secure_computing+0xa9/0x120 Aug 22 10:22:34 juju-e4d256-prod-github-runner-207 kernel: [17928.611523] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 10:22:34 juju-e4d256-prod-github-runner-207 kernel: [17928.612283] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:22:34 juju-e4d256-prod-github-runner-207 kernel: [17928.613020] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:22:34 juju-e4d256-prod-github-runner-207 kernel: [17928.613738] ? do_syscall_64+0x69/0xc0 Aug 22 10:22:34 juju-e4d256-prod-github-runner-207 kernel: [17928.614384] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:22:34 juju-e4d256-prod-github-runner-207 kernel: [17928.615126] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:22:34 juju-e4d256-prod-github-runner-207 kernel: [17928.615826] ? do_syscall_64+0x69/0xc0 Aug 22 10:22:34 juju-e4d256-prod-github-runner-207 kernel: [17928.616451] ? do_syscall_64+0x69/0xc0 Aug 22 10:22:34 juju-e4d256-prod-github-runner-207 kernel: [17928.617090] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 10:22:34 juju-e4d256-prod-github-runner-207 kernel: [17928.617798] RIP: 0033:0x7faa5d0edaff Aug 22 10:22:34 juju-e4d256-prod-github-runner-207 kernel: [17928.618445] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 10:22:34 juju-e4d256-prod-github-runner-207 kernel: [17928.620427] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 10:22:34 juju-e4d256-prod-github-runner-207 kernel: [17928.621352] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 10:22:34 juju-e4d256-prod-github-runner-207 kernel: [17928.622242] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 10:22:34 juju-e4d256-prod-github-runner-207 kernel: [17928.623136] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 10:22:34 juju-e4d256-prod-github-runner-207 kernel: [17928.624023] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 10:22:34 juju-e4d256-prod-github-runner-207 kernel: [17928.624947] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 10:22:34 juju-e4d256-prod-github-runner-207 kernel: [17928.625893] Aug 22 10:23:02 juju-e4d256-prod-github-runner-207 kernel: [17956.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 16615s! [qemu-system-x86:6715] Aug 22 10:23:02 juju-e4d256-prod-github-runner-207 kernel: [17956.543107] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 10:23:02 juju-e4d256-prod-github-runner-207 kernel: [17956.543174] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 10:23:02 juju-e4d256-prod-github-runner-207 kernel: [17956.555269] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 10:23:02 juju-e4d256-prod-github-runner-207 kernel: [17956.556537] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 10:23:02 juju-e4d256-prod-github-runner-207 kernel: [17956.557773] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:23:02 juju-e4d256-prod-github-runner-207 kernel: [17956.558840] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 10:23:02 juju-e4d256-prod-github-runner-207 kernel: [17956.561493] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 10:23:02 juju-e4d256-prod-github-runner-207 kernel: [17956.562571] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 10:23:02 juju-e4d256-prod-github-runner-207 kernel: [17956.563746] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 10:23:02 juju-e4d256-prod-github-runner-207 kernel: [17956.564919] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 10:23:02 juju-e4d256-prod-github-runner-207 kernel: [17956.566083] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 10:23:02 juju-e4d256-prod-github-runner-207 kernel: [17956.567242] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 10:23:02 juju-e4d256-prod-github-runner-207 kernel: [17956.568416] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 10:23:02 juju-e4d256-prod-github-runner-207 kernel: [17956.569670] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 10:23:02 juju-e4d256-prod-github-runner-207 kernel: [17956.570765] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 10:23:02 juju-e4d256-prod-github-runner-207 kernel: [17956.571961] Call Trace: Aug 22 10:23:02 juju-e4d256-prod-github-runner-207 kernel: [17956.572908] Aug 22 10:23:02 juju-e4d256-prod-github-runner-207 kernel: [17956.573808] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:23:02 juju-e4d256-prod-github-runner-207 kernel: [17956.574837] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:23:02 juju-e4d256-prod-github-runner-207 kernel: [17956.575855] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:23:02 juju-e4d256-prod-github-runner-207 kernel: [17956.576943] ? show_regs.part.0+0x23/0x29 Aug 22 10:23:02 juju-e4d256-prod-github-runner-207 kernel: [17956.577939] ? show_regs.cold+0x8/0xd Aug 22 10:23:02 juju-e4d256-prod-github-runner-207 kernel: [17956.578940] ? watchdog_timer_fn+0x1be/0x220 Aug 22 10:23:02 juju-e4d256-prod-github-runner-207 kernel: [17956.579974] ? lockup_detector_update_enable+0x60/0x60 Aug 22 10:23:02 juju-e4d256-prod-github-runner-207 kernel: [17956.581046] ? __hrtimer_run_queues+0x107/0x230 Aug 22 10:23:02 juju-e4d256-prod-github-runner-207 kernel: [17956.582075] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 10:23:02 juju-e4d256-prod-github-runner-207 kernel: [17956.583097] ? hrtimer_interrupt+0x101/0x220 Aug 22 10:23:02 juju-e4d256-prod-github-runner-207 kernel: [17956.584119] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 10:23:02 juju-e4d256-prod-github-runner-207 kernel: [17956.585204] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 10:23:02 juju-e4d256-prod-github-runner-207 kernel: [17956.586249] Aug 22 10:23:02 juju-e4d256-prod-github-runner-207 kernel: [17956.587100] Aug 22 10:23:02 juju-e4d256-prod-github-runner-207 kernel: [17956.587937] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 10:23:02 juju-e4d256-prod-github-runner-207 kernel: [17956.588995] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:23:02 juju-e4d256-prod-github-runner-207 kernel: [17956.590038] ? _raw_spin_lock+0x22/0x30 Aug 22 10:23:02 juju-e4d256-prod-github-runner-207 kernel: [17956.590986] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:23:02 juju-e4d256-prod-github-runner-207 kernel: [17956.592002] direct_page_fault+0x206/0x310 [kvm] Aug 22 10:23:02 juju-e4d256-prod-github-runner-207 kernel: [17956.593041] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 10:23:02 juju-e4d256-prod-github-runner-207 kernel: [17956.594069] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 10:23:02 juju-e4d256-prod-github-runner-207 kernel: [17956.595070] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 10:23:02 juju-e4d256-prod-github-runner-207 kernel: [17956.596043] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 10:23:02 juju-e4d256-prod-github-runner-207 kernel: [17956.597007] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 10:23:02 juju-e4d256-prod-github-runner-207 kernel: [17956.597994] handle_exit+0x98/0x230 [kvm_amd] Aug 22 10:23:02 juju-e4d256-prod-github-runner-207 kernel: [17956.598886] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 10:23:02 juju-e4d256-prod-github-runner-207 kernel: [17956.599817] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 10:23:02 juju-e4d256-prod-github-runner-207 kernel: [17956.600755] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 10:23:02 juju-e4d256-prod-github-runner-207 kernel: [17956.601664] vcpu_run+0x62/0x2c0 [kvm] Aug 22 10:23:02 juju-e4d256-prod-github-runner-207 kernel: [17956.602472] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 10:23:02 juju-e4d256-prod-github-runner-207 kernel: [17956.603276] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 10:23:02 juju-e4d256-prod-github-runner-207 kernel: [17956.604133] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 10:23:02 juju-e4d256-prod-github-runner-207 kernel: [17956.604946] ? __seccomp_filter+0x4a/0x4a0 Aug 22 10:23:02 juju-e4d256-prod-github-runner-207 kernel: [17956.605689] ? __fget_files+0x86/0xc0 Aug 22 10:23:02 juju-e4d256-prod-github-runner-207 kernel: [17956.606390] __x64_sys_ioctl+0x95/0xd0 Aug 22 10:23:02 juju-e4d256-prod-github-runner-207 kernel: [17956.607080] do_syscall_64+0x5c/0xc0 Aug 22 10:23:02 juju-e4d256-prod-github-runner-207 kernel: [17956.607742] ? do_futex+0x162/0x1f0 Aug 22 10:23:02 juju-e4d256-prod-github-runner-207 kernel: [17956.608389] ? __x64_sys_futex+0x78/0x1e0 Aug 22 10:23:02 juju-e4d256-prod-github-runner-207 kernel: [17956.609071] ? __secure_computing+0xa9/0x120 Aug 22 10:23:02 juju-e4d256-prod-github-runner-207 kernel: [17956.609770] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 10:23:02 juju-e4d256-prod-github-runner-207 kernel: [17956.610534] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:23:02 juju-e4d256-prod-github-runner-207 kernel: [17956.611253] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:23:02 juju-e4d256-prod-github-runner-207 kernel: [17956.611969] ? do_syscall_64+0x69/0xc0 Aug 22 10:23:02 juju-e4d256-prod-github-runner-207 kernel: [17956.612611] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:23:02 juju-e4d256-prod-github-runner-207 kernel: [17956.614074] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:23:02 juju-e4d256-prod-github-runner-207 kernel: [17956.614817] ? do_syscall_64+0x69/0xc0 Aug 22 10:23:02 juju-e4d256-prod-github-runner-207 kernel: [17956.615457] ? do_syscall_64+0x69/0xc0 Aug 22 10:23:02 juju-e4d256-prod-github-runner-207 kernel: [17956.616091] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 10:23:02 juju-e4d256-prod-github-runner-207 kernel: [17956.616822] RIP: 0033:0x7faa5d0edaff Aug 22 10:23:02 juju-e4d256-prod-github-runner-207 kernel: [17956.617483] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 10:23:02 juju-e4d256-prod-github-runner-207 kernel: [17956.619510] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 10:23:02 juju-e4d256-prod-github-runner-207 kernel: [17956.620448] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 10:23:02 juju-e4d256-prod-github-runner-207 kernel: [17956.621370] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 10:23:02 juju-e4d256-prod-github-runner-207 kernel: [17956.622280] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 10:23:02 juju-e4d256-prod-github-runner-207 kernel: [17956.623192] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 10:23:02 juju-e4d256-prod-github-runner-207 kernel: [17956.624102] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 10:23:02 juju-e4d256-prod-github-runner-207 kernel: [17956.625033] Aug 22 10:23:30 juju-e4d256-prod-github-runner-207 kernel: [17984.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 16641s! [qemu-system-x86:6715] Aug 22 10:23:30 juju-e4d256-prod-github-runner-207 kernel: [17984.543745] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 10:23:30 juju-e4d256-prod-github-runner-207 kernel: [17984.544003] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 10:23:30 juju-e4d256-prod-github-runner-207 kernel: [17984.556099] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 10:23:30 juju-e4d256-prod-github-runner-207 kernel: [17984.557380] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 10:23:30 juju-e4d256-prod-github-runner-207 kernel: [17984.558608] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:23:30 juju-e4d256-prod-github-runner-207 kernel: [17984.559664] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 10:23:30 juju-e4d256-prod-github-runner-207 kernel: [17984.562219] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 10:23:30 juju-e4d256-prod-github-runner-207 kernel: [17984.563264] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 10:23:30 juju-e4d256-prod-github-runner-207 kernel: [17984.564435] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 10:23:30 juju-e4d256-prod-github-runner-207 kernel: [17984.565598] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 10:23:30 juju-e4d256-prod-github-runner-207 kernel: [17984.566760] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 10:23:30 juju-e4d256-prod-github-runner-207 kernel: [17984.567927] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 10:23:30 juju-e4d256-prod-github-runner-207 kernel: [17984.569138] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 10:23:30 juju-e4d256-prod-github-runner-207 kernel: [17984.570377] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 10:23:30 juju-e4d256-prod-github-runner-207 kernel: [17984.571474] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 10:23:30 juju-e4d256-prod-github-runner-207 kernel: [17984.572680] Call Trace: Aug 22 10:23:30 juju-e4d256-prod-github-runner-207 kernel: [17984.573599] Aug 22 10:23:30 juju-e4d256-prod-github-runner-207 kernel: [17984.574491] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:23:30 juju-e4d256-prod-github-runner-207 kernel: [17984.575518] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:23:30 juju-e4d256-prod-github-runner-207 kernel: [17984.576553] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:23:30 juju-e4d256-prod-github-runner-207 kernel: [17984.577642] ? show_regs.part.0+0x23/0x29 Aug 22 10:23:30 juju-e4d256-prod-github-runner-207 kernel: [17984.578640] ? show_regs.cold+0x8/0xd Aug 22 10:23:30 juju-e4d256-prod-github-runner-207 kernel: [17984.579611] ? watchdog_timer_fn+0x1be/0x220 Aug 22 10:23:30 juju-e4d256-prod-github-runner-207 kernel: [17984.580625] ? lockup_detector_update_enable+0x60/0x60 Aug 22 10:23:30 juju-e4d256-prod-github-runner-207 kernel: [17984.581688] ? __hrtimer_run_queues+0x107/0x230 Aug 22 10:23:30 juju-e4d256-prod-github-runner-207 kernel: [17984.582714] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 10:23:30 juju-e4d256-prod-github-runner-207 kernel: [17984.583740] ? hrtimer_interrupt+0x101/0x220 Aug 22 10:23:30 juju-e4d256-prod-github-runner-207 kernel: [17984.584763] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 10:23:30 juju-e4d256-prod-github-runner-207 kernel: [17984.585854] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 10:23:30 juju-e4d256-prod-github-runner-207 kernel: [17984.586911] Aug 22 10:23:30 juju-e4d256-prod-github-runner-207 kernel: [17984.587763] Aug 22 10:23:30 juju-e4d256-prod-github-runner-207 kernel: [17984.588616] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 10:23:30 juju-e4d256-prod-github-runner-207 kernel: [17984.589656] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:23:30 juju-e4d256-prod-github-runner-207 kernel: [17984.590690] ? _raw_spin_lock+0x22/0x30 Aug 22 10:23:30 juju-e4d256-prod-github-runner-207 kernel: [17984.591632] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:23:30 juju-e4d256-prod-github-runner-207 kernel: [17984.592653] direct_page_fault+0x206/0x310 [kvm] Aug 22 10:23:30 juju-e4d256-prod-github-runner-207 kernel: [17984.593681] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 10:23:30 juju-e4d256-prod-github-runner-207 kernel: [17984.594693] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 10:23:30 juju-e4d256-prod-github-runner-207 kernel: [17984.595692] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 10:23:30 juju-e4d256-prod-github-runner-207 kernel: [17984.596681] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 10:23:30 juju-e4d256-prod-github-runner-207 kernel: [17984.597626] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 10:23:30 juju-e4d256-prod-github-runner-207 kernel: [17984.598606] handle_exit+0x98/0x230 [kvm_amd] Aug 22 10:23:30 juju-e4d256-prod-github-runner-207 kernel: [17984.599500] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 10:23:30 juju-e4d256-prod-github-runner-207 kernel: [17984.600419] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 10:23:30 juju-e4d256-prod-github-runner-207 kernel: [17984.601349] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 10:23:30 juju-e4d256-prod-github-runner-207 kernel: [17984.602248] vcpu_run+0x62/0x2c0 [kvm] Aug 22 10:23:30 juju-e4d256-prod-github-runner-207 kernel: [17984.603057] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 10:23:30 juju-e4d256-prod-github-runner-207 kernel: [17984.603861] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 10:23:30 juju-e4d256-prod-github-runner-207 kernel: [17984.604721] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 10:23:30 juju-e4d256-prod-github-runner-207 kernel: [17984.605522] ? __seccomp_filter+0x4a/0x4a0 Aug 22 10:23:30 juju-e4d256-prod-github-runner-207 kernel: [17984.606267] ? __fget_files+0x86/0xc0 Aug 22 10:23:30 juju-e4d256-prod-github-runner-207 kernel: [17984.606968] __x64_sys_ioctl+0x95/0xd0 Aug 22 10:23:30 juju-e4d256-prod-github-runner-207 kernel: [17984.607661] do_syscall_64+0x5c/0xc0 Aug 22 10:23:30 juju-e4d256-prod-github-runner-207 kernel: [17984.608322] ? do_futex+0x162/0x1f0 Aug 22 10:23:30 juju-e4d256-prod-github-runner-207 kernel: [17984.608975] ? __x64_sys_futex+0x78/0x1e0 Aug 22 10:23:30 juju-e4d256-prod-github-runner-207 kernel: [17984.609647] ? __secure_computing+0xa9/0x120 Aug 22 10:23:30 juju-e4d256-prod-github-runner-207 kernel: [17984.610333] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 10:23:30 juju-e4d256-prod-github-runner-207 kernel: [17984.611088] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:23:30 juju-e4d256-prod-github-runner-207 kernel: [17984.611812] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:23:30 juju-e4d256-prod-github-runner-207 kernel: [17984.612532] ? do_syscall_64+0x69/0xc0 Aug 22 10:23:30 juju-e4d256-prod-github-runner-207 kernel: [17984.613176] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:23:30 juju-e4d256-prod-github-runner-207 kernel: [17984.613874] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:23:30 juju-e4d256-prod-github-runner-207 kernel: [17984.614571] ? do_syscall_64+0x69/0xc0 Aug 22 10:23:30 juju-e4d256-prod-github-runner-207 kernel: [17984.615193] ? do_syscall_64+0x69/0xc0 Aug 22 10:23:30 juju-e4d256-prod-github-runner-207 kernel: [17984.615811] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 10:23:30 juju-e4d256-prod-github-runner-207 kernel: [17984.616523] RIP: 0033:0x7faa5d0edaff Aug 22 10:23:30 juju-e4d256-prod-github-runner-207 kernel: [17984.617158] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 10:23:30 juju-e4d256-prod-github-runner-207 kernel: [17984.619140] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 10:23:30 juju-e4d256-prod-github-runner-207 kernel: [17984.620046] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 10:23:30 juju-e4d256-prod-github-runner-207 kernel: [17984.620947] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 10:23:30 juju-e4d256-prod-github-runner-207 kernel: [17984.621834] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 10:23:30 juju-e4d256-prod-github-runner-207 kernel: [17984.622719] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 10:23:30 juju-e4d256-prod-github-runner-207 kernel: [17984.623602] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 10:23:30 juju-e4d256-prod-github-runner-207 kernel: [17984.624534] Aug 22 10:23:44 juju-e4d256-prod-github-runner-207 kernel: [17998.388706] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 10:23:44 juju-e4d256-prod-github-runner-207 kernel: [17998.389695] rcu: 1-....: (4456343 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=2156132 Aug 22 10:23:44 juju-e4d256-prod-github-runner-207 kernel: [17998.390826] (t=4470297 jiffies g=23269 q=24581) Aug 22 10:23:44 juju-e4d256-prod-github-runner-207 kernel: [17998.391622] NMI backtrace for cpu 1 Aug 22 10:23:44 juju-e4d256-prod-github-runner-207 kernel: [17998.392363] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 10:23:44 juju-e4d256-prod-github-runner-207 kernel: [17998.393480] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 10:23:44 juju-e4d256-prod-github-runner-207 kernel: [17998.394551] Call Trace: Aug 22 10:23:44 juju-e4d256-prod-github-runner-207 kernel: [17998.395232] Aug 22 10:23:44 juju-e4d256-prod-github-runner-207 kernel: [17998.395884] show_stack+0x52/0x5c Aug 22 10:23:44 juju-e4d256-prod-github-runner-207 kernel: [17998.396629] dump_stack_lvl+0x4a/0x63 Aug 22 10:23:44 juju-e4d256-prod-github-runner-207 kernel: [17998.397381] dump_stack+0x10/0x16 Aug 22 10:23:44 juju-e4d256-prod-github-runner-207 kernel: [17998.398104] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 10:23:44 juju-e4d256-prod-github-runner-207 kernel: [17998.398890] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 10:23:44 juju-e4d256-prod-github-runner-207 kernel: [17998.399671] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 10:23:44 juju-e4d256-prod-github-runner-207 kernel: [17998.400549] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 10:23:44 juju-e4d256-prod-github-runner-207 kernel: [17998.401384] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 10:23:44 juju-e4d256-prod-github-runner-207 kernel: [17998.402199] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 10:23:44 juju-e4d256-prod-github-runner-207 kernel: [17998.402978] print_cpu_stall.cold+0x2f/0xe2 Aug 22 10:23:44 juju-e4d256-prod-github-runner-207 kernel: [17998.403746] ? timekeeping_update+0xf7/0x150 Aug 22 10:23:44 juju-e4d256-prod-github-runner-207 kernel: [17998.404540] check_cpu_stall+0x109/0x270 Aug 22 10:23:44 juju-e4d256-prod-github-runner-207 kernel: [17998.405296] rcu_sched_clock_irq+0x9a/0x250 Aug 22 10:23:44 juju-e4d256-prod-github-runner-207 kernel: [17998.406083] update_process_times+0x94/0xd0 Aug 22 10:23:44 juju-e4d256-prod-github-runner-207 kernel: [17998.406849] tick_sched_handle+0x29/0x70 Aug 22 10:23:44 juju-e4d256-prod-github-runner-207 kernel: [17998.407605] tick_sched_timer+0x8c/0xc0 Aug 22 10:23:44 juju-e4d256-prod-github-runner-207 kernel: [17998.408366] ? tick_nohz_handler+0xb0/0xb0 Aug 22 10:23:44 juju-e4d256-prod-github-runner-207 kernel: [17998.409127] __hrtimer_run_queues+0x107/0x230 Aug 22 10:23:44 juju-e4d256-prod-github-runner-207 kernel: [17998.409906] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 10:23:44 juju-e4d256-prod-github-runner-207 kernel: [17998.410693] hrtimer_interrupt+0x101/0x220 Aug 22 10:23:44 juju-e4d256-prod-github-runner-207 kernel: [17998.411469] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 10:23:44 juju-e4d256-prod-github-runner-207 kernel: [17998.412303] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 10:23:44 juju-e4d256-prod-github-runner-207 kernel: [17998.413113] Aug 22 10:23:44 juju-e4d256-prod-github-runner-207 kernel: [17998.413753] Aug 22 10:23:44 juju-e4d256-prod-github-runner-207 kernel: [17998.414386] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 10:23:44 juju-e4d256-prod-github-runner-207 kernel: [17998.415210] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:23:44 juju-e4d256-prod-github-runner-207 kernel: [17998.416100] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 10:23:44 juju-e4d256-prod-github-runner-207 kernel: [17998.418352] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 10:23:44 juju-e4d256-prod-github-runner-207 kernel: [17998.419257] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 10:23:44 juju-e4d256-prod-github-runner-207 kernel: [17998.420273] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 10:23:44 juju-e4d256-prod-github-runner-207 kernel: [17998.421264] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 10:23:44 juju-e4d256-prod-github-runner-207 kernel: [17998.422238] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 10:23:44 juju-e4d256-prod-github-runner-207 kernel: [17998.423205] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 10:23:44 juju-e4d256-prod-github-runner-207 kernel: [17998.424187] ? _raw_spin_lock+0x22/0x30 Aug 22 10:23:44 juju-e4d256-prod-github-runner-207 kernel: [17998.424955] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:23:44 juju-e4d256-prod-github-runner-207 kernel: [17998.425804] direct_page_fault+0x206/0x310 [kvm] Aug 22 10:23:44 juju-e4d256-prod-github-runner-207 kernel: [17998.426665] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 10:23:44 juju-e4d256-prod-github-runner-207 kernel: [17998.427502] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 10:23:44 juju-e4d256-prod-github-runner-207 kernel: [17998.428360] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 10:23:44 juju-e4d256-prod-github-runner-207 kernel: [17998.429178] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 10:23:44 juju-e4d256-prod-github-runner-207 kernel: [17998.429978] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 10:23:44 juju-e4d256-prod-github-runner-207 kernel: [17998.430832] handle_exit+0x98/0x230 [kvm_amd] Aug 22 10:23:44 juju-e4d256-prod-github-runner-207 kernel: [17998.431594] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 10:23:44 juju-e4d256-prod-github-runner-207 kernel: [17998.432407] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 10:23:44 juju-e4d256-prod-github-runner-207 kernel: [17998.433215] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 10:23:44 juju-e4d256-prod-github-runner-207 kernel: [17998.434012] vcpu_run+0x62/0x2c0 [kvm] Aug 22 10:23:44 juju-e4d256-prod-github-runner-207 kernel: [17998.434735] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 10:23:44 juju-e4d256-prod-github-runner-207 kernel: [17998.435475] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 10:23:44 juju-e4d256-prod-github-runner-207 kernel: [17998.436303] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 10:23:44 juju-e4d256-prod-github-runner-207 kernel: [17998.437084] ? __seccomp_filter+0x4a/0x4a0 Aug 22 10:23:44 juju-e4d256-prod-github-runner-207 kernel: [17998.437810] ? __fget_files+0x86/0xc0 Aug 22 10:23:44 juju-e4d256-prod-github-runner-207 kernel: [17998.438513] __x64_sys_ioctl+0x95/0xd0 Aug 22 10:23:44 juju-e4d256-prod-github-runner-207 kernel: [17998.439217] do_syscall_64+0x5c/0xc0 Aug 22 10:23:44 juju-e4d256-prod-github-runner-207 kernel: [17998.439902] ? do_futex+0x162/0x1f0 Aug 22 10:23:44 juju-e4d256-prod-github-runner-207 kernel: [17998.440594] ? __x64_sys_futex+0x78/0x1e0 Aug 22 10:23:44 juju-e4d256-prod-github-runner-207 kernel: [17998.441309] ? __secure_computing+0xa9/0x120 Aug 22 10:23:44 juju-e4d256-prod-github-runner-207 kernel: [17998.442033] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 10:23:44 juju-e4d256-prod-github-runner-207 kernel: [17998.442844] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:23:44 juju-e4d256-prod-github-runner-207 kernel: [17998.443613] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:23:44 juju-e4d256-prod-github-runner-207 kernel: [17998.444396] ? do_syscall_64+0x69/0xc0 Aug 22 10:23:44 juju-e4d256-prod-github-runner-207 kernel: [17998.445095] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:23:44 juju-e4d256-prod-github-runner-207 kernel: [17998.445858] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:23:44 juju-e4d256-prod-github-runner-207 kernel: [17998.446620] ? do_syscall_64+0x69/0xc0 Aug 22 10:23:44 juju-e4d256-prod-github-runner-207 kernel: [17998.447329] ? do_syscall_64+0x69/0xc0 Aug 22 10:23:44 juju-e4d256-prod-github-runner-207 kernel: [17998.448022] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 10:23:44 juju-e4d256-prod-github-runner-207 kernel: [17998.448817] RIP: 0033:0x7faa5d0edaff Aug 22 10:23:44 juju-e4d256-prod-github-runner-207 kernel: [17998.449527] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 10:23:44 juju-e4d256-prod-github-runner-207 kernel: [17998.451645] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 10:23:44 juju-e4d256-prod-github-runner-207 kernel: [17998.452643] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 10:23:44 juju-e4d256-prod-github-runner-207 kernel: [17998.453603] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 10:23:44 juju-e4d256-prod-github-runner-207 kernel: [17998.454562] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 10:23:44 juju-e4d256-prod-github-runner-207 kernel: [17998.455515] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 10:23:44 juju-e4d256-prod-github-runner-207 kernel: [17998.456455] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 10:23:44 juju-e4d256-prod-github-runner-207 kernel: [17998.457381] Aug 22 10:24:10 juju-e4d256-prod-github-runner-207 kernel: [18024.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 16678s! [qemu-system-x86:6715] Aug 22 10:24:10 juju-e4d256-prod-github-runner-207 kernel: [18024.543132] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 10:24:10 juju-e4d256-prod-github-runner-207 kernel: [18024.543203] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 10:24:10 juju-e4d256-prod-github-runner-207 kernel: [18024.555279] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 10:24:10 juju-e4d256-prod-github-runner-207 kernel: [18024.556575] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 10:24:10 juju-e4d256-prod-github-runner-207 kernel: [18024.557814] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:24:10 juju-e4d256-prod-github-runner-207 kernel: [18024.558871] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 10:24:10 juju-e4d256-prod-github-runner-207 kernel: [18024.561562] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 10:24:10 juju-e4d256-prod-github-runner-207 kernel: [18024.562600] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 10:24:10 juju-e4d256-prod-github-runner-207 kernel: [18024.563755] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 10:24:10 juju-e4d256-prod-github-runner-207 kernel: [18024.564918] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 10:24:10 juju-e4d256-prod-github-runner-207 kernel: [18024.566071] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 10:24:10 juju-e4d256-prod-github-runner-207 kernel: [18024.567249] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 10:24:10 juju-e4d256-prod-github-runner-207 kernel: [18024.568426] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 10:24:10 juju-e4d256-prod-github-runner-207 kernel: [18024.569660] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 10:24:10 juju-e4d256-prod-github-runner-207 kernel: [18024.570852] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 10:24:10 juju-e4d256-prod-github-runner-207 kernel: [18024.572092] Call Trace: Aug 22 10:24:10 juju-e4d256-prod-github-runner-207 kernel: [18024.573009] Aug 22 10:24:10 juju-e4d256-prod-github-runner-207 kernel: [18024.573892] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:24:10 juju-e4d256-prod-github-runner-207 kernel: [18024.574918] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:24:10 juju-e4d256-prod-github-runner-207 kernel: [18024.575957] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:24:10 juju-e4d256-prod-github-runner-207 kernel: [18024.577029] ? show_regs.part.0+0x23/0x29 Aug 22 10:24:10 juju-e4d256-prod-github-runner-207 kernel: [18024.578022] ? show_regs.cold+0x8/0xd Aug 22 10:24:10 juju-e4d256-prod-github-runner-207 kernel: [18024.578994] ? watchdog_timer_fn+0x1be/0x220 Aug 22 10:24:10 juju-e4d256-prod-github-runner-207 kernel: [18024.580009] ? lockup_detector_update_enable+0x60/0x60 Aug 22 10:24:10 juju-e4d256-prod-github-runner-207 kernel: [18024.581071] ? __hrtimer_run_queues+0x107/0x230 Aug 22 10:24:10 juju-e4d256-prod-github-runner-207 kernel: [18024.582108] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 10:24:10 juju-e4d256-prod-github-runner-207 kernel: [18024.583168] ? hrtimer_interrupt+0x101/0x220 Aug 22 10:24:10 juju-e4d256-prod-github-runner-207 kernel: [18024.584196] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 10:24:10 juju-e4d256-prod-github-runner-207 kernel: [18024.585261] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 10:24:10 juju-e4d256-prod-github-runner-207 kernel: [18024.586311] Aug 22 10:24:10 juju-e4d256-prod-github-runner-207 kernel: [18024.587170] Aug 22 10:24:10 juju-e4d256-prod-github-runner-207 kernel: [18024.588023] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 10:24:10 juju-e4d256-prod-github-runner-207 kernel: [18024.589052] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:24:10 juju-e4d256-prod-github-runner-207 kernel: [18024.590097] ? _raw_spin_lock+0x22/0x30 Aug 22 10:24:10 juju-e4d256-prod-github-runner-207 kernel: [18024.591083] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:24:10 juju-e4d256-prod-github-runner-207 kernel: [18024.592116] direct_page_fault+0x206/0x310 [kvm] Aug 22 10:24:10 juju-e4d256-prod-github-runner-207 kernel: [18024.593137] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 10:24:10 juju-e4d256-prod-github-runner-207 kernel: [18024.594158] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 10:24:10 juju-e4d256-prod-github-runner-207 kernel: [18024.595190] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 10:24:10 juju-e4d256-prod-github-runner-207 kernel: [18024.596208] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 10:24:10 juju-e4d256-prod-github-runner-207 kernel: [18024.597151] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 10:24:10 juju-e4d256-prod-github-runner-207 kernel: [18024.598126] handle_exit+0x98/0x230 [kvm_amd] Aug 22 10:24:10 juju-e4d256-prod-github-runner-207 kernel: [18024.599016] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 10:24:10 juju-e4d256-prod-github-runner-207 kernel: [18024.599939] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 10:24:10 juju-e4d256-prod-github-runner-207 kernel: [18024.600865] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 10:24:10 juju-e4d256-prod-github-runner-207 kernel: [18024.601766] vcpu_run+0x62/0x2c0 [kvm] Aug 22 10:24:10 juju-e4d256-prod-github-runner-207 kernel: [18024.602574] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 10:24:10 juju-e4d256-prod-github-runner-207 kernel: [18024.603378] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 10:24:10 juju-e4d256-prod-github-runner-207 kernel: [18024.604248] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 10:24:10 juju-e4d256-prod-github-runner-207 kernel: [18024.605042] ? __seccomp_filter+0x4a/0x4a0 Aug 22 10:24:10 juju-e4d256-prod-github-runner-207 kernel: [18024.605782] ? __fget_files+0x86/0xc0 Aug 22 10:24:10 juju-e4d256-prod-github-runner-207 kernel: [18024.606484] __x64_sys_ioctl+0x95/0xd0 Aug 22 10:24:10 juju-e4d256-prod-github-runner-207 kernel: [18024.607173] do_syscall_64+0x5c/0xc0 Aug 22 10:24:10 juju-e4d256-prod-github-runner-207 kernel: [18024.607834] ? do_futex+0x162/0x1f0 Aug 22 10:24:10 juju-e4d256-prod-github-runner-207 kernel: [18024.608488] ? __x64_sys_futex+0x78/0x1e0 Aug 22 10:24:10 juju-e4d256-prod-github-runner-207 kernel: [18024.609159] ? __secure_computing+0xa9/0x120 Aug 22 10:24:10 juju-e4d256-prod-github-runner-207 kernel: [18024.609845] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 10:24:10 juju-e4d256-prod-github-runner-207 kernel: [18024.610618] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:24:10 juju-e4d256-prod-github-runner-207 kernel: [18024.611342] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:24:10 juju-e4d256-prod-github-runner-207 kernel: [18024.612075] ? do_syscall_64+0x69/0xc0 Aug 22 10:24:10 juju-e4d256-prod-github-runner-207 kernel: [18024.612750] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:24:10 juju-e4d256-prod-github-runner-207 kernel: [18024.613450] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:24:10 juju-e4d256-prod-github-runner-207 kernel: [18024.614146] ? do_syscall_64+0x69/0xc0 Aug 22 10:24:10 juju-e4d256-prod-github-runner-207 kernel: [18024.614767] ? do_syscall_64+0x69/0xc0 Aug 22 10:24:10 juju-e4d256-prod-github-runner-207 kernel: [18024.615386] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 10:24:10 juju-e4d256-prod-github-runner-207 kernel: [18024.616097] RIP: 0033:0x7faa5d0edaff Aug 22 10:24:10 juju-e4d256-prod-github-runner-207 kernel: [18024.616721] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 10:24:10 juju-e4d256-prod-github-runner-207 kernel: [18024.618735] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 10:24:10 juju-e4d256-prod-github-runner-207 kernel: [18024.619645] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 10:24:10 juju-e4d256-prod-github-runner-207 kernel: [18024.620546] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 10:24:10 juju-e4d256-prod-github-runner-207 kernel: [18024.621437] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 10:24:10 juju-e4d256-prod-github-runner-207 kernel: [18024.622319] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 10:24:10 juju-e4d256-prod-github-runner-207 kernel: [18024.623203] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 10:24:10 juju-e4d256-prod-github-runner-207 kernel: [18024.624100] Aug 22 10:24:38 juju-e4d256-prod-github-runner-207 kernel: [18052.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 16704s! [qemu-system-x86:6715] Aug 22 10:24:38 juju-e4d256-prod-github-runner-207 kernel: [18052.543120] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 10:24:38 juju-e4d256-prod-github-runner-207 kernel: [18052.543192] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 10:24:38 juju-e4d256-prod-github-runner-207 kernel: [18052.555295] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 10:24:38 juju-e4d256-prod-github-runner-207 kernel: [18052.556567] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 10:24:38 juju-e4d256-prod-github-runner-207 kernel: [18052.557792] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:24:38 juju-e4d256-prod-github-runner-207 kernel: [18052.558847] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 10:24:38 juju-e4d256-prod-github-runner-207 kernel: [18052.561421] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 10:24:38 juju-e4d256-prod-github-runner-207 kernel: [18052.562588] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 10:24:38 juju-e4d256-prod-github-runner-207 kernel: [18052.563916] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 10:24:38 juju-e4d256-prod-github-runner-207 kernel: [18052.565213] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 10:24:38 juju-e4d256-prod-github-runner-207 kernel: [18052.566507] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 10:24:38 juju-e4d256-prod-github-runner-207 kernel: [18052.567819] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 10:24:38 juju-e4d256-prod-github-runner-207 kernel: [18052.569114] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 10:24:38 juju-e4d256-prod-github-runner-207 kernel: [18052.570496] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 10:24:38 juju-e4d256-prod-github-runner-207 kernel: [18052.571709] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 10:24:38 juju-e4d256-prod-github-runner-207 kernel: [18052.573038] Call Trace: Aug 22 10:24:38 juju-e4d256-prod-github-runner-207 kernel: [18052.574004] Aug 22 10:24:38 juju-e4d256-prod-github-runner-207 kernel: [18052.574935] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:24:38 juju-e4d256-prod-github-runner-207 kernel: [18052.576067] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:24:38 juju-e4d256-prod-github-runner-207 kernel: [18052.577314] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:24:38 juju-e4d256-prod-github-runner-207 kernel: [18052.578476] ? show_regs.part.0+0x23/0x29 Aug 22 10:24:38 juju-e4d256-prod-github-runner-207 kernel: [18052.579570] ? show_regs.cold+0x8/0xd Aug 22 10:24:38 juju-e4d256-prod-github-runner-207 kernel: [18052.580633] ? watchdog_timer_fn+0x1be/0x220 Aug 22 10:24:38 juju-e4d256-prod-github-runner-207 kernel: [18052.581911] ? lockup_detector_update_enable+0x60/0x60 Aug 22 10:24:38 juju-e4d256-prod-github-runner-207 kernel: [18052.583077] ? __hrtimer_run_queues+0x107/0x230 Aug 22 10:24:38 juju-e4d256-prod-github-runner-207 kernel: [18052.584213] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 10:24:38 juju-e4d256-prod-github-runner-207 kernel: [18052.585329] ? hrtimer_interrupt+0x101/0x220 Aug 22 10:24:38 juju-e4d256-prod-github-runner-207 kernel: [18052.586505] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 10:24:38 juju-e4d256-prod-github-runner-207 kernel: [18052.587690] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 10:24:38 juju-e4d256-prod-github-runner-207 kernel: [18052.588841] Aug 22 10:24:38 juju-e4d256-prod-github-runner-207 kernel: [18052.589771] Aug 22 10:24:38 juju-e4d256-prod-github-runner-207 kernel: [18052.590660] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 10:24:38 juju-e4d256-prod-github-runner-207 kernel: [18052.591804] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:24:38 juju-e4d256-prod-github-runner-207 kernel: [18052.592981] ? _raw_spin_lock+0x22/0x30 Aug 22 10:24:38 juju-e4d256-prod-github-runner-207 kernel: [18052.594029] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:24:38 juju-e4d256-prod-github-runner-207 kernel: [18052.595142] direct_page_fault+0x206/0x310 [kvm] Aug 22 10:24:38 juju-e4d256-prod-github-runner-207 kernel: [18052.596316] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 10:24:38 juju-e4d256-prod-github-runner-207 kernel: [18052.597421] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 10:24:38 juju-e4d256-prod-github-runner-207 kernel: [18052.598510] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 10:24:38 juju-e4d256-prod-github-runner-207 kernel: [18052.599581] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 10:24:38 juju-e4d256-prod-github-runner-207 kernel: [18052.600616] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 10:24:38 juju-e4d256-prod-github-runner-207 kernel: [18052.601699] handle_exit+0x98/0x230 [kvm_amd] Aug 22 10:24:38 juju-e4d256-prod-github-runner-207 kernel: [18052.602675] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 10:24:38 juju-e4d256-prod-github-runner-207 kernel: [18052.603696] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 10:24:38 juju-e4d256-prod-github-runner-207 kernel: [18052.604720] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 10:24:38 juju-e4d256-prod-github-runner-207 kernel: [18052.605716] vcpu_run+0x62/0x2c0 [kvm] Aug 22 10:24:38 juju-e4d256-prod-github-runner-207 kernel: [18052.606610] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 10:24:38 juju-e4d256-prod-github-runner-207 kernel: [18052.607504] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 10:24:38 juju-e4d256-prod-github-runner-207 kernel: [18052.608484] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 10:24:38 juju-e4d256-prod-github-runner-207 kernel: [18052.609365] ? __seccomp_filter+0x4a/0x4a0 Aug 22 10:24:38 juju-e4d256-prod-github-runner-207 kernel: [18052.610184] ? __fget_files+0x86/0xc0 Aug 22 10:24:38 juju-e4d256-prod-github-runner-207 kernel: [18052.610963] __x64_sys_ioctl+0x95/0xd0 Aug 22 10:24:38 juju-e4d256-prod-github-runner-207 kernel: [18052.611741] do_syscall_64+0x5c/0xc0 Aug 22 10:24:38 juju-e4d256-prod-github-runner-207 kernel: [18052.612475] ? do_futex+0x162/0x1f0 Aug 22 10:24:38 juju-e4d256-prod-github-runner-207 kernel: [18052.613191] ? __x64_sys_futex+0x78/0x1e0 Aug 22 10:24:38 juju-e4d256-prod-github-runner-207 kernel: [18052.613946] ? __secure_computing+0xa9/0x120 Aug 22 10:24:38 juju-e4d256-prod-github-runner-207 kernel: [18052.614718] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 10:24:38 juju-e4d256-prod-github-runner-207 kernel: [18052.615599] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:24:38 juju-e4d256-prod-github-runner-207 kernel: [18052.616411] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:24:38 juju-e4d256-prod-github-runner-207 kernel: [18052.617229] ? do_syscall_64+0x69/0xc0 Aug 22 10:24:38 juju-e4d256-prod-github-runner-207 kernel: [18052.617947] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:24:38 juju-e4d256-prod-github-runner-207 kernel: [18052.618737] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:24:38 juju-e4d256-prod-github-runner-207 kernel: [18052.619525] ? do_syscall_64+0x69/0xc0 Aug 22 10:24:38 juju-e4d256-prod-github-runner-207 kernel: [18052.620245] ? do_syscall_64+0x69/0xc0 Aug 22 10:24:38 juju-e4d256-prod-github-runner-207 kernel: [18052.620939] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 10:24:38 juju-e4d256-prod-github-runner-207 kernel: [18052.621744] RIP: 0033:0x7faa5d0edaff Aug 22 10:24:38 juju-e4d256-prod-github-runner-207 kernel: [18052.622437] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 10:24:38 juju-e4d256-prod-github-runner-207 kernel: [18052.624775] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 10:24:38 juju-e4d256-prod-github-runner-207 kernel: [18052.625876] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 10:24:38 juju-e4d256-prod-github-runner-207 kernel: [18052.626906] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 10:24:38 juju-e4d256-prod-github-runner-207 kernel: [18052.627938] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 10:24:38 juju-e4d256-prod-github-runner-207 kernel: [18052.628963] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 10:24:38 juju-e4d256-prod-github-runner-207 kernel: [18052.629986] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 10:24:38 juju-e4d256-prod-github-runner-207 kernel: [18052.631014] Aug 22 10:25:06 juju-e4d256-prod-github-runner-207 kernel: [18080.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 16730s! [qemu-system-x86:6715] Aug 22 10:25:06 juju-e4d256-prod-github-runner-207 kernel: [18080.543837] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 10:25:06 juju-e4d256-prod-github-runner-207 kernel: [18080.544083] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 10:25:06 juju-e4d256-prod-github-runner-207 kernel: [18080.556388] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 10:25:06 juju-e4d256-prod-github-runner-207 kernel: [18080.557664] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 10:25:06 juju-e4d256-prod-github-runner-207 kernel: [18080.558886] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:25:06 juju-e4d256-prod-github-runner-207 kernel: [18080.559994] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 10:25:06 juju-e4d256-prod-github-runner-207 kernel: [18080.562556] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 10:25:06 juju-e4d256-prod-github-runner-207 kernel: [18080.563676] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 10:25:06 juju-e4d256-prod-github-runner-207 kernel: [18080.564840] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 10:25:06 juju-e4d256-prod-github-runner-207 kernel: [18080.566001] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 10:25:06 juju-e4d256-prod-github-runner-207 kernel: [18080.567171] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 10:25:06 juju-e4d256-prod-github-runner-207 kernel: [18080.568573] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 10:25:06 juju-e4d256-prod-github-runner-207 kernel: [18080.569745] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 10:25:06 juju-e4d256-prod-github-runner-207 kernel: [18080.570985] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 10:25:06 juju-e4d256-prod-github-runner-207 kernel: [18080.572143] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 10:25:06 juju-e4d256-prod-github-runner-207 kernel: [18080.573342] Call Trace: Aug 22 10:25:06 juju-e4d256-prod-github-runner-207 kernel: [18080.574260] Aug 22 10:25:06 juju-e4d256-prod-github-runner-207 kernel: [18080.575155] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:25:06 juju-e4d256-prod-github-runner-207 kernel: [18080.576250] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:25:06 juju-e4d256-prod-github-runner-207 kernel: [18080.577276] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:25:06 juju-e4d256-prod-github-runner-207 kernel: [18080.578371] ? show_regs.part.0+0x23/0x29 Aug 22 10:25:06 juju-e4d256-prod-github-runner-207 kernel: [18080.579429] ? show_regs.cold+0x8/0xd Aug 22 10:25:06 juju-e4d256-prod-github-runner-207 kernel: [18080.580420] ? watchdog_timer_fn+0x1be/0x220 Aug 22 10:25:06 juju-e4d256-prod-github-runner-207 kernel: [18080.581429] ? lockup_detector_update_enable+0x60/0x60 Aug 22 10:25:06 juju-e4d256-prod-github-runner-207 kernel: [18080.582497] ? __hrtimer_run_queues+0x107/0x230 Aug 22 10:25:06 juju-e4d256-prod-github-runner-207 kernel: [18080.583641] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 10:25:06 juju-e4d256-prod-github-runner-207 kernel: [18080.584668] ? hrtimer_interrupt+0x101/0x220 Aug 22 10:25:06 juju-e4d256-prod-github-runner-207 kernel: [18080.585684] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 10:25:06 juju-e4d256-prod-github-runner-207 kernel: [18080.586751] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 10:25:06 juju-e4d256-prod-github-runner-207 kernel: [18080.587892] Aug 22 10:25:06 juju-e4d256-prod-github-runner-207 kernel: [18080.588754] Aug 22 10:25:06 juju-e4d256-prod-github-runner-207 kernel: [18080.589591] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 10:25:06 juju-e4d256-prod-github-runner-207 kernel: [18080.590628] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:25:06 juju-e4d256-prod-github-runner-207 kernel: [18080.591751] ? _raw_spin_lock+0x22/0x30 Aug 22 10:25:06 juju-e4d256-prod-github-runner-207 kernel: [18080.592706] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:25:06 juju-e4d256-prod-github-runner-207 kernel: [18080.593731] direct_page_fault+0x206/0x310 [kvm] Aug 22 10:25:06 juju-e4d256-prod-github-runner-207 kernel: [18080.594756] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 10:25:06 juju-e4d256-prod-github-runner-207 kernel: [18080.595854] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 10:25:06 juju-e4d256-prod-github-runner-207 kernel: [18080.596864] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 10:25:06 juju-e4d256-prod-github-runner-207 kernel: [18080.597857] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 10:25:06 juju-e4d256-prod-github-runner-207 kernel: [18080.598808] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 10:25:06 juju-e4d256-prod-github-runner-207 kernel: [18080.599854] handle_exit+0x98/0x230 [kvm_amd] Aug 22 10:25:06 juju-e4d256-prod-github-runner-207 kernel: [18080.600760] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 10:25:06 juju-e4d256-prod-github-runner-207 kernel: [18080.601673] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 10:25:06 juju-e4d256-prod-github-runner-207 kernel: [18080.602603] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 10:25:06 juju-e4d256-prod-github-runner-207 kernel: [18080.603593] vcpu_run+0x62/0x2c0 [kvm] Aug 22 10:25:06 juju-e4d256-prod-github-runner-207 kernel: [18080.604565] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 10:25:06 juju-e4d256-prod-github-runner-207 kernel: [18080.605374] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 10:25:06 juju-e4d256-prod-github-runner-207 kernel: [18080.606233] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 10:25:06 juju-e4d256-prod-github-runner-207 kernel: [18080.607034] ? __seccomp_filter+0x4a/0x4a0 Aug 22 10:25:06 juju-e4d256-prod-github-runner-207 kernel: [18080.607854] ? __fget_files+0x86/0xc0 Aug 22 10:25:06 juju-e4d256-prod-github-runner-207 kernel: [18080.608565] __x64_sys_ioctl+0x95/0xd0 Aug 22 10:25:06 juju-e4d256-prod-github-runner-207 kernel: [18080.609264] do_syscall_64+0x5c/0xc0 Aug 22 10:25:06 juju-e4d256-prod-github-runner-207 kernel: [18080.609927] ? do_futex+0x162/0x1f0 Aug 22 10:25:06 juju-e4d256-prod-github-runner-207 kernel: [18080.610574] ? __x64_sys_futex+0x78/0x1e0 Aug 22 10:25:06 juju-e4d256-prod-github-runner-207 kernel: [18080.611265] ? __secure_computing+0xa9/0x120 Aug 22 10:25:06 juju-e4d256-prod-github-runner-207 kernel: [18080.611996] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 10:25:06 juju-e4d256-prod-github-runner-207 kernel: [18080.612768] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:25:06 juju-e4d256-prod-github-runner-207 kernel: [18080.613488] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:25:06 juju-e4d256-prod-github-runner-207 kernel: [18080.614207] ? do_syscall_64+0x69/0xc0 Aug 22 10:25:06 juju-e4d256-prod-github-runner-207 kernel: [18080.614849] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:25:06 juju-e4d256-prod-github-runner-207 kernel: [18080.615614] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:25:06 juju-e4d256-prod-github-runner-207 kernel: [18080.616317] ? do_syscall_64+0x69/0xc0 Aug 22 10:25:06 juju-e4d256-prod-github-runner-207 kernel: [18080.616940] ? do_syscall_64+0x69/0xc0 Aug 22 10:25:06 juju-e4d256-prod-github-runner-207 kernel: [18080.617562] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 10:25:06 juju-e4d256-prod-github-runner-207 kernel: [18080.618322] RIP: 0033:0x7faa5d0edaff Aug 22 10:25:06 juju-e4d256-prod-github-runner-207 kernel: [18080.618963] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 10:25:06 juju-e4d256-prod-github-runner-207 kernel: [18080.621028] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 10:25:06 juju-e4d256-prod-github-runner-207 kernel: [18080.621946] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 10:25:06 juju-e4d256-prod-github-runner-207 kernel: [18080.622842] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 10:25:06 juju-e4d256-prod-github-runner-207 kernel: [18080.623788] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 10:25:06 juju-e4d256-prod-github-runner-207 kernel: [18080.624684] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 10:25:06 juju-e4d256-prod-github-runner-207 kernel: [18080.625579] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 10:25:06 juju-e4d256-prod-github-runner-207 kernel: [18080.626470] Aug 22 10:25:34 juju-e4d256-prod-github-runner-207 kernel: [18108.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 16756s! [qemu-system-x86:6715] Aug 22 10:25:34 juju-e4d256-prod-github-runner-207 kernel: [18108.543117] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 10:25:34 juju-e4d256-prod-github-runner-207 kernel: [18108.543186] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 10:25:34 juju-e4d256-prod-github-runner-207 kernel: [18108.555214] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 10:25:34 juju-e4d256-prod-github-runner-207 kernel: [18108.556487] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 10:25:34 juju-e4d256-prod-github-runner-207 kernel: [18108.557709] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:25:34 juju-e4d256-prod-github-runner-207 kernel: [18108.558769] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 10:25:34 juju-e4d256-prod-github-runner-207 kernel: [18108.561320] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 10:25:34 juju-e4d256-prod-github-runner-207 kernel: [18108.562361] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 10:25:34 juju-e4d256-prod-github-runner-207 kernel: [18108.563526] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 10:25:34 juju-e4d256-prod-github-runner-207 kernel: [18108.564687] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 10:25:34 juju-e4d256-prod-github-runner-207 kernel: [18108.565847] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 10:25:34 juju-e4d256-prod-github-runner-207 kernel: [18108.567023] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 10:25:34 juju-e4d256-prod-github-runner-207 kernel: [18108.568193] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 10:25:34 juju-e4d256-prod-github-runner-207 kernel: [18108.569427] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 10:25:34 juju-e4d256-prod-github-runner-207 kernel: [18108.570526] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 10:25:34 juju-e4d256-prod-github-runner-207 kernel: [18108.571733] Call Trace: Aug 22 10:25:34 juju-e4d256-prod-github-runner-207 kernel: [18108.572643] Aug 22 10:25:34 juju-e4d256-prod-github-runner-207 kernel: [18108.573531] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:25:34 juju-e4d256-prod-github-runner-207 kernel: [18108.574560] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:25:34 juju-e4d256-prod-github-runner-207 kernel: [18108.575586] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:25:34 juju-e4d256-prod-github-runner-207 kernel: [18108.576664] ? show_regs.part.0+0x23/0x29 Aug 22 10:25:34 juju-e4d256-prod-github-runner-207 kernel: [18108.577660] ? show_regs.cold+0x8/0xd Aug 22 10:25:34 juju-e4d256-prod-github-runner-207 kernel: [18108.578629] ? watchdog_timer_fn+0x1be/0x220 Aug 22 10:25:34 juju-e4d256-prod-github-runner-207 kernel: [18108.579642] ? lockup_detector_update_enable+0x60/0x60 Aug 22 10:25:34 juju-e4d256-prod-github-runner-207 kernel: [18108.580707] ? __hrtimer_run_queues+0x107/0x230 Aug 22 10:25:34 juju-e4d256-prod-github-runner-207 kernel: [18108.581731] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 10:25:34 juju-e4d256-prod-github-runner-207 kernel: [18108.582751] ? hrtimer_interrupt+0x101/0x220 Aug 22 10:25:34 juju-e4d256-prod-github-runner-207 kernel: [18108.583776] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 10:25:34 juju-e4d256-prod-github-runner-207 kernel: [18108.584839] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 10:25:34 juju-e4d256-prod-github-runner-207 kernel: [18108.585880] Aug 22 10:25:34 juju-e4d256-prod-github-runner-207 kernel: [18108.586737] Aug 22 10:25:34 juju-e4d256-prod-github-runner-207 kernel: [18108.587584] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 10:25:34 juju-e4d256-prod-github-runner-207 kernel: [18108.588626] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:25:34 juju-e4d256-prod-github-runner-207 kernel: [18108.589668] ? _raw_spin_lock+0x22/0x30 Aug 22 10:25:34 juju-e4d256-prod-github-runner-207 kernel: [18108.590615] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:25:34 juju-e4d256-prod-github-runner-207 kernel: [18108.591641] direct_page_fault+0x206/0x310 [kvm] Aug 22 10:25:34 juju-e4d256-prod-github-runner-207 kernel: [18108.592663] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 10:25:34 juju-e4d256-prod-github-runner-207 kernel: [18108.593674] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 10:25:34 juju-e4d256-prod-github-runner-207 kernel: [18108.594670] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 10:25:34 juju-e4d256-prod-github-runner-207 kernel: [18108.595648] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 10:25:34 juju-e4d256-prod-github-runner-207 kernel: [18108.596595] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 10:25:34 juju-e4d256-prod-github-runner-207 kernel: [18108.597570] handle_exit+0x98/0x230 [kvm_amd] Aug 22 10:25:34 juju-e4d256-prod-github-runner-207 kernel: [18108.598466] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 10:25:34 juju-e4d256-prod-github-runner-207 kernel: [18108.599424] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 10:25:34 juju-e4d256-prod-github-runner-207 kernel: [18108.600361] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 10:25:34 juju-e4d256-prod-github-runner-207 kernel: [18108.601264] vcpu_run+0x62/0x2c0 [kvm] Aug 22 10:25:34 juju-e4d256-prod-github-runner-207 kernel: [18108.602074] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 10:25:34 juju-e4d256-prod-github-runner-207 kernel: [18108.602908] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 10:25:34 juju-e4d256-prod-github-runner-207 kernel: [18108.603762] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 10:25:34 juju-e4d256-prod-github-runner-207 kernel: [18108.604558] ? __seccomp_filter+0x4a/0x4a0 Aug 22 10:25:34 juju-e4d256-prod-github-runner-207 kernel: [18108.605303] ? __fget_files+0x86/0xc0 Aug 22 10:25:34 juju-e4d256-prod-github-runner-207 kernel: [18108.606012] __x64_sys_ioctl+0x95/0xd0 Aug 22 10:25:34 juju-e4d256-prod-github-runner-207 kernel: [18108.606706] do_syscall_64+0x5c/0xc0 Aug 22 10:25:34 juju-e4d256-prod-github-runner-207 kernel: [18108.607380] ? do_futex+0x162/0x1f0 Aug 22 10:25:34 juju-e4d256-prod-github-runner-207 kernel: [18108.608029] ? __x64_sys_futex+0x78/0x1e0 Aug 22 10:25:34 juju-e4d256-prod-github-runner-207 kernel: [18108.608707] ? __secure_computing+0xa9/0x120 Aug 22 10:25:34 juju-e4d256-prod-github-runner-207 kernel: [18108.609415] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 10:25:34 juju-e4d256-prod-github-runner-207 kernel: [18108.610174] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:25:34 juju-e4d256-prod-github-runner-207 kernel: [18108.610912] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:25:34 juju-e4d256-prod-github-runner-207 kernel: [18108.611631] ? do_syscall_64+0x69/0xc0 Aug 22 10:25:34 juju-e4d256-prod-github-runner-207 kernel: [18108.612277] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:25:34 juju-e4d256-prod-github-runner-207 kernel: [18108.612986] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:25:34 juju-e4d256-prod-github-runner-207 kernel: [18108.613688] ? do_syscall_64+0x69/0xc0 Aug 22 10:25:34 juju-e4d256-prod-github-runner-207 kernel: [18108.614314] ? do_syscall_64+0x69/0xc0 Aug 22 10:25:34 juju-e4d256-prod-github-runner-207 kernel: [18108.614952] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 10:25:34 juju-e4d256-prod-github-runner-207 kernel: [18108.615659] RIP: 0033:0x7faa5d0edaff Aug 22 10:25:34 juju-e4d256-prod-github-runner-207 kernel: [18108.616286] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 10:25:34 juju-e4d256-prod-github-runner-207 kernel: [18108.618281] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 10:25:34 juju-e4d256-prod-github-runner-207 kernel: [18108.619211] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 10:25:34 juju-e4d256-prod-github-runner-207 kernel: [18108.620100] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 10:25:34 juju-e4d256-prod-github-runner-207 kernel: [18108.620987] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 10:25:34 juju-e4d256-prod-github-runner-207 kernel: [18108.621873] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 10:25:34 juju-e4d256-prod-github-runner-207 kernel: [18108.622759] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 10:25:34 juju-e4d256-prod-github-runner-207 kernel: [18108.623675] Aug 22 10:26:02 juju-e4d256-prod-github-runner-207 kernel: [18136.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 16782s! [qemu-system-x86:6715] Aug 22 10:26:02 juju-e4d256-prod-github-runner-207 kernel: [18136.543117] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 10:26:02 juju-e4d256-prod-github-runner-207 kernel: [18136.543185] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 10:26:02 juju-e4d256-prod-github-runner-207 kernel: [18136.555274] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 10:26:02 juju-e4d256-prod-github-runner-207 kernel: [18136.556550] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 10:26:02 juju-e4d256-prod-github-runner-207 kernel: [18136.557771] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:26:02 juju-e4d256-prod-github-runner-207 kernel: [18136.558861] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 10:26:02 juju-e4d256-prod-github-runner-207 kernel: [18136.561405] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 10:26:02 juju-e4d256-prod-github-runner-207 kernel: [18136.562445] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 10:26:02 juju-e4d256-prod-github-runner-207 kernel: [18136.563629] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 10:26:02 juju-e4d256-prod-github-runner-207 kernel: [18136.564795] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 10:26:02 juju-e4d256-prod-github-runner-207 kernel: [18136.565971] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 10:26:02 juju-e4d256-prod-github-runner-207 kernel: [18136.567164] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 10:26:02 juju-e4d256-prod-github-runner-207 kernel: [18136.568332] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 10:26:02 juju-e4d256-prod-github-runner-207 kernel: [18136.569564] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 10:26:02 juju-e4d256-prod-github-runner-207 kernel: [18136.570674] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 10:26:02 juju-e4d256-prod-github-runner-207 kernel: [18136.571867] Call Trace: Aug 22 10:26:02 juju-e4d256-prod-github-runner-207 kernel: [18136.572775] Aug 22 10:26:02 juju-e4d256-prod-github-runner-207 kernel: [18136.573656] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:26:02 juju-e4d256-prod-github-runner-207 kernel: [18136.574699] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:26:02 juju-e4d256-prod-github-runner-207 kernel: [18136.575718] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:26:02 juju-e4d256-prod-github-runner-207 kernel: [18136.576798] ? show_regs.part.0+0x23/0x29 Aug 22 10:26:02 juju-e4d256-prod-github-runner-207 kernel: [18136.577796] ? show_regs.cold+0x8/0xd Aug 22 10:26:02 juju-e4d256-prod-github-runner-207 kernel: [18136.578791] ? watchdog_timer_fn+0x1be/0x220 Aug 22 10:26:02 juju-e4d256-prod-github-runner-207 kernel: [18136.579803] ? lockup_detector_update_enable+0x60/0x60 Aug 22 10:26:02 juju-e4d256-prod-github-runner-207 kernel: [18136.580879] ? __hrtimer_run_queues+0x107/0x230 Aug 22 10:26:02 juju-e4d256-prod-github-runner-207 kernel: [18136.581912] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 10:26:02 juju-e4d256-prod-github-runner-207 kernel: [18136.582946] ? hrtimer_interrupt+0x101/0x220 Aug 22 10:26:02 juju-e4d256-prod-github-runner-207 kernel: [18136.583969] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 10:26:02 juju-e4d256-prod-github-runner-207 kernel: [18136.585035] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 10:26:02 juju-e4d256-prod-github-runner-207 kernel: [18136.586076] Aug 22 10:26:02 juju-e4d256-prod-github-runner-207 kernel: [18136.586948] Aug 22 10:26:02 juju-e4d256-prod-github-runner-207 kernel: [18136.587783] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 10:26:02 juju-e4d256-prod-github-runner-207 kernel: [18136.588809] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:26:02 juju-e4d256-prod-github-runner-207 kernel: [18136.589842] ? _raw_spin_lock+0x22/0x30 Aug 22 10:26:02 juju-e4d256-prod-github-runner-207 kernel: [18136.590803] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:26:02 juju-e4d256-prod-github-runner-207 kernel: [18136.591819] direct_page_fault+0x206/0x310 [kvm] Aug 22 10:26:02 juju-e4d256-prod-github-runner-207 kernel: [18136.592837] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 10:26:02 juju-e4d256-prod-github-runner-207 kernel: [18136.593846] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 10:26:02 juju-e4d256-prod-github-runner-207 kernel: [18136.594872] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 10:26:02 juju-e4d256-prod-github-runner-207 kernel: [18136.595839] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 10:26:02 juju-e4d256-prod-github-runner-207 kernel: [18136.596786] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 10:26:02 juju-e4d256-prod-github-runner-207 kernel: [18136.597761] handle_exit+0x98/0x230 [kvm_amd] Aug 22 10:26:02 juju-e4d256-prod-github-runner-207 kernel: [18136.598665] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 10:26:02 juju-e4d256-prod-github-runner-207 kernel: [18136.599577] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 10:26:02 juju-e4d256-prod-github-runner-207 kernel: [18136.600503] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 10:26:02 juju-e4d256-prod-github-runner-207 kernel: [18136.601402] vcpu_run+0x62/0x2c0 [kvm] Aug 22 10:26:02 juju-e4d256-prod-github-runner-207 kernel: [18136.602208] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 10:26:02 juju-e4d256-prod-github-runner-207 kernel: [18136.603030] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 10:26:02 juju-e4d256-prod-github-runner-207 kernel: [18136.603885] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 10:26:02 juju-e4d256-prod-github-runner-207 kernel: [18136.604678] ? __seccomp_filter+0x4a/0x4a0 Aug 22 10:26:02 juju-e4d256-prod-github-runner-207 kernel: [18136.605418] ? __fget_files+0x86/0xc0 Aug 22 10:26:02 juju-e4d256-prod-github-runner-207 kernel: [18136.606123] __x64_sys_ioctl+0x95/0xd0 Aug 22 10:26:02 juju-e4d256-prod-github-runner-207 kernel: [18136.606830] do_syscall_64+0x5c/0xc0 Aug 22 10:26:02 juju-e4d256-prod-github-runner-207 kernel: [18136.607491] ? do_futex+0x162/0x1f0 Aug 22 10:26:02 juju-e4d256-prod-github-runner-207 kernel: [18136.608135] ? __x64_sys_futex+0x78/0x1e0 Aug 22 10:26:02 juju-e4d256-prod-github-runner-207 kernel: [18136.608804] ? __secure_computing+0xa9/0x120 Aug 22 10:26:02 juju-e4d256-prod-github-runner-207 kernel: [18136.609489] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 10:26:02 juju-e4d256-prod-github-runner-207 kernel: [18136.610243] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:26:02 juju-e4d256-prod-github-runner-207 kernel: [18136.610975] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:26:02 juju-e4d256-prod-github-runner-207 kernel: [18136.611687] ? do_syscall_64+0x69/0xc0 Aug 22 10:26:02 juju-e4d256-prod-github-runner-207 kernel: [18136.612328] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:26:02 juju-e4d256-prod-github-runner-207 kernel: [18136.613030] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:26:02 juju-e4d256-prod-github-runner-207 kernel: [18136.613722] ? do_syscall_64+0x69/0xc0 Aug 22 10:26:02 juju-e4d256-prod-github-runner-207 kernel: [18136.614342] ? do_syscall_64+0x69/0xc0 Aug 22 10:26:02 juju-e4d256-prod-github-runner-207 kernel: [18136.614974] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 10:26:02 juju-e4d256-prod-github-runner-207 kernel: [18136.615676] RIP: 0033:0x7faa5d0edaff Aug 22 10:26:02 juju-e4d256-prod-github-runner-207 kernel: [18136.616298] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 10:26:02 juju-e4d256-prod-github-runner-207 kernel: [18136.618271] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 10:26:02 juju-e4d256-prod-github-runner-207 kernel: [18136.619364] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 10:26:02 juju-e4d256-prod-github-runner-207 kernel: [18136.620253] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 10:26:02 juju-e4d256-prod-github-runner-207 kernel: [18136.621139] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 10:26:02 juju-e4d256-prod-github-runner-207 kernel: [18136.622025] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 10:26:02 juju-e4d256-prod-github-runner-207 kernel: [18136.622923] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 10:26:02 juju-e4d256-prod-github-runner-207 kernel: [18136.623814] Aug 22 10:26:30 juju-e4d256-prod-github-runner-207 kernel: [18164.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 16809s! [qemu-system-x86:6715] Aug 22 10:26:30 juju-e4d256-prod-github-runner-207 kernel: [18164.543752] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 10:26:30 juju-e4d256-prod-github-runner-207 kernel: [18164.544009] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 10:26:30 juju-e4d256-prod-github-runner-207 kernel: [18164.556095] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 10:26:30 juju-e4d256-prod-github-runner-207 kernel: [18164.557372] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 10:26:30 juju-e4d256-prod-github-runner-207 kernel: [18164.558602] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:26:30 juju-e4d256-prod-github-runner-207 kernel: [18164.559663] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 10:26:30 juju-e4d256-prod-github-runner-207 kernel: [18164.562220] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 10:26:30 juju-e4d256-prod-github-runner-207 kernel: [18164.563272] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 10:26:30 juju-e4d256-prod-github-runner-207 kernel: [18164.564437] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 10:26:30 juju-e4d256-prod-github-runner-207 kernel: [18164.565601] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 10:26:30 juju-e4d256-prod-github-runner-207 kernel: [18164.566773] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 10:26:30 juju-e4d256-prod-github-runner-207 kernel: [18164.567934] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 10:26:30 juju-e4d256-prod-github-runner-207 kernel: [18164.569103] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 10:26:30 juju-e4d256-prod-github-runner-207 kernel: [18164.570353] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 10:26:30 juju-e4d256-prod-github-runner-207 kernel: [18164.571451] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 10:26:30 juju-e4d256-prod-github-runner-207 kernel: [18164.572642] Call Trace: Aug 22 10:26:30 juju-e4d256-prod-github-runner-207 kernel: [18164.573559] Aug 22 10:26:30 juju-e4d256-prod-github-runner-207 kernel: [18164.574472] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:26:30 juju-e4d256-prod-github-runner-207 kernel: [18164.575508] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:26:30 juju-e4d256-prod-github-runner-207 kernel: [18164.576544] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:26:30 juju-e4d256-prod-github-runner-207 kernel: [18164.577640] ? show_regs.part.0+0x23/0x29 Aug 22 10:26:30 juju-e4d256-prod-github-runner-207 kernel: [18164.578653] ? show_regs.cold+0x8/0xd Aug 22 10:26:30 juju-e4d256-prod-github-runner-207 kernel: [18164.579624] ? watchdog_timer_fn+0x1be/0x220 Aug 22 10:26:30 juju-e4d256-prod-github-runner-207 kernel: [18164.580633] ? lockup_detector_update_enable+0x60/0x60 Aug 22 10:26:30 juju-e4d256-prod-github-runner-207 kernel: [18164.581698] ? __hrtimer_run_queues+0x107/0x230 Aug 22 10:26:30 juju-e4d256-prod-github-runner-207 kernel: [18164.582744] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 10:26:30 juju-e4d256-prod-github-runner-207 kernel: [18164.583768] ? hrtimer_interrupt+0x101/0x220 Aug 22 10:26:30 juju-e4d256-prod-github-runner-207 kernel: [18164.584788] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 10:26:30 juju-e4d256-prod-github-runner-207 kernel: [18164.585855] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 10:26:30 juju-e4d256-prod-github-runner-207 kernel: [18164.586913] Aug 22 10:26:30 juju-e4d256-prod-github-runner-207 kernel: [18164.587771] Aug 22 10:26:30 juju-e4d256-prod-github-runner-207 kernel: [18164.588608] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 10:26:30 juju-e4d256-prod-github-runner-207 kernel: [18164.589641] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:26:30 juju-e4d256-prod-github-runner-207 kernel: [18164.590701] ? _raw_spin_lock+0x22/0x30 Aug 22 10:26:30 juju-e4d256-prod-github-runner-207 kernel: [18164.591651] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:26:30 juju-e4d256-prod-github-runner-207 kernel: [18164.592666] direct_page_fault+0x206/0x310 [kvm] Aug 22 10:26:30 juju-e4d256-prod-github-runner-207 kernel: [18164.593689] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 10:26:30 juju-e4d256-prod-github-runner-207 kernel: [18164.594717] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 10:26:30 juju-e4d256-prod-github-runner-207 kernel: [18164.595722] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 10:26:30 juju-e4d256-prod-github-runner-207 kernel: [18164.596714] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 10:26:30 juju-e4d256-prod-github-runner-207 kernel: [18164.597670] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 10:26:30 juju-e4d256-prod-github-runner-207 kernel: [18164.598666] handle_exit+0x98/0x230 [kvm_amd] Aug 22 10:26:30 juju-e4d256-prod-github-runner-207 kernel: [18164.599567] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 10:26:30 juju-e4d256-prod-github-runner-207 kernel: [18164.600485] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 10:26:30 juju-e4d256-prod-github-runner-207 kernel: [18164.601413] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 10:26:30 juju-e4d256-prod-github-runner-207 kernel: [18164.602336] vcpu_run+0x62/0x2c0 [kvm] Aug 22 10:26:30 juju-e4d256-prod-github-runner-207 kernel: [18164.603152] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 10:26:30 juju-e4d256-prod-github-runner-207 kernel: [18164.603958] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 10:26:30 juju-e4d256-prod-github-runner-207 kernel: [18164.604811] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 10:26:30 juju-e4d256-prod-github-runner-207 kernel: [18164.605613] ? __seccomp_filter+0x4a/0x4a0 Aug 22 10:26:30 juju-e4d256-prod-github-runner-207 kernel: [18164.606378] ? __fget_files+0x86/0xc0 Aug 22 10:26:30 juju-e4d256-prod-github-runner-207 kernel: [18164.607084] __x64_sys_ioctl+0x95/0xd0 Aug 22 10:26:30 juju-e4d256-prod-github-runner-207 kernel: [18164.607776] do_syscall_64+0x5c/0xc0 Aug 22 10:26:30 juju-e4d256-prod-github-runner-207 kernel: [18164.608439] ? do_futex+0x162/0x1f0 Aug 22 10:26:30 juju-e4d256-prod-github-runner-207 kernel: [18164.609092] ? __x64_sys_futex+0x78/0x1e0 Aug 22 10:26:30 juju-e4d256-prod-github-runner-207 kernel: [18164.609765] ? __secure_computing+0xa9/0x120 Aug 22 10:26:30 juju-e4d256-prod-github-runner-207 kernel: [18164.610473] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 10:26:30 juju-e4d256-prod-github-runner-207 kernel: [18164.611243] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:26:30 juju-e4d256-prod-github-runner-207 kernel: [18164.611964] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:26:30 juju-e4d256-prod-github-runner-207 kernel: [18164.612682] ? do_syscall_64+0x69/0xc0 Aug 22 10:26:30 juju-e4d256-prod-github-runner-207 kernel: [18164.613332] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:26:30 juju-e4d256-prod-github-runner-207 kernel: [18164.614034] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:26:30 juju-e4d256-prod-github-runner-207 kernel: [18164.614738] ? do_syscall_64+0x69/0xc0 Aug 22 10:26:30 juju-e4d256-prod-github-runner-207 kernel: [18164.615362] ? do_syscall_64+0x69/0xc0 Aug 22 10:26:30 juju-e4d256-prod-github-runner-207 kernel: [18164.615984] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 10:26:30 juju-e4d256-prod-github-runner-207 kernel: [18164.616689] RIP: 0033:0x7faa5d0edaff Aug 22 10:26:30 juju-e4d256-prod-github-runner-207 kernel: [18164.617328] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 10:26:30 juju-e4d256-prod-github-runner-207 kernel: [18164.619331] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 10:26:30 juju-e4d256-prod-github-runner-207 kernel: [18164.620238] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 10:26:30 juju-e4d256-prod-github-runner-207 kernel: [18164.621124] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 10:26:30 juju-e4d256-prod-github-runner-207 kernel: [18164.622017] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 10:26:30 juju-e4d256-prod-github-runner-207 kernel: [18164.622913] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 10:26:30 juju-e4d256-prod-github-runner-207 kernel: [18164.623800] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 10:26:30 juju-e4d256-prod-github-runner-207 kernel: [18164.624690] Aug 22 10:26:44 juju-e4d256-prod-github-runner-207 kernel: [18178.400707] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 10:26:44 juju-e4d256-prod-github-runner-207 kernel: [18178.401678] rcu: 1-....: (4501211 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=2178215 Aug 22 10:26:44 juju-e4d256-prod-github-runner-207 kernel: [18178.402817] (t=4515300 jiffies g=23269 q=24693) Aug 22 10:26:44 juju-e4d256-prod-github-runner-207 kernel: [18178.403597] NMI backtrace for cpu 1 Aug 22 10:26:44 juju-e4d256-prod-github-runner-207 kernel: [18178.404305] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 10:26:44 juju-e4d256-prod-github-runner-207 kernel: [18178.405410] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 10:26:44 juju-e4d256-prod-github-runner-207 kernel: [18178.406507] Call Trace: Aug 22 10:26:44 juju-e4d256-prod-github-runner-207 kernel: [18178.407193] Aug 22 10:26:44 juju-e4d256-prod-github-runner-207 kernel: [18178.407845] show_stack+0x52/0x5c Aug 22 10:26:44 juju-e4d256-prod-github-runner-207 kernel: [18178.408568] dump_stack_lvl+0x4a/0x63 Aug 22 10:26:44 juju-e4d256-prod-github-runner-207 kernel: [18178.409312] dump_stack+0x10/0x16 Aug 22 10:26:44 juju-e4d256-prod-github-runner-207 kernel: [18178.410028] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 10:26:44 juju-e4d256-prod-github-runner-207 kernel: [18178.410874] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 10:26:44 juju-e4d256-prod-github-runner-207 kernel: [18178.411686] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 10:26:44 juju-e4d256-prod-github-runner-207 kernel: [18178.412523] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 10:26:44 juju-e4d256-prod-github-runner-207 kernel: [18178.413346] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 10:26:44 juju-e4d256-prod-github-runner-207 kernel: [18178.414203] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 10:26:44 juju-e4d256-prod-github-runner-207 kernel: [18178.414977] print_cpu_stall.cold+0x2f/0xe2 Aug 22 10:26:44 juju-e4d256-prod-github-runner-207 kernel: [18178.415741] ? timekeeping_update+0xf7/0x150 Aug 22 10:26:44 juju-e4d256-prod-github-runner-207 kernel: [18178.416521] check_cpu_stall+0x109/0x270 Aug 22 10:26:44 juju-e4d256-prod-github-runner-207 kernel: [18178.417281] rcu_sched_clock_irq+0x9a/0x250 Aug 22 10:26:44 juju-e4d256-prod-github-runner-207 kernel: [18178.418042] update_process_times+0x94/0xd0 Aug 22 10:26:44 juju-e4d256-prod-github-runner-207 kernel: [18178.418822] tick_sched_handle+0x29/0x70 Aug 22 10:26:44 juju-e4d256-prod-github-runner-207 kernel: [18178.419577] tick_sched_timer+0x8c/0xc0 Aug 22 10:26:44 juju-e4d256-prod-github-runner-207 kernel: [18178.420337] ? tick_nohz_handler+0xb0/0xb0 Aug 22 10:26:44 juju-e4d256-prod-github-runner-207 kernel: [18178.421091] __hrtimer_run_queues+0x107/0x230 Aug 22 10:26:44 juju-e4d256-prod-github-runner-207 kernel: [18178.421877] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 10:26:44 juju-e4d256-prod-github-runner-207 kernel: [18178.422677] hrtimer_interrupt+0x101/0x220 Aug 22 10:26:44 juju-e4d256-prod-github-runner-207 kernel: [18178.423436] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 10:26:44 juju-e4d256-prod-github-runner-207 kernel: [18178.424247] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 10:26:44 juju-e4d256-prod-github-runner-207 kernel: [18178.425048] Aug 22 10:26:44 juju-e4d256-prod-github-runner-207 kernel: [18178.425681] Aug 22 10:26:44 juju-e4d256-prod-github-runner-207 kernel: [18178.426376] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 10:26:44 juju-e4d256-prod-github-runner-207 kernel: [18178.427269] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:26:44 juju-e4d256-prod-github-runner-207 kernel: [18178.428161] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 10:26:44 juju-e4d256-prod-github-runner-207 kernel: [18178.430396] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 10:26:44 juju-e4d256-prod-github-runner-207 kernel: [18178.431281] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 10:26:44 juju-e4d256-prod-github-runner-207 kernel: [18178.432294] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 10:26:44 juju-e4d256-prod-github-runner-207 kernel: [18178.433285] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 10:26:44 juju-e4d256-prod-github-runner-207 kernel: [18178.434272] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 10:26:44 juju-e4d256-prod-github-runner-207 kernel: [18178.435234] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 10:26:44 juju-e4d256-prod-github-runner-207 kernel: [18178.436194] ? _raw_spin_lock+0x22/0x30 Aug 22 10:26:44 juju-e4d256-prod-github-runner-207 kernel: [18178.437001] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:26:44 juju-e4d256-prod-github-runner-207 kernel: [18178.437847] direct_page_fault+0x206/0x310 [kvm] Aug 22 10:26:44 juju-e4d256-prod-github-runner-207 kernel: [18178.438701] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 10:26:44 juju-e4d256-prod-github-runner-207 kernel: [18178.439535] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 10:26:44 juju-e4d256-prod-github-runner-207 kernel: [18178.440358] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 10:26:44 juju-e4d256-prod-github-runner-207 kernel: [18178.441165] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 10:26:44 juju-e4d256-prod-github-runner-207 kernel: [18178.441952] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 10:26:44 juju-e4d256-prod-github-runner-207 kernel: [18178.442801] handle_exit+0x98/0x230 [kvm_amd] Aug 22 10:26:44 juju-e4d256-prod-github-runner-207 kernel: [18178.443560] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 10:26:44 juju-e4d256-prod-github-runner-207 kernel: [18178.444346] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 10:26:44 juju-e4d256-prod-github-runner-207 kernel: [18178.445146] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 10:26:44 juju-e4d256-prod-github-runner-207 kernel: [18178.445931] vcpu_run+0x62/0x2c0 [kvm] Aug 22 10:26:44 juju-e4d256-prod-github-runner-207 kernel: [18178.446672] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 10:26:44 juju-e4d256-prod-github-runner-207 kernel: [18178.447425] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 10:26:44 juju-e4d256-prod-github-runner-207 kernel: [18178.448232] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 10:26:44 juju-e4d256-prod-github-runner-207 kernel: [18178.448993] ? __seccomp_filter+0x4a/0x4a0 Aug 22 10:26:44 juju-e4d256-prod-github-runner-207 kernel: [18178.449720] ? __fget_files+0x86/0xc0 Aug 22 10:26:44 juju-e4d256-prod-github-runner-207 kernel: [18178.450429] __x64_sys_ioctl+0x95/0xd0 Aug 22 10:26:44 juju-e4d256-prod-github-runner-207 kernel: [18178.451123] do_syscall_64+0x5c/0xc0 Aug 22 10:26:44 juju-e4d256-prod-github-runner-207 kernel: [18178.451803] ? do_futex+0x162/0x1f0 Aug 22 10:26:44 juju-e4d256-prod-github-runner-207 kernel: [18178.452512] ? __x64_sys_futex+0x78/0x1e0 Aug 22 10:26:44 juju-e4d256-prod-github-runner-207 kernel: [18178.453223] ? __secure_computing+0xa9/0x120 Aug 22 10:26:44 juju-e4d256-prod-github-runner-207 kernel: [18178.453935] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 10:26:44 juju-e4d256-prod-github-runner-207 kernel: [18178.454742] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:26:44 juju-e4d256-prod-github-runner-207 kernel: [18178.455493] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:26:44 juju-e4d256-prod-github-runner-207 kernel: [18178.456242] ? do_syscall_64+0x69/0xc0 Aug 22 10:26:44 juju-e4d256-prod-github-runner-207 kernel: [18178.456929] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:26:44 juju-e4d256-prod-github-runner-207 kernel: [18178.457681] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:26:44 juju-e4d256-prod-github-runner-207 kernel: [18178.458461] ? do_syscall_64+0x69/0xc0 Aug 22 10:26:44 juju-e4d256-prod-github-runner-207 kernel: [18178.459164] ? do_syscall_64+0x69/0xc0 Aug 22 10:26:44 juju-e4d256-prod-github-runner-207 kernel: [18178.459852] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 10:26:44 juju-e4d256-prod-github-runner-207 kernel: [18178.460622] RIP: 0033:0x7faa5d0edaff Aug 22 10:26:44 juju-e4d256-prod-github-runner-207 kernel: [18178.461323] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 10:26:44 juju-e4d256-prod-github-runner-207 kernel: [18178.463451] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 10:26:44 juju-e4d256-prod-github-runner-207 kernel: [18178.464415] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 10:26:44 juju-e4d256-prod-github-runner-207 kernel: [18178.465366] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 10:26:44 juju-e4d256-prod-github-runner-207 kernel: [18178.466340] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 10:26:44 juju-e4d256-prod-github-runner-207 kernel: [18178.467355] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 10:26:44 juju-e4d256-prod-github-runner-207 kernel: [18178.468298] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 10:26:44 juju-e4d256-prod-github-runner-207 kernel: [18178.469218] Aug 22 10:27:10 juju-e4d256-prod-github-runner-207 kernel: [18204.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 16846s! [qemu-system-x86:6715] Aug 22 10:27:10 juju-e4d256-prod-github-runner-207 kernel: [18204.543091] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 10:27:10 juju-e4d256-prod-github-runner-207 kernel: [18204.543159] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 10:27:10 juju-e4d256-prod-github-runner-207 kernel: [18204.555246] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 10:27:10 juju-e4d256-prod-github-runner-207 kernel: [18204.556504] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 10:27:10 juju-e4d256-prod-github-runner-207 kernel: [18204.557720] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:27:10 juju-e4d256-prod-github-runner-207 kernel: [18204.558787] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 10:27:10 juju-e4d256-prod-github-runner-207 kernel: [18204.561325] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 10:27:10 juju-e4d256-prod-github-runner-207 kernel: [18204.562381] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 10:27:10 juju-e4d256-prod-github-runner-207 kernel: [18204.563541] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 10:27:10 juju-e4d256-prod-github-runner-207 kernel: [18204.564704] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 10:27:10 juju-e4d256-prod-github-runner-207 kernel: [18204.565873] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 10:27:10 juju-e4d256-prod-github-runner-207 kernel: [18204.567031] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 10:27:10 juju-e4d256-prod-github-runner-207 kernel: [18204.568200] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 10:27:10 juju-e4d256-prod-github-runner-207 kernel: [18204.569434] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 10:27:10 juju-e4d256-prod-github-runner-207 kernel: [18204.570549] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 10:27:10 juju-e4d256-prod-github-runner-207 kernel: [18204.571736] Call Trace: Aug 22 10:27:10 juju-e4d256-prod-github-runner-207 kernel: [18204.572645] Aug 22 10:27:10 juju-e4d256-prod-github-runner-207 kernel: [18204.573528] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:27:10 juju-e4d256-prod-github-runner-207 kernel: [18204.574569] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:27:10 juju-e4d256-prod-github-runner-207 kernel: [18204.575587] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:27:10 juju-e4d256-prod-github-runner-207 kernel: [18204.576780] ? show_regs.part.0+0x23/0x29 Aug 22 10:27:10 juju-e4d256-prod-github-runner-207 kernel: [18204.577793] ? show_regs.cold+0x8/0xd Aug 22 10:27:10 juju-e4d256-prod-github-runner-207 kernel: [18204.578763] ? watchdog_timer_fn+0x1be/0x220 Aug 22 10:27:10 juju-e4d256-prod-github-runner-207 kernel: [18204.579787] ? lockup_detector_update_enable+0x60/0x60 Aug 22 10:27:10 juju-e4d256-prod-github-runner-207 kernel: [18204.580851] ? __hrtimer_run_queues+0x107/0x230 Aug 22 10:27:10 juju-e4d256-prod-github-runner-207 kernel: [18204.581897] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 10:27:10 juju-e4d256-prod-github-runner-207 kernel: [18204.582919] ? hrtimer_interrupt+0x101/0x220 Aug 22 10:27:10 juju-e4d256-prod-github-runner-207 kernel: [18204.583957] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 10:27:10 juju-e4d256-prod-github-runner-207 kernel: [18204.585037] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 10:27:10 juju-e4d256-prod-github-runner-207 kernel: [18204.586101] Aug 22 10:27:10 juju-e4d256-prod-github-runner-207 kernel: [18204.586953] Aug 22 10:27:10 juju-e4d256-prod-github-runner-207 kernel: [18204.587788] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 10:27:10 juju-e4d256-prod-github-runner-207 kernel: [18204.588818] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:27:10 juju-e4d256-prod-github-runner-207 kernel: [18204.589865] ? _raw_spin_lock+0x22/0x30 Aug 22 10:27:10 juju-e4d256-prod-github-runner-207 kernel: [18204.590808] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:27:10 juju-e4d256-prod-github-runner-207 kernel: [18204.591821] direct_page_fault+0x206/0x310 [kvm] Aug 22 10:27:10 juju-e4d256-prod-github-runner-207 kernel: [18204.592847] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 10:27:10 juju-e4d256-prod-github-runner-207 kernel: [18204.593866] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 10:27:10 juju-e4d256-prod-github-runner-207 kernel: [18204.594863] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 10:27:10 juju-e4d256-prod-github-runner-207 kernel: [18204.595834] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 10:27:10 juju-e4d256-prod-github-runner-207 kernel: [18204.596777] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 10:27:10 juju-e4d256-prod-github-runner-207 kernel: [18204.597751] handle_exit+0x98/0x230 [kvm_amd] Aug 22 10:27:10 juju-e4d256-prod-github-runner-207 kernel: [18204.598655] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 10:27:10 juju-e4d256-prod-github-runner-207 kernel: [18204.599569] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 10:27:10 juju-e4d256-prod-github-runner-207 kernel: [18204.600499] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 10:27:10 juju-e4d256-prod-github-runner-207 kernel: [18204.601409] vcpu_run+0x62/0x2c0 [kvm] Aug 22 10:27:10 juju-e4d256-prod-github-runner-207 kernel: [18204.602241] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 10:27:10 juju-e4d256-prod-github-runner-207 kernel: [18204.603045] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 10:27:10 juju-e4d256-prod-github-runner-207 kernel: [18204.603894] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 10:27:10 juju-e4d256-prod-github-runner-207 kernel: [18204.604691] ? __seccomp_filter+0x4a/0x4a0 Aug 22 10:27:10 juju-e4d256-prod-github-runner-207 kernel: [18204.605435] ? __fget_files+0x86/0xc0 Aug 22 10:27:10 juju-e4d256-prod-github-runner-207 kernel: [18204.606161] __x64_sys_ioctl+0x95/0xd0 Aug 22 10:27:10 juju-e4d256-prod-github-runner-207 kernel: [18204.606879] do_syscall_64+0x5c/0xc0 Aug 22 10:27:10 juju-e4d256-prod-github-runner-207 kernel: [18204.607547] ? do_futex+0x162/0x1f0 Aug 22 10:27:10 juju-e4d256-prod-github-runner-207 kernel: [18204.608191] ? __x64_sys_futex+0x78/0x1e0 Aug 22 10:27:10 juju-e4d256-prod-github-runner-207 kernel: [18204.608866] ? __secure_computing+0xa9/0x120 Aug 22 10:27:10 juju-e4d256-prod-github-runner-207 kernel: [18204.609553] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 10:27:10 juju-e4d256-prod-github-runner-207 kernel: [18204.610331] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:27:10 juju-e4d256-prod-github-runner-207 kernel: [18204.611052] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:27:10 juju-e4d256-prod-github-runner-207 kernel: [18204.611773] ? do_syscall_64+0x69/0xc0 Aug 22 10:27:10 juju-e4d256-prod-github-runner-207 kernel: [18204.612418] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:27:10 juju-e4d256-prod-github-runner-207 kernel: [18204.613118] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:27:10 juju-e4d256-prod-github-runner-207 kernel: [18204.613824] ? do_syscall_64+0x69/0xc0 Aug 22 10:27:10 juju-e4d256-prod-github-runner-207 kernel: [18204.614446] ? do_syscall_64+0x69/0xc0 Aug 22 10:27:10 juju-e4d256-prod-github-runner-207 kernel: [18204.615065] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 10:27:10 juju-e4d256-prod-github-runner-207 kernel: [18204.615768] RIP: 0033:0x7faa5d0edaff Aug 22 10:27:10 juju-e4d256-prod-github-runner-207 kernel: [18204.616388] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 10:27:10 juju-e4d256-prod-github-runner-207 kernel: [18204.618394] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 10:27:10 juju-e4d256-prod-github-runner-207 kernel: [18204.619304] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 10:27:10 juju-e4d256-prod-github-runner-207 kernel: [18204.620191] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 10:27:10 juju-e4d256-prod-github-runner-207 kernel: [18204.621080] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 10:27:10 juju-e4d256-prod-github-runner-207 kernel: [18204.621991] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 10:27:10 juju-e4d256-prod-github-runner-207 kernel: [18204.622878] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 10:27:10 juju-e4d256-prod-github-runner-207 kernel: [18204.623768] Aug 22 10:27:38 juju-e4d256-prod-github-runner-207 kernel: [18232.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 16872s! [qemu-system-x86:6715] Aug 22 10:27:38 juju-e4d256-prod-github-runner-207 kernel: [18232.543091] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 10:27:38 juju-e4d256-prod-github-runner-207 kernel: [18232.543160] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 10:27:38 juju-e4d256-prod-github-runner-207 kernel: [18232.555244] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 10:27:38 juju-e4d256-prod-github-runner-207 kernel: [18232.556508] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 10:27:38 juju-e4d256-prod-github-runner-207 kernel: [18232.557740] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:27:38 juju-e4d256-prod-github-runner-207 kernel: [18232.558798] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 10:27:38 juju-e4d256-prod-github-runner-207 kernel: [18232.561354] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 10:27:38 juju-e4d256-prod-github-runner-207 kernel: [18232.562404] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 10:27:38 juju-e4d256-prod-github-runner-207 kernel: [18232.563564] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 10:27:38 juju-e4d256-prod-github-runner-207 kernel: [18232.564731] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 10:27:38 juju-e4d256-prod-github-runner-207 kernel: [18232.565912] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 10:27:38 juju-e4d256-prod-github-runner-207 kernel: [18232.567073] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 10:27:38 juju-e4d256-prod-github-runner-207 kernel: [18232.568239] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 10:27:38 juju-e4d256-prod-github-runner-207 kernel: [18232.569486] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 10:27:38 juju-e4d256-prod-github-runner-207 kernel: [18232.570583] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 10:27:38 juju-e4d256-prod-github-runner-207 kernel: [18232.571784] Call Trace: Aug 22 10:27:38 juju-e4d256-prod-github-runner-207 kernel: [18232.572695] Aug 22 10:27:38 juju-e4d256-prod-github-runner-207 kernel: [18232.573587] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:27:38 juju-e4d256-prod-github-runner-207 kernel: [18232.574617] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:27:38 juju-e4d256-prod-github-runner-207 kernel: [18232.575642] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:27:38 juju-e4d256-prod-github-runner-207 kernel: [18232.576719] ? show_regs.part.0+0x23/0x29 Aug 22 10:27:38 juju-e4d256-prod-github-runner-207 kernel: [18232.577723] ? show_regs.cold+0x8/0xd Aug 22 10:27:38 juju-e4d256-prod-github-runner-207 kernel: [18232.578702] ? watchdog_timer_fn+0x1be/0x220 Aug 22 10:27:38 juju-e4d256-prod-github-runner-207 kernel: [18232.579890] ? lockup_detector_update_enable+0x60/0x60 Aug 22 10:27:38 juju-e4d256-prod-github-runner-207 kernel: [18232.580953] ? __hrtimer_run_queues+0x107/0x230 Aug 22 10:27:38 juju-e4d256-prod-github-runner-207 kernel: [18232.581995] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 10:27:38 juju-e4d256-prod-github-runner-207 kernel: [18232.583018] ? hrtimer_interrupt+0x101/0x220 Aug 22 10:27:38 juju-e4d256-prod-github-runner-207 kernel: [18232.584031] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 10:27:38 juju-e4d256-prod-github-runner-207 kernel: [18232.585102] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 10:27:38 juju-e4d256-prod-github-runner-207 kernel: [18232.586166] Aug 22 10:27:38 juju-e4d256-prod-github-runner-207 kernel: [18232.587020] Aug 22 10:27:38 juju-e4d256-prod-github-runner-207 kernel: [18232.587856] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 10:27:38 juju-e4d256-prod-github-runner-207 kernel: [18232.588889] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:27:38 juju-e4d256-prod-github-runner-207 kernel: [18232.589941] ? _raw_spin_lock+0x22/0x30 Aug 22 10:27:38 juju-e4d256-prod-github-runner-207 kernel: [18232.590891] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:27:38 juju-e4d256-prod-github-runner-207 kernel: [18232.591906] direct_page_fault+0x206/0x310 [kvm] Aug 22 10:27:38 juju-e4d256-prod-github-runner-207 kernel: [18232.592932] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 10:27:38 juju-e4d256-prod-github-runner-207 kernel: [18232.593947] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 10:27:38 juju-e4d256-prod-github-runner-207 kernel: [18232.594948] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 10:27:38 juju-e4d256-prod-github-runner-207 kernel: [18232.595922] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 10:27:38 juju-e4d256-prod-github-runner-207 kernel: [18232.596868] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 10:27:38 juju-e4d256-prod-github-runner-207 kernel: [18232.597861] handle_exit+0x98/0x230 [kvm_amd] Aug 22 10:27:38 juju-e4d256-prod-github-runner-207 kernel: [18232.598753] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 10:27:38 juju-e4d256-prod-github-runner-207 kernel: [18232.599665] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 10:27:38 juju-e4d256-prod-github-runner-207 kernel: [18232.600592] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 10:27:38 juju-e4d256-prod-github-runner-207 kernel: [18232.601508] vcpu_run+0x62/0x2c0 [kvm] Aug 22 10:27:38 juju-e4d256-prod-github-runner-207 kernel: [18232.602319] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 10:27:38 juju-e4d256-prod-github-runner-207 kernel: [18232.603125] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 10:27:38 juju-e4d256-prod-github-runner-207 kernel: [18232.603976] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 10:27:38 juju-e4d256-prod-github-runner-207 kernel: [18232.604770] ? __seccomp_filter+0x4a/0x4a0 Aug 22 10:27:38 juju-e4d256-prod-github-runner-207 kernel: [18232.605526] ? __fget_files+0x86/0xc0 Aug 22 10:27:38 juju-e4d256-prod-github-runner-207 kernel: [18232.606233] __x64_sys_ioctl+0x95/0xd0 Aug 22 10:27:38 juju-e4d256-prod-github-runner-207 kernel: [18232.606933] do_syscall_64+0x5c/0xc0 Aug 22 10:27:38 juju-e4d256-prod-github-runner-207 kernel: [18232.607595] ? do_futex+0x162/0x1f0 Aug 22 10:27:38 juju-e4d256-prod-github-runner-207 kernel: [18232.608243] ? __x64_sys_futex+0x78/0x1e0 Aug 22 10:27:38 juju-e4d256-prod-github-runner-207 kernel: [18232.608914] ? __secure_computing+0xa9/0x120 Aug 22 10:27:38 juju-e4d256-prod-github-runner-207 kernel: [18232.609612] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 10:27:38 juju-e4d256-prod-github-runner-207 kernel: [18232.610375] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:27:38 juju-e4d256-prod-github-runner-207 kernel: [18232.611095] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:27:38 juju-e4d256-prod-github-runner-207 kernel: [18232.611813] ? do_syscall_64+0x69/0xc0 Aug 22 10:27:38 juju-e4d256-prod-github-runner-207 kernel: [18232.612458] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:27:38 juju-e4d256-prod-github-runner-207 kernel: [18232.613167] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:27:38 juju-e4d256-prod-github-runner-207 kernel: [18232.613871] ? do_syscall_64+0x69/0xc0 Aug 22 10:27:38 juju-e4d256-prod-github-runner-207 kernel: [18232.614494] ? do_syscall_64+0x69/0xc0 Aug 22 10:27:38 juju-e4d256-prod-github-runner-207 kernel: [18232.615115] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 10:27:38 juju-e4d256-prod-github-runner-207 kernel: [18232.615824] RIP: 0033:0x7faa5d0edaff Aug 22 10:27:38 juju-e4d256-prod-github-runner-207 kernel: [18232.616449] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 10:27:38 juju-e4d256-prod-github-runner-207 kernel: [18232.618447] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 10:27:38 juju-e4d256-prod-github-runner-207 kernel: [18232.619358] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 10:27:38 juju-e4d256-prod-github-runner-207 kernel: [18232.620255] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 10:27:38 juju-e4d256-prod-github-runner-207 kernel: [18232.621146] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 10:27:38 juju-e4d256-prod-github-runner-207 kernel: [18232.622045] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 10:27:38 juju-e4d256-prod-github-runner-207 kernel: [18232.622937] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 10:27:38 juju-e4d256-prod-github-runner-207 kernel: [18232.623826] Aug 22 10:28:06 juju-e4d256-prod-github-runner-207 kernel: [18260.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 16898s! [qemu-system-x86:6715] Aug 22 10:28:06 juju-e4d256-prod-github-runner-207 kernel: [18260.543738] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 10:28:06 juju-e4d256-prod-github-runner-207 kernel: [18260.543990] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 10:28:06 juju-e4d256-prod-github-runner-207 kernel: [18260.556089] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 10:28:06 juju-e4d256-prod-github-runner-207 kernel: [18260.557365] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 10:28:06 juju-e4d256-prod-github-runner-207 kernel: [18260.558587] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:28:06 juju-e4d256-prod-github-runner-207 kernel: [18260.559649] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 10:28:06 juju-e4d256-prod-github-runner-207 kernel: [18260.562313] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 10:28:06 juju-e4d256-prod-github-runner-207 kernel: [18260.563473] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 10:28:06 juju-e4d256-prod-github-runner-207 kernel: [18260.564757] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 10:28:06 juju-e4d256-prod-github-runner-207 kernel: [18260.566051] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 10:28:06 juju-e4d256-prod-github-runner-207 kernel: [18260.567414] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 10:28:06 juju-e4d256-prod-github-runner-207 kernel: [18260.568666] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 10:28:06 juju-e4d256-prod-github-runner-207 kernel: [18260.569859] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 10:28:06 juju-e4d256-prod-github-runner-207 kernel: [18260.571207] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 10:28:06 juju-e4d256-prod-github-runner-207 kernel: [18260.572557] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 10:28:06 juju-e4d256-prod-github-runner-207 kernel: [18260.573853] Call Trace: Aug 22 10:28:06 juju-e4d256-prod-github-runner-207 kernel: [18260.574829] Aug 22 10:28:06 juju-e4d256-prod-github-runner-207 kernel: [18260.575810] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:28:06 juju-e4d256-prod-github-runner-207 kernel: [18260.576984] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:28:06 juju-e4d256-prod-github-runner-207 kernel: [18260.578094] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:28:06 juju-e4d256-prod-github-runner-207 kernel: [18260.579240] ? show_regs.part.0+0x23/0x29 Aug 22 10:28:06 juju-e4d256-prod-github-runner-207 kernel: [18260.580381] ? show_regs.cold+0x8/0xd Aug 22 10:28:06 juju-e4d256-prod-github-runner-207 kernel: [18260.581480] ? watchdog_timer_fn+0x1be/0x220 Aug 22 10:28:06 juju-e4d256-prod-github-runner-207 kernel: [18260.582540] ? lockup_detector_update_enable+0x60/0x60 Aug 22 10:28:06 juju-e4d256-prod-github-runner-207 kernel: [18260.583646] ? __hrtimer_run_queues+0x107/0x230 Aug 22 10:28:06 juju-e4d256-prod-github-runner-207 kernel: [18260.584929] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 10:28:06 juju-e4d256-prod-github-runner-207 kernel: [18260.585970] ? hrtimer_interrupt+0x101/0x220 Aug 22 10:28:06 juju-e4d256-prod-github-runner-207 kernel: [18260.586984] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 10:28:06 juju-e4d256-prod-github-runner-207 kernel: [18260.588133] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 10:28:06 juju-e4d256-prod-github-runner-207 kernel: [18260.589277] Aug 22 10:28:06 juju-e4d256-prod-github-runner-207 kernel: [18260.590237] Aug 22 10:28:06 juju-e4d256-prod-github-runner-207 kernel: [18260.591174] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 10:28:06 juju-e4d256-prod-github-runner-207 kernel: [18260.592292] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:28:06 juju-e4d256-prod-github-runner-207 kernel: [18260.593430] ? _raw_spin_lock+0x22/0x30 Aug 22 10:28:06 juju-e4d256-prod-github-runner-207 kernel: [18260.594425] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:28:06 juju-e4d256-prod-github-runner-207 kernel: [18260.595561] direct_page_fault+0x206/0x310 [kvm] Aug 22 10:28:06 juju-e4d256-prod-github-runner-207 kernel: [18260.596611] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 10:28:06 juju-e4d256-prod-github-runner-207 kernel: [18260.597794] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 10:28:06 juju-e4d256-prod-github-runner-207 kernel: [18260.598891] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 10:28:06 juju-e4d256-prod-github-runner-207 kernel: [18260.599967] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 10:28:06 juju-e4d256-prod-github-runner-207 kernel: [18260.601074] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 10:28:06 juju-e4d256-prod-github-runner-207 kernel: [18260.602123] handle_exit+0x98/0x230 [kvm_amd] Aug 22 10:28:06 juju-e4d256-prod-github-runner-207 kernel: [18260.603071] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 10:28:06 juju-e4d256-prod-github-runner-207 kernel: [18260.604058] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 10:28:06 juju-e4d256-prod-github-runner-207 kernel: [18260.605059] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 10:28:06 juju-e4d256-prod-github-runner-207 kernel: [18260.606016] vcpu_run+0x62/0x2c0 [kvm] Aug 22 10:28:06 juju-e4d256-prod-github-runner-207 kernel: [18260.606831] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 10:28:06 juju-e4d256-prod-github-runner-207 kernel: [18260.607739] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 10:28:06 juju-e4d256-prod-github-runner-207 kernel: [18260.608599] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 10:28:06 juju-e4d256-prod-github-runner-207 kernel: [18260.609423] ? __seccomp_filter+0x4a/0x4a0 Aug 22 10:28:06 juju-e4d256-prod-github-runner-207 kernel: [18260.610169] ? __fget_files+0x86/0xc0 Aug 22 10:28:06 juju-e4d256-prod-github-runner-207 kernel: [18260.610998] __x64_sys_ioctl+0x95/0xd0 Aug 22 10:28:06 juju-e4d256-prod-github-runner-207 kernel: [18260.611749] do_syscall_64+0x5c/0xc0 Aug 22 10:28:06 juju-e4d256-prod-github-runner-207 kernel: [18260.612415] ? do_futex+0x162/0x1f0 Aug 22 10:28:06 juju-e4d256-prod-github-runner-207 kernel: [18260.613095] ? __x64_sys_futex+0x78/0x1e0 Aug 22 10:28:06 juju-e4d256-prod-github-runner-207 kernel: [18260.613894] ? __secure_computing+0xa9/0x120 Aug 22 10:28:06 juju-e4d256-prod-github-runner-207 kernel: [18260.614630] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 10:28:06 juju-e4d256-prod-github-runner-207 kernel: [18260.615444] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:28:06 juju-e4d256-prod-github-runner-207 kernel: [18260.616264] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:28:06 juju-e4d256-prod-github-runner-207 kernel: [18260.617049] ? do_syscall_64+0x69/0xc0 Aug 22 10:28:06 juju-e4d256-prod-github-runner-207 kernel: [18260.617715] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:28:06 juju-e4d256-prod-github-runner-207 kernel: [18260.618418] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:28:06 juju-e4d256-prod-github-runner-207 kernel: [18260.619244] ? do_syscall_64+0x69/0xc0 Aug 22 10:28:06 juju-e4d256-prod-github-runner-207 kernel: [18260.619931] ? do_syscall_64+0x69/0xc0 Aug 22 10:28:06 juju-e4d256-prod-github-runner-207 kernel: [18260.620605] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 10:28:06 juju-e4d256-prod-github-runner-207 kernel: [18260.621411] RIP: 0033:0x7faa5d0edaff Aug 22 10:28:06 juju-e4d256-prod-github-runner-207 kernel: [18260.622116] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 10:28:06 juju-e4d256-prod-github-runner-207 kernel: [18260.624209] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 10:28:06 juju-e4d256-prod-github-runner-207 kernel: [18260.625228] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 10:28:06 juju-e4d256-prod-github-runner-207 kernel: [18260.626301] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 10:28:06 juju-e4d256-prod-github-runner-207 kernel: [18260.627309] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 10:28:06 juju-e4d256-prod-github-runner-207 kernel: [18260.628244] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 10:28:06 juju-e4d256-prod-github-runner-207 kernel: [18260.629224] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 10:28:06 juju-e4d256-prod-github-runner-207 kernel: [18260.630182] Aug 22 10:28:34 juju-e4d256-prod-github-runner-207 kernel: [18288.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 16924s! [qemu-system-x86:6715] Aug 22 10:28:34 juju-e4d256-prod-github-runner-207 kernel: [18288.543106] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 10:28:34 juju-e4d256-prod-github-runner-207 kernel: [18288.543178] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 10:28:34 juju-e4d256-prod-github-runner-207 kernel: [18288.555514] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 10:28:34 juju-e4d256-prod-github-runner-207 kernel: [18288.556817] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 10:28:34 juju-e4d256-prod-github-runner-207 kernel: [18288.558047] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:28:34 juju-e4d256-prod-github-runner-207 kernel: [18288.559125] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 10:28:34 juju-e4d256-prod-github-runner-207 kernel: [18288.561703] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 10:28:34 juju-e4d256-prod-github-runner-207 kernel: [18288.562752] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 10:28:34 juju-e4d256-prod-github-runner-207 kernel: [18288.563946] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 10:28:34 juju-e4d256-prod-github-runner-207 kernel: [18288.565138] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 10:28:34 juju-e4d256-prod-github-runner-207 kernel: [18288.566312] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 10:28:34 juju-e4d256-prod-github-runner-207 kernel: [18288.567472] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 10:28:34 juju-e4d256-prod-github-runner-207 kernel: [18288.568642] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 10:28:34 juju-e4d256-prod-github-runner-207 kernel: [18288.569898] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 10:28:34 juju-e4d256-prod-github-runner-207 kernel: [18288.571012] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 10:28:34 juju-e4d256-prod-github-runner-207 kernel: [18288.572207] Call Trace: Aug 22 10:28:34 juju-e4d256-prod-github-runner-207 kernel: [18288.573130] Aug 22 10:28:34 juju-e4d256-prod-github-runner-207 kernel: [18288.574047] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:28:34 juju-e4d256-prod-github-runner-207 kernel: [18288.575093] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:28:34 juju-e4d256-prod-github-runner-207 kernel: [18288.576148] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:28:34 juju-e4d256-prod-github-runner-207 kernel: [18288.577244] ? show_regs.part.0+0x23/0x29 Aug 22 10:28:34 juju-e4d256-prod-github-runner-207 kernel: [18288.578242] ? show_regs.cold+0x8/0xd Aug 22 10:28:34 juju-e4d256-prod-github-runner-207 kernel: [18288.579235] ? watchdog_timer_fn+0x1be/0x220 Aug 22 10:28:34 juju-e4d256-prod-github-runner-207 kernel: [18288.580274] ? lockup_detector_update_enable+0x60/0x60 Aug 22 10:28:34 juju-e4d256-prod-github-runner-207 kernel: [18288.581375] ? __hrtimer_run_queues+0x107/0x230 Aug 22 10:28:34 juju-e4d256-prod-github-runner-207 kernel: [18288.582405] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 10:28:34 juju-e4d256-prod-github-runner-207 kernel: [18288.583432] ? hrtimer_interrupt+0x101/0x220 Aug 22 10:28:34 juju-e4d256-prod-github-runner-207 kernel: [18288.584447] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 10:28:34 juju-e4d256-prod-github-runner-207 kernel: [18288.585541] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 10:28:34 juju-e4d256-prod-github-runner-207 kernel: [18288.586611] Aug 22 10:28:34 juju-e4d256-prod-github-runner-207 kernel: [18288.587461] Aug 22 10:28:34 juju-e4d256-prod-github-runner-207 kernel: [18288.588295] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 10:28:34 juju-e4d256-prod-github-runner-207 kernel: [18288.589342] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:28:34 juju-e4d256-prod-github-runner-207 kernel: [18288.590392] ? _raw_spin_lock+0x22/0x30 Aug 22 10:28:34 juju-e4d256-prod-github-runner-207 kernel: [18288.591360] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:28:34 juju-e4d256-prod-github-runner-207 kernel: [18288.592385] direct_page_fault+0x206/0x310 [kvm] Aug 22 10:28:34 juju-e4d256-prod-github-runner-207 kernel: [18288.593422] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 10:28:34 juju-e4d256-prod-github-runner-207 kernel: [18288.594439] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 10:28:34 juju-e4d256-prod-github-runner-207 kernel: [18288.595454] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 10:28:34 juju-e4d256-prod-github-runner-207 kernel: [18288.596457] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 10:28:34 juju-e4d256-prod-github-runner-207 kernel: [18288.597431] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 10:28:34 juju-e4d256-prod-github-runner-207 kernel: [18288.598415] handle_exit+0x98/0x230 [kvm_amd] Aug 22 10:28:34 juju-e4d256-prod-github-runner-207 kernel: [18288.599311] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 10:28:34 juju-e4d256-prod-github-runner-207 kernel: [18288.600238] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 10:28:34 juju-e4d256-prod-github-runner-207 kernel: [18288.601184] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 10:28:34 juju-e4d256-prod-github-runner-207 kernel: [18288.602104] vcpu_run+0x62/0x2c0 [kvm] Aug 22 10:28:34 juju-e4d256-prod-github-runner-207 kernel: [18288.602920] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 10:28:34 juju-e4d256-prod-github-runner-207 kernel: [18288.603735] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 10:28:34 juju-e4d256-prod-github-runner-207 kernel: [18288.604598] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 10:28:34 juju-e4d256-prod-github-runner-207 kernel: [18288.605426] ? __seccomp_filter+0x4a/0x4a0 Aug 22 10:28:34 juju-e4d256-prod-github-runner-207 kernel: [18288.606178] ? __fget_files+0x86/0xc0 Aug 22 10:28:34 juju-e4d256-prod-github-runner-207 kernel: [18288.606902] __x64_sys_ioctl+0x95/0xd0 Aug 22 10:28:34 juju-e4d256-prod-github-runner-207 kernel: [18288.607598] do_syscall_64+0x5c/0xc0 Aug 22 10:28:34 juju-e4d256-prod-github-runner-207 kernel: [18288.608268] ? do_futex+0x162/0x1f0 Aug 22 10:28:34 juju-e4d256-prod-github-runner-207 kernel: [18288.608935] ? __x64_sys_futex+0x78/0x1e0 Aug 22 10:28:34 juju-e4d256-prod-github-runner-207 kernel: [18288.609612] ? __secure_computing+0xa9/0x120 Aug 22 10:28:34 juju-e4d256-prod-github-runner-207 kernel: [18288.610310] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 10:28:34 juju-e4d256-prod-github-runner-207 kernel: [18288.611078] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:28:34 juju-e4d256-prod-github-runner-207 kernel: [18288.611811] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:28:34 juju-e4d256-prod-github-runner-207 kernel: [18288.612540] ? do_syscall_64+0x69/0xc0 Aug 22 10:28:34 juju-e4d256-prod-github-runner-207 kernel: [18288.613197] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:28:34 juju-e4d256-prod-github-runner-207 kernel: [18288.613903] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:28:34 juju-e4d256-prod-github-runner-207 kernel: [18288.614601] ? do_syscall_64+0x69/0xc0 Aug 22 10:28:34 juju-e4d256-prod-github-runner-207 kernel: [18288.615234] ? do_syscall_64+0x69/0xc0 Aug 22 10:28:34 juju-e4d256-prod-github-runner-207 kernel: [18288.615867] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 10:28:34 juju-e4d256-prod-github-runner-207 kernel: [18288.616585] RIP: 0033:0x7faa5d0edaff Aug 22 10:28:34 juju-e4d256-prod-github-runner-207 kernel: [18288.617232] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 10:28:34 juju-e4d256-prod-github-runner-207 kernel: [18288.619220] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 10:28:34 juju-e4d256-prod-github-runner-207 kernel: [18288.620132] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 10:28:34 juju-e4d256-prod-github-runner-207 kernel: [18288.621054] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 10:28:34 juju-e4d256-prod-github-runner-207 kernel: [18288.621965] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 10:28:34 juju-e4d256-prod-github-runner-207 kernel: [18288.622856] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 10:28:34 juju-e4d256-prod-github-runner-207 kernel: [18288.623747] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 10:28:34 juju-e4d256-prod-github-runner-207 kernel: [18288.624647] Aug 22 10:29:02 juju-e4d256-prod-github-runner-207 kernel: [18316.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 16950s! [qemu-system-x86:6715] Aug 22 10:29:02 juju-e4d256-prod-github-runner-207 kernel: [18316.543108] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 10:29:02 juju-e4d256-prod-github-runner-207 kernel: [18316.543176] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 10:29:02 juju-e4d256-prod-github-runner-207 kernel: [18316.555244] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 10:29:02 juju-e4d256-prod-github-runner-207 kernel: [18316.556520] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 10:29:02 juju-e4d256-prod-github-runner-207 kernel: [18316.557746] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:29:02 juju-e4d256-prod-github-runner-207 kernel: [18316.558802] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 10:29:02 juju-e4d256-prod-github-runner-207 kernel: [18316.561362] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 10:29:02 juju-e4d256-prod-github-runner-207 kernel: [18316.562405] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 10:29:02 juju-e4d256-prod-github-runner-207 kernel: [18316.563572] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 10:29:02 juju-e4d256-prod-github-runner-207 kernel: [18316.564748] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 10:29:02 juju-e4d256-prod-github-runner-207 kernel: [18316.565907] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 10:29:02 juju-e4d256-prod-github-runner-207 kernel: [18316.567101] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 10:29:02 juju-e4d256-prod-github-runner-207 kernel: [18316.568265] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 10:29:02 juju-e4d256-prod-github-runner-207 kernel: [18316.569515] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 10:29:02 juju-e4d256-prod-github-runner-207 kernel: [18316.570618] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 10:29:02 juju-e4d256-prod-github-runner-207 kernel: [18316.571808] Call Trace: Aug 22 10:29:02 juju-e4d256-prod-github-runner-207 kernel: [18316.572731] Aug 22 10:29:02 juju-e4d256-prod-github-runner-207 kernel: [18316.573614] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:29:02 juju-e4d256-prod-github-runner-207 kernel: [18316.574647] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:29:02 juju-e4d256-prod-github-runner-207 kernel: [18316.575668] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:29:02 juju-e4d256-prod-github-runner-207 kernel: [18316.576756] ? show_regs.part.0+0x23/0x29 Aug 22 10:29:02 juju-e4d256-prod-github-runner-207 kernel: [18316.577758] ? show_regs.cold+0x8/0xd Aug 22 10:29:02 juju-e4d256-prod-github-runner-207 kernel: [18316.578733] ? watchdog_timer_fn+0x1be/0x220 Aug 22 10:29:02 juju-e4d256-prod-github-runner-207 kernel: [18316.579740] ? lockup_detector_update_enable+0x60/0x60 Aug 22 10:29:02 juju-e4d256-prod-github-runner-207 kernel: [18316.580816] ? __hrtimer_run_queues+0x107/0x230 Aug 22 10:29:02 juju-e4d256-prod-github-runner-207 kernel: [18316.581845] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 10:29:02 juju-e4d256-prod-github-runner-207 kernel: [18316.582872] ? hrtimer_interrupt+0x101/0x220 Aug 22 10:29:02 juju-e4d256-prod-github-runner-207 kernel: [18316.583891] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 10:29:02 juju-e4d256-prod-github-runner-207 kernel: [18316.584975] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 10:29:02 juju-e4d256-prod-github-runner-207 kernel: [18316.586022] Aug 22 10:29:02 juju-e4d256-prod-github-runner-207 kernel: [18316.586879] Aug 22 10:29:02 juju-e4d256-prod-github-runner-207 kernel: [18316.587716] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 10:29:02 juju-e4d256-prod-github-runner-207 kernel: [18316.588763] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:29:02 juju-e4d256-prod-github-runner-207 kernel: [18316.589837] ? _raw_spin_lock+0x22/0x30 Aug 22 10:29:02 juju-e4d256-prod-github-runner-207 kernel: [18316.590780] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:29:02 juju-e4d256-prod-github-runner-207 kernel: [18316.591799] direct_page_fault+0x206/0x310 [kvm] Aug 22 10:29:02 juju-e4d256-prod-github-runner-207 kernel: [18316.592837] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 10:29:02 juju-e4d256-prod-github-runner-207 kernel: [18316.593859] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 10:29:02 juju-e4d256-prod-github-runner-207 kernel: [18316.594890] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 10:29:02 juju-e4d256-prod-github-runner-207 kernel: [18316.595863] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 10:29:02 juju-e4d256-prod-github-runner-207 kernel: [18316.596823] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 10:29:02 juju-e4d256-prod-github-runner-207 kernel: [18316.597805] handle_exit+0x98/0x230 [kvm_amd] Aug 22 10:29:02 juju-e4d256-prod-github-runner-207 kernel: [18316.598697] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 10:29:02 juju-e4d256-prod-github-runner-207 kernel: [18316.599609] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 10:29:02 juju-e4d256-prod-github-runner-207 kernel: [18316.600562] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 10:29:02 juju-e4d256-prod-github-runner-207 kernel: [18316.601467] vcpu_run+0x62/0x2c0 [kvm] Aug 22 10:29:02 juju-e4d256-prod-github-runner-207 kernel: [18316.602278] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 10:29:02 juju-e4d256-prod-github-runner-207 kernel: [18316.603123] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 10:29:02 juju-e4d256-prod-github-runner-207 kernel: [18316.603979] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 10:29:02 juju-e4d256-prod-github-runner-207 kernel: [18316.604790] ? __seccomp_filter+0x4a/0x4a0 Aug 22 10:29:02 juju-e4d256-prod-github-runner-207 kernel: [18316.605539] ? __fget_files+0x86/0xc0 Aug 22 10:29:02 juju-e4d256-prod-github-runner-207 kernel: [18316.606242] __x64_sys_ioctl+0x95/0xd0 Aug 22 10:29:02 juju-e4d256-prod-github-runner-207 kernel: [18316.606934] do_syscall_64+0x5c/0xc0 Aug 22 10:29:02 juju-e4d256-prod-github-runner-207 kernel: [18316.607607] ? do_futex+0x162/0x1f0 Aug 22 10:29:02 juju-e4d256-prod-github-runner-207 kernel: [18316.608256] ? __x64_sys_futex+0x78/0x1e0 Aug 22 10:29:02 juju-e4d256-prod-github-runner-207 kernel: [18316.609104] ? __secure_computing+0xa9/0x120 Aug 22 10:29:02 juju-e4d256-prod-github-runner-207 kernel: [18316.609796] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 10:29:02 juju-e4d256-prod-github-runner-207 kernel: [18316.610572] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:29:02 juju-e4d256-prod-github-runner-207 kernel: [18316.611293] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:29:02 juju-e4d256-prod-github-runner-207 kernel: [18316.612013] ? do_syscall_64+0x69/0xc0 Aug 22 10:29:02 juju-e4d256-prod-github-runner-207 kernel: [18316.612680] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:29:02 juju-e4d256-prod-github-runner-207 kernel: [18316.613385] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:29:02 juju-e4d256-prod-github-runner-207 kernel: [18316.614086] ? do_syscall_64+0x69/0xc0 Aug 22 10:29:02 juju-e4d256-prod-github-runner-207 kernel: [18316.614711] ? do_syscall_64+0x69/0xc0 Aug 22 10:29:02 juju-e4d256-prod-github-runner-207 kernel: [18316.615333] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 10:29:02 juju-e4d256-prod-github-runner-207 kernel: [18316.616044] RIP: 0033:0x7faa5d0edaff Aug 22 10:29:02 juju-e4d256-prod-github-runner-207 kernel: [18316.616690] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 10:29:02 juju-e4d256-prod-github-runner-207 kernel: [18316.618679] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 10:29:02 juju-e4d256-prod-github-runner-207 kernel: [18316.619592] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 10:29:02 juju-e4d256-prod-github-runner-207 kernel: [18316.620504] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 10:29:02 juju-e4d256-prod-github-runner-207 kernel: [18316.621394] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 10:29:02 juju-e4d256-prod-github-runner-207 kernel: [18316.622283] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 10:29:02 juju-e4d256-prod-github-runner-207 kernel: [18316.623177] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 10:29:02 juju-e4d256-prod-github-runner-207 kernel: [18316.624069] Aug 22 10:29:30 juju-e4d256-prod-github-runner-207 kernel: [18344.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 16976s! [qemu-system-x86:6715] Aug 22 10:29:30 juju-e4d256-prod-github-runner-207 kernel: [18344.543718] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 10:29:30 juju-e4d256-prod-github-runner-207 kernel: [18344.543971] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 10:29:30 juju-e4d256-prod-github-runner-207 kernel: [18344.556073] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 10:29:30 juju-e4d256-prod-github-runner-207 kernel: [18344.557365] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 10:29:30 juju-e4d256-prod-github-runner-207 kernel: [18344.558582] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:29:30 juju-e4d256-prod-github-runner-207 kernel: [18344.559643] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 10:29:30 juju-e4d256-prod-github-runner-207 kernel: [18344.562218] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 10:29:30 juju-e4d256-prod-github-runner-207 kernel: [18344.563263] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 10:29:30 juju-e4d256-prod-github-runner-207 kernel: [18344.564437] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 10:29:30 juju-e4d256-prod-github-runner-207 kernel: [18344.565602] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 10:29:30 juju-e4d256-prod-github-runner-207 kernel: [18344.566764] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 10:29:30 juju-e4d256-prod-github-runner-207 kernel: [18344.567924] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 10:29:30 juju-e4d256-prod-github-runner-207 kernel: [18344.569104] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 10:29:30 juju-e4d256-prod-github-runner-207 kernel: [18344.570343] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 10:29:30 juju-e4d256-prod-github-runner-207 kernel: [18344.571443] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 10:29:30 juju-e4d256-prod-github-runner-207 kernel: [18344.572664] Call Trace: Aug 22 10:29:30 juju-e4d256-prod-github-runner-207 kernel: [18344.573581] Aug 22 10:29:30 juju-e4d256-prod-github-runner-207 kernel: [18344.574474] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:29:30 juju-e4d256-prod-github-runner-207 kernel: [18344.575501] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:29:30 juju-e4d256-prod-github-runner-207 kernel: [18344.576536] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:29:30 juju-e4d256-prod-github-runner-207 kernel: [18344.577627] ? show_regs.part.0+0x23/0x29 Aug 22 10:29:30 juju-e4d256-prod-github-runner-207 kernel: [18344.578621] ? show_regs.cold+0x8/0xd Aug 22 10:29:30 juju-e4d256-prod-github-runner-207 kernel: [18344.579596] ? watchdog_timer_fn+0x1be/0x220 Aug 22 10:29:30 juju-e4d256-prod-github-runner-207 kernel: [18344.580618] ? lockup_detector_update_enable+0x60/0x60 Aug 22 10:29:30 juju-e4d256-prod-github-runner-207 kernel: [18344.581681] ? __hrtimer_run_queues+0x107/0x230 Aug 22 10:29:30 juju-e4d256-prod-github-runner-207 kernel: [18344.582712] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 10:29:30 juju-e4d256-prod-github-runner-207 kernel: [18344.583734] ? hrtimer_interrupt+0x101/0x220 Aug 22 10:29:30 juju-e4d256-prod-github-runner-207 kernel: [18344.584763] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 10:29:30 juju-e4d256-prod-github-runner-207 kernel: [18344.585831] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 10:29:30 juju-e4d256-prod-github-runner-207 kernel: [18344.586875] Aug 22 10:29:30 juju-e4d256-prod-github-runner-207 kernel: [18344.587727] Aug 22 10:29:30 juju-e4d256-prod-github-runner-207 kernel: [18344.588579] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 10:29:30 juju-e4d256-prod-github-runner-207 kernel: [18344.589613] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:29:30 juju-e4d256-prod-github-runner-207 kernel: [18344.590788] ? _raw_spin_lock+0x22/0x30 Aug 22 10:29:30 juju-e4d256-prod-github-runner-207 kernel: [18344.591732] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:29:30 juju-e4d256-prod-github-runner-207 kernel: [18344.592759] direct_page_fault+0x206/0x310 [kvm] Aug 22 10:29:30 juju-e4d256-prod-github-runner-207 kernel: [18344.593783] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 10:29:30 juju-e4d256-prod-github-runner-207 kernel: [18344.594790] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 10:29:30 juju-e4d256-prod-github-runner-207 kernel: [18344.595791] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 10:29:30 juju-e4d256-prod-github-runner-207 kernel: [18344.596791] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 10:29:30 juju-e4d256-prod-github-runner-207 kernel: [18344.597739] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 10:29:30 juju-e4d256-prod-github-runner-207 kernel: [18344.598715] handle_exit+0x98/0x230 [kvm_amd] Aug 22 10:29:30 juju-e4d256-prod-github-runner-207 kernel: [18344.599606] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 10:29:30 juju-e4d256-prod-github-runner-207 kernel: [18344.600531] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 10:29:30 juju-e4d256-prod-github-runner-207 kernel: [18344.601456] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 10:29:30 juju-e4d256-prod-github-runner-207 kernel: [18344.602357] vcpu_run+0x62/0x2c0 [kvm] Aug 22 10:29:30 juju-e4d256-prod-github-runner-207 kernel: [18344.603172] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 10:29:30 juju-e4d256-prod-github-runner-207 kernel: [18344.603983] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 10:29:30 juju-e4d256-prod-github-runner-207 kernel: [18344.604850] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 10:29:30 juju-e4d256-prod-github-runner-207 kernel: [18344.605645] ? __seccomp_filter+0x4a/0x4a0 Aug 22 10:29:30 juju-e4d256-prod-github-runner-207 kernel: [18344.606391] ? __fget_files+0x86/0xc0 Aug 22 10:29:30 juju-e4d256-prod-github-runner-207 kernel: [18344.607094] __x64_sys_ioctl+0x95/0xd0 Aug 22 10:29:30 juju-e4d256-prod-github-runner-207 kernel: [18344.607787] do_syscall_64+0x5c/0xc0 Aug 22 10:29:30 juju-e4d256-prod-github-runner-207 kernel: [18344.608466] ? do_futex+0x162/0x1f0 Aug 22 10:29:30 juju-e4d256-prod-github-runner-207 kernel: [18344.609113] ? __x64_sys_futex+0x78/0x1e0 Aug 22 10:29:30 juju-e4d256-prod-github-runner-207 kernel: [18344.609785] ? __secure_computing+0xa9/0x120 Aug 22 10:29:30 juju-e4d256-prod-github-runner-207 kernel: [18344.610472] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 10:29:30 juju-e4d256-prod-github-runner-207 kernel: [18344.611231] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:29:30 juju-e4d256-prod-github-runner-207 kernel: [18344.611951] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:29:30 juju-e4d256-prod-github-runner-207 kernel: [18344.612685] ? do_syscall_64+0x69/0xc0 Aug 22 10:29:30 juju-e4d256-prod-github-runner-207 kernel: [18344.613330] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:29:30 juju-e4d256-prod-github-runner-207 kernel: [18344.614032] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:29:30 juju-e4d256-prod-github-runner-207 kernel: [18344.614725] ? do_syscall_64+0x69/0xc0 Aug 22 10:29:30 juju-e4d256-prod-github-runner-207 kernel: [18344.615349] ? do_syscall_64+0x69/0xc0 Aug 22 10:29:30 juju-e4d256-prod-github-runner-207 kernel: [18344.615970] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 10:29:30 juju-e4d256-prod-github-runner-207 kernel: [18344.616685] RIP: 0033:0x7faa5d0edaff Aug 22 10:29:30 juju-e4d256-prod-github-runner-207 kernel: [18344.617320] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 10:29:30 juju-e4d256-prod-github-runner-207 kernel: [18344.619305] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 10:29:30 juju-e4d256-prod-github-runner-207 kernel: [18344.620228] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 10:29:30 juju-e4d256-prod-github-runner-207 kernel: [18344.621119] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 10:29:30 juju-e4d256-prod-github-runner-207 kernel: [18344.622018] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 10:29:30 juju-e4d256-prod-github-runner-207 kernel: [18344.622904] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 10:29:30 juju-e4d256-prod-github-runner-207 kernel: [18344.623790] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 10:29:30 juju-e4d256-prod-github-runner-207 kernel: [18344.624707] Aug 22 10:29:44 juju-e4d256-prod-github-runner-207 kernel: [18358.412706] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 10:29:44 juju-e4d256-prod-github-runner-207 kernel: [18358.413682] rcu: 1-....: (4546080 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=2200244 Aug 22 10:29:44 juju-e4d256-prod-github-runner-207 kernel: [18358.414798] (t=4560303 jiffies g=23269 q=24841) Aug 22 10:29:44 juju-e4d256-prod-github-runner-207 kernel: [18358.415581] NMI backtrace for cpu 1 Aug 22 10:29:44 juju-e4d256-prod-github-runner-207 kernel: [18358.416309] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 10:29:44 juju-e4d256-prod-github-runner-207 kernel: [18358.417419] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 10:29:44 juju-e4d256-prod-github-runner-207 kernel: [18358.418481] Call Trace: Aug 22 10:29:44 juju-e4d256-prod-github-runner-207 kernel: [18358.419158] Aug 22 10:29:44 juju-e4d256-prod-github-runner-207 kernel: [18358.419800] show_stack+0x52/0x5c Aug 22 10:29:44 juju-e4d256-prod-github-runner-207 kernel: [18358.420535] dump_stack_lvl+0x4a/0x63 Aug 22 10:29:44 juju-e4d256-prod-github-runner-207 kernel: [18358.421278] dump_stack+0x10/0x16 Aug 22 10:29:44 juju-e4d256-prod-github-runner-207 kernel: [18358.421997] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 10:29:44 juju-e4d256-prod-github-runner-207 kernel: [18358.422775] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 10:29:44 juju-e4d256-prod-github-runner-207 kernel: [18358.423549] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 10:29:44 juju-e4d256-prod-github-runner-207 kernel: [18358.424388] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 10:29:44 juju-e4d256-prod-github-runner-207 kernel: [18358.425207] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 10:29:44 juju-e4d256-prod-github-runner-207 kernel: [18358.426012] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 10:29:44 juju-e4d256-prod-github-runner-207 kernel: [18358.426781] print_cpu_stall.cold+0x2f/0xe2 Aug 22 10:29:44 juju-e4d256-prod-github-runner-207 kernel: [18358.427543] ? timekeeping_update+0xf7/0x150 Aug 22 10:29:44 juju-e4d256-prod-github-runner-207 kernel: [18358.428327] check_cpu_stall+0x109/0x270 Aug 22 10:29:44 juju-e4d256-prod-github-runner-207 kernel: [18358.429075] rcu_sched_clock_irq+0x9a/0x250 Aug 22 10:29:44 juju-e4d256-prod-github-runner-207 kernel: [18358.429834] update_process_times+0x94/0xd0 Aug 22 10:29:44 juju-e4d256-prod-github-runner-207 kernel: [18358.430593] tick_sched_handle+0x29/0x70 Aug 22 10:29:44 juju-e4d256-prod-github-runner-207 kernel: [18358.431336] tick_sched_timer+0x8c/0xc0 Aug 22 10:29:44 juju-e4d256-prod-github-runner-207 kernel: [18358.432082] ? tick_nohz_handler+0xb0/0xb0 Aug 22 10:29:44 juju-e4d256-prod-github-runner-207 kernel: [18358.432836] __hrtimer_run_queues+0x107/0x230 Aug 22 10:29:44 juju-e4d256-prod-github-runner-207 kernel: [18358.433610] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 10:29:44 juju-e4d256-prod-github-runner-207 kernel: [18358.434385] hrtimer_interrupt+0x101/0x220 Aug 22 10:29:44 juju-e4d256-prod-github-runner-207 kernel: [18358.435148] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 10:29:44 juju-e4d256-prod-github-runner-207 kernel: [18358.435958] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 10:29:44 juju-e4d256-prod-github-runner-207 kernel: [18358.436771] Aug 22 10:29:44 juju-e4d256-prod-github-runner-207 kernel: [18358.437404] Aug 22 10:29:44 juju-e4d256-prod-github-runner-207 kernel: [18358.438030] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 10:29:44 juju-e4d256-prod-github-runner-207 kernel: [18358.438850] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:29:44 juju-e4d256-prod-github-runner-207 kernel: [18358.439761] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 10:29:44 juju-e4d256-prod-github-runner-207 kernel: [18358.442002] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 10:29:44 juju-e4d256-prod-github-runner-207 kernel: [18358.442875] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 10:29:44 juju-e4d256-prod-github-runner-207 kernel: [18358.443872] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 10:29:44 juju-e4d256-prod-github-runner-207 kernel: [18358.444855] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 10:29:44 juju-e4d256-prod-github-runner-207 kernel: [18358.445816] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 10:29:44 juju-e4d256-prod-github-runner-207 kernel: [18358.446768] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 10:29:44 juju-e4d256-prod-github-runner-207 kernel: [18358.447727] ? _raw_spin_lock+0x22/0x30 Aug 22 10:29:44 juju-e4d256-prod-github-runner-207 kernel: [18358.448492] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:29:44 juju-e4d256-prod-github-runner-207 kernel: [18358.449329] direct_page_fault+0x206/0x310 [kvm] Aug 22 10:29:44 juju-e4d256-prod-github-runner-207 kernel: [18358.450164] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 10:29:44 juju-e4d256-prod-github-runner-207 kernel: [18358.450994] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 10:29:44 juju-e4d256-prod-github-runner-207 kernel: [18358.451812] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 10:29:44 juju-e4d256-prod-github-runner-207 kernel: [18358.452664] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 10:29:44 juju-e4d256-prod-github-runner-207 kernel: [18358.453482] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 10:29:44 juju-e4d256-prod-github-runner-207 kernel: [18358.454310] handle_exit+0x98/0x230 [kvm_amd] Aug 22 10:29:44 juju-e4d256-prod-github-runner-207 kernel: [18358.455063] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 10:29:44 juju-e4d256-prod-github-runner-207 kernel: [18358.455843] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 10:29:44 juju-e4d256-prod-github-runner-207 kernel: [18358.456655] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 10:29:44 juju-e4d256-prod-github-runner-207 kernel: [18358.457439] vcpu_run+0x62/0x2c0 [kvm] Aug 22 10:29:44 juju-e4d256-prod-github-runner-207 kernel: [18358.458155] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 10:29:44 juju-e4d256-prod-github-runner-207 kernel: [18358.458886] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 10:29:44 juju-e4d256-prod-github-runner-207 kernel: [18358.459682] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 10:29:44 juju-e4d256-prod-github-runner-207 kernel: [18358.460462] ? __seccomp_filter+0x4a/0x4a0 Aug 22 10:29:44 juju-e4d256-prod-github-runner-207 kernel: [18358.461182] ? __fget_files+0x86/0xc0 Aug 22 10:29:44 juju-e4d256-prod-github-runner-207 kernel: [18358.461871] __x64_sys_ioctl+0x95/0xd0 Aug 22 10:29:44 juju-e4d256-prod-github-runner-207 kernel: [18358.462562] do_syscall_64+0x5c/0xc0 Aug 22 10:29:44 juju-e4d256-prod-github-runner-207 kernel: [18358.463277] ? do_futex+0x162/0x1f0 Aug 22 10:29:44 juju-e4d256-prod-github-runner-207 kernel: [18358.463960] ? __x64_sys_futex+0x78/0x1e0 Aug 22 10:29:44 juju-e4d256-prod-github-runner-207 kernel: [18358.464674] ? __secure_computing+0xa9/0x120 Aug 22 10:29:44 juju-e4d256-prod-github-runner-207 kernel: [18358.465425] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 10:29:44 juju-e4d256-prod-github-runner-207 kernel: [18358.466218] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:29:44 juju-e4d256-prod-github-runner-207 kernel: [18358.466968] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:29:44 juju-e4d256-prod-github-runner-207 kernel: [18358.467717] ? do_syscall_64+0x69/0xc0 Aug 22 10:29:44 juju-e4d256-prod-github-runner-207 kernel: [18358.468448] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:29:44 juju-e4d256-prod-github-runner-207 kernel: [18358.469207] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:29:44 juju-e4d256-prod-github-runner-207 kernel: [18358.469960] ? do_syscall_64+0x69/0xc0 Aug 22 10:29:44 juju-e4d256-prod-github-runner-207 kernel: [18358.470652] ? do_syscall_64+0x69/0xc0 Aug 22 10:29:44 juju-e4d256-prod-github-runner-207 kernel: [18358.471337] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 10:29:44 juju-e4d256-prod-github-runner-207 kernel: [18358.472116] RIP: 0033:0x7faa5d0edaff Aug 22 10:29:44 juju-e4d256-prod-github-runner-207 kernel: [18358.472813] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 10:29:44 juju-e4d256-prod-github-runner-207 kernel: [18358.474928] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 10:29:44 juju-e4d256-prod-github-runner-207 kernel: [18358.475907] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 10:29:44 juju-e4d256-prod-github-runner-207 kernel: [18358.476905] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 10:29:44 juju-e4d256-prod-github-runner-207 kernel: [18358.477846] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 10:29:44 juju-e4d256-prod-github-runner-207 kernel: [18358.478784] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 10:29:44 juju-e4d256-prod-github-runner-207 kernel: [18358.479708] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 10:29:44 juju-e4d256-prod-github-runner-207 kernel: [18358.480629] Aug 22 10:30:10 juju-e4d256-prod-github-runner-207 kernel: [18384.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 17013s! [qemu-system-x86:6715] Aug 22 10:30:10 juju-e4d256-prod-github-runner-207 kernel: [18384.543086] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 10:30:10 juju-e4d256-prod-github-runner-207 kernel: [18384.543152] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 10:30:10 juju-e4d256-prod-github-runner-207 kernel: [18384.555240] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 10:30:10 juju-e4d256-prod-github-runner-207 kernel: [18384.556506] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 10:30:10 juju-e4d256-prod-github-runner-207 kernel: [18384.557770] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:30:10 juju-e4d256-prod-github-runner-207 kernel: [18384.558836] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 10:30:10 juju-e4d256-prod-github-runner-207 kernel: [18384.561419] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 10:30:10 juju-e4d256-prod-github-runner-207 kernel: [18384.562465] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 10:30:10 juju-e4d256-prod-github-runner-207 kernel: [18384.563627] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 10:30:10 juju-e4d256-prod-github-runner-207 kernel: [18384.564974] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 10:30:10 juju-e4d256-prod-github-runner-207 kernel: [18384.566142] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 10:30:10 juju-e4d256-prod-github-runner-207 kernel: [18384.567310] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 10:30:10 juju-e4d256-prod-github-runner-207 kernel: [18384.568533] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 10:30:10 juju-e4d256-prod-github-runner-207 kernel: [18384.569775] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 10:30:10 juju-e4d256-prod-github-runner-207 kernel: [18384.570875] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 10:30:10 juju-e4d256-prod-github-runner-207 kernel: [18384.572084] Call Trace: Aug 22 10:30:10 juju-e4d256-prod-github-runner-207 kernel: [18384.573001] Aug 22 10:30:10 juju-e4d256-prod-github-runner-207 kernel: [18384.573889] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:30:10 juju-e4d256-prod-github-runner-207 kernel: [18384.574924] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:30:10 juju-e4d256-prod-github-runner-207 kernel: [18384.575951] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:30:10 juju-e4d256-prod-github-runner-207 kernel: [18384.577029] ? show_regs.part.0+0x23/0x29 Aug 22 10:30:10 juju-e4d256-prod-github-runner-207 kernel: [18384.578033] ? show_regs.cold+0x8/0xd Aug 22 10:30:10 juju-e4d256-prod-github-runner-207 kernel: [18384.579020] ? watchdog_timer_fn+0x1be/0x220 Aug 22 10:30:10 juju-e4d256-prod-github-runner-207 kernel: [18384.580045] ? lockup_detector_update_enable+0x60/0x60 Aug 22 10:30:10 juju-e4d256-prod-github-runner-207 kernel: [18384.581108] ? __hrtimer_run_queues+0x107/0x230 Aug 22 10:30:10 juju-e4d256-prod-github-runner-207 kernel: [18384.582138] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 10:30:10 juju-e4d256-prod-github-runner-207 kernel: [18384.583161] ? hrtimer_interrupt+0x101/0x220 Aug 22 10:30:10 juju-e4d256-prod-github-runner-207 kernel: [18384.584188] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 10:30:10 juju-e4d256-prod-github-runner-207 kernel: [18384.585257] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 10:30:10 juju-e4d256-prod-github-runner-207 kernel: [18384.586301] Aug 22 10:30:10 juju-e4d256-prod-github-runner-207 kernel: [18384.587153] Aug 22 10:30:10 juju-e4d256-prod-github-runner-207 kernel: [18384.588000] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 10:30:10 juju-e4d256-prod-github-runner-207 kernel: [18384.589049] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:30:10 juju-e4d256-prod-github-runner-207 kernel: [18384.590095] ? _raw_spin_lock+0x22/0x30 Aug 22 10:30:10 juju-e4d256-prod-github-runner-207 kernel: [18384.591045] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:30:10 juju-e4d256-prod-github-runner-207 kernel: [18384.592074] direct_page_fault+0x206/0x310 [kvm] Aug 22 10:30:10 juju-e4d256-prod-github-runner-207 kernel: [18384.593096] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 10:30:10 juju-e4d256-prod-github-runner-207 kernel: [18384.594244] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 10:30:10 juju-e4d256-prod-github-runner-207 kernel: [18384.595282] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 10:30:10 juju-e4d256-prod-github-runner-207 kernel: [18384.596268] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 10:30:10 juju-e4d256-prod-github-runner-207 kernel: [18384.597214] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 10:30:10 juju-e4d256-prod-github-runner-207 kernel: [18384.598191] handle_exit+0x98/0x230 [kvm_amd] Aug 22 10:30:10 juju-e4d256-prod-github-runner-207 kernel: [18384.599285] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 10:30:10 juju-e4d256-prod-github-runner-207 kernel: [18384.600228] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 10:30:10 juju-e4d256-prod-github-runner-207 kernel: [18384.601154] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 10:30:10 juju-e4d256-prod-github-runner-207 kernel: [18384.602059] vcpu_run+0x62/0x2c0 [kvm] Aug 22 10:30:10 juju-e4d256-prod-github-runner-207 kernel: [18384.602870] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 10:30:10 juju-e4d256-prod-github-runner-207 kernel: [18384.603676] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 10:30:10 juju-e4d256-prod-github-runner-207 kernel: [18384.604547] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 10:30:10 juju-e4d256-prod-github-runner-207 kernel: [18384.605344] ? __seccomp_filter+0x4a/0x4a0 Aug 22 10:30:10 juju-e4d256-prod-github-runner-207 kernel: [18384.606085] ? __fget_files+0x86/0xc0 Aug 22 10:30:10 juju-e4d256-prod-github-runner-207 kernel: [18384.606792] __x64_sys_ioctl+0x95/0xd0 Aug 22 10:30:10 juju-e4d256-prod-github-runner-207 kernel: [18384.607488] do_syscall_64+0x5c/0xc0 Aug 22 10:30:10 juju-e4d256-prod-github-runner-207 kernel: [18384.608167] ? do_futex+0x162/0x1f0 Aug 22 10:30:10 juju-e4d256-prod-github-runner-207 kernel: [18384.608816] ? __x64_sys_futex+0x78/0x1e0 Aug 22 10:30:10 juju-e4d256-prod-github-runner-207 kernel: [18384.609507] ? __secure_computing+0xa9/0x120 Aug 22 10:30:10 juju-e4d256-prod-github-runner-207 kernel: [18384.610200] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 10:30:10 juju-e4d256-prod-github-runner-207 kernel: [18384.610960] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:30:10 juju-e4d256-prod-github-runner-207 kernel: [18384.611706] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:30:10 juju-e4d256-prod-github-runner-207 kernel: [18384.612434] ? do_syscall_64+0x69/0xc0 Aug 22 10:30:10 juju-e4d256-prod-github-runner-207 kernel: [18384.613078] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:30:10 juju-e4d256-prod-github-runner-207 kernel: [18384.613782] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:30:10 juju-e4d256-prod-github-runner-207 kernel: [18384.614486] ? do_syscall_64+0x69/0xc0 Aug 22 10:30:10 juju-e4d256-prod-github-runner-207 kernel: [18384.615110] ? do_syscall_64+0x69/0xc0 Aug 22 10:30:10 juju-e4d256-prod-github-runner-207 kernel: [18384.615745] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 10:30:10 juju-e4d256-prod-github-runner-207 kernel: [18384.616450] RIP: 0033:0x7faa5d0edaff Aug 22 10:30:10 juju-e4d256-prod-github-runner-207 kernel: [18384.617072] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 10:30:10 juju-e4d256-prod-github-runner-207 kernel: [18384.619055] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 10:30:10 juju-e4d256-prod-github-runner-207 kernel: [18384.620000] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 10:30:10 juju-e4d256-prod-github-runner-207 kernel: [18384.620901] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 10:30:10 juju-e4d256-prod-github-runner-207 kernel: [18384.621797] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 10:30:10 juju-e4d256-prod-github-runner-207 kernel: [18384.622685] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 10:30:10 juju-e4d256-prod-github-runner-207 kernel: [18384.623573] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 10:30:10 juju-e4d256-prod-github-runner-207 kernel: [18384.624644] Aug 22 10:30:38 juju-e4d256-prod-github-runner-207 kernel: [18412.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 17040s! [qemu-system-x86:6715] Aug 22 10:30:38 juju-e4d256-prod-github-runner-207 kernel: [18412.543106] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 10:30:38 juju-e4d256-prod-github-runner-207 kernel: [18412.543175] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 10:30:38 juju-e4d256-prod-github-runner-207 kernel: [18412.555284] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 10:30:38 juju-e4d256-prod-github-runner-207 kernel: [18412.556561] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 10:30:38 juju-e4d256-prod-github-runner-207 kernel: [18412.557782] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:30:38 juju-e4d256-prod-github-runner-207 kernel: [18412.558845] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 10:30:38 juju-e4d256-prod-github-runner-207 kernel: [18412.561400] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 10:30:38 juju-e4d256-prod-github-runner-207 kernel: [18412.562447] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 10:30:38 juju-e4d256-prod-github-runner-207 kernel: [18412.563617] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 10:30:38 juju-e4d256-prod-github-runner-207 kernel: [18412.564783] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 10:30:38 juju-e4d256-prod-github-runner-207 kernel: [18412.565948] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 10:30:38 juju-e4d256-prod-github-runner-207 kernel: [18412.567108] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 10:30:38 juju-e4d256-prod-github-runner-207 kernel: [18412.568285] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 10:30:38 juju-e4d256-prod-github-runner-207 kernel: [18412.569523] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 10:30:38 juju-e4d256-prod-github-runner-207 kernel: [18412.570630] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 10:30:38 juju-e4d256-prod-github-runner-207 kernel: [18412.571835] Call Trace: Aug 22 10:30:38 juju-e4d256-prod-github-runner-207 kernel: [18412.572752] Aug 22 10:30:38 juju-e4d256-prod-github-runner-207 kernel: [18412.573636] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:30:38 juju-e4d256-prod-github-runner-207 kernel: [18412.574670] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:30:38 juju-e4d256-prod-github-runner-207 kernel: [18412.575699] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:30:38 juju-e4d256-prod-github-runner-207 kernel: [18412.576780] ? show_regs.part.0+0x23/0x29 Aug 22 10:30:38 juju-e4d256-prod-github-runner-207 kernel: [18412.577777] ? show_regs.cold+0x8/0xd Aug 22 10:30:38 juju-e4d256-prod-github-runner-207 kernel: [18412.578748] ? watchdog_timer_fn+0x1be/0x220 Aug 22 10:30:38 juju-e4d256-prod-github-runner-207 kernel: [18412.579769] ? lockup_detector_update_enable+0x60/0x60 Aug 22 10:30:38 juju-e4d256-prod-github-runner-207 kernel: [18412.580838] ? __hrtimer_run_queues+0x107/0x230 Aug 22 10:30:38 juju-e4d256-prod-github-runner-207 kernel: [18412.581865] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 10:30:38 juju-e4d256-prod-github-runner-207 kernel: [18412.582888] ? hrtimer_interrupt+0x101/0x220 Aug 22 10:30:38 juju-e4d256-prod-github-runner-207 kernel: [18412.583916] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 10:30:38 juju-e4d256-prod-github-runner-207 kernel: [18412.584990] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 10:30:38 juju-e4d256-prod-github-runner-207 kernel: [18412.586041] Aug 22 10:30:38 juju-e4d256-prod-github-runner-207 kernel: [18412.586899] Aug 22 10:30:38 juju-e4d256-prod-github-runner-207 kernel: [18412.587749] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 10:30:38 juju-e4d256-prod-github-runner-207 kernel: [18412.588782] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:30:38 juju-e4d256-prod-github-runner-207 kernel: [18412.589825] ? _raw_spin_lock+0x22/0x30 Aug 22 10:30:38 juju-e4d256-prod-github-runner-207 kernel: [18412.590770] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:30:38 juju-e4d256-prod-github-runner-207 kernel: [18412.591796] direct_page_fault+0x206/0x310 [kvm] Aug 22 10:30:38 juju-e4d256-prod-github-runner-207 kernel: [18412.592820] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 10:30:38 juju-e4d256-prod-github-runner-207 kernel: [18412.593827] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 10:30:38 juju-e4d256-prod-github-runner-207 kernel: [18412.594830] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 10:30:38 juju-e4d256-prod-github-runner-207 kernel: [18412.595804] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 10:30:38 juju-e4d256-prod-github-runner-207 kernel: [18412.596755] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 10:30:38 juju-e4d256-prod-github-runner-207 kernel: [18412.597731] handle_exit+0x98/0x230 [kvm_amd] Aug 22 10:30:38 juju-e4d256-prod-github-runner-207 kernel: [18412.598622] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 10:30:38 juju-e4d256-prod-github-runner-207 kernel: [18412.599551] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 10:30:38 juju-e4d256-prod-github-runner-207 kernel: [18412.600480] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 10:30:38 juju-e4d256-prod-github-runner-207 kernel: [18412.601388] vcpu_run+0x62/0x2c0 [kvm] Aug 22 10:30:38 juju-e4d256-prod-github-runner-207 kernel: [18412.602197] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 10:30:38 juju-e4d256-prod-github-runner-207 kernel: [18412.603008] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 10:30:38 juju-e4d256-prod-github-runner-207 kernel: [18412.603877] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 10:30:38 juju-e4d256-prod-github-runner-207 kernel: [18412.604774] ? __seccomp_filter+0x4a/0x4a0 Aug 22 10:30:38 juju-e4d256-prod-github-runner-207 kernel: [18412.605517] ? __fget_files+0x86/0xc0 Aug 22 10:30:38 juju-e4d256-prod-github-runner-207 kernel: [18412.606220] __x64_sys_ioctl+0x95/0xd0 Aug 22 10:30:38 juju-e4d256-prod-github-runner-207 kernel: [18412.606918] do_syscall_64+0x5c/0xc0 Aug 22 10:30:38 juju-e4d256-prod-github-runner-207 kernel: [18412.607590] ? do_futex+0x162/0x1f0 Aug 22 10:30:38 juju-e4d256-prod-github-runner-207 kernel: [18412.608240] ? __x64_sys_futex+0x78/0x1e0 Aug 22 10:30:38 juju-e4d256-prod-github-runner-207 kernel: [18412.608912] ? __secure_computing+0xa9/0x120 Aug 22 10:30:38 juju-e4d256-prod-github-runner-207 kernel: [18412.609600] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 10:30:38 juju-e4d256-prod-github-runner-207 kernel: [18412.610361] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:30:38 juju-e4d256-prod-github-runner-207 kernel: [18412.611083] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:30:38 juju-e4d256-prod-github-runner-207 kernel: [18412.611815] ? do_syscall_64+0x69/0xc0 Aug 22 10:30:38 juju-e4d256-prod-github-runner-207 kernel: [18412.612459] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:30:38 juju-e4d256-prod-github-runner-207 kernel: [18412.613162] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:30:38 juju-e4d256-prod-github-runner-207 kernel: [18412.613862] ? do_syscall_64+0x69/0xc0 Aug 22 10:30:38 juju-e4d256-prod-github-runner-207 kernel: [18412.614485] ? do_syscall_64+0x69/0xc0 Aug 22 10:30:38 juju-e4d256-prod-github-runner-207 kernel: [18412.615106] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 10:30:38 juju-e4d256-prod-github-runner-207 kernel: [18412.615821] RIP: 0033:0x7faa5d0edaff Aug 22 10:30:38 juju-e4d256-prod-github-runner-207 kernel: [18412.616464] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 10:30:38 juju-e4d256-prod-github-runner-207 kernel: [18412.618490] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 10:30:38 juju-e4d256-prod-github-runner-207 kernel: [18412.619412] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 10:30:38 juju-e4d256-prod-github-runner-207 kernel: [18412.620308] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 10:30:38 juju-e4d256-prod-github-runner-207 kernel: [18412.621197] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 10:30:38 juju-e4d256-prod-github-runner-207 kernel: [18412.622092] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 10:30:38 juju-e4d256-prod-github-runner-207 kernel: [18412.622984] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 10:30:38 juju-e4d256-prod-github-runner-207 kernel: [18412.623886] Aug 22 10:31:06 juju-e4d256-prod-github-runner-207 kernel: [18440.541976] watchdog: BUG: soft lockup - CPU#1 stuck for 17066s! [qemu-system-x86:6715] Aug 22 10:31:06 juju-e4d256-prod-github-runner-207 kernel: [18440.543733] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 10:31:06 juju-e4d256-prod-github-runner-207 kernel: [18440.543990] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 10:31:06 juju-e4d256-prod-github-runner-207 kernel: [18440.556128] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 10:31:06 juju-e4d256-prod-github-runner-207 kernel: [18440.557394] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 10:31:06 juju-e4d256-prod-github-runner-207 kernel: [18440.558615] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:31:06 juju-e4d256-prod-github-runner-207 kernel: [18440.559694] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 10:31:06 juju-e4d256-prod-github-runner-207 kernel: [18440.562244] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 10:31:06 juju-e4d256-prod-github-runner-207 kernel: [18440.563296] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 10:31:06 juju-e4d256-prod-github-runner-207 kernel: [18440.564462] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 10:31:06 juju-e4d256-prod-github-runner-207 kernel: [18440.565624] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 10:31:06 juju-e4d256-prod-github-runner-207 kernel: [18440.566781] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 10:31:06 juju-e4d256-prod-github-runner-207 kernel: [18440.567953] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 10:31:06 juju-e4d256-prod-github-runner-207 kernel: [18440.569122] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 10:31:06 juju-e4d256-prod-github-runner-207 kernel: [18440.570357] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 10:31:06 juju-e4d256-prod-github-runner-207 kernel: [18440.571467] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 10:31:06 juju-e4d256-prod-github-runner-207 kernel: [18440.572663] Call Trace: Aug 22 10:31:06 juju-e4d256-prod-github-runner-207 kernel: [18440.573575] Aug 22 10:31:06 juju-e4d256-prod-github-runner-207 kernel: [18440.574464] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:31:06 juju-e4d256-prod-github-runner-207 kernel: [18440.575546] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:31:06 juju-e4d256-prod-github-runner-207 kernel: [18440.576604] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:31:06 juju-e4d256-prod-github-runner-207 kernel: [18440.577690] ? show_regs.part.0+0x23/0x29 Aug 22 10:31:06 juju-e4d256-prod-github-runner-207 kernel: [18440.578690] ? show_regs.cold+0x8/0xd Aug 22 10:31:06 juju-e4d256-prod-github-runner-207 kernel: [18440.579679] ? watchdog_timer_fn+0x1be/0x220 Aug 22 10:31:06 juju-e4d256-prod-github-runner-207 kernel: [18440.580697] ? lockup_detector_update_enable+0x60/0x60 Aug 22 10:31:06 juju-e4d256-prod-github-runner-207 kernel: [18440.581763] ? __hrtimer_run_queues+0x107/0x230 Aug 22 10:31:06 juju-e4d256-prod-github-runner-207 kernel: [18440.582787] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 10:31:06 juju-e4d256-prod-github-runner-207 kernel: [18440.583823] ? hrtimer_interrupt+0x101/0x220 Aug 22 10:31:06 juju-e4d256-prod-github-runner-207 kernel: [18440.584843] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 10:31:06 juju-e4d256-prod-github-runner-207 kernel: [18440.585914] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 10:31:06 juju-e4d256-prod-github-runner-207 kernel: [18440.586956] Aug 22 10:31:06 juju-e4d256-prod-github-runner-207 kernel: [18440.587824] Aug 22 10:31:06 juju-e4d256-prod-github-runner-207 kernel: [18440.588659] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 10:31:06 juju-e4d256-prod-github-runner-207 kernel: [18440.589692] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:31:06 juju-e4d256-prod-github-runner-207 kernel: [18440.590737] ? _raw_spin_lock+0x22/0x30 Aug 22 10:31:06 juju-e4d256-prod-github-runner-207 kernel: [18440.591693] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:31:06 juju-e4d256-prod-github-runner-207 kernel: [18440.592711] direct_page_fault+0x206/0x310 [kvm] Aug 22 10:31:06 juju-e4d256-prod-github-runner-207 kernel: [18440.593738] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 10:31:06 juju-e4d256-prod-github-runner-207 kernel: [18440.594750] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 10:31:06 juju-e4d256-prod-github-runner-207 kernel: [18440.595763] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 10:31:06 juju-e4d256-prod-github-runner-207 kernel: [18440.596747] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 10:31:06 juju-e4d256-prod-github-runner-207 kernel: [18440.597693] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 10:31:06 juju-e4d256-prod-github-runner-207 kernel: [18440.598669] handle_exit+0x98/0x230 [kvm_amd] Aug 22 10:31:06 juju-e4d256-prod-github-runner-207 kernel: [18440.599583] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 10:31:06 juju-e4d256-prod-github-runner-207 kernel: [18440.600498] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 10:31:06 juju-e4d256-prod-github-runner-207 kernel: [18440.601430] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 10:31:06 juju-e4d256-prod-github-runner-207 kernel: [18440.602337] vcpu_run+0x62/0x2c0 [kvm] Aug 22 10:31:06 juju-e4d256-prod-github-runner-207 kernel: [18440.603158] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 10:31:06 juju-e4d256-prod-github-runner-207 kernel: [18440.603966] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 10:31:06 juju-e4d256-prod-github-runner-207 kernel: [18440.604823] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 10:31:06 juju-e4d256-prod-github-runner-207 kernel: [18440.605618] ? __seccomp_filter+0x4a/0x4a0 Aug 22 10:31:06 juju-e4d256-prod-github-runner-207 kernel: [18440.606450] ? __fget_files+0x86/0xc0 Aug 22 10:31:06 juju-e4d256-prod-github-runner-207 kernel: [18440.607246] __x64_sys_ioctl+0x95/0xd0 Aug 22 10:31:06 juju-e4d256-prod-github-runner-207 kernel: [18440.608013] do_syscall_64+0x5c/0xc0 Aug 22 10:31:06 juju-e4d256-prod-github-runner-207 kernel: [18440.608749] ? do_futex+0x162/0x1f0 Aug 22 10:31:06 juju-e4d256-prod-github-runner-207 kernel: [18440.609465] ? __x64_sys_futex+0x78/0x1e0 Aug 22 10:31:06 juju-e4d256-prod-github-runner-207 kernel: [18440.610220] ? __secure_computing+0xa9/0x120 Aug 22 10:31:06 juju-e4d256-prod-github-runner-207 kernel: [18440.611005] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 10:31:06 juju-e4d256-prod-github-runner-207 kernel: [18440.611892] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:31:06 juju-e4d256-prod-github-runner-207 kernel: [18440.612706] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:31:06 juju-e4d256-prod-github-runner-207 kernel: [18440.613520] ? do_syscall_64+0x69/0xc0 Aug 22 10:31:06 juju-e4d256-prod-github-runner-207 kernel: [18440.614246] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:31:06 juju-e4d256-prod-github-runner-207 kernel: [18440.615073] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:31:06 juju-e4d256-prod-github-runner-207 kernel: [18440.615860] ? do_syscall_64+0x69/0xc0 Aug 22 10:31:06 juju-e4d256-prod-github-runner-207 kernel: [18440.616557] ? do_syscall_64+0x69/0xc0 Aug 22 10:31:06 juju-e4d256-prod-github-runner-207 kernel: [18440.617260] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 10:31:06 juju-e4d256-prod-github-runner-207 kernel: [18440.618068] RIP: 0033:0x7faa5d0edaff Aug 22 10:31:06 juju-e4d256-prod-github-runner-207 kernel: [18440.618781] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 10:31:06 juju-e4d256-prod-github-runner-207 kernel: [18440.621100] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 10:31:06 juju-e4d256-prod-github-runner-207 kernel: [18440.622152] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 10:31:06 juju-e4d256-prod-github-runner-207 kernel: [18440.623188] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 10:31:06 juju-e4d256-prod-github-runner-207 kernel: [18440.624204] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 10:31:06 juju-e4d256-prod-github-runner-207 kernel: [18440.625233] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 10:31:06 juju-e4d256-prod-github-runner-207 kernel: [18440.626334] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 10:31:06 juju-e4d256-prod-github-runner-207 kernel: [18440.627385] Aug 22 10:31:34 juju-e4d256-prod-github-runner-207 kernel: [18468.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 17092s! [qemu-system-x86:6715] Aug 22 10:31:34 juju-e4d256-prod-github-runner-207 kernel: [18468.543129] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 10:31:34 juju-e4d256-prod-github-runner-207 kernel: [18468.543197] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 10:31:34 juju-e4d256-prod-github-runner-207 kernel: [18468.555253] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 10:31:34 juju-e4d256-prod-github-runner-207 kernel: [18468.556531] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 10:31:34 juju-e4d256-prod-github-runner-207 kernel: [18468.557766] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:31:34 juju-e4d256-prod-github-runner-207 kernel: [18468.558847] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 10:31:34 juju-e4d256-prod-github-runner-207 kernel: [18468.561395] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 10:31:34 juju-e4d256-prod-github-runner-207 kernel: [18468.562437] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 10:31:34 juju-e4d256-prod-github-runner-207 kernel: [18468.563621] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 10:31:34 juju-e4d256-prod-github-runner-207 kernel: [18468.564785] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 10:31:34 juju-e4d256-prod-github-runner-207 kernel: [18468.565947] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 10:31:34 juju-e4d256-prod-github-runner-207 kernel: [18468.567119] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 10:31:34 juju-e4d256-prod-github-runner-207 kernel: [18468.568286] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 10:31:34 juju-e4d256-prod-github-runner-207 kernel: [18468.569522] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 10:31:34 juju-e4d256-prod-github-runner-207 kernel: [18468.570624] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 10:31:34 juju-e4d256-prod-github-runner-207 kernel: [18468.571827] Call Trace: Aug 22 10:31:34 juju-e4d256-prod-github-runner-207 kernel: [18468.572737] Aug 22 10:31:34 juju-e4d256-prod-github-runner-207 kernel: [18468.573625] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:31:34 juju-e4d256-prod-github-runner-207 kernel: [18468.574653] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:31:34 juju-e4d256-prod-github-runner-207 kernel: [18468.575684] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:31:34 juju-e4d256-prod-github-runner-207 kernel: [18468.576933] ? show_regs.part.0+0x23/0x29 Aug 22 10:31:34 juju-e4d256-prod-github-runner-207 kernel: [18468.577930] ? show_regs.cold+0x8/0xd Aug 22 10:31:34 juju-e4d256-prod-github-runner-207 kernel: [18468.578917] ? watchdog_timer_fn+0x1be/0x220 Aug 22 10:31:34 juju-e4d256-prod-github-runner-207 kernel: [18468.579925] ? lockup_detector_update_enable+0x60/0x60 Aug 22 10:31:34 juju-e4d256-prod-github-runner-207 kernel: [18468.580990] ? __hrtimer_run_queues+0x107/0x230 Aug 22 10:31:34 juju-e4d256-prod-github-runner-207 kernel: [18468.582016] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 10:31:34 juju-e4d256-prod-github-runner-207 kernel: [18468.583059] ? hrtimer_interrupt+0x101/0x220 Aug 22 10:31:34 juju-e4d256-prod-github-runner-207 kernel: [18468.584077] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 10:31:34 juju-e4d256-prod-github-runner-207 kernel: [18468.585145] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 10:31:34 juju-e4d256-prod-github-runner-207 kernel: [18468.586303] Aug 22 10:31:34 juju-e4d256-prod-github-runner-207 kernel: [18468.587173] Aug 22 10:31:34 juju-e4d256-prod-github-runner-207 kernel: [18468.588010] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 10:31:34 juju-e4d256-prod-github-runner-207 kernel: [18468.589045] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:31:34 juju-e4d256-prod-github-runner-207 kernel: [18468.590082] ? _raw_spin_lock+0x22/0x30 Aug 22 10:31:34 juju-e4d256-prod-github-runner-207 kernel: [18468.591040] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:31:34 juju-e4d256-prod-github-runner-207 kernel: [18468.592060] direct_page_fault+0x206/0x310 [kvm] Aug 22 10:31:34 juju-e4d256-prod-github-runner-207 kernel: [18468.593081] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 10:31:34 juju-e4d256-prod-github-runner-207 kernel: [18468.594089] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 10:31:34 juju-e4d256-prod-github-runner-207 kernel: [18468.595105] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 10:31:34 juju-e4d256-prod-github-runner-207 kernel: [18468.596079] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 10:31:34 juju-e4d256-prod-github-runner-207 kernel: [18468.597026] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 10:31:34 juju-e4d256-prod-github-runner-207 kernel: [18468.598009] handle_exit+0x98/0x230 [kvm_amd] Aug 22 10:31:34 juju-e4d256-prod-github-runner-207 kernel: [18468.598912] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 10:31:34 juju-e4d256-prod-github-runner-207 kernel: [18468.599824] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 10:31:34 juju-e4d256-prod-github-runner-207 kernel: [18468.600762] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 10:31:34 juju-e4d256-prod-github-runner-207 kernel: [18468.601663] vcpu_run+0x62/0x2c0 [kvm] Aug 22 10:31:34 juju-e4d256-prod-github-runner-207 kernel: [18468.602474] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 10:31:34 juju-e4d256-prod-github-runner-207 kernel: [18468.603292] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 10:31:34 juju-e4d256-prod-github-runner-207 kernel: [18468.604144] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 10:31:34 juju-e4d256-prod-github-runner-207 kernel: [18468.604939] ? __seccomp_filter+0x4a/0x4a0 Aug 22 10:31:34 juju-e4d256-prod-github-runner-207 kernel: [18468.605681] ? __fget_files+0x86/0xc0 Aug 22 10:31:34 juju-e4d256-prod-github-runner-207 kernel: [18468.606383] __x64_sys_ioctl+0x95/0xd0 Aug 22 10:31:34 juju-e4d256-prod-github-runner-207 kernel: [18468.607103] do_syscall_64+0x5c/0xc0 Aug 22 10:31:34 juju-e4d256-prod-github-runner-207 kernel: [18468.607767] ? do_futex+0x162/0x1f0 Aug 22 10:31:34 juju-e4d256-prod-github-runner-207 kernel: [18468.608419] ? __x64_sys_futex+0x78/0x1e0 Aug 22 10:31:34 juju-e4d256-prod-github-runner-207 kernel: [18468.609091] ? __secure_computing+0xa9/0x120 Aug 22 10:31:34 juju-e4d256-prod-github-runner-207 kernel: [18468.609779] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 10:31:34 juju-e4d256-prod-github-runner-207 kernel: [18468.610536] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:31:34 juju-e4d256-prod-github-runner-207 kernel: [18468.611267] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:31:34 juju-e4d256-prod-github-runner-207 kernel: [18468.611989] ? do_syscall_64+0x69/0xc0 Aug 22 10:31:34 juju-e4d256-prod-github-runner-207 kernel: [18468.612633] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:31:34 juju-e4d256-prod-github-runner-207 kernel: [18468.613334] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:31:34 juju-e4d256-prod-github-runner-207 kernel: [18468.614026] ? do_syscall_64+0x69/0xc0 Aug 22 10:31:34 juju-e4d256-prod-github-runner-207 kernel: [18468.614654] ? do_syscall_64+0x69/0xc0 Aug 22 10:31:34 juju-e4d256-prod-github-runner-207 kernel: [18468.615290] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 10:31:34 juju-e4d256-prod-github-runner-207 kernel: [18468.615994] RIP: 0033:0x7faa5d0edaff Aug 22 10:31:34 juju-e4d256-prod-github-runner-207 kernel: [18468.616616] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 10:31:34 juju-e4d256-prod-github-runner-207 kernel: [18468.618603] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 10:31:34 juju-e4d256-prod-github-runner-207 kernel: [18468.619538] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 10:31:34 juju-e4d256-prod-github-runner-207 kernel: [18468.620425] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 10:31:34 juju-e4d256-prod-github-runner-207 kernel: [18468.621316] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 10:31:34 juju-e4d256-prod-github-runner-207 kernel: [18468.622200] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 10:31:34 juju-e4d256-prod-github-runner-207 kernel: [18468.623108] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 10:31:34 juju-e4d256-prod-github-runner-207 kernel: [18468.623995] Aug 22 10:32:02 juju-e4d256-prod-github-runner-207 kernel: [18496.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 17118s! [qemu-system-x86:6715] Aug 22 10:32:02 juju-e4d256-prod-github-runner-207 kernel: [18496.543106] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 10:32:02 juju-e4d256-prod-github-runner-207 kernel: [18496.543174] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 10:32:02 juju-e4d256-prod-github-runner-207 kernel: [18496.555240] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 10:32:02 juju-e4d256-prod-github-runner-207 kernel: [18496.556505] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 10:32:02 juju-e4d256-prod-github-runner-207 kernel: [18496.557732] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:32:02 juju-e4d256-prod-github-runner-207 kernel: [18496.558808] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 10:32:02 juju-e4d256-prod-github-runner-207 kernel: [18496.561359] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 10:32:02 juju-e4d256-prod-github-runner-207 kernel: [18496.562423] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 10:32:02 juju-e4d256-prod-github-runner-207 kernel: [18496.563584] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 10:32:02 juju-e4d256-prod-github-runner-207 kernel: [18496.564746] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 10:32:02 juju-e4d256-prod-github-runner-207 kernel: [18496.565907] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 10:32:02 juju-e4d256-prod-github-runner-207 kernel: [18496.567084] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 10:32:02 juju-e4d256-prod-github-runner-207 kernel: [18496.568255] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 10:32:02 juju-e4d256-prod-github-runner-207 kernel: [18496.569487] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 10:32:02 juju-e4d256-prod-github-runner-207 kernel: [18496.570592] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 10:32:02 juju-e4d256-prod-github-runner-207 kernel: [18496.571781] Call Trace: Aug 22 10:32:02 juju-e4d256-prod-github-runner-207 kernel: [18496.572691] Aug 22 10:32:02 juju-e4d256-prod-github-runner-207 kernel: [18496.573575] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:32:02 juju-e4d256-prod-github-runner-207 kernel: [18496.574616] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:32:02 juju-e4d256-prod-github-runner-207 kernel: [18496.575645] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:32:02 juju-e4d256-prod-github-runner-207 kernel: [18496.576739] ? show_regs.part.0+0x23/0x29 Aug 22 10:32:02 juju-e4d256-prod-github-runner-207 kernel: [18496.577734] ? show_regs.cold+0x8/0xd Aug 22 10:32:02 juju-e4d256-prod-github-runner-207 kernel: [18496.578715] ? watchdog_timer_fn+0x1be/0x220 Aug 22 10:32:02 juju-e4d256-prod-github-runner-207 kernel: [18496.579728] ? lockup_detector_update_enable+0x60/0x60 Aug 22 10:32:02 juju-e4d256-prod-github-runner-207 kernel: [18496.580789] ? __hrtimer_run_queues+0x107/0x230 Aug 22 10:32:02 juju-e4d256-prod-github-runner-207 kernel: [18496.581819] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 10:32:02 juju-e4d256-prod-github-runner-207 kernel: [18496.582853] ? hrtimer_interrupt+0x101/0x220 Aug 22 10:32:02 juju-e4d256-prod-github-runner-207 kernel: [18496.583869] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 10:32:02 juju-e4d256-prod-github-runner-207 kernel: [18496.584941] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 10:32:02 juju-e4d256-prod-github-runner-207 kernel: [18496.585986] Aug 22 10:32:02 juju-e4d256-prod-github-runner-207 kernel: [18496.586857] Aug 22 10:32:02 juju-e4d256-prod-github-runner-207 kernel: [18496.587694] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 10:32:02 juju-e4d256-prod-github-runner-207 kernel: [18496.588726] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:32:02 juju-e4d256-prod-github-runner-207 kernel: [18496.589772] ? _raw_spin_lock+0x22/0x30 Aug 22 10:32:02 juju-e4d256-prod-github-runner-207 kernel: [18496.590742] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:32:02 juju-e4d256-prod-github-runner-207 kernel: [18496.591756] direct_page_fault+0x206/0x310 [kvm] Aug 22 10:32:02 juju-e4d256-prod-github-runner-207 kernel: [18496.592778] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 10:32:02 juju-e4d256-prod-github-runner-207 kernel: [18496.593785] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 10:32:02 juju-e4d256-prod-github-runner-207 kernel: [18496.594799] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 10:32:02 juju-e4d256-prod-github-runner-207 kernel: [18496.595774] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 10:32:02 juju-e4d256-prod-github-runner-207 kernel: [18496.596718] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 10:32:02 juju-e4d256-prod-github-runner-207 kernel: [18496.597697] handle_exit+0x98/0x230 [kvm_amd] Aug 22 10:32:02 juju-e4d256-prod-github-runner-207 kernel: [18496.598608] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 10:32:02 juju-e4d256-prod-github-runner-207 kernel: [18496.599521] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 10:32:02 juju-e4d256-prod-github-runner-207 kernel: [18496.600442] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 10:32:02 juju-e4d256-prod-github-runner-207 kernel: [18496.601350] vcpu_run+0x62/0x2c0 [kvm] Aug 22 10:32:02 juju-e4d256-prod-github-runner-207 kernel: [18496.602159] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 10:32:02 juju-e4d256-prod-github-runner-207 kernel: [18496.602981] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 10:32:02 juju-e4d256-prod-github-runner-207 kernel: [18496.603833] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 10:32:02 juju-e4d256-prod-github-runner-207 kernel: [18496.604633] ? __seccomp_filter+0x4a/0x4a0 Aug 22 10:32:02 juju-e4d256-prod-github-runner-207 kernel: [18496.605375] ? __fget_files+0x86/0xc0 Aug 22 10:32:02 juju-e4d256-prod-github-runner-207 kernel: [18496.606078] __x64_sys_ioctl+0x95/0xd0 Aug 22 10:32:02 juju-e4d256-prod-github-runner-207 kernel: [18496.606791] do_syscall_64+0x5c/0xc0 Aug 22 10:32:02 juju-e4d256-prod-github-runner-207 kernel: [18496.607457] ? do_futex+0x162/0x1f0 Aug 22 10:32:02 juju-e4d256-prod-github-runner-207 kernel: [18496.608104] ? __x64_sys_futex+0x78/0x1e0 Aug 22 10:32:02 juju-e4d256-prod-github-runner-207 kernel: [18496.608775] ? __secure_computing+0xa9/0x120 Aug 22 10:32:02 juju-e4d256-prod-github-runner-207 kernel: [18496.609469] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 10:32:02 juju-e4d256-prod-github-runner-207 kernel: [18496.610228] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:32:02 juju-e4d256-prod-github-runner-207 kernel: [18496.610966] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:32:02 juju-e4d256-prod-github-runner-207 kernel: [18496.611685] ? do_syscall_64+0x69/0xc0 Aug 22 10:32:02 juju-e4d256-prod-github-runner-207 kernel: [18496.612327] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:32:02 juju-e4d256-prod-github-runner-207 kernel: [18496.613027] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:32:02 juju-e4d256-prod-github-runner-207 kernel: [18496.613718] ? do_syscall_64+0x69/0xc0 Aug 22 10:32:02 juju-e4d256-prod-github-runner-207 kernel: [18496.614346] ? do_syscall_64+0x69/0xc0 Aug 22 10:32:02 juju-e4d256-prod-github-runner-207 kernel: [18496.614979] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 10:32:02 juju-e4d256-prod-github-runner-207 kernel: [18496.615681] RIP: 0033:0x7faa5d0edaff Aug 22 10:32:02 juju-e4d256-prod-github-runner-207 kernel: [18496.616302] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 10:32:02 juju-e4d256-prod-github-runner-207 kernel: [18496.618282] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 10:32:02 juju-e4d256-prod-github-runner-207 kernel: [18496.619199] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 10:32:02 juju-e4d256-prod-github-runner-207 kernel: [18496.620086] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 10:32:02 juju-e4d256-prod-github-runner-207 kernel: [18496.620971] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 10:32:02 juju-e4d256-prod-github-runner-207 kernel: [18496.621861] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 10:32:02 juju-e4d256-prod-github-runner-207 kernel: [18496.622758] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 10:32:02 juju-e4d256-prod-github-runner-207 kernel: [18496.623651] Aug 22 10:32:30 juju-e4d256-prod-github-runner-207 kernel: [18524.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 17144s! [qemu-system-x86:6715] Aug 22 10:32:30 juju-e4d256-prod-github-runner-207 kernel: [18524.543781] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 10:32:30 juju-e4d256-prod-github-runner-207 kernel: [18524.544038] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 10:32:30 juju-e4d256-prod-github-runner-207 kernel: [18524.556278] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 10:32:30 juju-e4d256-prod-github-runner-207 kernel: [18524.557543] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 10:32:30 juju-e4d256-prod-github-runner-207 kernel: [18524.558781] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:32:30 juju-e4d256-prod-github-runner-207 kernel: [18524.559837] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 10:32:30 juju-e4d256-prod-github-runner-207 kernel: [18524.562401] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 10:32:30 juju-e4d256-prod-github-runner-207 kernel: [18524.563441] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 10:32:30 juju-e4d256-prod-github-runner-207 kernel: [18524.564603] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 10:32:30 juju-e4d256-prod-github-runner-207 kernel: [18524.565760] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 10:32:30 juju-e4d256-prod-github-runner-207 kernel: [18524.566930] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 10:32:30 juju-e4d256-prod-github-runner-207 kernel: [18524.568088] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 10:32:30 juju-e4d256-prod-github-runner-207 kernel: [18524.569253] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 10:32:30 juju-e4d256-prod-github-runner-207 kernel: [18524.570497] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 10:32:30 juju-e4d256-prod-github-runner-207 kernel: [18524.571600] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 10:32:30 juju-e4d256-prod-github-runner-207 kernel: [18524.572795] Call Trace: Aug 22 10:32:30 juju-e4d256-prod-github-runner-207 kernel: [18524.573706] Aug 22 10:32:30 juju-e4d256-prod-github-runner-207 kernel: [18524.574610] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:32:30 juju-e4d256-prod-github-runner-207 kernel: [18524.575644] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:32:30 juju-e4d256-prod-github-runner-207 kernel: [18524.576664] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:32:30 juju-e4d256-prod-github-runner-207 kernel: [18524.577756] ? show_regs.part.0+0x23/0x29 Aug 22 10:32:30 juju-e4d256-prod-github-runner-207 kernel: [18524.578762] ? show_regs.cold+0x8/0xd Aug 22 10:32:30 juju-e4d256-prod-github-runner-207 kernel: [18524.579732] ? watchdog_timer_fn+0x1be/0x220 Aug 22 10:32:30 juju-e4d256-prod-github-runner-207 kernel: [18524.580739] ? lockup_detector_update_enable+0x60/0x60 Aug 22 10:32:30 juju-e4d256-prod-github-runner-207 kernel: [18524.581801] ? __hrtimer_run_queues+0x107/0x230 Aug 22 10:32:30 juju-e4d256-prod-github-runner-207 kernel: [18524.582840] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 10:32:30 juju-e4d256-prod-github-runner-207 kernel: [18524.583868] ? hrtimer_interrupt+0x101/0x220 Aug 22 10:32:30 juju-e4d256-prod-github-runner-207 kernel: [18524.584882] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 10:32:30 juju-e4d256-prod-github-runner-207 kernel: [18524.585950] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 10:32:30 juju-e4d256-prod-github-runner-207 kernel: [18524.587023] Aug 22 10:32:30 juju-e4d256-prod-github-runner-207 kernel: [18524.587875] Aug 22 10:32:30 juju-e4d256-prod-github-runner-207 kernel: [18524.588712] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 10:32:30 juju-e4d256-prod-github-runner-207 kernel: [18524.589749] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:32:30 juju-e4d256-prod-github-runner-207 kernel: [18524.591689] ? _raw_spin_lock+0x22/0x30 Aug 22 10:32:30 juju-e4d256-prod-github-runner-207 kernel: [18524.592637] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:32:30 juju-e4d256-prod-github-runner-207 kernel: [18524.593656] direct_page_fault+0x206/0x310 [kvm] Aug 22 10:32:30 juju-e4d256-prod-github-runner-207 kernel: [18524.594692] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 10:32:30 juju-e4d256-prod-github-runner-207 kernel: [18524.595699] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 10:32:30 juju-e4d256-prod-github-runner-207 kernel: [18524.596702] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 10:32:30 juju-e4d256-prod-github-runner-207 kernel: [18524.597695] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 10:32:30 juju-e4d256-prod-github-runner-207 kernel: [18524.598648] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 10:32:30 juju-e4d256-prod-github-runner-207 kernel: [18524.599631] handle_exit+0x98/0x230 [kvm_amd] Aug 22 10:32:30 juju-e4d256-prod-github-runner-207 kernel: [18524.600521] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 10:32:30 juju-e4d256-prod-github-runner-207 kernel: [18524.601435] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 10:32:30 juju-e4d256-prod-github-runner-207 kernel: [18524.602368] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 10:32:30 juju-e4d256-prod-github-runner-207 kernel: [18524.603269] vcpu_run+0x62/0x2c0 [kvm] Aug 22 10:32:30 juju-e4d256-prod-github-runner-207 kernel: [18524.604113] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 10:32:30 juju-e4d256-prod-github-runner-207 kernel: [18524.604916] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 10:32:30 juju-e4d256-prod-github-runner-207 kernel: [18524.605805] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 10:32:30 juju-e4d256-prod-github-runner-207 kernel: [18524.606617] ? __seccomp_filter+0x4a/0x4a0 Aug 22 10:32:30 juju-e4d256-prod-github-runner-207 kernel: [18524.607358] ? __fget_files+0x86/0xc0 Aug 22 10:32:30 juju-e4d256-prod-github-runner-207 kernel: [18524.608059] __x64_sys_ioctl+0x95/0xd0 Aug 22 10:32:30 juju-e4d256-prod-github-runner-207 kernel: [18524.608754] do_syscall_64+0x5c/0xc0 Aug 22 10:32:30 juju-e4d256-prod-github-runner-207 kernel: [18524.609416] ? do_futex+0x162/0x1f0 Aug 22 10:32:30 juju-e4d256-prod-github-runner-207 kernel: [18524.610076] ? __x64_sys_futex+0x78/0x1e0 Aug 22 10:32:30 juju-e4d256-prod-github-runner-207 kernel: [18524.610746] ? __secure_computing+0xa9/0x120 Aug 22 10:32:30 juju-e4d256-prod-github-runner-207 kernel: [18524.611434] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 10:32:30 juju-e4d256-prod-github-runner-207 kernel: [18524.612194] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:32:30 juju-e4d256-prod-github-runner-207 kernel: [18524.612913] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:32:30 juju-e4d256-prod-github-runner-207 kernel: [18524.613627] ? do_syscall_64+0x69/0xc0 Aug 22 10:32:30 juju-e4d256-prod-github-runner-207 kernel: [18524.614280] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:32:30 juju-e4d256-prod-github-runner-207 kernel: [18524.614981] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:32:30 juju-e4d256-prod-github-runner-207 kernel: [18524.615679] ? do_syscall_64+0x69/0xc0 Aug 22 10:32:30 juju-e4d256-prod-github-runner-207 kernel: [18524.616301] ? do_syscall_64+0x69/0xc0 Aug 22 10:32:30 juju-e4d256-prod-github-runner-207 kernel: [18524.616921] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 10:32:30 juju-e4d256-prod-github-runner-207 kernel: [18524.617623] RIP: 0033:0x7faa5d0edaff Aug 22 10:32:30 juju-e4d256-prod-github-runner-207 kernel: [18524.618269] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 10:32:30 juju-e4d256-prod-github-runner-207 kernel: [18524.620247] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 10:32:30 juju-e4d256-prod-github-runner-207 kernel: [18524.621154] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 10:32:30 juju-e4d256-prod-github-runner-207 kernel: [18524.622047] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 10:32:30 juju-e4d256-prod-github-runner-207 kernel: [18524.622947] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 10:32:30 juju-e4d256-prod-github-runner-207 kernel: [18524.623829] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 10:32:30 juju-e4d256-prod-github-runner-207 kernel: [18524.624719] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 10:32:30 juju-e4d256-prod-github-runner-207 kernel: [18524.625609] Aug 22 10:32:44 juju-e4d256-prod-github-runner-207 kernel: [18538.424706] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 10:32:44 juju-e4d256-prod-github-runner-207 kernel: [18538.425669] rcu: 1-....: (4590950 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=2222288 Aug 22 10:32:44 juju-e4d256-prod-github-runner-207 kernel: [18538.426804] (t=4605306 jiffies g=23269 q=24943) Aug 22 10:32:44 juju-e4d256-prod-github-runner-207 kernel: [18538.427583] NMI backtrace for cpu 1 Aug 22 10:32:44 juju-e4d256-prod-github-runner-207 kernel: [18538.428290] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 10:32:44 juju-e4d256-prod-github-runner-207 kernel: [18538.429391] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 10:32:44 juju-e4d256-prod-github-runner-207 kernel: [18538.430461] Call Trace: Aug 22 10:32:44 juju-e4d256-prod-github-runner-207 kernel: [18538.431138] Aug 22 10:32:44 juju-e4d256-prod-github-runner-207 kernel: [18538.431778] show_stack+0x52/0x5c Aug 22 10:32:44 juju-e4d256-prod-github-runner-207 kernel: [18538.432500] dump_stack_lvl+0x4a/0x63 Aug 22 10:32:44 juju-e4d256-prod-github-runner-207 kernel: [18538.433243] dump_stack+0x10/0x16 Aug 22 10:32:44 juju-e4d256-prod-github-runner-207 kernel: [18538.433980] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 10:32:44 juju-e4d256-prod-github-runner-207 kernel: [18538.434759] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 10:32:44 juju-e4d256-prod-github-runner-207 kernel: [18538.435535] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 10:32:44 juju-e4d256-prod-github-runner-207 kernel: [18538.436352] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 10:32:44 juju-e4d256-prod-github-runner-207 kernel: [18538.437167] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 10:32:44 juju-e4d256-prod-github-runner-207 kernel: [18538.437994] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 10:32:44 juju-e4d256-prod-github-runner-207 kernel: [18538.438763] print_cpu_stall.cold+0x2f/0xe2 Aug 22 10:32:44 juju-e4d256-prod-github-runner-207 kernel: [18538.439525] ? timekeeping_update+0xf7/0x150 Aug 22 10:32:44 juju-e4d256-prod-github-runner-207 kernel: [18538.440298] check_cpu_stall+0x109/0x270 Aug 22 10:32:44 juju-e4d256-prod-github-runner-207 kernel: [18538.441042] rcu_sched_clock_irq+0x9a/0x250 Aug 22 10:32:44 juju-e4d256-prod-github-runner-207 kernel: [18538.441801] update_process_times+0x94/0xd0 Aug 22 10:32:44 juju-e4d256-prod-github-runner-207 kernel: [18538.442572] tick_sched_handle+0x29/0x70 Aug 22 10:32:44 juju-e4d256-prod-github-runner-207 kernel: [18538.443319] tick_sched_timer+0x8c/0xc0 Aug 22 10:32:44 juju-e4d256-prod-github-runner-207 kernel: [18538.444055] ? tick_nohz_handler+0xb0/0xb0 Aug 22 10:32:44 juju-e4d256-prod-github-runner-207 kernel: [18538.444807] __hrtimer_run_queues+0x107/0x230 Aug 22 10:32:44 juju-e4d256-prod-github-runner-207 kernel: [18538.445577] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 10:32:44 juju-e4d256-prod-github-runner-207 kernel: [18538.446365] hrtimer_interrupt+0x101/0x220 Aug 22 10:32:44 juju-e4d256-prod-github-runner-207 kernel: [18538.447122] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 10:32:44 juju-e4d256-prod-github-runner-207 kernel: [18538.447934] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 10:32:44 juju-e4d256-prod-github-runner-207 kernel: [18538.448732] Aug 22 10:32:44 juju-e4d256-prod-github-runner-207 kernel: [18538.449365] Aug 22 10:32:44 juju-e4d256-prod-github-runner-207 kernel: [18538.450003] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 10:32:44 juju-e4d256-prod-github-runner-207 kernel: [18538.450821] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:32:44 juju-e4d256-prod-github-runner-207 kernel: [18538.451697] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 10:32:44 juju-e4d256-prod-github-runner-207 kernel: [18538.453916] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 10:32:44 juju-e4d256-prod-github-runner-207 kernel: [18538.454787] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 10:32:44 juju-e4d256-prod-github-runner-207 kernel: [18538.455780] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 10:32:44 juju-e4d256-prod-github-runner-207 kernel: [18538.456753] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 10:32:44 juju-e4d256-prod-github-runner-207 kernel: [18538.457714] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 10:32:44 juju-e4d256-prod-github-runner-207 kernel: [18538.458678] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 10:32:44 juju-e4d256-prod-github-runner-207 kernel: [18538.459633] ? _raw_spin_lock+0x22/0x30 Aug 22 10:32:44 juju-e4d256-prod-github-runner-207 kernel: [18538.460388] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:32:44 juju-e4d256-prod-github-runner-207 kernel: [18538.461220] direct_page_fault+0x206/0x310 [kvm] Aug 22 10:32:44 juju-e4d256-prod-github-runner-207 kernel: [18538.462066] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 10:32:44 juju-e4d256-prod-github-runner-207 kernel: [18538.462897] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 10:32:44 juju-e4d256-prod-github-runner-207 kernel: [18538.463721] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 10:32:44 juju-e4d256-prod-github-runner-207 kernel: [18538.464524] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 10:32:44 juju-e4d256-prod-github-runner-207 kernel: [18538.465310] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 10:32:44 juju-e4d256-prod-github-runner-207 kernel: [18538.466148] handle_exit+0x98/0x230 [kvm_amd] Aug 22 10:32:44 juju-e4d256-prod-github-runner-207 kernel: [18538.466904] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 10:32:44 juju-e4d256-prod-github-runner-207 kernel: [18538.467687] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 10:32:44 juju-e4d256-prod-github-runner-207 kernel: [18538.468483] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 10:32:44 juju-e4d256-prod-github-runner-207 kernel: [18538.469268] vcpu_run+0x62/0x2c0 [kvm] Aug 22 10:32:44 juju-e4d256-prod-github-runner-207 kernel: [18538.469996] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 10:32:44 juju-e4d256-prod-github-runner-207 kernel: [18538.470728] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 10:32:44 juju-e4d256-prod-github-runner-207 kernel: [18538.471528] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 10:32:44 juju-e4d256-prod-github-runner-207 kernel: [18538.472293] ? __seccomp_filter+0x4a/0x4a0 Aug 22 10:32:44 juju-e4d256-prod-github-runner-207 kernel: [18538.473011] ? __fget_files+0x86/0xc0 Aug 22 10:32:44 juju-e4d256-prod-github-runner-207 kernel: [18538.473704] __x64_sys_ioctl+0x95/0xd0 Aug 22 10:32:44 juju-e4d256-prod-github-runner-207 kernel: [18538.474486] do_syscall_64+0x5c/0xc0 Aug 22 10:32:44 juju-e4d256-prod-github-runner-207 kernel: [18538.475166] ? do_futex+0x162/0x1f0 Aug 22 10:32:44 juju-e4d256-prod-github-runner-207 kernel: [18538.475839] ? __x64_sys_futex+0x78/0x1e0 Aug 22 10:32:44 juju-e4d256-prod-github-runner-207 kernel: [18538.476540] ? __secure_computing+0xa9/0x120 Aug 22 10:32:44 juju-e4d256-prod-github-runner-207 kernel: [18538.477257] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 10:32:44 juju-e4d256-prod-github-runner-207 kernel: [18538.478056] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:32:44 juju-e4d256-prod-github-runner-207 kernel: [18538.478809] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:32:44 juju-e4d256-prod-github-runner-207 kernel: [18538.479560] ? do_syscall_64+0x69/0xc0 Aug 22 10:32:44 juju-e4d256-prod-github-runner-207 kernel: [18538.480248] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:32:44 juju-e4d256-prod-github-runner-207 kernel: [18538.481006] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:32:44 juju-e4d256-prod-github-runner-207 kernel: [18538.481763] ? do_syscall_64+0x69/0xc0 Aug 22 10:32:44 juju-e4d256-prod-github-runner-207 kernel: [18538.482466] ? do_syscall_64+0x69/0xc0 Aug 22 10:32:44 juju-e4d256-prod-github-runner-207 kernel: [18538.483157] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 10:32:44 juju-e4d256-prod-github-runner-207 kernel: [18538.483930] RIP: 0033:0x7faa5d0edaff Aug 22 10:32:44 juju-e4d256-prod-github-runner-207 kernel: [18538.484630] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 10:32:44 juju-e4d256-prod-github-runner-207 kernel: [18538.486750] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 10:32:44 juju-e4d256-prod-github-runner-207 kernel: [18538.487712] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 10:32:44 juju-e4d256-prod-github-runner-207 kernel: [18538.488655] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 10:32:44 juju-e4d256-prod-github-runner-207 kernel: [18538.489598] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 10:32:44 juju-e4d256-prod-github-runner-207 kernel: [18538.490555] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 10:32:44 juju-e4d256-prod-github-runner-207 kernel: [18538.491481] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 10:32:44 juju-e4d256-prod-github-runner-207 kernel: [18538.492393] Aug 22 10:33:10 juju-e4d256-prod-github-runner-207 kernel: [18564.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 17181s! [qemu-system-x86:6715] Aug 22 10:33:10 juju-e4d256-prod-github-runner-207 kernel: [18564.543090] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 10:33:10 juju-e4d256-prod-github-runner-207 kernel: [18564.543157] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 10:33:10 juju-e4d256-prod-github-runner-207 kernel: [18564.555259] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 10:33:10 juju-e4d256-prod-github-runner-207 kernel: [18564.556528] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 10:33:10 juju-e4d256-prod-github-runner-207 kernel: [18564.557770] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:33:10 juju-e4d256-prod-github-runner-207 kernel: [18564.559008] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 10:33:10 juju-e4d256-prod-github-runner-207 kernel: [18564.561573] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 10:33:10 juju-e4d256-prod-github-runner-207 kernel: [18564.562640] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 10:33:10 juju-e4d256-prod-github-runner-207 kernel: [18564.563801] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 10:33:10 juju-e4d256-prod-github-runner-207 kernel: [18564.564967] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 10:33:10 juju-e4d256-prod-github-runner-207 kernel: [18564.566148] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 10:33:10 juju-e4d256-prod-github-runner-207 kernel: [18564.567308] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 10:33:10 juju-e4d256-prod-github-runner-207 kernel: [18564.568600] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 10:33:10 juju-e4d256-prod-github-runner-207 kernel: [18564.569964] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 10:33:10 juju-e4d256-prod-github-runner-207 kernel: [18564.571061] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 10:33:10 juju-e4d256-prod-github-runner-207 kernel: [18564.572254] Call Trace: Aug 22 10:33:10 juju-e4d256-prod-github-runner-207 kernel: [18564.573166] Aug 22 10:33:10 juju-e4d256-prod-github-runner-207 kernel: [18564.574064] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:33:10 juju-e4d256-prod-github-runner-207 kernel: [18564.575097] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:33:10 juju-e4d256-prod-github-runner-207 kernel: [18564.576116] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:33:10 juju-e4d256-prod-github-runner-207 kernel: [18564.577190] ? show_regs.part.0+0x23/0x29 Aug 22 10:33:10 juju-e4d256-prod-github-runner-207 kernel: [18564.578206] ? show_regs.cold+0x8/0xd Aug 22 10:33:10 juju-e4d256-prod-github-runner-207 kernel: [18564.579177] ? watchdog_timer_fn+0x1be/0x220 Aug 22 10:33:10 juju-e4d256-prod-github-runner-207 kernel: [18564.580183] ? lockup_detector_update_enable+0x60/0x60 Aug 22 10:33:10 juju-e4d256-prod-github-runner-207 kernel: [18564.581248] ? __hrtimer_run_queues+0x107/0x230 Aug 22 10:33:10 juju-e4d256-prod-github-runner-207 kernel: [18564.582294] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 10:33:10 juju-e4d256-prod-github-runner-207 kernel: [18564.583321] ? hrtimer_interrupt+0x101/0x220 Aug 22 10:33:10 juju-e4d256-prod-github-runner-207 kernel: [18564.584334] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 10:33:10 juju-e4d256-prod-github-runner-207 kernel: [18564.585400] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 10:33:10 juju-e4d256-prod-github-runner-207 kernel: [18564.586512] Aug 22 10:33:10 juju-e4d256-prod-github-runner-207 kernel: [18564.587376] Aug 22 10:33:10 juju-e4d256-prod-github-runner-207 kernel: [18564.588215] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 10:33:10 juju-e4d256-prod-github-runner-207 kernel: [18564.589262] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:33:10 juju-e4d256-prod-github-runner-207 kernel: [18564.590326] ? _raw_spin_lock+0x22/0x30 Aug 22 10:33:10 juju-e4d256-prod-github-runner-207 kernel: [18564.591279] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:33:10 juju-e4d256-prod-github-runner-207 kernel: [18564.592299] direct_page_fault+0x206/0x310 [kvm] Aug 22 10:33:10 juju-e4d256-prod-github-runner-207 kernel: [18564.593323] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 10:33:10 juju-e4d256-prod-github-runner-207 kernel: [18564.594346] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 10:33:10 juju-e4d256-prod-github-runner-207 kernel: [18564.595346] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 10:33:10 juju-e4d256-prod-github-runner-207 kernel: [18564.596315] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 10:33:10 juju-e4d256-prod-github-runner-207 kernel: [18564.597260] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 10:33:10 juju-e4d256-prod-github-runner-207 kernel: [18564.598256] handle_exit+0x98/0x230 [kvm_amd] Aug 22 10:33:10 juju-e4d256-prod-github-runner-207 kernel: [18564.599151] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 10:33:10 juju-e4d256-prod-github-runner-207 kernel: [18564.600070] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 10:33:10 juju-e4d256-prod-github-runner-207 kernel: [18564.600997] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 10:33:10 juju-e4d256-prod-github-runner-207 kernel: [18564.601926] vcpu_run+0x62/0x2c0 [kvm] Aug 22 10:33:10 juju-e4d256-prod-github-runner-207 kernel: [18564.602743] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 10:33:10 juju-e4d256-prod-github-runner-207 kernel: [18564.603556] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 10:33:10 juju-e4d256-prod-github-runner-207 kernel: [18564.604416] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 10:33:10 juju-e4d256-prod-github-runner-207 kernel: [18564.605214] ? __seccomp_filter+0x4a/0x4a0 Aug 22 10:33:10 juju-e4d256-prod-github-runner-207 kernel: [18564.605975] ? __fget_files+0x86/0xc0 Aug 22 10:33:10 juju-e4d256-prod-github-runner-207 kernel: [18564.606678] __x64_sys_ioctl+0x95/0xd0 Aug 22 10:33:10 juju-e4d256-prod-github-runner-207 kernel: [18564.607374] do_syscall_64+0x5c/0xc0 Aug 22 10:33:10 juju-e4d256-prod-github-runner-207 kernel: [18564.608043] ? do_futex+0x162/0x1f0 Aug 22 10:33:10 juju-e4d256-prod-github-runner-207 kernel: [18564.608695] ? __x64_sys_futex+0x78/0x1e0 Aug 22 10:33:10 juju-e4d256-prod-github-runner-207 kernel: [18564.609370] ? __secure_computing+0xa9/0x120 Aug 22 10:33:10 juju-e4d256-prod-github-runner-207 kernel: [18564.610078] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 10:33:10 juju-e4d256-prod-github-runner-207 kernel: [18564.610837] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:33:10 juju-e4d256-prod-github-runner-207 kernel: [18564.611557] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:33:10 juju-e4d256-prod-github-runner-207 kernel: [18564.612279] ? do_syscall_64+0x69/0xc0 Aug 22 10:33:10 juju-e4d256-prod-github-runner-207 kernel: [18564.612952] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:33:10 juju-e4d256-prod-github-runner-207 kernel: [18564.613681] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:33:10 juju-e4d256-prod-github-runner-207 kernel: [18564.614380] ? do_syscall_64+0x69/0xc0 Aug 22 10:33:10 juju-e4d256-prod-github-runner-207 kernel: [18564.615009] ? do_syscall_64+0x69/0xc0 Aug 22 10:33:10 juju-e4d256-prod-github-runner-207 kernel: [18564.615696] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 10:33:10 juju-e4d256-prod-github-runner-207 kernel: [18564.616459] RIP: 0033:0x7faa5d0edaff Aug 22 10:33:10 juju-e4d256-prod-github-runner-207 kernel: [18564.617086] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 10:33:10 juju-e4d256-prod-github-runner-207 kernel: [18564.619095] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 10:33:10 juju-e4d256-prod-github-runner-207 kernel: [18564.620020] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 10:33:10 juju-e4d256-prod-github-runner-207 kernel: [18564.620912] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 10:33:10 juju-e4d256-prod-github-runner-207 kernel: [18564.621822] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 10:33:10 juju-e4d256-prod-github-runner-207 kernel: [18564.622715] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 10:33:10 juju-e4d256-prod-github-runner-207 kernel: [18564.623606] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 10:33:10 juju-e4d256-prod-github-runner-207 kernel: [18564.624501] Aug 22 10:33:38 juju-e4d256-prod-github-runner-207 kernel: [18592.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 17207s! [qemu-system-x86:6715] Aug 22 10:33:38 juju-e4d256-prod-github-runner-207 kernel: [18592.543099] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 10:33:38 juju-e4d256-prod-github-runner-207 kernel: [18592.543165] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 10:33:38 juju-e4d256-prod-github-runner-207 kernel: [18592.555418] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 10:33:38 juju-e4d256-prod-github-runner-207 kernel: [18592.556697] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 10:33:38 juju-e4d256-prod-github-runner-207 kernel: [18592.557931] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:33:38 juju-e4d256-prod-github-runner-207 kernel: [18592.559001] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 10:33:38 juju-e4d256-prod-github-runner-207 kernel: [18592.561645] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 10:33:38 juju-e4d256-prod-github-runner-207 kernel: [18592.562716] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 10:33:38 juju-e4d256-prod-github-runner-207 kernel: [18592.563894] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 10:33:38 juju-e4d256-prod-github-runner-207 kernel: [18592.565075] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 10:33:38 juju-e4d256-prod-github-runner-207 kernel: [18592.566287] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 10:33:38 juju-e4d256-prod-github-runner-207 kernel: [18592.567458] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 10:33:38 juju-e4d256-prod-github-runner-207 kernel: [18592.568624] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 10:33:38 juju-e4d256-prod-github-runner-207 kernel: [18592.569896] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 10:33:38 juju-e4d256-prod-github-runner-207 kernel: [18592.571021] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 10:33:38 juju-e4d256-prod-github-runner-207 kernel: [18592.572242] Call Trace: Aug 22 10:33:38 juju-e4d256-prod-github-runner-207 kernel: [18592.573157] Aug 22 10:33:38 juju-e4d256-prod-github-runner-207 kernel: [18592.574058] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:33:38 juju-e4d256-prod-github-runner-207 kernel: [18592.575098] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:33:38 juju-e4d256-prod-github-runner-207 kernel: [18592.576152] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:33:38 juju-e4d256-prod-github-runner-207 kernel: [18592.577314] ? show_regs.part.0+0x23/0x29 Aug 22 10:33:38 juju-e4d256-prod-github-runner-207 kernel: [18592.578325] ? show_regs.cold+0x8/0xd Aug 22 10:33:38 juju-e4d256-prod-github-runner-207 kernel: [18592.579324] ? watchdog_timer_fn+0x1be/0x220 Aug 22 10:33:38 juju-e4d256-prod-github-runner-207 kernel: [18592.580343] ? lockup_detector_update_enable+0x60/0x60 Aug 22 10:33:38 juju-e4d256-prod-github-runner-207 kernel: [18592.581452] ? __hrtimer_run_queues+0x107/0x230 Aug 22 10:33:38 juju-e4d256-prod-github-runner-207 kernel: [18592.582494] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 10:33:38 juju-e4d256-prod-github-runner-207 kernel: [18592.583518] ? hrtimer_interrupt+0x101/0x220 Aug 22 10:33:38 juju-e4d256-prod-github-runner-207 kernel: [18592.584533] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 10:33:38 juju-e4d256-prod-github-runner-207 kernel: [18592.585643] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 10:33:38 juju-e4d256-prod-github-runner-207 kernel: [18592.586718] Aug 22 10:33:38 juju-e4d256-prod-github-runner-207 kernel: [18592.587583] Aug 22 10:33:38 juju-e4d256-prod-github-runner-207 kernel: [18592.588424] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 10:33:38 juju-e4d256-prod-github-runner-207 kernel: [18592.589475] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:33:38 juju-e4d256-prod-github-runner-207 kernel: [18592.590670] ? _raw_spin_lock+0x22/0x30 Aug 22 10:33:38 juju-e4d256-prod-github-runner-207 kernel: [18592.591736] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:33:38 juju-e4d256-prod-github-runner-207 kernel: [18592.592867] direct_page_fault+0x206/0x310 [kvm] Aug 22 10:33:38 juju-e4d256-prod-github-runner-207 kernel: [18592.594017] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 10:33:38 juju-e4d256-prod-github-runner-207 kernel: [18592.595124] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 10:33:38 juju-e4d256-prod-github-runner-207 kernel: [18592.596230] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 10:33:38 juju-e4d256-prod-github-runner-207 kernel: [18592.597349] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 10:33:38 juju-e4d256-prod-github-runner-207 kernel: [18592.598409] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 10:33:38 juju-e4d256-prod-github-runner-207 kernel: [18592.599494] handle_exit+0x98/0x230 [kvm_amd] Aug 22 10:33:38 juju-e4d256-prod-github-runner-207 kernel: [18592.600475] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 10:33:38 juju-e4d256-prod-github-runner-207 kernel: [18592.601514] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 10:33:38 juju-e4d256-prod-github-runner-207 kernel: [18592.602535] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 10:33:38 juju-e4d256-prod-github-runner-207 kernel: [18592.603535] vcpu_run+0x62/0x2c0 [kvm] Aug 22 10:33:38 juju-e4d256-prod-github-runner-207 kernel: [18592.604422] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 10:33:38 juju-e4d256-prod-github-runner-207 kernel: [18592.605335] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 10:33:38 juju-e4d256-prod-github-runner-207 kernel: [18592.606289] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 10:33:38 juju-e4d256-prod-github-runner-207 kernel: [18592.607172] ? __seccomp_filter+0x4a/0x4a0 Aug 22 10:33:38 juju-e4d256-prod-github-runner-207 kernel: [18592.607996] ? __fget_files+0x86/0xc0 Aug 22 10:33:38 juju-e4d256-prod-github-runner-207 kernel: [18592.608774] __x64_sys_ioctl+0x95/0xd0 Aug 22 10:33:38 juju-e4d256-prod-github-runner-207 kernel: [18592.609554] do_syscall_64+0x5c/0xc0 Aug 22 10:33:38 juju-e4d256-prod-github-runner-207 kernel: [18592.610291] ? do_futex+0x162/0x1f0 Aug 22 10:33:38 juju-e4d256-prod-github-runner-207 kernel: [18592.611011] ? __x64_sys_futex+0x78/0x1e0 Aug 22 10:33:38 juju-e4d256-prod-github-runner-207 kernel: [18592.611776] ? __secure_computing+0xa9/0x120 Aug 22 10:33:38 juju-e4d256-prod-github-runner-207 kernel: [18592.612551] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 10:33:38 juju-e4d256-prod-github-runner-207 kernel: [18592.613433] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:33:38 juju-e4d256-prod-github-runner-207 kernel: [18592.614251] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:33:38 juju-e4d256-prod-github-runner-207 kernel: [18592.615064] ? do_syscall_64+0x69/0xc0 Aug 22 10:33:38 juju-e4d256-prod-github-runner-207 kernel: [18592.615788] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:33:38 juju-e4d256-prod-github-runner-207 kernel: [18592.616590] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:33:38 juju-e4d256-prod-github-runner-207 kernel: [18592.617403] ? do_syscall_64+0x69/0xc0 Aug 22 10:33:38 juju-e4d256-prod-github-runner-207 kernel: [18592.618137] ? do_syscall_64+0x69/0xc0 Aug 22 10:33:38 juju-e4d256-prod-github-runner-207 kernel: [18592.618890] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 10:33:38 juju-e4d256-prod-github-runner-207 kernel: [18592.619596] RIP: 0033:0x7faa5d0edaff Aug 22 10:33:38 juju-e4d256-prod-github-runner-207 kernel: [18592.620219] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 10:33:38 juju-e4d256-prod-github-runner-207 kernel: [18592.622244] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 10:33:38 juju-e4d256-prod-github-runner-207 kernel: [18592.623156] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 10:33:38 juju-e4d256-prod-github-runner-207 kernel: [18592.624050] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 10:33:38 juju-e4d256-prod-github-runner-207 kernel: [18592.625015] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 10:33:38 juju-e4d256-prod-github-runner-207 kernel: [18592.626092] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 10:33:38 juju-e4d256-prod-github-runner-207 kernel: [18592.627065] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 10:33:38 juju-e4d256-prod-github-runner-207 kernel: [18592.627977] Aug 22 10:34:06 juju-e4d256-prod-github-runner-207 kernel: [18620.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 17233s! [qemu-system-x86:6715] Aug 22 10:34:06 juju-e4d256-prod-github-runner-207 kernel: [18620.543717] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 10:34:06 juju-e4d256-prod-github-runner-207 kernel: [18620.543967] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 10:34:06 juju-e4d256-prod-github-runner-207 kernel: [18620.556044] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 10:34:06 juju-e4d256-prod-github-runner-207 kernel: [18620.557319] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 10:34:06 juju-e4d256-prod-github-runner-207 kernel: [18620.558539] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:34:06 juju-e4d256-prod-github-runner-207 kernel: [18620.559598] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 10:34:06 juju-e4d256-prod-github-runner-207 kernel: [18620.562179] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 10:34:06 juju-e4d256-prod-github-runner-207 kernel: [18620.563221] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 10:34:06 juju-e4d256-prod-github-runner-207 kernel: [18620.564381] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 10:34:06 juju-e4d256-prod-github-runner-207 kernel: [18620.565557] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 10:34:06 juju-e4d256-prod-github-runner-207 kernel: [18620.566750] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 10:34:06 juju-e4d256-prod-github-runner-207 kernel: [18620.567914] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 10:34:06 juju-e4d256-prod-github-runner-207 kernel: [18620.569091] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 10:34:06 juju-e4d256-prod-github-runner-207 kernel: [18620.570320] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 10:34:06 juju-e4d256-prod-github-runner-207 kernel: [18620.571419] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 10:34:06 juju-e4d256-prod-github-runner-207 kernel: [18620.572608] Call Trace: Aug 22 10:34:06 juju-e4d256-prod-github-runner-207 kernel: [18620.573532] Aug 22 10:34:06 juju-e4d256-prod-github-runner-207 kernel: [18620.574422] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:34:06 juju-e4d256-prod-github-runner-207 kernel: [18620.575453] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:34:06 juju-e4d256-prod-github-runner-207 kernel: [18620.576468] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:34:06 juju-e4d256-prod-github-runner-207 kernel: [18620.577570] ? show_regs.part.0+0x23/0x29 Aug 22 10:34:06 juju-e4d256-prod-github-runner-207 kernel: [18620.578569] ? show_regs.cold+0x8/0xd Aug 22 10:34:06 juju-e4d256-prod-github-runner-207 kernel: [18620.579544] ? watchdog_timer_fn+0x1be/0x220 Aug 22 10:34:06 juju-e4d256-prod-github-runner-207 kernel: [18620.580549] ? lockup_detector_update_enable+0x60/0x60 Aug 22 10:34:06 juju-e4d256-prod-github-runner-207 kernel: [18620.581623] ? __hrtimer_run_queues+0x107/0x230 Aug 22 10:34:06 juju-e4d256-prod-github-runner-207 kernel: [18620.582647] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 10:34:06 juju-e4d256-prod-github-runner-207 kernel: [18620.583668] ? hrtimer_interrupt+0x101/0x220 Aug 22 10:34:06 juju-e4d256-prod-github-runner-207 kernel: [18620.584679] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 10:34:06 juju-e4d256-prod-github-runner-207 kernel: [18620.585761] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 10:34:06 juju-e4d256-prod-github-runner-207 kernel: [18620.586801] Aug 22 10:34:06 juju-e4d256-prod-github-runner-207 kernel: [18620.587650] Aug 22 10:34:06 juju-e4d256-prod-github-runner-207 kernel: [18620.588484] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 10:34:06 juju-e4d256-prod-github-runner-207 kernel: [18620.589546] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:34:06 juju-e4d256-prod-github-runner-207 kernel: [18620.590581] ? _raw_spin_lock+0x22/0x30 Aug 22 10:34:06 juju-e4d256-prod-github-runner-207 kernel: [18620.591521] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:34:06 juju-e4d256-prod-github-runner-207 kernel: [18620.592535] direct_page_fault+0x206/0x310 [kvm] Aug 22 10:34:06 juju-e4d256-prod-github-runner-207 kernel: [18620.593595] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 10:34:06 juju-e4d256-prod-github-runner-207 kernel: [18620.594641] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 10:34:06 juju-e4d256-prod-github-runner-207 kernel: [18620.595644] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 10:34:06 juju-e4d256-prod-github-runner-207 kernel: [18620.596650] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 10:34:06 juju-e4d256-prod-github-runner-207 kernel: [18620.597607] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 10:34:06 juju-e4d256-prod-github-runner-207 kernel: [18620.598584] handle_exit+0x98/0x230 [kvm_amd] Aug 22 10:34:06 juju-e4d256-prod-github-runner-207 kernel: [18620.599472] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 10:34:06 juju-e4d256-prod-github-runner-207 kernel: [18620.600386] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 10:34:06 juju-e4d256-prod-github-runner-207 kernel: [18620.601320] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 10:34:06 juju-e4d256-prod-github-runner-207 kernel: [18620.602218] vcpu_run+0x62/0x2c0 [kvm] Aug 22 10:34:06 juju-e4d256-prod-github-runner-207 kernel: [18620.603024] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 10:34:06 juju-e4d256-prod-github-runner-207 kernel: [18620.603831] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 10:34:06 juju-e4d256-prod-github-runner-207 kernel: [18620.604680] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 10:34:06 juju-e4d256-prod-github-runner-207 kernel: [18620.605486] ? __seccomp_filter+0x4a/0x4a0 Aug 22 10:34:06 juju-e4d256-prod-github-runner-207 kernel: [18620.606227] ? __fget_files+0x86/0xc0 Aug 22 10:34:06 juju-e4d256-prod-github-runner-207 kernel: [18620.606931] __x64_sys_ioctl+0x95/0xd0 Aug 22 10:34:06 juju-e4d256-prod-github-runner-207 kernel: [18620.607619] do_syscall_64+0x5c/0xc0 Aug 22 10:34:06 juju-e4d256-prod-github-runner-207 kernel: [18620.608279] ? do_futex+0x162/0x1f0 Aug 22 10:34:06 juju-e4d256-prod-github-runner-207 kernel: [18620.608924] ? __x64_sys_futex+0x78/0x1e0 Aug 22 10:34:06 juju-e4d256-prod-github-runner-207 kernel: [18620.609604] ? __secure_computing+0xa9/0x120 Aug 22 10:34:06 juju-e4d256-prod-github-runner-207 kernel: [18620.610290] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 10:34:06 juju-e4d256-prod-github-runner-207 kernel: [18620.611044] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:34:06 juju-e4d256-prod-github-runner-207 kernel: [18620.611761] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:34:06 juju-e4d256-prod-github-runner-207 kernel: [18620.612473] ? do_syscall_64+0x69/0xc0 Aug 22 10:34:06 juju-e4d256-prod-github-runner-207 kernel: [18620.613124] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:34:06 juju-e4d256-prod-github-runner-207 kernel: [18620.613825] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:34:06 juju-e4d256-prod-github-runner-207 kernel: [18620.614518] ? do_syscall_64+0x69/0xc0 Aug 22 10:34:06 juju-e4d256-prod-github-runner-207 kernel: [18620.615141] ? do_syscall_64+0x69/0xc0 Aug 22 10:34:06 juju-e4d256-prod-github-runner-207 kernel: [18620.615759] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 10:34:06 juju-e4d256-prod-github-runner-207 kernel: [18620.616459] RIP: 0033:0x7faa5d0edaff Aug 22 10:34:06 juju-e4d256-prod-github-runner-207 kernel: [18620.617103] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 10:34:06 juju-e4d256-prod-github-runner-207 kernel: [18620.619075] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 10:34:06 juju-e4d256-prod-github-runner-207 kernel: [18620.619978] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 10:34:06 juju-e4d256-prod-github-runner-207 kernel: [18620.620861] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 10:34:06 juju-e4d256-prod-github-runner-207 kernel: [18620.621750] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 10:34:06 juju-e4d256-prod-github-runner-207 kernel: [18620.622633] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 10:34:06 juju-e4d256-prod-github-runner-207 kernel: [18620.623514] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 10:34:06 juju-e4d256-prod-github-runner-207 kernel: [18620.624408] Aug 22 10:34:34 juju-e4d256-prod-github-runner-207 kernel: [18648.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 17259s! [qemu-system-x86:6715] Aug 22 10:34:34 juju-e4d256-prod-github-runner-207 kernel: [18648.543126] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 10:34:34 juju-e4d256-prod-github-runner-207 kernel: [18648.543193] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 10:34:34 juju-e4d256-prod-github-runner-207 kernel: [18648.555879] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 10:34:34 juju-e4d256-prod-github-runner-207 kernel: [18648.557165] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 10:34:34 juju-e4d256-prod-github-runner-207 kernel: [18648.558384] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:34:34 juju-e4d256-prod-github-runner-207 kernel: [18648.559445] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 10:34:34 juju-e4d256-prod-github-runner-207 kernel: [18648.562014] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 10:34:34 juju-e4d256-prod-github-runner-207 kernel: [18648.563095] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 10:34:34 juju-e4d256-prod-github-runner-207 kernel: [18648.564344] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 10:34:34 juju-e4d256-prod-github-runner-207 kernel: [18648.565588] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 10:34:34 juju-e4d256-prod-github-runner-207 kernel: [18648.566785] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 10:34:34 juju-e4d256-prod-github-runner-207 kernel: [18648.567945] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 10:34:34 juju-e4d256-prod-github-runner-207 kernel: [18648.569126] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 10:34:34 juju-e4d256-prod-github-runner-207 kernel: [18648.570364] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 10:34:34 juju-e4d256-prod-github-runner-207 kernel: [18648.571461] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 10:34:34 juju-e4d256-prod-github-runner-207 kernel: [18648.572672] Call Trace: Aug 22 10:34:34 juju-e4d256-prod-github-runner-207 kernel: [18648.573584] Aug 22 10:34:34 juju-e4d256-prod-github-runner-207 kernel: [18648.574544] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:34:34 juju-e4d256-prod-github-runner-207 kernel: [18648.575630] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:34:34 juju-e4d256-prod-github-runner-207 kernel: [18648.576723] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:34:34 juju-e4d256-prod-github-runner-207 kernel: [18648.577891] ? show_regs.part.0+0x23/0x29 Aug 22 10:34:34 juju-e4d256-prod-github-runner-207 kernel: [18648.578944] ? show_regs.cold+0x8/0xd Aug 22 10:34:34 juju-e4d256-prod-github-runner-207 kernel: [18648.579988] ? watchdog_timer_fn+0x1be/0x220 Aug 22 10:34:34 juju-e4d256-prod-github-runner-207 kernel: [18648.581102] ? lockup_detector_update_enable+0x60/0x60 Aug 22 10:34:34 juju-e4d256-prod-github-runner-207 kernel: [18648.582231] ? __hrtimer_run_queues+0x107/0x230 Aug 22 10:34:34 juju-e4d256-prod-github-runner-207 kernel: [18648.583347] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 10:34:34 juju-e4d256-prod-github-runner-207 kernel: [18648.584505] ? hrtimer_interrupt+0x101/0x220 Aug 22 10:34:34 juju-e4d256-prod-github-runner-207 kernel: [18648.585617] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 10:34:34 juju-e4d256-prod-github-runner-207 kernel: [18648.586761] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 10:34:34 juju-e4d256-prod-github-runner-207 kernel: [18648.587955] Aug 22 10:34:34 juju-e4d256-prod-github-runner-207 kernel: [18648.588942] Aug 22 10:34:34 juju-e4d256-prod-github-runner-207 kernel: [18648.589886] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 10:34:34 juju-e4d256-prod-github-runner-207 kernel: [18648.591042] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:34:34 juju-e4d256-prod-github-runner-207 kernel: [18648.592167] ? _raw_spin_lock+0x22/0x30 Aug 22 10:34:34 juju-e4d256-prod-github-runner-207 kernel: [18648.593192] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:34:34 juju-e4d256-prod-github-runner-207 kernel: [18648.594276] direct_page_fault+0x206/0x310 [kvm] Aug 22 10:34:34 juju-e4d256-prod-github-runner-207 kernel: [18648.595367] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 10:34:34 juju-e4d256-prod-github-runner-207 kernel: [18648.596484] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 10:34:34 juju-e4d256-prod-github-runner-207 kernel: [18648.597597] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 10:34:34 juju-e4d256-prod-github-runner-207 kernel: [18648.598629] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 10:34:34 juju-e4d256-prod-github-runner-207 kernel: [18648.599666] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 10:34:34 juju-e4d256-prod-github-runner-207 kernel: [18648.600800] handle_exit+0x98/0x230 [kvm_amd] Aug 22 10:34:34 juju-e4d256-prod-github-runner-207 kernel: [18648.601702] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 10:34:34 juju-e4d256-prod-github-runner-207 kernel: [18648.602620] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 10:34:34 juju-e4d256-prod-github-runner-207 kernel: [18648.603632] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 10:34:34 juju-e4d256-prod-github-runner-207 kernel: [18648.604595] vcpu_run+0x62/0x2c0 [kvm] Aug 22 10:34:34 juju-e4d256-prod-github-runner-207 kernel: [18648.605576] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 10:34:34 juju-e4d256-prod-github-runner-207 kernel: [18648.606496] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 10:34:34 juju-e4d256-prod-github-runner-207 kernel: [18648.607410] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 10:34:34 juju-e4d256-prod-github-runner-207 kernel: [18648.608237] ? __seccomp_filter+0x4a/0x4a0 Aug 22 10:34:34 juju-e4d256-prod-github-runner-207 kernel: [18648.609035] ? __fget_files+0x86/0xc0 Aug 22 10:34:34 juju-e4d256-prod-github-runner-207 kernel: [18648.609821] __x64_sys_ioctl+0x95/0xd0 Aug 22 10:34:34 juju-e4d256-prod-github-runner-207 kernel: [18648.610567] do_syscall_64+0x5c/0xc0 Aug 22 10:34:34 juju-e4d256-prod-github-runner-207 kernel: [18648.611273] ? do_futex+0x162/0x1f0 Aug 22 10:34:34 juju-e4d256-prod-github-runner-207 kernel: [18648.611932] ? __x64_sys_futex+0x78/0x1e0 Aug 22 10:34:34 juju-e4d256-prod-github-runner-207 kernel: [18648.612668] ? __secure_computing+0xa9/0x120 Aug 22 10:34:34 juju-e4d256-prod-github-runner-207 kernel: [18648.613408] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 10:34:34 juju-e4d256-prod-github-runner-207 kernel: [18648.614207] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:34:34 juju-e4d256-prod-github-runner-207 kernel: [18648.614962] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:34:34 juju-e4d256-prod-github-runner-207 kernel: [18648.615707] ? do_syscall_64+0x69/0xc0 Aug 22 10:34:34 juju-e4d256-prod-github-runner-207 kernel: [18648.616434] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:34:34 juju-e4d256-prod-github-runner-207 kernel: [18648.617208] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:34:34 juju-e4d256-prod-github-runner-207 kernel: [18648.618018] ? do_syscall_64+0x69/0xc0 Aug 22 10:34:34 juju-e4d256-prod-github-runner-207 kernel: [18648.618705] ? do_syscall_64+0x69/0xc0 Aug 22 10:34:34 juju-e4d256-prod-github-runner-207 kernel: [18648.619390] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 10:34:34 juju-e4d256-prod-github-runner-207 kernel: [18648.620102] RIP: 0033:0x7faa5d0edaff Aug 22 10:34:34 juju-e4d256-prod-github-runner-207 kernel: [18648.620763] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 10:34:34 juju-e4d256-prod-github-runner-207 kernel: [18648.622890] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 10:34:34 juju-e4d256-prod-github-runner-207 kernel: [18648.623841] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 10:34:34 juju-e4d256-prod-github-runner-207 kernel: [18648.624847] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 10:34:34 juju-e4d256-prod-github-runner-207 kernel: [18648.625777] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 10:34:34 juju-e4d256-prod-github-runner-207 kernel: [18648.626744] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 10:34:34 juju-e4d256-prod-github-runner-207 kernel: [18648.627704] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 10:34:34 juju-e4d256-prod-github-runner-207 kernel: [18648.628661] Aug 22 10:35:02 juju-e4d256-prod-github-runner-207 kernel: [18676.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 17285s! [qemu-system-x86:6715] Aug 22 10:35:02 juju-e4d256-prod-github-runner-207 kernel: [18676.543094] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 10:35:02 juju-e4d256-prod-github-runner-207 kernel: [18676.543160] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 10:35:02 juju-e4d256-prod-github-runner-207 kernel: [18676.555236] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 10:35:02 juju-e4d256-prod-github-runner-207 kernel: [18676.556508] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 10:35:02 juju-e4d256-prod-github-runner-207 kernel: [18676.557728] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:35:02 juju-e4d256-prod-github-runner-207 kernel: [18676.558786] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 10:35:02 juju-e4d256-prod-github-runner-207 kernel: [18676.561349] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 10:35:02 juju-e4d256-prod-github-runner-207 kernel: [18676.562418] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 10:35:02 juju-e4d256-prod-github-runner-207 kernel: [18676.563584] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 10:35:02 juju-e4d256-prod-github-runner-207 kernel: [18676.564752] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 10:35:02 juju-e4d256-prod-github-runner-207 kernel: [18676.565908] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 10:35:02 juju-e4d256-prod-github-runner-207 kernel: [18676.567073] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 10:35:02 juju-e4d256-prod-github-runner-207 kernel: [18676.568238] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 10:35:02 juju-e4d256-prod-github-runner-207 kernel: [18676.569488] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 10:35:02 juju-e4d256-prod-github-runner-207 kernel: [18676.570627] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 10:35:02 juju-e4d256-prod-github-runner-207 kernel: [18676.571814] Call Trace: Aug 22 10:35:02 juju-e4d256-prod-github-runner-207 kernel: [18676.572748] Aug 22 10:35:02 juju-e4d256-prod-github-runner-207 kernel: [18676.573630] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:35:02 juju-e4d256-prod-github-runner-207 kernel: [18676.574659] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:35:02 juju-e4d256-prod-github-runner-207 kernel: [18676.575683] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:35:02 juju-e4d256-prod-github-runner-207 kernel: [18676.576774] ? show_regs.part.0+0x23/0x29 Aug 22 10:35:02 juju-e4d256-prod-github-runner-207 kernel: [18676.577786] ? show_regs.cold+0x8/0xd Aug 22 10:35:02 juju-e4d256-prod-github-runner-207 kernel: [18676.578757] ? watchdog_timer_fn+0x1be/0x220 Aug 22 10:35:02 juju-e4d256-prod-github-runner-207 kernel: [18676.579763] ? lockup_detector_update_enable+0x60/0x60 Aug 22 10:35:02 juju-e4d256-prod-github-runner-207 kernel: [18676.580850] ? __hrtimer_run_queues+0x107/0x230 Aug 22 10:35:02 juju-e4d256-prod-github-runner-207 kernel: [18676.581877] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 10:35:02 juju-e4d256-prod-github-runner-207 kernel: [18676.582900] ? hrtimer_interrupt+0x101/0x220 Aug 22 10:35:02 juju-e4d256-prod-github-runner-207 kernel: [18676.583918] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 10:35:02 juju-e4d256-prod-github-runner-207 kernel: [18676.584995] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 10:35:02 juju-e4d256-prod-github-runner-207 kernel: [18676.586049] Aug 22 10:35:02 juju-e4d256-prod-github-runner-207 kernel: [18676.586900] Aug 22 10:35:02 juju-e4d256-prod-github-runner-207 kernel: [18676.587734] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 10:35:02 juju-e4d256-prod-github-runner-207 kernel: [18676.588787] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:35:02 juju-e4d256-prod-github-runner-207 kernel: [18676.589827] ? _raw_spin_lock+0x22/0x30 Aug 22 10:35:02 juju-e4d256-prod-github-runner-207 kernel: [18676.590773] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:35:02 juju-e4d256-prod-github-runner-207 kernel: [18676.591791] direct_page_fault+0x206/0x310 [kvm] Aug 22 10:35:02 juju-e4d256-prod-github-runner-207 kernel: [18676.592826] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 10:35:02 juju-e4d256-prod-github-runner-207 kernel: [18676.593833] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 10:35:02 juju-e4d256-prod-github-runner-207 kernel: [18676.594835] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 10:35:02 juju-e4d256-prod-github-runner-207 kernel: [18676.595806] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 10:35:02 juju-e4d256-prod-github-runner-207 kernel: [18676.596766] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 10:35:02 juju-e4d256-prod-github-runner-207 kernel: [18676.597747] handle_exit+0x98/0x230 [kvm_amd] Aug 22 10:35:02 juju-e4d256-prod-github-runner-207 kernel: [18676.598637] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 10:35:02 juju-e4d256-prod-github-runner-207 kernel: [18676.599547] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 10:35:02 juju-e4d256-prod-github-runner-207 kernel: [18676.600486] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 10:35:02 juju-e4d256-prod-github-runner-207 kernel: [18676.601388] vcpu_run+0x62/0x2c0 [kvm] Aug 22 10:35:02 juju-e4d256-prod-github-runner-207 kernel: [18676.602196] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 10:35:02 juju-e4d256-prod-github-runner-207 kernel: [18676.603000] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 10:35:02 juju-e4d256-prod-github-runner-207 kernel: [18676.603851] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 10:35:02 juju-e4d256-prod-github-runner-207 kernel: [18676.604664] ? __seccomp_filter+0x4a/0x4a0 Aug 22 10:35:02 juju-e4d256-prod-github-runner-207 kernel: [18676.605406] ? __fget_files+0x86/0xc0 Aug 22 10:35:02 juju-e4d256-prod-github-runner-207 kernel: [18676.606114] __x64_sys_ioctl+0x95/0xd0 Aug 22 10:35:02 juju-e4d256-prod-github-runner-207 kernel: [18676.606805] do_syscall_64+0x5c/0xc0 Aug 22 10:35:02 juju-e4d256-prod-github-runner-207 kernel: [18676.607496] ? do_futex+0x162/0x1f0 Aug 22 10:35:02 juju-e4d256-prod-github-runner-207 kernel: [18676.608146] ? __x64_sys_futex+0x78/0x1e0 Aug 22 10:35:02 juju-e4d256-prod-github-runner-207 kernel: [18676.608839] ? __secure_computing+0xa9/0x120 Aug 22 10:35:02 juju-e4d256-prod-github-runner-207 kernel: [18676.609527] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 10:35:02 juju-e4d256-prod-github-runner-207 kernel: [18676.610289] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:35:02 juju-e4d256-prod-github-runner-207 kernel: [18676.611014] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:35:02 juju-e4d256-prod-github-runner-207 kernel: [18676.611734] ? do_syscall_64+0x69/0xc0 Aug 22 10:35:02 juju-e4d256-prod-github-runner-207 kernel: [18676.612387] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:35:02 juju-e4d256-prod-github-runner-207 kernel: [18676.613093] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:35:02 juju-e4d256-prod-github-runner-207 kernel: [18676.613786] ? do_syscall_64+0x69/0xc0 Aug 22 10:35:02 juju-e4d256-prod-github-runner-207 kernel: [18676.614411] ? do_syscall_64+0x69/0xc0 Aug 22 10:35:02 juju-e4d256-prod-github-runner-207 kernel: [18676.615033] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 10:35:02 juju-e4d256-prod-github-runner-207 kernel: [18676.615741] RIP: 0033:0x7faa5d0edaff Aug 22 10:35:02 juju-e4d256-prod-github-runner-207 kernel: [18676.616405] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 10:35:02 juju-e4d256-prod-github-runner-207 kernel: [18676.618385] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 10:35:02 juju-e4d256-prod-github-runner-207 kernel: [18676.619290] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 10:35:02 juju-e4d256-prod-github-runner-207 kernel: [18676.620180] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 10:35:02 juju-e4d256-prod-github-runner-207 kernel: [18676.621099] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 10:35:02 juju-e4d256-prod-github-runner-207 kernel: [18676.621983] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 10:35:02 juju-e4d256-prod-github-runner-207 kernel: [18676.622870] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 10:35:02 juju-e4d256-prod-github-runner-207 kernel: [18676.623758] Aug 22 10:35:30 juju-e4d256-prod-github-runner-207 kernel: [18704.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 17311s! [qemu-system-x86:6715] Aug 22 10:35:30 juju-e4d256-prod-github-runner-207 kernel: [18704.543125] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 10:35:30 juju-e4d256-prod-github-runner-207 kernel: [18704.543193] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 10:35:30 juju-e4d256-prod-github-runner-207 kernel: [18704.556322] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 10:35:30 juju-e4d256-prod-github-runner-207 kernel: [18704.557833] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 10:35:30 juju-e4d256-prod-github-runner-207 kernel: [18704.559214] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:35:30 juju-e4d256-prod-github-runner-207 kernel: [18704.560506] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 10:35:30 juju-e4d256-prod-github-runner-207 kernel: [18704.563145] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 10:35:30 juju-e4d256-prod-github-runner-207 kernel: [18704.564211] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 10:35:30 juju-e4d256-prod-github-runner-207 kernel: [18704.565380] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 10:35:30 juju-e4d256-prod-github-runner-207 kernel: [18704.566545] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 10:35:30 juju-e4d256-prod-github-runner-207 kernel: [18704.567704] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 10:35:30 juju-e4d256-prod-github-runner-207 kernel: [18704.568918] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 10:35:30 juju-e4d256-prod-github-runner-207 kernel: [18704.570090] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 10:35:30 juju-e4d256-prod-github-runner-207 kernel: [18704.571326] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 10:35:30 juju-e4d256-prod-github-runner-207 kernel: [18704.572510] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 10:35:30 juju-e4d256-prod-github-runner-207 kernel: [18704.573716] Call Trace: Aug 22 10:35:30 juju-e4d256-prod-github-runner-207 kernel: [18704.574629] Aug 22 10:35:30 juju-e4d256-prod-github-runner-207 kernel: [18704.575529] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:35:30 juju-e4d256-prod-github-runner-207 kernel: [18704.576793] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:35:30 juju-e4d256-prod-github-runner-207 kernel: [18704.578052] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:35:30 juju-e4d256-prod-github-runner-207 kernel: [18704.579285] ? show_regs.part.0+0x23/0x29 Aug 22 10:35:30 juju-e4d256-prod-github-runner-207 kernel: [18704.580313] ? show_regs.cold+0x8/0xd Aug 22 10:35:30 juju-e4d256-prod-github-runner-207 kernel: [18704.581297] ? watchdog_timer_fn+0x1be/0x220 Aug 22 10:35:30 juju-e4d256-prod-github-runner-207 kernel: [18704.582466] ? lockup_detector_update_enable+0x60/0x60 Aug 22 10:35:30 juju-e4d256-prod-github-runner-207 kernel: [18704.583533] ? __hrtimer_run_queues+0x107/0x230 Aug 22 10:35:30 juju-e4d256-prod-github-runner-207 kernel: [18704.584654] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 10:35:30 juju-e4d256-prod-github-runner-207 kernel: [18704.585684] ? hrtimer_interrupt+0x101/0x220 Aug 22 10:35:30 juju-e4d256-prod-github-runner-207 kernel: [18704.586712] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 10:35:30 juju-e4d256-prod-github-runner-207 kernel: [18704.587785] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 10:35:30 juju-e4d256-prod-github-runner-207 kernel: [18704.588853] Aug 22 10:35:30 juju-e4d256-prod-github-runner-207 kernel: [18704.589909] Aug 22 10:35:30 juju-e4d256-prod-github-runner-207 kernel: [18704.590862] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 10:35:30 juju-e4d256-prod-github-runner-207 kernel: [18704.591906] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:35:30 juju-e4d256-prod-github-runner-207 kernel: [18704.593032] ? _raw_spin_lock+0x22/0x30 Aug 22 10:35:30 juju-e4d256-prod-github-runner-207 kernel: [18704.594139] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:35:30 juju-e4d256-prod-github-runner-207 kernel: [18704.595273] direct_page_fault+0x206/0x310 [kvm] Aug 22 10:35:30 juju-e4d256-prod-github-runner-207 kernel: [18704.596469] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 10:35:30 juju-e4d256-prod-github-runner-207 kernel: [18704.597578] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 10:35:30 juju-e4d256-prod-github-runner-207 kernel: [18704.598782] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 10:35:30 juju-e4d256-prod-github-runner-207 kernel: [18704.599779] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 10:35:30 juju-e4d256-prod-github-runner-207 kernel: [18704.600792] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 10:35:30 juju-e4d256-prod-github-runner-207 kernel: [18704.601926] handle_exit+0x98/0x230 [kvm_amd] Aug 22 10:35:30 juju-e4d256-prod-github-runner-207 kernel: [18704.602904] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 10:35:30 juju-e4d256-prod-github-runner-207 kernel: [18704.603991] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 10:35:30 juju-e4d256-prod-github-runner-207 kernel: [18704.605018] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 10:35:30 juju-e4d256-prod-github-runner-207 kernel: [18704.606028] vcpu_run+0x62/0x2c0 [kvm] Aug 22 10:35:30 juju-e4d256-prod-github-runner-207 kernel: [18704.606878] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 10:35:30 juju-e4d256-prod-github-runner-207 kernel: [18704.607784] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 10:35:30 juju-e4d256-prod-github-runner-207 kernel: [18704.608718] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 10:35:30 juju-e4d256-prod-github-runner-207 kernel: [18704.609609] ? __seccomp_filter+0x4a/0x4a0 Aug 22 10:35:30 juju-e4d256-prod-github-runner-207 kernel: [18704.610426] ? __fget_files+0x86/0xc0 Aug 22 10:35:30 juju-e4d256-prod-github-runner-207 kernel: [18704.611190] __x64_sys_ioctl+0x95/0xd0 Aug 22 10:35:30 juju-e4d256-prod-github-runner-207 kernel: [18704.612039] do_syscall_64+0x5c/0xc0 Aug 22 10:35:30 juju-e4d256-prod-github-runner-207 kernel: [18704.612865] ? do_futex+0x162/0x1f0 Aug 22 10:35:30 juju-e4d256-prod-github-runner-207 kernel: [18704.613660] ? __x64_sys_futex+0x78/0x1e0 Aug 22 10:35:30 juju-e4d256-prod-github-runner-207 kernel: [18704.614419] ? __secure_computing+0xa9/0x120 Aug 22 10:35:30 juju-e4d256-prod-github-runner-207 kernel: [18704.615114] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 10:35:30 juju-e4d256-prod-github-runner-207 kernel: [18704.615939] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:35:30 juju-e4d256-prod-github-runner-207 kernel: [18704.616813] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:35:30 juju-e4d256-prod-github-runner-207 kernel: [18704.617663] ? do_syscall_64+0x69/0xc0 Aug 22 10:35:30 juju-e4d256-prod-github-runner-207 kernel: [18704.618460] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:35:30 juju-e4d256-prod-github-runner-207 kernel: [18704.619277] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:35:30 juju-e4d256-prod-github-runner-207 kernel: [18704.620042] ? do_syscall_64+0x69/0xc0 Aug 22 10:35:30 juju-e4d256-prod-github-runner-207 kernel: [18704.620720] ? do_syscall_64+0x69/0xc0 Aug 22 10:35:30 juju-e4d256-prod-github-runner-207 kernel: [18704.621345] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 10:35:30 juju-e4d256-prod-github-runner-207 kernel: [18704.622149] RIP: 0033:0x7faa5d0edaff Aug 22 10:35:30 juju-e4d256-prod-github-runner-207 kernel: [18704.622905] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 10:35:30 juju-e4d256-prod-github-runner-207 kernel: [18704.625182] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 10:35:30 juju-e4d256-prod-github-runner-207 kernel: [18704.626231] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 10:35:30 juju-e4d256-prod-github-runner-207 kernel: [18704.627208] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 10:35:30 juju-e4d256-prod-github-runner-207 kernel: [18704.628167] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 10:35:30 juju-e4d256-prod-github-runner-207 kernel: [18704.629071] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 10:35:30 juju-e4d256-prod-github-runner-207 kernel: [18704.629964] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 10:35:30 juju-e4d256-prod-github-runner-207 kernel: [18704.630867] Aug 22 10:35:44 juju-e4d256-prod-github-runner-207 kernel: [18718.436706] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 10:35:44 juju-e4d256-prod-github-runner-207 kernel: [18718.438303] rcu: 1-....: (4635816 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=2244248 Aug 22 10:35:44 juju-e4d256-prod-github-runner-207 kernel: [18718.439440] (t=4650309 jiffies g=23269 q=25065) Aug 22 10:35:44 juju-e4d256-prod-github-runner-207 kernel: [18718.440261] NMI backtrace for cpu 1 Aug 22 10:35:44 juju-e4d256-prod-github-runner-207 kernel: [18718.440979] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 10:35:44 juju-e4d256-prod-github-runner-207 kernel: [18718.442090] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 10:35:44 juju-e4d256-prod-github-runner-207 kernel: [18718.443164] Call Trace: Aug 22 10:35:44 juju-e4d256-prod-github-runner-207 kernel: [18718.443859] Aug 22 10:35:44 juju-e4d256-prod-github-runner-207 kernel: [18718.444524] show_stack+0x52/0x5c Aug 22 10:35:44 juju-e4d256-prod-github-runner-207 kernel: [18718.445258] dump_stack_lvl+0x4a/0x63 Aug 22 10:35:44 juju-e4d256-prod-github-runner-207 kernel: [18718.446010] dump_stack+0x10/0x16 Aug 22 10:35:44 juju-e4d256-prod-github-runner-207 kernel: [18718.446735] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 10:35:44 juju-e4d256-prod-github-runner-207 kernel: [18718.447524] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 10:35:44 juju-e4d256-prod-github-runner-207 kernel: [18718.448331] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 10:35:44 juju-e4d256-prod-github-runner-207 kernel: [18718.449166] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 10:35:44 juju-e4d256-prod-github-runner-207 kernel: [18718.449998] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 10:35:44 juju-e4d256-prod-github-runner-207 kernel: [18718.450813] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 10:35:44 juju-e4d256-prod-github-runner-207 kernel: [18718.451593] print_cpu_stall.cold+0x2f/0xe2 Aug 22 10:35:44 juju-e4d256-prod-github-runner-207 kernel: [18718.452397] ? timekeeping_update+0xf7/0x150 Aug 22 10:35:44 juju-e4d256-prod-github-runner-207 kernel: [18718.453181] check_cpu_stall+0x109/0x270 Aug 22 10:35:44 juju-e4d256-prod-github-runner-207 kernel: [18718.453939] rcu_sched_clock_irq+0x9a/0x250 Aug 22 10:35:44 juju-e4d256-prod-github-runner-207 kernel: [18718.454708] update_process_times+0x94/0xd0 Aug 22 10:35:44 juju-e4d256-prod-github-runner-207 kernel: [18718.455481] tick_sched_handle+0x29/0x70 Aug 22 10:35:44 juju-e4d256-prod-github-runner-207 kernel: [18718.456257] tick_sched_timer+0x8c/0xc0 Aug 22 10:35:44 juju-e4d256-prod-github-runner-207 kernel: [18718.457007] ? tick_nohz_handler+0xb0/0xb0 Aug 22 10:35:44 juju-e4d256-prod-github-runner-207 kernel: [18718.457778] __hrtimer_run_queues+0x107/0x230 Aug 22 10:35:44 juju-e4d256-prod-github-runner-207 kernel: [18718.458558] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 10:35:44 juju-e4d256-prod-github-runner-207 kernel: [18718.459344] hrtimer_interrupt+0x101/0x220 Aug 22 10:35:44 juju-e4d256-prod-github-runner-207 kernel: [18718.460129] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 10:35:44 juju-e4d256-prod-github-runner-207 kernel: [18718.460952] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 10:35:44 juju-e4d256-prod-github-runner-207 kernel: [18718.461768] Aug 22 10:35:44 juju-e4d256-prod-github-runner-207 kernel: [18718.462411] Aug 22 10:35:44 juju-e4d256-prod-github-runner-207 kernel: [18718.463050] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 10:35:44 juju-e4d256-prod-github-runner-207 kernel: [18718.463908] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:35:44 juju-e4d256-prod-github-runner-207 kernel: [18718.464801] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 10:35:44 juju-e4d256-prod-github-runner-207 kernel: [18718.467040] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 10:35:44 juju-e4d256-prod-github-runner-207 kernel: [18718.467949] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 10:35:44 juju-e4d256-prod-github-runner-207 kernel: [18718.468957] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 10:35:44 juju-e4d256-prod-github-runner-207 kernel: [18718.469948] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 10:35:44 juju-e4d256-prod-github-runner-207 kernel: [18718.470928] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 10:35:44 juju-e4d256-prod-github-runner-207 kernel: [18718.471910] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 10:35:44 juju-e4d256-prod-github-runner-207 kernel: [18718.472892] ? _raw_spin_lock+0x22/0x30 Aug 22 10:35:44 juju-e4d256-prod-github-runner-207 kernel: [18718.473780] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:35:44 juju-e4d256-prod-github-runner-207 kernel: [18718.474719] direct_page_fault+0x206/0x310 [kvm] Aug 22 10:35:44 juju-e4d256-prod-github-runner-207 kernel: [18718.475652] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 10:35:44 juju-e4d256-prod-github-runner-207 kernel: [18718.476586] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 10:35:44 juju-e4d256-prod-github-runner-207 kernel: [18718.477516] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 10:35:44 juju-e4d256-prod-github-runner-207 kernel: [18718.478445] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 10:35:44 juju-e4d256-prod-github-runner-207 kernel: [18718.479319] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 10:35:44 juju-e4d256-prod-github-runner-207 kernel: [18718.480273] handle_exit+0x98/0x230 [kvm_amd] Aug 22 10:35:44 juju-e4d256-prod-github-runner-207 kernel: [18718.481123] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 10:35:44 juju-e4d256-prod-github-runner-207 kernel: [18718.481995] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 10:35:44 juju-e4d256-prod-github-runner-207 kernel: [18718.482886] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 10:35:44 juju-e4d256-prod-github-runner-207 kernel: [18718.483771] vcpu_run+0x62/0x2c0 [kvm] Aug 22 10:35:44 juju-e4d256-prod-github-runner-207 kernel: [18718.484582] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 10:35:44 juju-e4d256-prod-github-runner-207 kernel: [18718.485406] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 10:35:44 juju-e4d256-prod-github-runner-207 kernel: [18718.486306] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 10:35:44 juju-e4d256-prod-github-runner-207 kernel: [18718.487153] ? __seccomp_filter+0x4a/0x4a0 Aug 22 10:35:44 juju-e4d256-prod-github-runner-207 kernel: [18718.487977] ? __fget_files+0x86/0xc0 Aug 22 10:35:44 juju-e4d256-prod-github-runner-207 kernel: [18718.488747] __x64_sys_ioctl+0x95/0xd0 Aug 22 10:35:44 juju-e4d256-prod-github-runner-207 kernel: [18718.489513] do_syscall_64+0x5c/0xc0 Aug 22 10:35:44 juju-e4d256-prod-github-runner-207 kernel: [18718.490268] ? do_futex+0x162/0x1f0 Aug 22 10:35:44 juju-e4d256-prod-github-runner-207 kernel: [18718.491007] ? __x64_sys_futex+0x78/0x1e0 Aug 22 10:35:44 juju-e4d256-prod-github-runner-207 kernel: [18718.491786] ? __secure_computing+0xa9/0x120 Aug 22 10:35:44 juju-e4d256-prod-github-runner-207 kernel: [18718.492605] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 10:35:44 juju-e4d256-prod-github-runner-207 kernel: [18718.493502] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:35:44 juju-e4d256-prod-github-runner-207 kernel: [18718.494352] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:35:44 juju-e4d256-prod-github-runner-207 kernel: [18718.495202] ? do_syscall_64+0x69/0xc0 Aug 22 10:35:44 juju-e4d256-prod-github-runner-207 kernel: [18718.495990] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:35:44 juju-e4d256-prod-github-runner-207 kernel: [18718.496926] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:35:44 juju-e4d256-prod-github-runner-207 kernel: [18718.497870] ? do_syscall_64+0x69/0xc0 Aug 22 10:35:44 juju-e4d256-prod-github-runner-207 kernel: [18718.498731] ? do_syscall_64+0x69/0xc0 Aug 22 10:35:44 juju-e4d256-prod-github-runner-207 kernel: [18718.499604] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 10:35:44 juju-e4d256-prod-github-runner-207 kernel: [18718.500559] RIP: 0033:0x7faa5d0edaff Aug 22 10:35:44 juju-e4d256-prod-github-runner-207 kernel: [18718.501469] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 10:35:44 juju-e4d256-prod-github-runner-207 kernel: [18718.504182] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 10:35:44 juju-e4d256-prod-github-runner-207 kernel: [18718.505359] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 10:35:44 juju-e4d256-prod-github-runner-207 kernel: [18718.506338] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 10:35:44 juju-e4d256-prod-github-runner-207 kernel: [18718.507314] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 10:35:44 juju-e4d256-prod-github-runner-207 kernel: [18718.508334] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 10:35:44 juju-e4d256-prod-github-runner-207 kernel: [18718.509288] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 10:35:44 juju-e4d256-prod-github-runner-207 kernel: [18718.510225] Aug 22 10:36:10 juju-e4d256-prod-github-runner-207 kernel: [18744.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 17349s! [qemu-system-x86:6715] Aug 22 10:36:10 juju-e4d256-prod-github-runner-207 kernel: [18744.543164] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 10:36:10 juju-e4d256-prod-github-runner-207 kernel: [18744.543457] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 10:36:10 juju-e4d256-prod-github-runner-207 kernel: [18744.555863] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 10:36:10 juju-e4d256-prod-github-runner-207 kernel: [18744.557145] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 10:36:10 juju-e4d256-prod-github-runner-207 kernel: [18744.558368] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:36:10 juju-e4d256-prod-github-runner-207 kernel: [18744.559433] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 10:36:10 juju-e4d256-prod-github-runner-207 kernel: [18744.562059] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 10:36:10 juju-e4d256-prod-github-runner-207 kernel: [18744.563113] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 10:36:10 juju-e4d256-prod-github-runner-207 kernel: [18744.564351] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 10:36:10 juju-e4d256-prod-github-runner-207 kernel: [18744.565518] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 10:36:10 juju-e4d256-prod-github-runner-207 kernel: [18744.566681] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 10:36:10 juju-e4d256-prod-github-runner-207 kernel: [18744.567887] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 10:36:10 juju-e4d256-prod-github-runner-207 kernel: [18744.569060] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 10:36:10 juju-e4d256-prod-github-runner-207 kernel: [18744.570299] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 10:36:10 juju-e4d256-prod-github-runner-207 kernel: [18744.571404] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 10:36:10 juju-e4d256-prod-github-runner-207 kernel: [18744.572621] Call Trace: Aug 22 10:36:10 juju-e4d256-prod-github-runner-207 kernel: [18744.573538] Aug 22 10:36:10 juju-e4d256-prod-github-runner-207 kernel: [18744.574422] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:36:10 juju-e4d256-prod-github-runner-207 kernel: [18744.575453] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:36:10 juju-e4d256-prod-github-runner-207 kernel: [18744.576490] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:36:10 juju-e4d256-prod-github-runner-207 kernel: [18744.577566] ? show_regs.part.0+0x23/0x29 Aug 22 10:36:10 juju-e4d256-prod-github-runner-207 kernel: [18744.578567] ? show_regs.cold+0x8/0xd Aug 22 10:36:10 juju-e4d256-prod-github-runner-207 kernel: [18744.579559] ? watchdog_timer_fn+0x1be/0x220 Aug 22 10:36:10 juju-e4d256-prod-github-runner-207 kernel: [18744.580569] ? lockup_detector_update_enable+0x60/0x60 Aug 22 10:36:10 juju-e4d256-prod-github-runner-207 kernel: [18744.581653] ? __hrtimer_run_queues+0x107/0x230 Aug 22 10:36:10 juju-e4d256-prod-github-runner-207 kernel: [18744.582695] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 10:36:10 juju-e4d256-prod-github-runner-207 kernel: [18744.583844] ? hrtimer_interrupt+0x101/0x220 Aug 22 10:36:10 juju-e4d256-prod-github-runner-207 kernel: [18744.584902] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 10:36:10 juju-e4d256-prod-github-runner-207 kernel: [18744.585975] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 10:36:10 juju-e4d256-prod-github-runner-207 kernel: [18744.587026] Aug 22 10:36:10 juju-e4d256-prod-github-runner-207 kernel: [18744.587939] Aug 22 10:36:10 juju-e4d256-prod-github-runner-207 kernel: [18744.588783] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 10:36:10 juju-e4d256-prod-github-runner-207 kernel: [18744.589818] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:36:10 juju-e4d256-prod-github-runner-207 kernel: [18744.590863] ? _raw_spin_lock+0x22/0x30 Aug 22 10:36:10 juju-e4d256-prod-github-runner-207 kernel: [18744.591837] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:36:10 juju-e4d256-prod-github-runner-207 kernel: [18744.592860] direct_page_fault+0x206/0x310 [kvm] Aug 22 10:36:10 juju-e4d256-prod-github-runner-207 kernel: [18744.594097] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 10:36:10 juju-e4d256-prod-github-runner-207 kernel: [18744.595113] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 10:36:10 juju-e4d256-prod-github-runner-207 kernel: [18744.596127] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 10:36:10 juju-e4d256-prod-github-runner-207 kernel: [18744.597100] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 10:36:10 juju-e4d256-prod-github-runner-207 kernel: [18744.598052] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 10:36:10 juju-e4d256-prod-github-runner-207 kernel: [18744.599031] handle_exit+0x98/0x230 [kvm_amd] Aug 22 10:36:10 juju-e4d256-prod-github-runner-207 kernel: [18744.599960] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 10:36:10 juju-e4d256-prod-github-runner-207 kernel: [18744.600906] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 10:36:10 juju-e4d256-prod-github-runner-207 kernel: [18744.601833] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 10:36:10 juju-e4d256-prod-github-runner-207 kernel: [18744.602734] vcpu_run+0x62/0x2c0 [kvm] Aug 22 10:36:10 juju-e4d256-prod-github-runner-207 kernel: [18744.603566] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 10:36:10 juju-e4d256-prod-github-runner-207 kernel: [18744.604374] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 10:36:10 juju-e4d256-prod-github-runner-207 kernel: [18744.605232] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 10:36:10 juju-e4d256-prod-github-runner-207 kernel: [18744.606029] ? __seccomp_filter+0x4a/0x4a0 Aug 22 10:36:10 juju-e4d256-prod-github-runner-207 kernel: [18744.606777] ? __fget_files+0x86/0xc0 Aug 22 10:36:10 juju-e4d256-prod-github-runner-207 kernel: [18744.607478] __x64_sys_ioctl+0x95/0xd0 Aug 22 10:36:10 juju-e4d256-prod-github-runner-207 kernel: [18744.608183] do_syscall_64+0x5c/0xc0 Aug 22 10:36:10 juju-e4d256-prod-github-runner-207 kernel: [18744.608846] ? do_futex+0x162/0x1f0 Aug 22 10:36:10 juju-e4d256-prod-github-runner-207 kernel: [18744.609494] ? __x64_sys_futex+0x78/0x1e0 Aug 22 10:36:10 juju-e4d256-prod-github-runner-207 kernel: [18744.610172] ? __secure_computing+0xa9/0x120 Aug 22 10:36:10 juju-e4d256-prod-github-runner-207 kernel: [18744.610867] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 10:36:10 juju-e4d256-prod-github-runner-207 kernel: [18744.611639] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:36:10 juju-e4d256-prod-github-runner-207 kernel: [18744.612366] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:36:10 juju-e4d256-prod-github-runner-207 kernel: [18744.613083] ? do_syscall_64+0x69/0xc0 Aug 22 10:36:10 juju-e4d256-prod-github-runner-207 kernel: [18744.613727] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:36:10 juju-e4d256-prod-github-runner-207 kernel: [18744.614433] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:36:10 juju-e4d256-prod-github-runner-207 kernel: [18744.615126] ? do_syscall_64+0x69/0xc0 Aug 22 10:36:10 juju-e4d256-prod-github-runner-207 kernel: [18744.615766] ? do_syscall_64+0x69/0xc0 Aug 22 10:36:10 juju-e4d256-prod-github-runner-207 kernel: [18744.616389] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 10:36:10 juju-e4d256-prod-github-runner-207 kernel: [18744.617121] RIP: 0033:0x7faa5d0edaff Aug 22 10:36:10 juju-e4d256-prod-github-runner-207 kernel: [18744.617746] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 10:36:10 juju-e4d256-prod-github-runner-207 kernel: [18744.619749] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 10:36:10 juju-e4d256-prod-github-runner-207 kernel: [18744.620662] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 10:36:10 juju-e4d256-prod-github-runner-207 kernel: [18744.621552] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 10:36:10 juju-e4d256-prod-github-runner-207 kernel: [18744.622442] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 10:36:10 juju-e4d256-prod-github-runner-207 kernel: [18744.623332] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 10:36:10 juju-e4d256-prod-github-runner-207 kernel: [18744.624242] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 10:36:10 juju-e4d256-prod-github-runner-207 kernel: [18744.625131] Aug 22 10:36:38 juju-e4d256-prod-github-runner-207 kernel: [18772.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 17375s! [qemu-system-x86:6715] Aug 22 10:36:38 juju-e4d256-prod-github-runner-207 kernel: [18772.543153] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 10:36:38 juju-e4d256-prod-github-runner-207 kernel: [18772.543235] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 10:36:38 juju-e4d256-prod-github-runner-207 kernel: [18772.555342] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 10:36:38 juju-e4d256-prod-github-runner-207 kernel: [18772.556784] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 10:36:38 juju-e4d256-prod-github-runner-207 kernel: [18772.558009] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:36:38 juju-e4d256-prod-github-runner-207 kernel: [18772.559072] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 10:36:38 juju-e4d256-prod-github-runner-207 kernel: [18772.561666] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 10:36:38 juju-e4d256-prod-github-runner-207 kernel: [18772.562712] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 10:36:38 juju-e4d256-prod-github-runner-207 kernel: [18772.563885] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 10:36:38 juju-e4d256-prod-github-runner-207 kernel: [18772.565086] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 10:36:38 juju-e4d256-prod-github-runner-207 kernel: [18772.566265] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 10:36:38 juju-e4d256-prod-github-runner-207 kernel: [18772.567459] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 10:36:38 juju-e4d256-prod-github-runner-207 kernel: [18772.568634] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 10:36:38 juju-e4d256-prod-github-runner-207 kernel: [18772.569868] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 10:36:38 juju-e4d256-prod-github-runner-207 kernel: [18772.570965] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 10:36:38 juju-e4d256-prod-github-runner-207 kernel: [18772.572174] Call Trace: Aug 22 10:36:38 juju-e4d256-prod-github-runner-207 kernel: [18772.573111] Aug 22 10:36:38 juju-e4d256-prod-github-runner-207 kernel: [18772.574003] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:36:38 juju-e4d256-prod-github-runner-207 kernel: [18772.575033] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:36:38 juju-e4d256-prod-github-runner-207 kernel: [18772.576068] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:36:38 juju-e4d256-prod-github-runner-207 kernel: [18772.577157] ? show_regs.part.0+0x23/0x29 Aug 22 10:36:38 juju-e4d256-prod-github-runner-207 kernel: [18772.578155] ? show_regs.cold+0x8/0xd Aug 22 10:36:38 juju-e4d256-prod-github-runner-207 kernel: [18772.579124] ? watchdog_timer_fn+0x1be/0x220 Aug 22 10:36:38 juju-e4d256-prod-github-runner-207 kernel: [18772.580145] ? lockup_detector_update_enable+0x60/0x60 Aug 22 10:36:38 juju-e4d256-prod-github-runner-207 kernel: [18772.581205] ? __hrtimer_run_queues+0x107/0x230 Aug 22 10:36:38 juju-e4d256-prod-github-runner-207 kernel: [18772.582249] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 10:36:38 juju-e4d256-prod-github-runner-207 kernel: [18772.583298] ? hrtimer_interrupt+0x101/0x220 Aug 22 10:36:38 juju-e4d256-prod-github-runner-207 kernel: [18772.584316] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 10:36:38 juju-e4d256-prod-github-runner-207 kernel: [18772.585380] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 10:36:38 juju-e4d256-prod-github-runner-207 kernel: [18772.586424] Aug 22 10:36:38 juju-e4d256-prod-github-runner-207 kernel: [18772.587310] Aug 22 10:36:38 juju-e4d256-prod-github-runner-207 kernel: [18772.588204] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 10:36:38 juju-e4d256-prod-github-runner-207 kernel: [18772.589236] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:36:38 juju-e4d256-prod-github-runner-207 kernel: [18772.590272] ? _raw_spin_lock+0x22/0x30 Aug 22 10:36:38 juju-e4d256-prod-github-runner-207 kernel: [18772.591232] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:36:38 juju-e4d256-prod-github-runner-207 kernel: [18772.592251] direct_page_fault+0x206/0x310 [kvm] Aug 22 10:36:38 juju-e4d256-prod-github-runner-207 kernel: [18772.593278] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 10:36:38 juju-e4d256-prod-github-runner-207 kernel: [18772.594282] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 10:36:38 juju-e4d256-prod-github-runner-207 kernel: [18772.595299] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 10:36:38 juju-e4d256-prod-github-runner-207 kernel: [18772.596267] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 10:36:38 juju-e4d256-prod-github-runner-207 kernel: [18772.597208] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 10:36:38 juju-e4d256-prod-github-runner-207 kernel: [18772.598217] handle_exit+0x98/0x230 [kvm_amd] Aug 22 10:36:38 juju-e4d256-prod-github-runner-207 kernel: [18772.599112] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 10:36:38 juju-e4d256-prod-github-runner-207 kernel: [18772.600039] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 10:36:38 juju-e4d256-prod-github-runner-207 kernel: [18772.600967] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 10:36:38 juju-e4d256-prod-github-runner-207 kernel: [18772.601869] vcpu_run+0x62/0x2c0 [kvm] Aug 22 10:36:38 juju-e4d256-prod-github-runner-207 kernel: [18772.602677] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 10:36:38 juju-e4d256-prod-github-runner-207 kernel: [18772.603524] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 10:36:38 juju-e4d256-prod-github-runner-207 kernel: [18772.604379] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 10:36:38 juju-e4d256-prod-github-runner-207 kernel: [18772.605214] ? __seccomp_filter+0x4a/0x4a0 Aug 22 10:36:38 juju-e4d256-prod-github-runner-207 kernel: [18772.605956] ? __fget_files+0x86/0xc0 Aug 22 10:36:38 juju-e4d256-prod-github-runner-207 kernel: [18772.606663] __x64_sys_ioctl+0x95/0xd0 Aug 22 10:36:38 juju-e4d256-prod-github-runner-207 kernel: [18772.607365] do_syscall_64+0x5c/0xc0 Aug 22 10:36:38 juju-e4d256-prod-github-runner-207 kernel: [18772.608046] ? do_futex+0x162/0x1f0 Aug 22 10:36:38 juju-e4d256-prod-github-runner-207 kernel: [18772.608697] ? __x64_sys_futex+0x78/0x1e0 Aug 22 10:36:38 juju-e4d256-prod-github-runner-207 kernel: [18772.609370] ? __secure_computing+0xa9/0x120 Aug 22 10:36:38 juju-e4d256-prod-github-runner-207 kernel: [18772.610059] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 10:36:38 juju-e4d256-prod-github-runner-207 kernel: [18772.610818] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:36:38 juju-e4d256-prod-github-runner-207 kernel: [18772.611555] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:36:38 juju-e4d256-prod-github-runner-207 kernel: [18772.612278] ? do_syscall_64+0x69/0xc0 Aug 22 10:36:38 juju-e4d256-prod-github-runner-207 kernel: [18772.612955] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:36:38 juju-e4d256-prod-github-runner-207 kernel: [18772.613691] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:36:38 juju-e4d256-prod-github-runner-207 kernel: [18772.614432] ? do_syscall_64+0x69/0xc0 Aug 22 10:36:38 juju-e4d256-prod-github-runner-207 kernel: [18772.615145] ? do_syscall_64+0x69/0xc0 Aug 22 10:36:38 juju-e4d256-prod-github-runner-207 kernel: [18772.615865] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 10:36:38 juju-e4d256-prod-github-runner-207 kernel: [18772.616678] RIP: 0033:0x7faa5d0edaff Aug 22 10:36:38 juju-e4d256-prod-github-runner-207 kernel: [18772.617423] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 10:36:38 juju-e4d256-prod-github-runner-207 kernel: [18772.619755] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 10:36:38 juju-e4d256-prod-github-runner-207 kernel: [18772.620843] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 10:36:38 juju-e4d256-prod-github-runner-207 kernel: [18772.621869] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 10:36:38 juju-e4d256-prod-github-runner-207 kernel: [18772.622933] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 10:36:38 juju-e4d256-prod-github-runner-207 kernel: [18772.623959] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 10:36:38 juju-e4d256-prod-github-runner-207 kernel: [18772.624974] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 10:36:38 juju-e4d256-prod-github-runner-207 kernel: [18772.626041] Aug 22 10:37:06 juju-e4d256-prod-github-runner-207 kernel: [18800.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 17401s! [qemu-system-x86:6715] Aug 22 10:37:06 juju-e4d256-prod-github-runner-207 kernel: [18800.543202] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 10:37:06 juju-e4d256-prod-github-runner-207 kernel: [18800.543338] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 10:37:06 juju-e4d256-prod-github-runner-207 kernel: [18800.555560] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 10:37:06 juju-e4d256-prod-github-runner-207 kernel: [18800.556842] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 10:37:06 juju-e4d256-prod-github-runner-207 kernel: [18800.558068] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:37:06 juju-e4d256-prod-github-runner-207 kernel: [18800.559142] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 10:37:06 juju-e4d256-prod-github-runner-207 kernel: [18800.561739] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 10:37:06 juju-e4d256-prod-github-runner-207 kernel: [18800.562794] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 10:37:06 juju-e4d256-prod-github-runner-207 kernel: [18800.563981] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 10:37:06 juju-e4d256-prod-github-runner-207 kernel: [18800.565151] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 10:37:06 juju-e4d256-prod-github-runner-207 kernel: [18800.566309] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 10:37:06 juju-e4d256-prod-github-runner-207 kernel: [18800.567512] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 10:37:06 juju-e4d256-prod-github-runner-207 kernel: [18800.568673] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 10:37:06 juju-e4d256-prod-github-runner-207 kernel: [18800.569907] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 10:37:06 juju-e4d256-prod-github-runner-207 kernel: [18800.571021] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 10:37:06 juju-e4d256-prod-github-runner-207 kernel: [18800.572208] Call Trace: Aug 22 10:37:06 juju-e4d256-prod-github-runner-207 kernel: [18800.573119] Aug 22 10:37:06 juju-e4d256-prod-github-runner-207 kernel: [18800.574007] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:37:06 juju-e4d256-prod-github-runner-207 kernel: [18800.575046] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:37:06 juju-e4d256-prod-github-runner-207 kernel: [18800.576097] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:37:06 juju-e4d256-prod-github-runner-207 kernel: [18800.577235] ? show_regs.part.0+0x23/0x29 Aug 22 10:37:06 juju-e4d256-prod-github-runner-207 kernel: [18800.578282] ? show_regs.cold+0x8/0xd Aug 22 10:37:06 juju-e4d256-prod-github-runner-207 kernel: [18800.579272] ? watchdog_timer_fn+0x1be/0x220 Aug 22 10:37:06 juju-e4d256-prod-github-runner-207 kernel: [18800.580286] ? lockup_detector_update_enable+0x60/0x60 Aug 22 10:37:06 juju-e4d256-prod-github-runner-207 kernel: [18800.581347] ? __hrtimer_run_queues+0x107/0x230 Aug 22 10:37:06 juju-e4d256-prod-github-runner-207 kernel: [18800.582384] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 10:37:06 juju-e4d256-prod-github-runner-207 kernel: [18800.583442] ? hrtimer_interrupt+0x101/0x220 Aug 22 10:37:06 juju-e4d256-prod-github-runner-207 kernel: [18800.584491] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 10:37:06 juju-e4d256-prod-github-runner-207 kernel: [18800.585570] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 10:37:06 juju-e4d256-prod-github-runner-207 kernel: [18800.586626] Aug 22 10:37:06 juju-e4d256-prod-github-runner-207 kernel: [18800.587515] Aug 22 10:37:06 juju-e4d256-prod-github-runner-207 kernel: [18800.588358] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 10:37:06 juju-e4d256-prod-github-runner-207 kernel: [18800.589395] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:37:06 juju-e4d256-prod-github-runner-207 kernel: [18800.590435] ? _raw_spin_lock+0x22/0x30 Aug 22 10:37:06 juju-e4d256-prod-github-runner-207 kernel: [18800.591397] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:37:06 juju-e4d256-prod-github-runner-207 kernel: [18800.592416] direct_page_fault+0x206/0x310 [kvm] Aug 22 10:37:06 juju-e4d256-prod-github-runner-207 kernel: [18800.593493] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 10:37:06 juju-e4d256-prod-github-runner-207 kernel: [18800.594519] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 10:37:06 juju-e4d256-prod-github-runner-207 kernel: [18800.595533] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 10:37:06 juju-e4d256-prod-github-runner-207 kernel: [18800.596527] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 10:37:06 juju-e4d256-prod-github-runner-207 kernel: [18800.597514] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 10:37:06 juju-e4d256-prod-github-runner-207 kernel: [18800.598497] handle_exit+0x98/0x230 [kvm_amd] Aug 22 10:37:06 juju-e4d256-prod-github-runner-207 kernel: [18800.599434] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 10:37:06 juju-e4d256-prod-github-runner-207 kernel: [18800.600357] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 10:37:06 juju-e4d256-prod-github-runner-207 kernel: [18800.601279] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 10:37:06 juju-e4d256-prod-github-runner-207 kernel: [18800.602186] vcpu_run+0x62/0x2c0 [kvm] Aug 22 10:37:06 juju-e4d256-prod-github-runner-207 kernel: [18800.603007] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 10:37:06 juju-e4d256-prod-github-runner-207 kernel: [18800.603814] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 10:37:06 juju-e4d256-prod-github-runner-207 kernel: [18800.604666] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 10:37:06 juju-e4d256-prod-github-runner-207 kernel: [18800.605468] ? __seccomp_filter+0x4a/0x4a0 Aug 22 10:37:06 juju-e4d256-prod-github-runner-207 kernel: [18800.606209] ? __fget_files+0x86/0xc0 Aug 22 10:37:06 juju-e4d256-prod-github-runner-207 kernel: [18800.606950] __x64_sys_ioctl+0x95/0xd0 Aug 22 10:37:06 juju-e4d256-prod-github-runner-207 kernel: [18800.607684] do_syscall_64+0x5c/0xc0 Aug 22 10:37:06 juju-e4d256-prod-github-runner-207 kernel: [18800.608350] ? do_futex+0x162/0x1f0 Aug 22 10:37:06 juju-e4d256-prod-github-runner-207 kernel: [18800.608999] ? __x64_sys_futex+0x78/0x1e0 Aug 22 10:37:06 juju-e4d256-prod-github-runner-207 kernel: [18800.609672] ? __secure_computing+0xa9/0x120 Aug 22 10:37:06 juju-e4d256-prod-github-runner-207 kernel: [18800.610366] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 10:37:06 juju-e4d256-prod-github-runner-207 kernel: [18800.611142] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:37:06 juju-e4d256-prod-github-runner-207 kernel: [18800.611883] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:37:06 juju-e4d256-prod-github-runner-207 kernel: [18800.612642] ? do_syscall_64+0x69/0xc0 Aug 22 10:37:06 juju-e4d256-prod-github-runner-207 kernel: [18800.613304] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:37:06 juju-e4d256-prod-github-runner-207 kernel: [18800.614011] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:37:06 juju-e4d256-prod-github-runner-207 kernel: [18800.614707] ? do_syscall_64+0x69/0xc0 Aug 22 10:37:06 juju-e4d256-prod-github-runner-207 kernel: [18800.615342] ? do_syscall_64+0x69/0xc0 Aug 22 10:37:06 juju-e4d256-prod-github-runner-207 kernel: [18800.615971] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 10:37:06 juju-e4d256-prod-github-runner-207 kernel: [18800.616686] RIP: 0033:0x7faa5d0edaff Aug 22 10:37:06 juju-e4d256-prod-github-runner-207 kernel: [18800.617320] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 10:37:06 juju-e4d256-prod-github-runner-207 kernel: [18800.619313] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 10:37:06 juju-e4d256-prod-github-runner-207 kernel: [18800.620225] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 10:37:06 juju-e4d256-prod-github-runner-207 kernel: [18800.621146] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 10:37:06 juju-e4d256-prod-github-runner-207 kernel: [18800.622034] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 10:37:06 juju-e4d256-prod-github-runner-207 kernel: [18800.622952] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 10:37:06 juju-e4d256-prod-github-runner-207 kernel: [18800.623844] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 10:37:06 juju-e4d256-prod-github-runner-207 kernel: [18800.624733] Aug 22 10:37:34 juju-e4d256-prod-github-runner-207 kernel: [18828.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 17427s! [qemu-system-x86:6715] Aug 22 10:37:34 juju-e4d256-prod-github-runner-207 kernel: [18828.543657] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 10:37:34 juju-e4d256-prod-github-runner-207 kernel: [18828.543851] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 10:37:34 juju-e4d256-prod-github-runner-207 kernel: [18828.555960] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 10:37:34 juju-e4d256-prod-github-runner-207 kernel: [18828.557233] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 10:37:34 juju-e4d256-prod-github-runner-207 kernel: [18828.558463] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:37:34 juju-e4d256-prod-github-runner-207 kernel: [18828.559545] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 10:37:34 juju-e4d256-prod-github-runner-207 kernel: [18828.562099] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 10:37:34 juju-e4d256-prod-github-runner-207 kernel: [18828.563164] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 10:37:34 juju-e4d256-prod-github-runner-207 kernel: [18828.564332] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 10:37:34 juju-e4d256-prod-github-runner-207 kernel: [18828.565494] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 10:37:34 juju-e4d256-prod-github-runner-207 kernel: [18828.566673] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 10:37:34 juju-e4d256-prod-github-runner-207 kernel: [18828.567836] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 10:37:34 juju-e4d256-prod-github-runner-207 kernel: [18828.569047] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 10:37:34 juju-e4d256-prod-github-runner-207 kernel: [18828.570287] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 10:37:34 juju-e4d256-prod-github-runner-207 kernel: [18828.571396] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 10:37:34 juju-e4d256-prod-github-runner-207 kernel: [18828.572588] Call Trace: Aug 22 10:37:34 juju-e4d256-prod-github-runner-207 kernel: [18828.573505] Aug 22 10:37:34 juju-e4d256-prod-github-runner-207 kernel: [18828.574397] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:37:34 juju-e4d256-prod-github-runner-207 kernel: [18828.575442] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:37:34 juju-e4d256-prod-github-runner-207 kernel: [18828.576461] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:37:34 juju-e4d256-prod-github-runner-207 kernel: [18828.577540] ? show_regs.part.0+0x23/0x29 Aug 22 10:37:34 juju-e4d256-prod-github-runner-207 kernel: [18828.578548] ? show_regs.cold+0x8/0xd Aug 22 10:37:34 juju-e4d256-prod-github-runner-207 kernel: [18828.579519] ? watchdog_timer_fn+0x1be/0x220 Aug 22 10:37:34 juju-e4d256-prod-github-runner-207 kernel: [18828.580528] ? lockup_detector_update_enable+0x60/0x60 Aug 22 10:37:34 juju-e4d256-prod-github-runner-207 kernel: [18828.581596] ? __hrtimer_run_queues+0x107/0x230 Aug 22 10:37:34 juju-e4d256-prod-github-runner-207 kernel: [18828.582632] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 10:37:34 juju-e4d256-prod-github-runner-207 kernel: [18828.583656] ? hrtimer_interrupt+0x101/0x220 Aug 22 10:37:34 juju-e4d256-prod-github-runner-207 kernel: [18828.584671] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 10:37:34 juju-e4d256-prod-github-runner-207 kernel: [18828.585739] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 10:37:34 juju-e4d256-prod-github-runner-207 kernel: [18828.586793] Aug 22 10:37:34 juju-e4d256-prod-github-runner-207 kernel: [18828.587649] Aug 22 10:37:34 juju-e4d256-prod-github-runner-207 kernel: [18828.588489] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 10:37:34 juju-e4d256-prod-github-runner-207 kernel: [18828.589529] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:37:34 juju-e4d256-prod-github-runner-207 kernel: [18828.590585] ? _raw_spin_lock+0x22/0x30 Aug 22 10:37:34 juju-e4d256-prod-github-runner-207 kernel: [18828.591532] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:37:34 juju-e4d256-prod-github-runner-207 kernel: [18828.592546] direct_page_fault+0x206/0x310 [kvm] Aug 22 10:37:34 juju-e4d256-prod-github-runner-207 kernel: [18828.593575] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 10:37:34 juju-e4d256-prod-github-runner-207 kernel: [18828.594606] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 10:37:34 juju-e4d256-prod-github-runner-207 kernel: [18828.595608] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 10:37:34 juju-e4d256-prod-github-runner-207 kernel: [18828.596584] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 10:37:34 juju-e4d256-prod-github-runner-207 kernel: [18828.597535] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 10:37:34 juju-e4d256-prod-github-runner-207 kernel: [18828.598524] handle_exit+0x98/0x230 [kvm_amd] Aug 22 10:37:34 juju-e4d256-prod-github-runner-207 kernel: [18828.599421] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 10:37:34 juju-e4d256-prod-github-runner-207 kernel: [18828.600342] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 10:37:34 juju-e4d256-prod-github-runner-207 kernel: [18828.601273] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 10:37:34 juju-e4d256-prod-github-runner-207 kernel: [18828.602175] vcpu_run+0x62/0x2c0 [kvm] Aug 22 10:37:34 juju-e4d256-prod-github-runner-207 kernel: [18828.602997] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 10:37:34 juju-e4d256-prod-github-runner-207 kernel: [18828.603809] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 10:37:34 juju-e4d256-prod-github-runner-207 kernel: [18828.604664] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 10:37:34 juju-e4d256-prod-github-runner-207 kernel: [18828.605460] ? __seccomp_filter+0x4a/0x4a0 Aug 22 10:37:34 juju-e4d256-prod-github-runner-207 kernel: [18828.606201] ? __fget_files+0x86/0xc0 Aug 22 10:37:34 juju-e4d256-prod-github-runner-207 kernel: [18828.606915] __x64_sys_ioctl+0x95/0xd0 Aug 22 10:37:34 juju-e4d256-prod-github-runner-207 kernel: [18828.607608] do_syscall_64+0x5c/0xc0 Aug 22 10:37:34 juju-e4d256-prod-github-runner-207 kernel: [18828.608271] ? do_futex+0x162/0x1f0 Aug 22 10:37:34 juju-e4d256-prod-github-runner-207 kernel: [18828.608918] ? __x64_sys_futex+0x78/0x1e0 Aug 22 10:37:34 juju-e4d256-prod-github-runner-207 kernel: [18828.609593] ? __secure_computing+0xa9/0x120 Aug 22 10:37:34 juju-e4d256-prod-github-runner-207 kernel: [18828.610287] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 10:37:34 juju-e4d256-prod-github-runner-207 kernel: [18828.611057] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:37:34 juju-e4d256-prod-github-runner-207 kernel: [18828.611779] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:37:34 juju-e4d256-prod-github-runner-207 kernel: [18828.612494] ? do_syscall_64+0x69/0xc0 Aug 22 10:37:34 juju-e4d256-prod-github-runner-207 kernel: [18828.613145] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:37:34 juju-e4d256-prod-github-runner-207 kernel: [18828.613846] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:37:34 juju-e4d256-prod-github-runner-207 kernel: [18828.614551] ? do_syscall_64+0x69/0xc0 Aug 22 10:37:34 juju-e4d256-prod-github-runner-207 kernel: [18828.615176] ? do_syscall_64+0x69/0xc0 Aug 22 10:37:34 juju-e4d256-prod-github-runner-207 kernel: [18828.615798] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 10:37:34 juju-e4d256-prod-github-runner-207 kernel: [18828.616502] RIP: 0033:0x7faa5d0edaff Aug 22 10:37:34 juju-e4d256-prod-github-runner-207 kernel: [18828.617134] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 10:37:34 juju-e4d256-prod-github-runner-207 kernel: [18828.619126] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 10:37:34 juju-e4d256-prod-github-runner-207 kernel: [18828.620043] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 10:37:34 juju-e4d256-prod-github-runner-207 kernel: [18828.620933] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 10:37:34 juju-e4d256-prod-github-runner-207 kernel: [18828.621820] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 10:37:34 juju-e4d256-prod-github-runner-207 kernel: [18828.622717] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 10:37:34 juju-e4d256-prod-github-runner-207 kernel: [18828.623605] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 10:37:34 juju-e4d256-prod-github-runner-207 kernel: [18828.624495] Aug 22 10:38:02 juju-e4d256-prod-github-runner-207 kernel: [18856.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 17453s! [qemu-system-x86:6715] Aug 22 10:38:02 juju-e4d256-prod-github-runner-207 kernel: [18856.543101] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 10:38:02 juju-e4d256-prod-github-runner-207 kernel: [18856.543169] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 10:38:02 juju-e4d256-prod-github-runner-207 kernel: [18856.555238] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 10:38:02 juju-e4d256-prod-github-runner-207 kernel: [18856.556511] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 10:38:02 juju-e4d256-prod-github-runner-207 kernel: [18856.557741] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:38:02 juju-e4d256-prod-github-runner-207 kernel: [18856.558825] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 10:38:02 juju-e4d256-prod-github-runner-207 kernel: [18856.561390] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 10:38:02 juju-e4d256-prod-github-runner-207 kernel: [18856.562451] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 10:38:02 juju-e4d256-prod-github-runner-207 kernel: [18856.563608] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 10:38:02 juju-e4d256-prod-github-runner-207 kernel: [18856.564769] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 10:38:02 juju-e4d256-prod-github-runner-207 kernel: [18856.565930] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 10:38:02 juju-e4d256-prod-github-runner-207 kernel: [18856.567114] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 10:38:02 juju-e4d256-prod-github-runner-207 kernel: [18856.568277] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 10:38:02 juju-e4d256-prod-github-runner-207 kernel: [18856.569506] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 10:38:02 juju-e4d256-prod-github-runner-207 kernel: [18856.570624] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 10:38:02 juju-e4d256-prod-github-runner-207 kernel: [18856.571819] Call Trace: Aug 22 10:38:02 juju-e4d256-prod-github-runner-207 kernel: [18856.572735] Aug 22 10:38:02 juju-e4d256-prod-github-runner-207 kernel: [18856.573634] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:38:02 juju-e4d256-prod-github-runner-207 kernel: [18856.574685] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:38:02 juju-e4d256-prod-github-runner-207 kernel: [18856.575715] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:38:02 juju-e4d256-prod-github-runner-207 kernel: [18856.576795] ? show_regs.part.0+0x23/0x29 Aug 22 10:38:02 juju-e4d256-prod-github-runner-207 kernel: [18856.577790] ? show_regs.cold+0x8/0xd Aug 22 10:38:02 juju-e4d256-prod-github-runner-207 kernel: [18856.578774] ? watchdog_timer_fn+0x1be/0x220 Aug 22 10:38:02 juju-e4d256-prod-github-runner-207 kernel: [18856.579779] ? lockup_detector_update_enable+0x60/0x60 Aug 22 10:38:02 juju-e4d256-prod-github-runner-207 kernel: [18856.580845] ? __hrtimer_run_queues+0x107/0x230 Aug 22 10:38:02 juju-e4d256-prod-github-runner-207 kernel: [18856.581875] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 10:38:02 juju-e4d256-prod-github-runner-207 kernel: [18856.582907] ? hrtimer_interrupt+0x101/0x220 Aug 22 10:38:02 juju-e4d256-prod-github-runner-207 kernel: [18856.583923] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 10:38:02 juju-e4d256-prod-github-runner-207 kernel: [18856.585130] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 10:38:02 juju-e4d256-prod-github-runner-207 kernel: [18856.586199] Aug 22 10:38:02 juju-e4d256-prod-github-runner-207 kernel: [18856.587049] Aug 22 10:38:02 juju-e4d256-prod-github-runner-207 kernel: [18856.587884] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 10:38:02 juju-e4d256-prod-github-runner-207 kernel: [18856.588928] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:38:02 juju-e4d256-prod-github-runner-207 kernel: [18856.589978] ? _raw_spin_lock+0x22/0x30 Aug 22 10:38:02 juju-e4d256-prod-github-runner-207 kernel: [18856.590958] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:38:02 juju-e4d256-prod-github-runner-207 kernel: [18856.591980] direct_page_fault+0x206/0x310 [kvm] Aug 22 10:38:02 juju-e4d256-prod-github-runner-207 kernel: [18856.593005] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 10:38:02 juju-e4d256-prod-github-runner-207 kernel: [18856.594011] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 10:38:02 juju-e4d256-prod-github-runner-207 kernel: [18856.595031] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 10:38:02 juju-e4d256-prod-github-runner-207 kernel: [18856.596005] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 10:38:02 juju-e4d256-prod-github-runner-207 kernel: [18856.596950] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 10:38:02 juju-e4d256-prod-github-runner-207 kernel: [18856.597928] handle_exit+0x98/0x230 [kvm_amd] Aug 22 10:38:02 juju-e4d256-prod-github-runner-207 kernel: [18856.598829] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 10:38:02 juju-e4d256-prod-github-runner-207 kernel: [18856.599744] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 10:38:02 juju-e4d256-prod-github-runner-207 kernel: [18856.600664] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 10:38:02 juju-e4d256-prod-github-runner-207 kernel: [18856.601565] vcpu_run+0x62/0x2c0 [kvm] Aug 22 10:38:02 juju-e4d256-prod-github-runner-207 kernel: [18856.602415] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 10:38:02 juju-e4d256-prod-github-runner-207 kernel: [18856.603235] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 10:38:02 juju-e4d256-prod-github-runner-207 kernel: [18856.604091] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 10:38:02 juju-e4d256-prod-github-runner-207 kernel: [18856.604884] ? __seccomp_filter+0x4a/0x4a0 Aug 22 10:38:02 juju-e4d256-prod-github-runner-207 kernel: [18856.605629] ? __fget_files+0x86/0xc0 Aug 22 10:38:02 juju-e4d256-prod-github-runner-207 kernel: [18856.606343] __x64_sys_ioctl+0x95/0xd0 Aug 22 10:38:02 juju-e4d256-prod-github-runner-207 kernel: [18856.607043] do_syscall_64+0x5c/0xc0 Aug 22 10:38:02 juju-e4d256-prod-github-runner-207 kernel: [18856.607708] ? do_futex+0x162/0x1f0 Aug 22 10:38:02 juju-e4d256-prod-github-runner-207 kernel: [18856.608369] ? __x64_sys_futex+0x78/0x1e0 Aug 22 10:38:02 juju-e4d256-prod-github-runner-207 kernel: [18856.609039] ? __secure_computing+0xa9/0x120 Aug 22 10:38:02 juju-e4d256-prod-github-runner-207 kernel: [18856.609726] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 10:38:02 juju-e4d256-prod-github-runner-207 kernel: [18856.610495] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:38:02 juju-e4d256-prod-github-runner-207 kernel: [18856.611220] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:38:02 juju-e4d256-prod-github-runner-207 kernel: [18856.611942] ? do_syscall_64+0x69/0xc0 Aug 22 10:38:02 juju-e4d256-prod-github-runner-207 kernel: [18856.612583] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:38:02 juju-e4d256-prod-github-runner-207 kernel: [18856.613289] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:38:02 juju-e4d256-prod-github-runner-207 kernel: [18856.613982] ? do_syscall_64+0x69/0xc0 Aug 22 10:38:02 juju-e4d256-prod-github-runner-207 kernel: [18856.614614] ? do_syscall_64+0x69/0xc0 Aug 22 10:38:02 juju-e4d256-prod-github-runner-207 kernel: [18856.615234] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 10:38:02 juju-e4d256-prod-github-runner-207 kernel: [18856.615934] RIP: 0033:0x7faa5d0edaff Aug 22 10:38:02 juju-e4d256-prod-github-runner-207 kernel: [18856.616557] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 10:38:02 juju-e4d256-prod-github-runner-207 kernel: [18856.618550] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 10:38:02 juju-e4d256-prod-github-runner-207 kernel: [18856.619459] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 10:38:02 juju-e4d256-prod-github-runner-207 kernel: [18856.620358] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 10:38:02 juju-e4d256-prod-github-runner-207 kernel: [18856.621249] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 10:38:02 juju-e4d256-prod-github-runner-207 kernel: [18856.622130] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 10:38:02 juju-e4d256-prod-github-runner-207 kernel: [18856.623028] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 10:38:02 juju-e4d256-prod-github-runner-207 kernel: [18856.623918] Aug 22 10:38:30 juju-e4d256-prod-github-runner-207 kernel: [18884.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 17479s! [qemu-system-x86:6715] Aug 22 10:38:30 juju-e4d256-prod-github-runner-207 kernel: [18884.543073] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 10:38:30 juju-e4d256-prod-github-runner-207 kernel: [18884.543139] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 10:38:30 juju-e4d256-prod-github-runner-207 kernel: [18884.555250] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 10:38:30 juju-e4d256-prod-github-runner-207 kernel: [18884.556516] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 10:38:30 juju-e4d256-prod-github-runner-207 kernel: [18884.557737] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:38:30 juju-e4d256-prod-github-runner-207 kernel: [18884.558806] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 10:38:30 juju-e4d256-prod-github-runner-207 kernel: [18884.561350] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 10:38:30 juju-e4d256-prod-github-runner-207 kernel: [18884.562400] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 10:38:30 juju-e4d256-prod-github-runner-207 kernel: [18884.563564] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 10:38:30 juju-e4d256-prod-github-runner-207 kernel: [18884.564721] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 10:38:30 juju-e4d256-prod-github-runner-207 kernel: [18884.565884] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 10:38:30 juju-e4d256-prod-github-runner-207 kernel: [18884.567043] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 10:38:30 juju-e4d256-prod-github-runner-207 kernel: [18884.568204] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 10:38:30 juju-e4d256-prod-github-runner-207 kernel: [18884.569438] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 10:38:30 juju-e4d256-prod-github-runner-207 kernel: [18884.570539] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 10:38:30 juju-e4d256-prod-github-runner-207 kernel: [18884.571728] Call Trace: Aug 22 10:38:30 juju-e4d256-prod-github-runner-207 kernel: [18884.572642] Aug 22 10:38:30 juju-e4d256-prod-github-runner-207 kernel: [18884.573523] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:38:30 juju-e4d256-prod-github-runner-207 kernel: [18884.574561] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:38:30 juju-e4d256-prod-github-runner-207 kernel: [18884.575585] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:38:30 juju-e4d256-prod-github-runner-207 kernel: [18884.576660] ? show_regs.part.0+0x23/0x29 Aug 22 10:38:30 juju-e4d256-prod-github-runner-207 kernel: [18884.577660] ? show_regs.cold+0x8/0xd Aug 22 10:38:30 juju-e4d256-prod-github-runner-207 kernel: [18884.578644] ? watchdog_timer_fn+0x1be/0x220 Aug 22 10:38:30 juju-e4d256-prod-github-runner-207 kernel: [18884.579648] ? lockup_detector_update_enable+0x60/0x60 Aug 22 10:38:30 juju-e4d256-prod-github-runner-207 kernel: [18884.580712] ? __hrtimer_run_queues+0x107/0x230 Aug 22 10:38:30 juju-e4d256-prod-github-runner-207 kernel: [18884.581735] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 10:38:30 juju-e4d256-prod-github-runner-207 kernel: [18884.582761] ? hrtimer_interrupt+0x101/0x220 Aug 22 10:38:30 juju-e4d256-prod-github-runner-207 kernel: [18884.583772] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 10:38:30 juju-e4d256-prod-github-runner-207 kernel: [18884.584837] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 10:38:30 juju-e4d256-prod-github-runner-207 kernel: [18884.585899] Aug 22 10:38:30 juju-e4d256-prod-github-runner-207 kernel: [18884.586755] Aug 22 10:38:30 juju-e4d256-prod-github-runner-207 kernel: [18884.587590] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 10:38:30 juju-e4d256-prod-github-runner-207 kernel: [18884.588624] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:38:30 juju-e4d256-prod-github-runner-207 kernel: [18884.589665] ? _raw_spin_lock+0x22/0x30 Aug 22 10:38:30 juju-e4d256-prod-github-runner-207 kernel: [18884.590639] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:38:30 juju-e4d256-prod-github-runner-207 kernel: [18884.591657] direct_page_fault+0x206/0x310 [kvm] Aug 22 10:38:30 juju-e4d256-prod-github-runner-207 kernel: [18884.592679] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 10:38:30 juju-e4d256-prod-github-runner-207 kernel: [18884.593684] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 10:38:30 juju-e4d256-prod-github-runner-207 kernel: [18884.594695] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 10:38:30 juju-e4d256-prod-github-runner-207 kernel: [18884.595664] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 10:38:30 juju-e4d256-prod-github-runner-207 kernel: [18884.596608] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 10:38:30 juju-e4d256-prod-github-runner-207 kernel: [18884.597584] handle_exit+0x98/0x230 [kvm_amd] Aug 22 10:38:30 juju-e4d256-prod-github-runner-207 kernel: [18884.598485] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 10:38:30 juju-e4d256-prod-github-runner-207 kernel: [18884.599396] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 10:38:30 juju-e4d256-prod-github-runner-207 kernel: [18884.600316] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 10:38:30 juju-e4d256-prod-github-runner-207 kernel: [18884.601222] vcpu_run+0x62/0x2c0 [kvm] Aug 22 10:38:30 juju-e4d256-prod-github-runner-207 kernel: [18884.602041] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 10:38:30 juju-e4d256-prod-github-runner-207 kernel: [18884.602854] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 10:38:30 juju-e4d256-prod-github-runner-207 kernel: [18884.603710] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 10:38:30 juju-e4d256-prod-github-runner-207 kernel: [18884.604512] ? __seccomp_filter+0x4a/0x4a0 Aug 22 10:38:30 juju-e4d256-prod-github-runner-207 kernel: [18884.605258] ? __fget_files+0x86/0xc0 Aug 22 10:38:30 juju-e4d256-prod-github-runner-207 kernel: [18884.605971] __x64_sys_ioctl+0x95/0xd0 Aug 22 10:38:30 juju-e4d256-prod-github-runner-207 kernel: [18884.606667] do_syscall_64+0x5c/0xc0 Aug 22 10:38:30 juju-e4d256-prod-github-runner-207 kernel: [18884.607334] ? do_futex+0x162/0x1f0 Aug 22 10:38:30 juju-e4d256-prod-github-runner-207 kernel: [18884.607980] ? __x64_sys_futex+0x78/0x1e0 Aug 22 10:38:30 juju-e4d256-prod-github-runner-207 kernel: [18884.608655] ? __secure_computing+0xa9/0x120 Aug 22 10:38:30 juju-e4d256-prod-github-runner-207 kernel: [18884.609341] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 10:38:30 juju-e4d256-prod-github-runner-207 kernel: [18884.610108] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:38:30 juju-e4d256-prod-github-runner-207 kernel: [18884.610834] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:38:30 juju-e4d256-prod-github-runner-207 kernel: [18884.611554] ? do_syscall_64+0x69/0xc0 Aug 22 10:38:30 juju-e4d256-prod-github-runner-207 kernel: [18884.612196] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:38:30 juju-e4d256-prod-github-runner-207 kernel: [18884.612898] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:38:30 juju-e4d256-prod-github-runner-207 kernel: [18884.613596] ? do_syscall_64+0x69/0xc0 Aug 22 10:38:30 juju-e4d256-prod-github-runner-207 kernel: [18884.614225] ? do_syscall_64+0x69/0xc0 Aug 22 10:38:30 juju-e4d256-prod-github-runner-207 kernel: [18884.614848] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 10:38:30 juju-e4d256-prod-github-runner-207 kernel: [18884.615555] RIP: 0033:0x7faa5d0edaff Aug 22 10:38:30 juju-e4d256-prod-github-runner-207 kernel: [18884.616181] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 10:38:30 juju-e4d256-prod-github-runner-207 kernel: [18884.618174] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 10:38:30 juju-e4d256-prod-github-runner-207 kernel: [18884.619088] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 10:38:30 juju-e4d256-prod-github-runner-207 kernel: [18884.619981] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 10:38:30 juju-e4d256-prod-github-runner-207 kernel: [18884.620890] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 10:38:30 juju-e4d256-prod-github-runner-207 kernel: [18884.621783] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 10:38:30 juju-e4d256-prod-github-runner-207 kernel: [18884.622679] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 10:38:30 juju-e4d256-prod-github-runner-207 kernel: [18884.623573] Aug 22 10:38:44 juju-e4d256-prod-github-runner-207 kernel: [18898.448708] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 10:38:44 juju-e4d256-prod-github-runner-207 kernel: [18898.450343] rcu: 1-....: (4680684 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=2266250 Aug 22 10:38:44 juju-e4d256-prod-github-runner-207 kernel: [18898.451471] (t=4695312 jiffies g=23269 q=25203) Aug 22 10:38:44 juju-e4d256-prod-github-runner-207 kernel: [18898.452254] NMI backtrace for cpu 1 Aug 22 10:38:44 juju-e4d256-prod-github-runner-207 kernel: [18898.452968] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 10:38:44 juju-e4d256-prod-github-runner-207 kernel: [18898.454087] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 10:38:44 juju-e4d256-prod-github-runner-207 kernel: [18898.455151] Call Trace: Aug 22 10:38:44 juju-e4d256-prod-github-runner-207 kernel: [18898.455825] Aug 22 10:38:44 juju-e4d256-prod-github-runner-207 kernel: [18898.456484] show_stack+0x52/0x5c Aug 22 10:38:44 juju-e4d256-prod-github-runner-207 kernel: [18898.457209] dump_stack_lvl+0x4a/0x63 Aug 22 10:38:44 juju-e4d256-prod-github-runner-207 kernel: [18898.457969] dump_stack+0x10/0x16 Aug 22 10:38:44 juju-e4d256-prod-github-runner-207 kernel: [18898.458688] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 10:38:44 juju-e4d256-prod-github-runner-207 kernel: [18898.459468] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 10:38:44 juju-e4d256-prod-github-runner-207 kernel: [18898.460248] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 10:38:44 juju-e4d256-prod-github-runner-207 kernel: [18898.461065] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 10:38:44 juju-e4d256-prod-github-runner-207 kernel: [18898.461895] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 10:38:44 juju-e4d256-prod-github-runner-207 kernel: [18898.462702] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 10:38:44 juju-e4d256-prod-github-runner-207 kernel: [18898.463506] print_cpu_stall.cold+0x2f/0xe2 Aug 22 10:38:44 juju-e4d256-prod-github-runner-207 kernel: [18898.464288] ? timekeeping_update+0xf7/0x150 Aug 22 10:38:44 juju-e4d256-prod-github-runner-207 kernel: [18898.465060] check_cpu_stall+0x109/0x270 Aug 22 10:38:44 juju-e4d256-prod-github-runner-207 kernel: [18898.465821] rcu_sched_clock_irq+0x9a/0x250 Aug 22 10:38:44 juju-e4d256-prod-github-runner-207 kernel: [18898.466585] update_process_times+0x94/0xd0 Aug 22 10:38:44 juju-e4d256-prod-github-runner-207 kernel: [18898.467344] tick_sched_handle+0x29/0x70 Aug 22 10:38:44 juju-e4d256-prod-github-runner-207 kernel: [18898.468089] tick_sched_timer+0x8c/0xc0 Aug 22 10:38:44 juju-e4d256-prod-github-runner-207 kernel: [18898.468828] ? tick_nohz_handler+0xb0/0xb0 Aug 22 10:38:44 juju-e4d256-prod-github-runner-207 kernel: [18898.469582] __hrtimer_run_queues+0x107/0x230 Aug 22 10:38:44 juju-e4d256-prod-github-runner-207 kernel: [18898.470376] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 10:38:44 juju-e4d256-prod-github-runner-207 kernel: [18898.471150] hrtimer_interrupt+0x101/0x220 Aug 22 10:38:44 juju-e4d256-prod-github-runner-207 kernel: [18898.471908] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 10:38:44 juju-e4d256-prod-github-runner-207 kernel: [18898.472863] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 10:38:44 juju-e4d256-prod-github-runner-207 kernel: [18898.473663] Aug 22 10:38:44 juju-e4d256-prod-github-runner-207 kernel: [18898.474312] Aug 22 10:38:44 juju-e4d256-prod-github-runner-207 kernel: [18898.474940] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 10:38:44 juju-e4d256-prod-github-runner-207 kernel: [18898.475898] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:38:44 juju-e4d256-prod-github-runner-207 kernel: [18898.476778] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 10:38:44 juju-e4d256-prod-github-runner-207 kernel: [18898.478986] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 10:38:44 juju-e4d256-prod-github-runner-207 kernel: [18898.479856] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 10:38:44 juju-e4d256-prod-github-runner-207 kernel: [18898.480846] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 10:38:44 juju-e4d256-prod-github-runner-207 kernel: [18898.481839] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 10:38:44 juju-e4d256-prod-github-runner-207 kernel: [18898.482879] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 10:38:44 juju-e4d256-prod-github-runner-207 kernel: [18898.483836] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 10:38:44 juju-e4d256-prod-github-runner-207 kernel: [18898.484788] ? _raw_spin_lock+0x22/0x30 Aug 22 10:38:44 juju-e4d256-prod-github-runner-207 kernel: [18898.485576] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:38:44 juju-e4d256-prod-github-runner-207 kernel: [18898.486458] direct_page_fault+0x206/0x310 [kvm] Aug 22 10:38:44 juju-e4d256-prod-github-runner-207 kernel: [18898.487295] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 10:38:44 juju-e4d256-prod-github-runner-207 kernel: [18898.488118] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 10:38:44 juju-e4d256-prod-github-runner-207 kernel: [18898.488972] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 10:38:44 juju-e4d256-prod-github-runner-207 kernel: [18898.489873] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 10:38:44 juju-e4d256-prod-github-runner-207 kernel: [18898.490667] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 10:38:44 juju-e4d256-prod-github-runner-207 kernel: [18898.491488] handle_exit+0x98/0x230 [kvm_amd] Aug 22 10:38:44 juju-e4d256-prod-github-runner-207 kernel: [18898.492240] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 10:38:44 juju-e4d256-prod-github-runner-207 kernel: [18898.493022] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 10:38:44 juju-e4d256-prod-github-runner-207 kernel: [18898.493890] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 10:38:44 juju-e4d256-prod-github-runner-207 kernel: [18898.494680] vcpu_run+0x62/0x2c0 [kvm] Aug 22 10:38:44 juju-e4d256-prod-github-runner-207 kernel: [18898.495397] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 10:38:44 juju-e4d256-prod-github-runner-207 kernel: [18898.496129] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 10:38:44 juju-e4d256-prod-github-runner-207 kernel: [18898.496933] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 10:38:44 juju-e4d256-prod-github-runner-207 kernel: [18898.497705] ? __seccomp_filter+0x4a/0x4a0 Aug 22 10:38:44 juju-e4d256-prod-github-runner-207 kernel: [18898.498428] ? __fget_files+0x86/0xc0 Aug 22 10:38:44 juju-e4d256-prod-github-runner-207 kernel: [18898.499125] __x64_sys_ioctl+0x95/0xd0 Aug 22 10:38:44 juju-e4d256-prod-github-runner-207 kernel: [18898.499819] do_syscall_64+0x5c/0xc0 Aug 22 10:38:44 juju-e4d256-prod-github-runner-207 kernel: [18898.500498] ? do_futex+0x162/0x1f0 Aug 22 10:38:44 juju-e4d256-prod-github-runner-207 kernel: [18898.501172] ? __x64_sys_futex+0x78/0x1e0 Aug 22 10:38:44 juju-e4d256-prod-github-runner-207 kernel: [18898.501903] ? __secure_computing+0xa9/0x120 Aug 22 10:38:44 juju-e4d256-prod-github-runner-207 kernel: [18898.502622] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 10:38:44 juju-e4d256-prod-github-runner-207 kernel: [18898.503411] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:38:44 juju-e4d256-prod-github-runner-207 kernel: [18898.504165] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:38:44 juju-e4d256-prod-github-runner-207 kernel: [18898.504924] ? do_syscall_64+0x69/0xc0 Aug 22 10:38:44 juju-e4d256-prod-github-runner-207 kernel: [18898.505614] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:38:44 juju-e4d256-prod-github-runner-207 kernel: [18898.506388] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:38:44 juju-e4d256-prod-github-runner-207 kernel: [18898.507145] ? do_syscall_64+0x69/0xc0 Aug 22 10:38:44 juju-e4d256-prod-github-runner-207 kernel: [18898.507840] ? do_syscall_64+0x69/0xc0 Aug 22 10:38:44 juju-e4d256-prod-github-runner-207 kernel: [18898.508527] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 10:38:44 juju-e4d256-prod-github-runner-207 kernel: [18898.509302] RIP: 0033:0x7faa5d0edaff Aug 22 10:38:44 juju-e4d256-prod-github-runner-207 kernel: [18898.510035] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 10:38:44 juju-e4d256-prod-github-runner-207 kernel: [18898.512144] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 10:38:44 juju-e4d256-prod-github-runner-207 kernel: [18898.513108] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 10:38:44 juju-e4d256-prod-github-runner-207 kernel: [18898.514117] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 10:38:44 juju-e4d256-prod-github-runner-207 kernel: [18898.515069] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 10:38:44 juju-e4d256-prod-github-runner-207 kernel: [18898.516012] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 10:38:44 juju-e4d256-prod-github-runner-207 kernel: [18898.516940] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 10:38:44 juju-e4d256-prod-github-runner-207 kernel: [18898.517882] Aug 22 10:39:10 juju-e4d256-prod-github-runner-207 kernel: [18924.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 17516s! [qemu-system-x86:6715] Aug 22 10:39:10 juju-e4d256-prod-github-runner-207 kernel: [18924.543111] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 10:39:10 juju-e4d256-prod-github-runner-207 kernel: [18924.543428] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 10:39:10 juju-e4d256-prod-github-runner-207 kernel: [18924.555542] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 10:39:10 juju-e4d256-prod-github-runner-207 kernel: [18924.556815] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 10:39:10 juju-e4d256-prod-github-runner-207 kernel: [18924.558046] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:39:10 juju-e4d256-prod-github-runner-207 kernel: [18924.559104] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 10:39:10 juju-e4d256-prod-github-runner-207 kernel: [18924.561666] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 10:39:10 juju-e4d256-prod-github-runner-207 kernel: [18924.562710] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 10:39:10 juju-e4d256-prod-github-runner-207 kernel: [18924.563871] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 10:39:10 juju-e4d256-prod-github-runner-207 kernel: [18924.565039] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 10:39:10 juju-e4d256-prod-github-runner-207 kernel: [18924.566205] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 10:39:10 juju-e4d256-prod-github-runner-207 kernel: [18924.567366] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 10:39:10 juju-e4d256-prod-github-runner-207 kernel: [18924.568532] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 10:39:10 juju-e4d256-prod-github-runner-207 kernel: [18924.569775] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 10:39:10 juju-e4d256-prod-github-runner-207 kernel: [18924.570885] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 10:39:10 juju-e4d256-prod-github-runner-207 kernel: [18924.572080] Call Trace: Aug 22 10:39:10 juju-e4d256-prod-github-runner-207 kernel: [18924.572997] Aug 22 10:39:10 juju-e4d256-prod-github-runner-207 kernel: [18924.573896] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:39:10 juju-e4d256-prod-github-runner-207 kernel: [18924.574927] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:39:10 juju-e4d256-prod-github-runner-207 kernel: [18924.575952] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:39:10 juju-e4d256-prod-github-runner-207 kernel: [18924.577026] ? show_regs.part.0+0x23/0x29 Aug 22 10:39:10 juju-e4d256-prod-github-runner-207 kernel: [18924.578033] ? show_regs.cold+0x8/0xd Aug 22 10:39:10 juju-e4d256-prod-github-runner-207 kernel: [18924.579010] ? watchdog_timer_fn+0x1be/0x220 Aug 22 10:39:10 juju-e4d256-prod-github-runner-207 kernel: [18924.580017] ? lockup_detector_update_enable+0x60/0x60 Aug 22 10:39:10 juju-e4d256-prod-github-runner-207 kernel: [18924.581081] ? __hrtimer_run_queues+0x107/0x230 Aug 22 10:39:10 juju-e4d256-prod-github-runner-207 kernel: [18924.582115] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 10:39:10 juju-e4d256-prod-github-runner-207 kernel: [18924.583140] ? hrtimer_interrupt+0x101/0x220 Aug 22 10:39:10 juju-e4d256-prod-github-runner-207 kernel: [18924.584160] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 10:39:10 juju-e4d256-prod-github-runner-207 kernel: [18924.585229] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 10:39:10 juju-e4d256-prod-github-runner-207 kernel: [18924.586291] Aug 22 10:39:10 juju-e4d256-prod-github-runner-207 kernel: [18924.587148] Aug 22 10:39:10 juju-e4d256-prod-github-runner-207 kernel: [18924.587984] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 10:39:10 juju-e4d256-prod-github-runner-207 kernel: [18924.589015] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:39:10 juju-e4d256-prod-github-runner-207 kernel: [18924.590071] ? _raw_spin_lock+0x22/0x30 Aug 22 10:39:10 juju-e4d256-prod-github-runner-207 kernel: [18924.591021] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:39:10 juju-e4d256-prod-github-runner-207 kernel: [18924.592041] direct_page_fault+0x206/0x310 [kvm] Aug 22 10:39:10 juju-e4d256-prod-github-runner-207 kernel: [18924.593064] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 10:39:10 juju-e4d256-prod-github-runner-207 kernel: [18924.594082] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 10:39:10 juju-e4d256-prod-github-runner-207 kernel: [18924.595082] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 10:39:10 juju-e4d256-prod-github-runner-207 kernel: [18924.596056] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 10:39:10 juju-e4d256-prod-github-runner-207 kernel: [18924.597002] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 10:39:10 juju-e4d256-prod-github-runner-207 kernel: [18924.597993] handle_exit+0x98/0x230 [kvm_amd] Aug 22 10:39:10 juju-e4d256-prod-github-runner-207 kernel: [18924.598885] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 10:39:10 juju-e4d256-prod-github-runner-207 kernel: [18924.599809] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 10:39:10 juju-e4d256-prod-github-runner-207 kernel: [18924.600741] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 10:39:10 juju-e4d256-prod-github-runner-207 kernel: [18924.601673] vcpu_run+0x62/0x2c0 [kvm] Aug 22 10:39:10 juju-e4d256-prod-github-runner-207 kernel: [18924.602484] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 10:39:10 juju-e4d256-prod-github-runner-207 kernel: [18924.603290] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 10:39:10 juju-e4d256-prod-github-runner-207 kernel: [18924.604141] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 10:39:10 juju-e4d256-prod-github-runner-207 kernel: [18924.604936] ? __seccomp_filter+0x4a/0x4a0 Aug 22 10:39:10 juju-e4d256-prod-github-runner-207 kernel: [18924.605699] ? __fget_files+0x86/0xc0 Aug 22 10:39:10 juju-e4d256-prod-github-runner-207 kernel: [18924.606404] __x64_sys_ioctl+0x95/0xd0 Aug 22 10:39:10 juju-e4d256-prod-github-runner-207 kernel: [18924.607100] do_syscall_64+0x5c/0xc0 Aug 22 10:39:10 juju-e4d256-prod-github-runner-207 kernel: [18924.607767] ? do_futex+0x162/0x1f0 Aug 22 10:39:10 juju-e4d256-prod-github-runner-207 kernel: [18924.608414] ? __x64_sys_futex+0x78/0x1e0 Aug 22 10:39:10 juju-e4d256-prod-github-runner-207 kernel: [18924.609085] ? __secure_computing+0xa9/0x120 Aug 22 10:39:10 juju-e4d256-prod-github-runner-207 kernel: [18924.609789] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 10:39:10 juju-e4d256-prod-github-runner-207 kernel: [18924.610548] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:39:10 juju-e4d256-prod-github-runner-207 kernel: [18924.611274] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:39:10 juju-e4d256-prod-github-runner-207 kernel: [18924.611994] ? do_syscall_64+0x69/0xc0 Aug 22 10:39:10 juju-e4d256-prod-github-runner-207 kernel: [18924.612642] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:39:10 juju-e4d256-prod-github-runner-207 kernel: [18924.613344] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:39:10 juju-e4d256-prod-github-runner-207 kernel: [18924.614045] ? do_syscall_64+0x69/0xc0 Aug 22 10:39:10 juju-e4d256-prod-github-runner-207 kernel: [18924.614667] ? do_syscall_64+0x69/0xc0 Aug 22 10:39:10 juju-e4d256-prod-github-runner-207 kernel: [18924.615287] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 10:39:10 juju-e4d256-prod-github-runner-207 kernel: [18924.615993] RIP: 0033:0x7faa5d0edaff Aug 22 10:39:10 juju-e4d256-prod-github-runner-207 kernel: [18924.616621] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 10:39:10 juju-e4d256-prod-github-runner-207 kernel: [18924.618633] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 10:39:10 juju-e4d256-prod-github-runner-207 kernel: [18924.619561] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 10:39:10 juju-e4d256-prod-github-runner-207 kernel: [18924.620518] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 10:39:10 juju-e4d256-prod-github-runner-207 kernel: [18924.621434] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 10:39:10 juju-e4d256-prod-github-runner-207 kernel: [18924.622327] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 10:39:10 juju-e4d256-prod-github-runner-207 kernel: [18924.623212] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 10:39:10 juju-e4d256-prod-github-runner-207 kernel: [18924.624105] Aug 22 10:39:38 juju-e4d256-prod-github-runner-207 kernel: [18952.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 17542s! [qemu-system-x86:6715] Aug 22 10:39:38 juju-e4d256-prod-github-runner-207 kernel: [18952.543178] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 10:39:38 juju-e4d256-prod-github-runner-207 kernel: [18952.543254] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 10:39:38 juju-e4d256-prod-github-runner-207 kernel: [18952.555348] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 10:39:38 juju-e4d256-prod-github-runner-207 kernel: [18952.556612] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 10:39:38 juju-e4d256-prod-github-runner-207 kernel: [18952.557844] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:39:38 juju-e4d256-prod-github-runner-207 kernel: [18952.558901] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 10:39:38 juju-e4d256-prod-github-runner-207 kernel: [18952.561490] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 10:39:38 juju-e4d256-prod-github-runner-207 kernel: [18952.562543] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 10:39:38 juju-e4d256-prod-github-runner-207 kernel: [18952.563701] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 10:39:38 juju-e4d256-prod-github-runner-207 kernel: [18952.564856] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 10:39:38 juju-e4d256-prod-github-runner-207 kernel: [18952.566026] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 10:39:38 juju-e4d256-prod-github-runner-207 kernel: [18952.567183] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 10:39:38 juju-e4d256-prod-github-runner-207 kernel: [18952.568347] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 10:39:38 juju-e4d256-prod-github-runner-207 kernel: [18952.569717] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 10:39:38 juju-e4d256-prod-github-runner-207 kernel: [18952.570817] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 10:39:38 juju-e4d256-prod-github-runner-207 kernel: [18952.572145] Call Trace: Aug 22 10:39:38 juju-e4d256-prod-github-runner-207 kernel: [18952.573071] Aug 22 10:39:38 juju-e4d256-prod-github-runner-207 kernel: [18952.574067] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:39:38 juju-e4d256-prod-github-runner-207 kernel: [18952.575106] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:39:38 juju-e4d256-prod-github-runner-207 kernel: [18952.576129] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:39:38 juju-e4d256-prod-github-runner-207 kernel: [18952.577225] ? show_regs.part.0+0x23/0x29 Aug 22 10:39:38 juju-e4d256-prod-github-runner-207 kernel: [18952.578227] ? show_regs.cold+0x8/0xd Aug 22 10:39:38 juju-e4d256-prod-github-runner-207 kernel: [18952.579195] ? watchdog_timer_fn+0x1be/0x220 Aug 22 10:39:38 juju-e4d256-prod-github-runner-207 kernel: [18952.580205] ? lockup_detector_update_enable+0x60/0x60 Aug 22 10:39:38 juju-e4d256-prod-github-runner-207 kernel: [18952.581276] ? __hrtimer_run_queues+0x107/0x230 Aug 22 10:39:38 juju-e4d256-prod-github-runner-207 kernel: [18952.582302] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 10:39:38 juju-e4d256-prod-github-runner-207 kernel: [18952.583323] ? hrtimer_interrupt+0x101/0x220 Aug 22 10:39:38 juju-e4d256-prod-github-runner-207 kernel: [18952.584344] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 10:39:38 juju-e4d256-prod-github-runner-207 kernel: [18952.585418] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 10:39:38 juju-e4d256-prod-github-runner-207 kernel: [18952.586463] Aug 22 10:39:38 juju-e4d256-prod-github-runner-207 kernel: [18952.587315] Aug 22 10:39:38 juju-e4d256-prod-github-runner-207 kernel: [18952.588151] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 10:39:38 juju-e4d256-prod-github-runner-207 kernel: [18952.589199] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:39:38 juju-e4d256-prod-github-runner-207 kernel: [18952.590235] ? _raw_spin_lock+0x22/0x30 Aug 22 10:39:38 juju-e4d256-prod-github-runner-207 kernel: [18952.591187] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:39:38 juju-e4d256-prod-github-runner-207 kernel: [18952.592208] direct_page_fault+0x206/0x310 [kvm] Aug 22 10:39:38 juju-e4d256-prod-github-runner-207 kernel: [18952.593251] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 10:39:38 juju-e4d256-prod-github-runner-207 kernel: [18952.594259] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 10:39:38 juju-e4d256-prod-github-runner-207 kernel: [18952.595262] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 10:39:38 juju-e4d256-prod-github-runner-207 kernel: [18952.596237] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 10:39:38 juju-e4d256-prod-github-runner-207 kernel: [18952.597197] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 10:39:38 juju-e4d256-prod-github-runner-207 kernel: [18952.598173] handle_exit+0x98/0x230 [kvm_amd] Aug 22 10:39:38 juju-e4d256-prod-github-runner-207 kernel: [18952.599063] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 10:39:38 juju-e4d256-prod-github-runner-207 kernel: [18952.599980] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 10:39:38 juju-e4d256-prod-github-runner-207 kernel: [18952.600900] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 10:39:38 juju-e4d256-prod-github-runner-207 kernel: [18952.601827] vcpu_run+0x62/0x2c0 [kvm] Aug 22 10:39:38 juju-e4d256-prod-github-runner-207 kernel: [18952.602634] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 10:39:38 juju-e4d256-prod-github-runner-207 kernel: [18952.603492] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 10:39:38 juju-e4d256-prod-github-runner-207 kernel: [18952.604417] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 10:39:38 juju-e4d256-prod-github-runner-207 kernel: [18952.605237] ? __seccomp_filter+0x4a/0x4a0 Aug 22 10:39:38 juju-e4d256-prod-github-runner-207 kernel: [18952.605979] ? __fget_files+0x86/0xc0 Aug 22 10:39:38 juju-e4d256-prod-github-runner-207 kernel: [18952.606679] __x64_sys_ioctl+0x95/0xd0 Aug 22 10:39:38 juju-e4d256-prod-github-runner-207 kernel: [18952.607371] do_syscall_64+0x5c/0xc0 Aug 22 10:39:38 juju-e4d256-prod-github-runner-207 kernel: [18952.608031] ? do_futex+0x162/0x1f0 Aug 22 10:39:38 juju-e4d256-prod-github-runner-207 kernel: [18952.608675] ? __x64_sys_futex+0x78/0x1e0 Aug 22 10:39:38 juju-e4d256-prod-github-runner-207 kernel: [18952.609366] ? __secure_computing+0xa9/0x120 Aug 22 10:39:38 juju-e4d256-prod-github-runner-207 kernel: [18952.610054] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 10:39:38 juju-e4d256-prod-github-runner-207 kernel: [18952.610810] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:39:38 juju-e4d256-prod-github-runner-207 kernel: [18952.611536] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:39:38 juju-e4d256-prod-github-runner-207 kernel: [18952.612256] ? do_syscall_64+0x69/0xc0 Aug 22 10:39:38 juju-e4d256-prod-github-runner-207 kernel: [18952.612897] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:39:38 juju-e4d256-prod-github-runner-207 kernel: [18952.613608] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:39:38 juju-e4d256-prod-github-runner-207 kernel: [18952.614301] ? do_syscall_64+0x69/0xc0 Aug 22 10:39:38 juju-e4d256-prod-github-runner-207 kernel: [18952.614924] ? do_syscall_64+0x69/0xc0 Aug 22 10:39:38 juju-e4d256-prod-github-runner-207 kernel: [18952.615544] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 10:39:38 juju-e4d256-prod-github-runner-207 kernel: [18952.616246] RIP: 0033:0x7faa5d0edaff Aug 22 10:39:38 juju-e4d256-prod-github-runner-207 kernel: [18952.616866] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 10:39:38 juju-e4d256-prod-github-runner-207 kernel: [18952.618871] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 10:39:38 juju-e4d256-prod-github-runner-207 kernel: [18952.619874] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 10:39:38 juju-e4d256-prod-github-runner-207 kernel: [18952.620767] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 10:39:38 juju-e4d256-prod-github-runner-207 kernel: [18952.621683] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 10:39:38 juju-e4d256-prod-github-runner-207 kernel: [18952.622566] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 10:39:38 juju-e4d256-prod-github-runner-207 kernel: [18952.623451] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 10:39:38 juju-e4d256-prod-github-runner-207 kernel: [18952.624339] Aug 22 10:40:06 juju-e4d256-prod-github-runner-207 kernel: [18980.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 17569s! [qemu-system-x86:6715] Aug 22 10:40:06 juju-e4d256-prod-github-runner-207 kernel: [18980.543208] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 10:40:06 juju-e4d256-prod-github-runner-207 kernel: [18980.543429] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 10:40:06 juju-e4d256-prod-github-runner-207 kernel: [18980.556198] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 10:40:06 juju-e4d256-prod-github-runner-207 kernel: [18980.557502] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 10:40:06 juju-e4d256-prod-github-runner-207 kernel: [18980.558754] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:40:06 juju-e4d256-prod-github-runner-207 kernel: [18980.559817] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 10:40:06 juju-e4d256-prod-github-runner-207 kernel: [18980.562443] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 10:40:06 juju-e4d256-prod-github-runner-207 kernel: [18980.563513] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 10:40:06 juju-e4d256-prod-github-runner-207 kernel: [18980.564858] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 10:40:06 juju-e4d256-prod-github-runner-207 kernel: [18980.566024] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 10:40:06 juju-e4d256-prod-github-runner-207 kernel: [18980.567223] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 10:40:06 juju-e4d256-prod-github-runner-207 kernel: [18980.568432] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 10:40:06 juju-e4d256-prod-github-runner-207 kernel: [18980.569724] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 10:40:06 juju-e4d256-prod-github-runner-207 kernel: [18980.570962] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 10:40:06 juju-e4d256-prod-github-runner-207 kernel: [18980.572055] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 10:40:06 juju-e4d256-prod-github-runner-207 kernel: [18980.573282] Call Trace: Aug 22 10:40:06 juju-e4d256-prod-github-runner-207 kernel: [18980.574219] Aug 22 10:40:06 juju-e4d256-prod-github-runner-207 kernel: [18980.575132] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:40:06 juju-e4d256-prod-github-runner-207 kernel: [18980.576161] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:40:06 juju-e4d256-prod-github-runner-207 kernel: [18980.577224] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:40:06 juju-e4d256-prod-github-runner-207 kernel: [18980.578358] ? show_regs.part.0+0x23/0x29 Aug 22 10:40:06 juju-e4d256-prod-github-runner-207 kernel: [18980.579379] ? show_regs.cold+0x8/0xd Aug 22 10:40:06 juju-e4d256-prod-github-runner-207 kernel: [18980.580353] ? watchdog_timer_fn+0x1be/0x220 Aug 22 10:40:06 juju-e4d256-prod-github-runner-207 kernel: [18980.581385] ? lockup_detector_update_enable+0x60/0x60 Aug 22 10:40:06 juju-e4d256-prod-github-runner-207 kernel: [18980.582454] ? __hrtimer_run_queues+0x107/0x230 Aug 22 10:40:06 juju-e4d256-prod-github-runner-207 kernel: [18980.583531] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 10:40:06 juju-e4d256-prod-github-runner-207 kernel: [18980.584594] ? hrtimer_interrupt+0x101/0x220 Aug 22 10:40:06 juju-e4d256-prod-github-runner-207 kernel: [18980.585645] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 10:40:06 juju-e4d256-prod-github-runner-207 kernel: [18980.586729] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 10:40:06 juju-e4d256-prod-github-runner-207 kernel: [18980.587821] Aug 22 10:40:06 juju-e4d256-prod-github-runner-207 kernel: [18980.588699] Aug 22 10:40:06 juju-e4d256-prod-github-runner-207 kernel: [18980.589579] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 10:40:06 juju-e4d256-prod-github-runner-207 kernel: [18980.590626] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:40:06 juju-e4d256-prod-github-runner-207 kernel: [18980.591675] ? _raw_spin_lock+0x22/0x30 Aug 22 10:40:06 juju-e4d256-prod-github-runner-207 kernel: [18980.592631] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:40:06 juju-e4d256-prod-github-runner-207 kernel: [18980.593701] direct_page_fault+0x206/0x310 [kvm] Aug 22 10:40:06 juju-e4d256-prod-github-runner-207 kernel: [18980.594762] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 10:40:06 juju-e4d256-prod-github-runner-207 kernel: [18980.595784] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 10:40:06 juju-e4d256-prod-github-runner-207 kernel: [18980.596804] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 10:40:06 juju-e4d256-prod-github-runner-207 kernel: [18980.597802] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 10:40:06 juju-e4d256-prod-github-runner-207 kernel: [18980.598760] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 10:40:06 juju-e4d256-prod-github-runner-207 kernel: [18980.599757] handle_exit+0x98/0x230 [kvm_amd] Aug 22 10:40:06 juju-e4d256-prod-github-runner-207 kernel: [18980.600799] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 10:40:06 juju-e4d256-prod-github-runner-207 kernel: [18980.601825] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 10:40:06 juju-e4d256-prod-github-runner-207 kernel: [18980.602801] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 10:40:06 juju-e4d256-prod-github-runner-207 kernel: [18980.603772] vcpu_run+0x62/0x2c0 [kvm] Aug 22 10:40:06 juju-e4d256-prod-github-runner-207 kernel: [18980.604668] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 10:40:06 juju-e4d256-prod-github-runner-207 kernel: [18980.605569] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 10:40:06 juju-e4d256-prod-github-runner-207 kernel: [18980.606485] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 10:40:06 juju-e4d256-prod-github-runner-207 kernel: [18980.607357] ? __seccomp_filter+0x4a/0x4a0 Aug 22 10:40:06 juju-e4d256-prod-github-runner-207 kernel: [18980.608266] ? __fget_files+0x86/0xc0 Aug 22 10:40:06 juju-e4d256-prod-github-runner-207 kernel: [18980.609117] __x64_sys_ioctl+0x95/0xd0 Aug 22 10:40:06 juju-e4d256-prod-github-runner-207 kernel: [18980.610041] do_syscall_64+0x5c/0xc0 Aug 22 10:40:06 juju-e4d256-prod-github-runner-207 kernel: [18980.610884] ? do_futex+0x162/0x1f0 Aug 22 10:40:06 juju-e4d256-prod-github-runner-207 kernel: [18980.611762] ? __x64_sys_futex+0x78/0x1e0 Aug 22 10:40:06 juju-e4d256-prod-github-runner-207 kernel: [18980.612504] ? __secure_computing+0xa9/0x120 Aug 22 10:40:06 juju-e4d256-prod-github-runner-207 kernel: [18980.613338] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 10:40:06 juju-e4d256-prod-github-runner-207 kernel: [18980.614161] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:40:06 juju-e4d256-prod-github-runner-207 kernel: [18980.614934] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:40:06 juju-e4d256-prod-github-runner-207 kernel: [18980.615771] ? do_syscall_64+0x69/0xc0 Aug 22 10:40:06 juju-e4d256-prod-github-runner-207 kernel: [18980.616429] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:40:06 juju-e4d256-prod-github-runner-207 kernel: [18980.617244] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:40:06 juju-e4d256-prod-github-runner-207 kernel: [18980.618068] ? do_syscall_64+0x69/0xc0 Aug 22 10:40:06 juju-e4d256-prod-github-runner-207 kernel: [18980.618706] ? do_syscall_64+0x69/0xc0 Aug 22 10:40:06 juju-e4d256-prod-github-runner-207 kernel: [18980.619433] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 10:40:06 juju-e4d256-prod-github-runner-207 kernel: [18980.620157] RIP: 0033:0x7faa5d0edaff Aug 22 10:40:06 juju-e4d256-prod-github-runner-207 kernel: [18980.620860] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 10:40:06 juju-e4d256-prod-github-runner-207 kernel: [18980.622991] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 10:40:06 juju-e4d256-prod-github-runner-207 kernel: [18980.623972] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 10:40:06 juju-e4d256-prod-github-runner-207 kernel: [18980.624948] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 10:40:06 juju-e4d256-prod-github-runner-207 kernel: [18980.625870] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 10:40:06 juju-e4d256-prod-github-runner-207 kernel: [18980.626772] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 10:40:06 juju-e4d256-prod-github-runner-207 kernel: [18980.627700] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 10:40:06 juju-e4d256-prod-github-runner-207 kernel: [18980.628597] Aug 22 10:40:34 juju-e4d256-prod-github-runner-207 kernel: [19008.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 17595s! [qemu-system-x86:6715] Aug 22 10:40:34 juju-e4d256-prod-github-runner-207 kernel: [19008.543800] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 10:40:34 juju-e4d256-prod-github-runner-207 kernel: [19008.543954] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 10:40:34 juju-e4d256-prod-github-runner-207 kernel: [19008.557069] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 10:40:34 juju-e4d256-prod-github-runner-207 kernel: [19008.558408] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 10:40:34 juju-e4d256-prod-github-runner-207 kernel: [19008.559803] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:40:34 juju-e4d256-prod-github-runner-207 kernel: [19008.560942] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 10:40:34 juju-e4d256-prod-github-runner-207 kernel: [19008.563793] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 10:40:34 juju-e4d256-prod-github-runner-207 kernel: [19008.564925] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 10:40:34 juju-e4d256-prod-github-runner-207 kernel: [19008.566186] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 10:40:34 juju-e4d256-prod-github-runner-207 kernel: [19008.567544] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 10:40:34 juju-e4d256-prod-github-runner-207 kernel: [19008.568824] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 10:40:34 juju-e4d256-prod-github-runner-207 kernel: [19008.570301] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 10:40:34 juju-e4d256-prod-github-runner-207 kernel: [19008.571532] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 10:40:34 juju-e4d256-prod-github-runner-207 kernel: [19008.572932] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 10:40:34 juju-e4d256-prod-github-runner-207 kernel: [19008.574079] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 10:40:34 juju-e4d256-prod-github-runner-207 kernel: [19008.575372] Call Trace: Aug 22 10:40:34 juju-e4d256-prod-github-runner-207 kernel: [19008.576292] Aug 22 10:40:34 juju-e4d256-prod-github-runner-207 kernel: [19008.577387] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:40:34 juju-e4d256-prod-github-runner-207 kernel: [19008.578497] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:40:34 juju-e4d256-prod-github-runner-207 kernel: [19008.579606] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:40:34 juju-e4d256-prod-github-runner-207 kernel: [19008.580846] ? show_regs.part.0+0x23/0x29 Aug 22 10:40:34 juju-e4d256-prod-github-runner-207 kernel: [19008.581884] ? show_regs.cold+0x8/0xd Aug 22 10:40:34 juju-e4d256-prod-github-runner-207 kernel: [19008.582963] ? watchdog_timer_fn+0x1be/0x220 Aug 22 10:40:34 juju-e4d256-prod-github-runner-207 kernel: [19008.584066] ? lockup_detector_update_enable+0x60/0x60 Aug 22 10:40:34 juju-e4d256-prod-github-runner-207 kernel: [19008.585222] ? __hrtimer_run_queues+0x107/0x230 Aug 22 10:40:34 juju-e4d256-prod-github-runner-207 kernel: [19008.586359] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 10:40:34 juju-e4d256-prod-github-runner-207 kernel: [19008.587462] ? hrtimer_interrupt+0x101/0x220 Aug 22 10:40:34 juju-e4d256-prod-github-runner-207 kernel: [19008.588626] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 10:40:34 juju-e4d256-prod-github-runner-207 kernel: [19008.589841] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 10:40:34 juju-e4d256-prod-github-runner-207 kernel: [19008.590958] Aug 22 10:40:34 juju-e4d256-prod-github-runner-207 kernel: [19008.591964] Aug 22 10:40:34 juju-e4d256-prod-github-runner-207 kernel: [19008.592824] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 10:40:34 juju-e4d256-prod-github-runner-207 kernel: [19008.593961] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:40:34 juju-e4d256-prod-github-runner-207 kernel: [19008.595071] ? _raw_spin_lock+0x22/0x30 Aug 22 10:40:34 juju-e4d256-prod-github-runner-207 kernel: [19008.596097] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:40:34 juju-e4d256-prod-github-runner-207 kernel: [19008.597263] direct_page_fault+0x206/0x310 [kvm] Aug 22 10:40:34 juju-e4d256-prod-github-runner-207 kernel: [19008.598413] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 10:40:34 juju-e4d256-prod-github-runner-207 kernel: [19008.599464] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 10:40:34 juju-e4d256-prod-github-runner-207 kernel: [19008.600583] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 10:40:34 juju-e4d256-prod-github-runner-207 kernel: [19008.601691] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 10:40:34 juju-e4d256-prod-github-runner-207 kernel: [19008.602685] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 10:40:34 juju-e4d256-prod-github-runner-207 kernel: [19008.603724] handle_exit+0x98/0x230 [kvm_amd] Aug 22 10:40:34 juju-e4d256-prod-github-runner-207 kernel: [19008.604715] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 10:40:34 juju-e4d256-prod-github-runner-207 kernel: [19008.605681] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 10:40:34 juju-e4d256-prod-github-runner-207 kernel: [19008.606727] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 10:40:34 juju-e4d256-prod-github-runner-207 kernel: [19008.607657] vcpu_run+0x62/0x2c0 [kvm] Aug 22 10:40:34 juju-e4d256-prod-github-runner-207 kernel: [19008.608613] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 10:40:34 juju-e4d256-prod-github-runner-207 kernel: [19008.609480] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 10:40:34 juju-e4d256-prod-github-runner-207 kernel: [19008.610442] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 10:40:34 juju-e4d256-prod-github-runner-207 kernel: [19008.611323] ? __seccomp_filter+0x4a/0x4a0 Aug 22 10:40:34 juju-e4d256-prod-github-runner-207 kernel: [19008.612083] ? __fget_files+0x86/0xc0 Aug 22 10:40:34 juju-e4d256-prod-github-runner-207 kernel: [19008.612887] __x64_sys_ioctl+0x95/0xd0 Aug 22 10:40:34 juju-e4d256-prod-github-runner-207 kernel: [19008.613693] do_syscall_64+0x5c/0xc0 Aug 22 10:40:34 juju-e4d256-prod-github-runner-207 kernel: [19008.614436] ? do_futex+0x162/0x1f0 Aug 22 10:40:34 juju-e4d256-prod-github-runner-207 kernel: [19008.615186] ? __x64_sys_futex+0x78/0x1e0 Aug 22 10:40:34 juju-e4d256-prod-github-runner-207 kernel: [19008.615910] ? __secure_computing+0xa9/0x120 Aug 22 10:40:34 juju-e4d256-prod-github-runner-207 kernel: [19008.616667] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 10:40:34 juju-e4d256-prod-github-runner-207 kernel: [19008.617465] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:40:34 juju-e4d256-prod-github-runner-207 kernel: [19008.618257] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:40:34 juju-e4d256-prod-github-runner-207 kernel: [19008.619028] ? do_syscall_64+0x69/0xc0 Aug 22 10:40:34 juju-e4d256-prod-github-runner-207 kernel: [19008.619762] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:40:34 juju-e4d256-prod-github-runner-207 kernel: [19008.620600] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:40:34 juju-e4d256-prod-github-runner-207 kernel: [19008.621351] ? do_syscall_64+0x69/0xc0 Aug 22 10:40:34 juju-e4d256-prod-github-runner-207 kernel: [19008.622023] ? do_syscall_64+0x69/0xc0 Aug 22 10:40:34 juju-e4d256-prod-github-runner-207 kernel: [19008.622682] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 10:40:34 juju-e4d256-prod-github-runner-207 kernel: [19008.623506] RIP: 0033:0x7faa5d0edaff Aug 22 10:40:34 juju-e4d256-prod-github-runner-207 kernel: [19008.624250] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 10:40:34 juju-e4d256-prod-github-runner-207 kernel: [19008.626443] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 10:40:34 juju-e4d256-prod-github-runner-207 kernel: [19008.627410] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 10:40:34 juju-e4d256-prod-github-runner-207 kernel: [19008.628451] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 10:40:34 juju-e4d256-prod-github-runner-207 kernel: [19008.629381] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 10:40:34 juju-e4d256-prod-github-runner-207 kernel: [19008.630346] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 10:40:34 juju-e4d256-prod-github-runner-207 kernel: [19008.631309] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 10:40:34 juju-e4d256-prod-github-runner-207 kernel: [19008.632269] Aug 22 10:41:02 juju-e4d256-prod-github-runner-207 kernel: [19036.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 17621s! [qemu-system-x86:6715] Aug 22 10:41:02 juju-e4d256-prod-github-runner-207 kernel: [19036.543099] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 10:41:02 juju-e4d256-prod-github-runner-207 kernel: [19036.543166] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 10:41:02 juju-e4d256-prod-github-runner-207 kernel: [19036.555311] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 10:41:02 juju-e4d256-prod-github-runner-207 kernel: [19036.556599] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 10:41:02 juju-e4d256-prod-github-runner-207 kernel: [19036.557823] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:41:02 juju-e4d256-prod-github-runner-207 kernel: [19036.558878] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 10:41:02 juju-e4d256-prod-github-runner-207 kernel: [19036.561441] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 10:41:02 juju-e4d256-prod-github-runner-207 kernel: [19036.562482] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 10:41:02 juju-e4d256-prod-github-runner-207 kernel: [19036.563643] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 10:41:02 juju-e4d256-prod-github-runner-207 kernel: [19036.564824] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 10:41:02 juju-e4d256-prod-github-runner-207 kernel: [19036.565985] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 10:41:02 juju-e4d256-prod-github-runner-207 kernel: [19036.567150] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 10:41:02 juju-e4d256-prod-github-runner-207 kernel: [19036.568331] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 10:41:02 juju-e4d256-prod-github-runner-207 kernel: [19036.569565] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 10:41:02 juju-e4d256-prod-github-runner-207 kernel: [19036.570667] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 10:41:02 juju-e4d256-prod-github-runner-207 kernel: [19036.571859] Call Trace: Aug 22 10:41:02 juju-e4d256-prod-github-runner-207 kernel: [19036.572781] Aug 22 10:41:02 juju-e4d256-prod-github-runner-207 kernel: [19036.573667] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:41:02 juju-e4d256-prod-github-runner-207 kernel: [19036.574705] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:41:02 juju-e4d256-prod-github-runner-207 kernel: [19036.575729] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:41:02 juju-e4d256-prod-github-runner-207 kernel: [19036.576816] ? show_regs.part.0+0x23/0x29 Aug 22 10:41:02 juju-e4d256-prod-github-runner-207 kernel: [19036.577813] ? show_regs.cold+0x8/0xd Aug 22 10:41:02 juju-e4d256-prod-github-runner-207 kernel: [19036.578783] ? watchdog_timer_fn+0x1be/0x220 Aug 22 10:41:02 juju-e4d256-prod-github-runner-207 kernel: [19036.579791] ? lockup_detector_update_enable+0x60/0x60 Aug 22 10:41:02 juju-e4d256-prod-github-runner-207 kernel: [19036.580867] ? __hrtimer_run_queues+0x107/0x230 Aug 22 10:41:02 juju-e4d256-prod-github-runner-207 kernel: [19036.581893] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 10:41:02 juju-e4d256-prod-github-runner-207 kernel: [19036.582915] ? hrtimer_interrupt+0x101/0x220 Aug 22 10:41:02 juju-e4d256-prod-github-runner-207 kernel: [19036.583927] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 10:41:02 juju-e4d256-prod-github-runner-207 kernel: [19036.585013] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 10:41:02 juju-e4d256-prod-github-runner-207 kernel: [19036.586057] Aug 22 10:41:02 juju-e4d256-prod-github-runner-207 kernel: [19036.586908] Aug 22 10:41:02 juju-e4d256-prod-github-runner-207 kernel: [19036.587743] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 10:41:02 juju-e4d256-prod-github-runner-207 kernel: [19036.588788] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:41:02 juju-e4d256-prod-github-runner-207 kernel: [19036.589989] ? _raw_spin_lock+0x22/0x30 Aug 22 10:41:02 juju-e4d256-prod-github-runner-207 kernel: [19036.590938] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:41:02 juju-e4d256-prod-github-runner-207 kernel: [19036.591950] direct_page_fault+0x206/0x310 [kvm] Aug 22 10:41:02 juju-e4d256-prod-github-runner-207 kernel: [19036.592986] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 10:41:02 juju-e4d256-prod-github-runner-207 kernel: [19036.593998] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 10:41:02 juju-e4d256-prod-github-runner-207 kernel: [19036.594996] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 10:41:02 juju-e4d256-prod-github-runner-207 kernel: [19036.595968] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 10:41:02 juju-e4d256-prod-github-runner-207 kernel: [19036.596923] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 10:41:02 juju-e4d256-prod-github-runner-207 kernel: [19036.597900] handle_exit+0x98/0x230 [kvm_amd] Aug 22 10:41:02 juju-e4d256-prod-github-runner-207 kernel: [19036.598790] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 10:41:02 juju-e4d256-prod-github-runner-207 kernel: [19036.599702] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 10:41:02 juju-e4d256-prod-github-runner-207 kernel: [19036.600642] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 10:41:02 juju-e4d256-prod-github-runner-207 kernel: [19036.601545] vcpu_run+0x62/0x2c0 [kvm] Aug 22 10:41:02 juju-e4d256-prod-github-runner-207 kernel: [19036.602354] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 10:41:02 juju-e4d256-prod-github-runner-207 kernel: [19036.603159] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 10:41:02 juju-e4d256-prod-github-runner-207 kernel: [19036.604010] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 10:41:02 juju-e4d256-prod-github-runner-207 kernel: [19036.604827] ? __seccomp_filter+0x4a/0x4a0 Aug 22 10:41:02 juju-e4d256-prod-github-runner-207 kernel: [19036.605570] ? __fget_files+0x86/0xc0 Aug 22 10:41:02 juju-e4d256-prod-github-runner-207 kernel: [19036.606272] __x64_sys_ioctl+0x95/0xd0 Aug 22 10:41:02 juju-e4d256-prod-github-runner-207 kernel: [19036.606962] do_syscall_64+0x5c/0xc0 Aug 22 10:41:02 juju-e4d256-prod-github-runner-207 kernel: [19036.607626] ? do_futex+0x162/0x1f0 Aug 22 10:41:02 juju-e4d256-prod-github-runner-207 kernel: [19036.608296] ? __x64_sys_futex+0x78/0x1e0 Aug 22 10:41:02 juju-e4d256-prod-github-runner-207 kernel: [19036.608969] ? __secure_computing+0xa9/0x120 Aug 22 10:41:02 juju-e4d256-prod-github-runner-207 kernel: [19036.609657] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 10:41:02 juju-e4d256-prod-github-runner-207 kernel: [19036.610415] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:41:02 juju-e4d256-prod-github-runner-207 kernel: [19036.611136] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:41:02 juju-e4d256-prod-github-runner-207 kernel: [19036.611852] ? do_syscall_64+0x69/0xc0 Aug 22 10:41:02 juju-e4d256-prod-github-runner-207 kernel: [19036.612508] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:41:02 juju-e4d256-prod-github-runner-207 kernel: [19036.613211] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:41:02 juju-e4d256-prod-github-runner-207 kernel: [19036.613904] ? do_syscall_64+0x69/0xc0 Aug 22 10:41:02 juju-e4d256-prod-github-runner-207 kernel: [19036.614527] ? do_syscall_64+0x69/0xc0 Aug 22 10:41:02 juju-e4d256-prod-github-runner-207 kernel: [19036.615148] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 10:41:02 juju-e4d256-prod-github-runner-207 kernel: [19036.615854] RIP: 0033:0x7faa5d0edaff Aug 22 10:41:02 juju-e4d256-prod-github-runner-207 kernel: [19036.616498] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 10:41:02 juju-e4d256-prod-github-runner-207 kernel: [19036.618475] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 10:41:02 juju-e4d256-prod-github-runner-207 kernel: [19036.619381] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 10:41:02 juju-e4d256-prod-github-runner-207 kernel: [19036.620295] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 10:41:02 juju-e4d256-prod-github-runner-207 kernel: [19036.621184] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 10:41:02 juju-e4d256-prod-github-runner-207 kernel: [19036.622070] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 10:41:02 juju-e4d256-prod-github-runner-207 kernel: [19036.622954] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 10:41:02 juju-e4d256-prod-github-runner-207 kernel: [19036.623848] Aug 22 10:41:30 juju-e4d256-prod-github-runner-207 kernel: [19064.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 17647s! [qemu-system-x86:6715] Aug 22 10:41:30 juju-e4d256-prod-github-runner-207 kernel: [19064.543099] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 10:41:30 juju-e4d256-prod-github-runner-207 kernel: [19064.543167] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 10:41:30 juju-e4d256-prod-github-runner-207 kernel: [19064.555216] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 10:41:30 juju-e4d256-prod-github-runner-207 kernel: [19064.556504] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 10:41:30 juju-e4d256-prod-github-runner-207 kernel: [19064.557730] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:41:30 juju-e4d256-prod-github-runner-207 kernel: [19064.558785] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 10:41:30 juju-e4d256-prod-github-runner-207 kernel: [19064.561345] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 10:41:30 juju-e4d256-prod-github-runner-207 kernel: [19064.562388] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 10:41:30 juju-e4d256-prod-github-runner-207 kernel: [19064.563545] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 10:41:30 juju-e4d256-prod-github-runner-207 kernel: [19064.564713] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 10:41:30 juju-e4d256-prod-github-runner-207 kernel: [19064.565874] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 10:41:30 juju-e4d256-prod-github-runner-207 kernel: [19064.567038] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 10:41:30 juju-e4d256-prod-github-runner-207 kernel: [19064.568223] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 10:41:30 juju-e4d256-prod-github-runner-207 kernel: [19064.569454] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 10:41:30 juju-e4d256-prod-github-runner-207 kernel: [19064.570555] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 10:41:30 juju-e4d256-prod-github-runner-207 kernel: [19064.571765] Call Trace: Aug 22 10:41:30 juju-e4d256-prod-github-runner-207 kernel: [19064.572681] Aug 22 10:41:30 juju-e4d256-prod-github-runner-207 kernel: [19064.573695] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:41:30 juju-e4d256-prod-github-runner-207 kernel: [19064.574724] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:41:30 juju-e4d256-prod-github-runner-207 kernel: [19064.575936] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:41:30 juju-e4d256-prod-github-runner-207 kernel: [19064.577105] ? show_regs.part.0+0x23/0x29 Aug 22 10:41:30 juju-e4d256-prod-github-runner-207 kernel: [19064.578104] ? show_regs.cold+0x8/0xd Aug 22 10:41:30 juju-e4d256-prod-github-runner-207 kernel: [19064.579074] ? watchdog_timer_fn+0x1be/0x220 Aug 22 10:41:30 juju-e4d256-prod-github-runner-207 kernel: [19064.580098] ? lockup_detector_update_enable+0x60/0x60 Aug 22 10:41:30 juju-e4d256-prod-github-runner-207 kernel: [19064.581159] ? __hrtimer_run_queues+0x107/0x230 Aug 22 10:41:30 juju-e4d256-prod-github-runner-207 kernel: [19064.582187] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 10:41:30 juju-e4d256-prod-github-runner-207 kernel: [19064.583214] ? hrtimer_interrupt+0x101/0x220 Aug 22 10:41:30 juju-e4d256-prod-github-runner-207 kernel: [19064.584244] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 10:41:30 juju-e4d256-prod-github-runner-207 kernel: [19064.585311] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 10:41:30 juju-e4d256-prod-github-runner-207 kernel: [19064.586359] Aug 22 10:41:30 juju-e4d256-prod-github-runner-207 kernel: [19064.587215] Aug 22 10:41:30 juju-e4d256-prod-github-runner-207 kernel: [19064.588070] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 10:41:30 juju-e4d256-prod-github-runner-207 kernel: [19064.589101] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:41:30 juju-e4d256-prod-github-runner-207 kernel: [19064.590137] ? _raw_spin_lock+0x22/0x30 Aug 22 10:41:30 juju-e4d256-prod-github-runner-207 kernel: [19064.591086] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:41:30 juju-e4d256-prod-github-runner-207 kernel: [19064.592111] direct_page_fault+0x206/0x310 [kvm] Aug 22 10:41:30 juju-e4d256-prod-github-runner-207 kernel: [19064.593139] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 10:41:30 juju-e4d256-prod-github-runner-207 kernel: [19064.594151] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 10:41:30 juju-e4d256-prod-github-runner-207 kernel: [19064.595154] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 10:41:30 juju-e4d256-prod-github-runner-207 kernel: [19064.596132] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 10:41:30 juju-e4d256-prod-github-runner-207 kernel: [19064.597084] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 10:41:30 juju-e4d256-prod-github-runner-207 kernel: [19064.598067] handle_exit+0x98/0x230 [kvm_amd] Aug 22 10:41:30 juju-e4d256-prod-github-runner-207 kernel: [19064.598962] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 10:41:30 juju-e4d256-prod-github-runner-207 kernel: [19064.599886] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 10:41:30 juju-e4d256-prod-github-runner-207 kernel: [19064.600808] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 10:41:30 juju-e4d256-prod-github-runner-207 kernel: [19064.601715] vcpu_run+0x62/0x2c0 [kvm] Aug 22 10:41:30 juju-e4d256-prod-github-runner-207 kernel: [19064.602529] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 10:41:30 juju-e4d256-prod-github-runner-207 kernel: [19064.603334] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 10:41:30 juju-e4d256-prod-github-runner-207 kernel: [19064.604206] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 10:41:30 juju-e4d256-prod-github-runner-207 kernel: [19064.605003] ? __seccomp_filter+0x4a/0x4a0 Aug 22 10:41:30 juju-e4d256-prod-github-runner-207 kernel: [19064.605743] ? __fget_files+0x86/0xc0 Aug 22 10:41:30 juju-e4d256-prod-github-runner-207 kernel: [19064.606444] __x64_sys_ioctl+0x95/0xd0 Aug 22 10:41:30 juju-e4d256-prod-github-runner-207 kernel: [19064.607140] do_syscall_64+0x5c/0xc0 Aug 22 10:41:30 juju-e4d256-prod-github-runner-207 kernel: [19064.607816] ? do_futex+0x162/0x1f0 Aug 22 10:41:30 juju-e4d256-prod-github-runner-207 kernel: [19064.608468] ? __x64_sys_futex+0x78/0x1e0 Aug 22 10:41:30 juju-e4d256-prod-github-runner-207 kernel: [19064.609152] ? __secure_computing+0xa9/0x120 Aug 22 10:41:30 juju-e4d256-prod-github-runner-207 kernel: [19064.609840] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 10:41:30 juju-e4d256-prod-github-runner-207 kernel: [19064.610603] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:41:30 juju-e4d256-prod-github-runner-207 kernel: [19064.611323] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:41:30 juju-e4d256-prod-github-runner-207 kernel: [19064.612050] ? do_syscall_64+0x69/0xc0 Aug 22 10:41:30 juju-e4d256-prod-github-runner-207 kernel: [19064.612694] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:41:30 juju-e4d256-prod-github-runner-207 kernel: [19064.613396] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:41:30 juju-e4d256-prod-github-runner-207 kernel: [19064.614093] ? do_syscall_64+0x69/0xc0 Aug 22 10:41:30 juju-e4d256-prod-github-runner-207 kernel: [19064.614716] ? do_syscall_64+0x69/0xc0 Aug 22 10:41:30 juju-e4d256-prod-github-runner-207 kernel: [19064.615336] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 10:41:30 juju-e4d256-prod-github-runner-207 kernel: [19064.616055] RIP: 0033:0x7faa5d0edaff Aug 22 10:41:30 juju-e4d256-prod-github-runner-207 kernel: [19064.616677] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 10:41:30 juju-e4d256-prod-github-runner-207 kernel: [19064.618656] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 10:41:30 juju-e4d256-prod-github-runner-207 kernel: [19064.619573] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 10:41:30 juju-e4d256-prod-github-runner-207 kernel: [19064.620477] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 10:41:30 juju-e4d256-prod-github-runner-207 kernel: [19064.621369] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 10:41:30 juju-e4d256-prod-github-runner-207 kernel: [19064.622254] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 10:41:30 juju-e4d256-prod-github-runner-207 kernel: [19064.623145] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 10:41:30 juju-e4d256-prod-github-runner-207 kernel: [19064.624054] Aug 22 10:41:44 juju-e4d256-prod-github-runner-207 kernel: [19078.460707] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 10:41:44 juju-e4d256-prod-github-runner-207 kernel: [19078.462311] rcu: 1-....: (4725550 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=2288297 Aug 22 10:41:44 juju-e4d256-prod-github-runner-207 kernel: [19078.463431] (t=4740315 jiffies g=23269 q=25316) Aug 22 10:41:44 juju-e4d256-prod-github-runner-207 kernel: [19078.464235] NMI backtrace for cpu 1 Aug 22 10:41:44 juju-e4d256-prod-github-runner-207 kernel: [19078.464944] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 10:41:44 juju-e4d256-prod-github-runner-207 kernel: [19078.466049] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 10:41:44 juju-e4d256-prod-github-runner-207 kernel: [19078.467111] Call Trace: Aug 22 10:41:44 juju-e4d256-prod-github-runner-207 kernel: [19078.467814] Aug 22 10:41:44 juju-e4d256-prod-github-runner-207 kernel: [19078.468471] show_stack+0x52/0x5c Aug 22 10:41:44 juju-e4d256-prod-github-runner-207 kernel: [19078.469193] dump_stack_lvl+0x4a/0x63 Aug 22 10:41:44 juju-e4d256-prod-github-runner-207 kernel: [19078.469938] dump_stack+0x10/0x16 Aug 22 10:41:44 juju-e4d256-prod-github-runner-207 kernel: [19078.470651] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 10:41:44 juju-e4d256-prod-github-runner-207 kernel: [19078.471440] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 10:41:44 juju-e4d256-prod-github-runner-207 kernel: [19078.472228] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 10:41:44 juju-e4d256-prod-github-runner-207 kernel: [19078.473044] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 10:41:44 juju-e4d256-prod-github-runner-207 kernel: [19078.473862] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 10:41:44 juju-e4d256-prod-github-runner-207 kernel: [19078.474674] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 10:41:44 juju-e4d256-prod-github-runner-207 kernel: [19078.475450] print_cpu_stall.cold+0x2f/0xe2 Aug 22 10:41:44 juju-e4d256-prod-github-runner-207 kernel: [19078.476229] ? timekeeping_update+0xf7/0x150 Aug 22 10:41:44 juju-e4d256-prod-github-runner-207 kernel: [19078.476996] check_cpu_stall+0x109/0x270 Aug 22 10:41:44 juju-e4d256-prod-github-runner-207 kernel: [19078.477747] rcu_sched_clock_irq+0x9a/0x250 Aug 22 10:41:44 juju-e4d256-prod-github-runner-207 kernel: [19078.478505] update_process_times+0x94/0xd0 Aug 22 10:41:44 juju-e4d256-prod-github-runner-207 kernel: [19078.479262] tick_sched_handle+0x29/0x70 Aug 22 10:41:44 juju-e4d256-prod-github-runner-207 kernel: [19078.480021] tick_sched_timer+0x8c/0xc0 Aug 22 10:41:44 juju-e4d256-prod-github-runner-207 kernel: [19078.480758] ? tick_nohz_handler+0xb0/0xb0 Aug 22 10:41:44 juju-e4d256-prod-github-runner-207 kernel: [19078.481517] __hrtimer_run_queues+0x107/0x230 Aug 22 10:41:44 juju-e4d256-prod-github-runner-207 kernel: [19078.482293] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 10:41:44 juju-e4d256-prod-github-runner-207 kernel: [19078.483067] hrtimer_interrupt+0x101/0x220 Aug 22 10:41:44 juju-e4d256-prod-github-runner-207 kernel: [19078.483841] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 10:41:44 juju-e4d256-prod-github-runner-207 kernel: [19078.484650] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 10:41:44 juju-e4d256-prod-github-runner-207 kernel: [19078.485450] Aug 22 10:41:44 juju-e4d256-prod-github-runner-207 kernel: [19078.486084] Aug 22 10:41:44 juju-e4d256-prod-github-runner-207 kernel: [19078.486715] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 10:41:44 juju-e4d256-prod-github-runner-207 kernel: [19078.487538] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:41:44 juju-e4d256-prod-github-runner-207 kernel: [19078.488426] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 10:41:44 juju-e4d256-prod-github-runner-207 kernel: [19078.490631] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 10:41:44 juju-e4d256-prod-github-runner-207 kernel: [19078.491506] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 10:41:44 juju-e4d256-prod-github-runner-207 kernel: [19078.492515] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 10:41:44 juju-e4d256-prod-github-runner-207 kernel: [19078.493494] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 10:41:44 juju-e4d256-prod-github-runner-207 kernel: [19078.494453] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 10:41:44 juju-e4d256-prod-github-runner-207 kernel: [19078.495406] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 10:41:44 juju-e4d256-prod-github-runner-207 kernel: [19078.496379] ? _raw_spin_lock+0x22/0x30 Aug 22 10:41:44 juju-e4d256-prod-github-runner-207 kernel: [19078.497147] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:41:44 juju-e4d256-prod-github-runner-207 kernel: [19078.497996] direct_page_fault+0x206/0x310 [kvm] Aug 22 10:41:44 juju-e4d256-prod-github-runner-207 kernel: [19078.498831] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 10:41:44 juju-e4d256-prod-github-runner-207 kernel: [19078.499675] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 10:41:44 juju-e4d256-prod-github-runner-207 kernel: [19078.500512] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 10:41:44 juju-e4d256-prod-github-runner-207 kernel: [19078.501344] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 10:41:44 juju-e4d256-prod-github-runner-207 kernel: [19078.502129] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 10:41:44 juju-e4d256-prod-github-runner-207 kernel: [19078.502954] handle_exit+0x98/0x230 [kvm_amd] Aug 22 10:41:44 juju-e4d256-prod-github-runner-207 kernel: [19078.503726] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 10:41:44 juju-e4d256-prod-github-runner-207 kernel: [19078.504509] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 10:41:44 juju-e4d256-prod-github-runner-207 kernel: [19078.505308] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 10:41:44 juju-e4d256-prod-github-runner-207 kernel: [19078.506093] vcpu_run+0x62/0x2c0 [kvm] Aug 22 10:41:44 juju-e4d256-prod-github-runner-207 kernel: [19078.506808] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 10:41:44 juju-e4d256-prod-github-runner-207 kernel: [19078.507545] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 10:41:44 juju-e4d256-prod-github-runner-207 kernel: [19078.508364] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 10:41:44 juju-e4d256-prod-github-runner-207 kernel: [19078.509130] ? __seccomp_filter+0x4a/0x4a0 Aug 22 10:41:44 juju-e4d256-prod-github-runner-207 kernel: [19078.509849] ? __fget_files+0x86/0xc0 Aug 22 10:41:44 juju-e4d256-prod-github-runner-207 kernel: [19078.510541] __x64_sys_ioctl+0x95/0xd0 Aug 22 10:41:44 juju-e4d256-prod-github-runner-207 kernel: [19078.511234] do_syscall_64+0x5c/0xc0 Aug 22 10:41:44 juju-e4d256-prod-github-runner-207 kernel: [19078.511927] ? do_futex+0x162/0x1f0 Aug 22 10:41:44 juju-e4d256-prod-github-runner-207 kernel: [19078.512609] ? __x64_sys_futex+0x78/0x1e0 Aug 22 10:41:44 juju-e4d256-prod-github-runner-207 kernel: [19078.513311] ? __secure_computing+0xa9/0x120 Aug 22 10:41:44 juju-e4d256-prod-github-runner-207 kernel: [19078.514025] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 10:41:44 juju-e4d256-prod-github-runner-207 kernel: [19078.514814] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:41:44 juju-e4d256-prod-github-runner-207 kernel: [19078.515617] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:41:44 juju-e4d256-prod-github-runner-207 kernel: [19078.516403] ? do_syscall_64+0x69/0xc0 Aug 22 10:41:44 juju-e4d256-prod-github-runner-207 kernel: [19078.517095] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:41:44 juju-e4d256-prod-github-runner-207 kernel: [19078.517857] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:41:44 juju-e4d256-prod-github-runner-207 kernel: [19078.518620] ? do_syscall_64+0x69/0xc0 Aug 22 10:41:44 juju-e4d256-prod-github-runner-207 kernel: [19078.519313] ? do_syscall_64+0x69/0xc0 Aug 22 10:41:44 juju-e4d256-prod-github-runner-207 kernel: [19078.520027] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 10:41:44 juju-e4d256-prod-github-runner-207 kernel: [19078.520801] RIP: 0033:0x7faa5d0edaff Aug 22 10:41:44 juju-e4d256-prod-github-runner-207 kernel: [19078.521506] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 10:41:44 juju-e4d256-prod-github-runner-207 kernel: [19078.523624] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 10:41:44 juju-e4d256-prod-github-runner-207 kernel: [19078.524586] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 10:41:44 juju-e4d256-prod-github-runner-207 kernel: [19078.525538] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 10:41:44 juju-e4d256-prod-github-runner-207 kernel: [19078.526482] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 10:41:44 juju-e4d256-prod-github-runner-207 kernel: [19078.527425] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 10:41:44 juju-e4d256-prod-github-runner-207 kernel: [19078.528376] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 10:41:44 juju-e4d256-prod-github-runner-207 kernel: [19078.529296] Aug 22 10:42:10 juju-e4d256-prod-github-runner-207 kernel: [19104.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 17684s! [qemu-system-x86:6715] Aug 22 10:42:10 juju-e4d256-prod-github-runner-207 kernel: [19104.543100] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 10:42:10 juju-e4d256-prod-github-runner-207 kernel: [19104.543390] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 10:42:10 juju-e4d256-prod-github-runner-207 kernel: [19104.555505] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 10:42:10 juju-e4d256-prod-github-runner-207 kernel: [19104.556765] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 10:42:10 juju-e4d256-prod-github-runner-207 kernel: [19104.557982] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:42:10 juju-e4d256-prod-github-runner-207 kernel: [19104.559037] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 10:42:10 juju-e4d256-prod-github-runner-207 kernel: [19104.561592] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 10:42:10 juju-e4d256-prod-github-runner-207 kernel: [19104.562638] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 10:42:10 juju-e4d256-prod-github-runner-207 kernel: [19104.563833] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 10:42:10 juju-e4d256-prod-github-runner-207 kernel: [19104.565024] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 10:42:10 juju-e4d256-prod-github-runner-207 kernel: [19104.566194] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 10:42:10 juju-e4d256-prod-github-runner-207 kernel: [19104.567367] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 10:42:10 juju-e4d256-prod-github-runner-207 kernel: [19104.568538] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 10:42:10 juju-e4d256-prod-github-runner-207 kernel: [19104.569776] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 10:42:10 juju-e4d256-prod-github-runner-207 kernel: [19104.570871] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 10:42:10 juju-e4d256-prod-github-runner-207 kernel: [19104.572102] Call Trace: Aug 22 10:42:10 juju-e4d256-prod-github-runner-207 kernel: [19104.573056] Aug 22 10:42:10 juju-e4d256-prod-github-runner-207 kernel: [19104.573961] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:42:10 juju-e4d256-prod-github-runner-207 kernel: [19104.574993] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:42:10 juju-e4d256-prod-github-runner-207 kernel: [19104.576031] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:42:10 juju-e4d256-prod-github-runner-207 kernel: [19104.577102] ? show_regs.part.0+0x23/0x29 Aug 22 10:42:10 juju-e4d256-prod-github-runner-207 kernel: [19104.578117] ? show_regs.cold+0x8/0xd Aug 22 10:42:10 juju-e4d256-prod-github-runner-207 kernel: [19104.579121] ? watchdog_timer_fn+0x1be/0x220 Aug 22 10:42:10 juju-e4d256-prod-github-runner-207 kernel: [19104.580146] ? lockup_detector_update_enable+0x60/0x60 Aug 22 10:42:10 juju-e4d256-prod-github-runner-207 kernel: [19104.581207] ? __hrtimer_run_queues+0x107/0x230 Aug 22 10:42:10 juju-e4d256-prod-github-runner-207 kernel: [19104.582235] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 10:42:10 juju-e4d256-prod-github-runner-207 kernel: [19104.583270] ? hrtimer_interrupt+0x101/0x220 Aug 22 10:42:10 juju-e4d256-prod-github-runner-207 kernel: [19104.584286] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 10:42:10 juju-e4d256-prod-github-runner-207 kernel: [19104.585352] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 10:42:10 juju-e4d256-prod-github-runner-207 kernel: [19104.586400] Aug 22 10:42:10 juju-e4d256-prod-github-runner-207 kernel: [19104.587264] Aug 22 10:42:10 juju-e4d256-prod-github-runner-207 kernel: [19104.588104] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 10:42:10 juju-e4d256-prod-github-runner-207 kernel: [19104.589134] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:42:10 juju-e4d256-prod-github-runner-207 kernel: [19104.590173] ? _raw_spin_lock+0x22/0x30 Aug 22 10:42:10 juju-e4d256-prod-github-runner-207 kernel: [19104.591116] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:42:10 juju-e4d256-prod-github-runner-207 kernel: [19104.592153] direct_page_fault+0x206/0x310 [kvm] Aug 22 10:42:10 juju-e4d256-prod-github-runner-207 kernel: [19104.593185] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 10:42:10 juju-e4d256-prod-github-runner-207 kernel: [19104.594192] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 10:42:10 juju-e4d256-prod-github-runner-207 kernel: [19104.595189] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 10:42:10 juju-e4d256-prod-github-runner-207 kernel: [19104.596173] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 10:42:10 juju-e4d256-prod-github-runner-207 kernel: [19104.597115] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 10:42:10 juju-e4d256-prod-github-runner-207 kernel: [19104.598207] handle_exit+0x98/0x230 [kvm_amd] Aug 22 10:42:10 juju-e4d256-prod-github-runner-207 kernel: [19104.599096] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 10:42:10 juju-e4d256-prod-github-runner-207 kernel: [19104.600031] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 10:42:10 juju-e4d256-prod-github-runner-207 kernel: [19104.601107] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 10:42:10 juju-e4d256-prod-github-runner-207 kernel: [19104.602009] vcpu_run+0x62/0x2c0 [kvm] Aug 22 10:42:10 juju-e4d256-prod-github-runner-207 kernel: [19104.602820] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 10:42:10 juju-e4d256-prod-github-runner-207 kernel: [19104.603643] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 10:42:10 juju-e4d256-prod-github-runner-207 kernel: [19104.604499] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 10:42:10 juju-e4d256-prod-github-runner-207 kernel: [19104.605303] ? __seccomp_filter+0x4a/0x4a0 Aug 22 10:42:10 juju-e4d256-prod-github-runner-207 kernel: [19104.606044] ? __fget_files+0x86/0xc0 Aug 22 10:42:10 juju-e4d256-prod-github-runner-207 kernel: [19104.606749] __x64_sys_ioctl+0x95/0xd0 Aug 22 10:42:10 juju-e4d256-prod-github-runner-207 kernel: [19104.607462] do_syscall_64+0x5c/0xc0 Aug 22 10:42:10 juju-e4d256-prod-github-runner-207 kernel: [19104.608144] ? do_futex+0x162/0x1f0 Aug 22 10:42:10 juju-e4d256-prod-github-runner-207 kernel: [19104.608837] ? __x64_sys_futex+0x78/0x1e0 Aug 22 10:42:10 juju-e4d256-prod-github-runner-207 kernel: [19104.609518] ? __secure_computing+0xa9/0x120 Aug 22 10:42:10 juju-e4d256-prod-github-runner-207 kernel: [19104.610207] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 10:42:10 juju-e4d256-prod-github-runner-207 kernel: [19104.610966] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:42:10 juju-e4d256-prod-github-runner-207 kernel: [19104.611715] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:42:10 juju-e4d256-prod-github-runner-207 kernel: [19104.612432] ? do_syscall_64+0x69/0xc0 Aug 22 10:42:10 juju-e4d256-prod-github-runner-207 kernel: [19104.613079] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:42:10 juju-e4d256-prod-github-runner-207 kernel: [19104.613787] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:42:10 juju-e4d256-prod-github-runner-207 kernel: [19104.614487] ? do_syscall_64+0x69/0xc0 Aug 22 10:42:10 juju-e4d256-prod-github-runner-207 kernel: [19104.615111] ? do_syscall_64+0x69/0xc0 Aug 22 10:42:10 juju-e4d256-prod-github-runner-207 kernel: [19104.615756] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 10:42:10 juju-e4d256-prod-github-runner-207 kernel: [19104.616461] RIP: 0033:0x7faa5d0edaff Aug 22 10:42:10 juju-e4d256-prod-github-runner-207 kernel: [19104.617085] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 10:42:10 juju-e4d256-prod-github-runner-207 kernel: [19104.619066] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 10:42:10 juju-e4d256-prod-github-runner-207 kernel: [19104.619997] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 10:42:10 juju-e4d256-prod-github-runner-207 kernel: [19104.620887] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 10:42:10 juju-e4d256-prod-github-runner-207 kernel: [19104.621774] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 10:42:10 juju-e4d256-prod-github-runner-207 kernel: [19104.622660] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 10:42:10 juju-e4d256-prod-github-runner-207 kernel: [19104.623573] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 10:42:10 juju-e4d256-prod-github-runner-207 kernel: [19104.624516] Aug 22 10:42:38 juju-e4d256-prod-github-runner-207 kernel: [19132.541981] watchdog: BUG: soft lockup - CPU#1 stuck for 17710s! [qemu-system-x86:6715] Aug 22 10:42:38 juju-e4d256-prod-github-runner-207 kernel: [19132.543528] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 10:42:38 juju-e4d256-prod-github-runner-207 kernel: [19132.543608] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 10:42:38 juju-e4d256-prod-github-runner-207 kernel: [19132.557039] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 10:42:38 juju-e4d256-prod-github-runner-207 kernel: [19132.558698] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 10:42:38 juju-e4d256-prod-github-runner-207 kernel: [19132.559940] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:42:38 juju-e4d256-prod-github-runner-207 kernel: [19132.561004] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 10:42:38 juju-e4d256-prod-github-runner-207 kernel: [19132.563887] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 10:42:38 juju-e4d256-prod-github-runner-207 kernel: [19132.564936] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 10:42:38 juju-e4d256-prod-github-runner-207 kernel: [19132.566109] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 10:42:38 juju-e4d256-prod-github-runner-207 kernel: [19132.567361] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 10:42:38 juju-e4d256-prod-github-runner-207 kernel: [19132.568719] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 10:42:38 juju-e4d256-prod-github-runner-207 kernel: [19132.569882] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 10:42:38 juju-e4d256-prod-github-runner-207 kernel: [19132.571067] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 10:42:38 juju-e4d256-prod-github-runner-207 kernel: [19132.572301] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 10:42:38 juju-e4d256-prod-github-runner-207 kernel: [19132.573402] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 10:42:38 juju-e4d256-prod-github-runner-207 kernel: [19132.574598] Call Trace: Aug 22 10:42:38 juju-e4d256-prod-github-runner-207 kernel: [19132.575527] Aug 22 10:42:38 juju-e4d256-prod-github-runner-207 kernel: [19132.576412] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:42:38 juju-e4d256-prod-github-runner-207 kernel: [19132.577446] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:42:38 juju-e4d256-prod-github-runner-207 kernel: [19132.578611] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:42:38 juju-e4d256-prod-github-runner-207 kernel: [19132.579743] ? show_regs.part.0+0x23/0x29 Aug 22 10:42:38 juju-e4d256-prod-github-runner-207 kernel: [19132.580742] ? show_regs.cold+0x8/0xd Aug 22 10:42:38 juju-e4d256-prod-github-runner-207 kernel: [19132.581715] ? watchdog_timer_fn+0x1be/0x220 Aug 22 10:42:38 juju-e4d256-prod-github-runner-207 kernel: [19132.582726] ? lockup_detector_update_enable+0x60/0x60 Aug 22 10:42:38 juju-e4d256-prod-github-runner-207 kernel: [19132.583804] ? __hrtimer_run_queues+0x107/0x230 Aug 22 10:42:38 juju-e4d256-prod-github-runner-207 kernel: [19132.584837] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 10:42:38 juju-e4d256-prod-github-runner-207 kernel: [19132.585865] ? hrtimer_interrupt+0x101/0x220 Aug 22 10:42:38 juju-e4d256-prod-github-runner-207 kernel: [19132.586884] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 10:42:38 juju-e4d256-prod-github-runner-207 kernel: [19132.587962] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 10:42:38 juju-e4d256-prod-github-runner-207 kernel: [19132.589009] Aug 22 10:42:38 juju-e4d256-prod-github-runner-207 kernel: [19132.589867] Aug 22 10:42:38 juju-e4d256-prod-github-runner-207 kernel: [19132.590705] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 10:42:38 juju-e4d256-prod-github-runner-207 kernel: [19132.591758] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:42:38 juju-e4d256-prod-github-runner-207 kernel: [19132.592797] ? _raw_spin_lock+0x22/0x30 Aug 22 10:42:38 juju-e4d256-prod-github-runner-207 kernel: [19132.593743] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:42:38 juju-e4d256-prod-github-runner-207 kernel: [19132.594757] direct_page_fault+0x206/0x310 [kvm] Aug 22 10:42:38 juju-e4d256-prod-github-runner-207 kernel: [19132.595794] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 10:42:38 juju-e4d256-prod-github-runner-207 kernel: [19132.596803] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 10:42:38 juju-e4d256-prod-github-runner-207 kernel: [19132.597802] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 10:42:38 juju-e4d256-prod-github-runner-207 kernel: [19132.598769] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 10:42:38 juju-e4d256-prod-github-runner-207 kernel: [19132.599726] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 10:42:38 juju-e4d256-prod-github-runner-207 kernel: [19132.600703] handle_exit+0x98/0x230 [kvm_amd] Aug 22 10:42:38 juju-e4d256-prod-github-runner-207 kernel: [19132.601596] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 10:42:38 juju-e4d256-prod-github-runner-207 kernel: [19132.602583] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 10:42:38 juju-e4d256-prod-github-runner-207 kernel: [19132.603529] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 10:42:38 juju-e4d256-prod-github-runner-207 kernel: [19132.604437] vcpu_run+0x62/0x2c0 [kvm] Aug 22 10:42:38 juju-e4d256-prod-github-runner-207 kernel: [19132.605250] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 10:42:38 juju-e4d256-prod-github-runner-207 kernel: [19132.606124] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 10:42:38 juju-e4d256-prod-github-runner-207 kernel: [19132.607007] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 10:42:38 juju-e4d256-prod-github-runner-207 kernel: [19132.607914] ? __seccomp_filter+0x4a/0x4a0 Aug 22 10:42:38 juju-e4d256-prod-github-runner-207 kernel: [19132.608738] ? __fget_files+0x86/0xc0 Aug 22 10:42:38 juju-e4d256-prod-github-runner-207 kernel: [19132.609518] __x64_sys_ioctl+0x95/0xd0 Aug 22 10:42:38 juju-e4d256-prod-github-runner-207 kernel: [19132.610287] do_syscall_64+0x5c/0xc0 Aug 22 10:42:38 juju-e4d256-prod-github-runner-207 kernel: [19132.611047] ? do_futex+0x162/0x1f0 Aug 22 10:42:38 juju-e4d256-prod-github-runner-207 kernel: [19132.611769] ? __x64_sys_futex+0x78/0x1e0 Aug 22 10:42:38 juju-e4d256-prod-github-runner-207 kernel: [19132.612531] ? __secure_computing+0xa9/0x120 Aug 22 10:42:38 juju-e4d256-prod-github-runner-207 kernel: [19132.613315] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 10:42:38 juju-e4d256-prod-github-runner-207 kernel: [19132.614182] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:42:38 juju-e4d256-prod-github-runner-207 kernel: [19132.615024] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:42:38 juju-e4d256-prod-github-runner-207 kernel: [19132.615837] ? do_syscall_64+0x69/0xc0 Aug 22 10:42:38 juju-e4d256-prod-github-runner-207 kernel: [19132.616567] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:42:38 juju-e4d256-prod-github-runner-207 kernel: [19132.617366] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:42:38 juju-e4d256-prod-github-runner-207 kernel: [19132.618148] ? do_syscall_64+0x69/0xc0 Aug 22 10:42:38 juju-e4d256-prod-github-runner-207 kernel: [19132.618855] ? do_syscall_64+0x69/0xc0 Aug 22 10:42:38 juju-e4d256-prod-github-runner-207 kernel: [19132.619574] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 10:42:38 juju-e4d256-prod-github-runner-207 kernel: [19132.620375] RIP: 0033:0x7faa5d0edaff Aug 22 10:42:38 juju-e4d256-prod-github-runner-207 kernel: [19132.621077] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 10:42:38 juju-e4d256-prod-github-runner-207 kernel: [19132.623424] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 10:42:38 juju-e4d256-prod-github-runner-207 kernel: [19132.624473] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 10:42:38 juju-e4d256-prod-github-runner-207 kernel: [19132.625493] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 10:42:38 juju-e4d256-prod-github-runner-207 kernel: [19132.626513] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 10:42:38 juju-e4d256-prod-github-runner-207 kernel: [19132.627557] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 10:42:38 juju-e4d256-prod-github-runner-207 kernel: [19132.628580] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 10:42:38 juju-e4d256-prod-github-runner-207 kernel: [19132.629617] Aug 22 10:43:06 juju-e4d256-prod-github-runner-207 kernel: [19160.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 17736s! [qemu-system-x86:6715] Aug 22 10:43:06 juju-e4d256-prod-github-runner-207 kernel: [19160.543161] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 10:43:06 juju-e4d256-prod-github-runner-207 kernel: [19160.543233] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 10:43:06 juju-e4d256-prod-github-runner-207 kernel: [19160.555288] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 10:43:06 juju-e4d256-prod-github-runner-207 kernel: [19160.556550] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 10:43:06 juju-e4d256-prod-github-runner-207 kernel: [19160.557772] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:43:06 juju-e4d256-prod-github-runner-207 kernel: [19160.558848] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 10:43:06 juju-e4d256-prod-github-runner-207 kernel: [19160.561394] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 10:43:06 juju-e4d256-prod-github-runner-207 kernel: [19160.562434] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 10:43:06 juju-e4d256-prod-github-runner-207 kernel: [19160.563609] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 10:43:06 juju-e4d256-prod-github-runner-207 kernel: [19160.564765] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 10:43:06 juju-e4d256-prod-github-runner-207 kernel: [19160.565927] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 10:43:06 juju-e4d256-prod-github-runner-207 kernel: [19160.567100] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 10:43:06 juju-e4d256-prod-github-runner-207 kernel: [19160.568264] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 10:43:06 juju-e4d256-prod-github-runner-207 kernel: [19160.569502] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 10:43:06 juju-e4d256-prod-github-runner-207 kernel: [19160.570610] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 10:43:06 juju-e4d256-prod-github-runner-207 kernel: [19160.571801] Call Trace: Aug 22 10:43:06 juju-e4d256-prod-github-runner-207 kernel: [19160.572715] Aug 22 10:43:06 juju-e4d256-prod-github-runner-207 kernel: [19160.573597] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:43:06 juju-e4d256-prod-github-runner-207 kernel: [19160.574640] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:43:06 juju-e4d256-prod-github-runner-207 kernel: [19160.575658] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:43:06 juju-e4d256-prod-github-runner-207 kernel: [19160.576736] ? show_regs.part.0+0x23/0x29 Aug 22 10:43:06 juju-e4d256-prod-github-runner-207 kernel: [19160.577730] ? show_regs.cold+0x8/0xd Aug 22 10:43:06 juju-e4d256-prod-github-runner-207 kernel: [19160.578717] ? watchdog_timer_fn+0x1be/0x220 Aug 22 10:43:06 juju-e4d256-prod-github-runner-207 kernel: [19160.579727] ? lockup_detector_update_enable+0x60/0x60 Aug 22 10:43:06 juju-e4d256-prod-github-runner-207 kernel: [19160.580792] ? __hrtimer_run_queues+0x107/0x230 Aug 22 10:43:06 juju-e4d256-prod-github-runner-207 kernel: [19160.581825] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 10:43:06 juju-e4d256-prod-github-runner-207 kernel: [19160.582866] ? hrtimer_interrupt+0x101/0x220 Aug 22 10:43:06 juju-e4d256-prod-github-runner-207 kernel: [19160.583881] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 10:43:06 juju-e4d256-prod-github-runner-207 kernel: [19160.584948] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 10:43:06 juju-e4d256-prod-github-runner-207 kernel: [19160.585991] Aug 22 10:43:06 juju-e4d256-prod-github-runner-207 kernel: [19160.586854] Aug 22 10:43:06 juju-e4d256-prod-github-runner-207 kernel: [19160.587697] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 10:43:06 juju-e4d256-prod-github-runner-207 kernel: [19160.588734] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:43:06 juju-e4d256-prod-github-runner-207 kernel: [19160.589771] ? _raw_spin_lock+0x22/0x30 Aug 22 10:43:06 juju-e4d256-prod-github-runner-207 kernel: [19160.590728] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:43:06 juju-e4d256-prod-github-runner-207 kernel: [19160.591748] direct_page_fault+0x206/0x310 [kvm] Aug 22 10:43:06 juju-e4d256-prod-github-runner-207 kernel: [19160.592776] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 10:43:06 juju-e4d256-prod-github-runner-207 kernel: [19160.593785] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 10:43:06 juju-e4d256-prod-github-runner-207 kernel: [19160.594796] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 10:43:06 juju-e4d256-prod-github-runner-207 kernel: [19160.595766] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 10:43:06 juju-e4d256-prod-github-runner-207 kernel: [19160.596710] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 10:43:06 juju-e4d256-prod-github-runner-207 kernel: [19160.597692] handle_exit+0x98/0x230 [kvm_amd] Aug 22 10:43:06 juju-e4d256-prod-github-runner-207 kernel: [19160.598586] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 10:43:06 juju-e4d256-prod-github-runner-207 kernel: [19160.599519] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 10:43:06 juju-e4d256-prod-github-runner-207 kernel: [19160.600447] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 10:43:06 juju-e4d256-prod-github-runner-207 kernel: [19160.601350] vcpu_run+0x62/0x2c0 [kvm] Aug 22 10:43:06 juju-e4d256-prod-github-runner-207 kernel: [19160.602160] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 10:43:06 juju-e4d256-prod-github-runner-207 kernel: [19160.602988] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 10:43:06 juju-e4d256-prod-github-runner-207 kernel: [19160.603848] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 10:43:06 juju-e4d256-prod-github-runner-207 kernel: [19160.604649] ? __seccomp_filter+0x4a/0x4a0 Aug 22 10:43:06 juju-e4d256-prod-github-runner-207 kernel: [19160.605390] ? __fget_files+0x86/0xc0 Aug 22 10:43:06 juju-e4d256-prod-github-runner-207 kernel: [19160.606093] __x64_sys_ioctl+0x95/0xd0 Aug 22 10:43:06 juju-e4d256-prod-github-runner-207 kernel: [19160.606796] do_syscall_64+0x5c/0xc0 Aug 22 10:43:06 juju-e4d256-prod-github-runner-207 kernel: [19160.607459] ? do_futex+0x162/0x1f0 Aug 22 10:43:06 juju-e4d256-prod-github-runner-207 kernel: [19160.608106] ? __x64_sys_futex+0x78/0x1e0 Aug 22 10:43:06 juju-e4d256-prod-github-runner-207 kernel: [19160.608779] ? __secure_computing+0xa9/0x120 Aug 22 10:43:06 juju-e4d256-prod-github-runner-207 kernel: [19160.609469] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 10:43:06 juju-e4d256-prod-github-runner-207 kernel: [19160.610227] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:43:06 juju-e4d256-prod-github-runner-207 kernel: [19160.610964] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:43:06 juju-e4d256-prod-github-runner-207 kernel: [19160.611681] ? do_syscall_64+0x69/0xc0 Aug 22 10:43:06 juju-e4d256-prod-github-runner-207 kernel: [19160.612324] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:43:06 juju-e4d256-prod-github-runner-207 kernel: [19160.613032] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:43:06 juju-e4d256-prod-github-runner-207 kernel: [19160.613790] ? do_syscall_64+0x69/0xc0 Aug 22 10:43:06 juju-e4d256-prod-github-runner-207 kernel: [19160.614520] ? do_syscall_64+0x69/0xc0 Aug 22 10:43:06 juju-e4d256-prod-github-runner-207 kernel: [19160.615237] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 10:43:06 juju-e4d256-prod-github-runner-207 kernel: [19160.616036] RIP: 0033:0x7faa5d0edaff Aug 22 10:43:06 juju-e4d256-prod-github-runner-207 kernel: [19160.616725] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 10:43:06 juju-e4d256-prod-github-runner-207 kernel: [19160.619066] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 10:43:06 juju-e4d256-prod-github-runner-207 kernel: [19160.620115] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 10:43:06 juju-e4d256-prod-github-runner-207 kernel: [19160.621157] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 10:43:06 juju-e4d256-prod-github-runner-207 kernel: [19160.622183] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 10:43:06 juju-e4d256-prod-github-runner-207 kernel: [19160.623235] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 10:43:06 juju-e4d256-prod-github-runner-207 kernel: [19160.624132] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 10:43:06 juju-e4d256-prod-github-runner-207 kernel: [19160.625023] Aug 22 10:43:34 juju-e4d256-prod-github-runner-207 kernel: [19188.541983] watchdog: BUG: soft lockup - CPU#1 stuck for 17762s! [qemu-system-x86:6715] Aug 22 10:43:34 juju-e4d256-prod-github-runner-207 kernel: [19188.543768] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 10:43:34 juju-e4d256-prod-github-runner-207 kernel: [19188.544011] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 10:43:34 juju-e4d256-prod-github-runner-207 kernel: [19188.556171] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 10:43:34 juju-e4d256-prod-github-runner-207 kernel: [19188.557514] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 10:43:34 juju-e4d256-prod-github-runner-207 kernel: [19188.558765] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:43:34 juju-e4d256-prod-github-runner-207 kernel: [19188.559820] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 10:43:34 juju-e4d256-prod-github-runner-207 kernel: [19188.562405] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 10:43:34 juju-e4d256-prod-github-runner-207 kernel: [19188.563452] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 10:43:34 juju-e4d256-prod-github-runner-207 kernel: [19188.564611] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 10:43:34 juju-e4d256-prod-github-runner-207 kernel: [19188.565779] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 10:43:34 juju-e4d256-prod-github-runner-207 kernel: [19188.566957] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 10:43:34 juju-e4d256-prod-github-runner-207 kernel: [19188.568120] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 10:43:34 juju-e4d256-prod-github-runner-207 kernel: [19188.569285] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 10:43:34 juju-e4d256-prod-github-runner-207 kernel: [19188.570544] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 10:43:34 juju-e4d256-prod-github-runner-207 kernel: [19188.571708] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 10:43:34 juju-e4d256-prod-github-runner-207 kernel: [19188.572921] Call Trace: Aug 22 10:43:34 juju-e4d256-prod-github-runner-207 kernel: [19188.573844] Aug 22 10:43:34 juju-e4d256-prod-github-runner-207 kernel: [19188.574766] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:43:34 juju-e4d256-prod-github-runner-207 kernel: [19188.575833] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:43:34 juju-e4d256-prod-github-runner-207 kernel: [19188.576866] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:43:34 juju-e4d256-prod-github-runner-207 kernel: [19188.577965] ? show_regs.part.0+0x23/0x29 Aug 22 10:43:34 juju-e4d256-prod-github-runner-207 kernel: [19188.579036] ? show_regs.cold+0x8/0xd Aug 22 10:43:34 juju-e4d256-prod-github-runner-207 kernel: [19188.580045] ? watchdog_timer_fn+0x1be/0x220 Aug 22 10:43:34 juju-e4d256-prod-github-runner-207 kernel: [19188.581088] ? lockup_detector_update_enable+0x60/0x60 Aug 22 10:43:34 juju-e4d256-prod-github-runner-207 kernel: [19188.582175] ? __hrtimer_run_queues+0x107/0x230 Aug 22 10:43:34 juju-e4d256-prod-github-runner-207 kernel: [19188.583231] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 10:43:34 juju-e4d256-prod-github-runner-207 kernel: [19188.584257] ? hrtimer_interrupt+0x101/0x220 Aug 22 10:43:34 juju-e4d256-prod-github-runner-207 kernel: [19188.585274] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 10:43:34 juju-e4d256-prod-github-runner-207 kernel: [19188.586374] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 10:43:34 juju-e4d256-prod-github-runner-207 kernel: [19188.587445] Aug 22 10:43:34 juju-e4d256-prod-github-runner-207 kernel: [19188.588344] Aug 22 10:43:34 juju-e4d256-prod-github-runner-207 kernel: [19188.589192] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 10:43:34 juju-e4d256-prod-github-runner-207 kernel: [19188.590269] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:43:34 juju-e4d256-prod-github-runner-207 kernel: [19188.591326] ? _raw_spin_lock+0x22/0x30 Aug 22 10:43:34 juju-e4d256-prod-github-runner-207 kernel: [19188.592283] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:43:34 juju-e4d256-prod-github-runner-207 kernel: [19188.593314] direct_page_fault+0x206/0x310 [kvm] Aug 22 10:43:34 juju-e4d256-prod-github-runner-207 kernel: [19188.594363] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 10:43:34 juju-e4d256-prod-github-runner-207 kernel: [19188.595383] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 10:43:34 juju-e4d256-prod-github-runner-207 kernel: [19188.596406] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 10:43:34 juju-e4d256-prod-github-runner-207 kernel: [19188.597438] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 10:43:34 juju-e4d256-prod-github-runner-207 kernel: [19188.598409] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 10:43:34 juju-e4d256-prod-github-runner-207 kernel: [19188.599402] handle_exit+0x98/0x230 [kvm_amd] Aug 22 10:43:34 juju-e4d256-prod-github-runner-207 kernel: [19188.600302] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 10:43:34 juju-e4d256-prod-github-runner-207 kernel: [19188.601270] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 10:43:34 juju-e4d256-prod-github-runner-207 kernel: [19188.602248] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 10:43:34 juju-e4d256-prod-github-runner-207 kernel: [19188.603172] vcpu_run+0x62/0x2c0 [kvm] Aug 22 10:43:34 juju-e4d256-prod-github-runner-207 kernel: [19188.603987] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 10:43:34 juju-e4d256-prod-github-runner-207 kernel: [19188.604800] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 10:43:34 juju-e4d256-prod-github-runner-207 kernel: [19188.605681] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 10:43:34 juju-e4d256-prod-github-runner-207 kernel: [19188.606503] ? __seccomp_filter+0x4a/0x4a0 Aug 22 10:43:34 juju-e4d256-prod-github-runner-207 kernel: [19188.607275] ? __fget_files+0x86/0xc0 Aug 22 10:43:34 juju-e4d256-prod-github-runner-207 kernel: [19188.607984] __x64_sys_ioctl+0x95/0xd0 Aug 22 10:43:34 juju-e4d256-prod-github-runner-207 kernel: [19188.608683] do_syscall_64+0x5c/0xc0 Aug 22 10:43:34 juju-e4d256-prod-github-runner-207 kernel: [19188.609356] ? do_futex+0x162/0x1f0 Aug 22 10:43:34 juju-e4d256-prod-github-runner-207 kernel: [19188.610010] ? __x64_sys_futex+0x78/0x1e0 Aug 22 10:43:34 juju-e4d256-prod-github-runner-207 kernel: [19188.610707] ? __secure_computing+0xa9/0x120 Aug 22 10:43:34 juju-e4d256-prod-github-runner-207 kernel: [19188.611414] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 10:43:34 juju-e4d256-prod-github-runner-207 kernel: [19188.612191] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:43:34 juju-e4d256-prod-github-runner-207 kernel: [19188.612928] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:43:34 juju-e4d256-prod-github-runner-207 kernel: [19188.613651] ? do_syscall_64+0x69/0xc0 Aug 22 10:43:34 juju-e4d256-prod-github-runner-207 kernel: [19188.614331] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:43:34 juju-e4d256-prod-github-runner-207 kernel: [19188.615041] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:43:34 juju-e4d256-prod-github-runner-207 kernel: [19188.615741] ? do_syscall_64+0x69/0xc0 Aug 22 10:43:34 juju-e4d256-prod-github-runner-207 kernel: [19188.616383] ? do_syscall_64+0x69/0xc0 Aug 22 10:43:34 juju-e4d256-prod-github-runner-207 kernel: [19188.617011] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 10:43:34 juju-e4d256-prod-github-runner-207 kernel: [19188.617778] RIP: 0033:0x7faa5d0edaff Aug 22 10:43:34 juju-e4d256-prod-github-runner-207 kernel: [19188.618470] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 10:43:34 juju-e4d256-prod-github-runner-207 kernel: [19188.620473] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 10:43:34 juju-e4d256-prod-github-runner-207 kernel: [19188.621401] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 10:43:34 juju-e4d256-prod-github-runner-207 kernel: [19188.622327] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 10:43:34 juju-e4d256-prod-github-runner-207 kernel: [19188.623228] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 10:43:34 juju-e4d256-prod-github-runner-207 kernel: [19188.624119] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 10:43:34 juju-e4d256-prod-github-runner-207 kernel: [19188.625009] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 10:43:34 juju-e4d256-prod-github-runner-207 kernel: [19188.625904] Aug 22 10:44:02 juju-e4d256-prod-github-runner-207 kernel: [19216.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 17788s! [qemu-system-x86:6715] Aug 22 10:44:02 juju-e4d256-prod-github-runner-207 kernel: [19216.543109] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 10:44:02 juju-e4d256-prod-github-runner-207 kernel: [19216.543181] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 10:44:02 juju-e4d256-prod-github-runner-207 kernel: [19216.555720] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 10:44:02 juju-e4d256-prod-github-runner-207 kernel: [19216.557012] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 10:44:02 juju-e4d256-prod-github-runner-207 kernel: [19216.558262] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:44:02 juju-e4d256-prod-github-runner-207 kernel: [19216.559334] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 10:44:02 juju-e4d256-prod-github-runner-207 kernel: [19216.561908] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 10:44:02 juju-e4d256-prod-github-runner-207 kernel: [19216.562978] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 10:44:02 juju-e4d256-prod-github-runner-207 kernel: [19216.564155] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 10:44:02 juju-e4d256-prod-github-runner-207 kernel: [19216.565330] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 10:44:02 juju-e4d256-prod-github-runner-207 kernel: [19216.566526] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 10:44:02 juju-e4d256-prod-github-runner-207 kernel: [19216.567699] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 10:44:02 juju-e4d256-prod-github-runner-207 kernel: [19216.568876] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 10:44:02 juju-e4d256-prod-github-runner-207 kernel: [19216.570132] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 10:44:02 juju-e4d256-prod-github-runner-207 kernel: [19216.571242] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 10:44:02 juju-e4d256-prod-github-runner-207 kernel: [19216.572457] Call Trace: Aug 22 10:44:02 juju-e4d256-prod-github-runner-207 kernel: [19216.573372] Aug 22 10:44:02 juju-e4d256-prod-github-runner-207 kernel: [19216.574271] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:44:02 juju-e4d256-prod-github-runner-207 kernel: [19216.575308] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:44:02 juju-e4d256-prod-github-runner-207 kernel: [19216.576344] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:44:02 juju-e4d256-prod-github-runner-207 kernel: [19216.577426] ? show_regs.part.0+0x23/0x29 Aug 22 10:44:02 juju-e4d256-prod-github-runner-207 kernel: [19216.578447] ? show_regs.cold+0x8/0xd Aug 22 10:44:02 juju-e4d256-prod-github-runner-207 kernel: [19216.579424] ? watchdog_timer_fn+0x1be/0x220 Aug 22 10:44:02 juju-e4d256-prod-github-runner-207 kernel: [19216.580437] ? lockup_detector_update_enable+0x60/0x60 Aug 22 10:44:02 juju-e4d256-prod-github-runner-207 kernel: [19216.581516] ? __hrtimer_run_queues+0x107/0x230 Aug 22 10:44:02 juju-e4d256-prod-github-runner-207 kernel: [19216.582568] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 10:44:02 juju-e4d256-prod-github-runner-207 kernel: [19216.583606] ? hrtimer_interrupt+0x101/0x220 Aug 22 10:44:02 juju-e4d256-prod-github-runner-207 kernel: [19216.584628] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 10:44:02 juju-e4d256-prod-github-runner-207 kernel: [19216.585710] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 10:44:02 juju-e4d256-prod-github-runner-207 kernel: [19216.586776] Aug 22 10:44:02 juju-e4d256-prod-github-runner-207 kernel: [19216.587638] Aug 22 10:44:02 juju-e4d256-prod-github-runner-207 kernel: [19216.588477] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 10:44:02 juju-e4d256-prod-github-runner-207 kernel: [19216.589520] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:44:02 juju-e4d256-prod-github-runner-207 kernel: [19216.590591] ? _raw_spin_lock+0x22/0x30 Aug 22 10:44:02 juju-e4d256-prod-github-runner-207 kernel: [19216.591543] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:44:02 juju-e4d256-prod-github-runner-207 kernel: [19216.592570] direct_page_fault+0x206/0x310 [kvm] Aug 22 10:44:02 juju-e4d256-prod-github-runner-207 kernel: [19216.593605] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 10:44:02 juju-e4d256-prod-github-runner-207 kernel: [19216.594630] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 10:44:02 juju-e4d256-prod-github-runner-207 kernel: [19216.595634] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 10:44:02 juju-e4d256-prod-github-runner-207 kernel: [19216.596610] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 10:44:02 juju-e4d256-prod-github-runner-207 kernel: [19216.597557] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 10:44:02 juju-e4d256-prod-github-runner-207 kernel: [19216.598547] handle_exit+0x98/0x230 [kvm_amd] Aug 22 10:44:02 juju-e4d256-prod-github-runner-207 kernel: [19216.599440] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 10:44:02 juju-e4d256-prod-github-runner-207 kernel: [19216.600358] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 10:44:02 juju-e4d256-prod-github-runner-207 kernel: [19216.601282] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 10:44:02 juju-e4d256-prod-github-runner-207 kernel: [19216.602203] vcpu_run+0x62/0x2c0 [kvm] Aug 22 10:44:02 juju-e4d256-prod-github-runner-207 kernel: [19216.603029] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 10:44:02 juju-e4d256-prod-github-runner-207 kernel: [19216.603837] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 10:44:02 juju-e4d256-prod-github-runner-207 kernel: [19216.604694] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 10:44:02 juju-e4d256-prod-github-runner-207 kernel: [19216.605491] ? __seccomp_filter+0x4a/0x4a0 Aug 22 10:44:02 juju-e4d256-prod-github-runner-207 kernel: [19216.606249] ? __fget_files+0x86/0xc0 Aug 22 10:44:02 juju-e4d256-prod-github-runner-207 kernel: [19216.606958] __x64_sys_ioctl+0x95/0xd0 Aug 22 10:44:02 juju-e4d256-prod-github-runner-207 kernel: [19216.607649] do_syscall_64+0x5c/0xc0 Aug 22 10:44:02 juju-e4d256-prod-github-runner-207 kernel: [19216.608322] ? do_futex+0x162/0x1f0 Aug 22 10:44:02 juju-e4d256-prod-github-runner-207 kernel: [19216.608975] ? __x64_sys_futex+0x78/0x1e0 Aug 22 10:44:02 juju-e4d256-prod-github-runner-207 kernel: [19216.609652] ? __secure_computing+0xa9/0x120 Aug 22 10:44:02 juju-e4d256-prod-github-runner-207 kernel: [19216.610351] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 10:44:02 juju-e4d256-prod-github-runner-207 kernel: [19216.611120] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:44:02 juju-e4d256-prod-github-runner-207 kernel: [19216.611840] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:44:02 juju-e4d256-prod-github-runner-207 kernel: [19216.612562] ? do_syscall_64+0x69/0xc0 Aug 22 10:44:02 juju-e4d256-prod-github-runner-207 kernel: [19216.613213] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:44:02 juju-e4d256-prod-github-runner-207 kernel: [19216.613915] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:44:02 juju-e4d256-prod-github-runner-207 kernel: [19216.614626] ? do_syscall_64+0x69/0xc0 Aug 22 10:44:02 juju-e4d256-prod-github-runner-207 kernel: [19216.615249] ? do_syscall_64+0x69/0xc0 Aug 22 10:44:02 juju-e4d256-prod-github-runner-207 kernel: [19216.615874] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 10:44:02 juju-e4d256-prod-github-runner-207 kernel: [19216.616582] RIP: 0033:0x7faa5d0edaff Aug 22 10:44:02 juju-e4d256-prod-github-runner-207 kernel: [19216.617207] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 10:44:02 juju-e4d256-prod-github-runner-207 kernel: [19216.619207] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 10:44:02 juju-e4d256-prod-github-runner-207 kernel: [19216.620115] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 10:44:02 juju-e4d256-prod-github-runner-207 kernel: [19216.621001] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 10:44:02 juju-e4d256-prod-github-runner-207 kernel: [19216.621893] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 10:44:02 juju-e4d256-prod-github-runner-207 kernel: [19216.622794] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 10:44:02 juju-e4d256-prod-github-runner-207 kernel: [19216.623698] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 10:44:02 juju-e4d256-prod-github-runner-207 kernel: [19216.624595] Aug 22 10:44:30 juju-e4d256-prod-github-runner-207 kernel: [19244.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 17814s! [qemu-system-x86:6715] Aug 22 10:44:30 juju-e4d256-prod-github-runner-207 kernel: [19244.543104] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 10:44:30 juju-e4d256-prod-github-runner-207 kernel: [19244.543172] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 10:44:30 juju-e4d256-prod-github-runner-207 kernel: [19244.555374] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 10:44:30 juju-e4d256-prod-github-runner-207 kernel: [19244.556753] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 10:44:30 juju-e4d256-prod-github-runner-207 kernel: [19244.558083] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:44:30 juju-e4d256-prod-github-runner-207 kernel: [19244.559154] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 10:44:30 juju-e4d256-prod-github-runner-207 kernel: [19244.561751] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 10:44:30 juju-e4d256-prod-github-runner-207 kernel: [19244.562817] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 10:44:30 juju-e4d256-prod-github-runner-207 kernel: [19244.563978] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 10:44:30 juju-e4d256-prod-github-runner-207 kernel: [19244.565275] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 10:44:30 juju-e4d256-prod-github-runner-207 kernel: [19244.566517] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 10:44:30 juju-e4d256-prod-github-runner-207 kernel: [19244.567681] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 10:44:30 juju-e4d256-prod-github-runner-207 kernel: [19244.568845] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 10:44:30 juju-e4d256-prod-github-runner-207 kernel: [19244.570143] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 10:44:30 juju-e4d256-prod-github-runner-207 kernel: [19244.571247] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 10:44:30 juju-e4d256-prod-github-runner-207 kernel: [19244.572440] Call Trace: Aug 22 10:44:30 juju-e4d256-prod-github-runner-207 kernel: [19244.573351] Aug 22 10:44:30 juju-e4d256-prod-github-runner-207 kernel: [19244.574524] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:44:30 juju-e4d256-prod-github-runner-207 kernel: [19244.575560] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:44:30 juju-e4d256-prod-github-runner-207 kernel: [19244.576582] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:44:30 juju-e4d256-prod-github-runner-207 kernel: [19244.577699] ? show_regs.part.0+0x23/0x29 Aug 22 10:44:30 juju-e4d256-prod-github-runner-207 kernel: [19244.578745] ? show_regs.cold+0x8/0xd Aug 22 10:44:30 juju-e4d256-prod-github-runner-207 kernel: [19244.579717] ? watchdog_timer_fn+0x1be/0x220 Aug 22 10:44:30 juju-e4d256-prod-github-runner-207 kernel: [19244.580725] ? lockup_detector_update_enable+0x60/0x60 Aug 22 10:44:30 juju-e4d256-prod-github-runner-207 kernel: [19244.581883] ? __hrtimer_run_queues+0x107/0x230 Aug 22 10:44:30 juju-e4d256-prod-github-runner-207 kernel: [19244.582916] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 10:44:30 juju-e4d256-prod-github-runner-207 kernel: [19244.583945] ? hrtimer_interrupt+0x101/0x220 Aug 22 10:44:30 juju-e4d256-prod-github-runner-207 kernel: [19244.584959] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 10:44:30 juju-e4d256-prod-github-runner-207 kernel: [19244.586092] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 10:44:30 juju-e4d256-prod-github-runner-207 kernel: [19244.587335] Aug 22 10:44:30 juju-e4d256-prod-github-runner-207 kernel: [19244.588189] Aug 22 10:44:30 juju-e4d256-prod-github-runner-207 kernel: [19244.589026] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 10:44:30 juju-e4d256-prod-github-runner-207 kernel: [19244.590133] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:44:30 juju-e4d256-prod-github-runner-207 kernel: [19244.591177] ? _raw_spin_lock+0x22/0x30 Aug 22 10:44:30 juju-e4d256-prod-github-runner-207 kernel: [19244.592122] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:44:30 juju-e4d256-prod-github-runner-207 kernel: [19244.593146] direct_page_fault+0x206/0x310 [kvm] Aug 22 10:44:30 juju-e4d256-prod-github-runner-207 kernel: [19244.594290] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 10:44:30 juju-e4d256-prod-github-runner-207 kernel: [19244.595306] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 10:44:30 juju-e4d256-prod-github-runner-207 kernel: [19244.596307] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 10:44:30 juju-e4d256-prod-github-runner-207 kernel: [19244.597275] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 10:44:30 juju-e4d256-prod-github-runner-207 kernel: [19244.598308] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 10:44:30 juju-e4d256-prod-github-runner-207 kernel: [19244.599293] handle_exit+0x98/0x230 [kvm_amd] Aug 22 10:44:30 juju-e4d256-prod-github-runner-207 kernel: [19244.600187] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 10:44:30 juju-e4d256-prod-github-runner-207 kernel: [19244.601107] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 10:44:30 juju-e4d256-prod-github-runner-207 kernel: [19244.602117] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 10:44:30 juju-e4d256-prod-github-runner-207 kernel: [19244.603051] vcpu_run+0x62/0x2c0 [kvm] Aug 22 10:44:30 juju-e4d256-prod-github-runner-207 kernel: [19244.603870] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 10:44:30 juju-e4d256-prod-github-runner-207 kernel: [19244.604678] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 10:44:30 juju-e4d256-prod-github-runner-207 kernel: [19244.605534] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 10:44:30 juju-e4d256-prod-github-runner-207 kernel: [19244.606403] ? __seccomp_filter+0x4a/0x4a0 Aug 22 10:44:30 juju-e4d256-prod-github-runner-207 kernel: [19244.607152] ? __fget_files+0x86/0xc0 Aug 22 10:44:30 juju-e4d256-prod-github-runner-207 kernel: [19244.607855] __x64_sys_ioctl+0x95/0xd0 Aug 22 10:44:30 juju-e4d256-prod-github-runner-207 kernel: [19244.608547] do_syscall_64+0x5c/0xc0 Aug 22 10:44:30 juju-e4d256-prod-github-runner-207 kernel: [19244.609214] ? do_futex+0x162/0x1f0 Aug 22 10:44:30 juju-e4d256-prod-github-runner-207 kernel: [19244.609950] ? __x64_sys_futex+0x78/0x1e0 Aug 22 10:44:30 juju-e4d256-prod-github-runner-207 kernel: [19244.610630] ? __secure_computing+0xa9/0x120 Aug 22 10:44:30 juju-e4d256-prod-github-runner-207 kernel: [19244.611319] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 10:44:30 juju-e4d256-prod-github-runner-207 kernel: [19244.612085] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:44:30 juju-e4d256-prod-github-runner-207 kernel: [19244.612806] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:44:30 juju-e4d256-prod-github-runner-207 kernel: [19244.613545] ? do_syscall_64+0x69/0xc0 Aug 22 10:44:30 juju-e4d256-prod-github-runner-207 kernel: [19244.614231] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:44:30 juju-e4d256-prod-github-runner-207 kernel: [19244.614941] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:44:30 juju-e4d256-prod-github-runner-207 kernel: [19244.615638] ? do_syscall_64+0x69/0xc0 Aug 22 10:44:30 juju-e4d256-prod-github-runner-207 kernel: [19244.616269] ? do_syscall_64+0x69/0xc0 Aug 22 10:44:30 juju-e4d256-prod-github-runner-207 kernel: [19244.616897] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 10:44:30 juju-e4d256-prod-github-runner-207 kernel: [19244.617638] RIP: 0033:0x7faa5d0edaff Aug 22 10:44:30 juju-e4d256-prod-github-runner-207 kernel: [19244.618355] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 10:44:30 juju-e4d256-prod-github-runner-207 kernel: [19244.620349] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 10:44:30 juju-e4d256-prod-github-runner-207 kernel: [19244.621269] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 10:44:30 juju-e4d256-prod-github-runner-207 kernel: [19244.622223] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 10:44:30 juju-e4d256-prod-github-runner-207 kernel: [19244.623113] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 10:44:30 juju-e4d256-prod-github-runner-207 kernel: [19244.624001] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 10:44:30 juju-e4d256-prod-github-runner-207 kernel: [19244.624894] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 10:44:30 juju-e4d256-prod-github-runner-207 kernel: [19244.625864] Aug 22 10:44:44 juju-e4d256-prod-github-runner-207 kernel: [19258.472706] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 10:44:44 juju-e4d256-prod-github-runner-207 kernel: [19258.473764] rcu: 1-....: (4770416 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=2310172 Aug 22 10:44:44 juju-e4d256-prod-github-runner-207 kernel: [19258.474885] (t=4785318 jiffies g=23269 q=25464) Aug 22 10:44:44 juju-e4d256-prod-github-runner-207 kernel: [19258.475671] NMI backtrace for cpu 1 Aug 22 10:44:44 juju-e4d256-prod-github-runner-207 kernel: [19258.476378] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 10:44:44 juju-e4d256-prod-github-runner-207 kernel: [19258.477500] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 10:44:44 juju-e4d256-prod-github-runner-207 kernel: [19258.478560] Call Trace: Aug 22 10:44:44 juju-e4d256-prod-github-runner-207 kernel: [19258.479238] Aug 22 10:44:44 juju-e4d256-prod-github-runner-207 kernel: [19258.479881] show_stack+0x52/0x5c Aug 22 10:44:44 juju-e4d256-prod-github-runner-207 kernel: [19258.480604] dump_stack_lvl+0x4a/0x63 Aug 22 10:44:44 juju-e4d256-prod-github-runner-207 kernel: [19258.481352] dump_stack+0x10/0x16 Aug 22 10:44:44 juju-e4d256-prod-github-runner-207 kernel: [19258.482082] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 10:44:44 juju-e4d256-prod-github-runner-207 kernel: [19258.482862] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 10:44:44 juju-e4d256-prod-github-runner-207 kernel: [19258.483638] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 10:44:44 juju-e4d256-prod-github-runner-207 kernel: [19258.484456] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 10:44:44 juju-e4d256-prod-github-runner-207 kernel: [19258.485279] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 10:44:44 juju-e4d256-prod-github-runner-207 kernel: [19258.486099] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 10:44:44 juju-e4d256-prod-github-runner-207 kernel: [19258.486869] print_cpu_stall.cold+0x2f/0xe2 Aug 22 10:44:44 juju-e4d256-prod-github-runner-207 kernel: [19258.487631] ? timekeeping_update+0xf7/0x150 Aug 22 10:44:44 juju-e4d256-prod-github-runner-207 kernel: [19258.488404] check_cpu_stall+0x109/0x270 Aug 22 10:44:44 juju-e4d256-prod-github-runner-207 kernel: [19258.489149] rcu_sched_clock_irq+0x9a/0x250 Aug 22 10:44:44 juju-e4d256-prod-github-runner-207 kernel: [19258.489922] update_process_times+0x94/0xd0 Aug 22 10:44:44 juju-e4d256-prod-github-runner-207 kernel: [19258.490680] tick_sched_handle+0x29/0x70 Aug 22 10:44:44 juju-e4d256-prod-github-runner-207 kernel: [19258.491423] tick_sched_timer+0x8c/0xc0 Aug 22 10:44:44 juju-e4d256-prod-github-runner-207 kernel: [19258.492157] ? tick_nohz_handler+0xb0/0xb0 Aug 22 10:44:44 juju-e4d256-prod-github-runner-207 kernel: [19258.492911] __hrtimer_run_queues+0x107/0x230 Aug 22 10:44:44 juju-e4d256-prod-github-runner-207 kernel: [19258.493693] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 10:44:44 juju-e4d256-prod-github-runner-207 kernel: [19258.494467] hrtimer_interrupt+0x101/0x220 Aug 22 10:44:44 juju-e4d256-prod-github-runner-207 kernel: [19258.495223] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 10:44:44 juju-e4d256-prod-github-runner-207 kernel: [19258.496034] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 10:44:44 juju-e4d256-prod-github-runner-207 kernel: [19258.496833] Aug 22 10:44:44 juju-e4d256-prod-github-runner-207 kernel: [19258.497476] Aug 22 10:44:44 juju-e4d256-prod-github-runner-207 kernel: [19258.498103] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 10:44:44 juju-e4d256-prod-github-runner-207 kernel: [19258.498917] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:44:44 juju-e4d256-prod-github-runner-207 kernel: [19258.499793] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 10:44:44 juju-e4d256-prod-github-runner-207 kernel: [19258.502020] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 10:44:44 juju-e4d256-prod-github-runner-207 kernel: [19258.502893] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 10:44:44 juju-e4d256-prod-github-runner-207 kernel: [19258.503882] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 10:44:44 juju-e4d256-prod-github-runner-207 kernel: [19258.504859] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 10:44:44 juju-e4d256-prod-github-runner-207 kernel: [19258.505834] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 10:44:44 juju-e4d256-prod-github-runner-207 kernel: [19258.506794] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 10:44:44 juju-e4d256-prod-github-runner-207 kernel: [19258.507744] ? _raw_spin_lock+0x22/0x30 Aug 22 10:44:44 juju-e4d256-prod-github-runner-207 kernel: [19258.508505] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:44:44 juju-e4d256-prod-github-runner-207 kernel: [19258.509358] direct_page_fault+0x206/0x310 [kvm] Aug 22 10:44:44 juju-e4d256-prod-github-runner-207 kernel: [19258.510209] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 10:44:44 juju-e4d256-prod-github-runner-207 kernel: [19258.511034] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 10:44:44 juju-e4d256-prod-github-runner-207 kernel: [19258.511870] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 10:44:44 juju-e4d256-prod-github-runner-207 kernel: [19258.512686] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 10:44:44 juju-e4d256-prod-github-runner-207 kernel: [19258.513489] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 10:44:44 juju-e4d256-prod-github-runner-207 kernel: [19258.514311] handle_exit+0x98/0x230 [kvm_amd] Aug 22 10:44:44 juju-e4d256-prod-github-runner-207 kernel: [19258.515063] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 10:44:44 juju-e4d256-prod-github-runner-207 kernel: [19258.515846] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 10:44:44 juju-e4d256-prod-github-runner-207 kernel: [19258.516651] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 10:44:44 juju-e4d256-prod-github-runner-207 kernel: [19258.517457] vcpu_run+0x62/0x2c0 [kvm] Aug 22 10:44:44 juju-e4d256-prod-github-runner-207 kernel: [19258.518171] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 10:44:44 juju-e4d256-prod-github-runner-207 kernel: [19258.518903] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 10:44:44 juju-e4d256-prod-github-runner-207 kernel: [19258.519703] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 10:44:44 juju-e4d256-prod-github-runner-207 kernel: [19258.520467] ? __seccomp_filter+0x4a/0x4a0 Aug 22 10:44:44 juju-e4d256-prod-github-runner-207 kernel: [19258.521187] ? __fget_files+0x86/0xc0 Aug 22 10:44:44 juju-e4d256-prod-github-runner-207 kernel: [19258.521892] __x64_sys_ioctl+0x95/0xd0 Aug 22 10:44:44 juju-e4d256-prod-github-runner-207 kernel: [19258.522586] do_syscall_64+0x5c/0xc0 Aug 22 10:44:44 juju-e4d256-prod-github-runner-207 kernel: [19258.523265] ? do_futex+0x162/0x1f0 Aug 22 10:44:44 juju-e4d256-prod-github-runner-207 kernel: [19258.523936] ? __x64_sys_futex+0x78/0x1e0 Aug 22 10:44:44 juju-e4d256-prod-github-runner-207 kernel: [19258.524636] ? __secure_computing+0xa9/0x120 Aug 22 10:44:44 juju-e4d256-prod-github-runner-207 kernel: [19258.525352] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 10:44:44 juju-e4d256-prod-github-runner-207 kernel: [19258.526158] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:44:44 juju-e4d256-prod-github-runner-207 kernel: [19258.526913] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:44:44 juju-e4d256-prod-github-runner-207 kernel: [19258.527665] ? do_syscall_64+0x69/0xc0 Aug 22 10:44:44 juju-e4d256-prod-github-runner-207 kernel: [19258.528353] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:44:44 juju-e4d256-prod-github-runner-207 kernel: [19258.529107] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:44:44 juju-e4d256-prod-github-runner-207 kernel: [19258.529882] ? do_syscall_64+0x69/0xc0 Aug 22 10:44:44 juju-e4d256-prod-github-runner-207 kernel: [19258.530580] ? do_syscall_64+0x69/0xc0 Aug 22 10:44:44 juju-e4d256-prod-github-runner-207 kernel: [19258.531267] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 10:44:44 juju-e4d256-prod-github-runner-207 kernel: [19258.532035] RIP: 0033:0x7faa5d0edaff Aug 22 10:44:44 juju-e4d256-prod-github-runner-207 kernel: [19258.532730] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 10:44:44 juju-e4d256-prod-github-runner-207 kernel: [19258.534952] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 10:44:44 juju-e4d256-prod-github-runner-207 kernel: [19258.535914] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 10:44:44 juju-e4d256-prod-github-runner-207 kernel: [19258.536860] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 10:44:44 juju-e4d256-prod-github-runner-207 kernel: [19258.537824] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 10:44:44 juju-e4d256-prod-github-runner-207 kernel: [19258.538764] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 10:44:44 juju-e4d256-prod-github-runner-207 kernel: [19258.539689] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 10:44:44 juju-e4d256-prod-github-runner-207 kernel: [19258.540602] Aug 22 10:45:10 juju-e4d256-prod-github-runner-207 kernel: [19284.541981] watchdog: BUG: soft lockup - CPU#1 stuck for 17852s! [qemu-system-x86:6715] Aug 22 10:45:10 juju-e4d256-prod-github-runner-207 kernel: [19284.543847] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 10:45:10 juju-e4d256-prod-github-runner-207 kernel: [19284.544121] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 10:45:10 juju-e4d256-prod-github-runner-207 kernel: [19284.556659] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 10:45:10 juju-e4d256-prod-github-runner-207 kernel: [19284.557987] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 10:45:10 juju-e4d256-prod-github-runner-207 kernel: [19284.559264] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:45:10 juju-e4d256-prod-github-runner-207 kernel: [19284.560337] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 10:45:10 juju-e4d256-prod-github-runner-207 kernel: [19284.562978] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 10:45:10 juju-e4d256-prod-github-runner-207 kernel: [19284.564050] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 10:45:10 juju-e4d256-prod-github-runner-207 kernel: [19284.565252] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 10:45:10 juju-e4d256-prod-github-runner-207 kernel: [19284.566455] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 10:45:10 juju-e4d256-prod-github-runner-207 kernel: [19284.567660] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 10:45:10 juju-e4d256-prod-github-runner-207 kernel: [19284.568880] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 10:45:10 juju-e4d256-prod-github-runner-207 kernel: [19284.570103] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 10:45:10 juju-e4d256-prod-github-runner-207 kernel: [19284.571373] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 10:45:10 juju-e4d256-prod-github-runner-207 kernel: [19284.572501] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 10:45:10 juju-e4d256-prod-github-runner-207 kernel: [19284.573800] Call Trace: Aug 22 10:45:10 juju-e4d256-prod-github-runner-207 kernel: [19284.574734] Aug 22 10:45:10 juju-e4d256-prod-github-runner-207 kernel: [19284.575647] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:45:10 juju-e4d256-prod-github-runner-207 kernel: [19284.576691] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:45:10 juju-e4d256-prod-github-runner-207 kernel: [19284.577774] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:45:10 juju-e4d256-prod-github-runner-207 kernel: [19284.578924] ? show_regs.part.0+0x23/0x29 Aug 22 10:45:10 juju-e4d256-prod-github-runner-207 kernel: [19284.579941] ? show_regs.cold+0x8/0xd Aug 22 10:45:10 juju-e4d256-prod-github-runner-207 kernel: [19284.580926] ? watchdog_timer_fn+0x1be/0x220 Aug 22 10:45:10 juju-e4d256-prod-github-runner-207 kernel: [19284.581969] ? lockup_detector_update_enable+0x60/0x60 Aug 22 10:45:10 juju-e4d256-prod-github-runner-207 kernel: [19284.583058] ? __hrtimer_run_queues+0x107/0x230 Aug 22 10:45:10 juju-e4d256-prod-github-runner-207 kernel: [19284.584133] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 10:45:10 juju-e4d256-prod-github-runner-207 kernel: [19284.585207] ? hrtimer_interrupt+0x101/0x220 Aug 22 10:45:10 juju-e4d256-prod-github-runner-207 kernel: [19284.586237] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 10:45:10 juju-e4d256-prod-github-runner-207 kernel: [19284.587322] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 10:45:10 juju-e4d256-prod-github-runner-207 kernel: [19284.588403] Aug 22 10:45:10 juju-e4d256-prod-github-runner-207 kernel: [19284.589317] Aug 22 10:45:10 juju-e4d256-prod-github-runner-207 kernel: [19284.590167] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 10:45:10 juju-e4d256-prod-github-runner-207 kernel: [19284.591222] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:45:10 juju-e4d256-prod-github-runner-207 kernel: [19284.592467] ? _raw_spin_lock+0x22/0x30 Aug 22 10:45:10 juju-e4d256-prod-github-runner-207 kernel: [19284.593454] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:45:10 juju-e4d256-prod-github-runner-207 kernel: [19284.594523] direct_page_fault+0x206/0x310 [kvm] Aug 22 10:45:10 juju-e4d256-prod-github-runner-207 kernel: [19284.595576] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 10:45:10 juju-e4d256-prod-github-runner-207 kernel: [19284.596601] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 10:45:10 juju-e4d256-prod-github-runner-207 kernel: [19284.597801] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 10:45:10 juju-e4d256-prod-github-runner-207 kernel: [19284.598847] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 10:45:10 juju-e4d256-prod-github-runner-207 kernel: [19284.599885] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 10:45:10 juju-e4d256-prod-github-runner-207 kernel: [19284.600893] handle_exit+0x98/0x230 [kvm_amd] Aug 22 10:45:10 juju-e4d256-prod-github-runner-207 kernel: [19284.601826] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 10:45:10 juju-e4d256-prod-github-runner-207 kernel: [19284.602758] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 10:45:10 juju-e4d256-prod-github-runner-207 kernel: [19284.603711] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 10:45:10 juju-e4d256-prod-github-runner-207 kernel: [19284.604648] vcpu_run+0x62/0x2c0 [kvm] Aug 22 10:45:10 juju-e4d256-prod-github-runner-207 kernel: [19284.605496] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 10:45:10 juju-e4d256-prod-github-runner-207 kernel: [19284.606322] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 10:45:10 juju-e4d256-prod-github-runner-207 kernel: [19284.607194] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 10:45:10 juju-e4d256-prod-github-runner-207 kernel: [19284.608010] ? __seccomp_filter+0x4a/0x4a0 Aug 22 10:45:10 juju-e4d256-prod-github-runner-207 kernel: [19284.608783] ? __fget_files+0x86/0xc0 Aug 22 10:45:10 juju-e4d256-prod-github-runner-207 kernel: [19284.609526] __x64_sys_ioctl+0x95/0xd0 Aug 22 10:45:10 juju-e4d256-prod-github-runner-207 kernel: [19284.610266] do_syscall_64+0x5c/0xc0 Aug 22 10:45:10 juju-e4d256-prod-github-runner-207 kernel: [19284.610946] ? do_futex+0x162/0x1f0 Aug 22 10:45:10 juju-e4d256-prod-github-runner-207 kernel: [19284.611606] ? __x64_sys_futex+0x78/0x1e0 Aug 22 10:45:10 juju-e4d256-prod-github-runner-207 kernel: [19284.612292] ? __secure_computing+0xa9/0x120 Aug 22 10:45:10 juju-e4d256-prod-github-runner-207 kernel: [19284.612996] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 10:45:10 juju-e4d256-prod-github-runner-207 kernel: [19284.613794] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:45:10 juju-e4d256-prod-github-runner-207 kernel: [19284.614547] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:45:10 juju-e4d256-prod-github-runner-207 kernel: [19284.615293] ? do_syscall_64+0x69/0xc0 Aug 22 10:45:10 juju-e4d256-prod-github-runner-207 kernel: [19284.615955] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:45:10 juju-e4d256-prod-github-runner-207 kernel: [19284.616681] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:45:10 juju-e4d256-prod-github-runner-207 kernel: [19284.617416] ? do_syscall_64+0x69/0xc0 Aug 22 10:45:10 juju-e4d256-prod-github-runner-207 kernel: [19284.618059] ? do_syscall_64+0x69/0xc0 Aug 22 10:45:10 juju-e4d256-prod-github-runner-207 kernel: [19284.618697] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 10:45:10 juju-e4d256-prod-github-runner-207 kernel: [19284.619450] RIP: 0033:0x7faa5d0edaff Aug 22 10:45:10 juju-e4d256-prod-github-runner-207 kernel: [19284.620175] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 10:45:10 juju-e4d256-prod-github-runner-207 kernel: [19284.622299] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 10:45:10 juju-e4d256-prod-github-runner-207 kernel: [19284.623253] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 10:45:10 juju-e4d256-prod-github-runner-207 kernel: [19284.624178] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 10:45:10 juju-e4d256-prod-github-runner-207 kernel: [19284.625148] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 10:45:10 juju-e4d256-prod-github-runner-207 kernel: [19284.626204] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 10:45:10 juju-e4d256-prod-github-runner-207 kernel: [19284.627122] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 10:45:10 juju-e4d256-prod-github-runner-207 kernel: [19284.628041] Aug 22 10:45:38 juju-e4d256-prod-github-runner-207 kernel: [19312.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 17878s! [qemu-system-x86:6715] Aug 22 10:45:38 juju-e4d256-prod-github-runner-207 kernel: [19312.543972] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 10:45:38 juju-e4d256-prod-github-runner-207 kernel: [19312.544286] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 10:45:38 juju-e4d256-prod-github-runner-207 kernel: [19312.556494] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 10:45:38 juju-e4d256-prod-github-runner-207 kernel: [19312.557782] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 10:45:38 juju-e4d256-prod-github-runner-207 kernel: [19312.559014] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:45:38 juju-e4d256-prod-github-runner-207 kernel: [19312.560088] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 10:45:38 juju-e4d256-prod-github-runner-207 kernel: [19312.562713] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 10:45:38 juju-e4d256-prod-github-runner-207 kernel: [19312.563772] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 10:45:38 juju-e4d256-prod-github-runner-207 kernel: [19312.564979] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 10:45:38 juju-e4d256-prod-github-runner-207 kernel: [19312.566144] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 10:45:38 juju-e4d256-prod-github-runner-207 kernel: [19312.567305] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 10:45:38 juju-e4d256-prod-github-runner-207 kernel: [19312.568471] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 10:45:38 juju-e4d256-prod-github-runner-207 kernel: [19312.569698] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 10:45:38 juju-e4d256-prod-github-runner-207 kernel: [19312.570945] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 10:45:38 juju-e4d256-prod-github-runner-207 kernel: [19312.572042] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 10:45:38 juju-e4d256-prod-github-runner-207 kernel: [19312.573307] Call Trace: Aug 22 10:45:38 juju-e4d256-prod-github-runner-207 kernel: [19312.574475] Aug 22 10:45:38 juju-e4d256-prod-github-runner-207 kernel: [19312.575404] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:45:38 juju-e4d256-prod-github-runner-207 kernel: [19312.576446] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:45:38 juju-e4d256-prod-github-runner-207 kernel: [19312.577496] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:45:38 juju-e4d256-prod-github-runner-207 kernel: [19312.578603] ? show_regs.part.0+0x23/0x29 Aug 22 10:45:38 juju-e4d256-prod-github-runner-207 kernel: [19312.579617] ? show_regs.cold+0x8/0xd Aug 22 10:45:38 juju-e4d256-prod-github-runner-207 kernel: [19312.580604] ? watchdog_timer_fn+0x1be/0x220 Aug 22 10:45:38 juju-e4d256-prod-github-runner-207 kernel: [19312.581639] ? lockup_detector_update_enable+0x60/0x60 Aug 22 10:45:38 juju-e4d256-prod-github-runner-207 kernel: [19312.582703] ? __hrtimer_run_queues+0x107/0x230 Aug 22 10:45:38 juju-e4d256-prod-github-runner-207 kernel: [19312.583736] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 10:45:38 juju-e4d256-prod-github-runner-207 kernel: [19312.584770] ? hrtimer_interrupt+0x101/0x220 Aug 22 10:45:38 juju-e4d256-prod-github-runner-207 kernel: [19312.585826] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 10:45:38 juju-e4d256-prod-github-runner-207 kernel: [19312.586905] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 10:45:38 juju-e4d256-prod-github-runner-207 kernel: [19312.587951] Aug 22 10:45:38 juju-e4d256-prod-github-runner-207 kernel: [19312.588825] Aug 22 10:45:38 juju-e4d256-prod-github-runner-207 kernel: [19312.589679] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 10:45:38 juju-e4d256-prod-github-runner-207 kernel: [19312.590727] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:45:38 juju-e4d256-prod-github-runner-207 kernel: [19312.591777] ? _raw_spin_lock+0x22/0x30 Aug 22 10:45:38 juju-e4d256-prod-github-runner-207 kernel: [19312.592727] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:45:38 juju-e4d256-prod-github-runner-207 kernel: [19312.593758] direct_page_fault+0x206/0x310 [kvm] Aug 22 10:45:38 juju-e4d256-prod-github-runner-207 kernel: [19312.594815] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 10:45:38 juju-e4d256-prod-github-runner-207 kernel: [19312.595842] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 10:45:38 juju-e4d256-prod-github-runner-207 kernel: [19312.597000] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 10:45:38 juju-e4d256-prod-github-runner-207 kernel: [19312.598033] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 10:45:38 juju-e4d256-prod-github-runner-207 kernel: [19312.598983] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 10:45:38 juju-e4d256-prod-github-runner-207 kernel: [19312.599976] handle_exit+0x98/0x230 [kvm_amd] Aug 22 10:45:38 juju-e4d256-prod-github-runner-207 kernel: [19312.600925] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 10:45:38 juju-e4d256-prod-github-runner-207 kernel: [19312.601874] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 10:45:38 juju-e4d256-prod-github-runner-207 kernel: [19312.602798] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 10:45:38 juju-e4d256-prod-github-runner-207 kernel: [19312.603702] vcpu_run+0x62/0x2c0 [kvm] Aug 22 10:45:38 juju-e4d256-prod-github-runner-207 kernel: [19312.604613] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 10:45:38 juju-e4d256-prod-github-runner-207 kernel: [19312.605612] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 10:45:38 juju-e4d256-prod-github-runner-207 kernel: [19312.606491] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 10:45:38 juju-e4d256-prod-github-runner-207 kernel: [19312.607292] ? __seccomp_filter+0x4a/0x4a0 Aug 22 10:45:38 juju-e4d256-prod-github-runner-207 kernel: [19312.608038] ? __fget_files+0x86/0xc0 Aug 22 10:45:38 juju-e4d256-prod-github-runner-207 kernel: [19312.608745] __x64_sys_ioctl+0x95/0xd0 Aug 22 10:45:38 juju-e4d256-prod-github-runner-207 kernel: [19312.609463] do_syscall_64+0x5c/0xc0 Aug 22 10:45:38 juju-e4d256-prod-github-runner-207 kernel: [19312.610128] ? do_futex+0x162/0x1f0 Aug 22 10:45:38 juju-e4d256-prod-github-runner-207 kernel: [19312.610789] ? __x64_sys_futex+0x78/0x1e0 Aug 22 10:45:38 juju-e4d256-prod-github-runner-207 kernel: [19312.611472] ? __secure_computing+0xa9/0x120 Aug 22 10:45:38 juju-e4d256-prod-github-runner-207 kernel: [19312.612165] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 10:45:38 juju-e4d256-prod-github-runner-207 kernel: [19312.612951] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:45:38 juju-e4d256-prod-github-runner-207 kernel: [19312.613680] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:45:38 juju-e4d256-prod-github-runner-207 kernel: [19312.614398] ? do_syscall_64+0x69/0xc0 Aug 22 10:45:38 juju-e4d256-prod-github-runner-207 kernel: [19312.615042] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:45:38 juju-e4d256-prod-github-runner-207 kernel: [19312.615759] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:45:38 juju-e4d256-prod-github-runner-207 kernel: [19312.616469] ? do_syscall_64+0x69/0xc0 Aug 22 10:45:38 juju-e4d256-prod-github-runner-207 kernel: [19312.617117] ? do_syscall_64+0x69/0xc0 Aug 22 10:45:38 juju-e4d256-prod-github-runner-207 kernel: [19312.617746] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 10:45:38 juju-e4d256-prod-github-runner-207 kernel: [19312.618451] RIP: 0033:0x7faa5d0edaff Aug 22 10:45:38 juju-e4d256-prod-github-runner-207 kernel: [19312.619116] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 10:45:38 juju-e4d256-prod-github-runner-207 kernel: [19312.621135] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 10:45:38 juju-e4d256-prod-github-runner-207 kernel: [19312.622065] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 10:45:38 juju-e4d256-prod-github-runner-207 kernel: [19312.622954] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 10:45:38 juju-e4d256-prod-github-runner-207 kernel: [19312.623840] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 10:45:38 juju-e4d256-prod-github-runner-207 kernel: [19312.624724] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 10:45:38 juju-e4d256-prod-github-runner-207 kernel: [19312.625632] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 10:45:38 juju-e4d256-prod-github-runner-207 kernel: [19312.626537] Aug 22 10:46:06 juju-e4d256-prod-github-runner-207 kernel: [19340.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 17904s! [qemu-system-x86:6715] Aug 22 10:46:06 juju-e4d256-prod-github-runner-207 kernel: [19340.543775] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 10:46:06 juju-e4d256-prod-github-runner-207 kernel: [19340.544029] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 10:46:06 juju-e4d256-prod-github-runner-207 kernel: [19340.556142] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 10:46:06 juju-e4d256-prod-github-runner-207 kernel: [19340.557428] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 10:46:06 juju-e4d256-prod-github-runner-207 kernel: [19340.558648] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:46:06 juju-e4d256-prod-github-runner-207 kernel: [19340.559757] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 10:46:06 juju-e4d256-prod-github-runner-207 kernel: [19340.562457] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 10:46:06 juju-e4d256-prod-github-runner-207 kernel: [19340.563504] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 10:46:06 juju-e4d256-prod-github-runner-207 kernel: [19340.564689] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 10:46:06 juju-e4d256-prod-github-runner-207 kernel: [19340.565852] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 10:46:06 juju-e4d256-prod-github-runner-207 kernel: [19340.567016] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 10:46:06 juju-e4d256-prod-github-runner-207 kernel: [19340.568186] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 10:46:06 juju-e4d256-prod-github-runner-207 kernel: [19340.569371] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 10:46:06 juju-e4d256-prod-github-runner-207 kernel: [19340.570628] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 10:46:06 juju-e4d256-prod-github-runner-207 kernel: [19340.571762] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 10:46:06 juju-e4d256-prod-github-runner-207 kernel: [19340.572991] Call Trace: Aug 22 10:46:06 juju-e4d256-prod-github-runner-207 kernel: [19340.573911] Aug 22 10:46:06 juju-e4d256-prod-github-runner-207 kernel: [19340.574809] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:46:06 juju-e4d256-prod-github-runner-207 kernel: [19340.575847] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:46:06 juju-e4d256-prod-github-runner-207 kernel: [19340.576885] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:46:06 juju-e4d256-prod-github-runner-207 kernel: [19340.577979] ? show_regs.part.0+0x23/0x29 Aug 22 10:46:06 juju-e4d256-prod-github-runner-207 kernel: [19340.578980] ? show_regs.cold+0x8/0xd Aug 22 10:46:06 juju-e4d256-prod-github-runner-207 kernel: [19340.579968] ? watchdog_timer_fn+0x1be/0x220 Aug 22 10:46:06 juju-e4d256-prod-github-runner-207 kernel: [19340.581004] ? lockup_detector_update_enable+0x60/0x60 Aug 22 10:46:06 juju-e4d256-prod-github-runner-207 kernel: [19340.582068] ? __hrtimer_run_queues+0x107/0x230 Aug 22 10:46:06 juju-e4d256-prod-github-runner-207 kernel: [19340.583103] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 10:46:06 juju-e4d256-prod-github-runner-207 kernel: [19340.584191] ? hrtimer_interrupt+0x101/0x220 Aug 22 10:46:06 juju-e4d256-prod-github-runner-207 kernel: [19340.585345] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 10:46:06 juju-e4d256-prod-github-runner-207 kernel: [19340.586428] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 10:46:06 juju-e4d256-prod-github-runner-207 kernel: [19340.587488] Aug 22 10:46:06 juju-e4d256-prod-github-runner-207 kernel: [19340.588347] Aug 22 10:46:06 juju-e4d256-prod-github-runner-207 kernel: [19340.589207] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 10:46:06 juju-e4d256-prod-github-runner-207 kernel: [19340.590245] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:46:06 juju-e4d256-prod-github-runner-207 kernel: [19340.591304] ? _raw_spin_lock+0x22/0x30 Aug 22 10:46:06 juju-e4d256-prod-github-runner-207 kernel: [19340.592254] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:46:06 juju-e4d256-prod-github-runner-207 kernel: [19340.593298] direct_page_fault+0x206/0x310 [kvm] Aug 22 10:46:06 juju-e4d256-prod-github-runner-207 kernel: [19340.594328] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 10:46:06 juju-e4d256-prod-github-runner-207 kernel: [19340.595355] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 10:46:06 juju-e4d256-prod-github-runner-207 kernel: [19340.596370] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 10:46:06 juju-e4d256-prod-github-runner-207 kernel: [19340.597395] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 10:46:06 juju-e4d256-prod-github-runner-207 kernel: [19340.598345] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 10:46:06 juju-e4d256-prod-github-runner-207 kernel: [19340.599341] handle_exit+0x98/0x230 [kvm_amd] Aug 22 10:46:06 juju-e4d256-prod-github-runner-207 kernel: [19340.600240] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 10:46:06 juju-e4d256-prod-github-runner-207 kernel: [19340.601183] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 10:46:06 juju-e4d256-prod-github-runner-207 kernel: [19340.602111] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 10:46:06 juju-e4d256-prod-github-runner-207 kernel: [19340.603021] vcpu_run+0x62/0x2c0 [kvm] Aug 22 10:46:06 juju-e4d256-prod-github-runner-207 kernel: [19340.603842] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 10:46:06 juju-e4d256-prod-github-runner-207 kernel: [19340.604671] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 10:46:06 juju-e4d256-prod-github-runner-207 kernel: [19340.605538] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 10:46:06 juju-e4d256-prod-github-runner-207 kernel: [19340.606348] ? __seccomp_filter+0x4a/0x4a0 Aug 22 10:46:06 juju-e4d256-prod-github-runner-207 kernel: [19340.607089] ? __fget_files+0x86/0xc0 Aug 22 10:46:06 juju-e4d256-prod-github-runner-207 kernel: [19340.607812] __x64_sys_ioctl+0x95/0xd0 Aug 22 10:46:06 juju-e4d256-prod-github-runner-207 kernel: [19340.608525] do_syscall_64+0x5c/0xc0 Aug 22 10:46:06 juju-e4d256-prod-github-runner-207 kernel: [19340.609199] ? do_futex+0x162/0x1f0 Aug 22 10:46:06 juju-e4d256-prod-github-runner-207 kernel: [19340.609854] ? __x64_sys_futex+0x78/0x1e0 Aug 22 10:46:06 juju-e4d256-prod-github-runner-207 kernel: [19340.610525] ? __secure_computing+0xa9/0x120 Aug 22 10:46:06 juju-e4d256-prod-github-runner-207 kernel: [19340.611220] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 10:46:06 juju-e4d256-prod-github-runner-207 kernel: [19340.611994] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:46:06 juju-e4d256-prod-github-runner-207 kernel: [19340.612725] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:46:06 juju-e4d256-prod-github-runner-207 kernel: [19340.613443] ? do_syscall_64+0x69/0xc0 Aug 22 10:46:06 juju-e4d256-prod-github-runner-207 kernel: [19340.614088] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:46:06 juju-e4d256-prod-github-runner-207 kernel: [19340.614796] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:46:06 juju-e4d256-prod-github-runner-207 kernel: [19340.615497] ? do_syscall_64+0x69/0xc0 Aug 22 10:46:06 juju-e4d256-prod-github-runner-207 kernel: [19340.616123] ? do_syscall_64+0x69/0xc0 Aug 22 10:46:06 juju-e4d256-prod-github-runner-207 kernel: [19340.616768] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 10:46:06 juju-e4d256-prod-github-runner-207 kernel: [19340.617477] RIP: 0033:0x7faa5d0edaff Aug 22 10:46:06 juju-e4d256-prod-github-runner-207 kernel: [19340.618135] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 10:46:06 juju-e4d256-prod-github-runner-207 kernel: [19340.620139] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 10:46:06 juju-e4d256-prod-github-runner-207 kernel: [19340.621067] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 10:46:06 juju-e4d256-prod-github-runner-207 kernel: [19340.621960] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 10:46:06 juju-e4d256-prod-github-runner-207 kernel: [19340.622846] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 10:46:06 juju-e4d256-prod-github-runner-207 kernel: [19340.623745] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 10:46:06 juju-e4d256-prod-github-runner-207 kernel: [19340.624660] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 10:46:06 juju-e4d256-prod-github-runner-207 kernel: [19340.625556] Aug 22 10:46:34 juju-e4d256-prod-github-runner-207 kernel: [19368.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 17930s! [qemu-system-x86:6715] Aug 22 10:46:34 juju-e4d256-prod-github-runner-207 kernel: [19368.543735] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 10:46:34 juju-e4d256-prod-github-runner-207 kernel: [19368.543992] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 10:46:34 juju-e4d256-prod-github-runner-207 kernel: [19368.556232] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 10:46:34 juju-e4d256-prod-github-runner-207 kernel: [19368.557499] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 10:46:34 juju-e4d256-prod-github-runner-207 kernel: [19368.558720] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:46:34 juju-e4d256-prod-github-runner-207 kernel: [19368.559778] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 10:46:34 juju-e4d256-prod-github-runner-207 kernel: [19368.562373] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 10:46:34 juju-e4d256-prod-github-runner-207 kernel: [19368.563420] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 10:46:34 juju-e4d256-prod-github-runner-207 kernel: [19368.564595] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 10:46:34 juju-e4d256-prod-github-runner-207 kernel: [19368.565783] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 10:46:34 juju-e4d256-prod-github-runner-207 kernel: [19368.566942] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 10:46:34 juju-e4d256-prod-github-runner-207 kernel: [19368.568099] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 10:46:34 juju-e4d256-prod-github-runner-207 kernel: [19368.569279] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 10:46:34 juju-e4d256-prod-github-runner-207 kernel: [19368.570509] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 10:46:34 juju-e4d256-prod-github-runner-207 kernel: [19368.571611] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 10:46:34 juju-e4d256-prod-github-runner-207 kernel: [19368.572821] Call Trace: Aug 22 10:46:34 juju-e4d256-prod-github-runner-207 kernel: [19368.573732] Aug 22 10:46:34 juju-e4d256-prod-github-runner-207 kernel: [19368.574638] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:46:34 juju-e4d256-prod-github-runner-207 kernel: [19368.575670] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:46:34 juju-e4d256-prod-github-runner-207 kernel: [19368.576720] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:46:34 juju-e4d256-prod-github-runner-207 kernel: [19368.577818] ? show_regs.part.0+0x23/0x29 Aug 22 10:46:34 juju-e4d256-prod-github-runner-207 kernel: [19368.578818] ? show_regs.cold+0x8/0xd Aug 22 10:46:34 juju-e4d256-prod-github-runner-207 kernel: [19368.579787] ? watchdog_timer_fn+0x1be/0x220 Aug 22 10:46:34 juju-e4d256-prod-github-runner-207 kernel: [19368.580814] ? lockup_detector_update_enable+0x60/0x60 Aug 22 10:46:34 juju-e4d256-prod-github-runner-207 kernel: [19368.581887] ? __hrtimer_run_queues+0x107/0x230 Aug 22 10:46:34 juju-e4d256-prod-github-runner-207 kernel: [19368.582918] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 10:46:34 juju-e4d256-prod-github-runner-207 kernel: [19368.583938] ? hrtimer_interrupt+0x101/0x220 Aug 22 10:46:34 juju-e4d256-prod-github-runner-207 kernel: [19368.584970] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 10:46:34 juju-e4d256-prod-github-runner-207 kernel: [19368.586039] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 10:46:34 juju-e4d256-prod-github-runner-207 kernel: [19368.587090] Aug 22 10:46:34 juju-e4d256-prod-github-runner-207 kernel: [19368.587941] Aug 22 10:46:34 juju-e4d256-prod-github-runner-207 kernel: [19368.590491] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 10:46:34 juju-e4d256-prod-github-runner-207 kernel: [19368.592061] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:46:34 juju-e4d256-prod-github-runner-207 kernel: [19368.593128] ? _raw_spin_lock+0x22/0x30 Aug 22 10:46:34 juju-e4d256-prod-github-runner-207 kernel: [19368.594072] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:46:34 juju-e4d256-prod-github-runner-207 kernel: [19368.595109] direct_page_fault+0x206/0x310 [kvm] Aug 22 10:46:34 juju-e4d256-prod-github-runner-207 kernel: [19368.596180] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 10:46:34 juju-e4d256-prod-github-runner-207 kernel: [19368.597193] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 10:46:34 juju-e4d256-prod-github-runner-207 kernel: [19368.598377] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 10:46:34 juju-e4d256-prod-github-runner-207 kernel: [19368.599377] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 10:46:34 juju-e4d256-prod-github-runner-207 kernel: [19368.600344] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 10:46:34 juju-e4d256-prod-github-runner-207 kernel: [19368.601320] handle_exit+0x98/0x230 [kvm_amd] Aug 22 10:46:34 juju-e4d256-prod-github-runner-207 kernel: [19368.602216] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 10:46:34 juju-e4d256-prod-github-runner-207 kernel: [19368.603134] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 10:46:34 juju-e4d256-prod-github-runner-207 kernel: [19368.604054] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 10:46:34 juju-e4d256-prod-github-runner-207 kernel: [19368.604965] vcpu_run+0x62/0x2c0 [kvm] Aug 22 10:46:34 juju-e4d256-prod-github-runner-207 kernel: [19368.605773] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 10:46:34 juju-e4d256-prod-github-runner-207 kernel: [19368.606589] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 10:46:34 juju-e4d256-prod-github-runner-207 kernel: [19368.607441] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 10:46:34 juju-e4d256-prod-github-runner-207 kernel: [19368.608252] ? __seccomp_filter+0x4a/0x4a0 Aug 22 10:46:34 juju-e4d256-prod-github-runner-207 kernel: [19368.608997] ? __fget_files+0x86/0xc0 Aug 22 10:46:34 juju-e4d256-prod-github-runner-207 kernel: [19368.609700] __x64_sys_ioctl+0x95/0xd0 Aug 22 10:46:34 juju-e4d256-prod-github-runner-207 kernel: [19368.610395] do_syscall_64+0x5c/0xc0 Aug 22 10:46:34 juju-e4d256-prod-github-runner-207 kernel: [19368.611064] ? do_futex+0x162/0x1f0 Aug 22 10:46:34 juju-e4d256-prod-github-runner-207 kernel: [19368.611718] ? __x64_sys_futex+0x78/0x1e0 Aug 22 10:46:34 juju-e4d256-prod-github-runner-207 kernel: [19368.612414] ? __secure_computing+0xa9/0x120 Aug 22 10:46:34 juju-e4d256-prod-github-runner-207 kernel: [19368.613109] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 10:46:34 juju-e4d256-prod-github-runner-207 kernel: [19368.613866] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:46:34 juju-e4d256-prod-github-runner-207 kernel: [19368.614587] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:46:34 juju-e4d256-prod-github-runner-207 kernel: [19368.615302] ? do_syscall_64+0x69/0xc0 Aug 22 10:46:34 juju-e4d256-prod-github-runner-207 kernel: [19368.615945] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:46:34 juju-e4d256-prod-github-runner-207 kernel: [19368.616696] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:46:34 juju-e4d256-prod-github-runner-207 kernel: [19368.617396] ? do_syscall_64+0x69/0xc0 Aug 22 10:46:34 juju-e4d256-prod-github-runner-207 kernel: [19368.618024] ? do_syscall_64+0x69/0xc0 Aug 22 10:46:34 juju-e4d256-prod-github-runner-207 kernel: [19368.618646] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 10:46:34 juju-e4d256-prod-github-runner-207 kernel: [19368.619354] RIP: 0033:0x7faa5d0edaff Aug 22 10:46:34 juju-e4d256-prod-github-runner-207 kernel: [19368.620016] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 10:46:34 juju-e4d256-prod-github-runner-207 kernel: [19368.622022] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 10:46:34 juju-e4d256-prod-github-runner-207 kernel: [19368.622940] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 10:46:34 juju-e4d256-prod-github-runner-207 kernel: [19368.623832] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 10:46:34 juju-e4d256-prod-github-runner-207 kernel: [19368.624727] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 10:46:34 juju-e4d256-prod-github-runner-207 kernel: [19368.625639] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 10:46:34 juju-e4d256-prod-github-runner-207 kernel: [19368.626526] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 10:46:34 juju-e4d256-prod-github-runner-207 kernel: [19368.627418] Aug 22 10:47:02 juju-e4d256-prod-github-runner-207 kernel: [19396.541980] watchdog: BUG: soft lockup - CPU#1 stuck for 17956s! [qemu-system-x86:6715] Aug 22 10:47:02 juju-e4d256-prod-github-runner-207 kernel: [19396.543739] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 10:47:02 juju-e4d256-prod-github-runner-207 kernel: [19396.544008] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 10:47:02 juju-e4d256-prod-github-runner-207 kernel: [19396.556067] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 10:47:02 juju-e4d256-prod-github-runner-207 kernel: [19396.557348] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 10:47:02 juju-e4d256-prod-github-runner-207 kernel: [19396.558595] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:47:02 juju-e4d256-prod-github-runner-207 kernel: [19396.559655] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 10:47:02 juju-e4d256-prod-github-runner-207 kernel: [19396.562209] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 10:47:02 juju-e4d256-prod-github-runner-207 kernel: [19396.563249] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 10:47:02 juju-e4d256-prod-github-runner-207 kernel: [19396.564424] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 10:47:02 juju-e4d256-prod-github-runner-207 kernel: [19396.565588] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 10:47:02 juju-e4d256-prod-github-runner-207 kernel: [19396.566750] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 10:47:02 juju-e4d256-prod-github-runner-207 kernel: [19396.567924] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 10:47:02 juju-e4d256-prod-github-runner-207 kernel: [19396.569092] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 10:47:02 juju-e4d256-prod-github-runner-207 kernel: [19396.570332] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 10:47:02 juju-e4d256-prod-github-runner-207 kernel: [19396.571482] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 10:47:02 juju-e4d256-prod-github-runner-207 kernel: [19396.572700] Call Trace: Aug 22 10:47:02 juju-e4d256-prod-github-runner-207 kernel: [19396.573616] Aug 22 10:47:02 juju-e4d256-prod-github-runner-207 kernel: [19396.574514] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:47:02 juju-e4d256-prod-github-runner-207 kernel: [19396.575546] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:47:02 juju-e4d256-prod-github-runner-207 kernel: [19396.576605] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:47:02 juju-e4d256-prod-github-runner-207 kernel: [19396.577709] ? show_regs.part.0+0x23/0x29 Aug 22 10:47:02 juju-e4d256-prod-github-runner-207 kernel: [19396.578715] ? show_regs.cold+0x8/0xd Aug 22 10:47:02 juju-e4d256-prod-github-runner-207 kernel: [19396.579682] ? watchdog_timer_fn+0x1be/0x220 Aug 22 10:47:02 juju-e4d256-prod-github-runner-207 kernel: [19396.580702] ? lockup_detector_update_enable+0x60/0x60 Aug 22 10:47:02 juju-e4d256-prod-github-runner-207 kernel: [19396.581769] ? __hrtimer_run_queues+0x107/0x230 Aug 22 10:47:02 juju-e4d256-prod-github-runner-207 kernel: [19396.582798] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 10:47:02 juju-e4d256-prod-github-runner-207 kernel: [19396.583832] ? hrtimer_interrupt+0x101/0x220 Aug 22 10:47:02 juju-e4d256-prod-github-runner-207 kernel: [19396.584849] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 10:47:02 juju-e4d256-prod-github-runner-207 kernel: [19396.585914] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 10:47:02 juju-e4d256-prod-github-runner-207 kernel: [19396.586976] Aug 22 10:47:02 juju-e4d256-prod-github-runner-207 kernel: [19396.587875] Aug 22 10:47:02 juju-e4d256-prod-github-runner-207 kernel: [19396.588720] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 10:47:02 juju-e4d256-prod-github-runner-207 kernel: [19396.589750] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:47:02 juju-e4d256-prod-github-runner-207 kernel: [19396.590785] ? _raw_spin_lock+0x22/0x30 Aug 22 10:47:02 juju-e4d256-prod-github-runner-207 kernel: [19396.591731] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:47:02 juju-e4d256-prod-github-runner-207 kernel: [19396.592759] direct_page_fault+0x206/0x310 [kvm] Aug 22 10:47:02 juju-e4d256-prod-github-runner-207 kernel: [19396.593780] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 10:47:02 juju-e4d256-prod-github-runner-207 kernel: [19396.594789] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 10:47:02 juju-e4d256-prod-github-runner-207 kernel: [19396.595794] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 10:47:02 juju-e4d256-prod-github-runner-207 kernel: [19396.596785] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 10:47:02 juju-e4d256-prod-github-runner-207 kernel: [19396.597733] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 10:47:02 juju-e4d256-prod-github-runner-207 kernel: [19396.598712] handle_exit+0x98/0x230 [kvm_amd] Aug 22 10:47:02 juju-e4d256-prod-github-runner-207 kernel: [19396.599605] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 10:47:02 juju-e4d256-prod-github-runner-207 kernel: [19396.600524] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 10:47:02 juju-e4d256-prod-github-runner-207 kernel: [19396.601475] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 10:47:02 juju-e4d256-prod-github-runner-207 kernel: [19396.602392] vcpu_run+0x62/0x2c0 [kvm] Aug 22 10:47:02 juju-e4d256-prod-github-runner-207 kernel: [19396.603200] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 10:47:02 juju-e4d256-prod-github-runner-207 kernel: [19396.604019] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 10:47:02 juju-e4d256-prod-github-runner-207 kernel: [19396.604876] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 10:47:02 juju-e4d256-prod-github-runner-207 kernel: [19396.605674] ? __seccomp_filter+0x4a/0x4a0 Aug 22 10:47:02 juju-e4d256-prod-github-runner-207 kernel: [19396.606413] ? __fget_files+0x86/0xc0 Aug 22 10:47:02 juju-e4d256-prod-github-runner-207 kernel: [19396.607114] __x64_sys_ioctl+0x95/0xd0 Aug 22 10:47:02 juju-e4d256-prod-github-runner-207 kernel: [19396.607815] do_syscall_64+0x5c/0xc0 Aug 22 10:47:02 juju-e4d256-prod-github-runner-207 kernel: [19396.608486] ? do_futex+0x162/0x1f0 Aug 22 10:47:02 juju-e4d256-prod-github-runner-207 kernel: [19396.609130] ? __x64_sys_futex+0x78/0x1e0 Aug 22 10:47:02 juju-e4d256-prod-github-runner-207 kernel: [19396.609805] ? __secure_computing+0xa9/0x120 Aug 22 10:47:02 juju-e4d256-prod-github-runner-207 kernel: [19396.610496] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 10:47:02 juju-e4d256-prod-github-runner-207 kernel: [19396.611253] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:47:02 juju-e4d256-prod-github-runner-207 kernel: [19396.611983] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:47:02 juju-e4d256-prod-github-runner-207 kernel: [19396.612704] ? do_syscall_64+0x69/0xc0 Aug 22 10:47:02 juju-e4d256-prod-github-runner-207 kernel: [19396.613351] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:47:02 juju-e4d256-prod-github-runner-207 kernel: [19396.614050] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:47:02 juju-e4d256-prod-github-runner-207 kernel: [19396.614747] ? do_syscall_64+0x69/0xc0 Aug 22 10:47:02 juju-e4d256-prod-github-runner-207 kernel: [19396.615369] ? do_syscall_64+0x69/0xc0 Aug 22 10:47:02 juju-e4d256-prod-github-runner-207 kernel: [19396.615995] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 10:47:02 juju-e4d256-prod-github-runner-207 kernel: [19396.616698] RIP: 0033:0x7faa5d0edaff Aug 22 10:47:02 juju-e4d256-prod-github-runner-207 kernel: [19396.617357] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 10:47:02 juju-e4d256-prod-github-runner-207 kernel: [19396.619352] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 10:47:02 juju-e4d256-prod-github-runner-207 kernel: [19396.620272] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 10:47:02 juju-e4d256-prod-github-runner-207 kernel: [19396.621163] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 10:47:02 juju-e4d256-prod-github-runner-207 kernel: [19396.622054] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 10:47:02 juju-e4d256-prod-github-runner-207 kernel: [19396.622939] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 10:47:02 juju-e4d256-prod-github-runner-207 kernel: [19396.623838] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 10:47:02 juju-e4d256-prod-github-runner-207 kernel: [19396.624728] Aug 22 10:47:30 juju-e4d256-prod-github-runner-207 kernel: [19424.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 17982s! [qemu-system-x86:6715] Aug 22 10:47:30 juju-e4d256-prod-github-runner-207 kernel: [19424.543699] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 10:47:30 juju-e4d256-prod-github-runner-207 kernel: [19424.543926] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 10:47:30 juju-e4d256-prod-github-runner-207 kernel: [19424.556025] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 10:47:30 juju-e4d256-prod-github-runner-207 kernel: [19424.557289] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 10:47:30 juju-e4d256-prod-github-runner-207 kernel: [19424.558508] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:47:30 juju-e4d256-prod-github-runner-207 kernel: [19424.559580] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 10:47:30 juju-e4d256-prod-github-runner-207 kernel: [19424.562142] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 10:47:30 juju-e4d256-prod-github-runner-207 kernel: [19424.563197] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 10:47:30 juju-e4d256-prod-github-runner-207 kernel: [19424.564431] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 10:47:30 juju-e4d256-prod-github-runner-207 kernel: [19424.565598] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 10:47:30 juju-e4d256-prod-github-runner-207 kernel: [19424.566757] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 10:47:30 juju-e4d256-prod-github-runner-207 kernel: [19424.567964] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 10:47:30 juju-e4d256-prod-github-runner-207 kernel: [19424.569150] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 10:47:30 juju-e4d256-prod-github-runner-207 kernel: [19424.570437] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 10:47:30 juju-e4d256-prod-github-runner-207 kernel: [19424.571571] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 10:47:30 juju-e4d256-prod-github-runner-207 kernel: [19424.572765] Call Trace: Aug 22 10:47:30 juju-e4d256-prod-github-runner-207 kernel: [19424.573689] Aug 22 10:47:30 juju-e4d256-prod-github-runner-207 kernel: [19424.574615] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:47:30 juju-e4d256-prod-github-runner-207 kernel: [19424.575678] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:47:30 juju-e4d256-prod-github-runner-207 kernel: [19424.576710] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:47:30 juju-e4d256-prod-github-runner-207 kernel: [19424.577848] ? show_regs.part.0+0x23/0x29 Aug 22 10:47:30 juju-e4d256-prod-github-runner-207 kernel: [19424.578860] ? show_regs.cold+0x8/0xd Aug 22 10:47:30 juju-e4d256-prod-github-runner-207 kernel: [19424.579850] ? watchdog_timer_fn+0x1be/0x220 Aug 22 10:47:30 juju-e4d256-prod-github-runner-207 kernel: [19424.580861] ? lockup_detector_update_enable+0x60/0x60 Aug 22 10:47:30 juju-e4d256-prod-github-runner-207 kernel: [19424.581933] ? __hrtimer_run_queues+0x107/0x230 Aug 22 10:47:30 juju-e4d256-prod-github-runner-207 kernel: [19424.582971] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 10:47:30 juju-e4d256-prod-github-runner-207 kernel: [19424.584020] ? hrtimer_interrupt+0x101/0x220 Aug 22 10:47:30 juju-e4d256-prod-github-runner-207 kernel: [19424.585051] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 10:47:30 juju-e4d256-prod-github-runner-207 kernel: [19424.586189] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 10:47:30 juju-e4d256-prod-github-runner-207 kernel: [19424.587237] Aug 22 10:47:30 juju-e4d256-prod-github-runner-207 kernel: [19424.588115] Aug 22 10:47:30 juju-e4d256-prod-github-runner-207 kernel: [19424.588969] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 10:47:30 juju-e4d256-prod-github-runner-207 kernel: [19424.590059] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:47:30 juju-e4d256-prod-github-runner-207 kernel: [19424.591118] ? _raw_spin_lock+0x22/0x30 Aug 22 10:47:30 juju-e4d256-prod-github-runner-207 kernel: [19424.592113] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:47:30 juju-e4d256-prod-github-runner-207 kernel: [19424.593154] direct_page_fault+0x206/0x310 [kvm] Aug 22 10:47:30 juju-e4d256-prod-github-runner-207 kernel: [19424.594180] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 10:47:30 juju-e4d256-prod-github-runner-207 kernel: [19424.595202] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 10:47:30 juju-e4d256-prod-github-runner-207 kernel: [19424.596218] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 10:47:30 juju-e4d256-prod-github-runner-207 kernel: [19424.597217] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 10:47:30 juju-e4d256-prod-github-runner-207 kernel: [19424.598170] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 10:47:30 juju-e4d256-prod-github-runner-207 kernel: [19424.599150] handle_exit+0x98/0x230 [kvm_amd] Aug 22 10:47:30 juju-e4d256-prod-github-runner-207 kernel: [19424.600070] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 10:47:30 juju-e4d256-prod-github-runner-207 kernel: [19424.600989] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 10:47:30 juju-e4d256-prod-github-runner-207 kernel: [19424.601961] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 10:47:30 juju-e4d256-prod-github-runner-207 kernel: [19424.602900] vcpu_run+0x62/0x2c0 [kvm] Aug 22 10:47:30 juju-e4d256-prod-github-runner-207 kernel: [19424.603749] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 10:47:30 juju-e4d256-prod-github-runner-207 kernel: [19424.604563] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 10:47:30 juju-e4d256-prod-github-runner-207 kernel: [19424.605557] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 10:47:30 juju-e4d256-prod-github-runner-207 kernel: [19424.606369] ? __seccomp_filter+0x4a/0x4a0 Aug 22 10:47:30 juju-e4d256-prod-github-runner-207 kernel: [19424.607306] ? __fget_files+0x86/0xc0 Aug 22 10:47:30 juju-e4d256-prod-github-runner-207 kernel: [19424.608218] __x64_sys_ioctl+0x95/0xd0 Aug 22 10:47:30 juju-e4d256-prod-github-runner-207 kernel: [19424.608941] do_syscall_64+0x5c/0xc0 Aug 22 10:47:30 juju-e4d256-prod-github-runner-207 kernel: [19424.609648] ? do_futex+0x162/0x1f0 Aug 22 10:47:30 juju-e4d256-prod-github-runner-207 kernel: [19424.610329] ? __x64_sys_futex+0x78/0x1e0 Aug 22 10:47:30 juju-e4d256-prod-github-runner-207 kernel: [19424.611016] ? __secure_computing+0xa9/0x120 Aug 22 10:47:30 juju-e4d256-prod-github-runner-207 kernel: [19424.611760] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 10:47:30 juju-e4d256-prod-github-runner-207 kernel: [19424.612686] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:47:30 juju-e4d256-prod-github-runner-207 kernel: [19424.613522] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:47:30 juju-e4d256-prod-github-runner-207 kernel: [19424.614288] ? do_syscall_64+0x69/0xc0 Aug 22 10:47:30 juju-e4d256-prod-github-runner-207 kernel: [19424.614994] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:47:30 juju-e4d256-prod-github-runner-207 kernel: [19424.615737] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:47:30 juju-e4d256-prod-github-runner-207 kernel: [19424.616434] ? do_syscall_64+0x69/0xc0 Aug 22 10:47:30 juju-e4d256-prod-github-runner-207 kernel: [19424.617065] ? do_syscall_64+0x69/0xc0 Aug 22 10:47:30 juju-e4d256-prod-github-runner-207 kernel: [19424.617694] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 10:47:30 juju-e4d256-prod-github-runner-207 kernel: [19424.618401] RIP: 0033:0x7faa5d0edaff Aug 22 10:47:30 juju-e4d256-prod-github-runner-207 kernel: [19424.619060] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 10:47:30 juju-e4d256-prod-github-runner-207 kernel: [19424.621420] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 10:47:30 juju-e4d256-prod-github-runner-207 kernel: [19424.622473] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 10:47:30 juju-e4d256-prod-github-runner-207 kernel: [19424.623530] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 10:47:30 juju-e4d256-prod-github-runner-207 kernel: [19424.624559] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 10:47:30 juju-e4d256-prod-github-runner-207 kernel: [19424.625461] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 10:47:30 juju-e4d256-prod-github-runner-207 kernel: [19424.626362] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 10:47:30 juju-e4d256-prod-github-runner-207 kernel: [19424.627254] Aug 22 10:47:44 juju-e4d256-prod-github-runner-207 kernel: [19438.484708] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 10:47:44 juju-e4d256-prod-github-runner-207 kernel: [19438.486312] rcu: 1-....: (4815276 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=2332192 Aug 22 10:47:44 juju-e4d256-prod-github-runner-207 kernel: [19438.487454] (t=4830321 jiffies g=23269 q=25566) Aug 22 10:47:44 juju-e4d256-prod-github-runner-207 kernel: [19438.488235] NMI backtrace for cpu 1 Aug 22 10:47:44 juju-e4d256-prod-github-runner-207 kernel: [19438.488943] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 10:47:44 juju-e4d256-prod-github-runner-207 kernel: [19438.490150] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 10:47:44 juju-e4d256-prod-github-runner-207 kernel: [19438.491373] Call Trace: Aug 22 10:47:44 juju-e4d256-prod-github-runner-207 kernel: [19438.492049] Aug 22 10:47:44 juju-e4d256-prod-github-runner-207 kernel: [19438.492705] show_stack+0x52/0x5c Aug 22 10:47:44 juju-e4d256-prod-github-runner-207 kernel: [19438.493428] dump_stack_lvl+0x4a/0x63 Aug 22 10:47:44 juju-e4d256-prod-github-runner-207 kernel: [19438.494170] dump_stack+0x10/0x16 Aug 22 10:47:44 juju-e4d256-prod-github-runner-207 kernel: [19438.494885] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 10:47:44 juju-e4d256-prod-github-runner-207 kernel: [19438.495682] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 10:47:44 juju-e4d256-prod-github-runner-207 kernel: [19438.496461] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 10:47:44 juju-e4d256-prod-github-runner-207 kernel: [19438.497280] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 10:47:44 juju-e4d256-prod-github-runner-207 kernel: [19438.498097] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 10:47:44 juju-e4d256-prod-github-runner-207 kernel: [19438.498937] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 10:47:44 juju-e4d256-prod-github-runner-207 kernel: [19438.499790] print_cpu_stall.cold+0x2f/0xe2 Aug 22 10:47:44 juju-e4d256-prod-github-runner-207 kernel: [19438.500554] ? timekeeping_update+0xf7/0x150 Aug 22 10:47:44 juju-e4d256-prod-github-runner-207 kernel: [19438.501325] check_cpu_stall+0x109/0x270 Aug 22 10:47:44 juju-e4d256-prod-github-runner-207 kernel: [19438.502141] rcu_sched_clock_irq+0x9a/0x250 Aug 22 10:47:44 juju-e4d256-prod-github-runner-207 kernel: [19438.503011] update_process_times+0x94/0xd0 Aug 22 10:47:44 juju-e4d256-prod-github-runner-207 kernel: [19438.503920] tick_sched_handle+0x29/0x70 Aug 22 10:47:44 juju-e4d256-prod-github-runner-207 kernel: [19438.504722] tick_sched_timer+0x8c/0xc0 Aug 22 10:47:44 juju-e4d256-prod-github-runner-207 kernel: [19438.505485] ? tick_nohz_handler+0xb0/0xb0 Aug 22 10:47:44 juju-e4d256-prod-github-runner-207 kernel: [19438.506323] __hrtimer_run_queues+0x107/0x230 Aug 22 10:47:44 juju-e4d256-prod-github-runner-207 kernel: [19438.507095] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 10:47:44 juju-e4d256-prod-github-runner-207 kernel: [19438.507894] hrtimer_interrupt+0x101/0x220 Aug 22 10:47:44 juju-e4d256-prod-github-runner-207 kernel: [19438.508661] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 10:47:44 juju-e4d256-prod-github-runner-207 kernel: [19438.509473] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 10:47:44 juju-e4d256-prod-github-runner-207 kernel: [19438.510273] Aug 22 10:47:44 juju-e4d256-prod-github-runner-207 kernel: [19438.510906] Aug 22 10:47:44 juju-e4d256-prod-github-runner-207 kernel: [19438.511560] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 10:47:44 juju-e4d256-prod-github-runner-207 kernel: [19438.512389] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:47:44 juju-e4d256-prod-github-runner-207 kernel: [19438.513270] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 10:47:44 juju-e4d256-prod-github-runner-207 kernel: [19438.515664] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 10:47:44 juju-e4d256-prod-github-runner-207 kernel: [19438.516541] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 10:47:44 juju-e4d256-prod-github-runner-207 kernel: [19438.517550] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 10:47:44 juju-e4d256-prod-github-runner-207 kernel: [19438.518627] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 10:47:44 juju-e4d256-prod-github-runner-207 kernel: [19438.519710] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 10:47:44 juju-e4d256-prod-github-runner-207 kernel: [19438.520671] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 10:47:44 juju-e4d256-prod-github-runner-207 kernel: [19438.521625] ? _raw_spin_lock+0x22/0x30 Aug 22 10:47:44 juju-e4d256-prod-github-runner-207 kernel: [19438.522464] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:47:44 juju-e4d256-prod-github-runner-207 kernel: [19438.523476] direct_page_fault+0x206/0x310 [kvm] Aug 22 10:47:44 juju-e4d256-prod-github-runner-207 kernel: [19438.524415] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 10:47:44 juju-e4d256-prod-github-runner-207 kernel: [19438.525265] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 10:47:44 juju-e4d256-prod-github-runner-207 kernel: [19438.526108] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 10:47:44 juju-e4d256-prod-github-runner-207 kernel: [19438.526932] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 10:47:44 juju-e4d256-prod-github-runner-207 kernel: [19438.527741] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 10:47:44 juju-e4d256-prod-github-runner-207 kernel: [19438.528563] handle_exit+0x98/0x230 [kvm_amd] Aug 22 10:47:44 juju-e4d256-prod-github-runner-207 kernel: [19438.529317] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 10:47:44 juju-e4d256-prod-github-runner-207 kernel: [19438.530101] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 10:47:44 juju-e4d256-prod-github-runner-207 kernel: [19438.530903] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 10:47:44 juju-e4d256-prod-github-runner-207 kernel: [19438.531708] vcpu_run+0x62/0x2c0 [kvm] Aug 22 10:47:44 juju-e4d256-prod-github-runner-207 kernel: [19438.532424] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 10:47:44 juju-e4d256-prod-github-runner-207 kernel: [19438.533157] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 10:47:44 juju-e4d256-prod-github-runner-207 kernel: [19438.533984] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 10:47:44 juju-e4d256-prod-github-runner-207 kernel: [19438.534818] ? __seccomp_filter+0x4a/0x4a0 Aug 22 10:47:44 juju-e4d256-prod-github-runner-207 kernel: [19438.535655] ? __fget_files+0x86/0xc0 Aug 22 10:47:44 juju-e4d256-prod-github-runner-207 kernel: [19438.536410] __x64_sys_ioctl+0x95/0xd0 Aug 22 10:47:44 juju-e4d256-prod-github-runner-207 kernel: [19438.537107] do_syscall_64+0x5c/0xc0 Aug 22 10:47:44 juju-e4d256-prod-github-runner-207 kernel: [19438.537790] ? do_futex+0x162/0x1f0 Aug 22 10:47:44 juju-e4d256-prod-github-runner-207 kernel: [19438.538472] ? __x64_sys_futex+0x78/0x1e0 Aug 22 10:47:44 juju-e4d256-prod-github-runner-207 kernel: [19438.539173] ? __secure_computing+0xa9/0x120 Aug 22 10:47:44 juju-e4d256-prod-github-runner-207 kernel: [19438.539912] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 10:47:44 juju-e4d256-prod-github-runner-207 kernel: [19438.540701] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:47:44 juju-e4d256-prod-github-runner-207 kernel: [19438.541454] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:47:44 juju-e4d256-prod-github-runner-207 kernel: [19438.542215] ? do_syscall_64+0x69/0xc0 Aug 22 10:47:44 juju-e4d256-prod-github-runner-207 kernel: [19438.542904] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:47:44 juju-e4d256-prod-github-runner-207 kernel: [19438.543673] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:47:44 juju-e4d256-prod-github-runner-207 kernel: [19438.544430] ? do_syscall_64+0x69/0xc0 Aug 22 10:47:44 juju-e4d256-prod-github-runner-207 kernel: [19438.545121] ? do_syscall_64+0x69/0xc0 Aug 22 10:47:44 juju-e4d256-prod-github-runner-207 kernel: [19438.545808] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 10:47:44 juju-e4d256-prod-github-runner-207 kernel: [19438.546577] RIP: 0033:0x7faa5d0edaff Aug 22 10:47:44 juju-e4d256-prod-github-runner-207 kernel: [19438.547323] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 10:47:44 juju-e4d256-prod-github-runner-207 kernel: [19438.549611] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 10:47:44 juju-e4d256-prod-github-runner-207 kernel: [19438.550582] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 10:47:44 juju-e4d256-prod-github-runner-207 kernel: [19438.551575] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 10:47:44 juju-e4d256-prod-github-runner-207 kernel: [19438.552655] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 10:47:44 juju-e4d256-prod-github-runner-207 kernel: [19438.553705] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 10:47:44 juju-e4d256-prod-github-runner-207 kernel: [19438.554688] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 10:47:44 juju-e4d256-prod-github-runner-207 kernel: [19438.555665] Aug 22 10:48:10 juju-e4d256-prod-github-runner-207 kernel: [19464.541984] watchdog: BUG: soft lockup - CPU#1 stuck for 18019s! [qemu-system-x86:6715] Aug 22 10:48:10 juju-e4d256-prod-github-runner-207 kernel: [19464.543175] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 10:48:10 juju-e4d256-prod-github-runner-207 kernel: [19464.543501] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 10:48:10 juju-e4d256-prod-github-runner-207 kernel: [19464.556002] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 10:48:10 juju-e4d256-prod-github-runner-207 kernel: [19464.557279] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 10:48:10 juju-e4d256-prod-github-runner-207 kernel: [19464.558677] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:48:10 juju-e4d256-prod-github-runner-207 kernel: [19464.559750] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 10:48:10 juju-e4d256-prod-github-runner-207 kernel: [19464.562294] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 10:48:10 juju-e4d256-prod-github-runner-207 kernel: [19464.563355] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 10:48:10 juju-e4d256-prod-github-runner-207 kernel: [19464.564522] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 10:48:10 juju-e4d256-prod-github-runner-207 kernel: [19464.565684] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 10:48:10 juju-e4d256-prod-github-runner-207 kernel: [19464.566852] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 10:48:10 juju-e4d256-prod-github-runner-207 kernel: [19464.568025] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 10:48:10 juju-e4d256-prod-github-runner-207 kernel: [19464.569203] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 10:48:10 juju-e4d256-prod-github-runner-207 kernel: [19464.570442] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 10:48:10 juju-e4d256-prod-github-runner-207 kernel: [19464.571555] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 10:48:10 juju-e4d256-prod-github-runner-207 kernel: [19464.572769] Call Trace: Aug 22 10:48:10 juju-e4d256-prod-github-runner-207 kernel: [19464.573695] Aug 22 10:48:10 juju-e4d256-prod-github-runner-207 kernel: [19464.574579] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:48:10 juju-e4d256-prod-github-runner-207 kernel: [19464.575636] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:48:10 juju-e4d256-prod-github-runner-207 kernel: [19464.576659] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:48:10 juju-e4d256-prod-github-runner-207 kernel: [19464.577741] ? show_regs.part.0+0x23/0x29 Aug 22 10:48:10 juju-e4d256-prod-github-runner-207 kernel: [19464.578744] ? show_regs.cold+0x8/0xd Aug 22 10:48:10 juju-e4d256-prod-github-runner-207 kernel: [19464.579732] ? watchdog_timer_fn+0x1be/0x220 Aug 22 10:48:10 juju-e4d256-prod-github-runner-207 kernel: [19464.580740] ? lockup_detector_update_enable+0x60/0x60 Aug 22 10:48:10 juju-e4d256-prod-github-runner-207 kernel: [19464.581803] ? __hrtimer_run_queues+0x107/0x230 Aug 22 10:48:10 juju-e4d256-prod-github-runner-207 kernel: [19464.582833] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 10:48:10 juju-e4d256-prod-github-runner-207 kernel: [19464.583871] ? hrtimer_interrupt+0x101/0x220 Aug 22 10:48:10 juju-e4d256-prod-github-runner-207 kernel: [19464.584885] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 10:48:10 juju-e4d256-prod-github-runner-207 kernel: [19464.585951] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 10:48:10 juju-e4d256-prod-github-runner-207 kernel: [19464.587014] Aug 22 10:48:10 juju-e4d256-prod-github-runner-207 kernel: [19464.587867] Aug 22 10:48:10 juju-e4d256-prod-github-runner-207 kernel: [19464.588706] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 10:48:10 juju-e4d256-prod-github-runner-207 kernel: [19464.589742] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:48:10 juju-e4d256-prod-github-runner-207 kernel: [19464.590781] ? _raw_spin_lock+0x22/0x30 Aug 22 10:48:10 juju-e4d256-prod-github-runner-207 kernel: [19464.591748] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:48:10 juju-e4d256-prod-github-runner-207 kernel: [19464.592766] direct_page_fault+0x206/0x310 [kvm] Aug 22 10:48:10 juju-e4d256-prod-github-runner-207 kernel: [19464.593788] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 10:48:10 juju-e4d256-prod-github-runner-207 kernel: [19464.594800] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 10:48:10 juju-e4d256-prod-github-runner-207 kernel: [19464.595818] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 10:48:10 juju-e4d256-prod-github-runner-207 kernel: [19464.596788] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 10:48:10 juju-e4d256-prod-github-runner-207 kernel: [19464.597733] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 10:48:10 juju-e4d256-prod-github-runner-207 kernel: [19464.598732] handle_exit+0x98/0x230 [kvm_amd] Aug 22 10:48:10 juju-e4d256-prod-github-runner-207 kernel: [19464.599652] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 10:48:10 juju-e4d256-prod-github-runner-207 kernel: [19464.600568] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 10:48:10 juju-e4d256-prod-github-runner-207 kernel: [19464.601492] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 10:48:10 juju-e4d256-prod-github-runner-207 kernel: [19464.602395] vcpu_run+0x62/0x2c0 [kvm] Aug 22 10:48:10 juju-e4d256-prod-github-runner-207 kernel: [19464.603221] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 10:48:10 juju-e4d256-prod-github-runner-207 kernel: [19464.604044] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 10:48:10 juju-e4d256-prod-github-runner-207 kernel: [19464.604901] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 10:48:10 juju-e4d256-prod-github-runner-207 kernel: [19464.605698] ? __seccomp_filter+0x4a/0x4a0 Aug 22 10:48:10 juju-e4d256-prod-github-runner-207 kernel: [19464.606442] ? __fget_files+0x86/0xc0 Aug 22 10:48:10 juju-e4d256-prod-github-runner-207 kernel: [19464.607165] __x64_sys_ioctl+0x95/0xd0 Aug 22 10:48:10 juju-e4d256-prod-github-runner-207 kernel: [19464.607863] do_syscall_64+0x5c/0xc0 Aug 22 10:48:10 juju-e4d256-prod-github-runner-207 kernel: [19464.608538] ? do_futex+0x162/0x1f0 Aug 22 10:48:10 juju-e4d256-prod-github-runner-207 kernel: [19464.609194] ? __x64_sys_futex+0x78/0x1e0 Aug 22 10:48:10 juju-e4d256-prod-github-runner-207 kernel: [19464.609871] ? __secure_computing+0xa9/0x120 Aug 22 10:48:10 juju-e4d256-prod-github-runner-207 kernel: [19464.610562] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 10:48:10 juju-e4d256-prod-github-runner-207 kernel: [19464.611339] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:48:10 juju-e4d256-prod-github-runner-207 kernel: [19464.612063] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:48:10 juju-e4d256-prod-github-runner-207 kernel: [19464.612781] ? do_syscall_64+0x69/0xc0 Aug 22 10:48:10 juju-e4d256-prod-github-runner-207 kernel: [19464.613427] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:48:10 juju-e4d256-prod-github-runner-207 kernel: [19464.614132] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:48:10 juju-e4d256-prod-github-runner-207 kernel: [19464.614833] ? do_syscall_64+0x69/0xc0 Aug 22 10:48:10 juju-e4d256-prod-github-runner-207 kernel: [19464.615472] ? do_syscall_64+0x69/0xc0 Aug 22 10:48:10 juju-e4d256-prod-github-runner-207 kernel: [19464.616096] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 10:48:10 juju-e4d256-prod-github-runner-207 kernel: [19464.616802] RIP: 0033:0x7faa5d0edaff Aug 22 10:48:10 juju-e4d256-prod-github-runner-207 kernel: [19464.617430] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 10:48:10 juju-e4d256-prod-github-runner-207 kernel: [19464.619442] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 10:48:10 juju-e4d256-prod-github-runner-207 kernel: [19464.620359] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 10:48:10 juju-e4d256-prod-github-runner-207 kernel: [19464.621251] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 10:48:10 juju-e4d256-prod-github-runner-207 kernel: [19464.622139] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 10:48:10 juju-e4d256-prod-github-runner-207 kernel: [19464.623047] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 10:48:10 juju-e4d256-prod-github-runner-207 kernel: [19464.623941] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 10:48:10 juju-e4d256-prod-github-runner-207 kernel: [19464.624836] Aug 22 10:48:38 juju-e4d256-prod-github-runner-207 kernel: [19492.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 18045s! [qemu-system-x86:6715] Aug 22 10:48:38 juju-e4d256-prod-github-runner-207 kernel: [19492.543741] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 10:48:38 juju-e4d256-prod-github-runner-207 kernel: [19492.543991] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 10:48:38 juju-e4d256-prod-github-runner-207 kernel: [19492.556037] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 10:48:38 juju-e4d256-prod-github-runner-207 kernel: [19492.557298] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 10:48:38 juju-e4d256-prod-github-runner-207 kernel: [19492.558516] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:48:38 juju-e4d256-prod-github-runner-207 kernel: [19492.559595] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 10:48:38 juju-e4d256-prod-github-runner-207 kernel: [19492.562137] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 10:48:38 juju-e4d256-prod-github-runner-207 kernel: [19492.563194] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 10:48:38 juju-e4d256-prod-github-runner-207 kernel: [19492.564358] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 10:48:38 juju-e4d256-prod-github-runner-207 kernel: [19492.565519] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 10:48:38 juju-e4d256-prod-github-runner-207 kernel: [19492.566697] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 10:48:38 juju-e4d256-prod-github-runner-207 kernel: [19492.567859] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 10:48:38 juju-e4d256-prod-github-runner-207 kernel: [19492.569030] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 10:48:38 juju-e4d256-prod-github-runner-207 kernel: [19492.570264] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 10:48:38 juju-e4d256-prod-github-runner-207 kernel: [19492.571376] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 10:48:38 juju-e4d256-prod-github-runner-207 kernel: [19492.572692] Call Trace: Aug 22 10:48:38 juju-e4d256-prod-github-runner-207 kernel: [19492.573604] Aug 22 10:48:38 juju-e4d256-prod-github-runner-207 kernel: [19492.574495] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:48:38 juju-e4d256-prod-github-runner-207 kernel: [19492.575540] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:48:38 juju-e4d256-prod-github-runner-207 kernel: [19492.576567] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:48:38 juju-e4d256-prod-github-runner-207 kernel: [19492.577655] ? show_regs.part.0+0x23/0x29 Aug 22 10:48:38 juju-e4d256-prod-github-runner-207 kernel: [19492.578663] ? show_regs.cold+0x8/0xd Aug 22 10:48:38 juju-e4d256-prod-github-runner-207 kernel: [19492.579639] ? watchdog_timer_fn+0x1be/0x220 Aug 22 10:48:38 juju-e4d256-prod-github-runner-207 kernel: [19492.580646] ? lockup_detector_update_enable+0x60/0x60 Aug 22 10:48:38 juju-e4d256-prod-github-runner-207 kernel: [19492.581710] ? __hrtimer_run_queues+0x107/0x230 Aug 22 10:48:38 juju-e4d256-prod-github-runner-207 kernel: [19492.582756] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 10:48:38 juju-e4d256-prod-github-runner-207 kernel: [19492.583780] ? hrtimer_interrupt+0x101/0x220 Aug 22 10:48:38 juju-e4d256-prod-github-runner-207 kernel: [19492.584799] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 10:48:38 juju-e4d256-prod-github-runner-207 kernel: [19492.585869] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 10:48:38 juju-e4d256-prod-github-runner-207 kernel: [19492.586944] Aug 22 10:48:38 juju-e4d256-prod-github-runner-207 kernel: [19492.587798] Aug 22 10:48:38 juju-e4d256-prod-github-runner-207 kernel: [19492.588640] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 10:48:38 juju-e4d256-prod-github-runner-207 kernel: [19492.589674] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:48:38 juju-e4d256-prod-github-runner-207 kernel: [19492.590723] ? _raw_spin_lock+0x22/0x30 Aug 22 10:48:38 juju-e4d256-prod-github-runner-207 kernel: [19492.591674] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:48:38 juju-e4d256-prod-github-runner-207 kernel: [19492.592689] direct_page_fault+0x206/0x310 [kvm] Aug 22 10:48:38 juju-e4d256-prod-github-runner-207 kernel: [19492.593713] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 10:48:38 juju-e4d256-prod-github-runner-207 kernel: [19492.594732] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 10:48:38 juju-e4d256-prod-github-runner-207 kernel: [19492.595739] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 10:48:38 juju-e4d256-prod-github-runner-207 kernel: [19492.596723] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 10:48:38 juju-e4d256-prod-github-runner-207 kernel: [19492.597677] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 10:48:38 juju-e4d256-prod-github-runner-207 kernel: [19492.598675] handle_exit+0x98/0x230 [kvm_amd] Aug 22 10:48:38 juju-e4d256-prod-github-runner-207 kernel: [19492.599568] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 10:48:38 juju-e4d256-prod-github-runner-207 kernel: [19492.600481] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 10:48:38 juju-e4d256-prod-github-runner-207 kernel: [19492.601412] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 10:48:38 juju-e4d256-prod-github-runner-207 kernel: [19492.602315] vcpu_run+0x62/0x2c0 [kvm] Aug 22 10:48:38 juju-e4d256-prod-github-runner-207 kernel: [19492.603141] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 10:48:38 juju-e4d256-prod-github-runner-207 kernel: [19492.603955] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 10:48:38 juju-e4d256-prod-github-runner-207 kernel: [19492.604814] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 10:48:38 juju-e4d256-prod-github-runner-207 kernel: [19492.605612] ? __seccomp_filter+0x4a/0x4a0 Aug 22 10:48:38 juju-e4d256-prod-github-runner-207 kernel: [19492.606354] ? __fget_files+0x86/0xc0 Aug 22 10:48:38 juju-e4d256-prod-github-runner-207 kernel: [19492.607069] __x64_sys_ioctl+0x95/0xd0 Aug 22 10:48:38 juju-e4d256-prod-github-runner-207 kernel: [19492.607769] do_syscall_64+0x5c/0xc0 Aug 22 10:48:38 juju-e4d256-prod-github-runner-207 kernel: [19492.608434] ? do_futex+0x162/0x1f0 Aug 22 10:48:38 juju-e4d256-prod-github-runner-207 kernel: [19492.609083] ? __x64_sys_futex+0x78/0x1e0 Aug 22 10:48:38 juju-e4d256-prod-github-runner-207 kernel: [19492.609756] ? __secure_computing+0xa9/0x120 Aug 22 10:48:38 juju-e4d256-prod-github-runner-207 kernel: [19492.610446] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 10:48:38 juju-e4d256-prod-github-runner-207 kernel: [19492.611220] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:48:38 juju-e4d256-prod-github-runner-207 kernel: [19492.611941] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:48:38 juju-e4d256-prod-github-runner-207 kernel: [19492.612658] ? do_syscall_64+0x69/0xc0 Aug 22 10:48:38 juju-e4d256-prod-github-runner-207 kernel: [19492.613304] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:48:38 juju-e4d256-prod-github-runner-207 kernel: [19492.614006] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:48:38 juju-e4d256-prod-github-runner-207 kernel: [19492.614714] ? do_syscall_64+0x69/0xc0 Aug 22 10:48:38 juju-e4d256-prod-github-runner-207 kernel: [19492.615339] ? do_syscall_64+0x69/0xc0 Aug 22 10:48:38 juju-e4d256-prod-github-runner-207 kernel: [19492.615961] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 10:48:38 juju-e4d256-prod-github-runner-207 kernel: [19492.616665] RIP: 0033:0x7faa5d0edaff Aug 22 10:48:38 juju-e4d256-prod-github-runner-207 kernel: [19492.617309] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 10:48:38 juju-e4d256-prod-github-runner-207 kernel: [19492.619316] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 10:48:38 juju-e4d256-prod-github-runner-207 kernel: [19492.620225] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 10:48:38 juju-e4d256-prod-github-runner-207 kernel: [19492.621113] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 10:48:38 juju-e4d256-prod-github-runner-207 kernel: [19492.622003] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 10:48:38 juju-e4d256-prod-github-runner-207 kernel: [19492.622897] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 10:48:38 juju-e4d256-prod-github-runner-207 kernel: [19492.623791] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 10:48:38 juju-e4d256-prod-github-runner-207 kernel: [19492.624682] Aug 22 10:49:06 juju-e4d256-prod-github-runner-207 kernel: [19520.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 18071s! [qemu-system-x86:6715] Aug 22 10:49:06 juju-e4d256-prod-github-runner-207 kernel: [19520.543791] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 10:49:06 juju-e4d256-prod-github-runner-207 kernel: [19520.544075] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 10:49:06 juju-e4d256-prod-github-runner-207 kernel: [19520.556178] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 10:49:06 juju-e4d256-prod-github-runner-207 kernel: [19520.557449] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 10:49:06 juju-e4d256-prod-github-runner-207 kernel: [19520.558700] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:49:06 juju-e4d256-prod-github-runner-207 kernel: [19520.559759] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 10:49:06 juju-e4d256-prod-github-runner-207 kernel: [19520.562326] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 10:49:06 juju-e4d256-prod-github-runner-207 kernel: [19520.563367] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 10:49:06 juju-e4d256-prod-github-runner-207 kernel: [19520.564534] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 10:49:06 juju-e4d256-prod-github-runner-207 kernel: [19520.565695] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 10:49:06 juju-e4d256-prod-github-runner-207 kernel: [19520.566867] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 10:49:06 juju-e4d256-prod-github-runner-207 kernel: [19520.568037] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 10:49:06 juju-e4d256-prod-github-runner-207 kernel: [19520.569209] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 10:49:06 juju-e4d256-prod-github-runner-207 kernel: [19520.570458] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 10:49:06 juju-e4d256-prod-github-runner-207 kernel: [19520.571583] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 10:49:06 juju-e4d256-prod-github-runner-207 kernel: [19520.572797] Call Trace: Aug 22 10:49:06 juju-e4d256-prod-github-runner-207 kernel: [19520.573714] Aug 22 10:49:06 juju-e4d256-prod-github-runner-207 kernel: [19520.574618] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:49:06 juju-e4d256-prod-github-runner-207 kernel: [19520.575653] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:49:06 juju-e4d256-prod-github-runner-207 kernel: [19520.576674] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:49:06 juju-e4d256-prod-github-runner-207 kernel: [19520.577768] ? show_regs.part.0+0x23/0x29 Aug 22 10:49:06 juju-e4d256-prod-github-runner-207 kernel: [19520.578773] ? show_regs.cold+0x8/0xd Aug 22 10:49:06 juju-e4d256-prod-github-runner-207 kernel: [19520.579743] ? watchdog_timer_fn+0x1be/0x220 Aug 22 10:49:06 juju-e4d256-prod-github-runner-207 kernel: [19520.580750] ? lockup_detector_update_enable+0x60/0x60 Aug 22 10:49:06 juju-e4d256-prod-github-runner-207 kernel: [19520.581813] ? __hrtimer_run_queues+0x107/0x230 Aug 22 10:49:06 juju-e4d256-prod-github-runner-207 kernel: [19520.582857] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 10:49:06 juju-e4d256-prod-github-runner-207 kernel: [19520.583881] ? hrtimer_interrupt+0x101/0x220 Aug 22 10:49:06 juju-e4d256-prod-github-runner-207 kernel: [19520.584897] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 10:49:06 juju-e4d256-prod-github-runner-207 kernel: [19520.585981] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 10:49:06 juju-e4d256-prod-github-runner-207 kernel: [19520.587071] Aug 22 10:49:06 juju-e4d256-prod-github-runner-207 kernel: [19520.587931] Aug 22 10:49:06 juju-e4d256-prod-github-runner-207 kernel: [19520.588772] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 10:49:06 juju-e4d256-prod-github-runner-207 kernel: [19520.589802] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:49:06 juju-e4d256-prod-github-runner-207 kernel: [19520.590858] ? _raw_spin_lock+0x22/0x30 Aug 22 10:49:06 juju-e4d256-prod-github-runner-207 kernel: [19520.591802] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:49:06 juju-e4d256-prod-github-runner-207 kernel: [19520.592861] direct_page_fault+0x206/0x310 [kvm] Aug 22 10:49:06 juju-e4d256-prod-github-runner-207 kernel: [19520.593998] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 10:49:06 juju-e4d256-prod-github-runner-207 kernel: [19520.595057] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 10:49:06 juju-e4d256-prod-github-runner-207 kernel: [19520.596060] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 10:49:06 juju-e4d256-prod-github-runner-207 kernel: [19520.597129] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 10:49:06 juju-e4d256-prod-github-runner-207 kernel: [19520.598082] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 10:49:06 juju-e4d256-prod-github-runner-207 kernel: [19520.599082] handle_exit+0x98/0x230 [kvm_amd] Aug 22 10:49:06 juju-e4d256-prod-github-runner-207 kernel: [19520.599974] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 10:49:06 juju-e4d256-prod-github-runner-207 kernel: [19520.600891] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 10:49:06 juju-e4d256-prod-github-runner-207 kernel: [19520.601819] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 10:49:06 juju-e4d256-prod-github-runner-207 kernel: [19520.602744] vcpu_run+0x62/0x2c0 [kvm] Aug 22 10:49:06 juju-e4d256-prod-github-runner-207 kernel: [19520.603556] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 10:49:06 juju-e4d256-prod-github-runner-207 kernel: [19520.604363] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 10:49:06 juju-e4d256-prod-github-runner-207 kernel: [19520.605216] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 10:49:06 juju-e4d256-prod-github-runner-207 kernel: [19520.606030] ? __seccomp_filter+0x4a/0x4a0 Aug 22 10:49:06 juju-e4d256-prod-github-runner-207 kernel: [19520.606824] ? __fget_files+0x86/0xc0 Aug 22 10:49:06 juju-e4d256-prod-github-runner-207 kernel: [19520.607538] __x64_sys_ioctl+0x95/0xd0 Aug 22 10:49:06 juju-e4d256-prod-github-runner-207 kernel: [19520.608235] do_syscall_64+0x5c/0xc0 Aug 22 10:49:06 juju-e4d256-prod-github-runner-207 kernel: [19520.608901] ? do_futex+0x162/0x1f0 Aug 22 10:49:06 juju-e4d256-prod-github-runner-207 kernel: [19520.609549] ? __x64_sys_futex+0x78/0x1e0 Aug 22 10:49:06 juju-e4d256-prod-github-runner-207 kernel: [19520.610222] ? __secure_computing+0xa9/0x120 Aug 22 10:49:06 juju-e4d256-prod-github-runner-207 kernel: [19520.610936] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 10:49:06 juju-e4d256-prod-github-runner-207 kernel: [19520.611695] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:49:06 juju-e4d256-prod-github-runner-207 kernel: [19520.612415] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:49:06 juju-e4d256-prod-github-runner-207 kernel: [19520.613138] ? do_syscall_64+0x69/0xc0 Aug 22 10:49:06 juju-e4d256-prod-github-runner-207 kernel: [19520.613788] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:49:06 juju-e4d256-prod-github-runner-207 kernel: [19520.614509] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:49:06 juju-e4d256-prod-github-runner-207 kernel: [19520.615210] ? do_syscall_64+0x69/0xc0 Aug 22 10:49:06 juju-e4d256-prod-github-runner-207 kernel: [19520.615833] ? do_syscall_64+0x69/0xc0 Aug 22 10:49:06 juju-e4d256-prod-github-runner-207 kernel: [19520.616455] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 10:49:06 juju-e4d256-prod-github-runner-207 kernel: [19520.617184] RIP: 0033:0x7faa5d0edaff Aug 22 10:49:06 juju-e4d256-prod-github-runner-207 kernel: [19520.617842] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 10:49:06 juju-e4d256-prod-github-runner-207 kernel: [19520.619852] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 10:49:06 juju-e4d256-prod-github-runner-207 kernel: [19520.620764] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 10:49:06 juju-e4d256-prod-github-runner-207 kernel: [19520.621655] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 10:49:06 juju-e4d256-prod-github-runner-207 kernel: [19520.622562] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 10:49:06 juju-e4d256-prod-github-runner-207 kernel: [19520.623493] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 10:49:06 juju-e4d256-prod-github-runner-207 kernel: [19520.624445] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 10:49:06 juju-e4d256-prod-github-runner-207 kernel: [19520.625374] Aug 22 10:49:34 juju-e4d256-prod-github-runner-207 kernel: [19548.542280] watchdog: BUG: soft lockup - CPU#1 stuck for 18097s! [qemu-system-x86:6715] Aug 22 10:49:34 juju-e4d256-prod-github-runner-207 kernel: [19548.543945] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 10:49:34 juju-e4d256-prod-github-runner-207 kernel: [19548.544019] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 10:49:34 juju-e4d256-prod-github-runner-207 kernel: [19548.568950] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 10:49:34 juju-e4d256-prod-github-runner-207 kernel: [19548.571287] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 10:49:34 juju-e4d256-prod-github-runner-207 kernel: [19548.573544] RIP: 0010:native_queued_spin_lock_slowpath+0xc/0x40 Aug 22 10:49:34 juju-e4d256-prod-github-runner-207 kernel: [19548.576696] Code: fe ff ff eb af 4c 89 fe 48 c7 c7 20 99 e9 89 e8 ca 69 55 00 e9 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 <8b> 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 eb Aug 22 10:49:34 juju-e4d256-prod-github-runner-207 kernel: [19548.581336] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 10:49:34 juju-e4d256-prod-github-runner-207 kernel: [19548.582422] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 10:49:34 juju-e4d256-prod-github-runner-207 kernel: [19548.585617] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 10:49:34 juju-e4d256-prod-github-runner-207 kernel: [19548.586812] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 10:49:34 juju-e4d256-prod-github-runner-207 kernel: [19548.587993] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 10:49:34 juju-e4d256-prod-github-runner-207 kernel: [19548.589174] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 10:49:34 juju-e4d256-prod-github-runner-207 kernel: [19548.590383] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 10:49:34 juju-e4d256-prod-github-runner-207 kernel: [19548.591632] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 10:49:34 juju-e4d256-prod-github-runner-207 kernel: [19548.592758] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 10:49:34 juju-e4d256-prod-github-runner-207 kernel: [19548.593989] Call Trace: Aug 22 10:49:34 juju-e4d256-prod-github-runner-207 kernel: [19548.594914] Aug 22 10:49:34 juju-e4d256-prod-github-runner-207 kernel: [19548.595803] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:49:34 juju-e4d256-prod-github-runner-207 kernel: [19548.596846] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:49:34 juju-e4d256-prod-github-runner-207 kernel: [19548.597913] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:49:34 juju-e4d256-prod-github-runner-207 kernel: [19548.599019] ? show_regs.part.0+0x23/0x29 Aug 22 10:49:34 juju-e4d256-prod-github-runner-207 kernel: [19548.600030] ? show_regs.cold+0x8/0xd Aug 22 10:49:34 juju-e4d256-prod-github-runner-207 kernel: [19548.601007] ? watchdog_timer_fn+0x1be/0x220 Aug 22 10:49:34 juju-e4d256-prod-github-runner-207 kernel: [19548.602059] ? lockup_detector_update_enable+0x60/0x60 Aug 22 10:49:34 juju-e4d256-prod-github-runner-207 kernel: [19548.603141] ? __hrtimer_run_queues+0x107/0x230 Aug 22 10:49:34 juju-e4d256-prod-github-runner-207 kernel: [19548.604179] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 10:49:34 juju-e4d256-prod-github-runner-207 kernel: [19548.605210] ? hrtimer_interrupt+0x101/0x220 Aug 22 10:49:34 juju-e4d256-prod-github-runner-207 kernel: [19548.606248] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 10:49:34 juju-e4d256-prod-github-runner-207 kernel: [19548.607340] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 10:49:34 juju-e4d256-prod-github-runner-207 kernel: [19548.608408] Aug 22 10:49:34 juju-e4d256-prod-github-runner-207 kernel: [19548.609270] Aug 22 10:49:34 juju-e4d256-prod-github-runner-207 kernel: [19548.610121] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 10:49:34 juju-e4d256-prod-github-runner-207 kernel: [19548.611159] ? native_queued_spin_lock_slowpath+0xc/0x40 Aug 22 10:49:34 juju-e4d256-prod-github-runner-207 kernel: [19548.612228] ? _raw_spin_lock+0x22/0x30 Aug 22 10:49:34 juju-e4d256-prod-github-runner-207 kernel: [19548.613192] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:49:34 juju-e4d256-prod-github-runner-207 kernel: [19548.614225] direct_page_fault+0x206/0x310 [kvm] Aug 22 10:49:34 juju-e4d256-prod-github-runner-207 kernel: [19548.615252] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 10:49:34 juju-e4d256-prod-github-runner-207 kernel: [19548.616263] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 10:49:34 juju-e4d256-prod-github-runner-207 kernel: [19548.617280] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 10:49:34 juju-e4d256-prod-github-runner-207 kernel: [19548.618303] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 10:49:34 juju-e4d256-prod-github-runner-207 kernel: [19548.619258] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 10:49:34 juju-e4d256-prod-github-runner-207 kernel: [19548.620237] handle_exit+0x98/0x230 [kvm_amd] Aug 22 10:49:34 juju-e4d256-prod-github-runner-207 kernel: [19548.621138] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 10:49:34 juju-e4d256-prod-github-runner-207 kernel: [19548.622079] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 10:49:34 juju-e4d256-prod-github-runner-207 kernel: [19548.623017] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 10:49:34 juju-e4d256-prod-github-runner-207 kernel: [19548.623928] vcpu_run+0x62/0x2c0 [kvm] Aug 22 10:49:34 juju-e4d256-prod-github-runner-207 kernel: [19548.624738] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 10:49:34 juju-e4d256-prod-github-runner-207 kernel: [19548.625545] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 10:49:34 juju-e4d256-prod-github-runner-207 kernel: [19548.626414] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 10:49:34 juju-e4d256-prod-github-runner-207 kernel: [19548.627224] ? __seccomp_filter+0x4a/0x4a0 Aug 22 10:49:34 juju-e4d256-prod-github-runner-207 kernel: [19548.627980] ? __fget_files+0x86/0xc0 Aug 22 10:49:34 juju-e4d256-prod-github-runner-207 kernel: [19548.628700] __x64_sys_ioctl+0x95/0xd0 Aug 22 10:49:34 juju-e4d256-prod-github-runner-207 kernel: [19548.629393] do_syscall_64+0x5c/0xc0 Aug 22 10:49:34 juju-e4d256-prod-github-runner-207 kernel: [19548.630070] ? do_futex+0x162/0x1f0 Aug 22 10:49:34 juju-e4d256-prod-github-runner-207 kernel: [19548.630721] ? __x64_sys_futex+0x78/0x1e0 Aug 22 10:49:34 juju-e4d256-prod-github-runner-207 kernel: [19548.631406] ? __secure_computing+0xa9/0x120 Aug 22 10:49:34 juju-e4d256-prod-github-runner-207 kernel: [19548.632117] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 10:49:34 juju-e4d256-prod-github-runner-207 kernel: [19548.633072] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:49:34 juju-e4d256-prod-github-runner-207 kernel: [19548.633806] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:49:34 juju-e4d256-prod-github-runner-207 kernel: [19548.634544] ? do_syscall_64+0x69/0xc0 Aug 22 10:49:34 juju-e4d256-prod-github-runner-207 kernel: [19548.635193] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:49:34 juju-e4d256-prod-github-runner-207 kernel: [19548.635893] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:49:34 juju-e4d256-prod-github-runner-207 kernel: [19548.636587] ? do_syscall_64+0x69/0xc0 Aug 22 10:49:34 juju-e4d256-prod-github-runner-207 kernel: [19548.637213] ? do_syscall_64+0x69/0xc0 Aug 22 10:49:34 juju-e4d256-prod-github-runner-207 kernel: [19548.637841] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 10:49:34 juju-e4d256-prod-github-runner-207 kernel: [19548.638597] RIP: 0033:0x7faa5d0edaff Aug 22 10:49:34 juju-e4d256-prod-github-runner-207 kernel: [19548.639226] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 10:49:34 juju-e4d256-prod-github-runner-207 kernel: [19548.641212] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 10:49:34 juju-e4d256-prod-github-runner-207 kernel: [19548.642150] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 10:49:34 juju-e4d256-prod-github-runner-207 kernel: [19548.643051] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 10:49:34 juju-e4d256-prod-github-runner-207 kernel: [19548.643950] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 10:49:34 juju-e4d256-prod-github-runner-207 kernel: [19548.644838] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 10:49:34 juju-e4d256-prod-github-runner-207 kernel: [19548.645726] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 10:49:34 juju-e4d256-prod-github-runner-207 kernel: [19548.646629] Aug 22 10:50:02 juju-e4d256-prod-github-runner-207 kernel: [19576.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 18124s! [qemu-system-x86:6715] Aug 22 10:50:02 juju-e4d256-prod-github-runner-207 kernel: [19576.543736] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 10:50:02 juju-e4d256-prod-github-runner-207 kernel: [19576.543989] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 10:50:02 juju-e4d256-prod-github-runner-207 kernel: [19576.556030] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 10:50:02 juju-e4d256-prod-github-runner-207 kernel: [19576.557290] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 10:50:02 juju-e4d256-prod-github-runner-207 kernel: [19576.558519] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:50:02 juju-e4d256-prod-github-runner-207 kernel: [19576.559577] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 10:50:02 juju-e4d256-prod-github-runner-207 kernel: [19576.562123] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 10:50:02 juju-e4d256-prod-github-runner-207 kernel: [19576.563164] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 10:50:02 juju-e4d256-prod-github-runner-207 kernel: [19576.564323] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 10:50:02 juju-e4d256-prod-github-runner-207 kernel: [19576.565487] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 10:50:02 juju-e4d256-prod-github-runner-207 kernel: [19576.566650] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 10:50:02 juju-e4d256-prod-github-runner-207 kernel: [19576.567809] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 10:50:02 juju-e4d256-prod-github-runner-207 kernel: [19576.568978] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 10:50:02 juju-e4d256-prod-github-runner-207 kernel: [19576.570220] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 10:50:02 juju-e4d256-prod-github-runner-207 kernel: [19576.571323] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 10:50:02 juju-e4d256-prod-github-runner-207 kernel: [19576.572513] Call Trace: Aug 22 10:50:02 juju-e4d256-prod-github-runner-207 kernel: [19576.573447] Aug 22 10:50:02 juju-e4d256-prod-github-runner-207 kernel: [19576.574378] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:50:02 juju-e4d256-prod-github-runner-207 kernel: [19576.575412] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:50:02 juju-e4d256-prod-github-runner-207 kernel: [19576.576430] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:50:02 juju-e4d256-prod-github-runner-207 kernel: [19576.577527] ? show_regs.part.0+0x23/0x29 Aug 22 10:50:02 juju-e4d256-prod-github-runner-207 kernel: [19576.578532] ? show_regs.cold+0x8/0xd Aug 22 10:50:02 juju-e4d256-prod-github-runner-207 kernel: [19576.579501] ? watchdog_timer_fn+0x1be/0x220 Aug 22 10:50:02 juju-e4d256-prod-github-runner-207 kernel: [19576.580506] ? lockup_detector_update_enable+0x60/0x60 Aug 22 10:50:02 juju-e4d256-prod-github-runner-207 kernel: [19576.581567] ? __hrtimer_run_queues+0x107/0x230 Aug 22 10:50:02 juju-e4d256-prod-github-runner-207 kernel: [19576.582604] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 10:50:02 juju-e4d256-prod-github-runner-207 kernel: [19576.583625] ? hrtimer_interrupt+0x101/0x220 Aug 22 10:50:02 juju-e4d256-prod-github-runner-207 kernel: [19576.584639] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 10:50:02 juju-e4d256-prod-github-runner-207 kernel: [19576.586572] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 10:50:02 juju-e4d256-prod-github-runner-207 kernel: [19576.587632] Aug 22 10:50:02 juju-e4d256-prod-github-runner-207 kernel: [19576.588484] Aug 22 10:50:02 juju-e4d256-prod-github-runner-207 kernel: [19576.589319] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 10:50:02 juju-e4d256-prod-github-runner-207 kernel: [19576.590366] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:50:02 juju-e4d256-prod-github-runner-207 kernel: [19576.591401] ? _raw_spin_lock+0x22/0x30 Aug 22 10:50:02 juju-e4d256-prod-github-runner-207 kernel: [19576.592342] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:50:02 juju-e4d256-prod-github-runner-207 kernel: [19576.593355] direct_page_fault+0x206/0x310 [kvm] Aug 22 10:50:02 juju-e4d256-prod-github-runner-207 kernel: [19576.594393] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 10:50:02 juju-e4d256-prod-github-runner-207 kernel: [19576.595397] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 10:50:02 juju-e4d256-prod-github-runner-207 kernel: [19576.596394] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 10:50:02 juju-e4d256-prod-github-runner-207 kernel: [19576.597395] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 10:50:02 juju-e4d256-prod-github-runner-207 kernel: [19576.598349] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 10:50:02 juju-e4d256-prod-github-runner-207 kernel: [19576.599323] handle_exit+0x98/0x230 [kvm_amd] Aug 22 10:50:02 juju-e4d256-prod-github-runner-207 kernel: [19576.600216] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 10:50:02 juju-e4d256-prod-github-runner-207 kernel: [19576.601132] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 10:50:02 juju-e4d256-prod-github-runner-207 kernel: [19576.602066] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 10:50:02 juju-e4d256-prod-github-runner-207 kernel: [19576.602965] vcpu_run+0x62/0x2c0 [kvm] Aug 22 10:50:02 juju-e4d256-prod-github-runner-207 kernel: [19576.603778] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 10:50:02 juju-e4d256-prod-github-runner-207 kernel: [19576.604586] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 10:50:02 juju-e4d256-prod-github-runner-207 kernel: [19576.605439] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 10:50:02 juju-e4d256-prod-github-runner-207 kernel: [19576.606250] ? __seccomp_filter+0x4a/0x4a0 Aug 22 10:50:02 juju-e4d256-prod-github-runner-207 kernel: [19576.606988] ? __fget_files+0x86/0xc0 Aug 22 10:50:02 juju-e4d256-prod-github-runner-207 kernel: [19576.607851] __x64_sys_ioctl+0x95/0xd0 Aug 22 10:50:02 juju-e4d256-prod-github-runner-207 kernel: [19576.608542] do_syscall_64+0x5c/0xc0 Aug 22 10:50:02 juju-e4d256-prod-github-runner-207 kernel: [19576.609204] ? do_futex+0x162/0x1f0 Aug 22 10:50:02 juju-e4d256-prod-github-runner-207 kernel: [19576.609861] ? __x64_sys_futex+0x78/0x1e0 Aug 22 10:50:02 juju-e4d256-prod-github-runner-207 kernel: [19576.610536] ? __secure_computing+0xa9/0x120 Aug 22 10:50:02 juju-e4d256-prod-github-runner-207 kernel: [19576.611223] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 10:50:02 juju-e4d256-prod-github-runner-207 kernel: [19576.611980] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:50:02 juju-e4d256-prod-github-runner-207 kernel: [19576.612698] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:50:02 juju-e4d256-prod-github-runner-207 kernel: [19576.613412] ? do_syscall_64+0x69/0xc0 Aug 22 10:50:02 juju-e4d256-prod-github-runner-207 kernel: [19576.614064] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:50:02 juju-e4d256-prod-github-runner-207 kernel: [19576.614766] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:50:02 juju-e4d256-prod-github-runner-207 kernel: [19576.615457] ? do_syscall_64+0x69/0xc0 Aug 22 10:50:02 juju-e4d256-prod-github-runner-207 kernel: [19576.616078] ? do_syscall_64+0x69/0xc0 Aug 22 10:50:02 juju-e4d256-prod-github-runner-207 kernel: [19576.616698] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 10:50:02 juju-e4d256-prod-github-runner-207 kernel: [19576.617400] RIP: 0033:0x7faa5d0edaff Aug 22 10:50:02 juju-e4d256-prod-github-runner-207 kernel: [19576.618055] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 10:50:02 juju-e4d256-prod-github-runner-207 kernel: [19576.620037] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 10:50:02 juju-e4d256-prod-github-runner-207 kernel: [19576.620948] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 10:50:02 juju-e4d256-prod-github-runner-207 kernel: [19576.621840] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 10:50:02 juju-e4d256-prod-github-runner-207 kernel: [19576.622730] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 10:50:02 juju-e4d256-prod-github-runner-207 kernel: [19576.623619] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 10:50:02 juju-e4d256-prod-github-runner-207 kernel: [19576.624504] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 10:50:02 juju-e4d256-prod-github-runner-207 kernel: [19576.625394] Aug 22 10:50:30 juju-e4d256-prod-github-runner-207 kernel: [19604.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 18150s! [qemu-system-x86:6715] Aug 22 10:50:30 juju-e4d256-prod-github-runner-207 kernel: [19604.543765] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 10:50:30 juju-e4d256-prod-github-runner-207 kernel: [19604.544017] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 10:50:30 juju-e4d256-prod-github-runner-207 kernel: [19604.556206] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 10:50:30 juju-e4d256-prod-github-runner-207 kernel: [19604.557496] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 10:50:30 juju-e4d256-prod-github-runner-207 kernel: [19604.558743] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:50:30 juju-e4d256-prod-github-runner-207 kernel: [19604.559815] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 10:50:30 juju-e4d256-prod-github-runner-207 kernel: [19604.562404] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 10:50:30 juju-e4d256-prod-github-runner-207 kernel: [19604.563494] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 10:50:30 juju-e4d256-prod-github-runner-207 kernel: [19604.564653] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 10:50:30 juju-e4d256-prod-github-runner-207 kernel: [19604.565833] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 10:50:30 juju-e4d256-prod-github-runner-207 kernel: [19604.567002] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 10:50:30 juju-e4d256-prod-github-runner-207 kernel: [19604.568180] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 10:50:30 juju-e4d256-prod-github-runner-207 kernel: [19604.569369] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 10:50:30 juju-e4d256-prod-github-runner-207 kernel: [19604.570644] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 10:50:30 juju-e4d256-prod-github-runner-207 kernel: [19604.571777] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 10:50:30 juju-e4d256-prod-github-runner-207 kernel: [19604.573017] Call Trace: Aug 22 10:50:30 juju-e4d256-prod-github-runner-207 kernel: [19604.573961] Aug 22 10:50:30 juju-e4d256-prod-github-runner-207 kernel: [19604.574873] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:50:30 juju-e4d256-prod-github-runner-207 kernel: [19604.575915] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:50:30 juju-e4d256-prod-github-runner-207 kernel: [19604.576936] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:50:30 juju-e4d256-prod-github-runner-207 kernel: [19604.578053] ? show_regs.part.0+0x23/0x29 Aug 22 10:50:30 juju-e4d256-prod-github-runner-207 kernel: [19604.579067] ? show_regs.cold+0x8/0xd Aug 22 10:50:30 juju-e4d256-prod-github-runner-207 kernel: [19604.580040] ? watchdog_timer_fn+0x1be/0x220 Aug 22 10:50:30 juju-e4d256-prod-github-runner-207 kernel: [19604.581064] ? lockup_detector_update_enable+0x60/0x60 Aug 22 10:50:30 juju-e4d256-prod-github-runner-207 kernel: [19604.582150] ? __hrtimer_run_queues+0x107/0x230 Aug 22 10:50:30 juju-e4d256-prod-github-runner-207 kernel: [19604.583198] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 10:50:30 juju-e4d256-prod-github-runner-207 kernel: [19604.584239] ? hrtimer_interrupt+0x101/0x220 Aug 22 10:50:30 juju-e4d256-prod-github-runner-207 kernel: [19604.585254] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 10:50:30 juju-e4d256-prod-github-runner-207 kernel: [19604.586345] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 10:50:30 juju-e4d256-prod-github-runner-207 kernel: [19604.587399] Aug 22 10:50:30 juju-e4d256-prod-github-runner-207 kernel: [19604.588248] Aug 22 10:50:30 juju-e4d256-prod-github-runner-207 kernel: [19604.589097] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 10:50:30 juju-e4d256-prod-github-runner-207 kernel: [19604.590151] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:50:30 juju-e4d256-prod-github-runner-207 kernel: [19604.591191] ? _raw_spin_lock+0x22/0x30 Aug 22 10:50:30 juju-e4d256-prod-github-runner-207 kernel: [19604.592157] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:50:30 juju-e4d256-prod-github-runner-207 kernel: [19604.593178] direct_page_fault+0x206/0x310 [kvm] Aug 22 10:50:30 juju-e4d256-prod-github-runner-207 kernel: [19604.594265] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 10:50:30 juju-e4d256-prod-github-runner-207 kernel: [19604.595330] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 10:50:30 juju-e4d256-prod-github-runner-207 kernel: [19604.596356] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 10:50:30 juju-e4d256-prod-github-runner-207 kernel: [19604.597384] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 10:50:30 juju-e4d256-prod-github-runner-207 kernel: [19604.598334] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 10:50:30 juju-e4d256-prod-github-runner-207 kernel: [19604.599343] handle_exit+0x98/0x230 [kvm_amd] Aug 22 10:50:30 juju-e4d256-prod-github-runner-207 kernel: [19604.600256] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 10:50:30 juju-e4d256-prod-github-runner-207 kernel: [19604.601181] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 10:50:30 juju-e4d256-prod-github-runner-207 kernel: [19604.602128] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 10:50:30 juju-e4d256-prod-github-runner-207 kernel: [19604.603038] vcpu_run+0x62/0x2c0 [kvm] Aug 22 10:50:30 juju-e4d256-prod-github-runner-207 kernel: [19604.603875] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 10:50:30 juju-e4d256-prod-github-runner-207 kernel: [19604.604716] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 10:50:30 juju-e4d256-prod-github-runner-207 kernel: [19604.605738] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 10:50:30 juju-e4d256-prod-github-runner-207 kernel: [19604.606587] ? __seccomp_filter+0x4a/0x4a0 Aug 22 10:50:30 juju-e4d256-prod-github-runner-207 kernel: [19604.607343] ? __fget_files+0x86/0xc0 Aug 22 10:50:30 juju-e4d256-prod-github-runner-207 kernel: [19604.608061] __x64_sys_ioctl+0x95/0xd0 Aug 22 10:50:30 juju-e4d256-prod-github-runner-207 kernel: [19604.608761] do_syscall_64+0x5c/0xc0 Aug 22 10:50:30 juju-e4d256-prod-github-runner-207 kernel: [19604.609493] ? do_futex+0x162/0x1f0 Aug 22 10:50:30 juju-e4d256-prod-github-runner-207 kernel: [19604.610152] ? __x64_sys_futex+0x78/0x1e0 Aug 22 10:50:30 juju-e4d256-prod-github-runner-207 kernel: [19604.610830] ? __secure_computing+0xa9/0x120 Aug 22 10:50:30 juju-e4d256-prod-github-runner-207 kernel: [19604.611519] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 10:50:30 juju-e4d256-prod-github-runner-207 kernel: [19604.612310] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:50:30 juju-e4d256-prod-github-runner-207 kernel: [19604.613043] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:50:30 juju-e4d256-prod-github-runner-207 kernel: [19604.613804] ? do_syscall_64+0x69/0xc0 Aug 22 10:50:30 juju-e4d256-prod-github-runner-207 kernel: [19604.614485] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:50:30 juju-e4d256-prod-github-runner-207 kernel: [19604.615207] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:50:30 juju-e4d256-prod-github-runner-207 kernel: [19604.615915] ? do_syscall_64+0x69/0xc0 Aug 22 10:50:30 juju-e4d256-prod-github-runner-207 kernel: [19604.616622] ? do_syscall_64+0x69/0xc0 Aug 22 10:50:30 juju-e4d256-prod-github-runner-207 kernel: [19604.617265] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 10:50:30 juju-e4d256-prod-github-runner-207 kernel: [19604.618037] RIP: 0033:0x7faa5d0edaff Aug 22 10:50:30 juju-e4d256-prod-github-runner-207 kernel: [19604.618738] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 10:50:30 juju-e4d256-prod-github-runner-207 kernel: [19604.620930] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 10:50:30 juju-e4d256-prod-github-runner-207 kernel: [19604.621879] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 10:50:30 juju-e4d256-prod-github-runner-207 kernel: [19604.622768] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 10:50:30 juju-e4d256-prod-github-runner-207 kernel: [19604.623677] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 10:50:30 juju-e4d256-prod-github-runner-207 kernel: [19604.624574] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 10:50:30 juju-e4d256-prod-github-runner-207 kernel: [19604.625488] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 10:50:30 juju-e4d256-prod-github-runner-207 kernel: [19604.626394] Aug 22 10:50:44 juju-e4d256-prod-github-runner-207 kernel: [19618.496705] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 10:50:44 juju-e4d256-prod-github-runner-207 kernel: [19618.498309] rcu: 1-....: (4860138 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=2354127 Aug 22 10:50:44 juju-e4d256-prod-github-runner-207 kernel: [19618.499429] (t=4875324 jiffies g=23269 q=25714) Aug 22 10:50:44 juju-e4d256-prod-github-runner-207 kernel: [19618.500210] NMI backtrace for cpu 1 Aug 22 10:50:44 juju-e4d256-prod-github-runner-207 kernel: [19618.500920] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 10:50:44 juju-e4d256-prod-github-runner-207 kernel: [19618.502040] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 10:50:44 juju-e4d256-prod-github-runner-207 kernel: [19618.503104] Call Trace: Aug 22 10:50:44 juju-e4d256-prod-github-runner-207 kernel: [19618.503781] Aug 22 10:50:44 juju-e4d256-prod-github-runner-207 kernel: [19618.504433] show_stack+0x52/0x5c Aug 22 10:50:44 juju-e4d256-prod-github-runner-207 kernel: [19618.505175] dump_stack_lvl+0x4a/0x63 Aug 22 10:50:44 juju-e4d256-prod-github-runner-207 kernel: [19618.505925] dump_stack+0x10/0x16 Aug 22 10:50:44 juju-e4d256-prod-github-runner-207 kernel: [19618.506644] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 10:50:44 juju-e4d256-prod-github-runner-207 kernel: [19618.507425] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 10:50:44 juju-e4d256-prod-github-runner-207 kernel: [19618.508205] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 10:50:44 juju-e4d256-prod-github-runner-207 kernel: [19618.509027] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 10:50:44 juju-e4d256-prod-github-runner-207 kernel: [19618.509865] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 10:50:44 juju-e4d256-prod-github-runner-207 kernel: [19618.510670] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 10:50:44 juju-e4d256-prod-github-runner-207 kernel: [19618.511440] print_cpu_stall.cold+0x2f/0xe2 Aug 22 10:50:44 juju-e4d256-prod-github-runner-207 kernel: [19618.512203] ? timekeeping_update+0xf7/0x150 Aug 22 10:50:44 juju-e4d256-prod-github-runner-207 kernel: [19618.512977] check_cpu_stall+0x109/0x270 Aug 22 10:50:44 juju-e4d256-prod-github-runner-207 kernel: [19618.513739] rcu_sched_clock_irq+0x9a/0x250 Aug 22 10:50:44 juju-e4d256-prod-github-runner-207 kernel: [19618.514498] update_process_times+0x94/0xd0 Aug 22 10:50:44 juju-e4d256-prod-github-runner-207 kernel: [19618.515254] tick_sched_handle+0x29/0x70 Aug 22 10:50:44 juju-e4d256-prod-github-runner-207 kernel: [19618.515997] tick_sched_timer+0x8c/0xc0 Aug 22 10:50:44 juju-e4d256-prod-github-runner-207 kernel: [19618.516731] ? tick_nohz_handler+0xb0/0xb0 Aug 22 10:50:44 juju-e4d256-prod-github-runner-207 kernel: [19618.517501] __hrtimer_run_queues+0x107/0x230 Aug 22 10:50:44 juju-e4d256-prod-github-runner-207 kernel: [19618.518274] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 10:50:44 juju-e4d256-prod-github-runner-207 kernel: [19618.519047] hrtimer_interrupt+0x101/0x220 Aug 22 10:50:44 juju-e4d256-prod-github-runner-207 kernel: [19618.519802] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 10:50:44 juju-e4d256-prod-github-runner-207 kernel: [19618.520615] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 10:50:44 juju-e4d256-prod-github-runner-207 kernel: [19618.521427] Aug 22 10:50:44 juju-e4d256-prod-github-runner-207 kernel: [19618.522066] Aug 22 10:50:44 juju-e4d256-prod-github-runner-207 kernel: [19618.522693] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 10:50:44 juju-e4d256-prod-github-runner-207 kernel: [19618.523518] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:50:44 juju-e4d256-prod-github-runner-207 kernel: [19618.524395] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 10:50:44 juju-e4d256-prod-github-runner-207 kernel: [19618.526620] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 10:50:44 juju-e4d256-prod-github-runner-207 kernel: [19618.527494] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 10:50:44 juju-e4d256-prod-github-runner-207 kernel: [19618.528490] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 10:50:44 juju-e4d256-prod-github-runner-207 kernel: [19618.529480] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 10:50:44 juju-e4d256-prod-github-runner-207 kernel: [19618.530441] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 10:50:44 juju-e4d256-prod-github-runner-207 kernel: [19618.531395] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 10:50:44 juju-e4d256-prod-github-runner-207 kernel: [19618.532351] ? _raw_spin_lock+0x22/0x30 Aug 22 10:50:44 juju-e4d256-prod-github-runner-207 kernel: [19618.533117] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:50:44 juju-e4d256-prod-github-runner-207 kernel: [19618.533980] direct_page_fault+0x206/0x310 [kvm] Aug 22 10:50:44 juju-e4d256-prod-github-runner-207 kernel: [19618.534820] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 10:50:44 juju-e4d256-prod-github-runner-207 kernel: [19618.535645] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 10:50:44 juju-e4d256-prod-github-runner-207 kernel: [19618.536473] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 10:50:44 juju-e4d256-prod-github-runner-207 kernel: [19618.537306] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 10:50:44 juju-e4d256-prod-github-runner-207 kernel: [19618.538096] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 10:50:44 juju-e4d256-prod-github-runner-207 kernel: [19618.538920] handle_exit+0x98/0x230 [kvm_amd] Aug 22 10:50:44 juju-e4d256-prod-github-runner-207 kernel: [19618.539677] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 10:50:44 juju-e4d256-prod-github-runner-207 kernel: [19618.540458] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 10:50:44 juju-e4d256-prod-github-runner-207 kernel: [19618.541279] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 10:50:44 juju-e4d256-prod-github-runner-207 kernel: [19618.542063] vcpu_run+0x62/0x2c0 [kvm] Aug 22 10:50:44 juju-e4d256-prod-github-runner-207 kernel: [19618.542777] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 10:50:44 juju-e4d256-prod-github-runner-207 kernel: [19618.543512] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 10:50:44 juju-e4d256-prod-github-runner-207 kernel: [19618.544311] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 10:50:44 juju-e4d256-prod-github-runner-207 kernel: [19618.545075] ? __seccomp_filter+0x4a/0x4a0 Aug 22 10:50:44 juju-e4d256-prod-github-runner-207 kernel: [19618.545809] ? __fget_files+0x86/0xc0 Aug 22 10:50:44 juju-e4d256-prod-github-runner-207 kernel: [19618.546502] __x64_sys_ioctl+0x95/0xd0 Aug 22 10:50:44 juju-e4d256-prod-github-runner-207 kernel: [19618.547196] do_syscall_64+0x5c/0xc0 Aug 22 10:50:44 juju-e4d256-prod-github-runner-207 kernel: [19618.547873] ? do_futex+0x162/0x1f0 Aug 22 10:50:44 juju-e4d256-prod-github-runner-207 kernel: [19618.548547] ? __x64_sys_futex+0x78/0x1e0 Aug 22 10:50:44 juju-e4d256-prod-github-runner-207 kernel: [19618.549261] ? __secure_computing+0xa9/0x120 Aug 22 10:50:44 juju-e4d256-prod-github-runner-207 kernel: [19618.549981] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 10:50:44 juju-e4d256-prod-github-runner-207 kernel: [19618.550767] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:50:44 juju-e4d256-prod-github-runner-207 kernel: [19618.551524] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:50:44 juju-e4d256-prod-github-runner-207 kernel: [19618.552274] ? do_syscall_64+0x69/0xc0 Aug 22 10:50:44 juju-e4d256-prod-github-runner-207 kernel: [19618.552966] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:50:44 juju-e4d256-prod-github-runner-207 kernel: [19618.553735] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:50:44 juju-e4d256-prod-github-runner-207 kernel: [19618.554493] ? do_syscall_64+0x69/0xc0 Aug 22 10:50:44 juju-e4d256-prod-github-runner-207 kernel: [19618.555187] ? do_syscall_64+0x69/0xc0 Aug 22 10:50:44 juju-e4d256-prod-github-runner-207 kernel: [19618.555872] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 10:50:44 juju-e4d256-prod-github-runner-207 kernel: [19618.556644] RIP: 0033:0x7faa5d0edaff Aug 22 10:50:44 juju-e4d256-prod-github-runner-207 kernel: [19618.557355] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 10:50:44 juju-e4d256-prod-github-runner-207 kernel: [19618.559447] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 10:50:44 juju-e4d256-prod-github-runner-207 kernel: [19618.560409] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 10:50:44 juju-e4d256-prod-github-runner-207 kernel: [19618.561368] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 10:50:44 juju-e4d256-prod-github-runner-207 kernel: [19618.562311] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 10:50:44 juju-e4d256-prod-github-runner-207 kernel: [19618.563254] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 10:50:44 juju-e4d256-prod-github-runner-207 kernel: [19618.564175] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 10:50:44 juju-e4d256-prod-github-runner-207 kernel: [19618.565092] Aug 22 10:51:10 juju-e4d256-prod-github-runner-207 kernel: [19644.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 18187s! [qemu-system-x86:6715] Aug 22 10:51:10 juju-e4d256-prod-github-runner-207 kernel: [19644.543705] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 10:51:10 juju-e4d256-prod-github-runner-207 kernel: [19644.543959] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 10:51:10 juju-e4d256-prod-github-runner-207 kernel: [19644.556012] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 10:51:10 juju-e4d256-prod-github-runner-207 kernel: [19644.557285] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 10:51:10 juju-e4d256-prod-github-runner-207 kernel: [19644.558503] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:51:10 juju-e4d256-prod-github-runner-207 kernel: [19644.559557] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 10:51:10 juju-e4d256-prod-github-runner-207 kernel: [19644.562112] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 10:51:10 juju-e4d256-prod-github-runner-207 kernel: [19644.563161] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 10:51:10 juju-e4d256-prod-github-runner-207 kernel: [19644.564325] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 10:51:10 juju-e4d256-prod-github-runner-207 kernel: [19644.565496] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 10:51:10 juju-e4d256-prod-github-runner-207 kernel: [19644.566659] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 10:51:10 juju-e4d256-prod-github-runner-207 kernel: [19644.567824] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 10:51:10 juju-e4d256-prod-github-runner-207 kernel: [19644.568997] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 10:51:10 juju-e4d256-prod-github-runner-207 kernel: [19644.570230] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 10:51:10 juju-e4d256-prod-github-runner-207 kernel: [19644.571328] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 10:51:10 juju-e4d256-prod-github-runner-207 kernel: [19644.572519] Call Trace: Aug 22 10:51:10 juju-e4d256-prod-github-runner-207 kernel: [19644.573440] Aug 22 10:51:10 juju-e4d256-prod-github-runner-207 kernel: [19644.574337] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:51:10 juju-e4d256-prod-github-runner-207 kernel: [19644.575365] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:51:10 juju-e4d256-prod-github-runner-207 kernel: [19644.576394] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:51:10 juju-e4d256-prod-github-runner-207 kernel: [19644.577493] ? show_regs.part.0+0x23/0x29 Aug 22 10:51:10 juju-e4d256-prod-github-runner-207 kernel: [19644.578494] ? show_regs.cold+0x8/0xd Aug 22 10:51:10 juju-e4d256-prod-github-runner-207 kernel: [19644.579463] ? watchdog_timer_fn+0x1be/0x220 Aug 22 10:51:10 juju-e4d256-prod-github-runner-207 kernel: [19644.580470] ? lockup_detector_update_enable+0x60/0x60 Aug 22 10:51:10 juju-e4d256-prod-github-runner-207 kernel: [19644.581545] ? __hrtimer_run_queues+0x107/0x230 Aug 22 10:51:10 juju-e4d256-prod-github-runner-207 kernel: [19644.582571] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 10:51:10 juju-e4d256-prod-github-runner-207 kernel: [19644.583592] ? hrtimer_interrupt+0x101/0x220 Aug 22 10:51:10 juju-e4d256-prod-github-runner-207 kernel: [19644.584605] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 10:51:10 juju-e4d256-prod-github-runner-207 kernel: [19644.585680] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 10:51:10 juju-e4d256-prod-github-runner-207 kernel: [19644.586726] Aug 22 10:51:10 juju-e4d256-prod-github-runner-207 kernel: [19644.587578] Aug 22 10:51:10 juju-e4d256-prod-github-runner-207 kernel: [19644.588414] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 10:51:10 juju-e4d256-prod-github-runner-207 kernel: [19644.589453] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:51:10 juju-e4d256-prod-github-runner-207 kernel: [19644.590489] ? _raw_spin_lock+0x22/0x30 Aug 22 10:51:10 juju-e4d256-prod-github-runner-207 kernel: [19644.591630] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:51:10 juju-e4d256-prod-github-runner-207 kernel: [19644.592647] direct_page_fault+0x206/0x310 [kvm] Aug 22 10:51:10 juju-e4d256-prod-github-runner-207 kernel: [19644.593678] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 10:51:10 juju-e4d256-prod-github-runner-207 kernel: [19644.594684] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 10:51:10 juju-e4d256-prod-github-runner-207 kernel: [19644.595683] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 10:51:10 juju-e4d256-prod-github-runner-207 kernel: [19644.596679] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 10:51:10 juju-e4d256-prod-github-runner-207 kernel: [19644.597645] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 10:51:10 juju-e4d256-prod-github-runner-207 kernel: [19644.598622] handle_exit+0x98/0x230 [kvm_amd] Aug 22 10:51:10 juju-e4d256-prod-github-runner-207 kernel: [19644.599678] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 10:51:10 juju-e4d256-prod-github-runner-207 kernel: [19644.600623] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 10:51:10 juju-e4d256-prod-github-runner-207 kernel: [19644.601557] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 10:51:10 juju-e4d256-prod-github-runner-207 kernel: [19644.602461] vcpu_run+0x62/0x2c0 [kvm] Aug 22 10:51:10 juju-e4d256-prod-github-runner-207 kernel: [19644.603277] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 10:51:10 juju-e4d256-prod-github-runner-207 kernel: [19644.604083] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 10:51:10 juju-e4d256-prod-github-runner-207 kernel: [19644.604948] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 10:51:10 juju-e4d256-prod-github-runner-207 kernel: [19644.605745] ? __seccomp_filter+0x4a/0x4a0 Aug 22 10:51:10 juju-e4d256-prod-github-runner-207 kernel: [19644.606488] ? __fget_files+0x86/0xc0 Aug 22 10:51:10 juju-e4d256-prod-github-runner-207 kernel: [19644.607190] __x64_sys_ioctl+0x95/0xd0 Aug 22 10:51:10 juju-e4d256-prod-github-runner-207 kernel: [19644.607887] do_syscall_64+0x5c/0xc0 Aug 22 10:51:10 juju-e4d256-prod-github-runner-207 kernel: [19644.608551] ? do_futex+0x162/0x1f0 Aug 22 10:51:10 juju-e4d256-prod-github-runner-207 kernel: [19644.609209] ? __x64_sys_futex+0x78/0x1e0 Aug 22 10:51:10 juju-e4d256-prod-github-runner-207 kernel: [19644.609883] ? __secure_computing+0xa9/0x120 Aug 22 10:51:10 juju-e4d256-prod-github-runner-207 kernel: [19644.610571] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 10:51:10 juju-e4d256-prod-github-runner-207 kernel: [19644.611329] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:51:10 juju-e4d256-prod-github-runner-207 kernel: [19644.612053] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:51:10 juju-e4d256-prod-github-runner-207 kernel: [19644.612771] ? do_syscall_64+0x69/0xc0 Aug 22 10:51:10 juju-e4d256-prod-github-runner-207 kernel: [19644.613424] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:51:10 juju-e4d256-prod-github-runner-207 kernel: [19644.614125] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:51:10 juju-e4d256-prod-github-runner-207 kernel: [19644.614818] ? do_syscall_64+0x69/0xc0 Aug 22 10:51:10 juju-e4d256-prod-github-runner-207 kernel: [19644.615442] ? do_syscall_64+0x69/0xc0 Aug 22 10:51:10 juju-e4d256-prod-github-runner-207 kernel: [19644.616064] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 10:51:10 juju-e4d256-prod-github-runner-207 kernel: [19644.616769] RIP: 0033:0x7faa5d0edaff Aug 22 10:51:10 juju-e4d256-prod-github-runner-207 kernel: [19644.617424] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 10:51:10 juju-e4d256-prod-github-runner-207 kernel: [19644.619408] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 10:51:10 juju-e4d256-prod-github-runner-207 kernel: [19644.620316] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 10:51:10 juju-e4d256-prod-github-runner-207 kernel: [19644.621232] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 10:51:10 juju-e4d256-prod-github-runner-207 kernel: [19644.622121] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 10:51:10 juju-e4d256-prod-github-runner-207 kernel: [19644.623010] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 10:51:10 juju-e4d256-prod-github-runner-207 kernel: [19644.623902] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 10:51:10 juju-e4d256-prod-github-runner-207 kernel: [19644.624794] Aug 22 10:51:38 juju-e4d256-prod-github-runner-207 kernel: [19672.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 18213s! [qemu-system-x86:6715] Aug 22 10:51:38 juju-e4d256-prod-github-runner-207 kernel: [19672.543947] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 10:51:38 juju-e4d256-prod-github-runner-207 kernel: [19672.544280] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 10:51:38 juju-e4d256-prod-github-runner-207 kernel: [19672.556435] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 10:51:38 juju-e4d256-prod-github-runner-207 kernel: [19672.557721] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 10:51:38 juju-e4d256-prod-github-runner-207 kernel: [19672.558947] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:51:38 juju-e4d256-prod-github-runner-207 kernel: [19672.560024] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 10:51:38 juju-e4d256-prod-github-runner-207 kernel: [19672.562684] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 10:51:38 juju-e4d256-prod-github-runner-207 kernel: [19672.563790] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 10:51:38 juju-e4d256-prod-github-runner-207 kernel: [19672.564976] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 10:51:38 juju-e4d256-prod-github-runner-207 kernel: [19672.566307] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 10:51:38 juju-e4d256-prod-github-runner-207 kernel: [19672.567913] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 10:51:38 juju-e4d256-prod-github-runner-207 kernel: [19672.569100] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 10:51:38 juju-e4d256-prod-github-runner-207 kernel: [19672.570283] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 10:51:38 juju-e4d256-prod-github-runner-207 kernel: [19672.571775] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 10:51:38 juju-e4d256-prod-github-runner-207 kernel: [19672.572894] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 10:51:38 juju-e4d256-prod-github-runner-207 kernel: [19672.574154] Call Trace: Aug 22 10:51:38 juju-e4d256-prod-github-runner-207 kernel: [19672.575181] Aug 22 10:51:38 juju-e4d256-prod-github-runner-207 kernel: [19672.576414] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:51:38 juju-e4d256-prod-github-runner-207 kernel: [19672.578184] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:51:38 juju-e4d256-prod-github-runner-207 kernel: [19672.579220] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:51:38 juju-e4d256-prod-github-runner-207 kernel: [19672.580325] ? show_regs.part.0+0x23/0x29 Aug 22 10:51:38 juju-e4d256-prod-github-runner-207 kernel: [19672.581899] ? show_regs.cold+0x8/0xd Aug 22 10:51:38 juju-e4d256-prod-github-runner-207 kernel: [19672.582890] ? watchdog_timer_fn+0x1be/0x220 Aug 22 10:51:38 juju-e4d256-prod-github-runner-207 kernel: [19672.583908] ? lockup_detector_update_enable+0x60/0x60 Aug 22 10:51:38 juju-e4d256-prod-github-runner-207 kernel: [19672.584988] ? __hrtimer_run_queues+0x107/0x230 Aug 22 10:51:38 juju-e4d256-prod-github-runner-207 kernel: [19672.586027] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 10:51:38 juju-e4d256-prod-github-runner-207 kernel: [19672.587079] ? hrtimer_interrupt+0x101/0x220 Aug 22 10:51:38 juju-e4d256-prod-github-runner-207 kernel: [19672.588105] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 10:51:38 juju-e4d256-prod-github-runner-207 kernel: [19672.589189] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 10:51:38 juju-e4d256-prod-github-runner-207 kernel: [19672.590244] Aug 22 10:51:38 juju-e4d256-prod-github-runner-207 kernel: [19672.591103] Aug 22 10:51:38 juju-e4d256-prod-github-runner-207 kernel: [19672.591945] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 10:51:38 juju-e4d256-prod-github-runner-207 kernel: [19672.593006] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:51:38 juju-e4d256-prod-github-runner-207 kernel: [19672.594051] ? _raw_spin_lock+0x22/0x30 Aug 22 10:51:38 juju-e4d256-prod-github-runner-207 kernel: [19672.594999] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:51:38 juju-e4d256-prod-github-runner-207 kernel: [19672.596034] direct_page_fault+0x206/0x310 [kvm] Aug 22 10:51:38 juju-e4d256-prod-github-runner-207 kernel: [19672.597071] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 10:51:38 juju-e4d256-prod-github-runner-207 kernel: [19672.598090] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 10:51:38 juju-e4d256-prod-github-runner-207 kernel: [19672.599094] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 10:51:38 juju-e4d256-prod-github-runner-207 kernel: [19672.600111] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 10:51:38 juju-e4d256-prod-github-runner-207 kernel: [19672.601086] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 10:51:38 juju-e4d256-prod-github-runner-207 kernel: [19672.602081] handle_exit+0x98/0x230 [kvm_amd] Aug 22 10:51:38 juju-e4d256-prod-github-runner-207 kernel: [19672.603011] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 10:51:38 juju-e4d256-prod-github-runner-207 kernel: [19672.603964] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 10:51:38 juju-e4d256-prod-github-runner-207 kernel: [19672.604909] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 10:51:38 juju-e4d256-prod-github-runner-207 kernel: [19672.606086] vcpu_run+0x62/0x2c0 [kvm] Aug 22 10:51:38 juju-e4d256-prod-github-runner-207 kernel: [19672.606910] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 10:51:38 juju-e4d256-prod-github-runner-207 kernel: [19672.607873] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 10:51:38 juju-e4d256-prod-github-runner-207 kernel: [19672.608750] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 10:51:38 juju-e4d256-prod-github-runner-207 kernel: [19672.609556] ? __seccomp_filter+0x4a/0x4a0 Aug 22 10:51:38 juju-e4d256-prod-github-runner-207 kernel: [19672.610301] ? __fget_files+0x86/0xc0 Aug 22 10:51:38 juju-e4d256-prod-github-runner-207 kernel: [19672.611006] __x64_sys_ioctl+0x95/0xd0 Aug 22 10:51:38 juju-e4d256-prod-github-runner-207 kernel: [19672.611705] do_syscall_64+0x5c/0xc0 Aug 22 10:51:38 juju-e4d256-prod-github-runner-207 kernel: [19672.612372] ? do_futex+0x162/0x1f0 Aug 22 10:51:38 juju-e4d256-prod-github-runner-207 kernel: [19672.613030] ? __x64_sys_futex+0x78/0x1e0 Aug 22 10:51:38 juju-e4d256-prod-github-runner-207 kernel: [19672.613730] ? __secure_computing+0xa9/0x120 Aug 22 10:51:38 juju-e4d256-prod-github-runner-207 kernel: [19672.614419] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 10:51:38 juju-e4d256-prod-github-runner-207 kernel: [19672.615176] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:51:38 juju-e4d256-prod-github-runner-207 kernel: [19672.615900] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:51:38 juju-e4d256-prod-github-runner-207 kernel: [19672.616628] ? do_syscall_64+0x69/0xc0 Aug 22 10:51:38 juju-e4d256-prod-github-runner-207 kernel: [19672.617274] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:51:38 juju-e4d256-prod-github-runner-207 kernel: [19672.617979] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:51:38 juju-e4d256-prod-github-runner-207 kernel: [19672.618756] ? do_syscall_64+0x69/0xc0 Aug 22 10:51:38 juju-e4d256-prod-github-runner-207 kernel: [19672.619379] ? do_syscall_64+0x69/0xc0 Aug 22 10:51:38 juju-e4d256-prod-github-runner-207 kernel: [19672.620001] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 10:51:38 juju-e4d256-prod-github-runner-207 kernel: [19672.620715] RIP: 0033:0x7faa5d0edaff Aug 22 10:51:38 juju-e4d256-prod-github-runner-207 kernel: [19672.621379] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 10:51:38 juju-e4d256-prod-github-runner-207 kernel: [19672.623362] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 10:51:38 juju-e4d256-prod-github-runner-207 kernel: [19672.624464] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 10:51:38 juju-e4d256-prod-github-runner-207 kernel: [19672.625369] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 10:51:38 juju-e4d256-prod-github-runner-207 kernel: [19672.626263] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 10:51:38 juju-e4d256-prod-github-runner-207 kernel: [19672.627163] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 10:51:38 juju-e4d256-prod-github-runner-207 kernel: [19672.628054] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 10:51:38 juju-e4d256-prod-github-runner-207 kernel: [19672.628975] Aug 22 10:52:06 juju-e4d256-prod-github-runner-207 kernel: [19700.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 18239s! [qemu-system-x86:6715] Aug 22 10:52:06 juju-e4d256-prod-github-runner-207 kernel: [19700.544505] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 10:52:06 juju-e4d256-prod-github-runner-207 kernel: [19700.544816] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 10:52:06 juju-e4d256-prod-github-runner-207 kernel: [19700.557518] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 10:52:06 juju-e4d256-prod-github-runner-207 kernel: [19700.558799] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 10:52:06 juju-e4d256-prod-github-runner-207 kernel: [19700.560033] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:52:06 juju-e4d256-prod-github-runner-207 kernel: [19700.561109] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 10:52:06 juju-e4d256-prod-github-runner-207 kernel: [19700.563664] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 10:52:06 juju-e4d256-prod-github-runner-207 kernel: [19700.564726] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 10:52:06 juju-e4d256-prod-github-runner-207 kernel: [19700.565899] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 10:52:06 juju-e4d256-prod-github-runner-207 kernel: [19700.567063] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 10:52:06 juju-e4d256-prod-github-runner-207 kernel: [19700.568311] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 10:52:06 juju-e4d256-prod-github-runner-207 kernel: [19700.569494] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 10:52:06 juju-e4d256-prod-github-runner-207 kernel: [19700.570667] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 10:52:06 juju-e4d256-prod-github-runner-207 kernel: [19700.571917] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 10:52:06 juju-e4d256-prod-github-runner-207 kernel: [19700.573047] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 10:52:06 juju-e4d256-prod-github-runner-207 kernel: [19700.574248] Call Trace: Aug 22 10:52:06 juju-e4d256-prod-github-runner-207 kernel: [19700.575165] Aug 22 10:52:06 juju-e4d256-prod-github-runner-207 kernel: [19700.576069] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:52:06 juju-e4d256-prod-github-runner-207 kernel: [19700.577132] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:52:06 juju-e4d256-prod-github-runner-207 kernel: [19700.578158] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:52:06 juju-e4d256-prod-github-runner-207 kernel: [19700.579267] ? show_regs.part.0+0x23/0x29 Aug 22 10:52:06 juju-e4d256-prod-github-runner-207 kernel: [19700.580287] ? show_regs.cold+0x8/0xd Aug 22 10:52:06 juju-e4d256-prod-github-runner-207 kernel: [19700.581570] ? watchdog_timer_fn+0x1be/0x220 Aug 22 10:52:06 juju-e4d256-prod-github-runner-207 kernel: [19700.582593] ? lockup_detector_update_enable+0x60/0x60 Aug 22 10:52:06 juju-e4d256-prod-github-runner-207 kernel: [19700.583660] ? __hrtimer_run_queues+0x107/0x230 Aug 22 10:52:06 juju-e4d256-prod-github-runner-207 kernel: [19700.584708] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 10:52:06 juju-e4d256-prod-github-runner-207 kernel: [19700.585738] ? hrtimer_interrupt+0x101/0x220 Aug 22 10:52:06 juju-e4d256-prod-github-runner-207 kernel: [19700.586757] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 10:52:06 juju-e4d256-prod-github-runner-207 kernel: [19700.587830] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 10:52:06 juju-e4d256-prod-github-runner-207 kernel: [19700.588884] Aug 22 10:52:06 juju-e4d256-prod-github-runner-207 kernel: [19700.589741] Aug 22 10:52:06 juju-e4d256-prod-github-runner-207 kernel: [19700.590587] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 10:52:06 juju-e4d256-prod-github-runner-207 kernel: [19700.591654] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:52:06 juju-e4d256-prod-github-runner-207 kernel: [19700.592702] ? _raw_spin_lock+0x22/0x30 Aug 22 10:52:06 juju-e4d256-prod-github-runner-207 kernel: [19700.593656] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:52:06 juju-e4d256-prod-github-runner-207 kernel: [19700.594680] direct_page_fault+0x206/0x310 [kvm] Aug 22 10:52:06 juju-e4d256-prod-github-runner-207 kernel: [19700.595708] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 10:52:06 juju-e4d256-prod-github-runner-207 kernel: [19700.596738] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 10:52:06 juju-e4d256-prod-github-runner-207 kernel: [19700.597749] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 10:52:06 juju-e4d256-prod-github-runner-207 kernel: [19700.598759] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 10:52:06 juju-e4d256-prod-github-runner-207 kernel: [19700.599712] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 10:52:06 juju-e4d256-prod-github-runner-207 kernel: [19700.600711] handle_exit+0x98/0x230 [kvm_amd] Aug 22 10:52:06 juju-e4d256-prod-github-runner-207 kernel: [19700.601615] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 10:52:06 juju-e4d256-prod-github-runner-207 kernel: [19700.602531] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 10:52:06 juju-e4d256-prod-github-runner-207 kernel: [19700.603464] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 10:52:06 juju-e4d256-prod-github-runner-207 kernel: [19700.604382] vcpu_run+0x62/0x2c0 [kvm] Aug 22 10:52:06 juju-e4d256-prod-github-runner-207 kernel: [19700.605198] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 10:52:06 juju-e4d256-prod-github-runner-207 kernel: [19700.606012] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 10:52:06 juju-e4d256-prod-github-runner-207 kernel: [19700.606874] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 10:52:06 juju-e4d256-prod-github-runner-207 kernel: [19700.607673] ? __seccomp_filter+0x4a/0x4a0 Aug 22 10:52:06 juju-e4d256-prod-github-runner-207 kernel: [19700.608426] ? __fget_files+0x86/0xc0 Aug 22 10:52:06 juju-e4d256-prod-github-runner-207 kernel: [19700.609132] __x64_sys_ioctl+0x95/0xd0 Aug 22 10:52:06 juju-e4d256-prod-github-runner-207 kernel: [19700.609828] do_syscall_64+0x5c/0xc0 Aug 22 10:52:06 juju-e4d256-prod-github-runner-207 kernel: [19700.610496] ? do_futex+0x162/0x1f0 Aug 22 10:52:06 juju-e4d256-prod-github-runner-207 kernel: [19700.611146] ? __x64_sys_futex+0x78/0x1e0 Aug 22 10:52:06 juju-e4d256-prod-github-runner-207 kernel: [19700.611829] ? __secure_computing+0xa9/0x120 Aug 22 10:52:06 juju-e4d256-prod-github-runner-207 kernel: [19700.612545] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 10:52:06 juju-e4d256-prod-github-runner-207 kernel: [19700.613315] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:52:06 juju-e4d256-prod-github-runner-207 kernel: [19700.614038] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:52:06 juju-e4d256-prod-github-runner-207 kernel: [19700.614761] ? do_syscall_64+0x69/0xc0 Aug 22 10:52:06 juju-e4d256-prod-github-runner-207 kernel: [19700.615410] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:52:06 juju-e4d256-prod-github-runner-207 kernel: [19700.616112] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:52:06 juju-e4d256-prod-github-runner-207 kernel: [19700.616817] ? do_syscall_64+0x69/0xc0 Aug 22 10:52:06 juju-e4d256-prod-github-runner-207 kernel: [19700.617442] ? do_syscall_64+0x69/0xc0 Aug 22 10:52:06 juju-e4d256-prod-github-runner-207 kernel: [19700.618064] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 10:52:06 juju-e4d256-prod-github-runner-207 kernel: [19700.618769] RIP: 0033:0x7faa5d0edaff Aug 22 10:52:06 juju-e4d256-prod-github-runner-207 kernel: [19700.619416] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 10:52:06 juju-e4d256-prod-github-runner-207 kernel: [19700.621408] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 10:52:06 juju-e4d256-prod-github-runner-207 kernel: [19700.622319] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 10:52:06 juju-e4d256-prod-github-runner-207 kernel: [19700.623207] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 10:52:06 juju-e4d256-prod-github-runner-207 kernel: [19700.624094] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 10:52:06 juju-e4d256-prod-github-runner-207 kernel: [19700.624985] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 10:52:06 juju-e4d256-prod-github-runner-207 kernel: [19700.625879] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 10:52:06 juju-e4d256-prod-github-runner-207 kernel: [19700.626770] Aug 22 10:52:34 juju-e4d256-prod-github-runner-207 kernel: [19728.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 18265s! [qemu-system-x86:6715] Aug 22 10:52:34 juju-e4d256-prod-github-runner-207 kernel: [19728.543871] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 10:52:34 juju-e4d256-prod-github-runner-207 kernel: [19728.544191] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 10:52:34 juju-e4d256-prod-github-runner-207 kernel: [19728.556801] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 10:52:34 juju-e4d256-prod-github-runner-207 kernel: [19728.558161] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 10:52:34 juju-e4d256-prod-github-runner-207 kernel: [19728.559406] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:52:34 juju-e4d256-prod-github-runner-207 kernel: [19728.560502] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 10:52:34 juju-e4d256-prod-github-runner-207 kernel: [19728.563150] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 10:52:34 juju-e4d256-prod-github-runner-207 kernel: [19728.564496] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 10:52:34 juju-e4d256-prod-github-runner-207 kernel: [19728.565795] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 10:52:34 juju-e4d256-prod-github-runner-207 kernel: [19728.566977] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 10:52:34 juju-e4d256-prod-github-runner-207 kernel: [19728.568309] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 10:52:34 juju-e4d256-prod-github-runner-207 kernel: [19728.569575] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 10:52:34 juju-e4d256-prod-github-runner-207 kernel: [19728.570778] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 10:52:34 juju-e4d256-prod-github-runner-207 kernel: [19728.572122] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 10:52:34 juju-e4d256-prod-github-runner-207 kernel: [19728.573272] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 10:52:34 juju-e4d256-prod-github-runner-207 kernel: [19728.574538] Call Trace: Aug 22 10:52:34 juju-e4d256-prod-github-runner-207 kernel: [19728.575460] Aug 22 10:52:34 juju-e4d256-prod-github-runner-207 kernel: [19728.576393] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:52:34 juju-e4d256-prod-github-runner-207 kernel: [19728.577443] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:52:34 juju-e4d256-prod-github-runner-207 kernel: [19728.578496] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:52:34 juju-e4d256-prod-github-runner-207 kernel: [19728.579629] ? show_regs.part.0+0x23/0x29 Aug 22 10:52:34 juju-e4d256-prod-github-runner-207 kernel: [19728.580650] ? show_regs.cold+0x8/0xd Aug 22 10:52:34 juju-e4d256-prod-github-runner-207 kernel: [19728.581634] ? watchdog_timer_fn+0x1be/0x220 Aug 22 10:52:34 juju-e4d256-prod-github-runner-207 kernel: [19728.582654] ? lockup_detector_update_enable+0x60/0x60 Aug 22 10:52:34 juju-e4d256-prod-github-runner-207 kernel: [19728.583733] ? __hrtimer_run_queues+0x107/0x230 Aug 22 10:52:34 juju-e4d256-prod-github-runner-207 kernel: [19728.584819] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 10:52:34 juju-e4d256-prod-github-runner-207 kernel: [19728.585863] ? hrtimer_interrupt+0x101/0x220 Aug 22 10:52:34 juju-e4d256-prod-github-runner-207 kernel: [19728.586896] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 10:52:34 juju-e4d256-prod-github-runner-207 kernel: [19728.588030] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 10:52:34 juju-e4d256-prod-github-runner-207 kernel: [19728.589164] Aug 22 10:52:34 juju-e4d256-prod-github-runner-207 kernel: [19728.590035] Aug 22 10:52:34 juju-e4d256-prod-github-runner-207 kernel: [19728.590890] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 10:52:34 juju-e4d256-prod-github-runner-207 kernel: [19728.591953] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:52:34 juju-e4d256-prod-github-runner-207 kernel: [19728.593007] ? _raw_spin_lock+0x22/0x30 Aug 22 10:52:34 juju-e4d256-prod-github-runner-207 kernel: [19728.594100] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:52:34 juju-e4d256-prod-github-runner-207 kernel: [19728.595252] direct_page_fault+0x206/0x310 [kvm] Aug 22 10:52:34 juju-e4d256-prod-github-runner-207 kernel: [19728.596405] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 10:52:34 juju-e4d256-prod-github-runner-207 kernel: [19728.597516] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 10:52:34 juju-e4d256-prod-github-runner-207 kernel: [19728.598768] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 10:52:34 juju-e4d256-prod-github-runner-207 kernel: [19728.600049] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 10:52:34 juju-e4d256-prod-github-runner-207 kernel: [19728.601104] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 10:52:34 juju-e4d256-prod-github-runner-207 kernel: [19728.602197] handle_exit+0x98/0x230 [kvm_amd] Aug 22 10:52:34 juju-e4d256-prod-github-runner-207 kernel: [19728.603188] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 10:52:34 juju-e4d256-prod-github-runner-207 kernel: [19728.604231] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 10:52:34 juju-e4d256-prod-github-runner-207 kernel: [19728.605263] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 10:52:34 juju-e4d256-prod-github-runner-207 kernel: [19728.606276] vcpu_run+0x62/0x2c0 [kvm] Aug 22 10:52:34 juju-e4d256-prod-github-runner-207 kernel: [19728.607171] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 10:52:34 juju-e4d256-prod-github-runner-207 kernel: [19728.608098] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 10:52:34 juju-e4d256-prod-github-runner-207 kernel: [19728.609058] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 10:52:34 juju-e4d256-prod-github-runner-207 kernel: [19728.609947] ? __seccomp_filter+0x4a/0x4a0 Aug 22 10:52:34 juju-e4d256-prod-github-runner-207 kernel: [19728.610779] ? __fget_files+0x86/0xc0 Aug 22 10:52:34 juju-e4d256-prod-github-runner-207 kernel: [19728.611599] __x64_sys_ioctl+0x95/0xd0 Aug 22 10:52:34 juju-e4d256-prod-github-runner-207 kernel: [19728.612438] do_syscall_64+0x5c/0xc0 Aug 22 10:52:34 juju-e4d256-prod-github-runner-207 kernel: [19728.613228] ? do_futex+0x162/0x1f0 Aug 22 10:52:34 juju-e4d256-prod-github-runner-207 kernel: [19728.613993] ? __x64_sys_futex+0x78/0x1e0 Aug 22 10:52:34 juju-e4d256-prod-github-runner-207 kernel: [19728.614840] ? __secure_computing+0xa9/0x120 Aug 22 10:52:34 juju-e4d256-prod-github-runner-207 kernel: [19728.615905] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 10:52:34 juju-e4d256-prod-github-runner-207 kernel: [19728.616854] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:52:34 juju-e4d256-prod-github-runner-207 kernel: [19728.617610] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:52:34 juju-e4d256-prod-github-runner-207 kernel: [19728.618343] ? do_syscall_64+0x69/0xc0 Aug 22 10:52:34 juju-e4d256-prod-github-runner-207 kernel: [19728.618998] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:52:34 juju-e4d256-prod-github-runner-207 kernel: [19728.619730] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:52:34 juju-e4d256-prod-github-runner-207 kernel: [19728.620491] ? do_syscall_64+0x69/0xc0 Aug 22 10:52:34 juju-e4d256-prod-github-runner-207 kernel: [19728.621133] ? do_syscall_64+0x69/0xc0 Aug 22 10:52:34 juju-e4d256-prod-github-runner-207 kernel: [19728.621787] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 10:52:34 juju-e4d256-prod-github-runner-207 kernel: [19728.622507] RIP: 0033:0x7faa5d0edaff Aug 22 10:52:34 juju-e4d256-prod-github-runner-207 kernel: [19728.623204] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 10:52:34 juju-e4d256-prod-github-runner-207 kernel: [19728.625235] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 10:52:34 juju-e4d256-prod-github-runner-207 kernel: [19728.626173] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 10:52:34 juju-e4d256-prod-github-runner-207 kernel: [19728.627097] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 10:52:34 juju-e4d256-prod-github-runner-207 kernel: [19728.628012] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 10:52:34 juju-e4d256-prod-github-runner-207 kernel: [19728.628913] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 10:52:34 juju-e4d256-prod-github-runner-207 kernel: [19728.629810] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 10:52:34 juju-e4d256-prod-github-runner-207 kernel: [19728.630711] Aug 22 10:53:02 juju-e4d256-prod-github-runner-207 kernel: [19756.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 18291s! [qemu-system-x86:6715] Aug 22 10:53:02 juju-e4d256-prod-github-runner-207 kernel: [19756.543913] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 10:53:02 juju-e4d256-prod-github-runner-207 kernel: [19756.544230] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 10:53:02 juju-e4d256-prod-github-runner-207 kernel: [19756.556448] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 10:53:02 juju-e4d256-prod-github-runner-207 kernel: [19756.557726] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 10:53:02 juju-e4d256-prod-github-runner-207 kernel: [19756.558968] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:53:02 juju-e4d256-prod-github-runner-207 kernel: [19756.560046] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 10:53:02 juju-e4d256-prod-github-runner-207 kernel: [19756.562630] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 10:53:02 juju-e4d256-prod-github-runner-207 kernel: [19756.563699] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 10:53:02 juju-e4d256-prod-github-runner-207 kernel: [19756.564874] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 10:53:02 juju-e4d256-prod-github-runner-207 kernel: [19756.566067] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 10:53:02 juju-e4d256-prod-github-runner-207 kernel: [19756.567276] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 10:53:02 juju-e4d256-prod-github-runner-207 kernel: [19756.568476] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 10:53:02 juju-e4d256-prod-github-runner-207 kernel: [19756.569655] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 10:53:02 juju-e4d256-prod-github-runner-207 kernel: [19756.570894] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 10:53:02 juju-e4d256-prod-github-runner-207 kernel: [19756.572015] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 10:53:02 juju-e4d256-prod-github-runner-207 kernel: [19756.573214] Call Trace: Aug 22 10:53:02 juju-e4d256-prod-github-runner-207 kernel: [19756.574132] Aug 22 10:53:02 juju-e4d256-prod-github-runner-207 kernel: [19756.575040] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:53:02 juju-e4d256-prod-github-runner-207 kernel: [19756.576094] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:53:02 juju-e4d256-prod-github-runner-207 kernel: [19756.577121] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:53:02 juju-e4d256-prod-github-runner-207 kernel: [19756.578226] ? show_regs.part.0+0x23/0x29 Aug 22 10:53:02 juju-e4d256-prod-github-runner-207 kernel: [19756.579229] ? show_regs.cold+0x8/0xd Aug 22 10:53:02 juju-e4d256-prod-github-runner-207 kernel: [19756.580221] ? watchdog_timer_fn+0x1be/0x220 Aug 22 10:53:02 juju-e4d256-prod-github-runner-207 kernel: [19756.581235] ? lockup_detector_update_enable+0x60/0x60 Aug 22 10:53:02 juju-e4d256-prod-github-runner-207 kernel: [19756.582304] ? __hrtimer_run_queues+0x107/0x230 Aug 22 10:53:02 juju-e4d256-prod-github-runner-207 kernel: [19756.583567] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 10:53:02 juju-e4d256-prod-github-runner-207 kernel: [19756.584698] ? hrtimer_interrupt+0x101/0x220 Aug 22 10:53:02 juju-e4d256-prod-github-runner-207 kernel: [19756.585815] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 10:53:02 juju-e4d256-prod-github-runner-207 kernel: [19756.587014] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 10:53:02 juju-e4d256-prod-github-runner-207 kernel: [19756.588183] Aug 22 10:53:02 juju-e4d256-prod-github-runner-207 kernel: [19756.589093] Aug 22 10:53:02 juju-e4d256-prod-github-runner-207 kernel: [19756.589980] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 10:53:02 juju-e4d256-prod-github-runner-207 kernel: [19756.591128] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:53:02 juju-e4d256-prod-github-runner-207 kernel: [19756.592308] ? _raw_spin_lock+0x22/0x30 Aug 22 10:53:02 juju-e4d256-prod-github-runner-207 kernel: [19756.593344] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:53:02 juju-e4d256-prod-github-runner-207 kernel: [19756.594465] direct_page_fault+0x206/0x310 [kvm] Aug 22 10:53:02 juju-e4d256-prod-github-runner-207 kernel: [19756.595607] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 10:53:02 juju-e4d256-prod-github-runner-207 kernel: [19756.596717] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 10:53:02 juju-e4d256-prod-github-runner-207 kernel: [19756.597814] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 10:53:02 juju-e4d256-prod-github-runner-207 kernel: [19756.598932] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 10:53:02 juju-e4d256-prod-github-runner-207 kernel: [19756.599997] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 10:53:02 juju-e4d256-prod-github-runner-207 kernel: [19756.601083] handle_exit+0x98/0x230 [kvm_amd] Aug 22 10:53:02 juju-e4d256-prod-github-runner-207 kernel: [19756.602071] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 10:53:02 juju-e4d256-prod-github-runner-207 kernel: [19756.603086] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 10:53:02 juju-e4d256-prod-github-runner-207 kernel: [19756.604266] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 10:53:02 juju-e4d256-prod-github-runner-207 kernel: [19756.605279] vcpu_run+0x62/0x2c0 [kvm] Aug 22 10:53:02 juju-e4d256-prod-github-runner-207 kernel: [19756.606206] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 10:53:02 juju-e4d256-prod-github-runner-207 kernel: [19756.607110] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 10:53:02 juju-e4d256-prod-github-runner-207 kernel: [19756.608093] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 10:53:02 juju-e4d256-prod-github-runner-207 kernel: [19756.608992] ? __seccomp_filter+0x4a/0x4a0 Aug 22 10:53:02 juju-e4d256-prod-github-runner-207 kernel: [19756.609823] ? __fget_files+0x86/0xc0 Aug 22 10:53:02 juju-e4d256-prod-github-runner-207 kernel: [19756.610614] __x64_sys_ioctl+0x95/0xd0 Aug 22 10:53:02 juju-e4d256-prod-github-runner-207 kernel: [19756.611386] do_syscall_64+0x5c/0xc0 Aug 22 10:53:02 juju-e4d256-prod-github-runner-207 kernel: [19756.612152] ? do_futex+0x162/0x1f0 Aug 22 10:53:02 juju-e4d256-prod-github-runner-207 kernel: [19756.612888] ? __x64_sys_futex+0x78/0x1e0 Aug 22 10:53:02 juju-e4d256-prod-github-runner-207 kernel: [19756.613646] ? __secure_computing+0xa9/0x120 Aug 22 10:53:02 juju-e4d256-prod-github-runner-207 kernel: [19756.614425] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 10:53:02 juju-e4d256-prod-github-runner-207 kernel: [19756.615296] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:53:02 juju-e4d256-prod-github-runner-207 kernel: [19756.616131] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:53:02 juju-e4d256-prod-github-runner-207 kernel: [19756.616980] ? do_syscall_64+0x69/0xc0 Aug 22 10:53:02 juju-e4d256-prod-github-runner-207 kernel: [19756.617706] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:53:02 juju-e4d256-prod-github-runner-207 kernel: [19756.618506] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:53:02 juju-e4d256-prod-github-runner-207 kernel: [19756.619297] ? do_syscall_64+0x69/0xc0 Aug 22 10:53:02 juju-e4d256-prod-github-runner-207 kernel: [19756.620070] ? do_syscall_64+0x69/0xc0 Aug 22 10:53:02 juju-e4d256-prod-github-runner-207 kernel: [19756.620775] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 10:53:02 juju-e4d256-prod-github-runner-207 kernel: [19756.621593] RIP: 0033:0x7faa5d0edaff Aug 22 10:53:02 juju-e4d256-prod-github-runner-207 kernel: [19756.622339] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 10:53:02 juju-e4d256-prod-github-runner-207 kernel: [19756.624740] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 10:53:02 juju-e4d256-prod-github-runner-207 kernel: [19756.625679] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 10:53:02 juju-e4d256-prod-github-runner-207 kernel: [19756.626577] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 10:53:02 juju-e4d256-prod-github-runner-207 kernel: [19756.628352] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 10:53:02 juju-e4d256-prod-github-runner-207 kernel: [19756.629276] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 10:53:02 juju-e4d256-prod-github-runner-207 kernel: [19756.630174] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 10:53:02 juju-e4d256-prod-github-runner-207 kernel: [19756.631074] Aug 22 10:53:30 juju-e4d256-prod-github-runner-207 kernel: [19784.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 18317s! [qemu-system-x86:6715] Aug 22 10:53:30 juju-e4d256-prod-github-runner-207 kernel: [19784.543895] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 10:53:30 juju-e4d256-prod-github-runner-207 kernel: [19784.544187] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 10:53:30 juju-e4d256-prod-github-runner-207 kernel: [19784.556619] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 10:53:30 juju-e4d256-prod-github-runner-207 kernel: [19784.557942] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 10:53:30 juju-e4d256-prod-github-runner-207 kernel: [19784.559221] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:53:30 juju-e4d256-prod-github-runner-207 kernel: [19784.560307] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 10:53:30 juju-e4d256-prod-github-runner-207 kernel: [19784.562908] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 10:53:30 juju-e4d256-prod-github-runner-207 kernel: [19784.563999] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 10:53:30 juju-e4d256-prod-github-runner-207 kernel: [19784.565217] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 10:53:30 juju-e4d256-prod-github-runner-207 kernel: [19784.566398] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 10:53:30 juju-e4d256-prod-github-runner-207 kernel: [19784.567598] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 10:53:30 juju-e4d256-prod-github-runner-207 kernel: [19784.568787] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 10:53:30 juju-e4d256-prod-github-runner-207 kernel: [19784.569974] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 10:53:30 juju-e4d256-prod-github-runner-207 kernel: [19784.571292] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 10:53:30 juju-e4d256-prod-github-runner-207 kernel: [19784.572411] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 10:53:30 juju-e4d256-prod-github-runner-207 kernel: [19784.573620] Call Trace: Aug 22 10:53:30 juju-e4d256-prod-github-runner-207 kernel: [19784.574535] Aug 22 10:53:30 juju-e4d256-prod-github-runner-207 kernel: [19784.575473] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:53:30 juju-e4d256-prod-github-runner-207 kernel: [19784.576519] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:53:30 juju-e4d256-prod-github-runner-207 kernel: [19784.577552] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:53:30 juju-e4d256-prod-github-runner-207 kernel: [19784.578670] ? show_regs.part.0+0x23/0x29 Aug 22 10:53:30 juju-e4d256-prod-github-runner-207 kernel: [19784.579690] ? show_regs.cold+0x8/0xd Aug 22 10:53:30 juju-e4d256-prod-github-runner-207 kernel: [19784.580671] ? watchdog_timer_fn+0x1be/0x220 Aug 22 10:53:30 juju-e4d256-prod-github-runner-207 kernel: [19784.581684] ? lockup_detector_update_enable+0x60/0x60 Aug 22 10:53:30 juju-e4d256-prod-github-runner-207 kernel: [19784.582753] ? __hrtimer_run_queues+0x107/0x230 Aug 22 10:53:30 juju-e4d256-prod-github-runner-207 kernel: [19784.583814] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 10:53:30 juju-e4d256-prod-github-runner-207 kernel: [19784.584845] ? hrtimer_interrupt+0x101/0x220 Aug 22 10:53:30 juju-e4d256-prod-github-runner-207 kernel: [19784.585864] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 10:53:30 juju-e4d256-prod-github-runner-207 kernel: [19784.586952] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 10:53:30 juju-e4d256-prod-github-runner-207 kernel: [19784.588018] Aug 22 10:53:30 juju-e4d256-prod-github-runner-207 kernel: [19784.589026] Aug 22 10:53:30 juju-e4d256-prod-github-runner-207 kernel: [19784.589881] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 10:53:30 juju-e4d256-prod-github-runner-207 kernel: [19784.590919] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:53:30 juju-e4d256-prod-github-runner-207 kernel: [19784.591974] ? _raw_spin_lock+0x22/0x30 Aug 22 10:53:30 juju-e4d256-prod-github-runner-207 kernel: [19784.592929] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:53:30 juju-e4d256-prod-github-runner-207 kernel: [19784.593950] direct_page_fault+0x206/0x310 [kvm] Aug 22 10:53:30 juju-e4d256-prod-github-runner-207 kernel: [19784.594984] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 10:53:30 juju-e4d256-prod-github-runner-207 kernel: [19784.596016] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 10:53:30 juju-e4d256-prod-github-runner-207 kernel: [19784.597127] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 10:53:30 juju-e4d256-prod-github-runner-207 kernel: [19784.598146] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 10:53:30 juju-e4d256-prod-github-runner-207 kernel: [19784.599099] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 10:53:30 juju-e4d256-prod-github-runner-207 kernel: [19784.600097] handle_exit+0x98/0x230 [kvm_amd] Aug 22 10:53:30 juju-e4d256-prod-github-runner-207 kernel: [19784.601000] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 10:53:30 juju-e4d256-prod-github-runner-207 kernel: [19784.602012] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 10:53:30 juju-e4d256-prod-github-runner-207 kernel: [19784.602956] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 10:53:30 juju-e4d256-prod-github-runner-207 kernel: [19784.603967] vcpu_run+0x62/0x2c0 [kvm] Aug 22 10:53:30 juju-e4d256-prod-github-runner-207 kernel: [19784.604783] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 10:53:30 juju-e4d256-prod-github-runner-207 kernel: [19784.605599] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 10:53:30 juju-e4d256-prod-github-runner-207 kernel: [19784.606457] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 10:53:30 juju-e4d256-prod-github-runner-207 kernel: [19784.607277] ? __seccomp_filter+0x4a/0x4a0 Aug 22 10:53:30 juju-e4d256-prod-github-runner-207 kernel: [19784.608026] ? __fget_files+0x86/0xc0 Aug 22 10:53:30 juju-e4d256-prod-github-runner-207 kernel: [19784.608734] __x64_sys_ioctl+0x95/0xd0 Aug 22 10:53:30 juju-e4d256-prod-github-runner-207 kernel: [19784.609429] do_syscall_64+0x5c/0xc0 Aug 22 10:53:30 juju-e4d256-prod-github-runner-207 kernel: [19784.610096] ? do_futex+0x162/0x1f0 Aug 22 10:53:30 juju-e4d256-prod-github-runner-207 kernel: [19784.610748] ? __x64_sys_futex+0x78/0x1e0 Aug 22 10:53:30 juju-e4d256-prod-github-runner-207 kernel: [19784.611448] ? __secure_computing+0xa9/0x120 Aug 22 10:53:30 juju-e4d256-prod-github-runner-207 kernel: [19784.612141] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 10:53:30 juju-e4d256-prod-github-runner-207 kernel: [19784.612903] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:53:30 juju-e4d256-prod-github-runner-207 kernel: [19784.613628] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:53:30 juju-e4d256-prod-github-runner-207 kernel: [19784.614347] ? do_syscall_64+0x69/0xc0 Aug 22 10:53:30 juju-e4d256-prod-github-runner-207 kernel: [19784.614998] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:53:30 juju-e4d256-prod-github-runner-207 kernel: [19784.615729] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:53:30 juju-e4d256-prod-github-runner-207 kernel: [19784.616427] ? do_syscall_64+0x69/0xc0 Aug 22 10:53:30 juju-e4d256-prod-github-runner-207 kernel: [19784.617054] ? do_syscall_64+0x69/0xc0 Aug 22 10:53:30 juju-e4d256-prod-github-runner-207 kernel: [19784.617685] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 10:53:30 juju-e4d256-prod-github-runner-207 kernel: [19784.618392] RIP: 0033:0x7faa5d0edaff Aug 22 10:53:30 juju-e4d256-prod-github-runner-207 kernel: [19784.619074] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 10:53:30 juju-e4d256-prod-github-runner-207 kernel: [19784.621107] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 10:53:30 juju-e4d256-prod-github-runner-207 kernel: [19784.622022] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 10:53:30 juju-e4d256-prod-github-runner-207 kernel: [19784.622912] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 10:53:30 juju-e4d256-prod-github-runner-207 kernel: [19784.623810] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 10:53:30 juju-e4d256-prod-github-runner-207 kernel: [19784.624707] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 10:53:30 juju-e4d256-prod-github-runner-207 kernel: [19784.625608] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 10:53:30 juju-e4d256-prod-github-runner-207 kernel: [19784.626538] Aug 22 10:53:44 juju-e4d256-prod-github-runner-207 kernel: [19798.508706] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 10:53:44 juju-e4d256-prod-github-runner-207 kernel: [19798.510437] rcu: 1-....: (4904988 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=2375871 Aug 22 10:53:44 juju-e4d256-prod-github-runner-207 kernel: [19798.511604] (t=4920327 jiffies g=23269 q=25816) Aug 22 10:53:44 juju-e4d256-prod-github-runner-207 kernel: [19798.512400] NMI backtrace for cpu 1 Aug 22 10:53:44 juju-e4d256-prod-github-runner-207 kernel: [19798.513159] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 10:53:44 juju-e4d256-prod-github-runner-207 kernel: [19798.514308] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 10:53:44 juju-e4d256-prod-github-runner-207 kernel: [19798.515391] Call Trace: Aug 22 10:53:44 juju-e4d256-prod-github-runner-207 kernel: [19798.516075] Aug 22 10:53:44 juju-e4d256-prod-github-runner-207 kernel: [19798.516743] show_stack+0x52/0x5c Aug 22 10:53:44 juju-e4d256-prod-github-runner-207 kernel: [19798.517483] dump_stack_lvl+0x4a/0x63 Aug 22 10:53:44 juju-e4d256-prod-github-runner-207 kernel: [19798.518241] dump_stack+0x10/0x16 Aug 22 10:53:44 juju-e4d256-prod-github-runner-207 kernel: [19798.519028] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 10:53:44 juju-e4d256-prod-github-runner-207 kernel: [19798.519848] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 10:53:44 juju-e4d256-prod-github-runner-207 kernel: [19798.520640] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 10:53:44 juju-e4d256-prod-github-runner-207 kernel: [19798.521473] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 10:53:44 juju-e4d256-prod-github-runner-207 kernel: [19798.522295] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 10:53:44 juju-e4d256-prod-github-runner-207 kernel: [19798.523136] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 10:53:44 juju-e4d256-prod-github-runner-207 kernel: [19798.523921] print_cpu_stall.cold+0x2f/0xe2 Aug 22 10:53:44 juju-e4d256-prod-github-runner-207 kernel: [19798.524700] ? timekeeping_update+0xf7/0x150 Aug 22 10:53:44 juju-e4d256-prod-github-runner-207 kernel: [19798.525477] check_cpu_stall+0x109/0x270 Aug 22 10:53:44 juju-e4d256-prod-github-runner-207 kernel: [19798.526232] rcu_sched_clock_irq+0x9a/0x250 Aug 22 10:53:44 juju-e4d256-prod-github-runner-207 kernel: [19798.527013] update_process_times+0x94/0xd0 Aug 22 10:53:44 juju-e4d256-prod-github-runner-207 kernel: [19798.527784] tick_sched_handle+0x29/0x70 Aug 22 10:53:44 juju-e4d256-prod-github-runner-207 kernel: [19798.528542] tick_sched_timer+0x8c/0xc0 Aug 22 10:53:44 juju-e4d256-prod-github-runner-207 kernel: [19798.529297] ? tick_nohz_handler+0xb0/0xb0 Aug 22 10:53:44 juju-e4d256-prod-github-runner-207 kernel: [19798.530060] __hrtimer_run_queues+0x107/0x230 Aug 22 10:53:44 juju-e4d256-prod-github-runner-207 kernel: [19798.530844] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 10:53:44 juju-e4d256-prod-github-runner-207 kernel: [19798.531642] hrtimer_interrupt+0x101/0x220 Aug 22 10:53:44 juju-e4d256-prod-github-runner-207 kernel: [19798.532406] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 10:53:44 juju-e4d256-prod-github-runner-207 kernel: [19798.533224] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 10:53:44 juju-e4d256-prod-github-runner-207 kernel: [19798.534047] Aug 22 10:53:44 juju-e4d256-prod-github-runner-207 kernel: [19798.534710] Aug 22 10:53:44 juju-e4d256-prod-github-runner-207 kernel: [19798.535363] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 10:53:44 juju-e4d256-prod-github-runner-207 kernel: [19798.536190] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:53:44 juju-e4d256-prod-github-runner-207 kernel: [19798.537076] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 10:53:44 juju-e4d256-prod-github-runner-207 kernel: [19798.539311] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 10:53:44 juju-e4d256-prod-github-runner-207 kernel: [19798.540207] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 10:53:44 juju-e4d256-prod-github-runner-207 kernel: [19798.541209] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 10:53:44 juju-e4d256-prod-github-runner-207 kernel: [19798.542193] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 10:53:44 juju-e4d256-prod-github-runner-207 kernel: [19798.543184] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 10:53:44 juju-e4d256-prod-github-runner-207 kernel: [19798.544158] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 10:53:44 juju-e4d256-prod-github-runner-207 kernel: [19798.545133] ? _raw_spin_lock+0x22/0x30 Aug 22 10:53:44 juju-e4d256-prod-github-runner-207 kernel: [19798.545915] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:53:44 juju-e4d256-prod-github-runner-207 kernel: [19798.546810] direct_page_fault+0x206/0x310 [kvm] Aug 22 10:53:44 juju-e4d256-prod-github-runner-207 kernel: [19798.547674] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 10:53:44 juju-e4d256-prod-github-runner-207 kernel: [19798.548883] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 10:53:44 juju-e4d256-prod-github-runner-207 kernel: [19798.549877] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 10:53:44 juju-e4d256-prod-github-runner-207 kernel: [19798.550825] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 10:53:44 juju-e4d256-prod-github-runner-207 kernel: [19798.551727] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 10:53:44 juju-e4d256-prod-github-runner-207 kernel: [19798.552660] handle_exit+0x98/0x230 [kvm_amd] Aug 22 10:53:44 juju-e4d256-prod-github-runner-207 kernel: [19798.553502] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 10:53:44 juju-e4d256-prod-github-runner-207 kernel: [19798.554380] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 10:53:44 juju-e4d256-prod-github-runner-207 kernel: [19798.555284] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 10:53:44 juju-e4d256-prod-github-runner-207 kernel: [19798.556168] vcpu_run+0x62/0x2c0 [kvm] Aug 22 10:53:44 juju-e4d256-prod-github-runner-207 kernel: [19798.556960] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 10:53:44 juju-e4d256-prod-github-runner-207 kernel: [19798.557785] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 10:53:44 juju-e4d256-prod-github-runner-207 kernel: [19798.558684] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 10:53:44 juju-e4d256-prod-github-runner-207 kernel: [19798.559545] ? __seccomp_filter+0x4a/0x4a0 Aug 22 10:53:44 juju-e4d256-prod-github-runner-207 kernel: [19798.560353] ? __fget_files+0x86/0xc0 Aug 22 10:53:44 juju-e4d256-prod-github-runner-207 kernel: [19798.561155] __x64_sys_ioctl+0x95/0xd0 Aug 22 10:53:44 juju-e4d256-prod-github-runner-207 kernel: [19798.561930] do_syscall_64+0x5c/0xc0 Aug 22 10:53:44 juju-e4d256-prod-github-runner-207 kernel: [19798.562700] ? do_futex+0x162/0x1f0 Aug 22 10:53:44 juju-e4d256-prod-github-runner-207 kernel: [19798.563460] ? __x64_sys_futex+0x78/0x1e0 Aug 22 10:53:44 juju-e4d256-prod-github-runner-207 kernel: [19798.564244] ? __secure_computing+0xa9/0x120 Aug 22 10:53:44 juju-e4d256-prod-github-runner-207 kernel: [19798.565051] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 10:53:44 juju-e4d256-prod-github-runner-207 kernel: [19798.565947] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:53:44 juju-e4d256-prod-github-runner-207 kernel: [19798.566815] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:53:44 juju-e4d256-prod-github-runner-207 kernel: [19798.567678] ? do_syscall_64+0x69/0xc0 Aug 22 10:53:44 juju-e4d256-prod-github-runner-207 kernel: [19798.568445] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:53:44 juju-e4d256-prod-github-runner-207 kernel: [19798.569293] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:53:44 juju-e4d256-prod-github-runner-207 kernel: [19798.570144] ? do_syscall_64+0x69/0xc0 Aug 22 10:53:44 juju-e4d256-prod-github-runner-207 kernel: [19798.570916] ? do_syscall_64+0x69/0xc0 Aug 22 10:53:44 juju-e4d256-prod-github-runner-207 kernel: [19798.571719] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 10:53:44 juju-e4d256-prod-github-runner-207 kernel: [19798.572506] RIP: 0033:0x7faa5d0edaff Aug 22 10:53:44 juju-e4d256-prod-github-runner-207 kernel: [19798.573275] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 10:53:44 juju-e4d256-prod-github-runner-207 kernel: [19798.575621] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 10:53:44 juju-e4d256-prod-github-runner-207 kernel: [19798.576753] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 10:53:44 juju-e4d256-prod-github-runner-207 kernel: [19798.577839] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 10:53:44 juju-e4d256-prod-github-runner-207 kernel: [19798.578924] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 10:53:44 juju-e4d256-prod-github-runner-207 kernel: [19798.580012] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 10:53:44 juju-e4d256-prod-github-runner-207 kernel: [19798.581074] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 10:53:44 juju-e4d256-prod-github-runner-207 kernel: [19798.582124] Aug 22 10:54:10 juju-e4d256-prod-github-runner-207 kernel: [19824.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 18355s! [qemu-system-x86:6715] Aug 22 10:54:10 juju-e4d256-prod-github-runner-207 kernel: [19824.543892] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 10:54:10 juju-e4d256-prod-github-runner-207 kernel: [19824.544211] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 10:54:10 juju-e4d256-prod-github-runner-207 kernel: [19824.556929] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 10:54:10 juju-e4d256-prod-github-runner-207 kernel: [19824.558202] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 10:54:10 juju-e4d256-prod-github-runner-207 kernel: [19824.559436] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:54:10 juju-e4d256-prod-github-runner-207 kernel: [19824.560493] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 10:54:10 juju-e4d256-prod-github-runner-207 kernel: [19824.563078] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 10:54:10 juju-e4d256-prod-github-runner-207 kernel: [19824.564126] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 10:54:10 juju-e4d256-prod-github-runner-207 kernel: [19824.565303] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 10:54:10 juju-e4d256-prod-github-runner-207 kernel: [19824.566477] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 10:54:10 juju-e4d256-prod-github-runner-207 kernel: [19824.567650] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 10:54:10 juju-e4d256-prod-github-runner-207 kernel: [19824.568819] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 10:54:10 juju-e4d256-prod-github-runner-207 kernel: [19824.569992] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 10:54:10 juju-e4d256-prod-github-runner-207 kernel: [19824.571248] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 10:54:10 juju-e4d256-prod-github-runner-207 kernel: [19824.572356] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 10:54:10 juju-e4d256-prod-github-runner-207 kernel: [19824.573558] Call Trace: Aug 22 10:54:10 juju-e4d256-prod-github-runner-207 kernel: [19824.574479] Aug 22 10:54:10 juju-e4d256-prod-github-runner-207 kernel: [19824.575402] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:54:10 juju-e4d256-prod-github-runner-207 kernel: [19824.576439] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:54:10 juju-e4d256-prod-github-runner-207 kernel: [19824.577608] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:54:10 juju-e4d256-prod-github-runner-207 kernel: [19824.578866] ? show_regs.part.0+0x23/0x29 Aug 22 10:54:10 juju-e4d256-prod-github-runner-207 kernel: [19824.579892] ? show_regs.cold+0x8/0xd Aug 22 10:54:10 juju-e4d256-prod-github-runner-207 kernel: [19824.580874] ? watchdog_timer_fn+0x1be/0x220 Aug 22 10:54:10 juju-e4d256-prod-github-runner-207 kernel: [19824.581890] ? lockup_detector_update_enable+0x60/0x60 Aug 22 10:54:10 juju-e4d256-prod-github-runner-207 kernel: [19824.582984] ? __hrtimer_run_queues+0x107/0x230 Aug 22 10:54:10 juju-e4d256-prod-github-runner-207 kernel: [19824.584020] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 10:54:10 juju-e4d256-prod-github-runner-207 kernel: [19824.585051] ? hrtimer_interrupt+0x101/0x220 Aug 22 10:54:10 juju-e4d256-prod-github-runner-207 kernel: [19824.586079] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 10:54:10 juju-e4d256-prod-github-runner-207 kernel: [19824.587167] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 10:54:10 juju-e4d256-prod-github-runner-207 kernel: [19824.588226] Aug 22 10:54:10 juju-e4d256-prod-github-runner-207 kernel: [19824.589086] Aug 22 10:54:10 juju-e4d256-prod-github-runner-207 kernel: [19824.589932] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 10:54:10 juju-e4d256-prod-github-runner-207 kernel: [19824.590990] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:54:10 juju-e4d256-prod-github-runner-207 kernel: [19824.592036] ? _raw_spin_lock+0x22/0x30 Aug 22 10:54:10 juju-e4d256-prod-github-runner-207 kernel: [19824.592992] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:54:10 juju-e4d256-prod-github-runner-207 kernel: [19824.594022] direct_page_fault+0x206/0x310 [kvm] Aug 22 10:54:10 juju-e4d256-prod-github-runner-207 kernel: [19824.595068] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 10:54:10 juju-e4d256-prod-github-runner-207 kernel: [19824.596087] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 10:54:10 juju-e4d256-prod-github-runner-207 kernel: [19824.597103] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 10:54:10 juju-e4d256-prod-github-runner-207 kernel: [19824.598121] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 10:54:10 juju-e4d256-prod-github-runner-207 kernel: [19824.599095] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 10:54:10 juju-e4d256-prod-github-runner-207 kernel: [19824.600098] handle_exit+0x98/0x230 [kvm_amd] Aug 22 10:54:10 juju-e4d256-prod-github-runner-207 kernel: [19824.601000] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 10:54:10 juju-e4d256-prod-github-runner-207 kernel: [19824.601921] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 10:54:10 juju-e4d256-prod-github-runner-207 kernel: [19824.602867] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 10:54:10 juju-e4d256-prod-github-runner-207 kernel: [19824.603774] vcpu_run+0x62/0x2c0 [kvm] Aug 22 10:54:10 juju-e4d256-prod-github-runner-207 kernel: [19824.604588] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 10:54:10 juju-e4d256-prod-github-runner-207 kernel: [19824.605411] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 10:54:10 juju-e4d256-prod-github-runner-207 kernel: [19824.606291] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 10:54:10 juju-e4d256-prod-github-runner-207 kernel: [19824.607107] ? __seccomp_filter+0x4a/0x4a0 Aug 22 10:54:10 juju-e4d256-prod-github-runner-207 kernel: [19824.608053] ? __fget_files+0x86/0xc0 Aug 22 10:54:10 juju-e4d256-prod-github-runner-207 kernel: [19824.608787] __x64_sys_ioctl+0x95/0xd0 Aug 22 10:54:10 juju-e4d256-prod-github-runner-207 kernel: [19824.609488] do_syscall_64+0x5c/0xc0 Aug 22 10:54:10 juju-e4d256-prod-github-runner-207 kernel: [19824.610164] ? do_futex+0x162/0x1f0 Aug 22 10:54:10 juju-e4d256-prod-github-runner-207 kernel: [19824.610846] ? __x64_sys_futex+0x78/0x1e0 Aug 22 10:54:10 juju-e4d256-prod-github-runner-207 kernel: [19824.611525] ? __secure_computing+0xa9/0x120 Aug 22 10:54:10 juju-e4d256-prod-github-runner-207 kernel: [19824.612219] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 10:54:10 juju-e4d256-prod-github-runner-207 kernel: [19824.612985] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:54:10 juju-e4d256-prod-github-runner-207 kernel: [19824.613721] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:54:10 juju-e4d256-prod-github-runner-207 kernel: [19824.614448] ? do_syscall_64+0x69/0xc0 Aug 22 10:54:10 juju-e4d256-prod-github-runner-207 kernel: [19824.615109] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:54:10 juju-e4d256-prod-github-runner-207 kernel: [19824.615822] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:54:10 juju-e4d256-prod-github-runner-207 kernel: [19824.616529] ? do_syscall_64+0x69/0xc0 Aug 22 10:54:10 juju-e4d256-prod-github-runner-207 kernel: [19824.617157] ? do_syscall_64+0x69/0xc0 Aug 22 10:54:10 juju-e4d256-prod-github-runner-207 kernel: [19824.617783] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 10:54:10 juju-e4d256-prod-github-runner-207 kernel: [19824.618491] RIP: 0033:0x7faa5d0edaff Aug 22 10:54:10 juju-e4d256-prod-github-runner-207 kernel: [19824.619174] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 10:54:10 juju-e4d256-prod-github-runner-207 kernel: [19824.621169] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 10:54:10 juju-e4d256-prod-github-runner-207 kernel: [19824.622090] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 10:54:10 juju-e4d256-prod-github-runner-207 kernel: [19824.623020] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 10:54:10 juju-e4d256-prod-github-runner-207 kernel: [19824.623919] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 10:54:10 juju-e4d256-prod-github-runner-207 kernel: [19824.624852] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 10:54:10 juju-e4d256-prod-github-runner-207 kernel: [19824.625745] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 10:54:10 juju-e4d256-prod-github-runner-207 kernel: [19824.626644] Aug 22 10:54:38 juju-e4d256-prod-github-runner-207 kernel: [19852.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 18381s! [qemu-system-x86:6715] Aug 22 10:54:38 juju-e4d256-prod-github-runner-207 kernel: [19852.543175] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 10:54:38 juju-e4d256-prod-github-runner-207 kernel: [19852.543256] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 10:54:38 juju-e4d256-prod-github-runner-207 kernel: [19852.555735] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 10:54:38 juju-e4d256-prod-github-runner-207 kernel: [19852.557050] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 10:54:38 juju-e4d256-prod-github-runner-207 kernel: [19852.558290] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:54:38 juju-e4d256-prod-github-runner-207 kernel: [19852.559365] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 10:54:38 juju-e4d256-prod-github-runner-207 kernel: [19852.561925] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 10:54:38 juju-e4d256-prod-github-runner-207 kernel: [19852.562986] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 10:54:38 juju-e4d256-prod-github-runner-207 kernel: [19852.564158] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 10:54:38 juju-e4d256-prod-github-runner-207 kernel: [19852.565321] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 10:54:38 juju-e4d256-prod-github-runner-207 kernel: [19852.566497] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 10:54:38 juju-e4d256-prod-github-runner-207 kernel: [19852.567663] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 10:54:38 juju-e4d256-prod-github-runner-207 kernel: [19852.568835] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 10:54:38 juju-e4d256-prod-github-runner-207 kernel: [19852.570079] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 10:54:38 juju-e4d256-prod-github-runner-207 kernel: [19852.571218] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 10:54:38 juju-e4d256-prod-github-runner-207 kernel: [19852.572418] Call Trace: Aug 22 10:54:38 juju-e4d256-prod-github-runner-207 kernel: [19852.573336] Aug 22 10:54:38 juju-e4d256-prod-github-runner-207 kernel: [19852.574223] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:54:38 juju-e4d256-prod-github-runner-207 kernel: [19852.575276] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:54:38 juju-e4d256-prod-github-runner-207 kernel: [19852.576307] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:54:38 juju-e4d256-prod-github-runner-207 kernel: [19852.577388] ? show_regs.part.0+0x23/0x29 Aug 22 10:54:38 juju-e4d256-prod-github-runner-207 kernel: [19852.578404] ? show_regs.cold+0x8/0xd Aug 22 10:54:38 juju-e4d256-prod-github-runner-207 kernel: [19852.579382] ? watchdog_timer_fn+0x1be/0x220 Aug 22 10:54:38 juju-e4d256-prod-github-runner-207 kernel: [19852.580397] ? lockup_detector_update_enable+0x60/0x60 Aug 22 10:54:38 juju-e4d256-prod-github-runner-207 kernel: [19852.581484] ? __hrtimer_run_queues+0x107/0x230 Aug 22 10:54:38 juju-e4d256-prod-github-runner-207 kernel: [19852.582535] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 10:54:38 juju-e4d256-prod-github-runner-207 kernel: [19852.583572] ? hrtimer_interrupt+0x101/0x220 Aug 22 10:54:38 juju-e4d256-prod-github-runner-207 kernel: [19852.584600] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 10:54:38 juju-e4d256-prod-github-runner-207 kernel: [19852.585681] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 10:54:38 juju-e4d256-prod-github-runner-207 kernel: [19852.586746] Aug 22 10:54:38 juju-e4d256-prod-github-runner-207 kernel: [19852.587605] Aug 22 10:54:38 juju-e4d256-prod-github-runner-207 kernel: [19852.588448] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 10:54:38 juju-e4d256-prod-github-runner-207 kernel: [19852.589486] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:54:38 juju-e4d256-prod-github-runner-207 kernel: [19852.590545] ? _raw_spin_lock+0x22/0x30 Aug 22 10:54:38 juju-e4d256-prod-github-runner-207 kernel: [19852.591503] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:54:38 juju-e4d256-prod-github-runner-207 kernel: [19852.592524] direct_page_fault+0x206/0x310 [kvm] Aug 22 10:54:38 juju-e4d256-prod-github-runner-207 kernel: [19852.593555] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 10:54:38 juju-e4d256-prod-github-runner-207 kernel: [19852.594577] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 10:54:38 juju-e4d256-prod-github-runner-207 kernel: [19852.595591] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 10:54:38 juju-e4d256-prod-github-runner-207 kernel: [19852.596576] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 10:54:38 juju-e4d256-prod-github-runner-207 kernel: [19852.597528] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 10:54:38 juju-e4d256-prod-github-runner-207 kernel: [19852.598521] handle_exit+0x98/0x230 [kvm_amd] Aug 22 10:54:38 juju-e4d256-prod-github-runner-207 kernel: [19852.599419] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 10:54:38 juju-e4d256-prod-github-runner-207 kernel: [19852.600337] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 10:54:38 juju-e4d256-prod-github-runner-207 kernel: [19852.601264] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 10:54:38 juju-e4d256-prod-github-runner-207 kernel: [19852.602176] vcpu_run+0x62/0x2c0 [kvm] Aug 22 10:54:38 juju-e4d256-prod-github-runner-207 kernel: [19852.602998] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 10:54:38 juju-e4d256-prod-github-runner-207 kernel: [19852.603810] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 10:54:38 juju-e4d256-prod-github-runner-207 kernel: [19852.604675] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 10:54:38 juju-e4d256-prod-github-runner-207 kernel: [19852.605480] ? __seccomp_filter+0x4a/0x4a0 Aug 22 10:54:38 juju-e4d256-prod-github-runner-207 kernel: [19852.606226] ? __fget_files+0x86/0xc0 Aug 22 10:54:38 juju-e4d256-prod-github-runner-207 kernel: [19852.606964] __x64_sys_ioctl+0x95/0xd0 Aug 22 10:54:38 juju-e4d256-prod-github-runner-207 kernel: [19852.607681] do_syscall_64+0x5c/0xc0 Aug 22 10:54:38 juju-e4d256-prod-github-runner-207 kernel: [19852.608355] ? do_futex+0x162/0x1f0 Aug 22 10:54:38 juju-e4d256-prod-github-runner-207 kernel: [19852.609007] ? __x64_sys_futex+0x78/0x1e0 Aug 22 10:54:38 juju-e4d256-prod-github-runner-207 kernel: [19852.609683] ? __secure_computing+0xa9/0x120 Aug 22 10:54:38 juju-e4d256-prod-github-runner-207 kernel: [19852.610385] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 10:54:38 juju-e4d256-prod-github-runner-207 kernel: [19852.611176] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:54:38 juju-e4d256-prod-github-runner-207 kernel: [19852.611921] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:54:38 juju-e4d256-prod-github-runner-207 kernel: [19852.612641] ? do_syscall_64+0x69/0xc0 Aug 22 10:54:38 juju-e4d256-prod-github-runner-207 kernel: [19852.613294] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:54:38 juju-e4d256-prod-github-runner-207 kernel: [19852.614004] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:54:38 juju-e4d256-prod-github-runner-207 kernel: [19852.614709] ? do_syscall_64+0x69/0xc0 Aug 22 10:54:38 juju-e4d256-prod-github-runner-207 kernel: [19852.615336] ? do_syscall_64+0x69/0xc0 Aug 22 10:54:38 juju-e4d256-prod-github-runner-207 kernel: [19852.615966] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 10:54:38 juju-e4d256-prod-github-runner-207 kernel: [19852.616672] RIP: 0033:0x7faa5d0edaff Aug 22 10:54:38 juju-e4d256-prod-github-runner-207 kernel: [19852.617319] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 10:54:38 juju-e4d256-prod-github-runner-207 kernel: [19852.619316] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 10:54:38 juju-e4d256-prod-github-runner-207 kernel: [19852.620233] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 10:54:38 juju-e4d256-prod-github-runner-207 kernel: [19852.621135] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 10:54:38 juju-e4d256-prod-github-runner-207 kernel: [19852.622031] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 10:54:38 juju-e4d256-prod-github-runner-207 kernel: [19852.622942] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 10:54:38 juju-e4d256-prod-github-runner-207 kernel: [19852.623860] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 10:54:38 juju-e4d256-prod-github-runner-207 kernel: [19852.624757] Aug 22 10:55:06 juju-e4d256-prod-github-runner-207 kernel: [19880.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 18407s! [qemu-system-x86:6715] Aug 22 10:55:06 juju-e4d256-prod-github-runner-207 kernel: [19880.543886] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 10:55:06 juju-e4d256-prod-github-runner-207 kernel: [19880.544198] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 10:55:06 juju-e4d256-prod-github-runner-207 kernel: [19880.556353] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 10:55:06 juju-e4d256-prod-github-runner-207 kernel: [19880.557624] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 10:55:06 juju-e4d256-prod-github-runner-207 kernel: [19880.558859] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:55:06 juju-e4d256-prod-github-runner-207 kernel: [19880.560080] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 10:55:06 juju-e4d256-prod-github-runner-207 kernel: [19880.562647] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 10:55:06 juju-e4d256-prod-github-runner-207 kernel: [19880.563701] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 10:55:06 juju-e4d256-prod-github-runner-207 kernel: [19880.564867] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 10:55:06 juju-e4d256-prod-github-runner-207 kernel: [19880.566055] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 10:55:06 juju-e4d256-prod-github-runner-207 kernel: [19880.567223] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 10:55:06 juju-e4d256-prod-github-runner-207 kernel: [19880.568396] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 10:55:06 juju-e4d256-prod-github-runner-207 kernel: [19880.569585] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 10:55:06 juju-e4d256-prod-github-runner-207 kernel: [19880.570838] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 10:55:06 juju-e4d256-prod-github-runner-207 kernel: [19880.571942] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 10:55:06 juju-e4d256-prod-github-runner-207 kernel: [19880.573140] Call Trace: Aug 22 10:55:06 juju-e4d256-prod-github-runner-207 kernel: [19880.574068] Aug 22 10:55:06 juju-e4d256-prod-github-runner-207 kernel: [19880.574972] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:55:06 juju-e4d256-prod-github-runner-207 kernel: [19880.576009] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:55:06 juju-e4d256-prod-github-runner-207 kernel: [19880.577038] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:55:06 juju-e4d256-prod-github-runner-207 kernel: [19880.578147] ? show_regs.part.0+0x23/0x29 Aug 22 10:55:06 juju-e4d256-prod-github-runner-207 kernel: [19880.579149] ? show_regs.cold+0x8/0xd Aug 22 10:55:06 juju-e4d256-prod-github-runner-207 kernel: [19880.580125] ? watchdog_timer_fn+0x1be/0x220 Aug 22 10:55:06 juju-e4d256-prod-github-runner-207 kernel: [19880.581145] ? lockup_detector_update_enable+0x60/0x60 Aug 22 10:55:06 juju-e4d256-prod-github-runner-207 kernel: [19880.582241] ? __hrtimer_run_queues+0x107/0x230 Aug 22 10:55:06 juju-e4d256-prod-github-runner-207 kernel: [19880.583277] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 10:55:06 juju-e4d256-prod-github-runner-207 kernel: [19880.584311] ? hrtimer_interrupt+0x101/0x220 Aug 22 10:55:06 juju-e4d256-prod-github-runner-207 kernel: [19880.585332] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 10:55:06 juju-e4d256-prod-github-runner-207 kernel: [19880.586424] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 10:55:06 juju-e4d256-prod-github-runner-207 kernel: [19880.587477] Aug 22 10:55:06 juju-e4d256-prod-github-runner-207 kernel: [19880.588385] Aug 22 10:55:06 juju-e4d256-prod-github-runner-207 kernel: [19880.589232] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 10:55:06 juju-e4d256-prod-github-runner-207 kernel: [19880.590285] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:55:06 juju-e4d256-prod-github-runner-207 kernel: [19880.591400] ? _raw_spin_lock+0x22/0x30 Aug 22 10:55:06 juju-e4d256-prod-github-runner-207 kernel: [19880.594619] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:55:06 juju-e4d256-prod-github-runner-207 kernel: [19880.595657] direct_page_fault+0x206/0x310 [kvm] Aug 22 10:55:06 juju-e4d256-prod-github-runner-207 kernel: [19880.598931] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 10:55:06 juju-e4d256-prod-github-runner-207 kernel: [19880.599964] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 10:55:06 juju-e4d256-prod-github-runner-207 kernel: [19880.603314] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 10:55:06 juju-e4d256-prod-github-runner-207 kernel: [19880.606094] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 10:55:06 juju-e4d256-prod-github-runner-207 kernel: [19880.607624] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 10:55:06 juju-e4d256-prod-github-runner-207 kernel: [19880.610868] handle_exit+0x98/0x230 [kvm_amd] Aug 22 10:55:06 juju-e4d256-prod-github-runner-207 kernel: [19880.611774] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 10:55:06 juju-e4d256-prod-github-runner-207 kernel: [19880.614932] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 10:55:06 juju-e4d256-prod-github-runner-207 kernel: [19880.615875] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 10:55:06 juju-e4d256-prod-github-runner-207 kernel: [19880.616779] vcpu_run+0x62/0x2c0 [kvm] Aug 22 10:55:06 juju-e4d256-prod-github-runner-207 kernel: [19880.619802] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 10:55:06 juju-e4d256-prod-github-runner-207 kernel: [19880.620616] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 10:55:06 juju-e4d256-prod-github-runner-207 kernel: [19880.623671] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 10:55:06 juju-e4d256-prod-github-runner-207 kernel: [19880.624479] ? __seccomp_filter+0x4a/0x4a0 Aug 22 10:55:06 juju-e4d256-prod-github-runner-207 kernel: [19880.626288] ? __fget_files+0x86/0xc0 Aug 22 10:55:06 juju-e4d256-prod-github-runner-207 kernel: [19880.628085] __x64_sys_ioctl+0x95/0xd0 Aug 22 10:55:06 juju-e4d256-prod-github-runner-207 kernel: [19880.628782] do_syscall_64+0x5c/0xc0 Aug 22 10:55:06 juju-e4d256-prod-github-runner-207 kernel: [19880.631760] ? do_futex+0x162/0x1f0 Aug 22 10:55:06 juju-e4d256-prod-github-runner-207 kernel: [19880.632575] ? __x64_sys_futex+0x78/0x1e0 Aug 22 10:55:06 juju-e4d256-prod-github-runner-207 kernel: [19880.634520] ? __secure_computing+0xa9/0x120 Aug 22 10:55:06 juju-e4d256-prod-github-runner-207 kernel: [19880.636335] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 10:55:06 juju-e4d256-prod-github-runner-207 kernel: [19880.637839] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:55:06 juju-e4d256-prod-github-runner-207 kernel: [19880.640317] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:55:06 juju-e4d256-prod-github-runner-207 kernel: [19880.641072] ? do_syscall_64+0x69/0xc0 Aug 22 10:55:06 juju-e4d256-prod-github-runner-207 kernel: [19880.644012] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:55:06 juju-e4d256-prod-github-runner-207 kernel: [19880.644743] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:55:06 juju-e4d256-prod-github-runner-207 kernel: [19880.645454] ? do_syscall_64+0x69/0xc0 Aug 22 10:55:06 juju-e4d256-prod-github-runner-207 kernel: [19880.648289] ? do_syscall_64+0x69/0xc0 Aug 22 10:55:06 juju-e4d256-prod-github-runner-207 kernel: [19880.648985] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 10:55:06 juju-e4d256-prod-github-runner-207 kernel: [19880.650276] RIP: 0033:0x7faa5d0edaff Aug 22 10:55:06 juju-e4d256-prod-github-runner-207 kernel: [19880.652582] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 10:55:06 juju-e4d256-prod-github-runner-207 kernel: [19880.656863] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 10:55:06 juju-e4d256-prod-github-runner-207 kernel: [19880.657788] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 10:55:06 juju-e4d256-prod-github-runner-207 kernel: [19880.661008] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 10:55:06 juju-e4d256-prod-github-runner-207 kernel: [19880.661909] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 10:55:06 juju-e4d256-prod-github-runner-207 kernel: [19880.664515] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 10:55:06 juju-e4d256-prod-github-runner-207 kernel: [19880.665954] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 10:55:06 juju-e4d256-prod-github-runner-207 kernel: [19880.669292] Aug 22 10:55:34 juju-e4d256-prod-github-runner-207 kernel: [19908.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 18433s! [qemu-system-x86:6715] Aug 22 10:55:34 juju-e4d256-prod-github-runner-207 kernel: [19908.543833] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 10:55:34 juju-e4d256-prod-github-runner-207 kernel: [19908.544116] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 10:55:34 juju-e4d256-prod-github-runner-207 kernel: [19908.556774] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 10:55:34 juju-e4d256-prod-github-runner-207 kernel: [19908.558081] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 10:55:34 juju-e4d256-prod-github-runner-207 kernel: [19908.559304] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:55:34 juju-e4d256-prod-github-runner-207 kernel: [19908.560378] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 10:55:34 juju-e4d256-prod-github-runner-207 kernel: [19908.563024] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 10:55:34 juju-e4d256-prod-github-runner-207 kernel: [19908.564200] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 10:55:34 juju-e4d256-prod-github-runner-207 kernel: [19908.565517] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 10:55:34 juju-e4d256-prod-github-runner-207 kernel: [19908.566842] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 10:55:34 juju-e4d256-prod-github-runner-207 kernel: [19908.568159] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 10:55:34 juju-e4d256-prod-github-runner-207 kernel: [19908.569471] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 10:55:34 juju-e4d256-prod-github-runner-207 kernel: [19908.570797] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 10:55:34 juju-e4d256-prod-github-runner-207 kernel: [19908.572197] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 10:55:34 juju-e4d256-prod-github-runner-207 kernel: [19908.573415] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 10:55:34 juju-e4d256-prod-github-runner-207 kernel: [19908.574766] Call Trace: Aug 22 10:55:34 juju-e4d256-prod-github-runner-207 kernel: [19908.575775] Aug 22 10:55:34 juju-e4d256-prod-github-runner-207 kernel: [19908.576738] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:55:34 juju-e4d256-prod-github-runner-207 kernel: [19908.577891] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:55:34 juju-e4d256-prod-github-runner-207 kernel: [19908.579011] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:55:34 juju-e4d256-prod-github-runner-207 kernel: [19908.580217] ? show_regs.part.0+0x23/0x29 Aug 22 10:55:34 juju-e4d256-prod-github-runner-207 kernel: [19908.581314] ? show_regs.cold+0x8/0xd Aug 22 10:55:34 juju-e4d256-prod-github-runner-207 kernel: [19908.582395] ? watchdog_timer_fn+0x1be/0x220 Aug 22 10:55:34 juju-e4d256-prod-github-runner-207 kernel: [19908.583504] ? lockup_detector_update_enable+0x60/0x60 Aug 22 10:55:34 juju-e4d256-prod-github-runner-207 kernel: [19908.584680] ? __hrtimer_run_queues+0x107/0x230 Aug 22 10:55:34 juju-e4d256-prod-github-runner-207 kernel: [19908.585829] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 10:55:34 juju-e4d256-prod-github-runner-207 kernel: [19908.586952] ? hrtimer_interrupt+0x101/0x220 Aug 22 10:55:34 juju-e4d256-prod-github-runner-207 kernel: [19908.588062] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 10:55:34 juju-e4d256-prod-github-runner-207 kernel: [19908.589262] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 10:55:34 juju-e4d256-prod-github-runner-207 kernel: [19908.590427] Aug 22 10:55:34 juju-e4d256-prod-github-runner-207 kernel: [19908.591328] Aug 22 10:55:34 juju-e4d256-prod-github-runner-207 kernel: [19908.592242] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 10:55:34 juju-e4d256-prod-github-runner-207 kernel: [19908.593398] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:55:34 juju-e4d256-prod-github-runner-207 kernel: [19908.594562] ? _raw_spin_lock+0x22/0x30 Aug 22 10:55:34 juju-e4d256-prod-github-runner-207 kernel: [19908.595595] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:55:34 juju-e4d256-prod-github-runner-207 kernel: [19908.596720] direct_page_fault+0x206/0x310 [kvm] Aug 22 10:55:34 juju-e4d256-prod-github-runner-207 kernel: [19908.597873] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 10:55:34 juju-e4d256-prod-github-runner-207 kernel: [19908.598991] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 10:55:34 juju-e4d256-prod-github-runner-207 kernel: [19908.600098] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 10:55:34 juju-e4d256-prod-github-runner-207 kernel: [19908.601209] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 10:55:34 juju-e4d256-prod-github-runner-207 kernel: [19908.602275] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 10:55:34 juju-e4d256-prod-github-runner-207 kernel: [19908.603366] handle_exit+0x98/0x230 [kvm_amd] Aug 22 10:55:34 juju-e4d256-prod-github-runner-207 kernel: [19908.604363] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 10:55:34 juju-e4d256-prod-github-runner-207 kernel: [19908.605372] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 10:55:34 juju-e4d256-prod-github-runner-207 kernel: [19908.606404] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 10:55:34 juju-e4d256-prod-github-runner-207 kernel: [19908.607418] vcpu_run+0x62/0x2c0 [kvm] Aug 22 10:55:34 juju-e4d256-prod-github-runner-207 kernel: [19908.608306] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 10:55:34 juju-e4d256-prod-github-runner-207 kernel: [19908.609205] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 10:55:34 juju-e4d256-prod-github-runner-207 kernel: [19908.610269] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 10:55:34 juju-e4d256-prod-github-runner-207 kernel: [19908.611156] ? __seccomp_filter+0x4a/0x4a0 Aug 22 10:55:34 juju-e4d256-prod-github-runner-207 kernel: [19908.611987] ? __fget_files+0x86/0xc0 Aug 22 10:55:34 juju-e4d256-prod-github-runner-207 kernel: [19908.612769] __x64_sys_ioctl+0x95/0xd0 Aug 22 10:55:34 juju-e4d256-prod-github-runner-207 kernel: [19908.613541] do_syscall_64+0x5c/0xc0 Aug 22 10:55:34 juju-e4d256-prod-github-runner-207 kernel: [19908.614292] ? do_futex+0x162/0x1f0 Aug 22 10:55:34 juju-e4d256-prod-github-runner-207 kernel: [19908.615013] ? __x64_sys_futex+0x78/0x1e0 Aug 22 10:55:34 juju-e4d256-prod-github-runner-207 kernel: [19908.615769] ? __secure_computing+0xa9/0x120 Aug 22 10:55:34 juju-e4d256-prod-github-runner-207 kernel: [19908.616547] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 10:55:34 juju-e4d256-prod-github-runner-207 kernel: [19908.617422] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:55:34 juju-e4d256-prod-github-runner-207 kernel: [19908.618262] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:55:34 juju-e4d256-prod-github-runner-207 kernel: [19908.619080] ? do_syscall_64+0x69/0xc0 Aug 22 10:55:34 juju-e4d256-prod-github-runner-207 kernel: [19908.619801] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:55:34 juju-e4d256-prod-github-runner-207 kernel: [19908.620597] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:55:34 juju-e4d256-prod-github-runner-207 kernel: [19908.621386] ? do_syscall_64+0x69/0xc0 Aug 22 10:55:34 juju-e4d256-prod-github-runner-207 kernel: [19908.622104] ? do_syscall_64+0x69/0xc0 Aug 22 10:55:34 juju-e4d256-prod-github-runner-207 kernel: [19908.622803] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 10:55:34 juju-e4d256-prod-github-runner-207 kernel: [19908.623607] RIP: 0033:0x7faa5d0edaff Aug 22 10:55:34 juju-e4d256-prod-github-runner-207 kernel: [19908.624328] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 10:55:34 juju-e4d256-prod-github-runner-207 kernel: [19908.626666] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 10:55:34 juju-e4d256-prod-github-runner-207 kernel: [19908.627726] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 10:55:34 juju-e4d256-prod-github-runner-207 kernel: [19908.628752] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 10:55:34 juju-e4d256-prod-github-runner-207 kernel: [19908.629805] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 10:55:34 juju-e4d256-prod-github-runner-207 kernel: [19908.630831] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 10:55:34 juju-e4d256-prod-github-runner-207 kernel: [19908.631851] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 10:55:34 juju-e4d256-prod-github-runner-207 kernel: [19908.632890] Aug 22 10:56:02 juju-e4d256-prod-github-runner-207 kernel: [19936.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 18459s! [qemu-system-x86:6715] Aug 22 10:56:02 juju-e4d256-prod-github-runner-207 kernel: [19936.543147] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 10:56:02 juju-e4d256-prod-github-runner-207 kernel: [19936.543223] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 10:56:02 juju-e4d256-prod-github-runner-207 kernel: [19936.555474] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 10:56:02 juju-e4d256-prod-github-runner-207 kernel: [19936.556806] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 10:56:02 juju-e4d256-prod-github-runner-207 kernel: [19936.558047] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:56:02 juju-e4d256-prod-github-runner-207 kernel: [19936.559118] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 10:56:02 juju-e4d256-prod-github-runner-207 kernel: [19936.561700] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 10:56:02 juju-e4d256-prod-github-runner-207 kernel: [19936.562746] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 10:56:02 juju-e4d256-prod-github-runner-207 kernel: [19936.563941] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 10:56:02 juju-e4d256-prod-github-runner-207 kernel: [19936.565138] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 10:56:02 juju-e4d256-prod-github-runner-207 kernel: [19936.566329] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 10:56:02 juju-e4d256-prod-github-runner-207 kernel: [19936.567508] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 10:56:02 juju-e4d256-prod-github-runner-207 kernel: [19936.568789] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 10:56:02 juju-e4d256-prod-github-runner-207 kernel: [19936.570104] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 10:56:02 juju-e4d256-prod-github-runner-207 kernel: [19936.571223] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 10:56:02 juju-e4d256-prod-github-runner-207 kernel: [19936.572446] Call Trace: Aug 22 10:56:02 juju-e4d256-prod-github-runner-207 kernel: [19936.573397] Aug 22 10:56:02 juju-e4d256-prod-github-runner-207 kernel: [19936.574287] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:56:02 juju-e4d256-prod-github-runner-207 kernel: [19936.575323] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:56:02 juju-e4d256-prod-github-runner-207 kernel: [19936.576351] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:56:02 juju-e4d256-prod-github-runner-207 kernel: [19936.577451] ? show_regs.part.0+0x23/0x29 Aug 22 10:56:02 juju-e4d256-prod-github-runner-207 kernel: [19936.578508] ? show_regs.cold+0x8/0xd Aug 22 10:56:02 juju-e4d256-prod-github-runner-207 kernel: [19936.579494] ? watchdog_timer_fn+0x1be/0x220 Aug 22 10:56:02 juju-e4d256-prod-github-runner-207 kernel: [19936.580514] ? lockup_detector_update_enable+0x60/0x60 Aug 22 10:56:02 juju-e4d256-prod-github-runner-207 kernel: [19936.581605] ? __hrtimer_run_queues+0x107/0x230 Aug 22 10:56:02 juju-e4d256-prod-github-runner-207 kernel: [19936.582786] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 10:56:02 juju-e4d256-prod-github-runner-207 kernel: [19936.583817] ? hrtimer_interrupt+0x101/0x220 Aug 22 10:56:02 juju-e4d256-prod-github-runner-207 kernel: [19936.584836] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 10:56:02 juju-e4d256-prod-github-runner-207 kernel: [19936.585953] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 10:56:02 juju-e4d256-prod-github-runner-207 kernel: [19936.587187] Aug 22 10:56:02 juju-e4d256-prod-github-runner-207 kernel: [19936.588049] Aug 22 10:56:02 juju-e4d256-prod-github-runner-207 kernel: [19936.588931] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 10:56:02 juju-e4d256-prod-github-runner-207 kernel: [19936.589993] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:56:02 juju-e4d256-prod-github-runner-207 kernel: [19936.591042] ? _raw_spin_lock+0x22/0x30 Aug 22 10:56:02 juju-e4d256-prod-github-runner-207 kernel: [19936.591996] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:56:02 juju-e4d256-prod-github-runner-207 kernel: [19936.593030] direct_page_fault+0x206/0x310 [kvm] Aug 22 10:56:02 juju-e4d256-prod-github-runner-207 kernel: [19936.594069] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 10:56:02 juju-e4d256-prod-github-runner-207 kernel: [19936.595083] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 10:56:02 juju-e4d256-prod-github-runner-207 kernel: [19936.596109] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 10:56:02 juju-e4d256-prod-github-runner-207 kernel: [19936.597092] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 10:56:02 juju-e4d256-prod-github-runner-207 kernel: [19936.598084] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 10:56:02 juju-e4d256-prod-github-runner-207 kernel: [19936.599067] handle_exit+0x98/0x230 [kvm_amd] Aug 22 10:56:02 juju-e4d256-prod-github-runner-207 kernel: [19936.599964] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 10:56:02 juju-e4d256-prod-github-runner-207 kernel: [19936.600887] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 10:56:02 juju-e4d256-prod-github-runner-207 kernel: [19936.601829] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 10:56:02 juju-e4d256-prod-github-runner-207 kernel: [19936.602738] vcpu_run+0x62/0x2c0 [kvm] Aug 22 10:56:02 juju-e4d256-prod-github-runner-207 kernel: [19936.603552] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 10:56:02 juju-e4d256-prod-github-runner-207 kernel: [19936.604364] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 10:56:02 juju-e4d256-prod-github-runner-207 kernel: [19936.605223] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 10:56:02 juju-e4d256-prod-github-runner-207 kernel: [19936.606072] ? __seccomp_filter+0x4a/0x4a0 Aug 22 10:56:02 juju-e4d256-prod-github-runner-207 kernel: [19936.606823] ? __fget_files+0x86/0xc0 Aug 22 10:56:02 juju-e4d256-prod-github-runner-207 kernel: [19936.607530] __x64_sys_ioctl+0x95/0xd0 Aug 22 10:56:02 juju-e4d256-prod-github-runner-207 kernel: [19936.608225] do_syscall_64+0x5c/0xc0 Aug 22 10:56:02 juju-e4d256-prod-github-runner-207 kernel: [19936.608894] ? do_futex+0x162/0x1f0 Aug 22 10:56:02 juju-e4d256-prod-github-runner-207 kernel: [19936.609562] ? __x64_sys_futex+0x78/0x1e0 Aug 22 10:56:02 juju-e4d256-prod-github-runner-207 kernel: [19936.610239] ? __secure_computing+0xa9/0x120 Aug 22 10:56:02 juju-e4d256-prod-github-runner-207 kernel: [19936.610952] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 10:56:02 juju-e4d256-prod-github-runner-207 kernel: [19936.611719] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:56:02 juju-e4d256-prod-github-runner-207 kernel: [19936.612442] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:56:02 juju-e4d256-prod-github-runner-207 kernel: [19936.613167] ? do_syscall_64+0x69/0xc0 Aug 22 10:56:02 juju-e4d256-prod-github-runner-207 kernel: [19936.613845] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:56:02 juju-e4d256-prod-github-runner-207 kernel: [19936.614600] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:56:02 juju-e4d256-prod-github-runner-207 kernel: [19936.615311] ? do_syscall_64+0x69/0xc0 Aug 22 10:56:02 juju-e4d256-prod-github-runner-207 kernel: [19936.615942] ? do_syscall_64+0x69/0xc0 Aug 22 10:56:02 juju-e4d256-prod-github-runner-207 kernel: [19936.616571] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 10:56:02 juju-e4d256-prod-github-runner-207 kernel: [19936.617356] RIP: 0033:0x7faa5d0edaff Aug 22 10:56:02 juju-e4d256-prod-github-runner-207 kernel: [19936.618014] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 10:56:02 juju-e4d256-prod-github-runner-207 kernel: [19936.620020] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 10:56:02 juju-e4d256-prod-github-runner-207 kernel: [19936.620935] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 10:56:02 juju-e4d256-prod-github-runner-207 kernel: [19936.621853] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 10:56:02 juju-e4d256-prod-github-runner-207 kernel: [19936.622745] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 10:56:02 juju-e4d256-prod-github-runner-207 kernel: [19936.623635] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 10:56:02 juju-e4d256-prod-github-runner-207 kernel: [19936.624531] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 10:56:02 juju-e4d256-prod-github-runner-207 kernel: [19936.625460] Aug 22 10:56:30 juju-e4d256-prod-github-runner-207 kernel: [19964.541980] watchdog: BUG: soft lockup - CPU#1 stuck for 18485s! [qemu-system-x86:6715] Aug 22 10:56:30 juju-e4d256-prod-github-runner-207 kernel: [19964.543844] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 10:56:30 juju-e4d256-prod-github-runner-207 kernel: [19964.544130] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 10:56:30 juju-e4d256-prod-github-runner-207 kernel: [19964.557292] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 10:56:30 juju-e4d256-prod-github-runner-207 kernel: [19964.558636] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 10:56:30 juju-e4d256-prod-github-runner-207 kernel: [19964.559884] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:56:30 juju-e4d256-prod-github-runner-207 kernel: [19964.560958] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 10:56:30 juju-e4d256-prod-github-runner-207 kernel: [19964.563595] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 10:56:30 juju-e4d256-prod-github-runner-207 kernel: [19964.564660] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 10:56:30 juju-e4d256-prod-github-runner-207 kernel: [19964.565866] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 10:56:30 juju-e4d256-prod-github-runner-207 kernel: [19964.567050] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 10:56:30 juju-e4d256-prod-github-runner-207 kernel: [19964.568238] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 10:56:30 juju-e4d256-prod-github-runner-207 kernel: [19964.569435] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 10:56:30 juju-e4d256-prod-github-runner-207 kernel: [19964.570617] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 10:56:30 juju-e4d256-prod-github-runner-207 kernel: [19964.571857] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 10:56:30 juju-e4d256-prod-github-runner-207 kernel: [19964.573003] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 10:56:30 juju-e4d256-prod-github-runner-207 kernel: [19964.574255] Call Trace: Aug 22 10:56:30 juju-e4d256-prod-github-runner-207 kernel: [19964.575175] Aug 22 10:56:30 juju-e4d256-prod-github-runner-207 kernel: [19964.576092] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:56:30 juju-e4d256-prod-github-runner-207 kernel: [19964.577148] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:56:30 juju-e4d256-prod-github-runner-207 kernel: [19964.578380] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:56:30 juju-e4d256-prod-github-runner-207 kernel: [19964.580041] ? show_regs.part.0+0x23/0x29 Aug 22 10:56:30 juju-e4d256-prod-github-runner-207 kernel: [19964.581528] ? show_regs.cold+0x8/0xd Aug 22 10:56:30 juju-e4d256-prod-github-runner-207 kernel: [19964.583011] ? watchdog_timer_fn+0x1be/0x220 Aug 22 10:56:30 juju-e4d256-prod-github-runner-207 kernel: [19964.584538] ? lockup_detector_update_enable+0x60/0x60 Aug 22 10:56:30 juju-e4d256-prod-github-runner-207 kernel: [19964.586218] ? __hrtimer_run_queues+0x107/0x230 Aug 22 10:56:30 juju-e4d256-prod-github-runner-207 kernel: [19964.588284] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 10:56:30 juju-e4d256-prod-github-runner-207 kernel: [19964.589526] ? hrtimer_interrupt+0x101/0x220 Aug 22 10:56:30 juju-e4d256-prod-github-runner-207 kernel: [19964.590583] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 10:56:30 juju-e4d256-prod-github-runner-207 kernel: [19964.591700] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 10:56:30 juju-e4d256-prod-github-runner-207 kernel: [19964.592750] Aug 22 10:56:30 juju-e4d256-prod-github-runner-207 kernel: [19964.593627] Aug 22 10:56:30 juju-e4d256-prod-github-runner-207 kernel: [19964.594498] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 10:56:30 juju-e4d256-prod-github-runner-207 kernel: [19964.595538] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:56:30 juju-e4d256-prod-github-runner-207 kernel: [19964.596586] ? _raw_spin_lock+0x22/0x30 Aug 22 10:56:30 juju-e4d256-prod-github-runner-207 kernel: [19964.597615] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:56:30 juju-e4d256-prod-github-runner-207 kernel: [19964.598660] direct_page_fault+0x206/0x310 [kvm] Aug 22 10:56:30 juju-e4d256-prod-github-runner-207 kernel: [19964.599692] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 10:56:30 juju-e4d256-prod-github-runner-207 kernel: [19964.600745] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 10:56:30 juju-e4d256-prod-github-runner-207 kernel: [19964.601767] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 10:56:30 juju-e4d256-prod-github-runner-207 kernel: [19964.602787] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 10:56:30 juju-e4d256-prod-github-runner-207 kernel: [19964.603736] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 10:56:30 juju-e4d256-prod-github-runner-207 kernel: [19964.604735] handle_exit+0x98/0x230 [kvm_amd] Aug 22 10:56:30 juju-e4d256-prod-github-runner-207 kernel: [19964.605652] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 10:56:30 juju-e4d256-prod-github-runner-207 kernel: [19964.606586] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 10:56:30 juju-e4d256-prod-github-runner-207 kernel: [19964.607533] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 10:56:30 juju-e4d256-prod-github-runner-207 kernel: [19964.608447] vcpu_run+0x62/0x2c0 [kvm] Aug 22 10:56:30 juju-e4d256-prod-github-runner-207 kernel: [19964.609295] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 10:56:30 juju-e4d256-prod-github-runner-207 kernel: [19964.610110] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 10:56:30 juju-e4d256-prod-github-runner-207 kernel: [19964.610992] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 10:56:30 juju-e4d256-prod-github-runner-207 kernel: [19964.611812] ? __seccomp_filter+0x4a/0x4a0 Aug 22 10:56:30 juju-e4d256-prod-github-runner-207 kernel: [19964.612705] ? __fget_files+0x86/0xc0 Aug 22 10:56:30 juju-e4d256-prod-github-runner-207 kernel: [19964.613438] __x64_sys_ioctl+0x95/0xd0 Aug 22 10:56:30 juju-e4d256-prod-github-runner-207 kernel: [19964.614135] do_syscall_64+0x5c/0xc0 Aug 22 10:56:30 juju-e4d256-prod-github-runner-207 kernel: [19964.614834] ? do_futex+0x162/0x1f0 Aug 22 10:56:30 juju-e4d256-prod-github-runner-207 kernel: [19964.615623] ? __x64_sys_futex+0x78/0x1e0 Aug 22 10:56:30 juju-e4d256-prod-github-runner-207 kernel: [19964.616300] ? __secure_computing+0xa9/0x120 Aug 22 10:56:30 juju-e4d256-prod-github-runner-207 kernel: [19964.617008] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 10:56:30 juju-e4d256-prod-github-runner-207 kernel: [19964.617771] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:56:30 juju-e4d256-prod-github-runner-207 kernel: [19964.618688] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:56:30 juju-e4d256-prod-github-runner-207 kernel: [19964.619414] ? do_syscall_64+0x69/0xc0 Aug 22 10:56:30 juju-e4d256-prod-github-runner-207 kernel: [19964.620066] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:56:30 juju-e4d256-prod-github-runner-207 kernel: [19964.620773] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:56:30 juju-e4d256-prod-github-runner-207 kernel: [19964.621538] ? do_syscall_64+0x69/0xc0 Aug 22 10:56:30 juju-e4d256-prod-github-runner-207 kernel: [19964.622182] ? do_syscall_64+0x69/0xc0 Aug 22 10:56:30 juju-e4d256-prod-github-runner-207 kernel: [19964.622808] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 10:56:30 juju-e4d256-prod-github-runner-207 kernel: [19964.623522] RIP: 0033:0x7faa5d0edaff Aug 22 10:56:30 juju-e4d256-prod-github-runner-207 kernel: [19964.624202] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 10:56:30 juju-e4d256-prod-github-runner-207 kernel: [19964.626256] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 10:56:30 juju-e4d256-prod-github-runner-207 kernel: [19964.627173] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 10:56:30 juju-e4d256-prod-github-runner-207 kernel: [19964.628088] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 10:56:30 juju-e4d256-prod-github-runner-207 kernel: [19964.629046] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 10:56:30 juju-e4d256-prod-github-runner-207 kernel: [19964.629938] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 10:56:30 juju-e4d256-prod-github-runner-207 kernel: [19964.630907] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 10:56:30 juju-e4d256-prod-github-runner-207 kernel: [19964.631831] Aug 22 10:56:44 juju-e4d256-prod-github-runner-207 kernel: [19978.520708] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 10:56:44 juju-e4d256-prod-github-runner-207 kernel: [19978.521712] rcu: 1-....: (4949840 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=2397438 Aug 22 10:56:44 juju-e4d256-prod-github-runner-207 kernel: [19978.523001] (t=4965330 jiffies g=23269 q=25964) Aug 22 10:56:44 juju-e4d256-prod-github-runner-207 kernel: [19978.523785] NMI backtrace for cpu 1 Aug 22 10:56:44 juju-e4d256-prod-github-runner-207 kernel: [19978.524494] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 10:56:44 juju-e4d256-prod-github-runner-207 kernel: [19978.525629] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 10:56:44 juju-e4d256-prod-github-runner-207 kernel: [19978.526880] Call Trace: Aug 22 10:56:44 juju-e4d256-prod-github-runner-207 kernel: [19978.527563] Aug 22 10:56:44 juju-e4d256-prod-github-runner-207 kernel: [19978.528208] show_stack+0x52/0x5c Aug 22 10:56:44 juju-e4d256-prod-github-runner-207 kernel: [19978.528955] dump_stack_lvl+0x4a/0x63 Aug 22 10:56:44 juju-e4d256-prod-github-runner-207 kernel: [19978.529706] dump_stack+0x10/0x16 Aug 22 10:56:44 juju-e4d256-prod-github-runner-207 kernel: [19978.530423] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 10:56:44 juju-e4d256-prod-github-runner-207 kernel: [19978.531207] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 10:56:44 juju-e4d256-prod-github-runner-207 kernel: [19978.531995] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 10:56:44 juju-e4d256-prod-github-runner-207 kernel: [19978.532833] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 10:56:44 juju-e4d256-prod-github-runner-207 kernel: [19978.533655] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 10:56:44 juju-e4d256-prod-github-runner-207 kernel: [19978.534465] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 10:56:44 juju-e4d256-prod-github-runner-207 kernel: [19978.535239] print_cpu_stall.cold+0x2f/0xe2 Aug 22 10:56:44 juju-e4d256-prod-github-runner-207 kernel: [19978.536006] ? timekeeping_update+0xf7/0x150 Aug 22 10:56:44 juju-e4d256-prod-github-runner-207 kernel: [19978.536778] check_cpu_stall+0x109/0x270 Aug 22 10:56:44 juju-e4d256-prod-github-runner-207 kernel: [19978.537544] rcu_sched_clock_irq+0x9a/0x250 Aug 22 10:56:44 juju-e4d256-prod-github-runner-207 kernel: [19978.538312] update_process_times+0x94/0xd0 Aug 22 10:56:44 juju-e4d256-prod-github-runner-207 kernel: [19978.539073] tick_sched_handle+0x29/0x70 Aug 22 10:56:44 juju-e4d256-prod-github-runner-207 kernel: [19978.539820] tick_sched_timer+0x8c/0xc0 Aug 22 10:56:44 juju-e4d256-prod-github-runner-207 kernel: [19978.540558] ? tick_nohz_handler+0xb0/0xb0 Aug 22 10:56:44 juju-e4d256-prod-github-runner-207 kernel: [19978.541327] __hrtimer_run_queues+0x107/0x230 Aug 22 10:56:44 juju-e4d256-prod-github-runner-207 kernel: [19978.542114] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 10:56:44 juju-e4d256-prod-github-runner-207 kernel: [19978.542892] hrtimer_interrupt+0x101/0x220 Aug 22 10:56:44 juju-e4d256-prod-github-runner-207 kernel: [19978.543657] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 10:56:44 juju-e4d256-prod-github-runner-207 kernel: [19978.544470] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 10:56:44 juju-e4d256-prod-github-runner-207 kernel: [19978.545290] Aug 22 10:56:44 juju-e4d256-prod-github-runner-207 kernel: [19978.545929] Aug 22 10:56:44 juju-e4d256-prod-github-runner-207 kernel: [19978.546560] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 10:56:44 juju-e4d256-prod-github-runner-207 kernel: [19978.547378] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:56:44 juju-e4d256-prod-github-runner-207 kernel: [19978.548257] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 10:56:44 juju-e4d256-prod-github-runner-207 kernel: [19978.550477] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 10:56:44 juju-e4d256-prod-github-runner-207 kernel: [19978.551357] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 10:56:44 juju-e4d256-prod-github-runner-207 kernel: [19978.552350] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 10:56:44 juju-e4d256-prod-github-runner-207 kernel: [19978.553338] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 10:56:44 juju-e4d256-prod-github-runner-207 kernel: [19978.554304] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 10:56:44 juju-e4d256-prod-github-runner-207 kernel: [19978.555266] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 10:56:44 juju-e4d256-prod-github-runner-207 kernel: [19978.556219] ? _raw_spin_lock+0x22/0x30 Aug 22 10:56:44 juju-e4d256-prod-github-runner-207 kernel: [19978.556997] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:56:44 juju-e4d256-prod-github-runner-207 kernel: [19978.557837] direct_page_fault+0x206/0x310 [kvm] Aug 22 10:56:44 juju-e4d256-prod-github-runner-207 kernel: [19978.558682] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 10:56:44 juju-e4d256-prod-github-runner-207 kernel: [19978.559516] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 10:56:44 juju-e4d256-prod-github-runner-207 kernel: [19978.560341] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 10:56:44 juju-e4d256-prod-github-runner-207 kernel: [19978.561162] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 10:56:44 juju-e4d256-prod-github-runner-207 kernel: [19978.561950] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 10:56:44 juju-e4d256-prod-github-runner-207 kernel: [19978.562774] handle_exit+0x98/0x230 [kvm_amd] Aug 22 10:56:44 juju-e4d256-prod-github-runner-207 kernel: [19978.563532] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 10:56:44 juju-e4d256-prod-github-runner-207 kernel: [19978.564375] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 10:56:44 juju-e4d256-prod-github-runner-207 kernel: [19978.565210] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 10:56:44 juju-e4d256-prod-github-runner-207 kernel: [19978.566003] vcpu_run+0x62/0x2c0 [kvm] Aug 22 10:56:44 juju-e4d256-prod-github-runner-207 kernel: [19978.566721] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 10:56:44 juju-e4d256-prod-github-runner-207 kernel: [19978.567463] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 10:56:44 juju-e4d256-prod-github-runner-207 kernel: [19978.568267] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 10:56:44 juju-e4d256-prod-github-runner-207 kernel: [19978.569074] ? __seccomp_filter+0x4a/0x4a0 Aug 22 10:56:44 juju-e4d256-prod-github-runner-207 kernel: [19978.569813] ? __fget_files+0x86/0xc0 Aug 22 10:56:44 juju-e4d256-prod-github-runner-207 kernel: [19978.570742] __x64_sys_ioctl+0x95/0xd0 Aug 22 10:56:44 juju-e4d256-prod-github-runner-207 kernel: [19978.571451] do_syscall_64+0x5c/0xc0 Aug 22 10:56:44 juju-e4d256-prod-github-runner-207 kernel: [19978.572137] ? do_futex+0x162/0x1f0 Aug 22 10:56:44 juju-e4d256-prod-github-runner-207 kernel: [19978.572830] ? __x64_sys_futex+0x78/0x1e0 Aug 22 10:56:44 juju-e4d256-prod-github-runner-207 kernel: [19978.573567] ? __secure_computing+0xa9/0x120 Aug 22 10:56:44 juju-e4d256-prod-github-runner-207 kernel: [19978.574294] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 10:56:44 juju-e4d256-prod-github-runner-207 kernel: [19978.575101] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:56:44 juju-e4d256-prod-github-runner-207 kernel: [19978.575859] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:56:44 juju-e4d256-prod-github-runner-207 kernel: [19978.576623] ? do_syscall_64+0x69/0xc0 Aug 22 10:56:44 juju-e4d256-prod-github-runner-207 kernel: [19978.577344] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:56:44 juju-e4d256-prod-github-runner-207 kernel: [19978.578129] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:56:44 juju-e4d256-prod-github-runner-207 kernel: [19978.578912] ? do_syscall_64+0x69/0xc0 Aug 22 10:56:44 juju-e4d256-prod-github-runner-207 kernel: [19978.579613] ? do_syscall_64+0x69/0xc0 Aug 22 10:56:44 juju-e4d256-prod-github-runner-207 kernel: [19978.580310] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 10:56:44 juju-e4d256-prod-github-runner-207 kernel: [19978.581124] RIP: 0033:0x7faa5d0edaff Aug 22 10:56:44 juju-e4d256-prod-github-runner-207 kernel: [19978.581818] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 10:56:44 juju-e4d256-prod-github-runner-207 kernel: [19978.583990] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 10:56:44 juju-e4d256-prod-github-runner-207 kernel: [19978.585034] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 10:56:44 juju-e4d256-prod-github-runner-207 kernel: [19978.586011] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 10:56:44 juju-e4d256-prod-github-runner-207 kernel: [19978.586966] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 10:56:44 juju-e4d256-prod-github-runner-207 kernel: [19978.587916] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 10:56:44 juju-e4d256-prod-github-runner-207 kernel: [19978.588863] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 10:56:44 juju-e4d256-prod-github-runner-207 kernel: [19978.589786] Aug 22 10:57:10 juju-e4d256-prod-github-runner-207 kernel: [20004.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 18522s! [qemu-system-x86:6715] Aug 22 10:57:10 juju-e4d256-prod-github-runner-207 kernel: [20004.543131] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 10:57:10 juju-e4d256-prod-github-runner-207 kernel: [20004.543206] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 10:57:10 juju-e4d256-prod-github-runner-207 kernel: [20004.555602] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 10:57:10 juju-e4d256-prod-github-runner-207 kernel: [20004.556919] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 10:57:10 juju-e4d256-prod-github-runner-207 kernel: [20004.558178] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:57:10 juju-e4d256-prod-github-runner-207 kernel: [20004.559270] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 10:57:10 juju-e4d256-prod-github-runner-207 kernel: [20004.561917] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 10:57:10 juju-e4d256-prod-github-runner-207 kernel: [20004.563000] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 10:57:10 juju-e4d256-prod-github-runner-207 kernel: [20004.564185] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 10:57:10 juju-e4d256-prod-github-runner-207 kernel: [20004.565388] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 10:57:10 juju-e4d256-prod-github-runner-207 kernel: [20004.566601] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 10:57:10 juju-e4d256-prod-github-runner-207 kernel: [20004.567778] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 10:57:10 juju-e4d256-prod-github-runner-207 kernel: [20004.568986] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 10:57:10 juju-e4d256-prod-github-runner-207 kernel: [20004.570226] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 10:57:10 juju-e4d256-prod-github-runner-207 kernel: [20004.571349] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 10:57:10 juju-e4d256-prod-github-runner-207 kernel: [20004.572585] Call Trace: Aug 22 10:57:10 juju-e4d256-prod-github-runner-207 kernel: [20004.573535] Aug 22 10:57:10 juju-e4d256-prod-github-runner-207 kernel: [20004.574452] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:57:10 juju-e4d256-prod-github-runner-207 kernel: [20004.575503] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:57:10 juju-e4d256-prod-github-runner-207 kernel: [20004.576783] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:57:10 juju-e4d256-prod-github-runner-207 kernel: [20004.578046] ? show_regs.part.0+0x23/0x29 Aug 22 10:57:10 juju-e4d256-prod-github-runner-207 kernel: [20004.579073] ? show_regs.cold+0x8/0xd Aug 22 10:57:10 juju-e4d256-prod-github-runner-207 kernel: [20004.580074] ? watchdog_timer_fn+0x1be/0x220 Aug 22 10:57:10 juju-e4d256-prod-github-runner-207 kernel: [20004.581178] ? lockup_detector_update_enable+0x60/0x60 Aug 22 10:57:10 juju-e4d256-prod-github-runner-207 kernel: [20004.582256] ? __hrtimer_run_queues+0x107/0x230 Aug 22 10:57:10 juju-e4d256-prod-github-runner-207 kernel: [20004.583291] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 10:57:10 juju-e4d256-prod-github-runner-207 kernel: [20004.584338] ? hrtimer_interrupt+0x101/0x220 Aug 22 10:57:10 juju-e4d256-prod-github-runner-207 kernel: [20004.585418] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 10:57:10 juju-e4d256-prod-github-runner-207 kernel: [20004.586526] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 10:57:10 juju-e4d256-prod-github-runner-207 kernel: [20004.587593] Aug 22 10:57:10 juju-e4d256-prod-github-runner-207 kernel: [20004.588478] Aug 22 10:57:10 juju-e4d256-prod-github-runner-207 kernel: [20004.589381] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 10:57:10 juju-e4d256-prod-github-runner-207 kernel: [20004.590441] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:57:10 juju-e4d256-prod-github-runner-207 kernel: [20004.591508] ? _raw_spin_lock+0x22/0x30 Aug 22 10:57:10 juju-e4d256-prod-github-runner-207 kernel: [20004.592471] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:57:10 juju-e4d256-prod-github-runner-207 kernel: [20004.593519] direct_page_fault+0x206/0x310 [kvm] Aug 22 10:57:10 juju-e4d256-prod-github-runner-207 kernel: [20004.594562] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 10:57:10 juju-e4d256-prod-github-runner-207 kernel: [20004.595574] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 10:57:10 juju-e4d256-prod-github-runner-207 kernel: [20004.596604] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 10:57:10 juju-e4d256-prod-github-runner-207 kernel: [20004.597576] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 10:57:10 juju-e4d256-prod-github-runner-207 kernel: [20004.598546] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 10:57:10 juju-e4d256-prod-github-runner-207 kernel: [20004.599527] handle_exit+0x98/0x230 [kvm_amd] Aug 22 10:57:10 juju-e4d256-prod-github-runner-207 kernel: [20004.600451] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 10:57:10 juju-e4d256-prod-github-runner-207 kernel: [20004.601394] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 10:57:10 juju-e4d256-prod-github-runner-207 kernel: [20004.602322] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 10:57:10 juju-e4d256-prod-github-runner-207 kernel: [20004.603228] vcpu_run+0x62/0x2c0 [kvm] Aug 22 10:57:10 juju-e4d256-prod-github-runner-207 kernel: [20004.604043] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 10:57:10 juju-e4d256-prod-github-runner-207 kernel: [20004.604870] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 10:57:10 juju-e4d256-prod-github-runner-207 kernel: [20004.605745] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 10:57:10 juju-e4d256-prod-github-runner-207 kernel: [20004.606567] ? __seccomp_filter+0x4a/0x4a0 Aug 22 10:57:10 juju-e4d256-prod-github-runner-207 kernel: [20004.607317] ? __fget_files+0x86/0xc0 Aug 22 10:57:10 juju-e4d256-prod-github-runner-207 kernel: [20004.608025] __x64_sys_ioctl+0x95/0xd0 Aug 22 10:57:10 juju-e4d256-prod-github-runner-207 kernel: [20004.608746] do_syscall_64+0x5c/0xc0 Aug 22 10:57:10 juju-e4d256-prod-github-runner-207 kernel: [20004.609420] ? do_futex+0x162/0x1f0 Aug 22 10:57:10 juju-e4d256-prod-github-runner-207 kernel: [20004.610070] ? __x64_sys_futex+0x78/0x1e0 Aug 22 10:57:10 juju-e4d256-prod-github-runner-207 kernel: [20004.610798] ? __secure_computing+0xa9/0x120 Aug 22 10:57:10 juju-e4d256-prod-github-runner-207 kernel: [20004.611506] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 10:57:10 juju-e4d256-prod-github-runner-207 kernel: [20004.612267] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:57:10 juju-e4d256-prod-github-runner-207 kernel: [20004.613002] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:57:10 juju-e4d256-prod-github-runner-207 kernel: [20004.613721] ? do_syscall_64+0x69/0xc0 Aug 22 10:57:10 juju-e4d256-prod-github-runner-207 kernel: [20004.614382] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:57:10 juju-e4d256-prod-github-runner-207 kernel: [20004.615098] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:57:10 juju-e4d256-prod-github-runner-207 kernel: [20004.615800] ? do_syscall_64+0x69/0xc0 Aug 22 10:57:10 juju-e4d256-prod-github-runner-207 kernel: [20004.616450] ? do_syscall_64+0x69/0xc0 Aug 22 10:57:10 juju-e4d256-prod-github-runner-207 kernel: [20004.617104] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 10:57:10 juju-e4d256-prod-github-runner-207 kernel: [20004.617817] RIP: 0033:0x7faa5d0edaff Aug 22 10:57:10 juju-e4d256-prod-github-runner-207 kernel: [20004.618443] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 10:57:10 juju-e4d256-prod-github-runner-207 kernel: [20004.620524] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 10:57:10 juju-e4d256-prod-github-runner-207 kernel: [20004.621477] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 10:57:10 juju-e4d256-prod-github-runner-207 kernel: [20004.622371] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 10:57:10 juju-e4d256-prod-github-runner-207 kernel: [20004.623278] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 10:57:10 juju-e4d256-prod-github-runner-207 kernel: [20004.624197] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 10:57:10 juju-e4d256-prod-github-runner-207 kernel: [20004.625113] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 10:57:10 juju-e4d256-prod-github-runner-207 kernel: [20004.626129] Aug 22 10:57:38 juju-e4d256-prod-github-runner-207 kernel: [20032.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 18548s! [qemu-system-x86:6715] Aug 22 10:57:38 juju-e4d256-prod-github-runner-207 kernel: [20032.543852] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 10:57:38 juju-e4d256-prod-github-runner-207 kernel: [20032.544145] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 10:57:38 juju-e4d256-prod-github-runner-207 kernel: [20032.556385] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 10:57:38 juju-e4d256-prod-github-runner-207 kernel: [20032.557675] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 10:57:38 juju-e4d256-prod-github-runner-207 kernel: [20032.558947] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:57:38 juju-e4d256-prod-github-runner-207 kernel: [20032.560036] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 10:57:38 juju-e4d256-prod-github-runner-207 kernel: [20032.562632] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 10:57:38 juju-e4d256-prod-github-runner-207 kernel: [20032.563682] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 10:57:38 juju-e4d256-prod-github-runner-207 kernel: [20032.564870] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 10:57:38 juju-e4d256-prod-github-runner-207 kernel: [20032.566047] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 10:57:38 juju-e4d256-prod-github-runner-207 kernel: [20032.567239] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 10:57:38 juju-e4d256-prod-github-runner-207 kernel: [20032.568421] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 10:57:38 juju-e4d256-prod-github-runner-207 kernel: [20032.569592] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 10:57:38 juju-e4d256-prod-github-runner-207 kernel: [20032.570826] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 10:57:38 juju-e4d256-prod-github-runner-207 kernel: [20032.571926] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 10:57:38 juju-e4d256-prod-github-runner-207 kernel: [20032.573136] Call Trace: Aug 22 10:57:38 juju-e4d256-prod-github-runner-207 kernel: [20032.574060] Aug 22 10:57:38 juju-e4d256-prod-github-runner-207 kernel: [20032.574974] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:57:38 juju-e4d256-prod-github-runner-207 kernel: [20032.576012] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:57:38 juju-e4d256-prod-github-runner-207 kernel: [20032.577054] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:57:38 juju-e4d256-prod-github-runner-207 kernel: [20032.578158] ? show_regs.part.0+0x23/0x29 Aug 22 10:57:38 juju-e4d256-prod-github-runner-207 kernel: [20032.579162] ? show_regs.cold+0x8/0xd Aug 22 10:57:38 juju-e4d256-prod-github-runner-207 kernel: [20032.580142] ? watchdog_timer_fn+0x1be/0x220 Aug 22 10:57:38 juju-e4d256-prod-github-runner-207 kernel: [20032.581174] ? lockup_detector_update_enable+0x60/0x60 Aug 22 10:57:38 juju-e4d256-prod-github-runner-207 kernel: [20032.582246] ? __hrtimer_run_queues+0x107/0x230 Aug 22 10:57:38 juju-e4d256-prod-github-runner-207 kernel: [20032.583282] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 10:57:38 juju-e4d256-prod-github-runner-207 kernel: [20032.584334] ? hrtimer_interrupt+0x101/0x220 Aug 22 10:57:38 juju-e4d256-prod-github-runner-207 kernel: [20032.585363] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 10:57:38 juju-e4d256-prod-github-runner-207 kernel: [20032.586441] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 10:57:38 juju-e4d256-prod-github-runner-207 kernel: [20032.587532] Aug 22 10:57:38 juju-e4d256-prod-github-runner-207 kernel: [20032.588441] Aug 22 10:57:38 juju-e4d256-prod-github-runner-207 kernel: [20032.589292] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 10:57:38 juju-e4d256-prod-github-runner-207 kernel: [20032.590333] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:57:38 juju-e4d256-prod-github-runner-207 kernel: [20032.591379] ? _raw_spin_lock+0x22/0x30 Aug 22 10:57:38 juju-e4d256-prod-github-runner-207 kernel: [20032.592351] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:57:38 juju-e4d256-prod-github-runner-207 kernel: [20032.593378] direct_page_fault+0x206/0x310 [kvm] Aug 22 10:57:38 juju-e4d256-prod-github-runner-207 kernel: [20032.594407] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 10:57:38 juju-e4d256-prod-github-runner-207 kernel: [20032.595426] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 10:57:38 juju-e4d256-prod-github-runner-207 kernel: [20032.596468] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 10:57:38 juju-e4d256-prod-github-runner-207 kernel: [20032.597493] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 10:57:38 juju-e4d256-prod-github-runner-207 kernel: [20032.598445] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 10:57:38 juju-e4d256-prod-github-runner-207 kernel: [20032.599434] handle_exit+0x98/0x230 [kvm_amd] Aug 22 10:57:38 juju-e4d256-prod-github-runner-207 kernel: [20032.600353] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 10:57:38 juju-e4d256-prod-github-runner-207 kernel: [20032.601275] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 10:57:38 juju-e4d256-prod-github-runner-207 kernel: [20032.602211] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 10:57:38 juju-e4d256-prod-github-runner-207 kernel: [20032.603124] vcpu_run+0x62/0x2c0 [kvm] Aug 22 10:57:38 juju-e4d256-prod-github-runner-207 kernel: [20032.603941] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 10:57:38 juju-e4d256-prod-github-runner-207 kernel: [20032.604764] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 10:57:38 juju-e4d256-prod-github-runner-207 kernel: [20032.605625] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 10:57:38 juju-e4d256-prod-github-runner-207 kernel: [20032.606428] ? __seccomp_filter+0x4a/0x4a0 Aug 22 10:57:38 juju-e4d256-prod-github-runner-207 kernel: [20032.607178] ? __fget_files+0x86/0xc0 Aug 22 10:57:38 juju-e4d256-prod-github-runner-207 kernel: [20032.607892] __x64_sys_ioctl+0x95/0xd0 Aug 22 10:57:38 juju-e4d256-prod-github-runner-207 kernel: [20032.608599] do_syscall_64+0x5c/0xc0 Aug 22 10:57:38 juju-e4d256-prod-github-runner-207 kernel: [20032.609277] ? do_futex+0x162/0x1f0 Aug 22 10:57:38 juju-e4d256-prod-github-runner-207 kernel: [20032.609930] ? __x64_sys_futex+0x78/0x1e0 Aug 22 10:57:38 juju-e4d256-prod-github-runner-207 kernel: [20032.610610] ? __secure_computing+0xa9/0x120 Aug 22 10:57:38 juju-e4d256-prod-github-runner-207 kernel: [20032.611309] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 10:57:38 juju-e4d256-prod-github-runner-207 kernel: [20032.612074] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:57:38 juju-e4d256-prod-github-runner-207 kernel: [20032.612839] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:57:38 juju-e4d256-prod-github-runner-207 kernel: [20032.613563] ? do_syscall_64+0x69/0xc0 Aug 22 10:57:38 juju-e4d256-prod-github-runner-207 kernel: [20032.614214] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:57:38 juju-e4d256-prod-github-runner-207 kernel: [20032.614926] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:57:38 juju-e4d256-prod-github-runner-207 kernel: [20032.615627] ? do_syscall_64+0x69/0xc0 Aug 22 10:57:38 juju-e4d256-prod-github-runner-207 kernel: [20032.616267] ? do_syscall_64+0x69/0xc0 Aug 22 10:57:38 juju-e4d256-prod-github-runner-207 kernel: [20032.616899] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 10:57:38 juju-e4d256-prod-github-runner-207 kernel: [20032.617610] RIP: 0033:0x7faa5d0edaff Aug 22 10:57:38 juju-e4d256-prod-github-runner-207 kernel: [20032.618289] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 10:57:38 juju-e4d256-prod-github-runner-207 kernel: [20032.620298] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 10:57:38 juju-e4d256-prod-github-runner-207 kernel: [20032.621219] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 10:57:38 juju-e4d256-prod-github-runner-207 kernel: [20032.622113] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 10:57:38 juju-e4d256-prod-github-runner-207 kernel: [20032.623006] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 10:57:38 juju-e4d256-prod-github-runner-207 kernel: [20032.623903] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 10:57:38 juju-e4d256-prod-github-runner-207 kernel: [20032.624817] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 10:57:38 juju-e4d256-prod-github-runner-207 kernel: [20032.625716] Aug 22 10:58:06 juju-e4d256-prod-github-runner-207 kernel: [20060.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 18574s! [qemu-system-x86:6715] Aug 22 10:58:06 juju-e4d256-prod-github-runner-207 kernel: [20060.543115] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 10:58:06 juju-e4d256-prod-github-runner-207 kernel: [20060.543192] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 10:58:06 juju-e4d256-prod-github-runner-207 kernel: [20060.555303] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 10:58:06 juju-e4d256-prod-github-runner-207 kernel: [20060.556583] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 10:58:06 juju-e4d256-prod-github-runner-207 kernel: [20060.557807] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:58:06 juju-e4d256-prod-github-runner-207 kernel: [20060.558874] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 10:58:06 juju-e4d256-prod-github-runner-207 kernel: [20060.561448] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 10:58:06 juju-e4d256-prod-github-runner-207 kernel: [20060.562494] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 10:58:06 juju-e4d256-prod-github-runner-207 kernel: [20060.563658] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 10:58:06 juju-e4d256-prod-github-runner-207 kernel: [20060.564836] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 10:58:06 juju-e4d256-prod-github-runner-207 kernel: [20060.566006] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 10:58:06 juju-e4d256-prod-github-runner-207 kernel: [20060.567178] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 10:58:06 juju-e4d256-prod-github-runner-207 kernel: [20060.568353] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 10:58:06 juju-e4d256-prod-github-runner-207 kernel: [20060.569591] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 10:58:06 juju-e4d256-prod-github-runner-207 kernel: [20060.570696] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 10:58:06 juju-e4d256-prod-github-runner-207 kernel: [20060.571909] Call Trace: Aug 22 10:58:06 juju-e4d256-prod-github-runner-207 kernel: [20060.572826] Aug 22 10:58:06 juju-e4d256-prod-github-runner-207 kernel: [20060.573720] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:58:06 juju-e4d256-prod-github-runner-207 kernel: [20060.574761] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:58:06 juju-e4d256-prod-github-runner-207 kernel: [20060.575792] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:58:06 juju-e4d256-prod-github-runner-207 kernel: [20060.576911] ? show_regs.part.0+0x23/0x29 Aug 22 10:58:06 juju-e4d256-prod-github-runner-207 kernel: [20060.577913] ? show_regs.cold+0x8/0xd Aug 22 10:58:06 juju-e4d256-prod-github-runner-207 kernel: [20060.578912] ? watchdog_timer_fn+0x1be/0x220 Aug 22 10:58:06 juju-e4d256-prod-github-runner-207 kernel: [20060.579938] ? lockup_detector_update_enable+0x60/0x60 Aug 22 10:58:06 juju-e4d256-prod-github-runner-207 kernel: [20060.581007] ? __hrtimer_run_queues+0x107/0x230 Aug 22 10:58:06 juju-e4d256-prod-github-runner-207 kernel: [20060.582047] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 10:58:06 juju-e4d256-prod-github-runner-207 kernel: [20060.583080] ? hrtimer_interrupt+0x101/0x220 Aug 22 10:58:06 juju-e4d256-prod-github-runner-207 kernel: [20060.584107] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 10:58:06 juju-e4d256-prod-github-runner-207 kernel: [20060.585180] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 10:58:06 juju-e4d256-prod-github-runner-207 kernel: [20060.586232] Aug 22 10:58:06 juju-e4d256-prod-github-runner-207 kernel: [20060.587097] Aug 22 10:58:06 juju-e4d256-prod-github-runner-207 kernel: [20060.587945] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 10:58:06 juju-e4d256-prod-github-runner-207 kernel: [20060.588980] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:58:06 juju-e4d256-prod-github-runner-207 kernel: [20060.590022] ? _raw_spin_lock+0x22/0x30 Aug 22 10:58:06 juju-e4d256-prod-github-runner-207 kernel: [20060.590974] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:58:06 juju-e4d256-prod-github-runner-207 kernel: [20060.592012] direct_page_fault+0x206/0x310 [kvm] Aug 22 10:58:06 juju-e4d256-prod-github-runner-207 kernel: [20060.593044] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 10:58:06 juju-e4d256-prod-github-runner-207 kernel: [20060.594068] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 10:58:06 juju-e4d256-prod-github-runner-207 kernel: [20060.595071] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 10:58:06 juju-e4d256-prod-github-runner-207 kernel: [20060.596053] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 10:58:06 juju-e4d256-prod-github-runner-207 kernel: [20060.597002] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 10:58:06 juju-e4d256-prod-github-runner-207 kernel: [20060.597982] handle_exit+0x98/0x230 [kvm_amd] Aug 22 10:58:06 juju-e4d256-prod-github-runner-207 kernel: [20060.598876] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 10:58:06 juju-e4d256-prod-github-runner-207 kernel: [20060.599790] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 10:58:06 juju-e4d256-prod-github-runner-207 kernel: [20060.600727] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 10:58:06 juju-e4d256-prod-github-runner-207 kernel: [20060.601639] vcpu_run+0x62/0x2c0 [kvm] Aug 22 10:58:06 juju-e4d256-prod-github-runner-207 kernel: [20060.602461] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 10:58:06 juju-e4d256-prod-github-runner-207 kernel: [20060.603273] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 10:58:06 juju-e4d256-prod-github-runner-207 kernel: [20060.604145] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 10:58:06 juju-e4d256-prod-github-runner-207 kernel: [20060.604946] ? __seccomp_filter+0x4a/0x4a0 Aug 22 10:58:06 juju-e4d256-prod-github-runner-207 kernel: [20060.605703] ? __fget_files+0x86/0xc0 Aug 22 10:58:06 juju-e4d256-prod-github-runner-207 kernel: [20060.606410] __x64_sys_ioctl+0x95/0xd0 Aug 22 10:58:06 juju-e4d256-prod-github-runner-207 kernel: [20060.607111] do_syscall_64+0x5c/0xc0 Aug 22 10:58:06 juju-e4d256-prod-github-runner-207 kernel: [20060.607869] ? do_futex+0x162/0x1f0 Aug 22 10:58:06 juju-e4d256-prod-github-runner-207 kernel: [20060.608525] ? __x64_sys_futex+0x78/0x1e0 Aug 22 10:58:06 juju-e4d256-prod-github-runner-207 kernel: [20060.609202] ? __secure_computing+0xa9/0x120 Aug 22 10:58:06 juju-e4d256-prod-github-runner-207 kernel: [20060.609893] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 10:58:06 juju-e4d256-prod-github-runner-207 kernel: [20060.610652] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:58:06 juju-e4d256-prod-github-runner-207 kernel: [20060.611381] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:58:06 juju-e4d256-prod-github-runner-207 kernel: [20060.612110] ? do_syscall_64+0x69/0xc0 Aug 22 10:58:06 juju-e4d256-prod-github-runner-207 kernel: [20060.612769] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:58:06 juju-e4d256-prod-github-runner-207 kernel: [20060.613479] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:58:06 juju-e4d256-prod-github-runner-207 kernel: [20060.614179] ? do_syscall_64+0x69/0xc0 Aug 22 10:58:06 juju-e4d256-prod-github-runner-207 kernel: [20060.614803] ? do_syscall_64+0x69/0xc0 Aug 22 10:58:06 juju-e4d256-prod-github-runner-207 kernel: [20060.615425] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 10:58:06 juju-e4d256-prod-github-runner-207 kernel: [20060.616142] RIP: 0033:0x7faa5d0edaff Aug 22 10:58:06 juju-e4d256-prod-github-runner-207 kernel: [20060.616768] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 10:58:06 juju-e4d256-prod-github-runner-207 kernel: [20060.618753] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 10:58:06 juju-e4d256-prod-github-runner-207 kernel: [20060.619663] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 10:58:06 juju-e4d256-prod-github-runner-207 kernel: [20060.620569] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 10:58:06 juju-e4d256-prod-github-runner-207 kernel: [20060.621463] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 10:58:06 juju-e4d256-prod-github-runner-207 kernel: [20060.622357] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 10:58:06 juju-e4d256-prod-github-runner-207 kernel: [20060.623256] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 10:58:06 juju-e4d256-prod-github-runner-207 kernel: [20060.624156] Aug 22 10:58:34 juju-e4d256-prod-github-runner-207 kernel: [20088.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 18600s! [qemu-system-x86:6715] Aug 22 10:58:34 juju-e4d256-prod-github-runner-207 kernel: [20088.543175] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 10:58:34 juju-e4d256-prod-github-runner-207 kernel: [20088.543250] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 10:58:34 juju-e4d256-prod-github-runner-207 kernel: [20088.555637] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 10:58:34 juju-e4d256-prod-github-runner-207 kernel: [20088.556950] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 10:58:34 juju-e4d256-prod-github-runner-207 kernel: [20088.558207] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:58:34 juju-e4d256-prod-github-runner-207 kernel: [20088.559304] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 10:58:34 juju-e4d256-prod-github-runner-207 kernel: [20088.561973] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 10:58:34 juju-e4d256-prod-github-runner-207 kernel: [20088.563064] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 10:58:34 juju-e4d256-prod-github-runner-207 kernel: [20088.564288] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 10:58:34 juju-e4d256-prod-github-runner-207 kernel: [20088.565484] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 10:58:34 juju-e4d256-prod-github-runner-207 kernel: [20088.566692] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 10:58:34 juju-e4d256-prod-github-runner-207 kernel: [20088.567923] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 10:58:34 juju-e4d256-prod-github-runner-207 kernel: [20088.569130] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 10:58:34 juju-e4d256-prod-github-runner-207 kernel: [20088.570400] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 10:58:34 juju-e4d256-prod-github-runner-207 kernel: [20088.571545] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 10:58:34 juju-e4d256-prod-github-runner-207 kernel: [20088.572777] Call Trace: Aug 22 10:58:34 juju-e4d256-prod-github-runner-207 kernel: [20088.573714] Aug 22 10:58:34 juju-e4d256-prod-github-runner-207 kernel: [20088.574635] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:58:34 juju-e4d256-prod-github-runner-207 kernel: [20088.575717] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:58:34 juju-e4d256-prod-github-runner-207 kernel: [20088.576782] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:58:34 juju-e4d256-prod-github-runner-207 kernel: [20088.577888] ? show_regs.part.0+0x23/0x29 Aug 22 10:58:34 juju-e4d256-prod-github-runner-207 kernel: [20088.578915] ? show_regs.cold+0x8/0xd Aug 22 10:58:34 juju-e4d256-prod-github-runner-207 kernel: [20088.579953] ? watchdog_timer_fn+0x1be/0x220 Aug 22 10:58:34 juju-e4d256-prod-github-runner-207 kernel: [20088.580994] ? lockup_detector_update_enable+0x60/0x60 Aug 22 10:58:34 juju-e4d256-prod-github-runner-207 kernel: [20088.582095] ? __hrtimer_run_queues+0x107/0x230 Aug 22 10:58:34 juju-e4d256-prod-github-runner-207 kernel: [20088.583168] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 10:58:34 juju-e4d256-prod-github-runner-207 kernel: [20088.584253] ? hrtimer_interrupt+0x101/0x220 Aug 22 10:58:34 juju-e4d256-prod-github-runner-207 kernel: [20088.585297] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 10:58:34 juju-e4d256-prod-github-runner-207 kernel: [20088.586393] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 10:58:34 juju-e4d256-prod-github-runner-207 kernel: [20088.587479] Aug 22 10:58:34 juju-e4d256-prod-github-runner-207 kernel: [20088.588376] Aug 22 10:58:34 juju-e4d256-prod-github-runner-207 kernel: [20088.589251] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 10:58:34 juju-e4d256-prod-github-runner-207 kernel: [20088.590317] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:58:34 juju-e4d256-prod-github-runner-207 kernel: [20088.591389] ? _raw_spin_lock+0x22/0x30 Aug 22 10:58:34 juju-e4d256-prod-github-runner-207 kernel: [20088.592388] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:58:34 juju-e4d256-prod-github-runner-207 kernel: [20088.593435] direct_page_fault+0x206/0x310 [kvm] Aug 22 10:58:34 juju-e4d256-prod-github-runner-207 kernel: [20088.594489] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 10:58:34 juju-e4d256-prod-github-runner-207 kernel: [20088.595544] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 10:58:34 juju-e4d256-prod-github-runner-207 kernel: [20088.596590] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 10:58:34 juju-e4d256-prod-github-runner-207 kernel: [20088.597598] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 10:58:34 juju-e4d256-prod-github-runner-207 kernel: [20088.598571] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 10:58:34 juju-e4d256-prod-github-runner-207 kernel: [20088.599607] handle_exit+0x98/0x230 [kvm_amd] Aug 22 10:58:34 juju-e4d256-prod-github-runner-207 kernel: [20088.600538] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 10:58:34 juju-e4d256-prod-github-runner-207 kernel: [20088.601489] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 10:58:34 juju-e4d256-prod-github-runner-207 kernel: [20088.602443] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 10:58:34 juju-e4d256-prod-github-runner-207 kernel: [20088.603377] vcpu_run+0x62/0x2c0 [kvm] Aug 22 10:58:34 juju-e4d256-prod-github-runner-207 kernel: [20088.604241] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 10:58:34 juju-e4d256-prod-github-runner-207 kernel: [20088.605074] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 10:58:34 juju-e4d256-prod-github-runner-207 kernel: [20088.605954] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 10:58:34 juju-e4d256-prod-github-runner-207 kernel: [20088.606790] ? __seccomp_filter+0x4a/0x4a0 Aug 22 10:58:34 juju-e4d256-prod-github-runner-207 kernel: [20088.607562] ? __fget_files+0x86/0xc0 Aug 22 10:58:34 juju-e4d256-prod-github-runner-207 kernel: [20088.608294] __x64_sys_ioctl+0x95/0xd0 Aug 22 10:58:34 juju-e4d256-prod-github-runner-207 kernel: [20088.609011] do_syscall_64+0x5c/0xc0 Aug 22 10:58:34 juju-e4d256-prod-github-runner-207 kernel: [20088.609712] ? do_futex+0x162/0x1f0 Aug 22 10:58:34 juju-e4d256-prod-github-runner-207 kernel: [20088.610391] ? __x64_sys_futex+0x78/0x1e0 Aug 22 10:58:34 juju-e4d256-prod-github-runner-207 kernel: [20088.611087] ? __secure_computing+0xa9/0x120 Aug 22 10:58:34 juju-e4d256-prod-github-runner-207 kernel: [20088.611825] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 10:58:34 juju-e4d256-prod-github-runner-207 kernel: [20088.612609] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:58:34 juju-e4d256-prod-github-runner-207 kernel: [20088.613360] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:58:34 juju-e4d256-prod-github-runner-207 kernel: [20088.614099] ? do_syscall_64+0x69/0xc0 Aug 22 10:58:34 juju-e4d256-prod-github-runner-207 kernel: [20088.614777] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:58:34 juju-e4d256-prod-github-runner-207 kernel: [20088.615538] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:58:34 juju-e4d256-prod-github-runner-207 kernel: [20088.616258] ? do_syscall_64+0x69/0xc0 Aug 22 10:58:34 juju-e4d256-prod-github-runner-207 kernel: [20088.616918] ? do_syscall_64+0x69/0xc0 Aug 22 10:58:34 juju-e4d256-prod-github-runner-207 kernel: [20088.617567] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 10:58:34 juju-e4d256-prod-github-runner-207 kernel: [20088.618398] RIP: 0033:0x7faa5d0edaff Aug 22 10:58:34 juju-e4d256-prod-github-runner-207 kernel: [20088.619213] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 10:58:34 juju-e4d256-prod-github-runner-207 kernel: [20088.621550] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 10:58:34 juju-e4d256-prod-github-runner-207 kernel: [20088.622492] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 10:58:34 juju-e4d256-prod-github-runner-207 kernel: [20088.623419] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 10:58:34 juju-e4d256-prod-github-runner-207 kernel: [20088.624351] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 10:58:34 juju-e4d256-prod-github-runner-207 kernel: [20088.625266] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 10:58:34 juju-e4d256-prod-github-runner-207 kernel: [20088.626194] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 10:58:34 juju-e4d256-prod-github-runner-207 kernel: [20088.627117] Aug 22 10:59:02 juju-e4d256-prod-github-runner-207 kernel: [20116.541980] watchdog: BUG: soft lockup - CPU#1 stuck for 18626s! [qemu-system-x86:6715] Aug 22 10:59:02 juju-e4d256-prod-github-runner-207 kernel: [20116.543879] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 10:59:02 juju-e4d256-prod-github-runner-207 kernel: [20116.544169] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 10:59:02 juju-e4d256-prod-github-runner-207 kernel: [20116.556351] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 10:59:02 juju-e4d256-prod-github-runner-207 kernel: [20116.557739] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 10:59:02 juju-e4d256-prod-github-runner-207 kernel: [20116.559058] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:59:02 juju-e4d256-prod-github-runner-207 kernel: [20116.560143] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 10:59:02 juju-e4d256-prod-github-runner-207 kernel: [20116.562701] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 10:59:02 juju-e4d256-prod-github-runner-207 kernel: [20116.563768] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 10:59:02 juju-e4d256-prod-github-runner-207 kernel: [20116.564933] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 10:59:02 juju-e4d256-prod-github-runner-207 kernel: [20116.566107] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 10:59:02 juju-e4d256-prod-github-runner-207 kernel: [20116.567279] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 10:59:02 juju-e4d256-prod-github-runner-207 kernel: [20116.568461] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 10:59:02 juju-e4d256-prod-github-runner-207 kernel: [20116.569637] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 10:59:02 juju-e4d256-prod-github-runner-207 kernel: [20116.570873] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 10:59:02 juju-e4d256-prod-github-runner-207 kernel: [20116.571991] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 10:59:02 juju-e4d256-prod-github-runner-207 kernel: [20116.573421] Call Trace: Aug 22 10:59:02 juju-e4d256-prod-github-runner-207 kernel: [20116.574374] Aug 22 10:59:02 juju-e4d256-prod-github-runner-207 kernel: [20116.575290] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:59:02 juju-e4d256-prod-github-runner-207 kernel: [20116.576333] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:59:02 juju-e4d256-prod-github-runner-207 kernel: [20116.577361] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:59:02 juju-e4d256-prod-github-runner-207 kernel: [20116.578462] ? show_regs.part.0+0x23/0x29 Aug 22 10:59:02 juju-e4d256-prod-github-runner-207 kernel: [20116.579475] ? show_regs.cold+0x8/0xd Aug 22 10:59:02 juju-e4d256-prod-github-runner-207 kernel: [20116.580457] ? watchdog_timer_fn+0x1be/0x220 Aug 22 10:59:02 juju-e4d256-prod-github-runner-207 kernel: [20116.581554] ? lockup_detector_update_enable+0x60/0x60 Aug 22 10:59:02 juju-e4d256-prod-github-runner-207 kernel: [20116.582630] ? __hrtimer_run_queues+0x107/0x230 Aug 22 10:59:02 juju-e4d256-prod-github-runner-207 kernel: [20116.583682] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 10:59:02 juju-e4d256-prod-github-runner-207 kernel: [20116.584728] ? hrtimer_interrupt+0x101/0x220 Aug 22 10:59:02 juju-e4d256-prod-github-runner-207 kernel: [20116.585760] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 10:59:02 juju-e4d256-prod-github-runner-207 kernel: [20116.586847] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 10:59:02 juju-e4d256-prod-github-runner-207 kernel: [20116.587942] Aug 22 10:59:02 juju-e4d256-prod-github-runner-207 kernel: [20116.588826] Aug 22 10:59:02 juju-e4d256-prod-github-runner-207 kernel: [20116.589678] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 10:59:02 juju-e4d256-prod-github-runner-207 kernel: [20116.590723] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:59:02 juju-e4d256-prod-github-runner-207 kernel: [20116.591790] ? _raw_spin_lock+0x22/0x30 Aug 22 10:59:02 juju-e4d256-prod-github-runner-207 kernel: [20116.592747] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:59:02 juju-e4d256-prod-github-runner-207 kernel: [20116.593769] direct_page_fault+0x206/0x310 [kvm] Aug 22 10:59:02 juju-e4d256-prod-github-runner-207 kernel: [20116.594807] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 10:59:02 juju-e4d256-prod-github-runner-207 kernel: [20116.595858] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 10:59:02 juju-e4d256-prod-github-runner-207 kernel: [20116.596873] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 10:59:02 juju-e4d256-prod-github-runner-207 kernel: [20116.597887] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 10:59:02 juju-e4d256-prod-github-runner-207 kernel: [20116.598846] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 10:59:02 juju-e4d256-prod-github-runner-207 kernel: [20116.599846] handle_exit+0x98/0x230 [kvm_amd] Aug 22 10:59:02 juju-e4d256-prod-github-runner-207 kernel: [20116.600756] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 10:59:02 juju-e4d256-prod-github-runner-207 kernel: [20116.601678] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 10:59:02 juju-e4d256-prod-github-runner-207 kernel: [20116.602605] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 10:59:02 juju-e4d256-prod-github-runner-207 kernel: [20116.603532] vcpu_run+0x62/0x2c0 [kvm] Aug 22 10:59:02 juju-e4d256-prod-github-runner-207 kernel: [20116.604354] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 10:59:02 juju-e4d256-prod-github-runner-207 kernel: [20116.605216] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 10:59:02 juju-e4d256-prod-github-runner-207 kernel: [20116.606096] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 10:59:02 juju-e4d256-prod-github-runner-207 kernel: [20116.607105] ? __seccomp_filter+0x4a/0x4a0 Aug 22 10:59:02 juju-e4d256-prod-github-runner-207 kernel: [20116.607984] ? __fget_files+0x86/0xc0 Aug 22 10:59:02 juju-e4d256-prod-github-runner-207 kernel: [20116.608832] __x64_sys_ioctl+0x95/0xd0 Aug 22 10:59:02 juju-e4d256-prod-github-runner-207 kernel: [20116.609665] do_syscall_64+0x5c/0xc0 Aug 22 10:59:02 juju-e4d256-prod-github-runner-207 kernel: [20116.610351] ? do_futex+0x162/0x1f0 Aug 22 10:59:02 juju-e4d256-prod-github-runner-207 kernel: [20116.611002] ? __x64_sys_futex+0x78/0x1e0 Aug 22 10:59:02 juju-e4d256-prod-github-runner-207 kernel: [20116.611719] ? __secure_computing+0xa9/0x120 Aug 22 10:59:02 juju-e4d256-prod-github-runner-207 kernel: [20116.612424] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 10:59:02 juju-e4d256-prod-github-runner-207 kernel: [20116.613202] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:59:02 juju-e4d256-prod-github-runner-207 kernel: [20116.613925] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:59:02 juju-e4d256-prod-github-runner-207 kernel: [20116.614665] ? do_syscall_64+0x69/0xc0 Aug 22 10:59:02 juju-e4d256-prod-github-runner-207 kernel: [20116.615330] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:59:02 juju-e4d256-prod-github-runner-207 kernel: [20116.616034] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:59:02 juju-e4d256-prod-github-runner-207 kernel: [20116.616730] ? do_syscall_64+0x69/0xc0 Aug 22 10:59:02 juju-e4d256-prod-github-runner-207 kernel: [20116.617356] ? do_syscall_64+0x69/0xc0 Aug 22 10:59:02 juju-e4d256-prod-github-runner-207 kernel: [20116.617983] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 10:59:02 juju-e4d256-prod-github-runner-207 kernel: [20116.618689] RIP: 0033:0x7faa5d0edaff Aug 22 10:59:02 juju-e4d256-prod-github-runner-207 kernel: [20116.619360] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 10:59:02 juju-e4d256-prod-github-runner-207 kernel: [20116.621344] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 10:59:02 juju-e4d256-prod-github-runner-207 kernel: [20116.622257] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 10:59:02 juju-e4d256-prod-github-runner-207 kernel: [20116.623152] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 10:59:02 juju-e4d256-prod-github-runner-207 kernel: [20116.624062] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 10:59:02 juju-e4d256-prod-github-runner-207 kernel: [20116.624950] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 10:59:02 juju-e4d256-prod-github-runner-207 kernel: [20116.625837] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 10:59:02 juju-e4d256-prod-github-runner-207 kernel: [20116.626850] Aug 22 10:59:30 juju-e4d256-prod-github-runner-207 kernel: [20144.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 18653s! [qemu-system-x86:6715] Aug 22 10:59:30 juju-e4d256-prod-github-runner-207 kernel: [20144.543137] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 10:59:30 juju-e4d256-prod-github-runner-207 kernel: [20144.543211] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 10:59:30 juju-e4d256-prod-github-runner-207 kernel: [20144.555398] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 10:59:30 juju-e4d256-prod-github-runner-207 kernel: [20144.556672] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 10:59:30 juju-e4d256-prod-github-runner-207 kernel: [20144.557901] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:59:30 juju-e4d256-prod-github-runner-207 kernel: [20144.558971] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 10:59:30 juju-e4d256-prod-github-runner-207 kernel: [20144.561515] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 10:59:30 juju-e4d256-prod-github-runner-207 kernel: [20144.562564] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 10:59:30 juju-e4d256-prod-github-runner-207 kernel: [20144.563738] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 10:59:30 juju-e4d256-prod-github-runner-207 kernel: [20144.564901] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 10:59:30 juju-e4d256-prod-github-runner-207 kernel: [20144.566060] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 10:59:30 juju-e4d256-prod-github-runner-207 kernel: [20144.567240] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 10:59:30 juju-e4d256-prod-github-runner-207 kernel: [20144.568407] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 10:59:30 juju-e4d256-prod-github-runner-207 kernel: [20144.569652] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 10:59:30 juju-e4d256-prod-github-runner-207 kernel: [20144.570763] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 10:59:30 juju-e4d256-prod-github-runner-207 kernel: [20144.571977] Call Trace: Aug 22 10:59:30 juju-e4d256-prod-github-runner-207 kernel: [20144.572892] Aug 22 10:59:30 juju-e4d256-prod-github-runner-207 kernel: [20144.573787] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:59:30 juju-e4d256-prod-github-runner-207 kernel: [20144.574842] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 10:59:30 juju-e4d256-prod-github-runner-207 kernel: [20144.575865] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:59:30 juju-e4d256-prod-github-runner-207 kernel: [20144.576948] ? show_regs.part.0+0x23/0x29 Aug 22 10:59:30 juju-e4d256-prod-github-runner-207 kernel: [20144.577948] ? show_regs.cold+0x8/0xd Aug 22 10:59:30 juju-e4d256-prod-github-runner-207 kernel: [20144.578941] ? watchdog_timer_fn+0x1be/0x220 Aug 22 10:59:30 juju-e4d256-prod-github-runner-207 kernel: [20144.579976] ? lockup_detector_update_enable+0x60/0x60 Aug 22 10:59:30 juju-e4d256-prod-github-runner-207 kernel: [20144.581040] ? __hrtimer_run_queues+0x107/0x230 Aug 22 10:59:30 juju-e4d256-prod-github-runner-207 kernel: [20144.582070] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 10:59:30 juju-e4d256-prod-github-runner-207 kernel: [20144.583107] ? hrtimer_interrupt+0x101/0x220 Aug 22 10:59:30 juju-e4d256-prod-github-runner-207 kernel: [20144.584128] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 10:59:30 juju-e4d256-prod-github-runner-207 kernel: [20144.585202] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 10:59:30 juju-e4d256-prod-github-runner-207 kernel: [20144.586249] Aug 22 10:59:30 juju-e4d256-prod-github-runner-207 kernel: [20144.587115] Aug 22 10:59:30 juju-e4d256-prod-github-runner-207 kernel: [20144.587963] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 10:59:30 juju-e4d256-prod-github-runner-207 kernel: [20144.589002] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:59:30 juju-e4d256-prod-github-runner-207 kernel: [20144.590046] ? _raw_spin_lock+0x22/0x30 Aug 22 10:59:30 juju-e4d256-prod-github-runner-207 kernel: [20144.591003] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:59:30 juju-e4d256-prod-github-runner-207 kernel: [20144.592027] direct_page_fault+0x206/0x310 [kvm] Aug 22 10:59:30 juju-e4d256-prod-github-runner-207 kernel: [20144.593059] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 10:59:30 juju-e4d256-prod-github-runner-207 kernel: [20144.594076] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 10:59:30 juju-e4d256-prod-github-runner-207 kernel: [20144.595090] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 10:59:30 juju-e4d256-prod-github-runner-207 kernel: [20144.596062] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 10:59:30 juju-e4d256-prod-github-runner-207 kernel: [20144.597009] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 10:59:30 juju-e4d256-prod-github-runner-207 kernel: [20144.597994] handle_exit+0x98/0x230 [kvm_amd] Aug 22 10:59:30 juju-e4d256-prod-github-runner-207 kernel: [20144.598905] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 10:59:30 juju-e4d256-prod-github-runner-207 kernel: [20144.599828] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 10:59:30 juju-e4d256-prod-github-runner-207 kernel: [20144.600754] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 10:59:30 juju-e4d256-prod-github-runner-207 kernel: [20144.601664] vcpu_run+0x62/0x2c0 [kvm] Aug 22 10:59:30 juju-e4d256-prod-github-runner-207 kernel: [20144.602483] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 10:59:30 juju-e4d256-prod-github-runner-207 kernel: [20144.603298] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 10:59:30 juju-e4d256-prod-github-runner-207 kernel: [20144.604153] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 10:59:30 juju-e4d256-prod-github-runner-207 kernel: [20144.604955] ? __seccomp_filter+0x4a/0x4a0 Aug 22 10:59:30 juju-e4d256-prod-github-runner-207 kernel: [20144.605697] ? __fget_files+0x86/0xc0 Aug 22 10:59:30 juju-e4d256-prod-github-runner-207 kernel: [20144.606400] __x64_sys_ioctl+0x95/0xd0 Aug 22 10:59:30 juju-e4d256-prod-github-runner-207 kernel: [20144.607151] do_syscall_64+0x5c/0xc0 Aug 22 10:59:30 juju-e4d256-prod-github-runner-207 kernel: [20144.607976] ? do_futex+0x162/0x1f0 Aug 22 10:59:30 juju-e4d256-prod-github-runner-207 kernel: [20144.608658] ? __x64_sys_futex+0x78/0x1e0 Aug 22 10:59:30 juju-e4d256-prod-github-runner-207 kernel: [20144.609343] ? __secure_computing+0xa9/0x120 Aug 22 10:59:30 juju-e4d256-prod-github-runner-207 kernel: [20144.610036] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 10:59:30 juju-e4d256-prod-github-runner-207 kernel: [20144.610798] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:59:30 juju-e4d256-prod-github-runner-207 kernel: [20144.611541] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:59:30 juju-e4d256-prod-github-runner-207 kernel: [20144.612268] ? do_syscall_64+0x69/0xc0 Aug 22 10:59:30 juju-e4d256-prod-github-runner-207 kernel: [20144.612917] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:59:30 juju-e4d256-prod-github-runner-207 kernel: [20144.613716] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:59:30 juju-e4d256-prod-github-runner-207 kernel: [20144.614414] ? do_syscall_64+0x69/0xc0 Aug 22 10:59:30 juju-e4d256-prod-github-runner-207 kernel: [20144.615062] ? do_syscall_64+0x69/0xc0 Aug 22 10:59:30 juju-e4d256-prod-github-runner-207 kernel: [20144.615691] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 10:59:30 juju-e4d256-prod-github-runner-207 kernel: [20144.616396] RIP: 0033:0x7faa5d0edaff Aug 22 10:59:30 juju-e4d256-prod-github-runner-207 kernel: [20144.617045] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 10:59:30 juju-e4d256-prod-github-runner-207 kernel: [20144.619093] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 10:59:30 juju-e4d256-prod-github-runner-207 kernel: [20144.620016] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 10:59:30 juju-e4d256-prod-github-runner-207 kernel: [20144.620915] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 10:59:30 juju-e4d256-prod-github-runner-207 kernel: [20144.621804] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 10:59:30 juju-e4d256-prod-github-runner-207 kernel: [20144.622707] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 10:59:30 juju-e4d256-prod-github-runner-207 kernel: [20144.623619] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 10:59:30 juju-e4d256-prod-github-runner-207 kernel: [20144.624513] Aug 22 10:59:44 juju-e4d256-prod-github-runner-207 kernel: [20158.532708] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 10:59:44 juju-e4d256-prod-github-runner-207 kernel: [20158.533664] rcu: 1-....: (4994707 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=2419092 Aug 22 10:59:44 juju-e4d256-prod-github-runner-207 kernel: [20158.534814] (t=5010333 jiffies g=23269 q=26076) Aug 22 10:59:44 juju-e4d256-prod-github-runner-207 kernel: [20158.535607] NMI backtrace for cpu 1 Aug 22 10:59:44 juju-e4d256-prod-github-runner-207 kernel: [20158.536332] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 10:59:44 juju-e4d256-prod-github-runner-207 kernel: [20158.537491] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 10:59:44 juju-e4d256-prod-github-runner-207 kernel: [20158.538583] Call Trace: Aug 22 10:59:44 juju-e4d256-prod-github-runner-207 kernel: [20158.539309] Aug 22 10:59:44 juju-e4d256-prod-github-runner-207 kernel: [20158.539978] show_stack+0x52/0x5c Aug 22 10:59:44 juju-e4d256-prod-github-runner-207 kernel: [20158.540711] dump_stack_lvl+0x4a/0x63 Aug 22 10:59:44 juju-e4d256-prod-github-runner-207 kernel: [20158.541463] dump_stack+0x10/0x16 Aug 22 10:59:44 juju-e4d256-prod-github-runner-207 kernel: [20158.542186] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 10:59:44 juju-e4d256-prod-github-runner-207 kernel: [20158.542996] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 10:59:44 juju-e4d256-prod-github-runner-207 kernel: [20158.543783] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 10:59:44 juju-e4d256-prod-github-runner-207 kernel: [20158.544625] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 10:59:44 juju-e4d256-prod-github-runner-207 kernel: [20158.545454] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 10:59:44 juju-e4d256-prod-github-runner-207 kernel: [20158.546274] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 10:59:44 juju-e4d256-prod-github-runner-207 kernel: [20158.547063] print_cpu_stall.cold+0x2f/0xe2 Aug 22 10:59:44 juju-e4d256-prod-github-runner-207 kernel: [20158.547832] ? timekeeping_update+0xf7/0x150 Aug 22 10:59:44 juju-e4d256-prod-github-runner-207 kernel: [20158.548606] check_cpu_stall+0x109/0x270 Aug 22 10:59:44 juju-e4d256-prod-github-runner-207 kernel: [20158.549359] rcu_sched_clock_irq+0x9a/0x250 Aug 22 10:59:44 juju-e4d256-prod-github-runner-207 kernel: [20158.550122] update_process_times+0x94/0xd0 Aug 22 10:59:44 juju-e4d256-prod-github-runner-207 kernel: [20158.550895] tick_sched_handle+0x29/0x70 Aug 22 10:59:44 juju-e4d256-prod-github-runner-207 kernel: [20158.551645] tick_sched_timer+0x8c/0xc0 Aug 22 10:59:44 juju-e4d256-prod-github-runner-207 kernel: [20158.552384] ? tick_nohz_handler+0xb0/0xb0 Aug 22 10:59:44 juju-e4d256-prod-github-runner-207 kernel: [20158.553145] __hrtimer_run_queues+0x107/0x230 Aug 22 10:59:44 juju-e4d256-prod-github-runner-207 kernel: [20158.553921] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 10:59:44 juju-e4d256-prod-github-runner-207 kernel: [20158.554722] hrtimer_interrupt+0x101/0x220 Aug 22 10:59:44 juju-e4d256-prod-github-runner-207 kernel: [20158.555487] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 10:59:44 juju-e4d256-prod-github-runner-207 kernel: [20158.556300] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 10:59:44 juju-e4d256-prod-github-runner-207 kernel: [20158.557102] Aug 22 10:59:44 juju-e4d256-prod-github-runner-207 kernel: [20158.557739] Aug 22 10:59:44 juju-e4d256-prod-github-runner-207 kernel: [20158.558370] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 10:59:44 juju-e4d256-prod-github-runner-207 kernel: [20158.559209] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 10:59:44 juju-e4d256-prod-github-runner-207 kernel: [20158.560326] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 10:59:44 juju-e4d256-prod-github-runner-207 kernel: [20158.562577] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 10:59:44 juju-e4d256-prod-github-runner-207 kernel: [20158.563474] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 10:59:44 juju-e4d256-prod-github-runner-207 kernel: [20158.564497] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 10:59:44 juju-e4d256-prod-github-runner-207 kernel: [20158.565522] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 10:59:44 juju-e4d256-prod-github-runner-207 kernel: [20158.566525] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 10:59:44 juju-e4d256-prod-github-runner-207 kernel: [20158.567502] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 10:59:44 juju-e4d256-prod-github-runner-207 kernel: [20158.568607] ? _raw_spin_lock+0x22/0x30 Aug 22 10:59:44 juju-e4d256-prod-github-runner-207 kernel: [20158.569380] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 10:59:44 juju-e4d256-prod-github-runner-207 kernel: [20158.570217] direct_page_fault+0x206/0x310 [kvm] Aug 22 10:59:44 juju-e4d256-prod-github-runner-207 kernel: [20158.571095] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 10:59:44 juju-e4d256-prod-github-runner-207 kernel: [20158.571924] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 10:59:44 juju-e4d256-prod-github-runner-207 kernel: [20158.572749] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 10:59:44 juju-e4d256-prod-github-runner-207 kernel: [20158.573565] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 10:59:44 juju-e4d256-prod-github-runner-207 kernel: [20158.574354] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 10:59:44 juju-e4d256-prod-github-runner-207 kernel: [20158.575192] handle_exit+0x98/0x230 [kvm_amd] Aug 22 10:59:44 juju-e4d256-prod-github-runner-207 kernel: [20158.575948] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 10:59:44 juju-e4d256-prod-github-runner-207 kernel: [20158.576732] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 10:59:44 juju-e4d256-prod-github-runner-207 kernel: [20158.577538] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 10:59:44 juju-e4d256-prod-github-runner-207 kernel: [20158.578324] vcpu_run+0x62/0x2c0 [kvm] Aug 22 10:59:44 juju-e4d256-prod-github-runner-207 kernel: [20158.579059] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 10:59:44 juju-e4d256-prod-github-runner-207 kernel: [20158.579796] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 10:59:44 juju-e4d256-prod-github-runner-207 kernel: [20158.580600] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 10:59:44 juju-e4d256-prod-github-runner-207 kernel: [20158.581364] ? __seccomp_filter+0x4a/0x4a0 Aug 22 10:59:44 juju-e4d256-prod-github-runner-207 kernel: [20158.582092] ? __fget_files+0x86/0xc0 Aug 22 10:59:44 juju-e4d256-prod-github-runner-207 kernel: [20158.582822] __x64_sys_ioctl+0x95/0xd0 Aug 22 10:59:44 juju-e4d256-prod-github-runner-207 kernel: [20158.583536] do_syscall_64+0x5c/0xc0 Aug 22 10:59:44 juju-e4d256-prod-github-runner-207 kernel: [20158.584219] ? do_futex+0x162/0x1f0 Aug 22 10:59:44 juju-e4d256-prod-github-runner-207 kernel: [20158.584892] ? __x64_sys_futex+0x78/0x1e0 Aug 22 10:59:44 juju-e4d256-prod-github-runner-207 kernel: [20158.585615] ? __secure_computing+0xa9/0x120 Aug 22 10:59:44 juju-e4d256-prod-github-runner-207 kernel: [20158.586344] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 10:59:44 juju-e4d256-prod-github-runner-207 kernel: [20158.587158] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:59:44 juju-e4d256-prod-github-runner-207 kernel: [20158.587967] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:59:44 juju-e4d256-prod-github-runner-207 kernel: [20158.588735] ? do_syscall_64+0x69/0xc0 Aug 22 10:59:44 juju-e4d256-prod-github-runner-207 kernel: [20158.589428] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 10:59:44 juju-e4d256-prod-github-runner-207 kernel: [20158.590187] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 10:59:44 juju-e4d256-prod-github-runner-207 kernel: [20158.590975] ? do_syscall_64+0x69/0xc0 Aug 22 10:59:44 juju-e4d256-prod-github-runner-207 kernel: [20158.591673] ? do_syscall_64+0x69/0xc0 Aug 22 10:59:44 juju-e4d256-prod-github-runner-207 kernel: [20158.592362] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 10:59:44 juju-e4d256-prod-github-runner-207 kernel: [20158.593324] RIP: 0033:0x7faa5d0edaff Aug 22 10:59:44 juju-e4d256-prod-github-runner-207 kernel: [20158.594019] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 10:59:44 juju-e4d256-prod-github-runner-207 kernel: [20158.596137] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 10:59:44 juju-e4d256-prod-github-runner-207 kernel: [20158.597106] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 10:59:44 juju-e4d256-prod-github-runner-207 kernel: [20158.598055] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 10:59:44 juju-e4d256-prod-github-runner-207 kernel: [20158.599020] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 10:59:44 juju-e4d256-prod-github-runner-207 kernel: [20158.599969] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 10:59:44 juju-e4d256-prod-github-runner-207 kernel: [20158.600904] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 10:59:44 juju-e4d256-prod-github-runner-207 kernel: [20158.601850] Aug 22 11:00:10 juju-e4d256-prod-github-runner-207 kernel: [20184.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 18690s! [qemu-system-x86:6715] Aug 22 11:00:10 juju-e4d256-prod-github-runner-207 kernel: [20184.543924] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 11:00:10 juju-e4d256-prod-github-runner-207 kernel: [20184.544247] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 11:00:10 juju-e4d256-prod-github-runner-207 kernel: [20184.556583] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 11:00:10 juju-e4d256-prod-github-runner-207 kernel: [20184.557861] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 11:00:10 juju-e4d256-prod-github-runner-207 kernel: [20184.559180] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:00:10 juju-e4d256-prod-github-runner-207 kernel: [20184.560618] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 11:00:10 juju-e4d256-prod-github-runner-207 kernel: [20184.563474] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 11:00:10 juju-e4d256-prod-github-runner-207 kernel: [20184.564530] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 11:00:10 juju-e4d256-prod-github-runner-207 kernel: [20184.565703] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 11:00:10 juju-e4d256-prod-github-runner-207 kernel: [20184.566899] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 11:00:10 juju-e4d256-prod-github-runner-207 kernel: [20184.568103] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 11:00:10 juju-e4d256-prod-github-runner-207 kernel: [20184.569283] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 11:00:10 juju-e4d256-prod-github-runner-207 kernel: [20184.570480] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 11:00:10 juju-e4d256-prod-github-runner-207 kernel: [20184.571729] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 11:00:10 juju-e4d256-prod-github-runner-207 kernel: [20184.572838] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 11:00:10 juju-e4d256-prod-github-runner-207 kernel: [20184.574046] Call Trace: Aug 22 11:00:10 juju-e4d256-prod-github-runner-207 kernel: [20184.574983] Aug 22 11:00:10 juju-e4d256-prod-github-runner-207 kernel: [20184.575907] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:00:10 juju-e4d256-prod-github-runner-207 kernel: [20184.577018] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:00:10 juju-e4d256-prod-github-runner-207 kernel: [20184.578066] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:00:10 juju-e4d256-prod-github-runner-207 kernel: [20184.579207] ? show_regs.part.0+0x23/0x29 Aug 22 11:00:10 juju-e4d256-prod-github-runner-207 kernel: [20184.580479] ? show_regs.cold+0x8/0xd Aug 22 11:00:10 juju-e4d256-prod-github-runner-207 kernel: [20184.581592] ? watchdog_timer_fn+0x1be/0x220 Aug 22 11:00:10 juju-e4d256-prod-github-runner-207 kernel: [20184.582644] ? lockup_detector_update_enable+0x60/0x60 Aug 22 11:00:10 juju-e4d256-prod-github-runner-207 kernel: [20184.583915] ? __hrtimer_run_queues+0x107/0x230 Aug 22 11:00:10 juju-e4d256-prod-github-runner-207 kernel: [20184.584973] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 11:00:10 juju-e4d256-prod-github-runner-207 kernel: [20184.586020] ? hrtimer_interrupt+0x101/0x220 Aug 22 11:00:10 juju-e4d256-prod-github-runner-207 kernel: [20184.587069] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 11:00:10 juju-e4d256-prod-github-runner-207 kernel: [20184.588153] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 11:00:10 juju-e4d256-prod-github-runner-207 kernel: [20184.589261] Aug 22 11:00:10 juju-e4d256-prod-github-runner-207 kernel: [20184.590129] Aug 22 11:00:10 juju-e4d256-prod-github-runner-207 kernel: [20184.590994] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 11:00:10 juju-e4d256-prod-github-runner-207 kernel: [20184.592033] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:00:10 juju-e4d256-prod-github-runner-207 kernel: [20184.593096] ? _raw_spin_lock+0x22/0x30 Aug 22 11:00:10 juju-e4d256-prod-github-runner-207 kernel: [20184.594065] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:00:10 juju-e4d256-prod-github-runner-207 kernel: [20184.595117] direct_page_fault+0x206/0x310 [kvm] Aug 22 11:00:10 juju-e4d256-prod-github-runner-207 kernel: [20184.596248] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 11:00:10 juju-e4d256-prod-github-runner-207 kernel: [20184.597457] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 11:00:10 juju-e4d256-prod-github-runner-207 kernel: [20184.598477] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 11:00:10 juju-e4d256-prod-github-runner-207 kernel: [20184.599496] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 11:00:10 juju-e4d256-prod-github-runner-207 kernel: [20184.600450] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 11:00:10 juju-e4d256-prod-github-runner-207 kernel: [20184.601583] handle_exit+0x98/0x230 [kvm_amd] Aug 22 11:00:10 juju-e4d256-prod-github-runner-207 kernel: [20184.602554] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 11:00:10 juju-e4d256-prod-github-runner-207 kernel: [20184.603484] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 11:00:10 juju-e4d256-prod-github-runner-207 kernel: [20184.604411] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 11:00:10 juju-e4d256-prod-github-runner-207 kernel: [20184.605320] vcpu_run+0x62/0x2c0 [kvm] Aug 22 11:00:10 juju-e4d256-prod-github-runner-207 kernel: [20184.606136] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 11:00:10 juju-e4d256-prod-github-runner-207 kernel: [20184.606967] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 11:00:10 juju-e4d256-prod-github-runner-207 kernel: [20184.607838] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 11:00:10 juju-e4d256-prod-github-runner-207 kernel: [20184.608641] ? __seccomp_filter+0x4a/0x4a0 Aug 22 11:00:10 juju-e4d256-prod-github-runner-207 kernel: [20184.609394] ? __fget_files+0x86/0xc0 Aug 22 11:00:10 juju-e4d256-prod-github-runner-207 kernel: [20184.610102] __x64_sys_ioctl+0x95/0xd0 Aug 22 11:00:10 juju-e4d256-prod-github-runner-207 kernel: [20184.610838] do_syscall_64+0x5c/0xc0 Aug 22 11:00:10 juju-e4d256-prod-github-runner-207 kernel: [20184.611509] ? do_futex+0x162/0x1f0 Aug 22 11:00:10 juju-e4d256-prod-github-runner-207 kernel: [20184.612171] ? __x64_sys_futex+0x78/0x1e0 Aug 22 11:00:10 juju-e4d256-prod-github-runner-207 kernel: [20184.612852] ? __secure_computing+0xa9/0x120 Aug 22 11:00:10 juju-e4d256-prod-github-runner-207 kernel: [20184.613551] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 11:00:10 juju-e4d256-prod-github-runner-207 kernel: [20184.614314] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:00:10 juju-e4d256-prod-github-runner-207 kernel: [20184.615058] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:00:10 juju-e4d256-prod-github-runner-207 kernel: [20184.615780] ? do_syscall_64+0x69/0xc0 Aug 22 11:00:10 juju-e4d256-prod-github-runner-207 kernel: [20184.616434] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:00:10 juju-e4d256-prod-github-runner-207 kernel: [20184.617143] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:00:10 juju-e4d256-prod-github-runner-207 kernel: [20184.617842] ? do_syscall_64+0x69/0xc0 Aug 22 11:00:10 juju-e4d256-prod-github-runner-207 kernel: [20184.618482] ? do_syscall_64+0x69/0xc0 Aug 22 11:00:10 juju-e4d256-prod-github-runner-207 kernel: [20184.619108] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 11:00:10 juju-e4d256-prod-github-runner-207 kernel: [20184.619817] RIP: 0033:0x7faa5d0edaff Aug 22 11:00:10 juju-e4d256-prod-github-runner-207 kernel: [20184.620492] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 11:00:10 juju-e4d256-prod-github-runner-207 kernel: [20184.622510] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 11:00:10 juju-e4d256-prod-github-runner-207 kernel: [20184.623445] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 11:00:10 juju-e4d256-prod-github-runner-207 kernel: [20184.624416] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 11:00:10 juju-e4d256-prod-github-runner-207 kernel: [20184.625321] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 11:00:10 juju-e4d256-prod-github-runner-207 kernel: [20184.626222] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 11:00:10 juju-e4d256-prod-github-runner-207 kernel: [20184.627145] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 11:00:10 juju-e4d256-prod-github-runner-207 kernel: [20184.628044] Aug 22 11:00:38 juju-e4d256-prod-github-runner-207 kernel: [20212.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 18716s! [qemu-system-x86:6715] Aug 22 11:00:38 juju-e4d256-prod-github-runner-207 kernel: [20212.543953] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 11:00:38 juju-e4d256-prod-github-runner-207 kernel: [20212.544280] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 11:00:38 juju-e4d256-prod-github-runner-207 kernel: [20212.556393] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 11:00:38 juju-e4d256-prod-github-runner-207 kernel: [20212.557680] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 11:00:38 juju-e4d256-prod-github-runner-207 kernel: [20212.558910] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:00:38 juju-e4d256-prod-github-runner-207 kernel: [20212.560193] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 11:00:38 juju-e4d256-prod-github-runner-207 kernel: [20212.562996] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 11:00:38 juju-e4d256-prod-github-runner-207 kernel: [20212.564131] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 11:00:38 juju-e4d256-prod-github-runner-207 kernel: [20212.565309] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 11:00:38 juju-e4d256-prod-github-runner-207 kernel: [20212.566539] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 11:00:38 juju-e4d256-prod-github-runner-207 kernel: [20212.567715] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 11:00:38 juju-e4d256-prod-github-runner-207 kernel: [20212.568941] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 11:00:38 juju-e4d256-prod-github-runner-207 kernel: [20212.570239] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 11:00:38 juju-e4d256-prod-github-runner-207 kernel: [20212.571536] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 11:00:38 juju-e4d256-prod-github-runner-207 kernel: [20212.572824] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 11:00:38 juju-e4d256-prod-github-runner-207 kernel: [20212.574163] Call Trace: Aug 22 11:00:38 juju-e4d256-prod-github-runner-207 kernel: [20212.575217] Aug 22 11:00:38 juju-e4d256-prod-github-runner-207 kernel: [20212.576173] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:00:38 juju-e4d256-prod-github-runner-207 kernel: [20212.577330] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:00:38 juju-e4d256-prod-github-runner-207 kernel: [20212.578548] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:00:38 juju-e4d256-prod-github-runner-207 kernel: [20212.579791] ? show_regs.part.0+0x23/0x29 Aug 22 11:00:38 juju-e4d256-prod-github-runner-207 kernel: [20212.580888] ? show_regs.cold+0x8/0xd Aug 22 11:00:38 juju-e4d256-prod-github-runner-207 kernel: [20212.581872] ? watchdog_timer_fn+0x1be/0x220 Aug 22 11:00:38 juju-e4d256-prod-github-runner-207 kernel: [20212.582897] ? lockup_detector_update_enable+0x60/0x60 Aug 22 11:00:38 juju-e4d256-prod-github-runner-207 kernel: [20212.583986] ? __hrtimer_run_queues+0x107/0x230 Aug 22 11:00:38 juju-e4d256-prod-github-runner-207 kernel: [20212.585028] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 11:00:38 juju-e4d256-prod-github-runner-207 kernel: [20212.586079] ? hrtimer_interrupt+0x101/0x220 Aug 22 11:00:38 juju-e4d256-prod-github-runner-207 kernel: [20212.587116] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 11:00:38 juju-e4d256-prod-github-runner-207 kernel: [20212.588231] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 11:00:38 juju-e4d256-prod-github-runner-207 kernel: [20212.589282] Aug 22 11:00:38 juju-e4d256-prod-github-runner-207 kernel: [20212.590208] Aug 22 11:00:38 juju-e4d256-prod-github-runner-207 kernel: [20212.591057] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 11:00:38 juju-e4d256-prod-github-runner-207 kernel: [20212.592103] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:00:38 juju-e4d256-prod-github-runner-207 kernel: [20212.593148] ? _raw_spin_lock+0x22/0x30 Aug 22 11:00:38 juju-e4d256-prod-github-runner-207 kernel: [20212.594108] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:00:38 juju-e4d256-prod-github-runner-207 kernel: [20212.595136] direct_page_fault+0x206/0x310 [kvm] Aug 22 11:00:38 juju-e4d256-prod-github-runner-207 kernel: [20212.596168] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 11:00:38 juju-e4d256-prod-github-runner-207 kernel: [20212.597184] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 11:00:38 juju-e4d256-prod-github-runner-207 kernel: [20212.598210] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 11:00:38 juju-e4d256-prod-github-runner-207 kernel: [20212.599229] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 11:00:38 juju-e4d256-prod-github-runner-207 kernel: [20212.600184] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 11:00:38 juju-e4d256-prod-github-runner-207 kernel: [20212.601171] handle_exit+0x98/0x230 [kvm_amd] Aug 22 11:00:38 juju-e4d256-prod-github-runner-207 kernel: [20212.602083] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 11:00:38 juju-e4d256-prod-github-runner-207 kernel: [20212.603008] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 11:00:38 juju-e4d256-prod-github-runner-207 kernel: [20212.603953] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 11:00:38 juju-e4d256-prod-github-runner-207 kernel: [20212.604865] vcpu_run+0x62/0x2c0 [kvm] Aug 22 11:00:38 juju-e4d256-prod-github-runner-207 kernel: [20212.605694] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 11:00:38 juju-e4d256-prod-github-runner-207 kernel: [20212.606522] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 11:00:38 juju-e4d256-prod-github-runner-207 kernel: [20212.607385] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 11:00:38 juju-e4d256-prod-github-runner-207 kernel: [20212.608186] ? __seccomp_filter+0x4a/0x4a0 Aug 22 11:00:38 juju-e4d256-prod-github-runner-207 kernel: [20212.608934] ? __fget_files+0x86/0xc0 Aug 22 11:00:38 juju-e4d256-prod-github-runner-207 kernel: [20212.609643] __x64_sys_ioctl+0x95/0xd0 Aug 22 11:00:38 juju-e4d256-prod-github-runner-207 kernel: [20212.610354] do_syscall_64+0x5c/0xc0 Aug 22 11:00:38 juju-e4d256-prod-github-runner-207 kernel: [20212.611031] ? do_futex+0x162/0x1f0 Aug 22 11:00:38 juju-e4d256-prod-github-runner-207 kernel: [20212.611682] ? __x64_sys_futex+0x78/0x1e0 Aug 22 11:00:38 juju-e4d256-prod-github-runner-207 kernel: [20212.612376] ? __secure_computing+0xa9/0x120 Aug 22 11:00:38 juju-e4d256-prod-github-runner-207 kernel: [20212.613068] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 11:00:38 juju-e4d256-prod-github-runner-207 kernel: [20212.613834] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:00:38 juju-e4d256-prod-github-runner-207 kernel: [20212.614570] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:00:38 juju-e4d256-prod-github-runner-207 kernel: [20212.615288] ? do_syscall_64+0x69/0xc0 Aug 22 11:00:38 juju-e4d256-prod-github-runner-207 kernel: [20212.615952] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:00:38 juju-e4d256-prod-github-runner-207 kernel: [20212.616662] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:00:38 juju-e4d256-prod-github-runner-207 kernel: [20212.617358] ? do_syscall_64+0x69/0xc0 Aug 22 11:00:38 juju-e4d256-prod-github-runner-207 kernel: [20212.617983] ? do_syscall_64+0x69/0xc0 Aug 22 11:00:38 juju-e4d256-prod-github-runner-207 kernel: [20212.618617] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 11:00:38 juju-e4d256-prod-github-runner-207 kernel: [20212.619367] RIP: 0033:0x7faa5d0edaff Aug 22 11:00:38 juju-e4d256-prod-github-runner-207 kernel: [20212.620068] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 11:00:38 juju-e4d256-prod-github-runner-207 kernel: [20212.622074] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 11:00:38 juju-e4d256-prod-github-runner-207 kernel: [20212.622992] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 11:00:38 juju-e4d256-prod-github-runner-207 kernel: [20212.623884] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 11:00:38 juju-e4d256-prod-github-runner-207 kernel: [20212.625036] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 11:00:38 juju-e4d256-prod-github-runner-207 kernel: [20212.625948] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 11:00:38 juju-e4d256-prod-github-runner-207 kernel: [20212.626868] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 11:00:38 juju-e4d256-prod-github-runner-207 kernel: [20212.627812] Aug 22 11:01:06 juju-e4d256-prod-github-runner-207 kernel: [20240.541981] watchdog: BUG: soft lockup - CPU#1 stuck for 18742s! [qemu-system-x86:6715] Aug 22 11:01:06 juju-e4d256-prod-github-runner-207 kernel: [20240.544066] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 11:01:06 juju-e4d256-prod-github-runner-207 kernel: [20240.544377] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 11:01:06 juju-e4d256-prod-github-runner-207 kernel: [20240.558757] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 11:01:06 juju-e4d256-prod-github-runner-207 kernel: [20240.560230] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 11:01:06 juju-e4d256-prod-github-runner-207 kernel: [20240.561615] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:01:06 juju-e4d256-prod-github-runner-207 kernel: [20240.562824] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 11:01:06 juju-e4d256-prod-github-runner-207 kernel: [20240.565752] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 11:01:06 juju-e4d256-prod-github-runner-207 kernel: [20240.566906] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 11:01:06 juju-e4d256-prod-github-runner-207 kernel: [20240.568213] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 11:01:06 juju-e4d256-prod-github-runner-207 kernel: [20240.569543] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 11:01:06 juju-e4d256-prod-github-runner-207 kernel: [20240.570890] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 11:01:06 juju-e4d256-prod-github-runner-207 kernel: [20240.572196] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 11:01:06 juju-e4d256-prod-github-runner-207 kernel: [20240.573725] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 11:01:06 juju-e4d256-prod-github-runner-207 kernel: [20240.575124] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 11:01:06 juju-e4d256-prod-github-runner-207 kernel: [20240.576343] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 11:01:06 juju-e4d256-prod-github-runner-207 kernel: [20240.577700] Call Trace: Aug 22 11:01:06 juju-e4d256-prod-github-runner-207 kernel: [20240.578686] Aug 22 11:01:06 juju-e4d256-prod-github-runner-207 kernel: [20240.579644] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:01:06 juju-e4d256-prod-github-runner-207 kernel: [20240.580771] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:01:06 juju-e4d256-prod-github-runner-207 kernel: [20240.581953] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:01:06 juju-e4d256-prod-github-runner-207 kernel: [20240.583178] ? show_regs.part.0+0x23/0x29 Aug 22 11:01:06 juju-e4d256-prod-github-runner-207 kernel: [20240.584303] ? show_regs.cold+0x8/0xd Aug 22 11:01:06 juju-e4d256-prod-github-runner-207 kernel: [20240.585395] ? watchdog_timer_fn+0x1be/0x220 Aug 22 11:01:06 juju-e4d256-prod-github-runner-207 kernel: [20240.586537] ? lockup_detector_update_enable+0x60/0x60 Aug 22 11:01:06 juju-e4d256-prod-github-runner-207 kernel: [20240.587709] ? __hrtimer_run_queues+0x107/0x230 Aug 22 11:01:06 juju-e4d256-prod-github-runner-207 kernel: [20240.588838] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 11:01:06 juju-e4d256-prod-github-runner-207 kernel: [20240.589983] ? hrtimer_interrupt+0x101/0x220 Aug 22 11:01:06 juju-e4d256-prod-github-runner-207 kernel: [20240.591093] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 11:01:06 juju-e4d256-prod-github-runner-207 kernel: [20240.592267] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 11:01:06 juju-e4d256-prod-github-runner-207 kernel: [20240.593418] Aug 22 11:01:06 juju-e4d256-prod-github-runner-207 kernel: [20240.594352] Aug 22 11:01:06 juju-e4d256-prod-github-runner-207 kernel: [20240.595244] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 11:01:06 juju-e4d256-prod-github-runner-207 kernel: [20240.596384] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:01:06 juju-e4d256-prod-github-runner-207 kernel: [20240.597534] ? _raw_spin_lock+0x22/0x30 Aug 22 11:01:06 juju-e4d256-prod-github-runner-207 kernel: [20240.598599] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:01:06 juju-e4d256-prod-github-runner-207 kernel: [20240.599760] direct_page_fault+0x206/0x310 [kvm] Aug 22 11:01:06 juju-e4d256-prod-github-runner-207 kernel: [20240.600918] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 11:01:06 juju-e4d256-prod-github-runner-207 kernel: [20240.602180] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 11:01:06 juju-e4d256-prod-github-runner-207 kernel: [20240.603307] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 11:01:06 juju-e4d256-prod-github-runner-207 kernel: [20240.604428] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 11:01:06 juju-e4d256-prod-github-runner-207 kernel: [20240.605486] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 11:01:06 juju-e4d256-prod-github-runner-207 kernel: [20240.606596] handle_exit+0x98/0x230 [kvm_amd] Aug 22 11:01:06 juju-e4d256-prod-github-runner-207 kernel: [20240.607596] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 11:01:06 juju-e4d256-prod-github-runner-207 kernel: [20240.608616] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 11:01:06 juju-e4d256-prod-github-runner-207 kernel: [20240.609641] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 11:01:06 juju-e4d256-prod-github-runner-207 kernel: [20240.610671] vcpu_run+0x62/0x2c0 [kvm] Aug 22 11:01:06 juju-e4d256-prod-github-runner-207 kernel: [20240.611564] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 11:01:06 juju-e4d256-prod-github-runner-207 kernel: [20240.612470] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 11:01:06 juju-e4d256-prod-github-runner-207 kernel: [20240.613427] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 11:01:06 juju-e4d256-prod-github-runner-207 kernel: [20240.614348] ? __seccomp_filter+0x4a/0x4a0 Aug 22 11:01:06 juju-e4d256-prod-github-runner-207 kernel: [20240.615225] ? __fget_files+0x86/0xc0 Aug 22 11:01:06 juju-e4d256-prod-github-runner-207 kernel: [20240.616018] __x64_sys_ioctl+0x95/0xd0 Aug 22 11:01:06 juju-e4d256-prod-github-runner-207 kernel: [20240.616798] do_syscall_64+0x5c/0xc0 Aug 22 11:01:06 juju-e4d256-prod-github-runner-207 kernel: [20240.617546] ? do_futex+0x162/0x1f0 Aug 22 11:01:06 juju-e4d256-prod-github-runner-207 kernel: [20240.618299] ? __x64_sys_futex+0x78/0x1e0 Aug 22 11:01:06 juju-e4d256-prod-github-runner-207 kernel: [20240.619058] ? __secure_computing+0xa9/0x120 Aug 22 11:01:06 juju-e4d256-prod-github-runner-207 kernel: [20240.619844] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 11:01:06 juju-e4d256-prod-github-runner-207 kernel: [20240.620725] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:01:06 juju-e4d256-prod-github-runner-207 kernel: [20240.621554] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:01:06 juju-e4d256-prod-github-runner-207 kernel: [20240.622413] ? do_syscall_64+0x69/0xc0 Aug 22 11:01:06 juju-e4d256-prod-github-runner-207 kernel: [20240.623142] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:01:06 juju-e4d256-prod-github-runner-207 kernel: [20240.623969] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:01:06 juju-e4d256-prod-github-runner-207 kernel: [20240.624776] ? do_syscall_64+0x69/0xc0 Aug 22 11:01:06 juju-e4d256-prod-github-runner-207 kernel: [20240.625490] ? do_syscall_64+0x69/0xc0 Aug 22 11:01:06 juju-e4d256-prod-github-runner-207 kernel: [20240.626214] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 11:01:06 juju-e4d256-prod-github-runner-207 kernel: [20240.627033] RIP: 0033:0x7faa5d0edaff Aug 22 11:01:06 juju-e4d256-prod-github-runner-207 kernel: [20240.627772] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 11:01:06 juju-e4d256-prod-github-runner-207 kernel: [20240.630149] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 11:01:06 juju-e4d256-prod-github-runner-207 kernel: [20240.631215] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 11:01:06 juju-e4d256-prod-github-runner-207 kernel: [20240.632247] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 11:01:06 juju-e4d256-prod-github-runner-207 kernel: [20240.633302] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 11:01:06 juju-e4d256-prod-github-runner-207 kernel: [20240.634413] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 11:01:06 juju-e4d256-prod-github-runner-207 kernel: [20240.635446] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 11:01:06 juju-e4d256-prod-github-runner-207 kernel: [20240.636480] Aug 22 11:01:34 juju-e4d256-prod-github-runner-207 kernel: [20268.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 18768s! [qemu-system-x86:6715] Aug 22 11:01:34 juju-e4d256-prod-github-runner-207 kernel: [20268.543821] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 11:01:34 juju-e4d256-prod-github-runner-207 kernel: [20268.544119] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 11:01:34 juju-e4d256-prod-github-runner-207 kernel: [20268.556373] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 11:01:34 juju-e4d256-prod-github-runner-207 kernel: [20268.557666] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 11:01:34 juju-e4d256-prod-github-runner-207 kernel: [20268.558893] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:01:34 juju-e4d256-prod-github-runner-207 kernel: [20268.559975] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 11:01:34 juju-e4d256-prod-github-runner-207 kernel: [20268.562750] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 11:01:34 juju-e4d256-prod-github-runner-207 kernel: [20268.564017] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 11:01:34 juju-e4d256-prod-github-runner-207 kernel: [20268.565613] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 11:01:34 juju-e4d256-prod-github-runner-207 kernel: [20268.566824] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 11:01:34 juju-e4d256-prod-github-runner-207 kernel: [20268.568018] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 11:01:34 juju-e4d256-prod-github-runner-207 kernel: [20268.569211] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 11:01:34 juju-e4d256-prod-github-runner-207 kernel: [20268.570452] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 11:01:34 juju-e4d256-prod-github-runner-207 kernel: [20268.571722] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 11:01:34 juju-e4d256-prod-github-runner-207 kernel: [20268.572849] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 11:01:34 juju-e4d256-prod-github-runner-207 kernel: [20268.574112] Call Trace: Aug 22 11:01:34 juju-e4d256-prod-github-runner-207 kernel: [20268.575056] Aug 22 11:01:34 juju-e4d256-prod-github-runner-207 kernel: [20268.576037] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:01:34 juju-e4d256-prod-github-runner-207 kernel: [20268.577235] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:01:34 juju-e4d256-prod-github-runner-207 kernel: [20268.578291] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:01:34 juju-e4d256-prod-github-runner-207 kernel: [20268.579419] ? show_regs.part.0+0x23/0x29 Aug 22 11:01:34 juju-e4d256-prod-github-runner-207 kernel: [20268.580484] ? show_regs.cold+0x8/0xd Aug 22 11:01:34 juju-e4d256-prod-github-runner-207 kernel: [20268.581526] ? watchdog_timer_fn+0x1be/0x220 Aug 22 11:01:34 juju-e4d256-prod-github-runner-207 kernel: [20268.582565] ? lockup_detector_update_enable+0x60/0x60 Aug 22 11:01:34 juju-e4d256-prod-github-runner-207 kernel: [20268.583813] ? __hrtimer_run_queues+0x107/0x230 Aug 22 11:01:34 juju-e4d256-prod-github-runner-207 kernel: [20268.584858] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 11:01:34 juju-e4d256-prod-github-runner-207 kernel: [20268.585925] ? hrtimer_interrupt+0x101/0x220 Aug 22 11:01:34 juju-e4d256-prod-github-runner-207 kernel: [20268.586953] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 11:01:34 juju-e4d256-prod-github-runner-207 kernel: [20268.588063] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 11:01:34 juju-e4d256-prod-github-runner-207 kernel: [20268.589183] Aug 22 11:01:34 juju-e4d256-prod-github-runner-207 kernel: [20268.590085] Aug 22 11:01:34 juju-e4d256-prod-github-runner-207 kernel: [20268.590939] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 11:01:34 juju-e4d256-prod-github-runner-207 kernel: [20268.592016] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:01:34 juju-e4d256-prod-github-runner-207 kernel: [20268.593095] ? _raw_spin_lock+0x22/0x30 Aug 22 11:01:34 juju-e4d256-prod-github-runner-207 kernel: [20268.594153] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:01:34 juju-e4d256-prod-github-runner-207 kernel: [20268.595192] direct_page_fault+0x206/0x310 [kvm] Aug 22 11:01:34 juju-e4d256-prod-github-runner-207 kernel: [20268.596249] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 11:01:34 juju-e4d256-prod-github-runner-207 kernel: [20268.597569] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 11:01:34 juju-e4d256-prod-github-runner-207 kernel: [20268.598582] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 11:01:34 juju-e4d256-prod-github-runner-207 kernel: [20268.599613] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 11:01:34 juju-e4d256-prod-github-runner-207 kernel: [20268.600581] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 11:01:34 juju-e4d256-prod-github-runner-207 kernel: [20268.601623] handle_exit+0x98/0x230 [kvm_amd] Aug 22 11:01:34 juju-e4d256-prod-github-runner-207 kernel: [20268.602537] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 11:01:34 juju-e4d256-prod-github-runner-207 kernel: [20268.603458] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 11:01:34 juju-e4d256-prod-github-runner-207 kernel: [20268.604398] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 11:01:34 juju-e4d256-prod-github-runner-207 kernel: [20268.605310] vcpu_run+0x62/0x2c0 [kvm] Aug 22 11:01:34 juju-e4d256-prod-github-runner-207 kernel: [20268.606163] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 11:01:34 juju-e4d256-prod-github-runner-207 kernel: [20268.607001] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 11:01:34 juju-e4d256-prod-github-runner-207 kernel: [20268.607867] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 11:01:34 juju-e4d256-prod-github-runner-207 kernel: [20268.608670] ? __seccomp_filter+0x4a/0x4a0 Aug 22 11:01:34 juju-e4d256-prod-github-runner-207 kernel: [20268.609439] ? __fget_files+0x86/0xc0 Aug 22 11:01:34 juju-e4d256-prod-github-runner-207 kernel: [20268.610155] __x64_sys_ioctl+0x95/0xd0 Aug 22 11:01:34 juju-e4d256-prod-github-runner-207 kernel: [20268.610902] do_syscall_64+0x5c/0xc0 Aug 22 11:01:34 juju-e4d256-prod-github-runner-207 kernel: [20268.611590] ? do_futex+0x162/0x1f0 Aug 22 11:01:34 juju-e4d256-prod-github-runner-207 kernel: [20268.612254] ? __x64_sys_futex+0x78/0x1e0 Aug 22 11:01:34 juju-e4d256-prod-github-runner-207 kernel: [20268.612933] ? __secure_computing+0xa9/0x120 Aug 22 11:01:34 juju-e4d256-prod-github-runner-207 kernel: [20268.613642] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 11:01:34 juju-e4d256-prod-github-runner-207 kernel: [20268.614407] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:01:34 juju-e4d256-prod-github-runner-207 kernel: [20268.615137] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:01:34 juju-e4d256-prod-github-runner-207 kernel: [20268.615877] ? do_syscall_64+0x69/0xc0 Aug 22 11:01:34 juju-e4d256-prod-github-runner-207 kernel: [20268.616670] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:01:34 juju-e4d256-prod-github-runner-207 kernel: [20268.617421] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:01:34 juju-e4d256-prod-github-runner-207 kernel: [20268.618123] ? do_syscall_64+0x69/0xc0 Aug 22 11:01:34 juju-e4d256-prod-github-runner-207 kernel: [20268.618910] ? do_syscall_64+0x69/0xc0 Aug 22 11:01:34 juju-e4d256-prod-github-runner-207 kernel: [20268.619536] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 11:01:34 juju-e4d256-prod-github-runner-207 kernel: [20268.620247] RIP: 0033:0x7faa5d0edaff Aug 22 11:01:34 juju-e4d256-prod-github-runner-207 kernel: [20268.620975] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 11:01:34 juju-e4d256-prod-github-runner-207 kernel: [20268.623008] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 11:01:34 juju-e4d256-prod-github-runner-207 kernel: [20268.623923] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 11:01:34 juju-e4d256-prod-github-runner-207 kernel: [20268.624822] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 11:01:34 juju-e4d256-prod-github-runner-207 kernel: [20268.625741] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 11:01:34 juju-e4d256-prod-github-runner-207 kernel: [20268.626640] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 11:01:34 juju-e4d256-prod-github-runner-207 kernel: [20268.627578] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 11:01:34 juju-e4d256-prod-github-runner-207 kernel: [20268.628481] Aug 22 11:02:02 juju-e4d256-prod-github-runner-207 kernel: [20296.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 18794s! [qemu-system-x86:6715] Aug 22 11:02:02 juju-e4d256-prod-github-runner-207 kernel: [20296.543913] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 11:02:02 juju-e4d256-prod-github-runner-207 kernel: [20296.544223] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 11:02:02 juju-e4d256-prod-github-runner-207 kernel: [20296.556317] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 11:02:02 juju-e4d256-prod-github-runner-207 kernel: [20296.557607] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 11:02:02 juju-e4d256-prod-github-runner-207 kernel: [20296.558830] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:02:02 juju-e4d256-prod-github-runner-207 kernel: [20296.559887] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 11:02:02 juju-e4d256-prod-github-runner-207 kernel: [20296.562446] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 11:02:02 juju-e4d256-prod-github-runner-207 kernel: [20296.563489] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 11:02:02 juju-e4d256-prod-github-runner-207 kernel: [20296.564651] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 11:02:02 juju-e4d256-prod-github-runner-207 kernel: [20296.565819] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 11:02:02 juju-e4d256-prod-github-runner-207 kernel: [20296.566979] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 11:02:02 juju-e4d256-prod-github-runner-207 kernel: [20296.568147] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 11:02:02 juju-e4d256-prod-github-runner-207 kernel: [20296.569338] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 11:02:02 juju-e4d256-prod-github-runner-207 kernel: [20296.570595] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 11:02:02 juju-e4d256-prod-github-runner-207 kernel: [20296.571694] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 11:02:02 juju-e4d256-prod-github-runner-207 kernel: [20296.572904] Call Trace: Aug 22 11:02:02 juju-e4d256-prod-github-runner-207 kernel: [20296.573831] Aug 22 11:02:02 juju-e4d256-prod-github-runner-207 kernel: [20296.574754] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:02:02 juju-e4d256-prod-github-runner-207 kernel: [20296.575794] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:02:02 juju-e4d256-prod-github-runner-207 kernel: [20296.576817] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:02:02 juju-e4d256-prod-github-runner-207 kernel: [20296.577936] ? show_regs.part.0+0x23/0x29 Aug 22 11:02:02 juju-e4d256-prod-github-runner-207 kernel: [20296.578936] ? show_regs.cold+0x8/0xd Aug 22 11:02:02 juju-e4d256-prod-github-runner-207 kernel: [20296.579910] ? watchdog_timer_fn+0x1be/0x220 Aug 22 11:02:02 juju-e4d256-prod-github-runner-207 kernel: [20296.580944] ? lockup_detector_update_enable+0x60/0x60 Aug 22 11:02:02 juju-e4d256-prod-github-runner-207 kernel: [20296.582045] ? __hrtimer_run_queues+0x107/0x230 Aug 22 11:02:02 juju-e4d256-prod-github-runner-207 kernel: [20296.583080] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 11:02:02 juju-e4d256-prod-github-runner-207 kernel: [20296.584178] ? hrtimer_interrupt+0x101/0x220 Aug 22 11:02:02 juju-e4d256-prod-github-runner-207 kernel: [20296.585258] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 11:02:02 juju-e4d256-prod-github-runner-207 kernel: [20296.586401] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 11:02:02 juju-e4d256-prod-github-runner-207 kernel: [20296.587466] Aug 22 11:02:02 juju-e4d256-prod-github-runner-207 kernel: [20296.588320] Aug 22 11:02:02 juju-e4d256-prod-github-runner-207 kernel: [20296.589174] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 11:02:02 juju-e4d256-prod-github-runner-207 kernel: [20296.590214] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:02:02 juju-e4d256-prod-github-runner-207 kernel: [20296.591321] ? _raw_spin_lock+0x22/0x30 Aug 22 11:02:02 juju-e4d256-prod-github-runner-207 kernel: [20296.592326] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:02:02 juju-e4d256-prod-github-runner-207 kernel: [20296.593407] direct_page_fault+0x206/0x310 [kvm] Aug 22 11:02:02 juju-e4d256-prod-github-runner-207 kernel: [20296.594521] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 11:02:02 juju-e4d256-prod-github-runner-207 kernel: [20296.595594] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 11:02:02 juju-e4d256-prod-github-runner-207 kernel: [20296.596645] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 11:02:02 juju-e4d256-prod-github-runner-207 kernel: [20296.597708] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 11:02:02 juju-e4d256-prod-github-runner-207 kernel: [20296.598673] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 11:02:02 juju-e4d256-prod-github-runner-207 kernel: [20296.599654] handle_exit+0x98/0x230 [kvm_amd] Aug 22 11:02:02 juju-e4d256-prod-github-runner-207 kernel: [20296.600552] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 11:02:02 juju-e4d256-prod-github-runner-207 kernel: [20296.601532] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 11:02:02 juju-e4d256-prod-github-runner-207 kernel: [20296.602473] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 11:02:02 juju-e4d256-prod-github-runner-207 kernel: [20296.603380] vcpu_run+0x62/0x2c0 [kvm] Aug 22 11:02:02 juju-e4d256-prod-github-runner-207 kernel: [20296.604204] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 11:02:02 juju-e4d256-prod-github-runner-207 kernel: [20296.605037] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 11:02:02 juju-e4d256-prod-github-runner-207 kernel: [20296.605895] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 11:02:02 juju-e4d256-prod-github-runner-207 kernel: [20296.606710] ? __seccomp_filter+0x4a/0x4a0 Aug 22 11:02:02 juju-e4d256-prod-github-runner-207 kernel: [20296.607462] ? __fget_files+0x86/0xc0 Aug 22 11:02:02 juju-e4d256-prod-github-runner-207 kernel: [20296.608172] __x64_sys_ioctl+0x95/0xd0 Aug 22 11:02:02 juju-e4d256-prod-github-runner-207 kernel: [20296.608882] do_syscall_64+0x5c/0xc0 Aug 22 11:02:02 juju-e4d256-prod-github-runner-207 kernel: [20296.609580] ? do_futex+0x162/0x1f0 Aug 22 11:02:02 juju-e4d256-prod-github-runner-207 kernel: [20296.610236] ? __x64_sys_futex+0x78/0x1e0 Aug 22 11:02:02 juju-e4d256-prod-github-runner-207 kernel: [20296.610913] ? __secure_computing+0xa9/0x120 Aug 22 11:02:02 juju-e4d256-prod-github-runner-207 kernel: [20296.611632] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 11:02:02 juju-e4d256-prod-github-runner-207 kernel: [20296.612409] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:02:02 juju-e4d256-prod-github-runner-207 kernel: [20296.613156] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:02:02 juju-e4d256-prod-github-runner-207 kernel: [20296.613878] ? do_syscall_64+0x69/0xc0 Aug 22 11:02:02 juju-e4d256-prod-github-runner-207 kernel: [20296.614526] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:02:02 juju-e4d256-prod-github-runner-207 kernel: [20296.615233] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:02:02 juju-e4d256-prod-github-runner-207 kernel: [20296.615984] ? do_syscall_64+0x69/0xc0 Aug 22 11:02:02 juju-e4d256-prod-github-runner-207 kernel: [20296.616622] ? do_syscall_64+0x69/0xc0 Aug 22 11:02:02 juju-e4d256-prod-github-runner-207 kernel: [20296.617282] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 11:02:02 juju-e4d256-prod-github-runner-207 kernel: [20296.617993] RIP: 0033:0x7faa5d0edaff Aug 22 11:02:02 juju-e4d256-prod-github-runner-207 kernel: [20296.618667] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 11:02:02 juju-e4d256-prod-github-runner-207 kernel: [20296.620680] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 11:02:02 juju-e4d256-prod-github-runner-207 kernel: [20296.621622] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 11:02:02 juju-e4d256-prod-github-runner-207 kernel: [20296.622533] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 11:02:02 juju-e4d256-prod-github-runner-207 kernel: [20296.623427] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 11:02:02 juju-e4d256-prod-github-runner-207 kernel: [20296.624326] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 11:02:02 juju-e4d256-prod-github-runner-207 kernel: [20296.625234] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 11:02:02 juju-e4d256-prod-github-runner-207 kernel: [20296.626138] Aug 22 11:02:30 juju-e4d256-prod-github-runner-207 kernel: [20324.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 18820s! [qemu-system-x86:6715] Aug 22 11:02:30 juju-e4d256-prod-github-runner-207 kernel: [20324.543891] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 11:02:30 juju-e4d256-prod-github-runner-207 kernel: [20324.544211] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 11:02:30 juju-e4d256-prod-github-runner-207 kernel: [20324.556319] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 11:02:30 juju-e4d256-prod-github-runner-207 kernel: [20324.557596] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 11:02:30 juju-e4d256-prod-github-runner-207 kernel: [20324.558818] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:02:30 juju-e4d256-prod-github-runner-207 kernel: [20324.559881] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 11:02:30 juju-e4d256-prod-github-runner-207 kernel: [20324.562442] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 11:02:30 juju-e4d256-prod-github-runner-207 kernel: [20324.563486] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 11:02:30 juju-e4d256-prod-github-runner-207 kernel: [20324.564737] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 11:02:30 juju-e4d256-prod-github-runner-207 kernel: [20324.565908] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 11:02:30 juju-e4d256-prod-github-runner-207 kernel: [20324.567078] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 11:02:30 juju-e4d256-prod-github-runner-207 kernel: [20324.568242] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 11:02:30 juju-e4d256-prod-github-runner-207 kernel: [20324.569434] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 11:02:30 juju-e4d256-prod-github-runner-207 kernel: [20324.570678] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 11:02:30 juju-e4d256-prod-github-runner-207 kernel: [20324.571781] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 11:02:30 juju-e4d256-prod-github-runner-207 kernel: [20324.572998] Call Trace: Aug 22 11:02:30 juju-e4d256-prod-github-runner-207 kernel: [20324.573914] Aug 22 11:02:30 juju-e4d256-prod-github-runner-207 kernel: [20324.574815] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:02:30 juju-e4d256-prod-github-runner-207 kernel: [20324.575852] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:02:30 juju-e4d256-prod-github-runner-207 kernel: [20324.576886] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:02:30 juju-e4d256-prod-github-runner-207 kernel: [20324.577990] ? show_regs.part.0+0x23/0x29 Aug 22 11:02:30 juju-e4d256-prod-github-runner-207 kernel: [20324.578989] ? show_regs.cold+0x8/0xd Aug 22 11:02:30 juju-e4d256-prod-github-runner-207 kernel: [20324.579972] ? watchdog_timer_fn+0x1be/0x220 Aug 22 11:02:30 juju-e4d256-prod-github-runner-207 kernel: [20324.581004] ? lockup_detector_update_enable+0x60/0x60 Aug 22 11:02:30 juju-e4d256-prod-github-runner-207 kernel: [20324.582074] ? __hrtimer_run_queues+0x107/0x230 Aug 22 11:02:30 juju-e4d256-prod-github-runner-207 kernel: [20324.583112] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 11:02:30 juju-e4d256-prod-github-runner-207 kernel: [20324.584141] ? hrtimer_interrupt+0x101/0x220 Aug 22 11:02:30 juju-e4d256-prod-github-runner-207 kernel: [20324.585189] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 11:02:30 juju-e4d256-prod-github-runner-207 kernel: [20324.586265] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 11:02:30 juju-e4d256-prod-github-runner-207 kernel: [20324.587313] Aug 22 11:02:30 juju-e4d256-prod-github-runner-207 kernel: [20324.588166] Aug 22 11:02:30 juju-e4d256-prod-github-runner-207 kernel: [20324.589023] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 11:02:30 juju-e4d256-prod-github-runner-207 kernel: [20324.590059] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:02:30 juju-e4d256-prod-github-runner-207 kernel: [20324.591101] ? _raw_spin_lock+0x22/0x30 Aug 22 11:02:30 juju-e4d256-prod-github-runner-207 kernel: [20324.592049] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:02:30 juju-e4d256-prod-github-runner-207 kernel: [20324.593078] direct_page_fault+0x206/0x310 [kvm] Aug 22 11:02:30 juju-e4d256-prod-github-runner-207 kernel: [20324.594107] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 11:02:30 juju-e4d256-prod-github-runner-207 kernel: [20324.595124] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 11:02:30 juju-e4d256-prod-github-runner-207 kernel: [20324.596130] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 11:02:30 juju-e4d256-prod-github-runner-207 kernel: [20324.597148] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 11:02:30 juju-e4d256-prod-github-runner-207 kernel: [20324.598099] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 11:02:30 juju-e4d256-prod-github-runner-207 kernel: [20324.599079] handle_exit+0x98/0x230 [kvm_amd] Aug 22 11:02:30 juju-e4d256-prod-github-runner-207 kernel: [20324.599973] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 11:02:30 juju-e4d256-prod-github-runner-207 kernel: [20324.600899] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 11:02:30 juju-e4d256-prod-github-runner-207 kernel: [20324.601830] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 11:02:30 juju-e4d256-prod-github-runner-207 kernel: [20324.602736] vcpu_run+0x62/0x2c0 [kvm] Aug 22 11:02:30 juju-e4d256-prod-github-runner-207 kernel: [20324.603551] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 11:02:30 juju-e4d256-prod-github-runner-207 kernel: [20324.604361] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 11:02:30 juju-e4d256-prod-github-runner-207 kernel: [20324.605234] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 11:02:30 juju-e4d256-prod-github-runner-207 kernel: [20324.606034] ? __seccomp_filter+0x4a/0x4a0 Aug 22 11:02:30 juju-e4d256-prod-github-runner-207 kernel: [20324.606782] ? __fget_files+0x86/0xc0 Aug 22 11:02:30 juju-e4d256-prod-github-runner-207 kernel: [20324.607486] __x64_sys_ioctl+0x95/0xd0 Aug 22 11:02:30 juju-e4d256-prod-github-runner-207 kernel: [20324.608182] do_syscall_64+0x5c/0xc0 Aug 22 11:02:30 juju-e4d256-prod-github-runner-207 kernel: [20324.608862] ? do_futex+0x162/0x1f0 Aug 22 11:02:30 juju-e4d256-prod-github-runner-207 kernel: [20324.609512] ? __x64_sys_futex+0x78/0x1e0 Aug 22 11:02:30 juju-e4d256-prod-github-runner-207 kernel: [20324.610187] ? __secure_computing+0xa9/0x120 Aug 22 11:02:30 juju-e4d256-prod-github-runner-207 kernel: [20324.610882] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 11:02:30 juju-e4d256-prod-github-runner-207 kernel: [20324.611642] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:02:30 juju-e4d256-prod-github-runner-207 kernel: [20324.612362] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:02:30 juju-e4d256-prod-github-runner-207 kernel: [20324.613085] ? do_syscall_64+0x69/0xc0 Aug 22 11:02:30 juju-e4d256-prod-github-runner-207 kernel: [20324.613766] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:02:30 juju-e4d256-prod-github-runner-207 kernel: [20324.614470] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:02:30 juju-e4d256-prod-github-runner-207 kernel: [20324.615166] ? do_syscall_64+0x69/0xc0 Aug 22 11:02:30 juju-e4d256-prod-github-runner-207 kernel: [20324.615796] ? do_syscall_64+0x69/0xc0 Aug 22 11:02:30 juju-e4d256-prod-github-runner-207 kernel: [20324.616418] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 11:02:30 juju-e4d256-prod-github-runner-207 kernel: [20324.617141] RIP: 0033:0x7faa5d0edaff Aug 22 11:02:30 juju-e4d256-prod-github-runner-207 kernel: [20324.617807] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 11:02:30 juju-e4d256-prod-github-runner-207 kernel: [20324.619815] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 11:02:30 juju-e4d256-prod-github-runner-207 kernel: [20324.620740] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 11:02:30 juju-e4d256-prod-github-runner-207 kernel: [20324.621630] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 11:02:30 juju-e4d256-prod-github-runner-207 kernel: [20324.622519] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 11:02:30 juju-e4d256-prod-github-runner-207 kernel: [20324.623412] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 11:02:30 juju-e4d256-prod-github-runner-207 kernel: [20324.624301] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 11:02:30 juju-e4d256-prod-github-runner-207 kernel: [20324.625202] Aug 22 11:02:44 juju-e4d256-prod-github-runner-207 kernel: [20338.544706] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 11:02:44 juju-e4d256-prod-github-runner-207 kernel: [20338.546429] rcu: 1-....: (5039561 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=2440515 Aug 22 11:02:44 juju-e4d256-prod-github-runner-207 kernel: [20338.547556] (t=5055336 jiffies g=23269 q=26214) Aug 22 11:02:44 juju-e4d256-prod-github-runner-207 kernel: [20338.548340] NMI backtrace for cpu 1 Aug 22 11:02:44 juju-e4d256-prod-github-runner-207 kernel: [20338.549056] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 11:02:44 juju-e4d256-prod-github-runner-207 kernel: [20338.550158] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 11:02:44 juju-e4d256-prod-github-runner-207 kernel: [20338.551216] Call Trace: Aug 22 11:02:44 juju-e4d256-prod-github-runner-207 kernel: [20338.551890] Aug 22 11:02:44 juju-e4d256-prod-github-runner-207 kernel: [20338.552557] show_stack+0x52/0x5c Aug 22 11:02:44 juju-e4d256-prod-github-runner-207 kernel: [20338.553283] dump_stack_lvl+0x4a/0x63 Aug 22 11:02:44 juju-e4d256-prod-github-runner-207 kernel: [20338.554033] dump_stack+0x10/0x16 Aug 22 11:02:44 juju-e4d256-prod-github-runner-207 kernel: [20338.554748] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 11:02:44 juju-e4d256-prod-github-runner-207 kernel: [20338.555540] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 11:02:44 juju-e4d256-prod-github-runner-207 kernel: [20338.556328] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 11:02:44 juju-e4d256-prod-github-runner-207 kernel: [20338.557157] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 11:02:44 juju-e4d256-prod-github-runner-207 kernel: [20338.557971] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 11:02:44 juju-e4d256-prod-github-runner-207 kernel: [20338.558774] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 11:02:44 juju-e4d256-prod-github-runner-207 kernel: [20338.559542] print_cpu_stall.cold+0x2f/0xe2 Aug 22 11:02:44 juju-e4d256-prod-github-runner-207 kernel: [20338.560307] ? timekeeping_update+0xf7/0x150 Aug 22 11:02:44 juju-e4d256-prod-github-runner-207 kernel: [20338.561086] check_cpu_stall+0x109/0x270 Aug 22 11:02:44 juju-e4d256-prod-github-runner-207 kernel: [20338.561837] rcu_sched_clock_irq+0x9a/0x250 Aug 22 11:02:44 juju-e4d256-prod-github-runner-207 kernel: [20338.562594] update_process_times+0x94/0xd0 Aug 22 11:02:44 juju-e4d256-prod-github-runner-207 kernel: [20338.563351] tick_sched_handle+0x29/0x70 Aug 22 11:02:44 juju-e4d256-prod-github-runner-207 kernel: [20338.564098] tick_sched_timer+0x8c/0xc0 Aug 22 11:02:44 juju-e4d256-prod-github-runner-207 kernel: [20338.564853] ? tick_nohz_handler+0xb0/0xb0 Aug 22 11:02:44 juju-e4d256-prod-github-runner-207 kernel: [20338.565624] __hrtimer_run_queues+0x107/0x230 Aug 22 11:02:44 juju-e4d256-prod-github-runner-207 kernel: [20338.566399] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 11:02:44 juju-e4d256-prod-github-runner-207 kernel: [20338.567178] hrtimer_interrupt+0x101/0x220 Aug 22 11:02:44 juju-e4d256-prod-github-runner-207 kernel: [20338.567934] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 11:02:44 juju-e4d256-prod-github-runner-207 kernel: [20338.568762] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 11:02:44 juju-e4d256-prod-github-runner-207 kernel: [20338.569562] Aug 22 11:02:44 juju-e4d256-prod-github-runner-207 kernel: [20338.570195] Aug 22 11:02:44 juju-e4d256-prod-github-runner-207 kernel: [20338.570828] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 11:02:44 juju-e4d256-prod-github-runner-207 kernel: [20338.571644] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:02:44 juju-e4d256-prod-github-runner-207 kernel: [20338.572529] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 11:02:44 juju-e4d256-prod-github-runner-207 kernel: [20338.574758] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 11:02:44 juju-e4d256-prod-github-runner-207 kernel: [20338.575659] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 11:02:44 juju-e4d256-prod-github-runner-207 kernel: [20338.576670] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 11:02:44 juju-e4d256-prod-github-runner-207 kernel: [20338.577648] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 11:02:44 juju-e4d256-prod-github-runner-207 kernel: [20338.578636] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 11:02:44 juju-e4d256-prod-github-runner-207 kernel: [20338.579640] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 11:02:44 juju-e4d256-prod-github-runner-207 kernel: [20338.580622] ? _raw_spin_lock+0x22/0x30 Aug 22 11:02:44 juju-e4d256-prod-github-runner-207 kernel: [20338.581412] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:02:44 juju-e4d256-prod-github-runner-207 kernel: [20338.582274] direct_page_fault+0x206/0x310 [kvm] Aug 22 11:02:44 juju-e4d256-prod-github-runner-207 kernel: [20338.583118] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 11:02:44 juju-e4d256-prod-github-runner-207 kernel: [20338.583944] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 11:02:44 juju-e4d256-prod-github-runner-207 kernel: [20338.584834] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 11:02:44 juju-e4d256-prod-github-runner-207 kernel: [20338.585673] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 11:02:44 juju-e4d256-prod-github-runner-207 kernel: [20338.586468] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 11:02:44 juju-e4d256-prod-github-runner-207 kernel: [20338.587296] handle_exit+0x98/0x230 [kvm_amd] Aug 22 11:02:44 juju-e4d256-prod-github-runner-207 kernel: [20338.588066] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 11:02:44 juju-e4d256-prod-github-runner-207 kernel: [20338.588863] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 11:02:44 juju-e4d256-prod-github-runner-207 kernel: [20338.589662] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 11:02:44 juju-e4d256-prod-github-runner-207 kernel: [20338.590448] vcpu_run+0x62/0x2c0 [kvm] Aug 22 11:02:44 juju-e4d256-prod-github-runner-207 kernel: [20338.591161] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 11:02:44 juju-e4d256-prod-github-runner-207 kernel: [20338.591903] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 11:02:44 juju-e4d256-prod-github-runner-207 kernel: [20338.592770] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 11:02:44 juju-e4d256-prod-github-runner-207 kernel: [20338.593533] ? __seccomp_filter+0x4a/0x4a0 Aug 22 11:02:44 juju-e4d256-prod-github-runner-207 kernel: [20338.594258] ? __fget_files+0x86/0xc0 Aug 22 11:02:44 juju-e4d256-prod-github-runner-207 kernel: [20338.594956] __x64_sys_ioctl+0x95/0xd0 Aug 22 11:02:44 juju-e4d256-prod-github-runner-207 kernel: [20338.595649] do_syscall_64+0x5c/0xc0 Aug 22 11:02:44 juju-e4d256-prod-github-runner-207 kernel: [20338.596330] ? do_futex+0x162/0x1f0 Aug 22 11:02:44 juju-e4d256-prod-github-runner-207 kernel: [20338.597011] ? __x64_sys_futex+0x78/0x1e0 Aug 22 11:02:44 juju-e4d256-prod-github-runner-207 kernel: [20338.597723] ? __secure_computing+0xa9/0x120 Aug 22 11:02:44 juju-e4d256-prod-github-runner-207 kernel: [20338.598442] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 11:02:44 juju-e4d256-prod-github-runner-207 kernel: [20338.599237] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:02:44 juju-e4d256-prod-github-runner-207 kernel: [20338.599998] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:02:44 juju-e4d256-prod-github-runner-207 kernel: [20338.600765] ? do_syscall_64+0x69/0xc0 Aug 22 11:02:44 juju-e4d256-prod-github-runner-207 kernel: [20338.601462] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:02:44 juju-e4d256-prod-github-runner-207 kernel: [20338.602258] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:02:44 juju-e4d256-prod-github-runner-207 kernel: [20338.603031] ? do_syscall_64+0x69/0xc0 Aug 22 11:02:44 juju-e4d256-prod-github-runner-207 kernel: [20338.603734] ? do_syscall_64+0x69/0xc0 Aug 22 11:02:44 juju-e4d256-prod-github-runner-207 kernel: [20338.604424] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 11:02:44 juju-e4d256-prod-github-runner-207 kernel: [20338.605215] RIP: 0033:0x7faa5d0edaff Aug 22 11:02:44 juju-e4d256-prod-github-runner-207 kernel: [20338.605935] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 11:02:44 juju-e4d256-prod-github-runner-207 kernel: [20338.608060] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 11:02:44 juju-e4d256-prod-github-runner-207 kernel: [20338.609040] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 11:02:44 juju-e4d256-prod-github-runner-207 kernel: [20338.609994] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 11:02:44 juju-e4d256-prod-github-runner-207 kernel: [20338.610942] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 11:02:44 juju-e4d256-prod-github-runner-207 kernel: [20338.611920] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 11:02:44 juju-e4d256-prod-github-runner-207 kernel: [20338.612860] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 11:02:44 juju-e4d256-prod-github-runner-207 kernel: [20338.613811] Aug 22 11:03:10 juju-e4d256-prod-github-runner-207 kernel: [20364.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 18857s! [qemu-system-x86:6715] Aug 22 11:03:10 juju-e4d256-prod-github-runner-207 kernel: [20364.544117] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 11:03:10 juju-e4d256-prod-github-runner-207 kernel: [20364.544461] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 11:03:10 juju-e4d256-prod-github-runner-207 kernel: [20364.556615] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 11:03:10 juju-e4d256-prod-github-runner-207 kernel: [20364.557877] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 11:03:10 juju-e4d256-prod-github-runner-207 kernel: [20364.559159] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:03:10 juju-e4d256-prod-github-runner-207 kernel: [20364.560239] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 11:03:10 juju-e4d256-prod-github-runner-207 kernel: [20364.562796] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 11:03:10 juju-e4d256-prod-github-runner-207 kernel: [20364.563839] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 11:03:10 juju-e4d256-prod-github-runner-207 kernel: [20364.565032] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 11:03:10 juju-e4d256-prod-github-runner-207 kernel: [20364.566223] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 11:03:10 juju-e4d256-prod-github-runner-207 kernel: [20364.567387] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 11:03:10 juju-e4d256-prod-github-runner-207 kernel: [20364.568566] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 11:03:10 juju-e4d256-prod-github-runner-207 kernel: [20364.569735] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 11:03:10 juju-e4d256-prod-github-runner-207 kernel: [20364.570992] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 11:03:10 juju-e4d256-prod-github-runner-207 kernel: [20364.572098] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 11:03:10 juju-e4d256-prod-github-runner-207 kernel: [20364.573310] Call Trace: Aug 22 11:03:10 juju-e4d256-prod-github-runner-207 kernel: [20364.574230] Aug 22 11:03:10 juju-e4d256-prod-github-runner-207 kernel: [20364.575131] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:03:10 juju-e4d256-prod-github-runner-207 kernel: [20364.576239] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:03:10 juju-e4d256-prod-github-runner-207 kernel: [20364.577278] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:03:10 juju-e4d256-prod-github-runner-207 kernel: [20364.578379] ? show_regs.part.0+0x23/0x29 Aug 22 11:03:10 juju-e4d256-prod-github-runner-207 kernel: [20364.579379] ? show_regs.cold+0x8/0xd Aug 22 11:03:10 juju-e4d256-prod-github-runner-207 kernel: [20364.580376] ? watchdog_timer_fn+0x1be/0x220 Aug 22 11:03:10 juju-e4d256-prod-github-runner-207 kernel: [20364.581403] ? lockup_detector_update_enable+0x60/0x60 Aug 22 11:03:10 juju-e4d256-prod-github-runner-207 kernel: [20364.582468] ? __hrtimer_run_queues+0x107/0x230 Aug 22 11:03:10 juju-e4d256-prod-github-runner-207 kernel: [20364.583500] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 11:03:10 juju-e4d256-prod-github-runner-207 kernel: [20364.584537] ? hrtimer_interrupt+0x101/0x220 Aug 22 11:03:10 juju-e4d256-prod-github-runner-207 kernel: [20364.585561] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 11:03:10 juju-e4d256-prod-github-runner-207 kernel: [20364.586642] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 11:03:10 juju-e4d256-prod-github-runner-207 kernel: [20364.587690] Aug 22 11:03:10 juju-e4d256-prod-github-runner-207 kernel: [20364.588594] Aug 22 11:03:10 juju-e4d256-prod-github-runner-207 kernel: [20364.589449] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 11:03:10 juju-e4d256-prod-github-runner-207 kernel: [20364.590488] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:03:10 juju-e4d256-prod-github-runner-207 kernel: [20364.591572] ? _raw_spin_lock+0x22/0x30 Aug 22 11:03:10 juju-e4d256-prod-github-runner-207 kernel: [20364.592560] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:03:10 juju-e4d256-prod-github-runner-207 kernel: [20364.593583] direct_page_fault+0x206/0x310 [kvm] Aug 22 11:03:10 juju-e4d256-prod-github-runner-207 kernel: [20364.594607] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 11:03:10 juju-e4d256-prod-github-runner-207 kernel: [20364.595616] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 11:03:10 juju-e4d256-prod-github-runner-207 kernel: [20364.596648] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 11:03:10 juju-e4d256-prod-github-runner-207 kernel: [20364.597674] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 11:03:10 juju-e4d256-prod-github-runner-207 kernel: [20364.598730] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 11:03:10 juju-e4d256-prod-github-runner-207 kernel: [20364.599818] handle_exit+0x98/0x230 [kvm_amd] Aug 22 11:03:10 juju-e4d256-prod-github-runner-207 kernel: [20364.600863] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 11:03:10 juju-e4d256-prod-github-runner-207 kernel: [20364.601899] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 11:03:10 juju-e4d256-prod-github-runner-207 kernel: [20364.602925] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 11:03:10 juju-e4d256-prod-github-runner-207 kernel: [20364.603928] vcpu_run+0x62/0x2c0 [kvm] Aug 22 11:03:10 juju-e4d256-prod-github-runner-207 kernel: [20364.604842] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 11:03:10 juju-e4d256-prod-github-runner-207 kernel: [20364.605745] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 11:03:10 juju-e4d256-prod-github-runner-207 kernel: [20364.606703] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 11:03:10 juju-e4d256-prod-github-runner-207 kernel: [20364.607590] ? __seccomp_filter+0x4a/0x4a0 Aug 22 11:03:10 juju-e4d256-prod-github-runner-207 kernel: [20364.608443] ? __fget_files+0x86/0xc0 Aug 22 11:03:10 juju-e4d256-prod-github-runner-207 kernel: [20364.609226] __x64_sys_ioctl+0x95/0xd0 Aug 22 11:03:10 juju-e4d256-prod-github-runner-207 kernel: [20364.609994] do_syscall_64+0x5c/0xc0 Aug 22 11:03:10 juju-e4d256-prod-github-runner-207 kernel: [20364.610737] ? do_futex+0x162/0x1f0 Aug 22 11:03:10 juju-e4d256-prod-github-runner-207 kernel: [20364.611473] ? __x64_sys_futex+0x78/0x1e0 Aug 22 11:03:10 juju-e4d256-prod-github-runner-207 kernel: [20364.612255] ? __secure_computing+0xa9/0x120 Aug 22 11:03:10 juju-e4d256-prod-github-runner-207 kernel: [20364.613130] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 11:03:10 juju-e4d256-prod-github-runner-207 kernel: [20364.614010] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:03:10 juju-e4d256-prod-github-runner-207 kernel: [20364.614823] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:03:10 juju-e4d256-prod-github-runner-207 kernel: [20364.615634] ? do_syscall_64+0x69/0xc0 Aug 22 11:03:10 juju-e4d256-prod-github-runner-207 kernel: [20364.616381] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:03:10 juju-e4d256-prod-github-runner-207 kernel: [20364.617177] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:03:10 juju-e4d256-prod-github-runner-207 kernel: [20364.617968] ? do_syscall_64+0x69/0xc0 Aug 22 11:03:10 juju-e4d256-prod-github-runner-207 kernel: [20364.618664] ? do_syscall_64+0x69/0xc0 Aug 22 11:03:10 juju-e4d256-prod-github-runner-207 kernel: [20364.619364] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 11:03:10 juju-e4d256-prod-github-runner-207 kernel: [20364.620170] RIP: 0033:0x7faa5d0edaff Aug 22 11:03:10 juju-e4d256-prod-github-runner-207 kernel: [20364.620920] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 11:03:10 juju-e4d256-prod-github-runner-207 kernel: [20364.623251] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 11:03:10 juju-e4d256-prod-github-runner-207 kernel: [20364.624336] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 11:03:10 juju-e4d256-prod-github-runner-207 kernel: [20364.625365] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 11:03:10 juju-e4d256-prod-github-runner-207 kernel: [20364.626386] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 11:03:10 juju-e4d256-prod-github-runner-207 kernel: [20364.627412] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 11:03:10 juju-e4d256-prod-github-runner-207 kernel: [20364.628456] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 11:03:10 juju-e4d256-prod-github-runner-207 kernel: [20364.629485] Aug 22 11:03:38 juju-e4d256-prod-github-runner-207 kernel: [20392.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 18884s! [qemu-system-x86:6715] Aug 22 11:03:38 juju-e4d256-prod-github-runner-207 kernel: [20392.543893] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 11:03:38 juju-e4d256-prod-github-runner-207 kernel: [20392.544212] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 11:03:38 juju-e4d256-prod-github-runner-207 kernel: [20392.556760] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 11:03:38 juju-e4d256-prod-github-runner-207 kernel: [20392.558055] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 11:03:38 juju-e4d256-prod-github-runner-207 kernel: [20392.559298] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:03:38 juju-e4d256-prod-github-runner-207 kernel: [20392.560389] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 11:03:38 juju-e4d256-prod-github-runner-207 kernel: [20392.563130] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 11:03:38 juju-e4d256-prod-github-runner-207 kernel: [20392.564254] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 11:03:38 juju-e4d256-prod-github-runner-207 kernel: [20392.565439] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 11:03:38 juju-e4d256-prod-github-runner-207 kernel: [20392.566620] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 11:03:38 juju-e4d256-prod-github-runner-207 kernel: [20392.567802] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 11:03:38 juju-e4d256-prod-github-runner-207 kernel: [20392.569113] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 11:03:38 juju-e4d256-prod-github-runner-207 kernel: [20392.570355] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 11:03:38 juju-e4d256-prod-github-runner-207 kernel: [20392.571619] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 11:03:38 juju-e4d256-prod-github-runner-207 kernel: [20392.572786] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 11:03:38 juju-e4d256-prod-github-runner-207 kernel: [20392.574005] Call Trace: Aug 22 11:03:38 juju-e4d256-prod-github-runner-207 kernel: [20392.574923] Aug 22 11:03:38 juju-e4d256-prod-github-runner-207 kernel: [20392.575867] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:03:38 juju-e4d256-prod-github-runner-207 kernel: [20392.576923] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:03:38 juju-e4d256-prod-github-runner-207 kernel: [20392.578121] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:03:38 juju-e4d256-prod-github-runner-207 kernel: [20392.579409] ? show_regs.part.0+0x23/0x29 Aug 22 11:03:38 juju-e4d256-prod-github-runner-207 kernel: [20392.580593] ? show_regs.cold+0x8/0xd Aug 22 11:03:38 juju-e4d256-prod-github-runner-207 kernel: [20392.581570] ? watchdog_timer_fn+0x1be/0x220 Aug 22 11:03:38 juju-e4d256-prod-github-runner-207 kernel: [20392.582589] ? lockup_detector_update_enable+0x60/0x60 Aug 22 11:03:38 juju-e4d256-prod-github-runner-207 kernel: [20392.583750] ? __hrtimer_run_queues+0x107/0x230 Aug 22 11:03:38 juju-e4d256-prod-github-runner-207 kernel: [20392.584890] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 11:03:38 juju-e4d256-prod-github-runner-207 kernel: [20392.585929] ? hrtimer_interrupt+0x101/0x220 Aug 22 11:03:38 juju-e4d256-prod-github-runner-207 kernel: [20392.586948] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 11:03:38 juju-e4d256-prod-github-runner-207 kernel: [20392.588038] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 11:03:38 juju-e4d256-prod-github-runner-207 kernel: [20392.589090] Aug 22 11:03:38 juju-e4d256-prod-github-runner-207 kernel: [20392.589947] Aug 22 11:03:38 juju-e4d256-prod-github-runner-207 kernel: [20392.590787] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 11:03:38 juju-e4d256-prod-github-runner-207 kernel: [20392.591827] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:03:38 juju-e4d256-prod-github-runner-207 kernel: [20392.592888] ? _raw_spin_lock+0x22/0x30 Aug 22 11:03:38 juju-e4d256-prod-github-runner-207 kernel: [20392.593838] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:03:38 juju-e4d256-prod-github-runner-207 kernel: [20392.594876] direct_page_fault+0x206/0x310 [kvm] Aug 22 11:03:38 juju-e4d256-prod-github-runner-207 kernel: [20392.595961] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 11:03:38 juju-e4d256-prod-github-runner-207 kernel: [20392.596986] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 11:03:38 juju-e4d256-prod-github-runner-207 kernel: [20392.598400] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 11:03:38 juju-e4d256-prod-github-runner-207 kernel: [20392.599416] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 11:03:38 juju-e4d256-prod-github-runner-207 kernel: [20392.600525] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 11:03:38 juju-e4d256-prod-github-runner-207 kernel: [20392.601615] handle_exit+0x98/0x230 [kvm_amd] Aug 22 11:03:38 juju-e4d256-prod-github-runner-207 kernel: [20392.602514] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 11:03:38 juju-e4d256-prod-github-runner-207 kernel: [20392.603447] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 11:03:38 juju-e4d256-prod-github-runner-207 kernel: [20392.604391] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 11:03:38 juju-e4d256-prod-github-runner-207 kernel: [20392.605297] vcpu_run+0x62/0x2c0 [kvm] Aug 22 11:03:38 juju-e4d256-prod-github-runner-207 kernel: [20392.606110] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 11:03:38 juju-e4d256-prod-github-runner-207 kernel: [20392.606919] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 11:03:38 juju-e4d256-prod-github-runner-207 kernel: [20392.607776] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 11:03:38 juju-e4d256-prod-github-runner-207 kernel: [20392.608581] ? __seccomp_filter+0x4a/0x4a0 Aug 22 11:03:38 juju-e4d256-prod-github-runner-207 kernel: [20392.609329] ? __fget_files+0x86/0xc0 Aug 22 11:03:38 juju-e4d256-prod-github-runner-207 kernel: [20392.610034] __x64_sys_ioctl+0x95/0xd0 Aug 22 11:03:38 juju-e4d256-prod-github-runner-207 kernel: [20392.610728] do_syscall_64+0x5c/0xc0 Aug 22 11:03:38 juju-e4d256-prod-github-runner-207 kernel: [20392.611399] ? do_futex+0x162/0x1f0 Aug 22 11:03:38 juju-e4d256-prod-github-runner-207 kernel: [20392.612067] ? __x64_sys_futex+0x78/0x1e0 Aug 22 11:03:38 juju-e4d256-prod-github-runner-207 kernel: [20392.612752] ? __secure_computing+0xa9/0x120 Aug 22 11:03:38 juju-e4d256-prod-github-runner-207 kernel: [20392.613449] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 11:03:38 juju-e4d256-prod-github-runner-207 kernel: [20392.614209] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:03:38 juju-e4d256-prod-github-runner-207 kernel: [20392.614931] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:03:38 juju-e4d256-prod-github-runner-207 kernel: [20392.615679] ? do_syscall_64+0x69/0xc0 Aug 22 11:03:38 juju-e4d256-prod-github-runner-207 kernel: [20392.616358] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:03:38 juju-e4d256-prod-github-runner-207 kernel: [20392.617063] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:03:38 juju-e4d256-prod-github-runner-207 kernel: [20392.617762] ? do_syscall_64+0x69/0xc0 Aug 22 11:03:38 juju-e4d256-prod-github-runner-207 kernel: [20392.618393] ? do_syscall_64+0x69/0xc0 Aug 22 11:03:38 juju-e4d256-prod-github-runner-207 kernel: [20392.619015] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 11:03:38 juju-e4d256-prod-github-runner-207 kernel: [20392.619723] RIP: 0033:0x7faa5d0edaff Aug 22 11:03:38 juju-e4d256-prod-github-runner-207 kernel: [20392.620403] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 11:03:38 juju-e4d256-prod-github-runner-207 kernel: [20392.622419] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 11:03:38 juju-e4d256-prod-github-runner-207 kernel: [20392.623332] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 11:03:38 juju-e4d256-prod-github-runner-207 kernel: [20392.624266] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 11:03:38 juju-e4d256-prod-github-runner-207 kernel: [20392.625266] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 11:03:38 juju-e4d256-prod-github-runner-207 kernel: [20392.626212] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 11:03:38 juju-e4d256-prod-github-runner-207 kernel: [20392.627174] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 11:03:38 juju-e4d256-prod-github-runner-207 kernel: [20392.628128] Aug 22 11:04:06 juju-e4d256-prod-github-runner-207 kernel: [20420.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 18910s! [qemu-system-x86:6715] Aug 22 11:04:06 juju-e4d256-prod-github-runner-207 kernel: [20420.543943] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 11:04:06 juju-e4d256-prod-github-runner-207 kernel: [20420.544237] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 11:04:06 juju-e4d256-prod-github-runner-207 kernel: [20420.556735] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 11:04:06 juju-e4d256-prod-github-runner-207 kernel: [20420.558304] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 11:04:06 juju-e4d256-prod-github-runner-207 kernel: [20420.559571] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:04:06 juju-e4d256-prod-github-runner-207 kernel: [20420.560642] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 11:04:06 juju-e4d256-prod-github-runner-207 kernel: [20420.563253] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 11:04:06 juju-e4d256-prod-github-runner-207 kernel: [20420.564335] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 11:04:06 juju-e4d256-prod-github-runner-207 kernel: [20420.565546] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 11:04:06 juju-e4d256-prod-github-runner-207 kernel: [20420.566733] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 11:04:06 juju-e4d256-prod-github-runner-207 kernel: [20420.567932] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 11:04:06 juju-e4d256-prod-github-runner-207 kernel: [20420.569137] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 11:04:06 juju-e4d256-prod-github-runner-207 kernel: [20420.570344] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 11:04:06 juju-e4d256-prod-github-runner-207 kernel: [20420.571611] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 11:04:06 juju-e4d256-prod-github-runner-207 kernel: [20420.572726] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 11:04:06 juju-e4d256-prod-github-runner-207 kernel: [20420.573966] Call Trace: Aug 22 11:04:06 juju-e4d256-prod-github-runner-207 kernel: [20420.574893] Aug 22 11:04:06 juju-e4d256-prod-github-runner-207 kernel: [20420.575808] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:04:06 juju-e4d256-prod-github-runner-207 kernel: [20420.576852] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:04:06 juju-e4d256-prod-github-runner-207 kernel: [20420.577883] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:04:06 juju-e4d256-prod-github-runner-207 kernel: [20420.578991] ? show_regs.part.0+0x23/0x29 Aug 22 11:04:06 juju-e4d256-prod-github-runner-207 kernel: [20420.580013] ? show_regs.cold+0x8/0xd Aug 22 11:04:06 juju-e4d256-prod-github-runner-207 kernel: [20420.580995] ? watchdog_timer_fn+0x1be/0x220 Aug 22 11:04:06 juju-e4d256-prod-github-runner-207 kernel: [20420.582015] ? lockup_detector_update_enable+0x60/0x60 Aug 22 11:04:06 juju-e4d256-prod-github-runner-207 kernel: [20420.583091] ? __hrtimer_run_queues+0x107/0x230 Aug 22 11:04:06 juju-e4d256-prod-github-runner-207 kernel: [20420.584139] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 11:04:06 juju-e4d256-prod-github-runner-207 kernel: [20420.585176] ? hrtimer_interrupt+0x101/0x220 Aug 22 11:04:06 juju-e4d256-prod-github-runner-207 kernel: [20420.586202] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 11:04:06 juju-e4d256-prod-github-runner-207 kernel: [20420.587308] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 11:04:06 juju-e4d256-prod-github-runner-207 kernel: [20420.588426] Aug 22 11:04:06 juju-e4d256-prod-github-runner-207 kernel: [20420.589325] Aug 22 11:04:06 juju-e4d256-prod-github-runner-207 kernel: [20420.590335] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 11:04:06 juju-e4d256-prod-github-runner-207 kernel: [20420.591396] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:04:06 juju-e4d256-prod-github-runner-207 kernel: [20420.592491] ? _raw_spin_lock+0x22/0x30 Aug 22 11:04:06 juju-e4d256-prod-github-runner-207 kernel: [20420.593454] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:04:06 juju-e4d256-prod-github-runner-207 kernel: [20420.594499] direct_page_fault+0x206/0x310 [kvm] Aug 22 11:04:06 juju-e4d256-prod-github-runner-207 kernel: [20420.595553] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 11:04:06 juju-e4d256-prod-github-runner-207 kernel: [20420.596576] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 11:04:06 juju-e4d256-prod-github-runner-207 kernel: [20420.597587] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 11:04:06 juju-e4d256-prod-github-runner-207 kernel: [20420.598608] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 11:04:06 juju-e4d256-prod-github-runner-207 kernel: [20420.599583] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 11:04:06 juju-e4d256-prod-github-runner-207 kernel: [20420.600580] handle_exit+0x98/0x230 [kvm_amd] Aug 22 11:04:06 juju-e4d256-prod-github-runner-207 kernel: [20420.601488] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 11:04:06 juju-e4d256-prod-github-runner-207 kernel: [20420.602428] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 11:04:06 juju-e4d256-prod-github-runner-207 kernel: [20420.603368] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 11:04:06 juju-e4d256-prod-github-runner-207 kernel: [20420.604316] vcpu_run+0x62/0x2c0 [kvm] Aug 22 11:04:06 juju-e4d256-prod-github-runner-207 kernel: [20420.605143] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 11:04:06 juju-e4d256-prod-github-runner-207 kernel: [20420.605962] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 11:04:06 juju-e4d256-prod-github-runner-207 kernel: [20420.606831] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 11:04:06 juju-e4d256-prod-github-runner-207 kernel: [20420.607660] ? __seccomp_filter+0x4a/0x4a0 Aug 22 11:04:06 juju-e4d256-prod-github-runner-207 kernel: [20420.608417] ? __fget_files+0x86/0xc0 Aug 22 11:04:06 juju-e4d256-prod-github-runner-207 kernel: [20420.609139] __x64_sys_ioctl+0x95/0xd0 Aug 22 11:04:06 juju-e4d256-prod-github-runner-207 kernel: [20420.609855] do_syscall_64+0x5c/0xc0 Aug 22 11:04:06 juju-e4d256-prod-github-runner-207 kernel: [20420.610529] ? do_futex+0x162/0x1f0 Aug 22 11:04:06 juju-e4d256-prod-github-runner-207 kernel: [20420.611184] ? __x64_sys_futex+0x78/0x1e0 Aug 22 11:04:06 juju-e4d256-prod-github-runner-207 kernel: [20420.611877] ? __secure_computing+0xa9/0x120 Aug 22 11:04:06 juju-e4d256-prod-github-runner-207 kernel: [20420.612579] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 11:04:06 juju-e4d256-prod-github-runner-207 kernel: [20420.613354] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:04:06 juju-e4d256-prod-github-runner-207 kernel: [20420.614086] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:04:06 juju-e4d256-prod-github-runner-207 kernel: [20420.614827] ? do_syscall_64+0x69/0xc0 Aug 22 11:04:06 juju-e4d256-prod-github-runner-207 kernel: [20420.615489] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:04:06 juju-e4d256-prod-github-runner-207 kernel: [20420.616217] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:04:06 juju-e4d256-prod-github-runner-207 kernel: [20420.616924] ? do_syscall_64+0x69/0xc0 Aug 22 11:04:06 juju-e4d256-prod-github-runner-207 kernel: [20420.617557] ? do_syscall_64+0x69/0xc0 Aug 22 11:04:06 juju-e4d256-prod-github-runner-207 kernel: [20420.618199] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 11:04:06 juju-e4d256-prod-github-runner-207 kernel: [20420.618918] RIP: 0033:0x7faa5d0edaff Aug 22 11:04:06 juju-e4d256-prod-github-runner-207 kernel: [20420.619596] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 11:04:06 juju-e4d256-prod-github-runner-207 kernel: [20420.621644] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 11:04:06 juju-e4d256-prod-github-runner-207 kernel: [20420.622585] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 11:04:06 juju-e4d256-prod-github-runner-207 kernel: [20420.623493] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 11:04:06 juju-e4d256-prod-github-runner-207 kernel: [20420.624420] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 11:04:06 juju-e4d256-prod-github-runner-207 kernel: [20420.625336] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 11:04:06 juju-e4d256-prod-github-runner-207 kernel: [20420.626246] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 11:04:06 juju-e4d256-prod-github-runner-207 kernel: [20420.627156] Aug 22 11:04:34 juju-e4d256-prod-github-runner-207 kernel: [20448.541976] watchdog: BUG: soft lockup - CPU#1 stuck for 18936s! [qemu-system-x86:6715] Aug 22 11:04:34 juju-e4d256-prod-github-runner-207 kernel: [20448.543865] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 11:04:34 juju-e4d256-prod-github-runner-207 kernel: [20448.544162] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 11:04:34 juju-e4d256-prod-github-runner-207 kernel: [20448.556315] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 11:04:34 juju-e4d256-prod-github-runner-207 kernel: [20448.557593] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 11:04:34 juju-e4d256-prod-github-runner-207 kernel: [20448.558824] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:04:34 juju-e4d256-prod-github-runner-207 kernel: [20448.559893] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 11:04:34 juju-e4d256-prod-github-runner-207 kernel: [20448.562455] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 11:04:34 juju-e4d256-prod-github-runner-207 kernel: [20448.563517] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 11:04:34 juju-e4d256-prod-github-runner-207 kernel: [20448.564688] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 11:04:34 juju-e4d256-prod-github-runner-207 kernel: [20448.565852] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 11:04:34 juju-e4d256-prod-github-runner-207 kernel: [20448.567026] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 11:04:34 juju-e4d256-prod-github-runner-207 kernel: [20448.568205] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 11:04:34 juju-e4d256-prod-github-runner-207 kernel: [20448.569375] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 11:04:34 juju-e4d256-prod-github-runner-207 kernel: [20448.570615] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 11:04:34 juju-e4d256-prod-github-runner-207 kernel: [20448.571724] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 11:04:34 juju-e4d256-prod-github-runner-207 kernel: [20448.572921] Call Trace: Aug 22 11:04:34 juju-e4d256-prod-github-runner-207 kernel: [20448.573840] Aug 22 11:04:34 juju-e4d256-prod-github-runner-207 kernel: [20448.574738] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:04:34 juju-e4d256-prod-github-runner-207 kernel: [20448.575782] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:04:34 juju-e4d256-prod-github-runner-207 kernel: [20448.576830] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:04:34 juju-e4d256-prod-github-runner-207 kernel: [20448.577931] ? show_regs.part.0+0x23/0x29 Aug 22 11:04:34 juju-e4d256-prod-github-runner-207 kernel: [20448.578935] ? show_regs.cold+0x8/0xd Aug 22 11:04:34 juju-e4d256-prod-github-runner-207 kernel: [20448.579929] ? watchdog_timer_fn+0x1be/0x220 Aug 22 11:04:34 juju-e4d256-prod-github-runner-207 kernel: [20448.580940] ? lockup_detector_update_enable+0x60/0x60 Aug 22 11:04:34 juju-e4d256-prod-github-runner-207 kernel: [20448.582004] ? __hrtimer_run_queues+0x107/0x230 Aug 22 11:04:34 juju-e4d256-prod-github-runner-207 kernel: [20448.583037] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 11:04:34 juju-e4d256-prod-github-runner-207 kernel: [20448.584076] ? hrtimer_interrupt+0x101/0x220 Aug 22 11:04:34 juju-e4d256-prod-github-runner-207 kernel: [20448.585093] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 11:04:34 juju-e4d256-prod-github-runner-207 kernel: [20448.586171] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 11:04:34 juju-e4d256-prod-github-runner-207 kernel: [20448.587231] Aug 22 11:04:34 juju-e4d256-prod-github-runner-207 kernel: [20448.588085] Aug 22 11:04:34 juju-e4d256-prod-github-runner-207 kernel: [20448.588926] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 11:04:34 juju-e4d256-prod-github-runner-207 kernel: [20448.589963] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:04:34 juju-e4d256-prod-github-runner-207 kernel: [20448.591012] ? _raw_spin_lock+0x22/0x30 Aug 22 11:04:34 juju-e4d256-prod-github-runner-207 kernel: [20448.591976] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:04:34 juju-e4d256-prod-github-runner-207 kernel: [20448.593003] direct_page_fault+0x206/0x310 [kvm] Aug 22 11:04:34 juju-e4d256-prod-github-runner-207 kernel: [20448.594033] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 11:04:34 juju-e4d256-prod-github-runner-207 kernel: [20448.595043] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 11:04:34 juju-e4d256-prod-github-runner-207 kernel: [20448.596057] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 11:04:34 juju-e4d256-prod-github-runner-207 kernel: [20448.597064] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 11:04:34 juju-e4d256-prod-github-runner-207 kernel: [20448.598011] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 11:04:34 juju-e4d256-prod-github-runner-207 kernel: [20448.598990] handle_exit+0x98/0x230 [kvm_amd] Aug 22 11:04:34 juju-e4d256-prod-github-runner-207 kernel: [20448.599902] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 11:04:34 juju-e4d256-prod-github-runner-207 kernel: [20448.600816] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 11:04:34 juju-e4d256-prod-github-runner-207 kernel: [20448.601740] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 11:04:34 juju-e4d256-prod-github-runner-207 kernel: [20448.602649] vcpu_run+0x62/0x2c0 [kvm] Aug 22 11:04:34 juju-e4d256-prod-github-runner-207 kernel: [20448.603522] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 11:04:34 juju-e4d256-prod-github-runner-207 kernel: [20448.604333] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 11:04:34 juju-e4d256-prod-github-runner-207 kernel: [20448.605225] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 11:04:34 juju-e4d256-prod-github-runner-207 kernel: [20448.606025] ? __seccomp_filter+0x4a/0x4a0 Aug 22 11:04:34 juju-e4d256-prod-github-runner-207 kernel: [20448.606773] ? __fget_files+0x86/0xc0 Aug 22 11:04:34 juju-e4d256-prod-github-runner-207 kernel: [20448.607491] __x64_sys_ioctl+0x95/0xd0 Aug 22 11:04:34 juju-e4d256-prod-github-runner-207 kernel: [20448.608188] do_syscall_64+0x5c/0xc0 Aug 22 11:04:34 juju-e4d256-prod-github-runner-207 kernel: [20448.608853] ? do_futex+0x162/0x1f0 Aug 22 11:04:34 juju-e4d256-prod-github-runner-207 kernel: [20448.609501] ? __x64_sys_futex+0x78/0x1e0 Aug 22 11:04:34 juju-e4d256-prod-github-runner-207 kernel: [20448.610174] ? __secure_computing+0xa9/0x120 Aug 22 11:04:34 juju-e4d256-prod-github-runner-207 kernel: [20448.610863] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 11:04:34 juju-e4d256-prod-github-runner-207 kernel: [20448.611646] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:04:34 juju-e4d256-prod-github-runner-207 kernel: [20448.612366] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:04:34 juju-e4d256-prod-github-runner-207 kernel: [20448.613082] ? do_syscall_64+0x69/0xc0 Aug 22 11:04:34 juju-e4d256-prod-github-runner-207 kernel: [20448.613725] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:04:34 juju-e4d256-prod-github-runner-207 kernel: [20448.614427] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:04:34 juju-e4d256-prod-github-runner-207 kernel: [20448.615121] ? do_syscall_64+0x69/0xc0 Aug 22 11:04:34 juju-e4d256-prod-github-runner-207 kernel: [20448.615750] ? do_syscall_64+0x69/0xc0 Aug 22 11:04:34 juju-e4d256-prod-github-runner-207 kernel: [20448.616372] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 11:04:34 juju-e4d256-prod-github-runner-207 kernel: [20448.617076] RIP: 0033:0x7faa5d0edaff Aug 22 11:04:34 juju-e4d256-prod-github-runner-207 kernel: [20448.617741] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 11:04:34 juju-e4d256-prod-github-runner-207 kernel: [20448.619741] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 11:04:34 juju-e4d256-prod-github-runner-207 kernel: [20448.620659] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 11:04:34 juju-e4d256-prod-github-runner-207 kernel: [20448.621554] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 11:04:34 juju-e4d256-prod-github-runner-207 kernel: [20448.622440] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 11:04:34 juju-e4d256-prod-github-runner-207 kernel: [20448.623337] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 11:04:34 juju-e4d256-prod-github-runner-207 kernel: [20448.624229] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 11:04:34 juju-e4d256-prod-github-runner-207 kernel: [20448.625126] Aug 22 11:05:02 juju-e4d256-prod-github-runner-207 kernel: [20476.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 18962s! [qemu-system-x86:6715] Aug 22 11:05:02 juju-e4d256-prod-github-runner-207 kernel: [20476.543909] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 11:05:02 juju-e4d256-prod-github-runner-207 kernel: [20476.544221] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 11:05:02 juju-e4d256-prod-github-runner-207 kernel: [20476.556893] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 11:05:02 juju-e4d256-prod-github-runner-207 kernel: [20476.558176] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 11:05:02 juju-e4d256-prod-github-runner-207 kernel: [20476.559428] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:05:02 juju-e4d256-prod-github-runner-207 kernel: [20476.560496] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 11:05:02 juju-e4d256-prod-github-runner-207 kernel: [20476.563110] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 11:05:02 juju-e4d256-prod-github-runner-207 kernel: [20476.564168] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 11:05:02 juju-e4d256-prod-github-runner-207 kernel: [20476.565345] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 11:05:02 juju-e4d256-prod-github-runner-207 kernel: [20476.566518] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 11:05:02 juju-e4d256-prod-github-runner-207 kernel: [20476.567732] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 11:05:02 juju-e4d256-prod-github-runner-207 kernel: [20476.568906] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 11:05:02 juju-e4d256-prod-github-runner-207 kernel: [20476.570104] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 11:05:02 juju-e4d256-prod-github-runner-207 kernel: [20476.571365] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 11:05:02 juju-e4d256-prod-github-runner-207 kernel: [20476.572481] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 11:05:02 juju-e4d256-prod-github-runner-207 kernel: [20476.573694] Call Trace: Aug 22 11:05:02 juju-e4d256-prod-github-runner-207 kernel: [20476.574614] Aug 22 11:05:02 juju-e4d256-prod-github-runner-207 kernel: [20476.575650] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:05:02 juju-e4d256-prod-github-runner-207 kernel: [20476.576701] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:05:02 juju-e4d256-prod-github-runner-207 kernel: [20476.577763] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:05:02 juju-e4d256-prod-github-runner-207 kernel: [20476.578894] ? show_regs.part.0+0x23/0x29 Aug 22 11:05:02 juju-e4d256-prod-github-runner-207 kernel: [20476.579913] ? show_regs.cold+0x8/0xd Aug 22 11:05:02 juju-e4d256-prod-github-runner-207 kernel: [20476.580929] ? watchdog_timer_fn+0x1be/0x220 Aug 22 11:05:02 juju-e4d256-prod-github-runner-207 kernel: [20476.582121] ? lockup_detector_update_enable+0x60/0x60 Aug 22 11:05:02 juju-e4d256-prod-github-runner-207 kernel: [20476.583253] ? __hrtimer_run_queues+0x107/0x230 Aug 22 11:05:02 juju-e4d256-prod-github-runner-207 kernel: [20476.584304] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 11:05:02 juju-e4d256-prod-github-runner-207 kernel: [20476.585337] ? hrtimer_interrupt+0x101/0x220 Aug 22 11:05:02 juju-e4d256-prod-github-runner-207 kernel: [20476.586366] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 11:05:02 juju-e4d256-prod-github-runner-207 kernel: [20476.587460] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 11:05:02 juju-e4d256-prod-github-runner-207 kernel: [20476.588518] Aug 22 11:05:02 juju-e4d256-prod-github-runner-207 kernel: [20476.589377] Aug 22 11:05:02 juju-e4d256-prod-github-runner-207 kernel: [20476.590221] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 11:05:02 juju-e4d256-prod-github-runner-207 kernel: [20476.591273] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:05:02 juju-e4d256-prod-github-runner-207 kernel: [20476.592329] ? _raw_spin_lock+0x22/0x30 Aug 22 11:05:02 juju-e4d256-prod-github-runner-207 kernel: [20476.593287] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:05:02 juju-e4d256-prod-github-runner-207 kernel: [20476.594320] direct_page_fault+0x206/0x310 [kvm] Aug 22 11:05:02 juju-e4d256-prod-github-runner-207 kernel: [20476.595373] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 11:05:02 juju-e4d256-prod-github-runner-207 kernel: [20476.596400] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 11:05:02 juju-e4d256-prod-github-runner-207 kernel: [20476.597412] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 11:05:02 juju-e4d256-prod-github-runner-207 kernel: [20476.598422] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 11:05:02 juju-e4d256-prod-github-runner-207 kernel: [20476.599386] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 11:05:02 juju-e4d256-prod-github-runner-207 kernel: [20476.600377] handle_exit+0x98/0x230 [kvm_amd] Aug 22 11:05:02 juju-e4d256-prod-github-runner-207 kernel: [20476.601283] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 11:05:02 juju-e4d256-prod-github-runner-207 kernel: [20476.602209] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 11:05:02 juju-e4d256-prod-github-runner-207 kernel: [20476.603326] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 11:05:02 juju-e4d256-prod-github-runner-207 kernel: [20476.604270] vcpu_run+0x62/0x2c0 [kvm] Aug 22 11:05:02 juju-e4d256-prod-github-runner-207 kernel: [20476.605098] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 11:05:02 juju-e4d256-prod-github-runner-207 kernel: [20476.605920] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 11:05:02 juju-e4d256-prod-github-runner-207 kernel: [20476.606786] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 11:05:02 juju-e4d256-prod-github-runner-207 kernel: [20476.607613] ? __seccomp_filter+0x4a/0x4a0 Aug 22 11:05:02 juju-e4d256-prod-github-runner-207 kernel: [20476.608367] ? __fget_files+0x86/0xc0 Aug 22 11:05:02 juju-e4d256-prod-github-runner-207 kernel: [20476.609085] __x64_sys_ioctl+0x95/0xd0 Aug 22 11:05:02 juju-e4d256-prod-github-runner-207 kernel: [20476.609787] do_syscall_64+0x5c/0xc0 Aug 22 11:05:02 juju-e4d256-prod-github-runner-207 kernel: [20476.610468] ? do_futex+0x162/0x1f0 Aug 22 11:05:02 juju-e4d256-prod-github-runner-207 kernel: [20476.611141] ? __x64_sys_futex+0x78/0x1e0 Aug 22 11:05:02 juju-e4d256-prod-github-runner-207 kernel: [20476.611831] ? __secure_computing+0xa9/0x120 Aug 22 11:05:02 juju-e4d256-prod-github-runner-207 kernel: [20476.612533] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 11:05:02 juju-e4d256-prod-github-runner-207 kernel: [20476.613313] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:05:02 juju-e4d256-prod-github-runner-207 kernel: [20476.614046] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:05:02 juju-e4d256-prod-github-runner-207 kernel: [20476.614779] ? do_syscall_64+0x69/0xc0 Aug 22 11:05:02 juju-e4d256-prod-github-runner-207 kernel: [20476.615450] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:05:02 juju-e4d256-prod-github-runner-207 kernel: [20476.616161] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:05:02 juju-e4d256-prod-github-runner-207 kernel: [20476.616866] ? do_syscall_64+0x69/0xc0 Aug 22 11:05:02 juju-e4d256-prod-github-runner-207 kernel: [20476.617503] ? do_syscall_64+0x69/0xc0 Aug 22 11:05:02 juju-e4d256-prod-github-runner-207 kernel: [20476.618133] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 11:05:02 juju-e4d256-prod-github-runner-207 kernel: [20476.618862] RIP: 0033:0x7faa5d0edaff Aug 22 11:05:02 juju-e4d256-prod-github-runner-207 kernel: [20476.619538] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 11:05:02 juju-e4d256-prod-github-runner-207 kernel: [20476.621603] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 11:05:02 juju-e4d256-prod-github-runner-207 kernel: [20476.622537] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 11:05:02 juju-e4d256-prod-github-runner-207 kernel: [20476.623458] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 11:05:02 juju-e4d256-prod-github-runner-207 kernel: [20476.624367] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 11:05:02 juju-e4d256-prod-github-runner-207 kernel: [20476.625278] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 11:05:02 juju-e4d256-prod-github-runner-207 kernel: [20476.626188] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 11:05:02 juju-e4d256-prod-github-runner-207 kernel: [20476.627113] Aug 22 11:05:30 juju-e4d256-prod-github-runner-207 kernel: [20504.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 18988s! [qemu-system-x86:6715] Aug 22 11:05:30 juju-e4d256-prod-github-runner-207 kernel: [20504.543878] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 11:05:30 juju-e4d256-prod-github-runner-207 kernel: [20504.544189] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 11:05:30 juju-e4d256-prod-github-runner-207 kernel: [20504.556606] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 11:05:30 juju-e4d256-prod-github-runner-207 kernel: [20504.558047] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 11:05:30 juju-e4d256-prod-github-runner-207 kernel: [20504.559315] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:05:30 juju-e4d256-prod-github-runner-207 kernel: [20504.560391] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 11:05:30 juju-e4d256-prod-github-runner-207 kernel: [20504.563026] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 11:05:30 juju-e4d256-prod-github-runner-207 kernel: [20504.564079] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 11:05:30 juju-e4d256-prod-github-runner-207 kernel: [20504.565268] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 11:05:30 juju-e4d256-prod-github-runner-207 kernel: [20504.566451] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 11:05:30 juju-e4d256-prod-github-runner-207 kernel: [20504.567635] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 11:05:30 juju-e4d256-prod-github-runner-207 kernel: [20504.568808] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 11:05:30 juju-e4d256-prod-github-runner-207 kernel: [20504.569989] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 11:05:30 juju-e4d256-prod-github-runner-207 kernel: [20504.571246] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 11:05:30 juju-e4d256-prod-github-runner-207 kernel: [20504.572354] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 11:05:30 juju-e4d256-prod-github-runner-207 kernel: [20504.573575] Call Trace: Aug 22 11:05:30 juju-e4d256-prod-github-runner-207 kernel: [20504.574509] Aug 22 11:05:30 juju-e4d256-prod-github-runner-207 kernel: [20504.575413] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:05:30 juju-e4d256-prod-github-runner-207 kernel: [20504.576446] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:05:30 juju-e4d256-prod-github-runner-207 kernel: [20504.577472] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:05:30 juju-e4d256-prod-github-runner-207 kernel: [20504.578584] ? show_regs.part.0+0x23/0x29 Aug 22 11:05:30 juju-e4d256-prod-github-runner-207 kernel: [20504.579596] ? show_regs.cold+0x8/0xd Aug 22 11:05:30 juju-e4d256-prod-github-runner-207 kernel: [20504.580600] ? watchdog_timer_fn+0x1be/0x220 Aug 22 11:05:30 juju-e4d256-prod-github-runner-207 kernel: [20504.581636] ? lockup_detector_update_enable+0x60/0x60 Aug 22 11:05:30 juju-e4d256-prod-github-runner-207 kernel: [20504.582747] ? __hrtimer_run_queues+0x107/0x230 Aug 22 11:05:30 juju-e4d256-prod-github-runner-207 kernel: [20504.583779] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 11:05:30 juju-e4d256-prod-github-runner-207 kernel: [20504.584805] ? hrtimer_interrupt+0x101/0x220 Aug 22 11:05:30 juju-e4d256-prod-github-runner-207 kernel: [20504.585826] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 11:05:30 juju-e4d256-prod-github-runner-207 kernel: [20504.586909] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 11:05:30 juju-e4d256-prod-github-runner-207 kernel: [20504.587960] Aug 22 11:05:30 juju-e4d256-prod-github-runner-207 kernel: [20504.588817] Aug 22 11:05:30 juju-e4d256-prod-github-runner-207 kernel: [20504.589659] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 11:05:30 juju-e4d256-prod-github-runner-207 kernel: [20504.590712] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:05:30 juju-e4d256-prod-github-runner-207 kernel: [20504.591756] ? _raw_spin_lock+0x22/0x30 Aug 22 11:05:30 juju-e4d256-prod-github-runner-207 kernel: [20504.592707] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:05:30 juju-e4d256-prod-github-runner-207 kernel: [20504.593736] direct_page_fault+0x206/0x310 [kvm] Aug 22 11:05:30 juju-e4d256-prod-github-runner-207 kernel: [20504.594809] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 11:05:30 juju-e4d256-prod-github-runner-207 kernel: [20504.595826] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 11:05:30 juju-e4d256-prod-github-runner-207 kernel: [20504.596837] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 11:05:30 juju-e4d256-prod-github-runner-207 kernel: [20504.597846] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 11:05:30 juju-e4d256-prod-github-runner-207 kernel: [20504.598810] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 11:05:30 juju-e4d256-prod-github-runner-207 kernel: [20504.599796] handle_exit+0x98/0x230 [kvm_amd] Aug 22 11:05:30 juju-e4d256-prod-github-runner-207 kernel: [20504.600691] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 11:05:30 juju-e4d256-prod-github-runner-207 kernel: [20504.601631] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 11:05:30 juju-e4d256-prod-github-runner-207 kernel: [20504.602614] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 11:05:30 juju-e4d256-prod-github-runner-207 kernel: [20504.603519] vcpu_run+0x62/0x2c0 [kvm] Aug 22 11:05:30 juju-e4d256-prod-github-runner-207 kernel: [20504.604331] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 11:05:30 juju-e4d256-prod-github-runner-207 kernel: [20504.605141] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 11:05:30 juju-e4d256-prod-github-runner-207 kernel: [20504.606002] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 11:05:30 juju-e4d256-prod-github-runner-207 kernel: [20504.606832] ? __seccomp_filter+0x4a/0x4a0 Aug 22 11:05:30 juju-e4d256-prod-github-runner-207 kernel: [20504.607617] ? __fget_files+0x86/0xc0 Aug 22 11:05:30 juju-e4d256-prod-github-runner-207 kernel: [20504.608328] __x64_sys_ioctl+0x95/0xd0 Aug 22 11:05:30 juju-e4d256-prod-github-runner-207 kernel: [20504.609038] do_syscall_64+0x5c/0xc0 Aug 22 11:05:30 juju-e4d256-prod-github-runner-207 kernel: [20504.609716] ? do_futex+0x162/0x1f0 Aug 22 11:05:30 juju-e4d256-prod-github-runner-207 kernel: [20504.610373] ? __x64_sys_futex+0x78/0x1e0 Aug 22 11:05:30 juju-e4d256-prod-github-runner-207 kernel: [20504.611063] ? __secure_computing+0xa9/0x120 Aug 22 11:05:30 juju-e4d256-prod-github-runner-207 kernel: [20504.611752] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 11:05:30 juju-e4d256-prod-github-runner-207 kernel: [20504.612516] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:05:30 juju-e4d256-prod-github-runner-207 kernel: [20504.613239] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:05:30 juju-e4d256-prod-github-runner-207 kernel: [20504.613955] ? do_syscall_64+0x69/0xc0 Aug 22 11:05:30 juju-e4d256-prod-github-runner-207 kernel: [20504.614617] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:05:30 juju-e4d256-prod-github-runner-207 kernel: [20504.615319] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:05:30 juju-e4d256-prod-github-runner-207 kernel: [20504.616019] ? do_syscall_64+0x69/0xc0 Aug 22 11:05:30 juju-e4d256-prod-github-runner-207 kernel: [20504.616642] ? do_syscall_64+0x69/0xc0 Aug 22 11:05:30 juju-e4d256-prod-github-runner-207 kernel: [20504.617263] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 11:05:30 juju-e4d256-prod-github-runner-207 kernel: [20504.617971] RIP: 0033:0x7faa5d0edaff Aug 22 11:05:30 juju-e4d256-prod-github-runner-207 kernel: [20504.618653] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 11:05:30 juju-e4d256-prod-github-runner-207 kernel: [20504.620663] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 11:05:30 juju-e4d256-prod-github-runner-207 kernel: [20504.621578] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 11:05:30 juju-e4d256-prod-github-runner-207 kernel: [20504.622462] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 11:05:30 juju-e4d256-prod-github-runner-207 kernel: [20504.623368] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 11:05:30 juju-e4d256-prod-github-runner-207 kernel: [20504.624252] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 11:05:30 juju-e4d256-prod-github-runner-207 kernel: [20504.625141] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 11:05:30 juju-e4d256-prod-github-runner-207 kernel: [20504.626043] Aug 22 11:05:44 juju-e4d256-prod-github-runner-207 kernel: [20518.556706] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 11:05:44 juju-e4d256-prod-github-runner-207 kernel: [20518.557683] rcu: 1-....: (5084415 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=2462272 Aug 22 11:05:44 juju-e4d256-prod-github-runner-207 kernel: [20518.558817] (t=5100339 jiffies g=23269 q=26326) Aug 22 11:05:44 juju-e4d256-prod-github-runner-207 kernel: [20518.559598] NMI backtrace for cpu 1 Aug 22 11:05:44 juju-e4d256-prod-github-runner-207 kernel: [20518.560309] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 11:05:44 juju-e4d256-prod-github-runner-207 kernel: [20518.561418] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 11:05:44 juju-e4d256-prod-github-runner-207 kernel: [20518.562505] Call Trace: Aug 22 11:05:44 juju-e4d256-prod-github-runner-207 kernel: [20518.563184] Aug 22 11:05:44 juju-e4d256-prod-github-runner-207 kernel: [20518.563829] show_stack+0x52/0x5c Aug 22 11:05:44 juju-e4d256-prod-github-runner-207 kernel: [20518.564561] dump_stack_lvl+0x4a/0x63 Aug 22 11:05:44 juju-e4d256-prod-github-runner-207 kernel: [20518.565310] dump_stack+0x10/0x16 Aug 22 11:05:44 juju-e4d256-prod-github-runner-207 kernel: [20518.566030] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 11:05:44 juju-e4d256-prod-github-runner-207 kernel: [20518.566820] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 11:05:44 juju-e4d256-prod-github-runner-207 kernel: [20518.567602] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 11:05:44 juju-e4d256-prod-github-runner-207 kernel: [20518.568424] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 11:05:44 juju-e4d256-prod-github-runner-207 kernel: [20518.569241] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 11:05:44 juju-e4d256-prod-github-runner-207 kernel: [20518.570057] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 11:05:44 juju-e4d256-prod-github-runner-207 kernel: [20518.570847] print_cpu_stall.cold+0x2f/0xe2 Aug 22 11:05:44 juju-e4d256-prod-github-runner-207 kernel: [20518.571615] ? timekeeping_update+0xf7/0x150 Aug 22 11:05:44 juju-e4d256-prod-github-runner-207 kernel: [20518.572388] check_cpu_stall+0x109/0x270 Aug 22 11:05:44 juju-e4d256-prod-github-runner-207 kernel: [20518.573134] rcu_sched_clock_irq+0x9a/0x250 Aug 22 11:05:44 juju-e4d256-prod-github-runner-207 kernel: [20518.573898] update_process_times+0x94/0xd0 Aug 22 11:05:44 juju-e4d256-prod-github-runner-207 kernel: [20518.574668] tick_sched_handle+0x29/0x70 Aug 22 11:05:44 juju-e4d256-prod-github-runner-207 kernel: [20518.575422] tick_sched_timer+0x8c/0xc0 Aug 22 11:05:44 juju-e4d256-prod-github-runner-207 kernel: [20518.576161] ? tick_nohz_handler+0xb0/0xb0 Aug 22 11:05:44 juju-e4d256-prod-github-runner-207 kernel: [20518.576983] __hrtimer_run_queues+0x107/0x230 Aug 22 11:05:44 juju-e4d256-prod-github-runner-207 kernel: [20518.577764] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 11:05:44 juju-e4d256-prod-github-runner-207 kernel: [20518.578557] hrtimer_interrupt+0x101/0x220 Aug 22 11:05:44 juju-e4d256-prod-github-runner-207 kernel: [20518.579322] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 11:05:44 juju-e4d256-prod-github-runner-207 kernel: [20518.580146] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 11:05:44 juju-e4d256-prod-github-runner-207 kernel: [20518.581122] Aug 22 11:05:44 juju-e4d256-prod-github-runner-207 kernel: [20518.581763] Aug 22 11:05:44 juju-e4d256-prod-github-runner-207 kernel: [20518.582409] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 11:05:44 juju-e4d256-prod-github-runner-207 kernel: [20518.583230] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:05:44 juju-e4d256-prod-github-runner-207 kernel: [20518.584109] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 11:05:44 juju-e4d256-prod-github-runner-207 kernel: [20518.586321] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 11:05:44 juju-e4d256-prod-github-runner-207 kernel: [20518.587202] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 11:05:44 juju-e4d256-prod-github-runner-207 kernel: [20518.588197] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 11:05:44 juju-e4d256-prod-github-runner-207 kernel: [20518.589173] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 11:05:44 juju-e4d256-prod-github-runner-207 kernel: [20518.590141] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 11:05:44 juju-e4d256-prod-github-runner-207 kernel: [20518.591129] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 11:05:44 juju-e4d256-prod-github-runner-207 kernel: [20518.592092] ? _raw_spin_lock+0x22/0x30 Aug 22 11:05:44 juju-e4d256-prod-github-runner-207 kernel: [20518.592857] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:05:44 juju-e4d256-prod-github-runner-207 kernel: [20518.593805] direct_page_fault+0x206/0x310 [kvm] Aug 22 11:05:44 juju-e4d256-prod-github-runner-207 kernel: [20518.594754] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 11:05:44 juju-e4d256-prod-github-runner-207 kernel: [20518.595672] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 11:05:44 juju-e4d256-prod-github-runner-207 kernel: [20518.596591] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 11:05:44 juju-e4d256-prod-github-runner-207 kernel: [20518.597488] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 11:05:44 juju-e4d256-prod-github-runner-207 kernel: [20518.598379] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 11:05:44 juju-e4d256-prod-github-runner-207 kernel: [20518.599305] handle_exit+0x98/0x230 [kvm_amd] Aug 22 11:05:44 juju-e4d256-prod-github-runner-207 kernel: [20518.600150] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 11:05:44 juju-e4d256-prod-github-runner-207 kernel: [20518.601025] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 11:05:44 juju-e4d256-prod-github-runner-207 kernel: [20518.601925] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 11:05:44 juju-e4d256-prod-github-runner-207 kernel: [20518.602820] vcpu_run+0x62/0x2c0 [kvm] Aug 22 11:05:44 juju-e4d256-prod-github-runner-207 kernel: [20518.603612] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 11:05:44 juju-e4d256-prod-github-runner-207 kernel: [20518.604431] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 11:05:44 juju-e4d256-prod-github-runner-207 kernel: [20518.605332] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 11:05:44 juju-e4d256-prod-github-runner-207 kernel: [20518.606360] ? __seccomp_filter+0x4a/0x4a0 Aug 22 11:05:44 juju-e4d256-prod-github-runner-207 kernel: [20518.607174] ? __fget_files+0x86/0xc0 Aug 22 11:05:44 juju-e4d256-prod-github-runner-207 kernel: [20518.607937] __x64_sys_ioctl+0x95/0xd0 Aug 22 11:05:44 juju-e4d256-prod-github-runner-207 kernel: [20518.608716] do_syscall_64+0x5c/0xc0 Aug 22 11:05:44 juju-e4d256-prod-github-runner-207 kernel: [20518.609469] ? do_futex+0x162/0x1f0 Aug 22 11:05:44 juju-e4d256-prod-github-runner-207 kernel: [20518.610216] ? __x64_sys_futex+0x78/0x1e0 Aug 22 11:05:44 juju-e4d256-prod-github-runner-207 kernel: [20518.611013] ? __secure_computing+0xa9/0x120 Aug 22 11:05:44 juju-e4d256-prod-github-runner-207 kernel: [20518.611824] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 11:05:44 juju-e4d256-prod-github-runner-207 kernel: [20518.612718] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:05:44 juju-e4d256-prod-github-runner-207 kernel: [20518.613562] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:05:44 juju-e4d256-prod-github-runner-207 kernel: [20518.614426] ? do_syscall_64+0x69/0xc0 Aug 22 11:05:44 juju-e4d256-prod-github-runner-207 kernel: [20518.615195] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:05:44 juju-e4d256-prod-github-runner-207 kernel: [20518.616047] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:05:44 juju-e4d256-prod-github-runner-207 kernel: [20518.616906] ? do_syscall_64+0x69/0xc0 Aug 22 11:05:44 juju-e4d256-prod-github-runner-207 kernel: [20518.617681] ? do_syscall_64+0x69/0xc0 Aug 22 11:05:44 juju-e4d256-prod-github-runner-207 kernel: [20518.618466] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 11:05:44 juju-e4d256-prod-github-runner-207 kernel: [20518.619334] RIP: 0033:0x7faa5d0edaff Aug 22 11:05:44 juju-e4d256-prod-github-runner-207 kernel: [20518.620110] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 11:05:44 juju-e4d256-prod-github-runner-207 kernel: [20518.622565] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 11:05:44 juju-e4d256-prod-github-runner-207 kernel: [20518.623664] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 11:05:44 juju-e4d256-prod-github-runner-207 kernel: [20518.624746] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 11:05:44 juju-e4d256-prod-github-runner-207 kernel: [20518.625822] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 11:05:44 juju-e4d256-prod-github-runner-207 kernel: [20518.626910] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 11:05:44 juju-e4d256-prod-github-runner-207 kernel: [20518.627968] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 11:05:44 juju-e4d256-prod-github-runner-207 kernel: [20518.629023] Aug 22 11:06:10 juju-e4d256-prod-github-runner-207 kernel: [20544.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 19025s! [qemu-system-x86:6715] Aug 22 11:06:10 juju-e4d256-prod-github-runner-207 kernel: [20544.544056] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 11:06:10 juju-e4d256-prod-github-runner-207 kernel: [20544.544373] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 11:06:10 juju-e4d256-prod-github-runner-207 kernel: [20544.559281] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 11:06:10 juju-e4d256-prod-github-runner-207 kernel: [20544.560778] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 11:06:10 juju-e4d256-prod-github-runner-207 kernel: [20544.562060] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:06:10 juju-e4d256-prod-github-runner-207 kernel: [20544.563175] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 11:06:10 juju-e4d256-prod-github-runner-207 kernel: [20544.565745] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 11:06:10 juju-e4d256-prod-github-runner-207 kernel: [20544.566817] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 11:06:10 juju-e4d256-prod-github-runner-207 kernel: [20544.568050] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 11:06:10 juju-e4d256-prod-github-runner-207 kernel: [20544.569265] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 11:06:10 juju-e4d256-prod-github-runner-207 kernel: [20544.570454] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 11:06:10 juju-e4d256-prod-github-runner-207 kernel: [20544.571618] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 11:06:10 juju-e4d256-prod-github-runner-207 kernel: [20544.572783] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 11:06:10 juju-e4d256-prod-github-runner-207 kernel: [20544.574076] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 11:06:10 juju-e4d256-prod-github-runner-207 kernel: [20544.575215] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 11:06:10 juju-e4d256-prod-github-runner-207 kernel: [20544.576415] Call Trace: Aug 22 11:06:10 juju-e4d256-prod-github-runner-207 kernel: [20544.577332] Aug 22 11:06:10 juju-e4d256-prod-github-runner-207 kernel: [20544.578263] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:06:10 juju-e4d256-prod-github-runner-207 kernel: [20544.579301] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:06:10 juju-e4d256-prod-github-runner-207 kernel: [20544.580345] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:06:10 juju-e4d256-prod-github-runner-207 kernel: [20544.581548] ? show_regs.part.0+0x23/0x29 Aug 22 11:06:10 juju-e4d256-prod-github-runner-207 kernel: [20544.582604] ? show_regs.cold+0x8/0xd Aug 22 11:06:10 juju-e4d256-prod-github-runner-207 kernel: [20544.583590] ? watchdog_timer_fn+0x1be/0x220 Aug 22 11:06:10 juju-e4d256-prod-github-runner-207 kernel: [20544.584608] ? lockup_detector_update_enable+0x60/0x60 Aug 22 11:06:10 juju-e4d256-prod-github-runner-207 kernel: [20544.585684] ? __hrtimer_run_queues+0x107/0x230 Aug 22 11:06:10 juju-e4d256-prod-github-runner-207 kernel: [20544.586769] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 11:06:10 juju-e4d256-prod-github-runner-207 kernel: [20544.587839] ? hrtimer_interrupt+0x101/0x220 Aug 22 11:06:10 juju-e4d256-prod-github-runner-207 kernel: [20544.588918] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 11:06:10 juju-e4d256-prod-github-runner-207 kernel: [20544.590067] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 11:06:10 juju-e4d256-prod-github-runner-207 kernel: [20544.591143] Aug 22 11:06:10 juju-e4d256-prod-github-runner-207 kernel: [20544.592065] Aug 22 11:06:10 juju-e4d256-prod-github-runner-207 kernel: [20544.592923] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 11:06:10 juju-e4d256-prod-github-runner-207 kernel: [20544.593983] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:06:10 juju-e4d256-prod-github-runner-207 kernel: [20544.595066] ? _raw_spin_lock+0x22/0x30 Aug 22 11:06:10 juju-e4d256-prod-github-runner-207 kernel: [20544.596026] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:06:10 juju-e4d256-prod-github-runner-207 kernel: [20544.597071] direct_page_fault+0x206/0x310 [kvm] Aug 22 11:06:10 juju-e4d256-prod-github-runner-207 kernel: [20544.598126] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 11:06:10 juju-e4d256-prod-github-runner-207 kernel: [20544.599150] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 11:06:10 juju-e4d256-prod-github-runner-207 kernel: [20544.600160] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 11:06:10 juju-e4d256-prod-github-runner-207 kernel: [20544.601189] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 11:06:10 juju-e4d256-prod-github-runner-207 kernel: [20544.602266] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 11:06:10 juju-e4d256-prod-github-runner-207 kernel: [20544.603271] handle_exit+0x98/0x230 [kvm_amd] Aug 22 11:06:10 juju-e4d256-prod-github-runner-207 kernel: [20544.604239] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 11:06:10 juju-e4d256-prod-github-runner-207 kernel: [20544.605179] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 11:06:10 juju-e4d256-prod-github-runner-207 kernel: [20544.606135] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 11:06:10 juju-e4d256-prod-github-runner-207 kernel: [20544.607045] vcpu_run+0x62/0x2c0 [kvm] Aug 22 11:06:10 juju-e4d256-prod-github-runner-207 kernel: [20544.607861] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 11:06:10 juju-e4d256-prod-github-runner-207 kernel: [20544.608680] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 11:06:10 juju-e4d256-prod-github-runner-207 kernel: [20544.609553] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 11:06:10 juju-e4d256-prod-github-runner-207 kernel: [20544.610426] ? __seccomp_filter+0x4a/0x4a0 Aug 22 11:06:10 juju-e4d256-prod-github-runner-207 kernel: [20544.611213] ? __fget_files+0x86/0xc0 Aug 22 11:06:10 juju-e4d256-prod-github-runner-207 kernel: [20544.611921] __x64_sys_ioctl+0x95/0xd0 Aug 22 11:06:10 juju-e4d256-prod-github-runner-207 kernel: [20544.612647] do_syscall_64+0x5c/0xc0 Aug 22 11:06:10 juju-e4d256-prod-github-runner-207 kernel: [20544.613326] ? do_futex+0x162/0x1f0 Aug 22 11:06:10 juju-e4d256-prod-github-runner-207 kernel: [20544.613978] ? __x64_sys_futex+0x78/0x1e0 Aug 22 11:06:10 juju-e4d256-prod-github-runner-207 kernel: [20544.614728] ? __secure_computing+0xa9/0x120 Aug 22 11:06:10 juju-e4d256-prod-github-runner-207 kernel: [20544.615453] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 11:06:10 juju-e4d256-prod-github-runner-207 kernel: [20544.616222] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:06:10 juju-e4d256-prod-github-runner-207 kernel: [20544.616946] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:06:10 juju-e4d256-prod-github-runner-207 kernel: [20544.617692] ? do_syscall_64+0x69/0xc0 Aug 22 11:06:10 juju-e4d256-prod-github-runner-207 kernel: [20544.618365] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:06:10 juju-e4d256-prod-github-runner-207 kernel: [20544.619077] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:06:10 juju-e4d256-prod-github-runner-207 kernel: [20544.619772] ? do_syscall_64+0x69/0xc0 Aug 22 11:06:10 juju-e4d256-prod-github-runner-207 kernel: [20544.620398] ? do_syscall_64+0x69/0xc0 Aug 22 11:06:10 juju-e4d256-prod-github-runner-207 kernel: [20544.621022] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 11:06:10 juju-e4d256-prod-github-runner-207 kernel: [20544.621737] RIP: 0033:0x7faa5d0edaff Aug 22 11:06:10 juju-e4d256-prod-github-runner-207 kernel: [20544.622506] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 11:06:10 juju-e4d256-prod-github-runner-207 kernel: [20544.624978] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 11:06:10 juju-e4d256-prod-github-runner-207 kernel: [20544.626228] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 11:06:10 juju-e4d256-prod-github-runner-207 kernel: [20544.627321] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 11:06:10 juju-e4d256-prod-github-runner-207 kernel: [20544.628258] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 11:06:10 juju-e4d256-prod-github-runner-207 kernel: [20544.629181] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 11:06:10 juju-e4d256-prod-github-runner-207 kernel: [20544.630133] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 11:06:10 juju-e4d256-prod-github-runner-207 kernel: [20544.631096] Aug 22 11:06:38 juju-e4d256-prod-github-runner-207 kernel: [20572.541981] watchdog: BUG: soft lockup - CPU#1 stuck for 19051s! [qemu-system-x86:6715] Aug 22 11:06:38 juju-e4d256-prod-github-runner-207 kernel: [20572.543940] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 11:06:38 juju-e4d256-prod-github-runner-207 kernel: [20572.544283] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 11:06:38 juju-e4d256-prod-github-runner-207 kernel: [20572.557966] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 11:06:38 juju-e4d256-prod-github-runner-207 kernel: [20572.559274] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 11:06:38 juju-e4d256-prod-github-runner-207 kernel: [20572.560534] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:06:38 juju-e4d256-prod-github-runner-207 kernel: [20572.561618] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 11:06:38 juju-e4d256-prod-github-runner-207 kernel: [20572.564232] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 11:06:38 juju-e4d256-prod-github-runner-207 kernel: [20572.565323] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 11:06:38 juju-e4d256-prod-github-runner-207 kernel: [20572.566619] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 11:06:38 juju-e4d256-prod-github-runner-207 kernel: [20572.567826] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 11:06:38 juju-e4d256-prod-github-runner-207 kernel: [20572.569026] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 11:06:38 juju-e4d256-prod-github-runner-207 kernel: [20572.570260] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 11:06:38 juju-e4d256-prod-github-runner-207 kernel: [20572.571749] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 11:06:38 juju-e4d256-prod-github-runner-207 kernel: [20572.573441] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 11:06:38 juju-e4d256-prod-github-runner-207 kernel: [20572.574931] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 11:06:38 juju-e4d256-prod-github-runner-207 kernel: [20572.576519] Call Trace: Aug 22 11:06:38 juju-e4d256-prod-github-runner-207 kernel: [20572.577753] Aug 22 11:06:38 juju-e4d256-prod-github-runner-207 kernel: [20572.578962] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:06:38 juju-e4d256-prod-github-runner-207 kernel: [20572.580366] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:06:38 juju-e4d256-prod-github-runner-207 kernel: [20572.581810] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:06:38 juju-e4d256-prod-github-runner-207 kernel: [20572.583132] ? show_regs.part.0+0x23/0x29 Aug 22 11:06:38 juju-e4d256-prod-github-runner-207 kernel: [20572.584590] ? show_regs.cold+0x8/0xd Aug 22 11:06:38 juju-e4d256-prod-github-runner-207 kernel: [20572.585935] ? watchdog_timer_fn+0x1be/0x220 Aug 22 11:06:38 juju-e4d256-prod-github-runner-207 kernel: [20572.587339] ? lockup_detector_update_enable+0x60/0x60 Aug 22 11:06:38 juju-e4d256-prod-github-runner-207 kernel: [20572.588789] ? __hrtimer_run_queues+0x107/0x230 Aug 22 11:06:38 juju-e4d256-prod-github-runner-207 kernel: [20572.590245] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 11:06:38 juju-e4d256-prod-github-runner-207 kernel: [20572.591617] ? hrtimer_interrupt+0x101/0x220 Aug 22 11:06:38 juju-e4d256-prod-github-runner-207 kernel: [20572.593020] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 11:06:38 juju-e4d256-prod-github-runner-207 kernel: [20572.594481] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 11:06:38 juju-e4d256-prod-github-runner-207 kernel: [20572.595905] Aug 22 11:06:38 juju-e4d256-prod-github-runner-207 kernel: [20572.597082] Aug 22 11:06:38 juju-e4d256-prod-github-runner-207 kernel: [20572.598221] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 11:06:38 juju-e4d256-prod-github-runner-207 kernel: [20572.599495] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:06:38 juju-e4d256-prod-github-runner-207 kernel: [20572.600879] ? _raw_spin_lock+0x22/0x30 Aug 22 11:06:38 juju-e4d256-prod-github-runner-207 kernel: [20572.602190] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:06:38 juju-e4d256-prod-github-runner-207 kernel: [20572.603578] direct_page_fault+0x206/0x310 [kvm] Aug 22 11:06:38 juju-e4d256-prod-github-runner-207 kernel: [20572.604977] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 11:06:38 juju-e4d256-prod-github-runner-207 kernel: [20572.606404] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 11:06:38 juju-e4d256-prod-github-runner-207 kernel: [20572.607617] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 11:06:38 juju-e4d256-prod-github-runner-207 kernel: [20572.608915] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 11:06:38 juju-e4d256-prod-github-runner-207 kernel: [20572.610214] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 11:06:38 juju-e4d256-prod-github-runner-207 kernel: [20572.611538] handle_exit+0x98/0x230 [kvm_amd] Aug 22 11:06:38 juju-e4d256-prod-github-runner-207 kernel: [20572.612780] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 11:06:38 juju-e4d256-prod-github-runner-207 kernel: [20572.614403] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 11:06:38 juju-e4d256-prod-github-runner-207 kernel: [20572.615494] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 11:06:38 juju-e4d256-prod-github-runner-207 kernel: [20572.616696] vcpu_run+0x62/0x2c0 [kvm] Aug 22 11:06:38 juju-e4d256-prod-github-runner-207 kernel: [20572.617822] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 11:06:38 juju-e4d256-prod-github-runner-207 kernel: [20572.618944] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 11:06:38 juju-e4d256-prod-github-runner-207 kernel: [20572.620106] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 11:06:38 juju-e4d256-prod-github-runner-207 kernel: [20572.621213] ? __seccomp_filter+0x4a/0x4a0 Aug 22 11:06:38 juju-e4d256-prod-github-runner-207 kernel: [20572.622259] ? __fget_files+0x86/0xc0 Aug 22 11:06:38 juju-e4d256-prod-github-runner-207 kernel: [20572.623236] __x64_sys_ioctl+0x95/0xd0 Aug 22 11:06:38 juju-e4d256-prod-github-runner-207 kernel: [20572.624180] do_syscall_64+0x5c/0xc0 Aug 22 11:06:38 juju-e4d256-prod-github-runner-207 kernel: [20572.625092] ? do_futex+0x162/0x1f0 Aug 22 11:06:38 juju-e4d256-prod-github-runner-207 kernel: [20572.626008] ? __x64_sys_futex+0x78/0x1e0 Aug 22 11:06:38 juju-e4d256-prod-github-runner-207 kernel: [20572.626933] ? __secure_computing+0xa9/0x120 Aug 22 11:06:38 juju-e4d256-prod-github-runner-207 kernel: [20572.627893] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 11:06:38 juju-e4d256-prod-github-runner-207 kernel: [20572.628961] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:06:38 juju-e4d256-prod-github-runner-207 kernel: [20572.629990] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:06:38 juju-e4d256-prod-github-runner-207 kernel: [20572.630978] ? do_syscall_64+0x69/0xc0 Aug 22 11:06:38 juju-e4d256-prod-github-runner-207 kernel: [20572.631880] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:06:38 juju-e4d256-prod-github-runner-207 kernel: [20572.632697] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:06:38 juju-e4d256-prod-github-runner-207 kernel: [20572.633597] ? do_syscall_64+0x69/0xc0 Aug 22 11:06:38 juju-e4d256-prod-github-runner-207 kernel: [20572.635643] ? do_syscall_64+0x69/0xc0 Aug 22 11:06:38 juju-e4d256-prod-github-runner-207 kernel: [20572.636487] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 11:06:38 juju-e4d256-prod-github-runner-207 kernel: [20572.637433] RIP: 0033:0x7faa5d0edaff Aug 22 11:06:38 juju-e4d256-prod-github-runner-207 kernel: [20572.638273] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 11:06:38 juju-e4d256-prod-github-runner-207 kernel: [20572.640284] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 11:06:38 juju-e4d256-prod-github-runner-207 kernel: [20572.641219] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 11:06:38 juju-e4d256-prod-github-runner-207 kernel: [20572.642146] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 11:06:38 juju-e4d256-prod-github-runner-207 kernel: [20572.643222] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 11:06:38 juju-e4d256-prod-github-runner-207 kernel: [20572.644351] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 11:06:38 juju-e4d256-prod-github-runner-207 kernel: [20572.645503] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 11:06:38 juju-e4d256-prod-github-runner-207 kernel: [20572.646481] Aug 22 11:07:06 juju-e4d256-prod-github-runner-207 kernel: [20600.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 19077s! [qemu-system-x86:6715] Aug 22 11:07:06 juju-e4d256-prod-github-runner-207 kernel: [20600.543190] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 11:07:06 juju-e4d256-prod-github-runner-207 kernel: [20600.543265] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 11:07:06 juju-e4d256-prod-github-runner-207 kernel: [20600.555647] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 11:07:06 juju-e4d256-prod-github-runner-207 kernel: [20600.556916] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 11:07:06 juju-e4d256-prod-github-runner-207 kernel: [20600.558153] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:07:06 juju-e4d256-prod-github-runner-207 kernel: [20600.559210] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 11:07:06 juju-e4d256-prod-github-runner-207 kernel: [20600.561768] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 11:07:06 juju-e4d256-prod-github-runner-207 kernel: [20600.562816] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 11:07:06 juju-e4d256-prod-github-runner-207 kernel: [20600.564011] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 11:07:06 juju-e4d256-prod-github-runner-207 kernel: [20600.565185] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 11:07:06 juju-e4d256-prod-github-runner-207 kernel: [20600.566387] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 11:07:06 juju-e4d256-prod-github-runner-207 kernel: [20600.567555] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 11:07:06 juju-e4d256-prod-github-runner-207 kernel: [20600.568721] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 11:07:06 juju-e4d256-prod-github-runner-207 kernel: [20600.569975] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 11:07:06 juju-e4d256-prod-github-runner-207 kernel: [20600.571079] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 11:07:06 juju-e4d256-prod-github-runner-207 kernel: [20600.572274] Call Trace: Aug 22 11:07:06 juju-e4d256-prod-github-runner-207 kernel: [20600.573187] Aug 22 11:07:06 juju-e4d256-prod-github-runner-207 kernel: [20600.574112] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:07:06 juju-e4d256-prod-github-runner-207 kernel: [20600.575192] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:07:06 juju-e4d256-prod-github-runner-207 kernel: [20600.576235] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:07:06 juju-e4d256-prod-github-runner-207 kernel: [20600.577313] ? show_regs.part.0+0x23/0x29 Aug 22 11:07:06 juju-e4d256-prod-github-runner-207 kernel: [20600.578329] ? show_regs.cold+0x8/0xd Aug 22 11:07:06 juju-e4d256-prod-github-runner-207 kernel: [20600.579305] ? watchdog_timer_fn+0x1be/0x220 Aug 22 11:07:06 juju-e4d256-prod-github-runner-207 kernel: [20600.580389] ? lockup_detector_update_enable+0x60/0x60 Aug 22 11:07:06 juju-e4d256-prod-github-runner-207 kernel: [20600.581617] ? __hrtimer_run_queues+0x107/0x230 Aug 22 11:07:06 juju-e4d256-prod-github-runner-207 kernel: [20600.582658] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 11:07:06 juju-e4d256-prod-github-runner-207 kernel: [20600.583688] ? hrtimer_interrupt+0x101/0x220 Aug 22 11:07:06 juju-e4d256-prod-github-runner-207 kernel: [20600.584715] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 11:07:06 juju-e4d256-prod-github-runner-207 kernel: [20600.585802] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 11:07:06 juju-e4d256-prod-github-runner-207 kernel: [20600.586852] Aug 22 11:07:06 juju-e4d256-prod-github-runner-207 kernel: [20600.587707] Aug 22 11:07:06 juju-e4d256-prod-github-runner-207 kernel: [20600.588553] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 11:07:06 juju-e4d256-prod-github-runner-207 kernel: [20600.589606] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:07:06 juju-e4d256-prod-github-runner-207 kernel: [20600.590653] ? _raw_spin_lock+0x22/0x30 Aug 22 11:07:06 juju-e4d256-prod-github-runner-207 kernel: [20600.591601] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:07:06 juju-e4d256-prod-github-runner-207 kernel: [20600.592621] direct_page_fault+0x206/0x310 [kvm] Aug 22 11:07:06 juju-e4d256-prod-github-runner-207 kernel: [20600.593715] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 11:07:06 juju-e4d256-prod-github-runner-207 kernel: [20600.594768] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 11:07:06 juju-e4d256-prod-github-runner-207 kernel: [20600.595774] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 11:07:06 juju-e4d256-prod-github-runner-207 kernel: [20600.596749] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 11:07:06 juju-e4d256-prod-github-runner-207 kernel: [20600.597716] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 11:07:06 juju-e4d256-prod-github-runner-207 kernel: [20600.598694] handle_exit+0x98/0x230 [kvm_amd] Aug 22 11:07:06 juju-e4d256-prod-github-runner-207 kernel: [20600.599587] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 11:07:06 juju-e4d256-prod-github-runner-207 kernel: [20600.600500] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 11:07:06 juju-e4d256-prod-github-runner-207 kernel: [20600.601443] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 11:07:06 juju-e4d256-prod-github-runner-207 kernel: [20600.602348] vcpu_run+0x62/0x2c0 [kvm] Aug 22 11:07:06 juju-e4d256-prod-github-runner-207 kernel: [20600.603159] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 11:07:06 juju-e4d256-prod-github-runner-207 kernel: [20600.603973] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 11:07:06 juju-e4d256-prod-github-runner-207 kernel: [20600.604827] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 11:07:06 juju-e4d256-prod-github-runner-207 kernel: [20600.605694] ? __seccomp_filter+0x4a/0x4a0 Aug 22 11:07:06 juju-e4d256-prod-github-runner-207 kernel: [20600.606446] ? __fget_files+0x86/0xc0 Aug 22 11:07:06 juju-e4d256-prod-github-runner-207 kernel: [20600.607186] __x64_sys_ioctl+0x95/0xd0 Aug 22 11:07:06 juju-e4d256-prod-github-runner-207 kernel: [20600.607925] do_syscall_64+0x5c/0xc0 Aug 22 11:07:06 juju-e4d256-prod-github-runner-207 kernel: [20600.608591] ? do_futex+0x162/0x1f0 Aug 22 11:07:06 juju-e4d256-prod-github-runner-207 kernel: [20600.609240] ? __x64_sys_futex+0x78/0x1e0 Aug 22 11:07:06 juju-e4d256-prod-github-runner-207 kernel: [20600.609943] ? __secure_computing+0xa9/0x120 Aug 22 11:07:06 juju-e4d256-prod-github-runner-207 kernel: [20600.610710] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 11:07:06 juju-e4d256-prod-github-runner-207 kernel: [20600.611469] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:07:06 juju-e4d256-prod-github-runner-207 kernel: [20600.612191] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:07:06 juju-e4d256-prod-github-runner-207 kernel: [20600.612914] ? do_syscall_64+0x69/0xc0 Aug 22 11:07:06 juju-e4d256-prod-github-runner-207 kernel: [20600.613579] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:07:06 juju-e4d256-prod-github-runner-207 kernel: [20600.614284] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:07:06 juju-e4d256-prod-github-runner-207 kernel: [20600.614985] ? do_syscall_64+0x69/0xc0 Aug 22 11:07:06 juju-e4d256-prod-github-runner-207 kernel: [20600.615615] ? do_syscall_64+0x69/0xc0 Aug 22 11:07:06 juju-e4d256-prod-github-runner-207 kernel: [20600.616242] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 11:07:06 juju-e4d256-prod-github-runner-207 kernel: [20600.616972] RIP: 0033:0x7faa5d0edaff Aug 22 11:07:06 juju-e4d256-prod-github-runner-207 kernel: [20600.617618] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 11:07:06 juju-e4d256-prod-github-runner-207 kernel: [20600.619753] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 11:07:06 juju-e4d256-prod-github-runner-207 kernel: [20600.620677] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 11:07:06 juju-e4d256-prod-github-runner-207 kernel: [20600.621592] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 11:07:06 juju-e4d256-prod-github-runner-207 kernel: [20600.622494] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 11:07:06 juju-e4d256-prod-github-runner-207 kernel: [20600.623428] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 11:07:06 juju-e4d256-prod-github-runner-207 kernel: [20600.624324] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 11:07:06 juju-e4d256-prod-github-runner-207 kernel: [20600.625222] Aug 22 11:07:34 juju-e4d256-prod-github-runner-207 kernel: [20628.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 19103s! [qemu-system-x86:6715] Aug 22 11:07:34 juju-e4d256-prod-github-runner-207 kernel: [20628.543878] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 11:07:34 juju-e4d256-prod-github-runner-207 kernel: [20628.544165] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 11:07:34 juju-e4d256-prod-github-runner-207 kernel: [20628.556308] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 11:07:34 juju-e4d256-prod-github-runner-207 kernel: [20628.557597] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 11:07:34 juju-e4d256-prod-github-runner-207 kernel: [20628.558891] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:07:34 juju-e4d256-prod-github-runner-207 kernel: [20628.559946] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 11:07:34 juju-e4d256-prod-github-runner-207 kernel: [20628.562492] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 11:07:34 juju-e4d256-prod-github-runner-207 kernel: [20628.563545] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 11:07:34 juju-e4d256-prod-github-runner-207 kernel: [20628.564730] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 11:07:34 juju-e4d256-prod-github-runner-207 kernel: [20628.565930] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 11:07:34 juju-e4d256-prod-github-runner-207 kernel: [20628.567094] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 11:07:34 juju-e4d256-prod-github-runner-207 kernel: [20628.568277] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 11:07:34 juju-e4d256-prod-github-runner-207 kernel: [20628.569467] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 11:07:34 juju-e4d256-prod-github-runner-207 kernel: [20628.570777] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 11:07:34 juju-e4d256-prod-github-runner-207 kernel: [20628.571984] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 11:07:34 juju-e4d256-prod-github-runner-207 kernel: [20628.573194] Call Trace: Aug 22 11:07:34 juju-e4d256-prod-github-runner-207 kernel: [20628.574117] Aug 22 11:07:34 juju-e4d256-prod-github-runner-207 kernel: [20628.575020] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:07:34 juju-e4d256-prod-github-runner-207 kernel: [20628.576064] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:07:34 juju-e4d256-prod-github-runner-207 kernel: [20628.577123] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:07:34 juju-e4d256-prod-github-runner-207 kernel: [20628.578242] ? show_regs.part.0+0x23/0x29 Aug 22 11:07:34 juju-e4d256-prod-github-runner-207 kernel: [20628.579282] ? show_regs.cold+0x8/0xd Aug 22 11:07:34 juju-e4d256-prod-github-runner-207 kernel: [20628.580281] ? watchdog_timer_fn+0x1be/0x220 Aug 22 11:07:34 juju-e4d256-prod-github-runner-207 kernel: [20628.581309] ? lockup_detector_update_enable+0x60/0x60 Aug 22 11:07:34 juju-e4d256-prod-github-runner-207 kernel: [20628.582403] ? __hrtimer_run_queues+0x107/0x230 Aug 22 11:07:34 juju-e4d256-prod-github-runner-207 kernel: [20628.583436] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 11:07:34 juju-e4d256-prod-github-runner-207 kernel: [20628.584459] ? hrtimer_interrupt+0x101/0x220 Aug 22 11:07:34 juju-e4d256-prod-github-runner-207 kernel: [20628.585500] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 11:07:34 juju-e4d256-prod-github-runner-207 kernel: [20628.586577] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 11:07:34 juju-e4d256-prod-github-runner-207 kernel: [20628.587631] Aug 22 11:07:34 juju-e4d256-prod-github-runner-207 kernel: [20628.588485] Aug 22 11:07:34 juju-e4d256-prod-github-runner-207 kernel: [20628.589337] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 11:07:34 juju-e4d256-prod-github-runner-207 kernel: [20628.590384] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:07:34 juju-e4d256-prod-github-runner-207 kernel: [20628.591422] ? _raw_spin_lock+0x22/0x30 Aug 22 11:07:34 juju-e4d256-prod-github-runner-207 kernel: [20628.592364] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:07:34 juju-e4d256-prod-github-runner-207 kernel: [20628.593397] direct_page_fault+0x206/0x310 [kvm] Aug 22 11:07:34 juju-e4d256-prod-github-runner-207 kernel: [20628.594423] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 11:07:34 juju-e4d256-prod-github-runner-207 kernel: [20628.595469] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 11:07:34 juju-e4d256-prod-github-runner-207 kernel: [20628.596496] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 11:07:34 juju-e4d256-prod-github-runner-207 kernel: [20628.597513] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 11:07:34 juju-e4d256-prod-github-runner-207 kernel: [20628.598459] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 11:07:34 juju-e4d256-prod-github-runner-207 kernel: [20628.599443] handle_exit+0x98/0x230 [kvm_amd] Aug 22 11:07:34 juju-e4d256-prod-github-runner-207 kernel: [20628.600344] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 11:07:34 juju-e4d256-prod-github-runner-207 kernel: [20628.601287] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 11:07:34 juju-e4d256-prod-github-runner-207 kernel: [20628.602213] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 11:07:34 juju-e4d256-prod-github-runner-207 kernel: [20628.603113] vcpu_run+0x62/0x2c0 [kvm] Aug 22 11:07:34 juju-e4d256-prod-github-runner-207 kernel: [20628.603924] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 11:07:34 juju-e4d256-prod-github-runner-207 kernel: [20628.604746] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 11:07:34 juju-e4d256-prod-github-runner-207 kernel: [20628.605630] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 11:07:34 juju-e4d256-prod-github-runner-207 kernel: [20628.606427] ? __seccomp_filter+0x4a/0x4a0 Aug 22 11:07:34 juju-e4d256-prod-github-runner-207 kernel: [20628.607167] ? __fget_files+0x86/0xc0 Aug 22 11:07:34 juju-e4d256-prod-github-runner-207 kernel: [20628.608035] __x64_sys_ioctl+0x95/0xd0 Aug 22 11:07:34 juju-e4d256-prod-github-runner-207 kernel: [20628.608729] do_syscall_64+0x5c/0xc0 Aug 22 11:07:34 juju-e4d256-prod-github-runner-207 kernel: [20628.609401] ? do_futex+0x162/0x1f0 Aug 22 11:07:34 juju-e4d256-prod-github-runner-207 kernel: [20628.610049] ? __x64_sys_futex+0x78/0x1e0 Aug 22 11:07:34 juju-e4d256-prod-github-runner-207 kernel: [20628.610720] ? __secure_computing+0xa9/0x120 Aug 22 11:07:34 juju-e4d256-prod-github-runner-207 kernel: [20628.611406] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 11:07:34 juju-e4d256-prod-github-runner-207 kernel: [20628.612168] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:07:34 juju-e4d256-prod-github-runner-207 kernel: [20628.612887] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:07:34 juju-e4d256-prod-github-runner-207 kernel: [20628.613609] ? do_syscall_64+0x69/0xc0 Aug 22 11:07:34 juju-e4d256-prod-github-runner-207 kernel: [20628.614252] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:07:34 juju-e4d256-prod-github-runner-207 kernel: [20628.615099] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:07:34 juju-e4d256-prod-github-runner-207 kernel: [20628.615803] ? do_syscall_64+0x69/0xc0 Aug 22 11:07:34 juju-e4d256-prod-github-runner-207 kernel: [20628.616560] ? do_syscall_64+0x69/0xc0 Aug 22 11:07:34 juju-e4d256-prod-github-runner-207 kernel: [20628.617212] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 11:07:34 juju-e4d256-prod-github-runner-207 kernel: [20628.618044] RIP: 0033:0x7faa5d0edaff Aug 22 11:07:34 juju-e4d256-prod-github-runner-207 kernel: [20628.618702] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 11:07:34 juju-e4d256-prod-github-runner-207 kernel: [20628.620717] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 11:07:34 juju-e4d256-prod-github-runner-207 kernel: [20628.621840] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 11:07:34 juju-e4d256-prod-github-runner-207 kernel: [20628.622739] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 11:07:34 juju-e4d256-prod-github-runner-207 kernel: [20628.623633] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 11:07:34 juju-e4d256-prod-github-runner-207 kernel: [20628.624521] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 11:07:34 juju-e4d256-prod-github-runner-207 kernel: [20628.625485] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 11:07:34 juju-e4d256-prod-github-runner-207 kernel: [20628.626379] Aug 22 11:08:02 juju-e4d256-prod-github-runner-207 kernel: [20656.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 19129s! [qemu-system-x86:6715] Aug 22 11:08:02 juju-e4d256-prod-github-runner-207 kernel: [20656.543108] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 11:08:02 juju-e4d256-prod-github-runner-207 kernel: [20656.543181] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 11:08:02 juju-e4d256-prod-github-runner-207 kernel: [20656.555288] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 11:08:02 juju-e4d256-prod-github-runner-207 kernel: [20656.556593] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 11:08:02 juju-e4d256-prod-github-runner-207 kernel: [20656.557846] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:08:02 juju-e4d256-prod-github-runner-207 kernel: [20656.558916] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 11:08:02 juju-e4d256-prod-github-runner-207 kernel: [20656.561640] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 11:08:02 juju-e4d256-prod-github-runner-207 kernel: [20656.562706] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 11:08:02 juju-e4d256-prod-github-runner-207 kernel: [20656.563906] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 11:08:02 juju-e4d256-prod-github-runner-207 kernel: [20656.565103] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 11:08:02 juju-e4d256-prod-github-runner-207 kernel: [20656.566275] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 11:08:02 juju-e4d256-prod-github-runner-207 kernel: [20656.567441] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 11:08:02 juju-e4d256-prod-github-runner-207 kernel: [20656.568772] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 11:08:02 juju-e4d256-prod-github-runner-207 kernel: [20656.570160] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 11:08:02 juju-e4d256-prod-github-runner-207 kernel: [20656.571373] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 11:08:02 juju-e4d256-prod-github-runner-207 kernel: [20656.572729] Call Trace: Aug 22 11:08:02 juju-e4d256-prod-github-runner-207 kernel: [20656.573700] Aug 22 11:08:02 juju-e4d256-prod-github-runner-207 kernel: [20656.574631] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:08:02 juju-e4d256-prod-github-runner-207 kernel: [20656.575748] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:08:02 juju-e4d256-prod-github-runner-207 kernel: [20656.576921] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:08:02 juju-e4d256-prod-github-runner-207 kernel: [20656.578099] ? show_regs.part.0+0x23/0x29 Aug 22 11:08:02 juju-e4d256-prod-github-runner-207 kernel: [20656.579227] ? show_regs.cold+0x8/0xd Aug 22 11:08:02 juju-e4d256-prod-github-runner-207 kernel: [20656.580285] ? watchdog_timer_fn+0x1be/0x220 Aug 22 11:08:02 juju-e4d256-prod-github-runner-207 kernel: [20656.581406] ? lockup_detector_update_enable+0x60/0x60 Aug 22 11:08:02 juju-e4d256-prod-github-runner-207 kernel: [20656.582573] ? __hrtimer_run_queues+0x107/0x230 Aug 22 11:08:02 juju-e4d256-prod-github-runner-207 kernel: [20656.583703] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 11:08:02 juju-e4d256-prod-github-runner-207 kernel: [20656.584846] ? hrtimer_interrupt+0x101/0x220 Aug 22 11:08:02 juju-e4d256-prod-github-runner-207 kernel: [20656.585962] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 11:08:02 juju-e4d256-prod-github-runner-207 kernel: [20656.587149] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 11:08:02 juju-e4d256-prod-github-runner-207 kernel: [20656.588308] Aug 22 11:08:02 juju-e4d256-prod-github-runner-207 kernel: [20656.589245] Aug 22 11:08:02 juju-e4d256-prod-github-runner-207 kernel: [20656.590132] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 11:08:02 juju-e4d256-prod-github-runner-207 kernel: [20656.591292] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:08:02 juju-e4d256-prod-github-runner-207 kernel: [20656.592449] ? _raw_spin_lock+0x22/0x30 Aug 22 11:08:02 juju-e4d256-prod-github-runner-207 kernel: [20656.593492] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:08:02 juju-e4d256-prod-github-runner-207 kernel: [20656.594605] direct_page_fault+0x206/0x310 [kvm] Aug 22 11:08:02 juju-e4d256-prod-github-runner-207 kernel: [20656.595735] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 11:08:02 juju-e4d256-prod-github-runner-207 kernel: [20656.596870] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 11:08:02 juju-e4d256-prod-github-runner-207 kernel: [20656.597967] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 11:08:02 juju-e4d256-prod-github-runner-207 kernel: [20656.599030] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 11:08:02 juju-e4d256-prod-github-runner-207 kernel: [20656.600228] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 11:08:02 juju-e4d256-prod-github-runner-207 kernel: [20656.601335] handle_exit+0x98/0x230 [kvm_amd] Aug 22 11:08:02 juju-e4d256-prod-github-runner-207 kernel: [20656.602319] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 11:08:02 juju-e4d256-prod-github-runner-207 kernel: [20656.603328] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 11:08:02 juju-e4d256-prod-github-runner-207 kernel: [20656.604357] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 11:08:02 juju-e4d256-prod-github-runner-207 kernel: [20656.605379] vcpu_run+0x62/0x2c0 [kvm] Aug 22 11:08:02 juju-e4d256-prod-github-runner-207 kernel: [20656.606271] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 11:08:02 juju-e4d256-prod-github-runner-207 kernel: [20656.607171] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 11:08:02 juju-e4d256-prod-github-runner-207 kernel: [20656.608122] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 11:08:02 juju-e4d256-prod-github-runner-207 kernel: [20656.609159] ? __seccomp_filter+0x4a/0x4a0 Aug 22 11:08:02 juju-e4d256-prod-github-runner-207 kernel: [20656.609993] ? __fget_files+0x86/0xc0 Aug 22 11:08:02 juju-e4d256-prod-github-runner-207 kernel: [20656.610781] __x64_sys_ioctl+0x95/0xd0 Aug 22 11:08:02 juju-e4d256-prod-github-runner-207 kernel: [20656.611558] do_syscall_64+0x5c/0xc0 Aug 22 11:08:02 juju-e4d256-prod-github-runner-207 kernel: [20656.612308] ? do_futex+0x162/0x1f0 Aug 22 11:08:02 juju-e4d256-prod-github-runner-207 kernel: [20656.613205] ? __x64_sys_futex+0x78/0x1e0 Aug 22 11:08:02 juju-e4d256-prod-github-runner-207 kernel: [20656.613976] ? __secure_computing+0xa9/0x120 Aug 22 11:08:02 juju-e4d256-prod-github-runner-207 kernel: [20656.614759] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 11:08:02 juju-e4d256-prod-github-runner-207 kernel: [20656.615648] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:08:02 juju-e4d256-prod-github-runner-207 kernel: [20656.616663] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:08:02 juju-e4d256-prod-github-runner-207 kernel: [20656.617514] ? do_syscall_64+0x69/0xc0 Aug 22 11:08:02 juju-e4d256-prod-github-runner-207 kernel: [20656.618240] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:08:02 juju-e4d256-prod-github-runner-207 kernel: [20656.619053] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:08:02 juju-e4d256-prod-github-runner-207 kernel: [20656.619856] ? do_syscall_64+0x69/0xc0 Aug 22 11:08:02 juju-e4d256-prod-github-runner-207 kernel: [20656.620567] ? do_syscall_64+0x69/0xc0 Aug 22 11:08:02 juju-e4d256-prod-github-runner-207 kernel: [20656.621319] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 11:08:02 juju-e4d256-prod-github-runner-207 kernel: [20656.622154] RIP: 0033:0x7faa5d0edaff Aug 22 11:08:02 juju-e4d256-prod-github-runner-207 kernel: [20656.622858] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 11:08:02 juju-e4d256-prod-github-runner-207 kernel: [20656.625230] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 11:08:02 juju-e4d256-prod-github-runner-207 kernel: [20656.626291] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 11:08:02 juju-e4d256-prod-github-runner-207 kernel: [20656.627322] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 11:08:02 juju-e4d256-prod-github-runner-207 kernel: [20656.628356] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 11:08:02 juju-e4d256-prod-github-runner-207 kernel: [20656.629412] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 11:08:02 juju-e4d256-prod-github-runner-207 kernel: [20656.630447] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 11:08:02 juju-e4d256-prod-github-runner-207 kernel: [20656.631489] Aug 22 11:08:30 juju-e4d256-prod-github-runner-207 kernel: [20684.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 19155s! [qemu-system-x86:6715] Aug 22 11:08:30 juju-e4d256-prod-github-runner-207 kernel: [20684.543861] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 11:08:30 juju-e4d256-prod-github-runner-207 kernel: [20684.544143] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 11:08:30 juju-e4d256-prod-github-runner-207 kernel: [20684.556614] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 11:08:30 juju-e4d256-prod-github-runner-207 kernel: [20684.557908] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 11:08:30 juju-e4d256-prod-github-runner-207 kernel: [20684.559156] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:08:30 juju-e4d256-prod-github-runner-207 kernel: [20684.560233] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 11:08:30 juju-e4d256-prod-github-runner-207 kernel: [20684.562862] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 11:08:30 juju-e4d256-prod-github-runner-207 kernel: [20684.563923] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 11:08:30 juju-e4d256-prod-github-runner-207 kernel: [20684.565117] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 11:08:30 juju-e4d256-prod-github-runner-207 kernel: [20684.566291] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 11:08:30 juju-e4d256-prod-github-runner-207 kernel: [20684.567471] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 11:08:30 juju-e4d256-prod-github-runner-207 kernel: [20684.568825] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 11:08:30 juju-e4d256-prod-github-runner-207 kernel: [20684.570026] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 11:08:30 juju-e4d256-prod-github-runner-207 kernel: [20684.571270] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 11:08:30 juju-e4d256-prod-github-runner-207 kernel: [20684.572387] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 11:08:30 juju-e4d256-prod-github-runner-207 kernel: [20684.573594] Call Trace: Aug 22 11:08:30 juju-e4d256-prod-github-runner-207 kernel: [20684.574516] Aug 22 11:08:30 juju-e4d256-prod-github-runner-207 kernel: [20684.575509] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:08:30 juju-e4d256-prod-github-runner-207 kernel: [20684.576559] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:08:30 juju-e4d256-prod-github-runner-207 kernel: [20684.577594] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:08:30 juju-e4d256-prod-github-runner-207 kernel: [20684.578698] ? show_regs.part.0+0x23/0x29 Aug 22 11:08:30 juju-e4d256-prod-github-runner-207 kernel: [20684.579702] ? show_regs.cold+0x8/0xd Aug 22 11:08:30 juju-e4d256-prod-github-runner-207 kernel: [20684.580691] ? watchdog_timer_fn+0x1be/0x220 Aug 22 11:08:30 juju-e4d256-prod-github-runner-207 kernel: [20684.581709] ? lockup_detector_update_enable+0x60/0x60 Aug 22 11:08:30 juju-e4d256-prod-github-runner-207 kernel: [20684.582780] ? __hrtimer_run_queues+0x107/0x230 Aug 22 11:08:30 juju-e4d256-prod-github-runner-207 kernel: [20684.583827] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 11:08:30 juju-e4d256-prod-github-runner-207 kernel: [20684.584867] ? hrtimer_interrupt+0x101/0x220 Aug 22 11:08:30 juju-e4d256-prod-github-runner-207 kernel: [20684.585890] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 11:08:30 juju-e4d256-prod-github-runner-207 kernel: [20684.586967] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 11:08:30 juju-e4d256-prod-github-runner-207 kernel: [20684.588024] Aug 22 11:08:30 juju-e4d256-prod-github-runner-207 kernel: [20684.588892] Aug 22 11:08:30 juju-e4d256-prod-github-runner-207 kernel: [20684.589737] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 11:08:30 juju-e4d256-prod-github-runner-207 kernel: [20684.590784] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:08:30 juju-e4d256-prod-github-runner-207 kernel: [20684.591830] ? _raw_spin_lock+0x22/0x30 Aug 22 11:08:30 juju-e4d256-prod-github-runner-207 kernel: [20684.592800] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:08:30 juju-e4d256-prod-github-runner-207 kernel: [20684.593838] direct_page_fault+0x206/0x310 [kvm] Aug 22 11:08:30 juju-e4d256-prod-github-runner-207 kernel: [20684.594872] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 11:08:30 juju-e4d256-prod-github-runner-207 kernel: [20684.595888] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 11:08:30 juju-e4d256-prod-github-runner-207 kernel: [20684.596915] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 11:08:30 juju-e4d256-prod-github-runner-207 kernel: [20684.597936] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 11:08:30 juju-e4d256-prod-github-runner-207 kernel: [20684.598887] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 11:08:30 juju-e4d256-prod-github-runner-207 kernel: [20684.599876] handle_exit+0x98/0x230 [kvm_amd] Aug 22 11:08:30 juju-e4d256-prod-github-runner-207 kernel: [20684.600793] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 11:08:30 juju-e4d256-prod-github-runner-207 kernel: [20684.601769] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 11:08:30 juju-e4d256-prod-github-runner-207 kernel: [20684.602710] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 11:08:30 juju-e4d256-prod-github-runner-207 kernel: [20684.603621] vcpu_run+0x62/0x2c0 [kvm] Aug 22 11:08:30 juju-e4d256-prod-github-runner-207 kernel: [20684.604463] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 11:08:30 juju-e4d256-prod-github-runner-207 kernel: [20684.605286] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 11:08:30 juju-e4d256-prod-github-runner-207 kernel: [20684.606167] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 11:08:30 juju-e4d256-prod-github-runner-207 kernel: [20684.606970] ? __seccomp_filter+0x4a/0x4a0 Aug 22 11:08:30 juju-e4d256-prod-github-runner-207 kernel: [20684.607723] ? __fget_files+0x86/0xc0 Aug 22 11:08:30 juju-e4d256-prod-github-runner-207 kernel: [20684.608448] __x64_sys_ioctl+0x95/0xd0 Aug 22 11:08:30 juju-e4d256-prod-github-runner-207 kernel: [20684.609151] do_syscall_64+0x5c/0xc0 Aug 22 11:08:30 juju-e4d256-prod-github-runner-207 kernel: [20684.609824] ? do_futex+0x162/0x1f0 Aug 22 11:08:30 juju-e4d256-prod-github-runner-207 kernel: [20684.610476] ? __x64_sys_futex+0x78/0x1e0 Aug 22 11:08:30 juju-e4d256-prod-github-runner-207 kernel: [20684.611151] ? __secure_computing+0xa9/0x120 Aug 22 11:08:30 juju-e4d256-prod-github-runner-207 kernel: [20684.611845] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 11:08:30 juju-e4d256-prod-github-runner-207 kernel: [20684.612623] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:08:30 juju-e4d256-prod-github-runner-207 kernel: [20684.613412] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:08:30 juju-e4d256-prod-github-runner-207 kernel: [20684.614142] ? do_syscall_64+0x69/0xc0 Aug 22 11:08:30 juju-e4d256-prod-github-runner-207 kernel: [20684.614789] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:08:30 juju-e4d256-prod-github-runner-207 kernel: [20684.615495] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:08:30 juju-e4d256-prod-github-runner-207 kernel: [20684.616193] ? do_syscall_64+0x69/0xc0 Aug 22 11:08:30 juju-e4d256-prod-github-runner-207 kernel: [20684.616831] ? do_syscall_64+0x69/0xc0 Aug 22 11:08:30 juju-e4d256-prod-github-runner-207 kernel: [20684.617455] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 11:08:30 juju-e4d256-prod-github-runner-207 kernel: [20684.618163] RIP: 0033:0x7faa5d0edaff Aug 22 11:08:30 juju-e4d256-prod-github-runner-207 kernel: [20684.618824] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 11:08:30 juju-e4d256-prod-github-runner-207 kernel: [20684.621073] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 11:08:30 juju-e4d256-prod-github-runner-207 kernel: [20684.622012] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 11:08:30 juju-e4d256-prod-github-runner-207 kernel: [20684.622913] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 11:08:30 juju-e4d256-prod-github-runner-207 kernel: [20684.623860] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 11:08:30 juju-e4d256-prod-github-runner-207 kernel: [20684.624811] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 11:08:30 juju-e4d256-prod-github-runner-207 kernel: [20684.625749] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 11:08:30 juju-e4d256-prod-github-runner-207 kernel: [20684.626649] Aug 22 11:08:44 juju-e4d256-prod-github-runner-207 kernel: [20698.568705] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 11:08:44 juju-e4d256-prod-github-runner-207 kernel: [20698.569682] rcu: 1-....: (5129273 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=2483797 Aug 22 11:08:44 juju-e4d256-prod-github-runner-207 kernel: [20698.570800] (t=5145342 jiffies g=23269 q=26465) Aug 22 11:08:44 juju-e4d256-prod-github-runner-207 kernel: [20698.571582] NMI backtrace for cpu 1 Aug 22 11:08:44 juju-e4d256-prod-github-runner-207 kernel: [20698.572306] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 11:08:44 juju-e4d256-prod-github-runner-207 kernel: [20698.573410] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 11:08:44 juju-e4d256-prod-github-runner-207 kernel: [20698.574475] Call Trace: Aug 22 11:08:44 juju-e4d256-prod-github-runner-207 kernel: [20698.575150] Aug 22 11:08:44 juju-e4d256-prod-github-runner-207 kernel: [20698.575801] show_stack+0x52/0x5c Aug 22 11:08:44 juju-e4d256-prod-github-runner-207 kernel: [20698.576537] dump_stack_lvl+0x4a/0x63 Aug 22 11:08:44 juju-e4d256-prod-github-runner-207 kernel: [20698.577284] dump_stack+0x10/0x16 Aug 22 11:08:44 juju-e4d256-prod-github-runner-207 kernel: [20698.578008] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 11:08:44 juju-e4d256-prod-github-runner-207 kernel: [20698.578789] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 11:08:44 juju-e4d256-prod-github-runner-207 kernel: [20698.579568] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 11:08:44 juju-e4d256-prod-github-runner-207 kernel: [20698.580431] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 11:08:44 juju-e4d256-prod-github-runner-207 kernel: [20698.581264] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 11:08:44 juju-e4d256-prod-github-runner-207 kernel: [20698.582073] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 11:08:44 juju-e4d256-prod-github-runner-207 kernel: [20698.582844] print_cpu_stall.cold+0x2f/0xe2 Aug 22 11:08:44 juju-e4d256-prod-github-runner-207 kernel: [20698.583643] ? timekeeping_update+0xf7/0x150 Aug 22 11:08:44 juju-e4d256-prod-github-runner-207 kernel: [20698.584425] check_cpu_stall+0x109/0x270 Aug 22 11:08:44 juju-e4d256-prod-github-runner-207 kernel: [20698.585173] rcu_sched_clock_irq+0x9a/0x250 Aug 22 11:08:44 juju-e4d256-prod-github-runner-207 kernel: [20698.585933] update_process_times+0x94/0xd0 Aug 22 11:08:44 juju-e4d256-prod-github-runner-207 kernel: [20698.586691] tick_sched_handle+0x29/0x70 Aug 22 11:08:44 juju-e4d256-prod-github-runner-207 kernel: [20698.587435] tick_sched_timer+0x8c/0xc0 Aug 22 11:08:44 juju-e4d256-prod-github-runner-207 kernel: [20698.588180] ? tick_nohz_handler+0xb0/0xb0 Aug 22 11:08:44 juju-e4d256-prod-github-runner-207 kernel: [20698.588939] __hrtimer_run_queues+0x107/0x230 Aug 22 11:08:44 juju-e4d256-prod-github-runner-207 kernel: [20698.589709] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 11:08:44 juju-e4d256-prod-github-runner-207 kernel: [20698.590486] hrtimer_interrupt+0x101/0x220 Aug 22 11:08:44 juju-e4d256-prod-github-runner-207 kernel: [20698.591242] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 11:08:44 juju-e4d256-prod-github-runner-207 kernel: [20698.592052] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 11:08:44 juju-e4d256-prod-github-runner-207 kernel: [20698.592890] Aug 22 11:08:44 juju-e4d256-prod-github-runner-207 kernel: [20698.593533] Aug 22 11:08:44 juju-e4d256-prod-github-runner-207 kernel: [20698.594163] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 11:08:44 juju-e4d256-prod-github-runner-207 kernel: [20698.595057] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:08:44 juju-e4d256-prod-github-runner-207 kernel: [20698.596005] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 11:08:44 juju-e4d256-prod-github-runner-207 kernel: [20698.598228] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 11:08:44 juju-e4d256-prod-github-runner-207 kernel: [20698.599099] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 11:08:44 juju-e4d256-prod-github-runner-207 kernel: [20698.600092] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 11:08:44 juju-e4d256-prod-github-runner-207 kernel: [20698.601122] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 11:08:44 juju-e4d256-prod-github-runner-207 kernel: [20698.602093] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 11:08:44 juju-e4d256-prod-github-runner-207 kernel: [20698.603046] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 11:08:44 juju-e4d256-prod-github-runner-207 kernel: [20698.604001] ? _raw_spin_lock+0x22/0x30 Aug 22 11:08:44 juju-e4d256-prod-github-runner-207 kernel: [20698.604778] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:08:44 juju-e4d256-prod-github-runner-207 kernel: [20698.605611] direct_page_fault+0x206/0x310 [kvm] Aug 22 11:08:44 juju-e4d256-prod-github-runner-207 kernel: [20698.606446] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 11:08:44 juju-e4d256-prod-github-runner-207 kernel: [20698.607271] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 11:08:44 juju-e4d256-prod-github-runner-207 kernel: [20698.608092] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 11:08:44 juju-e4d256-prod-github-runner-207 kernel: [20698.608904] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 11:08:44 juju-e4d256-prod-github-runner-207 kernel: [20698.609688] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 11:08:44 juju-e4d256-prod-github-runner-207 kernel: [20698.610509] handle_exit+0x98/0x230 [kvm_amd] Aug 22 11:08:44 juju-e4d256-prod-github-runner-207 kernel: [20698.611263] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 11:08:44 juju-e4d256-prod-github-runner-207 kernel: [20698.612109] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 11:08:44 juju-e4d256-prod-github-runner-207 kernel: [20698.613143] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 11:08:44 juju-e4d256-prod-github-runner-207 kernel: [20698.613938] vcpu_run+0x62/0x2c0 [kvm] Aug 22 11:08:44 juju-e4d256-prod-github-runner-207 kernel: [20698.614654] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 11:08:44 juju-e4d256-prod-github-runner-207 kernel: [20698.615393] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 11:08:44 juju-e4d256-prod-github-runner-207 kernel: [20698.616212] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 11:08:44 juju-e4d256-prod-github-runner-207 kernel: [20698.616976] ? __seccomp_filter+0x4a/0x4a0 Aug 22 11:08:44 juju-e4d256-prod-github-runner-207 kernel: [20698.617695] ? __fget_files+0x86/0xc0 Aug 22 11:08:44 juju-e4d256-prod-github-runner-207 kernel: [20698.618393] __x64_sys_ioctl+0x95/0xd0 Aug 22 11:08:44 juju-e4d256-prod-github-runner-207 kernel: [20698.619087] do_syscall_64+0x5c/0xc0 Aug 22 11:08:44 juju-e4d256-prod-github-runner-207 kernel: [20698.619767] ? do_futex+0x162/0x1f0 Aug 22 11:08:44 juju-e4d256-prod-github-runner-207 kernel: [20698.620459] ? __x64_sys_futex+0x78/0x1e0 Aug 22 11:08:44 juju-e4d256-prod-github-runner-207 kernel: [20698.621177] ? __secure_computing+0xa9/0x120 Aug 22 11:08:44 juju-e4d256-prod-github-runner-207 kernel: [20698.621900] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 11:08:44 juju-e4d256-prod-github-runner-207 kernel: [20698.622687] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:08:44 juju-e4d256-prod-github-runner-207 kernel: [20698.623438] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:08:44 juju-e4d256-prod-github-runner-207 kernel: [20698.624206] ? do_syscall_64+0x69/0xc0 Aug 22 11:08:44 juju-e4d256-prod-github-runner-207 kernel: [20698.624895] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:08:44 juju-e4d256-prod-github-runner-207 kernel: [20698.625653] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:08:44 juju-e4d256-prod-github-runner-207 kernel: [20698.626407] ? do_syscall_64+0x69/0xc0 Aug 22 11:08:44 juju-e4d256-prod-github-runner-207 kernel: [20698.627097] ? do_syscall_64+0x69/0xc0 Aug 22 11:08:44 juju-e4d256-prod-github-runner-207 kernel: [20698.627782] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 11:08:44 juju-e4d256-prod-github-runner-207 kernel: [20698.628559] RIP: 0033:0x7faa5d0edaff Aug 22 11:08:44 juju-e4d256-prod-github-runner-207 kernel: [20698.629261] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 11:08:44 juju-e4d256-prod-github-runner-207 kernel: [20698.631350] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 11:08:44 juju-e4d256-prod-github-runner-207 kernel: [20698.632322] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 11:08:44 juju-e4d256-prod-github-runner-207 kernel: [20698.633267] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 11:08:44 juju-e4d256-prod-github-runner-207 kernel: [20698.634209] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 11:08:44 juju-e4d256-prod-github-runner-207 kernel: [20698.635148] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 11:08:44 juju-e4d256-prod-github-runner-207 kernel: [20698.636077] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 11:08:44 juju-e4d256-prod-github-runner-207 kernel: [20698.636997] Aug 22 11:09:10 juju-e4d256-prod-github-runner-207 kernel: [20724.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 19193s! [qemu-system-x86:6715] Aug 22 11:09:10 juju-e4d256-prod-github-runner-207 kernel: [20724.543122] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 11:09:10 juju-e4d256-prod-github-runner-207 kernel: [20724.543198] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 11:09:10 juju-e4d256-prod-github-runner-207 kernel: [20724.556016] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 11:09:10 juju-e4d256-prod-github-runner-207 kernel: [20724.557287] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 11:09:10 juju-e4d256-prod-github-runner-207 kernel: [20724.558501] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:09:10 juju-e4d256-prod-github-runner-207 kernel: [20724.559554] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 11:09:10 juju-e4d256-prod-github-runner-207 kernel: [20724.562116] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 11:09:10 juju-e4d256-prod-github-runner-207 kernel: [20724.563157] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 11:09:10 juju-e4d256-prod-github-runner-207 kernel: [20724.564364] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 11:09:10 juju-e4d256-prod-github-runner-207 kernel: [20724.565534] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 11:09:10 juju-e4d256-prod-github-runner-207 kernel: [20724.566758] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 11:09:10 juju-e4d256-prod-github-runner-207 kernel: [20724.568012] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 11:09:10 juju-e4d256-prod-github-runner-207 kernel: [20724.569188] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 11:09:10 juju-e4d256-prod-github-runner-207 kernel: [20724.570452] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 11:09:10 juju-e4d256-prod-github-runner-207 kernel: [20724.571563] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 11:09:10 juju-e4d256-prod-github-runner-207 kernel: [20724.572797] Call Trace: Aug 22 11:09:10 juju-e4d256-prod-github-runner-207 kernel: [20724.573724] Aug 22 11:09:10 juju-e4d256-prod-github-runner-207 kernel: [20724.574683] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:09:10 juju-e4d256-prod-github-runner-207 kernel: [20724.575803] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:09:10 juju-e4d256-prod-github-runner-207 kernel: [20724.576932] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:09:10 juju-e4d256-prod-github-runner-207 kernel: [20724.578102] ? show_regs.part.0+0x23/0x29 Aug 22 11:09:10 juju-e4d256-prod-github-runner-207 kernel: [20724.579182] ? show_regs.cold+0x8/0xd Aug 22 11:09:10 juju-e4d256-prod-github-runner-207 kernel: [20724.580255] ? watchdog_timer_fn+0x1be/0x220 Aug 22 11:09:10 juju-e4d256-prod-github-runner-207 kernel: [20724.581354] ? lockup_detector_update_enable+0x60/0x60 Aug 22 11:09:10 juju-e4d256-prod-github-runner-207 kernel: [20724.582563] ? __hrtimer_run_queues+0x107/0x230 Aug 22 11:09:10 juju-e4d256-prod-github-runner-207 kernel: [20724.583708] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 11:09:10 juju-e4d256-prod-github-runner-207 kernel: [20724.584841] ? hrtimer_interrupt+0x101/0x220 Aug 22 11:09:10 juju-e4d256-prod-github-runner-207 kernel: [20724.585945] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 11:09:10 juju-e4d256-prod-github-runner-207 kernel: [20724.587119] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 11:09:10 juju-e4d256-prod-github-runner-207 kernel: [20724.588280] Aug 22 11:09:10 juju-e4d256-prod-github-runner-207 kernel: [20724.589184] Aug 22 11:09:10 juju-e4d256-prod-github-runner-207 kernel: [20724.590080] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 11:09:10 juju-e4d256-prod-github-runner-207 kernel: [20724.591213] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:09:10 juju-e4d256-prod-github-runner-207 kernel: [20724.592387] ? _raw_spin_lock+0x22/0x30 Aug 22 11:09:10 juju-e4d256-prod-github-runner-207 kernel: [20724.593417] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:09:10 juju-e4d256-prod-github-runner-207 kernel: [20724.594523] direct_page_fault+0x206/0x310 [kvm] Aug 22 11:09:10 juju-e4d256-prod-github-runner-207 kernel: [20724.595642] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 11:09:10 juju-e4d256-prod-github-runner-207 kernel: [20724.596767] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 11:09:10 juju-e4d256-prod-github-runner-207 kernel: [20724.597880] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 11:09:10 juju-e4d256-prod-github-runner-207 kernel: [20724.598952] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 11:09:10 juju-e4d256-prod-github-runner-207 kernel: [20724.600015] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 11:09:10 juju-e4d256-prod-github-runner-207 kernel: [20724.601110] handle_exit+0x98/0x230 [kvm_amd] Aug 22 11:09:10 juju-e4d256-prod-github-runner-207 kernel: [20724.602089] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 11:09:10 juju-e4d256-prod-github-runner-207 kernel: [20724.603098] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 11:09:10 juju-e4d256-prod-github-runner-207 kernel: [20724.604148] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 11:09:10 juju-e4d256-prod-github-runner-207 kernel: [20724.605152] vcpu_run+0x62/0x2c0 [kvm] Aug 22 11:09:10 juju-e4d256-prod-github-runner-207 kernel: [20724.606044] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 11:09:10 juju-e4d256-prod-github-runner-207 kernel: [20724.606938] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 11:09:10 juju-e4d256-prod-github-runner-207 kernel: [20724.607919] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 11:09:10 juju-e4d256-prod-github-runner-207 kernel: [20724.608805] ? __seccomp_filter+0x4a/0x4a0 Aug 22 11:09:10 juju-e4d256-prod-github-runner-207 kernel: [20724.609629] ? __fget_files+0x86/0xc0 Aug 22 11:09:10 juju-e4d256-prod-github-runner-207 kernel: [20724.610420] __x64_sys_ioctl+0x95/0xd0 Aug 22 11:09:10 juju-e4d256-prod-github-runner-207 kernel: [20724.611187] do_syscall_64+0x5c/0xc0 Aug 22 11:09:10 juju-e4d256-prod-github-runner-207 kernel: [20724.611942] ? do_futex+0x162/0x1f0 Aug 22 11:09:10 juju-e4d256-prod-github-runner-207 kernel: [20724.612664] ? __x64_sys_futex+0x78/0x1e0 Aug 22 11:09:10 juju-e4d256-prod-github-runner-207 kernel: [20724.613418] ? __secure_computing+0xa9/0x120 Aug 22 11:09:10 juju-e4d256-prod-github-runner-207 kernel: [20724.614193] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 11:09:10 juju-e4d256-prod-github-runner-207 kernel: [20724.615066] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:09:10 juju-e4d256-prod-github-runner-207 kernel: [20724.615912] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:09:10 juju-e4d256-prod-github-runner-207 kernel: [20724.616728] ? do_syscall_64+0x69/0xc0 Aug 22 11:09:10 juju-e4d256-prod-github-runner-207 kernel: [20724.617452] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:09:10 juju-e4d256-prod-github-runner-207 kernel: [20724.618261] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:09:10 juju-e4d256-prod-github-runner-207 kernel: [20724.619060] ? do_syscall_64+0x69/0xc0 Aug 22 11:09:10 juju-e4d256-prod-github-runner-207 kernel: [20724.619767] ? do_syscall_64+0x69/0xc0 Aug 22 11:09:10 juju-e4d256-prod-github-runner-207 kernel: [20724.620483] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 11:09:10 juju-e4d256-prod-github-runner-207 kernel: [20724.621295] RIP: 0033:0x7faa5d0edaff Aug 22 11:09:10 juju-e4d256-prod-github-runner-207 kernel: [20724.622006] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 11:09:10 juju-e4d256-prod-github-runner-207 kernel: [20724.624350] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 11:09:10 juju-e4d256-prod-github-runner-207 kernel: [20724.625410] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 11:09:10 juju-e4d256-prod-github-runner-207 kernel: [20724.626501] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 11:09:10 juju-e4d256-prod-github-runner-207 kernel: [20724.627561] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 11:09:10 juju-e4d256-prod-github-runner-207 kernel: [20724.628605] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 11:09:10 juju-e4d256-prod-github-runner-207 kernel: [20724.629642] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 11:09:10 juju-e4d256-prod-github-runner-207 kernel: [20724.630711] Aug 22 11:09:38 juju-e4d256-prod-github-runner-207 kernel: [20752.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 19219s! [qemu-system-x86:6715] Aug 22 11:09:38 juju-e4d256-prod-github-runner-207 kernel: [20752.543217] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 11:09:38 juju-e4d256-prod-github-runner-207 kernel: [20752.543454] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 11:09:38 juju-e4d256-prod-github-runner-207 kernel: [20752.555825] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 11:09:38 juju-e4d256-prod-github-runner-207 kernel: [20752.557328] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 11:09:38 juju-e4d256-prod-github-runner-207 kernel: [20752.558645] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:09:38 juju-e4d256-prod-github-runner-207 kernel: [20752.559770] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 11:09:38 juju-e4d256-prod-github-runner-207 kernel: [20752.562328] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 11:09:38 juju-e4d256-prod-github-runner-207 kernel: [20752.563380] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 11:09:38 juju-e4d256-prod-github-runner-207 kernel: [20752.564562] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 11:09:38 juju-e4d256-prod-github-runner-207 kernel: [20752.565995] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 11:09:38 juju-e4d256-prod-github-runner-207 kernel: [20752.567183] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 11:09:38 juju-e4d256-prod-github-runner-207 kernel: [20752.568408] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 11:09:38 juju-e4d256-prod-github-runner-207 kernel: [20752.569583] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 11:09:38 juju-e4d256-prod-github-runner-207 kernel: [20752.570850] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 11:09:38 juju-e4d256-prod-github-runner-207 kernel: [20752.572002] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 11:09:38 juju-e4d256-prod-github-runner-207 kernel: [20752.573227] Call Trace: Aug 22 11:09:38 juju-e4d256-prod-github-runner-207 kernel: [20752.574175] Aug 22 11:09:38 juju-e4d256-prod-github-runner-207 kernel: [20752.575068] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:09:38 juju-e4d256-prod-github-runner-207 kernel: [20752.578137] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:09:38 juju-e4d256-prod-github-runner-207 kernel: [20752.579587] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:09:38 juju-e4d256-prod-github-runner-207 kernel: [20752.580689] ? show_regs.part.0+0x23/0x29 Aug 22 11:09:38 juju-e4d256-prod-github-runner-207 kernel: [20752.581697] ? show_regs.cold+0x8/0xd Aug 22 11:09:38 juju-e4d256-prod-github-runner-207 kernel: [20752.582673] ? watchdog_timer_fn+0x1be/0x220 Aug 22 11:09:38 juju-e4d256-prod-github-runner-207 kernel: [20752.583701] ? lockup_detector_update_enable+0x60/0x60 Aug 22 11:09:38 juju-e4d256-prod-github-runner-207 kernel: [20752.584767] ? __hrtimer_run_queues+0x107/0x230 Aug 22 11:09:38 juju-e4d256-prod-github-runner-207 kernel: [20752.585804] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 11:09:38 juju-e4d256-prod-github-runner-207 kernel: [20752.586874] ? hrtimer_interrupt+0x101/0x220 Aug 22 11:09:38 juju-e4d256-prod-github-runner-207 kernel: [20752.587942] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 11:09:38 juju-e4d256-prod-github-runner-207 kernel: [20752.589030] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 11:09:38 juju-e4d256-prod-github-runner-207 kernel: [20752.590147] Aug 22 11:09:38 juju-e4d256-prod-github-runner-207 kernel: [20752.591015] Aug 22 11:09:38 juju-e4d256-prod-github-runner-207 kernel: [20752.591895] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 11:09:38 juju-e4d256-prod-github-runner-207 kernel: [20752.592936] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:09:38 juju-e4d256-prod-github-runner-207 kernel: [20752.593977] ? _raw_spin_lock+0x22/0x30 Aug 22 11:09:38 juju-e4d256-prod-github-runner-207 kernel: [20752.594926] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:09:38 juju-e4d256-prod-github-runner-207 kernel: [20752.595968] direct_page_fault+0x206/0x310 [kvm] Aug 22 11:09:38 juju-e4d256-prod-github-runner-207 kernel: [20752.596994] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 11:09:38 juju-e4d256-prod-github-runner-207 kernel: [20752.598009] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 11:09:38 juju-e4d256-prod-github-runner-207 kernel: [20752.599047] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 11:09:38 juju-e4d256-prod-github-runner-207 kernel: [20752.600109] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 11:09:38 juju-e4d256-prod-github-runner-207 kernel: [20752.601182] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 11:09:38 juju-e4d256-prod-github-runner-207 kernel: [20752.602285] handle_exit+0x98/0x230 [kvm_amd] Aug 22 11:09:38 juju-e4d256-prod-github-runner-207 kernel: [20752.603267] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 11:09:38 juju-e4d256-prod-github-runner-207 kernel: [20752.604317] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 11:09:38 juju-e4d256-prod-github-runner-207 kernel: [20752.605344] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 11:09:38 juju-e4d256-prod-github-runner-207 kernel: [20752.606352] vcpu_run+0x62/0x2c0 [kvm] Aug 22 11:09:38 juju-e4d256-prod-github-runner-207 kernel: [20752.607243] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 11:09:38 juju-e4d256-prod-github-runner-207 kernel: [20752.608154] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 11:09:38 juju-e4d256-prod-github-runner-207 kernel: [20752.609110] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 11:09:38 juju-e4d256-prod-github-runner-207 kernel: [20752.609999] ? __seccomp_filter+0x4a/0x4a0 Aug 22 11:09:38 juju-e4d256-prod-github-runner-207 kernel: [20752.610833] ? __fget_files+0x86/0xc0 Aug 22 11:09:38 juju-e4d256-prod-github-runner-207 kernel: [20752.611647] __x64_sys_ioctl+0x95/0xd0 Aug 22 11:09:38 juju-e4d256-prod-github-runner-207 kernel: [20752.612418] do_syscall_64+0x5c/0xc0 Aug 22 11:09:38 juju-e4d256-prod-github-runner-207 kernel: [20752.613169] ? do_futex+0x162/0x1f0 Aug 22 11:09:38 juju-e4d256-prod-github-runner-207 kernel: [20752.613893] ? __x64_sys_futex+0x78/0x1e0 Aug 22 11:09:38 juju-e4d256-prod-github-runner-207 kernel: [20752.614650] ? __secure_computing+0xa9/0x120 Aug 22 11:09:38 juju-e4d256-prod-github-runner-207 kernel: [20752.615438] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 11:09:38 juju-e4d256-prod-github-runner-207 kernel: [20752.616332] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:09:38 juju-e4d256-prod-github-runner-207 kernel: [20752.617159] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:09:38 juju-e4d256-prod-github-runner-207 kernel: [20752.617976] ? do_syscall_64+0x69/0xc0 Aug 22 11:09:38 juju-e4d256-prod-github-runner-207 kernel: [20752.618707] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:09:38 juju-e4d256-prod-github-runner-207 kernel: [20752.619523] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:09:38 juju-e4d256-prod-github-runner-207 kernel: [20752.620312] ? do_syscall_64+0x69/0xc0 Aug 22 11:09:38 juju-e4d256-prod-github-runner-207 kernel: [20752.621013] ? do_syscall_64+0x69/0xc0 Aug 22 11:09:38 juju-e4d256-prod-github-runner-207 kernel: [20752.621710] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 11:09:38 juju-e4d256-prod-github-runner-207 kernel: [20752.622557] RIP: 0033:0x7faa5d0edaff Aug 22 11:09:38 juju-e4d256-prod-github-runner-207 kernel: [20752.623310] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 11:09:38 juju-e4d256-prod-github-runner-207 kernel: [20752.625675] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 11:09:38 juju-e4d256-prod-github-runner-207 kernel: [20752.626737] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 11:09:38 juju-e4d256-prod-github-runner-207 kernel: [20752.627791] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 11:09:38 juju-e4d256-prod-github-runner-207 kernel: [20752.628829] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 11:09:38 juju-e4d256-prod-github-runner-207 kernel: [20752.629858] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 11:09:38 juju-e4d256-prod-github-runner-207 kernel: [20752.630893] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 11:09:38 juju-e4d256-prod-github-runner-207 kernel: [20752.631957] Aug 22 11:10:06 juju-e4d256-prod-github-runner-207 kernel: [20780.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 19245s! [qemu-system-x86:6715] Aug 22 11:10:06 juju-e4d256-prod-github-runner-207 kernel: [20780.543113] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 11:10:06 juju-e4d256-prod-github-runner-207 kernel: [20780.543386] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 11:10:06 juju-e4d256-prod-github-runner-207 kernel: [20780.556157] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 11:10:06 juju-e4d256-prod-github-runner-207 kernel: [20780.557428] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 11:10:06 juju-e4d256-prod-github-runner-207 kernel: [20780.558649] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:10:06 juju-e4d256-prod-github-runner-207 kernel: [20780.559785] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 11:10:06 juju-e4d256-prod-github-runner-207 kernel: [20780.562508] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 11:10:06 juju-e4d256-prod-github-runner-207 kernel: [20780.563607] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 11:10:06 juju-e4d256-prod-github-runner-207 kernel: [20780.564789] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 11:10:06 juju-e4d256-prod-github-runner-207 kernel: [20780.565967] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 11:10:06 juju-e4d256-prod-github-runner-207 kernel: [20780.567139] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 11:10:06 juju-e4d256-prod-github-runner-207 kernel: [20780.568325] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 11:10:06 juju-e4d256-prod-github-runner-207 kernel: [20780.569495] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 11:10:06 juju-e4d256-prod-github-runner-207 kernel: [20780.570730] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 11:10:06 juju-e4d256-prod-github-runner-207 kernel: [20780.571845] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 11:10:06 juju-e4d256-prod-github-runner-207 kernel: [20780.573074] Call Trace: Aug 22 11:10:06 juju-e4d256-prod-github-runner-207 kernel: [20780.573993] Aug 22 11:10:06 juju-e4d256-prod-github-runner-207 kernel: [20780.574915] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:10:06 juju-e4d256-prod-github-runner-207 kernel: [20780.575972] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:10:06 juju-e4d256-prod-github-runner-207 kernel: [20780.576996] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:10:06 juju-e4d256-prod-github-runner-207 kernel: [20780.578077] ? show_regs.part.0+0x23/0x29 Aug 22 11:10:06 juju-e4d256-prod-github-runner-207 kernel: [20780.579098] ? show_regs.cold+0x8/0xd Aug 22 11:10:06 juju-e4d256-prod-github-runner-207 kernel: [20780.580129] ? watchdog_timer_fn+0x1be/0x220 Aug 22 11:10:06 juju-e4d256-prod-github-runner-207 kernel: [20780.581147] ? lockup_detector_update_enable+0x60/0x60 Aug 22 11:10:06 juju-e4d256-prod-github-runner-207 kernel: [20780.582215] ? __hrtimer_run_queues+0x107/0x230 Aug 22 11:10:06 juju-e4d256-prod-github-runner-207 kernel: [20780.583324] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 11:10:06 juju-e4d256-prod-github-runner-207 kernel: [20780.584668] ? hrtimer_interrupt+0x101/0x220 Aug 22 11:10:06 juju-e4d256-prod-github-runner-207 kernel: [20780.585718] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 11:10:06 juju-e4d256-prod-github-runner-207 kernel: [20780.586826] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 11:10:06 juju-e4d256-prod-github-runner-207 kernel: [20780.587897] Aug 22 11:10:06 juju-e4d256-prod-github-runner-207 kernel: [20780.588757] Aug 22 11:10:06 juju-e4d256-prod-github-runner-207 kernel: [20780.589598] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 11:10:06 juju-e4d256-prod-github-runner-207 kernel: [20780.590634] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:10:06 juju-e4d256-prod-github-runner-207 kernel: [20780.591702] ? _raw_spin_lock+0x22/0x30 Aug 22 11:10:06 juju-e4d256-prod-github-runner-207 kernel: [20780.592661] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:10:06 juju-e4d256-prod-github-runner-207 kernel: [20780.593722] direct_page_fault+0x206/0x310 [kvm] Aug 22 11:10:06 juju-e4d256-prod-github-runner-207 kernel: [20780.594749] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 11:10:06 juju-e4d256-prod-github-runner-207 kernel: [20780.595775] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 11:10:06 juju-e4d256-prod-github-runner-207 kernel: [20780.596797] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 11:10:06 juju-e4d256-prod-github-runner-207 kernel: [20780.597790] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 11:10:06 juju-e4d256-prod-github-runner-207 kernel: [20780.598780] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 11:10:06 juju-e4d256-prod-github-runner-207 kernel: [20780.599879] handle_exit+0x98/0x230 [kvm_amd] Aug 22 11:10:06 juju-e4d256-prod-github-runner-207 kernel: [20780.600824] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 11:10:06 juju-e4d256-prod-github-runner-207 kernel: [20780.601748] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 11:10:06 juju-e4d256-prod-github-runner-207 kernel: [20780.602698] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 11:10:06 juju-e4d256-prod-github-runner-207 kernel: [20780.603637] vcpu_run+0x62/0x2c0 [kvm] Aug 22 11:10:06 juju-e4d256-prod-github-runner-207 kernel: [20780.604485] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 11:10:06 juju-e4d256-prod-github-runner-207 kernel: [20780.605300] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 11:10:06 juju-e4d256-prod-github-runner-207 kernel: [20780.606163] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 11:10:06 juju-e4d256-prod-github-runner-207 kernel: [20780.606964] ? __seccomp_filter+0x4a/0x4a0 Aug 22 11:10:06 juju-e4d256-prod-github-runner-207 kernel: [20780.607729] ? __fget_files+0x86/0xc0 Aug 22 11:10:06 juju-e4d256-prod-github-runner-207 kernel: [20780.608436] __x64_sys_ioctl+0x95/0xd0 Aug 22 11:10:06 juju-e4d256-prod-github-runner-207 kernel: [20780.609135] do_syscall_64+0x5c/0xc0 Aug 22 11:10:06 juju-e4d256-prod-github-runner-207 kernel: [20780.609805] ? do_futex+0x162/0x1f0 Aug 22 11:10:06 juju-e4d256-prod-github-runner-207 kernel: [20780.610461] ? __x64_sys_futex+0x78/0x1e0 Aug 22 11:10:06 juju-e4d256-prod-github-runner-207 kernel: [20780.611137] ? __secure_computing+0xa9/0x120 Aug 22 11:10:06 juju-e4d256-prod-github-runner-207 kernel: [20780.611853] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 11:10:06 juju-e4d256-prod-github-runner-207 kernel: [20780.612625] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:10:06 juju-e4d256-prod-github-runner-207 kernel: [20780.613373] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:10:06 juju-e4d256-prod-github-runner-207 kernel: [20780.614098] ? do_syscall_64+0x69/0xc0 Aug 22 11:10:06 juju-e4d256-prod-github-runner-207 kernel: [20780.614745] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:10:06 juju-e4d256-prod-github-runner-207 kernel: [20780.615465] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:10:06 juju-e4d256-prod-github-runner-207 kernel: [20780.616163] ? do_syscall_64+0x69/0xc0 Aug 22 11:10:06 juju-e4d256-prod-github-runner-207 kernel: [20780.616790] ? do_syscall_64+0x69/0xc0 Aug 22 11:10:06 juju-e4d256-prod-github-runner-207 kernel: [20780.617415] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 11:10:06 juju-e4d256-prod-github-runner-207 kernel: [20780.618124] RIP: 0033:0x7faa5d0edaff Aug 22 11:10:06 juju-e4d256-prod-github-runner-207 kernel: [20780.618762] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 11:10:06 juju-e4d256-prod-github-runner-207 kernel: [20780.620780] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 11:10:06 juju-e4d256-prod-github-runner-207 kernel: [20780.621708] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 11:10:06 juju-e4d256-prod-github-runner-207 kernel: [20780.622615] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 11:10:06 juju-e4d256-prod-github-runner-207 kernel: [20780.623546] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 11:10:06 juju-e4d256-prod-github-runner-207 kernel: [20780.624436] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 11:10:06 juju-e4d256-prod-github-runner-207 kernel: [20780.625333] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 11:10:06 juju-e4d256-prod-github-runner-207 kernel: [20780.626232] Aug 22 11:10:34 juju-e4d256-prod-github-runner-207 kernel: [20808.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 19271s! [qemu-system-x86:6715] Aug 22 11:10:34 juju-e4d256-prod-github-runner-207 kernel: [20808.543106] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 11:10:34 juju-e4d256-prod-github-runner-207 kernel: [20808.543188] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 11:10:34 juju-e4d256-prod-github-runner-207 kernel: [20808.555459] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 11:10:34 juju-e4d256-prod-github-runner-207 kernel: [20808.556747] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 11:10:34 juju-e4d256-prod-github-runner-207 kernel: [20808.558005] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:10:34 juju-e4d256-prod-github-runner-207 kernel: [20808.559297] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 11:10:34 juju-e4d256-prod-github-runner-207 kernel: [20808.561992] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 11:10:34 juju-e4d256-prod-github-runner-207 kernel: [20808.563082] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 11:10:34 juju-e4d256-prod-github-runner-207 kernel: [20808.564259] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 11:10:34 juju-e4d256-prod-github-runner-207 kernel: [20808.565429] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 11:10:34 juju-e4d256-prod-github-runner-207 kernel: [20808.566593] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 11:10:34 juju-e4d256-prod-github-runner-207 kernel: [20808.567794] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 11:10:34 juju-e4d256-prod-github-runner-207 kernel: [20808.568983] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 11:10:34 juju-e4d256-prod-github-runner-207 kernel: [20808.572457] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 11:10:34 juju-e4d256-prod-github-runner-207 kernel: [20808.573598] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 11:10:34 juju-e4d256-prod-github-runner-207 kernel: [20808.574804] Call Trace: Aug 22 11:10:34 juju-e4d256-prod-github-runner-207 kernel: [20808.575741] Aug 22 11:10:34 juju-e4d256-prod-github-runner-207 kernel: [20808.576637] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:10:34 juju-e4d256-prod-github-runner-207 kernel: [20808.577684] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:10:34 juju-e4d256-prod-github-runner-207 kernel: [20808.578723] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:10:34 juju-e4d256-prod-github-runner-207 kernel: [20808.579822] ? show_regs.part.0+0x23/0x29 Aug 22 11:10:34 juju-e4d256-prod-github-runner-207 kernel: [20808.580831] ? show_regs.cold+0x8/0xd Aug 22 11:10:34 juju-e4d256-prod-github-runner-207 kernel: [20808.581810] ? watchdog_timer_fn+0x1be/0x220 Aug 22 11:10:34 juju-e4d256-prod-github-runner-207 kernel: [20808.582866] ? lockup_detector_update_enable+0x60/0x60 Aug 22 11:10:34 juju-e4d256-prod-github-runner-207 kernel: [20808.583949] ? __hrtimer_run_queues+0x107/0x230 Aug 22 11:10:34 juju-e4d256-prod-github-runner-207 kernel: [20808.584987] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 11:10:34 juju-e4d256-prod-github-runner-207 kernel: [20808.586033] ? hrtimer_interrupt+0x101/0x220 Aug 22 11:10:34 juju-e4d256-prod-github-runner-207 kernel: [20808.587087] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 11:10:34 juju-e4d256-prod-github-runner-207 kernel: [20808.588175] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 11:10:34 juju-e4d256-prod-github-runner-207 kernel: [20808.589244] Aug 22 11:10:34 juju-e4d256-prod-github-runner-207 kernel: [20808.590112] Aug 22 11:10:34 juju-e4d256-prod-github-runner-207 kernel: [20808.590989] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 11:10:34 juju-e4d256-prod-github-runner-207 kernel: [20808.592032] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:10:34 juju-e4d256-prod-github-runner-207 kernel: [20808.593091] ? _raw_spin_lock+0x22/0x30 Aug 22 11:10:34 juju-e4d256-prod-github-runner-207 kernel: [20808.594057] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:10:34 juju-e4d256-prod-github-runner-207 kernel: [20808.595136] direct_page_fault+0x206/0x310 [kvm] Aug 22 11:10:34 juju-e4d256-prod-github-runner-207 kernel: [20808.596178] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 11:10:34 juju-e4d256-prod-github-runner-207 kernel: [20808.597216] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 11:10:34 juju-e4d256-prod-github-runner-207 kernel: [20808.598243] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 11:10:34 juju-e4d256-prod-github-runner-207 kernel: [20808.599256] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 11:10:34 juju-e4d256-prod-github-runner-207 kernel: [20808.600212] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 11:10:34 juju-e4d256-prod-github-runner-207 kernel: [20808.601200] handle_exit+0x98/0x230 [kvm_amd] Aug 22 11:10:34 juju-e4d256-prod-github-runner-207 kernel: [20808.602103] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 11:10:34 juju-e4d256-prod-github-runner-207 kernel: [20808.603057] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 11:10:34 juju-e4d256-prod-github-runner-207 kernel: [20808.604164] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 11:10:34 juju-e4d256-prod-github-runner-207 kernel: [20808.605083] vcpu_run+0x62/0x2c0 [kvm] Aug 22 11:10:34 juju-e4d256-prod-github-runner-207 kernel: [20808.605909] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 11:10:34 juju-e4d256-prod-github-runner-207 kernel: [20808.606726] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 11:10:34 juju-e4d256-prod-github-runner-207 kernel: [20808.607599] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 11:10:34 juju-e4d256-prod-github-runner-207 kernel: [20808.608413] ? __seccomp_filter+0x4a/0x4a0 Aug 22 11:10:34 juju-e4d256-prod-github-runner-207 kernel: [20808.609165] ? __fget_files+0x86/0xc0 Aug 22 11:10:34 juju-e4d256-prod-github-runner-207 kernel: [20808.609891] __x64_sys_ioctl+0x95/0xd0 Aug 22 11:10:34 juju-e4d256-prod-github-runner-207 kernel: [20808.610591] do_syscall_64+0x5c/0xc0 Aug 22 11:10:34 juju-e4d256-prod-github-runner-207 kernel: [20808.611277] ? do_futex+0x162/0x1f0 Aug 22 11:10:34 juju-e4d256-prod-github-runner-207 kernel: [20808.611941] ? __x64_sys_futex+0x78/0x1e0 Aug 22 11:10:34 juju-e4d256-prod-github-runner-207 kernel: [20808.612625] ? __secure_computing+0xa9/0x120 Aug 22 11:10:34 juju-e4d256-prod-github-runner-207 kernel: [20808.613330] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 11:10:34 juju-e4d256-prod-github-runner-207 kernel: [20808.614104] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:10:34 juju-e4d256-prod-github-runner-207 kernel: [20808.614870] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:10:34 juju-e4d256-prod-github-runner-207 kernel: [20808.615612] ? do_syscall_64+0x69/0xc0 Aug 22 11:10:34 juju-e4d256-prod-github-runner-207 kernel: [20808.616287] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:10:34 juju-e4d256-prod-github-runner-207 kernel: [20808.616995] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:10:34 juju-e4d256-prod-github-runner-207 kernel: [20808.617694] ? do_syscall_64+0x69/0xc0 Aug 22 11:10:34 juju-e4d256-prod-github-runner-207 kernel: [20808.618323] ? do_syscall_64+0x69/0xc0 Aug 22 11:10:34 juju-e4d256-prod-github-runner-207 kernel: [20808.619234] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 11:10:34 juju-e4d256-prod-github-runner-207 kernel: [20808.619966] RIP: 0033:0x7faa5d0edaff Aug 22 11:10:34 juju-e4d256-prod-github-runner-207 kernel: [20808.620597] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 11:10:34 juju-e4d256-prod-github-runner-207 kernel: [20808.622602] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 11:10:34 juju-e4d256-prod-github-runner-207 kernel: [20808.623539] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 11:10:34 juju-e4d256-prod-github-runner-207 kernel: [20808.624451] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 11:10:34 juju-e4d256-prod-github-runner-207 kernel: [20808.625360] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 11:10:34 juju-e4d256-prod-github-runner-207 kernel: [20808.626255] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 11:10:34 juju-e4d256-prod-github-runner-207 kernel: [20808.627169] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 11:10:34 juju-e4d256-prod-github-runner-207 kernel: [20808.628070] Aug 22 11:11:02 juju-e4d256-prod-github-runner-207 kernel: [20836.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 19297s! [qemu-system-x86:6715] Aug 22 11:11:02 juju-e4d256-prod-github-runner-207 kernel: [20836.543171] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 11:11:02 juju-e4d256-prod-github-runner-207 kernel: [20836.543246] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 11:11:02 juju-e4d256-prod-github-runner-207 kernel: [20836.555472] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 11:11:02 juju-e4d256-prod-github-runner-207 kernel: [20836.556746] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 11:11:02 juju-e4d256-prod-github-runner-207 kernel: [20836.557975] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:11:02 juju-e4d256-prod-github-runner-207 kernel: [20836.559056] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 11:11:02 juju-e4d256-prod-github-runner-207 kernel: [20836.561647] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 11:11:02 juju-e4d256-prod-github-runner-207 kernel: [20836.562719] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 11:11:02 juju-e4d256-prod-github-runner-207 kernel: [20836.564109] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 11:11:02 juju-e4d256-prod-github-runner-207 kernel: [20836.565299] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 11:11:02 juju-e4d256-prod-github-runner-207 kernel: [20836.566464] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 11:11:02 juju-e4d256-prod-github-runner-207 kernel: [20836.567651] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 11:11:02 juju-e4d256-prod-github-runner-207 kernel: [20836.568818] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 11:11:02 juju-e4d256-prod-github-runner-207 kernel: [20836.570066] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 11:11:02 juju-e4d256-prod-github-runner-207 kernel: [20836.571210] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 11:11:02 juju-e4d256-prod-github-runner-207 kernel: [20836.572409] Call Trace: Aug 22 11:11:02 juju-e4d256-prod-github-runner-207 kernel: [20836.573331] Aug 22 11:11:02 juju-e4d256-prod-github-runner-207 kernel: [20836.574220] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:11:02 juju-e4d256-prod-github-runner-207 kernel: [20836.575441] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:11:02 juju-e4d256-prod-github-runner-207 kernel: [20836.576478] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:11:02 juju-e4d256-prod-github-runner-207 kernel: [20836.577559] ? show_regs.part.0+0x23/0x29 Aug 22 11:11:02 juju-e4d256-prod-github-runner-207 kernel: [20836.578590] ? show_regs.cold+0x8/0xd Aug 22 11:11:02 juju-e4d256-prod-github-runner-207 kernel: [20836.579598] ? watchdog_timer_fn+0x1be/0x220 Aug 22 11:11:02 juju-e4d256-prod-github-runner-207 kernel: [20836.580616] ? lockup_detector_update_enable+0x60/0x60 Aug 22 11:11:02 juju-e4d256-prod-github-runner-207 kernel: [20836.581698] ? __hrtimer_run_queues+0x107/0x230 Aug 22 11:11:02 juju-e4d256-prod-github-runner-207 kernel: [20836.582756] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 11:11:02 juju-e4d256-prod-github-runner-207 kernel: [20836.583793] ? hrtimer_interrupt+0x101/0x220 Aug 22 11:11:02 juju-e4d256-prod-github-runner-207 kernel: [20836.584813] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 11:11:02 juju-e4d256-prod-github-runner-207 kernel: [20836.585896] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 11:11:02 juju-e4d256-prod-github-runner-207 kernel: [20836.586974] Aug 22 11:11:02 juju-e4d256-prod-github-runner-207 kernel: [20836.587834] Aug 22 11:11:02 juju-e4d256-prod-github-runner-207 kernel: [20836.588678] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 11:11:02 juju-e4d256-prod-github-runner-207 kernel: [20836.589719] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:11:02 juju-e4d256-prod-github-runner-207 kernel: [20836.590774] ? _raw_spin_lock+0x22/0x30 Aug 22 11:11:02 juju-e4d256-prod-github-runner-207 kernel: [20836.591724] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:11:02 juju-e4d256-prod-github-runner-207 kernel: [20836.592747] direct_page_fault+0x206/0x310 [kvm] Aug 22 11:11:02 juju-e4d256-prod-github-runner-207 kernel: [20836.593775] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 11:11:02 juju-e4d256-prod-github-runner-207 kernel: [20836.594802] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 11:11:02 juju-e4d256-prod-github-runner-207 kernel: [20836.595807] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 11:11:02 juju-e4d256-prod-github-runner-207 kernel: [20836.596787] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 11:11:02 juju-e4d256-prod-github-runner-207 kernel: [20836.597736] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 11:11:02 juju-e4d256-prod-github-runner-207 kernel: [20836.598731] handle_exit+0x98/0x230 [kvm_amd] Aug 22 11:11:02 juju-e4d256-prod-github-runner-207 kernel: [20836.599627] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 11:11:02 juju-e4d256-prod-github-runner-207 kernel: [20836.600548] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 11:11:02 juju-e4d256-prod-github-runner-207 kernel: [20836.601479] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 11:11:02 juju-e4d256-prod-github-runner-207 kernel: [20836.602387] vcpu_run+0x62/0x2c0 [kvm] Aug 22 11:11:02 juju-e4d256-prod-github-runner-207 kernel: [20836.603225] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 11:11:02 juju-e4d256-prod-github-runner-207 kernel: [20836.604102] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 11:11:02 juju-e4d256-prod-github-runner-207 kernel: [20836.604996] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 11:11:02 juju-e4d256-prod-github-runner-207 kernel: [20836.605862] ? __seccomp_filter+0x4a/0x4a0 Aug 22 11:11:02 juju-e4d256-prod-github-runner-207 kernel: [20836.606634] ? __fget_files+0x86/0xc0 Aug 22 11:11:02 juju-e4d256-prod-github-runner-207 kernel: [20836.607353] __x64_sys_ioctl+0x95/0xd0 Aug 22 11:11:02 juju-e4d256-prod-github-runner-207 kernel: [20836.608058] do_syscall_64+0x5c/0xc0 Aug 22 11:11:02 juju-e4d256-prod-github-runner-207 kernel: [20836.608749] ? do_futex+0x162/0x1f0 Aug 22 11:11:02 juju-e4d256-prod-github-runner-207 kernel: [20836.609417] ? __x64_sys_futex+0x78/0x1e0 Aug 22 11:11:02 juju-e4d256-prod-github-runner-207 kernel: [20836.610105] ? __secure_computing+0xa9/0x120 Aug 22 11:11:02 juju-e4d256-prod-github-runner-207 kernel: [20836.610976] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 11:11:02 juju-e4d256-prod-github-runner-207 kernel: [20836.611742] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:11:02 juju-e4d256-prod-github-runner-207 kernel: [20836.612467] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:11:02 juju-e4d256-prod-github-runner-207 kernel: [20836.613199] ? do_syscall_64+0x69/0xc0 Aug 22 11:11:02 juju-e4d256-prod-github-runner-207 kernel: [20836.613857] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:11:02 juju-e4d256-prod-github-runner-207 kernel: [20836.614582] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:11:02 juju-e4d256-prod-github-runner-207 kernel: [20836.615282] ? do_syscall_64+0x69/0xc0 Aug 22 11:11:02 juju-e4d256-prod-github-runner-207 kernel: [20836.615913] ? do_syscall_64+0x69/0xc0 Aug 22 11:11:02 juju-e4d256-prod-github-runner-207 kernel: [20836.616537] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 11:11:02 juju-e4d256-prod-github-runner-207 kernel: [20836.617252] RIP: 0033:0x7faa5d0edaff Aug 22 11:11:02 juju-e4d256-prod-github-runner-207 kernel: [20836.617890] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 11:11:02 juju-e4d256-prod-github-runner-207 kernel: [20836.620079] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 11:11:02 juju-e4d256-prod-github-runner-207 kernel: [20836.620997] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 11:11:02 juju-e4d256-prod-github-runner-207 kernel: [20836.621899] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 11:11:02 juju-e4d256-prod-github-runner-207 kernel: [20836.622849] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 11:11:02 juju-e4d256-prod-github-runner-207 kernel: [20836.623756] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 11:11:02 juju-e4d256-prod-github-runner-207 kernel: [20836.624654] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 11:11:02 juju-e4d256-prod-github-runner-207 kernel: [20836.625554] Aug 22 11:11:30 juju-e4d256-prod-github-runner-207 kernel: [20864.541980] watchdog: BUG: soft lockup - CPU#1 stuck for 19323s! [qemu-system-x86:6715] Aug 22 11:11:30 juju-e4d256-prod-github-runner-207 kernel: [20864.543830] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 11:11:30 juju-e4d256-prod-github-runner-207 kernel: [20864.544114] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 11:11:30 juju-e4d256-prod-github-runner-207 kernel: [20864.556522] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 11:11:30 juju-e4d256-prod-github-runner-207 kernel: [20864.557804] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 11:11:30 juju-e4d256-prod-github-runner-207 kernel: [20864.559044] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:11:30 juju-e4d256-prod-github-runner-207 kernel: [20864.560135] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 11:11:30 juju-e4d256-prod-github-runner-207 kernel: [20864.562808] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 11:11:30 juju-e4d256-prod-github-runner-207 kernel: [20864.563904] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 11:11:30 juju-e4d256-prod-github-runner-207 kernel: [20864.565084] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 11:11:30 juju-e4d256-prod-github-runner-207 kernel: [20864.566378] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 11:11:30 juju-e4d256-prod-github-runner-207 kernel: [20864.567935] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 11:11:30 juju-e4d256-prod-github-runner-207 kernel: [20864.569137] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 11:11:30 juju-e4d256-prod-github-runner-207 kernel: [20864.570359] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 11:11:30 juju-e4d256-prod-github-runner-207 kernel: [20864.571619] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 11:11:30 juju-e4d256-prod-github-runner-207 kernel: [20864.572737] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 11:11:30 juju-e4d256-prod-github-runner-207 kernel: [20864.573953] Call Trace: Aug 22 11:11:30 juju-e4d256-prod-github-runner-207 kernel: [20864.574908] Aug 22 11:11:30 juju-e4d256-prod-github-runner-207 kernel: [20864.575827] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:11:30 juju-e4d256-prod-github-runner-207 kernel: [20864.576858] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:11:30 juju-e4d256-prod-github-runner-207 kernel: [20864.578011] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:11:30 juju-e4d256-prod-github-runner-207 kernel: [20864.579612] ? show_regs.part.0+0x23/0x29 Aug 22 11:11:30 juju-e4d256-prod-github-runner-207 kernel: [20864.580760] ? show_regs.cold+0x8/0xd Aug 22 11:11:30 juju-e4d256-prod-github-runner-207 kernel: [20864.581781] ? watchdog_timer_fn+0x1be/0x220 Aug 22 11:11:30 juju-e4d256-prod-github-runner-207 kernel: [20864.582823] ? lockup_detector_update_enable+0x60/0x60 Aug 22 11:11:30 juju-e4d256-prod-github-runner-207 kernel: [20864.583922] ? __hrtimer_run_queues+0x107/0x230 Aug 22 11:11:30 juju-e4d256-prod-github-runner-207 kernel: [20864.584973] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 11:11:30 juju-e4d256-prod-github-runner-207 kernel: [20864.586020] ? hrtimer_interrupt+0x101/0x220 Aug 22 11:11:30 juju-e4d256-prod-github-runner-207 kernel: [20864.587095] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 11:11:30 juju-e4d256-prod-github-runner-207 kernel: [20864.588215] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 11:11:30 juju-e4d256-prod-github-runner-207 kernel: [20864.589280] Aug 22 11:11:30 juju-e4d256-prod-github-runner-207 kernel: [20864.590138] Aug 22 11:11:30 juju-e4d256-prod-github-runner-207 kernel: [20864.590997] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 11:11:30 juju-e4d256-prod-github-runner-207 kernel: [20864.592032] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:11:30 juju-e4d256-prod-github-runner-207 kernel: [20864.593080] ? _raw_spin_lock+0x22/0x30 Aug 22 11:11:30 juju-e4d256-prod-github-runner-207 kernel: [20864.594029] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:11:30 juju-e4d256-prod-github-runner-207 kernel: [20864.595073] direct_page_fault+0x206/0x310 [kvm] Aug 22 11:11:30 juju-e4d256-prod-github-runner-207 kernel: [20864.598464] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 11:11:30 juju-e4d256-prod-github-runner-207 kernel: [20864.599526] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 11:11:30 juju-e4d256-prod-github-runner-207 kernel: [20864.600535] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 11:11:30 juju-e4d256-prod-github-runner-207 kernel: [20864.601771] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 11:11:30 juju-e4d256-prod-github-runner-207 kernel: [20864.602762] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 11:11:30 juju-e4d256-prod-github-runner-207 kernel: [20864.603763] handle_exit+0x98/0x230 [kvm_amd] Aug 22 11:11:30 juju-e4d256-prod-github-runner-207 kernel: [20864.604692] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 11:11:30 juju-e4d256-prod-github-runner-207 kernel: [20864.605624] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 11:11:30 juju-e4d256-prod-github-runner-207 kernel: [20864.606583] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 11:11:30 juju-e4d256-prod-github-runner-207 kernel: [20864.607493] vcpu_run+0x62/0x2c0 [kvm] Aug 22 11:11:30 juju-e4d256-prod-github-runner-207 kernel: [20864.608308] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 11:11:30 juju-e4d256-prod-github-runner-207 kernel: [20864.609125] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 11:11:30 juju-e4d256-prod-github-runner-207 kernel: [20864.609999] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 11:11:30 juju-e4d256-prod-github-runner-207 kernel: [20864.610854] ? __seccomp_filter+0x4a/0x4a0 Aug 22 11:11:30 juju-e4d256-prod-github-runner-207 kernel: [20864.611610] ? __fget_files+0x86/0xc0 Aug 22 11:11:30 juju-e4d256-prod-github-runner-207 kernel: [20864.612326] __x64_sys_ioctl+0x95/0xd0 Aug 22 11:11:30 juju-e4d256-prod-github-runner-207 kernel: [20864.613024] do_syscall_64+0x5c/0xc0 Aug 22 11:11:30 juju-e4d256-prod-github-runner-207 kernel: [20864.613698] ? do_futex+0x162/0x1f0 Aug 22 11:11:30 juju-e4d256-prod-github-runner-207 kernel: [20864.614470] ? __x64_sys_futex+0x78/0x1e0 Aug 22 11:11:30 juju-e4d256-prod-github-runner-207 kernel: [20864.615152] ? __secure_computing+0xa9/0x120 Aug 22 11:11:30 juju-e4d256-prod-github-runner-207 kernel: [20864.616032] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 11:11:30 juju-e4d256-prod-github-runner-207 kernel: [20864.616792] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:11:30 juju-e4d256-prod-github-runner-207 kernel: [20864.617519] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:11:30 juju-e4d256-prod-github-runner-207 kernel: [20864.618257] ? do_syscall_64+0x69/0xc0 Aug 22 11:11:30 juju-e4d256-prod-github-runner-207 kernel: [20864.618944] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:11:30 juju-e4d256-prod-github-runner-207 kernel: [20864.619679] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:11:30 juju-e4d256-prod-github-runner-207 kernel: [20864.620404] ? do_syscall_64+0x69/0xc0 Aug 22 11:11:30 juju-e4d256-prod-github-runner-207 kernel: [20864.621039] ? do_syscall_64+0x69/0xc0 Aug 22 11:11:30 juju-e4d256-prod-github-runner-207 kernel: [20864.621663] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 11:11:30 juju-e4d256-prod-github-runner-207 kernel: [20864.622403] RIP: 0033:0x7faa5d0edaff Aug 22 11:11:30 juju-e4d256-prod-github-runner-207 kernel: [20864.623087] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 11:11:30 juju-e4d256-prod-github-runner-207 kernel: [20864.625124] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 11:11:30 juju-e4d256-prod-github-runner-207 kernel: [20864.626058] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 11:11:30 juju-e4d256-prod-github-runner-207 kernel: [20864.626973] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 11:11:30 juju-e4d256-prod-github-runner-207 kernel: [20864.627868] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 11:11:30 juju-e4d256-prod-github-runner-207 kernel: [20864.628761] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 11:11:30 juju-e4d256-prod-github-runner-207 kernel: [20864.629662] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 11:11:30 juju-e4d256-prod-github-runner-207 kernel: [20864.630572] Aug 22 11:11:44 juju-e4d256-prod-github-runner-207 kernel: [20878.580708] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 11:11:44 juju-e4d256-prod-github-runner-207 kernel: [20878.581659] rcu: 1-....: (5174137 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=2505498 Aug 22 11:11:44 juju-e4d256-prod-github-runner-207 kernel: [20878.582914] (t=5190345 jiffies g=23269 q=26577) Aug 22 11:11:44 juju-e4d256-prod-github-runner-207 kernel: [20878.583920] NMI backtrace for cpu 1 Aug 22 11:11:44 juju-e4d256-prod-github-runner-207 kernel: [20878.584744] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 11:11:44 juju-e4d256-prod-github-runner-207 kernel: [20878.586490] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 11:11:44 juju-e4d256-prod-github-runner-207 kernel: [20878.587547] Call Trace: Aug 22 11:11:44 juju-e4d256-prod-github-runner-207 kernel: [20878.588222] Aug 22 11:11:44 juju-e4d256-prod-github-runner-207 kernel: [20878.588868] show_stack+0x52/0x5c Aug 22 11:11:44 juju-e4d256-prod-github-runner-207 kernel: [20878.589591] dump_stack_lvl+0x4a/0x63 Aug 22 11:11:44 juju-e4d256-prod-github-runner-207 kernel: [20878.590533] dump_stack+0x10/0x16 Aug 22 11:11:44 juju-e4d256-prod-github-runner-207 kernel: [20878.591252] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 11:11:44 juju-e4d256-prod-github-runner-207 kernel: [20878.592084] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 11:11:44 juju-e4d256-prod-github-runner-207 kernel: [20878.592876] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 11:11:44 juju-e4d256-prod-github-runner-207 kernel: [20878.593709] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 11:11:44 juju-e4d256-prod-github-runner-207 kernel: [20878.594542] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 11:11:44 juju-e4d256-prod-github-runner-207 kernel: [20878.595349] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 11:11:44 juju-e4d256-prod-github-runner-207 kernel: [20878.596119] print_cpu_stall.cold+0x2f/0xe2 Aug 22 11:11:44 juju-e4d256-prod-github-runner-207 kernel: [20878.596881] ? timekeeping_update+0xf7/0x150 Aug 22 11:11:44 juju-e4d256-prod-github-runner-207 kernel: [20878.597650] check_cpu_stall+0x109/0x270 Aug 22 11:11:44 juju-e4d256-prod-github-runner-207 kernel: [20878.598406] rcu_sched_clock_irq+0x9a/0x250 Aug 22 11:11:44 juju-e4d256-prod-github-runner-207 kernel: [20878.599167] update_process_times+0x94/0xd0 Aug 22 11:11:44 juju-e4d256-prod-github-runner-207 kernel: [20878.599930] tick_sched_handle+0x29/0x70 Aug 22 11:11:44 juju-e4d256-prod-github-runner-207 kernel: [20878.600770] tick_sched_timer+0x8c/0xc0 Aug 22 11:11:44 juju-e4d256-prod-github-runner-207 kernel: [20878.601544] ? tick_nohz_handler+0xb0/0xb0 Aug 22 11:11:44 juju-e4d256-prod-github-runner-207 kernel: [20878.602333] __hrtimer_run_queues+0x107/0x230 Aug 22 11:11:44 juju-e4d256-prod-github-runner-207 kernel: [20878.603116] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 11:11:44 juju-e4d256-prod-github-runner-207 kernel: [20878.603895] hrtimer_interrupt+0x101/0x220 Aug 22 11:11:44 juju-e4d256-prod-github-runner-207 kernel: [20878.604654] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 11:11:44 juju-e4d256-prod-github-runner-207 kernel: [20878.605588] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 11:11:44 juju-e4d256-prod-github-runner-207 kernel: [20878.606411] Aug 22 11:11:44 juju-e4d256-prod-github-runner-207 kernel: [20878.607048] Aug 22 11:11:44 juju-e4d256-prod-github-runner-207 kernel: [20878.607824] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 11:11:44 juju-e4d256-prod-github-runner-207 kernel: [20878.608645] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:11:44 juju-e4d256-prod-github-runner-207 kernel: [20878.609526] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 11:11:44 juju-e4d256-prod-github-runner-207 kernel: [20878.611742] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 11:11:44 juju-e4d256-prod-github-runner-207 kernel: [20878.612665] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 11:11:44 juju-e4d256-prod-github-runner-207 kernel: [20878.613661] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 11:11:44 juju-e4d256-prod-github-runner-207 kernel: [20878.614653] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 11:11:44 juju-e4d256-prod-github-runner-207 kernel: [20878.615627] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 11:11:44 juju-e4d256-prod-github-runner-207 kernel: [20878.616698] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 11:11:44 juju-e4d256-prod-github-runner-207 kernel: [20878.617699] ? _raw_spin_lock+0x22/0x30 Aug 22 11:11:44 juju-e4d256-prod-github-runner-207 kernel: [20878.618501] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:11:44 juju-e4d256-prod-github-runner-207 kernel: [20878.619347] direct_page_fault+0x206/0x310 [kvm] Aug 22 11:11:44 juju-e4d256-prod-github-runner-207 kernel: [20878.620193] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 11:11:44 juju-e4d256-prod-github-runner-207 kernel: [20878.621031] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 11:11:44 juju-e4d256-prod-github-runner-207 kernel: [20878.621875] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 11:11:44 juju-e4d256-prod-github-runner-207 kernel: [20878.622845] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 11:11:44 juju-e4d256-prod-github-runner-207 kernel: [20878.623714] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 11:11:44 juju-e4d256-prod-github-runner-207 kernel: [20878.624560] handle_exit+0x98/0x230 [kvm_amd] Aug 22 11:11:44 juju-e4d256-prod-github-runner-207 kernel: [20878.625353] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 11:11:44 juju-e4d256-prod-github-runner-207 kernel: [20878.626170] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 11:11:44 juju-e4d256-prod-github-runner-207 kernel: [20878.626973] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 11:11:44 juju-e4d256-prod-github-runner-207 kernel: [20878.627761] vcpu_run+0x62/0x2c0 [kvm] Aug 22 11:11:44 juju-e4d256-prod-github-runner-207 kernel: [20878.628495] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 11:11:44 juju-e4d256-prod-github-runner-207 kernel: [20878.629232] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 11:11:44 juju-e4d256-prod-github-runner-207 kernel: [20878.630052] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 11:11:44 juju-e4d256-prod-github-runner-207 kernel: [20878.630854] ? __seccomp_filter+0x4a/0x4a0 Aug 22 11:11:44 juju-e4d256-prod-github-runner-207 kernel: [20878.631580] ? __fget_files+0x86/0xc0 Aug 22 11:11:44 juju-e4d256-prod-github-runner-207 kernel: [20878.632273] __x64_sys_ioctl+0x95/0xd0 Aug 22 11:11:44 juju-e4d256-prod-github-runner-207 kernel: [20878.632967] do_syscall_64+0x5c/0xc0 Aug 22 11:11:44 juju-e4d256-prod-github-runner-207 kernel: [20878.633648] ? do_futex+0x162/0x1f0 Aug 22 11:11:44 juju-e4d256-prod-github-runner-207 kernel: [20878.634333] ? __x64_sys_futex+0x78/0x1e0 Aug 22 11:11:44 juju-e4d256-prod-github-runner-207 kernel: [20878.635036] ? __secure_computing+0xa9/0x120 Aug 22 11:11:44 juju-e4d256-prod-github-runner-207 kernel: [20878.635774] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 11:11:44 juju-e4d256-prod-github-runner-207 kernel: [20878.636572] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:11:44 juju-e4d256-prod-github-runner-207 kernel: [20878.637328] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:11:44 juju-e4d256-prod-github-runner-207 kernel: [20878.638101] ? do_syscall_64+0x69/0xc0 Aug 22 11:11:44 juju-e4d256-prod-github-runner-207 kernel: [20878.638791] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:11:44 juju-e4d256-prod-github-runner-207 kernel: [20878.639558] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:11:44 juju-e4d256-prod-github-runner-207 kernel: [20878.640323] ? do_syscall_64+0x69/0xc0 Aug 22 11:11:44 juju-e4d256-prod-github-runner-207 kernel: [20878.641019] ? do_syscall_64+0x69/0xc0 Aug 22 11:11:44 juju-e4d256-prod-github-runner-207 kernel: [20878.641708] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 11:11:44 juju-e4d256-prod-github-runner-207 kernel: [20878.642498] RIP: 0033:0x7faa5d0edaff Aug 22 11:11:44 juju-e4d256-prod-github-runner-207 kernel: [20878.643180] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 11:11:44 juju-e4d256-prod-github-runner-207 kernel: [20878.645275] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 11:11:44 juju-e4d256-prod-github-runner-207 kernel: [20878.646255] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 11:11:44 juju-e4d256-prod-github-runner-207 kernel: [20878.647213] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 11:11:44 juju-e4d256-prod-github-runner-207 kernel: [20878.648186] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 11:11:44 juju-e4d256-prod-github-runner-207 kernel: [20878.649140] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 11:11:44 juju-e4d256-prod-github-runner-207 kernel: [20878.650114] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 11:11:44 juju-e4d256-prod-github-runner-207 kernel: [20878.651037] Aug 22 11:12:10 juju-e4d256-prod-github-runner-207 kernel: [20904.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 19360s! [qemu-system-x86:6715] Aug 22 11:12:10 juju-e4d256-prod-github-runner-207 kernel: [20904.543097] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 11:12:10 juju-e4d256-prod-github-runner-207 kernel: [20904.543168] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 11:12:10 juju-e4d256-prod-github-runner-207 kernel: [20904.555724] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 11:12:10 juju-e4d256-prod-github-runner-207 kernel: [20904.557807] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 11:12:10 juju-e4d256-prod-github-runner-207 kernel: [20904.559672] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:12:10 juju-e4d256-prod-github-runner-207 kernel: [20904.561130] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 11:12:10 juju-e4d256-prod-github-runner-207 kernel: [20904.564746] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 11:12:10 juju-e4d256-prod-github-runner-207 kernel: [20904.566176] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 11:12:10 juju-e4d256-prod-github-runner-207 kernel: [20904.567453] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 11:12:10 juju-e4d256-prod-github-runner-207 kernel: [20904.568614] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 11:12:10 juju-e4d256-prod-github-runner-207 kernel: [20904.569793] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 11:12:10 juju-e4d256-prod-github-runner-207 kernel: [20904.570960] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 11:12:10 juju-e4d256-prod-github-runner-207 kernel: [20904.572127] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 11:12:10 juju-e4d256-prod-github-runner-207 kernel: [20904.573395] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 11:12:10 juju-e4d256-prod-github-runner-207 kernel: [20904.574532] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 11:12:10 juju-e4d256-prod-github-runner-207 kernel: [20904.575739] Call Trace: Aug 22 11:12:10 juju-e4d256-prod-github-runner-207 kernel: [20904.576654] Aug 22 11:12:10 juju-e4d256-prod-github-runner-207 kernel: [20904.577550] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:12:10 juju-e4d256-prod-github-runner-207 kernel: [20904.578680] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:12:10 juju-e4d256-prod-github-runner-207 kernel: [20904.579731] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:12:10 juju-e4d256-prod-github-runner-207 kernel: [20904.580822] ? show_regs.part.0+0x23/0x29 Aug 22 11:12:10 juju-e4d256-prod-github-runner-207 kernel: [20904.581839] ? show_regs.cold+0x8/0xd Aug 22 11:12:10 juju-e4d256-prod-github-runner-207 kernel: [20904.582820] ? watchdog_timer_fn+0x1be/0x220 Aug 22 11:12:10 juju-e4d256-prod-github-runner-207 kernel: [20904.583853] ? lockup_detector_update_enable+0x60/0x60 Aug 22 11:12:10 juju-e4d256-prod-github-runner-207 kernel: [20904.584930] ? __hrtimer_run_queues+0x107/0x230 Aug 22 11:12:10 juju-e4d256-prod-github-runner-207 kernel: [20904.585989] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 11:12:10 juju-e4d256-prod-github-runner-207 kernel: [20904.587025] ? hrtimer_interrupt+0x101/0x220 Aug 22 11:12:10 juju-e4d256-prod-github-runner-207 kernel: [20904.588042] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 11:12:10 juju-e4d256-prod-github-runner-207 kernel: [20904.589116] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 11:12:10 juju-e4d256-prod-github-runner-207 kernel: [20904.590178] Aug 22 11:12:10 juju-e4d256-prod-github-runner-207 kernel: [20904.591035] Aug 22 11:12:10 juju-e4d256-prod-github-runner-207 kernel: [20904.591877] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 11:12:10 juju-e4d256-prod-github-runner-207 kernel: [20904.592914] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:12:10 juju-e4d256-prod-github-runner-207 kernel: [20904.593973] ? _raw_spin_lock+0x22/0x30 Aug 22 11:12:10 juju-e4d256-prod-github-runner-207 kernel: [20904.594970] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:12:10 juju-e4d256-prod-github-runner-207 kernel: [20904.596006] direct_page_fault+0x206/0x310 [kvm] Aug 22 11:12:10 juju-e4d256-prod-github-runner-207 kernel: [20904.597036] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 11:12:10 juju-e4d256-prod-github-runner-207 kernel: [20904.598114] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 11:12:10 juju-e4d256-prod-github-runner-207 kernel: [20904.599130] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 11:12:10 juju-e4d256-prod-github-runner-207 kernel: [20904.600181] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 11:12:10 juju-e4d256-prod-github-runner-207 kernel: [20904.601170] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 11:12:10 juju-e4d256-prod-github-runner-207 kernel: [20904.602194] handle_exit+0x98/0x230 [kvm_amd] Aug 22 11:12:10 juju-e4d256-prod-github-runner-207 kernel: [20904.603100] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 11:12:10 juju-e4d256-prod-github-runner-207 kernel: [20904.604095] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 11:12:10 juju-e4d256-prod-github-runner-207 kernel: [20904.605308] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 11:12:10 juju-e4d256-prod-github-runner-207 kernel: [20904.606298] vcpu_run+0x62/0x2c0 [kvm] Aug 22 11:12:10 juju-e4d256-prod-github-runner-207 kernel: [20904.607405] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 11:12:10 juju-e4d256-prod-github-runner-207 kernel: [20904.608518] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 11:12:10 juju-e4d256-prod-github-runner-207 kernel: [20904.609708] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 11:12:10 juju-e4d256-prod-github-runner-207 kernel: [20904.610807] ? __seccomp_filter+0x4a/0x4a0 Aug 22 11:12:10 juju-e4d256-prod-github-runner-207 kernel: [20904.611859] ? __fget_files+0x86/0xc0 Aug 22 11:12:10 juju-e4d256-prod-github-runner-207 kernel: [20904.612823] __x64_sys_ioctl+0x95/0xd0 Aug 22 11:12:10 juju-e4d256-prod-github-runner-207 kernel: [20904.613766] do_syscall_64+0x5c/0xc0 Aug 22 11:12:10 juju-e4d256-prod-github-runner-207 kernel: [20904.614683] ? do_futex+0x162/0x1f0 Aug 22 11:12:10 juju-e4d256-prod-github-runner-207 kernel: [20904.615778] ? __x64_sys_futex+0x78/0x1e0 Aug 22 11:12:10 juju-e4d256-prod-github-runner-207 kernel: [20904.616905] ? __secure_computing+0xa9/0x120 Aug 22 11:12:10 juju-e4d256-prod-github-runner-207 kernel: [20904.618089] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 11:12:10 juju-e4d256-prod-github-runner-207 kernel: [20904.618944] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:12:10 juju-e4d256-prod-github-runner-207 kernel: [20904.619696] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:12:10 juju-e4d256-prod-github-runner-207 kernel: [20904.620425] ? do_syscall_64+0x69/0xc0 Aug 22 11:12:10 juju-e4d256-prod-github-runner-207 kernel: [20904.621103] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:12:10 juju-e4d256-prod-github-runner-207 kernel: [20904.621844] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:12:10 juju-e4d256-prod-github-runner-207 kernel: [20904.622546] ? do_syscall_64+0x69/0xc0 Aug 22 11:12:10 juju-e4d256-prod-github-runner-207 kernel: [20904.623180] ? do_syscall_64+0x69/0xc0 Aug 22 11:12:10 juju-e4d256-prod-github-runner-207 kernel: [20904.623810] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 11:12:10 juju-e4d256-prod-github-runner-207 kernel: [20904.624519] RIP: 0033:0x7faa5d0edaff Aug 22 11:12:10 juju-e4d256-prod-github-runner-207 kernel: [20904.625149] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 11:12:10 juju-e4d256-prod-github-runner-207 kernel: [20904.627168] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 11:12:10 juju-e4d256-prod-github-runner-207 kernel: [20904.628082] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 11:12:10 juju-e4d256-prod-github-runner-207 kernel: [20904.629009] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 11:12:10 juju-e4d256-prod-github-runner-207 kernel: [20904.629926] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 11:12:10 juju-e4d256-prod-github-runner-207 kernel: [20904.630819] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 11:12:10 juju-e4d256-prod-github-runner-207 kernel: [20904.631731] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 11:12:10 juju-e4d256-prod-github-runner-207 kernel: [20904.632798] Aug 22 11:12:38 juju-e4d256-prod-github-runner-207 kernel: [20932.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 19386s! [qemu-system-x86:6715] Aug 22 11:12:38 juju-e4d256-prod-github-runner-207 kernel: [20932.543133] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 11:12:38 juju-e4d256-prod-github-runner-207 kernel: [20932.543206] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 11:12:38 juju-e4d256-prod-github-runner-207 kernel: [20932.555536] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 11:12:38 juju-e4d256-prod-github-runner-207 kernel: [20932.556819] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 11:12:38 juju-e4d256-prod-github-runner-207 kernel: [20932.558076] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:12:38 juju-e4d256-prod-github-runner-207 kernel: [20932.559141] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 11:12:38 juju-e4d256-prod-github-runner-207 kernel: [20932.562032] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 11:12:38 juju-e4d256-prod-github-runner-207 kernel: [20932.563132] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 11:12:38 juju-e4d256-prod-github-runner-207 kernel: [20932.564340] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 11:12:38 juju-e4d256-prod-github-runner-207 kernel: [20932.565540] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 11:12:38 juju-e4d256-prod-github-runner-207 kernel: [20932.566721] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 11:12:38 juju-e4d256-prod-github-runner-207 kernel: [20932.567933] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 11:12:38 juju-e4d256-prod-github-runner-207 kernel: [20932.569149] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 11:12:38 juju-e4d256-prod-github-runner-207 kernel: [20932.570590] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 11:12:38 juju-e4d256-prod-github-runner-207 kernel: [20932.571707] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 11:12:38 juju-e4d256-prod-github-runner-207 kernel: [20932.572942] Call Trace: Aug 22 11:12:38 juju-e4d256-prod-github-runner-207 kernel: [20932.573885] Aug 22 11:12:38 juju-e4d256-prod-github-runner-207 kernel: [20932.574803] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:12:38 juju-e4d256-prod-github-runner-207 kernel: [20932.575844] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:12:38 juju-e4d256-prod-github-runner-207 kernel: [20932.576876] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:12:38 juju-e4d256-prod-github-runner-207 kernel: [20932.577980] ? show_regs.part.0+0x23/0x29 Aug 22 11:12:38 juju-e4d256-prod-github-runner-207 kernel: [20932.578989] ? show_regs.cold+0x8/0xd Aug 22 11:12:38 juju-e4d256-prod-github-runner-207 kernel: [20932.579968] ? watchdog_timer_fn+0x1be/0x220 Aug 22 11:12:38 juju-e4d256-prod-github-runner-207 kernel: [20932.581010] ? lockup_detector_update_enable+0x60/0x60 Aug 22 11:12:38 juju-e4d256-prod-github-runner-207 kernel: [20932.582104] ? __hrtimer_run_queues+0x107/0x230 Aug 22 11:12:38 juju-e4d256-prod-github-runner-207 kernel: [20932.583170] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 11:12:38 juju-e4d256-prod-github-runner-207 kernel: [20932.584215] ? hrtimer_interrupt+0x101/0x220 Aug 22 11:12:38 juju-e4d256-prod-github-runner-207 kernel: [20932.585259] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 11:12:38 juju-e4d256-prod-github-runner-207 kernel: [20932.586411] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 11:12:38 juju-e4d256-prod-github-runner-207 kernel: [20932.587470] Aug 22 11:12:38 juju-e4d256-prod-github-runner-207 kernel: [20932.588330] Aug 22 11:12:38 juju-e4d256-prod-github-runner-207 kernel: [20932.589173] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 11:12:38 juju-e4d256-prod-github-runner-207 kernel: [20932.590245] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:12:38 juju-e4d256-prod-github-runner-207 kernel: [20932.591299] ? _raw_spin_lock+0x22/0x30 Aug 22 11:12:38 juju-e4d256-prod-github-runner-207 kernel: [20932.592251] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:12:38 juju-e4d256-prod-github-runner-207 kernel: [20932.593285] direct_page_fault+0x206/0x310 [kvm] Aug 22 11:12:38 juju-e4d256-prod-github-runner-207 kernel: [20932.594349] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 11:12:38 juju-e4d256-prod-github-runner-207 kernel: [20932.595370] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 11:12:38 juju-e4d256-prod-github-runner-207 kernel: [20932.596391] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 11:12:38 juju-e4d256-prod-github-runner-207 kernel: [20932.597397] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 11:12:38 juju-e4d256-prod-github-runner-207 kernel: [20932.598402] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 11:12:38 juju-e4d256-prod-github-runner-207 kernel: [20932.599397] handle_exit+0x98/0x230 [kvm_amd] Aug 22 11:12:38 juju-e4d256-prod-github-runner-207 kernel: [20932.600300] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 11:12:38 juju-e4d256-prod-github-runner-207 kernel: [20932.601227] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 11:12:38 juju-e4d256-prod-github-runner-207 kernel: [20932.602183] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 11:12:38 juju-e4d256-prod-github-runner-207 kernel: [20932.603114] vcpu_run+0x62/0x2c0 [kvm] Aug 22 11:12:38 juju-e4d256-prod-github-runner-207 kernel: [20932.603937] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 11:12:38 juju-e4d256-prod-github-runner-207 kernel: [20932.604753] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 11:12:38 juju-e4d256-prod-github-runner-207 kernel: [20932.605644] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 11:12:38 juju-e4d256-prod-github-runner-207 kernel: [20932.606451] ? __seccomp_filter+0x4a/0x4a0 Aug 22 11:12:38 juju-e4d256-prod-github-runner-207 kernel: [20932.607207] ? __fget_files+0x86/0xc0 Aug 22 11:12:38 juju-e4d256-prod-github-runner-207 kernel: [20932.607918] __x64_sys_ioctl+0x95/0xd0 Aug 22 11:12:38 juju-e4d256-prod-github-runner-207 kernel: [20932.608619] do_syscall_64+0x5c/0xc0 Aug 22 11:12:38 juju-e4d256-prod-github-runner-207 kernel: [20932.609294] ? do_futex+0x162/0x1f0 Aug 22 11:12:38 juju-e4d256-prod-github-runner-207 kernel: [20932.609992] ? __x64_sys_futex+0x78/0x1e0 Aug 22 11:12:38 juju-e4d256-prod-github-runner-207 kernel: [20932.610673] ? __secure_computing+0xa9/0x120 Aug 22 11:12:38 juju-e4d256-prod-github-runner-207 kernel: [20932.611383] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 11:12:38 juju-e4d256-prod-github-runner-207 kernel: [20932.612167] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:12:38 juju-e4d256-prod-github-runner-207 kernel: [20932.612928] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:12:38 juju-e4d256-prod-github-runner-207 kernel: [20932.613687] ? do_syscall_64+0x69/0xc0 Aug 22 11:12:38 juju-e4d256-prod-github-runner-207 kernel: [20932.614397] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:12:38 juju-e4d256-prod-github-runner-207 kernel: [20932.615148] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:12:38 juju-e4d256-prod-github-runner-207 kernel: [20932.615883] ? do_syscall_64+0x69/0xc0 Aug 22 11:12:38 juju-e4d256-prod-github-runner-207 kernel: [20932.616537] ? do_syscall_64+0x69/0xc0 Aug 22 11:12:38 juju-e4d256-prod-github-runner-207 kernel: [20932.617182] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 11:12:38 juju-e4d256-prod-github-runner-207 kernel: [20932.617921] RIP: 0033:0x7faa5d0edaff Aug 22 11:12:38 juju-e4d256-prod-github-runner-207 kernel: [20932.618556] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 11:12:38 juju-e4d256-prod-github-runner-207 kernel: [20932.620583] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 11:12:38 juju-e4d256-prod-github-runner-207 kernel: [20932.621546] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 11:12:38 juju-e4d256-prod-github-runner-207 kernel: [20932.622458] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 11:12:38 juju-e4d256-prod-github-runner-207 kernel: [20932.623369] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 11:12:38 juju-e4d256-prod-github-runner-207 kernel: [20932.624278] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 11:12:38 juju-e4d256-prod-github-runner-207 kernel: [20932.625196] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 11:12:38 juju-e4d256-prod-github-runner-207 kernel: [20932.626142] Aug 22 11:13:06 juju-e4d256-prod-github-runner-207 kernel: [20960.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 19413s! [qemu-system-x86:6715] Aug 22 11:13:06 juju-e4d256-prod-github-runner-207 kernel: [20960.543854] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 11:13:06 juju-e4d256-prod-github-runner-207 kernel: [20960.544142] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 11:13:06 juju-e4d256-prod-github-runner-207 kernel: [20960.556290] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 11:13:06 juju-e4d256-prod-github-runner-207 kernel: [20960.557587] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 11:13:06 juju-e4d256-prod-github-runner-207 kernel: [20960.558812] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:13:06 juju-e4d256-prod-github-runner-207 kernel: [20960.559876] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 11:13:06 juju-e4d256-prod-github-runner-207 kernel: [20960.562438] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 11:13:06 juju-e4d256-prod-github-runner-207 kernel: [20960.563482] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 11:13:06 juju-e4d256-prod-github-runner-207 kernel: [20960.564644] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 11:13:06 juju-e4d256-prod-github-runner-207 kernel: [20960.565814] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 11:13:06 juju-e4d256-prod-github-runner-207 kernel: [20960.566977] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 11:13:06 juju-e4d256-prod-github-runner-207 kernel: [20960.568138] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 11:13:06 juju-e4d256-prod-github-runner-207 kernel: [20960.569316] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 11:13:06 juju-e4d256-prod-github-runner-207 kernel: [20960.570556] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 11:13:06 juju-e4d256-prod-github-runner-207 kernel: [20960.571665] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 11:13:06 juju-e4d256-prod-github-runner-207 kernel: [20960.572868] Call Trace: Aug 22 11:13:06 juju-e4d256-prod-github-runner-207 kernel: [20960.573791] Aug 22 11:13:06 juju-e4d256-prod-github-runner-207 kernel: [20960.574692] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:13:06 juju-e4d256-prod-github-runner-207 kernel: [20960.575723] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:13:06 juju-e4d256-prod-github-runner-207 kernel: [20960.576746] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:13:06 juju-e4d256-prod-github-runner-207 kernel: [20960.577855] ? show_regs.part.0+0x23/0x29 Aug 22 11:13:06 juju-e4d256-prod-github-runner-207 kernel: [20960.578857] ? show_regs.cold+0x8/0xd Aug 22 11:13:06 juju-e4d256-prod-github-runner-207 kernel: [20960.579830] ? watchdog_timer_fn+0x1be/0x220 Aug 22 11:13:06 juju-e4d256-prod-github-runner-207 kernel: [20960.580843] ? lockup_detector_update_enable+0x60/0x60 Aug 22 11:13:06 juju-e4d256-prod-github-runner-207 kernel: [20960.581915] ? __hrtimer_run_queues+0x107/0x230 Aug 22 11:13:06 juju-e4d256-prod-github-runner-207 kernel: [20960.582945] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 11:13:06 juju-e4d256-prod-github-runner-207 kernel: [20960.583971] ? hrtimer_interrupt+0x101/0x220 Aug 22 11:13:06 juju-e4d256-prod-github-runner-207 kernel: [20960.585008] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 11:13:06 juju-e4d256-prod-github-runner-207 kernel: [20960.586087] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 11:13:06 juju-e4d256-prod-github-runner-207 kernel: [20960.587398] Aug 22 11:13:06 juju-e4d256-prod-github-runner-207 kernel: [20960.588256] Aug 22 11:13:06 juju-e4d256-prod-github-runner-207 kernel: [20960.589112] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 11:13:06 juju-e4d256-prod-github-runner-207 kernel: [20960.590156] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:13:06 juju-e4d256-prod-github-runner-207 kernel: [20960.591209] ? _raw_spin_lock+0x22/0x30 Aug 22 11:13:06 juju-e4d256-prod-github-runner-207 kernel: [20960.592163] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:13:06 juju-e4d256-prod-github-runner-207 kernel: [20960.593194] direct_page_fault+0x206/0x310 [kvm] Aug 22 11:13:06 juju-e4d256-prod-github-runner-207 kernel: [20960.594227] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 11:13:06 juju-e4d256-prod-github-runner-207 kernel: [20960.595237] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 11:13:06 juju-e4d256-prod-github-runner-207 kernel: [20960.596324] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 11:13:06 juju-e4d256-prod-github-runner-207 kernel: [20960.597460] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 11:13:06 juju-e4d256-prod-github-runner-207 kernel: [20960.598419] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 11:13:06 juju-e4d256-prod-github-runner-207 kernel: [20960.599398] handle_exit+0x98/0x230 [kvm_amd] Aug 22 11:13:06 juju-e4d256-prod-github-runner-207 kernel: [20960.600297] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 11:13:06 juju-e4d256-prod-github-runner-207 kernel: [20960.601229] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 11:13:06 juju-e4d256-prod-github-runner-207 kernel: [20960.602156] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 11:13:06 juju-e4d256-prod-github-runner-207 kernel: [20960.603060] vcpu_run+0x62/0x2c0 [kvm] Aug 22 11:13:06 juju-e4d256-prod-github-runner-207 kernel: [20960.603872] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 11:13:06 juju-e4d256-prod-github-runner-207 kernel: [20960.604684] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 11:13:06 juju-e4d256-prod-github-runner-207 kernel: [20960.605563] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 11:13:06 juju-e4d256-prod-github-runner-207 kernel: [20960.606363] ? __seccomp_filter+0x4a/0x4a0 Aug 22 11:13:06 juju-e4d256-prod-github-runner-207 kernel: [20960.607108] ? __fget_files+0x86/0xc0 Aug 22 11:13:06 juju-e4d256-prod-github-runner-207 kernel: [20960.607810] __x64_sys_ioctl+0x95/0xd0 Aug 22 11:13:06 juju-e4d256-prod-github-runner-207 kernel: [20960.608503] do_syscall_64+0x5c/0xc0 Aug 22 11:13:06 juju-e4d256-prod-github-runner-207 kernel: [20960.609175] ? do_futex+0x162/0x1f0 Aug 22 11:13:06 juju-e4d256-prod-github-runner-207 kernel: [20960.609826] ? __x64_sys_futex+0x78/0x1e0 Aug 22 11:13:06 juju-e4d256-prod-github-runner-207 kernel: [20960.610503] ? __secure_computing+0xa9/0x120 Aug 22 11:13:06 juju-e4d256-prod-github-runner-207 kernel: [20960.611200] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 11:13:06 juju-e4d256-prod-github-runner-207 kernel: [20960.612031] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:13:06 juju-e4d256-prod-github-runner-207 kernel: [20960.612757] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:13:06 juju-e4d256-prod-github-runner-207 kernel: [20960.613495] ? do_syscall_64+0x69/0xc0 Aug 22 11:13:06 juju-e4d256-prod-github-runner-207 kernel: [20960.614143] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:13:06 juju-e4d256-prod-github-runner-207 kernel: [20960.614847] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:13:06 juju-e4d256-prod-github-runner-207 kernel: [20960.615543] ? do_syscall_64+0x69/0xc0 Aug 22 11:13:06 juju-e4d256-prod-github-runner-207 kernel: [20960.616167] ? do_syscall_64+0x69/0xc0 Aug 22 11:13:06 juju-e4d256-prod-github-runner-207 kernel: [20960.616791] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 11:13:06 juju-e4d256-prod-github-runner-207 kernel: [20960.617513] RIP: 0033:0x7faa5d0edaff Aug 22 11:13:06 juju-e4d256-prod-github-runner-207 kernel: [20960.618165] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 11:13:06 juju-e4d256-prod-github-runner-207 kernel: [20960.620148] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 11:13:06 juju-e4d256-prod-github-runner-207 kernel: [20960.621063] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 11:13:06 juju-e4d256-prod-github-runner-207 kernel: [20960.621966] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 11:13:06 juju-e4d256-prod-github-runner-207 kernel: [20960.622853] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 11:13:06 juju-e4d256-prod-github-runner-207 kernel: [20960.623754] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 11:13:06 juju-e4d256-prod-github-runner-207 kernel: [20960.624668] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 11:13:06 juju-e4d256-prod-github-runner-207 kernel: [20960.625620] Aug 22 11:13:34 juju-e4d256-prod-github-runner-207 kernel: [20988.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 19439s! [qemu-system-x86:6715] Aug 22 11:13:34 juju-e4d256-prod-github-runner-207 kernel: [20988.543119] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 11:13:34 juju-e4d256-prod-github-runner-207 kernel: [20988.543194] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 11:13:34 juju-e4d256-prod-github-runner-207 kernel: [20988.555368] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 11:13:34 juju-e4d256-prod-github-runner-207 kernel: [20988.556654] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 11:13:34 juju-e4d256-prod-github-runner-207 kernel: [20988.557891] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:13:34 juju-e4d256-prod-github-runner-207 kernel: [20988.558968] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 11:13:34 juju-e4d256-prod-github-runner-207 kernel: [20988.561540] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 11:13:34 juju-e4d256-prod-github-runner-207 kernel: [20988.562597] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 11:13:34 juju-e4d256-prod-github-runner-207 kernel: [20988.563825] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 11:13:34 juju-e4d256-prod-github-runner-207 kernel: [20988.565035] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 11:13:34 juju-e4d256-prod-github-runner-207 kernel: [20988.566206] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 11:13:34 juju-e4d256-prod-github-runner-207 kernel: [20988.567377] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 11:13:34 juju-e4d256-prod-github-runner-207 kernel: [20988.568547] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 11:13:34 juju-e4d256-prod-github-runner-207 kernel: [20988.569810] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 11:13:34 juju-e4d256-prod-github-runner-207 kernel: [20988.571036] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 11:13:34 juju-e4d256-prod-github-runner-207 kernel: [20988.572279] Call Trace: Aug 22 11:13:34 juju-e4d256-prod-github-runner-207 kernel: [20988.573229] Aug 22 11:13:34 juju-e4d256-prod-github-runner-207 kernel: [20988.574116] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:13:34 juju-e4d256-prod-github-runner-207 kernel: [20988.575151] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:13:34 juju-e4d256-prod-github-runner-207 kernel: [20988.576173] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:13:34 juju-e4d256-prod-github-runner-207 kernel: [20988.577387] ? show_regs.part.0+0x23/0x29 Aug 22 11:13:34 juju-e4d256-prod-github-runner-207 kernel: [20988.578445] ? show_regs.cold+0x8/0xd Aug 22 11:13:34 juju-e4d256-prod-github-runner-207 kernel: [20988.579602] ? watchdog_timer_fn+0x1be/0x220 Aug 22 11:13:34 juju-e4d256-prod-github-runner-207 kernel: [20988.580784] ? lockup_detector_update_enable+0x60/0x60 Aug 22 11:13:34 juju-e4d256-prod-github-runner-207 kernel: [20988.581859] ? __hrtimer_run_queues+0x107/0x230 Aug 22 11:13:34 juju-e4d256-prod-github-runner-207 kernel: [20988.582892] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 11:13:34 juju-e4d256-prod-github-runner-207 kernel: [20988.583927] ? hrtimer_interrupt+0x101/0x220 Aug 22 11:13:34 juju-e4d256-prod-github-runner-207 kernel: [20988.584965] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 11:13:34 juju-e4d256-prod-github-runner-207 kernel: [20988.586054] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 11:13:34 juju-e4d256-prod-github-runner-207 kernel: [20988.587112] Aug 22 11:13:34 juju-e4d256-prod-github-runner-207 kernel: [20988.587970] Aug 22 11:13:34 juju-e4d256-prod-github-runner-207 kernel: [20988.588844] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 11:13:34 juju-e4d256-prod-github-runner-207 kernel: [20988.589886] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:13:34 juju-e4d256-prod-github-runner-207 kernel: [20988.590974] ? _raw_spin_lock+0x22/0x30 Aug 22 11:13:34 juju-e4d256-prod-github-runner-207 kernel: [20988.591930] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:13:34 juju-e4d256-prod-github-runner-207 kernel: [20988.593028] direct_page_fault+0x206/0x310 [kvm] Aug 22 11:13:34 juju-e4d256-prod-github-runner-207 kernel: [20988.594057] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 11:13:34 juju-e4d256-prod-github-runner-207 kernel: [20988.595078] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 11:13:34 juju-e4d256-prod-github-runner-207 kernel: [20988.596094] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 11:13:34 juju-e4d256-prod-github-runner-207 kernel: [20988.597076] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 11:13:34 juju-e4d256-prod-github-runner-207 kernel: [20988.598302] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 11:13:34 juju-e4d256-prod-github-runner-207 kernel: [20988.599299] handle_exit+0x98/0x230 [kvm_amd] Aug 22 11:13:34 juju-e4d256-prod-github-runner-207 kernel: [20988.600200] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 11:13:34 juju-e4d256-prod-github-runner-207 kernel: [20988.601131] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 11:13:34 juju-e4d256-prod-github-runner-207 kernel: [20988.602060] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 11:13:34 juju-e4d256-prod-github-runner-207 kernel: [20988.602966] vcpu_run+0x62/0x2c0 [kvm] Aug 22 11:13:34 juju-e4d256-prod-github-runner-207 kernel: [20988.603778] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 11:13:34 juju-e4d256-prod-github-runner-207 kernel: [20988.604589] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 11:13:34 juju-e4d256-prod-github-runner-207 kernel: [20988.605472] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 11:13:34 juju-e4d256-prod-github-runner-207 kernel: [20988.606273] ? __seccomp_filter+0x4a/0x4a0 Aug 22 11:13:34 juju-e4d256-prod-github-runner-207 kernel: [20988.607025] ? __fget_files+0x86/0xc0 Aug 22 11:13:34 juju-e4d256-prod-github-runner-207 kernel: [20988.607751] __x64_sys_ioctl+0x95/0xd0 Aug 22 11:13:34 juju-e4d256-prod-github-runner-207 kernel: [20988.608445] do_syscall_64+0x5c/0xc0 Aug 22 11:13:34 juju-e4d256-prod-github-runner-207 kernel: [20988.609123] ? do_futex+0x162/0x1f0 Aug 22 11:13:34 juju-e4d256-prod-github-runner-207 kernel: [20988.609774] ? __x64_sys_futex+0x78/0x1e0 Aug 22 11:13:34 juju-e4d256-prod-github-runner-207 kernel: [20988.610453] ? __secure_computing+0xa9/0x120 Aug 22 11:13:34 juju-e4d256-prod-github-runner-207 kernel: [20988.611147] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 11:13:34 juju-e4d256-prod-github-runner-207 kernel: [20988.611909] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:13:34 juju-e4d256-prod-github-runner-207 kernel: [20988.612638] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:13:34 juju-e4d256-prod-github-runner-207 kernel: [20988.613360] ? do_syscall_64+0x69/0xc0 Aug 22 11:13:34 juju-e4d256-prod-github-runner-207 kernel: [20988.614009] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:13:34 juju-e4d256-prod-github-runner-207 kernel: [20988.614715] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:13:34 juju-e4d256-prod-github-runner-207 kernel: [20988.615414] ? do_syscall_64+0x69/0xc0 Aug 22 11:13:34 juju-e4d256-prod-github-runner-207 kernel: [20988.616043] ? do_syscall_64+0x69/0xc0 Aug 22 11:13:34 juju-e4d256-prod-github-runner-207 kernel: [20988.616677] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 11:13:34 juju-e4d256-prod-github-runner-207 kernel: [20988.617385] RIP: 0033:0x7faa5d0edaff Aug 22 11:13:34 juju-e4d256-prod-github-runner-207 kernel: [20988.618011] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 11:13:34 juju-e4d256-prod-github-runner-207 kernel: [20988.620008] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 11:13:34 juju-e4d256-prod-github-runner-207 kernel: [20988.620938] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 11:13:34 juju-e4d256-prod-github-runner-207 kernel: [20988.621831] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 11:13:34 juju-e4d256-prod-github-runner-207 kernel: [20988.622722] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 11:13:34 juju-e4d256-prod-github-runner-207 kernel: [20988.623616] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 11:13:34 juju-e4d256-prod-github-runner-207 kernel: [20988.624507] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 11:13:34 juju-e4d256-prod-github-runner-207 kernel: [20988.625421] Aug 22 11:14:02 juju-e4d256-prod-github-runner-207 kernel: [21016.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 19465s! [qemu-system-x86:6715] Aug 22 11:14:02 juju-e4d256-prod-github-runner-207 kernel: [21016.543121] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 11:14:02 juju-e4d256-prod-github-runner-207 kernel: [21016.543195] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 11:14:02 juju-e4d256-prod-github-runner-207 kernel: [21016.555293] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 11:14:02 juju-e4d256-prod-github-runner-207 kernel: [21016.556571] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 11:14:02 juju-e4d256-prod-github-runner-207 kernel: [21016.557799] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:14:02 juju-e4d256-prod-github-runner-207 kernel: [21016.558869] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 11:14:02 juju-e4d256-prod-github-runner-207 kernel: [21016.561435] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 11:14:02 juju-e4d256-prod-github-runner-207 kernel: [21016.562481] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 11:14:02 juju-e4d256-prod-github-runner-207 kernel: [21016.563647] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 11:14:02 juju-e4d256-prod-github-runner-207 kernel: [21016.564819] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 11:14:02 juju-e4d256-prod-github-runner-207 kernel: [21016.565983] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 11:14:02 juju-e4d256-prod-github-runner-207 kernel: [21016.567147] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 11:14:02 juju-e4d256-prod-github-runner-207 kernel: [21016.568343] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 11:14:02 juju-e4d256-prod-github-runner-207 kernel: [21016.569582] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 11:14:02 juju-e4d256-prod-github-runner-207 kernel: [21016.570686] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 11:14:02 juju-e4d256-prod-github-runner-207 kernel: [21016.571880] Call Trace: Aug 22 11:14:02 juju-e4d256-prod-github-runner-207 kernel: [21016.572811] Aug 22 11:14:02 juju-e4d256-prod-github-runner-207 kernel: [21016.573706] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:14:02 juju-e4d256-prod-github-runner-207 kernel: [21016.574744] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:14:02 juju-e4d256-prod-github-runner-207 kernel: [21016.575777] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:14:02 juju-e4d256-prod-github-runner-207 kernel: [21016.576863] ? show_regs.part.0+0x23/0x29 Aug 22 11:14:02 juju-e4d256-prod-github-runner-207 kernel: [21016.577864] ? show_regs.cold+0x8/0xd Aug 22 11:14:02 juju-e4d256-prod-github-runner-207 kernel: [21016.578843] ? watchdog_timer_fn+0x1be/0x220 Aug 22 11:14:02 juju-e4d256-prod-github-runner-207 kernel: [21016.579862] ? lockup_detector_update_enable+0x60/0x60 Aug 22 11:14:02 juju-e4d256-prod-github-runner-207 kernel: [21016.580932] ? __hrtimer_run_queues+0x107/0x230 Aug 22 11:14:02 juju-e4d256-prod-github-runner-207 kernel: [21016.581969] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 11:14:02 juju-e4d256-prod-github-runner-207 kernel: [21016.582993] ? hrtimer_interrupt+0x101/0x220 Aug 22 11:14:02 juju-e4d256-prod-github-runner-207 kernel: [21016.584047] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 11:14:02 juju-e4d256-prod-github-runner-207 kernel: [21016.585154] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 11:14:02 juju-e4d256-prod-github-runner-207 kernel: [21016.586221] Aug 22 11:14:02 juju-e4d256-prod-github-runner-207 kernel: [21016.587077] Aug 22 11:14:02 juju-e4d256-prod-github-runner-207 kernel: [21016.587918] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 11:14:02 juju-e4d256-prod-github-runner-207 kernel: [21016.588975] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:14:02 juju-e4d256-prod-github-runner-207 kernel: [21016.590016] ? _raw_spin_lock+0x22/0x30 Aug 22 11:14:02 juju-e4d256-prod-github-runner-207 kernel: [21016.590963] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:14:02 juju-e4d256-prod-github-runner-207 kernel: [21016.591982] direct_page_fault+0x206/0x310 [kvm] Aug 22 11:14:02 juju-e4d256-prod-github-runner-207 kernel: [21016.593013] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 11:14:02 juju-e4d256-prod-github-runner-207 kernel: [21016.594023] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 11:14:02 juju-e4d256-prod-github-runner-207 kernel: [21016.595024] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 11:14:02 juju-e4d256-prod-github-runner-207 kernel: [21016.595994] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 11:14:02 juju-e4d256-prod-github-runner-207 kernel: [21016.596949] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 11:14:02 juju-e4d256-prod-github-runner-207 kernel: [21016.597933] handle_exit+0x98/0x230 [kvm_amd] Aug 22 11:14:02 juju-e4d256-prod-github-runner-207 kernel: [21016.598830] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 11:14:02 juju-e4d256-prod-github-runner-207 kernel: [21016.599747] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 11:14:02 juju-e4d256-prod-github-runner-207 kernel: [21016.600799] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 11:14:02 juju-e4d256-prod-github-runner-207 kernel: [21016.601704] vcpu_run+0x62/0x2c0 [kvm] Aug 22 11:14:02 juju-e4d256-prod-github-runner-207 kernel: [21016.602515] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 11:14:02 juju-e4d256-prod-github-runner-207 kernel: [21016.603351] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 11:14:02 juju-e4d256-prod-github-runner-207 kernel: [21016.604214] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 11:14:02 juju-e4d256-prod-github-runner-207 kernel: [21016.605046] ? __seccomp_filter+0x4a/0x4a0 Aug 22 11:14:02 juju-e4d256-prod-github-runner-207 kernel: [21016.605797] ? __fget_files+0x86/0xc0 Aug 22 11:14:02 juju-e4d256-prod-github-runner-207 kernel: [21016.606503] __x64_sys_ioctl+0x95/0xd0 Aug 22 11:14:02 juju-e4d256-prod-github-runner-207 kernel: [21016.607194] do_syscall_64+0x5c/0xc0 Aug 22 11:14:02 juju-e4d256-prod-github-runner-207 kernel: [21016.607863] ? do_futex+0x162/0x1f0 Aug 22 11:14:02 juju-e4d256-prod-github-runner-207 kernel: [21016.608559] ? __x64_sys_futex+0x78/0x1e0 Aug 22 11:14:02 juju-e4d256-prod-github-runner-207 kernel: [21016.609243] ? __secure_computing+0xa9/0x120 Aug 22 11:14:02 juju-e4d256-prod-github-runner-207 kernel: [21016.609963] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 11:14:02 juju-e4d256-prod-github-runner-207 kernel: [21016.610725] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:14:02 juju-e4d256-prod-github-runner-207 kernel: [21016.611458] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:14:02 juju-e4d256-prod-github-runner-207 kernel: [21016.612177] ? do_syscall_64+0x69/0xc0 Aug 22 11:14:02 juju-e4d256-prod-github-runner-207 kernel: [21016.612837] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:14:02 juju-e4d256-prod-github-runner-207 kernel: [21016.613545] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:14:02 juju-e4d256-prod-github-runner-207 kernel: [21016.614239] ? do_syscall_64+0x69/0xc0 Aug 22 11:14:02 juju-e4d256-prod-github-runner-207 kernel: [21016.614863] ? do_syscall_64+0x69/0xc0 Aug 22 11:14:02 juju-e4d256-prod-github-runner-207 kernel: [21016.615486] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 11:14:02 juju-e4d256-prod-github-runner-207 kernel: [21016.616194] RIP: 0033:0x7faa5d0edaff Aug 22 11:14:02 juju-e4d256-prod-github-runner-207 kernel: [21016.616839] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 11:14:02 juju-e4d256-prod-github-runner-207 kernel: [21016.618823] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 11:14:02 juju-e4d256-prod-github-runner-207 kernel: [21016.619734] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 11:14:02 juju-e4d256-prod-github-runner-207 kernel: [21016.620639] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 11:14:02 juju-e4d256-prod-github-runner-207 kernel: [21016.621528] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 11:14:02 juju-e4d256-prod-github-runner-207 kernel: [21016.622415] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 11:14:02 juju-e4d256-prod-github-runner-207 kernel: [21016.623304] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 11:14:02 juju-e4d256-prod-github-runner-207 kernel: [21016.624195] Aug 22 11:14:30 juju-e4d256-prod-github-runner-207 kernel: [21044.541981] watchdog: BUG: soft lockup - CPU#1 stuck for 19491s! [qemu-system-x86:6715] Aug 22 11:14:30 juju-e4d256-prod-github-runner-207 kernel: [21044.543821] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 11:14:30 juju-e4d256-prod-github-runner-207 kernel: [21044.544120] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 11:14:30 juju-e4d256-prod-github-runner-207 kernel: [21044.556381] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 11:14:30 juju-e4d256-prod-github-runner-207 kernel: [21044.557659] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 11:14:30 juju-e4d256-prod-github-runner-207 kernel: [21044.558904] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:14:30 juju-e4d256-prod-github-runner-207 kernel: [21044.559996] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 11:14:30 juju-e4d256-prod-github-runner-207 kernel: [21044.562584] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 11:14:30 juju-e4d256-prod-github-runner-207 kernel: [21044.563638] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 11:14:30 juju-e4d256-prod-github-runner-207 kernel: [21044.564814] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 11:14:30 juju-e4d256-prod-github-runner-207 kernel: [21044.565976] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 11:14:30 juju-e4d256-prod-github-runner-207 kernel: [21044.567148] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 11:14:30 juju-e4d256-prod-github-runner-207 kernel: [21044.568344] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 11:14:30 juju-e4d256-prod-github-runner-207 kernel: [21044.569528] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 11:14:30 juju-e4d256-prod-github-runner-207 kernel: [21044.570767] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 11:14:30 juju-e4d256-prod-github-runner-207 kernel: [21044.571896] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 11:14:30 juju-e4d256-prod-github-runner-207 kernel: [21044.573104] Call Trace: Aug 22 11:14:30 juju-e4d256-prod-github-runner-207 kernel: [21044.574042] Aug 22 11:14:30 juju-e4d256-prod-github-runner-207 kernel: [21044.574945] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:14:30 juju-e4d256-prod-github-runner-207 kernel: [21044.576004] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:14:30 juju-e4d256-prod-github-runner-207 kernel: [21044.577045] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:14:30 juju-e4d256-prod-github-runner-207 kernel: [21044.578161] ? show_regs.part.0+0x23/0x29 Aug 22 11:14:30 juju-e4d256-prod-github-runner-207 kernel: [21044.579166] ? show_regs.cold+0x8/0xd Aug 22 11:14:30 juju-e4d256-prod-github-runner-207 kernel: [21044.580173] ? watchdog_timer_fn+0x1be/0x220 Aug 22 11:14:30 juju-e4d256-prod-github-runner-207 kernel: [21044.581191] ? lockup_detector_update_enable+0x60/0x60 Aug 22 11:14:30 juju-e4d256-prod-github-runner-207 kernel: [21044.582267] ? __hrtimer_run_queues+0x107/0x230 Aug 22 11:14:30 juju-e4d256-prod-github-runner-207 kernel: [21044.583307] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 11:14:30 juju-e4d256-prod-github-runner-207 kernel: [21044.584344] ? hrtimer_interrupt+0x101/0x220 Aug 22 11:14:30 juju-e4d256-prod-github-runner-207 kernel: [21044.585367] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 11:14:30 juju-e4d256-prod-github-runner-207 kernel: [21044.586440] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 11:14:30 juju-e4d256-prod-github-runner-207 kernel: [21044.587501] Aug 22 11:14:30 juju-e4d256-prod-github-runner-207 kernel: [21044.588376] Aug 22 11:14:30 juju-e4d256-prod-github-runner-207 kernel: [21044.589218] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 11:14:30 juju-e4d256-prod-github-runner-207 kernel: [21044.590259] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:14:30 juju-e4d256-prod-github-runner-207 kernel: [21044.591300] ? _raw_spin_lock+0x22/0x30 Aug 22 11:14:30 juju-e4d256-prod-github-runner-207 kernel: [21044.592262] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:14:30 juju-e4d256-prod-github-runner-207 kernel: [21044.593300] direct_page_fault+0x206/0x310 [kvm] Aug 22 11:14:30 juju-e4d256-prod-github-runner-207 kernel: [21044.594332] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 11:14:30 juju-e4d256-prod-github-runner-207 kernel: [21044.595348] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 11:14:30 juju-e4d256-prod-github-runner-207 kernel: [21044.596371] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 11:14:30 juju-e4d256-prod-github-runner-207 kernel: [21044.597382] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 11:14:30 juju-e4d256-prod-github-runner-207 kernel: [21044.598363] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 11:14:30 juju-e4d256-prod-github-runner-207 kernel: [21044.599357] handle_exit+0x98/0x230 [kvm_amd] Aug 22 11:14:30 juju-e4d256-prod-github-runner-207 kernel: [21044.600268] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 11:14:30 juju-e4d256-prod-github-runner-207 kernel: [21044.601184] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 11:14:30 juju-e4d256-prod-github-runner-207 kernel: [21044.602113] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 11:14:30 juju-e4d256-prod-github-runner-207 kernel: [21044.603031] vcpu_run+0x62/0x2c0 [kvm] Aug 22 11:14:30 juju-e4d256-prod-github-runner-207 kernel: [21044.603854] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 11:14:30 juju-e4d256-prod-github-runner-207 kernel: [21044.604680] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 11:14:30 juju-e4d256-prod-github-runner-207 kernel: [21044.605542] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 11:14:30 juju-e4d256-prod-github-runner-207 kernel: [21044.606349] ? __seccomp_filter+0x4a/0x4a0 Aug 22 11:14:30 juju-e4d256-prod-github-runner-207 kernel: [21044.607094] ? __fget_files+0x86/0xc0 Aug 22 11:14:30 juju-e4d256-prod-github-runner-207 kernel: [21044.607814] __x64_sys_ioctl+0x95/0xd0 Aug 22 11:14:30 juju-e4d256-prod-github-runner-207 kernel: [21044.608533] do_syscall_64+0x5c/0xc0 Aug 22 11:14:30 juju-e4d256-prod-github-runner-207 kernel: [21044.609204] ? do_futex+0x162/0x1f0 Aug 22 11:14:30 juju-e4d256-prod-github-runner-207 kernel: [21044.609853] ? __x64_sys_futex+0x78/0x1e0 Aug 22 11:14:30 juju-e4d256-prod-github-runner-207 kernel: [21044.610528] ? __secure_computing+0xa9/0x120 Aug 22 11:14:30 juju-e4d256-prod-github-runner-207 kernel: [21044.611224] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 11:14:30 juju-e4d256-prod-github-runner-207 kernel: [21044.612007] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:14:30 juju-e4d256-prod-github-runner-207 kernel: [21044.612733] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:14:30 juju-e4d256-prod-github-runner-207 kernel: [21044.613462] ? do_syscall_64+0x69/0xc0 Aug 22 11:14:30 juju-e4d256-prod-github-runner-207 kernel: [21044.614110] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:14:30 juju-e4d256-prod-github-runner-207 kernel: [21044.614816] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:14:30 juju-e4d256-prod-github-runner-207 kernel: [21044.615531] ? do_syscall_64+0x69/0xc0 Aug 22 11:14:30 juju-e4d256-prod-github-runner-207 kernel: [21044.616194] ? do_syscall_64+0x69/0xc0 Aug 22 11:14:30 juju-e4d256-prod-github-runner-207 kernel: [21044.616819] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 11:14:30 juju-e4d256-prod-github-runner-207 kernel: [21044.617524] RIP: 0033:0x7faa5d0edaff Aug 22 11:14:30 juju-e4d256-prod-github-runner-207 kernel: [21044.618203] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 11:14:30 juju-e4d256-prod-github-runner-207 kernel: [21044.620218] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 11:14:30 juju-e4d256-prod-github-runner-207 kernel: [21044.621137] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 11:14:30 juju-e4d256-prod-github-runner-207 kernel: [21044.622029] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 11:14:30 juju-e4d256-prod-github-runner-207 kernel: [21044.622923] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 11:14:30 juju-e4d256-prod-github-runner-207 kernel: [21044.623839] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 11:14:30 juju-e4d256-prod-github-runner-207 kernel: [21044.624782] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 11:14:30 juju-e4d256-prod-github-runner-207 kernel: [21044.625685] Aug 22 11:14:44 juju-e4d256-prod-github-runner-207 kernel: [21058.592705] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 11:14:44 juju-e4d256-prod-github-runner-207 kernel: [21058.595985] rcu: 1-....: (5219002 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=2527008 Aug 22 11:14:44 juju-e4d256-prod-github-runner-207 kernel: [21058.599305] (t=5235348 jiffies g=23269 q=26725) Aug 22 11:14:44 juju-e4d256-prod-github-runner-207 kernel: [21058.600117] NMI backtrace for cpu 1 Aug 22 11:14:44 juju-e4d256-prod-github-runner-207 kernel: [21058.601908] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 11:14:44 juju-e4d256-prod-github-runner-207 kernel: [21058.604150] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 11:14:44 juju-e4d256-prod-github-runner-207 kernel: [21058.607304] Call Trace: Aug 22 11:14:44 juju-e4d256-prod-github-runner-207 kernel: [21058.608002] Aug 22 11:14:44 juju-e4d256-prod-github-runner-207 kernel: [21058.610342] show_stack+0x52/0x5c Aug 22 11:14:44 juju-e4d256-prod-github-runner-207 kernel: [21058.611615] dump_stack_lvl+0x4a/0x63 Aug 22 11:14:44 juju-e4d256-prod-github-runner-207 kernel: [21058.612987] dump_stack+0x10/0x16 Aug 22 11:14:44 juju-e4d256-prod-github-runner-207 kernel: [21058.615310] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 11:14:44 juju-e4d256-prod-github-runner-207 kernel: [21058.616107] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 11:14:44 juju-e4d256-prod-github-runner-207 kernel: [21058.619089] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 11:14:44 juju-e4d256-prod-github-runner-207 kernel: [21058.619929] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 11:14:44 juju-e4d256-prod-github-runner-207 kernel: [21058.623021] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 11:14:44 juju-e4d256-prod-github-runner-207 kernel: [21058.623848] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 11:14:44 juju-e4d256-prod-github-runner-207 kernel: [21058.626838] print_cpu_stall.cold+0x2f/0xe2 Aug 22 11:14:44 juju-e4d256-prod-github-runner-207 kernel: [21058.627607] ? timekeeping_update+0xf7/0x150 Aug 22 11:14:44 juju-e4d256-prod-github-runner-207 kernel: [21058.629521] check_cpu_stall+0x109/0x270 Aug 22 11:14:44 juju-e4d256-prod-github-runner-207 kernel: [21058.631434] rcu_sched_clock_irq+0x9a/0x250 Aug 22 11:14:44 juju-e4d256-prod-github-runner-207 kernel: [21058.632203] update_process_times+0x94/0xd0 Aug 22 11:14:44 juju-e4d256-prod-github-runner-207 kernel: [21058.632987] tick_sched_handle+0x29/0x70 Aug 22 11:14:44 juju-e4d256-prod-github-runner-207 kernel: [21058.636860] tick_sched_timer+0x8c/0xc0 Aug 22 11:14:44 juju-e4d256-prod-github-runner-207 kernel: [21058.638206] ? tick_nohz_handler+0xb0/0xb0 Aug 22 11:14:44 juju-e4d256-prod-github-runner-207 kernel: [21058.640665] __hrtimer_run_queues+0x107/0x230 Aug 22 11:14:44 juju-e4d256-prod-github-runner-207 kernel: [21058.641439] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 11:14:44 juju-e4d256-prod-github-runner-207 kernel: [21058.644495] hrtimer_interrupt+0x101/0x220 Aug 22 11:14:44 juju-e4d256-prod-github-runner-207 kernel: [21058.645262] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 11:14:44 juju-e4d256-prod-github-runner-207 kernel: [21058.648344] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 11:14:44 juju-e4d256-prod-github-runner-207 kernel: [21058.649153] Aug 22 11:14:44 juju-e4d256-prod-github-runner-207 kernel: [21058.652002] Aug 22 11:14:44 juju-e4d256-prod-github-runner-207 kernel: [21058.652647] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 11:14:44 juju-e4d256-prod-github-runner-207 kernel: [21058.655642] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:14:44 juju-e4d256-prod-github-runner-207 kernel: [21058.656594] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 11:14:44 juju-e4d256-prod-github-runner-207 kernel: [21058.663230] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 11:14:44 juju-e4d256-prod-github-runner-207 kernel: [21058.664157] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 11:14:44 juju-e4d256-prod-github-runner-207 kernel: [21058.667295] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 11:14:44 juju-e4d256-prod-github-runner-207 kernel: [21058.669929] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 11:14:44 juju-e4d256-prod-github-runner-207 kernel: [21058.671721] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 11:14:44 juju-e4d256-prod-github-runner-207 kernel: [21058.674897] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 11:14:44 juju-e4d256-prod-github-runner-207 kernel: [21058.677220] ? _raw_spin_lock+0x22/0x30 Aug 22 11:14:44 juju-e4d256-prod-github-runner-207 kernel: [21058.679092] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:14:44 juju-e4d256-prod-github-runner-207 kernel: [21058.680014] direct_page_fault+0x206/0x310 [kvm] Aug 22 11:14:44 juju-e4d256-prod-github-runner-207 kernel: [21058.683007] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 11:14:44 juju-e4d256-prod-github-runner-207 kernel: [21058.683938] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 11:14:44 juju-e4d256-prod-github-runner-207 kernel: [21058.686923] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 11:14:44 juju-e4d256-prod-github-runner-207 kernel: [21058.687822] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 11:14:44 juju-e4d256-prod-github-runner-207 kernel: [21058.690737] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 11:14:44 juju-e4d256-prod-github-runner-207 kernel: [21058.691633] handle_exit+0x98/0x230 [kvm_amd] Aug 22 11:14:44 juju-e4d256-prod-github-runner-207 kernel: [21058.692462] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 11:14:44 juju-e4d256-prod-github-runner-207 kernel: [21058.693352] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 11:14:44 juju-e4d256-prod-github-runner-207 kernel: [21058.694224] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 11:14:44 juju-e4d256-prod-github-runner-207 kernel: [21058.695067] vcpu_run+0x62/0x2c0 [kvm] Aug 22 11:14:44 juju-e4d256-prod-github-runner-207 kernel: [21058.695800] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 11:14:44 juju-e4d256-prod-github-runner-207 kernel: [21058.696596] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 11:14:44 juju-e4d256-prod-github-runner-207 kernel: [21058.697493] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 11:14:44 juju-e4d256-prod-github-runner-207 kernel: [21058.698348] ? __seccomp_filter+0x4a/0x4a0 Aug 22 11:14:44 juju-e4d256-prod-github-runner-207 kernel: [21058.699153] ? __fget_files+0x86/0xc0 Aug 22 11:14:44 juju-e4d256-prod-github-runner-207 kernel: [21058.699878] __x64_sys_ioctl+0x95/0xd0 Aug 22 11:14:44 juju-e4d256-prod-github-runner-207 kernel: [21058.700637] do_syscall_64+0x5c/0xc0 Aug 22 11:14:44 juju-e4d256-prod-github-runner-207 kernel: [21058.701413] ? do_futex+0x162/0x1f0 Aug 22 11:14:44 juju-e4d256-prod-github-runner-207 kernel: [21058.702238] ? __x64_sys_futex+0x78/0x1e0 Aug 22 11:14:44 juju-e4d256-prod-github-runner-207 kernel: [21058.703204] ? __secure_computing+0xa9/0x120 Aug 22 11:14:44 juju-e4d256-prod-github-runner-207 kernel: [21058.704029] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 11:14:44 juju-e4d256-prod-github-runner-207 kernel: [21058.704926] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:14:44 juju-e4d256-prod-github-runner-207 kernel: [21058.705778] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:14:44 juju-e4d256-prod-github-runner-207 kernel: [21058.706635] ? do_syscall_64+0x69/0xc0 Aug 22 11:14:44 juju-e4d256-prod-github-runner-207 kernel: [21058.707400] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:14:44 juju-e4d256-prod-github-runner-207 kernel: [21058.708309] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:14:44 juju-e4d256-prod-github-runner-207 kernel: [21058.709163] ? do_syscall_64+0x69/0xc0 Aug 22 11:14:44 juju-e4d256-prod-github-runner-207 kernel: [21058.709941] ? do_syscall_64+0x69/0xc0 Aug 22 11:14:44 juju-e4d256-prod-github-runner-207 kernel: [21058.710703] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 11:14:44 juju-e4d256-prod-github-runner-207 kernel: [21058.711577] RIP: 0033:0x7faa5d0edaff Aug 22 11:14:44 juju-e4d256-prod-github-runner-207 kernel: [21058.712346] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 11:14:44 juju-e4d256-prod-github-runner-207 kernel: [21058.714790] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 11:14:44 juju-e4d256-prod-github-runner-207 kernel: [21058.715924] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 11:14:44 juju-e4d256-prod-github-runner-207 kernel: [21058.717051] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 11:14:44 juju-e4d256-prod-github-runner-207 kernel: [21058.718134] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 11:14:44 juju-e4d256-prod-github-runner-207 kernel: [21058.719246] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 11:14:44 juju-e4d256-prod-github-runner-207 kernel: [21058.720357] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 11:14:44 juju-e4d256-prod-github-runner-207 kernel: [21058.721438] Aug 22 11:15:10 juju-e4d256-prod-github-runner-207 kernel: [21084.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 19528s! [qemu-system-x86:6715] Aug 22 11:15:10 juju-e4d256-prod-github-runner-207 kernel: [21084.543102] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 11:15:10 juju-e4d256-prod-github-runner-207 kernel: [21084.543179] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 11:15:10 juju-e4d256-prod-github-runner-207 kernel: [21084.555725] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 11:15:10 juju-e4d256-prod-github-runner-207 kernel: [21084.557000] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 11:15:10 juju-e4d256-prod-github-runner-207 kernel: [21084.558224] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:15:10 juju-e4d256-prod-github-runner-207 kernel: [21084.559291] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 11:15:10 juju-e4d256-prod-github-runner-207 kernel: [21084.562025] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 11:15:10 juju-e4d256-prod-github-runner-207 kernel: [21084.563118] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 11:15:10 juju-e4d256-prod-github-runner-207 kernel: [21084.564303] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 11:15:10 juju-e4d256-prod-github-runner-207 kernel: [21084.565478] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 11:15:10 juju-e4d256-prod-github-runner-207 kernel: [21084.566782] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 11:15:10 juju-e4d256-prod-github-runner-207 kernel: [21084.568067] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 11:15:10 juju-e4d256-prod-github-runner-207 kernel: [21084.569273] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 11:15:10 juju-e4d256-prod-github-runner-207 kernel: [21084.570520] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 11:15:10 juju-e4d256-prod-github-runner-207 kernel: [21084.571644] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 11:15:10 juju-e4d256-prod-github-runner-207 kernel: [21084.572988] Call Trace: Aug 22 11:15:10 juju-e4d256-prod-github-runner-207 kernel: [21084.573904] Aug 22 11:15:10 juju-e4d256-prod-github-runner-207 kernel: [21084.574792] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:15:10 juju-e4d256-prod-github-runner-207 kernel: [21084.575847] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:15:10 juju-e4d256-prod-github-runner-207 kernel: [21084.576874] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:15:10 juju-e4d256-prod-github-runner-207 kernel: [21084.577954] ? show_regs.part.0+0x23/0x29 Aug 22 11:15:10 juju-e4d256-prod-github-runner-207 kernel: [21084.578955] ? show_regs.cold+0x8/0xd Aug 22 11:15:10 juju-e4d256-prod-github-runner-207 kernel: [21084.579940] ? watchdog_timer_fn+0x1be/0x220 Aug 22 11:15:10 juju-e4d256-prod-github-runner-207 kernel: [21084.580955] ? lockup_detector_update_enable+0x60/0x60 Aug 22 11:15:10 juju-e4d256-prod-github-runner-207 kernel: [21084.582047] ? __hrtimer_run_queues+0x107/0x230 Aug 22 11:15:10 juju-e4d256-prod-github-runner-207 kernel: [21084.583079] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 11:15:10 juju-e4d256-prod-github-runner-207 kernel: [21084.584148] ? hrtimer_interrupt+0x101/0x220 Aug 22 11:15:10 juju-e4d256-prod-github-runner-207 kernel: [21084.585199] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 11:15:10 juju-e4d256-prod-github-runner-207 kernel: [21084.586275] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 11:15:10 juju-e4d256-prod-github-runner-207 kernel: [21084.587323] Aug 22 11:15:10 juju-e4d256-prod-github-runner-207 kernel: [21084.588202] Aug 22 11:15:10 juju-e4d256-prod-github-runner-207 kernel: [21084.589052] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 11:15:10 juju-e4d256-prod-github-runner-207 kernel: [21084.590093] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:15:10 juju-e4d256-prod-github-runner-207 kernel: [21084.591180] ? _raw_spin_lock+0x22/0x30 Aug 22 11:15:10 juju-e4d256-prod-github-runner-207 kernel: [21084.592153] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:15:10 juju-e4d256-prod-github-runner-207 kernel: [21084.593181] direct_page_fault+0x206/0x310 [kvm] Aug 22 11:15:10 juju-e4d256-prod-github-runner-207 kernel: [21084.594220] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 11:15:10 juju-e4d256-prod-github-runner-207 kernel: [21084.595245] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 11:15:10 juju-e4d256-prod-github-runner-207 kernel: [21084.596338] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 11:15:10 juju-e4d256-prod-github-runner-207 kernel: [21084.597316] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 11:15:10 juju-e4d256-prod-github-runner-207 kernel: [21084.598262] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 11:15:10 juju-e4d256-prod-github-runner-207 kernel: [21084.599256] handle_exit+0x98/0x230 [kvm_amd] Aug 22 11:15:10 juju-e4d256-prod-github-runner-207 kernel: [21084.600168] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 11:15:10 juju-e4d256-prod-github-runner-207 kernel: [21084.601087] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 11:15:10 juju-e4d256-prod-github-runner-207 kernel: [21084.602016] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 11:15:10 juju-e4d256-prod-github-runner-207 kernel: [21084.602922] vcpu_run+0x62/0x2c0 [kvm] Aug 22 11:15:10 juju-e4d256-prod-github-runner-207 kernel: [21084.603761] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 11:15:10 juju-e4d256-prod-github-runner-207 kernel: [21084.604586] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 11:15:10 juju-e4d256-prod-github-runner-207 kernel: [21084.605443] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 11:15:10 juju-e4d256-prod-github-runner-207 kernel: [21084.606251] ? __seccomp_filter+0x4a/0x4a0 Aug 22 11:15:10 juju-e4d256-prod-github-runner-207 kernel: [21084.606996] ? __fget_files+0x86/0xc0 Aug 22 11:15:10 juju-e4d256-prod-github-runner-207 kernel: [21084.607720] __x64_sys_ioctl+0x95/0xd0 Aug 22 11:15:10 juju-e4d256-prod-github-runner-207 kernel: [21084.608417] do_syscall_64+0x5c/0xc0 Aug 22 11:15:10 juju-e4d256-prod-github-runner-207 kernel: [21084.609084] ? do_futex+0x162/0x1f0 Aug 22 11:15:10 juju-e4d256-prod-github-runner-207 kernel: [21084.609755] ? __x64_sys_futex+0x78/0x1e0 Aug 22 11:15:10 juju-e4d256-prod-github-runner-207 kernel: [21084.610456] ? __secure_computing+0xa9/0x120 Aug 22 11:15:10 juju-e4d256-prod-github-runner-207 kernel: [21084.611173] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 11:15:10 juju-e4d256-prod-github-runner-207 kernel: [21084.611973] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:15:10 juju-e4d256-prod-github-runner-207 kernel: [21084.612697] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:15:10 juju-e4d256-prod-github-runner-207 kernel: [21084.613417] ? do_syscall_64+0x69/0xc0 Aug 22 11:15:10 juju-e4d256-prod-github-runner-207 kernel: [21084.614062] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:15:10 juju-e4d256-prod-github-runner-207 kernel: [21084.614765] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:15:10 juju-e4d256-prod-github-runner-207 kernel: [21084.615475] ? do_syscall_64+0x69/0xc0 Aug 22 11:15:10 juju-e4d256-prod-github-runner-207 kernel: [21084.616101] ? do_syscall_64+0x69/0xc0 Aug 22 11:15:10 juju-e4d256-prod-github-runner-207 kernel: [21084.616754] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 11:15:10 juju-e4d256-prod-github-runner-207 kernel: [21084.617463] RIP: 0033:0x7faa5d0edaff Aug 22 11:15:10 juju-e4d256-prod-github-runner-207 kernel: [21084.618089] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 11:15:10 juju-e4d256-prod-github-runner-207 kernel: [21084.620103] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 11:15:10 juju-e4d256-prod-github-runner-207 kernel: [21084.621018] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 11:15:10 juju-e4d256-prod-github-runner-207 kernel: [21084.621911] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 11:15:10 juju-e4d256-prod-github-runner-207 kernel: [21084.622831] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 11:15:10 juju-e4d256-prod-github-runner-207 kernel: [21084.623827] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 11:15:10 juju-e4d256-prod-github-runner-207 kernel: [21084.624812] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 11:15:10 juju-e4d256-prod-github-runner-207 kernel: [21084.625767] Aug 22 11:15:38 juju-e4d256-prod-github-runner-207 kernel: [21112.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 19554s! [qemu-system-x86:6715] Aug 22 11:15:38 juju-e4d256-prod-github-runner-207 kernel: [21112.543131] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 11:15:38 juju-e4d256-prod-github-runner-207 kernel: [21112.543207] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 11:15:38 juju-e4d256-prod-github-runner-207 kernel: [21112.555378] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 11:15:38 juju-e4d256-prod-github-runner-207 kernel: [21112.556679] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 11:15:38 juju-e4d256-prod-github-runner-207 kernel: [21112.557955] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:15:38 juju-e4d256-prod-github-runner-207 kernel: [21112.559012] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 11:15:38 juju-e4d256-prod-github-runner-207 kernel: [21112.561566] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 11:15:38 juju-e4d256-prod-github-runner-207 kernel: [21112.562863] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 11:15:38 juju-e4d256-prod-github-runner-207 kernel: [21112.564196] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 11:15:38 juju-e4d256-prod-github-runner-207 kernel: [21112.565393] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 11:15:38 juju-e4d256-prod-github-runner-207 kernel: [21112.566566] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 11:15:38 juju-e4d256-prod-github-runner-207 kernel: [21112.567768] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 11:15:38 juju-e4d256-prod-github-runner-207 kernel: [21112.568950] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 11:15:38 juju-e4d256-prod-github-runner-207 kernel: [21112.570187] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 11:15:38 juju-e4d256-prod-github-runner-207 kernel: [21112.571344] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 11:15:38 juju-e4d256-prod-github-runner-207 kernel: [21112.572555] Call Trace: Aug 22 11:15:38 juju-e4d256-prod-github-runner-207 kernel: [21112.573476] Aug 22 11:15:38 juju-e4d256-prod-github-runner-207 kernel: [21112.574364] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:15:38 juju-e4d256-prod-github-runner-207 kernel: [21112.575415] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:15:38 juju-e4d256-prod-github-runner-207 kernel: [21112.576444] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:15:38 juju-e4d256-prod-github-runner-207 kernel: [21112.577528] ? show_regs.part.0+0x23/0x29 Aug 22 11:15:38 juju-e4d256-prod-github-runner-207 kernel: [21112.578526] ? show_regs.cold+0x8/0xd Aug 22 11:15:38 juju-e4d256-prod-github-runner-207 kernel: [21112.579521] ? watchdog_timer_fn+0x1be/0x220 Aug 22 11:15:38 juju-e4d256-prod-github-runner-207 kernel: [21112.580531] ? lockup_detector_update_enable+0x60/0x60 Aug 22 11:15:38 juju-e4d256-prod-github-runner-207 kernel: [21112.581603] ? __hrtimer_run_queues+0x107/0x230 Aug 22 11:15:38 juju-e4d256-prod-github-runner-207 kernel: [21112.582754] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 11:15:38 juju-e4d256-prod-github-runner-207 kernel: [21112.583790] ? hrtimer_interrupt+0x101/0x220 Aug 22 11:15:38 juju-e4d256-prod-github-runner-207 kernel: [21112.584809] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 11:15:38 juju-e4d256-prod-github-runner-207 kernel: [21112.585903] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 11:15:38 juju-e4d256-prod-github-runner-207 kernel: [21112.586963] Aug 22 11:15:38 juju-e4d256-prod-github-runner-207 kernel: [21112.587853] Aug 22 11:15:38 juju-e4d256-prod-github-runner-207 kernel: [21112.588695] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 11:15:38 juju-e4d256-prod-github-runner-207 kernel: [21112.589730] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:15:38 juju-e4d256-prod-github-runner-207 kernel: [21112.590773] ? _raw_spin_lock+0x22/0x30 Aug 22 11:15:38 juju-e4d256-prod-github-runner-207 kernel: [21112.591742] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:15:38 juju-e4d256-prod-github-runner-207 kernel: [21112.592762] direct_page_fault+0x206/0x310 [kvm] Aug 22 11:15:38 juju-e4d256-prod-github-runner-207 kernel: [21112.593788] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 11:15:38 juju-e4d256-prod-github-runner-207 kernel: [21112.594807] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 11:15:38 juju-e4d256-prod-github-runner-207 kernel: [21112.595820] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 11:15:38 juju-e4d256-prod-github-runner-207 kernel: [21112.596790] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 11:15:38 juju-e4d256-prod-github-runner-207 kernel: [21112.597750] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 11:15:38 juju-e4d256-prod-github-runner-207 kernel: [21112.598747] handle_exit+0x98/0x230 [kvm_amd] Aug 22 11:15:38 juju-e4d256-prod-github-runner-207 kernel: [21112.599729] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 11:15:38 juju-e4d256-prod-github-runner-207 kernel: [21112.600767] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 11:15:38 juju-e4d256-prod-github-runner-207 kernel: [21112.601757] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 11:15:38 juju-e4d256-prod-github-runner-207 kernel: [21112.602673] vcpu_run+0x62/0x2c0 [kvm] Aug 22 11:15:38 juju-e4d256-prod-github-runner-207 kernel: [21112.603532] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 11:15:38 juju-e4d256-prod-github-runner-207 kernel: [21112.604351] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 11:15:38 juju-e4d256-prod-github-runner-207 kernel: [21112.605206] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 11:15:38 juju-e4d256-prod-github-runner-207 kernel: [21112.606004] ? __seccomp_filter+0x4a/0x4a0 Aug 22 11:15:38 juju-e4d256-prod-github-runner-207 kernel: [21112.606799] ? __fget_files+0x86/0xc0 Aug 22 11:15:38 juju-e4d256-prod-github-runner-207 kernel: [21112.607594] __x64_sys_ioctl+0x95/0xd0 Aug 22 11:15:38 juju-e4d256-prod-github-runner-207 kernel: [21112.608384] do_syscall_64+0x5c/0xc0 Aug 22 11:15:38 juju-e4d256-prod-github-runner-207 kernel: [21112.609080] ? do_futex+0x162/0x1f0 Aug 22 11:15:38 juju-e4d256-prod-github-runner-207 kernel: [21112.609791] ? __x64_sys_futex+0x78/0x1e0 Aug 22 11:15:38 juju-e4d256-prod-github-runner-207 kernel: [21112.610477] ? __secure_computing+0xa9/0x120 Aug 22 11:15:38 juju-e4d256-prod-github-runner-207 kernel: [21112.611206] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 11:15:38 juju-e4d256-prod-github-runner-207 kernel: [21112.612002] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:15:38 juju-e4d256-prod-github-runner-207 kernel: [21112.612745] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:15:38 juju-e4d256-prod-github-runner-207 kernel: [21112.613470] ? do_syscall_64+0x69/0xc0 Aug 22 11:15:38 juju-e4d256-prod-github-runner-207 kernel: [21112.614115] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:15:38 juju-e4d256-prod-github-runner-207 kernel: [21112.614823] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:15:38 juju-e4d256-prod-github-runner-207 kernel: [21112.615527] ? do_syscall_64+0x69/0xc0 Aug 22 11:15:38 juju-e4d256-prod-github-runner-207 kernel: [21112.616151] ? do_syscall_64+0x69/0xc0 Aug 22 11:15:38 juju-e4d256-prod-github-runner-207 kernel: [21112.616795] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 11:15:38 juju-e4d256-prod-github-runner-207 kernel: [21112.617515] RIP: 0033:0x7faa5d0edaff Aug 22 11:15:38 juju-e4d256-prod-github-runner-207 kernel: [21112.618137] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 11:15:38 juju-e4d256-prod-github-runner-207 kernel: [21112.620139] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 11:15:38 juju-e4d256-prod-github-runner-207 kernel: [21112.621055] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 11:15:38 juju-e4d256-prod-github-runner-207 kernel: [21112.621944] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 11:15:38 juju-e4d256-prod-github-runner-207 kernel: [21112.622838] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 11:15:38 juju-e4d256-prod-github-runner-207 kernel: [21112.623753] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 11:15:38 juju-e4d256-prod-github-runner-207 kernel: [21112.624655] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 11:15:38 juju-e4d256-prod-github-runner-207 kernel: [21112.625563] Aug 22 11:16:06 juju-e4d256-prod-github-runner-207 kernel: [21140.541980] watchdog: BUG: soft lockup - CPU#1 stuck for 19580s! [qemu-system-x86:6715] Aug 22 11:16:06 juju-e4d256-prod-github-runner-207 kernel: [21140.543914] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 11:16:06 juju-e4d256-prod-github-runner-207 kernel: [21140.544239] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 11:16:06 juju-e4d256-prod-github-runner-207 kernel: [21140.556637] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 11:16:06 juju-e4d256-prod-github-runner-207 kernel: [21140.557894] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 11:16:06 juju-e4d256-prod-github-runner-207 kernel: [21140.559148] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:16:06 juju-e4d256-prod-github-runner-207 kernel: [21140.560217] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 11:16:06 juju-e4d256-prod-github-runner-207 kernel: [21140.562857] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 11:16:06 juju-e4d256-prod-github-runner-207 kernel: [21140.563940] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 11:16:06 juju-e4d256-prod-github-runner-207 kernel: [21140.565108] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 11:16:06 juju-e4d256-prod-github-runner-207 kernel: [21140.566292] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 11:16:06 juju-e4d256-prod-github-runner-207 kernel: [21140.567484] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 11:16:06 juju-e4d256-prod-github-runner-207 kernel: [21140.568653] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 11:16:06 juju-e4d256-prod-github-runner-207 kernel: [21140.569840] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 11:16:06 juju-e4d256-prod-github-runner-207 kernel: [21140.571125] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 11:16:06 juju-e4d256-prod-github-runner-207 kernel: [21140.572230] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 11:16:06 juju-e4d256-prod-github-runner-207 kernel: [21140.573448] Call Trace: Aug 22 11:16:06 juju-e4d256-prod-github-runner-207 kernel: [21140.574458] Aug 22 11:16:06 juju-e4d256-prod-github-runner-207 kernel: [21140.575422] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:16:06 juju-e4d256-prod-github-runner-207 kernel: [21140.576468] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:16:06 juju-e4d256-prod-github-runner-207 kernel: [21140.577506] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:16:06 juju-e4d256-prod-github-runner-207 kernel: [21140.578647] ? show_regs.part.0+0x23/0x29 Aug 22 11:16:06 juju-e4d256-prod-github-runner-207 kernel: [21140.579699] ? show_regs.cold+0x8/0xd Aug 22 11:16:06 juju-e4d256-prod-github-runner-207 kernel: [21140.580685] ? watchdog_timer_fn+0x1be/0x220 Aug 22 11:16:06 juju-e4d256-prod-github-runner-207 kernel: [21140.581709] ? lockup_detector_update_enable+0x60/0x60 Aug 22 11:16:06 juju-e4d256-prod-github-runner-207 kernel: [21140.582813] ? __hrtimer_run_queues+0x107/0x230 Aug 22 11:16:06 juju-e4d256-prod-github-runner-207 kernel: [21140.584023] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 11:16:06 juju-e4d256-prod-github-runner-207 kernel: [21140.585072] ? hrtimer_interrupt+0x101/0x220 Aug 22 11:16:06 juju-e4d256-prod-github-runner-207 kernel: [21140.586111] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 11:16:06 juju-e4d256-prod-github-runner-207 kernel: [21140.587363] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 11:16:06 juju-e4d256-prod-github-runner-207 kernel: [21140.588423] Aug 22 11:16:06 juju-e4d256-prod-github-runner-207 kernel: [21140.589281] Aug 22 11:16:06 juju-e4d256-prod-github-runner-207 kernel: [21140.590120] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 11:16:06 juju-e4d256-prod-github-runner-207 kernel: [21140.591166] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:16:06 juju-e4d256-prod-github-runner-207 kernel: [21140.592220] ? _raw_spin_lock+0x22/0x30 Aug 22 11:16:06 juju-e4d256-prod-github-runner-207 kernel: [21140.593191] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:16:06 juju-e4d256-prod-github-runner-207 kernel: [21140.594250] direct_page_fault+0x206/0x310 [kvm] Aug 22 11:16:06 juju-e4d256-prod-github-runner-207 kernel: [21140.595337] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 11:16:06 juju-e4d256-prod-github-runner-207 kernel: [21140.596383] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 11:16:06 juju-e4d256-prod-github-runner-207 kernel: [21140.597399] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 11:16:06 juju-e4d256-prod-github-runner-207 kernel: [21140.598422] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 11:16:06 juju-e4d256-prod-github-runner-207 kernel: [21140.599394] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 11:16:06 juju-e4d256-prod-github-runner-207 kernel: [21140.600377] handle_exit+0x98/0x230 [kvm_amd] Aug 22 11:16:06 juju-e4d256-prod-github-runner-207 kernel: [21140.601280] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 11:16:06 juju-e4d256-prod-github-runner-207 kernel: [21140.602218] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 11:16:06 juju-e4d256-prod-github-runner-207 kernel: [21140.603205] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 11:16:06 juju-e4d256-prod-github-runner-207 kernel: [21140.604165] vcpu_run+0x62/0x2c0 [kvm] Aug 22 11:16:06 juju-e4d256-prod-github-runner-207 kernel: [21140.604998] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 11:16:06 juju-e4d256-prod-github-runner-207 kernel: [21140.605862] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 11:16:06 juju-e4d256-prod-github-runner-207 kernel: [21140.606748] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 11:16:06 juju-e4d256-prod-github-runner-207 kernel: [21140.607546] ? __seccomp_filter+0x4a/0x4a0 Aug 22 11:16:06 juju-e4d256-prod-github-runner-207 kernel: [21140.608289] ? __fget_files+0x86/0xc0 Aug 22 11:16:06 juju-e4d256-prod-github-runner-207 kernel: [21140.608994] __x64_sys_ioctl+0x95/0xd0 Aug 22 11:16:06 juju-e4d256-prod-github-runner-207 kernel: [21140.609705] do_syscall_64+0x5c/0xc0 Aug 22 11:16:06 juju-e4d256-prod-github-runner-207 kernel: [21140.610370] ? do_futex+0x162/0x1f0 Aug 22 11:16:06 juju-e4d256-prod-github-runner-207 kernel: [21140.611068] ? __x64_sys_futex+0x78/0x1e0 Aug 22 11:16:06 juju-e4d256-prod-github-runner-207 kernel: [21140.611745] ? __secure_computing+0xa9/0x120 Aug 22 11:16:06 juju-e4d256-prod-github-runner-207 kernel: [21140.612437] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 11:16:06 juju-e4d256-prod-github-runner-207 kernel: [21140.613215] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:16:06 juju-e4d256-prod-github-runner-207 kernel: [21140.613952] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:16:06 juju-e4d256-prod-github-runner-207 kernel: [21140.614678] ? do_syscall_64+0x69/0xc0 Aug 22 11:16:06 juju-e4d256-prod-github-runner-207 kernel: [21140.615365] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:16:06 juju-e4d256-prod-github-runner-207 kernel: [21140.616125] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:16:06 juju-e4d256-prod-github-runner-207 kernel: [21140.616850] ? do_syscall_64+0x69/0xc0 Aug 22 11:16:06 juju-e4d256-prod-github-runner-207 kernel: [21140.617563] ? do_syscall_64+0x69/0xc0 Aug 22 11:16:06 juju-e4d256-prod-github-runner-207 kernel: [21140.618194] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 11:16:06 juju-e4d256-prod-github-runner-207 kernel: [21140.618973] RIP: 0033:0x7faa5d0edaff Aug 22 11:16:06 juju-e4d256-prod-github-runner-207 kernel: [21140.619647] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 11:16:06 juju-e4d256-prod-github-runner-207 kernel: [21140.621681] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 11:16:06 juju-e4d256-prod-github-runner-207 kernel: [21140.622606] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 11:16:06 juju-e4d256-prod-github-runner-207 kernel: [21140.623517] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 11:16:06 juju-e4d256-prod-github-runner-207 kernel: [21140.624411] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 11:16:06 juju-e4d256-prod-github-runner-207 kernel: [21140.625506] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 11:16:06 juju-e4d256-prod-github-runner-207 kernel: [21140.626414] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 11:16:06 juju-e4d256-prod-github-runner-207 kernel: [21140.627360] Aug 22 11:16:34 juju-e4d256-prod-github-runner-207 kernel: [21168.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 19606s! [qemu-system-x86:6715] Aug 22 11:16:34 juju-e4d256-prod-github-runner-207 kernel: [21168.543915] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 11:16:34 juju-e4d256-prod-github-runner-207 kernel: [21168.544241] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 11:16:34 juju-e4d256-prod-github-runner-207 kernel: [21168.556497] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 11:16:34 juju-e4d256-prod-github-runner-207 kernel: [21168.557770] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 11:16:34 juju-e4d256-prod-github-runner-207 kernel: [21168.559016] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:16:34 juju-e4d256-prod-github-runner-207 kernel: [21168.560079] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 11:16:34 juju-e4d256-prod-github-runner-207 kernel: [21168.562654] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 11:16:34 juju-e4d256-prod-github-runner-207 kernel: [21168.563724] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 11:16:34 juju-e4d256-prod-github-runner-207 kernel: [21168.564900] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 11:16:34 juju-e4d256-prod-github-runner-207 kernel: [21168.566080] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 11:16:34 juju-e4d256-prod-github-runner-207 kernel: [21168.567273] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 11:16:34 juju-e4d256-prod-github-runner-207 kernel: [21168.568452] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 11:16:34 juju-e4d256-prod-github-runner-207 kernel: [21168.569668] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 11:16:34 juju-e4d256-prod-github-runner-207 kernel: [21168.570959] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 11:16:34 juju-e4d256-prod-github-runner-207 kernel: [21168.572079] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 11:16:34 juju-e4d256-prod-github-runner-207 kernel: [21168.573284] Call Trace: Aug 22 11:16:34 juju-e4d256-prod-github-runner-207 kernel: [21168.574202] Aug 22 11:16:34 juju-e4d256-prod-github-runner-207 kernel: [21168.575139] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:16:34 juju-e4d256-prod-github-runner-207 kernel: [21168.576177] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:16:34 juju-e4d256-prod-github-runner-207 kernel: [21168.577205] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:16:34 juju-e4d256-prod-github-runner-207 kernel: [21168.578335] ? show_regs.part.0+0x23/0x29 Aug 22 11:16:34 juju-e4d256-prod-github-runner-207 kernel: [21168.579446] ? show_regs.cold+0x8/0xd Aug 22 11:16:34 juju-e4d256-prod-github-runner-207 kernel: [21168.580460] ? watchdog_timer_fn+0x1be/0x220 Aug 22 11:16:34 juju-e4d256-prod-github-runner-207 kernel: [21168.581477] ? lockup_detector_update_enable+0x60/0x60 Aug 22 11:16:34 juju-e4d256-prod-github-runner-207 kernel: [21168.582570] ? __hrtimer_run_queues+0x107/0x230 Aug 22 11:16:34 juju-e4d256-prod-github-runner-207 kernel: [21168.583602] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 11:16:34 juju-e4d256-prod-github-runner-207 kernel: [21168.584631] ? hrtimer_interrupt+0x101/0x220 Aug 22 11:16:34 juju-e4d256-prod-github-runner-207 kernel: [21168.585655] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 11:16:34 juju-e4d256-prod-github-runner-207 kernel: [21168.586786] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 11:16:34 juju-e4d256-prod-github-runner-207 kernel: [21168.587836] Aug 22 11:16:34 juju-e4d256-prod-github-runner-207 kernel: [21168.588730] Aug 22 11:16:34 juju-e4d256-prod-github-runner-207 kernel: [21168.589592] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 11:16:34 juju-e4d256-prod-github-runner-207 kernel: [21168.590672] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:16:34 juju-e4d256-prod-github-runner-207 kernel: [21168.591726] ? _raw_spin_lock+0x22/0x30 Aug 22 11:16:34 juju-e4d256-prod-github-runner-207 kernel: [21168.592668] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:16:34 juju-e4d256-prod-github-runner-207 kernel: [21168.593687] direct_page_fault+0x206/0x310 [kvm] Aug 22 11:16:34 juju-e4d256-prod-github-runner-207 kernel: [21168.594727] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 11:16:34 juju-e4d256-prod-github-runner-207 kernel: [21168.595735] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 11:16:34 juju-e4d256-prod-github-runner-207 kernel: [21168.596737] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 11:16:34 juju-e4d256-prod-github-runner-207 kernel: [21168.597748] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 11:16:34 juju-e4d256-prod-github-runner-207 kernel: [21168.598703] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 11:16:34 juju-e4d256-prod-github-runner-207 kernel: [21168.599681] handle_exit+0x98/0x230 [kvm_amd] Aug 22 11:16:34 juju-e4d256-prod-github-runner-207 kernel: [21168.600600] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 11:16:34 juju-e4d256-prod-github-runner-207 kernel: [21168.601536] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 11:16:34 juju-e4d256-prod-github-runner-207 kernel: [21168.602500] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 11:16:34 juju-e4d256-prod-github-runner-207 kernel: [21168.603442] vcpu_run+0x62/0x2c0 [kvm] Aug 22 11:16:34 juju-e4d256-prod-github-runner-207 kernel: [21168.604278] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 11:16:34 juju-e4d256-prod-github-runner-207 kernel: [21168.605376] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 11:16:34 juju-e4d256-prod-github-runner-207 kernel: [21168.606340] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 11:16:34 juju-e4d256-prod-github-runner-207 kernel: [21168.607255] ? __seccomp_filter+0x4a/0x4a0 Aug 22 11:16:34 juju-e4d256-prod-github-runner-207 kernel: [21168.608027] ? __fget_files+0x86/0xc0 Aug 22 11:16:34 juju-e4d256-prod-github-runner-207 kernel: [21168.608755] __x64_sys_ioctl+0x95/0xd0 Aug 22 11:16:34 juju-e4d256-prod-github-runner-207 kernel: [21168.609450] do_syscall_64+0x5c/0xc0 Aug 22 11:16:34 juju-e4d256-prod-github-runner-207 kernel: [21168.610122] ? do_futex+0x162/0x1f0 Aug 22 11:16:34 juju-e4d256-prod-github-runner-207 kernel: [21168.610784] ? __x64_sys_futex+0x78/0x1e0 Aug 22 11:16:34 juju-e4d256-prod-github-runner-207 kernel: [21168.611588] ? __secure_computing+0xa9/0x120 Aug 22 11:16:34 juju-e4d256-prod-github-runner-207 kernel: [21168.612467] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 11:16:34 juju-e4d256-prod-github-runner-207 kernel: [21168.613237] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:16:34 juju-e4d256-prod-github-runner-207 kernel: [21168.613967] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:16:34 juju-e4d256-prod-github-runner-207 kernel: [21168.614763] ? do_syscall_64+0x69/0xc0 Aug 22 11:16:34 juju-e4d256-prod-github-runner-207 kernel: [21168.615433] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:16:34 juju-e4d256-prod-github-runner-207 kernel: [21168.616161] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:16:34 juju-e4d256-prod-github-runner-207 kernel: [21168.616859] ? do_syscall_64+0x69/0xc0 Aug 22 11:16:34 juju-e4d256-prod-github-runner-207 kernel: [21168.617491] ? do_syscall_64+0x69/0xc0 Aug 22 11:16:34 juju-e4d256-prod-github-runner-207 kernel: [21168.618128] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 11:16:34 juju-e4d256-prod-github-runner-207 kernel: [21168.618847] RIP: 0033:0x7faa5d0edaff Aug 22 11:16:34 juju-e4d256-prod-github-runner-207 kernel: [21168.619525] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 11:16:34 juju-e4d256-prod-github-runner-207 kernel: [21168.621543] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 11:16:34 juju-e4d256-prod-github-runner-207 kernel: [21168.622504] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 11:16:34 juju-e4d256-prod-github-runner-207 kernel: [21168.623407] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 11:16:34 juju-e4d256-prod-github-runner-207 kernel: [21168.624305] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 11:16:34 juju-e4d256-prod-github-runner-207 kernel: [21168.625191] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 11:16:34 juju-e4d256-prod-github-runner-207 kernel: [21168.626082] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 11:16:34 juju-e4d256-prod-github-runner-207 kernel: [21168.626993] Aug 22 11:17:02 juju-e4d256-prod-github-runner-207 kernel: [21196.541980] watchdog: BUG: soft lockup - CPU#1 stuck for 19632s! [qemu-system-x86:6715] Aug 22 11:17:02 juju-e4d256-prod-github-runner-207 kernel: [21196.543826] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 11:17:02 juju-e4d256-prod-github-runner-207 kernel: [21196.544094] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 11:17:02 juju-e4d256-prod-github-runner-207 kernel: [21196.556659] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 11:17:02 juju-e4d256-prod-github-runner-207 kernel: [21196.557936] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 11:17:02 juju-e4d256-prod-github-runner-207 kernel: [21196.559192] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:17:02 juju-e4d256-prod-github-runner-207 kernel: [21196.560288] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 11:17:02 juju-e4d256-prod-github-runner-207 kernel: [21196.562860] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 11:17:02 juju-e4d256-prod-github-runner-207 kernel: [21196.563909] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 11:17:02 juju-e4d256-prod-github-runner-207 kernel: [21196.565067] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 11:17:02 juju-e4d256-prod-github-runner-207 kernel: [21196.566240] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 11:17:02 juju-e4d256-prod-github-runner-207 kernel: [21196.567419] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 11:17:02 juju-e4d256-prod-github-runner-207 kernel: [21196.568581] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 11:17:02 juju-e4d256-prod-github-runner-207 kernel: [21196.569750] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 11:17:02 juju-e4d256-prod-github-runner-207 kernel: [21196.571011] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 11:17:02 juju-e4d256-prod-github-runner-207 kernel: [21196.572116] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 11:17:02 juju-e4d256-prod-github-runner-207 kernel: [21196.573320] Call Trace: Aug 22 11:17:02 juju-e4d256-prod-github-runner-207 kernel: [21196.574251] Aug 22 11:17:02 juju-e4d256-prod-github-runner-207 kernel: [21196.575148] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:17:02 juju-e4d256-prod-github-runner-207 kernel: [21196.576211] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:17:02 juju-e4d256-prod-github-runner-207 kernel: [21196.577272] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:17:02 juju-e4d256-prod-github-runner-207 kernel: [21196.578427] ? show_regs.part.0+0x23/0x29 Aug 22 11:17:02 juju-e4d256-prod-github-runner-207 kernel: [21196.579429] ? show_regs.cold+0x8/0xd Aug 22 11:17:02 juju-e4d256-prod-github-runner-207 kernel: [21196.580489] ? watchdog_timer_fn+0x1be/0x220 Aug 22 11:17:02 juju-e4d256-prod-github-runner-207 kernel: [21196.581592] ? lockup_detector_update_enable+0x60/0x60 Aug 22 11:17:02 juju-e4d256-prod-github-runner-207 kernel: [21196.582779] ? __hrtimer_run_queues+0x107/0x230 Aug 22 11:17:02 juju-e4d256-prod-github-runner-207 kernel: [21196.583810] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 11:17:02 juju-e4d256-prod-github-runner-207 kernel: [21196.584845] ? hrtimer_interrupt+0x101/0x220 Aug 22 11:17:02 juju-e4d256-prod-github-runner-207 kernel: [21196.585872] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 11:17:02 juju-e4d256-prod-github-runner-207 kernel: [21196.587064] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 11:17:02 juju-e4d256-prod-github-runner-207 kernel: [21196.588108] Aug 22 11:17:02 juju-e4d256-prod-github-runner-207 kernel: [21196.588971] Aug 22 11:17:02 juju-e4d256-prod-github-runner-207 kernel: [21196.589809] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 11:17:02 juju-e4d256-prod-github-runner-207 kernel: [21196.590854] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:17:02 juju-e4d256-prod-github-runner-207 kernel: [21196.591891] ? _raw_spin_lock+0x22/0x30 Aug 22 11:17:02 juju-e4d256-prod-github-runner-207 kernel: [21196.592839] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:17:02 juju-e4d256-prod-github-runner-207 kernel: [21196.593857] direct_page_fault+0x206/0x310 [kvm] Aug 22 11:17:02 juju-e4d256-prod-github-runner-207 kernel: [21196.594896] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 11:17:02 juju-e4d256-prod-github-runner-207 kernel: [21196.595907] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 11:17:02 juju-e4d256-prod-github-runner-207 kernel: [21196.596908] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 11:17:02 juju-e4d256-prod-github-runner-207 kernel: [21196.597915] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 11:17:02 juju-e4d256-prod-github-runner-207 kernel: [21196.598889] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 11:17:02 juju-e4d256-prod-github-runner-207 kernel: [21196.599865] handle_exit+0x98/0x230 [kvm_amd] Aug 22 11:17:02 juju-e4d256-prod-github-runner-207 kernel: [21196.600755] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 11:17:02 juju-e4d256-prod-github-runner-207 kernel: [21196.601667] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 11:17:02 juju-e4d256-prod-github-runner-207 kernel: [21196.602610] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 11:17:02 juju-e4d256-prod-github-runner-207 kernel: [21196.603513] vcpu_run+0x62/0x2c0 [kvm] Aug 22 11:17:02 juju-e4d256-prod-github-runner-207 kernel: [21196.604328] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 11:17:02 juju-e4d256-prod-github-runner-207 kernel: [21196.605146] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 11:17:02 juju-e4d256-prod-github-runner-207 kernel: [21196.605997] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 11:17:02 juju-e4d256-prod-github-runner-207 kernel: [21196.606805] ? __seccomp_filter+0x4a/0x4a0 Aug 22 11:17:02 juju-e4d256-prod-github-runner-207 kernel: [21196.607545] ? __fget_files+0x86/0xc0 Aug 22 11:17:02 juju-e4d256-prod-github-runner-207 kernel: [21196.608247] __x64_sys_ioctl+0x95/0xd0 Aug 22 11:17:02 juju-e4d256-prod-github-runner-207 kernel: [21196.608937] do_syscall_64+0x5c/0xc0 Aug 22 11:17:02 juju-e4d256-prod-github-runner-207 kernel: [21196.609604] ? do_futex+0x162/0x1f0 Aug 22 11:17:02 juju-e4d256-prod-github-runner-207 kernel: [21196.610261] ? __x64_sys_futex+0x78/0x1e0 Aug 22 11:17:02 juju-e4d256-prod-github-runner-207 kernel: [21196.610932] ? __secure_computing+0xa9/0x120 Aug 22 11:17:02 juju-e4d256-prod-github-runner-207 kernel: [21196.611620] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 11:17:02 juju-e4d256-prod-github-runner-207 kernel: [21196.612378] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:17:02 juju-e4d256-prod-github-runner-207 kernel: [21196.613099] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:17:02 juju-e4d256-prod-github-runner-207 kernel: [21196.613814] ? do_syscall_64+0x69/0xc0 Aug 22 11:17:02 juju-e4d256-prod-github-runner-207 kernel: [21196.614514] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:17:02 juju-e4d256-prod-github-runner-207 kernel: [21196.615234] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:17:02 juju-e4d256-prod-github-runner-207 kernel: [21196.615927] ? do_syscall_64+0x69/0xc0 Aug 22 11:17:02 juju-e4d256-prod-github-runner-207 kernel: [21196.616549] ? do_syscall_64+0x69/0xc0 Aug 22 11:17:02 juju-e4d256-prod-github-runner-207 kernel: [21196.617169] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 11:17:02 juju-e4d256-prod-github-runner-207 kernel: [21196.617876] RIP: 0033:0x7faa5d0edaff Aug 22 11:17:02 juju-e4d256-prod-github-runner-207 kernel: [21196.618561] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 11:17:02 juju-e4d256-prod-github-runner-207 kernel: [21196.620540] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 11:17:02 juju-e4d256-prod-github-runner-207 kernel: [21196.621448] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 11:17:02 juju-e4d256-prod-github-runner-207 kernel: [21196.622413] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 11:17:02 juju-e4d256-prod-github-runner-207 kernel: [21196.623318] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 11:17:02 juju-e4d256-prod-github-runner-207 kernel: [21196.624203] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 11:17:02 juju-e4d256-prod-github-runner-207 kernel: [21196.625087] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 11:17:02 juju-e4d256-prod-github-runner-207 kernel: [21196.625977] Aug 22 11:17:30 juju-e4d256-prod-github-runner-207 kernel: [21224.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 19658s! [qemu-system-x86:6715] Aug 22 11:17:30 juju-e4d256-prod-github-runner-207 kernel: [21224.543847] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 11:17:30 juju-e4d256-prod-github-runner-207 kernel: [21224.544145] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 11:17:30 juju-e4d256-prod-github-runner-207 kernel: [21224.556188] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 11:17:30 juju-e4d256-prod-github-runner-207 kernel: [21224.557457] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 11:17:30 juju-e4d256-prod-github-runner-207 kernel: [21224.558696] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:17:30 juju-e4d256-prod-github-runner-207 kernel: [21224.559751] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 11:17:30 juju-e4d256-prod-github-runner-207 kernel: [21224.562304] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 11:17:30 juju-e4d256-prod-github-runner-207 kernel: [21224.563350] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 11:17:30 juju-e4d256-prod-github-runner-207 kernel: [21224.564508] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 11:17:30 juju-e4d256-prod-github-runner-207 kernel: [21224.565671] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 11:17:30 juju-e4d256-prod-github-runner-207 kernel: [21224.566844] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 11:17:30 juju-e4d256-prod-github-runner-207 kernel: [21224.568003] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 11:17:30 juju-e4d256-prod-github-runner-207 kernel: [21224.569172] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 11:17:30 juju-e4d256-prod-github-runner-207 kernel: [21224.570429] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 11:17:30 juju-e4d256-prod-github-runner-207 kernel: [21224.571537] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 11:17:30 juju-e4d256-prod-github-runner-207 kernel: [21224.572738] Call Trace: Aug 22 11:17:30 juju-e4d256-prod-github-runner-207 kernel: [21224.573655] Aug 22 11:17:30 juju-e4d256-prod-github-runner-207 kernel: [21224.574555] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:17:30 juju-e4d256-prod-github-runner-207 kernel: [21224.575586] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:17:30 juju-e4d256-prod-github-runner-207 kernel: [21224.576603] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:17:30 juju-e4d256-prod-github-runner-207 kernel: [21224.577716] ? show_regs.part.0+0x23/0x29 Aug 22 11:17:30 juju-e4d256-prod-github-runner-207 kernel: [21224.578710] ? show_regs.cold+0x8/0xd Aug 22 11:17:30 juju-e4d256-prod-github-runner-207 kernel: [21224.579677] ? watchdog_timer_fn+0x1be/0x220 Aug 22 11:17:30 juju-e4d256-prod-github-runner-207 kernel: [21224.580687] ? lockup_detector_update_enable+0x60/0x60 Aug 22 11:17:30 juju-e4d256-prod-github-runner-207 kernel: [21224.581757] ? __hrtimer_run_queues+0x107/0x230 Aug 22 11:17:30 juju-e4d256-prod-github-runner-207 kernel: [21224.582781] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 11:17:30 juju-e4d256-prod-github-runner-207 kernel: [21224.583802] ? hrtimer_interrupt+0x101/0x220 Aug 22 11:17:30 juju-e4d256-prod-github-runner-207 kernel: [21224.584819] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 11:17:30 juju-e4d256-prod-github-runner-207 kernel: [21224.585898] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 11:17:30 juju-e4d256-prod-github-runner-207 kernel: [21224.586940] Aug 22 11:17:30 juju-e4d256-prod-github-runner-207 kernel: [21224.587796] Aug 22 11:17:30 juju-e4d256-prod-github-runner-207 kernel: [21224.588632] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 11:17:30 juju-e4d256-prod-github-runner-207 kernel: [21224.589668] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:17:30 juju-e4d256-prod-github-runner-207 kernel: [21224.590709] ? _raw_spin_lock+0x22/0x30 Aug 22 11:17:30 juju-e4d256-prod-github-runner-207 kernel: [21224.591651] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:17:30 juju-e4d256-prod-github-runner-207 kernel: [21224.592668] direct_page_fault+0x206/0x310 [kvm] Aug 22 11:17:30 juju-e4d256-prod-github-runner-207 kernel: [21224.593707] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 11:17:30 juju-e4d256-prod-github-runner-207 kernel: [21224.594734] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 11:17:30 juju-e4d256-prod-github-runner-207 kernel: [21224.595738] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 11:17:30 juju-e4d256-prod-github-runner-207 kernel: [21224.596735] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 11:17:30 juju-e4d256-prod-github-runner-207 kernel: [21224.597700] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 11:17:30 juju-e4d256-prod-github-runner-207 kernel: [21224.598676] handle_exit+0x98/0x230 [kvm_amd] Aug 22 11:17:30 juju-e4d256-prod-github-runner-207 kernel: [21224.599571] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 11:17:30 juju-e4d256-prod-github-runner-207 kernel: [21224.600632] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 11:17:30 juju-e4d256-prod-github-runner-207 kernel: [21224.601562] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 11:17:30 juju-e4d256-prod-github-runner-207 kernel: [21224.602479] vcpu_run+0x62/0x2c0 [kvm] Aug 22 11:17:30 juju-e4d256-prod-github-runner-207 kernel: [21224.603293] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 11:17:30 juju-e4d256-prod-github-runner-207 kernel: [21224.604097] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 11:17:30 juju-e4d256-prod-github-runner-207 kernel: [21224.604952] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 11:17:30 juju-e4d256-prod-github-runner-207 kernel: [21224.605754] ? __seccomp_filter+0x4a/0x4a0 Aug 22 11:17:30 juju-e4d256-prod-github-runner-207 kernel: [21224.606498] ? __fget_files+0x86/0xc0 Aug 22 11:17:30 juju-e4d256-prod-github-runner-207 kernel: [21224.607205] __x64_sys_ioctl+0x95/0xd0 Aug 22 11:17:30 juju-e4d256-prod-github-runner-207 kernel: [21224.607900] do_syscall_64+0x5c/0xc0 Aug 22 11:17:30 juju-e4d256-prod-github-runner-207 kernel: [21224.608566] ? do_futex+0x162/0x1f0 Aug 22 11:17:30 juju-e4d256-prod-github-runner-207 kernel: [21224.609214] ? __x64_sys_futex+0x78/0x1e0 Aug 22 11:17:30 juju-e4d256-prod-github-runner-207 kernel: [21224.609893] ? __secure_computing+0xa9/0x120 Aug 22 11:17:30 juju-e4d256-prod-github-runner-207 kernel: [21224.610588] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 11:17:30 juju-e4d256-prod-github-runner-207 kernel: [21224.611344] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:17:30 juju-e4d256-prod-github-runner-207 kernel: [21224.612062] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:17:30 juju-e4d256-prod-github-runner-207 kernel: [21224.612786] ? do_syscall_64+0x69/0xc0 Aug 22 11:17:30 juju-e4d256-prod-github-runner-207 kernel: [21224.613428] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:17:30 juju-e4d256-prod-github-runner-207 kernel: [21224.614145] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:17:30 juju-e4d256-prod-github-runner-207 kernel: [21224.614842] ? do_syscall_64+0x69/0xc0 Aug 22 11:17:30 juju-e4d256-prod-github-runner-207 kernel: [21224.615463] ? do_syscall_64+0x69/0xc0 Aug 22 11:17:30 juju-e4d256-prod-github-runner-207 kernel: [21224.616084] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 11:17:30 juju-e4d256-prod-github-runner-207 kernel: [21224.616856] RIP: 0033:0x7faa5d0edaff Aug 22 11:17:30 juju-e4d256-prod-github-runner-207 kernel: [21224.617501] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 11:17:30 juju-e4d256-prod-github-runner-207 kernel: [21224.619495] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 11:17:30 juju-e4d256-prod-github-runner-207 kernel: [21224.620411] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 11:17:30 juju-e4d256-prod-github-runner-207 kernel: [21224.621296] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 11:17:30 juju-e4d256-prod-github-runner-207 kernel: [21224.622192] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 11:17:30 juju-e4d256-prod-github-runner-207 kernel: [21224.623088] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 11:17:30 juju-e4d256-prod-github-runner-207 kernel: [21224.623973] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 11:17:30 juju-e4d256-prod-github-runner-207 kernel: [21224.624862] Aug 22 11:17:44 juju-e4d256-prod-github-runner-207 kernel: [21238.604709] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 11:17:44 juju-e4d256-prod-github-runner-207 kernel: [21238.606534] rcu: 1-....: (5263846 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=2548539 Aug 22 11:17:44 juju-e4d256-prod-github-runner-207 kernel: [21238.607669] (t=5280351 jiffies g=23269 q=26957) Aug 22 11:17:44 juju-e4d256-prod-github-runner-207 kernel: [21238.608463] NMI backtrace for cpu 1 Aug 22 11:17:44 juju-e4d256-prod-github-runner-207 kernel: [21238.609177] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 11:17:44 juju-e4d256-prod-github-runner-207 kernel: [21238.610290] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 11:17:44 juju-e4d256-prod-github-runner-207 kernel: [21238.611363] Call Trace: Aug 22 11:17:44 juju-e4d256-prod-github-runner-207 kernel: [21238.612048] Aug 22 11:17:44 juju-e4d256-prod-github-runner-207 kernel: [21238.612705] show_stack+0x52/0x5c Aug 22 11:17:44 juju-e4d256-prod-github-runner-207 kernel: [21238.613472] dump_stack_lvl+0x4a/0x63 Aug 22 11:17:44 juju-e4d256-prod-github-runner-207 kernel: [21238.614232] dump_stack+0x10/0x16 Aug 22 11:17:44 juju-e4d256-prod-github-runner-207 kernel: [21238.614955] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 11:17:44 juju-e4d256-prod-github-runner-207 kernel: [21238.615735] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 11:17:44 juju-e4d256-prod-github-runner-207 kernel: [21238.616514] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 11:17:44 juju-e4d256-prod-github-runner-207 kernel: [21238.617333] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 11:17:44 juju-e4d256-prod-github-runner-207 kernel: [21238.618165] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 11:17:44 juju-e4d256-prod-github-runner-207 kernel: [21238.618970] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 11:17:44 juju-e4d256-prod-github-runner-207 kernel: [21238.619740] print_cpu_stall.cold+0x2f/0xe2 Aug 22 11:17:44 juju-e4d256-prod-github-runner-207 kernel: [21238.620501] ? timekeeping_update+0xf7/0x150 Aug 22 11:17:44 juju-e4d256-prod-github-runner-207 kernel: [21238.621276] check_cpu_stall+0x109/0x270 Aug 22 11:17:44 juju-e4d256-prod-github-runner-207 kernel: [21238.622073] rcu_sched_clock_irq+0x9a/0x250 Aug 22 11:17:44 juju-e4d256-prod-github-runner-207 kernel: [21238.622854] update_process_times+0x94/0xd0 Aug 22 11:17:44 juju-e4d256-prod-github-runner-207 kernel: [21238.623614] tick_sched_handle+0x29/0x70 Aug 22 11:17:44 juju-e4d256-prod-github-runner-207 kernel: [21238.624361] tick_sched_timer+0x8c/0xc0 Aug 22 11:17:44 juju-e4d256-prod-github-runner-207 kernel: [21238.625101] ? tick_nohz_handler+0xb0/0xb0 Aug 22 11:17:44 juju-e4d256-prod-github-runner-207 kernel: [21238.625865] __hrtimer_run_queues+0x107/0x230 Aug 22 11:17:44 juju-e4d256-prod-github-runner-207 kernel: [21238.626634] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 11:17:44 juju-e4d256-prod-github-runner-207 kernel: [21238.627408] hrtimer_interrupt+0x101/0x220 Aug 22 11:17:44 juju-e4d256-prod-github-runner-207 kernel: [21238.628164] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 11:17:44 juju-e4d256-prod-github-runner-207 kernel: [21238.628987] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 11:17:44 juju-e4d256-prod-github-runner-207 kernel: [21238.629809] Aug 22 11:17:44 juju-e4d256-prod-github-runner-207 kernel: [21238.630441] Aug 22 11:17:44 juju-e4d256-prod-github-runner-207 kernel: [21238.631067] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 11:17:44 juju-e4d256-prod-github-runner-207 kernel: [21238.631881] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:17:44 juju-e4d256-prod-github-runner-207 kernel: [21238.632755] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 11:17:44 juju-e4d256-prod-github-runner-207 kernel: [21238.634962] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 11:17:44 juju-e4d256-prod-github-runner-207 kernel: [21238.635830] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 11:17:44 juju-e4d256-prod-github-runner-207 kernel: [21238.636820] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 11:17:44 juju-e4d256-prod-github-runner-207 kernel: [21238.637797] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 11:17:44 juju-e4d256-prod-github-runner-207 kernel: [21238.638754] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 11:17:44 juju-e4d256-prod-github-runner-207 kernel: [21238.639708] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 11:17:44 juju-e4d256-prod-github-runner-207 kernel: [21238.640658] ? _raw_spin_lock+0x22/0x30 Aug 22 11:17:44 juju-e4d256-prod-github-runner-207 kernel: [21238.641448] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:17:44 juju-e4d256-prod-github-runner-207 kernel: [21238.642335] direct_page_fault+0x206/0x310 [kvm] Aug 22 11:17:44 juju-e4d256-prod-github-runner-207 kernel: [21238.643169] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 11:17:44 juju-e4d256-prod-github-runner-207 kernel: [21238.643994] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 11:17:44 juju-e4d256-prod-github-runner-207 kernel: [21238.644839] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 11:17:44 juju-e4d256-prod-github-runner-207 kernel: [21238.645677] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 11:17:44 juju-e4d256-prod-github-runner-207 kernel: [21238.646461] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 11:17:44 juju-e4d256-prod-github-runner-207 kernel: [21238.647285] handle_exit+0x98/0x230 [kvm_amd] Aug 22 11:17:44 juju-e4d256-prod-github-runner-207 kernel: [21238.648036] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 11:17:44 juju-e4d256-prod-github-runner-207 kernel: [21238.648817] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 11:17:44 juju-e4d256-prod-github-runner-207 kernel: [21238.649629] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 11:17:44 juju-e4d256-prod-github-runner-207 kernel: [21238.650412] vcpu_run+0x62/0x2c0 [kvm] Aug 22 11:17:44 juju-e4d256-prod-github-runner-207 kernel: [21238.651131] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 11:17:44 juju-e4d256-prod-github-runner-207 kernel: [21238.651863] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 11:17:44 juju-e4d256-prod-github-runner-207 kernel: [21238.652661] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 11:17:44 juju-e4d256-prod-github-runner-207 kernel: [21238.653425] ? __seccomp_filter+0x4a/0x4a0 Aug 22 11:17:44 juju-e4d256-prod-github-runner-207 kernel: [21238.654154] ? __fget_files+0x86/0xc0 Aug 22 11:17:44 juju-e4d256-prod-github-runner-207 kernel: [21238.654847] __x64_sys_ioctl+0x95/0xd0 Aug 22 11:17:44 juju-e4d256-prod-github-runner-207 kernel: [21238.655543] do_syscall_64+0x5c/0xc0 Aug 22 11:17:44 juju-e4d256-prod-github-runner-207 kernel: [21238.656228] ? do_futex+0x162/0x1f0 Aug 22 11:17:44 juju-e4d256-prod-github-runner-207 kernel: [21238.656944] ? __x64_sys_futex+0x78/0x1e0 Aug 22 11:17:44 juju-e4d256-prod-github-runner-207 kernel: [21238.657664] ? __secure_computing+0xa9/0x120 Aug 22 11:17:44 juju-e4d256-prod-github-runner-207 kernel: [21238.658380] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 11:17:44 juju-e4d256-prod-github-runner-207 kernel: [21238.659173] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:17:44 juju-e4d256-prod-github-runner-207 kernel: [21238.659926] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:17:44 juju-e4d256-prod-github-runner-207 kernel: [21238.660679] ? do_syscall_64+0x69/0xc0 Aug 22 11:17:44 juju-e4d256-prod-github-runner-207 kernel: [21238.661374] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:17:44 juju-e4d256-prod-github-runner-207 kernel: [21238.662142] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:17:44 juju-e4d256-prod-github-runner-207 kernel: [21238.662899] ? do_syscall_64+0x69/0xc0 Aug 22 11:17:44 juju-e4d256-prod-github-runner-207 kernel: [21238.663591] ? do_syscall_64+0x69/0xc0 Aug 22 11:17:44 juju-e4d256-prod-github-runner-207 kernel: [21238.664281] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 11:17:44 juju-e4d256-prod-github-runner-207 kernel: [21238.665054] RIP: 0033:0x7faa5d0edaff Aug 22 11:17:44 juju-e4d256-prod-github-runner-207 kernel: [21238.665787] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 11:17:44 juju-e4d256-prod-github-runner-207 kernel: [21238.667892] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 11:17:44 juju-e4d256-prod-github-runner-207 kernel: [21238.668859] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 11:17:44 juju-e4d256-prod-github-runner-207 kernel: [21238.669814] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 11:17:44 juju-e4d256-prod-github-runner-207 kernel: [21238.670765] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 11:17:44 juju-e4d256-prod-github-runner-207 kernel: [21238.671746] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 11:17:44 juju-e4d256-prod-github-runner-207 kernel: [21238.672676] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 11:17:44 juju-e4d256-prod-github-runner-207 kernel: [21238.673614] Aug 22 11:18:10 juju-e4d256-prod-github-runner-207 kernel: [21264.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 19696s! [qemu-system-x86:6715] Aug 22 11:18:10 juju-e4d256-prod-github-runner-207 kernel: [21264.543840] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 11:18:10 juju-e4d256-prod-github-runner-207 kernel: [21264.544157] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 11:18:10 juju-e4d256-prod-github-runner-207 kernel: [21264.557486] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 11:18:10 juju-e4d256-prod-github-runner-207 kernel: [21264.558795] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 11:18:10 juju-e4d256-prod-github-runner-207 kernel: [21264.560173] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:18:10 juju-e4d256-prod-github-runner-207 kernel: [21264.561457] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 11:18:10 juju-e4d256-prod-github-runner-207 kernel: [21264.564028] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 11:18:10 juju-e4d256-prod-github-runner-207 kernel: [21264.565100] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 11:18:10 juju-e4d256-prod-github-runner-207 kernel: [21264.566275] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 11:18:10 juju-e4d256-prod-github-runner-207 kernel: [21264.567442] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 11:18:10 juju-e4d256-prod-github-runner-207 kernel: [21264.568627] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 11:18:10 juju-e4d256-prod-github-runner-207 kernel: [21264.569879] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 11:18:10 juju-e4d256-prod-github-runner-207 kernel: [21264.571059] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 11:18:10 juju-e4d256-prod-github-runner-207 kernel: [21264.572291] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 11:18:10 juju-e4d256-prod-github-runner-207 kernel: [21264.573438] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 11:18:10 juju-e4d256-prod-github-runner-207 kernel: [21264.574701] Call Trace: Aug 22 11:18:10 juju-e4d256-prod-github-runner-207 kernel: [21264.575641] Aug 22 11:18:10 juju-e4d256-prod-github-runner-207 kernel: [21264.576562] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:18:10 juju-e4d256-prod-github-runner-207 kernel: [21264.577611] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:18:10 juju-e4d256-prod-github-runner-207 kernel: [21264.578650] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:18:10 juju-e4d256-prod-github-runner-207 kernel: [21264.579765] ? show_regs.part.0+0x23/0x29 Aug 22 11:18:10 juju-e4d256-prod-github-runner-207 kernel: [21264.580781] ? show_regs.cold+0x8/0xd Aug 22 11:18:10 juju-e4d256-prod-github-runner-207 kernel: [21264.581969] ? watchdog_timer_fn+0x1be/0x220 Aug 22 11:18:10 juju-e4d256-prod-github-runner-207 kernel: [21264.582984] ? lockup_detector_update_enable+0x60/0x60 Aug 22 11:18:10 juju-e4d256-prod-github-runner-207 kernel: [21264.584074] ? __hrtimer_run_queues+0x107/0x230 Aug 22 11:18:10 juju-e4d256-prod-github-runner-207 kernel: [21264.585129] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 11:18:10 juju-e4d256-prod-github-runner-207 kernel: [21264.586179] ? hrtimer_interrupt+0x101/0x220 Aug 22 11:18:10 juju-e4d256-prod-github-runner-207 kernel: [21264.587239] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 11:18:10 juju-e4d256-prod-github-runner-207 kernel: [21264.588354] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 11:18:10 juju-e4d256-prod-github-runner-207 kernel: [21264.589447] Aug 22 11:18:10 juju-e4d256-prod-github-runner-207 kernel: [21264.590321] Aug 22 11:18:10 juju-e4d256-prod-github-runner-207 kernel: [21264.591170] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 11:18:10 juju-e4d256-prod-github-runner-207 kernel: [21264.592208] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:18:10 juju-e4d256-prod-github-runner-207 kernel: [21264.593296] ? _raw_spin_lock+0x22/0x30 Aug 22 11:18:10 juju-e4d256-prod-github-runner-207 kernel: [21264.594255] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:18:10 juju-e4d256-prod-github-runner-207 kernel: [21264.595420] direct_page_fault+0x206/0x310 [kvm] Aug 22 11:18:10 juju-e4d256-prod-github-runner-207 kernel: [21264.596472] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 11:18:10 juju-e4d256-prod-github-runner-207 kernel: [21264.597507] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 11:18:10 juju-e4d256-prod-github-runner-207 kernel: [21264.598522] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 11:18:10 juju-e4d256-prod-github-runner-207 kernel: [21264.599595] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 11:18:10 juju-e4d256-prod-github-runner-207 kernel: [21264.600640] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 11:18:10 juju-e4d256-prod-github-runner-207 kernel: [21264.601696] handle_exit+0x98/0x230 [kvm_amd] Aug 22 11:18:10 juju-e4d256-prod-github-runner-207 kernel: [21264.602598] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 11:18:10 juju-e4d256-prod-github-runner-207 kernel: [21264.603568] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 11:18:10 juju-e4d256-prod-github-runner-207 kernel: [21264.604524] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 11:18:10 juju-e4d256-prod-github-runner-207 kernel: [21264.605473] vcpu_run+0x62/0x2c0 [kvm] Aug 22 11:18:10 juju-e4d256-prod-github-runner-207 kernel: [21264.606301] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 11:18:10 juju-e4d256-prod-github-runner-207 kernel: [21264.607122] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 11:18:10 juju-e4d256-prod-github-runner-207 kernel: [21264.607989] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 11:18:10 juju-e4d256-prod-github-runner-207 kernel: [21264.608806] ? __seccomp_filter+0x4a/0x4a0 Aug 22 11:18:10 juju-e4d256-prod-github-runner-207 kernel: [21264.609587] ? __fget_files+0x86/0xc0 Aug 22 11:18:10 juju-e4d256-prod-github-runner-207 kernel: [21264.610301] __x64_sys_ioctl+0x95/0xd0 Aug 22 11:18:10 juju-e4d256-prod-github-runner-207 kernel: [21264.611009] do_syscall_64+0x5c/0xc0 Aug 22 11:18:10 juju-e4d256-prod-github-runner-207 kernel: [21264.611682] ? do_futex+0x162/0x1f0 Aug 22 11:18:10 juju-e4d256-prod-github-runner-207 kernel: [21264.612342] ? __x64_sys_futex+0x78/0x1e0 Aug 22 11:18:10 juju-e4d256-prod-github-runner-207 kernel: [21264.613055] ? __secure_computing+0xa9/0x120 Aug 22 11:18:10 juju-e4d256-prod-github-runner-207 kernel: [21264.613781] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 11:18:10 juju-e4d256-prod-github-runner-207 kernel: [21264.614572] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:18:10 juju-e4d256-prod-github-runner-207 kernel: [21264.615304] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:18:10 juju-e4d256-prod-github-runner-207 kernel: [21264.616070] ? do_syscall_64+0x69/0xc0 Aug 22 11:18:10 juju-e4d256-prod-github-runner-207 kernel: [21264.616769] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:18:10 juju-e4d256-prod-github-runner-207 kernel: [21264.617510] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:18:10 juju-e4d256-prod-github-runner-207 kernel: [21264.618208] ? do_syscall_64+0x69/0xc0 Aug 22 11:18:10 juju-e4d256-prod-github-runner-207 kernel: [21264.618836] ? do_syscall_64+0x69/0xc0 Aug 22 11:18:10 juju-e4d256-prod-github-runner-207 kernel: [21264.619460] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 11:18:10 juju-e4d256-prod-github-runner-207 kernel: [21264.620183] RIP: 0033:0x7faa5d0edaff Aug 22 11:18:10 juju-e4d256-prod-github-runner-207 kernel: [21264.620873] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 11:18:10 juju-e4d256-prod-github-runner-207 kernel: [21264.622911] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 11:18:10 juju-e4d256-prod-github-runner-207 kernel: [21264.623830] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 11:18:10 juju-e4d256-prod-github-runner-207 kernel: [21264.624734] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 11:18:10 juju-e4d256-prod-github-runner-207 kernel: [21264.625664] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 11:18:10 juju-e4d256-prod-github-runner-207 kernel: [21264.626570] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 11:18:10 juju-e4d256-prod-github-runner-207 kernel: [21264.627481] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 11:18:10 juju-e4d256-prod-github-runner-207 kernel: [21264.628391] Aug 22 11:18:38 juju-e4d256-prod-github-runner-207 kernel: [21292.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 19722s! [qemu-system-x86:6715] Aug 22 11:18:38 juju-e4d256-prod-github-runner-207 kernel: [21292.543914] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 11:18:38 juju-e4d256-prod-github-runner-207 kernel: [21292.544246] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 11:18:38 juju-e4d256-prod-github-runner-207 kernel: [21292.556333] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 11:18:38 juju-e4d256-prod-github-runner-207 kernel: [21292.557608] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 11:18:38 juju-e4d256-prod-github-runner-207 kernel: [21292.558977] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:18:38 juju-e4d256-prod-github-runner-207 kernel: [21292.560029] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 11:18:38 juju-e4d256-prod-github-runner-207 kernel: [21292.562586] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 11:18:38 juju-e4d256-prod-github-runner-207 kernel: [21292.563628] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 11:18:38 juju-e4d256-prod-github-runner-207 kernel: [21292.564785] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 11:18:38 juju-e4d256-prod-github-runner-207 kernel: [21292.565960] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 11:18:38 juju-e4d256-prod-github-runner-207 kernel: [21292.567115] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 11:18:38 juju-e4d256-prod-github-runner-207 kernel: [21292.568304] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 11:18:38 juju-e4d256-prod-github-runner-207 kernel: [21292.569637] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 11:18:38 juju-e4d256-prod-github-runner-207 kernel: [21292.571085] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 11:18:38 juju-e4d256-prod-github-runner-207 kernel: [21292.572256] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 11:18:38 juju-e4d256-prod-github-runner-207 kernel: [21292.573465] Call Trace: Aug 22 11:18:38 juju-e4d256-prod-github-runner-207 kernel: [21292.574382] Aug 22 11:18:38 juju-e4d256-prod-github-runner-207 kernel: [21292.575292] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:18:38 juju-e4d256-prod-github-runner-207 kernel: [21292.576336] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:18:38 juju-e4d256-prod-github-runner-207 kernel: [21292.577376] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:18:38 juju-e4d256-prod-github-runner-207 kernel: [21292.578480] ? show_regs.part.0+0x23/0x29 Aug 22 11:18:38 juju-e4d256-prod-github-runner-207 kernel: [21292.579475] ? show_regs.cold+0x8/0xd Aug 22 11:18:38 juju-e4d256-prod-github-runner-207 kernel: [21292.580450] ? watchdog_timer_fn+0x1be/0x220 Aug 22 11:18:38 juju-e4d256-prod-github-runner-207 kernel: [21292.581475] ? lockup_detector_update_enable+0x60/0x60 Aug 22 11:18:38 juju-e4d256-prod-github-runner-207 kernel: [21292.582536] ? __hrtimer_run_queues+0x107/0x230 Aug 22 11:18:38 juju-e4d256-prod-github-runner-207 kernel: [21292.583561] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 11:18:38 juju-e4d256-prod-github-runner-207 kernel: [21292.584582] ? hrtimer_interrupt+0x101/0x220 Aug 22 11:18:38 juju-e4d256-prod-github-runner-207 kernel: [21292.585621] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 11:18:38 juju-e4d256-prod-github-runner-207 kernel: [21292.586697] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 11:18:38 juju-e4d256-prod-github-runner-207 kernel: [21292.587747] Aug 22 11:18:38 juju-e4d256-prod-github-runner-207 kernel: [21292.588604] Aug 22 11:18:38 juju-e4d256-prod-github-runner-207 kernel: [21292.589464] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 11:18:38 juju-e4d256-prod-github-runner-207 kernel: [21292.590508] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:18:38 juju-e4d256-prod-github-runner-207 kernel: [21292.591550] ? _raw_spin_lock+0x22/0x30 Aug 22 11:18:38 juju-e4d256-prod-github-runner-207 kernel: [21292.592515] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:18:38 juju-e4d256-prod-github-runner-207 kernel: [21292.593559] direct_page_fault+0x206/0x310 [kvm] Aug 22 11:18:38 juju-e4d256-prod-github-runner-207 kernel: [21292.594593] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 11:18:38 juju-e4d256-prod-github-runner-207 kernel: [21292.595607] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 11:18:38 juju-e4d256-prod-github-runner-207 kernel: [21292.596605] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 11:18:38 juju-e4d256-prod-github-runner-207 kernel: [21292.597677] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 11:18:38 juju-e4d256-prod-github-runner-207 kernel: [21292.598639] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 11:18:38 juju-e4d256-prod-github-runner-207 kernel: [21292.599622] handle_exit+0x98/0x230 [kvm_amd] Aug 22 11:18:38 juju-e4d256-prod-github-runner-207 kernel: [21292.600520] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 11:18:38 juju-e4d256-prod-github-runner-207 kernel: [21292.601476] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 11:18:38 juju-e4d256-prod-github-runner-207 kernel: [21292.602413] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 11:18:38 juju-e4d256-prod-github-runner-207 kernel: [21292.603324] vcpu_run+0x62/0x2c0 [kvm] Aug 22 11:18:38 juju-e4d256-prod-github-runner-207 kernel: [21292.604136] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 11:18:38 juju-e4d256-prod-github-runner-207 kernel: [21292.604966] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 11:18:38 juju-e4d256-prod-github-runner-207 kernel: [21292.605827] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 11:18:38 juju-e4d256-prod-github-runner-207 kernel: [21292.606642] ? __seccomp_filter+0x4a/0x4a0 Aug 22 11:18:38 juju-e4d256-prod-github-runner-207 kernel: [21292.607384] ? __fget_files+0x86/0xc0 Aug 22 11:18:38 juju-e4d256-prod-github-runner-207 kernel: [21292.608085] __x64_sys_ioctl+0x95/0xd0 Aug 22 11:18:38 juju-e4d256-prod-github-runner-207 kernel: [21292.608778] do_syscall_64+0x5c/0xc0 Aug 22 11:18:38 juju-e4d256-prod-github-runner-207 kernel: [21292.609471] ? do_futex+0x162/0x1f0 Aug 22 11:18:38 juju-e4d256-prod-github-runner-207 kernel: [21292.610120] ? __x64_sys_futex+0x78/0x1e0 Aug 22 11:18:38 juju-e4d256-prod-github-runner-207 kernel: [21292.610796] ? __secure_computing+0xa9/0x120 Aug 22 11:18:38 juju-e4d256-prod-github-runner-207 kernel: [21292.611489] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 11:18:38 juju-e4d256-prod-github-runner-207 kernel: [21292.612290] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:18:38 juju-e4d256-prod-github-runner-207 kernel: [21292.613031] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:18:38 juju-e4d256-prod-github-runner-207 kernel: [21292.613751] ? do_syscall_64+0x69/0xc0 Aug 22 11:18:38 juju-e4d256-prod-github-runner-207 kernel: [21292.614397] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:18:38 juju-e4d256-prod-github-runner-207 kernel: [21292.615125] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:18:38 juju-e4d256-prod-github-runner-207 kernel: [21292.615819] ? do_syscall_64+0x69/0xc0 Aug 22 11:18:38 juju-e4d256-prod-github-runner-207 kernel: [21292.616443] ? do_syscall_64+0x69/0xc0 Aug 22 11:18:38 juju-e4d256-prod-github-runner-207 kernel: [21292.617084] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 11:18:38 juju-e4d256-prod-github-runner-207 kernel: [21292.617790] RIP: 0033:0x7faa5d0edaff Aug 22 11:18:38 juju-e4d256-prod-github-runner-207 kernel: [21292.618464] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 11:18:38 juju-e4d256-prod-github-runner-207 kernel: [21292.620464] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 11:18:38 juju-e4d256-prod-github-runner-207 kernel: [21292.621430] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 11:18:38 juju-e4d256-prod-github-runner-207 kernel: [21292.622320] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 11:18:38 juju-e4d256-prod-github-runner-207 kernel: [21292.623204] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 11:18:38 juju-e4d256-prod-github-runner-207 kernel: [21292.624093] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 11:18:38 juju-e4d256-prod-github-runner-207 kernel: [21292.625004] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 11:18:38 juju-e4d256-prod-github-runner-207 kernel: [21292.625907] Aug 22 11:19:06 juju-e4d256-prod-github-runner-207 kernel: [21320.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 19748s! [qemu-system-x86:6715] Aug 22 11:19:06 juju-e4d256-prod-github-runner-207 kernel: [21320.543882] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 11:19:06 juju-e4d256-prod-github-runner-207 kernel: [21320.544181] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 11:19:06 juju-e4d256-prod-github-runner-207 kernel: [21320.556474] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 11:19:06 juju-e4d256-prod-github-runner-207 kernel: [21320.557774] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 11:19:06 juju-e4d256-prod-github-runner-207 kernel: [21320.559011] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:19:06 juju-e4d256-prod-github-runner-207 kernel: [21320.560077] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 11:19:06 juju-e4d256-prod-github-runner-207 kernel: [21320.562668] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 11:19:06 juju-e4d256-prod-github-runner-207 kernel: [21320.563720] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 11:19:06 juju-e4d256-prod-github-runner-207 kernel: [21320.564908] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 11:19:06 juju-e4d256-prod-github-runner-207 kernel: [21320.566083] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 11:19:06 juju-e4d256-prod-github-runner-207 kernel: [21320.567254] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 11:19:06 juju-e4d256-prod-github-runner-207 kernel: [21320.568431] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 11:19:06 juju-e4d256-prod-github-runner-207 kernel: [21320.569623] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 11:19:06 juju-e4d256-prod-github-runner-207 kernel: [21320.570865] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 11:19:06 juju-e4d256-prod-github-runner-207 kernel: [21320.571971] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 11:19:06 juju-e4d256-prod-github-runner-207 kernel: [21320.573189] Call Trace: Aug 22 11:19:06 juju-e4d256-prod-github-runner-207 kernel: [21320.574104] Aug 22 11:19:06 juju-e4d256-prod-github-runner-207 kernel: [21320.575006] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:19:06 juju-e4d256-prod-github-runner-207 kernel: [21320.576040] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:19:06 juju-e4d256-prod-github-runner-207 kernel: [21320.577086] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:19:06 juju-e4d256-prod-github-runner-207 kernel: [21320.578184] ? show_regs.part.0+0x23/0x29 Aug 22 11:19:06 juju-e4d256-prod-github-runner-207 kernel: [21320.579191] ? show_regs.cold+0x8/0xd Aug 22 11:19:06 juju-e4d256-prod-github-runner-207 kernel: [21320.580173] ? watchdog_timer_fn+0x1be/0x220 Aug 22 11:19:06 juju-e4d256-prod-github-runner-207 kernel: [21320.581202] ? lockup_detector_update_enable+0x60/0x60 Aug 22 11:19:06 juju-e4d256-prod-github-runner-207 kernel: [21320.582272] ? __hrtimer_run_queues+0x107/0x230 Aug 22 11:19:06 juju-e4d256-prod-github-runner-207 kernel: [21320.583310] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 11:19:06 juju-e4d256-prod-github-runner-207 kernel: [21320.584333] ? hrtimer_interrupt+0x101/0x220 Aug 22 11:19:06 juju-e4d256-prod-github-runner-207 kernel: [21320.585470] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 11:19:06 juju-e4d256-prod-github-runner-207 kernel: [21320.586546] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 11:19:06 juju-e4d256-prod-github-runner-207 kernel: [21320.587591] Aug 22 11:19:06 juju-e4d256-prod-github-runner-207 kernel: [21320.588444] Aug 22 11:19:06 juju-e4d256-prod-github-runner-207 kernel: [21320.589297] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 11:19:06 juju-e4d256-prod-github-runner-207 kernel: [21320.590330] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:19:06 juju-e4d256-prod-github-runner-207 kernel: [21320.591371] ? _raw_spin_lock+0x22/0x30 Aug 22 11:19:06 juju-e4d256-prod-github-runner-207 kernel: [21320.592315] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:19:06 juju-e4d256-prod-github-runner-207 kernel: [21320.593341] direct_page_fault+0x206/0x310 [kvm] Aug 22 11:19:06 juju-e4d256-prod-github-runner-207 kernel: [21320.594380] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 11:19:06 juju-e4d256-prod-github-runner-207 kernel: [21320.595389] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 11:19:06 juju-e4d256-prod-github-runner-207 kernel: [21320.596389] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 11:19:06 juju-e4d256-prod-github-runner-207 kernel: [21320.597407] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 11:19:06 juju-e4d256-prod-github-runner-207 kernel: [21320.598353] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 11:19:06 juju-e4d256-prod-github-runner-207 kernel: [21320.599334] handle_exit+0x98/0x230 [kvm_amd] Aug 22 11:19:06 juju-e4d256-prod-github-runner-207 kernel: [21320.600230] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 11:19:06 juju-e4d256-prod-github-runner-207 kernel: [21320.601154] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 11:19:06 juju-e4d256-prod-github-runner-207 kernel: [21320.602088] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 11:19:06 juju-e4d256-prod-github-runner-207 kernel: [21320.602997] vcpu_run+0x62/0x2c0 [kvm] Aug 22 11:19:06 juju-e4d256-prod-github-runner-207 kernel: [21320.603806] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 11:19:06 juju-e4d256-prod-github-runner-207 kernel: [21320.604637] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 11:19:06 juju-e4d256-prod-github-runner-207 kernel: [21320.605494] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 11:19:06 juju-e4d256-prod-github-runner-207 kernel: [21320.606291] ? __seccomp_filter+0x4a/0x4a0 Aug 22 11:19:06 juju-e4d256-prod-github-runner-207 kernel: [21320.607036] ? __fget_files+0x86/0xc0 Aug 22 11:19:06 juju-e4d256-prod-github-runner-207 kernel: [21320.607737] __x64_sys_ioctl+0x95/0xd0 Aug 22 11:19:06 juju-e4d256-prod-github-runner-207 kernel: [21320.608428] do_syscall_64+0x5c/0xc0 Aug 22 11:19:06 juju-e4d256-prod-github-runner-207 kernel: [21320.609105] ? do_futex+0x162/0x1f0 Aug 22 11:19:06 juju-e4d256-prod-github-runner-207 kernel: [21320.609758] ? __x64_sys_futex+0x78/0x1e0 Aug 22 11:19:06 juju-e4d256-prod-github-runner-207 kernel: [21320.610429] ? __secure_computing+0xa9/0x120 Aug 22 11:19:06 juju-e4d256-prod-github-runner-207 kernel: [21320.611121] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 11:19:06 juju-e4d256-prod-github-runner-207 kernel: [21320.611885] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:19:06 juju-e4d256-prod-github-runner-207 kernel: [21320.612624] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:19:06 juju-e4d256-prod-github-runner-207 kernel: [21320.613344] ? do_syscall_64+0x69/0xc0 Aug 22 11:19:06 juju-e4d256-prod-github-runner-207 kernel: [21320.613994] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:19:06 juju-e4d256-prod-github-runner-207 kernel: [21320.614700] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:19:06 juju-e4d256-prod-github-runner-207 kernel: [21320.615394] ? do_syscall_64+0x69/0xc0 Aug 22 11:19:06 juju-e4d256-prod-github-runner-207 kernel: [21320.616027] ? do_syscall_64+0x69/0xc0 Aug 22 11:19:06 juju-e4d256-prod-github-runner-207 kernel: [21320.616667] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 11:19:06 juju-e4d256-prod-github-runner-207 kernel: [21320.617377] RIP: 0033:0x7faa5d0edaff Aug 22 11:19:06 juju-e4d256-prod-github-runner-207 kernel: [21320.618032] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 11:19:06 juju-e4d256-prod-github-runner-207 kernel: [21320.620042] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 11:19:06 juju-e4d256-prod-github-runner-207 kernel: [21320.620971] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 11:19:06 juju-e4d256-prod-github-runner-207 kernel: [21320.621860] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 11:19:06 juju-e4d256-prod-github-runner-207 kernel: [21320.622750] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 11:19:06 juju-e4d256-prod-github-runner-207 kernel: [21320.623633] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 11:19:06 juju-e4d256-prod-github-runner-207 kernel: [21320.624518] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 11:19:06 juju-e4d256-prod-github-runner-207 kernel: [21320.625419] Aug 22 11:19:34 juju-e4d256-prod-github-runner-207 kernel: [21348.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 19774s! [qemu-system-x86:6715] Aug 22 11:19:34 juju-e4d256-prod-github-runner-207 kernel: [21348.543848] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 11:19:34 juju-e4d256-prod-github-runner-207 kernel: [21348.544127] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 11:19:34 juju-e4d256-prod-github-runner-207 kernel: [21348.564459] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 11:19:34 juju-e4d256-prod-github-runner-207 kernel: [21348.565751] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 11:19:34 juju-e4d256-prod-github-runner-207 kernel: [21348.566982] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:19:34 juju-e4d256-prod-github-runner-207 kernel: [21348.568051] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 11:19:34 juju-e4d256-prod-github-runner-207 kernel: [21348.570638] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 11:19:34 juju-e4d256-prod-github-runner-207 kernel: [21348.571692] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 11:19:34 juju-e4d256-prod-github-runner-207 kernel: [21348.572920] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 11:19:34 juju-e4d256-prod-github-runner-207 kernel: [21348.574144] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 11:19:34 juju-e4d256-prod-github-runner-207 kernel: [21348.575305] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 11:19:34 juju-e4d256-prod-github-runner-207 kernel: [21348.576622] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 11:19:34 juju-e4d256-prod-github-runner-207 kernel: [21348.578194] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 11:19:34 juju-e4d256-prod-github-runner-207 kernel: [21348.579577] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 11:19:34 juju-e4d256-prod-github-runner-207 kernel: [21348.580718] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 11:19:34 juju-e4d256-prod-github-runner-207 kernel: [21348.581939] Call Trace: Aug 22 11:19:34 juju-e4d256-prod-github-runner-207 kernel: [21348.582874] Aug 22 11:19:34 juju-e4d256-prod-github-runner-207 kernel: [21348.583790] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:19:34 juju-e4d256-prod-github-runner-207 kernel: [21348.584885] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:19:34 juju-e4d256-prod-github-runner-207 kernel: [21348.585910] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:19:34 juju-e4d256-prod-github-runner-207 kernel: [21348.587005] ? show_regs.part.0+0x23/0x29 Aug 22 11:19:34 juju-e4d256-prod-github-runner-207 kernel: [21348.588004] ? show_regs.cold+0x8/0xd Aug 22 11:19:34 juju-e4d256-prod-github-runner-207 kernel: [21348.588998] ? watchdog_timer_fn+0x1be/0x220 Aug 22 11:19:34 juju-e4d256-prod-github-runner-207 kernel: [21348.590009] ? lockup_detector_update_enable+0x60/0x60 Aug 22 11:19:34 juju-e4d256-prod-github-runner-207 kernel: [21348.591075] ? __hrtimer_run_queues+0x107/0x230 Aug 22 11:19:34 juju-e4d256-prod-github-runner-207 kernel: [21348.592106] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 11:19:34 juju-e4d256-prod-github-runner-207 kernel: [21348.593146] ? hrtimer_interrupt+0x101/0x220 Aug 22 11:19:34 juju-e4d256-prod-github-runner-207 kernel: [21348.594191] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 11:19:34 juju-e4d256-prod-github-runner-207 kernel: [21348.595260] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 11:19:34 juju-e4d256-prod-github-runner-207 kernel: [21348.596358] Aug 22 11:19:34 juju-e4d256-prod-github-runner-207 kernel: [21348.597566] Aug 22 11:19:34 juju-e4d256-prod-github-runner-207 kernel: [21348.598711] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 11:19:34 juju-e4d256-prod-github-runner-207 kernel: [21348.600519] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:19:34 juju-e4d256-prod-github-runner-207 kernel: [21348.601979] ? _raw_spin_lock+0x22/0x30 Aug 22 11:19:34 juju-e4d256-prod-github-runner-207 kernel: [21348.603128] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:19:34 juju-e4d256-prod-github-runner-207 kernel: [21348.604209] direct_page_fault+0x206/0x310 [kvm] Aug 22 11:19:34 juju-e4d256-prod-github-runner-207 kernel: [21348.605294] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 11:19:34 juju-e4d256-prod-github-runner-207 kernel: [21348.606328] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 11:19:34 juju-e4d256-prod-github-runner-207 kernel: [21348.607356] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 11:19:34 juju-e4d256-prod-github-runner-207 kernel: [21348.608440] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 11:19:34 juju-e4d256-prod-github-runner-207 kernel: [21348.609414] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 11:19:34 juju-e4d256-prod-github-runner-207 kernel: [21348.610436] handle_exit+0x98/0x230 [kvm_amd] Aug 22 11:19:34 juju-e4d256-prod-github-runner-207 kernel: [21348.611338] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 11:19:34 juju-e4d256-prod-github-runner-207 kernel: [21348.612277] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 11:19:34 juju-e4d256-prod-github-runner-207 kernel: [21348.613214] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 11:19:34 juju-e4d256-prod-github-runner-207 kernel: [21348.614133] vcpu_run+0x62/0x2c0 [kvm] Aug 22 11:19:34 juju-e4d256-prod-github-runner-207 kernel: [21348.614958] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 11:19:34 juju-e4d256-prod-github-runner-207 kernel: [21348.615787] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 11:19:34 juju-e4d256-prod-github-runner-207 kernel: [21348.616670] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 11:19:34 juju-e4d256-prod-github-runner-207 kernel: [21348.617612] ? __seccomp_filter+0x4a/0x4a0 Aug 22 11:19:34 juju-e4d256-prod-github-runner-207 kernel: [21348.618392] ? __fget_files+0x86/0xc0 Aug 22 11:19:34 juju-e4d256-prod-github-runner-207 kernel: [21348.619118] __x64_sys_ioctl+0x95/0xd0 Aug 22 11:19:34 juju-e4d256-prod-github-runner-207 kernel: [21348.619877] do_syscall_64+0x5c/0xc0 Aug 22 11:19:34 juju-e4d256-prod-github-runner-207 kernel: [21348.620616] ? do_futex+0x162/0x1f0 Aug 22 11:19:34 juju-e4d256-prod-github-runner-207 kernel: [21348.621300] ? __x64_sys_futex+0x78/0x1e0 Aug 22 11:19:34 juju-e4d256-prod-github-runner-207 kernel: [21348.622192] ? __secure_computing+0xa9/0x120 Aug 22 11:19:34 juju-e4d256-prod-github-runner-207 kernel: [21348.622968] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 11:19:34 juju-e4d256-prod-github-runner-207 kernel: [21348.623735] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:19:34 juju-e4d256-prod-github-runner-207 kernel: [21348.624502] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:19:34 juju-e4d256-prod-github-runner-207 kernel: [21348.625233] ? do_syscall_64+0x69/0xc0 Aug 22 11:19:34 juju-e4d256-prod-github-runner-207 kernel: [21348.625902] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:19:34 juju-e4d256-prod-github-runner-207 kernel: [21348.626676] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:19:34 juju-e4d256-prod-github-runner-207 kernel: [21348.627380] ? do_syscall_64+0x69/0xc0 Aug 22 11:19:34 juju-e4d256-prod-github-runner-207 kernel: [21348.628013] ? do_syscall_64+0x69/0xc0 Aug 22 11:19:34 juju-e4d256-prod-github-runner-207 kernel: [21348.628656] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 11:19:34 juju-e4d256-prod-github-runner-207 kernel: [21348.629368] RIP: 0033:0x7faa5d0edaff Aug 22 11:19:34 juju-e4d256-prod-github-runner-207 kernel: [21348.630055] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 11:19:34 juju-e4d256-prod-github-runner-207 kernel: [21348.632084] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 11:19:34 juju-e4d256-prod-github-runner-207 kernel: [21348.633052] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 11:19:34 juju-e4d256-prod-github-runner-207 kernel: [21348.633958] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 11:19:34 juju-e4d256-prod-github-runner-207 kernel: [21348.634869] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 11:19:34 juju-e4d256-prod-github-runner-207 kernel: [21348.635774] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 11:19:34 juju-e4d256-prod-github-runner-207 kernel: [21348.636709] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 11:19:34 juju-e4d256-prod-github-runner-207 kernel: [21348.637651] Aug 22 11:20:02 juju-e4d256-prod-github-runner-207 kernel: [21376.541981] watchdog: BUG: soft lockup - CPU#1 stuck for 19800s! [qemu-system-x86:6715] Aug 22 11:20:02 juju-e4d256-prod-github-runner-207 kernel: [21376.543835] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 11:20:02 juju-e4d256-prod-github-runner-207 kernel: [21376.544150] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 11:20:02 juju-e4d256-prod-github-runner-207 kernel: [21376.556873] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 11:20:02 juju-e4d256-prod-github-runner-207 kernel: [21376.558165] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 11:20:02 juju-e4d256-prod-github-runner-207 kernel: [21376.559406] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:20:02 juju-e4d256-prod-github-runner-207 kernel: [21376.560539] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 11:20:02 juju-e4d256-prod-github-runner-207 kernel: [21376.563187] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 11:20:02 juju-e4d256-prod-github-runner-207 kernel: [21376.564257] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 11:20:02 juju-e4d256-prod-github-runner-207 kernel: [21376.565447] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 11:20:02 juju-e4d256-prod-github-runner-207 kernel: [21376.566638] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 11:20:02 juju-e4d256-prod-github-runner-207 kernel: [21376.567821] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 11:20:02 juju-e4d256-prod-github-runner-207 kernel: [21376.569022] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 11:20:02 juju-e4d256-prod-github-runner-207 kernel: [21376.570227] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 11:20:02 juju-e4d256-prod-github-runner-207 kernel: [21376.571550] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 11:20:02 juju-e4d256-prod-github-runner-207 kernel: [21376.572727] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 11:20:02 juju-e4d256-prod-github-runner-207 kernel: [21376.574147] Call Trace: Aug 22 11:20:02 juju-e4d256-prod-github-runner-207 kernel: [21376.575070] Aug 22 11:20:02 juju-e4d256-prod-github-runner-207 kernel: [21376.576008] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:20:02 juju-e4d256-prod-github-runner-207 kernel: [21376.577085] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:20:02 juju-e4d256-prod-github-runner-207 kernel: [21376.578125] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:20:02 juju-e4d256-prod-github-runner-207 kernel: [21376.579238] ? show_regs.part.0+0x23/0x29 Aug 22 11:20:02 juju-e4d256-prod-github-runner-207 kernel: [21376.580262] ? show_regs.cold+0x8/0xd Aug 22 11:20:02 juju-e4d256-prod-github-runner-207 kernel: [21376.581258] ? watchdog_timer_fn+0x1be/0x220 Aug 22 11:20:02 juju-e4d256-prod-github-runner-207 kernel: [21376.582292] ? lockup_detector_update_enable+0x60/0x60 Aug 22 11:20:02 juju-e4d256-prod-github-runner-207 kernel: [21376.583374] ? __hrtimer_run_queues+0x107/0x230 Aug 22 11:20:02 juju-e4d256-prod-github-runner-207 kernel: [21376.584437] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 11:20:02 juju-e4d256-prod-github-runner-207 kernel: [21376.585555] ? hrtimer_interrupt+0x101/0x220 Aug 22 11:20:02 juju-e4d256-prod-github-runner-207 kernel: [21376.586603] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 11:20:02 juju-e4d256-prod-github-runner-207 kernel: [21376.587758] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 11:20:02 juju-e4d256-prod-github-runner-207 kernel: [21376.588952] Aug 22 11:20:02 juju-e4d256-prod-github-runner-207 kernel: [21376.589822] Aug 22 11:20:02 juju-e4d256-prod-github-runner-207 kernel: [21376.590666] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 11:20:02 juju-e4d256-prod-github-runner-207 kernel: [21376.591778] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:20:02 juju-e4d256-prod-github-runner-207 kernel: [21376.592911] ? _raw_spin_lock+0x22/0x30 Aug 22 11:20:02 juju-e4d256-prod-github-runner-207 kernel: [21376.593882] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:20:02 juju-e4d256-prod-github-runner-207 kernel: [21376.595019] direct_page_fault+0x206/0x310 [kvm] Aug 22 11:20:02 juju-e4d256-prod-github-runner-207 kernel: [21376.596196] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 11:20:02 juju-e4d256-prod-github-runner-207 kernel: [21376.597241] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 11:20:02 juju-e4d256-prod-github-runner-207 kernel: [21376.598252] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 11:20:02 juju-e4d256-prod-github-runner-207 kernel: [21376.599299] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 11:20:02 juju-e4d256-prod-github-runner-207 kernel: [21376.600274] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 11:20:02 juju-e4d256-prod-github-runner-207 kernel: [21376.601270] handle_exit+0x98/0x230 [kvm_amd] Aug 22 11:20:02 juju-e4d256-prod-github-runner-207 kernel: [21376.602179] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 11:20:02 juju-e4d256-prod-github-runner-207 kernel: [21376.603110] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 11:20:02 juju-e4d256-prod-github-runner-207 kernel: [21376.604069] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 11:20:02 juju-e4d256-prod-github-runner-207 kernel: [21376.605039] vcpu_run+0x62/0x2c0 [kvm] Aug 22 11:20:02 juju-e4d256-prod-github-runner-207 kernel: [21376.605903] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 11:20:02 juju-e4d256-prod-github-runner-207 kernel: [21376.606726] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 11:20:02 juju-e4d256-prod-github-runner-207 kernel: [21376.607594] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 11:20:02 juju-e4d256-prod-github-runner-207 kernel: [21376.608430] ? __seccomp_filter+0x4a/0x4a0 Aug 22 11:20:02 juju-e4d256-prod-github-runner-207 kernel: [21376.609205] ? __fget_files+0x86/0xc0 Aug 22 11:20:02 juju-e4d256-prod-github-runner-207 kernel: [21376.609928] __x64_sys_ioctl+0x95/0xd0 Aug 22 11:20:02 juju-e4d256-prod-github-runner-207 kernel: [21376.610641] do_syscall_64+0x5c/0xc0 Aug 22 11:20:02 juju-e4d256-prod-github-runner-207 kernel: [21376.611508] ? do_futex+0x162/0x1f0 Aug 22 11:20:02 juju-e4d256-prod-github-runner-207 kernel: [21376.612238] ? __x64_sys_futex+0x78/0x1e0 Aug 22 11:20:02 juju-e4d256-prod-github-runner-207 kernel: [21376.612965] ? __secure_computing+0xa9/0x120 Aug 22 11:20:02 juju-e4d256-prod-github-runner-207 kernel: [21376.613699] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 11:20:02 juju-e4d256-prod-github-runner-207 kernel: [21376.614472] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:20:02 juju-e4d256-prod-github-runner-207 kernel: [21376.615212] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:20:02 juju-e4d256-prod-github-runner-207 kernel: [21376.616034] ? do_syscall_64+0x69/0xc0 Aug 22 11:20:02 juju-e4d256-prod-github-runner-207 kernel: [21376.616727] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:20:02 juju-e4d256-prod-github-runner-207 kernel: [21376.617480] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:20:02 juju-e4d256-prod-github-runner-207 kernel: [21376.618225] ? do_syscall_64+0x69/0xc0 Aug 22 11:20:02 juju-e4d256-prod-github-runner-207 kernel: [21376.618861] ? do_syscall_64+0x69/0xc0 Aug 22 11:20:02 juju-e4d256-prod-github-runner-207 kernel: [21376.619523] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 11:20:02 juju-e4d256-prod-github-runner-207 kernel: [21376.620296] RIP: 0033:0x7faa5d0edaff Aug 22 11:20:02 juju-e4d256-prod-github-runner-207 kernel: [21376.620972] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 11:20:02 juju-e4d256-prod-github-runner-207 kernel: [21376.623025] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 11:20:02 juju-e4d256-prod-github-runner-207 kernel: [21376.623992] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 11:20:02 juju-e4d256-prod-github-runner-207 kernel: [21376.624910] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 11:20:02 juju-e4d256-prod-github-runner-207 kernel: [21376.626019] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 11:20:02 juju-e4d256-prod-github-runner-207 kernel: [21376.626929] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 11:20:02 juju-e4d256-prod-github-runner-207 kernel: [21376.627903] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 11:20:02 juju-e4d256-prod-github-runner-207 kernel: [21376.628823] Aug 22 11:20:30 juju-e4d256-prod-github-runner-207 kernel: [21404.541976] watchdog: BUG: soft lockup - CPU#1 stuck for 19826s! [qemu-system-x86:6715] Aug 22 11:20:30 juju-e4d256-prod-github-runner-207 kernel: [21404.543888] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 11:20:30 juju-e4d256-prod-github-runner-207 kernel: [21404.544174] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 11:20:30 juju-e4d256-prod-github-runner-207 kernel: [21404.556435] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 11:20:30 juju-e4d256-prod-github-runner-207 kernel: [21404.557695] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 11:20:30 juju-e4d256-prod-github-runner-207 kernel: [21404.558910] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:20:30 juju-e4d256-prod-github-runner-207 kernel: [21404.559986] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 11:20:30 juju-e4d256-prod-github-runner-207 kernel: [21404.562532] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 11:20:30 juju-e4d256-prod-github-runner-207 kernel: [21404.563589] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 11:20:30 juju-e4d256-prod-github-runner-207 kernel: [21404.564753] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 11:20:30 juju-e4d256-prod-github-runner-207 kernel: [21404.565912] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 11:20:30 juju-e4d256-prod-github-runner-207 kernel: [21404.567080] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 11:20:30 juju-e4d256-prod-github-runner-207 kernel: [21404.568255] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 11:20:30 juju-e4d256-prod-github-runner-207 kernel: [21404.569422] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 11:20:30 juju-e4d256-prod-github-runner-207 kernel: [21404.570655] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 11:20:30 juju-e4d256-prod-github-runner-207 kernel: [21404.571764] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 11:20:30 juju-e4d256-prod-github-runner-207 kernel: [21404.572958] Call Trace: Aug 22 11:20:30 juju-e4d256-prod-github-runner-207 kernel: [21404.573868] Aug 22 11:20:30 juju-e4d256-prod-github-runner-207 kernel: [21404.574767] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:20:30 juju-e4d256-prod-github-runner-207 kernel: [21404.575803] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:20:30 juju-e4d256-prod-github-runner-207 kernel: [21404.576822] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:20:30 juju-e4d256-prod-github-runner-207 kernel: [21404.577930] ? show_regs.part.0+0x23/0x29 Aug 22 11:20:30 juju-e4d256-prod-github-runner-207 kernel: [21404.578931] ? show_regs.cold+0x8/0xd Aug 22 11:20:30 juju-e4d256-prod-github-runner-207 kernel: [21404.579917] ? watchdog_timer_fn+0x1be/0x220 Aug 22 11:20:30 juju-e4d256-prod-github-runner-207 kernel: [21404.581071] ? lockup_detector_update_enable+0x60/0x60 Aug 22 11:20:30 juju-e4d256-prod-github-runner-207 kernel: [21404.582232] ? __hrtimer_run_queues+0x107/0x230 Aug 22 11:20:30 juju-e4d256-prod-github-runner-207 kernel: [21404.583255] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 11:20:30 juju-e4d256-prod-github-runner-207 kernel: [21404.584286] ? hrtimer_interrupt+0x101/0x220 Aug 22 11:20:30 juju-e4d256-prod-github-runner-207 kernel: [21404.585300] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 11:20:30 juju-e4d256-prod-github-runner-207 kernel: [21404.586376] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 11:20:30 juju-e4d256-prod-github-runner-207 kernel: [21404.587426] Aug 22 11:20:30 juju-e4d256-prod-github-runner-207 kernel: [21404.588292] Aug 22 11:20:30 juju-e4d256-prod-github-runner-207 kernel: [21404.589132] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 11:20:30 juju-e4d256-prod-github-runner-207 kernel: [21404.590163] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:20:30 juju-e4d256-prod-github-runner-207 kernel: [21404.591202] ? _raw_spin_lock+0x22/0x30 Aug 22 11:20:30 juju-e4d256-prod-github-runner-207 kernel: [21404.592169] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:20:30 juju-e4d256-prod-github-runner-207 kernel: [21404.593184] direct_page_fault+0x206/0x310 [kvm] Aug 22 11:20:30 juju-e4d256-prod-github-runner-207 kernel: [21404.594211] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 11:20:30 juju-e4d256-prod-github-runner-207 kernel: [21404.595218] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 11:20:30 juju-e4d256-prod-github-runner-207 kernel: [21404.596221] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 11:20:30 juju-e4d256-prod-github-runner-207 kernel: [21404.597230] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 11:20:30 juju-e4d256-prod-github-runner-207 kernel: [21404.598172] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 11:20:30 juju-e4d256-prod-github-runner-207 kernel: [21404.599150] handle_exit+0x98/0x230 [kvm_amd] Aug 22 11:20:30 juju-e4d256-prod-github-runner-207 kernel: [21404.600060] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 11:20:30 juju-e4d256-prod-github-runner-207 kernel: [21404.600973] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 11:20:30 juju-e4d256-prod-github-runner-207 kernel: [21404.601894] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 11:20:30 juju-e4d256-prod-github-runner-207 kernel: [21404.602795] vcpu_run+0x62/0x2c0 [kvm] Aug 22 11:20:30 juju-e4d256-prod-github-runner-207 kernel: [21404.603631] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 11:20:30 juju-e4d256-prod-github-runner-207 kernel: [21404.604458] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 11:20:30 juju-e4d256-prod-github-runner-207 kernel: [21404.605310] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 11:20:30 juju-e4d256-prod-github-runner-207 kernel: [21404.606110] ? __seccomp_filter+0x4a/0x4a0 Aug 22 11:20:30 juju-e4d256-prod-github-runner-207 kernel: [21404.606850] ? __fget_files+0x86/0xc0 Aug 22 11:20:30 juju-e4d256-prod-github-runner-207 kernel: [21404.607573] __x64_sys_ioctl+0x95/0xd0 Aug 22 11:20:30 juju-e4d256-prod-github-runner-207 kernel: [21404.608263] do_syscall_64+0x5c/0xc0 Aug 22 11:20:30 juju-e4d256-prod-github-runner-207 kernel: [21404.608923] ? do_futex+0x162/0x1f0 Aug 22 11:20:30 juju-e4d256-prod-github-runner-207 kernel: [21404.609573] ? __x64_sys_futex+0x78/0x1e0 Aug 22 11:20:30 juju-e4d256-prod-github-runner-207 kernel: [21404.610242] ? __secure_computing+0xa9/0x120 Aug 22 11:20:30 juju-e4d256-prod-github-runner-207 kernel: [21404.610929] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 11:20:30 juju-e4d256-prod-github-runner-207 kernel: [21404.611696] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:20:30 juju-e4d256-prod-github-runner-207 kernel: [21404.612424] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:20:30 juju-e4d256-prod-github-runner-207 kernel: [21404.613138] ? do_syscall_64+0x69/0xc0 Aug 22 11:20:30 juju-e4d256-prod-github-runner-207 kernel: [21404.613779] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:20:30 juju-e4d256-prod-github-runner-207 kernel: [21404.614477] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:20:30 juju-e4d256-prod-github-runner-207 kernel: [21404.615169] ? do_syscall_64+0x69/0xc0 Aug 22 11:20:30 juju-e4d256-prod-github-runner-207 kernel: [21404.615809] ? do_syscall_64+0x69/0xc0 Aug 22 11:20:30 juju-e4d256-prod-github-runner-207 kernel: [21404.616428] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 11:20:30 juju-e4d256-prod-github-runner-207 kernel: [21404.617130] RIP: 0033:0x7faa5d0edaff Aug 22 11:20:30 juju-e4d256-prod-github-runner-207 kernel: [21404.617773] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 11:20:30 juju-e4d256-prod-github-runner-207 kernel: [21404.619779] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 11:20:30 juju-e4d256-prod-github-runner-207 kernel: [21404.620684] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 11:20:30 juju-e4d256-prod-github-runner-207 kernel: [21404.621576] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 11:20:30 juju-e4d256-prod-github-runner-207 kernel: [21404.622467] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 11:20:30 juju-e4d256-prod-github-runner-207 kernel: [21404.623356] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 11:20:30 juju-e4d256-prod-github-runner-207 kernel: [21404.624282] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 11:20:30 juju-e4d256-prod-github-runner-207 kernel: [21404.625172] Aug 22 11:20:44 juju-e4d256-prod-github-runner-207 kernel: [21418.616711] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 11:20:44 juju-e4d256-prod-github-runner-207 kernel: [21418.618404] rcu: 1-....: (5308706 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=2570204 Aug 22 11:20:44 juju-e4d256-prod-github-runner-207 kernel: [21418.619577] (t=5325354 jiffies g=23269 q=27106) Aug 22 11:20:44 juju-e4d256-prod-github-runner-207 kernel: [21418.620366] NMI backtrace for cpu 1 Aug 22 11:20:44 juju-e4d256-prod-github-runner-207 kernel: [21418.621080] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 11:20:44 juju-e4d256-prod-github-runner-207 kernel: [21418.622205] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 11:20:44 juju-e4d256-prod-github-runner-207 kernel: [21418.623291] Call Trace: Aug 22 11:20:44 juju-e4d256-prod-github-runner-207 kernel: [21418.623984] Aug 22 11:20:44 juju-e4d256-prod-github-runner-207 kernel: [21418.624707] show_stack+0x52/0x5c Aug 22 11:20:44 juju-e4d256-prod-github-runner-207 kernel: [21418.625513] dump_stack_lvl+0x4a/0x63 Aug 22 11:20:44 juju-e4d256-prod-github-runner-207 kernel: [21418.626271] dump_stack+0x10/0x16 Aug 22 11:20:44 juju-e4d256-prod-github-runner-207 kernel: [21418.627002] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 11:20:44 juju-e4d256-prod-github-runner-207 kernel: [21418.627806] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 11:20:44 juju-e4d256-prod-github-runner-207 kernel: [21418.628591] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 11:20:44 juju-e4d256-prod-github-runner-207 kernel: [21418.629420] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 11:20:44 juju-e4d256-prod-github-runner-207 kernel: [21418.630261] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 11:20:44 juju-e4d256-prod-github-runner-207 kernel: [21418.631073] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 11:20:44 juju-e4d256-prod-github-runner-207 kernel: [21418.631862] print_cpu_stall.cold+0x2f/0xe2 Aug 22 11:20:44 juju-e4d256-prod-github-runner-207 kernel: [21418.632662] ? timekeeping_update+0xf7/0x150 Aug 22 11:20:44 juju-e4d256-prod-github-runner-207 kernel: [21418.633440] check_cpu_stall+0x109/0x270 Aug 22 11:20:44 juju-e4d256-prod-github-runner-207 kernel: [21418.634186] rcu_sched_clock_irq+0x9a/0x250 Aug 22 11:20:44 juju-e4d256-prod-github-runner-207 kernel: [21418.634980] update_process_times+0x94/0xd0 Aug 22 11:20:44 juju-e4d256-prod-github-runner-207 kernel: [21418.635755] tick_sched_handle+0x29/0x70 Aug 22 11:20:44 juju-e4d256-prod-github-runner-207 kernel: [21418.636499] tick_sched_timer+0x8c/0xc0 Aug 22 11:20:44 juju-e4d256-prod-github-runner-207 kernel: [21418.637235] ? tick_nohz_handler+0xb0/0xb0 Aug 22 11:20:44 juju-e4d256-prod-github-runner-207 kernel: [21418.638008] __hrtimer_run_queues+0x107/0x230 Aug 22 11:20:44 juju-e4d256-prod-github-runner-207 kernel: [21418.638786] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 11:20:44 juju-e4d256-prod-github-runner-207 kernel: [21418.639576] hrtimer_interrupt+0x101/0x220 Aug 22 11:20:44 juju-e4d256-prod-github-runner-207 kernel: [21418.640359] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 11:20:44 juju-e4d256-prod-github-runner-207 kernel: [21418.641205] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 11:20:44 juju-e4d256-prod-github-runner-207 kernel: [21418.642010] Aug 22 11:20:44 juju-e4d256-prod-github-runner-207 kernel: [21418.642716] Aug 22 11:20:44 juju-e4d256-prod-github-runner-207 kernel: [21418.643379] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 11:20:44 juju-e4d256-prod-github-runner-207 kernel: [21418.644209] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:20:44 juju-e4d256-prod-github-runner-207 kernel: [21418.645084] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 11:20:44 juju-e4d256-prod-github-runner-207 kernel: [21418.647281] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 11:20:44 juju-e4d256-prod-github-runner-207 kernel: [21418.648175] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 11:20:44 juju-e4d256-prod-github-runner-207 kernel: [21418.649213] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 11:20:44 juju-e4d256-prod-github-runner-207 kernel: [21418.650203] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 11:20:44 juju-e4d256-prod-github-runner-207 kernel: [21418.651189] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 11:20:44 juju-e4d256-prod-github-runner-207 kernel: [21418.652182] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 11:20:44 juju-e4d256-prod-github-runner-207 kernel: [21418.653139] ? _raw_spin_lock+0x22/0x30 Aug 22 11:20:44 juju-e4d256-prod-github-runner-207 kernel: [21418.653912] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:20:44 juju-e4d256-prod-github-runner-207 kernel: [21418.654785] direct_page_fault+0x206/0x310 [kvm] Aug 22 11:20:44 juju-e4d256-prod-github-runner-207 kernel: [21418.655730] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 11:20:44 juju-e4d256-prod-github-runner-207 kernel: [21418.656577] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 11:20:44 juju-e4d256-prod-github-runner-207 kernel: [21418.657420] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 11:20:44 juju-e4d256-prod-github-runner-207 kernel: [21418.658259] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 11:20:44 juju-e4d256-prod-github-runner-207 kernel: [21418.659047] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 11:20:44 juju-e4d256-prod-github-runner-207 kernel: [21418.659907] handle_exit+0x98/0x230 [kvm_amd] Aug 22 11:20:44 juju-e4d256-prod-github-runner-207 kernel: [21418.660672] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 11:20:44 juju-e4d256-prod-github-runner-207 kernel: [21418.661454] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 11:20:44 juju-e4d256-prod-github-runner-207 kernel: [21418.662249] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 11:20:44 juju-e4d256-prod-github-runner-207 kernel: [21418.663075] vcpu_run+0x62/0x2c0 [kvm] Aug 22 11:20:44 juju-e4d256-prod-github-runner-207 kernel: [21418.663806] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 11:20:44 juju-e4d256-prod-github-runner-207 kernel: [21418.664538] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 11:20:44 juju-e4d256-prod-github-runner-207 kernel: [21418.665452] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 11:20:44 juju-e4d256-prod-github-runner-207 kernel: [21418.666232] ? __seccomp_filter+0x4a/0x4a0 Aug 22 11:20:44 juju-e4d256-prod-github-runner-207 kernel: [21418.666972] ? __fget_files+0x86/0xc0 Aug 22 11:20:44 juju-e4d256-prod-github-runner-207 kernel: [21418.667704] __x64_sys_ioctl+0x95/0xd0 Aug 22 11:20:44 juju-e4d256-prod-github-runner-207 kernel: [21418.668430] do_syscall_64+0x5c/0xc0 Aug 22 11:20:44 juju-e4d256-prod-github-runner-207 kernel: [21418.669121] ? do_futex+0x162/0x1f0 Aug 22 11:20:44 juju-e4d256-prod-github-runner-207 kernel: [21418.669794] ? __x64_sys_futex+0x78/0x1e0 Aug 22 11:20:44 juju-e4d256-prod-github-runner-207 kernel: [21418.670505] ? __secure_computing+0xa9/0x120 Aug 22 11:20:44 juju-e4d256-prod-github-runner-207 kernel: [21418.671234] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 11:20:44 juju-e4d256-prod-github-runner-207 kernel: [21418.672051] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:20:44 juju-e4d256-prod-github-runner-207 kernel: [21418.672808] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:20:44 juju-e4d256-prod-github-runner-207 kernel: [21418.673653] ? do_syscall_64+0x69/0xc0 Aug 22 11:20:44 juju-e4d256-prod-github-runner-207 kernel: [21418.674348] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:20:44 juju-e4d256-prod-github-runner-207 kernel: [21418.675119] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:20:44 juju-e4d256-prod-github-runner-207 kernel: [21418.675930] ? do_syscall_64+0x69/0xc0 Aug 22 11:20:44 juju-e4d256-prod-github-runner-207 kernel: [21418.676667] ? do_syscall_64+0x69/0xc0 Aug 22 11:20:44 juju-e4d256-prod-github-runner-207 kernel: [21418.677358] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 11:20:44 juju-e4d256-prod-github-runner-207 kernel: [21418.678130] RIP: 0033:0x7faa5d0edaff Aug 22 11:20:44 juju-e4d256-prod-github-runner-207 kernel: [21418.678854] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 11:20:44 juju-e4d256-prod-github-runner-207 kernel: [21418.680978] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 11:20:44 juju-e4d256-prod-github-runner-207 kernel: [21418.681957] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 11:20:44 juju-e4d256-prod-github-runner-207 kernel: [21418.683195] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 11:20:44 juju-e4d256-prod-github-runner-207 kernel: [21418.684342] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 11:20:44 juju-e4d256-prod-github-runner-207 kernel: [21418.685330] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 11:20:44 juju-e4d256-prod-github-runner-207 kernel: [21418.686281] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 11:20:44 juju-e4d256-prod-github-runner-207 kernel: [21418.687198] Aug 22 11:21:10 juju-e4d256-prod-github-runner-207 kernel: [21444.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 19863s! [qemu-system-x86:6715] Aug 22 11:21:10 juju-e4d256-prod-github-runner-207 kernel: [21444.543137] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 11:21:10 juju-e4d256-prod-github-runner-207 kernel: [21444.543500] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 11:21:10 juju-e4d256-prod-github-runner-207 kernel: [21444.555702] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 11:21:10 juju-e4d256-prod-github-runner-207 kernel: [21444.556980] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 11:21:10 juju-e4d256-prod-github-runner-207 kernel: [21444.558206] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:21:10 juju-e4d256-prod-github-runner-207 kernel: [21444.559286] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 11:21:10 juju-e4d256-prod-github-runner-207 kernel: [21444.561870] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 11:21:10 juju-e4d256-prod-github-runner-207 kernel: [21444.562914] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 11:21:10 juju-e4d256-prod-github-runner-207 kernel: [21444.564122] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 11:21:10 juju-e4d256-prod-github-runner-207 kernel: [21444.565295] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 11:21:10 juju-e4d256-prod-github-runner-207 kernel: [21444.566473] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 11:21:10 juju-e4d256-prod-github-runner-207 kernel: [21444.567671] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 11:21:10 juju-e4d256-prod-github-runner-207 kernel: [21444.568848] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 11:21:10 juju-e4d256-prod-github-runner-207 kernel: [21444.570083] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 11:21:10 juju-e4d256-prod-github-runner-207 kernel: [21444.571215] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 11:21:10 juju-e4d256-prod-github-runner-207 kernel: [21444.572423] Call Trace: Aug 22 11:21:10 juju-e4d256-prod-github-runner-207 kernel: [21444.573346] Aug 22 11:21:10 juju-e4d256-prod-github-runner-207 kernel: [21444.574233] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:21:10 juju-e4d256-prod-github-runner-207 kernel: [21444.575317] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:21:10 juju-e4d256-prod-github-runner-207 kernel: [21444.576343] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:21:10 juju-e4d256-prod-github-runner-207 kernel: [21444.577447] ? show_regs.part.0+0x23/0x29 Aug 22 11:21:10 juju-e4d256-prod-github-runner-207 kernel: [21444.578451] ? show_regs.cold+0x8/0xd Aug 22 11:21:10 juju-e4d256-prod-github-runner-207 kernel: [21444.579444] ? watchdog_timer_fn+0x1be/0x220 Aug 22 11:21:10 juju-e4d256-prod-github-runner-207 kernel: [21444.580466] ? lockup_detector_update_enable+0x60/0x60 Aug 22 11:21:10 juju-e4d256-prod-github-runner-207 kernel: [21444.581549] ? __hrtimer_run_queues+0x107/0x230 Aug 22 11:21:10 juju-e4d256-prod-github-runner-207 kernel: [21444.582652] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 11:21:10 juju-e4d256-prod-github-runner-207 kernel: [21444.583717] ? hrtimer_interrupt+0x101/0x220 Aug 22 11:21:10 juju-e4d256-prod-github-runner-207 kernel: [21444.584752] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 11:21:10 juju-e4d256-prod-github-runner-207 kernel: [21444.585836] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 11:21:10 juju-e4d256-prod-github-runner-207 kernel: [21444.586899] Aug 22 11:21:10 juju-e4d256-prod-github-runner-207 kernel: [21444.587774] Aug 22 11:21:10 juju-e4d256-prod-github-runner-207 kernel: [21444.588631] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 11:21:10 juju-e4d256-prod-github-runner-207 kernel: [21444.589686] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:21:10 juju-e4d256-prod-github-runner-207 kernel: [21444.590765] ? _raw_spin_lock+0x22/0x30 Aug 22 11:21:10 juju-e4d256-prod-github-runner-207 kernel: [21444.591732] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:21:10 juju-e4d256-prod-github-runner-207 kernel: [21444.592757] direct_page_fault+0x206/0x310 [kvm] Aug 22 11:21:10 juju-e4d256-prod-github-runner-207 kernel: [21444.593790] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 11:21:10 juju-e4d256-prod-github-runner-207 kernel: [21444.594827] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 11:21:10 juju-e4d256-prod-github-runner-207 kernel: [21444.595860] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 11:21:10 juju-e4d256-prod-github-runner-207 kernel: [21444.596834] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 11:21:10 juju-e4d256-prod-github-runner-207 kernel: [21444.597798] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 11:21:10 juju-e4d256-prod-github-runner-207 kernel: [21444.598815] handle_exit+0x98/0x230 [kvm_amd] Aug 22 11:21:10 juju-e4d256-prod-github-runner-207 kernel: [21444.599737] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 11:21:10 juju-e4d256-prod-github-runner-207 kernel: [21444.600652] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 11:21:10 juju-e4d256-prod-github-runner-207 kernel: [21444.601579] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 11:21:10 juju-e4d256-prod-github-runner-207 kernel: [21444.602502] vcpu_run+0x62/0x2c0 [kvm] Aug 22 11:21:10 juju-e4d256-prod-github-runner-207 kernel: [21444.603357] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 11:21:10 juju-e4d256-prod-github-runner-207 kernel: [21444.604168] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 11:21:10 juju-e4d256-prod-github-runner-207 kernel: [21444.605047] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 11:21:10 juju-e4d256-prod-github-runner-207 kernel: [21444.605866] ? __seccomp_filter+0x4a/0x4a0 Aug 22 11:21:10 juju-e4d256-prod-github-runner-207 kernel: [21444.606623] ? __fget_files+0x86/0xc0 Aug 22 11:21:10 juju-e4d256-prod-github-runner-207 kernel: [21444.607396] __x64_sys_ioctl+0x95/0xd0 Aug 22 11:21:10 juju-e4d256-prod-github-runner-207 kernel: [21444.608094] do_syscall_64+0x5c/0xc0 Aug 22 11:21:10 juju-e4d256-prod-github-runner-207 kernel: [21444.608765] ? do_futex+0x162/0x1f0 Aug 22 11:21:10 juju-e4d256-prod-github-runner-207 kernel: [21444.609415] ? __x64_sys_futex+0x78/0x1e0 Aug 22 11:21:10 juju-e4d256-prod-github-runner-207 kernel: [21444.610092] ? __secure_computing+0xa9/0x120 Aug 22 11:21:10 juju-e4d256-prod-github-runner-207 kernel: [21444.610832] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 11:21:10 juju-e4d256-prod-github-runner-207 kernel: [21444.611642] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:21:10 juju-e4d256-prod-github-runner-207 kernel: [21444.612373] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:21:10 juju-e4d256-prod-github-runner-207 kernel: [21444.613098] ? do_syscall_64+0x69/0xc0 Aug 22 11:21:10 juju-e4d256-prod-github-runner-207 kernel: [21444.613747] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:21:10 juju-e4d256-prod-github-runner-207 kernel: [21444.614452] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:21:10 juju-e4d256-prod-github-runner-207 kernel: [21444.615168] ? do_syscall_64+0x69/0xc0 Aug 22 11:21:10 juju-e4d256-prod-github-runner-207 kernel: [21444.615800] ? do_syscall_64+0x69/0xc0 Aug 22 11:21:10 juju-e4d256-prod-github-runner-207 kernel: [21444.616422] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 11:21:10 juju-e4d256-prod-github-runner-207 kernel: [21444.617128] RIP: 0033:0x7faa5d0edaff Aug 22 11:21:10 juju-e4d256-prod-github-runner-207 kernel: [21444.617752] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 11:21:10 juju-e4d256-prod-github-runner-207 kernel: [21444.619767] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 11:21:10 juju-e4d256-prod-github-runner-207 kernel: [21444.620687] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 11:21:10 juju-e4d256-prod-github-runner-207 kernel: [21444.621595] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 11:21:10 juju-e4d256-prod-github-runner-207 kernel: [21444.622728] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 11:21:10 juju-e4d256-prod-github-runner-207 kernel: [21444.623643] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 11:21:10 juju-e4d256-prod-github-runner-207 kernel: [21444.624534] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 11:21:10 juju-e4d256-prod-github-runner-207 kernel: [21444.625440] Aug 22 11:21:38 juju-e4d256-prod-github-runner-207 kernel: [21472.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 19889s! [qemu-system-x86:6715] Aug 22 11:21:38 juju-e4d256-prod-github-runner-207 kernel: [21472.543921] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 11:21:38 juju-e4d256-prod-github-runner-207 kernel: [21472.544228] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 11:21:38 juju-e4d256-prod-github-runner-207 kernel: [21472.556730] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 11:21:38 juju-e4d256-prod-github-runner-207 kernel: [21472.558132] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 11:21:38 juju-e4d256-prod-github-runner-207 kernel: [21472.559387] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:21:38 juju-e4d256-prod-github-runner-207 kernel: [21472.560458] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 11:21:38 juju-e4d256-prod-github-runner-207 kernel: [21472.563062] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 11:21:38 juju-e4d256-prod-github-runner-207 kernel: [21472.564114] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 11:21:38 juju-e4d256-prod-github-runner-207 kernel: [21472.565294] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 11:21:38 juju-e4d256-prod-github-runner-207 kernel: [21472.566468] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 11:21:38 juju-e4d256-prod-github-runner-207 kernel: [21472.567658] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 11:21:38 juju-e4d256-prod-github-runner-207 kernel: [21472.568834] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 11:21:38 juju-e4d256-prod-github-runner-207 kernel: [21472.570014] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 11:21:38 juju-e4d256-prod-github-runner-207 kernel: [21472.571270] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 11:21:38 juju-e4d256-prod-github-runner-207 kernel: [21472.572379] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 11:21:38 juju-e4d256-prod-github-runner-207 kernel: [21472.573587] Call Trace: Aug 22 11:21:38 juju-e4d256-prod-github-runner-207 kernel: [21472.574645] Aug 22 11:21:38 juju-e4d256-prod-github-runner-207 kernel: [21472.575578] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:21:38 juju-e4d256-prod-github-runner-207 kernel: [21472.576617] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:21:38 juju-e4d256-prod-github-runner-207 kernel: [21472.577648] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:21:38 juju-e4d256-prod-github-runner-207 kernel: [21472.578766] ? show_regs.part.0+0x23/0x29 Aug 22 11:21:38 juju-e4d256-prod-github-runner-207 kernel: [21472.579772] ? show_regs.cold+0x8/0xd Aug 22 11:21:38 juju-e4d256-prod-github-runner-207 kernel: [21472.580751] ? watchdog_timer_fn+0x1be/0x220 Aug 22 11:21:38 juju-e4d256-prod-github-runner-207 kernel: [21472.581785] ? lockup_detector_update_enable+0x60/0x60 Aug 22 11:21:38 juju-e4d256-prod-github-runner-207 kernel: [21472.583022] ? __hrtimer_run_queues+0x107/0x230 Aug 22 11:21:38 juju-e4d256-prod-github-runner-207 kernel: [21472.584061] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 11:21:38 juju-e4d256-prod-github-runner-207 kernel: [21472.585090] ? hrtimer_interrupt+0x101/0x220 Aug 22 11:21:38 juju-e4d256-prod-github-runner-207 kernel: [21472.586113] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 11:21:38 juju-e4d256-prod-github-runner-207 kernel: [21472.587197] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 11:21:38 juju-e4d256-prod-github-runner-207 kernel: [21472.588252] Aug 22 11:21:38 juju-e4d256-prod-github-runner-207 kernel: [21472.589106] Aug 22 11:21:38 juju-e4d256-prod-github-runner-207 kernel: [21472.589945] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 11:21:38 juju-e4d256-prod-github-runner-207 kernel: [21472.591005] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:21:38 juju-e4d256-prod-github-runner-207 kernel: [21472.592053] ? _raw_spin_lock+0x22/0x30 Aug 22 11:21:38 juju-e4d256-prod-github-runner-207 kernel: [21472.593005] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:21:38 juju-e4d256-prod-github-runner-207 kernel: [21472.594031] direct_page_fault+0x206/0x310 [kvm] Aug 22 11:21:38 juju-e4d256-prod-github-runner-207 kernel: [21472.595071] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 11:21:38 juju-e4d256-prod-github-runner-207 kernel: [21472.596088] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 11:21:38 juju-e4d256-prod-github-runner-207 kernel: [21472.597237] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 11:21:38 juju-e4d256-prod-github-runner-207 kernel: [21472.598274] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 11:21:38 juju-e4d256-prod-github-runner-207 kernel: [21472.599241] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 11:21:38 juju-e4d256-prod-github-runner-207 kernel: [21472.600228] handle_exit+0x98/0x230 [kvm_amd] Aug 22 11:21:38 juju-e4d256-prod-github-runner-207 kernel: [21472.601128] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 11:21:38 juju-e4d256-prod-github-runner-207 kernel: [21472.602079] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 11:21:38 juju-e4d256-prod-github-runner-207 kernel: [21472.603047] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 11:21:38 juju-e4d256-prod-github-runner-207 kernel: [21472.603962] vcpu_run+0x62/0x2c0 [kvm] Aug 22 11:21:38 juju-e4d256-prod-github-runner-207 kernel: [21472.604783] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 11:21:38 juju-e4d256-prod-github-runner-207 kernel: [21472.605597] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 11:21:38 juju-e4d256-prod-github-runner-207 kernel: [21472.606461] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 11:21:38 juju-e4d256-prod-github-runner-207 kernel: [21472.607271] ? __seccomp_filter+0x4a/0x4a0 Aug 22 11:21:38 juju-e4d256-prod-github-runner-207 kernel: [21472.608020] ? __fget_files+0x86/0xc0 Aug 22 11:21:38 juju-e4d256-prod-github-runner-207 kernel: [21472.608730] __x64_sys_ioctl+0x95/0xd0 Aug 22 11:21:38 juju-e4d256-prod-github-runner-207 kernel: [21472.609435] do_syscall_64+0x5c/0xc0 Aug 22 11:21:38 juju-e4d256-prod-github-runner-207 kernel: [21472.610120] ? do_futex+0x162/0x1f0 Aug 22 11:21:38 juju-e4d256-prod-github-runner-207 kernel: [21472.610803] ? __x64_sys_futex+0x78/0x1e0 Aug 22 11:21:38 juju-e4d256-prod-github-runner-207 kernel: [21472.611508] ? __secure_computing+0xa9/0x120 Aug 22 11:21:38 juju-e4d256-prod-github-runner-207 kernel: [21472.612220] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 11:21:38 juju-e4d256-prod-github-runner-207 kernel: [21472.612993] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:21:38 juju-e4d256-prod-github-runner-207 kernel: [21472.613725] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:21:38 juju-e4d256-prod-github-runner-207 kernel: [21472.614453] ? do_syscall_64+0x69/0xc0 Aug 22 11:21:38 juju-e4d256-prod-github-runner-207 kernel: [21472.615145] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:21:38 juju-e4d256-prod-github-runner-207 kernel: [21472.615860] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:21:38 juju-e4d256-prod-github-runner-207 kernel: [21472.616565] ? do_syscall_64+0x69/0xc0 Aug 22 11:21:38 juju-e4d256-prod-github-runner-207 kernel: [21472.617203] ? do_syscall_64+0x69/0xc0 Aug 22 11:21:38 juju-e4d256-prod-github-runner-207 kernel: [21472.617836] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 11:21:38 juju-e4d256-prod-github-runner-207 kernel: [21472.618552] RIP: 0033:0x7faa5d0edaff Aug 22 11:21:38 juju-e4d256-prod-github-runner-207 kernel: [21472.619229] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 11:21:38 juju-e4d256-prod-github-runner-207 kernel: [21472.621261] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 11:21:38 juju-e4d256-prod-github-runner-207 kernel: [21472.622193] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 11:21:38 juju-e4d256-prod-github-runner-207 kernel: [21472.623113] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 11:21:38 juju-e4d256-prod-github-runner-207 kernel: [21472.624017] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 11:21:38 juju-e4d256-prod-github-runner-207 kernel: [21472.624927] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 11:21:38 juju-e4d256-prod-github-runner-207 kernel: [21472.625841] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 11:21:38 juju-e4d256-prod-github-runner-207 kernel: [21472.626752] Aug 22 11:22:06 juju-e4d256-prod-github-runner-207 kernel: [21500.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 19915s! [qemu-system-x86:6715] Aug 22 11:22:06 juju-e4d256-prod-github-runner-207 kernel: [21500.543443] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 11:22:06 juju-e4d256-prod-github-runner-207 kernel: [21500.543733] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 11:22:06 juju-e4d256-prod-github-runner-207 kernel: [21500.556289] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 11:22:06 juju-e4d256-prod-github-runner-207 kernel: [21500.557584] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 11:22:06 juju-e4d256-prod-github-runner-207 kernel: [21500.558831] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:22:06 juju-e4d256-prod-github-runner-207 kernel: [21500.559925] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 11:22:06 juju-e4d256-prod-github-runner-207 kernel: [21500.562610] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 11:22:06 juju-e4d256-prod-github-runner-207 kernel: [21500.563728] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 11:22:06 juju-e4d256-prod-github-runner-207 kernel: [21500.564902] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 11:22:06 juju-e4d256-prod-github-runner-207 kernel: [21500.566074] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 11:22:06 juju-e4d256-prod-github-runner-207 kernel: [21500.567265] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 11:22:06 juju-e4d256-prod-github-runner-207 kernel: [21500.568439] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 11:22:06 juju-e4d256-prod-github-runner-207 kernel: [21500.569617] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 11:22:06 juju-e4d256-prod-github-runner-207 kernel: [21500.571027] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 11:22:06 juju-e4d256-prod-github-runner-207 kernel: [21500.572252] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 11:22:06 juju-e4d256-prod-github-runner-207 kernel: [21500.573459] Call Trace: Aug 22 11:22:06 juju-e4d256-prod-github-runner-207 kernel: [21500.574388] Aug 22 11:22:06 juju-e4d256-prod-github-runner-207 kernel: [21500.575277] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:22:06 juju-e4d256-prod-github-runner-207 kernel: [21500.576319] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:22:06 juju-e4d256-prod-github-runner-207 kernel: [21500.577350] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:22:06 juju-e4d256-prod-github-runner-207 kernel: [21500.578487] ? show_regs.part.0+0x23/0x29 Aug 22 11:22:06 juju-e4d256-prod-github-runner-207 kernel: [21500.579500] ? show_regs.cold+0x8/0xd Aug 22 11:22:06 juju-e4d256-prod-github-runner-207 kernel: [21500.580479] ? watchdog_timer_fn+0x1be/0x220 Aug 22 11:22:06 juju-e4d256-prod-github-runner-207 kernel: [21500.581497] ? lockup_detector_update_enable+0x60/0x60 Aug 22 11:22:06 juju-e4d256-prod-github-runner-207 kernel: [21500.582581] ? __hrtimer_run_queues+0x107/0x230 Aug 22 11:22:06 juju-e4d256-prod-github-runner-207 kernel: [21500.583624] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 11:22:06 juju-e4d256-prod-github-runner-207 kernel: [21500.584661] ? hrtimer_interrupt+0x101/0x220 Aug 22 11:22:06 juju-e4d256-prod-github-runner-207 kernel: [21500.585695] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 11:22:06 juju-e4d256-prod-github-runner-207 kernel: [21500.586902] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 11:22:06 juju-e4d256-prod-github-runner-207 kernel: [21500.588220] Aug 22 11:22:06 juju-e4d256-prod-github-runner-207 kernel: [21500.589292] Aug 22 11:22:06 juju-e4d256-prod-github-runner-207 kernel: [21500.590137] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 11:22:06 juju-e4d256-prod-github-runner-207 kernel: [21500.591198] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:22:06 juju-e4d256-prod-github-runner-207 kernel: [21500.592259] ? _raw_spin_lock+0x22/0x30 Aug 22 11:22:06 juju-e4d256-prod-github-runner-207 kernel: [21500.593221] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:22:06 juju-e4d256-prod-github-runner-207 kernel: [21500.594256] direct_page_fault+0x206/0x310 [kvm] Aug 22 11:22:06 juju-e4d256-prod-github-runner-207 kernel: [21500.595305] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 11:22:06 juju-e4d256-prod-github-runner-207 kernel: [21500.596330] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 11:22:06 juju-e4d256-prod-github-runner-207 kernel: [21500.597344] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 11:22:06 juju-e4d256-prod-github-runner-207 kernel: [21500.598351] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 11:22:06 juju-e4d256-prod-github-runner-207 kernel: [21500.599325] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 11:22:06 juju-e4d256-prod-github-runner-207 kernel: [21500.600317] handle_exit+0x98/0x230 [kvm_amd] Aug 22 11:22:06 juju-e4d256-prod-github-runner-207 kernel: [21500.601248] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 11:22:06 juju-e4d256-prod-github-runner-207 kernel: [21500.602192] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 11:22:06 juju-e4d256-prod-github-runner-207 kernel: [21500.603148] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 11:22:06 juju-e4d256-prod-github-runner-207 kernel: [21500.604065] vcpu_run+0x62/0x2c0 [kvm] Aug 22 11:22:06 juju-e4d256-prod-github-runner-207 kernel: [21500.604891] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 11:22:06 juju-e4d256-prod-github-runner-207 kernel: [21500.605712] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 11:22:06 juju-e4d256-prod-github-runner-207 kernel: [21500.606610] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 11:22:06 juju-e4d256-prod-github-runner-207 kernel: [21500.607420] ? __seccomp_filter+0x4a/0x4a0 Aug 22 11:22:06 juju-e4d256-prod-github-runner-207 kernel: [21500.608175] ? __fget_files+0x86/0xc0 Aug 22 11:22:06 juju-e4d256-prod-github-runner-207 kernel: [21500.608894] __x64_sys_ioctl+0x95/0xd0 Aug 22 11:22:06 juju-e4d256-prod-github-runner-207 kernel: [21500.609598] do_syscall_64+0x5c/0xc0 Aug 22 11:22:06 juju-e4d256-prod-github-runner-207 kernel: [21500.610274] ? do_futex+0x162/0x1f0 Aug 22 11:22:06 juju-e4d256-prod-github-runner-207 kernel: [21500.610982] ? __x64_sys_futex+0x78/0x1e0 Aug 22 11:22:06 juju-e4d256-prod-github-runner-207 kernel: [21500.611680] ? __secure_computing+0xa9/0x120 Aug 22 11:22:06 juju-e4d256-prod-github-runner-207 kernel: [21500.612381] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 11:22:06 juju-e4d256-prod-github-runner-207 kernel: [21500.613154] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:22:06 juju-e4d256-prod-github-runner-207 kernel: [21500.613970] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:22:06 juju-e4d256-prod-github-runner-207 kernel: [21500.614720] ? do_syscall_64+0x69/0xc0 Aug 22 11:22:06 juju-e4d256-prod-github-runner-207 kernel: [21500.615391] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:22:06 juju-e4d256-prod-github-runner-207 kernel: [21500.616130] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:22:06 juju-e4d256-prod-github-runner-207 kernel: [21500.616860] ? do_syscall_64+0x69/0xc0 Aug 22 11:22:06 juju-e4d256-prod-github-runner-207 kernel: [21500.617496] ? do_syscall_64+0x69/0xc0 Aug 22 11:22:06 juju-e4d256-prod-github-runner-207 kernel: [21500.618130] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 11:22:06 juju-e4d256-prod-github-runner-207 kernel: [21500.618879] RIP: 0033:0x7faa5d0edaff Aug 22 11:22:06 juju-e4d256-prod-github-runner-207 kernel: [21500.619567] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 11:22:06 juju-e4d256-prod-github-runner-207 kernel: [21500.621604] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 11:22:06 juju-e4d256-prod-github-runner-207 kernel: [21500.622548] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 11:22:06 juju-e4d256-prod-github-runner-207 kernel: [21500.623497] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 11:22:06 juju-e4d256-prod-github-runner-207 kernel: [21500.624407] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 11:22:06 juju-e4d256-prod-github-runner-207 kernel: [21500.625313] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 11:22:06 juju-e4d256-prod-github-runner-207 kernel: [21500.626218] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 11:22:06 juju-e4d256-prod-github-runner-207 kernel: [21500.627162] Aug 22 11:22:34 juju-e4d256-prod-github-runner-207 kernel: [21528.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 19942s! [qemu-system-x86:6715] Aug 22 11:22:34 juju-e4d256-prod-github-runner-207 kernel: [21528.543796] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 11:22:34 juju-e4d256-prod-github-runner-207 kernel: [21528.544007] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 11:22:34 juju-e4d256-prod-github-runner-207 kernel: [21528.556458] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 11:22:34 juju-e4d256-prod-github-runner-207 kernel: [21528.557727] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 11:22:34 juju-e4d256-prod-github-runner-207 kernel: [21528.558973] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:22:34 juju-e4d256-prod-github-runner-207 kernel: [21528.560072] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 11:22:34 juju-e4d256-prod-github-runner-207 kernel: [21528.562660] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 11:22:34 juju-e4d256-prod-github-runner-207 kernel: [21528.563701] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 11:22:34 juju-e4d256-prod-github-runner-207 kernel: [21528.564869] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 11:22:34 juju-e4d256-prod-github-runner-207 kernel: [21528.566064] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 11:22:34 juju-e4d256-prod-github-runner-207 kernel: [21528.567231] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 11:22:34 juju-e4d256-prod-github-runner-207 kernel: [21528.568392] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 11:22:34 juju-e4d256-prod-github-runner-207 kernel: [21528.569566] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 11:22:34 juju-e4d256-prod-github-runner-207 kernel: [21528.570882] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 11:22:34 juju-e4d256-prod-github-runner-207 kernel: [21528.571991] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 11:22:34 juju-e4d256-prod-github-runner-207 kernel: [21528.573184] Call Trace: Aug 22 11:22:34 juju-e4d256-prod-github-runner-207 kernel: [21528.574130] Aug 22 11:22:34 juju-e4d256-prod-github-runner-207 kernel: [21528.575046] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:22:34 juju-e4d256-prod-github-runner-207 kernel: [21528.576100] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:22:34 juju-e4d256-prod-github-runner-207 kernel: [21528.577242] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:22:34 juju-e4d256-prod-github-runner-207 kernel: [21528.578396] ? show_regs.part.0+0x23/0x29 Aug 22 11:22:34 juju-e4d256-prod-github-runner-207 kernel: [21528.579443] ? show_regs.cold+0x8/0xd Aug 22 11:22:34 juju-e4d256-prod-github-runner-207 kernel: [21528.580571] ? watchdog_timer_fn+0x1be/0x220 Aug 22 11:22:34 juju-e4d256-prod-github-runner-207 kernel: [21528.581637] ? lockup_detector_update_enable+0x60/0x60 Aug 22 11:22:34 juju-e4d256-prod-github-runner-207 kernel: [21528.582771] ? __hrtimer_run_queues+0x107/0x230 Aug 22 11:22:34 juju-e4d256-prod-github-runner-207 kernel: [21528.583810] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 11:22:34 juju-e4d256-prod-github-runner-207 kernel: [21528.584836] ? hrtimer_interrupt+0x101/0x220 Aug 22 11:22:34 juju-e4d256-prod-github-runner-207 kernel: [21528.585879] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 11:22:34 juju-e4d256-prod-github-runner-207 kernel: [21528.586995] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 11:22:34 juju-e4d256-prod-github-runner-207 kernel: [21528.588050] Aug 22 11:22:34 juju-e4d256-prod-github-runner-207 kernel: [21528.588908] Aug 22 11:22:34 juju-e4d256-prod-github-runner-207 kernel: [21528.589749] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 11:22:34 juju-e4d256-prod-github-runner-207 kernel: [21528.590823] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:22:34 juju-e4d256-prod-github-runner-207 kernel: [21528.591911] ? _raw_spin_lock+0x22/0x30 Aug 22 11:22:34 juju-e4d256-prod-github-runner-207 kernel: [21528.592867] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:22:34 juju-e4d256-prod-github-runner-207 kernel: [21528.593934] direct_page_fault+0x206/0x310 [kvm] Aug 22 11:22:34 juju-e4d256-prod-github-runner-207 kernel: [21528.594985] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 11:22:34 juju-e4d256-prod-github-runner-207 kernel: [21528.596025] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 11:22:34 juju-e4d256-prod-github-runner-207 kernel: [21528.597061] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 11:22:34 juju-e4d256-prod-github-runner-207 kernel: [21528.598077] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 11:22:34 juju-e4d256-prod-github-runner-207 kernel: [21528.599030] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 11:22:34 juju-e4d256-prod-github-runner-207 kernel: [21528.600015] handle_exit+0x98/0x230 [kvm_amd] Aug 22 11:22:34 juju-e4d256-prod-github-runner-207 kernel: [21528.600929] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 11:22:34 juju-e4d256-prod-github-runner-207 kernel: [21528.601879] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 11:22:34 juju-e4d256-prod-github-runner-207 kernel: [21528.602833] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 11:22:34 juju-e4d256-prod-github-runner-207 kernel: [21528.603747] vcpu_run+0x62/0x2c0 [kvm] Aug 22 11:22:34 juju-e4d256-prod-github-runner-207 kernel: [21528.604639] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 11:22:34 juju-e4d256-prod-github-runner-207 kernel: [21528.605595] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 11:22:34 juju-e4d256-prod-github-runner-207 kernel: [21528.606729] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 11:22:34 juju-e4d256-prod-github-runner-207 kernel: [21528.607711] ? __seccomp_filter+0x4a/0x4a0 Aug 22 11:22:34 juju-e4d256-prod-github-runner-207 kernel: [21528.608470] ? __fget_files+0x86/0xc0 Aug 22 11:22:34 juju-e4d256-prod-github-runner-207 kernel: [21528.609186] __x64_sys_ioctl+0x95/0xd0 Aug 22 11:22:34 juju-e4d256-prod-github-runner-207 kernel: [21528.609886] do_syscall_64+0x5c/0xc0 Aug 22 11:22:34 juju-e4d256-prod-github-runner-207 kernel: [21528.610579] ? do_futex+0x162/0x1f0 Aug 22 11:22:34 juju-e4d256-prod-github-runner-207 kernel: [21528.611250] ? __x64_sys_futex+0x78/0x1e0 Aug 22 11:22:34 juju-e4d256-prod-github-runner-207 kernel: [21528.611952] ? __secure_computing+0xa9/0x120 Aug 22 11:22:34 juju-e4d256-prod-github-runner-207 kernel: [21528.612668] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 11:22:34 juju-e4d256-prod-github-runner-207 kernel: [21528.613435] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:22:34 juju-e4d256-prod-github-runner-207 kernel: [21528.614183] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:22:34 juju-e4d256-prod-github-runner-207 kernel: [21528.615094] ? do_syscall_64+0x69/0xc0 Aug 22 11:22:34 juju-e4d256-prod-github-runner-207 kernel: [21528.615744] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:22:34 juju-e4d256-prod-github-runner-207 kernel: [21528.616530] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:22:34 juju-e4d256-prod-github-runner-207 kernel: [21528.617310] ? do_syscall_64+0x69/0xc0 Aug 22 11:22:34 juju-e4d256-prod-github-runner-207 kernel: [21528.617956] ? do_syscall_64+0x69/0xc0 Aug 22 11:22:34 juju-e4d256-prod-github-runner-207 kernel: [21528.618608] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 11:22:34 juju-e4d256-prod-github-runner-207 kernel: [21528.619318] RIP: 0033:0x7faa5d0edaff Aug 22 11:22:34 juju-e4d256-prod-github-runner-207 kernel: [21528.619973] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 11:22:34 juju-e4d256-prod-github-runner-207 kernel: [21528.621979] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 11:22:34 juju-e4d256-prod-github-runner-207 kernel: [21528.622966] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 11:22:34 juju-e4d256-prod-github-runner-207 kernel: [21528.623867] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 11:22:34 juju-e4d256-prod-github-runner-207 kernel: [21528.624785] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 11:22:34 juju-e4d256-prod-github-runner-207 kernel: [21528.625673] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 11:22:34 juju-e4d256-prod-github-runner-207 kernel: [21528.626591] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 11:22:34 juju-e4d256-prod-github-runner-207 kernel: [21528.627500] Aug 22 11:23:02 juju-e4d256-prod-github-runner-207 kernel: [21556.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 19968s! [qemu-system-x86:6715] Aug 22 11:23:02 juju-e4d256-prod-github-runner-207 kernel: [21556.543844] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 11:23:02 juju-e4d256-prod-github-runner-207 kernel: [21556.544153] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 11:23:02 juju-e4d256-prod-github-runner-207 kernel: [21556.556268] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 11:23:02 juju-e4d256-prod-github-runner-207 kernel: [21556.557541] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 11:23:02 juju-e4d256-prod-github-runner-207 kernel: [21556.558784] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:23:02 juju-e4d256-prod-github-runner-207 kernel: [21556.559868] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 11:23:02 juju-e4d256-prod-github-runner-207 kernel: [21556.562451] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 11:23:02 juju-e4d256-prod-github-runner-207 kernel: [21556.563503] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 11:23:02 juju-e4d256-prod-github-runner-207 kernel: [21556.564665] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 11:23:02 juju-e4d256-prod-github-runner-207 kernel: [21556.565856] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 11:23:02 juju-e4d256-prod-github-runner-207 kernel: [21556.567018] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 11:23:02 juju-e4d256-prod-github-runner-207 kernel: [21556.568185] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 11:23:02 juju-e4d256-prod-github-runner-207 kernel: [21556.569352] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 11:23:02 juju-e4d256-prod-github-runner-207 kernel: [21556.570599] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 11:23:02 juju-e4d256-prod-github-runner-207 kernel: [21556.571701] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 11:23:02 juju-e4d256-prod-github-runner-207 kernel: [21556.572894] Call Trace: Aug 22 11:23:02 juju-e4d256-prod-github-runner-207 kernel: [21556.573823] Aug 22 11:23:02 juju-e4d256-prod-github-runner-207 kernel: [21556.574773] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:23:02 juju-e4d256-prod-github-runner-207 kernel: [21556.575853] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:23:02 juju-e4d256-prod-github-runner-207 kernel: [21556.576877] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:23:02 juju-e4d256-prod-github-runner-207 kernel: [21556.577995] ? show_regs.part.0+0x23/0x29 Aug 22 11:23:02 juju-e4d256-prod-github-runner-207 kernel: [21556.578994] ? show_regs.cold+0x8/0xd Aug 22 11:23:02 juju-e4d256-prod-github-runner-207 kernel: [21556.579966] ? watchdog_timer_fn+0x1be/0x220 Aug 22 11:23:02 juju-e4d256-prod-github-runner-207 kernel: [21556.581160] ? lockup_detector_update_enable+0x60/0x60 Aug 22 11:23:02 juju-e4d256-prod-github-runner-207 kernel: [21556.582237] ? __hrtimer_run_queues+0x107/0x230 Aug 22 11:23:02 juju-e4d256-prod-github-runner-207 kernel: [21556.583270] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 11:23:02 juju-e4d256-prod-github-runner-207 kernel: [21556.584294] ? hrtimer_interrupt+0x101/0x220 Aug 22 11:23:02 juju-e4d256-prod-github-runner-207 kernel: [21556.585319] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 11:23:02 juju-e4d256-prod-github-runner-207 kernel: [21556.586610] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 11:23:02 juju-e4d256-prod-github-runner-207 kernel: [21556.587859] Aug 22 11:23:02 juju-e4d256-prod-github-runner-207 kernel: [21556.588717] Aug 22 11:23:02 juju-e4d256-prod-github-runner-207 kernel: [21556.589554] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 11:23:02 juju-e4d256-prod-github-runner-207 kernel: [21556.590639] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:23:02 juju-e4d256-prod-github-runner-207 kernel: [21556.591683] ? _raw_spin_lock+0x22/0x30 Aug 22 11:23:02 juju-e4d256-prod-github-runner-207 kernel: [21556.592627] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:23:02 juju-e4d256-prod-github-runner-207 kernel: [21556.593651] direct_page_fault+0x206/0x310 [kvm] Aug 22 11:23:02 juju-e4d256-prod-github-runner-207 kernel: [21556.594681] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 11:23:02 juju-e4d256-prod-github-runner-207 kernel: [21556.595724] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 11:23:02 juju-e4d256-prod-github-runner-207 kernel: [21556.596726] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 11:23:02 juju-e4d256-prod-github-runner-207 kernel: [21556.597761] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 11:23:02 juju-e4d256-prod-github-runner-207 kernel: [21556.598707] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 11:23:02 juju-e4d256-prod-github-runner-207 kernel: [21556.599687] handle_exit+0x98/0x230 [kvm_amd] Aug 22 11:23:02 juju-e4d256-prod-github-runner-207 kernel: [21556.600578] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 11:23:02 juju-e4d256-prod-github-runner-207 kernel: [21556.601497] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 11:23:02 juju-e4d256-prod-github-runner-207 kernel: [21556.602475] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 11:23:02 juju-e4d256-prod-github-runner-207 kernel: [21556.603383] vcpu_run+0x62/0x2c0 [kvm] Aug 22 11:23:02 juju-e4d256-prod-github-runner-207 kernel: [21556.604194] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 11:23:02 juju-e4d256-prod-github-runner-207 kernel: [21556.605074] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 11:23:02 juju-e4d256-prod-github-runner-207 kernel: [21556.605945] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 11:23:02 juju-e4d256-prod-github-runner-207 kernel: [21556.606743] ? __seccomp_filter+0x4a/0x4a0 Aug 22 11:23:02 juju-e4d256-prod-github-runner-207 kernel: [21556.607489] ? __fget_files+0x86/0xc0 Aug 22 11:23:02 juju-e4d256-prod-github-runner-207 kernel: [21556.608191] __x64_sys_ioctl+0x95/0xd0 Aug 22 11:23:02 juju-e4d256-prod-github-runner-207 kernel: [21556.608882] do_syscall_64+0x5c/0xc0 Aug 22 11:23:02 juju-e4d256-prod-github-runner-207 kernel: [21556.609556] ? do_futex+0x162/0x1f0 Aug 22 11:23:02 juju-e4d256-prod-github-runner-207 kernel: [21556.610220] ? __x64_sys_futex+0x78/0x1e0 Aug 22 11:23:02 juju-e4d256-prod-github-runner-207 kernel: [21556.610894] ? __secure_computing+0xa9/0x120 Aug 22 11:23:02 juju-e4d256-prod-github-runner-207 kernel: [21556.611587] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 11:23:02 juju-e4d256-prod-github-runner-207 kernel: [21556.612354] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:23:02 juju-e4d256-prod-github-runner-207 kernel: [21556.613075] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:23:02 juju-e4d256-prod-github-runner-207 kernel: [21556.613801] ? do_syscall_64+0x69/0xc0 Aug 22 11:23:02 juju-e4d256-prod-github-runner-207 kernel: [21556.614456] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:23:02 juju-e4d256-prod-github-runner-207 kernel: [21556.615172] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:23:02 juju-e4d256-prod-github-runner-207 kernel: [21556.616055] ? do_syscall_64+0x69/0xc0 Aug 22 11:23:02 juju-e4d256-prod-github-runner-207 kernel: [21556.616733] ? do_syscall_64+0x69/0xc0 Aug 22 11:23:02 juju-e4d256-prod-github-runner-207 kernel: [21556.617357] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 11:23:02 juju-e4d256-prod-github-runner-207 kernel: [21556.618106] RIP: 0033:0x7faa5d0edaff Aug 22 11:23:02 juju-e4d256-prod-github-runner-207 kernel: [21556.618766] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 11:23:02 juju-e4d256-prod-github-runner-207 kernel: [21556.620761] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 11:23:02 juju-e4d256-prod-github-runner-207 kernel: [21556.621675] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 11:23:02 juju-e4d256-prod-github-runner-207 kernel: [21556.622582] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 11:23:02 juju-e4d256-prod-github-runner-207 kernel: [21556.623475] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 11:23:02 juju-e4d256-prod-github-runner-207 kernel: [21556.624367] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 11:23:02 juju-e4d256-prod-github-runner-207 kernel: [21556.625256] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 11:23:02 juju-e4d256-prod-github-runner-207 kernel: [21556.626164] Aug 22 11:23:30 juju-e4d256-prod-github-runner-207 kernel: [21584.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 19994s! [qemu-system-x86:6715] Aug 22 11:23:30 juju-e4d256-prod-github-runner-207 kernel: [21584.543110] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 11:23:30 juju-e4d256-prod-github-runner-207 kernel: [21584.543186] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 11:23:30 juju-e4d256-prod-github-runner-207 kernel: [21584.555829] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 11:23:30 juju-e4d256-prod-github-runner-207 kernel: [21584.557145] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 11:23:30 juju-e4d256-prod-github-runner-207 kernel: [21584.558412] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:23:30 juju-e4d256-prod-github-runner-207 kernel: [21584.559478] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 11:23:30 juju-e4d256-prod-github-runner-207 kernel: [21584.562136] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 11:23:30 juju-e4d256-prod-github-runner-207 kernel: [21584.563256] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 11:23:30 juju-e4d256-prod-github-runner-207 kernel: [21584.564445] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 11:23:30 juju-e4d256-prod-github-runner-207 kernel: [21584.565654] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 11:23:30 juju-e4d256-prod-github-runner-207 kernel: [21584.566847] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 11:23:30 juju-e4d256-prod-github-runner-207 kernel: [21584.568008] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 11:23:30 juju-e4d256-prod-github-runner-207 kernel: [21584.569198] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 11:23:30 juju-e4d256-prod-github-runner-207 kernel: [21584.570459] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 11:23:30 juju-e4d256-prod-github-runner-207 kernel: [21584.571572] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 11:23:30 juju-e4d256-prod-github-runner-207 kernel: [21584.572809] Call Trace: Aug 22 11:23:30 juju-e4d256-prod-github-runner-207 kernel: [21584.573759] Aug 22 11:23:30 juju-e4d256-prod-github-runner-207 kernel: [21584.574659] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:23:30 juju-e4d256-prod-github-runner-207 kernel: [21584.575687] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:23:30 juju-e4d256-prod-github-runner-207 kernel: [21584.576723] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:23:30 juju-e4d256-prod-github-runner-207 kernel: [21584.577820] ? show_regs.part.0+0x23/0x29 Aug 22 11:23:30 juju-e4d256-prod-github-runner-207 kernel: [21584.578817] ? show_regs.cold+0x8/0xd Aug 22 11:23:30 juju-e4d256-prod-github-runner-207 kernel: [21584.579791] ? watchdog_timer_fn+0x1be/0x220 Aug 22 11:23:30 juju-e4d256-prod-github-runner-207 kernel: [21584.580803] ? lockup_detector_update_enable+0x60/0x60 Aug 22 11:23:30 juju-e4d256-prod-github-runner-207 kernel: [21584.582135] ? __hrtimer_run_queues+0x107/0x230 Aug 22 11:23:30 juju-e4d256-prod-github-runner-207 kernel: [21584.583207] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 11:23:30 juju-e4d256-prod-github-runner-207 kernel: [21584.584243] ? hrtimer_interrupt+0x101/0x220 Aug 22 11:23:30 juju-e4d256-prod-github-runner-207 kernel: [21584.585258] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 11:23:30 juju-e4d256-prod-github-runner-207 kernel: [21584.586345] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 11:23:30 juju-e4d256-prod-github-runner-207 kernel: [21584.587388] Aug 22 11:23:30 juju-e4d256-prod-github-runner-207 kernel: [21584.588241] Aug 22 11:23:30 juju-e4d256-prod-github-runner-207 kernel: [21584.589077] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 11:23:30 juju-e4d256-prod-github-runner-207 kernel: [21584.590157] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:23:30 juju-e4d256-prod-github-runner-207 kernel: [21584.591203] ? _raw_spin_lock+0x22/0x30 Aug 22 11:23:30 juju-e4d256-prod-github-runner-207 kernel: [21584.592195] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:23:30 juju-e4d256-prod-github-runner-207 kernel: [21584.593226] direct_page_fault+0x206/0x310 [kvm] Aug 22 11:23:30 juju-e4d256-prod-github-runner-207 kernel: [21584.594345] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 11:23:30 juju-e4d256-prod-github-runner-207 kernel: [21584.595385] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 11:23:30 juju-e4d256-prod-github-runner-207 kernel: [21584.596401] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 11:23:30 juju-e4d256-prod-github-runner-207 kernel: [21584.597383] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 11:23:30 juju-e4d256-prod-github-runner-207 kernel: [21584.598330] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 11:23:30 juju-e4d256-prod-github-runner-207 kernel: [21584.599341] handle_exit+0x98/0x230 [kvm_amd] Aug 22 11:23:30 juju-e4d256-prod-github-runner-207 kernel: [21584.600243] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 11:23:30 juju-e4d256-prod-github-runner-207 kernel: [21584.601182] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 11:23:30 juju-e4d256-prod-github-runner-207 kernel: [21584.602118] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 11:23:30 juju-e4d256-prod-github-runner-207 kernel: [21584.603025] vcpu_run+0x62/0x2c0 [kvm] Aug 22 11:23:30 juju-e4d256-prod-github-runner-207 kernel: [21584.603833] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 11:23:30 juju-e4d256-prod-github-runner-207 kernel: [21584.604640] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 11:23:30 juju-e4d256-prod-github-runner-207 kernel: [21584.605501] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 11:23:30 juju-e4d256-prod-github-runner-207 kernel: [21584.606301] ? __seccomp_filter+0x4a/0x4a0 Aug 22 11:23:30 juju-e4d256-prod-github-runner-207 kernel: [21584.607049] ? __fget_files+0x86/0xc0 Aug 22 11:23:30 juju-e4d256-prod-github-runner-207 kernel: [21584.607758] __x64_sys_ioctl+0x95/0xd0 Aug 22 11:23:30 juju-e4d256-prod-github-runner-207 kernel: [21584.608454] do_syscall_64+0x5c/0xc0 Aug 22 11:23:30 juju-e4d256-prod-github-runner-207 kernel: [21584.609118] ? do_futex+0x162/0x1f0 Aug 22 11:23:30 juju-e4d256-prod-github-runner-207 kernel: [21584.609788] ? __x64_sys_futex+0x78/0x1e0 Aug 22 11:23:30 juju-e4d256-prod-github-runner-207 kernel: [21584.610461] ? __secure_computing+0xa9/0x120 Aug 22 11:23:30 juju-e4d256-prod-github-runner-207 kernel: [21584.611164] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 11:23:30 juju-e4d256-prod-github-runner-207 kernel: [21584.611933] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:23:30 juju-e4d256-prod-github-runner-207 kernel: [21584.612660] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:23:30 juju-e4d256-prod-github-runner-207 kernel: [21584.613393] ? do_syscall_64+0x69/0xc0 Aug 22 11:23:30 juju-e4d256-prod-github-runner-207 kernel: [21584.614038] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:23:30 juju-e4d256-prod-github-runner-207 kernel: [21584.614740] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:23:30 juju-e4d256-prod-github-runner-207 kernel: [21584.615441] ? do_syscall_64+0x69/0xc0 Aug 22 11:23:30 juju-e4d256-prod-github-runner-207 kernel: [21584.616066] ? do_syscall_64+0x69/0xc0 Aug 22 11:23:30 juju-e4d256-prod-github-runner-207 kernel: [21584.616688] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 11:23:30 juju-e4d256-prod-github-runner-207 kernel: [21584.617401] RIP: 0033:0x7faa5d0edaff Aug 22 11:23:30 juju-e4d256-prod-github-runner-207 kernel: [21584.618047] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 11:23:30 juju-e4d256-prod-github-runner-207 kernel: [21584.620040] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 11:23:30 juju-e4d256-prod-github-runner-207 kernel: [21584.620953] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 11:23:30 juju-e4d256-prod-github-runner-207 kernel: [21584.621860] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 11:23:30 juju-e4d256-prod-github-runner-207 kernel: [21584.622849] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 11:23:30 juju-e4d256-prod-github-runner-207 kernel: [21584.623852] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 11:23:30 juju-e4d256-prod-github-runner-207 kernel: [21584.624764] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 11:23:30 juju-e4d256-prod-github-runner-207 kernel: [21584.625718] Aug 22 11:23:44 juju-e4d256-prod-github-runner-207 kernel: [21598.628704] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 11:23:44 juju-e4d256-prod-github-runner-207 kernel: [21598.629669] rcu: 1-....: (5353572 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=2591906 Aug 22 11:23:44 juju-e4d256-prod-github-runner-207 kernel: [21598.630796] (t=5370357 jiffies g=23269 q=27208) Aug 22 11:23:44 juju-e4d256-prod-github-runner-207 kernel: [21598.631590] NMI backtrace for cpu 1 Aug 22 11:23:44 juju-e4d256-prod-github-runner-207 kernel: [21598.632307] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 11:23:44 juju-e4d256-prod-github-runner-207 kernel: [21598.633468] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 11:23:44 juju-e4d256-prod-github-runner-207 kernel: [21598.634550] Call Trace: Aug 22 11:23:44 juju-e4d256-prod-github-runner-207 kernel: [21598.635260] Aug 22 11:23:44 juju-e4d256-prod-github-runner-207 kernel: [21598.635926] show_stack+0x52/0x5c Aug 22 11:23:44 juju-e4d256-prod-github-runner-207 kernel: [21598.636659] dump_stack_lvl+0x4a/0x63 Aug 22 11:23:44 juju-e4d256-prod-github-runner-207 kernel: [21598.637438] dump_stack+0x10/0x16 Aug 22 11:23:44 juju-e4d256-prod-github-runner-207 kernel: [21598.638161] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 11:23:44 juju-e4d256-prod-github-runner-207 kernel: [21598.638945] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 11:23:44 juju-e4d256-prod-github-runner-207 kernel: [21598.639729] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 11:23:44 juju-e4d256-prod-github-runner-207 kernel: [21598.640553] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 11:23:44 juju-e4d256-prod-github-runner-207 kernel: [21598.641394] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 11:23:44 juju-e4d256-prod-github-runner-207 kernel: [21598.642214] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 11:23:44 juju-e4d256-prod-github-runner-207 kernel: [21598.643005] print_cpu_stall.cold+0x2f/0xe2 Aug 22 11:23:44 juju-e4d256-prod-github-runner-207 kernel: [21598.643771] ? timekeeping_update+0xf7/0x150 Aug 22 11:23:44 juju-e4d256-prod-github-runner-207 kernel: [21598.644544] check_cpu_stall+0x109/0x270 Aug 22 11:23:44 juju-e4d256-prod-github-runner-207 kernel: [21598.645306] rcu_sched_clock_irq+0x9a/0x250 Aug 22 11:23:44 juju-e4d256-prod-github-runner-207 kernel: [21598.646067] update_process_times+0x94/0xd0 Aug 22 11:23:44 juju-e4d256-prod-github-runner-207 kernel: [21598.646825] tick_sched_handle+0x29/0x70 Aug 22 11:23:44 juju-e4d256-prod-github-runner-207 kernel: [21598.647574] tick_sched_timer+0x8c/0xc0 Aug 22 11:23:44 juju-e4d256-prod-github-runner-207 kernel: [21598.648309] ? tick_nohz_handler+0xb0/0xb0 Aug 22 11:23:44 juju-e4d256-prod-github-runner-207 kernel: [21598.649061] __hrtimer_run_queues+0x107/0x230 Aug 22 11:23:44 juju-e4d256-prod-github-runner-207 kernel: [21598.649857] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 11:23:44 juju-e4d256-prod-github-runner-207 kernel: [21598.650660] hrtimer_interrupt+0x101/0x220 Aug 22 11:23:44 juju-e4d256-prod-github-runner-207 kernel: [21598.651433] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 11:23:44 juju-e4d256-prod-github-runner-207 kernel: [21598.652243] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 11:23:44 juju-e4d256-prod-github-runner-207 kernel: [21598.653053] Aug 22 11:23:44 juju-e4d256-prod-github-runner-207 kernel: [21598.653713] Aug 22 11:23:44 juju-e4d256-prod-github-runner-207 kernel: [21598.654343] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 11:23:44 juju-e4d256-prod-github-runner-207 kernel: [21598.655190] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:23:44 juju-e4d256-prod-github-runner-207 kernel: [21598.656067] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 11:23:44 juju-e4d256-prod-github-runner-207 kernel: [21598.658289] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 11:23:44 juju-e4d256-prod-github-runner-207 kernel: [21598.659166] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 11:23:44 juju-e4d256-prod-github-runner-207 kernel: [21598.660209] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 11:23:44 juju-e4d256-prod-github-runner-207 kernel: [21598.661269] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 11:23:44 juju-e4d256-prod-github-runner-207 kernel: [21598.662237] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 11:23:44 juju-e4d256-prod-github-runner-207 kernel: [21598.663188] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 11:23:44 juju-e4d256-prod-github-runner-207 kernel: [21598.664142] ? _raw_spin_lock+0x22/0x30 Aug 22 11:23:44 juju-e4d256-prod-github-runner-207 kernel: [21598.664899] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:23:44 juju-e4d256-prod-github-runner-207 kernel: [21598.665758] direct_page_fault+0x206/0x310 [kvm] Aug 22 11:23:44 juju-e4d256-prod-github-runner-207 kernel: [21598.666594] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 11:23:44 juju-e4d256-prod-github-runner-207 kernel: [21598.667423] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 11:23:44 juju-e4d256-prod-github-runner-207 kernel: [21598.668242] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 11:23:44 juju-e4d256-prod-github-runner-207 kernel: [21598.669047] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 11:23:44 juju-e4d256-prod-github-runner-207 kernel: [21598.669845] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 11:23:44 juju-e4d256-prod-github-runner-207 kernel: [21598.670668] handle_exit+0x98/0x230 [kvm_amd] Aug 22 11:23:44 juju-e4d256-prod-github-runner-207 kernel: [21598.671425] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 11:23:44 juju-e4d256-prod-github-runner-207 kernel: [21598.672204] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 11:23:44 juju-e4d256-prod-github-runner-207 kernel: [21598.672999] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 11:23:44 juju-e4d256-prod-github-runner-207 kernel: [21598.673802] vcpu_run+0x62/0x2c0 [kvm] Aug 22 11:23:44 juju-e4d256-prod-github-runner-207 kernel: [21598.674514] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 11:23:44 juju-e4d256-prod-github-runner-207 kernel: [21598.675249] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 11:23:44 juju-e4d256-prod-github-runner-207 kernel: [21598.676051] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 11:23:44 juju-e4d256-prod-github-runner-207 kernel: [21598.676808] ? __seccomp_filter+0x4a/0x4a0 Aug 22 11:23:44 juju-e4d256-prod-github-runner-207 kernel: [21598.677537] ? __fget_files+0x86/0xc0 Aug 22 11:23:44 juju-e4d256-prod-github-runner-207 kernel: [21598.678248] __x64_sys_ioctl+0x95/0xd0 Aug 22 11:23:44 juju-e4d256-prod-github-runner-207 kernel: [21598.678959] do_syscall_64+0x5c/0xc0 Aug 22 11:23:44 juju-e4d256-prod-github-runner-207 kernel: [21598.679639] ? do_futex+0x162/0x1f0 Aug 22 11:23:44 juju-e4d256-prod-github-runner-207 kernel: [21598.680308] ? __x64_sys_futex+0x78/0x1e0 Aug 22 11:23:44 juju-e4d256-prod-github-runner-207 kernel: [21598.681025] ? __secure_computing+0xa9/0x120 Aug 22 11:23:44 juju-e4d256-prod-github-runner-207 kernel: [21598.681767] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 11:23:44 juju-e4d256-prod-github-runner-207 kernel: [21598.682555] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:23:44 juju-e4d256-prod-github-runner-207 kernel: [21598.683305] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:23:44 juju-e4d256-prod-github-runner-207 kernel: [21598.684055] ? do_syscall_64+0x69/0xc0 Aug 22 11:23:44 juju-e4d256-prod-github-runner-207 kernel: [21598.684743] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:23:44 juju-e4d256-prod-github-runner-207 kernel: [21598.685518] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:23:44 juju-e4d256-prod-github-runner-207 kernel: [21598.686273] ? do_syscall_64+0x69/0xc0 Aug 22 11:23:44 juju-e4d256-prod-github-runner-207 kernel: [21598.686999] ? do_syscall_64+0x69/0xc0 Aug 22 11:23:44 juju-e4d256-prod-github-runner-207 kernel: [21598.687686] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 11:23:44 juju-e4d256-prod-github-runner-207 kernel: [21598.688459] RIP: 0033:0x7faa5d0edaff Aug 22 11:23:44 juju-e4d256-prod-github-runner-207 kernel: [21598.689140] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 11:23:44 juju-e4d256-prod-github-runner-207 kernel: [21598.691246] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 11:23:44 juju-e4d256-prod-github-runner-207 kernel: [21598.692210] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 11:23:44 juju-e4d256-prod-github-runner-207 kernel: [21598.693153] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 11:23:44 juju-e4d256-prod-github-runner-207 kernel: [21598.694117] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 11:23:44 juju-e4d256-prod-github-runner-207 kernel: [21598.695060] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 11:23:44 juju-e4d256-prod-github-runner-207 kernel: [21598.696000] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 11:23:44 juju-e4d256-prod-github-runner-207 kernel: [21598.696965] Aug 22 11:24:10 juju-e4d256-prod-github-runner-207 kernel: [21624.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 20031s! [qemu-system-x86:6715] Aug 22 11:24:10 juju-e4d256-prod-github-runner-207 kernel: [21624.543200] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 11:24:10 juju-e4d256-prod-github-runner-207 kernel: [21624.543369] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 11:24:10 juju-e4d256-prod-github-runner-207 kernel: [21624.555837] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 11:24:10 juju-e4d256-prod-github-runner-207 kernel: [21624.557136] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 11:24:10 juju-e4d256-prod-github-runner-207 kernel: [21624.558367] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:24:10 juju-e4d256-prod-github-runner-207 kernel: [21624.559431] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 11:24:10 juju-e4d256-prod-github-runner-207 kernel: [21624.562034] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 11:24:10 juju-e4d256-prod-github-runner-207 kernel: [21624.563093] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 11:24:10 juju-e4d256-prod-github-runner-207 kernel: [21624.564265] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 11:24:10 juju-e4d256-prod-github-runner-207 kernel: [21624.565460] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 11:24:10 juju-e4d256-prod-github-runner-207 kernel: [21624.566763] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 11:24:10 juju-e4d256-prod-github-runner-207 kernel: [21624.567938] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 11:24:10 juju-e4d256-prod-github-runner-207 kernel: [21624.569140] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 11:24:10 juju-e4d256-prod-github-runner-207 kernel: [21624.570436] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 11:24:10 juju-e4d256-prod-github-runner-207 kernel: [21624.571561] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 11:24:10 juju-e4d256-prod-github-runner-207 kernel: [21624.572771] Call Trace: Aug 22 11:24:10 juju-e4d256-prod-github-runner-207 kernel: [21624.573697] Aug 22 11:24:10 juju-e4d256-prod-github-runner-207 kernel: [21624.574591] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:24:10 juju-e4d256-prod-github-runner-207 kernel: [21624.575640] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:24:10 juju-e4d256-prod-github-runner-207 kernel: [21624.576666] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:24:10 juju-e4d256-prod-github-runner-207 kernel: [21624.577794] ? show_regs.part.0+0x23/0x29 Aug 22 11:24:10 juju-e4d256-prod-github-runner-207 kernel: [21624.578800] ? show_regs.cold+0x8/0xd Aug 22 11:24:10 juju-e4d256-prod-github-runner-207 kernel: [21624.579809] ? watchdog_timer_fn+0x1be/0x220 Aug 22 11:24:10 juju-e4d256-prod-github-runner-207 kernel: [21624.580834] ? lockup_detector_update_enable+0x60/0x60 Aug 22 11:24:10 juju-e4d256-prod-github-runner-207 kernel: [21624.581949] ? __hrtimer_run_queues+0x107/0x230 Aug 22 11:24:10 juju-e4d256-prod-github-runner-207 kernel: [21624.582998] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 11:24:10 juju-e4d256-prod-github-runner-207 kernel: [21624.584025] ? hrtimer_interrupt+0x101/0x220 Aug 22 11:24:10 juju-e4d256-prod-github-runner-207 kernel: [21624.585077] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 11:24:10 juju-e4d256-prod-github-runner-207 kernel: [21624.586161] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 11:24:10 juju-e4d256-prod-github-runner-207 kernel: [21624.587215] Aug 22 11:24:10 juju-e4d256-prod-github-runner-207 kernel: [21624.588126] Aug 22 11:24:10 juju-e4d256-prod-github-runner-207 kernel: [21624.589029] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 11:24:10 juju-e4d256-prod-github-runner-207 kernel: [21624.590072] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:24:10 juju-e4d256-prod-github-runner-207 kernel: [21624.591115] ? _raw_spin_lock+0x22/0x30 Aug 22 11:24:10 juju-e4d256-prod-github-runner-207 kernel: [21624.592072] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:24:10 juju-e4d256-prod-github-runner-207 kernel: [21624.593131] direct_page_fault+0x206/0x310 [kvm] Aug 22 11:24:10 juju-e4d256-prod-github-runner-207 kernel: [21624.594194] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 11:24:10 juju-e4d256-prod-github-runner-207 kernel: [21624.595233] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 11:24:10 juju-e4d256-prod-github-runner-207 kernel: [21624.596266] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 11:24:10 juju-e4d256-prod-github-runner-207 kernel: [21624.597306] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 11:24:10 juju-e4d256-prod-github-runner-207 kernel: [21624.598263] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 11:24:10 juju-e4d256-prod-github-runner-207 kernel: [21624.599288] handle_exit+0x98/0x230 [kvm_amd] Aug 22 11:24:10 juju-e4d256-prod-github-runner-207 kernel: [21624.600218] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 11:24:10 juju-e4d256-prod-github-runner-207 kernel: [21624.601176] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 11:24:10 juju-e4d256-prod-github-runner-207 kernel: [21624.602149] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 11:24:10 juju-e4d256-prod-github-runner-207 kernel: [21624.603064] vcpu_run+0x62/0x2c0 [kvm] Aug 22 11:24:10 juju-e4d256-prod-github-runner-207 kernel: [21624.603886] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 11:24:10 juju-e4d256-prod-github-runner-207 kernel: [21624.604709] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 11:24:10 juju-e4d256-prod-github-runner-207 kernel: [21624.605638] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 11:24:10 juju-e4d256-prod-github-runner-207 kernel: [21624.606458] ? __seccomp_filter+0x4a/0x4a0 Aug 22 11:24:10 juju-e4d256-prod-github-runner-207 kernel: [21624.607209] ? __fget_files+0x86/0xc0 Aug 22 11:24:10 juju-e4d256-prod-github-runner-207 kernel: [21624.607933] __x64_sys_ioctl+0x95/0xd0 Aug 22 11:24:10 juju-e4d256-prod-github-runner-207 kernel: [21624.608650] do_syscall_64+0x5c/0xc0 Aug 22 11:24:10 juju-e4d256-prod-github-runner-207 kernel: [21624.609353] ? do_futex+0x162/0x1f0 Aug 22 11:24:10 juju-e4d256-prod-github-runner-207 kernel: [21624.610003] ? __x64_sys_futex+0x78/0x1e0 Aug 22 11:24:10 juju-e4d256-prod-github-runner-207 kernel: [21624.610703] ? __secure_computing+0xa9/0x120 Aug 22 11:24:10 juju-e4d256-prod-github-runner-207 kernel: [21624.611398] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 11:24:10 juju-e4d256-prod-github-runner-207 kernel: [21624.612154] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:24:10 juju-e4d256-prod-github-runner-207 kernel: [21624.612882] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:24:10 juju-e4d256-prod-github-runner-207 kernel: [21624.613635] ? do_syscall_64+0x69/0xc0 Aug 22 11:24:10 juju-e4d256-prod-github-runner-207 kernel: [21624.614299] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:24:10 juju-e4d256-prod-github-runner-207 kernel: [21624.615025] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:24:10 juju-e4d256-prod-github-runner-207 kernel: [21624.615883] ? do_syscall_64+0x69/0xc0 Aug 22 11:24:10 juju-e4d256-prod-github-runner-207 kernel: [21624.616561] ? do_syscall_64+0x69/0xc0 Aug 22 11:24:10 juju-e4d256-prod-github-runner-207 kernel: [21624.617227] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 11:24:10 juju-e4d256-prod-github-runner-207 kernel: [21624.617942] RIP: 0033:0x7faa5d0edaff Aug 22 11:24:10 juju-e4d256-prod-github-runner-207 kernel: [21624.618573] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 11:24:10 juju-e4d256-prod-github-runner-207 kernel: [21624.620686] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 11:24:10 juju-e4d256-prod-github-runner-207 kernel: [21624.621666] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 11:24:10 juju-e4d256-prod-github-runner-207 kernel: [21624.622565] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 11:24:10 juju-e4d256-prod-github-runner-207 kernel: [21624.623467] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 11:24:10 juju-e4d256-prod-github-runner-207 kernel: [21624.624406] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 11:24:10 juju-e4d256-prod-github-runner-207 kernel: [21624.625351] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 11:24:10 juju-e4d256-prod-github-runner-207 kernel: [21624.626280] Aug 22 11:24:38 juju-e4d256-prod-github-runner-207 kernel: [21652.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 20057s! [qemu-system-x86:6715] Aug 22 11:24:38 juju-e4d256-prod-github-runner-207 kernel: [21652.543760] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 11:24:38 juju-e4d256-prod-github-runner-207 kernel: [21652.543994] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 11:24:38 juju-e4d256-prod-github-runner-207 kernel: [21652.556278] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 11:24:38 juju-e4d256-prod-github-runner-207 kernel: [21652.557567] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 11:24:38 juju-e4d256-prod-github-runner-207 kernel: [21652.558888] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:24:38 juju-e4d256-prod-github-runner-207 kernel: [21652.559958] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 11:24:38 juju-e4d256-prod-github-runner-207 kernel: [21652.562551] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 11:24:38 juju-e4d256-prod-github-runner-207 kernel: [21652.563602] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 11:24:38 juju-e4d256-prod-github-runner-207 kernel: [21652.564791] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 11:24:38 juju-e4d256-prod-github-runner-207 kernel: [21652.565970] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 11:24:38 juju-e4d256-prod-github-runner-207 kernel: [21652.567142] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 11:24:38 juju-e4d256-prod-github-runner-207 kernel: [21652.568313] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 11:24:38 juju-e4d256-prod-github-runner-207 kernel: [21652.569507] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 11:24:38 juju-e4d256-prod-github-runner-207 kernel: [21652.570751] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 11:24:38 juju-e4d256-prod-github-runner-207 kernel: [21652.571863] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 11:24:38 juju-e4d256-prod-github-runner-207 kernel: [21652.573080] Call Trace: Aug 22 11:24:38 juju-e4d256-prod-github-runner-207 kernel: [21652.574004] Aug 22 11:24:38 juju-e4d256-prod-github-runner-207 kernel: [21652.574900] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:24:38 juju-e4d256-prod-github-runner-207 kernel: [21652.575938] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:24:38 juju-e4d256-prod-github-runner-207 kernel: [21652.577002] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:24:38 juju-e4d256-prod-github-runner-207 kernel: [21652.578096] ? show_regs.part.0+0x23/0x29 Aug 22 11:24:38 juju-e4d256-prod-github-runner-207 kernel: [21652.579103] ? show_regs.cold+0x8/0xd Aug 22 11:24:38 juju-e4d256-prod-github-runner-207 kernel: [21652.580087] ? watchdog_timer_fn+0x1be/0x220 Aug 22 11:24:38 juju-e4d256-prod-github-runner-207 kernel: [21652.581122] ? lockup_detector_update_enable+0x60/0x60 Aug 22 11:24:38 juju-e4d256-prod-github-runner-207 kernel: [21652.582196] ? __hrtimer_run_queues+0x107/0x230 Aug 22 11:24:38 juju-e4d256-prod-github-runner-207 kernel: [21652.583237] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 11:24:38 juju-e4d256-prod-github-runner-207 kernel: [21652.584269] ? hrtimer_interrupt+0x101/0x220 Aug 22 11:24:38 juju-e4d256-prod-github-runner-207 kernel: [21652.585341] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 11:24:38 juju-e4d256-prod-github-runner-207 kernel: [21652.586514] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 11:24:38 juju-e4d256-prod-github-runner-207 kernel: [21652.587606] Aug 22 11:24:38 juju-e4d256-prod-github-runner-207 kernel: [21652.588505] Aug 22 11:24:38 juju-e4d256-prod-github-runner-207 kernel: [21652.589368] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 11:24:38 juju-e4d256-prod-github-runner-207 kernel: [21652.590416] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:24:38 juju-e4d256-prod-github-runner-207 kernel: [21652.591467] ? _raw_spin_lock+0x22/0x30 Aug 22 11:24:38 juju-e4d256-prod-github-runner-207 kernel: [21652.592422] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:24:38 juju-e4d256-prod-github-runner-207 kernel: [21652.593468] direct_page_fault+0x206/0x310 [kvm] Aug 22 11:24:38 juju-e4d256-prod-github-runner-207 kernel: [21652.594506] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 11:24:38 juju-e4d256-prod-github-runner-207 kernel: [21652.595525] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 11:24:38 juju-e4d256-prod-github-runner-207 kernel: [21652.596542] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 11:24:38 juju-e4d256-prod-github-runner-207 kernel: [21652.597553] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 11:24:38 juju-e4d256-prod-github-runner-207 kernel: [21652.598522] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 11:24:38 juju-e4d256-prod-github-runner-207 kernel: [21652.599523] handle_exit+0x98/0x230 [kvm_amd] Aug 22 11:24:38 juju-e4d256-prod-github-runner-207 kernel: [21652.600439] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 11:24:38 juju-e4d256-prod-github-runner-207 kernel: [21652.601372] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 11:24:38 juju-e4d256-prod-github-runner-207 kernel: [21652.602320] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 11:24:38 juju-e4d256-prod-github-runner-207 kernel: [21652.603237] vcpu_run+0x62/0x2c0 [kvm] Aug 22 11:24:38 juju-e4d256-prod-github-runner-207 kernel: [21652.604058] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 11:24:38 juju-e4d256-prod-github-runner-207 kernel: [21652.605767] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 11:24:38 juju-e4d256-prod-github-runner-207 kernel: [21652.606642] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 11:24:38 juju-e4d256-prod-github-runner-207 kernel: [21652.607448] ? __seccomp_filter+0x4a/0x4a0 Aug 22 11:24:38 juju-e4d256-prod-github-runner-207 kernel: [21652.608199] ? __fget_files+0x86/0xc0 Aug 22 11:24:38 juju-e4d256-prod-github-runner-207 kernel: [21652.608930] __x64_sys_ioctl+0x95/0xd0 Aug 22 11:24:38 juju-e4d256-prod-github-runner-207 kernel: [21652.609631] do_syscall_64+0x5c/0xc0 Aug 22 11:24:38 juju-e4d256-prod-github-runner-207 kernel: [21652.610311] ? do_futex+0x162/0x1f0 Aug 22 11:24:38 juju-e4d256-prod-github-runner-207 kernel: [21652.610969] ? __x64_sys_futex+0x78/0x1e0 Aug 22 11:24:38 juju-e4d256-prod-github-runner-207 kernel: [21652.611651] ? __secure_computing+0xa9/0x120 Aug 22 11:24:38 juju-e4d256-prod-github-runner-207 kernel: [21652.612351] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 11:24:38 juju-e4d256-prod-github-runner-207 kernel: [21652.613131] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:24:38 juju-e4d256-prod-github-runner-207 kernel: [21652.613864] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:24:38 juju-e4d256-prod-github-runner-207 kernel: [21652.614592] ? do_syscall_64+0x69/0xc0 Aug 22 11:24:38 juju-e4d256-prod-github-runner-207 kernel: [21652.615401] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:24:38 juju-e4d256-prod-github-runner-207 kernel: [21652.616116] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:24:38 juju-e4d256-prod-github-runner-207 kernel: [21652.616832] ? do_syscall_64+0x69/0xc0 Aug 22 11:24:38 juju-e4d256-prod-github-runner-207 kernel: [21652.617468] ? do_syscall_64+0x69/0xc0 Aug 22 11:24:38 juju-e4d256-prod-github-runner-207 kernel: [21652.618107] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 11:24:38 juju-e4d256-prod-github-runner-207 kernel: [21652.618824] RIP: 0033:0x7faa5d0edaff Aug 22 11:24:38 juju-e4d256-prod-github-runner-207 kernel: [21652.619685] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 11:24:38 juju-e4d256-prod-github-runner-207 kernel: [21652.621767] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 11:24:38 juju-e4d256-prod-github-runner-207 kernel: [21652.622707] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 11:24:38 juju-e4d256-prod-github-runner-207 kernel: [21652.623614] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 11:24:38 juju-e4d256-prod-github-runner-207 kernel: [21652.624516] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 11:24:38 juju-e4d256-prod-github-runner-207 kernel: [21652.625439] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 11:24:38 juju-e4d256-prod-github-runner-207 kernel: [21652.626345] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 11:24:38 juju-e4d256-prod-github-runner-207 kernel: [21652.627261] Aug 22 11:25:06 juju-e4d256-prod-github-runner-207 kernel: [21680.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 20083s! [qemu-system-x86:6715] Aug 22 11:25:06 juju-e4d256-prod-github-runner-207 kernel: [21680.543090] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 11:25:06 juju-e4d256-prod-github-runner-207 kernel: [21680.543163] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 11:25:06 juju-e4d256-prod-github-runner-207 kernel: [21680.555449] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 11:25:06 juju-e4d256-prod-github-runner-207 kernel: [21680.556733] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 11:25:06 juju-e4d256-prod-github-runner-207 kernel: [21680.557964] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:25:06 juju-e4d256-prod-github-runner-207 kernel: [21680.559031] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 11:25:06 juju-e4d256-prod-github-runner-207 kernel: [21680.561732] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 11:25:06 juju-e4d256-prod-github-runner-207 kernel: [21680.562776] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 11:25:06 juju-e4d256-prod-github-runner-207 kernel: [21680.563954] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 11:25:06 juju-e4d256-prod-github-runner-207 kernel: [21680.565154] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 11:25:06 juju-e4d256-prod-github-runner-207 kernel: [21680.566318] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 11:25:06 juju-e4d256-prod-github-runner-207 kernel: [21680.567475] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 11:25:06 juju-e4d256-prod-github-runner-207 kernel: [21680.568650] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 11:25:06 juju-e4d256-prod-github-runner-207 kernel: [21680.569880] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 11:25:06 juju-e4d256-prod-github-runner-207 kernel: [21680.570979] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 11:25:06 juju-e4d256-prod-github-runner-207 kernel: [21680.572188] Call Trace: Aug 22 11:25:06 juju-e4d256-prod-github-runner-207 kernel: [21680.573117] Aug 22 11:25:06 juju-e4d256-prod-github-runner-207 kernel: [21680.574005] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:25:06 juju-e4d256-prod-github-runner-207 kernel: [21680.575031] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:25:06 juju-e4d256-prod-github-runner-207 kernel: [21680.576049] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:25:06 juju-e4d256-prod-github-runner-207 kernel: [21680.577132] ? show_regs.part.0+0x23/0x29 Aug 22 11:25:06 juju-e4d256-prod-github-runner-207 kernel: [21680.578136] ? show_regs.cold+0x8/0xd Aug 22 11:25:06 juju-e4d256-prod-github-runner-207 kernel: [21680.579121] ? watchdog_timer_fn+0x1be/0x220 Aug 22 11:25:06 juju-e4d256-prod-github-runner-207 kernel: [21680.580136] ? lockup_detector_update_enable+0x60/0x60 Aug 22 11:25:06 juju-e4d256-prod-github-runner-207 kernel: [21680.581222] ? __hrtimer_run_queues+0x107/0x230 Aug 22 11:25:06 juju-e4d256-prod-github-runner-207 kernel: [21680.582257] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 11:25:06 juju-e4d256-prod-github-runner-207 kernel: [21680.583284] ? hrtimer_interrupt+0x101/0x220 Aug 22 11:25:06 juju-e4d256-prod-github-runner-207 kernel: [21680.584325] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 11:25:06 juju-e4d256-prod-github-runner-207 kernel: [21680.585481] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 11:25:06 juju-e4d256-prod-github-runner-207 kernel: [21680.586565] Aug 22 11:25:06 juju-e4d256-prod-github-runner-207 kernel: [21680.587439] Aug 22 11:25:06 juju-e4d256-prod-github-runner-207 kernel: [21680.588314] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 11:25:06 juju-e4d256-prod-github-runner-207 kernel: [21680.589359] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:25:06 juju-e4d256-prod-github-runner-207 kernel: [21680.590405] ? _raw_spin_lock+0x22/0x30 Aug 22 11:25:06 juju-e4d256-prod-github-runner-207 kernel: [21680.591349] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:25:06 juju-e4d256-prod-github-runner-207 kernel: [21680.592372] direct_page_fault+0x206/0x310 [kvm] Aug 22 11:25:06 juju-e4d256-prod-github-runner-207 kernel: [21680.593400] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 11:25:06 juju-e4d256-prod-github-runner-207 kernel: [21680.594414] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 11:25:06 juju-e4d256-prod-github-runner-207 kernel: [21680.595435] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 11:25:06 juju-e4d256-prod-github-runner-207 kernel: [21680.596440] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 11:25:06 juju-e4d256-prod-github-runner-207 kernel: [21680.597388] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 11:25:06 juju-e4d256-prod-github-runner-207 kernel: [21680.598367] handle_exit+0x98/0x230 [kvm_amd] Aug 22 11:25:06 juju-e4d256-prod-github-runner-207 kernel: [21680.599272] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 11:25:06 juju-e4d256-prod-github-runner-207 kernel: [21680.600183] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 11:25:06 juju-e4d256-prod-github-runner-207 kernel: [21680.601145] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 11:25:06 juju-e4d256-prod-github-runner-207 kernel: [21680.602057] vcpu_run+0x62/0x2c0 [kvm] Aug 22 11:25:06 juju-e4d256-prod-github-runner-207 kernel: [21680.602875] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 11:25:06 juju-e4d256-prod-github-runner-207 kernel: [21680.603689] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 11:25:06 juju-e4d256-prod-github-runner-207 kernel: [21680.604573] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 11:25:06 juju-e4d256-prod-github-runner-207 kernel: [21680.605375] ? __seccomp_filter+0x4a/0x4a0 Aug 22 11:25:06 juju-e4d256-prod-github-runner-207 kernel: [21680.606124] ? __fget_files+0x86/0xc0 Aug 22 11:25:06 juju-e4d256-prod-github-runner-207 kernel: [21680.606827] __x64_sys_ioctl+0x95/0xd0 Aug 22 11:25:06 juju-e4d256-prod-github-runner-207 kernel: [21680.607541] do_syscall_64+0x5c/0xc0 Aug 22 11:25:06 juju-e4d256-prod-github-runner-207 kernel: [21680.608224] ? do_futex+0x162/0x1f0 Aug 22 11:25:06 juju-e4d256-prod-github-runner-207 kernel: [21680.608887] ? __x64_sys_futex+0x78/0x1e0 Aug 22 11:25:06 juju-e4d256-prod-github-runner-207 kernel: [21680.609575] ? __secure_computing+0xa9/0x120 Aug 22 11:25:06 juju-e4d256-prod-github-runner-207 kernel: [21680.610265] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 11:25:06 juju-e4d256-prod-github-runner-207 kernel: [21680.611078] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:25:06 juju-e4d256-prod-github-runner-207 kernel: [21680.611802] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:25:06 juju-e4d256-prod-github-runner-207 kernel: [21680.612541] ? do_syscall_64+0x69/0xc0 Aug 22 11:25:06 juju-e4d256-prod-github-runner-207 kernel: [21680.613264] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:25:06 juju-e4d256-prod-github-runner-207 kernel: [21680.613971] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:25:06 juju-e4d256-prod-github-runner-207 kernel: [21680.614674] ? do_syscall_64+0x69/0xc0 Aug 22 11:25:06 juju-e4d256-prod-github-runner-207 kernel: [21680.615304] ? do_syscall_64+0x69/0xc0 Aug 22 11:25:06 juju-e4d256-prod-github-runner-207 kernel: [21680.615925] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 11:25:06 juju-e4d256-prod-github-runner-207 kernel: [21680.616638] RIP: 0033:0x7faa5d0edaff Aug 22 11:25:06 juju-e4d256-prod-github-runner-207 kernel: [21680.617267] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 11:25:06 juju-e4d256-prod-github-runner-207 kernel: [21680.619257] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 11:25:06 juju-e4d256-prod-github-runner-207 kernel: [21680.620171] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 11:25:06 juju-e4d256-prod-github-runner-207 kernel: [21680.621066] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 11:25:06 juju-e4d256-prod-github-runner-207 kernel: [21680.621954] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 11:25:06 juju-e4d256-prod-github-runner-207 kernel: [21680.622839] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 11:25:06 juju-e4d256-prod-github-runner-207 kernel: [21680.623726] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 11:25:06 juju-e4d256-prod-github-runner-207 kernel: [21680.624632] Aug 22 11:25:34 juju-e4d256-prod-github-runner-207 kernel: [21708.541980] watchdog: BUG: soft lockup - CPU#1 stuck for 20109s! [qemu-system-x86:6715] Aug 22 11:25:34 juju-e4d256-prod-github-runner-207 kernel: [21708.543231] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 11:25:34 juju-e4d256-prod-github-runner-207 kernel: [21708.543497] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 11:25:34 juju-e4d256-prod-github-runner-207 kernel: [21708.555846] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 11:25:34 juju-e4d256-prod-github-runner-207 kernel: [21708.557140] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 11:25:34 juju-e4d256-prod-github-runner-207 kernel: [21708.558359] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:25:34 juju-e4d256-prod-github-runner-207 kernel: [21708.559416] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 11:25:34 juju-e4d256-prod-github-runner-207 kernel: [21708.562023] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 11:25:34 juju-e4d256-prod-github-runner-207 kernel: [21708.563070] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 11:25:34 juju-e4d256-prod-github-runner-207 kernel: [21708.564254] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 11:25:34 juju-e4d256-prod-github-runner-207 kernel: [21708.565414] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 11:25:34 juju-e4d256-prod-github-runner-207 kernel: [21708.566575] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 11:25:34 juju-e4d256-prod-github-runner-207 kernel: [21708.567770] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 11:25:34 juju-e4d256-prod-github-runner-207 kernel: [21708.569020] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 11:25:34 juju-e4d256-prod-github-runner-207 kernel: [21708.570307] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 11:25:34 juju-e4d256-prod-github-runner-207 kernel: [21708.571478] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 11:25:34 juju-e4d256-prod-github-runner-207 kernel: [21708.572715] Call Trace: Aug 22 11:25:34 juju-e4d256-prod-github-runner-207 kernel: [21708.573632] Aug 22 11:25:34 juju-e4d256-prod-github-runner-207 kernel: [21708.574548] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:25:34 juju-e4d256-prod-github-runner-207 kernel: [21708.575577] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:25:34 juju-e4d256-prod-github-runner-207 kernel: [21708.576627] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:25:34 juju-e4d256-prod-github-runner-207 kernel: [21708.577725] ? show_regs.part.0+0x23/0x29 Aug 22 11:25:34 juju-e4d256-prod-github-runner-207 kernel: [21708.578723] ? show_regs.cold+0x8/0xd Aug 22 11:25:34 juju-e4d256-prod-github-runner-207 kernel: [21708.579693] ? watchdog_timer_fn+0x1be/0x220 Aug 22 11:25:34 juju-e4d256-prod-github-runner-207 kernel: [21708.580722] ? lockup_detector_update_enable+0x60/0x60 Aug 22 11:25:34 juju-e4d256-prod-github-runner-207 kernel: [21708.581787] ? __hrtimer_run_queues+0x107/0x230 Aug 22 11:25:34 juju-e4d256-prod-github-runner-207 kernel: [21708.582815] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 11:25:34 juju-e4d256-prod-github-runner-207 kernel: [21708.583839] ? hrtimer_interrupt+0x101/0x220 Aug 22 11:25:34 juju-e4d256-prod-github-runner-207 kernel: [21708.584882] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 11:25:34 juju-e4d256-prod-github-runner-207 kernel: [21708.585952] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 11:25:34 juju-e4d256-prod-github-runner-207 kernel: [21708.586999] Aug 22 11:25:34 juju-e4d256-prod-github-runner-207 kernel: [21708.587856] Aug 22 11:25:34 juju-e4d256-prod-github-runner-207 kernel: [21708.588727] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 11:25:34 juju-e4d256-prod-github-runner-207 kernel: [21708.589855] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:25:34 juju-e4d256-prod-github-runner-207 kernel: [21708.590929] ? _raw_spin_lock+0x22/0x30 Aug 22 11:25:34 juju-e4d256-prod-github-runner-207 kernel: [21708.591890] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:25:34 juju-e4d256-prod-github-runner-207 kernel: [21708.592930] direct_page_fault+0x206/0x310 [kvm] Aug 22 11:25:34 juju-e4d256-prod-github-runner-207 kernel: [21708.593960] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 11:25:34 juju-e4d256-prod-github-runner-207 kernel: [21708.594990] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 11:25:34 juju-e4d256-prod-github-runner-207 kernel: [21708.596025] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 11:25:34 juju-e4d256-prod-github-runner-207 kernel: [21708.597053] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 11:25:34 juju-e4d256-prod-github-runner-207 kernel: [21708.598032] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 11:25:34 juju-e4d256-prod-github-runner-207 kernel: [21708.599015] handle_exit+0x98/0x230 [kvm_amd] Aug 22 11:25:34 juju-e4d256-prod-github-runner-207 kernel: [21708.599942] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 11:25:34 juju-e4d256-prod-github-runner-207 kernel: [21708.600863] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 11:25:34 juju-e4d256-prod-github-runner-207 kernel: [21708.601796] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 11:25:34 juju-e4d256-prod-github-runner-207 kernel: [21708.602705] vcpu_run+0x62/0x2c0 [kvm] Aug 22 11:25:34 juju-e4d256-prod-github-runner-207 kernel: [21708.603528] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 11:25:34 juju-e4d256-prod-github-runner-207 kernel: [21708.604403] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 11:25:34 juju-e4d256-prod-github-runner-207 kernel: [21708.605274] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 11:25:34 juju-e4d256-prod-github-runner-207 kernel: [21708.606079] ? __seccomp_filter+0x4a/0x4a0 Aug 22 11:25:34 juju-e4d256-prod-github-runner-207 kernel: [21708.606825] ? __fget_files+0x86/0xc0 Aug 22 11:25:34 juju-e4d256-prod-github-runner-207 kernel: [21708.607524] __x64_sys_ioctl+0x95/0xd0 Aug 22 11:25:34 juju-e4d256-prod-github-runner-207 kernel: [21708.608239] do_syscall_64+0x5c/0xc0 Aug 22 11:25:34 juju-e4d256-prod-github-runner-207 kernel: [21708.608905] ? do_futex+0x162/0x1f0 Aug 22 11:25:34 juju-e4d256-prod-github-runner-207 kernel: [21708.609553] ? __x64_sys_futex+0x78/0x1e0 Aug 22 11:25:34 juju-e4d256-prod-github-runner-207 kernel: [21708.610234] ? __secure_computing+0xa9/0x120 Aug 22 11:25:34 juju-e4d256-prod-github-runner-207 kernel: [21708.610926] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 11:25:34 juju-e4d256-prod-github-runner-207 kernel: [21708.611682] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:25:34 juju-e4d256-prod-github-runner-207 kernel: [21708.612458] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:25:34 juju-e4d256-prod-github-runner-207 kernel: [21708.613190] ? do_syscall_64+0x69/0xc0 Aug 22 11:25:34 juju-e4d256-prod-github-runner-207 kernel: [21708.613862] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:25:34 juju-e4d256-prod-github-runner-207 kernel: [21708.614566] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:25:34 juju-e4d256-prod-github-runner-207 kernel: [21708.615351] ? do_syscall_64+0x69/0xc0 Aug 22 11:25:34 juju-e4d256-prod-github-runner-207 kernel: [21708.616017] ? do_syscall_64+0x69/0xc0 Aug 22 11:25:34 juju-e4d256-prod-github-runner-207 kernel: [21708.616648] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 11:25:34 juju-e4d256-prod-github-runner-207 kernel: [21708.617363] RIP: 0033:0x7faa5d0edaff Aug 22 11:25:34 juju-e4d256-prod-github-runner-207 kernel: [21708.618029] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 11:25:34 juju-e4d256-prod-github-runner-207 kernel: [21708.620053] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 11:25:34 juju-e4d256-prod-github-runner-207 kernel: [21708.620965] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 11:25:34 juju-e4d256-prod-github-runner-207 kernel: [21708.621860] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 11:25:34 juju-e4d256-prod-github-runner-207 kernel: [21708.622749] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 11:25:34 juju-e4d256-prod-github-runner-207 kernel: [21708.623637] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 11:25:34 juju-e4d256-prod-github-runner-207 kernel: [21708.624540] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 11:25:34 juju-e4d256-prod-github-runner-207 kernel: [21708.625437] Aug 22 11:26:02 juju-e4d256-prod-github-runner-207 kernel: [21736.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 20135s! [qemu-system-x86:6715] Aug 22 11:26:02 juju-e4d256-prod-github-runner-207 kernel: [21736.543878] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 11:26:02 juju-e4d256-prod-github-runner-207 kernel: [21736.544056] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 11:26:02 juju-e4d256-prod-github-runner-207 kernel: [21736.556565] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 11:26:02 juju-e4d256-prod-github-runner-207 kernel: [21736.557991] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 11:26:02 juju-e4d256-prod-github-runner-207 kernel: [21736.559286] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:26:02 juju-e4d256-prod-github-runner-207 kernel: [21736.560396] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 11:26:02 juju-e4d256-prod-github-runner-207 kernel: [21736.563078] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 11:26:02 juju-e4d256-prod-github-runner-207 kernel: [21736.564211] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 11:26:02 juju-e4d256-prod-github-runner-207 kernel: [21736.565415] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 11:26:02 juju-e4d256-prod-github-runner-207 kernel: [21736.566592] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 11:26:02 juju-e4d256-prod-github-runner-207 kernel: [21736.567824] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 11:26:02 juju-e4d256-prod-github-runner-207 kernel: [21736.569011] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 11:26:02 juju-e4d256-prod-github-runner-207 kernel: [21736.570200] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 11:26:02 juju-e4d256-prod-github-runner-207 kernel: [21736.571539] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 11:26:02 juju-e4d256-prod-github-runner-207 kernel: [21736.572778] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 11:26:02 juju-e4d256-prod-github-runner-207 kernel: [21736.574003] Call Trace: Aug 22 11:26:02 juju-e4d256-prod-github-runner-207 kernel: [21736.574926] Aug 22 11:26:02 juju-e4d256-prod-github-runner-207 kernel: [21736.575850] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:26:02 juju-e4d256-prod-github-runner-207 kernel: [21736.577041] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:26:02 juju-e4d256-prod-github-runner-207 kernel: [21736.578190] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:26:02 juju-e4d256-prod-github-runner-207 kernel: [21736.579275] ? show_regs.part.0+0x23/0x29 Aug 22 11:26:02 juju-e4d256-prod-github-runner-207 kernel: [21736.580312] ? show_regs.cold+0x8/0xd Aug 22 11:26:02 juju-e4d256-prod-github-runner-207 kernel: [21736.581335] ? watchdog_timer_fn+0x1be/0x220 Aug 22 11:26:02 juju-e4d256-prod-github-runner-207 kernel: [21736.582385] ? lockup_detector_update_enable+0x60/0x60 Aug 22 11:26:02 juju-e4d256-prod-github-runner-207 kernel: [21736.583456] ? __hrtimer_run_queues+0x107/0x230 Aug 22 11:26:02 juju-e4d256-prod-github-runner-207 kernel: [21736.584512] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 11:26:02 juju-e4d256-prod-github-runner-207 kernel: [21736.585535] ? hrtimer_interrupt+0x101/0x220 Aug 22 11:26:02 juju-e4d256-prod-github-runner-207 kernel: [21736.586551] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 11:26:02 juju-e4d256-prod-github-runner-207 kernel: [21736.587651] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 11:26:02 juju-e4d256-prod-github-runner-207 kernel: [21736.588701] Aug 22 11:26:02 juju-e4d256-prod-github-runner-207 kernel: [21736.589555] Aug 22 11:26:02 juju-e4d256-prod-github-runner-207 kernel: [21736.590397] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 11:26:02 juju-e4d256-prod-github-runner-207 kernel: [21736.591430] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:26:02 juju-e4d256-prod-github-runner-207 kernel: [21736.592482] ? _raw_spin_lock+0x22/0x30 Aug 22 11:26:02 juju-e4d256-prod-github-runner-207 kernel: [21736.593427] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:26:02 juju-e4d256-prod-github-runner-207 kernel: [21736.594445] direct_page_fault+0x206/0x310 [kvm] Aug 22 11:26:02 juju-e4d256-prod-github-runner-207 kernel: [21736.595467] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 11:26:02 juju-e4d256-prod-github-runner-207 kernel: [21736.596509] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 11:26:02 juju-e4d256-prod-github-runner-207 kernel: [21736.597511] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 11:26:02 juju-e4d256-prod-github-runner-207 kernel: [21736.598505] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 11:26:02 juju-e4d256-prod-github-runner-207 kernel: [21736.599453] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 11:26:02 juju-e4d256-prod-github-runner-207 kernel: [21736.600454] handle_exit+0x98/0x230 [kvm_amd] Aug 22 11:26:02 juju-e4d256-prod-github-runner-207 kernel: [21736.601373] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 11:26:02 juju-e4d256-prod-github-runner-207 kernel: [21736.602293] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 11:26:02 juju-e4d256-prod-github-runner-207 kernel: [21736.603215] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 11:26:02 juju-e4d256-prod-github-runner-207 kernel: [21736.604138] vcpu_run+0x62/0x2c0 [kvm] Aug 22 11:26:02 juju-e4d256-prod-github-runner-207 kernel: [21736.604950] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 11:26:02 juju-e4d256-prod-github-runner-207 kernel: [21736.605756] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 11:26:02 juju-e4d256-prod-github-runner-207 kernel: [21736.606747] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 11:26:02 juju-e4d256-prod-github-runner-207 kernel: [21736.607544] ? __seccomp_filter+0x4a/0x4a0 Aug 22 11:26:02 juju-e4d256-prod-github-runner-207 kernel: [21736.608423] ? __fget_files+0x86/0xc0 Aug 22 11:26:02 juju-e4d256-prod-github-runner-207 kernel: [21736.609131] __x64_sys_ioctl+0x95/0xd0 Aug 22 11:26:02 juju-e4d256-prod-github-runner-207 kernel: [21736.609824] do_syscall_64+0x5c/0xc0 Aug 22 11:26:02 juju-e4d256-prod-github-runner-207 kernel: [21736.610486] ? do_futex+0x162/0x1f0 Aug 22 11:26:02 juju-e4d256-prod-github-runner-207 kernel: [21736.611134] ? __x64_sys_futex+0x78/0x1e0 Aug 22 11:26:02 juju-e4d256-prod-github-runner-207 kernel: [21736.611822] ? __secure_computing+0xa9/0x120 Aug 22 11:26:02 juju-e4d256-prod-github-runner-207 kernel: [21736.612512] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 11:26:02 juju-e4d256-prod-github-runner-207 kernel: [21736.613278] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:26:02 juju-e4d256-prod-github-runner-207 kernel: [21736.614002] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:26:02 juju-e4d256-prod-github-runner-207 kernel: [21736.614719] ? do_syscall_64+0x69/0xc0 Aug 22 11:26:02 juju-e4d256-prod-github-runner-207 kernel: [21736.615362] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:26:02 juju-e4d256-prod-github-runner-207 kernel: [21736.616079] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:26:02 juju-e4d256-prod-github-runner-207 kernel: [21736.616774] ? do_syscall_64+0x69/0xc0 Aug 22 11:26:02 juju-e4d256-prod-github-runner-207 kernel: [21736.617398] ? do_syscall_64+0x69/0xc0 Aug 22 11:26:02 juju-e4d256-prod-github-runner-207 kernel: [21736.618025] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 11:26:02 juju-e4d256-prod-github-runner-207 kernel: [21736.618761] RIP: 0033:0x7faa5d0edaff Aug 22 11:26:02 juju-e4d256-prod-github-runner-207 kernel: [21736.619399] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 11:26:02 juju-e4d256-prod-github-runner-207 kernel: [21736.621407] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 11:26:02 juju-e4d256-prod-github-runner-207 kernel: [21736.622339] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 11:26:02 juju-e4d256-prod-github-runner-207 kernel: [21736.623228] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 11:26:02 juju-e4d256-prod-github-runner-207 kernel: [21736.624135] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 11:26:02 juju-e4d256-prod-github-runner-207 kernel: [21736.625026] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 11:26:02 juju-e4d256-prod-github-runner-207 kernel: [21736.625913] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 11:26:02 juju-e4d256-prod-github-runner-207 kernel: [21736.626809] Aug 22 11:26:30 juju-e4d256-prod-github-runner-207 kernel: [21764.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 20161s! [qemu-system-x86:6715] Aug 22 11:26:30 juju-e4d256-prod-github-runner-207 kernel: [21764.543105] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 11:26:30 juju-e4d256-prod-github-runner-207 kernel: [21764.543179] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 11:26:30 juju-e4d256-prod-github-runner-207 kernel: [21764.555416] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 11:26:30 juju-e4d256-prod-github-runner-207 kernel: [21764.556682] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 11:26:30 juju-e4d256-prod-github-runner-207 kernel: [21764.557903] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:26:30 juju-e4d256-prod-github-runner-207 kernel: [21764.558975] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 11:26:30 juju-e4d256-prod-github-runner-207 kernel: [21764.561566] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 11:26:30 juju-e4d256-prod-github-runner-207 kernel: [21764.562616] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 11:26:30 juju-e4d256-prod-github-runner-207 kernel: [21764.563796] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 11:26:30 juju-e4d256-prod-github-runner-207 kernel: [21764.564964] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 11:26:30 juju-e4d256-prod-github-runner-207 kernel: [21764.566122] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 11:26:30 juju-e4d256-prod-github-runner-207 kernel: [21764.567306] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 11:26:30 juju-e4d256-prod-github-runner-207 kernel: [21764.568469] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 11:26:30 juju-e4d256-prod-github-runner-207 kernel: [21764.569704] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 11:26:30 juju-e4d256-prod-github-runner-207 kernel: [21764.570803] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 11:26:30 juju-e4d256-prod-github-runner-207 kernel: [21764.572018] Call Trace: Aug 22 11:26:30 juju-e4d256-prod-github-runner-207 kernel: [21764.572929] Aug 22 11:26:30 juju-e4d256-prod-github-runner-207 kernel: [21764.573812] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:26:30 juju-e4d256-prod-github-runner-207 kernel: [21764.574847] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:26:30 juju-e4d256-prod-github-runner-207 kernel: [21764.575896] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:26:30 juju-e4d256-prod-github-runner-207 kernel: [21764.576974] ? show_regs.part.0+0x23/0x29 Aug 22 11:26:30 juju-e4d256-prod-github-runner-207 kernel: [21764.577974] ? show_regs.cold+0x8/0xd Aug 22 11:26:30 juju-e4d256-prod-github-runner-207 kernel: [21764.578942] ? watchdog_timer_fn+0x1be/0x220 Aug 22 11:26:30 juju-e4d256-prod-github-runner-207 kernel: [21764.579971] ? lockup_detector_update_enable+0x60/0x60 Aug 22 11:26:30 juju-e4d256-prod-github-runner-207 kernel: [21764.581032] ? __hrtimer_run_queues+0x107/0x230 Aug 22 11:26:30 juju-e4d256-prod-github-runner-207 kernel: [21764.582057] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 11:26:30 juju-e4d256-prod-github-runner-207 kernel: [21764.583077] ? hrtimer_interrupt+0x101/0x220 Aug 22 11:26:30 juju-e4d256-prod-github-runner-207 kernel: [21764.584102] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 11:26:30 juju-e4d256-prod-github-runner-207 kernel: [21764.585167] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 11:26:30 juju-e4d256-prod-github-runner-207 kernel: [21764.586210] Aug 22 11:26:30 juju-e4d256-prod-github-runner-207 kernel: [21764.587061] Aug 22 11:26:30 juju-e4d256-prod-github-runner-207 kernel: [21764.587905] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 11:26:30 juju-e4d256-prod-github-runner-207 kernel: [21764.588934] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:26:30 juju-e4d256-prod-github-runner-207 kernel: [21764.589970] ? _raw_spin_lock+0x22/0x30 Aug 22 11:26:30 juju-e4d256-prod-github-runner-207 kernel: [21764.590912] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:26:30 juju-e4d256-prod-github-runner-207 kernel: [21764.591939] direct_page_fault+0x206/0x310 [kvm] Aug 22 11:26:30 juju-e4d256-prod-github-runner-207 kernel: [21764.592965] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 11:26:30 juju-e4d256-prod-github-runner-207 kernel: [21764.593970] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 11:26:30 juju-e4d256-prod-github-runner-207 kernel: [21764.594971] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 11:26:30 juju-e4d256-prod-github-runner-207 kernel: [21764.595959] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 11:26:30 juju-e4d256-prod-github-runner-207 kernel: [21764.596902] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 11:26:30 juju-e4d256-prod-github-runner-207 kernel: [21764.597877] handle_exit+0x98/0x230 [kvm_amd] Aug 22 11:26:30 juju-e4d256-prod-github-runner-207 kernel: [21764.598766] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 11:26:30 juju-e4d256-prod-github-runner-207 kernel: [21764.599690] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 11:26:30 juju-e4d256-prod-github-runner-207 kernel: [21764.600613] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 11:26:30 juju-e4d256-prod-github-runner-207 kernel: [21764.601560] vcpu_run+0x62/0x2c0 [kvm] Aug 22 11:26:30 juju-e4d256-prod-github-runner-207 kernel: [21764.602371] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 11:26:30 juju-e4d256-prod-github-runner-207 kernel: [21764.603177] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 11:26:30 juju-e4d256-prod-github-runner-207 kernel: [21764.604043] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 11:26:30 juju-e4d256-prod-github-runner-207 kernel: [21764.604845] ? __seccomp_filter+0x4a/0x4a0 Aug 22 11:26:30 juju-e4d256-prod-github-runner-207 kernel: [21764.605595] ? __fget_files+0x86/0xc0 Aug 22 11:26:30 juju-e4d256-prod-github-runner-207 kernel: [21764.606296] __x64_sys_ioctl+0x95/0xd0 Aug 22 11:26:30 juju-e4d256-prod-github-runner-207 kernel: [21764.606992] do_syscall_64+0x5c/0xc0 Aug 22 11:26:30 juju-e4d256-prod-github-runner-207 kernel: [21764.607674] ? do_futex+0x162/0x1f0 Aug 22 11:26:30 juju-e4d256-prod-github-runner-207 kernel: [21764.608322] ? __x64_sys_futex+0x78/0x1e0 Aug 22 11:26:30 juju-e4d256-prod-github-runner-207 kernel: [21764.608998] ? __secure_computing+0xa9/0x120 Aug 22 11:26:30 juju-e4d256-prod-github-runner-207 kernel: [21764.609686] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 11:26:30 juju-e4d256-prod-github-runner-207 kernel: [21764.610442] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:26:30 juju-e4d256-prod-github-runner-207 kernel: [21764.611161] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:26:30 juju-e4d256-prod-github-runner-207 kernel: [21764.611898] ? do_syscall_64+0x69/0xc0 Aug 22 11:26:30 juju-e4d256-prod-github-runner-207 kernel: [21764.612540] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:26:30 juju-e4d256-prod-github-runner-207 kernel: [21764.613240] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:26:30 juju-e4d256-prod-github-runner-207 kernel: [21764.613931] ? do_syscall_64+0x69/0xc0 Aug 22 11:26:30 juju-e4d256-prod-github-runner-207 kernel: [21764.614553] ? do_syscall_64+0x69/0xc0 Aug 22 11:26:30 juju-e4d256-prod-github-runner-207 kernel: [21764.615172] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 11:26:30 juju-e4d256-prod-github-runner-207 kernel: [21764.615892] RIP: 0033:0x7faa5d0edaff Aug 22 11:26:30 juju-e4d256-prod-github-runner-207 kernel: [21764.616514] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 11:26:30 juju-e4d256-prod-github-runner-207 kernel: [21764.618495] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 11:26:30 juju-e4d256-prod-github-runner-207 kernel: [21764.619431] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 11:26:30 juju-e4d256-prod-github-runner-207 kernel: [21764.620317] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 11:26:30 juju-e4d256-prod-github-runner-207 kernel: [21764.621203] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 11:26:30 juju-e4d256-prod-github-runner-207 kernel: [21764.622094] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 11:26:30 juju-e4d256-prod-github-runner-207 kernel: [21764.622979] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 11:26:30 juju-e4d256-prod-github-runner-207 kernel: [21764.623878] Aug 22 11:26:44 juju-e4d256-prod-github-runner-207 kernel: [21778.640706] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 11:26:44 juju-e4d256-prod-github-runner-207 kernel: [21778.641652] rcu: 1-....: (5398440 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=2613673 Aug 22 11:26:44 juju-e4d256-prod-github-runner-207 kernel: [21778.643180] (t=5415360 jiffies g=23269 q=27439) Aug 22 11:26:44 juju-e4d256-prod-github-runner-207 kernel: [21778.644357] NMI backtrace for cpu 1 Aug 22 11:26:44 juju-e4d256-prod-github-runner-207 kernel: [21778.645191] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 11:26:44 juju-e4d256-prod-github-runner-207 kernel: [21778.646407] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 11:26:44 juju-e4d256-prod-github-runner-207 kernel: [21778.647540] Call Trace: Aug 22 11:26:44 juju-e4d256-prod-github-runner-207 kernel: [21778.648222] Aug 22 11:26:44 juju-e4d256-prod-github-runner-207 kernel: [21778.648867] show_stack+0x52/0x5c Aug 22 11:26:44 juju-e4d256-prod-github-runner-207 kernel: [21778.649598] dump_stack_lvl+0x4a/0x63 Aug 22 11:26:44 juju-e4d256-prod-github-runner-207 kernel: [21778.650344] dump_stack+0x10/0x16 Aug 22 11:26:44 juju-e4d256-prod-github-runner-207 kernel: [21778.651076] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 11:26:44 juju-e4d256-prod-github-runner-207 kernel: [21778.651856] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 11:26:44 juju-e4d256-prod-github-runner-207 kernel: [21778.652631] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 11:26:44 juju-e4d256-prod-github-runner-207 kernel: [21778.653446] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 11:26:44 juju-e4d256-prod-github-runner-207 kernel: [21778.654262] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 11:26:44 juju-e4d256-prod-github-runner-207 kernel: [21778.655088] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 11:26:44 juju-e4d256-prod-github-runner-207 kernel: [21778.655858] print_cpu_stall.cold+0x2f/0xe2 Aug 22 11:26:44 juju-e4d256-prod-github-runner-207 kernel: [21778.656623] ? timekeeping_update+0xf7/0x150 Aug 22 11:26:44 juju-e4d256-prod-github-runner-207 kernel: [21778.657392] check_cpu_stall+0x109/0x270 Aug 22 11:26:44 juju-e4d256-prod-github-runner-207 kernel: [21778.658136] rcu_sched_clock_irq+0x9a/0x250 Aug 22 11:26:44 juju-e4d256-prod-github-runner-207 kernel: [21778.658954] update_process_times+0x94/0xd0 Aug 22 11:26:44 juju-e4d256-prod-github-runner-207 kernel: [21778.659758] tick_sched_handle+0x29/0x70 Aug 22 11:26:44 juju-e4d256-prod-github-runner-207 kernel: [21778.660500] tick_sched_timer+0x8c/0xc0 Aug 22 11:26:44 juju-e4d256-prod-github-runner-207 kernel: [21778.661235] ? tick_nohz_handler+0xb0/0xb0 Aug 22 11:26:44 juju-e4d256-prod-github-runner-207 kernel: [21778.662000] __hrtimer_run_queues+0x107/0x230 Aug 22 11:26:44 juju-e4d256-prod-github-runner-207 kernel: [21778.663033] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 11:26:44 juju-e4d256-prod-github-runner-207 kernel: [21778.664078] hrtimer_interrupt+0x101/0x220 Aug 22 11:26:44 juju-e4d256-prod-github-runner-207 kernel: [21778.664838] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 11:26:44 juju-e4d256-prod-github-runner-207 kernel: [21778.665646] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 11:26:44 juju-e4d256-prod-github-runner-207 kernel: [21778.666445] Aug 22 11:26:44 juju-e4d256-prod-github-runner-207 kernel: [21778.667089] Aug 22 11:26:44 juju-e4d256-prod-github-runner-207 kernel: [21778.667715] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 11:26:44 juju-e4d256-prod-github-runner-207 kernel: [21778.668531] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:26:44 juju-e4d256-prod-github-runner-207 kernel: [21778.669405] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 11:26:44 juju-e4d256-prod-github-runner-207 kernel: [21778.671618] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 11:26:44 juju-e4d256-prod-github-runner-207 kernel: [21778.672489] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 11:26:44 juju-e4d256-prod-github-runner-207 kernel: [21778.673479] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 11:26:44 juju-e4d256-prod-github-runner-207 kernel: [21778.674452] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 11:26:44 juju-e4d256-prod-github-runner-207 kernel: [21778.675425] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 11:26:44 juju-e4d256-prod-github-runner-207 kernel: [21778.676398] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 11:26:44 juju-e4d256-prod-github-runner-207 kernel: [21778.677349] ? _raw_spin_lock+0x22/0x30 Aug 22 11:26:44 juju-e4d256-prod-github-runner-207 kernel: [21778.678110] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:26:44 juju-e4d256-prod-github-runner-207 kernel: [21778.678946] direct_page_fault+0x206/0x310 [kvm] Aug 22 11:26:44 juju-e4d256-prod-github-runner-207 kernel: [21778.679818] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 11:26:44 juju-e4d256-prod-github-runner-207 kernel: [21778.680651] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 11:26:44 juju-e4d256-prod-github-runner-207 kernel: [21778.681476] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 11:26:44 juju-e4d256-prod-github-runner-207 kernel: [21778.682278] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 11:26:44 juju-e4d256-prod-github-runner-207 kernel: [21778.683075] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 11:26:44 juju-e4d256-prod-github-runner-207 kernel: [21778.683899] handle_exit+0x98/0x230 [kvm_amd] Aug 22 11:26:44 juju-e4d256-prod-github-runner-207 kernel: [21778.684655] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 11:26:44 juju-e4d256-prod-github-runner-207 kernel: [21778.685436] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 11:26:44 juju-e4d256-prod-github-runner-207 kernel: [21778.686231] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 11:26:44 juju-e4d256-prod-github-runner-207 kernel: [21778.687013] vcpu_run+0x62/0x2c0 [kvm] Aug 22 11:26:44 juju-e4d256-prod-github-runner-207 kernel: [21778.687734] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 11:26:44 juju-e4d256-prod-github-runner-207 kernel: [21778.688465] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 11:26:44 juju-e4d256-prod-github-runner-207 kernel: [21778.689318] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 11:26:44 juju-e4d256-prod-github-runner-207 kernel: [21778.690081] ? __seccomp_filter+0x4a/0x4a0 Aug 22 11:26:44 juju-e4d256-prod-github-runner-207 kernel: [21778.690801] ? __fget_files+0x86/0xc0 Aug 22 11:26:44 juju-e4d256-prod-github-runner-207 kernel: [21778.691515] __x64_sys_ioctl+0x95/0xd0 Aug 22 11:26:44 juju-e4d256-prod-github-runner-207 kernel: [21778.692212] do_syscall_64+0x5c/0xc0 Aug 22 11:26:44 juju-e4d256-prod-github-runner-207 kernel: [21778.692889] ? do_futex+0x162/0x1f0 Aug 22 11:26:44 juju-e4d256-prod-github-runner-207 kernel: [21778.693557] ? __x64_sys_futex+0x78/0x1e0 Aug 22 11:26:44 juju-e4d256-prod-github-runner-207 kernel: [21778.694261] ? __secure_computing+0xa9/0x120 Aug 22 11:26:44 juju-e4d256-prod-github-runner-207 kernel: [21778.694974] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 11:26:44 juju-e4d256-prod-github-runner-207 kernel: [21778.695780] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:26:44 juju-e4d256-prod-github-runner-207 kernel: [21778.696531] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:26:44 juju-e4d256-prod-github-runner-207 kernel: [21778.697300] ? do_syscall_64+0x69/0xc0 Aug 22 11:26:44 juju-e4d256-prod-github-runner-207 kernel: [21778.697989] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:26:44 juju-e4d256-prod-github-runner-207 kernel: [21778.698742] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:26:44 juju-e4d256-prod-github-runner-207 kernel: [21778.699524] ? do_syscall_64+0x69/0xc0 Aug 22 11:26:44 juju-e4d256-prod-github-runner-207 kernel: [21778.700235] ? do_syscall_64+0x69/0xc0 Aug 22 11:26:44 juju-e4d256-prod-github-runner-207 kernel: [21778.700933] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 11:26:44 juju-e4d256-prod-github-runner-207 kernel: [21778.701707] RIP: 0033:0x7faa5d0edaff Aug 22 11:26:44 juju-e4d256-prod-github-runner-207 kernel: [21778.702393] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 11:26:44 juju-e4d256-prod-github-runner-207 kernel: [21778.704503] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 11:26:44 juju-e4d256-prod-github-runner-207 kernel: [21778.705465] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 11:26:44 juju-e4d256-prod-github-runner-207 kernel: [21778.706414] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 11:26:44 juju-e4d256-prod-github-runner-207 kernel: [21778.707377] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 11:26:44 juju-e4d256-prod-github-runner-207 kernel: [21778.708319] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 11:26:44 juju-e4d256-prod-github-runner-207 kernel: [21778.709248] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 11:26:44 juju-e4d256-prod-github-runner-207 kernel: [21778.710164] Aug 22 11:27:10 juju-e4d256-prod-github-runner-207 kernel: [21804.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 20199s! [qemu-system-x86:6715] Aug 22 11:27:10 juju-e4d256-prod-github-runner-207 kernel: [21804.543954] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 11:27:10 juju-e4d256-prod-github-runner-207 kernel: [21804.544265] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 11:27:10 juju-e4d256-prod-github-runner-207 kernel: [21804.556663] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 11:27:10 juju-e4d256-prod-github-runner-207 kernel: [21804.558003] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 11:27:10 juju-e4d256-prod-github-runner-207 kernel: [21804.559280] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:27:10 juju-e4d256-prod-github-runner-207 kernel: [21804.560372] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 11:27:10 juju-e4d256-prod-github-runner-207 kernel: [21804.562998] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 11:27:10 juju-e4d256-prod-github-runner-207 kernel: [21804.564054] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 11:27:10 juju-e4d256-prod-github-runner-207 kernel: [21804.565231] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 11:27:10 juju-e4d256-prod-github-runner-207 kernel: [21804.566412] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 11:27:10 juju-e4d256-prod-github-runner-207 kernel: [21804.567610] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 11:27:10 juju-e4d256-prod-github-runner-207 kernel: [21804.568792] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 11:27:10 juju-e4d256-prod-github-runner-207 kernel: [21804.569982] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 11:27:10 juju-e4d256-prod-github-runner-207 kernel: [21804.571446] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 11:27:10 juju-e4d256-prod-github-runner-207 kernel: [21804.572568] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 11:27:10 juju-e4d256-prod-github-runner-207 kernel: [21804.573770] Call Trace: Aug 22 11:27:10 juju-e4d256-prod-github-runner-207 kernel: [21804.574704] Aug 22 11:27:10 juju-e4d256-prod-github-runner-207 kernel: [21804.575650] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:27:10 juju-e4d256-prod-github-runner-207 kernel: [21804.576681] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:27:10 juju-e4d256-prod-github-runner-207 kernel: [21804.577707] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:27:10 juju-e4d256-prod-github-runner-207 kernel: [21804.578951] ? show_regs.part.0+0x23/0x29 Aug 22 11:27:10 juju-e4d256-prod-github-runner-207 kernel: [21804.579995] ? show_regs.cold+0x8/0xd Aug 22 11:27:10 juju-e4d256-prod-github-runner-207 kernel: [21804.581117] ? watchdog_timer_fn+0x1be/0x220 Aug 22 11:27:10 juju-e4d256-prod-github-runner-207 kernel: [21804.582156] ? lockup_detector_update_enable+0x60/0x60 Aug 22 11:27:10 juju-e4d256-prod-github-runner-207 kernel: [21804.583254] ? __hrtimer_run_queues+0x107/0x230 Aug 22 11:27:10 juju-e4d256-prod-github-runner-207 kernel: [21804.584285] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 11:27:10 juju-e4d256-prod-github-runner-207 kernel: [21804.585380] ? hrtimer_interrupt+0x101/0x220 Aug 22 11:27:10 juju-e4d256-prod-github-runner-207 kernel: [21804.586592] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 11:27:10 juju-e4d256-prod-github-runner-207 kernel: [21804.587808] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 11:27:10 juju-e4d256-prod-github-runner-207 kernel: [21804.588866] Aug 22 11:27:10 juju-e4d256-prod-github-runner-207 kernel: [21804.589745] Aug 22 11:27:10 juju-e4d256-prod-github-runner-207 kernel: [21804.590590] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 11:27:10 juju-e4d256-prod-github-runner-207 kernel: [21804.591644] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:27:10 juju-e4d256-prod-github-runner-207 kernel: [21804.592691] ? _raw_spin_lock+0x22/0x30 Aug 22 11:27:10 juju-e4d256-prod-github-runner-207 kernel: [21804.593638] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:27:10 juju-e4d256-prod-github-runner-207 kernel: [21804.594675] direct_page_fault+0x206/0x310 [kvm] Aug 22 11:27:10 juju-e4d256-prod-github-runner-207 kernel: [21804.595717] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 11:27:10 juju-e4d256-prod-github-runner-207 kernel: [21804.596725] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 11:27:10 juju-e4d256-prod-github-runner-207 kernel: [21804.597731] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 11:27:10 juju-e4d256-prod-github-runner-207 kernel: [21804.598744] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 11:27:10 juju-e4d256-prod-github-runner-207 kernel: [21804.599698] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 11:27:10 juju-e4d256-prod-github-runner-207 kernel: [21804.600685] handle_exit+0x98/0x230 [kvm_amd] Aug 22 11:27:10 juju-e4d256-prod-github-runner-207 kernel: [21804.601580] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 11:27:10 juju-e4d256-prod-github-runner-207 kernel: [21804.602498] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 11:27:10 juju-e4d256-prod-github-runner-207 kernel: [21804.603435] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 11:27:10 juju-e4d256-prod-github-runner-207 kernel: [21804.604339] vcpu_run+0x62/0x2c0 [kvm] Aug 22 11:27:10 juju-e4d256-prod-github-runner-207 kernel: [21804.605149] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 11:27:10 juju-e4d256-prod-github-runner-207 kernel: [21804.605979] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 11:27:10 juju-e4d256-prod-github-runner-207 kernel: [21804.607223] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 11:27:10 juju-e4d256-prod-github-runner-207 kernel: [21804.608041] ? __seccomp_filter+0x4a/0x4a0 Aug 22 11:27:10 juju-e4d256-prod-github-runner-207 kernel: [21804.608782] ? __fget_files+0x86/0xc0 Aug 22 11:27:10 juju-e4d256-prod-github-runner-207 kernel: [21804.609489] __x64_sys_ioctl+0x95/0xd0 Aug 22 11:27:10 juju-e4d256-prod-github-runner-207 kernel: [21804.610179] do_syscall_64+0x5c/0xc0 Aug 22 11:27:10 juju-e4d256-prod-github-runner-207 kernel: [21804.610868] ? do_futex+0x162/0x1f0 Aug 22 11:27:10 juju-e4d256-prod-github-runner-207 kernel: [21804.611516] ? __x64_sys_futex+0x78/0x1e0 Aug 22 11:27:10 juju-e4d256-prod-github-runner-207 kernel: [21804.612225] ? __secure_computing+0xa9/0x120 Aug 22 11:27:10 juju-e4d256-prod-github-runner-207 kernel: [21804.612930] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 11:27:10 juju-e4d256-prod-github-runner-207 kernel: [21804.613691] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:27:10 juju-e4d256-prod-github-runner-207 kernel: [21804.614418] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:27:10 juju-e4d256-prod-github-runner-207 kernel: [21804.615172] ? do_syscall_64+0x69/0xc0 Aug 22 11:27:10 juju-e4d256-prod-github-runner-207 kernel: [21804.615820] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:27:10 juju-e4d256-prod-github-runner-207 kernel: [21804.616524] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:27:10 juju-e4d256-prod-github-runner-207 kernel: [21804.617220] ? do_syscall_64+0x69/0xc0 Aug 22 11:27:10 juju-e4d256-prod-github-runner-207 kernel: [21804.617853] ? do_syscall_64+0x69/0xc0 Aug 22 11:27:10 juju-e4d256-prod-github-runner-207 kernel: [21804.618487] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 11:27:10 juju-e4d256-prod-github-runner-207 kernel: [21804.619216] RIP: 0033:0x7faa5d0edaff Aug 22 11:27:10 juju-e4d256-prod-github-runner-207 kernel: [21804.619887] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 11:27:10 juju-e4d256-prod-github-runner-207 kernel: [21804.621902] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 11:27:10 juju-e4d256-prod-github-runner-207 kernel: [21804.622835] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 11:27:10 juju-e4d256-prod-github-runner-207 kernel: [21804.623729] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 11:27:10 juju-e4d256-prod-github-runner-207 kernel: [21804.624621] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 11:27:10 juju-e4d256-prod-github-runner-207 kernel: [21804.625519] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 11:27:10 juju-e4d256-prod-github-runner-207 kernel: [21804.626409] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 11:27:10 juju-e4d256-prod-github-runner-207 kernel: [21804.627349] Aug 22 11:27:38 juju-e4d256-prod-github-runner-207 kernel: [21832.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 20225s! [qemu-system-x86:6715] Aug 22 11:27:38 juju-e4d256-prod-github-runner-207 kernel: [21832.543118] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 11:27:38 juju-e4d256-prod-github-runner-207 kernel: [21832.543193] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 11:27:38 juju-e4d256-prod-github-runner-207 kernel: [21832.555624] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 11:27:38 juju-e4d256-prod-github-runner-207 kernel: [21832.556909] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 11:27:38 juju-e4d256-prod-github-runner-207 kernel: [21832.558155] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:27:38 juju-e4d256-prod-github-runner-207 kernel: [21832.559248] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 11:27:38 juju-e4d256-prod-github-runner-207 kernel: [21832.561867] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 11:27:38 juju-e4d256-prod-github-runner-207 kernel: [21832.562925] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 11:27:38 juju-e4d256-prod-github-runner-207 kernel: [21832.564103] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 11:27:38 juju-e4d256-prod-github-runner-207 kernel: [21832.565277] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 11:27:38 juju-e4d256-prod-github-runner-207 kernel: [21832.566465] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 11:27:38 juju-e4d256-prod-github-runner-207 kernel: [21832.567655] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 11:27:38 juju-e4d256-prod-github-runner-207 kernel: [21832.568837] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 11:27:38 juju-e4d256-prod-github-runner-207 kernel: [21832.570086] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 11:27:38 juju-e4d256-prod-github-runner-207 kernel: [21832.571210] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 11:27:38 juju-e4d256-prod-github-runner-207 kernel: [21832.572417] Call Trace: Aug 22 11:27:38 juju-e4d256-prod-github-runner-207 kernel: [21832.573331] Aug 22 11:27:38 juju-e4d256-prod-github-runner-207 kernel: [21832.574226] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:27:38 juju-e4d256-prod-github-runner-207 kernel: [21832.575279] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:27:38 juju-e4d256-prod-github-runner-207 kernel: [21832.576307] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:27:38 juju-e4d256-prod-github-runner-207 kernel: [21832.577392] ? show_regs.part.0+0x23/0x29 Aug 22 11:27:38 juju-e4d256-prod-github-runner-207 kernel: [21832.578396] ? show_regs.cold+0x8/0xd Aug 22 11:27:38 juju-e4d256-prod-github-runner-207 kernel: [21832.579413] ? watchdog_timer_fn+0x1be/0x220 Aug 22 11:27:38 juju-e4d256-prod-github-runner-207 kernel: [21832.580428] ? lockup_detector_update_enable+0x60/0x60 Aug 22 11:27:38 juju-e4d256-prod-github-runner-207 kernel: [21832.581500] ? __hrtimer_run_queues+0x107/0x230 Aug 22 11:27:38 juju-e4d256-prod-github-runner-207 kernel: [21832.582552] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 11:27:38 juju-e4d256-prod-github-runner-207 kernel: [21832.583581] ? hrtimer_interrupt+0x101/0x220 Aug 22 11:27:38 juju-e4d256-prod-github-runner-207 kernel: [21832.584601] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 11:27:38 juju-e4d256-prod-github-runner-207 kernel: [21832.585678] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 11:27:38 juju-e4d256-prod-github-runner-207 kernel: [21832.586740] Aug 22 11:27:38 juju-e4d256-prod-github-runner-207 kernel: [21832.587594] Aug 22 11:27:38 juju-e4d256-prod-github-runner-207 kernel: [21832.588479] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 11:27:38 juju-e4d256-prod-github-runner-207 kernel: [21832.589533] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:27:38 juju-e4d256-prod-github-runner-207 kernel: [21832.590611] ? _raw_spin_lock+0x22/0x30 Aug 22 11:27:38 juju-e4d256-prod-github-runner-207 kernel: [21832.591564] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:27:38 juju-e4d256-prod-github-runner-207 kernel: [21832.592589] direct_page_fault+0x206/0x310 [kvm] Aug 22 11:27:38 juju-e4d256-prod-github-runner-207 kernel: [21832.593693] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 11:27:38 juju-e4d256-prod-github-runner-207 kernel: [21832.594727] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 11:27:38 juju-e4d256-prod-github-runner-207 kernel: [21832.595744] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 11:27:38 juju-e4d256-prod-github-runner-207 kernel: [21832.596723] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 11:27:38 juju-e4d256-prod-github-runner-207 kernel: [21832.597678] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 11:27:38 juju-e4d256-prod-github-runner-207 kernel: [21832.598685] handle_exit+0x98/0x230 [kvm_amd] Aug 22 11:27:38 juju-e4d256-prod-github-runner-207 kernel: [21832.599588] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 11:27:38 juju-e4d256-prod-github-runner-207 kernel: [21832.600568] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 11:27:38 juju-e4d256-prod-github-runner-207 kernel: [21832.601525] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 11:27:38 juju-e4d256-prod-github-runner-207 kernel: [21832.602455] vcpu_run+0x62/0x2c0 [kvm] Aug 22 11:27:38 juju-e4d256-prod-github-runner-207 kernel: [21832.603328] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 11:27:38 juju-e4d256-prod-github-runner-207 kernel: [21832.604157] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 11:27:38 juju-e4d256-prod-github-runner-207 kernel: [21832.605030] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 11:27:38 juju-e4d256-prod-github-runner-207 kernel: [21832.605841] ? __seccomp_filter+0x4a/0x4a0 Aug 22 11:27:38 juju-e4d256-prod-github-runner-207 kernel: [21832.606608] ? __fget_files+0x86/0xc0 Aug 22 11:27:38 juju-e4d256-prod-github-runner-207 kernel: [21832.607321] __x64_sys_ioctl+0x95/0xd0 Aug 22 11:27:38 juju-e4d256-prod-github-runner-207 kernel: [21832.608020] do_syscall_64+0x5c/0xc0 Aug 22 11:27:38 juju-e4d256-prod-github-runner-207 kernel: [21832.608693] ? do_futex+0x162/0x1f0 Aug 22 11:27:38 juju-e4d256-prod-github-runner-207 kernel: [21832.609353] ? __x64_sys_futex+0x78/0x1e0 Aug 22 11:27:38 juju-e4d256-prod-github-runner-207 kernel: [21832.610045] ? __secure_computing+0xa9/0x120 Aug 22 11:27:38 juju-e4d256-prod-github-runner-207 kernel: [21832.610799] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 11:27:38 juju-e4d256-prod-github-runner-207 kernel: [21832.611576] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:27:38 juju-e4d256-prod-github-runner-207 kernel: [21832.612315] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:27:38 juju-e4d256-prod-github-runner-207 kernel: [21832.613075] ? do_syscall_64+0x69/0xc0 Aug 22 11:27:38 juju-e4d256-prod-github-runner-207 kernel: [21832.613758] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:27:38 juju-e4d256-prod-github-runner-207 kernel: [21832.614505] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:27:38 juju-e4d256-prod-github-runner-207 kernel: [21832.615232] ? do_syscall_64+0x69/0xc0 Aug 22 11:27:38 juju-e4d256-prod-github-runner-207 kernel: [21832.615873] ? do_syscall_64+0x69/0xc0 Aug 22 11:27:38 juju-e4d256-prod-github-runner-207 kernel: [21832.616504] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 11:27:38 juju-e4d256-prod-github-runner-207 kernel: [21832.617222] RIP: 0033:0x7faa5d0edaff Aug 22 11:27:38 juju-e4d256-prod-github-runner-207 kernel: [21832.617856] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 11:27:38 juju-e4d256-prod-github-runner-207 kernel: [21832.619927] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 11:27:38 juju-e4d256-prod-github-runner-207 kernel: [21832.620857] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 11:27:38 juju-e4d256-prod-github-runner-207 kernel: [21832.621758] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 11:27:38 juju-e4d256-prod-github-runner-207 kernel: [21832.622679] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 11:27:38 juju-e4d256-prod-github-runner-207 kernel: [21832.623582] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 11:27:38 juju-e4d256-prod-github-runner-207 kernel: [21832.624484] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 11:27:38 juju-e4d256-prod-github-runner-207 kernel: [21832.625397] Aug 22 11:28:06 juju-e4d256-prod-github-runner-207 kernel: [21860.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 20251s! [qemu-system-x86:6715] Aug 22 11:28:06 juju-e4d256-prod-github-runner-207 kernel: [21860.543121] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 11:28:06 juju-e4d256-prod-github-runner-207 kernel: [21860.543195] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 11:28:06 juju-e4d256-prod-github-runner-207 kernel: [21860.555601] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 11:28:06 juju-e4d256-prod-github-runner-207 kernel: [21860.556897] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 11:28:06 juju-e4d256-prod-github-runner-207 kernel: [21860.558161] RIP: 0010:native_queued_spin_lock_slowpath+0xc/0x40 Aug 22 11:28:06 juju-e4d256-prod-github-runner-207 kernel: [21860.559243] Code: fe ff ff eb af 4c 89 fe 48 c7 c7 20 99 e9 89 e8 ca 69 55 00 e9 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 <8b> 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 eb Aug 22 11:28:06 juju-e4d256-prod-github-runner-207 kernel: [21860.561844] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 11:28:06 juju-e4d256-prod-github-runner-207 kernel: [21860.562925] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 11:28:06 juju-e4d256-prod-github-runner-207 kernel: [21860.564107] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 11:28:06 juju-e4d256-prod-github-runner-207 kernel: [21860.565279] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 11:28:06 juju-e4d256-prod-github-runner-207 kernel: [21860.566478] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 11:28:06 juju-e4d256-prod-github-runner-207 kernel: [21860.567654] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 11:28:06 juju-e4d256-prod-github-runner-207 kernel: [21860.568834] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 11:28:06 juju-e4d256-prod-github-runner-207 kernel: [21860.570103] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 11:28:06 juju-e4d256-prod-github-runner-207 kernel: [21860.571219] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 11:28:06 juju-e4d256-prod-github-runner-207 kernel: [21860.572427] Call Trace: Aug 22 11:28:06 juju-e4d256-prod-github-runner-207 kernel: [21860.573343] Aug 22 11:28:06 juju-e4d256-prod-github-runner-207 kernel: [21860.574244] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:28:06 juju-e4d256-prod-github-runner-207 kernel: [21860.575283] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:28:06 juju-e4d256-prod-github-runner-207 kernel: [21860.576313] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:28:06 juju-e4d256-prod-github-runner-207 kernel: [21860.577396] ? show_regs.part.0+0x23/0x29 Aug 22 11:28:06 juju-e4d256-prod-github-runner-207 kernel: [21860.578428] ? show_regs.cold+0x8/0xd Aug 22 11:28:06 juju-e4d256-prod-github-runner-207 kernel: [21860.579406] ? watchdog_timer_fn+0x1be/0x220 Aug 22 11:28:06 juju-e4d256-prod-github-runner-207 kernel: [21860.580428] ? lockup_detector_update_enable+0x60/0x60 Aug 22 11:28:06 juju-e4d256-prod-github-runner-207 kernel: [21860.581500] ? __hrtimer_run_queues+0x107/0x230 Aug 22 11:28:06 juju-e4d256-prod-github-runner-207 kernel: [21860.582548] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 11:28:06 juju-e4d256-prod-github-runner-207 kernel: [21860.583576] ? hrtimer_interrupt+0x101/0x220 Aug 22 11:28:06 juju-e4d256-prod-github-runner-207 kernel: [21860.584595] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 11:28:06 juju-e4d256-prod-github-runner-207 kernel: [21860.585697] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 11:28:06 juju-e4d256-prod-github-runner-207 kernel: [21860.586766] Aug 22 11:28:06 juju-e4d256-prod-github-runner-207 kernel: [21860.587635] Aug 22 11:28:06 juju-e4d256-prod-github-runner-207 kernel: [21860.588477] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 11:28:06 juju-e4d256-prod-github-runner-207 kernel: [21860.589527] ? native_queued_spin_lock_slowpath+0xc/0x40 Aug 22 11:28:06 juju-e4d256-prod-github-runner-207 kernel: [21860.590583] ? _raw_spin_lock+0x22/0x30 Aug 22 11:28:06 juju-e4d256-prod-github-runner-207 kernel: [21860.591542] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:28:06 juju-e4d256-prod-github-runner-207 kernel: [21860.592572] direct_page_fault+0x206/0x310 [kvm] Aug 22 11:28:06 juju-e4d256-prod-github-runner-207 kernel: [21860.593633] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 11:28:06 juju-e4d256-prod-github-runner-207 kernel: [21860.594693] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 11:28:06 juju-e4d256-prod-github-runner-207 kernel: [21860.595707] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 11:28:06 juju-e4d256-prod-github-runner-207 kernel: [21860.596699] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 11:28:06 juju-e4d256-prod-github-runner-207 kernel: [21860.597653] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 11:28:06 juju-e4d256-prod-github-runner-207 kernel: [21860.598657] handle_exit+0x98/0x230 [kvm_amd] Aug 22 11:28:06 juju-e4d256-prod-github-runner-207 kernel: [21860.599561] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 11:28:06 juju-e4d256-prod-github-runner-207 kernel: [21860.600482] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 11:28:06 juju-e4d256-prod-github-runner-207 kernel: [21860.601417] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 11:28:06 juju-e4d256-prod-github-runner-207 kernel: [21860.602342] vcpu_run+0x62/0x2c0 [kvm] Aug 22 11:28:06 juju-e4d256-prod-github-runner-207 kernel: [21860.603159] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 11:28:06 juju-e4d256-prod-github-runner-207 kernel: [21860.603976] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 11:28:06 juju-e4d256-prod-github-runner-207 kernel: [21860.604849] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 11:28:06 juju-e4d256-prod-github-runner-207 kernel: [21860.605666] ? __seccomp_filter+0x4a/0x4a0 Aug 22 11:28:06 juju-e4d256-prod-github-runner-207 kernel: [21860.606466] ? __fget_files+0x86/0xc0 Aug 22 11:28:06 juju-e4d256-prod-github-runner-207 kernel: [21860.607187] __x64_sys_ioctl+0x95/0xd0 Aug 22 11:28:06 juju-e4d256-prod-github-runner-207 kernel: [21860.607891] do_syscall_64+0x5c/0xc0 Aug 22 11:28:06 juju-e4d256-prod-github-runner-207 kernel: [21860.608578] ? do_futex+0x162/0x1f0 Aug 22 11:28:06 juju-e4d256-prod-github-runner-207 kernel: [21860.609285] ? __x64_sys_futex+0x78/0x1e0 Aug 22 11:28:06 juju-e4d256-prod-github-runner-207 kernel: [21860.609989] ? __secure_computing+0xa9/0x120 Aug 22 11:28:06 juju-e4d256-prod-github-runner-207 kernel: [21860.610789] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 11:28:06 juju-e4d256-prod-github-runner-207 kernel: [21860.611567] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:28:06 juju-e4d256-prod-github-runner-207 kernel: [21860.612297] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:28:06 juju-e4d256-prod-github-runner-207 kernel: [21860.613129] ? do_syscall_64+0x69/0xc0 Aug 22 11:28:06 juju-e4d256-prod-github-runner-207 kernel: [21860.613782] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:28:06 juju-e4d256-prod-github-runner-207 kernel: [21860.614510] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:28:06 juju-e4d256-prod-github-runner-207 kernel: [21860.615281] ? do_syscall_64+0x69/0xc0 Aug 22 11:28:06 juju-e4d256-prod-github-runner-207 kernel: [21860.615918] ? do_syscall_64+0x69/0xc0 Aug 22 11:28:06 juju-e4d256-prod-github-runner-207 kernel: [21860.616559] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 11:28:06 juju-e4d256-prod-github-runner-207 kernel: [21860.617284] RIP: 0033:0x7faa5d0edaff Aug 22 11:28:06 juju-e4d256-prod-github-runner-207 kernel: [21860.617945] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 11:28:06 juju-e4d256-prod-github-runner-207 kernel: [21860.620004] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 11:28:06 juju-e4d256-prod-github-runner-207 kernel: [21860.620934] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 11:28:06 juju-e4d256-prod-github-runner-207 kernel: [21860.621846] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 11:28:06 juju-e4d256-prod-github-runner-207 kernel: [21860.622765] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 11:28:06 juju-e4d256-prod-github-runner-207 kernel: [21860.623666] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 11:28:06 juju-e4d256-prod-github-runner-207 kernel: [21860.624577] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 11:28:06 juju-e4d256-prod-github-runner-207 kernel: [21860.625490] Aug 22 11:28:34 juju-e4d256-prod-github-runner-207 kernel: [21888.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 20277s! [qemu-system-x86:6715] Aug 22 11:28:34 juju-e4d256-prod-github-runner-207 kernel: [21888.543118] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 11:28:34 juju-e4d256-prod-github-runner-207 kernel: [21888.543189] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 11:28:34 juju-e4d256-prod-github-runner-207 kernel: [21888.555383] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 11:28:34 juju-e4d256-prod-github-runner-207 kernel: [21888.556661] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 11:28:34 juju-e4d256-prod-github-runner-207 kernel: [21888.557910] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:28:34 juju-e4d256-prod-github-runner-207 kernel: [21888.558979] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 11:28:34 juju-e4d256-prod-github-runner-207 kernel: [21888.561554] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 11:28:34 juju-e4d256-prod-github-runner-207 kernel: [21888.562644] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 11:28:34 juju-e4d256-prod-github-runner-207 kernel: [21888.563824] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 11:28:34 juju-e4d256-prod-github-runner-207 kernel: [21888.565052] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 11:28:34 juju-e4d256-prod-github-runner-207 kernel: [21888.566248] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 11:28:34 juju-e4d256-prod-github-runner-207 kernel: [21888.567411] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 11:28:34 juju-e4d256-prod-github-runner-207 kernel: [21888.568585] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 11:28:34 juju-e4d256-prod-github-runner-207 kernel: [21888.569836] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 11:28:34 juju-e4d256-prod-github-runner-207 kernel: [21888.570950] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 11:28:34 juju-e4d256-prod-github-runner-207 kernel: [21888.572191] Call Trace: Aug 22 11:28:34 juju-e4d256-prod-github-runner-207 kernel: [21888.573131] Aug 22 11:28:34 juju-e4d256-prod-github-runner-207 kernel: [21888.574054] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:28:34 juju-e4d256-prod-github-runner-207 kernel: [21888.575130] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:28:34 juju-e4d256-prod-github-runner-207 kernel: [21888.576251] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:28:34 juju-e4d256-prod-github-runner-207 kernel: [21888.577344] ? show_regs.part.0+0x23/0x29 Aug 22 11:28:34 juju-e4d256-prod-github-runner-207 kernel: [21888.578368] ? show_regs.cold+0x8/0xd Aug 22 11:28:34 juju-e4d256-prod-github-runner-207 kernel: [21888.579341] ? watchdog_timer_fn+0x1be/0x220 Aug 22 11:28:34 juju-e4d256-prod-github-runner-207 kernel: [21888.580350] ? lockup_detector_update_enable+0x60/0x60 Aug 22 11:28:34 juju-e4d256-prod-github-runner-207 kernel: [21888.581414] ? __hrtimer_run_queues+0x107/0x230 Aug 22 11:28:34 juju-e4d256-prod-github-runner-207 kernel: [21888.582454] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 11:28:34 juju-e4d256-prod-github-runner-207 kernel: [21888.583513] ? hrtimer_interrupt+0x101/0x220 Aug 22 11:28:34 juju-e4d256-prod-github-runner-207 kernel: [21888.584543] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 11:28:34 juju-e4d256-prod-github-runner-207 kernel: [21888.585643] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 11:28:34 juju-e4d256-prod-github-runner-207 kernel: [21888.586706] Aug 22 11:28:34 juju-e4d256-prod-github-runner-207 kernel: [21888.587557] Aug 22 11:28:34 juju-e4d256-prod-github-runner-207 kernel: [21888.588413] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 11:28:34 juju-e4d256-prod-github-runner-207 kernel: [21888.589457] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:28:34 juju-e4d256-prod-github-runner-207 kernel: [21888.590514] ? _raw_spin_lock+0x22/0x30 Aug 22 11:28:34 juju-e4d256-prod-github-runner-207 kernel: [21888.591456] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:28:34 juju-e4d256-prod-github-runner-207 kernel: [21888.592469] direct_page_fault+0x206/0x310 [kvm] Aug 22 11:28:34 juju-e4d256-prod-github-runner-207 kernel: [21888.593490] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 11:28:34 juju-e4d256-prod-github-runner-207 kernel: [21888.594543] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 11:28:34 juju-e4d256-prod-github-runner-207 kernel: [21888.595544] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 11:28:34 juju-e4d256-prod-github-runner-207 kernel: [21888.596513] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 11:28:34 juju-e4d256-prod-github-runner-207 kernel: [21888.597467] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 11:28:34 juju-e4d256-prod-github-runner-207 kernel: [21888.598475] handle_exit+0x98/0x230 [kvm_amd] Aug 22 11:28:34 juju-e4d256-prod-github-runner-207 kernel: [21888.599394] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 11:28:34 juju-e4d256-prod-github-runner-207 kernel: [21888.600305] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 11:28:34 juju-e4d256-prod-github-runner-207 kernel: [21888.601224] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 11:28:34 juju-e4d256-prod-github-runner-207 kernel: [21888.602146] vcpu_run+0x62/0x2c0 [kvm] Aug 22 11:28:34 juju-e4d256-prod-github-runner-207 kernel: [21888.602959] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 11:28:34 juju-e4d256-prod-github-runner-207 kernel: [21888.603771] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 11:28:34 juju-e4d256-prod-github-runner-207 kernel: [21888.604680] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 11:28:34 juju-e4d256-prod-github-runner-207 kernel: [21888.605489] ? __seccomp_filter+0x4a/0x4a0 Aug 22 11:28:34 juju-e4d256-prod-github-runner-207 kernel: [21888.606259] ? __fget_files+0x86/0xc0 Aug 22 11:28:34 juju-e4d256-prod-github-runner-207 kernel: [21888.606970] __x64_sys_ioctl+0x95/0xd0 Aug 22 11:28:34 juju-e4d256-prod-github-runner-207 kernel: [21888.607665] do_syscall_64+0x5c/0xc0 Aug 22 11:28:34 juju-e4d256-prod-github-runner-207 kernel: [21888.608332] ? do_futex+0x162/0x1f0 Aug 22 11:28:34 juju-e4d256-prod-github-runner-207 kernel: [21888.609012] ? __x64_sys_futex+0x78/0x1e0 Aug 22 11:28:34 juju-e4d256-prod-github-runner-207 kernel: [21888.609685] ? __secure_computing+0xa9/0x120 Aug 22 11:28:34 juju-e4d256-prod-github-runner-207 kernel: [21888.610450] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 11:28:34 juju-e4d256-prod-github-runner-207 kernel: [21888.611221] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:28:34 juju-e4d256-prod-github-runner-207 kernel: [21888.611940] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:28:34 juju-e4d256-prod-github-runner-207 kernel: [21888.612653] ? do_syscall_64+0x69/0xc0 Aug 22 11:28:34 juju-e4d256-prod-github-runner-207 kernel: [21888.613300] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:28:34 juju-e4d256-prod-github-runner-207 kernel: [21888.614022] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:28:34 juju-e4d256-prod-github-runner-207 kernel: [21888.614759] ? do_syscall_64+0x69/0xc0 Aug 22 11:28:34 juju-e4d256-prod-github-runner-207 kernel: [21888.615390] ? do_syscall_64+0x69/0xc0 Aug 22 11:28:34 juju-e4d256-prod-github-runner-207 kernel: [21888.616011] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 11:28:34 juju-e4d256-prod-github-runner-207 kernel: [21888.616716] RIP: 0033:0x7faa5d0edaff Aug 22 11:28:34 juju-e4d256-prod-github-runner-207 kernel: [21888.617346] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 11:28:34 juju-e4d256-prod-github-runner-207 kernel: [21888.619357] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 11:28:34 juju-e4d256-prod-github-runner-207 kernel: [21888.620271] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 11:28:34 juju-e4d256-prod-github-runner-207 kernel: [21888.621162] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 11:28:34 juju-e4d256-prod-github-runner-207 kernel: [21888.622071] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 11:28:34 juju-e4d256-prod-github-runner-207 kernel: [21888.622959] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 11:28:34 juju-e4d256-prod-github-runner-207 kernel: [21888.623847] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 11:28:34 juju-e4d256-prod-github-runner-207 kernel: [21888.624748] Aug 22 11:29:02 juju-e4d256-prod-github-runner-207 kernel: [21916.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 20303s! [qemu-system-x86:6715] Aug 22 11:29:02 juju-e4d256-prod-github-runner-207 kernel: [21916.543867] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 11:29:02 juju-e4d256-prod-github-runner-207 kernel: [21916.544179] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 11:29:02 juju-e4d256-prod-github-runner-207 kernel: [21916.556280] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 11:29:02 juju-e4d256-prod-github-runner-207 kernel: [21916.557554] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 11:29:02 juju-e4d256-prod-github-runner-207 kernel: [21916.558776] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:29:02 juju-e4d256-prod-github-runner-207 kernel: [21916.559836] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 11:29:02 juju-e4d256-prod-github-runner-207 kernel: [21916.562390] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 11:29:02 juju-e4d256-prod-github-runner-207 kernel: [21916.563432] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 11:29:02 juju-e4d256-prod-github-runner-207 kernel: [21916.564600] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 11:29:02 juju-e4d256-prod-github-runner-207 kernel: [21916.565768] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 11:29:02 juju-e4d256-prod-github-runner-207 kernel: [21916.566928] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 11:29:02 juju-e4d256-prod-github-runner-207 kernel: [21916.568088] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 11:29:02 juju-e4d256-prod-github-runner-207 kernel: [21916.569254] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 11:29:02 juju-e4d256-prod-github-runner-207 kernel: [21916.570496] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 11:29:02 juju-e4d256-prod-github-runner-207 kernel: [21916.571600] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 11:29:02 juju-e4d256-prod-github-runner-207 kernel: [21916.572791] Call Trace: Aug 22 11:29:02 juju-e4d256-prod-github-runner-207 kernel: [21916.573721] Aug 22 11:29:02 juju-e4d256-prod-github-runner-207 kernel: [21916.574615] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:29:02 juju-e4d256-prod-github-runner-207 kernel: [21916.575651] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:29:02 juju-e4d256-prod-github-runner-207 kernel: [21916.576675] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:29:02 juju-e4d256-prod-github-runner-207 kernel: [21916.577800] ? show_regs.part.0+0x23/0x29 Aug 22 11:29:02 juju-e4d256-prod-github-runner-207 kernel: [21916.578801] ? show_regs.cold+0x8/0xd Aug 22 11:29:02 juju-e4d256-prod-github-runner-207 kernel: [21916.579771] ? watchdog_timer_fn+0x1be/0x220 Aug 22 11:29:02 juju-e4d256-prod-github-runner-207 kernel: [21916.580777] ? lockup_detector_update_enable+0x60/0x60 Aug 22 11:29:02 juju-e4d256-prod-github-runner-207 kernel: [21916.581857] ? __hrtimer_run_queues+0x107/0x230 Aug 22 11:29:02 juju-e4d256-prod-github-runner-207 kernel: [21916.582888] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 11:29:02 juju-e4d256-prod-github-runner-207 kernel: [21916.583910] ? hrtimer_interrupt+0x101/0x220 Aug 22 11:29:02 juju-e4d256-prod-github-runner-207 kernel: [21916.584923] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 11:29:02 juju-e4d256-prod-github-runner-207 kernel: [21916.586010] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 11:29:02 juju-e4d256-prod-github-runner-207 kernel: [21916.587058] Aug 22 11:29:02 juju-e4d256-prod-github-runner-207 kernel: [21916.587909] Aug 22 11:29:02 juju-e4d256-prod-github-runner-207 kernel: [21916.588749] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 11:29:02 juju-e4d256-prod-github-runner-207 kernel: [21916.589790] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:29:02 juju-e4d256-prod-github-runner-207 kernel: [21916.590826] ? _raw_spin_lock+0x22/0x30 Aug 22 11:29:02 juju-e4d256-prod-github-runner-207 kernel: [21916.591770] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:29:02 juju-e4d256-prod-github-runner-207 kernel: [21916.592783] direct_page_fault+0x206/0x310 [kvm] Aug 22 11:29:02 juju-e4d256-prod-github-runner-207 kernel: [21916.593815] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 11:29:02 juju-e4d256-prod-github-runner-207 kernel: [21916.594827] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 11:29:02 juju-e4d256-prod-github-runner-207 kernel: [21916.595826] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 11:29:02 juju-e4d256-prod-github-runner-207 kernel: [21916.596814] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 11:29:02 juju-e4d256-prod-github-runner-207 kernel: [21916.597767] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 11:29:02 juju-e4d256-prod-github-runner-207 kernel: [21916.598744] handle_exit+0x98/0x230 [kvm_amd] Aug 22 11:29:02 juju-e4d256-prod-github-runner-207 kernel: [21916.599636] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 11:29:02 juju-e4d256-prod-github-runner-207 kernel: [21916.600552] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 11:29:02 juju-e4d256-prod-github-runner-207 kernel: [21916.601483] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 11:29:02 juju-e4d256-prod-github-runner-207 kernel: [21916.602384] vcpu_run+0x62/0x2c0 [kvm] Aug 22 11:29:02 juju-e4d256-prod-github-runner-207 kernel: [21916.603197] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 11:29:02 juju-e4d256-prod-github-runner-207 kernel: [21916.604003] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 11:29:02 juju-e4d256-prod-github-runner-207 kernel: [21916.604860] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 11:29:02 juju-e4d256-prod-github-runner-207 kernel: [21916.605663] ? __seccomp_filter+0x4a/0x4a0 Aug 22 11:29:02 juju-e4d256-prod-github-runner-207 kernel: [21916.606404] ? __fget_files+0x86/0xc0 Aug 22 11:29:02 juju-e4d256-prod-github-runner-207 kernel: [21916.607106] __x64_sys_ioctl+0x95/0xd0 Aug 22 11:29:02 juju-e4d256-prod-github-runner-207 kernel: [21916.607817] do_syscall_64+0x5c/0xc0 Aug 22 11:29:02 juju-e4d256-prod-github-runner-207 kernel: [21916.608493] ? do_futex+0x162/0x1f0 Aug 22 11:29:02 juju-e4d256-prod-github-runner-207 kernel: [21916.609243] ? __x64_sys_futex+0x78/0x1e0 Aug 22 11:29:02 juju-e4d256-prod-github-runner-207 kernel: [21916.610102] ? __secure_computing+0xa9/0x120 Aug 22 11:29:02 juju-e4d256-prod-github-runner-207 kernel: [21916.610894] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 11:29:02 juju-e4d256-prod-github-runner-207 kernel: [21916.611665] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:29:02 juju-e4d256-prod-github-runner-207 kernel: [21916.612388] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:29:02 juju-e4d256-prod-github-runner-207 kernel: [21916.613119] ? do_syscall_64+0x69/0xc0 Aug 22 11:29:02 juju-e4d256-prod-github-runner-207 kernel: [21916.613781] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:29:02 juju-e4d256-prod-github-runner-207 kernel: [21916.614484] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:29:02 juju-e4d256-prod-github-runner-207 kernel: [21916.615187] ? do_syscall_64+0x69/0xc0 Aug 22 11:29:02 juju-e4d256-prod-github-runner-207 kernel: [21916.615824] ? do_syscall_64+0x69/0xc0 Aug 22 11:29:02 juju-e4d256-prod-github-runner-207 kernel: [21916.616445] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 11:29:02 juju-e4d256-prod-github-runner-207 kernel: [21916.617155] RIP: 0033:0x7faa5d0edaff Aug 22 11:29:02 juju-e4d256-prod-github-runner-207 kernel: [21916.617833] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 11:29:02 juju-e4d256-prod-github-runner-207 kernel: [21916.620143] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 11:29:02 juju-e4d256-prod-github-runner-207 kernel: [21916.621221] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 11:29:02 juju-e4d256-prod-github-runner-207 kernel: [21916.622267] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 11:29:02 juju-e4d256-prod-github-runner-207 kernel: [21916.623301] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 11:29:02 juju-e4d256-prod-github-runner-207 kernel: [21916.624327] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 11:29:02 juju-e4d256-prod-github-runner-207 kernel: [21916.625347] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 11:29:02 juju-e4d256-prod-github-runner-207 kernel: [21916.626393] Aug 22 11:29:30 juju-e4d256-prod-github-runner-207 kernel: [21944.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 20329s! [qemu-system-x86:6715] Aug 22 11:29:30 juju-e4d256-prod-github-runner-207 kernel: [21944.543109] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 11:29:30 juju-e4d256-prod-github-runner-207 kernel: [21944.543185] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 11:29:30 juju-e4d256-prod-github-runner-207 kernel: [21944.555355] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 11:29:30 juju-e4d256-prod-github-runner-207 kernel: [21944.556618] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 11:29:30 juju-e4d256-prod-github-runner-207 kernel: [21944.557857] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:29:30 juju-e4d256-prod-github-runner-207 kernel: [21944.558913] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 11:29:30 juju-e4d256-prod-github-runner-207 kernel: [21944.561477] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 11:29:30 juju-e4d256-prod-github-runner-207 kernel: [21944.562518] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 11:29:30 juju-e4d256-prod-github-runner-207 kernel: [21944.563684] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 11:29:30 juju-e4d256-prod-github-runner-207 kernel: [21944.564848] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 11:29:30 juju-e4d256-prod-github-runner-207 kernel: [21944.566019] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 11:29:30 juju-e4d256-prod-github-runner-207 kernel: [21944.567179] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 11:29:30 juju-e4d256-prod-github-runner-207 kernel: [21944.568344] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 11:29:30 juju-e4d256-prod-github-runner-207 kernel: [21944.569589] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 11:29:30 juju-e4d256-prod-github-runner-207 kernel: [21944.570694] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 11:29:30 juju-e4d256-prod-github-runner-207 kernel: [21944.571892] Call Trace: Aug 22 11:29:30 juju-e4d256-prod-github-runner-207 kernel: [21944.572802] Aug 22 11:29:30 juju-e4d256-prod-github-runner-207 kernel: [21944.573695] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:29:30 juju-e4d256-prod-github-runner-207 kernel: [21944.574728] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:29:30 juju-e4d256-prod-github-runner-207 kernel: [21944.575747] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:29:30 juju-e4d256-prod-github-runner-207 kernel: [21944.576823] ? show_regs.part.0+0x23/0x29 Aug 22 11:29:30 juju-e4d256-prod-github-runner-207 kernel: [21944.577851] ? show_regs.cold+0x8/0xd Aug 22 11:29:30 juju-e4d256-prod-github-runner-207 kernel: [21944.578823] ? watchdog_timer_fn+0x1be/0x220 Aug 22 11:29:30 juju-e4d256-prod-github-runner-207 kernel: [21944.579830] ? lockup_detector_update_enable+0x60/0x60 Aug 22 11:29:30 juju-e4d256-prod-github-runner-207 kernel: [21944.580890] ? __hrtimer_run_queues+0x107/0x230 Aug 22 11:29:30 juju-e4d256-prod-github-runner-207 kernel: [21944.581927] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 11:29:30 juju-e4d256-prod-github-runner-207 kernel: [21944.582953] ? hrtimer_interrupt+0x101/0x220 Aug 22 11:29:30 juju-e4d256-prod-github-runner-207 kernel: [21944.583966] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 11:29:30 juju-e4d256-prod-github-runner-207 kernel: [21944.585031] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 11:29:30 juju-e4d256-prod-github-runner-207 kernel: [21944.586087] Aug 22 11:29:30 juju-e4d256-prod-github-runner-207 kernel: [21944.586943] Aug 22 11:29:30 juju-e4d256-prod-github-runner-207 kernel: [21944.587777] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 11:29:30 juju-e4d256-prod-github-runner-207 kernel: [21944.588807] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:29:30 juju-e4d256-prod-github-runner-207 kernel: [21944.589855] ? _raw_spin_lock+0x22/0x30 Aug 22 11:29:30 juju-e4d256-prod-github-runner-207 kernel: [21944.590803] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:29:30 juju-e4d256-prod-github-runner-207 kernel: [21944.591822] direct_page_fault+0x206/0x310 [kvm] Aug 22 11:29:30 juju-e4d256-prod-github-runner-207 kernel: [21944.592844] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 11:29:30 juju-e4d256-prod-github-runner-207 kernel: [21944.593868] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 11:29:30 juju-e4d256-prod-github-runner-207 kernel: [21944.594866] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 11:29:30 juju-e4d256-prod-github-runner-207 kernel: [21944.595838] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 11:29:30 juju-e4d256-prod-github-runner-207 kernel: [21944.596780] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 11:29:30 juju-e4d256-prod-github-runner-207 kernel: [21944.597766] handle_exit+0x98/0x230 [kvm_amd] Aug 22 11:29:30 juju-e4d256-prod-github-runner-207 kernel: [21944.598657] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 11:29:30 juju-e4d256-prod-github-runner-207 kernel: [21944.599572] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 11:29:30 juju-e4d256-prod-github-runner-207 kernel: [21944.600493] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 11:29:30 juju-e4d256-prod-github-runner-207 kernel: [21944.601404] vcpu_run+0x62/0x2c0 [kvm] Aug 22 11:29:30 juju-e4d256-prod-github-runner-207 kernel: [21944.602218] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 11:29:30 juju-e4d256-prod-github-runner-207 kernel: [21944.603023] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 11:29:30 juju-e4d256-prod-github-runner-207 kernel: [21944.603874] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 11:29:30 juju-e4d256-prod-github-runner-207 kernel: [21944.604669] ? __seccomp_filter+0x4a/0x4a0 Aug 22 11:29:30 juju-e4d256-prod-github-runner-207 kernel: [21944.605422] ? __fget_files+0x86/0xc0 Aug 22 11:29:30 juju-e4d256-prod-github-runner-207 kernel: [21944.606131] __x64_sys_ioctl+0x95/0xd0 Aug 22 11:29:30 juju-e4d256-prod-github-runner-207 kernel: [21944.606828] do_syscall_64+0x5c/0xc0 Aug 22 11:29:30 juju-e4d256-prod-github-runner-207 kernel: [21944.607490] ? do_futex+0x162/0x1f0 Aug 22 11:29:30 juju-e4d256-prod-github-runner-207 kernel: [21944.608137] ? __x64_sys_futex+0x78/0x1e0 Aug 22 11:29:30 juju-e4d256-prod-github-runner-207 kernel: [21944.608813] ? __secure_computing+0xa9/0x120 Aug 22 11:29:30 juju-e4d256-prod-github-runner-207 kernel: [21944.609511] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 11:29:30 juju-e4d256-prod-github-runner-207 kernel: [21944.610268] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:29:30 juju-e4d256-prod-github-runner-207 kernel: [21944.610987] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:29:30 juju-e4d256-prod-github-runner-207 kernel: [21944.611702] ? do_syscall_64+0x69/0xc0 Aug 22 11:29:30 juju-e4d256-prod-github-runner-207 kernel: [21944.612350] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:29:30 juju-e4d256-prod-github-runner-207 kernel: [21944.613051] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:29:30 juju-e4d256-prod-github-runner-207 kernel: [21944.613762] ? do_syscall_64+0x69/0xc0 Aug 22 11:29:30 juju-e4d256-prod-github-runner-207 kernel: [21944.614385] ? do_syscall_64+0x69/0xc0 Aug 22 11:29:30 juju-e4d256-prod-github-runner-207 kernel: [21944.615011] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 11:29:30 juju-e4d256-prod-github-runner-207 kernel: [21944.615725] RIP: 0033:0x7faa5d0edaff Aug 22 11:29:30 juju-e4d256-prod-github-runner-207 kernel: [21944.616354] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 11:29:30 juju-e4d256-prod-github-runner-207 kernel: [21944.618354] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 11:29:30 juju-e4d256-prod-github-runner-207 kernel: [21944.619265] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 11:29:30 juju-e4d256-prod-github-runner-207 kernel: [21944.620171] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 11:29:30 juju-e4d256-prod-github-runner-207 kernel: [21944.621193] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 11:29:30 juju-e4d256-prod-github-runner-207 kernel: [21944.622090] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 11:29:30 juju-e4d256-prod-github-runner-207 kernel: [21944.622979] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 11:29:30 juju-e4d256-prod-github-runner-207 kernel: [21944.623871] Aug 22 11:29:44 juju-e4d256-prod-github-runner-207 kernel: [21958.652706] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 11:29:44 juju-e4d256-prod-github-runner-207 kernel: [21958.653683] rcu: 1-....: (5443308 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=2635274 Aug 22 11:29:44 juju-e4d256-prod-github-runner-207 kernel: [21958.654804] (t=5460363 jiffies g=23269 q=27551) Aug 22 11:29:44 juju-e4d256-prod-github-runner-207 kernel: [21958.655586] NMI backtrace for cpu 1 Aug 22 11:29:44 juju-e4d256-prod-github-runner-207 kernel: [21958.656296] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 11:29:44 juju-e4d256-prod-github-runner-207 kernel: [21958.657414] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 11:29:44 juju-e4d256-prod-github-runner-207 kernel: [21958.658474] Call Trace: Aug 22 11:29:44 juju-e4d256-prod-github-runner-207 kernel: [21958.659152] Aug 22 11:29:44 juju-e4d256-prod-github-runner-207 kernel: [21958.659796] show_stack+0x52/0x5c Aug 22 11:29:44 juju-e4d256-prod-github-runner-207 kernel: [21958.660524] dump_stack_lvl+0x4a/0x63 Aug 22 11:29:44 juju-e4d256-prod-github-runner-207 kernel: [21958.661350] dump_stack+0x10/0x16 Aug 22 11:29:44 juju-e4d256-prod-github-runner-207 kernel: [21958.662068] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 11:29:44 juju-e4d256-prod-github-runner-207 kernel: [21958.662966] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 11:29:44 juju-e4d256-prod-github-runner-207 kernel: [21958.663743] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 11:29:44 juju-e4d256-prod-github-runner-207 kernel: [21958.664560] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 11:29:44 juju-e4d256-prod-github-runner-207 kernel: [21958.665390] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 11:29:44 juju-e4d256-prod-github-runner-207 kernel: [21958.666197] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 11:29:44 juju-e4d256-prod-github-runner-207 kernel: [21958.666967] print_cpu_stall.cold+0x2f/0xe2 Aug 22 11:29:44 juju-e4d256-prod-github-runner-207 kernel: [21958.667728] ? timekeeping_update+0xf7/0x150 Aug 22 11:29:44 juju-e4d256-prod-github-runner-207 kernel: [21958.668495] check_cpu_stall+0x109/0x270 Aug 22 11:29:44 juju-e4d256-prod-github-runner-207 kernel: [21958.669263] rcu_sched_clock_irq+0x9a/0x250 Aug 22 11:29:44 juju-e4d256-prod-github-runner-207 kernel: [21958.670025] update_process_times+0x94/0xd0 Aug 22 11:29:44 juju-e4d256-prod-github-runner-207 kernel: [21958.670785] tick_sched_handle+0x29/0x70 Aug 22 11:29:44 juju-e4d256-prod-github-runner-207 kernel: [21958.671528] tick_sched_timer+0x8c/0xc0 Aug 22 11:29:44 juju-e4d256-prod-github-runner-207 kernel: [21958.672263] ? tick_nohz_handler+0xb0/0xb0 Aug 22 11:29:44 juju-e4d256-prod-github-runner-207 kernel: [21958.673023] __hrtimer_run_queues+0x107/0x230 Aug 22 11:29:44 juju-e4d256-prod-github-runner-207 kernel: [21958.673955] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 11:29:44 juju-e4d256-prod-github-runner-207 kernel: [21958.674728] hrtimer_interrupt+0x101/0x220 Aug 22 11:29:44 juju-e4d256-prod-github-runner-207 kernel: [21958.675484] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 11:29:44 juju-e4d256-prod-github-runner-207 kernel: [21958.676299] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 11:29:44 juju-e4d256-prod-github-runner-207 kernel: [21958.677107] Aug 22 11:29:44 juju-e4d256-prod-github-runner-207 kernel: [21958.677741] Aug 22 11:29:44 juju-e4d256-prod-github-runner-207 kernel: [21958.678374] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 11:29:44 juju-e4d256-prod-github-runner-207 kernel: [21958.679192] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:29:44 juju-e4d256-prod-github-runner-207 kernel: [21958.680074] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 11:29:44 juju-e4d256-prod-github-runner-207 kernel: [21958.682286] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 11:29:44 juju-e4d256-prod-github-runner-207 kernel: [21958.683162] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 11:29:44 juju-e4d256-prod-github-runner-207 kernel: [21958.684151] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 11:29:44 juju-e4d256-prod-github-runner-207 kernel: [21958.685145] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 11:29:44 juju-e4d256-prod-github-runner-207 kernel: [21958.686107] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 11:29:44 juju-e4d256-prod-github-runner-207 kernel: [21958.687073] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 11:29:44 juju-e4d256-prod-github-runner-207 kernel: [21958.688036] ? _raw_spin_lock+0x22/0x30 Aug 22 11:29:44 juju-e4d256-prod-github-runner-207 kernel: [21958.688791] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:29:44 juju-e4d256-prod-github-runner-207 kernel: [21958.689633] direct_page_fault+0x206/0x310 [kvm] Aug 22 11:29:44 juju-e4d256-prod-github-runner-207 kernel: [21958.690468] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 11:29:44 juju-e4d256-prod-github-runner-207 kernel: [21958.691300] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 11:29:44 juju-e4d256-prod-github-runner-207 kernel: [21958.692127] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 11:29:44 juju-e4d256-prod-github-runner-207 kernel: [21958.692936] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 11:29:44 juju-e4d256-prod-github-runner-207 kernel: [21958.693719] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 11:29:44 juju-e4d256-prod-github-runner-207 kernel: [21958.694539] handle_exit+0x98/0x230 [kvm_amd] Aug 22 11:29:44 juju-e4d256-prod-github-runner-207 kernel: [21958.695291] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 11:29:44 juju-e4d256-prod-github-runner-207 kernel: [21958.696073] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 11:29:44 juju-e4d256-prod-github-runner-207 kernel: [21958.696871] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 11:29:44 juju-e4d256-prod-github-runner-207 kernel: [21958.697673] vcpu_run+0x62/0x2c0 [kvm] Aug 22 11:29:44 juju-e4d256-prod-github-runner-207 kernel: [21958.698387] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 11:29:44 juju-e4d256-prod-github-runner-207 kernel: [21958.699118] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 11:29:44 juju-e4d256-prod-github-runner-207 kernel: [21958.699917] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 11:29:44 juju-e4d256-prod-github-runner-207 kernel: [21958.700675] ? __seccomp_filter+0x4a/0x4a0 Aug 22 11:29:44 juju-e4d256-prod-github-runner-207 kernel: [21958.701402] ? __fget_files+0x86/0xc0 Aug 22 11:29:44 juju-e4d256-prod-github-runner-207 kernel: [21958.702095] __x64_sys_ioctl+0x95/0xd0 Aug 22 11:29:44 juju-e4d256-prod-github-runner-207 kernel: [21958.702788] do_syscall_64+0x5c/0xc0 Aug 22 11:29:44 juju-e4d256-prod-github-runner-207 kernel: [21958.703467] ? do_futex+0x162/0x1f0 Aug 22 11:29:44 juju-e4d256-prod-github-runner-207 kernel: [21958.704141] ? __x64_sys_futex+0x78/0x1e0 Aug 22 11:29:44 juju-e4d256-prod-github-runner-207 kernel: [21958.704841] ? __secure_computing+0xa9/0x120 Aug 22 11:29:44 juju-e4d256-prod-github-runner-207 kernel: [21958.705564] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 11:29:44 juju-e4d256-prod-github-runner-207 kernel: [21958.706353] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:29:44 juju-e4d256-prod-github-runner-207 kernel: [21958.707111] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:29:44 juju-e4d256-prod-github-runner-207 kernel: [21958.707861] ? do_syscall_64+0x69/0xc0 Aug 22 11:29:44 juju-e4d256-prod-github-runner-207 kernel: [21958.708548] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:29:44 juju-e4d256-prod-github-runner-207 kernel: [21958.709312] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:29:44 juju-e4d256-prod-github-runner-207 kernel: [21958.710068] ? do_syscall_64+0x69/0xc0 Aug 22 11:29:44 juju-e4d256-prod-github-runner-207 kernel: [21958.710760] ? do_syscall_64+0x69/0xc0 Aug 22 11:29:44 juju-e4d256-prod-github-runner-207 kernel: [21958.711446] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 11:29:44 juju-e4d256-prod-github-runner-207 kernel: [21958.712224] RIP: 0033:0x7faa5d0edaff Aug 22 11:29:44 juju-e4d256-prod-github-runner-207 kernel: [21958.712915] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 11:29:44 juju-e4d256-prod-github-runner-207 kernel: [21958.715012] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 11:29:44 juju-e4d256-prod-github-runner-207 kernel: [21958.715972] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 11:29:44 juju-e4d256-prod-github-runner-207 kernel: [21958.716935] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 11:29:44 juju-e4d256-prod-github-runner-207 kernel: [21958.717878] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 11:29:44 juju-e4d256-prod-github-runner-207 kernel: [21958.718819] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 11:29:44 juju-e4d256-prod-github-runner-207 kernel: [21958.719744] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 11:29:44 juju-e4d256-prod-github-runner-207 kernel: [21958.720661] Aug 22 11:30:10 juju-e4d256-prod-github-runner-207 kernel: [21984.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 20366s! [qemu-system-x86:6715] Aug 22 11:30:10 juju-e4d256-prod-github-runner-207 kernel: [21984.543919] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 11:30:10 juju-e4d256-prod-github-runner-207 kernel: [21984.544260] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 11:30:10 juju-e4d256-prod-github-runner-207 kernel: [21984.556436] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 11:30:10 juju-e4d256-prod-github-runner-207 kernel: [21984.557717] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 11:30:10 juju-e4d256-prod-github-runner-207 kernel: [21984.558933] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:30:10 juju-e4d256-prod-github-runner-207 kernel: [21984.559987] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 11:30:10 juju-e4d256-prod-github-runner-207 kernel: [21984.562550] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 11:30:10 juju-e4d256-prod-github-runner-207 kernel: [21984.563597] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 11:30:10 juju-e4d256-prod-github-runner-207 kernel: [21984.564773] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 11:30:10 juju-e4d256-prod-github-runner-207 kernel: [21984.565935] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 11:30:10 juju-e4d256-prod-github-runner-207 kernel: [21984.567105] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 11:30:10 juju-e4d256-prod-github-runner-207 kernel: [21984.568271] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 11:30:10 juju-e4d256-prod-github-runner-207 kernel: [21984.569449] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 11:30:10 juju-e4d256-prod-github-runner-207 kernel: [21984.570682] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 11:30:10 juju-e4d256-prod-github-runner-207 kernel: [21984.571775] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 11:30:10 juju-e4d256-prod-github-runner-207 kernel: [21984.572973] Call Trace: Aug 22 11:30:10 juju-e4d256-prod-github-runner-207 kernel: [21984.573890] Aug 22 11:30:10 juju-e4d256-prod-github-runner-207 kernel: [21984.574807] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:30:10 juju-e4d256-prod-github-runner-207 kernel: [21984.575843] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:30:10 juju-e4d256-prod-github-runner-207 kernel: [21984.577066] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:30:10 juju-e4d256-prod-github-runner-207 kernel: [21984.578168] ? show_regs.part.0+0x23/0x29 Aug 22 11:30:10 juju-e4d256-prod-github-runner-207 kernel: [21984.579316] ? show_regs.cold+0x8/0xd Aug 22 11:30:10 juju-e4d256-prod-github-runner-207 kernel: [21984.580323] ? watchdog_timer_fn+0x1be/0x220 Aug 22 11:30:10 juju-e4d256-prod-github-runner-207 kernel: [21984.581344] ? lockup_detector_update_enable+0x60/0x60 Aug 22 11:30:10 juju-e4d256-prod-github-runner-207 kernel: [21984.582407] ? __hrtimer_run_queues+0x107/0x230 Aug 22 11:30:10 juju-e4d256-prod-github-runner-207 kernel: [21984.583433] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 11:30:10 juju-e4d256-prod-github-runner-207 kernel: [21984.584454] ? hrtimer_interrupt+0x101/0x220 Aug 22 11:30:10 juju-e4d256-prod-github-runner-207 kernel: [21984.585486] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 11:30:10 juju-e4d256-prod-github-runner-207 kernel: [21984.586552] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 11:30:10 juju-e4d256-prod-github-runner-207 kernel: [21984.587597] Aug 22 11:30:10 juju-e4d256-prod-github-runner-207 kernel: [21984.588449] Aug 22 11:30:10 juju-e4d256-prod-github-runner-207 kernel: [21984.589293] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 11:30:10 juju-e4d256-prod-github-runner-207 kernel: [21984.590365] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:30:10 juju-e4d256-prod-github-runner-207 kernel: [21984.591412] ? _raw_spin_lock+0x22/0x30 Aug 22 11:30:10 juju-e4d256-prod-github-runner-207 kernel: [21984.592359] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:30:10 juju-e4d256-prod-github-runner-207 kernel: [21984.593392] direct_page_fault+0x206/0x310 [kvm] Aug 22 11:30:10 juju-e4d256-prod-github-runner-207 kernel: [21984.594414] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 11:30:10 juju-e4d256-prod-github-runner-207 kernel: [21984.595422] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 11:30:10 juju-e4d256-prod-github-runner-207 kernel: [21984.596425] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 11:30:10 juju-e4d256-prod-github-runner-207 kernel: [21984.597444] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 11:30:10 juju-e4d256-prod-github-runner-207 kernel: [21984.598388] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 11:30:10 juju-e4d256-prod-github-runner-207 kernel: [21984.599406] handle_exit+0x98/0x230 [kvm_amd] Aug 22 11:30:10 juju-e4d256-prod-github-runner-207 kernel: [21984.600314] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 11:30:10 juju-e4d256-prod-github-runner-207 kernel: [21984.601251] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 11:30:10 juju-e4d256-prod-github-runner-207 kernel: [21984.602173] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 11:30:10 juju-e4d256-prod-github-runner-207 kernel: [21984.603075] vcpu_run+0x62/0x2c0 [kvm] Aug 22 11:30:10 juju-e4d256-prod-github-runner-207 kernel: [21984.603884] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 11:30:10 juju-e4d256-prod-github-runner-207 kernel: [21984.604704] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 11:30:10 juju-e4d256-prod-github-runner-207 kernel: [21984.605559] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 11:30:10 juju-e4d256-prod-github-runner-207 kernel: [21984.606356] ? __seccomp_filter+0x4a/0x4a0 Aug 22 11:30:10 juju-e4d256-prod-github-runner-207 kernel: [21984.607098] ? __fget_files+0x86/0xc0 Aug 22 11:30:10 juju-e4d256-prod-github-runner-207 kernel: [21984.607806] __x64_sys_ioctl+0x95/0xd0 Aug 22 11:30:10 juju-e4d256-prod-github-runner-207 kernel: [21984.608502] do_syscall_64+0x5c/0xc0 Aug 22 11:30:10 juju-e4d256-prod-github-runner-207 kernel: [21984.609178] ? do_futex+0x162/0x1f0 Aug 22 11:30:10 juju-e4d256-prod-github-runner-207 kernel: [21984.609842] ? __x64_sys_futex+0x78/0x1e0 Aug 22 11:30:10 juju-e4d256-prod-github-runner-207 kernel: [21984.610517] ? __secure_computing+0xa9/0x120 Aug 22 11:30:10 juju-e4d256-prod-github-runner-207 kernel: [21984.611213] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 11:30:10 juju-e4d256-prod-github-runner-207 kernel: [21984.612040] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:30:10 juju-e4d256-prod-github-runner-207 kernel: [21984.612778] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:30:10 juju-e4d256-prod-github-runner-207 kernel: [21984.613498] ? do_syscall_64+0x69/0xc0 Aug 22 11:30:10 juju-e4d256-prod-github-runner-207 kernel: [21984.614161] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:30:10 juju-e4d256-prod-github-runner-207 kernel: [21984.614864] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:30:10 juju-e4d256-prod-github-runner-207 kernel: [21984.615558] ? do_syscall_64+0x69/0xc0 Aug 22 11:30:10 juju-e4d256-prod-github-runner-207 kernel: [21984.616182] ? do_syscall_64+0x69/0xc0 Aug 22 11:30:10 juju-e4d256-prod-github-runner-207 kernel: [21984.616933] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 11:30:10 juju-e4d256-prod-github-runner-207 kernel: [21984.617742] RIP: 0033:0x7faa5d0edaff Aug 22 11:30:10 juju-e4d256-prod-github-runner-207 kernel: [21984.618474] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 11:30:10 juju-e4d256-prod-github-runner-207 kernel: [21984.620855] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 11:30:10 juju-e4d256-prod-github-runner-207 kernel: [21984.621969] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 11:30:10 juju-e4d256-prod-github-runner-207 kernel: [21984.623054] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 11:30:10 juju-e4d256-prod-github-runner-207 kernel: [21984.624115] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 11:30:10 juju-e4d256-prod-github-runner-207 kernel: [21984.625173] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 11:30:10 juju-e4d256-prod-github-runner-207 kernel: [21984.626210] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 11:30:10 juju-e4d256-prod-github-runner-207 kernel: [21984.627245] Aug 22 11:30:38 juju-e4d256-prod-github-runner-207 kernel: [22012.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 20392s! [qemu-system-x86:6715] Aug 22 11:30:38 juju-e4d256-prod-github-runner-207 kernel: [22012.543289] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 11:30:38 juju-e4d256-prod-github-runner-207 kernel: [22012.543365] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 11:30:38 juju-e4d256-prod-github-runner-207 kernel: [22012.557333] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 11:30:38 juju-e4d256-prod-github-runner-207 kernel: [22012.558793] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 11:30:38 juju-e4d256-prod-github-runner-207 kernel: [22012.560181] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:30:38 juju-e4d256-prod-github-runner-207 kernel: [22012.561384] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 11:30:38 juju-e4d256-prod-github-runner-207 kernel: [22012.564269] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 11:30:38 juju-e4d256-prod-github-runner-207 kernel: [22012.565423] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 11:30:38 juju-e4d256-prod-github-runner-207 kernel: [22012.566730] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 11:30:38 juju-e4d256-prod-github-runner-207 kernel: [22012.568035] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 11:30:38 juju-e4d256-prod-github-runner-207 kernel: [22012.569344] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 11:30:38 juju-e4d256-prod-github-runner-207 kernel: [22012.570639] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 11:30:38 juju-e4d256-prod-github-runner-207 kernel: [22012.571934] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 11:30:38 juju-e4d256-prod-github-runner-207 kernel: [22012.573321] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 11:30:38 juju-e4d256-prod-github-runner-207 kernel: [22012.574530] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 11:30:38 juju-e4d256-prod-github-runner-207 kernel: [22012.575859] Call Trace: Aug 22 11:30:38 juju-e4d256-prod-github-runner-207 kernel: [22012.576844] Aug 22 11:30:38 juju-e4d256-prod-github-runner-207 kernel: [22012.577828] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:30:38 juju-e4d256-prod-github-runner-207 kernel: [22012.578946] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:30:38 juju-e4d256-prod-github-runner-207 kernel: [22012.580062] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:30:38 juju-e4d256-prod-github-runner-207 kernel: [22012.581251] ? show_regs.part.0+0x23/0x29 Aug 22 11:30:38 juju-e4d256-prod-github-runner-207 kernel: [22012.582329] ? show_regs.cold+0x8/0xd Aug 22 11:30:38 juju-e4d256-prod-github-runner-207 kernel: [22012.583501] ? watchdog_timer_fn+0x1be/0x220 Aug 22 11:30:38 juju-e4d256-prod-github-runner-207 kernel: [22012.584609] ? lockup_detector_update_enable+0x60/0x60 Aug 22 11:30:38 juju-e4d256-prod-github-runner-207 kernel: [22012.585780] ? __hrtimer_run_queues+0x107/0x230 Aug 22 11:30:38 juju-e4d256-prod-github-runner-207 kernel: [22012.586905] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 11:30:38 juju-e4d256-prod-github-runner-207 kernel: [22012.588014] ? hrtimer_interrupt+0x101/0x220 Aug 22 11:30:38 juju-e4d256-prod-github-runner-207 kernel: [22012.589129] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 11:30:38 juju-e4d256-prod-github-runner-207 kernel: [22012.590308] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 11:30:38 juju-e4d256-prod-github-runner-207 kernel: [22012.591451] Aug 22 11:30:38 juju-e4d256-prod-github-runner-207 kernel: [22012.592366] Aug 22 11:30:38 juju-e4d256-prod-github-runner-207 kernel: [22012.593257] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 11:30:38 juju-e4d256-prod-github-runner-207 kernel: [22012.594389] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:30:38 juju-e4d256-prod-github-runner-207 kernel: [22012.595537] ? _raw_spin_lock+0x22/0x30 Aug 22 11:30:38 juju-e4d256-prod-github-runner-207 kernel: [22012.596567] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:30:38 juju-e4d256-prod-github-runner-207 kernel: [22012.597670] direct_page_fault+0x206/0x310 [kvm] Aug 22 11:30:38 juju-e4d256-prod-github-runner-207 kernel: [22012.598788] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 11:30:38 juju-e4d256-prod-github-runner-207 kernel: [22012.599899] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 11:30:38 juju-e4d256-prod-github-runner-207 kernel: [22012.601007] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 11:30:38 juju-e4d256-prod-github-runner-207 kernel: [22012.602080] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 11:30:38 juju-e4d256-prod-github-runner-207 kernel: [22012.603122] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 11:30:38 juju-e4d256-prod-github-runner-207 kernel: [22012.604204] handle_exit+0x98/0x230 [kvm_amd] Aug 22 11:30:38 juju-e4d256-prod-github-runner-207 kernel: [22012.605194] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 11:30:38 juju-e4d256-prod-github-runner-207 kernel: [22012.606203] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 11:30:38 juju-e4d256-prod-github-runner-207 kernel: [22012.607231] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 11:30:38 juju-e4d256-prod-github-runner-207 kernel: [22012.608235] vcpu_run+0x62/0x2c0 [kvm] Aug 22 11:30:38 juju-e4d256-prod-github-runner-207 kernel: [22012.609168] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 11:30:38 juju-e4d256-prod-github-runner-207 kernel: [22012.610062] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 11:30:38 juju-e4d256-prod-github-runner-207 kernel: [22012.611018] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 11:30:38 juju-e4d256-prod-github-runner-207 kernel: [22012.611915] ? __seccomp_filter+0x4a/0x4a0 Aug 22 11:30:38 juju-e4d256-prod-github-runner-207 kernel: [22012.612772] ? __fget_files+0x86/0xc0 Aug 22 11:30:38 juju-e4d256-prod-github-runner-207 kernel: [22012.613568] __x64_sys_ioctl+0x95/0xd0 Aug 22 11:30:38 juju-e4d256-prod-github-runner-207 kernel: [22012.614339] do_syscall_64+0x5c/0xc0 Aug 22 11:30:38 juju-e4d256-prod-github-runner-207 kernel: [22012.615083] ? do_futex+0x162/0x1f0 Aug 22 11:30:38 juju-e4d256-prod-github-runner-207 kernel: [22012.615799] ? __x64_sys_futex+0x78/0x1e0 Aug 22 11:30:38 juju-e4d256-prod-github-runner-207 kernel: [22012.616578] ? __secure_computing+0xa9/0x120 Aug 22 11:30:38 juju-e4d256-prod-github-runner-207 kernel: [22012.617358] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 11:30:38 juju-e4d256-prod-github-runner-207 kernel: [22012.618229] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:30:38 juju-e4d256-prod-github-runner-207 kernel: [22012.619044] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:30:38 juju-e4d256-prod-github-runner-207 kernel: [22012.619856] ? do_syscall_64+0x69/0xc0 Aug 22 11:30:38 juju-e4d256-prod-github-runner-207 kernel: [22012.620594] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:30:38 juju-e4d256-prod-github-runner-207 kernel: [22012.621398] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:30:38 juju-e4d256-prod-github-runner-207 kernel: [22012.622189] ? do_syscall_64+0x69/0xc0 Aug 22 11:30:38 juju-e4d256-prod-github-runner-207 kernel: [22012.622892] ? do_syscall_64+0x69/0xc0 Aug 22 11:30:38 juju-e4d256-prod-github-runner-207 kernel: [22012.623588] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 11:30:38 juju-e4d256-prod-github-runner-207 kernel: [22012.624404] RIP: 0033:0x7faa5d0edaff Aug 22 11:30:38 juju-e4d256-prod-github-runner-207 kernel: [22012.625130] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 11:30:38 juju-e4d256-prod-github-runner-207 kernel: [22012.627452] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 11:30:38 juju-e4d256-prod-github-runner-207 kernel: [22012.628524] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 11:30:38 juju-e4d256-prod-github-runner-207 kernel: [22012.629585] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 11:30:38 juju-e4d256-prod-github-runner-207 kernel: [22012.630656] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 11:30:38 juju-e4d256-prod-github-runner-207 kernel: [22012.631703] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 11:30:38 juju-e4d256-prod-github-runner-207 kernel: [22012.632837] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 11:30:38 juju-e4d256-prod-github-runner-207 kernel: [22012.633904] Aug 22 11:31:06 juju-e4d256-prod-github-runner-207 kernel: [22040.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 20418s! [qemu-system-x86:6715] Aug 22 11:31:06 juju-e4d256-prod-github-runner-207 kernel: [22040.543164] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 11:31:06 juju-e4d256-prod-github-runner-207 kernel: [22040.543245] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 11:31:06 juju-e4d256-prod-github-runner-207 kernel: [22040.555559] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 11:31:06 juju-e4d256-prod-github-runner-207 kernel: [22040.556847] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 11:31:06 juju-e4d256-prod-github-runner-207 kernel: [22040.558066] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:31:06 juju-e4d256-prod-github-runner-207 kernel: [22040.559127] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 11:31:06 juju-e4d256-prod-github-runner-207 kernel: [22040.561765] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 11:31:06 juju-e4d256-prod-github-runner-207 kernel: [22040.562817] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 11:31:06 juju-e4d256-prod-github-runner-207 kernel: [22040.564005] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 11:31:06 juju-e4d256-prod-github-runner-207 kernel: [22040.565167] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 11:31:06 juju-e4d256-prod-github-runner-207 kernel: [22040.566330] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 11:31:06 juju-e4d256-prod-github-runner-207 kernel: [22040.567495] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 11:31:06 juju-e4d256-prod-github-runner-207 kernel: [22040.568715] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 11:31:06 juju-e4d256-prod-github-runner-207 kernel: [22040.569976] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 11:31:06 juju-e4d256-prod-github-runner-207 kernel: [22040.571089] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 11:31:06 juju-e4d256-prod-github-runner-207 kernel: [22040.572325] Call Trace: Aug 22 11:31:06 juju-e4d256-prod-github-runner-207 kernel: [22040.573241] Aug 22 11:31:06 juju-e4d256-prod-github-runner-207 kernel: [22040.574298] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:31:06 juju-e4d256-prod-github-runner-207 kernel: [22040.575356] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:31:06 juju-e4d256-prod-github-runner-207 kernel: [22040.576436] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:31:06 juju-e4d256-prod-github-runner-207 kernel: [22040.577522] ? show_regs.part.0+0x23/0x29 Aug 22 11:31:06 juju-e4d256-prod-github-runner-207 kernel: [22040.578526] ? show_regs.cold+0x8/0xd Aug 22 11:31:06 juju-e4d256-prod-github-runner-207 kernel: [22040.579498] ? watchdog_timer_fn+0x1be/0x220 Aug 22 11:31:06 juju-e4d256-prod-github-runner-207 kernel: [22040.580529] ? lockup_detector_update_enable+0x60/0x60 Aug 22 11:31:06 juju-e4d256-prod-github-runner-207 kernel: [22040.581600] ? __hrtimer_run_queues+0x107/0x230 Aug 22 11:31:06 juju-e4d256-prod-github-runner-207 kernel: [22040.582633] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 11:31:06 juju-e4d256-prod-github-runner-207 kernel: [22040.583657] ? hrtimer_interrupt+0x101/0x220 Aug 22 11:31:06 juju-e4d256-prod-github-runner-207 kernel: [22040.584687] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 11:31:06 juju-e4d256-prod-github-runner-207 kernel: [22040.585806] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 11:31:06 juju-e4d256-prod-github-runner-207 kernel: [22040.586850] Aug 22 11:31:06 juju-e4d256-prod-github-runner-207 kernel: [22040.587728] Aug 22 11:31:06 juju-e4d256-prod-github-runner-207 kernel: [22040.588611] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 11:31:06 juju-e4d256-prod-github-runner-207 kernel: [22040.589675] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:31:06 juju-e4d256-prod-github-runner-207 kernel: [22040.590727] ? _raw_spin_lock+0x22/0x30 Aug 22 11:31:06 juju-e4d256-prod-github-runner-207 kernel: [22040.591678] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:31:06 juju-e4d256-prod-github-runner-207 kernel: [22040.592720] direct_page_fault+0x206/0x310 [kvm] Aug 22 11:31:06 juju-e4d256-prod-github-runner-207 kernel: [22040.593754] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 11:31:06 juju-e4d256-prod-github-runner-207 kernel: [22040.594795] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 11:31:06 juju-e4d256-prod-github-runner-207 kernel: [22040.595819] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 11:31:06 juju-e4d256-prod-github-runner-207 kernel: [22040.596820] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 11:31:06 juju-e4d256-prod-github-runner-207 kernel: [22040.597779] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 11:31:06 juju-e4d256-prod-github-runner-207 kernel: [22040.598761] handle_exit+0x98/0x230 [kvm_amd] Aug 22 11:31:06 juju-e4d256-prod-github-runner-207 kernel: [22040.599657] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 11:31:06 juju-e4d256-prod-github-runner-207 kernel: [22040.600589] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 11:31:06 juju-e4d256-prod-github-runner-207 kernel: [22040.601532] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 11:31:06 juju-e4d256-prod-github-runner-207 kernel: [22040.602507] vcpu_run+0x62/0x2c0 [kvm] Aug 22 11:31:06 juju-e4d256-prod-github-runner-207 kernel: [22040.603345] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 11:31:06 juju-e4d256-prod-github-runner-207 kernel: [22040.604256] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 11:31:06 juju-e4d256-prod-github-runner-207 kernel: [22040.605222] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 11:31:06 juju-e4d256-prod-github-runner-207 kernel: [22040.606086] ? __seccomp_filter+0x4a/0x4a0 Aug 22 11:31:06 juju-e4d256-prod-github-runner-207 kernel: [22040.606918] ? __fget_files+0x86/0xc0 Aug 22 11:31:06 juju-e4d256-prod-github-runner-207 kernel: [22040.607687] __x64_sys_ioctl+0x95/0xd0 Aug 22 11:31:06 juju-e4d256-prod-github-runner-207 kernel: [22040.608515] do_syscall_64+0x5c/0xc0 Aug 22 11:31:06 juju-e4d256-prod-github-runner-207 kernel: [22040.609209] ? do_futex+0x162/0x1f0 Aug 22 11:31:06 juju-e4d256-prod-github-runner-207 kernel: [22040.609968] ? __x64_sys_futex+0x78/0x1e0 Aug 22 11:31:06 juju-e4d256-prod-github-runner-207 kernel: [22040.610675] ? __secure_computing+0xa9/0x120 Aug 22 11:31:06 juju-e4d256-prod-github-runner-207 kernel: [22040.611529] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 11:31:06 juju-e4d256-prod-github-runner-207 kernel: [22040.612339] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:31:06 juju-e4d256-prod-github-runner-207 kernel: [22040.613088] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:31:06 juju-e4d256-prod-github-runner-207 kernel: [22040.613943] ? do_syscall_64+0x69/0xc0 Aug 22 11:31:06 juju-e4d256-prod-github-runner-207 kernel: [22040.614604] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:31:06 juju-e4d256-prod-github-runner-207 kernel: [22040.615421] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:31:06 juju-e4d256-prod-github-runner-207 kernel: [22040.616202] ? do_syscall_64+0x69/0xc0 Aug 22 11:31:06 juju-e4d256-prod-github-runner-207 kernel: [22040.616931] ? do_syscall_64+0x69/0xc0 Aug 22 11:31:06 juju-e4d256-prod-github-runner-207 kernel: [22040.617587] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 11:31:06 juju-e4d256-prod-github-runner-207 kernel: [22040.618471] RIP: 0033:0x7faa5d0edaff Aug 22 11:31:06 juju-e4d256-prod-github-runner-207 kernel: [22040.619215] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 11:31:06 juju-e4d256-prod-github-runner-207 kernel: [22040.621425] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 11:31:06 juju-e4d256-prod-github-runner-207 kernel: [22040.622506] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 11:31:06 juju-e4d256-prod-github-runner-207 kernel: [22040.623492] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 11:31:06 juju-e4d256-prod-github-runner-207 kernel: [22040.624459] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 11:31:06 juju-e4d256-prod-github-runner-207 kernel: [22040.625421] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 11:31:06 juju-e4d256-prod-github-runner-207 kernel: [22040.626446] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 11:31:06 juju-e4d256-prod-github-runner-207 kernel: [22040.627434] Aug 22 11:31:34 juju-e4d256-prod-github-runner-207 kernel: [22068.541982] watchdog: BUG: soft lockup - CPU#1 stuck for 20444s! [qemu-system-x86:6715] Aug 22 11:31:34 juju-e4d256-prod-github-runner-207 kernel: [22068.543153] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 11:31:34 juju-e4d256-prod-github-runner-207 kernel: [22068.543227] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 11:31:34 juju-e4d256-prod-github-runner-207 kernel: [22068.555463] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 11:31:34 juju-e4d256-prod-github-runner-207 kernel: [22068.556772] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 11:31:34 juju-e4d256-prod-github-runner-207 kernel: [22068.558007] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:31:34 juju-e4d256-prod-github-runner-207 kernel: [22068.559080] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 11:31:34 juju-e4d256-prod-github-runner-207 kernel: [22068.561722] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 11:31:34 juju-e4d256-prod-github-runner-207 kernel: [22068.562846] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 11:31:34 juju-e4d256-prod-github-runner-207 kernel: [22068.564074] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 11:31:34 juju-e4d256-prod-github-runner-207 kernel: [22068.565234] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 11:31:34 juju-e4d256-prod-github-runner-207 kernel: [22068.566394] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 11:31:34 juju-e4d256-prod-github-runner-207 kernel: [22068.567560] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 11:31:34 juju-e4d256-prod-github-runner-207 kernel: [22068.568739] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 11:31:34 juju-e4d256-prod-github-runner-207 kernel: [22068.569976] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 11:31:34 juju-e4d256-prod-github-runner-207 kernel: [22068.571084] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 11:31:34 juju-e4d256-prod-github-runner-207 kernel: [22068.572291] Call Trace: Aug 22 11:31:34 juju-e4d256-prod-github-runner-207 kernel: [22068.573212] Aug 22 11:31:34 juju-e4d256-prod-github-runner-207 kernel: [22068.574109] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:31:34 juju-e4d256-prod-github-runner-207 kernel: [22068.575136] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:31:34 juju-e4d256-prod-github-runner-207 kernel: [22068.576162] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:31:34 juju-e4d256-prod-github-runner-207 kernel: [22068.577284] ? show_regs.part.0+0x23/0x29 Aug 22 11:31:34 juju-e4d256-prod-github-runner-207 kernel: [22068.578292] ? show_regs.cold+0x8/0xd Aug 22 11:31:34 juju-e4d256-prod-github-runner-207 kernel: [22068.579278] ? watchdog_timer_fn+0x1be/0x220 Aug 22 11:31:34 juju-e4d256-prod-github-runner-207 kernel: [22068.580312] ? lockup_detector_update_enable+0x60/0x60 Aug 22 11:31:34 juju-e4d256-prod-github-runner-207 kernel: [22068.581374] ? __hrtimer_run_queues+0x107/0x230 Aug 22 11:31:34 juju-e4d256-prod-github-runner-207 kernel: [22068.582401] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 11:31:34 juju-e4d256-prod-github-runner-207 kernel: [22068.583427] ? hrtimer_interrupt+0x101/0x220 Aug 22 11:31:34 juju-e4d256-prod-github-runner-207 kernel: [22068.584456] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 11:31:34 juju-e4d256-prod-github-runner-207 kernel: [22068.585526] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 11:31:34 juju-e4d256-prod-github-runner-207 kernel: [22068.586573] Aug 22 11:31:34 juju-e4d256-prod-github-runner-207 kernel: [22068.587423] Aug 22 11:31:34 juju-e4d256-prod-github-runner-207 kernel: [22068.588292] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 11:31:34 juju-e4d256-prod-github-runner-207 kernel: [22068.589331] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:31:34 juju-e4d256-prod-github-runner-207 kernel: [22068.590369] ? _raw_spin_lock+0x22/0x30 Aug 22 11:31:34 juju-e4d256-prod-github-runner-207 kernel: [22068.591311] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:31:34 juju-e4d256-prod-github-runner-207 kernel: [22068.592359] direct_page_fault+0x206/0x310 [kvm] Aug 22 11:31:34 juju-e4d256-prod-github-runner-207 kernel: [22068.593383] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 11:31:34 juju-e4d256-prod-github-runner-207 kernel: [22068.594387] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 11:31:34 juju-e4d256-prod-github-runner-207 kernel: [22068.595384] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 11:31:34 juju-e4d256-prod-github-runner-207 kernel: [22068.596378] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 11:31:34 juju-e4d256-prod-github-runner-207 kernel: [22068.597319] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 11:31:34 juju-e4d256-prod-github-runner-207 kernel: [22068.598292] handle_exit+0x98/0x230 [kvm_amd] Aug 22 11:31:34 juju-e4d256-prod-github-runner-207 kernel: [22068.599186] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 11:31:34 juju-e4d256-prod-github-runner-207 kernel: [22068.600100] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 11:31:34 juju-e4d256-prod-github-runner-207 kernel: [22068.601020] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 11:31:34 juju-e4d256-prod-github-runner-207 kernel: [22068.601919] vcpu_run+0x62/0x2c0 [kvm] Aug 22 11:31:34 juju-e4d256-prod-github-runner-207 kernel: [22068.602732] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 11:31:34 juju-e4d256-prod-github-runner-207 kernel: [22068.603537] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 11:31:34 juju-e4d256-prod-github-runner-207 kernel: [22068.604399] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 11:31:34 juju-e4d256-prod-github-runner-207 kernel: [22068.605196] ? __seccomp_filter+0x4a/0x4a0 Aug 22 11:31:34 juju-e4d256-prod-github-runner-207 kernel: [22068.605936] ? __fget_files+0x86/0xc0 Aug 22 11:31:34 juju-e4d256-prod-github-runner-207 kernel: [22068.606636] __x64_sys_ioctl+0x95/0xd0 Aug 22 11:31:34 juju-e4d256-prod-github-runner-207 kernel: [22068.607323] do_syscall_64+0x5c/0xc0 Aug 22 11:31:34 juju-e4d256-prod-github-runner-207 kernel: [22068.607997] ? do_futex+0x162/0x1f0 Aug 22 11:31:34 juju-e4d256-prod-github-runner-207 kernel: [22068.608643] ? __x64_sys_futex+0x78/0x1e0 Aug 22 11:31:34 juju-e4d256-prod-github-runner-207 kernel: [22068.609318] ? __secure_computing+0xa9/0x120 Aug 22 11:31:34 juju-e4d256-prod-github-runner-207 kernel: [22068.610007] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 11:31:34 juju-e4d256-prod-github-runner-207 kernel: [22068.610762] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:31:34 juju-e4d256-prod-github-runner-207 kernel: [22068.611483] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:31:34 juju-e4d256-prod-github-runner-207 kernel: [22068.612232] ? do_syscall_64+0x69/0xc0 Aug 22 11:31:34 juju-e4d256-prod-github-runner-207 kernel: [22068.612874] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:31:34 juju-e4d256-prod-github-runner-207 kernel: [22068.613572] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:31:34 juju-e4d256-prod-github-runner-207 kernel: [22068.614264] ? do_syscall_64+0x69/0xc0 Aug 22 11:31:34 juju-e4d256-prod-github-runner-207 kernel: [22068.614886] ? do_syscall_64+0x69/0xc0 Aug 22 11:31:34 juju-e4d256-prod-github-runner-207 kernel: [22068.615510] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 11:31:34 juju-e4d256-prod-github-runner-207 kernel: [22068.616225] RIP: 0033:0x7faa5d0edaff Aug 22 11:31:34 juju-e4d256-prod-github-runner-207 kernel: [22068.616844] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 11:31:34 juju-e4d256-prod-github-runner-207 kernel: [22068.618812] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 11:31:34 juju-e4d256-prod-github-runner-207 kernel: [22068.619728] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 11:31:34 juju-e4d256-prod-github-runner-207 kernel: [22068.620613] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 11:31:34 juju-e4d256-prod-github-runner-207 kernel: [22068.621502] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 11:31:34 juju-e4d256-prod-github-runner-207 kernel: [22068.622385] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 11:31:34 juju-e4d256-prod-github-runner-207 kernel: [22068.623267] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 11:31:34 juju-e4d256-prod-github-runner-207 kernel: [22068.624166] Aug 22 11:32:02 juju-e4d256-prod-github-runner-207 kernel: [22096.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 20471s! [qemu-system-x86:6715] Aug 22 11:32:02 juju-e4d256-prod-github-runner-207 kernel: [22096.543902] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 11:32:02 juju-e4d256-prod-github-runner-207 kernel: [22096.544206] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 11:32:02 juju-e4d256-prod-github-runner-207 kernel: [22096.556723] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 11:32:02 juju-e4d256-prod-github-runner-207 kernel: [22096.558009] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 11:32:02 juju-e4d256-prod-github-runner-207 kernel: [22096.559253] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:32:02 juju-e4d256-prod-github-runner-207 kernel: [22096.560341] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 11:32:02 juju-e4d256-prod-github-runner-207 kernel: [22096.562932] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 11:32:02 juju-e4d256-prod-github-runner-207 kernel: [22096.563994] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 11:32:02 juju-e4d256-prod-github-runner-207 kernel: [22096.565210] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 11:32:02 juju-e4d256-prod-github-runner-207 kernel: [22096.566406] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 11:32:02 juju-e4d256-prod-github-runner-207 kernel: [22096.567657] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 11:32:02 juju-e4d256-prod-github-runner-207 kernel: [22096.568847] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 11:32:02 juju-e4d256-prod-github-runner-207 kernel: [22096.570025] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 11:32:02 juju-e4d256-prod-github-runner-207 kernel: [22096.571283] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 11:32:02 juju-e4d256-prod-github-runner-207 kernel: [22096.572391] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 11:32:02 juju-e4d256-prod-github-runner-207 kernel: [22096.573603] Call Trace: Aug 22 11:32:02 juju-e4d256-prod-github-runner-207 kernel: [22096.574520] Aug 22 11:32:02 juju-e4d256-prod-github-runner-207 kernel: [22096.575426] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:32:02 juju-e4d256-prod-github-runner-207 kernel: [22096.576469] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:32:02 juju-e4d256-prod-github-runner-207 kernel: [22096.577553] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:32:02 juju-e4d256-prod-github-runner-207 kernel: [22096.578651] ? show_regs.part.0+0x23/0x29 Aug 22 11:32:02 juju-e4d256-prod-github-runner-207 kernel: [22096.579698] ? show_regs.cold+0x8/0xd Aug 22 11:32:02 juju-e4d256-prod-github-runner-207 kernel: [22096.580704] ? watchdog_timer_fn+0x1be/0x220 Aug 22 11:32:02 juju-e4d256-prod-github-runner-207 kernel: [22096.581729] ? lockup_detector_update_enable+0x60/0x60 Aug 22 11:32:02 juju-e4d256-prod-github-runner-207 kernel: [22096.582815] ? __hrtimer_run_queues+0x107/0x230 Aug 22 11:32:02 juju-e4d256-prod-github-runner-207 kernel: [22096.583863] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 11:32:02 juju-e4d256-prod-github-runner-207 kernel: [22096.584894] ? hrtimer_interrupt+0x101/0x220 Aug 22 11:32:02 juju-e4d256-prod-github-runner-207 kernel: [22096.585943] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 11:32:02 juju-e4d256-prod-github-runner-207 kernel: [22096.587059] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 11:32:02 juju-e4d256-prod-github-runner-207 kernel: [22096.588132] Aug 22 11:32:02 juju-e4d256-prod-github-runner-207 kernel: [22096.588989] Aug 22 11:32:02 juju-e4d256-prod-github-runner-207 kernel: [22096.589835] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 11:32:02 juju-e4d256-prod-github-runner-207 kernel: [22096.590877] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:32:02 juju-e4d256-prod-github-runner-207 kernel: [22096.591962] ? _raw_spin_lock+0x22/0x30 Aug 22 11:32:02 juju-e4d256-prod-github-runner-207 kernel: [22096.592930] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:32:02 juju-e4d256-prod-github-runner-207 kernel: [22096.594030] direct_page_fault+0x206/0x310 [kvm] Aug 22 11:32:02 juju-e4d256-prod-github-runner-207 kernel: [22096.595077] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 11:32:02 juju-e4d256-prod-github-runner-207 kernel: [22096.596346] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 11:32:02 juju-e4d256-prod-github-runner-207 kernel: [22096.597361] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 11:32:02 juju-e4d256-prod-github-runner-207 kernel: [22096.598370] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 11:32:02 juju-e4d256-prod-github-runner-207 kernel: [22096.599335] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 11:32:02 juju-e4d256-prod-github-runner-207 kernel: [22096.600325] handle_exit+0x98/0x230 [kvm_amd] Aug 22 11:32:02 juju-e4d256-prod-github-runner-207 kernel: [22096.601225] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 11:32:02 juju-e4d256-prod-github-runner-207 kernel: [22096.602151] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 11:32:02 juju-e4d256-prod-github-runner-207 kernel: [22096.603084] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 11:32:02 juju-e4d256-prod-github-runner-207 kernel: [22096.604008] vcpu_run+0x62/0x2c0 [kvm] Aug 22 11:32:02 juju-e4d256-prod-github-runner-207 kernel: [22096.604823] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 11:32:02 juju-e4d256-prod-github-runner-207 kernel: [22096.605638] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 11:32:02 juju-e4d256-prod-github-runner-207 kernel: [22096.606531] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 11:32:02 juju-e4d256-prod-github-runner-207 kernel: [22096.607360] ? __seccomp_filter+0x4a/0x4a0 Aug 22 11:32:02 juju-e4d256-prod-github-runner-207 kernel: [22096.608129] ? __fget_files+0x86/0xc0 Aug 22 11:32:02 juju-e4d256-prod-github-runner-207 kernel: [22096.608905] __x64_sys_ioctl+0x95/0xd0 Aug 22 11:32:02 juju-e4d256-prod-github-runner-207 kernel: [22096.609629] do_syscall_64+0x5c/0xc0 Aug 22 11:32:02 juju-e4d256-prod-github-runner-207 kernel: [22096.610297] ? do_futex+0x162/0x1f0 Aug 22 11:32:02 juju-e4d256-prod-github-runner-207 kernel: [22096.610950] ? __x64_sys_futex+0x78/0x1e0 Aug 22 11:32:02 juju-e4d256-prod-github-runner-207 kernel: [22096.611644] ? __secure_computing+0xa9/0x120 Aug 22 11:32:02 juju-e4d256-prod-github-runner-207 kernel: [22096.612341] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 11:32:02 juju-e4d256-prod-github-runner-207 kernel: [22096.613109] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:32:02 juju-e4d256-prod-github-runner-207 kernel: [22096.613835] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:32:02 juju-e4d256-prod-github-runner-207 kernel: [22096.614565] ? do_syscall_64+0x69/0xc0 Aug 22 11:32:02 juju-e4d256-prod-github-runner-207 kernel: [22096.615218] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:32:02 juju-e4d256-prod-github-runner-207 kernel: [22096.615959] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:32:02 juju-e4d256-prod-github-runner-207 kernel: [22096.616663] ? do_syscall_64+0x69/0xc0 Aug 22 11:32:02 juju-e4d256-prod-github-runner-207 kernel: [22096.617300] ? do_syscall_64+0x69/0xc0 Aug 22 11:32:02 juju-e4d256-prod-github-runner-207 kernel: [22096.617928] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 11:32:02 juju-e4d256-prod-github-runner-207 kernel: [22096.618642] RIP: 0033:0x7faa5d0edaff Aug 22 11:32:02 juju-e4d256-prod-github-runner-207 kernel: [22096.619340] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 11:32:02 juju-e4d256-prod-github-runner-207 kernel: [22096.621396] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 11:32:02 juju-e4d256-prod-github-runner-207 kernel: [22096.622318] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 11:32:02 juju-e4d256-prod-github-runner-207 kernel: [22096.623249] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 11:32:02 juju-e4d256-prod-github-runner-207 kernel: [22096.624154] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 11:32:02 juju-e4d256-prod-github-runner-207 kernel: [22096.625061] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 11:32:02 juju-e4d256-prod-github-runner-207 kernel: [22096.625985] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 11:32:02 juju-e4d256-prod-github-runner-207 kernel: [22096.626898] Aug 22 11:32:30 juju-e4d256-prod-github-runner-207 kernel: [22124.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 20497s! [qemu-system-x86:6715] Aug 22 11:32:30 juju-e4d256-prod-github-runner-207 kernel: [22124.543123] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 11:32:30 juju-e4d256-prod-github-runner-207 kernel: [22124.543201] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 11:32:30 juju-e4d256-prod-github-runner-207 kernel: [22124.555856] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 11:32:30 juju-e4d256-prod-github-runner-207 kernel: [22124.557183] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 11:32:30 juju-e4d256-prod-github-runner-207 kernel: [22124.558444] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:32:30 juju-e4d256-prod-github-runner-207 kernel: [22124.559518] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 11:32:30 juju-e4d256-prod-github-runner-207 kernel: [22124.562216] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 11:32:30 juju-e4d256-prod-github-runner-207 kernel: [22124.563315] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 11:32:30 juju-e4d256-prod-github-runner-207 kernel: [22124.564478] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 11:32:30 juju-e4d256-prod-github-runner-207 kernel: [22124.565640] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 11:32:30 juju-e4d256-prod-github-runner-207 kernel: [22124.566813] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 11:32:30 juju-e4d256-prod-github-runner-207 kernel: [22124.567985] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 11:32:30 juju-e4d256-prod-github-runner-207 kernel: [22124.569150] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 11:32:30 juju-e4d256-prod-github-runner-207 kernel: [22124.570492] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 11:32:30 juju-e4d256-prod-github-runner-207 kernel: [22124.571768] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 11:32:30 juju-e4d256-prod-github-runner-207 kernel: [22124.572967] Call Trace: Aug 22 11:32:30 juju-e4d256-prod-github-runner-207 kernel: [22124.573884] Aug 22 11:32:30 juju-e4d256-prod-github-runner-207 kernel: [22124.574845] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:32:30 juju-e4d256-prod-github-runner-207 kernel: [22124.575899] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:32:30 juju-e4d256-prod-github-runner-207 kernel: [22124.576920] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:32:30 juju-e4d256-prod-github-runner-207 kernel: [22124.578006] ? show_regs.part.0+0x23/0x29 Aug 22 11:32:30 juju-e4d256-prod-github-runner-207 kernel: [22124.579093] ? show_regs.cold+0x8/0xd Aug 22 11:32:30 juju-e4d256-prod-github-runner-207 kernel: [22124.580110] ? watchdog_timer_fn+0x1be/0x220 Aug 22 11:32:30 juju-e4d256-prod-github-runner-207 kernel: [22124.581120] ? lockup_detector_update_enable+0x60/0x60 Aug 22 11:32:30 juju-e4d256-prod-github-runner-207 kernel: [22124.582183] ? __hrtimer_run_queues+0x107/0x230 Aug 22 11:32:30 juju-e4d256-prod-github-runner-207 kernel: [22124.583236] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 11:32:30 juju-e4d256-prod-github-runner-207 kernel: [22124.584264] ? hrtimer_interrupt+0x101/0x220 Aug 22 11:32:30 juju-e4d256-prod-github-runner-207 kernel: [22124.585282] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 11:32:30 juju-e4d256-prod-github-runner-207 kernel: [22124.586359] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 11:32:30 juju-e4d256-prod-github-runner-207 kernel: [22124.587435] Aug 22 11:32:30 juju-e4d256-prod-github-runner-207 kernel: [22124.588292] Aug 22 11:32:30 juju-e4d256-prod-github-runner-207 kernel: [22124.589137] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 11:32:30 juju-e4d256-prod-github-runner-207 kernel: [22124.590200] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:32:30 juju-e4d256-prod-github-runner-207 kernel: [22124.591274] ? _raw_spin_lock+0x22/0x30 Aug 22 11:32:30 juju-e4d256-prod-github-runner-207 kernel: [22124.592276] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:32:30 juju-e4d256-prod-github-runner-207 kernel: [22124.593315] direct_page_fault+0x206/0x310 [kvm] Aug 22 11:32:30 juju-e4d256-prod-github-runner-207 kernel: [22124.594406] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 11:32:30 juju-e4d256-prod-github-runner-207 kernel: [22124.595452] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 11:32:30 juju-e4d256-prod-github-runner-207 kernel: [22124.596461] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 11:32:30 juju-e4d256-prod-github-runner-207 kernel: [22124.597444] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 11:32:30 juju-e4d256-prod-github-runner-207 kernel: [22124.598402] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 11:32:30 juju-e4d256-prod-github-runner-207 kernel: [22124.599402] handle_exit+0x98/0x230 [kvm_amd] Aug 22 11:32:30 juju-e4d256-prod-github-runner-207 kernel: [22124.600294] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 11:32:30 juju-e4d256-prod-github-runner-207 kernel: [22124.601205] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 11:32:30 juju-e4d256-prod-github-runner-207 kernel: [22124.602131] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 11:32:30 juju-e4d256-prod-github-runner-207 kernel: [22124.603047] vcpu_run+0x62/0x2c0 [kvm] Aug 22 11:32:30 juju-e4d256-prod-github-runner-207 kernel: [22124.603857] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 11:32:30 juju-e4d256-prod-github-runner-207 kernel: [22124.604664] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 11:32:30 juju-e4d256-prod-github-runner-207 kernel: [22124.605516] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 11:32:30 juju-e4d256-prod-github-runner-207 kernel: [22124.606315] ? __seccomp_filter+0x4a/0x4a0 Aug 22 11:32:30 juju-e4d256-prod-github-runner-207 kernel: [22124.607076] ? __fget_files+0x86/0xc0 Aug 22 11:32:30 juju-e4d256-prod-github-runner-207 kernel: [22124.607788] __x64_sys_ioctl+0x95/0xd0 Aug 22 11:32:30 juju-e4d256-prod-github-runner-207 kernel: [22124.608486] do_syscall_64+0x5c/0xc0 Aug 22 11:32:30 juju-e4d256-prod-github-runner-207 kernel: [22124.609158] ? do_futex+0x162/0x1f0 Aug 22 11:32:30 juju-e4d256-prod-github-runner-207 kernel: [22124.609812] ? __x64_sys_futex+0x78/0x1e0 Aug 22 11:32:30 juju-e4d256-prod-github-runner-207 kernel: [22124.610490] ? __secure_computing+0xa9/0x120 Aug 22 11:32:30 juju-e4d256-prod-github-runner-207 kernel: [22124.611202] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 11:32:30 juju-e4d256-prod-github-runner-207 kernel: [22124.611965] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:32:30 juju-e4d256-prod-github-runner-207 kernel: [22124.612687] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:32:30 juju-e4d256-prod-github-runner-207 kernel: [22124.613405] ? do_syscall_64+0x69/0xc0 Aug 22 11:32:30 juju-e4d256-prod-github-runner-207 kernel: [22124.614058] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:32:30 juju-e4d256-prod-github-runner-207 kernel: [22124.614776] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:32:30 juju-e4d256-prod-github-runner-207 kernel: [22124.615487] ? do_syscall_64+0x69/0xc0 Aug 22 11:32:30 juju-e4d256-prod-github-runner-207 kernel: [22124.616115] ? do_syscall_64+0x69/0xc0 Aug 22 11:32:30 juju-e4d256-prod-github-runner-207 kernel: [22124.616740] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 11:32:30 juju-e4d256-prod-github-runner-207 kernel: [22124.617448] RIP: 0033:0x7faa5d0edaff Aug 22 11:32:30 juju-e4d256-prod-github-runner-207 kernel: [22124.618079] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 11:32:30 juju-e4d256-prod-github-runner-207 kernel: [22124.620079] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 11:32:30 juju-e4d256-prod-github-runner-207 kernel: [22124.620990] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 11:32:30 juju-e4d256-prod-github-runner-207 kernel: [22124.621885] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 11:32:30 juju-e4d256-prod-github-runner-207 kernel: [22124.622775] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 11:32:30 juju-e4d256-prod-github-runner-207 kernel: [22124.623682] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 11:32:30 juju-e4d256-prod-github-runner-207 kernel: [22124.624567] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 11:32:30 juju-e4d256-prod-github-runner-207 kernel: [22124.625467] Aug 22 11:32:44 juju-e4d256-prod-github-runner-207 kernel: [22138.664709] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 11:32:44 juju-e4d256-prod-github-runner-207 kernel: [22138.665712] rcu: 1-....: (5488173 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=2657092 Aug 22 11:32:44 juju-e4d256-prod-github-runner-207 kernel: [22138.666847] (t=5505366 jiffies g=23269 q=27689) Aug 22 11:32:44 juju-e4d256-prod-github-runner-207 kernel: [22138.667639] NMI backtrace for cpu 1 Aug 22 11:32:44 juju-e4d256-prod-github-runner-207 kernel: [22138.668360] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 11:32:44 juju-e4d256-prod-github-runner-207 kernel: [22138.669459] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 11:32:44 juju-e4d256-prod-github-runner-207 kernel: [22138.670515] Call Trace: Aug 22 11:32:44 juju-e4d256-prod-github-runner-207 kernel: [22138.671208] Aug 22 11:32:44 juju-e4d256-prod-github-runner-207 kernel: [22138.671852] show_stack+0x52/0x5c Aug 22 11:32:44 juju-e4d256-prod-github-runner-207 kernel: [22138.672575] dump_stack_lvl+0x4a/0x63 Aug 22 11:32:44 juju-e4d256-prod-github-runner-207 kernel: [22138.673326] dump_stack+0x10/0x16 Aug 22 11:32:44 juju-e4d256-prod-github-runner-207 kernel: [22138.674042] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 11:32:44 juju-e4d256-prod-github-runner-207 kernel: [22138.674839] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 11:32:44 juju-e4d256-prod-github-runner-207 kernel: [22138.675617] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 11:32:44 juju-e4d256-prod-github-runner-207 kernel: [22138.676436] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 11:32:44 juju-e4d256-prod-github-runner-207 kernel: [22138.677253] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 11:32:44 juju-e4d256-prod-github-runner-207 kernel: [22138.678059] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 11:32:44 juju-e4d256-prod-github-runner-207 kernel: [22138.678844] print_cpu_stall.cold+0x2f/0xe2 Aug 22 11:32:44 juju-e4d256-prod-github-runner-207 kernel: [22138.679608] ? timekeeping_update+0xf7/0x150 Aug 22 11:32:44 juju-e4d256-prod-github-runner-207 kernel: [22138.680384] check_cpu_stall+0x109/0x270 Aug 22 11:32:44 juju-e4d256-prod-github-runner-207 kernel: [22138.681131] rcu_sched_clock_irq+0x9a/0x250 Aug 22 11:32:44 juju-e4d256-prod-github-runner-207 kernel: [22138.681891] update_process_times+0x94/0xd0 Aug 22 11:32:44 juju-e4d256-prod-github-runner-207 kernel: [22138.682650] tick_sched_handle+0x29/0x70 Aug 22 11:32:44 juju-e4d256-prod-github-runner-207 kernel: [22138.683412] tick_sched_timer+0x8c/0xc0 Aug 22 11:32:44 juju-e4d256-prod-github-runner-207 kernel: [22138.684146] ? tick_nohz_handler+0xb0/0xb0 Aug 22 11:32:44 juju-e4d256-prod-github-runner-207 kernel: [22138.684898] __hrtimer_run_queues+0x107/0x230 Aug 22 11:32:44 juju-e4d256-prod-github-runner-207 kernel: [22138.685668] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 11:32:44 juju-e4d256-prod-github-runner-207 kernel: [22138.686440] hrtimer_interrupt+0x101/0x220 Aug 22 11:32:44 juju-e4d256-prod-github-runner-207 kernel: [22138.687239] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 11:32:44 juju-e4d256-prod-github-runner-207 kernel: [22138.688103] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 11:32:44 juju-e4d256-prod-github-runner-207 kernel: [22138.688907] Aug 22 11:32:44 juju-e4d256-prod-github-runner-207 kernel: [22138.689574] Aug 22 11:32:44 juju-e4d256-prod-github-runner-207 kernel: [22138.690208] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 11:32:44 juju-e4d256-prod-github-runner-207 kernel: [22138.691044] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:32:44 juju-e4d256-prod-github-runner-207 kernel: [22138.691921] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 11:32:44 juju-e4d256-prod-github-runner-207 kernel: [22138.694118] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 11:32:44 juju-e4d256-prod-github-runner-207 kernel: [22138.695006] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 11:32:44 juju-e4d256-prod-github-runner-207 kernel: [22138.695996] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 11:32:44 juju-e4d256-prod-github-runner-207 kernel: [22138.696990] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 11:32:44 juju-e4d256-prod-github-runner-207 kernel: [22138.697948] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 11:32:44 juju-e4d256-prod-github-runner-207 kernel: [22138.698938] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 11:32:44 juju-e4d256-prod-github-runner-207 kernel: [22138.699884] ? _raw_spin_lock+0x22/0x30 Aug 22 11:32:44 juju-e4d256-prod-github-runner-207 kernel: [22138.700642] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:32:44 juju-e4d256-prod-github-runner-207 kernel: [22138.701479] direct_page_fault+0x206/0x310 [kvm] Aug 22 11:32:44 juju-e4d256-prod-github-runner-207 kernel: [22138.702312] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 11:32:44 juju-e4d256-prod-github-runner-207 kernel: [22138.703153] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 11:32:44 juju-e4d256-prod-github-runner-207 kernel: [22138.704023] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 11:32:44 juju-e4d256-prod-github-runner-207 kernel: [22138.704824] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 11:32:44 juju-e4d256-prod-github-runner-207 kernel: [22138.705604] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 11:32:44 juju-e4d256-prod-github-runner-207 kernel: [22138.706421] handle_exit+0x98/0x230 [kvm_amd] Aug 22 11:32:44 juju-e4d256-prod-github-runner-207 kernel: [22138.707184] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 11:32:44 juju-e4d256-prod-github-runner-207 kernel: [22138.707963] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 11:32:44 juju-e4d256-prod-github-runner-207 kernel: [22138.708774] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 11:32:44 juju-e4d256-prod-github-runner-207 kernel: [22138.709561] vcpu_run+0x62/0x2c0 [kvm] Aug 22 11:32:44 juju-e4d256-prod-github-runner-207 kernel: [22138.710280] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 11:32:44 juju-e4d256-prod-github-runner-207 kernel: [22138.711025] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 11:32:44 juju-e4d256-prod-github-runner-207 kernel: [22138.711824] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 11:32:44 juju-e4d256-prod-github-runner-207 kernel: [22138.712582] ? __seccomp_filter+0x4a/0x4a0 Aug 22 11:32:44 juju-e4d256-prod-github-runner-207 kernel: [22138.713304] ? __fget_files+0x86/0xc0 Aug 22 11:32:44 juju-e4d256-prod-github-runner-207 kernel: [22138.713996] __x64_sys_ioctl+0x95/0xd0 Aug 22 11:32:44 juju-e4d256-prod-github-runner-207 kernel: [22138.714689] do_syscall_64+0x5c/0xc0 Aug 22 11:32:44 juju-e4d256-prod-github-runner-207 kernel: [22138.715389] ? do_futex+0x162/0x1f0 Aug 22 11:32:44 juju-e4d256-prod-github-runner-207 kernel: [22138.716063] ? __x64_sys_futex+0x78/0x1e0 Aug 22 11:32:44 juju-e4d256-prod-github-runner-207 kernel: [22138.716760] ? __secure_computing+0xa9/0x120 Aug 22 11:32:44 juju-e4d256-prod-github-runner-207 kernel: [22138.717473] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 11:32:44 juju-e4d256-prod-github-runner-207 kernel: [22138.718259] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:32:44 juju-e4d256-prod-github-runner-207 kernel: [22138.719020] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:32:44 juju-e4d256-prod-github-runner-207 kernel: [22138.719771] ? do_syscall_64+0x69/0xc0 Aug 22 11:32:44 juju-e4d256-prod-github-runner-207 kernel: [22138.720460] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:32:44 juju-e4d256-prod-github-runner-207 kernel: [22138.721233] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:32:44 juju-e4d256-prod-github-runner-207 kernel: [22138.721994] ? do_syscall_64+0x69/0xc0 Aug 22 11:32:44 juju-e4d256-prod-github-runner-207 kernel: [22138.722685] ? do_syscall_64+0x69/0xc0 Aug 22 11:32:44 juju-e4d256-prod-github-runner-207 kernel: [22138.723378] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 11:32:44 juju-e4d256-prod-github-runner-207 kernel: [22138.724146] RIP: 0033:0x7faa5d0edaff Aug 22 11:32:44 juju-e4d256-prod-github-runner-207 kernel: [22138.724830] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 11:32:44 juju-e4d256-prod-github-runner-207 kernel: [22138.726998] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 11:32:44 juju-e4d256-prod-github-runner-207 kernel: [22138.727959] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 11:32:44 juju-e4d256-prod-github-runner-207 kernel: [22138.728903] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 11:32:44 juju-e4d256-prod-github-runner-207 kernel: [22138.729846] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 11:32:44 juju-e4d256-prod-github-runner-207 kernel: [22138.730793] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 11:32:44 juju-e4d256-prod-github-runner-207 kernel: [22138.731731] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 11:32:44 juju-e4d256-prod-github-runner-207 kernel: [22138.732648] Aug 22 11:33:10 juju-e4d256-prod-github-runner-207 kernel: [22164.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 20534s! [qemu-system-x86:6715] Aug 22 11:33:10 juju-e4d256-prod-github-runner-207 kernel: [22164.543237] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 11:33:10 juju-e4d256-prod-github-runner-207 kernel: [22164.543405] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 11:33:10 juju-e4d256-prod-github-runner-207 kernel: [22164.555840] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 11:33:10 juju-e4d256-prod-github-runner-207 kernel: [22164.557131] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 11:33:10 juju-e4d256-prod-github-runner-207 kernel: [22164.558374] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:33:10 juju-e4d256-prod-github-runner-207 kernel: [22164.559467] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 11:33:10 juju-e4d256-prod-github-runner-207 kernel: [22164.562076] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 11:33:10 juju-e4d256-prod-github-runner-207 kernel: [22164.563147] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 11:33:10 juju-e4d256-prod-github-runner-207 kernel: [22164.564332] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 11:33:10 juju-e4d256-prod-github-runner-207 kernel: [22164.565507] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 11:33:10 juju-e4d256-prod-github-runner-207 kernel: [22164.566699] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 11:33:10 juju-e4d256-prod-github-runner-207 kernel: [22164.567882] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 11:33:10 juju-e4d256-prod-github-runner-207 kernel: [22164.569073] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 11:33:10 juju-e4d256-prod-github-runner-207 kernel: [22164.570331] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 11:33:10 juju-e4d256-prod-github-runner-207 kernel: [22164.571465] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 11:33:10 juju-e4d256-prod-github-runner-207 kernel: [22164.572676] Call Trace: Aug 22 11:33:10 juju-e4d256-prod-github-runner-207 kernel: [22164.573602] Aug 22 11:33:10 juju-e4d256-prod-github-runner-207 kernel: [22164.574505] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:33:10 juju-e4d256-prod-github-runner-207 kernel: [22164.575550] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:33:10 juju-e4d256-prod-github-runner-207 kernel: [22164.576587] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:33:10 juju-e4d256-prod-github-runner-207 kernel: [22164.577705] ? show_regs.part.0+0x23/0x29 Aug 22 11:33:10 juju-e4d256-prod-github-runner-207 kernel: [22164.578732] ? show_regs.cold+0x8/0xd Aug 22 11:33:10 juju-e4d256-prod-github-runner-207 kernel: [22164.579713] ? watchdog_timer_fn+0x1be/0x220 Aug 22 11:33:10 juju-e4d256-prod-github-runner-207 kernel: [22164.580738] ? lockup_detector_update_enable+0x60/0x60 Aug 22 11:33:10 juju-e4d256-prod-github-runner-207 kernel: [22164.581816] ? __hrtimer_run_queues+0x107/0x230 Aug 22 11:33:10 juju-e4d256-prod-github-runner-207 kernel: [22164.582879] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 11:33:10 juju-e4d256-prod-github-runner-207 kernel: [22164.583926] ? hrtimer_interrupt+0x101/0x220 Aug 22 11:33:10 juju-e4d256-prod-github-runner-207 kernel: [22164.584956] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 11:33:10 juju-e4d256-prod-github-runner-207 kernel: [22164.586191] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 11:33:10 juju-e4d256-prod-github-runner-207 kernel: [22164.587269] Aug 22 11:33:10 juju-e4d256-prod-github-runner-207 kernel: [22164.588319] Aug 22 11:33:10 juju-e4d256-prod-github-runner-207 kernel: [22164.589173] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 11:33:10 juju-e4d256-prod-github-runner-207 kernel: [22164.590221] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:33:10 juju-e4d256-prod-github-runner-207 kernel: [22164.591294] ? _raw_spin_lock+0x22/0x30 Aug 22 11:33:10 juju-e4d256-prod-github-runner-207 kernel: [22164.592255] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:33:10 juju-e4d256-prod-github-runner-207 kernel: [22164.593291] direct_page_fault+0x206/0x310 [kvm] Aug 22 11:33:10 juju-e4d256-prod-github-runner-207 kernel: [22164.594339] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 11:33:10 juju-e4d256-prod-github-runner-207 kernel: [22164.595377] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 11:33:10 juju-e4d256-prod-github-runner-207 kernel: [22164.596399] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 11:33:10 juju-e4d256-prod-github-runner-207 kernel: [22164.597415] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 11:33:10 juju-e4d256-prod-github-runner-207 kernel: [22164.598374] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 11:33:10 juju-e4d256-prod-github-runner-207 kernel: [22164.599389] handle_exit+0x98/0x230 [kvm_amd] Aug 22 11:33:10 juju-e4d256-prod-github-runner-207 kernel: [22164.600293] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 11:33:10 juju-e4d256-prod-github-runner-207 kernel: [22164.601228] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 11:33:10 juju-e4d256-prod-github-runner-207 kernel: [22164.602163] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 11:33:10 juju-e4d256-prod-github-runner-207 kernel: [22164.603095] vcpu_run+0x62/0x2c0 [kvm] Aug 22 11:33:10 juju-e4d256-prod-github-runner-207 kernel: [22164.603918] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 11:33:10 juju-e4d256-prod-github-runner-207 kernel: [22164.604739] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 11:33:10 juju-e4d256-prod-github-runner-207 kernel: [22164.605613] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 11:33:10 juju-e4d256-prod-github-runner-207 kernel: [22164.606438] ? __seccomp_filter+0x4a/0x4a0 Aug 22 11:33:10 juju-e4d256-prod-github-runner-207 kernel: [22164.607195] ? __fget_files+0x86/0xc0 Aug 22 11:33:10 juju-e4d256-prod-github-runner-207 kernel: [22164.607911] __x64_sys_ioctl+0x95/0xd0 Aug 22 11:33:10 juju-e4d256-prod-github-runner-207 kernel: [22164.608622] do_syscall_64+0x5c/0xc0 Aug 22 11:33:10 juju-e4d256-prod-github-runner-207 kernel: [22164.609302] ? do_futex+0x162/0x1f0 Aug 22 11:33:10 juju-e4d256-prod-github-runner-207 kernel: [22164.609960] ? __x64_sys_futex+0x78/0x1e0 Aug 22 11:33:10 juju-e4d256-prod-github-runner-207 kernel: [22164.610658] ? __secure_computing+0xa9/0x120 Aug 22 11:33:10 juju-e4d256-prod-github-runner-207 kernel: [22164.611367] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 11:33:10 juju-e4d256-prod-github-runner-207 kernel: [22164.612142] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:33:10 juju-e4d256-prod-github-runner-207 kernel: [22164.612876] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:33:10 juju-e4d256-prod-github-runner-207 kernel: [22164.613612] ? do_syscall_64+0x69/0xc0 Aug 22 11:33:10 juju-e4d256-prod-github-runner-207 kernel: [22164.614270] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:33:10 juju-e4d256-prod-github-runner-207 kernel: [22164.615003] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:33:10 juju-e4d256-prod-github-runner-207 kernel: [22164.615708] ? do_syscall_64+0x69/0xc0 Aug 22 11:33:10 juju-e4d256-prod-github-runner-207 kernel: [22164.616345] ? do_syscall_64+0x69/0xc0 Aug 22 11:33:10 juju-e4d256-prod-github-runner-207 kernel: [22164.616976] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 11:33:10 juju-e4d256-prod-github-runner-207 kernel: [22164.617695] RIP: 0033:0x7faa5d0edaff Aug 22 11:33:10 juju-e4d256-prod-github-runner-207 kernel: [22164.618337] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 11:33:10 juju-e4d256-prod-github-runner-207 kernel: [22164.620396] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 11:33:10 juju-e4d256-prod-github-runner-207 kernel: [22164.621348] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 11:33:10 juju-e4d256-prod-github-runner-207 kernel: [22164.622261] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 11:33:10 juju-e4d256-prod-github-runner-207 kernel: [22164.623189] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 11:33:10 juju-e4d256-prod-github-runner-207 kernel: [22164.624090] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 11:33:10 juju-e4d256-prod-github-runner-207 kernel: [22164.624992] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 11:33:10 juju-e4d256-prod-github-runner-207 kernel: [22164.625893] Aug 22 11:33:38 juju-e4d256-prod-github-runner-207 kernel: [22192.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 20560s! [qemu-system-x86:6715] Aug 22 11:33:38 juju-e4d256-prod-github-runner-207 kernel: [22192.544081] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 11:33:38 juju-e4d256-prod-github-runner-207 kernel: [22192.544319] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 11:33:38 juju-e4d256-prod-github-runner-207 kernel: [22192.556650] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 11:33:38 juju-e4d256-prod-github-runner-207 kernel: [22192.557931] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 11:33:38 juju-e4d256-prod-github-runner-207 kernel: [22192.559170] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:33:38 juju-e4d256-prod-github-runner-207 kernel: [22192.560227] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 11:33:38 juju-e4d256-prod-github-runner-207 kernel: [22192.562789] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 11:33:38 juju-e4d256-prod-github-runner-207 kernel: [22192.563831] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 11:33:38 juju-e4d256-prod-github-runner-207 kernel: [22192.564994] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 11:33:38 juju-e4d256-prod-github-runner-207 kernel: [22192.566177] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 11:33:38 juju-e4d256-prod-github-runner-207 kernel: [22192.567398] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 11:33:38 juju-e4d256-prod-github-runner-207 kernel: [22192.568562] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 11:33:38 juju-e4d256-prod-github-runner-207 kernel: [22192.569744] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 11:33:38 juju-e4d256-prod-github-runner-207 kernel: [22192.571043] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 11:33:38 juju-e4d256-prod-github-runner-207 kernel: [22192.572149] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 11:33:38 juju-e4d256-prod-github-runner-207 kernel: [22192.573342] Call Trace: Aug 22 11:33:38 juju-e4d256-prod-github-runner-207 kernel: [22192.574272] Aug 22 11:33:38 juju-e4d256-prod-github-runner-207 kernel: [22192.575183] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:33:38 juju-e4d256-prod-github-runner-207 kernel: [22192.576217] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:33:38 juju-e4d256-prod-github-runner-207 kernel: [22192.577249] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:33:38 juju-e4d256-prod-github-runner-207 kernel: [22192.578341] ? show_regs.part.0+0x23/0x29 Aug 22 11:33:38 juju-e4d256-prod-github-runner-207 kernel: [22192.579336] ? show_regs.cold+0x8/0xd Aug 22 11:33:38 juju-e4d256-prod-github-runner-207 kernel: [22192.580312] ? watchdog_timer_fn+0x1be/0x220 Aug 22 11:33:38 juju-e4d256-prod-github-runner-207 kernel: [22192.581323] ? lockup_detector_update_enable+0x60/0x60 Aug 22 11:33:38 juju-e4d256-prod-github-runner-207 kernel: [22192.582422] ? __hrtimer_run_queues+0x107/0x230 Aug 22 11:33:38 juju-e4d256-prod-github-runner-207 kernel: [22192.583453] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 11:33:38 juju-e4d256-prod-github-runner-207 kernel: [22192.584474] ? hrtimer_interrupt+0x101/0x220 Aug 22 11:33:38 juju-e4d256-prod-github-runner-207 kernel: [22192.585488] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 11:33:38 juju-e4d256-prod-github-runner-207 kernel: [22192.586566] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 11:33:38 juju-e4d256-prod-github-runner-207 kernel: [22192.587615] Aug 22 11:33:38 juju-e4d256-prod-github-runner-207 kernel: [22192.588466] Aug 22 11:33:38 juju-e4d256-prod-github-runner-207 kernel: [22192.589301] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 11:33:38 juju-e4d256-prod-github-runner-207 kernel: [22192.590339] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:33:38 juju-e4d256-prod-github-runner-207 kernel: [22192.591377] ? _raw_spin_lock+0x22/0x30 Aug 22 11:33:38 juju-e4d256-prod-github-runner-207 kernel: [22192.592319] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:33:38 juju-e4d256-prod-github-runner-207 kernel: [22192.593338] direct_page_fault+0x206/0x310 [kvm] Aug 22 11:33:38 juju-e4d256-prod-github-runner-207 kernel: [22192.594370] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 11:33:38 juju-e4d256-prod-github-runner-207 kernel: [22192.595384] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 11:33:38 juju-e4d256-prod-github-runner-207 kernel: [22192.596387] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 11:33:38 juju-e4d256-prod-github-runner-207 kernel: [22192.597365] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 11:33:38 juju-e4d256-prod-github-runner-207 kernel: [22192.598318] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 11:33:38 juju-e4d256-prod-github-runner-207 kernel: [22192.599295] handle_exit+0x98/0x230 [kvm_amd] Aug 22 11:33:38 juju-e4d256-prod-github-runner-207 kernel: [22192.600186] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 11:33:38 juju-e4d256-prod-github-runner-207 kernel: [22192.601098] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 11:33:38 juju-e4d256-prod-github-runner-207 kernel: [22192.602019] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 11:33:38 juju-e4d256-prod-github-runner-207 kernel: [22192.602937] vcpu_run+0x62/0x2c0 [kvm] Aug 22 11:33:38 juju-e4d256-prod-github-runner-207 kernel: [22192.603750] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 11:33:38 juju-e4d256-prod-github-runner-207 kernel: [22192.604561] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 11:33:38 juju-e4d256-prod-github-runner-207 kernel: [22192.605415] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 11:33:38 juju-e4d256-prod-github-runner-207 kernel: [22192.606220] ? __seccomp_filter+0x4a/0x4a0 Aug 22 11:33:38 juju-e4d256-prod-github-runner-207 kernel: [22192.606965] ? __fget_files+0x86/0xc0 Aug 22 11:33:38 juju-e4d256-prod-github-runner-207 kernel: [22192.607666] __x64_sys_ioctl+0x95/0xd0 Aug 22 11:33:38 juju-e4d256-prod-github-runner-207 kernel: [22192.608356] do_syscall_64+0x5c/0xc0 Aug 22 11:33:38 juju-e4d256-prod-github-runner-207 kernel: [22192.609020] ? do_futex+0x162/0x1f0 Aug 22 11:33:38 juju-e4d256-prod-github-runner-207 kernel: [22192.609671] ? __x64_sys_futex+0x78/0x1e0 Aug 22 11:33:38 juju-e4d256-prod-github-runner-207 kernel: [22192.610359] ? __secure_computing+0xa9/0x120 Aug 22 11:33:38 juju-e4d256-prod-github-runner-207 kernel: [22192.611049] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 11:33:38 juju-e4d256-prod-github-runner-207 kernel: [22192.611856] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:33:38 juju-e4d256-prod-github-runner-207 kernel: [22192.612584] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:33:38 juju-e4d256-prod-github-runner-207 kernel: [22192.613308] ? do_syscall_64+0x69/0xc0 Aug 22 11:33:38 juju-e4d256-prod-github-runner-207 kernel: [22192.613951] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:33:38 juju-e4d256-prod-github-runner-207 kernel: [22192.614662] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:33:38 juju-e4d256-prod-github-runner-207 kernel: [22192.615360] ? do_syscall_64+0x69/0xc0 Aug 22 11:33:38 juju-e4d256-prod-github-runner-207 kernel: [22192.615985] ? do_syscall_64+0x69/0xc0 Aug 22 11:33:38 juju-e4d256-prod-github-runner-207 kernel: [22192.616605] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 11:33:38 juju-e4d256-prod-github-runner-207 kernel: [22192.617324] RIP: 0033:0x7faa5d0edaff Aug 22 11:33:38 juju-e4d256-prod-github-runner-207 kernel: [22192.617970] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 11:33:38 juju-e4d256-prod-github-runner-207 kernel: [22192.619964] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 11:33:38 juju-e4d256-prod-github-runner-207 kernel: [22192.620872] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 11:33:38 juju-e4d256-prod-github-runner-207 kernel: [22192.621758] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 11:33:38 juju-e4d256-prod-github-runner-207 kernel: [22192.622646] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 11:33:38 juju-e4d256-prod-github-runner-207 kernel: [22192.623533] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 11:33:38 juju-e4d256-prod-github-runner-207 kernel: [22192.624423] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 11:33:38 juju-e4d256-prod-github-runner-207 kernel: [22192.625317] Aug 22 11:34:06 juju-e4d256-prod-github-runner-207 kernel: [22220.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 20586s! [qemu-system-x86:6715] Aug 22 11:34:06 juju-e4d256-prod-github-runner-207 kernel: [22220.543798] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 11:34:06 juju-e4d256-prod-github-runner-207 kernel: [22220.543894] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 11:34:06 juju-e4d256-prod-github-runner-207 kernel: [22220.557832] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 11:34:06 juju-e4d256-prod-github-runner-207 kernel: [22220.559111] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 11:34:06 juju-e4d256-prod-github-runner-207 kernel: [22220.560343] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:34:06 juju-e4d256-prod-github-runner-207 kernel: [22220.561412] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 11:34:06 juju-e4d256-prod-github-runner-207 kernel: [22220.563984] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 11:34:06 juju-e4d256-prod-github-runner-207 kernel: [22220.565031] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 11:34:06 juju-e4d256-prod-github-runner-207 kernel: [22220.566373] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 11:34:06 juju-e4d256-prod-github-runner-207 kernel: [22220.567535] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 11:34:06 juju-e4d256-prod-github-runner-207 kernel: [22220.568703] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 11:34:06 juju-e4d256-prod-github-runner-207 kernel: [22220.569880] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 11:34:06 juju-e4d256-prod-github-runner-207 kernel: [22220.571050] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 11:34:06 juju-e4d256-prod-github-runner-207 kernel: [22220.572291] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 11:34:06 juju-e4d256-prod-github-runner-207 kernel: [22220.573398] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 11:34:06 juju-e4d256-prod-github-runner-207 kernel: [22220.574628] Call Trace: Aug 22 11:34:06 juju-e4d256-prod-github-runner-207 kernel: [22220.575562] Aug 22 11:34:06 juju-e4d256-prod-github-runner-207 kernel: [22220.576449] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:34:06 juju-e4d256-prod-github-runner-207 kernel: [22220.577488] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:34:06 juju-e4d256-prod-github-runner-207 kernel: [22220.578541] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:34:06 juju-e4d256-prod-github-runner-207 kernel: [22220.579678] ? show_regs.part.0+0x23/0x29 Aug 22 11:34:06 juju-e4d256-prod-github-runner-207 kernel: [22220.580755] ? show_regs.cold+0x8/0xd Aug 22 11:34:06 juju-e4d256-prod-github-runner-207 kernel: [22220.581850] ? watchdog_timer_fn+0x1be/0x220 Aug 22 11:34:06 juju-e4d256-prod-github-runner-207 kernel: [22220.582912] ? lockup_detector_update_enable+0x60/0x60 Aug 22 11:34:06 juju-e4d256-prod-github-runner-207 kernel: [22220.584010] ? __hrtimer_run_queues+0x107/0x230 Aug 22 11:34:06 juju-e4d256-prod-github-runner-207 kernel: [22220.585044] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 11:34:06 juju-e4d256-prod-github-runner-207 kernel: [22220.586077] ? hrtimer_interrupt+0x101/0x220 Aug 22 11:34:06 juju-e4d256-prod-github-runner-207 kernel: [22220.587126] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 11:34:06 juju-e4d256-prod-github-runner-207 kernel: [22220.588202] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 11:34:06 juju-e4d256-prod-github-runner-207 kernel: [22220.589245] Aug 22 11:34:06 juju-e4d256-prod-github-runner-207 kernel: [22220.590134] Aug 22 11:34:06 juju-e4d256-prod-github-runner-207 kernel: [22220.590992] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 11:34:06 juju-e4d256-prod-github-runner-207 kernel: [22220.592053] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:34:06 juju-e4d256-prod-github-runner-207 kernel: [22220.593090] ? _raw_spin_lock+0x22/0x30 Aug 22 11:34:06 juju-e4d256-prod-github-runner-207 kernel: [22220.594121] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:34:06 juju-e4d256-prod-github-runner-207 kernel: [22220.595159] direct_page_fault+0x206/0x310 [kvm] Aug 22 11:34:06 juju-e4d256-prod-github-runner-207 kernel: [22220.596194] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 11:34:06 juju-e4d256-prod-github-runner-207 kernel: [22220.597231] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 11:34:06 juju-e4d256-prod-github-runner-207 kernel: [22220.598252] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 11:34:06 juju-e4d256-prod-github-runner-207 kernel: [22220.599221] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 11:34:06 juju-e4d256-prod-github-runner-207 kernel: [22220.600165] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 11:34:06 juju-e4d256-prod-github-runner-207 kernel: [22220.601142] handle_exit+0x98/0x230 [kvm_amd] Aug 22 11:34:06 juju-e4d256-prod-github-runner-207 kernel: [22220.602041] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 11:34:06 juju-e4d256-prod-github-runner-207 kernel: [22220.602963] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 11:34:06 juju-e4d256-prod-github-runner-207 kernel: [22220.603890] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 11:34:06 juju-e4d256-prod-github-runner-207 kernel: [22220.604795] vcpu_run+0x62/0x2c0 [kvm] Aug 22 11:34:06 juju-e4d256-prod-github-runner-207 kernel: [22220.605605] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 11:34:06 juju-e4d256-prod-github-runner-207 kernel: [22220.606420] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 11:34:06 juju-e4d256-prod-github-runner-207 kernel: [22220.607272] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 11:34:06 juju-e4d256-prod-github-runner-207 kernel: [22220.608066] ? __seccomp_filter+0x4a/0x4a0 Aug 22 11:34:06 juju-e4d256-prod-github-runner-207 kernel: [22220.608811] ? __fget_files+0x86/0xc0 Aug 22 11:34:06 juju-e4d256-prod-github-runner-207 kernel: [22220.609513] __x64_sys_ioctl+0x95/0xd0 Aug 22 11:34:06 juju-e4d256-prod-github-runner-207 kernel: [22220.610212] do_syscall_64+0x5c/0xc0 Aug 22 11:34:06 juju-e4d256-prod-github-runner-207 kernel: [22220.610875] ? do_futex+0x162/0x1f0 Aug 22 11:34:06 juju-e4d256-prod-github-runner-207 kernel: [22220.611544] ? __x64_sys_futex+0x78/0x1e0 Aug 22 11:34:06 juju-e4d256-prod-github-runner-207 kernel: [22220.612233] ? __secure_computing+0xa9/0x120 Aug 22 11:34:06 juju-e4d256-prod-github-runner-207 kernel: [22220.612936] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 11:34:06 juju-e4d256-prod-github-runner-207 kernel: [22220.613703] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:34:06 juju-e4d256-prod-github-runner-207 kernel: [22220.614445] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:34:06 juju-e4d256-prod-github-runner-207 kernel: [22220.615166] ? do_syscall_64+0x69/0xc0 Aug 22 11:34:06 juju-e4d256-prod-github-runner-207 kernel: [22220.615818] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:34:06 juju-e4d256-prod-github-runner-207 kernel: [22220.616530] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:34:06 juju-e4d256-prod-github-runner-207 kernel: [22220.617239] ? do_syscall_64+0x69/0xc0 Aug 22 11:34:06 juju-e4d256-prod-github-runner-207 kernel: [22220.617888] ? do_syscall_64+0x69/0xc0 Aug 22 11:34:06 juju-e4d256-prod-github-runner-207 kernel: [22220.618513] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 11:34:06 juju-e4d256-prod-github-runner-207 kernel: [22220.619222] RIP: 0033:0x7faa5d0edaff Aug 22 11:34:06 juju-e4d256-prod-github-runner-207 kernel: [22220.619854] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 11:34:06 juju-e4d256-prod-github-runner-207 kernel: [22220.621864] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 11:34:06 juju-e4d256-prod-github-runner-207 kernel: [22220.622773] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 11:34:06 juju-e4d256-prod-github-runner-207 kernel: [22220.623661] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 11:34:06 juju-e4d256-prod-github-runner-207 kernel: [22220.624549] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 11:34:06 juju-e4d256-prod-github-runner-207 kernel: [22220.625440] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 11:34:06 juju-e4d256-prod-github-runner-207 kernel: [22220.626350] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 11:34:06 juju-e4d256-prod-github-runner-207 kernel: [22220.627259] Aug 22 11:34:34 juju-e4d256-prod-github-runner-207 kernel: [22248.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 20612s! [qemu-system-x86:6715] Aug 22 11:34:34 juju-e4d256-prod-github-runner-207 kernel: [22248.543109] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 11:34:34 juju-e4d256-prod-github-runner-207 kernel: [22248.543185] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 11:34:34 juju-e4d256-prod-github-runner-207 kernel: [22248.555499] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 11:34:34 juju-e4d256-prod-github-runner-207 kernel: [22248.556766] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 11:34:34 juju-e4d256-prod-github-runner-207 kernel: [22248.557993] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:34:34 juju-e4d256-prod-github-runner-207 kernel: [22248.559050] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 11:34:34 juju-e4d256-prod-github-runner-207 kernel: [22248.561601] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 11:34:34 juju-e4d256-prod-github-runner-207 kernel: [22248.562654] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 11:34:34 juju-e4d256-prod-github-runner-207 kernel: [22248.563824] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 11:34:34 juju-e4d256-prod-github-runner-207 kernel: [22248.564984] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 11:34:34 juju-e4d256-prod-github-runner-207 kernel: [22248.566164] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 11:34:34 juju-e4d256-prod-github-runner-207 kernel: [22248.567327] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 11:34:34 juju-e4d256-prod-github-runner-207 kernel: [22248.568497] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 11:34:34 juju-e4d256-prod-github-runner-207 kernel: [22248.569742] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 11:34:34 juju-e4d256-prod-github-runner-207 kernel: [22248.570843] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 11:34:34 juju-e4d256-prod-github-runner-207 kernel: [22248.572040] Call Trace: Aug 22 11:34:34 juju-e4d256-prod-github-runner-207 kernel: [22248.572954] Aug 22 11:34:34 juju-e4d256-prod-github-runner-207 kernel: [22248.573867] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:34:34 juju-e4d256-prod-github-runner-207 kernel: [22248.574902] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:34:34 juju-e4d256-prod-github-runner-207 kernel: [22248.575927] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:34:34 juju-e4d256-prod-github-runner-207 kernel: [22248.577002] ? show_regs.part.0+0x23/0x29 Aug 22 11:34:34 juju-e4d256-prod-github-runner-207 kernel: [22248.578013] ? show_regs.cold+0x8/0xd Aug 22 11:34:34 juju-e4d256-prod-github-runner-207 kernel: [22248.578988] ? watchdog_timer_fn+0x1be/0x220 Aug 22 11:34:34 juju-e4d256-prod-github-runner-207 kernel: [22248.579994] ? lockup_detector_update_enable+0x60/0x60 Aug 22 11:34:34 juju-e4d256-prod-github-runner-207 kernel: [22248.581060] ? __hrtimer_run_queues+0x107/0x230 Aug 22 11:34:34 juju-e4d256-prod-github-runner-207 kernel: [22248.582100] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 11:34:34 juju-e4d256-prod-github-runner-207 kernel: [22248.583127] ? hrtimer_interrupt+0x101/0x220 Aug 22 11:34:34 juju-e4d256-prod-github-runner-207 kernel: [22248.584139] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 11:34:34 juju-e4d256-prod-github-runner-207 kernel: [22248.585208] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 11:34:34 juju-e4d256-prod-github-runner-207 kernel: [22248.586261] Aug 22 11:34:34 juju-e4d256-prod-github-runner-207 kernel: [22248.587148] Aug 22 11:34:34 juju-e4d256-prod-github-runner-207 kernel: [22248.587992] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 11:34:34 juju-e4d256-prod-github-runner-207 kernel: [22248.589021] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:34:34 juju-e4d256-prod-github-runner-207 kernel: [22248.590065] ? _raw_spin_lock+0x22/0x30 Aug 22 11:34:34 juju-e4d256-prod-github-runner-207 kernel: [22248.591008] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:34:34 juju-e4d256-prod-github-runner-207 kernel: [22248.592024] direct_page_fault+0x206/0x310 [kvm] Aug 22 11:34:34 juju-e4d256-prod-github-runner-207 kernel: [22248.593048] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 11:34:34 juju-e4d256-prod-github-runner-207 kernel: [22248.594068] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 11:34:34 juju-e4d256-prod-github-runner-207 kernel: [22248.595072] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 11:34:34 juju-e4d256-prod-github-runner-207 kernel: [22248.596041] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 11:34:34 juju-e4d256-prod-github-runner-207 kernel: [22248.596986] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 11:34:34 juju-e4d256-prod-github-runner-207 kernel: [22248.597978] handle_exit+0x98/0x230 [kvm_amd] Aug 22 11:34:34 juju-e4d256-prod-github-runner-207 kernel: [22248.598870] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 11:34:34 juju-e4d256-prod-github-runner-207 kernel: [22248.599781] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 11:34:34 juju-e4d256-prod-github-runner-207 kernel: [22248.600701] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 11:34:34 juju-e4d256-prod-github-runner-207 kernel: [22248.601609] vcpu_run+0x62/0x2c0 [kvm] Aug 22 11:34:34 juju-e4d256-prod-github-runner-207 kernel: [22248.602424] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 11:34:34 juju-e4d256-prod-github-runner-207 kernel: [22248.603235] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 11:34:34 juju-e4d256-prod-github-runner-207 kernel: [22248.604097] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 11:34:34 juju-e4d256-prod-github-runner-207 kernel: [22248.604904] ? __seccomp_filter+0x4a/0x4a0 Aug 22 11:34:34 juju-e4d256-prod-github-runner-207 kernel: [22248.605676] ? __fget_files+0x86/0xc0 Aug 22 11:34:34 juju-e4d256-prod-github-runner-207 kernel: [22248.606382] __x64_sys_ioctl+0x95/0xd0 Aug 22 11:34:34 juju-e4d256-prod-github-runner-207 kernel: [22248.607074] do_syscall_64+0x5c/0xc0 Aug 22 11:34:34 juju-e4d256-prod-github-runner-207 kernel: [22248.607738] ? do_futex+0x162/0x1f0 Aug 22 11:34:34 juju-e4d256-prod-github-runner-207 kernel: [22248.608385] ? __x64_sys_futex+0x78/0x1e0 Aug 22 11:34:34 juju-e4d256-prod-github-runner-207 kernel: [22248.609057] ? __secure_computing+0xa9/0x120 Aug 22 11:34:34 juju-e4d256-prod-github-runner-207 kernel: [22248.609752] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 11:34:34 juju-e4d256-prod-github-runner-207 kernel: [22248.610512] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:34:34 juju-e4d256-prod-github-runner-207 kernel: [22248.611233] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:34:34 juju-e4d256-prod-github-runner-207 kernel: [22248.611951] ? do_syscall_64+0x69/0xc0 Aug 22 11:34:34 juju-e4d256-prod-github-runner-207 kernel: [22248.612596] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:34:34 juju-e4d256-prod-github-runner-207 kernel: [22248.613300] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:34:34 juju-e4d256-prod-github-runner-207 kernel: [22248.614004] ? do_syscall_64+0x69/0xc0 Aug 22 11:34:34 juju-e4d256-prod-github-runner-207 kernel: [22248.614630] ? do_syscall_64+0x69/0xc0 Aug 22 11:34:34 juju-e4d256-prod-github-runner-207 kernel: [22248.615252] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 11:34:34 juju-e4d256-prod-github-runner-207 kernel: [22248.615957] RIP: 0033:0x7faa5d0edaff Aug 22 11:34:34 juju-e4d256-prod-github-runner-207 kernel: [22248.616607] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 11:34:34 juju-e4d256-prod-github-runner-207 kernel: [22248.618612] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 11:34:34 juju-e4d256-prod-github-runner-207 kernel: [22248.619523] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 11:34:34 juju-e4d256-prod-github-runner-207 kernel: [22248.620419] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 11:34:34 juju-e4d256-prod-github-runner-207 kernel: [22248.621308] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 11:34:34 juju-e4d256-prod-github-runner-207 kernel: [22248.622221] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 11:34:34 juju-e4d256-prod-github-runner-207 kernel: [22248.623114] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 11:34:34 juju-e4d256-prod-github-runner-207 kernel: [22248.624010] Aug 22 11:35:02 juju-e4d256-prod-github-runner-207 kernel: [22276.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 20638s! [qemu-system-x86:6715] Aug 22 11:35:02 juju-e4d256-prod-github-runner-207 kernel: [22276.543882] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 11:35:02 juju-e4d256-prod-github-runner-207 kernel: [22276.544169] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 11:35:02 juju-e4d256-prod-github-runner-207 kernel: [22276.556438] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 11:35:02 juju-e4d256-prod-github-runner-207 kernel: [22276.557791] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 11:35:02 juju-e4d256-prod-github-runner-207 kernel: [22276.559064] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:35:02 juju-e4d256-prod-github-runner-207 kernel: [22276.560214] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 11:35:02 juju-e4d256-prod-github-runner-207 kernel: [22276.562782] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 11:35:02 juju-e4d256-prod-github-runner-207 kernel: [22276.563863] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 11:35:02 juju-e4d256-prod-github-runner-207 kernel: [22276.565032] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 11:35:02 juju-e4d256-prod-github-runner-207 kernel: [22276.566229] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 11:35:02 juju-e4d256-prod-github-runner-207 kernel: [22276.567400] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 11:35:02 juju-e4d256-prod-github-runner-207 kernel: [22276.568618] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 11:35:02 juju-e4d256-prod-github-runner-207 kernel: [22276.569825] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 11:35:02 juju-e4d256-prod-github-runner-207 kernel: [22276.571065] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 11:35:02 juju-e4d256-prod-github-runner-207 kernel: [22276.572202] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 11:35:02 juju-e4d256-prod-github-runner-207 kernel: [22276.573429] Call Trace: Aug 22 11:35:02 juju-e4d256-prod-github-runner-207 kernel: [22276.574386] Aug 22 11:35:02 juju-e4d256-prod-github-runner-207 kernel: [22276.575314] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:35:02 juju-e4d256-prod-github-runner-207 kernel: [22276.576354] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:35:02 juju-e4d256-prod-github-runner-207 kernel: [22276.577480] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:35:02 juju-e4d256-prod-github-runner-207 kernel: [22276.578593] ? show_regs.part.0+0x23/0x29 Aug 22 11:35:02 juju-e4d256-prod-github-runner-207 kernel: [22276.579620] ? show_regs.cold+0x8/0xd Aug 22 11:35:02 juju-e4d256-prod-github-runner-207 kernel: [22276.580599] ? watchdog_timer_fn+0x1be/0x220 Aug 22 11:35:02 juju-e4d256-prod-github-runner-207 kernel: [22276.581626] ? lockup_detector_update_enable+0x60/0x60 Aug 22 11:35:02 juju-e4d256-prod-github-runner-207 kernel: [22276.582730] ? __hrtimer_run_queues+0x107/0x230 Aug 22 11:35:02 juju-e4d256-prod-github-runner-207 kernel: [22276.583784] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 11:35:02 juju-e4d256-prod-github-runner-207 kernel: [22276.584815] ? hrtimer_interrupt+0x101/0x220 Aug 22 11:35:02 juju-e4d256-prod-github-runner-207 kernel: [22276.585850] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 11:35:02 juju-e4d256-prod-github-runner-207 kernel: [22276.586940] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 11:35:02 juju-e4d256-prod-github-runner-207 kernel: [22276.588019] Aug 22 11:35:02 juju-e4d256-prod-github-runner-207 kernel: [22276.588899] Aug 22 11:35:02 juju-e4d256-prod-github-runner-207 kernel: [22276.589751] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 11:35:02 juju-e4d256-prod-github-runner-207 kernel: [22276.590785] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:35:02 juju-e4d256-prod-github-runner-207 kernel: [22276.591828] ? _raw_spin_lock+0x22/0x30 Aug 22 11:35:02 juju-e4d256-prod-github-runner-207 kernel: [22276.592773] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:35:02 juju-e4d256-prod-github-runner-207 kernel: [22276.593800] direct_page_fault+0x206/0x310 [kvm] Aug 22 11:35:02 juju-e4d256-prod-github-runner-207 kernel: [22276.594853] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 11:35:02 juju-e4d256-prod-github-runner-207 kernel: [22276.595875] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 11:35:02 juju-e4d256-prod-github-runner-207 kernel: [22276.597019] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 11:35:02 juju-e4d256-prod-github-runner-207 kernel: [22276.598042] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 11:35:02 juju-e4d256-prod-github-runner-207 kernel: [22276.599025] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 11:35:02 juju-e4d256-prod-github-runner-207 kernel: [22276.600059] handle_exit+0x98/0x230 [kvm_amd] Aug 22 11:35:02 juju-e4d256-prod-github-runner-207 kernel: [22276.600967] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 11:35:02 juju-e4d256-prod-github-runner-207 kernel: [22276.601918] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 11:35:02 juju-e4d256-prod-github-runner-207 kernel: [22276.602848] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 11:35:02 juju-e4d256-prod-github-runner-207 kernel: [22276.603752] vcpu_run+0x62/0x2c0 [kvm] Aug 22 11:35:02 juju-e4d256-prod-github-runner-207 kernel: [22276.604568] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 11:35:02 juju-e4d256-prod-github-runner-207 kernel: [22276.605419] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 11:35:02 juju-e4d256-prod-github-runner-207 kernel: [22276.606280] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 11:35:02 juju-e4d256-prod-github-runner-207 kernel: [22276.607081] ? __seccomp_filter+0x4a/0x4a0 Aug 22 11:35:02 juju-e4d256-prod-github-runner-207 kernel: [22276.607821] ? __fget_files+0x86/0xc0 Aug 22 11:35:02 juju-e4d256-prod-github-runner-207 kernel: [22276.608523] __x64_sys_ioctl+0x95/0xd0 Aug 22 11:35:02 juju-e4d256-prod-github-runner-207 kernel: [22276.609235] do_syscall_64+0x5c/0xc0 Aug 22 11:35:02 juju-e4d256-prod-github-runner-207 kernel: [22276.609899] ? do_futex+0x162/0x1f0 Aug 22 11:35:02 juju-e4d256-prod-github-runner-207 kernel: [22276.610544] ? __x64_sys_futex+0x78/0x1e0 Aug 22 11:35:02 juju-e4d256-prod-github-runner-207 kernel: [22276.611221] ? __secure_computing+0xa9/0x120 Aug 22 11:35:02 juju-e4d256-prod-github-runner-207 kernel: [22276.611917] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 11:35:02 juju-e4d256-prod-github-runner-207 kernel: [22276.612675] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:35:02 juju-e4d256-prod-github-runner-207 kernel: [22276.613411] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:35:02 juju-e4d256-prod-github-runner-207 kernel: [22276.614127] ? do_syscall_64+0x69/0xc0 Aug 22 11:35:02 juju-e4d256-prod-github-runner-207 kernel: [22276.614770] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:35:02 juju-e4d256-prod-github-runner-207 kernel: [22276.615471] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:35:02 juju-e4d256-prod-github-runner-207 kernel: [22276.616163] ? do_syscall_64+0x69/0xc0 Aug 22 11:35:02 juju-e4d256-prod-github-runner-207 kernel: [22276.616786] ? do_syscall_64+0x69/0xc0 Aug 22 11:35:02 juju-e4d256-prod-github-runner-207 kernel: [22276.617424] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 11:35:02 juju-e4d256-prod-github-runner-207 kernel: [22276.618172] RIP: 0033:0x7faa5d0edaff Aug 22 11:35:02 juju-e4d256-prod-github-runner-207 kernel: [22276.618864] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 11:35:02 juju-e4d256-prod-github-runner-207 kernel: [22276.620988] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 11:35:02 juju-e4d256-prod-github-runner-207 kernel: [22276.621916] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 11:35:02 juju-e4d256-prod-github-runner-207 kernel: [22276.622806] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 11:35:02 juju-e4d256-prod-github-runner-207 kernel: [22276.623695] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 11:35:02 juju-e4d256-prod-github-runner-207 kernel: [22276.624580] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 11:35:02 juju-e4d256-prod-github-runner-207 kernel: [22276.625473] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 11:35:02 juju-e4d256-prod-github-runner-207 kernel: [22276.626373] Aug 22 11:35:30 juju-e4d256-prod-github-runner-207 kernel: [22304.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 20664s! [qemu-system-x86:6715] Aug 22 11:35:30 juju-e4d256-prod-github-runner-207 kernel: [22304.543120] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 11:35:30 juju-e4d256-prod-github-runner-207 kernel: [22304.543195] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 11:35:30 juju-e4d256-prod-github-runner-207 kernel: [22304.555262] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 11:35:30 juju-e4d256-prod-github-runner-207 kernel: [22304.556518] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 11:35:30 juju-e4d256-prod-github-runner-207 kernel: [22304.557774] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:35:30 juju-e4d256-prod-github-runner-207 kernel: [22304.558837] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 11:35:30 juju-e4d256-prod-github-runner-207 kernel: [22304.561410] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 11:35:30 juju-e4d256-prod-github-runner-207 kernel: [22304.562454] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 11:35:30 juju-e4d256-prod-github-runner-207 kernel: [22304.563630] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 11:35:30 juju-e4d256-prod-github-runner-207 kernel: [22304.564839] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 11:35:30 juju-e4d256-prod-github-runner-207 kernel: [22304.566019] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 11:35:30 juju-e4d256-prod-github-runner-207 kernel: [22304.567191] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 11:35:30 juju-e4d256-prod-github-runner-207 kernel: [22304.568384] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 11:35:30 juju-e4d256-prod-github-runner-207 kernel: [22304.569639] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 11:35:30 juju-e4d256-prod-github-runner-207 kernel: [22304.570735] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 11:35:30 juju-e4d256-prod-github-runner-207 kernel: [22304.571925] Call Trace: Aug 22 11:35:30 juju-e4d256-prod-github-runner-207 kernel: [22304.572863] Aug 22 11:35:30 juju-e4d256-prod-github-runner-207 kernel: [22304.573755] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:35:30 juju-e4d256-prod-github-runner-207 kernel: [22304.574788] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:35:30 juju-e4d256-prod-github-runner-207 kernel: [22304.575807] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:35:30 juju-e4d256-prod-github-runner-207 kernel: [22304.576898] ? show_regs.part.0+0x23/0x29 Aug 22 11:35:30 juju-e4d256-prod-github-runner-207 kernel: [22304.577902] ? show_regs.cold+0x8/0xd Aug 22 11:35:30 juju-e4d256-prod-github-runner-207 kernel: [22304.578871] ? watchdog_timer_fn+0x1be/0x220 Aug 22 11:35:30 juju-e4d256-prod-github-runner-207 kernel: [22304.579890] ? lockup_detector_update_enable+0x60/0x60 Aug 22 11:35:30 juju-e4d256-prod-github-runner-207 kernel: [22304.581007] ? __hrtimer_run_queues+0x107/0x230 Aug 22 11:35:30 juju-e4d256-prod-github-runner-207 kernel: [22304.582040] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 11:35:30 juju-e4d256-prod-github-runner-207 kernel: [22304.583081] ? hrtimer_interrupt+0x101/0x220 Aug 22 11:35:30 juju-e4d256-prod-github-runner-207 kernel: [22304.584096] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 11:35:30 juju-e4d256-prod-github-runner-207 kernel: [22304.585184] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 11:35:30 juju-e4d256-prod-github-runner-207 kernel: [22304.586230] Aug 22 11:35:30 juju-e4d256-prod-github-runner-207 kernel: [22304.587081] Aug 22 11:35:30 juju-e4d256-prod-github-runner-207 kernel: [22304.587921] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 11:35:30 juju-e4d256-prod-github-runner-207 kernel: [22304.588968] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:35:30 juju-e4d256-prod-github-runner-207 kernel: [22304.590008] ? _raw_spin_lock+0x22/0x30 Aug 22 11:35:30 juju-e4d256-prod-github-runner-207 kernel: [22304.590950] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:35:30 juju-e4d256-prod-github-runner-207 kernel: [22304.591963] direct_page_fault+0x206/0x310 [kvm] Aug 22 11:35:30 juju-e4d256-prod-github-runner-207 kernel: [22304.593004] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 11:35:30 juju-e4d256-prod-github-runner-207 kernel: [22304.594010] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 11:35:30 juju-e4d256-prod-github-runner-207 kernel: [22304.595011] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 11:35:30 juju-e4d256-prod-github-runner-207 kernel: [22304.595991] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 11:35:30 juju-e4d256-prod-github-runner-207 kernel: [22304.596959] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 11:35:30 juju-e4d256-prod-github-runner-207 kernel: [22304.597935] handle_exit+0x98/0x230 [kvm_amd] Aug 22 11:35:30 juju-e4d256-prod-github-runner-207 kernel: [22304.598823] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 11:35:30 juju-e4d256-prod-github-runner-207 kernel: [22304.599733] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 11:35:30 juju-e4d256-prod-github-runner-207 kernel: [22304.600667] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 11:35:30 juju-e4d256-prod-github-runner-207 kernel: [22304.601608] vcpu_run+0x62/0x2c0 [kvm] Aug 22 11:35:30 juju-e4d256-prod-github-runner-207 kernel: [22304.602432] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 11:35:30 juju-e4d256-prod-github-runner-207 kernel: [22304.603246] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 11:35:30 juju-e4d256-prod-github-runner-207 kernel: [22304.604100] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 11:35:30 juju-e4d256-prod-github-runner-207 kernel: [22304.604916] ? __seccomp_filter+0x4a/0x4a0 Aug 22 11:35:30 juju-e4d256-prod-github-runner-207 kernel: [22304.605665] ? __fget_files+0x86/0xc0 Aug 22 11:35:30 juju-e4d256-prod-github-runner-207 kernel: [22304.606373] __x64_sys_ioctl+0x95/0xd0 Aug 22 11:35:30 juju-e4d256-prod-github-runner-207 kernel: [22304.607062] do_syscall_64+0x5c/0xc0 Aug 22 11:35:30 juju-e4d256-prod-github-runner-207 kernel: [22304.607725] ? do_futex+0x162/0x1f0 Aug 22 11:35:30 juju-e4d256-prod-github-runner-207 kernel: [22304.608396] ? __x64_sys_futex+0x78/0x1e0 Aug 22 11:35:30 juju-e4d256-prod-github-runner-207 kernel: [22304.609090] ? __secure_computing+0xa9/0x120 Aug 22 11:35:30 juju-e4d256-prod-github-runner-207 kernel: [22304.609805] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 11:35:30 juju-e4d256-prod-github-runner-207 kernel: [22304.610564] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:35:30 juju-e4d256-prod-github-runner-207 kernel: [22304.611309] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:35:30 juju-e4d256-prod-github-runner-207 kernel: [22304.612059] ? do_syscall_64+0x69/0xc0 Aug 22 11:35:30 juju-e4d256-prod-github-runner-207 kernel: [22304.612703] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:35:30 juju-e4d256-prod-github-runner-207 kernel: [22304.613424] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:35:30 juju-e4d256-prod-github-runner-207 kernel: [22304.614120] ? do_syscall_64+0x69/0xc0 Aug 22 11:35:30 juju-e4d256-prod-github-runner-207 kernel: [22304.614761] ? do_syscall_64+0x69/0xc0 Aug 22 11:35:30 juju-e4d256-prod-github-runner-207 kernel: [22304.615396] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 11:35:30 juju-e4d256-prod-github-runner-207 kernel: [22304.616098] RIP: 0033:0x7faa5d0edaff Aug 22 11:35:30 juju-e4d256-prod-github-runner-207 kernel: [22304.616740] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 11:35:30 juju-e4d256-prod-github-runner-207 kernel: [22304.618744] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 11:35:30 juju-e4d256-prod-github-runner-207 kernel: [22304.619652] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 11:35:30 juju-e4d256-prod-github-runner-207 kernel: [22304.620540] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 11:35:30 juju-e4d256-prod-github-runner-207 kernel: [22304.621441] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 11:35:30 juju-e4d256-prod-github-runner-207 kernel: [22304.622323] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 11:35:30 juju-e4d256-prod-github-runner-207 kernel: [22304.623244] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 11:35:30 juju-e4d256-prod-github-runner-207 kernel: [22304.624165] Aug 22 11:35:44 juju-e4d256-prod-github-runner-207 kernel: [22318.676706] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 11:35:44 juju-e4d256-prod-github-runner-207 kernel: [22318.677657] rcu: 1-....: (5533041 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=2678662 Aug 22 11:35:44 juju-e4d256-prod-github-runner-207 kernel: [22318.678791] (t=5550369 jiffies g=23269 q=27801) Aug 22 11:35:44 juju-e4d256-prod-github-runner-207 kernel: [22318.679610] NMI backtrace for cpu 1 Aug 22 11:35:44 juju-e4d256-prod-github-runner-207 kernel: [22318.680316] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 11:35:44 juju-e4d256-prod-github-runner-207 kernel: [22318.681437] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 11:35:44 juju-e4d256-prod-github-runner-207 kernel: [22318.682563] Call Trace: Aug 22 11:35:44 juju-e4d256-prod-github-runner-207 kernel: [22318.683316] Aug 22 11:35:44 juju-e4d256-prod-github-runner-207 kernel: [22318.683971] show_stack+0x52/0x5c Aug 22 11:35:44 juju-e4d256-prod-github-runner-207 kernel: [22318.684908] dump_stack_lvl+0x4a/0x63 Aug 22 11:35:44 juju-e4d256-prod-github-runner-207 kernel: [22318.685684] dump_stack+0x10/0x16 Aug 22 11:35:44 juju-e4d256-prod-github-runner-207 kernel: [22318.686441] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 11:35:44 juju-e4d256-prod-github-runner-207 kernel: [22318.687246] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 11:35:44 juju-e4d256-prod-github-runner-207 kernel: [22318.688061] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 11:35:44 juju-e4d256-prod-github-runner-207 kernel: [22318.688933] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 11:35:44 juju-e4d256-prod-github-runner-207 kernel: [22318.689862] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 11:35:44 juju-e4d256-prod-github-runner-207 kernel: [22318.690668] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 11:35:44 juju-e4d256-prod-github-runner-207 kernel: [22318.691464] print_cpu_stall.cold+0x2f/0xe2 Aug 22 11:35:44 juju-e4d256-prod-github-runner-207 kernel: [22318.692228] ? timekeeping_update+0xf7/0x150 Aug 22 11:35:44 juju-e4d256-prod-github-runner-207 kernel: [22318.693046] check_cpu_stall+0x109/0x270 Aug 22 11:35:44 juju-e4d256-prod-github-runner-207 kernel: [22318.693834] rcu_sched_clock_irq+0x9a/0x250 Aug 22 11:35:44 juju-e4d256-prod-github-runner-207 kernel: [22318.694665] update_process_times+0x94/0xd0 Aug 22 11:35:44 juju-e4d256-prod-github-runner-207 kernel: [22318.695534] tick_sched_handle+0x29/0x70 Aug 22 11:35:44 juju-e4d256-prod-github-runner-207 kernel: [22318.696366] tick_sched_timer+0x8c/0xc0 Aug 22 11:35:44 juju-e4d256-prod-github-runner-207 kernel: [22318.697142] ? tick_nohz_handler+0xb0/0xb0 Aug 22 11:35:44 juju-e4d256-prod-github-runner-207 kernel: [22318.697897] __hrtimer_run_queues+0x107/0x230 Aug 22 11:35:44 juju-e4d256-prod-github-runner-207 kernel: [22318.698705] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 11:35:44 juju-e4d256-prod-github-runner-207 kernel: [22318.699487] hrtimer_interrupt+0x101/0x220 Aug 22 11:35:44 juju-e4d256-prod-github-runner-207 kernel: [22318.700249] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 11:35:44 juju-e4d256-prod-github-runner-207 kernel: [22318.701081] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 11:35:44 juju-e4d256-prod-github-runner-207 kernel: [22318.701908] Aug 22 11:35:44 juju-e4d256-prod-github-runner-207 kernel: [22318.702566] Aug 22 11:35:44 juju-e4d256-prod-github-runner-207 kernel: [22318.703197] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 11:35:44 juju-e4d256-prod-github-runner-207 kernel: [22318.704035] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:35:44 juju-e4d256-prod-github-runner-207 kernel: [22318.704946] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 11:35:44 juju-e4d256-prod-github-runner-207 kernel: [22318.707155] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 11:35:44 juju-e4d256-prod-github-runner-207 kernel: [22318.708045] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 11:35:44 juju-e4d256-prod-github-runner-207 kernel: [22318.709058] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 11:35:44 juju-e4d256-prod-github-runner-207 kernel: [22318.710031] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 11:35:44 juju-e4d256-prod-github-runner-207 kernel: [22318.710999] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 11:35:44 juju-e4d256-prod-github-runner-207 kernel: [22318.711959] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 11:35:44 juju-e4d256-prod-github-runner-207 kernel: [22318.712927] ? _raw_spin_lock+0x22/0x30 Aug 22 11:35:44 juju-e4d256-prod-github-runner-207 kernel: [22318.713686] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:35:44 juju-e4d256-prod-github-runner-207 kernel: [22318.714558] direct_page_fault+0x206/0x310 [kvm] Aug 22 11:35:44 juju-e4d256-prod-github-runner-207 kernel: [22318.715451] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 11:35:44 juju-e4d256-prod-github-runner-207 kernel: [22318.716288] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 11:35:44 juju-e4d256-prod-github-runner-207 kernel: [22318.717163] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 11:35:44 juju-e4d256-prod-github-runner-207 kernel: [22318.718027] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 11:35:44 juju-e4d256-prod-github-runner-207 kernel: [22318.718827] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 11:35:44 juju-e4d256-prod-github-runner-207 kernel: [22318.719650] handle_exit+0x98/0x230 [kvm_amd] Aug 22 11:35:44 juju-e4d256-prod-github-runner-207 kernel: [22318.720426] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 11:35:44 juju-e4d256-prod-github-runner-207 kernel: [22318.721237] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 11:35:44 juju-e4d256-prod-github-runner-207 kernel: [22318.722038] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 11:35:44 juju-e4d256-prod-github-runner-207 kernel: [22318.722850] vcpu_run+0x62/0x2c0 [kvm] Aug 22 11:35:44 juju-e4d256-prod-github-runner-207 kernel: [22318.723577] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 11:35:44 juju-e4d256-prod-github-runner-207 kernel: [22318.724311] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 11:35:44 juju-e4d256-prod-github-runner-207 kernel: [22318.725178] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 11:35:44 juju-e4d256-prod-github-runner-207 kernel: [22318.725941] ? __seccomp_filter+0x4a/0x4a0 Aug 22 11:35:44 juju-e4d256-prod-github-runner-207 kernel: [22318.726663] ? __fget_files+0x86/0xc0 Aug 22 11:35:44 juju-e4d256-prod-github-runner-207 kernel: [22318.727354] __x64_sys_ioctl+0x95/0xd0 Aug 22 11:35:44 juju-e4d256-prod-github-runner-207 kernel: [22318.728052] do_syscall_64+0x5c/0xc0 Aug 22 11:35:44 juju-e4d256-prod-github-runner-207 kernel: [22318.728755] ? do_futex+0x162/0x1f0 Aug 22 11:35:44 juju-e4d256-prod-github-runner-207 kernel: [22318.729442] ? __x64_sys_futex+0x78/0x1e0 Aug 22 11:35:44 juju-e4d256-prod-github-runner-207 kernel: [22318.730142] ? __secure_computing+0xa9/0x120 Aug 22 11:35:44 juju-e4d256-prod-github-runner-207 kernel: [22318.730860] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 11:35:44 juju-e4d256-prod-github-runner-207 kernel: [22318.731656] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:35:44 juju-e4d256-prod-github-runner-207 kernel: [22318.732408] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:35:44 juju-e4d256-prod-github-runner-207 kernel: [22318.733177] ? do_syscall_64+0x69/0xc0 Aug 22 11:35:44 juju-e4d256-prod-github-runner-207 kernel: [22318.733869] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:35:44 juju-e4d256-prod-github-runner-207 kernel: [22318.734621] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:35:44 juju-e4d256-prod-github-runner-207 kernel: [22318.735390] ? do_syscall_64+0x69/0xc0 Aug 22 11:35:44 juju-e4d256-prod-github-runner-207 kernel: [22318.736085] ? do_syscall_64+0x69/0xc0 Aug 22 11:35:44 juju-e4d256-prod-github-runner-207 kernel: [22318.736790] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 11:35:44 juju-e4d256-prod-github-runner-207 kernel: [22318.737611] RIP: 0033:0x7faa5d0edaff Aug 22 11:35:44 juju-e4d256-prod-github-runner-207 kernel: [22318.738325] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 11:35:44 juju-e4d256-prod-github-runner-207 kernel: [22318.740432] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 11:35:44 juju-e4d256-prod-github-runner-207 kernel: [22318.741451] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 11:35:44 juju-e4d256-prod-github-runner-207 kernel: [22318.742392] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 11:35:44 juju-e4d256-prod-github-runner-207 kernel: [22318.743340] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 11:35:44 juju-e4d256-prod-github-runner-207 kernel: [22318.744293] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 11:35:44 juju-e4d256-prod-github-runner-207 kernel: [22318.745246] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 11:35:44 juju-e4d256-prod-github-runner-207 kernel: [22318.746169] Aug 22 11:36:10 juju-e4d256-prod-github-runner-207 kernel: [22344.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 20701s! [qemu-system-x86:6715] Aug 22 11:36:10 juju-e4d256-prod-github-runner-207 kernel: [22344.543240] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 11:36:10 juju-e4d256-prod-github-runner-207 kernel: [22344.543541] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 11:36:10 juju-e4d256-prod-github-runner-207 kernel: [22344.555631] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 11:36:10 juju-e4d256-prod-github-runner-207 kernel: [22344.556905] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 11:36:10 juju-e4d256-prod-github-runner-207 kernel: [22344.558146] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:36:10 juju-e4d256-prod-github-runner-207 kernel: [22344.559201] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 11:36:10 juju-e4d256-prod-github-runner-207 kernel: [22344.561762] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 11:36:10 juju-e4d256-prod-github-runner-207 kernel: [22344.562808] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 11:36:10 juju-e4d256-prod-github-runner-207 kernel: [22344.563974] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 11:36:10 juju-e4d256-prod-github-runner-207 kernel: [22344.565141] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 11:36:10 juju-e4d256-prod-github-runner-207 kernel: [22344.566305] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 11:36:10 juju-e4d256-prod-github-runner-207 kernel: [22344.567468] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 11:36:10 juju-e4d256-prod-github-runner-207 kernel: [22344.568648] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 11:36:10 juju-e4d256-prod-github-runner-207 kernel: [22344.569886] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 11:36:10 juju-e4d256-prod-github-runner-207 kernel: [22344.570986] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 11:36:10 juju-e4d256-prod-github-runner-207 kernel: [22344.572181] Call Trace: Aug 22 11:36:10 juju-e4d256-prod-github-runner-207 kernel: [22344.573110] Aug 22 11:36:10 juju-e4d256-prod-github-runner-207 kernel: [22344.574014] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:36:10 juju-e4d256-prod-github-runner-207 kernel: [22344.575049] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:36:10 juju-e4d256-prod-github-runner-207 kernel: [22344.576068] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:36:10 juju-e4d256-prod-github-runner-207 kernel: [22344.577182] ? show_regs.part.0+0x23/0x29 Aug 22 11:36:10 juju-e4d256-prod-github-runner-207 kernel: [22344.578178] ? show_regs.cold+0x8/0xd Aug 22 11:36:10 juju-e4d256-prod-github-runner-207 kernel: [22344.579148] ? watchdog_timer_fn+0x1be/0x220 Aug 22 11:36:10 juju-e4d256-prod-github-runner-207 kernel: [22344.580160] ? lockup_detector_update_enable+0x60/0x60 Aug 22 11:36:10 juju-e4d256-prod-github-runner-207 kernel: [22344.581232] ? __hrtimer_run_queues+0x107/0x230 Aug 22 11:36:10 juju-e4d256-prod-github-runner-207 kernel: [22344.582258] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 11:36:10 juju-e4d256-prod-github-runner-207 kernel: [22344.583284] ? hrtimer_interrupt+0x101/0x220 Aug 22 11:36:10 juju-e4d256-prod-github-runner-207 kernel: [22344.584309] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 11:36:10 juju-e4d256-prod-github-runner-207 kernel: [22344.585376] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 11:36:10 juju-e4d256-prod-github-runner-207 kernel: [22344.586424] Aug 22 11:36:10 juju-e4d256-prod-github-runner-207 kernel: [22344.587276] Aug 22 11:36:10 juju-e4d256-prod-github-runner-207 kernel: [22344.588110] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 11:36:10 juju-e4d256-prod-github-runner-207 kernel: [22344.589155] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:36:10 juju-e4d256-prod-github-runner-207 kernel: [22344.590192] ? _raw_spin_lock+0x22/0x30 Aug 22 11:36:10 juju-e4d256-prod-github-runner-207 kernel: [22344.591140] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:36:10 juju-e4d256-prod-github-runner-207 kernel: [22344.592154] direct_page_fault+0x206/0x310 [kvm] Aug 22 11:36:10 juju-e4d256-prod-github-runner-207 kernel: [22344.593188] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 11:36:10 juju-e4d256-prod-github-runner-207 kernel: [22344.594194] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 11:36:10 juju-e4d256-prod-github-runner-207 kernel: [22344.595192] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 11:36:10 juju-e4d256-prod-github-runner-207 kernel: [22344.596183] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 11:36:10 juju-e4d256-prod-github-runner-207 kernel: [22344.597138] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 11:36:10 juju-e4d256-prod-github-runner-207 kernel: [22344.598132] handle_exit+0x98/0x230 [kvm_amd] Aug 22 11:36:10 juju-e4d256-prod-github-runner-207 kernel: [22344.599033] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 11:36:10 juju-e4d256-prod-github-runner-207 kernel: [22344.599955] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 11:36:10 juju-e4d256-prod-github-runner-207 kernel: [22344.600886] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 11:36:10 juju-e4d256-prod-github-runner-207 kernel: [22344.601796] vcpu_run+0x62/0x2c0 [kvm] Aug 22 11:36:10 juju-e4d256-prod-github-runner-207 kernel: [22344.602606] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 11:36:10 juju-e4d256-prod-github-runner-207 kernel: [22344.603411] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 11:36:10 juju-e4d256-prod-github-runner-207 kernel: [22344.604273] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 11:36:10 juju-e4d256-prod-github-runner-207 kernel: [22344.605076] ? __seccomp_filter+0x4a/0x4a0 Aug 22 11:36:10 juju-e4d256-prod-github-runner-207 kernel: [22344.605823] ? __fget_files+0x86/0xc0 Aug 22 11:36:10 juju-e4d256-prod-github-runner-207 kernel: [22344.606524] __x64_sys_ioctl+0x95/0xd0 Aug 22 11:36:10 juju-e4d256-prod-github-runner-207 kernel: [22344.607214] do_syscall_64+0x5c/0xc0 Aug 22 11:36:10 juju-e4d256-prod-github-runner-207 kernel: [22344.607881] ? do_futex+0x162/0x1f0 Aug 22 11:36:10 juju-e4d256-prod-github-runner-207 kernel: [22344.608534] ? __x64_sys_futex+0x78/0x1e0 Aug 22 11:36:10 juju-e4d256-prod-github-runner-207 kernel: [22344.609212] ? __secure_computing+0xa9/0x120 Aug 22 11:36:10 juju-e4d256-prod-github-runner-207 kernel: [22344.609900] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 11:36:10 juju-e4d256-prod-github-runner-207 kernel: [22344.610655] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:36:10 juju-e4d256-prod-github-runner-207 kernel: [22344.611379] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:36:10 juju-e4d256-prod-github-runner-207 kernel: [22344.612098] ? do_syscall_64+0x69/0xc0 Aug 22 11:36:10 juju-e4d256-prod-github-runner-207 kernel: [22344.612747] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:36:10 juju-e4d256-prod-github-runner-207 kernel: [22344.613447] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:36:10 juju-e4d256-prod-github-runner-207 kernel: [22344.614143] ? do_syscall_64+0x69/0xc0 Aug 22 11:36:10 juju-e4d256-prod-github-runner-207 kernel: [22344.614765] ? do_syscall_64+0x69/0xc0 Aug 22 11:36:10 juju-e4d256-prod-github-runner-207 kernel: [22344.615384] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 11:36:10 juju-e4d256-prod-github-runner-207 kernel: [22344.616085] RIP: 0033:0x7faa5d0edaff Aug 22 11:36:10 juju-e4d256-prod-github-runner-207 kernel: [22344.616746] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 11:36:10 juju-e4d256-prod-github-runner-207 kernel: [22344.618724] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 11:36:10 juju-e4d256-prod-github-runner-207 kernel: [22344.619630] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 11:36:10 juju-e4d256-prod-github-runner-207 kernel: [22344.620526] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 11:36:10 juju-e4d256-prod-github-runner-207 kernel: [22344.621417] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 11:36:10 juju-e4d256-prod-github-runner-207 kernel: [22344.622302] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 11:36:10 juju-e4d256-prod-github-runner-207 kernel: [22344.623187] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 11:36:10 juju-e4d256-prod-github-runner-207 kernel: [22344.624076] Aug 22 11:36:38 juju-e4d256-prod-github-runner-207 kernel: [22372.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 20728s! [qemu-system-x86:6715] Aug 22 11:36:38 juju-e4d256-prod-github-runner-207 kernel: [22372.543858] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 11:36:38 juju-e4d256-prod-github-runner-207 kernel: [22372.544052] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 11:36:38 juju-e4d256-prod-github-runner-207 kernel: [22372.556256] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 11:36:38 juju-e4d256-prod-github-runner-207 kernel: [22372.557537] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 11:36:38 juju-e4d256-prod-github-runner-207 kernel: [22372.558759] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:36:38 juju-e4d256-prod-github-runner-207 kernel: [22372.559838] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 11:36:38 juju-e4d256-prod-github-runner-207 kernel: [22372.562406] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 11:36:38 juju-e4d256-prod-github-runner-207 kernel: [22372.563459] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 11:36:38 juju-e4d256-prod-github-runner-207 kernel: [22372.564653] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 11:36:38 juju-e4d256-prod-github-runner-207 kernel: [22372.565813] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 11:36:38 juju-e4d256-prod-github-runner-207 kernel: [22372.566970] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 11:36:38 juju-e4d256-prod-github-runner-207 kernel: [22372.568148] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 11:36:38 juju-e4d256-prod-github-runner-207 kernel: [22372.569315] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 11:36:38 juju-e4d256-prod-github-runner-207 kernel: [22372.570547] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 11:36:38 juju-e4d256-prod-github-runner-207 kernel: [22372.571648] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 11:36:38 juju-e4d256-prod-github-runner-207 kernel: [22372.572855] Call Trace: Aug 22 11:36:38 juju-e4d256-prod-github-runner-207 kernel: [22372.573769] Aug 22 11:36:38 juju-e4d256-prod-github-runner-207 kernel: [22372.574656] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:36:38 juju-e4d256-prod-github-runner-207 kernel: [22372.575684] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:36:38 juju-e4d256-prod-github-runner-207 kernel: [22372.576718] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:36:38 juju-e4d256-prod-github-runner-207 kernel: [22372.577799] ? show_regs.part.0+0x23/0x29 Aug 22 11:36:38 juju-e4d256-prod-github-runner-207 kernel: [22372.578799] ? show_regs.cold+0x8/0xd Aug 22 11:36:38 juju-e4d256-prod-github-runner-207 kernel: [22372.579767] ? watchdog_timer_fn+0x1be/0x220 Aug 22 11:36:38 juju-e4d256-prod-github-runner-207 kernel: [22372.580802] ? lockup_detector_update_enable+0x60/0x60 Aug 22 11:36:38 juju-e4d256-prod-github-runner-207 kernel: [22372.581865] ? __hrtimer_run_queues+0x107/0x230 Aug 22 11:36:38 juju-e4d256-prod-github-runner-207 kernel: [22372.582899] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 11:36:38 juju-e4d256-prod-github-runner-207 kernel: [22372.583936] ? hrtimer_interrupt+0x101/0x220 Aug 22 11:36:38 juju-e4d256-prod-github-runner-207 kernel: [22372.584950] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 11:36:38 juju-e4d256-prod-github-runner-207 kernel: [22372.586018] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 11:36:38 juju-e4d256-prod-github-runner-207 kernel: [22372.587065] Aug 22 11:36:38 juju-e4d256-prod-github-runner-207 kernel: [22372.587938] Aug 22 11:36:38 juju-e4d256-prod-github-runner-207 kernel: [22372.588776] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 11:36:38 juju-e4d256-prod-github-runner-207 kernel: [22372.589819] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:36:38 juju-e4d256-prod-github-runner-207 kernel: [22372.590875] ? _raw_spin_lock+0x22/0x30 Aug 22 11:36:38 juju-e4d256-prod-github-runner-207 kernel: [22372.592014] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:36:38 juju-e4d256-prod-github-runner-207 kernel: [22372.593064] direct_page_fault+0x206/0x310 [kvm] Aug 22 11:36:38 juju-e4d256-prod-github-runner-207 kernel: [22372.594131] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 11:36:38 juju-e4d256-prod-github-runner-207 kernel: [22372.595144] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 11:36:38 juju-e4d256-prod-github-runner-207 kernel: [22372.596207] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 11:36:38 juju-e4d256-prod-github-runner-207 kernel: [22372.597222] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 11:36:38 juju-e4d256-prod-github-runner-207 kernel: [22372.598194] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 11:36:38 juju-e4d256-prod-github-runner-207 kernel: [22372.599220] handle_exit+0x98/0x230 [kvm_amd] Aug 22 11:36:38 juju-e4d256-prod-github-runner-207 kernel: [22372.600151] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 11:36:38 juju-e4d256-prod-github-runner-207 kernel: [22372.601087] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 11:36:38 juju-e4d256-prod-github-runner-207 kernel: [22372.602016] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 11:36:38 juju-e4d256-prod-github-runner-207 kernel: [22372.602938] vcpu_run+0x62/0x2c0 [kvm] Aug 22 11:36:38 juju-e4d256-prod-github-runner-207 kernel: [22372.603776] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 11:36:38 juju-e4d256-prod-github-runner-207 kernel: [22372.604662] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 11:36:38 juju-e4d256-prod-github-runner-207 kernel: [22372.605544] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 11:36:38 juju-e4d256-prod-github-runner-207 kernel: [22372.606350] ? __seccomp_filter+0x4a/0x4a0 Aug 22 11:36:38 juju-e4d256-prod-github-runner-207 kernel: [22372.607096] ? __fget_files+0x86/0xc0 Aug 22 11:36:38 juju-e4d256-prod-github-runner-207 kernel: [22372.607843] __x64_sys_ioctl+0x95/0xd0 Aug 22 11:36:38 juju-e4d256-prod-github-runner-207 kernel: [22372.608573] do_syscall_64+0x5c/0xc0 Aug 22 11:36:38 juju-e4d256-prod-github-runner-207 kernel: [22372.609256] ? do_futex+0x162/0x1f0 Aug 22 11:36:38 juju-e4d256-prod-github-runner-207 kernel: [22372.609911] ? __x64_sys_futex+0x78/0x1e0 Aug 22 11:36:38 juju-e4d256-prod-github-runner-207 kernel: [22372.610588] ? __secure_computing+0xa9/0x120 Aug 22 11:36:38 juju-e4d256-prod-github-runner-207 kernel: [22372.611288] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 11:36:38 juju-e4d256-prod-github-runner-207 kernel: [22372.612073] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:36:38 juju-e4d256-prod-github-runner-207 kernel: [22372.612795] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:36:38 juju-e4d256-prod-github-runner-207 kernel: [22372.613535] ? do_syscall_64+0x69/0xc0 Aug 22 11:36:38 juju-e4d256-prod-github-runner-207 kernel: [22372.614202] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:36:38 juju-e4d256-prod-github-runner-207 kernel: [22372.614914] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:36:38 juju-e4d256-prod-github-runner-207 kernel: [22372.615612] ? do_syscall_64+0x69/0xc0 Aug 22 11:36:38 juju-e4d256-prod-github-runner-207 kernel: [22372.616252] ? do_syscall_64+0x69/0xc0 Aug 22 11:36:38 juju-e4d256-prod-github-runner-207 kernel: [22372.616951] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 11:36:38 juju-e4d256-prod-github-runner-207 kernel: [22372.617672] RIP: 0033:0x7faa5d0edaff Aug 22 11:36:38 juju-e4d256-prod-github-runner-207 kernel: [22372.618333] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 11:36:38 juju-e4d256-prod-github-runner-207 kernel: [22372.620364] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 11:36:38 juju-e4d256-prod-github-runner-207 kernel: [22372.621291] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 11:36:38 juju-e4d256-prod-github-runner-207 kernel: [22372.622190] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 11:36:38 juju-e4d256-prod-github-runner-207 kernel: [22372.623083] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 11:36:38 juju-e4d256-prod-github-runner-207 kernel: [22372.624000] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 11:36:38 juju-e4d256-prod-github-runner-207 kernel: [22372.624952] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 11:36:38 juju-e4d256-prod-github-runner-207 kernel: [22372.625859] Aug 22 11:37:06 juju-e4d256-prod-github-runner-207 kernel: [22400.542228] watchdog: BUG: soft lockup - CPU#1 stuck for 20754s! [qemu-system-x86:6715] Aug 22 11:37:06 juju-e4d256-prod-github-runner-207 kernel: [22400.544955] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 11:37:06 juju-e4d256-prod-github-runner-207 kernel: [22400.545031] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 11:37:06 juju-e4d256-prod-github-runner-207 kernel: [22400.561644] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 11:37:06 juju-e4d256-prod-github-runner-207 kernel: [22400.562967] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 11:37:06 juju-e4d256-prod-github-runner-207 kernel: [22400.564239] RIP: 0010:native_queued_spin_lock_slowpath+0xc/0x40 Aug 22 11:37:06 juju-e4d256-prod-github-runner-207 kernel: [22400.565303] Code: fe ff ff eb af 4c 89 fe 48 c7 c7 20 99 e9 89 e8 ca 69 55 00 e9 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 <8b> 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 eb Aug 22 11:37:06 juju-e4d256-prod-github-runner-207 kernel: [22400.567903] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 11:37:06 juju-e4d256-prod-github-runner-207 kernel: [22400.568978] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 11:37:06 juju-e4d256-prod-github-runner-207 kernel: [22400.570151] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 11:37:06 juju-e4d256-prod-github-runner-207 kernel: [22400.571324] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 11:37:06 juju-e4d256-prod-github-runner-207 kernel: [22400.572511] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 11:37:06 juju-e4d256-prod-github-runner-207 kernel: [22400.573694] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 11:37:06 juju-e4d256-prod-github-runner-207 kernel: [22400.574879] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 11:37:06 juju-e4d256-prod-github-runner-207 kernel: [22400.576131] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 11:37:06 juju-e4d256-prod-github-runner-207 kernel: [22400.577261] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 11:37:06 juju-e4d256-prod-github-runner-207 kernel: [22400.578478] Call Trace: Aug 22 11:37:06 juju-e4d256-prod-github-runner-207 kernel: [22400.579414] Aug 22 11:37:06 juju-e4d256-prod-github-runner-207 kernel: [22400.580330] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:37:06 juju-e4d256-prod-github-runner-207 kernel: [22400.581368] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:37:06 juju-e4d256-prod-github-runner-207 kernel: [22400.582399] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:37:06 juju-e4d256-prod-github-runner-207 kernel: [22400.583500] ? show_regs.part.0+0x23/0x29 Aug 22 11:37:06 juju-e4d256-prod-github-runner-207 kernel: [22400.584525] ? show_regs.cold+0x8/0xd Aug 22 11:37:06 juju-e4d256-prod-github-runner-207 kernel: [22400.585510] ? watchdog_timer_fn+0x1be/0x220 Aug 22 11:37:06 juju-e4d256-prod-github-runner-207 kernel: [22400.586649] ? lockup_detector_update_enable+0x60/0x60 Aug 22 11:37:06 juju-e4d256-prod-github-runner-207 kernel: [22400.587844] ? __hrtimer_run_queues+0x107/0x230 Aug 22 11:37:06 juju-e4d256-prod-github-runner-207 kernel: [22400.588981] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 11:37:06 juju-e4d256-prod-github-runner-207 kernel: [22400.590121] ? hrtimer_interrupt+0x101/0x220 Aug 22 11:37:06 juju-e4d256-prod-github-runner-207 kernel: [22400.591231] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 11:37:06 juju-e4d256-prod-github-runner-207 kernel: [22400.592439] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 11:37:06 juju-e4d256-prod-github-runner-207 kernel: [22400.593587] Aug 22 11:37:06 juju-e4d256-prod-github-runner-207 kernel: [22400.594497] Aug 22 11:37:06 juju-e4d256-prod-github-runner-207 kernel: [22400.595386] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 11:37:06 juju-e4d256-prod-github-runner-207 kernel: [22400.596719] ? native_queued_spin_lock_slowpath+0xc/0x40 Aug 22 11:37:06 juju-e4d256-prod-github-runner-207 kernel: [22400.597855] ? _raw_spin_lock+0x22/0x30 Aug 22 11:37:06 juju-e4d256-prod-github-runner-207 kernel: [22400.598877] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:37:06 juju-e4d256-prod-github-runner-207 kernel: [22400.599998] direct_page_fault+0x206/0x310 [kvm] Aug 22 11:37:06 juju-e4d256-prod-github-runner-207 kernel: [22400.601120] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 11:37:06 juju-e4d256-prod-github-runner-207 kernel: [22400.602225] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 11:37:06 juju-e4d256-prod-github-runner-207 kernel: [22400.603333] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 11:37:06 juju-e4d256-prod-github-runner-207 kernel: [22400.604446] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 11:37:06 juju-e4d256-prod-github-runner-207 kernel: [22400.605501] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 11:37:06 juju-e4d256-prod-github-runner-207 kernel: [22400.606597] handle_exit+0x98/0x230 [kvm_amd] Aug 22 11:37:06 juju-e4d256-prod-github-runner-207 kernel: [22400.607609] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 11:37:06 juju-e4d256-prod-github-runner-207 kernel: [22400.608774] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 11:37:06 juju-e4d256-prod-github-runner-207 kernel: [22400.609796] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 11:37:06 juju-e4d256-prod-github-runner-207 kernel: [22400.610804] vcpu_run+0x62/0x2c0 [kvm] Aug 22 11:37:06 juju-e4d256-prod-github-runner-207 kernel: [22400.611714] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 11:37:06 juju-e4d256-prod-github-runner-207 kernel: [22400.612608] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 11:37:06 juju-e4d256-prod-github-runner-207 kernel: [22400.613572] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 11:37:06 juju-e4d256-prod-github-runner-207 kernel: [22400.614479] ? __seccomp_filter+0x4a/0x4a0 Aug 22 11:37:06 juju-e4d256-prod-github-runner-207 kernel: [22400.615310] ? __fget_files+0x86/0xc0 Aug 22 11:37:06 juju-e4d256-prod-github-runner-207 kernel: [22400.616120] __x64_sys_ioctl+0x95/0xd0 Aug 22 11:37:06 juju-e4d256-prod-github-runner-207 kernel: [22400.616898] do_syscall_64+0x5c/0xc0 Aug 22 11:37:06 juju-e4d256-prod-github-runner-207 kernel: [22400.617642] ? do_futex+0x162/0x1f0 Aug 22 11:37:06 juju-e4d256-prod-github-runner-207 kernel: [22400.618365] ? __x64_sys_futex+0x78/0x1e0 Aug 22 11:37:06 juju-e4d256-prod-github-runner-207 kernel: [22400.619121] ? __secure_computing+0xa9/0x120 Aug 22 11:37:06 juju-e4d256-prod-github-runner-207 kernel: [22400.619923] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 11:37:06 juju-e4d256-prod-github-runner-207 kernel: [22400.620797] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:37:06 juju-e4d256-prod-github-runner-207 kernel: [22400.621626] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:37:06 juju-e4d256-prod-github-runner-207 kernel: [22400.622454] ? do_syscall_64+0x69/0xc0 Aug 22 11:37:06 juju-e4d256-prod-github-runner-207 kernel: [22400.623178] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:37:06 juju-e4d256-prod-github-runner-207 kernel: [22400.624003] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:37:06 juju-e4d256-prod-github-runner-207 kernel: [22400.624795] ? do_syscall_64+0x69/0xc0 Aug 22 11:37:06 juju-e4d256-prod-github-runner-207 kernel: [22400.625497] ? do_syscall_64+0x69/0xc0 Aug 22 11:37:06 juju-e4d256-prod-github-runner-207 kernel: [22400.626200] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 11:37:06 juju-e4d256-prod-github-runner-207 kernel: [22400.627019] RIP: 0033:0x7faa5d0edaff Aug 22 11:37:06 juju-e4d256-prod-github-runner-207 kernel: [22400.627747] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 11:37:06 juju-e4d256-prod-github-runner-207 kernel: [22400.630081] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 11:37:06 juju-e4d256-prod-github-runner-207 kernel: [22400.631137] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 11:37:06 juju-e4d256-prod-github-runner-207 kernel: [22400.632175] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 11:37:06 juju-e4d256-prod-github-runner-207 kernel: [22400.633208] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 11:37:06 juju-e4d256-prod-github-runner-207 kernel: [22400.634233] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 11:37:06 juju-e4d256-prod-github-runner-207 kernel: [22400.635262] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 11:37:06 juju-e4d256-prod-github-runner-207 kernel: [22400.636312] Aug 22 11:37:34 juju-e4d256-prod-github-runner-207 kernel: [22428.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 20780s! [qemu-system-x86:6715] Aug 22 11:37:34 juju-e4d256-prod-github-runner-207 kernel: [22428.543111] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 11:37:34 juju-e4d256-prod-github-runner-207 kernel: [22428.543187] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 11:37:34 juju-e4d256-prod-github-runner-207 kernel: [22428.555371] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 11:37:34 juju-e4d256-prod-github-runner-207 kernel: [22428.556634] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 11:37:34 juju-e4d256-prod-github-runner-207 kernel: [22428.557852] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:37:34 juju-e4d256-prod-github-runner-207 kernel: [22428.558906] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 11:37:34 juju-e4d256-prod-github-runner-207 kernel: [22428.561464] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 11:37:34 juju-e4d256-prod-github-runner-207 kernel: [22428.562504] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 11:37:34 juju-e4d256-prod-github-runner-207 kernel: [22428.563681] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 11:37:34 juju-e4d256-prod-github-runner-207 kernel: [22428.564846] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 11:37:34 juju-e4d256-prod-github-runner-207 kernel: [22428.566029] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 11:37:34 juju-e4d256-prod-github-runner-207 kernel: [22428.567190] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 11:37:34 juju-e4d256-prod-github-runner-207 kernel: [22428.568377] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 11:37:34 juju-e4d256-prod-github-runner-207 kernel: [22428.569609] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 11:37:34 juju-e4d256-prod-github-runner-207 kernel: [22428.570748] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 11:37:34 juju-e4d256-prod-github-runner-207 kernel: [22428.571963] Call Trace: Aug 22 11:37:34 juju-e4d256-prod-github-runner-207 kernel: [22428.572915] Aug 22 11:37:34 juju-e4d256-prod-github-runner-207 kernel: [22428.573863] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:37:34 juju-e4d256-prod-github-runner-207 kernel: [22428.574907] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:37:34 juju-e4d256-prod-github-runner-207 kernel: [22428.575944] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:37:34 juju-e4d256-prod-github-runner-207 kernel: [22428.577042] ? show_regs.part.0+0x23/0x29 Aug 22 11:37:34 juju-e4d256-prod-github-runner-207 kernel: [22428.578041] ? show_regs.cold+0x8/0xd Aug 22 11:37:34 juju-e4d256-prod-github-runner-207 kernel: [22428.579011] ? watchdog_timer_fn+0x1be/0x220 Aug 22 11:37:34 juju-e4d256-prod-github-runner-207 kernel: [22428.580036] ? lockup_detector_update_enable+0x60/0x60 Aug 22 11:37:34 juju-e4d256-prod-github-runner-207 kernel: [22428.581102] ? __hrtimer_run_queues+0x107/0x230 Aug 22 11:37:34 juju-e4d256-prod-github-runner-207 kernel: [22428.582136] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 11:37:34 juju-e4d256-prod-github-runner-207 kernel: [22428.583162] ? hrtimer_interrupt+0x101/0x220 Aug 22 11:37:34 juju-e4d256-prod-github-runner-207 kernel: [22428.584182] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 11:37:34 juju-e4d256-prod-github-runner-207 kernel: [22428.585254] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 11:37:34 juju-e4d256-prod-github-runner-207 kernel: [22428.586297] Aug 22 11:37:34 juju-e4d256-prod-github-runner-207 kernel: [22428.587157] Aug 22 11:37:34 juju-e4d256-prod-github-runner-207 kernel: [22428.588006] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 11:37:34 juju-e4d256-prod-github-runner-207 kernel: [22428.589037] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:37:34 juju-e4d256-prod-github-runner-207 kernel: [22428.590075] ? _raw_spin_lock+0x22/0x30 Aug 22 11:37:34 juju-e4d256-prod-github-runner-207 kernel: [22428.591025] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:37:34 juju-e4d256-prod-github-runner-207 kernel: [22428.592059] direct_page_fault+0x206/0x310 [kvm] Aug 22 11:37:34 juju-e4d256-prod-github-runner-207 kernel: [22428.593234] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 11:37:34 juju-e4d256-prod-github-runner-207 kernel: [22428.594242] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 11:37:34 juju-e4d256-prod-github-runner-207 kernel: [22428.595281] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 11:37:34 juju-e4d256-prod-github-runner-207 kernel: [22428.596263] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 11:37:34 juju-e4d256-prod-github-runner-207 kernel: [22428.597215] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 11:37:34 juju-e4d256-prod-github-runner-207 kernel: [22428.598193] handle_exit+0x98/0x230 [kvm_amd] Aug 22 11:37:34 juju-e4d256-prod-github-runner-207 kernel: [22428.599085] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 11:37:34 juju-e4d256-prod-github-runner-207 kernel: [22428.600171] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 11:37:34 juju-e4d256-prod-github-runner-207 kernel: [22428.601111] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 11:37:34 juju-e4d256-prod-github-runner-207 kernel: [22428.602030] vcpu_run+0x62/0x2c0 [kvm] Aug 22 11:37:34 juju-e4d256-prod-github-runner-207 kernel: [22428.602848] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 11:37:34 juju-e4d256-prod-github-runner-207 kernel: [22428.603674] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 11:37:34 juju-e4d256-prod-github-runner-207 kernel: [22428.604535] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 11:37:34 juju-e4d256-prod-github-runner-207 kernel: [22428.605339] ? __seccomp_filter+0x4a/0x4a0 Aug 22 11:37:34 juju-e4d256-prod-github-runner-207 kernel: [22428.606089] ? __fget_files+0x86/0xc0 Aug 22 11:37:34 juju-e4d256-prod-github-runner-207 kernel: [22428.606800] __x64_sys_ioctl+0x95/0xd0 Aug 22 11:37:34 juju-e4d256-prod-github-runner-207 kernel: [22428.607514] do_syscall_64+0x5c/0xc0 Aug 22 11:37:34 juju-e4d256-prod-github-runner-207 kernel: [22428.608182] ? do_futex+0x162/0x1f0 Aug 22 11:37:34 juju-e4d256-prod-github-runner-207 kernel: [22428.608835] ? __x64_sys_futex+0x78/0x1e0 Aug 22 11:37:34 juju-e4d256-prod-github-runner-207 kernel: [22428.609510] ? __secure_computing+0xa9/0x120 Aug 22 11:37:34 juju-e4d256-prod-github-runner-207 kernel: [22428.610199] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 11:37:34 juju-e4d256-prod-github-runner-207 kernel: [22428.610960] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:37:34 juju-e4d256-prod-github-runner-207 kernel: [22428.611696] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:37:34 juju-e4d256-prod-github-runner-207 kernel: [22428.612444] ? do_syscall_64+0x69/0xc0 Aug 22 11:37:34 juju-e4d256-prod-github-runner-207 kernel: [22428.613174] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:37:34 juju-e4d256-prod-github-runner-207 kernel: [22428.613880] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:37:34 juju-e4d256-prod-github-runner-207 kernel: [22428.614586] ? do_syscall_64+0x69/0xc0 Aug 22 11:37:34 juju-e4d256-prod-github-runner-207 kernel: [22428.615235] ? do_syscall_64+0x69/0xc0 Aug 22 11:37:34 juju-e4d256-prod-github-runner-207 kernel: [22428.615858] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 11:37:34 juju-e4d256-prod-github-runner-207 kernel: [22428.616564] RIP: 0033:0x7faa5d0edaff Aug 22 11:37:34 juju-e4d256-prod-github-runner-207 kernel: [22428.617195] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 11:37:34 juju-e4d256-prod-github-runner-207 kernel: [22428.619188] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 11:37:34 juju-e4d256-prod-github-runner-207 kernel: [22428.620113] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 11:37:34 juju-e4d256-prod-github-runner-207 kernel: [22428.621007] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 11:37:34 juju-e4d256-prod-github-runner-207 kernel: [22428.621906] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 11:37:34 juju-e4d256-prod-github-runner-207 kernel: [22428.622792] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 11:37:34 juju-e4d256-prod-github-runner-207 kernel: [22428.623688] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 11:37:34 juju-e4d256-prod-github-runner-207 kernel: [22428.624578] Aug 22 11:38:02 juju-e4d256-prod-github-runner-207 kernel: [22456.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 20806s! [qemu-system-x86:6715] Aug 22 11:38:02 juju-e4d256-prod-github-runner-207 kernel: [22456.543892] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 11:38:02 juju-e4d256-prod-github-runner-207 kernel: [22456.544206] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 11:38:02 juju-e4d256-prod-github-runner-207 kernel: [22456.556391] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 11:38:02 juju-e4d256-prod-github-runner-207 kernel: [22456.557671] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 11:38:02 juju-e4d256-prod-github-runner-207 kernel: [22456.558930] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:38:02 juju-e4d256-prod-github-runner-207 kernel: [22456.560005] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 11:38:02 juju-e4d256-prod-github-runner-207 kernel: [22456.562553] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 11:38:02 juju-e4d256-prod-github-runner-207 kernel: [22456.563618] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 11:38:02 juju-e4d256-prod-github-runner-207 kernel: [22456.564780] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 11:38:02 juju-e4d256-prod-github-runner-207 kernel: [22456.566011] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 11:38:02 juju-e4d256-prod-github-runner-207 kernel: [22456.567204] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 11:38:02 juju-e4d256-prod-github-runner-207 kernel: [22456.568377] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 11:38:02 juju-e4d256-prod-github-runner-207 kernel: [22456.569569] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 11:38:02 juju-e4d256-prod-github-runner-207 kernel: [22456.570803] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 11:38:02 juju-e4d256-prod-github-runner-207 kernel: [22456.571926] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 11:38:02 juju-e4d256-prod-github-runner-207 kernel: [22456.573126] Call Trace: Aug 22 11:38:02 juju-e4d256-prod-github-runner-207 kernel: [22456.574041] Aug 22 11:38:02 juju-e4d256-prod-github-runner-207 kernel: [22456.574958] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:38:02 juju-e4d256-prod-github-runner-207 kernel: [22456.575996] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:38:02 juju-e4d256-prod-github-runner-207 kernel: [22456.577375] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:38:02 juju-e4d256-prod-github-runner-207 kernel: [22456.578590] ? show_regs.part.0+0x23/0x29 Aug 22 11:38:02 juju-e4d256-prod-github-runner-207 kernel: [22456.579692] ? show_regs.cold+0x8/0xd Aug 22 11:38:02 juju-e4d256-prod-github-runner-207 kernel: [22456.580801] ? watchdog_timer_fn+0x1be/0x220 Aug 22 11:38:02 juju-e4d256-prod-github-runner-207 kernel: [22456.581888] ? lockup_detector_update_enable+0x60/0x60 Aug 22 11:38:02 juju-e4d256-prod-github-runner-207 kernel: [22456.583006] ? __hrtimer_run_queues+0x107/0x230 Aug 22 11:38:02 juju-e4d256-prod-github-runner-207 kernel: [22456.584044] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 11:38:02 juju-e4d256-prod-github-runner-207 kernel: [22456.585071] ? hrtimer_interrupt+0x101/0x220 Aug 22 11:38:02 juju-e4d256-prod-github-runner-207 kernel: [22456.586097] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 11:38:02 juju-e4d256-prod-github-runner-207 kernel: [22456.587192] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 11:38:02 juju-e4d256-prod-github-runner-207 kernel: [22456.588290] Aug 22 11:38:02 juju-e4d256-prod-github-runner-207 kernel: [22456.589179] Aug 22 11:38:02 juju-e4d256-prod-github-runner-207 kernel: [22456.590038] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 11:38:02 juju-e4d256-prod-github-runner-207 kernel: [22456.591119] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:38:02 juju-e4d256-prod-github-runner-207 kernel: [22456.592161] ? _raw_spin_lock+0x22/0x30 Aug 22 11:38:02 juju-e4d256-prod-github-runner-207 kernel: [22456.593109] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:38:02 juju-e4d256-prod-github-runner-207 kernel: [22456.594130] direct_page_fault+0x206/0x310 [kvm] Aug 22 11:38:02 juju-e4d256-prod-github-runner-207 kernel: [22456.595166] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 11:38:02 juju-e4d256-prod-github-runner-207 kernel: [22456.596238] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 11:38:02 juju-e4d256-prod-github-runner-207 kernel: [22456.597253] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 11:38:02 juju-e4d256-prod-github-runner-207 kernel: [22456.598271] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 11:38:02 juju-e4d256-prod-github-runner-207 kernel: [22456.599229] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 11:38:02 juju-e4d256-prod-github-runner-207 kernel: [22456.600254] handle_exit+0x98/0x230 [kvm_amd] Aug 22 11:38:02 juju-e4d256-prod-github-runner-207 kernel: [22456.601164] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 11:38:02 juju-e4d256-prod-github-runner-207 kernel: [22456.602083] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 11:38:02 juju-e4d256-prod-github-runner-207 kernel: [22456.603024] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 11:38:02 juju-e4d256-prod-github-runner-207 kernel: [22456.603937] vcpu_run+0x62/0x2c0 [kvm] Aug 22 11:38:02 juju-e4d256-prod-github-runner-207 kernel: [22456.604749] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 11:38:02 juju-e4d256-prod-github-runner-207 kernel: [22456.605562] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 11:38:02 juju-e4d256-prod-github-runner-207 kernel: [22456.606426] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 11:38:02 juju-e4d256-prod-github-runner-207 kernel: [22456.607243] ? __seccomp_filter+0x4a/0x4a0 Aug 22 11:38:02 juju-e4d256-prod-github-runner-207 kernel: [22456.607996] ? __fget_files+0x86/0xc0 Aug 22 11:38:02 juju-e4d256-prod-github-runner-207 kernel: [22456.608703] __x64_sys_ioctl+0x95/0xd0 Aug 22 11:38:02 juju-e4d256-prod-github-runner-207 kernel: [22456.609400] do_syscall_64+0x5c/0xc0 Aug 22 11:38:02 juju-e4d256-prod-github-runner-207 kernel: [22456.610090] ? do_futex+0x162/0x1f0 Aug 22 11:38:02 juju-e4d256-prod-github-runner-207 kernel: [22456.610747] ? __x64_sys_futex+0x78/0x1e0 Aug 22 11:38:02 juju-e4d256-prod-github-runner-207 kernel: [22456.611441] ? __secure_computing+0xa9/0x120 Aug 22 11:38:02 juju-e4d256-prod-github-runner-207 kernel: [22456.612135] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 11:38:02 juju-e4d256-prod-github-runner-207 kernel: [22456.612899] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:38:02 juju-e4d256-prod-github-runner-207 kernel: [22456.613625] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:38:02 juju-e4d256-prod-github-runner-207 kernel: [22456.614347] ? do_syscall_64+0x69/0xc0 Aug 22 11:38:02 juju-e4d256-prod-github-runner-207 kernel: [22456.615011] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:38:02 juju-e4d256-prod-github-runner-207 kernel: [22456.615721] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:38:02 juju-e4d256-prod-github-runner-207 kernel: [22456.616420] ? do_syscall_64+0x69/0xc0 Aug 22 11:38:02 juju-e4d256-prod-github-runner-207 kernel: [22456.617064] ? do_syscall_64+0x69/0xc0 Aug 22 11:38:02 juju-e4d256-prod-github-runner-207 kernel: [22456.617708] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 11:38:02 juju-e4d256-prod-github-runner-207 kernel: [22456.618426] RIP: 0033:0x7faa5d0edaff Aug 22 11:38:02 juju-e4d256-prod-github-runner-207 kernel: [22456.619114] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 11:38:02 juju-e4d256-prod-github-runner-207 kernel: [22456.621126] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 11:38:02 juju-e4d256-prod-github-runner-207 kernel: [22456.622057] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 11:38:02 juju-e4d256-prod-github-runner-207 kernel: [22456.622965] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 11:38:02 juju-e4d256-prod-github-runner-207 kernel: [22456.623852] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 11:38:02 juju-e4d256-prod-github-runner-207 kernel: [22456.624779] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 11:38:02 juju-e4d256-prod-github-runner-207 kernel: [22456.625709] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 11:38:02 juju-e4d256-prod-github-runner-207 kernel: [22456.626637] Aug 22 11:38:30 juju-e4d256-prod-github-runner-207 kernel: [22484.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 20832s! [qemu-system-x86:6715] Aug 22 11:38:30 juju-e4d256-prod-github-runner-207 kernel: [22484.543109] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 11:38:30 juju-e4d256-prod-github-runner-207 kernel: [22484.543185] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 11:38:30 juju-e4d256-prod-github-runner-207 kernel: [22484.555289] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 11:38:30 juju-e4d256-prod-github-runner-207 kernel: [22484.556549] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 11:38:30 juju-e4d256-prod-github-runner-207 kernel: [22484.557765] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:38:30 juju-e4d256-prod-github-runner-207 kernel: [22484.558826] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 11:38:30 juju-e4d256-prod-github-runner-207 kernel: [22484.561384] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 11:38:30 juju-e4d256-prod-github-runner-207 kernel: [22484.562422] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 11:38:30 juju-e4d256-prod-github-runner-207 kernel: [22484.563593] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 11:38:30 juju-e4d256-prod-github-runner-207 kernel: [22484.564751] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 11:38:30 juju-e4d256-prod-github-runner-207 kernel: [22484.565910] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 11:38:30 juju-e4d256-prod-github-runner-207 kernel: [22484.567076] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 11:38:30 juju-e4d256-prod-github-runner-207 kernel: [22484.568283] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 11:38:30 juju-e4d256-prod-github-runner-207 kernel: [22484.569521] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 11:38:30 juju-e4d256-prod-github-runner-207 kernel: [22484.570642] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 11:38:30 juju-e4d256-prod-github-runner-207 kernel: [22484.571832] Call Trace: Aug 22 11:38:30 juju-e4d256-prod-github-runner-207 kernel: [22484.572741] Aug 22 11:38:30 juju-e4d256-prod-github-runner-207 kernel: [22484.573627] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:38:30 juju-e4d256-prod-github-runner-207 kernel: [22484.574705] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:38:30 juju-e4d256-prod-github-runner-207 kernel: [22484.575734] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:38:30 juju-e4d256-prod-github-runner-207 kernel: [22484.576864] ? show_regs.part.0+0x23/0x29 Aug 22 11:38:30 juju-e4d256-prod-github-runner-207 kernel: [22484.577874] ? show_regs.cold+0x8/0xd Aug 22 11:38:30 juju-e4d256-prod-github-runner-207 kernel: [22484.578866] ? watchdog_timer_fn+0x1be/0x220 Aug 22 11:38:30 juju-e4d256-prod-github-runner-207 kernel: [22484.579878] ? lockup_detector_update_enable+0x60/0x60 Aug 22 11:38:30 juju-e4d256-prod-github-runner-207 kernel: [22484.581010] ? __hrtimer_run_queues+0x107/0x230 Aug 22 11:38:30 juju-e4d256-prod-github-runner-207 kernel: [22484.582049] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 11:38:30 juju-e4d256-prod-github-runner-207 kernel: [22484.583089] ? hrtimer_interrupt+0x101/0x220 Aug 22 11:38:30 juju-e4d256-prod-github-runner-207 kernel: [22484.584103] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 11:38:30 juju-e4d256-prod-github-runner-207 kernel: [22484.585168] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 11:38:30 juju-e4d256-prod-github-runner-207 kernel: [22484.586211] Aug 22 11:38:30 juju-e4d256-prod-github-runner-207 kernel: [22484.587078] Aug 22 11:38:30 juju-e4d256-prod-github-runner-207 kernel: [22484.587917] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 11:38:30 juju-e4d256-prod-github-runner-207 kernel: [22484.588992] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:38:30 juju-e4d256-prod-github-runner-207 kernel: [22484.590045] ? _raw_spin_lock+0x22/0x30 Aug 22 11:38:30 juju-e4d256-prod-github-runner-207 kernel: [22484.591027] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:38:30 juju-e4d256-prod-github-runner-207 kernel: [22484.592053] direct_page_fault+0x206/0x310 [kvm] Aug 22 11:38:30 juju-e4d256-prod-github-runner-207 kernel: [22484.593074] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 11:38:30 juju-e4d256-prod-github-runner-207 kernel: [22484.594078] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 11:38:30 juju-e4d256-prod-github-runner-207 kernel: [22484.595092] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 11:38:30 juju-e4d256-prod-github-runner-207 kernel: [22484.596082] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 11:38:30 juju-e4d256-prod-github-runner-207 kernel: [22484.597025] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 11:38:30 juju-e4d256-prod-github-runner-207 kernel: [22484.597997] handle_exit+0x98/0x230 [kvm_amd] Aug 22 11:38:30 juju-e4d256-prod-github-runner-207 kernel: [22484.598957] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 11:38:30 juju-e4d256-prod-github-runner-207 kernel: [22484.599892] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 11:38:30 juju-e4d256-prod-github-runner-207 kernel: [22484.600814] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 11:38:30 juju-e4d256-prod-github-runner-207 kernel: [22484.601715] vcpu_run+0x62/0x2c0 [kvm] Aug 22 11:38:30 juju-e4d256-prod-github-runner-207 kernel: [22484.602526] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 11:38:30 juju-e4d256-prod-github-runner-207 kernel: [22484.603363] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 11:38:30 juju-e4d256-prod-github-runner-207 kernel: [22484.604214] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 11:38:30 juju-e4d256-prod-github-runner-207 kernel: [22484.605008] ? __seccomp_filter+0x4a/0x4a0 Aug 22 11:38:30 juju-e4d256-prod-github-runner-207 kernel: [22484.605754] ? __fget_files+0x86/0xc0 Aug 22 11:38:30 juju-e4d256-prod-github-runner-207 kernel: [22484.606457] __x64_sys_ioctl+0x95/0xd0 Aug 22 11:38:30 juju-e4d256-prod-github-runner-207 kernel: [22484.607163] do_syscall_64+0x5c/0xc0 Aug 22 11:38:30 juju-e4d256-prod-github-runner-207 kernel: [22484.607828] ? do_futex+0x162/0x1f0 Aug 22 11:38:30 juju-e4d256-prod-github-runner-207 kernel: [22484.608476] ? __x64_sys_futex+0x78/0x1e0 Aug 22 11:38:30 juju-e4d256-prod-github-runner-207 kernel: [22484.609168] ? __secure_computing+0xa9/0x120 Aug 22 11:38:30 juju-e4d256-prod-github-runner-207 kernel: [22484.609862] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 11:38:30 juju-e4d256-prod-github-runner-207 kernel: [22484.610638] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:38:30 juju-e4d256-prod-github-runner-207 kernel: [22484.611360] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:38:30 juju-e4d256-prod-github-runner-207 kernel: [22484.612078] ? do_syscall_64+0x69/0xc0 Aug 22 11:38:30 juju-e4d256-prod-github-runner-207 kernel: [22484.612722] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:38:30 juju-e4d256-prod-github-runner-207 kernel: [22484.613424] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:38:30 juju-e4d256-prod-github-runner-207 kernel: [22484.614118] ? do_syscall_64+0x69/0xc0 Aug 22 11:38:30 juju-e4d256-prod-github-runner-207 kernel: [22484.614762] ? do_syscall_64+0x69/0xc0 Aug 22 11:38:30 juju-e4d256-prod-github-runner-207 kernel: [22484.615385] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 11:38:30 juju-e4d256-prod-github-runner-207 kernel: [22484.616107] RIP: 0033:0x7faa5d0edaff Aug 22 11:38:30 juju-e4d256-prod-github-runner-207 kernel: [22484.616747] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 11:38:30 juju-e4d256-prod-github-runner-207 kernel: [22484.618743] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 11:38:30 juju-e4d256-prod-github-runner-207 kernel: [22484.619680] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 11:38:30 juju-e4d256-prod-github-runner-207 kernel: [22484.620578] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 11:38:30 juju-e4d256-prod-github-runner-207 kernel: [22484.621469] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 11:38:30 juju-e4d256-prod-github-runner-207 kernel: [22484.622356] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 11:38:30 juju-e4d256-prod-github-runner-207 kernel: [22484.623263] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 11:38:30 juju-e4d256-prod-github-runner-207 kernel: [22484.624238] Aug 22 11:38:44 juju-e4d256-prod-github-runner-207 kernel: [22498.688706] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 11:38:44 juju-e4d256-prod-github-runner-207 kernel: [22498.689695] rcu: 1-....: (5577906 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=2700448 Aug 22 11:38:44 juju-e4d256-prod-github-runner-207 kernel: [22498.690866] (t=5595372 jiffies g=23269 q=27903) Aug 22 11:38:44 juju-e4d256-prod-github-runner-207 kernel: [22498.691656] NMI backtrace for cpu 1 Aug 22 11:38:44 juju-e4d256-prod-github-runner-207 kernel: [22498.692370] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 11:38:44 juju-e4d256-prod-github-runner-207 kernel: [22498.693490] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 11:38:44 juju-e4d256-prod-github-runner-207 kernel: [22498.694673] Call Trace: Aug 22 11:38:44 juju-e4d256-prod-github-runner-207 kernel: [22498.695352] Aug 22 11:38:44 juju-e4d256-prod-github-runner-207 kernel: [22498.695998] show_stack+0x52/0x5c Aug 22 11:38:44 juju-e4d256-prod-github-runner-207 kernel: [22498.696726] dump_stack_lvl+0x4a/0x63 Aug 22 11:38:44 juju-e4d256-prod-github-runner-207 kernel: [22498.697479] dump_stack+0x10/0x16 Aug 22 11:38:44 juju-e4d256-prod-github-runner-207 kernel: [22498.698202] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 11:38:44 juju-e4d256-prod-github-runner-207 kernel: [22498.699008] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 11:38:44 juju-e4d256-prod-github-runner-207 kernel: [22498.699790] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 11:38:44 juju-e4d256-prod-github-runner-207 kernel: [22498.700619] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 11:38:44 juju-e4d256-prod-github-runner-207 kernel: [22498.701448] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 11:38:44 juju-e4d256-prod-github-runner-207 kernel: [22498.702264] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 11:38:44 juju-e4d256-prod-github-runner-207 kernel: [22498.703054] print_cpu_stall.cold+0x2f/0xe2 Aug 22 11:38:44 juju-e4d256-prod-github-runner-207 kernel: [22498.703830] ? timekeeping_update+0xf7/0x150 Aug 22 11:38:44 juju-e4d256-prod-github-runner-207 kernel: [22498.704603] check_cpu_stall+0x109/0x270 Aug 22 11:38:44 juju-e4d256-prod-github-runner-207 kernel: [22498.705350] rcu_sched_clock_irq+0x9a/0x250 Aug 22 11:38:44 juju-e4d256-prod-github-runner-207 kernel: [22498.706110] update_process_times+0x94/0xd0 Aug 22 11:38:44 juju-e4d256-prod-github-runner-207 kernel: [22498.706881] tick_sched_handle+0x29/0x70 Aug 22 11:38:44 juju-e4d256-prod-github-runner-207 kernel: [22498.707626] tick_sched_timer+0x8c/0xc0 Aug 22 11:38:44 juju-e4d256-prod-github-runner-207 kernel: [22498.708371] ? tick_nohz_handler+0xb0/0xb0 Aug 22 11:38:44 juju-e4d256-prod-github-runner-207 kernel: [22498.709133] __hrtimer_run_queues+0x107/0x230 Aug 22 11:38:44 juju-e4d256-prod-github-runner-207 kernel: [22498.709908] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 11:38:44 juju-e4d256-prod-github-runner-207 kernel: [22498.710696] hrtimer_interrupt+0x101/0x220 Aug 22 11:38:44 juju-e4d256-prod-github-runner-207 kernel: [22498.711454] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 11:38:44 juju-e4d256-prod-github-runner-207 kernel: [22498.712267] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 11:38:44 juju-e4d256-prod-github-runner-207 kernel: [22498.713167] Aug 22 11:38:44 juju-e4d256-prod-github-runner-207 kernel: [22498.713810] Aug 22 11:38:44 juju-e4d256-prod-github-runner-207 kernel: [22498.714457] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 11:38:44 juju-e4d256-prod-github-runner-207 kernel: [22498.715278] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:38:44 juju-e4d256-prod-github-runner-207 kernel: [22498.716158] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 11:38:44 juju-e4d256-prod-github-runner-207 kernel: [22498.718375] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 11:38:44 juju-e4d256-prod-github-runner-207 kernel: [22498.719252] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 11:38:44 juju-e4d256-prod-github-runner-207 kernel: [22498.720251] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 11:38:44 juju-e4d256-prod-github-runner-207 kernel: [22498.721229] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 11:38:44 juju-e4d256-prod-github-runner-207 kernel: [22498.722193] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 11:38:44 juju-e4d256-prod-github-runner-207 kernel: [22498.723159] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 11:38:44 juju-e4d256-prod-github-runner-207 kernel: [22498.724128] ? _raw_spin_lock+0x22/0x30 Aug 22 11:38:44 juju-e4d256-prod-github-runner-207 kernel: [22498.724903] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:38:44 juju-e4d256-prod-github-runner-207 kernel: [22498.725747] direct_page_fault+0x206/0x310 [kvm] Aug 22 11:38:44 juju-e4d256-prod-github-runner-207 kernel: [22498.726604] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 11:38:44 juju-e4d256-prod-github-runner-207 kernel: [22498.727435] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 11:38:44 juju-e4d256-prod-github-runner-207 kernel: [22498.728263] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 11:38:44 juju-e4d256-prod-github-runner-207 kernel: [22498.729071] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 11:38:44 juju-e4d256-prod-github-runner-207 kernel: [22498.729857] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 11:38:44 juju-e4d256-prod-github-runner-207 kernel: [22498.730691] handle_exit+0x98/0x230 [kvm_amd] Aug 22 11:38:44 juju-e4d256-prod-github-runner-207 kernel: [22498.731446] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 11:38:44 juju-e4d256-prod-github-runner-207 kernel: [22498.732232] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 11:38:44 juju-e4d256-prod-github-runner-207 kernel: [22498.733035] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 11:38:44 juju-e4d256-prod-github-runner-207 kernel: [22498.733829] vcpu_run+0x62/0x2c0 [kvm] Aug 22 11:38:44 juju-e4d256-prod-github-runner-207 kernel: [22498.734742] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 11:38:44 juju-e4d256-prod-github-runner-207 kernel: [22498.735479] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 11:38:44 juju-e4d256-prod-github-runner-207 kernel: [22498.736281] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 11:38:44 juju-e4d256-prod-github-runner-207 kernel: [22498.737043] ? __seccomp_filter+0x4a/0x4a0 Aug 22 11:38:44 juju-e4d256-prod-github-runner-207 kernel: [22498.737867] ? __fget_files+0x86/0xc0 Aug 22 11:38:44 juju-e4d256-prod-github-runner-207 kernel: [22498.738575] __x64_sys_ioctl+0x95/0xd0 Aug 22 11:38:44 juju-e4d256-prod-github-runner-207 kernel: [22498.739272] do_syscall_64+0x5c/0xc0 Aug 22 11:38:44 juju-e4d256-prod-github-runner-207 kernel: [22498.739967] ? do_futex+0x162/0x1f0 Aug 22 11:38:44 juju-e4d256-prod-github-runner-207 kernel: [22498.740652] ? __x64_sys_futex+0x78/0x1e0 Aug 22 11:38:44 juju-e4d256-prod-github-runner-207 kernel: [22498.741352] ? __secure_computing+0xa9/0x120 Aug 22 11:38:44 juju-e4d256-prod-github-runner-207 kernel: [22498.742066] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 11:38:44 juju-e4d256-prod-github-runner-207 kernel: [22498.742873] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:38:44 juju-e4d256-prod-github-runner-207 kernel: [22498.743626] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:38:44 juju-e4d256-prod-github-runner-207 kernel: [22498.744382] ? do_syscall_64+0x69/0xc0 Aug 22 11:38:44 juju-e4d256-prod-github-runner-207 kernel: [22498.745069] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:38:44 juju-e4d256-prod-github-runner-207 kernel: [22498.745822] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:38:44 juju-e4d256-prod-github-runner-207 kernel: [22498.746589] ? do_syscall_64+0x69/0xc0 Aug 22 11:38:44 juju-e4d256-prod-github-runner-207 kernel: [22498.747287] ? do_syscall_64+0x69/0xc0 Aug 22 11:38:44 juju-e4d256-prod-github-runner-207 kernel: [22498.747974] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 11:38:44 juju-e4d256-prod-github-runner-207 kernel: [22498.748749] RIP: 0033:0x7faa5d0edaff Aug 22 11:38:44 juju-e4d256-prod-github-runner-207 kernel: [22498.749442] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 11:38:44 juju-e4d256-prod-github-runner-207 kernel: [22498.751618] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 11:38:44 juju-e4d256-prod-github-runner-207 kernel: [22498.752577] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 11:38:44 juju-e4d256-prod-github-runner-207 kernel: [22498.753710] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 11:38:44 juju-e4d256-prod-github-runner-207 kernel: [22498.754668] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 11:38:44 juju-e4d256-prod-github-runner-207 kernel: [22498.755608] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 11:38:44 juju-e4d256-prod-github-runner-207 kernel: [22498.756529] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 11:38:44 juju-e4d256-prod-github-runner-207 kernel: [22498.757454] Aug 22 11:39:10 juju-e4d256-prod-github-runner-207 kernel: [22524.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 20869s! [qemu-system-x86:6715] Aug 22 11:39:10 juju-e4d256-prod-github-runner-207 kernel: [22524.543171] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 11:39:10 juju-e4d256-prod-github-runner-207 kernel: [22524.543245] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 11:39:10 juju-e4d256-prod-github-runner-207 kernel: [22524.555415] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 11:39:10 juju-e4d256-prod-github-runner-207 kernel: [22524.556686] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 11:39:10 juju-e4d256-prod-github-runner-207 kernel: [22524.557908] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:39:10 juju-e4d256-prod-github-runner-207 kernel: [22524.558971] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 11:39:10 juju-e4d256-prod-github-runner-207 kernel: [22524.561519] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 11:39:10 juju-e4d256-prod-github-runner-207 kernel: [22524.562571] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 11:39:10 juju-e4d256-prod-github-runner-207 kernel: [22524.563733] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 11:39:10 juju-e4d256-prod-github-runner-207 kernel: [22524.564927] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 11:39:10 juju-e4d256-prod-github-runner-207 kernel: [22524.566115] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 11:39:10 juju-e4d256-prod-github-runner-207 kernel: [22524.567275] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 11:39:10 juju-e4d256-prod-github-runner-207 kernel: [22524.568445] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 11:39:10 juju-e4d256-prod-github-runner-207 kernel: [22524.569674] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 11:39:10 juju-e4d256-prod-github-runner-207 kernel: [22524.570779] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 11:39:10 juju-e4d256-prod-github-runner-207 kernel: [22524.571971] Call Trace: Aug 22 11:39:10 juju-e4d256-prod-github-runner-207 kernel: [22524.572887] Aug 22 11:39:10 juju-e4d256-prod-github-runner-207 kernel: [22524.573770] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:39:10 juju-e4d256-prod-github-runner-207 kernel: [22524.574819] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:39:10 juju-e4d256-prod-github-runner-207 kernel: [22524.575841] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:39:10 juju-e4d256-prod-github-runner-207 kernel: [22524.576920] ? show_regs.part.0+0x23/0x29 Aug 22 11:39:10 juju-e4d256-prod-github-runner-207 kernel: [22524.577934] ? show_regs.cold+0x8/0xd Aug 22 11:39:10 juju-e4d256-prod-github-runner-207 kernel: [22524.578924] ? watchdog_timer_fn+0x1be/0x220 Aug 22 11:39:10 juju-e4d256-prod-github-runner-207 kernel: [22524.579931] ? lockup_detector_update_enable+0x60/0x60 Aug 22 11:39:10 juju-e4d256-prod-github-runner-207 kernel: [22524.580996] ? __hrtimer_run_queues+0x107/0x230 Aug 22 11:39:10 juju-e4d256-prod-github-runner-207 kernel: [22524.582022] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 11:39:10 juju-e4d256-prod-github-runner-207 kernel: [22524.583059] ? hrtimer_interrupt+0x101/0x220 Aug 22 11:39:10 juju-e4d256-prod-github-runner-207 kernel: [22524.584079] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 11:39:10 juju-e4d256-prod-github-runner-207 kernel: [22524.585166] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 11:39:10 juju-e4d256-prod-github-runner-207 kernel: [22524.586221] Aug 22 11:39:10 juju-e4d256-prod-github-runner-207 kernel: [22524.587079] Aug 22 11:39:10 juju-e4d256-prod-github-runner-207 kernel: [22524.587916] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 11:39:10 juju-e4d256-prod-github-runner-207 kernel: [22524.588947] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:39:10 juju-e4d256-prod-github-runner-207 kernel: [22524.589990] ? _raw_spin_lock+0x22/0x30 Aug 22 11:39:10 juju-e4d256-prod-github-runner-207 kernel: [22524.590961] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:39:10 juju-e4d256-prod-github-runner-207 kernel: [22524.591980] direct_page_fault+0x206/0x310 [kvm] Aug 22 11:39:10 juju-e4d256-prod-github-runner-207 kernel: [22524.593007] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 11:39:10 juju-e4d256-prod-github-runner-207 kernel: [22524.594015] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 11:39:10 juju-e4d256-prod-github-runner-207 kernel: [22524.595031] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 11:39:10 juju-e4d256-prod-github-runner-207 kernel: [22524.596019] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 11:39:10 juju-e4d256-prod-github-runner-207 kernel: [22524.596962] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 11:39:10 juju-e4d256-prod-github-runner-207 kernel: [22524.597943] handle_exit+0x98/0x230 [kvm_amd] Aug 22 11:39:10 juju-e4d256-prod-github-runner-207 kernel: [22524.598850] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 11:39:10 juju-e4d256-prod-github-runner-207 kernel: [22524.599769] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 11:39:10 juju-e4d256-prod-github-runner-207 kernel: [22524.600692] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 11:39:10 juju-e4d256-prod-github-runner-207 kernel: [22524.601601] vcpu_run+0x62/0x2c0 [kvm] Aug 22 11:39:10 juju-e4d256-prod-github-runner-207 kernel: [22524.602445] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 11:39:10 juju-e4d256-prod-github-runner-207 kernel: [22524.603267] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 11:39:10 juju-e4d256-prod-github-runner-207 kernel: [22524.604123] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 11:39:10 juju-e4d256-prod-github-runner-207 kernel: [22524.604919] ? __seccomp_filter+0x4a/0x4a0 Aug 22 11:39:10 juju-e4d256-prod-github-runner-207 kernel: [22524.605667] ? __fget_files+0x86/0xc0 Aug 22 11:39:10 juju-e4d256-prod-github-runner-207 kernel: [22524.606380] __x64_sys_ioctl+0x95/0xd0 Aug 22 11:39:10 juju-e4d256-prod-github-runner-207 kernel: [22524.607079] do_syscall_64+0x5c/0xc0 Aug 22 11:39:10 juju-e4d256-prod-github-runner-207 kernel: [22524.607743] ? do_futex+0x162/0x1f0 Aug 22 11:39:10 juju-e4d256-prod-github-runner-207 kernel: [22524.608392] ? __x64_sys_futex+0x78/0x1e0 Aug 22 11:39:10 juju-e4d256-prod-github-runner-207 kernel: [22524.609071] ? __secure_computing+0xa9/0x120 Aug 22 11:39:10 juju-e4d256-prod-github-runner-207 kernel: [22524.609761] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 11:39:10 juju-e4d256-prod-github-runner-207 kernel: [22524.610529] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:39:10 juju-e4d256-prod-github-runner-207 kernel: [22524.611251] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:39:10 juju-e4d256-prod-github-runner-207 kernel: [22524.611973] ? do_syscall_64+0x69/0xc0 Aug 22 11:39:10 juju-e4d256-prod-github-runner-207 kernel: [22524.612617] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:39:10 juju-e4d256-prod-github-runner-207 kernel: [22524.613321] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:39:10 juju-e4d256-prod-github-runner-207 kernel: [22524.614023] ? do_syscall_64+0x69/0xc0 Aug 22 11:39:10 juju-e4d256-prod-github-runner-207 kernel: [22524.614662] ? do_syscall_64+0x69/0xc0 Aug 22 11:39:10 juju-e4d256-prod-github-runner-207 kernel: [22524.615285] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 11:39:10 juju-e4d256-prod-github-runner-207 kernel: [22524.615990] RIP: 0033:0x7faa5d0edaff Aug 22 11:39:10 juju-e4d256-prod-github-runner-207 kernel: [22524.616615] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 11:39:10 juju-e4d256-prod-github-runner-207 kernel: [22524.618611] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 11:39:10 juju-e4d256-prod-github-runner-207 kernel: [22524.619522] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 11:39:10 juju-e4d256-prod-github-runner-207 kernel: [22524.620412] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 11:39:10 juju-e4d256-prod-github-runner-207 kernel: [22524.621370] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 11:39:10 juju-e4d256-prod-github-runner-207 kernel: [22524.622532] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 11:39:10 juju-e4d256-prod-github-runner-207 kernel: [22524.623441] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 11:39:10 juju-e4d256-prod-github-runner-207 kernel: [22524.624351] Aug 22 11:39:38 juju-e4d256-prod-github-runner-207 kernel: [22552.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 20895s! [qemu-system-x86:6715] Aug 22 11:39:38 juju-e4d256-prod-github-runner-207 kernel: [22552.543859] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 11:39:38 juju-e4d256-prod-github-runner-207 kernel: [22552.544145] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 11:39:38 juju-e4d256-prod-github-runner-207 kernel: [22552.556293] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 11:39:38 juju-e4d256-prod-github-runner-207 kernel: [22552.557566] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 11:39:38 juju-e4d256-prod-github-runner-207 kernel: [22552.558798] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:39:38 juju-e4d256-prod-github-runner-207 kernel: [22552.559860] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 11:39:38 juju-e4d256-prod-github-runner-207 kernel: [22552.562488] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 11:39:38 juju-e4d256-prod-github-runner-207 kernel: [22552.563547] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 11:39:38 juju-e4d256-prod-github-runner-207 kernel: [22552.564707] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 11:39:38 juju-e4d256-prod-github-runner-207 kernel: [22552.565872] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 11:39:38 juju-e4d256-prod-github-runner-207 kernel: [22552.567029] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 11:39:38 juju-e4d256-prod-github-runner-207 kernel: [22552.568193] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 11:39:38 juju-e4d256-prod-github-runner-207 kernel: [22552.569357] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 11:39:38 juju-e4d256-prod-github-runner-207 kernel: [22552.570591] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 11:39:38 juju-e4d256-prod-github-runner-207 kernel: [22552.571693] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 11:39:38 juju-e4d256-prod-github-runner-207 kernel: [22552.572890] Call Trace: Aug 22 11:39:38 juju-e4d256-prod-github-runner-207 kernel: [22552.573810] Aug 22 11:39:38 juju-e4d256-prod-github-runner-207 kernel: [22552.574750] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:39:38 juju-e4d256-prod-github-runner-207 kernel: [22552.575781] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:39:38 juju-e4d256-prod-github-runner-207 kernel: [22552.576814] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:39:38 juju-e4d256-prod-github-runner-207 kernel: [22552.577947] ? show_regs.part.0+0x23/0x29 Aug 22 11:39:38 juju-e4d256-prod-github-runner-207 kernel: [22552.578950] ? show_regs.cold+0x8/0xd Aug 22 11:39:38 juju-e4d256-prod-github-runner-207 kernel: [22552.579959] ? watchdog_timer_fn+0x1be/0x220 Aug 22 11:39:38 juju-e4d256-prod-github-runner-207 kernel: [22552.580967] ? lockup_detector_update_enable+0x60/0x60 Aug 22 11:39:38 juju-e4d256-prod-github-runner-207 kernel: [22552.582052] ? __hrtimer_run_queues+0x107/0x230 Aug 22 11:39:38 juju-e4d256-prod-github-runner-207 kernel: [22552.583084] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 11:39:38 juju-e4d256-prod-github-runner-207 kernel: [22552.584110] ? hrtimer_interrupt+0x101/0x220 Aug 22 11:39:38 juju-e4d256-prod-github-runner-207 kernel: [22552.585125] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 11:39:38 juju-e4d256-prod-github-runner-207 kernel: [22552.586219] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 11:39:38 juju-e4d256-prod-github-runner-207 kernel: [22552.587266] Aug 22 11:39:38 juju-e4d256-prod-github-runner-207 kernel: [22552.588122] Aug 22 11:39:38 juju-e4d256-prod-github-runner-207 kernel: [22552.588968] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 11:39:38 juju-e4d256-prod-github-runner-207 kernel: [22552.590009] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:39:38 juju-e4d256-prod-github-runner-207 kernel: [22552.591048] ? _raw_spin_lock+0x22/0x30 Aug 22 11:39:38 juju-e4d256-prod-github-runner-207 kernel: [22552.592034] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:39:38 juju-e4d256-prod-github-runner-207 kernel: [22552.593054] direct_page_fault+0x206/0x310 [kvm] Aug 22 11:39:38 juju-e4d256-prod-github-runner-207 kernel: [22552.594113] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 11:39:38 juju-e4d256-prod-github-runner-207 kernel: [22552.595225] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 11:39:38 juju-e4d256-prod-github-runner-207 kernel: [22552.596254] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 11:39:38 juju-e4d256-prod-github-runner-207 kernel: [22552.597273] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 11:39:38 juju-e4d256-prod-github-runner-207 kernel: [22552.598233] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 11:39:38 juju-e4d256-prod-github-runner-207 kernel: [22552.599266] handle_exit+0x98/0x230 [kvm_amd] Aug 22 11:39:38 juju-e4d256-prod-github-runner-207 kernel: [22552.600394] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 11:39:38 juju-e4d256-prod-github-runner-207 kernel: [22552.601316] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 11:39:38 juju-e4d256-prod-github-runner-207 kernel: [22552.602261] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 11:39:38 juju-e4d256-prod-github-runner-207 kernel: [22552.603210] vcpu_run+0x62/0x2c0 [kvm] Aug 22 11:39:38 juju-e4d256-prod-github-runner-207 kernel: [22552.604023] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 11:39:38 juju-e4d256-prod-github-runner-207 kernel: [22552.604832] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 11:39:38 juju-e4d256-prod-github-runner-207 kernel: [22552.605732] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 11:39:38 juju-e4d256-prod-github-runner-207 kernel: [22552.606548] ? __seccomp_filter+0x4a/0x4a0 Aug 22 11:39:38 juju-e4d256-prod-github-runner-207 kernel: [22552.607290] ? __fget_files+0x86/0xc0 Aug 22 11:39:38 juju-e4d256-prod-github-runner-207 kernel: [22552.608006] __x64_sys_ioctl+0x95/0xd0 Aug 22 11:39:38 juju-e4d256-prod-github-runner-207 kernel: [22552.608702] do_syscall_64+0x5c/0xc0 Aug 22 11:39:38 juju-e4d256-prod-github-runner-207 kernel: [22552.609369] ? do_futex+0x162/0x1f0 Aug 22 11:39:38 juju-e4d256-prod-github-runner-207 kernel: [22552.610034] ? __x64_sys_futex+0x78/0x1e0 Aug 22 11:39:38 juju-e4d256-prod-github-runner-207 kernel: [22552.610709] ? __secure_computing+0xa9/0x120 Aug 22 11:39:38 juju-e4d256-prod-github-runner-207 kernel: [22552.611542] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 11:39:38 juju-e4d256-prod-github-runner-207 kernel: [22552.612303] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:39:38 juju-e4d256-prod-github-runner-207 kernel: [22552.613065] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:39:38 juju-e4d256-prod-github-runner-207 kernel: [22552.613799] ? do_syscall_64+0x69/0xc0 Aug 22 11:39:38 juju-e4d256-prod-github-runner-207 kernel: [22552.614451] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:39:38 juju-e4d256-prod-github-runner-207 kernel: [22552.615154] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:39:38 juju-e4d256-prod-github-runner-207 kernel: [22552.615850] ? do_syscall_64+0x69/0xc0 Aug 22 11:39:38 juju-e4d256-prod-github-runner-207 kernel: [22552.616482] ? do_syscall_64+0x69/0xc0 Aug 22 11:39:38 juju-e4d256-prod-github-runner-207 kernel: [22552.617120] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 11:39:38 juju-e4d256-prod-github-runner-207 kernel: [22552.617842] RIP: 0033:0x7faa5d0edaff Aug 22 11:39:38 juju-e4d256-prod-github-runner-207 kernel: [22552.618512] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 11:39:38 juju-e4d256-prod-github-runner-207 kernel: [22552.620523] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 11:39:38 juju-e4d256-prod-github-runner-207 kernel: [22552.621481] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 11:39:38 juju-e4d256-prod-github-runner-207 kernel: [22552.622408] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 11:39:38 juju-e4d256-prod-github-runner-207 kernel: [22552.623309] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 11:39:38 juju-e4d256-prod-github-runner-207 kernel: [22552.624231] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 11:39:38 juju-e4d256-prod-github-runner-207 kernel: [22552.625122] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 11:39:38 juju-e4d256-prod-github-runner-207 kernel: [22552.626029] Aug 22 11:40:06 juju-e4d256-prod-github-runner-207 kernel: [22580.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 20921s! [qemu-system-x86:6715] Aug 22 11:40:06 juju-e4d256-prod-github-runner-207 kernel: [22580.543126] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 11:40:06 juju-e4d256-prod-github-runner-207 kernel: [22580.543204] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 11:40:06 juju-e4d256-prod-github-runner-207 kernel: [22580.555954] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 11:40:06 juju-e4d256-prod-github-runner-207 kernel: [22580.557223] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 11:40:06 juju-e4d256-prod-github-runner-207 kernel: [22580.558462] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:40:06 juju-e4d256-prod-github-runner-207 kernel: [22580.559533] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 11:40:06 juju-e4d256-prod-github-runner-207 kernel: [22580.562115] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 11:40:06 juju-e4d256-prod-github-runner-207 kernel: [22580.563180] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 11:40:06 juju-e4d256-prod-github-runner-207 kernel: [22580.564342] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 11:40:06 juju-e4d256-prod-github-runner-207 kernel: [22580.565522] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 11:40:06 juju-e4d256-prod-github-runner-207 kernel: [22580.566687] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 11:40:06 juju-e4d256-prod-github-runner-207 kernel: [22580.567858] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 11:40:06 juju-e4d256-prod-github-runner-207 kernel: [22580.569035] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 11:40:06 juju-e4d256-prod-github-runner-207 kernel: [22580.570328] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 11:40:06 juju-e4d256-prod-github-runner-207 kernel: [22580.571432] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 11:40:06 juju-e4d256-prod-github-runner-207 kernel: [22580.572626] Call Trace: Aug 22 11:40:06 juju-e4d256-prod-github-runner-207 kernel: [22580.573556] Aug 22 11:40:06 juju-e4d256-prod-github-runner-207 kernel: [22580.574441] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:40:06 juju-e4d256-prod-github-runner-207 kernel: [22580.575489] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:40:06 juju-e4d256-prod-github-runner-207 kernel: [22580.576512] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:40:06 juju-e4d256-prod-github-runner-207 kernel: [22580.577598] ? show_regs.part.0+0x23/0x29 Aug 22 11:40:06 juju-e4d256-prod-github-runner-207 kernel: [22580.578593] ? show_regs.cold+0x8/0xd Aug 22 11:40:06 juju-e4d256-prod-github-runner-207 kernel: [22580.579562] ? watchdog_timer_fn+0x1be/0x220 Aug 22 11:40:06 juju-e4d256-prod-github-runner-207 kernel: [22580.580582] ? lockup_detector_update_enable+0x60/0x60 Aug 22 11:40:06 juju-e4d256-prod-github-runner-207 kernel: [22580.581653] ? __hrtimer_run_queues+0x107/0x230 Aug 22 11:40:06 juju-e4d256-prod-github-runner-207 kernel: [22580.582720] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 11:40:06 juju-e4d256-prod-github-runner-207 kernel: [22580.583756] ? hrtimer_interrupt+0x101/0x220 Aug 22 11:40:06 juju-e4d256-prod-github-runner-207 kernel: [22580.584775] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 11:40:06 juju-e4d256-prod-github-runner-207 kernel: [22580.585901] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 11:40:06 juju-e4d256-prod-github-runner-207 kernel: [22580.586948] Aug 22 11:40:06 juju-e4d256-prod-github-runner-207 kernel: [22580.587800] Aug 22 11:40:06 juju-e4d256-prod-github-runner-207 kernel: [22580.588642] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 11:40:06 juju-e4d256-prod-github-runner-207 kernel: [22580.589688] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:40:06 juju-e4d256-prod-github-runner-207 kernel: [22580.590736] ? _raw_spin_lock+0x22/0x30 Aug 22 11:40:06 juju-e4d256-prod-github-runner-207 kernel: [22580.591683] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:40:06 juju-e4d256-prod-github-runner-207 kernel: [22580.592711] direct_page_fault+0x206/0x310 [kvm] Aug 22 11:40:06 juju-e4d256-prod-github-runner-207 kernel: [22580.593748] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 11:40:06 juju-e4d256-prod-github-runner-207 kernel: [22580.594759] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 11:40:06 juju-e4d256-prod-github-runner-207 kernel: [22580.595768] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 11:40:06 juju-e4d256-prod-github-runner-207 kernel: [22580.596740] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 11:40:06 juju-e4d256-prod-github-runner-207 kernel: [22580.597717] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 11:40:06 juju-e4d256-prod-github-runner-207 kernel: [22580.598699] handle_exit+0x98/0x230 [kvm_amd] Aug 22 11:40:06 juju-e4d256-prod-github-runner-207 kernel: [22580.599591] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 11:40:06 juju-e4d256-prod-github-runner-207 kernel: [22580.600514] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 11:40:06 juju-e4d256-prod-github-runner-207 kernel: [22580.601461] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 11:40:06 juju-e4d256-prod-github-runner-207 kernel: [22580.602370] vcpu_run+0x62/0x2c0 [kvm] Aug 22 11:40:06 juju-e4d256-prod-github-runner-207 kernel: [22580.603180] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 11:40:06 juju-e4d256-prod-github-runner-207 kernel: [22580.604017] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 11:40:06 juju-e4d256-prod-github-runner-207 kernel: [22580.604880] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 11:40:06 juju-e4d256-prod-github-runner-207 kernel: [22580.605698] ? __seccomp_filter+0x4a/0x4a0 Aug 22 11:40:06 juju-e4d256-prod-github-runner-207 kernel: [22580.606478] ? __fget_files+0x86/0xc0 Aug 22 11:40:06 juju-e4d256-prod-github-runner-207 kernel: [22580.607233] __x64_sys_ioctl+0x95/0xd0 Aug 22 11:40:06 juju-e4d256-prod-github-runner-207 kernel: [22580.607929] do_syscall_64+0x5c/0xc0 Aug 22 11:40:06 juju-e4d256-prod-github-runner-207 kernel: [22580.608600] ? do_futex+0x162/0x1f0 Aug 22 11:40:06 juju-e4d256-prod-github-runner-207 kernel: [22580.609249] ? __x64_sys_futex+0x78/0x1e0 Aug 22 11:40:06 juju-e4d256-prod-github-runner-207 kernel: [22580.609930] ? __secure_computing+0xa9/0x120 Aug 22 11:40:06 juju-e4d256-prod-github-runner-207 kernel: [22580.610634] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 11:40:06 juju-e4d256-prod-github-runner-207 kernel: [22580.611396] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:40:06 juju-e4d256-prod-github-runner-207 kernel: [22580.612119] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:40:06 juju-e4d256-prod-github-runner-207 kernel: [22580.612841] ? do_syscall_64+0x69/0xc0 Aug 22 11:40:06 juju-e4d256-prod-github-runner-207 kernel: [22580.613502] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:40:06 juju-e4d256-prod-github-runner-207 kernel: [22580.614208] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:40:06 juju-e4d256-prod-github-runner-207 kernel: [22580.614904] ? do_syscall_64+0x69/0xc0 Aug 22 11:40:06 juju-e4d256-prod-github-runner-207 kernel: [22580.615530] ? do_syscall_64+0x69/0xc0 Aug 22 11:40:06 juju-e4d256-prod-github-runner-207 kernel: [22580.616164] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 11:40:06 juju-e4d256-prod-github-runner-207 kernel: [22580.616869] RIP: 0033:0x7faa5d0edaff Aug 22 11:40:06 juju-e4d256-prod-github-runner-207 kernel: [22580.617517] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 11:40:06 juju-e4d256-prod-github-runner-207 kernel: [22580.619517] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 11:40:06 juju-e4d256-prod-github-runner-207 kernel: [22580.620430] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 11:40:06 juju-e4d256-prod-github-runner-207 kernel: [22580.621337] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 11:40:06 juju-e4d256-prod-github-runner-207 kernel: [22580.622252] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 11:40:06 juju-e4d256-prod-github-runner-207 kernel: [22580.623150] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 11:40:06 juju-e4d256-prod-github-runner-207 kernel: [22580.624040] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 11:40:06 juju-e4d256-prod-github-runner-207 kernel: [22580.624931] Aug 22 11:40:34 juju-e4d256-prod-github-runner-207 kernel: [22608.541982] watchdog: BUG: soft lockup - CPU#1 stuck for 20947s! [qemu-system-x86:6715] Aug 22 11:40:34 juju-e4d256-prod-github-runner-207 kernel: [22608.543108] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 11:40:34 juju-e4d256-prod-github-runner-207 kernel: [22608.543185] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 11:40:34 juju-e4d256-prod-github-runner-207 kernel: [22608.555605] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 11:40:34 juju-e4d256-prod-github-runner-207 kernel: [22608.556893] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 11:40:34 juju-e4d256-prod-github-runner-207 kernel: [22608.558394] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:40:34 juju-e4d256-prod-github-runner-207 kernel: [22608.559487] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 11:40:34 juju-e4d256-prod-github-runner-207 kernel: [22608.562093] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 11:40:34 juju-e4d256-prod-github-runner-207 kernel: [22608.563297] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 11:40:34 juju-e4d256-prod-github-runner-207 kernel: [22608.564483] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 11:40:34 juju-e4d256-prod-github-runner-207 kernel: [22608.565829] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 11:40:34 juju-e4d256-prod-github-runner-207 kernel: [22608.567039] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 11:40:34 juju-e4d256-prod-github-runner-207 kernel: [22608.568220] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 11:40:34 juju-e4d256-prod-github-runner-207 kernel: [22608.569418] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 11:40:34 juju-e4d256-prod-github-runner-207 kernel: [22608.570657] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 11:40:34 juju-e4d256-prod-github-runner-207 kernel: [22608.571783] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 11:40:34 juju-e4d256-prod-github-runner-207 kernel: [22608.573028] Call Trace: Aug 22 11:40:34 juju-e4d256-prod-github-runner-207 kernel: [22608.574026] Aug 22 11:40:34 juju-e4d256-prod-github-runner-207 kernel: [22608.574964] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:40:34 juju-e4d256-prod-github-runner-207 kernel: [22608.576019] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:40:34 juju-e4d256-prod-github-runner-207 kernel: [22608.577079] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:40:34 juju-e4d256-prod-github-runner-207 kernel: [22608.578185] ? show_regs.part.0+0x23/0x29 Aug 22 11:40:34 juju-e4d256-prod-github-runner-207 kernel: [22608.579189] ? show_regs.cold+0x8/0xd Aug 22 11:40:34 juju-e4d256-prod-github-runner-207 kernel: [22608.580163] ? watchdog_timer_fn+0x1be/0x220 Aug 22 11:40:34 juju-e4d256-prod-github-runner-207 kernel: [22608.581207] ? lockup_detector_update_enable+0x60/0x60 Aug 22 11:40:34 juju-e4d256-prod-github-runner-207 kernel: [22608.582287] ? __hrtimer_run_queues+0x107/0x230 Aug 22 11:40:34 juju-e4d256-prod-github-runner-207 kernel: [22608.583349] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 11:40:34 juju-e4d256-prod-github-runner-207 kernel: [22608.584415] ? hrtimer_interrupt+0x101/0x220 Aug 22 11:40:34 juju-e4d256-prod-github-runner-207 kernel: [22608.585570] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 11:40:34 juju-e4d256-prod-github-runner-207 kernel: [22608.586671] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 11:40:34 juju-e4d256-prod-github-runner-207 kernel: [22608.587752] Aug 22 11:40:34 juju-e4d256-prod-github-runner-207 kernel: [22608.588636] Aug 22 11:40:34 juju-e4d256-prod-github-runner-207 kernel: [22608.589527] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 11:40:34 juju-e4d256-prod-github-runner-207 kernel: [22608.590577] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:40:34 juju-e4d256-prod-github-runner-207 kernel: [22608.591623] ? _raw_spin_lock+0x22/0x30 Aug 22 11:40:34 juju-e4d256-prod-github-runner-207 kernel: [22608.592634] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:40:34 juju-e4d256-prod-github-runner-207 kernel: [22608.593737] direct_page_fault+0x206/0x310 [kvm] Aug 22 11:40:34 juju-e4d256-prod-github-runner-207 kernel: [22608.594830] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 11:40:34 juju-e4d256-prod-github-runner-207 kernel: [22608.595930] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 11:40:34 juju-e4d256-prod-github-runner-207 kernel: [22608.596951] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 11:40:34 juju-e4d256-prod-github-runner-207 kernel: [22608.597958] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 11:40:34 juju-e4d256-prod-github-runner-207 kernel: [22608.598939] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 11:40:34 juju-e4d256-prod-github-runner-207 kernel: [22608.599940] handle_exit+0x98/0x230 [kvm_amd] Aug 22 11:40:34 juju-e4d256-prod-github-runner-207 kernel: [22608.600978] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 11:40:34 juju-e4d256-prod-github-runner-207 kernel: [22608.601981] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 11:40:34 juju-e4d256-prod-github-runner-207 kernel: [22608.602940] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 11:40:34 juju-e4d256-prod-github-runner-207 kernel: [22608.603869] vcpu_run+0x62/0x2c0 [kvm] Aug 22 11:40:34 juju-e4d256-prod-github-runner-207 kernel: [22608.604698] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 11:40:34 juju-e4d256-prod-github-runner-207 kernel: [22608.605522] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 11:40:34 juju-e4d256-prod-github-runner-207 kernel: [22608.606383] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 11:40:34 juju-e4d256-prod-github-runner-207 kernel: [22608.607190] ? __seccomp_filter+0x4a/0x4a0 Aug 22 11:40:34 juju-e4d256-prod-github-runner-207 kernel: [22608.607941] ? __fget_files+0x86/0xc0 Aug 22 11:40:34 juju-e4d256-prod-github-runner-207 kernel: [22608.608657] __x64_sys_ioctl+0x95/0xd0 Aug 22 11:40:34 juju-e4d256-prod-github-runner-207 kernel: [22608.609395] do_syscall_64+0x5c/0xc0 Aug 22 11:40:34 juju-e4d256-prod-github-runner-207 kernel: [22608.610069] ? do_futex+0x162/0x1f0 Aug 22 11:40:34 juju-e4d256-prod-github-runner-207 kernel: [22608.610722] ? __x64_sys_futex+0x78/0x1e0 Aug 22 11:40:34 juju-e4d256-prod-github-runner-207 kernel: [22608.611399] ? __secure_computing+0xa9/0x120 Aug 22 11:40:34 juju-e4d256-prod-github-runner-207 kernel: [22608.612094] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 11:40:34 juju-e4d256-prod-github-runner-207 kernel: [22608.612858] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:40:34 juju-e4d256-prod-github-runner-207 kernel: [22608.613608] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:40:34 juju-e4d256-prod-github-runner-207 kernel: [22608.614369] ? do_syscall_64+0x69/0xc0 Aug 22 11:40:34 juju-e4d256-prod-github-runner-207 kernel: [22608.615023] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:40:34 juju-e4d256-prod-github-runner-207 kernel: [22608.615736] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:40:34 juju-e4d256-prod-github-runner-207 kernel: [22608.616440] ? do_syscall_64+0x69/0xc0 Aug 22 11:40:34 juju-e4d256-prod-github-runner-207 kernel: [22608.617082] ? do_syscall_64+0x69/0xc0 Aug 22 11:40:34 juju-e4d256-prod-github-runner-207 kernel: [22608.617709] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 11:40:34 juju-e4d256-prod-github-runner-207 kernel: [22608.618428] RIP: 0033:0x7faa5d0edaff Aug 22 11:40:34 juju-e4d256-prod-github-runner-207 kernel: [22608.619060] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 11:40:34 juju-e4d256-prod-github-runner-207 kernel: [22608.621071] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 11:40:34 juju-e4d256-prod-github-runner-207 kernel: [22608.621988] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 11:40:34 juju-e4d256-prod-github-runner-207 kernel: [22608.622963] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 11:40:34 juju-e4d256-prod-github-runner-207 kernel: [22608.623868] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 11:40:34 juju-e4d256-prod-github-runner-207 kernel: [22608.624804] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 11:40:34 juju-e4d256-prod-github-runner-207 kernel: [22608.625719] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 11:40:34 juju-e4d256-prod-github-runner-207 kernel: [22608.626623] Aug 22 11:41:02 juju-e4d256-prod-github-runner-207 kernel: [22636.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 20973s! [qemu-system-x86:6715] Aug 22 11:41:02 juju-e4d256-prod-github-runner-207 kernel: [22636.543916] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 11:41:02 juju-e4d256-prod-github-runner-207 kernel: [22636.544233] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 11:41:02 juju-e4d256-prod-github-runner-207 kernel: [22636.556674] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 11:41:02 juju-e4d256-prod-github-runner-207 kernel: [22636.557967] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 11:41:02 juju-e4d256-prod-github-runner-207 kernel: [22636.559204] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:41:02 juju-e4d256-prod-github-runner-207 kernel: [22636.560266] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 11:41:02 juju-e4d256-prod-github-runner-207 kernel: [22636.562851] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 11:41:02 juju-e4d256-prod-github-runner-207 kernel: [22636.563896] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 11:41:02 juju-e4d256-prod-github-runner-207 kernel: [22636.565070] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 11:41:02 juju-e4d256-prod-github-runner-207 kernel: [22636.566233] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 11:41:02 juju-e4d256-prod-github-runner-207 kernel: [22636.567402] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 11:41:02 juju-e4d256-prod-github-runner-207 kernel: [22636.568580] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 11:41:02 juju-e4d256-prod-github-runner-207 kernel: [22636.570097] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 11:41:02 juju-e4d256-prod-github-runner-207 kernel: [22636.571369] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 11:41:02 juju-e4d256-prod-github-runner-207 kernel: [22636.572489] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 11:41:02 juju-e4d256-prod-github-runner-207 kernel: [22636.573802] Call Trace: Aug 22 11:41:02 juju-e4d256-prod-github-runner-207 kernel: [22636.574725] Aug 22 11:41:02 juju-e4d256-prod-github-runner-207 kernel: [22636.575638] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:41:02 juju-e4d256-prod-github-runner-207 kernel: [22636.576684] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:41:02 juju-e4d256-prod-github-runner-207 kernel: [22636.577764] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:41:02 juju-e4d256-prod-github-runner-207 kernel: [22636.578868] ? show_regs.part.0+0x23/0x29 Aug 22 11:41:02 juju-e4d256-prod-github-runner-207 kernel: [22636.579871] ? show_regs.cold+0x8/0xd Aug 22 11:41:02 juju-e4d256-prod-github-runner-207 kernel: [22636.580882] ? watchdog_timer_fn+0x1be/0x220 Aug 22 11:41:02 juju-e4d256-prod-github-runner-207 kernel: [22636.581903] ? lockup_detector_update_enable+0x60/0x60 Aug 22 11:41:02 juju-e4d256-prod-github-runner-207 kernel: [22636.582972] ? __hrtimer_run_queues+0x107/0x230 Aug 22 11:41:02 juju-e4d256-prod-github-runner-207 kernel: [22636.584002] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 11:41:02 juju-e4d256-prod-github-runner-207 kernel: [22636.585052] ? hrtimer_interrupt+0x101/0x220 Aug 22 11:41:02 juju-e4d256-prod-github-runner-207 kernel: [22636.586070] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 11:41:02 juju-e4d256-prod-github-runner-207 kernel: [22636.587137] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 11:41:02 juju-e4d256-prod-github-runner-207 kernel: [22636.588185] Aug 22 11:41:02 juju-e4d256-prod-github-runner-207 kernel: [22636.589051] Aug 22 11:41:02 juju-e4d256-prod-github-runner-207 kernel: [22636.589889] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 11:41:02 juju-e4d256-prod-github-runner-207 kernel: [22636.590933] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:41:02 juju-e4d256-prod-github-runner-207 kernel: [22636.591977] ? _raw_spin_lock+0x22/0x30 Aug 22 11:41:02 juju-e4d256-prod-github-runner-207 kernel: [22636.592954] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:41:02 juju-e4d256-prod-github-runner-207 kernel: [22636.594025] direct_page_fault+0x206/0x310 [kvm] Aug 22 11:41:02 juju-e4d256-prod-github-runner-207 kernel: [22636.595154] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 11:41:02 juju-e4d256-prod-github-runner-207 kernel: [22636.596167] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 11:41:02 juju-e4d256-prod-github-runner-207 kernel: [22636.597187] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 11:41:02 juju-e4d256-prod-github-runner-207 kernel: [22636.598209] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 11:41:02 juju-e4d256-prod-github-runner-207 kernel: [22636.599158] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 11:41:02 juju-e4d256-prod-github-runner-207 kernel: [22636.600136] handle_exit+0x98/0x230 [kvm_amd] Aug 22 11:41:02 juju-e4d256-prod-github-runner-207 kernel: [22636.601055] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 11:41:02 juju-e4d256-prod-github-runner-207 kernel: [22636.601978] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 11:41:02 juju-e4d256-prod-github-runner-207 kernel: [22636.602921] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 11:41:02 juju-e4d256-prod-github-runner-207 kernel: [22636.603846] vcpu_run+0x62/0x2c0 [kvm] Aug 22 11:41:02 juju-e4d256-prod-github-runner-207 kernel: [22636.604683] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 11:41:02 juju-e4d256-prod-github-runner-207 kernel: [22636.605510] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 11:41:02 juju-e4d256-prod-github-runner-207 kernel: [22636.606368] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 11:41:02 juju-e4d256-prod-github-runner-207 kernel: [22636.607167] ? __seccomp_filter+0x4a/0x4a0 Aug 22 11:41:02 juju-e4d256-prod-github-runner-207 kernel: [22636.607937] ? __fget_files+0x86/0xc0 Aug 22 11:41:02 juju-e4d256-prod-github-runner-207 kernel: [22636.608644] __x64_sys_ioctl+0x95/0xd0 Aug 22 11:41:02 juju-e4d256-prod-github-runner-207 kernel: [22636.609361] do_syscall_64+0x5c/0xc0 Aug 22 11:41:02 juju-e4d256-prod-github-runner-207 kernel: [22636.610026] ? do_futex+0x162/0x1f0 Aug 22 11:41:02 juju-e4d256-prod-github-runner-207 kernel: [22636.610689] ? __x64_sys_futex+0x78/0x1e0 Aug 22 11:41:02 juju-e4d256-prod-github-runner-207 kernel: [22636.611367] ? __secure_computing+0xa9/0x120 Aug 22 11:41:02 juju-e4d256-prod-github-runner-207 kernel: [22636.612068] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 11:41:02 juju-e4d256-prod-github-runner-207 kernel: [22636.612845] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:41:02 juju-e4d256-prod-github-runner-207 kernel: [22636.613566] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:41:02 juju-e4d256-prod-github-runner-207 kernel: [22636.614299] ? do_syscall_64+0x69/0xc0 Aug 22 11:41:02 juju-e4d256-prod-github-runner-207 kernel: [22636.614944] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:41:02 juju-e4d256-prod-github-runner-207 kernel: [22636.615649] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:41:02 juju-e4d256-prod-github-runner-207 kernel: [22636.616344] ? do_syscall_64+0x69/0xc0 Aug 22 11:41:02 juju-e4d256-prod-github-runner-207 kernel: [22636.616990] ? do_syscall_64+0x69/0xc0 Aug 22 11:41:02 juju-e4d256-prod-github-runner-207 kernel: [22636.617614] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 11:41:02 juju-e4d256-prod-github-runner-207 kernel: [22636.618327] RIP: 0033:0x7faa5d0edaff Aug 22 11:41:02 juju-e4d256-prod-github-runner-207 kernel: [22636.618987] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 11:41:02 juju-e4d256-prod-github-runner-207 kernel: [22636.620998] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 11:41:02 juju-e4d256-prod-github-runner-207 kernel: [22636.621908] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 11:41:02 juju-e4d256-prod-github-runner-207 kernel: [22636.622798] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 11:41:02 juju-e4d256-prod-github-runner-207 kernel: [22636.623722] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 11:41:02 juju-e4d256-prod-github-runner-207 kernel: [22636.624614] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 11:41:02 juju-e4d256-prod-github-runner-207 kernel: [22636.625517] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 11:41:02 juju-e4d256-prod-github-runner-207 kernel: [22636.626408] Aug 22 11:41:30 juju-e4d256-prod-github-runner-207 kernel: [22664.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 20999s! [qemu-system-x86:6715] Aug 22 11:41:30 juju-e4d256-prod-github-runner-207 kernel: [22664.543125] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 11:41:30 juju-e4d256-prod-github-runner-207 kernel: [22664.543199] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 11:41:30 juju-e4d256-prod-github-runner-207 kernel: [22664.555544] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 11:41:30 juju-e4d256-prod-github-runner-207 kernel: [22664.556869] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 11:41:30 juju-e4d256-prod-github-runner-207 kernel: [22664.558166] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:41:30 juju-e4d256-prod-github-runner-207 kernel: [22664.559283] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 11:41:30 juju-e4d256-prod-github-runner-207 kernel: [22664.561999] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 11:41:30 juju-e4d256-prod-github-runner-207 kernel: [22664.563061] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 11:41:30 juju-e4d256-prod-github-runner-207 kernel: [22664.564303] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 11:41:30 juju-e4d256-prod-github-runner-207 kernel: [22664.565583] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 11:41:30 juju-e4d256-prod-github-runner-207 kernel: [22664.566745] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 11:41:30 juju-e4d256-prod-github-runner-207 kernel: [22664.567904] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 11:41:30 juju-e4d256-prod-github-runner-207 kernel: [22664.569091] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 11:41:30 juju-e4d256-prod-github-runner-207 kernel: [22664.570514] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 11:41:30 juju-e4d256-prod-github-runner-207 kernel: [22664.571617] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 11:41:30 juju-e4d256-prod-github-runner-207 kernel: [22664.572827] Call Trace: Aug 22 11:41:30 juju-e4d256-prod-github-runner-207 kernel: [22664.573738] Aug 22 11:41:30 juju-e4d256-prod-github-runner-207 kernel: [22664.574618] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:41:30 juju-e4d256-prod-github-runner-207 kernel: [22664.575652] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:41:30 juju-e4d256-prod-github-runner-207 kernel: [22664.576687] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:41:30 juju-e4d256-prod-github-runner-207 kernel: [22664.577765] ? show_regs.part.0+0x23/0x29 Aug 22 11:41:30 juju-e4d256-prod-github-runner-207 kernel: [22664.578759] ? show_regs.cold+0x8/0xd Aug 22 11:41:30 juju-e4d256-prod-github-runner-207 kernel: [22664.579726] ? watchdog_timer_fn+0x1be/0x220 Aug 22 11:41:30 juju-e4d256-prod-github-runner-207 kernel: [22664.580748] ? lockup_detector_update_enable+0x60/0x60 Aug 22 11:41:30 juju-e4d256-prod-github-runner-207 kernel: [22664.581814] ? __hrtimer_run_queues+0x107/0x230 Aug 22 11:41:30 juju-e4d256-prod-github-runner-207 kernel: [22664.582844] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 11:41:30 juju-e4d256-prod-github-runner-207 kernel: [22664.583868] ? hrtimer_interrupt+0x101/0x220 Aug 22 11:41:30 juju-e4d256-prod-github-runner-207 kernel: [22664.584902] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 11:41:30 juju-e4d256-prod-github-runner-207 kernel: [22664.585967] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 11:41:30 juju-e4d256-prod-github-runner-207 kernel: [22664.587010] Aug 22 11:41:30 juju-e4d256-prod-github-runner-207 kernel: [22664.587863] Aug 22 11:41:30 juju-e4d256-prod-github-runner-207 kernel: [22664.588710] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 11:41:30 juju-e4d256-prod-github-runner-207 kernel: [22664.589745] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:41:30 juju-e4d256-prod-github-runner-207 kernel: [22664.590781] ? _raw_spin_lock+0x22/0x30 Aug 22 11:41:30 juju-e4d256-prod-github-runner-207 kernel: [22664.591730] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:41:30 juju-e4d256-prod-github-runner-207 kernel: [22664.592761] direct_page_fault+0x206/0x310 [kvm] Aug 22 11:41:30 juju-e4d256-prod-github-runner-207 kernel: [22664.593789] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 11:41:30 juju-e4d256-prod-github-runner-207 kernel: [22664.594800] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 11:41:30 juju-e4d256-prod-github-runner-207 kernel: [22664.595804] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 11:41:30 juju-e4d256-prod-github-runner-207 kernel: [22664.596783] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 11:41:30 juju-e4d256-prod-github-runner-207 kernel: [22664.597729] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 11:41:30 juju-e4d256-prod-github-runner-207 kernel: [22664.598705] handle_exit+0x98/0x230 [kvm_amd] Aug 22 11:41:30 juju-e4d256-prod-github-runner-207 kernel: [22664.599596] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 11:41:30 juju-e4d256-prod-github-runner-207 kernel: [22664.600514] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 11:41:30 juju-e4d256-prod-github-runner-207 kernel: [22664.601440] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 11:41:30 juju-e4d256-prod-github-runner-207 kernel: [22664.602352] vcpu_run+0x62/0x2c0 [kvm] Aug 22 11:41:30 juju-e4d256-prod-github-runner-207 kernel: [22664.603162] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 11:41:30 juju-e4d256-prod-github-runner-207 kernel: [22664.603969] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 11:41:30 juju-e4d256-prod-github-runner-207 kernel: [22664.604835] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 11:41:30 juju-e4d256-prod-github-runner-207 kernel: [22664.605636] ? __seccomp_filter+0x4a/0x4a0 Aug 22 11:41:30 juju-e4d256-prod-github-runner-207 kernel: [22664.606383] ? __fget_files+0x86/0xc0 Aug 22 11:41:30 juju-e4d256-prod-github-runner-207 kernel: [22664.607086] __x64_sys_ioctl+0x95/0xd0 Aug 22 11:41:30 juju-e4d256-prod-github-runner-207 kernel: [22664.607780] do_syscall_64+0x5c/0xc0 Aug 22 11:41:30 juju-e4d256-prod-github-runner-207 kernel: [22664.608465] ? do_futex+0x162/0x1f0 Aug 22 11:41:30 juju-e4d256-prod-github-runner-207 kernel: [22664.609114] ? __x64_sys_futex+0x78/0x1e0 Aug 22 11:41:30 juju-e4d256-prod-github-runner-207 kernel: [22664.609799] ? __secure_computing+0xa9/0x120 Aug 22 11:41:30 juju-e4d256-prod-github-runner-207 kernel: [22664.610501] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 11:41:30 juju-e4d256-prod-github-runner-207 kernel: [22664.611265] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:41:30 juju-e4d256-prod-github-runner-207 kernel: [22664.611991] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:41:30 juju-e4d256-prod-github-runner-207 kernel: [22664.612722] ? do_syscall_64+0x69/0xc0 Aug 22 11:41:30 juju-e4d256-prod-github-runner-207 kernel: [22664.613373] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:41:30 juju-e4d256-prod-github-runner-207 kernel: [22664.614079] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:41:30 juju-e4d256-prod-github-runner-207 kernel: [22664.614773] ? do_syscall_64+0x69/0xc0 Aug 22 11:41:30 juju-e4d256-prod-github-runner-207 kernel: [22664.615402] ? do_syscall_64+0x69/0xc0 Aug 22 11:41:30 juju-e4d256-prod-github-runner-207 kernel: [22664.616023] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 11:41:30 juju-e4d256-prod-github-runner-207 kernel: [22664.616741] RIP: 0033:0x7faa5d0edaff Aug 22 11:41:30 juju-e4d256-prod-github-runner-207 kernel: [22664.617374] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 11:41:30 juju-e4d256-prod-github-runner-207 kernel: [22664.619367] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 11:41:30 juju-e4d256-prod-github-runner-207 kernel: [22664.620285] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 11:41:30 juju-e4d256-prod-github-runner-207 kernel: [22664.621185] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 11:41:30 juju-e4d256-prod-github-runner-207 kernel: [22664.622071] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 11:41:30 juju-e4d256-prod-github-runner-207 kernel: [22664.622965] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 11:41:30 juju-e4d256-prod-github-runner-207 kernel: [22664.623850] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 11:41:30 juju-e4d256-prod-github-runner-207 kernel: [22664.624754] Aug 22 11:41:44 juju-e4d256-prod-github-runner-207 kernel: [22678.700706] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 11:41:44 juju-e4d256-prod-github-runner-207 kernel: [22678.701677] rcu: 1-....: (5622772 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=2722079 Aug 22 11:41:44 juju-e4d256-prod-github-runner-207 kernel: [22678.702827] (t=5640375 jiffies g=23269 q=28051) Aug 22 11:41:44 juju-e4d256-prod-github-runner-207 kernel: [22678.703616] NMI backtrace for cpu 1 Aug 22 11:41:44 juju-e4d256-prod-github-runner-207 kernel: [22678.704347] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 11:41:44 juju-e4d256-prod-github-runner-207 kernel: [22678.705522] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 11:41:44 juju-e4d256-prod-github-runner-207 kernel: [22678.706598] Call Trace: Aug 22 11:41:44 juju-e4d256-prod-github-runner-207 kernel: [22678.707277] Aug 22 11:41:44 juju-e4d256-prod-github-runner-207 kernel: [22678.707923] show_stack+0x52/0x5c Aug 22 11:41:44 juju-e4d256-prod-github-runner-207 kernel: [22678.708671] dump_stack_lvl+0x4a/0x63 Aug 22 11:41:44 juju-e4d256-prod-github-runner-207 kernel: [22678.709427] dump_stack+0x10/0x16 Aug 22 11:41:44 juju-e4d256-prod-github-runner-207 kernel: [22678.710150] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 11:41:44 juju-e4d256-prod-github-runner-207 kernel: [22678.710959] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 11:41:44 juju-e4d256-prod-github-runner-207 kernel: [22678.711755] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 11:41:44 juju-e4d256-prod-github-runner-207 kernel: [22678.712600] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 11:41:44 juju-e4d256-prod-github-runner-207 kernel: [22678.713436] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 11:41:44 juju-e4d256-prod-github-runner-207 kernel: [22678.714259] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 11:41:44 juju-e4d256-prod-github-runner-207 kernel: [22678.715038] print_cpu_stall.cold+0x2f/0xe2 Aug 22 11:41:44 juju-e4d256-prod-github-runner-207 kernel: [22678.715808] ? timekeeping_update+0xf7/0x150 Aug 22 11:41:44 juju-e4d256-prod-github-runner-207 kernel: [22678.716605] check_cpu_stall+0x109/0x270 Aug 22 11:41:44 juju-e4d256-prod-github-runner-207 kernel: [22678.717368] rcu_sched_clock_irq+0x9a/0x250 Aug 22 11:41:44 juju-e4d256-prod-github-runner-207 kernel: [22678.718135] update_process_times+0x94/0xd0 Aug 22 11:41:44 juju-e4d256-prod-github-runner-207 kernel: [22678.718899] tick_sched_handle+0x29/0x70 Aug 22 11:41:44 juju-e4d256-prod-github-runner-207 kernel: [22678.719650] tick_sched_timer+0x8c/0xc0 Aug 22 11:41:44 juju-e4d256-prod-github-runner-207 kernel: [22678.720409] ? tick_nohz_handler+0xb0/0xb0 Aug 22 11:41:44 juju-e4d256-prod-github-runner-207 kernel: [22678.721173] __hrtimer_run_queues+0x107/0x230 Aug 22 11:41:44 juju-e4d256-prod-github-runner-207 kernel: [22678.721952] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 11:41:44 juju-e4d256-prod-github-runner-207 kernel: [22678.722961] hrtimer_interrupt+0x101/0x220 Aug 22 11:41:44 juju-e4d256-prod-github-runner-207 kernel: [22678.723731] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 11:41:44 juju-e4d256-prod-github-runner-207 kernel: [22678.724565] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 11:41:44 juju-e4d256-prod-github-runner-207 kernel: [22678.725375] Aug 22 11:41:44 juju-e4d256-prod-github-runner-207 kernel: [22678.726011] Aug 22 11:41:44 juju-e4d256-prod-github-runner-207 kernel: [22678.726642] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 11:41:44 juju-e4d256-prod-github-runner-207 kernel: [22678.727475] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:41:44 juju-e4d256-prod-github-runner-207 kernel: [22678.728367] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 11:41:44 juju-e4d256-prod-github-runner-207 kernel: [22678.730568] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 11:41:44 juju-e4d256-prod-github-runner-207 kernel: [22678.731437] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 11:41:44 juju-e4d256-prod-github-runner-207 kernel: [22678.732442] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 11:41:44 juju-e4d256-prod-github-runner-207 kernel: [22678.733421] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 11:41:44 juju-e4d256-prod-github-runner-207 kernel: [22678.734378] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 11:41:44 juju-e4d256-prod-github-runner-207 kernel: [22678.735327] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 11:41:44 juju-e4d256-prod-github-runner-207 kernel: [22678.736304] ? _raw_spin_lock+0x22/0x30 Aug 22 11:41:44 juju-e4d256-prod-github-runner-207 kernel: [22678.737063] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:41:44 juju-e4d256-prod-github-runner-207 kernel: [22678.737907] direct_page_fault+0x206/0x310 [kvm] Aug 22 11:41:44 juju-e4d256-prod-github-runner-207 kernel: [22678.738747] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 11:41:44 juju-e4d256-prod-github-runner-207 kernel: [22678.739571] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 11:41:44 juju-e4d256-prod-github-runner-207 kernel: [22678.740410] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 11:41:44 juju-e4d256-prod-github-runner-207 kernel: [22678.741226] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 11:41:44 juju-e4d256-prod-github-runner-207 kernel: [22678.742014] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 11:41:44 juju-e4d256-prod-github-runner-207 kernel: [22678.742833] handle_exit+0x98/0x230 [kvm_amd] Aug 22 11:41:44 juju-e4d256-prod-github-runner-207 kernel: [22678.743591] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 11:41:44 juju-e4d256-prod-github-runner-207 kernel: [22678.744384] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 11:41:44 juju-e4d256-prod-github-runner-207 kernel: [22678.745182] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 11:41:44 juju-e4d256-prod-github-runner-207 kernel: [22678.745965] vcpu_run+0x62/0x2c0 [kvm] Aug 22 11:41:44 juju-e4d256-prod-github-runner-207 kernel: [22678.746678] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 11:41:44 juju-e4d256-prod-github-runner-207 kernel: [22678.747409] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 11:41:44 juju-e4d256-prod-github-runner-207 kernel: [22678.748226] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 11:41:44 juju-e4d256-prod-github-runner-207 kernel: [22678.748987] ? __seccomp_filter+0x4a/0x4a0 Aug 22 11:41:44 juju-e4d256-prod-github-runner-207 kernel: [22678.749713] ? __fget_files+0x86/0xc0 Aug 22 11:41:44 juju-e4d256-prod-github-runner-207 kernel: [22678.750405] __x64_sys_ioctl+0x95/0xd0 Aug 22 11:41:44 juju-e4d256-prod-github-runner-207 kernel: [22678.751098] do_syscall_64+0x5c/0xc0 Aug 22 11:41:44 juju-e4d256-prod-github-runner-207 kernel: [22678.751777] ? do_futex+0x162/0x1f0 Aug 22 11:41:44 juju-e4d256-prod-github-runner-207 kernel: [22678.752468] ? __x64_sys_futex+0x78/0x1e0 Aug 22 11:41:44 juju-e4d256-prod-github-runner-207 kernel: [22678.753170] ? __secure_computing+0xa9/0x120 Aug 22 11:41:44 juju-e4d256-prod-github-runner-207 kernel: [22678.753887] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 11:41:44 juju-e4d256-prod-github-runner-207 kernel: [22678.754874] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:41:44 juju-e4d256-prod-github-runner-207 kernel: [22678.755651] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:41:44 juju-e4d256-prod-github-runner-207 kernel: [22678.756412] ? do_syscall_64+0x69/0xc0 Aug 22 11:41:44 juju-e4d256-prod-github-runner-207 kernel: [22678.757110] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:41:44 juju-e4d256-prod-github-runner-207 kernel: [22678.757880] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:41:44 juju-e4d256-prod-github-runner-207 kernel: [22678.758644] ? do_syscall_64+0x69/0xc0 Aug 22 11:41:44 juju-e4d256-prod-github-runner-207 kernel: [22678.759342] ? do_syscall_64+0x69/0xc0 Aug 22 11:41:44 juju-e4d256-prod-github-runner-207 kernel: [22678.760028] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 11:41:44 juju-e4d256-prod-github-runner-207 kernel: [22678.760813] RIP: 0033:0x7faa5d0edaff Aug 22 11:41:44 juju-e4d256-prod-github-runner-207 kernel: [22678.761496] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 11:41:44 juju-e4d256-prod-github-runner-207 kernel: [22678.763627] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 11:41:44 juju-e4d256-prod-github-runner-207 kernel: [22678.764623] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 11:41:44 juju-e4d256-prod-github-runner-207 kernel: [22678.765576] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 11:41:44 juju-e4d256-prod-github-runner-207 kernel: [22678.766518] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 11:41:44 juju-e4d256-prod-github-runner-207 kernel: [22678.767471] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 11:41:44 juju-e4d256-prod-github-runner-207 kernel: [22678.768422] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 11:41:44 juju-e4d256-prod-github-runner-207 kernel: [22678.769345] Aug 22 11:42:10 juju-e4d256-prod-github-runner-207 kernel: [22704.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 21037s! [qemu-system-x86:6715] Aug 22 11:42:10 juju-e4d256-prod-github-runner-207 kernel: [22704.543124] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 11:42:10 juju-e4d256-prod-github-runner-207 kernel: [22704.543196] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 11:42:10 juju-e4d256-prod-github-runner-207 kernel: [22704.555285] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 11:42:10 juju-e4d256-prod-github-runner-207 kernel: [22704.556561] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 11:42:10 juju-e4d256-prod-github-runner-207 kernel: [22704.557781] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:42:10 juju-e4d256-prod-github-runner-207 kernel: [22704.558839] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 11:42:10 juju-e4d256-prod-github-runner-207 kernel: [22704.561430] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 11:42:10 juju-e4d256-prod-github-runner-207 kernel: [22704.562472] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 11:42:10 juju-e4d256-prod-github-runner-207 kernel: [22704.563638] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 11:42:10 juju-e4d256-prod-github-runner-207 kernel: [22704.564807] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 11:42:10 juju-e4d256-prod-github-runner-207 kernel: [22704.565966] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 11:42:10 juju-e4d256-prod-github-runner-207 kernel: [22704.567127] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 11:42:10 juju-e4d256-prod-github-runner-207 kernel: [22704.568302] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 11:42:10 juju-e4d256-prod-github-runner-207 kernel: [22704.569538] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 11:42:10 juju-e4d256-prod-github-runner-207 kernel: [22704.570637] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 11:42:10 juju-e4d256-prod-github-runner-207 kernel: [22704.571827] Call Trace: Aug 22 11:42:10 juju-e4d256-prod-github-runner-207 kernel: [22704.572746] Aug 22 11:42:10 juju-e4d256-prod-github-runner-207 kernel: [22704.573634] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:42:10 juju-e4d256-prod-github-runner-207 kernel: [22704.574670] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:42:10 juju-e4d256-prod-github-runner-207 kernel: [22704.575697] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:42:10 juju-e4d256-prod-github-runner-207 kernel: [22704.576783] ? show_regs.part.0+0x23/0x29 Aug 22 11:42:10 juju-e4d256-prod-github-runner-207 kernel: [22704.577777] ? show_regs.cold+0x8/0xd Aug 22 11:42:10 juju-e4d256-prod-github-runner-207 kernel: [22704.578745] ? watchdog_timer_fn+0x1be/0x220 Aug 22 11:42:10 juju-e4d256-prod-github-runner-207 kernel: [22704.579750] ? lockup_detector_update_enable+0x60/0x60 Aug 22 11:42:10 juju-e4d256-prod-github-runner-207 kernel: [22704.580823] ? __hrtimer_run_queues+0x107/0x230 Aug 22 11:42:10 juju-e4d256-prod-github-runner-207 kernel: [22704.581856] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 11:42:10 juju-e4d256-prod-github-runner-207 kernel: [22704.582884] ? hrtimer_interrupt+0x101/0x220 Aug 22 11:42:10 juju-e4d256-prod-github-runner-207 kernel: [22704.583914] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 11:42:10 juju-e4d256-prod-github-runner-207 kernel: [22704.585038] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 11:42:10 juju-e4d256-prod-github-runner-207 kernel: [22704.586085] Aug 22 11:42:10 juju-e4d256-prod-github-runner-207 kernel: [22704.586941] Aug 22 11:42:10 juju-e4d256-prod-github-runner-207 kernel: [22704.587778] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 11:42:10 juju-e4d256-prod-github-runner-207 kernel: [22704.588816] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:42:10 juju-e4d256-prod-github-runner-207 kernel: [22704.589850] ? _raw_spin_lock+0x22/0x30 Aug 22 11:42:10 juju-e4d256-prod-github-runner-207 kernel: [22704.590792] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:42:10 juju-e4d256-prod-github-runner-207 kernel: [22704.591804] direct_page_fault+0x206/0x310 [kvm] Aug 22 11:42:10 juju-e4d256-prod-github-runner-207 kernel: [22704.592858] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 11:42:10 juju-e4d256-prod-github-runner-207 kernel: [22704.593869] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 11:42:10 juju-e4d256-prod-github-runner-207 kernel: [22704.594916] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 11:42:10 juju-e4d256-prod-github-runner-207 kernel: [22704.595896] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 11:42:10 juju-e4d256-prod-github-runner-207 kernel: [22704.596895] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 11:42:10 juju-e4d256-prod-github-runner-207 kernel: [22704.597868] handle_exit+0x98/0x230 [kvm_amd] Aug 22 11:42:10 juju-e4d256-prod-github-runner-207 kernel: [22704.598758] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 11:42:10 juju-e4d256-prod-github-runner-207 kernel: [22704.599670] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 11:42:10 juju-e4d256-prod-github-runner-207 kernel: [22704.600598] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 11:42:10 juju-e4d256-prod-github-runner-207 kernel: [22704.601503] vcpu_run+0x62/0x2c0 [kvm] Aug 22 11:42:10 juju-e4d256-prod-github-runner-207 kernel: [22704.602343] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 11:42:10 juju-e4d256-prod-github-runner-207 kernel: [22704.603163] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 11:42:10 juju-e4d256-prod-github-runner-207 kernel: [22704.604036] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 11:42:10 juju-e4d256-prod-github-runner-207 kernel: [22704.604877] ? __seccomp_filter+0x4a/0x4a0 Aug 22 11:42:10 juju-e4d256-prod-github-runner-207 kernel: [22704.605654] ? __fget_files+0x86/0xc0 Aug 22 11:42:10 juju-e4d256-prod-github-runner-207 kernel: [22704.606356] __x64_sys_ioctl+0x95/0xd0 Aug 22 11:42:10 juju-e4d256-prod-github-runner-207 kernel: [22704.607052] do_syscall_64+0x5c/0xc0 Aug 22 11:42:10 juju-e4d256-prod-github-runner-207 kernel: [22704.607718] ? do_futex+0x162/0x1f0 Aug 22 11:42:10 juju-e4d256-prod-github-runner-207 kernel: [22704.608399] ? __x64_sys_futex+0x78/0x1e0 Aug 22 11:42:10 juju-e4d256-prod-github-runner-207 kernel: [22704.609077] ? __secure_computing+0xa9/0x120 Aug 22 11:42:10 juju-e4d256-prod-github-runner-207 kernel: [22704.609797] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 11:42:10 juju-e4d256-prod-github-runner-207 kernel: [22704.610554] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:42:10 juju-e4d256-prod-github-runner-207 kernel: [22704.611273] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:42:10 juju-e4d256-prod-github-runner-207 kernel: [22704.611999] ? do_syscall_64+0x69/0xc0 Aug 22 11:42:10 juju-e4d256-prod-github-runner-207 kernel: [22704.612644] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:42:10 juju-e4d256-prod-github-runner-207 kernel: [22704.613345] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:42:10 juju-e4d256-prod-github-runner-207 kernel: [22704.614037] ? do_syscall_64+0x69/0xc0 Aug 22 11:42:10 juju-e4d256-prod-github-runner-207 kernel: [22704.614665] ? do_syscall_64+0x69/0xc0 Aug 22 11:42:10 juju-e4d256-prod-github-runner-207 kernel: [22704.615285] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 11:42:10 juju-e4d256-prod-github-runner-207 kernel: [22704.615997] RIP: 0033:0x7faa5d0edaff Aug 22 11:42:10 juju-e4d256-prod-github-runner-207 kernel: [22704.616620] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 11:42:10 juju-e4d256-prod-github-runner-207 kernel: [22704.618614] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 11:42:10 juju-e4d256-prod-github-runner-207 kernel: [22704.619525] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 11:42:10 juju-e4d256-prod-github-runner-207 kernel: [22704.620425] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 11:42:10 juju-e4d256-prod-github-runner-207 kernel: [22704.621313] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 11:42:10 juju-e4d256-prod-github-runner-207 kernel: [22704.622199] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 11:42:10 juju-e4d256-prod-github-runner-207 kernel: [22704.623088] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 11:42:10 juju-e4d256-prod-github-runner-207 kernel: [22704.624076] Aug 22 11:42:38 juju-e4d256-prod-github-runner-207 kernel: [22732.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 21063s! [qemu-system-x86:6715] Aug 22 11:42:38 juju-e4d256-prod-github-runner-207 kernel: [22732.543873] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 11:42:38 juju-e4d256-prod-github-runner-207 kernel: [22732.544181] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 11:42:38 juju-e4d256-prod-github-runner-207 kernel: [22732.556567] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 11:42:38 juju-e4d256-prod-github-runner-207 kernel: [22732.557859] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 11:42:38 juju-e4d256-prod-github-runner-207 kernel: [22732.559128] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:42:38 juju-e4d256-prod-github-runner-207 kernel: [22732.560240] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 11:42:38 juju-e4d256-prod-github-runner-207 kernel: [22732.562846] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 11:42:38 juju-e4d256-prod-github-runner-207 kernel: [22732.563920] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 11:42:38 juju-e4d256-prod-github-runner-207 kernel: [22732.565123] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 11:42:38 juju-e4d256-prod-github-runner-207 kernel: [22732.566333] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 11:42:38 juju-e4d256-prod-github-runner-207 kernel: [22732.567516] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 11:42:38 juju-e4d256-prod-github-runner-207 kernel: [22732.568708] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 11:42:38 juju-e4d256-prod-github-runner-207 kernel: [22732.569889] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 11:42:38 juju-e4d256-prod-github-runner-207 kernel: [22732.571149] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 11:42:38 juju-e4d256-prod-github-runner-207 kernel: [22732.572280] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 11:42:38 juju-e4d256-prod-github-runner-207 kernel: [22732.573491] Call Trace: Aug 22 11:42:38 juju-e4d256-prod-github-runner-207 kernel: [22732.574408] Aug 22 11:42:38 juju-e4d256-prod-github-runner-207 kernel: [22732.575306] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:42:38 juju-e4d256-prod-github-runner-207 kernel: [22732.576367] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:42:38 juju-e4d256-prod-github-runner-207 kernel: [22732.577407] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:42:38 juju-e4d256-prod-github-runner-207 kernel: [22732.578505] ? show_regs.part.0+0x23/0x29 Aug 22 11:42:38 juju-e4d256-prod-github-runner-207 kernel: [22732.579534] ? show_regs.cold+0x8/0xd Aug 22 11:42:38 juju-e4d256-prod-github-runner-207 kernel: [22732.580541] ? watchdog_timer_fn+0x1be/0x220 Aug 22 11:42:38 juju-e4d256-prod-github-runner-207 kernel: [22732.581572] ? lockup_detector_update_enable+0x60/0x60 Aug 22 11:42:38 juju-e4d256-prod-github-runner-207 kernel: [22732.582655] ? __hrtimer_run_queues+0x107/0x230 Aug 22 11:42:38 juju-e4d256-prod-github-runner-207 kernel: [22732.583709] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 11:42:38 juju-e4d256-prod-github-runner-207 kernel: [22732.584741] ? hrtimer_interrupt+0x101/0x220 Aug 22 11:42:38 juju-e4d256-prod-github-runner-207 kernel: [22732.585772] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 11:42:38 juju-e4d256-prod-github-runner-207 kernel: [22732.586911] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 11:42:38 juju-e4d256-prod-github-runner-207 kernel: [22732.587995] Aug 22 11:42:38 juju-e4d256-prod-github-runner-207 kernel: [22732.588854] Aug 22 11:42:38 juju-e4d256-prod-github-runner-207 kernel: [22732.589698] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 11:42:38 juju-e4d256-prod-github-runner-207 kernel: [22732.590744] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:42:38 juju-e4d256-prod-github-runner-207 kernel: [22732.591820] ? _raw_spin_lock+0x22/0x30 Aug 22 11:42:38 juju-e4d256-prod-github-runner-207 kernel: [22732.592790] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:42:38 juju-e4d256-prod-github-runner-207 kernel: [22732.593822] direct_page_fault+0x206/0x310 [kvm] Aug 22 11:42:38 juju-e4d256-prod-github-runner-207 kernel: [22732.594857] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 11:42:38 juju-e4d256-prod-github-runner-207 kernel: [22732.595914] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 11:42:38 juju-e4d256-prod-github-runner-207 kernel: [22732.596948] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 11:42:38 juju-e4d256-prod-github-runner-207 kernel: [22732.597971] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 11:42:38 juju-e4d256-prod-github-runner-207 kernel: [22732.598931] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 11:42:38 juju-e4d256-prod-github-runner-207 kernel: [22732.599937] handle_exit+0x98/0x230 [kvm_amd] Aug 22 11:42:38 juju-e4d256-prod-github-runner-207 kernel: [22732.600843] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 11:42:38 juju-e4d256-prod-github-runner-207 kernel: [22732.601811] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 11:42:38 juju-e4d256-prod-github-runner-207 kernel: [22732.602763] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 11:42:38 juju-e4d256-prod-github-runner-207 kernel: [22732.603694] vcpu_run+0x62/0x2c0 [kvm] Aug 22 11:42:38 juju-e4d256-prod-github-runner-207 kernel: [22732.604514] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 11:42:38 juju-e4d256-prod-github-runner-207 kernel: [22732.605520] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 11:42:38 juju-e4d256-prod-github-runner-207 kernel: [22732.606395] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 11:42:38 juju-e4d256-prod-github-runner-207 kernel: [22732.607210] ? __seccomp_filter+0x4a/0x4a0 Aug 22 11:42:38 juju-e4d256-prod-github-runner-207 kernel: [22732.607984] ? __fget_files+0x86/0xc0 Aug 22 11:42:38 juju-e4d256-prod-github-runner-207 kernel: [22732.608700] __x64_sys_ioctl+0x95/0xd0 Aug 22 11:42:38 juju-e4d256-prod-github-runner-207 kernel: [22732.609400] do_syscall_64+0x5c/0xc0 Aug 22 11:42:38 juju-e4d256-prod-github-runner-207 kernel: [22732.610075] ? do_futex+0x162/0x1f0 Aug 22 11:42:38 juju-e4d256-prod-github-runner-207 kernel: [22732.610728] ? __x64_sys_futex+0x78/0x1e0 Aug 22 11:42:38 juju-e4d256-prod-github-runner-207 kernel: [22732.611410] ? __secure_computing+0xa9/0x120 Aug 22 11:42:38 juju-e4d256-prod-github-runner-207 kernel: [22732.612157] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 11:42:38 juju-e4d256-prod-github-runner-207 kernel: [22732.612940] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:42:38 juju-e4d256-prod-github-runner-207 kernel: [22732.613674] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:42:38 juju-e4d256-prod-github-runner-207 kernel: [22732.614400] ? do_syscall_64+0x69/0xc0 Aug 22 11:42:38 juju-e4d256-prod-github-runner-207 kernel: [22732.615051] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:42:38 juju-e4d256-prod-github-runner-207 kernel: [22732.615780] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:42:38 juju-e4d256-prod-github-runner-207 kernel: [22732.616487] ? do_syscall_64+0x69/0xc0 Aug 22 11:42:38 juju-e4d256-prod-github-runner-207 kernel: [22732.617128] ? do_syscall_64+0x69/0xc0 Aug 22 11:42:38 juju-e4d256-prod-github-runner-207 kernel: [22732.617772] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 11:42:38 juju-e4d256-prod-github-runner-207 kernel: [22732.618486] RIP: 0033:0x7faa5d0edaff Aug 22 11:42:38 juju-e4d256-prod-github-runner-207 kernel: [22732.619153] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 11:42:38 juju-e4d256-prod-github-runner-207 kernel: [22732.621381] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 11:42:38 juju-e4d256-prod-github-runner-207 kernel: [22732.622313] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 11:42:38 juju-e4d256-prod-github-runner-207 kernel: [22732.623229] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 11:42:38 juju-e4d256-prod-github-runner-207 kernel: [22732.624146] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 11:42:38 juju-e4d256-prod-github-runner-207 kernel: [22732.625049] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 11:42:38 juju-e4d256-prod-github-runner-207 kernel: [22732.625960] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 11:42:38 juju-e4d256-prod-github-runner-207 kernel: [22732.626867] Aug 22 11:43:06 juju-e4d256-prod-github-runner-207 kernel: [22760.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 21089s! [qemu-system-x86:6715] Aug 22 11:43:06 juju-e4d256-prod-github-runner-207 kernel: [22760.543083] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 11:43:06 juju-e4d256-prod-github-runner-207 kernel: [22760.543154] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 11:43:06 juju-e4d256-prod-github-runner-207 kernel: [22760.555545] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 11:43:06 juju-e4d256-prod-github-runner-207 kernel: [22760.556840] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 11:43:06 juju-e4d256-prod-github-runner-207 kernel: [22760.558080] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:43:06 juju-e4d256-prod-github-runner-207 kernel: [22760.559152] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 11:43:06 juju-e4d256-prod-github-runner-207 kernel: [22760.561756] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 11:43:06 juju-e4d256-prod-github-runner-207 kernel: [22760.562834] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 11:43:06 juju-e4d256-prod-github-runner-207 kernel: [22760.564027] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 11:43:06 juju-e4d256-prod-github-runner-207 kernel: [22760.565209] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 11:43:06 juju-e4d256-prod-github-runner-207 kernel: [22760.566387] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 11:43:06 juju-e4d256-prod-github-runner-207 kernel: [22760.567587] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 11:43:06 juju-e4d256-prod-github-runner-207 kernel: [22760.568790] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 11:43:06 juju-e4d256-prod-github-runner-207 kernel: [22760.570050] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 11:43:06 juju-e4d256-prod-github-runner-207 kernel: [22760.571176] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 11:43:06 juju-e4d256-prod-github-runner-207 kernel: [22760.572418] Call Trace: Aug 22 11:43:06 juju-e4d256-prod-github-runner-207 kernel: [22760.573345] Aug 22 11:43:06 juju-e4d256-prod-github-runner-207 kernel: [22760.574252] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:43:06 juju-e4d256-prod-github-runner-207 kernel: [22760.575338] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:43:06 juju-e4d256-prod-github-runner-207 kernel: [22760.576401] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:43:06 juju-e4d256-prod-github-runner-207 kernel: [22760.577499] ? show_regs.part.0+0x23/0x29 Aug 22 11:43:06 juju-e4d256-prod-github-runner-207 kernel: [22760.578512] ? show_regs.cold+0x8/0xd Aug 22 11:43:06 juju-e4d256-prod-github-runner-207 kernel: [22760.579511] ? watchdog_timer_fn+0x1be/0x220 Aug 22 11:43:06 juju-e4d256-prod-github-runner-207 kernel: [22760.580532] ? lockup_detector_update_enable+0x60/0x60 Aug 22 11:43:06 juju-e4d256-prod-github-runner-207 kernel: [22760.581610] ? __hrtimer_run_queues+0x107/0x230 Aug 22 11:43:06 juju-e4d256-prod-github-runner-207 kernel: [22760.582657] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 11:43:06 juju-e4d256-prod-github-runner-207 kernel: [22760.583718] ? hrtimer_interrupt+0x101/0x220 Aug 22 11:43:06 juju-e4d256-prod-github-runner-207 kernel: [22760.584755] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 11:43:06 juju-e4d256-prod-github-runner-207 kernel: [22760.585897] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 11:43:06 juju-e4d256-prod-github-runner-207 kernel: [22760.586976] Aug 22 11:43:06 juju-e4d256-prod-github-runner-207 kernel: [22760.587850] Aug 22 11:43:06 juju-e4d256-prod-github-runner-207 kernel: [22760.588701] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 11:43:06 juju-e4d256-prod-github-runner-207 kernel: [22760.589747] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:43:06 juju-e4d256-prod-github-runner-207 kernel: [22760.590805] ? _raw_spin_lock+0x22/0x30 Aug 22 11:43:06 juju-e4d256-prod-github-runner-207 kernel: [22760.591815] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:43:06 juju-e4d256-prod-github-runner-207 kernel: [22760.592888] direct_page_fault+0x206/0x310 [kvm] Aug 22 11:43:06 juju-e4d256-prod-github-runner-207 kernel: [22760.593948] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 11:43:06 juju-e4d256-prod-github-runner-207 kernel: [22760.594989] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 11:43:06 juju-e4d256-prod-github-runner-207 kernel: [22760.596354] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 11:43:06 juju-e4d256-prod-github-runner-207 kernel: [22760.597331] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 11:43:06 juju-e4d256-prod-github-runner-207 kernel: [22760.598285] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 11:43:06 juju-e4d256-prod-github-runner-207 kernel: [22760.599294] handle_exit+0x98/0x230 [kvm_amd] Aug 22 11:43:06 juju-e4d256-prod-github-runner-207 kernel: [22760.600197] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 11:43:06 juju-e4d256-prod-github-runner-207 kernel: [22760.601168] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 11:43:06 juju-e4d256-prod-github-runner-207 kernel: [22760.602110] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 11:43:06 juju-e4d256-prod-github-runner-207 kernel: [22760.603023] vcpu_run+0x62/0x2c0 [kvm] Aug 22 11:43:06 juju-e4d256-prod-github-runner-207 kernel: [22760.603859] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 11:43:06 juju-e4d256-prod-github-runner-207 kernel: [22760.604686] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 11:43:06 juju-e4d256-prod-github-runner-207 kernel: [22760.605567] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 11:43:06 juju-e4d256-prod-github-runner-207 kernel: [22760.606376] ? __seccomp_filter+0x4a/0x4a0 Aug 22 11:43:06 juju-e4d256-prod-github-runner-207 kernel: [22760.607132] ? __fget_files+0x86/0xc0 Aug 22 11:43:06 juju-e4d256-prod-github-runner-207 kernel: [22760.607868] __x64_sys_ioctl+0x95/0xd0 Aug 22 11:43:06 juju-e4d256-prod-github-runner-207 kernel: [22760.608571] do_syscall_64+0x5c/0xc0 Aug 22 11:43:06 juju-e4d256-prod-github-runner-207 kernel: [22760.609249] ? do_futex+0x162/0x1f0 Aug 22 11:43:06 juju-e4d256-prod-github-runner-207 kernel: [22760.609902] ? __x64_sys_futex+0x78/0x1e0 Aug 22 11:43:06 juju-e4d256-prod-github-runner-207 kernel: [22760.610599] ? __secure_computing+0xa9/0x120 Aug 22 11:43:06 juju-e4d256-prod-github-runner-207 kernel: [22760.611332] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 11:43:06 juju-e4d256-prod-github-runner-207 kernel: [22760.612113] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:43:06 juju-e4d256-prod-github-runner-207 kernel: [22760.612846] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:43:06 juju-e4d256-prod-github-runner-207 kernel: [22760.613574] ? do_syscall_64+0x69/0xc0 Aug 22 11:43:06 juju-e4d256-prod-github-runner-207 kernel: [22760.614228] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:43:06 juju-e4d256-prod-github-runner-207 kernel: [22760.614943] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:43:06 juju-e4d256-prod-github-runner-207 kernel: [22760.615682] ? do_syscall_64+0x69/0xc0 Aug 22 11:43:06 juju-e4d256-prod-github-runner-207 kernel: [22760.616338] ? do_syscall_64+0x69/0xc0 Aug 22 11:43:06 juju-e4d256-prod-github-runner-207 kernel: [22760.616973] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 11:43:06 juju-e4d256-prod-github-runner-207 kernel: [22760.617690] RIP: 0033:0x7faa5d0edaff Aug 22 11:43:06 juju-e4d256-prod-github-runner-207 kernel: [22760.618360] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 11:43:06 juju-e4d256-prod-github-runner-207 kernel: [22760.620512] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 11:43:06 juju-e4d256-prod-github-runner-207 kernel: [22760.621447] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 11:43:06 juju-e4d256-prod-github-runner-207 kernel: [22760.622354] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 11:43:06 juju-e4d256-prod-github-runner-207 kernel: [22760.623282] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 11:43:06 juju-e4d256-prod-github-runner-207 kernel: [22760.624209] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 11:43:06 juju-e4d256-prod-github-runner-207 kernel: [22760.625133] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 11:43:06 juju-e4d256-prod-github-runner-207 kernel: [22760.626056] Aug 22 11:43:34 juju-e4d256-prod-github-runner-207 kernel: [22788.541983] watchdog: BUG: soft lockup - CPU#1 stuck for 21115s! [qemu-system-x86:6715] Aug 22 11:43:34 juju-e4d256-prod-github-runner-207 kernel: [22788.543629] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 11:43:34 juju-e4d256-prod-github-runner-207 kernel: [22788.543702] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 11:43:34 juju-e4d256-prod-github-runner-207 kernel: [22788.557647] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 11:43:34 juju-e4d256-prod-github-runner-207 kernel: [22788.559273] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 11:43:34 juju-e4d256-prod-github-runner-207 kernel: [22788.560664] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:43:34 juju-e4d256-prod-github-runner-207 kernel: [22788.561834] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 11:43:34 juju-e4d256-prod-github-runner-207 kernel: [22788.564768] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 11:43:34 juju-e4d256-prod-github-runner-207 kernel: [22788.565910] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 11:43:34 juju-e4d256-prod-github-runner-207 kernel: [22788.567223] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 11:43:34 juju-e4d256-prod-github-runner-207 kernel: [22788.568515] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 11:43:34 juju-e4d256-prod-github-runner-207 kernel: [22788.569820] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 11:43:34 juju-e4d256-prod-github-runner-207 kernel: [22788.571144] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 11:43:34 juju-e4d256-prod-github-runner-207 kernel: [22788.572441] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 11:43:34 juju-e4d256-prod-github-runner-207 kernel: [22788.573826] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 11:43:34 juju-e4d256-prod-github-runner-207 kernel: [22788.575062] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 11:43:34 juju-e4d256-prod-github-runner-207 kernel: [22788.576396] Call Trace: Aug 22 11:43:34 juju-e4d256-prod-github-runner-207 kernel: [22788.577375] Aug 22 11:43:34 juju-e4d256-prod-github-runner-207 kernel: [22788.578307] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:43:34 juju-e4d256-prod-github-runner-207 kernel: [22788.579437] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:43:34 juju-e4d256-prod-github-runner-207 kernel: [22788.580548] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:43:34 juju-e4d256-prod-github-runner-207 kernel: [22788.581713] ? show_regs.part.0+0x23/0x29 Aug 22 11:43:34 juju-e4d256-prod-github-runner-207 kernel: [22788.582789] ? show_regs.cold+0x8/0xd Aug 22 11:43:34 juju-e4d256-prod-github-runner-207 kernel: [22788.583862] ? watchdog_timer_fn+0x1be/0x220 Aug 22 11:43:34 juju-e4d256-prod-github-runner-207 kernel: [22788.584964] ? lockup_detector_update_enable+0x60/0x60 Aug 22 11:43:34 juju-e4d256-prod-github-runner-207 kernel: [22788.586137] ? __hrtimer_run_queues+0x107/0x230 Aug 22 11:43:34 juju-e4d256-prod-github-runner-207 kernel: [22788.587273] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 11:43:34 juju-e4d256-prod-github-runner-207 kernel: [22788.588383] ? hrtimer_interrupt+0x101/0x220 Aug 22 11:43:34 juju-e4d256-prod-github-runner-207 kernel: [22788.589492] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 11:43:34 juju-e4d256-prod-github-runner-207 kernel: [22788.590669] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 11:43:34 juju-e4d256-prod-github-runner-207 kernel: [22788.591825] Aug 22 11:43:34 juju-e4d256-prod-github-runner-207 kernel: [22788.592722] Aug 22 11:43:34 juju-e4d256-prod-github-runner-207 kernel: [22788.593601] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 11:43:34 juju-e4d256-prod-github-runner-207 kernel: [22788.594735] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:43:34 juju-e4d256-prod-github-runner-207 kernel: [22788.595887] ? _raw_spin_lock+0x22/0x30 Aug 22 11:43:34 juju-e4d256-prod-github-runner-207 kernel: [22788.596906] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:43:34 juju-e4d256-prod-github-runner-207 kernel: [22788.598049] direct_page_fault+0x206/0x310 [kvm] Aug 22 11:43:34 juju-e4d256-prod-github-runner-207 kernel: [22788.599183] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 11:43:34 juju-e4d256-prod-github-runner-207 kernel: [22788.600282] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 11:43:34 juju-e4d256-prod-github-runner-207 kernel: [22788.601379] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 11:43:34 juju-e4d256-prod-github-runner-207 kernel: [22788.602450] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 11:43:34 juju-e4d256-prod-github-runner-207 kernel: [22788.603515] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 11:43:34 juju-e4d256-prod-github-runner-207 kernel: [22788.604642] handle_exit+0x98/0x230 [kvm_amd] Aug 22 11:43:34 juju-e4d256-prod-github-runner-207 kernel: [22788.605625] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 11:43:34 juju-e4d256-prod-github-runner-207 kernel: [22788.606627] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 11:43:34 juju-e4d256-prod-github-runner-207 kernel: [22788.607656] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 11:43:34 juju-e4d256-prod-github-runner-207 kernel: [22788.608660] vcpu_run+0x62/0x2c0 [kvm] Aug 22 11:43:34 juju-e4d256-prod-github-runner-207 kernel: [22788.609544] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 11:43:34 juju-e4d256-prod-github-runner-207 kernel: [22788.610447] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 11:43:34 juju-e4d256-prod-github-runner-207 kernel: [22788.611409] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 11:43:34 juju-e4d256-prod-github-runner-207 kernel: [22788.612289] ? __seccomp_filter+0x4a/0x4a0 Aug 22 11:43:34 juju-e4d256-prod-github-runner-207 kernel: [22788.613111] ? __fget_files+0x86/0xc0 Aug 22 11:43:34 juju-e4d256-prod-github-runner-207 kernel: [22788.613888] __x64_sys_ioctl+0x95/0xd0 Aug 22 11:43:34 juju-e4d256-prod-github-runner-207 kernel: [22788.614660] do_syscall_64+0x5c/0xc0 Aug 22 11:43:34 juju-e4d256-prod-github-runner-207 kernel: [22788.615420] ? do_futex+0x162/0x1f0 Aug 22 11:43:34 juju-e4d256-prod-github-runner-207 kernel: [22788.616138] ? __x64_sys_futex+0x78/0x1e0 Aug 22 11:43:34 juju-e4d256-prod-github-runner-207 kernel: [22788.616889] ? __secure_computing+0xa9/0x120 Aug 22 11:43:34 juju-e4d256-prod-github-runner-207 kernel: [22788.617664] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 11:43:34 juju-e4d256-prod-github-runner-207 kernel: [22788.618529] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:43:34 juju-e4d256-prod-github-runner-207 kernel: [22788.619358] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:43:34 juju-e4d256-prod-github-runner-207 kernel: [22788.620176] ? do_syscall_64+0x69/0xc0 Aug 22 11:43:34 juju-e4d256-prod-github-runner-207 kernel: [22788.620899] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:43:34 juju-e4d256-prod-github-runner-207 kernel: [22788.621697] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:43:34 juju-e4d256-prod-github-runner-207 kernel: [22788.622481] ? do_syscall_64+0x69/0xc0 Aug 22 11:43:34 juju-e4d256-prod-github-runner-207 kernel: [22788.623209] ? do_syscall_64+0x69/0xc0 Aug 22 11:43:34 juju-e4d256-prod-github-runner-207 kernel: [22788.623911] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 11:43:34 juju-e4d256-prod-github-runner-207 kernel: [22788.624712] RIP: 0033:0x7faa5d0edaff Aug 22 11:43:34 juju-e4d256-prod-github-runner-207 kernel: [22788.625406] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 11:43:34 juju-e4d256-prod-github-runner-207 kernel: [22788.627734] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 11:43:34 juju-e4d256-prod-github-runner-207 kernel: [22788.628784] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 11:43:34 juju-e4d256-prod-github-runner-207 kernel: [22788.629802] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 11:43:34 juju-e4d256-prod-github-runner-207 kernel: [22788.630828] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 11:43:34 juju-e4d256-prod-github-runner-207 kernel: [22788.631933] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 11:43:34 juju-e4d256-prod-github-runner-207 kernel: [22788.632957] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 11:43:34 juju-e4d256-prod-github-runner-207 kernel: [22788.633982] Aug 22 11:44:02 juju-e4d256-prod-github-runner-207 kernel: [22816.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 21141s! [qemu-system-x86:6715] Aug 22 11:44:02 juju-e4d256-prod-github-runner-207 kernel: [22816.543889] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 11:44:02 juju-e4d256-prod-github-runner-207 kernel: [22816.544198] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 11:44:02 juju-e4d256-prod-github-runner-207 kernel: [22816.556393] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 11:44:02 juju-e4d256-prod-github-runner-207 kernel: [22816.557668] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 11:44:02 juju-e4d256-prod-github-runner-207 kernel: [22816.558907] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:44:02 juju-e4d256-prod-github-runner-207 kernel: [22816.559970] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 11:44:02 juju-e4d256-prod-github-runner-207 kernel: [22816.562558] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 11:44:02 juju-e4d256-prod-github-runner-207 kernel: [22816.563602] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 11:44:02 juju-e4d256-prod-github-runner-207 kernel: [22816.564781] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 11:44:02 juju-e4d256-prod-github-runner-207 kernel: [22816.565965] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 11:44:02 juju-e4d256-prod-github-runner-207 kernel: [22816.567145] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 11:44:02 juju-e4d256-prod-github-runner-207 kernel: [22816.568329] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 11:44:02 juju-e4d256-prod-github-runner-207 kernel: [22816.569495] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 11:44:02 juju-e4d256-prod-github-runner-207 kernel: [22816.570748] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 11:44:02 juju-e4d256-prod-github-runner-207 kernel: [22816.571856] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 11:44:02 juju-e4d256-prod-github-runner-207 kernel: [22816.573065] Call Trace: Aug 22 11:44:02 juju-e4d256-prod-github-runner-207 kernel: [22816.573988] Aug 22 11:44:02 juju-e4d256-prod-github-runner-207 kernel: [22816.574902] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:44:02 juju-e4d256-prod-github-runner-207 kernel: [22816.575932] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:44:02 juju-e4d256-prod-github-runner-207 kernel: [22816.576965] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:44:02 juju-e4d256-prod-github-runner-207 kernel: [22816.578078] ? show_regs.part.0+0x23/0x29 Aug 22 11:44:02 juju-e4d256-prod-github-runner-207 kernel: [22816.579087] ? show_regs.cold+0x8/0xd Aug 22 11:44:02 juju-e4d256-prod-github-runner-207 kernel: [22816.580082] ? watchdog_timer_fn+0x1be/0x220 Aug 22 11:44:02 juju-e4d256-prod-github-runner-207 kernel: [22816.581096] ? lockup_detector_update_enable+0x60/0x60 Aug 22 11:44:02 juju-e4d256-prod-github-runner-207 kernel: [22816.582163] ? __hrtimer_run_queues+0x107/0x230 Aug 22 11:44:02 juju-e4d256-prod-github-runner-207 kernel: [22816.583229] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 11:44:02 juju-e4d256-prod-github-runner-207 kernel: [22816.584269] ? hrtimer_interrupt+0x101/0x220 Aug 22 11:44:02 juju-e4d256-prod-github-runner-207 kernel: [22816.585288] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 11:44:02 juju-e4d256-prod-github-runner-207 kernel: [22816.586368] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 11:44:02 juju-e4d256-prod-github-runner-207 kernel: [22816.587418] Aug 22 11:44:02 juju-e4d256-prod-github-runner-207 kernel: [22816.588268] Aug 22 11:44:02 juju-e4d256-prod-github-runner-207 kernel: [22816.589103] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 11:44:02 juju-e4d256-prod-github-runner-207 kernel: [22816.590133] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:44:02 juju-e4d256-prod-github-runner-207 kernel: [22816.591177] ? _raw_spin_lock+0x22/0x30 Aug 22 11:44:02 juju-e4d256-prod-github-runner-207 kernel: [22816.592118] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:44:02 juju-e4d256-prod-github-runner-207 kernel: [22816.593131] direct_page_fault+0x206/0x310 [kvm] Aug 22 11:44:02 juju-e4d256-prod-github-runner-207 kernel: [22816.594153] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 11:44:02 juju-e4d256-prod-github-runner-207 kernel: [22816.595167] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 11:44:02 juju-e4d256-prod-github-runner-207 kernel: [22816.596165] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 11:44:02 juju-e4d256-prod-github-runner-207 kernel: [22816.597157] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 11:44:02 juju-e4d256-prod-github-runner-207 kernel: [22816.598124] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 11:44:02 juju-e4d256-prod-github-runner-207 kernel: [22816.599108] handle_exit+0x98/0x230 [kvm_amd] Aug 22 11:44:02 juju-e4d256-prod-github-runner-207 kernel: [22816.600029] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 11:44:02 juju-e4d256-prod-github-runner-207 kernel: [22816.600949] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 11:44:02 juju-e4d256-prod-github-runner-207 kernel: [22816.601878] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 11:44:02 juju-e4d256-prod-github-runner-207 kernel: [22816.602792] vcpu_run+0x62/0x2c0 [kvm] Aug 22 11:44:02 juju-e4d256-prod-github-runner-207 kernel: [22816.603617] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 11:44:02 juju-e4d256-prod-github-runner-207 kernel: [22816.604435] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 11:44:02 juju-e4d256-prod-github-runner-207 kernel: [22816.605292] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 11:44:02 juju-e4d256-prod-github-runner-207 kernel: [22816.606088] ? __seccomp_filter+0x4a/0x4a0 Aug 22 11:44:02 juju-e4d256-prod-github-runner-207 kernel: [22816.606934] ? __fget_files+0x86/0xc0 Aug 22 11:44:02 juju-e4d256-prod-github-runner-207 kernel: [22816.607668] __x64_sys_ioctl+0x95/0xd0 Aug 22 11:44:02 juju-e4d256-prod-github-runner-207 kernel: [22816.608385] do_syscall_64+0x5c/0xc0 Aug 22 11:44:02 juju-e4d256-prod-github-runner-207 kernel: [22816.609064] ? do_futex+0x162/0x1f0 Aug 22 11:44:02 juju-e4d256-prod-github-runner-207 kernel: [22816.609730] ? __x64_sys_futex+0x78/0x1e0 Aug 22 11:44:02 juju-e4d256-prod-github-runner-207 kernel: [22816.610414] ? __secure_computing+0xa9/0x120 Aug 22 11:44:02 juju-e4d256-prod-github-runner-207 kernel: [22816.611130] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 11:44:02 juju-e4d256-prod-github-runner-207 kernel: [22816.611911] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:44:02 juju-e4d256-prod-github-runner-207 kernel: [22816.612636] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:44:02 juju-e4d256-prod-github-runner-207 kernel: [22816.613365] ? do_syscall_64+0x69/0xc0 Aug 22 11:44:02 juju-e4d256-prod-github-runner-207 kernel: [22816.614008] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:44:02 juju-e4d256-prod-github-runner-207 kernel: [22816.614728] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:44:02 juju-e4d256-prod-github-runner-207 kernel: [22816.615476] ? do_syscall_64+0x69/0xc0 Aug 22 11:44:02 juju-e4d256-prod-github-runner-207 kernel: [22816.616115] ? do_syscall_64+0x69/0xc0 Aug 22 11:44:02 juju-e4d256-prod-github-runner-207 kernel: [22816.616851] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 11:44:02 juju-e4d256-prod-github-runner-207 kernel: [22816.617567] RIP: 0033:0x7faa5d0edaff Aug 22 11:44:02 juju-e4d256-prod-github-runner-207 kernel: [22816.618235] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 11:44:02 juju-e4d256-prod-github-runner-207 kernel: [22816.620384] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 11:44:02 juju-e4d256-prod-github-runner-207 kernel: [22816.621322] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 11:44:02 juju-e4d256-prod-github-runner-207 kernel: [22816.622230] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 11:44:02 juju-e4d256-prod-github-runner-207 kernel: [22816.623136] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 11:44:02 juju-e4d256-prod-github-runner-207 kernel: [22816.624052] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 11:44:02 juju-e4d256-prod-github-runner-207 kernel: [22816.624953] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 11:44:02 juju-e4d256-prod-github-runner-207 kernel: [22816.626000] Aug 22 11:44:30 juju-e4d256-prod-github-runner-207 kernel: [22844.541982] watchdog: BUG: soft lockup - CPU#1 stuck for 21167s! [qemu-system-x86:6715] Aug 22 11:44:30 juju-e4d256-prod-github-runner-207 kernel: [22844.543132] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 11:44:30 juju-e4d256-prod-github-runner-207 kernel: [22844.543207] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 11:44:30 juju-e4d256-prod-github-runner-207 kernel: [22844.555502] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 11:44:30 juju-e4d256-prod-github-runner-207 kernel: [22844.556780] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 11:44:30 juju-e4d256-prod-github-runner-207 kernel: [22844.558005] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:44:30 juju-e4d256-prod-github-runner-207 kernel: [22844.559090] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 11:44:30 juju-e4d256-prod-github-runner-207 kernel: [22844.561691] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 11:44:30 juju-e4d256-prod-github-runner-207 kernel: [22844.562770] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 11:44:30 juju-e4d256-prod-github-runner-207 kernel: [22844.563956] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 11:44:30 juju-e4d256-prod-github-runner-207 kernel: [22844.565125] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 11:44:30 juju-e4d256-prod-github-runner-207 kernel: [22844.566302] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 11:44:30 juju-e4d256-prod-github-runner-207 kernel: [22844.567467] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 11:44:30 juju-e4d256-prod-github-runner-207 kernel: [22844.568639] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 11:44:30 juju-e4d256-prod-github-runner-207 kernel: [22844.569873] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 11:44:30 juju-e4d256-prod-github-runner-207 kernel: [22844.570987] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 11:44:30 juju-e4d256-prod-github-runner-207 kernel: [22844.572199] Call Trace: Aug 22 11:44:30 juju-e4d256-prod-github-runner-207 kernel: [22844.573141] Aug 22 11:44:30 juju-e4d256-prod-github-runner-207 kernel: [22844.574036] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:44:30 juju-e4d256-prod-github-runner-207 kernel: [22844.575088] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:44:30 juju-e4d256-prod-github-runner-207 kernel: [22844.576107] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:44:30 juju-e4d256-prod-github-runner-207 kernel: [22844.577191] ? show_regs.part.0+0x23/0x29 Aug 22 11:44:30 juju-e4d256-prod-github-runner-207 kernel: [22844.578213] ? show_regs.cold+0x8/0xd Aug 22 11:44:30 juju-e4d256-prod-github-runner-207 kernel: [22844.579189] ? watchdog_timer_fn+0x1be/0x220 Aug 22 11:44:30 juju-e4d256-prod-github-runner-207 kernel: [22844.580198] ? lockup_detector_update_enable+0x60/0x60 Aug 22 11:44:30 juju-e4d256-prod-github-runner-207 kernel: [22844.581284] ? __hrtimer_run_queues+0x107/0x230 Aug 22 11:44:30 juju-e4d256-prod-github-runner-207 kernel: [22844.582424] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 11:44:30 juju-e4d256-prod-github-runner-207 kernel: [22844.583509] ? hrtimer_interrupt+0x101/0x220 Aug 22 11:44:30 juju-e4d256-prod-github-runner-207 kernel: [22844.584543] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 11:44:30 juju-e4d256-prod-github-runner-207 kernel: [22844.585627] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 11:44:30 juju-e4d256-prod-github-runner-207 kernel: [22844.586726] Aug 22 11:44:30 juju-e4d256-prod-github-runner-207 kernel: [22844.587589] Aug 22 11:44:30 juju-e4d256-prod-github-runner-207 kernel: [22844.588430] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 11:44:30 juju-e4d256-prod-github-runner-207 kernel: [22844.589467] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:44:30 juju-e4d256-prod-github-runner-207 kernel: [22844.590525] ? _raw_spin_lock+0x22/0x30 Aug 22 11:44:30 juju-e4d256-prod-github-runner-207 kernel: [22844.591482] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:44:30 juju-e4d256-prod-github-runner-207 kernel: [22844.592508] direct_page_fault+0x206/0x310 [kvm] Aug 22 11:44:30 juju-e4d256-prod-github-runner-207 kernel: [22844.593546] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 11:44:30 juju-e4d256-prod-github-runner-207 kernel: [22844.594726] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 11:44:30 juju-e4d256-prod-github-runner-207 kernel: [22844.595729] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 11:44:30 juju-e4d256-prod-github-runner-207 kernel: [22844.596740] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 11:44:30 juju-e4d256-prod-github-runner-207 kernel: [22844.597698] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 11:44:30 juju-e4d256-prod-github-runner-207 kernel: [22844.598700] handle_exit+0x98/0x230 [kvm_amd] Aug 22 11:44:30 juju-e4d256-prod-github-runner-207 kernel: [22844.599598] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 11:44:30 juju-e4d256-prod-github-runner-207 kernel: [22844.600514] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 11:44:30 juju-e4d256-prod-github-runner-207 kernel: [22844.601442] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 11:44:30 juju-e4d256-prod-github-runner-207 kernel: [22844.602410] vcpu_run+0x62/0x2c0 [kvm] Aug 22 11:44:30 juju-e4d256-prod-github-runner-207 kernel: [22844.603243] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 11:44:30 juju-e4d256-prod-github-runner-207 kernel: [22844.604062] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 11:44:30 juju-e4d256-prod-github-runner-207 kernel: [22844.604922] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 11:44:30 juju-e4d256-prod-github-runner-207 kernel: [22844.605723] ? __seccomp_filter+0x4a/0x4a0 Aug 22 11:44:30 juju-e4d256-prod-github-runner-207 kernel: [22844.606485] ? __fget_files+0x86/0xc0 Aug 22 11:44:30 juju-e4d256-prod-github-runner-207 kernel: [22844.607190] __x64_sys_ioctl+0x95/0xd0 Aug 22 11:44:30 juju-e4d256-prod-github-runner-207 kernel: [22844.607885] do_syscall_64+0x5c/0xc0 Aug 22 11:44:30 juju-e4d256-prod-github-runner-207 kernel: [22844.608576] ? do_futex+0x162/0x1f0 Aug 22 11:44:30 juju-e4d256-prod-github-runner-207 kernel: [22844.609259] ? __x64_sys_futex+0x78/0x1e0 Aug 22 11:44:30 juju-e4d256-prod-github-runner-207 kernel: [22844.609960] ? __secure_computing+0xa9/0x120 Aug 22 11:44:30 juju-e4d256-prod-github-runner-207 kernel: [22844.610675] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 11:44:30 juju-e4d256-prod-github-runner-207 kernel: [22844.611442] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:44:30 juju-e4d256-prod-github-runner-207 kernel: [22844.612166] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:44:30 juju-e4d256-prod-github-runner-207 kernel: [22844.612892] ? do_syscall_64+0x69/0xc0 Aug 22 11:44:30 juju-e4d256-prod-github-runner-207 kernel: [22844.613538] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:44:30 juju-e4d256-prod-github-runner-207 kernel: [22844.614268] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:44:30 juju-e4d256-prod-github-runner-207 kernel: [22844.614972] ? do_syscall_64+0x69/0xc0 Aug 22 11:44:30 juju-e4d256-prod-github-runner-207 kernel: [22844.615598] ? do_syscall_64+0x69/0xc0 Aug 22 11:44:30 juju-e4d256-prod-github-runner-207 kernel: [22844.616228] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 11:44:30 juju-e4d256-prod-github-runner-207 kernel: [22844.616940] RIP: 0033:0x7faa5d0edaff Aug 22 11:44:30 juju-e4d256-prod-github-runner-207 kernel: [22844.617568] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 11:44:30 juju-e4d256-prod-github-runner-207 kernel: [22844.619613] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 11:44:30 juju-e4d256-prod-github-runner-207 kernel: [22844.620830] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 11:44:30 juju-e4d256-prod-github-runner-207 kernel: [22844.621731] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 11:44:30 juju-e4d256-prod-github-runner-207 kernel: [22844.622645] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 11:44:30 juju-e4d256-prod-github-runner-207 kernel: [22844.623547] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 11:44:30 juju-e4d256-prod-github-runner-207 kernel: [22844.624441] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 11:44:30 juju-e4d256-prod-github-runner-207 kernel: [22844.625344] Aug 22 11:44:44 juju-e4d256-prod-github-runner-207 kernel: [22858.712704] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 11:44:44 juju-e4d256-prod-github-runner-207 kernel: [22858.713661] rcu: 1-....: (5667638 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=2743812 Aug 22 11:44:44 juju-e4d256-prod-github-runner-207 kernel: [22858.714781] (t=5685378 jiffies g=23269 q=28164) Aug 22 11:44:44 juju-e4d256-prod-github-runner-207 kernel: [22858.715560] NMI backtrace for cpu 1 Aug 22 11:44:44 juju-e4d256-prod-github-runner-207 kernel: [22858.716269] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 11:44:44 juju-e4d256-prod-github-runner-207 kernel: [22858.717372] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 11:44:44 juju-e4d256-prod-github-runner-207 kernel: [22858.718437] Call Trace: Aug 22 11:44:44 juju-e4d256-prod-github-runner-207 kernel: [22858.719110] Aug 22 11:44:44 juju-e4d256-prod-github-runner-207 kernel: [22858.719754] show_stack+0x52/0x5c Aug 22 11:44:44 juju-e4d256-prod-github-runner-207 kernel: [22858.720481] dump_stack_lvl+0x4a/0x63 Aug 22 11:44:44 juju-e4d256-prod-github-runner-207 kernel: [22858.721223] dump_stack+0x10/0x16 Aug 22 11:44:44 juju-e4d256-prod-github-runner-207 kernel: [22858.721938] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 11:44:44 juju-e4d256-prod-github-runner-207 kernel: [22858.722725] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 11:44:44 juju-e4d256-prod-github-runner-207 kernel: [22858.723501] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 11:44:44 juju-e4d256-prod-github-runner-207 kernel: [22858.724318] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 11:44:44 juju-e4d256-prod-github-runner-207 kernel: [22858.725137] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 11:44:44 juju-e4d256-prod-github-runner-207 kernel: [22858.725947] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 11:44:44 juju-e4d256-prod-github-runner-207 kernel: [22858.726726] print_cpu_stall.cold+0x2f/0xe2 Aug 22 11:44:44 juju-e4d256-prod-github-runner-207 kernel: [22858.727488] ? timekeeping_update+0xf7/0x150 Aug 22 11:44:44 juju-e4d256-prod-github-runner-207 kernel: [22858.728256] check_cpu_stall+0x109/0x270 Aug 22 11:44:44 juju-e4d256-prod-github-runner-207 kernel: [22858.728999] rcu_sched_clock_irq+0x9a/0x250 Aug 22 11:44:44 juju-e4d256-prod-github-runner-207 kernel: [22858.729758] update_process_times+0x94/0xd0 Aug 22 11:44:44 juju-e4d256-prod-github-runner-207 kernel: [22858.730541] tick_sched_handle+0x29/0x70 Aug 22 11:44:44 juju-e4d256-prod-github-runner-207 kernel: [22858.731285] tick_sched_timer+0x8c/0xc0 Aug 22 11:44:44 juju-e4d256-prod-github-runner-207 kernel: [22858.732020] ? tick_nohz_handler+0xb0/0xb0 Aug 22 11:44:44 juju-e4d256-prod-github-runner-207 kernel: [22858.732772] __hrtimer_run_queues+0x107/0x230 Aug 22 11:44:44 juju-e4d256-prod-github-runner-207 kernel: [22858.733543] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 11:44:44 juju-e4d256-prod-github-runner-207 kernel: [22858.734343] hrtimer_interrupt+0x101/0x220 Aug 22 11:44:44 juju-e4d256-prod-github-runner-207 kernel: [22858.735100] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 11:44:44 juju-e4d256-prod-github-runner-207 kernel: [22858.735928] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 11:44:44 juju-e4d256-prod-github-runner-207 kernel: [22858.736729] Aug 22 11:44:44 juju-e4d256-prod-github-runner-207 kernel: [22858.737361] Aug 22 11:44:44 juju-e4d256-prod-github-runner-207 kernel: [22858.737987] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 11:44:44 juju-e4d256-prod-github-runner-207 kernel: [22858.738810] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:44:44 juju-e4d256-prod-github-runner-207 kernel: [22858.739688] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 11:44:44 juju-e4d256-prod-github-runner-207 kernel: [22858.741881] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 11:44:44 juju-e4d256-prod-github-runner-207 kernel: [22858.742760] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 11:44:44 juju-e4d256-prod-github-runner-207 kernel: [22858.743750] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 11:44:44 juju-e4d256-prod-github-runner-207 kernel: [22858.744723] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 11:44:44 juju-e4d256-prod-github-runner-207 kernel: [22858.745687] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 11:44:44 juju-e4d256-prod-github-runner-207 kernel: [22858.746646] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 11:44:44 juju-e4d256-prod-github-runner-207 kernel: [22858.747593] ? _raw_spin_lock+0x22/0x30 Aug 22 11:44:44 juju-e4d256-prod-github-runner-207 kernel: [22858.748353] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:44:44 juju-e4d256-prod-github-runner-207 kernel: [22858.749183] direct_page_fault+0x206/0x310 [kvm] Aug 22 11:44:44 juju-e4d256-prod-github-runner-207 kernel: [22858.750016] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 11:44:44 juju-e4d256-prod-github-runner-207 kernel: [22858.750868] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 11:44:44 juju-e4d256-prod-github-runner-207 kernel: [22858.751687] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 11:44:44 juju-e4d256-prod-github-runner-207 kernel: [22858.752493] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 11:44:44 juju-e4d256-prod-github-runner-207 kernel: [22858.753275] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 11:44:44 juju-e4d256-prod-github-runner-207 kernel: [22858.754101] handle_exit+0x98/0x230 [kvm_amd] Aug 22 11:44:44 juju-e4d256-prod-github-runner-207 kernel: [22858.754855] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 11:44:44 juju-e4d256-prod-github-runner-207 kernel: [22858.755635] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 11:44:44 juju-e4d256-prod-github-runner-207 kernel: [22858.756431] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 11:44:44 juju-e4d256-prod-github-runner-207 kernel: [22858.757214] vcpu_run+0x62/0x2c0 [kvm] Aug 22 11:44:44 juju-e4d256-prod-github-runner-207 kernel: [22858.757926] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 11:44:44 juju-e4d256-prod-github-runner-207 kernel: [22858.758702] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 11:44:44 juju-e4d256-prod-github-runner-207 kernel: [22858.759508] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 11:44:44 juju-e4d256-prod-github-runner-207 kernel: [22858.760270] ? __seccomp_filter+0x4a/0x4a0 Aug 22 11:44:44 juju-e4d256-prod-github-runner-207 kernel: [22858.760990] ? __fget_files+0x86/0xc0 Aug 22 11:44:44 juju-e4d256-prod-github-runner-207 kernel: [22858.761690] __x64_sys_ioctl+0x95/0xd0 Aug 22 11:44:44 juju-e4d256-prod-github-runner-207 kernel: [22858.762442] do_syscall_64+0x5c/0xc0 Aug 22 11:44:44 juju-e4d256-prod-github-runner-207 kernel: [22858.763122] ? do_futex+0x162/0x1f0 Aug 22 11:44:44 juju-e4d256-prod-github-runner-207 kernel: [22858.763789] ? __x64_sys_futex+0x78/0x1e0 Aug 22 11:44:44 juju-e4d256-prod-github-runner-207 kernel: [22858.764490] ? __secure_computing+0xa9/0x120 Aug 22 11:44:44 juju-e4d256-prod-github-runner-207 kernel: [22858.765201] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 11:44:44 juju-e4d256-prod-github-runner-207 kernel: [22858.765986] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:44:44 juju-e4d256-prod-github-runner-207 kernel: [22858.766744] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:44:44 juju-e4d256-prod-github-runner-207 kernel: [22858.767500] ? do_syscall_64+0x69/0xc0 Aug 22 11:44:44 juju-e4d256-prod-github-runner-207 kernel: [22858.768190] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:44:44 juju-e4d256-prod-github-runner-207 kernel: [22858.768938] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:44:44 juju-e4d256-prod-github-runner-207 kernel: [22858.769688] ? do_syscall_64+0x69/0xc0 Aug 22 11:44:44 juju-e4d256-prod-github-runner-207 kernel: [22858.770386] ? do_syscall_64+0x69/0xc0 Aug 22 11:44:44 juju-e4d256-prod-github-runner-207 kernel: [22858.771070] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 11:44:44 juju-e4d256-prod-github-runner-207 kernel: [22858.771839] RIP: 0033:0x7faa5d0edaff Aug 22 11:44:44 juju-e4d256-prod-github-runner-207 kernel: [22858.772515] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 11:44:44 juju-e4d256-prod-github-runner-207 kernel: [22858.774634] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 11:44:44 juju-e4d256-prod-github-runner-207 kernel: [22858.775601] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 11:44:44 juju-e4d256-prod-github-runner-207 kernel: [22858.776546] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 11:44:44 juju-e4d256-prod-github-runner-207 kernel: [22858.777504] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 11:44:44 juju-e4d256-prod-github-runner-207 kernel: [22858.778448] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 11:44:44 juju-e4d256-prod-github-runner-207 kernel: [22858.779373] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 11:44:44 juju-e4d256-prod-github-runner-207 kernel: [22858.780287] Aug 22 11:45:10 juju-e4d256-prod-github-runner-207 kernel: [22884.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 21204s! [qemu-system-x86:6715] Aug 22 11:45:10 juju-e4d256-prod-github-runner-207 kernel: [22884.543136] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 11:45:10 juju-e4d256-prod-github-runner-207 kernel: [22884.543211] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 11:45:10 juju-e4d256-prod-github-runner-207 kernel: [22884.555509] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 11:45:10 juju-e4d256-prod-github-runner-207 kernel: [22884.556900] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 11:45:10 juju-e4d256-prod-github-runner-207 kernel: [22884.558195] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:45:10 juju-e4d256-prod-github-runner-207 kernel: [22884.559262] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 11:45:10 juju-e4d256-prod-github-runner-207 kernel: [22884.561854] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 11:45:10 juju-e4d256-prod-github-runner-207 kernel: [22884.562903] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 11:45:10 juju-e4d256-prod-github-runner-207 kernel: [22884.564091] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 11:45:10 juju-e4d256-prod-github-runner-207 kernel: [22884.565258] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 11:45:10 juju-e4d256-prod-github-runner-207 kernel: [22884.566456] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 11:45:10 juju-e4d256-prod-github-runner-207 kernel: [22884.567622] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 11:45:10 juju-e4d256-prod-github-runner-207 kernel: [22884.568813] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 11:45:10 juju-e4d256-prod-github-runner-207 kernel: [22884.570094] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 11:45:10 juju-e4d256-prod-github-runner-207 kernel: [22884.571195] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 11:45:10 juju-e4d256-prod-github-runner-207 kernel: [22884.572405] Call Trace: Aug 22 11:45:10 juju-e4d256-prod-github-runner-207 kernel: [22884.573339] Aug 22 11:45:10 juju-e4d256-prod-github-runner-207 kernel: [22884.574255] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:45:10 juju-e4d256-prod-github-runner-207 kernel: [22884.575293] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:45:10 juju-e4d256-prod-github-runner-207 kernel: [22884.576313] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:45:10 juju-e4d256-prod-github-runner-207 kernel: [22884.577395] ? show_regs.part.0+0x23/0x29 Aug 22 11:45:10 juju-e4d256-prod-github-runner-207 kernel: [22884.578422] ? show_regs.cold+0x8/0xd Aug 22 11:45:10 juju-e4d256-prod-github-runner-207 kernel: [22884.579419] ? watchdog_timer_fn+0x1be/0x220 Aug 22 11:45:10 juju-e4d256-prod-github-runner-207 kernel: [22884.580428] ? lockup_detector_update_enable+0x60/0x60 Aug 22 11:45:10 juju-e4d256-prod-github-runner-207 kernel: [22884.581530] ? __hrtimer_run_queues+0x107/0x230 Aug 22 11:45:10 juju-e4d256-prod-github-runner-207 kernel: [22884.582600] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 11:45:10 juju-e4d256-prod-github-runner-207 kernel: [22884.583663] ? hrtimer_interrupt+0x101/0x220 Aug 22 11:45:10 juju-e4d256-prod-github-runner-207 kernel: [22884.584703] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 11:45:10 juju-e4d256-prod-github-runner-207 kernel: [22884.585798] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 11:45:10 juju-e4d256-prod-github-runner-207 kernel: [22884.586845] Aug 22 11:45:10 juju-e4d256-prod-github-runner-207 kernel: [22884.587708] Aug 22 11:45:10 juju-e4d256-prod-github-runner-207 kernel: [22884.588548] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 11:45:10 juju-e4d256-prod-github-runner-207 kernel: [22884.589615] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:45:10 juju-e4d256-prod-github-runner-207 kernel: [22884.590691] ? _raw_spin_lock+0x22/0x30 Aug 22 11:45:10 juju-e4d256-prod-github-runner-207 kernel: [22884.591649] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:45:10 juju-e4d256-prod-github-runner-207 kernel: [22884.592667] direct_page_fault+0x206/0x310 [kvm] Aug 22 11:45:10 juju-e4d256-prod-github-runner-207 kernel: [22884.593693] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 11:45:10 juju-e4d256-prod-github-runner-207 kernel: [22884.594735] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 11:45:10 juju-e4d256-prod-github-runner-207 kernel: [22884.595747] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 11:45:10 juju-e4d256-prod-github-runner-207 kernel: [22884.596718] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 11:45:10 juju-e4d256-prod-github-runner-207 kernel: [22884.597665] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 11:45:10 juju-e4d256-prod-github-runner-207 kernel: [22884.598663] handle_exit+0x98/0x230 [kvm_amd] Aug 22 11:45:10 juju-e4d256-prod-github-runner-207 kernel: [22884.599589] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 11:45:10 juju-e4d256-prod-github-runner-207 kernel: [22884.600513] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 11:45:10 juju-e4d256-prod-github-runner-207 kernel: [22884.601437] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 11:45:10 juju-e4d256-prod-github-runner-207 kernel: [22884.602357] vcpu_run+0x62/0x2c0 [kvm] Aug 22 11:45:10 juju-e4d256-prod-github-runner-207 kernel: [22884.603170] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 11:45:10 juju-e4d256-prod-github-runner-207 kernel: [22884.603974] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 11:45:10 juju-e4d256-prod-github-runner-207 kernel: [22884.604860] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 11:45:10 juju-e4d256-prod-github-runner-207 kernel: [22884.605662] ? __seccomp_filter+0x4a/0x4a0 Aug 22 11:45:10 juju-e4d256-prod-github-runner-207 kernel: [22884.606433] ? __fget_files+0x86/0xc0 Aug 22 11:45:10 juju-e4d256-prod-github-runner-207 kernel: [22884.607147] __x64_sys_ioctl+0x95/0xd0 Aug 22 11:45:10 juju-e4d256-prod-github-runner-207 kernel: [22884.607881] do_syscall_64+0x5c/0xc0 Aug 22 11:45:10 juju-e4d256-prod-github-runner-207 kernel: [22884.608549] ? do_futex+0x162/0x1f0 Aug 22 11:45:10 juju-e4d256-prod-github-runner-207 kernel: [22884.609199] ? __x64_sys_futex+0x78/0x1e0 Aug 22 11:45:10 juju-e4d256-prod-github-runner-207 kernel: [22884.609906] ? __secure_computing+0xa9/0x120 Aug 22 11:45:10 juju-e4d256-prod-github-runner-207 kernel: [22884.610598] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 11:45:10 juju-e4d256-prod-github-runner-207 kernel: [22884.611357] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:45:10 juju-e4d256-prod-github-runner-207 kernel: [22884.612078] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:45:10 juju-e4d256-prod-github-runner-207 kernel: [22884.612795] ? do_syscall_64+0x69/0xc0 Aug 22 11:45:10 juju-e4d256-prod-github-runner-207 kernel: [22884.613440] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:45:10 juju-e4d256-prod-github-runner-207 kernel: [22884.614173] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:45:10 juju-e4d256-prod-github-runner-207 kernel: [22884.614891] ? do_syscall_64+0x69/0xc0 Aug 22 11:45:10 juju-e4d256-prod-github-runner-207 kernel: [22884.615529] ? do_syscall_64+0x69/0xc0 Aug 22 11:45:10 juju-e4d256-prod-github-runner-207 kernel: [22884.616150] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 11:45:10 juju-e4d256-prod-github-runner-207 kernel: [22884.616854] RIP: 0033:0x7faa5d0edaff Aug 22 11:45:10 juju-e4d256-prod-github-runner-207 kernel: [22884.617483] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 11:45:10 juju-e4d256-prod-github-runner-207 kernel: [22884.619474] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 11:45:10 juju-e4d256-prod-github-runner-207 kernel: [22884.620406] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 11:45:10 juju-e4d256-prod-github-runner-207 kernel: [22884.621306] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 11:45:10 juju-e4d256-prod-github-runner-207 kernel: [22884.622292] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 11:45:10 juju-e4d256-prod-github-runner-207 kernel: [22884.623207] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 11:45:10 juju-e4d256-prod-github-runner-207 kernel: [22884.624103] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 11:45:10 juju-e4d256-prod-github-runner-207 kernel: [22884.625022] Aug 22 11:45:38 juju-e4d256-prod-github-runner-207 kernel: [22912.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 21230s! [qemu-system-x86:6715] Aug 22 11:45:38 juju-e4d256-prod-github-runner-207 kernel: [22912.543929] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 11:45:38 juju-e4d256-prod-github-runner-207 kernel: [22912.544238] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 11:45:38 juju-e4d256-prod-github-runner-207 kernel: [22912.557147] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 11:45:38 juju-e4d256-prod-github-runner-207 kernel: [22912.558482] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 11:45:38 juju-e4d256-prod-github-runner-207 kernel: [22912.559730] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:45:38 juju-e4d256-prod-github-runner-207 kernel: [22912.560807] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 11:45:38 juju-e4d256-prod-github-runner-207 kernel: [22912.563412] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 11:45:38 juju-e4d256-prod-github-runner-207 kernel: [22912.564468] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 11:45:38 juju-e4d256-prod-github-runner-207 kernel: [22912.565671] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 11:45:38 juju-e4d256-prod-github-runner-207 kernel: [22912.566892] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 11:45:38 juju-e4d256-prod-github-runner-207 kernel: [22912.568074] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 11:45:38 juju-e4d256-prod-github-runner-207 kernel: [22912.569262] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 11:45:38 juju-e4d256-prod-github-runner-207 kernel: [22912.570473] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 11:45:38 juju-e4d256-prod-github-runner-207 kernel: [22912.571730] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 11:45:38 juju-e4d256-prod-github-runner-207 kernel: [22912.572851] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 11:45:38 juju-e4d256-prod-github-runner-207 kernel: [22912.574073] Call Trace: Aug 22 11:45:38 juju-e4d256-prod-github-runner-207 kernel: [22912.574994] Aug 22 11:45:38 juju-e4d256-prod-github-runner-207 kernel: [22912.575894] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:45:38 juju-e4d256-prod-github-runner-207 kernel: [22912.576934] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:45:38 juju-e4d256-prod-github-runner-207 kernel: [22912.578099] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:45:38 juju-e4d256-prod-github-runner-207 kernel: [22912.579259] ? show_regs.part.0+0x23/0x29 Aug 22 11:45:38 juju-e4d256-prod-github-runner-207 kernel: [22912.580273] ? show_regs.cold+0x8/0xd Aug 22 11:45:38 juju-e4d256-prod-github-runner-207 kernel: [22912.581256] ? watchdog_timer_fn+0x1be/0x220 Aug 22 11:45:38 juju-e4d256-prod-github-runner-207 kernel: [22912.582292] ? lockup_detector_update_enable+0x60/0x60 Aug 22 11:45:38 juju-e4d256-prod-github-runner-207 kernel: [22912.583376] ? __hrtimer_run_queues+0x107/0x230 Aug 22 11:45:38 juju-e4d256-prod-github-runner-207 kernel: [22912.584484] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 11:45:38 juju-e4d256-prod-github-runner-207 kernel: [22912.585530] ? hrtimer_interrupt+0x101/0x220 Aug 22 11:45:38 juju-e4d256-prod-github-runner-207 kernel: [22912.586561] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 11:45:38 juju-e4d256-prod-github-runner-207 kernel: [22912.587649] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 11:45:38 juju-e4d256-prod-github-runner-207 kernel: [22912.588711] Aug 22 11:45:38 juju-e4d256-prod-github-runner-207 kernel: [22912.589578] Aug 22 11:45:38 juju-e4d256-prod-github-runner-207 kernel: [22912.590423] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 11:45:38 juju-e4d256-prod-github-runner-207 kernel: [22912.591471] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:45:38 juju-e4d256-prod-github-runner-207 kernel: [22912.592535] ? _raw_spin_lock+0x22/0x30 Aug 22 11:45:38 juju-e4d256-prod-github-runner-207 kernel: [22912.593633] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:45:38 juju-e4d256-prod-github-runner-207 kernel: [22912.594680] direct_page_fault+0x206/0x310 [kvm] Aug 22 11:45:38 juju-e4d256-prod-github-runner-207 kernel: [22912.595726] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 11:45:38 juju-e4d256-prod-github-runner-207 kernel: [22912.596749] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 11:45:38 juju-e4d256-prod-github-runner-207 kernel: [22912.597786] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 11:45:38 juju-e4d256-prod-github-runner-207 kernel: [22912.598798] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 11:45:38 juju-e4d256-prod-github-runner-207 kernel: [22912.599757] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 11:45:38 juju-e4d256-prod-github-runner-207 kernel: [22912.600749] handle_exit+0x98/0x230 [kvm_amd] Aug 22 11:45:38 juju-e4d256-prod-github-runner-207 kernel: [22912.601664] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 11:45:38 juju-e4d256-prod-github-runner-207 kernel: [22912.602608] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 11:45:38 juju-e4d256-prod-github-runner-207 kernel: [22912.603560] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 11:45:38 juju-e4d256-prod-github-runner-207 kernel: [22912.604477] vcpu_run+0x62/0x2c0 [kvm] Aug 22 11:45:38 juju-e4d256-prod-github-runner-207 kernel: [22912.605315] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 11:45:38 juju-e4d256-prod-github-runner-207 kernel: [22912.606155] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 11:45:38 juju-e4d256-prod-github-runner-207 kernel: [22912.607020] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 11:45:38 juju-e4d256-prod-github-runner-207 kernel: [22912.607844] ? __seccomp_filter+0x4a/0x4a0 Aug 22 11:45:38 juju-e4d256-prod-github-runner-207 kernel: [22912.608598] ? __fget_files+0x86/0xc0 Aug 22 11:45:38 juju-e4d256-prod-github-runner-207 kernel: [22912.609311] __x64_sys_ioctl+0x95/0xd0 Aug 22 11:45:38 juju-e4d256-prod-github-runner-207 kernel: [22912.610034] do_syscall_64+0x5c/0xc0 Aug 22 11:45:38 juju-e4d256-prod-github-runner-207 kernel: [22912.610707] ? do_futex+0x162/0x1f0 Aug 22 11:45:38 juju-e4d256-prod-github-runner-207 kernel: [22912.611362] ? __x64_sys_futex+0x78/0x1e0 Aug 22 11:45:38 juju-e4d256-prod-github-runner-207 kernel: [22912.612051] ? __secure_computing+0xa9/0x120 Aug 22 11:45:38 juju-e4d256-prod-github-runner-207 kernel: [22912.612751] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 11:45:38 juju-e4d256-prod-github-runner-207 kernel: [22912.613541] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:45:38 juju-e4d256-prod-github-runner-207 kernel: [22912.614274] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:45:38 juju-e4d256-prod-github-runner-207 kernel: [22912.615002] ? do_syscall_64+0x69/0xc0 Aug 22 11:45:38 juju-e4d256-prod-github-runner-207 kernel: [22912.615655] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:45:38 juju-e4d256-prod-github-runner-207 kernel: [22912.616367] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:45:38 juju-e4d256-prod-github-runner-207 kernel: [22912.617079] ? do_syscall_64+0x69/0xc0 Aug 22 11:45:38 juju-e4d256-prod-github-runner-207 kernel: [22912.617725] ? do_syscall_64+0x69/0xc0 Aug 22 11:45:38 juju-e4d256-prod-github-runner-207 kernel: [22912.618366] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 11:45:38 juju-e4d256-prod-github-runner-207 kernel: [22912.619084] RIP: 0033:0x7faa5d0edaff Aug 22 11:45:38 juju-e4d256-prod-github-runner-207 kernel: [22912.619757] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 11:45:38 juju-e4d256-prod-github-runner-207 kernel: [22912.621847] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 11:45:38 juju-e4d256-prod-github-runner-207 kernel: [22912.622822] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 11:45:38 juju-e4d256-prod-github-runner-207 kernel: [22912.623750] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 11:45:38 juju-e4d256-prod-github-runner-207 kernel: [22912.624665] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 11:45:38 juju-e4d256-prod-github-runner-207 kernel: [22912.625645] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 11:45:38 juju-e4d256-prod-github-runner-207 kernel: [22912.626585] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 11:45:38 juju-e4d256-prod-github-runner-207 kernel: [22912.627538] Aug 22 11:46:06 juju-e4d256-prod-github-runner-207 kernel: [22940.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 21257s! [qemu-system-x86:6715] Aug 22 11:46:06 juju-e4d256-prod-github-runner-207 kernel: [22940.543136] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 11:46:06 juju-e4d256-prod-github-runner-207 kernel: [22940.543212] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 11:46:06 juju-e4d256-prod-github-runner-207 kernel: [22940.555545] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 11:46:06 juju-e4d256-prod-github-runner-207 kernel: [22940.556815] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 11:46:06 juju-e4d256-prod-github-runner-207 kernel: [22940.558052] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:46:06 juju-e4d256-prod-github-runner-207 kernel: [22940.559106] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 11:46:06 juju-e4d256-prod-github-runner-207 kernel: [22940.561727] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 11:46:06 juju-e4d256-prod-github-runner-207 kernel: [22940.562779] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 11:46:06 juju-e4d256-prod-github-runner-207 kernel: [22940.563954] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 11:46:06 juju-e4d256-prod-github-runner-207 kernel: [22940.565157] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 11:46:06 juju-e4d256-prod-github-runner-207 kernel: [22940.566317] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 11:46:06 juju-e4d256-prod-github-runner-207 kernel: [22940.567530] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 11:46:06 juju-e4d256-prod-github-runner-207 kernel: [22940.568697] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 11:46:06 juju-e4d256-prod-github-runner-207 kernel: [22940.569963] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 11:46:06 juju-e4d256-prod-github-runner-207 kernel: [22940.571081] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 11:46:06 juju-e4d256-prod-github-runner-207 kernel: [22940.572311] Call Trace: Aug 22 11:46:06 juju-e4d256-prod-github-runner-207 kernel: [22940.573237] Aug 22 11:46:06 juju-e4d256-prod-github-runner-207 kernel: [22940.574127] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:46:06 juju-e4d256-prod-github-runner-207 kernel: [22940.575163] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:46:06 juju-e4d256-prod-github-runner-207 kernel: [22940.576182] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:46:06 juju-e4d256-prod-github-runner-207 kernel: [22940.577267] ? show_regs.part.0+0x23/0x29 Aug 22 11:46:06 juju-e4d256-prod-github-runner-207 kernel: [22940.578262] ? show_regs.cold+0x8/0xd Aug 22 11:46:06 juju-e4d256-prod-github-runner-207 kernel: [22940.579251] ? watchdog_timer_fn+0x1be/0x220 Aug 22 11:46:06 juju-e4d256-prod-github-runner-207 kernel: [22940.580285] ? lockup_detector_update_enable+0x60/0x60 Aug 22 11:46:06 juju-e4d256-prod-github-runner-207 kernel: [22940.581377] ? __hrtimer_run_queues+0x107/0x230 Aug 22 11:46:06 juju-e4d256-prod-github-runner-207 kernel: [22940.582406] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 11:46:06 juju-e4d256-prod-github-runner-207 kernel: [22940.583531] ? hrtimer_interrupt+0x101/0x220 Aug 22 11:46:06 juju-e4d256-prod-github-runner-207 kernel: [22940.584594] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 11:46:06 juju-e4d256-prod-github-runner-207 kernel: [22940.585680] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 11:46:06 juju-e4d256-prod-github-runner-207 kernel: [22940.586726] Aug 22 11:46:06 juju-e4d256-prod-github-runner-207 kernel: [22940.587578] Aug 22 11:46:06 juju-e4d256-prod-github-runner-207 kernel: [22940.588422] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 11:46:06 juju-e4d256-prod-github-runner-207 kernel: [22940.589464] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:46:06 juju-e4d256-prod-github-runner-207 kernel: [22940.590519] ? _raw_spin_lock+0x22/0x30 Aug 22 11:46:06 juju-e4d256-prod-github-runner-207 kernel: [22940.591463] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:46:06 juju-e4d256-prod-github-runner-207 kernel: [22940.592479] direct_page_fault+0x206/0x310 [kvm] Aug 22 11:46:06 juju-e4d256-prod-github-runner-207 kernel: [22940.593523] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 11:46:06 juju-e4d256-prod-github-runner-207 kernel: [22940.594537] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 11:46:06 juju-e4d256-prod-github-runner-207 kernel: [22940.595547] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 11:46:06 juju-e4d256-prod-github-runner-207 kernel: [22940.596516] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 11:46:06 juju-e4d256-prod-github-runner-207 kernel: [22940.597480] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 11:46:06 juju-e4d256-prod-github-runner-207 kernel: [22940.598457] handle_exit+0x98/0x230 [kvm_amd] Aug 22 11:46:06 juju-e4d256-prod-github-runner-207 kernel: [22940.599354] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 11:46:06 juju-e4d256-prod-github-runner-207 kernel: [22940.600266] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 11:46:06 juju-e4d256-prod-github-runner-207 kernel: [22940.601201] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 11:46:06 juju-e4d256-prod-github-runner-207 kernel: [22940.602105] vcpu_run+0x62/0x2c0 [kvm] Aug 22 11:46:06 juju-e4d256-prod-github-runner-207 kernel: [22940.602914] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 11:46:06 juju-e4d256-prod-github-runner-207 kernel: [22940.603719] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 11:46:06 juju-e4d256-prod-github-runner-207 kernel: [22940.604579] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 11:46:06 juju-e4d256-prod-github-runner-207 kernel: [22940.605388] ? __seccomp_filter+0x4a/0x4a0 Aug 22 11:46:06 juju-e4d256-prod-github-runner-207 kernel: [22940.606130] ? __fget_files+0x86/0xc0 Aug 22 11:46:06 juju-e4d256-prod-github-runner-207 kernel: [22940.606834] __x64_sys_ioctl+0x95/0xd0 Aug 22 11:46:06 juju-e4d256-prod-github-runner-207 kernel: [22940.607529] do_syscall_64+0x5c/0xc0 Aug 22 11:46:06 juju-e4d256-prod-github-runner-207 kernel: [22940.608193] ? do_futex+0x162/0x1f0 Aug 22 11:46:06 juju-e4d256-prod-github-runner-207 kernel: [22940.608839] ? __x64_sys_futex+0x78/0x1e0 Aug 22 11:46:06 juju-e4d256-prod-github-runner-207 kernel: [22940.609521] ? __secure_computing+0xa9/0x120 Aug 22 11:46:06 juju-e4d256-prod-github-runner-207 kernel: [22940.610209] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 11:46:06 juju-e4d256-prod-github-runner-207 kernel: [22940.610967] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:46:06 juju-e4d256-prod-github-runner-207 kernel: [22940.611688] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:46:06 juju-e4d256-prod-github-runner-207 kernel: [22940.612406] ? do_syscall_64+0x69/0xc0 Aug 22 11:46:06 juju-e4d256-prod-github-runner-207 kernel: [22940.613067] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:46:06 juju-e4d256-prod-github-runner-207 kernel: [22940.613770] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:46:06 juju-e4d256-prod-github-runner-207 kernel: [22940.614463] ? do_syscall_64+0x69/0xc0 Aug 22 11:46:06 juju-e4d256-prod-github-runner-207 kernel: [22940.615093] ? do_syscall_64+0x69/0xc0 Aug 22 11:46:06 juju-e4d256-prod-github-runner-207 kernel: [22940.615715] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 11:46:06 juju-e4d256-prod-github-runner-207 kernel: [22940.616417] RIP: 0033:0x7faa5d0edaff Aug 22 11:46:06 juju-e4d256-prod-github-runner-207 kernel: [22940.617052] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 11:46:06 juju-e4d256-prod-github-runner-207 kernel: [22940.619045] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 11:46:06 juju-e4d256-prod-github-runner-207 kernel: [22940.619953] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 11:46:06 juju-e4d256-prod-github-runner-207 kernel: [22940.620845] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 11:46:06 juju-e4d256-prod-github-runner-207 kernel: [22940.621753] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 11:46:06 juju-e4d256-prod-github-runner-207 kernel: [22940.622645] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 11:46:06 juju-e4d256-prod-github-runner-207 kernel: [22940.623545] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 11:46:06 juju-e4d256-prod-github-runner-207 kernel: [22940.624477] Aug 22 11:46:34 juju-e4d256-prod-github-runner-207 kernel: [22968.541976] watchdog: BUG: soft lockup - CPU#1 stuck for 21283s! [qemu-system-x86:6715] Aug 22 11:46:34 juju-e4d256-prod-github-runner-207 kernel: [22968.543237] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 11:46:34 juju-e4d256-prod-github-runner-207 kernel: [22968.543310] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 11:46:34 juju-e4d256-prod-github-runner-207 kernel: [22968.555473] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 11:46:34 juju-e4d256-prod-github-runner-207 kernel: [22968.556768] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 11:46:34 juju-e4d256-prod-github-runner-207 kernel: [22968.557994] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:46:34 juju-e4d256-prod-github-runner-207 kernel: [22968.559049] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 11:46:34 juju-e4d256-prod-github-runner-207 kernel: [22968.561612] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 11:46:34 juju-e4d256-prod-github-runner-207 kernel: [22968.562668] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 11:46:34 juju-e4d256-prod-github-runner-207 kernel: [22968.563880] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 11:46:34 juju-e4d256-prod-github-runner-207 kernel: [22968.565086] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 11:46:34 juju-e4d256-prod-github-runner-207 kernel: [22968.566264] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 11:46:34 juju-e4d256-prod-github-runner-207 kernel: [22968.567446] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 11:46:34 juju-e4d256-prod-github-runner-207 kernel: [22968.568619] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 11:46:34 juju-e4d256-prod-github-runner-207 kernel: [22968.569862] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 11:46:34 juju-e4d256-prod-github-runner-207 kernel: [22968.570955] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 11:46:34 juju-e4d256-prod-github-runner-207 kernel: [22968.572180] Call Trace: Aug 22 11:46:34 juju-e4d256-prod-github-runner-207 kernel: [22968.573130] Aug 22 11:46:34 juju-e4d256-prod-github-runner-207 kernel: [22968.574020] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:46:34 juju-e4d256-prod-github-runner-207 kernel: [22968.575107] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:46:34 juju-e4d256-prod-github-runner-207 kernel: [22968.576154] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:46:34 juju-e4d256-prod-github-runner-207 kernel: [22968.577298] ? show_regs.part.0+0x23/0x29 Aug 22 11:46:34 juju-e4d256-prod-github-runner-207 kernel: [22968.578297] ? show_regs.cold+0x8/0xd Aug 22 11:46:34 juju-e4d256-prod-github-runner-207 kernel: [22968.579274] ? watchdog_timer_fn+0x1be/0x220 Aug 22 11:46:34 juju-e4d256-prod-github-runner-207 kernel: [22968.580291] ? lockup_detector_update_enable+0x60/0x60 Aug 22 11:46:34 juju-e4d256-prod-github-runner-207 kernel: [22968.581377] ? __hrtimer_run_queues+0x107/0x230 Aug 22 11:46:34 juju-e4d256-prod-github-runner-207 kernel: [22968.582406] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 11:46:34 juju-e4d256-prod-github-runner-207 kernel: [22968.583427] ? hrtimer_interrupt+0x101/0x220 Aug 22 11:46:34 juju-e4d256-prod-github-runner-207 kernel: [22968.584440] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 11:46:34 juju-e4d256-prod-github-runner-207 kernel: [22968.585524] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 11:46:34 juju-e4d256-prod-github-runner-207 kernel: [22968.586565] Aug 22 11:46:34 juju-e4d256-prod-github-runner-207 kernel: [22968.587415] Aug 22 11:46:34 juju-e4d256-prod-github-runner-207 kernel: [22968.588249] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 11:46:34 juju-e4d256-prod-github-runner-207 kernel: [22968.589286] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:46:34 juju-e4d256-prod-github-runner-207 kernel: [22968.590348] ? _raw_spin_lock+0x22/0x30 Aug 22 11:46:34 juju-e4d256-prod-github-runner-207 kernel: [22968.591299] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:46:34 juju-e4d256-prod-github-runner-207 kernel: [22968.592321] direct_page_fault+0x206/0x310 [kvm] Aug 22 11:46:34 juju-e4d256-prod-github-runner-207 kernel: [22968.593368] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 11:46:34 juju-e4d256-prod-github-runner-207 kernel: [22968.594412] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 11:46:34 juju-e4d256-prod-github-runner-207 kernel: [22968.595419] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 11:46:34 juju-e4d256-prod-github-runner-207 kernel: [22968.596499] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 11:46:34 juju-e4d256-prod-github-runner-207 kernel: [22968.597557] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 11:46:34 juju-e4d256-prod-github-runner-207 kernel: [22968.598537] handle_exit+0x98/0x230 [kvm_amd] Aug 22 11:46:34 juju-e4d256-prod-github-runner-207 kernel: [22968.599434] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 11:46:34 juju-e4d256-prod-github-runner-207 kernel: [22968.600356] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 11:46:34 juju-e4d256-prod-github-runner-207 kernel: [22968.601298] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 11:46:34 juju-e4d256-prod-github-runner-207 kernel: [22968.602208] vcpu_run+0x62/0x2c0 [kvm] Aug 22 11:46:34 juju-e4d256-prod-github-runner-207 kernel: [22968.603024] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 11:46:34 juju-e4d256-prod-github-runner-207 kernel: [22968.603876] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 11:46:34 juju-e4d256-prod-github-runner-207 kernel: [22968.604768] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 11:46:34 juju-e4d256-prod-github-runner-207 kernel: [22968.605572] ? __seccomp_filter+0x4a/0x4a0 Aug 22 11:46:34 juju-e4d256-prod-github-runner-207 kernel: [22968.606375] ? __fget_files+0x86/0xc0 Aug 22 11:46:34 juju-e4d256-prod-github-runner-207 kernel: [22968.607094] __x64_sys_ioctl+0x95/0xd0 Aug 22 11:46:34 juju-e4d256-prod-github-runner-207 kernel: [22968.607789] do_syscall_64+0x5c/0xc0 Aug 22 11:46:34 juju-e4d256-prod-github-runner-207 kernel: [22968.608463] ? do_futex+0x162/0x1f0 Aug 22 11:46:34 juju-e4d256-prod-github-runner-207 kernel: [22968.609137] ? __x64_sys_futex+0x78/0x1e0 Aug 22 11:46:34 juju-e4d256-prod-github-runner-207 kernel: [22968.609812] ? __secure_computing+0xa9/0x120 Aug 22 11:46:34 juju-e4d256-prod-github-runner-207 kernel: [22968.610500] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 11:46:34 juju-e4d256-prod-github-runner-207 kernel: [22968.611258] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:46:34 juju-e4d256-prod-github-runner-207 kernel: [22968.611978] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:46:34 juju-e4d256-prod-github-runner-207 kernel: [22968.612694] ? do_syscall_64+0x69/0xc0 Aug 22 11:46:34 juju-e4d256-prod-github-runner-207 kernel: [22968.613363] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:46:34 juju-e4d256-prod-github-runner-207 kernel: [22968.614072] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:46:34 juju-e4d256-prod-github-runner-207 kernel: [22968.614783] ? do_syscall_64+0x69/0xc0 Aug 22 11:46:34 juju-e4d256-prod-github-runner-207 kernel: [22968.615412] ? do_syscall_64+0x69/0xc0 Aug 22 11:46:34 juju-e4d256-prod-github-runner-207 kernel: [22968.616041] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 11:46:34 juju-e4d256-prod-github-runner-207 kernel: [22968.616776] RIP: 0033:0x7faa5d0edaff Aug 22 11:46:34 juju-e4d256-prod-github-runner-207 kernel: [22968.617502] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 11:46:34 juju-e4d256-prod-github-runner-207 kernel: [22968.619491] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 11:46:34 juju-e4d256-prod-github-runner-207 kernel: [22968.620401] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 11:46:34 juju-e4d256-prod-github-runner-207 kernel: [22968.621309] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 11:46:34 juju-e4d256-prod-github-runner-207 kernel: [22968.622195] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 11:46:34 juju-e4d256-prod-github-runner-207 kernel: [22968.623086] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 11:46:34 juju-e4d256-prod-github-runner-207 kernel: [22968.623997] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 11:46:34 juju-e4d256-prod-github-runner-207 kernel: [22968.624905] Aug 22 11:47:02 juju-e4d256-prod-github-runner-207 kernel: [22996.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 21309s! [qemu-system-x86:6715] Aug 22 11:47:02 juju-e4d256-prod-github-runner-207 kernel: [22996.543866] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 11:47:02 juju-e4d256-prod-github-runner-207 kernel: [22996.544171] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 11:47:02 juju-e4d256-prod-github-runner-207 kernel: [22996.556417] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 11:47:02 juju-e4d256-prod-github-runner-207 kernel: [22996.557715] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 11:47:02 juju-e4d256-prod-github-runner-207 kernel: [22996.558959] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:47:02 juju-e4d256-prod-github-runner-207 kernel: [22996.560078] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 11:47:02 juju-e4d256-prod-github-runner-207 kernel: [22996.562650] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 11:47:02 juju-e4d256-prod-github-runner-207 kernel: [22996.563693] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 11:47:02 juju-e4d256-prod-github-runner-207 kernel: [22996.564875] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 11:47:02 juju-e4d256-prod-github-runner-207 kernel: [22996.566036] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 11:47:02 juju-e4d256-prod-github-runner-207 kernel: [22996.567256] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 11:47:02 juju-e4d256-prod-github-runner-207 kernel: [22996.568567] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 11:47:02 juju-e4d256-prod-github-runner-207 kernel: [22996.569901] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 11:47:02 juju-e4d256-prod-github-runner-207 kernel: [22996.571157] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 11:47:02 juju-e4d256-prod-github-runner-207 kernel: [22996.572273] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 11:47:02 juju-e4d256-prod-github-runner-207 kernel: [22996.573516] Call Trace: Aug 22 11:47:02 juju-e4d256-prod-github-runner-207 kernel: [22996.574430] Aug 22 11:47:02 juju-e4d256-prod-github-runner-207 kernel: [22996.575335] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:47:02 juju-e4d256-prod-github-runner-207 kernel: [22996.576395] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:47:02 juju-e4d256-prod-github-runner-207 kernel: [22996.577422] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:47:02 juju-e4d256-prod-github-runner-207 kernel: [22996.578528] ? show_regs.part.0+0x23/0x29 Aug 22 11:47:02 juju-e4d256-prod-github-runner-207 kernel: [22996.579529] ? show_regs.cold+0x8/0xd Aug 22 11:47:02 juju-e4d256-prod-github-runner-207 kernel: [22996.580510] ? watchdog_timer_fn+0x1be/0x220 Aug 22 11:47:02 juju-e4d256-prod-github-runner-207 kernel: [22996.581521] ? lockup_detector_update_enable+0x60/0x60 Aug 22 11:47:02 juju-e4d256-prod-github-runner-207 kernel: [22996.582586] ? __hrtimer_run_queues+0x107/0x230 Aug 22 11:47:02 juju-e4d256-prod-github-runner-207 kernel: [22996.583615] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 11:47:02 juju-e4d256-prod-github-runner-207 kernel: [22996.584645] ? hrtimer_interrupt+0x101/0x220 Aug 22 11:47:02 juju-e4d256-prod-github-runner-207 kernel: [22996.585659] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 11:47:02 juju-e4d256-prod-github-runner-207 kernel: [22996.586726] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 11:47:02 juju-e4d256-prod-github-runner-207 kernel: [22996.587778] Aug 22 11:47:02 juju-e4d256-prod-github-runner-207 kernel: [22996.588656] Aug 22 11:47:02 juju-e4d256-prod-github-runner-207 kernel: [22996.589502] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 11:47:02 juju-e4d256-prod-github-runner-207 kernel: [22996.590532] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:47:02 juju-e4d256-prod-github-runner-207 kernel: [22996.591568] ? _raw_spin_lock+0x22/0x30 Aug 22 11:47:02 juju-e4d256-prod-github-runner-207 kernel: [22996.592521] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:47:02 juju-e4d256-prod-github-runner-207 kernel: [22996.593540] direct_page_fault+0x206/0x310 [kvm] Aug 22 11:47:02 juju-e4d256-prod-github-runner-207 kernel: [22996.594563] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 11:47:02 juju-e4d256-prod-github-runner-207 kernel: [22996.595575] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 11:47:02 juju-e4d256-prod-github-runner-207 kernel: [22996.596589] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 11:47:02 juju-e4d256-prod-github-runner-207 kernel: [22996.597599] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 11:47:02 juju-e4d256-prod-github-runner-207 kernel: [22996.598541] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 11:47:02 juju-e4d256-prod-github-runner-207 kernel: [22996.599520] handle_exit+0x98/0x230 [kvm_amd] Aug 22 11:47:02 juju-e4d256-prod-github-runner-207 kernel: [22996.600426] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 11:47:02 juju-e4d256-prod-github-runner-207 kernel: [22996.601355] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 11:47:02 juju-e4d256-prod-github-runner-207 kernel: [22996.602279] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 11:47:02 juju-e4d256-prod-github-runner-207 kernel: [22996.603183] vcpu_run+0x62/0x2c0 [kvm] Aug 22 11:47:02 juju-e4d256-prod-github-runner-207 kernel: [22996.603993] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 11:47:02 juju-e4d256-prod-github-runner-207 kernel: [22996.604813] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 11:47:02 juju-e4d256-prod-github-runner-207 kernel: [22996.605673] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 11:47:02 juju-e4d256-prod-github-runner-207 kernel: [22996.606467] ? __seccomp_filter+0x4a/0x4a0 Aug 22 11:47:02 juju-e4d256-prod-github-runner-207 kernel: [22996.607208] ? __fget_files+0x86/0xc0 Aug 22 11:47:02 juju-e4d256-prod-github-runner-207 kernel: [22996.607923] __x64_sys_ioctl+0x95/0xd0 Aug 22 11:47:02 juju-e4d256-prod-github-runner-207 kernel: [22996.608625] do_syscall_64+0x5c/0xc0 Aug 22 11:47:02 juju-e4d256-prod-github-runner-207 kernel: [22996.609288] ? do_futex+0x162/0x1f0 Aug 22 11:47:02 juju-e4d256-prod-github-runner-207 kernel: [22996.609933] ? __x64_sys_futex+0x78/0x1e0 Aug 22 11:47:02 juju-e4d256-prod-github-runner-207 kernel: [22996.610604] ? __secure_computing+0xa9/0x120 Aug 22 11:47:02 juju-e4d256-prod-github-runner-207 kernel: [22996.611290] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 11:47:02 juju-e4d256-prod-github-runner-207 kernel: [22996.612046] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:47:02 juju-e4d256-prod-github-runner-207 kernel: [22996.612777] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:47:02 juju-e4d256-prod-github-runner-207 kernel: [22996.613517] ? do_syscall_64+0x69/0xc0 Aug 22 11:47:02 juju-e4d256-prod-github-runner-207 kernel: [22996.614176] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:47:02 juju-e4d256-prod-github-runner-207 kernel: [22996.614890] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:47:02 juju-e4d256-prod-github-runner-207 kernel: [22996.615595] ? do_syscall_64+0x69/0xc0 Aug 22 11:47:02 juju-e4d256-prod-github-runner-207 kernel: [22996.616216] ? do_syscall_64+0x69/0xc0 Aug 22 11:47:02 juju-e4d256-prod-github-runner-207 kernel: [22996.616849] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 11:47:02 juju-e4d256-prod-github-runner-207 kernel: [22996.617549] RIP: 0033:0x7faa5d0edaff Aug 22 11:47:02 juju-e4d256-prod-github-runner-207 kernel: [22996.618199] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 11:47:02 juju-e4d256-prod-github-runner-207 kernel: [22996.620195] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 11:47:02 juju-e4d256-prod-github-runner-207 kernel: [22996.621292] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 11:47:02 juju-e4d256-prod-github-runner-207 kernel: [22996.622243] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 11:47:02 juju-e4d256-prod-github-runner-207 kernel: [22996.623133] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 11:47:02 juju-e4d256-prod-github-runner-207 kernel: [22996.624354] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 11:47:02 juju-e4d256-prod-github-runner-207 kernel: [22996.625356] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 11:47:02 juju-e4d256-prod-github-runner-207 kernel: [22996.626256] Aug 22 11:47:30 juju-e4d256-prod-github-runner-207 kernel: [23024.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 21335s! [qemu-system-x86:6715] Aug 22 11:47:30 juju-e4d256-prod-github-runner-207 kernel: [23024.543108] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 11:47:30 juju-e4d256-prod-github-runner-207 kernel: [23024.543186] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 11:47:30 juju-e4d256-prod-github-runner-207 kernel: [23024.555559] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 11:47:30 juju-e4d256-prod-github-runner-207 kernel: [23024.556840] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 11:47:30 juju-e4d256-prod-github-runner-207 kernel: [23024.558055] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:47:30 juju-e4d256-prod-github-runner-207 kernel: [23024.559111] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 11:47:30 juju-e4d256-prod-github-runner-207 kernel: [23024.561656] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 11:47:30 juju-e4d256-prod-github-runner-207 kernel: [23024.562704] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 11:47:30 juju-e4d256-prod-github-runner-207 kernel: [23024.563874] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 11:47:30 juju-e4d256-prod-github-runner-207 kernel: [23024.565051] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 11:47:30 juju-e4d256-prod-github-runner-207 kernel: [23024.566209] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 11:47:30 juju-e4d256-prod-github-runner-207 kernel: [23024.567379] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 11:47:30 juju-e4d256-prod-github-runner-207 kernel: [23024.568559] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 11:47:30 juju-e4d256-prod-github-runner-207 kernel: [23024.569790] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 11:47:30 juju-e4d256-prod-github-runner-207 kernel: [23024.570888] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 11:47:30 juju-e4d256-prod-github-runner-207 kernel: [23024.572103] Call Trace: Aug 22 11:47:30 juju-e4d256-prod-github-runner-207 kernel: [23024.573039] Aug 22 11:47:30 juju-e4d256-prod-github-runner-207 kernel: [23024.573927] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:47:30 juju-e4d256-prod-github-runner-207 kernel: [23024.574978] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:47:30 juju-e4d256-prod-github-runner-207 kernel: [23024.576016] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:47:30 juju-e4d256-prod-github-runner-207 kernel: [23024.577121] ? show_regs.part.0+0x23/0x29 Aug 22 11:47:30 juju-e4d256-prod-github-runner-207 kernel: [23024.578167] ? show_regs.cold+0x8/0xd Aug 22 11:47:30 juju-e4d256-prod-github-runner-207 kernel: [23024.579138] ? watchdog_timer_fn+0x1be/0x220 Aug 22 11:47:30 juju-e4d256-prod-github-runner-207 kernel: [23024.580160] ? lockup_detector_update_enable+0x60/0x60 Aug 22 11:47:30 juju-e4d256-prod-github-runner-207 kernel: [23024.581227] ? __hrtimer_run_queues+0x107/0x230 Aug 22 11:47:30 juju-e4d256-prod-github-runner-207 kernel: [23024.582256] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 11:47:30 juju-e4d256-prod-github-runner-207 kernel: [23024.583402] ? hrtimer_interrupt+0x101/0x220 Aug 22 11:47:30 juju-e4d256-prod-github-runner-207 kernel: [23024.584532] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 11:47:30 juju-e4d256-prod-github-runner-207 kernel: [23024.585707] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 11:47:30 juju-e4d256-prod-github-runner-207 kernel: [23024.586845] Aug 22 11:47:30 juju-e4d256-prod-github-runner-207 kernel: [23024.587744] Aug 22 11:47:30 juju-e4d256-prod-github-runner-207 kernel: [23024.588646] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 11:47:30 juju-e4d256-prod-github-runner-207 kernel: [23024.589789] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:47:30 juju-e4d256-prod-github-runner-207 kernel: [23024.590943] ? _raw_spin_lock+0x22/0x30 Aug 22 11:47:30 juju-e4d256-prod-github-runner-207 kernel: [23024.591979] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:47:30 juju-e4d256-prod-github-runner-207 kernel: [23024.593102] direct_page_fault+0x206/0x310 [kvm] Aug 22 11:47:30 juju-e4d256-prod-github-runner-207 kernel: [23024.594220] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 11:47:30 juju-e4d256-prod-github-runner-207 kernel: [23024.595317] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 11:47:30 juju-e4d256-prod-github-runner-207 kernel: [23024.596427] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 11:47:30 juju-e4d256-prod-github-runner-207 kernel: [23024.597493] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 11:47:30 juju-e4d256-prod-github-runner-207 kernel: [23024.598526] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 11:47:30 juju-e4d256-prod-github-runner-207 kernel: [23024.599615] handle_exit+0x98/0x230 [kvm_amd] Aug 22 11:47:30 juju-e4d256-prod-github-runner-207 kernel: [23024.600605] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 11:47:30 juju-e4d256-prod-github-runner-207 kernel: [23024.601604] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 11:47:30 juju-e4d256-prod-github-runner-207 kernel: [23024.602625] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 11:47:30 juju-e4d256-prod-github-runner-207 kernel: [23024.603622] vcpu_run+0x62/0x2c0 [kvm] Aug 22 11:47:30 juju-e4d256-prod-github-runner-207 kernel: [23024.604519] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 11:47:30 juju-e4d256-prod-github-runner-207 kernel: [23024.605434] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 11:47:30 juju-e4d256-prod-github-runner-207 kernel: [23024.606398] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 11:47:30 juju-e4d256-prod-github-runner-207 kernel: [23024.607288] ? __seccomp_filter+0x4a/0x4a0 Aug 22 11:47:30 juju-e4d256-prod-github-runner-207 kernel: [23024.608131] ? __fget_files+0x86/0xc0 Aug 22 11:47:30 juju-e4d256-prod-github-runner-207 kernel: [23024.608910] __x64_sys_ioctl+0x95/0xd0 Aug 22 11:47:30 juju-e4d256-prod-github-runner-207 kernel: [23024.609678] do_syscall_64+0x5c/0xc0 Aug 22 11:47:30 juju-e4d256-prod-github-runner-207 kernel: [23024.610411] ? do_futex+0x162/0x1f0 Aug 22 11:47:30 juju-e4d256-prod-github-runner-207 kernel: [23024.611125] ? __x64_sys_futex+0x78/0x1e0 Aug 22 11:47:30 juju-e4d256-prod-github-runner-207 kernel: [23024.611877] ? __secure_computing+0xa9/0x120 Aug 22 11:47:30 juju-e4d256-prod-github-runner-207 kernel: [23024.612671] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 11:47:30 juju-e4d256-prod-github-runner-207 kernel: [23024.613541] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:47:30 juju-e4d256-prod-github-runner-207 kernel: [23024.614364] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:47:30 juju-e4d256-prod-github-runner-207 kernel: [23024.615180] ? do_syscall_64+0x69/0xc0 Aug 22 11:47:30 juju-e4d256-prod-github-runner-207 kernel: [23024.615901] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:47:30 juju-e4d256-prod-github-runner-207 kernel: [23024.616718] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:47:30 juju-e4d256-prod-github-runner-207 kernel: [23024.617510] ? do_syscall_64+0x69/0xc0 Aug 22 11:47:30 juju-e4d256-prod-github-runner-207 kernel: [23024.618208] ? do_syscall_64+0x69/0xc0 Aug 22 11:47:30 juju-e4d256-prod-github-runner-207 kernel: [23024.618905] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 11:47:30 juju-e4d256-prod-github-runner-207 kernel: [23024.619706] RIP: 0033:0x7faa5d0edaff Aug 22 11:47:30 juju-e4d256-prod-github-runner-207 kernel: [23024.620416] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 11:47:30 juju-e4d256-prod-github-runner-207 kernel: [23024.622738] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 11:47:30 juju-e4d256-prod-github-runner-207 kernel: [23024.624123] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 11:47:30 juju-e4d256-prod-github-runner-207 kernel: [23024.625143] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 11:47:30 juju-e4d256-prod-github-runner-207 kernel: [23024.626162] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 11:47:30 juju-e4d256-prod-github-runner-207 kernel: [23024.627184] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 11:47:30 juju-e4d256-prod-github-runner-207 kernel: [23024.628226] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 11:47:30 juju-e4d256-prod-github-runner-207 kernel: [23024.629252] Aug 22 11:47:44 juju-e4d256-prod-github-runner-207 kernel: [23038.724705] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 11:47:44 juju-e4d256-prod-github-runner-207 kernel: [23038.725682] rcu: 1-....: (5712503 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=2765556 Aug 22 11:47:44 juju-e4d256-prod-github-runner-207 kernel: [23038.726795] (t=5730381 jiffies g=23269 q=28302) Aug 22 11:47:44 juju-e4d256-prod-github-runner-207 kernel: [23038.727574] NMI backtrace for cpu 1 Aug 22 11:47:44 juju-e4d256-prod-github-runner-207 kernel: [23038.728294] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 11:47:44 juju-e4d256-prod-github-runner-207 kernel: [23038.729399] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 11:47:44 juju-e4d256-prod-github-runner-207 kernel: [23038.730457] Call Trace: Aug 22 11:47:44 juju-e4d256-prod-github-runner-207 kernel: [23038.731136] Aug 22 11:47:44 juju-e4d256-prod-github-runner-207 kernel: [23038.731780] show_stack+0x52/0x5c Aug 22 11:47:44 juju-e4d256-prod-github-runner-207 kernel: [23038.732510] dump_stack_lvl+0x4a/0x63 Aug 22 11:47:44 juju-e4d256-prod-github-runner-207 kernel: [23038.733255] dump_stack+0x10/0x16 Aug 22 11:47:44 juju-e4d256-prod-github-runner-207 kernel: [23038.733970] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 11:47:44 juju-e4d256-prod-github-runner-207 kernel: [23038.734752] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 11:47:44 juju-e4d256-prod-github-runner-207 kernel: [23038.735528] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 11:47:44 juju-e4d256-prod-github-runner-207 kernel: [23038.736352] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 11:47:44 juju-e4d256-prod-github-runner-207 kernel: [23038.737187] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 11:47:44 juju-e4d256-prod-github-runner-207 kernel: [23038.738039] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 11:47:44 juju-e4d256-prod-github-runner-207 kernel: [23038.738807] print_cpu_stall.cold+0x2f/0xe2 Aug 22 11:47:44 juju-e4d256-prod-github-runner-207 kernel: [23038.739569] ? timekeeping_update+0xf7/0x150 Aug 22 11:47:44 juju-e4d256-prod-github-runner-207 kernel: [23038.740352] check_cpu_stall+0x109/0x270 Aug 22 11:47:44 juju-e4d256-prod-github-runner-207 kernel: [23038.741104] rcu_sched_clock_irq+0x9a/0x250 Aug 22 11:47:44 juju-e4d256-prod-github-runner-207 kernel: [23038.741862] update_process_times+0x94/0xd0 Aug 22 11:47:44 juju-e4d256-prod-github-runner-207 kernel: [23038.742620] tick_sched_handle+0x29/0x70 Aug 22 11:47:44 juju-e4d256-prod-github-runner-207 kernel: [23038.743363] tick_sched_timer+0x8c/0xc0 Aug 22 11:47:44 juju-e4d256-prod-github-runner-207 kernel: [23038.744107] ? tick_nohz_handler+0xb0/0xb0 Aug 22 11:47:44 juju-e4d256-prod-github-runner-207 kernel: [23038.744859] __hrtimer_run_queues+0x107/0x230 Aug 22 11:47:44 juju-e4d256-prod-github-runner-207 kernel: [23038.745630] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 11:47:44 juju-e4d256-prod-github-runner-207 kernel: [23038.746401] hrtimer_interrupt+0x101/0x220 Aug 22 11:47:44 juju-e4d256-prod-github-runner-207 kernel: [23038.747163] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 11:47:44 juju-e4d256-prod-github-runner-207 kernel: [23038.747980] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 11:47:44 juju-e4d256-prod-github-runner-207 kernel: [23038.748780] Aug 22 11:47:44 juju-e4d256-prod-github-runner-207 kernel: [23038.749414] Aug 22 11:47:44 juju-e4d256-prod-github-runner-207 kernel: [23038.750046] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 11:47:44 juju-e4d256-prod-github-runner-207 kernel: [23038.750864] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:47:44 juju-e4d256-prod-github-runner-207 kernel: [23038.751741] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 11:47:44 juju-e4d256-prod-github-runner-207 kernel: [23038.753953] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 11:47:44 juju-e4d256-prod-github-runner-207 kernel: [23038.754833] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 11:47:44 juju-e4d256-prod-github-runner-207 kernel: [23038.755828] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 11:47:44 juju-e4d256-prod-github-runner-207 kernel: [23038.756810] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 11:47:44 juju-e4d256-prod-github-runner-207 kernel: [23038.757769] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 11:47:44 juju-e4d256-prod-github-runner-207 kernel: [23038.758720] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 11:47:44 juju-e4d256-prod-github-runner-207 kernel: [23038.759670] ? _raw_spin_lock+0x22/0x30 Aug 22 11:47:44 juju-e4d256-prod-github-runner-207 kernel: [23038.760445] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:47:44 juju-e4d256-prod-github-runner-207 kernel: [23038.761285] direct_page_fault+0x206/0x310 [kvm] Aug 22 11:47:44 juju-e4d256-prod-github-runner-207 kernel: [23038.762121] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 11:47:44 juju-e4d256-prod-github-runner-207 kernel: [23038.762954] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 11:47:44 juju-e4d256-prod-github-runner-207 kernel: [23038.763772] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 11:47:44 juju-e4d256-prod-github-runner-207 kernel: [23038.764578] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 11:47:44 juju-e4d256-prod-github-runner-207 kernel: [23038.765359] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 11:47:44 juju-e4d256-prod-github-runner-207 kernel: [23038.766196] handle_exit+0x98/0x230 [kvm_amd] Aug 22 11:47:44 juju-e4d256-prod-github-runner-207 kernel: [23038.766949] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 11:47:44 juju-e4d256-prod-github-runner-207 kernel: [23038.767748] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 11:47:44 juju-e4d256-prod-github-runner-207 kernel: [23038.768559] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 11:47:44 juju-e4d256-prod-github-runner-207 kernel: [23038.769347] vcpu_run+0x62/0x2c0 [kvm] Aug 22 11:47:44 juju-e4d256-prod-github-runner-207 kernel: [23038.770059] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 11:47:44 juju-e4d256-prod-github-runner-207 kernel: [23038.770792] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 11:47:44 juju-e4d256-prod-github-runner-207 kernel: [23038.771593] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 11:47:44 juju-e4d256-prod-github-runner-207 kernel: [23038.772364] ? __seccomp_filter+0x4a/0x4a0 Aug 22 11:47:44 juju-e4d256-prod-github-runner-207 kernel: [23038.773082] ? __fget_files+0x86/0xc0 Aug 22 11:47:44 juju-e4d256-prod-github-runner-207 kernel: [23038.773772] __x64_sys_ioctl+0x95/0xd0 Aug 22 11:47:44 juju-e4d256-prod-github-runner-207 kernel: [23038.774464] do_syscall_64+0x5c/0xc0 Aug 22 11:47:44 juju-e4d256-prod-github-runner-207 kernel: [23038.775147] ? do_futex+0x162/0x1f0 Aug 22 11:47:44 juju-e4d256-prod-github-runner-207 kernel: [23038.775818] ? __x64_sys_futex+0x78/0x1e0 Aug 22 11:47:44 juju-e4d256-prod-github-runner-207 kernel: [23038.776523] ? __secure_computing+0xa9/0x120 Aug 22 11:47:44 juju-e4d256-prod-github-runner-207 kernel: [23038.777243] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 11:47:44 juju-e4d256-prod-github-runner-207 kernel: [23038.778035] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:47:44 juju-e4d256-prod-github-runner-207 kernel: [23038.778787] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:47:44 juju-e4d256-prod-github-runner-207 kernel: [23038.779535] ? do_syscall_64+0x69/0xc0 Aug 22 11:47:44 juju-e4d256-prod-github-runner-207 kernel: [23038.780230] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:47:44 juju-e4d256-prod-github-runner-207 kernel: [23038.780999] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:47:44 juju-e4d256-prod-github-runner-207 kernel: [23038.781768] ? do_syscall_64+0x69/0xc0 Aug 22 11:47:44 juju-e4d256-prod-github-runner-207 kernel: [23038.782484] ? do_syscall_64+0x69/0xc0 Aug 22 11:47:44 juju-e4d256-prod-github-runner-207 kernel: [23038.783188] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 11:47:44 juju-e4d256-prod-github-runner-207 kernel: [23038.783993] RIP: 0033:0x7faa5d0edaff Aug 22 11:47:44 juju-e4d256-prod-github-runner-207 kernel: [23038.784832] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 11:47:44 juju-e4d256-prod-github-runner-207 kernel: [23038.787132] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 11:47:44 juju-e4d256-prod-github-runner-207 kernel: [23038.788162] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 11:47:44 juju-e4d256-prod-github-runner-207 kernel: [23038.789116] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 11:47:44 juju-e4d256-prod-github-runner-207 kernel: [23038.790061] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 11:47:44 juju-e4d256-prod-github-runner-207 kernel: [23038.791002] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 11:47:44 juju-e4d256-prod-github-runner-207 kernel: [23038.791947] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 11:47:44 juju-e4d256-prod-github-runner-207 kernel: [23038.792864] Aug 22 11:48:10 juju-e4d256-prod-github-runner-207 kernel: [23064.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 21372s! [qemu-system-x86:6715] Aug 22 11:48:10 juju-e4d256-prod-github-runner-207 kernel: [23064.543129] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 11:48:10 juju-e4d256-prod-github-runner-207 kernel: [23064.543217] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 11:48:10 juju-e4d256-prod-github-runner-207 kernel: [23064.555403] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 11:48:10 juju-e4d256-prod-github-runner-207 kernel: [23064.556693] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 11:48:10 juju-e4d256-prod-github-runner-207 kernel: [23064.557946] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:48:10 juju-e4d256-prod-github-runner-207 kernel: [23064.559050] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 11:48:10 juju-e4d256-prod-github-runner-207 kernel: [23064.561641] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 11:48:10 juju-e4d256-prod-github-runner-207 kernel: [23064.562713] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 11:48:10 juju-e4d256-prod-github-runner-207 kernel: [23064.563904] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 11:48:10 juju-e4d256-prod-github-runner-207 kernel: [23064.565062] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 11:48:10 juju-e4d256-prod-github-runner-207 kernel: [23064.566219] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 11:48:10 juju-e4d256-prod-github-runner-207 kernel: [23064.567390] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 11:48:10 juju-e4d256-prod-github-runner-207 kernel: [23064.568578] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 11:48:10 juju-e4d256-prod-github-runner-207 kernel: [23064.569834] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 11:48:10 juju-e4d256-prod-github-runner-207 kernel: [23064.570933] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 11:48:10 juju-e4d256-prod-github-runner-207 kernel: [23064.572136] Call Trace: Aug 22 11:48:10 juju-e4d256-prod-github-runner-207 kernel: [23064.573052] Aug 22 11:48:10 juju-e4d256-prod-github-runner-207 kernel: [23064.573934] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:48:10 juju-e4d256-prod-github-runner-207 kernel: [23064.574963] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:48:10 juju-e4d256-prod-github-runner-207 kernel: [23064.576000] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:48:10 juju-e4d256-prod-github-runner-207 kernel: [23064.577071] ? show_regs.part.0+0x23/0x29 Aug 22 11:48:10 juju-e4d256-prod-github-runner-207 kernel: [23064.578071] ? show_regs.cold+0x8/0xd Aug 22 11:48:10 juju-e4d256-prod-github-runner-207 kernel: [23064.579041] ? watchdog_timer_fn+0x1be/0x220 Aug 22 11:48:10 juju-e4d256-prod-github-runner-207 kernel: [23064.580059] ? lockup_detector_update_enable+0x60/0x60 Aug 22 11:48:10 juju-e4d256-prod-github-runner-207 kernel: [23064.581122] ? __hrtimer_run_queues+0x107/0x230 Aug 22 11:48:10 juju-e4d256-prod-github-runner-207 kernel: [23064.582149] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 11:48:10 juju-e4d256-prod-github-runner-207 kernel: [23064.583167] ? hrtimer_interrupt+0x101/0x220 Aug 22 11:48:10 juju-e4d256-prod-github-runner-207 kernel: [23064.584207] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 11:48:10 juju-e4d256-prod-github-runner-207 kernel: [23064.585272] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 11:48:10 juju-e4d256-prod-github-runner-207 kernel: [23064.586318] Aug 22 11:48:10 juju-e4d256-prod-github-runner-207 kernel: [23064.587168] Aug 22 11:48:10 juju-e4d256-prod-github-runner-207 kernel: [23064.588017] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 11:48:10 juju-e4d256-prod-github-runner-207 kernel: [23064.589045] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:48:10 juju-e4d256-prod-github-runner-207 kernel: [23064.590119] ? _raw_spin_lock+0x22/0x30 Aug 22 11:48:10 juju-e4d256-prod-github-runner-207 kernel: [23064.591062] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:48:10 juju-e4d256-prod-github-runner-207 kernel: [23064.592103] direct_page_fault+0x206/0x310 [kvm] Aug 22 11:48:10 juju-e4d256-prod-github-runner-207 kernel: [23064.593159] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 11:48:10 juju-e4d256-prod-github-runner-207 kernel: [23064.594174] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 11:48:10 juju-e4d256-prod-github-runner-207 kernel: [23064.595172] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 11:48:10 juju-e4d256-prod-github-runner-207 kernel: [23064.596148] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 11:48:10 juju-e4d256-prod-github-runner-207 kernel: [23064.597119] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 11:48:10 juju-e4d256-prod-github-runner-207 kernel: [23064.598114] handle_exit+0x98/0x230 [kvm_amd] Aug 22 11:48:10 juju-e4d256-prod-github-runner-207 kernel: [23064.599005] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 11:48:10 juju-e4d256-prod-github-runner-207 kernel: [23064.599931] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 11:48:10 juju-e4d256-prod-github-runner-207 kernel: [23064.600903] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 11:48:10 juju-e4d256-prod-github-runner-207 kernel: [23064.601808] vcpu_run+0x62/0x2c0 [kvm] Aug 22 11:48:10 juju-e4d256-prod-github-runner-207 kernel: [23064.602617] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 11:48:10 juju-e4d256-prod-github-runner-207 kernel: [23064.603429] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 11:48:10 juju-e4d256-prod-github-runner-207 kernel: [23064.604292] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 11:48:10 juju-e4d256-prod-github-runner-207 kernel: [23064.605087] ? __seccomp_filter+0x4a/0x4a0 Aug 22 11:48:10 juju-e4d256-prod-github-runner-207 kernel: [23064.605829] ? __fget_files+0x86/0xc0 Aug 22 11:48:10 juju-e4d256-prod-github-runner-207 kernel: [23064.606534] __x64_sys_ioctl+0x95/0xd0 Aug 22 11:48:10 juju-e4d256-prod-github-runner-207 kernel: [23064.607235] do_syscall_64+0x5c/0xc0 Aug 22 11:48:10 juju-e4d256-prod-github-runner-207 kernel: [23064.607909] ? do_futex+0x162/0x1f0 Aug 22 11:48:10 juju-e4d256-prod-github-runner-207 kernel: [23064.608558] ? __x64_sys_futex+0x78/0x1e0 Aug 22 11:48:10 juju-e4d256-prod-github-runner-207 kernel: [23064.609230] ? __secure_computing+0xa9/0x120 Aug 22 11:48:10 juju-e4d256-prod-github-runner-207 kernel: [23064.609918] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 11:48:10 juju-e4d256-prod-github-runner-207 kernel: [23064.610675] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:48:10 juju-e4d256-prod-github-runner-207 kernel: [23064.611405] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:48:10 juju-e4d256-prod-github-runner-207 kernel: [23064.612127] ? do_syscall_64+0x69/0xc0 Aug 22 11:48:10 juju-e4d256-prod-github-runner-207 kernel: [23064.612880] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:48:10 juju-e4d256-prod-github-runner-207 kernel: [23064.613580] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:48:10 juju-e4d256-prod-github-runner-207 kernel: [23064.614277] ? do_syscall_64+0x69/0xc0 Aug 22 11:48:10 juju-e4d256-prod-github-runner-207 kernel: [23064.614901] ? do_syscall_64+0x69/0xc0 Aug 22 11:48:10 juju-e4d256-prod-github-runner-207 kernel: [23064.615526] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 11:48:10 juju-e4d256-prod-github-runner-207 kernel: [23064.616244] RIP: 0033:0x7faa5d0edaff Aug 22 11:48:10 juju-e4d256-prod-github-runner-207 kernel: [23064.616873] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 11:48:10 juju-e4d256-prod-github-runner-207 kernel: [23064.618860] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 11:48:10 juju-e4d256-prod-github-runner-207 kernel: [23064.619781] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 11:48:10 juju-e4d256-prod-github-runner-207 kernel: [23064.620675] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 11:48:10 juju-e4d256-prod-github-runner-207 kernel: [23064.621574] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 11:48:10 juju-e4d256-prod-github-runner-207 kernel: [23064.622492] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 11:48:10 juju-e4d256-prod-github-runner-207 kernel: [23064.623405] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 11:48:10 juju-e4d256-prod-github-runner-207 kernel: [23064.624335] Aug 22 11:48:38 juju-e4d256-prod-github-runner-207 kernel: [23092.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 21398s! [qemu-system-x86:6715] Aug 22 11:48:38 juju-e4d256-prod-github-runner-207 kernel: [23092.543889] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 11:48:38 juju-e4d256-prod-github-runner-207 kernel: [23092.544195] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 11:48:38 juju-e4d256-prod-github-runner-207 kernel: [23092.556323] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 11:48:38 juju-e4d256-prod-github-runner-207 kernel: [23092.557614] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 11:48:38 juju-e4d256-prod-github-runner-207 kernel: [23092.558836] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:48:38 juju-e4d256-prod-github-runner-207 kernel: [23092.559910] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 11:48:38 juju-e4d256-prod-github-runner-207 kernel: [23092.562469] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 11:48:38 juju-e4d256-prod-github-runner-207 kernel: [23092.563521] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 11:48:38 juju-e4d256-prod-github-runner-207 kernel: [23092.564681] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 11:48:38 juju-e4d256-prod-github-runner-207 kernel: [23092.565835] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 11:48:38 juju-e4d256-prod-github-runner-207 kernel: [23092.566992] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 11:48:38 juju-e4d256-prod-github-runner-207 kernel: [23092.568165] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 11:48:38 juju-e4d256-prod-github-runner-207 kernel: [23092.569326] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 11:48:38 juju-e4d256-prod-github-runner-207 kernel: [23092.570576] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 11:48:38 juju-e4d256-prod-github-runner-207 kernel: [23092.571692] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 11:48:38 juju-e4d256-prod-github-runner-207 kernel: [23092.572905] Call Trace: Aug 22 11:48:38 juju-e4d256-prod-github-runner-207 kernel: [23092.573818] Aug 22 11:48:38 juju-e4d256-prod-github-runner-207 kernel: [23092.574721] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:48:38 juju-e4d256-prod-github-runner-207 kernel: [23092.575774] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:48:38 juju-e4d256-prod-github-runner-207 kernel: [23092.576801] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:48:38 juju-e4d256-prod-github-runner-207 kernel: [23092.577894] ? show_regs.part.0+0x23/0x29 Aug 22 11:48:38 juju-e4d256-prod-github-runner-207 kernel: [23092.578889] ? show_regs.cold+0x8/0xd Aug 22 11:48:38 juju-e4d256-prod-github-runner-207 kernel: [23092.579895] ? watchdog_timer_fn+0x1be/0x220 Aug 22 11:48:38 juju-e4d256-prod-github-runner-207 kernel: [23092.580908] ? lockup_detector_update_enable+0x60/0x60 Aug 22 11:48:38 juju-e4d256-prod-github-runner-207 kernel: [23092.581987] ? __hrtimer_run_queues+0x107/0x230 Aug 22 11:48:38 juju-e4d256-prod-github-runner-207 kernel: [23092.583023] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 11:48:38 juju-e4d256-prod-github-runner-207 kernel: [23092.584061] ? hrtimer_interrupt+0x101/0x220 Aug 22 11:48:38 juju-e4d256-prod-github-runner-207 kernel: [23092.585075] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 11:48:38 juju-e4d256-prod-github-runner-207 kernel: [23092.586140] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 11:48:38 juju-e4d256-prod-github-runner-207 kernel: [23092.587253] Aug 22 11:48:38 juju-e4d256-prod-github-runner-207 kernel: [23092.588130] Aug 22 11:48:38 juju-e4d256-prod-github-runner-207 kernel: [23092.588968] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 11:48:38 juju-e4d256-prod-github-runner-207 kernel: [23092.590005] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:48:38 juju-e4d256-prod-github-runner-207 kernel: [23092.591041] ? _raw_spin_lock+0x22/0x30 Aug 22 11:48:38 juju-e4d256-prod-github-runner-207 kernel: [23092.591996] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:48:38 juju-e4d256-prod-github-runner-207 kernel: [23092.593018] direct_page_fault+0x206/0x310 [kvm] Aug 22 11:48:38 juju-e4d256-prod-github-runner-207 kernel: [23092.594045] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 11:48:38 juju-e4d256-prod-github-runner-207 kernel: [23092.595053] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 11:48:38 juju-e4d256-prod-github-runner-207 kernel: [23092.596075] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 11:48:38 juju-e4d256-prod-github-runner-207 kernel: [23092.597097] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 11:48:38 juju-e4d256-prod-github-runner-207 kernel: [23092.598043] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 11:48:38 juju-e4d256-prod-github-runner-207 kernel: [23092.599034] handle_exit+0x98/0x230 [kvm_amd] Aug 22 11:48:38 juju-e4d256-prod-github-runner-207 kernel: [23092.599952] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 11:48:38 juju-e4d256-prod-github-runner-207 kernel: [23092.600862] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 11:48:38 juju-e4d256-prod-github-runner-207 kernel: [23092.601789] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 11:48:38 juju-e4d256-prod-github-runner-207 kernel: [23092.602689] vcpu_run+0x62/0x2c0 [kvm] Aug 22 11:48:38 juju-e4d256-prod-github-runner-207 kernel: [23092.603510] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 11:48:38 juju-e4d256-prod-github-runner-207 kernel: [23092.604317] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 11:48:38 juju-e4d256-prod-github-runner-207 kernel: [23092.605168] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 11:48:38 juju-e4d256-prod-github-runner-207 kernel: [23092.605998] ? __seccomp_filter+0x4a/0x4a0 Aug 22 11:48:38 juju-e4d256-prod-github-runner-207 kernel: [23092.606992] ? __fget_files+0x86/0xc0 Aug 22 11:48:38 juju-e4d256-prod-github-runner-207 kernel: [23092.607715] __x64_sys_ioctl+0x95/0xd0 Aug 22 11:48:38 juju-e4d256-prod-github-runner-207 kernel: [23092.608407] do_syscall_64+0x5c/0xc0 Aug 22 11:48:38 juju-e4d256-prod-github-runner-207 kernel: [23092.609072] ? do_futex+0x162/0x1f0 Aug 22 11:48:38 juju-e4d256-prod-github-runner-207 kernel: [23092.609720] ? __x64_sys_futex+0x78/0x1e0 Aug 22 11:48:38 juju-e4d256-prod-github-runner-207 kernel: [23092.610392] ? __secure_computing+0xa9/0x120 Aug 22 11:48:38 juju-e4d256-prod-github-runner-207 kernel: [23092.611080] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 11:48:38 juju-e4d256-prod-github-runner-207 kernel: [23092.611847] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:48:38 juju-e4d256-prod-github-runner-207 kernel: [23092.612567] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:48:38 juju-e4d256-prod-github-runner-207 kernel: [23092.613285] ? do_syscall_64+0x69/0xc0 Aug 22 11:48:38 juju-e4d256-prod-github-runner-207 kernel: [23092.613928] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:48:38 juju-e4d256-prod-github-runner-207 kernel: [23092.614629] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:48:38 juju-e4d256-prod-github-runner-207 kernel: [23092.615334] ? do_syscall_64+0x69/0xc0 Aug 22 11:48:38 juju-e4d256-prod-github-runner-207 kernel: [23092.615958] ? do_syscall_64+0x69/0xc0 Aug 22 11:48:38 juju-e4d256-prod-github-runner-207 kernel: [23092.616578] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 11:48:38 juju-e4d256-prod-github-runner-207 kernel: [23092.617319] RIP: 0033:0x7faa5d0edaff Aug 22 11:48:38 juju-e4d256-prod-github-runner-207 kernel: [23092.617979] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 11:48:38 juju-e4d256-prod-github-runner-207 kernel: [23092.619980] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 11:48:38 juju-e4d256-prod-github-runner-207 kernel: [23092.620895] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 11:48:38 juju-e4d256-prod-github-runner-207 kernel: [23092.621778] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 11:48:38 juju-e4d256-prod-github-runner-207 kernel: [23092.622660] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 11:48:38 juju-e4d256-prod-github-runner-207 kernel: [23092.623561] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 11:48:38 juju-e4d256-prod-github-runner-207 kernel: [23092.624453] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 11:48:38 juju-e4d256-prod-github-runner-207 kernel: [23092.625341] Aug 22 11:49:06 juju-e4d256-prod-github-runner-207 kernel: [23120.541976] watchdog: BUG: soft lockup - CPU#1 stuck for 21424s! [qemu-system-x86:6715] Aug 22 11:49:06 juju-e4d256-prod-github-runner-207 kernel: [23120.543124] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 11:49:06 juju-e4d256-prod-github-runner-207 kernel: [23120.543198] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 11:49:06 juju-e4d256-prod-github-runner-207 kernel: [23120.555759] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 11:49:06 juju-e4d256-prod-github-runner-207 kernel: [23120.557105] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 11:49:06 juju-e4d256-prod-github-runner-207 kernel: [23120.558335] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:49:06 juju-e4d256-prod-github-runner-207 kernel: [23120.559405] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 11:49:06 juju-e4d256-prod-github-runner-207 kernel: [23120.561950] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 11:49:06 juju-e4d256-prod-github-runner-207 kernel: [23120.563034] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 11:49:06 juju-e4d256-prod-github-runner-207 kernel: [23120.564198] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 11:49:06 juju-e4d256-prod-github-runner-207 kernel: [23120.565367] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 11:49:06 juju-e4d256-prod-github-runner-207 kernel: [23120.566577] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 11:49:06 juju-e4d256-prod-github-runner-207 kernel: [23120.567773] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 11:49:06 juju-e4d256-prod-github-runner-207 kernel: [23120.568941] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 11:49:06 juju-e4d256-prod-github-runner-207 kernel: [23120.570266] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 11:49:06 juju-e4d256-prod-github-runner-207 kernel: [23120.571387] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 11:49:06 juju-e4d256-prod-github-runner-207 kernel: [23120.572590] Call Trace: Aug 22 11:49:06 juju-e4d256-prod-github-runner-207 kernel: [23120.573509] Aug 22 11:49:06 juju-e4d256-prod-github-runner-207 kernel: [23120.574393] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:49:06 juju-e4d256-prod-github-runner-207 kernel: [23120.575501] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:49:06 juju-e4d256-prod-github-runner-207 kernel: [23120.576529] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:49:06 juju-e4d256-prod-github-runner-207 kernel: [23120.577622] ? show_regs.part.0+0x23/0x29 Aug 22 11:49:06 juju-e4d256-prod-github-runner-207 kernel: [23120.578642] ? show_regs.cold+0x8/0xd Aug 22 11:49:06 juju-e4d256-prod-github-runner-207 kernel: [23120.579632] ? watchdog_timer_fn+0x1be/0x220 Aug 22 11:49:06 juju-e4d256-prod-github-runner-207 kernel: [23120.580646] ? lockup_detector_update_enable+0x60/0x60 Aug 22 11:49:06 juju-e4d256-prod-github-runner-207 kernel: [23120.581712] ? __hrtimer_run_queues+0x107/0x230 Aug 22 11:49:06 juju-e4d256-prod-github-runner-207 kernel: [23120.582958] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 11:49:06 juju-e4d256-prod-github-runner-207 kernel: [23120.583990] ? hrtimer_interrupt+0x101/0x220 Aug 22 11:49:06 juju-e4d256-prod-github-runner-207 kernel: [23120.585020] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 11:49:06 juju-e4d256-prod-github-runner-207 kernel: [23120.586091] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 11:49:06 juju-e4d256-prod-github-runner-207 kernel: [23120.587148] Aug 22 11:49:06 juju-e4d256-prod-github-runner-207 kernel: [23120.588015] Aug 22 11:49:06 juju-e4d256-prod-github-runner-207 kernel: [23120.588859] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 11:49:06 juju-e4d256-prod-github-runner-207 kernel: [23120.589908] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:49:06 juju-e4d256-prod-github-runner-207 kernel: [23120.590968] ? _raw_spin_lock+0x22/0x30 Aug 22 11:49:06 juju-e4d256-prod-github-runner-207 kernel: [23120.591923] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:49:06 juju-e4d256-prod-github-runner-207 kernel: [23120.593076] direct_page_fault+0x206/0x310 [kvm] Aug 22 11:49:06 juju-e4d256-prod-github-runner-207 kernel: [23120.594107] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 11:49:06 juju-e4d256-prod-github-runner-207 kernel: [23120.595138] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 11:49:06 juju-e4d256-prod-github-runner-207 kernel: [23120.596138] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 11:49:06 juju-e4d256-prod-github-runner-207 kernel: [23120.597117] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 11:49:06 juju-e4d256-prod-github-runner-207 kernel: [23120.598062] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 11:49:06 juju-e4d256-prod-github-runner-207 kernel: [23120.599062] handle_exit+0x98/0x230 [kvm_amd] Aug 22 11:49:06 juju-e4d256-prod-github-runner-207 kernel: [23120.599959] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 11:49:06 juju-e4d256-prod-github-runner-207 kernel: [23120.600873] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 11:49:06 juju-e4d256-prod-github-runner-207 kernel: [23120.601795] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 11:49:06 juju-e4d256-prod-github-runner-207 kernel: [23120.602698] vcpu_run+0x62/0x2c0 [kvm] Aug 22 11:49:06 juju-e4d256-prod-github-runner-207 kernel: [23120.603525] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 11:49:06 juju-e4d256-prod-github-runner-207 kernel: [23120.604333] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 11:49:06 juju-e4d256-prod-github-runner-207 kernel: [23120.605187] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 11:49:06 juju-e4d256-prod-github-runner-207 kernel: [23120.605986] ? __seccomp_filter+0x4a/0x4a0 Aug 22 11:49:06 juju-e4d256-prod-github-runner-207 kernel: [23120.606729] ? __fget_files+0x86/0xc0 Aug 22 11:49:06 juju-e4d256-prod-github-runner-207 kernel: [23120.607444] __x64_sys_ioctl+0x95/0xd0 Aug 22 11:49:06 juju-e4d256-prod-github-runner-207 kernel: [23120.608141] do_syscall_64+0x5c/0xc0 Aug 22 11:49:06 juju-e4d256-prod-github-runner-207 kernel: [23120.608805] ? do_futex+0x162/0x1f0 Aug 22 11:49:06 juju-e4d256-prod-github-runner-207 kernel: [23120.609452] ? __x64_sys_futex+0x78/0x1e0 Aug 22 11:49:06 juju-e4d256-prod-github-runner-207 kernel: [23120.610124] ? __secure_computing+0xa9/0x120 Aug 22 11:49:06 juju-e4d256-prod-github-runner-207 kernel: [23120.610817] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 11:49:06 juju-e4d256-prod-github-runner-207 kernel: [23120.611589] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:49:06 juju-e4d256-prod-github-runner-207 kernel: [23120.612308] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:49:06 juju-e4d256-prod-github-runner-207 kernel: [23120.613031] ? do_syscall_64+0x69/0xc0 Aug 22 11:49:06 juju-e4d256-prod-github-runner-207 kernel: [23120.613675] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:49:06 juju-e4d256-prod-github-runner-207 kernel: [23120.614416] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:49:06 juju-e4d256-prod-github-runner-207 kernel: [23120.615131] ? do_syscall_64+0x69/0xc0 Aug 22 11:49:06 juju-e4d256-prod-github-runner-207 kernel: [23120.615824] ? do_syscall_64+0x69/0xc0 Aug 22 11:49:06 juju-e4d256-prod-github-runner-207 kernel: [23120.616558] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 11:49:06 juju-e4d256-prod-github-runner-207 kernel: [23120.617276] RIP: 0033:0x7faa5d0edaff Aug 22 11:49:06 juju-e4d256-prod-github-runner-207 kernel: [23120.617968] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 11:49:06 juju-e4d256-prod-github-runner-207 kernel: [23120.620029] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 11:49:06 juju-e4d256-prod-github-runner-207 kernel: [23120.620936] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 11:49:06 juju-e4d256-prod-github-runner-207 kernel: [23120.621821] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 11:49:06 juju-e4d256-prod-github-runner-207 kernel: [23120.622721] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 11:49:06 juju-e4d256-prod-github-runner-207 kernel: [23120.623633] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 11:49:06 juju-e4d256-prod-github-runner-207 kernel: [23120.624519] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 11:49:06 juju-e4d256-prod-github-runner-207 kernel: [23120.625407] Aug 22 11:49:34 juju-e4d256-prod-github-runner-207 kernel: [23148.541981] watchdog: BUG: soft lockup - CPU#1 stuck for 21450s! [qemu-system-x86:6715] Aug 22 11:49:34 juju-e4d256-prod-github-runner-207 kernel: [23148.543434] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 11:49:34 juju-e4d256-prod-github-runner-207 kernel: [23148.543515] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 11:49:34 juju-e4d256-prod-github-runner-207 kernel: [23148.555783] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 11:49:34 juju-e4d256-prod-github-runner-207 kernel: [23148.557072] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 11:49:34 juju-e4d256-prod-github-runner-207 kernel: [23148.558309] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:49:34 juju-e4d256-prod-github-runner-207 kernel: [23148.559396] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 11:49:34 juju-e4d256-prod-github-runner-207 kernel: [23148.561956] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 11:49:34 juju-e4d256-prod-github-runner-207 kernel: [23148.563016] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 11:49:34 juju-e4d256-prod-github-runner-207 kernel: [23148.564228] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 11:49:34 juju-e4d256-prod-github-runner-207 kernel: [23148.565424] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 11:49:34 juju-e4d256-prod-github-runner-207 kernel: [23148.566610] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 11:49:34 juju-e4d256-prod-github-runner-207 kernel: [23148.567781] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 11:49:34 juju-e4d256-prod-github-runner-207 kernel: [23148.568948] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 11:49:34 juju-e4d256-prod-github-runner-207 kernel: [23148.570188] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 11:49:34 juju-e4d256-prod-github-runner-207 kernel: [23148.571314] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 11:49:34 juju-e4d256-prod-github-runner-207 kernel: [23148.572617] Call Trace: Aug 22 11:49:34 juju-e4d256-prod-github-runner-207 kernel: [23148.573604] Aug 22 11:49:34 juju-e4d256-prod-github-runner-207 kernel: [23148.574518] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:49:34 juju-e4d256-prod-github-runner-207 kernel: [23148.575590] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:49:34 juju-e4d256-prod-github-runner-207 kernel: [23148.576631] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:49:34 juju-e4d256-prod-github-runner-207 kernel: [23148.577708] ? show_regs.part.0+0x23/0x29 Aug 22 11:49:34 juju-e4d256-prod-github-runner-207 kernel: [23148.578724] ? show_regs.cold+0x8/0xd Aug 22 11:49:34 juju-e4d256-prod-github-runner-207 kernel: [23148.579704] ? watchdog_timer_fn+0x1be/0x220 Aug 22 11:49:34 juju-e4d256-prod-github-runner-207 kernel: [23148.580714] ? lockup_detector_update_enable+0x60/0x60 Aug 22 11:49:34 juju-e4d256-prod-github-runner-207 kernel: [23148.581796] ? __hrtimer_run_queues+0x107/0x230 Aug 22 11:49:34 juju-e4d256-prod-github-runner-207 kernel: [23148.582850] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 11:49:34 juju-e4d256-prod-github-runner-207 kernel: [23148.583873] ? hrtimer_interrupt+0x101/0x220 Aug 22 11:49:34 juju-e4d256-prod-github-runner-207 kernel: [23148.584900] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 11:49:34 juju-e4d256-prod-github-runner-207 kernel: [23148.586003] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 11:49:34 juju-e4d256-prod-github-runner-207 kernel: [23148.587152] Aug 22 11:49:34 juju-e4d256-prod-github-runner-207 kernel: [23148.588300] Aug 22 11:49:34 juju-e4d256-prod-github-runner-207 kernel: [23148.589371] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 11:49:34 juju-e4d256-prod-github-runner-207 kernel: [23148.590702] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:49:34 juju-e4d256-prod-github-runner-207 kernel: [23148.592023] ? _raw_spin_lock+0x22/0x30 Aug 22 11:49:34 juju-e4d256-prod-github-runner-207 kernel: [23148.593220] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:49:34 juju-e4d256-prod-github-runner-207 kernel: [23148.594533] direct_page_fault+0x206/0x310 [kvm] Aug 22 11:49:34 juju-e4d256-prod-github-runner-207 kernel: [23148.595860] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 11:49:34 juju-e4d256-prod-github-runner-207 kernel: [23148.597168] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 11:49:34 juju-e4d256-prod-github-runner-207 kernel: [23148.598444] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 11:49:34 juju-e4d256-prod-github-runner-207 kernel: [23148.599694] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 11:49:34 juju-e4d256-prod-github-runner-207 kernel: [23148.600899] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 11:49:34 juju-e4d256-prod-github-runner-207 kernel: [23148.602182] handle_exit+0x98/0x230 [kvm_amd] Aug 22 11:49:34 juju-e4d256-prod-github-runner-207 kernel: [23148.603445] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 11:49:34 juju-e4d256-prod-github-runner-207 kernel: [23148.604737] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 11:49:34 juju-e4d256-prod-github-runner-207 kernel: [23148.605981] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 11:49:34 juju-e4d256-prod-github-runner-207 kernel: [23148.606932] vcpu_run+0x62/0x2c0 [kvm] Aug 22 11:49:34 juju-e4d256-prod-github-runner-207 kernel: [23148.607759] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 11:49:34 juju-e4d256-prod-github-runner-207 kernel: [23148.608579] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 11:49:34 juju-e4d256-prod-github-runner-207 kernel: [23148.609436] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 11:49:34 juju-e4d256-prod-github-runner-207 kernel: [23148.610244] ? __seccomp_filter+0x4a/0x4a0 Aug 22 11:49:34 juju-e4d256-prod-github-runner-207 kernel: [23148.611007] ? __fget_files+0x86/0xc0 Aug 22 11:49:34 juju-e4d256-prod-github-runner-207 kernel: [23148.611717] __x64_sys_ioctl+0x95/0xd0 Aug 22 11:49:34 juju-e4d256-prod-github-runner-207 kernel: [23148.612417] do_syscall_64+0x5c/0xc0 Aug 22 11:49:34 juju-e4d256-prod-github-runner-207 kernel: [23148.613092] ? do_futex+0x162/0x1f0 Aug 22 11:49:34 juju-e4d256-prod-github-runner-207 kernel: [23148.613745] ? __x64_sys_futex+0x78/0x1e0 Aug 22 11:49:34 juju-e4d256-prod-github-runner-207 kernel: [23148.614476] ? __secure_computing+0xa9/0x120 Aug 22 11:49:34 juju-e4d256-prod-github-runner-207 kernel: [23148.615213] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 11:49:34 juju-e4d256-prod-github-runner-207 kernel: [23148.616012] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:49:34 juju-e4d256-prod-github-runner-207 kernel: [23148.616743] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:49:34 juju-e4d256-prod-github-runner-207 kernel: [23148.617460] ? do_syscall_64+0x69/0xc0 Aug 22 11:49:34 juju-e4d256-prod-github-runner-207 kernel: [23148.618104] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:49:34 juju-e4d256-prod-github-runner-207 kernel: [23148.618820] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:49:34 juju-e4d256-prod-github-runner-207 kernel: [23148.619515] ? do_syscall_64+0x69/0xc0 Aug 22 11:49:34 juju-e4d256-prod-github-runner-207 kernel: [23148.620149] ? do_syscall_64+0x69/0xc0 Aug 22 11:49:34 juju-e4d256-prod-github-runner-207 kernel: [23148.620773] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 11:49:34 juju-e4d256-prod-github-runner-207 kernel: [23148.621483] RIP: 0033:0x7faa5d0edaff Aug 22 11:49:34 juju-e4d256-prod-github-runner-207 kernel: [23148.622108] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 11:49:34 juju-e4d256-prod-github-runner-207 kernel: [23148.624146] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 11:49:34 juju-e4d256-prod-github-runner-207 kernel: [23148.625067] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 11:49:34 juju-e4d256-prod-github-runner-207 kernel: [23148.626203] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 11:49:34 juju-e4d256-prod-github-runner-207 kernel: [23148.627168] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 11:49:34 juju-e4d256-prod-github-runner-207 kernel: [23148.628070] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 11:49:34 juju-e4d256-prod-github-runner-207 kernel: [23148.628962] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 11:49:34 juju-e4d256-prod-github-runner-207 kernel: [23148.629862] Aug 22 11:50:02 juju-e4d256-prod-github-runner-207 kernel: [23176.542501] watchdog: BUG: soft lockup - CPU#1 stuck for 21476s! [qemu-system-x86:6715] Aug 22 11:50:02 juju-e4d256-prod-github-runner-207 kernel: [23176.544922] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 11:50:02 juju-e4d256-prod-github-runner-207 kernel: [23176.545209] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 11:50:02 juju-e4d256-prod-github-runner-207 kernel: [23176.557368] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 11:50:02 juju-e4d256-prod-github-runner-207 kernel: [23176.558846] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 11:50:02 juju-e4d256-prod-github-runner-207 kernel: [23176.560257] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:50:02 juju-e4d256-prod-github-runner-207 kernel: [23176.561367] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 11:50:02 juju-e4d256-prod-github-runner-207 kernel: [23176.563939] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 11:50:02 juju-e4d256-prod-github-runner-207 kernel: [23176.565040] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 11:50:02 juju-e4d256-prod-github-runner-207 kernel: [23176.566209] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 11:50:02 juju-e4d256-prod-github-runner-207 kernel: [23176.567385] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 11:50:02 juju-e4d256-prod-github-runner-207 kernel: [23176.568546] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 11:50:02 juju-e4d256-prod-github-runner-207 kernel: [23176.569705] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 11:50:02 juju-e4d256-prod-github-runner-207 kernel: [23176.570947] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 11:50:02 juju-e4d256-prod-github-runner-207 kernel: [23176.572192] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 11:50:02 juju-e4d256-prod-github-runner-207 kernel: [23176.573290] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 11:50:02 juju-e4d256-prod-github-runner-207 kernel: [23176.574556] Call Trace: Aug 22 11:50:02 juju-e4d256-prod-github-runner-207 kernel: [23176.575485] Aug 22 11:50:02 juju-e4d256-prod-github-runner-207 kernel: [23176.576391] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:50:02 juju-e4d256-prod-github-runner-207 kernel: [23176.577427] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:50:02 juju-e4d256-prod-github-runner-207 kernel: [23176.578467] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:50:02 juju-e4d256-prod-github-runner-207 kernel: [23176.579571] ? show_regs.part.0+0x23/0x29 Aug 22 11:50:02 juju-e4d256-prod-github-runner-207 kernel: [23176.580574] ? show_regs.cold+0x8/0xd Aug 22 11:50:02 juju-e4d256-prod-github-runner-207 kernel: [23176.581575] ? watchdog_timer_fn+0x1be/0x220 Aug 22 11:50:02 juju-e4d256-prod-github-runner-207 kernel: [23176.582623] ? lockup_detector_update_enable+0x60/0x60 Aug 22 11:50:02 juju-e4d256-prod-github-runner-207 kernel: [23176.583687] ? __hrtimer_run_queues+0x107/0x230 Aug 22 11:50:02 juju-e4d256-prod-github-runner-207 kernel: [23176.584721] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 11:50:02 juju-e4d256-prod-github-runner-207 kernel: [23176.585746] ? hrtimer_interrupt+0x101/0x220 Aug 22 11:50:02 juju-e4d256-prod-github-runner-207 kernel: [23176.586790] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 11:50:02 juju-e4d256-prod-github-runner-207 kernel: [23176.587859] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 11:50:02 juju-e4d256-prod-github-runner-207 kernel: [23176.588909] Aug 22 11:50:02 juju-e4d256-prod-github-runner-207 kernel: [23176.589762] Aug 22 11:50:02 juju-e4d256-prod-github-runner-207 kernel: [23176.590611] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 11:50:02 juju-e4d256-prod-github-runner-207 kernel: [23176.591652] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:50:02 juju-e4d256-prod-github-runner-207 kernel: [23176.592690] ? _raw_spin_lock+0x22/0x30 Aug 22 11:50:02 juju-e4d256-prod-github-runner-207 kernel: [23176.593641] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:50:02 juju-e4d256-prod-github-runner-207 kernel: [23176.594670] direct_page_fault+0x206/0x310 [kvm] Aug 22 11:50:02 juju-e4d256-prod-github-runner-207 kernel: [23176.595704] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 11:50:02 juju-e4d256-prod-github-runner-207 kernel: [23176.596728] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 11:50:02 juju-e4d256-prod-github-runner-207 kernel: [23176.597753] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 11:50:02 juju-e4d256-prod-github-runner-207 kernel: [23176.598799] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 11:50:02 juju-e4d256-prod-github-runner-207 kernel: [23176.599749] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 11:50:02 juju-e4d256-prod-github-runner-207 kernel: [23176.600731] handle_exit+0x98/0x230 [kvm_amd] Aug 22 11:50:02 juju-e4d256-prod-github-runner-207 kernel: [23176.601660] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 11:50:02 juju-e4d256-prod-github-runner-207 kernel: [23176.602603] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 11:50:02 juju-e4d256-prod-github-runner-207 kernel: [23176.603543] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 11:50:02 juju-e4d256-prod-github-runner-207 kernel: [23176.604451] vcpu_run+0x62/0x2c0 [kvm] Aug 22 11:50:02 juju-e4d256-prod-github-runner-207 kernel: [23176.605264] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 11:50:02 juju-e4d256-prod-github-runner-207 kernel: [23176.606077] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 11:50:02 juju-e4d256-prod-github-runner-207 kernel: [23176.606961] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 11:50:02 juju-e4d256-prod-github-runner-207 kernel: [23176.607761] ? __seccomp_filter+0x4a/0x4a0 Aug 22 11:50:02 juju-e4d256-prod-github-runner-207 kernel: [23176.608508] ? __fget_files+0x86/0xc0 Aug 22 11:50:02 juju-e4d256-prod-github-runner-207 kernel: [23176.609211] __x64_sys_ioctl+0x95/0xd0 Aug 22 11:50:02 juju-e4d256-prod-github-runner-207 kernel: [23176.609902] do_syscall_64+0x5c/0xc0 Aug 22 11:50:02 juju-e4d256-prod-github-runner-207 kernel: [23176.610626] ? do_futex+0x162/0x1f0 Aug 22 11:50:02 juju-e4d256-prod-github-runner-207 kernel: [23176.611296] ? __x64_sys_futex+0x78/0x1e0 Aug 22 11:50:02 juju-e4d256-prod-github-runner-207 kernel: [23176.612046] ? __secure_computing+0xa9/0x120 Aug 22 11:50:02 juju-e4d256-prod-github-runner-207 kernel: [23176.612771] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 11:50:02 juju-e4d256-prod-github-runner-207 kernel: [23176.613547] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:50:02 juju-e4d256-prod-github-runner-207 kernel: [23176.614287] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:50:02 juju-e4d256-prod-github-runner-207 kernel: [23176.615008] ? do_syscall_64+0x69/0xc0 Aug 22 11:50:02 juju-e4d256-prod-github-runner-207 kernel: [23176.615661] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:50:02 juju-e4d256-prod-github-runner-207 kernel: [23176.616384] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:50:02 juju-e4d256-prod-github-runner-207 kernel: [23176.617121] ? do_syscall_64+0x69/0xc0 Aug 22 11:50:02 juju-e4d256-prod-github-runner-207 kernel: [23176.617765] ? do_syscall_64+0x69/0xc0 Aug 22 11:50:02 juju-e4d256-prod-github-runner-207 kernel: [23176.618407] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 11:50:02 juju-e4d256-prod-github-runner-207 kernel: [23176.619117] RIP: 0033:0x7faa5d0edaff Aug 22 11:50:02 juju-e4d256-prod-github-runner-207 kernel: [23176.619776] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 11:50:02 juju-e4d256-prod-github-runner-207 kernel: [23176.621824] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 11:50:02 juju-e4d256-prod-github-runner-207 kernel: [23176.622795] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 11:50:02 juju-e4d256-prod-github-runner-207 kernel: [23176.623705] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 11:50:02 juju-e4d256-prod-github-runner-207 kernel: [23176.624602] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 11:50:02 juju-e4d256-prod-github-runner-207 kernel: [23176.625518] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 11:50:02 juju-e4d256-prod-github-runner-207 kernel: [23176.626431] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 11:50:02 juju-e4d256-prod-github-runner-207 kernel: [23176.627326] Aug 22 11:50:30 juju-e4d256-prod-github-runner-207 kernel: [23204.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 21502s! [qemu-system-x86:6715] Aug 22 11:50:30 juju-e4d256-prod-github-runner-207 kernel: [23204.543115] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 11:50:30 juju-e4d256-prod-github-runner-207 kernel: [23204.543189] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 11:50:30 juju-e4d256-prod-github-runner-207 kernel: [23204.555546] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 11:50:30 juju-e4d256-prod-github-runner-207 kernel: [23204.556832] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 11:50:30 juju-e4d256-prod-github-runner-207 kernel: [23204.558087] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:50:30 juju-e4d256-prod-github-runner-207 kernel: [23204.559160] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 11:50:30 juju-e4d256-prod-github-runner-207 kernel: [23204.561745] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 11:50:30 juju-e4d256-prod-github-runner-207 kernel: [23204.562812] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 11:50:30 juju-e4d256-prod-github-runner-207 kernel: [23204.563989] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 11:50:30 juju-e4d256-prod-github-runner-207 kernel: [23204.565164] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 11:50:30 juju-e4d256-prod-github-runner-207 kernel: [23204.566352] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 11:50:30 juju-e4d256-prod-github-runner-207 kernel: [23204.567545] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 11:50:30 juju-e4d256-prod-github-runner-207 kernel: [23204.568732] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 11:50:30 juju-e4d256-prod-github-runner-207 kernel: [23204.570049] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 11:50:30 juju-e4d256-prod-github-runner-207 kernel: [23204.571164] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 11:50:30 juju-e4d256-prod-github-runner-207 kernel: [23204.572373] Call Trace: Aug 22 11:50:30 juju-e4d256-prod-github-runner-207 kernel: [23204.573289] Aug 22 11:50:30 juju-e4d256-prod-github-runner-207 kernel: [23204.574196] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:50:30 juju-e4d256-prod-github-runner-207 kernel: [23204.575237] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:50:30 juju-e4d256-prod-github-runner-207 kernel: [23204.576270] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:50:30 juju-e4d256-prod-github-runner-207 kernel: [23204.577357] ? show_regs.part.0+0x23/0x29 Aug 22 11:50:30 juju-e4d256-prod-github-runner-207 kernel: [23204.578385] ? show_regs.cold+0x8/0xd Aug 22 11:50:30 juju-e4d256-prod-github-runner-207 kernel: [23204.579371] ? watchdog_timer_fn+0x1be/0x220 Aug 22 11:50:30 juju-e4d256-prod-github-runner-207 kernel: [23204.580390] ? lockup_detector_update_enable+0x60/0x60 Aug 22 11:50:30 juju-e4d256-prod-github-runner-207 kernel: [23204.581499] ? __hrtimer_run_queues+0x107/0x230 Aug 22 11:50:30 juju-e4d256-prod-github-runner-207 kernel: [23204.582559] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 11:50:30 juju-e4d256-prod-github-runner-207 kernel: [23204.583608] ? hrtimer_interrupt+0x101/0x220 Aug 22 11:50:30 juju-e4d256-prod-github-runner-207 kernel: [23204.584640] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 11:50:30 juju-e4d256-prod-github-runner-207 kernel: [23204.585720] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 11:50:30 juju-e4d256-prod-github-runner-207 kernel: [23204.586784] Aug 22 11:50:30 juju-e4d256-prod-github-runner-207 kernel: [23204.587642] Aug 22 11:50:30 juju-e4d256-prod-github-runner-207 kernel: [23204.588482] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 11:50:30 juju-e4d256-prod-github-runner-207 kernel: [23204.589523] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:50:30 juju-e4d256-prod-github-runner-207 kernel: [23204.590690] ? _raw_spin_lock+0x22/0x30 Aug 22 11:50:30 juju-e4d256-prod-github-runner-207 kernel: [23204.591645] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:50:30 juju-e4d256-prod-github-runner-207 kernel: [23204.592664] direct_page_fault+0x206/0x310 [kvm] Aug 22 11:50:30 juju-e4d256-prod-github-runner-207 kernel: [23204.593693] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 11:50:30 juju-e4d256-prod-github-runner-207 kernel: [23204.594727] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 11:50:30 juju-e4d256-prod-github-runner-207 kernel: [23204.595728] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 11:50:30 juju-e4d256-prod-github-runner-207 kernel: [23204.596842] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 11:50:30 juju-e4d256-prod-github-runner-207 kernel: [23204.597797] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 11:50:30 juju-e4d256-prod-github-runner-207 kernel: [23204.598800] handle_exit+0x98/0x230 [kvm_amd] Aug 22 11:50:30 juju-e4d256-prod-github-runner-207 kernel: [23204.599723] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 11:50:30 juju-e4d256-prod-github-runner-207 kernel: [23204.600655] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 11:50:30 juju-e4d256-prod-github-runner-207 kernel: [23204.601594] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 11:50:30 juju-e4d256-prod-github-runner-207 kernel: [23204.602512] vcpu_run+0x62/0x2c0 [kvm] Aug 22 11:50:30 juju-e4d256-prod-github-runner-207 kernel: [23204.603335] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 11:50:30 juju-e4d256-prod-github-runner-207 kernel: [23204.604145] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 11:50:30 juju-e4d256-prod-github-runner-207 kernel: [23204.605001] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 11:50:30 juju-e4d256-prod-github-runner-207 kernel: [23204.605804] ? __seccomp_filter+0x4a/0x4a0 Aug 22 11:50:30 juju-e4d256-prod-github-runner-207 kernel: [23204.606561] ? __fget_files+0x86/0xc0 Aug 22 11:50:30 juju-e4d256-prod-github-runner-207 kernel: [23204.607271] __x64_sys_ioctl+0x95/0xd0 Aug 22 11:50:30 juju-e4d256-prod-github-runner-207 kernel: [23204.607966] do_syscall_64+0x5c/0xc0 Aug 22 11:50:30 juju-e4d256-prod-github-runner-207 kernel: [23204.608630] ? do_futex+0x162/0x1f0 Aug 22 11:50:30 juju-e4d256-prod-github-runner-207 kernel: [23204.609279] ? __x64_sys_futex+0x78/0x1e0 Aug 22 11:50:30 juju-e4d256-prod-github-runner-207 kernel: [23204.609965] ? __secure_computing+0xa9/0x120 Aug 22 11:50:30 juju-e4d256-prod-github-runner-207 kernel: [23204.610655] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 11:50:30 juju-e4d256-prod-github-runner-207 kernel: [23204.611415] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:50:30 juju-e4d256-prod-github-runner-207 kernel: [23204.612136] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:50:30 juju-e4d256-prod-github-runner-207 kernel: [23204.612853] ? do_syscall_64+0x69/0xc0 Aug 22 11:50:30 juju-e4d256-prod-github-runner-207 kernel: [23204.613496] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:50:30 juju-e4d256-prod-github-runner-207 kernel: [23204.614212] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:50:30 juju-e4d256-prod-github-runner-207 kernel: [23204.614913] ? do_syscall_64+0x69/0xc0 Aug 22 11:50:30 juju-e4d256-prod-github-runner-207 kernel: [23204.615537] ? do_syscall_64+0x69/0xc0 Aug 22 11:50:30 juju-e4d256-prod-github-runner-207 kernel: [23204.616161] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 11:50:30 juju-e4d256-prod-github-runner-207 kernel: [23204.616988] RIP: 0033:0x7faa5d0edaff Aug 22 11:50:30 juju-e4d256-prod-github-runner-207 kernel: [23204.617903] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 11:50:30 juju-e4d256-prod-github-runner-207 kernel: [23204.620642] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 11:50:30 juju-e4d256-prod-github-runner-207 kernel: [23204.621584] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 11:50:30 juju-e4d256-prod-github-runner-207 kernel: [23204.622500] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 11:50:30 juju-e4d256-prod-github-runner-207 kernel: [23204.623412] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 11:50:30 juju-e4d256-prod-github-runner-207 kernel: [23204.624311] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 11:50:30 juju-e4d256-prod-github-runner-207 kernel: [23204.625212] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 11:50:30 juju-e4d256-prod-github-runner-207 kernel: [23204.626128] Aug 22 11:50:44 juju-e4d256-prod-github-runner-207 kernel: [23218.736705] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 11:50:44 juju-e4d256-prod-github-runner-207 kernel: [23218.737678] rcu: 1-....: (5757369 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=2787245 Aug 22 11:50:44 juju-e4d256-prod-github-runner-207 kernel: [23218.738828] (t=5775384 jiffies g=23269 q=28414) Aug 22 11:50:44 juju-e4d256-prod-github-runner-207 kernel: [23218.739615] NMI backtrace for cpu 1 Aug 22 11:50:44 juju-e4d256-prod-github-runner-207 kernel: [23218.740322] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 11:50:44 juju-e4d256-prod-github-runner-207 kernel: [23218.741423] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 11:50:44 juju-e4d256-prod-github-runner-207 kernel: [23218.742489] Call Trace: Aug 22 11:50:44 juju-e4d256-prod-github-runner-207 kernel: [23218.743163] Aug 22 11:50:44 juju-e4d256-prod-github-runner-207 kernel: [23218.743807] show_stack+0x52/0x5c Aug 22 11:50:44 juju-e4d256-prod-github-runner-207 kernel: [23218.744534] dump_stack_lvl+0x4a/0x63 Aug 22 11:50:44 juju-e4d256-prod-github-runner-207 kernel: [23218.745279] dump_stack+0x10/0x16 Aug 22 11:50:44 juju-e4d256-prod-github-runner-207 kernel: [23218.746010] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 11:50:44 juju-e4d256-prod-github-runner-207 kernel: [23218.746789] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 11:50:44 juju-e4d256-prod-github-runner-207 kernel: [23218.747567] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 11:50:44 juju-e4d256-prod-github-runner-207 kernel: [23218.748386] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 11:50:44 juju-e4d256-prod-github-runner-207 kernel: [23218.749204] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 11:50:44 juju-e4d256-prod-github-runner-207 kernel: [23218.750022] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 11:50:44 juju-e4d256-prod-github-runner-207 kernel: [23218.750793] print_cpu_stall.cold+0x2f/0xe2 Aug 22 11:50:44 juju-e4d256-prod-github-runner-207 kernel: [23218.751556] ? timekeeping_update+0xf7/0x150 Aug 22 11:50:44 juju-e4d256-prod-github-runner-207 kernel: [23218.752326] check_cpu_stall+0x109/0x270 Aug 22 11:50:44 juju-e4d256-prod-github-runner-207 kernel: [23218.753076] rcu_sched_clock_irq+0x9a/0x250 Aug 22 11:50:44 juju-e4d256-prod-github-runner-207 kernel: [23218.753851] update_process_times+0x94/0xd0 Aug 22 11:50:44 juju-e4d256-prod-github-runner-207 kernel: [23218.754611] tick_sched_handle+0x29/0x70 Aug 22 11:50:44 juju-e4d256-prod-github-runner-207 kernel: [23218.755354] tick_sched_timer+0x8c/0xc0 Aug 22 11:50:44 juju-e4d256-prod-github-runner-207 kernel: [23218.756094] ? tick_nohz_handler+0xb0/0xb0 Aug 22 11:50:44 juju-e4d256-prod-github-runner-207 kernel: [23218.756846] __hrtimer_run_queues+0x107/0x230 Aug 22 11:50:44 juju-e4d256-prod-github-runner-207 kernel: [23218.757615] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 11:50:44 juju-e4d256-prod-github-runner-207 kernel: [23218.758397] hrtimer_interrupt+0x101/0x220 Aug 22 11:50:44 juju-e4d256-prod-github-runner-207 kernel: [23218.759153] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 11:50:44 juju-e4d256-prod-github-runner-207 kernel: [23218.759967] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 11:50:44 juju-e4d256-prod-github-runner-207 kernel: [23218.760771] Aug 22 11:50:44 juju-e4d256-prod-github-runner-207 kernel: [23218.761484] Aug 22 11:50:44 juju-e4d256-prod-github-runner-207 kernel: [23218.762172] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 11:50:44 juju-e4d256-prod-github-runner-207 kernel: [23218.763104] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:50:44 juju-e4d256-prod-github-runner-207 kernel: [23218.764093] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 11:50:44 juju-e4d256-prod-github-runner-207 kernel: [23218.766789] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 11:50:44 juju-e4d256-prod-github-runner-207 kernel: [23218.767776] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 11:50:44 juju-e4d256-prod-github-runner-207 kernel: [23218.768910] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 11:50:44 juju-e4d256-prod-github-runner-207 kernel: [23218.770042] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 11:50:44 juju-e4d256-prod-github-runner-207 kernel: [23218.771137] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 11:50:44 juju-e4d256-prod-github-runner-207 kernel: [23218.772224] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 11:50:44 juju-e4d256-prod-github-runner-207 kernel: [23218.773309] ? _raw_spin_lock+0x22/0x30 Aug 22 11:50:44 juju-e4d256-prod-github-runner-207 kernel: [23218.774169] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:50:44 juju-e4d256-prod-github-runner-207 kernel: [23218.775099] direct_page_fault+0x206/0x310 [kvm] Aug 22 11:50:44 juju-e4d256-prod-github-runner-207 kernel: [23218.776031] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 11:50:44 juju-e4d256-prod-github-runner-207 kernel: [23218.777002] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 11:50:44 juju-e4d256-prod-github-runner-207 kernel: [23218.777952] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 11:50:44 juju-e4d256-prod-github-runner-207 kernel: [23218.778991] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 11:50:44 juju-e4d256-prod-github-runner-207 kernel: [23218.779865] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 11:50:44 juju-e4d256-prod-github-runner-207 kernel: [23218.780809] handle_exit+0x98/0x230 [kvm_amd] Aug 22 11:50:44 juju-e4d256-prod-github-runner-207 kernel: [23218.781654] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 11:50:44 juju-e4d256-prod-github-runner-207 kernel: [23218.782542] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 11:50:44 juju-e4d256-prod-github-runner-207 kernel: [23218.783436] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 11:50:44 juju-e4d256-prod-github-runner-207 kernel: [23218.784327] vcpu_run+0x62/0x2c0 [kvm] Aug 22 11:50:44 juju-e4d256-prod-github-runner-207 kernel: [23218.785115] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 11:50:44 juju-e4d256-prod-github-runner-207 kernel: [23218.785957] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 11:50:44 juju-e4d256-prod-github-runner-207 kernel: [23218.786862] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 11:50:44 juju-e4d256-prod-github-runner-207 kernel: [23218.787708] ? __seccomp_filter+0x4a/0x4a0 Aug 22 11:50:44 juju-e4d256-prod-github-runner-207 kernel: [23218.788509] ? __fget_files+0x86/0xc0 Aug 22 11:50:44 juju-e4d256-prod-github-runner-207 kernel: [23218.789283] __x64_sys_ioctl+0x95/0xd0 Aug 22 11:50:44 juju-e4d256-prod-github-runner-207 kernel: [23218.790070] do_syscall_64+0x5c/0xc0 Aug 22 11:50:44 juju-e4d256-prod-github-runner-207 kernel: [23218.790828] ? do_futex+0x162/0x1f0 Aug 22 11:50:44 juju-e4d256-prod-github-runner-207 kernel: [23218.791567] ? __x64_sys_futex+0x78/0x1e0 Aug 22 11:50:44 juju-e4d256-prod-github-runner-207 kernel: [23218.792351] ? __secure_computing+0xa9/0x120 Aug 22 11:50:44 juju-e4d256-prod-github-runner-207 kernel: [23218.793156] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 11:50:44 juju-e4d256-prod-github-runner-207 kernel: [23218.794090] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:50:44 juju-e4d256-prod-github-runner-207 kernel: [23218.794943] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:50:44 juju-e4d256-prod-github-runner-207 kernel: [23218.795789] ? do_syscall_64+0x69/0xc0 Aug 22 11:50:44 juju-e4d256-prod-github-runner-207 kernel: [23218.796556] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:50:44 juju-e4d256-prod-github-runner-207 kernel: [23218.797414] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:50:44 juju-e4d256-prod-github-runner-207 kernel: [23218.798330] ? do_syscall_64+0x69/0xc0 Aug 22 11:50:44 juju-e4d256-prod-github-runner-207 kernel: [23218.799104] ? do_syscall_64+0x69/0xc0 Aug 22 11:50:44 juju-e4d256-prod-github-runner-207 kernel: [23218.799866] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 11:50:44 juju-e4d256-prod-github-runner-207 kernel: [23218.800731] RIP: 0033:0x7faa5d0edaff Aug 22 11:50:44 juju-e4d256-prod-github-runner-207 kernel: [23218.801485] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 11:50:44 juju-e4d256-prod-github-runner-207 kernel: [23218.803943] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 11:50:44 juju-e4d256-prod-github-runner-207 kernel: [23218.805048] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 11:50:44 juju-e4d256-prod-github-runner-207 kernel: [23218.806146] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 11:50:44 juju-e4d256-prod-github-runner-207 kernel: [23218.807235] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 11:50:44 juju-e4d256-prod-github-runner-207 kernel: [23218.808313] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 11:50:44 juju-e4d256-prod-github-runner-207 kernel: [23218.809377] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 11:50:44 juju-e4d256-prod-github-runner-207 kernel: [23218.810446] Aug 22 11:51:10 juju-e4d256-prod-github-runner-207 kernel: [23244.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 21540s! [qemu-system-x86:6715] Aug 22 11:51:10 juju-e4d256-prod-github-runner-207 kernel: [23244.543307] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 11:51:10 juju-e4d256-prod-github-runner-207 kernel: [23244.543380] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 11:51:10 juju-e4d256-prod-github-runner-207 kernel: [23244.557356] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 11:51:10 juju-e4d256-prod-github-runner-207 kernel: [23244.558828] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 11:51:10 juju-e4d256-prod-github-runner-207 kernel: [23244.560225] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:51:10 juju-e4d256-prod-github-runner-207 kernel: [23244.561403] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 11:51:10 juju-e4d256-prod-github-runner-207 kernel: [23244.564495] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 11:51:10 juju-e4d256-prod-github-runner-207 kernel: [23244.565666] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 11:51:10 juju-e4d256-prod-github-runner-207 kernel: [23244.566990] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 11:51:10 juju-e4d256-prod-github-runner-207 kernel: [23244.568291] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 11:51:10 juju-e4d256-prod-github-runner-207 kernel: [23244.569599] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 11:51:10 juju-e4d256-prod-github-runner-207 kernel: [23244.570908] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 11:51:10 juju-e4d256-prod-github-runner-207 kernel: [23244.572213] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 11:51:10 juju-e4d256-prod-github-runner-207 kernel: [23244.573617] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 11:51:10 juju-e4d256-prod-github-runner-207 kernel: [23244.574833] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 11:51:10 juju-e4d256-prod-github-runner-207 kernel: [23244.576207] Call Trace: Aug 22 11:51:10 juju-e4d256-prod-github-runner-207 kernel: [23244.577177] Aug 22 11:51:10 juju-e4d256-prod-github-runner-207 kernel: [23244.578129] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:51:10 juju-e4d256-prod-github-runner-207 kernel: [23244.579252] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:51:10 juju-e4d256-prod-github-runner-207 kernel: [23244.580364] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:51:10 juju-e4d256-prod-github-runner-207 kernel: [23244.581550] ? show_regs.part.0+0x23/0x29 Aug 22 11:51:10 juju-e4d256-prod-github-runner-207 kernel: [23244.582627] ? show_regs.cold+0x8/0xd Aug 22 11:51:10 juju-e4d256-prod-github-runner-207 kernel: [23244.583690] ? watchdog_timer_fn+0x1be/0x220 Aug 22 11:51:10 juju-e4d256-prod-github-runner-207 kernel: [23244.584801] ? lockup_detector_update_enable+0x60/0x60 Aug 22 11:51:10 juju-e4d256-prod-github-runner-207 kernel: [23244.586000] ? __hrtimer_run_queues+0x107/0x230 Aug 22 11:51:10 juju-e4d256-prod-github-runner-207 kernel: [23244.587124] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 11:51:10 juju-e4d256-prod-github-runner-207 kernel: [23244.588274] ? hrtimer_interrupt+0x101/0x220 Aug 22 11:51:10 juju-e4d256-prod-github-runner-207 kernel: [23244.589375] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 11:51:10 juju-e4d256-prod-github-runner-207 kernel: [23244.590575] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 11:51:10 juju-e4d256-prod-github-runner-207 kernel: [23244.591752] Aug 22 11:51:10 juju-e4d256-prod-github-runner-207 kernel: [23244.592648] Aug 22 11:51:10 juju-e4d256-prod-github-runner-207 kernel: [23244.593562] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 11:51:10 juju-e4d256-prod-github-runner-207 kernel: [23244.594700] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:51:10 juju-e4d256-prod-github-runner-207 kernel: [23244.595848] ? _raw_spin_lock+0x22/0x30 Aug 22 11:51:10 juju-e4d256-prod-github-runner-207 kernel: [23244.596882] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:51:10 juju-e4d256-prod-github-runner-207 kernel: [23244.598311] direct_page_fault+0x206/0x310 [kvm] Aug 22 11:51:10 juju-e4d256-prod-github-runner-207 kernel: [23244.599430] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 11:51:10 juju-e4d256-prod-github-runner-207 kernel: [23244.600524] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 11:51:10 juju-e4d256-prod-github-runner-207 kernel: [23244.601639] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 11:51:10 juju-e4d256-prod-github-runner-207 kernel: [23244.602712] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 11:51:10 juju-e4d256-prod-github-runner-207 kernel: [23244.603755] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 11:51:10 juju-e4d256-prod-github-runner-207 kernel: [23244.604840] handle_exit+0x98/0x230 [kvm_amd] Aug 22 11:51:10 juju-e4d256-prod-github-runner-207 kernel: [23244.605846] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 11:51:10 juju-e4d256-prod-github-runner-207 kernel: [23244.606855] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 11:51:10 juju-e4d256-prod-github-runner-207 kernel: [23244.607882] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 11:51:10 juju-e4d256-prod-github-runner-207 kernel: [23244.608891] vcpu_run+0x62/0x2c0 [kvm] Aug 22 11:51:10 juju-e4d256-prod-github-runner-207 kernel: [23244.609799] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 11:51:10 juju-e4d256-prod-github-runner-207 kernel: [23244.610697] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 11:51:10 juju-e4d256-prod-github-runner-207 kernel: [23244.611652] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 11:51:10 juju-e4d256-prod-github-runner-207 kernel: [23244.612646] ? __seccomp_filter+0x4a/0x4a0 Aug 22 11:51:10 juju-e4d256-prod-github-runner-207 kernel: [23244.613502] ? __fget_files+0x86/0xc0 Aug 22 11:51:10 juju-e4d256-prod-github-runner-207 kernel: [23244.614286] __x64_sys_ioctl+0x95/0xd0 Aug 22 11:51:10 juju-e4d256-prod-github-runner-207 kernel: [23244.615056] do_syscall_64+0x5c/0xc0 Aug 22 11:51:10 juju-e4d256-prod-github-runner-207 kernel: [23244.615807] ? do_futex+0x162/0x1f0 Aug 22 11:51:10 juju-e4d256-prod-github-runner-207 kernel: [23244.616532] ? __x64_sys_futex+0x78/0x1e0 Aug 22 11:51:10 juju-e4d256-prod-github-runner-207 kernel: [23244.617287] ? __secure_computing+0xa9/0x120 Aug 22 11:51:10 juju-e4d256-prod-github-runner-207 kernel: [23244.618070] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 11:51:10 juju-e4d256-prod-github-runner-207 kernel: [23244.618957] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:51:10 juju-e4d256-prod-github-runner-207 kernel: [23244.619791] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:51:10 juju-e4d256-prod-github-runner-207 kernel: [23244.620599] ? do_syscall_64+0x69/0xc0 Aug 22 11:51:10 juju-e4d256-prod-github-runner-207 kernel: [23244.621321] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:51:10 juju-e4d256-prod-github-runner-207 kernel: [23244.622129] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:51:10 juju-e4d256-prod-github-runner-207 kernel: [23244.622913] ? do_syscall_64+0x69/0xc0 Aug 22 11:51:10 juju-e4d256-prod-github-runner-207 kernel: [23244.623619] ? do_syscall_64+0x69/0xc0 Aug 22 11:51:10 juju-e4d256-prod-github-runner-207 kernel: [23244.624318] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 11:51:10 juju-e4d256-prod-github-runner-207 kernel: [23244.625123] RIP: 0033:0x7faa5d0edaff Aug 22 11:51:10 juju-e4d256-prod-github-runner-207 kernel: [23244.625862] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 11:51:10 juju-e4d256-prod-github-runner-207 kernel: [23244.628193] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 11:51:10 juju-e4d256-prod-github-runner-207 kernel: [23244.629248] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 11:51:10 juju-e4d256-prod-github-runner-207 kernel: [23244.630311] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 11:51:10 juju-e4d256-prod-github-runner-207 kernel: [23244.631351] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 11:51:10 juju-e4d256-prod-github-runner-207 kernel: [23244.632402] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 11:51:10 juju-e4d256-prod-github-runner-207 kernel: [23244.633481] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 11:51:10 juju-e4d256-prod-github-runner-207 kernel: [23244.634528] Aug 22 11:51:38 juju-e4d256-prod-github-runner-207 kernel: [23272.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 21566s! [qemu-system-x86:6715] Aug 22 11:51:38 juju-e4d256-prod-github-runner-207 kernel: [23272.543859] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 11:51:38 juju-e4d256-prod-github-runner-207 kernel: [23272.544163] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 11:51:38 juju-e4d256-prod-github-runner-207 kernel: [23272.556349] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 11:51:38 juju-e4d256-prod-github-runner-207 kernel: [23272.557629] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 11:51:38 juju-e4d256-prod-github-runner-207 kernel: [23272.558860] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:51:38 juju-e4d256-prod-github-runner-207 kernel: [23272.559953] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 11:51:38 juju-e4d256-prod-github-runner-207 kernel: [23272.562517] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 11:51:38 juju-e4d256-prod-github-runner-207 kernel: [23272.563557] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 11:51:38 juju-e4d256-prod-github-runner-207 kernel: [23272.564716] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 11:51:38 juju-e4d256-prod-github-runner-207 kernel: [23272.565887] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 11:51:38 juju-e4d256-prod-github-runner-207 kernel: [23272.567048] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 11:51:38 juju-e4d256-prod-github-runner-207 kernel: [23272.568205] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 11:51:38 juju-e4d256-prod-github-runner-207 kernel: [23272.569388] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 11:51:38 juju-e4d256-prod-github-runner-207 kernel: [23272.570622] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 11:51:38 juju-e4d256-prod-github-runner-207 kernel: [23272.571728] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 11:51:38 juju-e4d256-prod-github-runner-207 kernel: [23272.572923] Call Trace: Aug 22 11:51:38 juju-e4d256-prod-github-runner-207 kernel: [23272.573855] Aug 22 11:51:38 juju-e4d256-prod-github-runner-207 kernel: [23272.574802] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:51:38 juju-e4d256-prod-github-runner-207 kernel: [23272.575861] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:51:38 juju-e4d256-prod-github-runner-207 kernel: [23272.576936] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:51:38 juju-e4d256-prod-github-runner-207 kernel: [23272.578110] ? show_regs.part.0+0x23/0x29 Aug 22 11:51:38 juju-e4d256-prod-github-runner-207 kernel: [23272.579117] ? show_regs.cold+0x8/0xd Aug 22 11:51:38 juju-e4d256-prod-github-runner-207 kernel: [23272.580118] ? watchdog_timer_fn+0x1be/0x220 Aug 22 11:51:38 juju-e4d256-prod-github-runner-207 kernel: [23272.581151] ? lockup_detector_update_enable+0x60/0x60 Aug 22 11:51:38 juju-e4d256-prod-github-runner-207 kernel: [23272.582216] ? __hrtimer_run_queues+0x107/0x230 Aug 22 11:51:38 juju-e4d256-prod-github-runner-207 kernel: [23272.583248] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 11:51:38 juju-e4d256-prod-github-runner-207 kernel: [23272.584269] ? hrtimer_interrupt+0x101/0x220 Aug 22 11:51:38 juju-e4d256-prod-github-runner-207 kernel: [23272.585299] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 11:51:38 juju-e4d256-prod-github-runner-207 kernel: [23272.586365] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 11:51:38 juju-e4d256-prod-github-runner-207 kernel: [23272.587407] Aug 22 11:51:38 juju-e4d256-prod-github-runner-207 kernel: [23272.588258] Aug 22 11:51:38 juju-e4d256-prod-github-runner-207 kernel: [23272.589128] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 11:51:38 juju-e4d256-prod-github-runner-207 kernel: [23272.590178] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:51:38 juju-e4d256-prod-github-runner-207 kernel: [23272.591214] ? _raw_spin_lock+0x22/0x30 Aug 22 11:51:38 juju-e4d256-prod-github-runner-207 kernel: [23272.592161] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:51:38 juju-e4d256-prod-github-runner-207 kernel: [23272.593191] direct_page_fault+0x206/0x310 [kvm] Aug 22 11:51:38 juju-e4d256-prod-github-runner-207 kernel: [23272.594211] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 11:51:38 juju-e4d256-prod-github-runner-207 kernel: [23272.595216] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 11:51:38 juju-e4d256-prod-github-runner-207 kernel: [23272.596215] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 11:51:38 juju-e4d256-prod-github-runner-207 kernel: [23272.597216] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 11:51:38 juju-e4d256-prod-github-runner-207 kernel: [23272.598164] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 11:51:38 juju-e4d256-prod-github-runner-207 kernel: [23272.599160] handle_exit+0x98/0x230 [kvm_amd] Aug 22 11:51:38 juju-e4d256-prod-github-runner-207 kernel: [23272.600061] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 11:51:38 juju-e4d256-prod-github-runner-207 kernel: [23272.600972] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 11:51:38 juju-e4d256-prod-github-runner-207 kernel: [23272.601901] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 11:51:38 juju-e4d256-prod-github-runner-207 kernel: [23272.602800] vcpu_run+0x62/0x2c0 [kvm] Aug 22 11:51:38 juju-e4d256-prod-github-runner-207 kernel: [23272.603606] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 11:51:38 juju-e4d256-prod-github-runner-207 kernel: [23272.604408] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 11:51:38 juju-e4d256-prod-github-runner-207 kernel: [23272.605286] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 11:51:38 juju-e4d256-prod-github-runner-207 kernel: [23272.606081] ? __seccomp_filter+0x4a/0x4a0 Aug 22 11:51:38 juju-e4d256-prod-github-runner-207 kernel: [23272.606821] ? __fget_files+0x86/0xc0 Aug 22 11:51:38 juju-e4d256-prod-github-runner-207 kernel: [23272.607521] __x64_sys_ioctl+0x95/0xd0 Aug 22 11:51:38 juju-e4d256-prod-github-runner-207 kernel: [23272.608279] do_syscall_64+0x5c/0xc0 Aug 22 11:51:38 juju-e4d256-prod-github-runner-207 kernel: [23272.608949] ? do_futex+0x162/0x1f0 Aug 22 11:51:38 juju-e4d256-prod-github-runner-207 kernel: [23272.609602] ? __x64_sys_futex+0x78/0x1e0 Aug 22 11:51:38 juju-e4d256-prod-github-runner-207 kernel: [23272.610283] ? __secure_computing+0xa9/0x120 Aug 22 11:51:38 juju-e4d256-prod-github-runner-207 kernel: [23272.610978] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 11:51:38 juju-e4d256-prod-github-runner-207 kernel: [23272.611753] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:51:38 juju-e4d256-prod-github-runner-207 kernel: [23272.612480] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:51:38 juju-e4d256-prod-github-runner-207 kernel: [23272.613212] ? do_syscall_64+0x69/0xc0 Aug 22 11:51:38 juju-e4d256-prod-github-runner-207 kernel: [23272.613854] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:51:38 juju-e4d256-prod-github-runner-207 kernel: [23272.614558] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:51:38 juju-e4d256-prod-github-runner-207 kernel: [23272.615248] ? do_syscall_64+0x69/0xc0 Aug 22 11:51:38 juju-e4d256-prod-github-runner-207 kernel: [23272.615868] ? do_syscall_64+0x69/0xc0 Aug 22 11:51:38 juju-e4d256-prod-github-runner-207 kernel: [23272.616487] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 11:51:38 juju-e4d256-prod-github-runner-207 kernel: [23272.617209] RIP: 0033:0x7faa5d0edaff Aug 22 11:51:38 juju-e4d256-prod-github-runner-207 kernel: [23272.617855] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 11:51:38 juju-e4d256-prod-github-runner-207 kernel: [23272.619830] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 11:51:38 juju-e4d256-prod-github-runner-207 kernel: [23272.620744] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 11:51:38 juju-e4d256-prod-github-runner-207 kernel: [23272.621648] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 11:51:38 juju-e4d256-prod-github-runner-207 kernel: [23272.622531] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 11:51:38 juju-e4d256-prod-github-runner-207 kernel: [23272.623420] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 11:51:38 juju-e4d256-prod-github-runner-207 kernel: [23272.624304] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 11:51:38 juju-e4d256-prod-github-runner-207 kernel: [23272.625264] Aug 22 11:52:06 juju-e4d256-prod-github-runner-207 kernel: [23300.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 21592s! [qemu-system-x86:6715] Aug 22 11:52:06 juju-e4d256-prod-github-runner-207 kernel: [23300.543095] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 11:52:06 juju-e4d256-prod-github-runner-207 kernel: [23300.543169] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 11:52:06 juju-e4d256-prod-github-runner-207 kernel: [23300.555342] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 11:52:06 juju-e4d256-prod-github-runner-207 kernel: [23300.556649] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 11:52:06 juju-e4d256-prod-github-runner-207 kernel: [23300.558029] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:52:06 juju-e4d256-prod-github-runner-207 kernel: [23300.559083] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 11:52:06 juju-e4d256-prod-github-runner-207 kernel: [23300.561635] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 11:52:06 juju-e4d256-prod-github-runner-207 kernel: [23300.562672] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 11:52:06 juju-e4d256-prod-github-runner-207 kernel: [23300.563829] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 11:52:06 juju-e4d256-prod-github-runner-207 kernel: [23300.565001] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 11:52:06 juju-e4d256-prod-github-runner-207 kernel: [23300.566164] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 11:52:06 juju-e4d256-prod-github-runner-207 kernel: [23300.567326] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 11:52:06 juju-e4d256-prod-github-runner-207 kernel: [23300.568494] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 11:52:06 juju-e4d256-prod-github-runner-207 kernel: [23300.569753] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 11:52:06 juju-e4d256-prod-github-runner-207 kernel: [23300.570859] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 11:52:06 juju-e4d256-prod-github-runner-207 kernel: [23300.572061] Call Trace: Aug 22 11:52:06 juju-e4d256-prod-github-runner-207 kernel: [23300.572991] Aug 22 11:52:06 juju-e4d256-prod-github-runner-207 kernel: [23300.573877] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:52:06 juju-e4d256-prod-github-runner-207 kernel: [23300.574907] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:52:06 juju-e4d256-prod-github-runner-207 kernel: [23300.575925] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:52:06 juju-e4d256-prod-github-runner-207 kernel: [23300.577013] ? show_regs.part.0+0x23/0x29 Aug 22 11:52:06 juju-e4d256-prod-github-runner-207 kernel: [23300.578007] ? show_regs.cold+0x8/0xd Aug 22 11:52:06 juju-e4d256-prod-github-runner-207 kernel: [23300.578980] ? watchdog_timer_fn+0x1be/0x220 Aug 22 11:52:06 juju-e4d256-prod-github-runner-207 kernel: [23300.579985] ? lockup_detector_update_enable+0x60/0x60 Aug 22 11:52:06 juju-e4d256-prod-github-runner-207 kernel: [23300.581059] ? __hrtimer_run_queues+0x107/0x230 Aug 22 11:52:06 juju-e4d256-prod-github-runner-207 kernel: [23300.582089] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 11:52:06 juju-e4d256-prod-github-runner-207 kernel: [23300.583111] ? hrtimer_interrupt+0x101/0x220 Aug 22 11:52:06 juju-e4d256-prod-github-runner-207 kernel: [23300.584123] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 11:52:06 juju-e4d256-prod-github-runner-207 kernel: [23300.585207] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 11:52:06 juju-e4d256-prod-github-runner-207 kernel: [23300.586275] Aug 22 11:52:06 juju-e4d256-prod-github-runner-207 kernel: [23300.587133] Aug 22 11:52:06 juju-e4d256-prod-github-runner-207 kernel: [23300.587973] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 11:52:06 juju-e4d256-prod-github-runner-207 kernel: [23300.589017] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:52:06 juju-e4d256-prod-github-runner-207 kernel: [23300.590053] ? _raw_spin_lock+0x22/0x30 Aug 22 11:52:06 juju-e4d256-prod-github-runner-207 kernel: [23300.590999] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:52:06 juju-e4d256-prod-github-runner-207 kernel: [23300.592010] direct_page_fault+0x206/0x310 [kvm] Aug 22 11:52:06 juju-e4d256-prod-github-runner-207 kernel: [23300.593057] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 11:52:06 juju-e4d256-prod-github-runner-207 kernel: [23300.594069] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 11:52:06 juju-e4d256-prod-github-runner-207 kernel: [23300.595076] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 11:52:06 juju-e4d256-prod-github-runner-207 kernel: [23300.596052] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 11:52:06 juju-e4d256-prod-github-runner-207 kernel: [23300.597019] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 11:52:06 juju-e4d256-prod-github-runner-207 kernel: [23300.597994] handle_exit+0x98/0x230 [kvm_amd] Aug 22 11:52:06 juju-e4d256-prod-github-runner-207 kernel: [23300.598887] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 11:52:06 juju-e4d256-prod-github-runner-207 kernel: [23300.599986] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 11:52:06 juju-e4d256-prod-github-runner-207 kernel: [23300.600944] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 11:52:06 juju-e4d256-prod-github-runner-207 kernel: [23300.601849] vcpu_run+0x62/0x2c0 [kvm] Aug 22 11:52:06 juju-e4d256-prod-github-runner-207 kernel: [23300.602687] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 11:52:06 juju-e4d256-prod-github-runner-207 kernel: [23300.603503] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 11:52:06 juju-e4d256-prod-github-runner-207 kernel: [23300.604355] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 11:52:06 juju-e4d256-prod-github-runner-207 kernel: [23300.605168] ? __seccomp_filter+0x4a/0x4a0 Aug 22 11:52:06 juju-e4d256-prod-github-runner-207 kernel: [23300.605911] ? __fget_files+0x86/0xc0 Aug 22 11:52:06 juju-e4d256-prod-github-runner-207 kernel: [23300.606619] __x64_sys_ioctl+0x95/0xd0 Aug 22 11:52:06 juju-e4d256-prod-github-runner-207 kernel: [23300.607310] do_syscall_64+0x5c/0xc0 Aug 22 11:52:06 juju-e4d256-prod-github-runner-207 kernel: [23300.607973] ? do_futex+0x162/0x1f0 Aug 22 11:52:06 juju-e4d256-prod-github-runner-207 kernel: [23300.608631] ? __x64_sys_futex+0x78/0x1e0 Aug 22 11:52:06 juju-e4d256-prod-github-runner-207 kernel: [23300.609325] ? __secure_computing+0xa9/0x120 Aug 22 11:52:06 juju-e4d256-prod-github-runner-207 kernel: [23300.610013] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 11:52:06 juju-e4d256-prod-github-runner-207 kernel: [23300.610771] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:52:06 juju-e4d256-prod-github-runner-207 kernel: [23300.611523] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:52:06 juju-e4d256-prod-github-runner-207 kernel: [23300.612257] ? do_syscall_64+0x69/0xc0 Aug 22 11:52:06 juju-e4d256-prod-github-runner-207 kernel: [23300.612943] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:52:06 juju-e4d256-prod-github-runner-207 kernel: [23300.613652] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:52:06 juju-e4d256-prod-github-runner-207 kernel: [23300.614352] ? do_syscall_64+0x69/0xc0 Aug 22 11:52:06 juju-e4d256-prod-github-runner-207 kernel: [23300.614977] ? do_syscall_64+0x69/0xc0 Aug 22 11:52:06 juju-e4d256-prod-github-runner-207 kernel: [23300.615634] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 11:52:06 juju-e4d256-prod-github-runner-207 kernel: [23300.616350] RIP: 0033:0x7faa5d0edaff Aug 22 11:52:06 juju-e4d256-prod-github-runner-207 kernel: [23300.617001] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 11:52:06 juju-e4d256-prod-github-runner-207 kernel: [23300.618991] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 11:52:06 juju-e4d256-prod-github-runner-207 kernel: [23300.619904] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 11:52:06 juju-e4d256-prod-github-runner-207 kernel: [23300.620815] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 11:52:06 juju-e4d256-prod-github-runner-207 kernel: [23300.621703] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 11:52:06 juju-e4d256-prod-github-runner-207 kernel: [23300.622594] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 11:52:06 juju-e4d256-prod-github-runner-207 kernel: [23300.623511] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 11:52:06 juju-e4d256-prod-github-runner-207 kernel: [23300.624402] Aug 22 11:52:34 juju-e4d256-prod-github-runner-207 kernel: [23328.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 21618s! [qemu-system-x86:6715] Aug 22 11:52:34 juju-e4d256-prod-github-runner-207 kernel: [23328.543097] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 11:52:34 juju-e4d256-prod-github-runner-207 kernel: [23328.543167] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 11:52:34 juju-e4d256-prod-github-runner-207 kernel: [23328.555425] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 11:52:34 juju-e4d256-prod-github-runner-207 kernel: [23328.556696] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 11:52:34 juju-e4d256-prod-github-runner-207 kernel: [23328.557913] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:52:34 juju-e4d256-prod-github-runner-207 kernel: [23328.558968] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 11:52:34 juju-e4d256-prod-github-runner-207 kernel: [23328.561523] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 11:52:34 juju-e4d256-prod-github-runner-207 kernel: [23328.562590] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 11:52:34 juju-e4d256-prod-github-runner-207 kernel: [23328.563754] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 11:52:34 juju-e4d256-prod-github-runner-207 kernel: [23328.565077] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 11:52:34 juju-e4d256-prod-github-runner-207 kernel: [23328.566392] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 11:52:34 juju-e4d256-prod-github-runner-207 kernel: [23328.567719] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 11:52:34 juju-e4d256-prod-github-runner-207 kernel: [23328.569043] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 11:52:34 juju-e4d256-prod-github-runner-207 kernel: [23328.570434] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 11:52:34 juju-e4d256-prod-github-runner-207 kernel: [23328.571662] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 11:52:34 juju-e4d256-prod-github-runner-207 kernel: [23328.573012] Call Trace: Aug 22 11:52:34 juju-e4d256-prod-github-runner-207 kernel: [23328.573973] Aug 22 11:52:34 juju-e4d256-prod-github-runner-207 kernel: [23328.574901] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:52:34 juju-e4d256-prod-github-runner-207 kernel: [23328.576029] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:52:34 juju-e4d256-prod-github-runner-207 kernel: [23328.577172] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:52:34 juju-e4d256-prod-github-runner-207 kernel: [23328.578342] ? show_regs.part.0+0x23/0x29 Aug 22 11:52:34 juju-e4d256-prod-github-runner-207 kernel: [23328.579424] ? show_regs.cold+0x8/0xd Aug 22 11:52:34 juju-e4d256-prod-github-runner-207 kernel: [23328.580492] ? watchdog_timer_fn+0x1be/0x220 Aug 22 11:52:34 juju-e4d256-prod-github-runner-207 kernel: [23328.581585] ? lockup_detector_update_enable+0x60/0x60 Aug 22 11:52:34 juju-e4d256-prod-github-runner-207 kernel: [23328.582746] ? __hrtimer_run_queues+0x107/0x230 Aug 22 11:52:34 juju-e4d256-prod-github-runner-207 kernel: [23328.583861] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 11:52:34 juju-e4d256-prod-github-runner-207 kernel: [23328.584927] ? hrtimer_interrupt+0x101/0x220 Aug 22 11:52:34 juju-e4d256-prod-github-runner-207 kernel: [23328.585951] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 11:52:34 juju-e4d256-prod-github-runner-207 kernel: [23328.587019] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 11:52:34 juju-e4d256-prod-github-runner-207 kernel: [23328.588063] Aug 22 11:52:34 juju-e4d256-prod-github-runner-207 kernel: [23328.588938] Aug 22 11:52:34 juju-e4d256-prod-github-runner-207 kernel: [23328.589777] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 11:52:34 juju-e4d256-prod-github-runner-207 kernel: [23328.590809] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:52:34 juju-e4d256-prod-github-runner-207 kernel: [23328.591853] ? _raw_spin_lock+0x22/0x30 Aug 22 11:52:34 juju-e4d256-prod-github-runner-207 kernel: [23328.592814] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:52:34 juju-e4d256-prod-github-runner-207 kernel: [23328.593836] direct_page_fault+0x206/0x310 [kvm] Aug 22 11:52:34 juju-e4d256-prod-github-runner-207 kernel: [23328.594863] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 11:52:34 juju-e4d256-prod-github-runner-207 kernel: [23328.595871] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 11:52:34 juju-e4d256-prod-github-runner-207 kernel: [23328.596919] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 11:52:34 juju-e4d256-prod-github-runner-207 kernel: [23328.597891] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 11:52:34 juju-e4d256-prod-github-runner-207 kernel: [23328.598841] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 11:52:34 juju-e4d256-prod-github-runner-207 kernel: [23328.599819] handle_exit+0x98/0x230 [kvm_amd] Aug 22 11:52:34 juju-e4d256-prod-github-runner-207 kernel: [23328.600722] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 11:52:34 juju-e4d256-prod-github-runner-207 kernel: [23328.601640] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 11:52:34 juju-e4d256-prod-github-runner-207 kernel: [23328.602564] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 11:52:34 juju-e4d256-prod-github-runner-207 kernel: [23328.603467] vcpu_run+0x62/0x2c0 [kvm] Aug 22 11:52:34 juju-e4d256-prod-github-runner-207 kernel: [23328.604278] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 11:52:34 juju-e4d256-prod-github-runner-207 kernel: [23328.605101] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 11:52:34 juju-e4d256-prod-github-runner-207 kernel: [23328.605962] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 11:52:34 juju-e4d256-prod-github-runner-207 kernel: [23328.606763] ? __seccomp_filter+0x4a/0x4a0 Aug 22 11:52:34 juju-e4d256-prod-github-runner-207 kernel: [23328.607506] ? __fget_files+0x86/0xc0 Aug 22 11:52:34 juju-e4d256-prod-github-runner-207 kernel: [23328.608215] __x64_sys_ioctl+0x95/0xd0 Aug 22 11:52:34 juju-e4d256-prod-github-runner-207 kernel: [23328.608920] do_syscall_64+0x5c/0xc0 Aug 22 11:52:34 juju-e4d256-prod-github-runner-207 kernel: [23328.609585] ? do_futex+0x162/0x1f0 Aug 22 11:52:34 juju-e4d256-prod-github-runner-207 kernel: [23328.610234] ? __x64_sys_futex+0x78/0x1e0 Aug 22 11:52:34 juju-e4d256-prod-github-runner-207 kernel: [23328.610915] ? __secure_computing+0xa9/0x120 Aug 22 11:52:34 juju-e4d256-prod-github-runner-207 kernel: [23328.611604] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 11:52:34 juju-e4d256-prod-github-runner-207 kernel: [23328.612365] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:52:34 juju-e4d256-prod-github-runner-207 kernel: [23328.613099] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:52:34 juju-e4d256-prod-github-runner-207 kernel: [23328.613819] ? do_syscall_64+0x69/0xc0 Aug 22 11:52:34 juju-e4d256-prod-github-runner-207 kernel: [23328.614462] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:52:34 juju-e4d256-prod-github-runner-207 kernel: [23328.615169] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:52:34 juju-e4d256-prod-github-runner-207 kernel: [23328.615871] ? do_syscall_64+0x69/0xc0 Aug 22 11:52:34 juju-e4d256-prod-github-runner-207 kernel: [23328.616502] ? do_syscall_64+0x69/0xc0 Aug 22 11:52:34 juju-e4d256-prod-github-runner-207 kernel: [23328.617128] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 11:52:34 juju-e4d256-prod-github-runner-207 kernel: [23328.617836] RIP: 0033:0x7faa5d0edaff Aug 22 11:52:34 juju-e4d256-prod-github-runner-207 kernel: [23328.618459] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 11:52:34 juju-e4d256-prod-github-runner-207 kernel: [23328.620454] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 11:52:34 juju-e4d256-prod-github-runner-207 kernel: [23328.621373] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 11:52:34 juju-e4d256-prod-github-runner-207 kernel: [23328.622269] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 11:52:34 juju-e4d256-prod-github-runner-207 kernel: [23328.623216] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 11:52:34 juju-e4d256-prod-github-runner-207 kernel: [23328.624108] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 11:52:34 juju-e4d256-prod-github-runner-207 kernel: [23328.625063] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 11:52:34 juju-e4d256-prod-github-runner-207 kernel: [23328.625963] Aug 22 11:53:02 juju-e4d256-prod-github-runner-207 kernel: [23356.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 21644s! [qemu-system-x86:6715] Aug 22 11:53:02 juju-e4d256-prod-github-runner-207 kernel: [23356.543188] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 11:53:02 juju-e4d256-prod-github-runner-207 kernel: [23356.543356] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 11:53:02 juju-e4d256-prod-github-runner-207 kernel: [23356.555437] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 11:53:02 juju-e4d256-prod-github-runner-207 kernel: [23356.556732] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 11:53:02 juju-e4d256-prod-github-runner-207 kernel: [23356.557975] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:53:02 juju-e4d256-prod-github-runner-207 kernel: [23356.559029] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 11:53:02 juju-e4d256-prod-github-runner-207 kernel: [23356.561582] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 11:53:02 juju-e4d256-prod-github-runner-207 kernel: [23356.562620] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 11:53:02 juju-e4d256-prod-github-runner-207 kernel: [23356.563775] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 11:53:02 juju-e4d256-prod-github-runner-207 kernel: [23356.564948] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 11:53:02 juju-e4d256-prod-github-runner-207 kernel: [23356.566109] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 11:53:02 juju-e4d256-prod-github-runner-207 kernel: [23356.567276] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 11:53:02 juju-e4d256-prod-github-runner-207 kernel: [23356.568453] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 11:53:02 juju-e4d256-prod-github-runner-207 kernel: [23356.569691] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 11:53:02 juju-e4d256-prod-github-runner-207 kernel: [23356.570788] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 11:53:02 juju-e4d256-prod-github-runner-207 kernel: [23356.571988] Call Trace: Aug 22 11:53:02 juju-e4d256-prod-github-runner-207 kernel: [23356.572923] Aug 22 11:53:02 juju-e4d256-prod-github-runner-207 kernel: [23356.573805] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:53:02 juju-e4d256-prod-github-runner-207 kernel: [23356.574835] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:53:02 juju-e4d256-prod-github-runner-207 kernel: [23356.575856] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:53:02 juju-e4d256-prod-github-runner-207 kernel: [23356.576972] ? show_regs.part.0+0x23/0x29 Aug 22 11:53:02 juju-e4d256-prod-github-runner-207 kernel: [23356.577966] ? show_regs.cold+0x8/0xd Aug 22 11:53:02 juju-e4d256-prod-github-runner-207 kernel: [23356.578936] ? watchdog_timer_fn+0x1be/0x220 Aug 22 11:53:02 juju-e4d256-prod-github-runner-207 kernel: [23356.579941] ? lockup_detector_update_enable+0x60/0x60 Aug 22 11:53:02 juju-e4d256-prod-github-runner-207 kernel: [23356.581006] ? __hrtimer_run_queues+0x107/0x230 Aug 22 11:53:02 juju-e4d256-prod-github-runner-207 kernel: [23356.582033] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 11:53:02 juju-e4d256-prod-github-runner-207 kernel: [23356.583056] ? hrtimer_interrupt+0x101/0x220 Aug 22 11:53:02 juju-e4d256-prod-github-runner-207 kernel: [23356.584069] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 11:53:02 juju-e4d256-prod-github-runner-207 kernel: [23356.585142] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 11:53:02 juju-e4d256-prod-github-runner-207 kernel: [23356.586200] Aug 22 11:53:02 juju-e4d256-prod-github-runner-207 kernel: [23356.587052] Aug 22 11:53:02 juju-e4d256-prod-github-runner-207 kernel: [23356.587893] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 11:53:02 juju-e4d256-prod-github-runner-207 kernel: [23356.588932] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:53:02 juju-e4d256-prod-github-runner-207 kernel: [23356.589967] ? _raw_spin_lock+0x22/0x30 Aug 22 11:53:02 juju-e4d256-prod-github-runner-207 kernel: [23356.590908] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:53:02 juju-e4d256-prod-github-runner-207 kernel: [23356.592184] direct_page_fault+0x206/0x310 [kvm] Aug 22 11:53:02 juju-e4d256-prod-github-runner-207 kernel: [23356.593516] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 11:53:02 juju-e4d256-prod-github-runner-207 kernel: [23356.594730] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 11:53:02 juju-e4d256-prod-github-runner-207 kernel: [23356.595807] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 11:53:02 juju-e4d256-prod-github-runner-207 kernel: [23356.596835] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 11:53:02 juju-e4d256-prod-github-runner-207 kernel: [23356.598087] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 11:53:02 juju-e4d256-prod-github-runner-207 kernel: [23356.599561] handle_exit+0x98/0x230 [kvm_amd] Aug 22 11:53:02 juju-e4d256-prod-github-runner-207 kernel: [23356.600706] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 11:53:02 juju-e4d256-prod-github-runner-207 kernel: [23356.601789] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 11:53:02 juju-e4d256-prod-github-runner-207 kernel: [23356.602822] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 11:53:02 juju-e4d256-prod-github-runner-207 kernel: [23356.603730] vcpu_run+0x62/0x2c0 [kvm] Aug 22 11:53:02 juju-e4d256-prod-github-runner-207 kernel: [23356.604554] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 11:53:02 juju-e4d256-prod-github-runner-207 kernel: [23356.605363] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 11:53:02 juju-e4d256-prod-github-runner-207 kernel: [23356.606218] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 11:53:02 juju-e4d256-prod-github-runner-207 kernel: [23356.607111] ? __seccomp_filter+0x4a/0x4a0 Aug 22 11:53:02 juju-e4d256-prod-github-runner-207 kernel: [23356.607878] ? __fget_files+0x86/0xc0 Aug 22 11:53:02 juju-e4d256-prod-github-runner-207 kernel: [23356.608761] __x64_sys_ioctl+0x95/0xd0 Aug 22 11:53:02 juju-e4d256-prod-github-runner-207 kernel: [23356.609679] do_syscall_64+0x5c/0xc0 Aug 22 11:53:02 juju-e4d256-prod-github-runner-207 kernel: [23356.610565] ? do_futex+0x162/0x1f0 Aug 22 11:53:02 juju-e4d256-prod-github-runner-207 kernel: [23356.611457] ? __x64_sys_futex+0x78/0x1e0 Aug 22 11:53:02 juju-e4d256-prod-github-runner-207 kernel: [23356.612398] ? __secure_computing+0xa9/0x120 Aug 22 11:53:02 juju-e4d256-prod-github-runner-207 kernel: [23356.613285] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 11:53:02 juju-e4d256-prod-github-runner-207 kernel: [23356.614047] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:53:02 juju-e4d256-prod-github-runner-207 kernel: [23356.614770] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:53:02 juju-e4d256-prod-github-runner-207 kernel: [23356.615488] ? do_syscall_64+0x69/0xc0 Aug 22 11:53:02 juju-e4d256-prod-github-runner-207 kernel: [23356.616149] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:53:02 juju-e4d256-prod-github-runner-207 kernel: [23356.616856] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:53:02 juju-e4d256-prod-github-runner-207 kernel: [23356.617555] ? do_syscall_64+0x69/0xc0 Aug 22 11:53:02 juju-e4d256-prod-github-runner-207 kernel: [23356.618235] ? do_syscall_64+0x69/0xc0 Aug 22 11:53:02 juju-e4d256-prod-github-runner-207 kernel: [23356.619250] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 11:53:02 juju-e4d256-prod-github-runner-207 kernel: [23356.620053] RIP: 0033:0x7faa5d0edaff Aug 22 11:53:02 juju-e4d256-prod-github-runner-207 kernel: [23356.620695] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 11:53:02 juju-e4d256-prod-github-runner-207 kernel: [23356.622679] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 11:53:02 juju-e4d256-prod-github-runner-207 kernel: [23356.623593] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 11:53:02 juju-e4d256-prod-github-runner-207 kernel: [23356.624488] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 11:53:02 juju-e4d256-prod-github-runner-207 kernel: [23356.625378] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 11:53:02 juju-e4d256-prod-github-runner-207 kernel: [23356.626269] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 11:53:02 juju-e4d256-prod-github-runner-207 kernel: [23356.627157] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 11:53:02 juju-e4d256-prod-github-runner-207 kernel: [23356.628049] Aug 22 11:53:30 juju-e4d256-prod-github-runner-207 kernel: [23384.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 21670s! [qemu-system-x86:6715] Aug 22 11:53:30 juju-e4d256-prod-github-runner-207 kernel: [23384.543860] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 11:53:30 juju-e4d256-prod-github-runner-207 kernel: [23384.544107] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 11:53:30 juju-e4d256-prod-github-runner-207 kernel: [23384.556205] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 11:53:30 juju-e4d256-prod-github-runner-207 kernel: [23384.557466] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 11:53:30 juju-e4d256-prod-github-runner-207 kernel: [23384.558680] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:53:30 juju-e4d256-prod-github-runner-207 kernel: [23384.559737] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 11:53:30 juju-e4d256-prod-github-runner-207 kernel: [23384.562297] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 11:53:30 juju-e4d256-prod-github-runner-207 kernel: [23384.563336] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 11:53:30 juju-e4d256-prod-github-runner-207 kernel: [23384.564517] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 11:53:30 juju-e4d256-prod-github-runner-207 kernel: [23384.565685] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 11:53:30 juju-e4d256-prod-github-runner-207 kernel: [23384.566842] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 11:53:30 juju-e4d256-prod-github-runner-207 kernel: [23384.568009] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 11:53:30 juju-e4d256-prod-github-runner-207 kernel: [23384.569177] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 11:53:30 juju-e4d256-prod-github-runner-207 kernel: [23384.570408] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 11:53:30 juju-e4d256-prod-github-runner-207 kernel: [23384.571505] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 11:53:30 juju-e4d256-prod-github-runner-207 kernel: [23384.572715] Call Trace: Aug 22 11:53:30 juju-e4d256-prod-github-runner-207 kernel: [23384.573627] Aug 22 11:53:30 juju-e4d256-prod-github-runner-207 kernel: [23384.574528] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:53:30 juju-e4d256-prod-github-runner-207 kernel: [23384.575596] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:53:30 juju-e4d256-prod-github-runner-207 kernel: [23384.576666] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:53:30 juju-e4d256-prod-github-runner-207 kernel: [23384.577742] ? show_regs.part.0+0x23/0x29 Aug 22 11:53:30 juju-e4d256-prod-github-runner-207 kernel: [23384.578740] ? show_regs.cold+0x8/0xd Aug 22 11:53:30 juju-e4d256-prod-github-runner-207 kernel: [23384.579713] ? watchdog_timer_fn+0x1be/0x220 Aug 22 11:53:30 juju-e4d256-prod-github-runner-207 kernel: [23384.580756] ? lockup_detector_update_enable+0x60/0x60 Aug 22 11:53:30 juju-e4d256-prod-github-runner-207 kernel: [23384.581819] ? __hrtimer_run_queues+0x107/0x230 Aug 22 11:53:30 juju-e4d256-prod-github-runner-207 kernel: [23384.582982] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 11:53:30 juju-e4d256-prod-github-runner-207 kernel: [23384.584074] ? hrtimer_interrupt+0x101/0x220 Aug 22 11:53:30 juju-e4d256-prod-github-runner-207 kernel: [23384.585191] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 11:53:30 juju-e4d256-prod-github-runner-207 kernel: [23384.586265] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 11:53:30 juju-e4d256-prod-github-runner-207 kernel: [23384.587311] Aug 22 11:53:30 juju-e4d256-prod-github-runner-207 kernel: [23384.588183] Aug 22 11:53:30 juju-e4d256-prod-github-runner-207 kernel: [23384.589020] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 11:53:30 juju-e4d256-prod-github-runner-207 kernel: [23384.590052] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:53:30 juju-e4d256-prod-github-runner-207 kernel: [23384.591096] ? _raw_spin_lock+0x22/0x30 Aug 22 11:53:30 juju-e4d256-prod-github-runner-207 kernel: [23384.592060] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:53:30 juju-e4d256-prod-github-runner-207 kernel: [23384.593124] direct_page_fault+0x206/0x310 [kvm] Aug 22 11:53:30 juju-e4d256-prod-github-runner-207 kernel: [23384.594241] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 11:53:30 juju-e4d256-prod-github-runner-207 kernel: [23384.595268] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 11:53:30 juju-e4d256-prod-github-runner-207 kernel: [23384.596301] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 11:53:30 juju-e4d256-prod-github-runner-207 kernel: [23384.597304] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 11:53:30 juju-e4d256-prod-github-runner-207 kernel: [23384.598256] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 11:53:30 juju-e4d256-prod-github-runner-207 kernel: [23384.599237] handle_exit+0x98/0x230 [kvm_amd] Aug 22 11:53:30 juju-e4d256-prod-github-runner-207 kernel: [23384.600179] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 11:53:30 juju-e4d256-prod-github-runner-207 kernel: [23384.601122] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 11:53:30 juju-e4d256-prod-github-runner-207 kernel: [23384.602050] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 11:53:30 juju-e4d256-prod-github-runner-207 kernel: [23384.602985] vcpu_run+0x62/0x2c0 [kvm] Aug 22 11:53:30 juju-e4d256-prod-github-runner-207 kernel: [23384.603837] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 11:53:30 juju-e4d256-prod-github-runner-207 kernel: [23384.604658] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 11:53:30 juju-e4d256-prod-github-runner-207 kernel: [23384.605519] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 11:53:30 juju-e4d256-prod-github-runner-207 kernel: [23384.606321] ? __seccomp_filter+0x4a/0x4a0 Aug 22 11:53:30 juju-e4d256-prod-github-runner-207 kernel: [23384.607067] ? __fget_files+0x86/0xc0 Aug 22 11:53:30 juju-e4d256-prod-github-runner-207 kernel: [23384.607790] __x64_sys_ioctl+0x95/0xd0 Aug 22 11:53:30 juju-e4d256-prod-github-runner-207 kernel: [23384.608488] do_syscall_64+0x5c/0xc0 Aug 22 11:53:30 juju-e4d256-prod-github-runner-207 kernel: [23384.609158] ? do_futex+0x162/0x1f0 Aug 22 11:53:30 juju-e4d256-prod-github-runner-207 kernel: [23384.609810] ? __x64_sys_futex+0x78/0x1e0 Aug 22 11:53:30 juju-e4d256-prod-github-runner-207 kernel: [23384.610487] ? __secure_computing+0xa9/0x120 Aug 22 11:53:30 juju-e4d256-prod-github-runner-207 kernel: [23384.611182] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 11:53:30 juju-e4d256-prod-github-runner-207 kernel: [23384.611961] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:53:30 juju-e4d256-prod-github-runner-207 kernel: [23384.612688] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:53:30 juju-e4d256-prod-github-runner-207 kernel: [23384.613411] ? do_syscall_64+0x69/0xc0 Aug 22 11:53:30 juju-e4d256-prod-github-runner-207 kernel: [23384.614093] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:53:30 juju-e4d256-prod-github-runner-207 kernel: [23384.614802] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:53:30 juju-e4d256-prod-github-runner-207 kernel: [23384.615496] ? do_syscall_64+0x69/0xc0 Aug 22 11:53:30 juju-e4d256-prod-github-runner-207 kernel: [23384.616141] ? do_syscall_64+0x69/0xc0 Aug 22 11:53:30 juju-e4d256-prod-github-runner-207 kernel: [23384.616775] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 11:53:30 juju-e4d256-prod-github-runner-207 kernel: [23384.617492] RIP: 0033:0x7faa5d0edaff Aug 22 11:53:30 juju-e4d256-prod-github-runner-207 kernel: [23384.618149] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 11:53:30 juju-e4d256-prod-github-runner-207 kernel: [23384.620166] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 11:53:30 juju-e4d256-prod-github-runner-207 kernel: [23384.621082] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 11:53:30 juju-e4d256-prod-github-runner-207 kernel: [23384.621971] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 11:53:30 juju-e4d256-prod-github-runner-207 kernel: [23384.622861] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 11:53:30 juju-e4d256-prod-github-runner-207 kernel: [23384.623813] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 11:53:30 juju-e4d256-prod-github-runner-207 kernel: [23384.624712] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 11:53:30 juju-e4d256-prod-github-runner-207 kernel: [23384.625622] Aug 22 11:53:44 juju-e4d256-prod-github-runner-207 kernel: [23398.748706] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 11:53:44 juju-e4d256-prod-github-runner-207 kernel: [23398.749757] rcu: 1-....: (5802231 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=2808908 Aug 22 11:53:44 juju-e4d256-prod-github-runner-207 kernel: [23398.750949] (t=5820387 jiffies g=23269 q=28552) Aug 22 11:53:44 juju-e4d256-prod-github-runner-207 kernel: [23398.751772] NMI backtrace for cpu 1 Aug 22 11:53:44 juju-e4d256-prod-github-runner-207 kernel: [23398.752488] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 11:53:44 juju-e4d256-prod-github-runner-207 kernel: [23398.753669] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 11:53:44 juju-e4d256-prod-github-runner-207 kernel: [23398.754732] Call Trace: Aug 22 11:53:44 juju-e4d256-prod-github-runner-207 kernel: [23398.755413] Aug 22 11:53:44 juju-e4d256-prod-github-runner-207 kernel: [23398.756116] show_stack+0x52/0x5c Aug 22 11:53:44 juju-e4d256-prod-github-runner-207 kernel: [23398.756853] dump_stack_lvl+0x4a/0x63 Aug 22 11:53:44 juju-e4d256-prod-github-runner-207 kernel: [23398.757604] dump_stack+0x10/0x16 Aug 22 11:53:44 juju-e4d256-prod-github-runner-207 kernel: [23398.758324] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 11:53:44 juju-e4d256-prod-github-runner-207 kernel: [23398.759114] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 11:53:44 juju-e4d256-prod-github-runner-207 kernel: [23398.759985] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 11:53:44 juju-e4d256-prod-github-runner-207 kernel: [23398.760820] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 11:53:44 juju-e4d256-prod-github-runner-207 kernel: [23398.761645] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 11:53:44 juju-e4d256-prod-github-runner-207 kernel: [23398.762454] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 11:53:44 juju-e4d256-prod-github-runner-207 kernel: [23398.763228] print_cpu_stall.cold+0x2f/0xe2 Aug 22 11:53:44 juju-e4d256-prod-github-runner-207 kernel: [23398.764014] ? timekeeping_update+0xf7/0x150 Aug 22 11:53:44 juju-e4d256-prod-github-runner-207 kernel: [23398.764808] check_cpu_stall+0x109/0x270 Aug 22 11:53:44 juju-e4d256-prod-github-runner-207 kernel: [23398.765558] rcu_sched_clock_irq+0x9a/0x250 Aug 22 11:53:44 juju-e4d256-prod-github-runner-207 kernel: [23398.766347] update_process_times+0x94/0xd0 Aug 22 11:53:44 juju-e4d256-prod-github-runner-207 kernel: [23398.767123] tick_sched_handle+0x29/0x70 Aug 22 11:53:44 juju-e4d256-prod-github-runner-207 kernel: [23398.767882] tick_sched_timer+0x8c/0xc0 Aug 22 11:53:44 juju-e4d256-prod-github-runner-207 kernel: [23398.768626] ? tick_nohz_handler+0xb0/0xb0 Aug 22 11:53:44 juju-e4d256-prod-github-runner-207 kernel: [23398.769382] __hrtimer_run_queues+0x107/0x230 Aug 22 11:53:44 juju-e4d256-prod-github-runner-207 kernel: [23398.770155] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 11:53:44 juju-e4d256-prod-github-runner-207 kernel: [23398.770937] hrtimer_interrupt+0x101/0x220 Aug 22 11:53:44 juju-e4d256-prod-github-runner-207 kernel: [23398.771705] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 11:53:44 juju-e4d256-prod-github-runner-207 kernel: [23398.772524] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 11:53:44 juju-e4d256-prod-github-runner-207 kernel: [23398.773327] Aug 22 11:53:44 juju-e4d256-prod-github-runner-207 kernel: [23398.773963] Aug 22 11:53:44 juju-e4d256-prod-github-runner-207 kernel: [23398.774598] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 11:53:44 juju-e4d256-prod-github-runner-207 kernel: [23398.775417] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:53:44 juju-e4d256-prod-github-runner-207 kernel: [23398.776309] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 11:53:44 juju-e4d256-prod-github-runner-207 kernel: [23398.778535] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 11:53:44 juju-e4d256-prod-github-runner-207 kernel: [23398.779417] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 11:53:44 juju-e4d256-prod-github-runner-207 kernel: [23398.780420] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 11:53:44 juju-e4d256-prod-github-runner-207 kernel: [23398.781395] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 11:53:44 juju-e4d256-prod-github-runner-207 kernel: [23398.782355] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 11:53:44 juju-e4d256-prod-github-runner-207 kernel: [23398.783312] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 11:53:44 juju-e4d256-prod-github-runner-207 kernel: [23398.784270] ? _raw_spin_lock+0x22/0x30 Aug 22 11:53:44 juju-e4d256-prod-github-runner-207 kernel: [23398.785026] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:53:44 juju-e4d256-prod-github-runner-207 kernel: [23398.785874] direct_page_fault+0x206/0x310 [kvm] Aug 22 11:53:44 juju-e4d256-prod-github-runner-207 kernel: [23398.786720] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 11:53:44 juju-e4d256-prod-github-runner-207 kernel: [23398.787564] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 11:53:44 juju-e4d256-prod-github-runner-207 kernel: [23398.788409] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 11:53:44 juju-e4d256-prod-github-runner-207 kernel: [23398.789212] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 11:53:44 juju-e4d256-prod-github-runner-207 kernel: [23398.789997] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 11:53:44 juju-e4d256-prod-github-runner-207 kernel: [23398.790835] handle_exit+0x98/0x230 [kvm_amd] Aug 22 11:53:44 juju-e4d256-prod-github-runner-207 kernel: [23398.791621] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 11:53:44 juju-e4d256-prod-github-runner-207 kernel: [23398.792409] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 11:53:44 juju-e4d256-prod-github-runner-207 kernel: [23398.793209] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 11:53:44 juju-e4d256-prod-github-runner-207 kernel: [23398.793995] vcpu_run+0x62/0x2c0 [kvm] Aug 22 11:53:44 juju-e4d256-prod-github-runner-207 kernel: [23398.794732] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 11:53:44 juju-e4d256-prod-github-runner-207 kernel: [23398.795468] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 11:53:44 juju-e4d256-prod-github-runner-207 kernel: [23398.796292] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 11:53:44 juju-e4d256-prod-github-runner-207 kernel: [23398.797058] ? __seccomp_filter+0x4a/0x4a0 Aug 22 11:53:44 juju-e4d256-prod-github-runner-207 kernel: [23398.797806] ? __fget_files+0x86/0xc0 Aug 22 11:53:44 juju-e4d256-prod-github-runner-207 kernel: [23398.798504] __x64_sys_ioctl+0x95/0xd0 Aug 22 11:53:44 juju-e4d256-prod-github-runner-207 kernel: [23398.799199] do_syscall_64+0x5c/0xc0 Aug 22 11:53:44 juju-e4d256-prod-github-runner-207 kernel: [23398.799891] ? do_futex+0x162/0x1f0 Aug 22 11:53:44 juju-e4d256-prod-github-runner-207 kernel: [23398.800562] ? __x64_sys_futex+0x78/0x1e0 Aug 22 11:53:44 juju-e4d256-prod-github-runner-207 kernel: [23398.801263] ? __secure_computing+0xa9/0x120 Aug 22 11:53:44 juju-e4d256-prod-github-runner-207 kernel: [23398.801984] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 11:53:44 juju-e4d256-prod-github-runner-207 kernel: [23398.802774] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:53:44 juju-e4d256-prod-github-runner-207 kernel: [23398.803533] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:53:44 juju-e4d256-prod-github-runner-207 kernel: [23398.804346] ? do_syscall_64+0x69/0xc0 Aug 22 11:53:44 juju-e4d256-prod-github-runner-207 kernel: [23398.805054] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:53:44 juju-e4d256-prod-github-runner-207 kernel: [23398.805813] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:53:44 juju-e4d256-prod-github-runner-207 kernel: [23398.806577] ? do_syscall_64+0x69/0xc0 Aug 22 11:53:44 juju-e4d256-prod-github-runner-207 kernel: [23398.807275] ? do_syscall_64+0x69/0xc0 Aug 22 11:53:44 juju-e4d256-prod-github-runner-207 kernel: [23398.808010] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 11:53:44 juju-e4d256-prod-github-runner-207 kernel: [23398.808796] RIP: 0033:0x7faa5d0edaff Aug 22 11:53:44 juju-e4d256-prod-github-runner-207 kernel: [23398.809480] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 11:53:44 juju-e4d256-prod-github-runner-207 kernel: [23398.811588] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 11:53:44 juju-e4d256-prod-github-runner-207 kernel: [23398.812548] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 11:53:44 juju-e4d256-prod-github-runner-207 kernel: [23398.813501] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 11:53:44 juju-e4d256-prod-github-runner-207 kernel: [23398.814444] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 11:53:44 juju-e4d256-prod-github-runner-207 kernel: [23398.815382] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 11:53:44 juju-e4d256-prod-github-runner-207 kernel: [23398.816323] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 11:53:44 juju-e4d256-prod-github-runner-207 kernel: [23398.817268] Aug 22 11:54:10 juju-e4d256-prod-github-runner-207 kernel: [23424.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 21707s! [qemu-system-x86:6715] Aug 22 11:54:10 juju-e4d256-prod-github-runner-207 kernel: [23424.543123] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 11:54:10 juju-e4d256-prod-github-runner-207 kernel: [23424.543220] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 11:54:10 juju-e4d256-prod-github-runner-207 kernel: [23424.555624] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 11:54:10 juju-e4d256-prod-github-runner-207 kernel: [23424.556894] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 11:54:10 juju-e4d256-prod-github-runner-207 kernel: [23424.558125] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:54:10 juju-e4d256-prod-github-runner-207 kernel: [23424.559186] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 11:54:10 juju-e4d256-prod-github-runner-207 kernel: [23424.561764] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 11:54:10 juju-e4d256-prod-github-runner-207 kernel: [23424.562811] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 11:54:10 juju-e4d256-prod-github-runner-207 kernel: [23424.563992] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 11:54:10 juju-e4d256-prod-github-runner-207 kernel: [23424.565154] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 11:54:10 juju-e4d256-prod-github-runner-207 kernel: [23424.566324] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 11:54:10 juju-e4d256-prod-github-runner-207 kernel: [23424.567521] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 11:54:10 juju-e4d256-prod-github-runner-207 kernel: [23424.568688] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 11:54:10 juju-e4d256-prod-github-runner-207 kernel: [23424.569923] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 11:54:10 juju-e4d256-prod-github-runner-207 kernel: [23424.571025] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 11:54:10 juju-e4d256-prod-github-runner-207 kernel: [23424.572246] Call Trace: Aug 22 11:54:10 juju-e4d256-prod-github-runner-207 kernel: [23424.573179] Aug 22 11:54:10 juju-e4d256-prod-github-runner-207 kernel: [23424.574063] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:54:10 juju-e4d256-prod-github-runner-207 kernel: [23424.575095] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:54:10 juju-e4d256-prod-github-runner-207 kernel: [23424.576281] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:54:10 juju-e4d256-prod-github-runner-207 kernel: [23424.577355] ? show_regs.part.0+0x23/0x29 Aug 22 11:54:10 juju-e4d256-prod-github-runner-207 kernel: [23424.578356] ? show_regs.cold+0x8/0xd Aug 22 11:54:10 juju-e4d256-prod-github-runner-207 kernel: [23424.579348] ? watchdog_timer_fn+0x1be/0x220 Aug 22 11:54:10 juju-e4d256-prod-github-runner-207 kernel: [23424.580355] ? lockup_detector_update_enable+0x60/0x60 Aug 22 11:54:10 juju-e4d256-prod-github-runner-207 kernel: [23424.581421] ? __hrtimer_run_queues+0x107/0x230 Aug 22 11:54:10 juju-e4d256-prod-github-runner-207 kernel: [23424.582454] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 11:54:10 juju-e4d256-prod-github-runner-207 kernel: [23424.583487] ? hrtimer_interrupt+0x101/0x220 Aug 22 11:54:10 juju-e4d256-prod-github-runner-207 kernel: [23424.584513] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 11:54:10 juju-e4d256-prod-github-runner-207 kernel: [23424.585600] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 11:54:10 juju-e4d256-prod-github-runner-207 kernel: [23424.586648] Aug 22 11:54:10 juju-e4d256-prod-github-runner-207 kernel: [23424.587511] Aug 22 11:54:10 juju-e4d256-prod-github-runner-207 kernel: [23424.588348] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 11:54:10 juju-e4d256-prod-github-runner-207 kernel: [23424.589379] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:54:10 juju-e4d256-prod-github-runner-207 kernel: [23424.590417] ? _raw_spin_lock+0x22/0x30 Aug 22 11:54:10 juju-e4d256-prod-github-runner-207 kernel: [23424.591379] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:54:10 juju-e4d256-prod-github-runner-207 kernel: [23424.592434] direct_page_fault+0x206/0x310 [kvm] Aug 22 11:54:10 juju-e4d256-prod-github-runner-207 kernel: [23424.593777] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 11:54:10 juju-e4d256-prod-github-runner-207 kernel: [23424.595218] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 11:54:10 juju-e4d256-prod-github-runner-207 kernel: [23424.596660] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 11:54:10 juju-e4d256-prod-github-runner-207 kernel: [23424.597845] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 11:54:10 juju-e4d256-prod-github-runner-207 kernel: [23424.598851] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 11:54:10 juju-e4d256-prod-github-runner-207 kernel: [23424.599892] handle_exit+0x98/0x230 [kvm_amd] Aug 22 11:54:10 juju-e4d256-prod-github-runner-207 kernel: [23424.600979] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 11:54:10 juju-e4d256-prod-github-runner-207 kernel: [23424.601950] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 11:54:10 juju-e4d256-prod-github-runner-207 kernel: [23424.602881] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 11:54:10 juju-e4d256-prod-github-runner-207 kernel: [23424.603806] vcpu_run+0x62/0x2c0 [kvm] Aug 22 11:54:10 juju-e4d256-prod-github-runner-207 kernel: [23424.604620] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 11:54:10 juju-e4d256-prod-github-runner-207 kernel: [23424.605435] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 11:54:10 juju-e4d256-prod-github-runner-207 kernel: [23424.606293] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 11:54:10 juju-e4d256-prod-github-runner-207 kernel: [23424.607090] ? __seccomp_filter+0x4a/0x4a0 Aug 22 11:54:10 juju-e4d256-prod-github-runner-207 kernel: [23424.607847] ? __fget_files+0x86/0xc0 Aug 22 11:54:10 juju-e4d256-prod-github-runner-207 kernel: [23424.608549] __x64_sys_ioctl+0x95/0xd0 Aug 22 11:54:10 juju-e4d256-prod-github-runner-207 kernel: [23424.609241] do_syscall_64+0x5c/0xc0 Aug 22 11:54:10 juju-e4d256-prod-github-runner-207 kernel: [23424.609904] ? do_futex+0x162/0x1f0 Aug 22 11:54:10 juju-e4d256-prod-github-runner-207 kernel: [23424.610552] ? __x64_sys_futex+0x78/0x1e0 Aug 22 11:54:10 juju-e4d256-prod-github-runner-207 kernel: [23424.611224] ? __secure_computing+0xa9/0x120 Aug 22 11:54:10 juju-e4d256-prod-github-runner-207 kernel: [23424.611947] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 11:54:10 juju-e4d256-prod-github-runner-207 kernel: [23424.612711] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:54:10 juju-e4d256-prod-github-runner-207 kernel: [23424.613433] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:54:10 juju-e4d256-prod-github-runner-207 kernel: [23424.614151] ? do_syscall_64+0x69/0xc0 Aug 22 11:54:10 juju-e4d256-prod-github-runner-207 kernel: [23424.614816] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:54:10 juju-e4d256-prod-github-runner-207 kernel: [23424.615630] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:54:10 juju-e4d256-prod-github-runner-207 kernel: [23424.616332] ? do_syscall_64+0x69/0xc0 Aug 22 11:54:10 juju-e4d256-prod-github-runner-207 kernel: [23424.616962] ? do_syscall_64+0x69/0xc0 Aug 22 11:54:10 juju-e4d256-prod-github-runner-207 kernel: [23424.617586] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 11:54:10 juju-e4d256-prod-github-runner-207 kernel: [23424.618292] RIP: 0033:0x7faa5d0edaff Aug 22 11:54:10 juju-e4d256-prod-github-runner-207 kernel: [23424.618915] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 11:54:10 juju-e4d256-prod-github-runner-207 kernel: [23424.620914] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 11:54:10 juju-e4d256-prod-github-runner-207 kernel: [23424.621823] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 11:54:10 juju-e4d256-prod-github-runner-207 kernel: [23424.622801] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 11:54:10 juju-e4d256-prod-github-runner-207 kernel: [23424.624177] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 11:54:10 juju-e4d256-prod-github-runner-207 kernel: [23424.625562] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 11:54:10 juju-e4d256-prod-github-runner-207 kernel: [23424.626944] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 11:54:10 juju-e4d256-prod-github-runner-207 kernel: [23424.628330] Aug 22 11:54:38 juju-e4d256-prod-github-runner-207 kernel: [23452.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 21733s! [qemu-system-x86:6715] Aug 22 11:54:38 juju-e4d256-prod-github-runner-207 kernel: [23452.543918] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 11:54:38 juju-e4d256-prod-github-runner-207 kernel: [23452.544234] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 11:54:38 juju-e4d256-prod-github-runner-207 kernel: [23452.556838] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 11:54:38 juju-e4d256-prod-github-runner-207 kernel: [23452.558131] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 11:54:38 juju-e4d256-prod-github-runner-207 kernel: [23452.559390] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:54:38 juju-e4d256-prod-github-runner-207 kernel: [23452.560468] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 11:54:38 juju-e4d256-prod-github-runner-207 kernel: [23452.563105] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 11:54:38 juju-e4d256-prod-github-runner-207 kernel: [23452.564162] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 11:54:38 juju-e4d256-prod-github-runner-207 kernel: [23452.565393] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 11:54:38 juju-e4d256-prod-github-runner-207 kernel: [23452.566581] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 11:54:38 juju-e4d256-prod-github-runner-207 kernel: [23452.567804] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 11:54:38 juju-e4d256-prod-github-runner-207 kernel: [23452.569006] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 11:54:38 juju-e4d256-prod-github-runner-207 kernel: [23452.570210] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 11:54:38 juju-e4d256-prod-github-runner-207 kernel: [23452.571490] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 11:54:38 juju-e4d256-prod-github-runner-207 kernel: [23452.572641] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 11:54:38 juju-e4d256-prod-github-runner-207 kernel: [23452.573872] Call Trace: Aug 22 11:54:38 juju-e4d256-prod-github-runner-207 kernel: [23452.574795] Aug 22 11:54:38 juju-e4d256-prod-github-runner-207 kernel: [23452.575748] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:54:38 juju-e4d256-prod-github-runner-207 kernel: [23452.576806] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:54:38 juju-e4d256-prod-github-runner-207 kernel: [23452.577853] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:54:38 juju-e4d256-prod-github-runner-207 kernel: [23452.578981] ? show_regs.part.0+0x23/0x29 Aug 22 11:54:38 juju-e4d256-prod-github-runner-207 kernel: [23452.579999] ? show_regs.cold+0x8/0xd Aug 22 11:54:38 juju-e4d256-prod-github-runner-207 kernel: [23452.580995] ? watchdog_timer_fn+0x1be/0x220 Aug 22 11:54:38 juju-e4d256-prod-github-runner-207 kernel: [23452.582026] ? lockup_detector_update_enable+0x60/0x60 Aug 22 11:54:38 juju-e4d256-prod-github-runner-207 kernel: [23452.583114] ? __hrtimer_run_queues+0x107/0x230 Aug 22 11:54:38 juju-e4d256-prod-github-runner-207 kernel: [23452.584156] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 11:54:38 juju-e4d256-prod-github-runner-207 kernel: [23452.585214] ? hrtimer_interrupt+0x101/0x220 Aug 22 11:54:38 juju-e4d256-prod-github-runner-207 kernel: [23452.586253] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 11:54:38 juju-e4d256-prod-github-runner-207 kernel: [23452.587355] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 11:54:38 juju-e4d256-prod-github-runner-207 kernel: [23452.588435] Aug 22 11:54:38 juju-e4d256-prod-github-runner-207 kernel: [23452.589300] Aug 22 11:54:38 juju-e4d256-prod-github-runner-207 kernel: [23452.590148] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 11:54:38 juju-e4d256-prod-github-runner-207 kernel: [23452.591220] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:54:38 juju-e4d256-prod-github-runner-207 kernel: [23452.592286] ? _raw_spin_lock+0x22/0x30 Aug 22 11:54:38 juju-e4d256-prod-github-runner-207 kernel: [23452.593249] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:54:38 juju-e4d256-prod-github-runner-207 kernel: [23452.594283] direct_page_fault+0x206/0x310 [kvm] Aug 22 11:54:38 juju-e4d256-prod-github-runner-207 kernel: [23452.595333] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 11:54:38 juju-e4d256-prod-github-runner-207 kernel: [23452.596404] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 11:54:38 juju-e4d256-prod-github-runner-207 kernel: [23452.597437] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 11:54:38 juju-e4d256-prod-github-runner-207 kernel: [23452.598458] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 11:54:38 juju-e4d256-prod-github-runner-207 kernel: [23452.599455] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 11:54:38 juju-e4d256-prod-github-runner-207 kernel: [23452.600462] handle_exit+0x98/0x230 [kvm_amd] Aug 22 11:54:38 juju-e4d256-prod-github-runner-207 kernel: [23452.601378] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 11:54:38 juju-e4d256-prod-github-runner-207 kernel: [23452.602308] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 11:54:38 juju-e4d256-prod-github-runner-207 kernel: [23452.603297] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 11:54:38 juju-e4d256-prod-github-runner-207 kernel: [23452.604237] vcpu_run+0x62/0x2c0 [kvm] Aug 22 11:54:38 juju-e4d256-prod-github-runner-207 kernel: [23452.605062] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 11:54:38 juju-e4d256-prod-github-runner-207 kernel: [23452.605902] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 11:54:38 juju-e4d256-prod-github-runner-207 kernel: [23452.606789] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 11:54:38 juju-e4d256-prod-github-runner-207 kernel: [23452.607618] ? __seccomp_filter+0x4a/0x4a0 Aug 22 11:54:38 juju-e4d256-prod-github-runner-207 kernel: [23452.608370] ? __fget_files+0x86/0xc0 Aug 22 11:54:38 juju-e4d256-prod-github-runner-207 kernel: [23452.609101] __x64_sys_ioctl+0x95/0xd0 Aug 22 11:54:38 juju-e4d256-prod-github-runner-207 kernel: [23452.609836] do_syscall_64+0x5c/0xc0 Aug 22 11:54:38 juju-e4d256-prod-github-runner-207 kernel: [23452.610513] ? do_futex+0x162/0x1f0 Aug 22 11:54:38 juju-e4d256-prod-github-runner-207 kernel: [23452.611187] ? __x64_sys_futex+0x78/0x1e0 Aug 22 11:54:38 juju-e4d256-prod-github-runner-207 kernel: [23452.611892] ? __secure_computing+0xa9/0x120 Aug 22 11:54:38 juju-e4d256-prod-github-runner-207 kernel: [23452.612615] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 11:54:38 juju-e4d256-prod-github-runner-207 kernel: [23452.613397] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:54:38 juju-e4d256-prod-github-runner-207 kernel: [23452.614139] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:54:38 juju-e4d256-prod-github-runner-207 kernel: [23452.614867] ? do_syscall_64+0x69/0xc0 Aug 22 11:54:38 juju-e4d256-prod-github-runner-207 kernel: [23452.615549] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:54:38 juju-e4d256-prod-github-runner-207 kernel: [23452.616283] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:54:38 juju-e4d256-prod-github-runner-207 kernel: [23452.617001] ? do_syscall_64+0x69/0xc0 Aug 22 11:54:38 juju-e4d256-prod-github-runner-207 kernel: [23452.617638] ? do_syscall_64+0x69/0xc0 Aug 22 11:54:38 juju-e4d256-prod-github-runner-207 kernel: [23452.618277] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 11:54:38 juju-e4d256-prod-github-runner-207 kernel: [23452.619043] RIP: 0033:0x7faa5d0edaff Aug 22 11:54:38 juju-e4d256-prod-github-runner-207 kernel: [23452.619726] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 11:54:38 juju-e4d256-prod-github-runner-207 kernel: [23452.621792] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 11:54:38 juju-e4d256-prod-github-runner-207 kernel: [23452.622740] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 11:54:38 juju-e4d256-prod-github-runner-207 kernel: [23452.623674] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 11:54:38 juju-e4d256-prod-github-runner-207 kernel: [23452.624582] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 11:54:38 juju-e4d256-prod-github-runner-207 kernel: [23452.625526] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 11:54:38 juju-e4d256-prod-github-runner-207 kernel: [23452.626578] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 11:54:38 juju-e4d256-prod-github-runner-207 kernel: [23452.627509] Aug 22 11:55:06 juju-e4d256-prod-github-runner-207 kernel: [23480.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 21759s! [qemu-system-x86:6715] Aug 22 11:55:06 juju-e4d256-prod-github-runner-207 kernel: [23480.543121] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 11:55:06 juju-e4d256-prod-github-runner-207 kernel: [23480.543197] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 11:55:06 juju-e4d256-prod-github-runner-207 kernel: [23480.555360] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 11:55:06 juju-e4d256-prod-github-runner-207 kernel: [23480.556633] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 11:55:06 juju-e4d256-prod-github-runner-207 kernel: [23480.557860] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:55:06 juju-e4d256-prod-github-runner-207 kernel: [23480.558920] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 11:55:06 juju-e4d256-prod-github-runner-207 kernel: [23480.561472] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 11:55:06 juju-e4d256-prod-github-runner-207 kernel: [23480.562513] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 11:55:06 juju-e4d256-prod-github-runner-207 kernel: [23480.563687] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 11:55:06 juju-e4d256-prod-github-runner-207 kernel: [23480.564845] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 11:55:06 juju-e4d256-prod-github-runner-207 kernel: [23480.566001] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 11:55:06 juju-e4d256-prod-github-runner-207 kernel: [23480.567179] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 11:55:06 juju-e4d256-prod-github-runner-207 kernel: [23480.568343] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 11:55:06 juju-e4d256-prod-github-runner-207 kernel: [23480.569573] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 11:55:06 juju-e4d256-prod-github-runner-207 kernel: [23480.570683] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 11:55:06 juju-e4d256-prod-github-runner-207 kernel: [23480.571875] Call Trace: Aug 22 11:55:06 juju-e4d256-prod-github-runner-207 kernel: [23480.572791] Aug 22 11:55:06 juju-e4d256-prod-github-runner-207 kernel: [23480.573679] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:55:06 juju-e4d256-prod-github-runner-207 kernel: [23480.574721] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:55:06 juju-e4d256-prod-github-runner-207 kernel: [23480.575777] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:55:06 juju-e4d256-prod-github-runner-207 kernel: [23480.576855] ? show_regs.part.0+0x23/0x29 Aug 22 11:55:06 juju-e4d256-prod-github-runner-207 kernel: [23480.577852] ? show_regs.cold+0x8/0xd Aug 22 11:55:06 juju-e4d256-prod-github-runner-207 kernel: [23480.578871] ? watchdog_timer_fn+0x1be/0x220 Aug 22 11:55:06 juju-e4d256-prod-github-runner-207 kernel: [23480.579902] ? lockup_detector_update_enable+0x60/0x60 Aug 22 11:55:06 juju-e4d256-prod-github-runner-207 kernel: [23480.580966] ? __hrtimer_run_queues+0x107/0x230 Aug 22 11:55:06 juju-e4d256-prod-github-runner-207 kernel: [23480.582047] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 11:55:06 juju-e4d256-prod-github-runner-207 kernel: [23480.583085] ? hrtimer_interrupt+0x101/0x220 Aug 22 11:55:06 juju-e4d256-prod-github-runner-207 kernel: [23480.584105] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 11:55:06 juju-e4d256-prod-github-runner-207 kernel: [23480.585197] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 11:55:06 juju-e4d256-prod-github-runner-207 kernel: [23480.586248] Aug 22 11:55:06 juju-e4d256-prod-github-runner-207 kernel: [23480.587107] Aug 22 11:55:06 juju-e4d256-prod-github-runner-207 kernel: [23480.587944] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 11:55:06 juju-e4d256-prod-github-runner-207 kernel: [23480.588976] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:55:06 juju-e4d256-prod-github-runner-207 kernel: [23480.590014] ? _raw_spin_lock+0x22/0x30 Aug 22 11:55:06 juju-e4d256-prod-github-runner-207 kernel: [23480.590964] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:55:06 juju-e4d256-prod-github-runner-207 kernel: [23480.591990] direct_page_fault+0x206/0x310 [kvm] Aug 22 11:55:06 juju-e4d256-prod-github-runner-207 kernel: [23480.593021] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 11:55:06 juju-e4d256-prod-github-runner-207 kernel: [23480.594035] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 11:55:06 juju-e4d256-prod-github-runner-207 kernel: [23480.595052] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 11:55:06 juju-e4d256-prod-github-runner-207 kernel: [23480.596025] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 11:55:06 juju-e4d256-prod-github-runner-207 kernel: [23480.596972] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 11:55:06 juju-e4d256-prod-github-runner-207 kernel: [23480.597951] handle_exit+0x98/0x230 [kvm_amd] Aug 22 11:55:06 juju-e4d256-prod-github-runner-207 kernel: [23480.598873] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 11:55:06 juju-e4d256-prod-github-runner-207 kernel: [23480.600025] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 11:55:06 juju-e4d256-prod-github-runner-207 kernel: [23480.601091] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 11:55:06 juju-e4d256-prod-github-runner-207 kernel: [23480.602025] vcpu_run+0x62/0x2c0 [kvm] Aug 22 11:55:06 juju-e4d256-prod-github-runner-207 kernel: [23480.602878] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 11:55:06 juju-e4d256-prod-github-runner-207 kernel: [23480.603690] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 11:55:06 juju-e4d256-prod-github-runner-207 kernel: [23480.604565] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 11:55:06 juju-e4d256-prod-github-runner-207 kernel: [23480.605362] ? __seccomp_filter+0x4a/0x4a0 Aug 22 11:55:06 juju-e4d256-prod-github-runner-207 kernel: [23480.606145] ? __fget_files+0x86/0xc0 Aug 22 11:55:06 juju-e4d256-prod-github-runner-207 kernel: [23480.607138] __x64_sys_ioctl+0x95/0xd0 Aug 22 11:55:06 juju-e4d256-prod-github-runner-207 kernel: [23480.607951] do_syscall_64+0x5c/0xc0 Aug 22 11:55:06 juju-e4d256-prod-github-runner-207 kernel: [23480.608718] ? do_futex+0x162/0x1f0 Aug 22 11:55:06 juju-e4d256-prod-github-runner-207 kernel: [23480.609514] ? __x64_sys_futex+0x78/0x1e0 Aug 22 11:55:06 juju-e4d256-prod-github-runner-207 kernel: [23480.610355] ? __secure_computing+0xa9/0x120 Aug 22 11:55:06 juju-e4d256-prod-github-runner-207 kernel: [23480.611206] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 11:55:06 juju-e4d256-prod-github-runner-207 kernel: [23480.611978] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:55:06 juju-e4d256-prod-github-runner-207 kernel: [23480.612700] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:55:06 juju-e4d256-prod-github-runner-207 kernel: [23480.613486] ? do_syscall_64+0x69/0xc0 Aug 22 11:55:06 juju-e4d256-prod-github-runner-207 kernel: [23480.614148] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:55:06 juju-e4d256-prod-github-runner-207 kernel: [23480.614871] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:55:06 juju-e4d256-prod-github-runner-207 kernel: [23480.615568] ? do_syscall_64+0x69/0xc0 Aug 22 11:55:06 juju-e4d256-prod-github-runner-207 kernel: [23480.616197] ? do_syscall_64+0x69/0xc0 Aug 22 11:55:06 juju-e4d256-prod-github-runner-207 kernel: [23480.616838] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 11:55:06 juju-e4d256-prod-github-runner-207 kernel: [23480.617548] RIP: 0033:0x7faa5d0edaff Aug 22 11:55:06 juju-e4d256-prod-github-runner-207 kernel: [23480.618177] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 11:55:06 juju-e4d256-prod-github-runner-207 kernel: [23480.620211] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 11:55:06 juju-e4d256-prod-github-runner-207 kernel: [23480.621125] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 11:55:06 juju-e4d256-prod-github-runner-207 kernel: [23480.622015] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 11:55:06 juju-e4d256-prod-github-runner-207 kernel: [23480.622935] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 11:55:06 juju-e4d256-prod-github-runner-207 kernel: [23480.623826] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 11:55:06 juju-e4d256-prod-github-runner-207 kernel: [23480.624713] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 11:55:06 juju-e4d256-prod-github-runner-207 kernel: [23480.625629] Aug 22 11:55:34 juju-e4d256-prod-github-runner-207 kernel: [23508.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 21786s! [qemu-system-x86:6715] Aug 22 11:55:34 juju-e4d256-prod-github-runner-207 kernel: [23508.543099] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 11:55:34 juju-e4d256-prod-github-runner-207 kernel: [23508.543173] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 11:55:34 juju-e4d256-prod-github-runner-207 kernel: [23508.555241] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 11:55:34 juju-e4d256-prod-github-runner-207 kernel: [23508.556505] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 11:55:34 juju-e4d256-prod-github-runner-207 kernel: [23508.557724] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:55:34 juju-e4d256-prod-github-runner-207 kernel: [23508.558793] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 11:55:34 juju-e4d256-prod-github-runner-207 kernel: [23508.561359] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 11:55:34 juju-e4d256-prod-github-runner-207 kernel: [23508.562416] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 11:55:34 juju-e4d256-prod-github-runner-207 kernel: [23508.563772] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 11:55:34 juju-e4d256-prod-github-runner-207 kernel: [23508.564938] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 11:55:34 juju-e4d256-prod-github-runner-207 kernel: [23508.566290] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 11:55:34 juju-e4d256-prod-github-runner-207 kernel: [23508.567471] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 11:55:34 juju-e4d256-prod-github-runner-207 kernel: [23508.568646] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 11:55:34 juju-e4d256-prod-github-runner-207 kernel: [23508.569899] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 11:55:34 juju-e4d256-prod-github-runner-207 kernel: [23508.571022] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 11:55:34 juju-e4d256-prod-github-runner-207 kernel: [23508.572240] Call Trace: Aug 22 11:55:34 juju-e4d256-prod-github-runner-207 kernel: [23508.573159] Aug 22 11:55:34 juju-e4d256-prod-github-runner-207 kernel: [23508.574053] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:55:34 juju-e4d256-prod-github-runner-207 kernel: [23508.575108] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:55:34 juju-e4d256-prod-github-runner-207 kernel: [23508.576141] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:55:34 juju-e4d256-prod-github-runner-207 kernel: [23508.577260] ? show_regs.part.0+0x23/0x29 Aug 22 11:55:34 juju-e4d256-prod-github-runner-207 kernel: [23508.578308] ? show_regs.cold+0x8/0xd Aug 22 11:55:34 juju-e4d256-prod-github-runner-207 kernel: [23508.579305] ? watchdog_timer_fn+0x1be/0x220 Aug 22 11:55:34 juju-e4d256-prod-github-runner-207 kernel: [23508.580318] ? lockup_detector_update_enable+0x60/0x60 Aug 22 11:55:34 juju-e4d256-prod-github-runner-207 kernel: [23508.581381] ? __hrtimer_run_queues+0x107/0x230 Aug 22 11:55:34 juju-e4d256-prod-github-runner-207 kernel: [23508.582423] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 11:55:34 juju-e4d256-prod-github-runner-207 kernel: [23508.583471] ? hrtimer_interrupt+0x101/0x220 Aug 22 11:55:34 juju-e4d256-prod-github-runner-207 kernel: [23508.584489] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 11:55:34 juju-e4d256-prod-github-runner-207 kernel: [23508.585563] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 11:55:34 juju-e4d256-prod-github-runner-207 kernel: [23508.586661] Aug 22 11:55:34 juju-e4d256-prod-github-runner-207 kernel: [23508.587533] Aug 22 11:55:34 juju-e4d256-prod-github-runner-207 kernel: [23508.588374] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 11:55:34 juju-e4d256-prod-github-runner-207 kernel: [23508.589412] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:55:34 juju-e4d256-prod-github-runner-207 kernel: [23508.590473] ? _raw_spin_lock+0x22/0x30 Aug 22 11:55:34 juju-e4d256-prod-github-runner-207 kernel: [23508.591425] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:55:34 juju-e4d256-prod-github-runner-207 kernel: [23508.592447] direct_page_fault+0x206/0x310 [kvm] Aug 22 11:55:34 juju-e4d256-prod-github-runner-207 kernel: [23508.593470] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 11:55:34 juju-e4d256-prod-github-runner-207 kernel: [23508.594491] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 11:55:34 juju-e4d256-prod-github-runner-207 kernel: [23508.595497] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 11:55:34 juju-e4d256-prod-github-runner-207 kernel: [23508.596465] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 11:55:34 juju-e4d256-prod-github-runner-207 kernel: [23508.597410] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 11:55:34 juju-e4d256-prod-github-runner-207 kernel: [23508.598399] handle_exit+0x98/0x230 [kvm_amd] Aug 22 11:55:34 juju-e4d256-prod-github-runner-207 kernel: [23508.599315] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 11:55:34 juju-e4d256-prod-github-runner-207 kernel: [23508.600228] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 11:55:34 juju-e4d256-prod-github-runner-207 kernel: [23508.601158] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 11:55:34 juju-e4d256-prod-github-runner-207 kernel: [23508.602077] vcpu_run+0x62/0x2c0 [kvm] Aug 22 11:55:34 juju-e4d256-prod-github-runner-207 kernel: [23508.602896] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 11:55:34 juju-e4d256-prod-github-runner-207 kernel: [23508.603702] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 11:55:34 juju-e4d256-prod-github-runner-207 kernel: [23508.604555] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 11:55:34 juju-e4d256-prod-github-runner-207 kernel: [23508.605352] ? __seccomp_filter+0x4a/0x4a0 Aug 22 11:55:34 juju-e4d256-prod-github-runner-207 kernel: [23508.606104] ? __fget_files+0x86/0xc0 Aug 22 11:55:34 juju-e4d256-prod-github-runner-207 kernel: [23508.606819] __x64_sys_ioctl+0x95/0xd0 Aug 22 11:55:34 juju-e4d256-prod-github-runner-207 kernel: [23508.607511] do_syscall_64+0x5c/0xc0 Aug 22 11:55:34 juju-e4d256-prod-github-runner-207 kernel: [23508.608176] ? do_futex+0x162/0x1f0 Aug 22 11:55:34 juju-e4d256-prod-github-runner-207 kernel: [23508.608823] ? __x64_sys_futex+0x78/0x1e0 Aug 22 11:55:34 juju-e4d256-prod-github-runner-207 kernel: [23508.609501] ? __secure_computing+0xa9/0x120 Aug 22 11:55:34 juju-e4d256-prod-github-runner-207 kernel: [23508.610190] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 11:55:34 juju-e4d256-prod-github-runner-207 kernel: [23508.610955] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:55:34 juju-e4d256-prod-github-runner-207 kernel: [23508.611680] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:55:34 juju-e4d256-prod-github-runner-207 kernel: [23508.612396] ? do_syscall_64+0x69/0xc0 Aug 22 11:55:34 juju-e4d256-prod-github-runner-207 kernel: [23508.613039] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:55:34 juju-e4d256-prod-github-runner-207 kernel: [23508.613741] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:55:34 juju-e4d256-prod-github-runner-207 kernel: [23508.614448] ? do_syscall_64+0x69/0xc0 Aug 22 11:55:34 juju-e4d256-prod-github-runner-207 kernel: [23508.615072] ? do_syscall_64+0x69/0xc0 Aug 22 11:55:34 juju-e4d256-prod-github-runner-207 kernel: [23508.615698] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 11:55:34 juju-e4d256-prod-github-runner-207 kernel: [23508.616404] RIP: 0033:0x7faa5d0edaff Aug 22 11:55:34 juju-e4d256-prod-github-runner-207 kernel: [23508.617027] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 11:55:34 juju-e4d256-prod-github-runner-207 kernel: [23508.619003] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 11:55:34 juju-e4d256-prod-github-runner-207 kernel: [23508.619926] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 11:55:34 juju-e4d256-prod-github-runner-207 kernel: [23508.620817] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 11:55:34 juju-e4d256-prod-github-runner-207 kernel: [23508.621704] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 11:55:34 juju-e4d256-prod-github-runner-207 kernel: [23508.622608] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 11:55:34 juju-e4d256-prod-github-runner-207 kernel: [23508.623499] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 11:55:34 juju-e4d256-prod-github-runner-207 kernel: [23508.624389] Aug 22 11:56:02 juju-e4d256-prod-github-runner-207 kernel: [23536.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 21812s! [qemu-system-x86:6715] Aug 22 11:56:02 juju-e4d256-prod-github-runner-207 kernel: [23536.543219] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 11:56:02 juju-e4d256-prod-github-runner-207 kernel: [23536.543418] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 11:56:02 juju-e4d256-prod-github-runner-207 kernel: [23536.555470] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 11:56:02 juju-e4d256-prod-github-runner-207 kernel: [23536.556729] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 11:56:02 juju-e4d256-prod-github-runner-207 kernel: [23536.557962] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:56:02 juju-e4d256-prod-github-runner-207 kernel: [23536.559195] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 11:56:02 juju-e4d256-prod-github-runner-207 kernel: [23536.561780] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 11:56:02 juju-e4d256-prod-github-runner-207 kernel: [23536.562847] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 11:56:02 juju-e4d256-prod-github-runner-207 kernel: [23536.564011] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 11:56:02 juju-e4d256-prod-github-runner-207 kernel: [23536.565170] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 11:56:02 juju-e4d256-prod-github-runner-207 kernel: [23536.566333] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 11:56:02 juju-e4d256-prod-github-runner-207 kernel: [23536.567492] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 11:56:02 juju-e4d256-prod-github-runner-207 kernel: [23536.568656] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 11:56:02 juju-e4d256-prod-github-runner-207 kernel: [23536.570013] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 11:56:02 juju-e4d256-prod-github-runner-207 kernel: [23536.571114] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 11:56:02 juju-e4d256-prod-github-runner-207 kernel: [23536.572344] Call Trace: Aug 22 11:56:02 juju-e4d256-prod-github-runner-207 kernel: [23536.573267] Aug 22 11:56:02 juju-e4d256-prod-github-runner-207 kernel: [23536.574196] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:56:02 juju-e4d256-prod-github-runner-207 kernel: [23536.575252] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:56:02 juju-e4d256-prod-github-runner-207 kernel: [23536.576379] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:56:02 juju-e4d256-prod-github-runner-207 kernel: [23536.577480] ? show_regs.part.0+0x23/0x29 Aug 22 11:56:02 juju-e4d256-prod-github-runner-207 kernel: [23536.578489] ? show_regs.cold+0x8/0xd Aug 22 11:56:02 juju-e4d256-prod-github-runner-207 kernel: [23536.579464] ? watchdog_timer_fn+0x1be/0x220 Aug 22 11:56:02 juju-e4d256-prod-github-runner-207 kernel: [23536.580469] ? lockup_detector_update_enable+0x60/0x60 Aug 22 11:56:02 juju-e4d256-prod-github-runner-207 kernel: [23536.581551] ? __hrtimer_run_queues+0x107/0x230 Aug 22 11:56:02 juju-e4d256-prod-github-runner-207 kernel: [23536.582725] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 11:56:02 juju-e4d256-prod-github-runner-207 kernel: [23536.583776] ? hrtimer_interrupt+0x101/0x220 Aug 22 11:56:02 juju-e4d256-prod-github-runner-207 kernel: [23536.584797] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 11:56:02 juju-e4d256-prod-github-runner-207 kernel: [23536.585886] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 11:56:02 juju-e4d256-prod-github-runner-207 kernel: [23536.586952] Aug 22 11:56:02 juju-e4d256-prod-github-runner-207 kernel: [23536.587803] Aug 22 11:56:02 juju-e4d256-prod-github-runner-207 kernel: [23536.588644] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 11:56:02 juju-e4d256-prod-github-runner-207 kernel: [23536.589681] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:56:02 juju-e4d256-prod-github-runner-207 kernel: [23536.590733] ? _raw_spin_lock+0x22/0x30 Aug 22 11:56:02 juju-e4d256-prod-github-runner-207 kernel: [23536.591685] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:56:02 juju-e4d256-prod-github-runner-207 kernel: [23536.592699] direct_page_fault+0x206/0x310 [kvm] Aug 22 11:56:02 juju-e4d256-prod-github-runner-207 kernel: [23536.593729] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 11:56:02 juju-e4d256-prod-github-runner-207 kernel: [23536.594746] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 11:56:02 juju-e4d256-prod-github-runner-207 kernel: [23536.595783] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 11:56:02 juju-e4d256-prod-github-runner-207 kernel: [23536.596797] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 11:56:02 juju-e4d256-prod-github-runner-207 kernel: [23536.597747] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 11:56:02 juju-e4d256-prod-github-runner-207 kernel: [23536.598732] handle_exit+0x98/0x230 [kvm_amd] Aug 22 11:56:02 juju-e4d256-prod-github-runner-207 kernel: [23536.599626] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 11:56:02 juju-e4d256-prod-github-runner-207 kernel: [23536.600539] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 11:56:02 juju-e4d256-prod-github-runner-207 kernel: [23536.601462] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 11:56:02 juju-e4d256-prod-github-runner-207 kernel: [23536.602376] vcpu_run+0x62/0x2c0 [kvm] Aug 22 11:56:02 juju-e4d256-prod-github-runner-207 kernel: [23536.603185] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 11:56:02 juju-e4d256-prod-github-runner-207 kernel: [23536.603989] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 11:56:02 juju-e4d256-prod-github-runner-207 kernel: [23536.604845] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 11:56:02 juju-e4d256-prod-github-runner-207 kernel: [23536.605640] ? __seccomp_filter+0x4a/0x4a0 Aug 22 11:56:02 juju-e4d256-prod-github-runner-207 kernel: [23536.606388] ? __fget_files+0x86/0xc0 Aug 22 11:56:02 juju-e4d256-prod-github-runner-207 kernel: [23536.607096] __x64_sys_ioctl+0x95/0xd0 Aug 22 11:56:02 juju-e4d256-prod-github-runner-207 kernel: [23536.607790] do_syscall_64+0x5c/0xc0 Aug 22 11:56:02 juju-e4d256-prod-github-runner-207 kernel: [23536.608457] ? do_futex+0x162/0x1f0 Aug 22 11:56:02 juju-e4d256-prod-github-runner-207 kernel: [23536.609108] ? __x64_sys_futex+0x78/0x1e0 Aug 22 11:56:02 juju-e4d256-prod-github-runner-207 kernel: [23536.609781] ? __secure_computing+0xa9/0x120 Aug 22 11:56:02 juju-e4d256-prod-github-runner-207 kernel: [23536.610476] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 11:56:02 juju-e4d256-prod-github-runner-207 kernel: [23536.611244] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:56:02 juju-e4d256-prod-github-runner-207 kernel: [23536.611965] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:56:02 juju-e4d256-prod-github-runner-207 kernel: [23536.612682] ? do_syscall_64+0x69/0xc0 Aug 22 11:56:02 juju-e4d256-prod-github-runner-207 kernel: [23536.613331] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:56:02 juju-e4d256-prod-github-runner-207 kernel: [23536.614056] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:56:02 juju-e4d256-prod-github-runner-207 kernel: [23536.614750] ? do_syscall_64+0x69/0xc0 Aug 22 11:56:02 juju-e4d256-prod-github-runner-207 kernel: [23536.615378] ? do_syscall_64+0x69/0xc0 Aug 22 11:56:02 juju-e4d256-prod-github-runner-207 kernel: [23536.616004] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 11:56:02 juju-e4d256-prod-github-runner-207 kernel: [23536.616707] RIP: 0033:0x7faa5d0edaff Aug 22 11:56:02 juju-e4d256-prod-github-runner-207 kernel: [23536.617331] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 11:56:02 juju-e4d256-prod-github-runner-207 kernel: [23536.619315] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 11:56:02 juju-e4d256-prod-github-runner-207 kernel: [23536.620221] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 11:56:02 juju-e4d256-prod-github-runner-207 kernel: [23536.621112] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 11:56:02 juju-e4d256-prod-github-runner-207 kernel: [23536.622011] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 11:56:02 juju-e4d256-prod-github-runner-207 kernel: [23536.622897] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 11:56:02 juju-e4d256-prod-github-runner-207 kernel: [23536.623782] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 11:56:02 juju-e4d256-prod-github-runner-207 kernel: [23536.624679] Aug 22 11:56:30 juju-e4d256-prod-github-runner-207 kernel: [23564.541984] watchdog: BUG: soft lockup - CPU#1 stuck for 21838s! [qemu-system-x86:6715] Aug 22 11:56:30 juju-e4d256-prod-github-runner-207 kernel: [23564.544388] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 11:56:30 juju-e4d256-prod-github-runner-207 kernel: [23564.544667] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 11:56:30 juju-e4d256-prod-github-runner-207 kernel: [23564.563041] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 11:56:30 juju-e4d256-prod-github-runner-207 kernel: [23564.564686] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 11:56:30 juju-e4d256-prod-github-runner-207 kernel: [23564.566472] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:56:30 juju-e4d256-prod-github-runner-207 kernel: [23564.568043] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 11:56:30 juju-e4d256-prod-github-runner-207 kernel: [23564.571695] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 11:56:30 juju-e4d256-prod-github-runner-207 kernel: [23564.573162] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 11:56:30 juju-e4d256-prod-github-runner-207 kernel: [23564.574531] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 11:56:30 juju-e4d256-prod-github-runner-207 kernel: [23564.575695] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 11:56:30 juju-e4d256-prod-github-runner-207 kernel: [23564.576881] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 11:56:30 juju-e4d256-prod-github-runner-207 kernel: [23564.578061] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 11:56:30 juju-e4d256-prod-github-runner-207 kernel: [23564.579231] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 11:56:30 juju-e4d256-prod-github-runner-207 kernel: [23564.580473] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 11:56:30 juju-e4d256-prod-github-runner-207 kernel: [23564.581573] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 11:56:30 juju-e4d256-prod-github-runner-207 kernel: [23564.582779] Call Trace: Aug 22 11:56:30 juju-e4d256-prod-github-runner-207 kernel: [23564.583696] Aug 22 11:56:30 juju-e4d256-prod-github-runner-207 kernel: [23564.584603] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:56:30 juju-e4d256-prod-github-runner-207 kernel: [23564.585657] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:56:30 juju-e4d256-prod-github-runner-207 kernel: [23564.586687] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:56:30 juju-e4d256-prod-github-runner-207 kernel: [23564.587773] ? show_regs.part.0+0x23/0x29 Aug 22 11:56:30 juju-e4d256-prod-github-runner-207 kernel: [23564.588790] ? show_regs.cold+0x8/0xd Aug 22 11:56:30 juju-e4d256-prod-github-runner-207 kernel: [23564.589787] ? watchdog_timer_fn+0x1be/0x220 Aug 22 11:56:30 juju-e4d256-prod-github-runner-207 kernel: [23564.590799] ? lockup_detector_update_enable+0x60/0x60 Aug 22 11:56:30 juju-e4d256-prod-github-runner-207 kernel: [23564.591860] ? __hrtimer_run_queues+0x107/0x230 Aug 22 11:56:30 juju-e4d256-prod-github-runner-207 kernel: [23564.592889] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 11:56:30 juju-e4d256-prod-github-runner-207 kernel: [23564.593942] ? hrtimer_interrupt+0x101/0x220 Aug 22 11:56:30 juju-e4d256-prod-github-runner-207 kernel: [23564.594956] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 11:56:30 juju-e4d256-prod-github-runner-207 kernel: [23564.596266] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 11:56:30 juju-e4d256-prod-github-runner-207 kernel: [23564.597311] Aug 22 11:56:30 juju-e4d256-prod-github-runner-207 kernel: [23564.598286] Aug 22 11:56:30 juju-e4d256-prod-github-runner-207 kernel: [23564.599302] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 11:56:30 juju-e4d256-prod-github-runner-207 kernel: [23564.600473] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:56:30 juju-e4d256-prod-github-runner-207 kernel: [23564.601578] ? _raw_spin_lock+0x22/0x30 Aug 22 11:56:30 juju-e4d256-prod-github-runner-207 kernel: [23564.602560] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:56:30 juju-e4d256-prod-github-runner-207 kernel: [23564.603604] direct_page_fault+0x206/0x310 [kvm] Aug 22 11:56:30 juju-e4d256-prod-github-runner-207 kernel: [23564.604674] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 11:56:30 juju-e4d256-prod-github-runner-207 kernel: [23564.605803] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 11:56:30 juju-e4d256-prod-github-runner-207 kernel: [23564.606846] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 11:56:30 juju-e4d256-prod-github-runner-207 kernel: [23564.607853] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 11:56:30 juju-e4d256-prod-github-runner-207 kernel: [23564.608808] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 11:56:30 juju-e4d256-prod-github-runner-207 kernel: [23564.609850] handle_exit+0x98/0x230 [kvm_amd] Aug 22 11:56:30 juju-e4d256-prod-github-runner-207 kernel: [23564.610814] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 11:56:30 juju-e4d256-prod-github-runner-207 kernel: [23564.611785] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 11:56:30 juju-e4d256-prod-github-runner-207 kernel: [23564.612730] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 11:56:30 juju-e4d256-prod-github-runner-207 kernel: [23564.613668] vcpu_run+0x62/0x2c0 [kvm] Aug 22 11:56:30 juju-e4d256-prod-github-runner-207 kernel: [23564.614505] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 11:56:30 juju-e4d256-prod-github-runner-207 kernel: [23564.615383] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 11:56:30 juju-e4d256-prod-github-runner-207 kernel: [23564.616278] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 11:56:30 juju-e4d256-prod-github-runner-207 kernel: [23564.617095] ? __seccomp_filter+0x4a/0x4a0 Aug 22 11:56:30 juju-e4d256-prod-github-runner-207 kernel: [23564.617884] ? __fget_files+0x86/0xc0 Aug 22 11:56:30 juju-e4d256-prod-github-runner-207 kernel: [23564.618643] __x64_sys_ioctl+0x95/0xd0 Aug 22 11:56:30 juju-e4d256-prod-github-runner-207 kernel: [23564.619382] do_syscall_64+0x5c/0xc0 Aug 22 11:56:30 juju-e4d256-prod-github-runner-207 kernel: [23564.620091] ? do_futex+0x162/0x1f0 Aug 22 11:56:30 juju-e4d256-prod-github-runner-207 kernel: [23564.620815] ? __x64_sys_futex+0x78/0x1e0 Aug 22 11:56:30 juju-e4d256-prod-github-runner-207 kernel: [23564.621570] ? __secure_computing+0xa9/0x120 Aug 22 11:56:30 juju-e4d256-prod-github-runner-207 kernel: [23564.622307] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 11:56:30 juju-e4d256-prod-github-runner-207 kernel: [23564.623081] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:56:30 juju-e4d256-prod-github-runner-207 kernel: [23564.623819] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:56:30 juju-e4d256-prod-github-runner-207 kernel: [23564.624583] ? do_syscall_64+0x69/0xc0 Aug 22 11:56:30 juju-e4d256-prod-github-runner-207 kernel: [23564.625272] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:56:30 juju-e4d256-prod-github-runner-207 kernel: [23564.626075] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:56:30 juju-e4d256-prod-github-runner-207 kernel: [23564.626804] ? do_syscall_64+0x69/0xc0 Aug 22 11:56:30 juju-e4d256-prod-github-runner-207 kernel: [23564.627455] ? do_syscall_64+0x69/0xc0 Aug 22 11:56:30 juju-e4d256-prod-github-runner-207 kernel: [23564.628090] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 11:56:30 juju-e4d256-prod-github-runner-207 kernel: [23564.628834] RIP: 0033:0x7faa5d0edaff Aug 22 11:56:30 juju-e4d256-prod-github-runner-207 kernel: [23564.629538] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 11:56:30 juju-e4d256-prod-github-runner-207 kernel: [23564.631701] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 11:56:30 juju-e4d256-prod-github-runner-207 kernel: [23564.632680] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 11:56:30 juju-e4d256-prod-github-runner-207 kernel: [23564.633631] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 11:56:30 juju-e4d256-prod-github-runner-207 kernel: [23564.634562] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 11:56:30 juju-e4d256-prod-github-runner-207 kernel: [23564.635530] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 11:56:30 juju-e4d256-prod-github-runner-207 kernel: [23564.636538] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 11:56:30 juju-e4d256-prod-github-runner-207 kernel: [23564.637494] Aug 22 11:56:44 juju-e4d256-prod-github-runner-207 kernel: [23578.760706] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 11:56:44 juju-e4d256-prod-github-runner-207 kernel: [23578.761749] rcu: 1-....: (5847094 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=2830542 Aug 22 11:56:44 juju-e4d256-prod-github-runner-207 kernel: [23578.762893] (t=5865390 jiffies g=23269 q=28664) Aug 22 11:56:44 juju-e4d256-prod-github-runner-207 kernel: [23578.763683] NMI backtrace for cpu 1 Aug 22 11:56:44 juju-e4d256-prod-github-runner-207 kernel: [23578.764407] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 11:56:44 juju-e4d256-prod-github-runner-207 kernel: [23578.765537] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 11:56:44 juju-e4d256-prod-github-runner-207 kernel: [23578.766603] Call Trace: Aug 22 11:56:44 juju-e4d256-prod-github-runner-207 kernel: [23578.767281] Aug 22 11:56:44 juju-e4d256-prod-github-runner-207 kernel: [23578.767931] show_stack+0x52/0x5c Aug 22 11:56:44 juju-e4d256-prod-github-runner-207 kernel: [23578.768653] dump_stack_lvl+0x4a/0x63 Aug 22 11:56:44 juju-e4d256-prod-github-runner-207 kernel: [23578.769468] dump_stack+0x10/0x16 Aug 22 11:56:44 juju-e4d256-prod-github-runner-207 kernel: [23578.770209] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 11:56:44 juju-e4d256-prod-github-runner-207 kernel: [23578.770991] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 11:56:44 juju-e4d256-prod-github-runner-207 kernel: [23578.771771] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 11:56:44 juju-e4d256-prod-github-runner-207 kernel: [23578.772597] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 11:56:44 juju-e4d256-prod-github-runner-207 kernel: [23578.773420] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 11:56:44 juju-e4d256-prod-github-runner-207 kernel: [23578.774268] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 11:56:44 juju-e4d256-prod-github-runner-207 kernel: [23578.775053] print_cpu_stall.cold+0x2f/0xe2 Aug 22 11:56:44 juju-e4d256-prod-github-runner-207 kernel: [23578.775829] ? timekeeping_update+0xf7/0x150 Aug 22 11:56:44 juju-e4d256-prod-github-runner-207 kernel: [23578.776600] check_cpu_stall+0x109/0x270 Aug 22 11:56:44 juju-e4d256-prod-github-runner-207 kernel: [23578.777347] rcu_sched_clock_irq+0x9a/0x250 Aug 22 11:56:44 juju-e4d256-prod-github-runner-207 kernel: [23578.778129] update_process_times+0x94/0xd0 Aug 22 11:56:44 juju-e4d256-prod-github-runner-207 kernel: [23578.778885] tick_sched_handle+0x29/0x70 Aug 22 11:56:44 juju-e4d256-prod-github-runner-207 kernel: [23578.779626] tick_sched_timer+0x8c/0xc0 Aug 22 11:56:44 juju-e4d256-prod-github-runner-207 kernel: [23578.780373] ? tick_nohz_handler+0xb0/0xb0 Aug 22 11:56:44 juju-e4d256-prod-github-runner-207 kernel: [23578.781127] __hrtimer_run_queues+0x107/0x230 Aug 22 11:56:44 juju-e4d256-prod-github-runner-207 kernel: [23578.781908] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 11:56:44 juju-e4d256-prod-github-runner-207 kernel: [23578.782681] hrtimer_interrupt+0x101/0x220 Aug 22 11:56:44 juju-e4d256-prod-github-runner-207 kernel: [23578.783437] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 11:56:44 juju-e4d256-prod-github-runner-207 kernel: [23578.784258] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 11:56:44 juju-e4d256-prod-github-runner-207 kernel: [23578.785060] Aug 22 11:56:44 juju-e4d256-prod-github-runner-207 kernel: [23578.785715] Aug 22 11:56:44 juju-e4d256-prod-github-runner-207 kernel: [23578.786342] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 11:56:44 juju-e4d256-prod-github-runner-207 kernel: [23578.787164] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:56:44 juju-e4d256-prod-github-runner-207 kernel: [23578.788065] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 11:56:44 juju-e4d256-prod-github-runner-207 kernel: [23578.790317] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 11:56:44 juju-e4d256-prod-github-runner-207 kernel: [23578.791202] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 11:56:44 juju-e4d256-prod-github-runner-207 kernel: [23578.792219] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 11:56:44 juju-e4d256-prod-github-runner-207 kernel: [23578.793195] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 11:56:44 juju-e4d256-prod-github-runner-207 kernel: [23578.794184] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 11:56:44 juju-e4d256-prod-github-runner-207 kernel: [23578.795141] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 11:56:44 juju-e4d256-prod-github-runner-207 kernel: [23578.796091] ? _raw_spin_lock+0x22/0x30 Aug 22 11:56:44 juju-e4d256-prod-github-runner-207 kernel: [23578.796852] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:56:44 juju-e4d256-prod-github-runner-207 kernel: [23578.797734] direct_page_fault+0x206/0x310 [kvm] Aug 22 11:56:44 juju-e4d256-prod-github-runner-207 kernel: [23578.798571] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 11:56:44 juju-e4d256-prod-github-runner-207 kernel: [23578.799536] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 11:56:44 juju-e4d256-prod-github-runner-207 kernel: [23578.800407] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 11:56:44 juju-e4d256-prod-github-runner-207 kernel: [23578.801232] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 11:56:44 juju-e4d256-prod-github-runner-207 kernel: [23578.802054] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 11:56:44 juju-e4d256-prod-github-runner-207 kernel: [23578.802879] handle_exit+0x98/0x230 [kvm_amd] Aug 22 11:56:44 juju-e4d256-prod-github-runner-207 kernel: [23578.803638] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 11:56:44 juju-e4d256-prod-github-runner-207 kernel: [23578.804423] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 11:56:44 juju-e4d256-prod-github-runner-207 kernel: [23578.805224] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 11:56:44 juju-e4d256-prod-github-runner-207 kernel: [23578.806020] vcpu_run+0x62/0x2c0 [kvm] Aug 22 11:56:44 juju-e4d256-prod-github-runner-207 kernel: [23578.806734] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 11:56:44 juju-e4d256-prod-github-runner-207 kernel: [23578.807491] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 11:56:44 juju-e4d256-prod-github-runner-207 kernel: [23578.808305] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 11:56:44 juju-e4d256-prod-github-runner-207 kernel: [23578.809070] ? __seccomp_filter+0x4a/0x4a0 Aug 22 11:56:44 juju-e4d256-prod-github-runner-207 kernel: [23578.809805] ? __fget_files+0x86/0xc0 Aug 22 11:56:44 juju-e4d256-prod-github-runner-207 kernel: [23578.810504] __x64_sys_ioctl+0x95/0xd0 Aug 22 11:56:44 juju-e4d256-prod-github-runner-207 kernel: [23578.811218] do_syscall_64+0x5c/0xc0 Aug 22 11:56:44 juju-e4d256-prod-github-runner-207 kernel: [23578.811899] ? do_futex+0x162/0x1f0 Aug 22 11:56:44 juju-e4d256-prod-github-runner-207 kernel: [23578.812586] ? __x64_sys_futex+0x78/0x1e0 Aug 22 11:56:44 juju-e4d256-prod-github-runner-207 kernel: [23578.813291] ? __secure_computing+0xa9/0x120 Aug 22 11:56:44 juju-e4d256-prod-github-runner-207 kernel: [23578.814027] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 11:56:44 juju-e4d256-prod-github-runner-207 kernel: [23578.814826] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:56:44 juju-e4d256-prod-github-runner-207 kernel: [23578.815584] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:56:44 juju-e4d256-prod-github-runner-207 kernel: [23578.816341] ? do_syscall_64+0x69/0xc0 Aug 22 11:56:44 juju-e4d256-prod-github-runner-207 kernel: [23578.817030] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:56:44 juju-e4d256-prod-github-runner-207 kernel: [23578.817815] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:56:44 juju-e4d256-prod-github-runner-207 kernel: [23578.818582] ? do_syscall_64+0x69/0xc0 Aug 22 11:56:44 juju-e4d256-prod-github-runner-207 kernel: [23578.819276] ? do_syscall_64+0x69/0xc0 Aug 22 11:56:44 juju-e4d256-prod-github-runner-207 kernel: [23578.819962] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 11:56:44 juju-e4d256-prod-github-runner-207 kernel: [23578.820748] RIP: 0033:0x7faa5d0edaff Aug 22 11:56:44 juju-e4d256-prod-github-runner-207 kernel: [23578.821457] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 11:56:44 juju-e4d256-prod-github-runner-207 kernel: [23578.823653] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 11:56:44 juju-e4d256-prod-github-runner-207 kernel: [23578.824621] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 11:56:44 juju-e4d256-prod-github-runner-207 kernel: [23578.825599] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 11:56:44 juju-e4d256-prod-github-runner-207 kernel: [23578.826545] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 11:56:44 juju-e4d256-prod-github-runner-207 kernel: [23578.827489] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 11:56:44 juju-e4d256-prod-github-runner-207 kernel: [23578.828418] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 11:56:44 juju-e4d256-prod-github-runner-207 kernel: [23578.829338] Aug 22 11:57:10 juju-e4d256-prod-github-runner-207 kernel: [23604.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 21875s! [qemu-system-x86:6715] Aug 22 11:57:10 juju-e4d256-prod-github-runner-207 kernel: [23604.543141] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 11:57:10 juju-e4d256-prod-github-runner-207 kernel: [23604.543216] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 11:57:10 juju-e4d256-prod-github-runner-207 kernel: [23604.555590] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 11:57:10 juju-e4d256-prod-github-runner-207 kernel: [23604.556850] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 11:57:10 juju-e4d256-prod-github-runner-207 kernel: [23604.558083] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:57:10 juju-e4d256-prod-github-runner-207 kernel: [23604.559160] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 11:57:10 juju-e4d256-prod-github-runner-207 kernel: [23604.561720] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 11:57:10 juju-e4d256-prod-github-runner-207 kernel: [23604.562766] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 11:57:10 juju-e4d256-prod-github-runner-207 kernel: [23604.563926] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 11:57:10 juju-e4d256-prod-github-runner-207 kernel: [23604.565084] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 11:57:10 juju-e4d256-prod-github-runner-207 kernel: [23604.566251] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 11:57:10 juju-e4d256-prod-github-runner-207 kernel: [23604.567414] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 11:57:10 juju-e4d256-prod-github-runner-207 kernel: [23604.568583] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 11:57:10 juju-e4d256-prod-github-runner-207 kernel: [23604.569824] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 11:57:10 juju-e4d256-prod-github-runner-207 kernel: [23604.570920] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 11:57:10 juju-e4d256-prod-github-runner-207 kernel: [23604.572114] Call Trace: Aug 22 11:57:10 juju-e4d256-prod-github-runner-207 kernel: [23604.573025] Aug 22 11:57:10 juju-e4d256-prod-github-runner-207 kernel: [23604.573938] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:57:10 juju-e4d256-prod-github-runner-207 kernel: [23604.574975] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:57:10 juju-e4d256-prod-github-runner-207 kernel: [23604.575995] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:57:10 juju-e4d256-prod-github-runner-207 kernel: [23604.577069] ? show_regs.part.0+0x23/0x29 Aug 22 11:57:10 juju-e4d256-prod-github-runner-207 kernel: [23604.578079] ? show_regs.cold+0x8/0xd Aug 22 11:57:10 juju-e4d256-prod-github-runner-207 kernel: [23604.579049] ? watchdog_timer_fn+0x1be/0x220 Aug 22 11:57:10 juju-e4d256-prod-github-runner-207 kernel: [23604.580054] ? lockup_detector_update_enable+0x60/0x60 Aug 22 11:57:10 juju-e4d256-prod-github-runner-207 kernel: [23604.581119] ? __hrtimer_run_queues+0x107/0x230 Aug 22 11:57:10 juju-e4d256-prod-github-runner-207 kernel: [23604.582152] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 11:57:10 juju-e4d256-prod-github-runner-207 kernel: [23604.583192] ? hrtimer_interrupt+0x101/0x220 Aug 22 11:57:10 juju-e4d256-prod-github-runner-207 kernel: [23604.584240] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 11:57:10 juju-e4d256-prod-github-runner-207 kernel: [23604.585320] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 11:57:10 juju-e4d256-prod-github-runner-207 kernel: [23604.586367] Aug 22 11:57:10 juju-e4d256-prod-github-runner-207 kernel: [23604.587218] Aug 22 11:57:10 juju-e4d256-prod-github-runner-207 kernel: [23604.588057] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 11:57:10 juju-e4d256-prod-github-runner-207 kernel: [23604.589088] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:57:10 juju-e4d256-prod-github-runner-207 kernel: [23604.590134] ? _raw_spin_lock+0x22/0x30 Aug 22 11:57:10 juju-e4d256-prod-github-runner-207 kernel: [23604.591084] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:57:10 juju-e4d256-prod-github-runner-207 kernel: [23604.592104] direct_page_fault+0x206/0x310 [kvm] Aug 22 11:57:10 juju-e4d256-prod-github-runner-207 kernel: [23604.593135] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 11:57:10 juju-e4d256-prod-github-runner-207 kernel: [23604.594147] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 11:57:10 juju-e4d256-prod-github-runner-207 kernel: [23604.595145] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 11:57:10 juju-e4d256-prod-github-runner-207 kernel: [23604.596226] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 11:57:10 juju-e4d256-prod-github-runner-207 kernel: [23604.597175] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 11:57:10 juju-e4d256-prod-github-runner-207 kernel: [23604.598151] handle_exit+0x98/0x230 [kvm_amd] Aug 22 11:57:10 juju-e4d256-prod-github-runner-207 kernel: [23604.599041] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 11:57:10 juju-e4d256-prod-github-runner-207 kernel: [23604.599957] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 11:57:10 juju-e4d256-prod-github-runner-207 kernel: [23604.600876] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 11:57:10 juju-e4d256-prod-github-runner-207 kernel: [23604.601795] vcpu_run+0x62/0x2c0 [kvm] Aug 22 11:57:10 juju-e4d256-prod-github-runner-207 kernel: [23604.602602] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 11:57:10 juju-e4d256-prod-github-runner-207 kernel: [23604.603414] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 11:57:10 juju-e4d256-prod-github-runner-207 kernel: [23604.604268] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 11:57:10 juju-e4d256-prod-github-runner-207 kernel: [23604.605062] ? __seccomp_filter+0x4a/0x4a0 Aug 22 11:57:10 juju-e4d256-prod-github-runner-207 kernel: [23604.605815] ? __fget_files+0x86/0xc0 Aug 22 11:57:10 juju-e4d256-prod-github-runner-207 kernel: [23604.606521] __x64_sys_ioctl+0x95/0xd0 Aug 22 11:57:10 juju-e4d256-prod-github-runner-207 kernel: [23604.607211] do_syscall_64+0x5c/0xc0 Aug 22 11:57:10 juju-e4d256-prod-github-runner-207 kernel: [23604.607878] ? do_futex+0x162/0x1f0 Aug 22 11:57:10 juju-e4d256-prod-github-runner-207 kernel: [23604.608524] ? __x64_sys_futex+0x78/0x1e0 Aug 22 11:57:10 juju-e4d256-prod-github-runner-207 kernel: [23604.609209] ? __secure_computing+0xa9/0x120 Aug 22 11:57:10 juju-e4d256-prod-github-runner-207 kernel: [23604.609897] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 11:57:10 juju-e4d256-prod-github-runner-207 kernel: [23604.610656] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:57:10 juju-e4d256-prod-github-runner-207 kernel: [23604.611380] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:57:10 juju-e4d256-prod-github-runner-207 kernel: [23604.612098] ? do_syscall_64+0x69/0xc0 Aug 22 11:57:10 juju-e4d256-prod-github-runner-207 kernel: [23604.612759] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:57:10 juju-e4d256-prod-github-runner-207 kernel: [23604.613483] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:57:10 juju-e4d256-prod-github-runner-207 kernel: [23604.614178] ? do_syscall_64+0x69/0xc0 Aug 22 11:57:10 juju-e4d256-prod-github-runner-207 kernel: [23604.614801] ? do_syscall_64+0x69/0xc0 Aug 22 11:57:10 juju-e4d256-prod-github-runner-207 kernel: [23604.615426] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 11:57:10 juju-e4d256-prod-github-runner-207 kernel: [23604.616129] RIP: 0033:0x7faa5d0edaff Aug 22 11:57:10 juju-e4d256-prod-github-runner-207 kernel: [23604.616753] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 11:57:10 juju-e4d256-prod-github-runner-207 kernel: [23604.618758] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 11:57:10 juju-e4d256-prod-github-runner-207 kernel: [23604.619687] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 11:57:10 juju-e4d256-prod-github-runner-207 kernel: [23604.620586] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 11:57:10 juju-e4d256-prod-github-runner-207 kernel: [23604.621507] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 11:57:10 juju-e4d256-prod-github-runner-207 kernel: [23604.622393] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 11:57:10 juju-e4d256-prod-github-runner-207 kernel: [23604.623282] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 11:57:10 juju-e4d256-prod-github-runner-207 kernel: [23604.624177] Aug 22 11:57:38 juju-e4d256-prod-github-runner-207 kernel: [23632.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 21901s! [qemu-system-x86:6715] Aug 22 11:57:38 juju-e4d256-prod-github-runner-207 kernel: [23632.543216] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 11:57:38 juju-e4d256-prod-github-runner-207 kernel: [23632.543515] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 11:57:38 juju-e4d256-prod-github-runner-207 kernel: [23632.555939] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 11:57:38 juju-e4d256-prod-github-runner-207 kernel: [23632.557261] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 11:57:38 juju-e4d256-prod-github-runner-207 kernel: [23632.558489] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:57:38 juju-e4d256-prod-github-runner-207 kernel: [23632.559628] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 11:57:38 juju-e4d256-prod-github-runner-207 kernel: [23632.562548] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 11:57:38 juju-e4d256-prod-github-runner-207 kernel: [23632.563707] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 11:57:38 juju-e4d256-prod-github-runner-207 kernel: [23632.565031] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 11:57:38 juju-e4d256-prod-github-runner-207 kernel: [23632.566328] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 11:57:38 juju-e4d256-prod-github-runner-207 kernel: [23632.567618] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 11:57:38 juju-e4d256-prod-github-runner-207 kernel: [23632.568924] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 11:57:38 juju-e4d256-prod-github-runner-207 kernel: [23632.570222] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 11:57:38 juju-e4d256-prod-github-runner-207 kernel: [23632.571609] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 11:57:38 juju-e4d256-prod-github-runner-207 kernel: [23632.572828] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 11:57:38 juju-e4d256-prod-github-runner-207 kernel: [23632.574152] Call Trace: Aug 22 11:57:38 juju-e4d256-prod-github-runner-207 kernel: [23632.575117] Aug 22 11:57:38 juju-e4d256-prod-github-runner-207 kernel: [23632.576061] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:57:38 juju-e4d256-prod-github-runner-207 kernel: [23632.577194] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:57:38 juju-e4d256-prod-github-runner-207 kernel: [23632.578314] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:57:38 juju-e4d256-prod-github-runner-207 kernel: [23632.579507] ? show_regs.part.0+0x23/0x29 Aug 22 11:57:38 juju-e4d256-prod-github-runner-207 kernel: [23632.580583] ? show_regs.cold+0x8/0xd Aug 22 11:57:38 juju-e4d256-prod-github-runner-207 kernel: [23632.581655] ? watchdog_timer_fn+0x1be/0x220 Aug 22 11:57:38 juju-e4d256-prod-github-runner-207 kernel: [23632.582753] ? lockup_detector_update_enable+0x60/0x60 Aug 22 11:57:38 juju-e4d256-prod-github-runner-207 kernel: [23632.583926] ? __hrtimer_run_queues+0x107/0x230 Aug 22 11:57:38 juju-e4d256-prod-github-runner-207 kernel: [23632.585068] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 11:57:38 juju-e4d256-prod-github-runner-207 kernel: [23632.586185] ? hrtimer_interrupt+0x101/0x220 Aug 22 11:57:38 juju-e4d256-prod-github-runner-207 kernel: [23632.587287] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 11:57:38 juju-e4d256-prod-github-runner-207 kernel: [23632.588451] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 11:57:38 juju-e4d256-prod-github-runner-207 kernel: [23632.589602] Aug 22 11:57:38 juju-e4d256-prod-github-runner-207 kernel: [23632.590498] Aug 22 11:57:38 juju-e4d256-prod-github-runner-207 kernel: [23632.591378] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 11:57:38 juju-e4d256-prod-github-runner-207 kernel: [23632.592524] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:57:38 juju-e4d256-prod-github-runner-207 kernel: [23632.593699] ? _raw_spin_lock+0x22/0x30 Aug 22 11:57:38 juju-e4d256-prod-github-runner-207 kernel: [23632.594721] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:57:38 juju-e4d256-prod-github-runner-207 kernel: [23632.595874] direct_page_fault+0x206/0x310 [kvm] Aug 22 11:57:38 juju-e4d256-prod-github-runner-207 kernel: [23632.597007] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 11:57:38 juju-e4d256-prod-github-runner-207 kernel: [23632.598112] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 11:57:38 juju-e4d256-prod-github-runner-207 kernel: [23632.599204] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 11:57:38 juju-e4d256-prod-github-runner-207 kernel: [23632.600286] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 11:57:38 juju-e4d256-prod-github-runner-207 kernel: [23632.601339] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 11:57:38 juju-e4d256-prod-github-runner-207 kernel: [23632.602423] handle_exit+0x98/0x230 [kvm_amd] Aug 22 11:57:38 juju-e4d256-prod-github-runner-207 kernel: [23632.603404] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 11:57:38 juju-e4d256-prod-github-runner-207 kernel: [23632.604402] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 11:57:38 juju-e4d256-prod-github-runner-207 kernel: [23632.605431] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 11:57:38 juju-e4d256-prod-github-runner-207 kernel: [23632.606428] vcpu_run+0x62/0x2c0 [kvm] Aug 22 11:57:38 juju-e4d256-prod-github-runner-207 kernel: [23632.607311] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 11:57:38 juju-e4d256-prod-github-runner-207 kernel: [23632.608208] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 11:57:38 juju-e4d256-prod-github-runner-207 kernel: [23632.609166] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 11:57:38 juju-e4d256-prod-github-runner-207 kernel: [23632.610048] ? __seccomp_filter+0x4a/0x4a0 Aug 22 11:57:38 juju-e4d256-prod-github-runner-207 kernel: [23632.610919] ? __fget_files+0x86/0xc0 Aug 22 11:57:38 juju-e4d256-prod-github-runner-207 kernel: [23632.611694] __x64_sys_ioctl+0x95/0xd0 Aug 22 11:57:38 juju-e4d256-prod-github-runner-207 kernel: [23632.612459] do_syscall_64+0x5c/0xc0 Aug 22 11:57:38 juju-e4d256-prod-github-runner-207 kernel: [23632.613211] ? do_futex+0x162/0x1f0 Aug 22 11:57:38 juju-e4d256-prod-github-runner-207 kernel: [23632.613929] ? __x64_sys_futex+0x78/0x1e0 Aug 22 11:57:38 juju-e4d256-prod-github-runner-207 kernel: [23632.614688] ? __secure_computing+0xa9/0x120 Aug 22 11:57:38 juju-e4d256-prod-github-runner-207 kernel: [23632.615518] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 11:57:38 juju-e4d256-prod-github-runner-207 kernel: [23632.616449] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:57:38 juju-e4d256-prod-github-runner-207 kernel: [23632.617296] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:57:38 juju-e4d256-prod-github-runner-207 kernel: [23632.618112] ? do_syscall_64+0x69/0xc0 Aug 22 11:57:38 juju-e4d256-prod-github-runner-207 kernel: [23632.618837] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:57:38 juju-e4d256-prod-github-runner-207 kernel: [23632.619645] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:57:38 juju-e4d256-prod-github-runner-207 kernel: [23632.620439] ? do_syscall_64+0x69/0xc0 Aug 22 11:57:38 juju-e4d256-prod-github-runner-207 kernel: [23632.621164] ? do_syscall_64+0x69/0xc0 Aug 22 11:57:38 juju-e4d256-prod-github-runner-207 kernel: [23632.621866] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 11:57:38 juju-e4d256-prod-github-runner-207 kernel: [23632.622670] RIP: 0033:0x7faa5d0edaff Aug 22 11:57:38 juju-e4d256-prod-github-runner-207 kernel: [23632.623415] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 11:57:38 juju-e4d256-prod-github-runner-207 kernel: [23632.625763] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 11:57:38 juju-e4d256-prod-github-runner-207 kernel: [23632.626822] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 11:57:38 juju-e4d256-prod-github-runner-207 kernel: [23632.627844] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 11:57:38 juju-e4d256-prod-github-runner-207 kernel: [23632.628877] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 11:57:38 juju-e4d256-prod-github-runner-207 kernel: [23632.629898] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 11:57:38 juju-e4d256-prod-github-runner-207 kernel: [23632.630924] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 11:57:38 juju-e4d256-prod-github-runner-207 kernel: [23632.631949] Aug 22 11:58:06 juju-e4d256-prod-github-runner-207 kernel: [23660.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 21927s! [qemu-system-x86:6715] Aug 22 11:58:06 juju-e4d256-prod-github-runner-207 kernel: [23660.543809] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 11:58:06 juju-e4d256-prod-github-runner-207 kernel: [23660.543988] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 11:58:06 juju-e4d256-prod-github-runner-207 kernel: [23660.556154] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 11:58:06 juju-e4d256-prod-github-runner-207 kernel: [23660.557457] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 11:58:06 juju-e4d256-prod-github-runner-207 kernel: [23660.558700] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:58:06 juju-e4d256-prod-github-runner-207 kernel: [23660.559771] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 11:58:06 juju-e4d256-prod-github-runner-207 kernel: [23660.562324] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 11:58:06 juju-e4d256-prod-github-runner-207 kernel: [23660.563369] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 11:58:06 juju-e4d256-prod-github-runner-207 kernel: [23660.564550] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 11:58:06 juju-e4d256-prod-github-runner-207 kernel: [23660.565714] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 11:58:06 juju-e4d256-prod-github-runner-207 kernel: [23660.566872] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 11:58:06 juju-e4d256-prod-github-runner-207 kernel: [23660.568030] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 11:58:06 juju-e4d256-prod-github-runner-207 kernel: [23660.569310] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 11:58:06 juju-e4d256-prod-github-runner-207 kernel: [23660.570555] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 11:58:06 juju-e4d256-prod-github-runner-207 kernel: [23660.571658] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 11:58:06 juju-e4d256-prod-github-runner-207 kernel: [23660.572872] Call Trace: Aug 22 11:58:06 juju-e4d256-prod-github-runner-207 kernel: [23660.573788] Aug 22 11:58:06 juju-e4d256-prod-github-runner-207 kernel: [23660.574687] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:58:06 juju-e4d256-prod-github-runner-207 kernel: [23660.575732] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:58:06 juju-e4d256-prod-github-runner-207 kernel: [23660.576769] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:58:06 juju-e4d256-prod-github-runner-207 kernel: [23660.577843] ? show_regs.part.0+0x23/0x29 Aug 22 11:58:06 juju-e4d256-prod-github-runner-207 kernel: [23660.578842] ? show_regs.cold+0x8/0xd Aug 22 11:58:06 juju-e4d256-prod-github-runner-207 kernel: [23660.579823] ? watchdog_timer_fn+0x1be/0x220 Aug 22 11:58:06 juju-e4d256-prod-github-runner-207 kernel: [23660.580853] ? lockup_detector_update_enable+0x60/0x60 Aug 22 11:58:06 juju-e4d256-prod-github-runner-207 kernel: [23660.581921] ? __hrtimer_run_queues+0x107/0x230 Aug 22 11:58:06 juju-e4d256-prod-github-runner-207 kernel: [23660.582948] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 11:58:06 juju-e4d256-prod-github-runner-207 kernel: [23660.583976] ? hrtimer_interrupt+0x101/0x220 Aug 22 11:58:06 juju-e4d256-prod-github-runner-207 kernel: [23660.585009] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 11:58:06 juju-e4d256-prod-github-runner-207 kernel: [23660.586079] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 11:58:06 juju-e4d256-prod-github-runner-207 kernel: [23660.587133] Aug 22 11:58:06 juju-e4d256-prod-github-runner-207 kernel: [23660.587985] Aug 22 11:58:06 juju-e4d256-prod-github-runner-207 kernel: [23660.588943] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 11:58:06 juju-e4d256-prod-github-runner-207 kernel: [23660.590049] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:58:06 juju-e4d256-prod-github-runner-207 kernel: [23660.591114] ? _raw_spin_lock+0x22/0x30 Aug 22 11:58:06 juju-e4d256-prod-github-runner-207 kernel: [23660.592274] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:58:06 juju-e4d256-prod-github-runner-207 kernel: [23660.593323] direct_page_fault+0x206/0x310 [kvm] Aug 22 11:58:06 juju-e4d256-prod-github-runner-207 kernel: [23660.594345] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 11:58:06 juju-e4d256-prod-github-runner-207 kernel: [23660.595373] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 11:58:06 juju-e4d256-prod-github-runner-207 kernel: [23660.596376] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 11:58:06 juju-e4d256-prod-github-runner-207 kernel: [23660.597376] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 11:58:06 juju-e4d256-prod-github-runner-207 kernel: [23660.598354] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 11:58:06 juju-e4d256-prod-github-runner-207 kernel: [23660.599466] handle_exit+0x98/0x230 [kvm_amd] Aug 22 11:58:06 juju-e4d256-prod-github-runner-207 kernel: [23660.600412] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 11:58:06 juju-e4d256-prod-github-runner-207 kernel: [23660.601360] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 11:58:06 juju-e4d256-prod-github-runner-207 kernel: [23660.602290] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 11:58:06 juju-e4d256-prod-github-runner-207 kernel: [23660.603198] vcpu_run+0x62/0x2c0 [kvm] Aug 22 11:58:06 juju-e4d256-prod-github-runner-207 kernel: [23660.604009] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 11:58:06 juju-e4d256-prod-github-runner-207 kernel: [23660.604847] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 11:58:06 juju-e4d256-prod-github-runner-207 kernel: [23660.605729] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 11:58:06 juju-e4d256-prod-github-runner-207 kernel: [23660.606529] ? __seccomp_filter+0x4a/0x4a0 Aug 22 11:58:06 juju-e4d256-prod-github-runner-207 kernel: [23660.607272] ? __fget_files+0x86/0xc0 Aug 22 11:58:06 juju-e4d256-prod-github-runner-207 kernel: [23660.607975] __x64_sys_ioctl+0x95/0xd0 Aug 22 11:58:06 juju-e4d256-prod-github-runner-207 kernel: [23660.608683] do_syscall_64+0x5c/0xc0 Aug 22 11:58:06 juju-e4d256-prod-github-runner-207 kernel: [23660.609397] ? do_futex+0x162/0x1f0 Aug 22 11:58:06 juju-e4d256-prod-github-runner-207 kernel: [23660.610060] ? __x64_sys_futex+0x78/0x1e0 Aug 22 11:58:06 juju-e4d256-prod-github-runner-207 kernel: [23660.610745] ? __secure_computing+0xa9/0x120 Aug 22 11:58:06 juju-e4d256-prod-github-runner-207 kernel: [23660.611437] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 11:58:06 juju-e4d256-prod-github-runner-207 kernel: [23660.612235] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:58:06 juju-e4d256-prod-github-runner-207 kernel: [23660.612989] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:58:06 juju-e4d256-prod-github-runner-207 kernel: [23660.613730] ? do_syscall_64+0x69/0xc0 Aug 22 11:58:06 juju-e4d256-prod-github-runner-207 kernel: [23660.614414] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:58:06 juju-e4d256-prod-github-runner-207 kernel: [23660.615118] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:58:06 juju-e4d256-prod-github-runner-207 kernel: [23660.615831] ? do_syscall_64+0x69/0xc0 Aug 22 11:58:06 juju-e4d256-prod-github-runner-207 kernel: [23660.616458] ? do_syscall_64+0x69/0xc0 Aug 22 11:58:06 juju-e4d256-prod-github-runner-207 kernel: [23660.617095] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 11:58:06 juju-e4d256-prod-github-runner-207 kernel: [23660.617799] RIP: 0033:0x7faa5d0edaff Aug 22 11:58:06 juju-e4d256-prod-github-runner-207 kernel: [23660.618439] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 11:58:06 juju-e4d256-prod-github-runner-207 kernel: [23660.620508] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 11:58:06 juju-e4d256-prod-github-runner-207 kernel: [23660.621463] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 11:58:06 juju-e4d256-prod-github-runner-207 kernel: [23660.622423] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 11:58:06 juju-e4d256-prod-github-runner-207 kernel: [23660.623310] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 11:58:06 juju-e4d256-prod-github-runner-207 kernel: [23660.624201] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 11:58:06 juju-e4d256-prod-github-runner-207 kernel: [23660.625115] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 11:58:06 juju-e4d256-prod-github-runner-207 kernel: [23660.626041] Aug 22 11:58:34 juju-e4d256-prod-github-runner-207 kernel: [23688.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 21953s! [qemu-system-x86:6715] Aug 22 11:58:34 juju-e4d256-prod-github-runner-207 kernel: [23688.543161] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 11:58:34 juju-e4d256-prod-github-runner-207 kernel: [23688.543240] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 11:58:34 juju-e4d256-prod-github-runner-207 kernel: [23688.559629] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 11:58:34 juju-e4d256-prod-github-runner-207 kernel: [23688.560904] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 11:58:34 juju-e4d256-prod-github-runner-207 kernel: [23688.562122] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:58:34 juju-e4d256-prod-github-runner-207 kernel: [23688.563176] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 11:58:34 juju-e4d256-prod-github-runner-207 kernel: [23688.565734] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 11:58:34 juju-e4d256-prod-github-runner-207 kernel: [23688.566780] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 11:58:34 juju-e4d256-prod-github-runner-207 kernel: [23688.567942] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 11:58:34 juju-e4d256-prod-github-runner-207 kernel: [23688.569110] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 11:58:34 juju-e4d256-prod-github-runner-207 kernel: [23688.570273] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 11:58:34 juju-e4d256-prod-github-runner-207 kernel: [23688.571435] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 11:58:34 juju-e4d256-prod-github-runner-207 kernel: [23688.572618] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 11:58:34 juju-e4d256-prod-github-runner-207 kernel: [23688.573857] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 11:58:34 juju-e4d256-prod-github-runner-207 kernel: [23688.574954] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 11:58:34 juju-e4d256-prod-github-runner-207 kernel: [23688.576188] Call Trace: Aug 22 11:58:34 juju-e4d256-prod-github-runner-207 kernel: [23688.577100] Aug 22 11:58:34 juju-e4d256-prod-github-runner-207 kernel: [23688.577986] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:58:34 juju-e4d256-prod-github-runner-207 kernel: [23688.579020] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:58:34 juju-e4d256-prod-github-runner-207 kernel: [23688.580040] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:58:34 juju-e4d256-prod-github-runner-207 kernel: [23688.581141] ? show_regs.part.0+0x23/0x29 Aug 22 11:58:34 juju-e4d256-prod-github-runner-207 kernel: [23688.582155] ? show_regs.cold+0x8/0xd Aug 22 11:58:34 juju-e4d256-prod-github-runner-207 kernel: [23688.583128] ? watchdog_timer_fn+0x1be/0x220 Aug 22 11:58:34 juju-e4d256-prod-github-runner-207 kernel: [23688.584167] ? lockup_detector_update_enable+0x60/0x60 Aug 22 11:58:34 juju-e4d256-prod-github-runner-207 kernel: [23688.585235] ? __hrtimer_run_queues+0x107/0x230 Aug 22 11:58:34 juju-e4d256-prod-github-runner-207 kernel: [23688.586266] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 11:58:34 juju-e4d256-prod-github-runner-207 kernel: [23688.587436] ? hrtimer_interrupt+0x101/0x220 Aug 22 11:58:34 juju-e4d256-prod-github-runner-207 kernel: [23688.588952] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 11:58:34 juju-e4d256-prod-github-runner-207 kernel: [23688.590588] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 11:58:34 juju-e4d256-prod-github-runner-207 kernel: [23688.592168] Aug 22 11:58:34 juju-e4d256-prod-github-runner-207 kernel: [23688.593377] Aug 22 11:58:34 juju-e4d256-prod-github-runner-207 kernel: [23688.594565] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 11:58:34 juju-e4d256-prod-github-runner-207 kernel: [23688.596097] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:58:34 juju-e4d256-prod-github-runner-207 kernel: [23688.597640] ? _raw_spin_lock+0x22/0x30 Aug 22 11:58:34 juju-e4d256-prod-github-runner-207 kernel: [23688.599018] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:58:34 juju-e4d256-prod-github-runner-207 kernel: [23688.600480] direct_page_fault+0x206/0x310 [kvm] Aug 22 11:58:34 juju-e4d256-prod-github-runner-207 kernel: [23688.601739] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 11:58:34 juju-e4d256-prod-github-runner-207 kernel: [23688.602768] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 11:58:34 juju-e4d256-prod-github-runner-207 kernel: [23688.603848] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 11:58:34 juju-e4d256-prod-github-runner-207 kernel: [23688.604838] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 11:58:34 juju-e4d256-prod-github-runner-207 kernel: [23688.605785] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 11:58:34 juju-e4d256-prod-github-runner-207 kernel: [23688.606762] handle_exit+0x98/0x230 [kvm_amd] Aug 22 11:58:34 juju-e4d256-prod-github-runner-207 kernel: [23688.607655] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 11:58:34 juju-e4d256-prod-github-runner-207 kernel: [23688.608590] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 11:58:34 juju-e4d256-prod-github-runner-207 kernel: [23688.609516] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 11:58:34 juju-e4d256-prod-github-runner-207 kernel: [23688.610424] vcpu_run+0x62/0x2c0 [kvm] Aug 22 11:58:34 juju-e4d256-prod-github-runner-207 kernel: [23688.611242] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 11:58:34 juju-e4d256-prod-github-runner-207 kernel: [23688.612088] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 11:58:34 juju-e4d256-prod-github-runner-207 kernel: [23688.612957] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 11:58:34 juju-e4d256-prod-github-runner-207 kernel: [23688.613756] ? __seccomp_filter+0x4a/0x4a0 Aug 22 11:58:34 juju-e4d256-prod-github-runner-207 kernel: [23688.614499] ? __fget_files+0x86/0xc0 Aug 22 11:58:34 juju-e4d256-prod-github-runner-207 kernel: [23688.615205] __x64_sys_ioctl+0x95/0xd0 Aug 22 11:58:34 juju-e4d256-prod-github-runner-207 kernel: [23688.615948] do_syscall_64+0x5c/0xc0 Aug 22 11:58:34 juju-e4d256-prod-github-runner-207 kernel: [23688.616641] ? do_futex+0x162/0x1f0 Aug 22 11:58:34 juju-e4d256-prod-github-runner-207 kernel: [23688.617291] ? __x64_sys_futex+0x78/0x1e0 Aug 22 11:58:34 juju-e4d256-prod-github-runner-207 kernel: [23688.617964] ? __secure_computing+0xa9/0x120 Aug 22 11:58:34 juju-e4d256-prod-github-runner-207 kernel: [23688.618653] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 11:58:34 juju-e4d256-prod-github-runner-207 kernel: [23688.619421] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:58:34 juju-e4d256-prod-github-runner-207 kernel: [23688.620155] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:58:34 juju-e4d256-prod-github-runner-207 kernel: [23688.620874] ? do_syscall_64+0x69/0xc0 Aug 22 11:58:34 juju-e4d256-prod-github-runner-207 kernel: [23688.621580] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:58:34 juju-e4d256-prod-github-runner-207 kernel: [23688.622495] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:58:34 juju-e4d256-prod-github-runner-207 kernel: [23688.623216] ? do_syscall_64+0x69/0xc0 Aug 22 11:58:34 juju-e4d256-prod-github-runner-207 kernel: [23688.623855] ? do_syscall_64+0x69/0xc0 Aug 22 11:58:34 juju-e4d256-prod-github-runner-207 kernel: [23688.624515] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 11:58:34 juju-e4d256-prod-github-runner-207 kernel: [23688.625227] RIP: 0033:0x7faa5d0edaff Aug 22 11:58:34 juju-e4d256-prod-github-runner-207 kernel: [23688.625863] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 11:58:34 juju-e4d256-prod-github-runner-207 kernel: [23688.627886] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 11:58:34 juju-e4d256-prod-github-runner-207 kernel: [23688.628864] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 11:58:34 juju-e4d256-prod-github-runner-207 kernel: [23688.629768] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 11:58:34 juju-e4d256-prod-github-runner-207 kernel: [23688.630706] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 11:58:34 juju-e4d256-prod-github-runner-207 kernel: [23688.631670] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 11:58:34 juju-e4d256-prod-github-runner-207 kernel: [23688.632631] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 11:58:34 juju-e4d256-prod-github-runner-207 kernel: [23688.633541] Aug 22 11:59:02 juju-e4d256-prod-github-runner-207 kernel: [23716.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 21979s! [qemu-system-x86:6715] Aug 22 11:59:02 juju-e4d256-prod-github-runner-207 kernel: [23716.543094] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 11:59:02 juju-e4d256-prod-github-runner-207 kernel: [23716.543169] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 11:59:02 juju-e4d256-prod-github-runner-207 kernel: [23716.555359] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 11:59:02 juju-e4d256-prod-github-runner-207 kernel: [23716.556635] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 11:59:02 juju-e4d256-prod-github-runner-207 kernel: [23716.557854] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:59:02 juju-e4d256-prod-github-runner-207 kernel: [23716.558910] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 11:59:02 juju-e4d256-prod-github-runner-207 kernel: [23716.561462] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 11:59:02 juju-e4d256-prod-github-runner-207 kernel: [23716.562505] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 11:59:02 juju-e4d256-prod-github-runner-207 kernel: [23716.563673] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 11:59:02 juju-e4d256-prod-github-runner-207 kernel: [23716.564898] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 11:59:02 juju-e4d256-prod-github-runner-207 kernel: [23716.566082] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 11:59:02 juju-e4d256-prod-github-runner-207 kernel: [23716.567245] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 11:59:02 juju-e4d256-prod-github-runner-207 kernel: [23716.568425] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 11:59:02 juju-e4d256-prod-github-runner-207 kernel: [23716.569674] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 11:59:02 juju-e4d256-prod-github-runner-207 kernel: [23716.570784] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 11:59:02 juju-e4d256-prod-github-runner-207 kernel: [23716.572015] Call Trace: Aug 22 11:59:02 juju-e4d256-prod-github-runner-207 kernel: [23716.572942] Aug 22 11:59:02 juju-e4d256-prod-github-runner-207 kernel: [23716.573860] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:59:02 juju-e4d256-prod-github-runner-207 kernel: [23716.574907] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:59:02 juju-e4d256-prod-github-runner-207 kernel: [23716.575959] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:59:02 juju-e4d256-prod-github-runner-207 kernel: [23716.577045] ? show_regs.part.0+0x23/0x29 Aug 22 11:59:02 juju-e4d256-prod-github-runner-207 kernel: [23716.578049] ? show_regs.cold+0x8/0xd Aug 22 11:59:02 juju-e4d256-prod-github-runner-207 kernel: [23716.579023] ? watchdog_timer_fn+0x1be/0x220 Aug 22 11:59:02 juju-e4d256-prod-github-runner-207 kernel: [23716.580051] ? lockup_detector_update_enable+0x60/0x60 Aug 22 11:59:02 juju-e4d256-prod-github-runner-207 kernel: [23716.581116] ? __hrtimer_run_queues+0x107/0x230 Aug 22 11:59:02 juju-e4d256-prod-github-runner-207 kernel: [23716.582151] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 11:59:02 juju-e4d256-prod-github-runner-207 kernel: [23716.583176] ? hrtimer_interrupt+0x101/0x220 Aug 22 11:59:02 juju-e4d256-prod-github-runner-207 kernel: [23716.584205] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 11:59:02 juju-e4d256-prod-github-runner-207 kernel: [23716.585279] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 11:59:02 juju-e4d256-prod-github-runner-207 kernel: [23716.586325] Aug 22 11:59:02 juju-e4d256-prod-github-runner-207 kernel: [23716.587220] Aug 22 11:59:02 juju-e4d256-prod-github-runner-207 kernel: [23716.588087] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 11:59:02 juju-e4d256-prod-github-runner-207 kernel: [23716.589171] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:59:02 juju-e4d256-prod-github-runner-207 kernel: [23716.590214] ? _raw_spin_lock+0x22/0x30 Aug 22 11:59:02 juju-e4d256-prod-github-runner-207 kernel: [23716.591200] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:59:02 juju-e4d256-prod-github-runner-207 kernel: [23716.592258] direct_page_fault+0x206/0x310 [kvm] Aug 22 11:59:02 juju-e4d256-prod-github-runner-207 kernel: [23716.593288] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 11:59:02 juju-e4d256-prod-github-runner-207 kernel: [23716.594305] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 11:59:02 juju-e4d256-prod-github-runner-207 kernel: [23716.595311] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 11:59:02 juju-e4d256-prod-github-runner-207 kernel: [23716.596298] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 11:59:02 juju-e4d256-prod-github-runner-207 kernel: [23716.597282] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 11:59:02 juju-e4d256-prod-github-runner-207 kernel: [23716.598319] handle_exit+0x98/0x230 [kvm_amd] Aug 22 11:59:02 juju-e4d256-prod-github-runner-207 kernel: [23716.599252] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 11:59:02 juju-e4d256-prod-github-runner-207 kernel: [23716.600198] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 11:59:02 juju-e4d256-prod-github-runner-207 kernel: [23716.601133] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 11:59:02 juju-e4d256-prod-github-runner-207 kernel: [23716.602050] vcpu_run+0x62/0x2c0 [kvm] Aug 22 11:59:02 juju-e4d256-prod-github-runner-207 kernel: [23716.602884] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 11:59:02 juju-e4d256-prod-github-runner-207 kernel: [23716.603733] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 11:59:02 juju-e4d256-prod-github-runner-207 kernel: [23716.604632] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 11:59:02 juju-e4d256-prod-github-runner-207 kernel: [23716.605436] ? __seccomp_filter+0x4a/0x4a0 Aug 22 11:59:02 juju-e4d256-prod-github-runner-207 kernel: [23716.606195] ? __fget_files+0x86/0xc0 Aug 22 11:59:02 juju-e4d256-prod-github-runner-207 kernel: [23716.606909] __x64_sys_ioctl+0x95/0xd0 Aug 22 11:59:02 juju-e4d256-prod-github-runner-207 kernel: [23716.607667] do_syscall_64+0x5c/0xc0 Aug 22 11:59:02 juju-e4d256-prod-github-runner-207 kernel: [23716.608373] ? do_futex+0x162/0x1f0 Aug 22 11:59:02 juju-e4d256-prod-github-runner-207 kernel: [23716.609029] ? __x64_sys_futex+0x78/0x1e0 Aug 22 11:59:02 juju-e4d256-prod-github-runner-207 kernel: [23716.609710] ? __secure_computing+0xa9/0x120 Aug 22 11:59:02 juju-e4d256-prod-github-runner-207 kernel: [23716.610402] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 11:59:02 juju-e4d256-prod-github-runner-207 kernel: [23716.611164] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:59:02 juju-e4d256-prod-github-runner-207 kernel: [23716.611902] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:59:02 juju-e4d256-prod-github-runner-207 kernel: [23716.612627] ? do_syscall_64+0x69/0xc0 Aug 22 11:59:02 juju-e4d256-prod-github-runner-207 kernel: [23716.613275] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:59:02 juju-e4d256-prod-github-runner-207 kernel: [23716.613982] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:59:02 juju-e4d256-prod-github-runner-207 kernel: [23716.614680] ? do_syscall_64+0x69/0xc0 Aug 22 11:59:02 juju-e4d256-prod-github-runner-207 kernel: [23716.615306] ? do_syscall_64+0x69/0xc0 Aug 22 11:59:02 juju-e4d256-prod-github-runner-207 kernel: [23716.615942] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 11:59:02 juju-e4d256-prod-github-runner-207 kernel: [23716.616652] RIP: 0033:0x7faa5d0edaff Aug 22 11:59:02 juju-e4d256-prod-github-runner-207 kernel: [23716.617280] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 11:59:02 juju-e4d256-prod-github-runner-207 kernel: [23716.619414] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 11:59:02 juju-e4d256-prod-github-runner-207 kernel: [23716.620336] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 11:59:02 juju-e4d256-prod-github-runner-207 kernel: [23716.621227] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 11:59:02 juju-e4d256-prod-github-runner-207 kernel: [23716.622117] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 11:59:02 juju-e4d256-prod-github-runner-207 kernel: [23716.623010] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 11:59:02 juju-e4d256-prod-github-runner-207 kernel: [23716.623915] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 11:59:02 juju-e4d256-prod-github-runner-207 kernel: [23716.624815] Aug 22 11:59:30 juju-e4d256-prod-github-runner-207 kernel: [23744.541980] watchdog: BUG: soft lockup - CPU#1 stuck for 22005s! [qemu-system-x86:6715] Aug 22 11:59:30 juju-e4d256-prod-github-runner-207 kernel: [23744.543898] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 11:59:30 juju-e4d256-prod-github-runner-207 kernel: [23744.544199] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 11:59:30 juju-e4d256-prod-github-runner-207 kernel: [23744.557248] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 11:59:30 juju-e4d256-prod-github-runner-207 kernel: [23744.558521] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 11:59:30 juju-e4d256-prod-github-runner-207 kernel: [23744.559778] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:59:30 juju-e4d256-prod-github-runner-207 kernel: [23744.560864] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 11:59:30 juju-e4d256-prod-github-runner-207 kernel: [23744.563443] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 11:59:30 juju-e4d256-prod-github-runner-207 kernel: [23744.564527] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 11:59:30 juju-e4d256-prod-github-runner-207 kernel: [23744.565987] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 11:59:30 juju-e4d256-prod-github-runner-207 kernel: [23744.567557] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 11:59:30 juju-e4d256-prod-github-runner-207 kernel: [23744.568730] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 11:59:30 juju-e4d256-prod-github-runner-207 kernel: [23744.569895] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 11:59:30 juju-e4d256-prod-github-runner-207 kernel: [23744.571066] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 11:59:30 juju-e4d256-prod-github-runner-207 kernel: [23744.572329] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 11:59:30 juju-e4d256-prod-github-runner-207 kernel: [23744.573470] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 11:59:30 juju-e4d256-prod-github-runner-207 kernel: [23744.574672] Call Trace: Aug 22 11:59:30 juju-e4d256-prod-github-runner-207 kernel: [23744.575604] Aug 22 11:59:30 juju-e4d256-prod-github-runner-207 kernel: [23744.576512] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:59:30 juju-e4d256-prod-github-runner-207 kernel: [23744.577558] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 11:59:30 juju-e4d256-prod-github-runner-207 kernel: [23744.578599] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:59:30 juju-e4d256-prod-github-runner-207 kernel: [23744.579732] ? show_regs.part.0+0x23/0x29 Aug 22 11:59:30 juju-e4d256-prod-github-runner-207 kernel: [23744.580735] ? show_regs.cold+0x8/0xd Aug 22 11:59:30 juju-e4d256-prod-github-runner-207 kernel: [23744.581708] ? watchdog_timer_fn+0x1be/0x220 Aug 22 11:59:30 juju-e4d256-prod-github-runner-207 kernel: [23744.582723] ? lockup_detector_update_enable+0x60/0x60 Aug 22 11:59:30 juju-e4d256-prod-github-runner-207 kernel: [23744.583852] ? __hrtimer_run_queues+0x107/0x230 Aug 22 11:59:30 juju-e4d256-prod-github-runner-207 kernel: [23744.584893] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 11:59:30 juju-e4d256-prod-github-runner-207 kernel: [23744.585917] ? hrtimer_interrupt+0x101/0x220 Aug 22 11:59:30 juju-e4d256-prod-github-runner-207 kernel: [23744.586931] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 11:59:30 juju-e4d256-prod-github-runner-207 kernel: [23744.588032] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 11:59:30 juju-e4d256-prod-github-runner-207 kernel: [23744.589077] Aug 22 11:59:30 juju-e4d256-prod-github-runner-207 kernel: [23744.589935] Aug 22 11:59:30 juju-e4d256-prod-github-runner-207 kernel: [23744.590776] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 11:59:30 juju-e4d256-prod-github-runner-207 kernel: [23744.591829] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:59:30 juju-e4d256-prod-github-runner-207 kernel: [23744.592876] ? _raw_spin_lock+0x22/0x30 Aug 22 11:59:30 juju-e4d256-prod-github-runner-207 kernel: [23744.593833] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:59:30 juju-e4d256-prod-github-runner-207 kernel: [23744.594871] direct_page_fault+0x206/0x310 [kvm] Aug 22 11:59:30 juju-e4d256-prod-github-runner-207 kernel: [23744.595932] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 11:59:30 juju-e4d256-prod-github-runner-207 kernel: [23744.596968] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 11:59:30 juju-e4d256-prod-github-runner-207 kernel: [23744.598086] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 11:59:30 juju-e4d256-prod-github-runner-207 kernel: [23744.599112] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 11:59:30 juju-e4d256-prod-github-runner-207 kernel: [23744.600082] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 11:59:30 juju-e4d256-prod-github-runner-207 kernel: [23744.601067] handle_exit+0x98/0x230 [kvm_amd] Aug 22 11:59:30 juju-e4d256-prod-github-runner-207 kernel: [23744.601969] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 11:59:30 juju-e4d256-prod-github-runner-207 kernel: [23744.603163] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 11:59:30 juju-e4d256-prod-github-runner-207 kernel: [23744.604183] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 11:59:30 juju-e4d256-prod-github-runner-207 kernel: [23744.605108] vcpu_run+0x62/0x2c0 [kvm] Aug 22 11:59:30 juju-e4d256-prod-github-runner-207 kernel: [23744.605926] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 11:59:30 juju-e4d256-prod-github-runner-207 kernel: [23744.606978] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 11:59:30 juju-e4d256-prod-github-runner-207 kernel: [23744.607873] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 11:59:30 juju-e4d256-prod-github-runner-207 kernel: [23744.608687] ? __seccomp_filter+0x4a/0x4a0 Aug 22 11:59:30 juju-e4d256-prod-github-runner-207 kernel: [23744.609439] ? __fget_files+0x86/0xc0 Aug 22 11:59:30 juju-e4d256-prod-github-runner-207 kernel: [23744.610145] __x64_sys_ioctl+0x95/0xd0 Aug 22 11:59:30 juju-e4d256-prod-github-runner-207 kernel: [23744.610841] do_syscall_64+0x5c/0xc0 Aug 22 11:59:30 juju-e4d256-prod-github-runner-207 kernel: [23744.611527] ? do_futex+0x162/0x1f0 Aug 22 11:59:30 juju-e4d256-prod-github-runner-207 kernel: [23744.612183] ? __x64_sys_futex+0x78/0x1e0 Aug 22 11:59:30 juju-e4d256-prod-github-runner-207 kernel: [23744.612858] ? __secure_computing+0xa9/0x120 Aug 22 11:59:30 juju-e4d256-prod-github-runner-207 kernel: [23744.613549] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 11:59:30 juju-e4d256-prod-github-runner-207 kernel: [23744.614309] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:59:30 juju-e4d256-prod-github-runner-207 kernel: [23744.615060] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:59:30 juju-e4d256-prod-github-runner-207 kernel: [23744.615810] ? do_syscall_64+0x69/0xc0 Aug 22 11:59:30 juju-e4d256-prod-github-runner-207 kernel: [23744.616458] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:59:30 juju-e4d256-prod-github-runner-207 kernel: [23744.617168] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:59:30 juju-e4d256-prod-github-runner-207 kernel: [23744.617864] ? do_syscall_64+0x69/0xc0 Aug 22 11:59:30 juju-e4d256-prod-github-runner-207 kernel: [23744.618489] ? do_syscall_64+0x69/0xc0 Aug 22 11:59:30 juju-e4d256-prod-github-runner-207 kernel: [23744.619143] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 11:59:30 juju-e4d256-prod-github-runner-207 kernel: [23744.619866] RIP: 0033:0x7faa5d0edaff Aug 22 11:59:30 juju-e4d256-prod-github-runner-207 kernel: [23744.620540] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 11:59:30 juju-e4d256-prod-github-runner-207 kernel: [23744.622531] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 11:59:30 juju-e4d256-prod-github-runner-207 kernel: [23744.623450] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 11:59:30 juju-e4d256-prod-github-runner-207 kernel: [23744.624355] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 11:59:30 juju-e4d256-prod-github-runner-207 kernel: [23744.625267] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 11:59:30 juju-e4d256-prod-github-runner-207 kernel: [23744.626166] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 11:59:30 juju-e4d256-prod-github-runner-207 kernel: [23744.627060] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 11:59:30 juju-e4d256-prod-github-runner-207 kernel: [23744.627977] Aug 22 11:59:44 juju-e4d256-prod-github-runner-207 kernel: [23758.772710] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 11:59:44 juju-e4d256-prod-github-runner-207 kernel: [23758.773665] rcu: 1-....: (5891958 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=2852224 Aug 22 11:59:44 juju-e4d256-prod-github-runner-207 kernel: [23758.774779] (t=5910393 jiffies g=23269 q=28812) Aug 22 11:59:44 juju-e4d256-prod-github-runner-207 kernel: [23758.775585] NMI backtrace for cpu 1 Aug 22 11:59:44 juju-e4d256-prod-github-runner-207 kernel: [23758.776294] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 11:59:44 juju-e4d256-prod-github-runner-207 kernel: [23758.777394] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 11:59:44 juju-e4d256-prod-github-runner-207 kernel: [23758.778454] Call Trace: Aug 22 11:59:44 juju-e4d256-prod-github-runner-207 kernel: [23758.779127] Aug 22 11:59:44 juju-e4d256-prod-github-runner-207 kernel: [23758.779784] show_stack+0x52/0x5c Aug 22 11:59:44 juju-e4d256-prod-github-runner-207 kernel: [23758.780511] dump_stack_lvl+0x4a/0x63 Aug 22 11:59:44 juju-e4d256-prod-github-runner-207 kernel: [23758.781257] dump_stack+0x10/0x16 Aug 22 11:59:44 juju-e4d256-prod-github-runner-207 kernel: [23758.781971] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 11:59:44 juju-e4d256-prod-github-runner-207 kernel: [23758.782747] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 11:59:44 juju-e4d256-prod-github-runner-207 kernel: [23758.783534] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 11:59:44 juju-e4d256-prod-github-runner-207 kernel: [23758.784350] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 11:59:44 juju-e4d256-prod-github-runner-207 kernel: [23758.785171] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 11:59:44 juju-e4d256-prod-github-runner-207 kernel: [23758.785981] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 11:59:44 juju-e4d256-prod-github-runner-207 kernel: [23758.786750] print_cpu_stall.cold+0x2f/0xe2 Aug 22 11:59:44 juju-e4d256-prod-github-runner-207 kernel: [23758.787529] ? timekeeping_update+0xf7/0x150 Aug 22 11:59:44 juju-e4d256-prod-github-runner-207 kernel: [23758.788298] check_cpu_stall+0x109/0x270 Aug 22 11:59:44 juju-e4d256-prod-github-runner-207 kernel: [23758.789042] rcu_sched_clock_irq+0x9a/0x250 Aug 22 11:59:44 juju-e4d256-prod-github-runner-207 kernel: [23758.789803] update_process_times+0x94/0xd0 Aug 22 11:59:44 juju-e4d256-prod-github-runner-207 kernel: [23758.790567] tick_sched_handle+0x29/0x70 Aug 22 11:59:44 juju-e4d256-prod-github-runner-207 kernel: [23758.791320] tick_sched_timer+0x8c/0xc0 Aug 22 11:59:44 juju-e4d256-prod-github-runner-207 kernel: [23758.792055] ? tick_nohz_handler+0xb0/0xb0 Aug 22 11:59:44 juju-e4d256-prod-github-runner-207 kernel: [23758.792808] __hrtimer_run_queues+0x107/0x230 Aug 22 11:59:44 juju-e4d256-prod-github-runner-207 kernel: [23758.793606] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 11:59:44 juju-e4d256-prod-github-runner-207 kernel: [23758.794388] hrtimer_interrupt+0x101/0x220 Aug 22 11:59:44 juju-e4d256-prod-github-runner-207 kernel: [23758.795145] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 11:59:44 juju-e4d256-prod-github-runner-207 kernel: [23758.796045] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 11:59:44 juju-e4d256-prod-github-runner-207 kernel: [23758.796851] Aug 22 11:59:44 juju-e4d256-prod-github-runner-207 kernel: [23758.797484] Aug 22 11:59:44 juju-e4d256-prod-github-runner-207 kernel: [23758.798117] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 11:59:44 juju-e4d256-prod-github-runner-207 kernel: [23758.798940] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 11:59:44 juju-e4d256-prod-github-runner-207 kernel: [23758.799893] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 11:59:44 juju-e4d256-prod-github-runner-207 kernel: [23758.802181] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 11:59:44 juju-e4d256-prod-github-runner-207 kernel: [23758.803112] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 11:59:44 juju-e4d256-prod-github-runner-207 kernel: [23758.804118] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 11:59:44 juju-e4d256-prod-github-runner-207 kernel: [23758.805252] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 11:59:44 juju-e4d256-prod-github-runner-207 kernel: [23758.806222] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 11:59:44 juju-e4d256-prod-github-runner-207 kernel: [23758.807172] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 11:59:44 juju-e4d256-prod-github-runner-207 kernel: [23758.808169] ? _raw_spin_lock+0x22/0x30 Aug 22 11:59:44 juju-e4d256-prod-github-runner-207 kernel: [23758.808928] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 11:59:44 juju-e4d256-prod-github-runner-207 kernel: [23758.809760] direct_page_fault+0x206/0x310 [kvm] Aug 22 11:59:44 juju-e4d256-prod-github-runner-207 kernel: [23758.810609] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 11:59:44 juju-e4d256-prod-github-runner-207 kernel: [23758.811455] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 11:59:44 juju-e4d256-prod-github-runner-207 kernel: [23758.812283] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 11:59:44 juju-e4d256-prod-github-runner-207 kernel: [23758.813085] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 11:59:44 juju-e4d256-prod-github-runner-207 kernel: [23758.813865] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 11:59:44 juju-e4d256-prod-github-runner-207 kernel: [23758.814683] handle_exit+0x98/0x230 [kvm_amd] Aug 22 11:59:44 juju-e4d256-prod-github-runner-207 kernel: [23758.815445] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 11:59:44 juju-e4d256-prod-github-runner-207 kernel: [23758.816235] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 11:59:44 juju-e4d256-prod-github-runner-207 kernel: [23758.817030] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 11:59:44 juju-e4d256-prod-github-runner-207 kernel: [23758.817811] vcpu_run+0x62/0x2c0 [kvm] Aug 22 11:59:44 juju-e4d256-prod-github-runner-207 kernel: [23758.818526] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 11:59:44 juju-e4d256-prod-github-runner-207 kernel: [23758.819256] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 11:59:44 juju-e4d256-prod-github-runner-207 kernel: [23758.820068] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 11:59:44 juju-e4d256-prod-github-runner-207 kernel: [23758.820825] ? __seccomp_filter+0x4a/0x4a0 Aug 22 11:59:44 juju-e4d256-prod-github-runner-207 kernel: [23758.821540] ? __fget_files+0x86/0xc0 Aug 22 11:59:44 juju-e4d256-prod-github-runner-207 kernel: [23758.822233] __x64_sys_ioctl+0x95/0xd0 Aug 22 11:59:44 juju-e4d256-prod-github-runner-207 kernel: [23758.822925] do_syscall_64+0x5c/0xc0 Aug 22 11:59:44 juju-e4d256-prod-github-runner-207 kernel: [23758.823615] ? do_futex+0x162/0x1f0 Aug 22 11:59:44 juju-e4d256-prod-github-runner-207 kernel: [23758.824338] ? __x64_sys_futex+0x78/0x1e0 Aug 22 11:59:44 juju-e4d256-prod-github-runner-207 kernel: [23758.825078] ? __secure_computing+0xa9/0x120 Aug 22 11:59:44 juju-e4d256-prod-github-runner-207 kernel: [23758.825874] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 11:59:44 juju-e4d256-prod-github-runner-207 kernel: [23758.826668] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:59:44 juju-e4d256-prod-github-runner-207 kernel: [23758.827442] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:59:44 juju-e4d256-prod-github-runner-207 kernel: [23758.828200] ? do_syscall_64+0x69/0xc0 Aug 22 11:59:44 juju-e4d256-prod-github-runner-207 kernel: [23758.828888] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 11:59:44 juju-e4d256-prod-github-runner-207 kernel: [23758.829639] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 11:59:44 juju-e4d256-prod-github-runner-207 kernel: [23758.830393] ? do_syscall_64+0x69/0xc0 Aug 22 11:59:44 juju-e4d256-prod-github-runner-207 kernel: [23758.831090] ? do_syscall_64+0x69/0xc0 Aug 22 11:59:44 juju-e4d256-prod-github-runner-207 kernel: [23758.831794] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 11:59:44 juju-e4d256-prod-github-runner-207 kernel: [23758.832628] RIP: 0033:0x7faa5d0edaff Aug 22 11:59:44 juju-e4d256-prod-github-runner-207 kernel: [23758.833317] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 11:59:44 juju-e4d256-prod-github-runner-207 kernel: [23758.835438] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 11:59:44 juju-e4d256-prod-github-runner-207 kernel: [23758.836419] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 11:59:44 juju-e4d256-prod-github-runner-207 kernel: [23758.837365] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 11:59:44 juju-e4d256-prod-github-runner-207 kernel: [23758.838305] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 11:59:44 juju-e4d256-prod-github-runner-207 kernel: [23758.839239] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 11:59:44 juju-e4d256-prod-github-runner-207 kernel: [23758.840177] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 11:59:44 juju-e4d256-prod-github-runner-207 kernel: [23758.841213] Aug 22 12:00:10 juju-e4d256-prod-github-runner-207 kernel: [23784.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 22043s! [qemu-system-x86:6715] Aug 22 12:00:10 juju-e4d256-prod-github-runner-207 kernel: [23784.543143] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 12:00:10 juju-e4d256-prod-github-runner-207 kernel: [23784.543215] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 12:00:10 juju-e4d256-prod-github-runner-207 kernel: [23784.555630] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 12:00:10 juju-e4d256-prod-github-runner-207 kernel: [23784.556991] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 12:00:10 juju-e4d256-prod-github-runner-207 kernel: [23784.558290] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:00:10 juju-e4d256-prod-github-runner-207 kernel: [23784.559436] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 12:00:10 juju-e4d256-prod-github-runner-207 kernel: [23784.562076] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 12:00:10 juju-e4d256-prod-github-runner-207 kernel: [23784.563133] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 12:00:10 juju-e4d256-prod-github-runner-207 kernel: [23784.564326] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 12:00:10 juju-e4d256-prod-github-runner-207 kernel: [23784.565490] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 12:00:10 juju-e4d256-prod-github-runner-207 kernel: [23784.566655] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 12:00:10 juju-e4d256-prod-github-runner-207 kernel: [23784.567842] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 12:00:10 juju-e4d256-prod-github-runner-207 kernel: [23784.569011] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 12:00:10 juju-e4d256-prod-github-runner-207 kernel: [23784.570251] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 12:00:10 juju-e4d256-prod-github-runner-207 kernel: [23784.571373] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 12:00:10 juju-e4d256-prod-github-runner-207 kernel: [23784.572565] Call Trace: Aug 22 12:00:10 juju-e4d256-prod-github-runner-207 kernel: [23784.573490] Aug 22 12:00:10 juju-e4d256-prod-github-runner-207 kernel: [23784.574375] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:00:10 juju-e4d256-prod-github-runner-207 kernel: [23784.575421] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:00:10 juju-e4d256-prod-github-runner-207 kernel: [23784.576452] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:00:10 juju-e4d256-prod-github-runner-207 kernel: [23784.577536] ? show_regs.part.0+0x23/0x29 Aug 22 12:00:10 juju-e4d256-prod-github-runner-207 kernel: [23784.578539] ? show_regs.cold+0x8/0xd Aug 22 12:00:10 juju-e4d256-prod-github-runner-207 kernel: [23784.579525] ? watchdog_timer_fn+0x1be/0x220 Aug 22 12:00:10 juju-e4d256-prod-github-runner-207 kernel: [23784.580540] ? lockup_detector_update_enable+0x60/0x60 Aug 22 12:00:10 juju-e4d256-prod-github-runner-207 kernel: [23784.581632] ? __hrtimer_run_queues+0x107/0x230 Aug 22 12:00:10 juju-e4d256-prod-github-runner-207 kernel: [23784.582768] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 12:00:10 juju-e4d256-prod-github-runner-207 kernel: [23784.583865] ? hrtimer_interrupt+0x101/0x220 Aug 22 12:00:10 juju-e4d256-prod-github-runner-207 kernel: [23784.584907] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 12:00:10 juju-e4d256-prod-github-runner-207 kernel: [23784.586033] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 12:00:10 juju-e4d256-prod-github-runner-207 kernel: [23784.587124] Aug 22 12:00:10 juju-e4d256-prod-github-runner-207 kernel: [23784.588036] Aug 22 12:00:10 juju-e4d256-prod-github-runner-207 kernel: [23784.589012] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 12:00:10 juju-e4d256-prod-github-runner-207 kernel: [23784.590182] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:00:10 juju-e4d256-prod-github-runner-207 kernel: [23784.591387] ? _raw_spin_lock+0x22/0x30 Aug 22 12:00:10 juju-e4d256-prod-github-runner-207 kernel: [23784.592419] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:00:10 juju-e4d256-prod-github-runner-207 kernel: [23784.593536] direct_page_fault+0x206/0x310 [kvm] Aug 22 12:00:10 juju-e4d256-prod-github-runner-207 kernel: [23784.594572] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 12:00:10 juju-e4d256-prod-github-runner-207 kernel: [23784.595635] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 12:00:10 juju-e4d256-prod-github-runner-207 kernel: [23784.596726] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 12:00:10 juju-e4d256-prod-github-runner-207 kernel: [23784.597785] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 12:00:10 juju-e4d256-prod-github-runner-207 kernel: [23784.598746] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 12:00:10 juju-e4d256-prod-github-runner-207 kernel: [23784.599744] handle_exit+0x98/0x230 [kvm_amd] Aug 22 12:00:10 juju-e4d256-prod-github-runner-207 kernel: [23784.600656] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 12:00:10 juju-e4d256-prod-github-runner-207 kernel: [23784.601582] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 12:00:10 juju-e4d256-prod-github-runner-207 kernel: [23784.602583] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 12:00:10 juju-e4d256-prod-github-runner-207 kernel: [23784.603622] vcpu_run+0x62/0x2c0 [kvm] Aug 22 12:00:10 juju-e4d256-prod-github-runner-207 kernel: [23784.604499] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 12:00:10 juju-e4d256-prod-github-runner-207 kernel: [23784.605312] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 12:00:10 juju-e4d256-prod-github-runner-207 kernel: [23784.606171] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 12:00:10 juju-e4d256-prod-github-runner-207 kernel: [23784.606973] ? __seccomp_filter+0x4a/0x4a0 Aug 22 12:00:10 juju-e4d256-prod-github-runner-207 kernel: [23784.607743] ? __fget_files+0x86/0xc0 Aug 22 12:00:10 juju-e4d256-prod-github-runner-207 kernel: [23784.608627] __x64_sys_ioctl+0x95/0xd0 Aug 22 12:00:10 juju-e4d256-prod-github-runner-207 kernel: [23784.609395] do_syscall_64+0x5c/0xc0 Aug 22 12:00:10 juju-e4d256-prod-github-runner-207 kernel: [23784.610135] ? do_futex+0x162/0x1f0 Aug 22 12:00:10 juju-e4d256-prod-github-runner-207 kernel: [23784.610798] ? __x64_sys_futex+0x78/0x1e0 Aug 22 12:00:10 juju-e4d256-prod-github-runner-207 kernel: [23784.611529] ? __secure_computing+0xa9/0x120 Aug 22 12:00:10 juju-e4d256-prod-github-runner-207 kernel: [23784.612319] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 12:00:10 juju-e4d256-prod-github-runner-207 kernel: [23784.613126] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:00:10 juju-e4d256-prod-github-runner-207 kernel: [23784.614005] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:00:10 juju-e4d256-prod-github-runner-207 kernel: [23784.614775] ? do_syscall_64+0x69/0xc0 Aug 22 12:00:10 juju-e4d256-prod-github-runner-207 kernel: [23784.615493] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:00:10 juju-e4d256-prod-github-runner-207 kernel: [23784.616263] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:00:10 juju-e4d256-prod-github-runner-207 kernel: [23784.617028] ? do_syscall_64+0x69/0xc0 Aug 22 12:00:10 juju-e4d256-prod-github-runner-207 kernel: [23784.617675] ? do_syscall_64+0x69/0xc0 Aug 22 12:00:10 juju-e4d256-prod-github-runner-207 kernel: [23784.618309] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 12:00:10 juju-e4d256-prod-github-runner-207 kernel: [23784.619056] RIP: 0033:0x7faa5d0edaff Aug 22 12:00:10 juju-e4d256-prod-github-runner-207 kernel: [23784.619695] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 12:00:10 juju-e4d256-prod-github-runner-207 kernel: [23784.621758] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 12:00:10 juju-e4d256-prod-github-runner-207 kernel: [23784.622688] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 12:00:10 juju-e4d256-prod-github-runner-207 kernel: [23784.623621] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 12:00:10 juju-e4d256-prod-github-runner-207 kernel: [23784.624546] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 12:00:10 juju-e4d256-prod-github-runner-207 kernel: [23784.625604] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 12:00:10 juju-e4d256-prod-github-runner-207 kernel: [23784.626593] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 12:00:10 juju-e4d256-prod-github-runner-207 kernel: [23784.627573] Aug 22 12:00:38 juju-e4d256-prod-github-runner-207 kernel: [23812.541980] watchdog: BUG: soft lockup - CPU#1 stuck for 22069s! [qemu-system-x86:6715] Aug 22 12:00:38 juju-e4d256-prod-github-runner-207 kernel: [23812.543195] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 12:00:38 juju-e4d256-prod-github-runner-207 kernel: [23812.543273] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 12:00:38 juju-e4d256-prod-github-runner-207 kernel: [23812.555943] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 12:00:38 juju-e4d256-prod-github-runner-207 kernel: [23812.557259] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 12:00:38 juju-e4d256-prod-github-runner-207 kernel: [23812.558529] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:00:38 juju-e4d256-prod-github-runner-207 kernel: [23812.559649] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 12:00:38 juju-e4d256-prod-github-runner-207 kernel: [23812.562301] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 12:00:38 juju-e4d256-prod-github-runner-207 kernel: [23812.563399] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 12:00:38 juju-e4d256-prod-github-runner-207 kernel: [23812.564612] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 12:00:38 juju-e4d256-prod-github-runner-207 kernel: [23812.565805] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 12:00:38 juju-e4d256-prod-github-runner-207 kernel: [23812.567012] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 12:00:38 juju-e4d256-prod-github-runner-207 kernel: [23812.568215] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 12:00:38 juju-e4d256-prod-github-runner-207 kernel: [23812.569429] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 12:00:38 juju-e4d256-prod-github-runner-207 kernel: [23812.570720] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 12:00:38 juju-e4d256-prod-github-runner-207 kernel: [23812.571855] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 12:00:38 juju-e4d256-prod-github-runner-207 kernel: [23812.573095] Call Trace: Aug 22 12:00:38 juju-e4d256-prod-github-runner-207 kernel: [23812.574043] Aug 22 12:00:38 juju-e4d256-prod-github-runner-207 kernel: [23812.574970] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:00:38 juju-e4d256-prod-github-runner-207 kernel: [23812.576025] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:00:38 juju-e4d256-prod-github-runner-207 kernel: [23812.577066] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:00:38 juju-e4d256-prod-github-runner-207 kernel: [23812.578183] ? show_regs.part.0+0x23/0x29 Aug 22 12:00:38 juju-e4d256-prod-github-runner-207 kernel: [23812.579239] ? show_regs.cold+0x8/0xd Aug 22 12:00:38 juju-e4d256-prod-github-runner-207 kernel: [23812.580237] ? watchdog_timer_fn+0x1be/0x220 Aug 22 12:00:38 juju-e4d256-prod-github-runner-207 kernel: [23812.581271] ? lockup_detector_update_enable+0x60/0x60 Aug 22 12:00:38 juju-e4d256-prod-github-runner-207 kernel: [23812.582377] ? __hrtimer_run_queues+0x107/0x230 Aug 22 12:00:38 juju-e4d256-prod-github-runner-207 kernel: [23812.583456] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 12:00:38 juju-e4d256-prod-github-runner-207 kernel: [23812.584563] ? hrtimer_interrupt+0x101/0x220 Aug 22 12:00:38 juju-e4d256-prod-github-runner-207 kernel: [23812.585614] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 12:00:38 juju-e4d256-prod-github-runner-207 kernel: [23812.586741] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 12:00:38 juju-e4d256-prod-github-runner-207 kernel: [23812.587847] Aug 22 12:00:38 juju-e4d256-prod-github-runner-207 kernel: [23812.588742] Aug 22 12:00:38 juju-e4d256-prod-github-runner-207 kernel: [23812.589624] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 12:00:38 juju-e4d256-prod-github-runner-207 kernel: [23812.590714] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:00:38 juju-e4d256-prod-github-runner-207 kernel: [23812.591800] ? _raw_spin_lock+0x22/0x30 Aug 22 12:00:38 juju-e4d256-prod-github-runner-207 kernel: [23812.592766] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:00:38 juju-e4d256-prod-github-runner-207 kernel: [23812.593834] direct_page_fault+0x206/0x310 [kvm] Aug 22 12:00:38 juju-e4d256-prod-github-runner-207 kernel: [23812.594929] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 12:00:38 juju-e4d256-prod-github-runner-207 kernel: [23812.595980] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 12:00:38 juju-e4d256-prod-github-runner-207 kernel: [23812.597077] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 12:00:38 juju-e4d256-prod-github-runner-207 kernel: [23812.598074] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 12:00:38 juju-e4d256-prod-github-runner-207 kernel: [23812.599045] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 12:00:38 juju-e4d256-prod-github-runner-207 kernel: [23812.600041] handle_exit+0x98/0x230 [kvm_amd] Aug 22 12:00:38 juju-e4d256-prod-github-runner-207 kernel: [23812.600944] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 12:00:38 juju-e4d256-prod-github-runner-207 kernel: [23812.601874] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 12:00:38 juju-e4d256-prod-github-runner-207 kernel: [23812.602861] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 12:00:38 juju-e4d256-prod-github-runner-207 kernel: [23812.603800] vcpu_run+0x62/0x2c0 [kvm] Aug 22 12:00:38 juju-e4d256-prod-github-runner-207 kernel: [23812.604621] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 12:00:38 juju-e4d256-prod-github-runner-207 kernel: [23812.605441] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 12:00:38 juju-e4d256-prod-github-runner-207 kernel: [23812.606305] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 12:00:38 juju-e4d256-prod-github-runner-207 kernel: [23812.607139] ? __seccomp_filter+0x4a/0x4a0 Aug 22 12:00:38 juju-e4d256-prod-github-runner-207 kernel: [23812.607893] ? __fget_files+0x86/0xc0 Aug 22 12:00:38 juju-e4d256-prod-github-runner-207 kernel: [23812.608605] __x64_sys_ioctl+0x95/0xd0 Aug 22 12:00:38 juju-e4d256-prod-github-runner-207 kernel: [23812.609305] do_syscall_64+0x5c/0xc0 Aug 22 12:00:38 juju-e4d256-prod-github-runner-207 kernel: [23812.609976] ? do_futex+0x162/0x1f0 Aug 22 12:00:38 juju-e4d256-prod-github-runner-207 kernel: [23812.610639] ? __x64_sys_futex+0x78/0x1e0 Aug 22 12:00:38 juju-e4d256-prod-github-runner-207 kernel: [23812.611339] ? __secure_computing+0xa9/0x120 Aug 22 12:00:38 juju-e4d256-prod-github-runner-207 kernel: [23812.612040] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 12:00:38 juju-e4d256-prod-github-runner-207 kernel: [23812.612816] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:00:38 juju-e4d256-prod-github-runner-207 kernel: [23812.613554] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:00:38 juju-e4d256-prod-github-runner-207 kernel: [23812.614282] ? do_syscall_64+0x69/0xc0 Aug 22 12:00:38 juju-e4d256-prod-github-runner-207 kernel: [23812.615010] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:00:38 juju-e4d256-prod-github-runner-207 kernel: [23812.615732] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:00:38 juju-e4d256-prod-github-runner-207 kernel: [23812.616444] ? do_syscall_64+0x69/0xc0 Aug 22 12:00:38 juju-e4d256-prod-github-runner-207 kernel: [23812.617077] ? do_syscall_64+0x69/0xc0 Aug 22 12:00:38 juju-e4d256-prod-github-runner-207 kernel: [23812.617720] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 12:00:38 juju-e4d256-prod-github-runner-207 kernel: [23812.618436] RIP: 0033:0x7faa5d0edaff Aug 22 12:00:38 juju-e4d256-prod-github-runner-207 kernel: [23812.619081] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 12:00:38 juju-e4d256-prod-github-runner-207 kernel: [23812.621105] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 12:00:38 juju-e4d256-prod-github-runner-207 kernel: [23812.622037] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 12:00:38 juju-e4d256-prod-github-runner-207 kernel: [23812.622952] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 12:00:38 juju-e4d256-prod-github-runner-207 kernel: [23812.623863] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 12:00:38 juju-e4d256-prod-github-runner-207 kernel: [23812.624767] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 12:00:38 juju-e4d256-prod-github-runner-207 kernel: [23812.625672] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 12:00:38 juju-e4d256-prod-github-runner-207 kernel: [23812.626584] Aug 22 12:01:06 juju-e4d256-prod-github-runner-207 kernel: [23840.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 22095s! [qemu-system-x86:6715] Aug 22 12:01:06 juju-e4d256-prod-github-runner-207 kernel: [23840.543872] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 12:01:06 juju-e4d256-prod-github-runner-207 kernel: [23840.544168] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 12:01:06 juju-e4d256-prod-github-runner-207 kernel: [23840.556566] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 12:01:06 juju-e4d256-prod-github-runner-207 kernel: [23840.557835] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 12:01:06 juju-e4d256-prod-github-runner-207 kernel: [23840.559079] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:01:06 juju-e4d256-prod-github-runner-207 kernel: [23840.560200] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 12:01:06 juju-e4d256-prod-github-runner-207 kernel: [23840.562888] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 12:01:06 juju-e4d256-prod-github-runner-207 kernel: [23840.563974] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 12:01:06 juju-e4d256-prod-github-runner-207 kernel: [23840.565142] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 12:01:06 juju-e4d256-prod-github-runner-207 kernel: [23840.566307] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 12:01:06 juju-e4d256-prod-github-runner-207 kernel: [23840.567490] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 12:01:06 juju-e4d256-prod-github-runner-207 kernel: [23840.568662] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 12:01:06 juju-e4d256-prod-github-runner-207 kernel: [23840.569827] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 12:01:06 juju-e4d256-prod-github-runner-207 kernel: [23840.571139] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 12:01:06 juju-e4d256-prod-github-runner-207 kernel: [23840.572243] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 12:01:06 juju-e4d256-prod-github-runner-207 kernel: [23840.573441] Call Trace: Aug 22 12:01:06 juju-e4d256-prod-github-runner-207 kernel: [23840.574361] Aug 22 12:01:06 juju-e4d256-prod-github-runner-207 kernel: [23840.575457] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:01:06 juju-e4d256-prod-github-runner-207 kernel: [23840.577017] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:01:06 juju-e4d256-prod-github-runner-207 kernel: [23840.578058] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:01:06 juju-e4d256-prod-github-runner-207 kernel: [23840.579216] ? show_regs.part.0+0x23/0x29 Aug 22 12:01:06 juju-e4d256-prod-github-runner-207 kernel: [23840.580278] ? show_regs.cold+0x8/0xd Aug 22 12:01:06 juju-e4d256-prod-github-runner-207 kernel: [23840.581305] ? watchdog_timer_fn+0x1be/0x220 Aug 22 12:01:06 juju-e4d256-prod-github-runner-207 kernel: [23840.582416] ? lockup_detector_update_enable+0x60/0x60 Aug 22 12:01:06 juju-e4d256-prod-github-runner-207 kernel: [23840.583537] ? __hrtimer_run_queues+0x107/0x230 Aug 22 12:01:06 juju-e4d256-prod-github-runner-207 kernel: [23840.584598] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 12:01:06 juju-e4d256-prod-github-runner-207 kernel: [23840.585682] ? hrtimer_interrupt+0x101/0x220 Aug 22 12:01:06 juju-e4d256-prod-github-runner-207 kernel: [23840.586803] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 12:01:06 juju-e4d256-prod-github-runner-207 kernel: [23840.587966] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 12:01:06 juju-e4d256-prod-github-runner-207 kernel: [23840.589018] Aug 22 12:01:06 juju-e4d256-prod-github-runner-207 kernel: [23840.589881] Aug 22 12:01:06 juju-e4d256-prod-github-runner-207 kernel: [23840.590760] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 12:01:06 juju-e4d256-prod-github-runner-207 kernel: [23840.591800] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:01:06 juju-e4d256-prod-github-runner-207 kernel: [23840.592862] ? _raw_spin_lock+0x22/0x30 Aug 22 12:01:06 juju-e4d256-prod-github-runner-207 kernel: [23840.593833] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:01:06 juju-e4d256-prod-github-runner-207 kernel: [23840.594877] direct_page_fault+0x206/0x310 [kvm] Aug 22 12:01:06 juju-e4d256-prod-github-runner-207 kernel: [23840.595910] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 12:01:06 juju-e4d256-prod-github-runner-207 kernel: [23840.596921] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 12:01:06 juju-e4d256-prod-github-runner-207 kernel: [23840.597930] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 12:01:06 juju-e4d256-prod-github-runner-207 kernel: [23840.598962] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 12:01:06 juju-e4d256-prod-github-runner-207 kernel: [23840.599916] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 12:01:06 juju-e4d256-prod-github-runner-207 kernel: [23840.600897] handle_exit+0x98/0x230 [kvm_amd] Aug 22 12:01:06 juju-e4d256-prod-github-runner-207 kernel: [23840.601793] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 12:01:06 juju-e4d256-prod-github-runner-207 kernel: [23840.602731] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 12:01:06 juju-e4d256-prod-github-runner-207 kernel: [23840.603670] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 12:01:06 juju-e4d256-prod-github-runner-207 kernel: [23840.604577] vcpu_run+0x62/0x2c0 [kvm] Aug 22 12:01:06 juju-e4d256-prod-github-runner-207 kernel: [23840.605392] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 12:01:06 juju-e4d256-prod-github-runner-207 kernel: [23840.606203] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 12:01:06 juju-e4d256-prod-github-runner-207 kernel: [23840.607088] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 12:01:06 juju-e4d256-prod-github-runner-207 kernel: [23840.608008] ? __seccomp_filter+0x4a/0x4a0 Aug 22 12:01:06 juju-e4d256-prod-github-runner-207 kernel: [23840.608820] ? __fget_files+0x86/0xc0 Aug 22 12:01:06 juju-e4d256-prod-github-runner-207 kernel: [23840.609630] __x64_sys_ioctl+0x95/0xd0 Aug 22 12:01:06 juju-e4d256-prod-github-runner-207 kernel: [23840.610376] do_syscall_64+0x5c/0xc0 Aug 22 12:01:06 juju-e4d256-prod-github-runner-207 kernel: [23840.611047] ? do_futex+0x162/0x1f0 Aug 22 12:01:06 juju-e4d256-prod-github-runner-207 kernel: [23840.611825] ? __x64_sys_futex+0x78/0x1e0 Aug 22 12:01:06 juju-e4d256-prod-github-runner-207 kernel: [23840.612677] ? __secure_computing+0xa9/0x120 Aug 22 12:01:06 juju-e4d256-prod-github-runner-207 kernel: [23840.613461] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 12:01:06 juju-e4d256-prod-github-runner-207 kernel: [23840.614350] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:01:06 juju-e4d256-prod-github-runner-207 kernel: [23840.615230] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:01:06 juju-e4d256-prod-github-runner-207 kernel: [23840.615951] ? do_syscall_64+0x69/0xc0 Aug 22 12:01:06 juju-e4d256-prod-github-runner-207 kernel: [23840.616597] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:01:06 juju-e4d256-prod-github-runner-207 kernel: [23840.617302] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:01:06 juju-e4d256-prod-github-runner-207 kernel: [23840.618002] ? do_syscall_64+0x69/0xc0 Aug 22 12:01:06 juju-e4d256-prod-github-runner-207 kernel: [23840.618646] ? do_syscall_64+0x69/0xc0 Aug 22 12:01:06 juju-e4d256-prod-github-runner-207 kernel: [23840.619269] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 12:01:06 juju-e4d256-prod-github-runner-207 kernel: [23840.619981] RIP: 0033:0x7faa5d0edaff Aug 22 12:01:06 juju-e4d256-prod-github-runner-207 kernel: [23840.620637] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 12:01:06 juju-e4d256-prod-github-runner-207 kernel: [23840.622653] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 12:01:06 juju-e4d256-prod-github-runner-207 kernel: [23840.623661] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 12:01:06 juju-e4d256-prod-github-runner-207 kernel: [23840.624609] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 12:01:06 juju-e4d256-prod-github-runner-207 kernel: [23840.625504] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 12:01:06 juju-e4d256-prod-github-runner-207 kernel: [23840.626436] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 12:01:06 juju-e4d256-prod-github-runner-207 kernel: [23840.627749] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 12:01:06 juju-e4d256-prod-github-runner-207 kernel: [23840.629010] Aug 22 12:01:34 juju-e4d256-prod-github-runner-207 kernel: [23868.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 22121s! [qemu-system-x86:6715] Aug 22 12:01:34 juju-e4d256-prod-github-runner-207 kernel: [23868.543126] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 12:01:34 juju-e4d256-prod-github-runner-207 kernel: [23868.543198] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 12:01:34 juju-e4d256-prod-github-runner-207 kernel: [23868.555373] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 12:01:34 juju-e4d256-prod-github-runner-207 kernel: [23868.556644] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 12:01:34 juju-e4d256-prod-github-runner-207 kernel: [23868.557872] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:01:34 juju-e4d256-prod-github-runner-207 kernel: [23868.558986] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 12:01:34 juju-e4d256-prod-github-runner-207 kernel: [23868.561541] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 12:01:34 juju-e4d256-prod-github-runner-207 kernel: [23868.562622] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 12:01:34 juju-e4d256-prod-github-runner-207 kernel: [23868.563818] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 12:01:34 juju-e4d256-prod-github-runner-207 kernel: [23868.564998] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 12:01:34 juju-e4d256-prod-github-runner-207 kernel: [23868.566186] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 12:01:34 juju-e4d256-prod-github-runner-207 kernel: [23868.567352] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 12:01:34 juju-e4d256-prod-github-runner-207 kernel: [23868.568541] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 12:01:34 juju-e4d256-prod-github-runner-207 kernel: [23868.569829] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 12:01:34 juju-e4d256-prod-github-runner-207 kernel: [23868.570956] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 12:01:34 juju-e4d256-prod-github-runner-207 kernel: [23868.572156] Call Trace: Aug 22 12:01:34 juju-e4d256-prod-github-runner-207 kernel: [23868.573075] Aug 22 12:01:34 juju-e4d256-prod-github-runner-207 kernel: [23868.574019] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:01:34 juju-e4d256-prod-github-runner-207 kernel: [23868.575078] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:01:34 juju-e4d256-prod-github-runner-207 kernel: [23868.576126] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:01:34 juju-e4d256-prod-github-runner-207 kernel: [23868.577211] ? show_regs.part.0+0x23/0x29 Aug 22 12:01:34 juju-e4d256-prod-github-runner-207 kernel: [23868.578234] ? show_regs.cold+0x8/0xd Aug 22 12:01:34 juju-e4d256-prod-github-runner-207 kernel: [23868.579253] ? watchdog_timer_fn+0x1be/0x220 Aug 22 12:01:34 juju-e4d256-prod-github-runner-207 kernel: [23868.580275] ? lockup_detector_update_enable+0x60/0x60 Aug 22 12:01:34 juju-e4d256-prod-github-runner-207 kernel: [23868.581337] ? __hrtimer_run_queues+0x107/0x230 Aug 22 12:01:34 juju-e4d256-prod-github-runner-207 kernel: [23868.582398] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 12:01:34 juju-e4d256-prod-github-runner-207 kernel: [23868.583446] ? hrtimer_interrupt+0x101/0x220 Aug 22 12:01:34 juju-e4d256-prod-github-runner-207 kernel: [23868.584490] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 12:01:34 juju-e4d256-prod-github-runner-207 kernel: [23868.585580] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 12:01:34 juju-e4d256-prod-github-runner-207 kernel: [23868.586649] Aug 22 12:01:34 juju-e4d256-prod-github-runner-207 kernel: [23868.587507] Aug 22 12:01:34 juju-e4d256-prod-github-runner-207 kernel: [23868.588353] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 12:01:34 juju-e4d256-prod-github-runner-207 kernel: [23868.589410] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:01:34 juju-e4d256-prod-github-runner-207 kernel: [23868.590508] ? _raw_spin_lock+0x22/0x30 Aug 22 12:01:34 juju-e4d256-prod-github-runner-207 kernel: [23868.591459] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:01:34 juju-e4d256-prod-github-runner-207 kernel: [23868.592491] direct_page_fault+0x206/0x310 [kvm] Aug 22 12:01:34 juju-e4d256-prod-github-runner-207 kernel: [23868.593528] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 12:01:34 juju-e4d256-prod-github-runner-207 kernel: [23868.594577] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 12:01:34 juju-e4d256-prod-github-runner-207 kernel: [23868.595611] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 12:01:34 juju-e4d256-prod-github-runner-207 kernel: [23868.596599] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 12:01:34 juju-e4d256-prod-github-runner-207 kernel: [23868.597546] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 12:01:34 juju-e4d256-prod-github-runner-207 kernel: [23868.598549] handle_exit+0x98/0x230 [kvm_amd] Aug 22 12:01:34 juju-e4d256-prod-github-runner-207 kernel: [23868.599473] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 12:01:34 juju-e4d256-prod-github-runner-207 kernel: [23868.600423] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 12:01:34 juju-e4d256-prod-github-runner-207 kernel: [23868.601360] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 12:01:34 juju-e4d256-prod-github-runner-207 kernel: [23868.602445] vcpu_run+0x62/0x2c0 [kvm] Aug 22 12:01:34 juju-e4d256-prod-github-runner-207 kernel: [23868.603262] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 12:01:34 juju-e4d256-prod-github-runner-207 kernel: [23868.604127] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 12:01:34 juju-e4d256-prod-github-runner-207 kernel: [23868.605013] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 12:01:34 juju-e4d256-prod-github-runner-207 kernel: [23868.605823] ? __seccomp_filter+0x4a/0x4a0 Aug 22 12:01:34 juju-e4d256-prod-github-runner-207 kernel: [23868.606579] ? __fget_files+0x86/0xc0 Aug 22 12:01:34 juju-e4d256-prod-github-runner-207 kernel: [23868.607286] __x64_sys_ioctl+0x95/0xd0 Aug 22 12:01:34 juju-e4d256-prod-github-runner-207 kernel: [23868.607979] do_syscall_64+0x5c/0xc0 Aug 22 12:01:34 juju-e4d256-prod-github-runner-207 kernel: [23868.608825] ? do_futex+0x162/0x1f0 Aug 22 12:01:34 juju-e4d256-prod-github-runner-207 kernel: [23868.609483] ? __x64_sys_futex+0x78/0x1e0 Aug 22 12:01:34 juju-e4d256-prod-github-runner-207 kernel: [23868.610188] ? __secure_computing+0xa9/0x120 Aug 22 12:01:34 juju-e4d256-prod-github-runner-207 kernel: [23868.610894] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 12:01:34 juju-e4d256-prod-github-runner-207 kernel: [23868.611666] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:01:34 juju-e4d256-prod-github-runner-207 kernel: [23868.612403] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:01:34 juju-e4d256-prod-github-runner-207 kernel: [23868.613121] ? do_syscall_64+0x69/0xc0 Aug 22 12:01:34 juju-e4d256-prod-github-runner-207 kernel: [23868.613768] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:01:34 juju-e4d256-prod-github-runner-207 kernel: [23868.614501] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:01:34 juju-e4d256-prod-github-runner-207 kernel: [23868.615406] ? do_syscall_64+0x69/0xc0 Aug 22 12:01:34 juju-e4d256-prod-github-runner-207 kernel: [23868.616101] ? do_syscall_64+0x69/0xc0 Aug 22 12:01:34 juju-e4d256-prod-github-runner-207 kernel: [23868.616729] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 12:01:34 juju-e4d256-prod-github-runner-207 kernel: [23868.617442] RIP: 0033:0x7faa5d0edaff Aug 22 12:01:34 juju-e4d256-prod-github-runner-207 kernel: [23868.618088] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 12:01:34 juju-e4d256-prod-github-runner-207 kernel: [23868.620114] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 12:01:34 juju-e4d256-prod-github-runner-207 kernel: [23868.621059] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 12:01:34 juju-e4d256-prod-github-runner-207 kernel: [23868.621974] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 12:01:34 juju-e4d256-prod-github-runner-207 kernel: [23868.622899] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 12:01:34 juju-e4d256-prod-github-runner-207 kernel: [23868.623799] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 12:01:34 juju-e4d256-prod-github-runner-207 kernel: [23868.624718] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 12:01:34 juju-e4d256-prod-github-runner-207 kernel: [23868.625624] Aug 22 12:02:02 juju-e4d256-prod-github-runner-207 kernel: [23896.541980] watchdog: BUG: soft lockup - CPU#1 stuck for 22147s! [qemu-system-x86:6715] Aug 22 12:02:02 juju-e4d256-prod-github-runner-207 kernel: [23896.543129] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 12:02:02 juju-e4d256-prod-github-runner-207 kernel: [23896.543204] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 12:02:02 juju-e4d256-prod-github-runner-207 kernel: [23896.555541] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 12:02:02 juju-e4d256-prod-github-runner-207 kernel: [23896.556804] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 12:02:02 juju-e4d256-prod-github-runner-207 kernel: [23896.558042] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:02:02 juju-e4d256-prod-github-runner-207 kernel: [23896.559120] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 12:02:02 juju-e4d256-prod-github-runner-207 kernel: [23896.561743] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 12:02:02 juju-e4d256-prod-github-runner-207 kernel: [23896.562795] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 12:02:02 juju-e4d256-prod-github-runner-207 kernel: [23896.563987] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 12:02:02 juju-e4d256-prod-github-runner-207 kernel: [23896.565151] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 12:02:02 juju-e4d256-prod-github-runner-207 kernel: [23896.566318] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 12:02:02 juju-e4d256-prod-github-runner-207 kernel: [23896.567487] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 12:02:02 juju-e4d256-prod-github-runner-207 kernel: [23896.568658] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 12:02:02 juju-e4d256-prod-github-runner-207 kernel: [23896.569958] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 12:02:02 juju-e4d256-prod-github-runner-207 kernel: [23896.571059] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 12:02:02 juju-e4d256-prod-github-runner-207 kernel: [23896.572254] Call Trace: Aug 22 12:02:02 juju-e4d256-prod-github-runner-207 kernel: [23896.573167] Aug 22 12:02:02 juju-e4d256-prod-github-runner-207 kernel: [23896.574070] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:02:02 juju-e4d256-prod-github-runner-207 kernel: [23896.575101] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:02:02 juju-e4d256-prod-github-runner-207 kernel: [23896.576127] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:02:02 juju-e4d256-prod-github-runner-207 kernel: [23896.577204] ? show_regs.part.0+0x23/0x29 Aug 22 12:02:02 juju-e4d256-prod-github-runner-207 kernel: [23896.578216] ? show_regs.cold+0x8/0xd Aug 22 12:02:02 juju-e4d256-prod-github-runner-207 kernel: [23896.579500] ? watchdog_timer_fn+0x1be/0x220 Aug 22 12:02:02 juju-e4d256-prod-github-runner-207 kernel: [23896.580549] ? lockup_detector_update_enable+0x60/0x60 Aug 22 12:02:02 juju-e4d256-prod-github-runner-207 kernel: [23896.581652] ? __hrtimer_run_queues+0x107/0x230 Aug 22 12:02:02 juju-e4d256-prod-github-runner-207 kernel: [23896.582746] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 12:02:02 juju-e4d256-prod-github-runner-207 kernel: [23896.583784] ? hrtimer_interrupt+0x101/0x220 Aug 22 12:02:02 juju-e4d256-prod-github-runner-207 kernel: [23896.584802] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 12:02:02 juju-e4d256-prod-github-runner-207 kernel: [23896.585923] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 12:02:02 juju-e4d256-prod-github-runner-207 kernel: [23896.586978] Aug 22 12:02:02 juju-e4d256-prod-github-runner-207 kernel: [23896.587834] Aug 22 12:02:02 juju-e4d256-prod-github-runner-207 kernel: [23896.588692] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 12:02:02 juju-e4d256-prod-github-runner-207 kernel: [23896.589777] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:02:02 juju-e4d256-prod-github-runner-207 kernel: [23896.590842] ? _raw_spin_lock+0x22/0x30 Aug 22 12:02:02 juju-e4d256-prod-github-runner-207 kernel: [23896.591825] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:02:02 juju-e4d256-prod-github-runner-207 kernel: [23896.592859] direct_page_fault+0x206/0x310 [kvm] Aug 22 12:02:02 juju-e4d256-prod-github-runner-207 kernel: [23896.593945] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 12:02:02 juju-e4d256-prod-github-runner-207 kernel: [23896.594964] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 12:02:02 juju-e4d256-prod-github-runner-207 kernel: [23896.596008] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 12:02:02 juju-e4d256-prod-github-runner-207 kernel: [23896.596982] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 12:02:02 juju-e4d256-prod-github-runner-207 kernel: [23896.597942] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 12:02:02 juju-e4d256-prod-github-runner-207 kernel: [23896.598927] handle_exit+0x98/0x230 [kvm_amd] Aug 22 12:02:02 juju-e4d256-prod-github-runner-207 kernel: [23896.599878] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 12:02:02 juju-e4d256-prod-github-runner-207 kernel: [23896.600821] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 12:02:02 juju-e4d256-prod-github-runner-207 kernel: [23896.601772] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 12:02:02 juju-e4d256-prod-github-runner-207 kernel: [23896.602682] vcpu_run+0x62/0x2c0 [kvm] Aug 22 12:02:02 juju-e4d256-prod-github-runner-207 kernel: [23896.603495] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 12:02:02 juju-e4d256-prod-github-runner-207 kernel: [23896.604309] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 12:02:02 juju-e4d256-prod-github-runner-207 kernel: [23896.605164] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 12:02:02 juju-e4d256-prod-github-runner-207 kernel: [23896.606012] ? __seccomp_filter+0x4a/0x4a0 Aug 22 12:02:02 juju-e4d256-prod-github-runner-207 kernel: [23896.606765] ? __fget_files+0x86/0xc0 Aug 22 12:02:02 juju-e4d256-prod-github-runner-207 kernel: [23896.607492] __x64_sys_ioctl+0x95/0xd0 Aug 22 12:02:02 juju-e4d256-prod-github-runner-207 kernel: [23896.608187] do_syscall_64+0x5c/0xc0 Aug 22 12:02:02 juju-e4d256-prod-github-runner-207 kernel: [23896.608854] ? do_futex+0x162/0x1f0 Aug 22 12:02:02 juju-e4d256-prod-github-runner-207 kernel: [23896.609531] ? __x64_sys_futex+0x78/0x1e0 Aug 22 12:02:02 juju-e4d256-prod-github-runner-207 kernel: [23896.610226] ? __secure_computing+0xa9/0x120 Aug 22 12:02:02 juju-e4d256-prod-github-runner-207 kernel: [23896.610934] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 12:02:02 juju-e4d256-prod-github-runner-207 kernel: [23896.611704] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:02:02 juju-e4d256-prod-github-runner-207 kernel: [23896.612453] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:02:02 juju-e4d256-prod-github-runner-207 kernel: [23896.613183] ? do_syscall_64+0x69/0xc0 Aug 22 12:02:02 juju-e4d256-prod-github-runner-207 kernel: [23896.613868] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:02:02 juju-e4d256-prod-github-runner-207 kernel: [23896.614575] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:02:02 juju-e4d256-prod-github-runner-207 kernel: [23896.615271] ? do_syscall_64+0x69/0xc0 Aug 22 12:02:02 juju-e4d256-prod-github-runner-207 kernel: [23896.615898] ? do_syscall_64+0x69/0xc0 Aug 22 12:02:02 juju-e4d256-prod-github-runner-207 kernel: [23896.616525] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 12:02:02 juju-e4d256-prod-github-runner-207 kernel: [23896.617253] RIP: 0033:0x7faa5d0edaff Aug 22 12:02:02 juju-e4d256-prod-github-runner-207 kernel: [23896.617932] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 12:02:02 juju-e4d256-prod-github-runner-207 kernel: [23896.619927] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 12:02:02 juju-e4d256-prod-github-runner-207 kernel: [23896.620874] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 12:02:02 juju-e4d256-prod-github-runner-207 kernel: [23896.621812] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 12:02:02 juju-e4d256-prod-github-runner-207 kernel: [23896.622715] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 12:02:02 juju-e4d256-prod-github-runner-207 kernel: [23896.623608] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 12:02:02 juju-e4d256-prod-github-runner-207 kernel: [23896.624503] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 12:02:02 juju-e4d256-prod-github-runner-207 kernel: [23896.625557] Aug 22 12:02:30 juju-e4d256-prod-github-runner-207 kernel: [23924.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 22173s! [qemu-system-x86:6715] Aug 22 12:02:30 juju-e4d256-prod-github-runner-207 kernel: [23924.543829] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 12:02:30 juju-e4d256-prod-github-runner-207 kernel: [23924.544138] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 12:02:30 juju-e4d256-prod-github-runner-207 kernel: [23924.556528] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 12:02:30 juju-e4d256-prod-github-runner-207 kernel: [23924.557801] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 12:02:30 juju-e4d256-prod-github-runner-207 kernel: [23924.559037] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:02:30 juju-e4d256-prod-github-runner-207 kernel: [23924.560092] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 12:02:30 juju-e4d256-prod-github-runner-207 kernel: [23924.562646] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 12:02:30 juju-e4d256-prod-github-runner-207 kernel: [23924.563686] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 12:02:30 juju-e4d256-prod-github-runner-207 kernel: [23924.564844] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 12:02:30 juju-e4d256-prod-github-runner-207 kernel: [23924.566020] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 12:02:30 juju-e4d256-prod-github-runner-207 kernel: [23924.567734] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 12:02:30 juju-e4d256-prod-github-runner-207 kernel: [23924.570605] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 12:02:30 juju-e4d256-prod-github-runner-207 kernel: [23924.571780] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 12:02:30 juju-e4d256-prod-github-runner-207 kernel: [23924.573020] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 12:02:30 juju-e4d256-prod-github-runner-207 kernel: [23924.574146] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 12:02:30 juju-e4d256-prod-github-runner-207 kernel: [23924.575336] Call Trace: Aug 22 12:02:30 juju-e4d256-prod-github-runner-207 kernel: [23924.576246] Aug 22 12:02:30 juju-e4d256-prod-github-runner-207 kernel: [23924.577155] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:02:30 juju-e4d256-prod-github-runner-207 kernel: [23924.578215] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:02:30 juju-e4d256-prod-github-runner-207 kernel: [23924.579235] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:02:30 juju-e4d256-prod-github-runner-207 kernel: [23924.580335] ? show_regs.part.0+0x23/0x29 Aug 22 12:02:30 juju-e4d256-prod-github-runner-207 kernel: [23924.581380] ? show_regs.cold+0x8/0xd Aug 22 12:02:30 juju-e4d256-prod-github-runner-207 kernel: [23924.582350] ? watchdog_timer_fn+0x1be/0x220 Aug 22 12:02:30 juju-e4d256-prod-github-runner-207 kernel: [23924.583353] ? lockup_detector_update_enable+0x60/0x60 Aug 22 12:02:30 juju-e4d256-prod-github-runner-207 kernel: [23924.584411] ? __hrtimer_run_queues+0x107/0x230 Aug 22 12:02:30 juju-e4d256-prod-github-runner-207 kernel: [23924.585466] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 12:02:30 juju-e4d256-prod-github-runner-207 kernel: [23924.586485] ? hrtimer_interrupt+0x101/0x220 Aug 22 12:02:30 juju-e4d256-prod-github-runner-207 kernel: [23924.587496] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 12:02:30 juju-e4d256-prod-github-runner-207 kernel: [23924.588568] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 12:02:30 juju-e4d256-prod-github-runner-207 kernel: [23924.589633] Aug 22 12:02:30 juju-e4d256-prod-github-runner-207 kernel: [23924.590493] Aug 22 12:02:30 juju-e4d256-prod-github-runner-207 kernel: [23924.591329] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 12:02:30 juju-e4d256-prod-github-runner-207 kernel: [23924.592418] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:02:30 juju-e4d256-prod-github-runner-207 kernel: [23924.593480] ? _raw_spin_lock+0x22/0x30 Aug 22 12:02:30 juju-e4d256-prod-github-runner-207 kernel: [23924.594432] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:02:30 juju-e4d256-prod-github-runner-207 kernel: [23924.595457] direct_page_fault+0x206/0x310 [kvm] Aug 22 12:02:30 juju-e4d256-prod-github-runner-207 kernel: [23924.596619] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 12:02:30 juju-e4d256-prod-github-runner-207 kernel: [23924.597643] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 12:02:30 juju-e4d256-prod-github-runner-207 kernel: [23924.598639] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 12:02:30 juju-e4d256-prod-github-runner-207 kernel: [23924.599656] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 12:02:30 juju-e4d256-prod-github-runner-207 kernel: [23924.600598] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 12:02:30 juju-e4d256-prod-github-runner-207 kernel: [23924.601595] handle_exit+0x98/0x230 [kvm_amd] Aug 22 12:02:30 juju-e4d256-prod-github-runner-207 kernel: [23924.602499] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 12:02:30 juju-e4d256-prod-github-runner-207 kernel: [23924.603427] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 12:02:30 juju-e4d256-prod-github-runner-207 kernel: [23924.604348] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 12:02:30 juju-e4d256-prod-github-runner-207 kernel: [23924.605248] vcpu_run+0x62/0x2c0 [kvm] Aug 22 12:02:30 juju-e4d256-prod-github-runner-207 kernel: [23924.606137] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 12:02:30 juju-e4d256-prod-github-runner-207 kernel: [23924.606941] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 12:02:30 juju-e4d256-prod-github-runner-207 kernel: [23924.607789] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 12:02:30 juju-e4d256-prod-github-runner-207 kernel: [23924.608584] ? __seccomp_filter+0x4a/0x4a0 Aug 22 12:02:30 juju-e4d256-prod-github-runner-207 kernel: [23924.609342] ? __fget_files+0x86/0xc0 Aug 22 12:02:30 juju-e4d256-prod-github-runner-207 kernel: [23924.610048] __x64_sys_ioctl+0x95/0xd0 Aug 22 12:02:30 juju-e4d256-prod-github-runner-207 kernel: [23924.610737] do_syscall_64+0x5c/0xc0 Aug 22 12:02:30 juju-e4d256-prod-github-runner-207 kernel: [23924.611398] ? do_futex+0x162/0x1f0 Aug 22 12:02:30 juju-e4d256-prod-github-runner-207 kernel: [23924.612049] ? __x64_sys_futex+0x78/0x1e0 Aug 22 12:02:30 juju-e4d256-prod-github-runner-207 kernel: [23924.612717] ? __secure_computing+0xa9/0x120 Aug 22 12:02:30 juju-e4d256-prod-github-runner-207 kernel: [23924.613418] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 12:02:30 juju-e4d256-prod-github-runner-207 kernel: [23924.614210] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:02:30 juju-e4d256-prod-github-runner-207 kernel: [23924.614928] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:02:30 juju-e4d256-prod-github-runner-207 kernel: [23924.615645] ? do_syscall_64+0x69/0xc0 Aug 22 12:02:30 juju-e4d256-prod-github-runner-207 kernel: [23924.616286] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:02:30 juju-e4d256-prod-github-runner-207 kernel: [23924.616988] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:02:30 juju-e4d256-prod-github-runner-207 kernel: [23924.617712] ? do_syscall_64+0x69/0xc0 Aug 22 12:02:30 juju-e4d256-prod-github-runner-207 kernel: [23924.618354] ? do_syscall_64+0x69/0xc0 Aug 22 12:02:30 juju-e4d256-prod-github-runner-207 kernel: [23924.618979] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 12:02:30 juju-e4d256-prod-github-runner-207 kernel: [23924.619687] RIP: 0033:0x7faa5d0edaff Aug 22 12:02:30 juju-e4d256-prod-github-runner-207 kernel: [23924.620354] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 12:02:30 juju-e4d256-prod-github-runner-207 kernel: [23924.622356] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 12:02:30 juju-e4d256-prod-github-runner-207 kernel: [23924.623268] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 12:02:30 juju-e4d256-prod-github-runner-207 kernel: [23924.624160] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 12:02:30 juju-e4d256-prod-github-runner-207 kernel: [23924.625055] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 12:02:30 juju-e4d256-prod-github-runner-207 kernel: [23924.625956] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 12:02:30 juju-e4d256-prod-github-runner-207 kernel: [23924.626848] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 12:02:30 juju-e4d256-prod-github-runner-207 kernel: [23924.627754] Aug 22 12:02:44 juju-e4d256-prod-github-runner-207 kernel: [23938.784710] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 12:02:44 juju-e4d256-prod-github-runner-207 kernel: [23938.785703] rcu: 1-....: (5936824 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=2873813 Aug 22 12:02:44 juju-e4d256-prod-github-runner-207 kernel: [23938.786827] (t=5955396 jiffies g=23269 q=28914) Aug 22 12:02:44 juju-e4d256-prod-github-runner-207 kernel: [23938.787607] NMI backtrace for cpu 1 Aug 22 12:02:44 juju-e4d256-prod-github-runner-207 kernel: [23938.788320] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 12:02:44 juju-e4d256-prod-github-runner-207 kernel: [23938.789449] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 12:02:44 juju-e4d256-prod-github-runner-207 kernel: [23938.790551] Call Trace: Aug 22 12:02:44 juju-e4d256-prod-github-runner-207 kernel: [23938.791247] Aug 22 12:02:44 juju-e4d256-prod-github-runner-207 kernel: [23938.791892] show_stack+0x52/0x5c Aug 22 12:02:44 juju-e4d256-prod-github-runner-207 kernel: [23938.792626] dump_stack_lvl+0x4a/0x63 Aug 22 12:02:44 juju-e4d256-prod-github-runner-207 kernel: [23938.793419] dump_stack+0x10/0x16 Aug 22 12:02:44 juju-e4d256-prod-github-runner-207 kernel: [23938.794160] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 12:02:44 juju-e4d256-prod-github-runner-207 kernel: [23938.794945] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 12:02:44 juju-e4d256-prod-github-runner-207 kernel: [23938.795738] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 12:02:44 juju-e4d256-prod-github-runner-207 kernel: [23938.796567] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 12:02:44 juju-e4d256-prod-github-runner-207 kernel: [23938.797470] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 12:02:44 juju-e4d256-prod-github-runner-207 kernel: [23938.798292] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 12:02:44 juju-e4d256-prod-github-runner-207 kernel: [23938.799078] print_cpu_stall.cold+0x2f/0xe2 Aug 22 12:02:44 juju-e4d256-prod-github-runner-207 kernel: [23938.799856] ? timekeeping_update+0xf7/0x150 Aug 22 12:02:44 juju-e4d256-prod-github-runner-207 kernel: [23938.800637] check_cpu_stall+0x109/0x270 Aug 22 12:02:44 juju-e4d256-prod-github-runner-207 kernel: [23938.801404] rcu_sched_clock_irq+0x9a/0x250 Aug 22 12:02:44 juju-e4d256-prod-github-runner-207 kernel: [23938.802179] update_process_times+0x94/0xd0 Aug 22 12:02:44 juju-e4d256-prod-github-runner-207 kernel: [23938.802955] tick_sched_handle+0x29/0x70 Aug 22 12:02:44 juju-e4d256-prod-github-runner-207 kernel: [23938.803732] tick_sched_timer+0x8c/0xc0 Aug 22 12:02:44 juju-e4d256-prod-github-runner-207 kernel: [23938.804496] ? tick_nohz_handler+0xb0/0xb0 Aug 22 12:02:44 juju-e4d256-prod-github-runner-207 kernel: [23938.805306] __hrtimer_run_queues+0x107/0x230 Aug 22 12:02:44 juju-e4d256-prod-github-runner-207 kernel: [23938.806085] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 12:02:44 juju-e4d256-prod-github-runner-207 kernel: [23938.806864] hrtimer_interrupt+0x101/0x220 Aug 22 12:02:44 juju-e4d256-prod-github-runner-207 kernel: [23938.807624] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 12:02:44 juju-e4d256-prod-github-runner-207 kernel: [23938.808489] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 12:02:44 juju-e4d256-prod-github-runner-207 kernel: [23938.809326] Aug 22 12:02:44 juju-e4d256-prod-github-runner-207 kernel: [23938.809976] Aug 22 12:02:44 juju-e4d256-prod-github-runner-207 kernel: [23938.810608] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 12:02:44 juju-e4d256-prod-github-runner-207 kernel: [23938.811443] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:02:44 juju-e4d256-prod-github-runner-207 kernel: [23938.812345] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 12:02:44 juju-e4d256-prod-github-runner-207 kernel: [23938.814602] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 12:02:44 juju-e4d256-prod-github-runner-207 kernel: [23938.815493] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 12:02:44 juju-e4d256-prod-github-runner-207 kernel: [23938.816497] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 12:02:44 juju-e4d256-prod-github-runner-207 kernel: [23938.817504] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 12:02:44 juju-e4d256-prod-github-runner-207 kernel: [23938.818474] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 12:02:44 juju-e4d256-prod-github-runner-207 kernel: [23938.819438] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 12:02:44 juju-e4d256-prod-github-runner-207 kernel: [23938.820447] ? _raw_spin_lock+0x22/0x30 Aug 22 12:02:44 juju-e4d256-prod-github-runner-207 kernel: [23938.821260] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:02:44 juju-e4d256-prod-github-runner-207 kernel: [23938.822106] direct_page_fault+0x206/0x310 [kvm] Aug 22 12:02:44 juju-e4d256-prod-github-runner-207 kernel: [23938.822950] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 12:02:44 juju-e4d256-prod-github-runner-207 kernel: [23938.823781] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 12:02:44 juju-e4d256-prod-github-runner-207 kernel: [23938.824765] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 12:02:44 juju-e4d256-prod-github-runner-207 kernel: [23938.825841] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 12:02:44 juju-e4d256-prod-github-runner-207 kernel: [23938.826684] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 12:02:44 juju-e4d256-prod-github-runner-207 kernel: [23938.827525] handle_exit+0x98/0x230 [kvm_amd] Aug 22 12:02:44 juju-e4d256-prod-github-runner-207 kernel: [23938.828306] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 12:02:44 juju-e4d256-prod-github-runner-207 kernel: [23938.829150] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 12:02:44 juju-e4d256-prod-github-runner-207 kernel: [23938.829993] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 12:02:44 juju-e4d256-prod-github-runner-207 kernel: [23938.830784] vcpu_run+0x62/0x2c0 [kvm] Aug 22 12:02:44 juju-e4d256-prod-github-runner-207 kernel: [23938.831510] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 12:02:44 juju-e4d256-prod-github-runner-207 kernel: [23938.832257] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 12:02:44 juju-e4d256-prod-github-runner-207 kernel: [23938.833075] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 12:02:44 juju-e4d256-prod-github-runner-207 kernel: [23938.833857] ? __seccomp_filter+0x4a/0x4a0 Aug 22 12:02:44 juju-e4d256-prod-github-runner-207 kernel: [23938.834600] ? __fget_files+0x86/0xc0 Aug 22 12:02:44 juju-e4d256-prod-github-runner-207 kernel: [23938.835374] __x64_sys_ioctl+0x95/0xd0 Aug 22 12:02:44 juju-e4d256-prod-github-runner-207 kernel: [23938.836083] do_syscall_64+0x5c/0xc0 Aug 22 12:02:44 juju-e4d256-prod-github-runner-207 kernel: [23938.836770] ? do_futex+0x162/0x1f0 Aug 22 12:02:44 juju-e4d256-prod-github-runner-207 kernel: [23938.837469] ? __x64_sys_futex+0x78/0x1e0 Aug 22 12:02:44 juju-e4d256-prod-github-runner-207 kernel: [23938.838215] ? __secure_computing+0xa9/0x120 Aug 22 12:02:44 juju-e4d256-prod-github-runner-207 kernel: [23938.838944] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 12:02:44 juju-e4d256-prod-github-runner-207 kernel: [23938.839741] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:02:44 juju-e4d256-prod-github-runner-207 kernel: [23938.840497] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:02:44 juju-e4d256-prod-github-runner-207 kernel: [23938.841360] ? do_syscall_64+0x69/0xc0 Aug 22 12:02:44 juju-e4d256-prod-github-runner-207 kernel: [23938.842094] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:02:44 juju-e4d256-prod-github-runner-207 kernel: [23938.842866] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:02:44 juju-e4d256-prod-github-runner-207 kernel: [23938.843642] ? do_syscall_64+0x69/0xc0 Aug 22 12:02:44 juju-e4d256-prod-github-runner-207 kernel: [23938.844344] ? do_syscall_64+0x69/0xc0 Aug 22 12:02:44 juju-e4d256-prod-github-runner-207 kernel: [23938.845053] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 12:02:44 juju-e4d256-prod-github-runner-207 kernel: [23938.845865] RIP: 0033:0x7faa5d0edaff Aug 22 12:02:44 juju-e4d256-prod-github-runner-207 kernel: [23938.846555] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 12:02:44 juju-e4d256-prod-github-runner-207 kernel: [23938.848749] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 12:02:44 juju-e4d256-prod-github-runner-207 kernel: [23938.849751] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 12:02:44 juju-e4d256-prod-github-runner-207 kernel: [23938.850715] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 12:02:44 juju-e4d256-prod-github-runner-207 kernel: [23938.851674] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 12:02:44 juju-e4d256-prod-github-runner-207 kernel: [23938.852636] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 12:02:44 juju-e4d256-prod-github-runner-207 kernel: [23938.853593] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 12:02:44 juju-e4d256-prod-github-runner-207 kernel: [23938.854518] Aug 22 12:03:10 juju-e4d256-prod-github-runner-207 kernel: [23964.541981] watchdog: BUG: soft lockup - CPU#1 stuck for 22210s! [qemu-system-x86:6715] Aug 22 12:03:10 juju-e4d256-prod-github-runner-207 kernel: [23964.543377] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 12:03:10 juju-e4d256-prod-github-runner-207 kernel: [23964.543461] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 12:03:10 juju-e4d256-prod-github-runner-207 kernel: [23964.555751] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 12:03:10 juju-e4d256-prod-github-runner-207 kernel: [23964.557040] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 12:03:10 juju-e4d256-prod-github-runner-207 kernel: [23964.558290] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:03:10 juju-e4d256-prod-github-runner-207 kernel: [23964.559342] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 12:03:10 juju-e4d256-prod-github-runner-207 kernel: [23964.561929] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 12:03:10 juju-e4d256-prod-github-runner-207 kernel: [23964.562972] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 12:03:10 juju-e4d256-prod-github-runner-207 kernel: [23964.564177] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 12:03:10 juju-e4d256-prod-github-runner-207 kernel: [23964.565357] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 12:03:10 juju-e4d256-prod-github-runner-207 kernel: [23964.566514] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 12:03:10 juju-e4d256-prod-github-runner-207 kernel: [23964.567671] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 12:03:10 juju-e4d256-prod-github-runner-207 kernel: [23964.568834] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 12:03:10 juju-e4d256-prod-github-runner-207 kernel: [23964.570103] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 12:03:10 juju-e4d256-prod-github-runner-207 kernel: [23964.571335] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 12:03:10 juju-e4d256-prod-github-runner-207 kernel: [23964.572540] Call Trace: Aug 22 12:03:10 juju-e4d256-prod-github-runner-207 kernel: [23964.573486] Aug 22 12:03:10 juju-e4d256-prod-github-runner-207 kernel: [23964.574379] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:03:10 juju-e4d256-prod-github-runner-207 kernel: [23964.575416] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:03:10 juju-e4d256-prod-github-runner-207 kernel: [23964.576438] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:03:10 juju-e4d256-prod-github-runner-207 kernel: [23964.577532] ? show_regs.part.0+0x23/0x29 Aug 22 12:03:10 juju-e4d256-prod-github-runner-207 kernel: [23964.578535] ? show_regs.cold+0x8/0xd Aug 22 12:03:10 juju-e4d256-prod-github-runner-207 kernel: [23964.579503] ? watchdog_timer_fn+0x1be/0x220 Aug 22 12:03:10 juju-e4d256-prod-github-runner-207 kernel: [23964.580507] ? lockup_detector_update_enable+0x60/0x60 Aug 22 12:03:10 juju-e4d256-prod-github-runner-207 kernel: [23964.581587] ? __hrtimer_run_queues+0x107/0x230 Aug 22 12:03:10 juju-e4d256-prod-github-runner-207 kernel: [23964.582614] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 12:03:10 juju-e4d256-prod-github-runner-207 kernel: [23964.583639] ? hrtimer_interrupt+0x101/0x220 Aug 22 12:03:10 juju-e4d256-prod-github-runner-207 kernel: [23964.584650] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 12:03:10 juju-e4d256-prod-github-runner-207 kernel: [23964.585728] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 12:03:10 juju-e4d256-prod-github-runner-207 kernel: [23964.586775] Aug 22 12:03:10 juju-e4d256-prod-github-runner-207 kernel: [23964.587632] Aug 22 12:03:10 juju-e4d256-prod-github-runner-207 kernel: [23964.588475] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 12:03:10 juju-e4d256-prod-github-runner-207 kernel: [23964.589530] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:03:10 juju-e4d256-prod-github-runner-207 kernel: [23964.590584] ? _raw_spin_lock+0x22/0x30 Aug 22 12:03:10 juju-e4d256-prod-github-runner-207 kernel: [23964.591539] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:03:10 juju-e4d256-prod-github-runner-207 kernel: [23964.592582] direct_page_fault+0x206/0x310 [kvm] Aug 22 12:03:10 juju-e4d256-prod-github-runner-207 kernel: [23964.593626] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 12:03:10 juju-e4d256-prod-github-runner-207 kernel: [23964.594632] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 12:03:10 juju-e4d256-prod-github-runner-207 kernel: [23964.595631] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 12:03:10 juju-e4d256-prod-github-runner-207 kernel: [23964.596599] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 12:03:10 juju-e4d256-prod-github-runner-207 kernel: [23964.597571] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 12:03:10 juju-e4d256-prod-github-runner-207 kernel: [23964.598547] handle_exit+0x98/0x230 [kvm_amd] Aug 22 12:03:10 juju-e4d256-prod-github-runner-207 kernel: [23964.599440] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 12:03:10 juju-e4d256-prod-github-runner-207 kernel: [23964.600355] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 12:03:10 juju-e4d256-prod-github-runner-207 kernel: [23964.601283] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 12:03:10 juju-e4d256-prod-github-runner-207 kernel: [23964.602188] vcpu_run+0x62/0x2c0 [kvm] Aug 22 12:03:10 juju-e4d256-prod-github-runner-207 kernel: [23964.602994] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 12:03:10 juju-e4d256-prod-github-runner-207 kernel: [23964.603797] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 12:03:10 juju-e4d256-prod-github-runner-207 kernel: [23964.604646] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 12:03:10 juju-e4d256-prod-github-runner-207 kernel: [23964.605447] ? __seccomp_filter+0x4a/0x4a0 Aug 22 12:03:10 juju-e4d256-prod-github-runner-207 kernel: [23964.606217] ? __fget_files+0x86/0xc0 Aug 22 12:03:10 juju-e4d256-prod-github-runner-207 kernel: [23964.606930] __x64_sys_ioctl+0x95/0xd0 Aug 22 12:03:10 juju-e4d256-prod-github-runner-207 kernel: [23964.607629] do_syscall_64+0x5c/0xc0 Aug 22 12:03:10 juju-e4d256-prod-github-runner-207 kernel: [23964.608305] ? do_futex+0x162/0x1f0 Aug 22 12:03:10 juju-e4d256-prod-github-runner-207 kernel: [23964.608971] ? __x64_sys_futex+0x78/0x1e0 Aug 22 12:03:10 juju-e4d256-prod-github-runner-207 kernel: [23964.609646] ? __secure_computing+0xa9/0x120 Aug 22 12:03:10 juju-e4d256-prod-github-runner-207 kernel: [23964.610339] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 12:03:10 juju-e4d256-prod-github-runner-207 kernel: [23964.611103] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:03:10 juju-e4d256-prod-github-runner-207 kernel: [23964.611840] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:03:10 juju-e4d256-prod-github-runner-207 kernel: [23964.612571] ? do_syscall_64+0x69/0xc0 Aug 22 12:03:10 juju-e4d256-prod-github-runner-207 kernel: [23964.613296] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:03:10 juju-e4d256-prod-github-runner-207 kernel: [23964.614000] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:03:10 juju-e4d256-prod-github-runner-207 kernel: [23964.614695] ? do_syscall_64+0x69/0xc0 Aug 22 12:03:10 juju-e4d256-prod-github-runner-207 kernel: [23964.615319] ? do_syscall_64+0x69/0xc0 Aug 22 12:03:10 juju-e4d256-prod-github-runner-207 kernel: [23964.615943] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 12:03:10 juju-e4d256-prod-github-runner-207 kernel: [23964.616651] RIP: 0033:0x7faa5d0edaff Aug 22 12:03:10 juju-e4d256-prod-github-runner-207 kernel: [23964.617292] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 12:03:10 juju-e4d256-prod-github-runner-207 kernel: [23964.619283] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 12:03:10 juju-e4d256-prod-github-runner-207 kernel: [23964.620198] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 12:03:10 juju-e4d256-prod-github-runner-207 kernel: [23964.621091] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 12:03:10 juju-e4d256-prod-github-runner-207 kernel: [23964.621983] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 12:03:10 juju-e4d256-prod-github-runner-207 kernel: [23964.622872] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 12:03:10 juju-e4d256-prod-github-runner-207 kernel: [23964.623884] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 12:03:10 juju-e4d256-prod-github-runner-207 kernel: [23964.624777] Aug 22 12:03:38 juju-e4d256-prod-github-runner-207 kernel: [23992.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 22236s! [qemu-system-x86:6715] Aug 22 12:03:38 juju-e4d256-prod-github-runner-207 kernel: [23992.543119] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 12:03:38 juju-e4d256-prod-github-runner-207 kernel: [23992.543195] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 12:03:38 juju-e4d256-prod-github-runner-207 kernel: [23992.555301] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 12:03:38 juju-e4d256-prod-github-runner-207 kernel: [23992.556581] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 12:03:38 juju-e4d256-prod-github-runner-207 kernel: [23992.557803] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:03:38 juju-e4d256-prod-github-runner-207 kernel: [23992.558865] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 12:03:38 juju-e4d256-prod-github-runner-207 kernel: [23992.561451] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 12:03:38 juju-e4d256-prod-github-runner-207 kernel: [23992.562493] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 12:03:38 juju-e4d256-prod-github-runner-207 kernel: [23992.563652] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 12:03:38 juju-e4d256-prod-github-runner-207 kernel: [23992.564825] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 12:03:38 juju-e4d256-prod-github-runner-207 kernel: [23992.565986] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 12:03:38 juju-e4d256-prod-github-runner-207 kernel: [23992.567146] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 12:03:38 juju-e4d256-prod-github-runner-207 kernel: [23992.568319] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 12:03:38 juju-e4d256-prod-github-runner-207 kernel: [23992.569570] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 12:03:38 juju-e4d256-prod-github-runner-207 kernel: [23992.570667] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 12:03:38 juju-e4d256-prod-github-runner-207 kernel: [23992.571863] Call Trace: Aug 22 12:03:38 juju-e4d256-prod-github-runner-207 kernel: [23992.572791] Aug 22 12:03:38 juju-e4d256-prod-github-runner-207 kernel: [23992.573682] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:03:38 juju-e4d256-prod-github-runner-207 kernel: [23992.574711] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:03:38 juju-e4d256-prod-github-runner-207 kernel: [23992.575732] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:03:38 juju-e4d256-prod-github-runner-207 kernel: [23992.576852] ? show_regs.part.0+0x23/0x29 Aug 22 12:03:38 juju-e4d256-prod-github-runner-207 kernel: [23992.577851] ? show_regs.cold+0x8/0xd Aug 22 12:03:38 juju-e4d256-prod-github-runner-207 kernel: [23992.578820] ? watchdog_timer_fn+0x1be/0x220 Aug 22 12:03:38 juju-e4d256-prod-github-runner-207 kernel: [23992.579826] ? lockup_detector_update_enable+0x60/0x60 Aug 22 12:03:38 juju-e4d256-prod-github-runner-207 kernel: [23992.580899] ? __hrtimer_run_queues+0x107/0x230 Aug 22 12:03:38 juju-e4d256-prod-github-runner-207 kernel: [23992.581925] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 12:03:38 juju-e4d256-prod-github-runner-207 kernel: [23992.582950] ? hrtimer_interrupt+0x101/0x220 Aug 22 12:03:38 juju-e4d256-prod-github-runner-207 kernel: [23992.583968] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 12:03:38 juju-e4d256-prod-github-runner-207 kernel: [23992.585073] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 12:03:38 juju-e4d256-prod-github-runner-207 kernel: [23992.586120] Aug 22 12:03:38 juju-e4d256-prod-github-runner-207 kernel: [23992.586979] Aug 22 12:03:38 juju-e4d256-prod-github-runner-207 kernel: [23992.587814] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 12:03:38 juju-e4d256-prod-github-runner-207 kernel: [23992.588868] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:03:38 juju-e4d256-prod-github-runner-207 kernel: [23992.589927] ? _raw_spin_lock+0x22/0x30 Aug 22 12:03:38 juju-e4d256-prod-github-runner-207 kernel: [23992.590905] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:03:38 juju-e4d256-prod-github-runner-207 kernel: [23992.591944] direct_page_fault+0x206/0x310 [kvm] Aug 22 12:03:38 juju-e4d256-prod-github-runner-207 kernel: [23992.592989] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 12:03:38 juju-e4d256-prod-github-runner-207 kernel: [23992.594002] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 12:03:38 juju-e4d256-prod-github-runner-207 kernel: [23992.595002] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 12:03:38 juju-e4d256-prod-github-runner-207 kernel: [23992.596116] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 12:03:38 juju-e4d256-prod-github-runner-207 kernel: [23992.597075] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 12:03:38 juju-e4d256-prod-github-runner-207 kernel: [23992.598054] handle_exit+0x98/0x230 [kvm_amd] Aug 22 12:03:38 juju-e4d256-prod-github-runner-207 kernel: [23992.598950] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 12:03:38 juju-e4d256-prod-github-runner-207 kernel: [23992.599876] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 12:03:38 juju-e4d256-prod-github-runner-207 kernel: [23992.600811] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 12:03:38 juju-e4d256-prod-github-runner-207 kernel: [23992.601712] vcpu_run+0x62/0x2c0 [kvm] Aug 22 12:03:38 juju-e4d256-prod-github-runner-207 kernel: [23992.602526] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 12:03:38 juju-e4d256-prod-github-runner-207 kernel: [23992.603331] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 12:03:38 juju-e4d256-prod-github-runner-207 kernel: [23992.604182] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 12:03:38 juju-e4d256-prod-github-runner-207 kernel: [23992.604995] ? __seccomp_filter+0x4a/0x4a0 Aug 22 12:03:38 juju-e4d256-prod-github-runner-207 kernel: [23992.605745] ? __fget_files+0x86/0xc0 Aug 22 12:03:38 juju-e4d256-prod-github-runner-207 kernel: [23992.606609] __x64_sys_ioctl+0x95/0xd0 Aug 22 12:03:38 juju-e4d256-prod-github-runner-207 kernel: [23992.607299] do_syscall_64+0x5c/0xc0 Aug 22 12:03:38 juju-e4d256-prod-github-runner-207 kernel: [23992.607964] ? do_futex+0x162/0x1f0 Aug 22 12:03:38 juju-e4d256-prod-github-runner-207 kernel: [23992.608626] ? __x64_sys_futex+0x78/0x1e0 Aug 22 12:03:38 juju-e4d256-prod-github-runner-207 kernel: [23992.609304] ? __secure_computing+0xa9/0x120 Aug 22 12:03:38 juju-e4d256-prod-github-runner-207 kernel: [23992.609996] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 12:03:38 juju-e4d256-prod-github-runner-207 kernel: [23992.610756] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:03:38 juju-e4d256-prod-github-runner-207 kernel: [23992.611477] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:03:38 juju-e4d256-prod-github-runner-207 kernel: [23992.612193] ? do_syscall_64+0x69/0xc0 Aug 22 12:03:38 juju-e4d256-prod-github-runner-207 kernel: [23992.612858] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:03:38 juju-e4d256-prod-github-runner-207 kernel: [23992.613564] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:03:38 juju-e4d256-prod-github-runner-207 kernel: [23992.614257] ? do_syscall_64+0x69/0xc0 Aug 22 12:03:38 juju-e4d256-prod-github-runner-207 kernel: [23992.614883] ? do_syscall_64+0x69/0xc0 Aug 22 12:03:38 juju-e4d256-prod-github-runner-207 kernel: [23992.615512] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 12:03:38 juju-e4d256-prod-github-runner-207 kernel: [23992.616217] RIP: 0033:0x7faa5d0edaff Aug 22 12:03:38 juju-e4d256-prod-github-runner-207 kernel: [23992.616855] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 12:03:38 juju-e4d256-prod-github-runner-207 kernel: [23992.618853] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 12:03:38 juju-e4d256-prod-github-runner-207 kernel: [23992.619761] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 12:03:38 juju-e4d256-prod-github-runner-207 kernel: [23992.620659] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 12:03:38 juju-e4d256-prod-github-runner-207 kernel: [23992.621554] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 12:03:38 juju-e4d256-prod-github-runner-207 kernel: [23992.622439] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 12:03:38 juju-e4d256-prod-github-runner-207 kernel: [23992.623324] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 12:03:38 juju-e4d256-prod-github-runner-207 kernel: [23992.624215] Aug 22 12:04:06 juju-e4d256-prod-github-runner-207 kernel: [24020.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 22262s! [qemu-system-x86:6715] Aug 22 12:04:06 juju-e4d256-prod-github-runner-207 kernel: [24020.543804] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 12:04:06 juju-e4d256-prod-github-runner-207 kernel: [24020.544102] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 12:04:06 juju-e4d256-prod-github-runner-207 kernel: [24020.556983] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 12:04:06 juju-e4d256-prod-github-runner-207 kernel: [24020.559078] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 12:04:06 juju-e4d256-prod-github-runner-207 kernel: [24020.560357] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:04:06 juju-e4d256-prod-github-runner-207 kernel: [24020.561554] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 12:04:06 juju-e4d256-prod-github-runner-207 kernel: [24020.564303] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 12:04:06 juju-e4d256-prod-github-runner-207 kernel: [24020.565352] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 12:04:06 juju-e4d256-prod-github-runner-207 kernel: [24020.566514] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 12:04:06 juju-e4d256-prod-github-runner-207 kernel: [24020.567670] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 12:04:06 juju-e4d256-prod-github-runner-207 kernel: [24020.568839] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 12:04:06 juju-e4d256-prod-github-runner-207 kernel: [24020.569999] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 12:04:06 juju-e4d256-prod-github-runner-207 kernel: [24020.571168] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 12:04:06 juju-e4d256-prod-github-runner-207 kernel: [24020.572424] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 12:04:06 juju-e4d256-prod-github-runner-207 kernel: [24020.573522] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 12:04:06 juju-e4d256-prod-github-runner-207 kernel: [24020.574719] Call Trace: Aug 22 12:04:06 juju-e4d256-prod-github-runner-207 kernel: [24020.575640] Aug 22 12:04:06 juju-e4d256-prod-github-runner-207 kernel: [24020.576575] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:04:06 juju-e4d256-prod-github-runner-207 kernel: [24020.577609] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:04:06 juju-e4d256-prod-github-runner-207 kernel: [24020.578629] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:04:06 juju-e4d256-prod-github-runner-207 kernel: [24020.579726] ? show_regs.part.0+0x23/0x29 Aug 22 12:04:06 juju-e4d256-prod-github-runner-207 kernel: [24020.580736] ? show_regs.cold+0x8/0xd Aug 22 12:04:06 juju-e4d256-prod-github-runner-207 kernel: [24020.581711] ? watchdog_timer_fn+0x1be/0x220 Aug 22 12:04:06 juju-e4d256-prod-github-runner-207 kernel: [24020.582722] ? lockup_detector_update_enable+0x60/0x60 Aug 22 12:04:06 juju-e4d256-prod-github-runner-207 kernel: [24020.583792] ? __hrtimer_run_queues+0x107/0x230 Aug 22 12:04:06 juju-e4d256-prod-github-runner-207 kernel: [24020.584837] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 12:04:06 juju-e4d256-prod-github-runner-207 kernel: [24020.585862] ? hrtimer_interrupt+0x101/0x220 Aug 22 12:04:06 juju-e4d256-prod-github-runner-207 kernel: [24020.586878] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 12:04:06 juju-e4d256-prod-github-runner-207 kernel: [24020.587961] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 12:04:06 juju-e4d256-prod-github-runner-207 kernel: [24020.589017] Aug 22 12:04:06 juju-e4d256-prod-github-runner-207 kernel: [24020.589869] Aug 22 12:04:06 juju-e4d256-prod-github-runner-207 kernel: [24020.590711] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 12:04:06 juju-e4d256-prod-github-runner-207 kernel: [24020.591749] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:04:06 juju-e4d256-prod-github-runner-207 kernel: [24020.592808] ? _raw_spin_lock+0x22/0x30 Aug 22 12:04:06 juju-e4d256-prod-github-runner-207 kernel: [24020.593762] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:04:06 juju-e4d256-prod-github-runner-207 kernel: [24020.594786] direct_page_fault+0x206/0x310 [kvm] Aug 22 12:04:06 juju-e4d256-prod-github-runner-207 kernel: [24020.595810] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 12:04:06 juju-e4d256-prod-github-runner-207 kernel: [24020.596840] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 12:04:06 juju-e4d256-prod-github-runner-207 kernel: [24020.597848] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 12:04:06 juju-e4d256-prod-github-runner-207 kernel: [24020.598860] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 12:04:06 juju-e4d256-prod-github-runner-207 kernel: [24020.599810] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 12:04:06 juju-e4d256-prod-github-runner-207 kernel: [24020.600825] handle_exit+0x98/0x230 [kvm_amd] Aug 22 12:04:06 juju-e4d256-prod-github-runner-207 kernel: [24020.601726] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 12:04:06 juju-e4d256-prod-github-runner-207 kernel: [24020.602641] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 12:04:06 juju-e4d256-prod-github-runner-207 kernel: [24020.603570] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 12:04:06 juju-e4d256-prod-github-runner-207 kernel: [24020.604496] vcpu_run+0x62/0x2c0 [kvm] Aug 22 12:04:06 juju-e4d256-prod-github-runner-207 kernel: [24020.605311] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 12:04:06 juju-e4d256-prod-github-runner-207 kernel: [24020.606120] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 12:04:06 juju-e4d256-prod-github-runner-207 kernel: [24020.607001] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 12:04:06 juju-e4d256-prod-github-runner-207 kernel: [24020.607799] ? __seccomp_filter+0x4a/0x4a0 Aug 22 12:04:06 juju-e4d256-prod-github-runner-207 kernel: [24020.608562] ? __fget_files+0x86/0xc0 Aug 22 12:04:06 juju-e4d256-prod-github-runner-207 kernel: [24020.609269] __x64_sys_ioctl+0x95/0xd0 Aug 22 12:04:06 juju-e4d256-prod-github-runner-207 kernel: [24020.609971] do_syscall_64+0x5c/0xc0 Aug 22 12:04:06 juju-e4d256-prod-github-runner-207 kernel: [24020.610636] ? do_futex+0x162/0x1f0 Aug 22 12:04:06 juju-e4d256-prod-github-runner-207 kernel: [24020.611285] ? __x64_sys_futex+0x78/0x1e0 Aug 22 12:04:06 juju-e4d256-prod-github-runner-207 kernel: [24020.611960] ? __secure_computing+0xa9/0x120 Aug 22 12:04:06 juju-e4d256-prod-github-runner-207 kernel: [24020.612664] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 12:04:06 juju-e4d256-prod-github-runner-207 kernel: [24020.613426] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:04:06 juju-e4d256-prod-github-runner-207 kernel: [24020.614153] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:04:06 juju-e4d256-prod-github-runner-207 kernel: [24020.614870] ? do_syscall_64+0x69/0xc0 Aug 22 12:04:06 juju-e4d256-prod-github-runner-207 kernel: [24020.615520] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:04:06 juju-e4d256-prod-github-runner-207 kernel: [24020.616249] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:04:06 juju-e4d256-prod-github-runner-207 kernel: [24020.616948] ? do_syscall_64+0x69/0xc0 Aug 22 12:04:06 juju-e4d256-prod-github-runner-207 kernel: [24020.617575] ? do_syscall_64+0x69/0xc0 Aug 22 12:04:06 juju-e4d256-prod-github-runner-207 kernel: [24020.618214] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 12:04:06 juju-e4d256-prod-github-runner-207 kernel: [24020.618988] RIP: 0033:0x7faa5d0edaff Aug 22 12:04:06 juju-e4d256-prod-github-runner-207 kernel: [24020.619645] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 12:04:06 juju-e4d256-prod-github-runner-207 kernel: [24020.621648] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 12:04:06 juju-e4d256-prod-github-runner-207 kernel: [24020.622563] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 12:04:06 juju-e4d256-prod-github-runner-207 kernel: [24020.623456] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 12:04:06 juju-e4d256-prod-github-runner-207 kernel: [24020.624354] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 12:04:06 juju-e4d256-prod-github-runner-207 kernel: [24020.625248] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 12:04:06 juju-e4d256-prod-github-runner-207 kernel: [24020.626137] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 12:04:06 juju-e4d256-prod-github-runner-207 kernel: [24020.627027] Aug 22 12:04:34 juju-e4d256-prod-github-runner-207 kernel: [24048.542506] watchdog: BUG: soft lockup - CPU#1 stuck for 22288s! [qemu-system-x86:6715] Aug 22 12:04:34 juju-e4d256-prod-github-runner-207 kernel: [24048.544865] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 12:04:34 juju-e4d256-prod-github-runner-207 kernel: [24048.544943] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 12:04:34 juju-e4d256-prod-github-runner-207 kernel: [24048.575051] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 12:04:34 juju-e4d256-prod-github-runner-207 kernel: [24048.576936] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 12:04:34 juju-e4d256-prod-github-runner-207 kernel: [24048.580473] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:04:34 juju-e4d256-prod-github-runner-207 kernel: [24048.583819] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 12:04:34 juju-e4d256-prod-github-runner-207 kernel: [24048.586491] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 12:04:34 juju-e4d256-prod-github-runner-207 kernel: [24048.587556] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 12:04:34 juju-e4d256-prod-github-runner-207 kernel: [24048.588754] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 12:04:34 juju-e4d256-prod-github-runner-207 kernel: [24048.589964] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 12:04:34 juju-e4d256-prod-github-runner-207 kernel: [24048.591151] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 12:04:34 juju-e4d256-prod-github-runner-207 kernel: [24048.592363] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 12:04:34 juju-e4d256-prod-github-runner-207 kernel: [24048.593555] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 12:04:34 juju-e4d256-prod-github-runner-207 kernel: [24048.595016] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 12:04:34 juju-e4d256-prod-github-runner-207 kernel: [24048.596194] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 12:04:34 juju-e4d256-prod-github-runner-207 kernel: [24048.597409] Call Trace: Aug 22 12:04:34 juju-e4d256-prod-github-runner-207 kernel: [24048.598333] Aug 22 12:04:34 juju-e4d256-prod-github-runner-207 kernel: [24048.599225] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:04:34 juju-e4d256-prod-github-runner-207 kernel: [24048.600310] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:04:34 juju-e4d256-prod-github-runner-207 kernel: [24048.601368] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:04:34 juju-e4d256-prod-github-runner-207 kernel: [24048.602460] ? show_regs.part.0+0x23/0x29 Aug 22 12:04:34 juju-e4d256-prod-github-runner-207 kernel: [24048.603467] ? show_regs.cold+0x8/0xd Aug 22 12:04:34 juju-e4d256-prod-github-runner-207 kernel: [24048.604470] ? watchdog_timer_fn+0x1be/0x220 Aug 22 12:04:34 juju-e4d256-prod-github-runner-207 kernel: [24048.605508] ? lockup_detector_update_enable+0x60/0x60 Aug 22 12:04:34 juju-e4d256-prod-github-runner-207 kernel: [24048.606596] ? __hrtimer_run_queues+0x107/0x230 Aug 22 12:04:34 juju-e4d256-prod-github-runner-207 kernel: [24048.607641] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 12:04:34 juju-e4d256-prod-github-runner-207 kernel: [24048.608695] ? hrtimer_interrupt+0x101/0x220 Aug 22 12:04:34 juju-e4d256-prod-github-runner-207 kernel: [24048.609737] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 12:04:34 juju-e4d256-prod-github-runner-207 kernel: [24048.610839] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 12:04:34 juju-e4d256-prod-github-runner-207 kernel: [24048.611936] Aug 22 12:04:34 juju-e4d256-prod-github-runner-207 kernel: [24048.612813] Aug 22 12:04:34 juju-e4d256-prod-github-runner-207 kernel: [24048.613660] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 12:04:34 juju-e4d256-prod-github-runner-207 kernel: [24048.614714] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:04:34 juju-e4d256-prod-github-runner-207 kernel: [24048.615789] ? _raw_spin_lock+0x22/0x30 Aug 22 12:04:34 juju-e4d256-prod-github-runner-207 kernel: [24048.616779] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:04:34 juju-e4d256-prod-github-runner-207 kernel: [24048.617814] direct_page_fault+0x206/0x310 [kvm] Aug 22 12:04:34 juju-e4d256-prod-github-runner-207 kernel: [24048.618854] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 12:04:34 juju-e4d256-prod-github-runner-207 kernel: [24048.619901] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 12:04:34 juju-e4d256-prod-github-runner-207 kernel: [24048.620928] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 12:04:34 juju-e4d256-prod-github-runner-207 kernel: [24048.621928] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 12:04:34 juju-e4d256-prod-github-runner-207 kernel: [24048.622888] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 12:04:34 juju-e4d256-prod-github-runner-207 kernel: [24048.623894] handle_exit+0x98/0x230 [kvm_amd] Aug 22 12:04:34 juju-e4d256-prod-github-runner-207 kernel: [24048.624806] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 12:04:34 juju-e4d256-prod-github-runner-207 kernel: [24048.625776] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 12:04:34 juju-e4d256-prod-github-runner-207 kernel: [24048.626750] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 12:04:34 juju-e4d256-prod-github-runner-207 kernel: [24048.627683] vcpu_run+0x62/0x2c0 [kvm] Aug 22 12:04:34 juju-e4d256-prod-github-runner-207 kernel: [24048.628531] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 12:04:34 juju-e4d256-prod-github-runner-207 kernel: [24048.629355] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 12:04:34 juju-e4d256-prod-github-runner-207 kernel: [24048.630229] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 12:04:34 juju-e4d256-prod-github-runner-207 kernel: [24048.631054] ? __seccomp_filter+0x4a/0x4a0 Aug 22 12:04:34 juju-e4d256-prod-github-runner-207 kernel: [24048.631821] ? __fget_files+0x86/0xc0 Aug 22 12:04:34 juju-e4d256-prod-github-runner-207 kernel: [24048.632556] __x64_sys_ioctl+0x95/0xd0 Aug 22 12:04:34 juju-e4d256-prod-github-runner-207 kernel: [24048.633269] do_syscall_64+0x5c/0xc0 Aug 22 12:04:34 juju-e4d256-prod-github-runner-207 kernel: [24048.633950] ? do_futex+0x162/0x1f0 Aug 22 12:04:34 juju-e4d256-prod-github-runner-207 kernel: [24048.634610] ? __x64_sys_futex+0x78/0x1e0 Aug 22 12:04:34 juju-e4d256-prod-github-runner-207 kernel: [24048.635296] ? __secure_computing+0xa9/0x120 Aug 22 12:04:34 juju-e4d256-prod-github-runner-207 kernel: [24048.636035] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 12:04:34 juju-e4d256-prod-github-runner-207 kernel: [24048.636826] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:04:34 juju-e4d256-prod-github-runner-207 kernel: [24048.637567] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:04:34 juju-e4d256-prod-github-runner-207 kernel: [24048.638297] ? do_syscall_64+0x69/0xc0 Aug 22 12:04:34 juju-e4d256-prod-github-runner-207 kernel: [24048.638960] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:04:34 juju-e4d256-prod-github-runner-207 kernel: [24048.639932] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:04:34 juju-e4d256-prod-github-runner-207 kernel: [24048.641243] ? do_syscall_64+0x69/0xc0 Aug 22 12:04:34 juju-e4d256-prod-github-runner-207 kernel: [24048.642392] ? do_syscall_64+0x69/0xc0 Aug 22 12:04:34 juju-e4d256-prod-github-runner-207 kernel: [24048.643180] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 12:04:34 juju-e4d256-prod-github-runner-207 kernel: [24048.644073] RIP: 0033:0x7faa5d0edaff Aug 22 12:04:34 juju-e4d256-prod-github-runner-207 kernel: [24048.644852] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 12:04:34 juju-e4d256-prod-github-runner-207 kernel: [24048.647396] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 12:04:34 juju-e4d256-prod-github-runner-207 kernel: [24048.648596] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 12:04:34 juju-e4d256-prod-github-runner-207 kernel: [24048.649704] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 12:04:34 juju-e4d256-prod-github-runner-207 kernel: [24048.650858] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 12:04:34 juju-e4d256-prod-github-runner-207 kernel: [24048.652044] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 12:04:34 juju-e4d256-prod-github-runner-207 kernel: [24048.653198] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 12:04:34 juju-e4d256-prod-github-runner-207 kernel: [24048.654354] Aug 22 12:05:02 juju-e4d256-prod-github-runner-207 kernel: [24076.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 22315s! [qemu-system-x86:6715] Aug 22 12:05:02 juju-e4d256-prod-github-runner-207 kernel: [24076.543086] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 12:05:02 juju-e4d256-prod-github-runner-207 kernel: [24076.543158] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 12:05:02 juju-e4d256-prod-github-runner-207 kernel: [24076.555620] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 12:05:02 juju-e4d256-prod-github-runner-207 kernel: [24076.556959] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 12:05:02 juju-e4d256-prod-github-runner-207 kernel: [24076.558297] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:05:02 juju-e4d256-prod-github-runner-207 kernel: [24076.559419] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 12:05:02 juju-e4d256-prod-github-runner-207 kernel: [24076.562180] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 12:05:02 juju-e4d256-prod-github-runner-207 kernel: [24076.563304] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 12:05:02 juju-e4d256-prod-github-runner-207 kernel: [24076.564551] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 12:05:02 juju-e4d256-prod-github-runner-207 kernel: [24076.565799] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 12:05:02 juju-e4d256-prod-github-runner-207 kernel: [24076.566981] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 12:05:02 juju-e4d256-prod-github-runner-207 kernel: [24076.568177] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 12:05:02 juju-e4d256-prod-github-runner-207 kernel: [24076.569352] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 12:05:02 juju-e4d256-prod-github-runner-207 kernel: [24076.570688] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 12:05:02 juju-e4d256-prod-github-runner-207 kernel: [24076.572054] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 12:05:02 juju-e4d256-prod-github-runner-207 kernel: [24076.573338] Call Trace: Aug 22 12:05:02 juju-e4d256-prod-github-runner-207 kernel: [24076.574412] Aug 22 12:05:02 juju-e4d256-prod-github-runner-207 kernel: [24076.575329] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:05:02 juju-e4d256-prod-github-runner-207 kernel: [24076.576447] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:05:02 juju-e4d256-prod-github-runner-207 kernel: [24076.577530] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:05:02 juju-e4d256-prod-github-runner-207 kernel: [24076.578634] ? show_regs.part.0+0x23/0x29 Aug 22 12:05:02 juju-e4d256-prod-github-runner-207 kernel: [24076.579663] ? show_regs.cold+0x8/0xd Aug 22 12:05:02 juju-e4d256-prod-github-runner-207 kernel: [24076.580640] ? watchdog_timer_fn+0x1be/0x220 Aug 22 12:05:02 juju-e4d256-prod-github-runner-207 kernel: [24076.581658] ? lockup_detector_update_enable+0x60/0x60 Aug 22 12:05:02 juju-e4d256-prod-github-runner-207 kernel: [24076.582726] ? __hrtimer_run_queues+0x107/0x230 Aug 22 12:05:02 juju-e4d256-prod-github-runner-207 kernel: [24076.583767] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 12:05:02 juju-e4d256-prod-github-runner-207 kernel: [24076.584800] ? hrtimer_interrupt+0x101/0x220 Aug 22 12:05:02 juju-e4d256-prod-github-runner-207 kernel: [24076.585873] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 12:05:02 juju-e4d256-prod-github-runner-207 kernel: [24076.587069] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 12:05:02 juju-e4d256-prod-github-runner-207 kernel: [24076.588214] Aug 22 12:05:02 juju-e4d256-prod-github-runner-207 kernel: [24076.589121] Aug 22 12:05:02 juju-e4d256-prod-github-runner-207 kernel: [24076.590032] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 12:05:02 juju-e4d256-prod-github-runner-207 kernel: [24076.591143] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:05:02 juju-e4d256-prod-github-runner-207 kernel: [24076.592246] ? _raw_spin_lock+0x22/0x30 Aug 22 12:05:02 juju-e4d256-prod-github-runner-207 kernel: [24076.593275] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:05:02 juju-e4d256-prod-github-runner-207 kernel: [24076.594399] direct_page_fault+0x206/0x310 [kvm] Aug 22 12:05:02 juju-e4d256-prod-github-runner-207 kernel: [24076.595487] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 12:05:02 juju-e4d256-prod-github-runner-207 kernel: [24076.596536] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 12:05:02 juju-e4d256-prod-github-runner-207 kernel: [24076.597568] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 12:05:02 juju-e4d256-prod-github-runner-207 kernel: [24076.598556] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 12:05:02 juju-e4d256-prod-github-runner-207 kernel: [24076.599535] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 12:05:02 juju-e4d256-prod-github-runner-207 kernel: [24076.600527] handle_exit+0x98/0x230 [kvm_amd] Aug 22 12:05:02 juju-e4d256-prod-github-runner-207 kernel: [24076.601434] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 12:05:02 juju-e4d256-prod-github-runner-207 kernel: [24076.602367] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 12:05:02 juju-e4d256-prod-github-runner-207 kernel: [24076.603305] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 12:05:02 juju-e4d256-prod-github-runner-207 kernel: [24076.604234] vcpu_run+0x62/0x2c0 [kvm] Aug 22 12:05:02 juju-e4d256-prod-github-runner-207 kernel: [24076.605054] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 12:05:02 juju-e4d256-prod-github-runner-207 kernel: [24076.605879] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 12:05:02 juju-e4d256-prod-github-runner-207 kernel: [24076.606750] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 12:05:02 juju-e4d256-prod-github-runner-207 kernel: [24076.607576] ? __seccomp_filter+0x4a/0x4a0 Aug 22 12:05:02 juju-e4d256-prod-github-runner-207 kernel: [24076.608337] ? __fget_files+0x86/0xc0 Aug 22 12:05:02 juju-e4d256-prod-github-runner-207 kernel: [24076.609050] __x64_sys_ioctl+0x95/0xd0 Aug 22 12:05:02 juju-e4d256-prod-github-runner-207 kernel: [24076.609755] do_syscall_64+0x5c/0xc0 Aug 22 12:05:02 juju-e4d256-prod-github-runner-207 kernel: [24076.610429] ? do_futex+0x162/0x1f0 Aug 22 12:05:02 juju-e4d256-prod-github-runner-207 kernel: [24076.611093] ? __x64_sys_futex+0x78/0x1e0 Aug 22 12:05:02 juju-e4d256-prod-github-runner-207 kernel: [24076.611800] ? __secure_computing+0xa9/0x120 Aug 22 12:05:02 juju-e4d256-prod-github-runner-207 kernel: [24076.612539] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 12:05:02 juju-e4d256-prod-github-runner-207 kernel: [24076.613317] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:05:02 juju-e4d256-prod-github-runner-207 kernel: [24076.614047] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:05:02 juju-e4d256-prod-github-runner-207 kernel: [24076.614775] ? do_syscall_64+0x69/0xc0 Aug 22 12:05:02 juju-e4d256-prod-github-runner-207 kernel: [24076.615423] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:05:02 juju-e4d256-prod-github-runner-207 kernel: [24076.616144] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:05:02 juju-e4d256-prod-github-runner-207 kernel: [24076.616841] ? do_syscall_64+0x69/0xc0 Aug 22 12:05:02 juju-e4d256-prod-github-runner-207 kernel: [24076.617471] ? do_syscall_64+0x69/0xc0 Aug 22 12:05:02 juju-e4d256-prod-github-runner-207 kernel: [24076.618093] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 12:05:02 juju-e4d256-prod-github-runner-207 kernel: [24076.618800] RIP: 0033:0x7faa5d0edaff Aug 22 12:05:02 juju-e4d256-prod-github-runner-207 kernel: [24076.619432] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 12:05:02 juju-e4d256-prod-github-runner-207 kernel: [24076.621463] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 12:05:02 juju-e4d256-prod-github-runner-207 kernel: [24076.622391] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 12:05:02 juju-e4d256-prod-github-runner-207 kernel: [24076.623303] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 12:05:02 juju-e4d256-prod-github-runner-207 kernel: [24076.624213] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 12:05:02 juju-e4d256-prod-github-runner-207 kernel: [24076.625107] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 12:05:02 juju-e4d256-prod-github-runner-207 kernel: [24076.626004] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 12:05:02 juju-e4d256-prod-github-runner-207 kernel: [24076.626901] Aug 22 12:05:30 juju-e4d256-prod-github-runner-207 kernel: [24104.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 22341s! [qemu-system-x86:6715] Aug 22 12:05:30 juju-e4d256-prod-github-runner-207 kernel: [24104.543836] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 12:05:30 juju-e4d256-prod-github-runner-207 kernel: [24104.544120] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 12:05:30 juju-e4d256-prod-github-runner-207 kernel: [24104.556241] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 12:05:30 juju-e4d256-prod-github-runner-207 kernel: [24104.557513] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 12:05:30 juju-e4d256-prod-github-runner-207 kernel: [24104.558729] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:05:30 juju-e4d256-prod-github-runner-207 kernel: [24104.559796] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 12:05:30 juju-e4d256-prod-github-runner-207 kernel: [24104.562338] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 12:05:30 juju-e4d256-prod-github-runner-207 kernel: [24104.563399] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 12:05:30 juju-e4d256-prod-github-runner-207 kernel: [24104.564558] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 12:05:30 juju-e4d256-prod-github-runner-207 kernel: [24104.565717] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 12:05:30 juju-e4d256-prod-github-runner-207 kernel: [24104.566881] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 12:05:30 juju-e4d256-prod-github-runner-207 kernel: [24104.568247] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 12:05:30 juju-e4d256-prod-github-runner-207 kernel: [24104.569634] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 12:05:30 juju-e4d256-prod-github-runner-207 kernel: [24104.571079] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 12:05:30 juju-e4d256-prod-github-runner-207 kernel: [24104.572206] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 12:05:30 juju-e4d256-prod-github-runner-207 kernel: [24104.573419] Call Trace: Aug 22 12:05:30 juju-e4d256-prod-github-runner-207 kernel: [24104.574341] Aug 22 12:05:30 juju-e4d256-prod-github-runner-207 kernel: [24104.575267] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:05:30 juju-e4d256-prod-github-runner-207 kernel: [24104.576306] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:05:30 juju-e4d256-prod-github-runner-207 kernel: [24104.577350] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:05:30 juju-e4d256-prod-github-runner-207 kernel: [24104.578450] ? show_regs.part.0+0x23/0x29 Aug 22 12:05:30 juju-e4d256-prod-github-runner-207 kernel: [24104.579461] ? show_regs.cold+0x8/0xd Aug 22 12:05:30 juju-e4d256-prod-github-runner-207 kernel: [24104.580450] ? watchdog_timer_fn+0x1be/0x220 Aug 22 12:05:30 juju-e4d256-prod-github-runner-207 kernel: [24104.581486] ? lockup_detector_update_enable+0x60/0x60 Aug 22 12:05:30 juju-e4d256-prod-github-runner-207 kernel: [24104.582570] ? __hrtimer_run_queues+0x107/0x230 Aug 22 12:05:30 juju-e4d256-prod-github-runner-207 kernel: [24104.583637] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 12:05:30 juju-e4d256-prod-github-runner-207 kernel: [24104.584671] ? hrtimer_interrupt+0x101/0x220 Aug 22 12:05:30 juju-e4d256-prod-github-runner-207 kernel: [24104.585706] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 12:05:30 juju-e4d256-prod-github-runner-207 kernel: [24104.586787] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 12:05:30 juju-e4d256-prod-github-runner-207 kernel: [24104.587880] Aug 22 12:05:30 juju-e4d256-prod-github-runner-207 kernel: [24104.588738] Aug 22 12:05:30 juju-e4d256-prod-github-runner-207 kernel: [24104.589623] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 12:05:30 juju-e4d256-prod-github-runner-207 kernel: [24104.590657] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:05:30 juju-e4d256-prod-github-runner-207 kernel: [24104.591716] ? _raw_spin_lock+0x22/0x30 Aug 22 12:05:30 juju-e4d256-prod-github-runner-207 kernel: [24104.592661] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:05:30 juju-e4d256-prod-github-runner-207 kernel: [24104.593723] direct_page_fault+0x206/0x310 [kvm] Aug 22 12:05:30 juju-e4d256-prod-github-runner-207 kernel: [24104.594800] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 12:05:30 juju-e4d256-prod-github-runner-207 kernel: [24104.595832] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 12:05:30 juju-e4d256-prod-github-runner-207 kernel: [24104.596840] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 12:05:30 juju-e4d256-prod-github-runner-207 kernel: [24104.597845] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 12:05:30 juju-e4d256-prod-github-runner-207 kernel: [24104.598795] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 12:05:30 juju-e4d256-prod-github-runner-207 kernel: [24104.599794] handle_exit+0x98/0x230 [kvm_amd] Aug 22 12:05:30 juju-e4d256-prod-github-runner-207 kernel: [24104.600691] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 12:05:30 juju-e4d256-prod-github-runner-207 kernel: [24104.601618] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 12:05:30 juju-e4d256-prod-github-runner-207 kernel: [24104.602557] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 12:05:30 juju-e4d256-prod-github-runner-207 kernel: [24104.603479] vcpu_run+0x62/0x2c0 [kvm] Aug 22 12:05:30 juju-e4d256-prod-github-runner-207 kernel: [24104.604303] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 12:05:30 juju-e4d256-prod-github-runner-207 kernel: [24104.605120] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 12:05:30 juju-e4d256-prod-github-runner-207 kernel: [24104.605981] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 12:05:30 juju-e4d256-prod-github-runner-207 kernel: [24104.606789] ? __seccomp_filter+0x4a/0x4a0 Aug 22 12:05:30 juju-e4d256-prod-github-runner-207 kernel: [24104.607554] ? __fget_files+0x86/0xc0 Aug 22 12:05:30 juju-e4d256-prod-github-runner-207 kernel: [24104.608258] __x64_sys_ioctl+0x95/0xd0 Aug 22 12:05:30 juju-e4d256-prod-github-runner-207 kernel: [24104.608950] do_syscall_64+0x5c/0xc0 Aug 22 12:05:30 juju-e4d256-prod-github-runner-207 kernel: [24104.609613] ? do_futex+0x162/0x1f0 Aug 22 12:05:30 juju-e4d256-prod-github-runner-207 kernel: [24104.610261] ? __x64_sys_futex+0x78/0x1e0 Aug 22 12:05:30 juju-e4d256-prod-github-runner-207 kernel: [24104.610939] ? __secure_computing+0xa9/0x120 Aug 22 12:05:30 juju-e4d256-prod-github-runner-207 kernel: [24104.611637] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 12:05:30 juju-e4d256-prod-github-runner-207 kernel: [24104.612396] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:05:30 juju-e4d256-prod-github-runner-207 kernel: [24104.613116] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:05:30 juju-e4d256-prod-github-runner-207 kernel: [24104.613839] ? do_syscall_64+0x69/0xc0 Aug 22 12:05:30 juju-e4d256-prod-github-runner-207 kernel: [24104.614481] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:05:30 juju-e4d256-prod-github-runner-207 kernel: [24104.615198] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:05:30 juju-e4d256-prod-github-runner-207 kernel: [24104.615891] ? do_syscall_64+0x69/0xc0 Aug 22 12:05:30 juju-e4d256-prod-github-runner-207 kernel: [24104.616523] ? do_syscall_64+0x69/0xc0 Aug 22 12:05:30 juju-e4d256-prod-github-runner-207 kernel: [24104.617147] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 12:05:30 juju-e4d256-prod-github-runner-207 kernel: [24104.617853] RIP: 0033:0x7faa5d0edaff Aug 22 12:05:30 juju-e4d256-prod-github-runner-207 kernel: [24104.618510] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 12:05:30 juju-e4d256-prod-github-runner-207 kernel: [24104.620510] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 12:05:30 juju-e4d256-prod-github-runner-207 kernel: [24104.621426] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 12:05:30 juju-e4d256-prod-github-runner-207 kernel: [24104.622314] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 12:05:30 juju-e4d256-prod-github-runner-207 kernel: [24104.623226] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 12:05:30 juju-e4d256-prod-github-runner-207 kernel: [24104.624121] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 12:05:30 juju-e4d256-prod-github-runner-207 kernel: [24104.625032] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 12:05:30 juju-e4d256-prod-github-runner-207 kernel: [24104.625934] Aug 22 12:05:44 juju-e4d256-prod-github-runner-207 kernel: [24118.796707] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 12:05:44 juju-e4d256-prod-github-runner-207 kernel: [24118.797714] rcu: 1-....: (5981684 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=2895449 Aug 22 12:05:44 juju-e4d256-prod-github-runner-207 kernel: [24118.798877] (t=6000399 jiffies g=23269 q=29062) Aug 22 12:05:44 juju-e4d256-prod-github-runner-207 kernel: [24118.799702] NMI backtrace for cpu 1 Aug 22 12:05:44 juju-e4d256-prod-github-runner-207 kernel: [24118.800447] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 12:05:44 juju-e4d256-prod-github-runner-207 kernel: [24118.801597] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 12:05:44 juju-e4d256-prod-github-runner-207 kernel: [24118.802736] Call Trace: Aug 22 12:05:44 juju-e4d256-prod-github-runner-207 kernel: [24118.803484] Aug 22 12:05:44 juju-e4d256-prod-github-runner-207 kernel: [24118.804180] show_stack+0x52/0x5c Aug 22 12:05:44 juju-e4d256-prod-github-runner-207 kernel: [24118.804934] dump_stack_lvl+0x4a/0x63 Aug 22 12:05:44 juju-e4d256-prod-github-runner-207 kernel: [24118.805696] dump_stack+0x10/0x16 Aug 22 12:05:44 juju-e4d256-prod-github-runner-207 kernel: [24118.806417] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 12:05:44 juju-e4d256-prod-github-runner-207 kernel: [24118.807235] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 12:05:44 juju-e4d256-prod-github-runner-207 kernel: [24118.808025] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 12:05:44 juju-e4d256-prod-github-runner-207 kernel: [24118.808852] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 12:05:44 juju-e4d256-prod-github-runner-207 kernel: [24118.809680] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 12:05:44 juju-e4d256-prod-github-runner-207 kernel: [24118.810498] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 12:05:44 juju-e4d256-prod-github-runner-207 kernel: [24118.811298] print_cpu_stall.cold+0x2f/0xe2 Aug 22 12:05:44 juju-e4d256-prod-github-runner-207 kernel: [24118.812265] ? timekeeping_update+0xf7/0x150 Aug 22 12:05:44 juju-e4d256-prod-github-runner-207 kernel: [24118.813055] check_cpu_stall+0x109/0x270 Aug 22 12:05:44 juju-e4d256-prod-github-runner-207 kernel: [24118.813814] rcu_sched_clock_irq+0x9a/0x250 Aug 22 12:05:44 juju-e4d256-prod-github-runner-207 kernel: [24118.814611] update_process_times+0x94/0xd0 Aug 22 12:05:44 juju-e4d256-prod-github-runner-207 kernel: [24118.815442] tick_sched_handle+0x29/0x70 Aug 22 12:05:44 juju-e4d256-prod-github-runner-207 kernel: [24118.816208] tick_sched_timer+0x8c/0xc0 Aug 22 12:05:44 juju-e4d256-prod-github-runner-207 kernel: [24118.816953] ? tick_nohz_handler+0xb0/0xb0 Aug 22 12:05:44 juju-e4d256-prod-github-runner-207 kernel: [24118.817717] __hrtimer_run_queues+0x107/0x230 Aug 22 12:05:44 juju-e4d256-prod-github-runner-207 kernel: [24118.818507] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 12:05:44 juju-e4d256-prod-github-runner-207 kernel: [24118.819333] hrtimer_interrupt+0x101/0x220 Aug 22 12:05:44 juju-e4d256-prod-github-runner-207 kernel: [24118.820105] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 12:05:44 juju-e4d256-prod-github-runner-207 kernel: [24118.820922] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 12:05:44 juju-e4d256-prod-github-runner-207 kernel: [24118.821736] Aug 22 12:05:44 juju-e4d256-prod-github-runner-207 kernel: [24118.822375] Aug 22 12:05:44 juju-e4d256-prod-github-runner-207 kernel: [24118.823028] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 12:05:44 juju-e4d256-prod-github-runner-207 kernel: [24118.823862] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:05:44 juju-e4d256-prod-github-runner-207 kernel: [24118.824757] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 12:05:44 juju-e4d256-prod-github-runner-207 kernel: [24118.826958] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 12:05:44 juju-e4d256-prod-github-runner-207 kernel: [24118.827853] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 12:05:44 juju-e4d256-prod-github-runner-207 kernel: [24118.828880] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 12:05:44 juju-e4d256-prod-github-runner-207 kernel: [24118.829889] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 12:05:44 juju-e4d256-prod-github-runner-207 kernel: [24118.830936] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 12:05:44 juju-e4d256-prod-github-runner-207 kernel: [24118.831947] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 12:05:44 juju-e4d256-prod-github-runner-207 kernel: [24118.832919] ? _raw_spin_lock+0x22/0x30 Aug 22 12:05:44 juju-e4d256-prod-github-runner-207 kernel: [24118.833687] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:05:44 juju-e4d256-prod-github-runner-207 kernel: [24118.834546] direct_page_fault+0x206/0x310 [kvm] Aug 22 12:05:44 juju-e4d256-prod-github-runner-207 kernel: [24118.835418] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 12:05:44 juju-e4d256-prod-github-runner-207 kernel: [24118.836281] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 12:05:44 juju-e4d256-prod-github-runner-207 kernel: [24118.837170] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 12:05:44 juju-e4d256-prod-github-runner-207 kernel: [24118.838126] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 12:05:44 juju-e4d256-prod-github-runner-207 kernel: [24118.838954] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 12:05:44 juju-e4d256-prod-github-runner-207 kernel: [24118.839812] handle_exit+0x98/0x230 [kvm_amd] Aug 22 12:05:44 juju-e4d256-prod-github-runner-207 kernel: [24118.840579] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 12:05:44 juju-e4d256-prod-github-runner-207 kernel: [24118.841387] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 12:05:44 juju-e4d256-prod-github-runner-207 kernel: [24118.842204] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 12:05:44 juju-e4d256-prod-github-runner-207 kernel: [24118.843029] vcpu_run+0x62/0x2c0 [kvm] Aug 22 12:05:44 juju-e4d256-prod-github-runner-207 kernel: [24118.843759] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 12:05:44 juju-e4d256-prod-github-runner-207 kernel: [24118.844512] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 12:05:44 juju-e4d256-prod-github-runner-207 kernel: [24118.845383] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 12:05:44 juju-e4d256-prod-github-runner-207 kernel: [24118.846219] ? __seccomp_filter+0x4a/0x4a0 Aug 22 12:05:44 juju-e4d256-prod-github-runner-207 kernel: [24118.846952] ? __fget_files+0x86/0xc0 Aug 22 12:05:44 juju-e4d256-prod-github-runner-207 kernel: [24118.847692] __x64_sys_ioctl+0x95/0xd0 Aug 22 12:05:44 juju-e4d256-prod-github-runner-207 kernel: [24118.848413] do_syscall_64+0x5c/0xc0 Aug 22 12:05:44 juju-e4d256-prod-github-runner-207 kernel: [24118.849112] ? do_futex+0x162/0x1f0 Aug 22 12:05:44 juju-e4d256-prod-github-runner-207 kernel: [24118.849789] ? __x64_sys_futex+0x78/0x1e0 Aug 22 12:05:44 juju-e4d256-prod-github-runner-207 kernel: [24118.850502] ? __secure_computing+0xa9/0x120 Aug 22 12:05:44 juju-e4d256-prod-github-runner-207 kernel: [24118.851232] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 12:05:44 juju-e4d256-prod-github-runner-207 kernel: [24118.852023] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:05:44 juju-e4d256-prod-github-runner-207 kernel: [24118.852785] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:05:44 juju-e4d256-prod-github-runner-207 kernel: [24118.853553] ? do_syscall_64+0x69/0xc0 Aug 22 12:05:44 juju-e4d256-prod-github-runner-207 kernel: [24118.854257] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:05:44 juju-e4d256-prod-github-runner-207 kernel: [24118.855023] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:05:44 juju-e4d256-prod-github-runner-207 kernel: [24118.855896] ? do_syscall_64+0x69/0xc0 Aug 22 12:05:44 juju-e4d256-prod-github-runner-207 kernel: [24118.856600] ? do_syscall_64+0x69/0xc0 Aug 22 12:05:44 juju-e4d256-prod-github-runner-207 kernel: [24118.857290] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 12:05:44 juju-e4d256-prod-github-runner-207 kernel: [24118.858060] RIP: 0033:0x7faa5d0edaff Aug 22 12:05:44 juju-e4d256-prod-github-runner-207 kernel: [24118.858773] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 12:05:44 juju-e4d256-prod-github-runner-207 kernel: [24118.860910] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 12:05:44 juju-e4d256-prod-github-runner-207 kernel: [24118.861874] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 12:05:44 juju-e4d256-prod-github-runner-207 kernel: [24118.862823] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 12:05:44 juju-e4d256-prod-github-runner-207 kernel: [24118.863786] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 12:05:44 juju-e4d256-prod-github-runner-207 kernel: [24118.864729] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 12:05:44 juju-e4d256-prod-github-runner-207 kernel: [24118.865660] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 12:05:44 juju-e4d256-prod-github-runner-207 kernel: [24118.866575] Aug 22 12:06:10 juju-e4d256-prod-github-runner-207 kernel: [24144.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 22378s! [qemu-system-x86:6715] Aug 22 12:06:10 juju-e4d256-prod-github-runner-207 kernel: [24144.543279] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 12:06:10 juju-e4d256-prod-github-runner-207 kernel: [24144.543353] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 12:06:10 juju-e4d256-prod-github-runner-207 kernel: [24144.557444] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 12:06:10 juju-e4d256-prod-github-runner-207 kernel: [24144.559110] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 12:06:10 juju-e4d256-prod-github-runner-207 kernel: [24144.560487] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:06:10 juju-e4d256-prod-github-runner-207 kernel: [24144.561676] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 12:06:10 juju-e4d256-prod-github-runner-207 kernel: [24144.564555] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 12:06:10 juju-e4d256-prod-github-runner-207 kernel: [24144.565898] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 12:06:10 juju-e4d256-prod-github-runner-207 kernel: [24144.567216] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 12:06:10 juju-e4d256-prod-github-runner-207 kernel: [24144.568509] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 12:06:10 juju-e4d256-prod-github-runner-207 kernel: [24144.569798] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 12:06:10 juju-e4d256-prod-github-runner-207 kernel: [24144.571123] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 12:06:10 juju-e4d256-prod-github-runner-207 kernel: [24144.572445] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 12:06:10 juju-e4d256-prod-github-runner-207 kernel: [24144.573841] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 12:06:10 juju-e4d256-prod-github-runner-207 kernel: [24144.575085] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 12:06:10 juju-e4d256-prod-github-runner-207 kernel: [24144.576307] Call Trace: Aug 22 12:06:10 juju-e4d256-prod-github-runner-207 kernel: [24144.577278] Aug 22 12:06:10 juju-e4d256-prod-github-runner-207 kernel: [24144.578217] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:06:10 juju-e4d256-prod-github-runner-207 kernel: [24144.579360] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:06:10 juju-e4d256-prod-github-runner-207 kernel: [24144.580464] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:06:10 juju-e4d256-prod-github-runner-207 kernel: [24144.581629] ? show_regs.part.0+0x23/0x29 Aug 22 12:06:10 juju-e4d256-prod-github-runner-207 kernel: [24144.582722] ? show_regs.cold+0x8/0xd Aug 22 12:06:10 juju-e4d256-prod-github-runner-207 kernel: [24144.583770] ? watchdog_timer_fn+0x1be/0x220 Aug 22 12:06:10 juju-e4d256-prod-github-runner-207 kernel: [24144.584862] ? lockup_detector_update_enable+0x60/0x60 Aug 22 12:06:10 juju-e4d256-prod-github-runner-207 kernel: [24144.586024] ? __hrtimer_run_queues+0x107/0x230 Aug 22 12:06:10 juju-e4d256-prod-github-runner-207 kernel: [24144.587158] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 12:06:10 juju-e4d256-prod-github-runner-207 kernel: [24144.588273] ? hrtimer_interrupt+0x101/0x220 Aug 22 12:06:10 juju-e4d256-prod-github-runner-207 kernel: [24144.589377] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 12:06:10 juju-e4d256-prod-github-runner-207 kernel: [24144.590549] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 12:06:10 juju-e4d256-prod-github-runner-207 kernel: [24144.591710] Aug 22 12:06:10 juju-e4d256-prod-github-runner-207 kernel: [24144.592610] Aug 22 12:06:10 juju-e4d256-prod-github-runner-207 kernel: [24144.593494] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 12:06:10 juju-e4d256-prod-github-runner-207 kernel: [24144.594632] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:06:10 juju-e4d256-prod-github-runner-207 kernel: [24144.595803] ? _raw_spin_lock+0x22/0x30 Aug 22 12:06:10 juju-e4d256-prod-github-runner-207 kernel: [24144.596822] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:06:10 juju-e4d256-prod-github-runner-207 kernel: [24144.597931] direct_page_fault+0x206/0x310 [kvm] Aug 22 12:06:10 juju-e4d256-prod-github-runner-207 kernel: [24144.599072] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 12:06:10 juju-e4d256-prod-github-runner-207 kernel: [24144.600177] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 12:06:10 juju-e4d256-prod-github-runner-207 kernel: [24144.601271] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 12:06:10 juju-e4d256-prod-github-runner-207 kernel: [24144.602336] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 12:06:10 juju-e4d256-prod-github-runner-207 kernel: [24144.603387] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 12:06:10 juju-e4d256-prod-github-runner-207 kernel: [24144.604476] handle_exit+0x98/0x230 [kvm_amd] Aug 22 12:06:10 juju-e4d256-prod-github-runner-207 kernel: [24144.605463] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 12:06:10 juju-e4d256-prod-github-runner-207 kernel: [24144.606472] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 12:06:10 juju-e4d256-prod-github-runner-207 kernel: [24144.607517] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 12:06:10 juju-e4d256-prod-github-runner-207 kernel: [24144.608571] vcpu_run+0x62/0x2c0 [kvm] Aug 22 12:06:10 juju-e4d256-prod-github-runner-207 kernel: [24144.609491] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 12:06:10 juju-e4d256-prod-github-runner-207 kernel: [24144.610388] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 12:06:10 juju-e4d256-prod-github-runner-207 kernel: [24144.611364] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 12:06:10 juju-e4d256-prod-github-runner-207 kernel: [24144.612284] ? __seccomp_filter+0x4a/0x4a0 Aug 22 12:06:10 juju-e4d256-prod-github-runner-207 kernel: [24144.613110] ? __fget_files+0x86/0xc0 Aug 22 12:06:10 juju-e4d256-prod-github-runner-207 kernel: [24144.613923] __x64_sys_ioctl+0x95/0xd0 Aug 22 12:06:10 juju-e4d256-prod-github-runner-207 kernel: [24144.614690] do_syscall_64+0x5c/0xc0 Aug 22 12:06:10 juju-e4d256-prod-github-runner-207 kernel: [24144.615480] ? do_futex+0x162/0x1f0 Aug 22 12:06:10 juju-e4d256-prod-github-runner-207 kernel: [24144.616199] ? __x64_sys_futex+0x78/0x1e0 Aug 22 12:06:10 juju-e4d256-prod-github-runner-207 kernel: [24144.616951] ? __secure_computing+0xa9/0x120 Aug 22 12:06:10 juju-e4d256-prod-github-runner-207 kernel: [24144.617725] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 12:06:10 juju-e4d256-prod-github-runner-207 kernel: [24144.618596] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:06:10 juju-e4d256-prod-github-runner-207 kernel: [24144.619427] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:06:10 juju-e4d256-prod-github-runner-207 kernel: [24144.620247] ? do_syscall_64+0x69/0xc0 Aug 22 12:06:10 juju-e4d256-prod-github-runner-207 kernel: [24144.620972] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:06:10 juju-e4d256-prod-github-runner-207 kernel: [24144.621774] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:06:10 juju-e4d256-prod-github-runner-207 kernel: [24144.622567] ? do_syscall_64+0x69/0xc0 Aug 22 12:06:10 juju-e4d256-prod-github-runner-207 kernel: [24144.623275] ? do_syscall_64+0x69/0xc0 Aug 22 12:06:10 juju-e4d256-prod-github-runner-207 kernel: [24144.623971] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 12:06:10 juju-e4d256-prod-github-runner-207 kernel: [24144.624777] RIP: 0033:0x7faa5d0edaff Aug 22 12:06:10 juju-e4d256-prod-github-runner-207 kernel: [24144.625480] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 12:06:10 juju-e4d256-prod-github-runner-207 kernel: [24144.627825] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 12:06:10 juju-e4d256-prod-github-runner-207 kernel: [24144.628883] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 12:06:10 juju-e4d256-prod-github-runner-207 kernel: [24144.629920] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 12:06:10 juju-e4d256-prod-github-runner-207 kernel: [24144.630969] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 12:06:10 juju-e4d256-prod-github-runner-207 kernel: [24144.631993] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 12:06:10 juju-e4d256-prod-github-runner-207 kernel: [24144.633017] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 12:06:10 juju-e4d256-prod-github-runner-207 kernel: [24144.634056] Aug 22 12:06:38 juju-e4d256-prod-github-runner-207 kernel: [24172.541980] watchdog: BUG: soft lockup - CPU#1 stuck for 22404s! [qemu-system-x86:6715] Aug 22 12:06:38 juju-e4d256-prod-github-runner-207 kernel: [24172.543122] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 12:06:38 juju-e4d256-prod-github-runner-207 kernel: [24172.543197] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 12:06:38 juju-e4d256-prod-github-runner-207 kernel: [24172.555340] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 12:06:38 juju-e4d256-prod-github-runner-207 kernel: [24172.556618] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 12:06:38 juju-e4d256-prod-github-runner-207 kernel: [24172.557860] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:06:38 juju-e4d256-prod-github-runner-207 kernel: [24172.558939] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 12:06:38 juju-e4d256-prod-github-runner-207 kernel: [24172.561492] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 12:06:38 juju-e4d256-prod-github-runner-207 kernel: [24172.562552] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 12:06:38 juju-e4d256-prod-github-runner-207 kernel: [24172.563713] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 12:06:38 juju-e4d256-prod-github-runner-207 kernel: [24172.564874] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 12:06:38 juju-e4d256-prod-github-runner-207 kernel: [24172.566040] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 12:06:38 juju-e4d256-prod-github-runner-207 kernel: [24172.567216] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 12:06:38 juju-e4d256-prod-github-runner-207 kernel: [24172.568409] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 12:06:38 juju-e4d256-prod-github-runner-207 kernel: [24172.569649] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 12:06:38 juju-e4d256-prod-github-runner-207 kernel: [24172.570763] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 12:06:38 juju-e4d256-prod-github-runner-207 kernel: [24172.571956] Call Trace: Aug 22 12:06:38 juju-e4d256-prod-github-runner-207 kernel: [24172.572872] Aug 22 12:06:38 juju-e4d256-prod-github-runner-207 kernel: [24172.573756] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:06:38 juju-e4d256-prod-github-runner-207 kernel: [24172.574803] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:06:38 juju-e4d256-prod-github-runner-207 kernel: [24172.575833] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:06:38 juju-e4d256-prod-github-runner-207 kernel: [24172.576908] ? show_regs.part.0+0x23/0x29 Aug 22 12:06:38 juju-e4d256-prod-github-runner-207 kernel: [24172.577915] ? show_regs.cold+0x8/0xd Aug 22 12:06:38 juju-e4d256-prod-github-runner-207 kernel: [24172.578926] ? watchdog_timer_fn+0x1be/0x220 Aug 22 12:06:38 juju-e4d256-prod-github-runner-207 kernel: [24172.579937] ? lockup_detector_update_enable+0x60/0x60 Aug 22 12:06:38 juju-e4d256-prod-github-runner-207 kernel: [24172.581016] ? __hrtimer_run_queues+0x107/0x230 Aug 22 12:06:38 juju-e4d256-prod-github-runner-207 kernel: [24172.582058] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 12:06:38 juju-e4d256-prod-github-runner-207 kernel: [24172.583096] ? hrtimer_interrupt+0x101/0x220 Aug 22 12:06:38 juju-e4d256-prod-github-runner-207 kernel: [24172.584111] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 12:06:38 juju-e4d256-prod-github-runner-207 kernel: [24172.585205] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 12:06:38 juju-e4d256-prod-github-runner-207 kernel: [24172.586275] Aug 22 12:06:38 juju-e4d256-prod-github-runner-207 kernel: [24172.587151] Aug 22 12:06:38 juju-e4d256-prod-github-runner-207 kernel: [24172.587992] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 12:06:38 juju-e4d256-prod-github-runner-207 kernel: [24172.589076] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:06:38 juju-e4d256-prod-github-runner-207 kernel: [24172.590168] ? _raw_spin_lock+0x22/0x30 Aug 22 12:06:38 juju-e4d256-prod-github-runner-207 kernel: [24172.591143] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:06:38 juju-e4d256-prod-github-runner-207 kernel: [24172.592380] direct_page_fault+0x206/0x310 [kvm] Aug 22 12:06:38 juju-e4d256-prod-github-runner-207 kernel: [24172.593565] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 12:06:38 juju-e4d256-prod-github-runner-207 kernel: [24172.594645] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 12:06:38 juju-e4d256-prod-github-runner-207 kernel: [24172.595681] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 12:06:38 juju-e4d256-prod-github-runner-207 kernel: [24172.596682] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 12:06:38 juju-e4d256-prod-github-runner-207 kernel: [24172.597636] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 12:06:38 juju-e4d256-prod-github-runner-207 kernel: [24172.598715] handle_exit+0x98/0x230 [kvm_amd] Aug 22 12:06:38 juju-e4d256-prod-github-runner-207 kernel: [24172.599632] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 12:06:38 juju-e4d256-prod-github-runner-207 kernel: [24172.600550] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 12:06:38 juju-e4d256-prod-github-runner-207 kernel: [24172.601478] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 12:06:38 juju-e4d256-prod-github-runner-207 kernel: [24172.602408] vcpu_run+0x62/0x2c0 [kvm] Aug 22 12:06:38 juju-e4d256-prod-github-runner-207 kernel: [24172.603358] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 12:06:38 juju-e4d256-prod-github-runner-207 kernel: [24172.604169] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 12:06:38 juju-e4d256-prod-github-runner-207 kernel: [24172.605027] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 12:06:38 juju-e4d256-prod-github-runner-207 kernel: [24172.605826] ? __seccomp_filter+0x4a/0x4a0 Aug 22 12:06:38 juju-e4d256-prod-github-runner-207 kernel: [24172.606669] ? __fget_files+0x86/0xc0 Aug 22 12:06:38 juju-e4d256-prod-github-runner-207 kernel: [24172.607381] __x64_sys_ioctl+0x95/0xd0 Aug 22 12:06:38 juju-e4d256-prod-github-runner-207 kernel: [24172.608078] do_syscall_64+0x5c/0xc0 Aug 22 12:06:38 juju-e4d256-prod-github-runner-207 kernel: [24172.608781] ? do_futex+0x162/0x1f0 Aug 22 12:06:38 juju-e4d256-prod-github-runner-207 kernel: [24172.609459] ? __x64_sys_futex+0x78/0x1e0 Aug 22 12:06:38 juju-e4d256-prod-github-runner-207 kernel: [24172.610139] ? __secure_computing+0xa9/0x120 Aug 22 12:06:38 juju-e4d256-prod-github-runner-207 kernel: [24172.610848] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 12:06:38 juju-e4d256-prod-github-runner-207 kernel: [24172.611643] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:06:38 juju-e4d256-prod-github-runner-207 kernel: [24172.612405] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:06:38 juju-e4d256-prod-github-runner-207 kernel: [24172.613134] ? do_syscall_64+0x69/0xc0 Aug 22 12:06:38 juju-e4d256-prod-github-runner-207 kernel: [24172.613783] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:06:38 juju-e4d256-prod-github-runner-207 kernel: [24172.614522] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:06:38 juju-e4d256-prod-github-runner-207 kernel: [24172.615218] ? do_syscall_64+0x69/0xc0 Aug 22 12:06:38 juju-e4d256-prod-github-runner-207 kernel: [24172.615845] ? do_syscall_64+0x69/0xc0 Aug 22 12:06:38 juju-e4d256-prod-github-runner-207 kernel: [24172.616469] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 12:06:38 juju-e4d256-prod-github-runner-207 kernel: [24172.617175] RIP: 0033:0x7faa5d0edaff Aug 22 12:06:38 juju-e4d256-prod-github-runner-207 kernel: [24172.617801] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 12:06:38 juju-e4d256-prod-github-runner-207 kernel: [24172.619821] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 12:06:38 juju-e4d256-prod-github-runner-207 kernel: [24172.620755] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 12:06:38 juju-e4d256-prod-github-runner-207 kernel: [24172.621655] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 12:06:38 juju-e4d256-prod-github-runner-207 kernel: [24172.622572] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 12:06:38 juju-e4d256-prod-github-runner-207 kernel: [24172.623527] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 12:06:38 juju-e4d256-prod-github-runner-207 kernel: [24172.624472] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 12:06:38 juju-e4d256-prod-github-runner-207 kernel: [24172.625369] Aug 22 12:07:06 juju-e4d256-prod-github-runner-207 kernel: [24200.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 22430s! [qemu-system-x86:6715] Aug 22 12:07:06 juju-e4d256-prod-github-runner-207 kernel: [24200.543901] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 12:07:06 juju-e4d256-prod-github-runner-207 kernel: [24200.544208] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 12:07:06 juju-e4d256-prod-github-runner-207 kernel: [24200.556320] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 12:07:06 juju-e4d256-prod-github-runner-207 kernel: [24200.557582] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 12:07:06 juju-e4d256-prod-github-runner-207 kernel: [24200.558818] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:07:06 juju-e4d256-prod-github-runner-207 kernel: [24200.559882] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 12:07:06 juju-e4d256-prod-github-runner-207 kernel: [24200.562440] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 12:07:06 juju-e4d256-prod-github-runner-207 kernel: [24200.563481] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 12:07:06 juju-e4d256-prod-github-runner-207 kernel: [24200.564644] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 12:07:06 juju-e4d256-prod-github-runner-207 kernel: [24200.565801] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 12:07:06 juju-e4d256-prod-github-runner-207 kernel: [24200.566968] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 12:07:06 juju-e4d256-prod-github-runner-207 kernel: [24200.568132] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 12:07:06 juju-e4d256-prod-github-runner-207 kernel: [24200.569309] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 12:07:06 juju-e4d256-prod-github-runner-207 kernel: [24200.571003] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 12:07:06 juju-e4d256-prod-github-runner-207 kernel: [24200.572148] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 12:07:06 juju-e4d256-prod-github-runner-207 kernel: [24200.573494] Call Trace: Aug 22 12:07:06 juju-e4d256-prod-github-runner-207 kernel: [24200.574476] Aug 22 12:07:06 juju-e4d256-prod-github-runner-207 kernel: [24200.575604] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:07:06 juju-e4d256-prod-github-runner-207 kernel: [24200.576725] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:07:06 juju-e4d256-prod-github-runner-207 kernel: [24200.577848] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:07:06 juju-e4d256-prod-github-runner-207 kernel: [24200.579124] ? show_regs.part.0+0x23/0x29 Aug 22 12:07:06 juju-e4d256-prod-github-runner-207 kernel: [24200.580231] ? show_regs.cold+0x8/0xd Aug 22 12:07:06 juju-e4d256-prod-github-runner-207 kernel: [24200.581256] ? watchdog_timer_fn+0x1be/0x220 Aug 22 12:07:06 juju-e4d256-prod-github-runner-207 kernel: [24200.582344] ? lockup_detector_update_enable+0x60/0x60 Aug 22 12:07:06 juju-e4d256-prod-github-runner-207 kernel: [24200.583602] ? __hrtimer_run_queues+0x107/0x230 Aug 22 12:07:06 juju-e4d256-prod-github-runner-207 kernel: [24200.584654] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 12:07:06 juju-e4d256-prod-github-runner-207 kernel: [24200.585732] ? hrtimer_interrupt+0x101/0x220 Aug 22 12:07:06 juju-e4d256-prod-github-runner-207 kernel: [24200.586816] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 12:07:06 juju-e4d256-prod-github-runner-207 kernel: [24200.588233] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 12:07:06 juju-e4d256-prod-github-runner-207 kernel: [24200.589329] Aug 22 12:07:06 juju-e4d256-prod-github-runner-207 kernel: [24200.590280] Aug 22 12:07:06 juju-e4d256-prod-github-runner-207 kernel: [24200.591129] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 12:07:06 juju-e4d256-prod-github-runner-207 kernel: [24200.592209] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:07:06 juju-e4d256-prod-github-runner-207 kernel: [24200.593257] ? _raw_spin_lock+0x22/0x30 Aug 22 12:07:06 juju-e4d256-prod-github-runner-207 kernel: [24200.594242] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:07:06 juju-e4d256-prod-github-runner-207 kernel: [24200.595307] direct_page_fault+0x206/0x310 [kvm] Aug 22 12:07:06 juju-e4d256-prod-github-runner-207 kernel: [24200.596358] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 12:07:06 juju-e4d256-prod-github-runner-207 kernel: [24200.597376] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 12:07:06 juju-e4d256-prod-github-runner-207 kernel: [24200.598398] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 12:07:06 juju-e4d256-prod-github-runner-207 kernel: [24200.599440] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 12:07:06 juju-e4d256-prod-github-runner-207 kernel: [24200.600391] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 12:07:06 juju-e4d256-prod-github-runner-207 kernel: [24200.601373] handle_exit+0x98/0x230 [kvm_amd] Aug 22 12:07:06 juju-e4d256-prod-github-runner-207 kernel: [24200.602280] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 12:07:06 juju-e4d256-prod-github-runner-207 kernel: [24200.603206] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 12:07:06 juju-e4d256-prod-github-runner-207 kernel: [24200.604131] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 12:07:06 juju-e4d256-prod-github-runner-207 kernel: [24200.605103] vcpu_run+0x62/0x2c0 [kvm] Aug 22 12:07:06 juju-e4d256-prod-github-runner-207 kernel: [24200.605947] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 12:07:06 juju-e4d256-prod-github-runner-207 kernel: [24200.606806] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 12:07:06 juju-e4d256-prod-github-runner-207 kernel: [24200.607704] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 12:07:06 juju-e4d256-prod-github-runner-207 kernel: [24200.608509] ? __seccomp_filter+0x4a/0x4a0 Aug 22 12:07:06 juju-e4d256-prod-github-runner-207 kernel: [24200.609253] ? __fget_files+0x86/0xc0 Aug 22 12:07:06 juju-e4d256-prod-github-runner-207 kernel: [24200.609967] __x64_sys_ioctl+0x95/0xd0 Aug 22 12:07:06 juju-e4d256-prod-github-runner-207 kernel: [24200.610676] do_syscall_64+0x5c/0xc0 Aug 22 12:07:06 juju-e4d256-prod-github-runner-207 kernel: [24200.611361] ? do_futex+0x162/0x1f0 Aug 22 12:07:06 juju-e4d256-prod-github-runner-207 kernel: [24200.612032] ? __x64_sys_futex+0x78/0x1e0 Aug 22 12:07:06 juju-e4d256-prod-github-runner-207 kernel: [24200.612725] ? __secure_computing+0xa9/0x120 Aug 22 12:07:06 juju-e4d256-prod-github-runner-207 kernel: [24200.613432] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 12:07:06 juju-e4d256-prod-github-runner-207 kernel: [24200.614283] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:07:06 juju-e4d256-prod-github-runner-207 kernel: [24200.615031] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:07:06 juju-e4d256-prod-github-runner-207 kernel: [24200.615750] ? do_syscall_64+0x69/0xc0 Aug 22 12:07:06 juju-e4d256-prod-github-runner-207 kernel: [24200.616396] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:07:06 juju-e4d256-prod-github-runner-207 kernel: [24200.617099] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:07:06 juju-e4d256-prod-github-runner-207 kernel: [24200.617794] ? do_syscall_64+0x69/0xc0 Aug 22 12:07:06 juju-e4d256-prod-github-runner-207 kernel: [24200.618435] ? do_syscall_64+0x69/0xc0 Aug 22 12:07:06 juju-e4d256-prod-github-runner-207 kernel: [24200.619059] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 12:07:06 juju-e4d256-prod-github-runner-207 kernel: [24200.619765] RIP: 0033:0x7faa5d0edaff Aug 22 12:07:06 juju-e4d256-prod-github-runner-207 kernel: [24200.620425] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 12:07:06 juju-e4d256-prod-github-runner-207 kernel: [24200.622434] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 12:07:06 juju-e4d256-prod-github-runner-207 kernel: [24200.623346] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 12:07:06 juju-e4d256-prod-github-runner-207 kernel: [24200.624245] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 12:07:06 juju-e4d256-prod-github-runner-207 kernel: [24200.625139] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 12:07:06 juju-e4d256-prod-github-runner-207 kernel: [24200.626026] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 12:07:06 juju-e4d256-prod-github-runner-207 kernel: [24200.626930] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 12:07:06 juju-e4d256-prod-github-runner-207 kernel: [24200.627827] Aug 22 12:07:34 juju-e4d256-prod-github-runner-207 kernel: [24228.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 22456s! [qemu-system-x86:6715] Aug 22 12:07:34 juju-e4d256-prod-github-runner-207 kernel: [24228.543115] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 12:07:34 juju-e4d256-prod-github-runner-207 kernel: [24228.543193] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 12:07:34 juju-e4d256-prod-github-runner-207 kernel: [24228.555331] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 12:07:34 juju-e4d256-prod-github-runner-207 kernel: [24228.556593] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 12:07:34 juju-e4d256-prod-github-runner-207 kernel: [24228.557829] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:07:34 juju-e4d256-prod-github-runner-207 kernel: [24228.558882] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 12:07:34 juju-e4d256-prod-github-runner-207 kernel: [24228.561422] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 12:07:34 juju-e4d256-prod-github-runner-207 kernel: [24228.562496] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 12:07:34 juju-e4d256-prod-github-runner-207 kernel: [24228.563662] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 12:07:34 juju-e4d256-prod-github-runner-207 kernel: [24228.564826] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 12:07:34 juju-e4d256-prod-github-runner-207 kernel: [24228.565997] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 12:07:34 juju-e4d256-prod-github-runner-207 kernel: [24228.567163] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 12:07:34 juju-e4d256-prod-github-runner-207 kernel: [24228.568346] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 12:07:34 juju-e4d256-prod-github-runner-207 kernel: [24228.569583] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 12:07:34 juju-e4d256-prod-github-runner-207 kernel: [24228.570698] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 12:07:34 juju-e4d256-prod-github-runner-207 kernel: [24228.571893] Call Trace: Aug 22 12:07:34 juju-e4d256-prod-github-runner-207 kernel: [24228.572812] Aug 22 12:07:34 juju-e4d256-prod-github-runner-207 kernel: [24228.573706] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:07:34 juju-e4d256-prod-github-runner-207 kernel: [24228.574749] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:07:34 juju-e4d256-prod-github-runner-207 kernel: [24228.575770] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:07:34 juju-e4d256-prod-github-runner-207 kernel: [24228.576850] ? show_regs.part.0+0x23/0x29 Aug 22 12:07:34 juju-e4d256-prod-github-runner-207 kernel: [24228.578002] ? show_regs.cold+0x8/0xd Aug 22 12:07:34 juju-e4d256-prod-github-runner-207 kernel: [24228.578974] ? watchdog_timer_fn+0x1be/0x220 Aug 22 12:07:34 juju-e4d256-prod-github-runner-207 kernel: [24228.579982] ? lockup_detector_update_enable+0x60/0x60 Aug 22 12:07:34 juju-e4d256-prod-github-runner-207 kernel: [24228.581044] ? __hrtimer_run_queues+0x107/0x230 Aug 22 12:07:34 juju-e4d256-prod-github-runner-207 kernel: [24228.582096] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 12:07:34 juju-e4d256-prod-github-runner-207 kernel: [24228.583124] ? hrtimer_interrupt+0x101/0x220 Aug 22 12:07:34 juju-e4d256-prod-github-runner-207 kernel: [24228.584145] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 12:07:34 juju-e4d256-prod-github-runner-207 kernel: [24228.585223] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 12:07:34 juju-e4d256-prod-github-runner-207 kernel: [24228.586324] Aug 22 12:07:34 juju-e4d256-prod-github-runner-207 kernel: [24228.587186] Aug 22 12:07:34 juju-e4d256-prod-github-runner-207 kernel: [24228.588148] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 12:07:34 juju-e4d256-prod-github-runner-207 kernel: [24228.589180] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:07:34 juju-e4d256-prod-github-runner-207 kernel: [24228.590232] ? _raw_spin_lock+0x22/0x30 Aug 22 12:07:34 juju-e4d256-prod-github-runner-207 kernel: [24228.591177] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:07:34 juju-e4d256-prod-github-runner-207 kernel: [24228.592199] direct_page_fault+0x206/0x310 [kvm] Aug 22 12:07:34 juju-e4d256-prod-github-runner-207 kernel: [24228.593234] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 12:07:34 juju-e4d256-prod-github-runner-207 kernel: [24228.594257] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 12:07:34 juju-e4d256-prod-github-runner-207 kernel: [24228.595256] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 12:07:34 juju-e4d256-prod-github-runner-207 kernel: [24228.596230] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 12:07:34 juju-e4d256-prod-github-runner-207 kernel: [24228.597181] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 12:07:34 juju-e4d256-prod-github-runner-207 kernel: [24228.598176] handle_exit+0x98/0x230 [kvm_amd] Aug 22 12:07:34 juju-e4d256-prod-github-runner-207 kernel: [24228.599069] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 12:07:34 juju-e4d256-prod-github-runner-207 kernel: [24228.599987] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 12:07:34 juju-e4d256-prod-github-runner-207 kernel: [24228.600909] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 12:07:34 juju-e4d256-prod-github-runner-207 kernel: [24228.601823] vcpu_run+0x62/0x2c0 [kvm] Aug 22 12:07:34 juju-e4d256-prod-github-runner-207 kernel: [24228.602639] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 12:07:34 juju-e4d256-prod-github-runner-207 kernel: [24228.603454] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 12:07:34 juju-e4d256-prod-github-runner-207 kernel: [24228.604314] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 12:07:34 juju-e4d256-prod-github-runner-207 kernel: [24228.605141] ? __seccomp_filter+0x4a/0x4a0 Aug 22 12:07:34 juju-e4d256-prod-github-runner-207 kernel: [24228.605921] ? __fget_files+0x86/0xc0 Aug 22 12:07:34 juju-e4d256-prod-github-runner-207 kernel: [24228.606633] __x64_sys_ioctl+0x95/0xd0 Aug 22 12:07:34 juju-e4d256-prod-github-runner-207 kernel: [24228.607338] do_syscall_64+0x5c/0xc0 Aug 22 12:07:34 juju-e4d256-prod-github-runner-207 kernel: [24228.608013] ? do_futex+0x162/0x1f0 Aug 22 12:07:34 juju-e4d256-prod-github-runner-207 kernel: [24228.608668] ? __x64_sys_futex+0x78/0x1e0 Aug 22 12:07:34 juju-e4d256-prod-github-runner-207 kernel: [24228.609343] ? __secure_computing+0xa9/0x120 Aug 22 12:07:34 juju-e4d256-prod-github-runner-207 kernel: [24228.610048] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 12:07:34 juju-e4d256-prod-github-runner-207 kernel: [24228.610809] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:07:34 juju-e4d256-prod-github-runner-207 kernel: [24228.611529] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:07:34 juju-e4d256-prod-github-runner-207 kernel: [24228.612251] ? do_syscall_64+0x69/0xc0 Aug 22 12:07:34 juju-e4d256-prod-github-runner-207 kernel: [24228.612895] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:07:34 juju-e4d256-prod-github-runner-207 kernel: [24228.613609] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:07:34 juju-e4d256-prod-github-runner-207 kernel: [24228.614314] ? do_syscall_64+0x69/0xc0 Aug 22 12:07:34 juju-e4d256-prod-github-runner-207 kernel: [24228.614954] ? do_syscall_64+0x69/0xc0 Aug 22 12:07:34 juju-e4d256-prod-github-runner-207 kernel: [24228.615580] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 12:07:34 juju-e4d256-prod-github-runner-207 kernel: [24228.616284] RIP: 0033:0x7faa5d0edaff Aug 22 12:07:34 juju-e4d256-prod-github-runner-207 kernel: [24228.616911] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 12:07:34 juju-e4d256-prod-github-runner-207 kernel: [24228.618907] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 12:07:34 juju-e4d256-prod-github-runner-207 kernel: [24228.619838] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 12:07:34 juju-e4d256-prod-github-runner-207 kernel: [24228.620743] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 12:07:34 juju-e4d256-prod-github-runner-207 kernel: [24228.621645] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 12:07:34 juju-e4d256-prod-github-runner-207 kernel: [24228.622546] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 12:07:34 juju-e4d256-prod-github-runner-207 kernel: [24228.623435] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 12:07:34 juju-e4d256-prod-github-runner-207 kernel: [24228.624333] Aug 22 12:08:02 juju-e4d256-prod-github-runner-207 kernel: [24256.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 22482s! [qemu-system-x86:6715] Aug 22 12:08:02 juju-e4d256-prod-github-runner-207 kernel: [24256.543157] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 12:08:02 juju-e4d256-prod-github-runner-207 kernel: [24256.543242] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 12:08:02 juju-e4d256-prod-github-runner-207 kernel: [24256.555621] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 12:08:02 juju-e4d256-prod-github-runner-207 kernel: [24256.556920] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 12:08:02 juju-e4d256-prod-github-runner-207 kernel: [24256.558171] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:08:02 juju-e4d256-prod-github-runner-207 kernel: [24256.559240] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 12:08:02 juju-e4d256-prod-github-runner-207 kernel: [24256.561914] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 12:08:02 juju-e4d256-prod-github-runner-207 kernel: [24256.563030] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 12:08:02 juju-e4d256-prod-github-runner-207 kernel: [24256.564283] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 12:08:02 juju-e4d256-prod-github-runner-207 kernel: [24256.565544] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 12:08:02 juju-e4d256-prod-github-runner-207 kernel: [24256.566812] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 12:08:02 juju-e4d256-prod-github-runner-207 kernel: [24256.568088] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 12:08:02 juju-e4d256-prod-github-runner-207 kernel: [24256.569353] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 12:08:02 juju-e4d256-prod-github-runner-207 kernel: [24256.570752] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 12:08:02 juju-e4d256-prod-github-runner-207 kernel: [24256.571869] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 12:08:02 juju-e4d256-prod-github-runner-207 kernel: [24256.573079] Call Trace: Aug 22 12:08:02 juju-e4d256-prod-github-runner-207 kernel: [24256.574118] Aug 22 12:08:02 juju-e4d256-prod-github-runner-207 kernel: [24256.575125] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:08:02 juju-e4d256-prod-github-runner-207 kernel: [24256.576175] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:08:02 juju-e4d256-prod-github-runner-207 kernel: [24256.577221] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:08:02 juju-e4d256-prod-github-runner-207 kernel: [24256.578424] ? show_regs.part.0+0x23/0x29 Aug 22 12:08:02 juju-e4d256-prod-github-runner-207 kernel: [24256.579473] ? show_regs.cold+0x8/0xd Aug 22 12:08:02 juju-e4d256-prod-github-runner-207 kernel: [24256.580509] ? watchdog_timer_fn+0x1be/0x220 Aug 22 12:08:02 juju-e4d256-prod-github-runner-207 kernel: [24256.581609] ? lockup_detector_update_enable+0x60/0x60 Aug 22 12:08:02 juju-e4d256-prod-github-runner-207 kernel: [24256.582703] ? __hrtimer_run_queues+0x107/0x230 Aug 22 12:08:02 juju-e4d256-prod-github-runner-207 kernel: [24256.583775] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 12:08:02 juju-e4d256-prod-github-runner-207 kernel: [24256.584813] ? hrtimer_interrupt+0x101/0x220 Aug 22 12:08:02 juju-e4d256-prod-github-runner-207 kernel: [24256.585857] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 12:08:02 juju-e4d256-prod-github-runner-207 kernel: [24256.586947] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 12:08:02 juju-e4d256-prod-github-runner-207 kernel: [24256.588014] Aug 22 12:08:02 juju-e4d256-prod-github-runner-207 kernel: [24256.588874] Aug 22 12:08:02 juju-e4d256-prod-github-runner-207 kernel: [24256.589736] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 12:08:02 juju-e4d256-prod-github-runner-207 kernel: [24256.590783] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:08:02 juju-e4d256-prod-github-runner-207 kernel: [24256.591838] ? _raw_spin_lock+0x22/0x30 Aug 22 12:08:02 juju-e4d256-prod-github-runner-207 kernel: [24256.592813] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:08:02 juju-e4d256-prod-github-runner-207 kernel: [24256.593860] direct_page_fault+0x206/0x310 [kvm] Aug 22 12:08:02 juju-e4d256-prod-github-runner-207 kernel: [24256.594898] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 12:08:02 juju-e4d256-prod-github-runner-207 kernel: [24256.595925] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 12:08:02 juju-e4d256-prod-github-runner-207 kernel: [24256.596939] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 12:08:02 juju-e4d256-prod-github-runner-207 kernel: [24256.597997] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 12:08:02 juju-e4d256-prod-github-runner-207 kernel: [24256.599052] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 12:08:02 juju-e4d256-prod-github-runner-207 kernel: [24256.600180] handle_exit+0x98/0x230 [kvm_amd] Aug 22 12:08:02 juju-e4d256-prod-github-runner-207 kernel: [24256.601202] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 12:08:02 juju-e4d256-prod-github-runner-207 kernel: [24256.602183] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 12:08:02 juju-e4d256-prod-github-runner-207 kernel: [24256.603129] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 12:08:02 juju-e4d256-prod-github-runner-207 kernel: [24256.604099] vcpu_run+0x62/0x2c0 [kvm] Aug 22 12:08:02 juju-e4d256-prod-github-runner-207 kernel: [24256.604982] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 12:08:02 juju-e4d256-prod-github-runner-207 kernel: [24256.605864] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 12:08:02 juju-e4d256-prod-github-runner-207 kernel: [24256.606798] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 12:08:02 juju-e4d256-prod-github-runner-207 kernel: [24256.607675] ? __seccomp_filter+0x4a/0x4a0 Aug 22 12:08:02 juju-e4d256-prod-github-runner-207 kernel: [24256.608498] ? __fget_files+0x86/0xc0 Aug 22 12:08:02 juju-e4d256-prod-github-runner-207 kernel: [24256.609276] __x64_sys_ioctl+0x95/0xd0 Aug 22 12:08:02 juju-e4d256-prod-github-runner-207 kernel: [24256.610025] do_syscall_64+0x5c/0xc0 Aug 22 12:08:02 juju-e4d256-prod-github-runner-207 kernel: [24256.610705] ? do_futex+0x162/0x1f0 Aug 22 12:08:02 juju-e4d256-prod-github-runner-207 kernel: [24256.611383] ? __x64_sys_futex+0x78/0x1e0 Aug 22 12:08:02 juju-e4d256-prod-github-runner-207 kernel: [24256.612113] ? __secure_computing+0xa9/0x120 Aug 22 12:08:02 juju-e4d256-prod-github-runner-207 kernel: [24256.612827] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 12:08:02 juju-e4d256-prod-github-runner-207 kernel: [24256.613673] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:08:02 juju-e4d256-prod-github-runner-207 kernel: [24256.614456] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:08:02 juju-e4d256-prod-github-runner-207 kernel: [24256.615240] ? do_syscall_64+0x69/0xc0 Aug 22 12:08:02 juju-e4d256-prod-github-runner-207 kernel: [24256.615923] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:08:02 juju-e4d256-prod-github-runner-207 kernel: [24256.616671] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:08:02 juju-e4d256-prod-github-runner-207 kernel: [24256.617438] ? do_syscall_64+0x69/0xc0 Aug 22 12:08:02 juju-e4d256-prod-github-runner-207 kernel: [24256.618101] ? do_syscall_64+0x69/0xc0 Aug 22 12:08:02 juju-e4d256-prod-github-runner-207 kernel: [24256.618742] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 12:08:02 juju-e4d256-prod-github-runner-207 kernel: [24256.619461] RIP: 0033:0x7faa5d0edaff Aug 22 12:08:02 juju-e4d256-prod-github-runner-207 kernel: [24256.620099] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 12:08:02 juju-e4d256-prod-github-runner-207 kernel: [24256.622159] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 12:08:02 juju-e4d256-prod-github-runner-207 kernel: [24256.623092] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 12:08:02 juju-e4d256-prod-github-runner-207 kernel: [24256.624004] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 12:08:02 juju-e4d256-prod-github-runner-207 kernel: [24256.624913] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 12:08:02 juju-e4d256-prod-github-runner-207 kernel: [24256.625837] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 12:08:02 juju-e4d256-prod-github-runner-207 kernel: [24256.626748] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 12:08:02 juju-e4d256-prod-github-runner-207 kernel: [24256.627668] Aug 22 12:08:30 juju-e4d256-prod-github-runner-207 kernel: [24284.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 22508s! [qemu-system-x86:6715] Aug 22 12:08:30 juju-e4d256-prod-github-runner-207 kernel: [24284.544284] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 12:08:30 juju-e4d256-prod-github-runner-207 kernel: [24284.544604] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 12:08:30 juju-e4d256-prod-github-runner-207 kernel: [24284.556700] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 12:08:30 juju-e4d256-prod-github-runner-207 kernel: [24284.557992] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 12:08:30 juju-e4d256-prod-github-runner-207 kernel: [24284.559222] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:08:30 juju-e4d256-prod-github-runner-207 kernel: [24284.560280] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 12:08:30 juju-e4d256-prod-github-runner-207 kernel: [24284.562831] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 12:08:30 juju-e4d256-prod-github-runner-207 kernel: [24284.563876] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 12:08:30 juju-e4d256-prod-github-runner-207 kernel: [24284.565075] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 12:08:30 juju-e4d256-prod-github-runner-207 kernel: [24284.566235] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 12:08:30 juju-e4d256-prod-github-runner-207 kernel: [24284.567399] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 12:08:30 juju-e4d256-prod-github-runner-207 kernel: [24284.568558] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 12:08:30 juju-e4d256-prod-github-runner-207 kernel: [24284.569735] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 12:08:30 juju-e4d256-prod-github-runner-207 kernel: [24284.570966] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 12:08:30 juju-e4d256-prod-github-runner-207 kernel: [24284.572060] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 12:08:30 juju-e4d256-prod-github-runner-207 kernel: [24284.573261] Call Trace: Aug 22 12:08:30 juju-e4d256-prod-github-runner-207 kernel: [24284.574178] Aug 22 12:08:30 juju-e4d256-prod-github-runner-207 kernel: [24284.575077] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:08:30 juju-e4d256-prod-github-runner-207 kernel: [24284.576108] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:08:30 juju-e4d256-prod-github-runner-207 kernel: [24284.577141] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:08:30 juju-e4d256-prod-github-runner-207 kernel: [24284.578235] ? show_regs.part.0+0x23/0x29 Aug 22 12:08:30 juju-e4d256-prod-github-runner-207 kernel: [24284.579237] ? show_regs.cold+0x8/0xd Aug 22 12:08:30 juju-e4d256-prod-github-runner-207 kernel: [24284.580213] ? watchdog_timer_fn+0x1be/0x220 Aug 22 12:08:30 juju-e4d256-prod-github-runner-207 kernel: [24284.581248] ? lockup_detector_update_enable+0x60/0x60 Aug 22 12:08:30 juju-e4d256-prod-github-runner-207 kernel: [24284.582316] ? __hrtimer_run_queues+0x107/0x230 Aug 22 12:08:30 juju-e4d256-prod-github-runner-207 kernel: [24284.583342] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 12:08:30 juju-e4d256-prod-github-runner-207 kernel: [24284.584365] ? hrtimer_interrupt+0x101/0x220 Aug 22 12:08:30 juju-e4d256-prod-github-runner-207 kernel: [24284.585394] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 12:08:30 juju-e4d256-prod-github-runner-207 kernel: [24284.586466] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 12:08:30 juju-e4d256-prod-github-runner-207 kernel: [24284.587512] Aug 22 12:08:30 juju-e4d256-prod-github-runner-207 kernel: [24284.588384] Aug 22 12:08:30 juju-e4d256-prod-github-runner-207 kernel: [24284.589237] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 12:08:30 juju-e4d256-prod-github-runner-207 kernel: [24284.590273] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:08:30 juju-e4d256-prod-github-runner-207 kernel: [24284.591310] ? _raw_spin_lock+0x22/0x30 Aug 22 12:08:30 juju-e4d256-prod-github-runner-207 kernel: [24284.592260] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:08:30 juju-e4d256-prod-github-runner-207 kernel: [24284.593294] direct_page_fault+0x206/0x310 [kvm] Aug 22 12:08:30 juju-e4d256-prod-github-runner-207 kernel: [24284.594322] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 12:08:30 juju-e4d256-prod-github-runner-207 kernel: [24284.595331] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 12:08:30 juju-e4d256-prod-github-runner-207 kernel: [24284.596338] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 12:08:30 juju-e4d256-prod-github-runner-207 kernel: [24284.597360] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 12:08:30 juju-e4d256-prod-github-runner-207 kernel: [24284.598306] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 12:08:30 juju-e4d256-prod-github-runner-207 kernel: [24284.599283] handle_exit+0x98/0x230 [kvm_amd] Aug 22 12:08:30 juju-e4d256-prod-github-runner-207 kernel: [24284.600177] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 12:08:30 juju-e4d256-prod-github-runner-207 kernel: [24284.601106] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 12:08:30 juju-e4d256-prod-github-runner-207 kernel: [24284.602033] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 12:08:30 juju-e4d256-prod-github-runner-207 kernel: [24284.602940] vcpu_run+0x62/0x2c0 [kvm] Aug 22 12:08:30 juju-e4d256-prod-github-runner-207 kernel: [24284.603750] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 12:08:30 juju-e4d256-prod-github-runner-207 kernel: [24284.604560] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 12:08:30 juju-e4d256-prod-github-runner-207 kernel: [24284.605425] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 12:08:30 juju-e4d256-prod-github-runner-207 kernel: [24284.606225] ? __seccomp_filter+0x4a/0x4a0 Aug 22 12:08:30 juju-e4d256-prod-github-runner-207 kernel: [24284.606968] ? __fget_files+0x86/0xc0 Aug 22 12:08:30 juju-e4d256-prod-github-runner-207 kernel: [24284.607673] __x64_sys_ioctl+0x95/0xd0 Aug 22 12:08:30 juju-e4d256-prod-github-runner-207 kernel: [24284.608407] do_syscall_64+0x5c/0xc0 Aug 22 12:08:30 juju-e4d256-prod-github-runner-207 kernel: [24284.609090] ? do_futex+0x162/0x1f0 Aug 22 12:08:30 juju-e4d256-prod-github-runner-207 kernel: [24284.609752] ? __x64_sys_futex+0x78/0x1e0 Aug 22 12:08:30 juju-e4d256-prod-github-runner-207 kernel: [24284.610427] ? __secure_computing+0xa9/0x120 Aug 22 12:08:30 juju-e4d256-prod-github-runner-207 kernel: [24284.611129] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 12:08:30 juju-e4d256-prod-github-runner-207 kernel: [24284.611898] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:08:30 juju-e4d256-prod-github-runner-207 kernel: [24284.612619] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:08:30 juju-e4d256-prod-github-runner-207 kernel: [24284.613353] ? do_syscall_64+0x69/0xc0 Aug 22 12:08:30 juju-e4d256-prod-github-runner-207 kernel: [24284.613999] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:08:30 juju-e4d256-prod-github-runner-207 kernel: [24284.614708] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:08:30 juju-e4d256-prod-github-runner-207 kernel: [24284.615407] ? do_syscall_64+0x69/0xc0 Aug 22 12:08:30 juju-e4d256-prod-github-runner-207 kernel: [24284.616032] ? do_syscall_64+0x69/0xc0 Aug 22 12:08:30 juju-e4d256-prod-github-runner-207 kernel: [24284.616655] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 12:08:30 juju-e4d256-prod-github-runner-207 kernel: [24284.617371] RIP: 0033:0x7faa5d0edaff Aug 22 12:08:30 juju-e4d256-prod-github-runner-207 kernel: [24284.618034] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 12:08:30 juju-e4d256-prod-github-runner-207 kernel: [24284.620026] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 12:08:30 juju-e4d256-prod-github-runner-207 kernel: [24284.620936] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 12:08:30 juju-e4d256-prod-github-runner-207 kernel: [24284.621838] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 12:08:30 juju-e4d256-prod-github-runner-207 kernel: [24284.622732] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 12:08:30 juju-e4d256-prod-github-runner-207 kernel: [24284.623618] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 12:08:30 juju-e4d256-prod-github-runner-207 kernel: [24284.624506] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 12:08:30 juju-e4d256-prod-github-runner-207 kernel: [24284.625419] Aug 22 12:08:44 juju-e4d256-prod-github-runner-207 kernel: [24298.808709] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 12:08:44 juju-e4d256-prod-github-runner-207 kernel: [24298.810455] rcu: 1-....: (6026549 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=2916912 Aug 22 12:08:44 juju-e4d256-prod-github-runner-207 kernel: [24298.811614] (t=6045402 jiffies g=23269 q=29164) Aug 22 12:08:44 juju-e4d256-prod-github-runner-207 kernel: [24298.812419] NMI backtrace for cpu 1 Aug 22 12:08:44 juju-e4d256-prod-github-runner-207 kernel: [24298.813171] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 12:08:44 juju-e4d256-prod-github-runner-207 kernel: [24298.814296] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 12:08:44 juju-e4d256-prod-github-runner-207 kernel: [24298.815359] Call Trace: Aug 22 12:08:44 juju-e4d256-prod-github-runner-207 kernel: [24298.816036] Aug 22 12:08:44 juju-e4d256-prod-github-runner-207 kernel: [24298.816701] show_stack+0x52/0x5c Aug 22 12:08:44 juju-e4d256-prod-github-runner-207 kernel: [24298.817469] dump_stack_lvl+0x4a/0x63 Aug 22 12:08:44 juju-e4d256-prod-github-runner-207 kernel: [24298.818216] dump_stack+0x10/0x16 Aug 22 12:08:44 juju-e4d256-prod-github-runner-207 kernel: [24298.818941] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 12:08:44 juju-e4d256-prod-github-runner-207 kernel: [24298.819740] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 12:08:44 juju-e4d256-prod-github-runner-207 kernel: [24298.820530] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 12:08:44 juju-e4d256-prod-github-runner-207 kernel: [24298.821370] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 12:08:44 juju-e4d256-prod-github-runner-207 kernel: [24298.822190] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 12:08:44 juju-e4d256-prod-github-runner-207 kernel: [24298.823003] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 12:08:44 juju-e4d256-prod-github-runner-207 kernel: [24298.823791] print_cpu_stall.cold+0x2f/0xe2 Aug 22 12:08:44 juju-e4d256-prod-github-runner-207 kernel: [24298.824565] ? timekeeping_update+0xf7/0x150 Aug 22 12:08:44 juju-e4d256-prod-github-runner-207 kernel: [24298.825358] check_cpu_stall+0x109/0x270 Aug 22 12:08:44 juju-e4d256-prod-github-runner-207 kernel: [24298.826108] rcu_sched_clock_irq+0x9a/0x250 Aug 22 12:08:44 juju-e4d256-prod-github-runner-207 kernel: [24298.826868] update_process_times+0x94/0xd0 Aug 22 12:08:44 juju-e4d256-prod-github-runner-207 kernel: [24298.827629] tick_sched_handle+0x29/0x70 Aug 22 12:08:44 juju-e4d256-prod-github-runner-207 kernel: [24298.828376] tick_sched_timer+0x8c/0xc0 Aug 22 12:08:44 juju-e4d256-prod-github-runner-207 kernel: [24298.829143] ? tick_nohz_handler+0xb0/0xb0 Aug 22 12:08:44 juju-e4d256-prod-github-runner-207 kernel: [24298.829919] __hrtimer_run_queues+0x107/0x230 Aug 22 12:08:44 juju-e4d256-prod-github-runner-207 kernel: [24298.830696] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 12:08:44 juju-e4d256-prod-github-runner-207 kernel: [24298.831473] hrtimer_interrupt+0x101/0x220 Aug 22 12:08:44 juju-e4d256-prod-github-runner-207 kernel: [24298.832233] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 12:08:44 juju-e4d256-prod-github-runner-207 kernel: [24298.833058] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 12:08:44 juju-e4d256-prod-github-runner-207 kernel: [24298.833872] Aug 22 12:08:44 juju-e4d256-prod-github-runner-207 kernel: [24298.834515] Aug 22 12:08:44 juju-e4d256-prod-github-runner-207 kernel: [24298.835156] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 12:08:44 juju-e4d256-prod-github-runner-207 kernel: [24298.835987] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:08:44 juju-e4d256-prod-github-runner-207 kernel: [24298.836893] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 12:08:44 juju-e4d256-prod-github-runner-207 kernel: [24298.839107] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 12:08:44 juju-e4d256-prod-github-runner-207 kernel: [24298.839995] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 12:08:44 juju-e4d256-prod-github-runner-207 kernel: [24298.841006] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 12:08:44 juju-e4d256-prod-github-runner-207 kernel: [24298.841989] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 12:08:44 juju-e4d256-prod-github-runner-207 kernel: [24298.842953] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 12:08:44 juju-e4d256-prod-github-runner-207 kernel: [24298.843908] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 12:08:44 juju-e4d256-prod-github-runner-207 kernel: [24298.844892] ? _raw_spin_lock+0x22/0x30 Aug 22 12:08:44 juju-e4d256-prod-github-runner-207 kernel: [24298.845674] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:08:44 juju-e4d256-prod-github-runner-207 kernel: [24298.846536] direct_page_fault+0x206/0x310 [kvm] Aug 22 12:08:44 juju-e4d256-prod-github-runner-207 kernel: [24298.847392] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 12:08:44 juju-e4d256-prod-github-runner-207 kernel: [24298.848225] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 12:08:44 juju-e4d256-prod-github-runner-207 kernel: [24298.849079] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 12:08:44 juju-e4d256-prod-github-runner-207 kernel: [24298.849935] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 12:08:44 juju-e4d256-prod-github-runner-207 kernel: [24298.850733] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 12:08:44 juju-e4d256-prod-github-runner-207 kernel: [24298.851578] handle_exit+0x98/0x230 [kvm_amd] Aug 22 12:08:44 juju-e4d256-prod-github-runner-207 kernel: [24298.852347] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 12:08:44 juju-e4d256-prod-github-runner-207 kernel: [24298.853144] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 12:08:44 juju-e4d256-prod-github-runner-207 kernel: [24298.853953] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 12:08:44 juju-e4d256-prod-github-runner-207 kernel: [24298.854757] vcpu_run+0x62/0x2c0 [kvm] Aug 22 12:08:44 juju-e4d256-prod-github-runner-207 kernel: [24298.855487] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 12:08:44 juju-e4d256-prod-github-runner-207 kernel: [24298.856227] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 12:08:44 juju-e4d256-prod-github-runner-207 kernel: [24298.857045] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 12:08:44 juju-e4d256-prod-github-runner-207 kernel: [24298.857814] ? __seccomp_filter+0x4a/0x4a0 Aug 22 12:08:44 juju-e4d256-prod-github-runner-207 kernel: [24298.858536] ? __fget_files+0x86/0xc0 Aug 22 12:08:44 juju-e4d256-prod-github-runner-207 kernel: [24298.859230] __x64_sys_ioctl+0x95/0xd0 Aug 22 12:08:44 juju-e4d256-prod-github-runner-207 kernel: [24298.859942] do_syscall_64+0x5c/0xc0 Aug 22 12:08:44 juju-e4d256-prod-github-runner-207 kernel: [24298.860634] ? do_futex+0x162/0x1f0 Aug 22 12:08:44 juju-e4d256-prod-github-runner-207 kernel: [24298.861328] ? __x64_sys_futex+0x78/0x1e0 Aug 22 12:08:44 juju-e4d256-prod-github-runner-207 kernel: [24298.862062] ? __secure_computing+0xa9/0x120 Aug 22 12:08:44 juju-e4d256-prod-github-runner-207 kernel: [24298.862780] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 12:08:44 juju-e4d256-prod-github-runner-207 kernel: [24298.863574] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:08:44 juju-e4d256-prod-github-runner-207 kernel: [24298.864325] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:08:44 juju-e4d256-prod-github-runner-207 kernel: [24298.865118] ? do_syscall_64+0x69/0xc0 Aug 22 12:08:44 juju-e4d256-prod-github-runner-207 kernel: [24298.865833] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:08:44 juju-e4d256-prod-github-runner-207 kernel: [24298.866616] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:08:44 juju-e4d256-prod-github-runner-207 kernel: [24298.867389] ? do_syscall_64+0x69/0xc0 Aug 22 12:08:44 juju-e4d256-prod-github-runner-207 kernel: [24298.868083] ? do_syscall_64+0x69/0xc0 Aug 22 12:08:44 juju-e4d256-prod-github-runner-207 kernel: [24298.868770] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 12:08:44 juju-e4d256-prod-github-runner-207 kernel: [24298.869557] RIP: 0033:0x7faa5d0edaff Aug 22 12:08:44 juju-e4d256-prod-github-runner-207 kernel: [24298.870668] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 12:08:44 juju-e4d256-prod-github-runner-207 kernel: [24298.872800] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 12:08:44 juju-e4d256-prod-github-runner-207 kernel: [24298.873775] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 12:08:44 juju-e4d256-prod-github-runner-207 kernel: [24298.874738] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 12:08:44 juju-e4d256-prod-github-runner-207 kernel: [24298.875699] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 12:08:44 juju-e4d256-prod-github-runner-207 kernel: [24298.876661] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 12:08:44 juju-e4d256-prod-github-runner-207 kernel: [24298.877604] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 12:08:44 juju-e4d256-prod-github-runner-207 kernel: [24298.878520] Aug 22 12:09:10 juju-e4d256-prod-github-runner-207 kernel: [24324.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 22545s! [qemu-system-x86:6715] Aug 22 12:09:10 juju-e4d256-prod-github-runner-207 kernel: [24324.543920] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 12:09:10 juju-e4d256-prod-github-runner-207 kernel: [24324.544236] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 12:09:10 juju-e4d256-prod-github-runner-207 kernel: [24324.556379] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 12:09:10 juju-e4d256-prod-github-runner-207 kernel: [24324.557668] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 12:09:10 juju-e4d256-prod-github-runner-207 kernel: [24324.558891] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:09:10 juju-e4d256-prod-github-runner-207 kernel: [24324.559945] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 12:09:10 juju-e4d256-prod-github-runner-207 kernel: [24324.562507] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 12:09:10 juju-e4d256-prod-github-runner-207 kernel: [24324.563553] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 12:09:10 juju-e4d256-prod-github-runner-207 kernel: [24324.564731] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 12:09:10 juju-e4d256-prod-github-runner-207 kernel: [24324.565895] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 12:09:10 juju-e4d256-prod-github-runner-207 kernel: [24324.567060] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 12:09:10 juju-e4d256-prod-github-runner-207 kernel: [24324.568246] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 12:09:10 juju-e4d256-prod-github-runner-207 kernel: [24324.569465] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 12:09:10 juju-e4d256-prod-github-runner-207 kernel: [24324.570701] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 12:09:10 juju-e4d256-prod-github-runner-207 kernel: [24324.571800] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 12:09:10 juju-e4d256-prod-github-runner-207 kernel: [24324.573043] Call Trace: Aug 22 12:09:10 juju-e4d256-prod-github-runner-207 kernel: [24324.573987] Aug 22 12:09:10 juju-e4d256-prod-github-runner-207 kernel: [24324.574905] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:09:10 juju-e4d256-prod-github-runner-207 kernel: [24324.575943] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:09:10 juju-e4d256-prod-github-runner-207 kernel: [24324.576996] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:09:10 juju-e4d256-prod-github-runner-207 kernel: [24324.578098] ? show_regs.part.0+0x23/0x29 Aug 22 12:09:10 juju-e4d256-prod-github-runner-207 kernel: [24324.579162] ? show_regs.cold+0x8/0xd Aug 22 12:09:10 juju-e4d256-prod-github-runner-207 kernel: [24324.580165] ? watchdog_timer_fn+0x1be/0x220 Aug 22 12:09:10 juju-e4d256-prod-github-runner-207 kernel: [24324.581205] ? lockup_detector_update_enable+0x60/0x60 Aug 22 12:09:10 juju-e4d256-prod-github-runner-207 kernel: [24324.582304] ? __hrtimer_run_queues+0x107/0x230 Aug 22 12:09:10 juju-e4d256-prod-github-runner-207 kernel: [24324.583345] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 12:09:10 juju-e4d256-prod-github-runner-207 kernel: [24324.584385] ? hrtimer_interrupt+0x101/0x220 Aug 22 12:09:10 juju-e4d256-prod-github-runner-207 kernel: [24324.585424] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 12:09:10 juju-e4d256-prod-github-runner-207 kernel: [24324.586495] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 12:09:10 juju-e4d256-prod-github-runner-207 kernel: [24324.587546] Aug 22 12:09:10 juju-e4d256-prod-github-runner-207 kernel: [24324.588403] Aug 22 12:09:10 juju-e4d256-prod-github-runner-207 kernel: [24324.589298] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 12:09:10 juju-e4d256-prod-github-runner-207 kernel: [24324.590343] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:09:10 juju-e4d256-prod-github-runner-207 kernel: [24324.591385] ? _raw_spin_lock+0x22/0x30 Aug 22 12:09:10 juju-e4d256-prod-github-runner-207 kernel: [24324.592332] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:09:10 juju-e4d256-prod-github-runner-207 kernel: [24324.593375] direct_page_fault+0x206/0x310 [kvm] Aug 22 12:09:10 juju-e4d256-prod-github-runner-207 kernel: [24324.594410] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 12:09:10 juju-e4d256-prod-github-runner-207 kernel: [24324.595426] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 12:09:10 juju-e4d256-prod-github-runner-207 kernel: [24324.596434] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 12:09:10 juju-e4d256-prod-github-runner-207 kernel: [24324.597457] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 12:09:10 juju-e4d256-prod-github-runner-207 kernel: [24324.598409] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 12:09:10 juju-e4d256-prod-github-runner-207 kernel: [24324.599387] handle_exit+0x98/0x230 [kvm_amd] Aug 22 12:09:10 juju-e4d256-prod-github-runner-207 kernel: [24324.600291] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 12:09:10 juju-e4d256-prod-github-runner-207 kernel: [24324.601237] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 12:09:10 juju-e4d256-prod-github-runner-207 kernel: [24324.602169] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 12:09:10 juju-e4d256-prod-github-runner-207 kernel: [24324.603116] vcpu_run+0x62/0x2c0 [kvm] Aug 22 12:09:10 juju-e4d256-prod-github-runner-207 kernel: [24324.603935] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 12:09:10 juju-e4d256-prod-github-runner-207 kernel: [24324.604766] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 12:09:10 juju-e4d256-prod-github-runner-207 kernel: [24324.605622] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 12:09:10 juju-e4d256-prod-github-runner-207 kernel: [24324.606424] ? __seccomp_filter+0x4a/0x4a0 Aug 22 12:09:10 juju-e4d256-prod-github-runner-207 kernel: [24324.607174] ? __fget_files+0x86/0xc0 Aug 22 12:09:10 juju-e4d256-prod-github-runner-207 kernel: [24324.607878] __x64_sys_ioctl+0x95/0xd0 Aug 22 12:09:10 juju-e4d256-prod-github-runner-207 kernel: [24324.608607] do_syscall_64+0x5c/0xc0 Aug 22 12:09:10 juju-e4d256-prod-github-runner-207 kernel: [24324.609274] ? do_futex+0x162/0x1f0 Aug 22 12:09:10 juju-e4d256-prod-github-runner-207 kernel: [24324.609922] ? __x64_sys_futex+0x78/0x1e0 Aug 22 12:09:10 juju-e4d256-prod-github-runner-207 kernel: [24324.610617] ? __secure_computing+0xa9/0x120 Aug 22 12:09:10 juju-e4d256-prod-github-runner-207 kernel: [24324.611505] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 12:09:10 juju-e4d256-prod-github-runner-207 kernel: [24324.612266] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:09:10 juju-e4d256-prod-github-runner-207 kernel: [24324.613012] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:09:10 juju-e4d256-prod-github-runner-207 kernel: [24324.613732] ? do_syscall_64+0x69/0xc0 Aug 22 12:09:10 juju-e4d256-prod-github-runner-207 kernel: [24324.614374] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:09:10 juju-e4d256-prod-github-runner-207 kernel: [24324.615075] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:09:10 juju-e4d256-prod-github-runner-207 kernel: [24324.615790] ? do_syscall_64+0x69/0xc0 Aug 22 12:09:10 juju-e4d256-prod-github-runner-207 kernel: [24324.616415] ? do_syscall_64+0x69/0xc0 Aug 22 12:09:10 juju-e4d256-prod-github-runner-207 kernel: [24324.617057] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 12:09:10 juju-e4d256-prod-github-runner-207 kernel: [24324.617774] RIP: 0033:0x7faa5d0edaff Aug 22 12:09:10 juju-e4d256-prod-github-runner-207 kernel: [24324.618436] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 12:09:10 juju-e4d256-prod-github-runner-207 kernel: [24324.620429] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 12:09:10 juju-e4d256-prod-github-runner-207 kernel: [24324.621368] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 12:09:10 juju-e4d256-prod-github-runner-207 kernel: [24324.622259] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 12:09:10 juju-e4d256-prod-github-runner-207 kernel: [24324.623153] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 12:09:10 juju-e4d256-prod-github-runner-207 kernel: [24324.624043] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 12:09:10 juju-e4d256-prod-github-runner-207 kernel: [24324.624952] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 12:09:10 juju-e4d256-prod-github-runner-207 kernel: [24324.625850] Aug 22 12:09:38 juju-e4d256-prod-github-runner-207 kernel: [24352.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 22572s! [qemu-system-x86:6715] Aug 22 12:09:38 juju-e4d256-prod-github-runner-207 kernel: [24352.543856] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 12:09:38 juju-e4d256-prod-github-runner-207 kernel: [24352.544169] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 12:09:38 juju-e4d256-prod-github-runner-207 kernel: [24352.556346] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 12:09:38 juju-e4d256-prod-github-runner-207 kernel: [24352.557612] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 12:09:38 juju-e4d256-prod-github-runner-207 kernel: [24352.558835] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:09:38 juju-e4d256-prod-github-runner-207 kernel: [24352.559898] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 12:09:38 juju-e4d256-prod-github-runner-207 kernel: [24352.562580] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 12:09:38 juju-e4d256-prod-github-runner-207 kernel: [24352.563625] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 12:09:38 juju-e4d256-prod-github-runner-207 kernel: [24352.564863] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 12:09:38 juju-e4d256-prod-github-runner-207 kernel: [24352.566048] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 12:09:38 juju-e4d256-prod-github-runner-207 kernel: [24352.567216] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 12:09:38 juju-e4d256-prod-github-runner-207 kernel: [24352.568420] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 12:09:38 juju-e4d256-prod-github-runner-207 kernel: [24352.569590] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 12:09:38 juju-e4d256-prod-github-runner-207 kernel: [24352.570844] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 12:09:38 juju-e4d256-prod-github-runner-207 kernel: [24352.572048] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 12:09:38 juju-e4d256-prod-github-runner-207 kernel: [24352.573269] Call Trace: Aug 22 12:09:38 juju-e4d256-prod-github-runner-207 kernel: [24352.574181] Aug 22 12:09:38 juju-e4d256-prod-github-runner-207 kernel: [24352.575082] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:09:38 juju-e4d256-prod-github-runner-207 kernel: [24352.576113] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:09:38 juju-e4d256-prod-github-runner-207 kernel: [24352.577140] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:09:38 juju-e4d256-prod-github-runner-207 kernel: [24352.578236] ? show_regs.part.0+0x23/0x29 Aug 22 12:09:38 juju-e4d256-prod-github-runner-207 kernel: [24352.579231] ? show_regs.cold+0x8/0xd Aug 22 12:09:38 juju-e4d256-prod-github-runner-207 kernel: [24352.580201] ? watchdog_timer_fn+0x1be/0x220 Aug 22 12:09:38 juju-e4d256-prod-github-runner-207 kernel: [24352.581226] ? lockup_detector_update_enable+0x60/0x60 Aug 22 12:09:38 juju-e4d256-prod-github-runner-207 kernel: [24352.582288] ? __hrtimer_run_queues+0x107/0x230 Aug 22 12:09:38 juju-e4d256-prod-github-runner-207 kernel: [24352.583314] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 12:09:38 juju-e4d256-prod-github-runner-207 kernel: [24352.584357] ? hrtimer_interrupt+0x101/0x220 Aug 22 12:09:38 juju-e4d256-prod-github-runner-207 kernel: [24352.585383] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 12:09:38 juju-e4d256-prod-github-runner-207 kernel: [24352.586554] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 12:09:38 juju-e4d256-prod-github-runner-207 kernel: [24352.587601] Aug 22 12:09:38 juju-e4d256-prod-github-runner-207 kernel: [24352.588471] Aug 22 12:09:38 juju-e4d256-prod-github-runner-207 kernel: [24352.589358] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 12:09:38 juju-e4d256-prod-github-runner-207 kernel: [24352.590393] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:09:38 juju-e4d256-prod-github-runner-207 kernel: [24352.591431] ? _raw_spin_lock+0x22/0x30 Aug 22 12:09:38 juju-e4d256-prod-github-runner-207 kernel: [24352.592392] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:09:38 juju-e4d256-prod-github-runner-207 kernel: [24352.593428] direct_page_fault+0x206/0x310 [kvm] Aug 22 12:09:38 juju-e4d256-prod-github-runner-207 kernel: [24352.594485] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 12:09:38 juju-e4d256-prod-github-runner-207 kernel: [24352.595499] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 12:09:38 juju-e4d256-prod-github-runner-207 kernel: [24352.596506] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 12:09:38 juju-e4d256-prod-github-runner-207 kernel: [24352.597524] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 12:09:38 juju-e4d256-prod-github-runner-207 kernel: [24352.598469] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 12:09:38 juju-e4d256-prod-github-runner-207 kernel: [24352.599446] handle_exit+0x98/0x230 [kvm_amd] Aug 22 12:09:38 juju-e4d256-prod-github-runner-207 kernel: [24352.600355] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 12:09:38 juju-e4d256-prod-github-runner-207 kernel: [24352.601271] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 12:09:38 juju-e4d256-prod-github-runner-207 kernel: [24352.602196] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 12:09:38 juju-e4d256-prod-github-runner-207 kernel: [24352.603103] vcpu_run+0x62/0x2c0 [kvm] Aug 22 12:09:38 juju-e4d256-prod-github-runner-207 kernel: [24352.603913] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 12:09:38 juju-e4d256-prod-github-runner-207 kernel: [24352.604737] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 12:09:38 juju-e4d256-prod-github-runner-207 kernel: [24352.605592] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 12:09:38 juju-e4d256-prod-github-runner-207 kernel: [24352.606390] ? __seccomp_filter+0x4a/0x4a0 Aug 22 12:09:38 juju-e4d256-prod-github-runner-207 kernel: [24352.607137] ? __fget_files+0x86/0xc0 Aug 22 12:09:38 juju-e4d256-prod-github-runner-207 kernel: [24352.607840] __x64_sys_ioctl+0x95/0xd0 Aug 22 12:09:38 juju-e4d256-prod-github-runner-207 kernel: [24352.608539] do_syscall_64+0x5c/0xc0 Aug 22 12:09:38 juju-e4d256-prod-github-runner-207 kernel: [24352.609208] ? do_futex+0x162/0x1f0 Aug 22 12:09:38 juju-e4d256-prod-github-runner-207 kernel: [24352.609863] ? __x64_sys_futex+0x78/0x1e0 Aug 22 12:09:38 juju-e4d256-prod-github-runner-207 kernel: [24352.610676] ? __secure_computing+0xa9/0x120 Aug 22 12:09:38 juju-e4d256-prod-github-runner-207 kernel: [24352.611366] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 12:09:38 juju-e4d256-prod-github-runner-207 kernel: [24352.612125] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:09:38 juju-e4d256-prod-github-runner-207 kernel: [24352.612865] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:09:38 juju-e4d256-prod-github-runner-207 kernel: [24352.613587] ? do_syscall_64+0x69/0xc0 Aug 22 12:09:38 juju-e4d256-prod-github-runner-207 kernel: [24352.614238] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:09:38 juju-e4d256-prod-github-runner-207 kernel: [24352.614945] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:09:38 juju-e4d256-prod-github-runner-207 kernel: [24352.615642] ? do_syscall_64+0x69/0xc0 Aug 22 12:09:38 juju-e4d256-prod-github-runner-207 kernel: [24352.616284] ? do_syscall_64+0x69/0xc0 Aug 22 12:09:38 juju-e4d256-prod-github-runner-207 kernel: [24352.616908] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 12:09:38 juju-e4d256-prod-github-runner-207 kernel: [24352.617614] RIP: 0033:0x7faa5d0edaff Aug 22 12:09:38 juju-e4d256-prod-github-runner-207 kernel: [24352.618281] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 12:09:38 juju-e4d256-prod-github-runner-207 kernel: [24352.620286] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 12:09:38 juju-e4d256-prod-github-runner-207 kernel: [24352.621198] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 12:09:38 juju-e4d256-prod-github-runner-207 kernel: [24352.622093] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 12:09:38 juju-e4d256-prod-github-runner-207 kernel: [24352.622982] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 12:09:38 juju-e4d256-prod-github-runner-207 kernel: [24352.623868] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 12:09:38 juju-e4d256-prod-github-runner-207 kernel: [24352.624763] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 12:09:38 juju-e4d256-prod-github-runner-207 kernel: [24352.625659] Aug 22 12:10:06 juju-e4d256-prod-github-runner-207 kernel: [24380.541985] watchdog: BUG: soft lockup - CPU#1 stuck for 22598s! [qemu-system-x86:6715] Aug 22 12:10:06 juju-e4d256-prod-github-runner-207 kernel: [24380.543977] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 12:10:06 juju-e4d256-prod-github-runner-207 kernel: [24380.544263] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 12:10:06 juju-e4d256-prod-github-runner-207 kernel: [24380.556957] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 12:10:06 juju-e4d256-prod-github-runner-207 kernel: [24380.558239] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 12:10:06 juju-e4d256-prod-github-runner-207 kernel: [24380.559520] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:10:06 juju-e4d256-prod-github-runner-207 kernel: [24380.560607] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 12:10:06 juju-e4d256-prod-github-runner-207 kernel: [24380.563242] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 12:10:06 juju-e4d256-prod-github-runner-207 kernel: [24380.564334] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 12:10:06 juju-e4d256-prod-github-runner-207 kernel: [24380.565527] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 12:10:06 juju-e4d256-prod-github-runner-207 kernel: [24380.566738] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 12:10:06 juju-e4d256-prod-github-runner-207 kernel: [24380.567937] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 12:10:06 juju-e4d256-prod-github-runner-207 kernel: [24380.569191] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 12:10:06 juju-e4d256-prod-github-runner-207 kernel: [24380.570418] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 12:10:06 juju-e4d256-prod-github-runner-207 kernel: [24380.571706] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 12:10:06 juju-e4d256-prod-github-runner-207 kernel: [24380.572876] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 12:10:06 juju-e4d256-prod-github-runner-207 kernel: [24380.574101] Call Trace: Aug 22 12:10:06 juju-e4d256-prod-github-runner-207 kernel: [24380.575081] Aug 22 12:10:06 juju-e4d256-prod-github-runner-207 kernel: [24380.576037] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:10:06 juju-e4d256-prod-github-runner-207 kernel: [24380.577114] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:10:06 juju-e4d256-prod-github-runner-207 kernel: [24380.578207] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:10:06 juju-e4d256-prod-github-runner-207 kernel: [24380.579563] ? show_regs.part.0+0x23/0x29 Aug 22 12:10:06 juju-e4d256-prod-github-runner-207 kernel: [24380.580832] ? show_regs.cold+0x8/0xd Aug 22 12:10:06 juju-e4d256-prod-github-runner-207 kernel: [24380.582020] ? watchdog_timer_fn+0x1be/0x220 Aug 22 12:10:06 juju-e4d256-prod-github-runner-207 kernel: [24380.583062] ? lockup_detector_update_enable+0x60/0x60 Aug 22 12:10:06 juju-e4d256-prod-github-runner-207 kernel: [24380.584166] ? __hrtimer_run_queues+0x107/0x230 Aug 22 12:10:06 juju-e4d256-prod-github-runner-207 kernel: [24380.585241] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 12:10:06 juju-e4d256-prod-github-runner-207 kernel: [24380.586334] ? hrtimer_interrupt+0x101/0x220 Aug 22 12:10:06 juju-e4d256-prod-github-runner-207 kernel: [24380.587374] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 12:10:06 juju-e4d256-prod-github-runner-207 kernel: [24380.588491] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 12:10:06 juju-e4d256-prod-github-runner-207 kernel: [24380.589556] Aug 22 12:10:06 juju-e4d256-prod-github-runner-207 kernel: [24380.590456] Aug 22 12:10:06 juju-e4d256-prod-github-runner-207 kernel: [24380.591312] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 12:10:06 juju-e4d256-prod-github-runner-207 kernel: [24380.592382] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:10:06 juju-e4d256-prod-github-runner-207 kernel: [24380.593428] ? _raw_spin_lock+0x22/0x30 Aug 22 12:10:06 juju-e4d256-prod-github-runner-207 kernel: [24380.594375] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:10:06 juju-e4d256-prod-github-runner-207 kernel: [24380.595427] direct_page_fault+0x206/0x310 [kvm] Aug 22 12:10:06 juju-e4d256-prod-github-runner-207 kernel: [24380.596481] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 12:10:06 juju-e4d256-prod-github-runner-207 kernel: [24380.597506] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 12:10:06 juju-e4d256-prod-github-runner-207 kernel: [24380.598509] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 12:10:06 juju-e4d256-prod-github-runner-207 kernel: [24380.599542] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 12:10:06 juju-e4d256-prod-github-runner-207 kernel: [24380.600561] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 12:10:06 juju-e4d256-prod-github-runner-207 kernel: [24380.601630] handle_exit+0x98/0x230 [kvm_amd] Aug 22 12:10:06 juju-e4d256-prod-github-runner-207 kernel: [24380.602537] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 12:10:06 juju-e4d256-prod-github-runner-207 kernel: [24380.603464] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 12:10:06 juju-e4d256-prod-github-runner-207 kernel: [24380.604401] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 12:10:06 juju-e4d256-prod-github-runner-207 kernel: [24380.605323] vcpu_run+0x62/0x2c0 [kvm] Aug 22 12:10:06 juju-e4d256-prod-github-runner-207 kernel: [24380.606179] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 12:10:06 juju-e4d256-prod-github-runner-207 kernel: [24380.606996] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 12:10:06 juju-e4d256-prod-github-runner-207 kernel: [24380.607857] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 12:10:06 juju-e4d256-prod-github-runner-207 kernel: [24380.608684] ? __seccomp_filter+0x4a/0x4a0 Aug 22 12:10:06 juju-e4d256-prod-github-runner-207 kernel: [24380.609435] ? __fget_files+0x86/0xc0 Aug 22 12:10:06 juju-e4d256-prod-github-runner-207 kernel: [24380.610163] __x64_sys_ioctl+0x95/0xd0 Aug 22 12:10:06 juju-e4d256-prod-github-runner-207 kernel: [24380.610863] do_syscall_64+0x5c/0xc0 Aug 22 12:10:06 juju-e4d256-prod-github-runner-207 kernel: [24380.611557] ? do_futex+0x162/0x1f0 Aug 22 12:10:06 juju-e4d256-prod-github-runner-207 kernel: [24380.612225] ? __x64_sys_futex+0x78/0x1e0 Aug 22 12:10:06 juju-e4d256-prod-github-runner-207 kernel: [24380.612925] ? __secure_computing+0xa9/0x120 Aug 22 12:10:06 juju-e4d256-prod-github-runner-207 kernel: [24380.613623] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 12:10:06 juju-e4d256-prod-github-runner-207 kernel: [24380.614385] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:10:06 juju-e4d256-prod-github-runner-207 kernel: [24380.615118] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:10:06 juju-e4d256-prod-github-runner-207 kernel: [24380.615894] ? do_syscall_64+0x69/0xc0 Aug 22 12:10:06 juju-e4d256-prod-github-runner-207 kernel: [24380.616582] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:10:06 juju-e4d256-prod-github-runner-207 kernel: [24380.617301] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:10:06 juju-e4d256-prod-github-runner-207 kernel: [24380.617998] ? do_syscall_64+0x69/0xc0 Aug 22 12:10:06 juju-e4d256-prod-github-runner-207 kernel: [24380.618626] ? do_syscall_64+0x69/0xc0 Aug 22 12:10:06 juju-e4d256-prod-github-runner-207 kernel: [24380.619252] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 12:10:06 juju-e4d256-prod-github-runner-207 kernel: [24380.620005] RIP: 0033:0x7faa5d0edaff Aug 22 12:10:06 juju-e4d256-prod-github-runner-207 kernel: [24380.620680] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 12:10:06 juju-e4d256-prod-github-runner-207 kernel: [24380.624729] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 12:10:06 juju-e4d256-prod-github-runner-207 kernel: [24380.625666] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 12:10:06 juju-e4d256-prod-github-runner-207 kernel: [24380.628779] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 12:10:06 juju-e4d256-prod-github-runner-207 kernel: [24380.629692] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 12:10:06 juju-e4d256-prod-github-runner-207 kernel: [24380.632699] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 12:10:06 juju-e4d256-prod-github-runner-207 kernel: [24380.634720] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 12:10:06 juju-e4d256-prod-github-runner-207 kernel: [24380.636725] Aug 22 12:10:34 juju-e4d256-prod-github-runner-207 kernel: [24408.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 22624s! [qemu-system-x86:6715] Aug 22 12:10:34 juju-e4d256-prod-github-runner-207 kernel: [24408.543869] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 12:10:34 juju-e4d256-prod-github-runner-207 kernel: [24408.544165] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 12:10:34 juju-e4d256-prod-github-runner-207 kernel: [24408.556720] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 12:10:34 juju-e4d256-prod-github-runner-207 kernel: [24408.558036] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 12:10:34 juju-e4d256-prod-github-runner-207 kernel: [24408.559294] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:10:34 juju-e4d256-prod-github-runner-207 kernel: [24408.560404] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 12:10:34 juju-e4d256-prod-github-runner-207 kernel: [24408.563024] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 12:10:34 juju-e4d256-prod-github-runner-207 kernel: [24408.564132] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 12:10:34 juju-e4d256-prod-github-runner-207 kernel: [24408.565327] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 12:10:34 juju-e4d256-prod-github-runner-207 kernel: [24408.566504] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 12:10:34 juju-e4d256-prod-github-runner-207 kernel: [24408.567722] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 12:10:34 juju-e4d256-prod-github-runner-207 kernel: [24408.568917] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 12:10:34 juju-e4d256-prod-github-runner-207 kernel: [24408.570133] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 12:10:34 juju-e4d256-prod-github-runner-207 kernel: [24408.571399] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 12:10:34 juju-e4d256-prod-github-runner-207 kernel: [24408.572534] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 12:10:34 juju-e4d256-prod-github-runner-207 kernel: [24408.573775] Call Trace: Aug 22 12:10:34 juju-e4d256-prod-github-runner-207 kernel: [24408.574715] Aug 22 12:10:34 juju-e4d256-prod-github-runner-207 kernel: [24408.575656] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:10:34 juju-e4d256-prod-github-runner-207 kernel: [24408.576704] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:10:34 juju-e4d256-prod-github-runner-207 kernel: [24408.577739] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:10:34 juju-e4d256-prod-github-runner-207 kernel: [24408.578873] ? show_regs.part.0+0x23/0x29 Aug 22 12:10:34 juju-e4d256-prod-github-runner-207 kernel: [24408.579953] ? show_regs.cold+0x8/0xd Aug 22 12:10:34 juju-e4d256-prod-github-runner-207 kernel: [24408.580951] ? watchdog_timer_fn+0x1be/0x220 Aug 22 12:10:34 juju-e4d256-prod-github-runner-207 kernel: [24408.581998] ? lockup_detector_update_enable+0x60/0x60 Aug 22 12:10:34 juju-e4d256-prod-github-runner-207 kernel: [24408.583097] ? __hrtimer_run_queues+0x107/0x230 Aug 22 12:10:34 juju-e4d256-prod-github-runner-207 kernel: [24408.584188] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 12:10:34 juju-e4d256-prod-github-runner-207 kernel: [24408.585236] ? hrtimer_interrupt+0x101/0x220 Aug 22 12:10:34 juju-e4d256-prod-github-runner-207 kernel: [24408.586268] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 12:10:34 juju-e4d256-prod-github-runner-207 kernel: [24408.587361] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 12:10:34 juju-e4d256-prod-github-runner-207 kernel: [24408.588441] Aug 22 12:10:34 juju-e4d256-prod-github-runner-207 kernel: [24408.589315] Aug 22 12:10:34 juju-e4d256-prod-github-runner-207 kernel: [24408.590164] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 12:10:34 juju-e4d256-prod-github-runner-207 kernel: [24408.591212] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:10:34 juju-e4d256-prod-github-runner-207 kernel: [24408.592290] ? _raw_spin_lock+0x22/0x30 Aug 22 12:10:34 juju-e4d256-prod-github-runner-207 kernel: [24408.593272] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:10:34 juju-e4d256-prod-github-runner-207 kernel: [24408.594352] direct_page_fault+0x206/0x310 [kvm] Aug 22 12:10:34 juju-e4d256-prod-github-runner-207 kernel: [24408.595412] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 12:10:34 juju-e4d256-prod-github-runner-207 kernel: [24408.596458] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 12:10:34 juju-e4d256-prod-github-runner-207 kernel: [24408.597475] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 12:10:34 juju-e4d256-prod-github-runner-207 kernel: [24408.598502] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 12:10:34 juju-e4d256-prod-github-runner-207 kernel: [24408.599483] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 12:10:34 juju-e4d256-prod-github-runner-207 kernel: [24408.600513] handle_exit+0x98/0x230 [kvm_amd] Aug 22 12:10:34 juju-e4d256-prod-github-runner-207 kernel: [24408.601420] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 12:10:34 juju-e4d256-prod-github-runner-207 kernel: [24408.602347] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 12:10:34 juju-e4d256-prod-github-runner-207 kernel: [24408.603290] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 12:10:34 juju-e4d256-prod-github-runner-207 kernel: [24408.604227] vcpu_run+0x62/0x2c0 [kvm] Aug 22 12:10:34 juju-e4d256-prod-github-runner-207 kernel: [24408.605067] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 12:10:34 juju-e4d256-prod-github-runner-207 kernel: [24408.605898] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 12:10:34 juju-e4d256-prod-github-runner-207 kernel: [24408.606775] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 12:10:34 juju-e4d256-prod-github-runner-207 kernel: [24408.607606] ? __seccomp_filter+0x4a/0x4a0 Aug 22 12:10:34 juju-e4d256-prod-github-runner-207 kernel: [24408.608365] ? __fget_files+0x86/0xc0 Aug 22 12:10:34 juju-e4d256-prod-github-runner-207 kernel: [24408.609101] __x64_sys_ioctl+0x95/0xd0 Aug 22 12:10:34 juju-e4d256-prod-github-runner-207 kernel: [24408.609815] do_syscall_64+0x5c/0xc0 Aug 22 12:10:34 juju-e4d256-prod-github-runner-207 kernel: [24408.610502] ? do_futex+0x162/0x1f0 Aug 22 12:10:34 juju-e4d256-prod-github-runner-207 kernel: [24408.611163] ? __x64_sys_futex+0x78/0x1e0 Aug 22 12:10:34 juju-e4d256-prod-github-runner-207 kernel: [24408.611871] ? __secure_computing+0xa9/0x120 Aug 22 12:10:34 juju-e4d256-prod-github-runner-207 kernel: [24408.612580] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 12:10:34 juju-e4d256-prod-github-runner-207 kernel: [24408.613354] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:10:34 juju-e4d256-prod-github-runner-207 kernel: [24408.614098] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:10:34 juju-e4d256-prod-github-runner-207 kernel: [24408.614834] ? do_syscall_64+0x69/0xc0 Aug 22 12:10:34 juju-e4d256-prod-github-runner-207 kernel: [24408.615501] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:10:34 juju-e4d256-prod-github-runner-207 kernel: [24408.616232] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:10:34 juju-e4d256-prod-github-runner-207 kernel: [24408.616945] ? do_syscall_64+0x69/0xc0 Aug 22 12:10:34 juju-e4d256-prod-github-runner-207 kernel: [24408.617579] ? do_syscall_64+0x69/0xc0 Aug 22 12:10:34 juju-e4d256-prod-github-runner-207 kernel: [24408.618225] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 12:10:34 juju-e4d256-prod-github-runner-207 kernel: [24408.618947] RIP: 0033:0x7faa5d0edaff Aug 22 12:10:34 juju-e4d256-prod-github-runner-207 kernel: [24408.619669] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 12:10:34 juju-e4d256-prod-github-runner-207 kernel: [24408.621728] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 12:10:34 juju-e4d256-prod-github-runner-207 kernel: [24408.622661] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 12:10:34 juju-e4d256-prod-github-runner-207 kernel: [24408.623587] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 12:10:34 juju-e4d256-prod-github-runner-207 kernel: [24408.624519] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 12:10:34 juju-e4d256-prod-github-runner-207 kernel: [24408.625443] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 12:10:34 juju-e4d256-prod-github-runner-207 kernel: [24408.626354] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 12:10:34 juju-e4d256-prod-github-runner-207 kernel: [24408.627273] Aug 22 12:11:02 juju-e4d256-prod-github-runner-207 kernel: [24436.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 22650s! [qemu-system-x86:6715] Aug 22 12:11:02 juju-e4d256-prod-github-runner-207 kernel: [24436.543834] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 12:11:02 juju-e4d256-prod-github-runner-207 kernel: [24436.544129] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 12:11:02 juju-e4d256-prod-github-runner-207 kernel: [24436.556507] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 12:11:02 juju-e4d256-prod-github-runner-207 kernel: [24436.557800] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 12:11:02 juju-e4d256-prod-github-runner-207 kernel: [24436.559034] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:11:02 juju-e4d256-prod-github-runner-207 kernel: [24436.560119] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 12:11:02 juju-e4d256-prod-github-runner-207 kernel: [24436.562759] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 12:11:02 juju-e4d256-prod-github-runner-207 kernel: [24436.563844] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 12:11:02 juju-e4d256-prod-github-runner-207 kernel: [24436.565035] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 12:11:02 juju-e4d256-prod-github-runner-207 kernel: [24436.566204] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 12:11:02 juju-e4d256-prod-github-runner-207 kernel: [24436.567377] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 12:11:02 juju-e4d256-prod-github-runner-207 kernel: [24436.568537] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 12:11:02 juju-e4d256-prod-github-runner-207 kernel: [24436.569726] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 12:11:02 juju-e4d256-prod-github-runner-207 kernel: [24436.570981] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 12:11:02 juju-e4d256-prod-github-runner-207 kernel: [24436.572089] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 12:11:02 juju-e4d256-prod-github-runner-207 kernel: [24436.573281] Call Trace: Aug 22 12:11:02 juju-e4d256-prod-github-runner-207 kernel: [24436.574196] Aug 22 12:11:02 juju-e4d256-prod-github-runner-207 kernel: [24436.575096] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:11:02 juju-e4d256-prod-github-runner-207 kernel: [24436.576172] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:11:02 juju-e4d256-prod-github-runner-207 kernel: [24436.577228] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:11:02 juju-e4d256-prod-github-runner-207 kernel: [24436.578335] ? show_regs.part.0+0x23/0x29 Aug 22 12:11:02 juju-e4d256-prod-github-runner-207 kernel: [24436.579352] ? show_regs.cold+0x8/0xd Aug 22 12:11:02 juju-e4d256-prod-github-runner-207 kernel: [24436.580330] ? watchdog_timer_fn+0x1be/0x220 Aug 22 12:11:02 juju-e4d256-prod-github-runner-207 kernel: [24436.581345] ? lockup_detector_update_enable+0x60/0x60 Aug 22 12:11:02 juju-e4d256-prod-github-runner-207 kernel: [24436.582613] ? __hrtimer_run_queues+0x107/0x230 Aug 22 12:11:02 juju-e4d256-prod-github-runner-207 kernel: [24436.583667] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 12:11:02 juju-e4d256-prod-github-runner-207 kernel: [24436.584742] ? hrtimer_interrupt+0x101/0x220 Aug 22 12:11:02 juju-e4d256-prod-github-runner-207 kernel: [24436.585768] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 12:11:02 juju-e4d256-prod-github-runner-207 kernel: [24436.586842] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 12:11:02 juju-e4d256-prod-github-runner-207 kernel: [24436.587909] Aug 22 12:11:02 juju-e4d256-prod-github-runner-207 kernel: [24436.588790] Aug 22 12:11:02 juju-e4d256-prod-github-runner-207 kernel: [24436.589632] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 12:11:02 juju-e4d256-prod-github-runner-207 kernel: [24436.590668] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:11:02 juju-e4d256-prod-github-runner-207 kernel: [24436.591728] ? _raw_spin_lock+0x22/0x30 Aug 22 12:11:02 juju-e4d256-prod-github-runner-207 kernel: [24436.592707] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:11:02 juju-e4d256-prod-github-runner-207 kernel: [24436.593730] direct_page_fault+0x206/0x310 [kvm] Aug 22 12:11:02 juju-e4d256-prod-github-runner-207 kernel: [24436.594757] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 12:11:02 juju-e4d256-prod-github-runner-207 kernel: [24436.595778] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 12:11:02 juju-e4d256-prod-github-runner-207 kernel: [24436.596785] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 12:11:02 juju-e4d256-prod-github-runner-207 kernel: [24436.597793] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 12:11:02 juju-e4d256-prod-github-runner-207 kernel: [24436.598742] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 12:11:02 juju-e4d256-prod-github-runner-207 kernel: [24436.599736] handle_exit+0x98/0x230 [kvm_amd] Aug 22 12:11:02 juju-e4d256-prod-github-runner-207 kernel: [24436.600632] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 12:11:02 juju-e4d256-prod-github-runner-207 kernel: [24436.601556] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 12:11:02 juju-e4d256-prod-github-runner-207 kernel: [24436.602484] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 12:11:02 juju-e4d256-prod-github-runner-207 kernel: [24436.603397] vcpu_run+0x62/0x2c0 [kvm] Aug 22 12:11:02 juju-e4d256-prod-github-runner-207 kernel: [24436.604212] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 12:11:02 juju-e4d256-prod-github-runner-207 kernel: [24436.605023] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 12:11:02 juju-e4d256-prod-github-runner-207 kernel: [24436.605888] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 12:11:02 juju-e4d256-prod-github-runner-207 kernel: [24436.606688] ? __seccomp_filter+0x4a/0x4a0 Aug 22 12:11:02 juju-e4d256-prod-github-runner-207 kernel: [24436.607449] ? __fget_files+0x86/0xc0 Aug 22 12:11:02 juju-e4d256-prod-github-runner-207 kernel: [24436.608163] __x64_sys_ioctl+0x95/0xd0 Aug 22 12:11:02 juju-e4d256-prod-github-runner-207 kernel: [24436.608864] do_syscall_64+0x5c/0xc0 Aug 22 12:11:02 juju-e4d256-prod-github-runner-207 kernel: [24436.609555] ? do_futex+0x162/0x1f0 Aug 22 12:11:02 juju-e4d256-prod-github-runner-207 kernel: [24436.610207] ? __x64_sys_futex+0x78/0x1e0 Aug 22 12:11:02 juju-e4d256-prod-github-runner-207 kernel: [24436.610888] ? __secure_computing+0xa9/0x120 Aug 22 12:11:02 juju-e4d256-prod-github-runner-207 kernel: [24436.611610] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 12:11:02 juju-e4d256-prod-github-runner-207 kernel: [24436.612425] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:11:02 juju-e4d256-prod-github-runner-207 kernel: [24436.613150] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:11:02 juju-e4d256-prod-github-runner-207 kernel: [24436.613876] ? do_syscall_64+0x69/0xc0 Aug 22 12:11:02 juju-e4d256-prod-github-runner-207 kernel: [24436.614524] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:11:02 juju-e4d256-prod-github-runner-207 kernel: [24436.615245] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:11:02 juju-e4d256-prod-github-runner-207 kernel: [24436.615944] ? do_syscall_64+0x69/0xc0 Aug 22 12:11:02 juju-e4d256-prod-github-runner-207 kernel: [24436.616594] ? do_syscall_64+0x69/0xc0 Aug 22 12:11:02 juju-e4d256-prod-github-runner-207 kernel: [24436.617220] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 12:11:02 juju-e4d256-prod-github-runner-207 kernel: [24436.617928] RIP: 0033:0x7faa5d0edaff Aug 22 12:11:02 juju-e4d256-prod-github-runner-207 kernel: [24436.618587] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 12:11:02 juju-e4d256-prod-github-runner-207 kernel: [24436.620761] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 12:11:02 juju-e4d256-prod-github-runner-207 kernel: [24436.621676] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 12:11:02 juju-e4d256-prod-github-runner-207 kernel: [24436.622574] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 12:11:02 juju-e4d256-prod-github-runner-207 kernel: [24436.623492] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 12:11:02 juju-e4d256-prod-github-runner-207 kernel: [24436.624391] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 12:11:02 juju-e4d256-prod-github-runner-207 kernel: [24436.625284] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 12:11:02 juju-e4d256-prod-github-runner-207 kernel: [24436.626179] Aug 22 12:11:30 juju-e4d256-prod-github-runner-207 kernel: [24464.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 22676s! [qemu-system-x86:6715] Aug 22 12:11:30 juju-e4d256-prod-github-runner-207 kernel: [24464.544020] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 12:11:30 juju-e4d256-prod-github-runner-207 kernel: [24464.544331] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 12:11:30 juju-e4d256-prod-github-runner-207 kernel: [24464.556673] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 12:11:30 juju-e4d256-prod-github-runner-207 kernel: [24464.557947] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 12:11:30 juju-e4d256-prod-github-runner-207 kernel: [24464.559211] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:11:30 juju-e4d256-prod-github-runner-207 kernel: [24464.560266] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 12:11:30 juju-e4d256-prod-github-runner-207 kernel: [24464.562820] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 12:11:30 juju-e4d256-prod-github-runner-207 kernel: [24464.563877] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 12:11:30 juju-e4d256-prod-github-runner-207 kernel: [24464.565039] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 12:11:30 juju-e4d256-prod-github-runner-207 kernel: [24464.566253] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 12:11:30 juju-e4d256-prod-github-runner-207 kernel: [24464.567466] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 12:11:30 juju-e4d256-prod-github-runner-207 kernel: [24464.568637] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 12:11:30 juju-e4d256-prod-github-runner-207 kernel: [24464.569819] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 12:11:30 juju-e4d256-prod-github-runner-207 kernel: [24464.571065] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 12:11:30 juju-e4d256-prod-github-runner-207 kernel: [24464.572177] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 12:11:30 juju-e4d256-prod-github-runner-207 kernel: [24464.573372] Call Trace: Aug 22 12:11:30 juju-e4d256-prod-github-runner-207 kernel: [24464.574305] Aug 22 12:11:30 juju-e4d256-prod-github-runner-207 kernel: [24464.575230] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:11:30 juju-e4d256-prod-github-runner-207 kernel: [24464.576268] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:11:30 juju-e4d256-prod-github-runner-207 kernel: [24464.577296] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:11:30 juju-e4d256-prod-github-runner-207 kernel: [24464.578397] ? show_regs.part.0+0x23/0x29 Aug 22 12:11:30 juju-e4d256-prod-github-runner-207 kernel: [24464.579515] ? show_regs.cold+0x8/0xd Aug 22 12:11:30 juju-e4d256-prod-github-runner-207 kernel: [24464.580521] ? watchdog_timer_fn+0x1be/0x220 Aug 22 12:11:30 juju-e4d256-prod-github-runner-207 kernel: [24464.581546] ? lockup_detector_update_enable+0x60/0x60 Aug 22 12:11:30 juju-e4d256-prod-github-runner-207 kernel: [24464.582614] ? __hrtimer_run_queues+0x107/0x230 Aug 22 12:11:30 juju-e4d256-prod-github-runner-207 kernel: [24464.583675] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 12:11:30 juju-e4d256-prod-github-runner-207 kernel: [24464.584711] ? hrtimer_interrupt+0x101/0x220 Aug 22 12:11:30 juju-e4d256-prod-github-runner-207 kernel: [24464.585728] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 12:11:30 juju-e4d256-prod-github-runner-207 kernel: [24464.586840] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 12:11:30 juju-e4d256-prod-github-runner-207 kernel: [24464.587909] Aug 22 12:11:30 juju-e4d256-prod-github-runner-207 kernel: [24464.588762] Aug 22 12:11:30 juju-e4d256-prod-github-runner-207 kernel: [24464.589599] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 12:11:30 juju-e4d256-prod-github-runner-207 kernel: [24464.590629] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:11:30 juju-e4d256-prod-github-runner-207 kernel: [24464.591676] ? _raw_spin_lock+0x22/0x30 Aug 22 12:11:30 juju-e4d256-prod-github-runner-207 kernel: [24464.592621] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:11:30 juju-e4d256-prod-github-runner-207 kernel: [24464.593646] direct_page_fault+0x206/0x310 [kvm] Aug 22 12:11:30 juju-e4d256-prod-github-runner-207 kernel: [24464.594674] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 12:11:30 juju-e4d256-prod-github-runner-207 kernel: [24464.595694] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 12:11:30 juju-e4d256-prod-github-runner-207 kernel: [24464.596701] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 12:11:30 juju-e4d256-prod-github-runner-207 kernel: [24464.597713] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 12:11:30 juju-e4d256-prod-github-runner-207 kernel: [24464.598661] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 12:11:30 juju-e4d256-prod-github-runner-207 kernel: [24464.599703] handle_exit+0x98/0x230 [kvm_amd] Aug 22 12:11:30 juju-e4d256-prod-github-runner-207 kernel: [24464.600600] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 12:11:30 juju-e4d256-prod-github-runner-207 kernel: [24464.601554] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 12:11:30 juju-e4d256-prod-github-runner-207 kernel: [24464.602523] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 12:11:30 juju-e4d256-prod-github-runner-207 kernel: [24464.603461] vcpu_run+0x62/0x2c0 [kvm] Aug 22 12:11:30 juju-e4d256-prod-github-runner-207 kernel: [24464.604288] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 12:11:30 juju-e4d256-prod-github-runner-207 kernel: [24464.605135] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 12:11:30 juju-e4d256-prod-github-runner-207 kernel: [24464.605992] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 12:11:30 juju-e4d256-prod-github-runner-207 kernel: [24464.606791] ? __seccomp_filter+0x4a/0x4a0 Aug 22 12:11:30 juju-e4d256-prod-github-runner-207 kernel: [24464.607562] ? __fget_files+0x86/0xc0 Aug 22 12:11:30 juju-e4d256-prod-github-runner-207 kernel: [24464.608271] __x64_sys_ioctl+0x95/0xd0 Aug 22 12:11:30 juju-e4d256-prod-github-runner-207 kernel: [24464.608985] do_syscall_64+0x5c/0xc0 Aug 22 12:11:30 juju-e4d256-prod-github-runner-207 kernel: [24464.609655] ? do_futex+0x162/0x1f0 Aug 22 12:11:30 juju-e4d256-prod-github-runner-207 kernel: [24464.610459] ? __x64_sys_futex+0x78/0x1e0 Aug 22 12:11:30 juju-e4d256-prod-github-runner-207 kernel: [24464.611151] ? __secure_computing+0xa9/0x120 Aug 22 12:11:30 juju-e4d256-prod-github-runner-207 kernel: [24464.611843] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 12:11:30 juju-e4d256-prod-github-runner-207 kernel: [24464.612608] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:11:30 juju-e4d256-prod-github-runner-207 kernel: [24464.613338] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:11:30 juju-e4d256-prod-github-runner-207 kernel: [24464.614059] ? do_syscall_64+0x69/0xc0 Aug 22 12:11:30 juju-e4d256-prod-github-runner-207 kernel: [24464.614713] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:11:30 juju-e4d256-prod-github-runner-207 kernel: [24464.616319] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:11:30 juju-e4d256-prod-github-runner-207 kernel: [24464.617019] ? do_syscall_64+0x69/0xc0 Aug 22 12:11:30 juju-e4d256-prod-github-runner-207 kernel: [24464.617642] ? do_syscall_64+0x69/0xc0 Aug 22 12:11:30 juju-e4d256-prod-github-runner-207 kernel: [24464.618269] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 12:11:30 juju-e4d256-prod-github-runner-207 kernel: [24464.618998] RIP: 0033:0x7faa5d0edaff Aug 22 12:11:30 juju-e4d256-prod-github-runner-207 kernel: [24464.619663] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 12:11:30 juju-e4d256-prod-github-runner-207 kernel: [24464.623864] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 12:11:30 juju-e4d256-prod-github-runner-207 kernel: [24464.624782] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 12:11:30 juju-e4d256-prod-github-runner-207 kernel: [24464.625671] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 12:11:30 juju-e4d256-prod-github-runner-207 kernel: [24464.626579] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 12:11:30 juju-e4d256-prod-github-runner-207 kernel: [24464.627483] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 12:11:30 juju-e4d256-prod-github-runner-207 kernel: [24464.628371] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 12:11:30 juju-e4d256-prod-github-runner-207 kernel: [24464.629456] Aug 22 12:11:44 juju-e4d256-prod-github-runner-207 kernel: [24478.820710] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 12:11:44 juju-e4d256-prod-github-runner-207 kernel: [24478.821922] rcu: 1-....: (6071399 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=2938591 Aug 22 12:11:44 juju-e4d256-prod-github-runner-207 kernel: [24478.823156] (t=6090405 jiffies g=23269 q=29312) Aug 22 12:11:44 juju-e4d256-prod-github-runner-207 kernel: [24478.824000] NMI backtrace for cpu 1 Aug 22 12:11:44 juju-e4d256-prod-github-runner-207 kernel: [24478.824760] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 12:11:44 juju-e4d256-prod-github-runner-207 kernel: [24478.825944] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 12:11:44 juju-e4d256-prod-github-runner-207 kernel: [24478.827096] Call Trace: Aug 22 12:11:44 juju-e4d256-prod-github-runner-207 kernel: [24478.827845] Aug 22 12:11:44 juju-e4d256-prod-github-runner-207 kernel: [24478.828528] show_stack+0x52/0x5c Aug 22 12:11:44 juju-e4d256-prod-github-runner-207 kernel: [24478.829315] dump_stack_lvl+0x4a/0x63 Aug 22 12:11:44 juju-e4d256-prod-github-runner-207 kernel: [24478.830115] dump_stack+0x10/0x16 Aug 22 12:11:44 juju-e4d256-prod-github-runner-207 kernel: [24478.830901] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 12:11:44 juju-e4d256-prod-github-runner-207 kernel: [24478.831736] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 12:11:44 juju-e4d256-prod-github-runner-207 kernel: [24478.832567] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 12:11:44 juju-e4d256-prod-github-runner-207 kernel: [24478.833462] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 12:11:44 juju-e4d256-prod-github-runner-207 kernel: [24478.834339] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 12:11:44 juju-e4d256-prod-github-runner-207 kernel: [24478.835222] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 12:11:44 juju-e4d256-prod-github-runner-207 kernel: [24478.836034] print_cpu_stall.cold+0x2f/0xe2 Aug 22 12:11:44 juju-e4d256-prod-github-runner-207 kernel: [24478.836825] ? timekeeping_update+0xf7/0x150 Aug 22 12:11:44 juju-e4d256-prod-github-runner-207 kernel: [24478.837634] check_cpu_stall+0x109/0x270 Aug 22 12:11:44 juju-e4d256-prod-github-runner-207 kernel: [24478.838425] rcu_sched_clock_irq+0x9a/0x250 Aug 22 12:11:44 juju-e4d256-prod-github-runner-207 kernel: [24478.839258] update_process_times+0x94/0xd0 Aug 22 12:11:44 juju-e4d256-prod-github-runner-207 kernel: [24478.840068] tick_sched_handle+0x29/0x70 Aug 22 12:11:44 juju-e4d256-prod-github-runner-207 kernel: [24478.840859] tick_sched_timer+0x8c/0xc0 Aug 22 12:11:44 juju-e4d256-prod-github-runner-207 kernel: [24478.841696] ? tick_nohz_handler+0xb0/0xb0 Aug 22 12:11:44 juju-e4d256-prod-github-runner-207 kernel: [24478.842499] __hrtimer_run_queues+0x107/0x230 Aug 22 12:11:44 juju-e4d256-prod-github-runner-207 kernel: [24478.843376] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 12:11:44 juju-e4d256-prod-github-runner-207 kernel: [24478.844200] hrtimer_interrupt+0x101/0x220 Aug 22 12:11:44 juju-e4d256-prod-github-runner-207 kernel: [24478.845003] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 12:11:44 juju-e4d256-prod-github-runner-207 kernel: [24478.845876] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 12:11:44 juju-e4d256-prod-github-runner-207 kernel: [24478.846733] Aug 22 12:11:44 juju-e4d256-prod-github-runner-207 kernel: [24478.847422] Aug 22 12:11:44 juju-e4d256-prod-github-runner-207 kernel: [24478.848107] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 12:11:44 juju-e4d256-prod-github-runner-207 kernel: [24478.848975] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:11:44 juju-e4d256-prod-github-runner-207 kernel: [24478.849914] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 12:11:44 juju-e4d256-prod-github-runner-207 kernel: [24478.852297] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 12:11:44 juju-e4d256-prod-github-runner-207 kernel: [24478.853217] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 12:11:44 juju-e4d256-prod-github-runner-207 kernel: [24478.854285] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 12:11:44 juju-e4d256-prod-github-runner-207 kernel: [24478.855349] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 12:11:44 juju-e4d256-prod-github-runner-207 kernel: [24478.856384] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 12:11:44 juju-e4d256-prod-github-runner-207 kernel: [24478.857426] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 12:11:44 juju-e4d256-prod-github-runner-207 kernel: [24478.858441] ? _raw_spin_lock+0x22/0x30 Aug 22 12:11:44 juju-e4d256-prod-github-runner-207 kernel: [24478.859248] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:11:44 juju-e4d256-prod-github-runner-207 kernel: [24478.860121] direct_page_fault+0x206/0x310 [kvm] Aug 22 12:11:44 juju-e4d256-prod-github-runner-207 kernel: [24478.861014] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 12:11:44 juju-e4d256-prod-github-runner-207 kernel: [24478.861879] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 12:11:44 juju-e4d256-prod-github-runner-207 kernel: [24478.862769] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 12:11:44 juju-e4d256-prod-github-runner-207 kernel: [24478.863660] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 12:11:44 juju-e4d256-prod-github-runner-207 kernel: [24478.864506] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 12:11:44 juju-e4d256-prod-github-runner-207 kernel: [24478.865401] handle_exit+0x98/0x230 [kvm_amd] Aug 22 12:11:44 juju-e4d256-prod-github-runner-207 kernel: [24478.866230] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 12:11:44 juju-e4d256-prod-github-runner-207 kernel: [24478.867133] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 12:11:44 juju-e4d256-prod-github-runner-207 kernel: [24478.867999] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 12:11:44 juju-e4d256-prod-github-runner-207 kernel: [24478.868847] vcpu_run+0x62/0x2c0 [kvm] Aug 22 12:11:44 juju-e4d256-prod-github-runner-207 kernel: [24478.869609] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 12:11:44 juju-e4d256-prod-github-runner-207 kernel: [24478.870391] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 12:11:44 juju-e4d256-prod-github-runner-207 kernel: [24478.871270] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 12:11:44 juju-e4d256-prod-github-runner-207 kernel: [24478.872099] ? __seccomp_filter+0x4a/0x4a0 Aug 22 12:11:44 juju-e4d256-prod-github-runner-207 kernel: [24478.872859] ? __fget_files+0x86/0xc0 Aug 22 12:11:44 juju-e4d256-prod-github-runner-207 kernel: [24478.873632] __x64_sys_ioctl+0x95/0xd0 Aug 22 12:11:44 juju-e4d256-prod-github-runner-207 kernel: [24478.874375] do_syscall_64+0x5c/0xc0 Aug 22 12:11:44 juju-e4d256-prod-github-runner-207 kernel: [24478.875118] ? do_futex+0x162/0x1f0 Aug 22 12:11:44 juju-e4d256-prod-github-runner-207 kernel: [24478.875837] ? __x64_sys_futex+0x78/0x1e0 Aug 22 12:11:44 juju-e4d256-prod-github-runner-207 kernel: [24478.876582] ? __secure_computing+0xa9/0x120 Aug 22 12:11:44 juju-e4d256-prod-github-runner-207 kernel: [24478.877365] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 12:11:44 juju-e4d256-prod-github-runner-207 kernel: [24478.878217] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:11:44 juju-e4d256-prod-github-runner-207 kernel: [24478.879053] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:11:44 juju-e4d256-prod-github-runner-207 kernel: [24478.879861] ? do_syscall_64+0x69/0xc0 Aug 22 12:11:44 juju-e4d256-prod-github-runner-207 kernel: [24478.880611] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:11:44 juju-e4d256-prod-github-runner-207 kernel: [24478.881408] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:11:44 juju-e4d256-prod-github-runner-207 kernel: [24478.882217] ? do_syscall_64+0x69/0xc0 Aug 22 12:11:44 juju-e4d256-prod-github-runner-207 kernel: [24478.882992] ? do_syscall_64+0x69/0xc0 Aug 22 12:11:44 juju-e4d256-prod-github-runner-207 kernel: [24478.883733] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 12:11:44 juju-e4d256-prod-github-runner-207 kernel: [24478.884560] RIP: 0033:0x7faa5d0edaff Aug 22 12:11:44 juju-e4d256-prod-github-runner-207 kernel: [24478.885284] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 12:11:44 juju-e4d256-prod-github-runner-207 kernel: [24478.887546] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 12:11:44 juju-e4d256-prod-github-runner-207 kernel: [24478.888571] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 12:11:44 juju-e4d256-prod-github-runner-207 kernel: [24478.889580] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 12:11:44 juju-e4d256-prod-github-runner-207 kernel: [24478.890596] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 12:11:44 juju-e4d256-prod-github-runner-207 kernel: [24478.891608] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 12:11:44 juju-e4d256-prod-github-runner-207 kernel: [24478.892601] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 12:11:44 juju-e4d256-prod-github-runner-207 kernel: [24478.893588] Aug 22 12:12:10 juju-e4d256-prod-github-runner-207 kernel: [24504.541981] watchdog: BUG: soft lockup - CPU#1 stuck for 22713s! [qemu-system-x86:6715] Aug 22 12:12:10 juju-e4d256-prod-github-runner-207 kernel: [24504.543831] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 12:12:10 juju-e4d256-prod-github-runner-207 kernel: [24504.544124] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 12:12:10 juju-e4d256-prod-github-runner-207 kernel: [24504.556601] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 12:12:10 juju-e4d256-prod-github-runner-207 kernel: [24504.557930] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 12:12:10 juju-e4d256-prod-github-runner-207 kernel: [24504.559191] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:12:10 juju-e4d256-prod-github-runner-207 kernel: [24504.560252] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 12:12:10 juju-e4d256-prod-github-runner-207 kernel: [24504.562847] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 12:12:10 juju-e4d256-prod-github-runner-207 kernel: [24504.563899] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 12:12:10 juju-e4d256-prod-github-runner-207 kernel: [24504.565073] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 12:12:10 juju-e4d256-prod-github-runner-207 kernel: [24504.566239] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 12:12:10 juju-e4d256-prod-github-runner-207 kernel: [24504.567407] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 12:12:10 juju-e4d256-prod-github-runner-207 kernel: [24504.568628] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 12:12:10 juju-e4d256-prod-github-runner-207 kernel: [24504.569823] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 12:12:10 juju-e4d256-prod-github-runner-207 kernel: [24504.571076] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 12:12:10 juju-e4d256-prod-github-runner-207 kernel: [24504.572175] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 12:12:10 juju-e4d256-prod-github-runner-207 kernel: [24504.573373] Call Trace: Aug 22 12:12:10 juju-e4d256-prod-github-runner-207 kernel: [24504.574286] Aug 22 12:12:10 juju-e4d256-prod-github-runner-207 kernel: [24504.575260] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:12:10 juju-e4d256-prod-github-runner-207 kernel: [24504.576389] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:12:10 juju-e4d256-prod-github-runner-207 kernel: [24504.577538] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:12:10 juju-e4d256-prod-github-runner-207 kernel: [24504.578837] ? show_regs.part.0+0x23/0x29 Aug 22 12:12:10 juju-e4d256-prod-github-runner-207 kernel: [24504.579848] ? show_regs.cold+0x8/0xd Aug 22 12:12:10 juju-e4d256-prod-github-runner-207 kernel: [24504.580907] ? watchdog_timer_fn+0x1be/0x220 Aug 22 12:12:10 juju-e4d256-prod-github-runner-207 kernel: [24504.581997] ? lockup_detector_update_enable+0x60/0x60 Aug 22 12:12:10 juju-e4d256-prod-github-runner-207 kernel: [24504.583125] ? __hrtimer_run_queues+0x107/0x230 Aug 22 12:12:10 juju-e4d256-prod-github-runner-207 kernel: [24504.584164] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 12:12:10 juju-e4d256-prod-github-runner-207 kernel: [24504.585215] ? hrtimer_interrupt+0x101/0x220 Aug 22 12:12:10 juju-e4d256-prod-github-runner-207 kernel: [24504.586297] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 12:12:10 juju-e4d256-prod-github-runner-207 kernel: [24504.587414] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 12:12:10 juju-e4d256-prod-github-runner-207 kernel: [24504.588485] Aug 22 12:12:10 juju-e4d256-prod-github-runner-207 kernel: [24504.589377] Aug 22 12:12:10 juju-e4d256-prod-github-runner-207 kernel: [24504.590226] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 12:12:10 juju-e4d256-prod-github-runner-207 kernel: [24504.591277] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:12:10 juju-e4d256-prod-github-runner-207 kernel: [24504.592344] ? _raw_spin_lock+0x22/0x30 Aug 22 12:12:10 juju-e4d256-prod-github-runner-207 kernel: [24504.593302] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:12:10 juju-e4d256-prod-github-runner-207 kernel: [24504.594321] direct_page_fault+0x206/0x310 [kvm] Aug 22 12:12:10 juju-e4d256-prod-github-runner-207 kernel: [24504.595398] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 12:12:10 juju-e4d256-prod-github-runner-207 kernel: [24504.596406] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 12:12:10 juju-e4d256-prod-github-runner-207 kernel: [24504.597405] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 12:12:10 juju-e4d256-prod-github-runner-207 kernel: [24504.598440] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 12:12:10 juju-e4d256-prod-github-runner-207 kernel: [24504.599396] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 12:12:10 juju-e4d256-prod-github-runner-207 kernel: [24504.600392] handle_exit+0x98/0x230 [kvm_amd] Aug 22 12:12:10 juju-e4d256-prod-github-runner-207 kernel: [24504.601402] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 12:12:10 juju-e4d256-prod-github-runner-207 kernel: [24504.602408] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 12:12:10 juju-e4d256-prod-github-runner-207 kernel: [24504.603427] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 12:12:10 juju-e4d256-prod-github-runner-207 kernel: [24504.604338] vcpu_run+0x62/0x2c0 [kvm] Aug 22 12:12:10 juju-e4d256-prod-github-runner-207 kernel: [24504.605170] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 12:12:10 juju-e4d256-prod-github-runner-207 kernel: [24504.606021] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 12:12:10 juju-e4d256-prod-github-runner-207 kernel: [24504.606923] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 12:12:10 juju-e4d256-prod-github-runner-207 kernel: [24504.607725] ? __seccomp_filter+0x4a/0x4a0 Aug 22 12:12:10 juju-e4d256-prod-github-runner-207 kernel: [24504.608466] ? __fget_files+0x86/0xc0 Aug 22 12:12:10 juju-e4d256-prod-github-runner-207 kernel: [24504.609167] __x64_sys_ioctl+0x95/0xd0 Aug 22 12:12:10 juju-e4d256-prod-github-runner-207 kernel: [24504.609856] do_syscall_64+0x5c/0xc0 Aug 22 12:12:10 juju-e4d256-prod-github-runner-207 kernel: [24504.610542] ? do_futex+0x162/0x1f0 Aug 22 12:12:10 juju-e4d256-prod-github-runner-207 kernel: [24504.611191] ? __x64_sys_futex+0x78/0x1e0 Aug 22 12:12:10 juju-e4d256-prod-github-runner-207 kernel: [24504.611866] ? __secure_computing+0xa9/0x120 Aug 22 12:12:10 juju-e4d256-prod-github-runner-207 kernel: [24504.612556] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 12:12:10 juju-e4d256-prod-github-runner-207 kernel: [24504.613319] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:12:10 juju-e4d256-prod-github-runner-207 kernel: [24504.614061] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:12:10 juju-e4d256-prod-github-runner-207 kernel: [24504.614809] ? do_syscall_64+0x69/0xc0 Aug 22 12:12:10 juju-e4d256-prod-github-runner-207 kernel: [24504.615463] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:12:10 juju-e4d256-prod-github-runner-207 kernel: [24504.616173] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:12:10 juju-e4d256-prod-github-runner-207 kernel: [24504.616885] ? do_syscall_64+0x69/0xc0 Aug 22 12:12:10 juju-e4d256-prod-github-runner-207 kernel: [24504.617516] ? do_syscall_64+0x69/0xc0 Aug 22 12:12:10 juju-e4d256-prod-github-runner-207 kernel: [24504.618163] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 12:12:10 juju-e4d256-prod-github-runner-207 kernel: [24504.618885] RIP: 0033:0x7faa5d0edaff Aug 22 12:12:10 juju-e4d256-prod-github-runner-207 kernel: [24504.619546] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 12:12:10 juju-e4d256-prod-github-runner-207 kernel: [24504.621535] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 12:12:10 juju-e4d256-prod-github-runner-207 kernel: [24504.622493] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 12:12:10 juju-e4d256-prod-github-runner-207 kernel: [24504.623387] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 12:12:10 juju-e4d256-prod-github-runner-207 kernel: [24504.624292] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 12:12:10 juju-e4d256-prod-github-runner-207 kernel: [24504.625183] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 12:12:10 juju-e4d256-prod-github-runner-207 kernel: [24504.626065] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 12:12:10 juju-e4d256-prod-github-runner-207 kernel: [24504.626968] Aug 22 12:12:38 juju-e4d256-prod-github-runner-207 kernel: [24532.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 22739s! [qemu-system-x86:6715] Aug 22 12:12:38 juju-e4d256-prod-github-runner-207 kernel: [24532.543901] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 12:12:38 juju-e4d256-prod-github-runner-207 kernel: [24532.544195] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 12:12:38 juju-e4d256-prod-github-runner-207 kernel: [24532.556596] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 12:12:38 juju-e4d256-prod-github-runner-207 kernel: [24532.557881] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 12:12:38 juju-e4d256-prod-github-runner-207 kernel: [24532.559143] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:12:38 juju-e4d256-prod-github-runner-207 kernel: [24532.560215] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 12:12:38 juju-e4d256-prod-github-runner-207 kernel: [24532.562832] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 12:12:38 juju-e4d256-prod-github-runner-207 kernel: [24532.563890] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 12:12:38 juju-e4d256-prod-github-runner-207 kernel: [24532.565066] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 12:12:38 juju-e4d256-prod-github-runner-207 kernel: [24532.566252] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 12:12:38 juju-e4d256-prod-github-runner-207 kernel: [24532.567429] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 12:12:38 juju-e4d256-prod-github-runner-207 kernel: [24532.568602] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 12:12:38 juju-e4d256-prod-github-runner-207 kernel: [24532.569781] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 12:12:38 juju-e4d256-prod-github-runner-207 kernel: [24532.571045] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 12:12:38 juju-e4d256-prod-github-runner-207 kernel: [24532.572171] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 12:12:38 juju-e4d256-prod-github-runner-207 kernel: [24532.573382] Call Trace: Aug 22 12:12:38 juju-e4d256-prod-github-runner-207 kernel: [24532.574313] Aug 22 12:12:38 juju-e4d256-prod-github-runner-207 kernel: [24532.575212] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:12:38 juju-e4d256-prod-github-runner-207 kernel: [24532.576248] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:12:38 juju-e4d256-prod-github-runner-207 kernel: [24532.577284] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:12:38 juju-e4d256-prod-github-runner-207 kernel: [24532.578416] ? show_regs.part.0+0x23/0x29 Aug 22 12:12:38 juju-e4d256-prod-github-runner-207 kernel: [24532.579421] ? show_regs.cold+0x8/0xd Aug 22 12:12:38 juju-e4d256-prod-github-runner-207 kernel: [24532.580398] ? watchdog_timer_fn+0x1be/0x220 Aug 22 12:12:38 juju-e4d256-prod-github-runner-207 kernel: [24532.581418] ? lockup_detector_update_enable+0x60/0x60 Aug 22 12:12:38 juju-e4d256-prod-github-runner-207 kernel: [24532.582543] ? __hrtimer_run_queues+0x107/0x230 Aug 22 12:12:38 juju-e4d256-prod-github-runner-207 kernel: [24532.583604] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 12:12:38 juju-e4d256-prod-github-runner-207 kernel: [24532.584638] ? hrtimer_interrupt+0x101/0x220 Aug 22 12:12:38 juju-e4d256-prod-github-runner-207 kernel: [24532.585676] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 12:12:38 juju-e4d256-prod-github-runner-207 kernel: [24532.586776] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 12:12:38 juju-e4d256-prod-github-runner-207 kernel: [24532.587840] Aug 22 12:12:38 juju-e4d256-prod-github-runner-207 kernel: [24532.588700] Aug 22 12:12:38 juju-e4d256-prod-github-runner-207 kernel: [24532.589539] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 12:12:38 juju-e4d256-prod-github-runner-207 kernel: [24532.590601] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:12:38 juju-e4d256-prod-github-runner-207 kernel: [24532.591678] ? _raw_spin_lock+0x22/0x30 Aug 22 12:12:38 juju-e4d256-prod-github-runner-207 kernel: [24532.592656] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:12:38 juju-e4d256-prod-github-runner-207 kernel: [24532.593712] direct_page_fault+0x206/0x310 [kvm] Aug 22 12:12:38 juju-e4d256-prod-github-runner-207 kernel: [24532.594778] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 12:12:38 juju-e4d256-prod-github-runner-207 kernel: [24532.595802] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 12:12:38 juju-e4d256-prod-github-runner-207 kernel: [24532.596815] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 12:12:38 juju-e4d256-prod-github-runner-207 kernel: [24532.597819] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 12:12:38 juju-e4d256-prod-github-runner-207 kernel: [24532.598811] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 12:12:38 juju-e4d256-prod-github-runner-207 kernel: [24532.599807] handle_exit+0x98/0x230 [kvm_amd] Aug 22 12:12:38 juju-e4d256-prod-github-runner-207 kernel: [24532.600705] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 12:12:38 juju-e4d256-prod-github-runner-207 kernel: [24532.601626] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 12:12:38 juju-e4d256-prod-github-runner-207 kernel: [24532.602573] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 12:12:38 juju-e4d256-prod-github-runner-207 kernel: [24532.603490] vcpu_run+0x62/0x2c0 [kvm] Aug 22 12:12:38 juju-e4d256-prod-github-runner-207 kernel: [24532.604306] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 12:12:38 juju-e4d256-prod-github-runner-207 kernel: [24532.605134] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 12:12:38 juju-e4d256-prod-github-runner-207 kernel: [24532.606000] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 12:12:38 juju-e4d256-prod-github-runner-207 kernel: [24532.606829] ? __seccomp_filter+0x4a/0x4a0 Aug 22 12:12:38 juju-e4d256-prod-github-runner-207 kernel: [24532.607589] ? __fget_files+0x86/0xc0 Aug 22 12:12:38 juju-e4d256-prod-github-runner-207 kernel: [24532.608303] __x64_sys_ioctl+0x95/0xd0 Aug 22 12:12:38 juju-e4d256-prod-github-runner-207 kernel: [24532.609005] do_syscall_64+0x5c/0xc0 Aug 22 12:12:38 juju-e4d256-prod-github-runner-207 kernel: [24532.609676] ? do_futex+0x162/0x1f0 Aug 22 12:12:38 juju-e4d256-prod-github-runner-207 kernel: [24532.610351] ? __x64_sys_futex+0x78/0x1e0 Aug 22 12:12:38 juju-e4d256-prod-github-runner-207 kernel: [24532.611031] ? __secure_computing+0xa9/0x120 Aug 22 12:12:38 juju-e4d256-prod-github-runner-207 kernel: [24532.611733] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 12:12:38 juju-e4d256-prod-github-runner-207 kernel: [24532.612507] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:12:38 juju-e4d256-prod-github-runner-207 kernel: [24532.613235] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:12:38 juju-e4d256-prod-github-runner-207 kernel: [24532.613960] ? do_syscall_64+0x69/0xc0 Aug 22 12:12:38 juju-e4d256-prod-github-runner-207 kernel: [24532.614627] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:12:38 juju-e4d256-prod-github-runner-207 kernel: [24532.615339] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:12:38 juju-e4d256-prod-github-runner-207 kernel: [24532.616043] ? do_syscall_64+0x69/0xc0 Aug 22 12:12:38 juju-e4d256-prod-github-runner-207 kernel: [24532.616673] ? do_syscall_64+0x69/0xc0 Aug 22 12:12:38 juju-e4d256-prod-github-runner-207 kernel: [24532.617300] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 12:12:38 juju-e4d256-prod-github-runner-207 kernel: [24532.618010] RIP: 0033:0x7faa5d0edaff Aug 22 12:12:38 juju-e4d256-prod-github-runner-207 kernel: [24532.618683] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 12:12:38 juju-e4d256-prod-github-runner-207 kernel: [24532.620982] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 12:12:38 juju-e4d256-prod-github-runner-207 kernel: [24532.621981] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 12:12:38 juju-e4d256-prod-github-runner-207 kernel: [24532.622939] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 12:12:38 juju-e4d256-prod-github-runner-207 kernel: [24532.623873] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 12:12:38 juju-e4d256-prod-github-runner-207 kernel: [24532.624779] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 12:12:38 juju-e4d256-prod-github-runner-207 kernel: [24532.625686] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 12:12:38 juju-e4d256-prod-github-runner-207 kernel: [24532.626607] Aug 22 12:13:06 juju-e4d256-prod-github-runner-207 kernel: [24560.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 22765s! [qemu-system-x86:6715] Aug 22 12:13:06 juju-e4d256-prod-github-runner-207 kernel: [24560.543884] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 12:13:06 juju-e4d256-prod-github-runner-207 kernel: [24560.544186] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 12:13:06 juju-e4d256-prod-github-runner-207 kernel: [24560.556266] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 12:13:06 juju-e4d256-prod-github-runner-207 kernel: [24560.557545] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 12:13:06 juju-e4d256-prod-github-runner-207 kernel: [24560.558869] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:13:06 juju-e4d256-prod-github-runner-207 kernel: [24560.559928] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 12:13:06 juju-e4d256-prod-github-runner-207 kernel: [24560.562493] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 12:13:06 juju-e4d256-prod-github-runner-207 kernel: [24560.563541] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 12:13:06 juju-e4d256-prod-github-runner-207 kernel: [24560.564722] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 12:13:06 juju-e4d256-prod-github-runner-207 kernel: [24560.565900] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 12:13:06 juju-e4d256-prod-github-runner-207 kernel: [24560.567068] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 12:13:06 juju-e4d256-prod-github-runner-207 kernel: [24560.568249] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 12:13:06 juju-e4d256-prod-github-runner-207 kernel: [24560.569432] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 12:13:06 juju-e4d256-prod-github-runner-207 kernel: [24560.570689] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 12:13:06 juju-e4d256-prod-github-runner-207 kernel: [24560.571800] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 12:13:06 juju-e4d256-prod-github-runner-207 kernel: [24560.573009] Call Trace: Aug 22 12:13:06 juju-e4d256-prod-github-runner-207 kernel: [24560.573938] Aug 22 12:13:06 juju-e4d256-prod-github-runner-207 kernel: [24560.574838] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:13:06 juju-e4d256-prod-github-runner-207 kernel: [24560.575867] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:13:06 juju-e4d256-prod-github-runner-207 kernel: [24560.576886] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:13:06 juju-e4d256-prod-github-runner-207 kernel: [24560.578003] ? show_regs.part.0+0x23/0x29 Aug 22 12:13:06 juju-e4d256-prod-github-runner-207 kernel: [24560.578997] ? show_regs.cold+0x8/0xd Aug 22 12:13:06 juju-e4d256-prod-github-runner-207 kernel: [24560.579966] ? watchdog_timer_fn+0x1be/0x220 Aug 22 12:13:06 juju-e4d256-prod-github-runner-207 kernel: [24560.580978] ? lockup_detector_update_enable+0x60/0x60 Aug 22 12:13:06 juju-e4d256-prod-github-runner-207 kernel: [24560.582078] ? __hrtimer_run_queues+0x107/0x230 Aug 22 12:13:06 juju-e4d256-prod-github-runner-207 kernel: [24560.583107] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 12:13:06 juju-e4d256-prod-github-runner-207 kernel: [24560.584126] ? hrtimer_interrupt+0x101/0x220 Aug 22 12:13:06 juju-e4d256-prod-github-runner-207 kernel: [24560.585149] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 12:13:06 juju-e4d256-prod-github-runner-207 kernel: [24560.586251] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 12:13:06 juju-e4d256-prod-github-runner-207 kernel: [24560.587314] Aug 22 12:13:06 juju-e4d256-prod-github-runner-207 kernel: [24560.588170] Aug 22 12:13:06 juju-e4d256-prod-github-runner-207 kernel: [24560.589005] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 12:13:06 juju-e4d256-prod-github-runner-207 kernel: [24560.590051] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:13:06 juju-e4d256-prod-github-runner-207 kernel: [24560.591094] ? _raw_spin_lock+0x22/0x30 Aug 22 12:13:06 juju-e4d256-prod-github-runner-207 kernel: [24560.592036] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:13:06 juju-e4d256-prod-github-runner-207 kernel: [24560.593050] direct_page_fault+0x206/0x310 [kvm] Aug 22 12:13:06 juju-e4d256-prod-github-runner-207 kernel: [24560.594087] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 12:13:06 juju-e4d256-prod-github-runner-207 kernel: [24560.595098] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 12:13:06 juju-e4d256-prod-github-runner-207 kernel: [24560.596097] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 12:13:06 juju-e4d256-prod-github-runner-207 kernel: [24560.597099] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 12:13:06 juju-e4d256-prod-github-runner-207 kernel: [24560.598057] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 12:13:06 juju-e4d256-prod-github-runner-207 kernel: [24560.599053] handle_exit+0x98/0x230 [kvm_amd] Aug 22 12:13:06 juju-e4d256-prod-github-runner-207 kernel: [24560.600008] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 12:13:06 juju-e4d256-prod-github-runner-207 kernel: [24560.600925] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 12:13:06 juju-e4d256-prod-github-runner-207 kernel: [24560.601866] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 12:13:06 juju-e4d256-prod-github-runner-207 kernel: [24560.602769] vcpu_run+0x62/0x2c0 [kvm] Aug 22 12:13:06 juju-e4d256-prod-github-runner-207 kernel: [24560.603582] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 12:13:06 juju-e4d256-prod-github-runner-207 kernel: [24560.604387] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 12:13:06 juju-e4d256-prod-github-runner-207 kernel: [24560.605249] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 12:13:06 juju-e4d256-prod-github-runner-207 kernel: [24560.606064] ? __seccomp_filter+0x4a/0x4a0 Aug 22 12:13:06 juju-e4d256-prod-github-runner-207 kernel: [24560.606846] ? __fget_files+0x86/0xc0 Aug 22 12:13:06 juju-e4d256-prod-github-runner-207 kernel: [24560.607561] __x64_sys_ioctl+0x95/0xd0 Aug 22 12:13:06 juju-e4d256-prod-github-runner-207 kernel: [24560.608271] do_syscall_64+0x5c/0xc0 Aug 22 12:13:06 juju-e4d256-prod-github-runner-207 kernel: [24560.608946] ? do_futex+0x162/0x1f0 Aug 22 12:13:06 juju-e4d256-prod-github-runner-207 kernel: [24560.609599] ? __x64_sys_futex+0x78/0x1e0 Aug 22 12:13:06 juju-e4d256-prod-github-runner-207 kernel: [24560.610297] ? __secure_computing+0xa9/0x120 Aug 22 12:13:06 juju-e4d256-prod-github-runner-207 kernel: [24560.610986] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 12:13:06 juju-e4d256-prod-github-runner-207 kernel: [24560.611746] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:13:06 juju-e4d256-prod-github-runner-207 kernel: [24560.612466] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:13:06 juju-e4d256-prod-github-runner-207 kernel: [24560.613186] ? do_syscall_64+0x69/0xc0 Aug 22 12:13:06 juju-e4d256-prod-github-runner-207 kernel: [24560.613846] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:13:06 juju-e4d256-prod-github-runner-207 kernel: [24560.614555] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:13:06 juju-e4d256-prod-github-runner-207 kernel: [24560.615250] ? do_syscall_64+0x69/0xc0 Aug 22 12:13:06 juju-e4d256-prod-github-runner-207 kernel: [24560.615879] ? do_syscall_64+0x69/0xc0 Aug 22 12:13:06 juju-e4d256-prod-github-runner-207 kernel: [24560.616500] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 12:13:06 juju-e4d256-prod-github-runner-207 kernel: [24560.617222] RIP: 0033:0x7faa5d0edaff Aug 22 12:13:06 juju-e4d256-prod-github-runner-207 kernel: [24560.617886] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 12:13:06 juju-e4d256-prod-github-runner-207 kernel: [24560.619917] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 12:13:06 juju-e4d256-prod-github-runner-207 kernel: [24560.620837] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 12:13:06 juju-e4d256-prod-github-runner-207 kernel: [24560.621753] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 12:13:06 juju-e4d256-prod-github-runner-207 kernel: [24560.622637] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 12:13:06 juju-e4d256-prod-github-runner-207 kernel: [24560.623518] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 12:13:06 juju-e4d256-prod-github-runner-207 kernel: [24560.624399] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 12:13:06 juju-e4d256-prod-github-runner-207 kernel: [24560.625291] Aug 22 12:13:34 juju-e4d256-prod-github-runner-207 kernel: [24588.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 22791s! [qemu-system-x86:6715] Aug 22 12:13:34 juju-e4d256-prod-github-runner-207 kernel: [24588.543895] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 12:13:34 juju-e4d256-prod-github-runner-207 kernel: [24588.544213] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 12:13:34 juju-e4d256-prod-github-runner-207 kernel: [24588.556266] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 12:13:34 juju-e4d256-prod-github-runner-207 kernel: [24588.557548] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 12:13:34 juju-e4d256-prod-github-runner-207 kernel: [24588.558785] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:13:34 juju-e4d256-prod-github-runner-207 kernel: [24588.559843] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 12:13:34 juju-e4d256-prod-github-runner-207 kernel: [24588.562392] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 12:13:34 juju-e4d256-prod-github-runner-207 kernel: [24588.563441] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 12:13:34 juju-e4d256-prod-github-runner-207 kernel: [24588.564601] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 12:13:34 juju-e4d256-prod-github-runner-207 kernel: [24588.565776] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 12:13:34 juju-e4d256-prod-github-runner-207 kernel: [24588.566934] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 12:13:34 juju-e4d256-prod-github-runner-207 kernel: [24588.568101] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 12:13:34 juju-e4d256-prod-github-runner-207 kernel: [24588.569265] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 12:13:34 juju-e4d256-prod-github-runner-207 kernel: [24588.570519] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 12:13:34 juju-e4d256-prod-github-runner-207 kernel: [24588.571619] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 12:13:34 juju-e4d256-prod-github-runner-207 kernel: [24588.572808] Call Trace: Aug 22 12:13:34 juju-e4d256-prod-github-runner-207 kernel: [24588.573728] Aug 22 12:13:34 juju-e4d256-prod-github-runner-207 kernel: [24588.574648] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:13:34 juju-e4d256-prod-github-runner-207 kernel: [24588.575686] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:13:34 juju-e4d256-prod-github-runner-207 kernel: [24588.576762] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:13:34 juju-e4d256-prod-github-runner-207 kernel: [24588.577873] ? show_regs.part.0+0x23/0x29 Aug 22 12:13:34 juju-e4d256-prod-github-runner-207 kernel: [24588.578873] ? show_regs.cold+0x8/0xd Aug 22 12:13:34 juju-e4d256-prod-github-runner-207 kernel: [24588.579886] ? watchdog_timer_fn+0x1be/0x220 Aug 22 12:13:34 juju-e4d256-prod-github-runner-207 kernel: [24588.580915] ? lockup_detector_update_enable+0x60/0x60 Aug 22 12:13:34 juju-e4d256-prod-github-runner-207 kernel: [24588.582025] ? __hrtimer_run_queues+0x107/0x230 Aug 22 12:13:34 juju-e4d256-prod-github-runner-207 kernel: [24588.583054] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 12:13:34 juju-e4d256-prod-github-runner-207 kernel: [24588.584076] ? hrtimer_interrupt+0x101/0x220 Aug 22 12:13:34 juju-e4d256-prod-github-runner-207 kernel: [24588.585092] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 12:13:34 juju-e4d256-prod-github-runner-207 kernel: [24588.586181] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 12:13:34 juju-e4d256-prod-github-runner-207 kernel: [24588.587240] Aug 22 12:13:34 juju-e4d256-prod-github-runner-207 kernel: [24588.588105] Aug 22 12:13:34 juju-e4d256-prod-github-runner-207 kernel: [24588.588955] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 12:13:34 juju-e4d256-prod-github-runner-207 kernel: [24588.590010] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:13:34 juju-e4d256-prod-github-runner-207 kernel: [24588.591052] ? _raw_spin_lock+0x22/0x30 Aug 22 12:13:34 juju-e4d256-prod-github-runner-207 kernel: [24588.592132] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:13:34 juju-e4d256-prod-github-runner-207 kernel: [24588.593212] direct_page_fault+0x206/0x310 [kvm] Aug 22 12:13:34 juju-e4d256-prod-github-runner-207 kernel: [24588.594464] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 12:13:34 juju-e4d256-prod-github-runner-207 kernel: [24588.595505] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 12:13:34 juju-e4d256-prod-github-runner-207 kernel: [24588.596509] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 12:13:34 juju-e4d256-prod-github-runner-207 kernel: [24588.597538] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 12:13:34 juju-e4d256-prod-github-runner-207 kernel: [24588.598488] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 12:13:34 juju-e4d256-prod-github-runner-207 kernel: [24588.599473] handle_exit+0x98/0x230 [kvm_amd] Aug 22 12:13:34 juju-e4d256-prod-github-runner-207 kernel: [24588.600367] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 12:13:34 juju-e4d256-prod-github-runner-207 kernel: [24588.601283] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 12:13:34 juju-e4d256-prod-github-runner-207 kernel: [24588.602269] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 12:13:34 juju-e4d256-prod-github-runner-207 kernel: [24588.603172] vcpu_run+0x62/0x2c0 [kvm] Aug 22 12:13:34 juju-e4d256-prod-github-runner-207 kernel: [24588.603983] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 12:13:34 juju-e4d256-prod-github-runner-207 kernel: [24588.604791] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 12:13:34 juju-e4d256-prod-github-runner-207 kernel: [24588.605666] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 12:13:34 juju-e4d256-prod-github-runner-207 kernel: [24588.606469] ? __seccomp_filter+0x4a/0x4a0 Aug 22 12:13:34 juju-e4d256-prod-github-runner-207 kernel: [24588.607212] ? __fget_files+0x86/0xc0 Aug 22 12:13:34 juju-e4d256-prod-github-runner-207 kernel: [24588.607915] __x64_sys_ioctl+0x95/0xd0 Aug 22 12:13:34 juju-e4d256-prod-github-runner-207 kernel: [24588.608608] do_syscall_64+0x5c/0xc0 Aug 22 12:13:34 juju-e4d256-prod-github-runner-207 kernel: [24588.609279] ? do_futex+0x162/0x1f0 Aug 22 12:13:34 juju-e4d256-prod-github-runner-207 kernel: [24588.609934] ? __x64_sys_futex+0x78/0x1e0 Aug 22 12:13:34 juju-e4d256-prod-github-runner-207 kernel: [24588.610606] ? __secure_computing+0xa9/0x120 Aug 22 12:13:34 juju-e4d256-prod-github-runner-207 kernel: [24588.611300] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 12:13:34 juju-e4d256-prod-github-runner-207 kernel: [24588.612058] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:13:34 juju-e4d256-prod-github-runner-207 kernel: [24588.612805] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:13:34 juju-e4d256-prod-github-runner-207 kernel: [24588.613540] ? do_syscall_64+0x69/0xc0 Aug 22 12:13:34 juju-e4d256-prod-github-runner-207 kernel: [24588.614188] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:13:34 juju-e4d256-prod-github-runner-207 kernel: [24588.614892] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:13:34 juju-e4d256-prod-github-runner-207 kernel: [24588.615595] ? do_syscall_64+0x69/0xc0 Aug 22 12:13:34 juju-e4d256-prod-github-runner-207 kernel: [24588.616225] ? do_syscall_64+0x69/0xc0 Aug 22 12:13:34 juju-e4d256-prod-github-runner-207 kernel: [24588.616877] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 12:13:34 juju-e4d256-prod-github-runner-207 kernel: [24588.617636] RIP: 0033:0x7faa5d0edaff Aug 22 12:13:34 juju-e4d256-prod-github-runner-207 kernel: [24588.618300] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 12:13:34 juju-e4d256-prod-github-runner-207 kernel: [24588.620310] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 12:13:34 juju-e4d256-prod-github-runner-207 kernel: [24588.621240] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 12:13:34 juju-e4d256-prod-github-runner-207 kernel: [24588.622167] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 12:13:34 juju-e4d256-prod-github-runner-207 kernel: [24588.623058] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 12:13:34 juju-e4d256-prod-github-runner-207 kernel: [24588.623949] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 12:13:34 juju-e4d256-prod-github-runner-207 kernel: [24588.624840] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 12:13:34 juju-e4d256-prod-github-runner-207 kernel: [24588.625757] Aug 22 12:14:02 juju-e4d256-prod-github-runner-207 kernel: [24616.541980] watchdog: BUG: soft lockup - CPU#1 stuck for 22817s! [qemu-system-x86:6715] Aug 22 12:14:02 juju-e4d256-prod-github-runner-207 kernel: [24616.543103] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 12:14:02 juju-e4d256-prod-github-runner-207 kernel: [24616.543178] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 12:14:02 juju-e4d256-prod-github-runner-207 kernel: [24616.555499] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 12:14:02 juju-e4d256-prod-github-runner-207 kernel: [24616.556771] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 12:14:02 juju-e4d256-prod-github-runner-207 kernel: [24616.558015] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:14:02 juju-e4d256-prod-github-runner-207 kernel: [24616.559072] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 12:14:02 juju-e4d256-prod-github-runner-207 kernel: [24616.561638] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 12:14:02 juju-e4d256-prod-github-runner-207 kernel: [24616.562686] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 12:14:02 juju-e4d256-prod-github-runner-207 kernel: [24616.563851] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 12:14:02 juju-e4d256-prod-github-runner-207 kernel: [24616.565082] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 12:14:02 juju-e4d256-prod-github-runner-207 kernel: [24616.566318] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 12:14:02 juju-e4d256-prod-github-runner-207 kernel: [24616.567505] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 12:14:02 juju-e4d256-prod-github-runner-207 kernel: [24616.568691] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 12:14:02 juju-e4d256-prod-github-runner-207 kernel: [24616.569965] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 12:14:02 juju-e4d256-prod-github-runner-207 kernel: [24616.571109] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 12:14:02 juju-e4d256-prod-github-runner-207 kernel: [24616.572360] Call Trace: Aug 22 12:14:02 juju-e4d256-prod-github-runner-207 kernel: [24616.573312] Aug 22 12:14:02 juju-e4d256-prod-github-runner-207 kernel: [24616.574217] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:14:02 juju-e4d256-prod-github-runner-207 kernel: [24616.575274] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:14:02 juju-e4d256-prod-github-runner-207 kernel: [24616.576296] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:14:02 juju-e4d256-prod-github-runner-207 kernel: [24616.577421] ? show_regs.part.0+0x23/0x29 Aug 22 12:14:02 juju-e4d256-prod-github-runner-207 kernel: [24616.578436] ? show_regs.cold+0x8/0xd Aug 22 12:14:02 juju-e4d256-prod-github-runner-207 kernel: [24616.579433] ? watchdog_timer_fn+0x1be/0x220 Aug 22 12:14:02 juju-e4d256-prod-github-runner-207 kernel: [24616.580509] ? lockup_detector_update_enable+0x60/0x60 Aug 22 12:14:02 juju-e4d256-prod-github-runner-207 kernel: [24616.581611] ? __hrtimer_run_queues+0x107/0x230 Aug 22 12:14:02 juju-e4d256-prod-github-runner-207 kernel: [24616.582681] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 12:14:02 juju-e4d256-prod-github-runner-207 kernel: [24616.583730] ? hrtimer_interrupt+0x101/0x220 Aug 22 12:14:02 juju-e4d256-prod-github-runner-207 kernel: [24616.584782] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 12:14:02 juju-e4d256-prod-github-runner-207 kernel: [24616.585887] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 12:14:02 juju-e4d256-prod-github-runner-207 kernel: [24616.586966] Aug 22 12:14:02 juju-e4d256-prod-github-runner-207 kernel: [24616.587833] Aug 22 12:14:02 juju-e4d256-prod-github-runner-207 kernel: [24616.588716] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 12:14:02 juju-e4d256-prod-github-runner-207 kernel: [24616.589789] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:14:02 juju-e4d256-prod-github-runner-207 kernel: [24616.590866] ? _raw_spin_lock+0x22/0x30 Aug 22 12:14:02 juju-e4d256-prod-github-runner-207 kernel: [24616.591843] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:14:02 juju-e4d256-prod-github-runner-207 kernel: [24616.592878] direct_page_fault+0x206/0x310 [kvm] Aug 22 12:14:02 juju-e4d256-prod-github-runner-207 kernel: [24616.593968] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 12:14:02 juju-e4d256-prod-github-runner-207 kernel: [24616.595010] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 12:14:02 juju-e4d256-prod-github-runner-207 kernel: [24616.596049] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 12:14:02 juju-e4d256-prod-github-runner-207 kernel: [24616.597120] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 12:14:02 juju-e4d256-prod-github-runner-207 kernel: [24616.598087] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 12:14:02 juju-e4d256-prod-github-runner-207 kernel: [24616.599091] handle_exit+0x98/0x230 [kvm_amd] Aug 22 12:14:02 juju-e4d256-prod-github-runner-207 kernel: [24616.600022] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 12:14:02 juju-e4d256-prod-github-runner-207 kernel: [24616.600955] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 12:14:02 juju-e4d256-prod-github-runner-207 kernel: [24616.601911] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 12:14:02 juju-e4d256-prod-github-runner-207 kernel: [24616.602834] vcpu_run+0x62/0x2c0 [kvm] Aug 22 12:14:02 juju-e4d256-prod-github-runner-207 kernel: [24616.603651] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 12:14:02 juju-e4d256-prod-github-runner-207 kernel: [24616.604458] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 12:14:02 juju-e4d256-prod-github-runner-207 kernel: [24616.605344] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 12:14:02 juju-e4d256-prod-github-runner-207 kernel: [24616.606141] ? __seccomp_filter+0x4a/0x4a0 Aug 22 12:14:02 juju-e4d256-prod-github-runner-207 kernel: [24616.606883] ? __fget_files+0x86/0xc0 Aug 22 12:14:02 juju-e4d256-prod-github-runner-207 kernel: [24616.607587] __x64_sys_ioctl+0x95/0xd0 Aug 22 12:14:02 juju-e4d256-prod-github-runner-207 kernel: [24616.608291] do_syscall_64+0x5c/0xc0 Aug 22 12:14:02 juju-e4d256-prod-github-runner-207 kernel: [24616.608974] ? do_futex+0x162/0x1f0 Aug 22 12:14:02 juju-e4d256-prod-github-runner-207 kernel: [24616.609657] ? __x64_sys_futex+0x78/0x1e0 Aug 22 12:14:02 juju-e4d256-prod-github-runner-207 kernel: [24616.610335] ? __secure_computing+0xa9/0x120 Aug 22 12:14:02 juju-e4d256-prod-github-runner-207 kernel: [24616.611053] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 12:14:02 juju-e4d256-prod-github-runner-207 kernel: [24616.611856] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:14:02 juju-e4d256-prod-github-runner-207 kernel: [24616.612588] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:14:02 juju-e4d256-prod-github-runner-207 kernel: [24616.613356] ? do_syscall_64+0x69/0xc0 Aug 22 12:14:02 juju-e4d256-prod-github-runner-207 kernel: [24616.614056] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:14:02 juju-e4d256-prod-github-runner-207 kernel: [24616.614783] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:14:02 juju-e4d256-prod-github-runner-207 kernel: [24616.615506] ? do_syscall_64+0x69/0xc0 Aug 22 12:14:02 juju-e4d256-prod-github-runner-207 kernel: [24616.616147] ? do_syscall_64+0x69/0xc0 Aug 22 12:14:02 juju-e4d256-prod-github-runner-207 kernel: [24616.616799] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 12:14:02 juju-e4d256-prod-github-runner-207 kernel: [24616.617563] RIP: 0033:0x7faa5d0edaff Aug 22 12:14:02 juju-e4d256-prod-github-runner-207 kernel: [24616.618215] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 12:14:02 juju-e4d256-prod-github-runner-207 kernel: [24616.620229] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 12:14:02 juju-e4d256-prod-github-runner-207 kernel: [24616.621186] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 12:14:02 juju-e4d256-prod-github-runner-207 kernel: [24616.622289] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 12:14:02 juju-e4d256-prod-github-runner-207 kernel: [24616.623778] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 12:14:02 juju-e4d256-prod-github-runner-207 kernel: [24616.624992] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 12:14:02 juju-e4d256-prod-github-runner-207 kernel: [24616.626034] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 12:14:02 juju-e4d256-prod-github-runner-207 kernel: [24616.627046] Aug 22 12:14:30 juju-e4d256-prod-github-runner-207 kernel: [24644.541981] watchdog: BUG: soft lockup - CPU#1 stuck for 22844s! [qemu-system-x86:6715] Aug 22 12:14:30 juju-e4d256-prod-github-runner-207 kernel: [24644.543199] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 12:14:30 juju-e4d256-prod-github-runner-207 kernel: [24644.543381] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 12:14:30 juju-e4d256-prod-github-runner-207 kernel: [24644.555422] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 12:14:30 juju-e4d256-prod-github-runner-207 kernel: [24644.556702] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 12:14:30 juju-e4d256-prod-github-runner-207 kernel: [24644.557926] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:14:30 juju-e4d256-prod-github-runner-207 kernel: [24644.558988] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 12:14:30 juju-e4d256-prod-github-runner-207 kernel: [24644.561541] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 12:14:30 juju-e4d256-prod-github-runner-207 kernel: [24644.562741] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 12:14:30 juju-e4d256-prod-github-runner-207 kernel: [24644.563902] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 12:14:30 juju-e4d256-prod-github-runner-207 kernel: [24644.565082] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 12:14:30 juju-e4d256-prod-github-runner-207 kernel: [24644.566243] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 12:14:30 juju-e4d256-prod-github-runner-207 kernel: [24644.567404] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 12:14:30 juju-e4d256-prod-github-runner-207 kernel: [24644.568570] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 12:14:30 juju-e4d256-prod-github-runner-207 kernel: [24644.569817] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 12:14:30 juju-e4d256-prod-github-runner-207 kernel: [24644.570988] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 12:14:30 juju-e4d256-prod-github-runner-207 kernel: [24644.572305] Call Trace: Aug 22 12:14:30 juju-e4d256-prod-github-runner-207 kernel: [24644.573237] Aug 22 12:14:30 juju-e4d256-prod-github-runner-207 kernel: [24644.574122] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:14:30 juju-e4d256-prod-github-runner-207 kernel: [24644.575155] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:14:30 juju-e4d256-prod-github-runner-207 kernel: [24644.576180] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:14:30 juju-e4d256-prod-github-runner-207 kernel: [24644.577306] ? show_regs.part.0+0x23/0x29 Aug 22 12:14:30 juju-e4d256-prod-github-runner-207 kernel: [24644.578307] ? show_regs.cold+0x8/0xd Aug 22 12:14:30 juju-e4d256-prod-github-runner-207 kernel: [24644.579278] ? watchdog_timer_fn+0x1be/0x220 Aug 22 12:14:30 juju-e4d256-prod-github-runner-207 kernel: [24644.580300] ? lockup_detector_update_enable+0x60/0x60 Aug 22 12:14:30 juju-e4d256-prod-github-runner-207 kernel: [24644.581380] ? __hrtimer_run_queues+0x107/0x230 Aug 22 12:14:30 juju-e4d256-prod-github-runner-207 kernel: [24644.582488] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 12:14:30 juju-e4d256-prod-github-runner-207 kernel: [24644.583530] ? hrtimer_interrupt+0x101/0x220 Aug 22 12:14:30 juju-e4d256-prod-github-runner-207 kernel: [24644.584554] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 12:14:30 juju-e4d256-prod-github-runner-207 kernel: [24644.585638] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 12:14:30 juju-e4d256-prod-github-runner-207 kernel: [24644.586684] Aug 22 12:14:30 juju-e4d256-prod-github-runner-207 kernel: [24644.587539] Aug 22 12:14:30 juju-e4d256-prod-github-runner-207 kernel: [24644.588386] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 12:14:30 juju-e4d256-prod-github-runner-207 kernel: [24644.589487] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:14:30 juju-e4d256-prod-github-runner-207 kernel: [24644.590547] ? _raw_spin_lock+0x22/0x30 Aug 22 12:14:30 juju-e4d256-prod-github-runner-207 kernel: [24644.591493] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:14:30 juju-e4d256-prod-github-runner-207 kernel: [24644.592510] direct_page_fault+0x206/0x310 [kvm] Aug 22 12:14:30 juju-e4d256-prod-github-runner-207 kernel: [24644.593554] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 12:14:30 juju-e4d256-prod-github-runner-207 kernel: [24644.594563] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 12:14:30 juju-e4d256-prod-github-runner-207 kernel: [24644.595565] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 12:14:30 juju-e4d256-prod-github-runner-207 kernel: [24644.596567] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 12:14:30 juju-e4d256-prod-github-runner-207 kernel: [24644.597527] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 12:14:30 juju-e4d256-prod-github-runner-207 kernel: [24644.598507] handle_exit+0x98/0x230 [kvm_amd] Aug 22 12:14:30 juju-e4d256-prod-github-runner-207 kernel: [24644.599398] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 12:14:30 juju-e4d256-prod-github-runner-207 kernel: [24644.600360] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 12:14:30 juju-e4d256-prod-github-runner-207 kernel: [24644.601306] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 12:14:30 juju-e4d256-prod-github-runner-207 kernel: [24644.602265] vcpu_run+0x62/0x2c0 [kvm] Aug 22 12:14:30 juju-e4d256-prod-github-runner-207 kernel: [24644.603086] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 12:14:30 juju-e4d256-prod-github-runner-207 kernel: [24644.603894] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 12:14:30 juju-e4d256-prod-github-runner-207 kernel: [24644.604760] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 12:14:30 juju-e4d256-prod-github-runner-207 kernel: [24644.605575] ? __seccomp_filter+0x4a/0x4a0 Aug 22 12:14:30 juju-e4d256-prod-github-runner-207 kernel: [24644.606325] ? __fget_files+0x86/0xc0 Aug 22 12:14:30 juju-e4d256-prod-github-runner-207 kernel: [24644.607047] __x64_sys_ioctl+0x95/0xd0 Aug 22 12:14:30 juju-e4d256-prod-github-runner-207 kernel: [24644.607753] do_syscall_64+0x5c/0xc0 Aug 22 12:14:30 juju-e4d256-prod-github-runner-207 kernel: [24644.608419] ? do_futex+0x162/0x1f0 Aug 22 12:14:30 juju-e4d256-prod-github-runner-207 kernel: [24644.609086] ? __x64_sys_futex+0x78/0x1e0 Aug 22 12:14:30 juju-e4d256-prod-github-runner-207 kernel: [24644.609759] ? __secure_computing+0xa9/0x120 Aug 22 12:14:30 juju-e4d256-prod-github-runner-207 kernel: [24644.610448] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 12:14:30 juju-e4d256-prod-github-runner-207 kernel: [24644.611205] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:14:30 juju-e4d256-prod-github-runner-207 kernel: [24644.611924] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:14:30 juju-e4d256-prod-github-runner-207 kernel: [24644.612639] ? do_syscall_64+0x69/0xc0 Aug 22 12:14:30 juju-e4d256-prod-github-runner-207 kernel: [24644.613331] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:14:30 juju-e4d256-prod-github-runner-207 kernel: [24644.614045] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:14:30 juju-e4d256-prod-github-runner-207 kernel: [24644.614739] ? do_syscall_64+0x69/0xc0 Aug 22 12:14:30 juju-e4d256-prod-github-runner-207 kernel: [24644.615369] ? do_syscall_64+0x69/0xc0 Aug 22 12:14:30 juju-e4d256-prod-github-runner-207 kernel: [24644.615994] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 12:14:30 juju-e4d256-prod-github-runner-207 kernel: [24644.616718] RIP: 0033:0x7faa5d0edaff Aug 22 12:14:30 juju-e4d256-prod-github-runner-207 kernel: [24644.617343] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 12:14:30 juju-e4d256-prod-github-runner-207 kernel: [24644.619326] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 12:14:30 juju-e4d256-prod-github-runner-207 kernel: [24644.620233] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 12:14:30 juju-e4d256-prod-github-runner-207 kernel: [24644.621136] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 12:14:30 juju-e4d256-prod-github-runner-207 kernel: [24644.622028] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 12:14:30 juju-e4d256-prod-github-runner-207 kernel: [24644.622918] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 12:14:30 juju-e4d256-prod-github-runner-207 kernel: [24644.623809] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 12:14:30 juju-e4d256-prod-github-runner-207 kernel: [24644.624709] Aug 22 12:14:44 juju-e4d256-prod-github-runner-207 kernel: [24658.832705] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 12:14:44 juju-e4d256-prod-github-runner-207 kernel: [24658.834429] rcu: 1-....: (6116265 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=2960069 Aug 22 12:14:44 juju-e4d256-prod-github-runner-207 kernel: [24658.835628] (t=6135408 jiffies g=23269 q=29424) Aug 22 12:14:44 juju-e4d256-prod-github-runner-207 kernel: [24658.836427] NMI backtrace for cpu 1 Aug 22 12:14:44 juju-e4d256-prod-github-runner-207 kernel: [24658.837218] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 12:14:44 juju-e4d256-prod-github-runner-207 kernel: [24658.838334] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 12:14:44 juju-e4d256-prod-github-runner-207 kernel: [24658.839398] Call Trace: Aug 22 12:14:44 juju-e4d256-prod-github-runner-207 kernel: [24658.840074] Aug 22 12:14:44 juju-e4d256-prod-github-runner-207 kernel: [24658.840754] show_stack+0x52/0x5c Aug 22 12:14:44 juju-e4d256-prod-github-runner-207 kernel: [24658.841478] dump_stack_lvl+0x4a/0x63 Aug 22 12:14:44 juju-e4d256-prod-github-runner-207 kernel: [24658.842249] dump_stack+0x10/0x16 Aug 22 12:14:44 juju-e4d256-prod-github-runner-207 kernel: [24658.843012] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 12:14:44 juju-e4d256-prod-github-runner-207 kernel: [24658.843811] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 12:14:44 juju-e4d256-prod-github-runner-207 kernel: [24658.844625] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 12:14:44 juju-e4d256-prod-github-runner-207 kernel: [24658.845452] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 12:14:44 juju-e4d256-prod-github-runner-207 kernel: [24658.846275] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 12:14:44 juju-e4d256-prod-github-runner-207 kernel: [24658.847082] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 12:14:44 juju-e4d256-prod-github-runner-207 kernel: [24658.847895] print_cpu_stall.cold+0x2f/0xe2 Aug 22 12:14:44 juju-e4d256-prod-github-runner-207 kernel: [24658.848679] ? timekeeping_update+0xf7/0x150 Aug 22 12:14:44 juju-e4d256-prod-github-runner-207 kernel: [24658.849454] check_cpu_stall+0x109/0x270 Aug 22 12:14:44 juju-e4d256-prod-github-runner-207 kernel: [24658.850199] rcu_sched_clock_irq+0x9a/0x250 Aug 22 12:14:44 juju-e4d256-prod-github-runner-207 kernel: [24658.850975] update_process_times+0x94/0xd0 Aug 22 12:14:44 juju-e4d256-prod-github-runner-207 kernel: [24658.851774] tick_sched_handle+0x29/0x70 Aug 22 12:14:44 juju-e4d256-prod-github-runner-207 kernel: [24658.852567] tick_sched_timer+0x8c/0xc0 Aug 22 12:14:44 juju-e4d256-prod-github-runner-207 kernel: [24658.853319] ? tick_nohz_handler+0xb0/0xb0 Aug 22 12:14:44 juju-e4d256-prod-github-runner-207 kernel: [24658.854085] __hrtimer_run_queues+0x107/0x230 Aug 22 12:14:44 juju-e4d256-prod-github-runner-207 kernel: [24658.854891] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 12:14:44 juju-e4d256-prod-github-runner-207 kernel: [24658.855676] hrtimer_interrupt+0x101/0x220 Aug 22 12:14:44 juju-e4d256-prod-github-runner-207 kernel: [24658.856437] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 12:14:44 juju-e4d256-prod-github-runner-207 kernel: [24658.857264] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 12:14:44 juju-e4d256-prod-github-runner-207 kernel: [24658.858071] Aug 22 12:14:44 juju-e4d256-prod-github-runner-207 kernel: [24658.858703] Aug 22 12:14:44 juju-e4d256-prod-github-runner-207 kernel: [24658.859332] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 12:14:44 juju-e4d256-prod-github-runner-207 kernel: [24658.860147] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:14:44 juju-e4d256-prod-github-runner-207 kernel: [24658.861035] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 12:14:44 juju-e4d256-prod-github-runner-207 kernel: [24658.863229] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 12:14:44 juju-e4d256-prod-github-runner-207 kernel: [24658.864104] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 12:14:44 juju-e4d256-prod-github-runner-207 kernel: [24658.865179] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 12:14:44 juju-e4d256-prod-github-runner-207 kernel: [24658.866189] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 12:14:44 juju-e4d256-prod-github-runner-207 kernel: [24658.867170] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 12:14:44 juju-e4d256-prod-github-runner-207 kernel: [24658.868136] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 12:14:44 juju-e4d256-prod-github-runner-207 kernel: [24658.869113] ? _raw_spin_lock+0x22/0x30 Aug 22 12:14:44 juju-e4d256-prod-github-runner-207 kernel: [24658.869874] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:14:44 juju-e4d256-prod-github-runner-207 kernel: [24658.870710] direct_page_fault+0x206/0x310 [kvm] Aug 22 12:14:44 juju-e4d256-prod-github-runner-207 kernel: [24658.871556] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 12:14:44 juju-e4d256-prod-github-runner-207 kernel: [24658.872571] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 12:14:44 juju-e4d256-prod-github-runner-207 kernel: [24658.873473] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 12:14:44 juju-e4d256-prod-github-runner-207 kernel: [24658.874312] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 12:14:44 juju-e4d256-prod-github-runner-207 kernel: [24658.875150] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 12:14:44 juju-e4d256-prod-github-runner-207 kernel: [24658.876015] handle_exit+0x98/0x230 [kvm_amd] Aug 22 12:14:44 juju-e4d256-prod-github-runner-207 kernel: [24658.876785] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 12:14:44 juju-e4d256-prod-github-runner-207 kernel: [24658.877598] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 12:14:44 juju-e4d256-prod-github-runner-207 kernel: [24658.878401] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 12:14:44 juju-e4d256-prod-github-runner-207 kernel: [24658.879306] vcpu_run+0x62/0x2c0 [kvm] Aug 22 12:14:44 juju-e4d256-prod-github-runner-207 kernel: [24658.880091] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 12:14:44 juju-e4d256-prod-github-runner-207 kernel: [24658.880945] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 12:14:44 juju-e4d256-prod-github-runner-207 kernel: [24658.881853] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 12:14:44 juju-e4d256-prod-github-runner-207 kernel: [24658.882648] ? __seccomp_filter+0x4a/0x4a0 Aug 22 12:14:44 juju-e4d256-prod-github-runner-207 kernel: [24658.883379] ? __fget_files+0x86/0xc0 Aug 22 12:14:44 juju-e4d256-prod-github-runner-207 kernel: [24658.884072] __x64_sys_ioctl+0x95/0xd0 Aug 22 12:14:44 juju-e4d256-prod-github-runner-207 kernel: [24658.884788] do_syscall_64+0x5c/0xc0 Aug 22 12:14:44 juju-e4d256-prod-github-runner-207 kernel: [24658.885473] ? do_futex+0x162/0x1f0 Aug 22 12:14:44 juju-e4d256-prod-github-runner-207 kernel: [24658.886166] ? __x64_sys_futex+0x78/0x1e0 Aug 22 12:14:44 juju-e4d256-prod-github-runner-207 kernel: [24658.886868] ? __secure_computing+0xa9/0x120 Aug 22 12:14:44 juju-e4d256-prod-github-runner-207 kernel: [24658.887586] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 12:14:44 juju-e4d256-prod-github-runner-207 kernel: [24658.888375] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:14:44 juju-e4d256-prod-github-runner-207 kernel: [24658.889146] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:14:44 juju-e4d256-prod-github-runner-207 kernel: [24658.889941] ? do_syscall_64+0x69/0xc0 Aug 22 12:14:44 juju-e4d256-prod-github-runner-207 kernel: [24658.890660] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:14:44 juju-e4d256-prod-github-runner-207 kernel: [24658.891423] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:14:44 juju-e4d256-prod-github-runner-207 kernel: [24658.892177] ? do_syscall_64+0x69/0xc0 Aug 22 12:14:44 juju-e4d256-prod-github-runner-207 kernel: [24658.892896] ? do_syscall_64+0x69/0xc0 Aug 22 12:14:44 juju-e4d256-prod-github-runner-207 kernel: [24658.893584] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 12:14:44 juju-e4d256-prod-github-runner-207 kernel: [24658.894353] RIP: 0033:0x7faa5d0edaff Aug 22 12:14:44 juju-e4d256-prod-github-runner-207 kernel: [24658.895083] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 12:14:44 juju-e4d256-prod-github-runner-207 kernel: [24658.897231] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 12:14:44 juju-e4d256-prod-github-runner-207 kernel: [24658.898194] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 12:14:44 juju-e4d256-prod-github-runner-207 kernel: [24658.899168] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 12:14:44 juju-e4d256-prod-github-runner-207 kernel: [24658.900138] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 12:14:44 juju-e4d256-prod-github-runner-207 kernel: [24658.901097] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 12:14:44 juju-e4d256-prod-github-runner-207 kernel: [24658.902036] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 12:14:44 juju-e4d256-prod-github-runner-207 kernel: [24658.902952] Aug 22 12:15:10 juju-e4d256-prod-github-runner-207 kernel: [24684.541976] watchdog: BUG: soft lockup - CPU#1 stuck for 22881s! [qemu-system-x86:6715] Aug 22 12:15:10 juju-e4d256-prod-github-runner-207 kernel: [24684.543103] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 12:15:10 juju-e4d256-prod-github-runner-207 kernel: [24684.543415] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 12:15:10 juju-e4d256-prod-github-runner-207 kernel: [24684.557609] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 12:15:10 juju-e4d256-prod-github-runner-207 kernel: [24684.558883] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 12:15:10 juju-e4d256-prod-github-runner-207 kernel: [24684.560101] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:15:10 juju-e4d256-prod-github-runner-207 kernel: [24684.561194] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 12:15:10 juju-e4d256-prod-github-runner-207 kernel: [24684.563787] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 12:15:10 juju-e4d256-prod-github-runner-207 kernel: [24684.564855] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 12:15:10 juju-e4d256-prod-github-runner-207 kernel: [24684.566052] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 12:15:10 juju-e4d256-prod-github-runner-207 kernel: [24684.567258] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 12:15:10 juju-e4d256-prod-github-runner-207 kernel: [24684.568447] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 12:15:10 juju-e4d256-prod-github-runner-207 kernel: [24684.569615] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 12:15:10 juju-e4d256-prod-github-runner-207 kernel: [24684.570800] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 12:15:10 juju-e4d256-prod-github-runner-207 kernel: [24684.572072] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 12:15:10 juju-e4d256-prod-github-runner-207 kernel: [24684.573199] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 12:15:10 juju-e4d256-prod-github-runner-207 kernel: [24684.574391] Call Trace: Aug 22 12:15:10 juju-e4d256-prod-github-runner-207 kernel: [24684.575306] Aug 22 12:15:10 juju-e4d256-prod-github-runner-207 kernel: [24684.576219] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:15:10 juju-e4d256-prod-github-runner-207 kernel: [24684.577301] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:15:10 juju-e4d256-prod-github-runner-207 kernel: [24684.578339] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:15:10 juju-e4d256-prod-github-runner-207 kernel: [24684.579441] ? show_regs.part.0+0x23/0x29 Aug 22 12:15:10 juju-e4d256-prod-github-runner-207 kernel: [24684.580464] ? show_regs.cold+0x8/0xd Aug 22 12:15:10 juju-e4d256-prod-github-runner-207 kernel: [24684.581472] ? watchdog_timer_fn+0x1be/0x220 Aug 22 12:15:10 juju-e4d256-prod-github-runner-207 kernel: [24684.582658] ? lockup_detector_update_enable+0x60/0x60 Aug 22 12:15:10 juju-e4d256-prod-github-runner-207 kernel: [24684.583773] ? __hrtimer_run_queues+0x107/0x230 Aug 22 12:15:10 juju-e4d256-prod-github-runner-207 kernel: [24684.584914] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 12:15:10 juju-e4d256-prod-github-runner-207 kernel: [24684.586218] ? hrtimer_interrupt+0x101/0x220 Aug 22 12:15:10 juju-e4d256-prod-github-runner-207 kernel: [24684.587503] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 12:15:10 juju-e4d256-prod-github-runner-207 kernel: [24684.588927] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 12:15:10 juju-e4d256-prod-github-runner-207 kernel: [24684.590436] Aug 22 12:15:10 juju-e4d256-prod-github-runner-207 kernel: [24684.591654] Aug 22 12:15:10 juju-e4d256-prod-github-runner-207 kernel: [24684.592853] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 12:15:10 juju-e4d256-prod-github-runner-207 kernel: [24684.594206] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:15:10 juju-e4d256-prod-github-runner-207 kernel: [24684.595563] ? _raw_spin_lock+0x22/0x30 Aug 22 12:15:10 juju-e4d256-prod-github-runner-207 kernel: [24684.596859] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:15:10 juju-e4d256-prod-github-runner-207 kernel: [24684.598465] direct_page_fault+0x206/0x310 [kvm] Aug 22 12:15:10 juju-e4d256-prod-github-runner-207 kernel: [24684.600069] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 12:15:10 juju-e4d256-prod-github-runner-207 kernel: [24684.601496] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 12:15:10 juju-e4d256-prod-github-runner-207 kernel: [24684.602725] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 12:15:10 juju-e4d256-prod-github-runner-207 kernel: [24684.603794] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 12:15:10 juju-e4d256-prod-github-runner-207 kernel: [24684.604826] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 12:15:10 juju-e4d256-prod-github-runner-207 kernel: [24684.605812] handle_exit+0x98/0x230 [kvm_amd] Aug 22 12:15:10 juju-e4d256-prod-github-runner-207 kernel: [24684.606716] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 12:15:10 juju-e4d256-prod-github-runner-207 kernel: [24684.607652] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 12:15:10 juju-e4d256-prod-github-runner-207 kernel: [24684.608642] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 12:15:10 juju-e4d256-prod-github-runner-207 kernel: [24684.609650] vcpu_run+0x62/0x2c0 [kvm] Aug 22 12:15:10 juju-e4d256-prod-github-runner-207 kernel: [24684.610476] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 12:15:10 juju-e4d256-prod-github-runner-207 kernel: [24684.611300] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 12:15:10 juju-e4d256-prod-github-runner-207 kernel: [24684.612471] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 12:15:10 juju-e4d256-prod-github-runner-207 kernel: [24684.613345] ? __seccomp_filter+0x4a/0x4a0 Aug 22 12:15:10 juju-e4d256-prod-github-runner-207 kernel: [24684.614105] ? __fget_files+0x86/0xc0 Aug 22 12:15:10 juju-e4d256-prod-github-runner-207 kernel: [24684.614826] __x64_sys_ioctl+0x95/0xd0 Aug 22 12:15:10 juju-e4d256-prod-github-runner-207 kernel: [24684.615676] do_syscall_64+0x5c/0xc0 Aug 22 12:15:10 juju-e4d256-prod-github-runner-207 kernel: [24684.616375] ? do_futex+0x162/0x1f0 Aug 22 12:15:10 juju-e4d256-prod-github-runner-207 kernel: [24684.617032] ? __x64_sys_futex+0x78/0x1e0 Aug 22 12:15:10 juju-e4d256-prod-github-runner-207 kernel: [24684.617711] ? __secure_computing+0xa9/0x120 Aug 22 12:15:10 juju-e4d256-prod-github-runner-207 kernel: [24684.618405] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 12:15:10 juju-e4d256-prod-github-runner-207 kernel: [24684.619269] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:15:10 juju-e4d256-prod-github-runner-207 kernel: [24684.620065] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:15:10 juju-e4d256-prod-github-runner-207 kernel: [24684.620805] ? do_syscall_64+0x69/0xc0 Aug 22 12:15:10 juju-e4d256-prod-github-runner-207 kernel: [24684.621461] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:15:10 juju-e4d256-prod-github-runner-207 kernel: [24684.622166] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:15:10 juju-e4d256-prod-github-runner-207 kernel: [24684.622864] ? do_syscall_64+0x69/0xc0 Aug 22 12:15:10 juju-e4d256-prod-github-runner-207 kernel: [24684.623498] ? do_syscall_64+0x69/0xc0 Aug 22 12:15:10 juju-e4d256-prod-github-runner-207 kernel: [24684.624146] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 12:15:10 juju-e4d256-prod-github-runner-207 kernel: [24684.625013] RIP: 0033:0x7faa5d0edaff Aug 22 12:15:10 juju-e4d256-prod-github-runner-207 kernel: [24684.625674] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 12:15:10 juju-e4d256-prod-github-runner-207 kernel: [24684.627654] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 12:15:10 juju-e4d256-prod-github-runner-207 kernel: [24684.628623] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 12:15:10 juju-e4d256-prod-github-runner-207 kernel: [24684.629528] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 12:15:10 juju-e4d256-prod-github-runner-207 kernel: [24684.630541] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 12:15:10 juju-e4d256-prod-github-runner-207 kernel: [24684.631552] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 12:15:10 juju-e4d256-prod-github-runner-207 kernel: [24684.632500] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 12:15:10 juju-e4d256-prod-github-runner-207 kernel: [24684.633407] Aug 22 12:15:38 juju-e4d256-prod-github-runner-207 kernel: [24712.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 22907s! [qemu-system-x86:6715] Aug 22 12:15:38 juju-e4d256-prod-github-runner-207 kernel: [24712.543120] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 12:15:38 juju-e4d256-prod-github-runner-207 kernel: [24712.543196] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 12:15:38 juju-e4d256-prod-github-runner-207 kernel: [24712.555277] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 12:15:38 juju-e4d256-prod-github-runner-207 kernel: [24712.556552] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 12:15:38 juju-e4d256-prod-github-runner-207 kernel: [24712.557774] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:15:38 juju-e4d256-prod-github-runner-207 kernel: [24712.558829] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 12:15:38 juju-e4d256-prod-github-runner-207 kernel: [24712.561390] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 12:15:38 juju-e4d256-prod-github-runner-207 kernel: [24712.562435] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 12:15:38 juju-e4d256-prod-github-runner-207 kernel: [24712.563604] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 12:15:38 juju-e4d256-prod-github-runner-207 kernel: [24712.564789] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 12:15:38 juju-e4d256-prod-github-runner-207 kernel: [24712.565952] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 12:15:38 juju-e4d256-prod-github-runner-207 kernel: [24712.567128] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 12:15:38 juju-e4d256-prod-github-runner-207 kernel: [24712.568320] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 12:15:38 juju-e4d256-prod-github-runner-207 kernel: [24712.569585] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 12:15:38 juju-e4d256-prod-github-runner-207 kernel: [24712.570694] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 12:15:38 juju-e4d256-prod-github-runner-207 kernel: [24712.571909] Call Trace: Aug 22 12:15:38 juju-e4d256-prod-github-runner-207 kernel: [24712.572826] Aug 22 12:15:38 juju-e4d256-prod-github-runner-207 kernel: [24712.573724] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:15:38 juju-e4d256-prod-github-runner-207 kernel: [24712.574759] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:15:38 juju-e4d256-prod-github-runner-207 kernel: [24712.575798] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:15:38 juju-e4d256-prod-github-runner-207 kernel: [24712.576961] ? show_regs.part.0+0x23/0x29 Aug 22 12:15:38 juju-e4d256-prod-github-runner-207 kernel: [24712.578016] ? show_regs.cold+0x8/0xd Aug 22 12:15:38 juju-e4d256-prod-github-runner-207 kernel: [24712.579067] ? watchdog_timer_fn+0x1be/0x220 Aug 22 12:15:38 juju-e4d256-prod-github-runner-207 kernel: [24712.580122] ? lockup_detector_update_enable+0x60/0x60 Aug 22 12:15:38 juju-e4d256-prod-github-runner-207 kernel: [24712.581221] ? __hrtimer_run_queues+0x107/0x230 Aug 22 12:15:38 juju-e4d256-prod-github-runner-207 kernel: [24712.582309] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 12:15:38 juju-e4d256-prod-github-runner-207 kernel: [24712.583403] ? hrtimer_interrupt+0x101/0x220 Aug 22 12:15:38 juju-e4d256-prod-github-runner-207 kernel: [24712.584489] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 12:15:38 juju-e4d256-prod-github-runner-207 kernel: [24712.585597] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 12:15:38 juju-e4d256-prod-github-runner-207 kernel: [24712.586686] Aug 22 12:15:38 juju-e4d256-prod-github-runner-207 kernel: [24712.587756] Aug 22 12:15:38 juju-e4d256-prod-github-runner-207 kernel: [24712.588677] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 12:15:38 juju-e4d256-prod-github-runner-207 kernel: [24712.589858] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:15:38 juju-e4d256-prod-github-runner-207 kernel: [24712.590933] ? _raw_spin_lock+0x22/0x30 Aug 22 12:15:38 juju-e4d256-prod-github-runner-207 kernel: [24712.591925] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:15:38 juju-e4d256-prod-github-runner-207 kernel: [24712.592987] direct_page_fault+0x206/0x310 [kvm] Aug 22 12:15:38 juju-e4d256-prod-github-runner-207 kernel: [24712.594033] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 12:15:38 juju-e4d256-prod-github-runner-207 kernel: [24712.595100] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 12:15:38 juju-e4d256-prod-github-runner-207 kernel: [24712.596167] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 12:15:38 juju-e4d256-prod-github-runner-207 kernel: [24712.597154] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 12:15:38 juju-e4d256-prod-github-runner-207 kernel: [24712.598153] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 12:15:38 juju-e4d256-prod-github-runner-207 kernel: [24712.599164] handle_exit+0x98/0x230 [kvm_amd] Aug 22 12:15:38 juju-e4d256-prod-github-runner-207 kernel: [24712.600154] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 12:15:38 juju-e4d256-prod-github-runner-207 kernel: [24712.601089] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 12:15:38 juju-e4d256-prod-github-runner-207 kernel: [24712.602033] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 12:15:38 juju-e4d256-prod-github-runner-207 kernel: [24712.602956] vcpu_run+0x62/0x2c0 [kvm] Aug 22 12:15:38 juju-e4d256-prod-github-runner-207 kernel: [24712.603792] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 12:15:38 juju-e4d256-prod-github-runner-207 kernel: [24712.604635] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 12:15:38 juju-e4d256-prod-github-runner-207 kernel: [24712.605490] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 12:15:38 juju-e4d256-prod-github-runner-207 kernel: [24712.606290] ? __seccomp_filter+0x4a/0x4a0 Aug 22 12:15:38 juju-e4d256-prod-github-runner-207 kernel: [24712.607032] ? __fget_files+0x86/0xc0 Aug 22 12:15:38 juju-e4d256-prod-github-runner-207 kernel: [24712.607746] __x64_sys_ioctl+0x95/0xd0 Aug 22 12:15:38 juju-e4d256-prod-github-runner-207 kernel: [24712.608448] do_syscall_64+0x5c/0xc0 Aug 22 12:15:38 juju-e4d256-prod-github-runner-207 kernel: [24712.609122] ? do_futex+0x162/0x1f0 Aug 22 12:15:38 juju-e4d256-prod-github-runner-207 kernel: [24712.609769] ? __x64_sys_futex+0x78/0x1e0 Aug 22 12:15:38 juju-e4d256-prod-github-runner-207 kernel: [24712.610446] ? __secure_computing+0xa9/0x120 Aug 22 12:15:38 juju-e4d256-prod-github-runner-207 kernel: [24712.611134] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 12:15:38 juju-e4d256-prod-github-runner-207 kernel: [24712.611922] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:15:38 juju-e4d256-prod-github-runner-207 kernel: [24712.612651] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:15:38 juju-e4d256-prod-github-runner-207 kernel: [24712.613370] ? do_syscall_64+0x69/0xc0 Aug 22 12:15:38 juju-e4d256-prod-github-runner-207 kernel: [24712.614021] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:15:38 juju-e4d256-prod-github-runner-207 kernel: [24712.614728] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:15:38 juju-e4d256-prod-github-runner-207 kernel: [24712.615421] ? do_syscall_64+0x69/0xc0 Aug 22 12:15:38 juju-e4d256-prod-github-runner-207 kernel: [24712.616063] ? do_syscall_64+0x69/0xc0 Aug 22 12:15:38 juju-e4d256-prod-github-runner-207 kernel: [24712.616691] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 12:15:38 juju-e4d256-prod-github-runner-207 kernel: [24712.617395] RIP: 0033:0x7faa5d0edaff Aug 22 12:15:38 juju-e4d256-prod-github-runner-207 kernel: [24712.618019] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 12:15:38 juju-e4d256-prod-github-runner-207 kernel: [24712.620014] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 12:15:38 juju-e4d256-prod-github-runner-207 kernel: [24712.620928] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 12:15:38 juju-e4d256-prod-github-runner-207 kernel: [24712.621820] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 12:15:38 juju-e4d256-prod-github-runner-207 kernel: [24712.622706] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 12:15:38 juju-e4d256-prod-github-runner-207 kernel: [24712.623599] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 12:15:38 juju-e4d256-prod-github-runner-207 kernel: [24712.624526] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 12:15:38 juju-e4d256-prod-github-runner-207 kernel: [24712.625417] Aug 22 12:16:06 juju-e4d256-prod-github-runner-207 kernel: [24740.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 22933s! [qemu-system-x86:6715] Aug 22 12:16:06 juju-e4d256-prod-github-runner-207 kernel: [24740.543886] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 12:16:06 juju-e4d256-prod-github-runner-207 kernel: [24740.544186] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 12:16:06 juju-e4d256-prod-github-runner-207 kernel: [24740.556383] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 12:16:06 juju-e4d256-prod-github-runner-207 kernel: [24740.557649] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 12:16:06 juju-e4d256-prod-github-runner-207 kernel: [24740.558868] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:16:06 juju-e4d256-prod-github-runner-207 kernel: [24740.559942] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 12:16:06 juju-e4d256-prod-github-runner-207 kernel: [24740.562502] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 12:16:06 juju-e4d256-prod-github-runner-207 kernel: [24740.563565] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 12:16:06 juju-e4d256-prod-github-runner-207 kernel: [24740.564732] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 12:16:06 juju-e4d256-prod-github-runner-207 kernel: [24740.565902] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 12:16:06 juju-e4d256-prod-github-runner-207 kernel: [24740.567077] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 12:16:06 juju-e4d256-prod-github-runner-207 kernel: [24740.568262] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 12:16:06 juju-e4d256-prod-github-runner-207 kernel: [24740.569434] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 12:16:06 juju-e4d256-prod-github-runner-207 kernel: [24740.570674] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 12:16:06 juju-e4d256-prod-github-runner-207 kernel: [24740.571792] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 12:16:06 juju-e4d256-prod-github-runner-207 kernel: [24740.572984] Call Trace: Aug 22 12:16:06 juju-e4d256-prod-github-runner-207 kernel: [24740.573895] Aug 22 12:16:06 juju-e4d256-prod-github-runner-207 kernel: [24740.574801] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:16:06 juju-e4d256-prod-github-runner-207 kernel: [24740.575854] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:16:06 juju-e4d256-prod-github-runner-207 kernel: [24740.576876] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:16:06 juju-e4d256-prod-github-runner-207 kernel: [24740.577968] ? show_regs.part.0+0x23/0x29 Aug 22 12:16:06 juju-e4d256-prod-github-runner-207 kernel: [24740.578965] ? show_regs.cold+0x8/0xd Aug 22 12:16:06 juju-e4d256-prod-github-runner-207 kernel: [24740.579954] ? watchdog_timer_fn+0x1be/0x220 Aug 22 12:16:06 juju-e4d256-prod-github-runner-207 kernel: [24740.580965] ? lockup_detector_update_enable+0x60/0x60 Aug 22 12:16:06 juju-e4d256-prod-github-runner-207 kernel: [24740.582028] ? __hrtimer_run_queues+0x107/0x230 Aug 22 12:16:06 juju-e4d256-prod-github-runner-207 kernel: [24740.583062] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 12:16:06 juju-e4d256-prod-github-runner-207 kernel: [24740.584121] ? hrtimer_interrupt+0x101/0x220 Aug 22 12:16:06 juju-e4d256-prod-github-runner-207 kernel: [24740.585163] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 12:16:06 juju-e4d256-prod-github-runner-207 kernel: [24740.586247] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 12:16:06 juju-e4d256-prod-github-runner-207 kernel: [24740.587309] Aug 22 12:16:06 juju-e4d256-prod-github-runner-207 kernel: [24740.588191] Aug 22 12:16:06 juju-e4d256-prod-github-runner-207 kernel: [24740.589034] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 12:16:06 juju-e4d256-prod-github-runner-207 kernel: [24740.590068] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:16:06 juju-e4d256-prod-github-runner-207 kernel: [24740.591106] ? _raw_spin_lock+0x22/0x30 Aug 22 12:16:06 juju-e4d256-prod-github-runner-207 kernel: [24740.592070] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:16:06 juju-e4d256-prod-github-runner-207 kernel: [24740.593129] direct_page_fault+0x206/0x310 [kvm] Aug 22 12:16:06 juju-e4d256-prod-github-runner-207 kernel: [24740.594191] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 12:16:06 juju-e4d256-prod-github-runner-207 kernel: [24740.595232] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 12:16:06 juju-e4d256-prod-github-runner-207 kernel: [24740.596259] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 12:16:06 juju-e4d256-prod-github-runner-207 kernel: [24740.597266] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 12:16:06 juju-e4d256-prod-github-runner-207 kernel: [24740.598215] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 12:16:06 juju-e4d256-prod-github-runner-207 kernel: [24740.599221] handle_exit+0x98/0x230 [kvm_amd] Aug 22 12:16:06 juju-e4d256-prod-github-runner-207 kernel: [24740.600136] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 12:16:06 juju-e4d256-prod-github-runner-207 kernel: [24740.601058] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 12:16:06 juju-e4d256-prod-github-runner-207 kernel: [24740.601992] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 12:16:06 juju-e4d256-prod-github-runner-207 kernel: [24740.602899] vcpu_run+0x62/0x2c0 [kvm] Aug 22 12:16:06 juju-e4d256-prod-github-runner-207 kernel: [24740.603741] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 12:16:06 juju-e4d256-prod-github-runner-207 kernel: [24740.604550] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 12:16:06 juju-e4d256-prod-github-runner-207 kernel: [24740.605445] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 12:16:06 juju-e4d256-prod-github-runner-207 kernel: [24740.606267] ? __seccomp_filter+0x4a/0x4a0 Aug 22 12:16:06 juju-e4d256-prod-github-runner-207 kernel: [24740.607016] ? __fget_files+0x86/0xc0 Aug 22 12:16:06 juju-e4d256-prod-github-runner-207 kernel: [24740.607754] __x64_sys_ioctl+0x95/0xd0 Aug 22 12:16:06 juju-e4d256-prod-github-runner-207 kernel: [24740.608457] do_syscall_64+0x5c/0xc0 Aug 22 12:16:06 juju-e4d256-prod-github-runner-207 kernel: [24740.609122] ? do_futex+0x162/0x1f0 Aug 22 12:16:06 juju-e4d256-prod-github-runner-207 kernel: [24740.609796] ? __x64_sys_futex+0x78/0x1e0 Aug 22 12:16:06 juju-e4d256-prod-github-runner-207 kernel: [24740.610495] ? __secure_computing+0xa9/0x120 Aug 22 12:16:06 juju-e4d256-prod-github-runner-207 kernel: [24740.611190] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 12:16:06 juju-e4d256-prod-github-runner-207 kernel: [24740.611985] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:16:06 juju-e4d256-prod-github-runner-207 kernel: [24740.612723] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:16:06 juju-e4d256-prod-github-runner-207 kernel: [24740.613449] ? do_syscall_64+0x69/0xc0 Aug 22 12:16:06 juju-e4d256-prod-github-runner-207 kernel: [24740.614109] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:16:06 juju-e4d256-prod-github-runner-207 kernel: [24740.614841] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:16:06 juju-e4d256-prod-github-runner-207 kernel: [24740.615582] ? do_syscall_64+0x69/0xc0 Aug 22 12:16:06 juju-e4d256-prod-github-runner-207 kernel: [24740.616223] ? do_syscall_64+0x69/0xc0 Aug 22 12:16:06 juju-e4d256-prod-github-runner-207 kernel: [24740.616867] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 12:16:06 juju-e4d256-prod-github-runner-207 kernel: [24740.617587] RIP: 0033:0x7faa5d0edaff Aug 22 12:16:06 juju-e4d256-prod-github-runner-207 kernel: [24740.618255] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 12:16:06 juju-e4d256-prod-github-runner-207 kernel: [24740.620305] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 12:16:06 juju-e4d256-prod-github-runner-207 kernel: [24740.621239] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 12:16:06 juju-e4d256-prod-github-runner-207 kernel: [24740.622147] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 12:16:06 juju-e4d256-prod-github-runner-207 kernel: [24740.623063] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 12:16:06 juju-e4d256-prod-github-runner-207 kernel: [24740.623988] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 12:16:06 juju-e4d256-prod-github-runner-207 kernel: [24740.624889] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 12:16:06 juju-e4d256-prod-github-runner-207 kernel: [24740.625798] Aug 22 12:16:34 juju-e4d256-prod-github-runner-207 kernel: [24768.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 22959s! [qemu-system-x86:6715] Aug 22 12:16:34 juju-e4d256-prod-github-runner-207 kernel: [24768.543092] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 12:16:34 juju-e4d256-prod-github-runner-207 kernel: [24768.543166] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 12:16:34 juju-e4d256-prod-github-runner-207 kernel: [24768.555838] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 12:16:34 juju-e4d256-prod-github-runner-207 kernel: [24768.557162] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 12:16:34 juju-e4d256-prod-github-runner-207 kernel: [24768.558417] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:16:34 juju-e4d256-prod-github-runner-207 kernel: [24768.559505] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 12:16:34 juju-e4d256-prod-github-runner-207 kernel: [24768.562077] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 12:16:34 juju-e4d256-prod-github-runner-207 kernel: [24768.563127] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 12:16:34 juju-e4d256-prod-github-runner-207 kernel: [24768.564309] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 12:16:34 juju-e4d256-prod-github-runner-207 kernel: [24768.565483] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 12:16:34 juju-e4d256-prod-github-runner-207 kernel: [24768.566653] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 12:16:34 juju-e4d256-prod-github-runner-207 kernel: [24768.567850] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 12:16:34 juju-e4d256-prod-github-runner-207 kernel: [24768.569046] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 12:16:34 juju-e4d256-prod-github-runner-207 kernel: [24768.570296] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 12:16:34 juju-e4d256-prod-github-runner-207 kernel: [24768.571417] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 12:16:34 juju-e4d256-prod-github-runner-207 kernel: [24768.572619] Call Trace: Aug 22 12:16:34 juju-e4d256-prod-github-runner-207 kernel: [24768.573570] Aug 22 12:16:34 juju-e4d256-prod-github-runner-207 kernel: [24768.574465] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:16:34 juju-e4d256-prod-github-runner-207 kernel: [24768.575544] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:16:34 juju-e4d256-prod-github-runner-207 kernel: [24768.576581] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:16:34 juju-e4d256-prod-github-runner-207 kernel: [24768.577664] ? show_regs.part.0+0x23/0x29 Aug 22 12:16:34 juju-e4d256-prod-github-runner-207 kernel: [24768.578676] ? show_regs.cold+0x8/0xd Aug 22 12:16:34 juju-e4d256-prod-github-runner-207 kernel: [24768.579677] ? watchdog_timer_fn+0x1be/0x220 Aug 22 12:16:34 juju-e4d256-prod-github-runner-207 kernel: [24768.580696] ? lockup_detector_update_enable+0x60/0x60 Aug 22 12:16:34 juju-e4d256-prod-github-runner-207 kernel: [24768.581768] ? __hrtimer_run_queues+0x107/0x230 Aug 22 12:16:34 juju-e4d256-prod-github-runner-207 kernel: [24768.582948] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 12:16:34 juju-e4d256-prod-github-runner-207 kernel: [24768.584025] ? hrtimer_interrupt+0x101/0x220 Aug 22 12:16:34 juju-e4d256-prod-github-runner-207 kernel: [24768.585085] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 12:16:34 juju-e4d256-prod-github-runner-207 kernel: [24768.586170] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 12:16:34 juju-e4d256-prod-github-runner-207 kernel: [24768.587291] Aug 22 12:16:34 juju-e4d256-prod-github-runner-207 kernel: [24768.588175] Aug 22 12:16:34 juju-e4d256-prod-github-runner-207 kernel: [24768.589042] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 12:16:34 juju-e4d256-prod-github-runner-207 kernel: [24768.590108] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:16:34 juju-e4d256-prod-github-runner-207 kernel: [24768.591158] ? _raw_spin_lock+0x22/0x30 Aug 22 12:16:34 juju-e4d256-prod-github-runner-207 kernel: [24768.592134] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:16:34 juju-e4d256-prod-github-runner-207 kernel: [24768.593160] direct_page_fault+0x206/0x310 [kvm] Aug 22 12:16:34 juju-e4d256-prod-github-runner-207 kernel: [24768.594197] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 12:16:34 juju-e4d256-prod-github-runner-207 kernel: [24768.595225] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 12:16:34 juju-e4d256-prod-github-runner-207 kernel: [24768.596236] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 12:16:34 juju-e4d256-prod-github-runner-207 kernel: [24768.597219] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 12:16:34 juju-e4d256-prod-github-runner-207 kernel: [24768.598172] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 12:16:34 juju-e4d256-prod-github-runner-207 kernel: [24768.599158] handle_exit+0x98/0x230 [kvm_amd] Aug 22 12:16:34 juju-e4d256-prod-github-runner-207 kernel: [24768.600069] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 12:16:34 juju-e4d256-prod-github-runner-207 kernel: [24768.600990] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 12:16:34 juju-e4d256-prod-github-runner-207 kernel: [24768.601949] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 12:16:34 juju-e4d256-prod-github-runner-207 kernel: [24768.602899] vcpu_run+0x62/0x2c0 [kvm] Aug 22 12:16:34 juju-e4d256-prod-github-runner-207 kernel: [24768.603749] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 12:16:34 juju-e4d256-prod-github-runner-207 kernel: [24768.604653] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 12:16:34 juju-e4d256-prod-github-runner-207 kernel: [24768.605670] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 12:16:34 juju-e4d256-prod-github-runner-207 kernel: [24768.606525] ? __seccomp_filter+0x4a/0x4a0 Aug 22 12:16:34 juju-e4d256-prod-github-runner-207 kernel: [24768.607370] ? __fget_files+0x86/0xc0 Aug 22 12:16:34 juju-e4d256-prod-github-runner-207 kernel: [24768.608174] __x64_sys_ioctl+0x95/0xd0 Aug 22 12:16:34 juju-e4d256-prod-github-runner-207 kernel: [24768.608966] do_syscall_64+0x5c/0xc0 Aug 22 12:16:34 juju-e4d256-prod-github-runner-207 kernel: [24768.609705] ? do_futex+0x162/0x1f0 Aug 22 12:16:34 juju-e4d256-prod-github-runner-207 kernel: [24768.610396] ? __x64_sys_futex+0x78/0x1e0 Aug 22 12:16:34 juju-e4d256-prod-github-runner-207 kernel: [24768.611103] ? __secure_computing+0xa9/0x120 Aug 22 12:16:34 juju-e4d256-prod-github-runner-207 kernel: [24768.611888] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 12:16:34 juju-e4d256-prod-github-runner-207 kernel: [24768.612662] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:16:34 juju-e4d256-prod-github-runner-207 kernel: [24768.613390] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:16:34 juju-e4d256-prod-github-runner-207 kernel: [24768.614112] ? do_syscall_64+0x69/0xc0 Aug 22 12:16:34 juju-e4d256-prod-github-runner-207 kernel: [24768.614767] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:16:34 juju-e4d256-prod-github-runner-207 kernel: [24768.615488] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:16:34 juju-e4d256-prod-github-runner-207 kernel: [24768.616198] ? do_syscall_64+0x69/0xc0 Aug 22 12:16:34 juju-e4d256-prod-github-runner-207 kernel: [24768.616828] ? do_syscall_64+0x69/0xc0 Aug 22 12:16:34 juju-e4d256-prod-github-runner-207 kernel: [24768.617456] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 12:16:34 juju-e4d256-prod-github-runner-207 kernel: [24768.618168] RIP: 0033:0x7faa5d0edaff Aug 22 12:16:34 juju-e4d256-prod-github-runner-207 kernel: [24768.618825] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 12:16:34 juju-e4d256-prod-github-runner-207 kernel: [24768.620872] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 12:16:34 juju-e4d256-prod-github-runner-207 kernel: [24768.621799] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 12:16:34 juju-e4d256-prod-github-runner-207 kernel: [24768.622705] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 12:16:34 juju-e4d256-prod-github-runner-207 kernel: [24768.623621] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 12:16:34 juju-e4d256-prod-github-runner-207 kernel: [24768.624520] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 12:16:34 juju-e4d256-prod-github-runner-207 kernel: [24768.625419] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 12:16:34 juju-e4d256-prod-github-runner-207 kernel: [24768.626524] Aug 22 12:17:02 juju-e4d256-prod-github-runner-207 kernel: [24796.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 22985s! [qemu-system-x86:6715] Aug 22 12:17:02 juju-e4d256-prod-github-runner-207 kernel: [24796.543174] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 12:17:02 juju-e4d256-prod-github-runner-207 kernel: [24796.543244] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 12:17:02 juju-e4d256-prod-github-runner-207 kernel: [24796.555556] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 12:17:02 juju-e4d256-prod-github-runner-207 kernel: [24796.556837] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 12:17:02 juju-e4d256-prod-github-runner-207 kernel: [24796.558131] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:17:02 juju-e4d256-prod-github-runner-207 kernel: [24796.559238] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 12:17:02 juju-e4d256-prod-github-runner-207 kernel: [24796.561802] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 12:17:02 juju-e4d256-prod-github-runner-207 kernel: [24796.562875] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 12:17:02 juju-e4d256-prod-github-runner-207 kernel: [24796.564051] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 12:17:02 juju-e4d256-prod-github-runner-207 kernel: [24796.565208] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 12:17:02 juju-e4d256-prod-github-runner-207 kernel: [24796.566391] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 12:17:02 juju-e4d256-prod-github-runner-207 kernel: [24796.567634] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 12:17:02 juju-e4d256-prod-github-runner-207 kernel: [24796.568811] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 12:17:02 juju-e4d256-prod-github-runner-207 kernel: [24796.570034] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 12:17:02 juju-e4d256-prod-github-runner-207 kernel: [24796.571174] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 12:17:02 juju-e4d256-prod-github-runner-207 kernel: [24796.572370] Call Trace: Aug 22 12:17:02 juju-e4d256-prod-github-runner-207 kernel: [24796.573279] Aug 22 12:17:02 juju-e4d256-prod-github-runner-207 kernel: [24796.574160] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:17:02 juju-e4d256-prod-github-runner-207 kernel: [24796.575219] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:17:02 juju-e4d256-prod-github-runner-207 kernel: [24796.576252] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:17:02 juju-e4d256-prod-github-runner-207 kernel: [24796.577330] ? show_regs.part.0+0x23/0x29 Aug 22 12:17:02 juju-e4d256-prod-github-runner-207 kernel: [24796.578323] ? show_regs.cold+0x8/0xd Aug 22 12:17:02 juju-e4d256-prod-github-runner-207 kernel: [24796.579351] ? watchdog_timer_fn+0x1be/0x220 Aug 22 12:17:02 juju-e4d256-prod-github-runner-207 kernel: [24796.580361] ? lockup_detector_update_enable+0x60/0x60 Aug 22 12:17:02 juju-e4d256-prod-github-runner-207 kernel: [24796.581426] ? __hrtimer_run_queues+0x107/0x230 Aug 22 12:17:02 juju-e4d256-prod-github-runner-207 kernel: [24796.582458] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 12:17:02 juju-e4d256-prod-github-runner-207 kernel: [24796.583506] ? hrtimer_interrupt+0x101/0x220 Aug 22 12:17:02 juju-e4d256-prod-github-runner-207 kernel: [24796.584523] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 12:17:02 juju-e4d256-prod-github-runner-207 kernel: [24796.585589] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 12:17:02 juju-e4d256-prod-github-runner-207 kernel: [24796.586677] Aug 22 12:17:02 juju-e4d256-prod-github-runner-207 kernel: [24796.587571] Aug 22 12:17:02 juju-e4d256-prod-github-runner-207 kernel: [24796.588408] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 12:17:02 juju-e4d256-prod-github-runner-207 kernel: [24796.589436] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:17:02 juju-e4d256-prod-github-runner-207 kernel: [24796.590519] ? _raw_spin_lock+0x22/0x30 Aug 22 12:17:02 juju-e4d256-prod-github-runner-207 kernel: [24796.591513] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:17:02 juju-e4d256-prod-github-runner-207 kernel: [24796.592542] direct_page_fault+0x206/0x310 [kvm] Aug 22 12:17:02 juju-e4d256-prod-github-runner-207 kernel: [24796.593566] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 12:17:02 juju-e4d256-prod-github-runner-207 kernel: [24796.594609] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 12:17:02 juju-e4d256-prod-github-runner-207 kernel: [24796.595645] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 12:17:02 juju-e4d256-prod-github-runner-207 kernel: [24796.596618] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 12:17:02 juju-e4d256-prod-github-runner-207 kernel: [24796.597563] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 12:17:02 juju-e4d256-prod-github-runner-207 kernel: [24796.598539] handle_exit+0x98/0x230 [kvm_amd] Aug 22 12:17:02 juju-e4d256-prod-github-runner-207 kernel: [24796.599464] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 12:17:02 juju-e4d256-prod-github-runner-207 kernel: [24796.600385] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 12:17:02 juju-e4d256-prod-github-runner-207 kernel: [24796.601311] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 12:17:02 juju-e4d256-prod-github-runner-207 kernel: [24796.602217] vcpu_run+0x62/0x2c0 [kvm] Aug 22 12:17:02 juju-e4d256-prod-github-runner-207 kernel: [24796.603052] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 12:17:02 juju-e4d256-prod-github-runner-207 kernel: [24796.603862] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 12:17:02 juju-e4d256-prod-github-runner-207 kernel: [24796.604718] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 12:17:02 juju-e4d256-prod-github-runner-207 kernel: [24796.605516] ? __seccomp_filter+0x4a/0x4a0 Aug 22 12:17:02 juju-e4d256-prod-github-runner-207 kernel: [24796.606263] ? __fget_files+0x86/0xc0 Aug 22 12:17:02 juju-e4d256-prod-github-runner-207 kernel: [24796.607004] __x64_sys_ioctl+0x95/0xd0 Aug 22 12:17:02 juju-e4d256-prod-github-runner-207 kernel: [24796.607701] do_syscall_64+0x5c/0xc0 Aug 22 12:17:02 juju-e4d256-prod-github-runner-207 kernel: [24796.608367] ? do_futex+0x162/0x1f0 Aug 22 12:17:02 juju-e4d256-prod-github-runner-207 kernel: [24796.609023] ? __x64_sys_futex+0x78/0x1e0 Aug 22 12:17:02 juju-e4d256-prod-github-runner-207 kernel: [24796.609731] ? __secure_computing+0xa9/0x120 Aug 22 12:17:02 juju-e4d256-prod-github-runner-207 kernel: [24796.610429] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 12:17:02 juju-e4d256-prod-github-runner-207 kernel: [24796.611211] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:17:02 juju-e4d256-prod-github-runner-207 kernel: [24796.611935] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:17:02 juju-e4d256-prod-github-runner-207 kernel: [24796.612660] ? do_syscall_64+0x69/0xc0 Aug 22 12:17:02 juju-e4d256-prod-github-runner-207 kernel: [24796.613306] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:17:02 juju-e4d256-prod-github-runner-207 kernel: [24796.614010] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:17:02 juju-e4d256-prod-github-runner-207 kernel: [24796.614706] ? do_syscall_64+0x69/0xc0 Aug 22 12:17:02 juju-e4d256-prod-github-runner-207 kernel: [24796.615362] ? do_syscall_64+0x69/0xc0 Aug 22 12:17:02 juju-e4d256-prod-github-runner-207 kernel: [24796.615985] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 12:17:02 juju-e4d256-prod-github-runner-207 kernel: [24796.616692] RIP: 0033:0x7faa5d0edaff Aug 22 12:17:02 juju-e4d256-prod-github-runner-207 kernel: [24796.617318] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 12:17:02 juju-e4d256-prod-github-runner-207 kernel: [24796.619329] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 12:17:02 juju-e4d256-prod-github-runner-207 kernel: [24796.620244] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 12:17:02 juju-e4d256-prod-github-runner-207 kernel: [24796.621149] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 12:17:02 juju-e4d256-prod-github-runner-207 kernel: [24796.622041] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 12:17:02 juju-e4d256-prod-github-runner-207 kernel: [24796.622946] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 12:17:02 juju-e4d256-prod-github-runner-207 kernel: [24796.623844] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 12:17:02 juju-e4d256-prod-github-runner-207 kernel: [24796.624739] Aug 22 12:17:30 juju-e4d256-prod-github-runner-207 kernel: [24824.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 23011s! [qemu-system-x86:6715] Aug 22 12:17:30 juju-e4d256-prod-github-runner-207 kernel: [24824.543880] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 12:17:30 juju-e4d256-prod-github-runner-207 kernel: [24824.544167] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 12:17:30 juju-e4d256-prod-github-runner-207 kernel: [24824.556280] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 12:17:30 juju-e4d256-prod-github-runner-207 kernel: [24824.557564] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 12:17:30 juju-e4d256-prod-github-runner-207 kernel: [24824.558816] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:17:30 juju-e4d256-prod-github-runner-207 kernel: [24824.559875] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 12:17:30 juju-e4d256-prod-github-runner-207 kernel: [24824.562418] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 12:17:30 juju-e4d256-prod-github-runner-207 kernel: [24824.563481] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 12:17:30 juju-e4d256-prod-github-runner-207 kernel: [24824.564643] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 12:17:30 juju-e4d256-prod-github-runner-207 kernel: [24824.565800] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 12:17:30 juju-e4d256-prod-github-runner-207 kernel: [24824.566988] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 12:17:30 juju-e4d256-prod-github-runner-207 kernel: [24824.568299] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 12:17:30 juju-e4d256-prod-github-runner-207 kernel: [24824.569463] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 12:17:30 juju-e4d256-prod-github-runner-207 kernel: [24824.570714] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 12:17:30 juju-e4d256-prod-github-runner-207 kernel: [24824.571811] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 12:17:30 juju-e4d256-prod-github-runner-207 kernel: [24824.573141] Call Trace: Aug 22 12:17:30 juju-e4d256-prod-github-runner-207 kernel: [24824.574058] Aug 22 12:17:30 juju-e4d256-prod-github-runner-207 kernel: [24824.574973] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:17:30 juju-e4d256-prod-github-runner-207 kernel: [24824.576007] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:17:30 juju-e4d256-prod-github-runner-207 kernel: [24824.577161] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:17:30 juju-e4d256-prod-github-runner-207 kernel: [24824.578254] ? show_regs.part.0+0x23/0x29 Aug 22 12:17:30 juju-e4d256-prod-github-runner-207 kernel: [24824.579290] ? show_regs.cold+0x8/0xd Aug 22 12:17:30 juju-e4d256-prod-github-runner-207 kernel: [24824.580277] ? watchdog_timer_fn+0x1be/0x220 Aug 22 12:17:30 juju-e4d256-prod-github-runner-207 kernel: [24824.581661] ? lockup_detector_update_enable+0x60/0x60 Aug 22 12:17:30 juju-e4d256-prod-github-runner-207 kernel: [24824.583525] ? __hrtimer_run_queues+0x107/0x230 Aug 22 12:17:30 juju-e4d256-prod-github-runner-207 kernel: [24824.584955] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 12:17:30 juju-e4d256-prod-github-runner-207 kernel: [24824.585991] ? hrtimer_interrupt+0x101/0x220 Aug 22 12:17:30 juju-e4d256-prod-github-runner-207 kernel: [24824.587032] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 12:17:30 juju-e4d256-prod-github-runner-207 kernel: [24824.588126] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 12:17:30 juju-e4d256-prod-github-runner-207 kernel: [24824.589177] Aug 22 12:17:30 juju-e4d256-prod-github-runner-207 kernel: [24824.590031] Aug 22 12:17:30 juju-e4d256-prod-github-runner-207 kernel: [24824.590905] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 12:17:30 juju-e4d256-prod-github-runner-207 kernel: [24824.591953] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:17:30 juju-e4d256-prod-github-runner-207 kernel: [24824.592997] ? _raw_spin_lock+0x22/0x30 Aug 22 12:17:30 juju-e4d256-prod-github-runner-207 kernel: [24824.593949] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:17:30 juju-e4d256-prod-github-runner-207 kernel: [24824.594997] direct_page_fault+0x206/0x310 [kvm] Aug 22 12:17:30 juju-e4d256-prod-github-runner-207 kernel: [24824.596027] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 12:17:30 juju-e4d256-prod-github-runner-207 kernel: [24824.597062] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 12:17:30 juju-e4d256-prod-github-runner-207 kernel: [24824.598066] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 12:17:30 juju-e4d256-prod-github-runner-207 kernel: [24824.599105] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 12:17:30 juju-e4d256-prod-github-runner-207 kernel: [24824.600069] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 12:17:30 juju-e4d256-prod-github-runner-207 kernel: [24824.601053] handle_exit+0x98/0x230 [kvm_amd] Aug 22 12:17:30 juju-e4d256-prod-github-runner-207 kernel: [24824.601953] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 12:17:30 juju-e4d256-prod-github-runner-207 kernel: [24824.602891] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 12:17:30 juju-e4d256-prod-github-runner-207 kernel: [24824.603819] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 12:17:30 juju-e4d256-prod-github-runner-207 kernel: [24824.604751] vcpu_run+0x62/0x2c0 [kvm] Aug 22 12:17:30 juju-e4d256-prod-github-runner-207 kernel: [24824.605563] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 12:17:30 juju-e4d256-prod-github-runner-207 kernel: [24824.606370] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 12:17:30 juju-e4d256-prod-github-runner-207 kernel: [24824.607250] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 12:17:30 juju-e4d256-prod-github-runner-207 kernel: [24824.608048] ? __seccomp_filter+0x4a/0x4a0 Aug 22 12:17:30 juju-e4d256-prod-github-runner-207 kernel: [24824.608798] ? __fget_files+0x86/0xc0 Aug 22 12:17:30 juju-e4d256-prod-github-runner-207 kernel: [24824.609506] __x64_sys_ioctl+0x95/0xd0 Aug 22 12:17:30 juju-e4d256-prod-github-runner-207 kernel: [24824.610198] do_syscall_64+0x5c/0xc0 Aug 22 12:17:30 juju-e4d256-prod-github-runner-207 kernel: [24824.610891] ? do_futex+0x162/0x1f0 Aug 22 12:17:30 juju-e4d256-prod-github-runner-207 kernel: [24824.611548] ? __x64_sys_futex+0x78/0x1e0 Aug 22 12:17:30 juju-e4d256-prod-github-runner-207 kernel: [24824.612244] ? __secure_computing+0xa9/0x120 Aug 22 12:17:30 juju-e4d256-prod-github-runner-207 kernel: [24824.612938] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 12:17:30 juju-e4d256-prod-github-runner-207 kernel: [24824.613704] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:17:30 juju-e4d256-prod-github-runner-207 kernel: [24824.614430] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:17:30 juju-e4d256-prod-github-runner-207 kernel: [24824.615173] ? do_syscall_64+0x69/0xc0 Aug 22 12:17:30 juju-e4d256-prod-github-runner-207 kernel: [24824.615825] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:17:30 juju-e4d256-prod-github-runner-207 kernel: [24824.616529] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:17:30 juju-e4d256-prod-github-runner-207 kernel: [24824.617243] ? do_syscall_64+0x69/0xc0 Aug 22 12:17:30 juju-e4d256-prod-github-runner-207 kernel: [24824.617883] ? do_syscall_64+0x69/0xc0 Aug 22 12:17:30 juju-e4d256-prod-github-runner-207 kernel: [24824.618542] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 12:17:30 juju-e4d256-prod-github-runner-207 kernel: [24824.619256] RIP: 0033:0x7faa5d0edaff Aug 22 12:17:30 juju-e4d256-prod-github-runner-207 kernel: [24824.619907] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 12:17:30 juju-e4d256-prod-github-runner-207 kernel: [24824.621889] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 12:17:30 juju-e4d256-prod-github-runner-207 kernel: [24824.622809] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 12:17:30 juju-e4d256-prod-github-runner-207 kernel: [24824.623704] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 12:17:30 juju-e4d256-prod-github-runner-207 kernel: [24824.624611] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 12:17:30 juju-e4d256-prod-github-runner-207 kernel: [24824.625514] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 12:17:30 juju-e4d256-prod-github-runner-207 kernel: [24824.626403] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 12:17:30 juju-e4d256-prod-github-runner-207 kernel: [24824.627312] Aug 22 12:17:44 juju-e4d256-prod-github-runner-207 kernel: [24838.844709] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 12:17:44 juju-e4d256-prod-github-runner-207 kernel: [24838.845653] rcu: 1-....: (6161130 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=2981791 Aug 22 12:17:44 juju-e4d256-prod-github-runner-207 kernel: [24838.846822] (t=6180411 jiffies g=23269 q=29691) Aug 22 12:17:44 juju-e4d256-prod-github-runner-207 kernel: [24838.847634] NMI backtrace for cpu 1 Aug 22 12:17:44 juju-e4d256-prod-github-runner-207 kernel: [24838.848363] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 12:17:44 juju-e4d256-prod-github-runner-207 kernel: [24838.849485] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 12:17:44 juju-e4d256-prod-github-runner-207 kernel: [24838.850560] Call Trace: Aug 22 12:17:44 juju-e4d256-prod-github-runner-207 kernel: [24838.851241] Aug 22 12:17:44 juju-e4d256-prod-github-runner-207 kernel: [24838.851883] show_stack+0x52/0x5c Aug 22 12:17:44 juju-e4d256-prod-github-runner-207 kernel: [24838.852606] dump_stack_lvl+0x4a/0x63 Aug 22 12:17:44 juju-e4d256-prod-github-runner-207 kernel: [24838.853358] dump_stack+0x10/0x16 Aug 22 12:17:44 juju-e4d256-prod-github-runner-207 kernel: [24838.854099] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 12:17:44 juju-e4d256-prod-github-runner-207 kernel: [24838.854891] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 12:17:44 juju-e4d256-prod-github-runner-207 kernel: [24838.855666] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 12:17:44 juju-e4d256-prod-github-runner-207 kernel: [24838.856489] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 12:17:44 juju-e4d256-prod-github-runner-207 kernel: [24838.857320] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 12:17:44 juju-e4d256-prod-github-runner-207 kernel: [24838.858142] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 12:17:44 juju-e4d256-prod-github-runner-207 kernel: [24838.858966] print_cpu_stall.cold+0x2f/0xe2 Aug 22 12:17:44 juju-e4d256-prod-github-runner-207 kernel: [24838.859752] ? timekeeping_update+0xf7/0x150 Aug 22 12:17:44 juju-e4d256-prod-github-runner-207 kernel: [24838.860520] check_cpu_stall+0x109/0x270 Aug 22 12:17:44 juju-e4d256-prod-github-runner-207 kernel: [24838.861270] rcu_sched_clock_irq+0x9a/0x250 Aug 22 12:17:44 juju-e4d256-prod-github-runner-207 kernel: [24838.862029] update_process_times+0x94/0xd0 Aug 22 12:17:44 juju-e4d256-prod-github-runner-207 kernel: [24838.862811] tick_sched_handle+0x29/0x70 Aug 22 12:17:44 juju-e4d256-prod-github-runner-207 kernel: [24838.863569] tick_sched_timer+0x8c/0xc0 Aug 22 12:17:44 juju-e4d256-prod-github-runner-207 kernel: [24838.864318] ? tick_nohz_handler+0xb0/0xb0 Aug 22 12:17:44 juju-e4d256-prod-github-runner-207 kernel: [24838.865079] __hrtimer_run_queues+0x107/0x230 Aug 22 12:17:44 juju-e4d256-prod-github-runner-207 kernel: [24838.865852] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 12:17:44 juju-e4d256-prod-github-runner-207 kernel: [24838.866641] hrtimer_interrupt+0x101/0x220 Aug 22 12:17:44 juju-e4d256-prod-github-runner-207 kernel: [24838.867402] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 12:17:44 juju-e4d256-prod-github-runner-207 kernel: [24838.868235] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 12:17:44 juju-e4d256-prod-github-runner-207 kernel: [24838.869048] Aug 22 12:17:44 juju-e4d256-prod-github-runner-207 kernel: [24838.869700] Aug 22 12:17:44 juju-e4d256-prod-github-runner-207 kernel: [24838.870356] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 12:17:44 juju-e4d256-prod-github-runner-207 kernel: [24838.871176] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:17:44 juju-e4d256-prod-github-runner-207 kernel: [24838.872061] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 12:17:44 juju-e4d256-prod-github-runner-207 kernel: [24838.874286] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 12:17:44 juju-e4d256-prod-github-runner-207 kernel: [24838.875189] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 12:17:44 juju-e4d256-prod-github-runner-207 kernel: [24838.876179] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 12:17:44 juju-e4d256-prod-github-runner-207 kernel: [24838.877159] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 12:17:44 juju-e4d256-prod-github-runner-207 kernel: [24838.878143] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 12:17:44 juju-e4d256-prod-github-runner-207 kernel: [24838.879135] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 12:17:44 juju-e4d256-prod-github-runner-207 kernel: [24838.880116] ? _raw_spin_lock+0x22/0x30 Aug 22 12:17:44 juju-e4d256-prod-github-runner-207 kernel: [24838.880874] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:17:44 juju-e4d256-prod-github-runner-207 kernel: [24838.881708] direct_page_fault+0x206/0x310 [kvm] Aug 22 12:17:44 juju-e4d256-prod-github-runner-207 kernel: [24838.882570] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 12:17:44 juju-e4d256-prod-github-runner-207 kernel: [24838.883405] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 12:17:44 juju-e4d256-prod-github-runner-207 kernel: [24838.884238] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 12:17:44 juju-e4d256-prod-github-runner-207 kernel: [24838.885068] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 12:17:44 juju-e4d256-prod-github-runner-207 kernel: [24838.885861] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 12:17:44 juju-e4d256-prod-github-runner-207 kernel: [24838.886697] handle_exit+0x98/0x230 [kvm_amd] Aug 22 12:17:44 juju-e4d256-prod-github-runner-207 kernel: [24838.887454] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 12:17:44 juju-e4d256-prod-github-runner-207 kernel: [24838.888239] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 12:17:44 juju-e4d256-prod-github-runner-207 kernel: [24838.889051] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 12:17:44 juju-e4d256-prod-github-runner-207 kernel: [24838.889866] vcpu_run+0x62/0x2c0 [kvm] Aug 22 12:17:44 juju-e4d256-prod-github-runner-207 kernel: [24838.890600] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 12:17:44 juju-e4d256-prod-github-runner-207 kernel: [24838.891339] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 12:17:44 juju-e4d256-prod-github-runner-207 kernel: [24838.892148] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 12:17:44 juju-e4d256-prod-github-runner-207 kernel: [24838.892912] ? __seccomp_filter+0x4a/0x4a0 Aug 22 12:17:44 juju-e4d256-prod-github-runner-207 kernel: [24838.893633] ? __fget_files+0x86/0xc0 Aug 22 12:17:44 juju-e4d256-prod-github-runner-207 kernel: [24838.894383] __x64_sys_ioctl+0x95/0xd0 Aug 22 12:17:44 juju-e4d256-prod-github-runner-207 kernel: [24838.895100] do_syscall_64+0x5c/0xc0 Aug 22 12:17:44 juju-e4d256-prod-github-runner-207 kernel: [24838.895785] ? do_futex+0x162/0x1f0 Aug 22 12:17:44 juju-e4d256-prod-github-runner-207 kernel: [24838.896459] ? __x64_sys_futex+0x78/0x1e0 Aug 22 12:17:44 juju-e4d256-prod-github-runner-207 kernel: [24838.897162] ? __secure_computing+0xa9/0x120 Aug 22 12:17:44 juju-e4d256-prod-github-runner-207 kernel: [24838.897890] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 12:17:44 juju-e4d256-prod-github-runner-207 kernel: [24838.898862] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:17:44 juju-e4d256-prod-github-runner-207 kernel: [24838.899768] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:17:44 juju-e4d256-prod-github-runner-207 kernel: [24838.900732] ? do_syscall_64+0x69/0xc0 Aug 22 12:17:44 juju-e4d256-prod-github-runner-207 kernel: [24838.901423] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:17:44 juju-e4d256-prod-github-runner-207 kernel: [24838.902209] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:17:44 juju-e4d256-prod-github-runner-207 kernel: [24838.902983] ? do_syscall_64+0x69/0xc0 Aug 22 12:17:44 juju-e4d256-prod-github-runner-207 kernel: [24838.903680] ? do_syscall_64+0x69/0xc0 Aug 22 12:17:44 juju-e4d256-prod-github-runner-207 kernel: [24838.904383] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 12:17:44 juju-e4d256-prod-github-runner-207 kernel: [24838.905158] RIP: 0033:0x7faa5d0edaff Aug 22 12:17:44 juju-e4d256-prod-github-runner-207 kernel: [24838.905869] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 12:17:44 juju-e4d256-prod-github-runner-207 kernel: [24838.908011] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 12:17:44 juju-e4d256-prod-github-runner-207 kernel: [24838.908980] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 12:17:44 juju-e4d256-prod-github-runner-207 kernel: [24838.909947] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 12:17:44 juju-e4d256-prod-github-runner-207 kernel: [24838.910969] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 12:17:44 juju-e4d256-prod-github-runner-207 kernel: [24838.911917] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 12:17:44 juju-e4d256-prod-github-runner-207 kernel: [24838.912844] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 12:17:44 juju-e4d256-prod-github-runner-207 kernel: [24838.913781] Aug 22 12:18:10 juju-e4d256-prod-github-runner-207 kernel: [24864.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 23048s! [qemu-system-x86:6715] Aug 22 12:18:10 juju-e4d256-prod-github-runner-207 kernel: [24864.543125] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 12:18:10 juju-e4d256-prod-github-runner-207 kernel: [24864.543195] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 12:18:10 juju-e4d256-prod-github-runner-207 kernel: [24864.555813] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 12:18:10 juju-e4d256-prod-github-runner-207 kernel: [24864.557093] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 12:18:10 juju-e4d256-prod-github-runner-207 kernel: [24864.558345] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:18:10 juju-e4d256-prod-github-runner-207 kernel: [24864.559411] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 12:18:10 juju-e4d256-prod-github-runner-207 kernel: [24864.562018] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 12:18:10 juju-e4d256-prod-github-runner-207 kernel: [24864.563068] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 12:18:10 juju-e4d256-prod-github-runner-207 kernel: [24864.564441] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 12:18:10 juju-e4d256-prod-github-runner-207 kernel: [24864.565618] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 12:18:10 juju-e4d256-prod-github-runner-207 kernel: [24864.567006] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 12:18:10 juju-e4d256-prod-github-runner-207 kernel: [24864.568170] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 12:18:10 juju-e4d256-prod-github-runner-207 kernel: [24864.569347] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 12:18:10 juju-e4d256-prod-github-runner-207 kernel: [24864.570647] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 12:18:10 juju-e4d256-prod-github-runner-207 kernel: [24864.571811] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 12:18:10 juju-e4d256-prod-github-runner-207 kernel: [24864.573020] Call Trace: Aug 22 12:18:10 juju-e4d256-prod-github-runner-207 kernel: [24864.573947] Aug 22 12:18:10 juju-e4d256-prod-github-runner-207 kernel: [24864.574852] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:18:10 juju-e4d256-prod-github-runner-207 kernel: [24864.575889] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:18:10 juju-e4d256-prod-github-runner-207 kernel: [24864.576917] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:18:10 juju-e4d256-prod-github-runner-207 kernel: [24864.578020] ? show_regs.part.0+0x23/0x29 Aug 22 12:18:10 juju-e4d256-prod-github-runner-207 kernel: [24864.579029] ? show_regs.cold+0x8/0xd Aug 22 12:18:10 juju-e4d256-prod-github-runner-207 kernel: [24864.580002] ? watchdog_timer_fn+0x1be/0x220 Aug 22 12:18:10 juju-e4d256-prod-github-runner-207 kernel: [24864.581018] ? lockup_detector_update_enable+0x60/0x60 Aug 22 12:18:10 juju-e4d256-prod-github-runner-207 kernel: [24864.582117] ? __hrtimer_run_queues+0x107/0x230 Aug 22 12:18:10 juju-e4d256-prod-github-runner-207 kernel: [24864.583151] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 12:18:10 juju-e4d256-prod-github-runner-207 kernel: [24864.584181] ? hrtimer_interrupt+0x101/0x220 Aug 22 12:18:10 juju-e4d256-prod-github-runner-207 kernel: [24864.585223] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 12:18:10 juju-e4d256-prod-github-runner-207 kernel: [24864.586321] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 12:18:10 juju-e4d256-prod-github-runner-207 kernel: [24864.587379] Aug 22 12:18:10 juju-e4d256-prod-github-runner-207 kernel: [24864.588238] Aug 22 12:18:10 juju-e4d256-prod-github-runner-207 kernel: [24864.589077] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 12:18:10 juju-e4d256-prod-github-runner-207 kernel: [24864.590134] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:18:10 juju-e4d256-prod-github-runner-207 kernel: [24864.591191] ? _raw_spin_lock+0x22/0x30 Aug 22 12:18:10 juju-e4d256-prod-github-runner-207 kernel: [24864.592199] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:18:10 juju-e4d256-prod-github-runner-207 kernel: [24864.593232] direct_page_fault+0x206/0x310 [kvm] Aug 22 12:18:10 juju-e4d256-prod-github-runner-207 kernel: [24864.594293] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 12:18:10 juju-e4d256-prod-github-runner-207 kernel: [24864.595312] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 12:18:10 juju-e4d256-prod-github-runner-207 kernel: [24864.596319] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 12:18:10 juju-e4d256-prod-github-runner-207 kernel: [24864.597298] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 12:18:10 juju-e4d256-prod-github-runner-207 kernel: [24864.598273] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 12:18:10 juju-e4d256-prod-github-runner-207 kernel: [24864.599268] handle_exit+0x98/0x230 [kvm_amd] Aug 22 12:18:10 juju-e4d256-prod-github-runner-207 kernel: [24864.600174] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 12:18:10 juju-e4d256-prod-github-runner-207 kernel: [24864.601102] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 12:18:10 juju-e4d256-prod-github-runner-207 kernel: [24864.602062] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 12:18:10 juju-e4d256-prod-github-runner-207 kernel: [24864.602978] vcpu_run+0x62/0x2c0 [kvm] Aug 22 12:18:10 juju-e4d256-prod-github-runner-207 kernel: [24864.603795] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 12:18:10 juju-e4d256-prod-github-runner-207 kernel: [24864.604612] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 12:18:10 juju-e4d256-prod-github-runner-207 kernel: [24864.605476] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 12:18:10 juju-e4d256-prod-github-runner-207 kernel: [24864.606316] ? __seccomp_filter+0x4a/0x4a0 Aug 22 12:18:10 juju-e4d256-prod-github-runner-207 kernel: [24864.607066] ? __fget_files+0x86/0xc0 Aug 22 12:18:10 juju-e4d256-prod-github-runner-207 kernel: [24864.607777] __x64_sys_ioctl+0x95/0xd0 Aug 22 12:18:10 juju-e4d256-prod-github-runner-207 kernel: [24864.608477] do_syscall_64+0x5c/0xc0 Aug 22 12:18:10 juju-e4d256-prod-github-runner-207 kernel: [24864.609146] ? do_futex+0x162/0x1f0 Aug 22 12:18:10 juju-e4d256-prod-github-runner-207 kernel: [24864.609797] ? __x64_sys_futex+0x78/0x1e0 Aug 22 12:18:10 juju-e4d256-prod-github-runner-207 kernel: [24864.610497] ? __secure_computing+0xa9/0x120 Aug 22 12:18:10 juju-e4d256-prod-github-runner-207 kernel: [24864.611195] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 12:18:10 juju-e4d256-prod-github-runner-207 kernel: [24864.611967] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:18:10 juju-e4d256-prod-github-runner-207 kernel: [24864.612698] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:18:10 juju-e4d256-prod-github-runner-207 kernel: [24864.613424] ? do_syscall_64+0x69/0xc0 Aug 22 12:18:10 juju-e4d256-prod-github-runner-207 kernel: [24864.614093] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:18:10 juju-e4d256-prod-github-runner-207 kernel: [24864.614803] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:18:10 juju-e4d256-prod-github-runner-207 kernel: [24864.615505] ? do_syscall_64+0x69/0xc0 Aug 22 12:18:10 juju-e4d256-prod-github-runner-207 kernel: [24864.616133] ? do_syscall_64+0x69/0xc0 Aug 22 12:18:10 juju-e4d256-prod-github-runner-207 kernel: [24864.616760] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 12:18:10 juju-e4d256-prod-github-runner-207 kernel: [24864.617471] RIP: 0033:0x7faa5d0edaff Aug 22 12:18:10 juju-e4d256-prod-github-runner-207 kernel: [24864.618121] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 12:18:10 juju-e4d256-prod-github-runner-207 kernel: [24864.620143] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 12:18:10 juju-e4d256-prod-github-runner-207 kernel: [24864.621064] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 12:18:10 juju-e4d256-prod-github-runner-207 kernel: [24864.621964] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 12:18:10 juju-e4d256-prod-github-runner-207 kernel: [24864.622882] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 12:18:10 juju-e4d256-prod-github-runner-207 kernel: [24864.623808] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 12:18:10 juju-e4d256-prod-github-runner-207 kernel: [24864.624742] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 12:18:10 juju-e4d256-prod-github-runner-207 kernel: [24864.625665] Aug 22 12:18:38 juju-e4d256-prod-github-runner-207 kernel: [24892.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 23074s! [qemu-system-x86:6715] Aug 22 12:18:38 juju-e4d256-prod-github-runner-207 kernel: [24892.543089] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 12:18:38 juju-e4d256-prod-github-runner-207 kernel: [24892.543159] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 12:18:38 juju-e4d256-prod-github-runner-207 kernel: [24892.555414] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 12:18:38 juju-e4d256-prod-github-runner-207 kernel: [24892.556848] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 12:18:38 juju-e4d256-prod-github-runner-207 kernel: [24892.558200] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:18:38 juju-e4d256-prod-github-runner-207 kernel: [24892.559272] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 12:18:38 juju-e4d256-prod-github-runner-207 kernel: [24892.562088] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 12:18:38 juju-e4d256-prod-github-runner-207 kernel: [24892.563198] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 12:18:38 juju-e4d256-prod-github-runner-207 kernel: [24892.564391] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 12:18:38 juju-e4d256-prod-github-runner-207 kernel: [24892.565565] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 12:18:38 juju-e4d256-prod-github-runner-207 kernel: [24892.566741] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 12:18:38 juju-e4d256-prod-github-runner-207 kernel: [24892.567915] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 12:18:38 juju-e4d256-prod-github-runner-207 kernel: [24892.569225] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 12:18:38 juju-e4d256-prod-github-runner-207 kernel: [24892.570513] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 12:18:38 juju-e4d256-prod-github-runner-207 kernel: [24892.571621] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 12:18:38 juju-e4d256-prod-github-runner-207 kernel: [24892.572825] Call Trace: Aug 22 12:18:38 juju-e4d256-prod-github-runner-207 kernel: [24892.573755] Aug 22 12:18:38 juju-e4d256-prod-github-runner-207 kernel: [24892.574641] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:18:38 juju-e4d256-prod-github-runner-207 kernel: [24892.575680] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:18:38 juju-e4d256-prod-github-runner-207 kernel: [24892.576712] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:18:38 juju-e4d256-prod-github-runner-207 kernel: [24892.577805] ? show_regs.part.0+0x23/0x29 Aug 22 12:18:38 juju-e4d256-prod-github-runner-207 kernel: [24892.578880] ? show_regs.cold+0x8/0xd Aug 22 12:18:38 juju-e4d256-prod-github-runner-207 kernel: [24892.579950] ? watchdog_timer_fn+0x1be/0x220 Aug 22 12:18:38 juju-e4d256-prod-github-runner-207 kernel: [24892.581004] ? lockup_detector_update_enable+0x60/0x60 Aug 22 12:18:38 juju-e4d256-prod-github-runner-207 kernel: [24892.582091] ? __hrtimer_run_queues+0x107/0x230 Aug 22 12:18:38 juju-e4d256-prod-github-runner-207 kernel: [24892.583135] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 12:18:38 juju-e4d256-prod-github-runner-207 kernel: [24892.584171] ? hrtimer_interrupt+0x101/0x220 Aug 22 12:18:38 juju-e4d256-prod-github-runner-207 kernel: [24892.585198] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 12:18:38 juju-e4d256-prod-github-runner-207 kernel: [24892.586322] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 12:18:38 juju-e4d256-prod-github-runner-207 kernel: [24892.587467] Aug 22 12:18:38 juju-e4d256-prod-github-runner-207 kernel: [24892.588344] Aug 22 12:18:38 juju-e4d256-prod-github-runner-207 kernel: [24892.589184] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 12:18:38 juju-e4d256-prod-github-runner-207 kernel: [24892.590302] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:18:38 juju-e4d256-prod-github-runner-207 kernel: [24892.591357] ? _raw_spin_lock+0x22/0x30 Aug 22 12:18:38 juju-e4d256-prod-github-runner-207 kernel: [24892.592309] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:18:38 juju-e4d256-prod-github-runner-207 kernel: [24892.593378] direct_page_fault+0x206/0x310 [kvm] Aug 22 12:18:38 juju-e4d256-prod-github-runner-207 kernel: [24892.594434] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 12:18:38 juju-e4d256-prod-github-runner-207 kernel: [24892.595449] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 12:18:38 juju-e4d256-prod-github-runner-207 kernel: [24892.596457] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 12:18:38 juju-e4d256-prod-github-runner-207 kernel: [24892.597434] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 12:18:38 juju-e4d256-prod-github-runner-207 kernel: [24892.598452] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 12:18:38 juju-e4d256-prod-github-runner-207 kernel: [24892.599508] handle_exit+0x98/0x230 [kvm_amd] Aug 22 12:18:38 juju-e4d256-prod-github-runner-207 kernel: [24892.600413] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 12:18:38 juju-e4d256-prod-github-runner-207 kernel: [24892.601361] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 12:18:38 juju-e4d256-prod-github-runner-207 kernel: [24892.602327] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 12:18:38 juju-e4d256-prod-github-runner-207 kernel: [24892.603241] vcpu_run+0x62/0x2c0 [kvm] Aug 22 12:18:38 juju-e4d256-prod-github-runner-207 kernel: [24892.604059] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 12:18:38 juju-e4d256-prod-github-runner-207 kernel: [24892.604876] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 12:18:38 juju-e4d256-prod-github-runner-207 kernel: [24892.605765] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 12:18:38 juju-e4d256-prod-github-runner-207 kernel: [24892.606571] ? __seccomp_filter+0x4a/0x4a0 Aug 22 12:18:38 juju-e4d256-prod-github-runner-207 kernel: [24892.607321] ? __fget_files+0x86/0xc0 Aug 22 12:18:38 juju-e4d256-prod-github-runner-207 kernel: [24892.608029] __x64_sys_ioctl+0x95/0xd0 Aug 22 12:18:38 juju-e4d256-prod-github-runner-207 kernel: [24892.608770] do_syscall_64+0x5c/0xc0 Aug 22 12:18:38 juju-e4d256-prod-github-runner-207 kernel: [24892.609450] ? do_futex+0x162/0x1f0 Aug 22 12:18:38 juju-e4d256-prod-github-runner-207 kernel: [24892.610164] ? __x64_sys_futex+0x78/0x1e0 Aug 22 12:18:38 juju-e4d256-prod-github-runner-207 kernel: [24892.610858] ? __secure_computing+0xa9/0x120 Aug 22 12:18:38 juju-e4d256-prod-github-runner-207 kernel: [24892.611558] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 12:18:38 juju-e4d256-prod-github-runner-207 kernel: [24892.612334] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:18:38 juju-e4d256-prod-github-runner-207 kernel: [24892.613069] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:18:38 juju-e4d256-prod-github-runner-207 kernel: [24892.613809] ? do_syscall_64+0x69/0xc0 Aug 22 12:18:38 juju-e4d256-prod-github-runner-207 kernel: [24892.614467] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:18:38 juju-e4d256-prod-github-runner-207 kernel: [24892.615181] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:18:38 juju-e4d256-prod-github-runner-207 kernel: [24892.615888] ? do_syscall_64+0x69/0xc0 Aug 22 12:18:38 juju-e4d256-prod-github-runner-207 kernel: [24892.616595] ? do_syscall_64+0x69/0xc0 Aug 22 12:18:38 juju-e4d256-prod-github-runner-207 kernel: [24892.617347] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 12:18:38 juju-e4d256-prod-github-runner-207 kernel: [24892.618266] RIP: 0033:0x7faa5d0edaff Aug 22 12:18:38 juju-e4d256-prod-github-runner-207 kernel: [24892.618912] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 12:18:38 juju-e4d256-prod-github-runner-207 kernel: [24892.620956] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 12:18:38 juju-e4d256-prod-github-runner-207 kernel: [24892.621911] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 12:18:38 juju-e4d256-prod-github-runner-207 kernel: [24892.622819] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 12:18:38 juju-e4d256-prod-github-runner-207 kernel: [24892.623728] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 12:18:38 juju-e4d256-prod-github-runner-207 kernel: [24892.624639] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 12:18:38 juju-e4d256-prod-github-runner-207 kernel: [24892.625543] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 12:18:38 juju-e4d256-prod-github-runner-207 kernel: [24892.626480] Aug 22 12:19:06 juju-e4d256-prod-github-runner-207 kernel: [24920.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 23101s! [qemu-system-x86:6715] Aug 22 12:19:06 juju-e4d256-prod-github-runner-207 kernel: [24920.543888] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 12:19:06 juju-e4d256-prod-github-runner-207 kernel: [24920.544195] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 12:19:06 juju-e4d256-prod-github-runner-207 kernel: [24920.556433] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 12:19:06 juju-e4d256-prod-github-runner-207 kernel: [24920.557725] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 12:19:06 juju-e4d256-prod-github-runner-207 kernel: [24920.558949] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:19:06 juju-e4d256-prod-github-runner-207 kernel: [24920.560022] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 12:19:06 juju-e4d256-prod-github-runner-207 kernel: [24920.562704] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 12:19:06 juju-e4d256-prod-github-runner-207 kernel: [24920.563755] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 12:19:06 juju-e4d256-prod-github-runner-207 kernel: [24920.564920] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 12:19:06 juju-e4d256-prod-github-runner-207 kernel: [24920.566094] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 12:19:06 juju-e4d256-prod-github-runner-207 kernel: [24920.567254] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 12:19:06 juju-e4d256-prod-github-runner-207 kernel: [24920.568430] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 12:19:06 juju-e4d256-prod-github-runner-207 kernel: [24920.569620] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 12:19:06 juju-e4d256-prod-github-runner-207 kernel: [24920.570853] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 12:19:06 juju-e4d256-prod-github-runner-207 kernel: [24920.571951] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 12:19:06 juju-e4d256-prod-github-runner-207 kernel: [24920.573142] Call Trace: Aug 22 12:19:06 juju-e4d256-prod-github-runner-207 kernel: [24920.574096] Aug 22 12:19:06 juju-e4d256-prod-github-runner-207 kernel: [24920.575042] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:19:06 juju-e4d256-prod-github-runner-207 kernel: [24920.576097] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:19:06 juju-e4d256-prod-github-runner-207 kernel: [24920.577148] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:19:06 juju-e4d256-prod-github-runner-207 kernel: [24920.578284] ? show_regs.part.0+0x23/0x29 Aug 22 12:19:06 juju-e4d256-prod-github-runner-207 kernel: [24920.579394] ? show_regs.cold+0x8/0xd Aug 22 12:19:06 juju-e4d256-prod-github-runner-207 kernel: [24920.580526] ? watchdog_timer_fn+0x1be/0x220 Aug 22 12:19:06 juju-e4d256-prod-github-runner-207 kernel: [24920.581562] ? lockup_detector_update_enable+0x60/0x60 Aug 22 12:19:06 juju-e4d256-prod-github-runner-207 kernel: [24920.582637] ? __hrtimer_run_queues+0x107/0x230 Aug 22 12:19:06 juju-e4d256-prod-github-runner-207 kernel: [24920.583886] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 12:19:06 juju-e4d256-prod-github-runner-207 kernel: [24920.584965] ? hrtimer_interrupt+0x101/0x220 Aug 22 12:19:06 juju-e4d256-prod-github-runner-207 kernel: [24920.586155] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 12:19:06 juju-e4d256-prod-github-runner-207 kernel: [24920.587492] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 12:19:06 juju-e4d256-prod-github-runner-207 kernel: [24920.588669] Aug 22 12:19:06 juju-e4d256-prod-github-runner-207 kernel: [24920.589610] Aug 22 12:19:06 juju-e4d256-prod-github-runner-207 kernel: [24920.590510] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 12:19:06 juju-e4d256-prod-github-runner-207 kernel: [24920.591647] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:19:06 juju-e4d256-prod-github-runner-207 kernel: [24920.592789] ? _raw_spin_lock+0x22/0x30 Aug 22 12:19:06 juju-e4d256-prod-github-runner-207 kernel: [24920.593864] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:19:06 juju-e4d256-prod-github-runner-207 kernel: [24920.595022] direct_page_fault+0x206/0x310 [kvm] Aug 22 12:19:06 juju-e4d256-prod-github-runner-207 kernel: [24920.596184] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 12:19:06 juju-e4d256-prod-github-runner-207 kernel: [24920.597342] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 12:19:06 juju-e4d256-prod-github-runner-207 kernel: [24920.598494] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 12:19:06 juju-e4d256-prod-github-runner-207 kernel: [24920.599624] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 12:19:06 juju-e4d256-prod-github-runner-207 kernel: [24920.600675] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 12:19:06 juju-e4d256-prod-github-runner-207 kernel: [24920.601828] handle_exit+0x98/0x230 [kvm_amd] Aug 22 12:19:06 juju-e4d256-prod-github-runner-207 kernel: [24920.602830] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 12:19:06 juju-e4d256-prod-github-runner-207 kernel: [24920.603858] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 12:19:06 juju-e4d256-prod-github-runner-207 kernel: [24920.604901] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 12:19:06 juju-e4d256-prod-github-runner-207 kernel: [24920.605946] vcpu_run+0x62/0x2c0 [kvm] Aug 22 12:19:06 juju-e4d256-prod-github-runner-207 kernel: [24920.606840] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 12:19:06 juju-e4d256-prod-github-runner-207 kernel: [24920.607743] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 12:19:06 juju-e4d256-prod-github-runner-207 kernel: [24920.608699] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 12:19:06 juju-e4d256-prod-github-runner-207 kernel: [24920.609605] ? __seccomp_filter+0x4a/0x4a0 Aug 22 12:19:06 juju-e4d256-prod-github-runner-207 kernel: [24920.610435] ? __fget_files+0x86/0xc0 Aug 22 12:19:06 juju-e4d256-prod-github-runner-207 kernel: [24920.611234] __x64_sys_ioctl+0x95/0xd0 Aug 22 12:19:06 juju-e4d256-prod-github-runner-207 kernel: [24920.612011] do_syscall_64+0x5c/0xc0 Aug 22 12:19:06 juju-e4d256-prod-github-runner-207 kernel: [24920.612758] ? do_futex+0x162/0x1f0 Aug 22 12:19:06 juju-e4d256-prod-github-runner-207 kernel: [24920.613497] ? __x64_sys_futex+0x78/0x1e0 Aug 22 12:19:06 juju-e4d256-prod-github-runner-207 kernel: [24920.614256] ? __secure_computing+0xa9/0x120 Aug 22 12:19:06 juju-e4d256-prod-github-runner-207 kernel: [24920.615034] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 12:19:06 juju-e4d256-prod-github-runner-207 kernel: [24920.615905] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:19:06 juju-e4d256-prod-github-runner-207 kernel: [24920.616729] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:19:06 juju-e4d256-prod-github-runner-207 kernel: [24920.617590] ? do_syscall_64+0x69/0xc0 Aug 22 12:19:06 juju-e4d256-prod-github-runner-207 kernel: [24920.618338] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:19:06 juju-e4d256-prod-github-runner-207 kernel: [24920.619189] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:19:06 juju-e4d256-prod-github-runner-207 kernel: [24920.620012] ? do_syscall_64+0x69/0xc0 Aug 22 12:19:06 juju-e4d256-prod-github-runner-207 kernel: [24920.620754] ? do_syscall_64+0x69/0xc0 Aug 22 12:19:06 juju-e4d256-prod-github-runner-207 kernel: [24920.621493] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 12:19:06 juju-e4d256-prod-github-runner-207 kernel: [24920.622317] RIP: 0033:0x7faa5d0edaff Aug 22 12:19:06 juju-e4d256-prod-github-runner-207 kernel: [24920.623055] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 12:19:06 juju-e4d256-prod-github-runner-207 kernel: [24920.625452] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 12:19:06 juju-e4d256-prod-github-runner-207 kernel: [24920.626534] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 12:19:06 juju-e4d256-prod-github-runner-207 kernel: [24920.627571] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 12:19:06 juju-e4d256-prod-github-runner-207 kernel: [24920.628601] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 12:19:06 juju-e4d256-prod-github-runner-207 kernel: [24920.629658] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 12:19:06 juju-e4d256-prod-github-runner-207 kernel: [24920.630685] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 12:19:06 juju-e4d256-prod-github-runner-207 kernel: [24920.631717] Aug 22 12:19:34 juju-e4d256-prod-github-runner-207 kernel: [24948.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 23127s! [qemu-system-x86:6715] Aug 22 12:19:34 juju-e4d256-prod-github-runner-207 kernel: [24948.543094] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 12:19:34 juju-e4d256-prod-github-runner-207 kernel: [24948.543169] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 12:19:34 juju-e4d256-prod-github-runner-207 kernel: [24948.555519] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 12:19:34 juju-e4d256-prod-github-runner-207 kernel: [24948.556793] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 12:19:34 juju-e4d256-prod-github-runner-207 kernel: [24948.558031] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:19:34 juju-e4d256-prod-github-runner-207 kernel: [24948.559087] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 12:19:34 juju-e4d256-prod-github-runner-207 kernel: [24948.561658] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 12:19:34 juju-e4d256-prod-github-runner-207 kernel: [24948.562705] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 12:19:34 juju-e4d256-prod-github-runner-207 kernel: [24948.563871] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 12:19:34 juju-e4d256-prod-github-runner-207 kernel: [24948.565044] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 12:19:34 juju-e4d256-prod-github-runner-207 kernel: [24948.566205] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 12:19:34 juju-e4d256-prod-github-runner-207 kernel: [24948.567387] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 12:19:34 juju-e4d256-prod-github-runner-207 kernel: [24948.568572] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 12:19:34 juju-e4d256-prod-github-runner-207 kernel: [24948.569863] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 12:19:34 juju-e4d256-prod-github-runner-207 kernel: [24948.570962] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 12:19:34 juju-e4d256-prod-github-runner-207 kernel: [24948.572251] Call Trace: Aug 22 12:19:34 juju-e4d256-prod-github-runner-207 kernel: [24948.573246] Aug 22 12:19:34 juju-e4d256-prod-github-runner-207 kernel: [24948.574156] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:19:34 juju-e4d256-prod-github-runner-207 kernel: [24948.575490] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:19:34 juju-e4d256-prod-github-runner-207 kernel: [24948.576581] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:19:34 juju-e4d256-prod-github-runner-207 kernel: [24948.577742] ? show_regs.part.0+0x23/0x29 Aug 22 12:19:34 juju-e4d256-prod-github-runner-207 kernel: [24948.578774] ? show_regs.cold+0x8/0xd Aug 22 12:19:34 juju-e4d256-prod-github-runner-207 kernel: [24948.579749] ? watchdog_timer_fn+0x1be/0x220 Aug 22 12:19:34 juju-e4d256-prod-github-runner-207 kernel: [24948.580794] ? lockup_detector_update_enable+0x60/0x60 Aug 22 12:19:34 juju-e4d256-prod-github-runner-207 kernel: [24948.581903] ? __hrtimer_run_queues+0x107/0x230 Aug 22 12:19:34 juju-e4d256-prod-github-runner-207 kernel: [24948.582960] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 12:19:34 juju-e4d256-prod-github-runner-207 kernel: [24948.584019] ? hrtimer_interrupt+0x101/0x220 Aug 22 12:19:34 juju-e4d256-prod-github-runner-207 kernel: [24948.585066] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 12:19:34 juju-e4d256-prod-github-runner-207 kernel: [24948.586172] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 12:19:34 juju-e4d256-prod-github-runner-207 kernel: [24948.587253] Aug 22 12:19:34 juju-e4d256-prod-github-runner-207 kernel: [24948.588116] Aug 22 12:19:34 juju-e4d256-prod-github-runner-207 kernel: [24948.589002] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 12:19:34 juju-e4d256-prod-github-runner-207 kernel: [24948.590046] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:19:34 juju-e4d256-prod-github-runner-207 kernel: [24948.591095] ? _raw_spin_lock+0x22/0x30 Aug 22 12:19:34 juju-e4d256-prod-github-runner-207 kernel: [24948.592062] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:19:34 juju-e4d256-prod-github-runner-207 kernel: [24948.593123] direct_page_fault+0x206/0x310 [kvm] Aug 22 12:19:34 juju-e4d256-prod-github-runner-207 kernel: [24948.594190] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 12:19:34 juju-e4d256-prod-github-runner-207 kernel: [24948.595216] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 12:19:34 juju-e4d256-prod-github-runner-207 kernel: [24948.596219] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 12:19:34 juju-e4d256-prod-github-runner-207 kernel: [24948.597236] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 12:19:34 juju-e4d256-prod-github-runner-207 kernel: [24948.598207] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 12:19:34 juju-e4d256-prod-github-runner-207 kernel: [24948.599198] handle_exit+0x98/0x230 [kvm_amd] Aug 22 12:19:34 juju-e4d256-prod-github-runner-207 kernel: [24948.600107] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 12:19:34 juju-e4d256-prod-github-runner-207 kernel: [24948.601058] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 12:19:34 juju-e4d256-prod-github-runner-207 kernel: [24948.602007] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 12:19:34 juju-e4d256-prod-github-runner-207 kernel: [24948.603007] vcpu_run+0x62/0x2c0 [kvm] Aug 22 12:19:34 juju-e4d256-prod-github-runner-207 kernel: [24948.603838] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 12:19:34 juju-e4d256-prod-github-runner-207 kernel: [24948.604648] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 12:19:34 juju-e4d256-prod-github-runner-207 kernel: [24948.605544] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 12:19:34 juju-e4d256-prod-github-runner-207 kernel: [24948.606375] ? __seccomp_filter+0x4a/0x4a0 Aug 22 12:19:34 juju-e4d256-prod-github-runner-207 kernel: [24948.607295] ? __fget_files+0x86/0xc0 Aug 22 12:19:34 juju-e4d256-prod-github-runner-207 kernel: [24948.608255] __x64_sys_ioctl+0x95/0xd0 Aug 22 12:19:34 juju-e4d256-prod-github-runner-207 kernel: [24948.608992] do_syscall_64+0x5c/0xc0 Aug 22 12:19:34 juju-e4d256-prod-github-runner-207 kernel: [24948.609674] ? do_futex+0x162/0x1f0 Aug 22 12:19:34 juju-e4d256-prod-github-runner-207 kernel: [24948.610328] ? __x64_sys_futex+0x78/0x1e0 Aug 22 12:19:34 juju-e4d256-prod-github-runner-207 kernel: [24948.611041] ? __secure_computing+0xa9/0x120 Aug 22 12:19:34 juju-e4d256-prod-github-runner-207 kernel: [24948.611732] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 12:19:34 juju-e4d256-prod-github-runner-207 kernel: [24948.612514] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:19:34 juju-e4d256-prod-github-runner-207 kernel: [24948.613288] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:19:34 juju-e4d256-prod-github-runner-207 kernel: [24948.614011] ? do_syscall_64+0x69/0xc0 Aug 22 12:19:34 juju-e4d256-prod-github-runner-207 kernel: [24948.614666] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:19:34 juju-e4d256-prod-github-runner-207 kernel: [24948.615366] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:19:34 juju-e4d256-prod-github-runner-207 kernel: [24948.616061] ? do_syscall_64+0x69/0xc0 Aug 22 12:19:34 juju-e4d256-prod-github-runner-207 kernel: [24948.616684] ? do_syscall_64+0x69/0xc0 Aug 22 12:19:34 juju-e4d256-prod-github-runner-207 kernel: [24948.617338] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 12:19:34 juju-e4d256-prod-github-runner-207 kernel: [24948.618058] RIP: 0033:0x7faa5d0edaff Aug 22 12:19:34 juju-e4d256-prod-github-runner-207 kernel: [24948.618699] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 12:19:34 juju-e4d256-prod-github-runner-207 kernel: [24948.620689] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 12:19:34 juju-e4d256-prod-github-runner-207 kernel: [24948.621620] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 12:19:34 juju-e4d256-prod-github-runner-207 kernel: [24948.622524] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 12:19:34 juju-e4d256-prod-github-runner-207 kernel: [24948.623444] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 12:19:34 juju-e4d256-prod-github-runner-207 kernel: [24948.624370] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 12:19:34 juju-e4d256-prod-github-runner-207 kernel: [24948.625284] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 12:19:34 juju-e4d256-prod-github-runner-207 kernel: [24948.626174] Aug 22 12:20:02 juju-e4d256-prod-github-runner-207 kernel: [24976.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 23153s! [qemu-system-x86:6715] Aug 22 12:20:02 juju-e4d256-prod-github-runner-207 kernel: [24976.543142] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 12:20:02 juju-e4d256-prod-github-runner-207 kernel: [24976.543221] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 12:20:02 juju-e4d256-prod-github-runner-207 kernel: [24976.555681] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 12:20:02 juju-e4d256-prod-github-runner-207 kernel: [24976.556995] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 12:20:02 juju-e4d256-prod-github-runner-207 kernel: [24976.558231] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:20:02 juju-e4d256-prod-github-runner-207 kernel: [24976.559304] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 12:20:02 juju-e4d256-prod-github-runner-207 kernel: [24976.561905] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 12:20:02 juju-e4d256-prod-github-runner-207 kernel: [24976.562969] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 12:20:02 juju-e4d256-prod-github-runner-207 kernel: [24976.564142] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 12:20:02 juju-e4d256-prod-github-runner-207 kernel: [24976.565388] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 12:20:02 juju-e4d256-prod-github-runner-207 kernel: [24976.566646] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 12:20:02 juju-e4d256-prod-github-runner-207 kernel: [24976.567889] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 12:20:02 juju-e4d256-prod-github-runner-207 kernel: [24976.569137] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 12:20:02 juju-e4d256-prod-github-runner-207 kernel: [24976.570416] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 12:20:02 juju-e4d256-prod-github-runner-207 kernel: [24976.571541] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 12:20:02 juju-e4d256-prod-github-runner-207 kernel: [24976.573000] Call Trace: Aug 22 12:20:02 juju-e4d256-prod-github-runner-207 kernel: [24976.573929] Aug 22 12:20:02 juju-e4d256-prod-github-runner-207 kernel: [24976.574814] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:20:02 juju-e4d256-prod-github-runner-207 kernel: [24976.575851] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:20:02 juju-e4d256-prod-github-runner-207 kernel: [24976.576897] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:20:02 juju-e4d256-prod-github-runner-207 kernel: [24976.577986] ? show_regs.part.0+0x23/0x29 Aug 22 12:20:02 juju-e4d256-prod-github-runner-207 kernel: [24976.578991] ? show_regs.cold+0x8/0xd Aug 22 12:20:02 juju-e4d256-prod-github-runner-207 kernel: [24976.580003] ? watchdog_timer_fn+0x1be/0x220 Aug 22 12:20:02 juju-e4d256-prod-github-runner-207 kernel: [24976.581053] ? lockup_detector_update_enable+0x60/0x60 Aug 22 12:20:02 juju-e4d256-prod-github-runner-207 kernel: [24976.582135] ? __hrtimer_run_queues+0x107/0x230 Aug 22 12:20:02 juju-e4d256-prod-github-runner-207 kernel: [24976.583171] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 12:20:02 juju-e4d256-prod-github-runner-207 kernel: [24976.584217] ? hrtimer_interrupt+0x101/0x220 Aug 22 12:20:02 juju-e4d256-prod-github-runner-207 kernel: [24976.585250] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 12:20:02 juju-e4d256-prod-github-runner-207 kernel: [24976.586323] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 12:20:02 juju-e4d256-prod-github-runner-207 kernel: [24976.587379] Aug 22 12:20:02 juju-e4d256-prod-github-runner-207 kernel: [24976.588233] Aug 22 12:20:02 juju-e4d256-prod-github-runner-207 kernel: [24976.589092] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 12:20:02 juju-e4d256-prod-github-runner-207 kernel: [24976.590140] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:20:02 juju-e4d256-prod-github-runner-207 kernel: [24976.591219] ? _raw_spin_lock+0x22/0x30 Aug 22 12:20:02 juju-e4d256-prod-github-runner-207 kernel: [24976.592174] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:20:02 juju-e4d256-prod-github-runner-207 kernel: [24976.593219] direct_page_fault+0x206/0x310 [kvm] Aug 22 12:20:02 juju-e4d256-prod-github-runner-207 kernel: [24976.594247] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 12:20:02 juju-e4d256-prod-github-runner-207 kernel: [24976.595261] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 12:20:02 juju-e4d256-prod-github-runner-207 kernel: [24976.596272] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 12:20:02 juju-e4d256-prod-github-runner-207 kernel: [24976.597258] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 12:20:02 juju-e4d256-prod-github-runner-207 kernel: [24976.598210] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 12:20:02 juju-e4d256-prod-github-runner-207 kernel: [24976.599246] handle_exit+0x98/0x230 [kvm_amd] Aug 22 12:20:02 juju-e4d256-prod-github-runner-207 kernel: [24976.600163] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 12:20:02 juju-e4d256-prod-github-runner-207 kernel: [24976.601123] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 12:20:02 juju-e4d256-prod-github-runner-207 kernel: [24976.602057] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 12:20:02 juju-e4d256-prod-github-runner-207 kernel: [24976.602977] vcpu_run+0x62/0x2c0 [kvm] Aug 22 12:20:02 juju-e4d256-prod-github-runner-207 kernel: [24976.603794] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 12:20:02 juju-e4d256-prod-github-runner-207 kernel: [24976.604637] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 12:20:02 juju-e4d256-prod-github-runner-207 kernel: [24976.605507] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 12:20:02 juju-e4d256-prod-github-runner-207 kernel: [24976.606316] ? __seccomp_filter+0x4a/0x4a0 Aug 22 12:20:02 juju-e4d256-prod-github-runner-207 kernel: [24976.607065] ? __fget_files+0x86/0xc0 Aug 22 12:20:02 juju-e4d256-prod-github-runner-207 kernel: [24976.607825] __x64_sys_ioctl+0x95/0xd0 Aug 22 12:20:02 juju-e4d256-prod-github-runner-207 kernel: [24976.608542] do_syscall_64+0x5c/0xc0 Aug 22 12:20:02 juju-e4d256-prod-github-runner-207 kernel: [24976.609233] ? do_futex+0x162/0x1f0 Aug 22 12:20:02 juju-e4d256-prod-github-runner-207 kernel: [24976.609905] ? __x64_sys_futex+0x78/0x1e0 Aug 22 12:20:02 juju-e4d256-prod-github-runner-207 kernel: [24976.610592] ? __secure_computing+0xa9/0x120 Aug 22 12:20:02 juju-e4d256-prod-github-runner-207 kernel: [24976.611292] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 12:20:02 juju-e4d256-prod-github-runner-207 kernel: [24976.612063] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:20:02 juju-e4d256-prod-github-runner-207 kernel: [24976.612813] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:20:02 juju-e4d256-prod-github-runner-207 kernel: [24976.613539] ? do_syscall_64+0x69/0xc0 Aug 22 12:20:02 juju-e4d256-prod-github-runner-207 kernel: [24976.614189] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:20:02 juju-e4d256-prod-github-runner-207 kernel: [24976.614900] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:20:02 juju-e4d256-prod-github-runner-207 kernel: [24976.615609] ? do_syscall_64+0x69/0xc0 Aug 22 12:20:02 juju-e4d256-prod-github-runner-207 kernel: [24976.616242] ? do_syscall_64+0x69/0xc0 Aug 22 12:20:02 juju-e4d256-prod-github-runner-207 kernel: [24976.616883] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 12:20:02 juju-e4d256-prod-github-runner-207 kernel: [24976.617597] RIP: 0033:0x7faa5d0edaff Aug 22 12:20:02 juju-e4d256-prod-github-runner-207 kernel: [24976.618231] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 12:20:02 juju-e4d256-prod-github-runner-207 kernel: [24976.620253] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 12:20:02 juju-e4d256-prod-github-runner-207 kernel: [24976.621188] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 12:20:02 juju-e4d256-prod-github-runner-207 kernel: [24976.622085] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 12:20:02 juju-e4d256-prod-github-runner-207 kernel: [24976.622985] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 12:20:02 juju-e4d256-prod-github-runner-207 kernel: [24976.623879] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 12:20:02 juju-e4d256-prod-github-runner-207 kernel: [24976.624799] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 12:20:02 juju-e4d256-prod-github-runner-207 kernel: [24976.625729] Aug 22 12:20:30 juju-e4d256-prod-github-runner-207 kernel: [25004.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 23179s! [qemu-system-x86:6715] Aug 22 12:20:30 juju-e4d256-prod-github-runner-207 kernel: [25004.543887] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 12:20:30 juju-e4d256-prod-github-runner-207 kernel: [25004.544198] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 12:20:30 juju-e4d256-prod-github-runner-207 kernel: [25004.556668] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 12:20:30 juju-e4d256-prod-github-runner-207 kernel: [25004.557989] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 12:20:30 juju-e4d256-prod-github-runner-207 kernel: [25004.559202] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:20:30 juju-e4d256-prod-github-runner-207 kernel: [25004.560298] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 12:20:30 juju-e4d256-prod-github-runner-207 kernel: [25004.562857] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 12:20:30 juju-e4d256-prod-github-runner-207 kernel: [25004.563902] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 12:20:30 juju-e4d256-prod-github-runner-207 kernel: [25004.565076] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 12:20:30 juju-e4d256-prod-github-runner-207 kernel: [25004.566263] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 12:20:30 juju-e4d256-prod-github-runner-207 kernel: [25004.567441] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 12:20:30 juju-e4d256-prod-github-runner-207 kernel: [25004.568632] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 12:20:30 juju-e4d256-prod-github-runner-207 kernel: [25004.569802] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 12:20:30 juju-e4d256-prod-github-runner-207 kernel: [25004.571038] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 12:20:30 juju-e4d256-prod-github-runner-207 kernel: [25004.572133] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 12:20:30 juju-e4d256-prod-github-runner-207 kernel: [25004.573336] Call Trace: Aug 22 12:20:30 juju-e4d256-prod-github-runner-207 kernel: [25004.574249] Aug 22 12:20:30 juju-e4d256-prod-github-runner-207 kernel: [25004.575149] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:20:30 juju-e4d256-prod-github-runner-207 kernel: [25004.576174] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:20:30 juju-e4d256-prod-github-runner-207 kernel: [25004.577235] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:20:30 juju-e4d256-prod-github-runner-207 kernel: [25004.578328] ? show_regs.part.0+0x23/0x29 Aug 22 12:20:30 juju-e4d256-prod-github-runner-207 kernel: [25004.579322] ? show_regs.cold+0x8/0xd Aug 22 12:20:30 juju-e4d256-prod-github-runner-207 kernel: [25004.580311] ? watchdog_timer_fn+0x1be/0x220 Aug 22 12:20:30 juju-e4d256-prod-github-runner-207 kernel: [25004.581318] ? lockup_detector_update_enable+0x60/0x60 Aug 22 12:20:30 juju-e4d256-prod-github-runner-207 kernel: [25004.582380] ? __hrtimer_run_queues+0x107/0x230 Aug 22 12:20:30 juju-e4d256-prod-github-runner-207 kernel: [25004.583428] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 12:20:30 juju-e4d256-prod-github-runner-207 kernel: [25004.584476] ? hrtimer_interrupt+0x101/0x220 Aug 22 12:20:30 juju-e4d256-prod-github-runner-207 kernel: [25004.585531] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 12:20:30 juju-e4d256-prod-github-runner-207 kernel: [25004.586600] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 12:20:30 juju-e4d256-prod-github-runner-207 kernel: [25004.587673] Aug 22 12:20:30 juju-e4d256-prod-github-runner-207 kernel: [25004.588563] Aug 22 12:20:30 juju-e4d256-prod-github-runner-207 kernel: [25004.589433] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 12:20:30 juju-e4d256-prod-github-runner-207 kernel: [25004.590475] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:20:30 juju-e4d256-prod-github-runner-207 kernel: [25004.591547] ? _raw_spin_lock+0x22/0x30 Aug 22 12:20:30 juju-e4d256-prod-github-runner-207 kernel: [25004.592529] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:20:30 juju-e4d256-prod-github-runner-207 kernel: [25004.593550] direct_page_fault+0x206/0x310 [kvm] Aug 22 12:20:30 juju-e4d256-prod-github-runner-207 kernel: [25004.594575] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 12:20:30 juju-e4d256-prod-github-runner-207 kernel: [25004.595586] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 12:20:30 juju-e4d256-prod-github-runner-207 kernel: [25004.596603] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 12:20:30 juju-e4d256-prod-github-runner-207 kernel: [25004.597655] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 12:20:30 juju-e4d256-prod-github-runner-207 kernel: [25004.598634] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 12:20:30 juju-e4d256-prod-github-runner-207 kernel: [25004.599610] handle_exit+0x98/0x230 [kvm_amd] Aug 22 12:20:30 juju-e4d256-prod-github-runner-207 kernel: [25004.600534] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 12:20:30 juju-e4d256-prod-github-runner-207 kernel: [25004.601458] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 12:20:30 juju-e4d256-prod-github-runner-207 kernel: [25004.602381] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 12:20:30 juju-e4d256-prod-github-runner-207 kernel: [25004.603282] vcpu_run+0x62/0x2c0 [kvm] Aug 22 12:20:30 juju-e4d256-prod-github-runner-207 kernel: [25004.604092] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 12:20:30 juju-e4d256-prod-github-runner-207 kernel: [25004.604920] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 12:20:30 juju-e4d256-prod-github-runner-207 kernel: [25004.605772] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 12:20:30 juju-e4d256-prod-github-runner-207 kernel: [25004.606570] ? __seccomp_filter+0x4a/0x4a0 Aug 22 12:20:30 juju-e4d256-prod-github-runner-207 kernel: [25004.607311] ? __fget_files+0x86/0xc0 Aug 22 12:20:30 juju-e4d256-prod-github-runner-207 kernel: [25004.608046] __x64_sys_ioctl+0x95/0xd0 Aug 22 12:20:30 juju-e4d256-prod-github-runner-207 kernel: [25004.608874] do_syscall_64+0x5c/0xc0 Aug 22 12:20:30 juju-e4d256-prod-github-runner-207 kernel: [25004.609542] ? do_futex+0x162/0x1f0 Aug 22 12:20:30 juju-e4d256-prod-github-runner-207 kernel: [25004.610189] ? __x64_sys_futex+0x78/0x1e0 Aug 22 12:20:30 juju-e4d256-prod-github-runner-207 kernel: [25004.610859] ? __secure_computing+0xa9/0x120 Aug 22 12:20:30 juju-e4d256-prod-github-runner-207 kernel: [25004.611554] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 12:20:30 juju-e4d256-prod-github-runner-207 kernel: [25004.612332] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:20:30 juju-e4d256-prod-github-runner-207 kernel: [25004.613052] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:20:30 juju-e4d256-prod-github-runner-207 kernel: [25004.613768] ? do_syscall_64+0x69/0xc0 Aug 22 12:20:30 juju-e4d256-prod-github-runner-207 kernel: [25004.614416] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:20:30 juju-e4d256-prod-github-runner-207 kernel: [25004.615126] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:20:30 juju-e4d256-prod-github-runner-207 kernel: [25004.615845] ? do_syscall_64+0x69/0xc0 Aug 22 12:20:30 juju-e4d256-prod-github-runner-207 kernel: [25004.616481] ? do_syscall_64+0x69/0xc0 Aug 22 12:20:30 juju-e4d256-prod-github-runner-207 kernel: [25004.617117] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 12:20:30 juju-e4d256-prod-github-runner-207 kernel: [25004.617851] RIP: 0033:0x7faa5d0edaff Aug 22 12:20:30 juju-e4d256-prod-github-runner-207 kernel: [25004.618533] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 12:20:30 juju-e4d256-prod-github-runner-207 kernel: [25004.620555] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 12:20:30 juju-e4d256-prod-github-runner-207 kernel: [25004.621489] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 12:20:30 juju-e4d256-prod-github-runner-207 kernel: [25004.622382] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 12:20:30 juju-e4d256-prod-github-runner-207 kernel: [25004.623265] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 12:20:30 juju-e4d256-prod-github-runner-207 kernel: [25004.624148] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 12:20:30 juju-e4d256-prod-github-runner-207 kernel: [25004.625052] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 12:20:30 juju-e4d256-prod-github-runner-207 kernel: [25004.625944] Aug 22 12:20:44 juju-e4d256-prod-github-runner-207 kernel: [25018.856705] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 12:20:44 juju-e4d256-prod-github-runner-207 kernel: [25018.857683] rcu: 1-....: (6205996 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=3003429 Aug 22 12:20:44 juju-e4d256-prod-github-runner-207 kernel: [25018.858806] (t=6225414 jiffies g=23269 q=29803) Aug 22 12:20:44 juju-e4d256-prod-github-runner-207 kernel: [25018.859589] NMI backtrace for cpu 1 Aug 22 12:20:44 juju-e4d256-prod-github-runner-207 kernel: [25018.860318] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 12:20:44 juju-e4d256-prod-github-runner-207 kernel: [25018.861427] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 12:20:44 juju-e4d256-prod-github-runner-207 kernel: [25018.862486] Call Trace: Aug 22 12:20:44 juju-e4d256-prod-github-runner-207 kernel: [25018.863159] Aug 22 12:20:44 juju-e4d256-prod-github-runner-207 kernel: [25018.863811] show_stack+0x52/0x5c Aug 22 12:20:44 juju-e4d256-prod-github-runner-207 kernel: [25018.864545] dump_stack_lvl+0x4a/0x63 Aug 22 12:20:44 juju-e4d256-prod-github-runner-207 kernel: [25018.865295] dump_stack+0x10/0x16 Aug 22 12:20:44 juju-e4d256-prod-github-runner-207 kernel: [25018.866012] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 12:20:44 juju-e4d256-prod-github-runner-207 kernel: [25018.866790] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 12:20:44 juju-e4d256-prod-github-runner-207 kernel: [25018.867572] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 12:20:44 juju-e4d256-prod-github-runner-207 kernel: [25018.868399] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 12:20:44 juju-e4d256-prod-github-runner-207 kernel: [25018.869223] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 12:20:44 juju-e4d256-prod-github-runner-207 kernel: [25018.870043] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 12:20:44 juju-e4d256-prod-github-runner-207 kernel: [25018.870835] print_cpu_stall.cold+0x2f/0xe2 Aug 22 12:20:44 juju-e4d256-prod-github-runner-207 kernel: [25018.871597] ? timekeeping_update+0xf7/0x150 Aug 22 12:20:44 juju-e4d256-prod-github-runner-207 kernel: [25018.872384] check_cpu_stall+0x109/0x270 Aug 22 12:20:44 juju-e4d256-prod-github-runner-207 kernel: [25018.873131] rcu_sched_clock_irq+0x9a/0x250 Aug 22 12:20:44 juju-e4d256-prod-github-runner-207 kernel: [25018.873894] update_process_times+0x94/0xd0 Aug 22 12:20:44 juju-e4d256-prod-github-runner-207 kernel: [25018.874652] tick_sched_handle+0x29/0x70 Aug 22 12:20:44 juju-e4d256-prod-github-runner-207 kernel: [25018.875399] tick_sched_timer+0x8c/0xc0 Aug 22 12:20:44 juju-e4d256-prod-github-runner-207 kernel: [25018.876143] ? tick_nohz_handler+0xb0/0xb0 Aug 22 12:20:44 juju-e4d256-prod-github-runner-207 kernel: [25018.876901] __hrtimer_run_queues+0x107/0x230 Aug 22 12:20:44 juju-e4d256-prod-github-runner-207 kernel: [25018.877670] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 12:20:44 juju-e4d256-prod-github-runner-207 kernel: [25018.878449] hrtimer_interrupt+0x101/0x220 Aug 22 12:20:44 juju-e4d256-prod-github-runner-207 kernel: [25018.879207] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 12:20:44 juju-e4d256-prod-github-runner-207 kernel: [25018.880025] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 12:20:44 juju-e4d256-prod-github-runner-207 kernel: [25018.880833] Aug 22 12:20:44 juju-e4d256-prod-github-runner-207 kernel: [25018.881467] Aug 22 12:20:44 juju-e4d256-prod-github-runner-207 kernel: [25018.882096] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 12:20:44 juju-e4d256-prod-github-runner-207 kernel: [25018.882935] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:20:44 juju-e4d256-prod-github-runner-207 kernel: [25018.883811] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 12:20:44 juju-e4d256-prod-github-runner-207 kernel: [25018.886023] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 12:20:44 juju-e4d256-prod-github-runner-207 kernel: [25018.886900] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 12:20:44 juju-e4d256-prod-github-runner-207 kernel: [25018.887908] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 12:20:44 juju-e4d256-prod-github-runner-207 kernel: [25018.888900] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 12:20:44 juju-e4d256-prod-github-runner-207 kernel: [25018.889866] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 12:20:44 juju-e4d256-prod-github-runner-207 kernel: [25018.890820] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 12:20:44 juju-e4d256-prod-github-runner-207 kernel: [25018.891777] ? _raw_spin_lock+0x22/0x30 Aug 22 12:20:44 juju-e4d256-prod-github-runner-207 kernel: [25018.892554] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:20:44 juju-e4d256-prod-github-runner-207 kernel: [25018.893396] direct_page_fault+0x206/0x310 [kvm] Aug 22 12:20:44 juju-e4d256-prod-github-runner-207 kernel: [25018.894252] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 12:20:44 juju-e4d256-prod-github-runner-207 kernel: [25018.895105] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 12:20:44 juju-e4d256-prod-github-runner-207 kernel: [25018.895945] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 12:20:44 juju-e4d256-prod-github-runner-207 kernel: [25018.896769] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 12:20:44 juju-e4d256-prod-github-runner-207 kernel: [25018.897552] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 12:20:44 juju-e4d256-prod-github-runner-207 kernel: [25018.898371] handle_exit+0x98/0x230 [kvm_amd] Aug 22 12:20:44 juju-e4d256-prod-github-runner-207 kernel: [25018.899129] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 12:20:44 juju-e4d256-prod-github-runner-207 kernel: [25018.899909] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 12:20:44 juju-e4d256-prod-github-runner-207 kernel: [25018.900713] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 12:20:44 juju-e4d256-prod-github-runner-207 kernel: [25018.901496] vcpu_run+0x62/0x2c0 [kvm] Aug 22 12:20:44 juju-e4d256-prod-github-runner-207 kernel: [25018.902213] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 12:20:44 juju-e4d256-prod-github-runner-207 kernel: [25018.902954] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 12:20:44 juju-e4d256-prod-github-runner-207 kernel: [25018.903758] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 12:20:44 juju-e4d256-prod-github-runner-207 kernel: [25018.904533] ? __seccomp_filter+0x4a/0x4a0 Aug 22 12:20:44 juju-e4d256-prod-github-runner-207 kernel: [25018.905255] ? __fget_files+0x86/0xc0 Aug 22 12:20:44 juju-e4d256-prod-github-runner-207 kernel: [25018.905946] __x64_sys_ioctl+0x95/0xd0 Aug 22 12:20:44 juju-e4d256-prod-github-runner-207 kernel: [25018.906639] do_syscall_64+0x5c/0xc0 Aug 22 12:20:44 juju-e4d256-prod-github-runner-207 kernel: [25018.907318] ? do_futex+0x162/0x1f0 Aug 22 12:20:44 juju-e4d256-prod-github-runner-207 kernel: [25018.907992] ? __x64_sys_futex+0x78/0x1e0 Aug 22 12:20:44 juju-e4d256-prod-github-runner-207 kernel: [25018.908704] ? __secure_computing+0xa9/0x120 Aug 22 12:20:44 juju-e4d256-prod-github-runner-207 kernel: [25018.909417] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 12:20:44 juju-e4d256-prod-github-runner-207 kernel: [25018.910203] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:20:44 juju-e4d256-prod-github-runner-207 kernel: [25018.910954] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:20:44 juju-e4d256-prod-github-runner-207 kernel: [25018.911705] ? do_syscall_64+0x69/0xc0 Aug 22 12:20:44 juju-e4d256-prod-github-runner-207 kernel: [25018.912403] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:20:44 juju-e4d256-prod-github-runner-207 kernel: [25018.913182] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:20:44 juju-e4d256-prod-github-runner-207 kernel: [25018.913942] ? do_syscall_64+0x69/0xc0 Aug 22 12:20:44 juju-e4d256-prod-github-runner-207 kernel: [25018.914638] ? do_syscall_64+0x69/0xc0 Aug 22 12:20:44 juju-e4d256-prod-github-runner-207 kernel: [25018.915326] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 12:20:44 juju-e4d256-prod-github-runner-207 kernel: [25018.916111] RIP: 0033:0x7faa5d0edaff Aug 22 12:20:44 juju-e4d256-prod-github-runner-207 kernel: [25018.916822] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 12:20:44 juju-e4d256-prod-github-runner-207 kernel: [25018.919030] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 12:20:44 juju-e4d256-prod-github-runner-207 kernel: [25018.920007] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 12:20:44 juju-e4d256-prod-github-runner-207 kernel: [25018.920965] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 12:20:44 juju-e4d256-prod-github-runner-207 kernel: [25018.921907] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 12:20:44 juju-e4d256-prod-github-runner-207 kernel: [25018.922845] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 12:20:44 juju-e4d256-prod-github-runner-207 kernel: [25018.923768] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 12:20:44 juju-e4d256-prod-github-runner-207 kernel: [25018.924696] Aug 22 12:21:10 juju-e4d256-prod-github-runner-207 kernel: [25044.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 23216s! [qemu-system-x86:6715] Aug 22 12:21:10 juju-e4d256-prod-github-runner-207 kernel: [25044.543128] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 12:21:10 juju-e4d256-prod-github-runner-207 kernel: [25044.543204] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 12:21:10 juju-e4d256-prod-github-runner-207 kernel: [25044.555645] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 12:21:10 juju-e4d256-prod-github-runner-207 kernel: [25044.556937] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 12:21:10 juju-e4d256-prod-github-runner-207 kernel: [25044.558169] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:21:10 juju-e4d256-prod-github-runner-207 kernel: [25044.559232] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 12:21:10 juju-e4d256-prod-github-runner-207 kernel: [25044.561810] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 12:21:10 juju-e4d256-prod-github-runner-207 kernel: [25044.562858] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 12:21:10 juju-e4d256-prod-github-runner-207 kernel: [25044.564080] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 12:21:10 juju-e4d256-prod-github-runner-207 kernel: [25044.565254] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 12:21:10 juju-e4d256-prod-github-runner-207 kernel: [25044.566447] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 12:21:10 juju-e4d256-prod-github-runner-207 kernel: [25044.567651] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 12:21:10 juju-e4d256-prod-github-runner-207 kernel: [25044.568840] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 12:21:10 juju-e4d256-prod-github-runner-207 kernel: [25044.570253] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 12:21:10 juju-e4d256-prod-github-runner-207 kernel: [25044.571411] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 12:21:10 juju-e4d256-prod-github-runner-207 kernel: [25044.572742] Call Trace: Aug 22 12:21:10 juju-e4d256-prod-github-runner-207 kernel: [25044.573675] Aug 22 12:21:10 juju-e4d256-prod-github-runner-207 kernel: [25044.574599] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:21:10 juju-e4d256-prod-github-runner-207 kernel: [25044.575643] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:21:10 juju-e4d256-prod-github-runner-207 kernel: [25044.576695] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:21:10 juju-e4d256-prod-github-runner-207 kernel: [25044.577808] ? show_regs.part.0+0x23/0x29 Aug 22 12:21:10 juju-e4d256-prod-github-runner-207 kernel: [25044.578817] ? show_regs.cold+0x8/0xd Aug 22 12:21:10 juju-e4d256-prod-github-runner-207 kernel: [25044.579826] ? watchdog_timer_fn+0x1be/0x220 Aug 22 12:21:10 juju-e4d256-prod-github-runner-207 kernel: [25044.580889] ? lockup_detector_update_enable+0x60/0x60 Aug 22 12:21:10 juju-e4d256-prod-github-runner-207 kernel: [25044.582020] ? __hrtimer_run_queues+0x107/0x230 Aug 22 12:21:10 juju-e4d256-prod-github-runner-207 kernel: [25044.583092] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 12:21:10 juju-e4d256-prod-github-runner-207 kernel: [25044.584152] ? hrtimer_interrupt+0x101/0x220 Aug 22 12:21:10 juju-e4d256-prod-github-runner-207 kernel: [25044.585179] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 12:21:10 juju-e4d256-prod-github-runner-207 kernel: [25044.586281] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 12:21:10 juju-e4d256-prod-github-runner-207 kernel: [25044.587351] Aug 22 12:21:10 juju-e4d256-prod-github-runner-207 kernel: [25044.588255] Aug 22 12:21:10 juju-e4d256-prod-github-runner-207 kernel: [25044.589110] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 12:21:10 juju-e4d256-prod-github-runner-207 kernel: [25044.590183] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:21:10 juju-e4d256-prod-github-runner-207 kernel: [25044.591235] ? _raw_spin_lock+0x22/0x30 Aug 22 12:21:10 juju-e4d256-prod-github-runner-207 kernel: [25044.592250] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:21:10 juju-e4d256-prod-github-runner-207 kernel: [25044.593293] direct_page_fault+0x206/0x310 [kvm] Aug 22 12:21:10 juju-e4d256-prod-github-runner-207 kernel: [25044.594390] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 12:21:10 juju-e4d256-prod-github-runner-207 kernel: [25044.595454] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 12:21:10 juju-e4d256-prod-github-runner-207 kernel: [25044.596502] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 12:21:10 juju-e4d256-prod-github-runner-207 kernel: [25044.597484] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 12:21:10 juju-e4d256-prod-github-runner-207 kernel: [25044.598443] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 12:21:10 juju-e4d256-prod-github-runner-207 kernel: [25044.599443] handle_exit+0x98/0x230 [kvm_amd] Aug 22 12:21:10 juju-e4d256-prod-github-runner-207 kernel: [25044.600372] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 12:21:10 juju-e4d256-prod-github-runner-207 kernel: [25044.601302] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 12:21:10 juju-e4d256-prod-github-runner-207 kernel: [25044.602236] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 12:21:10 juju-e4d256-prod-github-runner-207 kernel: [25044.603153] vcpu_run+0x62/0x2c0 [kvm] Aug 22 12:21:10 juju-e4d256-prod-github-runner-207 kernel: [25044.603987] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 12:21:10 juju-e4d256-prod-github-runner-207 kernel: [25044.604806] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 12:21:10 juju-e4d256-prod-github-runner-207 kernel: [25044.605692] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 12:21:10 juju-e4d256-prod-github-runner-207 kernel: [25044.606508] ? __seccomp_filter+0x4a/0x4a0 Aug 22 12:21:10 juju-e4d256-prod-github-runner-207 kernel: [25044.607256] ? __fget_files+0x86/0xc0 Aug 22 12:21:10 juju-e4d256-prod-github-runner-207 kernel: [25044.607995] __x64_sys_ioctl+0x95/0xd0 Aug 22 12:21:10 juju-e4d256-prod-github-runner-207 kernel: [25044.608699] do_syscall_64+0x5c/0xc0 Aug 22 12:21:10 juju-e4d256-prod-github-runner-207 kernel: [25044.609385] ? do_futex+0x162/0x1f0 Aug 22 12:21:10 juju-e4d256-prod-github-runner-207 kernel: [25044.610041] ? __x64_sys_futex+0x78/0x1e0 Aug 22 12:21:10 juju-e4d256-prod-github-runner-207 kernel: [25044.610763] ? __secure_computing+0xa9/0x120 Aug 22 12:21:10 juju-e4d256-prod-github-runner-207 kernel: [25044.611466] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 12:21:10 juju-e4d256-prod-github-runner-207 kernel: [25044.612259] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:21:10 juju-e4d256-prod-github-runner-207 kernel: [25044.613006] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:21:10 juju-e4d256-prod-github-runner-207 kernel: [25044.613738] ? do_syscall_64+0x69/0xc0 Aug 22 12:21:10 juju-e4d256-prod-github-runner-207 kernel: [25044.614394] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:21:10 juju-e4d256-prod-github-runner-207 kernel: [25044.615110] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:21:10 juju-e4d256-prod-github-runner-207 kernel: [25044.615834] ? do_syscall_64+0x69/0xc0 Aug 22 12:21:10 juju-e4d256-prod-github-runner-207 kernel: [25044.616468] ? do_syscall_64+0x69/0xc0 Aug 22 12:21:10 juju-e4d256-prod-github-runner-207 kernel: [25044.617105] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 12:21:10 juju-e4d256-prod-github-runner-207 kernel: [25044.617820] RIP: 0033:0x7faa5d0edaff Aug 22 12:21:10 juju-e4d256-prod-github-runner-207 kernel: [25044.618451] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 12:21:10 juju-e4d256-prod-github-runner-207 kernel: [25044.620508] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 12:21:10 juju-e4d256-prod-github-runner-207 kernel: [25044.621436] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 12:21:10 juju-e4d256-prod-github-runner-207 kernel: [25044.622351] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 12:21:10 juju-e4d256-prod-github-runner-207 kernel: [25044.623266] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 12:21:10 juju-e4d256-prod-github-runner-207 kernel: [25044.624202] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 12:21:10 juju-e4d256-prod-github-runner-207 kernel: [25044.625106] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 12:21:10 juju-e4d256-prod-github-runner-207 kernel: [25044.626048] Aug 22 12:21:38 juju-e4d256-prod-github-runner-207 kernel: [25072.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 23242s! [qemu-system-x86:6715] Aug 22 12:21:38 juju-e4d256-prod-github-runner-207 kernel: [25072.543121] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 12:21:38 juju-e4d256-prod-github-runner-207 kernel: [25072.543197] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 12:21:38 juju-e4d256-prod-github-runner-207 kernel: [25072.555787] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 12:21:38 juju-e4d256-prod-github-runner-207 kernel: [25072.557165] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 12:21:38 juju-e4d256-prod-github-runner-207 kernel: [25072.558428] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:21:38 juju-e4d256-prod-github-runner-207 kernel: [25072.559569] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 12:21:38 juju-e4d256-prod-github-runner-207 kernel: [25072.562191] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 12:21:38 juju-e4d256-prod-github-runner-207 kernel: [25072.563245] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 12:21:38 juju-e4d256-prod-github-runner-207 kernel: [25072.564455] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 12:21:38 juju-e4d256-prod-github-runner-207 kernel: [25072.565651] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 12:21:38 juju-e4d256-prod-github-runner-207 kernel: [25072.566827] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 12:21:38 juju-e4d256-prod-github-runner-207 kernel: [25072.568012] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 12:21:38 juju-e4d256-prod-github-runner-207 kernel: [25072.569225] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 12:21:38 juju-e4d256-prod-github-runner-207 kernel: [25072.570479] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 12:21:38 juju-e4d256-prod-github-runner-207 kernel: [25072.571635] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 12:21:38 juju-e4d256-prod-github-runner-207 kernel: [25072.572846] Call Trace: Aug 22 12:21:38 juju-e4d256-prod-github-runner-207 kernel: [25072.573761] Aug 22 12:21:38 juju-e4d256-prod-github-runner-207 kernel: [25072.574655] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:21:38 juju-e4d256-prod-github-runner-207 kernel: [25072.575716] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:21:38 juju-e4d256-prod-github-runner-207 kernel: [25072.576744] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:21:38 juju-e4d256-prod-github-runner-207 kernel: [25072.577844] ? show_regs.part.0+0x23/0x29 Aug 22 12:21:38 juju-e4d256-prod-github-runner-207 kernel: [25072.578856] ? show_regs.cold+0x8/0xd Aug 22 12:21:38 juju-e4d256-prod-github-runner-207 kernel: [25072.579851] ? watchdog_timer_fn+0x1be/0x220 Aug 22 12:21:38 juju-e4d256-prod-github-runner-207 kernel: [25072.580866] ? lockup_detector_update_enable+0x60/0x60 Aug 22 12:21:38 juju-e4d256-prod-github-runner-207 kernel: [25072.581942] ? __hrtimer_run_queues+0x107/0x230 Aug 22 12:21:38 juju-e4d256-prod-github-runner-207 kernel: [25072.582980] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 12:21:38 juju-e4d256-prod-github-runner-207 kernel: [25072.584026] ? hrtimer_interrupt+0x101/0x220 Aug 22 12:21:38 juju-e4d256-prod-github-runner-207 kernel: [25072.585062] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 12:21:38 juju-e4d256-prod-github-runner-207 kernel: [25072.586138] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 12:21:38 juju-e4d256-prod-github-runner-207 kernel: [25072.587195] Aug 22 12:21:38 juju-e4d256-prod-github-runner-207 kernel: [25072.588067] Aug 22 12:21:38 juju-e4d256-prod-github-runner-207 kernel: [25072.588908] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 12:21:38 juju-e4d256-prod-github-runner-207 kernel: [25072.589951] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:21:38 juju-e4d256-prod-github-runner-207 kernel: [25072.590998] ? _raw_spin_lock+0x22/0x30 Aug 22 12:21:38 juju-e4d256-prod-github-runner-207 kernel: [25072.591963] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:21:38 juju-e4d256-prod-github-runner-207 kernel: [25072.592985] direct_page_fault+0x206/0x310 [kvm] Aug 22 12:21:38 juju-e4d256-prod-github-runner-207 kernel: [25072.594017] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 12:21:38 juju-e4d256-prod-github-runner-207 kernel: [25072.595048] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 12:21:38 juju-e4d256-prod-github-runner-207 kernel: [25072.596066] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 12:21:38 juju-e4d256-prod-github-runner-207 kernel: [25072.597046] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 12:21:38 juju-e4d256-prod-github-runner-207 kernel: [25072.597994] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 12:21:38 juju-e4d256-prod-github-runner-207 kernel: [25072.598980] handle_exit+0x98/0x230 [kvm_amd] Aug 22 12:21:38 juju-e4d256-prod-github-runner-207 kernel: [25072.599886] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 12:21:38 juju-e4d256-prod-github-runner-207 kernel: [25072.600812] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 12:21:38 juju-e4d256-prod-github-runner-207 kernel: [25072.601742] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 12:21:38 juju-e4d256-prod-github-runner-207 kernel: [25072.602652] vcpu_run+0x62/0x2c0 [kvm] Aug 22 12:21:38 juju-e4d256-prod-github-runner-207 kernel: [25072.603475] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 12:21:38 juju-e4d256-prod-github-runner-207 kernel: [25072.604296] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 12:21:38 juju-e4d256-prod-github-runner-207 kernel: [25072.605162] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 12:21:38 juju-e4d256-prod-github-runner-207 kernel: [25072.606006] ? __seccomp_filter+0x4a/0x4a0 Aug 22 12:21:38 juju-e4d256-prod-github-runner-207 kernel: [25072.606755] ? __fget_files+0x86/0xc0 Aug 22 12:21:38 juju-e4d256-prod-github-runner-207 kernel: [25072.607477] __x64_sys_ioctl+0x95/0xd0 Aug 22 12:21:38 juju-e4d256-prod-github-runner-207 kernel: [25072.608194] do_syscall_64+0x5c/0xc0 Aug 22 12:21:38 juju-e4d256-prod-github-runner-207 kernel: [25072.608881] ? do_futex+0x162/0x1f0 Aug 22 12:21:38 juju-e4d256-prod-github-runner-207 kernel: [25072.609535] ? __x64_sys_futex+0x78/0x1e0 Aug 22 12:21:38 juju-e4d256-prod-github-runner-207 kernel: [25072.610217] ? __secure_computing+0xa9/0x120 Aug 22 12:21:38 juju-e4d256-prod-github-runner-207 kernel: [25072.610914] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 12:21:38 juju-e4d256-prod-github-runner-207 kernel: [25072.611730] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:21:38 juju-e4d256-prod-github-runner-207 kernel: [25072.612476] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:21:38 juju-e4d256-prod-github-runner-207 kernel: [25072.613221] ? do_syscall_64+0x69/0xc0 Aug 22 12:21:38 juju-e4d256-prod-github-runner-207 kernel: [25072.613901] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:21:38 juju-e4d256-prod-github-runner-207 kernel: [25072.614627] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:21:38 juju-e4d256-prod-github-runner-207 kernel: [25072.615338] ? do_syscall_64+0x69/0xc0 Aug 22 12:21:38 juju-e4d256-prod-github-runner-207 kernel: [25072.616079] ? do_syscall_64+0x69/0xc0 Aug 22 12:21:38 juju-e4d256-prod-github-runner-207 kernel: [25072.616737] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 12:21:38 juju-e4d256-prod-github-runner-207 kernel: [25072.617499] RIP: 0033:0x7faa5d0edaff Aug 22 12:21:38 juju-e4d256-prod-github-runner-207 kernel: [25072.618141] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 12:21:38 juju-e4d256-prod-github-runner-207 kernel: [25072.620228] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 12:21:38 juju-e4d256-prod-github-runner-207 kernel: [25072.621164] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 12:21:38 juju-e4d256-prod-github-runner-207 kernel: [25072.622156] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 12:21:38 juju-e4d256-prod-github-runner-207 kernel: [25072.623069] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 12:21:38 juju-e4d256-prod-github-runner-207 kernel: [25072.624019] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 12:21:38 juju-e4d256-prod-github-runner-207 kernel: [25072.624958] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 12:21:38 juju-e4d256-prod-github-runner-207 kernel: [25072.625877] Aug 22 12:22:06 juju-e4d256-prod-github-runner-207 kernel: [25100.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 23268s! [qemu-system-x86:6715] Aug 22 12:22:06 juju-e4d256-prod-github-runner-207 kernel: [25100.543886] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 12:22:06 juju-e4d256-prod-github-runner-207 kernel: [25100.544185] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 12:22:06 juju-e4d256-prod-github-runner-207 kernel: [25100.557518] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 12:22:06 juju-e4d256-prod-github-runner-207 kernel: [25100.558806] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 12:22:06 juju-e4d256-prod-github-runner-207 kernel: [25100.560098] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:22:06 juju-e4d256-prod-github-runner-207 kernel: [25100.561202] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 12:22:06 juju-e4d256-prod-github-runner-207 kernel: [25100.563856] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 12:22:06 juju-e4d256-prod-github-runner-207 kernel: [25100.565167] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 12:22:06 juju-e4d256-prod-github-runner-207 kernel: [25100.566740] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 12:22:06 juju-e4d256-prod-github-runner-207 kernel: [25100.568165] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 12:22:06 juju-e4d256-prod-github-runner-207 kernel: [25100.569454] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 12:22:06 juju-e4d256-prod-github-runner-207 kernel: [25100.570934] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 12:22:06 juju-e4d256-prod-github-runner-207 kernel: [25100.572131] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 12:22:06 juju-e4d256-prod-github-runner-207 kernel: [25100.573466] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 12:22:06 juju-e4d256-prod-github-runner-207 kernel: [25100.574631] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 12:22:06 juju-e4d256-prod-github-runner-207 kernel: [25100.575901] Call Trace: Aug 22 12:22:06 juju-e4d256-prod-github-runner-207 kernel: [25100.576867] Aug 22 12:22:06 juju-e4d256-prod-github-runner-207 kernel: [25100.577808] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:22:06 juju-e4d256-prod-github-runner-207 kernel: [25100.578914] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:22:06 juju-e4d256-prod-github-runner-207 kernel: [25100.579961] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:22:06 juju-e4d256-prod-github-runner-207 kernel: [25100.581063] ? show_regs.part.0+0x23/0x29 Aug 22 12:22:06 juju-e4d256-prod-github-runner-207 kernel: [25100.582075] ? show_regs.cold+0x8/0xd Aug 22 12:22:06 juju-e4d256-prod-github-runner-207 kernel: [25100.583081] ? watchdog_timer_fn+0x1be/0x220 Aug 22 12:22:06 juju-e4d256-prod-github-runner-207 kernel: [25100.584095] ? lockup_detector_update_enable+0x60/0x60 Aug 22 12:22:06 juju-e4d256-prod-github-runner-207 kernel: [25100.585279] ? __hrtimer_run_queues+0x107/0x230 Aug 22 12:22:06 juju-e4d256-prod-github-runner-207 kernel: [25100.586393] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 12:22:06 juju-e4d256-prod-github-runner-207 kernel: [25100.587519] ? hrtimer_interrupt+0x101/0x220 Aug 22 12:22:06 juju-e4d256-prod-github-runner-207 kernel: [25100.588583] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 12:22:06 juju-e4d256-prod-github-runner-207 kernel: [25100.589684] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 12:22:06 juju-e4d256-prod-github-runner-207 kernel: [25100.590865] Aug 22 12:22:06 juju-e4d256-prod-github-runner-207 kernel: [25100.591743] Aug 22 12:22:06 juju-e4d256-prod-github-runner-207 kernel: [25100.592591] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 12:22:06 juju-e4d256-prod-github-runner-207 kernel: [25100.593629] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:22:06 juju-e4d256-prod-github-runner-207 kernel: [25100.594667] ? _raw_spin_lock+0x22/0x30 Aug 22 12:22:06 juju-e4d256-prod-github-runner-207 kernel: [25100.595684] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:22:06 juju-e4d256-prod-github-runner-207 kernel: [25100.596846] direct_page_fault+0x206/0x310 [kvm] Aug 22 12:22:06 juju-e4d256-prod-github-runner-207 kernel: [25100.597972] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 12:22:06 juju-e4d256-prod-github-runner-207 kernel: [25100.598985] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 12:22:06 juju-e4d256-prod-github-runner-207 kernel: [25100.599996] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 12:22:06 juju-e4d256-prod-github-runner-207 kernel: [25100.601050] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 12:22:06 juju-e4d256-prod-github-runner-207 kernel: [25100.602085] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 12:22:06 juju-e4d256-prod-github-runner-207 kernel: [25100.603163] handle_exit+0x98/0x230 [kvm_amd] Aug 22 12:22:06 juju-e4d256-prod-github-runner-207 kernel: [25100.604133] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 12:22:06 juju-e4d256-prod-github-runner-207 kernel: [25100.605062] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 12:22:06 juju-e4d256-prod-github-runner-207 kernel: [25100.606070] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 12:22:06 juju-e4d256-prod-github-runner-207 kernel: [25100.607091] vcpu_run+0x62/0x2c0 [kvm] Aug 22 12:22:06 juju-e4d256-prod-github-runner-207 kernel: [25100.607964] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 12:22:06 juju-e4d256-prod-github-runner-207 kernel: [25100.608820] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 12:22:06 juju-e4d256-prod-github-runner-207 kernel: [25100.609709] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 12:22:06 juju-e4d256-prod-github-runner-207 kernel: [25100.610577] ? __seccomp_filter+0x4a/0x4a0 Aug 22 12:22:06 juju-e4d256-prod-github-runner-207 kernel: [25100.611338] ? __fget_files+0x86/0xc0 Aug 22 12:22:06 juju-e4d256-prod-github-runner-207 kernel: [25100.612100] __x64_sys_ioctl+0x95/0xd0 Aug 22 12:22:06 juju-e4d256-prod-github-runner-207 kernel: [25100.612850] do_syscall_64+0x5c/0xc0 Aug 22 12:22:06 juju-e4d256-prod-github-runner-207 kernel: [25100.613519] ? do_futex+0x162/0x1f0 Aug 22 12:22:06 juju-e4d256-prod-github-runner-207 kernel: [25100.614178] ? __x64_sys_futex+0x78/0x1e0 Aug 22 12:22:06 juju-e4d256-prod-github-runner-207 kernel: [25100.614868] ? __secure_computing+0xa9/0x120 Aug 22 12:22:06 juju-e4d256-prod-github-runner-207 kernel: [25100.615619] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 12:22:06 juju-e4d256-prod-github-runner-207 kernel: [25100.616395] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:22:06 juju-e4d256-prod-github-runner-207 kernel: [25100.617117] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:22:06 juju-e4d256-prod-github-runner-207 kernel: [25100.617835] ? do_syscall_64+0x69/0xc0 Aug 22 12:22:06 juju-e4d256-prod-github-runner-207 kernel: [25100.618527] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:22:06 juju-e4d256-prod-github-runner-207 kernel: [25100.619291] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:22:06 juju-e4d256-prod-github-runner-207 kernel: [25100.620027] ? do_syscall_64+0x69/0xc0 Aug 22 12:22:06 juju-e4d256-prod-github-runner-207 kernel: [25100.620700] ? do_syscall_64+0x69/0xc0 Aug 22 12:22:06 juju-e4d256-prod-github-runner-207 kernel: [25100.621444] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 12:22:06 juju-e4d256-prod-github-runner-207 kernel: [25100.622200] RIP: 0033:0x7faa5d0edaff Aug 22 12:22:06 juju-e4d256-prod-github-runner-207 kernel: [25100.622862] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 12:22:06 juju-e4d256-prod-github-runner-207 kernel: [25100.624869] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 12:22:06 juju-e4d256-prod-github-runner-207 kernel: [25100.625784] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 12:22:06 juju-e4d256-prod-github-runner-207 kernel: [25100.626700] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 12:22:06 juju-e4d256-prod-github-runner-207 kernel: [25100.627681] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 12:22:06 juju-e4d256-prod-github-runner-207 kernel: [25100.628601] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 12:22:06 juju-e4d256-prod-github-runner-207 kernel: [25100.629530] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 12:22:06 juju-e4d256-prod-github-runner-207 kernel: [25100.630419] Aug 22 12:22:34 juju-e4d256-prod-github-runner-207 kernel: [25128.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 23294s! [qemu-system-x86:6715] Aug 22 12:22:34 juju-e4d256-prod-github-runner-207 kernel: [25128.543126] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 12:22:34 juju-e4d256-prod-github-runner-207 kernel: [25128.543196] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 12:22:34 juju-e4d256-prod-github-runner-207 kernel: [25128.556361] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 12:22:34 juju-e4d256-prod-github-runner-207 kernel: [25128.557751] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 12:22:34 juju-e4d256-prod-github-runner-207 kernel: [25128.559113] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:22:34 juju-e4d256-prod-github-runner-207 kernel: [25128.560226] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 12:22:34 juju-e4d256-prod-github-runner-207 kernel: [25128.562815] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 12:22:34 juju-e4d256-prod-github-runner-207 kernel: [25128.563874] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 12:22:34 juju-e4d256-prod-github-runner-207 kernel: [25128.565044] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 12:22:34 juju-e4d256-prod-github-runner-207 kernel: [25128.566217] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 12:22:34 juju-e4d256-prod-github-runner-207 kernel: [25128.567458] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 12:22:34 juju-e4d256-prod-github-runner-207 kernel: [25128.568639] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 12:22:34 juju-e4d256-prod-github-runner-207 kernel: [25128.569807] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 12:22:34 juju-e4d256-prod-github-runner-207 kernel: [25128.571109] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 12:22:34 juju-e4d256-prod-github-runner-207 kernel: [25128.572397] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 12:22:34 juju-e4d256-prod-github-runner-207 kernel: [25128.573923] Call Trace: Aug 22 12:22:34 juju-e4d256-prod-github-runner-207 kernel: [25128.575345] Aug 22 12:22:34 juju-e4d256-prod-github-runner-207 kernel: [25128.576749] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:22:34 juju-e4d256-prod-github-runner-207 kernel: [25128.578369] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:22:34 juju-e4d256-prod-github-runner-207 kernel: [25128.579899] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:22:34 juju-e4d256-prod-github-runner-207 kernel: [25128.581791] ? show_regs.part.0+0x23/0x29 Aug 22 12:22:34 juju-e4d256-prod-github-runner-207 kernel: [25128.583422] ? show_regs.cold+0x8/0xd Aug 22 12:22:34 juju-e4d256-prod-github-runner-207 kernel: [25128.584988] ? watchdog_timer_fn+0x1be/0x220 Aug 22 12:22:34 juju-e4d256-prod-github-runner-207 kernel: [25128.586472] ? lockup_detector_update_enable+0x60/0x60 Aug 22 12:22:34 juju-e4d256-prod-github-runner-207 kernel: [25128.588174] ? __hrtimer_run_queues+0x107/0x230 Aug 22 12:22:34 juju-e4d256-prod-github-runner-207 kernel: [25128.589760] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 12:22:34 juju-e4d256-prod-github-runner-207 kernel: [25128.591270] ? hrtimer_interrupt+0x101/0x220 Aug 22 12:22:34 juju-e4d256-prod-github-runner-207 kernel: [25128.592799] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 12:22:34 juju-e4d256-prod-github-runner-207 kernel: [25128.594600] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 12:22:34 juju-e4d256-prod-github-runner-207 kernel: [25128.596676] Aug 22 12:22:34 juju-e4d256-prod-github-runner-207 kernel: [25128.598084] Aug 22 12:22:34 juju-e4d256-prod-github-runner-207 kernel: [25128.599378] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 12:22:34 juju-e4d256-prod-github-runner-207 kernel: [25128.600988] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:22:34 juju-e4d256-prod-github-runner-207 kernel: [25128.602554] ? _raw_spin_lock+0x22/0x30 Aug 22 12:22:34 juju-e4d256-prod-github-runner-207 kernel: [25128.604169] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:22:34 juju-e4d256-prod-github-runner-207 kernel: [25128.605335] direct_page_fault+0x206/0x310 [kvm] Aug 22 12:22:34 juju-e4d256-prod-github-runner-207 kernel: [25128.606374] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 12:22:34 juju-e4d256-prod-github-runner-207 kernel: [25128.607425] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 12:22:34 juju-e4d256-prod-github-runner-207 kernel: [25128.608465] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 12:22:34 juju-e4d256-prod-github-runner-207 kernel: [25128.609449] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 12:22:34 juju-e4d256-prod-github-runner-207 kernel: [25128.610402] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 12:22:34 juju-e4d256-prod-github-runner-207 kernel: [25128.611640] handle_exit+0x98/0x230 [kvm_amd] Aug 22 12:22:34 juju-e4d256-prod-github-runner-207 kernel: [25128.612706] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 12:22:34 juju-e4d256-prod-github-runner-207 kernel: [25128.613637] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 12:22:34 juju-e4d256-prod-github-runner-207 kernel: [25128.614923] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 12:22:34 juju-e4d256-prod-github-runner-207 kernel: [25128.615861] vcpu_run+0x62/0x2c0 [kvm] Aug 22 12:22:34 juju-e4d256-prod-github-runner-207 kernel: [25128.616826] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 12:22:34 juju-e4d256-prod-github-runner-207 kernel: [25128.617657] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 12:22:34 juju-e4d256-prod-github-runner-207 kernel: [25128.618524] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 12:22:34 juju-e4d256-prod-github-runner-207 kernel: [25128.619358] ? __seccomp_filter+0x4a/0x4a0 Aug 22 12:22:34 juju-e4d256-prod-github-runner-207 kernel: [25128.620117] ? __fget_files+0x86/0xc0 Aug 22 12:22:34 juju-e4d256-prod-github-runner-207 kernel: [25128.620827] __x64_sys_ioctl+0x95/0xd0 Aug 22 12:22:34 juju-e4d256-prod-github-runner-207 kernel: [25128.621523] do_syscall_64+0x5c/0xc0 Aug 22 12:22:34 juju-e4d256-prod-github-runner-207 kernel: [25128.622194] ? do_futex+0x162/0x1f0 Aug 22 12:22:34 juju-e4d256-prod-github-runner-207 kernel: [25128.622897] ? __x64_sys_futex+0x78/0x1e0 Aug 22 12:22:34 juju-e4d256-prod-github-runner-207 kernel: [25128.623596] ? __secure_computing+0xa9/0x120 Aug 22 12:22:34 juju-e4d256-prod-github-runner-207 kernel: [25128.624307] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 12:22:34 juju-e4d256-prod-github-runner-207 kernel: [25128.625078] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:22:34 juju-e4d256-prod-github-runner-207 kernel: [25128.625810] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:22:34 juju-e4d256-prod-github-runner-207 kernel: [25128.626534] ? do_syscall_64+0x69/0xc0 Aug 22 12:22:34 juju-e4d256-prod-github-runner-207 kernel: [25128.627208] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:22:34 juju-e4d256-prod-github-runner-207 kernel: [25128.627917] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:22:34 juju-e4d256-prod-github-runner-207 kernel: [25128.628616] ? do_syscall_64+0x69/0xc0 Aug 22 12:22:34 juju-e4d256-prod-github-runner-207 kernel: [25128.629245] ? do_syscall_64+0x69/0xc0 Aug 22 12:22:34 juju-e4d256-prod-github-runner-207 kernel: [25128.629873] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 12:22:34 juju-e4d256-prod-github-runner-207 kernel: [25128.630587] RIP: 0033:0x7faa5d0edaff Aug 22 12:22:34 juju-e4d256-prod-github-runner-207 kernel: [25128.631320] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 12:22:34 juju-e4d256-prod-github-runner-207 kernel: [25128.633531] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 12:22:34 juju-e4d256-prod-github-runner-207 kernel: [25128.634460] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 12:22:34 juju-e4d256-prod-github-runner-207 kernel: [25128.635378] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 12:22:34 juju-e4d256-prod-github-runner-207 kernel: [25128.636280] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 12:22:34 juju-e4d256-prod-github-runner-207 kernel: [25128.637173] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 12:22:34 juju-e4d256-prod-github-runner-207 kernel: [25128.638063] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 12:22:34 juju-e4d256-prod-github-runner-207 kernel: [25128.638987] Aug 22 12:23:02 juju-e4d256-prod-github-runner-207 kernel: [25156.541981] watchdog: BUG: soft lockup - CPU#1 stuck for 23320s! [qemu-system-x86:6715] Aug 22 12:23:02 juju-e4d256-prod-github-runner-207 kernel: [25156.543118] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 12:23:02 juju-e4d256-prod-github-runner-207 kernel: [25156.543197] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 12:23:02 juju-e4d256-prod-github-runner-207 kernel: [25156.555534] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 12:23:02 juju-e4d256-prod-github-runner-207 kernel: [25156.557108] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 12:23:02 juju-e4d256-prod-github-runner-207 kernel: [25156.558367] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:23:02 juju-e4d256-prod-github-runner-207 kernel: [25156.559456] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 12:23:02 juju-e4d256-prod-github-runner-207 kernel: [25156.562029] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 12:23:02 juju-e4d256-prod-github-runner-207 kernel: [25156.563096] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 12:23:02 juju-e4d256-prod-github-runner-207 kernel: [25156.564280] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 12:23:02 juju-e4d256-prod-github-runner-207 kernel: [25156.565457] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 12:23:02 juju-e4d256-prod-github-runner-207 kernel: [25156.566656] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 12:23:02 juju-e4d256-prod-github-runner-207 kernel: [25156.567823] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 12:23:02 juju-e4d256-prod-github-runner-207 kernel: [25156.569001] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 12:23:02 juju-e4d256-prod-github-runner-207 kernel: [25156.570282] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 12:23:02 juju-e4d256-prod-github-runner-207 kernel: [25156.571405] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 12:23:02 juju-e4d256-prod-github-runner-207 kernel: [25156.572620] Call Trace: Aug 22 12:23:02 juju-e4d256-prod-github-runner-207 kernel: [25156.573549] Aug 22 12:23:02 juju-e4d256-prod-github-runner-207 kernel: [25156.574496] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:23:02 juju-e4d256-prod-github-runner-207 kernel: [25156.575600] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:23:02 juju-e4d256-prod-github-runner-207 kernel: [25156.576852] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:23:02 juju-e4d256-prod-github-runner-207 kernel: [25156.577949] ? show_regs.part.0+0x23/0x29 Aug 22 12:23:02 juju-e4d256-prod-github-runner-207 kernel: [25156.578978] ? show_regs.cold+0x8/0xd Aug 22 12:23:02 juju-e4d256-prod-github-runner-207 kernel: [25156.580019] ? watchdog_timer_fn+0x1be/0x220 Aug 22 12:23:02 juju-e4d256-prod-github-runner-207 kernel: [25156.581068] ? lockup_detector_update_enable+0x60/0x60 Aug 22 12:23:02 juju-e4d256-prod-github-runner-207 kernel: [25156.582158] ? __hrtimer_run_queues+0x107/0x230 Aug 22 12:23:02 juju-e4d256-prod-github-runner-207 kernel: [25156.583224] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 12:23:02 juju-e4d256-prod-github-runner-207 kernel: [25156.584249] ? hrtimer_interrupt+0x101/0x220 Aug 22 12:23:02 juju-e4d256-prod-github-runner-207 kernel: [25156.585287] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 12:23:02 juju-e4d256-prod-github-runner-207 kernel: [25156.586472] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 12:23:02 juju-e4d256-prod-github-runner-207 kernel: [25156.587595] Aug 22 12:23:02 juju-e4d256-prod-github-runner-207 kernel: [25156.588468] Aug 22 12:23:02 juju-e4d256-prod-github-runner-207 kernel: [25156.589318] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 12:23:02 juju-e4d256-prod-github-runner-207 kernel: [25156.590405] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:23:02 juju-e4d256-prod-github-runner-207 kernel: [25156.591475] ? _raw_spin_lock+0x22/0x30 Aug 22 12:23:02 juju-e4d256-prod-github-runner-207 kernel: [25156.592466] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:23:02 juju-e4d256-prod-github-runner-207 kernel: [25156.593498] direct_page_fault+0x206/0x310 [kvm] Aug 22 12:23:02 juju-e4d256-prod-github-runner-207 kernel: [25156.594591] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 12:23:02 juju-e4d256-prod-github-runner-207 kernel: [25156.595628] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 12:23:02 juju-e4d256-prod-github-runner-207 kernel: [25156.596728] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 12:23:02 juju-e4d256-prod-github-runner-207 kernel: [25156.597710] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 12:23:02 juju-e4d256-prod-github-runner-207 kernel: [25156.598684] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 12:23:02 juju-e4d256-prod-github-runner-207 kernel: [25156.599671] handle_exit+0x98/0x230 [kvm_amd] Aug 22 12:23:02 juju-e4d256-prod-github-runner-207 kernel: [25156.600589] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 12:23:02 juju-e4d256-prod-github-runner-207 kernel: [25156.601542] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 12:23:02 juju-e4d256-prod-github-runner-207 kernel: [25156.602500] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 12:23:02 juju-e4d256-prod-github-runner-207 kernel: [25156.603425] vcpu_run+0x62/0x2c0 [kvm] Aug 22 12:23:02 juju-e4d256-prod-github-runner-207 kernel: [25156.604246] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 12:23:02 juju-e4d256-prod-github-runner-207 kernel: [25156.605060] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 12:23:02 juju-e4d256-prod-github-runner-207 kernel: [25156.605989] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 12:23:02 juju-e4d256-prod-github-runner-207 kernel: [25156.606852] ? __seccomp_filter+0x4a/0x4a0 Aug 22 12:23:02 juju-e4d256-prod-github-runner-207 kernel: [25156.607649] ? __fget_files+0x86/0xc0 Aug 22 12:23:02 juju-e4d256-prod-github-runner-207 kernel: [25156.608391] __x64_sys_ioctl+0x95/0xd0 Aug 22 12:23:02 juju-e4d256-prod-github-runner-207 kernel: [25156.609218] do_syscall_64+0x5c/0xc0 Aug 22 12:23:02 juju-e4d256-prod-github-runner-207 kernel: [25156.609942] ? do_futex+0x162/0x1f0 Aug 22 12:23:02 juju-e4d256-prod-github-runner-207 kernel: [25156.610698] ? __x64_sys_futex+0x78/0x1e0 Aug 22 12:23:02 juju-e4d256-prod-github-runner-207 kernel: [25156.611601] ? __secure_computing+0xa9/0x120 Aug 22 12:23:02 juju-e4d256-prod-github-runner-207 kernel: [25156.612418] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 12:23:02 juju-e4d256-prod-github-runner-207 kernel: [25156.613190] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:23:02 juju-e4d256-prod-github-runner-207 kernel: [25156.613928] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:23:02 juju-e4d256-prod-github-runner-207 kernel: [25156.614671] ? do_syscall_64+0x69/0xc0 Aug 22 12:23:02 juju-e4d256-prod-github-runner-207 kernel: [25156.615346] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:23:02 juju-e4d256-prod-github-runner-207 kernel: [25156.616093] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:23:02 juju-e4d256-prod-github-runner-207 kernel: [25156.616817] ? do_syscall_64+0x69/0xc0 Aug 22 12:23:02 juju-e4d256-prod-github-runner-207 kernel: [25156.617525] ? do_syscall_64+0x69/0xc0 Aug 22 12:23:02 juju-e4d256-prod-github-runner-207 kernel: [25156.618205] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 12:23:02 juju-e4d256-prod-github-runner-207 kernel: [25156.618949] RIP: 0033:0x7faa5d0edaff Aug 22 12:23:02 juju-e4d256-prod-github-runner-207 kernel: [25156.619578] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 12:23:02 juju-e4d256-prod-github-runner-207 kernel: [25156.621657] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 12:23:02 juju-e4d256-prod-github-runner-207 kernel: [25156.622647] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 12:23:02 juju-e4d256-prod-github-runner-207 kernel: [25156.623571] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 12:23:02 juju-e4d256-prod-github-runner-207 kernel: [25156.624459] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 12:23:02 juju-e4d256-prod-github-runner-207 kernel: [25156.625352] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 12:23:02 juju-e4d256-prod-github-runner-207 kernel: [25156.626260] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 12:23:02 juju-e4d256-prod-github-runner-207 kernel: [25156.627201] Aug 22 12:23:30 juju-e4d256-prod-github-runner-207 kernel: [25184.541981] watchdog: BUG: soft lockup - CPU#1 stuck for 23346s! [qemu-system-x86:6715] Aug 22 12:23:30 juju-e4d256-prod-github-runner-207 kernel: [25184.543922] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 12:23:30 juju-e4d256-prod-github-runner-207 kernel: [25184.544234] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 12:23:30 juju-e4d256-prod-github-runner-207 kernel: [25184.556621] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 12:23:30 juju-e4d256-prod-github-runner-207 kernel: [25184.557925] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 12:23:30 juju-e4d256-prod-github-runner-207 kernel: [25184.559204] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:23:30 juju-e4d256-prod-github-runner-207 kernel: [25184.560265] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 12:23:30 juju-e4d256-prod-github-runner-207 kernel: [25184.562926] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 12:23:30 juju-e4d256-prod-github-runner-207 kernel: [25184.564088] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 12:23:30 juju-e4d256-prod-github-runner-207 kernel: [25184.565255] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 12:23:30 juju-e4d256-prod-github-runner-207 kernel: [25184.566432] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 12:23:30 juju-e4d256-prod-github-runner-207 kernel: [25184.567638] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 12:23:30 juju-e4d256-prod-github-runner-207 kernel: [25184.568814] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 12:23:30 juju-e4d256-prod-github-runner-207 kernel: [25184.569991] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 12:23:30 juju-e4d256-prod-github-runner-207 kernel: [25184.571427] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 12:23:30 juju-e4d256-prod-github-runner-207 kernel: [25184.572656] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 12:23:30 juju-e4d256-prod-github-runner-207 kernel: [25184.573982] Call Trace: Aug 22 12:23:30 juju-e4d256-prod-github-runner-207 kernel: [25184.575047] Aug 22 12:23:30 juju-e4d256-prod-github-runner-207 kernel: [25184.576029] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:23:30 juju-e4d256-prod-github-runner-207 kernel: [25184.577156] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:23:30 juju-e4d256-prod-github-runner-207 kernel: [25184.578408] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:23:30 juju-e4d256-prod-github-runner-207 kernel: [25184.579614] ? show_regs.part.0+0x23/0x29 Aug 22 12:23:30 juju-e4d256-prod-github-runner-207 kernel: [25184.580701] ? show_regs.cold+0x8/0xd Aug 22 12:23:30 juju-e4d256-prod-github-runner-207 kernel: [25184.581814] ? watchdog_timer_fn+0x1be/0x220 Aug 22 12:23:30 juju-e4d256-prod-github-runner-207 kernel: [25184.582852] ? lockup_detector_update_enable+0x60/0x60 Aug 22 12:23:30 juju-e4d256-prod-github-runner-207 kernel: [25184.583918] ? __hrtimer_run_queues+0x107/0x230 Aug 22 12:23:30 juju-e4d256-prod-github-runner-207 kernel: [25184.584950] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 12:23:30 juju-e4d256-prod-github-runner-207 kernel: [25184.585992] ? hrtimer_interrupt+0x101/0x220 Aug 22 12:23:30 juju-e4d256-prod-github-runner-207 kernel: [25184.587064] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 12:23:30 juju-e4d256-prod-github-runner-207 kernel: [25184.588138] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 12:23:30 juju-e4d256-prod-github-runner-207 kernel: [25184.589181] Aug 22 12:23:30 juju-e4d256-prod-github-runner-207 kernel: [25184.590057] Aug 22 12:23:30 juju-e4d256-prod-github-runner-207 kernel: [25184.590897] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 12:23:30 juju-e4d256-prod-github-runner-207 kernel: [25184.591932] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:23:30 juju-e4d256-prod-github-runner-207 kernel: [25184.592980] ? _raw_spin_lock+0x22/0x30 Aug 22 12:23:30 juju-e4d256-prod-github-runner-207 kernel: [25184.593954] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:23:30 juju-e4d256-prod-github-runner-207 kernel: [25184.595007] direct_page_fault+0x206/0x310 [kvm] Aug 22 12:23:30 juju-e4d256-prod-github-runner-207 kernel: [25184.596041] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 12:23:30 juju-e4d256-prod-github-runner-207 kernel: [25184.597054] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 12:23:30 juju-e4d256-prod-github-runner-207 kernel: [25184.598089] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 12:23:30 juju-e4d256-prod-github-runner-207 kernel: [25184.599124] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 12:23:30 juju-e4d256-prod-github-runner-207 kernel: [25184.600075] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 12:23:30 juju-e4d256-prod-github-runner-207 kernel: [25184.601088] handle_exit+0x98/0x230 [kvm_amd] Aug 22 12:23:30 juju-e4d256-prod-github-runner-207 kernel: [25184.601989] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 12:23:30 juju-e4d256-prod-github-runner-207 kernel: [25184.603028] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 12:23:30 juju-e4d256-prod-github-runner-207 kernel: [25184.604013] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 12:23:30 juju-e4d256-prod-github-runner-207 kernel: [25184.604944] vcpu_run+0x62/0x2c0 [kvm] Aug 22 12:23:30 juju-e4d256-prod-github-runner-207 kernel: [25184.605770] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 12:23:30 juju-e4d256-prod-github-runner-207 kernel: [25184.606614] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 12:23:30 juju-e4d256-prod-github-runner-207 kernel: [25184.607592] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 12:23:30 juju-e4d256-prod-github-runner-207 kernel: [25184.608478] ? __seccomp_filter+0x4a/0x4a0 Aug 22 12:23:30 juju-e4d256-prod-github-runner-207 kernel: [25184.609309] ? __fget_files+0x86/0xc0 Aug 22 12:23:30 juju-e4d256-prod-github-runner-207 kernel: [25184.610112] __x64_sys_ioctl+0x95/0xd0 Aug 22 12:23:30 juju-e4d256-prod-github-runner-207 kernel: [25184.610890] do_syscall_64+0x5c/0xc0 Aug 22 12:23:30 juju-e4d256-prod-github-runner-207 kernel: [25184.611636] ? do_futex+0x162/0x1f0 Aug 22 12:23:30 juju-e4d256-prod-github-runner-207 kernel: [25184.612451] ? __x64_sys_futex+0x78/0x1e0 Aug 22 12:23:30 juju-e4d256-prod-github-runner-207 kernel: [25184.613541] ? __secure_computing+0xa9/0x120 Aug 22 12:23:30 juju-e4d256-prod-github-runner-207 kernel: [25184.614564] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 12:23:30 juju-e4d256-prod-github-runner-207 kernel: [25184.615491] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:23:30 juju-e4d256-prod-github-runner-207 kernel: [25184.616453] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:23:30 juju-e4d256-prod-github-runner-207 kernel: [25184.617511] ? do_syscall_64+0x69/0xc0 Aug 22 12:23:30 juju-e4d256-prod-github-runner-207 kernel: [25184.618387] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:23:30 juju-e4d256-prod-github-runner-207 kernel: [25184.619243] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:23:30 juju-e4d256-prod-github-runner-207 kernel: [25184.620362] ? do_syscall_64+0x69/0xc0 Aug 22 12:23:30 juju-e4d256-prod-github-runner-207 kernel: [25184.621290] ? do_syscall_64+0x69/0xc0 Aug 22 12:23:30 juju-e4d256-prod-github-runner-207 kernel: [25184.622145] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 12:23:30 juju-e4d256-prod-github-runner-207 kernel: [25184.623064] RIP: 0033:0x7faa5d0edaff Aug 22 12:23:30 juju-e4d256-prod-github-runner-207 kernel: [25184.624074] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 12:23:30 juju-e4d256-prod-github-runner-207 kernel: [25184.626731] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 12:23:30 juju-e4d256-prod-github-runner-207 kernel: [25184.628013] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 12:23:30 juju-e4d256-prod-github-runner-207 kernel: [25184.629243] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 12:23:30 juju-e4d256-prod-github-runner-207 kernel: [25184.630418] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 12:23:30 juju-e4d256-prod-github-runner-207 kernel: [25184.631491] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 12:23:30 juju-e4d256-prod-github-runner-207 kernel: [25184.632680] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 12:23:30 juju-e4d256-prod-github-runner-207 kernel: [25184.633871] Aug 22 12:23:44 juju-e4d256-prod-github-runner-207 kernel: [25198.868706] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 12:23:44 juju-e4d256-prod-github-runner-207 kernel: [25198.869693] rcu: 1-....: (6250857 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=3025015 Aug 22 12:23:44 juju-e4d256-prod-github-runner-207 kernel: [25198.870843] (t=6270417 jiffies g=23269 q=29942) Aug 22 12:23:44 juju-e4d256-prod-github-runner-207 kernel: [25198.871657] NMI backtrace for cpu 1 Aug 22 12:23:44 juju-e4d256-prod-github-runner-207 kernel: [25198.872381] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 12:23:44 juju-e4d256-prod-github-runner-207 kernel: [25198.873502] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 12:23:44 juju-e4d256-prod-github-runner-207 kernel: [25198.874589] Call Trace: Aug 22 12:23:44 juju-e4d256-prod-github-runner-207 kernel: [25198.875268] Aug 22 12:23:44 juju-e4d256-prod-github-runner-207 kernel: [25198.875912] show_stack+0x52/0x5c Aug 22 12:23:44 juju-e4d256-prod-github-runner-207 kernel: [25198.876664] dump_stack_lvl+0x4a/0x63 Aug 22 12:23:44 juju-e4d256-prod-github-runner-207 kernel: [25198.877419] dump_stack+0x10/0x16 Aug 22 12:23:44 juju-e4d256-prod-github-runner-207 kernel: [25198.878157] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 12:23:44 juju-e4d256-prod-github-runner-207 kernel: [25198.878947] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 12:23:44 juju-e4d256-prod-github-runner-207 kernel: [25198.879733] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 12:23:44 juju-e4d256-prod-github-runner-207 kernel: [25198.880554] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 12:23:44 juju-e4d256-prod-github-runner-207 kernel: [25198.881377] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 12:23:44 juju-e4d256-prod-github-runner-207 kernel: [25198.882237] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 12:23:44 juju-e4d256-prod-github-runner-207 kernel: [25198.883024] print_cpu_stall.cold+0x2f/0xe2 Aug 22 12:23:44 juju-e4d256-prod-github-runner-207 kernel: [25198.883811] ? timekeeping_update+0xf7/0x150 Aug 22 12:23:44 juju-e4d256-prod-github-runner-207 kernel: [25198.884585] check_cpu_stall+0x109/0x270 Aug 22 12:23:44 juju-e4d256-prod-github-runner-207 kernel: [25198.885337] rcu_sched_clock_irq+0x9a/0x250 Aug 22 12:23:44 juju-e4d256-prod-github-runner-207 kernel: [25198.886168] update_process_times+0x94/0xd0 Aug 22 12:23:44 juju-e4d256-prod-github-runner-207 kernel: [25198.886969] tick_sched_handle+0x29/0x70 Aug 22 12:23:44 juju-e4d256-prod-github-runner-207 kernel: [25198.887722] tick_sched_timer+0x8c/0xc0 Aug 22 12:23:44 juju-e4d256-prod-github-runner-207 kernel: [25198.888470] ? tick_nohz_handler+0xb0/0xb0 Aug 22 12:23:44 juju-e4d256-prod-github-runner-207 kernel: [25198.889226] __hrtimer_run_queues+0x107/0x230 Aug 22 12:23:44 juju-e4d256-prod-github-runner-207 kernel: [25198.890024] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 12:23:44 juju-e4d256-prod-github-runner-207 kernel: [25198.890824] hrtimer_interrupt+0x101/0x220 Aug 22 12:23:44 juju-e4d256-prod-github-runner-207 kernel: [25198.891601] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 12:23:44 juju-e4d256-prod-github-runner-207 kernel: [25198.892422] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 12:23:44 juju-e4d256-prod-github-runner-207 kernel: [25198.893226] Aug 22 12:23:44 juju-e4d256-prod-github-runner-207 kernel: [25198.893881] Aug 22 12:23:44 juju-e4d256-prod-github-runner-207 kernel: [25198.894517] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 12:23:44 juju-e4d256-prod-github-runner-207 kernel: [25198.895337] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:23:44 juju-e4d256-prod-github-runner-207 kernel: [25198.896215] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 12:23:44 juju-e4d256-prod-github-runner-207 kernel: [25198.898455] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 12:23:44 juju-e4d256-prod-github-runner-207 kernel: [25198.899336] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 12:23:44 juju-e4d256-prod-github-runner-207 kernel: [25198.900331] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 12:23:44 juju-e4d256-prod-github-runner-207 kernel: [25198.901534] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 12:23:44 juju-e4d256-prod-github-runner-207 kernel: [25198.902507] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 12:23:44 juju-e4d256-prod-github-runner-207 kernel: [25198.903475] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 12:23:44 juju-e4d256-prod-github-runner-207 kernel: [25198.904444] ? _raw_spin_lock+0x22/0x30 Aug 22 12:23:44 juju-e4d256-prod-github-runner-207 kernel: [25198.905201] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:23:44 juju-e4d256-prod-github-runner-207 kernel: [25198.906107] direct_page_fault+0x206/0x310 [kvm] Aug 22 12:23:44 juju-e4d256-prod-github-runner-207 kernel: [25198.906946] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 12:23:44 juju-e4d256-prod-github-runner-207 kernel: [25198.907771] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 12:23:44 juju-e4d256-prod-github-runner-207 kernel: [25198.908596] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 12:23:44 juju-e4d256-prod-github-runner-207 kernel: [25198.909400] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 12:23:44 juju-e4d256-prod-github-runner-207 kernel: [25198.910202] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 12:23:44 juju-e4d256-prod-github-runner-207 kernel: [25198.911024] handle_exit+0x98/0x230 [kvm_amd] Aug 22 12:23:44 juju-e4d256-prod-github-runner-207 kernel: [25198.911780] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 12:23:44 juju-e4d256-prod-github-runner-207 kernel: [25198.912563] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 12:23:44 juju-e4d256-prod-github-runner-207 kernel: [25198.913371] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 12:23:44 juju-e4d256-prod-github-runner-207 kernel: [25198.914178] vcpu_run+0x62/0x2c0 [kvm] Aug 22 12:23:44 juju-e4d256-prod-github-runner-207 kernel: [25198.914919] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 12:23:44 juju-e4d256-prod-github-runner-207 kernel: [25198.915660] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 12:23:44 juju-e4d256-prod-github-runner-207 kernel: [25198.916476] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 12:23:44 juju-e4d256-prod-github-runner-207 kernel: [25198.917282] ? __seccomp_filter+0x4a/0x4a0 Aug 22 12:23:44 juju-e4d256-prod-github-runner-207 kernel: [25198.918081] ? __fget_files+0x86/0xc0 Aug 22 12:23:44 juju-e4d256-prod-github-runner-207 kernel: [25198.918920] __x64_sys_ioctl+0x95/0xd0 Aug 22 12:23:44 juju-e4d256-prod-github-runner-207 kernel: [25198.919856] do_syscall_64+0x5c/0xc0 Aug 22 12:23:44 juju-e4d256-prod-github-runner-207 kernel: [25198.920584] ? do_futex+0x162/0x1f0 Aug 22 12:23:44 juju-e4d256-prod-github-runner-207 kernel: [25198.921276] ? __x64_sys_futex+0x78/0x1e0 Aug 22 12:23:44 juju-e4d256-prod-github-runner-207 kernel: [25198.922013] ? __secure_computing+0xa9/0x120 Aug 22 12:23:44 juju-e4d256-prod-github-runner-207 kernel: [25198.922738] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 12:23:44 juju-e4d256-prod-github-runner-207 kernel: [25198.923541] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:23:44 juju-e4d256-prod-github-runner-207 kernel: [25198.924303] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:23:44 juju-e4d256-prod-github-runner-207 kernel: [25198.925099] ? do_syscall_64+0x69/0xc0 Aug 22 12:23:44 juju-e4d256-prod-github-runner-207 kernel: [25198.925805] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:23:44 juju-e4d256-prod-github-runner-207 kernel: [25198.926587] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:23:44 juju-e4d256-prod-github-runner-207 kernel: [25198.927350] ? do_syscall_64+0x69/0xc0 Aug 22 12:23:44 juju-e4d256-prod-github-runner-207 kernel: [25198.928052] ? do_syscall_64+0x69/0xc0 Aug 22 12:23:44 juju-e4d256-prod-github-runner-207 kernel: [25198.928746] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 12:23:44 juju-e4d256-prod-github-runner-207 kernel: [25198.929541] RIP: 0033:0x7faa5d0edaff Aug 22 12:23:44 juju-e4d256-prod-github-runner-207 kernel: [25198.930274] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 12:23:44 juju-e4d256-prod-github-runner-207 kernel: [25198.932414] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 12:23:44 juju-e4d256-prod-github-runner-207 kernel: [25198.933392] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 12:23:44 juju-e4d256-prod-github-runner-207 kernel: [25198.934356] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 12:23:44 juju-e4d256-prod-github-runner-207 kernel: [25198.935312] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 12:23:44 juju-e4d256-prod-github-runner-207 kernel: [25198.936262] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 12:23:44 juju-e4d256-prod-github-runner-207 kernel: [25198.937206] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 12:23:44 juju-e4d256-prod-github-runner-207 kernel: [25198.938143] Aug 22 12:24:10 juju-e4d256-prod-github-runner-207 kernel: [25224.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 23384s! [qemu-system-x86:6715] Aug 22 12:24:10 juju-e4d256-prod-github-runner-207 kernel: [25224.543134] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 12:24:10 juju-e4d256-prod-github-runner-207 kernel: [25224.543211] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 12:24:10 juju-e4d256-prod-github-runner-207 kernel: [25224.555348] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 12:24:10 juju-e4d256-prod-github-runner-207 kernel: [25224.556615] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 12:24:10 juju-e4d256-prod-github-runner-207 kernel: [25224.557844] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:24:10 juju-e4d256-prod-github-runner-207 kernel: [25224.558902] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 12:24:10 juju-e4d256-prod-github-runner-207 kernel: [25224.561726] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 12:24:10 juju-e4d256-prod-github-runner-207 kernel: [25224.562783] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 12:24:10 juju-e4d256-prod-github-runner-207 kernel: [25224.564141] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 12:24:10 juju-e4d256-prod-github-runner-207 kernel: [25224.565307] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 12:24:10 juju-e4d256-prod-github-runner-207 kernel: [25224.566484] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 12:24:10 juju-e4d256-prod-github-runner-207 kernel: [25224.567650] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 12:24:10 juju-e4d256-prod-github-runner-207 kernel: [25224.568819] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 12:24:10 juju-e4d256-prod-github-runner-207 kernel: [25224.570071] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 12:24:10 juju-e4d256-prod-github-runner-207 kernel: [25224.571170] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 12:24:10 juju-e4d256-prod-github-runner-207 kernel: [25224.572366] Call Trace: Aug 22 12:24:10 juju-e4d256-prod-github-runner-207 kernel: [25224.573278] Aug 22 12:24:10 juju-e4d256-prod-github-runner-207 kernel: [25224.574180] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:24:10 juju-e4d256-prod-github-runner-207 kernel: [25224.575216] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:24:10 juju-e4d256-prod-github-runner-207 kernel: [25224.576237] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:24:10 juju-e4d256-prod-github-runner-207 kernel: [25224.577317] ? show_regs.part.0+0x23/0x29 Aug 22 12:24:10 juju-e4d256-prod-github-runner-207 kernel: [25224.578359] ? show_regs.cold+0x8/0xd Aug 22 12:24:10 juju-e4d256-prod-github-runner-207 kernel: [25224.579336] ? watchdog_timer_fn+0x1be/0x220 Aug 22 12:24:10 juju-e4d256-prod-github-runner-207 kernel: [25224.580344] ? lockup_detector_update_enable+0x60/0x60 Aug 22 12:24:10 juju-e4d256-prod-github-runner-207 kernel: [25224.581439] ? __hrtimer_run_queues+0x107/0x230 Aug 22 12:24:10 juju-e4d256-prod-github-runner-207 kernel: [25224.582496] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 12:24:10 juju-e4d256-prod-github-runner-207 kernel: [25224.583539] ? hrtimer_interrupt+0x101/0x220 Aug 22 12:24:10 juju-e4d256-prod-github-runner-207 kernel: [25224.584597] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 12:24:10 juju-e4d256-prod-github-runner-207 kernel: [25224.585694] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 12:24:10 juju-e4d256-prod-github-runner-207 kernel: [25224.586749] Aug 22 12:24:10 juju-e4d256-prod-github-runner-207 kernel: [25224.587607] Aug 22 12:24:10 juju-e4d256-prod-github-runner-207 kernel: [25224.588447] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 12:24:10 juju-e4d256-prod-github-runner-207 kernel: [25224.589493] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:24:10 juju-e4d256-prod-github-runner-207 kernel: [25224.590558] ? _raw_spin_lock+0x22/0x30 Aug 22 12:24:10 juju-e4d256-prod-github-runner-207 kernel: [25224.591507] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:24:10 juju-e4d256-prod-github-runner-207 kernel: [25224.592530] direct_page_fault+0x206/0x310 [kvm] Aug 22 12:24:10 juju-e4d256-prod-github-runner-207 kernel: [25224.593579] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 12:24:10 juju-e4d256-prod-github-runner-207 kernel: [25224.594594] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 12:24:10 juju-e4d256-prod-github-runner-207 kernel: [25224.595604] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 12:24:10 juju-e4d256-prod-github-runner-207 kernel: [25224.596577] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 12:24:10 juju-e4d256-prod-github-runner-207 kernel: [25224.597545] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 12:24:10 juju-e4d256-prod-github-runner-207 kernel: [25224.598531] handle_exit+0x98/0x230 [kvm_amd] Aug 22 12:24:10 juju-e4d256-prod-github-runner-207 kernel: [25224.599434] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 12:24:10 juju-e4d256-prod-github-runner-207 kernel: [25224.600359] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 12:24:10 juju-e4d256-prod-github-runner-207 kernel: [25224.601289] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 12:24:10 juju-e4d256-prod-github-runner-207 kernel: [25224.602247] vcpu_run+0x62/0x2c0 [kvm] Aug 22 12:24:10 juju-e4d256-prod-github-runner-207 kernel: [25224.603067] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 12:24:10 juju-e4d256-prod-github-runner-207 kernel: [25224.603886] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 12:24:10 juju-e4d256-prod-github-runner-207 kernel: [25224.604754] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 12:24:10 juju-e4d256-prod-github-runner-207 kernel: [25224.605573] ? __seccomp_filter+0x4a/0x4a0 Aug 22 12:24:10 juju-e4d256-prod-github-runner-207 kernel: [25224.606323] ? __fget_files+0x86/0xc0 Aug 22 12:24:10 juju-e4d256-prod-github-runner-207 kernel: [25224.607029] __x64_sys_ioctl+0x95/0xd0 Aug 22 12:24:10 juju-e4d256-prod-github-runner-207 kernel: [25224.607723] do_syscall_64+0x5c/0xc0 Aug 22 12:24:10 juju-e4d256-prod-github-runner-207 kernel: [25224.608389] ? do_futex+0x162/0x1f0 Aug 22 12:24:10 juju-e4d256-prod-github-runner-207 kernel: [25224.609044] ? __x64_sys_futex+0x78/0x1e0 Aug 22 12:24:10 juju-e4d256-prod-github-runner-207 kernel: [25224.609740] ? __secure_computing+0xa9/0x120 Aug 22 12:24:10 juju-e4d256-prod-github-runner-207 kernel: [25224.610435] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 12:24:10 juju-e4d256-prod-github-runner-207 kernel: [25224.611198] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:24:10 juju-e4d256-prod-github-runner-207 kernel: [25224.611924] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:24:10 juju-e4d256-prod-github-runner-207 kernel: [25224.612652] ? do_syscall_64+0x69/0xc0 Aug 22 12:24:10 juju-e4d256-prod-github-runner-207 kernel: [25224.613300] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:24:10 juju-e4d256-prod-github-runner-207 kernel: [25224.614019] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:24:10 juju-e4d256-prod-github-runner-207 kernel: [25224.614722] ? do_syscall_64+0x69/0xc0 Aug 22 12:24:10 juju-e4d256-prod-github-runner-207 kernel: [25224.615347] ? do_syscall_64+0x69/0xc0 Aug 22 12:24:10 juju-e4d256-prod-github-runner-207 kernel: [25224.615974] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 12:24:10 juju-e4d256-prod-github-runner-207 kernel: [25224.616679] RIP: 0033:0x7faa5d0edaff Aug 22 12:24:10 juju-e4d256-prod-github-runner-207 kernel: [25224.617305] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 12:24:10 juju-e4d256-prod-github-runner-207 kernel: [25224.619306] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 12:24:10 juju-e4d256-prod-github-runner-207 kernel: [25224.620219] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 12:24:10 juju-e4d256-prod-github-runner-207 kernel: [25224.621111] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 12:24:10 juju-e4d256-prod-github-runner-207 kernel: [25224.622021] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 12:24:10 juju-e4d256-prod-github-runner-207 kernel: [25224.622911] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 12:24:10 juju-e4d256-prod-github-runner-207 kernel: [25224.623798] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 12:24:10 juju-e4d256-prod-github-runner-207 kernel: [25224.624706] Aug 22 12:24:38 juju-e4d256-prod-github-runner-207 kernel: [25252.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 23410s! [qemu-system-x86:6715] Aug 22 12:24:38 juju-e4d256-prod-github-runner-207 kernel: [25252.543139] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 12:24:38 juju-e4d256-prod-github-runner-207 kernel: [25252.543215] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 12:24:38 juju-e4d256-prod-github-runner-207 kernel: [25252.555626] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 12:24:38 juju-e4d256-prod-github-runner-207 kernel: [25252.556911] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 12:24:38 juju-e4d256-prod-github-runner-207 kernel: [25252.558164] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:24:38 juju-e4d256-prod-github-runner-207 kernel: [25252.559221] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 12:24:38 juju-e4d256-prod-github-runner-207 kernel: [25252.561804] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 12:24:38 juju-e4d256-prod-github-runner-207 kernel: [25252.562853] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 12:24:38 juju-e4d256-prod-github-runner-207 kernel: [25252.564019] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 12:24:38 juju-e4d256-prod-github-runner-207 kernel: [25252.565199] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 12:24:38 juju-e4d256-prod-github-runner-207 kernel: [25252.566358] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 12:24:38 juju-e4d256-prod-github-runner-207 kernel: [25252.567525] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 12:24:38 juju-e4d256-prod-github-runner-207 kernel: [25252.568694] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 12:24:38 juju-e4d256-prod-github-runner-207 kernel: [25252.569951] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 12:24:38 juju-e4d256-prod-github-runner-207 kernel: [25252.571063] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 12:24:38 juju-e4d256-prod-github-runner-207 kernel: [25252.572253] Call Trace: Aug 22 12:24:38 juju-e4d256-prod-github-runner-207 kernel: [25252.573196] Aug 22 12:24:38 juju-e4d256-prod-github-runner-207 kernel: [25252.574081] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:24:38 juju-e4d256-prod-github-runner-207 kernel: [25252.575131] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:24:38 juju-e4d256-prod-github-runner-207 kernel: [25252.576152] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:24:38 juju-e4d256-prod-github-runner-207 kernel: [25252.577252] ? show_regs.part.0+0x23/0x29 Aug 22 12:24:38 juju-e4d256-prod-github-runner-207 kernel: [25252.578279] ? show_regs.cold+0x8/0xd Aug 22 12:24:38 juju-e4d256-prod-github-runner-207 kernel: [25252.579327] ? watchdog_timer_fn+0x1be/0x220 Aug 22 12:24:38 juju-e4d256-prod-github-runner-207 kernel: [25252.580424] ? lockup_detector_update_enable+0x60/0x60 Aug 22 12:24:38 juju-e4d256-prod-github-runner-207 kernel: [25252.581714] ? __hrtimer_run_queues+0x107/0x230 Aug 22 12:24:38 juju-e4d256-prod-github-runner-207 kernel: [25252.582759] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 12:24:38 juju-e4d256-prod-github-runner-207 kernel: [25252.583785] ? hrtimer_interrupt+0x101/0x220 Aug 22 12:24:38 juju-e4d256-prod-github-runner-207 kernel: [25252.584806] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 12:24:38 juju-e4d256-prod-github-runner-207 kernel: [25252.585931] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 12:24:38 juju-e4d256-prod-github-runner-207 kernel: [25252.586988] Aug 22 12:24:38 juju-e4d256-prod-github-runner-207 kernel: [25252.587841] Aug 22 12:24:38 juju-e4d256-prod-github-runner-207 kernel: [25252.588677] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 12:24:38 juju-e4d256-prod-github-runner-207 kernel: [25252.589749] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:24:38 juju-e4d256-prod-github-runner-207 kernel: [25252.590805] ? _raw_spin_lock+0x22/0x30 Aug 22 12:24:38 juju-e4d256-prod-github-runner-207 kernel: [25252.591751] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:24:38 juju-e4d256-prod-github-runner-207 kernel: [25252.592776] direct_page_fault+0x206/0x310 [kvm] Aug 22 12:24:38 juju-e4d256-prod-github-runner-207 kernel: [25252.593815] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 12:24:38 juju-e4d256-prod-github-runner-207 kernel: [25252.594824] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 12:24:38 juju-e4d256-prod-github-runner-207 kernel: [25252.595827] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 12:24:38 juju-e4d256-prod-github-runner-207 kernel: [25252.596796] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 12:24:38 juju-e4d256-prod-github-runner-207 kernel: [25252.597759] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 12:24:38 juju-e4d256-prod-github-runner-207 kernel: [25252.598737] handle_exit+0x98/0x230 [kvm_amd] Aug 22 12:24:38 juju-e4d256-prod-github-runner-207 kernel: [25252.599634] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 12:24:38 juju-e4d256-prod-github-runner-207 kernel: [25252.600568] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 12:24:38 juju-e4d256-prod-github-runner-207 kernel: [25252.601524] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 12:24:38 juju-e4d256-prod-github-runner-207 kernel: [25252.602435] vcpu_run+0x62/0x2c0 [kvm] Aug 22 12:24:38 juju-e4d256-prod-github-runner-207 kernel: [25252.603245] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 12:24:38 juju-e4d256-prod-github-runner-207 kernel: [25252.604054] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 12:24:38 juju-e4d256-prod-github-runner-207 kernel: [25252.604909] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 12:24:38 juju-e4d256-prod-github-runner-207 kernel: [25252.605724] ? __seccomp_filter+0x4a/0x4a0 Aug 22 12:24:38 juju-e4d256-prod-github-runner-207 kernel: [25252.606469] ? __fget_files+0x86/0xc0 Aug 22 12:24:38 juju-e4d256-prod-github-runner-207 kernel: [25252.607172] __x64_sys_ioctl+0x95/0xd0 Aug 22 12:24:38 juju-e4d256-prod-github-runner-207 kernel: [25252.607864] do_syscall_64+0x5c/0xc0 Aug 22 12:24:38 juju-e4d256-prod-github-runner-207 kernel: [25252.608529] ? do_futex+0x162/0x1f0 Aug 22 12:24:38 juju-e4d256-prod-github-runner-207 kernel: [25252.609192] ? __x64_sys_futex+0x78/0x1e0 Aug 22 12:24:38 juju-e4d256-prod-github-runner-207 kernel: [25252.609866] ? __secure_computing+0xa9/0x120 Aug 22 12:24:38 juju-e4d256-prod-github-runner-207 kernel: [25252.610582] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 12:24:38 juju-e4d256-prod-github-runner-207 kernel: [25252.611469] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:24:38 juju-e4d256-prod-github-runner-207 kernel: [25252.612198] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:24:38 juju-e4d256-prod-github-runner-207 kernel: [25252.612963] ? do_syscall_64+0x69/0xc0 Aug 22 12:24:38 juju-e4d256-prod-github-runner-207 kernel: [25252.613638] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:24:38 juju-e4d256-prod-github-runner-207 kernel: [25252.614350] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:24:38 juju-e4d256-prod-github-runner-207 kernel: [25252.615047] ? do_syscall_64+0x69/0xc0 Aug 22 12:24:38 juju-e4d256-prod-github-runner-207 kernel: [25252.615675] ? do_syscall_64+0x69/0xc0 Aug 22 12:24:38 juju-e4d256-prod-github-runner-207 kernel: [25252.616352] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 12:24:38 juju-e4d256-prod-github-runner-207 kernel: [25252.617069] RIP: 0033:0x7faa5d0edaff Aug 22 12:24:38 juju-e4d256-prod-github-runner-207 kernel: [25252.617711] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 12:24:38 juju-e4d256-prod-github-runner-207 kernel: [25252.619704] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 12:24:38 juju-e4d256-prod-github-runner-207 kernel: [25252.620614] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 12:24:38 juju-e4d256-prod-github-runner-207 kernel: [25252.621532] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 12:24:38 juju-e4d256-prod-github-runner-207 kernel: [25252.622422] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 12:24:38 juju-e4d256-prod-github-runner-207 kernel: [25252.623313] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 12:24:38 juju-e4d256-prod-github-runner-207 kernel: [25252.628994] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 12:24:38 juju-e4d256-prod-github-runner-207 kernel: [25252.629919] Aug 22 12:25:06 juju-e4d256-prod-github-runner-207 kernel: [25280.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 23436s! [qemu-system-x86:6715] Aug 22 12:25:06 juju-e4d256-prod-github-runner-207 kernel: [25280.543861] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 12:25:06 juju-e4d256-prod-github-runner-207 kernel: [25280.544158] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 12:25:06 juju-e4d256-prod-github-runner-207 kernel: [25280.556638] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 12:25:06 juju-e4d256-prod-github-runner-207 kernel: [25280.557947] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 12:25:06 juju-e4d256-prod-github-runner-207 kernel: [25280.559267] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:25:06 juju-e4d256-prod-github-runner-207 kernel: [25280.560328] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 12:25:06 juju-e4d256-prod-github-runner-207 kernel: [25280.562899] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 12:25:06 juju-e4d256-prod-github-runner-207 kernel: [25280.563945] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 12:25:06 juju-e4d256-prod-github-runner-207 kernel: [25280.565118] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 12:25:06 juju-e4d256-prod-github-runner-207 kernel: [25280.566274] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 12:25:06 juju-e4d256-prod-github-runner-207 kernel: [25280.567429] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 12:25:06 juju-e4d256-prod-github-runner-207 kernel: [25280.568592] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 12:25:06 juju-e4d256-prod-github-runner-207 kernel: [25280.569785] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 12:25:06 juju-e4d256-prod-github-runner-207 kernel: [25280.571036] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 12:25:06 juju-e4d256-prod-github-runner-207 kernel: [25280.572144] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 12:25:06 juju-e4d256-prod-github-runner-207 kernel: [25280.573373] Call Trace: Aug 22 12:25:06 juju-e4d256-prod-github-runner-207 kernel: [25280.574348] Aug 22 12:25:06 juju-e4d256-prod-github-runner-207 kernel: [25280.575258] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:25:06 juju-e4d256-prod-github-runner-207 kernel: [25280.576289] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:25:06 juju-e4d256-prod-github-runner-207 kernel: [25280.577336] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:25:06 juju-e4d256-prod-github-runner-207 kernel: [25280.578431] ? show_regs.part.0+0x23/0x29 Aug 22 12:25:06 juju-e4d256-prod-github-runner-207 kernel: [25280.579426] ? show_regs.cold+0x8/0xd Aug 22 12:25:06 juju-e4d256-prod-github-runner-207 kernel: [25280.580401] ? watchdog_timer_fn+0x1be/0x220 Aug 22 12:25:06 juju-e4d256-prod-github-runner-207 kernel: [25280.581427] ? lockup_detector_update_enable+0x60/0x60 Aug 22 12:25:06 juju-e4d256-prod-github-runner-207 kernel: [25280.582489] ? __hrtimer_run_queues+0x107/0x230 Aug 22 12:25:06 juju-e4d256-prod-github-runner-207 kernel: [25280.583514] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 12:25:06 juju-e4d256-prod-github-runner-207 kernel: [25280.584578] ? hrtimer_interrupt+0x101/0x220 Aug 22 12:25:06 juju-e4d256-prod-github-runner-207 kernel: [25280.585624] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 12:25:06 juju-e4d256-prod-github-runner-207 kernel: [25280.586727] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 12:25:06 juju-e4d256-prod-github-runner-207 kernel: [25280.587790] Aug 22 12:25:06 juju-e4d256-prod-github-runner-207 kernel: [25280.588647] Aug 22 12:25:06 juju-e4d256-prod-github-runner-207 kernel: [25280.589508] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 12:25:06 juju-e4d256-prod-github-runner-207 kernel: [25280.590549] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:25:06 juju-e4d256-prod-github-runner-207 kernel: [25280.591593] ? _raw_spin_lock+0x22/0x30 Aug 22 12:25:06 juju-e4d256-prod-github-runner-207 kernel: [25280.592545] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:25:06 juju-e4d256-prod-github-runner-207 kernel: [25280.593603] direct_page_fault+0x206/0x310 [kvm] Aug 22 12:25:06 juju-e4d256-prod-github-runner-207 kernel: [25280.594632] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 12:25:06 juju-e4d256-prod-github-runner-207 kernel: [25280.595641] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 12:25:06 juju-e4d256-prod-github-runner-207 kernel: [25280.596646] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 12:25:06 juju-e4d256-prod-github-runner-207 kernel: [25280.597663] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 12:25:06 juju-e4d256-prod-github-runner-207 kernel: [25280.598610] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 12:25:06 juju-e4d256-prod-github-runner-207 kernel: [25280.599590] handle_exit+0x98/0x230 [kvm_amd] Aug 22 12:25:06 juju-e4d256-prod-github-runner-207 kernel: [25280.600487] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 12:25:06 juju-e4d256-prod-github-runner-207 kernel: [25280.601411] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 12:25:06 juju-e4d256-prod-github-runner-207 kernel: [25280.602340] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 12:25:06 juju-e4d256-prod-github-runner-207 kernel: [25280.603246] vcpu_run+0x62/0x2c0 [kvm] Aug 22 12:25:06 juju-e4d256-prod-github-runner-207 kernel: [25280.604078] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 12:25:06 juju-e4d256-prod-github-runner-207 kernel: [25280.604917] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 12:25:06 juju-e4d256-prod-github-runner-207 kernel: [25280.605774] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 12:25:06 juju-e4d256-prod-github-runner-207 kernel: [25280.606571] ? __seccomp_filter+0x4a/0x4a0 Aug 22 12:25:06 juju-e4d256-prod-github-runner-207 kernel: [25280.607315] ? __fget_files+0x86/0xc0 Aug 22 12:25:06 juju-e4d256-prod-github-runner-207 kernel: [25280.608020] __x64_sys_ioctl+0x95/0xd0 Aug 22 12:25:06 juju-e4d256-prod-github-runner-207 kernel: [25280.608723] do_syscall_64+0x5c/0xc0 Aug 22 12:25:06 juju-e4d256-prod-github-runner-207 kernel: [25280.609418] ? do_futex+0x162/0x1f0 Aug 22 12:25:06 juju-e4d256-prod-github-runner-207 kernel: [25280.610068] ? __x64_sys_futex+0x78/0x1e0 Aug 22 12:25:06 juju-e4d256-prod-github-runner-207 kernel: [25280.610744] ? __secure_computing+0xa9/0x120 Aug 22 12:25:06 juju-e4d256-prod-github-runner-207 kernel: [25280.611434] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 12:25:06 juju-e4d256-prod-github-runner-207 kernel: [25280.612193] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:25:06 juju-e4d256-prod-github-runner-207 kernel: [25280.612928] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:25:06 juju-e4d256-prod-github-runner-207 kernel: [25280.613647] ? do_syscall_64+0x69/0xc0 Aug 22 12:25:06 juju-e4d256-prod-github-runner-207 kernel: [25280.614309] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:25:06 juju-e4d256-prod-github-runner-207 kernel: [25280.615062] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:25:06 juju-e4d256-prod-github-runner-207 kernel: [25280.615764] ? do_syscall_64+0x69/0xc0 Aug 22 12:25:06 juju-e4d256-prod-github-runner-207 kernel: [25280.616388] ? do_syscall_64+0x69/0xc0 Aug 22 12:25:06 juju-e4d256-prod-github-runner-207 kernel: [25280.617026] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 12:25:06 juju-e4d256-prod-github-runner-207 kernel: [25280.617732] RIP: 0033:0x7faa5d0edaff Aug 22 12:25:06 juju-e4d256-prod-github-runner-207 kernel: [25280.618384] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 12:25:06 juju-e4d256-prod-github-runner-207 kernel: [25280.620373] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 12:25:06 juju-e4d256-prod-github-runner-207 kernel: [25280.621300] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 12:25:06 juju-e4d256-prod-github-runner-207 kernel: [25280.622187] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 12:25:06 juju-e4d256-prod-github-runner-207 kernel: [25280.623073] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 12:25:06 juju-e4d256-prod-github-runner-207 kernel: [25280.623956] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 12:25:06 juju-e4d256-prod-github-runner-207 kernel: [25280.624856] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 12:25:06 juju-e4d256-prod-github-runner-207 kernel: [25280.625747] Aug 22 12:25:34 juju-e4d256-prod-github-runner-207 kernel: [25308.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 23462s! [qemu-system-x86:6715] Aug 22 12:25:34 juju-e4d256-prod-github-runner-207 kernel: [25308.543141] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 12:25:34 juju-e4d256-prod-github-runner-207 kernel: [25308.543218] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 12:25:34 juju-e4d256-prod-github-runner-207 kernel: [25308.555561] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 12:25:34 juju-e4d256-prod-github-runner-207 kernel: [25308.556847] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 12:25:34 juju-e4d256-prod-github-runner-207 kernel: [25308.558152] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:25:34 juju-e4d256-prod-github-runner-207 kernel: [25308.559225] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 12:25:34 juju-e4d256-prod-github-runner-207 kernel: [25308.561830] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 12:25:34 juju-e4d256-prod-github-runner-207 kernel: [25308.562899] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 12:25:34 juju-e4d256-prod-github-runner-207 kernel: [25308.564077] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 12:25:34 juju-e4d256-prod-github-runner-207 kernel: [25308.565276] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 12:25:34 juju-e4d256-prod-github-runner-207 kernel: [25308.566447] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 12:25:34 juju-e4d256-prod-github-runner-207 kernel: [25308.567631] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 12:25:34 juju-e4d256-prod-github-runner-207 kernel: [25308.568845] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 12:25:34 juju-e4d256-prod-github-runner-207 kernel: [25308.570090] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 12:25:34 juju-e4d256-prod-github-runner-207 kernel: [25308.571202] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 12:25:34 juju-e4d256-prod-github-runner-207 kernel: [25308.572408] Call Trace: Aug 22 12:25:34 juju-e4d256-prod-github-runner-207 kernel: [25308.573357] Aug 22 12:25:34 juju-e4d256-prod-github-runner-207 kernel: [25308.574252] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:25:34 juju-e4d256-prod-github-runner-207 kernel: [25308.575289] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:25:34 juju-e4d256-prod-github-runner-207 kernel: [25308.576352] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:25:34 juju-e4d256-prod-github-runner-207 kernel: [25308.577480] ? show_regs.part.0+0x23/0x29 Aug 22 12:25:34 juju-e4d256-prod-github-runner-207 kernel: [25308.578524] ? show_regs.cold+0x8/0xd Aug 22 12:25:34 juju-e4d256-prod-github-runner-207 kernel: [25308.579528] ? watchdog_timer_fn+0x1be/0x220 Aug 22 12:25:34 juju-e4d256-prod-github-runner-207 kernel: [25308.580564] ? lockup_detector_update_enable+0x60/0x60 Aug 22 12:25:34 juju-e4d256-prod-github-runner-207 kernel: [25308.581651] ? __hrtimer_run_queues+0x107/0x230 Aug 22 12:25:34 juju-e4d256-prod-github-runner-207 kernel: [25308.582696] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 12:25:34 juju-e4d256-prod-github-runner-207 kernel: [25308.583735] ? hrtimer_interrupt+0x101/0x220 Aug 22 12:25:34 juju-e4d256-prod-github-runner-207 kernel: [25308.584792] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 12:25:34 juju-e4d256-prod-github-runner-207 kernel: [25308.585874] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 12:25:34 juju-e4d256-prod-github-runner-207 kernel: [25308.586928] Aug 22 12:25:34 juju-e4d256-prod-github-runner-207 kernel: [25308.587826] Aug 22 12:25:34 juju-e4d256-prod-github-runner-207 kernel: [25308.588683] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 12:25:34 juju-e4d256-prod-github-runner-207 kernel: [25308.589719] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:25:34 juju-e4d256-prod-github-runner-207 kernel: [25308.590778] ? _raw_spin_lock+0x22/0x30 Aug 22 12:25:34 juju-e4d256-prod-github-runner-207 kernel: [25308.591732] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:25:34 juju-e4d256-prod-github-runner-207 kernel: [25308.592766] direct_page_fault+0x206/0x310 [kvm] Aug 22 12:25:34 juju-e4d256-prod-github-runner-207 kernel: [25308.593791] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 12:25:34 juju-e4d256-prod-github-runner-207 kernel: [25308.594831] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 12:25:34 juju-e4d256-prod-github-runner-207 kernel: [25308.595836] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 12:25:34 juju-e4d256-prod-github-runner-207 kernel: [25308.596816] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 12:25:34 juju-e4d256-prod-github-runner-207 kernel: [25308.597762] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 12:25:34 juju-e4d256-prod-github-runner-207 kernel: [25308.598740] handle_exit+0x98/0x230 [kvm_amd] Aug 22 12:25:34 juju-e4d256-prod-github-runner-207 kernel: [25308.599630] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 12:25:34 juju-e4d256-prod-github-runner-207 kernel: [25308.600555] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 12:25:34 juju-e4d256-prod-github-runner-207 kernel: [25308.601480] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 12:25:34 juju-e4d256-prod-github-runner-207 kernel: [25308.602393] vcpu_run+0x62/0x2c0 [kvm] Aug 22 12:25:34 juju-e4d256-prod-github-runner-207 kernel: [25308.603204] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 12:25:34 juju-e4d256-prod-github-runner-207 kernel: [25308.604010] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 12:25:34 juju-e4d256-prod-github-runner-207 kernel: [25308.604873] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 12:25:34 juju-e4d256-prod-github-runner-207 kernel: [25308.605696] ? __seccomp_filter+0x4a/0x4a0 Aug 22 12:25:34 juju-e4d256-prod-github-runner-207 kernel: [25308.606442] ? __fget_files+0x86/0xc0 Aug 22 12:25:34 juju-e4d256-prod-github-runner-207 kernel: [25308.607154] __x64_sys_ioctl+0x95/0xd0 Aug 22 12:25:34 juju-e4d256-prod-github-runner-207 kernel: [25308.607848] do_syscall_64+0x5c/0xc0 Aug 22 12:25:34 juju-e4d256-prod-github-runner-207 kernel: [25308.608536] ? do_futex+0x162/0x1f0 Aug 22 12:25:34 juju-e4d256-prod-github-runner-207 kernel: [25308.609224] ? __x64_sys_futex+0x78/0x1e0 Aug 22 12:25:34 juju-e4d256-prod-github-runner-207 kernel: [25308.609908] ? __secure_computing+0xa9/0x120 Aug 22 12:25:34 juju-e4d256-prod-github-runner-207 kernel: [25308.610619] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 12:25:34 juju-e4d256-prod-github-runner-207 kernel: [25308.611380] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:25:34 juju-e4d256-prod-github-runner-207 kernel: [25308.612104] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:25:34 juju-e4d256-prod-github-runner-207 kernel: [25308.612842] ? do_syscall_64+0x69/0xc0 Aug 22 12:25:34 juju-e4d256-prod-github-runner-207 kernel: [25308.613488] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:25:34 juju-e4d256-prod-github-runner-207 kernel: [25308.614390] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:25:34 juju-e4d256-prod-github-runner-207 kernel: [25308.615122] ? do_syscall_64+0x69/0xc0 Aug 22 12:25:34 juju-e4d256-prod-github-runner-207 kernel: [25308.615834] ? do_syscall_64+0x69/0xc0 Aug 22 12:25:34 juju-e4d256-prod-github-runner-207 kernel: [25308.616460] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 12:25:34 juju-e4d256-prod-github-runner-207 kernel: [25308.617214] RIP: 0033:0x7faa5d0edaff Aug 22 12:25:34 juju-e4d256-prod-github-runner-207 kernel: [25308.617868] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 12:25:34 juju-e4d256-prod-github-runner-207 kernel: [25308.619853] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 12:25:34 juju-e4d256-prod-github-runner-207 kernel: [25308.620775] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 12:25:34 juju-e4d256-prod-github-runner-207 kernel: [25308.621669] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 12:25:34 juju-e4d256-prod-github-runner-207 kernel: [25308.622557] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 12:25:34 juju-e4d256-prod-github-runner-207 kernel: [25308.623444] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 12:25:34 juju-e4d256-prod-github-runner-207 kernel: [25308.624331] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 12:25:34 juju-e4d256-prod-github-runner-207 kernel: [25308.625260] Aug 22 12:26:02 juju-e4d256-prod-github-runner-207 kernel: [25336.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 23488s! [qemu-system-x86:6715] Aug 22 12:26:02 juju-e4d256-prod-github-runner-207 kernel: [25336.543183] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 12:26:02 juju-e4d256-prod-github-runner-207 kernel: [25336.543261] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 12:26:02 juju-e4d256-prod-github-runner-207 kernel: [25336.557561] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 12:26:02 juju-e4d256-prod-github-runner-207 kernel: [25336.558863] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 12:26:02 juju-e4d256-prod-github-runner-207 kernel: [25336.560174] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:26:02 juju-e4d256-prod-github-runner-207 kernel: [25336.561278] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 12:26:02 juju-e4d256-prod-github-runner-207 kernel: [25336.563902] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 12:26:02 juju-e4d256-prod-github-runner-207 kernel: [25336.564969] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 12:26:02 juju-e4d256-prod-github-runner-207 kernel: [25336.566138] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 12:26:02 juju-e4d256-prod-github-runner-207 kernel: [25336.567317] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 12:26:02 juju-e4d256-prod-github-runner-207 kernel: [25336.568574] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 12:26:02 juju-e4d256-prod-github-runner-207 kernel: [25336.569760] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 12:26:02 juju-e4d256-prod-github-runner-207 kernel: [25336.570937] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 12:26:02 juju-e4d256-prod-github-runner-207 kernel: [25336.572227] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 12:26:02 juju-e4d256-prod-github-runner-207 kernel: [25336.573474] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 12:26:02 juju-e4d256-prod-github-runner-207 kernel: [25336.574701] Call Trace: Aug 22 12:26:02 juju-e4d256-prod-github-runner-207 kernel: [25336.575629] Aug 22 12:26:02 juju-e4d256-prod-github-runner-207 kernel: [25336.576539] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:26:02 juju-e4d256-prod-github-runner-207 kernel: [25336.577578] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:26:02 juju-e4d256-prod-github-runner-207 kernel: [25336.578606] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:26:02 juju-e4d256-prod-github-runner-207 kernel: [25336.579682] ? show_regs.part.0+0x23/0x29 Aug 22 12:26:02 juju-e4d256-prod-github-runner-207 kernel: [25336.580693] ? show_regs.cold+0x8/0xd Aug 22 12:26:02 juju-e4d256-prod-github-runner-207 kernel: [25336.581664] ? watchdog_timer_fn+0x1be/0x220 Aug 22 12:26:02 juju-e4d256-prod-github-runner-207 kernel: [25336.582671] ? lockup_detector_update_enable+0x60/0x60 Aug 22 12:26:02 juju-e4d256-prod-github-runner-207 kernel: [25336.583729] ? __hrtimer_run_queues+0x107/0x230 Aug 22 12:26:02 juju-e4d256-prod-github-runner-207 kernel: [25336.584795] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 12:26:02 juju-e4d256-prod-github-runner-207 kernel: [25336.585833] ? hrtimer_interrupt+0x101/0x220 Aug 22 12:26:02 juju-e4d256-prod-github-runner-207 kernel: [25336.586857] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 12:26:02 juju-e4d256-prod-github-runner-207 kernel: [25336.588092] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 12:26:02 juju-e4d256-prod-github-runner-207 kernel: [25336.589273] Aug 22 12:26:02 juju-e4d256-prod-github-runner-207 kernel: [25336.590277] Aug 22 12:26:02 juju-e4d256-prod-github-runner-207 kernel: [25336.591197] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 12:26:02 juju-e4d256-prod-github-runner-207 kernel: [25336.592310] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:26:02 juju-e4d256-prod-github-runner-207 kernel: [25336.593466] ? _raw_spin_lock+0x22/0x30 Aug 22 12:26:02 juju-e4d256-prod-github-runner-207 kernel: [25336.594414] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:26:02 juju-e4d256-prod-github-runner-207 kernel: [25336.595435] direct_page_fault+0x206/0x310 [kvm] Aug 22 12:26:02 juju-e4d256-prod-github-runner-207 kernel: [25336.596478] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 12:26:02 juju-e4d256-prod-github-runner-207 kernel: [25336.597599] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 12:26:02 juju-e4d256-prod-github-runner-207 kernel: [25336.598709] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 12:26:02 juju-e4d256-prod-github-runner-207 kernel: [25336.599777] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 12:26:02 juju-e4d256-prod-github-runner-207 kernel: [25336.600841] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 12:26:02 juju-e4d256-prod-github-runner-207 kernel: [25336.601924] handle_exit+0x98/0x230 [kvm_amd] Aug 22 12:26:02 juju-e4d256-prod-github-runner-207 kernel: [25336.602901] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 12:26:02 juju-e4d256-prod-github-runner-207 kernel: [25336.603908] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 12:26:02 juju-e4d256-prod-github-runner-207 kernel: [25336.604939] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 12:26:02 juju-e4d256-prod-github-runner-207 kernel: [25336.605937] vcpu_run+0x62/0x2c0 [kvm] Aug 22 12:26:02 juju-e4d256-prod-github-runner-207 kernel: [25336.606823] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 12:26:02 juju-e4d256-prod-github-runner-207 kernel: [25336.607720] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 12:26:02 juju-e4d256-prod-github-runner-207 kernel: [25336.608680] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 12:26:02 juju-e4d256-prod-github-runner-207 kernel: [25336.609569] ? __seccomp_filter+0x4a/0x4a0 Aug 22 12:26:02 juju-e4d256-prod-github-runner-207 kernel: [25336.610400] ? __fget_files+0x86/0xc0 Aug 22 12:26:02 juju-e4d256-prod-github-runner-207 kernel: [25336.611179] __x64_sys_ioctl+0x95/0xd0 Aug 22 12:26:02 juju-e4d256-prod-github-runner-207 kernel: [25336.611947] do_syscall_64+0x5c/0xc0 Aug 22 12:26:02 juju-e4d256-prod-github-runner-207 kernel: [25336.612703] ? do_futex+0x162/0x1f0 Aug 22 12:26:02 juju-e4d256-prod-github-runner-207 kernel: [25336.613422] ? __x64_sys_futex+0x78/0x1e0 Aug 22 12:26:02 juju-e4d256-prod-github-runner-207 kernel: [25336.614175] ? __secure_computing+0xa9/0x120 Aug 22 12:26:02 juju-e4d256-prod-github-runner-207 kernel: [25336.614985] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 12:26:02 juju-e4d256-prod-github-runner-207 kernel: [25336.615754] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:26:02 juju-e4d256-prod-github-runner-207 kernel: [25336.616498] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:26:02 juju-e4d256-prod-github-runner-207 kernel: [25336.617223] ? do_syscall_64+0x69/0xc0 Aug 22 12:26:02 juju-e4d256-prod-github-runner-207 kernel: [25336.617867] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:26:02 juju-e4d256-prod-github-runner-207 kernel: [25336.618569] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:26:02 juju-e4d256-prod-github-runner-207 kernel: [25336.619262] ? do_syscall_64+0x69/0xc0 Aug 22 12:26:02 juju-e4d256-prod-github-runner-207 kernel: [25336.619889] ? do_syscall_64+0x69/0xc0 Aug 22 12:26:02 juju-e4d256-prod-github-runner-207 kernel: [25336.620594] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 12:26:02 juju-e4d256-prod-github-runner-207 kernel: [25336.621306] RIP: 0033:0x7faa5d0edaff Aug 22 12:26:02 juju-e4d256-prod-github-runner-207 kernel: [25336.621934] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 12:26:02 juju-e4d256-prod-github-runner-207 kernel: [25336.623934] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 12:26:02 juju-e4d256-prod-github-runner-207 kernel: [25336.624859] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 12:26:02 juju-e4d256-prod-github-runner-207 kernel: [25336.625754] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 12:26:02 juju-e4d256-prod-github-runner-207 kernel: [25336.626638] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 12:26:02 juju-e4d256-prod-github-runner-207 kernel: [25336.627535] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 12:26:02 juju-e4d256-prod-github-runner-207 kernel: [25336.628441] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 12:26:02 juju-e4d256-prod-github-runner-207 kernel: [25336.629341] Aug 22 12:26:30 juju-e4d256-prod-github-runner-207 kernel: [25364.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 23514s! [qemu-system-x86:6715] Aug 22 12:26:30 juju-e4d256-prod-github-runner-207 kernel: [25364.543993] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 12:26:30 juju-e4d256-prod-github-runner-207 kernel: [25364.544332] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 12:26:30 juju-e4d256-prod-github-runner-207 kernel: [25364.557302] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 12:26:30 juju-e4d256-prod-github-runner-207 kernel: [25364.558787] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 12:26:30 juju-e4d256-prod-github-runner-207 kernel: [25364.560266] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:26:30 juju-e4d256-prod-github-runner-207 kernel: [25364.561458] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 12:26:30 juju-e4d256-prod-github-runner-207 kernel: [25364.564472] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 12:26:30 juju-e4d256-prod-github-runner-207 kernel: [25364.565672] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 12:26:30 juju-e4d256-prod-github-runner-207 kernel: [25364.566999] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 12:26:30 juju-e4d256-prod-github-runner-207 kernel: [25364.568349] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 12:26:30 juju-e4d256-prod-github-runner-207 kernel: [25364.569674] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 12:26:30 juju-e4d256-prod-github-runner-207 kernel: [25364.571006] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 12:26:30 juju-e4d256-prod-github-runner-207 kernel: [25364.572395] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 12:26:30 juju-e4d256-prod-github-runner-207 kernel: [25364.573835] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 12:26:30 juju-e4d256-prod-github-runner-207 kernel: [25364.575082] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 12:26:30 juju-e4d256-prod-github-runner-207 kernel: [25364.576451] Call Trace: Aug 22 12:26:30 juju-e4d256-prod-github-runner-207 kernel: [25364.577446] Aug 22 12:26:30 juju-e4d256-prod-github-runner-207 kernel: [25364.578405] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:26:30 juju-e4d256-prod-github-runner-207 kernel: [25364.579463] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:26:30 juju-e4d256-prod-github-runner-207 kernel: [25364.580574] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:26:30 juju-e4d256-prod-github-runner-207 kernel: [25364.581734] ? show_regs.part.0+0x23/0x29 Aug 22 12:26:30 juju-e4d256-prod-github-runner-207 kernel: [25364.582991] ? show_regs.cold+0x8/0xd Aug 22 12:26:30 juju-e4d256-prod-github-runner-207 kernel: [25364.584144] ? watchdog_timer_fn+0x1be/0x220 Aug 22 12:26:30 juju-e4d256-prod-github-runner-207 kernel: [25364.585184] ? lockup_detector_update_enable+0x60/0x60 Aug 22 12:26:30 juju-e4d256-prod-github-runner-207 kernel: [25364.586301] ? __hrtimer_run_queues+0x107/0x230 Aug 22 12:26:30 juju-e4d256-prod-github-runner-207 kernel: [25364.587374] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 12:26:30 juju-e4d256-prod-github-runner-207 kernel: [25364.588475] ? hrtimer_interrupt+0x101/0x220 Aug 22 12:26:30 juju-e4d256-prod-github-runner-207 kernel: [25364.589508] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 12:26:30 juju-e4d256-prod-github-runner-207 kernel: [25364.590665] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 12:26:30 juju-e4d256-prod-github-runner-207 kernel: [25364.591850] Aug 22 12:26:30 juju-e4d256-prod-github-runner-207 kernel: [25364.592731] Aug 22 12:26:30 juju-e4d256-prod-github-runner-207 kernel: [25364.593600] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 12:26:30 juju-e4d256-prod-github-runner-207 kernel: [25364.594696] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:26:30 juju-e4d256-prod-github-runner-207 kernel: [25364.595781] ? _raw_spin_lock+0x22/0x30 Aug 22 12:26:30 juju-e4d256-prod-github-runner-207 kernel: [25364.596802] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:26:30 juju-e4d256-prod-github-runner-207 kernel: [25364.597905] direct_page_fault+0x206/0x310 [kvm] Aug 22 12:26:30 juju-e4d256-prod-github-runner-207 kernel: [25364.598958] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 12:26:30 juju-e4d256-prod-github-runner-207 kernel: [25364.600036] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 12:26:30 juju-e4d256-prod-github-runner-207 kernel: [25364.601085] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 12:26:30 juju-e4d256-prod-github-runner-207 kernel: [25364.602143] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 12:26:30 juju-e4d256-prod-github-runner-207 kernel: [25364.603143] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 12:26:30 juju-e4d256-prod-github-runner-207 kernel: [25364.604161] handle_exit+0x98/0x230 [kvm_amd] Aug 22 12:26:30 juju-e4d256-prod-github-runner-207 kernel: [25364.605057] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 12:26:30 juju-e4d256-prod-github-runner-207 kernel: [25364.605974] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 12:26:30 juju-e4d256-prod-github-runner-207 kernel: [25364.606899] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 12:26:30 juju-e4d256-prod-github-runner-207 kernel: [25364.607818] vcpu_run+0x62/0x2c0 [kvm] Aug 22 12:26:30 juju-e4d256-prod-github-runner-207 kernel: [25364.608662] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 12:26:30 juju-e4d256-prod-github-runner-207 kernel: [25364.609495] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 12:26:30 juju-e4d256-prod-github-runner-207 kernel: [25364.610376] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 12:26:30 juju-e4d256-prod-github-runner-207 kernel: [25364.611224] ? __seccomp_filter+0x4a/0x4a0 Aug 22 12:26:30 juju-e4d256-prod-github-runner-207 kernel: [25364.611992] ? __fget_files+0x86/0xc0 Aug 22 12:26:30 juju-e4d256-prod-github-runner-207 kernel: [25364.612700] __x64_sys_ioctl+0x95/0xd0 Aug 22 12:26:30 juju-e4d256-prod-github-runner-207 kernel: [25364.613395] do_syscall_64+0x5c/0xc0 Aug 22 12:26:30 juju-e4d256-prod-github-runner-207 kernel: [25364.614061] ? do_futex+0x162/0x1f0 Aug 22 12:26:30 juju-e4d256-prod-github-runner-207 kernel: [25364.614709] ? __x64_sys_futex+0x78/0x1e0 Aug 22 12:26:30 juju-e4d256-prod-github-runner-207 kernel: [25364.615383] ? __secure_computing+0xa9/0x120 Aug 22 12:26:30 juju-e4d256-prod-github-runner-207 kernel: [25364.616099] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 12:26:30 juju-e4d256-prod-github-runner-207 kernel: [25364.616864] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:26:30 juju-e4d256-prod-github-runner-207 kernel: [25364.617591] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:26:30 juju-e4d256-prod-github-runner-207 kernel: [25364.618312] ? do_syscall_64+0x69/0xc0 Aug 22 12:26:30 juju-e4d256-prod-github-runner-207 kernel: [25364.618959] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:26:30 juju-e4d256-prod-github-runner-207 kernel: [25364.619709] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:26:30 juju-e4d256-prod-github-runner-207 kernel: [25364.620428] ? do_syscall_64+0x69/0xc0 Aug 22 12:26:30 juju-e4d256-prod-github-runner-207 kernel: [25364.621063] ? do_syscall_64+0x69/0xc0 Aug 22 12:26:30 juju-e4d256-prod-github-runner-207 kernel: [25364.621689] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 12:26:30 juju-e4d256-prod-github-runner-207 kernel: [25364.622402] RIP: 0033:0x7faa5d0edaff Aug 22 12:26:30 juju-e4d256-prod-github-runner-207 kernel: [25364.623063] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 12:26:30 juju-e4d256-prod-github-runner-207 kernel: [25364.625074] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 12:26:30 juju-e4d256-prod-github-runner-207 kernel: [25364.625988] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 12:26:30 juju-e4d256-prod-github-runner-207 kernel: [25364.626879] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 12:26:30 juju-e4d256-prod-github-runner-207 kernel: [25364.627793] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 12:26:30 juju-e4d256-prod-github-runner-207 kernel: [25364.628688] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 12:26:30 juju-e4d256-prod-github-runner-207 kernel: [25364.629580] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 12:26:30 juju-e4d256-prod-github-runner-207 kernel: [25364.630489] Aug 22 12:26:44 juju-e4d256-prod-github-runner-207 kernel: [25378.880707] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 12:26:44 juju-e4d256-prod-github-runner-207 kernel: [25378.881705] rcu: 1-....: (6295720 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=3046667 Aug 22 12:26:44 juju-e4d256-prod-github-runner-207 kernel: [25378.882885] (t=6315420 jiffies g=23269 q=30054) Aug 22 12:26:44 juju-e4d256-prod-github-runner-207 kernel: [25378.883721] NMI backtrace for cpu 1 Aug 22 12:26:44 juju-e4d256-prod-github-runner-207 kernel: [25378.884493] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 12:26:44 juju-e4d256-prod-github-runner-207 kernel: [25378.885677] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 12:26:44 juju-e4d256-prod-github-runner-207 kernel: [25378.886772] Call Trace: Aug 22 12:26:44 juju-e4d256-prod-github-runner-207 kernel: [25378.887456] Aug 22 12:26:44 juju-e4d256-prod-github-runner-207 kernel: [25378.888129] show_stack+0x52/0x5c Aug 22 12:26:44 juju-e4d256-prod-github-runner-207 kernel: [25378.888870] dump_stack_lvl+0x4a/0x63 Aug 22 12:26:44 juju-e4d256-prod-github-runner-207 kernel: [25378.889747] dump_stack+0x10/0x16 Aug 22 12:26:44 juju-e4d256-prod-github-runner-207 kernel: [25378.890514] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 12:26:44 juju-e4d256-prod-github-runner-207 kernel: [25378.891368] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 12:26:44 juju-e4d256-prod-github-runner-207 kernel: [25378.892215] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 12:26:44 juju-e4d256-prod-github-runner-207 kernel: [25378.893036] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 12:26:44 juju-e4d256-prod-github-runner-207 kernel: [25378.893854] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 12:26:44 juju-e4d256-prod-github-runner-207 kernel: [25378.894684] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 12:26:44 juju-e4d256-prod-github-runner-207 kernel: [25378.895496] print_cpu_stall.cold+0x2f/0xe2 Aug 22 12:26:44 juju-e4d256-prod-github-runner-207 kernel: [25378.896319] ? timekeeping_update+0xf7/0x150 Aug 22 12:26:44 juju-e4d256-prod-github-runner-207 kernel: [25378.897124] check_cpu_stall+0x109/0x270 Aug 22 12:26:44 juju-e4d256-prod-github-runner-207 kernel: [25378.897872] rcu_sched_clock_irq+0x9a/0x250 Aug 22 12:26:44 juju-e4d256-prod-github-runner-207 kernel: [25378.898651] update_process_times+0x94/0xd0 Aug 22 12:26:44 juju-e4d256-prod-github-runner-207 kernel: [25378.899422] tick_sched_handle+0x29/0x70 Aug 22 12:26:44 juju-e4d256-prod-github-runner-207 kernel: [25378.900247] tick_sched_timer+0x8c/0xc0 Aug 22 12:26:44 juju-e4d256-prod-github-runner-207 kernel: [25378.901071] ? tick_nohz_handler+0xb0/0xb0 Aug 22 12:26:44 juju-e4d256-prod-github-runner-207 kernel: [25378.901919] __hrtimer_run_queues+0x107/0x230 Aug 22 12:26:44 juju-e4d256-prod-github-runner-207 kernel: [25378.902715] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 12:26:44 juju-e4d256-prod-github-runner-207 kernel: [25378.903493] hrtimer_interrupt+0x101/0x220 Aug 22 12:26:44 juju-e4d256-prod-github-runner-207 kernel: [25378.904274] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 12:26:44 juju-e4d256-prod-github-runner-207 kernel: [25378.905101] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 12:26:44 juju-e4d256-prod-github-runner-207 kernel: [25378.905942] Aug 22 12:26:44 juju-e4d256-prod-github-runner-207 kernel: [25378.906608] Aug 22 12:26:44 juju-e4d256-prod-github-runner-207 kernel: [25378.907378] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 12:26:44 juju-e4d256-prod-github-runner-207 kernel: [25378.908233] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:26:44 juju-e4d256-prod-github-runner-207 kernel: [25378.909118] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 12:26:44 juju-e4d256-prod-github-runner-207 kernel: [25378.911439] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 12:26:44 juju-e4d256-prod-github-runner-207 kernel: [25378.912363] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 12:26:44 juju-e4d256-prod-github-runner-207 kernel: [25378.913382] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 12:26:44 juju-e4d256-prod-github-runner-207 kernel: [25378.914365] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 12:26:44 juju-e4d256-prod-github-runner-207 kernel: [25378.915330] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 12:26:44 juju-e4d256-prod-github-runner-207 kernel: [25378.916330] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 12:26:44 juju-e4d256-prod-github-runner-207 kernel: [25378.917347] ? _raw_spin_lock+0x22/0x30 Aug 22 12:26:44 juju-e4d256-prod-github-runner-207 kernel: [25378.918129] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:26:44 juju-e4d256-prod-github-runner-207 kernel: [25378.918973] direct_page_fault+0x206/0x310 [kvm] Aug 22 12:26:44 juju-e4d256-prod-github-runner-207 kernel: [25378.919827] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 12:26:44 juju-e4d256-prod-github-runner-207 kernel: [25378.920700] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 12:26:44 juju-e4d256-prod-github-runner-207 kernel: [25378.921550] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 12:26:44 juju-e4d256-prod-github-runner-207 kernel: [25378.922430] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 12:26:44 juju-e4d256-prod-github-runner-207 kernel: [25378.923250] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 12:26:44 juju-e4d256-prod-github-runner-207 kernel: [25378.924105] handle_exit+0x98/0x230 [kvm_amd] Aug 22 12:26:44 juju-e4d256-prod-github-runner-207 kernel: [25378.924868] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 12:26:44 juju-e4d256-prod-github-runner-207 kernel: [25378.925665] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 12:26:44 juju-e4d256-prod-github-runner-207 kernel: [25378.926630] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 12:26:44 juju-e4d256-prod-github-runner-207 kernel: [25378.927656] vcpu_run+0x62/0x2c0 [kvm] Aug 22 12:26:44 juju-e4d256-prod-github-runner-207 kernel: [25378.928395] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 12:26:44 juju-e4d256-prod-github-runner-207 kernel: [25378.929140] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 12:26:44 juju-e4d256-prod-github-runner-207 kernel: [25378.929954] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 12:26:44 juju-e4d256-prod-github-runner-207 kernel: [25378.930715] ? __seccomp_filter+0x4a/0x4a0 Aug 22 12:26:44 juju-e4d256-prod-github-runner-207 kernel: [25378.931465] ? __fget_files+0x86/0xc0 Aug 22 12:26:44 juju-e4d256-prod-github-runner-207 kernel: [25378.932237] __x64_sys_ioctl+0x95/0xd0 Aug 22 12:26:44 juju-e4d256-prod-github-runner-207 kernel: [25378.932960] do_syscall_64+0x5c/0xc0 Aug 22 12:26:44 juju-e4d256-prod-github-runner-207 kernel: [25378.933663] ? do_futex+0x162/0x1f0 Aug 22 12:26:44 juju-e4d256-prod-github-runner-207 kernel: [25378.934348] ? __x64_sys_futex+0x78/0x1e0 Aug 22 12:26:44 juju-e4d256-prod-github-runner-207 kernel: [25378.935056] ? __secure_computing+0xa9/0x120 Aug 22 12:26:44 juju-e4d256-prod-github-runner-207 kernel: [25378.935810] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 12:26:44 juju-e4d256-prod-github-runner-207 kernel: [25378.936658] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:26:44 juju-e4d256-prod-github-runner-207 kernel: [25378.937471] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:26:44 juju-e4d256-prod-github-runner-207 kernel: [25378.938269] ? do_syscall_64+0x69/0xc0 Aug 22 12:26:44 juju-e4d256-prod-github-runner-207 kernel: [25378.938996] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:26:44 juju-e4d256-prod-github-runner-207 kernel: [25378.939774] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:26:44 juju-e4d256-prod-github-runner-207 kernel: [25378.940541] ? do_syscall_64+0x69/0xc0 Aug 22 12:26:44 juju-e4d256-prod-github-runner-207 kernel: [25378.941265] ? do_syscall_64+0x69/0xc0 Aug 22 12:26:44 juju-e4d256-prod-github-runner-207 kernel: [25378.941989] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 12:26:44 juju-e4d256-prod-github-runner-207 kernel: [25378.942824] RIP: 0033:0x7faa5d0edaff Aug 22 12:26:44 juju-e4d256-prod-github-runner-207 kernel: [25378.943580] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 12:26:44 juju-e4d256-prod-github-runner-207 kernel: [25378.945715] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 12:26:44 juju-e4d256-prod-github-runner-207 kernel: [25378.946696] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 12:26:44 juju-e4d256-prod-github-runner-207 kernel: [25378.947718] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 12:26:44 juju-e4d256-prod-github-runner-207 kernel: [25378.948712] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 12:26:44 juju-e4d256-prod-github-runner-207 kernel: [25378.949664] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 12:26:44 juju-e4d256-prod-github-runner-207 kernel: [25378.950593] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 12:26:44 juju-e4d256-prod-github-runner-207 kernel: [25378.951531] Aug 22 12:27:10 juju-e4d256-prod-github-runner-207 kernel: [25404.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 23551s! [qemu-system-x86:6715] Aug 22 12:27:10 juju-e4d256-prod-github-runner-207 kernel: [25404.543134] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 12:27:10 juju-e4d256-prod-github-runner-207 kernel: [25404.543208] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 12:27:10 juju-e4d256-prod-github-runner-207 kernel: [25404.555395] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 12:27:10 juju-e4d256-prod-github-runner-207 kernel: [25404.556656] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 12:27:10 juju-e4d256-prod-github-runner-207 kernel: [25404.557910] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:27:10 juju-e4d256-prod-github-runner-207 kernel: [25404.558977] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 12:27:10 juju-e4d256-prod-github-runner-207 kernel: [25404.561571] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 12:27:10 juju-e4d256-prod-github-runner-207 kernel: [25404.562623] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 12:27:10 juju-e4d256-prod-github-runner-207 kernel: [25404.563824] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 12:27:10 juju-e4d256-prod-github-runner-207 kernel: [25404.564983] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 12:27:10 juju-e4d256-prod-github-runner-207 kernel: [25404.566163] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 12:27:10 juju-e4d256-prod-github-runner-207 kernel: [25404.567423] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 12:27:10 juju-e4d256-prod-github-runner-207 kernel: [25404.568606] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 12:27:10 juju-e4d256-prod-github-runner-207 kernel: [25404.569858] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 12:27:10 juju-e4d256-prod-github-runner-207 kernel: [25404.570960] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 12:27:10 juju-e4d256-prod-github-runner-207 kernel: [25404.572218] Call Trace: Aug 22 12:27:10 juju-e4d256-prod-github-runner-207 kernel: [25404.573232] Aug 22 12:27:10 juju-e4d256-prod-github-runner-207 kernel: [25404.574186] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:27:10 juju-e4d256-prod-github-runner-207 kernel: [25404.575346] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:27:10 juju-e4d256-prod-github-runner-207 kernel: [25404.576461] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:27:10 juju-e4d256-prod-github-runner-207 kernel: [25404.577631] ? show_regs.part.0+0x23/0x29 Aug 22 12:27:10 juju-e4d256-prod-github-runner-207 kernel: [25404.578706] ? show_regs.cold+0x8/0xd Aug 22 12:27:10 juju-e4d256-prod-github-runner-207 kernel: [25404.579774] ? watchdog_timer_fn+0x1be/0x220 Aug 22 12:27:10 juju-e4d256-prod-github-runner-207 kernel: [25404.580876] ? lockup_detector_update_enable+0x60/0x60 Aug 22 12:27:10 juju-e4d256-prod-github-runner-207 kernel: [25404.582036] ? __hrtimer_run_queues+0x107/0x230 Aug 22 12:27:10 juju-e4d256-prod-github-runner-207 kernel: [25404.583153] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 12:27:10 juju-e4d256-prod-github-runner-207 kernel: [25404.584277] ? hrtimer_interrupt+0x101/0x220 Aug 22 12:27:10 juju-e4d256-prod-github-runner-207 kernel: [25404.585382] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 12:27:10 juju-e4d256-prod-github-runner-207 kernel: [25404.586551] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 12:27:10 juju-e4d256-prod-github-runner-207 kernel: [25404.587711] Aug 22 12:27:10 juju-e4d256-prod-github-runner-207 kernel: [25404.588608] Aug 22 12:27:10 juju-e4d256-prod-github-runner-207 kernel: [25404.589498] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 12:27:10 juju-e4d256-prod-github-runner-207 kernel: [25404.590656] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:27:10 juju-e4d256-prod-github-runner-207 kernel: [25404.591839] ? _raw_spin_lock+0x22/0x30 Aug 22 12:27:10 juju-e4d256-prod-github-runner-207 kernel: [25404.592871] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:27:10 juju-e4d256-prod-github-runner-207 kernel: [25404.593973] direct_page_fault+0x206/0x310 [kvm] Aug 22 12:27:10 juju-e4d256-prod-github-runner-207 kernel: [25404.595083] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 12:27:10 juju-e4d256-prod-github-runner-207 kernel: [25404.596269] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 12:27:10 juju-e4d256-prod-github-runner-207 kernel: [25404.597376] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 12:27:10 juju-e4d256-prod-github-runner-207 kernel: [25404.598444] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 12:27:10 juju-e4d256-prod-github-runner-207 kernel: [25404.599508] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 12:27:10 juju-e4d256-prod-github-runner-207 kernel: [25404.600599] handle_exit+0x98/0x230 [kvm_amd] Aug 22 12:27:10 juju-e4d256-prod-github-runner-207 kernel: [25404.601590] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 12:27:10 juju-e4d256-prod-github-runner-207 kernel: [25404.602600] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 12:27:10 juju-e4d256-prod-github-runner-207 kernel: [25404.603636] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 12:27:10 juju-e4d256-prod-github-runner-207 kernel: [25404.604644] vcpu_run+0x62/0x2c0 [kvm] Aug 22 12:27:10 juju-e4d256-prod-github-runner-207 kernel: [25404.605531] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 12:27:10 juju-e4d256-prod-github-runner-207 kernel: [25404.606433] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 12:27:10 juju-e4d256-prod-github-runner-207 kernel: [25404.607405] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 12:27:10 juju-e4d256-prod-github-runner-207 kernel: [25404.608287] ? __seccomp_filter+0x4a/0x4a0 Aug 22 12:27:10 juju-e4d256-prod-github-runner-207 kernel: [25404.609107] ? __fget_files+0x86/0xc0 Aug 22 12:27:10 juju-e4d256-prod-github-runner-207 kernel: [25404.609885] __x64_sys_ioctl+0x95/0xd0 Aug 22 12:27:10 juju-e4d256-prod-github-runner-207 kernel: [25404.610651] do_syscall_64+0x5c/0xc0 Aug 22 12:27:10 juju-e4d256-prod-github-runner-207 kernel: [25404.611408] ? do_futex+0x162/0x1f0 Aug 22 12:27:10 juju-e4d256-prod-github-runner-207 kernel: [25404.612130] ? __x64_sys_futex+0x78/0x1e0 Aug 22 12:27:10 juju-e4d256-prod-github-runner-207 kernel: [25404.612883] ? __secure_computing+0xa9/0x120 Aug 22 12:27:10 juju-e4d256-prod-github-runner-207 kernel: [25404.613669] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 12:27:10 juju-e4d256-prod-github-runner-207 kernel: [25404.614537] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:27:10 juju-e4d256-prod-github-runner-207 kernel: [25404.615375] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:27:10 juju-e4d256-prod-github-runner-207 kernel: [25404.616192] ? do_syscall_64+0x69/0xc0 Aug 22 12:27:10 juju-e4d256-prod-github-runner-207 kernel: [25404.616910] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:27:10 juju-e4d256-prod-github-runner-207 kernel: [25404.617709] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:27:10 juju-e4d256-prod-github-runner-207 kernel: [25404.618496] ? do_syscall_64+0x69/0xc0 Aug 22 12:27:10 juju-e4d256-prod-github-runner-207 kernel: [25404.619194] ? do_syscall_64+0x69/0xc0 Aug 22 12:27:10 juju-e4d256-prod-github-runner-207 kernel: [25404.619904] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 12:27:10 juju-e4d256-prod-github-runner-207 kernel: [25404.620714] RIP: 0033:0x7faa5d0edaff Aug 22 12:27:10 juju-e4d256-prod-github-runner-207 kernel: [25404.621415] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 12:27:10 juju-e4d256-prod-github-runner-207 kernel: [25404.623779] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 12:27:10 juju-e4d256-prod-github-runner-207 kernel: [25404.625012] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 12:27:10 juju-e4d256-prod-github-runner-207 kernel: [25404.626050] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 12:27:10 juju-e4d256-prod-github-runner-207 kernel: [25404.627102] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 12:27:10 juju-e4d256-prod-github-runner-207 kernel: [25404.628133] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 12:27:10 juju-e4d256-prod-github-runner-207 kernel: [25404.629153] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 12:27:10 juju-e4d256-prod-github-runner-207 kernel: [25404.630184] Aug 22 12:27:38 juju-e4d256-prod-github-runner-207 kernel: [25432.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 23577s! [qemu-system-x86:6715] Aug 22 12:27:38 juju-e4d256-prod-github-runner-207 kernel: [25432.543135] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 12:27:38 juju-e4d256-prod-github-runner-207 kernel: [25432.543209] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 12:27:38 juju-e4d256-prod-github-runner-207 kernel: [25432.555322] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 12:27:38 juju-e4d256-prod-github-runner-207 kernel: [25432.556591] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 12:27:38 juju-e4d256-prod-github-runner-207 kernel: [25432.557818] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:27:38 juju-e4d256-prod-github-runner-207 kernel: [25432.558878] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 12:27:38 juju-e4d256-prod-github-runner-207 kernel: [25432.561442] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 12:27:38 juju-e4d256-prod-github-runner-207 kernel: [25432.562509] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 12:27:38 juju-e4d256-prod-github-runner-207 kernel: [25432.563694] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 12:27:38 juju-e4d256-prod-github-runner-207 kernel: [25432.564853] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 12:27:38 juju-e4d256-prod-github-runner-207 kernel: [25432.566035] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 12:27:38 juju-e4d256-prod-github-runner-207 kernel: [25432.567221] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 12:27:38 juju-e4d256-prod-github-runner-207 kernel: [25432.568393] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 12:27:38 juju-e4d256-prod-github-runner-207 kernel: [25432.569627] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 12:27:38 juju-e4d256-prod-github-runner-207 kernel: [25432.570743] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 12:27:38 juju-e4d256-prod-github-runner-207 kernel: [25432.571957] Call Trace: Aug 22 12:27:38 juju-e4d256-prod-github-runner-207 kernel: [25432.572866] Aug 22 12:27:38 juju-e4d256-prod-github-runner-207 kernel: [25432.573747] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:27:38 juju-e4d256-prod-github-runner-207 kernel: [25432.574902] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:27:38 juju-e4d256-prod-github-runner-207 kernel: [25432.576069] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:27:38 juju-e4d256-prod-github-runner-207 kernel: [25432.577246] ? show_regs.part.0+0x23/0x29 Aug 22 12:27:38 juju-e4d256-prod-github-runner-207 kernel: [25432.578324] ? show_regs.cold+0x8/0xd Aug 22 12:27:38 juju-e4d256-prod-github-runner-207 kernel: [25432.579395] ? watchdog_timer_fn+0x1be/0x220 Aug 22 12:27:38 juju-e4d256-prod-github-runner-207 kernel: [25432.580494] ? lockup_detector_update_enable+0x60/0x60 Aug 22 12:27:38 juju-e4d256-prod-github-runner-207 kernel: [25432.581656] ? __hrtimer_run_queues+0x107/0x230 Aug 22 12:27:38 juju-e4d256-prod-github-runner-207 kernel: [25432.582777] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 12:27:38 juju-e4d256-prod-github-runner-207 kernel: [25432.583903] ? hrtimer_interrupt+0x101/0x220 Aug 22 12:27:38 juju-e4d256-prod-github-runner-207 kernel: [25432.585001] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 12:27:38 juju-e4d256-prod-github-runner-207 kernel: [25432.586191] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 12:27:38 juju-e4d256-prod-github-runner-207 kernel: [25432.587370] Aug 22 12:27:38 juju-e4d256-prod-github-runner-207 kernel: [25432.588273] Aug 22 12:27:38 juju-e4d256-prod-github-runner-207 kernel: [25432.589165] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 12:27:38 juju-e4d256-prod-github-runner-207 kernel: [25432.590302] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:27:38 juju-e4d256-prod-github-runner-207 kernel: [25432.591465] ? _raw_spin_lock+0x22/0x30 Aug 22 12:27:38 juju-e4d256-prod-github-runner-207 kernel: [25432.592489] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:27:38 juju-e4d256-prod-github-runner-207 kernel: [25432.593603] direct_page_fault+0x206/0x310 [kvm] Aug 22 12:27:38 juju-e4d256-prod-github-runner-207 kernel: [25432.594716] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 12:27:38 juju-e4d256-prod-github-runner-207 kernel: [25432.595861] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 12:27:38 juju-e4d256-prod-github-runner-207 kernel: [25432.596966] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 12:27:38 juju-e4d256-prod-github-runner-207 kernel: [25432.598053] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 12:27:38 juju-e4d256-prod-github-runner-207 kernel: [25432.599108] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 12:27:38 juju-e4d256-prod-github-runner-207 kernel: [25432.600192] handle_exit+0x98/0x230 [kvm_amd] Aug 22 12:27:38 juju-e4d256-prod-github-runner-207 kernel: [25432.601221] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 12:27:38 juju-e4d256-prod-github-runner-207 kernel: [25432.602247] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 12:27:38 juju-e4d256-prod-github-runner-207 kernel: [25432.603319] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 12:27:38 juju-e4d256-prod-github-runner-207 kernel: [25432.604335] vcpu_run+0x62/0x2c0 [kvm] Aug 22 12:27:38 juju-e4d256-prod-github-runner-207 kernel: [25432.605231] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 12:27:38 juju-e4d256-prod-github-runner-207 kernel: [25432.606130] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 12:27:38 juju-e4d256-prod-github-runner-207 kernel: [25432.607096] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 12:27:38 juju-e4d256-prod-github-runner-207 kernel: [25432.607984] ? __seccomp_filter+0x4a/0x4a0 Aug 22 12:27:38 juju-e4d256-prod-github-runner-207 kernel: [25432.608807] ? __fget_files+0x86/0xc0 Aug 22 12:27:38 juju-e4d256-prod-github-runner-207 kernel: [25432.609585] __x64_sys_ioctl+0x95/0xd0 Aug 22 12:27:38 juju-e4d256-prod-github-runner-207 kernel: [25432.610351] do_syscall_64+0x5c/0xc0 Aug 22 12:27:38 juju-e4d256-prod-github-runner-207 kernel: [25432.611106] ? do_futex+0x162/0x1f0 Aug 22 12:27:38 juju-e4d256-prod-github-runner-207 kernel: [25432.611828] ? __x64_sys_futex+0x78/0x1e0 Aug 22 12:27:38 juju-e4d256-prod-github-runner-207 kernel: [25432.612580] ? __secure_computing+0xa9/0x120 Aug 22 12:27:38 juju-e4d256-prod-github-runner-207 kernel: [25432.613354] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 12:27:38 juju-e4d256-prod-github-runner-207 kernel: [25432.614224] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:27:38 juju-e4d256-prod-github-runner-207 kernel: [25432.615057] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:27:38 juju-e4d256-prod-github-runner-207 kernel: [25432.615871] ? do_syscall_64+0x69/0xc0 Aug 22 12:27:38 juju-e4d256-prod-github-runner-207 kernel: [25432.616592] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:27:38 juju-e4d256-prod-github-runner-207 kernel: [25432.617402] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:27:38 juju-e4d256-prod-github-runner-207 kernel: [25432.618193] ? do_syscall_64+0x69/0xc0 Aug 22 12:27:38 juju-e4d256-prod-github-runner-207 kernel: [25432.618893] ? do_syscall_64+0x69/0xc0 Aug 22 12:27:38 juju-e4d256-prod-github-runner-207 kernel: [25432.619599] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 12:27:38 juju-e4d256-prod-github-runner-207 kernel: [25432.620407] RIP: 0033:0x7faa5d0edaff Aug 22 12:27:38 juju-e4d256-prod-github-runner-207 kernel: [25432.621105] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 12:27:38 juju-e4d256-prod-github-runner-207 kernel: [25432.623436] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 12:27:38 juju-e4d256-prod-github-runner-207 kernel: [25432.624486] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 12:27:38 juju-e4d256-prod-github-runner-207 kernel: [25432.625505] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 12:27:38 juju-e4d256-prod-github-runner-207 kernel: [25432.626560] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 12:27:38 juju-e4d256-prod-github-runner-207 kernel: [25432.627634] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 12:27:38 juju-e4d256-prod-github-runner-207 kernel: [25432.628662] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 12:27:38 juju-e4d256-prod-github-runner-207 kernel: [25432.629692] Aug 22 12:28:06 juju-e4d256-prod-github-runner-207 kernel: [25460.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 23603s! [qemu-system-x86:6715] Aug 22 12:28:06 juju-e4d256-prod-github-runner-207 kernel: [25460.543939] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 12:28:06 juju-e4d256-prod-github-runner-207 kernel: [25460.544254] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 12:28:06 juju-e4d256-prod-github-runner-207 kernel: [25460.557003] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 12:28:06 juju-e4d256-prod-github-runner-207 kernel: [25460.558290] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 12:28:06 juju-e4d256-prod-github-runner-207 kernel: [25460.559538] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:28:06 juju-e4d256-prod-github-runner-207 kernel: [25460.560597] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 12:28:06 juju-e4d256-prod-github-runner-207 kernel: [25460.563143] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 12:28:06 juju-e4d256-prod-github-runner-207 kernel: [25460.564196] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 12:28:06 juju-e4d256-prod-github-runner-207 kernel: [25460.565354] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 12:28:06 juju-e4d256-prod-github-runner-207 kernel: [25460.566517] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 12:28:06 juju-e4d256-prod-github-runner-207 kernel: [25460.567685] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 12:28:06 juju-e4d256-prod-github-runner-207 kernel: [25460.568910] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 12:28:06 juju-e4d256-prod-github-runner-207 kernel: [25460.570095] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 12:28:06 juju-e4d256-prod-github-runner-207 kernel: [25460.571372] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 12:28:06 juju-e4d256-prod-github-runner-207 kernel: [25460.572479] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 12:28:06 juju-e4d256-prod-github-runner-207 kernel: [25460.573677] Call Trace: Aug 22 12:28:06 juju-e4d256-prod-github-runner-207 kernel: [25460.574619] Aug 22 12:28:06 juju-e4d256-prod-github-runner-207 kernel: [25460.575536] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:28:06 juju-e4d256-prod-github-runner-207 kernel: [25460.576577] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:28:06 juju-e4d256-prod-github-runner-207 kernel: [25460.577609] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:28:06 juju-e4d256-prod-github-runner-207 kernel: [25460.578729] ? show_regs.part.0+0x23/0x29 Aug 22 12:28:06 juju-e4d256-prod-github-runner-207 kernel: [25460.579730] ? show_regs.cold+0x8/0xd Aug 22 12:28:06 juju-e4d256-prod-github-runner-207 kernel: [25460.580700] ? watchdog_timer_fn+0x1be/0x220 Aug 22 12:28:06 juju-e4d256-prod-github-runner-207 kernel: [25460.581705] ? lockup_detector_update_enable+0x60/0x60 Aug 22 12:28:06 juju-e4d256-prod-github-runner-207 kernel: [25460.582822] ? __hrtimer_run_queues+0x107/0x230 Aug 22 12:28:06 juju-e4d256-prod-github-runner-207 kernel: [25460.583859] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 12:28:06 juju-e4d256-prod-github-runner-207 kernel: [25460.584888] ? hrtimer_interrupt+0x101/0x220 Aug 22 12:28:06 juju-e4d256-prod-github-runner-207 kernel: [25460.585903] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 12:28:06 juju-e4d256-prod-github-runner-207 kernel: [25460.586996] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 12:28:06 juju-e4d256-prod-github-runner-207 kernel: [25460.588048] Aug 22 12:28:06 juju-e4d256-prod-github-runner-207 kernel: [25460.588900] Aug 22 12:28:06 juju-e4d256-prod-github-runner-207 kernel: [25460.589736] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 12:28:06 juju-e4d256-prod-github-runner-207 kernel: [25460.590780] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:28:06 juju-e4d256-prod-github-runner-207 kernel: [25460.591825] ? _raw_spin_lock+0x22/0x30 Aug 22 12:28:06 juju-e4d256-prod-github-runner-207 kernel: [25460.592772] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:28:06 juju-e4d256-prod-github-runner-207 kernel: [25460.593789] direct_page_fault+0x206/0x310 [kvm] Aug 22 12:28:06 juju-e4d256-prod-github-runner-207 kernel: [25460.594819] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 12:28:06 juju-e4d256-prod-github-runner-207 kernel: [25460.595845] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 12:28:06 juju-e4d256-prod-github-runner-207 kernel: [25460.596853] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 12:28:06 juju-e4d256-prod-github-runner-207 kernel: [25460.597852] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 12:28:06 juju-e4d256-prod-github-runner-207 kernel: [25460.598825] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 12:28:06 juju-e4d256-prod-github-runner-207 kernel: [25460.599818] handle_exit+0x98/0x230 [kvm_amd] Aug 22 12:28:06 juju-e4d256-prod-github-runner-207 kernel: [25460.600717] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 12:28:06 juju-e4d256-prod-github-runner-207 kernel: [25460.601646] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 12:28:06 juju-e4d256-prod-github-runner-207 kernel: [25460.602601] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 12:28:06 juju-e4d256-prod-github-runner-207 kernel: [25460.603503] vcpu_run+0x62/0x2c0 [kvm] Aug 22 12:28:06 juju-e4d256-prod-github-runner-207 kernel: [25460.604312] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 12:28:06 juju-e4d256-prod-github-runner-207 kernel: [25460.605117] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 12:28:06 juju-e4d256-prod-github-runner-207 kernel: [25460.605978] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 12:28:06 juju-e4d256-prod-github-runner-207 kernel: [25460.606788] ? __seccomp_filter+0x4a/0x4a0 Aug 22 12:28:06 juju-e4d256-prod-github-runner-207 kernel: [25460.607556] ? __fget_files+0x86/0xc0 Aug 22 12:28:06 juju-e4d256-prod-github-runner-207 kernel: [25460.608259] __x64_sys_ioctl+0x95/0xd0 Aug 22 12:28:06 juju-e4d256-prod-github-runner-207 kernel: [25460.608949] do_syscall_64+0x5c/0xc0 Aug 22 12:28:06 juju-e4d256-prod-github-runner-207 kernel: [25460.609609] ? do_futex+0x162/0x1f0 Aug 22 12:28:06 juju-e4d256-prod-github-runner-207 kernel: [25460.610259] ? __x64_sys_futex+0x78/0x1e0 Aug 22 12:28:06 juju-e4d256-prod-github-runner-207 kernel: [25460.610946] ? __secure_computing+0xa9/0x120 Aug 22 12:28:06 juju-e4d256-prod-github-runner-207 kernel: [25460.611635] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 12:28:06 juju-e4d256-prod-github-runner-207 kernel: [25460.612391] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:28:06 juju-e4d256-prod-github-runner-207 kernel: [25460.613114] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:28:06 juju-e4d256-prod-github-runner-207 kernel: [25460.613828] ? do_syscall_64+0x69/0xc0 Aug 22 12:28:06 juju-e4d256-prod-github-runner-207 kernel: [25460.614475] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:28:06 juju-e4d256-prod-github-runner-207 kernel: [25460.615193] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:28:06 juju-e4d256-prod-github-runner-207 kernel: [25460.615901] ? do_syscall_64+0x69/0xc0 Aug 22 12:28:06 juju-e4d256-prod-github-runner-207 kernel: [25460.616524] ? do_syscall_64+0x69/0xc0 Aug 22 12:28:06 juju-e4d256-prod-github-runner-207 kernel: [25460.617143] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 12:28:06 juju-e4d256-prod-github-runner-207 kernel: [25460.617854] RIP: 0033:0x7faa5d0edaff Aug 22 12:28:06 juju-e4d256-prod-github-runner-207 kernel: [25460.618528] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 12:28:06 juju-e4d256-prod-github-runner-207 kernel: [25460.620555] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 12:28:06 juju-e4d256-prod-github-runner-207 kernel: [25460.621462] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 12:28:06 juju-e4d256-prod-github-runner-207 kernel: [25460.622348] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 12:28:06 juju-e4d256-prod-github-runner-207 kernel: [25460.623247] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 12:28:06 juju-e4d256-prod-github-runner-207 kernel: [25460.624133] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 12:28:06 juju-e4d256-prod-github-runner-207 kernel: [25460.625019] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 12:28:06 juju-e4d256-prod-github-runner-207 kernel: [25460.625915] Aug 22 12:28:34 juju-e4d256-prod-github-runner-207 kernel: [25488.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 23630s! [qemu-system-x86:6715] Aug 22 12:28:34 juju-e4d256-prod-github-runner-207 kernel: [25488.543124] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 12:28:34 juju-e4d256-prod-github-runner-207 kernel: [25488.543203] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 12:28:34 juju-e4d256-prod-github-runner-207 kernel: [25488.555454] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 12:28:34 juju-e4d256-prod-github-runner-207 kernel: [25488.556715] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 12:28:34 juju-e4d256-prod-github-runner-207 kernel: [25488.557960] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:28:34 juju-e4d256-prod-github-runner-207 kernel: [25488.559070] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 12:28:34 juju-e4d256-prod-github-runner-207 kernel: [25488.561615] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 12:28:34 juju-e4d256-prod-github-runner-207 kernel: [25488.562688] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 12:28:34 juju-e4d256-prod-github-runner-207 kernel: [25488.563858] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 12:28:34 juju-e4d256-prod-github-runner-207 kernel: [25488.565016] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 12:28:34 juju-e4d256-prod-github-runner-207 kernel: [25488.566212] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 12:28:34 juju-e4d256-prod-github-runner-207 kernel: [25488.567376] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 12:28:34 juju-e4d256-prod-github-runner-207 kernel: [25488.568561] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 12:28:34 juju-e4d256-prod-github-runner-207 kernel: [25488.569835] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 12:28:34 juju-e4d256-prod-github-runner-207 kernel: [25488.570940] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 12:28:34 juju-e4d256-prod-github-runner-207 kernel: [25488.572136] Call Trace: Aug 22 12:28:34 juju-e4d256-prod-github-runner-207 kernel: [25488.573053] Aug 22 12:28:34 juju-e4d256-prod-github-runner-207 kernel: [25488.573936] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:28:34 juju-e4d256-prod-github-runner-207 kernel: [25488.574984] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:28:34 juju-e4d256-prod-github-runner-207 kernel: [25488.576026] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:28:34 juju-e4d256-prod-github-runner-207 kernel: [25488.577102] ? show_regs.part.0+0x23/0x29 Aug 22 12:28:34 juju-e4d256-prod-github-runner-207 kernel: [25488.578100] ? show_regs.cold+0x8/0xd Aug 22 12:28:34 juju-e4d256-prod-github-runner-207 kernel: [25488.579094] ? watchdog_timer_fn+0x1be/0x220 Aug 22 12:28:34 juju-e4d256-prod-github-runner-207 kernel: [25488.580147] ? lockup_detector_update_enable+0x60/0x60 Aug 22 12:28:34 juju-e4d256-prod-github-runner-207 kernel: [25488.581221] ? __hrtimer_run_queues+0x107/0x230 Aug 22 12:28:34 juju-e4d256-prod-github-runner-207 kernel: [25488.582257] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 12:28:34 juju-e4d256-prod-github-runner-207 kernel: [25488.583315] ? hrtimer_interrupt+0x101/0x220 Aug 22 12:28:34 juju-e4d256-prod-github-runner-207 kernel: [25488.584357] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 12:28:34 juju-e4d256-prod-github-runner-207 kernel: [25488.585444] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 12:28:34 juju-e4d256-prod-github-runner-207 kernel: [25488.586504] Aug 22 12:28:34 juju-e4d256-prod-github-runner-207 kernel: [25488.587360] Aug 22 12:28:34 juju-e4d256-prod-github-runner-207 kernel: [25488.588195] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 12:28:34 juju-e4d256-prod-github-runner-207 kernel: [25488.589226] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:28:34 juju-e4d256-prod-github-runner-207 kernel: [25488.590305] ? _raw_spin_lock+0x22/0x30 Aug 22 12:28:34 juju-e4d256-prod-github-runner-207 kernel: [25488.591272] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:28:34 juju-e4d256-prod-github-runner-207 kernel: [25488.592289] direct_page_fault+0x206/0x310 [kvm] Aug 22 12:28:34 juju-e4d256-prod-github-runner-207 kernel: [25488.593312] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 12:28:34 juju-e4d256-prod-github-runner-207 kernel: [25488.594345] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 12:28:34 juju-e4d256-prod-github-runner-207 kernel: [25488.595374] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 12:28:34 juju-e4d256-prod-github-runner-207 kernel: [25488.596347] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 12:28:34 juju-e4d256-prod-github-runner-207 kernel: [25488.597291] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 12:28:34 juju-e4d256-prod-github-runner-207 kernel: [25488.598280] handle_exit+0x98/0x230 [kvm_amd] Aug 22 12:28:34 juju-e4d256-prod-github-runner-207 kernel: [25488.599177] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 12:28:34 juju-e4d256-prod-github-runner-207 kernel: [25488.600100] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 12:28:34 juju-e4d256-prod-github-runner-207 kernel: [25488.601032] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 12:28:34 juju-e4d256-prod-github-runner-207 kernel: [25488.601937] vcpu_run+0x62/0x2c0 [kvm] Aug 22 12:28:34 juju-e4d256-prod-github-runner-207 kernel: [25488.602760] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 12:28:34 juju-e4d256-prod-github-runner-207 kernel: [25488.603607] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 12:28:34 juju-e4d256-prod-github-runner-207 kernel: [25488.604479] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 12:28:34 juju-e4d256-prod-github-runner-207 kernel: [25488.605287] ? __seccomp_filter+0x4a/0x4a0 Aug 22 12:28:34 juju-e4d256-prod-github-runner-207 kernel: [25488.606032] ? __fget_files+0x86/0xc0 Aug 22 12:28:34 juju-e4d256-prod-github-runner-207 kernel: [25488.606766] __x64_sys_ioctl+0x95/0xd0 Aug 22 12:28:34 juju-e4d256-prod-github-runner-207 kernel: [25488.607458] do_syscall_64+0x5c/0xc0 Aug 22 12:28:34 juju-e4d256-prod-github-runner-207 kernel: [25488.608123] ? do_futex+0x162/0x1f0 Aug 22 12:28:34 juju-e4d256-prod-github-runner-207 kernel: [25488.608770] ? __x64_sys_futex+0x78/0x1e0 Aug 22 12:28:34 juju-e4d256-prod-github-runner-207 kernel: [25488.609447] ? __secure_computing+0xa9/0x120 Aug 22 12:28:34 juju-e4d256-prod-github-runner-207 kernel: [25488.610137] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 12:28:34 juju-e4d256-prod-github-runner-207 kernel: [25488.610915] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:28:34 juju-e4d256-prod-github-runner-207 kernel: [25488.611636] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:28:34 juju-e4d256-prod-github-runner-207 kernel: [25488.612357] ? do_syscall_64+0x69/0xc0 Aug 22 12:28:34 juju-e4d256-prod-github-runner-207 kernel: [25488.613000] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:28:34 juju-e4d256-prod-github-runner-207 kernel: [25488.613708] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:28:34 juju-e4d256-prod-github-runner-207 kernel: [25488.614413] ? do_syscall_64+0x69/0xc0 Aug 22 12:28:34 juju-e4d256-prod-github-runner-207 kernel: [25488.615039] ? do_syscall_64+0x69/0xc0 Aug 22 12:28:34 juju-e4d256-prod-github-runner-207 kernel: [25488.615702] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 12:28:34 juju-e4d256-prod-github-runner-207 kernel: [25488.616416] RIP: 0033:0x7faa5d0edaff Aug 22 12:28:34 juju-e4d256-prod-github-runner-207 kernel: [25488.617065] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 12:28:34 juju-e4d256-prod-github-runner-207 kernel: [25488.619089] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 12:28:34 juju-e4d256-prod-github-runner-207 kernel: [25488.620020] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 12:28:34 juju-e4d256-prod-github-runner-207 kernel: [25488.620926] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 12:28:34 juju-e4d256-prod-github-runner-207 kernel: [25488.621819] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 12:28:34 juju-e4d256-prod-github-runner-207 kernel: [25488.622732] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 12:28:34 juju-e4d256-prod-github-runner-207 kernel: [25488.623643] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 12:28:34 juju-e4d256-prod-github-runner-207 kernel: [25488.624537] Aug 22 12:29:02 juju-e4d256-prod-github-runner-207 kernel: [25516.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 23656s! [qemu-system-x86:6715] Aug 22 12:29:02 juju-e4d256-prod-github-runner-207 kernel: [25516.543114] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 12:29:02 juju-e4d256-prod-github-runner-207 kernel: [25516.543190] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 12:29:02 juju-e4d256-prod-github-runner-207 kernel: [25516.555564] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 12:29:02 juju-e4d256-prod-github-runner-207 kernel: [25516.556852] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 12:29:02 juju-e4d256-prod-github-runner-207 kernel: [25516.558104] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:29:02 juju-e4d256-prod-github-runner-207 kernel: [25516.559172] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 12:29:02 juju-e4d256-prod-github-runner-207 kernel: [25516.561724] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 12:29:02 juju-e4d256-prod-github-runner-207 kernel: [25516.562804] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 12:29:02 juju-e4d256-prod-github-runner-207 kernel: [25516.563968] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 12:29:02 juju-e4d256-prod-github-runner-207 kernel: [25516.565182] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 12:29:02 juju-e4d256-prod-github-runner-207 kernel: [25516.566370] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 12:29:02 juju-e4d256-prod-github-runner-207 kernel: [25516.567534] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 12:29:02 juju-e4d256-prod-github-runner-207 kernel: [25516.568702] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 12:29:02 juju-e4d256-prod-github-runner-207 kernel: [25516.569960] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 12:29:02 juju-e4d256-prod-github-runner-207 kernel: [25516.571061] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 12:29:02 juju-e4d256-prod-github-runner-207 kernel: [25516.572279] Call Trace: Aug 22 12:29:02 juju-e4d256-prod-github-runner-207 kernel: [25516.573212] Aug 22 12:29:02 juju-e4d256-prod-github-runner-207 kernel: [25516.574139] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:29:02 juju-e4d256-prod-github-runner-207 kernel: [25516.575310] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:29:02 juju-e4d256-prod-github-runner-207 kernel: [25516.576337] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:29:02 juju-e4d256-prod-github-runner-207 kernel: [25516.577417] ? show_regs.part.0+0x23/0x29 Aug 22 12:29:02 juju-e4d256-prod-github-runner-207 kernel: [25516.578428] ? show_regs.cold+0x8/0xd Aug 22 12:29:02 juju-e4d256-prod-github-runner-207 kernel: [25516.579408] ? watchdog_timer_fn+0x1be/0x220 Aug 22 12:29:02 juju-e4d256-prod-github-runner-207 kernel: [25516.580414] ? lockup_detector_update_enable+0x60/0x60 Aug 22 12:29:02 juju-e4d256-prod-github-runner-207 kernel: [25516.581511] ? __hrtimer_run_queues+0x107/0x230 Aug 22 12:29:02 juju-e4d256-prod-github-runner-207 kernel: [25516.582559] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 12:29:02 juju-e4d256-prod-github-runner-207 kernel: [25516.583581] ? hrtimer_interrupt+0x101/0x220 Aug 22 12:29:02 juju-e4d256-prod-github-runner-207 kernel: [25516.584597] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 12:29:02 juju-e4d256-prod-github-runner-207 kernel: [25516.585704] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 12:29:02 juju-e4d256-prod-github-runner-207 kernel: [25516.586776] Aug 22 12:29:02 juju-e4d256-prod-github-runner-207 kernel: [25516.587640] Aug 22 12:29:02 juju-e4d256-prod-github-runner-207 kernel: [25516.588475] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 12:29:02 juju-e4d256-prod-github-runner-207 kernel: [25516.589503] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:29:02 juju-e4d256-prod-github-runner-207 kernel: [25516.590566] ? _raw_spin_lock+0x22/0x30 Aug 22 12:29:02 juju-e4d256-prod-github-runner-207 kernel: [25516.591522] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:29:02 juju-e4d256-prod-github-runner-207 kernel: [25516.592541] direct_page_fault+0x206/0x310 [kvm] Aug 22 12:29:02 juju-e4d256-prod-github-runner-207 kernel: [25516.593564] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 12:29:02 juju-e4d256-prod-github-runner-207 kernel: [25516.594634] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 12:29:02 juju-e4d256-prod-github-runner-207 kernel: [25516.595637] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 12:29:02 juju-e4d256-prod-github-runner-207 kernel: [25516.596609] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 12:29:02 juju-e4d256-prod-github-runner-207 kernel: [25516.597551] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 12:29:02 juju-e4d256-prod-github-runner-207 kernel: [25516.598543] handle_exit+0x98/0x230 [kvm_amd] Aug 22 12:29:02 juju-e4d256-prod-github-runner-207 kernel: [25516.599433] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 12:29:02 juju-e4d256-prod-github-runner-207 kernel: [25516.600372] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 12:29:02 juju-e4d256-prod-github-runner-207 kernel: [25516.601300] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 12:29:02 juju-e4d256-prod-github-runner-207 kernel: [25516.602213] vcpu_run+0x62/0x2c0 [kvm] Aug 22 12:29:02 juju-e4d256-prod-github-runner-207 kernel: [25516.603023] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 12:29:02 juju-e4d256-prod-github-runner-207 kernel: [25516.603834] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 12:29:02 juju-e4d256-prod-github-runner-207 kernel: [25516.604691] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 12:29:02 juju-e4d256-prod-github-runner-207 kernel: [25516.605487] ? __seccomp_filter+0x4a/0x4a0 Aug 22 12:29:02 juju-e4d256-prod-github-runner-207 kernel: [25516.606255] ? __fget_files+0x86/0xc0 Aug 22 12:29:02 juju-e4d256-prod-github-runner-207 kernel: [25516.606965] __x64_sys_ioctl+0x95/0xd0 Aug 22 12:29:02 juju-e4d256-prod-github-runner-207 kernel: [25516.607661] do_syscall_64+0x5c/0xc0 Aug 22 12:29:02 juju-e4d256-prod-github-runner-207 kernel: [25516.608324] ? do_futex+0x162/0x1f0 Aug 22 12:29:02 juju-e4d256-prod-github-runner-207 kernel: [25516.608978] ? __x64_sys_futex+0x78/0x1e0 Aug 22 12:29:02 juju-e4d256-prod-github-runner-207 kernel: [25516.609656] ? __secure_computing+0xa9/0x120 Aug 22 12:29:02 juju-e4d256-prod-github-runner-207 kernel: [25516.610354] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 12:29:02 juju-e4d256-prod-github-runner-207 kernel: [25516.611137] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:29:02 juju-e4d256-prod-github-runner-207 kernel: [25516.611860] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:29:02 juju-e4d256-prod-github-runner-207 kernel: [25516.612577] ? do_syscall_64+0x69/0xc0 Aug 22 12:29:02 juju-e4d256-prod-github-runner-207 kernel: [25516.613386] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:29:02 juju-e4d256-prod-github-runner-207 kernel: [25516.614110] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:29:02 juju-e4d256-prod-github-runner-207 kernel: [25516.614802] ? do_syscall_64+0x69/0xc0 Aug 22 12:29:02 juju-e4d256-prod-github-runner-207 kernel: [25516.615425] ? do_syscall_64+0x69/0xc0 Aug 22 12:29:02 juju-e4d256-prod-github-runner-207 kernel: [25516.616047] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 12:29:02 juju-e4d256-prod-github-runner-207 kernel: [25516.616754] RIP: 0033:0x7faa5d0edaff Aug 22 12:29:02 juju-e4d256-prod-github-runner-207 kernel: [25516.617377] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 12:29:02 juju-e4d256-prod-github-runner-207 kernel: [25516.619368] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 12:29:02 juju-e4d256-prod-github-runner-207 kernel: [25516.620280] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 12:29:02 juju-e4d256-prod-github-runner-207 kernel: [25516.621170] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 12:29:02 juju-e4d256-prod-github-runner-207 kernel: [25516.622079] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 12:29:02 juju-e4d256-prod-github-runner-207 kernel: [25516.622963] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 12:29:02 juju-e4d256-prod-github-runner-207 kernel: [25516.623852] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 12:29:02 juju-e4d256-prod-github-runner-207 kernel: [25516.624740] Aug 22 12:29:30 juju-e4d256-prod-github-runner-207 kernel: [25544.541976] watchdog: BUG: soft lockup - CPU#1 stuck for 23682s! [qemu-system-x86:6715] Aug 22 12:29:30 juju-e4d256-prod-github-runner-207 kernel: [25544.543138] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 12:29:30 juju-e4d256-prod-github-runner-207 kernel: [25544.543210] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 12:29:30 juju-e4d256-prod-github-runner-207 kernel: [25544.556289] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 12:29:30 juju-e4d256-prod-github-runner-207 kernel: [25544.557587] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 12:29:30 juju-e4d256-prod-github-runner-207 kernel: [25544.558823] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:29:30 juju-e4d256-prod-github-runner-207 kernel: [25544.559888] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 12:29:30 juju-e4d256-prod-github-runner-207 kernel: [25544.562484] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 12:29:30 juju-e4d256-prod-github-runner-207 kernel: [25544.563556] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 12:29:30 juju-e4d256-prod-github-runner-207 kernel: [25544.564730] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 12:29:30 juju-e4d256-prod-github-runner-207 kernel: [25544.565926] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 12:29:30 juju-e4d256-prod-github-runner-207 kernel: [25544.567151] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 12:29:30 juju-e4d256-prod-github-runner-207 kernel: [25544.568320] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 12:29:30 juju-e4d256-prod-github-runner-207 kernel: [25544.569568] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 12:29:30 juju-e4d256-prod-github-runner-207 kernel: [25544.570836] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 12:29:30 juju-e4d256-prod-github-runner-207 kernel: [25544.571940] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 12:29:30 juju-e4d256-prod-github-runner-207 kernel: [25544.573162] Call Trace: Aug 22 12:29:30 juju-e4d256-prod-github-runner-207 kernel: [25544.574140] Aug 22 12:29:30 juju-e4d256-prod-github-runner-207 kernel: [25544.575049] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:29:30 juju-e4d256-prod-github-runner-207 kernel: [25544.576101] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:29:30 juju-e4d256-prod-github-runner-207 kernel: [25544.577157] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:29:30 juju-e4d256-prod-github-runner-207 kernel: [25544.578281] ? show_regs.part.0+0x23/0x29 Aug 22 12:29:30 juju-e4d256-prod-github-runner-207 kernel: [25544.579290] ? show_regs.cold+0x8/0xd Aug 22 12:29:30 juju-e4d256-prod-github-runner-207 kernel: [25544.580268] ? watchdog_timer_fn+0x1be/0x220 Aug 22 12:29:30 juju-e4d256-prod-github-runner-207 kernel: [25544.581284] ? lockup_detector_update_enable+0x60/0x60 Aug 22 12:29:30 juju-e4d256-prod-github-runner-207 kernel: [25544.582408] ? __hrtimer_run_queues+0x107/0x230 Aug 22 12:29:30 juju-e4d256-prod-github-runner-207 kernel: [25544.583468] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 12:29:30 juju-e4d256-prod-github-runner-207 kernel: [25544.584537] ? hrtimer_interrupt+0x101/0x220 Aug 22 12:29:30 juju-e4d256-prod-github-runner-207 kernel: [25544.585582] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 12:29:30 juju-e4d256-prod-github-runner-207 kernel: [25544.586703] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 12:29:30 juju-e4d256-prod-github-runner-207 kernel: [25544.587773] Aug 22 12:29:30 juju-e4d256-prod-github-runner-207 kernel: [25544.588782] Aug 22 12:29:30 juju-e4d256-prod-github-runner-207 kernel: [25544.589633] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 12:29:30 juju-e4d256-prod-github-runner-207 kernel: [25544.590693] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:29:30 juju-e4d256-prod-github-runner-207 kernel: [25544.591742] ? _raw_spin_lock+0x22/0x30 Aug 22 12:29:30 juju-e4d256-prod-github-runner-207 kernel: [25544.592699] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:29:30 juju-e4d256-prod-github-runner-207 kernel: [25544.593736] direct_page_fault+0x206/0x310 [kvm] Aug 22 12:29:30 juju-e4d256-prod-github-runner-207 kernel: [25544.594778] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 12:29:30 juju-e4d256-prod-github-runner-207 kernel: [25544.595792] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 12:29:30 juju-e4d256-prod-github-runner-207 kernel: [25544.596824] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 12:29:30 juju-e4d256-prod-github-runner-207 kernel: [25544.597845] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 12:29:30 juju-e4d256-prod-github-runner-207 kernel: [25544.598865] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 12:29:30 juju-e4d256-prod-github-runner-207 kernel: [25544.599873] handle_exit+0x98/0x230 [kvm_amd] Aug 22 12:29:30 juju-e4d256-prod-github-runner-207 kernel: [25544.600775] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 12:29:30 juju-e4d256-prod-github-runner-207 kernel: [25544.601723] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 12:29:30 juju-e4d256-prod-github-runner-207 kernel: [25544.602661] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 12:29:30 juju-e4d256-prod-github-runner-207 kernel: [25544.603578] vcpu_run+0x62/0x2c0 [kvm] Aug 22 12:29:30 juju-e4d256-prod-github-runner-207 kernel: [25544.604402] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 12:29:30 juju-e4d256-prod-github-runner-207 kernel: [25544.605238] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 12:29:30 juju-e4d256-prod-github-runner-207 kernel: [25544.606126] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 12:29:30 juju-e4d256-prod-github-runner-207 kernel: [25544.606935] ? __seccomp_filter+0x4a/0x4a0 Aug 22 12:29:30 juju-e4d256-prod-github-runner-207 kernel: [25544.607685] ? __fget_files+0x86/0xc0 Aug 22 12:29:30 juju-e4d256-prod-github-runner-207 kernel: [25544.608395] __x64_sys_ioctl+0x95/0xd0 Aug 22 12:29:30 juju-e4d256-prod-github-runner-207 kernel: [25544.609120] do_syscall_64+0x5c/0xc0 Aug 22 12:29:30 juju-e4d256-prod-github-runner-207 kernel: [25544.609812] ? do_futex+0x162/0x1f0 Aug 22 12:29:30 juju-e4d256-prod-github-runner-207 kernel: [25544.610467] ? __x64_sys_futex+0x78/0x1e0 Aug 22 12:29:30 juju-e4d256-prod-github-runner-207 kernel: [25544.611152] ? __secure_computing+0xa9/0x120 Aug 22 12:29:30 juju-e4d256-prod-github-runner-207 kernel: [25544.611849] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 12:29:30 juju-e4d256-prod-github-runner-207 kernel: [25544.612619] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:29:30 juju-e4d256-prod-github-runner-207 kernel: [25544.613391] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:29:30 juju-e4d256-prod-github-runner-207 kernel: [25544.614182] ? do_syscall_64+0x69/0xc0 Aug 22 12:29:30 juju-e4d256-prod-github-runner-207 kernel: [25544.614939] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:29:30 juju-e4d256-prod-github-runner-207 kernel: [25544.615763] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:29:30 juju-e4d256-prod-github-runner-207 kernel: [25544.616499] ? do_syscall_64+0x69/0xc0 Aug 22 12:29:30 juju-e4d256-prod-github-runner-207 kernel: [25544.617176] ? do_syscall_64+0x69/0xc0 Aug 22 12:29:30 juju-e4d256-prod-github-runner-207 kernel: [25544.617849] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 12:29:30 juju-e4d256-prod-github-runner-207 kernel: [25544.618571] RIP: 0033:0x7faa5d0edaff Aug 22 12:29:30 juju-e4d256-prod-github-runner-207 kernel: [25544.619203] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 12:29:30 juju-e4d256-prod-github-runner-207 kernel: [25544.621245] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 12:29:30 juju-e4d256-prod-github-runner-207 kernel: [25544.622196] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 12:29:30 juju-e4d256-prod-github-runner-207 kernel: [25544.623102] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 12:29:30 juju-e4d256-prod-github-runner-207 kernel: [25544.624020] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 12:29:30 juju-e4d256-prod-github-runner-207 kernel: [25544.624940] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 12:29:30 juju-e4d256-prod-github-runner-207 kernel: [25544.625886] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 12:29:30 juju-e4d256-prod-github-runner-207 kernel: [25544.626798] Aug 22 12:29:44 juju-e4d256-prod-github-runner-207 kernel: [25558.892708] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 12:29:44 juju-e4d256-prod-github-runner-207 kernel: [25558.894400] rcu: 1-....: (6340585 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=3068268 Aug 22 12:29:44 juju-e4d256-prod-github-runner-207 kernel: [25558.895542] (t=6360423 jiffies g=23269 q=30198) Aug 22 12:29:44 juju-e4d256-prod-github-runner-207 kernel: [25558.896327] NMI backtrace for cpu 1 Aug 22 12:29:44 juju-e4d256-prod-github-runner-207 kernel: [25558.897032] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 12:29:44 juju-e4d256-prod-github-runner-207 kernel: [25558.898143] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 12:29:44 juju-e4d256-prod-github-runner-207 kernel: [25558.899194] Call Trace: Aug 22 12:29:44 juju-e4d256-prod-github-runner-207 kernel: [25558.899875] Aug 22 12:29:44 juju-e4d256-prod-github-runner-207 kernel: [25558.900532] show_stack+0x52/0x5c Aug 22 12:29:44 juju-e4d256-prod-github-runner-207 kernel: [25558.901263] dump_stack_lvl+0x4a/0x63 Aug 22 12:29:44 juju-e4d256-prod-github-runner-207 kernel: [25558.902038] dump_stack+0x10/0x16 Aug 22 12:29:44 juju-e4d256-prod-github-runner-207 kernel: [25558.902755] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 12:29:44 juju-e4d256-prod-github-runner-207 kernel: [25558.903536] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 12:29:44 juju-e4d256-prod-github-runner-207 kernel: [25558.904326] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 12:29:44 juju-e4d256-prod-github-runner-207 kernel: [25558.905166] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 12:29:44 juju-e4d256-prod-github-runner-207 kernel: [25558.906042] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 12:29:44 juju-e4d256-prod-github-runner-207 kernel: [25558.906875] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 12:29:44 juju-e4d256-prod-github-runner-207 kernel: [25558.907657] print_cpu_stall.cold+0x2f/0xe2 Aug 22 12:29:44 juju-e4d256-prod-github-runner-207 kernel: [25558.908428] ? timekeeping_update+0xf7/0x150 Aug 22 12:29:44 juju-e4d256-prod-github-runner-207 kernel: [25558.909206] check_cpu_stall+0x109/0x270 Aug 22 12:29:44 juju-e4d256-prod-github-runner-207 kernel: [25558.909972] rcu_sched_clock_irq+0x9a/0x250 Aug 22 12:29:44 juju-e4d256-prod-github-runner-207 kernel: [25558.910730] update_process_times+0x94/0xd0 Aug 22 12:29:44 juju-e4d256-prod-github-runner-207 kernel: [25558.911492] tick_sched_handle+0x29/0x70 Aug 22 12:29:44 juju-e4d256-prod-github-runner-207 kernel: [25558.912477] tick_sched_timer+0x8c/0xc0 Aug 22 12:29:44 juju-e4d256-prod-github-runner-207 kernel: [25558.913539] ? tick_nohz_handler+0xb0/0xb0 Aug 22 12:29:44 juju-e4d256-prod-github-runner-207 kernel: [25558.914556] __hrtimer_run_queues+0x107/0x230 Aug 22 12:29:44 juju-e4d256-prod-github-runner-207 kernel: [25558.915638] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 12:29:44 juju-e4d256-prod-github-runner-207 kernel: [25558.916710] hrtimer_interrupt+0x101/0x220 Aug 22 12:29:44 juju-e4d256-prod-github-runner-207 kernel: [25558.917771] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 12:29:44 juju-e4d256-prod-github-runner-207 kernel: [25558.918899] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 12:29:44 juju-e4d256-prod-github-runner-207 kernel: [25558.919994] Aug 22 12:29:44 juju-e4d256-prod-github-runner-207 kernel: [25558.920868] Aug 22 12:29:44 juju-e4d256-prod-github-runner-207 kernel: [25558.921746] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 12:29:44 juju-e4d256-prod-github-runner-207 kernel: [25558.922849] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:29:44 juju-e4d256-prod-github-runner-207 kernel: [25558.924082] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 12:29:44 juju-e4d256-prod-github-runner-207 kernel: [25558.926543] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 12:29:44 juju-e4d256-prod-github-runner-207 kernel: [25558.927428] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 12:29:44 juju-e4d256-prod-github-runner-207 kernel: [25558.928419] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 12:29:44 juju-e4d256-prod-github-runner-207 kernel: [25558.929406] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 12:29:44 juju-e4d256-prod-github-runner-207 kernel: [25558.930368] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 12:29:44 juju-e4d256-prod-github-runner-207 kernel: [25558.931365] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 12:29:44 juju-e4d256-prod-github-runner-207 kernel: [25558.932317] ? _raw_spin_lock+0x22/0x30 Aug 22 12:29:44 juju-e4d256-prod-github-runner-207 kernel: [25558.933080] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:29:44 juju-e4d256-prod-github-runner-207 kernel: [25558.933923] direct_page_fault+0x206/0x310 [kvm] Aug 22 12:29:44 juju-e4d256-prod-github-runner-207 kernel: [25558.934759] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 12:29:44 juju-e4d256-prod-github-runner-207 kernel: [25558.935583] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 12:29:44 juju-e4d256-prod-github-runner-207 kernel: [25558.936403] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 12:29:44 juju-e4d256-prod-github-runner-207 kernel: [25558.937233] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 12:29:44 juju-e4d256-prod-github-runner-207 kernel: [25558.938035] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 12:29:44 juju-e4d256-prod-github-runner-207 kernel: [25558.938855] handle_exit+0x98/0x230 [kvm_amd] Aug 22 12:29:44 juju-e4d256-prod-github-runner-207 kernel: [25558.939613] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 12:29:44 juju-e4d256-prod-github-runner-207 kernel: [25558.940408] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 12:29:44 juju-e4d256-prod-github-runner-207 kernel: [25558.941210] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 12:29:44 juju-e4d256-prod-github-runner-207 kernel: [25558.942003] vcpu_run+0x62/0x2c0 [kvm] Aug 22 12:29:44 juju-e4d256-prod-github-runner-207 kernel: [25558.942717] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 12:29:44 juju-e4d256-prod-github-runner-207 kernel: [25558.943452] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 12:29:44 juju-e4d256-prod-github-runner-207 kernel: [25558.944255] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 12:29:44 juju-e4d256-prod-github-runner-207 kernel: [25558.945022] ? __seccomp_filter+0x4a/0x4a0 Aug 22 12:29:44 juju-e4d256-prod-github-runner-207 kernel: [25558.945749] ? __fget_files+0x86/0xc0 Aug 22 12:29:44 juju-e4d256-prod-github-runner-207 kernel: [25558.946501] __x64_sys_ioctl+0x95/0xd0 Aug 22 12:29:44 juju-e4d256-prod-github-runner-207 kernel: [25558.947237] do_syscall_64+0x5c/0xc0 Aug 22 12:29:44 juju-e4d256-prod-github-runner-207 kernel: [25558.947946] ? do_futex+0x162/0x1f0 Aug 22 12:29:44 juju-e4d256-prod-github-runner-207 kernel: [25558.948658] ? __x64_sys_futex+0x78/0x1e0 Aug 22 12:29:44 juju-e4d256-prod-github-runner-207 kernel: [25558.949392] ? __secure_computing+0xa9/0x120 Aug 22 12:29:44 juju-e4d256-prod-github-runner-207 kernel: [25558.950112] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 12:29:44 juju-e4d256-prod-github-runner-207 kernel: [25558.950970] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:29:44 juju-e4d256-prod-github-runner-207 kernel: [25558.951741] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:29:44 juju-e4d256-prod-github-runner-207 kernel: [25558.952498] ? do_syscall_64+0x69/0xc0 Aug 22 12:29:44 juju-e4d256-prod-github-runner-207 kernel: [25558.953193] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:29:44 juju-e4d256-prod-github-runner-207 kernel: [25558.953960] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:29:44 juju-e4d256-prod-github-runner-207 kernel: [25558.954718] ? do_syscall_64+0x69/0xc0 Aug 22 12:29:44 juju-e4d256-prod-github-runner-207 kernel: [25558.955417] ? do_syscall_64+0x69/0xc0 Aug 22 12:29:44 juju-e4d256-prod-github-runner-207 kernel: [25558.956103] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 12:29:44 juju-e4d256-prod-github-runner-207 kernel: [25558.956872] RIP: 0033:0x7faa5d0edaff Aug 22 12:29:44 juju-e4d256-prod-github-runner-207 kernel: [25558.957600] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 12:29:44 juju-e4d256-prod-github-runner-207 kernel: [25558.959697] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 12:29:44 juju-e4d256-prod-github-runner-207 kernel: [25558.960667] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 12:29:44 juju-e4d256-prod-github-runner-207 kernel: [25558.961621] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 12:29:44 juju-e4d256-prod-github-runner-207 kernel: [25558.962567] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 12:29:44 juju-e4d256-prod-github-runner-207 kernel: [25558.963505] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 12:29:44 juju-e4d256-prod-github-runner-207 kernel: [25558.964431] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 12:29:44 juju-e4d256-prod-github-runner-207 kernel: [25558.965358] Aug 22 12:30:10 juju-e4d256-prod-github-runner-207 kernel: [25584.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 23719s! [qemu-system-x86:6715] Aug 22 12:30:10 juju-e4d256-prod-github-runner-207 kernel: [25584.543097] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 12:30:10 juju-e4d256-prod-github-runner-207 kernel: [25584.543456] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 12:30:10 juju-e4d256-prod-github-runner-207 kernel: [25584.555603] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 12:30:10 juju-e4d256-prod-github-runner-207 kernel: [25584.556875] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 12:30:10 juju-e4d256-prod-github-runner-207 kernel: [25584.558253] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:30:10 juju-e4d256-prod-github-runner-207 kernel: [25584.559335] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 12:30:10 juju-e4d256-prod-github-runner-207 kernel: [25584.562087] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 12:30:10 juju-e4d256-prod-github-runner-207 kernel: [25584.563142] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 12:30:10 juju-e4d256-prod-github-runner-207 kernel: [25584.564312] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 12:30:10 juju-e4d256-prod-github-runner-207 kernel: [25584.565491] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 12:30:10 juju-e4d256-prod-github-runner-207 kernel: [25584.566652] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 12:30:10 juju-e4d256-prod-github-runner-207 kernel: [25584.567813] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 12:30:10 juju-e4d256-prod-github-runner-207 kernel: [25584.568996] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 12:30:10 juju-e4d256-prod-github-runner-207 kernel: [25584.570363] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 12:30:10 juju-e4d256-prod-github-runner-207 kernel: [25584.571465] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 12:30:10 juju-e4d256-prod-github-runner-207 kernel: [25584.572661] Call Trace: Aug 22 12:30:10 juju-e4d256-prod-github-runner-207 kernel: [25584.573588] Aug 22 12:30:10 juju-e4d256-prod-github-runner-207 kernel: [25584.574472] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:30:10 juju-e4d256-prod-github-runner-207 kernel: [25584.575502] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:30:10 juju-e4d256-prod-github-runner-207 kernel: [25584.576530] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:30:10 juju-e4d256-prod-github-runner-207 kernel: [25584.577631] ? show_regs.part.0+0x23/0x29 Aug 22 12:30:10 juju-e4d256-prod-github-runner-207 kernel: [25584.578627] ? show_regs.cold+0x8/0xd Aug 22 12:30:10 juju-e4d256-prod-github-runner-207 kernel: [25584.579730] ? watchdog_timer_fn+0x1be/0x220 Aug 22 12:30:10 juju-e4d256-prod-github-runner-207 kernel: [25584.580856] ? lockup_detector_update_enable+0x60/0x60 Aug 22 12:30:10 juju-e4d256-prod-github-runner-207 kernel: [25584.582060] ? __hrtimer_run_queues+0x107/0x230 Aug 22 12:30:10 juju-e4d256-prod-github-runner-207 kernel: [25584.583193] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 12:30:10 juju-e4d256-prod-github-runner-207 kernel: [25584.584317] ? hrtimer_interrupt+0x101/0x220 Aug 22 12:30:10 juju-e4d256-prod-github-runner-207 kernel: [25584.585438] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 12:30:10 juju-e4d256-prod-github-runner-207 kernel: [25584.586608] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 12:30:10 juju-e4d256-prod-github-runner-207 kernel: [25584.587746] Aug 22 12:30:10 juju-e4d256-prod-github-runner-207 kernel: [25584.588650] Aug 22 12:30:10 juju-e4d256-prod-github-runner-207 kernel: [25584.589544] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 12:30:10 juju-e4d256-prod-github-runner-207 kernel: [25584.590693] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:30:10 juju-e4d256-prod-github-runner-207 kernel: [25584.591849] ? _raw_spin_lock+0x22/0x30 Aug 22 12:30:10 juju-e4d256-prod-github-runner-207 kernel: [25584.592871] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:30:10 juju-e4d256-prod-github-runner-207 kernel: [25584.593937] direct_page_fault+0x206/0x310 [kvm] Aug 22 12:30:10 juju-e4d256-prod-github-runner-207 kernel: [25584.594961] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 12:30:10 juju-e4d256-prod-github-runner-207 kernel: [25584.595969] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 12:30:10 juju-e4d256-prod-github-runner-207 kernel: [25584.596969] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 12:30:10 juju-e4d256-prod-github-runner-207 kernel: [25584.597973] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 12:30:10 juju-e4d256-prod-github-runner-207 kernel: [25584.598931] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 12:30:10 juju-e4d256-prod-github-runner-207 kernel: [25584.599927] handle_exit+0x98/0x230 [kvm_amd] Aug 22 12:30:10 juju-e4d256-prod-github-runner-207 kernel: [25584.600821] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 12:30:10 juju-e4d256-prod-github-runner-207 kernel: [25584.601798] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 12:30:10 juju-e4d256-prod-github-runner-207 kernel: [25584.602734] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 12:30:10 juju-e4d256-prod-github-runner-207 kernel: [25584.603638] vcpu_run+0x62/0x2c0 [kvm] Aug 22 12:30:10 juju-e4d256-prod-github-runner-207 kernel: [25584.604449] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 12:30:10 juju-e4d256-prod-github-runner-207 kernel: [25584.605280] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 12:30:10 juju-e4d256-prod-github-runner-207 kernel: [25584.606137] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 12:30:10 juju-e4d256-prod-github-runner-207 kernel: [25584.606935] ? __seccomp_filter+0x4a/0x4a0 Aug 22 12:30:10 juju-e4d256-prod-github-runner-207 kernel: [25584.607679] ? __fget_files+0x86/0xc0 Aug 22 12:30:10 juju-e4d256-prod-github-runner-207 kernel: [25584.608388] __x64_sys_ioctl+0x95/0xd0 Aug 22 12:30:10 juju-e4d256-prod-github-runner-207 kernel: [25584.609103] do_syscall_64+0x5c/0xc0 Aug 22 12:30:10 juju-e4d256-prod-github-runner-207 kernel: [25584.609792] ? do_futex+0x162/0x1f0 Aug 22 12:30:10 juju-e4d256-prod-github-runner-207 kernel: [25584.610458] ? __x64_sys_futex+0x78/0x1e0 Aug 22 12:30:10 juju-e4d256-prod-github-runner-207 kernel: [25584.611169] ? __secure_computing+0xa9/0x120 Aug 22 12:30:10 juju-e4d256-prod-github-runner-207 kernel: [25584.611897] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 12:30:10 juju-e4d256-prod-github-runner-207 kernel: [25584.612675] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:30:10 juju-e4d256-prod-github-runner-207 kernel: [25584.613444] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:30:10 juju-e4d256-prod-github-runner-207 kernel: [25584.614175] ? do_syscall_64+0x69/0xc0 Aug 22 12:30:10 juju-e4d256-prod-github-runner-207 kernel: [25584.614824] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:30:10 juju-e4d256-prod-github-runner-207 kernel: [25584.615528] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:30:10 juju-e4d256-prod-github-runner-207 kernel: [25584.616301] ? do_syscall_64+0x69/0xc0 Aug 22 12:30:10 juju-e4d256-prod-github-runner-207 kernel: [25584.616937] ? do_syscall_64+0x69/0xc0 Aug 22 12:30:10 juju-e4d256-prod-github-runner-207 kernel: [25584.617580] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 12:30:10 juju-e4d256-prod-github-runner-207 kernel: [25584.618290] RIP: 0033:0x7faa5d0edaff Aug 22 12:30:10 juju-e4d256-prod-github-runner-207 kernel: [25584.618914] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 12:30:10 juju-e4d256-prod-github-runner-207 kernel: [25584.620891] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 12:30:10 juju-e4d256-prod-github-runner-207 kernel: [25584.621831] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 12:30:10 juju-e4d256-prod-github-runner-207 kernel: [25584.622720] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 12:30:10 juju-e4d256-prod-github-runner-207 kernel: [25584.623611] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 12:30:10 juju-e4d256-prod-github-runner-207 kernel: [25584.624500] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 12:30:10 juju-e4d256-prod-github-runner-207 kernel: [25584.625411] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 12:30:10 juju-e4d256-prod-github-runner-207 kernel: [25584.626306] Aug 22 12:30:38 juju-e4d256-prod-github-runner-207 kernel: [25612.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 23745s! [qemu-system-x86:6715] Aug 22 12:30:38 juju-e4d256-prod-github-runner-207 kernel: [25612.543089] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 12:30:38 juju-e4d256-prod-github-runner-207 kernel: [25612.543161] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 12:30:38 juju-e4d256-prod-github-runner-207 kernel: [25612.555507] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 12:30:38 juju-e4d256-prod-github-runner-207 kernel: [25612.556850] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 12:30:38 juju-e4d256-prod-github-runner-207 kernel: [25612.558100] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:30:38 juju-e4d256-prod-github-runner-207 kernel: [25612.559176] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 12:30:38 juju-e4d256-prod-github-runner-207 kernel: [25612.561798] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 12:30:38 juju-e4d256-prod-github-runner-207 kernel: [25612.562858] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 12:30:38 juju-e4d256-prod-github-runner-207 kernel: [25612.564038] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 12:30:38 juju-e4d256-prod-github-runner-207 kernel: [25612.565224] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 12:30:38 juju-e4d256-prod-github-runner-207 kernel: [25612.566404] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 12:30:38 juju-e4d256-prod-github-runner-207 kernel: [25612.567592] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 12:30:38 juju-e4d256-prod-github-runner-207 kernel: [25612.568794] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 12:30:38 juju-e4d256-prod-github-runner-207 kernel: [25612.570061] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 12:30:38 juju-e4d256-prod-github-runner-207 kernel: [25612.571190] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 12:30:38 juju-e4d256-prod-github-runner-207 kernel: [25612.572413] Call Trace: Aug 22 12:30:38 juju-e4d256-prod-github-runner-207 kernel: [25612.573390] Aug 22 12:30:38 juju-e4d256-prod-github-runner-207 kernel: [25612.574291] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:30:38 juju-e4d256-prod-github-runner-207 kernel: [25612.575430] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:30:38 juju-e4d256-prod-github-runner-207 kernel: [25612.576575] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:30:38 juju-e4d256-prod-github-runner-207 kernel: [25612.577806] ? show_regs.part.0+0x23/0x29 Aug 22 12:30:38 juju-e4d256-prod-github-runner-207 kernel: [25612.578912] ? show_regs.cold+0x8/0xd Aug 22 12:30:38 juju-e4d256-prod-github-runner-207 kernel: [25612.579945] ? watchdog_timer_fn+0x1be/0x220 Aug 22 12:30:38 juju-e4d256-prod-github-runner-207 kernel: [25612.580988] ? lockup_detector_update_enable+0x60/0x60 Aug 22 12:30:38 juju-e4d256-prod-github-runner-207 kernel: [25612.582069] ? __hrtimer_run_queues+0x107/0x230 Aug 22 12:30:38 juju-e4d256-prod-github-runner-207 kernel: [25612.583117] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 12:30:38 juju-e4d256-prod-github-runner-207 kernel: [25612.584154] ? hrtimer_interrupt+0x101/0x220 Aug 22 12:30:38 juju-e4d256-prod-github-runner-207 kernel: [25612.585199] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 12:30:38 juju-e4d256-prod-github-runner-207 kernel: [25612.586283] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 12:30:38 juju-e4d256-prod-github-runner-207 kernel: [25612.587342] Aug 22 12:30:38 juju-e4d256-prod-github-runner-207 kernel: [25612.588199] Aug 22 12:30:38 juju-e4d256-prod-github-runner-207 kernel: [25612.589056] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 12:30:38 juju-e4d256-prod-github-runner-207 kernel: [25612.590307] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:30:38 juju-e4d256-prod-github-runner-207 kernel: [25612.591554] ? _raw_spin_lock+0x22/0x30 Aug 22 12:30:38 juju-e4d256-prod-github-runner-207 kernel: [25612.592510] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:30:38 juju-e4d256-prod-github-runner-207 kernel: [25612.593549] direct_page_fault+0x206/0x310 [kvm] Aug 22 12:30:38 juju-e4d256-prod-github-runner-207 kernel: [25612.594587] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 12:30:38 juju-e4d256-prod-github-runner-207 kernel: [25612.595608] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 12:30:38 juju-e4d256-prod-github-runner-207 kernel: [25612.596621] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 12:30:38 juju-e4d256-prod-github-runner-207 kernel: [25612.597620] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 12:30:38 juju-e4d256-prod-github-runner-207 kernel: [25612.598590] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 12:30:38 juju-e4d256-prod-github-runner-207 kernel: [25612.599582] handle_exit+0x98/0x230 [kvm_amd] Aug 22 12:30:38 juju-e4d256-prod-github-runner-207 kernel: [25612.600487] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 12:30:38 juju-e4d256-prod-github-runner-207 kernel: [25612.601427] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 12:30:38 juju-e4d256-prod-github-runner-207 kernel: [25612.602376] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 12:30:38 juju-e4d256-prod-github-runner-207 kernel: [25612.603301] vcpu_run+0x62/0x2c0 [kvm] Aug 22 12:30:38 juju-e4d256-prod-github-runner-207 kernel: [25612.604125] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 12:30:38 juju-e4d256-prod-github-runner-207 kernel: [25612.604962] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 12:30:38 juju-e4d256-prod-github-runner-207 kernel: [25612.605830] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 12:30:38 juju-e4d256-prod-github-runner-207 kernel: [25612.606639] ? __seccomp_filter+0x4a/0x4a0 Aug 22 12:30:38 juju-e4d256-prod-github-runner-207 kernel: [25612.607393] ? __fget_files+0x86/0xc0 Aug 22 12:30:38 juju-e4d256-prod-github-runner-207 kernel: [25612.608106] __x64_sys_ioctl+0x95/0xd0 Aug 22 12:30:38 juju-e4d256-prod-github-runner-207 kernel: [25612.608821] do_syscall_64+0x5c/0xc0 Aug 22 12:30:38 juju-e4d256-prod-github-runner-207 kernel: [25612.609498] ? do_futex+0x162/0x1f0 Aug 22 12:30:38 juju-e4d256-prod-github-runner-207 kernel: [25612.610158] ? __x64_sys_futex+0x78/0x1e0 Aug 22 12:30:38 juju-e4d256-prod-github-runner-207 kernel: [25612.610848] ? __secure_computing+0xa9/0x120 Aug 22 12:30:38 juju-e4d256-prod-github-runner-207 kernel: [25612.611554] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 12:30:38 juju-e4d256-prod-github-runner-207 kernel: [25612.612335] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:30:38 juju-e4d256-prod-github-runner-207 kernel: [25612.613084] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:30:38 juju-e4d256-prod-github-runner-207 kernel: [25612.613816] ? do_syscall_64+0x69/0xc0 Aug 22 12:30:38 juju-e4d256-prod-github-runner-207 kernel: [25612.614491] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:30:38 juju-e4d256-prod-github-runner-207 kernel: [25612.615208] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:30:38 juju-e4d256-prod-github-runner-207 kernel: [25612.615919] ? do_syscall_64+0x69/0xc0 Aug 22 12:30:38 juju-e4d256-prod-github-runner-207 kernel: [25612.616554] ? do_syscall_64+0x69/0xc0 Aug 22 12:30:38 juju-e4d256-prod-github-runner-207 kernel: [25612.617201] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 12:30:38 juju-e4d256-prod-github-runner-207 kernel: [25612.617921] RIP: 0033:0x7faa5d0edaff Aug 22 12:30:38 juju-e4d256-prod-github-runner-207 kernel: [25612.618560] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 12:30:38 juju-e4d256-prod-github-runner-207 kernel: [25612.620606] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 12:30:38 juju-e4d256-prod-github-runner-207 kernel: [25612.621544] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 12:30:38 juju-e4d256-prod-github-runner-207 kernel: [25612.622452] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 12:30:38 juju-e4d256-prod-github-runner-207 kernel: [25612.623359] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 12:30:38 juju-e4d256-prod-github-runner-207 kernel: [25612.624293] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 12:30:38 juju-e4d256-prod-github-runner-207 kernel: [25612.625208] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 12:30:38 juju-e4d256-prod-github-runner-207 kernel: [25612.626134] Aug 22 12:31:06 juju-e4d256-prod-github-runner-207 kernel: [25640.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 23771s! [qemu-system-x86:6715] Aug 22 12:31:06 juju-e4d256-prod-github-runner-207 kernel: [25640.543170] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 12:31:06 juju-e4d256-prod-github-runner-207 kernel: [25640.543335] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 12:31:06 juju-e4d256-prod-github-runner-207 kernel: [25640.555574] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 12:31:06 juju-e4d256-prod-github-runner-207 kernel: [25640.556864] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 12:31:06 juju-e4d256-prod-github-runner-207 kernel: [25640.558085] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:31:06 juju-e4d256-prod-github-runner-207 kernel: [25640.559145] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 12:31:06 juju-e4d256-prod-github-runner-207 kernel: [25640.561698] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 12:31:06 juju-e4d256-prod-github-runner-207 kernel: [25640.562745] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 12:31:06 juju-e4d256-prod-github-runner-207 kernel: [25640.563909] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 12:31:06 juju-e4d256-prod-github-runner-207 kernel: [25640.565115] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 12:31:06 juju-e4d256-prod-github-runner-207 kernel: [25640.566306] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 12:31:06 juju-e4d256-prod-github-runner-207 kernel: [25640.567469] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 12:31:06 juju-e4d256-prod-github-runner-207 kernel: [25640.568652] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 12:31:06 juju-e4d256-prod-github-runner-207 kernel: [25640.569916] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 12:31:06 juju-e4d256-prod-github-runner-207 kernel: [25640.571014] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 12:31:06 juju-e4d256-prod-github-runner-207 kernel: [25640.572210] Call Trace: Aug 22 12:31:06 juju-e4d256-prod-github-runner-207 kernel: [25640.573143] Aug 22 12:31:06 juju-e4d256-prod-github-runner-207 kernel: [25640.574082] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:31:06 juju-e4d256-prod-github-runner-207 kernel: [25640.575115] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:31:06 juju-e4d256-prod-github-runner-207 kernel: [25640.576149] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:31:06 juju-e4d256-prod-github-runner-207 kernel: [25640.577281] ? show_regs.part.0+0x23/0x29 Aug 22 12:31:06 juju-e4d256-prod-github-runner-207 kernel: [25640.578278] ? show_regs.cold+0x8/0xd Aug 22 12:31:06 juju-e4d256-prod-github-runner-207 kernel: [25640.579250] ? watchdog_timer_fn+0x1be/0x220 Aug 22 12:31:06 juju-e4d256-prod-github-runner-207 kernel: [25640.580259] ? lockup_detector_update_enable+0x60/0x60 Aug 22 12:31:06 juju-e4d256-prod-github-runner-207 kernel: [25640.581352] ? __hrtimer_run_queues+0x107/0x230 Aug 22 12:31:06 juju-e4d256-prod-github-runner-207 kernel: [25640.582384] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 12:31:06 juju-e4d256-prod-github-runner-207 kernel: [25640.583406] ? hrtimer_interrupt+0x101/0x220 Aug 22 12:31:06 juju-e4d256-prod-github-runner-207 kernel: [25640.584465] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 12:31:06 juju-e4d256-prod-github-runner-207 kernel: [25640.585536] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 12:31:06 juju-e4d256-prod-github-runner-207 kernel: [25640.586595] Aug 22 12:31:06 juju-e4d256-prod-github-runner-207 kernel: [25640.587451] Aug 22 12:31:06 juju-e4d256-prod-github-runner-207 kernel: [25640.588295] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 12:31:06 juju-e4d256-prod-github-runner-207 kernel: [25640.589327] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:31:06 juju-e4d256-prod-github-runner-207 kernel: [25640.590367] ? _raw_spin_lock+0x22/0x30 Aug 22 12:31:06 juju-e4d256-prod-github-runner-207 kernel: [25640.591311] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:31:06 juju-e4d256-prod-github-runner-207 kernel: [25640.592340] direct_page_fault+0x206/0x310 [kvm] Aug 22 12:31:06 juju-e4d256-prod-github-runner-207 kernel: [25640.593378] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 12:31:06 juju-e4d256-prod-github-runner-207 kernel: [25640.594388] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 12:31:06 juju-e4d256-prod-github-runner-207 kernel: [25640.595392] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 12:31:06 juju-e4d256-prod-github-runner-207 kernel: [25640.596403] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 12:31:06 juju-e4d256-prod-github-runner-207 kernel: [25640.597353] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 12:31:06 juju-e4d256-prod-github-runner-207 kernel: [25640.598329] handle_exit+0x98/0x230 [kvm_amd] Aug 22 12:31:06 juju-e4d256-prod-github-runner-207 kernel: [25640.599219] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 12:31:06 juju-e4d256-prod-github-runner-207 kernel: [25640.600132] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 12:31:06 juju-e4d256-prod-github-runner-207 kernel: [25640.601097] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 12:31:06 juju-e4d256-prod-github-runner-207 kernel: [25640.602005] vcpu_run+0x62/0x2c0 [kvm] Aug 22 12:31:06 juju-e4d256-prod-github-runner-207 kernel: [25640.602816] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 12:31:06 juju-e4d256-prod-github-runner-207 kernel: [25640.603644] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 12:31:06 juju-e4d256-prod-github-runner-207 kernel: [25640.604535] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 12:31:06 juju-e4d256-prod-github-runner-207 kernel: [25640.605333] ? __seccomp_filter+0x4a/0x4a0 Aug 22 12:31:06 juju-e4d256-prod-github-runner-207 kernel: [25640.606125] ? __fget_files+0x86/0xc0 Aug 22 12:31:06 juju-e4d256-prod-github-runner-207 kernel: [25640.606882] __x64_sys_ioctl+0x95/0xd0 Aug 22 12:31:06 juju-e4d256-prod-github-runner-207 kernel: [25640.607584] do_syscall_64+0x5c/0xc0 Aug 22 12:31:06 juju-e4d256-prod-github-runner-207 kernel: [25640.608253] ? do_futex+0x162/0x1f0 Aug 22 12:31:06 juju-e4d256-prod-github-runner-207 kernel: [25640.608920] ? __x64_sys_futex+0x78/0x1e0 Aug 22 12:31:06 juju-e4d256-prod-github-runner-207 kernel: [25640.609596] ? __secure_computing+0xa9/0x120 Aug 22 12:31:06 juju-e4d256-prod-github-runner-207 kernel: [25640.610303] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 12:31:06 juju-e4d256-prod-github-runner-207 kernel: [25640.611081] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:31:06 juju-e4d256-prod-github-runner-207 kernel: [25640.611818] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:31:06 juju-e4d256-prod-github-runner-207 kernel: [25640.612573] ? do_syscall_64+0x69/0xc0 Aug 22 12:31:06 juju-e4d256-prod-github-runner-207 kernel: [25640.613231] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:31:06 juju-e4d256-prod-github-runner-207 kernel: [25640.613936] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:31:06 juju-e4d256-prod-github-runner-207 kernel: [25640.614634] ? do_syscall_64+0x69/0xc0 Aug 22 12:31:06 juju-e4d256-prod-github-runner-207 kernel: [25640.615274] ? do_syscall_64+0x69/0xc0 Aug 22 12:31:06 juju-e4d256-prod-github-runner-207 kernel: [25640.615901] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 12:31:06 juju-e4d256-prod-github-runner-207 kernel: [25640.616657] RIP: 0033:0x7faa5d0edaff Aug 22 12:31:06 juju-e4d256-prod-github-runner-207 kernel: [25640.617354] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 12:31:06 juju-e4d256-prod-github-runner-207 kernel: [25640.619371] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 12:31:06 juju-e4d256-prod-github-runner-207 kernel: [25640.620526] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 12:31:06 juju-e4d256-prod-github-runner-207 kernel: [25640.621449] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 12:31:06 juju-e4d256-prod-github-runner-207 kernel: [25640.622362] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 12:31:06 juju-e4d256-prod-github-runner-207 kernel: [25640.623300] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 12:31:06 juju-e4d256-prod-github-runner-207 kernel: [25640.624191] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 12:31:06 juju-e4d256-prod-github-runner-207 kernel: [25640.625101] Aug 22 12:31:34 juju-e4d256-prod-github-runner-207 kernel: [25668.541980] watchdog: BUG: soft lockup - CPU#1 stuck for 23797s! [qemu-system-x86:6715] Aug 22 12:31:34 juju-e4d256-prod-github-runner-207 kernel: [25668.543912] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 12:31:34 juju-e4d256-prod-github-runner-207 kernel: [25668.544190] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 12:31:34 juju-e4d256-prod-github-runner-207 kernel: [25668.557711] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 12:31:34 juju-e4d256-prod-github-runner-207 kernel: [25668.559109] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 12:31:34 juju-e4d256-prod-github-runner-207 kernel: [25668.560453] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:31:34 juju-e4d256-prod-github-runner-207 kernel: [25668.561563] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 12:31:34 juju-e4d256-prod-github-runner-207 kernel: [25668.564246] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 12:31:34 juju-e4d256-prod-github-runner-207 kernel: [25668.565323] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 12:31:34 juju-e4d256-prod-github-runner-207 kernel: [25668.566514] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 12:31:34 juju-e4d256-prod-github-runner-207 kernel: [25668.567717] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 12:31:34 juju-e4d256-prod-github-runner-207 kernel: [25668.568927] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 12:31:34 juju-e4d256-prod-github-runner-207 kernel: [25668.570150] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 12:31:34 juju-e4d256-prod-github-runner-207 kernel: [25668.571352] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 12:31:34 juju-e4d256-prod-github-runner-207 kernel: [25668.572631] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 12:31:34 juju-e4d256-prod-github-runner-207 kernel: [25668.573763] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 12:31:34 juju-e4d256-prod-github-runner-207 kernel: [25668.574993] Call Trace: Aug 22 12:31:34 juju-e4d256-prod-github-runner-207 kernel: [25668.575925] Aug 22 12:31:34 juju-e4d256-prod-github-runner-207 kernel: [25668.576850] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:31:34 juju-e4d256-prod-github-runner-207 kernel: [25668.577939] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:31:34 juju-e4d256-prod-github-runner-207 kernel: [25668.578979] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:31:34 juju-e4d256-prod-github-runner-207 kernel: [25668.580115] ? show_regs.part.0+0x23/0x29 Aug 22 12:31:34 juju-e4d256-prod-github-runner-207 kernel: [25668.581134] ? show_regs.cold+0x8/0xd Aug 22 12:31:34 juju-e4d256-prod-github-runner-207 kernel: [25668.582126] ? watchdog_timer_fn+0x1be/0x220 Aug 22 12:31:34 juju-e4d256-prod-github-runner-207 kernel: [25668.583154] ? lockup_detector_update_enable+0x60/0x60 Aug 22 12:31:34 juju-e4d256-prod-github-runner-207 kernel: [25668.584260] ? __hrtimer_run_queues+0x107/0x230 Aug 22 12:31:34 juju-e4d256-prod-github-runner-207 kernel: [25668.585312] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 12:31:34 juju-e4d256-prod-github-runner-207 kernel: [25668.586374] ? hrtimer_interrupt+0x101/0x220 Aug 22 12:31:34 juju-e4d256-prod-github-runner-207 kernel: [25668.587408] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 12:31:34 juju-e4d256-prod-github-runner-207 kernel: [25668.588516] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 12:31:34 juju-e4d256-prod-github-runner-207 kernel: [25668.589580] Aug 22 12:31:34 juju-e4d256-prod-github-runner-207 kernel: [25668.590472] Aug 22 12:31:34 juju-e4d256-prod-github-runner-207 kernel: [25668.591328] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 12:31:34 juju-e4d256-prod-github-runner-207 kernel: [25668.592420] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:31:34 juju-e4d256-prod-github-runner-207 kernel: [25668.593480] ? _raw_spin_lock+0x22/0x30 Aug 22 12:31:34 juju-e4d256-prod-github-runner-207 kernel: [25668.594438] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:31:34 juju-e4d256-prod-github-runner-207 kernel: [25668.595470] direct_page_fault+0x206/0x310 [kvm] Aug 22 12:31:34 juju-e4d256-prod-github-runner-207 kernel: [25668.596531] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 12:31:34 juju-e4d256-prod-github-runner-207 kernel: [25668.597559] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 12:31:34 juju-e4d256-prod-github-runner-207 kernel: [25668.598578] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 12:31:34 juju-e4d256-prod-github-runner-207 kernel: [25668.599580] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 12:31:34 juju-e4d256-prod-github-runner-207 kernel: [25668.600680] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 12:31:34 juju-e4d256-prod-github-runner-207 kernel: [25668.601685] handle_exit+0x98/0x230 [kvm_amd] Aug 22 12:31:34 juju-e4d256-prod-github-runner-207 kernel: [25668.602594] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 12:31:34 juju-e4d256-prod-github-runner-207 kernel: [25668.603522] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 12:31:34 juju-e4d256-prod-github-runner-207 kernel: [25668.604499] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 12:31:34 juju-e4d256-prod-github-runner-207 kernel: [25668.605486] vcpu_run+0x62/0x2c0 [kvm] Aug 22 12:31:34 juju-e4d256-prod-github-runner-207 kernel: [25668.606332] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 12:31:34 juju-e4d256-prod-github-runner-207 kernel: [25668.607179] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 12:31:34 juju-e4d256-prod-github-runner-207 kernel: [25668.608090] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 12:31:34 juju-e4d256-prod-github-runner-207 kernel: [25668.608915] ? __seccomp_filter+0x4a/0x4a0 Aug 22 12:31:34 juju-e4d256-prod-github-runner-207 kernel: [25668.609682] ? __fget_files+0x86/0xc0 Aug 22 12:31:34 juju-e4d256-prod-github-runner-207 kernel: [25668.610397] __x64_sys_ioctl+0x95/0xd0 Aug 22 12:31:34 juju-e4d256-prod-github-runner-207 kernel: [25668.611143] do_syscall_64+0x5c/0xc0 Aug 22 12:31:34 juju-e4d256-prod-github-runner-207 kernel: [25668.611827] ? do_futex+0x162/0x1f0 Aug 22 12:31:34 juju-e4d256-prod-github-runner-207 kernel: [25668.612504] ? __x64_sys_futex+0x78/0x1e0 Aug 22 12:31:34 juju-e4d256-prod-github-runner-207 kernel: [25668.613195] ? __secure_computing+0xa9/0x120 Aug 22 12:31:34 juju-e4d256-prod-github-runner-207 kernel: [25668.613909] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 12:31:34 juju-e4d256-prod-github-runner-207 kernel: [25668.614695] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:31:34 juju-e4d256-prod-github-runner-207 kernel: [25668.615445] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:31:34 juju-e4d256-prod-github-runner-207 kernel: [25668.616236] ? do_syscall_64+0x69/0xc0 Aug 22 12:31:34 juju-e4d256-prod-github-runner-207 kernel: [25668.616910] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:31:34 juju-e4d256-prod-github-runner-207 kernel: [25668.617640] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:31:34 juju-e4d256-prod-github-runner-207 kernel: [25668.618362] ? do_syscall_64+0x69/0xc0 Aug 22 12:31:34 juju-e4d256-prod-github-runner-207 kernel: [25668.619000] ? do_syscall_64+0x69/0xc0 Aug 22 12:31:34 juju-e4d256-prod-github-runner-207 kernel: [25668.619632] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 12:31:34 juju-e4d256-prod-github-runner-207 kernel: [25668.620360] RIP: 0033:0x7faa5d0edaff Aug 22 12:31:34 juju-e4d256-prod-github-runner-207 kernel: [25668.621055] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 12:31:34 juju-e4d256-prod-github-runner-207 kernel: [25668.623317] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 12:31:34 juju-e4d256-prod-github-runner-207 kernel: [25668.624293] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 12:31:34 juju-e4d256-prod-github-runner-207 kernel: [25668.625207] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 12:31:34 juju-e4d256-prod-github-runner-207 kernel: [25668.626123] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 12:31:34 juju-e4d256-prod-github-runner-207 kernel: [25668.627053] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 12:31:34 juju-e4d256-prod-github-runner-207 kernel: [25668.627985] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 12:31:34 juju-e4d256-prod-github-runner-207 kernel: [25668.628903] Aug 22 12:32:02 juju-e4d256-prod-github-runner-207 kernel: [25696.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 23823s! [qemu-system-x86:6715] Aug 22 12:32:02 juju-e4d256-prod-github-runner-207 kernel: [25696.543181] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 12:32:02 juju-e4d256-prod-github-runner-207 kernel: [25696.543260] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 12:32:02 juju-e4d256-prod-github-runner-207 kernel: [25696.555410] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 12:32:02 juju-e4d256-prod-github-runner-207 kernel: [25696.556695] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 12:32:02 juju-e4d256-prod-github-runner-207 kernel: [25696.557911] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:32:02 juju-e4d256-prod-github-runner-207 kernel: [25696.558965] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 12:32:02 juju-e4d256-prod-github-runner-207 kernel: [25696.561515] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 12:32:02 juju-e4d256-prod-github-runner-207 kernel: [25696.562556] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 12:32:02 juju-e4d256-prod-github-runner-207 kernel: [25696.563730] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 12:32:02 juju-e4d256-prod-github-runner-207 kernel: [25696.564914] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 12:32:02 juju-e4d256-prod-github-runner-207 kernel: [25696.566080] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 12:32:02 juju-e4d256-prod-github-runner-207 kernel: [25696.567245] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 12:32:02 juju-e4d256-prod-github-runner-207 kernel: [25696.568437] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 12:32:02 juju-e4d256-prod-github-runner-207 kernel: [25696.569703] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 12:32:02 juju-e4d256-prod-github-runner-207 kernel: [25696.570819] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 12:32:02 juju-e4d256-prod-github-runner-207 kernel: [25696.572052] Call Trace: Aug 22 12:32:02 juju-e4d256-prod-github-runner-207 kernel: [25696.572995] Aug 22 12:32:02 juju-e4d256-prod-github-runner-207 kernel: [25696.573880] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:32:02 juju-e4d256-prod-github-runner-207 kernel: [25696.574923] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:32:02 juju-e4d256-prod-github-runner-207 kernel: [25696.575976] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:32:02 juju-e4d256-prod-github-runner-207 kernel: [25696.577074] ? show_regs.part.0+0x23/0x29 Aug 22 12:32:02 juju-e4d256-prod-github-runner-207 kernel: [25696.578096] ? show_regs.cold+0x8/0xd Aug 22 12:32:02 juju-e4d256-prod-github-runner-207 kernel: [25696.579076] ? watchdog_timer_fn+0x1be/0x220 Aug 22 12:32:02 juju-e4d256-prod-github-runner-207 kernel: [25696.580107] ? lockup_detector_update_enable+0x60/0x60 Aug 22 12:32:02 juju-e4d256-prod-github-runner-207 kernel: [25696.581391] ? __hrtimer_run_queues+0x107/0x230 Aug 22 12:32:02 juju-e4d256-prod-github-runner-207 kernel: [25696.582502] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 12:32:02 juju-e4d256-prod-github-runner-207 kernel: [25696.583537] ? hrtimer_interrupt+0x101/0x220 Aug 22 12:32:02 juju-e4d256-prod-github-runner-207 kernel: [25696.584572] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 12:32:02 juju-e4d256-prod-github-runner-207 kernel: [25696.585650] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 12:32:02 juju-e4d256-prod-github-runner-207 kernel: [25696.586697] Aug 22 12:32:02 juju-e4d256-prod-github-runner-207 kernel: [25696.587552] Aug 22 12:32:02 juju-e4d256-prod-github-runner-207 kernel: [25696.588406] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 12:32:02 juju-e4d256-prod-github-runner-207 kernel: [25696.589440] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:32:02 juju-e4d256-prod-github-runner-207 kernel: [25696.590515] ? _raw_spin_lock+0x22/0x30 Aug 22 12:32:02 juju-e4d256-prod-github-runner-207 kernel: [25696.591502] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:32:02 juju-e4d256-prod-github-runner-207 kernel: [25696.592635] direct_page_fault+0x206/0x310 [kvm] Aug 22 12:32:02 juju-e4d256-prod-github-runner-207 kernel: [25696.593736] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 12:32:02 juju-e4d256-prod-github-runner-207 kernel: [25696.594752] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 12:32:02 juju-e4d256-prod-github-runner-207 kernel: [25696.595851] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 12:32:02 juju-e4d256-prod-github-runner-207 kernel: [25696.596843] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 12:32:02 juju-e4d256-prod-github-runner-207 kernel: [25696.597787] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 12:32:02 juju-e4d256-prod-github-runner-207 kernel: [25696.598761] handle_exit+0x98/0x230 [kvm_amd] Aug 22 12:32:02 juju-e4d256-prod-github-runner-207 kernel: [25696.599725] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 12:32:02 juju-e4d256-prod-github-runner-207 kernel: [25696.600656] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 12:32:02 juju-e4d256-prod-github-runner-207 kernel: [25696.601582] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 12:32:02 juju-e4d256-prod-github-runner-207 kernel: [25696.602517] vcpu_run+0x62/0x2c0 [kvm] Aug 22 12:32:02 juju-e4d256-prod-github-runner-207 kernel: [25696.603374] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 12:32:02 juju-e4d256-prod-github-runner-207 kernel: [25696.604329] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 12:32:02 juju-e4d256-prod-github-runner-207 kernel: [25696.605305] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 12:32:02 juju-e4d256-prod-github-runner-207 kernel: [25696.606193] ? __seccomp_filter+0x4a/0x4a0 Aug 22 12:32:02 juju-e4d256-prod-github-runner-207 kernel: [25696.607023] ? __fget_files+0x86/0xc0 Aug 22 12:32:02 juju-e4d256-prod-github-runner-207 kernel: [25696.607827] __x64_sys_ioctl+0x95/0xd0 Aug 22 12:32:02 juju-e4d256-prod-github-runner-207 kernel: [25696.608608] do_syscall_64+0x5c/0xc0 Aug 22 12:32:02 juju-e4d256-prod-github-runner-207 kernel: [25696.609358] ? do_futex+0x162/0x1f0 Aug 22 12:32:02 juju-e4d256-prod-github-runner-207 kernel: [25696.610098] ? __x64_sys_futex+0x78/0x1e0 Aug 22 12:32:02 juju-e4d256-prod-github-runner-207 kernel: [25696.610854] ? __secure_computing+0xa9/0x120 Aug 22 12:32:02 juju-e4d256-prod-github-runner-207 kernel: [25696.611658] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 12:32:02 juju-e4d256-prod-github-runner-207 kernel: [25696.612537] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:32:02 juju-e4d256-prod-github-runner-207 kernel: [25696.613371] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:32:02 juju-e4d256-prod-github-runner-207 kernel: [25696.614212] ? do_syscall_64+0x69/0xc0 Aug 22 12:32:02 juju-e4d256-prod-github-runner-207 kernel: [25696.614960] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:32:02 juju-e4d256-prod-github-runner-207 kernel: [25696.615813] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:32:02 juju-e4d256-prod-github-runner-207 kernel: [25696.616618] ? do_syscall_64+0x69/0xc0 Aug 22 12:32:02 juju-e4d256-prod-github-runner-207 kernel: [25696.617322] ? do_syscall_64+0x69/0xc0 Aug 22 12:32:02 juju-e4d256-prod-github-runner-207 kernel: [25696.618023] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 12:32:02 juju-e4d256-prod-github-runner-207 kernel: [25696.618831] RIP: 0033:0x7faa5d0edaff Aug 22 12:32:02 juju-e4d256-prod-github-runner-207 kernel: [25696.619536] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 12:32:02 juju-e4d256-prod-github-runner-207 kernel: [25696.621869] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 12:32:02 juju-e4d256-prod-github-runner-207 kernel: [25696.622927] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 12:32:02 juju-e4d256-prod-github-runner-207 kernel: [25696.623976] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 12:32:02 juju-e4d256-prod-github-runner-207 kernel: [25696.625005] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 12:32:02 juju-e4d256-prod-github-runner-207 kernel: [25696.626034] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 12:32:02 juju-e4d256-prod-github-runner-207 kernel: [25696.627059] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 12:32:02 juju-e4d256-prod-github-runner-207 kernel: [25696.628107] Aug 22 12:32:30 juju-e4d256-prod-github-runner-207 kernel: [25724.541980] watchdog: BUG: soft lockup - CPU#1 stuck for 23849s! [qemu-system-x86:6715] Aug 22 12:32:30 juju-e4d256-prod-github-runner-207 kernel: [25724.543184] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 12:32:30 juju-e4d256-prod-github-runner-207 kernel: [25724.543307] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 12:32:30 juju-e4d256-prod-github-runner-207 kernel: [25724.555649] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 12:32:30 juju-e4d256-prod-github-runner-207 kernel: [25724.556944] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 12:32:30 juju-e4d256-prod-github-runner-207 kernel: [25724.558211] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:32:30 juju-e4d256-prod-github-runner-207 kernel: [25724.559330] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 12:32:30 juju-e4d256-prod-github-runner-207 kernel: [25724.561939] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 12:32:30 juju-e4d256-prod-github-runner-207 kernel: [25724.563031] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 12:32:30 juju-e4d256-prod-github-runner-207 kernel: [25724.564261] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 12:32:30 juju-e4d256-prod-github-runner-207 kernel: [25724.565434] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 12:32:30 juju-e4d256-prod-github-runner-207 kernel: [25724.566600] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 12:32:30 juju-e4d256-prod-github-runner-207 kernel: [25724.567797] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 12:32:30 juju-e4d256-prod-github-runner-207 kernel: [25724.569032] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 12:32:30 juju-e4d256-prod-github-runner-207 kernel: [25724.570291] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 12:32:30 juju-e4d256-prod-github-runner-207 kernel: [25724.571411] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 12:32:30 juju-e4d256-prod-github-runner-207 kernel: [25724.572635] Call Trace: Aug 22 12:32:30 juju-e4d256-prod-github-runner-207 kernel: [25724.573608] Aug 22 12:32:30 juju-e4d256-prod-github-runner-207 kernel: [25724.574526] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:32:30 juju-e4d256-prod-github-runner-207 kernel: [25724.575592] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:32:30 juju-e4d256-prod-github-runner-207 kernel: [25724.576787] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:32:30 juju-e4d256-prod-github-runner-207 kernel: [25724.578208] ? show_regs.part.0+0x23/0x29 Aug 22 12:32:30 juju-e4d256-prod-github-runner-207 kernel: [25724.579578] ? show_regs.cold+0x8/0xd Aug 22 12:32:30 juju-e4d256-prod-github-runner-207 kernel: [25724.580969] ? watchdog_timer_fn+0x1be/0x220 Aug 22 12:32:30 juju-e4d256-prod-github-runner-207 kernel: [25724.582232] ? lockup_detector_update_enable+0x60/0x60 Aug 22 12:32:30 juju-e4d256-prod-github-runner-207 kernel: [25724.583346] ? __hrtimer_run_queues+0x107/0x230 Aug 22 12:32:30 juju-e4d256-prod-github-runner-207 kernel: [25724.584390] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 12:32:30 juju-e4d256-prod-github-runner-207 kernel: [25724.585424] ? hrtimer_interrupt+0x101/0x220 Aug 22 12:32:30 juju-e4d256-prod-github-runner-207 kernel: [25724.586445] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 12:32:30 juju-e4d256-prod-github-runner-207 kernel: [25724.587543] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 12:32:30 juju-e4d256-prod-github-runner-207 kernel: [25724.588597] Aug 22 12:32:30 juju-e4d256-prod-github-runner-207 kernel: [25724.589458] Aug 22 12:32:30 juju-e4d256-prod-github-runner-207 kernel: [25724.590298] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 12:32:30 juju-e4d256-prod-github-runner-207 kernel: [25724.591356] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:32:30 juju-e4d256-prod-github-runner-207 kernel: [25724.592402] ? _raw_spin_lock+0x22/0x30 Aug 22 12:32:30 juju-e4d256-prod-github-runner-207 kernel: [25724.593356] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:32:30 juju-e4d256-prod-github-runner-207 kernel: [25724.594382] direct_page_fault+0x206/0x310 [kvm] Aug 22 12:32:30 juju-e4d256-prod-github-runner-207 kernel: [25724.595435] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 12:32:30 juju-e4d256-prod-github-runner-207 kernel: [25724.596457] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 12:32:30 juju-e4d256-prod-github-runner-207 kernel: [25724.597474] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 12:32:30 juju-e4d256-prod-github-runner-207 kernel: [25724.598448] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 12:32:30 juju-e4d256-prod-github-runner-207 kernel: [25724.599442] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 12:32:30 juju-e4d256-prod-github-runner-207 kernel: [25724.600434] handle_exit+0x98/0x230 [kvm_amd] Aug 22 12:32:30 juju-e4d256-prod-github-runner-207 kernel: [25724.601337] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 12:32:30 juju-e4d256-prod-github-runner-207 kernel: [25724.602257] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 12:32:30 juju-e4d256-prod-github-runner-207 kernel: [25724.603215] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 12:32:30 juju-e4d256-prod-github-runner-207 kernel: [25724.604147] vcpu_run+0x62/0x2c0 [kvm] Aug 22 12:32:30 juju-e4d256-prod-github-runner-207 kernel: [25724.604966] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 12:32:30 juju-e4d256-prod-github-runner-207 kernel: [25724.605778] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 12:32:30 juju-e4d256-prod-github-runner-207 kernel: [25724.606634] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 12:32:30 juju-e4d256-prod-github-runner-207 kernel: [25724.607458] ? __seccomp_filter+0x4a/0x4a0 Aug 22 12:32:30 juju-e4d256-prod-github-runner-207 kernel: [25724.608211] ? __fget_files+0x86/0xc0 Aug 22 12:32:30 juju-e4d256-prod-github-runner-207 kernel: [25724.608922] __x64_sys_ioctl+0x95/0xd0 Aug 22 12:32:30 juju-e4d256-prod-github-runner-207 kernel: [25724.609618] do_syscall_64+0x5c/0xc0 Aug 22 12:32:30 juju-e4d256-prod-github-runner-207 kernel: [25724.610287] ? do_futex+0x162/0x1f0 Aug 22 12:32:30 juju-e4d256-prod-github-runner-207 kernel: [25724.610968] ? __x64_sys_futex+0x78/0x1e0 Aug 22 12:32:30 juju-e4d256-prod-github-runner-207 kernel: [25724.611673] ? __secure_computing+0xa9/0x120 Aug 22 12:32:30 juju-e4d256-prod-github-runner-207 kernel: [25724.612387] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 12:32:30 juju-e4d256-prod-github-runner-207 kernel: [25724.613152] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:32:30 juju-e4d256-prod-github-runner-207 kernel: [25724.613876] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:32:30 juju-e4d256-prod-github-runner-207 kernel: [25724.614600] ? do_syscall_64+0x69/0xc0 Aug 22 12:32:30 juju-e4d256-prod-github-runner-207 kernel: [25724.615275] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:32:30 juju-e4d256-prod-github-runner-207 kernel: [25724.615990] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:32:30 juju-e4d256-prod-github-runner-207 kernel: [25724.616688] ? do_syscall_64+0x69/0xc0 Aug 22 12:32:30 juju-e4d256-prod-github-runner-207 kernel: [25724.617315] ? do_syscall_64+0x69/0xc0 Aug 22 12:32:30 juju-e4d256-prod-github-runner-207 kernel: [25724.617939] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 12:32:30 juju-e4d256-prod-github-runner-207 kernel: [25724.618648] RIP: 0033:0x7faa5d0edaff Aug 22 12:32:30 juju-e4d256-prod-github-runner-207 kernel: [25724.619287] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 12:32:30 juju-e4d256-prod-github-runner-207 kernel: [25724.621286] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 12:32:30 juju-e4d256-prod-github-runner-207 kernel: [25724.622200] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 12:32:30 juju-e4d256-prod-github-runner-207 kernel: [25724.623093] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 12:32:30 juju-e4d256-prod-github-runner-207 kernel: [25724.623998] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 12:32:30 juju-e4d256-prod-github-runner-207 kernel: [25724.624893] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 12:32:30 juju-e4d256-prod-github-runner-207 kernel: [25724.625784] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 12:32:30 juju-e4d256-prod-github-runner-207 kernel: [25724.626682] Aug 22 12:32:45 juju-e4d256-prod-github-runner-207 kernel: [25738.904710] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 12:32:45 juju-e4d256-prod-github-runner-207 kernel: [25738.906461] rcu: 1-....: (6385449 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=3089770 Aug 22 12:32:45 juju-e4d256-prod-github-runner-207 kernel: [25738.907641] (t=6405426 jiffies g=23269 q=30304) Aug 22 12:32:45 juju-e4d256-prod-github-runner-207 kernel: [25738.908424] NMI backtrace for cpu 1 Aug 22 12:32:45 juju-e4d256-prod-github-runner-207 kernel: [25738.909140] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 12:32:45 juju-e4d256-prod-github-runner-207 kernel: [25738.910242] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 12:32:45 juju-e4d256-prod-github-runner-207 kernel: [25738.911349] Call Trace: Aug 22 12:32:45 juju-e4d256-prod-github-runner-207 kernel: [25738.912214] Aug 22 12:32:45 juju-e4d256-prod-github-runner-207 kernel: [25738.912869] show_stack+0x52/0x5c Aug 22 12:32:45 juju-e4d256-prod-github-runner-207 kernel: [25738.913591] dump_stack_lvl+0x4a/0x63 Aug 22 12:32:45 juju-e4d256-prod-github-runner-207 kernel: [25738.914334] dump_stack+0x10/0x16 Aug 22 12:32:45 juju-e4d256-prod-github-runner-207 kernel: [25738.915048] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 12:32:45 juju-e4d256-prod-github-runner-207 kernel: [25738.915838] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 12:32:45 juju-e4d256-prod-github-runner-207 kernel: [25738.916657] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 12:32:45 juju-e4d256-prod-github-runner-207 kernel: [25738.917624] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 12:32:45 juju-e4d256-prod-github-runner-207 kernel: [25738.918520] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 12:32:45 juju-e4d256-prod-github-runner-207 kernel: [25738.919545] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 12:32:45 juju-e4d256-prod-github-runner-207 kernel: [25738.920325] print_cpu_stall.cold+0x2f/0xe2 Aug 22 12:32:45 juju-e4d256-prod-github-runner-207 kernel: [25738.921305] ? timekeeping_update+0xf7/0x150 Aug 22 12:32:45 juju-e4d256-prod-github-runner-207 kernel: [25738.922298] check_cpu_stall+0x109/0x270 Aug 22 12:32:45 juju-e4d256-prod-github-runner-207 kernel: [25738.923416] rcu_sched_clock_irq+0x9a/0x250 Aug 22 12:32:45 juju-e4d256-prod-github-runner-207 kernel: [25738.924616] update_process_times+0x94/0xd0 Aug 22 12:32:45 juju-e4d256-prod-github-runner-207 kernel: [25738.925565] tick_sched_handle+0x29/0x70 Aug 22 12:32:45 juju-e4d256-prod-github-runner-207 kernel: [25738.926635] tick_sched_timer+0x8c/0xc0 Aug 22 12:32:45 juju-e4d256-prod-github-runner-207 kernel: [25738.927610] ? tick_nohz_handler+0xb0/0xb0 Aug 22 12:32:45 juju-e4d256-prod-github-runner-207 kernel: [25738.928553] __hrtimer_run_queues+0x107/0x230 Aug 22 12:32:45 juju-e4d256-prod-github-runner-207 kernel: [25738.929693] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 12:32:45 juju-e4d256-prod-github-runner-207 kernel: [25738.930632] hrtimer_interrupt+0x101/0x220 Aug 22 12:32:45 juju-e4d256-prod-github-runner-207 kernel: [25738.931666] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 12:32:45 juju-e4d256-prod-github-runner-207 kernel: [25738.932615] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 12:32:45 juju-e4d256-prod-github-runner-207 kernel: [25738.933612] Aug 22 12:32:45 juju-e4d256-prod-github-runner-207 kernel: [25738.934402] Aug 22 12:32:45 juju-e4d256-prod-github-runner-207 kernel: [25738.935296] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 12:32:45 juju-e4d256-prod-github-runner-207 kernel: [25738.936278] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:32:45 juju-e4d256-prod-github-runner-207 kernel: [25738.937471] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 12:32:45 juju-e4d256-prod-github-runner-207 kernel: [25738.940213] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 12:32:45 juju-e4d256-prod-github-runner-207 kernel: [25738.941403] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 12:32:45 juju-e4d256-prod-github-runner-207 kernel: [25738.942623] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 12:32:45 juju-e4d256-prod-github-runner-207 kernel: [25738.943925] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 12:32:45 juju-e4d256-prod-github-runner-207 kernel: [25738.945151] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 12:32:45 juju-e4d256-prod-github-runner-207 kernel: [25738.946323] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 12:32:45 juju-e4d256-prod-github-runner-207 kernel: [25738.947446] ? _raw_spin_lock+0x22/0x30 Aug 22 12:32:45 juju-e4d256-prod-github-runner-207 kernel: [25738.948406] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:32:45 juju-e4d256-prod-github-runner-207 kernel: [25738.949298] direct_page_fault+0x206/0x310 [kvm] Aug 22 12:32:45 juju-e4d256-prod-github-runner-207 kernel: [25738.950360] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 12:32:45 juju-e4d256-prod-github-runner-207 kernel: [25738.951276] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 12:32:45 juju-e4d256-prod-github-runner-207 kernel: [25738.952326] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 12:32:45 juju-e4d256-prod-github-runner-207 kernel: [25738.953350] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 12:32:45 juju-e4d256-prod-github-runner-207 kernel: [25738.954390] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 12:32:45 juju-e4d256-prod-github-runner-207 kernel: [25738.955434] handle_exit+0x98/0x230 [kvm_amd] Aug 22 12:32:45 juju-e4d256-prod-github-runner-207 kernel: [25738.956277] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 12:32:45 juju-e4d256-prod-github-runner-207 kernel: [25738.957112] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 12:32:45 juju-e4d256-prod-github-runner-207 kernel: [25738.957979] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 12:32:45 juju-e4d256-prod-github-runner-207 kernel: [25738.958807] vcpu_run+0x62/0x2c0 [kvm] Aug 22 12:32:45 juju-e4d256-prod-github-runner-207 kernel: [25738.959611] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 12:32:45 juju-e4d256-prod-github-runner-207 kernel: [25738.960429] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 12:32:45 juju-e4d256-prod-github-runner-207 kernel: [25738.961301] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 12:32:45 juju-e4d256-prod-github-runner-207 kernel: [25738.962115] ? __seccomp_filter+0x4a/0x4a0 Aug 22 12:32:45 juju-e4d256-prod-github-runner-207 kernel: [25738.962864] ? __fget_files+0x86/0xc0 Aug 22 12:32:45 juju-e4d256-prod-github-runner-207 kernel: [25738.963610] __x64_sys_ioctl+0x95/0xd0 Aug 22 12:32:45 juju-e4d256-prod-github-runner-207 kernel: [25738.964355] do_syscall_64+0x5c/0xc0 Aug 22 12:32:45 juju-e4d256-prod-github-runner-207 kernel: [25738.965087] ? do_futex+0x162/0x1f0 Aug 22 12:32:45 juju-e4d256-prod-github-runner-207 kernel: [25738.965813] ? __x64_sys_futex+0x78/0x1e0 Aug 22 12:32:45 juju-e4d256-prod-github-runner-207 kernel: [25738.966551] ? __secure_computing+0xa9/0x120 Aug 22 12:32:45 juju-e4d256-prod-github-runner-207 kernel: [25738.967330] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 12:32:45 juju-e4d256-prod-github-runner-207 kernel: [25738.968191] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:32:45 juju-e4d256-prod-github-runner-207 kernel: [25738.968996] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:32:45 juju-e4d256-prod-github-runner-207 kernel: [25738.969807] ? do_syscall_64+0x69/0xc0 Aug 22 12:32:45 juju-e4d256-prod-github-runner-207 kernel: [25738.970546] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:32:45 juju-e4d256-prod-github-runner-207 kernel: [25738.971390] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:32:45 juju-e4d256-prod-github-runner-207 kernel: [25738.972213] ? do_syscall_64+0x69/0xc0 Aug 22 12:32:45 juju-e4d256-prod-github-runner-207 kernel: [25738.972971] ? do_syscall_64+0x69/0xc0 Aug 22 12:32:45 juju-e4d256-prod-github-runner-207 kernel: [25738.973705] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 12:32:45 juju-e4d256-prod-github-runner-207 kernel: [25738.974534] RIP: 0033:0x7faa5d0edaff Aug 22 12:32:45 juju-e4d256-prod-github-runner-207 kernel: [25738.975331] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 12:32:45 juju-e4d256-prod-github-runner-207 kernel: [25738.977558] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 12:32:45 juju-e4d256-prod-github-runner-207 kernel: [25738.978591] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 12:32:45 juju-e4d256-prod-github-runner-207 kernel: [25738.979615] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 12:32:45 juju-e4d256-prod-github-runner-207 kernel: [25738.980642] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 12:32:45 juju-e4d256-prod-github-runner-207 kernel: [25738.981628] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 12:32:45 juju-e4d256-prod-github-runner-207 kernel: [25738.982629] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 12:32:45 juju-e4d256-prod-github-runner-207 kernel: [25738.983628] Aug 22 12:33:10 juju-e4d256-prod-github-runner-207 kernel: [25764.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 23887s! [qemu-system-x86:6715] Aug 22 12:33:10 juju-e4d256-prod-github-runner-207 kernel: [25764.543130] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 12:33:10 juju-e4d256-prod-github-runner-207 kernel: [25764.543491] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 12:33:10 juju-e4d256-prod-github-runner-207 kernel: [25764.555897] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 12:33:10 juju-e4d256-prod-github-runner-207 kernel: [25764.557187] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 12:33:10 juju-e4d256-prod-github-runner-207 kernel: [25764.558634] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:33:10 juju-e4d256-prod-github-runner-207 kernel: [25764.559793] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 12:33:10 juju-e4d256-prod-github-runner-207 kernel: [25764.562694] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 12:33:10 juju-e4d256-prod-github-runner-207 kernel: [25764.563878] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 12:33:10 juju-e4d256-prod-github-runner-207 kernel: [25764.565102] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 12:33:10 juju-e4d256-prod-github-runner-207 kernel: [25764.566308] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 12:33:10 juju-e4d256-prod-github-runner-207 kernel: [25764.567515] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 12:33:10 juju-e4d256-prod-github-runner-207 kernel: [25764.568698] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 12:33:10 juju-e4d256-prod-github-runner-207 kernel: [25764.569884] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 12:33:10 juju-e4d256-prod-github-runner-207 kernel: [25764.571162] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 12:33:10 juju-e4d256-prod-github-runner-207 kernel: [25764.572279] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 12:33:10 juju-e4d256-prod-github-runner-207 kernel: [25764.573500] Call Trace: Aug 22 12:33:10 juju-e4d256-prod-github-runner-207 kernel: [25764.574424] Aug 22 12:33:10 juju-e4d256-prod-github-runner-207 kernel: [25764.575331] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:33:10 juju-e4d256-prod-github-runner-207 kernel: [25764.576406] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:33:10 juju-e4d256-prod-github-runner-207 kernel: [25764.577686] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:33:10 juju-e4d256-prod-github-runner-207 kernel: [25764.579028] ? show_regs.part.0+0x23/0x29 Aug 22 12:33:10 juju-e4d256-prod-github-runner-207 kernel: [25764.580075] ? show_regs.cold+0x8/0xd Aug 22 12:33:10 juju-e4d256-prod-github-runner-207 kernel: [25764.581279] ? watchdog_timer_fn+0x1be/0x220 Aug 22 12:33:10 juju-e4d256-prod-github-runner-207 kernel: [25764.582310] ? lockup_detector_update_enable+0x60/0x60 Aug 22 12:33:10 juju-e4d256-prod-github-runner-207 kernel: [25764.583443] ? __hrtimer_run_queues+0x107/0x230 Aug 22 12:33:10 juju-e4d256-prod-github-runner-207 kernel: [25764.584493] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 12:33:10 juju-e4d256-prod-github-runner-207 kernel: [25764.585537] ? hrtimer_interrupt+0x101/0x220 Aug 22 12:33:10 juju-e4d256-prod-github-runner-207 kernel: [25764.586587] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 12:33:10 juju-e4d256-prod-github-runner-207 kernel: [25764.587691] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 12:33:10 juju-e4d256-prod-github-runner-207 kernel: [25764.588757] Aug 22 12:33:10 juju-e4d256-prod-github-runner-207 kernel: [25764.589617] Aug 22 12:33:10 juju-e4d256-prod-github-runner-207 kernel: [25764.590466] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 12:33:10 juju-e4d256-prod-github-runner-207 kernel: [25764.591558] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:33:10 juju-e4d256-prod-github-runner-207 kernel: [25764.592622] ? _raw_spin_lock+0x22/0x30 Aug 22 12:33:10 juju-e4d256-prod-github-runner-207 kernel: [25764.593608] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:33:10 juju-e4d256-prod-github-runner-207 kernel: [25764.594659] direct_page_fault+0x206/0x310 [kvm] Aug 22 12:33:10 juju-e4d256-prod-github-runner-207 kernel: [25764.595719] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 12:33:10 juju-e4d256-prod-github-runner-207 kernel: [25764.596778] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 12:33:10 juju-e4d256-prod-github-runner-207 kernel: [25764.597811] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 12:33:10 juju-e4d256-prod-github-runner-207 kernel: [25764.598813] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 12:33:10 juju-e4d256-prod-github-runner-207 kernel: [25764.599772] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 12:33:10 juju-e4d256-prod-github-runner-207 kernel: [25764.600761] handle_exit+0x98/0x230 [kvm_amd] Aug 22 12:33:10 juju-e4d256-prod-github-runner-207 kernel: [25764.601702] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 12:33:10 juju-e4d256-prod-github-runner-207 kernel: [25764.602639] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 12:33:10 juju-e4d256-prod-github-runner-207 kernel: [25764.603596] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 12:33:10 juju-e4d256-prod-github-runner-207 kernel: [25764.604511] vcpu_run+0x62/0x2c0 [kvm] Aug 22 12:33:10 juju-e4d256-prod-github-runner-207 kernel: [25764.605331] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 12:33:10 juju-e4d256-prod-github-runner-207 kernel: [25764.606149] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 12:33:10 juju-e4d256-prod-github-runner-207 kernel: [25764.607030] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 12:33:10 juju-e4d256-prod-github-runner-207 kernel: [25764.607839] ? __seccomp_filter+0x4a/0x4a0 Aug 22 12:33:10 juju-e4d256-prod-github-runner-207 kernel: [25764.608589] ? __fget_files+0x86/0xc0 Aug 22 12:33:10 juju-e4d256-prod-github-runner-207 kernel: [25764.609331] __x64_sys_ioctl+0x95/0xd0 Aug 22 12:33:10 juju-e4d256-prod-github-runner-207 kernel: [25764.610034] do_syscall_64+0x5c/0xc0 Aug 22 12:33:10 juju-e4d256-prod-github-runner-207 kernel: [25764.610719] ? do_futex+0x162/0x1f0 Aug 22 12:33:10 juju-e4d256-prod-github-runner-207 kernel: [25764.611394] ? __x64_sys_futex+0x78/0x1e0 Aug 22 12:33:10 juju-e4d256-prod-github-runner-207 kernel: [25764.612080] ? __secure_computing+0xa9/0x120 Aug 22 12:33:10 juju-e4d256-prod-github-runner-207 kernel: [25764.612781] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 12:33:10 juju-e4d256-prod-github-runner-207 kernel: [25764.613558] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:33:10 juju-e4d256-prod-github-runner-207 kernel: [25764.614298] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:33:10 juju-e4d256-prod-github-runner-207 kernel: [25764.615039] ? do_syscall_64+0x69/0xc0 Aug 22 12:33:10 juju-e4d256-prod-github-runner-207 kernel: [25764.615698] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:33:10 juju-e4d256-prod-github-runner-207 kernel: [25764.616415] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:33:10 juju-e4d256-prod-github-runner-207 kernel: [25764.617128] ? do_syscall_64+0x69/0xc0 Aug 22 12:33:10 juju-e4d256-prod-github-runner-207 kernel: [25764.617763] ? do_syscall_64+0x69/0xc0 Aug 22 12:33:10 juju-e4d256-prod-github-runner-207 kernel: [25764.618394] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 12:33:10 juju-e4d256-prod-github-runner-207 kernel: [25764.619128] RIP: 0033:0x7faa5d0edaff Aug 22 12:33:10 juju-e4d256-prod-github-runner-207 kernel: [25764.619763] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 12:33:10 juju-e4d256-prod-github-runner-207 kernel: [25764.621803] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 12:33:10 juju-e4d256-prod-github-runner-207 kernel: [25764.622735] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 12:33:10 juju-e4d256-prod-github-runner-207 kernel: [25764.623659] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 12:33:10 juju-e4d256-prod-github-runner-207 kernel: [25764.624568] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 12:33:10 juju-e4d256-prod-github-runner-207 kernel: [25764.625477] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 12:33:10 juju-e4d256-prod-github-runner-207 kernel: [25764.626385] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 12:33:10 juju-e4d256-prod-github-runner-207 kernel: [25764.627324] Aug 22 12:33:38 juju-e4d256-prod-github-runner-207 kernel: [25792.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 23913s! [qemu-system-x86:6715] Aug 22 12:33:38 juju-e4d256-prod-github-runner-207 kernel: [25792.543120] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 12:33:38 juju-e4d256-prod-github-runner-207 kernel: [25792.543195] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 12:33:38 juju-e4d256-prod-github-runner-207 kernel: [25792.555347] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 12:33:38 juju-e4d256-prod-github-runner-207 kernel: [25792.556618] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 12:33:38 juju-e4d256-prod-github-runner-207 kernel: [25792.557849] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:33:38 juju-e4d256-prod-github-runner-207 kernel: [25792.558919] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 12:33:38 juju-e4d256-prod-github-runner-207 kernel: [25792.561479] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 12:33:38 juju-e4d256-prod-github-runner-207 kernel: [25792.562553] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 12:33:38 juju-e4d256-prod-github-runner-207 kernel: [25792.563726] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 12:33:38 juju-e4d256-prod-github-runner-207 kernel: [25792.564912] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 12:33:38 juju-e4d256-prod-github-runner-207 kernel: [25792.566091] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 12:33:38 juju-e4d256-prod-github-runner-207 kernel: [25792.567287] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 12:33:38 juju-e4d256-prod-github-runner-207 kernel: [25792.568453] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 12:33:38 juju-e4d256-prod-github-runner-207 kernel: [25792.569689] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 12:33:38 juju-e4d256-prod-github-runner-207 kernel: [25792.570802] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 12:33:38 juju-e4d256-prod-github-runner-207 kernel: [25792.572025] Call Trace: Aug 22 12:33:38 juju-e4d256-prod-github-runner-207 kernel: [25792.573040] Aug 22 12:33:38 juju-e4d256-prod-github-runner-207 kernel: [25792.573948] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:33:38 juju-e4d256-prod-github-runner-207 kernel: [25792.575007] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:33:38 juju-e4d256-prod-github-runner-207 kernel: [25792.576031] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:33:38 juju-e4d256-prod-github-runner-207 kernel: [25792.577109] ? show_regs.part.0+0x23/0x29 Aug 22 12:33:38 juju-e4d256-prod-github-runner-207 kernel: [25792.578115] ? show_regs.cold+0x8/0xd Aug 22 12:33:38 juju-e4d256-prod-github-runner-207 kernel: [25792.579098] ? watchdog_timer_fn+0x1be/0x220 Aug 22 12:33:38 juju-e4d256-prod-github-runner-207 kernel: [25792.580113] ? lockup_detector_update_enable+0x60/0x60 Aug 22 12:33:38 juju-e4d256-prod-github-runner-207 kernel: [25792.581199] ? __hrtimer_run_queues+0x107/0x230 Aug 22 12:33:38 juju-e4d256-prod-github-runner-207 kernel: [25792.582283] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 12:33:38 juju-e4d256-prod-github-runner-207 kernel: [25792.583344] ? hrtimer_interrupt+0x101/0x220 Aug 22 12:33:38 juju-e4d256-prod-github-runner-207 kernel: [25792.584360] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 12:33:38 juju-e4d256-prod-github-runner-207 kernel: [25792.585427] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 12:33:38 juju-e4d256-prod-github-runner-207 kernel: [25792.586522] Aug 22 12:33:38 juju-e4d256-prod-github-runner-207 kernel: [25792.587379] Aug 22 12:33:38 juju-e4d256-prod-github-runner-207 kernel: [25792.588221] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 12:33:38 juju-e4d256-prod-github-runner-207 kernel: [25792.589254] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:33:38 juju-e4d256-prod-github-runner-207 kernel: [25792.590293] ? _raw_spin_lock+0x22/0x30 Aug 22 12:33:38 juju-e4d256-prod-github-runner-207 kernel: [25792.591259] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:33:38 juju-e4d256-prod-github-runner-207 kernel: [25792.592280] direct_page_fault+0x206/0x310 [kvm] Aug 22 12:33:38 juju-e4d256-prod-github-runner-207 kernel: [25792.593308] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 12:33:38 juju-e4d256-prod-github-runner-207 kernel: [25792.594320] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 12:33:38 juju-e4d256-prod-github-runner-207 kernel: [25792.595342] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 12:33:38 juju-e4d256-prod-github-runner-207 kernel: [25792.596315] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 12:33:38 juju-e4d256-prod-github-runner-207 kernel: [25792.597282] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 12:33:38 juju-e4d256-prod-github-runner-207 kernel: [25792.598266] handle_exit+0x98/0x230 [kvm_amd] Aug 22 12:33:38 juju-e4d256-prod-github-runner-207 kernel: [25792.599180] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 12:33:38 juju-e4d256-prod-github-runner-207 kernel: [25792.600098] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 12:33:38 juju-e4d256-prod-github-runner-207 kernel: [25792.601031] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 12:33:38 juju-e4d256-prod-github-runner-207 kernel: [25792.601947] vcpu_run+0x62/0x2c0 [kvm] Aug 22 12:33:38 juju-e4d256-prod-github-runner-207 kernel: [25792.602817] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 12:33:38 juju-e4d256-prod-github-runner-207 kernel: [25792.603629] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 12:33:38 juju-e4d256-prod-github-runner-207 kernel: [25792.604490] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 12:33:38 juju-e4d256-prod-github-runner-207 kernel: [25792.605289] ? __seccomp_filter+0x4a/0x4a0 Aug 22 12:33:38 juju-e4d256-prod-github-runner-207 kernel: [25792.606032] ? __fget_files+0x86/0xc0 Aug 22 12:33:38 juju-e4d256-prod-github-runner-207 kernel: [25792.606764] __x64_sys_ioctl+0x95/0xd0 Aug 22 12:33:38 juju-e4d256-prod-github-runner-207 kernel: [25792.607464] do_syscall_64+0x5c/0xc0 Aug 22 12:33:38 juju-e4d256-prod-github-runner-207 kernel: [25792.608130] ? do_futex+0x162/0x1f0 Aug 22 12:33:38 juju-e4d256-prod-github-runner-207 kernel: [25792.608780] ? __x64_sys_futex+0x78/0x1e0 Aug 22 12:33:38 juju-e4d256-prod-github-runner-207 kernel: [25792.609455] ? __secure_computing+0xa9/0x120 Aug 22 12:33:38 juju-e4d256-prod-github-runner-207 kernel: [25792.610148] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 12:33:38 juju-e4d256-prod-github-runner-207 kernel: [25792.610935] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:33:38 juju-e4d256-prod-github-runner-207 kernel: [25792.611663] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:33:38 juju-e4d256-prod-github-runner-207 kernel: [25792.612430] ? do_syscall_64+0x69/0xc0 Aug 22 12:33:38 juju-e4d256-prod-github-runner-207 kernel: [25792.613085] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:33:38 juju-e4d256-prod-github-runner-207 kernel: [25792.613799] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:33:38 juju-e4d256-prod-github-runner-207 kernel: [25792.614518] ? do_syscall_64+0x69/0xc0 Aug 22 12:33:38 juju-e4d256-prod-github-runner-207 kernel: [25792.615149] ? do_syscall_64+0x69/0xc0 Aug 22 12:33:38 juju-e4d256-prod-github-runner-207 kernel: [25792.615821] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 12:33:38 juju-e4d256-prod-github-runner-207 kernel: [25792.616543] RIP: 0033:0x7faa5d0edaff Aug 22 12:33:38 juju-e4d256-prod-github-runner-207 kernel: [25792.617172] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 12:33:38 juju-e4d256-prod-github-runner-207 kernel: [25792.619177] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 12:33:38 juju-e4d256-prod-github-runner-207 kernel: [25792.620095] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 12:33:38 juju-e4d256-prod-github-runner-207 kernel: [25792.620996] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 12:33:38 juju-e4d256-prod-github-runner-207 kernel: [25792.621890] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 12:33:38 juju-e4d256-prod-github-runner-207 kernel: [25792.622786] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 12:33:38 juju-e4d256-prod-github-runner-207 kernel: [25792.623684] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 12:33:38 juju-e4d256-prod-github-runner-207 kernel: [25792.624581] Aug 22 12:34:06 juju-e4d256-prod-github-runner-207 kernel: [25820.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 23939s! [qemu-system-x86:6715] Aug 22 12:34:06 juju-e4d256-prod-github-runner-207 kernel: [25820.543873] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 12:34:06 juju-e4d256-prod-github-runner-207 kernel: [25820.544183] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 12:34:06 juju-e4d256-prod-github-runner-207 kernel: [25820.556708] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 12:34:06 juju-e4d256-prod-github-runner-207 kernel: [25820.558000] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 12:34:06 juju-e4d256-prod-github-runner-207 kernel: [25820.559238] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:34:06 juju-e4d256-prod-github-runner-207 kernel: [25820.560302] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 12:34:06 juju-e4d256-prod-github-runner-207 kernel: [25820.562891] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 12:34:06 juju-e4d256-prod-github-runner-207 kernel: [25820.563939] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 12:34:06 juju-e4d256-prod-github-runner-207 kernel: [25820.565106] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 12:34:06 juju-e4d256-prod-github-runner-207 kernel: [25820.566311] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 12:34:06 juju-e4d256-prod-github-runner-207 kernel: [25820.567552] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 12:34:06 juju-e4d256-prod-github-runner-207 kernel: [25820.568721] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 12:34:06 juju-e4d256-prod-github-runner-207 kernel: [25820.569891] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 12:34:06 juju-e4d256-prod-github-runner-207 kernel: [25820.571176] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 12:34:06 juju-e4d256-prod-github-runner-207 kernel: [25820.572277] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 12:34:06 juju-e4d256-prod-github-runner-207 kernel: [25820.573528] Call Trace: Aug 22 12:34:06 juju-e4d256-prod-github-runner-207 kernel: [25820.574475] Aug 22 12:34:06 juju-e4d256-prod-github-runner-207 kernel: [25820.575401] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:34:06 juju-e4d256-prod-github-runner-207 kernel: [25820.576436] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:34:06 juju-e4d256-prod-github-runner-207 kernel: [25820.577460] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:34:06 juju-e4d256-prod-github-runner-207 kernel: [25820.578630] ? show_regs.part.0+0x23/0x29 Aug 22 12:34:06 juju-e4d256-prod-github-runner-207 kernel: [25820.579635] ? show_regs.cold+0x8/0xd Aug 22 12:34:06 juju-e4d256-prod-github-runner-207 kernel: [25820.580621] ? watchdog_timer_fn+0x1be/0x220 Aug 22 12:34:06 juju-e4d256-prod-github-runner-207 kernel: [25820.581629] ? lockup_detector_update_enable+0x60/0x60 Aug 22 12:34:06 juju-e4d256-prod-github-runner-207 kernel: [25820.582708] ? __hrtimer_run_queues+0x107/0x230 Aug 22 12:34:06 juju-e4d256-prod-github-runner-207 kernel: [25820.583754] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 12:34:06 juju-e4d256-prod-github-runner-207 kernel: [25820.584783] ? hrtimer_interrupt+0x101/0x220 Aug 22 12:34:06 juju-e4d256-prod-github-runner-207 kernel: [25820.585801] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 12:34:06 juju-e4d256-prod-github-runner-207 kernel: [25820.586897] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 12:34:06 juju-e4d256-prod-github-runner-207 kernel: [25820.587944] Aug 22 12:34:06 juju-e4d256-prod-github-runner-207 kernel: [25820.588804] Aug 22 12:34:06 juju-e4d256-prod-github-runner-207 kernel: [25820.589650] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 12:34:06 juju-e4d256-prod-github-runner-207 kernel: [25820.590748] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:34:06 juju-e4d256-prod-github-runner-207 kernel: [25820.591800] ? _raw_spin_lock+0x22/0x30 Aug 22 12:34:06 juju-e4d256-prod-github-runner-207 kernel: [25820.592750] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:34:06 juju-e4d256-prod-github-runner-207 kernel: [25820.593774] direct_page_fault+0x206/0x310 [kvm] Aug 22 12:34:06 juju-e4d256-prod-github-runner-207 kernel: [25820.594821] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 12:34:06 juju-e4d256-prod-github-runner-207 kernel: [25820.595830] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 12:34:06 juju-e4d256-prod-github-runner-207 kernel: [25820.596834] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 12:34:06 juju-e4d256-prod-github-runner-207 kernel: [25820.597847] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 12:34:06 juju-e4d256-prod-github-runner-207 kernel: [25820.598815] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 12:34:06 juju-e4d256-prod-github-runner-207 kernel: [25820.599795] handle_exit+0x98/0x230 [kvm_amd] Aug 22 12:34:06 juju-e4d256-prod-github-runner-207 kernel: [25820.600691] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 12:34:06 juju-e4d256-prod-github-runner-207 kernel: [25820.601610] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 12:34:06 juju-e4d256-prod-github-runner-207 kernel: [25820.602560] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 12:34:06 juju-e4d256-prod-github-runner-207 kernel: [25820.603464] vcpu_run+0x62/0x2c0 [kvm] Aug 22 12:34:06 juju-e4d256-prod-github-runner-207 kernel: [25820.604276] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 12:34:06 juju-e4d256-prod-github-runner-207 kernel: [25820.605088] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 12:34:06 juju-e4d256-prod-github-runner-207 kernel: [25820.605947] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 12:34:06 juju-e4d256-prod-github-runner-207 kernel: [25820.606775] ? __seccomp_filter+0x4a/0x4a0 Aug 22 12:34:06 juju-e4d256-prod-github-runner-207 kernel: [25820.607518] ? __fget_files+0x86/0xc0 Aug 22 12:34:06 juju-e4d256-prod-github-runner-207 kernel: [25820.608220] __x64_sys_ioctl+0x95/0xd0 Aug 22 12:34:06 juju-e4d256-prod-github-runner-207 kernel: [25820.608916] do_syscall_64+0x5c/0xc0 Aug 22 12:34:06 juju-e4d256-prod-github-runner-207 kernel: [25820.609582] ? do_futex+0x162/0x1f0 Aug 22 12:34:06 juju-e4d256-prod-github-runner-207 kernel: [25820.610243] ? __x64_sys_futex+0x78/0x1e0 Aug 22 12:34:06 juju-e4d256-prod-github-runner-207 kernel: [25820.610916] ? __secure_computing+0xa9/0x120 Aug 22 12:34:06 juju-e4d256-prod-github-runner-207 kernel: [25820.611604] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 12:34:06 juju-e4d256-prod-github-runner-207 kernel: [25820.612376] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:34:06 juju-e4d256-prod-github-runner-207 kernel: [25820.613117] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:34:06 juju-e4d256-prod-github-runner-207 kernel: [25820.613840] ? do_syscall_64+0x69/0xc0 Aug 22 12:34:06 juju-e4d256-prod-github-runner-207 kernel: [25820.614516] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:34:06 juju-e4d256-prod-github-runner-207 kernel: [25820.615260] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:34:06 juju-e4d256-prod-github-runner-207 kernel: [25820.616010] ? do_syscall_64+0x69/0xc0 Aug 22 12:34:06 juju-e4d256-prod-github-runner-207 kernel: [25820.616661] ? do_syscall_64+0x69/0xc0 Aug 22 12:34:06 juju-e4d256-prod-github-runner-207 kernel: [25820.617303] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 12:34:06 juju-e4d256-prod-github-runner-207 kernel: [25820.618013] RIP: 0033:0x7faa5d0edaff Aug 22 12:34:06 juju-e4d256-prod-github-runner-207 kernel: [25820.618701] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 12:34:06 juju-e4d256-prod-github-runner-207 kernel: [25820.620682] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 12:34:06 juju-e4d256-prod-github-runner-207 kernel: [25820.621592] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 12:34:06 juju-e4d256-prod-github-runner-207 kernel: [25820.622519] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 12:34:06 juju-e4d256-prod-github-runner-207 kernel: [25820.623457] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 12:34:06 juju-e4d256-prod-github-runner-207 kernel: [25820.624380] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 12:34:06 juju-e4d256-prod-github-runner-207 kernel: [25820.625505] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 12:34:06 juju-e4d256-prod-github-runner-207 kernel: [25820.626437] Aug 22 12:34:34 juju-e4d256-prod-github-runner-207 kernel: [25848.541980] watchdog: BUG: soft lockup - CPU#1 stuck for 23965s! [qemu-system-x86:6715] Aug 22 12:34:34 juju-e4d256-prod-github-runner-207 kernel: [25848.543122] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 12:34:34 juju-e4d256-prod-github-runner-207 kernel: [25848.543194] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 12:34:34 juju-e4d256-prod-github-runner-207 kernel: [25848.555503] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 12:34:34 juju-e4d256-prod-github-runner-207 kernel: [25848.556784] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 12:34:34 juju-e4d256-prod-github-runner-207 kernel: [25848.558028] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:34:34 juju-e4d256-prod-github-runner-207 kernel: [25848.559125] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 12:34:34 juju-e4d256-prod-github-runner-207 kernel: [25848.561761] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 12:34:34 juju-e4d256-prod-github-runner-207 kernel: [25848.562828] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 12:34:34 juju-e4d256-prod-github-runner-207 kernel: [25848.564025] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 12:34:34 juju-e4d256-prod-github-runner-207 kernel: [25848.565237] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 12:34:34 juju-e4d256-prod-github-runner-207 kernel: [25848.566451] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 12:34:34 juju-e4d256-prod-github-runner-207 kernel: [25848.567638] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 12:34:34 juju-e4d256-prod-github-runner-207 kernel: [25848.568825] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 12:34:34 juju-e4d256-prod-github-runner-207 kernel: [25848.570255] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 12:34:34 juju-e4d256-prod-github-runner-207 kernel: [25848.571377] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 12:34:34 juju-e4d256-prod-github-runner-207 kernel: [25848.572628] Call Trace: Aug 22 12:34:34 juju-e4d256-prod-github-runner-207 kernel: [25848.573622] Aug 22 12:34:34 juju-e4d256-prod-github-runner-207 kernel: [25848.574556] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:34:34 juju-e4d256-prod-github-runner-207 kernel: [25848.575650] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:34:34 juju-e4d256-prod-github-runner-207 kernel: [25848.576686] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:34:34 juju-e4d256-prod-github-runner-207 kernel: [25848.577796] ? show_regs.part.0+0x23/0x29 Aug 22 12:34:34 juju-e4d256-prod-github-runner-207 kernel: [25848.578794] ? show_regs.cold+0x8/0xd Aug 22 12:34:34 juju-e4d256-prod-github-runner-207 kernel: [25848.579796] ? watchdog_timer_fn+0x1be/0x220 Aug 22 12:34:34 juju-e4d256-prod-github-runner-207 kernel: [25848.580876] ? lockup_detector_update_enable+0x60/0x60 Aug 22 12:34:34 juju-e4d256-prod-github-runner-207 kernel: [25848.581990] ? __hrtimer_run_queues+0x107/0x230 Aug 22 12:34:34 juju-e4d256-prod-github-runner-207 kernel: [25848.583041] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 12:34:34 juju-e4d256-prod-github-runner-207 kernel: [25848.584069] ? hrtimer_interrupt+0x101/0x220 Aug 22 12:34:34 juju-e4d256-prod-github-runner-207 kernel: [25848.585118] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 12:34:34 juju-e4d256-prod-github-runner-207 kernel: [25848.586268] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 12:34:34 juju-e4d256-prod-github-runner-207 kernel: [25848.587335] Aug 22 12:34:34 juju-e4d256-prod-github-runner-207 kernel: [25848.588196] Aug 22 12:34:34 juju-e4d256-prod-github-runner-207 kernel: [25848.589039] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 12:34:34 juju-e4d256-prod-github-runner-207 kernel: [25848.590123] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:34:34 juju-e4d256-prod-github-runner-207 kernel: [25848.591245] ? _raw_spin_lock+0x22/0x30 Aug 22 12:34:34 juju-e4d256-prod-github-runner-207 kernel: [25848.592206] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:34:34 juju-e4d256-prod-github-runner-207 kernel: [25848.593231] direct_page_fault+0x206/0x310 [kvm] Aug 22 12:34:34 juju-e4d256-prod-github-runner-207 kernel: [25848.594278] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 12:34:34 juju-e4d256-prod-github-runner-207 kernel: [25848.595320] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 12:34:34 juju-e4d256-prod-github-runner-207 kernel: [25848.596375] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 12:34:34 juju-e4d256-prod-github-runner-207 kernel: [25848.597362] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 12:34:34 juju-e4d256-prod-github-runner-207 kernel: [25848.598383] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 12:34:34 juju-e4d256-prod-github-runner-207 kernel: [25848.599367] handle_exit+0x98/0x230 [kvm_amd] Aug 22 12:34:34 juju-e4d256-prod-github-runner-207 kernel: [25848.600351] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 12:34:34 juju-e4d256-prod-github-runner-207 kernel: [25848.601360] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 12:34:34 juju-e4d256-prod-github-runner-207 kernel: [25848.602326] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 12:34:34 juju-e4d256-prod-github-runner-207 kernel: [25848.603284] vcpu_run+0x62/0x2c0 [kvm] Aug 22 12:34:34 juju-e4d256-prod-github-runner-207 kernel: [25848.604104] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 12:34:34 juju-e4d256-prod-github-runner-207 kernel: [25848.604913] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 12:34:34 juju-e4d256-prod-github-runner-207 kernel: [25848.605834] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 12:34:34 juju-e4d256-prod-github-runner-207 kernel: [25848.606680] ? __seccomp_filter+0x4a/0x4a0 Aug 22 12:34:34 juju-e4d256-prod-github-runner-207 kernel: [25848.607437] ? __fget_files+0x86/0xc0 Aug 22 12:34:34 juju-e4d256-prod-github-runner-207 kernel: [25848.608178] __x64_sys_ioctl+0x95/0xd0 Aug 22 12:34:34 juju-e4d256-prod-github-runner-207 kernel: [25848.608877] do_syscall_64+0x5c/0xc0 Aug 22 12:34:34 juju-e4d256-prod-github-runner-207 kernel: [25848.609541] ? do_futex+0x162/0x1f0 Aug 22 12:34:34 juju-e4d256-prod-github-runner-207 kernel: [25848.610241] ? __x64_sys_futex+0x78/0x1e0 Aug 22 12:34:34 juju-e4d256-prod-github-runner-207 kernel: [25848.610956] ? __secure_computing+0xa9/0x120 Aug 22 12:34:34 juju-e4d256-prod-github-runner-207 kernel: [25848.611709] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 12:34:34 juju-e4d256-prod-github-runner-207 kernel: [25848.612482] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:34:34 juju-e4d256-prod-github-runner-207 kernel: [25848.613207] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:34:34 juju-e4d256-prod-github-runner-207 kernel: [25848.613936] ? do_syscall_64+0x69/0xc0 Aug 22 12:34:34 juju-e4d256-prod-github-runner-207 kernel: [25848.614582] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:34:34 juju-e4d256-prod-github-runner-207 kernel: [25848.615285] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:34:34 juju-e4d256-prod-github-runner-207 kernel: [25848.616026] ? do_syscall_64+0x69/0xc0 Aug 22 12:34:34 juju-e4d256-prod-github-runner-207 kernel: [25848.616679] ? do_syscall_64+0x69/0xc0 Aug 22 12:34:34 juju-e4d256-prod-github-runner-207 kernel: [25848.617326] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 12:34:34 juju-e4d256-prod-github-runner-207 kernel: [25848.618052] RIP: 0033:0x7faa5d0edaff Aug 22 12:34:34 juju-e4d256-prod-github-runner-207 kernel: [25848.618700] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 12:34:34 juju-e4d256-prod-github-runner-207 kernel: [25848.620729] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 12:34:34 juju-e4d256-prod-github-runner-207 kernel: [25848.621695] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 12:34:34 juju-e4d256-prod-github-runner-207 kernel: [25848.622659] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 12:34:34 juju-e4d256-prod-github-runner-207 kernel: [25848.623562] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 12:34:34 juju-e4d256-prod-github-runner-207 kernel: [25848.624449] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 12:34:34 juju-e4d256-prod-github-runner-207 kernel: [25848.625351] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 12:34:34 juju-e4d256-prod-github-runner-207 kernel: [25848.626303] Aug 22 12:35:02 juju-e4d256-prod-github-runner-207 kernel: [25876.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 23991s! [qemu-system-x86:6715] Aug 22 12:35:02 juju-e4d256-prod-github-runner-207 kernel: [25876.543111] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 12:35:02 juju-e4d256-prod-github-runner-207 kernel: [25876.543179] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 12:35:02 juju-e4d256-prod-github-runner-207 kernel: [25876.555334] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 12:35:02 juju-e4d256-prod-github-runner-207 kernel: [25876.556608] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 12:35:02 juju-e4d256-prod-github-runner-207 kernel: [25876.557854] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:35:02 juju-e4d256-prod-github-runner-207 kernel: [25876.558927] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 12:35:02 juju-e4d256-prod-github-runner-207 kernel: [25876.561707] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 12:35:02 juju-e4d256-prod-github-runner-207 kernel: [25876.562774] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 12:35:02 juju-e4d256-prod-github-runner-207 kernel: [25876.563983] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 12:35:02 juju-e4d256-prod-github-runner-207 kernel: [25876.565219] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 12:35:02 juju-e4d256-prod-github-runner-207 kernel: [25876.566508] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 12:35:02 juju-e4d256-prod-github-runner-207 kernel: [25876.567690] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 12:35:02 juju-e4d256-prod-github-runner-207 kernel: [25876.568927] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 12:35:02 juju-e4d256-prod-github-runner-207 kernel: [25876.570273] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 12:35:02 juju-e4d256-prod-github-runner-207 kernel: [25876.571394] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 12:35:02 juju-e4d256-prod-github-runner-207 kernel: [25876.572605] Call Trace: Aug 22 12:35:02 juju-e4d256-prod-github-runner-207 kernel: [25876.573558] Aug 22 12:35:02 juju-e4d256-prod-github-runner-207 kernel: [25876.574481] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:35:02 juju-e4d256-prod-github-runner-207 kernel: [25876.575560] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:35:02 juju-e4d256-prod-github-runner-207 kernel: [25876.576596] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:35:02 juju-e4d256-prod-github-runner-207 kernel: [25876.577695] ? show_regs.part.0+0x23/0x29 Aug 22 12:35:02 juju-e4d256-prod-github-runner-207 kernel: [25876.578696] ? show_regs.cold+0x8/0xd Aug 22 12:35:02 juju-e4d256-prod-github-runner-207 kernel: [25876.579681] ? watchdog_timer_fn+0x1be/0x220 Aug 22 12:35:02 juju-e4d256-prod-github-runner-207 kernel: [25876.580715] ? lockup_detector_update_enable+0x60/0x60 Aug 22 12:35:02 juju-e4d256-prod-github-runner-207 kernel: [25876.581821] ? __hrtimer_run_queues+0x107/0x230 Aug 22 12:35:02 juju-e4d256-prod-github-runner-207 kernel: [25876.582866] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 12:35:02 juju-e4d256-prod-github-runner-207 kernel: [25876.583937] ? hrtimer_interrupt+0x101/0x220 Aug 22 12:35:02 juju-e4d256-prod-github-runner-207 kernel: [25876.585086] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 12:35:02 juju-e4d256-prod-github-runner-207 kernel: [25876.586241] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 12:35:02 juju-e4d256-prod-github-runner-207 kernel: [25876.587318] Aug 22 12:35:02 juju-e4d256-prod-github-runner-207 kernel: [25876.588177] Aug 22 12:35:02 juju-e4d256-prod-github-runner-207 kernel: [25876.589037] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 12:35:02 juju-e4d256-prod-github-runner-207 kernel: [25876.590283] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:35:02 juju-e4d256-prod-github-runner-207 kernel: [25876.591401] ? _raw_spin_lock+0x22/0x30 Aug 22 12:35:02 juju-e4d256-prod-github-runner-207 kernel: [25876.592369] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:35:02 juju-e4d256-prod-github-runner-207 kernel: [25876.593432] direct_page_fault+0x206/0x310 [kvm] Aug 22 12:35:02 juju-e4d256-prod-github-runner-207 kernel: [25876.594489] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 12:35:02 juju-e4d256-prod-github-runner-207 kernel: [25876.595534] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 12:35:02 juju-e4d256-prod-github-runner-207 kernel: [25876.596604] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 12:35:02 juju-e4d256-prod-github-runner-207 kernel: [25876.597613] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 12:35:02 juju-e4d256-prod-github-runner-207 kernel: [25876.598579] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 12:35:02 juju-e4d256-prod-github-runner-207 kernel: [25876.599653] handle_exit+0x98/0x230 [kvm_amd] Aug 22 12:35:02 juju-e4d256-prod-github-runner-207 kernel: [25876.600576] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 12:35:02 juju-e4d256-prod-github-runner-207 kernel: [25876.601545] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 12:35:02 juju-e4d256-prod-github-runner-207 kernel: [25876.602534] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 12:35:02 juju-e4d256-prod-github-runner-207 kernel: [25876.603467] vcpu_run+0x62/0x2c0 [kvm] Aug 22 12:35:02 juju-e4d256-prod-github-runner-207 kernel: [25876.604294] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 12:35:02 juju-e4d256-prod-github-runner-207 kernel: [25876.605108] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 12:35:02 juju-e4d256-prod-github-runner-207 kernel: [25876.605994] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 12:35:02 juju-e4d256-prod-github-runner-207 kernel: [25876.606834] ? __seccomp_filter+0x4a/0x4a0 Aug 22 12:35:02 juju-e4d256-prod-github-runner-207 kernel: [25876.607587] ? __fget_files+0x86/0xc0 Aug 22 12:35:02 juju-e4d256-prod-github-runner-207 kernel: [25876.608355] __x64_sys_ioctl+0x95/0xd0 Aug 22 12:35:02 juju-e4d256-prod-github-runner-207 kernel: [25876.609180] do_syscall_64+0x5c/0xc0 Aug 22 12:35:02 juju-e4d256-prod-github-runner-207 kernel: [25876.609913] ? do_futex+0x162/0x1f0 Aug 22 12:35:02 juju-e4d256-prod-github-runner-207 kernel: [25876.610607] ? __x64_sys_futex+0x78/0x1e0 Aug 22 12:35:02 juju-e4d256-prod-github-runner-207 kernel: [25876.611305] ? __secure_computing+0xa9/0x120 Aug 22 12:35:02 juju-e4d256-prod-github-runner-207 kernel: [25876.612025] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 12:35:02 juju-e4d256-prod-github-runner-207 kernel: [25876.612791] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:35:02 juju-e4d256-prod-github-runner-207 kernel: [25876.613537] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:35:02 juju-e4d256-prod-github-runner-207 kernel: [25876.614262] ? do_syscall_64+0x69/0xc0 Aug 22 12:35:02 juju-e4d256-prod-github-runner-207 kernel: [25876.614909] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:35:02 juju-e4d256-prod-github-runner-207 kernel: [25876.615614] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:35:02 juju-e4d256-prod-github-runner-207 kernel: [25876.616321] ? do_syscall_64+0x69/0xc0 Aug 22 12:35:02 juju-e4d256-prod-github-runner-207 kernel: [25876.616988] ? do_syscall_64+0x69/0xc0 Aug 22 12:35:02 juju-e4d256-prod-github-runner-207 kernel: [25876.617669] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 12:35:02 juju-e4d256-prod-github-runner-207 kernel: [25876.618386] RIP: 0033:0x7faa5d0edaff Aug 22 12:35:02 juju-e4d256-prod-github-runner-207 kernel: [25876.619015] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 12:35:02 juju-e4d256-prod-github-runner-207 kernel: [25876.621209] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 12:35:02 juju-e4d256-prod-github-runner-207 kernel: [25876.622208] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 12:35:02 juju-e4d256-prod-github-runner-207 kernel: [25876.623158] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 12:35:02 juju-e4d256-prod-github-runner-207 kernel: [25876.624099] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 12:35:02 juju-e4d256-prod-github-runner-207 kernel: [25876.624993] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 12:35:02 juju-e4d256-prod-github-runner-207 kernel: [25876.625937] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 12:35:02 juju-e4d256-prod-github-runner-207 kernel: [25876.626882] Aug 22 12:35:30 juju-e4d256-prod-github-runner-207 kernel: [25904.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 24017s! [qemu-system-x86:6715] Aug 22 12:35:30 juju-e4d256-prod-github-runner-207 kernel: [25904.543130] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 12:35:30 juju-e4d256-prod-github-runner-207 kernel: [25904.543202] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 12:35:30 juju-e4d256-prod-github-runner-207 kernel: [25904.555662] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 12:35:30 juju-e4d256-prod-github-runner-207 kernel: [25904.556932] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 12:35:30 juju-e4d256-prod-github-runner-207 kernel: [25904.558201] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:35:30 juju-e4d256-prod-github-runner-207 kernel: [25904.559280] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 12:35:30 juju-e4d256-prod-github-runner-207 kernel: [25904.561901] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 12:35:30 juju-e4d256-prod-github-runner-207 kernel: [25904.562968] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 12:35:30 juju-e4d256-prod-github-runner-207 kernel: [25904.564138] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 12:35:30 juju-e4d256-prod-github-runner-207 kernel: [25904.565365] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 12:35:30 juju-e4d256-prod-github-runner-207 kernel: [25904.566549] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 12:35:30 juju-e4d256-prod-github-runner-207 kernel: [25904.567746] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 12:35:30 juju-e4d256-prod-github-runner-207 kernel: [25904.568928] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 12:35:30 juju-e4d256-prod-github-runner-207 kernel: [25904.570189] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 12:35:30 juju-e4d256-prod-github-runner-207 kernel: [25904.571312] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 12:35:30 juju-e4d256-prod-github-runner-207 kernel: [25904.572520] Call Trace: Aug 22 12:35:30 juju-e4d256-prod-github-runner-207 kernel: [25904.573459] Aug 22 12:35:30 juju-e4d256-prod-github-runner-207 kernel: [25904.574351] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:35:30 juju-e4d256-prod-github-runner-207 kernel: [25904.575384] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:35:30 juju-e4d256-prod-github-runner-207 kernel: [25904.576407] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:35:30 juju-e4d256-prod-github-runner-207 kernel: [25904.577547] ? show_regs.part.0+0x23/0x29 Aug 22 12:35:30 juju-e4d256-prod-github-runner-207 kernel: [25904.578554] ? show_regs.cold+0x8/0xd Aug 22 12:35:30 juju-e4d256-prod-github-runner-207 kernel: [25904.579528] ? watchdog_timer_fn+0x1be/0x220 Aug 22 12:35:30 juju-e4d256-prod-github-runner-207 kernel: [25904.580558] ? lockup_detector_update_enable+0x60/0x60 Aug 22 12:35:30 juju-e4d256-prod-github-runner-207 kernel: [25904.581679] ? __hrtimer_run_queues+0x107/0x230 Aug 22 12:35:30 juju-e4d256-prod-github-runner-207 kernel: [25904.582717] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 12:35:30 juju-e4d256-prod-github-runner-207 kernel: [25904.583748] ? hrtimer_interrupt+0x101/0x220 Aug 22 12:35:30 juju-e4d256-prod-github-runner-207 kernel: [25904.584770] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 12:35:30 juju-e4d256-prod-github-runner-207 kernel: [25904.585862] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 12:35:30 juju-e4d256-prod-github-runner-207 kernel: [25904.586913] Aug 22 12:35:30 juju-e4d256-prod-github-runner-207 kernel: [25904.587779] Aug 22 12:35:30 juju-e4d256-prod-github-runner-207 kernel: [25904.588624] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 12:35:30 juju-e4d256-prod-github-runner-207 kernel: [25904.589689] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:35:30 juju-e4d256-prod-github-runner-207 kernel: [25904.590772] ? _raw_spin_lock+0x22/0x30 Aug 22 12:35:30 juju-e4d256-prod-github-runner-207 kernel: [25904.591735] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:35:30 juju-e4d256-prod-github-runner-207 kernel: [25904.592822] direct_page_fault+0x206/0x310 [kvm] Aug 22 12:35:30 juju-e4d256-prod-github-runner-207 kernel: [25904.593894] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 12:35:30 juju-e4d256-prod-github-runner-207 kernel: [25904.594960] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 12:35:30 juju-e4d256-prod-github-runner-207 kernel: [25904.595972] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 12:35:30 juju-e4d256-prod-github-runner-207 kernel: [25904.596952] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 12:35:30 juju-e4d256-prod-github-runner-207 kernel: [25904.597922] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 12:35:30 juju-e4d256-prod-github-runner-207 kernel: [25904.598923] handle_exit+0x98/0x230 [kvm_amd] Aug 22 12:35:30 juju-e4d256-prod-github-runner-207 kernel: [25904.599823] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 12:35:30 juju-e4d256-prod-github-runner-207 kernel: [25904.600750] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 12:35:30 juju-e4d256-prod-github-runner-207 kernel: [25904.601712] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 12:35:30 juju-e4d256-prod-github-runner-207 kernel: [25904.602666] vcpu_run+0x62/0x2c0 [kvm] Aug 22 12:35:30 juju-e4d256-prod-github-runner-207 kernel: [25904.603491] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 12:35:30 juju-e4d256-prod-github-runner-207 kernel: [25904.604306] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 12:35:30 juju-e4d256-prod-github-runner-207 kernel: [25904.605187] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 12:35:30 juju-e4d256-prod-github-runner-207 kernel: [25904.605995] ? __seccomp_filter+0x4a/0x4a0 Aug 22 12:35:30 juju-e4d256-prod-github-runner-207 kernel: [25904.606772] ? __fget_files+0x86/0xc0 Aug 22 12:35:30 juju-e4d256-prod-github-runner-207 kernel: [25904.607494] __x64_sys_ioctl+0x95/0xd0 Aug 22 12:35:30 juju-e4d256-prod-github-runner-207 kernel: [25904.608190] do_syscall_64+0x5c/0xc0 Aug 22 12:35:30 juju-e4d256-prod-github-runner-207 kernel: [25904.608884] ? do_futex+0x162/0x1f0 Aug 22 12:35:30 juju-e4d256-prod-github-runner-207 kernel: [25904.609613] ? __x64_sys_futex+0x78/0x1e0 Aug 22 12:35:30 juju-e4d256-prod-github-runner-207 kernel: [25904.610299] ? __secure_computing+0xa9/0x120 Aug 22 12:35:30 juju-e4d256-prod-github-runner-207 kernel: [25904.610995] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 12:35:30 juju-e4d256-prod-github-runner-207 kernel: [25904.611770] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:35:30 juju-e4d256-prod-github-runner-207 kernel: [25904.612504] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:35:30 juju-e4d256-prod-github-runner-207 kernel: [25904.613255] ? do_syscall_64+0x69/0xc0 Aug 22 12:35:30 juju-e4d256-prod-github-runner-207 kernel: [25904.613912] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:35:30 juju-e4d256-prod-github-runner-207 kernel: [25904.614628] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:35:30 juju-e4d256-prod-github-runner-207 kernel: [25904.615330] ? do_syscall_64+0x69/0xc0 Aug 22 12:35:30 juju-e4d256-prod-github-runner-207 kernel: [25904.615963] ? do_syscall_64+0x69/0xc0 Aug 22 12:35:30 juju-e4d256-prod-github-runner-207 kernel: [25904.616588] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 12:35:30 juju-e4d256-prod-github-runner-207 kernel: [25904.617335] RIP: 0033:0x7faa5d0edaff Aug 22 12:35:30 juju-e4d256-prod-github-runner-207 kernel: [25904.617993] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 12:35:30 juju-e4d256-prod-github-runner-207 kernel: [25904.620021] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 12:35:30 juju-e4d256-prod-github-runner-207 kernel: [25904.620986] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 12:35:30 juju-e4d256-prod-github-runner-207 kernel: [25904.621925] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 12:35:30 juju-e4d256-prod-github-runner-207 kernel: [25904.622998] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 12:35:30 juju-e4d256-prod-github-runner-207 kernel: [25904.623895] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 12:35:30 juju-e4d256-prod-github-runner-207 kernel: [25904.624785] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 12:35:30 juju-e4d256-prod-github-runner-207 kernel: [25904.625882] Aug 22 12:35:45 juju-e4d256-prod-github-runner-207 kernel: [25918.916706] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 12:35:45 juju-e4d256-prod-github-runner-207 kernel: [25918.918373] rcu: 1-....: (6430314 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=3111137 Aug 22 12:35:45 juju-e4d256-prod-github-runner-207 kernel: [25918.919493] (t=6450429 jiffies g=23269 q=30416) Aug 22 12:35:45 juju-e4d256-prod-github-runner-207 kernel: [25918.920356] NMI backtrace for cpu 1 Aug 22 12:35:45 juju-e4d256-prod-github-runner-207 kernel: [25918.921085] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 12:35:45 juju-e4d256-prod-github-runner-207 kernel: [25918.922383] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 12:35:45 juju-e4d256-prod-github-runner-207 kernel: [25918.923442] Call Trace: Aug 22 12:35:45 juju-e4d256-prod-github-runner-207 kernel: [25918.924116] Aug 22 12:35:45 juju-e4d256-prod-github-runner-207 kernel: [25918.924771] show_stack+0x52/0x5c Aug 22 12:35:45 juju-e4d256-prod-github-runner-207 kernel: [25918.925515] dump_stack_lvl+0x4a/0x63 Aug 22 12:35:45 juju-e4d256-prod-github-runner-207 kernel: [25918.926257] dump_stack+0x10/0x16 Aug 22 12:35:45 juju-e4d256-prod-github-runner-207 kernel: [25918.926972] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 12:35:45 juju-e4d256-prod-github-runner-207 kernel: [25918.927750] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 12:35:45 juju-e4d256-prod-github-runner-207 kernel: [25918.928538] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 12:35:45 juju-e4d256-prod-github-runner-207 kernel: [25918.929365] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 12:35:45 juju-e4d256-prod-github-runner-207 kernel: [25918.930182] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 12:35:45 juju-e4d256-prod-github-runner-207 kernel: [25918.931004] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 12:35:45 juju-e4d256-prod-github-runner-207 kernel: [25918.931782] print_cpu_stall.cold+0x2f/0xe2 Aug 22 12:35:45 juju-e4d256-prod-github-runner-207 kernel: [25918.932554] ? timekeeping_update+0xf7/0x150 Aug 22 12:35:45 juju-e4d256-prod-github-runner-207 kernel: [25918.933365] check_cpu_stall+0x109/0x270 Aug 22 12:35:45 juju-e4d256-prod-github-runner-207 kernel: [25918.934117] rcu_sched_clock_irq+0x9a/0x250 Aug 22 12:35:45 juju-e4d256-prod-github-runner-207 kernel: [25918.934884] update_process_times+0x94/0xd0 Aug 22 12:35:45 juju-e4d256-prod-github-runner-207 kernel: [25918.935643] tick_sched_handle+0x29/0x70 Aug 22 12:35:45 juju-e4d256-prod-github-runner-207 kernel: [25918.936386] tick_sched_timer+0x8c/0xc0 Aug 22 12:35:45 juju-e4d256-prod-github-runner-207 kernel: [25918.937143] ? tick_nohz_handler+0xb0/0xb0 Aug 22 12:35:45 juju-e4d256-prod-github-runner-207 kernel: [25918.937946] __hrtimer_run_queues+0x107/0x230 Aug 22 12:35:45 juju-e4d256-prod-github-runner-207 kernel: [25918.938723] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 12:35:45 juju-e4d256-prod-github-runner-207 kernel: [25918.939509] hrtimer_interrupt+0x101/0x220 Aug 22 12:35:45 juju-e4d256-prod-github-runner-207 kernel: [25918.940272] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 12:35:45 juju-e4d256-prod-github-runner-207 kernel: [25918.941106] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 12:35:45 juju-e4d256-prod-github-runner-207 kernel: [25918.941911] Aug 22 12:35:45 juju-e4d256-prod-github-runner-207 kernel: [25918.942549] Aug 22 12:35:45 juju-e4d256-prod-github-runner-207 kernel: [25918.943178] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 12:35:45 juju-e4d256-prod-github-runner-207 kernel: [25918.944000] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:35:45 juju-e4d256-prod-github-runner-207 kernel: [25918.944902] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 12:35:45 juju-e4d256-prod-github-runner-207 kernel: [25918.947106] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 12:35:45 juju-e4d256-prod-github-runner-207 kernel: [25918.947978] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 12:35:45 juju-e4d256-prod-github-runner-207 kernel: [25918.948986] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 12:35:45 juju-e4d256-prod-github-runner-207 kernel: [25918.949968] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 12:35:45 juju-e4d256-prod-github-runner-207 kernel: [25918.950935] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 12:35:45 juju-e4d256-prod-github-runner-207 kernel: [25918.951888] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 12:35:45 juju-e4d256-prod-github-runner-207 kernel: [25918.952839] ? _raw_spin_lock+0x22/0x30 Aug 22 12:35:45 juju-e4d256-prod-github-runner-207 kernel: [25918.953679] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:35:45 juju-e4d256-prod-github-runner-207 kernel: [25918.954893] direct_page_fault+0x206/0x310 [kvm] Aug 22 12:35:45 juju-e4d256-prod-github-runner-207 kernel: [25918.955784] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 12:35:45 juju-e4d256-prod-github-runner-207 kernel: [25918.956707] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 12:35:45 juju-e4d256-prod-github-runner-207 kernel: [25918.957632] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 12:35:45 juju-e4d256-prod-github-runner-207 kernel: [25918.958526] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 12:35:45 juju-e4d256-prod-github-runner-207 kernel: [25918.959325] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 12:35:45 juju-e4d256-prod-github-runner-207 kernel: [25918.960168] handle_exit+0x98/0x230 [kvm_amd] Aug 22 12:35:45 juju-e4d256-prod-github-runner-207 kernel: [25918.960953] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 12:35:45 juju-e4d256-prod-github-runner-207 kernel: [25918.961751] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 12:35:45 juju-e4d256-prod-github-runner-207 kernel: [25918.962557] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 12:35:45 juju-e4d256-prod-github-runner-207 kernel: [25918.963345] vcpu_run+0x62/0x2c0 [kvm] Aug 22 12:35:45 juju-e4d256-prod-github-runner-207 kernel: [25918.964077] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 12:35:45 juju-e4d256-prod-github-runner-207 kernel: [25918.964817] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 12:35:45 juju-e4d256-prod-github-runner-207 kernel: [25918.965665] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 12:35:45 juju-e4d256-prod-github-runner-207 kernel: [25918.966427] ? __seccomp_filter+0x4a/0x4a0 Aug 22 12:35:45 juju-e4d256-prod-github-runner-207 kernel: [25918.967275] ? __fget_files+0x86/0xc0 Aug 22 12:35:45 juju-e4d256-prod-github-runner-207 kernel: [25918.967967] __x64_sys_ioctl+0x95/0xd0 Aug 22 12:35:45 juju-e4d256-prod-github-runner-207 kernel: [25918.968843] do_syscall_64+0x5c/0xc0 Aug 22 12:35:45 juju-e4d256-prod-github-runner-207 kernel: [25918.969544] ? do_futex+0x162/0x1f0 Aug 22 12:35:45 juju-e4d256-prod-github-runner-207 kernel: [25918.970416] ? __x64_sys_futex+0x78/0x1e0 Aug 22 12:35:45 juju-e4d256-prod-github-runner-207 kernel: [25918.971131] ? __secure_computing+0xa9/0x120 Aug 22 12:35:45 juju-e4d256-prod-github-runner-207 kernel: [25918.971863] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 12:35:45 juju-e4d256-prod-github-runner-207 kernel: [25918.972675] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:35:45 juju-e4d256-prod-github-runner-207 kernel: [25918.973449] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:35:45 juju-e4d256-prod-github-runner-207 kernel: [25918.974205] ? do_syscall_64+0x69/0xc0 Aug 22 12:35:45 juju-e4d256-prod-github-runner-207 kernel: [25918.974894] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:35:45 juju-e4d256-prod-github-runner-207 kernel: [25918.975663] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:35:45 juju-e4d256-prod-github-runner-207 kernel: [25918.976444] ? do_syscall_64+0x69/0xc0 Aug 22 12:35:45 juju-e4d256-prod-github-runner-207 kernel: [25918.977174] ? do_syscall_64+0x69/0xc0 Aug 22 12:35:45 juju-e4d256-prod-github-runner-207 kernel: [25918.977863] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 12:35:45 juju-e4d256-prod-github-runner-207 kernel: [25918.978634] RIP: 0033:0x7faa5d0edaff Aug 22 12:35:45 juju-e4d256-prod-github-runner-207 kernel: [25918.979345] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 12:35:45 juju-e4d256-prod-github-runner-207 kernel: [25918.981486] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 12:35:45 juju-e4d256-prod-github-runner-207 kernel: [25918.982456] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 12:35:45 juju-e4d256-prod-github-runner-207 kernel: [25918.983403] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 12:35:45 juju-e4d256-prod-github-runner-207 kernel: [25918.984352] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 12:35:45 juju-e4d256-prod-github-runner-207 kernel: [25918.985305] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 12:35:45 juju-e4d256-prod-github-runner-207 kernel: [25918.986241] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 12:35:45 juju-e4d256-prod-github-runner-207 kernel: [25918.987168] Aug 22 12:36:10 juju-e4d256-prod-github-runner-207 kernel: [25944.541980] watchdog: BUG: soft lockup - CPU#1 stuck for 24054s! [qemu-system-x86:6715] Aug 22 12:36:10 juju-e4d256-prod-github-runner-207 kernel: [25944.543115] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 12:36:10 juju-e4d256-prod-github-runner-207 kernel: [25944.543463] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 12:36:10 juju-e4d256-prod-github-runner-207 kernel: [25944.556176] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 12:36:10 juju-e4d256-prod-github-runner-207 kernel: [25944.557698] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 12:36:10 juju-e4d256-prod-github-runner-207 kernel: [25944.558916] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:36:10 juju-e4d256-prod-github-runner-207 kernel: [25944.559973] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 12:36:10 juju-e4d256-prod-github-runner-207 kernel: [25944.562611] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 12:36:10 juju-e4d256-prod-github-runner-207 kernel: [25944.563661] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 12:36:10 juju-e4d256-prod-github-runner-207 kernel: [25944.564869] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 12:36:10 juju-e4d256-prod-github-runner-207 kernel: [25944.566054] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 12:36:10 juju-e4d256-prod-github-runner-207 kernel: [25944.567249] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 12:36:10 juju-e4d256-prod-github-runner-207 kernel: [25944.568432] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 12:36:10 juju-e4d256-prod-github-runner-207 kernel: [25944.569646] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 12:36:10 juju-e4d256-prod-github-runner-207 kernel: [25944.570883] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 12:36:10 juju-e4d256-prod-github-runner-207 kernel: [25944.572037] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 12:36:10 juju-e4d256-prod-github-runner-207 kernel: [25944.573308] Call Trace: Aug 22 12:36:10 juju-e4d256-prod-github-runner-207 kernel: [25944.574268] Aug 22 12:36:10 juju-e4d256-prod-github-runner-207 kernel: [25944.575180] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:36:10 juju-e4d256-prod-github-runner-207 kernel: [25944.576225] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:36:10 juju-e4d256-prod-github-runner-207 kernel: [25944.577296] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:36:10 juju-e4d256-prod-github-runner-207 kernel: [25944.578443] ? show_regs.part.0+0x23/0x29 Aug 22 12:36:10 juju-e4d256-prod-github-runner-207 kernel: [25944.579456] ? show_regs.cold+0x8/0xd Aug 22 12:36:10 juju-e4d256-prod-github-runner-207 kernel: [25944.580434] ? watchdog_timer_fn+0x1be/0x220 Aug 22 12:36:10 juju-e4d256-prod-github-runner-207 kernel: [25944.581467] ? lockup_detector_update_enable+0x60/0x60 Aug 22 12:36:10 juju-e4d256-prod-github-runner-207 kernel: [25944.582565] ? __hrtimer_run_queues+0x107/0x230 Aug 22 12:36:10 juju-e4d256-prod-github-runner-207 kernel: [25944.583641] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 12:36:10 juju-e4d256-prod-github-runner-207 kernel: [25944.584693] ? hrtimer_interrupt+0x101/0x220 Aug 22 12:36:10 juju-e4d256-prod-github-runner-207 kernel: [25944.585714] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 12:36:10 juju-e4d256-prod-github-runner-207 kernel: [25944.586804] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 12:36:10 juju-e4d256-prod-github-runner-207 kernel: [25944.587880] Aug 22 12:36:10 juju-e4d256-prod-github-runner-207 kernel: [25944.589717] Aug 22 12:36:10 juju-e4d256-prod-github-runner-207 kernel: [25944.590582] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 12:36:10 juju-e4d256-prod-github-runner-207 kernel: [25944.591624] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:36:10 juju-e4d256-prod-github-runner-207 kernel: [25944.592816] ? _raw_spin_lock+0x22/0x30 Aug 22 12:36:10 juju-e4d256-prod-github-runner-207 kernel: [25944.593918] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:36:10 juju-e4d256-prod-github-runner-207 kernel: [25944.594979] direct_page_fault+0x206/0x310 [kvm] Aug 22 12:36:10 juju-e4d256-prod-github-runner-207 kernel: [25944.596010] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 12:36:10 juju-e4d256-prod-github-runner-207 kernel: [25944.597082] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 12:36:10 juju-e4d256-prod-github-runner-207 kernel: [25944.598117] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 12:36:10 juju-e4d256-prod-github-runner-207 kernel: [25944.599128] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 12:36:10 juju-e4d256-prod-github-runner-207 kernel: [25944.600078] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 12:36:10 juju-e4d256-prod-github-runner-207 kernel: [25944.601086] handle_exit+0x98/0x230 [kvm_amd] Aug 22 12:36:10 juju-e4d256-prod-github-runner-207 kernel: [25944.601987] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 12:36:10 juju-e4d256-prod-github-runner-207 kernel: [25944.602968] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 12:36:10 juju-e4d256-prod-github-runner-207 kernel: [25944.603953] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 12:36:10 juju-e4d256-prod-github-runner-207 kernel: [25944.604903] vcpu_run+0x62/0x2c0 [kvm] Aug 22 12:36:10 juju-e4d256-prod-github-runner-207 kernel: [25944.605720] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 12:36:10 juju-e4d256-prod-github-runner-207 kernel: [25944.606541] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 12:36:10 juju-e4d256-prod-github-runner-207 kernel: [25944.607448] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 12:36:10 juju-e4d256-prod-github-runner-207 kernel: [25944.608280] ? __seccomp_filter+0x4a/0x4a0 Aug 22 12:36:10 juju-e4d256-prod-github-runner-207 kernel: [25944.609098] ? __fget_files+0x86/0xc0 Aug 22 12:36:10 juju-e4d256-prod-github-runner-207 kernel: [25944.609819] __x64_sys_ioctl+0x95/0xd0 Aug 22 12:36:10 juju-e4d256-prod-github-runner-207 kernel: [25944.610568] do_syscall_64+0x5c/0xc0 Aug 22 12:36:10 juju-e4d256-prod-github-runner-207 kernel: [25944.611271] ? do_futex+0x162/0x1f0 Aug 22 12:36:10 juju-e4d256-prod-github-runner-207 kernel: [25944.611921] ? __x64_sys_futex+0x78/0x1e0 Aug 22 12:36:10 juju-e4d256-prod-github-runner-207 kernel: [25944.612642] ? __secure_computing+0xa9/0x120 Aug 22 12:36:10 juju-e4d256-prod-github-runner-207 kernel: [25944.613353] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 12:36:10 juju-e4d256-prod-github-runner-207 kernel: [25944.614176] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:36:10 juju-e4d256-prod-github-runner-207 kernel: [25944.614911] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:36:10 juju-e4d256-prod-github-runner-207 kernel: [25944.615681] ? do_syscall_64+0x69/0xc0 Aug 22 12:36:10 juju-e4d256-prod-github-runner-207 kernel: [25944.616337] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:36:10 juju-e4d256-prod-github-runner-207 kernel: [25944.617064] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:36:10 juju-e4d256-prod-github-runner-207 kernel: [25944.617812] ? do_syscall_64+0x69/0xc0 Aug 22 12:36:10 juju-e4d256-prod-github-runner-207 kernel: [25944.618478] ? do_syscall_64+0x69/0xc0 Aug 22 12:36:10 juju-e4d256-prod-github-runner-207 kernel: [25944.619218] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 12:36:10 juju-e4d256-prod-github-runner-207 kernel: [25944.619974] RIP: 0033:0x7faa5d0edaff Aug 22 12:36:10 juju-e4d256-prod-github-runner-207 kernel: [25944.620674] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 12:36:10 juju-e4d256-prod-github-runner-207 kernel: [25944.622711] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 12:36:10 juju-e4d256-prod-github-runner-207 kernel: [25944.623765] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 12:36:10 juju-e4d256-prod-github-runner-207 kernel: [25944.624879] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 12:36:10 juju-e4d256-prod-github-runner-207 kernel: [25944.625980] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 12:36:10 juju-e4d256-prod-github-runner-207 kernel: [25944.627062] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 12:36:10 juju-e4d256-prod-github-runner-207 kernel: [25944.628084] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 12:36:10 juju-e4d256-prod-github-runner-207 kernel: [25944.629036] Aug 22 12:36:38 juju-e4d256-prod-github-runner-207 kernel: [25972.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 24080s! [qemu-system-x86:6715] Aug 22 12:36:38 juju-e4d256-prod-github-runner-207 kernel: [25972.543207] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 12:36:38 juju-e4d256-prod-github-runner-207 kernel: [25972.543293] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 12:36:38 juju-e4d256-prod-github-runner-207 kernel: [25972.556819] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 12:36:38 juju-e4d256-prod-github-runner-207 kernel: [25972.558110] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 12:36:38 juju-e4d256-prod-github-runner-207 kernel: [25972.559345] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:36:38 juju-e4d256-prod-github-runner-207 kernel: [25972.560435] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 12:36:38 juju-e4d256-prod-github-runner-207 kernel: [25972.563026] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 12:36:38 juju-e4d256-prod-github-runner-207 kernel: [25972.564083] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 12:36:38 juju-e4d256-prod-github-runner-207 kernel: [25972.565271] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 12:36:38 juju-e4d256-prod-github-runner-207 kernel: [25972.566473] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 12:36:38 juju-e4d256-prod-github-runner-207 kernel: [25972.567644] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 12:36:38 juju-e4d256-prod-github-runner-207 kernel: [25972.568831] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 12:36:38 juju-e4d256-prod-github-runner-207 kernel: [25972.570008] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 12:36:38 juju-e4d256-prod-github-runner-207 kernel: [25972.571265] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 12:36:38 juju-e4d256-prod-github-runner-207 kernel: [25972.572394] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 12:36:38 juju-e4d256-prod-github-runner-207 kernel: [25972.573659] Call Trace: Aug 22 12:36:38 juju-e4d256-prod-github-runner-207 kernel: [25972.574579] Aug 22 12:36:38 juju-e4d256-prod-github-runner-207 kernel: [25972.575467] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:36:38 juju-e4d256-prod-github-runner-207 kernel: [25972.576528] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:36:38 juju-e4d256-prod-github-runner-207 kernel: [25972.577560] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:36:38 juju-e4d256-prod-github-runner-207 kernel: [25972.578659] ? show_regs.part.0+0x23/0x29 Aug 22 12:36:38 juju-e4d256-prod-github-runner-207 kernel: [25972.579670] ? show_regs.cold+0x8/0xd Aug 22 12:36:38 juju-e4d256-prod-github-runner-207 kernel: [25972.580659] ? watchdog_timer_fn+0x1be/0x220 Aug 22 12:36:38 juju-e4d256-prod-github-runner-207 kernel: [25972.581679] ? lockup_detector_update_enable+0x60/0x60 Aug 22 12:36:38 juju-e4d256-prod-github-runner-207 kernel: [25972.582750] ? __hrtimer_run_queues+0x107/0x230 Aug 22 12:36:38 juju-e4d256-prod-github-runner-207 kernel: [25972.583785] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 12:36:38 juju-e4d256-prod-github-runner-207 kernel: [25972.584835] ? hrtimer_interrupt+0x101/0x220 Aug 22 12:36:38 juju-e4d256-prod-github-runner-207 kernel: [25972.585870] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 12:36:38 juju-e4d256-prod-github-runner-207 kernel: [25972.586952] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 12:36:38 juju-e4d256-prod-github-runner-207 kernel: [25972.588010] Aug 22 12:36:38 juju-e4d256-prod-github-runner-207 kernel: [25972.588879] Aug 22 12:36:38 juju-e4d256-prod-github-runner-207 kernel: [25972.589720] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 12:36:38 juju-e4d256-prod-github-runner-207 kernel: [25972.590762] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:36:38 juju-e4d256-prod-github-runner-207 kernel: [25972.591814] ? _raw_spin_lock+0x22/0x30 Aug 22 12:36:38 juju-e4d256-prod-github-runner-207 kernel: [25972.592795] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:36:38 juju-e4d256-prod-github-runner-207 kernel: [25972.593871] direct_page_fault+0x206/0x310 [kvm] Aug 22 12:36:38 juju-e4d256-prod-github-runner-207 kernel: [25972.594918] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 12:36:38 juju-e4d256-prod-github-runner-207 kernel: [25972.595940] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 12:36:38 juju-e4d256-prod-github-runner-207 kernel: [25972.597056] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 12:36:38 juju-e4d256-prod-github-runner-207 kernel: [25972.598045] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 12:36:38 juju-e4d256-prod-github-runner-207 kernel: [25972.599007] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 12:36:38 juju-e4d256-prod-github-runner-207 kernel: [25972.600000] handle_exit+0x98/0x230 [kvm_amd] Aug 22 12:36:38 juju-e4d256-prod-github-runner-207 kernel: [25972.600927] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 12:36:38 juju-e4d256-prod-github-runner-207 kernel: [25972.601849] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 12:36:38 juju-e4d256-prod-github-runner-207 kernel: [25972.602783] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 12:36:38 juju-e4d256-prod-github-runner-207 kernel: [25972.603695] vcpu_run+0x62/0x2c0 [kvm] Aug 22 12:36:38 juju-e4d256-prod-github-runner-207 kernel: [25972.604526] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 12:36:38 juju-e4d256-prod-github-runner-207 kernel: [25972.605385] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 12:36:38 juju-e4d256-prod-github-runner-207 kernel: [25972.606294] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 12:36:38 juju-e4d256-prod-github-runner-207 kernel: [25972.607161] ? __seccomp_filter+0x4a/0x4a0 Aug 22 12:36:38 juju-e4d256-prod-github-runner-207 kernel: [25972.607929] ? __fget_files+0x86/0xc0 Aug 22 12:36:38 juju-e4d256-prod-github-runner-207 kernel: [25972.608751] __x64_sys_ioctl+0x95/0xd0 Aug 22 12:36:38 juju-e4d256-prod-github-runner-207 kernel: [25972.609522] do_syscall_64+0x5c/0xc0 Aug 22 12:36:38 juju-e4d256-prod-github-runner-207 kernel: [25972.610228] ? do_futex+0x162/0x1f0 Aug 22 12:36:38 juju-e4d256-prod-github-runner-207 kernel: [25972.610980] ? __x64_sys_futex+0x78/0x1e0 Aug 22 12:36:38 juju-e4d256-prod-github-runner-207 kernel: [25972.611721] ? __secure_computing+0xa9/0x120 Aug 22 12:36:38 juju-e4d256-prod-github-runner-207 kernel: [25972.612494] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 12:36:38 juju-e4d256-prod-github-runner-207 kernel: [25972.613322] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:36:38 juju-e4d256-prod-github-runner-207 kernel: [25972.614116] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:36:38 juju-e4d256-prod-github-runner-207 kernel: [25972.614895] ? do_syscall_64+0x69/0xc0 Aug 22 12:36:38 juju-e4d256-prod-github-runner-207 kernel: [25972.615603] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:36:38 juju-e4d256-prod-github-runner-207 kernel: [25972.616413] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:36:38 juju-e4d256-prod-github-runner-207 kernel: [25972.617242] ? do_syscall_64+0x69/0xc0 Aug 22 12:36:38 juju-e4d256-prod-github-runner-207 kernel: [25972.617893] ? do_syscall_64+0x69/0xc0 Aug 22 12:36:38 juju-e4d256-prod-github-runner-207 kernel: [25972.618566] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 12:36:38 juju-e4d256-prod-github-runner-207 kernel: [25972.619327] RIP: 0033:0x7faa5d0edaff Aug 22 12:36:38 juju-e4d256-prod-github-runner-207 kernel: [25972.619995] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 12:36:38 juju-e4d256-prod-github-runner-207 kernel: [25972.622163] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 12:36:38 juju-e4d256-prod-github-runner-207 kernel: [25972.623142] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 12:36:38 juju-e4d256-prod-github-runner-207 kernel: [25972.624138] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 12:36:38 juju-e4d256-prod-github-runner-207 kernel: [25972.625092] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 12:36:38 juju-e4d256-prod-github-runner-207 kernel: [25972.626046] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 12:36:38 juju-e4d256-prod-github-runner-207 kernel: [25972.626995] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 12:36:38 juju-e4d256-prod-github-runner-207 kernel: [25972.627936] Aug 22 12:37:06 juju-e4d256-prod-github-runner-207 kernel: [26000.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 24106s! [qemu-system-x86:6715] Aug 22 12:37:06 juju-e4d256-prod-github-runner-207 kernel: [26000.543168] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 12:37:06 juju-e4d256-prod-github-runner-207 kernel: [26000.543240] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 12:37:06 juju-e4d256-prod-github-runner-207 kernel: [26000.555799] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 12:37:06 juju-e4d256-prod-github-runner-207 kernel: [26000.557182] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 12:37:06 juju-e4d256-prod-github-runner-207 kernel: [26000.558504] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:37:06 juju-e4d256-prod-github-runner-207 kernel: [26000.559649] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 12:37:06 juju-e4d256-prod-github-runner-207 kernel: [26000.562320] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 12:37:06 juju-e4d256-prod-github-runner-207 kernel: [26000.563374] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 12:37:06 juju-e4d256-prod-github-runner-207 kernel: [26000.564560] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 12:37:06 juju-e4d256-prod-github-runner-207 kernel: [26000.565718] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 12:37:06 juju-e4d256-prod-github-runner-207 kernel: [26000.566900] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 12:37:06 juju-e4d256-prod-github-runner-207 kernel: [26000.568105] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 12:37:06 juju-e4d256-prod-github-runner-207 kernel: [26000.569279] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 12:37:06 juju-e4d256-prod-github-runner-207 kernel: [26000.570542] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 12:37:06 juju-e4d256-prod-github-runner-207 kernel: [26000.571659] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 12:37:06 juju-e4d256-prod-github-runner-207 kernel: [26000.572894] Call Trace: Aug 22 12:37:06 juju-e4d256-prod-github-runner-207 kernel: [26000.573834] Aug 22 12:37:06 juju-e4d256-prod-github-runner-207 kernel: [26000.574733] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:37:06 juju-e4d256-prod-github-runner-207 kernel: [26000.575796] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:37:06 juju-e4d256-prod-github-runner-207 kernel: [26000.576877] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:37:06 juju-e4d256-prod-github-runner-207 kernel: [26000.577965] ? show_regs.part.0+0x23/0x29 Aug 22 12:37:06 juju-e4d256-prod-github-runner-207 kernel: [26000.578972] ? show_regs.cold+0x8/0xd Aug 22 12:37:06 juju-e4d256-prod-github-runner-207 kernel: [26000.580012] ? watchdog_timer_fn+0x1be/0x220 Aug 22 12:37:06 juju-e4d256-prod-github-runner-207 kernel: [26000.581159] ? lockup_detector_update_enable+0x60/0x60 Aug 22 12:37:06 juju-e4d256-prod-github-runner-207 kernel: [26000.582281] ? __hrtimer_run_queues+0x107/0x230 Aug 22 12:37:06 juju-e4d256-prod-github-runner-207 kernel: [26000.583366] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 12:37:06 juju-e4d256-prod-github-runner-207 kernel: [26000.584494] ? hrtimer_interrupt+0x101/0x220 Aug 22 12:37:06 juju-e4d256-prod-github-runner-207 kernel: [26000.585569] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 12:37:06 juju-e4d256-prod-github-runner-207 kernel: [26000.586718] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 12:37:06 juju-e4d256-prod-github-runner-207 kernel: [26000.587823] Aug 22 12:37:06 juju-e4d256-prod-github-runner-207 kernel: [26000.588833] Aug 22 12:37:06 juju-e4d256-prod-github-runner-207 kernel: [26000.589773] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 12:37:06 juju-e4d256-prod-github-runner-207 kernel: [26000.590885] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:37:06 juju-e4d256-prod-github-runner-207 kernel: [26000.591974] ? _raw_spin_lock+0x22/0x30 Aug 22 12:37:06 juju-e4d256-prod-github-runner-207 kernel: [26000.592996] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:37:06 juju-e4d256-prod-github-runner-207 kernel: [26000.594105] direct_page_fault+0x206/0x310 [kvm] Aug 22 12:37:06 juju-e4d256-prod-github-runner-207 kernel: [26000.595193] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 12:37:06 juju-e4d256-prod-github-runner-207 kernel: [26000.596248] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 12:37:06 juju-e4d256-prod-github-runner-207 kernel: [26000.597251] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 12:37:06 juju-e4d256-prod-github-runner-207 kernel: [26000.598220] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 12:37:06 juju-e4d256-prod-github-runner-207 kernel: [26000.599179] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 12:37:06 juju-e4d256-prod-github-runner-207 kernel: [26000.600169] handle_exit+0x98/0x230 [kvm_amd] Aug 22 12:37:06 juju-e4d256-prod-github-runner-207 kernel: [26000.601089] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 12:37:06 juju-e4d256-prod-github-runner-207 kernel: [26000.602025] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 12:37:06 juju-e4d256-prod-github-runner-207 kernel: [26000.602954] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 12:37:06 juju-e4d256-prod-github-runner-207 kernel: [26000.603857] vcpu_run+0x62/0x2c0 [kvm] Aug 22 12:37:06 juju-e4d256-prod-github-runner-207 kernel: [26000.604690] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 12:37:06 juju-e4d256-prod-github-runner-207 kernel: [26000.605533] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 12:37:06 juju-e4d256-prod-github-runner-207 kernel: [26000.606392] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 12:37:06 juju-e4d256-prod-github-runner-207 kernel: [26000.607197] ? __seccomp_filter+0x4a/0x4a0 Aug 22 12:37:06 juju-e4d256-prod-github-runner-207 kernel: [26000.607955] ? __fget_files+0x86/0xc0 Aug 22 12:37:06 juju-e4d256-prod-github-runner-207 kernel: [26000.608665] __x64_sys_ioctl+0x95/0xd0 Aug 22 12:37:06 juju-e4d256-prod-github-runner-207 kernel: [26000.609363] do_syscall_64+0x5c/0xc0 Aug 22 12:37:06 juju-e4d256-prod-github-runner-207 kernel: [26000.610027] ? do_futex+0x162/0x1f0 Aug 22 12:37:06 juju-e4d256-prod-github-runner-207 kernel: [26000.610679] ? __x64_sys_futex+0x78/0x1e0 Aug 22 12:37:06 juju-e4d256-prod-github-runner-207 kernel: [26000.611375] ? __secure_computing+0xa9/0x120 Aug 22 12:37:06 juju-e4d256-prod-github-runner-207 kernel: [26000.612109] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 12:37:06 juju-e4d256-prod-github-runner-207 kernel: [26000.612875] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:37:06 juju-e4d256-prod-github-runner-207 kernel: [26000.613594] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:37:06 juju-e4d256-prod-github-runner-207 kernel: [26000.614348] ? do_syscall_64+0x69/0xc0 Aug 22 12:37:06 juju-e4d256-prod-github-runner-207 kernel: [26000.615014] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:37:06 juju-e4d256-prod-github-runner-207 kernel: [26000.615739] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:37:06 juju-e4d256-prod-github-runner-207 kernel: [26000.616453] ? do_syscall_64+0x69/0xc0 Aug 22 12:37:06 juju-e4d256-prod-github-runner-207 kernel: [26000.617088] ? do_syscall_64+0x69/0xc0 Aug 22 12:37:06 juju-e4d256-prod-github-runner-207 kernel: [26000.617845] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 12:37:06 juju-e4d256-prod-github-runner-207 kernel: [26000.618567] RIP: 0033:0x7faa5d0edaff Aug 22 12:37:06 juju-e4d256-prod-github-runner-207 kernel: [26000.619228] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 12:37:06 juju-e4d256-prod-github-runner-207 kernel: [26000.621478] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 12:37:06 juju-e4d256-prod-github-runner-207 kernel: [26000.622535] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 12:37:06 juju-e4d256-prod-github-runner-207 kernel: [26000.623502] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 12:37:06 juju-e4d256-prod-github-runner-207 kernel: [26000.624431] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 12:37:06 juju-e4d256-prod-github-runner-207 kernel: [26000.625325] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 12:37:06 juju-e4d256-prod-github-runner-207 kernel: [26000.626212] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 12:37:06 juju-e4d256-prod-github-runner-207 kernel: [26000.627111] Aug 22 12:37:34 juju-e4d256-prod-github-runner-207 kernel: [26028.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 24132s! [qemu-system-x86:6715] Aug 22 12:37:34 juju-e4d256-prod-github-runner-207 kernel: [26028.543841] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 12:37:34 juju-e4d256-prod-github-runner-207 kernel: [26028.544132] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 12:37:34 juju-e4d256-prod-github-runner-207 kernel: [26028.556260] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 12:37:34 juju-e4d256-prod-github-runner-207 kernel: [26028.557523] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 12:37:34 juju-e4d256-prod-github-runner-207 kernel: [26028.558744] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:37:34 juju-e4d256-prod-github-runner-207 kernel: [26028.559823] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 12:37:34 juju-e4d256-prod-github-runner-207 kernel: [26028.562385] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 12:37:34 juju-e4d256-prod-github-runner-207 kernel: [26028.563457] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 12:37:34 juju-e4d256-prod-github-runner-207 kernel: [26028.564645] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 12:37:34 juju-e4d256-prod-github-runner-207 kernel: [26028.565807] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 12:37:34 juju-e4d256-prod-github-runner-207 kernel: [26028.566967] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 12:37:34 juju-e4d256-prod-github-runner-207 kernel: [26028.568164] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 12:37:34 juju-e4d256-prod-github-runner-207 kernel: [26028.569327] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 12:37:34 juju-e4d256-prod-github-runner-207 kernel: [26028.570556] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 12:37:34 juju-e4d256-prod-github-runner-207 kernel: [26028.571672] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 12:37:34 juju-e4d256-prod-github-runner-207 kernel: [26028.572867] Call Trace: Aug 22 12:37:34 juju-e4d256-prod-github-runner-207 kernel: [26028.573960] Aug 22 12:37:34 juju-e4d256-prod-github-runner-207 kernel: [26028.574859] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:37:34 juju-e4d256-prod-github-runner-207 kernel: [26028.575896] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:37:34 juju-e4d256-prod-github-runner-207 kernel: [26028.576924] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:37:34 juju-e4d256-prod-github-runner-207 kernel: [26028.578025] ? show_regs.part.0+0x23/0x29 Aug 22 12:37:34 juju-e4d256-prod-github-runner-207 kernel: [26028.579020] ? show_regs.cold+0x8/0xd Aug 22 12:37:34 juju-e4d256-prod-github-runner-207 kernel: [26028.580000] ? watchdog_timer_fn+0x1be/0x220 Aug 22 12:37:34 juju-e4d256-prod-github-runner-207 kernel: [26028.581006] ? lockup_detector_update_enable+0x60/0x60 Aug 22 12:37:34 juju-e4d256-prod-github-runner-207 kernel: [26028.582066] ? __hrtimer_run_queues+0x107/0x230 Aug 22 12:37:34 juju-e4d256-prod-github-runner-207 kernel: [26028.583162] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 12:37:34 juju-e4d256-prod-github-runner-207 kernel: [26028.584190] ? hrtimer_interrupt+0x101/0x220 Aug 22 12:37:34 juju-e4d256-prod-github-runner-207 kernel: [26028.585203] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 12:37:34 juju-e4d256-prod-github-runner-207 kernel: [26028.586273] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 12:37:34 juju-e4d256-prod-github-runner-207 kernel: [26028.587320] Aug 22 12:37:34 juju-e4d256-prod-github-runner-207 kernel: [26028.588184] Aug 22 12:37:34 juju-e4d256-prod-github-runner-207 kernel: [26028.589025] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 12:37:34 juju-e4d256-prod-github-runner-207 kernel: [26028.590054] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:37:34 juju-e4d256-prod-github-runner-207 kernel: [26028.591090] ? _raw_spin_lock+0x22/0x30 Aug 22 12:37:34 juju-e4d256-prod-github-runner-207 kernel: [26028.592061] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:37:34 juju-e4d256-prod-github-runner-207 kernel: [26028.593077] direct_page_fault+0x206/0x310 [kvm] Aug 22 12:37:34 juju-e4d256-prod-github-runner-207 kernel: [26028.594099] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 12:37:34 juju-e4d256-prod-github-runner-207 kernel: [26028.595106] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 12:37:34 juju-e4d256-prod-github-runner-207 kernel: [26028.596119] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 12:37:34 juju-e4d256-prod-github-runner-207 kernel: [26028.597130] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 12:37:34 juju-e4d256-prod-github-runner-207 kernel: [26028.598151] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 12:37:34 juju-e4d256-prod-github-runner-207 kernel: [26028.599140] handle_exit+0x98/0x230 [kvm_amd] Aug 22 12:37:34 juju-e4d256-prod-github-runner-207 kernel: [26028.600101] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 12:37:34 juju-e4d256-prod-github-runner-207 kernel: [26028.601025] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 12:37:34 juju-e4d256-prod-github-runner-207 kernel: [26028.601972] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 12:37:34 juju-e4d256-prod-github-runner-207 kernel: [26028.602886] vcpu_run+0x62/0x2c0 [kvm] Aug 22 12:37:34 juju-e4d256-prod-github-runner-207 kernel: [26028.603721] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 12:37:34 juju-e4d256-prod-github-runner-207 kernel: [26028.604562] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 12:37:34 juju-e4d256-prod-github-runner-207 kernel: [26028.605443] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 12:37:34 juju-e4d256-prod-github-runner-207 kernel: [26028.606255] ? __seccomp_filter+0x4a/0x4a0 Aug 22 12:37:34 juju-e4d256-prod-github-runner-207 kernel: [26028.606999] ? __fget_files+0x86/0xc0 Aug 22 12:37:34 juju-e4d256-prod-github-runner-207 kernel: [26028.607719] __x64_sys_ioctl+0x95/0xd0 Aug 22 12:37:34 juju-e4d256-prod-github-runner-207 kernel: [26028.608412] do_syscall_64+0x5c/0xc0 Aug 22 12:37:34 juju-e4d256-prod-github-runner-207 kernel: [26028.609086] ? do_futex+0x162/0x1f0 Aug 22 12:37:34 juju-e4d256-prod-github-runner-207 kernel: [26028.609736] ? __x64_sys_futex+0x78/0x1e0 Aug 22 12:37:34 juju-e4d256-prod-github-runner-207 kernel: [26028.610408] ? __secure_computing+0xa9/0x120 Aug 22 12:37:34 juju-e4d256-prod-github-runner-207 kernel: [26028.611104] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 12:37:34 juju-e4d256-prod-github-runner-207 kernel: [26028.611875] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:37:34 juju-e4d256-prod-github-runner-207 kernel: [26028.612597] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:37:34 juju-e4d256-prod-github-runner-207 kernel: [26028.613319] ? do_syscall_64+0x69/0xc0 Aug 22 12:37:34 juju-e4d256-prod-github-runner-207 kernel: [26028.613973] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:37:34 juju-e4d256-prod-github-runner-207 kernel: [26028.614688] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:37:34 juju-e4d256-prod-github-runner-207 kernel: [26028.615383] ? do_syscall_64+0x69/0xc0 Aug 22 12:37:34 juju-e4d256-prod-github-runner-207 kernel: [26028.616026] ? do_syscall_64+0x69/0xc0 Aug 22 12:37:34 juju-e4d256-prod-github-runner-207 kernel: [26028.616647] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 12:37:34 juju-e4d256-prod-github-runner-207 kernel: [26028.617351] RIP: 0033:0x7faa5d0edaff Aug 22 12:37:34 juju-e4d256-prod-github-runner-207 kernel: [26028.618020] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 12:37:34 juju-e4d256-prod-github-runner-207 kernel: [26028.620029] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 12:37:34 juju-e4d256-prod-github-runner-207 kernel: [26028.620952] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 12:37:34 juju-e4d256-prod-github-runner-207 kernel: [26028.621913] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 12:37:34 juju-e4d256-prod-github-runner-207 kernel: [26028.622813] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 12:37:34 juju-e4d256-prod-github-runner-207 kernel: [26028.623717] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 12:37:34 juju-e4d256-prod-github-runner-207 kernel: [26028.624628] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 12:37:34 juju-e4d256-prod-github-runner-207 kernel: [26028.625533] Aug 22 12:38:02 juju-e4d256-prod-github-runner-207 kernel: [26056.541981] watchdog: BUG: soft lockup - CPU#1 stuck for 24159s! [qemu-system-x86:6715] Aug 22 12:38:02 juju-e4d256-prod-github-runner-207 kernel: [26056.543101] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 12:38:02 juju-e4d256-prod-github-runner-207 kernel: [26056.543189] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 12:38:02 juju-e4d256-prod-github-runner-207 kernel: [26056.555313] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 12:38:02 juju-e4d256-prod-github-runner-207 kernel: [26056.556581] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 12:38:02 juju-e4d256-prod-github-runner-207 kernel: [26056.557814] RIP: 0010:native_queued_spin_lock_slowpath+0xc/0x40 Aug 22 12:38:02 juju-e4d256-prod-github-runner-207 kernel: [26056.558876] Code: fe ff ff eb af 4c 89 fe 48 c7 c7 20 99 e9 89 e8 ca 69 55 00 e9 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 <8b> 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 eb Aug 22 12:38:02 juju-e4d256-prod-github-runner-207 kernel: [26056.561441] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 12:38:02 juju-e4d256-prod-github-runner-207 kernel: [26056.562483] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 12:38:02 juju-e4d256-prod-github-runner-207 kernel: [26056.563658] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 12:38:02 juju-e4d256-prod-github-runner-207 kernel: [26056.564829] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 12:38:02 juju-e4d256-prod-github-runner-207 kernel: [26056.566006] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 12:38:02 juju-e4d256-prod-github-runner-207 kernel: [26056.567196] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 12:38:02 juju-e4d256-prod-github-runner-207 kernel: [26056.568370] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 12:38:02 juju-e4d256-prod-github-runner-207 kernel: [26056.569615] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 12:38:02 juju-e4d256-prod-github-runner-207 kernel: [26056.570719] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 12:38:02 juju-e4d256-prod-github-runner-207 kernel: [26056.571932] Call Trace: Aug 22 12:38:02 juju-e4d256-prod-github-runner-207 kernel: [26056.572849] Aug 22 12:38:02 juju-e4d256-prod-github-runner-207 kernel: [26056.573739] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:38:02 juju-e4d256-prod-github-runner-207 kernel: [26056.574772] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:38:02 juju-e4d256-prod-github-runner-207 kernel: [26056.575816] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:38:02 juju-e4d256-prod-github-runner-207 kernel: [26056.576896] ? show_regs.part.0+0x23/0x29 Aug 22 12:38:02 juju-e4d256-prod-github-runner-207 kernel: [26056.577900] ? show_regs.cold+0x8/0xd Aug 22 12:38:02 juju-e4d256-prod-github-runner-207 kernel: [26056.578879] ? watchdog_timer_fn+0x1be/0x220 Aug 22 12:38:02 juju-e4d256-prod-github-runner-207 kernel: [26056.579927] ? lockup_detector_update_enable+0x60/0x60 Aug 22 12:38:02 juju-e4d256-prod-github-runner-207 kernel: [26056.581039] ? __hrtimer_run_queues+0x107/0x230 Aug 22 12:38:02 juju-e4d256-prod-github-runner-207 kernel: [26056.582130] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 12:38:02 juju-e4d256-prod-github-runner-207 kernel: [26056.583164] ? hrtimer_interrupt+0x101/0x220 Aug 22 12:38:02 juju-e4d256-prod-github-runner-207 kernel: [26056.584298] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 12:38:02 juju-e4d256-prod-github-runner-207 kernel: [26056.585373] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 12:38:02 juju-e4d256-prod-github-runner-207 kernel: [26056.586440] Aug 22 12:38:02 juju-e4d256-prod-github-runner-207 kernel: [26056.587333] Aug 22 12:38:02 juju-e4d256-prod-github-runner-207 kernel: [26056.588177] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 12:38:02 juju-e4d256-prod-github-runner-207 kernel: [26056.589211] ? native_queued_spin_lock_slowpath+0xc/0x40 Aug 22 12:38:02 juju-e4d256-prod-github-runner-207 kernel: [26056.590284] ? _raw_spin_lock+0x22/0x30 Aug 22 12:38:02 juju-e4d256-prod-github-runner-207 kernel: [26056.591379] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:38:02 juju-e4d256-prod-github-runner-207 kernel: [26056.592475] direct_page_fault+0x206/0x310 [kvm] Aug 22 12:38:02 juju-e4d256-prod-github-runner-207 kernel: [26056.593543] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 12:38:02 juju-e4d256-prod-github-runner-207 kernel: [26056.594564] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 12:38:02 juju-e4d256-prod-github-runner-207 kernel: [26056.595596] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 12:38:02 juju-e4d256-prod-github-runner-207 kernel: [26056.596574] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 12:38:02 juju-e4d256-prod-github-runner-207 kernel: [26056.597520] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 12:38:02 juju-e4d256-prod-github-runner-207 kernel: [26056.598501] handle_exit+0x98/0x230 [kvm_amd] Aug 22 12:38:02 juju-e4d256-prod-github-runner-207 kernel: [26056.599406] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 12:38:02 juju-e4d256-prod-github-runner-207 kernel: [26056.600392] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 12:38:02 juju-e4d256-prod-github-runner-207 kernel: [26056.601374] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 12:38:02 juju-e4d256-prod-github-runner-207 kernel: [26056.602332] vcpu_run+0x62/0x2c0 [kvm] Aug 22 12:38:02 juju-e4d256-prod-github-runner-207 kernel: [26056.603160] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 12:38:02 juju-e4d256-prod-github-runner-207 kernel: [26056.604008] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 12:38:02 juju-e4d256-prod-github-runner-207 kernel: [26056.604870] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 12:38:02 juju-e4d256-prod-github-runner-207 kernel: [26056.605761] ? __seccomp_filter+0x4a/0x4a0 Aug 22 12:38:02 juju-e4d256-prod-github-runner-207 kernel: [26056.606533] ? __fget_files+0x86/0xc0 Aug 22 12:38:02 juju-e4d256-prod-github-runner-207 kernel: [26056.607260] __x64_sys_ioctl+0x95/0xd0 Aug 22 12:38:02 juju-e4d256-prod-github-runner-207 kernel: [26056.607970] do_syscall_64+0x5c/0xc0 Aug 22 12:38:02 juju-e4d256-prod-github-runner-207 kernel: [26056.608635] ? do_futex+0x162/0x1f0 Aug 22 12:38:02 juju-e4d256-prod-github-runner-207 kernel: [26056.609295] ? __x64_sys_futex+0x78/0x1e0 Aug 22 12:38:02 juju-e4d256-prod-github-runner-207 kernel: [26056.609981] ? __secure_computing+0xa9/0x120 Aug 22 12:38:02 juju-e4d256-prod-github-runner-207 kernel: [26056.610675] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 12:38:02 juju-e4d256-prod-github-runner-207 kernel: [26056.611640] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:38:02 juju-e4d256-prod-github-runner-207 kernel: [26056.612367] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:38:02 juju-e4d256-prod-github-runner-207 kernel: [26056.613085] ? do_syscall_64+0x69/0xc0 Aug 22 12:38:02 juju-e4d256-prod-github-runner-207 kernel: [26056.613732] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:38:02 juju-e4d256-prod-github-runner-207 kernel: [26056.614441] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:38:02 juju-e4d256-prod-github-runner-207 kernel: [26056.615137] ? do_syscall_64+0x69/0xc0 Aug 22 12:38:02 juju-e4d256-prod-github-runner-207 kernel: [26056.615785] ? do_syscall_64+0x69/0xc0 Aug 22 12:38:02 juju-e4d256-prod-github-runner-207 kernel: [26056.616432] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 12:38:02 juju-e4d256-prod-github-runner-207 kernel: [26056.617151] RIP: 0033:0x7faa5d0edaff Aug 22 12:38:02 juju-e4d256-prod-github-runner-207 kernel: [26056.617782] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 12:38:02 juju-e4d256-prod-github-runner-207 kernel: [26056.619800] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 12:38:02 juju-e4d256-prod-github-runner-207 kernel: [26056.620725] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 12:38:02 juju-e4d256-prod-github-runner-207 kernel: [26056.621623] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 12:38:02 juju-e4d256-prod-github-runner-207 kernel: [26056.622532] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 12:38:02 juju-e4d256-prod-github-runner-207 kernel: [26056.623447] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 12:38:02 juju-e4d256-prod-github-runner-207 kernel: [26056.624343] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 12:38:02 juju-e4d256-prod-github-runner-207 kernel: [26056.625258] Aug 22 12:38:30 juju-e4d256-prod-github-runner-207 kernel: [26084.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 24185s! [qemu-system-x86:6715] Aug 22 12:38:30 juju-e4d256-prod-github-runner-207 kernel: [26084.543107] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 12:38:30 juju-e4d256-prod-github-runner-207 kernel: [26084.543181] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 12:38:30 juju-e4d256-prod-github-runner-207 kernel: [26084.555558] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 12:38:30 juju-e4d256-prod-github-runner-207 kernel: [26084.556851] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 12:38:30 juju-e4d256-prod-github-runner-207 kernel: [26084.558096] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:38:30 juju-e4d256-prod-github-runner-207 kernel: [26084.559186] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 12:38:30 juju-e4d256-prod-github-runner-207 kernel: [26084.561778] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 12:38:30 juju-e4d256-prod-github-runner-207 kernel: [26084.562845] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 12:38:30 juju-e4d256-prod-github-runner-207 kernel: [26084.564027] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 12:38:30 juju-e4d256-prod-github-runner-207 kernel: [26084.565210] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 12:38:30 juju-e4d256-prod-github-runner-207 kernel: [26084.566391] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 12:38:30 juju-e4d256-prod-github-runner-207 kernel: [26084.567582] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 12:38:30 juju-e4d256-prod-github-runner-207 kernel: [26084.568785] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 12:38:30 juju-e4d256-prod-github-runner-207 kernel: [26084.570044] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 12:38:30 juju-e4d256-prod-github-runner-207 kernel: [26084.571176] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 12:38:30 juju-e4d256-prod-github-runner-207 kernel: [26084.572396] Call Trace: Aug 22 12:38:30 juju-e4d256-prod-github-runner-207 kernel: [26084.573321] Aug 22 12:38:30 juju-e4d256-prod-github-runner-207 kernel: [26084.574206] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:38:30 juju-e4d256-prod-github-runner-207 kernel: [26084.575309] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:38:30 juju-e4d256-prod-github-runner-207 kernel: [26084.576420] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:38:30 juju-e4d256-prod-github-runner-207 kernel: [26084.577769] ? show_regs.part.0+0x23/0x29 Aug 22 12:38:30 juju-e4d256-prod-github-runner-207 kernel: [26084.578959] ? show_regs.cold+0x8/0xd Aug 22 12:38:30 juju-e4d256-prod-github-runner-207 kernel: [26084.579973] ? watchdog_timer_fn+0x1be/0x220 Aug 22 12:38:30 juju-e4d256-prod-github-runner-207 kernel: [26084.581016] ? lockup_detector_update_enable+0x60/0x60 Aug 22 12:38:30 juju-e4d256-prod-github-runner-207 kernel: [26084.582182] ? __hrtimer_run_queues+0x107/0x230 Aug 22 12:38:30 juju-e4d256-prod-github-runner-207 kernel: [26084.583266] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 12:38:30 juju-e4d256-prod-github-runner-207 kernel: [26084.584385] ? hrtimer_interrupt+0x101/0x220 Aug 22 12:38:30 juju-e4d256-prod-github-runner-207 kernel: [26084.585508] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 12:38:30 juju-e4d256-prod-github-runner-207 kernel: [26084.586660] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 12:38:30 juju-e4d256-prod-github-runner-207 kernel: [26084.587829] Aug 22 12:38:30 juju-e4d256-prod-github-runner-207 kernel: [26084.588707] Aug 22 12:38:30 juju-e4d256-prod-github-runner-207 kernel: [26084.589608] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 12:38:30 juju-e4d256-prod-github-runner-207 kernel: [26084.590742] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:38:30 juju-e4d256-prod-github-runner-207 kernel: [26084.591928] ? _raw_spin_lock+0x22/0x30 Aug 22 12:38:30 juju-e4d256-prod-github-runner-207 kernel: [26084.592929] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:38:30 juju-e4d256-prod-github-runner-207 kernel: [26084.594000] direct_page_fault+0x206/0x310 [kvm] Aug 22 12:38:30 juju-e4d256-prod-github-runner-207 kernel: [26084.595194] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 12:38:30 juju-e4d256-prod-github-runner-207 kernel: [26084.596234] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 12:38:30 juju-e4d256-prod-github-runner-207 kernel: [26084.597297] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 12:38:30 juju-e4d256-prod-github-runner-207 kernel: [26084.598356] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 12:38:30 juju-e4d256-prod-github-runner-207 kernel: [26084.599411] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 12:38:30 juju-e4d256-prod-github-runner-207 kernel: [26084.600454] handle_exit+0x98/0x230 [kvm_amd] Aug 22 12:38:30 juju-e4d256-prod-github-runner-207 kernel: [26084.601361] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 12:38:30 juju-e4d256-prod-github-runner-207 kernel: [26084.602291] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 12:38:30 juju-e4d256-prod-github-runner-207 kernel: [26084.603276] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 12:38:30 juju-e4d256-prod-github-runner-207 kernel: [26084.604332] vcpu_run+0x62/0x2c0 [kvm] Aug 22 12:38:30 juju-e4d256-prod-github-runner-207 kernel: [26084.605167] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 12:38:30 juju-e4d256-prod-github-runner-207 kernel: [26084.606030] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 12:38:30 juju-e4d256-prod-github-runner-207 kernel: [26084.606925] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 12:38:30 juju-e4d256-prod-github-runner-207 kernel: [26084.607739] ? __seccomp_filter+0x4a/0x4a0 Aug 22 12:38:30 juju-e4d256-prod-github-runner-207 kernel: [26084.608502] ? __fget_files+0x86/0xc0 Aug 22 12:38:30 juju-e4d256-prod-github-runner-207 kernel: [26084.609226] __x64_sys_ioctl+0x95/0xd0 Aug 22 12:38:30 juju-e4d256-prod-github-runner-207 kernel: [26084.609936] do_syscall_64+0x5c/0xc0 Aug 22 12:38:30 juju-e4d256-prod-github-runner-207 kernel: [26084.610625] ? do_futex+0x162/0x1f0 Aug 22 12:38:30 juju-e4d256-prod-github-runner-207 kernel: [26084.611297] ? __x64_sys_futex+0x78/0x1e0 Aug 22 12:38:30 juju-e4d256-prod-github-runner-207 kernel: [26084.611986] ? __secure_computing+0xa9/0x120 Aug 22 12:38:30 juju-e4d256-prod-github-runner-207 kernel: [26084.612704] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 12:38:30 juju-e4d256-prod-github-runner-207 kernel: [26084.613479] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:38:30 juju-e4d256-prod-github-runner-207 kernel: [26084.614219] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:38:30 juju-e4d256-prod-github-runner-207 kernel: [26084.614980] ? do_syscall_64+0x69/0xc0 Aug 22 12:38:30 juju-e4d256-prod-github-runner-207 kernel: [26084.615653] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:38:30 juju-e4d256-prod-github-runner-207 kernel: [26084.616369] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:38:30 juju-e4d256-prod-github-runner-207 kernel: [26084.617074] ? do_syscall_64+0x69/0xc0 Aug 22 12:38:30 juju-e4d256-prod-github-runner-207 kernel: [26084.617705] ? do_syscall_64+0x69/0xc0 Aug 22 12:38:30 juju-e4d256-prod-github-runner-207 kernel: [26084.618339] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 12:38:30 juju-e4d256-prod-github-runner-207 kernel: [26084.619072] RIP: 0033:0x7faa5d0edaff Aug 22 12:38:30 juju-e4d256-prod-github-runner-207 kernel: [26084.619724] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 12:38:30 juju-e4d256-prod-github-runner-207 kernel: [26084.621776] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 12:38:30 juju-e4d256-prod-github-runner-207 kernel: [26084.622714] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 12:38:30 juju-e4d256-prod-github-runner-207 kernel: [26084.623644] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 12:38:30 juju-e4d256-prod-github-runner-207 kernel: [26084.624563] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 12:38:30 juju-e4d256-prod-github-runner-207 kernel: [26084.625475] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 12:38:30 juju-e4d256-prod-github-runner-207 kernel: [26084.626378] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 12:38:30 juju-e4d256-prod-github-runner-207 kernel: [26084.627302] Aug 22 12:38:45 juju-e4d256-prod-github-runner-207 kernel: [26098.928706] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 12:38:45 juju-e4d256-prod-github-runner-207 kernel: [26098.929773] rcu: 1-....: (6475180 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=3132742 Aug 22 12:38:45 juju-e4d256-prod-github-runner-207 kernel: [26098.930931] (t=6495432 jiffies g=23269 q=30554) Aug 22 12:38:45 juju-e4d256-prod-github-runner-207 kernel: [26098.931719] NMI backtrace for cpu 1 Aug 22 12:38:45 juju-e4d256-prod-github-runner-207 kernel: [26098.932426] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 12:38:45 juju-e4d256-prod-github-runner-207 kernel: [26098.933543] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 12:38:45 juju-e4d256-prod-github-runner-207 kernel: [26098.934626] Call Trace: Aug 22 12:38:45 juju-e4d256-prod-github-runner-207 kernel: [26098.935322] Aug 22 12:38:45 juju-e4d256-prod-github-runner-207 kernel: [26098.935985] show_stack+0x52/0x5c Aug 22 12:38:45 juju-e4d256-prod-github-runner-207 kernel: [26098.936712] dump_stack_lvl+0x4a/0x63 Aug 22 12:38:45 juju-e4d256-prod-github-runner-207 kernel: [26098.937461] dump_stack+0x10/0x16 Aug 22 12:38:45 juju-e4d256-prod-github-runner-207 kernel: [26098.938211] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 12:38:45 juju-e4d256-prod-github-runner-207 kernel: [26098.939025] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 12:38:45 juju-e4d256-prod-github-runner-207 kernel: [26098.939819] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 12:38:45 juju-e4d256-prod-github-runner-207 kernel: [26098.940693] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 12:38:45 juju-e4d256-prod-github-runner-207 kernel: [26098.941509] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 12:38:45 juju-e4d256-prod-github-runner-207 kernel: [26098.942324] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 12:38:45 juju-e4d256-prod-github-runner-207 kernel: [26098.943127] print_cpu_stall.cold+0x2f/0xe2 Aug 22 12:38:45 juju-e4d256-prod-github-runner-207 kernel: [26098.943939] ? timekeeping_update+0xf7/0x150 Aug 22 12:38:45 juju-e4d256-prod-github-runner-207 kernel: [26098.944726] check_cpu_stall+0x109/0x270 Aug 22 12:38:45 juju-e4d256-prod-github-runner-207 kernel: [26098.945473] rcu_sched_clock_irq+0x9a/0x250 Aug 22 12:38:45 juju-e4d256-prod-github-runner-207 kernel: [26098.946233] update_process_times+0x94/0xd0 Aug 22 12:38:45 juju-e4d256-prod-github-runner-207 kernel: [26098.947018] tick_sched_handle+0x29/0x70 Aug 22 12:38:45 juju-e4d256-prod-github-runner-207 kernel: [26098.947771] tick_sched_timer+0x8c/0xc0 Aug 22 12:38:45 juju-e4d256-prod-github-runner-207 kernel: [26098.948552] ? tick_nohz_handler+0xb0/0xb0 Aug 22 12:38:45 juju-e4d256-prod-github-runner-207 kernel: [26098.949558] __hrtimer_run_queues+0x107/0x230 Aug 22 12:38:45 juju-e4d256-prod-github-runner-207 kernel: [26098.950332] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 12:38:45 juju-e4d256-prod-github-runner-207 kernel: [26098.951124] hrtimer_interrupt+0x101/0x220 Aug 22 12:38:45 juju-e4d256-prod-github-runner-207 kernel: [26098.951884] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 12:38:45 juju-e4d256-prod-github-runner-207 kernel: [26098.952695] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 12:38:45 juju-e4d256-prod-github-runner-207 kernel: [26098.953604] Aug 22 12:38:45 juju-e4d256-prod-github-runner-207 kernel: [26098.954295] Aug 22 12:38:45 juju-e4d256-prod-github-runner-207 kernel: [26098.954985] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 12:38:45 juju-e4d256-prod-github-runner-207 kernel: [26098.955898] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:38:45 juju-e4d256-prod-github-runner-207 kernel: [26098.956889] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 12:38:45 juju-e4d256-prod-github-runner-207 kernel: [26098.959604] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 12:38:45 juju-e4d256-prod-github-runner-207 kernel: [26098.960735] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 12:38:45 juju-e4d256-prod-github-runner-207 kernel: [26098.961886] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 12:38:45 juju-e4d256-prod-github-runner-207 kernel: [26098.963025] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 12:38:45 juju-e4d256-prod-github-runner-207 kernel: [26098.964118] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 12:38:45 juju-e4d256-prod-github-runner-207 kernel: [26098.965207] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 12:38:45 juju-e4d256-prod-github-runner-207 kernel: [26098.966296] ? _raw_spin_lock+0x22/0x30 Aug 22 12:38:45 juju-e4d256-prod-github-runner-207 kernel: [26098.967157] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:38:45 juju-e4d256-prod-github-runner-207 kernel: [26098.968101] direct_page_fault+0x206/0x310 [kvm] Aug 22 12:38:45 juju-e4d256-prod-github-runner-207 kernel: [26098.969029] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 12:38:45 juju-e4d256-prod-github-runner-207 kernel: [26098.969953] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 12:38:45 juju-e4d256-prod-github-runner-207 kernel: [26098.970909] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 12:38:45 juju-e4d256-prod-github-runner-207 kernel: [26098.971824] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 12:38:45 juju-e4d256-prod-github-runner-207 kernel: [26098.972702] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 12:38:45 juju-e4d256-prod-github-runner-207 kernel: [26098.973625] handle_exit+0x98/0x230 [kvm_amd] Aug 22 12:38:45 juju-e4d256-prod-github-runner-207 kernel: [26098.974466] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 12:38:45 juju-e4d256-prod-github-runner-207 kernel: [26098.975351] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 12:38:45 juju-e4d256-prod-github-runner-207 kernel: [26098.976243] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 12:38:45 juju-e4d256-prod-github-runner-207 kernel: [26098.977124] vcpu_run+0x62/0x2c0 [kvm] Aug 22 12:38:45 juju-e4d256-prod-github-runner-207 kernel: [26098.977914] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 12:38:45 juju-e4d256-prod-github-runner-207 kernel: [26098.978755] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 12:38:45 juju-e4d256-prod-github-runner-207 kernel: [26098.979656] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 12:38:45 juju-e4d256-prod-github-runner-207 kernel: [26098.980498] ? __seccomp_filter+0x4a/0x4a0 Aug 22 12:38:45 juju-e4d256-prod-github-runner-207 kernel: [26098.981295] ? __fget_files+0x86/0xc0 Aug 22 12:38:45 juju-e4d256-prod-github-runner-207 kernel: [26098.982063] __x64_sys_ioctl+0x95/0xd0 Aug 22 12:38:45 juju-e4d256-prod-github-runner-207 kernel: [26098.982844] do_syscall_64+0x5c/0xc0 Aug 22 12:38:45 juju-e4d256-prod-github-runner-207 kernel: [26098.983593] ? do_futex+0x162/0x1f0 Aug 22 12:38:45 juju-e4d256-prod-github-runner-207 kernel: [26098.984331] ? __x64_sys_futex+0x78/0x1e0 Aug 22 12:38:45 juju-e4d256-prod-github-runner-207 kernel: [26098.985111] ? __secure_computing+0xa9/0x120 Aug 22 12:38:45 juju-e4d256-prod-github-runner-207 kernel: [26098.985910] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 12:38:45 juju-e4d256-prod-github-runner-207 kernel: [26098.986822] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:38:45 juju-e4d256-prod-github-runner-207 kernel: [26098.987681] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:38:45 juju-e4d256-prod-github-runner-207 kernel: [26098.988522] ? do_syscall_64+0x69/0xc0 Aug 22 12:38:45 juju-e4d256-prod-github-runner-207 kernel: [26098.989282] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:38:45 juju-e4d256-prod-github-runner-207 kernel: [26098.990123] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:38:45 juju-e4d256-prod-github-runner-207 kernel: [26098.990980] ? do_syscall_64+0x69/0xc0 Aug 22 12:38:45 juju-e4d256-prod-github-runner-207 kernel: [26098.991744] ? do_syscall_64+0x69/0xc0 Aug 22 12:38:45 juju-e4d256-prod-github-runner-207 kernel: [26098.992501] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 12:38:45 juju-e4d256-prod-github-runner-207 kernel: [26098.993370] RIP: 0033:0x7faa5d0edaff Aug 22 12:38:45 juju-e4d256-prod-github-runner-207 kernel: [26098.994149] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 12:38:45 juju-e4d256-prod-github-runner-207 kernel: [26098.996583] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 12:38:45 juju-e4d256-prod-github-runner-207 kernel: [26098.997686] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 12:38:45 juju-e4d256-prod-github-runner-207 kernel: [26098.998785] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 12:38:45 juju-e4d256-prod-github-runner-207 kernel: [26098.999859] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 12:38:45 juju-e4d256-prod-github-runner-207 kernel: [26099.000935] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 12:38:45 juju-e4d256-prod-github-runner-207 kernel: [26099.001991] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 12:38:45 juju-e4d256-prod-github-runner-207 kernel: [26099.003049] Aug 22 12:39:10 juju-e4d256-prod-github-runner-207 kernel: [26124.541981] watchdog: BUG: soft lockup - CPU#1 stuck for 24222s! [qemu-system-x86:6715] Aug 22 12:39:10 juju-e4d256-prod-github-runner-207 kernel: [26124.543766] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 12:39:10 juju-e4d256-prod-github-runner-207 kernel: [26124.544034] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 12:39:10 juju-e4d256-prod-github-runner-207 kernel: [26124.556681] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 12:39:10 juju-e4d256-prod-github-runner-207 kernel: [26124.557967] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 12:39:10 juju-e4d256-prod-github-runner-207 kernel: [26124.559242] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:39:10 juju-e4d256-prod-github-runner-207 kernel: [26124.560323] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 12:39:10 juju-e4d256-prod-github-runner-207 kernel: [26124.562928] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 12:39:10 juju-e4d256-prod-github-runner-207 kernel: [26124.563991] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 12:39:10 juju-e4d256-prod-github-runner-207 kernel: [26124.565166] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 12:39:10 juju-e4d256-prod-github-runner-207 kernel: [26124.566370] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 12:39:10 juju-e4d256-prod-github-runner-207 kernel: [26124.567551] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 12:39:10 juju-e4d256-prod-github-runner-207 kernel: [26124.568732] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 12:39:10 juju-e4d256-prod-github-runner-207 kernel: [26124.569953] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 12:39:10 juju-e4d256-prod-github-runner-207 kernel: [26124.571234] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 12:39:10 juju-e4d256-prod-github-runner-207 kernel: [26124.572682] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 12:39:10 juju-e4d256-prod-github-runner-207 kernel: [26124.574028] Call Trace: Aug 22 12:39:10 juju-e4d256-prod-github-runner-207 kernel: [26124.574974] Aug 22 12:39:10 juju-e4d256-prod-github-runner-207 kernel: [26124.575868] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:39:10 juju-e4d256-prod-github-runner-207 kernel: [26124.576910] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:39:10 juju-e4d256-prod-github-runner-207 kernel: [26124.577947] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:39:10 juju-e4d256-prod-github-runner-207 kernel: [26124.579077] ? show_regs.part.0+0x23/0x29 Aug 22 12:39:10 juju-e4d256-prod-github-runner-207 kernel: [26124.580084] ? show_regs.cold+0x8/0xd Aug 22 12:39:10 juju-e4d256-prod-github-runner-207 kernel: [26124.581071] ? watchdog_timer_fn+0x1be/0x220 Aug 22 12:39:10 juju-e4d256-prod-github-runner-207 kernel: [26124.582103] ? lockup_detector_update_enable+0x60/0x60 Aug 22 12:39:10 juju-e4d256-prod-github-runner-207 kernel: [26124.583218] ? __hrtimer_run_queues+0x107/0x230 Aug 22 12:39:10 juju-e4d256-prod-github-runner-207 kernel: [26124.584277] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 12:39:10 juju-e4d256-prod-github-runner-207 kernel: [26124.585316] ? hrtimer_interrupt+0x101/0x220 Aug 22 12:39:10 juju-e4d256-prod-github-runner-207 kernel: [26124.586366] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 12:39:10 juju-e4d256-prod-github-runner-207 kernel: [26124.587444] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 12:39:10 juju-e4d256-prod-github-runner-207 kernel: [26124.588500] Aug 22 12:39:10 juju-e4d256-prod-github-runner-207 kernel: [26124.589358] Aug 22 12:39:10 juju-e4d256-prod-github-runner-207 kernel: [26124.590226] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 12:39:10 juju-e4d256-prod-github-runner-207 kernel: [26124.591314] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:39:10 juju-e4d256-prod-github-runner-207 kernel: [26124.592367] ? _raw_spin_lock+0x22/0x30 Aug 22 12:39:10 juju-e4d256-prod-github-runner-207 kernel: [26124.593325] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:39:10 juju-e4d256-prod-github-runner-207 kernel: [26124.594384] direct_page_fault+0x206/0x310 [kvm] Aug 22 12:39:10 juju-e4d256-prod-github-runner-207 kernel: [26124.595420] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 12:39:10 juju-e4d256-prod-github-runner-207 kernel: [26124.596442] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 12:39:10 juju-e4d256-prod-github-runner-207 kernel: [26124.597452] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 12:39:10 juju-e4d256-prod-github-runner-207 kernel: [26124.598477] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 12:39:10 juju-e4d256-prod-github-runner-207 kernel: [26124.599708] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 12:39:10 juju-e4d256-prod-github-runner-207 kernel: [26124.600756] handle_exit+0x98/0x230 [kvm_amd] Aug 22 12:39:10 juju-e4d256-prod-github-runner-207 kernel: [26124.601694] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 12:39:10 juju-e4d256-prod-github-runner-207 kernel: [26124.603013] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 12:39:10 juju-e4d256-prod-github-runner-207 kernel: [26124.604014] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 12:39:10 juju-e4d256-prod-github-runner-207 kernel: [26124.604933] vcpu_run+0x62/0x2c0 [kvm] Aug 22 12:39:10 juju-e4d256-prod-github-runner-207 kernel: [26124.605752] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 12:39:10 juju-e4d256-prod-github-runner-207 kernel: [26124.606598] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 12:39:10 juju-e4d256-prod-github-runner-207 kernel: [26124.607463] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 12:39:10 juju-e4d256-prod-github-runner-207 kernel: [26124.608268] ? __seccomp_filter+0x4a/0x4a0 Aug 22 12:39:10 juju-e4d256-prod-github-runner-207 kernel: [26124.609028] ? __fget_files+0x86/0xc0 Aug 22 12:39:10 juju-e4d256-prod-github-runner-207 kernel: [26124.609738] __x64_sys_ioctl+0x95/0xd0 Aug 22 12:39:10 juju-e4d256-prod-github-runner-207 kernel: [26124.610458] do_syscall_64+0x5c/0xc0 Aug 22 12:39:10 juju-e4d256-prod-github-runner-207 kernel: [26124.611134] ? do_futex+0x162/0x1f0 Aug 22 12:39:10 juju-e4d256-prod-github-runner-207 kernel: [26124.611787] ? __x64_sys_futex+0x78/0x1e0 Aug 22 12:39:10 juju-e4d256-prod-github-runner-207 kernel: [26124.612466] ? __secure_computing+0xa9/0x120 Aug 22 12:39:10 juju-e4d256-prod-github-runner-207 kernel: [26124.613204] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 12:39:10 juju-e4d256-prod-github-runner-207 kernel: [26124.613975] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:39:10 juju-e4d256-prod-github-runner-207 kernel: [26124.614730] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:39:10 juju-e4d256-prod-github-runner-207 kernel: [26124.615458] ? do_syscall_64+0x69/0xc0 Aug 22 12:39:10 juju-e4d256-prod-github-runner-207 kernel: [26124.616111] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:39:10 juju-e4d256-prod-github-runner-207 kernel: [26124.616827] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:39:10 juju-e4d256-prod-github-runner-207 kernel: [26124.617530] ? do_syscall_64+0x69/0xc0 Aug 22 12:39:10 juju-e4d256-prod-github-runner-207 kernel: [26124.618163] ? do_syscall_64+0x69/0xc0 Aug 22 12:39:10 juju-e4d256-prod-github-runner-207 kernel: [26124.618812] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 12:39:10 juju-e4d256-prod-github-runner-207 kernel: [26124.619531] RIP: 0033:0x7faa5d0edaff Aug 22 12:39:10 juju-e4d256-prod-github-runner-207 kernel: [26124.620165] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 12:39:10 juju-e4d256-prod-github-runner-207 kernel: [26124.622209] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 12:39:10 juju-e4d256-prod-github-runner-207 kernel: [26124.623154] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 12:39:10 juju-e4d256-prod-github-runner-207 kernel: [26124.624062] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 12:39:10 juju-e4d256-prod-github-runner-207 kernel: [26124.624960] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 12:39:10 juju-e4d256-prod-github-runner-207 kernel: [26124.625870] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 12:39:10 juju-e4d256-prod-github-runner-207 kernel: [26124.626811] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 12:39:10 juju-e4d256-prod-github-runner-207 kernel: [26124.627724] Aug 22 12:39:38 juju-e4d256-prod-github-runner-207 kernel: [26152.542000] watchdog: BUG: soft lockup - CPU#1 stuck for 24248s! [qemu-system-x86:6715] Aug 22 12:39:38 juju-e4d256-prod-github-runner-207 kernel: [26152.543479] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 12:39:38 juju-e4d256-prod-github-runner-207 kernel: [26152.543554] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 12:39:38 juju-e4d256-prod-github-runner-207 kernel: [26152.556688] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 12:39:38 juju-e4d256-prod-github-runner-207 kernel: [26152.558006] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 12:39:38 juju-e4d256-prod-github-runner-207 kernel: [26152.559253] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:39:38 juju-e4d256-prod-github-runner-207 kernel: [26152.560327] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 12:39:38 juju-e4d256-prod-github-runner-207 kernel: [26152.563026] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 12:39:38 juju-e4d256-prod-github-runner-207 kernel: [26152.564105] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 12:39:38 juju-e4d256-prod-github-runner-207 kernel: [26152.565324] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 12:39:38 juju-e4d256-prod-github-runner-207 kernel: [26152.566557] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 12:39:38 juju-e4d256-prod-github-runner-207 kernel: [26152.567829] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 12:39:38 juju-e4d256-prod-github-runner-207 kernel: [26152.569013] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 12:39:38 juju-e4d256-prod-github-runner-207 kernel: [26152.570269] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 12:39:38 juju-e4d256-prod-github-runner-207 kernel: [26152.571534] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 12:39:38 juju-e4d256-prod-github-runner-207 kernel: [26152.572704] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 12:39:38 juju-e4d256-prod-github-runner-207 kernel: [26152.574087] Call Trace: Aug 22 12:39:38 juju-e4d256-prod-github-runner-207 kernel: [26152.575020] Aug 22 12:39:38 juju-e4d256-prod-github-runner-207 kernel: [26152.575914] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:39:38 juju-e4d256-prod-github-runner-207 kernel: [26152.576950] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:39:38 juju-e4d256-prod-github-runner-207 kernel: [26152.578001] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:39:38 juju-e4d256-prod-github-runner-207 kernel: [26152.579094] ? show_regs.part.0+0x23/0x29 Aug 22 12:39:38 juju-e4d256-prod-github-runner-207 kernel: [26152.580101] ? show_regs.cold+0x8/0xd Aug 22 12:39:38 juju-e4d256-prod-github-runner-207 kernel: [26152.581076] ? watchdog_timer_fn+0x1be/0x220 Aug 22 12:39:38 juju-e4d256-prod-github-runner-207 kernel: [26152.582116] ? lockup_detector_update_enable+0x60/0x60 Aug 22 12:39:38 juju-e4d256-prod-github-runner-207 kernel: [26152.583212] ? __hrtimer_run_queues+0x107/0x230 Aug 22 12:39:38 juju-e4d256-prod-github-runner-207 kernel: [26152.584259] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 12:39:38 juju-e4d256-prod-github-runner-207 kernel: [26152.585288] ? hrtimer_interrupt+0x101/0x220 Aug 22 12:39:38 juju-e4d256-prod-github-runner-207 kernel: [26152.586317] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 12:39:38 juju-e4d256-prod-github-runner-207 kernel: [26152.587393] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 12:39:38 juju-e4d256-prod-github-runner-207 kernel: [26152.588461] Aug 22 12:39:38 juju-e4d256-prod-github-runner-207 kernel: [26152.589332] Aug 22 12:39:38 juju-e4d256-prod-github-runner-207 kernel: [26152.590219] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 12:39:38 juju-e4d256-prod-github-runner-207 kernel: [26152.591284] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:39:38 juju-e4d256-prod-github-runner-207 kernel: [26152.592345] ? _raw_spin_lock+0x22/0x30 Aug 22 12:39:38 juju-e4d256-prod-github-runner-207 kernel: [26152.593297] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:39:38 juju-e4d256-prod-github-runner-207 kernel: [26152.594398] direct_page_fault+0x206/0x310 [kvm] Aug 22 12:39:38 juju-e4d256-prod-github-runner-207 kernel: [26152.595433] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 12:39:38 juju-e4d256-prod-github-runner-207 kernel: [26152.596449] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 12:39:38 juju-e4d256-prod-github-runner-207 kernel: [26152.597457] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 12:39:38 juju-e4d256-prod-github-runner-207 kernel: [26152.598476] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 12:39:38 juju-e4d256-prod-github-runner-207 kernel: [26152.599439] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 12:39:38 juju-e4d256-prod-github-runner-207 kernel: [26152.600429] handle_exit+0x98/0x230 [kvm_amd] Aug 22 12:39:38 juju-e4d256-prod-github-runner-207 kernel: [26152.601366] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 12:39:38 juju-e4d256-prod-github-runner-207 kernel: [26152.602339] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 12:39:38 juju-e4d256-prod-github-runner-207 kernel: [26152.603289] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 12:39:38 juju-e4d256-prod-github-runner-207 kernel: [26152.604201] vcpu_run+0x62/0x2c0 [kvm] Aug 22 12:39:38 juju-e4d256-prod-github-runner-207 kernel: [26152.605018] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 12:39:38 juju-e4d256-prod-github-runner-207 kernel: [26152.605891] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 12:39:38 juju-e4d256-prod-github-runner-207 kernel: [26152.606804] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 12:39:38 juju-e4d256-prod-github-runner-207 kernel: [26152.607610] ? __seccomp_filter+0x4a/0x4a0 Aug 22 12:39:38 juju-e4d256-prod-github-runner-207 kernel: [26152.608362] ? __fget_files+0x86/0xc0 Aug 22 12:39:38 juju-e4d256-prod-github-runner-207 kernel: [26152.609072] __x64_sys_ioctl+0x95/0xd0 Aug 22 12:39:38 juju-e4d256-prod-github-runner-207 kernel: [26152.609771] do_syscall_64+0x5c/0xc0 Aug 22 12:39:38 juju-e4d256-prod-github-runner-207 kernel: [26152.610461] ? do_futex+0x162/0x1f0 Aug 22 12:39:38 juju-e4d256-prod-github-runner-207 kernel: [26152.611120] ? __x64_sys_futex+0x78/0x1e0 Aug 22 12:39:38 juju-e4d256-prod-github-runner-207 kernel: [26152.611800] ? __secure_computing+0xa9/0x120 Aug 22 12:39:38 juju-e4d256-prod-github-runner-207 kernel: [26152.612494] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 12:39:38 juju-e4d256-prod-github-runner-207 kernel: [26152.613268] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:39:38 juju-e4d256-prod-github-runner-207 kernel: [26152.614025] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:39:38 juju-e4d256-prod-github-runner-207 kernel: [26152.614759] ? do_syscall_64+0x69/0xc0 Aug 22 12:39:38 juju-e4d256-prod-github-runner-207 kernel: [26152.615596] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:39:38 juju-e4d256-prod-github-runner-207 kernel: [26152.616532] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:39:38 juju-e4d256-prod-github-runner-207 kernel: [26152.617623] ? do_syscall_64+0x69/0xc0 Aug 22 12:39:38 juju-e4d256-prod-github-runner-207 kernel: [26152.618599] ? do_syscall_64+0x69/0xc0 Aug 22 12:39:38 juju-e4d256-prod-github-runner-207 kernel: [26152.619546] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 12:39:38 juju-e4d256-prod-github-runner-207 kernel: [26152.620658] RIP: 0033:0x7faa5d0edaff Aug 22 12:39:38 juju-e4d256-prod-github-runner-207 kernel: [26152.621356] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 12:39:38 juju-e4d256-prod-github-runner-207 kernel: [26152.623412] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 12:39:38 juju-e4d256-prod-github-runner-207 kernel: [26152.624362] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 12:39:38 juju-e4d256-prod-github-runner-207 kernel: [26152.625273] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 12:39:38 juju-e4d256-prod-github-runner-207 kernel: [26152.626186] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 12:39:38 juju-e4d256-prod-github-runner-207 kernel: [26152.627101] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 12:39:38 juju-e4d256-prod-github-runner-207 kernel: [26152.628006] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 12:39:38 juju-e4d256-prod-github-runner-207 kernel: [26152.628915] Aug 22 12:40:06 juju-e4d256-prod-github-runner-207 kernel: [26180.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 24274s! [qemu-system-x86:6715] Aug 22 12:40:06 juju-e4d256-prod-github-runner-207 kernel: [26180.543119] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 12:40:06 juju-e4d256-prod-github-runner-207 kernel: [26180.543194] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 12:40:06 juju-e4d256-prod-github-runner-207 kernel: [26180.555979] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 12:40:06 juju-e4d256-prod-github-runner-207 kernel: [26180.557299] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 12:40:06 juju-e4d256-prod-github-runner-207 kernel: [26180.558637] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:40:06 juju-e4d256-prod-github-runner-207 kernel: [26180.559740] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 12:40:06 juju-e4d256-prod-github-runner-207 kernel: [26180.562364] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 12:40:06 juju-e4d256-prod-github-runner-207 kernel: [26180.563415] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 12:40:06 juju-e4d256-prod-github-runner-207 kernel: [26180.564587] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 12:40:06 juju-e4d256-prod-github-runner-207 kernel: [26180.565813] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 12:40:06 juju-e4d256-prod-github-runner-207 kernel: [26180.566986] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 12:40:06 juju-e4d256-prod-github-runner-207 kernel: [26180.568162] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 12:40:06 juju-e4d256-prod-github-runner-207 kernel: [26180.569366] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 12:40:06 juju-e4d256-prod-github-runner-207 kernel: [26180.570627] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 12:40:06 juju-e4d256-prod-github-runner-207 kernel: [26180.571733] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 12:40:06 juju-e4d256-prod-github-runner-207 kernel: [26180.572939] Call Trace: Aug 22 12:40:06 juju-e4d256-prod-github-runner-207 kernel: [26180.573891] Aug 22 12:40:06 juju-e4d256-prod-github-runner-207 kernel: [26180.574779] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:40:06 juju-e4d256-prod-github-runner-207 kernel: [26180.576019] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:40:06 juju-e4d256-prod-github-runner-207 kernel: [26180.577127] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:40:06 juju-e4d256-prod-github-runner-207 kernel: [26180.578237] ? show_regs.part.0+0x23/0x29 Aug 22 12:40:06 juju-e4d256-prod-github-runner-207 kernel: [26180.579244] ? show_regs.cold+0x8/0xd Aug 22 12:40:06 juju-e4d256-prod-github-runner-207 kernel: [26180.580220] ? watchdog_timer_fn+0x1be/0x220 Aug 22 12:40:06 juju-e4d256-prod-github-runner-207 kernel: [26180.581239] ? lockup_detector_update_enable+0x60/0x60 Aug 22 12:40:06 juju-e4d256-prod-github-runner-207 kernel: [26180.582335] ? __hrtimer_run_queues+0x107/0x230 Aug 22 12:40:06 juju-e4d256-prod-github-runner-207 kernel: [26180.583371] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 12:40:06 juju-e4d256-prod-github-runner-207 kernel: [26180.584401] ? hrtimer_interrupt+0x101/0x220 Aug 22 12:40:06 juju-e4d256-prod-github-runner-207 kernel: [26180.585420] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 12:40:06 juju-e4d256-prod-github-runner-207 kernel: [26180.586512] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 12:40:06 juju-e4d256-prod-github-runner-207 kernel: [26180.587565] Aug 22 12:40:06 juju-e4d256-prod-github-runner-207 kernel: [26180.588418] Aug 22 12:40:06 juju-e4d256-prod-github-runner-207 kernel: [26180.589259] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 12:40:06 juju-e4d256-prod-github-runner-207 kernel: [26180.590318] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:40:06 juju-e4d256-prod-github-runner-207 kernel: [26180.591379] ? _raw_spin_lock+0x22/0x30 Aug 22 12:40:06 juju-e4d256-prod-github-runner-207 kernel: [26180.592328] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:40:06 juju-e4d256-prod-github-runner-207 kernel: [26180.593354] direct_page_fault+0x206/0x310 [kvm] Aug 22 12:40:06 juju-e4d256-prod-github-runner-207 kernel: [26180.594412] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 12:40:06 juju-e4d256-prod-github-runner-207 kernel: [26180.595434] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 12:40:06 juju-e4d256-prod-github-runner-207 kernel: [26180.596442] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 12:40:06 juju-e4d256-prod-github-runner-207 kernel: [26180.597427] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 12:40:06 juju-e4d256-prod-github-runner-207 kernel: [26180.598431] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 12:40:06 juju-e4d256-prod-github-runner-207 kernel: [26180.599443] handle_exit+0x98/0x230 [kvm_amd] Aug 22 12:40:06 juju-e4d256-prod-github-runner-207 kernel: [26180.600354] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 12:40:06 juju-e4d256-prod-github-runner-207 kernel: [26180.601281] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 12:40:06 juju-e4d256-prod-github-runner-207 kernel: [26180.602233] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 12:40:06 juju-e4d256-prod-github-runner-207 kernel: [26180.603146] vcpu_run+0x62/0x2c0 [kvm] Aug 22 12:40:06 juju-e4d256-prod-github-runner-207 kernel: [26180.603966] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 12:40:06 juju-e4d256-prod-github-runner-207 kernel: [26180.604782] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 12:40:06 juju-e4d256-prod-github-runner-207 kernel: [26180.605664] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 12:40:06 juju-e4d256-prod-github-runner-207 kernel: [26180.606607] ? __seccomp_filter+0x4a/0x4a0 Aug 22 12:40:06 juju-e4d256-prod-github-runner-207 kernel: [26180.607434] ? __fget_files+0x86/0xc0 Aug 22 12:40:06 juju-e4d256-prod-github-runner-207 kernel: [26180.608148] __x64_sys_ioctl+0x95/0xd0 Aug 22 12:40:06 juju-e4d256-prod-github-runner-207 kernel: [26180.608849] do_syscall_64+0x5c/0xc0 Aug 22 12:40:06 juju-e4d256-prod-github-runner-207 kernel: [26180.609522] ? do_futex+0x162/0x1f0 Aug 22 12:40:06 juju-e4d256-prod-github-runner-207 kernel: [26180.610197] ? __x64_sys_futex+0x78/0x1e0 Aug 22 12:40:06 juju-e4d256-prod-github-runner-207 kernel: [26180.610878] ? __secure_computing+0xa9/0x120 Aug 22 12:40:06 juju-e4d256-prod-github-runner-207 kernel: [26180.611690] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 12:40:06 juju-e4d256-prod-github-runner-207 kernel: [26180.612463] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:40:06 juju-e4d256-prod-github-runner-207 kernel: [26180.613198] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:40:06 juju-e4d256-prod-github-runner-207 kernel: [26180.613940] ? do_syscall_64+0x69/0xc0 Aug 22 12:40:06 juju-e4d256-prod-github-runner-207 kernel: [26180.614592] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:40:06 juju-e4d256-prod-github-runner-207 kernel: [26180.615300] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:40:06 juju-e4d256-prod-github-runner-207 kernel: [26180.616025] ? do_syscall_64+0x69/0xc0 Aug 22 12:40:06 juju-e4d256-prod-github-runner-207 kernel: [26180.616672] ? do_syscall_64+0x69/0xc0 Aug 22 12:40:06 juju-e4d256-prod-github-runner-207 kernel: [26180.617513] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 12:40:06 juju-e4d256-prod-github-runner-207 kernel: [26180.618311] RIP: 0033:0x7faa5d0edaff Aug 22 12:40:06 juju-e4d256-prod-github-runner-207 kernel: [26180.619037] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 12:40:06 juju-e4d256-prod-github-runner-207 kernel: [26180.621204] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 12:40:06 juju-e4d256-prod-github-runner-207 kernel: [26180.622213] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 12:40:06 juju-e4d256-prod-github-runner-207 kernel: [26180.623131] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 12:40:06 juju-e4d256-prod-github-runner-207 kernel: [26180.624055] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 12:40:06 juju-e4d256-prod-github-runner-207 kernel: [26180.625035] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 12:40:06 juju-e4d256-prod-github-runner-207 kernel: [26180.626040] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 12:40:06 juju-e4d256-prod-github-runner-207 kernel: [26180.626989] Aug 22 12:40:34 juju-e4d256-prod-github-runner-207 kernel: [26208.541980] watchdog: BUG: soft lockup - CPU#1 stuck for 24300s! [qemu-system-x86:6715] Aug 22 12:40:34 juju-e4d256-prod-github-runner-207 kernel: [26208.544252] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 12:40:34 juju-e4d256-prod-github-runner-207 kernel: [26208.544561] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 12:40:34 juju-e4d256-prod-github-runner-207 kernel: [26208.557766] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 12:40:34 juju-e4d256-prod-github-runner-207 kernel: [26208.559058] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 12:40:34 juju-e4d256-prod-github-runner-207 kernel: [26208.560311] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:40:34 juju-e4d256-prod-github-runner-207 kernel: [26208.561396] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 12:40:34 juju-e4d256-prod-github-runner-207 kernel: [26208.563980] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 12:40:34 juju-e4d256-prod-github-runner-207 kernel: [26208.565031] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 12:40:34 juju-e4d256-prod-github-runner-207 kernel: [26208.566233] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 12:40:34 juju-e4d256-prod-github-runner-207 kernel: [26208.567462] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 12:40:34 juju-e4d256-prod-github-runner-207 kernel: [26208.568649] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 12:40:34 juju-e4d256-prod-github-runner-207 kernel: [26208.569855] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 12:40:34 juju-e4d256-prod-github-runner-207 kernel: [26208.571049] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 12:40:34 juju-e4d256-prod-github-runner-207 kernel: [26208.572309] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 12:40:34 juju-e4d256-prod-github-runner-207 kernel: [26208.573457] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 12:40:34 juju-e4d256-prod-github-runner-207 kernel: [26208.574747] Call Trace: Aug 22 12:40:34 juju-e4d256-prod-github-runner-207 kernel: [26208.575682] Aug 22 12:40:34 juju-e4d256-prod-github-runner-207 kernel: [26208.576598] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:40:34 juju-e4d256-prod-github-runner-207 kernel: [26208.577664] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:40:34 juju-e4d256-prod-github-runner-207 kernel: [26208.578707] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:40:34 juju-e4d256-prod-github-runner-207 kernel: [26208.579840] ? show_regs.part.0+0x23/0x29 Aug 22 12:40:34 juju-e4d256-prod-github-runner-207 kernel: [26208.580849] ? show_regs.cold+0x8/0xd Aug 22 12:40:34 juju-e4d256-prod-github-runner-207 kernel: [26208.581843] ? watchdog_timer_fn+0x1be/0x220 Aug 22 12:40:34 juju-e4d256-prod-github-runner-207 kernel: [26208.582879] ? lockup_detector_update_enable+0x60/0x60 Aug 22 12:40:34 juju-e4d256-prod-github-runner-207 kernel: [26208.584120] ? __hrtimer_run_queues+0x107/0x230 Aug 22 12:40:34 juju-e4d256-prod-github-runner-207 kernel: [26208.585181] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 12:40:34 juju-e4d256-prod-github-runner-207 kernel: [26208.586281] ? hrtimer_interrupt+0x101/0x220 Aug 22 12:40:34 juju-e4d256-prod-github-runner-207 kernel: [26208.587354] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 12:40:34 juju-e4d256-prod-github-runner-207 kernel: [26208.588463] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 12:40:34 juju-e4d256-prod-github-runner-207 kernel: [26208.589557] Aug 22 12:40:34 juju-e4d256-prod-github-runner-207 kernel: [26208.590420] Aug 22 12:40:34 juju-e4d256-prod-github-runner-207 kernel: [26208.591265] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 12:40:34 juju-e4d256-prod-github-runner-207 kernel: [26208.592313] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:40:34 juju-e4d256-prod-github-runner-207 kernel: [26208.593397] ? _raw_spin_lock+0x22/0x30 Aug 22 12:40:34 juju-e4d256-prod-github-runner-207 kernel: [26208.594353] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:40:34 juju-e4d256-prod-github-runner-207 kernel: [26208.595393] direct_page_fault+0x206/0x310 [kvm] Aug 22 12:40:34 juju-e4d256-prod-github-runner-207 kernel: [26208.596428] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 12:40:34 juju-e4d256-prod-github-runner-207 kernel: [26208.597486] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 12:40:34 juju-e4d256-prod-github-runner-207 kernel: [26208.598562] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 12:40:34 juju-e4d256-prod-github-runner-207 kernel: [26208.599589] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 12:40:34 juju-e4d256-prod-github-runner-207 kernel: [26208.600600] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 12:40:34 juju-e4d256-prod-github-runner-207 kernel: [26208.601649] handle_exit+0x98/0x230 [kvm_amd] Aug 22 12:40:34 juju-e4d256-prod-github-runner-207 kernel: [26208.602574] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 12:40:34 juju-e4d256-prod-github-runner-207 kernel: [26208.603513] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 12:40:34 juju-e4d256-prod-github-runner-207 kernel: [26208.604456] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 12:40:34 juju-e4d256-prod-github-runner-207 kernel: [26208.605402] vcpu_run+0x62/0x2c0 [kvm] Aug 22 12:40:34 juju-e4d256-prod-github-runner-207 kernel: [26208.606226] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 12:40:34 juju-e4d256-prod-github-runner-207 kernel: [26208.607051] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 12:40:34 juju-e4d256-prod-github-runner-207 kernel: [26208.607931] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 12:40:34 juju-e4d256-prod-github-runner-207 kernel: [26208.608740] ? __seccomp_filter+0x4a/0x4a0 Aug 22 12:40:34 juju-e4d256-prod-github-runner-207 kernel: [26208.609539] ? __fget_files+0x86/0xc0 Aug 22 12:40:34 juju-e4d256-prod-github-runner-207 kernel: [26208.610259] __x64_sys_ioctl+0x95/0xd0 Aug 22 12:40:34 juju-e4d256-prod-github-runner-207 kernel: [26208.610963] do_syscall_64+0x5c/0xc0 Aug 22 12:40:34 juju-e4d256-prod-github-runner-207 kernel: [26208.611639] ? do_futex+0x162/0x1f0 Aug 22 12:40:34 juju-e4d256-prod-github-runner-207 kernel: [26208.612301] ? __x64_sys_futex+0x78/0x1e0 Aug 22 12:40:34 juju-e4d256-prod-github-runner-207 kernel: [26208.612986] ? __secure_computing+0xa9/0x120 Aug 22 12:40:34 juju-e4d256-prod-github-runner-207 kernel: [26208.613737] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 12:40:34 juju-e4d256-prod-github-runner-207 kernel: [26208.614528] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:40:34 juju-e4d256-prod-github-runner-207 kernel: [26208.615428] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:40:34 juju-e4d256-prod-github-runner-207 kernel: [26208.616161] ? do_syscall_64+0x69/0xc0 Aug 22 12:40:34 juju-e4d256-prod-github-runner-207 kernel: [26208.616816] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:40:34 juju-e4d256-prod-github-runner-207 kernel: [26208.617561] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:40:34 juju-e4d256-prod-github-runner-207 kernel: [26208.618278] ? do_syscall_64+0x69/0xc0 Aug 22 12:40:34 juju-e4d256-prod-github-runner-207 kernel: [26208.618913] ? do_syscall_64+0x69/0xc0 Aug 22 12:40:34 juju-e4d256-prod-github-runner-207 kernel: [26208.619554] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 12:40:34 juju-e4d256-prod-github-runner-207 kernel: [26208.620277] RIP: 0033:0x7faa5d0edaff Aug 22 12:40:34 juju-e4d256-prod-github-runner-207 kernel: [26208.620958] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 12:40:34 juju-e4d256-prod-github-runner-207 kernel: [26208.623035] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 12:40:34 juju-e4d256-prod-github-runner-207 kernel: [26208.623984] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 12:40:34 juju-e4d256-prod-github-runner-207 kernel: [26208.624922] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 12:40:34 juju-e4d256-prod-github-runner-207 kernel: [26208.625861] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 12:40:34 juju-e4d256-prod-github-runner-207 kernel: [26208.626773] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 12:40:34 juju-e4d256-prod-github-runner-207 kernel: [26208.627700] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 12:40:34 juju-e4d256-prod-github-runner-207 kernel: [26208.628634] Aug 22 12:41:02 juju-e4d256-prod-github-runner-207 kernel: [26236.541998] watchdog: BUG: soft lockup - CPU#1 stuck for 24326s! [qemu-system-x86:6715] Aug 22 12:41:02 juju-e4d256-prod-github-runner-207 kernel: [26236.543126] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 12:41:02 juju-e4d256-prod-github-runner-207 kernel: [26236.543203] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 12:41:02 juju-e4d256-prod-github-runner-207 kernel: [26236.555325] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 12:41:02 juju-e4d256-prod-github-runner-207 kernel: [26236.556586] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 12:41:02 juju-e4d256-prod-github-runner-207 kernel: [26236.557836] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:41:02 juju-e4d256-prod-github-runner-207 kernel: [26236.558906] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 12:41:02 juju-e4d256-prod-github-runner-207 kernel: [26236.561459] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 12:41:02 juju-e4d256-prod-github-runner-207 kernel: [26236.562534] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 12:41:02 juju-e4d256-prod-github-runner-207 kernel: [26236.563697] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 12:41:02 juju-e4d256-prod-github-runner-207 kernel: [26236.564862] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 12:41:02 juju-e4d256-prod-github-runner-207 kernel: [26236.566028] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 12:41:02 juju-e4d256-prod-github-runner-207 kernel: [26236.567192] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 12:41:02 juju-e4d256-prod-github-runner-207 kernel: [26236.568361] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 12:41:02 juju-e4d256-prod-github-runner-207 kernel: [26236.569600] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 12:41:02 juju-e4d256-prod-github-runner-207 kernel: [26236.570694] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 12:41:02 juju-e4d256-prod-github-runner-207 kernel: [26236.571889] Call Trace: Aug 22 12:41:02 juju-e4d256-prod-github-runner-207 kernel: [26236.573000] Aug 22 12:41:02 juju-e4d256-prod-github-runner-207 kernel: [26236.574099] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:41:02 juju-e4d256-prod-github-runner-207 kernel: [26236.575172] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:41:02 juju-e4d256-prod-github-runner-207 kernel: [26236.576210] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:41:02 juju-e4d256-prod-github-runner-207 kernel: [26236.577315] ? show_regs.part.0+0x23/0x29 Aug 22 12:41:02 juju-e4d256-prod-github-runner-207 kernel: [26236.578319] ? show_regs.cold+0x8/0xd Aug 22 12:41:02 juju-e4d256-prod-github-runner-207 kernel: [26236.579296] ? watchdog_timer_fn+0x1be/0x220 Aug 22 12:41:02 juju-e4d256-prod-github-runner-207 kernel: [26236.580305] ? lockup_detector_update_enable+0x60/0x60 Aug 22 12:41:02 juju-e4d256-prod-github-runner-207 kernel: [26236.581384] ? __hrtimer_run_queues+0x107/0x230 Aug 22 12:41:02 juju-e4d256-prod-github-runner-207 kernel: [26236.582415] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 12:41:02 juju-e4d256-prod-github-runner-207 kernel: [26236.583438] ? hrtimer_interrupt+0x101/0x220 Aug 22 12:41:02 juju-e4d256-prod-github-runner-207 kernel: [26236.584454] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 12:41:02 juju-e4d256-prod-github-runner-207 kernel: [26236.585546] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 12:41:02 juju-e4d256-prod-github-runner-207 kernel: [26236.586680] Aug 22 12:41:02 juju-e4d256-prod-github-runner-207 kernel: [26236.587785] Aug 22 12:41:02 juju-e4d256-prod-github-runner-207 kernel: [26236.588869] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 12:41:02 juju-e4d256-prod-github-runner-207 kernel: [26236.590037] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:41:02 juju-e4d256-prod-github-runner-207 kernel: [26236.591099] ? _raw_spin_lock+0x22/0x30 Aug 22 12:41:02 juju-e4d256-prod-github-runner-207 kernel: [26236.592050] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:41:02 juju-e4d256-prod-github-runner-207 kernel: [26236.593089] direct_page_fault+0x206/0x310 [kvm] Aug 22 12:41:02 juju-e4d256-prod-github-runner-207 kernel: [26236.594114] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 12:41:02 juju-e4d256-prod-github-runner-207 kernel: [26236.595143] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 12:41:02 juju-e4d256-prod-github-runner-207 kernel: [26236.596148] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 12:41:02 juju-e4d256-prod-github-runner-207 kernel: [26236.597136] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 12:41:02 juju-e4d256-prod-github-runner-207 kernel: [26236.598081] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 12:41:02 juju-e4d256-prod-github-runner-207 kernel: [26236.599058] handle_exit+0x98/0x230 [kvm_amd] Aug 22 12:41:02 juju-e4d256-prod-github-runner-207 kernel: [26236.599975] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 12:41:02 juju-e4d256-prod-github-runner-207 kernel: [26236.600986] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 12:41:02 juju-e4d256-prod-github-runner-207 kernel: [26236.601934] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 12:41:02 juju-e4d256-prod-github-runner-207 kernel: [26236.602841] vcpu_run+0x62/0x2c0 [kvm] Aug 22 12:41:02 juju-e4d256-prod-github-runner-207 kernel: [26236.603652] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 12:41:02 juju-e4d256-prod-github-runner-207 kernel: [26236.604463] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 12:41:02 juju-e4d256-prod-github-runner-207 kernel: [26236.605335] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 12:41:02 juju-e4d256-prod-github-runner-207 kernel: [26236.606138] ? __seccomp_filter+0x4a/0x4a0 Aug 22 12:41:02 juju-e4d256-prod-github-runner-207 kernel: [26236.606897] ? __fget_files+0x86/0xc0 Aug 22 12:41:02 juju-e4d256-prod-github-runner-207 kernel: [26236.607601] __x64_sys_ioctl+0x95/0xd0 Aug 22 12:41:02 juju-e4d256-prod-github-runner-207 kernel: [26236.608299] do_syscall_64+0x5c/0xc0 Aug 22 12:41:02 juju-e4d256-prod-github-runner-207 kernel: [26236.608989] ? do_futex+0x162/0x1f0 Aug 22 12:41:02 juju-e4d256-prod-github-runner-207 kernel: [26236.609641] ? __x64_sys_futex+0x78/0x1e0 Aug 22 12:41:02 juju-e4d256-prod-github-runner-207 kernel: [26236.610329] ? __secure_computing+0xa9/0x120 Aug 22 12:41:02 juju-e4d256-prod-github-runner-207 kernel: [26236.611054] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 12:41:02 juju-e4d256-prod-github-runner-207 kernel: [26236.611834] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:41:02 juju-e4d256-prod-github-runner-207 kernel: [26236.612555] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:41:02 juju-e4d256-prod-github-runner-207 kernel: [26236.613370] ? do_syscall_64+0x69/0xc0 Aug 22 12:41:02 juju-e4d256-prod-github-runner-207 kernel: [26236.614031] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:41:02 juju-e4d256-prod-github-runner-207 kernel: [26236.614759] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:41:02 juju-e4d256-prod-github-runner-207 kernel: [26236.615457] ? do_syscall_64+0x69/0xc0 Aug 22 12:41:02 juju-e4d256-prod-github-runner-207 kernel: [26236.616084] ? do_syscall_64+0x69/0xc0 Aug 22 12:41:02 juju-e4d256-prod-github-runner-207 kernel: [26236.616751] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 12:41:02 juju-e4d256-prod-github-runner-207 kernel: [26236.617479] RIP: 0033:0x7faa5d0edaff Aug 22 12:41:02 juju-e4d256-prod-github-runner-207 kernel: [26236.618122] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 12:41:02 juju-e4d256-prod-github-runner-207 kernel: [26236.620114] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 12:41:02 juju-e4d256-prod-github-runner-207 kernel: [26236.621051] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 12:41:02 juju-e4d256-prod-github-runner-207 kernel: [26236.621942] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 12:41:02 juju-e4d256-prod-github-runner-207 kernel: [26236.622834] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 12:41:02 juju-e4d256-prod-github-runner-207 kernel: [26236.623724] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 12:41:02 juju-e4d256-prod-github-runner-207 kernel: [26236.624611] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 12:41:02 juju-e4d256-prod-github-runner-207 kernel: [26236.625517] Aug 22 12:41:30 juju-e4d256-prod-github-runner-207 kernel: [26264.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 24352s! [qemu-system-x86:6715] Aug 22 12:41:30 juju-e4d256-prod-github-runner-207 kernel: [26264.543099] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 12:41:30 juju-e4d256-prod-github-runner-207 kernel: [26264.543172] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 12:41:30 juju-e4d256-prod-github-runner-207 kernel: [26264.555674] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 12:41:30 juju-e4d256-prod-github-runner-207 kernel: [26264.557021] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 12:41:30 juju-e4d256-prod-github-runner-207 kernel: [26264.558258] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:41:30 juju-e4d256-prod-github-runner-207 kernel: [26264.559326] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 12:41:30 juju-e4d256-prod-github-runner-207 kernel: [26264.561916] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 12:41:30 juju-e4d256-prod-github-runner-207 kernel: [26264.562980] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 12:41:30 juju-e4d256-prod-github-runner-207 kernel: [26264.564164] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 12:41:30 juju-e4d256-prod-github-runner-207 kernel: [26264.565385] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 12:41:30 juju-e4d256-prod-github-runner-207 kernel: [26264.566560] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 12:41:30 juju-e4d256-prod-github-runner-207 kernel: [26264.567734] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 12:41:30 juju-e4d256-prod-github-runner-207 kernel: [26264.568927] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 12:41:30 juju-e4d256-prod-github-runner-207 kernel: [26264.570181] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 12:41:30 juju-e4d256-prod-github-runner-207 kernel: [26264.571320] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 12:41:30 juju-e4d256-prod-github-runner-207 kernel: [26264.572540] Call Trace: Aug 22 12:41:30 juju-e4d256-prod-github-runner-207 kernel: [26264.573458] Aug 22 12:41:30 juju-e4d256-prod-github-runner-207 kernel: [26264.574343] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:41:30 juju-e4d256-prod-github-runner-207 kernel: [26264.575383] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:41:30 juju-e4d256-prod-github-runner-207 kernel: [26264.576415] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:41:30 juju-e4d256-prod-github-runner-207 kernel: [26264.577502] ? show_regs.part.0+0x23/0x29 Aug 22 12:41:30 juju-e4d256-prod-github-runner-207 kernel: [26264.578503] ? show_regs.cold+0x8/0xd Aug 22 12:41:30 juju-e4d256-prod-github-runner-207 kernel: [26264.579491] ? watchdog_timer_fn+0x1be/0x220 Aug 22 12:41:30 juju-e4d256-prod-github-runner-207 kernel: [26264.580506] ? lockup_detector_update_enable+0x60/0x60 Aug 22 12:41:30 juju-e4d256-prod-github-runner-207 kernel: [26264.581601] ? __hrtimer_run_queues+0x107/0x230 Aug 22 12:41:30 juju-e4d256-prod-github-runner-207 kernel: [26264.582635] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 12:41:30 juju-e4d256-prod-github-runner-207 kernel: [26264.583848] ? hrtimer_interrupt+0x101/0x220 Aug 22 12:41:30 juju-e4d256-prod-github-runner-207 kernel: [26264.584906] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 12:41:30 juju-e4d256-prod-github-runner-207 kernel: [26264.585986] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 12:41:30 juju-e4d256-prod-github-runner-207 kernel: [26264.587072] Aug 22 12:41:30 juju-e4d256-prod-github-runner-207 kernel: [26264.587926] Aug 22 12:41:30 juju-e4d256-prod-github-runner-207 kernel: [26264.588773] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 12:41:30 juju-e4d256-prod-github-runner-207 kernel: [26264.589822] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:41:30 juju-e4d256-prod-github-runner-207 kernel: [26264.590873] ? _raw_spin_lock+0x22/0x30 Aug 22 12:41:30 juju-e4d256-prod-github-runner-207 kernel: [26264.591824] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:41:30 juju-e4d256-prod-github-runner-207 kernel: [26264.592871] direct_page_fault+0x206/0x310 [kvm] Aug 22 12:41:30 juju-e4d256-prod-github-runner-207 kernel: [26264.593903] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 12:41:30 juju-e4d256-prod-github-runner-207 kernel: [26264.594918] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 12:41:30 juju-e4d256-prod-github-runner-207 kernel: [26264.595925] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 12:41:30 juju-e4d256-prod-github-runner-207 kernel: [26264.596980] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 12:41:30 juju-e4d256-prod-github-runner-207 kernel: [26264.597935] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 12:41:30 juju-e4d256-prod-github-runner-207 kernel: [26264.598926] handle_exit+0x98/0x230 [kvm_amd] Aug 22 12:41:30 juju-e4d256-prod-github-runner-207 kernel: [26264.599835] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 12:41:30 juju-e4d256-prod-github-runner-207 kernel: [26264.600762] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 12:41:30 juju-e4d256-prod-github-runner-207 kernel: [26264.601701] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 12:41:30 juju-e4d256-prod-github-runner-207 kernel: [26264.602622] vcpu_run+0x62/0x2c0 [kvm] Aug 22 12:41:30 juju-e4d256-prod-github-runner-207 kernel: [26264.603438] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 12:41:30 juju-e4d256-prod-github-runner-207 kernel: [26264.604259] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 12:41:30 juju-e4d256-prod-github-runner-207 kernel: [26264.605138] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 12:41:30 juju-e4d256-prod-github-runner-207 kernel: [26264.605945] ? __seccomp_filter+0x4a/0x4a0 Aug 22 12:41:30 juju-e4d256-prod-github-runner-207 kernel: [26264.606692] ? __fget_files+0x86/0xc0 Aug 22 12:41:30 juju-e4d256-prod-github-runner-207 kernel: [26264.607400] __x64_sys_ioctl+0x95/0xd0 Aug 22 12:41:30 juju-e4d256-prod-github-runner-207 kernel: [26264.608098] do_syscall_64+0x5c/0xc0 Aug 22 12:41:30 juju-e4d256-prod-github-runner-207 kernel: [26264.608777] ? do_futex+0x162/0x1f0 Aug 22 12:41:30 juju-e4d256-prod-github-runner-207 kernel: [26264.609435] ? __x64_sys_futex+0x78/0x1e0 Aug 22 12:41:30 juju-e4d256-prod-github-runner-207 kernel: [26264.610126] ? __secure_computing+0xa9/0x120 Aug 22 12:41:30 juju-e4d256-prod-github-runner-207 kernel: [26264.610829] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 12:41:30 juju-e4d256-prod-github-runner-207 kernel: [26264.611603] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:41:30 juju-e4d256-prod-github-runner-207 kernel: [26264.612332] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:41:30 juju-e4d256-prod-github-runner-207 kernel: [26264.613062] ? do_syscall_64+0x69/0xc0 Aug 22 12:41:30 juju-e4d256-prod-github-runner-207 kernel: [26264.613712] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:41:30 juju-e4d256-prod-github-runner-207 kernel: [26264.614426] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:41:30 juju-e4d256-prod-github-runner-207 kernel: [26264.615129] ? do_syscall_64+0x69/0xc0 Aug 22 12:41:30 juju-e4d256-prod-github-runner-207 kernel: [26264.615759] ? do_syscall_64+0x69/0xc0 Aug 22 12:41:30 juju-e4d256-prod-github-runner-207 kernel: [26264.616386] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 12:41:30 juju-e4d256-prod-github-runner-207 kernel: [26264.617114] RIP: 0033:0x7faa5d0edaff Aug 22 12:41:30 juju-e4d256-prod-github-runner-207 kernel: [26264.617743] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 12:41:30 juju-e4d256-prod-github-runner-207 kernel: [26264.619762] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 12:41:30 juju-e4d256-prod-github-runner-207 kernel: [26264.620696] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 12:41:30 juju-e4d256-prod-github-runner-207 kernel: [26264.621598] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 12:41:30 juju-e4d256-prod-github-runner-207 kernel: [26264.622498] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 12:41:30 juju-e4d256-prod-github-runner-207 kernel: [26264.623405] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 12:41:30 juju-e4d256-prod-github-runner-207 kernel: [26264.624304] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 12:41:30 juju-e4d256-prod-github-runner-207 kernel: [26264.625214] Aug 22 12:41:45 juju-e4d256-prod-github-runner-207 kernel: [26278.940708] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 12:41:45 juju-e4d256-prod-github-runner-207 kernel: [26278.941763] rcu: 1-....: (6520044 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=3154234 Aug 22 12:41:45 juju-e4d256-prod-github-runner-207 kernel: [26278.942908] (t=6540435 jiffies g=23269 q=30666) Aug 22 12:41:45 juju-e4d256-prod-github-runner-207 kernel: [26278.943699] NMI backtrace for cpu 1 Aug 22 12:41:45 juju-e4d256-prod-github-runner-207 kernel: [26278.944426] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 12:41:45 juju-e4d256-prod-github-runner-207 kernel: [26278.945552] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 12:41:45 juju-e4d256-prod-github-runner-207 kernel: [26278.946623] Call Trace: Aug 22 12:41:45 juju-e4d256-prod-github-runner-207 kernel: [26278.947297] Aug 22 12:41:45 juju-e4d256-prod-github-runner-207 kernel: [26278.947941] show_stack+0x52/0x5c Aug 22 12:41:45 juju-e4d256-prod-github-runner-207 kernel: [26278.948686] dump_stack_lvl+0x4a/0x63 Aug 22 12:41:45 juju-e4d256-prod-github-runner-207 kernel: [26278.949431] dump_stack+0x10/0x16 Aug 22 12:41:45 juju-e4d256-prod-github-runner-207 kernel: [26278.950168] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 12:41:45 juju-e4d256-prod-github-runner-207 kernel: [26278.950962] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 12:41:45 juju-e4d256-prod-github-runner-207 kernel: [26278.951741] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 12:41:45 juju-e4d256-prod-github-runner-207 kernel: [26278.952614] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 12:41:45 juju-e4d256-prod-github-runner-207 kernel: [26278.953437] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 12:41:45 juju-e4d256-prod-github-runner-207 kernel: [26278.954245] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 12:41:45 juju-e4d256-prod-github-runner-207 kernel: [26278.955060] print_cpu_stall.cold+0x2f/0xe2 Aug 22 12:41:45 juju-e4d256-prod-github-runner-207 kernel: [26278.955832] ? timekeeping_update+0xf7/0x150 Aug 22 12:41:45 juju-e4d256-prod-github-runner-207 kernel: [26278.956708] check_cpu_stall+0x109/0x270 Aug 22 12:41:45 juju-e4d256-prod-github-runner-207 kernel: [26278.957571] rcu_sched_clock_irq+0x9a/0x250 Aug 22 12:41:45 juju-e4d256-prod-github-runner-207 kernel: [26278.958331] update_process_times+0x94/0xd0 Aug 22 12:41:45 juju-e4d256-prod-github-runner-207 kernel: [26278.959107] tick_sched_handle+0x29/0x70 Aug 22 12:41:45 juju-e4d256-prod-github-runner-207 kernel: [26278.959862] tick_sched_timer+0x8c/0xc0 Aug 22 12:41:45 juju-e4d256-prod-github-runner-207 kernel: [26278.960645] ? tick_nohz_handler+0xb0/0xb0 Aug 22 12:41:45 juju-e4d256-prod-github-runner-207 kernel: [26278.961418] __hrtimer_run_queues+0x107/0x230 Aug 22 12:41:45 juju-e4d256-prod-github-runner-207 kernel: [26278.962192] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 12:41:45 juju-e4d256-prod-github-runner-207 kernel: [26278.962966] hrtimer_interrupt+0x101/0x220 Aug 22 12:41:45 juju-e4d256-prod-github-runner-207 kernel: [26278.963727] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 12:41:45 juju-e4d256-prod-github-runner-207 kernel: [26278.964556] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 12:41:45 juju-e4d256-prod-github-runner-207 kernel: [26278.965379] Aug 22 12:41:45 juju-e4d256-prod-github-runner-207 kernel: [26278.966017] Aug 22 12:41:45 juju-e4d256-prod-github-runner-207 kernel: [26278.966655] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 12:41:45 juju-e4d256-prod-github-runner-207 kernel: [26278.967503] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:41:45 juju-e4d256-prod-github-runner-207 kernel: [26278.968399] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 12:41:45 juju-e4d256-prod-github-runner-207 kernel: [26278.970684] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 12:41:45 juju-e4d256-prod-github-runner-207 kernel: [26278.971823] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 12:41:45 juju-e4d256-prod-github-runner-207 kernel: [26278.973028] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 12:41:45 juju-e4d256-prod-github-runner-207 kernel: [26278.974133] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 12:41:45 juju-e4d256-prod-github-runner-207 kernel: [26278.975229] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 12:41:45 juju-e4d256-prod-github-runner-207 kernel: [26278.976316] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 12:41:45 juju-e4d256-prod-github-runner-207 kernel: [26278.977412] ? _raw_spin_lock+0x22/0x30 Aug 22 12:41:45 juju-e4d256-prod-github-runner-207 kernel: [26278.978252] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:41:45 juju-e4d256-prod-github-runner-207 kernel: [26278.979189] direct_page_fault+0x206/0x310 [kvm] Aug 22 12:41:45 juju-e4d256-prod-github-runner-207 kernel: [26278.980115] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 12:41:45 juju-e4d256-prod-github-runner-207 kernel: [26278.981038] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 12:41:45 juju-e4d256-prod-github-runner-207 kernel: [26278.981964] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 12:41:45 juju-e4d256-prod-github-runner-207 kernel: [26278.982877] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 12:41:45 juju-e4d256-prod-github-runner-207 kernel: [26278.983764] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 12:41:45 juju-e4d256-prod-github-runner-207 kernel: [26278.984705] handle_exit+0x98/0x230 [kvm_amd] Aug 22 12:41:45 juju-e4d256-prod-github-runner-207 kernel: [26278.985547] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 12:41:45 juju-e4d256-prod-github-runner-207 kernel: [26278.986421] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 12:41:45 juju-e4d256-prod-github-runner-207 kernel: [26278.987313] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 12:41:45 juju-e4d256-prod-github-runner-207 kernel: [26278.988192] vcpu_run+0x62/0x2c0 [kvm] Aug 22 12:41:45 juju-e4d256-prod-github-runner-207 kernel: [26278.988997] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 12:41:45 juju-e4d256-prod-github-runner-207 kernel: [26278.989814] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 12:41:45 juju-e4d256-prod-github-runner-207 kernel: [26278.990709] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 12:41:45 juju-e4d256-prod-github-runner-207 kernel: [26278.991555] ? __seccomp_filter+0x4a/0x4a0 Aug 22 12:41:45 juju-e4d256-prod-github-runner-207 kernel: [26278.992365] ? __fget_files+0x86/0xc0 Aug 22 12:41:45 juju-e4d256-prod-github-runner-207 kernel: [26278.993134] __x64_sys_ioctl+0x95/0xd0 Aug 22 12:41:45 juju-e4d256-prod-github-runner-207 kernel: [26278.993902] do_syscall_64+0x5c/0xc0 Aug 22 12:41:45 juju-e4d256-prod-github-runner-207 kernel: [26278.994656] ? do_futex+0x162/0x1f0 Aug 22 12:41:45 juju-e4d256-prod-github-runner-207 kernel: [26278.995395] ? __x64_sys_futex+0x78/0x1e0 Aug 22 12:41:45 juju-e4d256-prod-github-runner-207 kernel: [26278.996175] ? __secure_computing+0xa9/0x120 Aug 22 12:41:45 juju-e4d256-prod-github-runner-207 kernel: [26278.996983] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 12:41:45 juju-e4d256-prod-github-runner-207 kernel: [26278.997924] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:41:45 juju-e4d256-prod-github-runner-207 kernel: [26278.998875] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:41:45 juju-e4d256-prod-github-runner-207 kernel: [26278.999723] ? do_syscall_64+0x69/0xc0 Aug 22 12:41:45 juju-e4d256-prod-github-runner-207 kernel: [26279.000510] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:41:45 juju-e4d256-prod-github-runner-207 kernel: [26279.001360] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:41:45 juju-e4d256-prod-github-runner-207 kernel: [26279.002207] ? do_syscall_64+0x69/0xc0 Aug 22 12:41:45 juju-e4d256-prod-github-runner-207 kernel: [26279.002975] ? do_syscall_64+0x69/0xc0 Aug 22 12:41:45 juju-e4d256-prod-github-runner-207 kernel: [26279.003736] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 12:41:45 juju-e4d256-prod-github-runner-207 kernel: [26279.004614] RIP: 0033:0x7faa5d0edaff Aug 22 12:41:45 juju-e4d256-prod-github-runner-207 kernel: [26279.005391] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 12:41:45 juju-e4d256-prod-github-runner-207 kernel: [26279.007821] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 12:41:45 juju-e4d256-prod-github-runner-207 kernel: [26279.008945] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 12:41:45 juju-e4d256-prod-github-runner-207 kernel: [26279.010087] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 12:41:45 juju-e4d256-prod-github-runner-207 kernel: [26279.011177] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 12:41:45 juju-e4d256-prod-github-runner-207 kernel: [26279.012256] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 12:41:45 juju-e4d256-prod-github-runner-207 kernel: [26279.013322] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 12:41:45 juju-e4d256-prod-github-runner-207 kernel: [26279.014391] Aug 22 12:42:10 juju-e4d256-prod-github-runner-207 kernel: [26304.541982] watchdog: BUG: soft lockup - CPU#1 stuck for 24390s! [qemu-system-x86:6715] Aug 22 12:42:10 juju-e4d256-prod-github-runner-207 kernel: [26304.543874] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 12:42:10 juju-e4d256-prod-github-runner-207 kernel: [26304.544193] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 12:42:10 juju-e4d256-prod-github-runner-207 kernel: [26304.556788] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 12:42:10 juju-e4d256-prod-github-runner-207 kernel: [26304.558187] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 12:42:10 juju-e4d256-prod-github-runner-207 kernel: [26304.559445] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:42:10 juju-e4d256-prod-github-runner-207 kernel: [26304.560629] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 12:42:10 juju-e4d256-prod-github-runner-207 kernel: [26304.563258] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 12:42:10 juju-e4d256-prod-github-runner-207 kernel: [26304.564376] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 12:42:10 juju-e4d256-prod-github-runner-207 kernel: [26304.565571] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 12:42:10 juju-e4d256-prod-github-runner-207 kernel: [26304.566750] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 12:42:10 juju-e4d256-prod-github-runner-207 kernel: [26304.567949] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 12:42:10 juju-e4d256-prod-github-runner-207 kernel: [26304.569173] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 12:42:10 juju-e4d256-prod-github-runner-207 kernel: [26304.570617] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 12:42:10 juju-e4d256-prod-github-runner-207 kernel: [26304.571953] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 12:42:10 juju-e4d256-prod-github-runner-207 kernel: [26304.573165] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 12:42:10 juju-e4d256-prod-github-runner-207 kernel: [26304.574415] Call Trace: Aug 22 12:42:10 juju-e4d256-prod-github-runner-207 kernel: [26304.575349] Aug 22 12:42:10 juju-e4d256-prod-github-runner-207 kernel: [26304.576297] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:42:10 juju-e4d256-prod-github-runner-207 kernel: [26304.577393] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:42:10 juju-e4d256-prod-github-runner-207 kernel: [26304.578446] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:42:10 juju-e4d256-prod-github-runner-207 kernel: [26304.579575] ? show_regs.part.0+0x23/0x29 Aug 22 12:42:10 juju-e4d256-prod-github-runner-207 kernel: [26304.580611] ? show_regs.cold+0x8/0xd Aug 22 12:42:10 juju-e4d256-prod-github-runner-207 kernel: [26304.581607] ? watchdog_timer_fn+0x1be/0x220 Aug 22 12:42:10 juju-e4d256-prod-github-runner-207 kernel: [26304.582631] ? lockup_detector_update_enable+0x60/0x60 Aug 22 12:42:10 juju-e4d256-prod-github-runner-207 kernel: [26304.583727] ? __hrtimer_run_queues+0x107/0x230 Aug 22 12:42:10 juju-e4d256-prod-github-runner-207 kernel: [26304.584801] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 12:42:10 juju-e4d256-prod-github-runner-207 kernel: [26304.585851] ? hrtimer_interrupt+0x101/0x220 Aug 22 12:42:10 juju-e4d256-prod-github-runner-207 kernel: [26304.587078] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 12:42:10 juju-e4d256-prod-github-runner-207 kernel: [26304.588400] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 12:42:10 juju-e4d256-prod-github-runner-207 kernel: [26304.589506] Aug 22 12:42:10 juju-e4d256-prod-github-runner-207 kernel: [26304.590378] Aug 22 12:42:10 juju-e4d256-prod-github-runner-207 kernel: [26304.591227] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 12:42:10 juju-e4d256-prod-github-runner-207 kernel: [26304.592297] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:42:10 juju-e4d256-prod-github-runner-207 kernel: [26304.593433] ? _raw_spin_lock+0x22/0x30 Aug 22 12:42:10 juju-e4d256-prod-github-runner-207 kernel: [26304.594405] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:42:10 juju-e4d256-prod-github-runner-207 kernel: [26304.595466] direct_page_fault+0x206/0x310 [kvm] Aug 22 12:42:10 juju-e4d256-prod-github-runner-207 kernel: [26304.596534] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 12:42:10 juju-e4d256-prod-github-runner-207 kernel: [26304.597599] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 12:42:10 juju-e4d256-prod-github-runner-207 kernel: [26304.598676] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 12:42:10 juju-e4d256-prod-github-runner-207 kernel: [26304.599723] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 12:42:10 juju-e4d256-prod-github-runner-207 kernel: [26304.600805] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 12:42:10 juju-e4d256-prod-github-runner-207 kernel: [26304.602074] handle_exit+0x98/0x230 [kvm_amd] Aug 22 12:42:10 juju-e4d256-prod-github-runner-207 kernel: [26304.603039] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 12:42:10 juju-e4d256-prod-github-runner-207 kernel: [26304.604224] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 12:42:10 juju-e4d256-prod-github-runner-207 kernel: [26304.605360] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 12:42:10 juju-e4d256-prod-github-runner-207 kernel: [26304.606309] vcpu_run+0x62/0x2c0 [kvm] Aug 22 12:42:10 juju-e4d256-prod-github-runner-207 kernel: [26304.607150] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 12:42:10 juju-e4d256-prod-github-runner-207 kernel: [26304.607986] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 12:42:10 juju-e4d256-prod-github-runner-207 kernel: [26304.608889] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 12:42:10 juju-e4d256-prod-github-runner-207 kernel: [26304.609718] ? __seccomp_filter+0x4a/0x4a0 Aug 22 12:42:10 juju-e4d256-prod-github-runner-207 kernel: [26304.610488] ? __fget_files+0x86/0xc0 Aug 22 12:42:10 juju-e4d256-prod-github-runner-207 kernel: [26304.611208] __x64_sys_ioctl+0x95/0xd0 Aug 22 12:42:10 juju-e4d256-prod-github-runner-207 kernel: [26304.611912] do_syscall_64+0x5c/0xc0 Aug 22 12:42:10 juju-e4d256-prod-github-runner-207 kernel: [26304.612606] ? do_futex+0x162/0x1f0 Aug 22 12:42:10 juju-e4d256-prod-github-runner-207 kernel: [26304.613333] ? __x64_sys_futex+0x78/0x1e0 Aug 22 12:42:10 juju-e4d256-prod-github-runner-207 kernel: [26304.614023] ? __secure_computing+0xa9/0x120 Aug 22 12:42:10 juju-e4d256-prod-github-runner-207 kernel: [26304.614738] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 12:42:10 juju-e4d256-prod-github-runner-207 kernel: [26304.615630] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:42:10 juju-e4d256-prod-github-runner-207 kernel: [26304.616406] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:42:10 juju-e4d256-prod-github-runner-207 kernel: [26304.617166] ? do_syscall_64+0x69/0xc0 Aug 22 12:42:10 juju-e4d256-prod-github-runner-207 kernel: [26304.617829] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:42:10 juju-e4d256-prod-github-runner-207 kernel: [26304.618556] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:42:10 juju-e4d256-prod-github-runner-207 kernel: [26304.619268] ? do_syscall_64+0x69/0xc0 Aug 22 12:42:10 juju-e4d256-prod-github-runner-207 kernel: [26304.620000] ? do_syscall_64+0x69/0xc0 Aug 22 12:42:10 juju-e4d256-prod-github-runner-207 kernel: [26304.620745] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 12:42:10 juju-e4d256-prod-github-runner-207 kernel: [26304.621473] RIP: 0033:0x7faa5d0edaff Aug 22 12:42:10 juju-e4d256-prod-github-runner-207 kernel: [26304.622129] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 12:42:10 juju-e4d256-prod-github-runner-207 kernel: [26304.624221] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 12:42:10 juju-e4d256-prod-github-runner-207 kernel: [26304.625189] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 12:42:10 juju-e4d256-prod-github-runner-207 kernel: [26304.626123] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 12:42:10 juju-e4d256-prod-github-runner-207 kernel: [26304.627042] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 12:42:10 juju-e4d256-prod-github-runner-207 kernel: [26304.627977] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 12:42:10 juju-e4d256-prod-github-runner-207 kernel: [26304.628922] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 12:42:10 juju-e4d256-prod-github-runner-207 kernel: [26304.629899] Aug 22 12:42:38 juju-e4d256-prod-github-runner-207 kernel: [26332.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 24416s! [qemu-system-x86:6715] Aug 22 12:42:38 juju-e4d256-prod-github-runner-207 kernel: [26332.543110] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 12:42:38 juju-e4d256-prod-github-runner-207 kernel: [26332.543187] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 12:42:38 juju-e4d256-prod-github-runner-207 kernel: [26332.555377] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 12:42:38 juju-e4d256-prod-github-runner-207 kernel: [26332.556670] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 12:42:38 juju-e4d256-prod-github-runner-207 kernel: [26332.557903] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:42:38 juju-e4d256-prod-github-runner-207 kernel: [26332.558963] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 12:42:38 juju-e4d256-prod-github-runner-207 kernel: [26332.561783] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 12:42:38 juju-e4d256-prod-github-runner-207 kernel: [26332.562845] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 12:42:38 juju-e4d256-prod-github-runner-207 kernel: [26332.564027] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 12:42:38 juju-e4d256-prod-github-runner-207 kernel: [26332.565185] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 12:42:38 juju-e4d256-prod-github-runner-207 kernel: [26332.566345] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 12:42:38 juju-e4d256-prod-github-runner-207 kernel: [26332.567506] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 12:42:38 juju-e4d256-prod-github-runner-207 kernel: [26332.568687] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 12:42:38 juju-e4d256-prod-github-runner-207 kernel: [26332.569918] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 12:42:38 juju-e4d256-prod-github-runner-207 kernel: [26332.571013] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 12:42:38 juju-e4d256-prod-github-runner-207 kernel: [26332.572220] Call Trace: Aug 22 12:42:38 juju-e4d256-prod-github-runner-207 kernel: [26332.573135] Aug 22 12:42:38 juju-e4d256-prod-github-runner-207 kernel: [26332.574029] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:42:38 juju-e4d256-prod-github-runner-207 kernel: [26332.575070] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:42:38 juju-e4d256-prod-github-runner-207 kernel: [26332.576120] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:42:38 juju-e4d256-prod-github-runner-207 kernel: [26332.577206] ? show_regs.part.0+0x23/0x29 Aug 22 12:42:38 juju-e4d256-prod-github-runner-207 kernel: [26332.578211] ? show_regs.cold+0x8/0xd Aug 22 12:42:38 juju-e4d256-prod-github-runner-207 kernel: [26332.579190] ? watchdog_timer_fn+0x1be/0x220 Aug 22 12:42:38 juju-e4d256-prod-github-runner-207 kernel: [26332.580239] ? lockup_detector_update_enable+0x60/0x60 Aug 22 12:42:38 juju-e4d256-prod-github-runner-207 kernel: [26332.581313] ? __hrtimer_run_queues+0x107/0x230 Aug 22 12:42:38 juju-e4d256-prod-github-runner-207 kernel: [26332.582345] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 12:42:38 juju-e4d256-prod-github-runner-207 kernel: [26332.583382] ? hrtimer_interrupt+0x101/0x220 Aug 22 12:42:38 juju-e4d256-prod-github-runner-207 kernel: [26332.584424] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 12:42:38 juju-e4d256-prod-github-runner-207 kernel: [26332.585497] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 12:42:38 juju-e4d256-prod-github-runner-207 kernel: [26332.586553] Aug 22 12:42:38 juju-e4d256-prod-github-runner-207 kernel: [26332.587417] Aug 22 12:42:38 juju-e4d256-prod-github-runner-207 kernel: [26332.588275] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 12:42:38 juju-e4d256-prod-github-runner-207 kernel: [26332.589323] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:42:38 juju-e4d256-prod-github-runner-207 kernel: [26332.590380] ? _raw_spin_lock+0x22/0x30 Aug 22 12:42:38 juju-e4d256-prod-github-runner-207 kernel: [26332.591344] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:42:38 juju-e4d256-prod-github-runner-207 kernel: [26332.592381] direct_page_fault+0x206/0x310 [kvm] Aug 22 12:42:38 juju-e4d256-prod-github-runner-207 kernel: [26332.593412] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 12:42:38 juju-e4d256-prod-github-runner-207 kernel: [26332.594431] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 12:42:38 juju-e4d256-prod-github-runner-207 kernel: [26332.595447] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 12:42:38 juju-e4d256-prod-github-runner-207 kernel: [26332.596442] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 12:42:38 juju-e4d256-prod-github-runner-207 kernel: [26332.597406] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 12:42:38 juju-e4d256-prod-github-runner-207 kernel: [26332.598401] handle_exit+0x98/0x230 [kvm_amd] Aug 22 12:42:38 juju-e4d256-prod-github-runner-207 kernel: [26332.599312] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 12:42:38 juju-e4d256-prod-github-runner-207 kernel: [26332.600257] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 12:42:38 juju-e4d256-prod-github-runner-207 kernel: [26332.601195] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 12:42:38 juju-e4d256-prod-github-runner-207 kernel: [26332.602104] vcpu_run+0x62/0x2c0 [kvm] Aug 22 12:42:38 juju-e4d256-prod-github-runner-207 kernel: [26332.602922] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 12:42:38 juju-e4d256-prod-github-runner-207 kernel: [26332.603753] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 12:42:38 juju-e4d256-prod-github-runner-207 kernel: [26332.604612] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 12:42:38 juju-e4d256-prod-github-runner-207 kernel: [26332.605417] ? __seccomp_filter+0x4a/0x4a0 Aug 22 12:42:38 juju-e4d256-prod-github-runner-207 kernel: [26332.606168] ? __fget_files+0x86/0xc0 Aug 22 12:42:38 juju-e4d256-prod-github-runner-207 kernel: [26332.606880] __x64_sys_ioctl+0x95/0xd0 Aug 22 12:42:38 juju-e4d256-prod-github-runner-207 kernel: [26332.607577] do_syscall_64+0x5c/0xc0 Aug 22 12:42:38 juju-e4d256-prod-github-runner-207 kernel: [26332.608270] ? do_futex+0x162/0x1f0 Aug 22 12:42:38 juju-e4d256-prod-github-runner-207 kernel: [26332.608926] ? __x64_sys_futex+0x78/0x1e0 Aug 22 12:42:38 juju-e4d256-prod-github-runner-207 kernel: [26332.609609] ? __secure_computing+0xa9/0x120 Aug 22 12:42:38 juju-e4d256-prod-github-runner-207 kernel: [26332.610305] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 12:42:38 juju-e4d256-prod-github-runner-207 kernel: [26332.611075] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:42:38 juju-e4d256-prod-github-runner-207 kernel: [26332.611816] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:42:38 juju-e4d256-prod-github-runner-207 kernel: [26332.612543] ? do_syscall_64+0x69/0xc0 Aug 22 12:42:38 juju-e4d256-prod-github-runner-207 kernel: [26332.613198] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:42:38 juju-e4d256-prod-github-runner-207 kernel: [26332.613921] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:42:38 juju-e4d256-prod-github-runner-207 kernel: [26332.614625] ? do_syscall_64+0x69/0xc0 Aug 22 12:42:38 juju-e4d256-prod-github-runner-207 kernel: [26332.615258] ? do_syscall_64+0x69/0xc0 Aug 22 12:42:38 juju-e4d256-prod-github-runner-207 kernel: [26332.615902] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 12:42:38 juju-e4d256-prod-github-runner-207 kernel: [26332.616612] RIP: 0033:0x7faa5d0edaff Aug 22 12:42:38 juju-e4d256-prod-github-runner-207 kernel: [26332.617375] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 12:42:38 juju-e4d256-prod-github-runner-207 kernel: [26332.619370] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 12:42:38 juju-e4d256-prod-github-runner-207 kernel: [26332.620307] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 12:42:38 juju-e4d256-prod-github-runner-207 kernel: [26332.621202] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 12:42:38 juju-e4d256-prod-github-runner-207 kernel: [26332.622094] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 12:42:38 juju-e4d256-prod-github-runner-207 kernel: [26332.622992] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 12:42:38 juju-e4d256-prod-github-runner-207 kernel: [26332.623906] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 12:42:38 juju-e4d256-prod-github-runner-207 kernel: [26332.624987] Aug 22 12:43:06 juju-e4d256-prod-github-runner-207 kernel: [26360.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 24442s! [qemu-system-x86:6715] Aug 22 12:43:06 juju-e4d256-prod-github-runner-207 kernel: [26360.543296] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 12:43:06 juju-e4d256-prod-github-runner-207 kernel: [26360.543371] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 12:43:06 juju-e4d256-prod-github-runner-207 kernel: [26360.557323] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 12:43:06 juju-e4d256-prod-github-runner-207 kernel: [26360.558812] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 12:43:06 juju-e4d256-prod-github-runner-207 kernel: [26360.560265] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:43:06 juju-e4d256-prod-github-runner-207 kernel: [26360.561430] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 12:43:06 juju-e4d256-prod-github-runner-207 kernel: [26360.564495] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 12:43:06 juju-e4d256-prod-github-runner-207 kernel: [26360.565640] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 12:43:06 juju-e4d256-prod-github-runner-207 kernel: [26360.566938] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 12:43:06 juju-e4d256-prod-github-runner-207 kernel: [26360.568367] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 12:43:06 juju-e4d256-prod-github-runner-207 kernel: [26360.569659] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 12:43:06 juju-e4d256-prod-github-runner-207 kernel: [26360.570944] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 12:43:06 juju-e4d256-prod-github-runner-207 kernel: [26360.572277] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 12:43:06 juju-e4d256-prod-github-runner-207 kernel: [26360.573655] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 12:43:06 juju-e4d256-prod-github-runner-207 kernel: [26360.574858] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 12:43:06 juju-e4d256-prod-github-runner-207 kernel: [26360.576256] Call Trace: Aug 22 12:43:06 juju-e4d256-prod-github-runner-207 kernel: [26360.577219] Aug 22 12:43:06 juju-e4d256-prod-github-runner-207 kernel: [26360.578142] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:43:06 juju-e4d256-prod-github-runner-207 kernel: [26360.579255] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:43:06 juju-e4d256-prod-github-runner-207 kernel: [26360.580367] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:43:06 juju-e4d256-prod-github-runner-207 kernel: [26360.581548] ? show_regs.part.0+0x23/0x29 Aug 22 12:43:06 juju-e4d256-prod-github-runner-207 kernel: [26360.582625] ? show_regs.cold+0x8/0xd Aug 22 12:43:06 juju-e4d256-prod-github-runner-207 kernel: [26360.583683] ? watchdog_timer_fn+0x1be/0x220 Aug 22 12:43:06 juju-e4d256-prod-github-runner-207 kernel: [26360.584782] ? lockup_detector_update_enable+0x60/0x60 Aug 22 12:43:06 juju-e4d256-prod-github-runner-207 kernel: [26360.585948] ? __hrtimer_run_queues+0x107/0x230 Aug 22 12:43:06 juju-e4d256-prod-github-runner-207 kernel: [26360.587064] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 12:43:06 juju-e4d256-prod-github-runner-207 kernel: [26360.588219] ? hrtimer_interrupt+0x101/0x220 Aug 22 12:43:06 juju-e4d256-prod-github-runner-207 kernel: [26360.589320] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 12:43:06 juju-e4d256-prod-github-runner-207 kernel: [26360.590497] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 12:43:06 juju-e4d256-prod-github-runner-207 kernel: [26360.591667] Aug 22 12:43:06 juju-e4d256-prod-github-runner-207 kernel: [26360.592589] Aug 22 12:43:06 juju-e4d256-prod-github-runner-207 kernel: [26360.593471] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 12:43:06 juju-e4d256-prod-github-runner-207 kernel: [26360.594617] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:43:06 juju-e4d256-prod-github-runner-207 kernel: [26360.595772] ? _raw_spin_lock+0x22/0x30 Aug 22 12:43:06 juju-e4d256-prod-github-runner-207 kernel: [26360.596790] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:43:06 juju-e4d256-prod-github-runner-207 kernel: [26360.597908] direct_page_fault+0x206/0x310 [kvm] Aug 22 12:43:06 juju-e4d256-prod-github-runner-207 kernel: [26360.599036] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 12:43:06 juju-e4d256-prod-github-runner-207 kernel: [26360.600161] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 12:43:06 juju-e4d256-prod-github-runner-207 kernel: [26360.601258] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 12:43:06 juju-e4d256-prod-github-runner-207 kernel: [26360.602337] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 12:43:06 juju-e4d256-prod-github-runner-207 kernel: [26360.603404] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 12:43:06 juju-e4d256-prod-github-runner-207 kernel: [26360.604506] handle_exit+0x98/0x230 [kvm_amd] Aug 22 12:43:06 juju-e4d256-prod-github-runner-207 kernel: [26360.605530] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 12:43:06 juju-e4d256-prod-github-runner-207 kernel: [26360.606540] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 12:43:06 juju-e4d256-prod-github-runner-207 kernel: [26360.607579] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 12:43:06 juju-e4d256-prod-github-runner-207 kernel: [26360.608603] vcpu_run+0x62/0x2c0 [kvm] Aug 22 12:43:06 juju-e4d256-prod-github-runner-207 kernel: [26360.609499] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 12:43:06 juju-e4d256-prod-github-runner-207 kernel: [26360.610422] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 12:43:06 juju-e4d256-prod-github-runner-207 kernel: [26360.611384] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 12:43:06 juju-e4d256-prod-github-runner-207 kernel: [26360.612267] ? __seccomp_filter+0x4a/0x4a0 Aug 22 12:43:06 juju-e4d256-prod-github-runner-207 kernel: [26360.613094] ? __fget_files+0x86/0xc0 Aug 22 12:43:06 juju-e4d256-prod-github-runner-207 kernel: [26360.613874] __x64_sys_ioctl+0x95/0xd0 Aug 22 12:43:06 juju-e4d256-prod-github-runner-207 kernel: [26360.614639] do_syscall_64+0x5c/0xc0 Aug 22 12:43:06 juju-e4d256-prod-github-runner-207 kernel: [26360.615383] ? do_futex+0x162/0x1f0 Aug 22 12:43:06 juju-e4d256-prod-github-runner-207 kernel: [26360.616109] ? __x64_sys_futex+0x78/0x1e0 Aug 22 12:43:06 juju-e4d256-prod-github-runner-207 kernel: [26360.616872] ? __secure_computing+0xa9/0x120 Aug 22 12:43:06 juju-e4d256-prod-github-runner-207 kernel: [26360.617652] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 12:43:06 juju-e4d256-prod-github-runner-207 kernel: [26360.618516] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:43:06 juju-e4d256-prod-github-runner-207 kernel: [26360.619371] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:43:06 juju-e4d256-prod-github-runner-207 kernel: [26360.620181] ? do_syscall_64+0x69/0xc0 Aug 22 12:43:06 juju-e4d256-prod-github-runner-207 kernel: [26360.620900] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:43:06 juju-e4d256-prod-github-runner-207 kernel: [26360.621709] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:43:06 juju-e4d256-prod-github-runner-207 kernel: [26360.622498] ? do_syscall_64+0x69/0xc0 Aug 22 12:43:06 juju-e4d256-prod-github-runner-207 kernel: [26360.623199] ? do_syscall_64+0x69/0xc0 Aug 22 12:43:06 juju-e4d256-prod-github-runner-207 kernel: [26360.623933] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 12:43:06 juju-e4d256-prod-github-runner-207 kernel: [26360.624736] RIP: 0033:0x7faa5d0edaff Aug 22 12:43:06 juju-e4d256-prod-github-runner-207 kernel: [26360.625434] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 12:43:06 juju-e4d256-prod-github-runner-207 kernel: [26360.627791] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 12:43:06 juju-e4d256-prod-github-runner-207 kernel: [26360.628859] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 12:43:06 juju-e4d256-prod-github-runner-207 kernel: [26360.629893] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 12:43:06 juju-e4d256-prod-github-runner-207 kernel: [26360.630938] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 12:43:06 juju-e4d256-prod-github-runner-207 kernel: [26360.631970] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 12:43:06 juju-e4d256-prod-github-runner-207 kernel: [26360.632986] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 12:43:06 juju-e4d256-prod-github-runner-207 kernel: [26360.634032] Aug 22 12:43:34 juju-e4d256-prod-github-runner-207 kernel: [26388.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 24468s! [qemu-system-x86:6715] Aug 22 12:43:34 juju-e4d256-prod-github-runner-207 kernel: [26388.543833] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 12:43:34 juju-e4d256-prod-github-runner-207 kernel: [26388.544116] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 12:43:34 juju-e4d256-prod-github-runner-207 kernel: [26388.557326] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 12:43:34 juju-e4d256-prod-github-runner-207 kernel: [26388.558683] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 12:43:34 juju-e4d256-prod-github-runner-207 kernel: [26388.559912] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:43:34 juju-e4d256-prod-github-runner-207 kernel: [26388.560967] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 12:43:34 juju-e4d256-prod-github-runner-207 kernel: [26388.563664] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 12:43:34 juju-e4d256-prod-github-runner-207 kernel: [26388.564712] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 12:43:34 juju-e4d256-prod-github-runner-207 kernel: [26388.565872] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 12:43:34 juju-e4d256-prod-github-runner-207 kernel: [26388.567043] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 12:43:34 juju-e4d256-prod-github-runner-207 kernel: [26388.568211] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 12:43:34 juju-e4d256-prod-github-runner-207 kernel: [26388.569374] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 12:43:34 juju-e4d256-prod-github-runner-207 kernel: [26388.570541] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 12:43:34 juju-e4d256-prod-github-runner-207 kernel: [26388.571789] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 12:43:34 juju-e4d256-prod-github-runner-207 kernel: [26388.572887] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 12:43:34 juju-e4d256-prod-github-runner-207 kernel: [26388.574076] Call Trace: Aug 22 12:43:34 juju-e4d256-prod-github-runner-207 kernel: [26388.574999] Aug 22 12:43:34 juju-e4d256-prod-github-runner-207 kernel: [26388.575898] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:43:34 juju-e4d256-prod-github-runner-207 kernel: [26388.576974] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:43:34 juju-e4d256-prod-github-runner-207 kernel: [26388.578002] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:43:34 juju-e4d256-prod-github-runner-207 kernel: [26388.579115] ? show_regs.part.0+0x23/0x29 Aug 22 12:43:34 juju-e4d256-prod-github-runner-207 kernel: [26388.580114] ? show_regs.cold+0x8/0xd Aug 22 12:43:34 juju-e4d256-prod-github-runner-207 kernel: [26388.581084] ? watchdog_timer_fn+0x1be/0x220 Aug 22 12:43:34 juju-e4d256-prod-github-runner-207 kernel: [26388.582091] ? lockup_detector_update_enable+0x60/0x60 Aug 22 12:43:34 juju-e4d256-prod-github-runner-207 kernel: [26388.583195] ? __hrtimer_run_queues+0x107/0x230 Aug 22 12:43:34 juju-e4d256-prod-github-runner-207 kernel: [26388.584224] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 12:43:34 juju-e4d256-prod-github-runner-207 kernel: [26388.585247] ? hrtimer_interrupt+0x101/0x220 Aug 22 12:43:34 juju-e4d256-prod-github-runner-207 kernel: [26388.586260] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 12:43:34 juju-e4d256-prod-github-runner-207 kernel: [26388.587337] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 12:43:34 juju-e4d256-prod-github-runner-207 kernel: [26388.588383] Aug 22 12:43:34 juju-e4d256-prod-github-runner-207 kernel: [26388.589244] Aug 22 12:43:34 juju-e4d256-prod-github-runner-207 kernel: [26388.590095] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 12:43:34 juju-e4d256-prod-github-runner-207 kernel: [26388.591137] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:43:34 juju-e4d256-prod-github-runner-207 kernel: [26388.592177] ? _raw_spin_lock+0x22/0x30 Aug 22 12:43:34 juju-e4d256-prod-github-runner-207 kernel: [26388.593125] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:43:34 juju-e4d256-prod-github-runner-207 kernel: [26388.594144] direct_page_fault+0x206/0x310 [kvm] Aug 22 12:43:34 juju-e4d256-prod-github-runner-207 kernel: [26388.595181] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 12:43:34 juju-e4d256-prod-github-runner-207 kernel: [26388.596190] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 12:43:34 juju-e4d256-prod-github-runner-207 kernel: [26388.597190] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 12:43:34 juju-e4d256-prod-github-runner-207 kernel: [26388.598196] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 12:43:34 juju-e4d256-prod-github-runner-207 kernel: [26388.599153] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 12:43:34 juju-e4d256-prod-github-runner-207 kernel: [26388.600130] handle_exit+0x98/0x230 [kvm_amd] Aug 22 12:43:34 juju-e4d256-prod-github-runner-207 kernel: [26388.601022] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 12:43:34 juju-e4d256-prod-github-runner-207 kernel: [26388.601940] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 12:43:34 juju-e4d256-prod-github-runner-207 kernel: [26388.603022] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 12:43:34 juju-e4d256-prod-github-runner-207 kernel: [26388.604030] vcpu_run+0x62/0x2c0 [kvm] Aug 22 12:43:34 juju-e4d256-prod-github-runner-207 kernel: [26388.604944] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 12:43:34 juju-e4d256-prod-github-runner-207 kernel: [26388.605882] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 12:43:34 juju-e4d256-prod-github-runner-207 kernel: [26388.606874] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 12:43:34 juju-e4d256-prod-github-runner-207 kernel: [26388.607788] ? __seccomp_filter+0x4a/0x4a0 Aug 22 12:43:34 juju-e4d256-prod-github-runner-207 kernel: [26388.608612] ? __fget_files+0x86/0xc0 Aug 22 12:43:34 juju-e4d256-prod-github-runner-207 kernel: [26388.609402] __x64_sys_ioctl+0x95/0xd0 Aug 22 12:43:34 juju-e4d256-prod-github-runner-207 kernel: [26388.610166] do_syscall_64+0x5c/0xc0 Aug 22 12:43:34 juju-e4d256-prod-github-runner-207 kernel: [26388.610908] ? do_futex+0x162/0x1f0 Aug 22 12:43:34 juju-e4d256-prod-github-runner-207 kernel: [26388.611642] ? __x64_sys_futex+0x78/0x1e0 Aug 22 12:43:34 juju-e4d256-prod-github-runner-207 kernel: [26388.612409] ? __secure_computing+0xa9/0x120 Aug 22 12:43:34 juju-e4d256-prod-github-runner-207 kernel: [26388.613257] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 12:43:34 juju-e4d256-prod-github-runner-207 kernel: [26388.614038] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:43:34 juju-e4d256-prod-github-runner-207 kernel: [26388.614775] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:43:34 juju-e4d256-prod-github-runner-207 kernel: [26388.615525] ? do_syscall_64+0x69/0xc0 Aug 22 12:43:34 juju-e4d256-prod-github-runner-207 kernel: [26388.616175] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:43:34 juju-e4d256-prod-github-runner-207 kernel: [26388.616881] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:43:34 juju-e4d256-prod-github-runner-207 kernel: [26388.617621] ? do_syscall_64+0x69/0xc0 Aug 22 12:43:34 juju-e4d256-prod-github-runner-207 kernel: [26388.618247] ? do_syscall_64+0x69/0xc0 Aug 22 12:43:34 juju-e4d256-prod-github-runner-207 kernel: [26388.618869] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 12:43:34 juju-e4d256-prod-github-runner-207 kernel: [26388.619632] RIP: 0033:0x7faa5d0edaff Aug 22 12:43:34 juju-e4d256-prod-github-runner-207 kernel: [26388.620290] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 12:43:34 juju-e4d256-prod-github-runner-207 kernel: [26388.622520] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 12:43:34 juju-e4d256-prod-github-runner-207 kernel: [26388.623556] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 12:43:34 juju-e4d256-prod-github-runner-207 kernel: [26388.624660] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 12:43:34 juju-e4d256-prod-github-runner-207 kernel: [26388.625637] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 12:43:34 juju-e4d256-prod-github-runner-207 kernel: [26388.626666] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 12:43:34 juju-e4d256-prod-github-runner-207 kernel: [26388.627649] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 12:43:34 juju-e4d256-prod-github-runner-207 kernel: [26388.628615] Aug 22 12:44:02 juju-e4d256-prod-github-runner-207 kernel: [26416.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 24494s! [qemu-system-x86:6715] Aug 22 12:44:02 juju-e4d256-prod-github-runner-207 kernel: [26416.543112] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 12:44:02 juju-e4d256-prod-github-runner-207 kernel: [26416.543185] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 12:44:02 juju-e4d256-prod-github-runner-207 kernel: [26416.555286] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 12:44:02 juju-e4d256-prod-github-runner-207 kernel: [26416.556560] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 12:44:02 juju-e4d256-prod-github-runner-207 kernel: [26416.557778] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:44:02 juju-e4d256-prod-github-runner-207 kernel: [26416.558874] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 12:44:02 juju-e4d256-prod-github-runner-207 kernel: [26416.561476] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 12:44:02 juju-e4d256-prod-github-runner-207 kernel: [26416.562554] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 12:44:02 juju-e4d256-prod-github-runner-207 kernel: [26416.563738] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 12:44:02 juju-e4d256-prod-github-runner-207 kernel: [26416.564897] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 12:44:02 juju-e4d256-prod-github-runner-207 kernel: [26416.566119] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 12:44:02 juju-e4d256-prod-github-runner-207 kernel: [26416.567317] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 12:44:02 juju-e4d256-prod-github-runner-207 kernel: [26416.568486] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 12:44:02 juju-e4d256-prod-github-runner-207 kernel: [26416.569719] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 12:44:02 juju-e4d256-prod-github-runner-207 kernel: [26416.570827] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 12:44:02 juju-e4d256-prod-github-runner-207 kernel: [26416.572033] Call Trace: Aug 22 12:44:02 juju-e4d256-prod-github-runner-207 kernel: [26416.572944] Aug 22 12:44:02 juju-e4d256-prod-github-runner-207 kernel: [26416.573827] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:44:02 juju-e4d256-prod-github-runner-207 kernel: [26416.574874] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:44:02 juju-e4d256-prod-github-runner-207 kernel: [26416.575900] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:44:02 juju-e4d256-prod-github-runner-207 kernel: [26416.576983] ? show_regs.part.0+0x23/0x29 Aug 22 12:44:02 juju-e4d256-prod-github-runner-207 kernel: [26416.578004] ? show_regs.cold+0x8/0xd Aug 22 12:44:02 juju-e4d256-prod-github-runner-207 kernel: [26416.579069] ? watchdog_timer_fn+0x1be/0x220 Aug 22 12:44:02 juju-e4d256-prod-github-runner-207 kernel: [26416.580154] ? lockup_detector_update_enable+0x60/0x60 Aug 22 12:44:02 juju-e4d256-prod-github-runner-207 kernel: [26416.581222] ? __hrtimer_run_queues+0x107/0x230 Aug 22 12:44:02 juju-e4d256-prod-github-runner-207 kernel: [26416.582269] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 12:44:02 juju-e4d256-prod-github-runner-207 kernel: [26416.583377] ? hrtimer_interrupt+0x101/0x220 Aug 22 12:44:02 juju-e4d256-prod-github-runner-207 kernel: [26416.584400] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 12:44:02 juju-e4d256-prod-github-runner-207 kernel: [26416.585475] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 12:44:02 juju-e4d256-prod-github-runner-207 kernel: [26416.586520] Aug 22 12:44:02 juju-e4d256-prod-github-runner-207 kernel: [26416.587394] Aug 22 12:44:02 juju-e4d256-prod-github-runner-207 kernel: [26416.588240] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 12:44:02 juju-e4d256-prod-github-runner-207 kernel: [26416.589293] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:44:02 juju-e4d256-prod-github-runner-207 kernel: [26416.590346] ? _raw_spin_lock+0x22/0x30 Aug 22 12:44:02 juju-e4d256-prod-github-runner-207 kernel: [26416.591310] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:44:02 juju-e4d256-prod-github-runner-207 kernel: [26416.592344] direct_page_fault+0x206/0x310 [kvm] Aug 22 12:44:02 juju-e4d256-prod-github-runner-207 kernel: [26416.593408] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 12:44:02 juju-e4d256-prod-github-runner-207 kernel: [26416.594474] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 12:44:02 juju-e4d256-prod-github-runner-207 kernel: [26416.595505] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 12:44:02 juju-e4d256-prod-github-runner-207 kernel: [26416.596484] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 12:44:02 juju-e4d256-prod-github-runner-207 kernel: [26416.597436] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 12:44:02 juju-e4d256-prod-github-runner-207 kernel: [26416.598431] handle_exit+0x98/0x230 [kvm_amd] Aug 22 12:44:02 juju-e4d256-prod-github-runner-207 kernel: [26416.599336] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 12:44:02 juju-e4d256-prod-github-runner-207 kernel: [26416.600251] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 12:44:02 juju-e4d256-prod-github-runner-207 kernel: [26416.601181] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 12:44:02 juju-e4d256-prod-github-runner-207 kernel: [26416.602093] vcpu_run+0x62/0x2c0 [kvm] Aug 22 12:44:02 juju-e4d256-prod-github-runner-207 kernel: [26416.602919] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 12:44:02 juju-e4d256-prod-github-runner-207 kernel: [26416.605838] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 12:44:02 juju-e4d256-prod-github-runner-207 kernel: [26416.606850] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 12:44:02 juju-e4d256-prod-github-runner-207 kernel: [26416.607668] ? __seccomp_filter+0x4a/0x4a0 Aug 22 12:44:02 juju-e4d256-prod-github-runner-207 kernel: [26416.608419] ? __fget_files+0x86/0xc0 Aug 22 12:44:02 juju-e4d256-prod-github-runner-207 kernel: [26416.609124] __x64_sys_ioctl+0x95/0xd0 Aug 22 12:44:02 juju-e4d256-prod-github-runner-207 kernel: [26416.609818] do_syscall_64+0x5c/0xc0 Aug 22 12:44:02 juju-e4d256-prod-github-runner-207 kernel: [26416.610483] ? do_futex+0x162/0x1f0 Aug 22 12:44:02 juju-e4d256-prod-github-runner-207 kernel: [26416.611146] ? __x64_sys_futex+0x78/0x1e0 Aug 22 12:44:02 juju-e4d256-prod-github-runner-207 kernel: [26416.614268] ? __secure_computing+0xa9/0x120 Aug 22 12:44:02 juju-e4d256-prod-github-runner-207 kernel: [26416.614990] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 12:44:02 juju-e4d256-prod-github-runner-207 kernel: [26416.615751] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:44:02 juju-e4d256-prod-github-runner-207 kernel: [26416.616472] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:44:02 juju-e4d256-prod-github-runner-207 kernel: [26416.617189] ? do_syscall_64+0x69/0xc0 Aug 22 12:44:02 juju-e4d256-prod-github-runner-207 kernel: [26416.617833] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:44:02 juju-e4d256-prod-github-runner-207 kernel: [26416.618542] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:44:02 juju-e4d256-prod-github-runner-207 kernel: [26416.619252] ? do_syscall_64+0x69/0xc0 Aug 22 12:44:02 juju-e4d256-prod-github-runner-207 kernel: [26416.619877] ? do_syscall_64+0x69/0xc0 Aug 22 12:44:02 juju-e4d256-prod-github-runner-207 kernel: [26416.620497] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 12:44:02 juju-e4d256-prod-github-runner-207 kernel: [26416.621202] RIP: 0033:0x7faa5d0edaff Aug 22 12:44:02 juju-e4d256-prod-github-runner-207 kernel: [26416.621845] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 12:44:02 juju-e4d256-prod-github-runner-207 kernel: [26416.623861] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 12:44:02 juju-e4d256-prod-github-runner-207 kernel: [26416.624771] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 12:44:02 juju-e4d256-prod-github-runner-207 kernel: [26416.625657] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 12:44:02 juju-e4d256-prod-github-runner-207 kernel: [26416.626545] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 12:44:02 juju-e4d256-prod-github-runner-207 kernel: [26416.627443] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 12:44:02 juju-e4d256-prod-github-runner-207 kernel: [26416.628332] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 12:44:02 juju-e4d256-prod-github-runner-207 kernel: [26416.629230] Aug 22 12:44:30 juju-e4d256-prod-github-runner-207 kernel: [26444.541980] watchdog: BUG: soft lockup - CPU#1 stuck for 24520s! [qemu-system-x86:6715] Aug 22 12:44:30 juju-e4d256-prod-github-runner-207 kernel: [26444.543134] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 12:44:30 juju-e4d256-prod-github-runner-207 kernel: [26444.543204] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 12:44:30 juju-e4d256-prod-github-runner-207 kernel: [26444.555408] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 12:44:30 juju-e4d256-prod-github-runner-207 kernel: [26444.556895] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 12:44:30 juju-e4d256-prod-github-runner-207 kernel: [26444.558333] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:44:30 juju-e4d256-prod-github-runner-207 kernel: [26444.559398] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 12:44:30 juju-e4d256-prod-github-runner-207 kernel: [26444.561989] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 12:44:30 juju-e4d256-prod-github-runner-207 kernel: [26444.563068] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 12:44:30 juju-e4d256-prod-github-runner-207 kernel: [26444.564245] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 12:44:30 juju-e4d256-prod-github-runner-207 kernel: [26444.565414] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 12:44:30 juju-e4d256-prod-github-runner-207 kernel: [26444.566589] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 12:44:30 juju-e4d256-prod-github-runner-207 kernel: [26444.567759] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 12:44:30 juju-e4d256-prod-github-runner-207 kernel: [26444.568934] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 12:44:30 juju-e4d256-prod-github-runner-207 kernel: [26444.570164] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 12:44:30 juju-e4d256-prod-github-runner-207 kernel: [26444.571269] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 12:44:30 juju-e4d256-prod-github-runner-207 kernel: [26444.572459] Call Trace: Aug 22 12:44:30 juju-e4d256-prod-github-runner-207 kernel: [26444.573385] Aug 22 12:44:30 juju-e4d256-prod-github-runner-207 kernel: [26444.574291] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:44:30 juju-e4d256-prod-github-runner-207 kernel: [26444.575323] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:44:30 juju-e4d256-prod-github-runner-207 kernel: [26444.576349] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:44:30 juju-e4d256-prod-github-runner-207 kernel: [26444.577435] ? show_regs.part.0+0x23/0x29 Aug 22 12:44:30 juju-e4d256-prod-github-runner-207 kernel: [26444.578485] ? show_regs.cold+0x8/0xd Aug 22 12:44:30 juju-e4d256-prod-github-runner-207 kernel: [26444.579472] ? watchdog_timer_fn+0x1be/0x220 Aug 22 12:44:30 juju-e4d256-prod-github-runner-207 kernel: [26444.580485] ? lockup_detector_update_enable+0x60/0x60 Aug 22 12:44:30 juju-e4d256-prod-github-runner-207 kernel: [26444.581551] ? __hrtimer_run_queues+0x107/0x230 Aug 22 12:44:30 juju-e4d256-prod-github-runner-207 kernel: [26444.582596] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 12:44:30 juju-e4d256-prod-github-runner-207 kernel: [26444.583648] ? hrtimer_interrupt+0x101/0x220 Aug 22 12:44:30 juju-e4d256-prod-github-runner-207 kernel: [26444.584679] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 12:44:30 juju-e4d256-prod-github-runner-207 kernel: [26444.585752] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 12:44:30 juju-e4d256-prod-github-runner-207 kernel: [26444.586806] Aug 22 12:44:30 juju-e4d256-prod-github-runner-207 kernel: [26444.587673] Aug 22 12:44:30 juju-e4d256-prod-github-runner-207 kernel: [26444.588510] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 12:44:30 juju-e4d256-prod-github-runner-207 kernel: [26444.589571] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:44:30 juju-e4d256-prod-github-runner-207 kernel: [26444.590634] ? _raw_spin_lock+0x22/0x30 Aug 22 12:44:30 juju-e4d256-prod-github-runner-207 kernel: [26444.591585] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:44:30 juju-e4d256-prod-github-runner-207 kernel: [26444.592625] direct_page_fault+0x206/0x310 [kvm] Aug 22 12:44:30 juju-e4d256-prod-github-runner-207 kernel: [26444.593652] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 12:44:30 juju-e4d256-prod-github-runner-207 kernel: [26444.594684] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 12:44:30 juju-e4d256-prod-github-runner-207 kernel: [26444.595684] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 12:44:30 juju-e4d256-prod-github-runner-207 kernel: [26444.596651] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 12:44:30 juju-e4d256-prod-github-runner-207 kernel: [26444.597619] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 12:44:30 juju-e4d256-prod-github-runner-207 kernel: [26444.598632] handle_exit+0x98/0x230 [kvm_amd] Aug 22 12:44:30 juju-e4d256-prod-github-runner-207 kernel: [26444.599529] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 12:44:30 juju-e4d256-prod-github-runner-207 kernel: [26444.600441] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 12:44:30 juju-e4d256-prod-github-runner-207 kernel: [26444.601363] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 12:44:30 juju-e4d256-prod-github-runner-207 kernel: [26444.602276] vcpu_run+0x62/0x2c0 [kvm] Aug 22 12:44:30 juju-e4d256-prod-github-runner-207 kernel: [26444.603091] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 12:44:30 juju-e4d256-prod-github-runner-207 kernel: [26444.603903] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 12:44:30 juju-e4d256-prod-github-runner-207 kernel: [26444.604765] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 12:44:30 juju-e4d256-prod-github-runner-207 kernel: [26444.605574] ? __seccomp_filter+0x4a/0x4a0 Aug 22 12:44:30 juju-e4d256-prod-github-runner-207 kernel: [26444.606328] ? __fget_files+0x86/0xc0 Aug 22 12:44:30 juju-e4d256-prod-github-runner-207 kernel: [26444.607031] __x64_sys_ioctl+0x95/0xd0 Aug 22 12:44:30 juju-e4d256-prod-github-runner-207 kernel: [26444.607723] do_syscall_64+0x5c/0xc0 Aug 22 12:44:30 juju-e4d256-prod-github-runner-207 kernel: [26444.608385] ? do_futex+0x162/0x1f0 Aug 22 12:44:30 juju-e4d256-prod-github-runner-207 kernel: [26444.609032] ? __x64_sys_futex+0x78/0x1e0 Aug 22 12:44:30 juju-e4d256-prod-github-runner-207 kernel: [26444.609703] ? __secure_computing+0xa9/0x120 Aug 22 12:44:30 juju-e4d256-prod-github-runner-207 kernel: [26444.610407] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 12:44:30 juju-e4d256-prod-github-runner-207 kernel: [26444.611169] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:44:30 juju-e4d256-prod-github-runner-207 kernel: [26444.611888] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:44:30 juju-e4d256-prod-github-runner-207 kernel: [26444.612603] ? do_syscall_64+0x69/0xc0 Aug 22 12:44:30 juju-e4d256-prod-github-runner-207 kernel: [26444.613245] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:44:30 juju-e4d256-prod-github-runner-207 kernel: [26444.613952] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:44:30 juju-e4d256-prod-github-runner-207 kernel: [26444.614664] ? do_syscall_64+0x69/0xc0 Aug 22 12:44:30 juju-e4d256-prod-github-runner-207 kernel: [26444.615294] ? do_syscall_64+0x69/0xc0 Aug 22 12:44:30 juju-e4d256-prod-github-runner-207 kernel: [26444.615920] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 12:44:30 juju-e4d256-prod-github-runner-207 kernel: [26444.616624] RIP: 0033:0x7faa5d0edaff Aug 22 12:44:30 juju-e4d256-prod-github-runner-207 kernel: [26444.617249] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 12:44:30 juju-e4d256-prod-github-runner-207 kernel: [26444.619236] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 12:44:30 juju-e4d256-prod-github-runner-207 kernel: [26444.620146] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 12:44:30 juju-e4d256-prod-github-runner-207 kernel: [26444.621041] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 12:44:30 juju-e4d256-prod-github-runner-207 kernel: [26444.621927] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 12:44:30 juju-e4d256-prod-github-runner-207 kernel: [26444.622845] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 12:44:30 juju-e4d256-prod-github-runner-207 kernel: [26444.623748] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 12:44:30 juju-e4d256-prod-github-runner-207 kernel: [26444.624639] Aug 22 12:44:45 juju-e4d256-prod-github-runner-207 kernel: [26458.952709] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 12:44:45 juju-e4d256-prod-github-runner-207 kernel: [26458.953665] rcu: 1-....: (6564905 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=3175881 Aug 22 12:44:45 juju-e4d256-prod-github-runner-207 kernel: [26458.954796] (t=6585438 jiffies g=23269 q=30814) Aug 22 12:44:45 juju-e4d256-prod-github-runner-207 kernel: [26458.955576] NMI backtrace for cpu 1 Aug 22 12:44:45 juju-e4d256-prod-github-runner-207 kernel: [26458.956361] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 12:44:45 juju-e4d256-prod-github-runner-207 kernel: [26458.957470] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 12:44:45 juju-e4d256-prod-github-runner-207 kernel: [26458.958557] Call Trace: Aug 22 12:44:45 juju-e4d256-prod-github-runner-207 kernel: [26458.959236] Aug 22 12:44:45 juju-e4d256-prod-github-runner-207 kernel: [26458.959887] show_stack+0x52/0x5c Aug 22 12:44:45 juju-e4d256-prod-github-runner-207 kernel: [26458.960618] dump_stack_lvl+0x4a/0x63 Aug 22 12:44:45 juju-e4d256-prod-github-runner-207 kernel: [26458.961371] dump_stack+0x10/0x16 Aug 22 12:44:45 juju-e4d256-prod-github-runner-207 kernel: [26458.962114] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 12:44:45 juju-e4d256-prod-github-runner-207 kernel: [26458.962897] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 12:44:45 juju-e4d256-prod-github-runner-207 kernel: [26458.963681] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 12:44:45 juju-e4d256-prod-github-runner-207 kernel: [26458.964507] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 12:44:45 juju-e4d256-prod-github-runner-207 kernel: [26458.965413] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 12:44:45 juju-e4d256-prod-github-runner-207 kernel: [26458.966253] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 12:44:45 juju-e4d256-prod-github-runner-207 kernel: [26458.967036] print_cpu_stall.cold+0x2f/0xe2 Aug 22 12:44:45 juju-e4d256-prod-github-runner-207 kernel: [26458.967800] ? timekeeping_update+0xf7/0x150 Aug 22 12:44:45 juju-e4d256-prod-github-runner-207 kernel: [26458.968572] check_cpu_stall+0x109/0x270 Aug 22 12:44:45 juju-e4d256-prod-github-runner-207 kernel: [26458.969345] rcu_sched_clock_irq+0x9a/0x250 Aug 22 12:44:45 juju-e4d256-prod-github-runner-207 kernel: [26458.970138] update_process_times+0x94/0xd0 Aug 22 12:44:45 juju-e4d256-prod-github-runner-207 kernel: [26458.970915] tick_sched_handle+0x29/0x70 Aug 22 12:44:45 juju-e4d256-prod-github-runner-207 kernel: [26458.971680] tick_sched_timer+0x8c/0xc0 Aug 22 12:44:45 juju-e4d256-prod-github-runner-207 kernel: [26458.972455] ? tick_nohz_handler+0xb0/0xb0 Aug 22 12:44:45 juju-e4d256-prod-github-runner-207 kernel: [26458.973227] __hrtimer_run_queues+0x107/0x230 Aug 22 12:44:45 juju-e4d256-prod-github-runner-207 kernel: [26458.974004] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 12:44:45 juju-e4d256-prod-github-runner-207 kernel: [26458.974794] hrtimer_interrupt+0x101/0x220 Aug 22 12:44:45 juju-e4d256-prod-github-runner-207 kernel: [26458.975561] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 12:44:45 juju-e4d256-prod-github-runner-207 kernel: [26458.976371] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 12:44:45 juju-e4d256-prod-github-runner-207 kernel: [26458.977169] Aug 22 12:44:45 juju-e4d256-prod-github-runner-207 kernel: [26458.977801] Aug 22 12:44:45 juju-e4d256-prod-github-runner-207 kernel: [26458.978438] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 12:44:45 juju-e4d256-prod-github-runner-207 kernel: [26458.979261] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:44:45 juju-e4d256-prod-github-runner-207 kernel: [26458.980142] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 12:44:45 juju-e4d256-prod-github-runner-207 kernel: [26458.982382] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 12:44:45 juju-e4d256-prod-github-runner-207 kernel: [26458.983272] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 12:44:45 juju-e4d256-prod-github-runner-207 kernel: [26458.984319] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 12:44:45 juju-e4d256-prod-github-runner-207 kernel: [26458.985308] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 12:44:45 juju-e4d256-prod-github-runner-207 kernel: [26458.986319] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 12:44:45 juju-e4d256-prod-github-runner-207 kernel: [26458.987278] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 12:44:45 juju-e4d256-prod-github-runner-207 kernel: [26458.988245] ? _raw_spin_lock+0x22/0x30 Aug 22 12:44:45 juju-e4d256-prod-github-runner-207 kernel: [26458.989004] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:44:45 juju-e4d256-prod-github-runner-207 kernel: [26458.989852] direct_page_fault+0x206/0x310 [kvm] Aug 22 12:44:45 juju-e4d256-prod-github-runner-207 kernel: [26458.990720] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 12:44:45 juju-e4d256-prod-github-runner-207 kernel: [26458.991551] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 12:44:45 juju-e4d256-prod-github-runner-207 kernel: [26458.992374] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 12:44:45 juju-e4d256-prod-github-runner-207 kernel: [26458.993177] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 12:44:45 juju-e4d256-prod-github-runner-207 kernel: [26458.993960] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 12:44:45 juju-e4d256-prod-github-runner-207 kernel: [26458.994846] handle_exit+0x98/0x230 [kvm_amd] Aug 22 12:44:45 juju-e4d256-prod-github-runner-207 kernel: [26458.995628] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 12:44:45 juju-e4d256-prod-github-runner-207 kernel: [26458.996425] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 12:44:45 juju-e4d256-prod-github-runner-207 kernel: [26458.997241] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 12:44:45 juju-e4d256-prod-github-runner-207 kernel: [26458.998041] vcpu_run+0x62/0x2c0 [kvm] Aug 22 12:44:45 juju-e4d256-prod-github-runner-207 kernel: [26458.998812] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 12:44:45 juju-e4d256-prod-github-runner-207 kernel: [26458.999555] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 12:44:45 juju-e4d256-prod-github-runner-207 kernel: [26459.000362] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 12:44:45 juju-e4d256-prod-github-runner-207 kernel: [26459.001129] ? __seccomp_filter+0x4a/0x4a0 Aug 22 12:44:45 juju-e4d256-prod-github-runner-207 kernel: [26459.001848] ? __fget_files+0x86/0xc0 Aug 22 12:44:45 juju-e4d256-prod-github-runner-207 kernel: [26459.002575] __x64_sys_ioctl+0x95/0xd0 Aug 22 12:44:45 juju-e4d256-prod-github-runner-207 kernel: [26459.003274] do_syscall_64+0x5c/0xc0 Aug 22 12:44:45 juju-e4d256-prod-github-runner-207 kernel: [26459.003971] ? do_futex+0x162/0x1f0 Aug 22 12:44:45 juju-e4d256-prod-github-runner-207 kernel: [26459.004645] ? __x64_sys_futex+0x78/0x1e0 Aug 22 12:44:45 juju-e4d256-prod-github-runner-207 kernel: [26459.005357] ? __secure_computing+0xa9/0x120 Aug 22 12:44:45 juju-e4d256-prod-github-runner-207 kernel: [26459.006097] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 12:44:45 juju-e4d256-prod-github-runner-207 kernel: [26459.006887] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:44:45 juju-e4d256-prod-github-runner-207 kernel: [26459.007647] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:44:45 juju-e4d256-prod-github-runner-207 kernel: [26459.008401] ? do_syscall_64+0x69/0xc0 Aug 22 12:44:45 juju-e4d256-prod-github-runner-207 kernel: [26459.009096] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:44:45 juju-e4d256-prod-github-runner-207 kernel: [26459.009849] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:44:45 juju-e4d256-prod-github-runner-207 kernel: [26459.010622] ? do_syscall_64+0x69/0xc0 Aug 22 12:44:45 juju-e4d256-prod-github-runner-207 kernel: [26459.011326] ? do_syscall_64+0x69/0xc0 Aug 22 12:44:45 juju-e4d256-prod-github-runner-207 kernel: [26459.012021] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 12:44:45 juju-e4d256-prod-github-runner-207 kernel: [26459.012831] RIP: 0033:0x7faa5d0edaff Aug 22 12:44:45 juju-e4d256-prod-github-runner-207 kernel: [26459.013540] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 12:44:45 juju-e4d256-prod-github-runner-207 kernel: [26459.015670] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 12:44:45 juju-e4d256-prod-github-runner-207 kernel: [26459.016641] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 12:44:45 juju-e4d256-prod-github-runner-207 kernel: [26459.017590] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 12:44:45 juju-e4d256-prod-github-runner-207 kernel: [26459.018563] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 12:44:45 juju-e4d256-prod-github-runner-207 kernel: [26459.019510] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 12:44:45 juju-e4d256-prod-github-runner-207 kernel: [26459.020442] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 12:44:45 juju-e4d256-prod-github-runner-207 kernel: [26459.021361] Aug 22 12:45:10 juju-e4d256-prod-github-runner-207 kernel: [26484.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 24557s! [qemu-system-x86:6715] Aug 22 12:45:10 juju-e4d256-prod-github-runner-207 kernel: [26484.543930] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 12:45:10 juju-e4d256-prod-github-runner-207 kernel: [26484.544237] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 12:45:10 juju-e4d256-prod-github-runner-207 kernel: [26484.556783] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 12:45:10 juju-e4d256-prod-github-runner-207 kernel: [26484.558221] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 12:45:10 juju-e4d256-prod-github-runner-207 kernel: [26484.559458] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:45:10 juju-e4d256-prod-github-runner-207 kernel: [26484.560526] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 12:45:10 juju-e4d256-prod-github-runner-207 kernel: [26484.563192] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 12:45:10 juju-e4d256-prod-github-runner-207 kernel: [26484.564296] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 12:45:10 juju-e4d256-prod-github-runner-207 kernel: [26484.565486] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 12:45:10 juju-e4d256-prod-github-runner-207 kernel: [26484.566691] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 12:45:10 juju-e4d256-prod-github-runner-207 kernel: [26484.567917] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 12:45:10 juju-e4d256-prod-github-runner-207 kernel: [26484.569105] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 12:45:10 juju-e4d256-prod-github-runner-207 kernel: [26484.570334] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 12:45:10 juju-e4d256-prod-github-runner-207 kernel: [26484.571588] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 12:45:10 juju-e4d256-prod-github-runner-207 kernel: [26484.572723] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 12:45:10 juju-e4d256-prod-github-runner-207 kernel: [26484.573994] Call Trace: Aug 22 12:45:10 juju-e4d256-prod-github-runner-207 kernel: [26484.574933] Aug 22 12:45:10 juju-e4d256-prod-github-runner-207 kernel: [26484.575870] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:45:10 juju-e4d256-prod-github-runner-207 kernel: [26484.576945] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:45:10 juju-e4d256-prod-github-runner-207 kernel: [26484.578033] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:45:10 juju-e4d256-prod-github-runner-207 kernel: [26484.579187] ? show_regs.part.0+0x23/0x29 Aug 22 12:45:10 juju-e4d256-prod-github-runner-207 kernel: [26484.580212] ? show_regs.cold+0x8/0xd Aug 22 12:45:10 juju-e4d256-prod-github-runner-207 kernel: [26484.581214] ? watchdog_timer_fn+0x1be/0x220 Aug 22 12:45:10 juju-e4d256-prod-github-runner-207 kernel: [26484.582272] ? lockup_detector_update_enable+0x60/0x60 Aug 22 12:45:10 juju-e4d256-prod-github-runner-207 kernel: [26484.583363] ? __hrtimer_run_queues+0x107/0x230 Aug 22 12:45:10 juju-e4d256-prod-github-runner-207 kernel: [26484.584430] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 12:45:10 juju-e4d256-prod-github-runner-207 kernel: [26484.585473] ? hrtimer_interrupt+0x101/0x220 Aug 22 12:45:10 juju-e4d256-prod-github-runner-207 kernel: [26484.586525] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 12:45:10 juju-e4d256-prod-github-runner-207 kernel: [26484.587610] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 12:45:10 juju-e4d256-prod-github-runner-207 kernel: [26484.588680] Aug 22 12:45:10 juju-e4d256-prod-github-runner-207 kernel: [26484.589559] Aug 22 12:45:10 juju-e4d256-prod-github-runner-207 kernel: [26484.590437] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 12:45:10 juju-e4d256-prod-github-runner-207 kernel: [26484.591511] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:45:10 juju-e4d256-prod-github-runner-207 kernel: [26484.592577] ? _raw_spin_lock+0x22/0x30 Aug 22 12:45:10 juju-e4d256-prod-github-runner-207 kernel: [26484.593558] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:45:10 juju-e4d256-prod-github-runner-207 kernel: [26484.594657] direct_page_fault+0x206/0x310 [kvm] Aug 22 12:45:10 juju-e4d256-prod-github-runner-207 kernel: [26484.595705] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 12:45:10 juju-e4d256-prod-github-runner-207 kernel: [26484.596733] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 12:45:10 juju-e4d256-prod-github-runner-207 kernel: [26484.597777] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 12:45:10 juju-e4d256-prod-github-runner-207 kernel: [26484.598835] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 12:45:10 juju-e4d256-prod-github-runner-207 kernel: [26484.599810] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 12:45:10 juju-e4d256-prod-github-runner-207 kernel: [26484.600804] handle_exit+0x98/0x230 [kvm_amd] Aug 22 12:45:10 juju-e4d256-prod-github-runner-207 kernel: [26484.601717] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 12:45:10 juju-e4d256-prod-github-runner-207 kernel: [26484.602673] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 12:45:10 juju-e4d256-prod-github-runner-207 kernel: [26484.603635] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 12:45:10 juju-e4d256-prod-github-runner-207 kernel: [26484.604579] vcpu_run+0x62/0x2c0 [kvm] Aug 22 12:45:10 juju-e4d256-prod-github-runner-207 kernel: [26484.605414] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 12:45:10 juju-e4d256-prod-github-runner-207 kernel: [26484.606268] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 12:45:10 juju-e4d256-prod-github-runner-207 kernel: [26484.607140] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 12:45:10 juju-e4d256-prod-github-runner-207 kernel: [26484.607954] ? __seccomp_filter+0x4a/0x4a0 Aug 22 12:45:10 juju-e4d256-prod-github-runner-207 kernel: [26484.608710] ? __fget_files+0x86/0xc0 Aug 22 12:45:10 juju-e4d256-prod-github-runner-207 kernel: [26484.609423] __x64_sys_ioctl+0x95/0xd0 Aug 22 12:45:10 juju-e4d256-prod-github-runner-207 kernel: [26484.610156] do_syscall_64+0x5c/0xc0 Aug 22 12:45:10 juju-e4d256-prod-github-runner-207 kernel: [26484.610850] ? do_futex+0x162/0x1f0 Aug 22 12:45:10 juju-e4d256-prod-github-runner-207 kernel: [26484.611521] ? __x64_sys_futex+0x78/0x1e0 Aug 22 12:45:10 juju-e4d256-prod-github-runner-207 kernel: [26484.612202] ? __secure_computing+0xa9/0x120 Aug 22 12:45:10 juju-e4d256-prod-github-runner-207 kernel: [26484.612903] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 12:45:10 juju-e4d256-prod-github-runner-207 kernel: [26484.613675] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:45:10 juju-e4d256-prod-github-runner-207 kernel: [26484.614422] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:45:10 juju-e4d256-prod-github-runner-207 kernel: [26484.615146] ? do_syscall_64+0x69/0xc0 Aug 22 12:45:10 juju-e4d256-prod-github-runner-207 kernel: [26484.615823] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:45:10 juju-e4d256-prod-github-runner-207 kernel: [26484.616534] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:45:10 juju-e4d256-prod-github-runner-207 kernel: [26484.617233] ? do_syscall_64+0x69/0xc0 Aug 22 12:45:10 juju-e4d256-prod-github-runner-207 kernel: [26484.617878] ? do_syscall_64+0x69/0xc0 Aug 22 12:45:10 juju-e4d256-prod-github-runner-207 kernel: [26484.618503] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 12:45:10 juju-e4d256-prod-github-runner-207 kernel: [26484.619212] RIP: 0033:0x7faa5d0edaff Aug 22 12:45:10 juju-e4d256-prod-github-runner-207 kernel: [26484.619883] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 12:45:10 juju-e4d256-prod-github-runner-207 kernel: [26484.621922] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 12:45:10 juju-e4d256-prod-github-runner-207 kernel: [26484.622844] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 12:45:10 juju-e4d256-prod-github-runner-207 kernel: [26484.623745] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 12:45:10 juju-e4d256-prod-github-runner-207 kernel: [26484.624661] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 12:45:10 juju-e4d256-prod-github-runner-207 kernel: [26484.625550] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 12:45:10 juju-e4d256-prod-github-runner-207 kernel: [26484.626473] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 12:45:10 juju-e4d256-prod-github-runner-207 kernel: [26484.627373] Aug 22 12:45:38 juju-e4d256-prod-github-runner-207 kernel: [26512.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 24583s! [qemu-system-x86:6715] Aug 22 12:45:38 juju-e4d256-prod-github-runner-207 kernel: [26512.543117] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 12:45:38 juju-e4d256-prod-github-runner-207 kernel: [26512.543188] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 12:45:38 juju-e4d256-prod-github-runner-207 kernel: [26512.555780] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 12:45:38 juju-e4d256-prod-github-runner-207 kernel: [26512.557063] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 12:45:38 juju-e4d256-prod-github-runner-207 kernel: [26512.558318] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:45:38 juju-e4d256-prod-github-runner-207 kernel: [26512.559439] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 12:45:38 juju-e4d256-prod-github-runner-207 kernel: [26512.562040] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 12:45:38 juju-e4d256-prod-github-runner-207 kernel: [26512.563095] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 12:45:38 juju-e4d256-prod-github-runner-207 kernel: [26512.564276] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 12:45:38 juju-e4d256-prod-github-runner-207 kernel: [26512.565566] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 12:45:38 juju-e4d256-prod-github-runner-207 kernel: [26512.566787] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 12:45:38 juju-e4d256-prod-github-runner-207 kernel: [26512.567989] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 12:45:38 juju-e4d256-prod-github-runner-207 kernel: [26512.569200] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 12:45:38 juju-e4d256-prod-github-runner-207 kernel: [26512.570643] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 12:45:38 juju-e4d256-prod-github-runner-207 kernel: [26512.571756] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 12:45:38 juju-e4d256-prod-github-runner-207 kernel: [26512.572978] Call Trace: Aug 22 12:45:38 juju-e4d256-prod-github-runner-207 kernel: [26512.573976] Aug 22 12:45:38 juju-e4d256-prod-github-runner-207 kernel: [26512.574878] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:45:38 juju-e4d256-prod-github-runner-207 kernel: [26512.575926] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:45:38 juju-e4d256-prod-github-runner-207 kernel: [26512.576976] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:45:38 juju-e4d256-prod-github-runner-207 kernel: [26512.578096] ? show_regs.part.0+0x23/0x29 Aug 22 12:45:38 juju-e4d256-prod-github-runner-207 kernel: [26512.579122] ? show_regs.cold+0x8/0xd Aug 22 12:45:38 juju-e4d256-prod-github-runner-207 kernel: [26512.580135] ? watchdog_timer_fn+0x1be/0x220 Aug 22 12:45:38 juju-e4d256-prod-github-runner-207 kernel: [26512.581179] ? lockup_detector_update_enable+0x60/0x60 Aug 22 12:45:38 juju-e4d256-prod-github-runner-207 kernel: [26512.582303] ? __hrtimer_run_queues+0x107/0x230 Aug 22 12:45:38 juju-e4d256-prod-github-runner-207 kernel: [26512.583348] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 12:45:38 juju-e4d256-prod-github-runner-207 kernel: [26512.584391] ? hrtimer_interrupt+0x101/0x220 Aug 22 12:45:38 juju-e4d256-prod-github-runner-207 kernel: [26512.585451] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 12:45:38 juju-e4d256-prod-github-runner-207 kernel: [26512.586532] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 12:45:38 juju-e4d256-prod-github-runner-207 kernel: [26512.587604] Aug 22 12:45:38 juju-e4d256-prod-github-runner-207 kernel: [26512.588475] Aug 22 12:45:38 juju-e4d256-prod-github-runner-207 kernel: [26512.589317] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 12:45:38 juju-e4d256-prod-github-runner-207 kernel: [26512.590385] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:45:38 juju-e4d256-prod-github-runner-207 kernel: [26512.591454] ? _raw_spin_lock+0x22/0x30 Aug 22 12:45:38 juju-e4d256-prod-github-runner-207 kernel: [26512.592409] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:45:38 juju-e4d256-prod-github-runner-207 kernel: [26512.593494] direct_page_fault+0x206/0x310 [kvm] Aug 22 12:45:38 juju-e4d256-prod-github-runner-207 kernel: [26512.594539] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 12:45:38 juju-e4d256-prod-github-runner-207 kernel: [26512.595564] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 12:45:38 juju-e4d256-prod-github-runner-207 kernel: [26512.596596] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 12:45:38 juju-e4d256-prod-github-runner-207 kernel: [26512.597594] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 12:45:38 juju-e4d256-prod-github-runner-207 kernel: [26512.598554] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 12:45:38 juju-e4d256-prod-github-runner-207 kernel: [26512.599543] handle_exit+0x98/0x230 [kvm_amd] Aug 22 12:45:38 juju-e4d256-prod-github-runner-207 kernel: [26512.600443] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 12:45:38 juju-e4d256-prod-github-runner-207 kernel: [26512.601366] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 12:45:38 juju-e4d256-prod-github-runner-207 kernel: [26512.602344] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 12:45:38 juju-e4d256-prod-github-runner-207 kernel: [26512.603283] vcpu_run+0x62/0x2c0 [kvm] Aug 22 12:45:38 juju-e4d256-prod-github-runner-207 kernel: [26512.604143] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 12:45:38 juju-e4d256-prod-github-runner-207 kernel: [26512.604967] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 12:45:38 juju-e4d256-prod-github-runner-207 kernel: [26512.605844] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 12:45:38 juju-e4d256-prod-github-runner-207 kernel: [26512.606649] ? __seccomp_filter+0x4a/0x4a0 Aug 22 12:45:38 juju-e4d256-prod-github-runner-207 kernel: [26512.607427] ? __fget_files+0x86/0xc0 Aug 22 12:45:38 juju-e4d256-prod-github-runner-207 kernel: [26512.608137] __x64_sys_ioctl+0x95/0xd0 Aug 22 12:45:38 juju-e4d256-prod-github-runner-207 kernel: [26512.608837] do_syscall_64+0x5c/0xc0 Aug 22 12:45:38 juju-e4d256-prod-github-runner-207 kernel: [26512.609518] ? do_futex+0x162/0x1f0 Aug 22 12:45:38 juju-e4d256-prod-github-runner-207 kernel: [26512.610171] ? __x64_sys_futex+0x78/0x1e0 Aug 22 12:45:38 juju-e4d256-prod-github-runner-207 kernel: [26512.610856] ? __secure_computing+0xa9/0x120 Aug 22 12:45:38 juju-e4d256-prod-github-runner-207 kernel: [26512.611550] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 12:45:38 juju-e4d256-prod-github-runner-207 kernel: [26512.612320] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:45:38 juju-e4d256-prod-github-runner-207 kernel: [26512.613056] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:45:38 juju-e4d256-prod-github-runner-207 kernel: [26512.613809] ? do_syscall_64+0x69/0xc0 Aug 22 12:45:38 juju-e4d256-prod-github-runner-207 kernel: [26512.614479] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:45:38 juju-e4d256-prod-github-runner-207 kernel: [26512.615199] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:45:38 juju-e4d256-prod-github-runner-207 kernel: [26512.615910] ? do_syscall_64+0x69/0xc0 Aug 22 12:45:38 juju-e4d256-prod-github-runner-207 kernel: [26512.616543] ? do_syscall_64+0x69/0xc0 Aug 22 12:45:38 juju-e4d256-prod-github-runner-207 kernel: [26512.617179] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 12:45:38 juju-e4d256-prod-github-runner-207 kernel: [26512.617933] RIP: 0033:0x7faa5d0edaff Aug 22 12:45:38 juju-e4d256-prod-github-runner-207 kernel: [26512.618589] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 12:45:38 juju-e4d256-prod-github-runner-207 kernel: [26512.620624] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 12:45:38 juju-e4d256-prod-github-runner-207 kernel: [26512.621570] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 12:45:38 juju-e4d256-prod-github-runner-207 kernel: [26512.622517] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 12:45:38 juju-e4d256-prod-github-runner-207 kernel: [26512.623448] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 12:45:38 juju-e4d256-prod-github-runner-207 kernel: [26512.624366] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 12:45:38 juju-e4d256-prod-github-runner-207 kernel: [26512.625306] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 12:45:38 juju-e4d256-prod-github-runner-207 kernel: [26512.626274] Aug 22 12:46:06 juju-e4d256-prod-github-runner-207 kernel: [26540.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 24609s! [qemu-system-x86:6715] Aug 22 12:46:06 juju-e4d256-prod-github-runner-207 kernel: [26540.543146] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 12:46:06 juju-e4d256-prod-github-runner-207 kernel: [26540.543222] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 12:46:06 juju-e4d256-prod-github-runner-207 kernel: [26540.556026] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 12:46:06 juju-e4d256-prod-github-runner-207 kernel: [26540.557361] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 12:46:06 juju-e4d256-prod-github-runner-207 kernel: [26540.558617] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:46:06 juju-e4d256-prod-github-runner-207 kernel: [26540.559701] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 12:46:06 juju-e4d256-prod-github-runner-207 kernel: [26540.562352] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 12:46:06 juju-e4d256-prod-github-runner-207 kernel: [26540.563443] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 12:46:06 juju-e4d256-prod-github-runner-207 kernel: [26540.564629] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 12:46:06 juju-e4d256-prod-github-runner-207 kernel: [26540.565837] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 12:46:06 juju-e4d256-prod-github-runner-207 kernel: [26540.567016] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 12:46:06 juju-e4d256-prod-github-runner-207 kernel: [26540.568191] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 12:46:06 juju-e4d256-prod-github-runner-207 kernel: [26540.569416] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 12:46:06 juju-e4d256-prod-github-runner-207 kernel: [26540.570719] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 12:46:06 juju-e4d256-prod-github-runner-207 kernel: [26540.571841] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 12:46:06 juju-e4d256-prod-github-runner-207 kernel: [26540.573123] Call Trace: Aug 22 12:46:06 juju-e4d256-prod-github-runner-207 kernel: [26540.574062] Aug 22 12:46:06 juju-e4d256-prod-github-runner-207 kernel: [26540.574953] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:46:06 juju-e4d256-prod-github-runner-207 kernel: [26540.576000] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:46:06 juju-e4d256-prod-github-runner-207 kernel: [26540.577047] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:46:06 juju-e4d256-prod-github-runner-207 kernel: [26540.578145] ? show_regs.part.0+0x23/0x29 Aug 22 12:46:06 juju-e4d256-prod-github-runner-207 kernel: [26540.579152] ? show_regs.cold+0x8/0xd Aug 22 12:46:06 juju-e4d256-prod-github-runner-207 kernel: [26540.580176] ? watchdog_timer_fn+0x1be/0x220 Aug 22 12:46:06 juju-e4d256-prod-github-runner-207 kernel: [26540.581223] ? lockup_detector_update_enable+0x60/0x60 Aug 22 12:46:06 juju-e4d256-prod-github-runner-207 kernel: [26540.582305] ? __hrtimer_run_queues+0x107/0x230 Aug 22 12:46:06 juju-e4d256-prod-github-runner-207 kernel: [26540.583389] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 12:46:06 juju-e4d256-prod-github-runner-207 kernel: [26540.584438] ? hrtimer_interrupt+0x101/0x220 Aug 22 12:46:06 juju-e4d256-prod-github-runner-207 kernel: [26540.585481] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 12:46:06 juju-e4d256-prod-github-runner-207 kernel: [26540.586577] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 12:46:06 juju-e4d256-prod-github-runner-207 kernel: [26540.587640] Aug 22 12:46:06 juju-e4d256-prod-github-runner-207 kernel: [26540.588519] Aug 22 12:46:06 juju-e4d256-prod-github-runner-207 kernel: [26540.589404] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 12:46:06 juju-e4d256-prod-github-runner-207 kernel: [26540.590462] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:46:06 juju-e4d256-prod-github-runner-207 kernel: [26540.591529] ? _raw_spin_lock+0x22/0x30 Aug 22 12:46:06 juju-e4d256-prod-github-runner-207 kernel: [26540.592490] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:46:06 juju-e4d256-prod-github-runner-207 kernel: [26540.593549] direct_page_fault+0x206/0x310 [kvm] Aug 22 12:46:06 juju-e4d256-prod-github-runner-207 kernel: [26540.594621] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 12:46:06 juju-e4d256-prod-github-runner-207 kernel: [26540.595649] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 12:46:06 juju-e4d256-prod-github-runner-207 kernel: [26540.596680] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 12:46:06 juju-e4d256-prod-github-runner-207 kernel: [26540.597692] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 12:46:06 juju-e4d256-prod-github-runner-207 kernel: [26540.598659] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 12:46:06 juju-e4d256-prod-github-runner-207 kernel: [26540.599652] handle_exit+0x98/0x230 [kvm_amd] Aug 22 12:46:06 juju-e4d256-prod-github-runner-207 kernel: [26540.600586] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 12:46:06 juju-e4d256-prod-github-runner-207 kernel: [26540.601571] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 12:46:06 juju-e4d256-prod-github-runner-207 kernel: [26540.602554] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 12:46:06 juju-e4d256-prod-github-runner-207 kernel: [26540.603496] vcpu_run+0x62/0x2c0 [kvm] Aug 22 12:46:06 juju-e4d256-prod-github-runner-207 kernel: [26540.604330] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 12:46:06 juju-e4d256-prod-github-runner-207 kernel: [26540.605211] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 12:46:06 juju-e4d256-prod-github-runner-207 kernel: [26540.606117] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 12:46:06 juju-e4d256-prod-github-runner-207 kernel: [26540.606959] ? __seccomp_filter+0x4a/0x4a0 Aug 22 12:46:06 juju-e4d256-prod-github-runner-207 kernel: [26540.607713] ? __fget_files+0x86/0xc0 Aug 22 12:46:06 juju-e4d256-prod-github-runner-207 kernel: [26540.608428] __x64_sys_ioctl+0x95/0xd0 Aug 22 12:46:06 juju-e4d256-prod-github-runner-207 kernel: [26540.609153] do_syscall_64+0x5c/0xc0 Aug 22 12:46:06 juju-e4d256-prod-github-runner-207 kernel: [26540.609854] ? do_futex+0x162/0x1f0 Aug 22 12:46:06 juju-e4d256-prod-github-runner-207 kernel: [26540.610572] ? __x64_sys_futex+0x78/0x1e0 Aug 22 12:46:06 juju-e4d256-prod-github-runner-207 kernel: [26540.611496] ? __secure_computing+0xa9/0x120 Aug 22 12:46:06 juju-e4d256-prod-github-runner-207 kernel: [26540.612209] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 12:46:06 juju-e4d256-prod-github-runner-207 kernel: [26540.612994] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:46:06 juju-e4d256-prod-github-runner-207 kernel: [26540.613762] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:46:06 juju-e4d256-prod-github-runner-207 kernel: [26540.614497] ? do_syscall_64+0x69/0xc0 Aug 22 12:46:06 juju-e4d256-prod-github-runner-207 kernel: [26540.615156] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:46:06 juju-e4d256-prod-github-runner-207 kernel: [26540.615884] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:46:06 juju-e4d256-prod-github-runner-207 kernel: [26540.616614] ? do_syscall_64+0x69/0xc0 Aug 22 12:46:06 juju-e4d256-prod-github-runner-207 kernel: [26540.617280] ? do_syscall_64+0x69/0xc0 Aug 22 12:46:06 juju-e4d256-prod-github-runner-207 kernel: [26540.617917] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 12:46:06 juju-e4d256-prod-github-runner-207 kernel: [26540.618648] RIP: 0033:0x7faa5d0edaff Aug 22 12:46:06 juju-e4d256-prod-github-runner-207 kernel: [26540.619283] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 12:46:06 juju-e4d256-prod-github-runner-207 kernel: [26540.621340] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 12:46:06 juju-e4d256-prod-github-runner-207 kernel: [26540.622273] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 12:46:06 juju-e4d256-prod-github-runner-207 kernel: [26540.623253] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 12:46:06 juju-e4d256-prod-github-runner-207 kernel: [26540.624174] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 12:46:06 juju-e4d256-prod-github-runner-207 kernel: [26540.625105] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 12:46:06 juju-e4d256-prod-github-runner-207 kernel: [26540.626027] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 12:46:06 juju-e4d256-prod-github-runner-207 kernel: [26540.626945] Aug 22 12:46:34 juju-e4d256-prod-github-runner-207 kernel: [26568.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 24635s! [qemu-system-x86:6715] Aug 22 12:46:34 juju-e4d256-prod-github-runner-207 kernel: [26568.543822] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 12:46:34 juju-e4d256-prod-github-runner-207 kernel: [26568.544111] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 12:46:34 juju-e4d256-prod-github-runner-207 kernel: [26568.556615] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 12:46:34 juju-e4d256-prod-github-runner-207 kernel: [26568.557933] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 12:46:34 juju-e4d256-prod-github-runner-207 kernel: [26568.559185] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:46:34 juju-e4d256-prod-github-runner-207 kernel: [26568.560247] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 12:46:34 juju-e4d256-prod-github-runner-207 kernel: [26568.564003] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 12:46:34 juju-e4d256-prod-github-runner-207 kernel: [26568.565090] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 12:46:34 juju-e4d256-prod-github-runner-207 kernel: [26568.566257] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 12:46:34 juju-e4d256-prod-github-runner-207 kernel: [26568.567544] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 12:46:34 juju-e4d256-prod-github-runner-207 kernel: [26568.568985] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 12:46:34 juju-e4d256-prod-github-runner-207 kernel: [26568.570154] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 12:46:34 juju-e4d256-prod-github-runner-207 kernel: [26568.571321] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 12:46:34 juju-e4d256-prod-github-runner-207 kernel: [26568.572560] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 12:46:34 juju-e4d256-prod-github-runner-207 kernel: [26568.573702] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 12:46:34 juju-e4d256-prod-github-runner-207 kernel: [26568.574898] Call Trace: Aug 22 12:46:34 juju-e4d256-prod-github-runner-207 kernel: [26568.575815] Aug 22 12:46:34 juju-e4d256-prod-github-runner-207 kernel: [26568.576771] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:46:34 juju-e4d256-prod-github-runner-207 kernel: [26568.577811] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:46:34 juju-e4d256-prod-github-runner-207 kernel: [26568.578878] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:46:34 juju-e4d256-prod-github-runner-207 kernel: [26568.579986] ? show_regs.part.0+0x23/0x29 Aug 22 12:46:34 juju-e4d256-prod-github-runner-207 kernel: [26568.581007] ? show_regs.cold+0x8/0xd Aug 22 12:46:34 juju-e4d256-prod-github-runner-207 kernel: [26568.581980] ? watchdog_timer_fn+0x1be/0x220 Aug 22 12:46:34 juju-e4d256-prod-github-runner-207 kernel: [26568.582987] ? lockup_detector_update_enable+0x60/0x60 Aug 22 12:46:34 juju-e4d256-prod-github-runner-207 kernel: [26568.584055] ? __hrtimer_run_queues+0x107/0x230 Aug 22 12:46:34 juju-e4d256-prod-github-runner-207 kernel: [26568.585095] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 12:46:34 juju-e4d256-prod-github-runner-207 kernel: [26568.586119] ? hrtimer_interrupt+0x101/0x220 Aug 22 12:46:34 juju-e4d256-prod-github-runner-207 kernel: [26568.587140] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 12:46:34 juju-e4d256-prod-github-runner-207 kernel: [26568.588207] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 12:46:34 juju-e4d256-prod-github-runner-207 kernel: [26568.589267] Aug 22 12:46:34 juju-e4d256-prod-github-runner-207 kernel: [26568.590127] Aug 22 12:46:34 juju-e4d256-prod-github-runner-207 kernel: [26568.590963] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 12:46:34 juju-e4d256-prod-github-runner-207 kernel: [26568.592000] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:46:34 juju-e4d256-prod-github-runner-207 kernel: [26568.593052] ? _raw_spin_lock+0x22/0x30 Aug 22 12:46:34 juju-e4d256-prod-github-runner-207 kernel: [26568.593999] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:46:34 juju-e4d256-prod-github-runner-207 kernel: [26568.595026] direct_page_fault+0x206/0x310 [kvm] Aug 22 12:46:34 juju-e4d256-prod-github-runner-207 kernel: [26568.596055] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 12:46:34 juju-e4d256-prod-github-runner-207 kernel: [26568.597082] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 12:46:34 juju-e4d256-prod-github-runner-207 kernel: [26568.598102] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 12:46:34 juju-e4d256-prod-github-runner-207 kernel: [26568.599133] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 12:46:34 juju-e4d256-prod-github-runner-207 kernel: [26568.600112] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 12:46:34 juju-e4d256-prod-github-runner-207 kernel: [26568.601116] handle_exit+0x98/0x230 [kvm_amd] Aug 22 12:46:34 juju-e4d256-prod-github-runner-207 kernel: [26568.602014] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 12:46:34 juju-e4d256-prod-github-runner-207 kernel: [26568.602940] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 12:46:34 juju-e4d256-prod-github-runner-207 kernel: [26568.603875] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 12:46:34 juju-e4d256-prod-github-runner-207 kernel: [26568.604808] vcpu_run+0x62/0x2c0 [kvm] Aug 22 12:46:34 juju-e4d256-prod-github-runner-207 kernel: [26568.605638] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 12:46:34 juju-e4d256-prod-github-runner-207 kernel: [26568.606460] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 12:46:34 juju-e4d256-prod-github-runner-207 kernel: [26568.607319] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 12:46:34 juju-e4d256-prod-github-runner-207 kernel: [26568.608123] ? __seccomp_filter+0x4a/0x4a0 Aug 22 12:46:34 juju-e4d256-prod-github-runner-207 kernel: [26568.608891] ? __fget_files+0x86/0xc0 Aug 22 12:46:34 juju-e4d256-prod-github-runner-207 kernel: [26568.609603] __x64_sys_ioctl+0x95/0xd0 Aug 22 12:46:34 juju-e4d256-prod-github-runner-207 kernel: [26568.610298] do_syscall_64+0x5c/0xc0 Aug 22 12:46:34 juju-e4d256-prod-github-runner-207 kernel: [26568.610966] ? do_futex+0x162/0x1f0 Aug 22 12:46:34 juju-e4d256-prod-github-runner-207 kernel: [26568.611616] ? __x64_sys_futex+0x78/0x1e0 Aug 22 12:46:34 juju-e4d256-prod-github-runner-207 kernel: [26568.612290] ? __secure_computing+0xa9/0x120 Aug 22 12:46:34 juju-e4d256-prod-github-runner-207 kernel: [26568.612997] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 12:46:34 juju-e4d256-prod-github-runner-207 kernel: [26568.613757] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:46:34 juju-e4d256-prod-github-runner-207 kernel: [26568.614476] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:46:34 juju-e4d256-prod-github-runner-207 kernel: [26568.615192] ? do_syscall_64+0x69/0xc0 Aug 22 12:46:34 juju-e4d256-prod-github-runner-207 kernel: [26568.615835] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:46:34 juju-e4d256-prod-github-runner-207 kernel: [26568.616536] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:46:34 juju-e4d256-prod-github-runner-207 kernel: [26568.617247] ? do_syscall_64+0x69/0xc0 Aug 22 12:46:34 juju-e4d256-prod-github-runner-207 kernel: [26568.617873] ? do_syscall_64+0x69/0xc0 Aug 22 12:46:34 juju-e4d256-prod-github-runner-207 kernel: [26568.618562] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 12:46:34 juju-e4d256-prod-github-runner-207 kernel: [26568.619283] RIP: 0033:0x7faa5d0edaff Aug 22 12:46:34 juju-e4d256-prod-github-runner-207 kernel: [26568.619946] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 12:46:34 juju-e4d256-prod-github-runner-207 kernel: [26568.622049] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 12:46:34 juju-e4d256-prod-github-runner-207 kernel: [26568.622965] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 12:46:34 juju-e4d256-prod-github-runner-207 kernel: [26568.624035] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 12:46:34 juju-e4d256-prod-github-runner-207 kernel: [26568.624957] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 12:46:34 juju-e4d256-prod-github-runner-207 kernel: [26568.625852] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 12:46:34 juju-e4d256-prod-github-runner-207 kernel: [26568.626743] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 12:46:34 juju-e4d256-prod-github-runner-207 kernel: [26568.627727] Aug 22 12:47:02 juju-e4d256-prod-github-runner-207 kernel: [26596.541983] watchdog: BUG: soft lockup - CPU#1 stuck for 24661s! [qemu-system-x86:6715] Aug 22 12:47:02 juju-e4d256-prod-github-runner-207 kernel: [26596.543472] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 12:47:02 juju-e4d256-prod-github-runner-207 kernel: [26596.543559] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 12:47:02 juju-e4d256-prod-github-runner-207 kernel: [26596.556607] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 12:47:02 juju-e4d256-prod-github-runner-207 kernel: [26596.557904] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 12:47:02 juju-e4d256-prod-github-runner-207 kernel: [26596.559126] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:47:02 juju-e4d256-prod-github-runner-207 kernel: [26596.560253] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 12:47:02 juju-e4d256-prod-github-runner-207 kernel: [26596.563036] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 12:47:02 juju-e4d256-prod-github-runner-207 kernel: [26596.564266] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 12:47:02 juju-e4d256-prod-github-runner-207 kernel: [26596.565582] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 12:47:02 juju-e4d256-prod-github-runner-207 kernel: [26596.566832] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 12:47:02 juju-e4d256-prod-github-runner-207 kernel: [26596.568022] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 12:47:02 juju-e4d256-prod-github-runner-207 kernel: [26596.569217] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 12:47:02 juju-e4d256-prod-github-runner-207 kernel: [26596.570420] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 12:47:02 juju-e4d256-prod-github-runner-207 kernel: [26596.571691] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 12:47:02 juju-e4d256-prod-github-runner-207 kernel: [26596.572840] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 12:47:02 juju-e4d256-prod-github-runner-207 kernel: [26596.574054] Call Trace: Aug 22 12:47:02 juju-e4d256-prod-github-runner-207 kernel: [26596.574971] Aug 22 12:47:02 juju-e4d256-prod-github-runner-207 kernel: [26596.575951] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:47:02 juju-e4d256-prod-github-runner-207 kernel: [26596.577197] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:47:02 juju-e4d256-prod-github-runner-207 kernel: [26596.578393] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:47:02 juju-e4d256-prod-github-runner-207 kernel: [26596.579639] ? show_regs.part.0+0x23/0x29 Aug 22 12:47:02 juju-e4d256-prod-github-runner-207 kernel: [26596.580761] ? show_regs.cold+0x8/0xd Aug 22 12:47:02 juju-e4d256-prod-github-runner-207 kernel: [26596.581822] ? watchdog_timer_fn+0x1be/0x220 Aug 22 12:47:02 juju-e4d256-prod-github-runner-207 kernel: [26596.582863] ? lockup_detector_update_enable+0x60/0x60 Aug 22 12:47:02 juju-e4d256-prod-github-runner-207 kernel: [26596.583972] ? __hrtimer_run_queues+0x107/0x230 Aug 22 12:47:02 juju-e4d256-prod-github-runner-207 kernel: [26596.585029] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 12:47:02 juju-e4d256-prod-github-runner-207 kernel: [26596.586069] ? hrtimer_interrupt+0x101/0x220 Aug 22 12:47:02 juju-e4d256-prod-github-runner-207 kernel: [26596.587136] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 12:47:02 juju-e4d256-prod-github-runner-207 kernel: [26596.588236] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 12:47:02 juju-e4d256-prod-github-runner-207 kernel: [26596.589312] Aug 22 12:47:02 juju-e4d256-prod-github-runner-207 kernel: [26596.590176] Aug 22 12:47:02 juju-e4d256-prod-github-runner-207 kernel: [26596.591019] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 12:47:02 juju-e4d256-prod-github-runner-207 kernel: [26596.592054] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:47:02 juju-e4d256-prod-github-runner-207 kernel: [26596.593241] ? _raw_spin_lock+0x22/0x30 Aug 22 12:47:02 juju-e4d256-prod-github-runner-207 kernel: [26596.594310] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:47:02 juju-e4d256-prod-github-runner-207 kernel: [26596.595347] direct_page_fault+0x206/0x310 [kvm] Aug 22 12:47:02 juju-e4d256-prod-github-runner-207 kernel: [26596.596410] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 12:47:02 juju-e4d256-prod-github-runner-207 kernel: [26596.597463] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 12:47:02 juju-e4d256-prod-github-runner-207 kernel: [26596.598545] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 12:47:02 juju-e4d256-prod-github-runner-207 kernel: [26596.599528] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 12:47:02 juju-e4d256-prod-github-runner-207 kernel: [26596.600522] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 12:47:02 juju-e4d256-prod-github-runner-207 kernel: [26596.601513] handle_exit+0x98/0x230 [kvm_amd] Aug 22 12:47:02 juju-e4d256-prod-github-runner-207 kernel: [26596.602416] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 12:47:02 juju-e4d256-prod-github-runner-207 kernel: [26596.603351] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 12:47:02 juju-e4d256-prod-github-runner-207 kernel: [26596.604295] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 12:47:02 juju-e4d256-prod-github-runner-207 kernel: [26596.605219] vcpu_run+0x62/0x2c0 [kvm] Aug 22 12:47:02 juju-e4d256-prod-github-runner-207 kernel: [26596.606087] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 12:47:02 juju-e4d256-prod-github-runner-207 kernel: [26596.606931] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 12:47:02 juju-e4d256-prod-github-runner-207 kernel: [26596.607822] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 12:47:02 juju-e4d256-prod-github-runner-207 kernel: [26596.608713] ? __seccomp_filter+0x4a/0x4a0 Aug 22 12:47:02 juju-e4d256-prod-github-runner-207 kernel: [26596.609500] ? __fget_files+0x86/0xc0 Aug 22 12:47:02 juju-e4d256-prod-github-runner-207 kernel: [26596.610209] __x64_sys_ioctl+0x95/0xd0 Aug 22 12:47:02 juju-e4d256-prod-github-runner-207 kernel: [26596.610906] do_syscall_64+0x5c/0xc0 Aug 22 12:47:02 juju-e4d256-prod-github-runner-207 kernel: [26596.611583] ? do_futex+0x162/0x1f0 Aug 22 12:47:02 juju-e4d256-prod-github-runner-207 kernel: [26596.612241] ? __x64_sys_futex+0x78/0x1e0 Aug 22 12:47:02 juju-e4d256-prod-github-runner-207 kernel: [26596.612933] ? __secure_computing+0xa9/0x120 Aug 22 12:47:02 juju-e4d256-prod-github-runner-207 kernel: [26596.613649] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 12:47:02 juju-e4d256-prod-github-runner-207 kernel: [26596.614427] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:47:02 juju-e4d256-prod-github-runner-207 kernel: [26596.615159] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:47:02 juju-e4d256-prod-github-runner-207 kernel: [26596.615888] ? do_syscall_64+0x69/0xc0 Aug 22 12:47:02 juju-e4d256-prod-github-runner-207 kernel: [26596.616561] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:47:02 juju-e4d256-prod-github-runner-207 kernel: [26596.617273] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:47:02 juju-e4d256-prod-github-runner-207 kernel: [26596.617974] ? do_syscall_64+0x69/0xc0 Aug 22 12:47:02 juju-e4d256-prod-github-runner-207 kernel: [26596.618619] ? do_syscall_64+0x69/0xc0 Aug 22 12:47:02 juju-e4d256-prod-github-runner-207 kernel: [26596.619258] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 12:47:02 juju-e4d256-prod-github-runner-207 kernel: [26596.620029] RIP: 0033:0x7faa5d0edaff Aug 22 12:47:02 juju-e4d256-prod-github-runner-207 kernel: [26596.620690] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 12:47:02 juju-e4d256-prod-github-runner-207 kernel: [26596.622726] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 12:47:02 juju-e4d256-prod-github-runner-207 kernel: [26596.623841] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 12:47:02 juju-e4d256-prod-github-runner-207 kernel: [26596.624800] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 12:47:02 juju-e4d256-prod-github-runner-207 kernel: [26596.625735] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 12:47:02 juju-e4d256-prod-github-runner-207 kernel: [26596.626633] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 12:47:02 juju-e4d256-prod-github-runner-207 kernel: [26596.627527] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 12:47:02 juju-e4d256-prod-github-runner-207 kernel: [26596.628446] Aug 22 12:47:30 juju-e4d256-prod-github-runner-207 kernel: [26624.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 24688s! [qemu-system-x86:6715] Aug 22 12:47:30 juju-e4d256-prod-github-runner-207 kernel: [26624.543119] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 12:47:30 juju-e4d256-prod-github-runner-207 kernel: [26624.543194] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 12:47:30 juju-e4d256-prod-github-runner-207 kernel: [26624.555436] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 12:47:30 juju-e4d256-prod-github-runner-207 kernel: [26624.556754] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 12:47:30 juju-e4d256-prod-github-runner-207 kernel: [26624.558007] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:47:30 juju-e4d256-prod-github-runner-207 kernel: [26624.559113] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 12:47:30 juju-e4d256-prod-github-runner-207 kernel: [26624.561919] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 12:47:30 juju-e4d256-prod-github-runner-207 kernel: [26624.562979] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 12:47:30 juju-e4d256-prod-github-runner-207 kernel: [26624.564359] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 12:47:30 juju-e4d256-prod-github-runner-207 kernel: [26624.565622] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 12:47:30 juju-e4d256-prod-github-runner-207 kernel: [26624.566796] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 12:47:30 juju-e4d256-prod-github-runner-207 kernel: [26624.567962] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 12:47:30 juju-e4d256-prod-github-runner-207 kernel: [26624.569179] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 12:47:30 juju-e4d256-prod-github-runner-207 kernel: [26624.570451] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 12:47:30 juju-e4d256-prod-github-runner-207 kernel: [26624.571565] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 12:47:30 juju-e4d256-prod-github-runner-207 kernel: [26624.572801] Call Trace: Aug 22 12:47:30 juju-e4d256-prod-github-runner-207 kernel: [26624.573717] Aug 22 12:47:30 juju-e4d256-prod-github-runner-207 kernel: [26624.574623] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:47:30 juju-e4d256-prod-github-runner-207 kernel: [26624.575679] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:47:30 juju-e4d256-prod-github-runner-207 kernel: [26624.576729] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:47:30 juju-e4d256-prod-github-runner-207 kernel: [26624.577845] ? show_regs.part.0+0x23/0x29 Aug 22 12:47:30 juju-e4d256-prod-github-runner-207 kernel: [26624.578859] ? show_regs.cold+0x8/0xd Aug 22 12:47:30 juju-e4d256-prod-github-runner-207 kernel: [26624.579858] ? watchdog_timer_fn+0x1be/0x220 Aug 22 12:47:30 juju-e4d256-prod-github-runner-207 kernel: [26624.580945] ? lockup_detector_update_enable+0x60/0x60 Aug 22 12:47:30 juju-e4d256-prod-github-runner-207 kernel: [26624.582040] ? __hrtimer_run_queues+0x107/0x230 Aug 22 12:47:30 juju-e4d256-prod-github-runner-207 kernel: [26624.583087] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 12:47:30 juju-e4d256-prod-github-runner-207 kernel: [26624.584150] ? hrtimer_interrupt+0x101/0x220 Aug 22 12:47:30 juju-e4d256-prod-github-runner-207 kernel: [26624.585190] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 12:47:30 juju-e4d256-prod-github-runner-207 kernel: [26624.586283] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 12:47:30 juju-e4d256-prod-github-runner-207 kernel: [26624.587342] Aug 22 12:47:30 juju-e4d256-prod-github-runner-207 kernel: [26624.588219] Aug 22 12:47:30 juju-e4d256-prod-github-runner-207 kernel: [26624.589068] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 12:47:30 juju-e4d256-prod-github-runner-207 kernel: [26624.590120] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:47:30 juju-e4d256-prod-github-runner-207 kernel: [26624.591204] ? _raw_spin_lock+0x22/0x30 Aug 22 12:47:30 juju-e4d256-prod-github-runner-207 kernel: [26624.592190] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:47:30 juju-e4d256-prod-github-runner-207 kernel: [26624.593229] direct_page_fault+0x206/0x310 [kvm] Aug 22 12:47:30 juju-e4d256-prod-github-runner-207 kernel: [26624.594265] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 12:47:30 juju-e4d256-prod-github-runner-207 kernel: [26624.595293] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 12:47:30 juju-e4d256-prod-github-runner-207 kernel: [26624.596348] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 12:47:30 juju-e4d256-prod-github-runner-207 kernel: [26624.597333] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 12:47:30 juju-e4d256-prod-github-runner-207 kernel: [26624.598292] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 12:47:30 juju-e4d256-prod-github-runner-207 kernel: [26624.599277] handle_exit+0x98/0x230 [kvm_amd] Aug 22 12:47:30 juju-e4d256-prod-github-runner-207 kernel: [26624.600200] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 12:47:30 juju-e4d256-prod-github-runner-207 kernel: [26624.601132] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 12:47:30 juju-e4d256-prod-github-runner-207 kernel: [26624.602093] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 12:47:30 juju-e4d256-prod-github-runner-207 kernel: [26624.603026] vcpu_run+0x62/0x2c0 [kvm] Aug 22 12:47:30 juju-e4d256-prod-github-runner-207 kernel: [26624.603850] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 12:47:30 juju-e4d256-prod-github-runner-207 kernel: [26624.604691] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 12:47:30 juju-e4d256-prod-github-runner-207 kernel: [26624.605562] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 12:47:30 juju-e4d256-prod-github-runner-207 kernel: [26624.606369] ? __seccomp_filter+0x4a/0x4a0 Aug 22 12:47:30 juju-e4d256-prod-github-runner-207 kernel: [26624.607131] ? __fget_files+0x86/0xc0 Aug 22 12:47:30 juju-e4d256-prod-github-runner-207 kernel: [26624.607843] __x64_sys_ioctl+0x95/0xd0 Aug 22 12:47:30 juju-e4d256-prod-github-runner-207 kernel: [26624.608552] do_syscall_64+0x5c/0xc0 Aug 22 12:47:30 juju-e4d256-prod-github-runner-207 kernel: [26624.609222] ? do_futex+0x162/0x1f0 Aug 22 12:47:30 juju-e4d256-prod-github-runner-207 kernel: [26624.609876] ? __x64_sys_futex+0x78/0x1e0 Aug 22 12:47:30 juju-e4d256-prod-github-runner-207 kernel: [26624.610564] ? __secure_computing+0xa9/0x120 Aug 22 12:47:30 juju-e4d256-prod-github-runner-207 kernel: [26624.611272] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 12:47:30 juju-e4d256-prod-github-runner-207 kernel: [26624.612077] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:47:30 juju-e4d256-prod-github-runner-207 kernel: [26624.612807] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:47:30 juju-e4d256-prod-github-runner-207 kernel: [26624.613537] ? do_syscall_64+0x69/0xc0 Aug 22 12:47:30 juju-e4d256-prod-github-runner-207 kernel: [26624.614186] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:47:30 juju-e4d256-prod-github-runner-207 kernel: [26624.614913] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:47:30 juju-e4d256-prod-github-runner-207 kernel: [26624.615714] ? do_syscall_64+0x69/0xc0 Aug 22 12:47:30 juju-e4d256-prod-github-runner-207 kernel: [26624.616485] ? do_syscall_64+0x69/0xc0 Aug 22 12:47:30 juju-e4d256-prod-github-runner-207 kernel: [26624.617164] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 12:47:30 juju-e4d256-prod-github-runner-207 kernel: [26624.617874] RIP: 0033:0x7faa5d0edaff Aug 22 12:47:30 juju-e4d256-prod-github-runner-207 kernel: [26624.618508] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 12:47:30 juju-e4d256-prod-github-runner-207 kernel: [26624.620576] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 12:47:30 juju-e4d256-prod-github-runner-207 kernel: [26624.621666] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 12:47:30 juju-e4d256-prod-github-runner-207 kernel: [26624.622814] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 12:47:30 juju-e4d256-prod-github-runner-207 kernel: [26624.623711] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 12:47:30 juju-e4d256-prod-github-runner-207 kernel: [26624.624638] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 12:47:30 juju-e4d256-prod-github-runner-207 kernel: [26624.625527] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 12:47:30 juju-e4d256-prod-github-runner-207 kernel: [26624.626460] Aug 22 12:47:45 juju-e4d256-prod-github-runner-207 kernel: [26638.964708] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 12:47:45 juju-e4d256-prod-github-runner-207 kernel: [26638.965704] rcu: 1-....: (6609771 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=3197279 Aug 22 12:47:45 juju-e4d256-prod-github-runner-207 kernel: [26638.966857] (t=6630441 jiffies g=23269 q=30917) Aug 22 12:47:45 juju-e4d256-prod-github-runner-207 kernel: [26638.967670] NMI backtrace for cpu 1 Aug 22 12:47:45 juju-e4d256-prod-github-runner-207 kernel: [26638.968419] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 12:47:45 juju-e4d256-prod-github-runner-207 kernel: [26638.969572] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 12:47:45 juju-e4d256-prod-github-runner-207 kernel: [26638.970672] Call Trace: Aug 22 12:47:45 juju-e4d256-prod-github-runner-207 kernel: [26638.971353] Aug 22 12:47:45 juju-e4d256-prod-github-runner-207 kernel: [26638.972020] show_stack+0x52/0x5c Aug 22 12:47:45 juju-e4d256-prod-github-runner-207 kernel: [26638.972754] dump_stack_lvl+0x4a/0x63 Aug 22 12:47:45 juju-e4d256-prod-github-runner-207 kernel: [26638.973507] dump_stack+0x10/0x16 Aug 22 12:47:45 juju-e4d256-prod-github-runner-207 kernel: [26638.974240] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 12:47:45 juju-e4d256-prod-github-runner-207 kernel: [26638.975057] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 12:47:45 juju-e4d256-prod-github-runner-207 kernel: [26638.975947] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 12:47:45 juju-e4d256-prod-github-runner-207 kernel: [26638.976781] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 12:47:45 juju-e4d256-prod-github-runner-207 kernel: [26638.977609] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 12:47:45 juju-e4d256-prod-github-runner-207 kernel: [26638.978455] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 12:47:45 juju-e4d256-prod-github-runner-207 kernel: [26638.979264] print_cpu_stall.cold+0x2f/0xe2 Aug 22 12:47:45 juju-e4d256-prod-github-runner-207 kernel: [26638.980087] ? timekeeping_update+0xf7/0x150 Aug 22 12:47:45 juju-e4d256-prod-github-runner-207 kernel: [26638.980893] check_cpu_stall+0x109/0x270 Aug 22 12:47:45 juju-e4d256-prod-github-runner-207 kernel: [26638.981642] rcu_sched_clock_irq+0x9a/0x250 Aug 22 12:47:45 juju-e4d256-prod-github-runner-207 kernel: [26638.982433] update_process_times+0x94/0xd0 Aug 22 12:47:45 juju-e4d256-prod-github-runner-207 kernel: [26638.983210] tick_sched_handle+0x29/0x70 Aug 22 12:47:45 juju-e4d256-prod-github-runner-207 kernel: [26638.983973] tick_sched_timer+0x8c/0xc0 Aug 22 12:47:45 juju-e4d256-prod-github-runner-207 kernel: [26638.984718] ? tick_nohz_handler+0xb0/0xb0 Aug 22 12:47:45 juju-e4d256-prod-github-runner-207 kernel: [26638.985476] __hrtimer_run_queues+0x107/0x230 Aug 22 12:47:45 juju-e4d256-prod-github-runner-207 kernel: [26638.986260] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 12:47:45 juju-e4d256-prod-github-runner-207 kernel: [26638.987042] hrtimer_interrupt+0x101/0x220 Aug 22 12:47:45 juju-e4d256-prod-github-runner-207 kernel: [26638.987816] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 12:47:45 juju-e4d256-prod-github-runner-207 kernel: [26638.988661] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 12:47:45 juju-e4d256-prod-github-runner-207 kernel: [26638.989491] Aug 22 12:47:45 juju-e4d256-prod-github-runner-207 kernel: [26638.990169] Aug 22 12:47:45 juju-e4d256-prod-github-runner-207 kernel: [26638.990799] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 12:47:45 juju-e4d256-prod-github-runner-207 kernel: [26638.991633] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:47:45 juju-e4d256-prod-github-runner-207 kernel: [26638.992530] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 12:47:45 juju-e4d256-prod-github-runner-207 kernel: [26638.994770] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 12:47:45 juju-e4d256-prod-github-runner-207 kernel: [26638.995641] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 12:47:45 juju-e4d256-prod-github-runner-207 kernel: [26638.996641] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 12:47:45 juju-e4d256-prod-github-runner-207 kernel: [26638.997623] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 12:47:45 juju-e4d256-prod-github-runner-207 kernel: [26638.998607] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 12:47:45 juju-e4d256-prod-github-runner-207 kernel: [26638.999555] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 12:47:45 juju-e4d256-prod-github-runner-207 kernel: [26639.000523] ? _raw_spin_lock+0x22/0x30 Aug 22 12:47:45 juju-e4d256-prod-github-runner-207 kernel: [26639.001284] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:47:45 juju-e4d256-prod-github-runner-207 kernel: [26639.002131] direct_page_fault+0x206/0x310 [kvm] Aug 22 12:47:45 juju-e4d256-prod-github-runner-207 kernel: [26639.002977] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 12:47:45 juju-e4d256-prod-github-runner-207 kernel: [26639.003798] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 12:47:45 juju-e4d256-prod-github-runner-207 kernel: [26639.004631] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 12:47:45 juju-e4d256-prod-github-runner-207 kernel: [26639.005433] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 12:47:45 juju-e4d256-prod-github-runner-207 kernel: [26639.006212] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 12:47:45 juju-e4d256-prod-github-runner-207 kernel: [26639.007029] handle_exit+0x98/0x230 [kvm_amd] Aug 22 12:47:45 juju-e4d256-prod-github-runner-207 kernel: [26639.007778] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 12:47:45 juju-e4d256-prod-github-runner-207 kernel: [26639.008576] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 12:47:45 juju-e4d256-prod-github-runner-207 kernel: [26639.009394] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 12:47:45 juju-e4d256-prod-github-runner-207 kernel: [26639.010175] vcpu_run+0x62/0x2c0 [kvm] Aug 22 12:47:45 juju-e4d256-prod-github-runner-207 kernel: [26639.010892] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 12:47:45 juju-e4d256-prod-github-runner-207 kernel: [26639.011621] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 12:47:45 juju-e4d256-prod-github-runner-207 kernel: [26639.012438] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 12:47:45 juju-e4d256-prod-github-runner-207 kernel: [26639.013266] ? __seccomp_filter+0x4a/0x4a0 Aug 22 12:47:45 juju-e4d256-prod-github-runner-207 kernel: [26639.013982] ? __fget_files+0x86/0xc0 Aug 22 12:47:45 juju-e4d256-prod-github-runner-207 kernel: [26639.014672] __x64_sys_ioctl+0x95/0xd0 Aug 22 12:47:45 juju-e4d256-prod-github-runner-207 kernel: [26639.015363] do_syscall_64+0x5c/0xc0 Aug 22 12:47:45 juju-e4d256-prod-github-runner-207 kernel: [26639.016225] ? do_futex+0x162/0x1f0 Aug 22 12:47:45 juju-e4d256-prod-github-runner-207 kernel: [26639.016896] ? __x64_sys_futex+0x78/0x1e0 Aug 22 12:47:45 juju-e4d256-prod-github-runner-207 kernel: [26639.017595] ? __secure_computing+0xa9/0x120 Aug 22 12:47:45 juju-e4d256-prod-github-runner-207 kernel: [26639.018311] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 12:47:45 juju-e4d256-prod-github-runner-207 kernel: [26639.019101] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:47:45 juju-e4d256-prod-github-runner-207 kernel: [26639.019908] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:47:45 juju-e4d256-prod-github-runner-207 kernel: [26639.020662] ? do_syscall_64+0x69/0xc0 Aug 22 12:47:45 juju-e4d256-prod-github-runner-207 kernel: [26639.021349] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:47:45 juju-e4d256-prod-github-runner-207 kernel: [26639.022101] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:47:45 juju-e4d256-prod-github-runner-207 kernel: [26639.022858] ? do_syscall_64+0x69/0xc0 Aug 22 12:47:45 juju-e4d256-prod-github-runner-207 kernel: [26639.023550] ? do_syscall_64+0x69/0xc0 Aug 22 12:47:45 juju-e4d256-prod-github-runner-207 kernel: [26639.024249] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 12:47:45 juju-e4d256-prod-github-runner-207 kernel: [26639.025023] RIP: 0033:0x7faa5d0edaff Aug 22 12:47:45 juju-e4d256-prod-github-runner-207 kernel: [26639.025713] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 12:47:45 juju-e4d256-prod-github-runner-207 kernel: [26639.027854] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 12:47:45 juju-e4d256-prod-github-runner-207 kernel: [26639.028824] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 12:47:45 juju-e4d256-prod-github-runner-207 kernel: [26639.029772] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 12:47:45 juju-e4d256-prod-github-runner-207 kernel: [26639.030713] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 12:47:45 juju-e4d256-prod-github-runner-207 kernel: [26639.031651] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 12:47:45 juju-e4d256-prod-github-runner-207 kernel: [26639.032593] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 12:47:45 juju-e4d256-prod-github-runner-207 kernel: [26639.033502] Aug 22 12:48:10 juju-e4d256-prod-github-runner-207 kernel: [26664.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 24725s! [qemu-system-x86:6715] Aug 22 12:48:10 juju-e4d256-prod-github-runner-207 kernel: [26664.543835] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 12:48:10 juju-e4d256-prod-github-runner-207 kernel: [26664.544120] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 12:48:10 juju-e4d256-prod-github-runner-207 kernel: [26664.556302] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 12:48:10 juju-e4d256-prod-github-runner-207 kernel: [26664.557573] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 12:48:10 juju-e4d256-prod-github-runner-207 kernel: [26664.558796] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:48:10 juju-e4d256-prod-github-runner-207 kernel: [26664.559876] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 12:48:10 juju-e4d256-prod-github-runner-207 kernel: [26664.562451] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 12:48:10 juju-e4d256-prod-github-runner-207 kernel: [26664.563510] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 12:48:10 juju-e4d256-prod-github-runner-207 kernel: [26664.564674] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 12:48:10 juju-e4d256-prod-github-runner-207 kernel: [26664.565838] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 12:48:10 juju-e4d256-prod-github-runner-207 kernel: [26664.567007] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 12:48:10 juju-e4d256-prod-github-runner-207 kernel: [26664.568190] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 12:48:10 juju-e4d256-prod-github-runner-207 kernel: [26664.569369] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 12:48:10 juju-e4d256-prod-github-runner-207 kernel: [26664.570606] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 12:48:10 juju-e4d256-prod-github-runner-207 kernel: [26664.571728] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 12:48:10 juju-e4d256-prod-github-runner-207 kernel: [26664.572928] Call Trace: Aug 22 12:48:10 juju-e4d256-prod-github-runner-207 kernel: [26664.573839] Aug 22 12:48:10 juju-e4d256-prod-github-runner-207 kernel: [26664.574742] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:48:10 juju-e4d256-prod-github-runner-207 kernel: [26664.575796] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:48:10 juju-e4d256-prod-github-runner-207 kernel: [26664.576818] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:48:10 juju-e4d256-prod-github-runner-207 kernel: [26664.577926] ? show_regs.part.0+0x23/0x29 Aug 22 12:48:10 juju-e4d256-prod-github-runner-207 kernel: [26664.578929] ? show_regs.cold+0x8/0xd Aug 22 12:48:10 juju-e4d256-prod-github-runner-207 kernel: [26664.579917] ? watchdog_timer_fn+0x1be/0x220 Aug 22 12:48:10 juju-e4d256-prod-github-runner-207 kernel: [26664.580930] ? lockup_detector_update_enable+0x60/0x60 Aug 22 12:48:10 juju-e4d256-prod-github-runner-207 kernel: [26664.581997] ? __hrtimer_run_queues+0x107/0x230 Aug 22 12:48:10 juju-e4d256-prod-github-runner-207 kernel: [26664.583022] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 12:48:10 juju-e4d256-prod-github-runner-207 kernel: [26664.584065] ? hrtimer_interrupt+0x101/0x220 Aug 22 12:48:10 juju-e4d256-prod-github-runner-207 kernel: [26664.585081] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 12:48:10 juju-e4d256-prod-github-runner-207 kernel: [26664.586148] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 12:48:10 juju-e4d256-prod-github-runner-207 kernel: [26664.587195] Aug 22 12:48:10 juju-e4d256-prod-github-runner-207 kernel: [26664.588076] Aug 22 12:48:10 juju-e4d256-prod-github-runner-207 kernel: [26664.588915] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 12:48:10 juju-e4d256-prod-github-runner-207 kernel: [26664.589945] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:48:10 juju-e4d256-prod-github-runner-207 kernel: [26664.591000] ? _raw_spin_lock+0x22/0x30 Aug 22 12:48:10 juju-e4d256-prod-github-runner-207 kernel: [26664.591950] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:48:10 juju-e4d256-prod-github-runner-207 kernel: [26664.592967] direct_page_fault+0x206/0x310 [kvm] Aug 22 12:48:10 juju-e4d256-prod-github-runner-207 kernel: [26664.593995] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 12:48:10 juju-e4d256-prod-github-runner-207 kernel: [26664.595007] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 12:48:10 juju-e4d256-prod-github-runner-207 kernel: [26664.596033] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 12:48:10 juju-e4d256-prod-github-runner-207 kernel: [26664.597256] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 12:48:10 juju-e4d256-prod-github-runner-207 kernel: [26664.598214] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 12:48:10 juju-e4d256-prod-github-runner-207 kernel: [26664.599195] handle_exit+0x98/0x230 [kvm_amd] Aug 22 12:48:10 juju-e4d256-prod-github-runner-207 kernel: [26664.600107] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 12:48:10 juju-e4d256-prod-github-runner-207 kernel: [26664.601030] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 12:48:10 juju-e4d256-prod-github-runner-207 kernel: [26664.601958] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 12:48:10 juju-e4d256-prod-github-runner-207 kernel: [26664.602866] vcpu_run+0x62/0x2c0 [kvm] Aug 22 12:48:10 juju-e4d256-prod-github-runner-207 kernel: [26664.603709] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 12:48:10 juju-e4d256-prod-github-runner-207 kernel: [26664.604532] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 12:48:10 juju-e4d256-prod-github-runner-207 kernel: [26664.605412] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 12:48:10 juju-e4d256-prod-github-runner-207 kernel: [26664.606212] ? __seccomp_filter+0x4a/0x4a0 Aug 22 12:48:10 juju-e4d256-prod-github-runner-207 kernel: [26664.606956] ? __fget_files+0x86/0xc0 Aug 22 12:48:10 juju-e4d256-prod-github-runner-207 kernel: [26664.607673] __x64_sys_ioctl+0x95/0xd0 Aug 22 12:48:10 juju-e4d256-prod-github-runner-207 kernel: [26664.608368] do_syscall_64+0x5c/0xc0 Aug 22 12:48:10 juju-e4d256-prod-github-runner-207 kernel: [26664.609041] ? do_futex+0x162/0x1f0 Aug 22 12:48:10 juju-e4d256-prod-github-runner-207 kernel: [26664.609689] ? __x64_sys_futex+0x78/0x1e0 Aug 22 12:48:10 juju-e4d256-prod-github-runner-207 kernel: [26664.610363] ? __secure_computing+0xa9/0x120 Aug 22 12:48:10 juju-e4d256-prod-github-runner-207 kernel: [26664.611057] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 12:48:10 juju-e4d256-prod-github-runner-207 kernel: [26664.612017] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:48:10 juju-e4d256-prod-github-runner-207 kernel: [26664.612901] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:48:10 juju-e4d256-prod-github-runner-207 kernel: [26664.613618] ? do_syscall_64+0x69/0xc0 Aug 22 12:48:10 juju-e4d256-prod-github-runner-207 kernel: [26664.614263] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:48:10 juju-e4d256-prod-github-runner-207 kernel: [26664.614965] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:48:10 juju-e4d256-prod-github-runner-207 kernel: [26664.615677] ? do_syscall_64+0x69/0xc0 Aug 22 12:48:10 juju-e4d256-prod-github-runner-207 kernel: [26664.616338] ? do_syscall_64+0x69/0xc0 Aug 22 12:48:10 juju-e4d256-prod-github-runner-207 kernel: [26664.616983] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 12:48:10 juju-e4d256-prod-github-runner-207 kernel: [26664.617691] RIP: 0033:0x7faa5d0edaff Aug 22 12:48:10 juju-e4d256-prod-github-runner-207 kernel: [26664.618354] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 12:48:10 juju-e4d256-prod-github-runner-207 kernel: [26664.620419] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 12:48:10 juju-e4d256-prod-github-runner-207 kernel: [26664.621340] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 12:48:10 juju-e4d256-prod-github-runner-207 kernel: [26664.622230] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 12:48:10 juju-e4d256-prod-github-runner-207 kernel: [26664.623120] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 12:48:10 juju-e4d256-prod-github-runner-207 kernel: [26664.624032] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 12:48:10 juju-e4d256-prod-github-runner-207 kernel: [26664.624921] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 12:48:10 juju-e4d256-prod-github-runner-207 kernel: [26664.625816] Aug 22 12:48:38 juju-e4d256-prod-github-runner-207 kernel: [26692.541982] watchdog: BUG: soft lockup - CPU#1 stuck for 24751s! [qemu-system-x86:6715] Aug 22 12:48:38 juju-e4d256-prod-github-runner-207 kernel: [26692.543115] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 12:48:38 juju-e4d256-prod-github-runner-207 kernel: [26692.543209] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 12:48:38 juju-e4d256-prod-github-runner-207 kernel: [26692.555507] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 12:48:38 juju-e4d256-prod-github-runner-207 kernel: [26692.556805] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 12:48:38 juju-e4d256-prod-github-runner-207 kernel: [26692.558240] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:48:38 juju-e4d256-prod-github-runner-207 kernel: [26692.559467] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 12:48:38 juju-e4d256-prod-github-runner-207 kernel: [26692.562550] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 12:48:38 juju-e4d256-prod-github-runner-207 kernel: [26692.563716] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 12:48:38 juju-e4d256-prod-github-runner-207 kernel: [26692.565031] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 12:48:38 juju-e4d256-prod-github-runner-207 kernel: [26692.566343] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 12:48:38 juju-e4d256-prod-github-runner-207 kernel: [26692.567658] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 12:48:38 juju-e4d256-prod-github-runner-207 kernel: [26692.568964] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 12:48:38 juju-e4d256-prod-github-runner-207 kernel: [26692.570276] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 12:48:38 juju-e4d256-prod-github-runner-207 kernel: [26692.571685] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 12:48:38 juju-e4d256-prod-github-runner-207 kernel: [26692.572896] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 12:48:38 juju-e4d256-prod-github-runner-207 kernel: [26692.574242] Call Trace: Aug 22 12:48:38 juju-e4d256-prod-github-runner-207 kernel: [26692.575232] Aug 22 12:48:38 juju-e4d256-prod-github-runner-207 kernel: [26692.576165] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:48:38 juju-e4d256-prod-github-runner-207 kernel: [26692.577241] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:48:38 juju-e4d256-prod-github-runner-207 kernel: [26692.578270] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:48:38 juju-e4d256-prod-github-runner-207 kernel: [26692.579375] ? show_regs.part.0+0x23/0x29 Aug 22 12:48:38 juju-e4d256-prod-github-runner-207 kernel: [26692.580382] ? show_regs.cold+0x8/0xd Aug 22 12:48:38 juju-e4d256-prod-github-runner-207 kernel: [26692.581367] ? watchdog_timer_fn+0x1be/0x220 Aug 22 12:48:38 juju-e4d256-prod-github-runner-207 kernel: [26692.582381] ? lockup_detector_update_enable+0x60/0x60 Aug 22 12:48:38 juju-e4d256-prod-github-runner-207 kernel: [26692.583459] ? __hrtimer_run_queues+0x107/0x230 Aug 22 12:48:38 juju-e4d256-prod-github-runner-207 kernel: [26692.584488] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 12:48:38 juju-e4d256-prod-github-runner-207 kernel: [26692.585511] ? hrtimer_interrupt+0x101/0x220 Aug 22 12:48:38 juju-e4d256-prod-github-runner-207 kernel: [26692.586531] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 12:48:38 juju-e4d256-prod-github-runner-207 kernel: [26692.587642] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 12:48:38 juju-e4d256-prod-github-runner-207 kernel: [26692.588695] Aug 22 12:48:38 juju-e4d256-prod-github-runner-207 kernel: [26692.589560] Aug 22 12:48:38 juju-e4d256-prod-github-runner-207 kernel: [26692.590397] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 12:48:38 juju-e4d256-prod-github-runner-207 kernel: [26692.591446] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:48:38 juju-e4d256-prod-github-runner-207 kernel: [26692.592616] ? _raw_spin_lock+0x22/0x30 Aug 22 12:48:38 juju-e4d256-prod-github-runner-207 kernel: [26692.593648] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:48:38 juju-e4d256-prod-github-runner-207 kernel: [26692.594769] direct_page_fault+0x206/0x310 [kvm] Aug 22 12:48:38 juju-e4d256-prod-github-runner-207 kernel: [26692.595906] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 12:48:38 juju-e4d256-prod-github-runner-207 kernel: [26692.597014] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 12:48:38 juju-e4d256-prod-github-runner-207 kernel: [26692.598179] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 12:48:38 juju-e4d256-prod-github-runner-207 kernel: [26692.599349] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 12:48:38 juju-e4d256-prod-github-runner-207 kernel: [26692.600433] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 12:48:38 juju-e4d256-prod-github-runner-207 kernel: [26692.601534] handle_exit+0x98/0x230 [kvm_amd] Aug 22 12:48:38 juju-e4d256-prod-github-runner-207 kernel: [26692.602519] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 12:48:38 juju-e4d256-prod-github-runner-207 kernel: [26692.603572] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 12:48:38 juju-e4d256-prod-github-runner-207 kernel: [26692.604600] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 12:48:38 juju-e4d256-prod-github-runner-207 kernel: [26692.605630] vcpu_run+0x62/0x2c0 [kvm] Aug 22 12:48:38 juju-e4d256-prod-github-runner-207 kernel: [26692.606521] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 12:48:38 juju-e4d256-prod-github-runner-207 kernel: [26692.607442] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 12:48:38 juju-e4d256-prod-github-runner-207 kernel: [26692.608429] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 12:48:38 juju-e4d256-prod-github-runner-207 kernel: [26692.609324] ? __seccomp_filter+0x4a/0x4a0 Aug 22 12:48:38 juju-e4d256-prod-github-runner-207 kernel: [26692.610152] ? __fget_files+0x86/0xc0 Aug 22 12:48:38 juju-e4d256-prod-github-runner-207 kernel: [26692.610940] __x64_sys_ioctl+0x95/0xd0 Aug 22 12:48:38 juju-e4d256-prod-github-runner-207 kernel: [26692.611725] do_syscall_64+0x5c/0xc0 Aug 22 12:48:38 juju-e4d256-prod-github-runner-207 kernel: [26692.612464] ? do_futex+0x162/0x1f0 Aug 22 12:48:38 juju-e4d256-prod-github-runner-207 kernel: [26692.613186] ? __x64_sys_futex+0x78/0x1e0 Aug 22 12:48:38 juju-e4d256-prod-github-runner-207 kernel: [26692.613941] ? __secure_computing+0xa9/0x120 Aug 22 12:48:38 juju-e4d256-prod-github-runner-207 kernel: [26692.614724] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 12:48:38 juju-e4d256-prod-github-runner-207 kernel: [26692.615604] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:48:38 juju-e4d256-prod-github-runner-207 kernel: [26692.616428] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:48:38 juju-e4d256-prod-github-runner-207 kernel: [26692.617263] ? do_syscall_64+0x69/0xc0 Aug 22 12:48:38 juju-e4d256-prod-github-runner-207 kernel: [26692.617987] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:48:38 juju-e4d256-prod-github-runner-207 kernel: [26692.618788] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:48:38 juju-e4d256-prod-github-runner-207 kernel: [26692.619597] ? do_syscall_64+0x69/0xc0 Aug 22 12:48:38 juju-e4d256-prod-github-runner-207 kernel: [26692.620314] ? do_syscall_64+0x69/0xc0 Aug 22 12:48:38 juju-e4d256-prod-github-runner-207 kernel: [26692.621016] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 12:48:38 juju-e4d256-prod-github-runner-207 kernel: [26692.621821] RIP: 0033:0x7faa5d0edaff Aug 22 12:48:38 juju-e4d256-prod-github-runner-207 kernel: [26692.622537] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 12:48:38 juju-e4d256-prod-github-runner-207 kernel: [26692.624890] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 12:48:38 juju-e4d256-prod-github-runner-207 kernel: [26692.625956] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 12:48:38 juju-e4d256-prod-github-runner-207 kernel: [26692.627046] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 12:48:38 juju-e4d256-prod-github-runner-207 kernel: [26692.628106] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 12:48:38 juju-e4d256-prod-github-runner-207 kernel: [26692.629153] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 12:48:38 juju-e4d256-prod-github-runner-207 kernel: [26692.630189] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 12:48:38 juju-e4d256-prod-github-runner-207 kernel: [26692.631306] Aug 22 12:49:06 juju-e4d256-prod-github-runner-207 kernel: [26720.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 24777s! [qemu-system-x86:6715] Aug 22 12:49:06 juju-e4d256-prod-github-runner-207 kernel: [26720.543128] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 12:49:06 juju-e4d256-prod-github-runner-207 kernel: [26720.543202] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 12:49:06 juju-e4d256-prod-github-runner-207 kernel: [26720.555637] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 12:49:06 juju-e4d256-prod-github-runner-207 kernel: [26720.556935] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 12:49:06 juju-e4d256-prod-github-runner-207 kernel: [26720.558158] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:49:06 juju-e4d256-prod-github-runner-207 kernel: [26720.559230] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 12:49:06 juju-e4d256-prod-github-runner-207 kernel: [26720.561775] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 12:49:06 juju-e4d256-prod-github-runner-207 kernel: [26720.562835] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 12:49:06 juju-e4d256-prod-github-runner-207 kernel: [26720.563999] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 12:49:06 juju-e4d256-prod-github-runner-207 kernel: [26720.565164] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 12:49:06 juju-e4d256-prod-github-runner-207 kernel: [26720.566369] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 12:49:06 juju-e4d256-prod-github-runner-207 kernel: [26720.567602] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 12:49:06 juju-e4d256-prod-github-runner-207 kernel: [26720.568796] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 12:49:06 juju-e4d256-prod-github-runner-207 kernel: [26720.570038] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 12:49:06 juju-e4d256-prod-github-runner-207 kernel: [26720.571154] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 12:49:06 juju-e4d256-prod-github-runner-207 kernel: [26720.572347] Call Trace: Aug 22 12:49:06 juju-e4d256-prod-github-runner-207 kernel: [26720.573264] Aug 22 12:49:06 juju-e4d256-prod-github-runner-207 kernel: [26720.574147] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:49:06 juju-e4d256-prod-github-runner-207 kernel: [26720.575187] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:49:06 juju-e4d256-prod-github-runner-207 kernel: [26720.576208] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:49:06 juju-e4d256-prod-github-runner-207 kernel: [26720.577283] ? show_regs.part.0+0x23/0x29 Aug 22 12:49:06 juju-e4d256-prod-github-runner-207 kernel: [26720.578277] ? show_regs.cold+0x8/0xd Aug 22 12:49:06 juju-e4d256-prod-github-runner-207 kernel: [26720.579266] ? watchdog_timer_fn+0x1be/0x220 Aug 22 12:49:06 juju-e4d256-prod-github-runner-207 kernel: [26720.580286] ? lockup_detector_update_enable+0x60/0x60 Aug 22 12:49:06 juju-e4d256-prod-github-runner-207 kernel: [26720.581347] ? __hrtimer_run_queues+0x107/0x230 Aug 22 12:49:06 juju-e4d256-prod-github-runner-207 kernel: [26720.582375] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 12:49:06 juju-e4d256-prod-github-runner-207 kernel: [26720.583413] ? hrtimer_interrupt+0x101/0x220 Aug 22 12:49:06 juju-e4d256-prod-github-runner-207 kernel: [26720.584431] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 12:49:06 juju-e4d256-prod-github-runner-207 kernel: [26720.585504] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 12:49:06 juju-e4d256-prod-github-runner-207 kernel: [26720.586547] Aug 22 12:49:06 juju-e4d256-prod-github-runner-207 kernel: [26720.587407] Aug 22 12:49:06 juju-e4d256-prod-github-runner-207 kernel: [26720.588244] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 12:49:06 juju-e4d256-prod-github-runner-207 kernel: [26720.589280] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:49:06 juju-e4d256-prod-github-runner-207 kernel: [26720.590316] ? _raw_spin_lock+0x22/0x30 Aug 22 12:49:06 juju-e4d256-prod-github-runner-207 kernel: [26720.591270] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:49:06 juju-e4d256-prod-github-runner-207 kernel: [26720.592307] direct_page_fault+0x206/0x310 [kvm] Aug 22 12:49:06 juju-e4d256-prod-github-runner-207 kernel: [26720.593331] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 12:49:06 juju-e4d256-prod-github-runner-207 kernel: [26720.594339] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 12:49:06 juju-e4d256-prod-github-runner-207 kernel: [26720.595344] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 12:49:06 juju-e4d256-prod-github-runner-207 kernel: [26720.596332] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 12:49:06 juju-e4d256-prod-github-runner-207 kernel: [26720.597301] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 12:49:06 juju-e4d256-prod-github-runner-207 kernel: [26720.598330] handle_exit+0x98/0x230 [kvm_amd] Aug 22 12:49:06 juju-e4d256-prod-github-runner-207 kernel: [26720.599254] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 12:49:06 juju-e4d256-prod-github-runner-207 kernel: [26720.600179] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 12:49:06 juju-e4d256-prod-github-runner-207 kernel: [26720.601160] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 12:49:06 juju-e4d256-prod-github-runner-207 kernel: [26720.602093] vcpu_run+0x62/0x2c0 [kvm] Aug 22 12:49:06 juju-e4d256-prod-github-runner-207 kernel: [26720.602921] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 12:49:06 juju-e4d256-prod-github-runner-207 kernel: [26720.603728] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 12:49:06 juju-e4d256-prod-github-runner-207 kernel: [26720.604579] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 12:49:06 juju-e4d256-prod-github-runner-207 kernel: [26720.605376] ? __seccomp_filter+0x4a/0x4a0 Aug 22 12:49:06 juju-e4d256-prod-github-runner-207 kernel: [26720.606120] ? __fget_files+0x86/0xc0 Aug 22 12:49:06 juju-e4d256-prod-github-runner-207 kernel: [26720.606832] __x64_sys_ioctl+0x95/0xd0 Aug 22 12:49:06 juju-e4d256-prod-github-runner-207 kernel: [26720.607532] do_syscall_64+0x5c/0xc0 Aug 22 12:49:06 juju-e4d256-prod-github-runner-207 kernel: [26720.608196] ? do_futex+0x162/0x1f0 Aug 22 12:49:06 juju-e4d256-prod-github-runner-207 kernel: [26720.608870] ? __x64_sys_futex+0x78/0x1e0 Aug 22 12:49:06 juju-e4d256-prod-github-runner-207 kernel: [26720.609556] ? __secure_computing+0xa9/0x120 Aug 22 12:49:06 juju-e4d256-prod-github-runner-207 kernel: [26720.610243] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 12:49:06 juju-e4d256-prod-github-runner-207 kernel: [26720.611017] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:49:06 juju-e4d256-prod-github-runner-207 kernel: [26720.611744] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:49:06 juju-e4d256-prod-github-runner-207 kernel: [26720.612460] ? do_syscall_64+0x69/0xc0 Aug 22 12:49:06 juju-e4d256-prod-github-runner-207 kernel: [26720.613116] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:49:06 juju-e4d256-prod-github-runner-207 kernel: [26720.613825] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:49:06 juju-e4d256-prod-github-runner-207 kernel: [26720.614520] ? do_syscall_64+0x69/0xc0 Aug 22 12:49:06 juju-e4d256-prod-github-runner-207 kernel: [26720.615154] ? do_syscall_64+0x69/0xc0 Aug 22 12:49:06 juju-e4d256-prod-github-runner-207 kernel: [26720.615774] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 12:49:06 juju-e4d256-prod-github-runner-207 kernel: [26720.616472] RIP: 0033:0x7faa5d0edaff Aug 22 12:49:06 juju-e4d256-prod-github-runner-207 kernel: [26720.617093] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 12:49:06 juju-e4d256-prod-github-runner-207 kernel: [26720.619116] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 12:49:06 juju-e4d256-prod-github-runner-207 kernel: [26720.620079] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 12:49:06 juju-e4d256-prod-github-runner-207 kernel: [26720.620985] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 12:49:06 juju-e4d256-prod-github-runner-207 kernel: [26720.621882] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 12:49:06 juju-e4d256-prod-github-runner-207 kernel: [26720.622768] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 12:49:06 juju-e4d256-prod-github-runner-207 kernel: [26720.623669] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 12:49:06 juju-e4d256-prod-github-runner-207 kernel: [26720.624557] Aug 22 12:49:34 juju-e4d256-prod-github-runner-207 kernel: [26748.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 24803s! [qemu-system-x86:6715] Aug 22 12:49:34 juju-e4d256-prod-github-runner-207 kernel: [26748.543898] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 12:49:34 juju-e4d256-prod-github-runner-207 kernel: [26748.544230] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 12:49:34 juju-e4d256-prod-github-runner-207 kernel: [26748.556453] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 12:49:34 juju-e4d256-prod-github-runner-207 kernel: [26748.557715] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 12:49:34 juju-e4d256-prod-github-runner-207 kernel: [26748.558988] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:49:34 juju-e4d256-prod-github-runner-207 kernel: [26748.560044] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 12:49:34 juju-e4d256-prod-github-runner-207 kernel: [26748.562660] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 12:49:34 juju-e4d256-prod-github-runner-207 kernel: [26748.563708] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 12:49:34 juju-e4d256-prod-github-runner-207 kernel: [26748.565130] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 12:49:34 juju-e4d256-prod-github-runner-207 kernel: [26748.566333] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 12:49:34 juju-e4d256-prod-github-runner-207 kernel: [26748.567528] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 12:49:34 juju-e4d256-prod-github-runner-207 kernel: [26748.568730] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 12:49:34 juju-e4d256-prod-github-runner-207 kernel: [26748.569910] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 12:49:34 juju-e4d256-prod-github-runner-207 kernel: [26748.571153] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 12:49:34 juju-e4d256-prod-github-runner-207 kernel: [26748.572314] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 12:49:34 juju-e4d256-prod-github-runner-207 kernel: [26748.573527] Call Trace: Aug 22 12:49:34 juju-e4d256-prod-github-runner-207 kernel: [26748.574493] Aug 22 12:49:34 juju-e4d256-prod-github-runner-207 kernel: [26748.575404] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:49:34 juju-e4d256-prod-github-runner-207 kernel: [26748.576434] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:49:34 juju-e4d256-prod-github-runner-207 kernel: [26748.577488] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:49:34 juju-e4d256-prod-github-runner-207 kernel: [26748.578713] ? show_regs.part.0+0x23/0x29 Aug 22 12:49:34 juju-e4d256-prod-github-runner-207 kernel: [26748.579769] ? show_regs.cold+0x8/0xd Aug 22 12:49:34 juju-e4d256-prod-github-runner-207 kernel: [26748.580741] ? watchdog_timer_fn+0x1be/0x220 Aug 22 12:49:34 juju-e4d256-prod-github-runner-207 kernel: [26748.581758] ? lockup_detector_update_enable+0x60/0x60 Aug 22 12:49:34 juju-e4d256-prod-github-runner-207 kernel: [26748.582841] ? __hrtimer_run_queues+0x107/0x230 Aug 22 12:49:34 juju-e4d256-prod-github-runner-207 kernel: [26748.583905] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 12:49:34 juju-e4d256-prod-github-runner-207 kernel: [26748.584954] ? hrtimer_interrupt+0x101/0x220 Aug 22 12:49:34 juju-e4d256-prod-github-runner-207 kernel: [26748.585989] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 12:49:34 juju-e4d256-prod-github-runner-207 kernel: [26748.587154] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 12:49:34 juju-e4d256-prod-github-runner-207 kernel: [26748.588206] Aug 22 12:49:34 juju-e4d256-prod-github-runner-207 kernel: [26748.589065] Aug 22 12:49:34 juju-e4d256-prod-github-runner-207 kernel: [26748.590010] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 12:49:34 juju-e4d256-prod-github-runner-207 kernel: [26748.591081] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:49:34 juju-e4d256-prod-github-runner-207 kernel: [26748.592147] ? _raw_spin_lock+0x22/0x30 Aug 22 12:49:34 juju-e4d256-prod-github-runner-207 kernel: [26748.593102] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:49:34 juju-e4d256-prod-github-runner-207 kernel: [26748.594131] direct_page_fault+0x206/0x310 [kvm] Aug 22 12:49:34 juju-e4d256-prod-github-runner-207 kernel: [26748.595292] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 12:49:34 juju-e4d256-prod-github-runner-207 kernel: [26748.596519] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 12:49:34 juju-e4d256-prod-github-runner-207 kernel: [26748.597565] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 12:49:34 juju-e4d256-prod-github-runner-207 kernel: [26748.598653] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 12:49:34 juju-e4d256-prod-github-runner-207 kernel: [26748.599607] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 12:49:34 juju-e4d256-prod-github-runner-207 kernel: [26748.600589] handle_exit+0x98/0x230 [kvm_amd] Aug 22 12:49:34 juju-e4d256-prod-github-runner-207 kernel: [26748.601487] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 12:49:34 juju-e4d256-prod-github-runner-207 kernel: [26748.602409] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 12:49:34 juju-e4d256-prod-github-runner-207 kernel: [26748.603352] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 12:49:34 juju-e4d256-prod-github-runner-207 kernel: [26748.604279] vcpu_run+0x62/0x2c0 [kvm] Aug 22 12:49:34 juju-e4d256-prod-github-runner-207 kernel: [26748.605113] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 12:49:34 juju-e4d256-prod-github-runner-207 kernel: [26748.605925] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 12:49:34 juju-e4d256-prod-github-runner-207 kernel: [26748.606805] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 12:49:34 juju-e4d256-prod-github-runner-207 kernel: [26748.607605] ? __seccomp_filter+0x4a/0x4a0 Aug 22 12:49:34 juju-e4d256-prod-github-runner-207 kernel: [26748.608348] ? __fget_files+0x86/0xc0 Aug 22 12:49:34 juju-e4d256-prod-github-runner-207 kernel: [26748.609058] __x64_sys_ioctl+0x95/0xd0 Aug 22 12:49:34 juju-e4d256-prod-github-runner-207 kernel: [26748.609750] do_syscall_64+0x5c/0xc0 Aug 22 12:49:34 juju-e4d256-prod-github-runner-207 kernel: [26748.610417] ? do_futex+0x162/0x1f0 Aug 22 12:49:34 juju-e4d256-prod-github-runner-207 kernel: [26748.611086] ? __x64_sys_futex+0x78/0x1e0 Aug 22 12:49:34 juju-e4d256-prod-github-runner-207 kernel: [26748.611767] ? __secure_computing+0xa9/0x120 Aug 22 12:49:34 juju-e4d256-prod-github-runner-207 kernel: [26748.612465] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 12:49:34 juju-e4d256-prod-github-runner-207 kernel: [26748.613235] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:49:34 juju-e4d256-prod-github-runner-207 kernel: [26748.613957] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:49:34 juju-e4d256-prod-github-runner-207 kernel: [26748.614690] ? do_syscall_64+0x69/0xc0 Aug 22 12:49:34 juju-e4d256-prod-github-runner-207 kernel: [26748.615340] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:49:34 juju-e4d256-prod-github-runner-207 kernel: [26748.616044] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:49:34 juju-e4d256-prod-github-runner-207 kernel: [26748.616737] ? do_syscall_64+0x69/0xc0 Aug 22 12:49:34 juju-e4d256-prod-github-runner-207 kernel: [26748.617361] ? do_syscall_64+0x69/0xc0 Aug 22 12:49:34 juju-e4d256-prod-github-runner-207 kernel: [26748.618100] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 12:49:34 juju-e4d256-prod-github-runner-207 kernel: [26748.618829] RIP: 0033:0x7faa5d0edaff Aug 22 12:49:34 juju-e4d256-prod-github-runner-207 kernel: [26748.619660] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 12:49:34 juju-e4d256-prod-github-runner-207 kernel: [26748.621670] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 12:49:34 juju-e4d256-prod-github-runner-207 kernel: [26748.622618] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 12:49:34 juju-e4d256-prod-github-runner-207 kernel: [26748.623516] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 12:49:34 juju-e4d256-prod-github-runner-207 kernel: [26748.624417] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 12:49:34 juju-e4d256-prod-github-runner-207 kernel: [26748.625302] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 12:49:34 juju-e4d256-prod-github-runner-207 kernel: [26748.626317] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 12:49:34 juju-e4d256-prod-github-runner-207 kernel: [26748.627367] Aug 22 12:50:02 juju-e4d256-prod-github-runner-207 kernel: [26776.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 24829s! [qemu-system-x86:6715] Aug 22 12:50:02 juju-e4d256-prod-github-runner-207 kernel: [26776.543088] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 12:50:02 juju-e4d256-prod-github-runner-207 kernel: [26776.543160] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 12:50:02 juju-e4d256-prod-github-runner-207 kernel: [26776.555330] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 12:50:02 juju-e4d256-prod-github-runner-207 kernel: [26776.556606] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 12:50:02 juju-e4d256-prod-github-runner-207 kernel: [26776.557822] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:50:02 juju-e4d256-prod-github-runner-207 kernel: [26776.558891] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 12:50:02 juju-e4d256-prod-github-runner-207 kernel: [26776.561421] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 12:50:02 juju-e4d256-prod-github-runner-207 kernel: [26776.562496] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 12:50:02 juju-e4d256-prod-github-runner-207 kernel: [26776.563662] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 12:50:02 juju-e4d256-prod-github-runner-207 kernel: [26776.564818] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 12:50:02 juju-e4d256-prod-github-runner-207 kernel: [26776.565973] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 12:50:02 juju-e4d256-prod-github-runner-207 kernel: [26776.567141] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 12:50:02 juju-e4d256-prod-github-runner-207 kernel: [26776.568300] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 12:50:02 juju-e4d256-prod-github-runner-207 kernel: [26776.569544] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 12:50:02 juju-e4d256-prod-github-runner-207 kernel: [26776.570658] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 12:50:02 juju-e4d256-prod-github-runner-207 kernel: [26776.571848] Call Trace: Aug 22 12:50:02 juju-e4d256-prod-github-runner-207 kernel: [26776.572761] Aug 22 12:50:02 juju-e4d256-prod-github-runner-207 kernel: [26776.573643] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:50:02 juju-e4d256-prod-github-runner-207 kernel: [26776.574683] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:50:02 juju-e4d256-prod-github-runner-207 kernel: [26776.575700] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:50:02 juju-e4d256-prod-github-runner-207 kernel: [26776.576770] ? show_regs.part.0+0x23/0x29 Aug 22 12:50:02 juju-e4d256-prod-github-runner-207 kernel: [26776.577766] ? show_regs.cold+0x8/0xd Aug 22 12:50:02 juju-e4d256-prod-github-runner-207 kernel: [26776.578769] ? watchdog_timer_fn+0x1be/0x220 Aug 22 12:50:02 juju-e4d256-prod-github-runner-207 kernel: [26776.579787] ? lockup_detector_update_enable+0x60/0x60 Aug 22 12:50:02 juju-e4d256-prod-github-runner-207 kernel: [26776.580857] ? __hrtimer_run_queues+0x107/0x230 Aug 22 12:50:02 juju-e4d256-prod-github-runner-207 kernel: [26776.581882] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 12:50:02 juju-e4d256-prod-github-runner-207 kernel: [26776.582918] ? hrtimer_interrupt+0x101/0x220 Aug 22 12:50:02 juju-e4d256-prod-github-runner-207 kernel: [26776.583933] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 12:50:02 juju-e4d256-prod-github-runner-207 kernel: [26776.585004] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 12:50:02 juju-e4d256-prod-github-runner-207 kernel: [26776.586044] Aug 22 12:50:02 juju-e4d256-prod-github-runner-207 kernel: [26776.586901] Aug 22 12:50:02 juju-e4d256-prod-github-runner-207 kernel: [26776.587735] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 12:50:02 juju-e4d256-prod-github-runner-207 kernel: [26776.588764] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:50:02 juju-e4d256-prod-github-runner-207 kernel: [26776.589798] ? _raw_spin_lock+0x22/0x30 Aug 22 12:50:02 juju-e4d256-prod-github-runner-207 kernel: [26776.590749] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:50:02 juju-e4d256-prod-github-runner-207 kernel: [26776.591771] direct_page_fault+0x206/0x310 [kvm] Aug 22 12:50:02 juju-e4d256-prod-github-runner-207 kernel: [26776.592792] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 12:50:02 juju-e4d256-prod-github-runner-207 kernel: [26776.593799] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 12:50:02 juju-e4d256-prod-github-runner-207 kernel: [26776.594819] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 12:50:02 juju-e4d256-prod-github-runner-207 kernel: [26776.595787] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 12:50:02 juju-e4d256-prod-github-runner-207 kernel: [26776.596729] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 12:50:02 juju-e4d256-prod-github-runner-207 kernel: [26776.597704] handle_exit+0x98/0x230 [kvm_amd] Aug 22 12:50:02 juju-e4d256-prod-github-runner-207 kernel: [26776.598605] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 12:50:02 juju-e4d256-prod-github-runner-207 kernel: [26776.599541] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 12:50:02 juju-e4d256-prod-github-runner-207 kernel: [26776.600472] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 12:50:02 juju-e4d256-prod-github-runner-207 kernel: [26776.601375] vcpu_run+0x62/0x2c0 [kvm] Aug 22 12:50:02 juju-e4d256-prod-github-runner-207 kernel: [26776.602197] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 12:50:02 juju-e4d256-prod-github-runner-207 kernel: [26776.603006] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 12:50:02 juju-e4d256-prod-github-runner-207 kernel: [26776.603865] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 12:50:02 juju-e4d256-prod-github-runner-207 kernel: [26776.604662] ? __seccomp_filter+0x4a/0x4a0 Aug 22 12:50:02 juju-e4d256-prod-github-runner-207 kernel: [26776.605417] ? __fget_files+0x86/0xc0 Aug 22 12:50:02 juju-e4d256-prod-github-runner-207 kernel: [26776.606168] __x64_sys_ioctl+0x95/0xd0 Aug 22 12:50:02 juju-e4d256-prod-github-runner-207 kernel: [26776.606863] do_syscall_64+0x5c/0xc0 Aug 22 12:50:02 juju-e4d256-prod-github-runner-207 kernel: [26776.607541] ? do_futex+0x162/0x1f0 Aug 22 12:50:02 juju-e4d256-prod-github-runner-207 kernel: [26776.608320] ? __x64_sys_futex+0x78/0x1e0 Aug 22 12:50:02 juju-e4d256-prod-github-runner-207 kernel: [26776.609006] ? __secure_computing+0xa9/0x120 Aug 22 12:50:02 juju-e4d256-prod-github-runner-207 kernel: [26776.609699] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 12:50:02 juju-e4d256-prod-github-runner-207 kernel: [26776.610522] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:50:02 juju-e4d256-prod-github-runner-207 kernel: [26776.611327] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:50:02 juju-e4d256-prod-github-runner-207 kernel: [26776.612055] ? do_syscall_64+0x69/0xc0 Aug 22 12:50:02 juju-e4d256-prod-github-runner-207 kernel: [26776.612706] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:50:02 juju-e4d256-prod-github-runner-207 kernel: [26776.613409] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:50:02 juju-e4d256-prod-github-runner-207 kernel: [26776.614116] ? do_syscall_64+0x69/0xc0 Aug 22 12:50:02 juju-e4d256-prod-github-runner-207 kernel: [26776.614770] ? do_syscall_64+0x69/0xc0 Aug 22 12:50:02 juju-e4d256-prod-github-runner-207 kernel: [26776.615394] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 12:50:02 juju-e4d256-prod-github-runner-207 kernel: [26776.616098] RIP: 0033:0x7faa5d0edaff Aug 22 12:50:02 juju-e4d256-prod-github-runner-207 kernel: [26776.616739] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 12:50:02 juju-e4d256-prod-github-runner-207 kernel: [26776.618766] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 12:50:02 juju-e4d256-prod-github-runner-207 kernel: [26776.619699] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 12:50:02 juju-e4d256-prod-github-runner-207 kernel: [26776.620591] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 12:50:02 juju-e4d256-prod-github-runner-207 kernel: [26776.621481] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 12:50:02 juju-e4d256-prod-github-runner-207 kernel: [26776.622392] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 12:50:02 juju-e4d256-prod-github-runner-207 kernel: [26776.623314] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 12:50:02 juju-e4d256-prod-github-runner-207 kernel: [26776.624229] Aug 22 12:50:30 juju-e4d256-prod-github-runner-207 kernel: [26804.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 24855s! [qemu-system-x86:6715] Aug 22 12:50:30 juju-e4d256-prod-github-runner-207 kernel: [26804.543112] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 12:50:30 juju-e4d256-prod-github-runner-207 kernel: [26804.543185] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 12:50:30 juju-e4d256-prod-github-runner-207 kernel: [26804.555607] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 12:50:30 juju-e4d256-prod-github-runner-207 kernel: [26804.556915] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 12:50:30 juju-e4d256-prod-github-runner-207 kernel: [26804.558178] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:50:30 juju-e4d256-prod-github-runner-207 kernel: [26804.559259] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 12:50:30 juju-e4d256-prod-github-runner-207 kernel: [26804.561885] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 12:50:30 juju-e4d256-prod-github-runner-207 kernel: [26804.562966] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 12:50:30 juju-e4d256-prod-github-runner-207 kernel: [26804.564168] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 12:50:30 juju-e4d256-prod-github-runner-207 kernel: [26804.565365] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 12:50:30 juju-e4d256-prod-github-runner-207 kernel: [26804.566575] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 12:50:30 juju-e4d256-prod-github-runner-207 kernel: [26804.567920] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 12:50:30 juju-e4d256-prod-github-runner-207 kernel: [26804.569126] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 12:50:30 juju-e4d256-prod-github-runner-207 kernel: [26804.570432] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 12:50:30 juju-e4d256-prod-github-runner-207 kernel: [26804.571557] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 12:50:30 juju-e4d256-prod-github-runner-207 kernel: [26804.572784] Call Trace: Aug 22 12:50:30 juju-e4d256-prod-github-runner-207 kernel: [26804.573943] Aug 22 12:50:30 juju-e4d256-prod-github-runner-207 kernel: [26804.574870] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:50:30 juju-e4d256-prod-github-runner-207 kernel: [26804.575929] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:50:30 juju-e4d256-prod-github-runner-207 kernel: [26804.576974] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:50:30 juju-e4d256-prod-github-runner-207 kernel: [26804.578097] ? show_regs.part.0+0x23/0x29 Aug 22 12:50:30 juju-e4d256-prod-github-runner-207 kernel: [26804.579127] ? show_regs.cold+0x8/0xd Aug 22 12:50:30 juju-e4d256-prod-github-runner-207 kernel: [26804.580125] ? watchdog_timer_fn+0x1be/0x220 Aug 22 12:50:30 juju-e4d256-prod-github-runner-207 kernel: [26804.581156] ? lockup_detector_update_enable+0x60/0x60 Aug 22 12:50:30 juju-e4d256-prod-github-runner-207 kernel: [26804.582288] ? __hrtimer_run_queues+0x107/0x230 Aug 22 12:50:30 juju-e4d256-prod-github-runner-207 kernel: [26804.583411] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 12:50:30 juju-e4d256-prod-github-runner-207 kernel: [26804.584477] ? hrtimer_interrupt+0x101/0x220 Aug 22 12:50:30 juju-e4d256-prod-github-runner-207 kernel: [26804.585619] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 12:50:30 juju-e4d256-prod-github-runner-207 kernel: [26804.586742] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 12:50:30 juju-e4d256-prod-github-runner-207 kernel: [26804.587854] Aug 22 12:50:30 juju-e4d256-prod-github-runner-207 kernel: [26804.588737] Aug 22 12:50:30 juju-e4d256-prod-github-runner-207 kernel: [26804.589592] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 12:50:30 juju-e4d256-prod-github-runner-207 kernel: [26804.590714] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:50:30 juju-e4d256-prod-github-runner-207 kernel: [26804.591791] ? _raw_spin_lock+0x22/0x30 Aug 22 12:50:30 juju-e4d256-prod-github-runner-207 kernel: [26804.592756] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:50:30 juju-e4d256-prod-github-runner-207 kernel: [26804.593791] direct_page_fault+0x206/0x310 [kvm] Aug 22 12:50:30 juju-e4d256-prod-github-runner-207 kernel: [26804.594850] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 12:50:30 juju-e4d256-prod-github-runner-207 kernel: [26804.595922] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 12:50:30 juju-e4d256-prod-github-runner-207 kernel: [26804.596954] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 12:50:30 juju-e4d256-prod-github-runner-207 kernel: [26804.597990] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 12:50:30 juju-e4d256-prod-github-runner-207 kernel: [26804.598971] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 12:50:30 juju-e4d256-prod-github-runner-207 kernel: [26804.599976] handle_exit+0x98/0x230 [kvm_amd] Aug 22 12:50:30 juju-e4d256-prod-github-runner-207 kernel: [26804.600891] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 12:50:30 juju-e4d256-prod-github-runner-207 kernel: [26804.601875] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 12:50:30 juju-e4d256-prod-github-runner-207 kernel: [26804.602837] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 12:50:30 juju-e4d256-prod-github-runner-207 kernel: [26804.603764] vcpu_run+0x62/0x2c0 [kvm] Aug 22 12:50:30 juju-e4d256-prod-github-runner-207 kernel: [26804.604592] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 12:50:30 juju-e4d256-prod-github-runner-207 kernel: [26804.605426] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 12:50:30 juju-e4d256-prod-github-runner-207 kernel: [26804.606340] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 12:50:30 juju-e4d256-prod-github-runner-207 kernel: [26804.607159] ? __seccomp_filter+0x4a/0x4a0 Aug 22 12:50:30 juju-e4d256-prod-github-runner-207 kernel: [26804.607939] ? __fget_files+0x86/0xc0 Aug 22 12:50:30 juju-e4d256-prod-github-runner-207 kernel: [26804.608701] __x64_sys_ioctl+0x95/0xd0 Aug 22 12:50:30 juju-e4d256-prod-github-runner-207 kernel: [26804.609413] do_syscall_64+0x5c/0xc0 Aug 22 12:50:30 juju-e4d256-prod-github-runner-207 kernel: [26804.610148] ? do_futex+0x162/0x1f0 Aug 22 12:50:30 juju-e4d256-prod-github-runner-207 kernel: [26804.610815] ? __x64_sys_futex+0x78/0x1e0 Aug 22 12:50:30 juju-e4d256-prod-github-runner-207 kernel: [26804.611507] ? __secure_computing+0xa9/0x120 Aug 22 12:50:30 juju-e4d256-prod-github-runner-207 kernel: [26804.612289] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 12:50:30 juju-e4d256-prod-github-runner-207 kernel: [26804.613075] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:50:30 juju-e4d256-prod-github-runner-207 kernel: [26804.613849] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:50:30 juju-e4d256-prod-github-runner-207 kernel: [26804.614601] ? do_syscall_64+0x69/0xc0 Aug 22 12:50:30 juju-e4d256-prod-github-runner-207 kernel: [26804.615270] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:50:30 juju-e4d256-prod-github-runner-207 kernel: [26804.616031] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:50:30 juju-e4d256-prod-github-runner-207 kernel: [26804.616758] ? do_syscall_64+0x69/0xc0 Aug 22 12:50:30 juju-e4d256-prod-github-runner-207 kernel: [26804.617404] ? do_syscall_64+0x69/0xc0 Aug 22 12:50:30 juju-e4d256-prod-github-runner-207 kernel: [26804.618055] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 12:50:30 juju-e4d256-prod-github-runner-207 kernel: [26804.618815] RIP: 0033:0x7faa5d0edaff Aug 22 12:50:30 juju-e4d256-prod-github-runner-207 kernel: [26804.619471] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 12:50:30 juju-e4d256-prod-github-runner-207 kernel: [26804.621649] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 12:50:30 juju-e4d256-prod-github-runner-207 kernel: [26804.622644] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 12:50:30 juju-e4d256-prod-github-runner-207 kernel: [26804.623567] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 12:50:30 juju-e4d256-prod-github-runner-207 kernel: [26804.624530] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 12:50:30 juju-e4d256-prod-github-runner-207 kernel: [26804.625477] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 12:50:30 juju-e4d256-prod-github-runner-207 kernel: [26804.626413] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 12:50:30 juju-e4d256-prod-github-runner-207 kernel: [26804.627349] Aug 22 12:50:45 juju-e4d256-prod-github-runner-207 kernel: [26818.976707] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 12:50:45 juju-e4d256-prod-github-runner-207 kernel: [26818.977699] rcu: 1-....: (6654637 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=3218674 Aug 22 12:50:45 juju-e4d256-prod-github-runner-207 kernel: [26818.978832] (t=6675444 jiffies g=23269 q=31065) Aug 22 12:50:45 juju-e4d256-prod-github-runner-207 kernel: [26818.979614] NMI backtrace for cpu 1 Aug 22 12:50:45 juju-e4d256-prod-github-runner-207 kernel: [26818.980322] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 12:50:45 juju-e4d256-prod-github-runner-207 kernel: [26818.981475] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 12:50:45 juju-e4d256-prod-github-runner-207 kernel: [26818.982551] Call Trace: Aug 22 12:50:45 juju-e4d256-prod-github-runner-207 kernel: [26818.983264] Aug 22 12:50:45 juju-e4d256-prod-github-runner-207 kernel: [26818.983923] show_stack+0x52/0x5c Aug 22 12:50:45 juju-e4d256-prod-github-runner-207 kernel: [26818.984647] dump_stack_lvl+0x4a/0x63 Aug 22 12:50:45 juju-e4d256-prod-github-runner-207 kernel: [26818.985392] dump_stack+0x10/0x16 Aug 22 12:50:45 juju-e4d256-prod-github-runner-207 kernel: [26818.986131] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 12:50:45 juju-e4d256-prod-github-runner-207 kernel: [26818.986916] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 12:50:45 juju-e4d256-prod-github-runner-207 kernel: [26818.987692] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 12:50:45 juju-e4d256-prod-github-runner-207 kernel: [26818.988564] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 12:50:45 juju-e4d256-prod-github-runner-207 kernel: [26818.989404] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 12:50:45 juju-e4d256-prod-github-runner-207 kernel: [26818.990230] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 12:50:45 juju-e4d256-prod-github-runner-207 kernel: [26818.991000] print_cpu_stall.cold+0x2f/0xe2 Aug 22 12:50:45 juju-e4d256-prod-github-runner-207 kernel: [26818.991762] ? timekeeping_update+0xf7/0x150 Aug 22 12:50:45 juju-e4d256-prod-github-runner-207 kernel: [26818.992534] check_cpu_stall+0x109/0x270 Aug 22 12:50:45 juju-e4d256-prod-github-runner-207 kernel: [26818.993373] rcu_sched_clock_irq+0x9a/0x250 Aug 22 12:50:45 juju-e4d256-prod-github-runner-207 kernel: [26818.994206] update_process_times+0x94/0xd0 Aug 22 12:50:45 juju-e4d256-prod-github-runner-207 kernel: [26818.994964] tick_sched_handle+0x29/0x70 Aug 22 12:50:45 juju-e4d256-prod-github-runner-207 kernel: [26818.995712] tick_sched_timer+0x8c/0xc0 Aug 22 12:50:45 juju-e4d256-prod-github-runner-207 kernel: [26818.996445] ? tick_nohz_handler+0xb0/0xb0 Aug 22 12:50:45 juju-e4d256-prod-github-runner-207 kernel: [26818.997198] __hrtimer_run_queues+0x107/0x230 Aug 22 12:50:45 juju-e4d256-prod-github-runner-207 kernel: [26818.997979] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 12:50:45 juju-e4d256-prod-github-runner-207 kernel: [26818.998757] hrtimer_interrupt+0x101/0x220 Aug 22 12:50:45 juju-e4d256-prod-github-runner-207 kernel: [26818.999537] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 12:50:45 juju-e4d256-prod-github-runner-207 kernel: [26819.000368] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 12:50:45 juju-e4d256-prod-github-runner-207 kernel: [26819.001168] Aug 22 12:50:45 juju-e4d256-prod-github-runner-207 kernel: [26819.001818] Aug 22 12:50:45 juju-e4d256-prod-github-runner-207 kernel: [26819.002446] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 12:50:45 juju-e4d256-prod-github-runner-207 kernel: [26819.003262] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:50:45 juju-e4d256-prod-github-runner-207 kernel: [26819.004165] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 12:50:45 juju-e4d256-prod-github-runner-207 kernel: [26819.006387] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 12:50:45 juju-e4d256-prod-github-runner-207 kernel: [26819.007258] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 12:50:45 juju-e4d256-prod-github-runner-207 kernel: [26819.008288] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 12:50:45 juju-e4d256-prod-github-runner-207 kernel: [26819.009387] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 12:50:45 juju-e4d256-prod-github-runner-207 kernel: [26819.010376] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 12:50:45 juju-e4d256-prod-github-runner-207 kernel: [26819.011336] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 12:50:45 juju-e4d256-prod-github-runner-207 kernel: [26819.012288] ? _raw_spin_lock+0x22/0x30 Aug 22 12:50:45 juju-e4d256-prod-github-runner-207 kernel: [26819.013044] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:50:45 juju-e4d256-prod-github-runner-207 kernel: [26819.013896] direct_page_fault+0x206/0x310 [kvm] Aug 22 12:50:45 juju-e4d256-prod-github-runner-207 kernel: [26819.014782] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 12:50:45 juju-e4d256-prod-github-runner-207 kernel: [26819.015612] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 12:50:45 juju-e4d256-prod-github-runner-207 kernel: [26819.016436] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 12:50:45 juju-e4d256-prod-github-runner-207 kernel: [26819.017242] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 12:50:45 juju-e4d256-prod-github-runner-207 kernel: [26819.018048] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 12:50:45 juju-e4d256-prod-github-runner-207 kernel: [26819.018908] handle_exit+0x98/0x230 [kvm_amd] Aug 22 12:50:45 juju-e4d256-prod-github-runner-207 kernel: [26819.019687] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 12:50:45 juju-e4d256-prod-github-runner-207 kernel: [26819.020479] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 12:50:45 juju-e4d256-prod-github-runner-207 kernel: [26819.021340] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 12:50:45 juju-e4d256-prod-github-runner-207 kernel: [26819.022429] vcpu_run+0x62/0x2c0 [kvm] Aug 22 12:50:45 juju-e4d256-prod-github-runner-207 kernel: [26819.023211] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 12:50:45 juju-e4d256-prod-github-runner-207 kernel: [26819.024033] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 12:50:45 juju-e4d256-prod-github-runner-207 kernel: [26819.025044] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 12:50:45 juju-e4d256-prod-github-runner-207 kernel: [26819.025840] ? __seccomp_filter+0x4a/0x4a0 Aug 22 12:50:45 juju-e4d256-prod-github-runner-207 kernel: [26819.026559] ? __fget_files+0x86/0xc0 Aug 22 12:50:45 juju-e4d256-prod-github-runner-207 kernel: [26819.027249] __x64_sys_ioctl+0x95/0xd0 Aug 22 12:50:45 juju-e4d256-prod-github-runner-207 kernel: [26819.027974] do_syscall_64+0x5c/0xc0 Aug 22 12:50:45 juju-e4d256-prod-github-runner-207 kernel: [26819.028658] ? do_futex+0x162/0x1f0 Aug 22 12:50:45 juju-e4d256-prod-github-runner-207 kernel: [26819.029380] ? __x64_sys_futex+0x78/0x1e0 Aug 22 12:50:45 juju-e4d256-prod-github-runner-207 kernel: [26819.030107] ? __secure_computing+0xa9/0x120 Aug 22 12:50:45 juju-e4d256-prod-github-runner-207 kernel: [26819.030831] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 12:50:45 juju-e4d256-prod-github-runner-207 kernel: [26819.031669] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:50:45 juju-e4d256-prod-github-runner-207 kernel: [26819.032436] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:50:45 juju-e4d256-prod-github-runner-207 kernel: [26819.033202] ? do_syscall_64+0x69/0xc0 Aug 22 12:50:45 juju-e4d256-prod-github-runner-207 kernel: [26819.033910] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:50:45 juju-e4d256-prod-github-runner-207 kernel: [26819.034683] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:50:45 juju-e4d256-prod-github-runner-207 kernel: [26819.035486] ? do_syscall_64+0x69/0xc0 Aug 22 12:50:45 juju-e4d256-prod-github-runner-207 kernel: [26819.036189] ? do_syscall_64+0x69/0xc0 Aug 22 12:50:45 juju-e4d256-prod-github-runner-207 kernel: [26819.036881] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 12:50:45 juju-e4d256-prod-github-runner-207 kernel: [26819.037671] RIP: 0033:0x7faa5d0edaff Aug 22 12:50:45 juju-e4d256-prod-github-runner-207 kernel: [26819.038354] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 12:50:45 juju-e4d256-prod-github-runner-207 kernel: [26819.040441] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 12:50:45 juju-e4d256-prod-github-runner-207 kernel: [26819.041404] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 12:50:45 juju-e4d256-prod-github-runner-207 kernel: [26819.042364] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 12:50:45 juju-e4d256-prod-github-runner-207 kernel: [26819.043328] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 12:50:45 juju-e4d256-prod-github-runner-207 kernel: [26819.044266] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 12:50:45 juju-e4d256-prod-github-runner-207 kernel: [26819.045219] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 12:50:45 juju-e4d256-prod-github-runner-207 kernel: [26819.046172] Aug 22 12:51:10 juju-e4d256-prod-github-runner-207 kernel: [26844.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 24892s! [qemu-system-x86:6715] Aug 22 12:51:10 juju-e4d256-prod-github-runner-207 kernel: [26844.543930] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 12:51:10 juju-e4d256-prod-github-runner-207 kernel: [26844.544240] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 12:51:10 juju-e4d256-prod-github-runner-207 kernel: [26844.557090] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 12:51:10 juju-e4d256-prod-github-runner-207 kernel: [26844.558550] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 12:51:10 juju-e4d256-prod-github-runner-207 kernel: [26844.559791] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:51:10 juju-e4d256-prod-github-runner-207 kernel: [26844.560861] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 12:51:10 juju-e4d256-prod-github-runner-207 kernel: [26844.563480] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 12:51:10 juju-e4d256-prod-github-runner-207 kernel: [26844.564534] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 12:51:10 juju-e4d256-prod-github-runner-207 kernel: [26844.565786] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 12:51:10 juju-e4d256-prod-github-runner-207 kernel: [26844.566970] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 12:51:10 juju-e4d256-prod-github-runner-207 kernel: [26844.568153] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 12:51:10 juju-e4d256-prod-github-runner-207 kernel: [26844.569381] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 12:51:10 juju-e4d256-prod-github-runner-207 kernel: [26844.570583] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 12:51:10 juju-e4d256-prod-github-runner-207 kernel: [26844.571837] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 12:51:10 juju-e4d256-prod-github-runner-207 kernel: [26844.572953] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 12:51:10 juju-e4d256-prod-github-runner-207 kernel: [26844.574177] Call Trace: Aug 22 12:51:10 juju-e4d256-prod-github-runner-207 kernel: [26844.575095] Aug 22 12:51:10 juju-e4d256-prod-github-runner-207 kernel: [26844.576006] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:51:10 juju-e4d256-prod-github-runner-207 kernel: [26844.577048] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:51:10 juju-e4d256-prod-github-runner-207 kernel: [26844.578124] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:51:10 juju-e4d256-prod-github-runner-207 kernel: [26844.579257] ? show_regs.part.0+0x23/0x29 Aug 22 12:51:10 juju-e4d256-prod-github-runner-207 kernel: [26844.580272] ? show_regs.cold+0x8/0xd Aug 22 12:51:10 juju-e4d256-prod-github-runner-207 kernel: [26844.581276] ? watchdog_timer_fn+0x1be/0x220 Aug 22 12:51:10 juju-e4d256-prod-github-runner-207 kernel: [26844.582325] ? lockup_detector_update_enable+0x60/0x60 Aug 22 12:51:10 juju-e4d256-prod-github-runner-207 kernel: [26844.583403] ? __hrtimer_run_queues+0x107/0x230 Aug 22 12:51:10 juju-e4d256-prod-github-runner-207 kernel: [26844.584456] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 12:51:10 juju-e4d256-prod-github-runner-207 kernel: [26844.585531] ? hrtimer_interrupt+0x101/0x220 Aug 22 12:51:10 juju-e4d256-prod-github-runner-207 kernel: [26844.586559] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 12:51:10 juju-e4d256-prod-github-runner-207 kernel: [26844.587666] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 12:51:10 juju-e4d256-prod-github-runner-207 kernel: [26844.588736] Aug 22 12:51:10 juju-e4d256-prod-github-runner-207 kernel: [26844.589634] Aug 22 12:51:10 juju-e4d256-prod-github-runner-207 kernel: [26844.590475] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 12:51:10 juju-e4d256-prod-github-runner-207 kernel: [26844.591524] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:51:10 juju-e4d256-prod-github-runner-207 kernel: [26844.592594] ? _raw_spin_lock+0x22/0x30 Aug 22 12:51:10 juju-e4d256-prod-github-runner-207 kernel: [26844.593573] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:51:10 juju-e4d256-prod-github-runner-207 kernel: [26844.594603] direct_page_fault+0x206/0x310 [kvm] Aug 22 12:51:10 juju-e4d256-prod-github-runner-207 kernel: [26844.595748] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 12:51:10 juju-e4d256-prod-github-runner-207 kernel: [26844.596797] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 12:51:10 juju-e4d256-prod-github-runner-207 kernel: [26844.597836] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 12:51:10 juju-e4d256-prod-github-runner-207 kernel: [26844.598938] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 12:51:10 juju-e4d256-prod-github-runner-207 kernel: [26844.599912] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 12:51:10 juju-e4d256-prod-github-runner-207 kernel: [26844.600908] handle_exit+0x98/0x230 [kvm_amd] Aug 22 12:51:10 juju-e4d256-prod-github-runner-207 kernel: [26844.601835] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 12:51:10 juju-e4d256-prod-github-runner-207 kernel: [26844.602802] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 12:51:10 juju-e4d256-prod-github-runner-207 kernel: [26844.603743] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 12:51:10 juju-e4d256-prod-github-runner-207 kernel: [26844.604658] vcpu_run+0x62/0x2c0 [kvm] Aug 22 12:51:10 juju-e4d256-prod-github-runner-207 kernel: [26844.605539] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 12:51:10 juju-e4d256-prod-github-runner-207 kernel: [26844.606365] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 12:51:10 juju-e4d256-prod-github-runner-207 kernel: [26844.607243] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 12:51:10 juju-e4d256-prod-github-runner-207 kernel: [26844.608061] ? __seccomp_filter+0x4a/0x4a0 Aug 22 12:51:10 juju-e4d256-prod-github-runner-207 kernel: [26844.608820] ? __fget_files+0x86/0xc0 Aug 22 12:51:10 juju-e4d256-prod-github-runner-207 kernel: [26844.609571] __x64_sys_ioctl+0x95/0xd0 Aug 22 12:51:10 juju-e4d256-prod-github-runner-207 kernel: [26844.610273] do_syscall_64+0x5c/0xc0 Aug 22 12:51:10 juju-e4d256-prod-github-runner-207 kernel: [26844.610957] ? do_futex+0x162/0x1f0 Aug 22 12:51:10 juju-e4d256-prod-github-runner-207 kernel: [26844.611639] ? __x64_sys_futex+0x78/0x1e0 Aug 22 12:51:10 juju-e4d256-prod-github-runner-207 kernel: [26844.612327] ? __secure_computing+0xa9/0x120 Aug 22 12:51:10 juju-e4d256-prod-github-runner-207 kernel: [26844.613031] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 12:51:10 juju-e4d256-prod-github-runner-207 kernel: [26844.613818] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:51:10 juju-e4d256-prod-github-runner-207 kernel: [26844.614551] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:51:10 juju-e4d256-prod-github-runner-207 kernel: [26844.615289] ? do_syscall_64+0x69/0xc0 Aug 22 12:51:10 juju-e4d256-prod-github-runner-207 kernel: [26844.615942] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:51:10 juju-e4d256-prod-github-runner-207 kernel: [26844.616675] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:51:10 juju-e4d256-prod-github-runner-207 kernel: [26844.617470] ? do_syscall_64+0x69/0xc0 Aug 22 12:51:10 juju-e4d256-prod-github-runner-207 kernel: [26844.618213] ? do_syscall_64+0x69/0xc0 Aug 22 12:51:10 juju-e4d256-prod-github-runner-207 kernel: [26844.618906] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 12:51:10 juju-e4d256-prod-github-runner-207 kernel: [26844.619624] RIP: 0033:0x7faa5d0edaff Aug 22 12:51:10 juju-e4d256-prod-github-runner-207 kernel: [26844.620289] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 12:51:10 juju-e4d256-prod-github-runner-207 kernel: [26844.622351] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 12:51:10 juju-e4d256-prod-github-runner-207 kernel: [26844.623307] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 12:51:10 juju-e4d256-prod-github-runner-207 kernel: [26844.624213] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 12:51:10 juju-e4d256-prod-github-runner-207 kernel: [26844.625142] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 12:51:10 juju-e4d256-prod-github-runner-207 kernel: [26844.626126] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 12:51:10 juju-e4d256-prod-github-runner-207 kernel: [26844.627062] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 12:51:10 juju-e4d256-prod-github-runner-207 kernel: [26844.627980] Aug 22 12:51:38 juju-e4d256-prod-github-runner-207 kernel: [26872.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 24919s! [qemu-system-x86:6715] Aug 22 12:51:38 juju-e4d256-prod-github-runner-207 kernel: [26872.543130] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 12:51:38 juju-e4d256-prod-github-runner-207 kernel: [26872.543204] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 12:51:38 juju-e4d256-prod-github-runner-207 kernel: [26872.555599] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 12:51:38 juju-e4d256-prod-github-runner-207 kernel: [26872.556900] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 12:51:38 juju-e4d256-prod-github-runner-207 kernel: [26872.558152] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:51:38 juju-e4d256-prod-github-runner-207 kernel: [26872.559218] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 12:51:38 juju-e4d256-prod-github-runner-207 kernel: [26872.561830] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 12:51:38 juju-e4d256-prod-github-runner-207 kernel: [26872.562888] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 12:51:38 juju-e4d256-prod-github-runner-207 kernel: [26872.564071] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 12:51:38 juju-e4d256-prod-github-runner-207 kernel: [26872.565264] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 12:51:38 juju-e4d256-prod-github-runner-207 kernel: [26872.566442] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 12:51:38 juju-e4d256-prod-github-runner-207 kernel: [26872.567624] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 12:51:38 juju-e4d256-prod-github-runner-207 kernel: [26872.568816] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 12:51:38 juju-e4d256-prod-github-runner-207 kernel: [26872.570077] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 12:51:38 juju-e4d256-prod-github-runner-207 kernel: [26872.571190] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 12:51:38 juju-e4d256-prod-github-runner-207 kernel: [26872.572401] Call Trace: Aug 22 12:51:38 juju-e4d256-prod-github-runner-207 kernel: [26872.573326] Aug 22 12:51:38 juju-e4d256-prod-github-runner-207 kernel: [26872.574217] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:51:38 juju-e4d256-prod-github-runner-207 kernel: [26872.575258] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:51:38 juju-e4d256-prod-github-runner-207 kernel: [26872.576292] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:51:38 juju-e4d256-prod-github-runner-207 kernel: [26872.577402] ? show_regs.part.0+0x23/0x29 Aug 22 12:51:38 juju-e4d256-prod-github-runner-207 kernel: [26872.578412] ? show_regs.cold+0x8/0xd Aug 22 12:51:38 juju-e4d256-prod-github-runner-207 kernel: [26872.579392] ? watchdog_timer_fn+0x1be/0x220 Aug 22 12:51:38 juju-e4d256-prod-github-runner-207 kernel: [26872.580407] ? lockup_detector_update_enable+0x60/0x60 Aug 22 12:51:38 juju-e4d256-prod-github-runner-207 kernel: [26872.581495] ? __hrtimer_run_queues+0x107/0x230 Aug 22 12:51:38 juju-e4d256-prod-github-runner-207 kernel: [26872.582537] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 12:51:38 juju-e4d256-prod-github-runner-207 kernel: [26872.583572] ? hrtimer_interrupt+0x101/0x220 Aug 22 12:51:38 juju-e4d256-prod-github-runner-207 kernel: [26872.584609] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 12:51:38 juju-e4d256-prod-github-runner-207 kernel: [26872.585707] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 12:51:38 juju-e4d256-prod-github-runner-207 kernel: [26872.586775] Aug 22 12:51:38 juju-e4d256-prod-github-runner-207 kernel: [26872.587642] Aug 22 12:51:38 juju-e4d256-prod-github-runner-207 kernel: [26872.588483] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 12:51:38 juju-e4d256-prod-github-runner-207 kernel: [26872.589540] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:51:38 juju-e4d256-prod-github-runner-207 kernel: [26872.590594] ? _raw_spin_lock+0x22/0x30 Aug 22 12:51:38 juju-e4d256-prod-github-runner-207 kernel: [26872.591546] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:51:38 juju-e4d256-prod-github-runner-207 kernel: [26872.592572] direct_page_fault+0x206/0x310 [kvm] Aug 22 12:51:38 juju-e4d256-prod-github-runner-207 kernel: [26872.593613] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 12:51:38 juju-e4d256-prod-github-runner-207 kernel: [26872.594631] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 12:51:38 juju-e4d256-prod-github-runner-207 kernel: [26872.595640] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 12:51:38 juju-e4d256-prod-github-runner-207 kernel: [26872.596746] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 12:51:38 juju-e4d256-prod-github-runner-207 kernel: [26872.597806] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 12:51:38 juju-e4d256-prod-github-runner-207 kernel: [26872.598890] handle_exit+0x98/0x230 [kvm_amd] Aug 22 12:51:38 juju-e4d256-prod-github-runner-207 kernel: [26872.599867] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 12:51:38 juju-e4d256-prod-github-runner-207 kernel: [26872.600912] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 12:51:38 juju-e4d256-prod-github-runner-207 kernel: [26872.601954] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 12:51:38 juju-e4d256-prod-github-runner-207 kernel: [26872.602958] vcpu_run+0x62/0x2c0 [kvm] Aug 22 12:51:38 juju-e4d256-prod-github-runner-207 kernel: [26872.603843] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 12:51:38 juju-e4d256-prod-github-runner-207 kernel: [26872.604740] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 12:51:38 juju-e4d256-prod-github-runner-207 kernel: [26872.605698] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 12:51:38 juju-e4d256-prod-github-runner-207 kernel: [26872.606579] ? __seccomp_filter+0x4a/0x4a0 Aug 22 12:51:38 juju-e4d256-prod-github-runner-207 kernel: [26872.607405] ? __fget_files+0x86/0xc0 Aug 22 12:51:38 juju-e4d256-prod-github-runner-207 kernel: [26872.608187] __x64_sys_ioctl+0x95/0xd0 Aug 22 12:51:38 juju-e4d256-prod-github-runner-207 kernel: [26872.608951] do_syscall_64+0x5c/0xc0 Aug 22 12:51:38 juju-e4d256-prod-github-runner-207 kernel: [26872.609884] ? do_futex+0x162/0x1f0 Aug 22 12:51:38 juju-e4d256-prod-github-runner-207 kernel: [26872.610605] ? __x64_sys_futex+0x78/0x1e0 Aug 22 12:51:38 juju-e4d256-prod-github-runner-207 kernel: [26872.611377] ? __secure_computing+0xa9/0x120 Aug 22 12:51:38 juju-e4d256-prod-github-runner-207 kernel: [26872.612155] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 12:51:38 juju-e4d256-prod-github-runner-207 kernel: [26872.613208] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:51:38 juju-e4d256-prod-github-runner-207 kernel: [26872.614022] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:51:38 juju-e4d256-prod-github-runner-207 kernel: [26872.614840] ? do_syscall_64+0x69/0xc0 Aug 22 12:51:38 juju-e4d256-prod-github-runner-207 kernel: [26872.615566] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:51:38 juju-e4d256-prod-github-runner-207 kernel: [26872.616379] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:51:38 juju-e4d256-prod-github-runner-207 kernel: [26872.617187] ? do_syscall_64+0x69/0xc0 Aug 22 12:51:38 juju-e4d256-prod-github-runner-207 kernel: [26872.617917] ? do_syscall_64+0x69/0xc0 Aug 22 12:51:38 juju-e4d256-prod-github-runner-207 kernel: [26872.618617] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 12:51:38 juju-e4d256-prod-github-runner-207 kernel: [26872.619420] RIP: 0033:0x7faa5d0edaff Aug 22 12:51:38 juju-e4d256-prod-github-runner-207 kernel: [26872.620113] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 12:51:38 juju-e4d256-prod-github-runner-207 kernel: [26872.622439] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 12:51:38 juju-e4d256-prod-github-runner-207 kernel: [26872.623488] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 12:51:38 juju-e4d256-prod-github-runner-207 kernel: [26872.624547] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 12:51:38 juju-e4d256-prod-github-runner-207 kernel: [26872.625585] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 12:51:38 juju-e4d256-prod-github-runner-207 kernel: [26872.626600] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 12:51:38 juju-e4d256-prod-github-runner-207 kernel: [26872.627614] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 12:51:38 juju-e4d256-prod-github-runner-207 kernel: [26872.628640] Aug 22 12:52:06 juju-e4d256-prod-github-runner-207 kernel: [26900.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 24945s! [qemu-system-x86:6715] Aug 22 12:52:06 juju-e4d256-prod-github-runner-207 kernel: [26900.543111] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 12:52:06 juju-e4d256-prod-github-runner-207 kernel: [26900.543180] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 12:52:06 juju-e4d256-prod-github-runner-207 kernel: [26900.555283] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 12:52:06 juju-e4d256-prod-github-runner-207 kernel: [26900.556554] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 12:52:06 juju-e4d256-prod-github-runner-207 kernel: [26900.557796] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:52:06 juju-e4d256-prod-github-runner-207 kernel: [26900.558855] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 12:52:06 juju-e4d256-prod-github-runner-207 kernel: [26900.561407] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 12:52:06 juju-e4d256-prod-github-runner-207 kernel: [26900.562485] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 12:52:06 juju-e4d256-prod-github-runner-207 kernel: [26900.563653] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 12:52:06 juju-e4d256-prod-github-runner-207 kernel: [26900.564832] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 12:52:06 juju-e4d256-prod-github-runner-207 kernel: [26900.566010] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 12:52:06 juju-e4d256-prod-github-runner-207 kernel: [26900.567203] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 12:52:06 juju-e4d256-prod-github-runner-207 kernel: [26900.568377] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 12:52:06 juju-e4d256-prod-github-runner-207 kernel: [26900.569637] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 12:52:06 juju-e4d256-prod-github-runner-207 kernel: [26900.570736] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 12:52:06 juju-e4d256-prod-github-runner-207 kernel: [26900.571940] Call Trace: Aug 22 12:52:06 juju-e4d256-prod-github-runner-207 kernel: [26900.572869] Aug 22 12:52:06 juju-e4d256-prod-github-runner-207 kernel: [26900.573981] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:52:06 juju-e4d256-prod-github-runner-207 kernel: [26900.575031] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:52:06 juju-e4d256-prod-github-runner-207 kernel: [26900.576066] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:52:06 juju-e4d256-prod-github-runner-207 kernel: [26900.577168] ? show_regs.part.0+0x23/0x29 Aug 22 12:52:06 juju-e4d256-prod-github-runner-207 kernel: [26900.578168] ? show_regs.cold+0x8/0xd Aug 22 12:52:06 juju-e4d256-prod-github-runner-207 kernel: [26900.579145] ? watchdog_timer_fn+0x1be/0x220 Aug 22 12:52:06 juju-e4d256-prod-github-runner-207 kernel: [26900.580344] ? lockup_detector_update_enable+0x60/0x60 Aug 22 12:52:06 juju-e4d256-prod-github-runner-207 kernel: [26900.581437] ? __hrtimer_run_queues+0x107/0x230 Aug 22 12:52:06 juju-e4d256-prod-github-runner-207 kernel: [26900.582676] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 12:52:06 juju-e4d256-prod-github-runner-207 kernel: [26900.583886] ? hrtimer_interrupt+0x101/0x220 Aug 22 12:52:06 juju-e4d256-prod-github-runner-207 kernel: [26900.584927] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 12:52:06 juju-e4d256-prod-github-runner-207 kernel: [26900.585996] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 12:52:06 juju-e4d256-prod-github-runner-207 kernel: [26900.587046] Aug 22 12:52:06 juju-e4d256-prod-github-runner-207 kernel: [26900.587898] Aug 22 12:52:06 juju-e4d256-prod-github-runner-207 kernel: [26900.588744] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 12:52:06 juju-e4d256-prod-github-runner-207 kernel: [26900.589781] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:52:06 juju-e4d256-prod-github-runner-207 kernel: [26900.590823] ? _raw_spin_lock+0x22/0x30 Aug 22 12:52:06 juju-e4d256-prod-github-runner-207 kernel: [26900.591765] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:52:06 juju-e4d256-prod-github-runner-207 kernel: [26900.592798] direct_page_fault+0x206/0x310 [kvm] Aug 22 12:52:06 juju-e4d256-prod-github-runner-207 kernel: [26900.593820] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 12:52:06 juju-e4d256-prod-github-runner-207 kernel: [26900.594831] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 12:52:06 juju-e4d256-prod-github-runner-207 kernel: [26900.595851] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 12:52:06 juju-e4d256-prod-github-runner-207 kernel: [26900.596833] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 12:52:06 juju-e4d256-prod-github-runner-207 kernel: [26900.597778] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 12:52:06 juju-e4d256-prod-github-runner-207 kernel: [26900.598757] handle_exit+0x98/0x230 [kvm_amd] Aug 22 12:52:06 juju-e4d256-prod-github-runner-207 kernel: [26900.599647] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 12:52:06 juju-e4d256-prod-github-runner-207 kernel: [26900.600559] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 12:52:06 juju-e4d256-prod-github-runner-207 kernel: [26900.601502] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 12:52:06 juju-e4d256-prod-github-runner-207 kernel: [26900.602411] vcpu_run+0x62/0x2c0 [kvm] Aug 22 12:52:06 juju-e4d256-prod-github-runner-207 kernel: [26900.603221] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 12:52:06 juju-e4d256-prod-github-runner-207 kernel: [26900.604035] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 12:52:06 juju-e4d256-prod-github-runner-207 kernel: [26900.604904] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 12:52:06 juju-e4d256-prod-github-runner-207 kernel: [26900.605705] ? __seccomp_filter+0x4a/0x4a0 Aug 22 12:52:06 juju-e4d256-prod-github-runner-207 kernel: [26900.606451] ? __fget_files+0x86/0xc0 Aug 22 12:52:06 juju-e4d256-prod-github-runner-207 kernel: [26900.607152] __x64_sys_ioctl+0x95/0xd0 Aug 22 12:52:06 juju-e4d256-prod-github-runner-207 kernel: [26900.607843] do_syscall_64+0x5c/0xc0 Aug 22 12:52:06 juju-e4d256-prod-github-runner-207 kernel: [26900.608506] ? do_futex+0x162/0x1f0 Aug 22 12:52:06 juju-e4d256-prod-github-runner-207 kernel: [26900.609197] ? __x64_sys_futex+0x78/0x1e0 Aug 22 12:52:06 juju-e4d256-prod-github-runner-207 kernel: [26900.609886] ? __secure_computing+0xa9/0x120 Aug 22 12:52:06 juju-e4d256-prod-github-runner-207 kernel: [26900.610575] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 12:52:06 juju-e4d256-prod-github-runner-207 kernel: [26900.611335] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:52:06 juju-e4d256-prod-github-runner-207 kernel: [26900.612055] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:52:06 juju-e4d256-prod-github-runner-207 kernel: [26900.612790] ? do_syscall_64+0x69/0xc0 Aug 22 12:52:06 juju-e4d256-prod-github-runner-207 kernel: [26900.613435] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:52:06 juju-e4d256-prod-github-runner-207 kernel: [26900.614194] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:52:06 juju-e4d256-prod-github-runner-207 kernel: [26900.614972] ? do_syscall_64+0x69/0xc0 Aug 22 12:52:06 juju-e4d256-prod-github-runner-207 kernel: [26900.615626] ? do_syscall_64+0x69/0xc0 Aug 22 12:52:06 juju-e4d256-prod-github-runner-207 kernel: [26900.616278] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 12:52:06 juju-e4d256-prod-github-runner-207 kernel: [26900.617006] RIP: 0033:0x7faa5d0edaff Aug 22 12:52:06 juju-e4d256-prod-github-runner-207 kernel: [26900.617631] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 12:52:06 juju-e4d256-prod-github-runner-207 kernel: [26900.619616] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 12:52:06 juju-e4d256-prod-github-runner-207 kernel: [26900.620525] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 12:52:06 juju-e4d256-prod-github-runner-207 kernel: [26900.621424] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 12:52:06 juju-e4d256-prod-github-runner-207 kernel: [26900.622317] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 12:52:06 juju-e4d256-prod-github-runner-207 kernel: [26900.623205] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 12:52:06 juju-e4d256-prod-github-runner-207 kernel: [26900.624094] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 12:52:06 juju-e4d256-prod-github-runner-207 kernel: [26900.624996] Aug 22 12:52:34 juju-e4d256-prod-github-runner-207 kernel: [26928.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 24971s! [qemu-system-x86:6715] Aug 22 12:52:34 juju-e4d256-prod-github-runner-207 kernel: [26928.543869] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 12:52:34 juju-e4d256-prod-github-runner-207 kernel: [26928.544172] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 12:52:34 juju-e4d256-prod-github-runner-207 kernel: [26928.556673] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 12:52:34 juju-e4d256-prod-github-runner-207 kernel: [26928.558025] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 12:52:34 juju-e4d256-prod-github-runner-207 kernel: [26928.559291] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:52:34 juju-e4d256-prod-github-runner-207 kernel: [26928.560425] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 12:52:34 juju-e4d256-prod-github-runner-207 kernel: [26928.563084] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 12:52:34 juju-e4d256-prod-github-runner-207 kernel: [26928.564181] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 12:52:34 juju-e4d256-prod-github-runner-207 kernel: [26928.565385] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 12:52:34 juju-e4d256-prod-github-runner-207 kernel: [26928.566567] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 12:52:34 juju-e4d256-prod-github-runner-207 kernel: [26928.567771] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 12:52:34 juju-e4d256-prod-github-runner-207 kernel: [26928.568999] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 12:52:34 juju-e4d256-prod-github-runner-207 kernel: [26928.570189] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 12:52:34 juju-e4d256-prod-github-runner-207 kernel: [26928.571636] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 12:52:34 juju-e4d256-prod-github-runner-207 kernel: [26928.572764] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 12:52:34 juju-e4d256-prod-github-runner-207 kernel: [26928.573992] Call Trace: Aug 22 12:52:34 juju-e4d256-prod-github-runner-207 kernel: [26928.574919] Aug 22 12:52:34 juju-e4d256-prod-github-runner-207 kernel: [26928.575825] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:52:34 juju-e4d256-prod-github-runner-207 kernel: [26928.576881] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:52:34 juju-e4d256-prod-github-runner-207 kernel: [26928.577919] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:52:34 juju-e4d256-prod-github-runner-207 kernel: [26928.579048] ? show_regs.part.0+0x23/0x29 Aug 22 12:52:34 juju-e4d256-prod-github-runner-207 kernel: [26928.580055] ? show_regs.cold+0x8/0xd Aug 22 12:52:34 juju-e4d256-prod-github-runner-207 kernel: [26928.581074] ? watchdog_timer_fn+0x1be/0x220 Aug 22 12:52:34 juju-e4d256-prod-github-runner-207 kernel: [26928.582099] ? lockup_detector_update_enable+0x60/0x60 Aug 22 12:52:34 juju-e4d256-prod-github-runner-207 kernel: [26928.583179] ? __hrtimer_run_queues+0x107/0x230 Aug 22 12:52:34 juju-e4d256-prod-github-runner-207 kernel: [26928.584265] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 12:52:34 juju-e4d256-prod-github-runner-207 kernel: [26928.585330] ? hrtimer_interrupt+0x101/0x220 Aug 22 12:52:34 juju-e4d256-prod-github-runner-207 kernel: [26928.586345] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 12:52:34 juju-e4d256-prod-github-runner-207 kernel: [26928.587413] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 12:52:34 juju-e4d256-prod-github-runner-207 kernel: [26928.588473] Aug 22 12:52:34 juju-e4d256-prod-github-runner-207 kernel: [26928.589327] Aug 22 12:52:34 juju-e4d256-prod-github-runner-207 kernel: [26928.590165] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 12:52:34 juju-e4d256-prod-github-runner-207 kernel: [26928.591198] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:52:34 juju-e4d256-prod-github-runner-207 kernel: [26928.592235] ? _raw_spin_lock+0x22/0x30 Aug 22 12:52:34 juju-e4d256-prod-github-runner-207 kernel: [26928.593204] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:52:34 juju-e4d256-prod-github-runner-207 kernel: [26928.594228] direct_page_fault+0x206/0x310 [kvm] Aug 22 12:52:34 juju-e4d256-prod-github-runner-207 kernel: [26928.595423] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 12:52:34 juju-e4d256-prod-github-runner-207 kernel: [26928.596464] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 12:52:34 juju-e4d256-prod-github-runner-207 kernel: [26928.597471] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 12:52:34 juju-e4d256-prod-github-runner-207 kernel: [26928.598484] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 12:52:34 juju-e4d256-prod-github-runner-207 kernel: [26928.599433] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 12:52:34 juju-e4d256-prod-github-runner-207 kernel: [26928.600429] handle_exit+0x98/0x230 [kvm_amd] Aug 22 12:52:34 juju-e4d256-prod-github-runner-207 kernel: [26928.601326] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 12:52:34 juju-e4d256-prod-github-runner-207 kernel: [26928.602299] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 12:52:34 juju-e4d256-prod-github-runner-207 kernel: [26928.603274] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 12:52:34 juju-e4d256-prod-github-runner-207 kernel: [26928.604206] vcpu_run+0x62/0x2c0 [kvm] Aug 22 12:52:34 juju-e4d256-prod-github-runner-207 kernel: [26928.605098] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 12:52:34 juju-e4d256-prod-github-runner-207 kernel: [26928.606052] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 12:52:34 juju-e4d256-prod-github-runner-207 kernel: [26928.606913] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 12:52:34 juju-e4d256-prod-github-runner-207 kernel: [26928.607715] ? __seccomp_filter+0x4a/0x4a0 Aug 22 12:52:34 juju-e4d256-prod-github-runner-207 kernel: [26928.608475] ? __fget_files+0x86/0xc0 Aug 22 12:52:34 juju-e4d256-prod-github-runner-207 kernel: [26928.609202] __x64_sys_ioctl+0x95/0xd0 Aug 22 12:52:34 juju-e4d256-prod-github-runner-207 kernel: [26928.609903] do_syscall_64+0x5c/0xc0 Aug 22 12:52:34 juju-e4d256-prod-github-runner-207 kernel: [26928.610572] ? do_futex+0x162/0x1f0 Aug 22 12:52:34 juju-e4d256-prod-github-runner-207 kernel: [26928.611226] ? __x64_sys_futex+0x78/0x1e0 Aug 22 12:52:34 juju-e4d256-prod-github-runner-207 kernel: [26928.611910] ? __secure_computing+0xa9/0x120 Aug 22 12:52:34 juju-e4d256-prod-github-runner-207 kernel: [26928.612625] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 12:52:34 juju-e4d256-prod-github-runner-207 kernel: [26928.613391] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:52:34 juju-e4d256-prod-github-runner-207 kernel: [26928.614121] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:52:34 juju-e4d256-prod-github-runner-207 kernel: [26928.614847] ? do_syscall_64+0x69/0xc0 Aug 22 12:52:34 juju-e4d256-prod-github-runner-207 kernel: [26928.615497] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:52:34 juju-e4d256-prod-github-runner-207 kernel: [26928.616203] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:52:34 juju-e4d256-prod-github-runner-207 kernel: [26928.616922] ? do_syscall_64+0x69/0xc0 Aug 22 12:52:34 juju-e4d256-prod-github-runner-207 kernel: [26928.617548] ? do_syscall_64+0x69/0xc0 Aug 22 12:52:34 juju-e4d256-prod-github-runner-207 kernel: [26928.618177] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 12:52:34 juju-e4d256-prod-github-runner-207 kernel: [26928.618896] RIP: 0033:0x7faa5d0edaff Aug 22 12:52:34 juju-e4d256-prod-github-runner-207 kernel: [26928.619554] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 12:52:34 juju-e4d256-prod-github-runner-207 kernel: [26928.621565] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 12:52:34 juju-e4d256-prod-github-runner-207 kernel: [26928.622497] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 12:52:34 juju-e4d256-prod-github-runner-207 kernel: [26928.623388] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 12:52:34 juju-e4d256-prod-github-runner-207 kernel: [26928.624303] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 12:52:34 juju-e4d256-prod-github-runner-207 kernel: [26928.625201] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 12:52:34 juju-e4d256-prod-github-runner-207 kernel: [26928.626277] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 12:52:34 juju-e4d256-prod-github-runner-207 kernel: [26928.627306] Aug 22 12:53:02 juju-e4d256-prod-github-runner-207 kernel: [26956.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 24997s! [qemu-system-x86:6715] Aug 22 12:53:02 juju-e4d256-prod-github-runner-207 kernel: [26956.543102] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 12:53:02 juju-e4d256-prod-github-runner-207 kernel: [26956.543178] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 12:53:02 juju-e4d256-prod-github-runner-207 kernel: [26956.555276] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 12:53:02 juju-e4d256-prod-github-runner-207 kernel: [26956.556578] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 12:53:02 juju-e4d256-prod-github-runner-207 kernel: [26956.557797] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:53:02 juju-e4d256-prod-github-runner-207 kernel: [26956.558861] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 12:53:02 juju-e4d256-prod-github-runner-207 kernel: [26956.561418] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 12:53:02 juju-e4d256-prod-github-runner-207 kernel: [26956.562463] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 12:53:02 juju-e4d256-prod-github-runner-207 kernel: [26956.563638] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 12:53:02 juju-e4d256-prod-github-runner-207 kernel: [26956.564812] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 12:53:02 juju-e4d256-prod-github-runner-207 kernel: [26956.565977] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 12:53:02 juju-e4d256-prod-github-runner-207 kernel: [26956.567134] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 12:53:02 juju-e4d256-prod-github-runner-207 kernel: [26956.568314] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 12:53:02 juju-e4d256-prod-github-runner-207 kernel: [26956.569551] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 12:53:02 juju-e4d256-prod-github-runner-207 kernel: [26956.570648] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 12:53:02 juju-e4d256-prod-github-runner-207 kernel: [26956.571839] Call Trace: Aug 22 12:53:02 juju-e4d256-prod-github-runner-207 kernel: [26956.572763] Aug 22 12:53:02 juju-e4d256-prod-github-runner-207 kernel: [26956.573647] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:53:02 juju-e4d256-prod-github-runner-207 kernel: [26956.574678] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:53:02 juju-e4d256-prod-github-runner-207 kernel: [26956.575705] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:53:02 juju-e4d256-prod-github-runner-207 kernel: [26956.576793] ? show_regs.part.0+0x23/0x29 Aug 22 12:53:02 juju-e4d256-prod-github-runner-207 kernel: [26956.577788] ? show_regs.cold+0x8/0xd Aug 22 12:53:02 juju-e4d256-prod-github-runner-207 kernel: [26956.578815] ? watchdog_timer_fn+0x1be/0x220 Aug 22 12:53:02 juju-e4d256-prod-github-runner-207 kernel: [26956.579837] ? lockup_detector_update_enable+0x60/0x60 Aug 22 12:53:02 juju-e4d256-prod-github-runner-207 kernel: [26956.580918] ? __hrtimer_run_queues+0x107/0x230 Aug 22 12:53:02 juju-e4d256-prod-github-runner-207 kernel: [26956.581954] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 12:53:02 juju-e4d256-prod-github-runner-207 kernel: [26956.582984] ? hrtimer_interrupt+0x101/0x220 Aug 22 12:53:02 juju-e4d256-prod-github-runner-207 kernel: [26956.584009] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 12:53:02 juju-e4d256-prod-github-runner-207 kernel: [26956.585083] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 12:53:02 juju-e4d256-prod-github-runner-207 kernel: [26956.586129] Aug 22 12:53:02 juju-e4d256-prod-github-runner-207 kernel: [26956.586981] Aug 22 12:53:02 juju-e4d256-prod-github-runner-207 kernel: [26956.587818] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 12:53:02 juju-e4d256-prod-github-runner-207 kernel: [26956.588864] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:53:02 juju-e4d256-prod-github-runner-207 kernel: [26956.589904] ? _raw_spin_lock+0x22/0x30 Aug 22 12:53:02 juju-e4d256-prod-github-runner-207 kernel: [26956.590847] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:53:02 juju-e4d256-prod-github-runner-207 kernel: [26956.591872] direct_page_fault+0x206/0x310 [kvm] Aug 22 12:53:02 juju-e4d256-prod-github-runner-207 kernel: [26956.592941] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 12:53:02 juju-e4d256-prod-github-runner-207 kernel: [26956.593962] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 12:53:02 juju-e4d256-prod-github-runner-207 kernel: [26956.594968] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 12:53:02 juju-e4d256-prod-github-runner-207 kernel: [26956.595987] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 12:53:02 juju-e4d256-prod-github-runner-207 kernel: [26956.596941] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 12:53:02 juju-e4d256-prod-github-runner-207 kernel: [26956.597926] handle_exit+0x98/0x230 [kvm_amd] Aug 22 12:53:02 juju-e4d256-prod-github-runner-207 kernel: [26956.598819] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 12:53:02 juju-e4d256-prod-github-runner-207 kernel: [26956.599733] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 12:53:02 juju-e4d256-prod-github-runner-207 kernel: [26956.600671] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 12:53:02 juju-e4d256-prod-github-runner-207 kernel: [26956.601580] vcpu_run+0x62/0x2c0 [kvm] Aug 22 12:53:02 juju-e4d256-prod-github-runner-207 kernel: [26956.602391] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 12:53:02 juju-e4d256-prod-github-runner-207 kernel: [26956.603206] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 12:53:02 juju-e4d256-prod-github-runner-207 kernel: [26956.604081] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 12:53:02 juju-e4d256-prod-github-runner-207 kernel: [26956.604881] ? __seccomp_filter+0x4a/0x4a0 Aug 22 12:53:02 juju-e4d256-prod-github-runner-207 kernel: [26956.605638] ? __fget_files+0x86/0xc0 Aug 22 12:53:02 juju-e4d256-prod-github-runner-207 kernel: [26956.606347] __x64_sys_ioctl+0x95/0xd0 Aug 22 12:53:02 juju-e4d256-prod-github-runner-207 kernel: [26956.607056] do_syscall_64+0x5c/0xc0 Aug 22 12:53:02 juju-e4d256-prod-github-runner-207 kernel: [26956.607725] ? do_futex+0x162/0x1f0 Aug 22 12:53:02 juju-e4d256-prod-github-runner-207 kernel: [26956.608385] ? __x64_sys_futex+0x78/0x1e0 Aug 22 12:53:02 juju-e4d256-prod-github-runner-207 kernel: [26956.609067] ? __secure_computing+0xa9/0x120 Aug 22 12:53:02 juju-e4d256-prod-github-runner-207 kernel: [26956.609763] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 12:53:02 juju-e4d256-prod-github-runner-207 kernel: [26956.610536] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:53:02 juju-e4d256-prod-github-runner-207 kernel: [26956.611279] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:53:02 juju-e4d256-prod-github-runner-207 kernel: [26956.612018] ? do_syscall_64+0x69/0xc0 Aug 22 12:53:02 juju-e4d256-prod-github-runner-207 kernel: [26956.612665] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:53:02 juju-e4d256-prod-github-runner-207 kernel: [26956.613368] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:53:02 juju-e4d256-prod-github-runner-207 kernel: [26956.614062] ? do_syscall_64+0x69/0xc0 Aug 22 12:53:02 juju-e4d256-prod-github-runner-207 kernel: [26956.614694] ? do_syscall_64+0x69/0xc0 Aug 22 12:53:02 juju-e4d256-prod-github-runner-207 kernel: [26956.615324] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 12:53:02 juju-e4d256-prod-github-runner-207 kernel: [26956.616058] RIP: 0033:0x7faa5d0edaff Aug 22 12:53:02 juju-e4d256-prod-github-runner-207 kernel: [26956.616703] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 12:53:02 juju-e4d256-prod-github-runner-207 kernel: [26956.618680] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 12:53:02 juju-e4d256-prod-github-runner-207 kernel: [26956.619603] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 12:53:02 juju-e4d256-prod-github-runner-207 kernel: [26956.620511] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 12:53:02 juju-e4d256-prod-github-runner-207 kernel: [26956.621402] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 12:53:02 juju-e4d256-prod-github-runner-207 kernel: [26956.622289] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 12:53:02 juju-e4d256-prod-github-runner-207 kernel: [26956.623180] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 12:53:02 juju-e4d256-prod-github-runner-207 kernel: [26956.624239] Aug 22 12:53:30 juju-e4d256-prod-github-runner-207 kernel: [26984.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 25023s! [qemu-system-x86:6715] Aug 22 12:53:30 juju-e4d256-prod-github-runner-207 kernel: [26984.543223] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 12:53:30 juju-e4d256-prod-github-runner-207 kernel: [26984.543300] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 12:53:30 juju-e4d256-prod-github-runner-207 kernel: [26984.555324] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 12:53:30 juju-e4d256-prod-github-runner-207 kernel: [26984.556595] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 12:53:30 juju-e4d256-prod-github-runner-207 kernel: [26984.557814] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:53:30 juju-e4d256-prod-github-runner-207 kernel: [26984.558871] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 12:53:30 juju-e4d256-prod-github-runner-207 kernel: [26984.561441] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 12:53:30 juju-e4d256-prod-github-runner-207 kernel: [26984.562485] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 12:53:30 juju-e4d256-prod-github-runner-207 kernel: [26984.563669] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 12:53:30 juju-e4d256-prod-github-runner-207 kernel: [26984.564840] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 12:53:30 juju-e4d256-prod-github-runner-207 kernel: [26984.566005] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 12:53:30 juju-e4d256-prod-github-runner-207 kernel: [26984.567172] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 12:53:30 juju-e4d256-prod-github-runner-207 kernel: [26984.568353] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 12:53:30 juju-e4d256-prod-github-runner-207 kernel: [26984.569585] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 12:53:30 juju-e4d256-prod-github-runner-207 kernel: [26984.570684] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 12:53:30 juju-e4d256-prod-github-runner-207 kernel: [26984.571889] Call Trace: Aug 22 12:53:30 juju-e4d256-prod-github-runner-207 kernel: [26984.572807] Aug 22 12:53:30 juju-e4d256-prod-github-runner-207 kernel: [26984.573691] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:53:30 juju-e4d256-prod-github-runner-207 kernel: [26984.574724] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:53:30 juju-e4d256-prod-github-runner-207 kernel: [26984.575756] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:53:30 juju-e4d256-prod-github-runner-207 kernel: [26984.576847] ? show_regs.part.0+0x23/0x29 Aug 22 12:53:30 juju-e4d256-prod-github-runner-207 kernel: [26984.577840] ? show_regs.cold+0x8/0xd Aug 22 12:53:30 juju-e4d256-prod-github-runner-207 kernel: [26984.578816] ? watchdog_timer_fn+0x1be/0x220 Aug 22 12:53:30 juju-e4d256-prod-github-runner-207 kernel: [26984.579827] ? lockup_detector_update_enable+0x60/0x60 Aug 22 12:53:30 juju-e4d256-prod-github-runner-207 kernel: [26984.580888] ? __hrtimer_run_queues+0x107/0x230 Aug 22 12:53:30 juju-e4d256-prod-github-runner-207 kernel: [26984.581919] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 12:53:30 juju-e4d256-prod-github-runner-207 kernel: [26984.582940] ? hrtimer_interrupt+0x101/0x220 Aug 22 12:53:30 juju-e4d256-prod-github-runner-207 kernel: [26984.583965] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 12:53:30 juju-e4d256-prod-github-runner-207 kernel: [26984.585031] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 12:53:30 juju-e4d256-prod-github-runner-207 kernel: [26984.586076] Aug 22 12:53:30 juju-e4d256-prod-github-runner-207 kernel: [26984.586927] Aug 22 12:53:30 juju-e4d256-prod-github-runner-207 kernel: [26984.587770] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 12:53:30 juju-e4d256-prod-github-runner-207 kernel: [26984.588809] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:53:30 juju-e4d256-prod-github-runner-207 kernel: [26984.589844] ? _raw_spin_lock+0x22/0x30 Aug 22 12:53:30 juju-e4d256-prod-github-runner-207 kernel: [26984.590794] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:53:30 juju-e4d256-prod-github-runner-207 kernel: [26984.591828] direct_page_fault+0x206/0x310 [kvm] Aug 22 12:53:30 juju-e4d256-prod-github-runner-207 kernel: [26984.592856] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 12:53:30 juju-e4d256-prod-github-runner-207 kernel: [26984.593864] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 12:53:30 juju-e4d256-prod-github-runner-207 kernel: [26984.594870] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 12:53:30 juju-e4d256-prod-github-runner-207 kernel: [26984.595856] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 12:53:30 juju-e4d256-prod-github-runner-207 kernel: [26984.596802] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 12:53:30 juju-e4d256-prod-github-runner-207 kernel: [26984.597778] handle_exit+0x98/0x230 [kvm_amd] Aug 22 12:53:30 juju-e4d256-prod-github-runner-207 kernel: [26984.598669] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 12:53:30 juju-e4d256-prod-github-runner-207 kernel: [26984.599590] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 12:53:30 juju-e4d256-prod-github-runner-207 kernel: [26984.600534] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 12:53:30 juju-e4d256-prod-github-runner-207 kernel: [26984.601436] vcpu_run+0x62/0x2c0 [kvm] Aug 22 12:53:30 juju-e4d256-prod-github-runner-207 kernel: [26984.602246] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 12:53:30 juju-e4d256-prod-github-runner-207 kernel: [26984.603054] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 12:53:30 juju-e4d256-prod-github-runner-207 kernel: [26984.604018] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 12:53:30 juju-e4d256-prod-github-runner-207 kernel: [26984.604964] ? __seccomp_filter+0x4a/0x4a0 Aug 22 12:53:30 juju-e4d256-prod-github-runner-207 kernel: [26984.605782] ? __fget_files+0x86/0xc0 Aug 22 12:53:30 juju-e4d256-prod-github-runner-207 kernel: [26984.606491] __x64_sys_ioctl+0x95/0xd0 Aug 22 12:53:30 juju-e4d256-prod-github-runner-207 kernel: [26984.607185] do_syscall_64+0x5c/0xc0 Aug 22 12:53:30 juju-e4d256-prod-github-runner-207 kernel: [26984.607875] ? do_futex+0x162/0x1f0 Aug 22 12:53:30 juju-e4d256-prod-github-runner-207 kernel: [26984.608535] ? __x64_sys_futex+0x78/0x1e0 Aug 22 12:53:30 juju-e4d256-prod-github-runner-207 kernel: [26984.609213] ? __secure_computing+0xa9/0x120 Aug 22 12:53:30 juju-e4d256-prod-github-runner-207 kernel: [26984.609902] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 12:53:30 juju-e4d256-prod-github-runner-207 kernel: [26984.610666] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:53:30 juju-e4d256-prod-github-runner-207 kernel: [26984.611387] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:53:30 juju-e4d256-prod-github-runner-207 kernel: [26984.612121] ? do_syscall_64+0x69/0xc0 Aug 22 12:53:30 juju-e4d256-prod-github-runner-207 kernel: [26984.612765] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:53:30 juju-e4d256-prod-github-runner-207 kernel: [26984.613472] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:53:30 juju-e4d256-prod-github-runner-207 kernel: [26984.614167] ? do_syscall_64+0x69/0xc0 Aug 22 12:53:30 juju-e4d256-prod-github-runner-207 kernel: [26984.614791] ? do_syscall_64+0x69/0xc0 Aug 22 12:53:30 juju-e4d256-prod-github-runner-207 kernel: [26984.615412] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 12:53:30 juju-e4d256-prod-github-runner-207 kernel: [26984.616136] RIP: 0033:0x7faa5d0edaff Aug 22 12:53:30 juju-e4d256-prod-github-runner-207 kernel: [26984.616759] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 12:53:30 juju-e4d256-prod-github-runner-207 kernel: [26984.618739] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 12:53:30 juju-e4d256-prod-github-runner-207 kernel: [26984.619659] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 12:53:30 juju-e4d256-prod-github-runner-207 kernel: [26984.620548] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 12:53:30 juju-e4d256-prod-github-runner-207 kernel: [26984.621435] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 12:53:30 juju-e4d256-prod-github-runner-207 kernel: [26984.622323] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 12:53:30 juju-e4d256-prod-github-runner-207 kernel: [26984.623209] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 12:53:30 juju-e4d256-prod-github-runner-207 kernel: [26984.624159] Aug 22 12:53:45 juju-e4d256-prod-github-runner-207 kernel: [26998.988705] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 12:53:45 juju-e4d256-prod-github-runner-207 kernel: [26998.989670] rcu: 1-....: (6699503 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=3240233 Aug 22 12:53:45 juju-e4d256-prod-github-runner-207 kernel: [26998.990791] (t=6720447 jiffies g=23269 q=31167) Aug 22 12:53:45 juju-e4d256-prod-github-runner-207 kernel: [26998.991579] NMI backtrace for cpu 1 Aug 22 12:53:45 juju-e4d256-prod-github-runner-207 kernel: [26998.992299] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 12:53:45 juju-e4d256-prod-github-runner-207 kernel: [26998.993406] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 12:53:45 juju-e4d256-prod-github-runner-207 kernel: [26998.994495] Call Trace: Aug 22 12:53:45 juju-e4d256-prod-github-runner-207 kernel: [26998.995181] Aug 22 12:53:45 juju-e4d256-prod-github-runner-207 kernel: [26998.995849] show_stack+0x52/0x5c Aug 22 12:53:45 juju-e4d256-prod-github-runner-207 kernel: [26998.996575] dump_stack_lvl+0x4a/0x63 Aug 22 12:53:45 juju-e4d256-prod-github-runner-207 kernel: [26998.997320] dump_stack+0x10/0x16 Aug 22 12:53:45 juju-e4d256-prod-github-runner-207 kernel: [26998.998041] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 12:53:45 juju-e4d256-prod-github-runner-207 kernel: [26998.998825] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 12:53:45 juju-e4d256-prod-github-runner-207 kernel: [26998.999635] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 12:53:45 juju-e4d256-prod-github-runner-207 kernel: [26999.000466] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 12:53:45 juju-e4d256-prod-github-runner-207 kernel: [26999.001284] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 12:53:45 juju-e4d256-prod-github-runner-207 kernel: [26999.002090] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 12:53:45 juju-e4d256-prod-github-runner-207 kernel: [26999.002877] print_cpu_stall.cold+0x2f/0xe2 Aug 22 12:53:45 juju-e4d256-prod-github-runner-207 kernel: [26999.003690] ? timekeeping_update+0xf7/0x150 Aug 22 12:53:45 juju-e4d256-prod-github-runner-207 kernel: [26999.004465] check_cpu_stall+0x109/0x270 Aug 22 12:53:45 juju-e4d256-prod-github-runner-207 kernel: [26999.005238] rcu_sched_clock_irq+0x9a/0x250 Aug 22 12:53:45 juju-e4d256-prod-github-runner-207 kernel: [26999.006012] update_process_times+0x94/0xd0 Aug 22 12:53:45 juju-e4d256-prod-github-runner-207 kernel: [26999.006776] tick_sched_handle+0x29/0x70 Aug 22 12:53:45 juju-e4d256-prod-github-runner-207 kernel: [26999.007536] tick_sched_timer+0x8c/0xc0 Aug 22 12:53:45 juju-e4d256-prod-github-runner-207 kernel: [26999.008272] ? tick_nohz_handler+0xb0/0xb0 Aug 22 12:53:45 juju-e4d256-prod-github-runner-207 kernel: [26999.009026] __hrtimer_run_queues+0x107/0x230 Aug 22 12:53:45 juju-e4d256-prod-github-runner-207 kernel: [26999.009802] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 12:53:45 juju-e4d256-prod-github-runner-207 kernel: [26999.010575] hrtimer_interrupt+0x101/0x220 Aug 22 12:53:45 juju-e4d256-prod-github-runner-207 kernel: [26999.011333] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 12:53:45 juju-e4d256-prod-github-runner-207 kernel: [26999.012206] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 12:53:45 juju-e4d256-prod-github-runner-207 kernel: [26999.013021] Aug 22 12:53:45 juju-e4d256-prod-github-runner-207 kernel: [26999.013657] Aug 22 12:53:45 juju-e4d256-prod-github-runner-207 kernel: [26999.014286] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 12:53:45 juju-e4d256-prod-github-runner-207 kernel: [26999.015142] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:53:45 juju-e4d256-prod-github-runner-207 kernel: [26999.016056] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 12:53:45 juju-e4d256-prod-github-runner-207 kernel: [26999.018261] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 12:53:45 juju-e4d256-prod-github-runner-207 kernel: [26999.019161] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 12:53:45 juju-e4d256-prod-github-runner-207 kernel: [26999.020317] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 12:53:45 juju-e4d256-prod-github-runner-207 kernel: [26999.021439] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 12:53:45 juju-e4d256-prod-github-runner-207 kernel: [26999.022530] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 12:53:45 juju-e4d256-prod-github-runner-207 kernel: [26999.023624] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 12:53:45 juju-e4d256-prod-github-runner-207 kernel: [26999.024708] ? _raw_spin_lock+0x22/0x30 Aug 22 12:53:45 juju-e4d256-prod-github-runner-207 kernel: [26999.025560] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:53:45 juju-e4d256-prod-github-runner-207 kernel: [26999.026480] direct_page_fault+0x206/0x310 [kvm] Aug 22 12:53:45 juju-e4d256-prod-github-runner-207 kernel: [26999.027505] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 12:53:45 juju-e4d256-prod-github-runner-207 kernel: [26999.028418] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 12:53:45 juju-e4d256-prod-github-runner-207 kernel: [26999.029330] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 12:53:45 juju-e4d256-prod-github-runner-207 kernel: [26999.030223] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 12:53:45 juju-e4d256-prod-github-runner-207 kernel: [26999.031108] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 12:53:45 juju-e4d256-prod-github-runner-207 kernel: [26999.032048] handle_exit+0x98/0x230 [kvm_amd] Aug 22 12:53:45 juju-e4d256-prod-github-runner-207 kernel: [26999.032883] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 12:53:45 juju-e4d256-prod-github-runner-207 kernel: [26999.033754] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 12:53:45 juju-e4d256-prod-github-runner-207 kernel: [26999.034652] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 12:53:45 juju-e4d256-prod-github-runner-207 kernel: [26999.035545] vcpu_run+0x62/0x2c0 [kvm] Aug 22 12:53:45 juju-e4d256-prod-github-runner-207 kernel: [26999.036345] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 12:53:45 juju-e4d256-prod-github-runner-207 kernel: [26999.037158] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 12:53:45 juju-e4d256-prod-github-runner-207 kernel: [26999.038050] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 12:53:45 juju-e4d256-prod-github-runner-207 kernel: [26999.038891] ? __seccomp_filter+0x4a/0x4a0 Aug 22 12:53:45 juju-e4d256-prod-github-runner-207 kernel: [26999.039709] ? __fget_files+0x86/0xc0 Aug 22 12:53:45 juju-e4d256-prod-github-runner-207 kernel: [26999.040472] __x64_sys_ioctl+0x95/0xd0 Aug 22 12:53:45 juju-e4d256-prod-github-runner-207 kernel: [26999.041240] do_syscall_64+0x5c/0xc0 Aug 22 12:53:45 juju-e4d256-prod-github-runner-207 kernel: [26999.041987] ? do_futex+0x162/0x1f0 Aug 22 12:53:45 juju-e4d256-prod-github-runner-207 kernel: [26999.042724] ? __x64_sys_futex+0x78/0x1e0 Aug 22 12:53:45 juju-e4d256-prod-github-runner-207 kernel: [26999.043513] ? __secure_computing+0xa9/0x120 Aug 22 12:53:45 juju-e4d256-prod-github-runner-207 kernel: [26999.044314] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 12:53:45 juju-e4d256-prod-github-runner-207 kernel: [26999.045203] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:53:45 juju-e4d256-prod-github-runner-207 kernel: [26999.046044] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:53:45 juju-e4d256-prod-github-runner-207 kernel: [26999.046884] ? do_syscall_64+0x69/0xc0 Aug 22 12:53:45 juju-e4d256-prod-github-runner-207 kernel: [26999.047658] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:53:45 juju-e4d256-prod-github-runner-207 kernel: [26999.048502] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:53:45 juju-e4d256-prod-github-runner-207 kernel: [26999.049346] ? do_syscall_64+0x69/0xc0 Aug 22 12:53:45 juju-e4d256-prod-github-runner-207 kernel: [26999.050110] ? do_syscall_64+0x69/0xc0 Aug 22 12:53:45 juju-e4d256-prod-github-runner-207 kernel: [26999.050873] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 12:53:45 juju-e4d256-prod-github-runner-207 kernel: [26999.051763] RIP: 0033:0x7faa5d0edaff Aug 22 12:53:45 juju-e4d256-prod-github-runner-207 kernel: [26999.052521] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 12:53:45 juju-e4d256-prod-github-runner-207 kernel: [26999.054942] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 12:53:45 juju-e4d256-prod-github-runner-207 kernel: [26999.056064] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 12:53:45 juju-e4d256-prod-github-runner-207 kernel: [26999.057139] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 12:53:45 juju-e4d256-prod-github-runner-207 kernel: [26999.058209] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 12:53:45 juju-e4d256-prod-github-runner-207 kernel: [26999.059278] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 12:53:45 juju-e4d256-prod-github-runner-207 kernel: [26999.060348] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 12:53:45 juju-e4d256-prod-github-runner-207 kernel: [26999.061389] Aug 22 12:54:10 juju-e4d256-prod-github-runner-207 kernel: [27024.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 25060s! [qemu-system-x86:6715] Aug 22 12:54:10 juju-e4d256-prod-github-runner-207 kernel: [27024.543865] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 12:54:10 juju-e4d256-prod-github-runner-207 kernel: [27024.544140] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 12:54:10 juju-e4d256-prod-github-runner-207 kernel: [27024.556581] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 12:54:10 juju-e4d256-prod-github-runner-207 kernel: [27024.557877] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 12:54:10 juju-e4d256-prod-github-runner-207 kernel: [27024.559152] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:54:10 juju-e4d256-prod-github-runner-207 kernel: [27024.560235] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 12:54:10 juju-e4d256-prod-github-runner-207 kernel: [27024.562816] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 12:54:10 juju-e4d256-prod-github-runner-207 kernel: [27024.563888] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 12:54:10 juju-e4d256-prod-github-runner-207 kernel: [27024.565050] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 12:54:10 juju-e4d256-prod-github-runner-207 kernel: [27024.566220] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 12:54:10 juju-e4d256-prod-github-runner-207 kernel: [27024.567416] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 12:54:10 juju-e4d256-prod-github-runner-207 kernel: [27024.568591] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 12:54:10 juju-e4d256-prod-github-runner-207 kernel: [27024.569762] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 12:54:10 juju-e4d256-prod-github-runner-207 kernel: [27024.570999] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 12:54:10 juju-e4d256-prod-github-runner-207 kernel: [27024.572140] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 12:54:10 juju-e4d256-prod-github-runner-207 kernel: [27024.573357] Call Trace: Aug 22 12:54:10 juju-e4d256-prod-github-runner-207 kernel: [27024.574269] Aug 22 12:54:10 juju-e4d256-prod-github-runner-207 kernel: [27024.575192] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:54:10 juju-e4d256-prod-github-runner-207 kernel: [27024.576234] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:54:10 juju-e4d256-prod-github-runner-207 kernel: [27024.577284] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:54:10 juju-e4d256-prod-github-runner-207 kernel: [27024.578405] ? show_regs.part.0+0x23/0x29 Aug 22 12:54:10 juju-e4d256-prod-github-runner-207 kernel: [27024.579434] ? show_regs.cold+0x8/0xd Aug 22 12:54:10 juju-e4d256-prod-github-runner-207 kernel: [27024.580411] ? watchdog_timer_fn+0x1be/0x220 Aug 22 12:54:10 juju-e4d256-prod-github-runner-207 kernel: [27024.581477] ? lockup_detector_update_enable+0x60/0x60 Aug 22 12:54:10 juju-e4d256-prod-github-runner-207 kernel: [27024.582588] ? __hrtimer_run_queues+0x107/0x230 Aug 22 12:54:10 juju-e4d256-prod-github-runner-207 kernel: [27024.583657] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 12:54:10 juju-e4d256-prod-github-runner-207 kernel: [27024.584872] ? hrtimer_interrupt+0x101/0x220 Aug 22 12:54:10 juju-e4d256-prod-github-runner-207 kernel: [27024.585908] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 12:54:10 juju-e4d256-prod-github-runner-207 kernel: [27024.587016] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 12:54:10 juju-e4d256-prod-github-runner-207 kernel: [27024.588113] Aug 22 12:54:10 juju-e4d256-prod-github-runner-207 kernel: [27024.588985] Aug 22 12:54:10 juju-e4d256-prod-github-runner-207 kernel: [27024.589838] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 12:54:10 juju-e4d256-prod-github-runner-207 kernel: [27024.590893] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:54:10 juju-e4d256-prod-github-runner-207 kernel: [27024.591985] ? _raw_spin_lock+0x22/0x30 Aug 22 12:54:10 juju-e4d256-prod-github-runner-207 kernel: [27024.592960] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:54:10 juju-e4d256-prod-github-runner-207 kernel: [27024.594026] direct_page_fault+0x206/0x310 [kvm] Aug 22 12:54:10 juju-e4d256-prod-github-runner-207 kernel: [27024.595136] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 12:54:10 juju-e4d256-prod-github-runner-207 kernel: [27024.596181] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 12:54:10 juju-e4d256-prod-github-runner-207 kernel: [27024.597228] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 12:54:10 juju-e4d256-prod-github-runner-207 kernel: [27024.598281] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 12:54:10 juju-e4d256-prod-github-runner-207 kernel: [27024.599263] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 12:54:10 juju-e4d256-prod-github-runner-207 kernel: [27024.600251] handle_exit+0x98/0x230 [kvm_amd] Aug 22 12:54:10 juju-e4d256-prod-github-runner-207 kernel: [27024.601192] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 12:54:10 juju-e4d256-prod-github-runner-207 kernel: [27024.602176] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 12:54:10 juju-e4d256-prod-github-runner-207 kernel: [27024.603171] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 12:54:10 juju-e4d256-prod-github-runner-207 kernel: [27024.604086] vcpu_run+0x62/0x2c0 [kvm] Aug 22 12:54:10 juju-e4d256-prod-github-runner-207 kernel: [27024.604912] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 12:54:10 juju-e4d256-prod-github-runner-207 kernel: [27024.605747] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 12:54:10 juju-e4d256-prod-github-runner-207 kernel: [27024.606756] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 12:54:10 juju-e4d256-prod-github-runner-207 kernel: [27024.607592] ? __seccomp_filter+0x4a/0x4a0 Aug 22 12:54:10 juju-e4d256-prod-github-runner-207 kernel: [27024.608340] ? __fget_files+0x86/0xc0 Aug 22 12:54:10 juju-e4d256-prod-github-runner-207 kernel: [27024.609049] __x64_sys_ioctl+0x95/0xd0 Aug 22 12:54:10 juju-e4d256-prod-github-runner-207 kernel: [27024.609747] do_syscall_64+0x5c/0xc0 Aug 22 12:54:10 juju-e4d256-prod-github-runner-207 kernel: [27024.610417] ? do_futex+0x162/0x1f0 Aug 22 12:54:10 juju-e4d256-prod-github-runner-207 kernel: [27024.611084] ? __x64_sys_futex+0x78/0x1e0 Aug 22 12:54:10 juju-e4d256-prod-github-runner-207 kernel: [27024.611802] ? __secure_computing+0xa9/0x120 Aug 22 12:54:10 juju-e4d256-prod-github-runner-207 kernel: [27024.612514] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 12:54:10 juju-e4d256-prod-github-runner-207 kernel: [27024.613317] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:54:10 juju-e4d256-prod-github-runner-207 kernel: [27024.614060] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:54:10 juju-e4d256-prod-github-runner-207 kernel: [27024.614791] ? do_syscall_64+0x69/0xc0 Aug 22 12:54:10 juju-e4d256-prod-github-runner-207 kernel: [27024.615510] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:54:10 juju-e4d256-prod-github-runner-207 kernel: [27024.616260] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:54:10 juju-e4d256-prod-github-runner-207 kernel: [27024.616969] ? do_syscall_64+0x69/0xc0 Aug 22 12:54:10 juju-e4d256-prod-github-runner-207 kernel: [27024.617652] ? do_syscall_64+0x69/0xc0 Aug 22 12:54:10 juju-e4d256-prod-github-runner-207 kernel: [27024.618299] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 12:54:10 juju-e4d256-prod-github-runner-207 kernel: [27024.619029] RIP: 0033:0x7faa5d0edaff Aug 22 12:54:10 juju-e4d256-prod-github-runner-207 kernel: [27024.619721] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 12:54:10 juju-e4d256-prod-github-runner-207 kernel: [27024.621728] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 12:54:10 juju-e4d256-prod-github-runner-207 kernel: [27024.622716] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 12:54:10 juju-e4d256-prod-github-runner-207 kernel: [27024.623762] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 12:54:10 juju-e4d256-prod-github-runner-207 kernel: [27024.624653] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 12:54:10 juju-e4d256-prod-github-runner-207 kernel: [27024.625544] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 12:54:10 juju-e4d256-prod-github-runner-207 kernel: [27024.626450] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 12:54:10 juju-e4d256-prod-github-runner-207 kernel: [27024.627392] Aug 22 12:54:38 juju-e4d256-prod-github-runner-207 kernel: [27052.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 25086s! [qemu-system-x86:6715] Aug 22 12:54:38 juju-e4d256-prod-github-runner-207 kernel: [27052.543288] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 12:54:38 juju-e4d256-prod-github-runner-207 kernel: [27052.543364] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 12:54:38 juju-e4d256-prod-github-runner-207 kernel: [27052.557234] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 12:54:38 juju-e4d256-prod-github-runner-207 kernel: [27052.558677] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 12:54:38 juju-e4d256-prod-github-runner-207 kernel: [27052.560071] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:54:38 juju-e4d256-prod-github-runner-207 kernel: [27052.561245] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 12:54:38 juju-e4d256-prod-github-runner-207 kernel: [27052.564165] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 12:54:38 juju-e4d256-prod-github-runner-207 kernel: [27052.565329] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 12:54:38 juju-e4d256-prod-github-runner-207 kernel: [27052.566627] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 12:54:38 juju-e4d256-prod-github-runner-207 kernel: [27052.567927] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 12:54:38 juju-e4d256-prod-github-runner-207 kernel: [27052.569221] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 12:54:38 juju-e4d256-prod-github-runner-207 kernel: [27052.570512] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 12:54:38 juju-e4d256-prod-github-runner-207 kernel: [27052.571822] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 12:54:38 juju-e4d256-prod-github-runner-207 kernel: [27052.573218] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 12:54:38 juju-e4d256-prod-github-runner-207 kernel: [27052.574430] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 12:54:38 juju-e4d256-prod-github-runner-207 kernel: [27052.575800] Call Trace: Aug 22 12:54:38 juju-e4d256-prod-github-runner-207 kernel: [27052.576766] Aug 22 12:54:38 juju-e4d256-prod-github-runner-207 kernel: [27052.577691] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:54:38 juju-e4d256-prod-github-runner-207 kernel: [27052.578830] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:54:38 juju-e4d256-prod-github-runner-207 kernel: [27052.579938] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:54:38 juju-e4d256-prod-github-runner-207 kernel: [27052.581109] ? show_regs.part.0+0x23/0x29 Aug 22 12:54:38 juju-e4d256-prod-github-runner-207 kernel: [27052.582190] ? show_regs.cold+0x8/0xd Aug 22 12:54:38 juju-e4d256-prod-github-runner-207 kernel: [27052.583259] ? watchdog_timer_fn+0x1be/0x220 Aug 22 12:54:38 juju-e4d256-prod-github-runner-207 kernel: [27052.584387] ? lockup_detector_update_enable+0x60/0x60 Aug 22 12:54:38 juju-e4d256-prod-github-runner-207 kernel: [27052.585563] ? __hrtimer_run_queues+0x107/0x230 Aug 22 12:54:38 juju-e4d256-prod-github-runner-207 kernel: [27052.586682] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 12:54:38 juju-e4d256-prod-github-runner-207 kernel: [27052.587811] ? hrtimer_interrupt+0x101/0x220 Aug 22 12:54:38 juju-e4d256-prod-github-runner-207 kernel: [27052.588919] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 12:54:38 juju-e4d256-prod-github-runner-207 kernel: [27052.590087] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 12:54:38 juju-e4d256-prod-github-runner-207 kernel: [27052.591252] Aug 22 12:54:38 juju-e4d256-prod-github-runner-207 kernel: [27052.592167] Aug 22 12:54:38 juju-e4d256-prod-github-runner-207 kernel: [27052.593107] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 12:54:38 juju-e4d256-prod-github-runner-207 kernel: [27052.594266] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:54:38 juju-e4d256-prod-github-runner-207 kernel: [27052.595429] ? _raw_spin_lock+0x22/0x30 Aug 22 12:54:38 juju-e4d256-prod-github-runner-207 kernel: [27052.596453] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:54:38 juju-e4d256-prod-github-runner-207 kernel: [27052.597651] direct_page_fault+0x206/0x310 [kvm] Aug 22 12:54:38 juju-e4d256-prod-github-runner-207 kernel: [27052.598825] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 12:54:38 juju-e4d256-prod-github-runner-207 kernel: [27052.599926] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 12:54:38 juju-e4d256-prod-github-runner-207 kernel: [27052.601025] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 12:54:38 juju-e4d256-prod-github-runner-207 kernel: [27052.602089] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 12:54:38 juju-e4d256-prod-github-runner-207 kernel: [27052.603283] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 12:54:38 juju-e4d256-prod-github-runner-207 kernel: [27052.604487] handle_exit+0x98/0x230 [kvm_amd] Aug 22 12:54:38 juju-e4d256-prod-github-runner-207 kernel: [27052.605469] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 12:54:38 juju-e4d256-prod-github-runner-207 kernel: [27052.606481] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 12:54:38 juju-e4d256-prod-github-runner-207 kernel: [27052.607531] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 12:54:38 juju-e4d256-prod-github-runner-207 kernel: [27052.608542] vcpu_run+0x62/0x2c0 [kvm] Aug 22 12:54:38 juju-e4d256-prod-github-runner-207 kernel: [27052.609431] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 12:54:38 juju-e4d256-prod-github-runner-207 kernel: [27052.610342] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 12:54:38 juju-e4d256-prod-github-runner-207 kernel: [27052.611322] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 12:54:38 juju-e4d256-prod-github-runner-207 kernel: [27052.612205] ? __seccomp_filter+0x4a/0x4a0 Aug 22 12:54:38 juju-e4d256-prod-github-runner-207 kernel: [27052.613041] ? __fget_files+0x86/0xc0 Aug 22 12:54:38 juju-e4d256-prod-github-runner-207 kernel: [27052.613820] __x64_sys_ioctl+0x95/0xd0 Aug 22 12:54:38 juju-e4d256-prod-github-runner-207 kernel: [27052.614591] do_syscall_64+0x5c/0xc0 Aug 22 12:54:38 juju-e4d256-prod-github-runner-207 kernel: [27052.615340] ? do_futex+0x162/0x1f0 Aug 22 12:54:38 juju-e4d256-prod-github-runner-207 kernel: [27052.616059] ? __x64_sys_futex+0x78/0x1e0 Aug 22 12:54:38 juju-e4d256-prod-github-runner-207 kernel: [27052.616829] ? __secure_computing+0xa9/0x120 Aug 22 12:54:38 juju-e4d256-prod-github-runner-207 kernel: [27052.617612] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 12:54:38 juju-e4d256-prod-github-runner-207 kernel: [27052.618472] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:54:38 juju-e4d256-prod-github-runner-207 kernel: [27052.619293] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:54:38 juju-e4d256-prod-github-runner-207 kernel: [27052.620101] ? do_syscall_64+0x69/0xc0 Aug 22 12:54:38 juju-e4d256-prod-github-runner-207 kernel: [27052.620820] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:54:38 juju-e4d256-prod-github-runner-207 kernel: [27052.621620] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:54:38 juju-e4d256-prod-github-runner-207 kernel: [27052.622407] ? do_syscall_64+0x69/0xc0 Aug 22 12:54:38 juju-e4d256-prod-github-runner-207 kernel: [27052.623124] ? do_syscall_64+0x69/0xc0 Aug 22 12:54:38 juju-e4d256-prod-github-runner-207 kernel: [27052.623832] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 12:54:38 juju-e4d256-prod-github-runner-207 kernel: [27052.624633] RIP: 0033:0x7faa5d0edaff Aug 22 12:54:38 juju-e4d256-prod-github-runner-207 kernel: [27052.625332] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 12:54:38 juju-e4d256-prod-github-runner-207 kernel: [27052.627688] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 12:54:38 juju-e4d256-prod-github-runner-207 kernel: [27052.628744] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 12:54:38 juju-e4d256-prod-github-runner-207 kernel: [27052.629770] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 12:54:38 juju-e4d256-prod-github-runner-207 kernel: [27052.630815] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 12:54:38 juju-e4d256-prod-github-runner-207 kernel: [27052.631835] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 12:54:38 juju-e4d256-prod-github-runner-207 kernel: [27052.632859] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 12:54:38 juju-e4d256-prod-github-runner-207 kernel: [27052.633884] Aug 22 12:55:06 juju-e4d256-prod-github-runner-207 kernel: [27080.541998] watchdog: BUG: soft lockup - CPU#1 stuck for 25112s! [qemu-system-x86:6715] Aug 22 12:55:06 juju-e4d256-prod-github-runner-207 kernel: [27080.543182] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 12:55:06 juju-e4d256-prod-github-runner-207 kernel: [27080.543262] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 12:55:06 juju-e4d256-prod-github-runner-207 kernel: [27080.555723] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 12:55:06 juju-e4d256-prod-github-runner-207 kernel: [27080.556993] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 12:55:06 juju-e4d256-prod-github-runner-207 kernel: [27080.558248] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:55:06 juju-e4d256-prod-github-runner-207 kernel: [27080.559350] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 12:55:06 juju-e4d256-prod-github-runner-207 kernel: [27080.562208] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 12:55:06 juju-e4d256-prod-github-runner-207 kernel: [27080.563429] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 12:55:06 juju-e4d256-prod-github-runner-207 kernel: [27080.564713] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 12:55:06 juju-e4d256-prod-github-runner-207 kernel: [27080.565893] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 12:55:06 juju-e4d256-prod-github-runner-207 kernel: [27080.567218] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 12:55:06 juju-e4d256-prod-github-runner-207 kernel: [27080.568392] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 12:55:06 juju-e4d256-prod-github-runner-207 kernel: [27080.569585] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 12:55:06 juju-e4d256-prod-github-runner-207 kernel: [27080.570856] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 12:55:06 juju-e4d256-prod-github-runner-207 kernel: [27080.571955] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 12:55:06 juju-e4d256-prod-github-runner-207 kernel: [27080.573171] Call Trace: Aug 22 12:55:06 juju-e4d256-prod-github-runner-207 kernel: [27080.574083] Aug 22 12:55:06 juju-e4d256-prod-github-runner-207 kernel: [27080.575010] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:55:06 juju-e4d256-prod-github-runner-207 kernel: [27080.576056] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:55:06 juju-e4d256-prod-github-runner-207 kernel: [27080.577085] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:55:06 juju-e4d256-prod-github-runner-207 kernel: [27080.578199] ? show_regs.part.0+0x23/0x29 Aug 22 12:55:06 juju-e4d256-prod-github-runner-207 kernel: [27080.579220] ? show_regs.cold+0x8/0xd Aug 22 12:55:06 juju-e4d256-prod-github-runner-207 kernel: [27080.580224] ? watchdog_timer_fn+0x1be/0x220 Aug 22 12:55:06 juju-e4d256-prod-github-runner-207 kernel: [27080.581231] ? lockup_detector_update_enable+0x60/0x60 Aug 22 12:55:06 juju-e4d256-prod-github-runner-207 kernel: [27080.582305] ? __hrtimer_run_queues+0x107/0x230 Aug 22 12:55:06 juju-e4d256-prod-github-runner-207 kernel: [27080.583364] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 12:55:06 juju-e4d256-prod-github-runner-207 kernel: [27080.584419] ? hrtimer_interrupt+0x101/0x220 Aug 22 12:55:06 juju-e4d256-prod-github-runner-207 kernel: [27080.585459] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 12:55:06 juju-e4d256-prod-github-runner-207 kernel: [27080.586547] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 12:55:06 juju-e4d256-prod-github-runner-207 kernel: [27080.587590] Aug 22 12:55:06 juju-e4d256-prod-github-runner-207 kernel: [27080.588474] Aug 22 12:55:06 juju-e4d256-prod-github-runner-207 kernel: [27080.589319] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 12:55:06 juju-e4d256-prod-github-runner-207 kernel: [27080.590354] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:55:06 juju-e4d256-prod-github-runner-207 kernel: [27080.591402] ? _raw_spin_lock+0x22/0x30 Aug 22 12:55:06 juju-e4d256-prod-github-runner-207 kernel: [27080.592353] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:55:06 juju-e4d256-prod-github-runner-207 kernel: [27080.593375] direct_page_fault+0x206/0x310 [kvm] Aug 22 12:55:06 juju-e4d256-prod-github-runner-207 kernel: [27080.594459] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 12:55:06 juju-e4d256-prod-github-runner-207 kernel: [27080.595480] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 12:55:06 juju-e4d256-prod-github-runner-207 kernel: [27080.596478] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 12:55:06 juju-e4d256-prod-github-runner-207 kernel: [27080.597445] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 12:55:06 juju-e4d256-prod-github-runner-207 kernel: [27080.598389] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 12:55:06 juju-e4d256-prod-github-runner-207 kernel: [27080.599379] handle_exit+0x98/0x230 [kvm_amd] Aug 22 12:55:06 juju-e4d256-prod-github-runner-207 kernel: [27080.600273] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 12:55:06 juju-e4d256-prod-github-runner-207 kernel: [27080.601203] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 12:55:06 juju-e4d256-prod-github-runner-207 kernel: [27080.602128] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 12:55:06 juju-e4d256-prod-github-runner-207 kernel: [27080.603051] vcpu_run+0x62/0x2c0 [kvm] Aug 22 12:55:06 juju-e4d256-prod-github-runner-207 kernel: [27080.603865] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 12:55:06 juju-e4d256-prod-github-runner-207 kernel: [27080.604670] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 12:55:06 juju-e4d256-prod-github-runner-207 kernel: [27080.605520] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 12:55:06 juju-e4d256-prod-github-runner-207 kernel: [27080.606341] ? __seccomp_filter+0x4a/0x4a0 Aug 22 12:55:06 juju-e4d256-prod-github-runner-207 kernel: [27080.607104] ? __fget_files+0x86/0xc0 Aug 22 12:55:06 juju-e4d256-prod-github-runner-207 kernel: [27080.607812] __x64_sys_ioctl+0x95/0xd0 Aug 22 12:55:06 juju-e4d256-prod-github-runner-207 kernel: [27080.608503] do_syscall_64+0x5c/0xc0 Aug 22 12:55:06 juju-e4d256-prod-github-runner-207 kernel: [27080.609166] ? do_futex+0x162/0x1f0 Aug 22 12:55:06 juju-e4d256-prod-github-runner-207 kernel: [27080.609811] ? __x64_sys_futex+0x78/0x1e0 Aug 22 12:55:06 juju-e4d256-prod-github-runner-207 kernel: [27080.610491] ? __secure_computing+0xa9/0x120 Aug 22 12:55:06 juju-e4d256-prod-github-runner-207 kernel: [27080.611177] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 12:55:06 juju-e4d256-prod-github-runner-207 kernel: [27080.611934] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:55:06 juju-e4d256-prod-github-runner-207 kernel: [27080.612652] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:55:06 juju-e4d256-prod-github-runner-207 kernel: [27080.613367] ? do_syscall_64+0x69/0xc0 Aug 22 12:55:06 juju-e4d256-prod-github-runner-207 kernel: [27080.614041] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:55:06 juju-e4d256-prod-github-runner-207 kernel: [27080.614767] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:55:06 juju-e4d256-prod-github-runner-207 kernel: [27080.615467] ? do_syscall_64+0x69/0xc0 Aug 22 12:55:06 juju-e4d256-prod-github-runner-207 kernel: [27080.616089] ? do_syscall_64+0x69/0xc0 Aug 22 12:55:06 juju-e4d256-prod-github-runner-207 kernel: [27080.616716] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 12:55:06 juju-e4d256-prod-github-runner-207 kernel: [27080.617431] RIP: 0033:0x7faa5d0edaff Aug 22 12:55:06 juju-e4d256-prod-github-runner-207 kernel: [27080.618070] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 12:55:06 juju-e4d256-prod-github-runner-207 kernel: [27080.620132] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 12:55:06 juju-e4d256-prod-github-runner-207 kernel: [27080.621042] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 12:55:06 juju-e4d256-prod-github-runner-207 kernel: [27080.621930] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 12:55:06 juju-e4d256-prod-github-runner-207 kernel: [27080.622822] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 12:55:06 juju-e4d256-prod-github-runner-207 kernel: [27080.623709] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 12:55:06 juju-e4d256-prod-github-runner-207 kernel: [27080.624617] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 12:55:06 juju-e4d256-prod-github-runner-207 kernel: [27080.625510] Aug 22 12:55:34 juju-e4d256-prod-github-runner-207 kernel: [27108.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 25138s! [qemu-system-x86:6715] Aug 22 12:55:34 juju-e4d256-prod-github-runner-207 kernel: [27108.543810] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 12:55:34 juju-e4d256-prod-github-runner-207 kernel: [27108.544103] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 12:55:34 juju-e4d256-prod-github-runner-207 kernel: [27108.556414] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 12:55:34 juju-e4d256-prod-github-runner-207 kernel: [27108.557692] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 12:55:34 juju-e4d256-prod-github-runner-207 kernel: [27108.558937] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:55:34 juju-e4d256-prod-github-runner-207 kernel: [27108.560001] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 12:55:34 juju-e4d256-prod-github-runner-207 kernel: [27108.562607] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 12:55:34 juju-e4d256-prod-github-runner-207 kernel: [27108.563676] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 12:55:34 juju-e4d256-prod-github-runner-207 kernel: [27108.564842] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 12:55:34 juju-e4d256-prod-github-runner-207 kernel: [27108.566008] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 12:55:34 juju-e4d256-prod-github-runner-207 kernel: [27108.567210] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 12:55:34 juju-e4d256-prod-github-runner-207 kernel: [27108.568375] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 12:55:34 juju-e4d256-prod-github-runner-207 kernel: [27108.569546] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 12:55:34 juju-e4d256-prod-github-runner-207 kernel: [27108.570794] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 12:55:34 juju-e4d256-prod-github-runner-207 kernel: [27108.571896] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 12:55:34 juju-e4d256-prod-github-runner-207 kernel: [27108.573100] Call Trace: Aug 22 12:55:34 juju-e4d256-prod-github-runner-207 kernel: [27108.574012] Aug 22 12:55:34 juju-e4d256-prod-github-runner-207 kernel: [27108.574916] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:55:34 juju-e4d256-prod-github-runner-207 kernel: [27108.575975] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:55:34 juju-e4d256-prod-github-runner-207 kernel: [27108.577012] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:55:34 juju-e4d256-prod-github-runner-207 kernel: [27108.578132] ? show_regs.part.0+0x23/0x29 Aug 22 12:55:34 juju-e4d256-prod-github-runner-207 kernel: [27108.579153] ? show_regs.cold+0x8/0xd Aug 22 12:55:34 juju-e4d256-prod-github-runner-207 kernel: [27108.580121] ? watchdog_timer_fn+0x1be/0x220 Aug 22 12:55:34 juju-e4d256-prod-github-runner-207 kernel: [27108.581126] ? lockup_detector_update_enable+0x60/0x60 Aug 22 12:55:34 juju-e4d256-prod-github-runner-207 kernel: [27108.582203] ? __hrtimer_run_queues+0x107/0x230 Aug 22 12:55:34 juju-e4d256-prod-github-runner-207 kernel: [27108.583229] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 12:55:34 juju-e4d256-prod-github-runner-207 kernel: [27108.584256] ? hrtimer_interrupt+0x101/0x220 Aug 22 12:55:34 juju-e4d256-prod-github-runner-207 kernel: [27108.585272] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 12:55:34 juju-e4d256-prod-github-runner-207 kernel: [27108.586357] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 12:55:34 juju-e4d256-prod-github-runner-207 kernel: [27108.587407] Aug 22 12:55:34 juju-e4d256-prod-github-runner-207 kernel: [27108.588298] Aug 22 12:55:34 juju-e4d256-prod-github-runner-207 kernel: [27108.589134] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 12:55:34 juju-e4d256-prod-github-runner-207 kernel: [27108.590181] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:55:34 juju-e4d256-prod-github-runner-207 kernel: [27108.591219] ? _raw_spin_lock+0x22/0x30 Aug 22 12:55:34 juju-e4d256-prod-github-runner-207 kernel: [27108.592169] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:55:34 juju-e4d256-prod-github-runner-207 kernel: [27108.593216] direct_page_fault+0x206/0x310 [kvm] Aug 22 12:55:34 juju-e4d256-prod-github-runner-207 kernel: [27108.594271] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 12:55:34 juju-e4d256-prod-github-runner-207 kernel: [27108.595301] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 12:55:34 juju-e4d256-prod-github-runner-207 kernel: [27108.596306] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 12:55:34 juju-e4d256-prod-github-runner-207 kernel: [27108.597307] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 12:55:34 juju-e4d256-prod-github-runner-207 kernel: [27108.598261] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 12:55:34 juju-e4d256-prod-github-runner-207 kernel: [27108.599236] handle_exit+0x98/0x230 [kvm_amd] Aug 22 12:55:34 juju-e4d256-prod-github-runner-207 kernel: [27108.600126] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 12:55:34 juju-e4d256-prod-github-runner-207 kernel: [27108.601040] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 12:55:34 juju-e4d256-prod-github-runner-207 kernel: [27108.601961] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 12:55:34 juju-e4d256-prod-github-runner-207 kernel: [27108.602877] vcpu_run+0x62/0x2c0 [kvm] Aug 22 12:55:34 juju-e4d256-prod-github-runner-207 kernel: [27108.603686] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 12:55:34 juju-e4d256-prod-github-runner-207 kernel: [27108.604502] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 12:55:34 juju-e4d256-prod-github-runner-207 kernel: [27108.605361] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 12:55:34 juju-e4d256-prod-github-runner-207 kernel: [27108.606181] ? __seccomp_filter+0x4a/0x4a0 Aug 22 12:55:34 juju-e4d256-prod-github-runner-207 kernel: [27108.606923] ? __fget_files+0x86/0xc0 Aug 22 12:55:34 juju-e4d256-prod-github-runner-207 kernel: [27108.607624] __x64_sys_ioctl+0x95/0xd0 Aug 22 12:55:34 juju-e4d256-prod-github-runner-207 kernel: [27108.608316] do_syscall_64+0x5c/0xc0 Aug 22 12:55:34 juju-e4d256-prod-github-runner-207 kernel: [27108.609015] ? do_futex+0x162/0x1f0 Aug 22 12:55:34 juju-e4d256-prod-github-runner-207 kernel: [27108.609674] ? __x64_sys_futex+0x78/0x1e0 Aug 22 12:55:34 juju-e4d256-prod-github-runner-207 kernel: [27108.610370] ? __secure_computing+0xa9/0x120 Aug 22 12:55:34 juju-e4d256-prod-github-runner-207 kernel: [27108.611065] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 12:55:34 juju-e4d256-prod-github-runner-207 kernel: [27108.611828] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:55:34 juju-e4d256-prod-github-runner-207 kernel: [27108.612555] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:55:34 juju-e4d256-prod-github-runner-207 kernel: [27108.613272] ? do_syscall_64+0x69/0xc0 Aug 22 12:55:34 juju-e4d256-prod-github-runner-207 kernel: [27108.613917] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:55:34 juju-e4d256-prod-github-runner-207 kernel: [27108.614640] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:55:34 juju-e4d256-prod-github-runner-207 kernel: [27108.615334] ? do_syscall_64+0x69/0xc0 Aug 22 12:55:34 juju-e4d256-prod-github-runner-207 kernel: [27108.615960] ? do_syscall_64+0x69/0xc0 Aug 22 12:55:34 juju-e4d256-prod-github-runner-207 kernel: [27108.616579] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 12:55:34 juju-e4d256-prod-github-runner-207 kernel: [27108.617330] RIP: 0033:0x7faa5d0edaff Aug 22 12:55:34 juju-e4d256-prod-github-runner-207 kernel: [27108.618150] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 12:55:34 juju-e4d256-prod-github-runner-207 kernel: [27108.620225] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 12:55:34 juju-e4d256-prod-github-runner-207 kernel: [27108.621135] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 12:55:34 juju-e4d256-prod-github-runner-207 kernel: [27108.622025] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 12:55:34 juju-e4d256-prod-github-runner-207 kernel: [27108.622937] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 12:55:34 juju-e4d256-prod-github-runner-207 kernel: [27108.623831] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 12:55:34 juju-e4d256-prod-github-runner-207 kernel: [27108.624715] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 12:55:34 juju-e4d256-prod-github-runner-207 kernel: [27108.625603] Aug 22 12:56:02 juju-e4d256-prod-github-runner-207 kernel: [27136.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 25164s! [qemu-system-x86:6715] Aug 22 12:56:02 juju-e4d256-prod-github-runner-207 kernel: [27136.543107] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 12:56:02 juju-e4d256-prod-github-runner-207 kernel: [27136.543182] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 12:56:02 juju-e4d256-prod-github-runner-207 kernel: [27136.555363] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 12:56:02 juju-e4d256-prod-github-runner-207 kernel: [27136.556657] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 12:56:02 juju-e4d256-prod-github-runner-207 kernel: [27136.557924] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:56:02 juju-e4d256-prod-github-runner-207 kernel: [27136.559002] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 12:56:02 juju-e4d256-prod-github-runner-207 kernel: [27136.561574] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 12:56:02 juju-e4d256-prod-github-runner-207 kernel: [27136.562638] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 12:56:02 juju-e4d256-prod-github-runner-207 kernel: [27136.563809] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 12:56:02 juju-e4d256-prod-github-runner-207 kernel: [27136.564984] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 12:56:02 juju-e4d256-prod-github-runner-207 kernel: [27136.566180] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 12:56:02 juju-e4d256-prod-github-runner-207 kernel: [27136.567357] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 12:56:02 juju-e4d256-prod-github-runner-207 kernel: [27136.568538] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 12:56:02 juju-e4d256-prod-github-runner-207 kernel: [27136.569806] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 12:56:02 juju-e4d256-prod-github-runner-207 kernel: [27136.570905] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 12:56:02 juju-e4d256-prod-github-runner-207 kernel: [27136.572155] Call Trace: Aug 22 12:56:02 juju-e4d256-prod-github-runner-207 kernel: [27136.573103] Aug 22 12:56:02 juju-e4d256-prod-github-runner-207 kernel: [27136.574006] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:56:02 juju-e4d256-prod-github-runner-207 kernel: [27136.575037] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:56:02 juju-e4d256-prod-github-runner-207 kernel: [27136.576055] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:56:02 juju-e4d256-prod-github-runner-207 kernel: [27136.577154] ? show_regs.part.0+0x23/0x29 Aug 22 12:56:02 juju-e4d256-prod-github-runner-207 kernel: [27136.578217] ? show_regs.cold+0x8/0xd Aug 22 12:56:02 juju-e4d256-prod-github-runner-207 kernel: [27136.579191] ? watchdog_timer_fn+0x1be/0x220 Aug 22 12:56:02 juju-e4d256-prod-github-runner-207 kernel: [27136.580198] ? lockup_detector_update_enable+0x60/0x60 Aug 22 12:56:02 juju-e4d256-prod-github-runner-207 kernel: [27136.581272] ? __hrtimer_run_queues+0x107/0x230 Aug 22 12:56:02 juju-e4d256-prod-github-runner-207 kernel: [27136.582351] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 12:56:02 juju-e4d256-prod-github-runner-207 kernel: [27136.583403] ? hrtimer_interrupt+0x101/0x220 Aug 22 12:56:02 juju-e4d256-prod-github-runner-207 kernel: [27136.584452] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 12:56:02 juju-e4d256-prod-github-runner-207 kernel: [27136.585534] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 12:56:02 juju-e4d256-prod-github-runner-207 kernel: [27136.586604] Aug 22 12:56:02 juju-e4d256-prod-github-runner-207 kernel: [27136.587466] Aug 22 12:56:02 juju-e4d256-prod-github-runner-207 kernel: [27136.588319] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 12:56:02 juju-e4d256-prod-github-runner-207 kernel: [27136.589378] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:56:02 juju-e4d256-prod-github-runner-207 kernel: [27136.590452] ? _raw_spin_lock+0x22/0x30 Aug 22 12:56:02 juju-e4d256-prod-github-runner-207 kernel: [27136.591398] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:56:02 juju-e4d256-prod-github-runner-207 kernel: [27136.592464] direct_page_fault+0x206/0x310 [kvm] Aug 22 12:56:02 juju-e4d256-prod-github-runner-207 kernel: [27136.593506] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 12:56:02 juju-e4d256-prod-github-runner-207 kernel: [27136.594540] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 12:56:02 juju-e4d256-prod-github-runner-207 kernel: [27136.595548] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 12:56:02 juju-e4d256-prod-github-runner-207 kernel: [27136.596521] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 12:56:02 juju-e4d256-prod-github-runner-207 kernel: [27136.597481] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 12:56:02 juju-e4d256-prod-github-runner-207 kernel: [27136.598489] handle_exit+0x98/0x230 [kvm_amd] Aug 22 12:56:02 juju-e4d256-prod-github-runner-207 kernel: [27136.599389] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 12:56:02 juju-e4d256-prod-github-runner-207 kernel: [27136.600303] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 12:56:02 juju-e4d256-prod-github-runner-207 kernel: [27136.601229] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 12:56:02 juju-e4d256-prod-github-runner-207 kernel: [27136.602149] vcpu_run+0x62/0x2c0 [kvm] Aug 22 12:56:02 juju-e4d256-prod-github-runner-207 kernel: [27136.602996] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 12:56:02 juju-e4d256-prod-github-runner-207 kernel: [27136.603808] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 12:56:02 juju-e4d256-prod-github-runner-207 kernel: [27136.604663] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 12:56:02 juju-e4d256-prod-github-runner-207 kernel: [27136.605464] ? __seccomp_filter+0x4a/0x4a0 Aug 22 12:56:02 juju-e4d256-prod-github-runner-207 kernel: [27136.606217] ? __fget_files+0x86/0xc0 Aug 22 12:56:02 juju-e4d256-prod-github-runner-207 kernel: [27136.606920] __x64_sys_ioctl+0x95/0xd0 Aug 22 12:56:02 juju-e4d256-prod-github-runner-207 kernel: [27136.607634] do_syscall_64+0x5c/0xc0 Aug 22 12:56:02 juju-e4d256-prod-github-runner-207 kernel: [27136.608312] ? do_futex+0x162/0x1f0 Aug 22 12:56:02 juju-e4d256-prod-github-runner-207 kernel: [27136.608959] ? __x64_sys_futex+0x78/0x1e0 Aug 22 12:56:02 juju-e4d256-prod-github-runner-207 kernel: [27136.609628] ? __secure_computing+0xa9/0x120 Aug 22 12:56:02 juju-e4d256-prod-github-runner-207 kernel: [27136.610355] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 12:56:02 juju-e4d256-prod-github-runner-207 kernel: [27136.611122] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:56:02 juju-e4d256-prod-github-runner-207 kernel: [27136.611846] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:56:02 juju-e4d256-prod-github-runner-207 kernel: [27136.612562] ? do_syscall_64+0x69/0xc0 Aug 22 12:56:02 juju-e4d256-prod-github-runner-207 kernel: [27136.613241] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:56:02 juju-e4d256-prod-github-runner-207 kernel: [27136.613975] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:56:02 juju-e4d256-prod-github-runner-207 kernel: [27136.614672] ? do_syscall_64+0x69/0xc0 Aug 22 12:56:02 juju-e4d256-prod-github-runner-207 kernel: [27136.615299] ? do_syscall_64+0x69/0xc0 Aug 22 12:56:02 juju-e4d256-prod-github-runner-207 kernel: [27136.615919] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 12:56:02 juju-e4d256-prod-github-runner-207 kernel: [27136.616620] RIP: 0033:0x7faa5d0edaff Aug 22 12:56:02 juju-e4d256-prod-github-runner-207 kernel: [27136.617262] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 12:56:02 juju-e4d256-prod-github-runner-207 kernel: [27136.619267] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 12:56:02 juju-e4d256-prod-github-runner-207 kernel: [27136.620180] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 12:56:02 juju-e4d256-prod-github-runner-207 kernel: [27136.621072] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 12:56:02 juju-e4d256-prod-github-runner-207 kernel: [27136.621977] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 12:56:02 juju-e4d256-prod-github-runner-207 kernel: [27136.622867] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 12:56:02 juju-e4d256-prod-github-runner-207 kernel: [27136.623799] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 12:56:02 juju-e4d256-prod-github-runner-207 kernel: [27136.624705] Aug 22 12:56:30 juju-e4d256-prod-github-runner-207 kernel: [27164.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 25190s! [qemu-system-x86:6715] Aug 22 12:56:30 juju-e4d256-prod-github-runner-207 kernel: [27164.543234] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 12:56:30 juju-e4d256-prod-github-runner-207 kernel: [27164.543309] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 12:56:30 juju-e4d256-prod-github-runner-207 kernel: [27164.555826] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 12:56:30 juju-e4d256-prod-github-runner-207 kernel: [27164.557205] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 12:56:30 juju-e4d256-prod-github-runner-207 kernel: [27164.558459] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:56:30 juju-e4d256-prod-github-runner-207 kernel: [27164.559537] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 12:56:30 juju-e4d256-prod-github-runner-207 kernel: [27164.562222] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 12:56:30 juju-e4d256-prod-github-runner-207 kernel: [27164.563324] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 12:56:30 juju-e4d256-prod-github-runner-207 kernel: [27164.564521] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 12:56:30 juju-e4d256-prod-github-runner-207 kernel: [27164.565720] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 12:56:30 juju-e4d256-prod-github-runner-207 kernel: [27164.566944] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 12:56:30 juju-e4d256-prod-github-runner-207 kernel: [27164.568194] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 12:56:30 juju-e4d256-prod-github-runner-207 kernel: [27164.569393] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 12:56:30 juju-e4d256-prod-github-runner-207 kernel: [27164.570627] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 12:56:30 juju-e4d256-prod-github-runner-207 kernel: [27164.571724] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 12:56:30 juju-e4d256-prod-github-runner-207 kernel: [27164.572920] Call Trace: Aug 22 12:56:30 juju-e4d256-prod-github-runner-207 kernel: [27164.573862] Aug 22 12:56:30 juju-e4d256-prod-github-runner-207 kernel: [27164.574754] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:56:30 juju-e4d256-prod-github-runner-207 kernel: [27164.575786] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:56:30 juju-e4d256-prod-github-runner-207 kernel: [27164.576832] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:56:30 juju-e4d256-prod-github-runner-207 kernel: [27164.577938] ? show_regs.part.0+0x23/0x29 Aug 22 12:56:30 juju-e4d256-prod-github-runner-207 kernel: [27164.578967] ? show_regs.cold+0x8/0xd Aug 22 12:56:30 juju-e4d256-prod-github-runner-207 kernel: [27164.579994] ? watchdog_timer_fn+0x1be/0x220 Aug 22 12:56:30 juju-e4d256-prod-github-runner-207 kernel: [27164.581011] ? lockup_detector_update_enable+0x60/0x60 Aug 22 12:56:30 juju-e4d256-prod-github-runner-207 kernel: [27164.582100] ? __hrtimer_run_queues+0x107/0x230 Aug 22 12:56:30 juju-e4d256-prod-github-runner-207 kernel: [27164.583268] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 12:56:30 juju-e4d256-prod-github-runner-207 kernel: [27164.584407] ? hrtimer_interrupt+0x101/0x220 Aug 22 12:56:30 juju-e4d256-prod-github-runner-207 kernel: [27164.585479] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 12:56:30 juju-e4d256-prod-github-runner-207 kernel: [27164.586702] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 12:56:30 juju-e4d256-prod-github-runner-207 kernel: [27164.587983] Aug 22 12:56:30 juju-e4d256-prod-github-runner-207 kernel: [27164.589003] Aug 22 12:56:30 juju-e4d256-prod-github-runner-207 kernel: [27164.590025] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 12:56:30 juju-e4d256-prod-github-runner-207 kernel: [27164.591279] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:56:30 juju-e4d256-prod-github-runner-207 kernel: [27164.592441] ? _raw_spin_lock+0x22/0x30 Aug 22 12:56:30 juju-e4d256-prod-github-runner-207 kernel: [27164.593462] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:56:30 juju-e4d256-prod-github-runner-207 kernel: [27164.594809] direct_page_fault+0x206/0x310 [kvm] Aug 22 12:56:30 juju-e4d256-prod-github-runner-207 kernel: [27164.595863] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 12:56:30 juju-e4d256-prod-github-runner-207 kernel: [27164.596892] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 12:56:30 juju-e4d256-prod-github-runner-207 kernel: [27164.598330] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 12:56:30 juju-e4d256-prod-github-runner-207 kernel: [27164.599519] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 12:56:30 juju-e4d256-prod-github-runner-207 kernel: [27164.600650] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 12:56:30 juju-e4d256-prod-github-runner-207 kernel: [27164.601894] handle_exit+0x98/0x230 [kvm_amd] Aug 22 12:56:30 juju-e4d256-prod-github-runner-207 kernel: [27164.602922] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 12:56:30 juju-e4d256-prod-github-runner-207 kernel: [27164.604051] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 12:56:30 juju-e4d256-prod-github-runner-207 kernel: [27164.605123] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 12:56:30 juju-e4d256-prod-github-runner-207 kernel: [27164.606232] vcpu_run+0x62/0x2c0 [kvm] Aug 22 12:56:30 juju-e4d256-prod-github-runner-207 kernel: [27164.607143] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 12:56:30 juju-e4d256-prod-github-runner-207 kernel: [27164.608098] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 12:56:30 juju-e4d256-prod-github-runner-207 kernel: [27164.609147] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 12:56:30 juju-e4d256-prod-github-runner-207 kernel: [27164.610123] ? __seccomp_filter+0x4a/0x4a0 Aug 22 12:56:30 juju-e4d256-prod-github-runner-207 kernel: [27164.611007] ? __fget_files+0x86/0xc0 Aug 22 12:56:30 juju-e4d256-prod-github-runner-207 kernel: [27164.611824] __x64_sys_ioctl+0x95/0xd0 Aug 22 12:56:30 juju-e4d256-prod-github-runner-207 kernel: [27164.612697] do_syscall_64+0x5c/0xc0 Aug 22 12:56:30 juju-e4d256-prod-github-runner-207 kernel: [27164.613522] ? do_futex+0x162/0x1f0 Aug 22 12:56:30 juju-e4d256-prod-github-runner-207 kernel: [27164.614226] ? __x64_sys_futex+0x78/0x1e0 Aug 22 12:56:30 juju-e4d256-prod-github-runner-207 kernel: [27164.615009] ? __secure_computing+0xa9/0x120 Aug 22 12:56:30 juju-e4d256-prod-github-runner-207 kernel: [27164.615843] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 12:56:30 juju-e4d256-prod-github-runner-207 kernel: [27164.616743] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:56:30 juju-e4d256-prod-github-runner-207 kernel: [27164.617612] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:56:30 juju-e4d256-prod-github-runner-207 kernel: [27164.618504] ? do_syscall_64+0x69/0xc0 Aug 22 12:56:30 juju-e4d256-prod-github-runner-207 kernel: [27164.619181] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:56:30 juju-e4d256-prod-github-runner-207 kernel: [27164.620017] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:56:30 juju-e4d256-prod-github-runner-207 kernel: [27164.620856] ? do_syscall_64+0x69/0xc0 Aug 22 12:56:30 juju-e4d256-prod-github-runner-207 kernel: [27164.621550] ? do_syscall_64+0x69/0xc0 Aug 22 12:56:30 juju-e4d256-prod-github-runner-207 kernel: [27164.622181] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 12:56:30 juju-e4d256-prod-github-runner-207 kernel: [27164.623020] RIP: 0033:0x7faa5d0edaff Aug 22 12:56:30 juju-e4d256-prod-github-runner-207 kernel: [27164.623716] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 12:56:30 juju-e4d256-prod-github-runner-207 kernel: [27164.626025] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 12:56:30 juju-e4d256-prod-github-runner-207 kernel: [27164.627145] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 12:56:30 juju-e4d256-prod-github-runner-207 kernel: [27164.628232] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 12:56:30 juju-e4d256-prod-github-runner-207 kernel: [27164.629322] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 12:56:30 juju-e4d256-prod-github-runner-207 kernel: [27164.630379] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 12:56:30 juju-e4d256-prod-github-runner-207 kernel: [27164.631726] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 12:56:30 juju-e4d256-prod-github-runner-207 kernel: [27164.632762] Aug 22 12:56:45 juju-e4d256-prod-github-runner-207 kernel: [27179.000713] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 12:56:45 juju-e4d256-prod-github-runner-207 kernel: [27179.001711] rcu: 1-....: (6744365 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=3261740 Aug 22 12:56:45 juju-e4d256-prod-github-runner-207 kernel: [27179.002851] (t=6765450 jiffies g=23269 q=31315) Aug 22 12:56:45 juju-e4d256-prod-github-runner-207 kernel: [27179.003649] NMI backtrace for cpu 1 Aug 22 12:56:45 juju-e4d256-prod-github-runner-207 kernel: [27179.004383] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 12:56:45 juju-e4d256-prod-github-runner-207 kernel: [27179.005657] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 12:56:45 juju-e4d256-prod-github-runner-207 kernel: [27179.006863] Call Trace: Aug 22 12:56:45 juju-e4d256-prod-github-runner-207 kernel: [27179.007588] Aug 22 12:56:45 juju-e4d256-prod-github-runner-207 kernel: [27179.008324] show_stack+0x52/0x5c Aug 22 12:56:45 juju-e4d256-prod-github-runner-207 kernel: [27179.009091] dump_stack_lvl+0x4a/0x63 Aug 22 12:56:45 juju-e4d256-prod-github-runner-207 kernel: [27179.009866] dump_stack+0x10/0x16 Aug 22 12:56:45 juju-e4d256-prod-github-runner-207 kernel: [27179.010593] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 12:56:45 juju-e4d256-prod-github-runner-207 kernel: [27179.011394] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 12:56:45 juju-e4d256-prod-github-runner-207 kernel: [27179.012230] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 12:56:45 juju-e4d256-prod-github-runner-207 kernel: [27179.013153] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 12:56:45 juju-e4d256-prod-github-runner-207 kernel: [27179.014079] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 12:56:45 juju-e4d256-prod-github-runner-207 kernel: [27179.014985] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 12:56:45 juju-e4d256-prod-github-runner-207 kernel: [27179.015835] print_cpu_stall.cold+0x2f/0xe2 Aug 22 12:56:45 juju-e4d256-prod-github-runner-207 kernel: [27179.016867] ? timekeeping_update+0xf7/0x150 Aug 22 12:56:45 juju-e4d256-prod-github-runner-207 kernel: [27179.017795] check_cpu_stall+0x109/0x270 Aug 22 12:56:45 juju-e4d256-prod-github-runner-207 kernel: [27179.018801] rcu_sched_clock_irq+0x9a/0x250 Aug 22 12:56:45 juju-e4d256-prod-github-runner-207 kernel: [27179.019669] update_process_times+0x94/0xd0 Aug 22 12:56:45 juju-e4d256-prod-github-runner-207 kernel: [27179.020462] tick_sched_handle+0x29/0x70 Aug 22 12:56:45 juju-e4d256-prod-github-runner-207 kernel: [27179.021325] tick_sched_timer+0x8c/0xc0 Aug 22 12:56:45 juju-e4d256-prod-github-runner-207 kernel: [27179.022102] ? tick_nohz_handler+0xb0/0xb0 Aug 22 12:56:45 juju-e4d256-prod-github-runner-207 kernel: [27179.022913] __hrtimer_run_queues+0x107/0x230 Aug 22 12:56:45 juju-e4d256-prod-github-runner-207 kernel: [27179.023765] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 12:56:45 juju-e4d256-prod-github-runner-207 kernel: [27179.024593] hrtimer_interrupt+0x101/0x220 Aug 22 12:56:45 juju-e4d256-prod-github-runner-207 kernel: [27179.025431] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 12:56:45 juju-e4d256-prod-github-runner-207 kernel: [27179.026257] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 12:56:45 juju-e4d256-prod-github-runner-207 kernel: [27179.027070] Aug 22 12:56:45 juju-e4d256-prod-github-runner-207 kernel: [27179.027714] Aug 22 12:56:45 juju-e4d256-prod-github-runner-207 kernel: [27179.028350] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 12:56:45 juju-e4d256-prod-github-runner-207 kernel: [27179.029200] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:56:45 juju-e4d256-prod-github-runner-207 kernel: [27179.030092] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 12:56:45 juju-e4d256-prod-github-runner-207 kernel: [27179.032343] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 12:56:45 juju-e4d256-prod-github-runner-207 kernel: [27179.033245] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 12:56:45 juju-e4d256-prod-github-runner-207 kernel: [27179.034280] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 12:56:45 juju-e4d256-prod-github-runner-207 kernel: [27179.035389] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 12:56:45 juju-e4d256-prod-github-runner-207 kernel: [27179.036557] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 12:56:45 juju-e4d256-prod-github-runner-207 kernel: [27179.037658] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 12:56:45 juju-e4d256-prod-github-runner-207 kernel: [27179.038723] ? _raw_spin_lock+0x22/0x30 Aug 22 12:56:45 juju-e4d256-prod-github-runner-207 kernel: [27179.039578] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:56:45 juju-e4d256-prod-github-runner-207 kernel: [27179.040532] direct_page_fault+0x206/0x310 [kvm] Aug 22 12:56:45 juju-e4d256-prod-github-runner-207 kernel: [27179.041667] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 12:56:45 juju-e4d256-prod-github-runner-207 kernel: [27179.042593] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 12:56:45 juju-e4d256-prod-github-runner-207 kernel: [27179.043516] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 12:56:45 juju-e4d256-prod-github-runner-207 kernel: [27179.044430] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 12:56:45 juju-e4d256-prod-github-runner-207 kernel: [27179.045396] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 12:56:45 juju-e4d256-prod-github-runner-207 kernel: [27179.046279] handle_exit+0x98/0x230 [kvm_amd] Aug 22 12:56:45 juju-e4d256-prod-github-runner-207 kernel: [27179.047263] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 12:56:45 juju-e4d256-prod-github-runner-207 kernel: [27179.048090] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 12:56:45 juju-e4d256-prod-github-runner-207 kernel: [27179.048966] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 12:56:45 juju-e4d256-prod-github-runner-207 kernel: [27179.049795] vcpu_run+0x62/0x2c0 [kvm] Aug 22 12:56:45 juju-e4d256-prod-github-runner-207 kernel: [27179.050520] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 12:56:45 juju-e4d256-prod-github-runner-207 kernel: [27179.051282] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 12:56:45 juju-e4d256-prod-github-runner-207 kernel: [27179.052126] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 12:56:45 juju-e4d256-prod-github-runner-207 kernel: [27179.052961] ? __seccomp_filter+0x4a/0x4a0 Aug 22 12:56:45 juju-e4d256-prod-github-runner-207 kernel: [27179.053745] ? __fget_files+0x86/0xc0 Aug 22 12:56:45 juju-e4d256-prod-github-runner-207 kernel: [27179.054446] __x64_sys_ioctl+0x95/0xd0 Aug 22 12:56:45 juju-e4d256-prod-github-runner-207 kernel: [27179.055174] do_syscall_64+0x5c/0xc0 Aug 22 12:56:45 juju-e4d256-prod-github-runner-207 kernel: [27179.055876] ? do_futex+0x162/0x1f0 Aug 22 12:56:45 juju-e4d256-prod-github-runner-207 kernel: [27179.056558] ? __x64_sys_futex+0x78/0x1e0 Aug 22 12:56:45 juju-e4d256-prod-github-runner-207 kernel: [27179.057302] ? __secure_computing+0xa9/0x120 Aug 22 12:56:45 juju-e4d256-prod-github-runner-207 kernel: [27179.058096] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 12:56:45 juju-e4d256-prod-github-runner-207 kernel: [27179.058910] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:56:45 juju-e4d256-prod-github-runner-207 kernel: [27179.059720] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:56:45 juju-e4d256-prod-github-runner-207 kernel: [27179.060529] ? do_syscall_64+0x69/0xc0 Aug 22 12:56:45 juju-e4d256-prod-github-runner-207 kernel: [27179.061255] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:56:45 juju-e4d256-prod-github-runner-207 kernel: [27179.062023] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:56:45 juju-e4d256-prod-github-runner-207 kernel: [27179.062790] ? do_syscall_64+0x69/0xc0 Aug 22 12:56:45 juju-e4d256-prod-github-runner-207 kernel: [27179.063492] ? do_syscall_64+0x69/0xc0 Aug 22 12:56:45 juju-e4d256-prod-github-runner-207 kernel: [27179.064198] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 12:56:45 juju-e4d256-prod-github-runner-207 kernel: [27179.064995] RIP: 0033:0x7faa5d0edaff Aug 22 12:56:45 juju-e4d256-prod-github-runner-207 kernel: [27179.065702] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 12:56:45 juju-e4d256-prod-github-runner-207 kernel: [27179.067842] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 12:56:45 juju-e4d256-prod-github-runner-207 kernel: [27179.068833] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 12:56:45 juju-e4d256-prod-github-runner-207 kernel: [27179.069822] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 12:56:45 juju-e4d256-prod-github-runner-207 kernel: [27179.070782] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 12:56:45 juju-e4d256-prod-github-runner-207 kernel: [27179.071809] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 12:56:45 juju-e4d256-prod-github-runner-207 kernel: [27179.072882] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 12:56:45 juju-e4d256-prod-github-runner-207 kernel: [27179.073950] Aug 22 12:57:10 juju-e4d256-prod-github-runner-207 kernel: [27204.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 25228s! [qemu-system-x86:6715] Aug 22 12:57:10 juju-e4d256-prod-github-runner-207 kernel: [27204.543867] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 12:57:10 juju-e4d256-prod-github-runner-207 kernel: [27204.544166] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 12:57:10 juju-e4d256-prod-github-runner-207 kernel: [27204.557019] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 12:57:10 juju-e4d256-prod-github-runner-207 kernel: [27204.558365] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 12:57:10 juju-e4d256-prod-github-runner-207 kernel: [27204.559616] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:57:10 juju-e4d256-prod-github-runner-207 kernel: [27204.560691] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 12:57:10 juju-e4d256-prod-github-runner-207 kernel: [27204.563305] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 12:57:10 juju-e4d256-prod-github-runner-207 kernel: [27204.564382] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 12:57:10 juju-e4d256-prod-github-runner-207 kernel: [27204.565618] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 12:57:10 juju-e4d256-prod-github-runner-207 kernel: [27204.566800] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 12:57:10 juju-e4d256-prod-github-runner-207 kernel: [27204.567994] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 12:57:10 juju-e4d256-prod-github-runner-207 kernel: [27204.569188] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 12:57:10 juju-e4d256-prod-github-runner-207 kernel: [27204.570421] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 12:57:10 juju-e4d256-prod-github-runner-207 kernel: [27204.571691] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 12:57:10 juju-e4d256-prod-github-runner-207 kernel: [27204.572817] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 12:57:10 juju-e4d256-prod-github-runner-207 kernel: [27204.574123] Call Trace: Aug 22 12:57:10 juju-e4d256-prod-github-runner-207 kernel: [27204.575109] Aug 22 12:57:10 juju-e4d256-prod-github-runner-207 kernel: [27204.576079] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:57:10 juju-e4d256-prod-github-runner-207 kernel: [27204.577143] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:57:10 juju-e4d256-prod-github-runner-207 kernel: [27204.578184] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:57:10 juju-e4d256-prod-github-runner-207 kernel: [27204.579300] ? show_regs.part.0+0x23/0x29 Aug 22 12:57:10 juju-e4d256-prod-github-runner-207 kernel: [27204.580323] ? show_regs.cold+0x8/0xd Aug 22 12:57:10 juju-e4d256-prod-github-runner-207 kernel: [27204.581366] ? watchdog_timer_fn+0x1be/0x220 Aug 22 12:57:10 juju-e4d256-prod-github-runner-207 kernel: [27204.582409] ? lockup_detector_update_enable+0x60/0x60 Aug 22 12:57:10 juju-e4d256-prod-github-runner-207 kernel: [27204.583502] ? __hrtimer_run_queues+0x107/0x230 Aug 22 12:57:10 juju-e4d256-prod-github-runner-207 kernel: [27204.584552] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 12:57:10 juju-e4d256-prod-github-runner-207 kernel: [27204.585627] ? hrtimer_interrupt+0x101/0x220 Aug 22 12:57:10 juju-e4d256-prod-github-runner-207 kernel: [27204.586666] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 12:57:10 juju-e4d256-prod-github-runner-207 kernel: [27204.587751] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 12:57:10 juju-e4d256-prod-github-runner-207 kernel: [27204.588896] Aug 22 12:57:10 juju-e4d256-prod-github-runner-207 kernel: [27204.589807] Aug 22 12:57:10 juju-e4d256-prod-github-runner-207 kernel: [27204.590700] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 12:57:10 juju-e4d256-prod-github-runner-207 kernel: [27204.591751] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:57:10 juju-e4d256-prod-github-runner-207 kernel: [27204.592959] ? _raw_spin_lock+0x22/0x30 Aug 22 12:57:10 juju-e4d256-prod-github-runner-207 kernel: [27204.593942] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:57:10 juju-e4d256-prod-github-runner-207 kernel: [27204.595003] direct_page_fault+0x206/0x310 [kvm] Aug 22 12:57:10 juju-e4d256-prod-github-runner-207 kernel: [27204.596044] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 12:57:10 juju-e4d256-prod-github-runner-207 kernel: [27204.597079] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 12:57:10 juju-e4d256-prod-github-runner-207 kernel: [27204.598100] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 12:57:10 juju-e4d256-prod-github-runner-207 kernel: [27204.599130] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 12:57:10 juju-e4d256-prod-github-runner-207 kernel: [27204.600134] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 12:57:10 juju-e4d256-prod-github-runner-207 kernel: [27204.601157] handle_exit+0x98/0x230 [kvm_amd] Aug 22 12:57:10 juju-e4d256-prod-github-runner-207 kernel: [27204.602098] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 12:57:10 juju-e4d256-prod-github-runner-207 kernel: [27204.603075] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 12:57:10 juju-e4d256-prod-github-runner-207 kernel: [27204.604012] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 12:57:10 juju-e4d256-prod-github-runner-207 kernel: [27204.604945] vcpu_run+0x62/0x2c0 [kvm] Aug 22 12:57:10 juju-e4d256-prod-github-runner-207 kernel: [27204.605767] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 12:57:10 juju-e4d256-prod-github-runner-207 kernel: [27204.606584] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 12:57:10 juju-e4d256-prod-github-runner-207 kernel: [27204.607449] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 12:57:10 juju-e4d256-prod-github-runner-207 kernel: [27204.608259] ? __seccomp_filter+0x4a/0x4a0 Aug 22 12:57:10 juju-e4d256-prod-github-runner-207 kernel: [27204.609034] ? __fget_files+0x86/0xc0 Aug 22 12:57:10 juju-e4d256-prod-github-runner-207 kernel: [27204.609803] __x64_sys_ioctl+0x95/0xd0 Aug 22 12:57:10 juju-e4d256-prod-github-runner-207 kernel: [27204.610512] do_syscall_64+0x5c/0xc0 Aug 22 12:57:10 juju-e4d256-prod-github-runner-207 kernel: [27204.611241] ? do_futex+0x162/0x1f0 Aug 22 12:57:10 juju-e4d256-prod-github-runner-207 kernel: [27204.611903] ? __x64_sys_futex+0x78/0x1e0 Aug 22 12:57:10 juju-e4d256-prod-github-runner-207 kernel: [27204.612585] ? __secure_computing+0xa9/0x120 Aug 22 12:57:10 juju-e4d256-prod-github-runner-207 kernel: [27204.613308] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 12:57:10 juju-e4d256-prod-github-runner-207 kernel: [27204.614089] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:57:10 juju-e4d256-prod-github-runner-207 kernel: [27204.614825] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:57:10 juju-e4d256-prod-github-runner-207 kernel: [27204.615553] ? do_syscall_64+0x69/0xc0 Aug 22 12:57:10 juju-e4d256-prod-github-runner-207 kernel: [27204.616209] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:57:10 juju-e4d256-prod-github-runner-207 kernel: [27204.616975] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:57:10 juju-e4d256-prod-github-runner-207 kernel: [27204.617692] ? do_syscall_64+0x69/0xc0 Aug 22 12:57:10 juju-e4d256-prod-github-runner-207 kernel: [27204.618332] ? do_syscall_64+0x69/0xc0 Aug 22 12:57:10 juju-e4d256-prod-github-runner-207 kernel: [27204.618964] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 12:57:10 juju-e4d256-prod-github-runner-207 kernel: [27204.619691] RIP: 0033:0x7faa5d0edaff Aug 22 12:57:10 juju-e4d256-prod-github-runner-207 kernel: [27204.620364] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 12:57:10 juju-e4d256-prod-github-runner-207 kernel: [27204.622429] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 12:57:10 juju-e4d256-prod-github-runner-207 kernel: [27204.623405] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 12:57:10 juju-e4d256-prod-github-runner-207 kernel: [27204.624322] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 12:57:10 juju-e4d256-prod-github-runner-207 kernel: [27204.625273] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 12:57:10 juju-e4d256-prod-github-runner-207 kernel: [27204.626180] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 12:57:10 juju-e4d256-prod-github-runner-207 kernel: [27204.627103] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 12:57:10 juju-e4d256-prod-github-runner-207 kernel: [27204.628008] Aug 22 12:57:38 juju-e4d256-prod-github-runner-207 kernel: [27232.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 25254s! [qemu-system-x86:6715] Aug 22 12:57:38 juju-e4d256-prod-github-runner-207 kernel: [27232.543100] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 12:57:38 juju-e4d256-prod-github-runner-207 kernel: [27232.543172] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 12:57:38 juju-e4d256-prod-github-runner-207 kernel: [27232.555396] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 12:57:38 juju-e4d256-prod-github-runner-207 kernel: [27232.556683] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 12:57:38 juju-e4d256-prod-github-runner-207 kernel: [27232.557897] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:57:38 juju-e4d256-prod-github-runner-207 kernel: [27232.558954] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 12:57:38 juju-e4d256-prod-github-runner-207 kernel: [27232.561512] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 12:57:38 juju-e4d256-prod-github-runner-207 kernel: [27232.562551] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 12:57:38 juju-e4d256-prod-github-runner-207 kernel: [27232.563708] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 12:57:38 juju-e4d256-prod-github-runner-207 kernel: [27232.564880] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 12:57:38 juju-e4d256-prod-github-runner-207 kernel: [27232.566036] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 12:57:38 juju-e4d256-prod-github-runner-207 kernel: [27232.567196] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 12:57:38 juju-e4d256-prod-github-runner-207 kernel: [27232.568358] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 12:57:38 juju-e4d256-prod-github-runner-207 kernel: [27232.569599] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 12:57:38 juju-e4d256-prod-github-runner-207 kernel: [27232.570695] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 12:57:38 juju-e4d256-prod-github-runner-207 kernel: [27232.571885] Call Trace: Aug 22 12:57:38 juju-e4d256-prod-github-runner-207 kernel: [27232.572815] Aug 22 12:57:38 juju-e4d256-prod-github-runner-207 kernel: [27232.573697] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:57:38 juju-e4d256-prod-github-runner-207 kernel: [27232.574725] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:57:38 juju-e4d256-prod-github-runner-207 kernel: [27232.575788] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:57:38 juju-e4d256-prod-github-runner-207 kernel: [27232.576902] ? show_regs.part.0+0x23/0x29 Aug 22 12:57:38 juju-e4d256-prod-github-runner-207 kernel: [27232.577898] ? show_regs.cold+0x8/0xd Aug 22 12:57:38 juju-e4d256-prod-github-runner-207 kernel: [27232.578883] ? watchdog_timer_fn+0x1be/0x220 Aug 22 12:57:38 juju-e4d256-prod-github-runner-207 kernel: [27232.579917] ? lockup_detector_update_enable+0x60/0x60 Aug 22 12:57:38 juju-e4d256-prod-github-runner-207 kernel: [27232.581023] ? __hrtimer_run_queues+0x107/0x230 Aug 22 12:57:38 juju-e4d256-prod-github-runner-207 kernel: [27232.582049] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 12:57:38 juju-e4d256-prod-github-runner-207 kernel: [27232.583071] ? hrtimer_interrupt+0x101/0x220 Aug 22 12:57:38 juju-e4d256-prod-github-runner-207 kernel: [27232.584084] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 12:57:38 juju-e4d256-prod-github-runner-207 kernel: [27232.585187] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 12:57:38 juju-e4d256-prod-github-runner-207 kernel: [27232.586277] Aug 22 12:57:38 juju-e4d256-prod-github-runner-207 kernel: [27232.587130] Aug 22 12:57:38 juju-e4d256-prod-github-runner-207 kernel: [27232.588082] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 12:57:38 juju-e4d256-prod-github-runner-207 kernel: [27232.589291] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:57:38 juju-e4d256-prod-github-runner-207 kernel: [27232.590358] ? _raw_spin_lock+0x22/0x30 Aug 22 12:57:38 juju-e4d256-prod-github-runner-207 kernel: [27232.591316] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:57:38 juju-e4d256-prod-github-runner-207 kernel: [27232.592349] direct_page_fault+0x206/0x310 [kvm] Aug 22 12:57:38 juju-e4d256-prod-github-runner-207 kernel: [27232.593397] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 12:57:38 juju-e4d256-prod-github-runner-207 kernel: [27232.594412] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 12:57:38 juju-e4d256-prod-github-runner-207 kernel: [27232.595424] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 12:57:38 juju-e4d256-prod-github-runner-207 kernel: [27232.596400] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 12:57:38 juju-e4d256-prod-github-runner-207 kernel: [27232.597371] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 12:57:38 juju-e4d256-prod-github-runner-207 kernel: [27232.598358] handle_exit+0x98/0x230 [kvm_amd] Aug 22 12:57:38 juju-e4d256-prod-github-runner-207 kernel: [27232.599257] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 12:57:38 juju-e4d256-prod-github-runner-207 kernel: [27232.600177] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 12:57:38 juju-e4d256-prod-github-runner-207 kernel: [27232.601124] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 12:57:38 juju-e4d256-prod-github-runner-207 kernel: [27232.602041] vcpu_run+0x62/0x2c0 [kvm] Aug 22 12:57:38 juju-e4d256-prod-github-runner-207 kernel: [27232.602857] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 12:57:38 juju-e4d256-prod-github-runner-207 kernel: [27232.603672] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 12:57:38 juju-e4d256-prod-github-runner-207 kernel: [27232.604544] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 12:57:38 juju-e4d256-prod-github-runner-207 kernel: [27232.605358] ? __seccomp_filter+0x4a/0x4a0 Aug 22 12:57:38 juju-e4d256-prod-github-runner-207 kernel: [27232.606106] ? __fget_files+0x86/0xc0 Aug 22 12:57:38 juju-e4d256-prod-github-runner-207 kernel: [27232.606818] __x64_sys_ioctl+0x95/0xd0 Aug 22 12:57:38 juju-e4d256-prod-github-runner-207 kernel: [27232.607516] do_syscall_64+0x5c/0xc0 Aug 22 12:57:38 juju-e4d256-prod-github-runner-207 kernel: [27232.608191] ? do_futex+0x162/0x1f0 Aug 22 12:57:38 juju-e4d256-prod-github-runner-207 kernel: [27232.608854] ? __x64_sys_futex+0x78/0x1e0 Aug 22 12:57:38 juju-e4d256-prod-github-runner-207 kernel: [27232.609588] ? __secure_computing+0xa9/0x120 Aug 22 12:57:38 juju-e4d256-prod-github-runner-207 kernel: [27232.610294] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 12:57:38 juju-e4d256-prod-github-runner-207 kernel: [27232.611068] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:57:38 juju-e4d256-prod-github-runner-207 kernel: [27232.611840] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:57:38 juju-e4d256-prod-github-runner-207 kernel: [27232.612602] ? do_syscall_64+0x69/0xc0 Aug 22 12:57:38 juju-e4d256-prod-github-runner-207 kernel: [27232.613260] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:57:38 juju-e4d256-prod-github-runner-207 kernel: [27232.613979] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:57:38 juju-e4d256-prod-github-runner-207 kernel: [27232.614683] ? do_syscall_64+0x69/0xc0 Aug 22 12:57:38 juju-e4d256-prod-github-runner-207 kernel: [27232.615316] ? do_syscall_64+0x69/0xc0 Aug 22 12:57:38 juju-e4d256-prod-github-runner-207 kernel: [27232.615953] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 12:57:38 juju-e4d256-prod-github-runner-207 kernel: [27232.616689] RIP: 0033:0x7faa5d0edaff Aug 22 12:57:38 juju-e4d256-prod-github-runner-207 kernel: [27232.617324] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 12:57:38 juju-e4d256-prod-github-runner-207 kernel: [27232.619372] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 12:57:38 juju-e4d256-prod-github-runner-207 kernel: [27232.620295] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 12:57:38 juju-e4d256-prod-github-runner-207 kernel: [27232.621198] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 12:57:38 juju-e4d256-prod-github-runner-207 kernel: [27232.622082] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 12:57:38 juju-e4d256-prod-github-runner-207 kernel: [27232.623047] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 12:57:38 juju-e4d256-prod-github-runner-207 kernel: [27232.623955] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 12:57:38 juju-e4d256-prod-github-runner-207 kernel: [27232.624878] Aug 22 12:58:06 juju-e4d256-prod-github-runner-207 kernel: [27260.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 25280s! [qemu-system-x86:6715] Aug 22 12:58:06 juju-e4d256-prod-github-runner-207 kernel: [27260.543183] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 12:58:06 juju-e4d256-prod-github-runner-207 kernel: [27260.543264] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 12:58:06 juju-e4d256-prod-github-runner-207 kernel: [27260.556116] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 12:58:06 juju-e4d256-prod-github-runner-207 kernel: [27260.557429] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 12:58:06 juju-e4d256-prod-github-runner-207 kernel: [27260.558677] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:58:06 juju-e4d256-prod-github-runner-207 kernel: [27260.559876] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 12:58:06 juju-e4d256-prod-github-runner-207 kernel: [27260.562577] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 12:58:06 juju-e4d256-prod-github-runner-207 kernel: [27260.563633] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 12:58:06 juju-e4d256-prod-github-runner-207 kernel: [27260.564831] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 12:58:06 juju-e4d256-prod-github-runner-207 kernel: [27260.566028] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 12:58:06 juju-e4d256-prod-github-runner-207 kernel: [27260.567206] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 12:58:06 juju-e4d256-prod-github-runner-207 kernel: [27260.568417] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 12:58:06 juju-e4d256-prod-github-runner-207 kernel: [27260.569617] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 12:58:06 juju-e4d256-prod-github-runner-207 kernel: [27260.571039] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 12:58:06 juju-e4d256-prod-github-runner-207 kernel: [27260.572221] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 12:58:06 juju-e4d256-prod-github-runner-207 kernel: [27260.573522] Call Trace: Aug 22 12:58:06 juju-e4d256-prod-github-runner-207 kernel: [27260.574523] Aug 22 12:58:06 juju-e4d256-prod-github-runner-207 kernel: [27260.575419] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:58:06 juju-e4d256-prod-github-runner-207 kernel: [27260.576482] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:58:06 juju-e4d256-prod-github-runner-207 kernel: [27260.577520] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:58:06 juju-e4d256-prod-github-runner-207 kernel: [27260.578606] ? show_regs.part.0+0x23/0x29 Aug 22 12:58:06 juju-e4d256-prod-github-runner-207 kernel: [27260.579620] ? show_regs.cold+0x8/0xd Aug 22 12:58:06 juju-e4d256-prod-github-runner-207 kernel: [27260.580634] ? watchdog_timer_fn+0x1be/0x220 Aug 22 12:58:06 juju-e4d256-prod-github-runner-207 kernel: [27260.581658] ? lockup_detector_update_enable+0x60/0x60 Aug 22 12:58:06 juju-e4d256-prod-github-runner-207 kernel: [27260.582753] ? __hrtimer_run_queues+0x107/0x230 Aug 22 12:58:06 juju-e4d256-prod-github-runner-207 kernel: [27260.583810] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 12:58:06 juju-e4d256-prod-github-runner-207 kernel: [27260.584865] ? hrtimer_interrupt+0x101/0x220 Aug 22 12:58:06 juju-e4d256-prod-github-runner-207 kernel: [27260.585893] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 12:58:06 juju-e4d256-prod-github-runner-207 kernel: [27260.587010] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 12:58:06 juju-e4d256-prod-github-runner-207 kernel: [27260.588091] Aug 22 12:58:06 juju-e4d256-prod-github-runner-207 kernel: [27260.588988] Aug 22 12:58:06 juju-e4d256-prod-github-runner-207 kernel: [27260.589833] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 12:58:06 juju-e4d256-prod-github-runner-207 kernel: [27260.590917] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:58:06 juju-e4d256-prod-github-runner-207 kernel: [27260.591980] ? _raw_spin_lock+0x22/0x30 Aug 22 12:58:06 juju-e4d256-prod-github-runner-207 kernel: [27260.592948] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:58:06 juju-e4d256-prod-github-runner-207 kernel: [27260.593996] direct_page_fault+0x206/0x310 [kvm] Aug 22 12:58:06 juju-e4d256-prod-github-runner-207 kernel: [27260.595039] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 12:58:06 juju-e4d256-prod-github-runner-207 kernel: [27260.596063] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 12:58:06 juju-e4d256-prod-github-runner-207 kernel: [27260.597105] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 12:58:06 juju-e4d256-prod-github-runner-207 kernel: [27260.598101] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 12:58:06 juju-e4d256-prod-github-runner-207 kernel: [27260.599057] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 12:58:06 juju-e4d256-prod-github-runner-207 kernel: [27260.600049] handle_exit+0x98/0x230 [kvm_amd] Aug 22 12:58:06 juju-e4d256-prod-github-runner-207 kernel: [27260.600976] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 12:58:06 juju-e4d256-prod-github-runner-207 kernel: [27260.601903] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 12:58:06 juju-e4d256-prod-github-runner-207 kernel: [27260.602842] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 12:58:06 juju-e4d256-prod-github-runner-207 kernel: [27260.603758] vcpu_run+0x62/0x2c0 [kvm] Aug 22 12:58:06 juju-e4d256-prod-github-runner-207 kernel: [27260.604588] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 12:58:06 juju-e4d256-prod-github-runner-207 kernel: [27260.605408] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 12:58:06 juju-e4d256-prod-github-runner-207 kernel: [27260.606280] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 12:58:06 juju-e4d256-prod-github-runner-207 kernel: [27260.607090] ? __seccomp_filter+0x4a/0x4a0 Aug 22 12:58:06 juju-e4d256-prod-github-runner-207 kernel: [27260.607843] ? __fget_files+0x86/0xc0 Aug 22 12:58:06 juju-e4d256-prod-github-runner-207 kernel: [27260.608569] __x64_sys_ioctl+0x95/0xd0 Aug 22 12:58:06 juju-e4d256-prod-github-runner-207 kernel: [27260.609274] do_syscall_64+0x5c/0xc0 Aug 22 12:58:06 juju-e4d256-prod-github-runner-207 kernel: [27260.609949] ? do_futex+0x162/0x1f0 Aug 22 12:58:06 juju-e4d256-prod-github-runner-207 kernel: [27260.610606] ? __x64_sys_futex+0x78/0x1e0 Aug 22 12:58:06 juju-e4d256-prod-github-runner-207 kernel: [27260.611289] ? __secure_computing+0xa9/0x120 Aug 22 12:58:06 juju-e4d256-prod-github-runner-207 kernel: [27260.611991] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 12:58:06 juju-e4d256-prod-github-runner-207 kernel: [27260.612782] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:58:06 juju-e4d256-prod-github-runner-207 kernel: [27260.613517] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:58:06 juju-e4d256-prod-github-runner-207 kernel: [27260.614247] ? do_syscall_64+0x69/0xc0 Aug 22 12:58:06 juju-e4d256-prod-github-runner-207 kernel: [27260.614903] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:58:06 juju-e4d256-prod-github-runner-207 kernel: [27260.615617] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:58:06 juju-e4d256-prod-github-runner-207 kernel: [27260.616366] ? do_syscall_64+0x69/0xc0 Aug 22 12:58:06 juju-e4d256-prod-github-runner-207 kernel: [27260.617006] ? do_syscall_64+0x69/0xc0 Aug 22 12:58:06 juju-e4d256-prod-github-runner-207 kernel: [27260.617666] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 12:58:06 juju-e4d256-prod-github-runner-207 kernel: [27260.618401] RIP: 0033:0x7faa5d0edaff Aug 22 12:58:06 juju-e4d256-prod-github-runner-207 kernel: [27260.619036] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 12:58:06 juju-e4d256-prod-github-runner-207 kernel: [27260.621081] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 12:58:06 juju-e4d256-prod-github-runner-207 kernel: [27260.622016] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 12:58:06 juju-e4d256-prod-github-runner-207 kernel: [27260.622924] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 12:58:06 juju-e4d256-prod-github-runner-207 kernel: [27260.623829] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 12:58:06 juju-e4d256-prod-github-runner-207 kernel: [27260.624739] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 12:58:06 juju-e4d256-prod-github-runner-207 kernel: [27260.625645] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 12:58:06 juju-e4d256-prod-github-runner-207 kernel: [27260.626556] Aug 22 12:58:34 juju-e4d256-prod-github-runner-207 kernel: [27288.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 25306s! [qemu-system-x86:6715] Aug 22 12:58:34 juju-e4d256-prod-github-runner-207 kernel: [27288.543980] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 12:58:34 juju-e4d256-prod-github-runner-207 kernel: [27288.544309] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 12:58:34 juju-e4d256-prod-github-runner-207 kernel: [27288.556760] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 12:58:34 juju-e4d256-prod-github-runner-207 kernel: [27288.558069] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 12:58:34 juju-e4d256-prod-github-runner-207 kernel: [27288.559282] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:58:34 juju-e4d256-prod-github-runner-207 kernel: [27288.560356] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 12:58:34 juju-e4d256-prod-github-runner-207 kernel: [27288.562916] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 12:58:34 juju-e4d256-prod-github-runner-207 kernel: [27288.564070] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 12:58:34 juju-e4d256-prod-github-runner-207 kernel: [27288.565444] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 12:58:34 juju-e4d256-prod-github-runner-207 kernel: [27288.566668] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 12:58:34 juju-e4d256-prod-github-runner-207 kernel: [27288.567911] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 12:58:34 juju-e4d256-prod-github-runner-207 kernel: [27288.569112] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 12:58:34 juju-e4d256-prod-github-runner-207 kernel: [27288.570311] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 12:58:34 juju-e4d256-prod-github-runner-207 kernel: [27288.571565] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 12:58:34 juju-e4d256-prod-github-runner-207 kernel: [27288.572707] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 12:58:34 juju-e4d256-prod-github-runner-207 kernel: [27288.573923] Call Trace: Aug 22 12:58:34 juju-e4d256-prod-github-runner-207 kernel: [27288.574847] Aug 22 12:58:34 juju-e4d256-prod-github-runner-207 kernel: [27288.575763] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:58:34 juju-e4d256-prod-github-runner-207 kernel: [27288.576823] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:58:34 juju-e4d256-prod-github-runner-207 kernel: [27288.577854] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:58:34 juju-e4d256-prod-github-runner-207 kernel: [27288.579026] ? show_regs.part.0+0x23/0x29 Aug 22 12:58:34 juju-e4d256-prod-github-runner-207 kernel: [27288.580051] ? show_regs.cold+0x8/0xd Aug 22 12:58:34 juju-e4d256-prod-github-runner-207 kernel: [27288.581037] ? watchdog_timer_fn+0x1be/0x220 Aug 22 12:58:34 juju-e4d256-prod-github-runner-207 kernel: [27288.582063] ? lockup_detector_update_enable+0x60/0x60 Aug 22 12:58:34 juju-e4d256-prod-github-runner-207 kernel: [27288.583174] ? __hrtimer_run_queues+0x107/0x230 Aug 22 12:58:34 juju-e4d256-prod-github-runner-207 kernel: [27288.584247] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 12:58:34 juju-e4d256-prod-github-runner-207 kernel: [27288.585281] ? hrtimer_interrupt+0x101/0x220 Aug 22 12:58:34 juju-e4d256-prod-github-runner-207 kernel: [27288.586312] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 12:58:34 juju-e4d256-prod-github-runner-207 kernel: [27288.587389] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 12:58:34 juju-e4d256-prod-github-runner-207 kernel: [27288.588445] Aug 22 12:58:34 juju-e4d256-prod-github-runner-207 kernel: [27288.589298] Aug 22 12:58:34 juju-e4d256-prod-github-runner-207 kernel: [27288.590134] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 12:58:34 juju-e4d256-prod-github-runner-207 kernel: [27288.591166] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:58:34 juju-e4d256-prod-github-runner-207 kernel: [27288.592218] ? _raw_spin_lock+0x22/0x30 Aug 22 12:58:34 juju-e4d256-prod-github-runner-207 kernel: [27288.593163] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:58:34 juju-e4d256-prod-github-runner-207 kernel: [27288.594185] direct_page_fault+0x206/0x310 [kvm] Aug 22 12:58:34 juju-e4d256-prod-github-runner-207 kernel: [27288.595214] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 12:58:34 juju-e4d256-prod-github-runner-207 kernel: [27288.596235] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 12:58:34 juju-e4d256-prod-github-runner-207 kernel: [27288.597255] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 12:58:34 juju-e4d256-prod-github-runner-207 kernel: [27288.598290] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 12:58:34 juju-e4d256-prod-github-runner-207 kernel: [27288.599289] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 12:58:34 juju-e4d256-prod-github-runner-207 kernel: [27288.600289] handle_exit+0x98/0x230 [kvm_amd] Aug 22 12:58:34 juju-e4d256-prod-github-runner-207 kernel: [27288.601186] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 12:58:34 juju-e4d256-prod-github-runner-207 kernel: [27288.602102] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 12:58:34 juju-e4d256-prod-github-runner-207 kernel: [27288.603026] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 12:58:34 juju-e4d256-prod-github-runner-207 kernel: [27288.603941] vcpu_run+0x62/0x2c0 [kvm] Aug 22 12:58:34 juju-e4d256-prod-github-runner-207 kernel: [27288.604766] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 12:58:34 juju-e4d256-prod-github-runner-207 kernel: [27288.605575] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 12:58:34 juju-e4d256-prod-github-runner-207 kernel: [27288.606428] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 12:58:34 juju-e4d256-prod-github-runner-207 kernel: [27288.607225] ? __seccomp_filter+0x4a/0x4a0 Aug 22 12:58:34 juju-e4d256-prod-github-runner-207 kernel: [27288.607983] ? __fget_files+0x86/0xc0 Aug 22 12:58:34 juju-e4d256-prod-github-runner-207 kernel: [27288.608688] __x64_sys_ioctl+0x95/0xd0 Aug 22 12:58:34 juju-e4d256-prod-github-runner-207 kernel: [27288.609380] do_syscall_64+0x5c/0xc0 Aug 22 12:58:34 juju-e4d256-prod-github-runner-207 kernel: [27288.610046] ? do_futex+0x162/0x1f0 Aug 22 12:58:34 juju-e4d256-prod-github-runner-207 kernel: [27288.610697] ? __x64_sys_futex+0x78/0x1e0 Aug 22 12:58:34 juju-e4d256-prod-github-runner-207 kernel: [27288.611379] ? __secure_computing+0xa9/0x120 Aug 22 12:58:34 juju-e4d256-prod-github-runner-207 kernel: [27288.612083] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 12:58:34 juju-e4d256-prod-github-runner-207 kernel: [27288.612844] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:58:34 juju-e4d256-prod-github-runner-207 kernel: [27288.613564] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:58:34 juju-e4d256-prod-github-runner-207 kernel: [27288.614286] ? do_syscall_64+0x69/0xc0 Aug 22 12:58:34 juju-e4d256-prod-github-runner-207 kernel: [27288.614930] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:58:34 juju-e4d256-prod-github-runner-207 kernel: [27288.615632] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:58:34 juju-e4d256-prod-github-runner-207 kernel: [27288.616334] ? do_syscall_64+0x69/0xc0 Aug 22 12:58:34 juju-e4d256-prod-github-runner-207 kernel: [27288.616960] ? do_syscall_64+0x69/0xc0 Aug 22 12:58:34 juju-e4d256-prod-github-runner-207 kernel: [27288.617582] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 12:58:34 juju-e4d256-prod-github-runner-207 kernel: [27288.618290] RIP: 0033:0x7faa5d0edaff Aug 22 12:58:34 juju-e4d256-prod-github-runner-207 kernel: [27288.618944] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 12:58:34 juju-e4d256-prod-github-runner-207 kernel: [27288.620954] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 12:58:34 juju-e4d256-prod-github-runner-207 kernel: [27288.621866] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 12:58:34 juju-e4d256-prod-github-runner-207 kernel: [27288.622760] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 12:58:34 juju-e4d256-prod-github-runner-207 kernel: [27288.623653] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 12:58:34 juju-e4d256-prod-github-runner-207 kernel: [27288.624558] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 12:58:34 juju-e4d256-prod-github-runner-207 kernel: [27288.625448] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 12:58:34 juju-e4d256-prod-github-runner-207 kernel: [27288.626346] Aug 22 12:59:02 juju-e4d256-prod-github-runner-207 kernel: [27316.541981] watchdog: BUG: soft lockup - CPU#1 stuck for 25332s! [qemu-system-x86:6715] Aug 22 12:59:02 juju-e4d256-prod-github-runner-207 kernel: [27316.543145] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 12:59:02 juju-e4d256-prod-github-runner-207 kernel: [27316.543226] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 12:59:02 juju-e4d256-prod-github-runner-207 kernel: [27316.555827] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 12:59:02 juju-e4d256-prod-github-runner-207 kernel: [27316.557128] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 12:59:02 juju-e4d256-prod-github-runner-207 kernel: [27316.558356] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:59:02 juju-e4d256-prod-github-runner-207 kernel: [27316.559418] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 12:59:02 juju-e4d256-prod-github-runner-207 kernel: [27316.562180] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 12:59:02 juju-e4d256-prod-github-runner-207 kernel: [27316.563238] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 12:59:02 juju-e4d256-prod-github-runner-207 kernel: [27316.564454] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 12:59:02 juju-e4d256-prod-github-runner-207 kernel: [27316.565627] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 12:59:02 juju-e4d256-prod-github-runner-207 kernel: [27316.566806] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 12:59:02 juju-e4d256-prod-github-runner-207 kernel: [27316.567995] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 12:59:02 juju-e4d256-prod-github-runner-207 kernel: [27316.569177] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 12:59:02 juju-e4d256-prod-github-runner-207 kernel: [27316.570405] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 12:59:02 juju-e4d256-prod-github-runner-207 kernel: [27316.571519] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 12:59:02 juju-e4d256-prod-github-runner-207 kernel: [27316.572837] Call Trace: Aug 22 12:59:02 juju-e4d256-prod-github-runner-207 kernel: [27316.573749] Aug 22 12:59:02 juju-e4d256-prod-github-runner-207 kernel: [27316.574665] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:59:02 juju-e4d256-prod-github-runner-207 kernel: [27316.575726] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:59:02 juju-e4d256-prod-github-runner-207 kernel: [27316.576774] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:59:02 juju-e4d256-prod-github-runner-207 kernel: [27316.578181] ? show_regs.part.0+0x23/0x29 Aug 22 12:59:02 juju-e4d256-prod-github-runner-207 kernel: [27316.579218] ? show_regs.cold+0x8/0xd Aug 22 12:59:02 juju-e4d256-prod-github-runner-207 kernel: [27316.580222] ? watchdog_timer_fn+0x1be/0x220 Aug 22 12:59:02 juju-e4d256-prod-github-runner-207 kernel: [27316.581299] ? lockup_detector_update_enable+0x60/0x60 Aug 22 12:59:02 juju-e4d256-prod-github-runner-207 kernel: [27316.582368] ? __hrtimer_run_queues+0x107/0x230 Aug 22 12:59:02 juju-e4d256-prod-github-runner-207 kernel: [27316.583396] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 12:59:02 juju-e4d256-prod-github-runner-207 kernel: [27316.584444] ? hrtimer_interrupt+0x101/0x220 Aug 22 12:59:02 juju-e4d256-prod-github-runner-207 kernel: [27316.585459] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 12:59:02 juju-e4d256-prod-github-runner-207 kernel: [27316.586525] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 12:59:02 juju-e4d256-prod-github-runner-207 kernel: [27316.587579] Aug 22 12:59:02 juju-e4d256-prod-github-runner-207 kernel: [27316.588477] Aug 22 12:59:02 juju-e4d256-prod-github-runner-207 kernel: [27316.589325] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 12:59:02 juju-e4d256-prod-github-runner-207 kernel: [27316.590357] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:59:02 juju-e4d256-prod-github-runner-207 kernel: [27316.591394] ? _raw_spin_lock+0x22/0x30 Aug 22 12:59:02 juju-e4d256-prod-github-runner-207 kernel: [27316.592369] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:59:02 juju-e4d256-prod-github-runner-207 kernel: [27316.593588] direct_page_fault+0x206/0x310 [kvm] Aug 22 12:59:02 juju-e4d256-prod-github-runner-207 kernel: [27316.594627] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 12:59:02 juju-e4d256-prod-github-runner-207 kernel: [27316.595663] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 12:59:02 juju-e4d256-prod-github-runner-207 kernel: [27316.596671] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 12:59:02 juju-e4d256-prod-github-runner-207 kernel: [27316.597671] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 12:59:02 juju-e4d256-prod-github-runner-207 kernel: [27316.598633] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 12:59:02 juju-e4d256-prod-github-runner-207 kernel: [27316.599647] handle_exit+0x98/0x230 [kvm_amd] Aug 22 12:59:02 juju-e4d256-prod-github-runner-207 kernel: [27316.600570] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 12:59:02 juju-e4d256-prod-github-runner-207 kernel: [27316.601607] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 12:59:02 juju-e4d256-prod-github-runner-207 kernel: [27316.602650] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 12:59:02 juju-e4d256-prod-github-runner-207 kernel: [27316.603621] vcpu_run+0x62/0x2c0 [kvm] Aug 22 12:59:02 juju-e4d256-prod-github-runner-207 kernel: [27316.604444] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 12:59:02 juju-e4d256-prod-github-runner-207 kernel: [27316.605268] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 12:59:02 juju-e4d256-prod-github-runner-207 kernel: [27316.606134] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 12:59:02 juju-e4d256-prod-github-runner-207 kernel: [27316.606979] ? __seccomp_filter+0x4a/0x4a0 Aug 22 12:59:02 juju-e4d256-prod-github-runner-207 kernel: [27316.607808] ? __fget_files+0x86/0xc0 Aug 22 12:59:02 juju-e4d256-prod-github-runner-207 kernel: [27316.608538] __x64_sys_ioctl+0x95/0xd0 Aug 22 12:59:02 juju-e4d256-prod-github-runner-207 kernel: [27316.609244] do_syscall_64+0x5c/0xc0 Aug 22 12:59:02 juju-e4d256-prod-github-runner-207 kernel: [27316.609921] ? do_futex+0x162/0x1f0 Aug 22 12:59:02 juju-e4d256-prod-github-runner-207 kernel: [27316.610580] ? __x64_sys_futex+0x78/0x1e0 Aug 22 12:59:02 juju-e4d256-prod-github-runner-207 kernel: [27316.611280] ? __secure_computing+0xa9/0x120 Aug 22 12:59:02 juju-e4d256-prod-github-runner-207 kernel: [27316.611995] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 12:59:02 juju-e4d256-prod-github-runner-207 kernel: [27316.612785] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:59:02 juju-e4d256-prod-github-runner-207 kernel: [27316.613517] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:59:02 juju-e4d256-prod-github-runner-207 kernel: [27316.614247] ? do_syscall_64+0x69/0xc0 Aug 22 12:59:02 juju-e4d256-prod-github-runner-207 kernel: [27316.614904] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:59:02 juju-e4d256-prod-github-runner-207 kernel: [27316.615671] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:59:02 juju-e4d256-prod-github-runner-207 kernel: [27316.616383] ? do_syscall_64+0x69/0xc0 Aug 22 12:59:02 juju-e4d256-prod-github-runner-207 kernel: [27316.617019] ? do_syscall_64+0x69/0xc0 Aug 22 12:59:02 juju-e4d256-prod-github-runner-207 kernel: [27316.617656] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 12:59:02 juju-e4d256-prod-github-runner-207 kernel: [27316.618388] RIP: 0033:0x7faa5d0edaff Aug 22 12:59:02 juju-e4d256-prod-github-runner-207 kernel: [27316.619042] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 12:59:02 juju-e4d256-prod-github-runner-207 kernel: [27316.621075] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 12:59:02 juju-e4d256-prod-github-runner-207 kernel: [27316.622281] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 12:59:02 juju-e4d256-prod-github-runner-207 kernel: [27316.623175] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 12:59:02 juju-e4d256-prod-github-runner-207 kernel: [27316.624084] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 12:59:02 juju-e4d256-prod-github-runner-207 kernel: [27316.624974] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 12:59:02 juju-e4d256-prod-github-runner-207 kernel: [27316.625871] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 12:59:02 juju-e4d256-prod-github-runner-207 kernel: [27316.626765] Aug 22 12:59:30 juju-e4d256-prod-github-runner-207 kernel: [27344.541980] watchdog: BUG: soft lockup - CPU#1 stuck for 25358s! [qemu-system-x86:6715] Aug 22 12:59:30 juju-e4d256-prod-github-runner-207 kernel: [27344.543329] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 12:59:30 juju-e4d256-prod-github-runner-207 kernel: [27344.543406] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 12:59:30 juju-e4d256-prod-github-runner-207 kernel: [27344.556058] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 12:59:30 juju-e4d256-prod-github-runner-207 kernel: [27344.557390] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 12:59:30 juju-e4d256-prod-github-runner-207 kernel: [27344.558765] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:59:30 juju-e4d256-prod-github-runner-207 kernel: [27344.559917] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 12:59:30 juju-e4d256-prod-github-runner-207 kernel: [27344.562591] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 12:59:30 juju-e4d256-prod-github-runner-207 kernel: [27344.563714] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 12:59:30 juju-e4d256-prod-github-runner-207 kernel: [27344.564906] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 12:59:30 juju-e4d256-prod-github-runner-207 kernel: [27344.566103] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 12:59:30 juju-e4d256-prod-github-runner-207 kernel: [27344.567367] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 12:59:30 juju-e4d256-prod-github-runner-207 kernel: [27344.568630] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 12:59:30 juju-e4d256-prod-github-runner-207 kernel: [27344.569822] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 12:59:30 juju-e4d256-prod-github-runner-207 kernel: [27344.571147] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 12:59:30 juju-e4d256-prod-github-runner-207 kernel: [27344.572356] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 12:59:30 juju-e4d256-prod-github-runner-207 kernel: [27344.573622] Call Trace: Aug 22 12:59:30 juju-e4d256-prod-github-runner-207 kernel: [27344.574556] Aug 22 12:59:30 juju-e4d256-prod-github-runner-207 kernel: [27344.575459] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:59:30 juju-e4d256-prod-github-runner-207 kernel: [27344.576511] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 12:59:30 juju-e4d256-prod-github-runner-207 kernel: [27344.577599] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:59:30 juju-e4d256-prod-github-runner-207 kernel: [27344.578712] ? show_regs.part.0+0x23/0x29 Aug 22 12:59:30 juju-e4d256-prod-github-runner-207 kernel: [27344.579766] ? show_regs.cold+0x8/0xd Aug 22 12:59:30 juju-e4d256-prod-github-runner-207 kernel: [27344.580754] ? watchdog_timer_fn+0x1be/0x220 Aug 22 12:59:30 juju-e4d256-prod-github-runner-207 kernel: [27344.581817] ? lockup_detector_update_enable+0x60/0x60 Aug 22 12:59:30 juju-e4d256-prod-github-runner-207 kernel: [27344.582959] ? __hrtimer_run_queues+0x107/0x230 Aug 22 12:59:30 juju-e4d256-prod-github-runner-207 kernel: [27344.584048] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 12:59:30 juju-e4d256-prod-github-runner-207 kernel: [27344.585121] ? hrtimer_interrupt+0x101/0x220 Aug 22 12:59:30 juju-e4d256-prod-github-runner-207 kernel: [27344.586147] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 12:59:30 juju-e4d256-prod-github-runner-207 kernel: [27344.587293] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 12:59:30 juju-e4d256-prod-github-runner-207 kernel: [27344.588468] Aug 22 12:59:30 juju-e4d256-prod-github-runner-207 kernel: [27344.589360] Aug 22 12:59:30 juju-e4d256-prod-github-runner-207 kernel: [27344.590234] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 12:59:30 juju-e4d256-prod-github-runner-207 kernel: [27344.591319] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:59:30 juju-e4d256-prod-github-runner-207 kernel: [27344.592377] ? _raw_spin_lock+0x22/0x30 Aug 22 12:59:30 juju-e4d256-prod-github-runner-207 kernel: [27344.593560] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:59:30 juju-e4d256-prod-github-runner-207 kernel: [27344.594911] direct_page_fault+0x206/0x310 [kvm] Aug 22 12:59:30 juju-e4d256-prod-github-runner-207 kernel: [27344.596073] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 12:59:30 juju-e4d256-prod-github-runner-207 kernel: [27344.597146] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 12:59:30 juju-e4d256-prod-github-runner-207 kernel: [27344.598302] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 12:59:30 juju-e4d256-prod-github-runner-207 kernel: [27344.599422] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 12:59:30 juju-e4d256-prod-github-runner-207 kernel: [27344.600864] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 12:59:30 juju-e4d256-prod-github-runner-207 kernel: [27344.602385] handle_exit+0x98/0x230 [kvm_amd] Aug 22 12:59:30 juju-e4d256-prod-github-runner-207 kernel: [27344.603397] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 12:59:30 juju-e4d256-prod-github-runner-207 kernel: [27344.604344] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 12:59:30 juju-e4d256-prod-github-runner-207 kernel: [27344.605438] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 12:59:30 juju-e4d256-prod-github-runner-207 kernel: [27344.606370] vcpu_run+0x62/0x2c0 [kvm] Aug 22 12:59:30 juju-e4d256-prod-github-runner-207 kernel: [27344.607242] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 12:59:30 juju-e4d256-prod-github-runner-207 kernel: [27344.608080] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 12:59:30 juju-e4d256-prod-github-runner-207 kernel: [27344.608971] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 12:59:30 juju-e4d256-prod-github-runner-207 kernel: [27344.609785] ? __seccomp_filter+0x4a/0x4a0 Aug 22 12:59:30 juju-e4d256-prod-github-runner-207 kernel: [27344.610597] ? __fget_files+0x86/0xc0 Aug 22 12:59:30 juju-e4d256-prod-github-runner-207 kernel: [27344.611353] __x64_sys_ioctl+0x95/0xd0 Aug 22 12:59:30 juju-e4d256-prod-github-runner-207 kernel: [27344.612126] do_syscall_64+0x5c/0xc0 Aug 22 12:59:30 juju-e4d256-prod-github-runner-207 kernel: [27344.613171] ? do_futex+0x162/0x1f0 Aug 22 12:59:30 juju-e4d256-prod-github-runner-207 kernel: [27344.614193] ? __x64_sys_futex+0x78/0x1e0 Aug 22 12:59:30 juju-e4d256-prod-github-runner-207 kernel: [27344.615285] ? __secure_computing+0xa9/0x120 Aug 22 12:59:30 juju-e4d256-prod-github-runner-207 kernel: [27344.616348] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 12:59:30 juju-e4d256-prod-github-runner-207 kernel: [27344.617299] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:59:30 juju-e4d256-prod-github-runner-207 kernel: [27344.618087] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:59:30 juju-e4d256-prod-github-runner-207 kernel: [27344.618874] ? do_syscall_64+0x69/0xc0 Aug 22 12:59:30 juju-e4d256-prod-github-runner-207 kernel: [27344.619817] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:59:30 juju-e4d256-prod-github-runner-207 kernel: [27344.620529] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:59:30 juju-e4d256-prod-github-runner-207 kernel: [27344.621226] ? do_syscall_64+0x69/0xc0 Aug 22 12:59:30 juju-e4d256-prod-github-runner-207 kernel: [27344.621858] ? do_syscall_64+0x69/0xc0 Aug 22 12:59:30 juju-e4d256-prod-github-runner-207 kernel: [27344.622482] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 12:59:30 juju-e4d256-prod-github-runner-207 kernel: [27344.623205] RIP: 0033:0x7faa5d0edaff Aug 22 12:59:30 juju-e4d256-prod-github-runner-207 kernel: [27344.623839] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 12:59:30 juju-e4d256-prod-github-runner-207 kernel: [27344.625827] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 12:59:30 juju-e4d256-prod-github-runner-207 kernel: [27344.626740] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 12:59:30 juju-e4d256-prod-github-runner-207 kernel: [27344.627687] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 12:59:30 juju-e4d256-prod-github-runner-207 kernel: [27344.628585] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 12:59:30 juju-e4d256-prod-github-runner-207 kernel: [27344.629504] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 12:59:30 juju-e4d256-prod-github-runner-207 kernel: [27344.630403] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 12:59:30 juju-e4d256-prod-github-runner-207 kernel: [27344.631322] Aug 22 12:59:45 juju-e4d256-prod-github-runner-207 kernel: [27359.012710] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 12:59:45 juju-e4d256-prod-github-runner-207 kernel: [27359.013711] rcu: 1-....: (6789229 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=3283211 Aug 22 12:59:45 juju-e4d256-prod-github-runner-207 kernel: [27359.014978] (t=6810453 jiffies g=23269 q=31427) Aug 22 12:59:45 juju-e4d256-prod-github-runner-207 kernel: [27359.015948] NMI backtrace for cpu 1 Aug 22 12:59:45 juju-e4d256-prod-github-runner-207 kernel: [27359.016670] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 12:59:45 juju-e4d256-prod-github-runner-207 kernel: [27359.017779] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 12:59:45 juju-e4d256-prod-github-runner-207 kernel: [27359.018854] Call Trace: Aug 22 12:59:45 juju-e4d256-prod-github-runner-207 kernel: [27359.019546] Aug 22 12:59:45 juju-e4d256-prod-github-runner-207 kernel: [27359.020191] show_stack+0x52/0x5c Aug 22 12:59:45 juju-e4d256-prod-github-runner-207 kernel: [27359.020915] dump_stack_lvl+0x4a/0x63 Aug 22 12:59:45 juju-e4d256-prod-github-runner-207 kernel: [27359.021661] dump_stack+0x10/0x16 Aug 22 12:59:45 juju-e4d256-prod-github-runner-207 kernel: [27359.022408] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 12:59:45 juju-e4d256-prod-github-runner-207 kernel: [27359.023208] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 12:59:45 juju-e4d256-prod-github-runner-207 kernel: [27359.023999] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 12:59:45 juju-e4d256-prod-github-runner-207 kernel: [27359.024816] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 12:59:45 juju-e4d256-prod-github-runner-207 kernel: [27359.025631] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 12:59:45 juju-e4d256-prod-github-runner-207 kernel: [27359.026451] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 12:59:45 juju-e4d256-prod-github-runner-207 kernel: [27359.027296] print_cpu_stall.cold+0x2f/0xe2 Aug 22 12:59:45 juju-e4d256-prod-github-runner-207 kernel: [27359.028070] ? timekeeping_update+0xf7/0x150 Aug 22 12:59:45 juju-e4d256-prod-github-runner-207 kernel: [27359.028863] check_cpu_stall+0x109/0x270 Aug 22 12:59:45 juju-e4d256-prod-github-runner-207 kernel: [27359.029611] rcu_sched_clock_irq+0x9a/0x250 Aug 22 12:59:45 juju-e4d256-prod-github-runner-207 kernel: [27359.030369] update_process_times+0x94/0xd0 Aug 22 12:59:45 juju-e4d256-prod-github-runner-207 kernel: [27359.031166] tick_sched_handle+0x29/0x70 Aug 22 12:59:45 juju-e4d256-prod-github-runner-207 kernel: [27359.031913] tick_sched_timer+0x8c/0xc0 Aug 22 12:59:45 juju-e4d256-prod-github-runner-207 kernel: [27359.032649] ? tick_nohz_handler+0xb0/0xb0 Aug 22 12:59:45 juju-e4d256-prod-github-runner-207 kernel: [27359.033402] __hrtimer_run_queues+0x107/0x230 Aug 22 12:59:45 juju-e4d256-prod-github-runner-207 kernel: [27359.034172] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 12:59:45 juju-e4d256-prod-github-runner-207 kernel: [27359.034959] hrtimer_interrupt+0x101/0x220 Aug 22 12:59:45 juju-e4d256-prod-github-runner-207 kernel: [27359.035713] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 12:59:45 juju-e4d256-prod-github-runner-207 kernel: [27359.036520] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 12:59:45 juju-e4d256-prod-github-runner-207 kernel: [27359.037318] Aug 22 12:59:45 juju-e4d256-prod-github-runner-207 kernel: [27359.037951] Aug 22 12:59:45 juju-e4d256-prod-github-runner-207 kernel: [27359.038577] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 12:59:45 juju-e4d256-prod-github-runner-207 kernel: [27359.039409] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 12:59:45 juju-e4d256-prod-github-runner-207 kernel: [27359.040283] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 12:59:45 juju-e4d256-prod-github-runner-207 kernel: [27359.042498] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 12:59:45 juju-e4d256-prod-github-runner-207 kernel: [27359.043419] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 12:59:45 juju-e4d256-prod-github-runner-207 kernel: [27359.044411] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 12:59:45 juju-e4d256-prod-github-runner-207 kernel: [27359.045385] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 12:59:45 juju-e4d256-prod-github-runner-207 kernel: [27359.046345] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 12:59:45 juju-e4d256-prod-github-runner-207 kernel: [27359.047314] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 12:59:45 juju-e4d256-prod-github-runner-207 kernel: [27359.048280] ? _raw_spin_lock+0x22/0x30 Aug 22 12:59:45 juju-e4d256-prod-github-runner-207 kernel: [27359.049037] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 12:59:45 juju-e4d256-prod-github-runner-207 kernel: [27359.049890] direct_page_fault+0x206/0x310 [kvm] Aug 22 12:59:45 juju-e4d256-prod-github-runner-207 kernel: [27359.050724] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 12:59:45 juju-e4d256-prod-github-runner-207 kernel: [27359.051570] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 12:59:45 juju-e4d256-prod-github-runner-207 kernel: [27359.052392] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 12:59:45 juju-e4d256-prod-github-runner-207 kernel: [27359.053194] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 12:59:45 juju-e4d256-prod-github-runner-207 kernel: [27359.054020] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 12:59:45 juju-e4d256-prod-github-runner-207 kernel: [27359.054846] handle_exit+0x98/0x230 [kvm_amd] Aug 22 12:59:45 juju-e4d256-prod-github-runner-207 kernel: [27359.055628] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 12:59:45 juju-e4d256-prod-github-runner-207 kernel: [27359.056412] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 12:59:45 juju-e4d256-prod-github-runner-207 kernel: [27359.057211] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 12:59:45 juju-e4d256-prod-github-runner-207 kernel: [27359.057999] vcpu_run+0x62/0x2c0 [kvm] Aug 22 12:59:45 juju-e4d256-prod-github-runner-207 kernel: [27359.058712] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 12:59:45 juju-e4d256-prod-github-runner-207 kernel: [27359.059468] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 12:59:45 juju-e4d256-prod-github-runner-207 kernel: [27359.060269] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 12:59:45 juju-e4d256-prod-github-runner-207 kernel: [27359.061058] ? __seccomp_filter+0x4a/0x4a0 Aug 22 12:59:45 juju-e4d256-prod-github-runner-207 kernel: [27359.061776] ? __fget_files+0x86/0xc0 Aug 22 12:59:45 juju-e4d256-prod-github-runner-207 kernel: [27359.062534] __x64_sys_ioctl+0x95/0xd0 Aug 22 12:59:45 juju-e4d256-prod-github-runner-207 kernel: [27359.063381] do_syscall_64+0x5c/0xc0 Aug 22 12:59:45 juju-e4d256-prod-github-runner-207 kernel: [27359.064072] ? do_futex+0x162/0x1f0 Aug 22 12:59:45 juju-e4d256-prod-github-runner-207 kernel: [27359.064742] ? __x64_sys_futex+0x78/0x1e0 Aug 22 12:59:45 juju-e4d256-prod-github-runner-207 kernel: [27359.065445] ? __secure_computing+0xa9/0x120 Aug 22 12:59:45 juju-e4d256-prod-github-runner-207 kernel: [27359.066158] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 12:59:45 juju-e4d256-prod-github-runner-207 kernel: [27359.066965] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:59:45 juju-e4d256-prod-github-runner-207 kernel: [27359.067714] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:59:45 juju-e4d256-prod-github-runner-207 kernel: [27359.068462] ? do_syscall_64+0x69/0xc0 Aug 22 12:59:45 juju-e4d256-prod-github-runner-207 kernel: [27359.069147] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 12:59:45 juju-e4d256-prod-github-runner-207 kernel: [27359.069899] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 12:59:45 juju-e4d256-prod-github-runner-207 kernel: [27359.070678] ? do_syscall_64+0x69/0xc0 Aug 22 12:59:45 juju-e4d256-prod-github-runner-207 kernel: [27359.071442] ? do_syscall_64+0x69/0xc0 Aug 22 12:59:45 juju-e4d256-prod-github-runner-207 kernel: [27359.072133] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 12:59:45 juju-e4d256-prod-github-runner-207 kernel: [27359.072908] RIP: 0033:0x7faa5d0edaff Aug 22 12:59:45 juju-e4d256-prod-github-runner-207 kernel: [27359.073591] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 12:59:45 juju-e4d256-prod-github-runner-207 kernel: [27359.075738] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 12:59:45 juju-e4d256-prod-github-runner-207 kernel: [27359.077014] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 12:59:45 juju-e4d256-prod-github-runner-207 kernel: [27359.078356] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 12:59:45 juju-e4d256-prod-github-runner-207 kernel: [27359.079618] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 12:59:45 juju-e4d256-prod-github-runner-207 kernel: [27359.080936] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 12:59:45 juju-e4d256-prod-github-runner-207 kernel: [27359.082000] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 12:59:45 juju-e4d256-prod-github-runner-207 kernel: [27359.083218] Aug 22 13:00:10 juju-e4d256-prod-github-runner-207 kernel: [27384.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 25395s! [qemu-system-x86:6715] Aug 22 13:00:10 juju-e4d256-prod-github-runner-207 kernel: [27384.543950] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 13:00:10 juju-e4d256-prod-github-runner-207 kernel: [27384.544263] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 13:00:10 juju-e4d256-prod-github-runner-207 kernel: [27384.556658] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 13:00:10 juju-e4d256-prod-github-runner-207 kernel: [27384.558057] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 13:00:10 juju-e4d256-prod-github-runner-207 kernel: [27384.559339] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:00:10 juju-e4d256-prod-github-runner-207 kernel: [27384.560430] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 13:00:10 juju-e4d256-prod-github-runner-207 kernel: [27384.563099] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 13:00:10 juju-e4d256-prod-github-runner-207 kernel: [27384.564176] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 13:00:10 juju-e4d256-prod-github-runner-207 kernel: [27384.565381] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 13:00:10 juju-e4d256-prod-github-runner-207 kernel: [27384.566748] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 13:00:10 juju-e4d256-prod-github-runner-207 kernel: [27384.568025] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 13:00:10 juju-e4d256-prod-github-runner-207 kernel: [27384.569420] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 13:00:10 juju-e4d256-prod-github-runner-207 kernel: [27384.570718] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 13:00:10 juju-e4d256-prod-github-runner-207 kernel: [27384.572443] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 13:00:10 juju-e4d256-prod-github-runner-207 kernel: [27384.573660] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 13:00:10 juju-e4d256-prod-github-runner-207 kernel: [27384.574946] Call Trace: Aug 22 13:00:10 juju-e4d256-prod-github-runner-207 kernel: [27384.575938] Aug 22 13:00:10 juju-e4d256-prod-github-runner-207 kernel: [27384.576871] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:00:10 juju-e4d256-prod-github-runner-207 kernel: [27384.577975] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:00:10 juju-e4d256-prod-github-runner-207 kernel: [27384.579328] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:00:10 juju-e4d256-prod-github-runner-207 kernel: [27384.581098] ? show_regs.part.0+0x23/0x29 Aug 22 13:00:10 juju-e4d256-prod-github-runner-207 kernel: [27384.582722] ? show_regs.cold+0x8/0xd Aug 22 13:00:10 juju-e4d256-prod-github-runner-207 kernel: [27384.583792] ? watchdog_timer_fn+0x1be/0x220 Aug 22 13:00:10 juju-e4d256-prod-github-runner-207 kernel: [27384.584827] ? lockup_detector_update_enable+0x60/0x60 Aug 22 13:00:10 juju-e4d256-prod-github-runner-207 kernel: [27384.585916] ? __hrtimer_run_queues+0x107/0x230 Aug 22 13:00:10 juju-e4d256-prod-github-runner-207 kernel: [27384.587001] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 13:00:10 juju-e4d256-prod-github-runner-207 kernel: [27384.588089] ? hrtimer_interrupt+0x101/0x220 Aug 22 13:00:10 juju-e4d256-prod-github-runner-207 kernel: [27384.589498] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 13:00:10 juju-e4d256-prod-github-runner-207 kernel: [27384.590601] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 13:00:10 juju-e4d256-prod-github-runner-207 kernel: [27384.591887] Aug 22 13:00:10 juju-e4d256-prod-github-runner-207 kernel: [27384.592763] Aug 22 13:00:10 juju-e4d256-prod-github-runner-207 kernel: [27384.593609] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 13:00:10 juju-e4d256-prod-github-runner-207 kernel: [27384.594677] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:00:10 juju-e4d256-prod-github-runner-207 kernel: [27384.595757] ? _raw_spin_lock+0x22/0x30 Aug 22 13:00:10 juju-e4d256-prod-github-runner-207 kernel: [27384.596734] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:00:10 juju-e4d256-prod-github-runner-207 kernel: [27384.597791] direct_page_fault+0x206/0x310 [kvm] Aug 22 13:00:10 juju-e4d256-prod-github-runner-207 kernel: [27384.598908] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 13:00:10 juju-e4d256-prod-github-runner-207 kernel: [27384.599968] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 13:00:10 juju-e4d256-prod-github-runner-207 kernel: [27384.600989] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 13:00:10 juju-e4d256-prod-github-runner-207 kernel: [27384.602023] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 13:00:10 juju-e4d256-prod-github-runner-207 kernel: [27384.603059] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 13:00:10 juju-e4d256-prod-github-runner-207 kernel: [27384.604089] handle_exit+0x98/0x230 [kvm_amd] Aug 22 13:00:10 juju-e4d256-prod-github-runner-207 kernel: [27384.605519] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 13:00:10 juju-e4d256-prod-github-runner-207 kernel: [27384.606983] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 13:00:10 juju-e4d256-prod-github-runner-207 kernel: [27384.608453] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 13:00:10 juju-e4d256-prod-github-runner-207 kernel: [27384.609395] vcpu_run+0x62/0x2c0 [kvm] Aug 22 13:00:10 juju-e4d256-prod-github-runner-207 kernel: [27384.610237] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 13:00:10 juju-e4d256-prod-github-runner-207 kernel: [27384.611113] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 13:00:10 juju-e4d256-prod-github-runner-207 kernel: [27384.611996] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 13:00:10 juju-e4d256-prod-github-runner-207 kernel: [27384.612848] ? __seccomp_filter+0x4a/0x4a0 Aug 22 13:00:10 juju-e4d256-prod-github-runner-207 kernel: [27384.613650] ? __fget_files+0x86/0xc0 Aug 22 13:00:10 juju-e4d256-prod-github-runner-207 kernel: [27384.614366] __x64_sys_ioctl+0x95/0xd0 Aug 22 13:00:10 juju-e4d256-prod-github-runner-207 kernel: [27384.615115] do_syscall_64+0x5c/0xc0 Aug 22 13:00:10 juju-e4d256-prod-github-runner-207 kernel: [27384.615803] ? do_futex+0x162/0x1f0 Aug 22 13:00:10 juju-e4d256-prod-github-runner-207 kernel: [27384.616461] ? __x64_sys_futex+0x78/0x1e0 Aug 22 13:00:10 juju-e4d256-prod-github-runner-207 kernel: [27384.617144] ? __secure_computing+0xa9/0x120 Aug 22 13:00:10 juju-e4d256-prod-github-runner-207 kernel: [27384.617851] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 13:00:10 juju-e4d256-prod-github-runner-207 kernel: [27384.618649] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:00:10 juju-e4d256-prod-github-runner-207 kernel: [27384.619414] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:00:10 juju-e4d256-prod-github-runner-207 kernel: [27384.620150] ? do_syscall_64+0x69/0xc0 Aug 22 13:00:10 juju-e4d256-prod-github-runner-207 kernel: [27384.620990] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:00:10 juju-e4d256-prod-github-runner-207 kernel: [27384.621739] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:00:10 juju-e4d256-prod-github-runner-207 kernel: [27384.622513] ? do_syscall_64+0x69/0xc0 Aug 22 13:00:10 juju-e4d256-prod-github-runner-207 kernel: [27384.623207] ? do_syscall_64+0x69/0xc0 Aug 22 13:00:10 juju-e4d256-prod-github-runner-207 kernel: [27384.623845] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 13:00:10 juju-e4d256-prod-github-runner-207 kernel: [27384.624596] RIP: 0033:0x7faa5d0edaff Aug 22 13:00:10 juju-e4d256-prod-github-runner-207 kernel: [27384.625275] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 13:00:10 juju-e4d256-prod-github-runner-207 kernel: [27384.628149] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 13:00:10 juju-e4d256-prod-github-runner-207 kernel: [27384.629541] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 13:00:10 juju-e4d256-prod-github-runner-207 kernel: [27384.630569] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 13:00:10 juju-e4d256-prod-github-runner-207 kernel: [27384.631662] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 13:00:10 juju-e4d256-prod-github-runner-207 kernel: [27384.632669] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 13:00:10 juju-e4d256-prod-github-runner-207 kernel: [27384.633665] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 13:00:10 juju-e4d256-prod-github-runner-207 kernel: [27384.634576] Aug 22 13:00:38 juju-e4d256-prod-github-runner-207 kernel: [27412.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 25421s! [qemu-system-x86:6715] Aug 22 13:00:38 juju-e4d256-prod-github-runner-207 kernel: [27412.543134] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 13:00:38 juju-e4d256-prod-github-runner-207 kernel: [27412.543210] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 13:00:38 juju-e4d256-prod-github-runner-207 kernel: [27412.555741] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 13:00:38 juju-e4d256-prod-github-runner-207 kernel: [27412.557023] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 13:00:38 juju-e4d256-prod-github-runner-207 kernel: [27412.558274] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:00:38 juju-e4d256-prod-github-runner-207 kernel: [27412.559372] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 13:00:38 juju-e4d256-prod-github-runner-207 kernel: [27412.561979] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 13:00:38 juju-e4d256-prod-github-runner-207 kernel: [27412.563068] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 13:00:38 juju-e4d256-prod-github-runner-207 kernel: [27412.564240] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 13:00:38 juju-e4d256-prod-github-runner-207 kernel: [27412.565414] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 13:00:38 juju-e4d256-prod-github-runner-207 kernel: [27412.566614] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 13:00:38 juju-e4d256-prod-github-runner-207 kernel: [27412.567808] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 13:00:38 juju-e4d256-prod-github-runner-207 kernel: [27412.568982] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 13:00:38 juju-e4d256-prod-github-runner-207 kernel: [27412.570276] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 13:00:38 juju-e4d256-prod-github-runner-207 kernel: [27412.571423] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 13:00:38 juju-e4d256-prod-github-runner-207 kernel: [27412.572639] Call Trace: Aug 22 13:00:38 juju-e4d256-prod-github-runner-207 kernel: [27412.573556] Aug 22 13:00:38 juju-e4d256-prod-github-runner-207 kernel: [27412.574474] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:00:38 juju-e4d256-prod-github-runner-207 kernel: [27412.575517] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:00:38 juju-e4d256-prod-github-runner-207 kernel: [27412.576553] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:00:38 juju-e4d256-prod-github-runner-207 kernel: [27412.577650] ? show_regs.part.0+0x23/0x29 Aug 22 13:00:38 juju-e4d256-prod-github-runner-207 kernel: [27412.578685] ? show_regs.cold+0x8/0xd Aug 22 13:00:38 juju-e4d256-prod-github-runner-207 kernel: [27412.579685] ? watchdog_timer_fn+0x1be/0x220 Aug 22 13:00:38 juju-e4d256-prod-github-runner-207 kernel: [27412.580713] ? lockup_detector_update_enable+0x60/0x60 Aug 22 13:00:38 juju-e4d256-prod-github-runner-207 kernel: [27412.581800] ? __hrtimer_run_queues+0x107/0x230 Aug 22 13:00:38 juju-e4d256-prod-github-runner-207 kernel: [27412.582856] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 13:00:38 juju-e4d256-prod-github-runner-207 kernel: [27412.583888] ? hrtimer_interrupt+0x101/0x220 Aug 22 13:00:38 juju-e4d256-prod-github-runner-207 kernel: [27412.584908] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 13:00:38 juju-e4d256-prod-github-runner-207 kernel: [27412.585982] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 13:00:38 juju-e4d256-prod-github-runner-207 kernel: [27412.587059] Aug 22 13:00:38 juju-e4d256-prod-github-runner-207 kernel: [27412.587915] Aug 22 13:00:38 juju-e4d256-prod-github-runner-207 kernel: [27412.588761] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 13:00:38 juju-e4d256-prod-github-runner-207 kernel: [27412.589815] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:00:38 juju-e4d256-prod-github-runner-207 kernel: [27412.590931] ? _raw_spin_lock+0x22/0x30 Aug 22 13:00:38 juju-e4d256-prod-github-runner-207 kernel: [27412.591886] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:00:38 juju-e4d256-prod-github-runner-207 kernel: [27412.592917] direct_page_fault+0x206/0x310 [kvm] Aug 22 13:00:38 juju-e4d256-prod-github-runner-207 kernel: [27412.593953] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 13:00:38 juju-e4d256-prod-github-runner-207 kernel: [27412.594990] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 13:00:38 juju-e4d256-prod-github-runner-207 kernel: [27412.596009] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 13:00:38 juju-e4d256-prod-github-runner-207 kernel: [27412.597006] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 13:00:38 juju-e4d256-prod-github-runner-207 kernel: [27412.597965] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 13:00:38 juju-e4d256-prod-github-runner-207 kernel: [27412.598977] handle_exit+0x98/0x230 [kvm_amd] Aug 22 13:00:38 juju-e4d256-prod-github-runner-207 kernel: [27412.599881] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 13:00:38 juju-e4d256-prod-github-runner-207 kernel: [27412.600842] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 13:00:38 juju-e4d256-prod-github-runner-207 kernel: [27412.601781] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 13:00:38 juju-e4d256-prod-github-runner-207 kernel: [27412.602707] vcpu_run+0x62/0x2c0 [kvm] Aug 22 13:00:38 juju-e4d256-prod-github-runner-207 kernel: [27412.603529] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 13:00:38 juju-e4d256-prod-github-runner-207 kernel: [27412.604344] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 13:00:38 juju-e4d256-prod-github-runner-207 kernel: [27412.605203] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 13:00:38 juju-e4d256-prod-github-runner-207 kernel: [27412.606007] ? __seccomp_filter+0x4a/0x4a0 Aug 22 13:00:38 juju-e4d256-prod-github-runner-207 kernel: [27412.606765] ? __fget_files+0x86/0xc0 Aug 22 13:00:38 juju-e4d256-prod-github-runner-207 kernel: [27412.607477] __x64_sys_ioctl+0x95/0xd0 Aug 22 13:00:38 juju-e4d256-prod-github-runner-207 kernel: [27412.608189] do_syscall_64+0x5c/0xc0 Aug 22 13:00:38 juju-e4d256-prod-github-runner-207 kernel: [27412.608860] ? do_futex+0x162/0x1f0 Aug 22 13:00:38 juju-e4d256-prod-github-runner-207 kernel: [27412.609520] ? __x64_sys_futex+0x78/0x1e0 Aug 22 13:00:38 juju-e4d256-prod-github-runner-207 kernel: [27412.610199] ? __secure_computing+0xa9/0x120 Aug 22 13:00:38 juju-e4d256-prod-github-runner-207 kernel: [27412.610936] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 13:00:38 juju-e4d256-prod-github-runner-207 kernel: [27412.611711] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:00:38 juju-e4d256-prod-github-runner-207 kernel: [27412.612443] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:00:38 juju-e4d256-prod-github-runner-207 kernel: [27412.613171] ? do_syscall_64+0x69/0xc0 Aug 22 13:00:38 juju-e4d256-prod-github-runner-207 kernel: [27412.613829] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:00:38 juju-e4d256-prod-github-runner-207 kernel: [27412.614576] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:00:38 juju-e4d256-prod-github-runner-207 kernel: [27412.615282] ? do_syscall_64+0x69/0xc0 Aug 22 13:00:38 juju-e4d256-prod-github-runner-207 kernel: [27412.615920] ? do_syscall_64+0x69/0xc0 Aug 22 13:00:38 juju-e4d256-prod-github-runner-207 kernel: [27412.616554] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 13:00:38 juju-e4d256-prod-github-runner-207 kernel: [27412.617271] RIP: 0033:0x7faa5d0edaff Aug 22 13:00:38 juju-e4d256-prod-github-runner-207 kernel: [27412.617919] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 13:00:38 juju-e4d256-prod-github-runner-207 kernel: [27412.619980] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 13:00:38 juju-e4d256-prod-github-runner-207 kernel: [27412.620927] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 13:00:38 juju-e4d256-prod-github-runner-207 kernel: [27412.621834] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 13:00:38 juju-e4d256-prod-github-runner-207 kernel: [27412.622769] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 13:00:38 juju-e4d256-prod-github-runner-207 kernel: [27412.623677] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 13:00:38 juju-e4d256-prod-github-runner-207 kernel: [27412.624597] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 13:00:38 juju-e4d256-prod-github-runner-207 kernel: [27412.625499] Aug 22 13:01:06 juju-e4d256-prod-github-runner-207 kernel: [27440.541976] watchdog: BUG: soft lockup - CPU#1 stuck for 25447s! [qemu-system-x86:6715] Aug 22 13:01:06 juju-e4d256-prod-github-runner-207 kernel: [27440.543147] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 13:01:06 juju-e4d256-prod-github-runner-207 kernel: [27440.543217] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 13:01:06 juju-e4d256-prod-github-runner-207 kernel: [27440.555563] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 13:01:06 juju-e4d256-prod-github-runner-207 kernel: [27440.556830] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 13:01:06 juju-e4d256-prod-github-runner-207 kernel: [27440.558058] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:01:06 juju-e4d256-prod-github-runner-207 kernel: [27440.559128] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 13:01:06 juju-e4d256-prod-github-runner-207 kernel: [27440.561719] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 13:01:06 juju-e4d256-prod-github-runner-207 kernel: [27440.562838] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 13:01:06 juju-e4d256-prod-github-runner-207 kernel: [27440.564000] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 13:01:06 juju-e4d256-prod-github-runner-207 kernel: [27440.565158] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 13:01:06 juju-e4d256-prod-github-runner-207 kernel: [27440.566335] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 13:01:06 juju-e4d256-prod-github-runner-207 kernel: [27440.567495] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 13:01:06 juju-e4d256-prod-github-runner-207 kernel: [27440.568662] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 13:01:06 juju-e4d256-prod-github-runner-207 kernel: [27440.569904] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 13:01:06 juju-e4d256-prod-github-runner-207 kernel: [27440.571021] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 13:01:06 juju-e4d256-prod-github-runner-207 kernel: [27440.572227] Call Trace: Aug 22 13:01:06 juju-e4d256-prod-github-runner-207 kernel: [27440.573139] Aug 22 13:01:06 juju-e4d256-prod-github-runner-207 kernel: [27440.574031] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:01:06 juju-e4d256-prod-github-runner-207 kernel: [27440.575066] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:01:06 juju-e4d256-prod-github-runner-207 kernel: [27440.576085] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:01:06 juju-e4d256-prod-github-runner-207 kernel: [27440.577157] ? show_regs.part.0+0x23/0x29 Aug 22 13:01:06 juju-e4d256-prod-github-runner-207 kernel: [27440.578164] ? show_regs.cold+0x8/0xd Aug 22 13:01:06 juju-e4d256-prod-github-runner-207 kernel: [27440.579143] ? watchdog_timer_fn+0x1be/0x220 Aug 22 13:01:06 juju-e4d256-prod-github-runner-207 kernel: [27440.580156] ? lockup_detector_update_enable+0x60/0x60 Aug 22 13:01:06 juju-e4d256-prod-github-runner-207 kernel: [27440.581217] ? __hrtimer_run_queues+0x107/0x230 Aug 22 13:01:06 juju-e4d256-prod-github-runner-207 kernel: [27440.582257] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 13:01:06 juju-e4d256-prod-github-runner-207 kernel: [27440.583279] ? hrtimer_interrupt+0x101/0x220 Aug 22 13:01:06 juju-e4d256-prod-github-runner-207 kernel: [27440.584301] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 13:01:06 juju-e4d256-prod-github-runner-207 kernel: [27440.585370] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 13:01:06 juju-e4d256-prod-github-runner-207 kernel: [27440.586426] Aug 22 13:01:06 juju-e4d256-prod-github-runner-207 kernel: [27440.587279] Aug 22 13:01:06 juju-e4d256-prod-github-runner-207 kernel: [27440.588114] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 13:01:06 juju-e4d256-prod-github-runner-207 kernel: [27440.589146] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:01:06 juju-e4d256-prod-github-runner-207 kernel: [27440.590205] ? _raw_spin_lock+0x22/0x30 Aug 22 13:01:06 juju-e4d256-prod-github-runner-207 kernel: [27440.591169] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:01:06 juju-e4d256-prod-github-runner-207 kernel: [27440.592378] direct_page_fault+0x206/0x310 [kvm] Aug 22 13:01:06 juju-e4d256-prod-github-runner-207 kernel: [27440.593401] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 13:01:06 juju-e4d256-prod-github-runner-207 kernel: [27440.594477] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 13:01:06 juju-e4d256-prod-github-runner-207 kernel: [27440.595490] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 13:01:06 juju-e4d256-prod-github-runner-207 kernel: [27440.596462] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 13:01:06 juju-e4d256-prod-github-runner-207 kernel: [27440.597415] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 13:01:06 juju-e4d256-prod-github-runner-207 kernel: [27440.598434] handle_exit+0x98/0x230 [kvm_amd] Aug 22 13:01:06 juju-e4d256-prod-github-runner-207 kernel: [27440.599355] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 13:01:06 juju-e4d256-prod-github-runner-207 kernel: [27440.600276] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 13:01:06 juju-e4d256-prod-github-runner-207 kernel: [27440.601218] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 13:01:06 juju-e4d256-prod-github-runner-207 kernel: [27440.602146] vcpu_run+0x62/0x2c0 [kvm] Aug 22 13:01:06 juju-e4d256-prod-github-runner-207 kernel: [27440.602961] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 13:01:06 juju-e4d256-prod-github-runner-207 kernel: [27440.603797] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 13:01:06 juju-e4d256-prod-github-runner-207 kernel: [27440.604703] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 13:01:06 juju-e4d256-prod-github-runner-207 kernel: [27440.605508] ? __seccomp_filter+0x4a/0x4a0 Aug 22 13:01:06 juju-e4d256-prod-github-runner-207 kernel: [27440.606272] ? __fget_files+0x86/0xc0 Aug 22 13:01:06 juju-e4d256-prod-github-runner-207 kernel: [27440.606977] __x64_sys_ioctl+0x95/0xd0 Aug 22 13:01:06 juju-e4d256-prod-github-runner-207 kernel: [27440.607672] do_syscall_64+0x5c/0xc0 Aug 22 13:01:06 juju-e4d256-prod-github-runner-207 kernel: [27440.608347] ? do_futex+0x162/0x1f0 Aug 22 13:01:06 juju-e4d256-prod-github-runner-207 kernel: [27440.609015] ? __x64_sys_futex+0x78/0x1e0 Aug 22 13:01:06 juju-e4d256-prod-github-runner-207 kernel: [27440.609707] ? __secure_computing+0xa9/0x120 Aug 22 13:01:06 juju-e4d256-prod-github-runner-207 kernel: [27440.610460] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 13:01:06 juju-e4d256-prod-github-runner-207 kernel: [27440.611232] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:01:06 juju-e4d256-prod-github-runner-207 kernel: [27440.611954] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:01:06 juju-e4d256-prod-github-runner-207 kernel: [27440.612686] ? do_syscall_64+0x69/0xc0 Aug 22 13:01:06 juju-e4d256-prod-github-runner-207 kernel: [27440.613363] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:01:06 juju-e4d256-prod-github-runner-207 kernel: [27440.614112] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:01:06 juju-e4d256-prod-github-runner-207 kernel: [27440.614828] ? do_syscall_64+0x69/0xc0 Aug 22 13:01:06 juju-e4d256-prod-github-runner-207 kernel: [27440.615461] ? do_syscall_64+0x69/0xc0 Aug 22 13:01:06 juju-e4d256-prod-github-runner-207 kernel: [27440.616120] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 13:01:06 juju-e4d256-prod-github-runner-207 kernel: [27440.616837] RIP: 0033:0x7faa5d0edaff Aug 22 13:01:06 juju-e4d256-prod-github-runner-207 kernel: [27440.617513] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 13:01:06 juju-e4d256-prod-github-runner-207 kernel: [27440.619646] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 13:01:06 juju-e4d256-prod-github-runner-207 kernel: [27440.620574] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 13:01:06 juju-e4d256-prod-github-runner-207 kernel: [27440.621481] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 13:01:06 juju-e4d256-prod-github-runner-207 kernel: [27440.622407] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 13:01:06 juju-e4d256-prod-github-runner-207 kernel: [27440.623304] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 13:01:06 juju-e4d256-prod-github-runner-207 kernel: [27440.624202] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 13:01:06 juju-e4d256-prod-github-runner-207 kernel: [27440.625145] Aug 22 13:01:34 juju-e4d256-prod-github-runner-207 kernel: [27468.541981] watchdog: BUG: soft lockup - CPU#1 stuck for 25474s! [qemu-system-x86:6715] Aug 22 13:01:34 juju-e4d256-prod-github-runner-207 kernel: [27468.543239] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 13:01:34 juju-e4d256-prod-github-runner-207 kernel: [27468.543500] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 13:01:34 juju-e4d256-prod-github-runner-207 kernel: [27468.555964] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 13:01:34 juju-e4d256-prod-github-runner-207 kernel: [27468.557267] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 13:01:34 juju-e4d256-prod-github-runner-207 kernel: [27468.558533] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:01:34 juju-e4d256-prod-github-runner-207 kernel: [27468.559607] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 13:01:34 juju-e4d256-prod-github-runner-207 kernel: [27468.562227] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 13:01:34 juju-e4d256-prod-github-runner-207 kernel: [27468.563287] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 13:01:34 juju-e4d256-prod-github-runner-207 kernel: [27468.564467] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 13:01:34 juju-e4d256-prod-github-runner-207 kernel: [27468.565680] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 13:01:34 juju-e4d256-prod-github-runner-207 kernel: [27468.566868] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 13:01:34 juju-e4d256-prod-github-runner-207 kernel: [27468.568054] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 13:01:34 juju-e4d256-prod-github-runner-207 kernel: [27468.569235] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 13:01:34 juju-e4d256-prod-github-runner-207 kernel: [27468.570509] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 13:01:34 juju-e4d256-prod-github-runner-207 kernel: [27468.571627] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 13:01:34 juju-e4d256-prod-github-runner-207 kernel: [27468.572865] Call Trace: Aug 22 13:01:34 juju-e4d256-prod-github-runner-207 kernel: [27468.573844] Aug 22 13:01:34 juju-e4d256-prod-github-runner-207 kernel: [27468.574747] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:01:34 juju-e4d256-prod-github-runner-207 kernel: [27468.575792] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:01:34 juju-e4d256-prod-github-runner-207 kernel: [27468.576829] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:01:34 juju-e4d256-prod-github-runner-207 kernel: [27468.577966] ? show_regs.part.0+0x23/0x29 Aug 22 13:01:34 juju-e4d256-prod-github-runner-207 kernel: [27468.578978] ? show_regs.cold+0x8/0xd Aug 22 13:01:34 juju-e4d256-prod-github-runner-207 kernel: [27468.579962] ? watchdog_timer_fn+0x1be/0x220 Aug 22 13:01:34 juju-e4d256-prod-github-runner-207 kernel: [27468.580987] ? lockup_detector_update_enable+0x60/0x60 Aug 22 13:01:34 juju-e4d256-prod-github-runner-207 kernel: [27468.582116] ? __hrtimer_run_queues+0x107/0x230 Aug 22 13:01:34 juju-e4d256-prod-github-runner-207 kernel: [27468.583171] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 13:01:34 juju-e4d256-prod-github-runner-207 kernel: [27468.584205] ? hrtimer_interrupt+0x101/0x220 Aug 22 13:01:34 juju-e4d256-prod-github-runner-207 kernel: [27468.585232] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 13:01:34 juju-e4d256-prod-github-runner-207 kernel: [27468.586339] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 13:01:34 juju-e4d256-prod-github-runner-207 kernel: [27468.587393] Aug 22 13:01:34 juju-e4d256-prod-github-runner-207 kernel: [27468.588254] Aug 22 13:01:34 juju-e4d256-prod-github-runner-207 kernel: [27468.589095] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 13:01:34 juju-e4d256-prod-github-runner-207 kernel: [27468.590172] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:01:34 juju-e4d256-prod-github-runner-207 kernel: [27468.591224] ? _raw_spin_lock+0x22/0x30 Aug 22 13:01:34 juju-e4d256-prod-github-runner-207 kernel: [27468.592180] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:01:34 juju-e4d256-prod-github-runner-207 kernel: [27468.593215] direct_page_fault+0x206/0x310 [kvm] Aug 22 13:01:34 juju-e4d256-prod-github-runner-207 kernel: [27468.594266] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 13:01:34 juju-e4d256-prod-github-runner-207 kernel: [27468.595306] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 13:01:34 juju-e4d256-prod-github-runner-207 kernel: [27468.596329] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 13:01:34 juju-e4d256-prod-github-runner-207 kernel: [27468.597343] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 13:01:34 juju-e4d256-prod-github-runner-207 kernel: [27468.598332] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 13:01:34 juju-e4d256-prod-github-runner-207 kernel: [27468.599357] handle_exit+0x98/0x230 [kvm_amd] Aug 22 13:01:34 juju-e4d256-prod-github-runner-207 kernel: [27468.600270] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 13:01:34 juju-e4d256-prod-github-runner-207 kernel: [27468.601200] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 13:01:34 juju-e4d256-prod-github-runner-207 kernel: [27468.602156] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 13:01:34 juju-e4d256-prod-github-runner-207 kernel: [27468.603074] vcpu_run+0x62/0x2c0 [kvm] Aug 22 13:01:34 juju-e4d256-prod-github-runner-207 kernel: [27468.603899] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 13:01:34 juju-e4d256-prod-github-runner-207 kernel: [27468.604731] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 13:01:34 juju-e4d256-prod-github-runner-207 kernel: [27468.605706] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 13:01:34 juju-e4d256-prod-github-runner-207 kernel: [27468.606545] ? __seccomp_filter+0x4a/0x4a0 Aug 22 13:01:34 juju-e4d256-prod-github-runner-207 kernel: [27468.607454] ? __fget_files+0x86/0xc0 Aug 22 13:01:34 juju-e4d256-prod-github-runner-207 kernel: [27468.608175] __x64_sys_ioctl+0x95/0xd0 Aug 22 13:01:34 juju-e4d256-prod-github-runner-207 kernel: [27468.608875] do_syscall_64+0x5c/0xc0 Aug 22 13:01:34 juju-e4d256-prod-github-runner-207 kernel: [27468.609548] ? do_futex+0x162/0x1f0 Aug 22 13:01:34 juju-e4d256-prod-github-runner-207 kernel: [27468.610238] ? __x64_sys_futex+0x78/0x1e0 Aug 22 13:01:34 juju-e4d256-prod-github-runner-207 kernel: [27468.611080] ? __secure_computing+0xa9/0x120 Aug 22 13:01:34 juju-e4d256-prod-github-runner-207 kernel: [27468.611791] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 13:01:34 juju-e4d256-prod-github-runner-207 kernel: [27468.612568] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:01:34 juju-e4d256-prod-github-runner-207 kernel: [27468.613322] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:01:34 juju-e4d256-prod-github-runner-207 kernel: [27468.614074] ? do_syscall_64+0x69/0xc0 Aug 22 13:01:34 juju-e4d256-prod-github-runner-207 kernel: [27468.614734] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:01:34 juju-e4d256-prod-github-runner-207 kernel: [27468.615451] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:01:34 juju-e4d256-prod-github-runner-207 kernel: [27468.616160] ? do_syscall_64+0x69/0xc0 Aug 22 13:01:34 juju-e4d256-prod-github-runner-207 kernel: [27468.616796] ? do_syscall_64+0x69/0xc0 Aug 22 13:01:34 juju-e4d256-prod-github-runner-207 kernel: [27468.617437] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 13:01:34 juju-e4d256-prod-github-runner-207 kernel: [27468.618173] RIP: 0033:0x7faa5d0edaff Aug 22 13:01:34 juju-e4d256-prod-github-runner-207 kernel: [27468.618843] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 13:01:34 juju-e4d256-prod-github-runner-207 kernel: [27468.620890] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 13:01:34 juju-e4d256-prod-github-runner-207 kernel: [27468.621834] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 13:01:34 juju-e4d256-prod-github-runner-207 kernel: [27468.622742] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 13:01:34 juju-e4d256-prod-github-runner-207 kernel: [27468.623659] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 13:01:34 juju-e4d256-prod-github-runner-207 kernel: [27468.624566] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 13:01:34 juju-e4d256-prod-github-runner-207 kernel: [27468.625495] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 13:01:34 juju-e4d256-prod-github-runner-207 kernel: [27468.626438] Aug 22 13:02:02 juju-e4d256-prod-github-runner-207 kernel: [27496.541980] watchdog: BUG: soft lockup - CPU#1 stuck for 25500s! [qemu-system-x86:6715] Aug 22 13:02:02 juju-e4d256-prod-github-runner-207 kernel: [27496.543768] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 13:02:02 juju-e4d256-prod-github-runner-207 kernel: [27496.543947] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 13:02:02 juju-e4d256-prod-github-runner-207 kernel: [27496.556401] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 13:02:02 juju-e4d256-prod-github-runner-207 kernel: [27496.557738] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 13:02:02 juju-e4d256-prod-github-runner-207 kernel: [27496.558963] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:02:02 juju-e4d256-prod-github-runner-207 kernel: [27496.560030] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 13:02:02 juju-e4d256-prod-github-runner-207 kernel: [27496.562796] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 13:02:02 juju-e4d256-prod-github-runner-207 kernel: [27496.563859] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 13:02:02 juju-e4d256-prod-github-runner-207 kernel: [27496.565023] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 13:02:02 juju-e4d256-prod-github-runner-207 kernel: [27496.566198] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 13:02:02 juju-e4d256-prod-github-runner-207 kernel: [27496.567380] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 13:02:02 juju-e4d256-prod-github-runner-207 kernel: [27496.568566] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 13:02:02 juju-e4d256-prod-github-runner-207 kernel: [27496.569754] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 13:02:02 juju-e4d256-prod-github-runner-207 kernel: [27496.570990] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 13:02:02 juju-e4d256-prod-github-runner-207 kernel: [27496.572109] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 13:02:02 juju-e4d256-prod-github-runner-207 kernel: [27496.574259] Call Trace: Aug 22 13:02:02 juju-e4d256-prod-github-runner-207 kernel: [27496.575233] Aug 22 13:02:02 juju-e4d256-prod-github-runner-207 kernel: [27496.576143] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:02:02 juju-e4d256-prod-github-runner-207 kernel: [27496.577192] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:02:02 juju-e4d256-prod-github-runner-207 kernel: [27496.578257] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:02:02 juju-e4d256-prod-github-runner-207 kernel: [27496.579350] ? show_regs.part.0+0x23/0x29 Aug 22 13:02:02 juju-e4d256-prod-github-runner-207 kernel: [27496.580351] ? show_regs.cold+0x8/0xd Aug 22 13:02:02 juju-e4d256-prod-github-runner-207 kernel: [27496.581338] ? watchdog_timer_fn+0x1be/0x220 Aug 22 13:02:02 juju-e4d256-prod-github-runner-207 kernel: [27496.582367] ? lockup_detector_update_enable+0x60/0x60 Aug 22 13:02:02 juju-e4d256-prod-github-runner-207 kernel: [27496.583471] ? __hrtimer_run_queues+0x107/0x230 Aug 22 13:02:02 juju-e4d256-prod-github-runner-207 kernel: [27496.584611] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 13:02:02 juju-e4d256-prod-github-runner-207 kernel: [27496.585675] ? hrtimer_interrupt+0x101/0x220 Aug 22 13:02:02 juju-e4d256-prod-github-runner-207 kernel: [27496.586695] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 13:02:02 juju-e4d256-prod-github-runner-207 kernel: [27496.587778] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 13:02:02 juju-e4d256-prod-github-runner-207 kernel: [27496.588841] Aug 22 13:02:02 juju-e4d256-prod-github-runner-207 kernel: [27496.589719] Aug 22 13:02:02 juju-e4d256-prod-github-runner-207 kernel: [27496.590562] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 13:02:02 juju-e4d256-prod-github-runner-207 kernel: [27496.591603] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:02:02 juju-e4d256-prod-github-runner-207 kernel: [27496.592673] ? _raw_spin_lock+0x22/0x30 Aug 22 13:02:02 juju-e4d256-prod-github-runner-207 kernel: [27496.593653] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:02:02 juju-e4d256-prod-github-runner-207 kernel: [27496.594685] direct_page_fault+0x206/0x310 [kvm] Aug 22 13:02:02 juju-e4d256-prod-github-runner-207 kernel: [27496.595712] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 13:02:02 juju-e4d256-prod-github-runner-207 kernel: [27496.596724] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 13:02:02 juju-e4d256-prod-github-runner-207 kernel: [27496.597750] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 13:02:02 juju-e4d256-prod-github-runner-207 kernel: [27496.598758] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 13:02:02 juju-e4d256-prod-github-runner-207 kernel: [27496.599712] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 13:02:02 juju-e4d256-prod-github-runner-207 kernel: [27496.600691] handle_exit+0x98/0x230 [kvm_amd] Aug 22 13:02:02 juju-e4d256-prod-github-runner-207 kernel: [27496.601612] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 13:02:02 juju-e4d256-prod-github-runner-207 kernel: [27496.602712] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 13:02:02 juju-e4d256-prod-github-runner-207 kernel: [27496.603652] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 13:02:02 juju-e4d256-prod-github-runner-207 kernel: [27496.604629] vcpu_run+0x62/0x2c0 [kvm] Aug 22 13:02:02 juju-e4d256-prod-github-runner-207 kernel: [27496.605469] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 13:02:02 juju-e4d256-prod-github-runner-207 kernel: [27496.606283] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 13:02:02 juju-e4d256-prod-github-runner-207 kernel: [27496.607141] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 13:02:02 juju-e4d256-prod-github-runner-207 kernel: [27496.607941] ? __seccomp_filter+0x4a/0x4a0 Aug 22 13:02:02 juju-e4d256-prod-github-runner-207 kernel: [27496.608734] ? __fget_files+0x86/0xc0 Aug 22 13:02:02 juju-e4d256-prod-github-runner-207 kernel: [27496.609477] __x64_sys_ioctl+0x95/0xd0 Aug 22 13:02:02 juju-e4d256-prod-github-runner-207 kernel: [27496.610207] do_syscall_64+0x5c/0xc0 Aug 22 13:02:02 juju-e4d256-prod-github-runner-207 kernel: [27496.610910] ? do_futex+0x162/0x1f0 Aug 22 13:02:02 juju-e4d256-prod-github-runner-207 kernel: [27496.611581] ? __x64_sys_futex+0x78/0x1e0 Aug 22 13:02:02 juju-e4d256-prod-github-runner-207 kernel: [27496.612256] ? __secure_computing+0xa9/0x120 Aug 22 13:02:02 juju-e4d256-prod-github-runner-207 kernel: [27496.612976] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 13:02:02 juju-e4d256-prod-github-runner-207 kernel: [27496.613829] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:02:02 juju-e4d256-prod-github-runner-207 kernel: [27496.614627] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:02:02 juju-e4d256-prod-github-runner-207 kernel: [27496.615356] ? do_syscall_64+0x69/0xc0 Aug 22 13:02:02 juju-e4d256-prod-github-runner-207 kernel: [27496.616027] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:02:02 juju-e4d256-prod-github-runner-207 kernel: [27496.616731] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:02:02 juju-e4d256-prod-github-runner-207 kernel: [27496.617462] ? do_syscall_64+0x69/0xc0 Aug 22 13:02:02 juju-e4d256-prod-github-runner-207 kernel: [27496.618098] ? do_syscall_64+0x69/0xc0 Aug 22 13:02:02 juju-e4d256-prod-github-runner-207 kernel: [27496.618753] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 13:02:02 juju-e4d256-prod-github-runner-207 kernel: [27496.619469] RIP: 0033:0x7faa5d0edaff Aug 22 13:02:02 juju-e4d256-prod-github-runner-207 kernel: [27496.620382] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 13:02:02 juju-e4d256-prod-github-runner-207 kernel: [27496.622609] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 13:02:02 juju-e4d256-prod-github-runner-207 kernel: [27496.623584] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 13:02:02 juju-e4d256-prod-github-runner-207 kernel: [27496.624487] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 13:02:02 juju-e4d256-prod-github-runner-207 kernel: [27496.625602] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 13:02:02 juju-e4d256-prod-github-runner-207 kernel: [27496.626503] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 13:02:02 juju-e4d256-prod-github-runner-207 kernel: [27496.627392] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 13:02:02 juju-e4d256-prod-github-runner-207 kernel: [27496.628288] Aug 22 13:02:30 juju-e4d256-prod-github-runner-207 kernel: [27524.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 25526s! [qemu-system-x86:6715] Aug 22 13:02:30 juju-e4d256-prod-github-runner-207 kernel: [27524.543114] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 13:02:30 juju-e4d256-prod-github-runner-207 kernel: [27524.543187] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 13:02:30 juju-e4d256-prod-github-runner-207 kernel: [27524.555929] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 13:02:30 juju-e4d256-prod-github-runner-207 kernel: [27524.557220] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 13:02:30 juju-e4d256-prod-github-runner-207 kernel: [27524.558455] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:02:30 juju-e4d256-prod-github-runner-207 kernel: [27524.559555] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 13:02:30 juju-e4d256-prod-github-runner-207 kernel: [27524.562120] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 13:02:30 juju-e4d256-prod-github-runner-207 kernel: [27524.563170] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 13:02:30 juju-e4d256-prod-github-runner-207 kernel: [27524.564380] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 13:02:30 juju-e4d256-prod-github-runner-207 kernel: [27524.565561] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 13:02:30 juju-e4d256-prod-github-runner-207 kernel: [27524.566722] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 13:02:30 juju-e4d256-prod-github-runner-207 kernel: [27524.567898] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 13:02:30 juju-e4d256-prod-github-runner-207 kernel: [27524.569105] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 13:02:30 juju-e4d256-prod-github-runner-207 kernel: [27524.570358] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 13:02:30 juju-e4d256-prod-github-runner-207 kernel: [27524.571454] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 13:02:30 juju-e4d256-prod-github-runner-207 kernel: [27524.572651] Call Trace: Aug 22 13:02:30 juju-e4d256-prod-github-runner-207 kernel: [27524.573590] Aug 22 13:02:30 juju-e4d256-prod-github-runner-207 kernel: [27524.574485] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:02:30 juju-e4d256-prod-github-runner-207 kernel: [27524.575536] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:02:30 juju-e4d256-prod-github-runner-207 kernel: [27524.576565] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:02:30 juju-e4d256-prod-github-runner-207 kernel: [27524.577654] ? show_regs.part.0+0x23/0x29 Aug 22 13:02:30 juju-e4d256-prod-github-runner-207 kernel: [27524.578653] ? show_regs.cold+0x8/0xd Aug 22 13:02:30 juju-e4d256-prod-github-runner-207 kernel: [27524.579648] ? watchdog_timer_fn+0x1be/0x220 Aug 22 13:02:30 juju-e4d256-prod-github-runner-207 kernel: [27524.580694] ? lockup_detector_update_enable+0x60/0x60 Aug 22 13:02:30 juju-e4d256-prod-github-runner-207 kernel: [27524.581783] ? __hrtimer_run_queues+0x107/0x230 Aug 22 13:02:30 juju-e4d256-prod-github-runner-207 kernel: [27524.582814] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 13:02:30 juju-e4d256-prod-github-runner-207 kernel: [27524.583838] ? hrtimer_interrupt+0x101/0x220 Aug 22 13:02:30 juju-e4d256-prod-github-runner-207 kernel: [27524.584886] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 13:02:30 juju-e4d256-prod-github-runner-207 kernel: [27524.586005] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 13:02:30 juju-e4d256-prod-github-runner-207 kernel: [27524.587050] Aug 22 13:02:30 juju-e4d256-prod-github-runner-207 kernel: [27524.587902] Aug 22 13:02:30 juju-e4d256-prod-github-runner-207 kernel: [27524.588738] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 13:02:30 juju-e4d256-prod-github-runner-207 kernel: [27524.589817] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:02:30 juju-e4d256-prod-github-runner-207 kernel: [27524.590874] ? _raw_spin_lock+0x22/0x30 Aug 22 13:02:30 juju-e4d256-prod-github-runner-207 kernel: [27524.591826] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:02:30 juju-e4d256-prod-github-runner-207 kernel: [27524.592852] direct_page_fault+0x206/0x310 [kvm] Aug 22 13:02:30 juju-e4d256-prod-github-runner-207 kernel: [27524.593912] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 13:02:30 juju-e4d256-prod-github-runner-207 kernel: [27524.594941] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 13:02:30 juju-e4d256-prod-github-runner-207 kernel: [27524.595968] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 13:02:30 juju-e4d256-prod-github-runner-207 kernel: [27524.596958] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 13:02:30 juju-e4d256-prod-github-runner-207 kernel: [27524.597905] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 13:02:30 juju-e4d256-prod-github-runner-207 kernel: [27524.598884] handle_exit+0x98/0x230 [kvm_amd] Aug 22 13:02:30 juju-e4d256-prod-github-runner-207 kernel: [27524.599788] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 13:02:30 juju-e4d256-prod-github-runner-207 kernel: [27524.600721] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 13:02:30 juju-e4d256-prod-github-runner-207 kernel: [27524.601679] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 13:02:30 juju-e4d256-prod-github-runner-207 kernel: [27524.602583] vcpu_run+0x62/0x2c0 [kvm] Aug 22 13:02:30 juju-e4d256-prod-github-runner-207 kernel: [27524.603395] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 13:02:30 juju-e4d256-prod-github-runner-207 kernel: [27524.604208] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 13:02:30 juju-e4d256-prod-github-runner-207 kernel: [27524.605310] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 13:02:30 juju-e4d256-prod-github-runner-207 kernel: [27524.606135] ? __seccomp_filter+0x4a/0x4a0 Aug 22 13:02:30 juju-e4d256-prod-github-runner-207 kernel: [27524.606877] ? __fget_files+0x86/0xc0 Aug 22 13:02:30 juju-e4d256-prod-github-runner-207 kernel: [27524.607579] __x64_sys_ioctl+0x95/0xd0 Aug 22 13:02:30 juju-e4d256-prod-github-runner-207 kernel: [27524.608271] do_syscall_64+0x5c/0xc0 Aug 22 13:02:30 juju-e4d256-prod-github-runner-207 kernel: [27524.608965] ? do_futex+0x162/0x1f0 Aug 22 13:02:30 juju-e4d256-prod-github-runner-207 kernel: [27524.609650] ? __x64_sys_futex+0x78/0x1e0 Aug 22 13:02:30 juju-e4d256-prod-github-runner-207 kernel: [27524.610379] ? __secure_computing+0xa9/0x120 Aug 22 13:02:30 juju-e4d256-prod-github-runner-207 kernel: [27524.611123] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 13:02:30 juju-e4d256-prod-github-runner-207 kernel: [27524.611891] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:02:30 juju-e4d256-prod-github-runner-207 kernel: [27524.612620] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:02:30 juju-e4d256-prod-github-runner-207 kernel: [27524.613373] ? do_syscall_64+0x69/0xc0 Aug 22 13:02:30 juju-e4d256-prod-github-runner-207 kernel: [27524.614022] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:02:30 juju-e4d256-prod-github-runner-207 kernel: [27524.614730] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:02:30 juju-e4d256-prod-github-runner-207 kernel: [27524.615436] ? do_syscall_64+0x69/0xc0 Aug 22 13:02:30 juju-e4d256-prod-github-runner-207 kernel: [27524.616095] ? do_syscall_64+0x69/0xc0 Aug 22 13:02:30 juju-e4d256-prod-github-runner-207 kernel: [27524.616730] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 13:02:30 juju-e4d256-prod-github-runner-207 kernel: [27524.617451] RIP: 0033:0x7faa5d0edaff Aug 22 13:02:30 juju-e4d256-prod-github-runner-207 kernel: [27524.618078] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 13:02:30 juju-e4d256-prod-github-runner-207 kernel: [27524.620096] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 13:02:30 juju-e4d256-prod-github-runner-207 kernel: [27524.621033] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 13:02:30 juju-e4d256-prod-github-runner-207 kernel: [27524.621946] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 13:02:30 juju-e4d256-prod-github-runner-207 kernel: [27524.622847] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 13:02:30 juju-e4d256-prod-github-runner-207 kernel: [27524.623748] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 13:02:30 juju-e4d256-prod-github-runner-207 kernel: [27524.624666] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 13:02:30 juju-e4d256-prod-github-runner-207 kernel: [27524.625596] Aug 22 13:02:45 juju-e4d256-prod-github-runner-207 kernel: [27539.024714] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 13:02:45 juju-e4d256-prod-github-runner-207 kernel: [27539.025759] rcu: 1-....: (6834093 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=3304613 Aug 22 13:02:45 juju-e4d256-prod-github-runner-207 kernel: [27539.027068] (t=6855456 jiffies g=23269 q=31565) Aug 22 13:02:45 juju-e4d256-prod-github-runner-207 kernel: [27539.027944] NMI backtrace for cpu 1 Aug 22 13:02:45 juju-e4d256-prod-github-runner-207 kernel: [27539.028673] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 13:02:45 juju-e4d256-prod-github-runner-207 kernel: [27539.029824] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 13:02:45 juju-e4d256-prod-github-runner-207 kernel: [27539.030906] Call Trace: Aug 22 13:02:45 juju-e4d256-prod-github-runner-207 kernel: [27539.031586] Aug 22 13:02:45 juju-e4d256-prod-github-runner-207 kernel: [27539.032251] show_stack+0x52/0x5c Aug 22 13:02:45 juju-e4d256-prod-github-runner-207 kernel: [27539.033032] dump_stack_lvl+0x4a/0x63 Aug 22 13:02:45 juju-e4d256-prod-github-runner-207 kernel: [27539.033876] dump_stack+0x10/0x16 Aug 22 13:02:45 juju-e4d256-prod-github-runner-207 kernel: [27539.034760] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 13:02:45 juju-e4d256-prod-github-runner-207 kernel: [27539.035650] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 13:02:45 juju-e4d256-prod-github-runner-207 kernel: [27539.036535] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 13:02:45 juju-e4d256-prod-github-runner-207 kernel: [27539.037509] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 13:02:45 juju-e4d256-prod-github-runner-207 kernel: [27539.038461] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 13:02:45 juju-e4d256-prod-github-runner-207 kernel: [27539.039335] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 13:02:45 juju-e4d256-prod-github-runner-207 kernel: [27539.040169] print_cpu_stall.cold+0x2f/0xe2 Aug 22 13:02:45 juju-e4d256-prod-github-runner-207 kernel: [27539.041041] ? timekeeping_update+0xf7/0x150 Aug 22 13:02:45 juju-e4d256-prod-github-runner-207 kernel: [27539.041895] check_cpu_stall+0x109/0x270 Aug 22 13:02:45 juju-e4d256-prod-github-runner-207 kernel: [27539.042666] rcu_sched_clock_irq+0x9a/0x250 Aug 22 13:02:45 juju-e4d256-prod-github-runner-207 kernel: [27539.043527] update_process_times+0x94/0xd0 Aug 22 13:02:45 juju-e4d256-prod-github-runner-207 kernel: [27539.044375] tick_sched_handle+0x29/0x70 Aug 22 13:02:45 juju-e4d256-prod-github-runner-207 kernel: [27539.045220] tick_sched_timer+0x8c/0xc0 Aug 22 13:02:45 juju-e4d256-prod-github-runner-207 kernel: [27539.046072] ? tick_nohz_handler+0xb0/0xb0 Aug 22 13:02:45 juju-e4d256-prod-github-runner-207 kernel: [27539.046931] __hrtimer_run_queues+0x107/0x230 Aug 22 13:02:45 juju-e4d256-prod-github-runner-207 kernel: [27539.047731] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 13:02:45 juju-e4d256-prod-github-runner-207 kernel: [27539.048609] hrtimer_interrupt+0x101/0x220 Aug 22 13:02:45 juju-e4d256-prod-github-runner-207 kernel: [27539.049474] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 13:02:45 juju-e4d256-prod-github-runner-207 kernel: [27539.050379] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 13:02:45 juju-e4d256-prod-github-runner-207 kernel: [27539.051251] Aug 22 13:02:45 juju-e4d256-prod-github-runner-207 kernel: [27539.051960] Aug 22 13:02:45 juju-e4d256-prod-github-runner-207 kernel: [27539.052660] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 13:02:45 juju-e4d256-prod-github-runner-207 kernel: [27539.053598] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:02:45 juju-e4d256-prod-github-runner-207 kernel: [27539.054525] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 13:02:45 juju-e4d256-prod-github-runner-207 kernel: [27539.056956] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 13:02:45 juju-e4d256-prod-github-runner-207 kernel: [27539.057930] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 13:02:45 juju-e4d256-prod-github-runner-207 kernel: [27539.059021] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 13:02:45 juju-e4d256-prod-github-runner-207 kernel: [27539.060134] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 13:02:45 juju-e4d256-prod-github-runner-207 kernel: [27539.061189] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 13:02:45 juju-e4d256-prod-github-runner-207 kernel: [27539.062275] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 13:02:45 juju-e4d256-prod-github-runner-207 kernel: [27539.063355] ? _raw_spin_lock+0x22/0x30 Aug 22 13:02:45 juju-e4d256-prod-github-runner-207 kernel: [27539.064194] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:02:45 juju-e4d256-prod-github-runner-207 kernel: [27539.065148] direct_page_fault+0x206/0x310 [kvm] Aug 22 13:02:45 juju-e4d256-prod-github-runner-207 kernel: [27539.066076] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 13:02:45 juju-e4d256-prod-github-runner-207 kernel: [27539.067055] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 13:02:45 juju-e4d256-prod-github-runner-207 kernel: [27539.068088] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 13:02:45 juju-e4d256-prod-github-runner-207 kernel: [27539.069017] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 13:02:45 juju-e4d256-prod-github-runner-207 kernel: [27539.069886] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 13:02:45 juju-e4d256-prod-github-runner-207 kernel: [27539.070824] handle_exit+0x98/0x230 [kvm_amd] Aug 22 13:02:45 juju-e4d256-prod-github-runner-207 kernel: [27539.071663] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 13:02:45 juju-e4d256-prod-github-runner-207 kernel: [27539.072528] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 13:02:45 juju-e4d256-prod-github-runner-207 kernel: [27539.073456] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 13:02:45 juju-e4d256-prod-github-runner-207 kernel: [27539.074399] vcpu_run+0x62/0x2c0 [kvm] Aug 22 13:02:45 juju-e4d256-prod-github-runner-207 kernel: [27539.075232] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 13:02:45 juju-e4d256-prod-github-runner-207 kernel: [27539.076026] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 13:02:45 juju-e4d256-prod-github-runner-207 kernel: [27539.077003] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 13:02:45 juju-e4d256-prod-github-runner-207 kernel: [27539.077859] ? __seccomp_filter+0x4a/0x4a0 Aug 22 13:02:45 juju-e4d256-prod-github-runner-207 kernel: [27539.078647] ? __fget_files+0x86/0xc0 Aug 22 13:02:45 juju-e4d256-prod-github-runner-207 kernel: [27539.079541] __x64_sys_ioctl+0x95/0xd0 Aug 22 13:02:45 juju-e4d256-prod-github-runner-207 kernel: [27539.080347] do_syscall_64+0x5c/0xc0 Aug 22 13:02:45 juju-e4d256-prod-github-runner-207 kernel: [27539.081120] ? do_futex+0x162/0x1f0 Aug 22 13:02:45 juju-e4d256-prod-github-runner-207 kernel: [27539.081861] ? __x64_sys_futex+0x78/0x1e0 Aug 22 13:02:45 juju-e4d256-prod-github-runner-207 kernel: [27539.082636] ? __secure_computing+0xa9/0x120 Aug 22 13:02:45 juju-e4d256-prod-github-runner-207 kernel: [27539.083477] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 13:02:45 juju-e4d256-prod-github-runner-207 kernel: [27539.084415] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:02:45 juju-e4d256-prod-github-runner-207 kernel: [27539.085263] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:02:45 juju-e4d256-prod-github-runner-207 kernel: [27539.086102] ? do_syscall_64+0x69/0xc0 Aug 22 13:02:45 juju-e4d256-prod-github-runner-207 kernel: [27539.086854] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:02:45 juju-e4d256-prod-github-runner-207 kernel: [27539.087681] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:02:45 juju-e4d256-prod-github-runner-207 kernel: [27539.088548] ? do_syscall_64+0x69/0xc0 Aug 22 13:02:45 juju-e4d256-prod-github-runner-207 kernel: [27539.089318] ? do_syscall_64+0x69/0xc0 Aug 22 13:02:45 juju-e4d256-prod-github-runner-207 kernel: [27539.090068] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 13:02:45 juju-e4d256-prod-github-runner-207 kernel: [27539.090899] RIP: 0033:0x7faa5d0edaff Aug 22 13:02:45 juju-e4d256-prod-github-runner-207 kernel: [27539.091605] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 13:02:45 juju-e4d256-prod-github-runner-207 kernel: [27539.093912] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 13:02:45 juju-e4d256-prod-github-runner-207 kernel: [27539.094953] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 13:02:45 juju-e4d256-prod-github-runner-207 kernel: [27539.095975] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 13:02:45 juju-e4d256-prod-github-runner-207 kernel: [27539.097010] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 13:02:45 juju-e4d256-prod-github-runner-207 kernel: [27539.098079] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 13:02:45 juju-e4d256-prod-github-runner-207 kernel: [27539.099139] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 13:02:45 juju-e4d256-prod-github-runner-207 kernel: [27539.100328] Aug 22 13:03:10 juju-e4d256-prod-github-runner-207 kernel: [27564.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 25563s! [qemu-system-x86:6715] Aug 22 13:03:10 juju-e4d256-prod-github-runner-207 kernel: [27564.543800] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 13:03:10 juju-e4d256-prod-github-runner-207 kernel: [27564.544090] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 13:03:10 juju-e4d256-prod-github-runner-207 kernel: [27564.556479] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 13:03:10 juju-e4d256-prod-github-runner-207 kernel: [27564.557758] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 13:03:10 juju-e4d256-prod-github-runner-207 kernel: [27564.559068] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:03:10 juju-e4d256-prod-github-runner-207 kernel: [27564.560125] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 13:03:10 juju-e4d256-prod-github-runner-207 kernel: [27564.562750] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 13:03:10 juju-e4d256-prod-github-runner-207 kernel: [27564.563864] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 13:03:10 juju-e4d256-prod-github-runner-207 kernel: [27564.565053] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 13:03:10 juju-e4d256-prod-github-runner-207 kernel: [27564.566223] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 13:03:10 juju-e4d256-prod-github-runner-207 kernel: [27564.567461] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 13:03:10 juju-e4d256-prod-github-runner-207 kernel: [27564.568707] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 13:03:10 juju-e4d256-prod-github-runner-207 kernel: [27564.569894] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 13:03:10 juju-e4d256-prod-github-runner-207 kernel: [27564.571141] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 13:03:10 juju-e4d256-prod-github-runner-207 kernel: [27564.572246] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 13:03:10 juju-e4d256-prod-github-runner-207 kernel: [27564.573481] Call Trace: Aug 22 13:03:10 juju-e4d256-prod-github-runner-207 kernel: [27564.574397] Aug 22 13:03:10 juju-e4d256-prod-github-runner-207 kernel: [27564.575322] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:03:10 juju-e4d256-prod-github-runner-207 kernel: [27564.576454] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:03:10 juju-e4d256-prod-github-runner-207 kernel: [27564.577531] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:03:10 juju-e4d256-prod-github-runner-207 kernel: [27564.578643] ? show_regs.part.0+0x23/0x29 Aug 22 13:03:10 juju-e4d256-prod-github-runner-207 kernel: [27564.579641] ? show_regs.cold+0x8/0xd Aug 22 13:03:10 juju-e4d256-prod-github-runner-207 kernel: [27564.580676] ? watchdog_timer_fn+0x1be/0x220 Aug 22 13:03:10 juju-e4d256-prod-github-runner-207 kernel: [27564.581873] ? lockup_detector_update_enable+0x60/0x60 Aug 22 13:03:10 juju-e4d256-prod-github-runner-207 kernel: [27564.582970] ? __hrtimer_run_queues+0x107/0x230 Aug 22 13:03:10 juju-e4d256-prod-github-runner-207 kernel: [27564.584085] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 13:03:10 juju-e4d256-prod-github-runner-207 kernel: [27564.585155] ? hrtimer_interrupt+0x101/0x220 Aug 22 13:03:10 juju-e4d256-prod-github-runner-207 kernel: [27564.586191] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 13:03:10 juju-e4d256-prod-github-runner-207 kernel: [27564.587329] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 13:03:10 juju-e4d256-prod-github-runner-207 kernel: [27564.588469] Aug 22 13:03:10 juju-e4d256-prod-github-runner-207 kernel: [27564.589352] Aug 22 13:03:10 juju-e4d256-prod-github-runner-207 kernel: [27564.590270] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 13:03:10 juju-e4d256-prod-github-runner-207 kernel: [27564.591768] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:03:10 juju-e4d256-prod-github-runner-207 kernel: [27564.593163] ? _raw_spin_lock+0x22/0x30 Aug 22 13:03:10 juju-e4d256-prod-github-runner-207 kernel: [27564.594151] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:03:10 juju-e4d256-prod-github-runner-207 kernel: [27564.595194] direct_page_fault+0x206/0x310 [kvm] Aug 22 13:03:10 juju-e4d256-prod-github-runner-207 kernel: [27564.596227] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 13:03:10 juju-e4d256-prod-github-runner-207 kernel: [27564.597267] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 13:03:10 juju-e4d256-prod-github-runner-207 kernel: [27564.598285] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 13:03:10 juju-e4d256-prod-github-runner-207 kernel: [27564.599308] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 13:03:10 juju-e4d256-prod-github-runner-207 kernel: [27564.600259] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 13:03:10 juju-e4d256-prod-github-runner-207 kernel: [27564.601261] handle_exit+0x98/0x230 [kvm_amd] Aug 22 13:03:10 juju-e4d256-prod-github-runner-207 kernel: [27564.602163] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 13:03:10 juju-e4d256-prod-github-runner-207 kernel: [27564.603092] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 13:03:10 juju-e4d256-prod-github-runner-207 kernel: [27564.604048] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 13:03:10 juju-e4d256-prod-github-runner-207 kernel: [27564.604989] vcpu_run+0x62/0x2c0 [kvm] Aug 22 13:03:10 juju-e4d256-prod-github-runner-207 kernel: [27564.605804] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 13:03:10 juju-e4d256-prod-github-runner-207 kernel: [27564.606621] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 13:03:10 juju-e4d256-prod-github-runner-207 kernel: [27564.607496] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 13:03:10 juju-e4d256-prod-github-runner-207 kernel: [27564.608295] ? __seccomp_filter+0x4a/0x4a0 Aug 22 13:03:10 juju-e4d256-prod-github-runner-207 kernel: [27564.609062] ? __fget_files+0x86/0xc0 Aug 22 13:03:10 juju-e4d256-prod-github-runner-207 kernel: [27564.609767] __x64_sys_ioctl+0x95/0xd0 Aug 22 13:03:10 juju-e4d256-prod-github-runner-207 kernel: [27564.610465] do_syscall_64+0x5c/0xc0 Aug 22 13:03:10 juju-e4d256-prod-github-runner-207 kernel: [27564.611140] ? do_futex+0x162/0x1f0 Aug 22 13:03:10 juju-e4d256-prod-github-runner-207 kernel: [27564.611791] ? __x64_sys_futex+0x78/0x1e0 Aug 22 13:03:10 juju-e4d256-prod-github-runner-207 kernel: [27564.612478] ? __secure_computing+0xa9/0x120 Aug 22 13:03:10 juju-e4d256-prod-github-runner-207 kernel: [27564.613170] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 13:03:10 juju-e4d256-prod-github-runner-207 kernel: [27564.613932] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:03:10 juju-e4d256-prod-github-runner-207 kernel: [27564.614665] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:03:10 juju-e4d256-prod-github-runner-207 kernel: [27564.615384] ? do_syscall_64+0x69/0xc0 Aug 22 13:03:10 juju-e4d256-prod-github-runner-207 kernel: [27564.616029] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:03:10 juju-e4d256-prod-github-runner-207 kernel: [27564.616764] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:03:10 juju-e4d256-prod-github-runner-207 kernel: [27564.617495] ? do_syscall_64+0x69/0xc0 Aug 22 13:03:10 juju-e4d256-prod-github-runner-207 kernel: [27564.618126] ? do_syscall_64+0x69/0xc0 Aug 22 13:03:10 juju-e4d256-prod-github-runner-207 kernel: [27564.618749] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 13:03:10 juju-e4d256-prod-github-runner-207 kernel: [27564.619458] RIP: 0033:0x7faa5d0edaff Aug 22 13:03:10 juju-e4d256-prod-github-runner-207 kernel: [27564.620145] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 13:03:10 juju-e4d256-prod-github-runner-207 kernel: [27564.622291] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 13:03:10 juju-e4d256-prod-github-runner-207 kernel: [27564.623263] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 13:03:10 juju-e4d256-prod-github-runner-207 kernel: [27564.624163] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 13:03:10 juju-e4d256-prod-github-runner-207 kernel: [27564.625119] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 13:03:10 juju-e4d256-prod-github-runner-207 kernel: [27564.626115] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 13:03:10 juju-e4d256-prod-github-runner-207 kernel: [27564.627046] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 13:03:10 juju-e4d256-prod-github-runner-207 kernel: [27564.628019] Aug 22 13:03:38 juju-e4d256-prod-github-runner-207 kernel: [27592.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 25589s! [qemu-system-x86:6715] Aug 22 13:03:38 juju-e4d256-prod-github-runner-207 kernel: [27592.543368] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 13:03:38 juju-e4d256-prod-github-runner-207 kernel: [27592.543446] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 13:03:38 juju-e4d256-prod-github-runner-207 kernel: [27592.556000] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 13:03:38 juju-e4d256-prod-github-runner-207 kernel: [27592.557295] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 13:03:38 juju-e4d256-prod-github-runner-207 kernel: [27592.558513] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:03:38 juju-e4d256-prod-github-runner-207 kernel: [27592.559573] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 13:03:38 juju-e4d256-prod-github-runner-207 kernel: [27592.562294] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 13:03:38 juju-e4d256-prod-github-runner-207 kernel: [27592.563338] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 13:03:38 juju-e4d256-prod-github-runner-207 kernel: [27592.564532] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 13:03:38 juju-e4d256-prod-github-runner-207 kernel: [27592.565720] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 13:03:38 juju-e4d256-prod-github-runner-207 kernel: [27592.566881] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 13:03:38 juju-e4d256-prod-github-runner-207 kernel: [27592.568163] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 13:03:38 juju-e4d256-prod-github-runner-207 kernel: [27592.569354] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 13:03:38 juju-e4d256-prod-github-runner-207 kernel: [27592.570592] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 13:03:38 juju-e4d256-prod-github-runner-207 kernel: [27592.571706] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 13:03:38 juju-e4d256-prod-github-runner-207 kernel: [27592.572932] Call Trace: Aug 22 13:03:38 juju-e4d256-prod-github-runner-207 kernel: [27592.573935] Aug 22 13:03:38 juju-e4d256-prod-github-runner-207 kernel: [27592.574841] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:03:38 juju-e4d256-prod-github-runner-207 kernel: [27592.575923] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:03:38 juju-e4d256-prod-github-runner-207 kernel: [27592.576990] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:03:38 juju-e4d256-prod-github-runner-207 kernel: [27592.578073] ? show_regs.part.0+0x23/0x29 Aug 22 13:03:38 juju-e4d256-prod-github-runner-207 kernel: [27592.579073] ? show_regs.cold+0x8/0xd Aug 22 13:03:38 juju-e4d256-prod-github-runner-207 kernel: [27592.580062] ? watchdog_timer_fn+0x1be/0x220 Aug 22 13:03:38 juju-e4d256-prod-github-runner-207 kernel: [27592.581066] ? lockup_detector_update_enable+0x60/0x60 Aug 22 13:03:38 juju-e4d256-prod-github-runner-207 kernel: [27592.582126] ? __hrtimer_run_queues+0x107/0x230 Aug 22 13:03:38 juju-e4d256-prod-github-runner-207 kernel: [27592.583149] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 13:03:38 juju-e4d256-prod-github-runner-207 kernel: [27592.584179] ? hrtimer_interrupt+0x101/0x220 Aug 22 13:03:38 juju-e4d256-prod-github-runner-207 kernel: [27592.585195] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 13:03:38 juju-e4d256-prod-github-runner-207 kernel: [27592.586276] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 13:03:38 juju-e4d256-prod-github-runner-207 kernel: [27592.587338] Aug 22 13:03:38 juju-e4d256-prod-github-runner-207 kernel: [27592.588236] Aug 22 13:03:38 juju-e4d256-prod-github-runner-207 kernel: [27592.589077] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 13:03:38 juju-e4d256-prod-github-runner-207 kernel: [27592.590107] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:03:38 juju-e4d256-prod-github-runner-207 kernel: [27592.591155] ? _raw_spin_lock+0x22/0x30 Aug 22 13:03:38 juju-e4d256-prod-github-runner-207 kernel: [27592.592129] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:03:38 juju-e4d256-prod-github-runner-207 kernel: [27592.593160] direct_page_fault+0x206/0x310 [kvm] Aug 22 13:03:38 juju-e4d256-prod-github-runner-207 kernel: [27592.594185] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 13:03:38 juju-e4d256-prod-github-runner-207 kernel: [27592.595190] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 13:03:38 juju-e4d256-prod-github-runner-207 kernel: [27592.596204] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 13:03:38 juju-e4d256-prod-github-runner-207 kernel: [27592.597174] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 13:03:38 juju-e4d256-prod-github-runner-207 kernel: [27592.598116] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 13:03:38 juju-e4d256-prod-github-runner-207 kernel: [27592.599088] handle_exit+0x98/0x230 [kvm_amd] Aug 22 13:03:38 juju-e4d256-prod-github-runner-207 kernel: [27592.599983] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 13:03:38 juju-e4d256-prod-github-runner-207 kernel: [27592.600922] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 13:03:38 juju-e4d256-prod-github-runner-207 kernel: [27592.601855] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 13:03:38 juju-e4d256-prod-github-runner-207 kernel: [27592.602759] vcpu_run+0x62/0x2c0 [kvm] Aug 22 13:03:38 juju-e4d256-prod-github-runner-207 kernel: [27592.603572] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 13:03:38 juju-e4d256-prod-github-runner-207 kernel: [27592.604400] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 13:03:38 juju-e4d256-prod-github-runner-207 kernel: [27592.605266] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 13:03:38 juju-e4d256-prod-github-runner-207 kernel: [27592.606064] ? __seccomp_filter+0x4a/0x4a0 Aug 22 13:03:38 juju-e4d256-prod-github-runner-207 kernel: [27592.606814] ? __fget_files+0x86/0xc0 Aug 22 13:03:38 juju-e4d256-prod-github-runner-207 kernel: [27592.607521] __x64_sys_ioctl+0x95/0xd0 Aug 22 13:03:38 juju-e4d256-prod-github-runner-207 kernel: [27592.608231] do_syscall_64+0x5c/0xc0 Aug 22 13:03:38 juju-e4d256-prod-github-runner-207 kernel: [27592.608896] ? do_futex+0x162/0x1f0 Aug 22 13:03:38 juju-e4d256-prod-github-runner-207 kernel: [27592.609579] ? __x64_sys_futex+0x78/0x1e0 Aug 22 13:03:38 juju-e4d256-prod-github-runner-207 kernel: [27592.610251] ? __secure_computing+0xa9/0x120 Aug 22 13:03:38 juju-e4d256-prod-github-runner-207 kernel: [27592.610939] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 13:03:38 juju-e4d256-prod-github-runner-207 kernel: [27592.611699] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:03:38 juju-e4d256-prod-github-runner-207 kernel: [27592.612443] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:03:38 juju-e4d256-prod-github-runner-207 kernel: [27592.613163] ? do_syscall_64+0x69/0xc0 Aug 22 13:03:38 juju-e4d256-prod-github-runner-207 kernel: [27592.613816] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:03:38 juju-e4d256-prod-github-runner-207 kernel: [27592.614638] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:03:38 juju-e4d256-prod-github-runner-207 kernel: [27592.615503] ? do_syscall_64+0x69/0xc0 Aug 22 13:03:38 juju-e4d256-prod-github-runner-207 kernel: [27592.616252] ? do_syscall_64+0x69/0xc0 Aug 22 13:03:38 juju-e4d256-prod-github-runner-207 kernel: [27592.616950] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 13:03:38 juju-e4d256-prod-github-runner-207 kernel: [27592.617755] RIP: 0033:0x7faa5d0edaff Aug 22 13:03:38 juju-e4d256-prod-github-runner-207 kernel: [27592.618450] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 13:03:38 juju-e4d256-prod-github-runner-207 kernel: [27592.620793] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 13:03:38 juju-e4d256-prod-github-runner-207 kernel: [27592.621845] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 13:03:38 juju-e4d256-prod-github-runner-207 kernel: [27592.622869] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 13:03:38 juju-e4d256-prod-github-runner-207 kernel: [27592.623915] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 13:03:38 juju-e4d256-prod-github-runner-207 kernel: [27592.624970] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 13:03:38 juju-e4d256-prod-github-runner-207 kernel: [27592.626038] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 13:03:38 juju-e4d256-prod-github-runner-207 kernel: [27592.627129] Aug 22 13:04:06 juju-e4d256-prod-github-runner-207 kernel: [27620.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 25615s! [qemu-system-x86:6715] Aug 22 13:04:06 juju-e4d256-prod-github-runner-207 kernel: [27620.543113] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 13:04:06 juju-e4d256-prod-github-runner-207 kernel: [27620.543190] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 13:04:06 juju-e4d256-prod-github-runner-207 kernel: [27620.555566] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 13:04:06 juju-e4d256-prod-github-runner-207 kernel: [27620.556840] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 13:04:06 juju-e4d256-prod-github-runner-207 kernel: [27620.558058] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:04:06 juju-e4d256-prod-github-runner-207 kernel: [27620.559116] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 13:04:06 juju-e4d256-prod-github-runner-207 kernel: [27620.561679] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 13:04:06 juju-e4d256-prod-github-runner-207 kernel: [27620.562719] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 13:04:06 juju-e4d256-prod-github-runner-207 kernel: [27620.563890] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 13:04:06 juju-e4d256-prod-github-runner-207 kernel: [27620.565052] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 13:04:06 juju-e4d256-prod-github-runner-207 kernel: [27620.566212] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 13:04:06 juju-e4d256-prod-github-runner-207 kernel: [27620.567369] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 13:04:06 juju-e4d256-prod-github-runner-207 kernel: [27620.568545] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 13:04:06 juju-e4d256-prod-github-runner-207 kernel: [27620.569778] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 13:04:06 juju-e4d256-prod-github-runner-207 kernel: [27620.570877] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 13:04:06 juju-e4d256-prod-github-runner-207 kernel: [27620.572190] Call Trace: Aug 22 13:04:06 juju-e4d256-prod-github-runner-207 kernel: [27620.573247] Aug 22 13:04:06 juju-e4d256-prod-github-runner-207 kernel: [27620.574135] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:04:06 juju-e4d256-prod-github-runner-207 kernel: [27620.575163] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:04:06 juju-e4d256-prod-github-runner-207 kernel: [27620.576192] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:04:06 juju-e4d256-prod-github-runner-207 kernel: [27620.577266] ? show_regs.part.0+0x23/0x29 Aug 22 13:04:06 juju-e4d256-prod-github-runner-207 kernel: [27620.578264] ? show_regs.cold+0x8/0xd Aug 22 13:04:06 juju-e4d256-prod-github-runner-207 kernel: [27620.579259] ? watchdog_timer_fn+0x1be/0x220 Aug 22 13:04:06 juju-e4d256-prod-github-runner-207 kernel: [27620.580275] ? lockup_detector_update_enable+0x60/0x60 Aug 22 13:04:06 juju-e4d256-prod-github-runner-207 kernel: [27620.581341] ? __hrtimer_run_queues+0x107/0x230 Aug 22 13:04:06 juju-e4d256-prod-github-runner-207 kernel: [27620.582370] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 13:04:06 juju-e4d256-prod-github-runner-207 kernel: [27620.583392] ? hrtimer_interrupt+0x101/0x220 Aug 22 13:04:06 juju-e4d256-prod-github-runner-207 kernel: [27620.584413] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 13:04:06 juju-e4d256-prod-github-runner-207 kernel: [27620.585485] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 13:04:06 juju-e4d256-prod-github-runner-207 kernel: [27620.586545] Aug 22 13:04:06 juju-e4d256-prod-github-runner-207 kernel: [27620.587401] Aug 22 13:04:06 juju-e4d256-prod-github-runner-207 kernel: [27620.588255] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 13:04:06 juju-e4d256-prod-github-runner-207 kernel: [27620.589285] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:04:06 juju-e4d256-prod-github-runner-207 kernel: [27620.590319] ? _raw_spin_lock+0x22/0x30 Aug 22 13:04:06 juju-e4d256-prod-github-runner-207 kernel: [27620.591262] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:04:06 juju-e4d256-prod-github-runner-207 kernel: [27620.592290] direct_page_fault+0x206/0x310 [kvm] Aug 22 13:04:06 juju-e4d256-prod-github-runner-207 kernel: [27620.593314] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 13:04:06 juju-e4d256-prod-github-runner-207 kernel: [27620.594319] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 13:04:06 juju-e4d256-prod-github-runner-207 kernel: [27620.595315] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 13:04:06 juju-e4d256-prod-github-runner-207 kernel: [27620.596290] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 13:04:06 juju-e4d256-prod-github-runner-207 kernel: [27620.597234] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 13:04:06 juju-e4d256-prod-github-runner-207 kernel: [27620.598208] handle_exit+0x98/0x230 [kvm_amd] Aug 22 13:04:06 juju-e4d256-prod-github-runner-207 kernel: [27620.599100] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 13:04:06 juju-e4d256-prod-github-runner-207 kernel: [27620.600046] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 13:04:06 juju-e4d256-prod-github-runner-207 kernel: [27620.600975] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 13:04:06 juju-e4d256-prod-github-runner-207 kernel: [27620.601876] vcpu_run+0x62/0x2c0 [kvm] Aug 22 13:04:06 juju-e4d256-prod-github-runner-207 kernel: [27620.602691] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 13:04:06 juju-e4d256-prod-github-runner-207 kernel: [27620.603496] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 13:04:06 juju-e4d256-prod-github-runner-207 kernel: [27620.604355] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 13:04:06 juju-e4d256-prod-github-runner-207 kernel: [27620.605148] ? __seccomp_filter+0x4a/0x4a0 Aug 22 13:04:06 juju-e4d256-prod-github-runner-207 kernel: [27620.605885] ? __fget_files+0x86/0xc0 Aug 22 13:04:06 juju-e4d256-prod-github-runner-207 kernel: [27620.606591] __x64_sys_ioctl+0x95/0xd0 Aug 22 13:04:06 juju-e4d256-prod-github-runner-207 kernel: [27620.607279] do_syscall_64+0x5c/0xc0 Aug 22 13:04:06 juju-e4d256-prod-github-runner-207 kernel: [27620.607949] ? do_futex+0x162/0x1f0 Aug 22 13:04:06 juju-e4d256-prod-github-runner-207 kernel: [27620.608601] ? __x64_sys_futex+0x78/0x1e0 Aug 22 13:04:06 juju-e4d256-prod-github-runner-207 kernel: [27620.609271] ? __secure_computing+0xa9/0x120 Aug 22 13:04:06 juju-e4d256-prod-github-runner-207 kernel: [27620.609959] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 13:04:06 juju-e4d256-prod-github-runner-207 kernel: [27620.610715] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:04:06 juju-e4d256-prod-github-runner-207 kernel: [27620.611433] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:04:06 juju-e4d256-prod-github-runner-207 kernel: [27620.612157] ? do_syscall_64+0x69/0xc0 Aug 22 13:04:06 juju-e4d256-prod-github-runner-207 kernel: [27620.612800] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:04:06 juju-e4d256-prod-github-runner-207 kernel: [27620.613500] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:04:06 juju-e4d256-prod-github-runner-207 kernel: [27620.614191] ? do_syscall_64+0x69/0xc0 Aug 22 13:04:06 juju-e4d256-prod-github-runner-207 kernel: [27620.614817] ? do_syscall_64+0x69/0xc0 Aug 22 13:04:06 juju-e4d256-prod-github-runner-207 kernel: [27620.615435] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 13:04:06 juju-e4d256-prod-github-runner-207 kernel: [27620.616143] RIP: 0033:0x7faa5d0edaff Aug 22 13:04:06 juju-e4d256-prod-github-runner-207 kernel: [27620.616764] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 13:04:06 juju-e4d256-prod-github-runner-207 kernel: [27620.618732] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 13:04:06 juju-e4d256-prod-github-runner-207 kernel: [27620.619637] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 13:04:06 juju-e4d256-prod-github-runner-207 kernel: [27620.620535] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 13:04:06 juju-e4d256-prod-github-runner-207 kernel: [27620.621419] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 13:04:06 juju-e4d256-prod-github-runner-207 kernel: [27620.622299] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 13:04:06 juju-e4d256-prod-github-runner-207 kernel: [27620.623180] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 13:04:06 juju-e4d256-prod-github-runner-207 kernel: [27620.624079] Aug 22 13:04:34 juju-e4d256-prod-github-runner-207 kernel: [27648.542141] watchdog: BUG: soft lockup - CPU#1 stuck for 25641s! [qemu-system-x86:6715] Aug 22 13:04:34 juju-e4d256-prod-github-runner-207 kernel: [27648.543302] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 13:04:34 juju-e4d256-prod-github-runner-207 kernel: [27648.543421] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 13:04:34 juju-e4d256-prod-github-runner-207 kernel: [27648.555513] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 13:04:34 juju-e4d256-prod-github-runner-207 kernel: [27648.556778] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 13:04:34 juju-e4d256-prod-github-runner-207 kernel: [27648.558007] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:04:34 juju-e4d256-prod-github-runner-207 kernel: [27648.559073] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 13:04:34 juju-e4d256-prod-github-runner-207 kernel: [27648.561630] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 13:04:34 juju-e4d256-prod-github-runner-207 kernel: [27648.562673] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 13:04:34 juju-e4d256-prod-github-runner-207 kernel: [27648.563850] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 13:04:34 juju-e4d256-prod-github-runner-207 kernel: [27648.565012] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 13:04:34 juju-e4d256-prod-github-runner-207 kernel: [27648.566168] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 13:04:34 juju-e4d256-prod-github-runner-207 kernel: [27648.567335] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 13:04:34 juju-e4d256-prod-github-runner-207 kernel: [27648.568500] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 13:04:34 juju-e4d256-prod-github-runner-207 kernel: [27648.569729] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 13:04:34 juju-e4d256-prod-github-runner-207 kernel: [27648.570836] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 13:04:34 juju-e4d256-prod-github-runner-207 kernel: [27648.572065] Call Trace: Aug 22 13:04:34 juju-e4d256-prod-github-runner-207 kernel: [27648.572984] Aug 22 13:04:34 juju-e4d256-prod-github-runner-207 kernel: [27648.573874] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:04:34 juju-e4d256-prod-github-runner-207 kernel: [27648.574947] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:04:34 juju-e4d256-prod-github-runner-207 kernel: [27648.575985] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:04:34 juju-e4d256-prod-github-runner-207 kernel: [27648.577068] ? show_regs.part.0+0x23/0x29 Aug 22 13:04:34 juju-e4d256-prod-github-runner-207 kernel: [27648.578064] ? show_regs.cold+0x8/0xd Aug 22 13:04:34 juju-e4d256-prod-github-runner-207 kernel: [27648.579034] ? watchdog_timer_fn+0x1be/0x220 Aug 22 13:04:34 juju-e4d256-prod-github-runner-207 kernel: [27648.580498] ? lockup_detector_update_enable+0x60/0x60 Aug 22 13:04:34 juju-e4d256-prod-github-runner-207 kernel: [27648.581570] ? __hrtimer_run_queues+0x107/0x230 Aug 22 13:04:34 juju-e4d256-prod-github-runner-207 kernel: [27648.582601] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 13:04:34 juju-e4d256-prod-github-runner-207 kernel: [27648.583670] ? hrtimer_interrupt+0x101/0x220 Aug 22 13:04:34 juju-e4d256-prod-github-runner-207 kernel: [27648.584695] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 13:04:34 juju-e4d256-prod-github-runner-207 kernel: [27648.585764] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 13:04:34 juju-e4d256-prod-github-runner-207 kernel: [27648.586814] Aug 22 13:04:34 juju-e4d256-prod-github-runner-207 kernel: [27648.587682] Aug 22 13:04:34 juju-e4d256-prod-github-runner-207 kernel: [27648.588526] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 13:04:34 juju-e4d256-prod-github-runner-207 kernel: [27648.589581] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:04:34 juju-e4d256-prod-github-runner-207 kernel: [27648.590625] ? _raw_spin_lock+0x22/0x30 Aug 22 13:04:34 juju-e4d256-prod-github-runner-207 kernel: [27648.591594] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:04:34 juju-e4d256-prod-github-runner-207 kernel: [27648.592630] direct_page_fault+0x206/0x310 [kvm] Aug 22 13:04:34 juju-e4d256-prod-github-runner-207 kernel: [27648.593684] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 13:04:34 juju-e4d256-prod-github-runner-207 kernel: [27648.594716] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 13:04:34 juju-e4d256-prod-github-runner-207 kernel: [27648.595749] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 13:04:34 juju-e4d256-prod-github-runner-207 kernel: [27648.596720] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 13:04:34 juju-e4d256-prod-github-runner-207 kernel: [27648.597664] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 13:04:34 juju-e4d256-prod-github-runner-207 kernel: [27648.598640] handle_exit+0x98/0x230 [kvm_amd] Aug 22 13:04:34 juju-e4d256-prod-github-runner-207 kernel: [27648.599802] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 13:04:34 juju-e4d256-prod-github-runner-207 kernel: [27648.601001] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 13:04:34 juju-e4d256-prod-github-runner-207 kernel: [27648.602244] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 13:04:34 juju-e4d256-prod-github-runner-207 kernel: [27648.603485] vcpu_run+0x62/0x2c0 [kvm] Aug 22 13:04:34 juju-e4d256-prod-github-runner-207 kernel: [27648.604560] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 13:04:34 juju-e4d256-prod-github-runner-207 kernel: [27648.605665] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 13:04:34 juju-e4d256-prod-github-runner-207 kernel: [27648.606928] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 13:04:34 juju-e4d256-prod-github-runner-207 kernel: [27648.608106] ? __seccomp_filter+0x4a/0x4a0 Aug 22 13:04:34 juju-e4d256-prod-github-runner-207 kernel: [27648.609169] ? __fget_files+0x86/0xc0 Aug 22 13:04:34 juju-e4d256-prod-github-runner-207 kernel: [27648.610150] __x64_sys_ioctl+0x95/0xd0 Aug 22 13:04:34 juju-e4d256-prod-github-runner-207 kernel: [27648.610972] do_syscall_64+0x5c/0xc0 Aug 22 13:04:34 juju-e4d256-prod-github-runner-207 kernel: [27648.611880] ? do_futex+0x162/0x1f0 Aug 22 13:04:34 juju-e4d256-prod-github-runner-207 kernel: [27648.612767] ? __x64_sys_futex+0x78/0x1e0 Aug 22 13:04:34 juju-e4d256-prod-github-runner-207 kernel: [27648.613722] ? __secure_computing+0xa9/0x120 Aug 22 13:04:34 juju-e4d256-prod-github-runner-207 kernel: [27648.614704] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 13:04:34 juju-e4d256-prod-github-runner-207 kernel: [27648.615753] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:04:34 juju-e4d256-prod-github-runner-207 kernel: [27648.616753] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:04:34 juju-e4d256-prod-github-runner-207 kernel: [27648.617500] ? do_syscall_64+0x69/0xc0 Aug 22 13:04:34 juju-e4d256-prod-github-runner-207 kernel: [27648.618149] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:04:34 juju-e4d256-prod-github-runner-207 kernel: [27648.618861] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:04:34 juju-e4d256-prod-github-runner-207 kernel: [27648.619590] ? do_syscall_64+0x69/0xc0 Aug 22 13:04:34 juju-e4d256-prod-github-runner-207 kernel: [27648.620225] ? do_syscall_64+0x69/0xc0 Aug 22 13:04:34 juju-e4d256-prod-github-runner-207 kernel: [27648.620869] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 13:04:34 juju-e4d256-prod-github-runner-207 kernel: [27648.621581] RIP: 0033:0x7faa5d0edaff Aug 22 13:04:34 juju-e4d256-prod-github-runner-207 kernel: [27648.622210] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 13:04:34 juju-e4d256-prod-github-runner-207 kernel: [27648.624223] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 13:04:34 juju-e4d256-prod-github-runner-207 kernel: [27648.625174] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 13:04:34 juju-e4d256-prod-github-runner-207 kernel: [27648.626079] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 13:04:34 juju-e4d256-prod-github-runner-207 kernel: [27648.626970] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 13:04:34 juju-e4d256-prod-github-runner-207 kernel: [27648.627880] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 13:04:34 juju-e4d256-prod-github-runner-207 kernel: [27648.628778] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 13:04:34 juju-e4d256-prod-github-runner-207 kernel: [27648.629676] Aug 22 13:05:02 juju-e4d256-prod-github-runner-207 kernel: [27676.541983] watchdog: BUG: soft lockup - CPU#1 stuck for 25667s! [qemu-system-x86:6715] Aug 22 13:05:02 juju-e4d256-prod-github-runner-207 kernel: [27676.544383] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 13:05:02 juju-e4d256-prod-github-runner-207 kernel: [27676.545041] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 13:05:02 juju-e4d256-prod-github-runner-207 kernel: [27676.561524] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 13:05:02 juju-e4d256-prod-github-runner-207 kernel: [27676.563219] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 13:05:02 juju-e4d256-prod-github-runner-207 kernel: [27676.564812] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:05:02 juju-e4d256-prod-github-runner-207 kernel: [27676.566220] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 13:05:02 juju-e4d256-prod-github-runner-207 kernel: [27676.569496] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 13:05:02 juju-e4d256-prod-github-runner-207 kernel: [27676.570864] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 13:05:02 juju-e4d256-prod-github-runner-207 kernel: [27676.572419] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 13:05:02 juju-e4d256-prod-github-runner-207 kernel: [27676.574005] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 13:05:02 juju-e4d256-prod-github-runner-207 kernel: [27676.575529] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 13:05:02 juju-e4d256-prod-github-runner-207 kernel: [27676.577301] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 13:05:02 juju-e4d256-prod-github-runner-207 kernel: [27676.578785] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 13:05:02 juju-e4d256-prod-github-runner-207 kernel: [27676.580433] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 13:05:02 juju-e4d256-prod-github-runner-207 kernel: [27676.581900] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 13:05:02 juju-e4d256-prod-github-runner-207 kernel: [27676.583415] Call Trace: Aug 22 13:05:02 juju-e4d256-prod-github-runner-207 kernel: [27676.584709] Aug 22 13:05:02 juju-e4d256-prod-github-runner-207 kernel: [27676.585927] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:05:02 juju-e4d256-prod-github-runner-207 kernel: [27676.587331] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:05:02 juju-e4d256-prod-github-runner-207 kernel: [27676.588690] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:05:02 juju-e4d256-prod-github-runner-207 kernel: [27676.590190] ? show_regs.part.0+0x23/0x29 Aug 22 13:05:02 juju-e4d256-prod-github-runner-207 kernel: [27676.591425] ? show_regs.cold+0x8/0xd Aug 22 13:05:02 juju-e4d256-prod-github-runner-207 kernel: [27676.592408] ? watchdog_timer_fn+0x1be/0x220 Aug 22 13:05:02 juju-e4d256-prod-github-runner-207 kernel: [27676.593419] ? lockup_detector_update_enable+0x60/0x60 Aug 22 13:05:02 juju-e4d256-prod-github-runner-207 kernel: [27676.594480] ? __hrtimer_run_queues+0x107/0x230 Aug 22 13:05:02 juju-e4d256-prod-github-runner-207 kernel: [27676.595542] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 13:05:02 juju-e4d256-prod-github-runner-207 kernel: [27676.596603] ? hrtimer_interrupt+0x101/0x220 Aug 22 13:05:02 juju-e4d256-prod-github-runner-207 kernel: [27676.597625] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 13:05:02 juju-e4d256-prod-github-runner-207 kernel: [27676.598697] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 13:05:02 juju-e4d256-prod-github-runner-207 kernel: [27676.599756] Aug 22 13:05:02 juju-e4d256-prod-github-runner-207 kernel: [27676.600611] Aug 22 13:05:02 juju-e4d256-prod-github-runner-207 kernel: [27676.601450] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 13:05:02 juju-e4d256-prod-github-runner-207 kernel: [27676.602489] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:05:02 juju-e4d256-prod-github-runner-207 kernel: [27676.603591] ? _raw_spin_lock+0x22/0x30 Aug 22 13:05:02 juju-e4d256-prod-github-runner-207 kernel: [27676.604547] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:05:02 juju-e4d256-prod-github-runner-207 kernel: [27676.605583] direct_page_fault+0x206/0x310 [kvm] Aug 22 13:05:02 juju-e4d256-prod-github-runner-207 kernel: [27676.606626] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 13:05:02 juju-e4d256-prod-github-runner-207 kernel: [27676.607699] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 13:05:02 juju-e4d256-prod-github-runner-207 kernel: [27676.608712] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 13:05:02 juju-e4d256-prod-github-runner-207 kernel: [27676.609733] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 13:05:02 juju-e4d256-prod-github-runner-207 kernel: [27676.610684] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 13:05:02 juju-e4d256-prod-github-runner-207 kernel: [27676.611681] handle_exit+0x98/0x230 [kvm_amd] Aug 22 13:05:02 juju-e4d256-prod-github-runner-207 kernel: [27676.612582] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 13:05:02 juju-e4d256-prod-github-runner-207 kernel: [27676.613502] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 13:05:02 juju-e4d256-prod-github-runner-207 kernel: [27676.614609] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 13:05:02 juju-e4d256-prod-github-runner-207 kernel: [27676.615537] vcpu_run+0x62/0x2c0 [kvm] Aug 22 13:05:02 juju-e4d256-prod-github-runner-207 kernel: [27676.616368] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 13:05:02 juju-e4d256-prod-github-runner-207 kernel: [27676.617189] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 13:05:02 juju-e4d256-prod-github-runner-207 kernel: [27676.618045] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 13:05:02 juju-e4d256-prod-github-runner-207 kernel: [27676.618847] ? __seccomp_filter+0x4a/0x4a0 Aug 22 13:05:02 juju-e4d256-prod-github-runner-207 kernel: [27676.619614] ? __fget_files+0x86/0xc0 Aug 22 13:05:02 juju-e4d256-prod-github-runner-207 kernel: [27676.620319] __x64_sys_ioctl+0x95/0xd0 Aug 22 13:05:02 juju-e4d256-prod-github-runner-207 kernel: [27676.621012] do_syscall_64+0x5c/0xc0 Aug 22 13:05:02 juju-e4d256-prod-github-runner-207 kernel: [27676.621678] ? do_futex+0x162/0x1f0 Aug 22 13:05:02 juju-e4d256-prod-github-runner-207 kernel: [27676.622336] ? __x64_sys_futex+0x78/0x1e0 Aug 22 13:05:02 juju-e4d256-prod-github-runner-207 kernel: [27676.623029] ? __secure_computing+0xa9/0x120 Aug 22 13:05:02 juju-e4d256-prod-github-runner-207 kernel: [27676.623723] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 13:05:02 juju-e4d256-prod-github-runner-207 kernel: [27676.624486] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:05:02 juju-e4d256-prod-github-runner-207 kernel: [27676.625210] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:05:02 juju-e4d256-prod-github-runner-207 kernel: [27676.625930] ? do_syscall_64+0x69/0xc0 Aug 22 13:05:02 juju-e4d256-prod-github-runner-207 kernel: [27676.626596] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:05:02 juju-e4d256-prod-github-runner-207 kernel: [27676.627320] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:05:02 juju-e4d256-prod-github-runner-207 kernel: [27676.628021] ? do_syscall_64+0x69/0xc0 Aug 22 13:05:02 juju-e4d256-prod-github-runner-207 kernel: [27676.628656] ? do_syscall_64+0x69/0xc0 Aug 22 13:05:02 juju-e4d256-prod-github-runner-207 kernel: [27676.629280] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 13:05:02 juju-e4d256-prod-github-runner-207 kernel: [27676.629986] RIP: 0033:0x7faa5d0edaff Aug 22 13:05:02 juju-e4d256-prod-github-runner-207 kernel: [27676.630654] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 13:05:02 juju-e4d256-prod-github-runner-207 kernel: [27676.632659] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 13:05:02 juju-e4d256-prod-github-runner-207 kernel: [27676.633578] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 13:05:02 juju-e4d256-prod-github-runner-207 kernel: [27676.634471] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 13:05:02 juju-e4d256-prod-github-runner-207 kernel: [27676.635389] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 13:05:02 juju-e4d256-prod-github-runner-207 kernel: [27676.636282] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 13:05:02 juju-e4d256-prod-github-runner-207 kernel: [27676.637173] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 13:05:02 juju-e4d256-prod-github-runner-207 kernel: [27676.638073] Aug 22 13:05:30 juju-e4d256-prod-github-runner-207 kernel: [27704.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 25693s! [qemu-system-x86:6715] Aug 22 13:05:30 juju-e4d256-prod-github-runner-207 kernel: [27704.543170] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 13:05:30 juju-e4d256-prod-github-runner-207 kernel: [27704.543245] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 13:05:30 juju-e4d256-prod-github-runner-207 kernel: [27704.555430] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 13:05:30 juju-e4d256-prod-github-runner-207 kernel: [27704.556709] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 13:05:30 juju-e4d256-prod-github-runner-207 kernel: [27704.557940] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:05:30 juju-e4d256-prod-github-runner-207 kernel: [27704.559016] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 13:05:30 juju-e4d256-prod-github-runner-207 kernel: [27704.561583] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 13:05:30 juju-e4d256-prod-github-runner-207 kernel: [27704.562657] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 13:05:30 juju-e4d256-prod-github-runner-207 kernel: [27704.563833] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 13:05:30 juju-e4d256-prod-github-runner-207 kernel: [27704.565005] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 13:05:30 juju-e4d256-prod-github-runner-207 kernel: [27704.566172] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 13:05:30 juju-e4d256-prod-github-runner-207 kernel: [27704.567380] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 13:05:30 juju-e4d256-prod-github-runner-207 kernel: [27704.568566] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 13:05:30 juju-e4d256-prod-github-runner-207 kernel: [27704.569809] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 13:05:30 juju-e4d256-prod-github-runner-207 kernel: [27704.570937] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 13:05:30 juju-e4d256-prod-github-runner-207 kernel: [27704.572157] Call Trace: Aug 22 13:05:30 juju-e4d256-prod-github-runner-207 kernel: [27704.573085] Aug 22 13:05:30 juju-e4d256-prod-github-runner-207 kernel: [27704.573976] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:05:30 juju-e4d256-prod-github-runner-207 kernel: [27704.575052] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:05:30 juju-e4d256-prod-github-runner-207 kernel: [27704.576099] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:05:30 juju-e4d256-prod-github-runner-207 kernel: [27704.577192] ? show_regs.part.0+0x23/0x29 Aug 22 13:05:30 juju-e4d256-prod-github-runner-207 kernel: [27704.578206] ? show_regs.cold+0x8/0xd Aug 22 13:05:30 juju-e4d256-prod-github-runner-207 kernel: [27704.579223] ? watchdog_timer_fn+0x1be/0x220 Aug 22 13:05:30 juju-e4d256-prod-github-runner-207 kernel: [27704.580243] ? lockup_detector_update_enable+0x60/0x60 Aug 22 13:05:30 juju-e4d256-prod-github-runner-207 kernel: [27704.581376] ? __hrtimer_run_queues+0x107/0x230 Aug 22 13:05:30 juju-e4d256-prod-github-runner-207 kernel: [27704.582482] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 13:05:30 juju-e4d256-prod-github-runner-207 kernel: [27704.583542] ? hrtimer_interrupt+0x101/0x220 Aug 22 13:05:30 juju-e4d256-prod-github-runner-207 kernel: [27704.584588] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 13:05:30 juju-e4d256-prod-github-runner-207 kernel: [27704.585679] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 13:05:30 juju-e4d256-prod-github-runner-207 kernel: [27704.586756] Aug 22 13:05:30 juju-e4d256-prod-github-runner-207 kernel: [27704.587675] Aug 22 13:05:30 juju-e4d256-prod-github-runner-207 kernel: [27704.588833] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 13:05:30 juju-e4d256-prod-github-runner-207 kernel: [27704.590001] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:05:30 juju-e4d256-prod-github-runner-207 kernel: [27704.591078] ? _raw_spin_lock+0x22/0x30 Aug 22 13:05:30 juju-e4d256-prod-github-runner-207 kernel: [27704.592034] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:05:30 juju-e4d256-prod-github-runner-207 kernel: [27704.593072] direct_page_fault+0x206/0x310 [kvm] Aug 22 13:05:30 juju-e4d256-prod-github-runner-207 kernel: [27704.594118] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 13:05:30 juju-e4d256-prod-github-runner-207 kernel: [27704.595169] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 13:05:30 juju-e4d256-prod-github-runner-207 kernel: [27704.596181] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 13:05:30 juju-e4d256-prod-github-runner-207 kernel: [27704.597156] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 13:05:30 juju-e4d256-prod-github-runner-207 kernel: [27704.598106] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 13:05:30 juju-e4d256-prod-github-runner-207 kernel: [27704.599116] handle_exit+0x98/0x230 [kvm_amd] Aug 22 13:05:30 juju-e4d256-prod-github-runner-207 kernel: [27704.600052] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 13:05:30 juju-e4d256-prod-github-runner-207 kernel: [27704.601037] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 13:05:30 juju-e4d256-prod-github-runner-207 kernel: [27704.602001] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 13:05:30 juju-e4d256-prod-github-runner-207 kernel: [27704.602961] vcpu_run+0x62/0x2c0 [kvm] Aug 22 13:05:30 juju-e4d256-prod-github-runner-207 kernel: [27704.603796] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 13:05:30 juju-e4d256-prod-github-runner-207 kernel: [27704.604622] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 13:05:30 juju-e4d256-prod-github-runner-207 kernel: [27704.605493] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 13:05:30 juju-e4d256-prod-github-runner-207 kernel: [27704.606301] ? __seccomp_filter+0x4a/0x4a0 Aug 22 13:05:30 juju-e4d256-prod-github-runner-207 kernel: [27704.607076] ? __fget_files+0x86/0xc0 Aug 22 13:05:30 juju-e4d256-prod-github-runner-207 kernel: [27704.607791] __x64_sys_ioctl+0x95/0xd0 Aug 22 13:05:30 juju-e4d256-prod-github-runner-207 kernel: [27704.608485] do_syscall_64+0x5c/0xc0 Aug 22 13:05:30 juju-e4d256-prod-github-runner-207 kernel: [27704.609151] ? do_futex+0x162/0x1f0 Aug 22 13:05:30 juju-e4d256-prod-github-runner-207 kernel: [27704.609811] ? __x64_sys_futex+0x78/0x1e0 Aug 22 13:05:30 juju-e4d256-prod-github-runner-207 kernel: [27704.610499] ? __secure_computing+0xa9/0x120 Aug 22 13:05:30 juju-e4d256-prod-github-runner-207 kernel: [27704.611212] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 13:05:30 juju-e4d256-prod-github-runner-207 kernel: [27704.611982] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:05:30 juju-e4d256-prod-github-runner-207 kernel: [27704.612715] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:05:30 juju-e4d256-prod-github-runner-207 kernel: [27704.613443] ? do_syscall_64+0x69/0xc0 Aug 22 13:05:30 juju-e4d256-prod-github-runner-207 kernel: [27704.614090] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:05:30 juju-e4d256-prod-github-runner-207 kernel: [27704.614810] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:05:30 juju-e4d256-prod-github-runner-207 kernel: [27704.615513] ? do_syscall_64+0x69/0xc0 Aug 22 13:05:30 juju-e4d256-prod-github-runner-207 kernel: [27704.616143] ? do_syscall_64+0x69/0xc0 Aug 22 13:05:30 juju-e4d256-prod-github-runner-207 kernel: [27704.616772] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 13:05:30 juju-e4d256-prod-github-runner-207 kernel: [27704.617484] RIP: 0033:0x7faa5d0edaff Aug 22 13:05:30 juju-e4d256-prod-github-runner-207 kernel: [27704.618114] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 13:05:30 juju-e4d256-prod-github-runner-207 kernel: [27704.620134] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 13:05:30 juju-e4d256-prod-github-runner-207 kernel: [27704.621060] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 13:05:30 juju-e4d256-prod-github-runner-207 kernel: [27704.621963] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 13:05:30 juju-e4d256-prod-github-runner-207 kernel: [27704.622873] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 13:05:30 juju-e4d256-prod-github-runner-207 kernel: [27704.623776] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 13:05:30 juju-e4d256-prod-github-runner-207 kernel: [27704.624680] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 13:05:30 juju-e4d256-prod-github-runner-207 kernel: [27704.625608] Aug 22 13:05:45 juju-e4d256-prod-github-runner-207 kernel: [27719.036709] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 13:05:45 juju-e4d256-prod-github-runner-207 kernel: [27719.037686] rcu: 1-....: (6878954 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=3326117 Aug 22 13:05:45 juju-e4d256-prod-github-runner-207 kernel: [27719.038849] (t=6900459 jiffies g=23269 q=31687) Aug 22 13:05:45 juju-e4d256-prod-github-runner-207 kernel: [27719.039641] NMI backtrace for cpu 1 Aug 22 13:05:45 juju-e4d256-prod-github-runner-207 kernel: [27719.040360] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 13:05:45 juju-e4d256-prod-github-runner-207 kernel: [27719.041493] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 13:05:45 juju-e4d256-prod-github-runner-207 kernel: [27719.042608] Call Trace: Aug 22 13:05:45 juju-e4d256-prod-github-runner-207 kernel: [27719.043289] Aug 22 13:05:45 juju-e4d256-prod-github-runner-207 kernel: [27719.043964] show_stack+0x52/0x5c Aug 22 13:05:45 juju-e4d256-prod-github-runner-207 kernel: [27719.044692] dump_stack_lvl+0x4a/0x63 Aug 22 13:05:45 juju-e4d256-prod-github-runner-207 kernel: [27719.045434] dump_stack+0x10/0x16 Aug 22 13:05:45 juju-e4d256-prod-github-runner-207 kernel: [27719.046147] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 13:05:45 juju-e4d256-prod-github-runner-207 kernel: [27719.046947] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 13:05:45 juju-e4d256-prod-github-runner-207 kernel: [27719.047735] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 13:05:45 juju-e4d256-prod-github-runner-207 kernel: [27719.048558] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 13:05:45 juju-e4d256-prod-github-runner-207 kernel: [27719.049371] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 13:05:45 juju-e4d256-prod-github-runner-207 kernel: [27719.050173] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 13:05:45 juju-e4d256-prod-github-runner-207 kernel: [27719.050953] print_cpu_stall.cold+0x2f/0xe2 Aug 22 13:05:45 juju-e4d256-prod-github-runner-207 kernel: [27719.051712] ? timekeeping_update+0xf7/0x150 Aug 22 13:05:45 juju-e4d256-prod-github-runner-207 kernel: [27719.052478] check_cpu_stall+0x109/0x270 Aug 22 13:05:45 juju-e4d256-prod-github-runner-207 kernel: [27719.053223] rcu_sched_clock_irq+0x9a/0x250 Aug 22 13:05:45 juju-e4d256-prod-github-runner-207 kernel: [27719.053987] update_process_times+0x94/0xd0 Aug 22 13:05:45 juju-e4d256-prod-github-runner-207 kernel: [27719.054752] tick_sched_handle+0x29/0x70 Aug 22 13:05:45 juju-e4d256-prod-github-runner-207 kernel: [27719.055585] tick_sched_timer+0x8c/0xc0 Aug 22 13:05:45 juju-e4d256-prod-github-runner-207 kernel: [27719.056347] ? tick_nohz_handler+0xb0/0xb0 Aug 22 13:05:45 juju-e4d256-prod-github-runner-207 kernel: [27719.057106] __hrtimer_run_queues+0x107/0x230 Aug 22 13:05:45 juju-e4d256-prod-github-runner-207 kernel: [27719.057880] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 13:05:45 juju-e4d256-prod-github-runner-207 kernel: [27719.058674] hrtimer_interrupt+0x101/0x220 Aug 22 13:05:45 juju-e4d256-prod-github-runner-207 kernel: [27719.059430] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 13:05:45 juju-e4d256-prod-github-runner-207 kernel: [27719.060238] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 13:05:45 juju-e4d256-prod-github-runner-207 kernel: [27719.061052] Aug 22 13:05:45 juju-e4d256-prod-github-runner-207 kernel: [27719.061687] Aug 22 13:05:45 juju-e4d256-prod-github-runner-207 kernel: [27719.062341] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 13:05:45 juju-e4d256-prod-github-runner-207 kernel: [27719.063191] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:05:45 juju-e4d256-prod-github-runner-207 kernel: [27719.064075] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 13:05:45 juju-e4d256-prod-github-runner-207 kernel: [27719.066284] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 13:05:45 juju-e4d256-prod-github-runner-207 kernel: [27719.067176] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 13:05:45 juju-e4d256-prod-github-runner-207 kernel: [27719.068175] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 13:05:45 juju-e4d256-prod-github-runner-207 kernel: [27719.069151] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 13:05:45 juju-e4d256-prod-github-runner-207 kernel: [27719.070125] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 13:05:45 juju-e4d256-prod-github-runner-207 kernel: [27719.071099] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 13:05:45 juju-e4d256-prod-github-runner-207 kernel: [27719.072050] ? _raw_spin_lock+0x22/0x30 Aug 22 13:05:45 juju-e4d256-prod-github-runner-207 kernel: [27719.072808] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:05:45 juju-e4d256-prod-github-runner-207 kernel: [27719.073644] direct_page_fault+0x206/0x310 [kvm] Aug 22 13:05:45 juju-e4d256-prod-github-runner-207 kernel: [27719.074489] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 13:05:45 juju-e4d256-prod-github-runner-207 kernel: [27719.075317] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 13:05:45 juju-e4d256-prod-github-runner-207 kernel: [27719.076144] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 13:05:45 juju-e4d256-prod-github-runner-207 kernel: [27719.076947] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 13:05:45 juju-e4d256-prod-github-runner-207 kernel: [27719.077749] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 13:05:45 juju-e4d256-prod-github-runner-207 kernel: [27719.078593] handle_exit+0x98/0x230 [kvm_amd] Aug 22 13:05:45 juju-e4d256-prod-github-runner-207 kernel: [27719.079349] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 13:05:45 juju-e4d256-prod-github-runner-207 kernel: [27719.080137] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 13:05:45 juju-e4d256-prod-github-runner-207 kernel: [27719.080980] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 13:05:45 juju-e4d256-prod-github-runner-207 kernel: [27719.081785] vcpu_run+0x62/0x2c0 [kvm] Aug 22 13:05:45 juju-e4d256-prod-github-runner-207 kernel: [27719.082523] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 13:05:45 juju-e4d256-prod-github-runner-207 kernel: [27719.083260] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 13:05:45 juju-e4d256-prod-github-runner-207 kernel: [27719.084099] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 13:05:45 juju-e4d256-prod-github-runner-207 kernel: [27719.084898] ? __seccomp_filter+0x4a/0x4a0 Aug 22 13:05:45 juju-e4d256-prod-github-runner-207 kernel: [27719.085715] ? __fget_files+0x86/0xc0 Aug 22 13:05:45 juju-e4d256-prod-github-runner-207 kernel: [27719.086417] __x64_sys_ioctl+0x95/0xd0 Aug 22 13:05:45 juju-e4d256-prod-github-runner-207 kernel: [27719.087149] do_syscall_64+0x5c/0xc0 Aug 22 13:05:45 juju-e4d256-prod-github-runner-207 kernel: [27719.087831] ? do_futex+0x162/0x1f0 Aug 22 13:05:45 juju-e4d256-prod-github-runner-207 kernel: [27719.088507] ? __x64_sys_futex+0x78/0x1e0 Aug 22 13:05:45 juju-e4d256-prod-github-runner-207 kernel: [27719.089208] ? __secure_computing+0xa9/0x120 Aug 22 13:05:45 juju-e4d256-prod-github-runner-207 kernel: [27719.089924] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 13:05:45 juju-e4d256-prod-github-runner-207 kernel: [27719.090729] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:05:45 juju-e4d256-prod-github-runner-207 kernel: [27719.091485] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:05:45 juju-e4d256-prod-github-runner-207 kernel: [27719.092243] ? do_syscall_64+0x69/0xc0 Aug 22 13:05:45 juju-e4d256-prod-github-runner-207 kernel: [27719.092932] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:05:45 juju-e4d256-prod-github-runner-207 kernel: [27719.093686] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:05:45 juju-e4d256-prod-github-runner-207 kernel: [27719.094450] ? do_syscall_64+0x69/0xc0 Aug 22 13:05:45 juju-e4d256-prod-github-runner-207 kernel: [27719.095155] ? do_syscall_64+0x69/0xc0 Aug 22 13:05:45 juju-e4d256-prod-github-runner-207 kernel: [27719.095843] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 13:05:45 juju-e4d256-prod-github-runner-207 kernel: [27719.096613] RIP: 0033:0x7faa5d0edaff Aug 22 13:05:45 juju-e4d256-prod-github-runner-207 kernel: [27719.097296] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 13:05:45 juju-e4d256-prod-github-runner-207 kernel: [27719.099417] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 13:05:45 juju-e4d256-prod-github-runner-207 kernel: [27719.100376] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 13:05:45 juju-e4d256-prod-github-runner-207 kernel: [27719.101336] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 13:05:45 juju-e4d256-prod-github-runner-207 kernel: [27719.102281] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 13:05:45 juju-e4d256-prod-github-runner-207 kernel: [27719.103242] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 13:05:45 juju-e4d256-prod-github-runner-207 kernel: [27719.104178] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 13:05:45 juju-e4d256-prod-github-runner-207 kernel: [27719.105095] Aug 22 13:06:10 juju-e4d256-prod-github-runner-207 kernel: [27744.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 25731s! [qemu-system-x86:6715] Aug 22 13:06:10 juju-e4d256-prod-github-runner-207 kernel: [27744.543280] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 13:06:10 juju-e4d256-prod-github-runner-207 kernel: [27744.543451] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 13:06:10 juju-e4d256-prod-github-runner-207 kernel: [27744.556246] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 13:06:10 juju-e4d256-prod-github-runner-207 kernel: [27744.557553] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 13:06:10 juju-e4d256-prod-github-runner-207 kernel: [27744.558958] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:06:10 juju-e4d256-prod-github-runner-207 kernel: [27744.560069] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 13:06:10 juju-e4d256-prod-github-runner-207 kernel: [27744.562710] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 13:06:10 juju-e4d256-prod-github-runner-207 kernel: [27744.563932] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 13:06:10 juju-e4d256-prod-github-runner-207 kernel: [27744.565132] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 13:06:10 juju-e4d256-prod-github-runner-207 kernel: [27744.566492] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 13:06:10 juju-e4d256-prod-github-runner-207 kernel: [27744.567751] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 13:06:10 juju-e4d256-prod-github-runner-207 kernel: [27744.568949] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 13:06:10 juju-e4d256-prod-github-runner-207 kernel: [27744.570175] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 13:06:10 juju-e4d256-prod-github-runner-207 kernel: [27744.571439] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 13:06:10 juju-e4d256-prod-github-runner-207 kernel: [27744.572552] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 13:06:10 juju-e4d256-prod-github-runner-207 kernel: [27744.573835] Call Trace: Aug 22 13:06:10 juju-e4d256-prod-github-runner-207 kernel: [27744.574777] Aug 22 13:06:10 juju-e4d256-prod-github-runner-207 kernel: [27744.575707] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:06:10 juju-e4d256-prod-github-runner-207 kernel: [27744.576765] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:06:10 juju-e4d256-prod-github-runner-207 kernel: [27744.577807] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:06:10 juju-e4d256-prod-github-runner-207 kernel: [27744.579014] ? show_regs.part.0+0x23/0x29 Aug 22 13:06:10 juju-e4d256-prod-github-runner-207 kernel: [27744.580054] ? show_regs.cold+0x8/0xd Aug 22 13:06:10 juju-e4d256-prod-github-runner-207 kernel: [27744.581037] ? watchdog_timer_fn+0x1be/0x220 Aug 22 13:06:10 juju-e4d256-prod-github-runner-207 kernel: [27744.582055] ? lockup_detector_update_enable+0x60/0x60 Aug 22 13:06:10 juju-e4d256-prod-github-runner-207 kernel: [27744.583156] ? __hrtimer_run_queues+0x107/0x230 Aug 22 13:06:10 juju-e4d256-prod-github-runner-207 kernel: [27744.584241] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 13:06:10 juju-e4d256-prod-github-runner-207 kernel: [27744.585289] ? hrtimer_interrupt+0x101/0x220 Aug 22 13:06:10 juju-e4d256-prod-github-runner-207 kernel: [27744.586339] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 13:06:10 juju-e4d256-prod-github-runner-207 kernel: [27744.587422] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 13:06:10 juju-e4d256-prod-github-runner-207 kernel: [27744.588531] Aug 22 13:06:10 juju-e4d256-prod-github-runner-207 kernel: [27744.589423] Aug 22 13:06:10 juju-e4d256-prod-github-runner-207 kernel: [27744.590296] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 13:06:10 juju-e4d256-prod-github-runner-207 kernel: [27744.591586] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:06:10 juju-e4d256-prod-github-runner-207 kernel: [27744.592658] ? _raw_spin_lock+0x22/0x30 Aug 22 13:06:10 juju-e4d256-prod-github-runner-207 kernel: [27744.593652] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:06:10 juju-e4d256-prod-github-runner-207 kernel: [27744.594769] direct_page_fault+0x206/0x310 [kvm] Aug 22 13:06:10 juju-e4d256-prod-github-runner-207 kernel: [27744.595824] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 13:06:10 juju-e4d256-prod-github-runner-207 kernel: [27744.596853] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 13:06:10 juju-e4d256-prod-github-runner-207 kernel: [27744.597873] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 13:06:10 juju-e4d256-prod-github-runner-207 kernel: [27744.598912] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 13:06:10 juju-e4d256-prod-github-runner-207 kernel: [27744.599891] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 13:06:10 juju-e4d256-prod-github-runner-207 kernel: [27744.600923] handle_exit+0x98/0x230 [kvm_amd] Aug 22 13:06:10 juju-e4d256-prod-github-runner-207 kernel: [27744.601843] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 13:06:10 juju-e4d256-prod-github-runner-207 kernel: [27744.602786] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 13:06:10 juju-e4d256-prod-github-runner-207 kernel: [27744.603725] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 13:06:10 juju-e4d256-prod-github-runner-207 kernel: [27744.604695] vcpu_run+0x62/0x2c0 [kvm] Aug 22 13:06:10 juju-e4d256-prod-github-runner-207 kernel: [27744.605535] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 13:06:10 juju-e4d256-prod-github-runner-207 kernel: [27744.606373] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 13:06:10 juju-e4d256-prod-github-runner-207 kernel: [27744.607250] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 13:06:10 juju-e4d256-prod-github-runner-207 kernel: [27744.608061] ? __seccomp_filter+0x4a/0x4a0 Aug 22 13:06:10 juju-e4d256-prod-github-runner-207 kernel: [27744.608813] ? __fget_files+0x86/0xc0 Aug 22 13:06:10 juju-e4d256-prod-github-runner-207 kernel: [27744.609535] __x64_sys_ioctl+0x95/0xd0 Aug 22 13:06:10 juju-e4d256-prod-github-runner-207 kernel: [27744.610284] do_syscall_64+0x5c/0xc0 Aug 22 13:06:10 juju-e4d256-prod-github-runner-207 kernel: [27744.610976] ? do_futex+0x162/0x1f0 Aug 22 13:06:10 juju-e4d256-prod-github-runner-207 kernel: [27744.611636] ? __x64_sys_futex+0x78/0x1e0 Aug 22 13:06:10 juju-e4d256-prod-github-runner-207 kernel: [27744.612318] ? __secure_computing+0xa9/0x120 Aug 22 13:06:10 juju-e4d256-prod-github-runner-207 kernel: [27744.613021] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 13:06:10 juju-e4d256-prod-github-runner-207 kernel: [27744.613801] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:06:10 juju-e4d256-prod-github-runner-207 kernel: [27744.614570] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:06:10 juju-e4d256-prod-github-runner-207 kernel: [27744.615316] ? do_syscall_64+0x69/0xc0 Aug 22 13:06:10 juju-e4d256-prod-github-runner-207 kernel: [27744.615979] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:06:10 juju-e4d256-prod-github-runner-207 kernel: [27744.616696] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:06:10 juju-e4d256-prod-github-runner-207 kernel: [27744.617403] ? do_syscall_64+0x69/0xc0 Aug 22 13:06:10 juju-e4d256-prod-github-runner-207 kernel: [27744.618076] ? do_syscall_64+0x69/0xc0 Aug 22 13:06:10 juju-e4d256-prod-github-runner-207 kernel: [27744.618745] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 13:06:10 juju-e4d256-prod-github-runner-207 kernel: [27744.619477] RIP: 0033:0x7faa5d0edaff Aug 22 13:06:10 juju-e4d256-prod-github-runner-207 kernel: [27744.620115] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 13:06:10 juju-e4d256-prod-github-runner-207 kernel: [27744.622180] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 13:06:10 juju-e4d256-prod-github-runner-207 kernel: [27744.623133] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 13:06:10 juju-e4d256-prod-github-runner-207 kernel: [27744.624046] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 13:06:10 juju-e4d256-prod-github-runner-207 kernel: [27744.624973] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 13:06:10 juju-e4d256-prod-github-runner-207 kernel: [27744.625911] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 13:06:10 juju-e4d256-prod-github-runner-207 kernel: [27744.626841] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 13:06:10 juju-e4d256-prod-github-runner-207 kernel: [27744.627790] Aug 22 13:06:38 juju-e4d256-prod-github-runner-207 kernel: [27772.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 25757s! [qemu-system-x86:6715] Aug 22 13:06:38 juju-e4d256-prod-github-runner-207 kernel: [27772.543917] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 13:06:38 juju-e4d256-prod-github-runner-207 kernel: [27772.544164] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 13:06:38 juju-e4d256-prod-github-runner-207 kernel: [27772.556559] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 13:06:38 juju-e4d256-prod-github-runner-207 kernel: [27772.557851] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 13:06:38 juju-e4d256-prod-github-runner-207 kernel: [27772.559113] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:06:38 juju-e4d256-prod-github-runner-207 kernel: [27772.560191] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 13:06:38 juju-e4d256-prod-github-runner-207 kernel: [27772.562833] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 13:06:38 juju-e4d256-prod-github-runner-207 kernel: [27772.563924] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 13:06:38 juju-e4d256-prod-github-runner-207 kernel: [27772.565166] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 13:06:38 juju-e4d256-prod-github-runner-207 kernel: [27772.566422] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 13:06:38 juju-e4d256-prod-github-runner-207 kernel: [27772.567597] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 13:06:38 juju-e4d256-prod-github-runner-207 kernel: [27772.568760] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 13:06:38 juju-e4d256-prod-github-runner-207 kernel: [27772.569944] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 13:06:38 juju-e4d256-prod-github-runner-207 kernel: [27772.571179] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 13:06:38 juju-e4d256-prod-github-runner-207 kernel: [27772.572276] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 13:06:38 juju-e4d256-prod-github-runner-207 kernel: [27772.573472] Call Trace: Aug 22 13:06:38 juju-e4d256-prod-github-runner-207 kernel: [27772.574422] Aug 22 13:06:38 juju-e4d256-prod-github-runner-207 kernel: [27772.575339] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:06:38 juju-e4d256-prod-github-runner-207 kernel: [27772.576400] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:06:38 juju-e4d256-prod-github-runner-207 kernel: [27772.577443] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:06:38 juju-e4d256-prod-github-runner-207 kernel: [27772.578540] ? show_regs.part.0+0x23/0x29 Aug 22 13:06:38 juju-e4d256-prod-github-runner-207 kernel: [27772.579588] ? show_regs.cold+0x8/0xd Aug 22 13:06:38 juju-e4d256-prod-github-runner-207 kernel: [27772.580589] ? watchdog_timer_fn+0x1be/0x220 Aug 22 13:06:38 juju-e4d256-prod-github-runner-207 kernel: [27772.581602] ? lockup_detector_update_enable+0x60/0x60 Aug 22 13:06:38 juju-e4d256-prod-github-runner-207 kernel: [27772.582688] ? __hrtimer_run_queues+0x107/0x230 Aug 22 13:06:38 juju-e4d256-prod-github-runner-207 kernel: [27772.583716] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 13:06:38 juju-e4d256-prod-github-runner-207 kernel: [27772.584831] ? hrtimer_interrupt+0x101/0x220 Aug 22 13:06:38 juju-e4d256-prod-github-runner-207 kernel: [27772.585972] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 13:06:38 juju-e4d256-prod-github-runner-207 kernel: [27772.587127] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 13:06:38 juju-e4d256-prod-github-runner-207 kernel: [27772.588238] Aug 22 13:06:38 juju-e4d256-prod-github-runner-207 kernel: [27772.589609] Aug 22 13:06:38 juju-e4d256-prod-github-runner-207 kernel: [27772.590476] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 13:06:38 juju-e4d256-prod-github-runner-207 kernel: [27772.591569] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:06:38 juju-e4d256-prod-github-runner-207 kernel: [27772.592616] ? _raw_spin_lock+0x22/0x30 Aug 22 13:06:38 juju-e4d256-prod-github-runner-207 kernel: [27772.593642] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:06:38 juju-e4d256-prod-github-runner-207 kernel: [27772.594713] direct_page_fault+0x206/0x310 [kvm] Aug 22 13:06:38 juju-e4d256-prod-github-runner-207 kernel: [27772.595775] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 13:06:38 juju-e4d256-prod-github-runner-207 kernel: [27772.596848] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 13:06:38 juju-e4d256-prod-github-runner-207 kernel: [27772.597899] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 13:06:38 juju-e4d256-prod-github-runner-207 kernel: [27772.598914] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 13:06:38 juju-e4d256-prod-github-runner-207 kernel: [27772.599867] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 13:06:38 juju-e4d256-prod-github-runner-207 kernel: [27772.600850] handle_exit+0x98/0x230 [kvm_amd] Aug 22 13:06:38 juju-e4d256-prod-github-runner-207 kernel: [27772.601780] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 13:06:38 juju-e4d256-prod-github-runner-207 kernel: [27772.602722] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 13:06:38 juju-e4d256-prod-github-runner-207 kernel: [27772.603679] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 13:06:38 juju-e4d256-prod-github-runner-207 kernel: [27772.604622] vcpu_run+0x62/0x2c0 [kvm] Aug 22 13:06:38 juju-e4d256-prod-github-runner-207 kernel: [27772.605500] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 13:06:38 juju-e4d256-prod-github-runner-207 kernel: [27772.606374] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 13:06:38 juju-e4d256-prod-github-runner-207 kernel: [27772.607280] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 13:06:38 juju-e4d256-prod-github-runner-207 kernel: [27772.608098] ? __seccomp_filter+0x4a/0x4a0 Aug 22 13:06:38 juju-e4d256-prod-github-runner-207 kernel: [27772.608866] ? __fget_files+0x86/0xc0 Aug 22 13:06:38 juju-e4d256-prod-github-runner-207 kernel: [27772.609596] __x64_sys_ioctl+0x95/0xd0 Aug 22 13:06:38 juju-e4d256-prod-github-runner-207 kernel: [27772.610332] do_syscall_64+0x5c/0xc0 Aug 22 13:06:38 juju-e4d256-prod-github-runner-207 kernel: [27772.611009] ? do_futex+0x162/0x1f0 Aug 22 13:06:38 juju-e4d256-prod-github-runner-207 kernel: [27772.611675] ? __x64_sys_futex+0x78/0x1e0 Aug 22 13:06:38 juju-e4d256-prod-github-runner-207 kernel: [27772.612348] ? __secure_computing+0xa9/0x120 Aug 22 13:06:38 juju-e4d256-prod-github-runner-207 kernel: [27772.613041] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 13:06:38 juju-e4d256-prod-github-runner-207 kernel: [27772.613819] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:06:38 juju-e4d256-prod-github-runner-207 kernel: [27772.614547] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:06:38 juju-e4d256-prod-github-runner-207 kernel: [27772.615270] ? do_syscall_64+0x69/0xc0 Aug 22 13:06:38 juju-e4d256-prod-github-runner-207 kernel: [27772.615915] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:06:38 juju-e4d256-prod-github-runner-207 kernel: [27772.616618] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:06:38 juju-e4d256-prod-github-runner-207 kernel: [27772.617319] ? do_syscall_64+0x69/0xc0 Aug 22 13:06:38 juju-e4d256-prod-github-runner-207 kernel: [27772.617964] ? do_syscall_64+0x69/0xc0 Aug 22 13:06:38 juju-e4d256-prod-github-runner-207 kernel: [27772.618589] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 13:06:38 juju-e4d256-prod-github-runner-207 kernel: [27772.619298] RIP: 0033:0x7faa5d0edaff Aug 22 13:06:38 juju-e4d256-prod-github-runner-207 kernel: [27772.619972] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 13:06:38 juju-e4d256-prod-github-runner-207 kernel: [27772.621982] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 13:06:38 juju-e4d256-prod-github-runner-207 kernel: [27772.622897] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 13:06:38 juju-e4d256-prod-github-runner-207 kernel: [27772.623789] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 13:06:38 juju-e4d256-prod-github-runner-207 kernel: [27772.624739] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 13:06:38 juju-e4d256-prod-github-runner-207 kernel: [27772.625674] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 13:06:38 juju-e4d256-prod-github-runner-207 kernel: [27772.626693] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 13:06:38 juju-e4d256-prod-github-runner-207 kernel: [27772.627644] Aug 22 13:07:06 juju-e4d256-prod-github-runner-207 kernel: [27800.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 25783s! [qemu-system-x86:6715] Aug 22 13:07:06 juju-e4d256-prod-github-runner-207 kernel: [27800.543117] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 13:07:06 juju-e4d256-prod-github-runner-207 kernel: [27800.543193] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 13:07:06 juju-e4d256-prod-github-runner-207 kernel: [27800.555379] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 13:07:06 juju-e4d256-prod-github-runner-207 kernel: [27800.556646] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 13:07:06 juju-e4d256-prod-github-runner-207 kernel: [27800.557915] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:07:06 juju-e4d256-prod-github-runner-207 kernel: [27800.558982] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 13:07:06 juju-e4d256-prod-github-runner-207 kernel: [27800.561544] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 13:07:06 juju-e4d256-prod-github-runner-207 kernel: [27800.562582] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 13:07:06 juju-e4d256-prod-github-runner-207 kernel: [27800.563739] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 13:07:06 juju-e4d256-prod-github-runner-207 kernel: [27800.564899] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 13:07:06 juju-e4d256-prod-github-runner-207 kernel: [27800.566066] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 13:07:06 juju-e4d256-prod-github-runner-207 kernel: [27800.567226] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 13:07:06 juju-e4d256-prod-github-runner-207 kernel: [27800.568401] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 13:07:06 juju-e4d256-prod-github-runner-207 kernel: [27800.569647] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 13:07:06 juju-e4d256-prod-github-runner-207 kernel: [27800.570747] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 13:07:06 juju-e4d256-prod-github-runner-207 kernel: [27800.571938] Call Trace: Aug 22 13:07:06 juju-e4d256-prod-github-runner-207 kernel: [27800.572850] Aug 22 13:07:06 juju-e4d256-prod-github-runner-207 kernel: [27800.573929] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:07:06 juju-e4d256-prod-github-runner-207 kernel: [27800.575093] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:07:06 juju-e4d256-prod-github-runner-207 kernel: [27800.576116] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:07:06 juju-e4d256-prod-github-runner-207 kernel: [27800.577193] ? show_regs.part.0+0x23/0x29 Aug 22 13:07:06 juju-e4d256-prod-github-runner-207 kernel: [27800.578207] ? show_regs.cold+0x8/0xd Aug 22 13:07:06 juju-e4d256-prod-github-runner-207 kernel: [27800.579178] ? watchdog_timer_fn+0x1be/0x220 Aug 22 13:07:06 juju-e4d256-prod-github-runner-207 kernel: [27800.580206] ? lockup_detector_update_enable+0x60/0x60 Aug 22 13:07:06 juju-e4d256-prod-github-runner-207 kernel: [27800.581284] ? __hrtimer_run_queues+0x107/0x230 Aug 22 13:07:06 juju-e4d256-prod-github-runner-207 kernel: [27800.582328] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 13:07:06 juju-e4d256-prod-github-runner-207 kernel: [27800.583352] ? hrtimer_interrupt+0x101/0x220 Aug 22 13:07:06 juju-e4d256-prod-github-runner-207 kernel: [27800.584368] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 13:07:06 juju-e4d256-prod-github-runner-207 kernel: [27800.585462] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 13:07:06 juju-e4d256-prod-github-runner-207 kernel: [27800.586517] Aug 22 13:07:06 juju-e4d256-prod-github-runner-207 kernel: [27800.587399] Aug 22 13:07:06 juju-e4d256-prod-github-runner-207 kernel: [27800.588259] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 13:07:06 juju-e4d256-prod-github-runner-207 kernel: [27800.589294] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:07:06 juju-e4d256-prod-github-runner-207 kernel: [27800.590368] ? _raw_spin_lock+0x22/0x30 Aug 22 13:07:06 juju-e4d256-prod-github-runner-207 kernel: [27800.591317] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:07:06 juju-e4d256-prod-github-runner-207 kernel: [27800.592344] direct_page_fault+0x206/0x310 [kvm] Aug 22 13:07:06 juju-e4d256-prod-github-runner-207 kernel: [27800.593424] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 13:07:06 juju-e4d256-prod-github-runner-207 kernel: [27800.594468] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 13:07:06 juju-e4d256-prod-github-runner-207 kernel: [27800.595476] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 13:07:06 juju-e4d256-prod-github-runner-207 kernel: [27800.596448] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 13:07:06 juju-e4d256-prod-github-runner-207 kernel: [27800.597433] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 13:07:06 juju-e4d256-prod-github-runner-207 kernel: [27800.598415] handle_exit+0x98/0x230 [kvm_amd] Aug 22 13:07:06 juju-e4d256-prod-github-runner-207 kernel: [27800.599308] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 13:07:06 juju-e4d256-prod-github-runner-207 kernel: [27800.600253] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 13:07:06 juju-e4d256-prod-github-runner-207 kernel: [27800.601178] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 13:07:06 juju-e4d256-prod-github-runner-207 kernel: [27800.602097] vcpu_run+0x62/0x2c0 [kvm] Aug 22 13:07:06 juju-e4d256-prod-github-runner-207 kernel: [27800.602909] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 13:07:06 juju-e4d256-prod-github-runner-207 kernel: [27800.603723] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 13:07:06 juju-e4d256-prod-github-runner-207 kernel: [27800.604577] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 13:07:06 juju-e4d256-prod-github-runner-207 kernel: [27800.605374] ? __seccomp_filter+0x4a/0x4a0 Aug 22 13:07:06 juju-e4d256-prod-github-runner-207 kernel: [27800.606174] ? __fget_files+0x86/0xc0 Aug 22 13:07:06 juju-e4d256-prod-github-runner-207 kernel: [27800.606885] __x64_sys_ioctl+0x95/0xd0 Aug 22 13:07:06 juju-e4d256-prod-github-runner-207 kernel: [27800.607577] do_syscall_64+0x5c/0xc0 Aug 22 13:07:06 juju-e4d256-prod-github-runner-207 kernel: [27800.608240] ? do_futex+0x162/0x1f0 Aug 22 13:07:06 juju-e4d256-prod-github-runner-207 kernel: [27800.608888] ? __x64_sys_futex+0x78/0x1e0 Aug 22 13:07:06 juju-e4d256-prod-github-runner-207 kernel: [27800.609607] ? __secure_computing+0xa9/0x120 Aug 22 13:07:06 juju-e4d256-prod-github-runner-207 kernel: [27800.610319] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 13:07:06 juju-e4d256-prod-github-runner-207 kernel: [27800.611187] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:07:06 juju-e4d256-prod-github-runner-207 kernel: [27800.611930] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:07:06 juju-e4d256-prod-github-runner-207 kernel: [27800.612751] ? do_syscall_64+0x69/0xc0 Aug 22 13:07:06 juju-e4d256-prod-github-runner-207 kernel: [27800.613461] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:07:06 juju-e4d256-prod-github-runner-207 kernel: [27800.614400] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:07:06 juju-e4d256-prod-github-runner-207 kernel: [27800.615390] ? do_syscall_64+0x69/0xc0 Aug 22 13:07:06 juju-e4d256-prod-github-runner-207 kernel: [27800.616258] ? do_syscall_64+0x69/0xc0 Aug 22 13:07:06 juju-e4d256-prod-github-runner-207 kernel: [27800.617085] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 13:07:06 juju-e4d256-prod-github-runner-207 kernel: [27800.617825] RIP: 0033:0x7faa5d0edaff Aug 22 13:07:06 juju-e4d256-prod-github-runner-207 kernel: [27800.618472] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 13:07:06 juju-e4d256-prod-github-runner-207 kernel: [27800.620480] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 13:07:06 juju-e4d256-prod-github-runner-207 kernel: [27800.621403] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 13:07:06 juju-e4d256-prod-github-runner-207 kernel: [27800.622327] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 13:07:06 juju-e4d256-prod-github-runner-207 kernel: [27800.623221] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 13:07:06 juju-e4d256-prod-github-runner-207 kernel: [27800.624119] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 13:07:06 juju-e4d256-prod-github-runner-207 kernel: [27800.625050] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 13:07:06 juju-e4d256-prod-github-runner-207 kernel: [27800.625999] Aug 22 13:07:34 juju-e4d256-prod-github-runner-207 kernel: [27828.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 25809s! [qemu-system-x86:6715] Aug 22 13:07:34 juju-e4d256-prod-github-runner-207 kernel: [27828.543141] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 13:07:34 juju-e4d256-prod-github-runner-207 kernel: [27828.543218] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 13:07:34 juju-e4d256-prod-github-runner-207 kernel: [27828.555594] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 13:07:34 juju-e4d256-prod-github-runner-207 kernel: [27828.556885] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 13:07:34 juju-e4d256-prod-github-runner-207 kernel: [27828.558166] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:07:34 juju-e4d256-prod-github-runner-207 kernel: [27828.559258] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 13:07:34 juju-e4d256-prod-github-runner-207 kernel: [27828.561943] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 13:07:34 juju-e4d256-prod-github-runner-207 kernel: [27828.563019] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 13:07:34 juju-e4d256-prod-github-runner-207 kernel: [27828.564194] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 13:07:34 juju-e4d256-prod-github-runner-207 kernel: [27828.565384] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 13:07:34 juju-e4d256-prod-github-runner-207 kernel: [27828.566557] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 13:07:34 juju-e4d256-prod-github-runner-207 kernel: [27828.567737] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 13:07:34 juju-e4d256-prod-github-runner-207 kernel: [27828.568922] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 13:07:34 juju-e4d256-prod-github-runner-207 kernel: [27828.570200] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 13:07:34 juju-e4d256-prod-github-runner-207 kernel: [27828.571319] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 13:07:34 juju-e4d256-prod-github-runner-207 kernel: [27828.572531] Call Trace: Aug 22 13:07:34 juju-e4d256-prod-github-runner-207 kernel: [27828.573457] Aug 22 13:07:34 juju-e4d256-prod-github-runner-207 kernel: [27828.574346] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:07:34 juju-e4d256-prod-github-runner-207 kernel: [27828.575391] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:07:34 juju-e4d256-prod-github-runner-207 kernel: [27828.576423] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:07:34 juju-e4d256-prod-github-runner-207 kernel: [27828.577528] ? show_regs.part.0+0x23/0x29 Aug 22 13:07:34 juju-e4d256-prod-github-runner-207 kernel: [27828.578533] ? show_regs.cold+0x8/0xd Aug 22 13:07:34 juju-e4d256-prod-github-runner-207 kernel: [27828.579511] ? watchdog_timer_fn+0x1be/0x220 Aug 22 13:07:34 juju-e4d256-prod-github-runner-207 kernel: [27828.580526] ? lockup_detector_update_enable+0x60/0x60 Aug 22 13:07:34 juju-e4d256-prod-github-runner-207 kernel: [27828.581608] ? __hrtimer_run_queues+0x107/0x230 Aug 22 13:07:34 juju-e4d256-prod-github-runner-207 kernel: [27828.582652] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 13:07:34 juju-e4d256-prod-github-runner-207 kernel: [27828.583693] ? hrtimer_interrupt+0x101/0x220 Aug 22 13:07:34 juju-e4d256-prod-github-runner-207 kernel: [27828.584771] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 13:07:34 juju-e4d256-prod-github-runner-207 kernel: [27828.585930] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 13:07:34 juju-e4d256-prod-github-runner-207 kernel: [27828.587000] Aug 22 13:07:34 juju-e4d256-prod-github-runner-207 kernel: [27828.587858] Aug 22 13:07:34 juju-e4d256-prod-github-runner-207 kernel: [27828.588702] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 13:07:34 juju-e4d256-prod-github-runner-207 kernel: [27828.589759] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:07:34 juju-e4d256-prod-github-runner-207 kernel: [27828.590815] ? _raw_spin_lock+0x22/0x30 Aug 22 13:07:34 juju-e4d256-prod-github-runner-207 kernel: [27828.591770] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:07:34 juju-e4d256-prod-github-runner-207 kernel: [27828.592800] direct_page_fault+0x206/0x310 [kvm] Aug 22 13:07:34 juju-e4d256-prod-github-runner-207 kernel: [27828.593869] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 13:07:34 juju-e4d256-prod-github-runner-207 kernel: [27828.594958] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 13:07:34 juju-e4d256-prod-github-runner-207 kernel: [27828.595988] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 13:07:34 juju-e4d256-prod-github-runner-207 kernel: [27828.596968] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 13:07:34 juju-e4d256-prod-github-runner-207 kernel: [27828.597943] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 13:07:34 juju-e4d256-prod-github-runner-207 kernel: [27828.598940] handle_exit+0x98/0x230 [kvm_amd] Aug 22 13:07:34 juju-e4d256-prod-github-runner-207 kernel: [27828.599852] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 13:07:34 juju-e4d256-prod-github-runner-207 kernel: [27828.600781] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 13:07:34 juju-e4d256-prod-github-runner-207 kernel: [27828.601735] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 13:07:34 juju-e4d256-prod-github-runner-207 kernel: [27828.602651] vcpu_run+0x62/0x2c0 [kvm] Aug 22 13:07:34 juju-e4d256-prod-github-runner-207 kernel: [27828.603478] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 13:07:34 juju-e4d256-prod-github-runner-207 kernel: [27828.604302] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 13:07:34 juju-e4d256-prod-github-runner-207 kernel: [27828.605207] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 13:07:34 juju-e4d256-prod-github-runner-207 kernel: [27828.606017] ? __seccomp_filter+0x4a/0x4a0 Aug 22 13:07:34 juju-e4d256-prod-github-runner-207 kernel: [27828.606766] ? __fget_files+0x86/0xc0 Aug 22 13:07:34 juju-e4d256-prod-github-runner-207 kernel: [27828.607479] __x64_sys_ioctl+0x95/0xd0 Aug 22 13:07:34 juju-e4d256-prod-github-runner-207 kernel: [27828.608178] do_syscall_64+0x5c/0xc0 Aug 22 13:07:34 juju-e4d256-prod-github-runner-207 kernel: [27828.608851] ? do_futex+0x162/0x1f0 Aug 22 13:07:34 juju-e4d256-prod-github-runner-207 kernel: [27828.609525] ? __x64_sys_futex+0x78/0x1e0 Aug 22 13:07:34 juju-e4d256-prod-github-runner-207 kernel: [27828.610399] ? __secure_computing+0xa9/0x120 Aug 22 13:07:34 juju-e4d256-prod-github-runner-207 kernel: [27828.611101] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 13:07:34 juju-e4d256-prod-github-runner-207 kernel: [27828.611999] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:07:34 juju-e4d256-prod-github-runner-207 kernel: [27828.612732] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:07:34 juju-e4d256-prod-github-runner-207 kernel: [27828.613479] ? do_syscall_64+0x69/0xc0 Aug 22 13:07:34 juju-e4d256-prod-github-runner-207 kernel: [27828.614135] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:07:34 juju-e4d256-prod-github-runner-207 kernel: [27828.614850] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:07:34 juju-e4d256-prod-github-runner-207 kernel: [27828.615556] ? do_syscall_64+0x69/0xc0 Aug 22 13:07:34 juju-e4d256-prod-github-runner-207 kernel: [27828.616189] ? do_syscall_64+0x69/0xc0 Aug 22 13:07:34 juju-e4d256-prod-github-runner-207 kernel: [27828.616833] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 13:07:34 juju-e4d256-prod-github-runner-207 kernel: [27828.617564] RIP: 0033:0x7faa5d0edaff Aug 22 13:07:34 juju-e4d256-prod-github-runner-207 kernel: [27828.618263] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 13:07:34 juju-e4d256-prod-github-runner-207 kernel: [27828.620320] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 13:07:34 juju-e4d256-prod-github-runner-207 kernel: [27828.621267] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 13:07:34 juju-e4d256-prod-github-runner-207 kernel: [27828.622173] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 13:07:34 juju-e4d256-prod-github-runner-207 kernel: [27828.623089] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 13:07:34 juju-e4d256-prod-github-runner-207 kernel: [27828.624002] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 13:07:34 juju-e4d256-prod-github-runner-207 kernel: [27828.624906] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 13:07:34 juju-e4d256-prod-github-runner-207 kernel: [27828.625825] Aug 22 13:08:02 juju-e4d256-prod-github-runner-207 kernel: [27856.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 25835s! [qemu-system-x86:6715] Aug 22 13:08:02 juju-e4d256-prod-github-runner-207 kernel: [27856.543894] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 13:08:02 juju-e4d256-prod-github-runner-207 kernel: [27856.544204] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 13:08:02 juju-e4d256-prod-github-runner-207 kernel: [27856.556610] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 13:08:02 juju-e4d256-prod-github-runner-207 kernel: [27856.557929] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 13:08:02 juju-e4d256-prod-github-runner-207 kernel: [27856.559170] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:08:02 juju-e4d256-prod-github-runner-207 kernel: [27856.560228] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 13:08:02 juju-e4d256-prod-github-runner-207 kernel: [27856.562800] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 13:08:02 juju-e4d256-prod-github-runner-207 kernel: [27856.563844] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 13:08:02 juju-e4d256-prod-github-runner-207 kernel: [27856.565022] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 13:08:02 juju-e4d256-prod-github-runner-207 kernel: [27856.566191] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 13:08:02 juju-e4d256-prod-github-runner-207 kernel: [27856.567351] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 13:08:02 juju-e4d256-prod-github-runner-207 kernel: [27856.568518] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 13:08:02 juju-e4d256-prod-github-runner-207 kernel: [27856.569703] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 13:08:02 juju-e4d256-prod-github-runner-207 kernel: [27856.570934] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 13:08:02 juju-e4d256-prod-github-runner-207 kernel: [27856.572065] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 13:08:02 juju-e4d256-prod-github-runner-207 kernel: [27856.573289] Call Trace: Aug 22 13:08:02 juju-e4d256-prod-github-runner-207 kernel: [27856.574210] Aug 22 13:08:02 juju-e4d256-prod-github-runner-207 kernel: [27856.575114] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:08:02 juju-e4d256-prod-github-runner-207 kernel: [27856.576159] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:08:02 juju-e4d256-prod-github-runner-207 kernel: [27856.577217] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:08:02 juju-e4d256-prod-github-runner-207 kernel: [27856.578315] ? show_regs.part.0+0x23/0x29 Aug 22 13:08:02 juju-e4d256-prod-github-runner-207 kernel: [27856.579311] ? show_regs.cold+0x8/0xd Aug 22 13:08:02 juju-e4d256-prod-github-runner-207 kernel: [27856.580283] ? watchdog_timer_fn+0x1be/0x220 Aug 22 13:08:02 juju-e4d256-prod-github-runner-207 kernel: [27856.581337] ? lockup_detector_update_enable+0x60/0x60 Aug 22 13:08:02 juju-e4d256-prod-github-runner-207 kernel: [27856.582416] ? __hrtimer_run_queues+0x107/0x230 Aug 22 13:08:02 juju-e4d256-prod-github-runner-207 kernel: [27856.583443] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 13:08:02 juju-e4d256-prod-github-runner-207 kernel: [27856.584471] ? hrtimer_interrupt+0x101/0x220 Aug 22 13:08:02 juju-e4d256-prod-github-runner-207 kernel: [27856.585532] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 13:08:02 juju-e4d256-prod-github-runner-207 kernel: [27856.586622] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 13:08:02 juju-e4d256-prod-github-runner-207 kernel: [27856.587688] Aug 22 13:08:02 juju-e4d256-prod-github-runner-207 kernel: [27856.588550] Aug 22 13:08:02 juju-e4d256-prod-github-runner-207 kernel: [27856.589415] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 13:08:02 juju-e4d256-prod-github-runner-207 kernel: [27856.590450] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:08:02 juju-e4d256-prod-github-runner-207 kernel: [27856.591512] ? _raw_spin_lock+0x22/0x30 Aug 22 13:08:02 juju-e4d256-prod-github-runner-207 kernel: [27856.592486] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:08:02 juju-e4d256-prod-github-runner-207 kernel: [27856.593543] direct_page_fault+0x206/0x310 [kvm] Aug 22 13:08:02 juju-e4d256-prod-github-runner-207 kernel: [27856.594575] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 13:08:02 juju-e4d256-prod-github-runner-207 kernel: [27856.595591] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 13:08:02 juju-e4d256-prod-github-runner-207 kernel: [27856.596607] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 13:08:02 juju-e4d256-prod-github-runner-207 kernel: [27856.597647] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 13:08:02 juju-e4d256-prod-github-runner-207 kernel: [27856.598604] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 13:08:02 juju-e4d256-prod-github-runner-207 kernel: [27856.599587] handle_exit+0x98/0x230 [kvm_amd] Aug 22 13:08:02 juju-e4d256-prod-github-runner-207 kernel: [27856.600483] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 13:08:02 juju-e4d256-prod-github-runner-207 kernel: [27856.601508] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 13:08:02 juju-e4d256-prod-github-runner-207 kernel: [27856.602437] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 13:08:02 juju-e4d256-prod-github-runner-207 kernel: [27856.603339] vcpu_run+0x62/0x2c0 [kvm] Aug 22 13:08:02 juju-e4d256-prod-github-runner-207 kernel: [27856.604148] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 13:08:02 juju-e4d256-prod-github-runner-207 kernel: [27856.604973] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 13:08:02 juju-e4d256-prod-github-runner-207 kernel: [27856.605826] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 13:08:02 juju-e4d256-prod-github-runner-207 kernel: [27856.606623] ? __seccomp_filter+0x4a/0x4a0 Aug 22 13:08:02 juju-e4d256-prod-github-runner-207 kernel: [27856.607376] ? __fget_files+0x86/0xc0 Aug 22 13:08:02 juju-e4d256-prod-github-runner-207 kernel: [27856.608079] __x64_sys_ioctl+0x95/0xd0 Aug 22 13:08:02 juju-e4d256-prod-github-runner-207 kernel: [27856.608787] do_syscall_64+0x5c/0xc0 Aug 22 13:08:02 juju-e4d256-prod-github-runner-207 kernel: [27856.609464] ? do_futex+0x162/0x1f0 Aug 22 13:08:02 juju-e4d256-prod-github-runner-207 kernel: [27856.610130] ? __x64_sys_futex+0x78/0x1e0 Aug 22 13:08:02 juju-e4d256-prod-github-runner-207 kernel: [27856.610812] ? __secure_computing+0xa9/0x120 Aug 22 13:08:02 juju-e4d256-prod-github-runner-207 kernel: [27856.611502] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 13:08:02 juju-e4d256-prod-github-runner-207 kernel: [27856.612286] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:08:02 juju-e4d256-prod-github-runner-207 kernel: [27856.613030] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:08:02 juju-e4d256-prod-github-runner-207 kernel: [27856.613780] ? do_syscall_64+0x69/0xc0 Aug 22 13:08:02 juju-e4d256-prod-github-runner-207 kernel: [27856.614444] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:08:02 juju-e4d256-prod-github-runner-207 kernel: [27856.615147] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:08:02 juju-e4d256-prod-github-runner-207 kernel: [27856.615843] ? do_syscall_64+0x69/0xc0 Aug 22 13:08:02 juju-e4d256-prod-github-runner-207 kernel: [27856.616486] ? do_syscall_64+0x69/0xc0 Aug 22 13:08:02 juju-e4d256-prod-github-runner-207 kernel: [27856.617122] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 13:08:02 juju-e4d256-prod-github-runner-207 kernel: [27856.617856] RIP: 0033:0x7faa5d0edaff Aug 22 13:08:02 juju-e4d256-prod-github-runner-207 kernel: [27856.618529] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 13:08:02 juju-e4d256-prod-github-runner-207 kernel: [27856.620514] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 13:08:02 juju-e4d256-prod-github-runner-207 kernel: [27856.621435] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 13:08:02 juju-e4d256-prod-github-runner-207 kernel: [27856.622332] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 13:08:02 juju-e4d256-prod-github-runner-207 kernel: [27856.623218] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 13:08:02 juju-e4d256-prod-github-runner-207 kernel: [27856.624101] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 13:08:02 juju-e4d256-prod-github-runner-207 kernel: [27856.625001] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 13:08:02 juju-e4d256-prod-github-runner-207 kernel: [27856.625892] Aug 22 13:08:30 juju-e4d256-prod-github-runner-207 kernel: [27884.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 25861s! [qemu-system-x86:6715] Aug 22 13:08:30 juju-e4d256-prod-github-runner-207 kernel: [27884.543119] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 13:08:30 juju-e4d256-prod-github-runner-207 kernel: [27884.543199] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 13:08:30 juju-e4d256-prod-github-runner-207 kernel: [27884.559416] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 13:08:30 juju-e4d256-prod-github-runner-207 kernel: [27884.560750] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 13:08:30 juju-e4d256-prod-github-runner-207 kernel: [27884.561983] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:08:30 juju-e4d256-prod-github-runner-207 kernel: [27884.563041] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 13:08:30 juju-e4d256-prod-github-runner-207 kernel: [27884.566363] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 13:08:30 juju-e4d256-prod-github-runner-207 kernel: [27884.567903] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 13:08:30 juju-e4d256-prod-github-runner-207 kernel: [27884.569698] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 13:08:30 juju-e4d256-prod-github-runner-207 kernel: [27884.571359] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 13:08:30 juju-e4d256-prod-github-runner-207 kernel: [27884.572993] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 13:08:30 juju-e4d256-prod-github-runner-207 kernel: [27884.574568] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 13:08:30 juju-e4d256-prod-github-runner-207 kernel: [27884.576156] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 13:08:30 juju-e4d256-prod-github-runner-207 kernel: [27884.577684] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 13:08:30 juju-e4d256-prod-github-runner-207 kernel: [27884.579232] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 13:08:30 juju-e4d256-prod-github-runner-207 kernel: [27884.580938] Call Trace: Aug 22 13:08:30 juju-e4d256-prod-github-runner-207 kernel: [27884.582153] Aug 22 13:08:30 juju-e4d256-prod-github-runner-207 kernel: [27884.583451] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:08:30 juju-e4d256-prod-github-runner-207 kernel: [27884.584908] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:08:30 juju-e4d256-prod-github-runner-207 kernel: [27884.586352] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:08:30 juju-e4d256-prod-github-runner-207 kernel: [27884.587890] ? show_regs.part.0+0x23/0x29 Aug 22 13:08:30 juju-e4d256-prod-github-runner-207 kernel: [27884.589273] ? show_regs.cold+0x8/0xd Aug 22 13:08:30 juju-e4d256-prod-github-runner-207 kernel: [27884.590721] ? watchdog_timer_fn+0x1be/0x220 Aug 22 13:08:30 juju-e4d256-prod-github-runner-207 kernel: [27884.592131] ? lockup_detector_update_enable+0x60/0x60 Aug 22 13:08:30 juju-e4d256-prod-github-runner-207 kernel: [27884.593343] ? __hrtimer_run_queues+0x107/0x230 Aug 22 13:08:30 juju-e4d256-prod-github-runner-207 kernel: [27884.594385] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 13:08:30 juju-e4d256-prod-github-runner-207 kernel: [27884.595411] ? hrtimer_interrupt+0x101/0x220 Aug 22 13:08:30 juju-e4d256-prod-github-runner-207 kernel: [27884.596468] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 13:08:30 juju-e4d256-prod-github-runner-207 kernel: [27884.597544] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 13:08:30 juju-e4d256-prod-github-runner-207 kernel: [27884.598598] Aug 22 13:08:30 juju-e4d256-prod-github-runner-207 kernel: [27884.599463] Aug 22 13:08:30 juju-e4d256-prod-github-runner-207 kernel: [27884.600306] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 13:08:30 juju-e4d256-prod-github-runner-207 kernel: [27884.601548] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:08:30 juju-e4d256-prod-github-runner-207 kernel: [27884.602596] ? _raw_spin_lock+0x22/0x30 Aug 22 13:08:30 juju-e4d256-prod-github-runner-207 kernel: [27884.603549] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:08:30 juju-e4d256-prod-github-runner-207 kernel: [27884.604599] direct_page_fault+0x206/0x310 [kvm] Aug 22 13:08:30 juju-e4d256-prod-github-runner-207 kernel: [27884.605630] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 13:08:30 juju-e4d256-prod-github-runner-207 kernel: [27884.606642] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 13:08:30 juju-e4d256-prod-github-runner-207 kernel: [27884.607648] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 13:08:30 juju-e4d256-prod-github-runner-207 kernel: [27884.608637] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 13:08:30 juju-e4d256-prod-github-runner-207 kernel: [27884.609588] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 13:08:30 juju-e4d256-prod-github-runner-207 kernel: [27884.610593] handle_exit+0x98/0x230 [kvm_amd] Aug 22 13:08:30 juju-e4d256-prod-github-runner-207 kernel: [27884.611511] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 13:08:30 juju-e4d256-prod-github-runner-207 kernel: [27884.612450] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 13:08:30 juju-e4d256-prod-github-runner-207 kernel: [27884.613386] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 13:08:30 juju-e4d256-prod-github-runner-207 kernel: [27884.614291] vcpu_run+0x62/0x2c0 [kvm] Aug 22 13:08:30 juju-e4d256-prod-github-runner-207 kernel: [27884.615109] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 13:08:30 juju-e4d256-prod-github-runner-207 kernel: [27884.615925] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 13:08:30 juju-e4d256-prod-github-runner-207 kernel: [27884.617164] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 13:08:30 juju-e4d256-prod-github-runner-207 kernel: [27884.618313] ? __seccomp_filter+0x4a/0x4a0 Aug 22 13:08:30 juju-e4d256-prod-github-runner-207 kernel: [27884.619411] ? __fget_files+0x86/0xc0 Aug 22 13:08:30 juju-e4d256-prod-github-runner-207 kernel: [27884.620436] __x64_sys_ioctl+0x95/0xd0 Aug 22 13:08:30 juju-e4d256-prod-github-runner-207 kernel: [27884.621423] do_syscall_64+0x5c/0xc0 Aug 22 13:08:30 juju-e4d256-prod-github-runner-207 kernel: [27884.622437] ? do_futex+0x162/0x1f0 Aug 22 13:08:30 juju-e4d256-prod-github-runner-207 kernel: [27884.623346] ? __x64_sys_futex+0x78/0x1e0 Aug 22 13:08:30 juju-e4d256-prod-github-runner-207 kernel: [27884.624337] ? __secure_computing+0xa9/0x120 Aug 22 13:08:30 juju-e4d256-prod-github-runner-207 kernel: [27884.625353] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 13:08:30 juju-e4d256-prod-github-runner-207 kernel: [27884.626387] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:08:30 juju-e4d256-prod-github-runner-207 kernel: [27884.627369] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:08:30 juju-e4d256-prod-github-runner-207 kernel: [27884.628390] ? do_syscall_64+0x69/0xc0 Aug 22 13:08:30 juju-e4d256-prod-github-runner-207 kernel: [27884.629288] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:08:30 juju-e4d256-prod-github-runner-207 kernel: [27884.630257] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:08:30 juju-e4d256-prod-github-runner-207 kernel: [27884.631245] ? do_syscall_64+0x69/0xc0 Aug 22 13:08:30 juju-e4d256-prod-github-runner-207 kernel: [27884.632046] ? do_syscall_64+0x69/0xc0 Aug 22 13:08:30 juju-e4d256-prod-github-runner-207 kernel: [27884.632859] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 13:08:30 juju-e4d256-prod-github-runner-207 kernel: [27884.633827] RIP: 0033:0x7faa5d0edaff Aug 22 13:08:30 juju-e4d256-prod-github-runner-207 kernel: [27884.634808] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 13:08:30 juju-e4d256-prod-github-runner-207 kernel: [27884.637597] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 13:08:30 juju-e4d256-prod-github-runner-207 kernel: [27884.638904] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 13:08:30 juju-e4d256-prod-github-runner-207 kernel: [27884.640084] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 13:08:30 juju-e4d256-prod-github-runner-207 kernel: [27884.641175] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 13:08:30 juju-e4d256-prod-github-runner-207 kernel: [27884.642401] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 13:08:30 juju-e4d256-prod-github-runner-207 kernel: [27884.643616] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 13:08:30 juju-e4d256-prod-github-runner-207 kernel: [27884.644782] Aug 22 13:08:45 juju-e4d256-prod-github-runner-207 kernel: [27899.048707] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 13:08:45 juju-e4d256-prod-github-runner-207 kernel: [27899.049679] rcu: 1-....: (6923816 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=3347675 Aug 22 13:08:45 juju-e4d256-prod-github-runner-207 kernel: [27899.050806] (t=6945462 jiffies g=23269 q=31789) Aug 22 13:08:45 juju-e4d256-prod-github-runner-207 kernel: [27899.051596] NMI backtrace for cpu 1 Aug 22 13:08:45 juju-e4d256-prod-github-runner-207 kernel: [27899.052331] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 13:08:45 juju-e4d256-prod-github-runner-207 kernel: [27899.053458] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 13:08:45 juju-e4d256-prod-github-runner-207 kernel: [27899.054528] Call Trace: Aug 22 13:08:45 juju-e4d256-prod-github-runner-207 kernel: [27899.055203] Aug 22 13:08:45 juju-e4d256-prod-github-runner-207 kernel: [27899.055862] show_stack+0x52/0x5c Aug 22 13:08:45 juju-e4d256-prod-github-runner-207 kernel: [27899.056608] dump_stack_lvl+0x4a/0x63 Aug 22 13:08:45 juju-e4d256-prod-github-runner-207 kernel: [27899.057357] dump_stack+0x10/0x16 Aug 22 13:08:45 juju-e4d256-prod-github-runner-207 kernel: [27899.058077] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 13:08:45 juju-e4d256-prod-github-runner-207 kernel: [27899.058875] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 13:08:45 juju-e4d256-prod-github-runner-207 kernel: [27899.059670] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 13:08:45 juju-e4d256-prod-github-runner-207 kernel: [27899.060513] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 13:08:45 juju-e4d256-prod-github-runner-207 kernel: [27899.061338] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 13:08:45 juju-e4d256-prod-github-runner-207 kernel: [27899.062159] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 13:08:45 juju-e4d256-prod-github-runner-207 kernel: [27899.062935] print_cpu_stall.cold+0x2f/0xe2 Aug 22 13:08:45 juju-e4d256-prod-github-runner-207 kernel: [27899.063707] ? timekeeping_update+0xf7/0x150 Aug 22 13:08:45 juju-e4d256-prod-github-runner-207 kernel: [27899.064497] check_cpu_stall+0x109/0x270 Aug 22 13:08:45 juju-e4d256-prod-github-runner-207 kernel: [27899.065258] rcu_sched_clock_irq+0x9a/0x250 Aug 22 13:08:45 juju-e4d256-prod-github-runner-207 kernel: [27899.066025] update_process_times+0x94/0xd0 Aug 22 13:08:45 juju-e4d256-prod-github-runner-207 kernel: [27899.066788] tick_sched_handle+0x29/0x70 Aug 22 13:08:45 juju-e4d256-prod-github-runner-207 kernel: [27899.067535] tick_sched_timer+0x8c/0xc0 Aug 22 13:08:45 juju-e4d256-prod-github-runner-207 kernel: [27899.068309] ? tick_nohz_handler+0xb0/0xb0 Aug 22 13:08:45 juju-e4d256-prod-github-runner-207 kernel: [27899.069069] __hrtimer_run_queues+0x107/0x230 Aug 22 13:08:45 juju-e4d256-prod-github-runner-207 kernel: [27899.069850] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 13:08:45 juju-e4d256-prod-github-runner-207 kernel: [27899.070635] hrtimer_interrupt+0x101/0x220 Aug 22 13:08:45 juju-e4d256-prod-github-runner-207 kernel: [27899.071401] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 13:08:45 juju-e4d256-prod-github-runner-207 kernel: [27899.072239] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 13:08:45 juju-e4d256-prod-github-runner-207 kernel: [27899.073042] Aug 22 13:08:45 juju-e4d256-prod-github-runner-207 kernel: [27899.073738] Aug 22 13:08:45 juju-e4d256-prod-github-runner-207 kernel: [27899.074375] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 13:08:45 juju-e4d256-prod-github-runner-207 kernel: [27899.075216] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:08:45 juju-e4d256-prod-github-runner-207 kernel: [27899.076097] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 13:08:45 juju-e4d256-prod-github-runner-207 kernel: [27899.078342] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 13:08:45 juju-e4d256-prod-github-runner-207 kernel: [27899.079220] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 13:08:45 juju-e4d256-prod-github-runner-207 kernel: [27899.080235] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 13:08:45 juju-e4d256-prod-github-runner-207 kernel: [27899.081223] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 13:08:45 juju-e4d256-prod-github-runner-207 kernel: [27899.082203] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 13:08:45 juju-e4d256-prod-github-runner-207 kernel: [27899.083178] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 13:08:45 juju-e4d256-prod-github-runner-207 kernel: [27899.084184] ? _raw_spin_lock+0x22/0x30 Aug 22 13:08:45 juju-e4d256-prod-github-runner-207 kernel: [27899.084950] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:08:45 juju-e4d256-prod-github-runner-207 kernel: [27899.085790] direct_page_fault+0x206/0x310 [kvm] Aug 22 13:08:45 juju-e4d256-prod-github-runner-207 kernel: [27899.086636] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 13:08:45 juju-e4d256-prod-github-runner-207 kernel: [27899.087477] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 13:08:45 juju-e4d256-prod-github-runner-207 kernel: [27899.088341] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 13:08:45 juju-e4d256-prod-github-runner-207 kernel: [27899.089152] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 13:08:45 juju-e4d256-prod-github-runner-207 kernel: [27899.089942] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 13:08:45 juju-e4d256-prod-github-runner-207 kernel: [27899.090775] handle_exit+0x98/0x230 [kvm_amd] Aug 22 13:08:45 juju-e4d256-prod-github-runner-207 kernel: [27899.091534] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 13:08:45 juju-e4d256-prod-github-runner-207 kernel: [27899.092333] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 13:08:45 juju-e4d256-prod-github-runner-207 kernel: [27899.093137] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 13:08:45 juju-e4d256-prod-github-runner-207 kernel: [27899.093934] vcpu_run+0x62/0x2c0 [kvm] Aug 22 13:08:45 juju-e4d256-prod-github-runner-207 kernel: [27899.094653] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 13:08:45 juju-e4d256-prod-github-runner-207 kernel: [27899.095394] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 13:08:45 juju-e4d256-prod-github-runner-207 kernel: [27899.096207] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 13:08:45 juju-e4d256-prod-github-runner-207 kernel: [27899.096999] ? __seccomp_filter+0x4a/0x4a0 Aug 22 13:08:45 juju-e4d256-prod-github-runner-207 kernel: [27899.097725] ? __fget_files+0x86/0xc0 Aug 22 13:08:45 juju-e4d256-prod-github-runner-207 kernel: [27899.098450] __x64_sys_ioctl+0x95/0xd0 Aug 22 13:08:45 juju-e4d256-prod-github-runner-207 kernel: [27899.099150] do_syscall_64+0x5c/0xc0 Aug 22 13:08:45 juju-e4d256-prod-github-runner-207 kernel: [27899.099845] ? do_futex+0x162/0x1f0 Aug 22 13:08:45 juju-e4d256-prod-github-runner-207 kernel: [27899.100537] ? __x64_sys_futex+0x78/0x1e0 Aug 22 13:08:45 juju-e4d256-prod-github-runner-207 kernel: [27899.101270] ? __secure_computing+0xa9/0x120 Aug 22 13:08:45 juju-e4d256-prod-github-runner-207 kernel: [27899.101992] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 13:08:45 juju-e4d256-prod-github-runner-207 kernel: [27899.102808] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:08:45 juju-e4d256-prod-github-runner-207 kernel: [27899.103566] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:08:45 juju-e4d256-prod-github-runner-207 kernel: [27899.104347] ? do_syscall_64+0x69/0xc0 Aug 22 13:08:45 juju-e4d256-prod-github-runner-207 kernel: [27899.105060] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:08:45 juju-e4d256-prod-github-runner-207 kernel: [27899.105829] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:08:45 juju-e4d256-prod-github-runner-207 kernel: [27899.106602] ? do_syscall_64+0x69/0xc0 Aug 22 13:08:45 juju-e4d256-prod-github-runner-207 kernel: [27899.107308] ? do_syscall_64+0x69/0xc0 Aug 22 13:08:45 juju-e4d256-prod-github-runner-207 kernel: [27899.107997] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 13:08:45 juju-e4d256-prod-github-runner-207 kernel: [27899.108781] RIP: 0033:0x7faa5d0edaff Aug 22 13:08:45 juju-e4d256-prod-github-runner-207 kernel: [27899.109469] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 13:08:45 juju-e4d256-prod-github-runner-207 kernel: [27899.111600] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 13:08:45 juju-e4d256-prod-github-runner-207 kernel: [27899.112589] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 13:08:45 juju-e4d256-prod-github-runner-207 kernel: [27899.113661] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 13:08:45 juju-e4d256-prod-github-runner-207 kernel: [27899.114616] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 13:08:45 juju-e4d256-prod-github-runner-207 kernel: [27899.115606] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 13:08:45 juju-e4d256-prod-github-runner-207 kernel: [27899.116599] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 13:08:45 juju-e4d256-prod-github-runner-207 kernel: [27899.117553] Aug 22 13:09:10 juju-e4d256-prod-github-runner-207 kernel: [27924.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 25898s! [qemu-system-x86:6715] Aug 22 13:09:10 juju-e4d256-prod-github-runner-207 kernel: [27924.543165] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 13:09:10 juju-e4d256-prod-github-runner-207 kernel: [27924.543240] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 13:09:10 juju-e4d256-prod-github-runner-207 kernel: [27924.555775] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 13:09:10 juju-e4d256-prod-github-runner-207 kernel: [27924.557086] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 13:09:10 juju-e4d256-prod-github-runner-207 kernel: [27924.558326] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:09:10 juju-e4d256-prod-github-runner-207 kernel: [27924.559402] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 13:09:10 juju-e4d256-prod-github-runner-207 kernel: [27924.562045] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 13:09:10 juju-e4d256-prod-github-runner-207 kernel: [27924.563104] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 13:09:10 juju-e4d256-prod-github-runner-207 kernel: [27924.564295] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 13:09:10 juju-e4d256-prod-github-runner-207 kernel: [27924.565477] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 13:09:10 juju-e4d256-prod-github-runner-207 kernel: [27924.566657] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 13:09:10 juju-e4d256-prod-github-runner-207 kernel: [27924.567841] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 13:09:10 juju-e4d256-prod-github-runner-207 kernel: [27924.569037] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 13:09:10 juju-e4d256-prod-github-runner-207 kernel: [27924.570288] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 13:09:10 juju-e4d256-prod-github-runner-207 kernel: [27924.571397] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 13:09:10 juju-e4d256-prod-github-runner-207 kernel: [27924.572612] Call Trace: Aug 22 13:09:10 juju-e4d256-prod-github-runner-207 kernel: [27924.573530] Aug 22 13:09:10 juju-e4d256-prod-github-runner-207 kernel: [27924.574418] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:09:10 juju-e4d256-prod-github-runner-207 kernel: [27924.575454] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:09:10 juju-e4d256-prod-github-runner-207 kernel: [27924.576490] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:09:10 juju-e4d256-prod-github-runner-207 kernel: [27924.577579] ? show_regs.part.0+0x23/0x29 Aug 22 13:09:10 juju-e4d256-prod-github-runner-207 kernel: [27924.578583] ? show_regs.cold+0x8/0xd Aug 22 13:09:10 juju-e4d256-prod-github-runner-207 kernel: [27924.579575] ? watchdog_timer_fn+0x1be/0x220 Aug 22 13:09:10 juju-e4d256-prod-github-runner-207 kernel: [27924.580626] ? lockup_detector_update_enable+0x60/0x60 Aug 22 13:09:10 juju-e4d256-prod-github-runner-207 kernel: [27924.581700] ? __hrtimer_run_queues+0x107/0x230 Aug 22 13:09:10 juju-e4d256-prod-github-runner-207 kernel: [27924.582739] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 13:09:10 juju-e4d256-prod-github-runner-207 kernel: [27924.583777] ? hrtimer_interrupt+0x101/0x220 Aug 22 13:09:10 juju-e4d256-prod-github-runner-207 kernel: [27924.584815] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 13:09:10 juju-e4d256-prod-github-runner-207 kernel: [27924.585891] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 13:09:10 juju-e4d256-prod-github-runner-207 kernel: [27924.586971] Aug 22 13:09:10 juju-e4d256-prod-github-runner-207 kernel: [27924.587868] Aug 22 13:09:10 juju-e4d256-prod-github-runner-207 kernel: [27924.588715] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 13:09:10 juju-e4d256-prod-github-runner-207 kernel: [27924.589770] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:09:10 juju-e4d256-prod-github-runner-207 kernel: [27924.591055] ? _raw_spin_lock+0x22/0x30 Aug 22 13:09:10 juju-e4d256-prod-github-runner-207 kernel: [27924.592036] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:09:10 juju-e4d256-prod-github-runner-207 kernel: [27924.593083] direct_page_fault+0x206/0x310 [kvm] Aug 22 13:09:10 juju-e4d256-prod-github-runner-207 kernel: [27924.594122] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 13:09:10 juju-e4d256-prod-github-runner-207 kernel: [27924.595140] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 13:09:10 juju-e4d256-prod-github-runner-207 kernel: [27924.596162] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 13:09:10 juju-e4d256-prod-github-runner-207 kernel: [27924.597148] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 13:09:10 juju-e4d256-prod-github-runner-207 kernel: [27924.598104] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 13:09:10 juju-e4d256-prod-github-runner-207 kernel: [27924.599092] handle_exit+0x98/0x230 [kvm_amd] Aug 22 13:09:10 juju-e4d256-prod-github-runner-207 kernel: [27924.600003] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 13:09:10 juju-e4d256-prod-github-runner-207 kernel: [27924.600934] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 13:09:10 juju-e4d256-prod-github-runner-207 kernel: [27924.601871] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 13:09:10 juju-e4d256-prod-github-runner-207 kernel: [27924.602792] vcpu_run+0x62/0x2c0 [kvm] Aug 22 13:09:10 juju-e4d256-prod-github-runner-207 kernel: [27924.603610] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 13:09:10 juju-e4d256-prod-github-runner-207 kernel: [27924.604438] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 13:09:10 juju-e4d256-prod-github-runner-207 kernel: [27924.605329] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 13:09:10 juju-e4d256-prod-github-runner-207 kernel: [27924.606134] ? __seccomp_filter+0x4a/0x4a0 Aug 22 13:09:10 juju-e4d256-prod-github-runner-207 kernel: [27924.606883] ? __fget_files+0x86/0xc0 Aug 22 13:09:10 juju-e4d256-prod-github-runner-207 kernel: [27924.607592] __x64_sys_ioctl+0x95/0xd0 Aug 22 13:09:10 juju-e4d256-prod-github-runner-207 kernel: [27924.608298] do_syscall_64+0x5c/0xc0 Aug 22 13:09:10 juju-e4d256-prod-github-runner-207 kernel: [27924.608971] ? do_futex+0x162/0x1f0 Aug 22 13:09:10 juju-e4d256-prod-github-runner-207 kernel: [27924.609639] ? __x64_sys_futex+0x78/0x1e0 Aug 22 13:09:10 juju-e4d256-prod-github-runner-207 kernel: [27924.610333] ? __secure_computing+0xa9/0x120 Aug 22 13:09:10 juju-e4d256-prod-github-runner-207 kernel: [27924.611113] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 13:09:10 juju-e4d256-prod-github-runner-207 kernel: [27924.611907] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:09:10 juju-e4d256-prod-github-runner-207 kernel: [27924.612642] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:09:10 juju-e4d256-prod-github-runner-207 kernel: [27924.613371] ? do_syscall_64+0x69/0xc0 Aug 22 13:09:10 juju-e4d256-prod-github-runner-207 kernel: [27924.614032] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:09:10 juju-e4d256-prod-github-runner-207 kernel: [27924.614755] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:09:10 juju-e4d256-prod-github-runner-207 kernel: [27924.615460] ? do_syscall_64+0x69/0xc0 Aug 22 13:09:10 juju-e4d256-prod-github-runner-207 kernel: [27924.616103] ? do_syscall_64+0x69/0xc0 Aug 22 13:09:10 juju-e4d256-prod-github-runner-207 kernel: [27924.616739] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 13:09:10 juju-e4d256-prod-github-runner-207 kernel: [27924.617453] RIP: 0033:0x7faa5d0edaff Aug 22 13:09:10 juju-e4d256-prod-github-runner-207 kernel: [27924.618084] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 13:09:10 juju-e4d256-prod-github-runner-207 kernel: [27924.620102] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 13:09:10 juju-e4d256-prod-github-runner-207 kernel: [27924.621032] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 13:09:10 juju-e4d256-prod-github-runner-207 kernel: [27924.621936] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 13:09:10 juju-e4d256-prod-github-runner-207 kernel: [27924.622837] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 13:09:10 juju-e4d256-prod-github-runner-207 kernel: [27924.623735] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 13:09:10 juju-e4d256-prod-github-runner-207 kernel: [27924.624653] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 13:09:10 juju-e4d256-prod-github-runner-207 kernel: [27924.625562] Aug 22 13:09:38 juju-e4d256-prod-github-runner-207 kernel: [27952.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 25924s! [qemu-system-x86:6715] Aug 22 13:09:38 juju-e4d256-prod-github-runner-207 kernel: [27952.543828] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 13:09:38 juju-e4d256-prod-github-runner-207 kernel: [27952.544128] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 13:09:38 juju-e4d256-prod-github-runner-207 kernel: [27952.556247] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 13:09:38 juju-e4d256-prod-github-runner-207 kernel: [27952.557515] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 13:09:38 juju-e4d256-prod-github-runner-207 kernel: [27952.558737] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:09:38 juju-e4d256-prod-github-runner-207 kernel: [27952.559811] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 13:09:38 juju-e4d256-prod-github-runner-207 kernel: [27952.562391] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 13:09:38 juju-e4d256-prod-github-runner-207 kernel: [27952.563439] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 13:09:38 juju-e4d256-prod-github-runner-207 kernel: [27952.564654] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 13:09:38 juju-e4d256-prod-github-runner-207 kernel: [27952.565822] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 13:09:38 juju-e4d256-prod-github-runner-207 kernel: [27952.566988] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 13:09:38 juju-e4d256-prod-github-runner-207 kernel: [27952.568168] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 13:09:38 juju-e4d256-prod-github-runner-207 kernel: [27952.569333] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 13:09:38 juju-e4d256-prod-github-runner-207 kernel: [27952.570562] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 13:09:38 juju-e4d256-prod-github-runner-207 kernel: [27952.571662] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 13:09:38 juju-e4d256-prod-github-runner-207 kernel: [27952.572854] Call Trace: Aug 22 13:09:38 juju-e4d256-prod-github-runner-207 kernel: [27952.573764] Aug 22 13:09:38 juju-e4d256-prod-github-runner-207 kernel: [27952.574656] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:09:38 juju-e4d256-prod-github-runner-207 kernel: [27952.575699] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:09:38 juju-e4d256-prod-github-runner-207 kernel: [27952.576717] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:09:38 juju-e4d256-prod-github-runner-207 kernel: [27952.577917] ? show_regs.part.0+0x23/0x29 Aug 22 13:09:38 juju-e4d256-prod-github-runner-207 kernel: [27952.578943] ? show_regs.cold+0x8/0xd Aug 22 13:09:38 juju-e4d256-prod-github-runner-207 kernel: [27952.579929] ? watchdog_timer_fn+0x1be/0x220 Aug 22 13:09:38 juju-e4d256-prod-github-runner-207 kernel: [27952.580943] ? lockup_detector_update_enable+0x60/0x60 Aug 22 13:09:38 juju-e4d256-prod-github-runner-207 kernel: [27952.582003] ? __hrtimer_run_queues+0x107/0x230 Aug 22 13:09:38 juju-e4d256-prod-github-runner-207 kernel: [27952.583029] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 13:09:38 juju-e4d256-prod-github-runner-207 kernel: [27952.584061] ? hrtimer_interrupt+0x101/0x220 Aug 22 13:09:38 juju-e4d256-prod-github-runner-207 kernel: [27952.585073] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 13:09:38 juju-e4d256-prod-github-runner-207 kernel: [27952.586139] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 13:09:38 juju-e4d256-prod-github-runner-207 kernel: [27952.587181] Aug 22 13:09:38 juju-e4d256-prod-github-runner-207 kernel: [27952.588039] Aug 22 13:09:38 juju-e4d256-prod-github-runner-207 kernel: [27952.588904] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 13:09:38 juju-e4d256-prod-github-runner-207 kernel: [27952.589939] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:09:38 juju-e4d256-prod-github-runner-207 kernel: [27952.590979] ? _raw_spin_lock+0x22/0x30 Aug 22 13:09:38 juju-e4d256-prod-github-runner-207 kernel: [27952.591935] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:09:38 juju-e4d256-prod-github-runner-207 kernel: [27952.592955] direct_page_fault+0x206/0x310 [kvm] Aug 22 13:09:38 juju-e4d256-prod-github-runner-207 kernel: [27952.593982] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 13:09:38 juju-e4d256-prod-github-runner-207 kernel: [27952.594994] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 13:09:38 juju-e4d256-prod-github-runner-207 kernel: [27952.596009] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 13:09:38 juju-e4d256-prod-github-runner-207 kernel: [27952.597012] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 13:09:38 juju-e4d256-prod-github-runner-207 kernel: [27952.597958] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 13:09:38 juju-e4d256-prod-github-runner-207 kernel: [27952.598933] handle_exit+0x98/0x230 [kvm_amd] Aug 22 13:09:38 juju-e4d256-prod-github-runner-207 kernel: [27952.599884] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 13:09:38 juju-e4d256-prod-github-runner-207 kernel: [27952.600802] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 13:09:38 juju-e4d256-prod-github-runner-207 kernel: [27952.601738] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 13:09:38 juju-e4d256-prod-github-runner-207 kernel: [27952.602656] vcpu_run+0x62/0x2c0 [kvm] Aug 22 13:09:38 juju-e4d256-prod-github-runner-207 kernel: [27952.603478] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 13:09:38 juju-e4d256-prod-github-runner-207 kernel: [27952.604306] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 13:09:38 juju-e4d256-prod-github-runner-207 kernel: [27952.605158] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 13:09:38 juju-e4d256-prod-github-runner-207 kernel: [27952.605953] ? __seccomp_filter+0x4a/0x4a0 Aug 22 13:09:38 juju-e4d256-prod-github-runner-207 kernel: [27952.606695] ? __fget_files+0x86/0xc0 Aug 22 13:09:38 juju-e4d256-prod-github-runner-207 kernel: [27952.607396] __x64_sys_ioctl+0x95/0xd0 Aug 22 13:09:38 juju-e4d256-prod-github-runner-207 kernel: [27952.608102] do_syscall_64+0x5c/0xc0 Aug 22 13:09:38 juju-e4d256-prod-github-runner-207 kernel: [27952.608766] ? do_futex+0x162/0x1f0 Aug 22 13:09:38 juju-e4d256-prod-github-runner-207 kernel: [27952.609411] ? __x64_sys_futex+0x78/0x1e0 Aug 22 13:09:38 juju-e4d256-prod-github-runner-207 kernel: [27952.610086] ? __secure_computing+0xa9/0x120 Aug 22 13:09:38 juju-e4d256-prod-github-runner-207 kernel: [27952.610774] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 13:09:38 juju-e4d256-prod-github-runner-207 kernel: [27952.611551] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:09:38 juju-e4d256-prod-github-runner-207 kernel: [27952.612271] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:09:38 juju-e4d256-prod-github-runner-207 kernel: [27952.612995] ? do_syscall_64+0x69/0xc0 Aug 22 13:09:38 juju-e4d256-prod-github-runner-207 kernel: [27952.613639] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:09:38 juju-e4d256-prod-github-runner-207 kernel: [27952.614340] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:09:38 juju-e4d256-prod-github-runner-207 kernel: [27952.615034] ? do_syscall_64+0x69/0xc0 Aug 22 13:09:38 juju-e4d256-prod-github-runner-207 kernel: [27952.615669] ? do_syscall_64+0x69/0xc0 Aug 22 13:09:38 juju-e4d256-prod-github-runner-207 kernel: [27952.616293] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 13:09:38 juju-e4d256-prod-github-runner-207 kernel: [27952.617001] RIP: 0033:0x7faa5d0edaff Aug 22 13:09:38 juju-e4d256-prod-github-runner-207 kernel: [27952.617650] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 13:09:38 juju-e4d256-prod-github-runner-207 kernel: [27952.619685] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 13:09:38 juju-e4d256-prod-github-runner-207 kernel: [27952.620607] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 13:09:38 juju-e4d256-prod-github-runner-207 kernel: [27952.621561] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 13:09:38 juju-e4d256-prod-github-runner-207 kernel: [27952.622461] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 13:09:38 juju-e4d256-prod-github-runner-207 kernel: [27952.623349] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 13:09:38 juju-e4d256-prod-github-runner-207 kernel: [27952.624250] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 13:09:38 juju-e4d256-prod-github-runner-207 kernel: [27952.625140] Aug 22 13:10:06 juju-e4d256-prod-github-runner-207 kernel: [27980.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 25950s! [qemu-system-x86:6715] Aug 22 13:10:06 juju-e4d256-prod-github-runner-207 kernel: [27980.543118] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 13:10:06 juju-e4d256-prod-github-runner-207 kernel: [27980.543205] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 13:10:06 juju-e4d256-prod-github-runner-207 kernel: [27980.555512] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 13:10:06 juju-e4d256-prod-github-runner-207 kernel: [27980.556779] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 13:10:06 juju-e4d256-prod-github-runner-207 kernel: [27980.558003] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:10:06 juju-e4d256-prod-github-runner-207 kernel: [27980.559077] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 13:10:06 juju-e4d256-prod-github-runner-207 kernel: [27980.561662] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 13:10:06 juju-e4d256-prod-github-runner-207 kernel: [27980.562733] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 13:10:06 juju-e4d256-prod-github-runner-207 kernel: [27980.563925] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 13:10:06 juju-e4d256-prod-github-runner-207 kernel: [27980.565323] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 13:10:06 juju-e4d256-prod-github-runner-207 kernel: [27980.566482] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 13:10:06 juju-e4d256-prod-github-runner-207 kernel: [27980.567658] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 13:10:06 juju-e4d256-prod-github-runner-207 kernel: [27980.568822] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 13:10:06 juju-e4d256-prod-github-runner-207 kernel: [27980.570050] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 13:10:06 juju-e4d256-prod-github-runner-207 kernel: [27980.571167] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 13:10:06 juju-e4d256-prod-github-runner-207 kernel: [27980.572367] Call Trace: Aug 22 13:10:06 juju-e4d256-prod-github-runner-207 kernel: [27980.573278] Aug 22 13:10:06 juju-e4d256-prod-github-runner-207 kernel: [27980.574160] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:10:06 juju-e4d256-prod-github-runner-207 kernel: [27980.575202] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:10:06 juju-e4d256-prod-github-runner-207 kernel: [27980.576221] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:10:06 juju-e4d256-prod-github-runner-207 kernel: [27980.577294] ? show_regs.part.0+0x23/0x29 Aug 22 13:10:06 juju-e4d256-prod-github-runner-207 kernel: [27980.578290] ? show_regs.cold+0x8/0xd Aug 22 13:10:06 juju-e4d256-prod-github-runner-207 kernel: [27980.579273] ? watchdog_timer_fn+0x1be/0x220 Aug 22 13:10:06 juju-e4d256-prod-github-runner-207 kernel: [27980.580297] ? lockup_detector_update_enable+0x60/0x60 Aug 22 13:10:06 juju-e4d256-prod-github-runner-207 kernel: [27980.581366] ? __hrtimer_run_queues+0x107/0x230 Aug 22 13:10:06 juju-e4d256-prod-github-runner-207 kernel: [27980.582432] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 13:10:06 juju-e4d256-prod-github-runner-207 kernel: [27980.583486] ? hrtimer_interrupt+0x101/0x220 Aug 22 13:10:06 juju-e4d256-prod-github-runner-207 kernel: [27980.584504] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 13:10:06 juju-e4d256-prod-github-runner-207 kernel: [27980.585579] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 13:10:06 juju-e4d256-prod-github-runner-207 kernel: [27980.586624] Aug 22 13:10:06 juju-e4d256-prod-github-runner-207 kernel: [27980.587489] Aug 22 13:10:06 juju-e4d256-prod-github-runner-207 kernel: [27980.588336] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 13:10:06 juju-e4d256-prod-github-runner-207 kernel: [27980.589372] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:10:06 juju-e4d256-prod-github-runner-207 kernel: [27980.590423] ? _raw_spin_lock+0x22/0x30 Aug 22 13:10:06 juju-e4d256-prod-github-runner-207 kernel: [27980.591377] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:10:06 juju-e4d256-prod-github-runner-207 kernel: [27980.592406] direct_page_fault+0x206/0x310 [kvm] Aug 22 13:10:06 juju-e4d256-prod-github-runner-207 kernel: [27980.593609] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 13:10:06 juju-e4d256-prod-github-runner-207 kernel: [27980.594622] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 13:10:06 juju-e4d256-prod-github-runner-207 kernel: [27980.595628] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 13:10:06 juju-e4d256-prod-github-runner-207 kernel: [27980.596599] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 13:10:06 juju-e4d256-prod-github-runner-207 kernel: [27980.597545] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 13:10:06 juju-e4d256-prod-github-runner-207 kernel: [27980.598528] handle_exit+0x98/0x230 [kvm_amd] Aug 22 13:10:06 juju-e4d256-prod-github-runner-207 kernel: [27980.599438] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 13:10:06 juju-e4d256-prod-github-runner-207 kernel: [27980.600353] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 13:10:06 juju-e4d256-prod-github-runner-207 kernel: [27980.601281] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 13:10:06 juju-e4d256-prod-github-runner-207 kernel: [27980.602206] vcpu_run+0x62/0x2c0 [kvm] Aug 22 13:10:06 juju-e4d256-prod-github-runner-207 kernel: [27980.603018] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 13:10:06 juju-e4d256-prod-github-runner-207 kernel: [27980.603836] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 13:10:06 juju-e4d256-prod-github-runner-207 kernel: [27980.604696] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 13:10:06 juju-e4d256-prod-github-runner-207 kernel: [27980.605493] ? __seccomp_filter+0x4a/0x4a0 Aug 22 13:10:06 juju-e4d256-prod-github-runner-207 kernel: [27980.606239] ? __fget_files+0x86/0xc0 Aug 22 13:10:06 juju-e4d256-prod-github-runner-207 kernel: [27980.606942] __x64_sys_ioctl+0x95/0xd0 Aug 22 13:10:06 juju-e4d256-prod-github-runner-207 kernel: [27980.607646] do_syscall_64+0x5c/0xc0 Aug 22 13:10:06 juju-e4d256-prod-github-runner-207 kernel: [27980.608315] ? do_futex+0x162/0x1f0 Aug 22 13:10:06 juju-e4d256-prod-github-runner-207 kernel: [27980.608993] ? __x64_sys_futex+0x78/0x1e0 Aug 22 13:10:06 juju-e4d256-prod-github-runner-207 kernel: [27980.609668] ? __secure_computing+0xa9/0x120 Aug 22 13:10:06 juju-e4d256-prod-github-runner-207 kernel: [27980.610358] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 13:10:06 juju-e4d256-prod-github-runner-207 kernel: [27980.611124] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:10:06 juju-e4d256-prod-github-runner-207 kernel: [27980.611855] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:10:06 juju-e4d256-prod-github-runner-207 kernel: [27980.612571] ? do_syscall_64+0x69/0xc0 Aug 22 13:10:06 juju-e4d256-prod-github-runner-207 kernel: [27980.613218] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:10:06 juju-e4d256-prod-github-runner-207 kernel: [27980.613945] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:10:06 juju-e4d256-prod-github-runner-207 kernel: [27980.614649] ? do_syscall_64+0x69/0xc0 Aug 22 13:10:06 juju-e4d256-prod-github-runner-207 kernel: [27980.615287] ? do_syscall_64+0x69/0xc0 Aug 22 13:10:06 juju-e4d256-prod-github-runner-207 kernel: [27980.615909] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 13:10:06 juju-e4d256-prod-github-runner-207 kernel: [27980.616613] RIP: 0033:0x7faa5d0edaff Aug 22 13:10:06 juju-e4d256-prod-github-runner-207 kernel: [27980.617239] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 13:10:06 juju-e4d256-prod-github-runner-207 kernel: [27980.619314] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 13:10:06 juju-e4d256-prod-github-runner-207 kernel: [27980.620229] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 13:10:06 juju-e4d256-prod-github-runner-207 kernel: [27980.621118] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 13:10:06 juju-e4d256-prod-github-runner-207 kernel: [27980.622006] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 13:10:06 juju-e4d256-prod-github-runner-207 kernel: [27980.622899] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 13:10:06 juju-e4d256-prod-github-runner-207 kernel: [27980.623811] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 13:10:06 juju-e4d256-prod-github-runner-207 kernel: [27980.624708] Aug 22 13:10:34 juju-e4d256-prod-github-runner-207 kernel: [28008.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 25976s! [qemu-system-x86:6715] Aug 22 13:10:34 juju-e4d256-prod-github-runner-207 kernel: [28008.543113] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 13:10:34 juju-e4d256-prod-github-runner-207 kernel: [28008.543189] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 13:10:34 juju-e4d256-prod-github-runner-207 kernel: [28008.555274] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 13:10:34 juju-e4d256-prod-github-runner-207 kernel: [28008.556547] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 13:10:34 juju-e4d256-prod-github-runner-207 kernel: [28008.557768] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:10:34 juju-e4d256-prod-github-runner-207 kernel: [28008.558835] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 13:10:34 juju-e4d256-prod-github-runner-207 kernel: [28008.561384] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 13:10:34 juju-e4d256-prod-github-runner-207 kernel: [28008.562442] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 13:10:34 juju-e4d256-prod-github-runner-207 kernel: [28008.563613] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 13:10:34 juju-e4d256-prod-github-runner-207 kernel: [28008.564778] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 13:10:34 juju-e4d256-prod-github-runner-207 kernel: [28008.565944] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 13:10:34 juju-e4d256-prod-github-runner-207 kernel: [28008.567115] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 13:10:34 juju-e4d256-prod-github-runner-207 kernel: [28008.568288] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 13:10:34 juju-e4d256-prod-github-runner-207 kernel: [28008.569528] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 13:10:34 juju-e4d256-prod-github-runner-207 kernel: [28008.570630] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 13:10:34 juju-e4d256-prod-github-runner-207 kernel: [28008.571838] Call Trace: Aug 22 13:10:34 juju-e4d256-prod-github-runner-207 kernel: [28008.572755] Aug 22 13:10:34 juju-e4d256-prod-github-runner-207 kernel: [28008.573639] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:10:34 juju-e4d256-prod-github-runner-207 kernel: [28008.574734] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:10:34 juju-e4d256-prod-github-runner-207 kernel: [28008.575779] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:10:34 juju-e4d256-prod-github-runner-207 kernel: [28008.576861] ? show_regs.part.0+0x23/0x29 Aug 22 13:10:34 juju-e4d256-prod-github-runner-207 kernel: [28008.577863] ? show_regs.cold+0x8/0xd Aug 22 13:10:34 juju-e4d256-prod-github-runner-207 kernel: [28008.578850] ? watchdog_timer_fn+0x1be/0x220 Aug 22 13:10:34 juju-e4d256-prod-github-runner-207 kernel: [28008.579887] ? lockup_detector_update_enable+0x60/0x60 Aug 22 13:10:34 juju-e4d256-prod-github-runner-207 kernel: [28008.580954] ? __hrtimer_run_queues+0x107/0x230 Aug 22 13:10:34 juju-e4d256-prod-github-runner-207 kernel: [28008.581986] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 13:10:34 juju-e4d256-prod-github-runner-207 kernel: [28008.583029] ? hrtimer_interrupt+0x101/0x220 Aug 22 13:10:34 juju-e4d256-prod-github-runner-207 kernel: [28008.584046] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 13:10:34 juju-e4d256-prod-github-runner-207 kernel: [28008.585119] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 13:10:34 juju-e4d256-prod-github-runner-207 kernel: [28008.586170] Aug 22 13:10:34 juju-e4d256-prod-github-runner-207 kernel: [28008.587035] Aug 22 13:10:34 juju-e4d256-prod-github-runner-207 kernel: [28008.587878] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 13:10:34 juju-e4d256-prod-github-runner-207 kernel: [28008.588916] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:10:34 juju-e4d256-prod-github-runner-207 kernel: [28008.589959] ? _raw_spin_lock+0x22/0x30 Aug 22 13:10:34 juju-e4d256-prod-github-runner-207 kernel: [28008.590931] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:10:34 juju-e4d256-prod-github-runner-207 kernel: [28008.592004] direct_page_fault+0x206/0x310 [kvm] Aug 22 13:10:34 juju-e4d256-prod-github-runner-207 kernel: [28008.593032] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 13:10:34 juju-e4d256-prod-github-runner-207 kernel: [28008.594040] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 13:10:34 juju-e4d256-prod-github-runner-207 kernel: [28008.595056] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 13:10:34 juju-e4d256-prod-github-runner-207 kernel: [28008.596031] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 13:10:34 juju-e4d256-prod-github-runner-207 kernel: [28008.596982] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 13:10:34 juju-e4d256-prod-github-runner-207 kernel: [28008.598106] handle_exit+0x98/0x230 [kvm_amd] Aug 22 13:10:34 juju-e4d256-prod-github-runner-207 kernel: [28008.599012] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 13:10:34 juju-e4d256-prod-github-runner-207 kernel: [28008.599924] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 13:10:34 juju-e4d256-prod-github-runner-207 kernel: [28008.600895] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 13:10:34 juju-e4d256-prod-github-runner-207 kernel: [28008.601817] vcpu_run+0x62/0x2c0 [kvm] Aug 22 13:10:34 juju-e4d256-prod-github-runner-207 kernel: [28008.602629] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 13:10:34 juju-e4d256-prod-github-runner-207 kernel: [28008.603455] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 13:10:34 juju-e4d256-prod-github-runner-207 kernel: [28008.604307] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 13:10:34 juju-e4d256-prod-github-runner-207 kernel: [28008.605102] ? __seccomp_filter+0x4a/0x4a0 Aug 22 13:10:34 juju-e4d256-prod-github-runner-207 kernel: [28008.605847] ? __fget_files+0x86/0xc0 Aug 22 13:10:34 juju-e4d256-prod-github-runner-207 kernel: [28008.606560] __x64_sys_ioctl+0x95/0xd0 Aug 22 13:10:34 juju-e4d256-prod-github-runner-207 kernel: [28008.607263] do_syscall_64+0x5c/0xc0 Aug 22 13:10:34 juju-e4d256-prod-github-runner-207 kernel: [28008.607929] ? do_futex+0x162/0x1f0 Aug 22 13:10:34 juju-e4d256-prod-github-runner-207 kernel: [28008.608577] ? __x64_sys_futex+0x78/0x1e0 Aug 22 13:10:34 juju-e4d256-prod-github-runner-207 kernel: [28008.609249] ? __secure_computing+0xa9/0x120 Aug 22 13:10:34 juju-e4d256-prod-github-runner-207 kernel: [28008.609943] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 13:10:34 juju-e4d256-prod-github-runner-207 kernel: [28008.610702] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:10:34 juju-e4d256-prod-github-runner-207 kernel: [28008.611457] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:10:34 juju-e4d256-prod-github-runner-207 kernel: [28008.612176] ? do_syscall_64+0x69/0xc0 Aug 22 13:10:34 juju-e4d256-prod-github-runner-207 kernel: [28008.612829] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:10:34 juju-e4d256-prod-github-runner-207 kernel: [28008.613532] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:10:34 juju-e4d256-prod-github-runner-207 kernel: [28008.614226] ? do_syscall_64+0x69/0xc0 Aug 22 13:10:34 juju-e4d256-prod-github-runner-207 kernel: [28008.614864] ? do_syscall_64+0x69/0xc0 Aug 22 13:10:34 juju-e4d256-prod-github-runner-207 kernel: [28008.615518] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 13:10:34 juju-e4d256-prod-github-runner-207 kernel: [28008.616224] RIP: 0033:0x7faa5d0edaff Aug 22 13:10:34 juju-e4d256-prod-github-runner-207 kernel: [28008.616853] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 13:10:34 juju-e4d256-prod-github-runner-207 kernel: [28008.618855] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 13:10:34 juju-e4d256-prod-github-runner-207 kernel: [28008.619766] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 13:10:34 juju-e4d256-prod-github-runner-207 kernel: [28008.620661] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 13:10:34 juju-e4d256-prod-github-runner-207 kernel: [28008.621551] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 13:10:34 juju-e4d256-prod-github-runner-207 kernel: [28008.622445] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 13:10:34 juju-e4d256-prod-github-runner-207 kernel: [28008.623371] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 13:10:34 juju-e4d256-prod-github-runner-207 kernel: [28008.624263] Aug 22 13:11:02 juju-e4d256-prod-github-runner-207 kernel: [28036.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 26003s! [qemu-system-x86:6715] Aug 22 13:11:02 juju-e4d256-prod-github-runner-207 kernel: [28036.543854] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 13:11:02 juju-e4d256-prod-github-runner-207 kernel: [28036.544142] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 13:11:02 juju-e4d256-prod-github-runner-207 kernel: [28036.556384] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 13:11:02 juju-e4d256-prod-github-runner-207 kernel: [28036.557646] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 13:11:02 juju-e4d256-prod-github-runner-207 kernel: [28036.558899] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:11:02 juju-e4d256-prod-github-runner-207 kernel: [28036.559955] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 13:11:02 juju-e4d256-prod-github-runner-207 kernel: [28036.562564] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 13:11:02 juju-e4d256-prod-github-runner-207 kernel: [28036.563606] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 13:11:02 juju-e4d256-prod-github-runner-207 kernel: [28036.564764] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 13:11:02 juju-e4d256-prod-github-runner-207 kernel: [28036.565940] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 13:11:02 juju-e4d256-prod-github-runner-207 kernel: [28036.567131] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 13:11:02 juju-e4d256-prod-github-runner-207 kernel: [28036.568301] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 13:11:02 juju-e4d256-prod-github-runner-207 kernel: [28036.569482] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 13:11:02 juju-e4d256-prod-github-runner-207 kernel: [28036.570789] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 13:11:02 juju-e4d256-prod-github-runner-207 kernel: [28036.571897] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 13:11:02 juju-e4d256-prod-github-runner-207 kernel: [28036.573085] Call Trace: Aug 22 13:11:02 juju-e4d256-prod-github-runner-207 kernel: [28036.573996] Aug 22 13:11:02 juju-e4d256-prod-github-runner-207 kernel: [28036.574905] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:11:02 juju-e4d256-prod-github-runner-207 kernel: [28036.575976] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:11:02 juju-e4d256-prod-github-runner-207 kernel: [28036.577003] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:11:02 juju-e4d256-prod-github-runner-207 kernel: [28036.578101] ? show_regs.part.0+0x23/0x29 Aug 22 13:11:02 juju-e4d256-prod-github-runner-207 kernel: [28036.579113] ? show_regs.cold+0x8/0xd Aug 22 13:11:02 juju-e4d256-prod-github-runner-207 kernel: [28036.580084] ? watchdog_timer_fn+0x1be/0x220 Aug 22 13:11:02 juju-e4d256-prod-github-runner-207 kernel: [28036.581090] ? lockup_detector_update_enable+0x60/0x60 Aug 22 13:11:02 juju-e4d256-prod-github-runner-207 kernel: [28036.582153] ? __hrtimer_run_queues+0x107/0x230 Aug 22 13:11:02 juju-e4d256-prod-github-runner-207 kernel: [28036.583188] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 13:11:02 juju-e4d256-prod-github-runner-207 kernel: [28036.584208] ? hrtimer_interrupt+0x101/0x220 Aug 22 13:11:02 juju-e4d256-prod-github-runner-207 kernel: [28036.585234] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 13:11:02 juju-e4d256-prod-github-runner-207 kernel: [28036.586309] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 13:11:02 juju-e4d256-prod-github-runner-207 kernel: [28036.587365] Aug 22 13:11:02 juju-e4d256-prod-github-runner-207 kernel: [28036.588220] Aug 22 13:11:02 juju-e4d256-prod-github-runner-207 kernel: [28036.589055] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 13:11:02 juju-e4d256-prod-github-runner-207 kernel: [28036.590084] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:11:02 juju-e4d256-prod-github-runner-207 kernel: [28036.591131] ? _raw_spin_lock+0x22/0x30 Aug 22 13:11:02 juju-e4d256-prod-github-runner-207 kernel: [28036.592076] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:11:02 juju-e4d256-prod-github-runner-207 kernel: [28036.593090] direct_page_fault+0x206/0x310 [kvm] Aug 22 13:11:02 juju-e4d256-prod-github-runner-207 kernel: [28036.594113] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 13:11:02 juju-e4d256-prod-github-runner-207 kernel: [28036.596057] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 13:11:02 juju-e4d256-prod-github-runner-207 kernel: [28036.597076] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 13:11:02 juju-e4d256-prod-github-runner-207 kernel: [28036.598081] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 13:11:02 juju-e4d256-prod-github-runner-207 kernel: [28036.599037] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 13:11:02 juju-e4d256-prod-github-runner-207 kernel: [28036.600015] handle_exit+0x98/0x230 [kvm_amd] Aug 22 13:11:02 juju-e4d256-prod-github-runner-207 kernel: [28036.600911] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 13:11:02 juju-e4d256-prod-github-runner-207 kernel: [28036.602013] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 13:11:02 juju-e4d256-prod-github-runner-207 kernel: [28036.603160] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 13:11:02 juju-e4d256-prod-github-runner-207 kernel: [28036.604071] vcpu_run+0x62/0x2c0 [kvm] Aug 22 13:11:02 juju-e4d256-prod-github-runner-207 kernel: [28036.604885] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 13:11:02 juju-e4d256-prod-github-runner-207 kernel: [28036.605755] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 13:11:02 juju-e4d256-prod-github-runner-207 kernel: [28036.606624] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 13:11:02 juju-e4d256-prod-github-runner-207 kernel: [28036.607476] ? __seccomp_filter+0x4a/0x4a0 Aug 22 13:11:02 juju-e4d256-prod-github-runner-207 kernel: [28036.608222] ? __fget_files+0x86/0xc0 Aug 22 13:11:02 juju-e4d256-prod-github-runner-207 kernel: [28036.608925] __x64_sys_ioctl+0x95/0xd0 Aug 22 13:11:02 juju-e4d256-prod-github-runner-207 kernel: [28036.609615] do_syscall_64+0x5c/0xc0 Aug 22 13:11:02 juju-e4d256-prod-github-runner-207 kernel: [28036.610294] ? do_futex+0x162/0x1f0 Aug 22 13:11:02 juju-e4d256-prod-github-runner-207 kernel: [28036.610954] ? __x64_sys_futex+0x78/0x1e0 Aug 22 13:11:02 juju-e4d256-prod-github-runner-207 kernel: [28036.611626] ? __secure_computing+0xa9/0x120 Aug 22 13:11:02 juju-e4d256-prod-github-runner-207 kernel: [28036.612319] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 13:11:02 juju-e4d256-prod-github-runner-207 kernel: [28036.613082] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:11:02 juju-e4d256-prod-github-runner-207 kernel: [28036.613801] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:11:02 juju-e4d256-prod-github-runner-207 kernel: [28036.614531] ? do_syscall_64+0x69/0xc0 Aug 22 13:11:02 juju-e4d256-prod-github-runner-207 kernel: [28036.615175] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:11:02 juju-e4d256-prod-github-runner-207 kernel: [28036.615878] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:11:02 juju-e4d256-prod-github-runner-207 kernel: [28036.616571] ? do_syscall_64+0x69/0xc0 Aug 22 13:11:02 juju-e4d256-prod-github-runner-207 kernel: [28036.617193] ? do_syscall_64+0x69/0xc0 Aug 22 13:11:02 juju-e4d256-prod-github-runner-207 kernel: [28036.617818] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 13:11:02 juju-e4d256-prod-github-runner-207 kernel: [28036.618530] RIP: 0033:0x7faa5d0edaff Aug 22 13:11:02 juju-e4d256-prod-github-runner-207 kernel: [28036.619186] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 13:11:02 juju-e4d256-prod-github-runner-207 kernel: [28036.621223] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 13:11:02 juju-e4d256-prod-github-runner-207 kernel: [28036.622130] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 13:11:02 juju-e4d256-prod-github-runner-207 kernel: [28036.623029] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 13:11:02 juju-e4d256-prod-github-runner-207 kernel: [28036.623921] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 13:11:02 juju-e4d256-prod-github-runner-207 kernel: [28036.624807] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 13:11:02 juju-e4d256-prod-github-runner-207 kernel: [28036.625695] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 13:11:02 juju-e4d256-prod-github-runner-207 kernel: [28036.626595] Aug 22 13:11:30 juju-e4d256-prod-github-runner-207 kernel: [28064.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 26029s! [qemu-system-x86:6715] Aug 22 13:11:30 juju-e4d256-prod-github-runner-207 kernel: [28064.543112] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 13:11:30 juju-e4d256-prod-github-runner-207 kernel: [28064.543188] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 13:11:30 juju-e4d256-prod-github-runner-207 kernel: [28064.555313] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 13:11:30 juju-e4d256-prod-github-runner-207 kernel: [28064.556587] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 13:11:30 juju-e4d256-prod-github-runner-207 kernel: [28064.558287] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:11:30 juju-e4d256-prod-github-runner-207 kernel: [28064.559350] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 13:11:30 juju-e4d256-prod-github-runner-207 kernel: [28064.561884] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 13:11:30 juju-e4d256-prod-github-runner-207 kernel: [28064.562938] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 13:11:30 juju-e4d256-prod-github-runner-207 kernel: [28064.564104] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 13:11:30 juju-e4d256-prod-github-runner-207 kernel: [28064.565272] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 13:11:30 juju-e4d256-prod-github-runner-207 kernel: [28064.566475] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 13:11:30 juju-e4d256-prod-github-runner-207 kernel: [28064.567636] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 13:11:30 juju-e4d256-prod-github-runner-207 kernel: [28064.568810] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 13:11:30 juju-e4d256-prod-github-runner-207 kernel: [28064.570045] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 13:11:30 juju-e4d256-prod-github-runner-207 kernel: [28064.571166] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 13:11:30 juju-e4d256-prod-github-runner-207 kernel: [28064.572355] Call Trace: Aug 22 13:11:30 juju-e4d256-prod-github-runner-207 kernel: [28064.573263] Aug 22 13:11:30 juju-e4d256-prod-github-runner-207 kernel: [28064.574150] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:11:30 juju-e4d256-prod-github-runner-207 kernel: [28064.575177] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:11:30 juju-e4d256-prod-github-runner-207 kernel: [28064.576194] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:11:30 juju-e4d256-prod-github-runner-207 kernel: [28064.577264] ? show_regs.part.0+0x23/0x29 Aug 22 13:11:30 juju-e4d256-prod-github-runner-207 kernel: [28064.578271] ? show_regs.cold+0x8/0xd Aug 22 13:11:30 juju-e4d256-prod-github-runner-207 kernel: [28064.579243] ? watchdog_timer_fn+0x1be/0x220 Aug 22 13:11:30 juju-e4d256-prod-github-runner-207 kernel: [28064.580249] ? lockup_detector_update_enable+0x60/0x60 Aug 22 13:11:30 juju-e4d256-prod-github-runner-207 kernel: [28064.581322] ? __hrtimer_run_queues+0x107/0x230 Aug 22 13:11:30 juju-e4d256-prod-github-runner-207 kernel: [28064.582360] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 13:11:30 juju-e4d256-prod-github-runner-207 kernel: [28064.583381] ? hrtimer_interrupt+0x101/0x220 Aug 22 13:11:30 juju-e4d256-prod-github-runner-207 kernel: [28064.584398] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 13:11:30 juju-e4d256-prod-github-runner-207 kernel: [28064.585463] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 13:11:30 juju-e4d256-prod-github-runner-207 kernel: [28064.586516] Aug 22 13:11:30 juju-e4d256-prod-github-runner-207 kernel: [28064.587372] Aug 22 13:11:30 juju-e4d256-prod-github-runner-207 kernel: [28064.588206] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 13:11:30 juju-e4d256-prod-github-runner-207 kernel: [28064.589235] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:11:30 juju-e4d256-prod-github-runner-207 kernel: [28064.590283] ? _raw_spin_lock+0x22/0x30 Aug 22 13:11:30 juju-e4d256-prod-github-runner-207 kernel: [28064.591231] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:11:30 juju-e4d256-prod-github-runner-207 kernel: [28064.592243] direct_page_fault+0x206/0x310 [kvm] Aug 22 13:11:30 juju-e4d256-prod-github-runner-207 kernel: [28064.593264] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 13:11:30 juju-e4d256-prod-github-runner-207 kernel: [28064.594292] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 13:11:30 juju-e4d256-prod-github-runner-207 kernel: [28064.595293] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 13:11:30 juju-e4d256-prod-github-runner-207 kernel: [28064.596260] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 13:11:30 juju-e4d256-prod-github-runner-207 kernel: [28064.597209] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 13:11:30 juju-e4d256-prod-github-runner-207 kernel: [28064.598200] handle_exit+0x98/0x230 [kvm_amd] Aug 22 13:11:30 juju-e4d256-prod-github-runner-207 kernel: [28064.599110] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 13:11:30 juju-e4d256-prod-github-runner-207 kernel: [28064.600225] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 13:11:30 juju-e4d256-prod-github-runner-207 kernel: [28064.601148] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 13:11:30 juju-e4d256-prod-github-runner-207 kernel: [28064.602050] vcpu_run+0x62/0x2c0 [kvm] Aug 22 13:11:30 juju-e4d256-prod-github-runner-207 kernel: [28064.602868] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 13:11:30 juju-e4d256-prod-github-runner-207 kernel: [28064.603678] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 13:11:30 juju-e4d256-prod-github-runner-207 kernel: [28064.604533] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 13:11:30 juju-e4d256-prod-github-runner-207 kernel: [28064.605334] ? __seccomp_filter+0x4a/0x4a0 Aug 22 13:11:30 juju-e4d256-prod-github-runner-207 kernel: [28064.606078] ? __fget_files+0x86/0xc0 Aug 22 13:11:30 juju-e4d256-prod-github-runner-207 kernel: [28064.606795] __x64_sys_ioctl+0x95/0xd0 Aug 22 13:11:30 juju-e4d256-prod-github-runner-207 kernel: [28064.607487] do_syscall_64+0x5c/0xc0 Aug 22 13:11:30 juju-e4d256-prod-github-runner-207 kernel: [28064.608161] ? do_futex+0x162/0x1f0 Aug 22 13:11:30 juju-e4d256-prod-github-runner-207 kernel: [28064.608809] ? __x64_sys_futex+0x78/0x1e0 Aug 22 13:11:30 juju-e4d256-prod-github-runner-207 kernel: [28064.609485] ? __secure_computing+0xa9/0x120 Aug 22 13:11:30 juju-e4d256-prod-github-runner-207 kernel: [28064.610189] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 13:11:30 juju-e4d256-prod-github-runner-207 kernel: [28064.610948] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:11:30 juju-e4d256-prod-github-runner-207 kernel: [28064.611846] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:11:30 juju-e4d256-prod-github-runner-207 kernel: [28064.612561] ? do_syscall_64+0x69/0xc0 Aug 22 13:11:30 juju-e4d256-prod-github-runner-207 kernel: [28064.613205] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:11:30 juju-e4d256-prod-github-runner-207 kernel: [28064.613907] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:11:30 juju-e4d256-prod-github-runner-207 kernel: [28064.614615] ? do_syscall_64+0x69/0xc0 Aug 22 13:11:30 juju-e4d256-prod-github-runner-207 kernel: [28064.615238] ? do_syscall_64+0x69/0xc0 Aug 22 13:11:30 juju-e4d256-prod-github-runner-207 kernel: [28064.615857] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 13:11:30 juju-e4d256-prod-github-runner-207 kernel: [28064.616565] RIP: 0033:0x7faa5d0edaff Aug 22 13:11:30 juju-e4d256-prod-github-runner-207 kernel: [28064.617194] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 13:11:30 juju-e4d256-prod-github-runner-207 kernel: [28064.619186] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 13:11:30 juju-e4d256-prod-github-runner-207 kernel: [28064.620097] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 13:11:30 juju-e4d256-prod-github-runner-207 kernel: [28064.620982] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 13:11:30 juju-e4d256-prod-github-runner-207 kernel: [28064.621867] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 13:11:30 juju-e4d256-prod-github-runner-207 kernel: [28064.622762] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 13:11:30 juju-e4d256-prod-github-runner-207 kernel: [28064.623646] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 13:11:30 juju-e4d256-prod-github-runner-207 kernel: [28064.624539] Aug 22 13:11:45 juju-e4d256-prod-github-runner-207 kernel: [28079.060709] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 13:11:45 juju-e4d256-prod-github-runner-207 kernel: [28079.061693] rcu: 1-....: (6968683 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=3369175 Aug 22 13:11:45 juju-e4d256-prod-github-runner-207 kernel: [28079.062876] (t=6990465 jiffies g=23269 q=31937) Aug 22 13:11:45 juju-e4d256-prod-github-runner-207 kernel: [28079.063656] NMI backtrace for cpu 1 Aug 22 13:11:45 juju-e4d256-prod-github-runner-207 kernel: [28079.064386] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 13:11:45 juju-e4d256-prod-github-runner-207 kernel: [28079.065595] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 13:11:45 juju-e4d256-prod-github-runner-207 kernel: [28079.066718] Call Trace: Aug 22 13:11:45 juju-e4d256-prod-github-runner-207 kernel: [28079.067402] Aug 22 13:11:45 juju-e4d256-prod-github-runner-207 kernel: [28079.068060] show_stack+0x52/0x5c Aug 22 13:11:45 juju-e4d256-prod-github-runner-207 kernel: [28079.068808] dump_stack_lvl+0x4a/0x63 Aug 22 13:11:45 juju-e4d256-prod-github-runner-207 kernel: [28079.069551] dump_stack+0x10/0x16 Aug 22 13:11:45 juju-e4d256-prod-github-runner-207 kernel: [28079.070323] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 13:11:45 juju-e4d256-prod-github-runner-207 kernel: [28079.071129] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 13:11:45 juju-e4d256-prod-github-runner-207 kernel: [28079.071924] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 13:11:45 juju-e4d256-prod-github-runner-207 kernel: [28079.072741] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 13:11:45 juju-e4d256-prod-github-runner-207 kernel: [28079.073559] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 13:11:45 juju-e4d256-prod-github-runner-207 kernel: [28079.074421] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 13:11:45 juju-e4d256-prod-github-runner-207 kernel: [28079.075204] print_cpu_stall.cold+0x2f/0xe2 Aug 22 13:11:45 juju-e4d256-prod-github-runner-207 kernel: [28079.075986] ? timekeeping_update+0xf7/0x150 Aug 22 13:11:45 juju-e4d256-prod-github-runner-207 kernel: [28079.076780] check_cpu_stall+0x109/0x270 Aug 22 13:11:45 juju-e4d256-prod-github-runner-207 kernel: [28079.077547] rcu_sched_clock_irq+0x9a/0x250 Aug 22 13:11:45 juju-e4d256-prod-github-runner-207 kernel: [28079.078327] update_process_times+0x94/0xd0 Aug 22 13:11:45 juju-e4d256-prod-github-runner-207 kernel: [28079.079087] tick_sched_handle+0x29/0x70 Aug 22 13:11:45 juju-e4d256-prod-github-runner-207 kernel: [28079.079861] tick_sched_timer+0x8c/0xc0 Aug 22 13:11:45 juju-e4d256-prod-github-runner-207 kernel: [28079.080628] ? tick_nohz_handler+0xb0/0xb0 Aug 22 13:11:45 juju-e4d256-prod-github-runner-207 kernel: [28079.081400] __hrtimer_run_queues+0x107/0x230 Aug 22 13:11:45 juju-e4d256-prod-github-runner-207 kernel: [28079.082203] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 13:11:45 juju-e4d256-prod-github-runner-207 kernel: [28079.082991] hrtimer_interrupt+0x101/0x220 Aug 22 13:11:45 juju-e4d256-prod-github-runner-207 kernel: [28079.083748] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 13:11:45 juju-e4d256-prod-github-runner-207 kernel: [28079.084555] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 13:11:45 juju-e4d256-prod-github-runner-207 kernel: [28079.085355] Aug 22 13:11:45 juju-e4d256-prod-github-runner-207 kernel: [28079.086013] Aug 22 13:11:45 juju-e4d256-prod-github-runner-207 kernel: [28079.086687] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 13:11:45 juju-e4d256-prod-github-runner-207 kernel: [28079.087559] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:11:45 juju-e4d256-prod-github-runner-207 kernel: [28079.088453] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 13:11:45 juju-e4d256-prod-github-runner-207 kernel: [28079.090679] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 13:11:45 juju-e4d256-prod-github-runner-207 kernel: [28079.091591] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 13:11:45 juju-e4d256-prod-github-runner-207 kernel: [28079.092602] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 13:11:45 juju-e4d256-prod-github-runner-207 kernel: [28079.093576] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 13:11:45 juju-e4d256-prod-github-runner-207 kernel: [28079.094560] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 13:11:45 juju-e4d256-prod-github-runner-207 kernel: [28079.095516] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 13:11:45 juju-e4d256-prod-github-runner-207 kernel: [28079.096492] ? _raw_spin_lock+0x22/0x30 Aug 22 13:11:45 juju-e4d256-prod-github-runner-207 kernel: [28079.097279] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:11:45 juju-e4d256-prod-github-runner-207 kernel: [28079.098166] direct_page_fault+0x206/0x310 [kvm] Aug 22 13:11:45 juju-e4d256-prod-github-runner-207 kernel: [28079.099009] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 13:11:45 juju-e4d256-prod-github-runner-207 kernel: [28079.099835] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 13:11:45 juju-e4d256-prod-github-runner-207 kernel: [28079.100666] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 13:11:45 juju-e4d256-prod-github-runner-207 kernel: [28079.101500] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 13:11:45 juju-e4d256-prod-github-runner-207 kernel: [28079.102413] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 13:11:45 juju-e4d256-prod-github-runner-207 kernel: [28079.103385] handle_exit+0x98/0x230 [kvm_amd] Aug 22 13:11:45 juju-e4d256-prod-github-runner-207 kernel: [28079.104141] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 13:11:45 juju-e4d256-prod-github-runner-207 kernel: [28079.104925] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 13:11:45 juju-e4d256-prod-github-runner-207 kernel: [28079.105746] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 13:11:45 juju-e4d256-prod-github-runner-207 kernel: [28079.106568] vcpu_run+0x62/0x2c0 [kvm] Aug 22 13:11:45 juju-e4d256-prod-github-runner-207 kernel: [28079.107287] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 13:11:45 juju-e4d256-prod-github-runner-207 kernel: [28079.108060] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 13:11:45 juju-e4d256-prod-github-runner-207 kernel: [28079.108877] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 13:11:45 juju-e4d256-prod-github-runner-207 kernel: [28079.109643] ? __seccomp_filter+0x4a/0x4a0 Aug 22 13:11:45 juju-e4d256-prod-github-runner-207 kernel: [28079.110414] ? __fget_files+0x86/0xc0 Aug 22 13:11:45 juju-e4d256-prod-github-runner-207 kernel: [28079.111119] __x64_sys_ioctl+0x95/0xd0 Aug 22 13:11:45 juju-e4d256-prod-github-runner-207 kernel: [28079.111845] do_syscall_64+0x5c/0xc0 Aug 22 13:11:45 juju-e4d256-prod-github-runner-207 kernel: [28079.112566] ? do_futex+0x162/0x1f0 Aug 22 13:11:45 juju-e4d256-prod-github-runner-207 kernel: [28079.113273] ? __x64_sys_futex+0x78/0x1e0 Aug 22 13:11:45 juju-e4d256-prod-github-runner-207 kernel: [28079.113994] ? __secure_computing+0xa9/0x120 Aug 22 13:11:45 juju-e4d256-prod-github-runner-207 kernel: [28079.114717] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 13:11:45 juju-e4d256-prod-github-runner-207 kernel: [28079.115520] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:11:45 juju-e4d256-prod-github-runner-207 kernel: [28079.116281] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:11:45 juju-e4d256-prod-github-runner-207 kernel: [28079.117053] ? do_syscall_64+0x69/0xc0 Aug 22 13:11:45 juju-e4d256-prod-github-runner-207 kernel: [28079.117762] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:11:45 juju-e4d256-prod-github-runner-207 kernel: [28079.118580] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:11:45 juju-e4d256-prod-github-runner-207 kernel: [28079.119345] ? do_syscall_64+0x69/0xc0 Aug 22 13:11:45 juju-e4d256-prod-github-runner-207 kernel: [28079.120052] ? do_syscall_64+0x69/0xc0 Aug 22 13:11:45 juju-e4d256-prod-github-runner-207 kernel: [28079.120739] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 13:11:45 juju-e4d256-prod-github-runner-207 kernel: [28079.121512] RIP: 0033:0x7faa5d0edaff Aug 22 13:11:45 juju-e4d256-prod-github-runner-207 kernel: [28079.122238] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 13:11:45 juju-e4d256-prod-github-runner-207 kernel: [28079.124415] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 13:11:45 juju-e4d256-prod-github-runner-207 kernel: [28079.125377] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 13:11:45 juju-e4d256-prod-github-runner-207 kernel: [28079.126342] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 13:11:45 juju-e4d256-prod-github-runner-207 kernel: [28079.127335] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 13:11:45 juju-e4d256-prod-github-runner-207 kernel: [28079.128337] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 13:11:45 juju-e4d256-prod-github-runner-207 kernel: [28079.129356] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 13:11:45 juju-e4d256-prod-github-runner-207 kernel: [28079.130310] Aug 22 13:12:10 juju-e4d256-prod-github-runner-207 kernel: [28104.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 26066s! [qemu-system-x86:6715] Aug 22 13:12:10 juju-e4d256-prod-github-runner-207 kernel: [28104.543174] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 13:12:10 juju-e4d256-prod-github-runner-207 kernel: [28104.543249] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 13:12:10 juju-e4d256-prod-github-runner-207 kernel: [28104.555361] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 13:12:10 juju-e4d256-prod-github-runner-207 kernel: [28104.556629] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 13:12:10 juju-e4d256-prod-github-runner-207 kernel: [28104.557866] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:12:10 juju-e4d256-prod-github-runner-207 kernel: [28104.558922] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 13:12:10 juju-e4d256-prod-github-runner-207 kernel: [28104.561470] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 13:12:10 juju-e4d256-prod-github-runner-207 kernel: [28104.562524] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 13:12:10 juju-e4d256-prod-github-runner-207 kernel: [28104.563726] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 13:12:10 juju-e4d256-prod-github-runner-207 kernel: [28104.564887] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 13:12:10 juju-e4d256-prod-github-runner-207 kernel: [28104.566056] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 13:12:10 juju-e4d256-prod-github-runner-207 kernel: [28104.567218] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 13:12:10 juju-e4d256-prod-github-runner-207 kernel: [28104.568384] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 13:12:10 juju-e4d256-prod-github-runner-207 kernel: [28104.569628] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 13:12:10 juju-e4d256-prod-github-runner-207 kernel: [28104.570726] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 13:12:10 juju-e4d256-prod-github-runner-207 kernel: [28104.571967] Call Trace: Aug 22 13:12:10 juju-e4d256-prod-github-runner-207 kernel: [28104.572895] Aug 22 13:12:10 juju-e4d256-prod-github-runner-207 kernel: [28104.573796] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:12:10 juju-e4d256-prod-github-runner-207 kernel: [28104.574833] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:12:10 juju-e4d256-prod-github-runner-207 kernel: [28104.575853] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:12:10 juju-e4d256-prod-github-runner-207 kernel: [28104.576929] ? show_regs.part.0+0x23/0x29 Aug 22 13:12:10 juju-e4d256-prod-github-runner-207 kernel: [28104.577937] ? show_regs.cold+0x8/0xd Aug 22 13:12:10 juju-e4d256-prod-github-runner-207 kernel: [28104.578939] ? watchdog_timer_fn+0x1be/0x220 Aug 22 13:12:10 juju-e4d256-prod-github-runner-207 kernel: [28104.579954] ? lockup_detector_update_enable+0x60/0x60 Aug 22 13:12:10 juju-e4d256-prod-github-runner-207 kernel: [28104.581017] ? __hrtimer_run_queues+0x107/0x230 Aug 22 13:12:10 juju-e4d256-prod-github-runner-207 kernel: [28104.582059] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 13:12:10 juju-e4d256-prod-github-runner-207 kernel: [28104.583197] ? hrtimer_interrupt+0x101/0x220 Aug 22 13:12:10 juju-e4d256-prod-github-runner-207 kernel: [28104.584311] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 13:12:10 juju-e4d256-prod-github-runner-207 kernel: [28104.585386] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 13:12:10 juju-e4d256-prod-github-runner-207 kernel: [28104.586449] Aug 22 13:12:10 juju-e4d256-prod-github-runner-207 kernel: [28104.587482] Aug 22 13:12:10 juju-e4d256-prod-github-runner-207 kernel: [28104.588461] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 13:12:10 juju-e4d256-prod-github-runner-207 kernel: [28104.589741] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:12:10 juju-e4d256-prod-github-runner-207 kernel: [28104.590910] ? _raw_spin_lock+0x22/0x30 Aug 22 13:12:10 juju-e4d256-prod-github-runner-207 kernel: [28104.591866] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:12:10 juju-e4d256-prod-github-runner-207 kernel: [28104.592890] direct_page_fault+0x206/0x310 [kvm] Aug 22 13:12:10 juju-e4d256-prod-github-runner-207 kernel: [28104.593932] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 13:12:10 juju-e4d256-prod-github-runner-207 kernel: [28104.594947] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 13:12:10 juju-e4d256-prod-github-runner-207 kernel: [28104.595947] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 13:12:10 juju-e4d256-prod-github-runner-207 kernel: [28104.596925] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 13:12:10 juju-e4d256-prod-github-runner-207 kernel: [28104.597880] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 13:12:10 juju-e4d256-prod-github-runner-207 kernel: [28104.598857] handle_exit+0x98/0x230 [kvm_amd] Aug 22 13:12:10 juju-e4d256-prod-github-runner-207 kernel: [28104.599748] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 13:12:10 juju-e4d256-prod-github-runner-207 kernel: [28104.600660] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 13:12:10 juju-e4d256-prod-github-runner-207 kernel: [28104.601589] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 13:12:10 juju-e4d256-prod-github-runner-207 kernel: [28104.602510] vcpu_run+0x62/0x2c0 [kvm] Aug 22 13:12:10 juju-e4d256-prod-github-runner-207 kernel: [28104.603320] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 13:12:10 juju-e4d256-prod-github-runner-207 kernel: [28104.604131] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 13:12:10 juju-e4d256-prod-github-runner-207 kernel: [28104.604988] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 13:12:10 juju-e4d256-prod-github-runner-207 kernel: [28104.605798] ? __seccomp_filter+0x4a/0x4a0 Aug 22 13:12:10 juju-e4d256-prod-github-runner-207 kernel: [28104.606540] ? __fget_files+0x86/0xc0 Aug 22 13:12:10 juju-e4d256-prod-github-runner-207 kernel: [28104.607259] __x64_sys_ioctl+0x95/0xd0 Aug 22 13:12:10 juju-e4d256-prod-github-runner-207 kernel: [28104.607953] do_syscall_64+0x5c/0xc0 Aug 22 13:12:10 juju-e4d256-prod-github-runner-207 kernel: [28104.608617] ? do_futex+0x162/0x1f0 Aug 22 13:12:10 juju-e4d256-prod-github-runner-207 kernel: [28104.609295] ? __x64_sys_futex+0x78/0x1e0 Aug 22 13:12:10 juju-e4d256-prod-github-runner-207 kernel: [28104.609985] ? __secure_computing+0xa9/0x120 Aug 22 13:12:10 juju-e4d256-prod-github-runner-207 kernel: [28104.610680] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 13:12:10 juju-e4d256-prod-github-runner-207 kernel: [28104.611439] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:12:10 juju-e4d256-prod-github-runner-207 kernel: [28104.612160] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:12:10 juju-e4d256-prod-github-runner-207 kernel: [28104.612880] ? do_syscall_64+0x69/0xc0 Aug 22 13:12:10 juju-e4d256-prod-github-runner-207 kernel: [28104.613529] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:12:10 juju-e4d256-prod-github-runner-207 kernel: [28104.614244] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:12:10 juju-e4d256-prod-github-runner-207 kernel: [28104.614939] ? do_syscall_64+0x69/0xc0 Aug 22 13:12:10 juju-e4d256-prod-github-runner-207 kernel: [28104.615565] ? do_syscall_64+0x69/0xc0 Aug 22 13:12:10 juju-e4d256-prod-github-runner-207 kernel: [28104.616187] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 13:12:10 juju-e4d256-prod-github-runner-207 kernel: [28104.616897] RIP: 0033:0x7faa5d0edaff Aug 22 13:12:10 juju-e4d256-prod-github-runner-207 kernel: [28104.617521] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 13:12:10 juju-e4d256-prod-github-runner-207 kernel: [28104.619512] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 13:12:10 juju-e4d256-prod-github-runner-207 kernel: [28104.620450] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 13:12:10 juju-e4d256-prod-github-runner-207 kernel: [28104.621339] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 13:12:10 juju-e4d256-prod-github-runner-207 kernel: [28104.622258] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 13:12:10 juju-e4d256-prod-github-runner-207 kernel: [28104.623149] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 13:12:10 juju-e4d256-prod-github-runner-207 kernel: [28104.624043] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 13:12:10 juju-e4d256-prod-github-runner-207 kernel: [28104.624937] Aug 22 13:12:38 juju-e4d256-prod-github-runner-207 kernel: [28132.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 26092s! [qemu-system-x86:6715] Aug 22 13:12:38 juju-e4d256-prod-github-runner-207 kernel: [28132.543872] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 13:12:38 juju-e4d256-prod-github-runner-207 kernel: [28132.544163] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 13:12:38 juju-e4d256-prod-github-runner-207 kernel: [28132.556305] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 13:12:38 juju-e4d256-prod-github-runner-207 kernel: [28132.557604] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 13:12:38 juju-e4d256-prod-github-runner-207 kernel: [28132.558836] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:12:38 juju-e4d256-prod-github-runner-207 kernel: [28132.559982] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 13:12:38 juju-e4d256-prod-github-runner-207 kernel: [28132.563405] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 13:12:38 juju-e4d256-prod-github-runner-207 kernel: [28132.564461] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 13:12:38 juju-e4d256-prod-github-runner-207 kernel: [28132.565958] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 13:12:38 juju-e4d256-prod-github-runner-207 kernel: [28132.567136] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 13:12:38 juju-e4d256-prod-github-runner-207 kernel: [28132.568329] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 13:12:38 juju-e4d256-prod-github-runner-207 kernel: [28132.569605] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 13:12:38 juju-e4d256-prod-github-runner-207 kernel: [28132.570808] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 13:12:38 juju-e4d256-prod-github-runner-207 kernel: [28132.572070] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 13:12:38 juju-e4d256-prod-github-runner-207 kernel: [28132.573171] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 13:12:38 juju-e4d256-prod-github-runner-207 kernel: [28132.574390] Call Trace: Aug 22 13:12:38 juju-e4d256-prod-github-runner-207 kernel: [28132.575324] Aug 22 13:12:38 juju-e4d256-prod-github-runner-207 kernel: [28132.576243] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:12:38 juju-e4d256-prod-github-runner-207 kernel: [28132.577307] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:12:38 juju-e4d256-prod-github-runner-207 kernel: [28132.578350] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:12:38 juju-e4d256-prod-github-runner-207 kernel: [28132.579469] ? show_regs.part.0+0x23/0x29 Aug 22 13:12:38 juju-e4d256-prod-github-runner-207 kernel: [28132.580519] ? show_regs.cold+0x8/0xd Aug 22 13:12:38 juju-e4d256-prod-github-runner-207 kernel: [28132.581558] ? watchdog_timer_fn+0x1be/0x220 Aug 22 13:12:38 juju-e4d256-prod-github-runner-207 kernel: [28132.582576] ? lockup_detector_update_enable+0x60/0x60 Aug 22 13:12:38 juju-e4d256-prod-github-runner-207 kernel: [28132.583655] ? __hrtimer_run_queues+0x107/0x230 Aug 22 13:12:38 juju-e4d256-prod-github-runner-207 kernel: [28132.584724] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 13:12:38 juju-e4d256-prod-github-runner-207 kernel: [28132.585806] ? hrtimer_interrupt+0x101/0x220 Aug 22 13:12:38 juju-e4d256-prod-github-runner-207 kernel: [28132.586838] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 13:12:38 juju-e4d256-prod-github-runner-207 kernel: [28132.588070] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 13:12:38 juju-e4d256-prod-github-runner-207 kernel: [28132.589244] Aug 22 13:12:38 juju-e4d256-prod-github-runner-207 kernel: [28132.590138] Aug 22 13:12:38 juju-e4d256-prod-github-runner-207 kernel: [28132.590989] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 13:12:38 juju-e4d256-prod-github-runner-207 kernel: [28132.592058] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:12:38 juju-e4d256-prod-github-runner-207 kernel: [28132.593113] ? _raw_spin_lock+0x22/0x30 Aug 22 13:12:38 juju-e4d256-prod-github-runner-207 kernel: [28132.594084] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:12:38 juju-e4d256-prod-github-runner-207 kernel: [28132.595116] direct_page_fault+0x206/0x310 [kvm] Aug 22 13:12:38 juju-e4d256-prod-github-runner-207 kernel: [28132.596159] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 13:12:38 juju-e4d256-prod-github-runner-207 kernel: [28132.597181] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 13:12:38 juju-e4d256-prod-github-runner-207 kernel: [28132.598206] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 13:12:38 juju-e4d256-prod-github-runner-207 kernel: [28132.599217] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 13:12:38 juju-e4d256-prod-github-runner-207 kernel: [28132.600178] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 13:12:38 juju-e4d256-prod-github-runner-207 kernel: [28132.601175] handle_exit+0x98/0x230 [kvm_amd] Aug 22 13:12:38 juju-e4d256-prod-github-runner-207 kernel: [28132.602099] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 13:12:38 juju-e4d256-prod-github-runner-207 kernel: [28132.603016] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 13:12:38 juju-e4d256-prod-github-runner-207 kernel: [28132.603959] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 13:12:38 juju-e4d256-prod-github-runner-207 kernel: [28132.604863] vcpu_run+0x62/0x2c0 [kvm] Aug 22 13:12:38 juju-e4d256-prod-github-runner-207 kernel: [28132.605701] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 13:12:38 juju-e4d256-prod-github-runner-207 kernel: [28132.606513] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 13:12:38 juju-e4d256-prod-github-runner-207 kernel: [28132.607391] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 13:12:38 juju-e4d256-prod-github-runner-207 kernel: [28132.608192] ? __seccomp_filter+0x4a/0x4a0 Aug 22 13:12:38 juju-e4d256-prod-github-runner-207 kernel: [28132.608937] ? __fget_files+0x86/0xc0 Aug 22 13:12:38 juju-e4d256-prod-github-runner-207 kernel: [28132.609656] __x64_sys_ioctl+0x95/0xd0 Aug 22 13:12:38 juju-e4d256-prod-github-runner-207 kernel: [28132.610353] do_syscall_64+0x5c/0xc0 Aug 22 13:12:38 juju-e4d256-prod-github-runner-207 kernel: [28132.611028] ? do_futex+0x162/0x1f0 Aug 22 13:12:38 juju-e4d256-prod-github-runner-207 kernel: [28132.611715] ? __x64_sys_futex+0x78/0x1e0 Aug 22 13:12:38 juju-e4d256-prod-github-runner-207 kernel: [28132.612415] ? __secure_computing+0xa9/0x120 Aug 22 13:12:38 juju-e4d256-prod-github-runner-207 kernel: [28132.613112] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 13:12:38 juju-e4d256-prod-github-runner-207 kernel: [28132.613889] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:12:38 juju-e4d256-prod-github-runner-207 kernel: [28132.614613] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:12:38 juju-e4d256-prod-github-runner-207 kernel: [28132.615342] ? do_syscall_64+0x69/0xc0 Aug 22 13:12:38 juju-e4d256-prod-github-runner-207 kernel: [28132.616002] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:12:38 juju-e4d256-prod-github-runner-207 kernel: [28132.616713] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:12:38 juju-e4d256-prod-github-runner-207 kernel: [28132.617430] ? do_syscall_64+0x69/0xc0 Aug 22 13:12:38 juju-e4d256-prod-github-runner-207 kernel: [28132.618071] ? do_syscall_64+0x69/0xc0 Aug 22 13:12:38 juju-e4d256-prod-github-runner-207 kernel: [28132.618711] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 13:12:38 juju-e4d256-prod-github-runner-207 kernel: [28132.619426] RIP: 0033:0x7faa5d0edaff Aug 22 13:12:38 juju-e4d256-prod-github-runner-207 kernel: [28132.620098] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 13:12:38 juju-e4d256-prod-github-runner-207 kernel: [28132.622147] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 13:12:38 juju-e4d256-prod-github-runner-207 kernel: [28132.623066] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 13:12:38 juju-e4d256-prod-github-runner-207 kernel: [28132.623965] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 13:12:38 juju-e4d256-prod-github-runner-207 kernel: [28132.624856] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 13:12:38 juju-e4d256-prod-github-runner-207 kernel: [28132.625771] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 13:12:38 juju-e4d256-prod-github-runner-207 kernel: [28132.626669] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 13:12:38 juju-e4d256-prod-github-runner-207 kernel: [28132.627586] Aug 22 13:13:06 juju-e4d256-prod-github-runner-207 kernel: [28160.541981] watchdog: BUG: soft lockup - CPU#1 stuck for 26118s! [qemu-system-x86:6715] Aug 22 13:13:06 juju-e4d256-prod-github-runner-207 kernel: [28160.543142] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 13:13:06 juju-e4d256-prod-github-runner-207 kernel: [28160.543217] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 13:13:06 juju-e4d256-prod-github-runner-207 kernel: [28160.556122] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 13:13:06 juju-e4d256-prod-github-runner-207 kernel: [28160.557422] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 13:13:06 juju-e4d256-prod-github-runner-207 kernel: [28160.558699] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:13:06 juju-e4d256-prod-github-runner-207 kernel: [28160.559855] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 13:13:06 juju-e4d256-prod-github-runner-207 kernel: [28160.562668] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 13:13:06 juju-e4d256-prod-github-runner-207 kernel: [28160.563817] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 13:13:06 juju-e4d256-prod-github-runner-207 kernel: [28160.565075] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 13:13:06 juju-e4d256-prod-github-runner-207 kernel: [28160.566300] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 13:13:06 juju-e4d256-prod-github-runner-207 kernel: [28160.567555] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 13:13:06 juju-e4d256-prod-github-runner-207 kernel: [28160.568856] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 13:13:06 juju-e4d256-prod-github-runner-207 kernel: [28160.570165] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 13:13:06 juju-e4d256-prod-github-runner-207 kernel: [28160.571441] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 13:13:06 juju-e4d256-prod-github-runner-207 kernel: [28160.572625] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 13:13:06 juju-e4d256-prod-github-runner-207 kernel: [28160.573949] Call Trace: Aug 22 13:13:06 juju-e4d256-prod-github-runner-207 kernel: [28160.574925] Aug 22 13:13:06 juju-e4d256-prod-github-runner-207 kernel: [28160.575909] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:13:06 juju-e4d256-prod-github-runner-207 kernel: [28160.577022] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:13:06 juju-e4d256-prod-github-runner-207 kernel: [28160.578155] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:13:06 juju-e4d256-prod-github-runner-207 kernel: [28160.579292] ? show_regs.part.0+0x23/0x29 Aug 22 13:13:06 juju-e4d256-prod-github-runner-207 kernel: [28160.580412] ? show_regs.cold+0x8/0xd Aug 22 13:13:06 juju-e4d256-prod-github-runner-207 kernel: [28160.581483] ? watchdog_timer_fn+0x1be/0x220 Aug 22 13:13:06 juju-e4d256-prod-github-runner-207 kernel: [28160.582584] ? lockup_detector_update_enable+0x60/0x60 Aug 22 13:13:06 juju-e4d256-prod-github-runner-207 kernel: [28160.583751] ? __hrtimer_run_queues+0x107/0x230 Aug 22 13:13:06 juju-e4d256-prod-github-runner-207 kernel: [28160.584792] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 13:13:06 juju-e4d256-prod-github-runner-207 kernel: [28160.585887] ? hrtimer_interrupt+0x101/0x220 Aug 22 13:13:06 juju-e4d256-prod-github-runner-207 kernel: [28160.586969] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 13:13:06 juju-e4d256-prod-github-runner-207 kernel: [28160.588146] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 13:13:06 juju-e4d256-prod-github-runner-207 kernel: [28160.589281] Aug 22 13:13:06 juju-e4d256-prod-github-runner-207 kernel: [28160.590227] Aug 22 13:13:06 juju-e4d256-prod-github-runner-207 kernel: [28160.591143] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 13:13:06 juju-e4d256-prod-github-runner-207 kernel: [28160.592282] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:13:06 juju-e4d256-prod-github-runner-207 kernel: [28160.593444] ? _raw_spin_lock+0x22/0x30 Aug 22 13:13:06 juju-e4d256-prod-github-runner-207 kernel: [28160.594515] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:13:06 juju-e4d256-prod-github-runner-207 kernel: [28160.595573] direct_page_fault+0x206/0x310 [kvm] Aug 22 13:13:06 juju-e4d256-prod-github-runner-207 kernel: [28160.596707] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 13:13:06 juju-e4d256-prod-github-runner-207 kernel: [28160.597865] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 13:13:06 juju-e4d256-prod-github-runner-207 kernel: [28160.599064] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 13:13:06 juju-e4d256-prod-github-runner-207 kernel: [28160.600277] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 13:13:06 juju-e4d256-prod-github-runner-207 kernel: [28160.601368] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 13:13:06 juju-e4d256-prod-github-runner-207 kernel: [28160.602396] handle_exit+0x98/0x230 [kvm_amd] Aug 22 13:13:06 juju-e4d256-prod-github-runner-207 kernel: [28160.603396] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 13:13:06 juju-e4d256-prod-github-runner-207 kernel: [28160.604407] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 13:13:06 juju-e4d256-prod-github-runner-207 kernel: [28160.605390] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 13:13:06 juju-e4d256-prod-github-runner-207 kernel: [28160.606362] vcpu_run+0x62/0x2c0 [kvm] Aug 22 13:13:06 juju-e4d256-prod-github-runner-207 kernel: [28160.607216] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 13:13:06 juju-e4d256-prod-github-runner-207 kernel: [28160.608093] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 13:13:06 juju-e4d256-prod-github-runner-207 kernel: [28160.608998] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 13:13:06 juju-e4d256-prod-github-runner-207 kernel: [28160.609805] ? __seccomp_filter+0x4a/0x4a0 Aug 22 13:13:06 juju-e4d256-prod-github-runner-207 kernel: [28160.610592] ? __fget_files+0x86/0xc0 Aug 22 13:13:06 juju-e4d256-prod-github-runner-207 kernel: [28160.611334] __x64_sys_ioctl+0x95/0xd0 Aug 22 13:13:06 juju-e4d256-prod-github-runner-207 kernel: [28160.612109] do_syscall_64+0x5c/0xc0 Aug 22 13:13:06 juju-e4d256-prod-github-runner-207 kernel: [28160.612793] ? do_futex+0x162/0x1f0 Aug 22 13:13:06 juju-e4d256-prod-github-runner-207 kernel: [28160.613514] ? __x64_sys_futex+0x78/0x1e0 Aug 22 13:13:06 juju-e4d256-prod-github-runner-207 kernel: [28160.614253] ? __secure_computing+0xa9/0x120 Aug 22 13:13:06 juju-e4d256-prod-github-runner-207 kernel: [28160.614989] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 13:13:06 juju-e4d256-prod-github-runner-207 kernel: [28160.615826] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:13:06 juju-e4d256-prod-github-runner-207 kernel: [28160.616630] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:13:06 juju-e4d256-prod-github-runner-207 kernel: [28160.617449] ? do_syscall_64+0x69/0xc0 Aug 22 13:13:06 juju-e4d256-prod-github-runner-207 kernel: [28160.618117] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:13:06 juju-e4d256-prod-github-runner-207 kernel: [28160.618882] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:13:06 juju-e4d256-prod-github-runner-207 kernel: [28160.619620] ? do_syscall_64+0x69/0xc0 Aug 22 13:13:06 juju-e4d256-prod-github-runner-207 kernel: [28160.620299] ? do_syscall_64+0x69/0xc0 Aug 22 13:13:06 juju-e4d256-prod-github-runner-207 kernel: [28160.620998] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 13:13:06 juju-e4d256-prod-github-runner-207 kernel: [28160.621742] RIP: 0033:0x7faa5d0edaff Aug 22 13:13:06 juju-e4d256-prod-github-runner-207 kernel: [28160.622401] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 13:13:06 juju-e4d256-prod-github-runner-207 kernel: [28160.624656] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 13:13:06 juju-e4d256-prod-github-runner-207 kernel: [28160.625687] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 13:13:06 juju-e4d256-prod-github-runner-207 kernel: [28160.626647] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 13:13:06 juju-e4d256-prod-github-runner-207 kernel: [28160.627655] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 13:13:06 juju-e4d256-prod-github-runner-207 kernel: [28160.628629] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 13:13:06 juju-e4d256-prod-github-runner-207 kernel: [28160.629613] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 13:13:06 juju-e4d256-prod-github-runner-207 kernel: [28160.630520] Aug 22 13:13:34 juju-e4d256-prod-github-runner-207 kernel: [28188.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 26144s! [qemu-system-x86:6715] Aug 22 13:13:34 juju-e4d256-prod-github-runner-207 kernel: [28188.543083] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 13:13:34 juju-e4d256-prod-github-runner-207 kernel: [28188.543157] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 13:13:34 juju-e4d256-prod-github-runner-207 kernel: [28188.555405] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 13:13:34 juju-e4d256-prod-github-runner-207 kernel: [28188.556715] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 13:13:34 juju-e4d256-prod-github-runner-207 kernel: [28188.557939] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:13:34 juju-e4d256-prod-github-runner-207 kernel: [28188.558995] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 13:13:34 juju-e4d256-prod-github-runner-207 kernel: [28188.561543] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 13:13:34 juju-e4d256-prod-github-runner-207 kernel: [28188.562584] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 13:13:34 juju-e4d256-prod-github-runner-207 kernel: [28188.563744] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 13:13:34 juju-e4d256-prod-github-runner-207 kernel: [28188.564910] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 13:13:34 juju-e4d256-prod-github-runner-207 kernel: [28188.566068] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 13:13:34 juju-e4d256-prod-github-runner-207 kernel: [28188.567227] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 13:13:34 juju-e4d256-prod-github-runner-207 kernel: [28188.568391] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 13:13:34 juju-e4d256-prod-github-runner-207 kernel: [28188.569634] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 13:13:34 juju-e4d256-prod-github-runner-207 kernel: [28188.570728] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 13:13:34 juju-e4d256-prod-github-runner-207 kernel: [28188.571942] Call Trace: Aug 22 13:13:34 juju-e4d256-prod-github-runner-207 kernel: [28188.572869] Aug 22 13:13:34 juju-e4d256-prod-github-runner-207 kernel: [28188.573752] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:13:34 juju-e4d256-prod-github-runner-207 kernel: [28188.574826] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:13:34 juju-e4d256-prod-github-runner-207 kernel: [28188.575860] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:13:34 juju-e4d256-prod-github-runner-207 kernel: [28188.576950] ? show_regs.part.0+0x23/0x29 Aug 22 13:13:34 juju-e4d256-prod-github-runner-207 kernel: [28188.577951] ? show_regs.cold+0x8/0xd Aug 22 13:13:34 juju-e4d256-prod-github-runner-207 kernel: [28188.578924] ? watchdog_timer_fn+0x1be/0x220 Aug 22 13:13:34 juju-e4d256-prod-github-runner-207 kernel: [28188.579950] ? lockup_detector_update_enable+0x60/0x60 Aug 22 13:13:34 juju-e4d256-prod-github-runner-207 kernel: [28188.581029] ? __hrtimer_run_queues+0x107/0x230 Aug 22 13:13:34 juju-e4d256-prod-github-runner-207 kernel: [28188.582059] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 13:13:34 juju-e4d256-prod-github-runner-207 kernel: [28188.583112] ? hrtimer_interrupt+0x101/0x220 Aug 22 13:13:34 juju-e4d256-prod-github-runner-207 kernel: [28188.584140] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 13:13:34 juju-e4d256-prod-github-runner-207 kernel: [28188.585218] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 13:13:34 juju-e4d256-prod-github-runner-207 kernel: [28188.586266] Aug 22 13:13:34 juju-e4d256-prod-github-runner-207 kernel: [28188.587120] Aug 22 13:13:34 juju-e4d256-prod-github-runner-207 kernel: [28188.587959] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 13:13:34 juju-e4d256-prod-github-runner-207 kernel: [28188.588997] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:13:34 juju-e4d256-prod-github-runner-207 kernel: [28188.590033] ? _raw_spin_lock+0x22/0x30 Aug 22 13:13:34 juju-e4d256-prod-github-runner-207 kernel: [28188.590980] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:13:34 juju-e4d256-prod-github-runner-207 kernel: [28188.592082] direct_page_fault+0x206/0x310 [kvm] Aug 22 13:13:34 juju-e4d256-prod-github-runner-207 kernel: [28188.593147] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 13:13:34 juju-e4d256-prod-github-runner-207 kernel: [28188.594171] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 13:13:34 juju-e4d256-prod-github-runner-207 kernel: [28188.595175] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 13:13:34 juju-e4d256-prod-github-runner-207 kernel: [28188.596142] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 13:13:34 juju-e4d256-prod-github-runner-207 kernel: [28188.597095] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 13:13:34 juju-e4d256-prod-github-runner-207 kernel: [28188.598070] handle_exit+0x98/0x230 [kvm_amd] Aug 22 13:13:34 juju-e4d256-prod-github-runner-207 kernel: [28188.598966] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 13:13:34 juju-e4d256-prod-github-runner-207 kernel: [28188.599878] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 13:13:34 juju-e4d256-prod-github-runner-207 kernel: [28188.600941] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 13:13:34 juju-e4d256-prod-github-runner-207 kernel: [28188.601857] vcpu_run+0x62/0x2c0 [kvm] Aug 22 13:13:34 juju-e4d256-prod-github-runner-207 kernel: [28188.602666] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 13:13:34 juju-e4d256-prod-github-runner-207 kernel: [28188.603475] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 13:13:34 juju-e4d256-prod-github-runner-207 kernel: [28188.604354] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 13:13:34 juju-e4d256-prod-github-runner-207 kernel: [28188.605175] ? __seccomp_filter+0x4a/0x4a0 Aug 22 13:13:34 juju-e4d256-prod-github-runner-207 kernel: [28188.605922] ? __fget_files+0x86/0xc0 Aug 22 13:13:34 juju-e4d256-prod-github-runner-207 kernel: [28188.606632] __x64_sys_ioctl+0x95/0xd0 Aug 22 13:13:34 juju-e4d256-prod-github-runner-207 kernel: [28188.607326] do_syscall_64+0x5c/0xc0 Aug 22 13:13:34 juju-e4d256-prod-github-runner-207 kernel: [28188.608014] ? do_futex+0x162/0x1f0 Aug 22 13:13:34 juju-e4d256-prod-github-runner-207 kernel: [28188.608689] ? __x64_sys_futex+0x78/0x1e0 Aug 22 13:13:34 juju-e4d256-prod-github-runner-207 kernel: [28188.609369] ? __secure_computing+0xa9/0x120 Aug 22 13:13:34 juju-e4d256-prod-github-runner-207 kernel: [28188.610057] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 13:13:34 juju-e4d256-prod-github-runner-207 kernel: [28188.610816] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:13:34 juju-e4d256-prod-github-runner-207 kernel: [28188.611534] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:13:34 juju-e4d256-prod-github-runner-207 kernel: [28188.612250] ? do_syscall_64+0x69/0xc0 Aug 22 13:13:34 juju-e4d256-prod-github-runner-207 kernel: [28188.612906] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:13:34 juju-e4d256-prod-github-runner-207 kernel: [28188.613608] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:13:34 juju-e4d256-prod-github-runner-207 kernel: [28188.614302] ? do_syscall_64+0x69/0xc0 Aug 22 13:13:34 juju-e4d256-prod-github-runner-207 kernel: [28188.614927] ? do_syscall_64+0x69/0xc0 Aug 22 13:13:34 juju-e4d256-prod-github-runner-207 kernel: [28188.615546] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 13:13:34 juju-e4d256-prod-github-runner-207 kernel: [28188.616262] RIP: 0033:0x7faa5d0edaff Aug 22 13:13:34 juju-e4d256-prod-github-runner-207 kernel: [28188.616891] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 13:13:34 juju-e4d256-prod-github-runner-207 kernel: [28188.618880] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 13:13:34 juju-e4d256-prod-github-runner-207 kernel: [28188.619849] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 13:13:34 juju-e4d256-prod-github-runner-207 kernel: [28188.620786] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 13:13:34 juju-e4d256-prod-github-runner-207 kernel: [28188.621682] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 13:13:34 juju-e4d256-prod-github-runner-207 kernel: [28188.622583] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 13:13:34 juju-e4d256-prod-github-runner-207 kernel: [28188.623468] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 13:13:34 juju-e4d256-prod-github-runner-207 kernel: [28188.624356] Aug 22 13:14:02 juju-e4d256-prod-github-runner-207 kernel: [28216.541986] watchdog: BUG: soft lockup - CPU#1 stuck for 26170s! [qemu-system-x86:6715] Aug 22 13:14:02 juju-e4d256-prod-github-runner-207 kernel: [28216.544330] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 13:14:02 juju-e4d256-prod-github-runner-207 kernel: [28216.544672] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 13:14:02 juju-e4d256-prod-github-runner-207 kernel: [28216.561232] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 13:14:02 juju-e4d256-prod-github-runner-207 kernel: [28216.562945] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 13:14:02 juju-e4d256-prod-github-runner-207 kernel: [28216.564235] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:14:02 juju-e4d256-prod-github-runner-207 kernel: [28216.565379] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 13:14:02 juju-e4d256-prod-github-runner-207 kernel: [28216.570884] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 13:14:02 juju-e4d256-prod-github-runner-207 kernel: [28216.572329] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 13:14:02 juju-e4d256-prod-github-runner-207 kernel: [28216.574079] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 13:14:02 juju-e4d256-prod-github-runner-207 kernel: [28216.575676] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 13:14:02 juju-e4d256-prod-github-runner-207 kernel: [28216.577341] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 13:14:02 juju-e4d256-prod-github-runner-207 kernel: [28216.579119] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 13:14:02 juju-e4d256-prod-github-runner-207 kernel: [28216.580924] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 13:14:02 juju-e4d256-prod-github-runner-207 kernel: [28216.582764] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 13:14:02 juju-e4d256-prod-github-runner-207 kernel: [28216.584328] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 13:14:02 juju-e4d256-prod-github-runner-207 kernel: [28216.585969] Call Trace: Aug 22 13:14:02 juju-e4d256-prod-github-runner-207 kernel: [28216.587149] Aug 22 13:14:02 juju-e4d256-prod-github-runner-207 kernel: [28216.588264] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:14:02 juju-e4d256-prod-github-runner-207 kernel: [28216.589701] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:14:02 juju-e4d256-prod-github-runner-207 kernel: [28216.591182] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:14:02 juju-e4d256-prod-github-runner-207 kernel: [28216.592705] ? show_regs.part.0+0x23/0x29 Aug 22 13:14:02 juju-e4d256-prod-github-runner-207 kernel: [28216.594046] ? show_regs.cold+0x8/0xd Aug 22 13:14:02 juju-e4d256-prod-github-runner-207 kernel: [28216.595380] ? watchdog_timer_fn+0x1be/0x220 Aug 22 13:14:02 juju-e4d256-prod-github-runner-207 kernel: [28216.596691] ? lockup_detector_update_enable+0x60/0x60 Aug 22 13:14:02 juju-e4d256-prod-github-runner-207 kernel: [28216.597883] ? __hrtimer_run_queues+0x107/0x230 Aug 22 13:14:02 juju-e4d256-prod-github-runner-207 kernel: [28216.599009] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 13:14:02 juju-e4d256-prod-github-runner-207 kernel: [28216.600126] ? hrtimer_interrupt+0x101/0x220 Aug 22 13:14:02 juju-e4d256-prod-github-runner-207 kernel: [28216.601265] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 13:14:02 juju-e4d256-prod-github-runner-207 kernel: [28216.602433] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 13:14:02 juju-e4d256-prod-github-runner-207 kernel: [28216.603597] Aug 22 13:14:02 juju-e4d256-prod-github-runner-207 kernel: [28216.604521] Aug 22 13:14:02 juju-e4d256-prod-github-runner-207 kernel: [28216.605413] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 13:14:02 juju-e4d256-prod-github-runner-207 kernel: [28216.606556] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:14:02 juju-e4d256-prod-github-runner-207 kernel: [28216.607700] ? _raw_spin_lock+0x22/0x30 Aug 22 13:14:02 juju-e4d256-prod-github-runner-207 kernel: [28216.608746] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:14:02 juju-e4d256-prod-github-runner-207 kernel: [28216.609863] direct_page_fault+0x206/0x310 [kvm] Aug 22 13:14:02 juju-e4d256-prod-github-runner-207 kernel: [28216.610982] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 13:14:02 juju-e4d256-prod-github-runner-207 kernel: [28216.612086] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 13:14:02 juju-e4d256-prod-github-runner-207 kernel: [28216.613215] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 13:14:02 juju-e4d256-prod-github-runner-207 kernel: [28216.614350] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 13:14:02 juju-e4d256-prod-github-runner-207 kernel: [28216.615396] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 13:14:02 juju-e4d256-prod-github-runner-207 kernel: [28216.616540] handle_exit+0x98/0x230 [kvm_amd] Aug 22 13:14:02 juju-e4d256-prod-github-runner-207 kernel: [28216.617538] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 13:14:02 juju-e4d256-prod-github-runner-207 kernel: [28216.618560] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 13:14:02 juju-e4d256-prod-github-runner-207 kernel: [28216.619597] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 13:14:02 juju-e4d256-prod-github-runner-207 kernel: [28216.620613] vcpu_run+0x62/0x2c0 [kvm] Aug 22 13:14:02 juju-e4d256-prod-github-runner-207 kernel: [28216.621513] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 13:14:02 juju-e4d256-prod-github-runner-207 kernel: [28216.622415] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 13:14:02 juju-e4d256-prod-github-runner-207 kernel: [28216.623373] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 13:14:02 juju-e4d256-prod-github-runner-207 kernel: [28216.624465] ? __seccomp_filter+0x4a/0x4a0 Aug 22 13:14:02 juju-e4d256-prod-github-runner-207 kernel: [28216.625300] ? __fget_files+0x86/0xc0 Aug 22 13:14:02 juju-e4d256-prod-github-runner-207 kernel: [28216.626093] __x64_sys_ioctl+0x95/0xd0 Aug 22 13:14:02 juju-e4d256-prod-github-runner-207 kernel: [28216.626877] do_syscall_64+0x5c/0xc0 Aug 22 13:14:02 juju-e4d256-prod-github-runner-207 kernel: [28216.627620] ? do_futex+0x162/0x1f0 Aug 22 13:14:02 juju-e4d256-prod-github-runner-207 kernel: [28216.628553] ? __x64_sys_futex+0x78/0x1e0 Aug 22 13:14:02 juju-e4d256-prod-github-runner-207 kernel: [28216.629483] ? __secure_computing+0xa9/0x120 Aug 22 13:14:02 juju-e4d256-prod-github-runner-207 kernel: [28216.630255] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 13:14:02 juju-e4d256-prod-github-runner-207 kernel: [28216.631118] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:14:02 juju-e4d256-prod-github-runner-207 kernel: [28216.631934] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:14:02 juju-e4d256-prod-github-runner-207 kernel: [28216.632769] ? do_syscall_64+0x69/0xc0 Aug 22 13:14:02 juju-e4d256-prod-github-runner-207 kernel: [28216.633486] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:14:02 juju-e4d256-prod-github-runner-207 kernel: [28216.634280] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:14:02 juju-e4d256-prod-github-runner-207 kernel: [28216.635073] ? do_syscall_64+0x69/0xc0 Aug 22 13:14:02 juju-e4d256-prod-github-runner-207 kernel: [28216.635771] ? do_syscall_64+0x69/0xc0 Aug 22 13:14:02 juju-e4d256-prod-github-runner-207 kernel: [28216.636482] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 13:14:02 juju-e4d256-prod-github-runner-207 kernel: [28216.637291] RIP: 0033:0x7faa5d0edaff Aug 22 13:14:02 juju-e4d256-prod-github-runner-207 kernel: [28216.638046] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 13:14:02 juju-e4d256-prod-github-runner-207 kernel: [28216.640376] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 13:14:02 juju-e4d256-prod-github-runner-207 kernel: [28216.641425] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 13:14:02 juju-e4d256-prod-github-runner-207 kernel: [28216.642451] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 13:14:02 juju-e4d256-prod-github-runner-207 kernel: [28216.643495] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 13:14:02 juju-e4d256-prod-github-runner-207 kernel: [28216.644541] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 13:14:02 juju-e4d256-prod-github-runner-207 kernel: [28216.645572] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 13:14:02 juju-e4d256-prod-github-runner-207 kernel: [28216.646601] Aug 22 13:14:30 juju-e4d256-prod-github-runner-207 kernel: [28244.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 26196s! [qemu-system-x86:6715] Aug 22 13:14:30 juju-e4d256-prod-github-runner-207 kernel: [28244.543116] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 13:14:30 juju-e4d256-prod-github-runner-207 kernel: [28244.543190] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 13:14:30 juju-e4d256-prod-github-runner-207 kernel: [28244.555602] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 13:14:30 juju-e4d256-prod-github-runner-207 kernel: [28244.556997] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 13:14:30 juju-e4d256-prod-github-runner-207 kernel: [28244.558322] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:14:30 juju-e4d256-prod-github-runner-207 kernel: [28244.559393] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 13:14:30 juju-e4d256-prod-github-runner-207 kernel: [28244.562048] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 13:14:30 juju-e4d256-prod-github-runner-207 kernel: [28244.563105] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 13:14:30 juju-e4d256-prod-github-runner-207 kernel: [28244.564342] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 13:14:30 juju-e4d256-prod-github-runner-207 kernel: [28244.565522] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 13:14:30 juju-e4d256-prod-github-runner-207 kernel: [28244.566695] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 13:14:30 juju-e4d256-prod-github-runner-207 kernel: [28244.567888] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 13:14:30 juju-e4d256-prod-github-runner-207 kernel: [28244.569096] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 13:14:30 juju-e4d256-prod-github-runner-207 kernel: [28244.570350] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 13:14:30 juju-e4d256-prod-github-runner-207 kernel: [28244.571479] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 13:14:30 juju-e4d256-prod-github-runner-207 kernel: [28244.572696] Call Trace: Aug 22 13:14:30 juju-e4d256-prod-github-runner-207 kernel: [28244.573618] Aug 22 13:14:30 juju-e4d256-prod-github-runner-207 kernel: [28244.574509] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:14:30 juju-e4d256-prod-github-runner-207 kernel: [28244.575551] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:14:30 juju-e4d256-prod-github-runner-207 kernel: [28244.576593] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:14:30 juju-e4d256-prod-github-runner-207 kernel: [28244.577678] ? show_regs.part.0+0x23/0x29 Aug 22 13:14:30 juju-e4d256-prod-github-runner-207 kernel: [28244.578683] ? show_regs.cold+0x8/0xd Aug 22 13:14:30 juju-e4d256-prod-github-runner-207 kernel: [28244.579671] ? watchdog_timer_fn+0x1be/0x220 Aug 22 13:14:30 juju-e4d256-prod-github-runner-207 kernel: [28244.580926] ? lockup_detector_update_enable+0x60/0x60 Aug 22 13:14:30 juju-e4d256-prod-github-runner-207 kernel: [28244.581991] ? __hrtimer_run_queues+0x107/0x230 Aug 22 13:14:30 juju-e4d256-prod-github-runner-207 kernel: [28244.583022] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 13:14:30 juju-e4d256-prod-github-runner-207 kernel: [28244.584083] ? hrtimer_interrupt+0x101/0x220 Aug 22 13:14:30 juju-e4d256-prod-github-runner-207 kernel: [28244.585105] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 13:14:30 juju-e4d256-prod-github-runner-207 kernel: [28244.586177] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 13:14:30 juju-e4d256-prod-github-runner-207 kernel: [28244.587225] Aug 22 13:14:30 juju-e4d256-prod-github-runner-207 kernel: [28244.588091] Aug 22 13:14:30 juju-e4d256-prod-github-runner-207 kernel: [28244.588957] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 13:14:30 juju-e4d256-prod-github-runner-207 kernel: [28244.590009] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:14:30 juju-e4d256-prod-github-runner-207 kernel: [28244.591054] ? _raw_spin_lock+0x22/0x30 Aug 22 13:14:30 juju-e4d256-prod-github-runner-207 kernel: [28244.592075] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:14:30 juju-e4d256-prod-github-runner-207 kernel: [28244.593111] direct_page_fault+0x206/0x310 [kvm] Aug 22 13:14:30 juju-e4d256-prod-github-runner-207 kernel: [28244.594141] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 13:14:30 juju-e4d256-prod-github-runner-207 kernel: [28244.595155] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 13:14:30 juju-e4d256-prod-github-runner-207 kernel: [28244.596171] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 13:14:30 juju-e4d256-prod-github-runner-207 kernel: [28244.597149] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 13:14:30 juju-e4d256-prod-github-runner-207 kernel: [28244.598136] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 13:14:30 juju-e4d256-prod-github-runner-207 kernel: [28244.599115] handle_exit+0x98/0x230 [kvm_amd] Aug 22 13:14:30 juju-e4d256-prod-github-runner-207 kernel: [28244.600029] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 13:14:30 juju-e4d256-prod-github-runner-207 kernel: [28244.600944] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 13:14:30 juju-e4d256-prod-github-runner-207 kernel: [28244.601873] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 13:14:30 juju-e4d256-prod-github-runner-207 kernel: [28244.602780] vcpu_run+0x62/0x2c0 [kvm] Aug 22 13:14:30 juju-e4d256-prod-github-runner-207 kernel: [28244.603592] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 13:14:30 juju-e4d256-prod-github-runner-207 kernel: [28244.604431] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 13:14:30 juju-e4d256-prod-github-runner-207 kernel: [28244.605341] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 13:14:30 juju-e4d256-prod-github-runner-207 kernel: [28244.606158] ? __seccomp_filter+0x4a/0x4a0 Aug 22 13:14:30 juju-e4d256-prod-github-runner-207 kernel: [28244.606899] ? __fget_files+0x86/0xc0 Aug 22 13:14:30 juju-e4d256-prod-github-runner-207 kernel: [28244.607601] __x64_sys_ioctl+0x95/0xd0 Aug 22 13:14:30 juju-e4d256-prod-github-runner-207 kernel: [28244.608308] do_syscall_64+0x5c/0xc0 Aug 22 13:14:30 juju-e4d256-prod-github-runner-207 kernel: [28244.608974] ? do_futex+0x162/0x1f0 Aug 22 13:14:30 juju-e4d256-prod-github-runner-207 kernel: [28244.609621] ? __x64_sys_futex+0x78/0x1e0 Aug 22 13:14:30 juju-e4d256-prod-github-runner-207 kernel: [28244.610294] ? __secure_computing+0xa9/0x120 Aug 22 13:14:30 juju-e4d256-prod-github-runner-207 kernel: [28244.610983] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 13:14:30 juju-e4d256-prod-github-runner-207 kernel: [28244.611742] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:14:30 juju-e4d256-prod-github-runner-207 kernel: [28244.612485] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:14:30 juju-e4d256-prod-github-runner-207 kernel: [28244.613202] ? do_syscall_64+0x69/0xc0 Aug 22 13:14:30 juju-e4d256-prod-github-runner-207 kernel: [28244.613850] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:14:30 juju-e4d256-prod-github-runner-207 kernel: [28244.614552] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:14:30 juju-e4d256-prod-github-runner-207 kernel: [28244.615245] ? do_syscall_64+0x69/0xc0 Aug 22 13:14:30 juju-e4d256-prod-github-runner-207 kernel: [28244.615881] ? do_syscall_64+0x69/0xc0 Aug 22 13:14:30 juju-e4d256-prod-github-runner-207 kernel: [28244.616503] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 13:14:30 juju-e4d256-prod-github-runner-207 kernel: [28244.617212] RIP: 0033:0x7faa5d0edaff Aug 22 13:14:30 juju-e4d256-prod-github-runner-207 kernel: [28244.617836] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 13:14:30 juju-e4d256-prod-github-runner-207 kernel: [28244.619819] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 13:14:30 juju-e4d256-prod-github-runner-207 kernel: [28244.620749] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 13:14:30 juju-e4d256-prod-github-runner-207 kernel: [28244.621652] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 13:14:30 juju-e4d256-prod-github-runner-207 kernel: [28244.622550] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 13:14:30 juju-e4d256-prod-github-runner-207 kernel: [28244.623488] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 13:14:30 juju-e4d256-prod-github-runner-207 kernel: [28244.624401] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 13:14:30 juju-e4d256-prod-github-runner-207 kernel: [28244.625319] Aug 22 13:14:45 juju-e4d256-prod-github-runner-207 kernel: [28259.072708] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 13:14:45 juju-e4d256-prod-github-runner-207 kernel: [28259.073689] rcu: 1-....: (7013544 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=3390601 Aug 22 13:14:45 juju-e4d256-prod-github-runner-207 kernel: [28259.074844] (t=7035468 jiffies g=23269 q=32049) Aug 22 13:14:45 juju-e4d256-prod-github-runner-207 kernel: [28259.075645] NMI backtrace for cpu 1 Aug 22 13:14:45 juju-e4d256-prod-github-runner-207 kernel: [28259.076400] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 13:14:45 juju-e4d256-prod-github-runner-207 kernel: [28259.077501] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 13:14:45 juju-e4d256-prod-github-runner-207 kernel: [28259.078570] Call Trace: Aug 22 13:14:45 juju-e4d256-prod-github-runner-207 kernel: [28259.079259] Aug 22 13:14:45 juju-e4d256-prod-github-runner-207 kernel: [28259.079949] show_stack+0x52/0x5c Aug 22 13:14:45 juju-e4d256-prod-github-runner-207 kernel: [28259.080686] dump_stack_lvl+0x4a/0x63 Aug 22 13:14:45 juju-e4d256-prod-github-runner-207 kernel: [28259.081443] dump_stack+0x10/0x16 Aug 22 13:14:45 juju-e4d256-prod-github-runner-207 kernel: [28259.082160] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 13:14:45 juju-e4d256-prod-github-runner-207 kernel: [28259.082943] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 13:14:45 juju-e4d256-prod-github-runner-207 kernel: [28259.083741] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 13:14:45 juju-e4d256-prod-github-runner-207 kernel: [28259.084560] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 13:14:45 juju-e4d256-prod-github-runner-207 kernel: [28259.085384] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 13:14:45 juju-e4d256-prod-github-runner-207 kernel: [28259.086218] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 13:14:45 juju-e4d256-prod-github-runner-207 kernel: [28259.086993] print_cpu_stall.cold+0x2f/0xe2 Aug 22 13:14:45 juju-e4d256-prod-github-runner-207 kernel: [28259.087769] ? timekeeping_update+0xf7/0x150 Aug 22 13:14:45 juju-e4d256-prod-github-runner-207 kernel: [28259.088538] check_cpu_stall+0x109/0x270 Aug 22 13:14:45 juju-e4d256-prod-github-runner-207 kernel: [28259.089360] rcu_sched_clock_irq+0x9a/0x250 Aug 22 13:14:45 juju-e4d256-prod-github-runner-207 kernel: [28259.090194] update_process_times+0x94/0xd0 Aug 22 13:14:45 juju-e4d256-prod-github-runner-207 kernel: [28259.090967] tick_sched_handle+0x29/0x70 Aug 22 13:14:45 juju-e4d256-prod-github-runner-207 kernel: [28259.091762] tick_sched_timer+0x8c/0xc0 Aug 22 13:14:45 juju-e4d256-prod-github-runner-207 kernel: [28259.092536] ? tick_nohz_handler+0xb0/0xb0 Aug 22 13:14:45 juju-e4d256-prod-github-runner-207 kernel: [28259.093303] __hrtimer_run_queues+0x107/0x230 Aug 22 13:14:45 juju-e4d256-prod-github-runner-207 kernel: [28259.094149] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 13:14:45 juju-e4d256-prod-github-runner-207 kernel: [28259.094945] hrtimer_interrupt+0x101/0x220 Aug 22 13:14:45 juju-e4d256-prod-github-runner-207 kernel: [28259.095764] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 13:14:45 juju-e4d256-prod-github-runner-207 kernel: [28259.096625] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 13:14:45 juju-e4d256-prod-github-runner-207 kernel: [28259.097455] Aug 22 13:14:45 juju-e4d256-prod-github-runner-207 kernel: [28259.098154] Aug 22 13:14:45 juju-e4d256-prod-github-runner-207 kernel: [28259.098833] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 13:14:45 juju-e4d256-prod-github-runner-207 kernel: [28259.099699] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:14:45 juju-e4d256-prod-github-runner-207 kernel: [28259.100641] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 13:14:45 juju-e4d256-prod-github-runner-207 kernel: [28259.102948] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 13:14:45 juju-e4d256-prod-github-runner-207 kernel: [28259.103947] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 13:14:45 juju-e4d256-prod-github-runner-207 kernel: [28259.104965] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 13:14:45 juju-e4d256-prod-github-runner-207 kernel: [28259.105979] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 13:14:45 juju-e4d256-prod-github-runner-207 kernel: [28259.107064] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 13:14:45 juju-e4d256-prod-github-runner-207 kernel: [28259.108119] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 13:14:45 juju-e4d256-prod-github-runner-207 kernel: [28259.109384] ? _raw_spin_lock+0x22/0x30 Aug 22 13:14:45 juju-e4d256-prod-github-runner-207 kernel: [28259.110364] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:14:45 juju-e4d256-prod-github-runner-207 kernel: [28259.111266] direct_page_fault+0x206/0x310 [kvm] Aug 22 13:14:45 juju-e4d256-prod-github-runner-207 kernel: [28259.112152] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 13:14:45 juju-e4d256-prod-github-runner-207 kernel: [28259.113026] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 13:14:45 juju-e4d256-prod-github-runner-207 kernel: [28259.114102] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 13:14:45 juju-e4d256-prod-github-runner-207 kernel: [28259.114923] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 13:14:45 juju-e4d256-prod-github-runner-207 kernel: [28259.115757] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 13:14:45 juju-e4d256-prod-github-runner-207 kernel: [28259.116607] handle_exit+0x98/0x230 [kvm_amd] Aug 22 13:14:45 juju-e4d256-prod-github-runner-207 kernel: [28259.117482] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 13:14:45 juju-e4d256-prod-github-runner-207 kernel: [28259.118288] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 13:14:45 juju-e4d256-prod-github-runner-207 kernel: [28259.119104] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 13:14:45 juju-e4d256-prod-github-runner-207 kernel: [28259.120031] vcpu_run+0x62/0x2c0 [kvm] Aug 22 13:14:45 juju-e4d256-prod-github-runner-207 kernel: [28259.120754] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 13:14:45 juju-e4d256-prod-github-runner-207 kernel: [28259.121488] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 13:14:45 juju-e4d256-prod-github-runner-207 kernel: [28259.122290] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 13:14:45 juju-e4d256-prod-github-runner-207 kernel: [28259.123055] ? __seccomp_filter+0x4a/0x4a0 Aug 22 13:14:45 juju-e4d256-prod-github-runner-207 kernel: [28259.123853] ? __fget_files+0x86/0xc0 Aug 22 13:14:45 juju-e4d256-prod-github-runner-207 kernel: [28259.124566] __x64_sys_ioctl+0x95/0xd0 Aug 22 13:14:45 juju-e4d256-prod-github-runner-207 kernel: [28259.125260] do_syscall_64+0x5c/0xc0 Aug 22 13:14:45 juju-e4d256-prod-github-runner-207 kernel: [28259.125947] ? do_futex+0x162/0x1f0 Aug 22 13:14:45 juju-e4d256-prod-github-runner-207 kernel: [28259.126619] ? __x64_sys_futex+0x78/0x1e0 Aug 22 13:14:45 juju-e4d256-prod-github-runner-207 kernel: [28259.127318] ? __secure_computing+0xa9/0x120 Aug 22 13:14:45 juju-e4d256-prod-github-runner-207 kernel: [28259.128047] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 13:14:45 juju-e4d256-prod-github-runner-207 kernel: [28259.128835] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:14:45 juju-e4d256-prod-github-runner-207 kernel: [28259.129590] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:14:45 juju-e4d256-prod-github-runner-207 kernel: [28259.130342] ? do_syscall_64+0x69/0xc0 Aug 22 13:14:45 juju-e4d256-prod-github-runner-207 kernel: [28259.131029] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:14:45 juju-e4d256-prod-github-runner-207 kernel: [28259.131797] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:14:45 juju-e4d256-prod-github-runner-207 kernel: [28259.132584] ? do_syscall_64+0x69/0xc0 Aug 22 13:14:45 juju-e4d256-prod-github-runner-207 kernel: [28259.133284] ? do_syscall_64+0x69/0xc0 Aug 22 13:14:45 juju-e4d256-prod-github-runner-207 kernel: [28259.133970] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 13:14:45 juju-e4d256-prod-github-runner-207 kernel: [28259.134738] RIP: 0033:0x7faa5d0edaff Aug 22 13:14:45 juju-e4d256-prod-github-runner-207 kernel: [28259.135419] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 13:14:45 juju-e4d256-prod-github-runner-207 kernel: [28259.137526] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 13:14:45 juju-e4d256-prod-github-runner-207 kernel: [28259.138485] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 13:14:45 juju-e4d256-prod-github-runner-207 kernel: [28259.139428] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 13:14:45 juju-e4d256-prod-github-runner-207 kernel: [28259.140376] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 13:14:45 juju-e4d256-prod-github-runner-207 kernel: [28259.141313] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 13:14:45 juju-e4d256-prod-github-runner-207 kernel: [28259.142239] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 13:14:45 juju-e4d256-prod-github-runner-207 kernel: [28259.143152] Aug 22 13:15:10 juju-e4d256-prod-github-runner-207 kernel: [28284.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 26234s! [qemu-system-x86:6715] Aug 22 13:15:10 juju-e4d256-prod-github-runner-207 kernel: [28284.543088] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 13:15:10 juju-e4d256-prod-github-runner-207 kernel: [28284.543159] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 13:15:10 juju-e4d256-prod-github-runner-207 kernel: [28284.555283] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 13:15:10 juju-e4d256-prod-github-runner-207 kernel: [28284.556550] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 13:15:10 juju-e4d256-prod-github-runner-207 kernel: [28284.557785] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:15:10 juju-e4d256-prod-github-runner-207 kernel: [28284.558838] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 13:15:10 juju-e4d256-prod-github-runner-207 kernel: [28284.561397] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 13:15:10 juju-e4d256-prod-github-runner-207 kernel: [28284.562447] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 13:15:10 juju-e4d256-prod-github-runner-207 kernel: [28284.563623] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 13:15:10 juju-e4d256-prod-github-runner-207 kernel: [28284.564786] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 13:15:10 juju-e4d256-prod-github-runner-207 kernel: [28284.565973] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 13:15:10 juju-e4d256-prod-github-runner-207 kernel: [28284.567152] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 13:15:10 juju-e4d256-prod-github-runner-207 kernel: [28284.568344] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 13:15:10 juju-e4d256-prod-github-runner-207 kernel: [28284.569578] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 13:15:10 juju-e4d256-prod-github-runner-207 kernel: [28284.570680] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 13:15:10 juju-e4d256-prod-github-runner-207 kernel: [28284.571880] Call Trace: Aug 22 13:15:10 juju-e4d256-prod-github-runner-207 kernel: [28284.572792] Aug 22 13:15:10 juju-e4d256-prod-github-runner-207 kernel: [28284.573674] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:15:10 juju-e4d256-prod-github-runner-207 kernel: [28284.574702] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:15:10 juju-e4d256-prod-github-runner-207 kernel: [28284.575729] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:15:10 juju-e4d256-prod-github-runner-207 kernel: [28284.576807] ? show_regs.part.0+0x23/0x29 Aug 22 13:15:10 juju-e4d256-prod-github-runner-207 kernel: [28284.577837] ? show_regs.cold+0x8/0xd Aug 22 13:15:10 juju-e4d256-prod-github-runner-207 kernel: [28284.578835] ? watchdog_timer_fn+0x1be/0x220 Aug 22 13:15:10 juju-e4d256-prod-github-runner-207 kernel: [28284.579861] ? lockup_detector_update_enable+0x60/0x60 Aug 22 13:15:10 juju-e4d256-prod-github-runner-207 kernel: [28284.580921] ? __hrtimer_run_queues+0x107/0x230 Aug 22 13:15:10 juju-e4d256-prod-github-runner-207 kernel: [28284.581980] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 13:15:10 juju-e4d256-prod-github-runner-207 kernel: [28284.583003] ? hrtimer_interrupt+0x101/0x220 Aug 22 13:15:10 juju-e4d256-prod-github-runner-207 kernel: [28284.584042] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 13:15:10 juju-e4d256-prod-github-runner-207 kernel: [28284.585109] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 13:15:10 juju-e4d256-prod-github-runner-207 kernel: [28284.586171] Aug 22 13:15:10 juju-e4d256-prod-github-runner-207 kernel: [28284.587023] Aug 22 13:15:10 juju-e4d256-prod-github-runner-207 kernel: [28284.587886] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 13:15:10 juju-e4d256-prod-github-runner-207 kernel: [28284.588925] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:15:10 juju-e4d256-prod-github-runner-207 kernel: [28284.589961] ? _raw_spin_lock+0x22/0x30 Aug 22 13:15:10 juju-e4d256-prod-github-runner-207 kernel: [28284.590904] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:15:10 juju-e4d256-prod-github-runner-207 kernel: [28284.591930] direct_page_fault+0x206/0x310 [kvm] Aug 22 13:15:10 juju-e4d256-prod-github-runner-207 kernel: [28284.592958] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 13:15:10 juju-e4d256-prod-github-runner-207 kernel: [28284.593968] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 13:15:10 juju-e4d256-prod-github-runner-207 kernel: [28284.594967] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 13:15:10 juju-e4d256-prod-github-runner-207 kernel: [28284.595947] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 13:15:10 juju-e4d256-prod-github-runner-207 kernel: [28284.596895] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 13:15:10 juju-e4d256-prod-github-runner-207 kernel: [28284.597871] handle_exit+0x98/0x230 [kvm_amd] Aug 22 13:15:10 juju-e4d256-prod-github-runner-207 kernel: [28284.598770] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 13:15:10 juju-e4d256-prod-github-runner-207 kernel: [28284.599693] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 13:15:10 juju-e4d256-prod-github-runner-207 kernel: [28284.600615] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 13:15:10 juju-e4d256-prod-github-runner-207 kernel: [28284.601520] vcpu_run+0x62/0x2c0 [kvm] Aug 22 13:15:10 juju-e4d256-prod-github-runner-207 kernel: [28284.602329] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 13:15:10 juju-e4d256-prod-github-runner-207 kernel: [28284.603135] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 13:15:10 juju-e4d256-prod-github-runner-207 kernel: [28284.603995] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 13:15:10 juju-e4d256-prod-github-runner-207 kernel: [28284.604794] ? __seccomp_filter+0x4a/0x4a0 Aug 22 13:15:10 juju-e4d256-prod-github-runner-207 kernel: [28284.605532] ? __fget_files+0x86/0xc0 Aug 22 13:15:10 juju-e4d256-prod-github-runner-207 kernel: [28284.606233] __x64_sys_ioctl+0x95/0xd0 Aug 22 13:15:10 juju-e4d256-prod-github-runner-207 kernel: [28284.606923] do_syscall_64+0x5c/0xc0 Aug 22 13:15:10 juju-e4d256-prod-github-runner-207 kernel: [28284.607665] ? do_futex+0x162/0x1f0 Aug 22 13:15:10 juju-e4d256-prod-github-runner-207 kernel: [28284.608312] ? __x64_sys_futex+0x78/0x1e0 Aug 22 13:15:10 juju-e4d256-prod-github-runner-207 kernel: [28284.608987] ? __secure_computing+0xa9/0x120 Aug 22 13:15:10 juju-e4d256-prod-github-runner-207 kernel: [28284.609674] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 13:15:10 juju-e4d256-prod-github-runner-207 kernel: [28284.610432] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:15:10 juju-e4d256-prod-github-runner-207 kernel: [28284.611154] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:15:10 juju-e4d256-prod-github-runner-207 kernel: [28284.611904] ? do_syscall_64+0x69/0xc0 Aug 22 13:15:10 juju-e4d256-prod-github-runner-207 kernel: [28284.612547] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:15:10 juju-e4d256-prod-github-runner-207 kernel: [28284.613247] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:15:10 juju-e4d256-prod-github-runner-207 kernel: [28284.613939] ? do_syscall_64+0x69/0xc0 Aug 22 13:15:10 juju-e4d256-prod-github-runner-207 kernel: [28284.614565] ? do_syscall_64+0x69/0xc0 Aug 22 13:15:10 juju-e4d256-prod-github-runner-207 kernel: [28284.615185] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 13:15:10 juju-e4d256-prod-github-runner-207 kernel: [28284.615896] RIP: 0033:0x7faa5d0edaff Aug 22 13:15:10 juju-e4d256-prod-github-runner-207 kernel: [28284.616517] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 13:15:10 juju-e4d256-prod-github-runner-207 kernel: [28284.618497] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 13:15:10 juju-e4d256-prod-github-runner-207 kernel: [28284.619420] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 13:15:10 juju-e4d256-prod-github-runner-207 kernel: [28284.620312] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 13:15:10 juju-e4d256-prod-github-runner-207 kernel: [28284.621199] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 13:15:10 juju-e4d256-prod-github-runner-207 kernel: [28284.622083] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 13:15:10 juju-e4d256-prod-github-runner-207 kernel: [28284.622969] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 13:15:10 juju-e4d256-prod-github-runner-207 kernel: [28284.623870] Aug 22 13:15:38 juju-e4d256-prod-github-runner-207 kernel: [28312.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 26260s! [qemu-system-x86:6715] Aug 22 13:15:38 juju-e4d256-prod-github-runner-207 kernel: [28312.543891] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 13:15:38 juju-e4d256-prod-github-runner-207 kernel: [28312.544186] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 13:15:38 juju-e4d256-prod-github-runner-207 kernel: [28312.556527] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 13:15:38 juju-e4d256-prod-github-runner-207 kernel: [28312.557830] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 13:15:38 juju-e4d256-prod-github-runner-207 kernel: [28312.559091] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:15:38 juju-e4d256-prod-github-runner-207 kernel: [28312.560164] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 13:15:38 juju-e4d256-prod-github-runner-207 kernel: [28312.562802] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 13:15:38 juju-e4d256-prod-github-runner-207 kernel: [28312.563875] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 13:15:38 juju-e4d256-prod-github-runner-207 kernel: [28312.565051] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 13:15:38 juju-e4d256-prod-github-runner-207 kernel: [28312.566225] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 13:15:38 juju-e4d256-prod-github-runner-207 kernel: [28312.567410] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 13:15:38 juju-e4d256-prod-github-runner-207 kernel: [28312.568591] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 13:15:38 juju-e4d256-prod-github-runner-207 kernel: [28312.569781] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 13:15:38 juju-e4d256-prod-github-runner-207 kernel: [28312.571046] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 13:15:38 juju-e4d256-prod-github-runner-207 kernel: [28312.572156] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 13:15:38 juju-e4d256-prod-github-runner-207 kernel: [28312.573367] Call Trace: Aug 22 13:15:38 juju-e4d256-prod-github-runner-207 kernel: [28312.574318] Aug 22 13:15:38 juju-e4d256-prod-github-runner-207 kernel: [28312.575227] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:15:38 juju-e4d256-prod-github-runner-207 kernel: [28312.576275] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:15:38 juju-e4d256-prod-github-runner-207 kernel: [28312.577308] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:15:38 juju-e4d256-prod-github-runner-207 kernel: [28312.578407] ? show_regs.part.0+0x23/0x29 Aug 22 13:15:38 juju-e4d256-prod-github-runner-207 kernel: [28312.579425] ? show_regs.cold+0x8/0xd Aug 22 13:15:38 juju-e4d256-prod-github-runner-207 kernel: [28312.580404] ? watchdog_timer_fn+0x1be/0x220 Aug 22 13:15:38 juju-e4d256-prod-github-runner-207 kernel: [28312.581427] ? lockup_detector_update_enable+0x60/0x60 Aug 22 13:15:38 juju-e4d256-prod-github-runner-207 kernel: [28312.582519] ? __hrtimer_run_queues+0x107/0x230 Aug 22 13:15:38 juju-e4d256-prod-github-runner-207 kernel: [28312.583573] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 13:15:38 juju-e4d256-prod-github-runner-207 kernel: [28312.584608] ? hrtimer_interrupt+0x101/0x220 Aug 22 13:15:38 juju-e4d256-prod-github-runner-207 kernel: [28312.585631] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 13:15:38 juju-e4d256-prod-github-runner-207 kernel: [28312.586727] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 13:15:38 juju-e4d256-prod-github-runner-207 kernel: [28312.587795] Aug 22 13:15:38 juju-e4d256-prod-github-runner-207 kernel: [28312.588655] Aug 22 13:15:38 juju-e4d256-prod-github-runner-207 kernel: [28312.589509] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 13:15:38 juju-e4d256-prod-github-runner-207 kernel: [28312.590554] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:15:38 juju-e4d256-prod-github-runner-207 kernel: [28312.591622] ? _raw_spin_lock+0x22/0x30 Aug 22 13:15:38 juju-e4d256-prod-github-runner-207 kernel: [28312.592577] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:15:38 juju-e4d256-prod-github-runner-207 kernel: [28312.593610] direct_page_fault+0x206/0x310 [kvm] Aug 22 13:15:38 juju-e4d256-prod-github-runner-207 kernel: [28312.594648] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 13:15:38 juju-e4d256-prod-github-runner-207 kernel: [28312.595708] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 13:15:38 juju-e4d256-prod-github-runner-207 kernel: [28312.596727] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 13:15:38 juju-e4d256-prod-github-runner-207 kernel: [28312.597738] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 13:15:38 juju-e4d256-prod-github-runner-207 kernel: [28312.598702] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 13:15:38 juju-e4d256-prod-github-runner-207 kernel: [28312.599705] handle_exit+0x98/0x230 [kvm_amd] Aug 22 13:15:38 juju-e4d256-prod-github-runner-207 kernel: [28312.600628] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 13:15:38 juju-e4d256-prod-github-runner-207 kernel: [28312.601554] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 13:15:38 juju-e4d256-prod-github-runner-207 kernel: [28312.602485] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 13:15:38 juju-e4d256-prod-github-runner-207 kernel: [28312.603408] vcpu_run+0x62/0x2c0 [kvm] Aug 22 13:15:38 juju-e4d256-prod-github-runner-207 kernel: [28312.604227] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 13:15:38 juju-e4d256-prod-github-runner-207 kernel: [28312.605046] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 13:15:38 juju-e4d256-prod-github-runner-207 kernel: [28312.605907] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 13:15:38 juju-e4d256-prod-github-runner-207 kernel: [28312.606709] ? __seccomp_filter+0x4a/0x4a0 Aug 22 13:15:38 juju-e4d256-prod-github-runner-207 kernel: [28312.607477] ? __fget_files+0x86/0xc0 Aug 22 13:15:38 juju-e4d256-prod-github-runner-207 kernel: [28312.608187] __x64_sys_ioctl+0x95/0xd0 Aug 22 13:15:38 juju-e4d256-prod-github-runner-207 kernel: [28312.608886] do_syscall_64+0x5c/0xc0 Aug 22 13:15:38 juju-e4d256-prod-github-runner-207 kernel: [28312.609563] ? do_futex+0x162/0x1f0 Aug 22 13:15:38 juju-e4d256-prod-github-runner-207 kernel: [28312.610221] ? __x64_sys_futex+0x78/0x1e0 Aug 22 13:15:38 juju-e4d256-prod-github-runner-207 kernel: [28312.610909] ? __secure_computing+0xa9/0x120 Aug 22 13:15:38 juju-e4d256-prod-github-runner-207 kernel: [28312.611615] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 13:15:38 juju-e4d256-prod-github-runner-207 kernel: [28312.612386] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:15:38 juju-e4d256-prod-github-runner-207 kernel: [28312.613116] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:15:38 juju-e4d256-prod-github-runner-207 kernel: [28312.613842] ? do_syscall_64+0x69/0xc0 Aug 22 13:15:38 juju-e4d256-prod-github-runner-207 kernel: [28312.614496] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:15:38 juju-e4d256-prod-github-runner-207 kernel: [28312.615221] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:15:38 juju-e4d256-prod-github-runner-207 kernel: [28312.615944] ? do_syscall_64+0x69/0xc0 Aug 22 13:15:38 juju-e4d256-prod-github-runner-207 kernel: [28312.616582] ? do_syscall_64+0x69/0xc0 Aug 22 13:15:38 juju-e4d256-prod-github-runner-207 kernel: [28312.617214] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 13:15:38 juju-e4d256-prod-github-runner-207 kernel: [28312.617925] RIP: 0033:0x7faa5d0edaff Aug 22 13:15:38 juju-e4d256-prod-github-runner-207 kernel: [28312.618590] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 13:15:38 juju-e4d256-prod-github-runner-207 kernel: [28312.620628] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 13:15:38 juju-e4d256-prod-github-runner-207 kernel: [28312.621555] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 13:15:38 juju-e4d256-prod-github-runner-207 kernel: [28312.622455] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 13:15:38 juju-e4d256-prod-github-runner-207 kernel: [28312.623370] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 13:15:38 juju-e4d256-prod-github-runner-207 kernel: [28312.624273] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 13:15:38 juju-e4d256-prod-github-runner-207 kernel: [28312.625176] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 13:15:38 juju-e4d256-prod-github-runner-207 kernel: [28312.626086] Aug 22 13:16:06 juju-e4d256-prod-github-runner-207 kernel: [28340.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 26286s! [qemu-system-x86:6715] Aug 22 13:16:06 juju-e4d256-prod-github-runner-207 kernel: [28340.543124] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 13:16:06 juju-e4d256-prod-github-runner-207 kernel: [28340.543199] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 13:16:06 juju-e4d256-prod-github-runner-207 kernel: [28340.555245] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 13:16:06 juju-e4d256-prod-github-runner-207 kernel: [28340.556512] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 13:16:06 juju-e4d256-prod-github-runner-207 kernel: [28340.557740] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:16:06 juju-e4d256-prod-github-runner-207 kernel: [28340.558810] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 13:16:06 juju-e4d256-prod-github-runner-207 kernel: [28340.561355] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 13:16:06 juju-e4d256-prod-github-runner-207 kernel: [28340.562400] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 13:16:06 juju-e4d256-prod-github-runner-207 kernel: [28340.563576] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 13:16:06 juju-e4d256-prod-github-runner-207 kernel: [28340.564739] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 13:16:06 juju-e4d256-prod-github-runner-207 kernel: [28340.565897] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 13:16:06 juju-e4d256-prod-github-runner-207 kernel: [28340.567066] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 13:16:06 juju-e4d256-prod-github-runner-207 kernel: [28340.568239] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 13:16:06 juju-e4d256-prod-github-runner-207 kernel: [28340.569470] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 13:16:06 juju-e4d256-prod-github-runner-207 kernel: [28340.570566] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 13:16:06 juju-e4d256-prod-github-runner-207 kernel: [28340.571763] Call Trace: Aug 22 13:16:06 juju-e4d256-prod-github-runner-207 kernel: [28340.572674] Aug 22 13:16:06 juju-e4d256-prod-github-runner-207 kernel: [28340.573562] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:16:06 juju-e4d256-prod-github-runner-207 kernel: [28340.574589] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:16:06 juju-e4d256-prod-github-runner-207 kernel: [28340.575612] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:16:06 juju-e4d256-prod-github-runner-207 kernel: [28340.576683] ? show_regs.part.0+0x23/0x29 Aug 22 13:16:06 juju-e4d256-prod-github-runner-207 kernel: [28340.577685] ? show_regs.cold+0x8/0xd Aug 22 13:16:06 juju-e4d256-prod-github-runner-207 kernel: [28340.578655] ? watchdog_timer_fn+0x1be/0x220 Aug 22 13:16:06 juju-e4d256-prod-github-runner-207 kernel: [28340.579674] ? lockup_detector_update_enable+0x60/0x60 Aug 22 13:16:06 juju-e4d256-prod-github-runner-207 kernel: [28340.580740] ? __hrtimer_run_queues+0x107/0x230 Aug 22 13:16:06 juju-e4d256-prod-github-runner-207 kernel: [28340.581771] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 13:16:06 juju-e4d256-prod-github-runner-207 kernel: [28340.582821] ? hrtimer_interrupt+0x101/0x220 Aug 22 13:16:06 juju-e4d256-prod-github-runner-207 kernel: [28340.584002] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 13:16:06 juju-e4d256-prod-github-runner-207 kernel: [28340.585078] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 13:16:06 juju-e4d256-prod-github-runner-207 kernel: [28340.586120] Aug 22 13:16:06 juju-e4d256-prod-github-runner-207 kernel: [28340.586990] Aug 22 13:16:06 juju-e4d256-prod-github-runner-207 kernel: [28340.587824] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 13:16:06 juju-e4d256-prod-github-runner-207 kernel: [28340.588853] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:16:06 juju-e4d256-prod-github-runner-207 kernel: [28340.589887] ? _raw_spin_lock+0x22/0x30 Aug 22 13:16:06 juju-e4d256-prod-github-runner-207 kernel: [28340.590855] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:16:06 juju-e4d256-prod-github-runner-207 kernel: [28340.591891] direct_page_fault+0x206/0x310 [kvm] Aug 22 13:16:06 juju-e4d256-prod-github-runner-207 kernel: [28340.592914] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 13:16:06 juju-e4d256-prod-github-runner-207 kernel: [28340.593924] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 13:16:06 juju-e4d256-prod-github-runner-207 kernel: [28340.594941] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 13:16:06 juju-e4d256-prod-github-runner-207 kernel: [28340.595911] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 13:16:06 juju-e4d256-prod-github-runner-207 kernel: [28340.596854] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 13:16:06 juju-e4d256-prod-github-runner-207 kernel: [28340.597850] handle_exit+0x98/0x230 [kvm_amd] Aug 22 13:16:06 juju-e4d256-prod-github-runner-207 kernel: [28340.598754] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 13:16:06 juju-e4d256-prod-github-runner-207 kernel: [28340.599666] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 13:16:06 juju-e4d256-prod-github-runner-207 kernel: [28340.600610] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 13:16:06 juju-e4d256-prod-github-runner-207 kernel: [28340.601524] vcpu_run+0x62/0x2c0 [kvm] Aug 22 13:16:06 juju-e4d256-prod-github-runner-207 kernel: [28340.602352] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 13:16:06 juju-e4d256-prod-github-runner-207 kernel: [28340.603192] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 13:16:06 juju-e4d256-prod-github-runner-207 kernel: [28340.604095] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 13:16:06 juju-e4d256-prod-github-runner-207 kernel: [28340.604923] ? __seccomp_filter+0x4a/0x4a0 Aug 22 13:16:06 juju-e4d256-prod-github-runner-207 kernel: [28340.605663] ? __fget_files+0x86/0xc0 Aug 22 13:16:06 juju-e4d256-prod-github-runner-207 kernel: [28340.606375] __x64_sys_ioctl+0x95/0xd0 Aug 22 13:16:06 juju-e4d256-prod-github-runner-207 kernel: [28340.607100] do_syscall_64+0x5c/0xc0 Aug 22 13:16:06 juju-e4d256-prod-github-runner-207 kernel: [28340.607775] ? do_futex+0x162/0x1f0 Aug 22 13:16:06 juju-e4d256-prod-github-runner-207 kernel: [28340.608421] ? __x64_sys_futex+0x78/0x1e0 Aug 22 13:16:06 juju-e4d256-prod-github-runner-207 kernel: [28340.609090] ? __secure_computing+0xa9/0x120 Aug 22 13:16:06 juju-e4d256-prod-github-runner-207 kernel: [28340.609776] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 13:16:06 juju-e4d256-prod-github-runner-207 kernel: [28340.610541] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:16:06 juju-e4d256-prod-github-runner-207 kernel: [28340.611285] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:16:06 juju-e4d256-prod-github-runner-207 kernel: [28340.611998] ? do_syscall_64+0x69/0xc0 Aug 22 13:16:06 juju-e4d256-prod-github-runner-207 kernel: [28340.612650] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:16:06 juju-e4d256-prod-github-runner-207 kernel: [28340.613350] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:16:06 juju-e4d256-prod-github-runner-207 kernel: [28340.614052] ? do_syscall_64+0x69/0xc0 Aug 22 13:16:06 juju-e4d256-prod-github-runner-207 kernel: [28340.614674] ? do_syscall_64+0x69/0xc0 Aug 22 13:16:06 juju-e4d256-prod-github-runner-207 kernel: [28340.615303] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 13:16:06 juju-e4d256-prod-github-runner-207 kernel: [28340.616008] RIP: 0033:0x7faa5d0edaff Aug 22 13:16:06 juju-e4d256-prod-github-runner-207 kernel: [28340.616626] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 13:16:06 juju-e4d256-prod-github-runner-207 kernel: [28340.618600] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 13:16:06 juju-e4d256-prod-github-runner-207 kernel: [28340.619525] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 13:16:06 juju-e4d256-prod-github-runner-207 kernel: [28340.620415] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 13:16:06 juju-e4d256-prod-github-runner-207 kernel: [28340.621300] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 13:16:06 juju-e4d256-prod-github-runner-207 kernel: [28340.622181] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 13:16:06 juju-e4d256-prod-github-runner-207 kernel: [28340.623070] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 13:16:06 juju-e4d256-prod-github-runner-207 kernel: [28340.623957] Aug 22 13:16:34 juju-e4d256-prod-github-runner-207 kernel: [28368.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 26312s! [qemu-system-x86:6715] Aug 22 13:16:34 juju-e4d256-prod-github-runner-207 kernel: [28368.543120] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 13:16:34 juju-e4d256-prod-github-runner-207 kernel: [28368.543192] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 13:16:34 juju-e4d256-prod-github-runner-207 kernel: [28368.555882] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 13:16:34 juju-e4d256-prod-github-runner-207 kernel: [28368.557207] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 13:16:34 juju-e4d256-prod-github-runner-207 kernel: [28368.558480] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:16:34 juju-e4d256-prod-github-runner-207 kernel: [28368.559554] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 13:16:34 juju-e4d256-prod-github-runner-207 kernel: [28368.562159] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 13:16:34 juju-e4d256-prod-github-runner-207 kernel: [28368.563272] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 13:16:34 juju-e4d256-prod-github-runner-207 kernel: [28368.564458] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 13:16:34 juju-e4d256-prod-github-runner-207 kernel: [28368.565636] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 13:16:34 juju-e4d256-prod-github-runner-207 kernel: [28368.566833] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 13:16:34 juju-e4d256-prod-github-runner-207 kernel: [28368.568039] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 13:16:34 juju-e4d256-prod-github-runner-207 kernel: [28368.569222] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 13:16:34 juju-e4d256-prod-github-runner-207 kernel: [28368.570489] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 13:16:34 juju-e4d256-prod-github-runner-207 kernel: [28368.571612] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 13:16:34 juju-e4d256-prod-github-runner-207 kernel: [28368.572842] Call Trace: Aug 22 13:16:34 juju-e4d256-prod-github-runner-207 kernel: [28368.573792] Aug 22 13:16:34 juju-e4d256-prod-github-runner-207 kernel: [28368.574773] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:16:34 juju-e4d256-prod-github-runner-207 kernel: [28368.575827] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:16:34 juju-e4d256-prod-github-runner-207 kernel: [28368.576864] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:16:34 juju-e4d256-prod-github-runner-207 kernel: [28368.577984] ? show_regs.part.0+0x23/0x29 Aug 22 13:16:34 juju-e4d256-prod-github-runner-207 kernel: [28368.579030] ? show_regs.cold+0x8/0xd Aug 22 13:16:34 juju-e4d256-prod-github-runner-207 kernel: [28368.580076] ? watchdog_timer_fn+0x1be/0x220 Aug 22 13:16:34 juju-e4d256-prod-github-runner-207 kernel: [28368.581132] ? lockup_detector_update_enable+0x60/0x60 Aug 22 13:16:34 juju-e4d256-prod-github-runner-207 kernel: [28368.582232] ? __hrtimer_run_queues+0x107/0x230 Aug 22 13:16:34 juju-e4d256-prod-github-runner-207 kernel: [28368.583292] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 13:16:34 juju-e4d256-prod-github-runner-207 kernel: [28368.584333] ? hrtimer_interrupt+0x101/0x220 Aug 22 13:16:34 juju-e4d256-prod-github-runner-207 kernel: [28368.585368] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 13:16:34 juju-e4d256-prod-github-runner-207 kernel: [28368.586670] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 13:16:34 juju-e4d256-prod-github-runner-207 kernel: [28368.587737] Aug 22 13:16:34 juju-e4d256-prod-github-runner-207 kernel: [28368.588602] Aug 22 13:16:34 juju-e4d256-prod-github-runner-207 kernel: [28368.589451] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 13:16:34 juju-e4d256-prod-github-runner-207 kernel: [28368.590542] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:16:34 juju-e4d256-prod-github-runner-207 kernel: [28368.591615] ? _raw_spin_lock+0x22/0x30 Aug 22 13:16:34 juju-e4d256-prod-github-runner-207 kernel: [28368.592797] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:16:34 juju-e4d256-prod-github-runner-207 kernel: [28368.593871] direct_page_fault+0x206/0x310 [kvm] Aug 22 13:16:34 juju-e4d256-prod-github-runner-207 kernel: [28368.594971] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 13:16:34 juju-e4d256-prod-github-runner-207 kernel: [28368.596025] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 13:16:34 juju-e4d256-prod-github-runner-207 kernel: [28368.597094] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 13:16:34 juju-e4d256-prod-github-runner-207 kernel: [28368.598114] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 13:16:34 juju-e4d256-prod-github-runner-207 kernel: [28368.599172] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 13:16:34 juju-e4d256-prod-github-runner-207 kernel: [28368.600193] handle_exit+0x98/0x230 [kvm_amd] Aug 22 13:16:34 juju-e4d256-prod-github-runner-207 kernel: [28368.601120] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 13:16:34 juju-e4d256-prod-github-runner-207 kernel: [28368.602064] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 13:16:34 juju-e4d256-prod-github-runner-207 kernel: [28368.603030] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 13:16:34 juju-e4d256-prod-github-runner-207 kernel: [28368.603944] vcpu_run+0x62/0x2c0 [kvm] Aug 22 13:16:34 juju-e4d256-prod-github-runner-207 kernel: [28368.604809] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 13:16:34 juju-e4d256-prod-github-runner-207 kernel: [28368.605750] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 13:16:34 juju-e4d256-prod-github-runner-207 kernel: [28368.606684] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 13:16:34 juju-e4d256-prod-github-runner-207 kernel: [28368.607511] ? __seccomp_filter+0x4a/0x4a0 Aug 22 13:16:34 juju-e4d256-prod-github-runner-207 kernel: [28368.608268] ? __fget_files+0x86/0xc0 Aug 22 13:16:34 juju-e4d256-prod-github-runner-207 kernel: [28368.608986] __x64_sys_ioctl+0x95/0xd0 Aug 22 13:16:34 juju-e4d256-prod-github-runner-207 kernel: [28368.609690] do_syscall_64+0x5c/0xc0 Aug 22 13:16:34 juju-e4d256-prod-github-runner-207 kernel: [28368.610398] ? do_futex+0x162/0x1f0 Aug 22 13:16:34 juju-e4d256-prod-github-runner-207 kernel: [28368.611063] ? __x64_sys_futex+0x78/0x1e0 Aug 22 13:16:34 juju-e4d256-prod-github-runner-207 kernel: [28368.611750] ? __secure_computing+0xa9/0x120 Aug 22 13:16:34 juju-e4d256-prod-github-runner-207 kernel: [28368.612460] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 13:16:34 juju-e4d256-prod-github-runner-207 kernel: [28368.613236] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:16:34 juju-e4d256-prod-github-runner-207 kernel: [28368.614250] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:16:34 juju-e4d256-prod-github-runner-207 kernel: [28368.615265] ? do_syscall_64+0x69/0xc0 Aug 22 13:16:34 juju-e4d256-prod-github-runner-207 kernel: [28368.616061] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:16:34 juju-e4d256-prod-github-runner-207 kernel: [28368.616858] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:16:34 juju-e4d256-prod-github-runner-207 kernel: [28368.617591] ? do_syscall_64+0x69/0xc0 Aug 22 13:16:34 juju-e4d256-prod-github-runner-207 kernel: [28368.618241] ? do_syscall_64+0x69/0xc0 Aug 22 13:16:34 juju-e4d256-prod-github-runner-207 kernel: [28368.618900] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 13:16:34 juju-e4d256-prod-github-runner-207 kernel: [28368.619629] RIP: 0033:0x7faa5d0edaff Aug 22 13:16:34 juju-e4d256-prod-github-runner-207 kernel: [28368.620266] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 13:16:34 juju-e4d256-prod-github-runner-207 kernel: [28368.622315] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 13:16:34 juju-e4d256-prod-github-runner-207 kernel: [28368.623275] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 13:16:34 juju-e4d256-prod-github-runner-207 kernel: [28368.624183] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 13:16:34 juju-e4d256-prod-github-runner-207 kernel: [28368.625170] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 13:16:34 juju-e4d256-prod-github-runner-207 kernel: [28368.626092] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 13:16:34 juju-e4d256-prod-github-runner-207 kernel: [28368.627027] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 13:16:34 juju-e4d256-prod-github-runner-207 kernel: [28368.627942] Aug 22 13:17:02 juju-e4d256-prod-github-runner-207 kernel: [28396.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 26338s! [qemu-system-x86:6715] Aug 22 13:17:02 juju-e4d256-prod-github-runner-207 kernel: [28396.543868] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 13:17:02 juju-e4d256-prod-github-runner-207 kernel: [28396.544146] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 13:17:02 juju-e4d256-prod-github-runner-207 kernel: [28396.556609] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 13:17:02 juju-e4d256-prod-github-runner-207 kernel: [28396.557882] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 13:17:02 juju-e4d256-prod-github-runner-207 kernel: [28396.559119] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:17:02 juju-e4d256-prod-github-runner-207 kernel: [28396.560176] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 13:17:02 juju-e4d256-prod-github-runner-207 kernel: [28396.562743] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 13:17:02 juju-e4d256-prod-github-runner-207 kernel: [28396.563785] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 13:17:02 juju-e4d256-prod-github-runner-207 kernel: [28396.564945] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 13:17:02 juju-e4d256-prod-github-runner-207 kernel: [28396.566121] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 13:17:02 juju-e4d256-prod-github-runner-207 kernel: [28396.567283] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 13:17:02 juju-e4d256-prod-github-runner-207 kernel: [28396.568442] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 13:17:02 juju-e4d256-prod-github-runner-207 kernel: [28396.569608] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 13:17:02 juju-e4d256-prod-github-runner-207 kernel: [28396.570859] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 13:17:02 juju-e4d256-prod-github-runner-207 kernel: [28396.571992] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 13:17:02 juju-e4d256-prod-github-runner-207 kernel: [28396.573191] Call Trace: Aug 22 13:17:02 juju-e4d256-prod-github-runner-207 kernel: [28396.574120] Aug 22 13:17:02 juju-e4d256-prod-github-runner-207 kernel: [28396.575019] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:17:02 juju-e4d256-prod-github-runner-207 kernel: [28396.576061] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:17:02 juju-e4d256-prod-github-runner-207 kernel: [28396.577108] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:17:02 juju-e4d256-prod-github-runner-207 kernel: [28396.578237] ? show_regs.part.0+0x23/0x29 Aug 22 13:17:02 juju-e4d256-prod-github-runner-207 kernel: [28396.579231] ? show_regs.cold+0x8/0xd Aug 22 13:17:02 juju-e4d256-prod-github-runner-207 kernel: [28396.580205] ? watchdog_timer_fn+0x1be/0x220 Aug 22 13:17:02 juju-e4d256-prod-github-runner-207 kernel: [28396.581212] ? lockup_detector_update_enable+0x60/0x60 Aug 22 13:17:02 juju-e4d256-prod-github-runner-207 kernel: [28396.582304] ? __hrtimer_run_queues+0x107/0x230 Aug 22 13:17:02 juju-e4d256-prod-github-runner-207 kernel: [28396.583331] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 13:17:02 juju-e4d256-prod-github-runner-207 kernel: [28396.584352] ? hrtimer_interrupt+0x101/0x220 Aug 22 13:17:02 juju-e4d256-prod-github-runner-207 kernel: [28396.585364] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 13:17:02 juju-e4d256-prod-github-runner-207 kernel: [28396.586449] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 13:17:02 juju-e4d256-prod-github-runner-207 kernel: [28396.587493] Aug 22 13:17:02 juju-e4d256-prod-github-runner-207 kernel: [28396.588353] Aug 22 13:17:02 juju-e4d256-prod-github-runner-207 kernel: [28396.589188] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 13:17:02 juju-e4d256-prod-github-runner-207 kernel: [28396.590324] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:17:02 juju-e4d256-prod-github-runner-207 kernel: [28396.591367] ? _raw_spin_lock+0x22/0x30 Aug 22 13:17:02 juju-e4d256-prod-github-runner-207 kernel: [28396.592310] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:17:02 juju-e4d256-prod-github-runner-207 kernel: [28396.593328] direct_page_fault+0x206/0x310 [kvm] Aug 22 13:17:02 juju-e4d256-prod-github-runner-207 kernel: [28396.594363] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 13:17:02 juju-e4d256-prod-github-runner-207 kernel: [28396.595371] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 13:17:02 juju-e4d256-prod-github-runner-207 kernel: [28396.596373] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 13:17:02 juju-e4d256-prod-github-runner-207 kernel: [28396.597381] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 13:17:02 juju-e4d256-prod-github-runner-207 kernel: [28396.598335] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 13:17:02 juju-e4d256-prod-github-runner-207 kernel: [28396.599311] handle_exit+0x98/0x230 [kvm_amd] Aug 22 13:17:02 juju-e4d256-prod-github-runner-207 kernel: [28396.600200] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 13:17:02 juju-e4d256-prod-github-runner-207 kernel: [28396.601117] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 13:17:02 juju-e4d256-prod-github-runner-207 kernel: [28396.602051] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 13:17:02 juju-e4d256-prod-github-runner-207 kernel: [28396.602961] vcpu_run+0x62/0x2c0 [kvm] Aug 22 13:17:02 juju-e4d256-prod-github-runner-207 kernel: [28396.603773] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 13:17:02 juju-e4d256-prod-github-runner-207 kernel: [28396.604580] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 13:17:02 juju-e4d256-prod-github-runner-207 kernel: [28396.605433] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 13:17:02 juju-e4d256-prod-github-runner-207 kernel: [28396.606242] ? __seccomp_filter+0x4a/0x4a0 Aug 22 13:17:02 juju-e4d256-prod-github-runner-207 kernel: [28396.606989] ? __fget_files+0x86/0xc0 Aug 22 13:17:02 juju-e4d256-prod-github-runner-207 kernel: [28396.607690] __x64_sys_ioctl+0x95/0xd0 Aug 22 13:17:02 juju-e4d256-prod-github-runner-207 kernel: [28396.608382] do_syscall_64+0x5c/0xc0 Aug 22 13:17:02 juju-e4d256-prod-github-runner-207 kernel: [28396.609051] ? do_futex+0x162/0x1f0 Aug 22 13:17:02 juju-e4d256-prod-github-runner-207 kernel: [28396.609699] ? __x64_sys_futex+0x78/0x1e0 Aug 22 13:17:02 juju-e4d256-prod-github-runner-207 kernel: [28396.610388] ? __secure_computing+0xa9/0x120 Aug 22 13:17:02 juju-e4d256-prod-github-runner-207 kernel: [28396.611077] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 13:17:02 juju-e4d256-prod-github-runner-207 kernel: [28396.611841] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:17:02 juju-e4d256-prod-github-runner-207 kernel: [28396.612561] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:17:02 juju-e4d256-prod-github-runner-207 kernel: [28396.613280] ? do_syscall_64+0x69/0xc0 Aug 22 13:17:02 juju-e4d256-prod-github-runner-207 kernel: [28396.613924] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:17:02 juju-e4d256-prod-github-runner-207 kernel: [28396.614636] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:17:02 juju-e4d256-prod-github-runner-207 kernel: [28396.615338] ? do_syscall_64+0x69/0xc0 Aug 22 13:17:02 juju-e4d256-prod-github-runner-207 kernel: [28396.615963] ? do_syscall_64+0x69/0xc0 Aug 22 13:17:02 juju-e4d256-prod-github-runner-207 kernel: [28396.616589] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 13:17:02 juju-e4d256-prod-github-runner-207 kernel: [28396.617296] RIP: 0033:0x7faa5d0edaff Aug 22 13:17:02 juju-e4d256-prod-github-runner-207 kernel: [28396.617954] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 13:17:02 juju-e4d256-prod-github-runner-207 kernel: [28396.619962] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 13:17:02 juju-e4d256-prod-github-runner-207 kernel: [28396.620879] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 13:17:02 juju-e4d256-prod-github-runner-207 kernel: [28396.621769] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 13:17:02 juju-e4d256-prod-github-runner-207 kernel: [28396.622710] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 13:17:02 juju-e4d256-prod-github-runner-207 kernel: [28396.623610] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 13:17:02 juju-e4d256-prod-github-runner-207 kernel: [28396.624506] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 13:17:02 juju-e4d256-prod-github-runner-207 kernel: [28396.625457] Aug 22 13:17:30 juju-e4d256-prod-github-runner-207 kernel: [28424.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 26364s! [qemu-system-x86:6715] Aug 22 13:17:30 juju-e4d256-prod-github-runner-207 kernel: [28424.543109] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 13:17:30 juju-e4d256-prod-github-runner-207 kernel: [28424.543189] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 13:17:30 juju-e4d256-prod-github-runner-207 kernel: [28424.555332] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 13:17:30 juju-e4d256-prod-github-runner-207 kernel: [28424.556627] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 13:17:30 juju-e4d256-prod-github-runner-207 kernel: [28424.557889] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:17:30 juju-e4d256-prod-github-runner-207 kernel: [28424.558972] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 13:17:30 juju-e4d256-prod-github-runner-207 kernel: [28424.561588] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 13:17:30 juju-e4d256-prod-github-runner-207 kernel: [28424.562652] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 13:17:30 juju-e4d256-prod-github-runner-207 kernel: [28424.563828] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 13:17:30 juju-e4d256-prod-github-runner-207 kernel: [28424.565010] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 13:17:30 juju-e4d256-prod-github-runner-207 kernel: [28424.566196] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 13:17:30 juju-e4d256-prod-github-runner-207 kernel: [28424.567364] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 13:17:30 juju-e4d256-prod-github-runner-207 kernel: [28424.568533] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 13:17:30 juju-e4d256-prod-github-runner-207 kernel: [28424.569813] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 13:17:30 juju-e4d256-prod-github-runner-207 kernel: [28424.570933] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 13:17:30 juju-e4d256-prod-github-runner-207 kernel: [28424.572134] Call Trace: Aug 22 13:17:30 juju-e4d256-prod-github-runner-207 kernel: [28424.573050] Aug 22 13:17:30 juju-e4d256-prod-github-runner-207 kernel: [28424.573953] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:17:30 juju-e4d256-prod-github-runner-207 kernel: [28424.575013] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:17:30 juju-e4d256-prod-github-runner-207 kernel: [28424.576050] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:17:30 juju-e4d256-prod-github-runner-207 kernel: [28424.577123] ? show_regs.part.0+0x23/0x29 Aug 22 13:17:30 juju-e4d256-prod-github-runner-207 kernel: [28424.578133] ? show_regs.cold+0x8/0xd Aug 22 13:17:30 juju-e4d256-prod-github-runner-207 kernel: [28424.579111] ? watchdog_timer_fn+0x1be/0x220 Aug 22 13:17:30 juju-e4d256-prod-github-runner-207 kernel: [28424.580137] ? lockup_detector_update_enable+0x60/0x60 Aug 22 13:17:30 juju-e4d256-prod-github-runner-207 kernel: [28424.581214] ? __hrtimer_run_queues+0x107/0x230 Aug 22 13:17:30 juju-e4d256-prod-github-runner-207 kernel: [28424.582260] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 13:17:30 juju-e4d256-prod-github-runner-207 kernel: [28424.583288] ? hrtimer_interrupt+0x101/0x220 Aug 22 13:17:30 juju-e4d256-prod-github-runner-207 kernel: [28424.584303] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 13:17:30 juju-e4d256-prod-github-runner-207 kernel: [28424.585391] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 13:17:30 juju-e4d256-prod-github-runner-207 kernel: [28424.586681] Aug 22 13:17:30 juju-e4d256-prod-github-runner-207 kernel: [28424.587532] Aug 22 13:17:30 juju-e4d256-prod-github-runner-207 kernel: [28424.588374] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 13:17:30 juju-e4d256-prod-github-runner-207 kernel: [28424.589408] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:17:30 juju-e4d256-prod-github-runner-207 kernel: [28424.590493] ? _raw_spin_lock+0x22/0x30 Aug 22 13:17:30 juju-e4d256-prod-github-runner-207 kernel: [28424.591467] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:17:30 juju-e4d256-prod-github-runner-207 kernel: [28424.592489] direct_page_fault+0x206/0x310 [kvm] Aug 22 13:17:30 juju-e4d256-prod-github-runner-207 kernel: [28424.593514] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 13:17:30 juju-e4d256-prod-github-runner-207 kernel: [28424.594533] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 13:17:30 juju-e4d256-prod-github-runner-207 kernel: [28424.595548] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 13:17:30 juju-e4d256-prod-github-runner-207 kernel: [28424.596532] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 13:17:30 juju-e4d256-prod-github-runner-207 kernel: [28424.597478] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 13:17:30 juju-e4d256-prod-github-runner-207 kernel: [28424.598473] handle_exit+0x98/0x230 [kvm_amd] Aug 22 13:17:30 juju-e4d256-prod-github-runner-207 kernel: [28424.599390] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 13:17:30 juju-e4d256-prod-github-runner-207 kernel: [28424.600354] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 13:17:30 juju-e4d256-prod-github-runner-207 kernel: [28424.601301] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 13:17:30 juju-e4d256-prod-github-runner-207 kernel: [28424.602237] vcpu_run+0x62/0x2c0 [kvm] Aug 22 13:17:30 juju-e4d256-prod-github-runner-207 kernel: [28424.603059] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 13:17:30 juju-e4d256-prod-github-runner-207 kernel: [28424.603870] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 13:17:30 juju-e4d256-prod-github-runner-207 kernel: [28424.604728] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 13:17:30 juju-e4d256-prod-github-runner-207 kernel: [28424.605690] ? __seccomp_filter+0x4a/0x4a0 Aug 22 13:17:30 juju-e4d256-prod-github-runner-207 kernel: [28424.606553] ? __fget_files+0x86/0xc0 Aug 22 13:17:30 juju-e4d256-prod-github-runner-207 kernel: [28424.607337] __x64_sys_ioctl+0x95/0xd0 Aug 22 13:17:30 juju-e4d256-prod-github-runner-207 kernel: [28424.608196] do_syscall_64+0x5c/0xc0 Aug 22 13:17:30 juju-e4d256-prod-github-runner-207 kernel: [28424.608937] ? do_futex+0x162/0x1f0 Aug 22 13:17:30 juju-e4d256-prod-github-runner-207 kernel: [28424.609607] ? __x64_sys_futex+0x78/0x1e0 Aug 22 13:17:30 juju-e4d256-prod-github-runner-207 kernel: [28424.610301] ? __secure_computing+0xa9/0x120 Aug 22 13:17:30 juju-e4d256-prod-github-runner-207 kernel: [28424.610997] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 13:17:30 juju-e4d256-prod-github-runner-207 kernel: [28424.611757] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:17:30 juju-e4d256-prod-github-runner-207 kernel: [28424.612480] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:17:30 juju-e4d256-prod-github-runner-207 kernel: [28424.613202] ? do_syscall_64+0x69/0xc0 Aug 22 13:17:30 juju-e4d256-prod-github-runner-207 kernel: [28424.613857] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:17:30 juju-e4d256-prod-github-runner-207 kernel: [28424.614566] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:17:30 juju-e4d256-prod-github-runner-207 kernel: [28424.615263] ? do_syscall_64+0x69/0xc0 Aug 22 13:17:30 juju-e4d256-prod-github-runner-207 kernel: [28424.615897] ? do_syscall_64+0x69/0xc0 Aug 22 13:17:30 juju-e4d256-prod-github-runner-207 kernel: [28424.616518] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 13:17:30 juju-e4d256-prod-github-runner-207 kernel: [28424.617223] RIP: 0033:0x7faa5d0edaff Aug 22 13:17:30 juju-e4d256-prod-github-runner-207 kernel: [28424.617887] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 13:17:30 juju-e4d256-prod-github-runner-207 kernel: [28424.619875] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 13:17:30 juju-e4d256-prod-github-runner-207 kernel: [28424.620791] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 13:17:30 juju-e4d256-prod-github-runner-207 kernel: [28424.621691] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 13:17:30 juju-e4d256-prod-github-runner-207 kernel: [28424.622579] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 13:17:30 juju-e4d256-prod-github-runner-207 kernel: [28424.623470] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 13:17:30 juju-e4d256-prod-github-runner-207 kernel: [28424.624357] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 13:17:30 juju-e4d256-prod-github-runner-207 kernel: [28424.625251] Aug 22 13:17:45 juju-e4d256-prod-github-runner-207 kernel: [28439.085201] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 13:17:45 juju-e4d256-prod-github-runner-207 kernel: [28439.091273] rcu: 1-....: (7058411 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=3412082 Aug 22 13:17:45 juju-e4d256-prod-github-runner-207 kernel: [28439.095322] (t=7080471 jiffies g=23269 q=32316) Aug 22 13:17:45 juju-e4d256-prod-github-runner-207 kernel: [28439.096743] NMI backtrace for cpu 1 Aug 22 13:17:45 juju-e4d256-prod-github-runner-207 kernel: [28439.099972] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 13:17:45 juju-e4d256-prod-github-runner-207 kernel: [28439.105157] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 13:17:45 juju-e4d256-prod-github-runner-207 kernel: [28439.106239] Call Trace: Aug 22 13:17:45 juju-e4d256-prod-github-runner-207 kernel: [28439.111258] Aug 22 13:17:45 juju-e4d256-prod-github-runner-207 kernel: [28439.113052] show_stack+0x52/0x5c Aug 22 13:17:45 juju-e4d256-prod-github-runner-207 kernel: [28439.117324] dump_stack_lvl+0x4a/0x63 Aug 22 13:17:45 juju-e4d256-prod-github-runner-207 kernel: [28439.119708] dump_stack+0x10/0x16 Aug 22 13:17:45 juju-e4d256-prod-github-runner-207 kernel: [28439.123227] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 13:17:45 juju-e4d256-prod-github-runner-207 kernel: [28439.126239] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 13:17:45 juju-e4d256-prod-github-runner-207 kernel: [28439.127062] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 13:17:45 juju-e4d256-prod-github-runner-207 kernel: [28439.127880] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 13:17:45 juju-e4d256-prod-github-runner-207 kernel: [28439.128742] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 13:17:45 juju-e4d256-prod-github-runner-207 kernel: [28439.129614] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 13:17:45 juju-e4d256-prod-github-runner-207 kernel: [28439.130394] print_cpu_stall.cold+0x2f/0xe2 Aug 22 13:17:45 juju-e4d256-prod-github-runner-207 kernel: [28439.131251] ? timekeeping_update+0xf7/0x150 Aug 22 13:17:45 juju-e4d256-prod-github-runner-207 kernel: [28439.132122] check_cpu_stall+0x109/0x270 Aug 22 13:17:45 juju-e4d256-prod-github-runner-207 kernel: [28439.132914] rcu_sched_clock_irq+0x9a/0x250 Aug 22 13:17:45 juju-e4d256-prod-github-runner-207 kernel: [28439.133693] update_process_times+0x94/0xd0 Aug 22 13:17:45 juju-e4d256-prod-github-runner-207 kernel: [28439.134452] tick_sched_handle+0x29/0x70 Aug 22 13:17:45 juju-e4d256-prod-github-runner-207 kernel: [28439.135198] tick_sched_timer+0x8c/0xc0 Aug 22 13:17:45 juju-e4d256-prod-github-runner-207 kernel: [28439.135944] ? tick_nohz_handler+0xb0/0xb0 Aug 22 13:17:45 juju-e4d256-prod-github-runner-207 kernel: [28439.136695] __hrtimer_run_queues+0x107/0x230 Aug 22 13:17:45 juju-e4d256-prod-github-runner-207 kernel: [28439.137490] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 13:17:45 juju-e4d256-prod-github-runner-207 kernel: [28439.138264] hrtimer_interrupt+0x101/0x220 Aug 22 13:17:45 juju-e4d256-prod-github-runner-207 kernel: [28439.139024] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 13:17:45 juju-e4d256-prod-github-runner-207 kernel: [28439.139864] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 13:17:45 juju-e4d256-prod-github-runner-207 kernel: [28439.140687] Aug 22 13:17:45 juju-e4d256-prod-github-runner-207 kernel: [28439.141328] Aug 22 13:17:45 juju-e4d256-prod-github-runner-207 kernel: [28439.141999] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 13:17:45 juju-e4d256-prod-github-runner-207 kernel: [28439.142832] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:17:45 juju-e4d256-prod-github-runner-207 kernel: [28439.143711] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 13:17:45 juju-e4d256-prod-github-runner-207 kernel: [28439.145927] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 13:17:45 juju-e4d256-prod-github-runner-207 kernel: [28439.146947] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 13:17:45 juju-e4d256-prod-github-runner-207 kernel: [28439.147940] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 13:17:45 juju-e4d256-prod-github-runner-207 kernel: [28439.148917] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 13:17:45 juju-e4d256-prod-github-runner-207 kernel: [28439.149898] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 13:17:45 juju-e4d256-prod-github-runner-207 kernel: [28439.150861] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 13:17:45 juju-e4d256-prod-github-runner-207 kernel: [28439.151814] ? _raw_spin_lock+0x22/0x30 Aug 22 13:17:45 juju-e4d256-prod-github-runner-207 kernel: [28439.152572] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:17:45 juju-e4d256-prod-github-runner-207 kernel: [28439.153447] direct_page_fault+0x206/0x310 [kvm] Aug 22 13:17:45 juju-e4d256-prod-github-runner-207 kernel: [28439.154423] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 13:17:45 juju-e4d256-prod-github-runner-207 kernel: [28439.155308] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 13:17:45 juju-e4d256-prod-github-runner-207 kernel: [28439.156164] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 13:17:45 juju-e4d256-prod-github-runner-207 kernel: [28439.156970] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 13:17:45 juju-e4d256-prod-github-runner-207 kernel: [28439.157780] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 13:17:45 juju-e4d256-prod-github-runner-207 kernel: [28439.158662] handle_exit+0x98/0x230 [kvm_amd] Aug 22 13:17:45 juju-e4d256-prod-github-runner-207 kernel: [28439.159444] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 13:17:45 juju-e4d256-prod-github-runner-207 kernel: [28439.160228] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 13:17:45 juju-e4d256-prod-github-runner-207 kernel: [28439.161028] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 13:17:45 juju-e4d256-prod-github-runner-207 kernel: [28439.161833] vcpu_run+0x62/0x2c0 [kvm] Aug 22 13:17:45 juju-e4d256-prod-github-runner-207 kernel: [28439.162551] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 13:17:45 juju-e4d256-prod-github-runner-207 kernel: [28439.163305] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 13:17:45 juju-e4d256-prod-github-runner-207 kernel: [28439.164116] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 13:17:45 juju-e4d256-prod-github-runner-207 kernel: [28439.164878] ? __seccomp_filter+0x4a/0x4a0 Aug 22 13:17:45 juju-e4d256-prod-github-runner-207 kernel: [28439.165611] ? __fget_files+0x86/0xc0 Aug 22 13:17:45 juju-e4d256-prod-github-runner-207 kernel: [28439.166355] __x64_sys_ioctl+0x95/0xd0 Aug 22 13:17:45 juju-e4d256-prod-github-runner-207 kernel: [28439.167064] do_syscall_64+0x5c/0xc0 Aug 22 13:17:45 juju-e4d256-prod-github-runner-207 kernel: [28439.167746] ? do_futex+0x162/0x1f0 Aug 22 13:17:45 juju-e4d256-prod-github-runner-207 kernel: [28439.168417] ? __x64_sys_futex+0x78/0x1e0 Aug 22 13:17:45 juju-e4d256-prod-github-runner-207 kernel: [28439.169140] ? __secure_computing+0xa9/0x120 Aug 22 13:17:45 juju-e4d256-prod-github-runner-207 kernel: [28439.169865] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 13:17:45 juju-e4d256-prod-github-runner-207 kernel: [28439.170654] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:17:45 juju-e4d256-prod-github-runner-207 kernel: [28439.171407] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:17:45 juju-e4d256-prod-github-runner-207 kernel: [28439.172160] ? do_syscall_64+0x69/0xc0 Aug 22 13:17:45 juju-e4d256-prod-github-runner-207 kernel: [28439.172849] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:17:45 juju-e4d256-prod-github-runner-207 kernel: [28439.173621] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:17:45 juju-e4d256-prod-github-runner-207 kernel: [28439.174384] ? do_syscall_64+0x69/0xc0 Aug 22 13:17:45 juju-e4d256-prod-github-runner-207 kernel: [28439.175096] ? do_syscall_64+0x69/0xc0 Aug 22 13:17:45 juju-e4d256-prod-github-runner-207 kernel: [28439.175800] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 13:17:45 juju-e4d256-prod-github-runner-207 kernel: [28439.176582] RIP: 0033:0x7faa5d0edaff Aug 22 13:17:45 juju-e4d256-prod-github-runner-207 kernel: [28439.177269] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 13:17:45 juju-e4d256-prod-github-runner-207 kernel: [28439.179370] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 13:17:45 juju-e4d256-prod-github-runner-207 kernel: [28439.180330] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 13:17:45 juju-e4d256-prod-github-runner-207 kernel: [28439.181272] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 13:17:45 juju-e4d256-prod-github-runner-207 kernel: [28439.182224] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 13:17:45 juju-e4d256-prod-github-runner-207 kernel: [28439.183162] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 13:17:45 juju-e4d256-prod-github-runner-207 kernel: [28439.184087] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 13:17:45 juju-e4d256-prod-github-runner-207 kernel: [28439.185016] Aug 22 13:18:10 juju-e4d256-prod-github-runner-207 kernel: [28464.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 26401s! [qemu-system-x86:6715] Aug 22 13:18:10 juju-e4d256-prod-github-runner-207 kernel: [28464.543145] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 13:18:10 juju-e4d256-prod-github-runner-207 kernel: [28464.543221] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 13:18:10 juju-e4d256-prod-github-runner-207 kernel: [28464.555399] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 13:18:10 juju-e4d256-prod-github-runner-207 kernel: [28464.556660] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 13:18:10 juju-e4d256-prod-github-runner-207 kernel: [28464.557883] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:18:10 juju-e4d256-prod-github-runner-207 kernel: [28464.558934] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 13:18:10 juju-e4d256-prod-github-runner-207 kernel: [28464.561485] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 13:18:10 juju-e4d256-prod-github-runner-207 kernel: [28464.562540] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 13:18:10 juju-e4d256-prod-github-runner-207 kernel: [28464.563698] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 13:18:10 juju-e4d256-prod-github-runner-207 kernel: [28464.564852] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 13:18:10 juju-e4d256-prod-github-runner-207 kernel: [28464.566016] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 13:18:10 juju-e4d256-prod-github-runner-207 kernel: [28464.567173] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 13:18:10 juju-e4d256-prod-github-runner-207 kernel: [28464.568393] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 13:18:10 juju-e4d256-prod-github-runner-207 kernel: [28464.569715] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 13:18:10 juju-e4d256-prod-github-runner-207 kernel: [28464.570871] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 13:18:10 juju-e4d256-prod-github-runner-207 kernel: [28464.572079] Call Trace: Aug 22 13:18:10 juju-e4d256-prod-github-runner-207 kernel: [28464.573000] Aug 22 13:18:10 juju-e4d256-prod-github-runner-207 kernel: [28464.573925] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:18:10 juju-e4d256-prod-github-runner-207 kernel: [28464.574982] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:18:10 juju-e4d256-prod-github-runner-207 kernel: [28464.576005] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:18:10 juju-e4d256-prod-github-runner-207 kernel: [28464.577086] ? show_regs.part.0+0x23/0x29 Aug 22 13:18:10 juju-e4d256-prod-github-runner-207 kernel: [28464.578102] ? show_regs.cold+0x8/0xd Aug 22 13:18:10 juju-e4d256-prod-github-runner-207 kernel: [28464.579093] ? watchdog_timer_fn+0x1be/0x220 Aug 22 13:18:10 juju-e4d256-prod-github-runner-207 kernel: [28464.580116] ? lockup_detector_update_enable+0x60/0x60 Aug 22 13:18:10 juju-e4d256-prod-github-runner-207 kernel: [28464.581210] ? __hrtimer_run_queues+0x107/0x230 Aug 22 13:18:10 juju-e4d256-prod-github-runner-207 kernel: [28464.582243] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 13:18:10 juju-e4d256-prod-github-runner-207 kernel: [28464.583270] ? hrtimer_interrupt+0x101/0x220 Aug 22 13:18:10 juju-e4d256-prod-github-runner-207 kernel: [28464.584300] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 13:18:10 juju-e4d256-prod-github-runner-207 kernel: [28464.585411] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 13:18:10 juju-e4d256-prod-github-runner-207 kernel: [28464.586474] Aug 22 13:18:10 juju-e4d256-prod-github-runner-207 kernel: [28464.587336] Aug 22 13:18:10 juju-e4d256-prod-github-runner-207 kernel: [28464.588174] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 13:18:10 juju-e4d256-prod-github-runner-207 kernel: [28464.589228] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:18:10 juju-e4d256-prod-github-runner-207 kernel: [28464.590295] ? _raw_spin_lock+0x22/0x30 Aug 22 13:18:10 juju-e4d256-prod-github-runner-207 kernel: [28464.591328] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:18:10 juju-e4d256-prod-github-runner-207 kernel: [28464.592367] direct_page_fault+0x206/0x310 [kvm] Aug 22 13:18:10 juju-e4d256-prod-github-runner-207 kernel: [28464.593413] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 13:18:10 juju-e4d256-prod-github-runner-207 kernel: [28464.594440] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 13:18:10 juju-e4d256-prod-github-runner-207 kernel: [28464.597903] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 13:18:10 juju-e4d256-prod-github-runner-207 kernel: [28464.598876] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 13:18:10 juju-e4d256-prod-github-runner-207 kernel: [28464.599840] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 13:18:10 juju-e4d256-prod-github-runner-207 kernel: [28464.600837] handle_exit+0x98/0x230 [kvm_amd] Aug 22 13:18:10 juju-e4d256-prod-github-runner-207 kernel: [28464.601752] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 13:18:10 juju-e4d256-prod-github-runner-207 kernel: [28464.602668] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 13:18:10 juju-e4d256-prod-github-runner-207 kernel: [28464.603598] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 13:18:10 juju-e4d256-prod-github-runner-207 kernel: [28464.604502] vcpu_run+0x62/0x2c0 [kvm] Aug 22 13:18:10 juju-e4d256-prod-github-runner-207 kernel: [28464.605385] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 13:18:10 juju-e4d256-prod-github-runner-207 kernel: [28464.606249] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 13:18:10 juju-e4d256-prod-github-runner-207 kernel: [28464.607112] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 13:18:10 juju-e4d256-prod-github-runner-207 kernel: [28464.607911] ? __seccomp_filter+0x4a/0x4a0 Aug 22 13:18:10 juju-e4d256-prod-github-runner-207 kernel: [28464.608658] ? __fget_files+0x86/0xc0 Aug 22 13:18:10 juju-e4d256-prod-github-runner-207 kernel: [28464.609387] __x64_sys_ioctl+0x95/0xd0 Aug 22 13:18:10 juju-e4d256-prod-github-runner-207 kernel: [28464.610111] do_syscall_64+0x5c/0xc0 Aug 22 13:18:10 juju-e4d256-prod-github-runner-207 kernel: [28464.610795] ? do_futex+0x162/0x1f0 Aug 22 13:18:10 juju-e4d256-prod-github-runner-207 kernel: [28464.611447] ? __x64_sys_futex+0x78/0x1e0 Aug 22 13:18:10 juju-e4d256-prod-github-runner-207 kernel: [28464.612125] ? __secure_computing+0xa9/0x120 Aug 22 13:18:10 juju-e4d256-prod-github-runner-207 kernel: [28464.612815] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 13:18:10 juju-e4d256-prod-github-runner-207 kernel: [28464.613585] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:18:10 juju-e4d256-prod-github-runner-207 kernel: [28464.614307] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:18:10 juju-e4d256-prod-github-runner-207 kernel: [28464.615038] ? do_syscall_64+0x69/0xc0 Aug 22 13:18:10 juju-e4d256-prod-github-runner-207 kernel: [28464.615684] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:18:10 juju-e4d256-prod-github-runner-207 kernel: [28464.616406] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:18:10 juju-e4d256-prod-github-runner-207 kernel: [28464.617101] ? do_syscall_64+0x69/0xc0 Aug 22 13:18:10 juju-e4d256-prod-github-runner-207 kernel: [28464.618432] ? do_syscall_64+0x69/0xc0 Aug 22 13:18:10 juju-e4d256-prod-github-runner-207 kernel: [28464.619162] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 13:18:10 juju-e4d256-prod-github-runner-207 kernel: [28464.619887] RIP: 0033:0x7faa5d0edaff Aug 22 13:18:10 juju-e4d256-prod-github-runner-207 kernel: [28464.620649] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 13:18:10 juju-e4d256-prod-github-runner-207 kernel: [28464.622715] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 13:18:10 juju-e4d256-prod-github-runner-207 kernel: [28464.623628] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 13:18:10 juju-e4d256-prod-github-runner-207 kernel: [28464.624527] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 13:18:10 juju-e4d256-prod-github-runner-207 kernel: [28464.625454] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 13:18:10 juju-e4d256-prod-github-runner-207 kernel: [28464.626363] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 13:18:10 juju-e4d256-prod-github-runner-207 kernel: [28464.627263] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 13:18:10 juju-e4d256-prod-github-runner-207 kernel: [28464.628154] Aug 22 13:18:38 juju-e4d256-prod-github-runner-207 kernel: [28492.541980] watchdog: BUG: soft lockup - CPU#1 stuck for 26427s! [qemu-system-x86:6715] Aug 22 13:18:38 juju-e4d256-prod-github-runner-207 kernel: [28492.543933] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 13:18:38 juju-e4d256-prod-github-runner-207 kernel: [28492.544245] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 13:18:38 juju-e4d256-prod-github-runner-207 kernel: [28492.556920] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 13:18:38 juju-e4d256-prod-github-runner-207 kernel: [28492.558189] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 13:18:38 juju-e4d256-prod-github-runner-207 kernel: [28492.559460] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:18:38 juju-e4d256-prod-github-runner-207 kernel: [28492.560527] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 13:18:38 juju-e4d256-prod-github-runner-207 kernel: [28492.563100] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 13:18:38 juju-e4d256-prod-github-runner-207 kernel: [28492.564142] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 13:18:38 juju-e4d256-prod-github-runner-207 kernel: [28492.565323] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 13:18:38 juju-e4d256-prod-github-runner-207 kernel: [28492.566508] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 13:18:38 juju-e4d256-prod-github-runner-207 kernel: [28492.567675] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 13:18:38 juju-e4d256-prod-github-runner-207 kernel: [28492.568855] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 13:18:38 juju-e4d256-prod-github-runner-207 kernel: [28492.570022] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 13:18:38 juju-e4d256-prod-github-runner-207 kernel: [28492.571259] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 13:18:38 juju-e4d256-prod-github-runner-207 kernel: [28492.572356] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 13:18:38 juju-e4d256-prod-github-runner-207 kernel: [28492.573558] Call Trace: Aug 22 13:18:38 juju-e4d256-prod-github-runner-207 kernel: [28492.574476] Aug 22 13:18:38 juju-e4d256-prod-github-runner-207 kernel: [28492.575383] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:18:38 juju-e4d256-prod-github-runner-207 kernel: [28492.576418] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:18:38 juju-e4d256-prod-github-runner-207 kernel: [28492.577462] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:18:38 juju-e4d256-prod-github-runner-207 kernel: [28492.578561] ? show_regs.part.0+0x23/0x29 Aug 22 13:18:38 juju-e4d256-prod-github-runner-207 kernel: [28492.579557] ? show_regs.cold+0x8/0xd Aug 22 13:18:38 juju-e4d256-prod-github-runner-207 kernel: [28492.580533] ? watchdog_timer_fn+0x1be/0x220 Aug 22 13:18:38 juju-e4d256-prod-github-runner-207 kernel: [28492.581593] ? lockup_detector_update_enable+0x60/0x60 Aug 22 13:18:38 juju-e4d256-prod-github-runner-207 kernel: [28492.582663] ? __hrtimer_run_queues+0x107/0x230 Aug 22 13:18:38 juju-e4d256-prod-github-runner-207 kernel: [28492.583693] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 13:18:38 juju-e4d256-prod-github-runner-207 kernel: [28492.584722] ? hrtimer_interrupt+0x101/0x220 Aug 22 13:18:38 juju-e4d256-prod-github-runner-207 kernel: [28492.585773] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 13:18:38 juju-e4d256-prod-github-runner-207 kernel: [28492.586846] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 13:18:38 juju-e4d256-prod-github-runner-207 kernel: [28492.587898] Aug 22 13:18:38 juju-e4d256-prod-github-runner-207 kernel: [28492.589067] Aug 22 13:18:38 juju-e4d256-prod-github-runner-207 kernel: [28492.589915] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 13:18:38 juju-e4d256-prod-github-runner-207 kernel: [28492.590952] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:18:38 juju-e4d256-prod-github-runner-207 kernel: [28492.591996] ? _raw_spin_lock+0x22/0x30 Aug 22 13:18:38 juju-e4d256-prod-github-runner-207 kernel: [28492.592983] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:18:38 juju-e4d256-prod-github-runner-207 kernel: [28492.594013] direct_page_fault+0x206/0x310 [kvm] Aug 22 13:18:38 juju-e4d256-prod-github-runner-207 kernel: [28492.595041] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 13:18:38 juju-e4d256-prod-github-runner-207 kernel: [28492.596050] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 13:18:38 juju-e4d256-prod-github-runner-207 kernel: [28492.600112] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 13:18:38 juju-e4d256-prod-github-runner-207 kernel: [28492.601830] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 13:18:38 juju-e4d256-prod-github-runner-207 kernel: [28492.603136] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 13:18:38 juju-e4d256-prod-github-runner-207 kernel: [28492.604544] handle_exit+0x98/0x230 [kvm_amd] Aug 22 13:18:38 juju-e4d256-prod-github-runner-207 kernel: [28492.605832] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 13:18:38 juju-e4d256-prod-github-runner-207 kernel: [28492.607084] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 13:18:38 juju-e4d256-prod-github-runner-207 kernel: [28492.608268] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 13:18:38 juju-e4d256-prod-github-runner-207 kernel: [28492.609495] vcpu_run+0x62/0x2c0 [kvm] Aug 22 13:18:38 juju-e4d256-prod-github-runner-207 kernel: [28492.610492] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 13:18:38 juju-e4d256-prod-github-runner-207 kernel: [28492.611506] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 13:18:38 juju-e4d256-prod-github-runner-207 kernel: [28492.612860] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 13:18:38 juju-e4d256-prod-github-runner-207 kernel: [28492.613882] ? __seccomp_filter+0x4a/0x4a0 Aug 22 13:18:38 juju-e4d256-prod-github-runner-207 kernel: [28492.614948] ? __fget_files+0x86/0xc0 Aug 22 13:18:38 juju-e4d256-prod-github-runner-207 kernel: [28492.615910] __x64_sys_ioctl+0x95/0xd0 Aug 22 13:18:38 juju-e4d256-prod-github-runner-207 kernel: [28492.616835] do_syscall_64+0x5c/0xc0 Aug 22 13:18:38 juju-e4d256-prod-github-runner-207 kernel: [28492.617788] ? do_futex+0x162/0x1f0 Aug 22 13:18:38 juju-e4d256-prod-github-runner-207 kernel: [28492.618735] ? __x64_sys_futex+0x78/0x1e0 Aug 22 13:18:38 juju-e4d256-prod-github-runner-207 kernel: [28492.619569] ? __secure_computing+0xa9/0x120 Aug 22 13:18:38 juju-e4d256-prod-github-runner-207 kernel: [28492.620491] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 13:18:38 juju-e4d256-prod-github-runner-207 kernel: [28492.621589] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:18:38 juju-e4d256-prod-github-runner-207 kernel: [28492.622542] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:18:38 juju-e4d256-prod-github-runner-207 kernel: [28492.623496] ? do_syscall_64+0x69/0xc0 Aug 22 13:18:38 juju-e4d256-prod-github-runner-207 kernel: [28492.624338] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:18:38 juju-e4d256-prod-github-runner-207 kernel: [28492.625303] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:18:38 juju-e4d256-prod-github-runner-207 kernel: [28492.626305] ? do_syscall_64+0x69/0xc0 Aug 22 13:18:38 juju-e4d256-prod-github-runner-207 kernel: [28492.627134] ? do_syscall_64+0x69/0xc0 Aug 22 13:18:38 juju-e4d256-prod-github-runner-207 kernel: [28492.628036] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 13:18:38 juju-e4d256-prod-github-runner-207 kernel: [28492.629057] RIP: 0033:0x7faa5d0edaff Aug 22 13:18:38 juju-e4d256-prod-github-runner-207 kernel: [28492.629986] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 13:18:38 juju-e4d256-prod-github-runner-207 kernel: [28492.632755] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 13:18:38 juju-e4d256-prod-github-runner-207 kernel: [28492.634138] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 13:18:38 juju-e4d256-prod-github-runner-207 kernel: [28492.635341] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 13:18:38 juju-e4d256-prod-github-runner-207 kernel: [28492.636513] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 13:18:38 juju-e4d256-prod-github-runner-207 kernel: [28492.637525] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 13:18:38 juju-e4d256-prod-github-runner-207 kernel: [28492.638443] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 13:18:38 juju-e4d256-prod-github-runner-207 kernel: [28492.639359] Aug 22 13:19:06 juju-e4d256-prod-github-runner-207 kernel: [28520.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 26453s! [qemu-system-x86:6715] Aug 22 13:19:06 juju-e4d256-prod-github-runner-207 kernel: [28520.543925] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 13:19:06 juju-e4d256-prod-github-runner-207 kernel: [28520.544258] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 13:19:06 juju-e4d256-prod-github-runner-207 kernel: [28520.556562] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 13:19:06 juju-e4d256-prod-github-runner-207 kernel: [28520.557859] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 13:19:06 juju-e4d256-prod-github-runner-207 kernel: [28520.559129] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:19:06 juju-e4d256-prod-github-runner-207 kernel: [28520.560298] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 13:19:06 juju-e4d256-prod-github-runner-207 kernel: [28520.562865] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 13:19:06 juju-e4d256-prod-github-runner-207 kernel: [28520.564057] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 13:19:06 juju-e4d256-prod-github-runner-207 kernel: [28520.565247] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 13:19:06 juju-e4d256-prod-github-runner-207 kernel: [28520.566415] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 13:19:06 juju-e4d256-prod-github-runner-207 kernel: [28520.567606] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 13:19:06 juju-e4d256-prod-github-runner-207 kernel: [28520.568839] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 13:19:06 juju-e4d256-prod-github-runner-207 kernel: [28520.570034] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 13:19:06 juju-e4d256-prod-github-runner-207 kernel: [28520.571272] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 13:19:06 juju-e4d256-prod-github-runner-207 kernel: [28520.572383] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 13:19:06 juju-e4d256-prod-github-runner-207 kernel: [28520.573604] Call Trace: Aug 22 13:19:06 juju-e4d256-prod-github-runner-207 kernel: [28520.574536] Aug 22 13:19:06 juju-e4d256-prod-github-runner-207 kernel: [28520.575453] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:19:06 juju-e4d256-prod-github-runner-207 kernel: [28520.576512] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:19:06 juju-e4d256-prod-github-runner-207 kernel: [28520.577556] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:19:06 juju-e4d256-prod-github-runner-207 kernel: [28520.578658] ? show_regs.part.0+0x23/0x29 Aug 22 13:19:06 juju-e4d256-prod-github-runner-207 kernel: [28520.579673] ? show_regs.cold+0x8/0xd Aug 22 13:19:06 juju-e4d256-prod-github-runner-207 kernel: [28520.580682] ? watchdog_timer_fn+0x1be/0x220 Aug 22 13:19:06 juju-e4d256-prod-github-runner-207 kernel: [28520.581718] ? lockup_detector_update_enable+0x60/0x60 Aug 22 13:19:06 juju-e4d256-prod-github-runner-207 kernel: [28520.582805] ? __hrtimer_run_queues+0x107/0x230 Aug 22 13:19:06 juju-e4d256-prod-github-runner-207 kernel: [28520.583858] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 13:19:06 juju-e4d256-prod-github-runner-207 kernel: [28520.584920] ? hrtimer_interrupt+0x101/0x220 Aug 22 13:19:06 juju-e4d256-prod-github-runner-207 kernel: [28520.585956] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 13:19:06 juju-e4d256-prod-github-runner-207 kernel: [28520.587029] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 13:19:06 juju-e4d256-prod-github-runner-207 kernel: [28520.588095] Aug 22 13:19:06 juju-e4d256-prod-github-runner-207 kernel: [28520.588975] Aug 22 13:19:06 juju-e4d256-prod-github-runner-207 kernel: [28520.589839] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 13:19:06 juju-e4d256-prod-github-runner-207 kernel: [28520.590896] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:19:06 juju-e4d256-prod-github-runner-207 kernel: [28520.591940] ? _raw_spin_lock+0x22/0x30 Aug 22 13:19:06 juju-e4d256-prod-github-runner-207 kernel: [28520.592905] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:19:06 juju-e4d256-prod-github-runner-207 kernel: [28520.593954] direct_page_fault+0x206/0x310 [kvm] Aug 22 13:19:06 juju-e4d256-prod-github-runner-207 kernel: [28520.594979] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 13:19:06 juju-e4d256-prod-github-runner-207 kernel: [28520.596003] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 13:19:06 juju-e4d256-prod-github-runner-207 kernel: [28520.597019] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 13:19:06 juju-e4d256-prod-github-runner-207 kernel: [28520.598024] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 13:19:06 juju-e4d256-prod-github-runner-207 kernel: [28520.598970] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 13:19:06 juju-e4d256-prod-github-runner-207 kernel: [28520.599955] handle_exit+0x98/0x230 [kvm_amd] Aug 22 13:19:06 juju-e4d256-prod-github-runner-207 kernel: [28520.600856] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 13:19:06 juju-e4d256-prod-github-runner-207 kernel: [28520.601771] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 13:19:06 juju-e4d256-prod-github-runner-207 kernel: [28520.602700] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 13:19:06 juju-e4d256-prod-github-runner-207 kernel: [28520.603602] vcpu_run+0x62/0x2c0 [kvm] Aug 22 13:19:06 juju-e4d256-prod-github-runner-207 kernel: [28520.604421] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 13:19:06 juju-e4d256-prod-github-runner-207 kernel: [28520.605248] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 13:19:06 juju-e4d256-prod-github-runner-207 kernel: [28520.606102] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 13:19:06 juju-e4d256-prod-github-runner-207 kernel: [28520.606905] ? __seccomp_filter+0x4a/0x4a0 Aug 22 13:19:06 juju-e4d256-prod-github-runner-207 kernel: [28520.607675] ? __fget_files+0x86/0xc0 Aug 22 13:19:06 juju-e4d256-prod-github-runner-207 kernel: [28520.608395] __x64_sys_ioctl+0x95/0xd0 Aug 22 13:19:06 juju-e4d256-prod-github-runner-207 kernel: [28520.609157] do_syscall_64+0x5c/0xc0 Aug 22 13:19:06 juju-e4d256-prod-github-runner-207 kernel: [28520.609860] ? do_futex+0x162/0x1f0 Aug 22 13:19:06 juju-e4d256-prod-github-runner-207 kernel: [28520.610514] ? __x64_sys_futex+0x78/0x1e0 Aug 22 13:19:06 juju-e4d256-prod-github-runner-207 kernel: [28520.611202] ? __secure_computing+0xa9/0x120 Aug 22 13:19:06 juju-e4d256-prod-github-runner-207 kernel: [28520.611918] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 13:19:06 juju-e4d256-prod-github-runner-207 kernel: [28520.612726] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:19:06 juju-e4d256-prod-github-runner-207 kernel: [28520.613474] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:19:06 juju-e4d256-prod-github-runner-207 kernel: [28520.614229] ? do_syscall_64+0x69/0xc0 Aug 22 13:19:06 juju-e4d256-prod-github-runner-207 kernel: [28520.614913] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:19:06 juju-e4d256-prod-github-runner-207 kernel: [28520.615866] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:19:06 juju-e4d256-prod-github-runner-207 kernel: [28520.616582] ? do_syscall_64+0x69/0xc0 Aug 22 13:19:06 juju-e4d256-prod-github-runner-207 kernel: [28520.617212] ? do_syscall_64+0x69/0xc0 Aug 22 13:19:06 juju-e4d256-prod-github-runner-207 kernel: [28520.617836] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 13:19:06 juju-e4d256-prod-github-runner-207 kernel: [28520.618551] RIP: 0033:0x7faa5d0edaff Aug 22 13:19:06 juju-e4d256-prod-github-runner-207 kernel: [28520.619224] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 13:19:06 juju-e4d256-prod-github-runner-207 kernel: [28520.621274] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 13:19:06 juju-e4d256-prod-github-runner-207 kernel: [28520.622232] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 13:19:06 juju-e4d256-prod-github-runner-207 kernel: [28520.623137] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 13:19:06 juju-e4d256-prod-github-runner-207 kernel: [28520.624034] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 13:19:06 juju-e4d256-prod-github-runner-207 kernel: [28520.626899] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 13:19:06 juju-e4d256-prod-github-runner-207 kernel: [28520.627970] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 13:19:06 juju-e4d256-prod-github-runner-207 kernel: [28520.629051] Aug 22 13:19:34 juju-e4d256-prod-github-runner-207 kernel: [28548.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 26479s! [qemu-system-x86:6715] Aug 22 13:19:34 juju-e4d256-prod-github-runner-207 kernel: [28548.548439] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 13:19:34 juju-e4d256-prod-github-runner-207 kernel: [28548.548796] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 13:19:34 juju-e4d256-prod-github-runner-207 kernel: [28548.575033] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 13:19:34 juju-e4d256-prod-github-runner-207 kernel: [28548.576351] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 13:19:34 juju-e4d256-prod-github-runner-207 kernel: [28548.579834] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:19:34 juju-e4d256-prod-github-runner-207 kernel: [28548.583239] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 13:19:34 juju-e4d256-prod-github-runner-207 kernel: [28548.588214] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 13:19:34 juju-e4d256-prod-github-runner-207 kernel: [28548.589385] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 13:19:34 juju-e4d256-prod-github-runner-207 kernel: [28548.592860] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 13:19:34 juju-e4d256-prod-github-runner-207 kernel: [28548.594036] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 13:19:34 juju-e4d256-prod-github-runner-207 kernel: [28548.597493] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 13:19:34 juju-e4d256-prod-github-runner-207 kernel: [28548.602386] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 13:19:34 juju-e4d256-prod-github-runner-207 kernel: [28548.606175] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 13:19:34 juju-e4d256-prod-github-runner-207 kernel: [28548.609653] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 13:19:34 juju-e4d256-prod-github-runner-207 kernel: [28548.611864] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 13:19:34 juju-e4d256-prod-github-runner-207 kernel: [28548.614216] Call Trace: Aug 22 13:19:34 juju-e4d256-prod-github-runner-207 kernel: [28548.617472] Aug 22 13:19:34 juju-e4d256-prod-github-runner-207 kernel: [28548.618405] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:19:34 juju-e4d256-prod-github-runner-207 kernel: [28548.621639] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:19:34 juju-e4d256-prod-github-runner-207 kernel: [28548.622679] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:19:34 juju-e4d256-prod-github-runner-207 kernel: [28548.625911] ? show_regs.part.0+0x23/0x29 Aug 22 13:19:34 juju-e4d256-prod-github-runner-207 kernel: [28548.629278] ? show_regs.cold+0x8/0xd Aug 22 13:19:34 juju-e4d256-prod-github-runner-207 kernel: [28548.630271] ? watchdog_timer_fn+0x1be/0x220 Aug 22 13:19:34 juju-e4d256-prod-github-runner-207 kernel: [28548.633705] ? lockup_detector_update_enable+0x60/0x60 Aug 22 13:19:34 juju-e4d256-prod-github-runner-207 kernel: [28548.634782] ? __hrtimer_run_queues+0x107/0x230 Aug 22 13:19:34 juju-e4d256-prod-github-runner-207 kernel: [28548.635826] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 13:19:34 juju-e4d256-prod-github-runner-207 kernel: [28548.639062] ? hrtimer_interrupt+0x101/0x220 Aug 22 13:19:34 juju-e4d256-prod-github-runner-207 kernel: [28548.640090] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 13:19:34 juju-e4d256-prod-github-runner-207 kernel: [28548.643445] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 13:19:34 juju-e4d256-prod-github-runner-207 kernel: [28548.646713] Aug 22 13:19:34 juju-e4d256-prod-github-runner-207 kernel: [28548.647579] Aug 22 13:19:34 juju-e4d256-prod-github-runner-207 kernel: [28548.650601] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 13:19:34 juju-e4d256-prod-github-runner-207 kernel: [28548.651653] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:19:34 juju-e4d256-prod-github-runner-207 kernel: [28548.654903] ? _raw_spin_lock+0x22/0x30 Aug 22 13:19:34 juju-e4d256-prod-github-runner-207 kernel: [28548.658145] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:19:34 juju-e4d256-prod-github-runner-207 kernel: [28548.659181] direct_page_fault+0x206/0x310 [kvm] Aug 22 13:19:34 juju-e4d256-prod-github-runner-207 kernel: [28548.662406] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 13:19:34 juju-e4d256-prod-github-runner-207 kernel: [28548.664586] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 13:19:34 juju-e4d256-prod-github-runner-207 kernel: [28548.666735] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 13:19:34 juju-e4d256-prod-github-runner-207 kernel: [28548.667749] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 13:19:34 juju-e4d256-prod-github-runner-207 kernel: [28548.668759] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 13:19:34 juju-e4d256-prod-github-runner-207 kernel: [28548.669770] handle_exit+0x98/0x230 [kvm_amd] Aug 22 13:19:34 juju-e4d256-prod-github-runner-207 kernel: [28548.670671] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 13:19:34 juju-e4d256-prod-github-runner-207 kernel: [28548.671605] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 13:19:34 juju-e4d256-prod-github-runner-207 kernel: [28548.672555] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 13:19:34 juju-e4d256-prod-github-runner-207 kernel: [28548.673470] vcpu_run+0x62/0x2c0 [kvm] Aug 22 13:19:34 juju-e4d256-prod-github-runner-207 kernel: [28548.674285] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 13:19:34 juju-e4d256-prod-github-runner-207 kernel: [28548.675097] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 13:19:34 juju-e4d256-prod-github-runner-207 kernel: [28548.675960] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 13:19:34 juju-e4d256-prod-github-runner-207 kernel: [28548.676906] ? __seccomp_filter+0x4a/0x4a0 Aug 22 13:19:34 juju-e4d256-prod-github-runner-207 kernel: [28548.677658] ? __fget_files+0x86/0xc0 Aug 22 13:19:34 juju-e4d256-prod-github-runner-207 kernel: [28548.678393] __x64_sys_ioctl+0x95/0xd0 Aug 22 13:19:34 juju-e4d256-prod-github-runner-207 kernel: [28548.679114] do_syscall_64+0x5c/0xc0 Aug 22 13:19:34 juju-e4d256-prod-github-runner-207 kernel: [28548.679784] ? do_futex+0x162/0x1f0 Aug 22 13:19:34 juju-e4d256-prod-github-runner-207 kernel: [28548.680449] ? __x64_sys_futex+0x78/0x1e0 Aug 22 13:19:34 juju-e4d256-prod-github-runner-207 kernel: [28548.681129] ? __secure_computing+0xa9/0x120 Aug 22 13:19:34 juju-e4d256-prod-github-runner-207 kernel: [28548.681823] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 13:19:34 juju-e4d256-prod-github-runner-207 kernel: [28548.682587] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:19:34 juju-e4d256-prod-github-runner-207 kernel: [28548.683331] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:19:34 juju-e4d256-prod-github-runner-207 kernel: [28548.684074] ? do_syscall_64+0x69/0xc0 Aug 22 13:19:34 juju-e4d256-prod-github-runner-207 kernel: [28548.684737] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:19:34 juju-e4d256-prod-github-runner-207 kernel: [28548.685444] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:19:34 juju-e4d256-prod-github-runner-207 kernel: [28548.686157] ? do_syscall_64+0x69/0xc0 Aug 22 13:19:34 juju-e4d256-prod-github-runner-207 kernel: [28548.686802] ? do_syscall_64+0x69/0xc0 Aug 22 13:19:34 juju-e4d256-prod-github-runner-207 kernel: [28548.687428] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 13:19:34 juju-e4d256-prod-github-runner-207 kernel: [28548.688152] RIP: 0033:0x7faa5d0edaff Aug 22 13:19:34 juju-e4d256-prod-github-runner-207 kernel: [28548.688844] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 13:19:34 juju-e4d256-prod-github-runner-207 kernel: [28548.690906] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 13:19:34 juju-e4d256-prod-github-runner-207 kernel: [28548.691825] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 13:19:34 juju-e4d256-prod-github-runner-207 kernel: [28548.692737] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 13:19:34 juju-e4d256-prod-github-runner-207 kernel: [28548.693680] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 13:19:34 juju-e4d256-prod-github-runner-207 kernel: [28548.694582] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 13:19:34 juju-e4d256-prod-github-runner-207 kernel: [28548.695479] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 13:19:34 juju-e4d256-prod-github-runner-207 kernel: [28548.696435] Aug 22 13:20:02 juju-e4d256-prod-github-runner-207 kernel: [28576.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 26505s! [qemu-system-x86:6715] Aug 22 13:20:02 juju-e4d256-prod-github-runner-207 kernel: [28576.543873] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 13:20:02 juju-e4d256-prod-github-runner-207 kernel: [28576.544189] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 13:20:02 juju-e4d256-prod-github-runner-207 kernel: [28576.556555] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 13:20:02 juju-e4d256-prod-github-runner-207 kernel: [28576.558129] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 13:20:02 juju-e4d256-prod-github-runner-207 kernel: [28576.559425] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:20:02 juju-e4d256-prod-github-runner-207 kernel: [28576.560509] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 13:20:02 juju-e4d256-prod-github-runner-207 kernel: [28576.563090] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 13:20:02 juju-e4d256-prod-github-runner-207 kernel: [28576.564154] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 13:20:02 juju-e4d256-prod-github-runner-207 kernel: [28576.565316] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 13:20:02 juju-e4d256-prod-github-runner-207 kernel: [28576.566479] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 13:20:02 juju-e4d256-prod-github-runner-207 kernel: [28576.567638] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 13:20:02 juju-e4d256-prod-github-runner-207 kernel: [28576.568816] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 13:20:02 juju-e4d256-prod-github-runner-207 kernel: [28576.570043] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 13:20:02 juju-e4d256-prod-github-runner-207 kernel: [28576.571416] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 13:20:02 juju-e4d256-prod-github-runner-207 kernel: [28576.572740] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 13:20:02 juju-e4d256-prod-github-runner-207 kernel: [28576.574398] Call Trace: Aug 22 13:20:02 juju-e4d256-prod-github-runner-207 kernel: [28576.575556] Aug 22 13:20:02 juju-e4d256-prod-github-runner-207 kernel: [28576.576485] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:20:02 juju-e4d256-prod-github-runner-207 kernel: [28576.577568] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:20:02 juju-e4d256-prod-github-runner-207 kernel: [28576.578615] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:20:02 juju-e4d256-prod-github-runner-207 kernel: [28576.579728] ? show_regs.part.0+0x23/0x29 Aug 22 13:20:02 juju-e4d256-prod-github-runner-207 kernel: [28576.580768] ? show_regs.cold+0x8/0xd Aug 22 13:20:02 juju-e4d256-prod-github-runner-207 kernel: [28576.581746] ? watchdog_timer_fn+0x1be/0x220 Aug 22 13:20:02 juju-e4d256-prod-github-runner-207 kernel: [28576.582756] ? lockup_detector_update_enable+0x60/0x60 Aug 22 13:20:02 juju-e4d256-prod-github-runner-207 kernel: [28576.583834] ? __hrtimer_run_queues+0x107/0x230 Aug 22 13:20:02 juju-e4d256-prod-github-runner-207 kernel: [28576.584866] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 13:20:02 juju-e4d256-prod-github-runner-207 kernel: [28576.585893] ? hrtimer_interrupt+0x101/0x220 Aug 22 13:20:02 juju-e4d256-prod-github-runner-207 kernel: [28576.586926] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 13:20:02 juju-e4d256-prod-github-runner-207 kernel: [28576.588034] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 13:20:02 juju-e4d256-prod-github-runner-207 kernel: [28576.589119] Aug 22 13:20:02 juju-e4d256-prod-github-runner-207 kernel: [28576.590071] Aug 22 13:20:02 juju-e4d256-prod-github-runner-207 kernel: [28576.590947] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 13:20:02 juju-e4d256-prod-github-runner-207 kernel: [28576.592030] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:20:02 juju-e4d256-prod-github-runner-207 kernel: [28576.593083] ? _raw_spin_lock+0x22/0x30 Aug 22 13:20:02 juju-e4d256-prod-github-runner-207 kernel: [28576.594040] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:20:02 juju-e4d256-prod-github-runner-207 kernel: [28576.595064] direct_page_fault+0x206/0x310 [kvm] Aug 22 13:20:02 juju-e4d256-prod-github-runner-207 kernel: [28576.596121] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 13:20:02 juju-e4d256-prod-github-runner-207 kernel: [28576.597134] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 13:20:02 juju-e4d256-prod-github-runner-207 kernel: [28576.598140] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 13:20:02 juju-e4d256-prod-github-runner-207 kernel: [28576.599152] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 13:20:02 juju-e4d256-prod-github-runner-207 kernel: [28576.600112] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 13:20:02 juju-e4d256-prod-github-runner-207 kernel: [28576.601096] handle_exit+0x98/0x230 [kvm_amd] Aug 22 13:20:02 juju-e4d256-prod-github-runner-207 kernel: [28576.601994] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 13:20:02 juju-e4d256-prod-github-runner-207 kernel: [28576.602915] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 13:20:02 juju-e4d256-prod-github-runner-207 kernel: [28576.603996] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 13:20:02 juju-e4d256-prod-github-runner-207 kernel: [28576.605093] vcpu_run+0x62/0x2c0 [kvm] Aug 22 13:20:02 juju-e4d256-prod-github-runner-207 kernel: [28576.605985] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 13:20:02 juju-e4d256-prod-github-runner-207 kernel: [28576.606884] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 13:20:02 juju-e4d256-prod-github-runner-207 kernel: [28576.607883] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 13:20:02 juju-e4d256-prod-github-runner-207 kernel: [28576.608768] ? __seccomp_filter+0x4a/0x4a0 Aug 22 13:20:02 juju-e4d256-prod-github-runner-207 kernel: [28576.609597] ? __fget_files+0x86/0xc0 Aug 22 13:20:02 juju-e4d256-prod-github-runner-207 kernel: [28576.610382] __x64_sys_ioctl+0x95/0xd0 Aug 22 13:20:02 juju-e4d256-prod-github-runner-207 kernel: [28576.611217] do_syscall_64+0x5c/0xc0 Aug 22 13:20:02 juju-e4d256-prod-github-runner-207 kernel: [28576.611978] ? do_futex+0x162/0x1f0 Aug 22 13:20:02 juju-e4d256-prod-github-runner-207 kernel: [28576.612708] ? __x64_sys_futex+0x78/0x1e0 Aug 22 13:20:02 juju-e4d256-prod-github-runner-207 kernel: [28576.613470] ? __secure_computing+0xa9/0x120 Aug 22 13:20:02 juju-e4d256-prod-github-runner-207 kernel: [28576.614246] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 13:20:02 juju-e4d256-prod-github-runner-207 kernel: [28576.615117] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:20:02 juju-e4d256-prod-github-runner-207 kernel: [28576.615949] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:20:02 juju-e4d256-prod-github-runner-207 kernel: [28576.616766] ? do_syscall_64+0x69/0xc0 Aug 22 13:20:02 juju-e4d256-prod-github-runner-207 kernel: [28576.617502] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:20:02 juju-e4d256-prod-github-runner-207 kernel: [28576.618302] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:20:02 juju-e4d256-prod-github-runner-207 kernel: [28576.619094] ? do_syscall_64+0x69/0xc0 Aug 22 13:20:02 juju-e4d256-prod-github-runner-207 kernel: [28576.619817] ? do_syscall_64+0x69/0xc0 Aug 22 13:20:02 juju-e4d256-prod-github-runner-207 kernel: [28576.620755] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 13:20:02 juju-e4d256-prod-github-runner-207 kernel: [28576.621464] RIP: 0033:0x7faa5d0edaff Aug 22 13:20:02 juju-e4d256-prod-github-runner-207 kernel: [28576.622132] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 13:20:02 juju-e4d256-prod-github-runner-207 kernel: [28576.624147] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 13:20:02 juju-e4d256-prod-github-runner-207 kernel: [28576.625062] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 13:20:02 juju-e4d256-prod-github-runner-207 kernel: [28576.625955] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 13:20:02 juju-e4d256-prod-github-runner-207 kernel: [28576.626848] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 13:20:02 juju-e4d256-prod-github-runner-207 kernel: [28576.627734] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 13:20:02 juju-e4d256-prod-github-runner-207 kernel: [28576.628643] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 13:20:02 juju-e4d256-prod-github-runner-207 kernel: [28576.629535] Aug 22 13:20:30 juju-e4d256-prod-github-runner-207 kernel: [28604.541976] watchdog: BUG: soft lockup - CPU#1 stuck for 26532s! [qemu-system-x86:6715] Aug 22 13:20:30 juju-e4d256-prod-github-runner-207 kernel: [28604.543833] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 13:20:30 juju-e4d256-prod-github-runner-207 kernel: [28604.544122] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 13:20:30 juju-e4d256-prod-github-runner-207 kernel: [28604.556285] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 13:20:30 juju-e4d256-prod-github-runner-207 kernel: [28604.557552] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 13:20:30 juju-e4d256-prod-github-runner-207 kernel: [28604.558774] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:20:30 juju-e4d256-prod-github-runner-207 kernel: [28604.559847] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 13:20:30 juju-e4d256-prod-github-runner-207 kernel: [28604.562409] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 13:20:30 juju-e4d256-prod-github-runner-207 kernel: [28604.563462] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 13:20:30 juju-e4d256-prod-github-runner-207 kernel: [28604.564634] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 13:20:30 juju-e4d256-prod-github-runner-207 kernel: [28604.565793] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 13:20:30 juju-e4d256-prod-github-runner-207 kernel: [28604.566953] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 13:20:30 juju-e4d256-prod-github-runner-207 kernel: [28604.568161] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 13:20:30 juju-e4d256-prod-github-runner-207 kernel: [28604.569332] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 13:20:30 juju-e4d256-prod-github-runner-207 kernel: [28604.570658] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 13:20:30 juju-e4d256-prod-github-runner-207 kernel: [28604.571784] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 13:20:30 juju-e4d256-prod-github-runner-207 kernel: [28604.572978] Call Trace: Aug 22 13:20:30 juju-e4d256-prod-github-runner-207 kernel: [28604.573888] Aug 22 13:20:30 juju-e4d256-prod-github-runner-207 kernel: [28604.574814] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:20:30 juju-e4d256-prod-github-runner-207 kernel: [28604.575921] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:20:30 juju-e4d256-prod-github-runner-207 kernel: [28604.576952] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:20:30 juju-e4d256-prod-github-runner-207 kernel: [28604.578053] ? show_regs.part.0+0x23/0x29 Aug 22 13:20:30 juju-e4d256-prod-github-runner-207 kernel: [28604.579050] ? show_regs.cold+0x8/0xd Aug 22 13:20:30 juju-e4d256-prod-github-runner-207 kernel: [28604.580038] ? watchdog_timer_fn+0x1be/0x220 Aug 22 13:20:30 juju-e4d256-prod-github-runner-207 kernel: [28604.581052] ? lockup_detector_update_enable+0x60/0x60 Aug 22 13:20:30 juju-e4d256-prod-github-runner-207 kernel: [28604.582115] ? __hrtimer_run_queues+0x107/0x230 Aug 22 13:20:30 juju-e4d256-prod-github-runner-207 kernel: [28604.583176] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 13:20:30 juju-e4d256-prod-github-runner-207 kernel: [28604.584224] ? hrtimer_interrupt+0x101/0x220 Aug 22 13:20:30 juju-e4d256-prod-github-runner-207 kernel: [28604.585242] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 13:20:30 juju-e4d256-prod-github-runner-207 kernel: [28604.586312] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 13:20:30 juju-e4d256-prod-github-runner-207 kernel: [28604.587358] Aug 22 13:20:30 juju-e4d256-prod-github-runner-207 kernel: [28604.588221] Aug 22 13:20:30 juju-e4d256-prod-github-runner-207 kernel: [28604.589058] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 13:20:30 juju-e4d256-prod-github-runner-207 kernel: [28604.590095] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:20:30 juju-e4d256-prod-github-runner-207 kernel: [28604.591143] ? _raw_spin_lock+0x22/0x30 Aug 22 13:20:30 juju-e4d256-prod-github-runner-207 kernel: [28604.592097] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:20:30 juju-e4d256-prod-github-runner-207 kernel: [28604.593113] direct_page_fault+0x206/0x310 [kvm] Aug 22 13:20:30 juju-e4d256-prod-github-runner-207 kernel: [28604.594143] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 13:20:30 juju-e4d256-prod-github-runner-207 kernel: [28604.595160] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 13:20:30 juju-e4d256-prod-github-runner-207 kernel: [28604.596321] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 13:20:30 juju-e4d256-prod-github-runner-207 kernel: [28604.597324] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 13:20:30 juju-e4d256-prod-github-runner-207 kernel: [28604.598268] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 13:20:30 juju-e4d256-prod-github-runner-207 kernel: [28604.599244] handle_exit+0x98/0x230 [kvm_amd] Aug 22 13:20:30 juju-e4d256-prod-github-runner-207 kernel: [28604.600146] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 13:20:30 juju-e4d256-prod-github-runner-207 kernel: [28604.601059] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 13:20:30 juju-e4d256-prod-github-runner-207 kernel: [28604.601987] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 13:20:30 juju-e4d256-prod-github-runner-207 kernel: [28604.602894] vcpu_run+0x62/0x2c0 [kvm] Aug 22 13:20:30 juju-e4d256-prod-github-runner-207 kernel: [28604.603714] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 13:20:30 juju-e4d256-prod-github-runner-207 kernel: [28604.604538] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 13:20:30 juju-e4d256-prod-github-runner-207 kernel: [28604.605512] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 13:20:30 juju-e4d256-prod-github-runner-207 kernel: [28604.606372] ? __seccomp_filter+0x4a/0x4a0 Aug 22 13:20:30 juju-e4d256-prod-github-runner-207 kernel: [28604.607152] ? __fget_files+0x86/0xc0 Aug 22 13:20:30 juju-e4d256-prod-github-runner-207 kernel: [28604.607890] __x64_sys_ioctl+0x95/0xd0 Aug 22 13:20:30 juju-e4d256-prod-github-runner-207 kernel: [28604.608614] do_syscall_64+0x5c/0xc0 Aug 22 13:20:30 juju-e4d256-prod-github-runner-207 kernel: [28604.609278] ? do_futex+0x162/0x1f0 Aug 22 13:20:30 juju-e4d256-prod-github-runner-207 kernel: [28604.609926] ? __x64_sys_futex+0x78/0x1e0 Aug 22 13:20:30 juju-e4d256-prod-github-runner-207 kernel: [28604.610606] ? __secure_computing+0xa9/0x120 Aug 22 13:20:30 juju-e4d256-prod-github-runner-207 kernel: [28604.611303] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 13:20:30 juju-e4d256-prod-github-runner-207 kernel: [28604.612084] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:20:30 juju-e4d256-prod-github-runner-207 kernel: [28604.612806] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:20:30 juju-e4d256-prod-github-runner-207 kernel: [28604.613525] ? do_syscall_64+0x69/0xc0 Aug 22 13:20:30 juju-e4d256-prod-github-runner-207 kernel: [28604.614168] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:20:30 juju-e4d256-prod-github-runner-207 kernel: [28604.614872] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:20:30 juju-e4d256-prod-github-runner-207 kernel: [28604.615631] ? do_syscall_64+0x69/0xc0 Aug 22 13:20:30 juju-e4d256-prod-github-runner-207 kernel: [28604.616257] ? do_syscall_64+0x69/0xc0 Aug 22 13:20:30 juju-e4d256-prod-github-runner-207 kernel: [28604.616886] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 13:20:30 juju-e4d256-prod-github-runner-207 kernel: [28604.617591] RIP: 0033:0x7faa5d0edaff Aug 22 13:20:30 juju-e4d256-prod-github-runner-207 kernel: [28604.618257] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 13:20:30 juju-e4d256-prod-github-runner-207 kernel: [28604.620299] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 13:20:30 juju-e4d256-prod-github-runner-207 kernel: [28604.621213] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 13:20:30 juju-e4d256-prod-github-runner-207 kernel: [28604.622111] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 13:20:30 juju-e4d256-prod-github-runner-207 kernel: [28604.622997] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 13:20:30 juju-e4d256-prod-github-runner-207 kernel: [28604.623901] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 13:20:30 juju-e4d256-prod-github-runner-207 kernel: [28604.624795] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 13:20:30 juju-e4d256-prod-github-runner-207 kernel: [28604.625704] Aug 22 13:20:45 juju-e4d256-prod-github-runner-207 kernel: [28619.096706] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 13:20:45 juju-e4d256-prod-github-runner-207 kernel: [28619.098425] rcu: 1-....: (7103228 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=3433495 Aug 22 13:20:45 juju-e4d256-prod-github-runner-207 kernel: [28619.099572] (t=7125474 jiffies g=23269 q=32429) Aug 22 13:20:45 juju-e4d256-prod-github-runner-207 kernel: [28619.100358] NMI backtrace for cpu 1 Aug 22 13:20:45 juju-e4d256-prod-github-runner-207 kernel: [28619.101073] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 13:20:45 juju-e4d256-prod-github-runner-207 kernel: [28619.102220] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 13:20:45 juju-e4d256-prod-github-runner-207 kernel: [28619.103672] Call Trace: Aug 22 13:20:45 juju-e4d256-prod-github-runner-207 kernel: [28619.104628] Aug 22 13:20:45 juju-e4d256-prod-github-runner-207 kernel: [28619.105508] show_stack+0x52/0x5c Aug 22 13:20:45 juju-e4d256-prod-github-runner-207 kernel: [28619.106309] dump_stack_lvl+0x4a/0x63 Aug 22 13:20:45 juju-e4d256-prod-github-runner-207 kernel: [28619.107053] dump_stack+0x10/0x16 Aug 22 13:20:45 juju-e4d256-prod-github-runner-207 kernel: [28619.107807] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 13:20:45 juju-e4d256-prod-github-runner-207 kernel: [28619.108853] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 13:20:45 juju-e4d256-prod-github-runner-207 kernel: [28619.109973] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 13:20:45 juju-e4d256-prod-github-runner-207 kernel: [28619.111119] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 13:20:45 juju-e4d256-prod-github-runner-207 kernel: [28619.112264] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 13:20:45 juju-e4d256-prod-github-runner-207 kernel: [28619.113349] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 13:20:45 juju-e4d256-prod-github-runner-207 kernel: [28619.114442] print_cpu_stall.cold+0x2f/0xe2 Aug 22 13:20:45 juju-e4d256-prod-github-runner-207 kernel: [28619.115496] ? timekeeping_update+0xf7/0x150 Aug 22 13:20:45 juju-e4d256-prod-github-runner-207 kernel: [28619.116577] check_cpu_stall+0x109/0x270 Aug 22 13:20:45 juju-e4d256-prod-github-runner-207 kernel: [28619.117578] rcu_sched_clock_irq+0x9a/0x250 Aug 22 13:20:45 juju-e4d256-prod-github-runner-207 kernel: [28619.118611] update_process_times+0x94/0xd0 Aug 22 13:20:45 juju-e4d256-prod-github-runner-207 kernel: [28619.119682] tick_sched_handle+0x29/0x70 Aug 22 13:20:45 juju-e4d256-prod-github-runner-207 kernel: [28619.120726] tick_sched_timer+0x8c/0xc0 Aug 22 13:20:45 juju-e4d256-prod-github-runner-207 kernel: [28619.121722] ? tick_nohz_handler+0xb0/0xb0 Aug 22 13:20:45 juju-e4d256-prod-github-runner-207 kernel: [28619.122740] __hrtimer_run_queues+0x107/0x230 Aug 22 13:20:45 juju-e4d256-prod-github-runner-207 kernel: [28619.123807] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 13:20:45 juju-e4d256-prod-github-runner-207 kernel: [28619.124861] hrtimer_interrupt+0x101/0x220 Aug 22 13:20:45 juju-e4d256-prod-github-runner-207 kernel: [28619.125904] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 13:20:45 juju-e4d256-prod-github-runner-207 kernel: [28619.127005] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 13:20:45 juju-e4d256-prod-github-runner-207 kernel: [28619.128113] Aug 22 13:20:45 juju-e4d256-prod-github-runner-207 kernel: [28619.129012] Aug 22 13:20:45 juju-e4d256-prod-github-runner-207 kernel: [28619.129907] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 13:20:45 juju-e4d256-prod-github-runner-207 kernel: [28619.131019] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:20:45 juju-e4d256-prod-github-runner-207 kernel: [28619.132226] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 13:20:45 juju-e4d256-prod-github-runner-207 kernel: [28619.135182] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 13:20:45 juju-e4d256-prod-github-runner-207 kernel: [28619.136424] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 13:20:45 juju-e4d256-prod-github-runner-207 kernel: [28619.137767] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 13:20:45 juju-e4d256-prod-github-runner-207 kernel: [28619.139132] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 13:20:45 juju-e4d256-prod-github-runner-207 kernel: [28619.140529] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 13:20:45 juju-e4d256-prod-github-runner-207 kernel: [28619.141839] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 13:20:45 juju-e4d256-prod-github-runner-207 kernel: [28619.143145] ? _raw_spin_lock+0x22/0x30 Aug 22 13:20:45 juju-e4d256-prod-github-runner-207 kernel: [28619.144195] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:20:45 juju-e4d256-prod-github-runner-207 kernel: [28619.145396] direct_page_fault+0x206/0x310 [kvm] Aug 22 13:20:45 juju-e4d256-prod-github-runner-207 kernel: [28619.146620] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 13:20:45 juju-e4d256-prod-github-runner-207 kernel: [28619.147894] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 13:20:45 juju-e4d256-prod-github-runner-207 kernel: [28619.149078] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 13:20:45 juju-e4d256-prod-github-runner-207 kernel: [28619.150218] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 13:20:45 juju-e4d256-prod-github-runner-207 kernel: [28619.151269] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 13:20:45 juju-e4d256-prod-github-runner-207 kernel: [28619.152393] handle_exit+0x98/0x230 [kvm_amd] Aug 22 13:20:45 juju-e4d256-prod-github-runner-207 kernel: [28619.153437] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 13:20:45 juju-e4d256-prod-github-runner-207 kernel: [28619.154510] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 13:20:45 juju-e4d256-prod-github-runner-207 kernel: [28619.155620] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 13:20:45 juju-e4d256-prod-github-runner-207 kernel: [28619.156693] vcpu_run+0x62/0x2c0 [kvm] Aug 22 13:20:45 juju-e4d256-prod-github-runner-207 kernel: [28619.157688] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 13:20:45 juju-e4d256-prod-github-runner-207 kernel: [28619.158714] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 13:20:45 juju-e4d256-prod-github-runner-207 kernel: [28619.159898] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 13:20:45 juju-e4d256-prod-github-runner-207 kernel: [28619.160966] ? __seccomp_filter+0x4a/0x4a0 Aug 22 13:20:45 juju-e4d256-prod-github-runner-207 kernel: [28619.161951] ? __fget_files+0x86/0xc0 Aug 22 13:20:45 juju-e4d256-prod-github-runner-207 kernel: [28619.162883] __x64_sys_ioctl+0x95/0xd0 Aug 22 13:20:45 juju-e4d256-prod-github-runner-207 kernel: [28619.163864] do_syscall_64+0x5c/0xc0 Aug 22 13:20:45 juju-e4d256-prod-github-runner-207 kernel: [28619.164830] ? do_futex+0x162/0x1f0 Aug 22 13:20:45 juju-e4d256-prod-github-runner-207 kernel: [28619.165764] ? __x64_sys_futex+0x78/0x1e0 Aug 22 13:20:45 juju-e4d256-prod-github-runner-207 kernel: [28619.166723] ? __secure_computing+0xa9/0x120 Aug 22 13:20:45 juju-e4d256-prod-github-runner-207 kernel: [28619.167691] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 13:20:45 juju-e4d256-prod-github-runner-207 kernel: [28619.168870] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:20:45 juju-e4d256-prod-github-runner-207 kernel: [28619.169933] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:20:45 juju-e4d256-prod-github-runner-207 kernel: [28619.170998] ? do_syscall_64+0x69/0xc0 Aug 22 13:20:45 juju-e4d256-prod-github-runner-207 kernel: [28619.171798] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:20:45 juju-e4d256-prod-github-runner-207 kernel: [28619.172712] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:20:45 juju-e4d256-prod-github-runner-207 kernel: [28619.173539] ? do_syscall_64+0x69/0xc0 Aug 22 13:20:45 juju-e4d256-prod-github-runner-207 kernel: [28619.174277] ? do_syscall_64+0x69/0xc0 Aug 22 13:20:45 juju-e4d256-prod-github-runner-207 kernel: [28619.174997] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 13:20:45 juju-e4d256-prod-github-runner-207 kernel: [28619.175834] RIP: 0033:0x7faa5d0edaff Aug 22 13:20:45 juju-e4d256-prod-github-runner-207 kernel: [28619.176961] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 13:20:45 juju-e4d256-prod-github-runner-207 kernel: [28619.179195] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 13:20:45 juju-e4d256-prod-github-runner-207 kernel: [28619.180209] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 13:20:45 juju-e4d256-prod-github-runner-207 kernel: [28619.181203] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 13:20:45 juju-e4d256-prod-github-runner-207 kernel: [28619.182222] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 13:20:45 juju-e4d256-prod-github-runner-207 kernel: [28619.183218] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 13:20:45 juju-e4d256-prod-github-runner-207 kernel: [28619.184270] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 13:20:45 juju-e4d256-prod-github-runner-207 kernel: [28619.185248] Aug 22 13:21:10 juju-e4d256-prod-github-runner-207 kernel: [28644.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 26569s! [qemu-system-x86:6715] Aug 22 13:21:10 juju-e4d256-prod-github-runner-207 kernel: [28644.543854] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 13:21:10 juju-e4d256-prod-github-runner-207 kernel: [28644.544123] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 13:21:10 juju-e4d256-prod-github-runner-207 kernel: [28644.558221] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 13:21:10 juju-e4d256-prod-github-runner-207 kernel: [28644.559629] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 13:21:10 juju-e4d256-prod-github-runner-207 kernel: [28644.560940] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:21:10 juju-e4d256-prod-github-runner-207 kernel: [28644.562078] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 13:21:10 juju-e4d256-prod-github-runner-207 kernel: [28644.564707] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 13:21:10 juju-e4d256-prod-github-runner-207 kernel: [28644.565763] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 13:21:10 juju-e4d256-prod-github-runner-207 kernel: [28644.566941] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 13:21:10 juju-e4d256-prod-github-runner-207 kernel: [28644.568185] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 13:21:10 juju-e4d256-prod-github-runner-207 kernel: [28644.569522] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 13:21:10 juju-e4d256-prod-github-runner-207 kernel: [28644.570825] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 13:21:10 juju-e4d256-prod-github-runner-207 kernel: [28644.572204] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 13:21:10 juju-e4d256-prod-github-runner-207 kernel: [28644.573602] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 13:21:10 juju-e4d256-prod-github-runner-207 kernel: [28644.574827] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 13:21:10 juju-e4d256-prod-github-runner-207 kernel: [28644.576224] Call Trace: Aug 22 13:21:10 juju-e4d256-prod-github-runner-207 kernel: [28644.577194] Aug 22 13:21:10 juju-e4d256-prod-github-runner-207 kernel: [28644.578159] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:21:10 juju-e4d256-prod-github-runner-207 kernel: [28644.579325] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:21:10 juju-e4d256-prod-github-runner-207 kernel: [28644.580452] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:21:10 juju-e4d256-prod-github-runner-207 kernel: [28644.581671] ? show_regs.part.0+0x23/0x29 Aug 22 13:21:10 juju-e4d256-prod-github-runner-207 kernel: [28644.582748] ? show_regs.cold+0x8/0xd Aug 22 13:21:10 juju-e4d256-prod-github-runner-207 kernel: [28644.583819] ? watchdog_timer_fn+0x1be/0x220 Aug 22 13:21:10 juju-e4d256-prod-github-runner-207 kernel: [28644.584924] ? lockup_detector_update_enable+0x60/0x60 Aug 22 13:21:10 juju-e4d256-prod-github-runner-207 kernel: [28644.586111] ? __hrtimer_run_queues+0x107/0x230 Aug 22 13:21:10 juju-e4d256-prod-github-runner-207 kernel: [28644.587287] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 13:21:10 juju-e4d256-prod-github-runner-207 kernel: [28644.588459] ? hrtimer_interrupt+0x101/0x220 Aug 22 13:21:10 juju-e4d256-prod-github-runner-207 kernel: [28644.589588] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 13:21:10 juju-e4d256-prod-github-runner-207 kernel: [28644.590772] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 13:21:10 juju-e4d256-prod-github-runner-207 kernel: [28644.591954] Aug 22 13:21:10 juju-e4d256-prod-github-runner-207 kernel: [28644.592854] Aug 22 13:21:10 juju-e4d256-prod-github-runner-207 kernel: [28644.593741] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 13:21:10 juju-e4d256-prod-github-runner-207 kernel: [28644.594882] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:21:10 juju-e4d256-prod-github-runner-207 kernel: [28644.596078] ? _raw_spin_lock+0x22/0x30 Aug 22 13:21:10 juju-e4d256-prod-github-runner-207 kernel: [28644.597102] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:21:10 juju-e4d256-prod-github-runner-207 kernel: [28644.598219] direct_page_fault+0x206/0x310 [kvm] Aug 22 13:21:10 juju-e4d256-prod-github-runner-207 kernel: [28644.599364] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 13:21:10 juju-e4d256-prod-github-runner-207 kernel: [28644.600661] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 13:21:10 juju-e4d256-prod-github-runner-207 kernel: [28644.602117] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 13:21:10 juju-e4d256-prod-github-runner-207 kernel: [28644.603457] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 13:21:10 juju-e4d256-prod-github-runner-207 kernel: [28644.604798] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 13:21:10 juju-e4d256-prod-github-runner-207 kernel: [28644.605783] handle_exit+0x98/0x230 [kvm_amd] Aug 22 13:21:10 juju-e4d256-prod-github-runner-207 kernel: [28644.606690] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 13:21:10 juju-e4d256-prod-github-runner-207 kernel: [28644.607652] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 13:21:10 juju-e4d256-prod-github-runner-207 kernel: [28644.608604] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 13:21:10 juju-e4d256-prod-github-runner-207 kernel: [28644.609560] vcpu_run+0x62/0x2c0 [kvm] Aug 22 13:21:10 juju-e4d256-prod-github-runner-207 kernel: [28644.610396] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 13:21:10 juju-e4d256-prod-github-runner-207 kernel: [28644.611273] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 13:21:10 juju-e4d256-prod-github-runner-207 kernel: [28644.612142] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 13:21:10 juju-e4d256-prod-github-runner-207 kernel: [28644.612945] ? __seccomp_filter+0x4a/0x4a0 Aug 22 13:21:10 juju-e4d256-prod-github-runner-207 kernel: [28644.613711] ? __fget_files+0x86/0xc0 Aug 22 13:21:10 juju-e4d256-prod-github-runner-207 kernel: [28644.614450] __x64_sys_ioctl+0x95/0xd0 Aug 22 13:21:10 juju-e4d256-prod-github-runner-207 kernel: [28644.615191] do_syscall_64+0x5c/0xc0 Aug 22 13:21:10 juju-e4d256-prod-github-runner-207 kernel: [28644.615890] ? do_futex+0x162/0x1f0 Aug 22 13:21:10 juju-e4d256-prod-github-runner-207 kernel: [28644.616562] ? __x64_sys_futex+0x78/0x1e0 Aug 22 13:21:10 juju-e4d256-prod-github-runner-207 kernel: [28644.617252] ? __secure_computing+0xa9/0x120 Aug 22 13:21:10 juju-e4d256-prod-github-runner-207 kernel: [28644.617951] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 13:21:10 juju-e4d256-prod-github-runner-207 kernel: [28644.618728] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:21:10 juju-e4d256-prod-github-runner-207 kernel: [28644.619506] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:21:10 juju-e4d256-prod-github-runner-207 kernel: [28644.620249] ? do_syscall_64+0x69/0xc0 Aug 22 13:21:10 juju-e4d256-prod-github-runner-207 kernel: [28644.620912] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:21:10 juju-e4d256-prod-github-runner-207 kernel: [28644.621616] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:21:10 juju-e4d256-prod-github-runner-207 kernel: [28644.622312] ? do_syscall_64+0x69/0xc0 Aug 22 13:21:10 juju-e4d256-prod-github-runner-207 kernel: [28644.623001] ? do_syscall_64+0x69/0xc0 Aug 22 13:21:10 juju-e4d256-prod-github-runner-207 kernel: [28644.623732] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 13:21:10 juju-e4d256-prod-github-runner-207 kernel: [28644.624523] RIP: 0033:0x7faa5d0edaff Aug 22 13:21:10 juju-e4d256-prod-github-runner-207 kernel: [28644.625332] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 13:21:10 juju-e4d256-prod-github-runner-207 kernel: [28644.627657] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 13:21:10 juju-e4d256-prod-github-runner-207 kernel: [28644.628609] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 13:21:10 juju-e4d256-prod-github-runner-207 kernel: [28644.629555] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 13:21:10 juju-e4d256-prod-github-runner-207 kernel: [28644.630514] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 13:21:10 juju-e4d256-prod-github-runner-207 kernel: [28644.631494] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 13:21:10 juju-e4d256-prod-github-runner-207 kernel: [28644.632605] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 13:21:10 juju-e4d256-prod-github-runner-207 kernel: [28644.633662] Aug 22 13:21:38 juju-e4d256-prod-github-runner-207 kernel: [28672.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 26595s! [qemu-system-x86:6715] Aug 22 13:21:38 juju-e4d256-prod-github-runner-207 kernel: [28672.543882] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 13:21:38 juju-e4d256-prod-github-runner-207 kernel: [28672.544188] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 13:21:38 juju-e4d256-prod-github-runner-207 kernel: [28672.556334] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 13:21:38 juju-e4d256-prod-github-runner-207 kernel: [28672.557598] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 13:21:38 juju-e4d256-prod-github-runner-207 kernel: [28672.558872] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:21:38 juju-e4d256-prod-github-runner-207 kernel: [28672.559966] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 13:21:38 juju-e4d256-prod-github-runner-207 kernel: [28672.562506] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 13:21:38 juju-e4d256-prod-github-runner-207 kernel: [28672.563561] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 13:21:38 juju-e4d256-prod-github-runner-207 kernel: [28672.564720] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 13:21:38 juju-e4d256-prod-github-runner-207 kernel: [28672.565878] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 13:21:38 juju-e4d256-prod-github-runner-207 kernel: [28672.567045] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 13:21:38 juju-e4d256-prod-github-runner-207 kernel: [28672.568211] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 13:21:38 juju-e4d256-prod-github-runner-207 kernel: [28672.569376] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 13:21:38 juju-e4d256-prod-github-runner-207 kernel: [28672.570613] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 13:21:38 juju-e4d256-prod-github-runner-207 kernel: [28672.571721] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 13:21:38 juju-e4d256-prod-github-runner-207 kernel: [28672.572913] Call Trace: Aug 22 13:21:38 juju-e4d256-prod-github-runner-207 kernel: [28672.573833] Aug 22 13:21:38 juju-e4d256-prod-github-runner-207 kernel: [28672.574790] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:21:38 juju-e4d256-prod-github-runner-207 kernel: [28672.575832] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:21:38 juju-e4d256-prod-github-runner-207 kernel: [28672.576881] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:21:38 juju-e4d256-prod-github-runner-207 kernel: [28672.577981] ? show_regs.part.0+0x23/0x29 Aug 22 13:21:38 juju-e4d256-prod-github-runner-207 kernel: [28672.578993] ? show_regs.cold+0x8/0xd Aug 22 13:21:38 juju-e4d256-prod-github-runner-207 kernel: [28672.579966] ? watchdog_timer_fn+0x1be/0x220 Aug 22 13:21:38 juju-e4d256-prod-github-runner-207 kernel: [28672.580980] ? lockup_detector_update_enable+0x60/0x60 Aug 22 13:21:38 juju-e4d256-prod-github-runner-207 kernel: [28672.582056] ? __hrtimer_run_queues+0x107/0x230 Aug 22 13:21:38 juju-e4d256-prod-github-runner-207 kernel: [28672.583093] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 13:21:38 juju-e4d256-prod-github-runner-207 kernel: [28672.584118] ? hrtimer_interrupt+0x101/0x220 Aug 22 13:21:38 juju-e4d256-prod-github-runner-207 kernel: [28672.585132] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 13:21:38 juju-e4d256-prod-github-runner-207 kernel: [28672.586213] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 13:21:38 juju-e4d256-prod-github-runner-207 kernel: [28672.587273] Aug 22 13:21:38 juju-e4d256-prod-github-runner-207 kernel: [28672.588148] Aug 22 13:21:38 juju-e4d256-prod-github-runner-207 kernel: [28672.588987] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 13:21:38 juju-e4d256-prod-github-runner-207 kernel: [28672.590022] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:21:38 juju-e4d256-prod-github-runner-207 kernel: [28672.591077] ? _raw_spin_lock+0x22/0x30 Aug 22 13:21:38 juju-e4d256-prod-github-runner-207 kernel: [28672.592021] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:21:38 juju-e4d256-prod-github-runner-207 kernel: [28672.593037] direct_page_fault+0x206/0x310 [kvm] Aug 22 13:21:38 juju-e4d256-prod-github-runner-207 kernel: [28672.594116] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 13:21:38 juju-e4d256-prod-github-runner-207 kernel: [28672.595403] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 13:21:38 juju-e4d256-prod-github-runner-207 kernel: [28672.596774] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 13:21:38 juju-e4d256-prod-github-runner-207 kernel: [28672.598003] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 13:21:38 juju-e4d256-prod-github-runner-207 kernel: [28672.599013] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 13:21:38 juju-e4d256-prod-github-runner-207 kernel: [28672.600007] handle_exit+0x98/0x230 [kvm_amd] Aug 22 13:21:38 juju-e4d256-prod-github-runner-207 kernel: [28672.600901] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 13:21:38 juju-e4d256-prod-github-runner-207 kernel: [28672.601817] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 13:21:38 juju-e4d256-prod-github-runner-207 kernel: [28672.602753] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 13:21:38 juju-e4d256-prod-github-runner-207 kernel: [28672.603657] vcpu_run+0x62/0x2c0 [kvm] Aug 22 13:21:38 juju-e4d256-prod-github-runner-207 kernel: [28672.604593] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 13:21:38 juju-e4d256-prod-github-runner-207 kernel: [28672.605408] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 13:21:38 juju-e4d256-prod-github-runner-207 kernel: [28672.606261] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 13:21:38 juju-e4d256-prod-github-runner-207 kernel: [28672.607067] ? __seccomp_filter+0x4a/0x4a0 Aug 22 13:21:38 juju-e4d256-prod-github-runner-207 kernel: [28672.607810] ? __fget_files+0x86/0xc0 Aug 22 13:21:38 juju-e4d256-prod-github-runner-207 kernel: [28672.608519] __x64_sys_ioctl+0x95/0xd0 Aug 22 13:21:38 juju-e4d256-prod-github-runner-207 kernel: [28672.609213] do_syscall_64+0x5c/0xc0 Aug 22 13:21:38 juju-e4d256-prod-github-runner-207 kernel: [28672.609877] ? do_futex+0x162/0x1f0 Aug 22 13:21:38 juju-e4d256-prod-github-runner-207 kernel: [28672.610525] ? __x64_sys_futex+0x78/0x1e0 Aug 22 13:21:38 juju-e4d256-prod-github-runner-207 kernel: [28672.611207] ? __secure_computing+0xa9/0x120 Aug 22 13:21:38 juju-e4d256-prod-github-runner-207 kernel: [28672.611897] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 13:21:38 juju-e4d256-prod-github-runner-207 kernel: [28672.612656] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:21:38 juju-e4d256-prod-github-runner-207 kernel: [28672.613378] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:21:38 juju-e4d256-prod-github-runner-207 kernel: [28672.614102] ? do_syscall_64+0x69/0xc0 Aug 22 13:21:38 juju-e4d256-prod-github-runner-207 kernel: [28672.614774] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:21:38 juju-e4d256-prod-github-runner-207 kernel: [28672.615524] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:21:38 juju-e4d256-prod-github-runner-207 kernel: [28672.616215] ? do_syscall_64+0x69/0xc0 Aug 22 13:21:38 juju-e4d256-prod-github-runner-207 kernel: [28672.616838] ? do_syscall_64+0x69/0xc0 Aug 22 13:21:38 juju-e4d256-prod-github-runner-207 kernel: [28672.617458] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 13:21:38 juju-e4d256-prod-github-runner-207 kernel: [28672.618160] RIP: 0033:0x7faa5d0edaff Aug 22 13:21:38 juju-e4d256-prod-github-runner-207 kernel: [28672.618826] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 13:21:38 juju-e4d256-prod-github-runner-207 kernel: [28672.620802] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 13:21:38 juju-e4d256-prod-github-runner-207 kernel: [28672.621713] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 13:21:38 juju-e4d256-prod-github-runner-207 kernel: [28672.622600] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 13:21:38 juju-e4d256-prod-github-runner-207 kernel: [28672.623522] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 13:21:38 juju-e4d256-prod-github-runner-207 kernel: [28672.624406] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 13:21:38 juju-e4d256-prod-github-runner-207 kernel: [28672.625291] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 13:21:38 juju-e4d256-prod-github-runner-207 kernel: [28672.626181] Aug 22 13:22:06 juju-e4d256-prod-github-runner-207 kernel: [28700.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 26621s! [qemu-system-x86:6715] Aug 22 13:22:06 juju-e4d256-prod-github-runner-207 kernel: [28700.543824] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 13:22:06 juju-e4d256-prod-github-runner-207 kernel: [28700.544111] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 13:22:06 juju-e4d256-prod-github-runner-207 kernel: [28700.556223] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 13:22:06 juju-e4d256-prod-github-runner-207 kernel: [28700.557490] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 13:22:06 juju-e4d256-prod-github-runner-207 kernel: [28700.558733] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:22:06 juju-e4d256-prod-github-runner-207 kernel: [28700.559793] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 13:22:06 juju-e4d256-prod-github-runner-207 kernel: [28700.562355] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 13:22:06 juju-e4d256-prod-github-runner-207 kernel: [28700.563397] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 13:22:06 juju-e4d256-prod-github-runner-207 kernel: [28700.564760] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 13:22:06 juju-e4d256-prod-github-runner-207 kernel: [28700.565918] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 13:22:06 juju-e4d256-prod-github-runner-207 kernel: [28700.567089] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 13:22:06 juju-e4d256-prod-github-runner-207 kernel: [28700.568248] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 13:22:06 juju-e4d256-prod-github-runner-207 kernel: [28700.569418] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 13:22:06 juju-e4d256-prod-github-runner-207 kernel: [28700.570664] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 13:22:06 juju-e4d256-prod-github-runner-207 kernel: [28700.571766] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 13:22:06 juju-e4d256-prod-github-runner-207 kernel: [28700.572961] Call Trace: Aug 22 13:22:06 juju-e4d256-prod-github-runner-207 kernel: [28700.573875] Aug 22 13:22:06 juju-e4d256-prod-github-runner-207 kernel: [28700.574798] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:22:06 juju-e4d256-prod-github-runner-207 kernel: [28700.575980] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:22:06 juju-e4d256-prod-github-runner-207 kernel: [28700.577164] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:22:06 juju-e4d256-prod-github-runner-207 kernel: [28700.578447] ? show_regs.part.0+0x23/0x29 Aug 22 13:22:06 juju-e4d256-prod-github-runner-207 kernel: [28700.579452] ? show_regs.cold+0x8/0xd Aug 22 13:22:06 juju-e4d256-prod-github-runner-207 kernel: [28700.580428] ? watchdog_timer_fn+0x1be/0x220 Aug 22 13:22:06 juju-e4d256-prod-github-runner-207 kernel: [28700.581439] ? lockup_detector_update_enable+0x60/0x60 Aug 22 13:22:06 juju-e4d256-prod-github-runner-207 kernel: [28700.582512] ? __hrtimer_run_queues+0x107/0x230 Aug 22 13:22:06 juju-e4d256-prod-github-runner-207 kernel: [28700.583539] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 13:22:06 juju-e4d256-prod-github-runner-207 kernel: [28700.584562] ? hrtimer_interrupt+0x101/0x220 Aug 22 13:22:06 juju-e4d256-prod-github-runner-207 kernel: [28700.585577] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 13:22:06 juju-e4d256-prod-github-runner-207 kernel: [28700.586661] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 13:22:06 juju-e4d256-prod-github-runner-207 kernel: [28700.587706] Aug 22 13:22:06 juju-e4d256-prod-github-runner-207 kernel: [28700.588559] Aug 22 13:22:06 juju-e4d256-prod-github-runner-207 kernel: [28700.589400] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 13:22:06 juju-e4d256-prod-github-runner-207 kernel: [28700.590463] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:22:06 juju-e4d256-prod-github-runner-207 kernel: [28700.591504] ? _raw_spin_lock+0x22/0x30 Aug 22 13:22:06 juju-e4d256-prod-github-runner-207 kernel: [28700.592450] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:22:06 juju-e4d256-prod-github-runner-207 kernel: [28700.593471] direct_page_fault+0x206/0x310 [kvm] Aug 22 13:22:06 juju-e4d256-prod-github-runner-207 kernel: [28700.594506] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 13:22:06 juju-e4d256-prod-github-runner-207 kernel: [28700.595515] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 13:22:06 juju-e4d256-prod-github-runner-207 kernel: [28700.596516] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 13:22:06 juju-e4d256-prod-github-runner-207 kernel: [28700.597527] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 13:22:06 juju-e4d256-prod-github-runner-207 kernel: [28700.598482] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 13:22:06 juju-e4d256-prod-github-runner-207 kernel: [28700.599458] handle_exit+0x98/0x230 [kvm_amd] Aug 22 13:22:06 juju-e4d256-prod-github-runner-207 kernel: [28700.600349] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 13:22:06 juju-e4d256-prod-github-runner-207 kernel: [28700.601262] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 13:22:06 juju-e4d256-prod-github-runner-207 kernel: [28700.602188] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 13:22:06 juju-e4d256-prod-github-runner-207 kernel: [28700.603101] vcpu_run+0x62/0x2c0 [kvm] Aug 22 13:22:06 juju-e4d256-prod-github-runner-207 kernel: [28700.603912] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 13:22:06 juju-e4d256-prod-github-runner-207 kernel: [28700.604719] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 13:22:06 juju-e4d256-prod-github-runner-207 kernel: [28700.605571] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 13:22:06 juju-e4d256-prod-github-runner-207 kernel: [28700.606380] ? __seccomp_filter+0x4a/0x4a0 Aug 22 13:22:06 juju-e4d256-prod-github-runner-207 kernel: [28700.607123] ? __fget_files+0x86/0xc0 Aug 22 13:22:06 juju-e4d256-prod-github-runner-207 kernel: [28700.607825] __x64_sys_ioctl+0x95/0xd0 Aug 22 13:22:06 juju-e4d256-prod-github-runner-207 kernel: [28700.608519] do_syscall_64+0x5c/0xc0 Aug 22 13:22:06 juju-e4d256-prod-github-runner-207 kernel: [28700.609185] ? do_futex+0x162/0x1f0 Aug 22 13:22:06 juju-e4d256-prod-github-runner-207 kernel: [28700.609833] ? __x64_sys_futex+0x78/0x1e0 Aug 22 13:22:06 juju-e4d256-prod-github-runner-207 kernel: [28700.610522] ? __secure_computing+0xa9/0x120 Aug 22 13:22:06 juju-e4d256-prod-github-runner-207 kernel: [28700.611213] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 13:22:06 juju-e4d256-prod-github-runner-207 kernel: [28700.611972] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:22:06 juju-e4d256-prod-github-runner-207 kernel: [28700.612700] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:22:06 juju-e4d256-prod-github-runner-207 kernel: [28700.613418] ? do_syscall_64+0x69/0xc0 Aug 22 13:22:06 juju-e4d256-prod-github-runner-207 kernel: [28700.614063] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:22:06 juju-e4d256-prod-github-runner-207 kernel: [28700.614789] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:22:06 juju-e4d256-prod-github-runner-207 kernel: [28700.615490] ? do_syscall_64+0x69/0xc0 Aug 22 13:22:06 juju-e4d256-prod-github-runner-207 kernel: [28700.616115] ? do_syscall_64+0x69/0xc0 Aug 22 13:22:06 juju-e4d256-prod-github-runner-207 kernel: [28700.616737] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 13:22:06 juju-e4d256-prod-github-runner-207 kernel: [28700.617442] RIP: 0033:0x7faa5d0edaff Aug 22 13:22:06 juju-e4d256-prod-github-runner-207 kernel: [28700.618094] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 13:22:06 juju-e4d256-prod-github-runner-207 kernel: [28700.620102] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 13:22:06 juju-e4d256-prod-github-runner-207 kernel: [28700.621017] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 13:22:06 juju-e4d256-prod-github-runner-207 kernel: [28700.621914] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 13:22:06 juju-e4d256-prod-github-runner-207 kernel: [28700.622839] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 13:22:06 juju-e4d256-prod-github-runner-207 kernel: [28700.623725] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 13:22:06 juju-e4d256-prod-github-runner-207 kernel: [28700.624611] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 13:22:06 juju-e4d256-prod-github-runner-207 kernel: [28700.625507] Aug 22 13:22:34 juju-e4d256-prod-github-runner-207 kernel: [28728.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 26647s! [qemu-system-x86:6715] Aug 22 13:22:34 juju-e4d256-prod-github-runner-207 kernel: [28728.543967] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 13:22:34 juju-e4d256-prod-github-runner-207 kernel: [28728.544283] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 13:22:34 juju-e4d256-prod-github-runner-207 kernel: [28728.557215] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 13:22:34 juju-e4d256-prod-github-runner-207 kernel: [28728.558582] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 13:22:34 juju-e4d256-prod-github-runner-207 kernel: [28728.559892] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:22:34 juju-e4d256-prod-github-runner-207 kernel: [28728.560990] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 13:22:34 juju-e4d256-prod-github-runner-207 kernel: [28728.563695] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 13:22:34 juju-e4d256-prod-github-runner-207 kernel: [28728.564781] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 13:22:34 juju-e4d256-prod-github-runner-207 kernel: [28728.566060] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 13:22:34 juju-e4d256-prod-github-runner-207 kernel: [28728.567280] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 13:22:34 juju-e4d256-prod-github-runner-207 kernel: [28728.568513] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 13:22:34 juju-e4d256-prod-github-runner-207 kernel: [28728.569700] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 13:22:34 juju-e4d256-prod-github-runner-207 kernel: [28728.570889] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 13:22:34 juju-e4d256-prod-github-runner-207 kernel: [28728.572122] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 13:22:34 juju-e4d256-prod-github-runner-207 kernel: [28728.573233] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 13:22:34 juju-e4d256-prod-github-runner-207 kernel: [28728.574462] Call Trace: Aug 22 13:22:34 juju-e4d256-prod-github-runner-207 kernel: [28728.575383] Aug 22 13:22:34 juju-e4d256-prod-github-runner-207 kernel: [28728.576296] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:22:34 juju-e4d256-prod-github-runner-207 kernel: [28728.577347] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:22:34 juju-e4d256-prod-github-runner-207 kernel: [28728.578413] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:22:34 juju-e4d256-prod-github-runner-207 kernel: [28728.579591] ? show_regs.part.0+0x23/0x29 Aug 22 13:22:34 juju-e4d256-prod-github-runner-207 kernel: [28728.580642] ? show_regs.cold+0x8/0xd Aug 22 13:22:34 juju-e4d256-prod-github-runner-207 kernel: [28728.581662] ? watchdog_timer_fn+0x1be/0x220 Aug 22 13:22:34 juju-e4d256-prod-github-runner-207 kernel: [28728.582729] ? lockup_detector_update_enable+0x60/0x60 Aug 22 13:22:34 juju-e4d256-prod-github-runner-207 kernel: [28728.583873] ? __hrtimer_run_queues+0x107/0x230 Aug 22 13:22:34 juju-e4d256-prod-github-runner-207 kernel: [28728.584998] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 13:22:34 juju-e4d256-prod-github-runner-207 kernel: [28728.586081] ? hrtimer_interrupt+0x101/0x220 Aug 22 13:22:34 juju-e4d256-prod-github-runner-207 kernel: [28728.587168] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 13:22:34 juju-e4d256-prod-github-runner-207 kernel: [28728.588308] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 13:22:34 juju-e4d256-prod-github-runner-207 kernel: [28728.589432] Aug 22 13:22:34 juju-e4d256-prod-github-runner-207 kernel: [28728.590354] Aug 22 13:22:34 juju-e4d256-prod-github-runner-207 kernel: [28728.591226] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 13:22:34 juju-e4d256-prod-github-runner-207 kernel: [28728.592324] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:22:34 juju-e4d256-prod-github-runner-207 kernel: [28728.593429] ? _raw_spin_lock+0x22/0x30 Aug 22 13:22:34 juju-e4d256-prod-github-runner-207 kernel: [28728.594473] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:22:34 juju-e4d256-prod-github-runner-207 kernel: [28728.595577] direct_page_fault+0x206/0x310 [kvm] Aug 22 13:22:34 juju-e4d256-prod-github-runner-207 kernel: [28728.596716] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 13:22:34 juju-e4d256-prod-github-runner-207 kernel: [28728.597819] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 13:22:34 juju-e4d256-prod-github-runner-207 kernel: [28728.598960] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 13:22:34 juju-e4d256-prod-github-runner-207 kernel: [28728.600075] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 13:22:34 juju-e4d256-prod-github-runner-207 kernel: [28728.601081] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 13:22:34 juju-e4d256-prod-github-runner-207 kernel: [28728.602158] handle_exit+0x98/0x230 [kvm_amd] Aug 22 13:22:34 juju-e4d256-prod-github-runner-207 kernel: [28728.603118] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 13:22:34 juju-e4d256-prod-github-runner-207 kernel: [28728.604099] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 13:22:34 juju-e4d256-prod-github-runner-207 kernel: [28728.605096] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 13:22:34 juju-e4d256-prod-github-runner-207 kernel: [28728.606051] vcpu_run+0x62/0x2c0 [kvm] Aug 22 13:22:34 juju-e4d256-prod-github-runner-207 kernel: [28728.606931] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 13:22:34 juju-e4d256-prod-github-runner-207 kernel: [28728.607750] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 13:22:34 juju-e4d256-prod-github-runner-207 kernel: [28728.608621] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 13:22:34 juju-e4d256-prod-github-runner-207 kernel: [28728.609448] ? __seccomp_filter+0x4a/0x4a0 Aug 22 13:22:34 juju-e4d256-prod-github-runner-207 kernel: [28728.610240] ? __fget_files+0x86/0xc0 Aug 22 13:22:34 juju-e4d256-prod-github-runner-207 kernel: [28728.610956] __x64_sys_ioctl+0x95/0xd0 Aug 22 13:22:34 juju-e4d256-prod-github-runner-207 kernel: [28728.611652] do_syscall_64+0x5c/0xc0 Aug 22 13:22:34 juju-e4d256-prod-github-runner-207 kernel: [28728.612352] ? do_futex+0x162/0x1f0 Aug 22 13:22:34 juju-e4d256-prod-github-runner-207 kernel: [28728.613012] ? __x64_sys_futex+0x78/0x1e0 Aug 22 13:22:34 juju-e4d256-prod-github-runner-207 kernel: [28728.613719] ? __secure_computing+0xa9/0x120 Aug 22 13:22:34 juju-e4d256-prod-github-runner-207 kernel: [28728.614445] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 13:22:34 juju-e4d256-prod-github-runner-207 kernel: [28728.615273] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:22:34 juju-e4d256-prod-github-runner-207 kernel: [28728.616055] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:22:34 juju-e4d256-prod-github-runner-207 kernel: [28728.616793] ? do_syscall_64+0x69/0xc0 Aug 22 13:22:34 juju-e4d256-prod-github-runner-207 kernel: [28728.617488] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:22:34 juju-e4d256-prod-github-runner-207 kernel: [28728.618254] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:22:34 juju-e4d256-prod-github-runner-207 kernel: [28728.618983] ? do_syscall_64+0x69/0xc0 Aug 22 13:22:34 juju-e4d256-prod-github-runner-207 kernel: [28728.619677] ? do_syscall_64+0x69/0xc0 Aug 22 13:22:34 juju-e4d256-prod-github-runner-207 kernel: [28728.620329] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 13:22:34 juju-e4d256-prod-github-runner-207 kernel: [28728.621104] RIP: 0033:0x7faa5d0edaff Aug 22 13:22:34 juju-e4d256-prod-github-runner-207 kernel: [28728.621812] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 13:22:34 juju-e4d256-prod-github-runner-207 kernel: [28728.623984] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 13:22:34 juju-e4d256-prod-github-runner-207 kernel: [28728.624992] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 13:22:34 juju-e4d256-prod-github-runner-207 kernel: [28728.625977] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 13:22:34 juju-e4d256-prod-github-runner-207 kernel: [28728.626950] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 13:22:34 juju-e4d256-prod-github-runner-207 kernel: [28728.627880] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 13:22:34 juju-e4d256-prod-github-runner-207 kernel: [28728.628839] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 13:22:34 juju-e4d256-prod-github-runner-207 kernel: [28728.629785] Aug 22 13:23:02 juju-e4d256-prod-github-runner-207 kernel: [28756.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 26673s! [qemu-system-x86:6715] Aug 22 13:23:02 juju-e4d256-prod-github-runner-207 kernel: [28756.543821] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 13:23:02 juju-e4d256-prod-github-runner-207 kernel: [28756.544117] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 13:23:02 juju-e4d256-prod-github-runner-207 kernel: [28756.556454] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 13:23:02 juju-e4d256-prod-github-runner-207 kernel: [28756.557796] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 13:23:02 juju-e4d256-prod-github-runner-207 kernel: [28756.559028] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:23:02 juju-e4d256-prod-github-runner-207 kernel: [28756.560079] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 13:23:02 juju-e4d256-prod-github-runner-207 kernel: [28756.562637] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 13:23:02 juju-e4d256-prod-github-runner-207 kernel: [28756.563676] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 13:23:02 juju-e4d256-prod-github-runner-207 kernel: [28756.564835] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 13:23:02 juju-e4d256-prod-github-runner-207 kernel: [28756.566007] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 13:23:02 juju-e4d256-prod-github-runner-207 kernel: [28756.567162] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 13:23:02 juju-e4d256-prod-github-runner-207 kernel: [28756.568317] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 13:23:02 juju-e4d256-prod-github-runner-207 kernel: [28756.569480] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 13:23:02 juju-e4d256-prod-github-runner-207 kernel: [28756.570730] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 13:23:02 juju-e4d256-prod-github-runner-207 kernel: [28756.571824] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 13:23:02 juju-e4d256-prod-github-runner-207 kernel: [28756.573013] Call Trace: Aug 22 13:23:02 juju-e4d256-prod-github-runner-207 kernel: [28756.573939] Aug 22 13:23:02 juju-e4d256-prod-github-runner-207 kernel: [28756.574930] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:23:02 juju-e4d256-prod-github-runner-207 kernel: [28756.576047] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:23:02 juju-e4d256-prod-github-runner-207 kernel: [28756.577073] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:23:02 juju-e4d256-prod-github-runner-207 kernel: [28756.578188] ? show_regs.part.0+0x23/0x29 Aug 22 13:23:02 juju-e4d256-prod-github-runner-207 kernel: [28756.579184] ? show_regs.cold+0x8/0xd Aug 22 13:23:02 juju-e4d256-prod-github-runner-207 kernel: [28756.580155] ? watchdog_timer_fn+0x1be/0x220 Aug 22 13:23:02 juju-e4d256-prod-github-runner-207 kernel: [28756.581160] ? lockup_detector_update_enable+0x60/0x60 Aug 22 13:23:02 juju-e4d256-prod-github-runner-207 kernel: [28756.582238] ? __hrtimer_run_queues+0x107/0x230 Aug 22 13:23:02 juju-e4d256-prod-github-runner-207 kernel: [28756.583313] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 13:23:02 juju-e4d256-prod-github-runner-207 kernel: [28756.584518] ? hrtimer_interrupt+0x101/0x220 Aug 22 13:23:02 juju-e4d256-prod-github-runner-207 kernel: [28756.585532] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 13:23:02 juju-e4d256-prod-github-runner-207 kernel: [28756.586644] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 13:23:02 juju-e4d256-prod-github-runner-207 kernel: [28756.587705] Aug 22 13:23:02 juju-e4d256-prod-github-runner-207 kernel: [28756.588563] Aug 22 13:23:02 juju-e4d256-prod-github-runner-207 kernel: [28756.589401] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 13:23:02 juju-e4d256-prod-github-runner-207 kernel: [28756.590451] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:23:02 juju-e4d256-prod-github-runner-207 kernel: [28756.591490] ? _raw_spin_lock+0x22/0x30 Aug 22 13:23:02 juju-e4d256-prod-github-runner-207 kernel: [28756.592435] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:23:02 juju-e4d256-prod-github-runner-207 kernel: [28756.593457] direct_page_fault+0x206/0x310 [kvm] Aug 22 13:23:02 juju-e4d256-prod-github-runner-207 kernel: [28756.594524] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 13:23:02 juju-e4d256-prod-github-runner-207 kernel: [28756.595542] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 13:23:02 juju-e4d256-prod-github-runner-207 kernel: [28756.596549] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 13:23:02 juju-e4d256-prod-github-runner-207 kernel: [28756.597563] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 13:23:02 juju-e4d256-prod-github-runner-207 kernel: [28756.598840] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 13:23:02 juju-e4d256-prod-github-runner-207 kernel: [28756.599849] handle_exit+0x98/0x230 [kvm_amd] Aug 22 13:23:02 juju-e4d256-prod-github-runner-207 kernel: [28756.600746] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 13:23:02 juju-e4d256-prod-github-runner-207 kernel: [28756.601691] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 13:23:02 juju-e4d256-prod-github-runner-207 kernel: [28756.602628] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 13:23:02 juju-e4d256-prod-github-runner-207 kernel: [28756.603534] vcpu_run+0x62/0x2c0 [kvm] Aug 22 13:23:02 juju-e4d256-prod-github-runner-207 kernel: [28756.604455] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 13:23:02 juju-e4d256-prod-github-runner-207 kernel: [28756.605274] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 13:23:02 juju-e4d256-prod-github-runner-207 kernel: [28756.606150] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 13:23:02 juju-e4d256-prod-github-runner-207 kernel: [28756.606949] ? __seccomp_filter+0x4a/0x4a0 Aug 22 13:23:02 juju-e4d256-prod-github-runner-207 kernel: [28756.607707] ? __fget_files+0x86/0xc0 Aug 22 13:23:02 juju-e4d256-prod-github-runner-207 kernel: [28756.608413] __x64_sys_ioctl+0x95/0xd0 Aug 22 13:23:02 juju-e4d256-prod-github-runner-207 kernel: [28756.609108] do_syscall_64+0x5c/0xc0 Aug 22 13:23:02 juju-e4d256-prod-github-runner-207 kernel: [28756.609795] ? do_futex+0x162/0x1f0 Aug 22 13:23:02 juju-e4d256-prod-github-runner-207 kernel: [28756.610445] ? __x64_sys_futex+0x78/0x1e0 Aug 22 13:23:02 juju-e4d256-prod-github-runner-207 kernel: [28756.611123] ? __secure_computing+0xa9/0x120 Aug 22 13:23:02 juju-e4d256-prod-github-runner-207 kernel: [28756.611814] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 13:23:02 juju-e4d256-prod-github-runner-207 kernel: [28756.612590] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:23:02 juju-e4d256-prod-github-runner-207 kernel: [28756.613329] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:23:02 juju-e4d256-prod-github-runner-207 kernel: [28756.614255] ? do_syscall_64+0x69/0xc0 Aug 22 13:23:02 juju-e4d256-prod-github-runner-207 kernel: [28756.614902] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:23:02 juju-e4d256-prod-github-runner-207 kernel: [28756.615636] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:23:02 juju-e4d256-prod-github-runner-207 kernel: [28756.616404] ? do_syscall_64+0x69/0xc0 Aug 22 13:23:02 juju-e4d256-prod-github-runner-207 kernel: [28756.617045] ? do_syscall_64+0x69/0xc0 Aug 22 13:23:02 juju-e4d256-prod-github-runner-207 kernel: [28756.617693] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 13:23:02 juju-e4d256-prod-github-runner-207 kernel: [28756.618436] RIP: 0033:0x7faa5d0edaff Aug 22 13:23:02 juju-e4d256-prod-github-runner-207 kernel: [28756.619118] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 13:23:02 juju-e4d256-prod-github-runner-207 kernel: [28756.621157] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 13:23:02 juju-e4d256-prod-github-runner-207 kernel: [28756.622115] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 13:23:02 juju-e4d256-prod-github-runner-207 kernel: [28756.623008] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 13:23:02 juju-e4d256-prod-github-runner-207 kernel: [28756.623903] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 13:23:02 juju-e4d256-prod-github-runner-207 kernel: [28756.624797] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 13:23:02 juju-e4d256-prod-github-runner-207 kernel: [28756.625710] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 13:23:02 juju-e4d256-prod-github-runner-207 kernel: [28756.626612] Aug 22 13:23:30 juju-e4d256-prod-github-runner-207 kernel: [28784.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 26699s! [qemu-system-x86:6715] Aug 22 13:23:30 juju-e4d256-prod-github-runner-207 kernel: [28784.543824] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 13:23:30 juju-e4d256-prod-github-runner-207 kernel: [28784.544132] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 13:23:30 juju-e4d256-prod-github-runner-207 kernel: [28784.556297] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 13:23:30 juju-e4d256-prod-github-runner-207 kernel: [28784.557581] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 13:23:30 juju-e4d256-prod-github-runner-207 kernel: [28784.558826] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:23:30 juju-e4d256-prod-github-runner-207 kernel: [28784.559890] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 13:23:30 juju-e4d256-prod-github-runner-207 kernel: [28784.562471] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 13:23:30 juju-e4d256-prod-github-runner-207 kernel: [28784.563521] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 13:23:30 juju-e4d256-prod-github-runner-207 kernel: [28784.564684] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 13:23:30 juju-e4d256-prod-github-runner-207 kernel: [28784.565898] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 13:23:30 juju-e4d256-prod-github-runner-207 kernel: [28784.567085] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 13:23:30 juju-e4d256-prod-github-runner-207 kernel: [28784.568251] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 13:23:30 juju-e4d256-prod-github-runner-207 kernel: [28784.569460] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 13:23:30 juju-e4d256-prod-github-runner-207 kernel: [28784.570707] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 13:23:30 juju-e4d256-prod-github-runner-207 kernel: [28784.571816] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 13:23:30 juju-e4d256-prod-github-runner-207 kernel: [28784.573025] Call Trace: Aug 22 13:23:30 juju-e4d256-prod-github-runner-207 kernel: [28784.573962] Aug 22 13:23:30 juju-e4d256-prod-github-runner-207 kernel: [28784.574900] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:23:30 juju-e4d256-prod-github-runner-207 kernel: [28784.575948] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:23:30 juju-e4d256-prod-github-runner-207 kernel: [28784.576999] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:23:30 juju-e4d256-prod-github-runner-207 kernel: [28784.578143] ? show_regs.part.0+0x23/0x29 Aug 22 13:23:30 juju-e4d256-prod-github-runner-207 kernel: [28784.579157] ? show_regs.cold+0x8/0xd Aug 22 13:23:30 juju-e4d256-prod-github-runner-207 kernel: [28784.580153] ? watchdog_timer_fn+0x1be/0x220 Aug 22 13:23:30 juju-e4d256-prod-github-runner-207 kernel: [28784.581208] ? lockup_detector_update_enable+0x60/0x60 Aug 22 13:23:30 juju-e4d256-prod-github-runner-207 kernel: [28784.582353] ? __hrtimer_run_queues+0x107/0x230 Aug 22 13:23:30 juju-e4d256-prod-github-runner-207 kernel: [28784.583400] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 13:23:30 juju-e4d256-prod-github-runner-207 kernel: [28784.584433] ? hrtimer_interrupt+0x101/0x220 Aug 22 13:23:30 juju-e4d256-prod-github-runner-207 kernel: [28784.585489] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 13:23:30 juju-e4d256-prod-github-runner-207 kernel: [28784.586574] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 13:23:30 juju-e4d256-prod-github-runner-207 kernel: [28784.587620] Aug 22 13:23:30 juju-e4d256-prod-github-runner-207 kernel: [28784.588479] Aug 22 13:23:30 juju-e4d256-prod-github-runner-207 kernel: [28784.589337] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 13:23:30 juju-e4d256-prod-github-runner-207 kernel: [28784.590406] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:23:30 juju-e4d256-prod-github-runner-207 kernel: [28784.591545] ? _raw_spin_lock+0x22/0x30 Aug 22 13:23:30 juju-e4d256-prod-github-runner-207 kernel: [28784.592695] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:23:30 juju-e4d256-prod-github-runner-207 kernel: [28784.593817] direct_page_fault+0x206/0x310 [kvm] Aug 22 13:23:30 juju-e4d256-prod-github-runner-207 kernel: [28784.594858] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 13:23:30 juju-e4d256-prod-github-runner-207 kernel: [28784.595914] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 13:23:30 juju-e4d256-prod-github-runner-207 kernel: [28784.596926] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 13:23:30 juju-e4d256-prod-github-runner-207 kernel: [28784.597999] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 13:23:30 juju-e4d256-prod-github-runner-207 kernel: [28784.598963] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 13:23:30 juju-e4d256-prod-github-runner-207 kernel: [28784.599952] handle_exit+0x98/0x230 [kvm_amd] Aug 22 13:23:30 juju-e4d256-prod-github-runner-207 kernel: [28784.600926] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 13:23:30 juju-e4d256-prod-github-runner-207 kernel: [28784.601895] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 13:23:30 juju-e4d256-prod-github-runner-207 kernel: [28784.602828] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 13:23:30 juju-e4d256-prod-github-runner-207 kernel: [28784.603740] vcpu_run+0x62/0x2c0 [kvm] Aug 22 13:23:30 juju-e4d256-prod-github-runner-207 kernel: [28784.604557] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 13:23:30 juju-e4d256-prod-github-runner-207 kernel: [28784.605630] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 13:23:30 juju-e4d256-prod-github-runner-207 kernel: [28784.606524] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 13:23:30 juju-e4d256-prod-github-runner-207 kernel: [28784.607352] ? __seccomp_filter+0x4a/0x4a0 Aug 22 13:23:30 juju-e4d256-prod-github-runner-207 kernel: [28784.608105] ? __fget_files+0x86/0xc0 Aug 22 13:23:30 juju-e4d256-prod-github-runner-207 kernel: [28784.608830] __x64_sys_ioctl+0x95/0xd0 Aug 22 13:23:30 juju-e4d256-prod-github-runner-207 kernel: [28784.609554] do_syscall_64+0x5c/0xc0 Aug 22 13:23:30 juju-e4d256-prod-github-runner-207 kernel: [28784.610228] ? do_futex+0x162/0x1f0 Aug 22 13:23:30 juju-e4d256-prod-github-runner-207 kernel: [28784.610892] ? __x64_sys_futex+0x78/0x1e0 Aug 22 13:23:30 juju-e4d256-prod-github-runner-207 kernel: [28784.611580] ? __secure_computing+0xa9/0x120 Aug 22 13:23:30 juju-e4d256-prod-github-runner-207 kernel: [28784.612281] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 13:23:30 juju-e4d256-prod-github-runner-207 kernel: [28784.613056] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:23:30 juju-e4d256-prod-github-runner-207 kernel: [28784.613819] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:23:30 juju-e4d256-prod-github-runner-207 kernel: [28784.614545] ? do_syscall_64+0x69/0xc0 Aug 22 13:23:30 juju-e4d256-prod-github-runner-207 kernel: [28784.615200] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:23:30 juju-e4d256-prod-github-runner-207 kernel: [28784.615909] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:23:30 juju-e4d256-prod-github-runner-207 kernel: [28784.616616] ? do_syscall_64+0x69/0xc0 Aug 22 13:23:30 juju-e4d256-prod-github-runner-207 kernel: [28784.617295] ? do_syscall_64+0x69/0xc0 Aug 22 13:23:30 juju-e4d256-prod-github-runner-207 kernel: [28784.617944] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 13:23:30 juju-e4d256-prod-github-runner-207 kernel: [28784.618658] RIP: 0033:0x7faa5d0edaff Aug 22 13:23:30 juju-e4d256-prod-github-runner-207 kernel: [28784.619328] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 13:23:30 juju-e4d256-prod-github-runner-207 kernel: [28784.621397] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 13:23:30 juju-e4d256-prod-github-runner-207 kernel: [28784.622326] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 13:23:30 juju-e4d256-prod-github-runner-207 kernel: [28784.623225] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 13:23:30 juju-e4d256-prod-github-runner-207 kernel: [28784.624130] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 13:23:30 juju-e4d256-prod-github-runner-207 kernel: [28784.625039] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 13:23:30 juju-e4d256-prod-github-runner-207 kernel: [28784.625960] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 13:23:30 juju-e4d256-prod-github-runner-207 kernel: [28784.626865] Aug 22 13:23:45 juju-e4d256-prod-github-runner-207 kernel: [28799.108708] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 13:23:45 juju-e4d256-prod-github-runner-207 kernel: [28799.109696] rcu: 1-....: (7148084 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=3454912 Aug 22 13:23:45 juju-e4d256-prod-github-runner-207 kernel: [28799.110845] (t=7170477 jiffies g=23269 q=32567) Aug 22 13:23:45 juju-e4d256-prod-github-runner-207 kernel: [28799.111639] NMI backtrace for cpu 1 Aug 22 13:23:45 juju-e4d256-prod-github-runner-207 kernel: [28799.112348] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 13:23:45 juju-e4d256-prod-github-runner-207 kernel: [28799.113472] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 13:23:45 juju-e4d256-prod-github-runner-207 kernel: [28799.114529] Call Trace: Aug 22 13:23:45 juju-e4d256-prod-github-runner-207 kernel: [28799.115205] Aug 22 13:23:45 juju-e4d256-prod-github-runner-207 kernel: [28799.115848] show_stack+0x52/0x5c Aug 22 13:23:45 juju-e4d256-prod-github-runner-207 kernel: [28799.116575] dump_stack_lvl+0x4a/0x63 Aug 22 13:23:45 juju-e4d256-prod-github-runner-207 kernel: [28799.117332] dump_stack+0x10/0x16 Aug 22 13:23:45 juju-e4d256-prod-github-runner-207 kernel: [28799.118048] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 13:23:45 juju-e4d256-prod-github-runner-207 kernel: [28799.118828] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 13:23:45 juju-e4d256-prod-github-runner-207 kernel: [28799.119605] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 13:23:45 juju-e4d256-prod-github-runner-207 kernel: [28799.120423] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 13:23:45 juju-e4d256-prod-github-runner-207 kernel: [28799.121265] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 13:23:45 juju-e4d256-prod-github-runner-207 kernel: [28799.122081] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 13:23:45 juju-e4d256-prod-github-runner-207 kernel: [28799.122853] print_cpu_stall.cold+0x2f/0xe2 Aug 22 13:23:45 juju-e4d256-prod-github-runner-207 kernel: [28799.123623] ? timekeeping_update+0xf7/0x150 Aug 22 13:23:45 juju-e4d256-prod-github-runner-207 kernel: [28799.124391] check_cpu_stall+0x109/0x270 Aug 22 13:23:45 juju-e4d256-prod-github-runner-207 kernel: [28799.125169] rcu_sched_clock_irq+0x9a/0x250 Aug 22 13:23:45 juju-e4d256-prod-github-runner-207 kernel: [28799.125931] update_process_times+0x94/0xd0 Aug 22 13:23:45 juju-e4d256-prod-github-runner-207 kernel: [28799.126690] tick_sched_handle+0x29/0x70 Aug 22 13:23:45 juju-e4d256-prod-github-runner-207 kernel: [28799.127437] tick_sched_timer+0x8c/0xc0 Aug 22 13:23:45 juju-e4d256-prod-github-runner-207 kernel: [28799.128174] ? tick_nohz_handler+0xb0/0xb0 Aug 22 13:23:45 juju-e4d256-prod-github-runner-207 kernel: [28799.128929] __hrtimer_run_queues+0x107/0x230 Aug 22 13:23:45 juju-e4d256-prod-github-runner-207 kernel: [28799.129730] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 13:23:45 juju-e4d256-prod-github-runner-207 kernel: [28799.130504] hrtimer_interrupt+0x101/0x220 Aug 22 13:23:45 juju-e4d256-prod-github-runner-207 kernel: [28799.131262] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 13:23:45 juju-e4d256-prod-github-runner-207 kernel: [28799.132077] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 13:23:45 juju-e4d256-prod-github-runner-207 kernel: [28799.132884] Aug 22 13:23:45 juju-e4d256-prod-github-runner-207 kernel: [28799.133531] Aug 22 13:23:45 juju-e4d256-prod-github-runner-207 kernel: [28799.134245] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 13:23:45 juju-e4d256-prod-github-runner-207 kernel: [28799.135167] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:23:45 juju-e4d256-prod-github-runner-207 kernel: [28799.136168] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 13:23:45 juju-e4d256-prod-github-runner-207 kernel: [28799.138722] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 13:23:45 juju-e4d256-prod-github-runner-207 kernel: [28799.139692] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 13:23:45 juju-e4d256-prod-github-runner-207 kernel: [28799.140830] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 13:23:45 juju-e4d256-prod-github-runner-207 kernel: [28799.141967] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 13:23:45 juju-e4d256-prod-github-runner-207 kernel: [28799.143068] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 13:23:45 juju-e4d256-prod-github-runner-207 kernel: [28799.144155] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 13:23:45 juju-e4d256-prod-github-runner-207 kernel: [28799.145302] ? _raw_spin_lock+0x22/0x30 Aug 22 13:23:45 juju-e4d256-prod-github-runner-207 kernel: [28799.146152] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:23:45 juju-e4d256-prod-github-runner-207 kernel: [28799.147083] direct_page_fault+0x206/0x310 [kvm] Aug 22 13:23:45 juju-e4d256-prod-github-runner-207 kernel: [28799.148011] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 13:23:45 juju-e4d256-prod-github-runner-207 kernel: [28799.148928] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 13:23:45 juju-e4d256-prod-github-runner-207 kernel: [28799.149854] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 13:23:45 juju-e4d256-prod-github-runner-207 kernel: [28799.150751] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 13:23:45 juju-e4d256-prod-github-runner-207 kernel: [28799.151632] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 13:23:45 juju-e4d256-prod-github-runner-207 kernel: [28799.152564] handle_exit+0x98/0x230 [kvm_amd] Aug 22 13:23:45 juju-e4d256-prod-github-runner-207 kernel: [28799.153422] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 13:23:45 juju-e4d256-prod-github-runner-207 kernel: [28799.154296] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 13:23:45 juju-e4d256-prod-github-runner-207 kernel: [28799.155191] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 13:23:45 juju-e4d256-prod-github-runner-207 kernel: [28799.156077] vcpu_run+0x62/0x2c0 [kvm] Aug 22 13:23:45 juju-e4d256-prod-github-runner-207 kernel: [28799.156866] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 13:23:45 juju-e4d256-prod-github-runner-207 kernel: [28799.157706] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 13:23:45 juju-e4d256-prod-github-runner-207 kernel: [28799.158606] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 13:23:45 juju-e4d256-prod-github-runner-207 kernel: [28799.159448] ? __seccomp_filter+0x4a/0x4a0 Aug 22 13:23:45 juju-e4d256-prod-github-runner-207 kernel: [28799.160249] ? __fget_files+0x86/0xc0 Aug 22 13:23:45 juju-e4d256-prod-github-runner-207 kernel: [28799.161017] __x64_sys_ioctl+0x95/0xd0 Aug 22 13:23:45 juju-e4d256-prod-github-runner-207 kernel: [28799.161811] do_syscall_64+0x5c/0xc0 Aug 22 13:23:45 juju-e4d256-prod-github-runner-207 kernel: [28799.162581] ? do_futex+0x162/0x1f0 Aug 22 13:23:45 juju-e4d256-prod-github-runner-207 kernel: [28799.163328] ? __x64_sys_futex+0x78/0x1e0 Aug 22 13:23:45 juju-e4d256-prod-github-runner-207 kernel: [28799.164119] ? __secure_computing+0xa9/0x120 Aug 22 13:23:45 juju-e4d256-prod-github-runner-207 kernel: [28799.164918] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 13:23:45 juju-e4d256-prod-github-runner-207 kernel: [28799.165825] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:23:45 juju-e4d256-prod-github-runner-207 kernel: [28799.166671] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:23:45 juju-e4d256-prod-github-runner-207 kernel: [28799.167528] ? do_syscall_64+0x69/0xc0 Aug 22 13:23:45 juju-e4d256-prod-github-runner-207 kernel: [28799.168292] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:23:45 juju-e4d256-prod-github-runner-207 kernel: [28799.169171] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:23:45 juju-e4d256-prod-github-runner-207 kernel: [28799.170025] ? do_syscall_64+0x69/0xc0 Aug 22 13:23:45 juju-e4d256-prod-github-runner-207 kernel: [28799.170796] ? do_syscall_64+0x69/0xc0 Aug 22 13:23:45 juju-e4d256-prod-github-runner-207 kernel: [28799.171558] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 13:23:45 juju-e4d256-prod-github-runner-207 kernel: [28799.172428] RIP: 0033:0x7faa5d0edaff Aug 22 13:23:45 juju-e4d256-prod-github-runner-207 kernel: [28799.173206] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 13:23:45 juju-e4d256-prod-github-runner-207 kernel: [28799.175661] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 13:23:45 juju-e4d256-prod-github-runner-207 kernel: [28799.176773] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 13:23:45 juju-e4d256-prod-github-runner-207 kernel: [28799.177878] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 13:23:45 juju-e4d256-prod-github-runner-207 kernel: [28799.178961] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 13:23:45 juju-e4d256-prod-github-runner-207 kernel: [28799.180037] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 13:23:45 juju-e4d256-prod-github-runner-207 kernel: [28799.181127] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 13:23:45 juju-e4d256-prod-github-runner-207 kernel: [28799.182194] Aug 22 13:24:10 juju-e4d256-prod-github-runner-207 kernel: [28824.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 26736s! [qemu-system-x86:6715] Aug 22 13:24:10 juju-e4d256-prod-github-runner-207 kernel: [28824.543203] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 13:24:10 juju-e4d256-prod-github-runner-207 kernel: [28824.543446] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 13:24:10 juju-e4d256-prod-github-runner-207 kernel: [28824.555559] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 13:24:10 juju-e4d256-prod-github-runner-207 kernel: [28824.556846] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 13:24:10 juju-e4d256-prod-github-runner-207 kernel: [28824.558073] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:24:10 juju-e4d256-prod-github-runner-207 kernel: [28824.559138] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 13:24:10 juju-e4d256-prod-github-runner-207 kernel: [28824.561706] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 13:24:10 juju-e4d256-prod-github-runner-207 kernel: [28824.562760] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 13:24:10 juju-e4d256-prod-github-runner-207 kernel: [28824.563919] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 13:24:10 juju-e4d256-prod-github-runner-207 kernel: [28824.565099] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 13:24:10 juju-e4d256-prod-github-runner-207 kernel: [28824.566258] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 13:24:10 juju-e4d256-prod-github-runner-207 kernel: [28824.567484] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 13:24:10 juju-e4d256-prod-github-runner-207 kernel: [28824.568652] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 13:24:10 juju-e4d256-prod-github-runner-207 kernel: [28824.570066] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 13:24:10 juju-e4d256-prod-github-runner-207 kernel: [28824.571330] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 13:24:10 juju-e4d256-prod-github-runner-207 kernel: [28824.572539] Call Trace: Aug 22 13:24:10 juju-e4d256-prod-github-runner-207 kernel: [28824.573470] Aug 22 13:24:10 juju-e4d256-prod-github-runner-207 kernel: [28824.574365] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:24:10 juju-e4d256-prod-github-runner-207 kernel: [28824.575405] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:24:10 juju-e4d256-prod-github-runner-207 kernel: [28824.576450] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:24:10 juju-e4d256-prod-github-runner-207 kernel: [28824.577578] ? show_regs.part.0+0x23/0x29 Aug 22 13:24:10 juju-e4d256-prod-github-runner-207 kernel: [28824.578610] ? show_regs.cold+0x8/0xd Aug 22 13:24:10 juju-e4d256-prod-github-runner-207 kernel: [28824.579619] ? watchdog_timer_fn+0x1be/0x220 Aug 22 13:24:10 juju-e4d256-prod-github-runner-207 kernel: [28824.580657] ? lockup_detector_update_enable+0x60/0x60 Aug 22 13:24:10 juju-e4d256-prod-github-runner-207 kernel: [28824.581795] ? __hrtimer_run_queues+0x107/0x230 Aug 22 13:24:10 juju-e4d256-prod-github-runner-207 kernel: [28824.582840] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 13:24:10 juju-e4d256-prod-github-runner-207 kernel: [28824.583885] ? hrtimer_interrupt+0x101/0x220 Aug 22 13:24:10 juju-e4d256-prod-github-runner-207 kernel: [28824.584945] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 13:24:10 juju-e4d256-prod-github-runner-207 kernel: [28824.586026] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 13:24:10 juju-e4d256-prod-github-runner-207 kernel: [28824.587092] Aug 22 13:24:10 juju-e4d256-prod-github-runner-207 kernel: [28824.587956] Aug 22 13:24:10 juju-e4d256-prod-github-runner-207 kernel: [28824.588840] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 13:24:10 juju-e4d256-prod-github-runner-207 kernel: [28824.589881] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:24:10 juju-e4d256-prod-github-runner-207 kernel: [28824.590930] ? _raw_spin_lock+0x22/0x30 Aug 22 13:24:10 juju-e4d256-prod-github-runner-207 kernel: [28824.591941] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:24:10 juju-e4d256-prod-github-runner-207 kernel: [28824.593023] direct_page_fault+0x206/0x310 [kvm] Aug 22 13:24:10 juju-e4d256-prod-github-runner-207 kernel: [28824.594069] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 13:24:10 juju-e4d256-prod-github-runner-207 kernel: [28824.595090] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 13:24:10 juju-e4d256-prod-github-runner-207 kernel: [28824.596110] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 13:24:10 juju-e4d256-prod-github-runner-207 kernel: [28824.597148] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 13:24:10 juju-e4d256-prod-github-runner-207 kernel: [28824.598173] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 13:24:10 juju-e4d256-prod-github-runner-207 kernel: [28824.599204] handle_exit+0x98/0x230 [kvm_amd] Aug 22 13:24:10 juju-e4d256-prod-github-runner-207 kernel: [28824.600147] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 13:24:10 juju-e4d256-prod-github-runner-207 kernel: [28824.601089] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 13:24:10 juju-e4d256-prod-github-runner-207 kernel: [28824.602019] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 13:24:10 juju-e4d256-prod-github-runner-207 kernel: [28824.602940] vcpu_run+0x62/0x2c0 [kvm] Aug 22 13:24:10 juju-e4d256-prod-github-runner-207 kernel: [28824.603757] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 13:24:10 juju-e4d256-prod-github-runner-207 kernel: [28824.604582] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 13:24:10 juju-e4d256-prod-github-runner-207 kernel: [28824.605545] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 13:24:10 juju-e4d256-prod-github-runner-207 kernel: [28824.606405] ? __seccomp_filter+0x4a/0x4a0 Aug 22 13:24:10 juju-e4d256-prod-github-runner-207 kernel: [28824.607187] ? __fget_files+0x86/0xc0 Aug 22 13:24:10 juju-e4d256-prod-github-runner-207 kernel: [28824.607949] __x64_sys_ioctl+0x95/0xd0 Aug 22 13:24:10 juju-e4d256-prod-github-runner-207 kernel: [28824.608691] do_syscall_64+0x5c/0xc0 Aug 22 13:24:10 juju-e4d256-prod-github-runner-207 kernel: [28824.609440] ? do_futex+0x162/0x1f0 Aug 22 13:24:10 juju-e4d256-prod-github-runner-207 kernel: [28824.610132] ? __x64_sys_futex+0x78/0x1e0 Aug 22 13:24:10 juju-e4d256-prod-github-runner-207 kernel: [28824.610851] ? __secure_computing+0xa9/0x120 Aug 22 13:24:10 juju-e4d256-prod-github-runner-207 kernel: [28824.611577] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 13:24:10 juju-e4d256-prod-github-runner-207 kernel: [28824.612379] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:24:10 juju-e4d256-prod-github-runner-207 kernel: [28824.613220] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:24:10 juju-e4d256-prod-github-runner-207 kernel: [28824.613969] ? do_syscall_64+0x69/0xc0 Aug 22 13:24:10 juju-e4d256-prod-github-runner-207 kernel: [28824.614863] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:24:10 juju-e4d256-prod-github-runner-207 kernel: [28824.615750] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:24:10 juju-e4d256-prod-github-runner-207 kernel: [28824.616499] ? do_syscall_64+0x69/0xc0 Aug 22 13:24:10 juju-e4d256-prod-github-runner-207 kernel: [28824.617198] ? do_syscall_64+0x69/0xc0 Aug 22 13:24:10 juju-e4d256-prod-github-runner-207 kernel: [28824.617876] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 13:24:10 juju-e4d256-prod-github-runner-207 kernel: [28824.618607] RIP: 0033:0x7faa5d0edaff Aug 22 13:24:10 juju-e4d256-prod-github-runner-207 kernel: [28824.619292] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 13:24:10 juju-e4d256-prod-github-runner-207 kernel: [28824.621555] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 13:24:10 juju-e4d256-prod-github-runner-207 kernel: [28824.622641] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 13:24:10 juju-e4d256-prod-github-runner-207 kernel: [28824.623598] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 13:24:10 juju-e4d256-prod-github-runner-207 kernel: [28824.624532] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 13:24:10 juju-e4d256-prod-github-runner-207 kernel: [28824.625478] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 13:24:10 juju-e4d256-prod-github-runner-207 kernel: [28824.626458] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 13:24:10 juju-e4d256-prod-github-runner-207 kernel: [28824.627786] Aug 22 13:24:38 juju-e4d256-prod-github-runner-207 kernel: [28852.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 26763s! [qemu-system-x86:6715] Aug 22 13:24:38 juju-e4d256-prod-github-runner-207 kernel: [28852.544110] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 13:24:38 juju-e4d256-prod-github-runner-207 kernel: [28852.544320] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 13:24:38 juju-e4d256-prod-github-runner-207 kernel: [28852.557439] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 13:24:38 juju-e4d256-prod-github-runner-207 kernel: [28852.558929] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 13:24:38 juju-e4d256-prod-github-runner-207 kernel: [28852.560382] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:24:38 juju-e4d256-prod-github-runner-207 kernel: [28852.561518] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 13:24:38 juju-e4d256-prod-github-runner-207 kernel: [28852.564501] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 13:24:38 juju-e4d256-prod-github-runner-207 kernel: [28852.565550] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 13:24:38 juju-e4d256-prod-github-runner-207 kernel: [28852.566713] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 13:24:38 juju-e4d256-prod-github-runner-207 kernel: [28852.567873] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 13:24:38 juju-e4d256-prod-github-runner-207 kernel: [28852.569057] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 13:24:38 juju-e4d256-prod-github-runner-207 kernel: [28852.570241] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 13:24:38 juju-e4d256-prod-github-runner-207 kernel: [28852.571415] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 13:24:38 juju-e4d256-prod-github-runner-207 kernel: [28852.572671] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 13:24:38 juju-e4d256-prod-github-runner-207 kernel: [28852.573783] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 13:24:38 juju-e4d256-prod-github-runner-207 kernel: [28852.574983] Call Trace: Aug 22 13:24:38 juju-e4d256-prod-github-runner-207 kernel: [28852.575903] Aug 22 13:24:38 juju-e4d256-prod-github-runner-207 kernel: [28852.576821] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:24:38 juju-e4d256-prod-github-runner-207 kernel: [28852.577856] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:24:38 juju-e4d256-prod-github-runner-207 kernel: [28852.578880] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:24:38 juju-e4d256-prod-github-runner-207 kernel: [28852.579955] ? show_regs.part.0+0x23/0x29 Aug 22 13:24:38 juju-e4d256-prod-github-runner-207 kernel: [28852.580985] ? show_regs.cold+0x8/0xd Aug 22 13:24:38 juju-e4d256-prod-github-runner-207 kernel: [28852.581958] ? watchdog_timer_fn+0x1be/0x220 Aug 22 13:24:38 juju-e4d256-prod-github-runner-207 kernel: [28852.582975] ? lockup_detector_update_enable+0x60/0x60 Aug 22 13:24:38 juju-e4d256-prod-github-runner-207 kernel: [28852.584040] ? __hrtimer_run_queues+0x107/0x230 Aug 22 13:24:38 juju-e4d256-prod-github-runner-207 kernel: [28852.585084] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 13:24:38 juju-e4d256-prod-github-runner-207 kernel: [28852.586131] ? hrtimer_interrupt+0x101/0x220 Aug 22 13:24:38 juju-e4d256-prod-github-runner-207 kernel: [28852.587146] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 13:24:38 juju-e4d256-prod-github-runner-207 kernel: [28852.588211] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 13:24:38 juju-e4d256-prod-github-runner-207 kernel: [28852.589275] Aug 22 13:24:38 juju-e4d256-prod-github-runner-207 kernel: [28852.590134] Aug 22 13:24:38 juju-e4d256-prod-github-runner-207 kernel: [28852.591002] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 13:24:38 juju-e4d256-prod-github-runner-207 kernel: [28852.592101] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:24:38 juju-e4d256-prod-github-runner-207 kernel: [28852.593156] ? _raw_spin_lock+0x22/0x30 Aug 22 13:24:38 juju-e4d256-prod-github-runner-207 kernel: [28852.594102] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:24:38 juju-e4d256-prod-github-runner-207 kernel: [28852.595125] direct_page_fault+0x206/0x310 [kvm] Aug 22 13:24:38 juju-e4d256-prod-github-runner-207 kernel: [28852.596151] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 13:24:38 juju-e4d256-prod-github-runner-207 kernel: [28852.597175] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 13:24:38 juju-e4d256-prod-github-runner-207 kernel: [28852.598184] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 13:24:38 juju-e4d256-prod-github-runner-207 kernel: [28852.599183] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 13:24:38 juju-e4d256-prod-github-runner-207 kernel: [28852.600130] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 13:24:38 juju-e4d256-prod-github-runner-207 kernel: [28852.601123] handle_exit+0x98/0x230 [kvm_amd] Aug 22 13:24:38 juju-e4d256-prod-github-runner-207 kernel: [28852.602030] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 13:24:38 juju-e4d256-prod-github-runner-207 kernel: [28852.602947] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 13:24:38 juju-e4d256-prod-github-runner-207 kernel: [28852.603884] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 13:24:38 juju-e4d256-prod-github-runner-207 kernel: [28852.604797] vcpu_run+0x62/0x2c0 [kvm] Aug 22 13:24:38 juju-e4d256-prod-github-runner-207 kernel: [28852.605615] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 13:24:38 juju-e4d256-prod-github-runner-207 kernel: [28852.606423] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 13:24:38 juju-e4d256-prod-github-runner-207 kernel: [28852.607293] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 13:24:38 juju-e4d256-prod-github-runner-207 kernel: [28852.608096] ? __seccomp_filter+0x4a/0x4a0 Aug 22 13:24:38 juju-e4d256-prod-github-runner-207 kernel: [28852.608853] ? __fget_files+0x86/0xc0 Aug 22 13:24:38 juju-e4d256-prod-github-runner-207 kernel: [28852.609557] __x64_sys_ioctl+0x95/0xd0 Aug 22 13:24:38 juju-e4d256-prod-github-runner-207 kernel: [28852.610255] do_syscall_64+0x5c/0xc0 Aug 22 13:24:38 juju-e4d256-prod-github-runner-207 kernel: [28852.611001] ? do_futex+0x162/0x1f0 Aug 22 13:24:38 juju-e4d256-prod-github-runner-207 kernel: [28852.611726] ? __x64_sys_futex+0x78/0x1e0 Aug 22 13:24:38 juju-e4d256-prod-github-runner-207 kernel: [28852.612517] ? __secure_computing+0xa9/0x120 Aug 22 13:24:38 juju-e4d256-prod-github-runner-207 kernel: [28852.613385] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 13:24:38 juju-e4d256-prod-github-runner-207 kernel: [28852.614253] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:24:38 juju-e4d256-prod-github-runner-207 kernel: [28852.615073] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:24:38 juju-e4d256-prod-github-runner-207 kernel: [28852.615892] ? do_syscall_64+0x69/0xc0 Aug 22 13:24:38 juju-e4d256-prod-github-runner-207 kernel: [28852.616633] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:24:38 juju-e4d256-prod-github-runner-207 kernel: [28852.617437] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:24:38 juju-e4d256-prod-github-runner-207 kernel: [28852.618227] ? do_syscall_64+0x69/0xc0 Aug 22 13:24:38 juju-e4d256-prod-github-runner-207 kernel: [28852.618926] ? do_syscall_64+0x69/0xc0 Aug 22 13:24:38 juju-e4d256-prod-github-runner-207 kernel: [28852.619622] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 13:24:38 juju-e4d256-prod-github-runner-207 kernel: [28852.620442] RIP: 0033:0x7faa5d0edaff Aug 22 13:24:38 juju-e4d256-prod-github-runner-207 kernel: [28852.621163] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 13:24:38 juju-e4d256-prod-github-runner-207 kernel: [28852.623479] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 13:24:38 juju-e4d256-prod-github-runner-207 kernel: [28852.624562] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 13:24:38 juju-e4d256-prod-github-runner-207 kernel: [28852.625586] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 13:24:38 juju-e4d256-prod-github-runner-207 kernel: [28852.626618] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 13:24:38 juju-e4d256-prod-github-runner-207 kernel: [28852.627639] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 13:24:38 juju-e4d256-prod-github-runner-207 kernel: [28852.628681] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 13:24:38 juju-e4d256-prod-github-runner-207 kernel: [28852.629707] Aug 22 13:25:06 juju-e4d256-prod-github-runner-207 kernel: [28880.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 26789s! [qemu-system-x86:6715] Aug 22 13:25:06 juju-e4d256-prod-github-runner-207 kernel: [28880.543185] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 13:25:06 juju-e4d256-prod-github-runner-207 kernel: [28880.543343] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 13:25:06 juju-e4d256-prod-github-runner-207 kernel: [28880.555956] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 13:25:06 juju-e4d256-prod-github-runner-207 kernel: [28880.557236] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 13:25:06 juju-e4d256-prod-github-runner-207 kernel: [28880.558457] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:25:06 juju-e4d256-prod-github-runner-207 kernel: [28880.559515] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 13:25:06 juju-e4d256-prod-github-runner-207 kernel: [28880.562098] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 13:25:06 juju-e4d256-prod-github-runner-207 kernel: [28880.563140] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 13:25:06 juju-e4d256-prod-github-runner-207 kernel: [28880.564340] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 13:25:06 juju-e4d256-prod-github-runner-207 kernel: [28880.565502] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 13:25:06 juju-e4d256-prod-github-runner-207 kernel: [28880.566692] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 13:25:06 juju-e4d256-prod-github-runner-207 kernel: [28880.567856] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 13:25:06 juju-e4d256-prod-github-runner-207 kernel: [28880.569030] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 13:25:06 juju-e4d256-prod-github-runner-207 kernel: [28880.570267] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 13:25:06 juju-e4d256-prod-github-runner-207 kernel: [28880.571389] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 13:25:06 juju-e4d256-prod-github-runner-207 kernel: [28880.572605] Call Trace: Aug 22 13:25:06 juju-e4d256-prod-github-runner-207 kernel: [28880.573539] Aug 22 13:25:06 juju-e4d256-prod-github-runner-207 kernel: [28880.574421] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:25:06 juju-e4d256-prod-github-runner-207 kernel: [28880.575455] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:25:06 juju-e4d256-prod-github-runner-207 kernel: [28880.576490] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:25:06 juju-e4d256-prod-github-runner-207 kernel: [28880.577596] ? show_regs.part.0+0x23/0x29 Aug 22 13:25:06 juju-e4d256-prod-github-runner-207 kernel: [28880.578597] ? show_regs.cold+0x8/0xd Aug 22 13:25:06 juju-e4d256-prod-github-runner-207 kernel: [28880.579567] ? watchdog_timer_fn+0x1be/0x220 Aug 22 13:25:06 juju-e4d256-prod-github-runner-207 kernel: [28880.580588] ? lockup_detector_update_enable+0x60/0x60 Aug 22 13:25:06 juju-e4d256-prod-github-runner-207 kernel: [28880.581651] ? __hrtimer_run_queues+0x107/0x230 Aug 22 13:25:06 juju-e4d256-prod-github-runner-207 kernel: [28880.582676] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 13:25:06 juju-e4d256-prod-github-runner-207 kernel: [28880.583700] ? hrtimer_interrupt+0x101/0x220 Aug 22 13:25:06 juju-e4d256-prod-github-runner-207 kernel: [28880.584729] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 13:25:06 juju-e4d256-prod-github-runner-207 kernel: [28880.585803] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 13:25:06 juju-e4d256-prod-github-runner-207 kernel: [28880.586849] Aug 22 13:25:06 juju-e4d256-prod-github-runner-207 kernel: [28880.587704] Aug 22 13:25:06 juju-e4d256-prod-github-runner-207 kernel: [28880.588565] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 13:25:06 juju-e4d256-prod-github-runner-207 kernel: [28880.589601] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:25:06 juju-e4d256-prod-github-runner-207 kernel: [28880.590672] ? _raw_spin_lock+0x22/0x30 Aug 22 13:25:06 juju-e4d256-prod-github-runner-207 kernel: [28880.591625] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:25:06 juju-e4d256-prod-github-runner-207 kernel: [28880.592658] direct_page_fault+0x206/0x310 [kvm] Aug 22 13:25:06 juju-e4d256-prod-github-runner-207 kernel: [28880.593693] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 13:25:06 juju-e4d256-prod-github-runner-207 kernel: [28880.594734] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 13:25:06 juju-e4d256-prod-github-runner-207 kernel: [28880.595741] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 13:25:06 juju-e4d256-prod-github-runner-207 kernel: [28880.596771] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 13:25:06 juju-e4d256-prod-github-runner-207 kernel: [28880.597721] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 13:25:06 juju-e4d256-prod-github-runner-207 kernel: [28880.598698] handle_exit+0x98/0x230 [kvm_amd] Aug 22 13:25:06 juju-e4d256-prod-github-runner-207 kernel: [28880.599590] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 13:25:06 juju-e4d256-prod-github-runner-207 kernel: [28880.600515] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 13:25:06 juju-e4d256-prod-github-runner-207 kernel: [28880.601444] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 13:25:06 juju-e4d256-prod-github-runner-207 kernel: [28880.602354] vcpu_run+0x62/0x2c0 [kvm] Aug 22 13:25:06 juju-e4d256-prod-github-runner-207 kernel: [28880.603168] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 13:25:06 juju-e4d256-prod-github-runner-207 kernel: [28880.603999] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 13:25:06 juju-e4d256-prod-github-runner-207 kernel: [28880.604867] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 13:25:06 juju-e4d256-prod-github-runner-207 kernel: [28880.605662] ? __seccomp_filter+0x4a/0x4a0 Aug 22 13:25:06 juju-e4d256-prod-github-runner-207 kernel: [28880.606416] ? __fget_files+0x86/0xc0 Aug 22 13:25:06 juju-e4d256-prod-github-runner-207 kernel: [28880.607141] __x64_sys_ioctl+0x95/0xd0 Aug 22 13:25:06 juju-e4d256-prod-github-runner-207 kernel: [28880.607837] do_syscall_64+0x5c/0xc0 Aug 22 13:25:06 juju-e4d256-prod-github-runner-207 kernel: [28880.608519] ? do_futex+0x162/0x1f0 Aug 22 13:25:06 juju-e4d256-prod-github-runner-207 kernel: [28880.609173] ? __x64_sys_futex+0x78/0x1e0 Aug 22 13:25:06 juju-e4d256-prod-github-runner-207 kernel: [28880.609844] ? __secure_computing+0xa9/0x120 Aug 22 13:25:06 juju-e4d256-prod-github-runner-207 kernel: [28880.610552] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 13:25:06 juju-e4d256-prod-github-runner-207 kernel: [28880.611315] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:25:06 juju-e4d256-prod-github-runner-207 kernel: [28880.612037] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:25:06 juju-e4d256-prod-github-runner-207 kernel: [28880.612768] ? do_syscall_64+0x69/0xc0 Aug 22 13:25:06 juju-e4d256-prod-github-runner-207 kernel: [28880.613419] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:25:06 juju-e4d256-prod-github-runner-207 kernel: [28880.614124] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:25:06 juju-e4d256-prod-github-runner-207 kernel: [28880.614820] ? do_syscall_64+0x69/0xc0 Aug 22 13:25:06 juju-e4d256-prod-github-runner-207 kernel: [28880.615443] ? do_syscall_64+0x69/0xc0 Aug 22 13:25:06 juju-e4d256-prod-github-runner-207 kernel: [28880.616072] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 13:25:06 juju-e4d256-prod-github-runner-207 kernel: [28880.616777] RIP: 0033:0x7faa5d0edaff Aug 22 13:25:06 juju-e4d256-prod-github-runner-207 kernel: [28880.617401] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 13:25:06 juju-e4d256-prod-github-runner-207 kernel: [28880.619407] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 13:25:06 juju-e4d256-prod-github-runner-207 kernel: [28880.620323] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 13:25:06 juju-e4d256-prod-github-runner-207 kernel: [28880.621216] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 13:25:06 juju-e4d256-prod-github-runner-207 kernel: [28880.622107] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 13:25:06 juju-e4d256-prod-github-runner-207 kernel: [28880.622995] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 13:25:06 juju-e4d256-prod-github-runner-207 kernel: [28880.623884] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 13:25:06 juju-e4d256-prod-github-runner-207 kernel: [28880.624786] Aug 22 13:25:34 juju-e4d256-prod-github-runner-207 kernel: [28908.541981] watchdog: BUG: soft lockup - CPU#1 stuck for 26815s! [qemu-system-x86:6715] Aug 22 13:25:34 juju-e4d256-prod-github-runner-207 kernel: [28908.543915] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 13:25:34 juju-e4d256-prod-github-runner-207 kernel: [28908.544178] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 13:25:34 juju-e4d256-prod-github-runner-207 kernel: [28908.556710] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 13:25:34 juju-e4d256-prod-github-runner-207 kernel: [28908.558005] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 13:25:34 juju-e4d256-prod-github-runner-207 kernel: [28908.559256] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:25:34 juju-e4d256-prod-github-runner-207 kernel: [28908.560345] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 13:25:34 juju-e4d256-prod-github-runner-207 kernel: [28908.562930] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 13:25:34 juju-e4d256-prod-github-runner-207 kernel: [28908.564020] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 13:25:34 juju-e4d256-prod-github-runner-207 kernel: [28908.565240] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 13:25:34 juju-e4d256-prod-github-runner-207 kernel: [28908.566451] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 13:25:34 juju-e4d256-prod-github-runner-207 kernel: [28908.567674] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 13:25:34 juju-e4d256-prod-github-runner-207 kernel: [28908.568873] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 13:25:34 juju-e4d256-prod-github-runner-207 kernel: [28908.570037] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 13:25:34 juju-e4d256-prod-github-runner-207 kernel: [28908.571291] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 13:25:34 juju-e4d256-prod-github-runner-207 kernel: [28908.572444] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 13:25:34 juju-e4d256-prod-github-runner-207 kernel: [28908.573705] Call Trace: Aug 22 13:25:34 juju-e4d256-prod-github-runner-207 kernel: [28908.574629] Aug 22 13:25:34 juju-e4d256-prod-github-runner-207 kernel: [28908.575553] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:25:34 juju-e4d256-prod-github-runner-207 kernel: [28908.576594] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:25:34 juju-e4d256-prod-github-runner-207 kernel: [28908.577671] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:25:34 juju-e4d256-prod-github-runner-207 kernel: [28908.578758] ? show_regs.part.0+0x23/0x29 Aug 22 13:25:34 juju-e4d256-prod-github-runner-207 kernel: [28908.579792] ? show_regs.cold+0x8/0xd Aug 22 13:25:34 juju-e4d256-prod-github-runner-207 kernel: [28908.580767] ? watchdog_timer_fn+0x1be/0x220 Aug 22 13:25:34 juju-e4d256-prod-github-runner-207 kernel: [28908.581772] ? lockup_detector_update_enable+0x60/0x60 Aug 22 13:25:34 juju-e4d256-prod-github-runner-207 kernel: [28908.582832] ? __hrtimer_run_queues+0x107/0x230 Aug 22 13:25:34 juju-e4d256-prod-github-runner-207 kernel: [28908.583928] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 13:25:34 juju-e4d256-prod-github-runner-207 kernel: [28908.585014] ? hrtimer_interrupt+0x101/0x220 Aug 22 13:25:34 juju-e4d256-prod-github-runner-207 kernel: [28908.586030] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 13:25:34 juju-e4d256-prod-github-runner-207 kernel: [28908.587099] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 13:25:34 juju-e4d256-prod-github-runner-207 kernel: [28908.588176] Aug 22 13:25:34 juju-e4d256-prod-github-runner-207 kernel: [28908.589029] Aug 22 13:25:34 juju-e4d256-prod-github-runner-207 kernel: [28908.589875] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 13:25:34 juju-e4d256-prod-github-runner-207 kernel: [28908.590910] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:25:34 juju-e4d256-prod-github-runner-207 kernel: [28908.591955] ? _raw_spin_lock+0x22/0x30 Aug 22 13:25:34 juju-e4d256-prod-github-runner-207 kernel: [28908.592901] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:25:34 juju-e4d256-prod-github-runner-207 kernel: [28908.593929] direct_page_fault+0x206/0x310 [kvm] Aug 22 13:25:34 juju-e4d256-prod-github-runner-207 kernel: [28908.594961] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 13:25:34 juju-e4d256-prod-github-runner-207 kernel: [28908.596063] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 13:25:34 juju-e4d256-prod-github-runner-207 kernel: [28908.597077] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 13:25:34 juju-e4d256-prod-github-runner-207 kernel: [28908.598104] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 13:25:34 juju-e4d256-prod-github-runner-207 kernel: [28908.599082] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 13:25:34 juju-e4d256-prod-github-runner-207 kernel: [28908.600125] handle_exit+0x98/0x230 [kvm_amd] Aug 22 13:25:34 juju-e4d256-prod-github-runner-207 kernel: [28908.601062] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 13:25:34 juju-e4d256-prod-github-runner-207 kernel: [28908.601997] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 13:25:34 juju-e4d256-prod-github-runner-207 kernel: [28908.602946] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 13:25:34 juju-e4d256-prod-github-runner-207 kernel: [28908.603874] vcpu_run+0x62/0x2c0 [kvm] Aug 22 13:25:34 juju-e4d256-prod-github-runner-207 kernel: [28908.604688] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 13:25:34 juju-e4d256-prod-github-runner-207 kernel: [28908.605503] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 13:25:34 juju-e4d256-prod-github-runner-207 kernel: [28908.606357] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 13:25:34 juju-e4d256-prod-github-runner-207 kernel: [28908.607173] ? __seccomp_filter+0x4a/0x4a0 Aug 22 13:25:34 juju-e4d256-prod-github-runner-207 kernel: [28908.607942] ? __fget_files+0x86/0xc0 Aug 22 13:25:34 juju-e4d256-prod-github-runner-207 kernel: [28908.608682] __x64_sys_ioctl+0x95/0xd0 Aug 22 13:25:34 juju-e4d256-prod-github-runner-207 kernel: [28908.609379] do_syscall_64+0x5c/0xc0 Aug 22 13:25:34 juju-e4d256-prod-github-runner-207 kernel: [28908.610048] ? do_futex+0x162/0x1f0 Aug 22 13:25:34 juju-e4d256-prod-github-runner-207 kernel: [28908.610696] ? __x64_sys_futex+0x78/0x1e0 Aug 22 13:25:34 juju-e4d256-prod-github-runner-207 kernel: [28908.611369] ? __secure_computing+0xa9/0x120 Aug 22 13:25:34 juju-e4d256-prod-github-runner-207 kernel: [28908.612081] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 13:25:34 juju-e4d256-prod-github-runner-207 kernel: [28908.612865] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:25:34 juju-e4d256-prod-github-runner-207 kernel: [28908.613585] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:25:34 juju-e4d256-prod-github-runner-207 kernel: [28908.614300] ? do_syscall_64+0x69/0xc0 Aug 22 13:25:34 juju-e4d256-prod-github-runner-207 kernel: [28908.614949] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:25:34 juju-e4d256-prod-github-runner-207 kernel: [28908.615661] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:25:34 juju-e4d256-prod-github-runner-207 kernel: [28908.616366] ? do_syscall_64+0x69/0xc0 Aug 22 13:25:34 juju-e4d256-prod-github-runner-207 kernel: [28908.616995] ? do_syscall_64+0x69/0xc0 Aug 22 13:25:34 juju-e4d256-prod-github-runner-207 kernel: [28908.617618] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 13:25:34 juju-e4d256-prod-github-runner-207 kernel: [28908.618321] RIP: 0033:0x7faa5d0edaff Aug 22 13:25:34 juju-e4d256-prod-github-runner-207 kernel: [28908.618989] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 13:25:34 juju-e4d256-prod-github-runner-207 kernel: [28908.620983] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 13:25:34 juju-e4d256-prod-github-runner-207 kernel: [28908.621894] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 13:25:34 juju-e4d256-prod-github-runner-207 kernel: [28908.622783] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 13:25:34 juju-e4d256-prod-github-runner-207 kernel: [28908.623672] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 13:25:34 juju-e4d256-prod-github-runner-207 kernel: [28908.624598] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 13:25:34 juju-e4d256-prod-github-runner-207 kernel: [28908.625513] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 13:25:34 juju-e4d256-prod-github-runner-207 kernel: [28908.626609] Aug 22 13:26:02 juju-e4d256-prod-github-runner-207 kernel: [28936.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 26841s! [qemu-system-x86:6715] Aug 22 13:26:02 juju-e4d256-prod-github-runner-207 kernel: [28936.543111] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 13:26:02 juju-e4d256-prod-github-runner-207 kernel: [28936.543185] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 13:26:02 juju-e4d256-prod-github-runner-207 kernel: [28936.556662] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 13:26:02 juju-e4d256-prod-github-runner-207 kernel: [28936.558120] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 13:26:02 juju-e4d256-prod-github-runner-207 kernel: [28936.559534] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:26:02 juju-e4d256-prod-github-runner-207 kernel: [28936.560723] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 13:26:02 juju-e4d256-prod-github-runner-207 kernel: [28936.563656] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 13:26:02 juju-e4d256-prod-github-runner-207 kernel: [28936.564812] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 13:26:02 juju-e4d256-prod-github-runner-207 kernel: [28936.566134] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 13:26:02 juju-e4d256-prod-github-runner-207 kernel: [28936.567474] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 13:26:02 juju-e4d256-prod-github-runner-207 kernel: [28936.568839] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 13:26:02 juju-e4d256-prod-github-runner-207 kernel: [28936.570221] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 13:26:02 juju-e4d256-prod-github-runner-207 kernel: [28936.571577] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 13:26:02 juju-e4d256-prod-github-runner-207 kernel: [28936.572983] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 13:26:02 juju-e4d256-prod-github-runner-207 kernel: [28936.574196] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 13:26:02 juju-e4d256-prod-github-runner-207 kernel: [28936.575551] Call Trace: Aug 22 13:26:02 juju-e4d256-prod-github-runner-207 kernel: [28936.576704] Aug 22 13:26:02 juju-e4d256-prod-github-runner-207 kernel: [28936.577637] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:26:02 juju-e4d256-prod-github-runner-207 kernel: [28936.578758] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:26:02 juju-e4d256-prod-github-runner-207 kernel: [28936.579889] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:26:02 juju-e4d256-prod-github-runner-207 kernel: [28936.581058] ? show_regs.part.0+0x23/0x29 Aug 22 13:26:02 juju-e4d256-prod-github-runner-207 kernel: [28936.582134] ? show_regs.cold+0x8/0xd Aug 22 13:26:02 juju-e4d256-prod-github-runner-207 kernel: [28936.583181] ? watchdog_timer_fn+0x1be/0x220 Aug 22 13:26:02 juju-e4d256-prod-github-runner-207 kernel: [28936.584288] ? lockup_detector_update_enable+0x60/0x60 Aug 22 13:26:02 juju-e4d256-prod-github-runner-207 kernel: [28936.585447] ? __hrtimer_run_queues+0x107/0x230 Aug 22 13:26:02 juju-e4d256-prod-github-runner-207 kernel: [28936.586567] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 13:26:02 juju-e4d256-prod-github-runner-207 kernel: [28936.587711] ? hrtimer_interrupt+0x101/0x220 Aug 22 13:26:02 juju-e4d256-prod-github-runner-207 kernel: [28936.588816] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 13:26:02 juju-e4d256-prod-github-runner-207 kernel: [28936.589984] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 13:26:02 juju-e4d256-prod-github-runner-207 kernel: [28936.591123] Aug 22 13:26:02 juju-e4d256-prod-github-runner-207 kernel: [28936.592215] Aug 22 13:26:02 juju-e4d256-prod-github-runner-207 kernel: [28936.593121] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 13:26:02 juju-e4d256-prod-github-runner-207 kernel: [28936.594350] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:26:02 juju-e4d256-prod-github-runner-207 kernel: [28936.595562] ? _raw_spin_lock+0x22/0x30 Aug 22 13:26:02 juju-e4d256-prod-github-runner-207 kernel: [28936.596624] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:26:02 juju-e4d256-prod-github-runner-207 kernel: [28936.597734] direct_page_fault+0x206/0x310 [kvm] Aug 22 13:26:02 juju-e4d256-prod-github-runner-207 kernel: [28936.598856] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 13:26:02 juju-e4d256-prod-github-runner-207 kernel: [28936.599987] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 13:26:02 juju-e4d256-prod-github-runner-207 kernel: [28936.601095] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 13:26:02 juju-e4d256-prod-github-runner-207 kernel: [28936.602162] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 13:26:02 juju-e4d256-prod-github-runner-207 kernel: [28936.603260] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 13:26:02 juju-e4d256-prod-github-runner-207 kernel: [28936.604402] handle_exit+0x98/0x230 [kvm_amd] Aug 22 13:26:02 juju-e4d256-prod-github-runner-207 kernel: [28936.605588] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 13:26:02 juju-e4d256-prod-github-runner-207 kernel: [28936.606592] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 13:26:02 juju-e4d256-prod-github-runner-207 kernel: [28936.607624] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 13:26:02 juju-e4d256-prod-github-runner-207 kernel: [28936.608645] vcpu_run+0x62/0x2c0 [kvm] Aug 22 13:26:02 juju-e4d256-prod-github-runner-207 kernel: [28936.609557] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 13:26:02 juju-e4d256-prod-github-runner-207 kernel: [28936.610455] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 13:26:02 juju-e4d256-prod-github-runner-207 kernel: [28936.611431] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 13:26:02 juju-e4d256-prod-github-runner-207 kernel: [28936.612329] ? __seccomp_filter+0x4a/0x4a0 Aug 22 13:26:02 juju-e4d256-prod-github-runner-207 kernel: [28936.613151] ? __fget_files+0x86/0xc0 Aug 22 13:26:02 juju-e4d256-prod-github-runner-207 kernel: [28936.613928] __x64_sys_ioctl+0x95/0xd0 Aug 22 13:26:02 juju-e4d256-prod-github-runner-207 kernel: [28936.614710] do_syscall_64+0x5c/0xc0 Aug 22 13:26:02 juju-e4d256-prod-github-runner-207 kernel: [28936.615472] ? do_futex+0x162/0x1f0 Aug 22 13:26:02 juju-e4d256-prod-github-runner-207 kernel: [28936.616191] ? __x64_sys_futex+0x78/0x1e0 Aug 22 13:26:02 juju-e4d256-prod-github-runner-207 kernel: [28936.616959] ? __secure_computing+0xa9/0x120 Aug 22 13:26:02 juju-e4d256-prod-github-runner-207 kernel: [28936.617739] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 13:26:02 juju-e4d256-prod-github-runner-207 kernel: [28936.618632] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:26:02 juju-e4d256-prod-github-runner-207 kernel: [28936.619591] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:26:02 juju-e4d256-prod-github-runner-207 kernel: [28936.620446] ? do_syscall_64+0x69/0xc0 Aug 22 13:26:02 juju-e4d256-prod-github-runner-207 kernel: [28936.621172] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:26:02 juju-e4d256-prod-github-runner-207 kernel: [28936.621966] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:26:02 juju-e4d256-prod-github-runner-207 kernel: [28936.622754] ? do_syscall_64+0x69/0xc0 Aug 22 13:26:02 juju-e4d256-prod-github-runner-207 kernel: [28936.623467] ? do_syscall_64+0x69/0xc0 Aug 22 13:26:02 juju-e4d256-prod-github-runner-207 kernel: [28936.624170] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 13:26:02 juju-e4d256-prod-github-runner-207 kernel: [28936.625048] RIP: 0033:0x7faa5d0edaff Aug 22 13:26:02 juju-e4d256-prod-github-runner-207 kernel: [28936.625764] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 13:26:02 juju-e4d256-prod-github-runner-207 kernel: [28936.628215] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 13:26:02 juju-e4d256-prod-github-runner-207 kernel: [28936.629292] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 13:26:02 juju-e4d256-prod-github-runner-207 kernel: [28936.630320] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 13:26:02 juju-e4d256-prod-github-runner-207 kernel: [28936.631347] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 13:26:02 juju-e4d256-prod-github-runner-207 kernel: [28936.632392] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 13:26:02 juju-e4d256-prod-github-runner-207 kernel: [28936.633412] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 13:26:02 juju-e4d256-prod-github-runner-207 kernel: [28936.634479] Aug 22 13:26:30 juju-e4d256-prod-github-runner-207 kernel: [28964.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 26867s! [qemu-system-x86:6715] Aug 22 13:26:30 juju-e4d256-prod-github-runner-207 kernel: [28964.543928] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 13:26:30 juju-e4d256-prod-github-runner-207 kernel: [28964.544223] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 13:26:30 juju-e4d256-prod-github-runner-207 kernel: [28964.556542] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 13:26:30 juju-e4d256-prod-github-runner-207 kernel: [28964.557811] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 13:26:30 juju-e4d256-prod-github-runner-207 kernel: [28964.559051] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:26:30 juju-e4d256-prod-github-runner-207 kernel: [28964.560114] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 13:26:30 juju-e4d256-prod-github-runner-207 kernel: [28964.562663] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 13:26:30 juju-e4d256-prod-github-runner-207 kernel: [28964.563718] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 13:26:30 juju-e4d256-prod-github-runner-207 kernel: [28964.564882] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 13:26:30 juju-e4d256-prod-github-runner-207 kernel: [28964.566042] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 13:26:30 juju-e4d256-prod-github-runner-207 kernel: [28964.567220] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 13:26:30 juju-e4d256-prod-github-runner-207 kernel: [28964.568381] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 13:26:30 juju-e4d256-prod-github-runner-207 kernel: [28964.569553] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 13:26:30 juju-e4d256-prod-github-runner-207 kernel: [28964.570791] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 13:26:30 juju-e4d256-prod-github-runner-207 kernel: [28964.571907] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 13:26:30 juju-e4d256-prod-github-runner-207 kernel: [28964.573105] Call Trace: Aug 22 13:26:30 juju-e4d256-prod-github-runner-207 kernel: [28964.574017] Aug 22 13:26:30 juju-e4d256-prod-github-runner-207 kernel: [28964.574914] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:26:30 juju-e4d256-prod-github-runner-207 kernel: [28964.575966] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:26:30 juju-e4d256-prod-github-runner-207 kernel: [28964.576989] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:26:30 juju-e4d256-prod-github-runner-207 kernel: [28964.578083] ? show_regs.part.0+0x23/0x29 Aug 22 13:26:30 juju-e4d256-prod-github-runner-207 kernel: [28964.579093] ? show_regs.cold+0x8/0xd Aug 22 13:26:30 juju-e4d256-prod-github-runner-207 kernel: [28964.580067] ? watchdog_timer_fn+0x1be/0x220 Aug 22 13:26:30 juju-e4d256-prod-github-runner-207 kernel: [28964.581073] ? lockup_detector_update_enable+0x60/0x60 Aug 22 13:26:30 juju-e4d256-prod-github-runner-207 kernel: [28964.582138] ? __hrtimer_run_queues+0x107/0x230 Aug 22 13:26:30 juju-e4d256-prod-github-runner-207 kernel: [28964.583173] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 13:26:30 juju-e4d256-prod-github-runner-207 kernel: [28964.584195] ? hrtimer_interrupt+0x101/0x220 Aug 22 13:26:30 juju-e4d256-prod-github-runner-207 kernel: [28964.585209] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 13:26:30 juju-e4d256-prod-github-runner-207 kernel: [28964.586274] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 13:26:30 juju-e4d256-prod-github-runner-207 kernel: [28964.587330] Aug 22 13:26:30 juju-e4d256-prod-github-runner-207 kernel: [28964.588181] Aug 22 13:26:30 juju-e4d256-prod-github-runner-207 kernel: [28964.589017] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 13:26:30 juju-e4d256-prod-github-runner-207 kernel: [28964.590050] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:26:30 juju-e4d256-prod-github-runner-207 kernel: [28964.591100] ? _raw_spin_lock+0x22/0x30 Aug 22 13:26:30 juju-e4d256-prod-github-runner-207 kernel: [28964.592044] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:26:30 juju-e4d256-prod-github-runner-207 kernel: [28964.593070] direct_page_fault+0x206/0x310 [kvm] Aug 22 13:26:30 juju-e4d256-prod-github-runner-207 kernel: [28964.594134] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 13:26:30 juju-e4d256-prod-github-runner-207 kernel: [28964.595158] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 13:26:30 juju-e4d256-prod-github-runner-207 kernel: [28964.596158] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 13:26:30 juju-e4d256-prod-github-runner-207 kernel: [28964.597162] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 13:26:30 juju-e4d256-prod-github-runner-207 kernel: [28964.598110] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 13:26:30 juju-e4d256-prod-github-runner-207 kernel: [28964.599093] handle_exit+0x98/0x230 [kvm_amd] Aug 22 13:26:30 juju-e4d256-prod-github-runner-207 kernel: [28964.599983] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 13:26:30 juju-e4d256-prod-github-runner-207 kernel: [28964.600896] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 13:26:30 juju-e4d256-prod-github-runner-207 kernel: [28964.601827] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 13:26:30 juju-e4d256-prod-github-runner-207 kernel: [28964.602732] vcpu_run+0x62/0x2c0 [kvm] Aug 22 13:26:30 juju-e4d256-prod-github-runner-207 kernel: [28964.603556] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 13:26:30 juju-e4d256-prod-github-runner-207 kernel: [28964.604369] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 13:26:30 juju-e4d256-prod-github-runner-207 kernel: [28964.605229] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 13:26:30 juju-e4d256-prod-github-runner-207 kernel: [28964.606025] ? __seccomp_filter+0x4a/0x4a0 Aug 22 13:26:30 juju-e4d256-prod-github-runner-207 kernel: [28964.606766] ? __fget_files+0x86/0xc0 Aug 22 13:26:30 juju-e4d256-prod-github-runner-207 kernel: [28964.607487] __x64_sys_ioctl+0x95/0xd0 Aug 22 13:26:30 juju-e4d256-prod-github-runner-207 kernel: [28964.608180] do_syscall_64+0x5c/0xc0 Aug 22 13:26:30 juju-e4d256-prod-github-runner-207 kernel: [28964.608844] ? do_futex+0x162/0x1f0 Aug 22 13:26:30 juju-e4d256-prod-github-runner-207 kernel: [28964.609510] ? __x64_sys_futex+0x78/0x1e0 Aug 22 13:26:30 juju-e4d256-prod-github-runner-207 kernel: [28964.610185] ? __secure_computing+0xa9/0x120 Aug 22 13:26:30 juju-e4d256-prod-github-runner-207 kernel: [28964.610925] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 13:26:30 juju-e4d256-prod-github-runner-207 kernel: [28964.611704] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:26:30 juju-e4d256-prod-github-runner-207 kernel: [28964.612432] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:26:30 juju-e4d256-prod-github-runner-207 kernel: [28964.613159] ? do_syscall_64+0x69/0xc0 Aug 22 13:26:30 juju-e4d256-prod-github-runner-207 kernel: [28964.613804] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:26:30 juju-e4d256-prod-github-runner-207 kernel: [28964.614537] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:26:30 juju-e4d256-prod-github-runner-207 kernel: [28964.615289] ? do_syscall_64+0x69/0xc0 Aug 22 13:26:30 juju-e4d256-prod-github-runner-207 kernel: [28964.615918] ? do_syscall_64+0x69/0xc0 Aug 22 13:26:30 juju-e4d256-prod-github-runner-207 kernel: [28964.616541] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 13:26:30 juju-e4d256-prod-github-runner-207 kernel: [28964.617252] RIP: 0033:0x7faa5d0edaff Aug 22 13:26:30 juju-e4d256-prod-github-runner-207 kernel: [28964.617916] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 13:26:30 juju-e4d256-prod-github-runner-207 kernel: [28964.619962] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 13:26:30 juju-e4d256-prod-github-runner-207 kernel: [28964.620883] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 13:26:30 juju-e4d256-prod-github-runner-207 kernel: [28964.621827] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 13:26:30 juju-e4d256-prod-github-runner-207 kernel: [28964.622759] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 13:26:30 juju-e4d256-prod-github-runner-207 kernel: [28964.623676] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 13:26:30 juju-e4d256-prod-github-runner-207 kernel: [28964.624618] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 13:26:30 juju-e4d256-prod-github-runner-207 kernel: [28964.625514] Aug 22 13:26:45 juju-e4d256-prod-github-runner-207 kernel: [28979.120711] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 13:26:45 juju-e4d256-prod-github-runner-207 kernel: [28979.121699] rcu: 1-....: (7192947 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=3476584 Aug 22 13:26:45 juju-e4d256-prod-github-runner-207 kernel: [28979.122866] (t=7215480 jiffies g=23269 q=32679) Aug 22 13:26:45 juju-e4d256-prod-github-runner-207 kernel: [28979.123711] NMI backtrace for cpu 1 Aug 22 13:26:45 juju-e4d256-prod-github-runner-207 kernel: [28979.124517] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 13:26:45 juju-e4d256-prod-github-runner-207 kernel: [28979.125731] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 13:26:45 juju-e4d256-prod-github-runner-207 kernel: [28979.126952] Call Trace: Aug 22 13:26:45 juju-e4d256-prod-github-runner-207 kernel: [28979.127785] Aug 22 13:26:45 juju-e4d256-prod-github-runner-207 kernel: [28979.128483] show_stack+0x52/0x5c Aug 22 13:26:45 juju-e4d256-prod-github-runner-207 kernel: [28979.129358] dump_stack_lvl+0x4a/0x63 Aug 22 13:26:45 juju-e4d256-prod-github-runner-207 kernel: [28979.130240] dump_stack+0x10/0x16 Aug 22 13:26:45 juju-e4d256-prod-github-runner-207 kernel: [28979.131056] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 13:26:45 juju-e4d256-prod-github-runner-207 kernel: [28979.131861] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 13:26:45 juju-e4d256-prod-github-runner-207 kernel: [28979.132656] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 13:26:45 juju-e4d256-prod-github-runner-207 kernel: [28979.133620] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 13:26:45 juju-e4d256-prod-github-runner-207 kernel: [28979.134508] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 13:26:45 juju-e4d256-prod-github-runner-207 kernel: [28979.135352] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 13:26:45 juju-e4d256-prod-github-runner-207 kernel: [28979.136138] print_cpu_stall.cold+0x2f/0xe2 Aug 22 13:26:45 juju-e4d256-prod-github-runner-207 kernel: [28979.136915] ? timekeeping_update+0xf7/0x150 Aug 22 13:26:45 juju-e4d256-prod-github-runner-207 kernel: [28979.137700] check_cpu_stall+0x109/0x270 Aug 22 13:26:45 juju-e4d256-prod-github-runner-207 kernel: [28979.138567] rcu_sched_clock_irq+0x9a/0x250 Aug 22 13:26:45 juju-e4d256-prod-github-runner-207 kernel: [28979.139431] update_process_times+0x94/0xd0 Aug 22 13:26:45 juju-e4d256-prod-github-runner-207 kernel: [28979.140274] tick_sched_handle+0x29/0x70 Aug 22 13:26:45 juju-e4d256-prod-github-runner-207 kernel: [28979.141110] tick_sched_timer+0x8c/0xc0 Aug 22 13:26:45 juju-e4d256-prod-github-runner-207 kernel: [28979.141897] ? tick_nohz_handler+0xb0/0xb0 Aug 22 13:26:45 juju-e4d256-prod-github-runner-207 kernel: [28979.142803] __hrtimer_run_queues+0x107/0x230 Aug 22 13:26:45 juju-e4d256-prod-github-runner-207 kernel: [28979.143604] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 13:26:45 juju-e4d256-prod-github-runner-207 kernel: [28979.144534] hrtimer_interrupt+0x101/0x220 Aug 22 13:26:45 juju-e4d256-prod-github-runner-207 kernel: [28979.145332] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 13:26:45 juju-e4d256-prod-github-runner-207 kernel: [28979.146241] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 13:26:45 juju-e4d256-prod-github-runner-207 kernel: [28979.147120] Aug 22 13:26:45 juju-e4d256-prod-github-runner-207 kernel: [28979.147802] Aug 22 13:26:45 juju-e4d256-prod-github-runner-207 kernel: [28979.148505] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 13:26:45 juju-e4d256-prod-github-runner-207 kernel: [28979.149396] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:26:45 juju-e4d256-prod-github-runner-207 kernel: [28979.150331] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 13:26:45 juju-e4d256-prod-github-runner-207 kernel: [28979.152817] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 13:26:45 juju-e4d256-prod-github-runner-207 kernel: [28979.153782] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 13:26:45 juju-e4d256-prod-github-runner-207 kernel: [28979.154801] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 13:26:45 juju-e4d256-prod-github-runner-207 kernel: [28979.155832] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 13:26:45 juju-e4d256-prod-github-runner-207 kernel: [28979.156860] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 13:26:45 juju-e4d256-prod-github-runner-207 kernel: [28979.157847] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 13:26:45 juju-e4d256-prod-github-runner-207 kernel: [28979.158928] ? _raw_spin_lock+0x22/0x30 Aug 22 13:26:45 juju-e4d256-prod-github-runner-207 kernel: [28979.159917] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:26:45 juju-e4d256-prod-github-runner-207 kernel: [28979.161044] direct_page_fault+0x206/0x310 [kvm] Aug 22 13:26:45 juju-e4d256-prod-github-runner-207 kernel: [28979.162045] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 13:26:45 juju-e4d256-prod-github-runner-207 kernel: [28979.162909] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 13:26:45 juju-e4d256-prod-github-runner-207 kernel: [28979.163753] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 13:26:45 juju-e4d256-prod-github-runner-207 kernel: [28979.164692] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 13:26:45 juju-e4d256-prod-github-runner-207 kernel: [28979.165723] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 13:26:45 juju-e4d256-prod-github-runner-207 kernel: [28979.166567] handle_exit+0x98/0x230 [kvm_amd] Aug 22 13:26:45 juju-e4d256-prod-github-runner-207 kernel: [28979.167349] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 13:26:45 juju-e4d256-prod-github-runner-207 kernel: [28979.168144] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 13:26:45 juju-e4d256-prod-github-runner-207 kernel: [28979.168958] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 13:26:45 juju-e4d256-prod-github-runner-207 kernel: [28979.169760] vcpu_run+0x62/0x2c0 [kvm] Aug 22 13:26:45 juju-e4d256-prod-github-runner-207 kernel: [28979.170489] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 13:26:45 juju-e4d256-prod-github-runner-207 kernel: [28979.171270] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 13:26:45 juju-e4d256-prod-github-runner-207 kernel: [28979.172100] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 13:26:45 juju-e4d256-prod-github-runner-207 kernel: [28979.172888] ? __seccomp_filter+0x4a/0x4a0 Aug 22 13:26:45 juju-e4d256-prod-github-runner-207 kernel: [28979.173622] ? __fget_files+0x86/0xc0 Aug 22 13:26:45 juju-e4d256-prod-github-runner-207 kernel: [28979.174335] __x64_sys_ioctl+0x95/0xd0 Aug 22 13:26:45 juju-e4d256-prod-github-runner-207 kernel: [28979.175060] do_syscall_64+0x5c/0xc0 Aug 22 13:26:45 juju-e4d256-prod-github-runner-207 kernel: [28979.175759] ? do_futex+0x162/0x1f0 Aug 22 13:26:45 juju-e4d256-prod-github-runner-207 kernel: [28979.176442] ? __x64_sys_futex+0x78/0x1e0 Aug 22 13:26:45 juju-e4d256-prod-github-runner-207 kernel: [28979.177161] ? __secure_computing+0xa9/0x120 Aug 22 13:26:45 juju-e4d256-prod-github-runner-207 kernel: [28979.177893] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 13:26:45 juju-e4d256-prod-github-runner-207 kernel: [28979.178703] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:26:45 juju-e4d256-prod-github-runner-207 kernel: [28979.179508] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:26:45 juju-e4d256-prod-github-runner-207 kernel: [28979.180276] ? do_syscall_64+0x69/0xc0 Aug 22 13:26:45 juju-e4d256-prod-github-runner-207 kernel: [28979.180978] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:26:45 juju-e4d256-prod-github-runner-207 kernel: [28979.181754] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:26:45 juju-e4d256-prod-github-runner-207 kernel: [28979.182534] ? do_syscall_64+0x69/0xc0 Aug 22 13:26:45 juju-e4d256-prod-github-runner-207 kernel: [28979.183329] ? do_syscall_64+0x69/0xc0 Aug 22 13:26:45 juju-e4d256-prod-github-runner-207 kernel: [28979.184213] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 13:26:45 juju-e4d256-prod-github-runner-207 kernel: [28979.185151] RIP: 0033:0x7faa5d0edaff Aug 22 13:26:45 juju-e4d256-prod-github-runner-207 kernel: [28979.185928] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 13:26:45 juju-e4d256-prod-github-runner-207 kernel: [28979.188231] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 13:26:45 juju-e4d256-prod-github-runner-207 kernel: [28979.189364] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 13:26:45 juju-e4d256-prod-github-runner-207 kernel: [28979.190347] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 13:26:45 juju-e4d256-prod-github-runner-207 kernel: [28979.191379] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 13:26:45 juju-e4d256-prod-github-runner-207 kernel: [28979.192342] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 13:26:45 juju-e4d256-prod-github-runner-207 kernel: [28979.193292] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 13:26:45 juju-e4d256-prod-github-runner-207 kernel: [28979.194370] Aug 22 13:27:10 juju-e4d256-prod-github-runner-207 kernel: [29004.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 26904s! [qemu-system-x86:6715] Aug 22 13:27:10 juju-e4d256-prod-github-runner-207 kernel: [29004.543198] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 13:27:10 juju-e4d256-prod-github-runner-207 kernel: [29004.543275] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 13:27:10 juju-e4d256-prod-github-runner-207 kernel: [29004.555503] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 13:27:10 juju-e4d256-prod-github-runner-207 kernel: [29004.556770] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 13:27:10 juju-e4d256-prod-github-runner-207 kernel: [29004.557994] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:27:10 juju-e4d256-prod-github-runner-207 kernel: [29004.559069] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 13:27:10 juju-e4d256-prod-github-runner-207 kernel: [29004.561632] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 13:27:10 juju-e4d256-prod-github-runner-207 kernel: [29004.562691] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 13:27:10 juju-e4d256-prod-github-runner-207 kernel: [29004.563873] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 13:27:10 juju-e4d256-prod-github-runner-207 kernel: [29004.565049] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 13:27:10 juju-e4d256-prod-github-runner-207 kernel: [29004.566223] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 13:27:10 juju-e4d256-prod-github-runner-207 kernel: [29004.567408] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 13:27:10 juju-e4d256-prod-github-runner-207 kernel: [29004.568590] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 13:27:10 juju-e4d256-prod-github-runner-207 kernel: [29004.569850] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 13:27:10 juju-e4d256-prod-github-runner-207 kernel: [29004.570986] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 13:27:10 juju-e4d256-prod-github-runner-207 kernel: [29004.572182] Call Trace: Aug 22 13:27:10 juju-e4d256-prod-github-runner-207 kernel: [29004.573091] Aug 22 13:27:10 juju-e4d256-prod-github-runner-207 kernel: [29004.573987] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:27:10 juju-e4d256-prod-github-runner-207 kernel: [29004.575039] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:27:10 juju-e4d256-prod-github-runner-207 kernel: [29004.576059] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:27:10 juju-e4d256-prod-github-runner-207 kernel: [29004.577129] ? show_regs.part.0+0x23/0x29 Aug 22 13:27:10 juju-e4d256-prod-github-runner-207 kernel: [29004.578150] ? show_regs.cold+0x8/0xd Aug 22 13:27:10 juju-e4d256-prod-github-runner-207 kernel: [29004.579159] ? watchdog_timer_fn+0x1be/0x220 Aug 22 13:27:10 juju-e4d256-prod-github-runner-207 kernel: [29004.580183] ? lockup_detector_update_enable+0x60/0x60 Aug 22 13:27:10 juju-e4d256-prod-github-runner-207 kernel: [29004.581254] ? __hrtimer_run_queues+0x107/0x230 Aug 22 13:27:10 juju-e4d256-prod-github-runner-207 kernel: [29004.582292] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 13:27:10 juju-e4d256-prod-github-runner-207 kernel: [29004.583338] ? hrtimer_interrupt+0x101/0x220 Aug 22 13:27:10 juju-e4d256-prod-github-runner-207 kernel: [29004.584414] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 13:27:10 juju-e4d256-prod-github-runner-207 kernel: [29004.585506] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 13:27:10 juju-e4d256-prod-github-runner-207 kernel: [29004.586590] Aug 22 13:27:10 juju-e4d256-prod-github-runner-207 kernel: [29004.587458] Aug 22 13:27:10 juju-e4d256-prod-github-runner-207 kernel: [29004.588294] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 13:27:10 juju-e4d256-prod-github-runner-207 kernel: [29004.589324] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:27:10 juju-e4d256-prod-github-runner-207 kernel: [29004.590366] ? _raw_spin_lock+0x22/0x30 Aug 22 13:27:10 juju-e4d256-prod-github-runner-207 kernel: [29004.591506] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:27:10 juju-e4d256-prod-github-runner-207 kernel: [29004.592549] direct_page_fault+0x206/0x310 [kvm] Aug 22 13:27:10 juju-e4d256-prod-github-runner-207 kernel: [29004.593580] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 13:27:10 juju-e4d256-prod-github-runner-207 kernel: [29004.594617] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 13:27:10 juju-e4d256-prod-github-runner-207 kernel: [29004.595626] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 13:27:10 juju-e4d256-prod-github-runner-207 kernel: [29004.596599] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 13:27:10 juju-e4d256-prod-github-runner-207 kernel: [29004.597548] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 13:27:10 juju-e4d256-prod-github-runner-207 kernel: [29004.598523] handle_exit+0x98/0x230 [kvm_amd] Aug 22 13:27:10 juju-e4d256-prod-github-runner-207 kernel: [29004.599464] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 13:27:10 juju-e4d256-prod-github-runner-207 kernel: [29004.600391] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 13:27:10 juju-e4d256-prod-github-runner-207 kernel: [29004.601323] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 13:27:10 juju-e4d256-prod-github-runner-207 kernel: [29004.602235] vcpu_run+0x62/0x2c0 [kvm] Aug 22 13:27:10 juju-e4d256-prod-github-runner-207 kernel: [29004.603083] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 13:27:10 juju-e4d256-prod-github-runner-207 kernel: [29004.603902] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 13:27:10 juju-e4d256-prod-github-runner-207 kernel: [29004.604769] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 13:27:10 juju-e4d256-prod-github-runner-207 kernel: [29004.605567] ? __seccomp_filter+0x4a/0x4a0 Aug 22 13:27:10 juju-e4d256-prod-github-runner-207 kernel: [29004.606308] ? __fget_files+0x86/0xc0 Aug 22 13:27:10 juju-e4d256-prod-github-runner-207 kernel: [29004.607036] __x64_sys_ioctl+0x95/0xd0 Aug 22 13:27:10 juju-e4d256-prod-github-runner-207 kernel: [29004.607732] do_syscall_64+0x5c/0xc0 Aug 22 13:27:10 juju-e4d256-prod-github-runner-207 kernel: [29004.608401] ? do_futex+0x162/0x1f0 Aug 22 13:27:10 juju-e4d256-prod-github-runner-207 kernel: [29004.609060] ? __x64_sys_futex+0x78/0x1e0 Aug 22 13:27:10 juju-e4d256-prod-github-runner-207 kernel: [29004.609738] ? __secure_computing+0xa9/0x120 Aug 22 13:27:10 juju-e4d256-prod-github-runner-207 kernel: [29004.610427] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 13:27:10 juju-e4d256-prod-github-runner-207 kernel: [29004.611193] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:27:10 juju-e4d256-prod-github-runner-207 kernel: [29004.611920] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:27:10 juju-e4d256-prod-github-runner-207 kernel: [29004.612636] ? do_syscall_64+0x69/0xc0 Aug 22 13:27:10 juju-e4d256-prod-github-runner-207 kernel: [29004.613279] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:27:10 juju-e4d256-prod-github-runner-207 kernel: [29004.613990] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:27:10 juju-e4d256-prod-github-runner-207 kernel: [29004.614699] ? do_syscall_64+0x69/0xc0 Aug 22 13:27:10 juju-e4d256-prod-github-runner-207 kernel: [29004.615324] ? do_syscall_64+0x69/0xc0 Aug 22 13:27:10 juju-e4d256-prod-github-runner-207 kernel: [29004.615955] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 13:27:10 juju-e4d256-prod-github-runner-207 kernel: [29004.616663] RIP: 0033:0x7faa5d0edaff Aug 22 13:27:10 juju-e4d256-prod-github-runner-207 kernel: [29004.617287] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 13:27:10 juju-e4d256-prod-github-runner-207 kernel: [29004.619266] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 13:27:10 juju-e4d256-prod-github-runner-207 kernel: [29004.620180] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 13:27:10 juju-e4d256-prod-github-runner-207 kernel: [29004.621068] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 13:27:10 juju-e4d256-prod-github-runner-207 kernel: [29004.622712] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 13:27:10 juju-e4d256-prod-github-runner-207 kernel: [29004.623665] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 13:27:10 juju-e4d256-prod-github-runner-207 kernel: [29004.624567] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 13:27:10 juju-e4d256-prod-github-runner-207 kernel: [29004.625943] Aug 22 13:27:38 juju-e4d256-prod-github-runner-207 kernel: [29032.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 26930s! [qemu-system-x86:6715] Aug 22 13:27:38 juju-e4d256-prod-github-runner-207 kernel: [29032.543163] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 13:27:38 juju-e4d256-prod-github-runner-207 kernel: [29032.543239] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 13:27:38 juju-e4d256-prod-github-runner-207 kernel: [29032.555648] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 13:27:38 juju-e4d256-prod-github-runner-207 kernel: [29032.556926] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 13:27:38 juju-e4d256-prod-github-runner-207 kernel: [29032.558148] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:27:38 juju-e4d256-prod-github-runner-207 kernel: [29032.559263] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 13:27:38 juju-e4d256-prod-github-runner-207 kernel: [29032.561872] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 13:27:38 juju-e4d256-prod-github-runner-207 kernel: [29032.562953] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 13:27:38 juju-e4d256-prod-github-runner-207 kernel: [29032.564138] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 13:27:38 juju-e4d256-prod-github-runner-207 kernel: [29032.565391] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 13:27:38 juju-e4d256-prod-github-runner-207 kernel: [29032.566587] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 13:27:38 juju-e4d256-prod-github-runner-207 kernel: [29032.567766] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 13:27:38 juju-e4d256-prod-github-runner-207 kernel: [29032.568941] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 13:27:38 juju-e4d256-prod-github-runner-207 kernel: [29032.570230] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 13:27:38 juju-e4d256-prod-github-runner-207 kernel: [29032.571351] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 13:27:38 juju-e4d256-prod-github-runner-207 kernel: [29032.572586] Call Trace: Aug 22 13:27:38 juju-e4d256-prod-github-runner-207 kernel: [29032.573511] Aug 22 13:27:38 juju-e4d256-prod-github-runner-207 kernel: [29032.574532] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:27:38 juju-e4d256-prod-github-runner-207 kernel: [29032.575686] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:27:38 juju-e4d256-prod-github-runner-207 kernel: [29032.576760] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:27:38 juju-e4d256-prod-github-runner-207 kernel: [29032.577845] ? show_regs.part.0+0x23/0x29 Aug 22 13:27:38 juju-e4d256-prod-github-runner-207 kernel: [29032.578950] ? show_regs.cold+0x8/0xd Aug 22 13:27:38 juju-e4d256-prod-github-runner-207 kernel: [29032.579941] ? watchdog_timer_fn+0x1be/0x220 Aug 22 13:27:38 juju-e4d256-prod-github-runner-207 kernel: [29032.580969] ? lockup_detector_update_enable+0x60/0x60 Aug 22 13:27:38 juju-e4d256-prod-github-runner-207 kernel: [29032.582057] ? __hrtimer_run_queues+0x107/0x230 Aug 22 13:27:38 juju-e4d256-prod-github-runner-207 kernel: [29032.583125] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 13:27:38 juju-e4d256-prod-github-runner-207 kernel: [29032.584160] ? hrtimer_interrupt+0x101/0x220 Aug 22 13:27:38 juju-e4d256-prod-github-runner-207 kernel: [29032.585179] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 13:27:38 juju-e4d256-prod-github-runner-207 kernel: [29032.586312] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 13:27:38 juju-e4d256-prod-github-runner-207 kernel: [29032.587378] Aug 22 13:27:38 juju-e4d256-prod-github-runner-207 kernel: [29032.588236] Aug 22 13:27:38 juju-e4d256-prod-github-runner-207 kernel: [29032.589080] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 13:27:38 juju-e4d256-prod-github-runner-207 kernel: [29032.590126] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:27:38 juju-e4d256-prod-github-runner-207 kernel: [29032.591208] ? _raw_spin_lock+0x22/0x30 Aug 22 13:27:38 juju-e4d256-prod-github-runner-207 kernel: [29032.592182] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:27:38 juju-e4d256-prod-github-runner-207 kernel: [29032.593207] direct_page_fault+0x206/0x310 [kvm] Aug 22 13:27:38 juju-e4d256-prod-github-runner-207 kernel: [29032.594251] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 13:27:38 juju-e4d256-prod-github-runner-207 kernel: [29032.595268] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 13:27:38 juju-e4d256-prod-github-runner-207 kernel: [29032.596287] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 13:27:38 juju-e4d256-prod-github-runner-207 kernel: [29032.597273] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 13:27:38 juju-e4d256-prod-github-runner-207 kernel: [29032.598240] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 13:27:38 juju-e4d256-prod-github-runner-207 kernel: [29032.599218] handle_exit+0x98/0x230 [kvm_amd] Aug 22 13:27:38 juju-e4d256-prod-github-runner-207 kernel: [29032.600112] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 13:27:38 juju-e4d256-prod-github-runner-207 kernel: [29032.601028] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 13:27:38 juju-e4d256-prod-github-runner-207 kernel: [29032.601972] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 13:27:38 juju-e4d256-prod-github-runner-207 kernel: [29032.602894] vcpu_run+0x62/0x2c0 [kvm] Aug 22 13:27:38 juju-e4d256-prod-github-runner-207 kernel: [29032.603722] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 13:27:38 juju-e4d256-prod-github-runner-207 kernel: [29032.604530] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 13:27:38 juju-e4d256-prod-github-runner-207 kernel: [29032.605389] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 13:27:38 juju-e4d256-prod-github-runner-207 kernel: [29032.606212] ? __seccomp_filter+0x4a/0x4a0 Aug 22 13:27:38 juju-e4d256-prod-github-runner-207 kernel: [29032.606963] ? __fget_files+0x86/0xc0 Aug 22 13:27:38 juju-e4d256-prod-github-runner-207 kernel: [29032.607683] __x64_sys_ioctl+0x95/0xd0 Aug 22 13:27:38 juju-e4d256-prod-github-runner-207 kernel: [29032.608441] do_syscall_64+0x5c/0xc0 Aug 22 13:27:38 juju-e4d256-prod-github-runner-207 kernel: [29032.609133] ? do_futex+0x162/0x1f0 Aug 22 13:27:38 juju-e4d256-prod-github-runner-207 kernel: [29032.609789] ? __x64_sys_futex+0x78/0x1e0 Aug 22 13:27:38 juju-e4d256-prod-github-runner-207 kernel: [29032.610485] ? __secure_computing+0xa9/0x120 Aug 22 13:27:38 juju-e4d256-prod-github-runner-207 kernel: [29032.611184] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 13:27:38 juju-e4d256-prod-github-runner-207 kernel: [29032.611968] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:27:38 juju-e4d256-prod-github-runner-207 kernel: [29032.612708] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:27:38 juju-e4d256-prod-github-runner-207 kernel: [29032.613433] ? do_syscall_64+0x69/0xc0 Aug 22 13:27:38 juju-e4d256-prod-github-runner-207 kernel: [29032.614082] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:27:38 juju-e4d256-prod-github-runner-207 kernel: [29032.614799] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:27:38 juju-e4d256-prod-github-runner-207 kernel: [29032.615497] ? do_syscall_64+0x69/0xc0 Aug 22 13:27:38 juju-e4d256-prod-github-runner-207 kernel: [29032.616123] ? do_syscall_64+0x69/0xc0 Aug 22 13:27:38 juju-e4d256-prod-github-runner-207 kernel: [29032.616765] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 13:27:38 juju-e4d256-prod-github-runner-207 kernel: [29032.617478] RIP: 0033:0x7faa5d0edaff Aug 22 13:27:38 juju-e4d256-prod-github-runner-207 kernel: [29032.618115] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 13:27:38 juju-e4d256-prod-github-runner-207 kernel: [29032.620133] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 13:27:38 juju-e4d256-prod-github-runner-207 kernel: [29032.621058] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 13:27:38 juju-e4d256-prod-github-runner-207 kernel: [29032.621963] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 13:27:38 juju-e4d256-prod-github-runner-207 kernel: [29032.622891] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 13:27:38 juju-e4d256-prod-github-runner-207 kernel: [29032.623788] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 13:27:38 juju-e4d256-prod-github-runner-207 kernel: [29032.624781] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 13:27:38 juju-e4d256-prod-github-runner-207 kernel: [29032.625751] Aug 22 13:28:06 juju-e4d256-prod-github-runner-207 kernel: [29060.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 26956s! [qemu-system-x86:6715] Aug 22 13:28:06 juju-e4d256-prod-github-runner-207 kernel: [29060.543860] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 13:28:06 juju-e4d256-prod-github-runner-207 kernel: [29060.544161] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 13:28:06 juju-e4d256-prod-github-runner-207 kernel: [29060.556429] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 13:28:06 juju-e4d256-prod-github-runner-207 kernel: [29060.557696] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 13:28:06 juju-e4d256-prod-github-runner-207 kernel: [29060.558938] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:28:06 juju-e4d256-prod-github-runner-207 kernel: [29060.559996] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 13:28:06 juju-e4d256-prod-github-runner-207 kernel: [29060.562556] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 13:28:06 juju-e4d256-prod-github-runner-207 kernel: [29060.563601] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 13:28:06 juju-e4d256-prod-github-runner-207 kernel: [29060.564769] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 13:28:06 juju-e4d256-prod-github-runner-207 kernel: [29060.566015] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 13:28:06 juju-e4d256-prod-github-runner-207 kernel: [29060.567195] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 13:28:06 juju-e4d256-prod-github-runner-207 kernel: [29060.568355] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 13:28:06 juju-e4d256-prod-github-runner-207 kernel: [29060.569525] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 13:28:06 juju-e4d256-prod-github-runner-207 kernel: [29060.570763] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 13:28:06 juju-e4d256-prod-github-runner-207 kernel: [29060.571855] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 13:28:06 juju-e4d256-prod-github-runner-207 kernel: [29060.573074] Call Trace: Aug 22 13:28:06 juju-e4d256-prod-github-runner-207 kernel: [29060.574014] Aug 22 13:28:06 juju-e4d256-prod-github-runner-207 kernel: [29060.574907] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:28:06 juju-e4d256-prod-github-runner-207 kernel: [29060.575976] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:28:06 juju-e4d256-prod-github-runner-207 kernel: [29060.577032] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:28:06 juju-e4d256-prod-github-runner-207 kernel: [29060.578151] ? show_regs.part.0+0x23/0x29 Aug 22 13:28:06 juju-e4d256-prod-github-runner-207 kernel: [29060.579152] ? show_regs.cold+0x8/0xd Aug 22 13:28:06 juju-e4d256-prod-github-runner-207 kernel: [29060.580129] ? watchdog_timer_fn+0x1be/0x220 Aug 22 13:28:06 juju-e4d256-prod-github-runner-207 kernel: [29060.581138] ? lockup_detector_update_enable+0x60/0x60 Aug 22 13:28:06 juju-e4d256-prod-github-runner-207 kernel: [29060.582230] ? __hrtimer_run_queues+0x107/0x230 Aug 22 13:28:06 juju-e4d256-prod-github-runner-207 kernel: [29060.583295] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 13:28:06 juju-e4d256-prod-github-runner-207 kernel: [29060.584318] ? hrtimer_interrupt+0x101/0x220 Aug 22 13:28:06 juju-e4d256-prod-github-runner-207 kernel: [29060.585331] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 13:28:06 juju-e4d256-prod-github-runner-207 kernel: [29060.586417] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 13:28:06 juju-e4d256-prod-github-runner-207 kernel: [29060.587467] Aug 22 13:28:06 juju-e4d256-prod-github-runner-207 kernel: [29060.588321] Aug 22 13:28:06 juju-e4d256-prod-github-runner-207 kernel: [29060.589158] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 13:28:06 juju-e4d256-prod-github-runner-207 kernel: [29060.590214] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:28:06 juju-e4d256-prod-github-runner-207 kernel: [29060.591252] ? _raw_spin_lock+0x22/0x30 Aug 22 13:28:06 juju-e4d256-prod-github-runner-207 kernel: [29060.592205] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:28:06 juju-e4d256-prod-github-runner-207 kernel: [29060.593224] direct_page_fault+0x206/0x310 [kvm] Aug 22 13:28:06 juju-e4d256-prod-github-runner-207 kernel: [29060.594275] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 13:28:06 juju-e4d256-prod-github-runner-207 kernel: [29060.595291] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 13:28:06 juju-e4d256-prod-github-runner-207 kernel: [29060.596323] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 13:28:06 juju-e4d256-prod-github-runner-207 kernel: [29060.597327] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 13:28:06 juju-e4d256-prod-github-runner-207 kernel: [29060.598290] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 13:28:06 juju-e4d256-prod-github-runner-207 kernel: [29060.599264] handle_exit+0x98/0x230 [kvm_amd] Aug 22 13:28:06 juju-e4d256-prod-github-runner-207 kernel: [29060.600153] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 13:28:06 juju-e4d256-prod-github-runner-207 kernel: [29060.601062] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 13:28:06 juju-e4d256-prod-github-runner-207 kernel: [29060.601994] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 13:28:06 juju-e4d256-prod-github-runner-207 kernel: [29060.602894] vcpu_run+0x62/0x2c0 [kvm] Aug 22 13:28:06 juju-e4d256-prod-github-runner-207 kernel: [29060.603703] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 13:28:06 juju-e4d256-prod-github-runner-207 kernel: [29060.604506] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 13:28:06 juju-e4d256-prod-github-runner-207 kernel: [29060.605360] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 13:28:06 juju-e4d256-prod-github-runner-207 kernel: [29060.606174] ? __seccomp_filter+0x4a/0x4a0 Aug 22 13:28:06 juju-e4d256-prod-github-runner-207 kernel: [29060.606921] ? __fget_files+0x86/0xc0 Aug 22 13:28:06 juju-e4d256-prod-github-runner-207 kernel: [29060.607620] __x64_sys_ioctl+0x95/0xd0 Aug 22 13:28:06 juju-e4d256-prod-github-runner-207 kernel: [29060.608315] do_syscall_64+0x5c/0xc0 Aug 22 13:28:06 juju-e4d256-prod-github-runner-207 kernel: [29060.608977] ? do_futex+0x162/0x1f0 Aug 22 13:28:06 juju-e4d256-prod-github-runner-207 kernel: [29060.609622] ? __x64_sys_futex+0x78/0x1e0 Aug 22 13:28:06 juju-e4d256-prod-github-runner-207 kernel: [29060.610306] ? __secure_computing+0xa9/0x120 Aug 22 13:28:06 juju-e4d256-prod-github-runner-207 kernel: [29060.610992] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 13:28:06 juju-e4d256-prod-github-runner-207 kernel: [29060.611748] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:28:06 juju-e4d256-prod-github-runner-207 kernel: [29060.612494] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:28:06 juju-e4d256-prod-github-runner-207 kernel: [29060.613222] ? do_syscall_64+0x69/0xc0 Aug 22 13:28:06 juju-e4d256-prod-github-runner-207 kernel: [29060.613878] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:28:06 juju-e4d256-prod-github-runner-207 kernel: [29060.614584] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:28:06 juju-e4d256-prod-github-runner-207 kernel: [29060.615286] ? do_syscall_64+0x69/0xc0 Aug 22 13:28:06 juju-e4d256-prod-github-runner-207 kernel: [29060.615910] ? do_syscall_64+0x69/0xc0 Aug 22 13:28:06 juju-e4d256-prod-github-runner-207 kernel: [29060.616531] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 13:28:06 juju-e4d256-prod-github-runner-207 kernel: [29060.617241] RIP: 0033:0x7faa5d0edaff Aug 22 13:28:06 juju-e4d256-prod-github-runner-207 kernel: [29060.617901] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 13:28:06 juju-e4d256-prod-github-runner-207 kernel: [29060.619905] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 13:28:06 juju-e4d256-prod-github-runner-207 kernel: [29060.620813] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 13:28:06 juju-e4d256-prod-github-runner-207 kernel: [29060.621705] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 13:28:06 juju-e4d256-prod-github-runner-207 kernel: [29060.622608] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 13:28:06 juju-e4d256-prod-github-runner-207 kernel: [29060.623520] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 13:28:06 juju-e4d256-prod-github-runner-207 kernel: [29060.624416] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 13:28:06 juju-e4d256-prod-github-runner-207 kernel: [29060.625309] Aug 22 13:28:34 juju-e4d256-prod-github-runner-207 kernel: [29088.541980] watchdog: BUG: soft lockup - CPU#1 stuck for 26982s! [qemu-system-x86:6715] Aug 22 13:28:34 juju-e4d256-prod-github-runner-207 kernel: [29088.543268] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 13:28:34 juju-e4d256-prod-github-runner-207 kernel: [29088.543346] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 13:28:34 juju-e4d256-prod-github-runner-207 kernel: [29088.557446] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 13:28:34 juju-e4d256-prod-github-runner-207 kernel: [29088.558898] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 13:28:34 juju-e4d256-prod-github-runner-207 kernel: [29088.560294] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:28:34 juju-e4d256-prod-github-runner-207 kernel: [29088.561472] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 13:28:34 juju-e4d256-prod-github-runner-207 kernel: [29088.564354] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 13:28:34 juju-e4d256-prod-github-runner-207 kernel: [29088.565495] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 13:28:34 juju-e4d256-prod-github-runner-207 kernel: [29088.566800] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 13:28:34 juju-e4d256-prod-github-runner-207 kernel: [29088.568086] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 13:28:34 juju-e4d256-prod-github-runner-207 kernel: [29088.569380] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 13:28:34 juju-e4d256-prod-github-runner-207 kernel: [29088.570683] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 13:28:34 juju-e4d256-prod-github-runner-207 kernel: [29088.571978] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 13:28:34 juju-e4d256-prod-github-runner-207 kernel: [29088.573359] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 13:28:34 juju-e4d256-prod-github-runner-207 kernel: [29088.574574] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 13:28:34 juju-e4d256-prod-github-runner-207 kernel: [29088.575898] Call Trace: Aug 22 13:28:34 juju-e4d256-prod-github-runner-207 kernel: [29088.576864] Aug 22 13:28:34 juju-e4d256-prod-github-runner-207 kernel: [29088.577806] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:28:34 juju-e4d256-prod-github-runner-207 kernel: [29088.578922] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:28:34 juju-e4d256-prod-github-runner-207 kernel: [29088.580023] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:28:34 juju-e4d256-prod-github-runner-207 kernel: [29088.581188] ? show_regs.part.0+0x23/0x29 Aug 22 13:28:34 juju-e4d256-prod-github-runner-207 kernel: [29088.582277] ? show_regs.cold+0x8/0xd Aug 22 13:28:34 juju-e4d256-prod-github-runner-207 kernel: [29088.583322] ? watchdog_timer_fn+0x1be/0x220 Aug 22 13:28:34 juju-e4d256-prod-github-runner-207 kernel: [29088.584424] ? lockup_detector_update_enable+0x60/0x60 Aug 22 13:28:34 juju-e4d256-prod-github-runner-207 kernel: [29088.585617] ? __hrtimer_run_queues+0x107/0x230 Aug 22 13:28:34 juju-e4d256-prod-github-runner-207 kernel: [29088.586735] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 13:28:34 juju-e4d256-prod-github-runner-207 kernel: [29088.587839] ? hrtimer_interrupt+0x101/0x220 Aug 22 13:28:34 juju-e4d256-prod-github-runner-207 kernel: [29088.588933] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 13:28:34 juju-e4d256-prod-github-runner-207 kernel: [29088.590118] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 13:28:34 juju-e4d256-prod-github-runner-207 kernel: [29088.591259] Aug 22 13:28:34 juju-e4d256-prod-github-runner-207 kernel: [29088.592160] Aug 22 13:28:34 juju-e4d256-prod-github-runner-207 kernel: [29088.593043] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 13:28:34 juju-e4d256-prod-github-runner-207 kernel: [29088.594194] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:28:34 juju-e4d256-prod-github-runner-207 kernel: [29088.595336] ? _raw_spin_lock+0x22/0x30 Aug 22 13:28:34 juju-e4d256-prod-github-runner-207 kernel: [29088.596358] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:28:34 juju-e4d256-prod-github-runner-207 kernel: [29088.597469] direct_page_fault+0x206/0x310 [kvm] Aug 22 13:28:34 juju-e4d256-prod-github-runner-207 kernel: [29088.598593] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 13:28:34 juju-e4d256-prod-github-runner-207 kernel: [29088.599693] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 13:28:34 juju-e4d256-prod-github-runner-207 kernel: [29088.600785] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 13:28:34 juju-e4d256-prod-github-runner-207 kernel: [29088.601859] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 13:28:34 juju-e4d256-prod-github-runner-207 kernel: [29088.602895] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 13:28:34 juju-e4d256-prod-github-runner-207 kernel: [29088.603975] handle_exit+0x98/0x230 [kvm_amd] Aug 22 13:28:34 juju-e4d256-prod-github-runner-207 kernel: [29088.604949] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 13:28:34 juju-e4d256-prod-github-runner-207 kernel: [29088.605973] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 13:28:34 juju-e4d256-prod-github-runner-207 kernel: [29088.607002] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 13:28:34 juju-e4d256-prod-github-runner-207 kernel: [29088.608003] vcpu_run+0x62/0x2c0 [kvm] Aug 22 13:28:34 juju-e4d256-prod-github-runner-207 kernel: [29088.608884] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 13:28:34 juju-e4d256-prod-github-runner-207 kernel: [29088.609794] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 13:28:34 juju-e4d256-prod-github-runner-207 kernel: [29088.610752] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 13:28:34 juju-e4d256-prod-github-runner-207 kernel: [29088.611635] ? __seccomp_filter+0x4a/0x4a0 Aug 22 13:28:34 juju-e4d256-prod-github-runner-207 kernel: [29088.612463] ? __fget_files+0x86/0xc0 Aug 22 13:28:34 juju-e4d256-prod-github-runner-207 kernel: [29088.613240] __x64_sys_ioctl+0x95/0xd0 Aug 22 13:28:34 juju-e4d256-prod-github-runner-207 kernel: [29088.614025] do_syscall_64+0x5c/0xc0 Aug 22 13:28:34 juju-e4d256-prod-github-runner-207 kernel: [29088.614761] ? do_futex+0x162/0x1f0 Aug 22 13:28:34 juju-e4d256-prod-github-runner-207 kernel: [29088.615478] ? __x64_sys_futex+0x78/0x1e0 Aug 22 13:28:34 juju-e4d256-prod-github-runner-207 kernel: [29088.616228] ? __secure_computing+0xa9/0x120 Aug 22 13:28:34 juju-e4d256-prod-github-runner-207 kernel: [29088.617008] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 13:28:34 juju-e4d256-prod-github-runner-207 kernel: [29088.617888] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:28:34 juju-e4d256-prod-github-runner-207 kernel: [29088.618704] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:28:34 juju-e4d256-prod-github-runner-207 kernel: [29088.619518] ? do_syscall_64+0x69/0xc0 Aug 22 13:28:34 juju-e4d256-prod-github-runner-207 kernel: [29088.620233] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:28:34 juju-e4d256-prod-github-runner-207 kernel: [29088.621028] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:28:34 juju-e4d256-prod-github-runner-207 kernel: [29088.621826] ? do_syscall_64+0x69/0xc0 Aug 22 13:28:34 juju-e4d256-prod-github-runner-207 kernel: [29088.622525] ? do_syscall_64+0x69/0xc0 Aug 22 13:28:34 juju-e4d256-prod-github-runner-207 kernel: [29088.623221] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 13:28:34 juju-e4d256-prod-github-runner-207 kernel: [29088.624024] RIP: 0033:0x7faa5d0edaff Aug 22 13:28:34 juju-e4d256-prod-github-runner-207 kernel: [29088.624747] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 13:28:34 juju-e4d256-prod-github-runner-207 kernel: [29088.627082] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 13:28:34 juju-e4d256-prod-github-runner-207 kernel: [29088.628129] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 13:28:34 juju-e4d256-prod-github-runner-207 kernel: [29088.629148] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 13:28:34 juju-e4d256-prod-github-runner-207 kernel: [29088.630178] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 13:28:34 juju-e4d256-prod-github-runner-207 kernel: [29088.631202] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 13:28:34 juju-e4d256-prod-github-runner-207 kernel: [29088.632228] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 13:28:34 juju-e4d256-prod-github-runner-207 kernel: [29088.633259] Aug 22 13:29:02 juju-e4d256-prod-github-runner-207 kernel: [29116.541980] watchdog: BUG: soft lockup - CPU#1 stuck for 27008s! [qemu-system-x86:6715] Aug 22 13:29:02 juju-e4d256-prod-github-runner-207 kernel: [29116.543117] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 13:29:02 juju-e4d256-prod-github-runner-207 kernel: [29116.543191] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 13:29:02 juju-e4d256-prod-github-runner-207 kernel: [29116.555502] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 13:29:02 juju-e4d256-prod-github-runner-207 kernel: [29116.556761] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 13:29:02 juju-e4d256-prod-github-runner-207 kernel: [29116.558041] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:29:02 juju-e4d256-prod-github-runner-207 kernel: [29116.559111] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 13:29:02 juju-e4d256-prod-github-runner-207 kernel: [29116.561673] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 13:29:02 juju-e4d256-prod-github-runner-207 kernel: [29116.562794] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 13:29:02 juju-e4d256-prod-github-runner-207 kernel: [29116.563958] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 13:29:02 juju-e4d256-prod-github-runner-207 kernel: [29116.565129] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 13:29:02 juju-e4d256-prod-github-runner-207 kernel: [29116.566309] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 13:29:02 juju-e4d256-prod-github-runner-207 kernel: [29116.567523] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 13:29:02 juju-e4d256-prod-github-runner-207 kernel: [29116.568740] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 13:29:02 juju-e4d256-prod-github-runner-207 kernel: [29116.570050] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 13:29:02 juju-e4d256-prod-github-runner-207 kernel: [29116.571160] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 13:29:02 juju-e4d256-prod-github-runner-207 kernel: [29116.572481] Call Trace: Aug 22 13:29:02 juju-e4d256-prod-github-runner-207 kernel: [29116.573435] Aug 22 13:29:02 juju-e4d256-prod-github-runner-207 kernel: [29116.574330] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:29:02 juju-e4d256-prod-github-runner-207 kernel: [29116.575370] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:29:02 juju-e4d256-prod-github-runner-207 kernel: [29116.576390] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:29:02 juju-e4d256-prod-github-runner-207 kernel: [29116.577510] ? show_regs.part.0+0x23/0x29 Aug 22 13:29:02 juju-e4d256-prod-github-runner-207 kernel: [29116.578527] ? show_regs.cold+0x8/0xd Aug 22 13:29:02 juju-e4d256-prod-github-runner-207 kernel: [29116.579573] ? watchdog_timer_fn+0x1be/0x220 Aug 22 13:29:02 juju-e4d256-prod-github-runner-207 kernel: [29116.580584] ? lockup_detector_update_enable+0x60/0x60 Aug 22 13:29:02 juju-e4d256-prod-github-runner-207 kernel: [29116.581691] ? __hrtimer_run_queues+0x107/0x230 Aug 22 13:29:02 juju-e4d256-prod-github-runner-207 kernel: [29116.582747] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 13:29:02 juju-e4d256-prod-github-runner-207 kernel: [29116.583782] ? hrtimer_interrupt+0x101/0x220 Aug 22 13:29:02 juju-e4d256-prod-github-runner-207 kernel: [29116.584820] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 13:29:02 juju-e4d256-prod-github-runner-207 kernel: [29116.585906] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 13:29:02 juju-e4d256-prod-github-runner-207 kernel: [29116.586953] Aug 22 13:29:02 juju-e4d256-prod-github-runner-207 kernel: [29116.587816] Aug 22 13:29:02 juju-e4d256-prod-github-runner-207 kernel: [29116.588669] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 13:29:02 juju-e4d256-prod-github-runner-207 kernel: [29116.589743] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:29:02 juju-e4d256-prod-github-runner-207 kernel: [29116.590789] ? _raw_spin_lock+0x22/0x30 Aug 22 13:29:02 juju-e4d256-prod-github-runner-207 kernel: [29116.591749] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:29:02 juju-e4d256-prod-github-runner-207 kernel: [29116.592781] direct_page_fault+0x206/0x310 [kvm] Aug 22 13:29:02 juju-e4d256-prod-github-runner-207 kernel: [29116.593825] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 13:29:02 juju-e4d256-prod-github-runner-207 kernel: [29116.594834] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 13:29:02 juju-e4d256-prod-github-runner-207 kernel: [29116.595929] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 13:29:02 juju-e4d256-prod-github-runner-207 kernel: [29116.596907] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 13:29:02 juju-e4d256-prod-github-runner-207 kernel: [29116.597868] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 13:29:02 juju-e4d256-prod-github-runner-207 kernel: [29116.598847] handle_exit+0x98/0x230 [kvm_amd] Aug 22 13:29:02 juju-e4d256-prod-github-runner-207 kernel: [29116.599843] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 13:29:02 juju-e4d256-prod-github-runner-207 kernel: [29116.600770] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 13:29:02 juju-e4d256-prod-github-runner-207 kernel: [29116.601712] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 13:29:02 juju-e4d256-prod-github-runner-207 kernel: [29116.602620] vcpu_run+0x62/0x2c0 [kvm] Aug 22 13:29:02 juju-e4d256-prod-github-runner-207 kernel: [29116.603434] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 13:29:02 juju-e4d256-prod-github-runner-207 kernel: [29116.604243] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 13:29:02 juju-e4d256-prod-github-runner-207 kernel: [29116.605106] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 13:29:02 juju-e4d256-prod-github-runner-207 kernel: [29116.605930] ? __seccomp_filter+0x4a/0x4a0 Aug 22 13:29:02 juju-e4d256-prod-github-runner-207 kernel: [29116.606683] ? __fget_files+0x86/0xc0 Aug 22 13:29:02 juju-e4d256-prod-github-runner-207 kernel: [29116.607390] __x64_sys_ioctl+0x95/0xd0 Aug 22 13:29:02 juju-e4d256-prod-github-runner-207 kernel: [29116.608085] do_syscall_64+0x5c/0xc0 Aug 22 13:29:02 juju-e4d256-prod-github-runner-207 kernel: [29116.608756] ? do_futex+0x162/0x1f0 Aug 22 13:29:02 juju-e4d256-prod-github-runner-207 kernel: [29116.609421] ? __x64_sys_futex+0x78/0x1e0 Aug 22 13:29:02 juju-e4d256-prod-github-runner-207 kernel: [29116.610130] ? __secure_computing+0xa9/0x120 Aug 22 13:29:02 juju-e4d256-prod-github-runner-207 kernel: [29116.610827] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 13:29:02 juju-e4d256-prod-github-runner-207 kernel: [29116.611589] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:29:02 juju-e4d256-prod-github-runner-207 kernel: [29116.612340] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:29:02 juju-e4d256-prod-github-runner-207 kernel: [29116.613059] ? do_syscall_64+0x69/0xc0 Aug 22 13:29:02 juju-e4d256-prod-github-runner-207 kernel: [29116.613716] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:29:02 juju-e4d256-prod-github-runner-207 kernel: [29116.614418] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:29:02 juju-e4d256-prod-github-runner-207 kernel: [29116.615112] ? do_syscall_64+0x69/0xc0 Aug 22 13:29:02 juju-e4d256-prod-github-runner-207 kernel: [29116.615740] ? do_syscall_64+0x69/0xc0 Aug 22 13:29:02 juju-e4d256-prod-github-runner-207 kernel: [29116.616361] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 13:29:02 juju-e4d256-prod-github-runner-207 kernel: [29116.617069] RIP: 0033:0x7faa5d0edaff Aug 22 13:29:02 juju-e4d256-prod-github-runner-207 kernel: [29116.617712] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 13:29:02 juju-e4d256-prod-github-runner-207 kernel: [29116.619694] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 13:29:02 juju-e4d256-prod-github-runner-207 kernel: [29116.620639] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 13:29:02 juju-e4d256-prod-github-runner-207 kernel: [29116.621541] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 13:29:02 juju-e4d256-prod-github-runner-207 kernel: [29116.622430] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 13:29:02 juju-e4d256-prod-github-runner-207 kernel: [29116.623316] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 13:29:02 juju-e4d256-prod-github-runner-207 kernel: [29116.624204] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 13:29:02 juju-e4d256-prod-github-runner-207 kernel: [29116.625095] Aug 22 13:29:30 juju-e4d256-prod-github-runner-207 kernel: [29144.541980] watchdog: BUG: soft lockup - CPU#1 stuck for 27034s! [qemu-system-x86:6715] Aug 22 13:29:30 juju-e4d256-prod-github-runner-207 kernel: [29144.543884] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 13:29:30 juju-e4d256-prod-github-runner-207 kernel: [29144.544171] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 13:29:30 juju-e4d256-prod-github-runner-207 kernel: [29144.556487] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 13:29:30 juju-e4d256-prod-github-runner-207 kernel: [29144.557789] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 13:29:30 juju-e4d256-prod-github-runner-207 kernel: [29144.559031] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:29:30 juju-e4d256-prod-github-runner-207 kernel: [29144.560101] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 13:29:30 juju-e4d256-prod-github-runner-207 kernel: [29144.562704] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 13:29:30 juju-e4d256-prod-github-runner-207 kernel: [29144.563772] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 13:29:30 juju-e4d256-prod-github-runner-207 kernel: [29144.564976] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 13:29:30 juju-e4d256-prod-github-runner-207 kernel: [29144.566151] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 13:29:30 juju-e4d256-prod-github-runner-207 kernel: [29144.567471] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 13:29:30 juju-e4d256-prod-github-runner-207 kernel: [29144.568652] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 13:29:30 juju-e4d256-prod-github-runner-207 kernel: [29144.569866] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 13:29:30 juju-e4d256-prod-github-runner-207 kernel: [29144.571109] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 13:29:30 juju-e4d256-prod-github-runner-207 kernel: [29144.572221] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 13:29:30 juju-e4d256-prod-github-runner-207 kernel: [29144.573452] Call Trace: Aug 22 13:29:30 juju-e4d256-prod-github-runner-207 kernel: [29144.574372] Aug 22 13:29:30 juju-e4d256-prod-github-runner-207 kernel: [29144.575284] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:29:30 juju-e4d256-prod-github-runner-207 kernel: [29144.576315] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:29:30 juju-e4d256-prod-github-runner-207 kernel: [29144.577353] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:29:30 juju-e4d256-prod-github-runner-207 kernel: [29144.578487] ? show_regs.part.0+0x23/0x29 Aug 22 13:29:30 juju-e4d256-prod-github-runner-207 kernel: [29144.579517] ? show_regs.cold+0x8/0xd Aug 22 13:29:30 juju-e4d256-prod-github-runner-207 kernel: [29144.580496] ? watchdog_timer_fn+0x1be/0x220 Aug 22 13:29:30 juju-e4d256-prod-github-runner-207 kernel: [29144.581543] ? lockup_detector_update_enable+0x60/0x60 Aug 22 13:29:30 juju-e4d256-prod-github-runner-207 kernel: [29144.582638] ? __hrtimer_run_queues+0x107/0x230 Aug 22 13:29:30 juju-e4d256-prod-github-runner-207 kernel: [29144.583695] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 13:29:30 juju-e4d256-prod-github-runner-207 kernel: [29144.584719] ? hrtimer_interrupt+0x101/0x220 Aug 22 13:29:30 juju-e4d256-prod-github-runner-207 kernel: [29144.585756] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 13:29:30 juju-e4d256-prod-github-runner-207 kernel: [29144.586826] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 13:29:30 juju-e4d256-prod-github-runner-207 kernel: [29144.587884] Aug 22 13:29:30 juju-e4d256-prod-github-runner-207 kernel: [29144.588747] Aug 22 13:29:30 juju-e4d256-prod-github-runner-207 kernel: [29144.589604] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 13:29:30 juju-e4d256-prod-github-runner-207 kernel: [29144.590749] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:29:30 juju-e4d256-prod-github-runner-207 kernel: [29144.591862] ? _raw_spin_lock+0x22/0x30 Aug 22 13:29:30 juju-e4d256-prod-github-runner-207 kernel: [29144.592846] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:29:30 juju-e4d256-prod-github-runner-207 kernel: [29144.593928] direct_page_fault+0x206/0x310 [kvm] Aug 22 13:29:30 juju-e4d256-prod-github-runner-207 kernel: [29144.594957] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 13:29:30 juju-e4d256-prod-github-runner-207 kernel: [29144.595975] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 13:29:30 juju-e4d256-prod-github-runner-207 kernel: [29144.597104] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 13:29:30 juju-e4d256-prod-github-runner-207 kernel: [29144.598165] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 13:29:30 juju-e4d256-prod-github-runner-207 kernel: [29144.599133] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 13:29:30 juju-e4d256-prod-github-runner-207 kernel: [29144.600115] handle_exit+0x98/0x230 [kvm_amd] Aug 22 13:29:30 juju-e4d256-prod-github-runner-207 kernel: [29144.601039] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 13:29:30 juju-e4d256-prod-github-runner-207 kernel: [29144.601958] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 13:29:30 juju-e4d256-prod-github-runner-207 kernel: [29144.602882] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 13:29:30 juju-e4d256-prod-github-runner-207 kernel: [29144.603814] vcpu_run+0x62/0x2c0 [kvm] Aug 22 13:29:30 juju-e4d256-prod-github-runner-207 kernel: [29144.604661] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 13:29:30 juju-e4d256-prod-github-runner-207 kernel: [29144.605494] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 13:29:30 juju-e4d256-prod-github-runner-207 kernel: [29144.606355] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 13:29:30 juju-e4d256-prod-github-runner-207 kernel: [29144.607158] ? __seccomp_filter+0x4a/0x4a0 Aug 22 13:29:30 juju-e4d256-prod-github-runner-207 kernel: [29144.607904] ? __fget_files+0x86/0xc0 Aug 22 13:29:30 juju-e4d256-prod-github-runner-207 kernel: [29144.608611] __x64_sys_ioctl+0x95/0xd0 Aug 22 13:29:30 juju-e4d256-prod-github-runner-207 kernel: [29144.609338] do_syscall_64+0x5c/0xc0 Aug 22 13:29:30 juju-e4d256-prod-github-runner-207 kernel: [29144.610013] ? do_futex+0x162/0x1f0 Aug 22 13:29:30 juju-e4d256-prod-github-runner-207 kernel: [29144.610666] ? __x64_sys_futex+0x78/0x1e0 Aug 22 13:29:30 juju-e4d256-prod-github-runner-207 kernel: [29144.611345] ? __secure_computing+0xa9/0x120 Aug 22 13:29:30 juju-e4d256-prod-github-runner-207 kernel: [29144.612037] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 13:29:30 juju-e4d256-prod-github-runner-207 kernel: [29144.612807] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:29:30 juju-e4d256-prod-github-runner-207 kernel: [29144.613575] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:29:30 juju-e4d256-prod-github-runner-207 kernel: [29144.614315] ? do_syscall_64+0x69/0xc0 Aug 22 13:29:30 juju-e4d256-prod-github-runner-207 kernel: [29144.614966] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:29:30 juju-e4d256-prod-github-runner-207 kernel: [29144.615674] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:29:30 juju-e4d256-prod-github-runner-207 kernel: [29144.616381] ? do_syscall_64+0x69/0xc0 Aug 22 13:29:30 juju-e4d256-prod-github-runner-207 kernel: [29144.617034] ? do_syscall_64+0x69/0xc0 Aug 22 13:29:30 juju-e4d256-prod-github-runner-207 kernel: [29144.617666] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 13:29:30 juju-e4d256-prod-github-runner-207 kernel: [29144.618374] RIP: 0033:0x7faa5d0edaff Aug 22 13:29:30 juju-e4d256-prod-github-runner-207 kernel: [29144.619039] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 13:29:30 juju-e4d256-prod-github-runner-207 kernel: [29144.621072] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 13:29:30 juju-e4d256-prod-github-runner-207 kernel: [29144.621991] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 13:29:30 juju-e4d256-prod-github-runner-207 kernel: [29144.622898] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 13:29:30 juju-e4d256-prod-github-runner-207 kernel: [29144.623791] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 13:29:30 juju-e4d256-prod-github-runner-207 kernel: [29144.624703] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 13:29:30 juju-e4d256-prod-github-runner-207 kernel: [29144.625614] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 13:29:30 juju-e4d256-prod-github-runner-207 kernel: [29144.626513] Aug 22 13:29:45 juju-e4d256-prod-github-runner-207 kernel: [29159.132708] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 13:29:45 juju-e4d256-prod-github-runner-207 kernel: [29159.133690] rcu: 1-....: (7237811 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=3498102 Aug 22 13:29:45 juju-e4d256-prod-github-runner-207 kernel: [29159.134809] (t=7260483 jiffies g=23269 q=32827) Aug 22 13:29:45 juju-e4d256-prod-github-runner-207 kernel: [29159.135606] NMI backtrace for cpu 1 Aug 22 13:29:45 juju-e4d256-prod-github-runner-207 kernel: [29159.136321] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 13:29:45 juju-e4d256-prod-github-runner-207 kernel: [29159.137447] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 13:29:45 juju-e4d256-prod-github-runner-207 kernel: [29159.138521] Call Trace: Aug 22 13:29:45 juju-e4d256-prod-github-runner-207 kernel: [29159.139199] Aug 22 13:29:45 juju-e4d256-prod-github-runner-207 kernel: [29159.139844] show_stack+0x52/0x5c Aug 22 13:29:45 juju-e4d256-prod-github-runner-207 kernel: [29159.140623] dump_stack_lvl+0x4a/0x63 Aug 22 13:29:45 juju-e4d256-prod-github-runner-207 kernel: [29159.141393] dump_stack+0x10/0x16 Aug 22 13:29:45 juju-e4d256-prod-github-runner-207 kernel: [29159.142124] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 13:29:45 juju-e4d256-prod-github-runner-207 kernel: [29159.142911] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 13:29:45 juju-e4d256-prod-github-runner-207 kernel: [29159.143705] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 13:29:45 juju-e4d256-prod-github-runner-207 kernel: [29159.144556] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 13:29:45 juju-e4d256-prod-github-runner-207 kernel: [29159.145425] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 13:29:45 juju-e4d256-prod-github-runner-207 kernel: [29159.146268] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 13:29:45 juju-e4d256-prod-github-runner-207 kernel: [29159.147043] print_cpu_stall.cold+0x2f/0xe2 Aug 22 13:29:45 juju-e4d256-prod-github-runner-207 kernel: [29159.147810] ? timekeeping_update+0xf7/0x150 Aug 22 13:29:45 juju-e4d256-prod-github-runner-207 kernel: [29159.148606] check_cpu_stall+0x109/0x270 Aug 22 13:29:45 juju-e4d256-prod-github-runner-207 kernel: [29159.149377] rcu_sched_clock_irq+0x9a/0x250 Aug 22 13:29:45 juju-e4d256-prod-github-runner-207 kernel: [29159.150141] update_process_times+0x94/0xd0 Aug 22 13:29:45 juju-e4d256-prod-github-runner-207 kernel: [29159.150900] tick_sched_handle+0x29/0x70 Aug 22 13:29:45 juju-e4d256-prod-github-runner-207 kernel: [29159.151650] tick_sched_timer+0x8c/0xc0 Aug 22 13:29:45 juju-e4d256-prod-github-runner-207 kernel: [29159.152389] ? tick_nohz_handler+0xb0/0xb0 Aug 22 13:29:45 juju-e4d256-prod-github-runner-207 kernel: [29159.153161] __hrtimer_run_queues+0x107/0x230 Aug 22 13:29:45 juju-e4d256-prod-github-runner-207 kernel: [29159.153963] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 13:29:45 juju-e4d256-prod-github-runner-207 kernel: [29159.154737] hrtimer_interrupt+0x101/0x220 Aug 22 13:29:45 juju-e4d256-prod-github-runner-207 kernel: [29159.155511] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 13:29:45 juju-e4d256-prod-github-runner-207 kernel: [29159.156339] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 13:29:45 juju-e4d256-prod-github-runner-207 kernel: [29159.157161] Aug 22 13:29:45 juju-e4d256-prod-github-runner-207 kernel: [29159.157798] Aug 22 13:29:45 juju-e4d256-prod-github-runner-207 kernel: [29159.158472] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 13:29:45 juju-e4d256-prod-github-runner-207 kernel: [29159.159308] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:29:45 juju-e4d256-prod-github-runner-207 kernel: [29159.160208] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 13:29:45 juju-e4d256-prod-github-runner-207 kernel: [29159.162476] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 13:29:45 juju-e4d256-prod-github-runner-207 kernel: [29159.163351] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 13:29:45 juju-e4d256-prod-github-runner-207 kernel: [29159.164342] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 13:29:45 juju-e4d256-prod-github-runner-207 kernel: [29159.165347] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 13:29:45 juju-e4d256-prod-github-runner-207 kernel: [29159.166331] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 13:29:45 juju-e4d256-prod-github-runner-207 kernel: [29159.167290] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 13:29:45 juju-e4d256-prod-github-runner-207 kernel: [29159.168261] ? _raw_spin_lock+0x22/0x30 Aug 22 13:29:45 juju-e4d256-prod-github-runner-207 kernel: [29159.169054] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:29:45 juju-e4d256-prod-github-runner-207 kernel: [29159.169896] direct_page_fault+0x206/0x310 [kvm] Aug 22 13:29:45 juju-e4d256-prod-github-runner-207 kernel: [29159.170735] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 13:29:45 juju-e4d256-prod-github-runner-207 kernel: [29159.171561] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 13:29:45 juju-e4d256-prod-github-runner-207 kernel: [29159.172383] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 13:29:45 juju-e4d256-prod-github-runner-207 kernel: [29159.173205] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 13:29:45 juju-e4d256-prod-github-runner-207 kernel: [29159.173993] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 13:29:45 juju-e4d256-prod-github-runner-207 kernel: [29159.174811] handle_exit+0x98/0x230 [kvm_amd] Aug 22 13:29:45 juju-e4d256-prod-github-runner-207 kernel: [29159.175567] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 13:29:45 juju-e4d256-prod-github-runner-207 kernel: [29159.176363] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 13:29:45 juju-e4d256-prod-github-runner-207 kernel: [29159.177198] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 13:29:45 juju-e4d256-prod-github-runner-207 kernel: [29159.177988] vcpu_run+0x62/0x2c0 [kvm] Aug 22 13:29:45 juju-e4d256-prod-github-runner-207 kernel: [29159.178703] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 13:29:45 juju-e4d256-prod-github-runner-207 kernel: [29159.179434] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 13:29:45 juju-e4d256-prod-github-runner-207 kernel: [29159.180243] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 13:29:45 juju-e4d256-prod-github-runner-207 kernel: [29159.181023] ? __seccomp_filter+0x4a/0x4a0 Aug 22 13:29:45 juju-e4d256-prod-github-runner-207 kernel: [29159.181789] ? __fget_files+0x86/0xc0 Aug 22 13:29:45 juju-e4d256-prod-github-runner-207 kernel: [29159.182503] __x64_sys_ioctl+0x95/0xd0 Aug 22 13:29:45 juju-e4d256-prod-github-runner-207 kernel: [29159.183207] do_syscall_64+0x5c/0xc0 Aug 22 13:29:45 juju-e4d256-prod-github-runner-207 kernel: [29159.183890] ? do_futex+0x162/0x1f0 Aug 22 13:29:45 juju-e4d256-prod-github-runner-207 kernel: [29159.184566] ? __x64_sys_futex+0x78/0x1e0 Aug 22 13:29:45 juju-e4d256-prod-github-runner-207 kernel: [29159.185286] ? __secure_computing+0xa9/0x120 Aug 22 13:29:45 juju-e4d256-prod-github-runner-207 kernel: [29159.186010] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 13:29:45 juju-e4d256-prod-github-runner-207 kernel: [29159.186803] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:29:45 juju-e4d256-prod-github-runner-207 kernel: [29159.187586] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:29:45 juju-e4d256-prod-github-runner-207 kernel: [29159.188369] ? do_syscall_64+0x69/0xc0 Aug 22 13:29:45 juju-e4d256-prod-github-runner-207 kernel: [29159.189083] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:29:45 juju-e4d256-prod-github-runner-207 kernel: [29159.189845] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:29:45 juju-e4d256-prod-github-runner-207 kernel: [29159.190605] ? do_syscall_64+0x69/0xc0 Aug 22 13:29:45 juju-e4d256-prod-github-runner-207 kernel: [29159.191302] ? do_syscall_64+0x69/0xc0 Aug 22 13:29:45 juju-e4d256-prod-github-runner-207 kernel: [29159.191991] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 13:29:45 juju-e4d256-prod-github-runner-207 kernel: [29159.192789] RIP: 0033:0x7faa5d0edaff Aug 22 13:29:45 juju-e4d256-prod-github-runner-207 kernel: [29159.193652] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 13:29:45 juju-e4d256-prod-github-runner-207 kernel: [29159.195787] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 13:29:45 juju-e4d256-prod-github-runner-207 kernel: [29159.196788] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 13:29:45 juju-e4d256-prod-github-runner-207 kernel: [29159.197738] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 13:29:45 juju-e4d256-prod-github-runner-207 kernel: [29159.198682] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 13:29:45 juju-e4d256-prod-github-runner-207 kernel: [29159.199619] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 13:29:45 juju-e4d256-prod-github-runner-207 kernel: [29159.200548] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 13:29:45 juju-e4d256-prod-github-runner-207 kernel: [29159.201493] Aug 22 13:30:10 juju-e4d256-prod-github-runner-207 kernel: [29184.541981] watchdog: BUG: soft lockup - CPU#1 stuck for 27072s! [qemu-system-x86:6715] Aug 22 13:30:10 juju-e4d256-prod-github-runner-207 kernel: [29184.543115] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 13:30:10 juju-e4d256-prod-github-runner-207 kernel: [29184.543185] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 13:30:10 juju-e4d256-prod-github-runner-207 kernel: [29184.556853] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 13:30:10 juju-e4d256-prod-github-runner-207 kernel: [29184.558188] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 13:30:10 juju-e4d256-prod-github-runner-207 kernel: [29184.559433] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:30:10 juju-e4d256-prod-github-runner-207 kernel: [29184.560537] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 13:30:10 juju-e4d256-prod-github-runner-207 kernel: [29184.563269] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 13:30:10 juju-e4d256-prod-github-runner-207 kernel: [29184.564426] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 13:30:10 juju-e4d256-prod-github-runner-207 kernel: [29184.565597] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 13:30:10 juju-e4d256-prod-github-runner-207 kernel: [29184.566753] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 13:30:10 juju-e4d256-prod-github-runner-207 kernel: [29184.567934] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 13:30:10 juju-e4d256-prod-github-runner-207 kernel: [29184.569456] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 13:30:10 juju-e4d256-prod-github-runner-207 kernel: [29184.570634] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 13:30:10 juju-e4d256-prod-github-runner-207 kernel: [29184.571878] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 13:30:10 juju-e4d256-prod-github-runner-207 kernel: [29184.573006] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 13:30:10 juju-e4d256-prod-github-runner-207 kernel: [29184.574223] Call Trace: Aug 22 13:30:10 juju-e4d256-prod-github-runner-207 kernel: [29184.575159] Aug 22 13:30:10 juju-e4d256-prod-github-runner-207 kernel: [29184.576085] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:30:10 juju-e4d256-prod-github-runner-207 kernel: [29184.577157] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:30:10 juju-e4d256-prod-github-runner-207 kernel: [29184.578208] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:30:10 juju-e4d256-prod-github-runner-207 kernel: [29184.579314] ? show_regs.part.0+0x23/0x29 Aug 22 13:30:10 juju-e4d256-prod-github-runner-207 kernel: [29184.580358] ? show_regs.cold+0x8/0xd Aug 22 13:30:10 juju-e4d256-prod-github-runner-207 kernel: [29184.581349] ? watchdog_timer_fn+0x1be/0x220 Aug 22 13:30:10 juju-e4d256-prod-github-runner-207 kernel: [29184.582386] ? lockup_detector_update_enable+0x60/0x60 Aug 22 13:30:10 juju-e4d256-prod-github-runner-207 kernel: [29184.583691] ? __hrtimer_run_queues+0x107/0x230 Aug 22 13:30:10 juju-e4d256-prod-github-runner-207 kernel: [29184.585376] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 13:30:10 juju-e4d256-prod-github-runner-207 kernel: [29184.586827] ? hrtimer_interrupt+0x101/0x220 Aug 22 13:30:10 juju-e4d256-prod-github-runner-207 kernel: [29184.587911] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 13:30:10 juju-e4d256-prod-github-runner-207 kernel: [29184.589120] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 13:30:10 juju-e4d256-prod-github-runner-207 kernel: [29184.590203] Aug 22 13:30:10 juju-e4d256-prod-github-runner-207 kernel: [29184.591071] Aug 22 13:30:10 juju-e4d256-prod-github-runner-207 kernel: [29184.591939] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 13:30:10 juju-e4d256-prod-github-runner-207 kernel: [29184.593041] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:30:10 juju-e4d256-prod-github-runner-207 kernel: [29184.594096] ? _raw_spin_lock+0x22/0x30 Aug 22 13:30:10 juju-e4d256-prod-github-runner-207 kernel: [29184.595054] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:30:10 juju-e4d256-prod-github-runner-207 kernel: [29184.596091] direct_page_fault+0x206/0x310 [kvm] Aug 22 13:30:10 juju-e4d256-prod-github-runner-207 kernel: [29184.597155] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 13:30:10 juju-e4d256-prod-github-runner-207 kernel: [29184.598206] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 13:30:10 juju-e4d256-prod-github-runner-207 kernel: [29184.599233] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 13:30:10 juju-e4d256-prod-github-runner-207 kernel: [29184.600212] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 13:30:10 juju-e4d256-prod-github-runner-207 kernel: [29184.601192] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 13:30:10 juju-e4d256-prod-github-runner-207 kernel: [29184.602178] handle_exit+0x98/0x230 [kvm_amd] Aug 22 13:30:10 juju-e4d256-prod-github-runner-207 kernel: [29184.603076] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 13:30:10 juju-e4d256-prod-github-runner-207 kernel: [29184.604061] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 13:30:10 juju-e4d256-prod-github-runner-207 kernel: [29184.605046] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 13:30:10 juju-e4d256-prod-github-runner-207 kernel: [29184.605961] vcpu_run+0x62/0x2c0 [kvm] Aug 22 13:30:10 juju-e4d256-prod-github-runner-207 kernel: [29184.606968] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 13:30:10 juju-e4d256-prod-github-runner-207 kernel: [29184.607786] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 13:30:10 juju-e4d256-prod-github-runner-207 kernel: [29184.608666] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 13:30:10 juju-e4d256-prod-github-runner-207 kernel: [29184.609478] ? __seccomp_filter+0x4a/0x4a0 Aug 22 13:30:10 juju-e4d256-prod-github-runner-207 kernel: [29184.610231] ? __fget_files+0x86/0xc0 Aug 22 13:30:10 juju-e4d256-prod-github-runner-207 kernel: [29184.610940] __x64_sys_ioctl+0x95/0xd0 Aug 22 13:30:10 juju-e4d256-prod-github-runner-207 kernel: [29184.611644] do_syscall_64+0x5c/0xc0 Aug 22 13:30:10 juju-e4d256-prod-github-runner-207 kernel: [29184.612315] ? do_futex+0x162/0x1f0 Aug 22 13:30:10 juju-e4d256-prod-github-runner-207 kernel: [29184.612997] ? __x64_sys_futex+0x78/0x1e0 Aug 22 13:30:10 juju-e4d256-prod-github-runner-207 kernel: [29184.613865] ? __secure_computing+0xa9/0x120 Aug 22 13:30:10 juju-e4d256-prod-github-runner-207 kernel: [29184.614582] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 13:30:10 juju-e4d256-prod-github-runner-207 kernel: [29184.615390] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:30:10 juju-e4d256-prod-github-runner-207 kernel: [29184.616229] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:30:10 juju-e4d256-prod-github-runner-207 kernel: [29184.617063] ? do_syscall_64+0x69/0xc0 Aug 22 13:30:10 juju-e4d256-prod-github-runner-207 kernel: [29184.617785] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:30:10 juju-e4d256-prod-github-runner-207 kernel: [29184.618586] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:30:10 juju-e4d256-prod-github-runner-207 kernel: [29184.619388] ? do_syscall_64+0x69/0xc0 Aug 22 13:30:10 juju-e4d256-prod-github-runner-207 kernel: [29184.620120] ? do_syscall_64+0x69/0xc0 Aug 22 13:30:10 juju-e4d256-prod-github-runner-207 kernel: [29184.620893] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 13:30:10 juju-e4d256-prod-github-runner-207 kernel: [29184.621704] RIP: 0033:0x7faa5d0edaff Aug 22 13:30:10 juju-e4d256-prod-github-runner-207 kernel: [29184.622404] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 13:30:10 juju-e4d256-prod-github-runner-207 kernel: [29184.624789] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 13:30:10 juju-e4d256-prod-github-runner-207 kernel: [29184.625843] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 13:30:10 juju-e4d256-prod-github-runner-207 kernel: [29184.626894] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 13:30:10 juju-e4d256-prod-github-runner-207 kernel: [29184.627936] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 13:30:10 juju-e4d256-prod-github-runner-207 kernel: [29184.628965] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 13:30:10 juju-e4d256-prod-github-runner-207 kernel: [29184.629985] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 13:30:10 juju-e4d256-prod-github-runner-207 kernel: [29184.631015] Aug 22 13:30:38 juju-e4d256-prod-github-runner-207 kernel: [29212.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 27098s! [qemu-system-x86:6715] Aug 22 13:30:38 juju-e4d256-prod-github-runner-207 kernel: [29212.543121] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 13:30:38 juju-e4d256-prod-github-runner-207 kernel: [29212.543196] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 13:30:38 juju-e4d256-prod-github-runner-207 kernel: [29212.555412] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 13:30:38 juju-e4d256-prod-github-runner-207 kernel: [29212.556690] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 13:30:38 juju-e4d256-prod-github-runner-207 kernel: [29212.557924] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:30:38 juju-e4d256-prod-github-runner-207 kernel: [29212.558980] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 13:30:38 juju-e4d256-prod-github-runner-207 kernel: [29212.561574] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 13:30:38 juju-e4d256-prod-github-runner-207 kernel: [29212.562645] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 13:30:38 juju-e4d256-prod-github-runner-207 kernel: [29212.563972] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 13:30:38 juju-e4d256-prod-github-runner-207 kernel: [29212.565262] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 13:30:38 juju-e4d256-prod-github-runner-207 kernel: [29212.566473] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 13:30:38 juju-e4d256-prod-github-runner-207 kernel: [29212.567644] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 13:30:38 juju-e4d256-prod-github-runner-207 kernel: [29212.568867] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 13:30:38 juju-e4d256-prod-github-runner-207 kernel: [29212.570117] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 13:30:38 juju-e4d256-prod-github-runner-207 kernel: [29212.571238] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 13:30:38 juju-e4d256-prod-github-runner-207 kernel: [29212.572445] Call Trace: Aug 22 13:30:38 juju-e4d256-prod-github-runner-207 kernel: [29212.573358] Aug 22 13:30:38 juju-e4d256-prod-github-runner-207 kernel: [29212.574247] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:30:38 juju-e4d256-prod-github-runner-207 kernel: [29212.575278] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:30:38 juju-e4d256-prod-github-runner-207 kernel: [29212.576308] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:30:38 juju-e4d256-prod-github-runner-207 kernel: [29212.577399] ? show_regs.part.0+0x23/0x29 Aug 22 13:30:38 juju-e4d256-prod-github-runner-207 kernel: [29212.578394] ? show_regs.cold+0x8/0xd Aug 22 13:30:38 juju-e4d256-prod-github-runner-207 kernel: [29212.579363] ? watchdog_timer_fn+0x1be/0x220 Aug 22 13:30:38 juju-e4d256-prod-github-runner-207 kernel: [29212.580408] ? lockup_detector_update_enable+0x60/0x60 Aug 22 13:30:38 juju-e4d256-prod-github-runner-207 kernel: [29212.581476] ? __hrtimer_run_queues+0x107/0x230 Aug 22 13:30:38 juju-e4d256-prod-github-runner-207 kernel: [29212.582507] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 13:30:38 juju-e4d256-prod-github-runner-207 kernel: [29212.583543] ? hrtimer_interrupt+0x101/0x220 Aug 22 13:30:38 juju-e4d256-prod-github-runner-207 kernel: [29212.584576] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 13:30:38 juju-e4d256-prod-github-runner-207 kernel: [29212.585665] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 13:30:38 juju-e4d256-prod-github-runner-207 kernel: [29212.586710] Aug 22 13:30:38 juju-e4d256-prod-github-runner-207 kernel: [29212.587562] Aug 22 13:30:38 juju-e4d256-prod-github-runner-207 kernel: [29212.588406] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 13:30:38 juju-e4d256-prod-github-runner-207 kernel: [29212.589452] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:30:38 juju-e4d256-prod-github-runner-207 kernel: [29212.590501] ? _raw_spin_lock+0x22/0x30 Aug 22 13:30:38 juju-e4d256-prod-github-runner-207 kernel: [29212.591468] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:30:38 juju-e4d256-prod-github-runner-207 kernel: [29212.592508] direct_page_fault+0x206/0x310 [kvm] Aug 22 13:30:38 juju-e4d256-prod-github-runner-207 kernel: [29212.593534] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 13:30:38 juju-e4d256-prod-github-runner-207 kernel: [29212.594551] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 13:30:38 juju-e4d256-prod-github-runner-207 kernel: [29212.595590] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 13:30:38 juju-e4d256-prod-github-runner-207 kernel: [29212.596599] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 13:30:38 juju-e4d256-prod-github-runner-207 kernel: [29212.597666] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 13:30:38 juju-e4d256-prod-github-runner-207 kernel: [29212.598710] handle_exit+0x98/0x230 [kvm_amd] Aug 22 13:30:38 juju-e4d256-prod-github-runner-207 kernel: [29212.599615] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 13:30:38 juju-e4d256-prod-github-runner-207 kernel: [29212.600546] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 13:30:38 juju-e4d256-prod-github-runner-207 kernel: [29212.601475] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 13:30:38 juju-e4d256-prod-github-runner-207 kernel: [29212.602377] vcpu_run+0x62/0x2c0 [kvm] Aug 22 13:30:38 juju-e4d256-prod-github-runner-207 kernel: [29212.603184] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 13:30:38 juju-e4d256-prod-github-runner-207 kernel: [29212.604007] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 13:30:38 juju-e4d256-prod-github-runner-207 kernel: [29212.604860] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 13:30:38 juju-e4d256-prod-github-runner-207 kernel: [29212.605656] ? __seccomp_filter+0x4a/0x4a0 Aug 22 13:30:38 juju-e4d256-prod-github-runner-207 kernel: [29212.606401] ? __fget_files+0x86/0xc0 Aug 22 13:30:38 juju-e4d256-prod-github-runner-207 kernel: [29212.607115] __x64_sys_ioctl+0x95/0xd0 Aug 22 13:30:38 juju-e4d256-prod-github-runner-207 kernel: [29212.607811] do_syscall_64+0x5c/0xc0 Aug 22 13:30:38 juju-e4d256-prod-github-runner-207 kernel: [29212.608495] ? do_futex+0x162/0x1f0 Aug 22 13:30:38 juju-e4d256-prod-github-runner-207 kernel: [29212.609145] ? __x64_sys_futex+0x78/0x1e0 Aug 22 13:30:38 juju-e4d256-prod-github-runner-207 kernel: [29212.609825] ? __secure_computing+0xa9/0x120 Aug 22 13:30:38 juju-e4d256-prod-github-runner-207 kernel: [29212.610513] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 13:30:38 juju-e4d256-prod-github-runner-207 kernel: [29212.611274] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:30:38 juju-e4d256-prod-github-runner-207 kernel: [29212.612012] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:30:38 juju-e4d256-prod-github-runner-207 kernel: [29212.612731] ? do_syscall_64+0x69/0xc0 Aug 22 13:30:38 juju-e4d256-prod-github-runner-207 kernel: [29212.613375] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:30:38 juju-e4d256-prod-github-runner-207 kernel: [29212.614081] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:30:38 juju-e4d256-prod-github-runner-207 kernel: [29212.614780] ? do_syscall_64+0x69/0xc0 Aug 22 13:30:38 juju-e4d256-prod-github-runner-207 kernel: [29212.615404] ? do_syscall_64+0x69/0xc0 Aug 22 13:30:38 juju-e4d256-prod-github-runner-207 kernel: [29212.616033] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 13:30:38 juju-e4d256-prod-github-runner-207 kernel: [29212.616737] RIP: 0033:0x7faa5d0edaff Aug 22 13:30:38 juju-e4d256-prod-github-runner-207 kernel: [29212.617375] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 13:30:38 juju-e4d256-prod-github-runner-207 kernel: [29212.619382] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 13:30:38 juju-e4d256-prod-github-runner-207 kernel: [29212.620315] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 13:30:38 juju-e4d256-prod-github-runner-207 kernel: [29212.621225] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 13:30:38 juju-e4d256-prod-github-runner-207 kernel: [29212.622124] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 13:30:38 juju-e4d256-prod-github-runner-207 kernel: [29212.623017] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 13:30:38 juju-e4d256-prod-github-runner-207 kernel: [29212.623912] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 13:30:38 juju-e4d256-prod-github-runner-207 kernel: [29212.624824] Aug 22 13:31:06 juju-e4d256-prod-github-runner-207 kernel: [29240.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 27124s! [qemu-system-x86:6715] Aug 22 13:31:06 juju-e4d256-prod-github-runner-207 kernel: [29240.543909] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 13:31:06 juju-e4d256-prod-github-runner-207 kernel: [29240.544244] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 13:31:06 juju-e4d256-prod-github-runner-207 kernel: [29240.556745] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 13:31:06 juju-e4d256-prod-github-runner-207 kernel: [29240.558029] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 13:31:06 juju-e4d256-prod-github-runner-207 kernel: [29240.559251] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:31:06 juju-e4d256-prod-github-runner-207 kernel: [29240.560354] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 13:31:06 juju-e4d256-prod-github-runner-207 kernel: [29240.562987] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 13:31:06 juju-e4d256-prod-github-runner-207 kernel: [29240.564075] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 13:31:06 juju-e4d256-prod-github-runner-207 kernel: [29240.565272] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 13:31:06 juju-e4d256-prod-github-runner-207 kernel: [29240.566465] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 13:31:06 juju-e4d256-prod-github-runner-207 kernel: [29240.567663] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 13:31:06 juju-e4d256-prod-github-runner-207 kernel: [29240.568836] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 13:31:06 juju-e4d256-prod-github-runner-207 kernel: [29240.570018] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 13:31:06 juju-e4d256-prod-github-runner-207 kernel: [29240.571534] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 13:31:06 juju-e4d256-prod-github-runner-207 kernel: [29240.572668] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 13:31:06 juju-e4d256-prod-github-runner-207 kernel: [29240.573877] Call Trace: Aug 22 13:31:06 juju-e4d256-prod-github-runner-207 kernel: [29240.574796] Aug 22 13:31:06 juju-e4d256-prod-github-runner-207 kernel: [29240.575744] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:31:06 juju-e4d256-prod-github-runner-207 kernel: [29240.576794] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:31:06 juju-e4d256-prod-github-runner-207 kernel: [29240.577819] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:31:06 juju-e4d256-prod-github-runner-207 kernel: [29240.578922] ? show_regs.part.0+0x23/0x29 Aug 22 13:31:06 juju-e4d256-prod-github-runner-207 kernel: [29240.579942] ? show_regs.cold+0x8/0xd Aug 22 13:31:06 juju-e4d256-prod-github-runner-207 kernel: [29240.580938] ? watchdog_timer_fn+0x1be/0x220 Aug 22 13:31:06 juju-e4d256-prod-github-runner-207 kernel: [29240.581967] ? lockup_detector_update_enable+0x60/0x60 Aug 22 13:31:06 juju-e4d256-prod-github-runner-207 kernel: [29240.583034] ? __hrtimer_run_queues+0x107/0x230 Aug 22 13:31:06 juju-e4d256-prod-github-runner-207 kernel: [29240.584098] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 13:31:06 juju-e4d256-prod-github-runner-207 kernel: [29240.585194] ? hrtimer_interrupt+0x101/0x220 Aug 22 13:31:06 juju-e4d256-prod-github-runner-207 kernel: [29240.586267] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 13:31:06 juju-e4d256-prod-github-runner-207 kernel: [29240.587550] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 13:31:06 juju-e4d256-prod-github-runner-207 kernel: [29240.588973] Aug 22 13:31:06 juju-e4d256-prod-github-runner-207 kernel: [29240.589879] Aug 22 13:31:06 juju-e4d256-prod-github-runner-207 kernel: [29240.590731] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 13:31:06 juju-e4d256-prod-github-runner-207 kernel: [29240.591834] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:31:06 juju-e4d256-prod-github-runner-207 kernel: [29240.592883] ? _raw_spin_lock+0x22/0x30 Aug 22 13:31:06 juju-e4d256-prod-github-runner-207 kernel: [29240.593847] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:31:06 juju-e4d256-prod-github-runner-207 kernel: [29240.594879] direct_page_fault+0x206/0x310 [kvm] Aug 22 13:31:06 juju-e4d256-prod-github-runner-207 kernel: [29240.595929] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 13:31:06 juju-e4d256-prod-github-runner-207 kernel: [29240.596954] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 13:31:06 juju-e4d256-prod-github-runner-207 kernel: [29240.597970] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 13:31:06 juju-e4d256-prod-github-runner-207 kernel: [29240.598992] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 13:31:06 juju-e4d256-prod-github-runner-207 kernel: [29240.599976] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 13:31:06 juju-e4d256-prod-github-runner-207 kernel: [29240.600969] handle_exit+0x98/0x230 [kvm_amd] Aug 22 13:31:06 juju-e4d256-prod-github-runner-207 kernel: [29240.601922] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 13:31:06 juju-e4d256-prod-github-runner-207 kernel: [29240.602853] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 13:31:06 juju-e4d256-prod-github-runner-207 kernel: [29240.603875] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 13:31:06 juju-e4d256-prod-github-runner-207 kernel: [29240.604801] vcpu_run+0x62/0x2c0 [kvm] Aug 22 13:31:06 juju-e4d256-prod-github-runner-207 kernel: [29240.605629] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 13:31:06 juju-e4d256-prod-github-runner-207 kernel: [29240.606464] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 13:31:06 juju-e4d256-prod-github-runner-207 kernel: [29240.607347] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 13:31:06 juju-e4d256-prod-github-runner-207 kernel: [29240.608192] ? __seccomp_filter+0x4a/0x4a0 Aug 22 13:31:06 juju-e4d256-prod-github-runner-207 kernel: [29240.608942] ? __fget_files+0x86/0xc0 Aug 22 13:31:06 juju-e4d256-prod-github-runner-207 kernel: [29240.609658] __x64_sys_ioctl+0x95/0xd0 Aug 22 13:31:06 juju-e4d256-prod-github-runner-207 kernel: [29240.610359] do_syscall_64+0x5c/0xc0 Aug 22 13:31:06 juju-e4d256-prod-github-runner-207 kernel: [29240.611089] ? do_futex+0x162/0x1f0 Aug 22 13:31:06 juju-e4d256-prod-github-runner-207 kernel: [29240.611791] ? __x64_sys_futex+0x78/0x1e0 Aug 22 13:31:06 juju-e4d256-prod-github-runner-207 kernel: [29240.612536] ? __secure_computing+0xa9/0x120 Aug 22 13:31:06 juju-e4d256-prod-github-runner-207 kernel: [29240.613234] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 13:31:06 juju-e4d256-prod-github-runner-207 kernel: [29240.613999] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:31:06 juju-e4d256-prod-github-runner-207 kernel: [29240.614725] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:31:06 juju-e4d256-prod-github-runner-207 kernel: [29240.615453] ? do_syscall_64+0x69/0xc0 Aug 22 13:31:06 juju-e4d256-prod-github-runner-207 kernel: [29240.616149] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:31:06 juju-e4d256-prod-github-runner-207 kernel: [29240.616857] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:31:06 juju-e4d256-prod-github-runner-207 kernel: [29240.617565] ? do_syscall_64+0x69/0xc0 Aug 22 13:31:06 juju-e4d256-prod-github-runner-207 kernel: [29240.618198] ? do_syscall_64+0x69/0xc0 Aug 22 13:31:06 juju-e4d256-prod-github-runner-207 kernel: [29240.618840] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 13:31:06 juju-e4d256-prod-github-runner-207 kernel: [29240.619568] RIP: 0033:0x7faa5d0edaff Aug 22 13:31:06 juju-e4d256-prod-github-runner-207 kernel: [29240.620267] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 13:31:06 juju-e4d256-prod-github-runner-207 kernel: [29240.622294] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 13:31:06 juju-e4d256-prod-github-runner-207 kernel: [29240.623213] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 13:31:06 juju-e4d256-prod-github-runner-207 kernel: [29240.624129] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 13:31:06 juju-e4d256-prod-github-runner-207 kernel: [29240.625033] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 13:31:06 juju-e4d256-prod-github-runner-207 kernel: [29240.625927] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 13:31:06 juju-e4d256-prod-github-runner-207 kernel: [29240.626826] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 13:31:06 juju-e4d256-prod-github-runner-207 kernel: [29240.627756] Aug 22 13:31:34 juju-e4d256-prod-github-runner-207 kernel: [29268.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 27150s! [qemu-system-x86:6715] Aug 22 13:31:34 juju-e4d256-prod-github-runner-207 kernel: [29268.543137] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 13:31:34 juju-e4d256-prod-github-runner-207 kernel: [29268.543214] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 13:31:34 juju-e4d256-prod-github-runner-207 kernel: [29268.556102] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 13:31:34 juju-e4d256-prod-github-runner-207 kernel: [29268.557422] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 13:31:34 juju-e4d256-prod-github-runner-207 kernel: [29268.558670] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:31:34 juju-e4d256-prod-github-runner-207 kernel: [29268.559750] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 13:31:34 juju-e4d256-prod-github-runner-207 kernel: [29268.562329] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 13:31:34 juju-e4d256-prod-github-runner-207 kernel: [29268.563404] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 13:31:34 juju-e4d256-prod-github-runner-207 kernel: [29268.564563] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 13:31:34 juju-e4d256-prod-github-runner-207 kernel: [29268.565730] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 13:31:34 juju-e4d256-prod-github-runner-207 kernel: [29268.566885] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 13:31:34 juju-e4d256-prod-github-runner-207 kernel: [29268.568059] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 13:31:34 juju-e4d256-prod-github-runner-207 kernel: [29268.569222] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 13:31:34 juju-e4d256-prod-github-runner-207 kernel: [29268.570460] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 13:31:34 juju-e4d256-prod-github-runner-207 kernel: [29268.571578] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 13:31:34 juju-e4d256-prod-github-runner-207 kernel: [29268.572783] Call Trace: Aug 22 13:31:34 juju-e4d256-prod-github-runner-207 kernel: [29268.573693] Aug 22 13:31:34 juju-e4d256-prod-github-runner-207 kernel: [29268.574581] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:31:34 juju-e4d256-prod-github-runner-207 kernel: [29268.575635] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:31:34 juju-e4d256-prod-github-runner-207 kernel: [29268.576671] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:31:34 juju-e4d256-prod-github-runner-207 kernel: [29268.577751] ? show_regs.part.0+0x23/0x29 Aug 22 13:31:34 juju-e4d256-prod-github-runner-207 kernel: [29268.578746] ? show_regs.cold+0x8/0xd Aug 22 13:31:34 juju-e4d256-prod-github-runner-207 kernel: [29268.579733] ? watchdog_timer_fn+0x1be/0x220 Aug 22 13:31:34 juju-e4d256-prod-github-runner-207 kernel: [29268.580759] ? lockup_detector_update_enable+0x60/0x60 Aug 22 13:31:34 juju-e4d256-prod-github-runner-207 kernel: [29268.581830] ? __hrtimer_run_queues+0x107/0x230 Aug 22 13:31:34 juju-e4d256-prod-github-runner-207 kernel: [29268.582885] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 13:31:34 juju-e4d256-prod-github-runner-207 kernel: [29268.583924] ? hrtimer_interrupt+0x101/0x220 Aug 22 13:31:34 juju-e4d256-prod-github-runner-207 kernel: [29268.584940] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 13:31:34 juju-e4d256-prod-github-runner-207 kernel: [29268.586008] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 13:31:34 juju-e4d256-prod-github-runner-207 kernel: [29268.587060] Aug 22 13:31:34 juju-e4d256-prod-github-runner-207 kernel: [29268.587933] Aug 22 13:31:34 juju-e4d256-prod-github-runner-207 kernel: [29268.588789] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 13:31:34 juju-e4d256-prod-github-runner-207 kernel: [29268.589825] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:31:34 juju-e4d256-prod-github-runner-207 kernel: [29268.590886] ? _raw_spin_lock+0x22/0x30 Aug 22 13:31:34 juju-e4d256-prod-github-runner-207 kernel: [29268.591839] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:31:34 juju-e4d256-prod-github-runner-207 kernel: [29268.592859] direct_page_fault+0x206/0x310 [kvm] Aug 22 13:31:34 juju-e4d256-prod-github-runner-207 kernel: [29268.593887] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 13:31:34 juju-e4d256-prod-github-runner-207 kernel: [29268.594895] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 13:31:34 juju-e4d256-prod-github-runner-207 kernel: [29268.595903] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 13:31:34 juju-e4d256-prod-github-runner-207 kernel: [29268.596878] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 13:31:34 juju-e4d256-prod-github-runner-207 kernel: [29268.597827] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 13:31:34 juju-e4d256-prod-github-runner-207 kernel: [29268.598807] handle_exit+0x98/0x230 [kvm_amd] Aug 22 13:31:34 juju-e4d256-prod-github-runner-207 kernel: [29268.599728] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 13:31:34 juju-e4d256-prod-github-runner-207 kernel: [29268.600643] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 13:31:34 juju-e4d256-prod-github-runner-207 kernel: [29268.601567] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 13:31:34 juju-e4d256-prod-github-runner-207 kernel: [29268.602468] vcpu_run+0x62/0x2c0 [kvm] Aug 22 13:31:34 juju-e4d256-prod-github-runner-207 kernel: [29268.603277] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 13:31:34 juju-e4d256-prod-github-runner-207 kernel: [29268.604098] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 13:31:34 juju-e4d256-prod-github-runner-207 kernel: [29268.604951] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 13:31:34 juju-e4d256-prod-github-runner-207 kernel: [29268.605748] ? __seccomp_filter+0x4a/0x4a0 Aug 22 13:31:34 juju-e4d256-prod-github-runner-207 kernel: [29268.606489] ? __fget_files+0x86/0xc0 Aug 22 13:31:34 juju-e4d256-prod-github-runner-207 kernel: [29268.607336] __x64_sys_ioctl+0x95/0xd0 Aug 22 13:31:34 juju-e4d256-prod-github-runner-207 kernel: [29268.608227] do_syscall_64+0x5c/0xc0 Aug 22 13:31:34 juju-e4d256-prod-github-runner-207 kernel: [29268.608893] ? do_futex+0x162/0x1f0 Aug 22 13:31:34 juju-e4d256-prod-github-runner-207 kernel: [29268.609539] ? __x64_sys_futex+0x78/0x1e0 Aug 22 13:31:34 juju-e4d256-prod-github-runner-207 kernel: [29268.610216] ? __secure_computing+0xa9/0x120 Aug 22 13:31:34 juju-e4d256-prod-github-runner-207 kernel: [29268.610922] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 13:31:34 juju-e4d256-prod-github-runner-207 kernel: [29268.611698] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:31:34 juju-e4d256-prod-github-runner-207 kernel: [29268.612423] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:31:34 juju-e4d256-prod-github-runner-207 kernel: [29268.613142] ? do_syscall_64+0x69/0xc0 Aug 22 13:31:34 juju-e4d256-prod-github-runner-207 kernel: [29268.613789] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:31:34 juju-e4d256-prod-github-runner-207 kernel: [29268.614502] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:31:34 juju-e4d256-prod-github-runner-207 kernel: [29268.615203] ? do_syscall_64+0x69/0xc0 Aug 22 13:31:34 juju-e4d256-prod-github-runner-207 kernel: [29268.615848] ? do_syscall_64+0x69/0xc0 Aug 22 13:31:34 juju-e4d256-prod-github-runner-207 kernel: [29268.616474] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 13:31:34 juju-e4d256-prod-github-runner-207 kernel: [29268.617183] RIP: 0033:0x7faa5d0edaff Aug 22 13:31:34 juju-e4d256-prod-github-runner-207 kernel: [29268.617854] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 13:31:34 juju-e4d256-prod-github-runner-207 kernel: [29268.619854] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 13:31:34 juju-e4d256-prod-github-runner-207 kernel: [29268.620762] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 13:31:34 juju-e4d256-prod-github-runner-207 kernel: [29268.621655] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 13:31:34 juju-e4d256-prod-github-runner-207 kernel: [29268.622577] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 13:31:34 juju-e4d256-prod-github-runner-207 kernel: [29268.623480] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 13:31:34 juju-e4d256-prod-github-runner-207 kernel: [29268.624370] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 13:31:34 juju-e4d256-prod-github-runner-207 kernel: [29268.625271] Aug 22 13:32:02 juju-e4d256-prod-github-runner-207 kernel: [29296.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 27176s! [qemu-system-x86:6715] Aug 22 13:32:02 juju-e4d256-prod-github-runner-207 kernel: [29296.543180] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 13:32:02 juju-e4d256-prod-github-runner-207 kernel: [29296.543263] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 13:32:02 juju-e4d256-prod-github-runner-207 kernel: [29296.559851] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 13:32:02 juju-e4d256-prod-github-runner-207 kernel: [29296.561543] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 13:32:02 juju-e4d256-prod-github-runner-207 kernel: [29296.563270] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:32:02 juju-e4d256-prod-github-runner-207 kernel: [29296.564770] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 13:32:02 juju-e4d256-prod-github-runner-207 kernel: [29296.568365] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 13:32:02 juju-e4d256-prod-github-runner-207 kernel: [29296.569805] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 13:32:02 juju-e4d256-prod-github-runner-207 kernel: [29296.571430] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 13:32:02 juju-e4d256-prod-github-runner-207 kernel: [29296.573003] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 13:32:02 juju-e4d256-prod-github-runner-207 kernel: [29296.574627] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 13:32:02 juju-e4d256-prod-github-runner-207 kernel: [29296.576238] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 13:32:02 juju-e4d256-prod-github-runner-207 kernel: [29296.577831] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 13:32:02 juju-e4d256-prod-github-runner-207 kernel: [29296.579524] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 13:32:02 juju-e4d256-prod-github-runner-207 kernel: [29296.581042] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 13:32:02 juju-e4d256-prod-github-runner-207 kernel: [29296.582339] Call Trace: Aug 22 13:32:02 juju-e4d256-prod-github-runner-207 kernel: [29296.583298] Aug 22 13:32:02 juju-e4d256-prod-github-runner-207 kernel: [29296.584187] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:32:02 juju-e4d256-prod-github-runner-207 kernel: [29296.585221] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:32:02 juju-e4d256-prod-github-runner-207 kernel: [29296.586281] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:32:02 juju-e4d256-prod-github-runner-207 kernel: [29296.587648] ? show_regs.part.0+0x23/0x29 Aug 22 13:32:02 juju-e4d256-prod-github-runner-207 kernel: [29296.589255] ? show_regs.cold+0x8/0xd Aug 22 13:32:02 juju-e4d256-prod-github-runner-207 kernel: [29296.590819] ? watchdog_timer_fn+0x1be/0x220 Aug 22 13:32:02 juju-e4d256-prod-github-runner-207 kernel: [29296.591994] ? lockup_detector_update_enable+0x60/0x60 Aug 22 13:32:02 juju-e4d256-prod-github-runner-207 kernel: [29296.593086] ? __hrtimer_run_queues+0x107/0x230 Aug 22 13:32:02 juju-e4d256-prod-github-runner-207 kernel: [29296.594144] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 13:32:02 juju-e4d256-prod-github-runner-207 kernel: [29296.595196] ? hrtimer_interrupt+0x101/0x220 Aug 22 13:32:02 juju-e4d256-prod-github-runner-207 kernel: [29296.596218] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 13:32:02 juju-e4d256-prod-github-runner-207 kernel: [29296.597292] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 13:32:02 juju-e4d256-prod-github-runner-207 kernel: [29296.598374] Aug 22 13:32:02 juju-e4d256-prod-github-runner-207 kernel: [29296.599267] Aug 22 13:32:02 juju-e4d256-prod-github-runner-207 kernel: [29296.600111] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 13:32:02 juju-e4d256-prod-github-runner-207 kernel: [29296.601154] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:32:02 juju-e4d256-prod-github-runner-207 kernel: [29296.602203] ? _raw_spin_lock+0x22/0x30 Aug 22 13:32:02 juju-e4d256-prod-github-runner-207 kernel: [29296.603178] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:32:02 juju-e4d256-prod-github-runner-207 kernel: [29296.604217] direct_page_fault+0x206/0x310 [kvm] Aug 22 13:32:02 juju-e4d256-prod-github-runner-207 kernel: [29296.605250] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 13:32:02 juju-e4d256-prod-github-runner-207 kernel: [29296.606272] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 13:32:02 juju-e4d256-prod-github-runner-207 kernel: [29296.607295] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 13:32:02 juju-e4d256-prod-github-runner-207 kernel: [29296.608278] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 13:32:02 juju-e4d256-prod-github-runner-207 kernel: [29296.609237] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 13:32:02 juju-e4d256-prod-github-runner-207 kernel: [29296.610223] handle_exit+0x98/0x230 [kvm_amd] Aug 22 13:32:02 juju-e4d256-prod-github-runner-207 kernel: [29296.611130] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 13:32:02 juju-e4d256-prod-github-runner-207 kernel: [29296.612192] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 13:32:02 juju-e4d256-prod-github-runner-207 kernel: [29296.613122] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 13:32:02 juju-e4d256-prod-github-runner-207 kernel: [29296.614027] vcpu_run+0x62/0x2c0 [kvm] Aug 22 13:32:02 juju-e4d256-prod-github-runner-207 kernel: [29296.614865] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 13:32:02 juju-e4d256-prod-github-runner-207 kernel: [29296.615965] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 13:32:02 juju-e4d256-prod-github-runner-207 kernel: [29296.617133] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 13:32:02 juju-e4d256-prod-github-runner-207 kernel: [29296.618212] ? __seccomp_filter+0x4a/0x4a0 Aug 22 13:32:02 juju-e4d256-prod-github-runner-207 kernel: [29296.619223] ? __fget_files+0x86/0xc0 Aug 22 13:32:02 juju-e4d256-prod-github-runner-207 kernel: [29296.620193] __x64_sys_ioctl+0x95/0xd0 Aug 22 13:32:02 juju-e4d256-prod-github-runner-207 kernel: [29296.621142] do_syscall_64+0x5c/0xc0 Aug 22 13:32:02 juju-e4d256-prod-github-runner-207 kernel: [29296.622242] ? do_futex+0x162/0x1f0 Aug 22 13:32:02 juju-e4d256-prod-github-runner-207 kernel: [29296.623160] ? __x64_sys_futex+0x78/0x1e0 Aug 22 13:32:02 juju-e4d256-prod-github-runner-207 kernel: [29296.624074] ? __secure_computing+0xa9/0x120 Aug 22 13:32:02 juju-e4d256-prod-github-runner-207 kernel: [29296.625040] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 13:32:02 juju-e4d256-prod-github-runner-207 kernel: [29296.626061] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:32:02 juju-e4d256-prod-github-runner-207 kernel: [29296.627074] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:32:02 juju-e4d256-prod-github-runner-207 kernel: [29296.628073] ? do_syscall_64+0x69/0xc0 Aug 22 13:32:02 juju-e4d256-prod-github-runner-207 kernel: [29296.628973] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:32:02 juju-e4d256-prod-github-runner-207 kernel: [29296.629935] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:32:02 juju-e4d256-prod-github-runner-207 kernel: [29296.630901] ? do_syscall_64+0x69/0xc0 Aug 22 13:32:02 juju-e4d256-prod-github-runner-207 kernel: [29296.631771] ? do_syscall_64+0x69/0xc0 Aug 22 13:32:02 juju-e4d256-prod-github-runner-207 kernel: [29296.632650] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 13:32:02 juju-e4d256-prod-github-runner-207 kernel: [29296.633625] RIP: 0033:0x7faa5d0edaff Aug 22 13:32:02 juju-e4d256-prod-github-runner-207 kernel: [29296.634447] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 13:32:02 juju-e4d256-prod-github-runner-207 kernel: [29296.637176] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 13:32:02 juju-e4d256-prod-github-runner-207 kernel: [29296.638433] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 13:32:02 juju-e4d256-prod-github-runner-207 kernel: [29296.639672] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 13:32:02 juju-e4d256-prod-github-runner-207 kernel: [29296.640705] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 13:32:02 juju-e4d256-prod-github-runner-207 kernel: [29296.641637] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 13:32:02 juju-e4d256-prod-github-runner-207 kernel: [29296.642543] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 13:32:02 juju-e4d256-prod-github-runner-207 kernel: [29296.643485] Aug 22 13:32:30 juju-e4d256-prod-github-runner-207 kernel: [29324.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 27202s! [qemu-system-x86:6715] Aug 22 13:32:30 juju-e4d256-prod-github-runner-207 kernel: [29324.543865] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 13:32:30 juju-e4d256-prod-github-runner-207 kernel: [29324.544156] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 13:32:30 juju-e4d256-prod-github-runner-207 kernel: [29324.556796] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 13:32:30 juju-e4d256-prod-github-runner-207 kernel: [29324.558060] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 13:32:30 juju-e4d256-prod-github-runner-207 kernel: [29324.559290] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:32:30 juju-e4d256-prod-github-runner-207 kernel: [29324.560351] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 13:32:30 juju-e4d256-prod-github-runner-207 kernel: [29324.562933] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 13:32:30 juju-e4d256-prod-github-runner-207 kernel: [29324.563993] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 13:32:30 juju-e4d256-prod-github-runner-207 kernel: [29324.565154] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 13:32:30 juju-e4d256-prod-github-runner-207 kernel: [29324.566314] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 13:32:30 juju-e4d256-prod-github-runner-207 kernel: [29324.567551] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 13:32:30 juju-e4d256-prod-github-runner-207 kernel: [29324.568736] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 13:32:30 juju-e4d256-prod-github-runner-207 kernel: [29324.569903] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 13:32:30 juju-e4d256-prod-github-runner-207 kernel: [29324.571145] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 13:32:30 juju-e4d256-prod-github-runner-207 kernel: [29324.572255] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 13:32:30 juju-e4d256-prod-github-runner-207 kernel: [29324.573462] Call Trace: Aug 22 13:32:30 juju-e4d256-prod-github-runner-207 kernel: [29324.574392] Aug 22 13:32:30 juju-e4d256-prod-github-runner-207 kernel: [29324.575324] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:32:30 juju-e4d256-prod-github-runner-207 kernel: [29324.576366] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:32:30 juju-e4d256-prod-github-runner-207 kernel: [29324.577518] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:32:30 juju-e4d256-prod-github-runner-207 kernel: [29324.578840] ? show_regs.part.0+0x23/0x29 Aug 22 13:32:30 juju-e4d256-prod-github-runner-207 kernel: [29324.579858] ? show_regs.cold+0x8/0xd Aug 22 13:32:30 juju-e4d256-prod-github-runner-207 kernel: [29324.580840] ? watchdog_timer_fn+0x1be/0x220 Aug 22 13:32:30 juju-e4d256-prod-github-runner-207 kernel: [29324.581899] ? lockup_detector_update_enable+0x60/0x60 Aug 22 13:32:30 juju-e4d256-prod-github-runner-207 kernel: [29324.582996] ? __hrtimer_run_queues+0x107/0x230 Aug 22 13:32:30 juju-e4d256-prod-github-runner-207 kernel: [29324.584034] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 13:32:30 juju-e4d256-prod-github-runner-207 kernel: [29324.585061] ? hrtimer_interrupt+0x101/0x220 Aug 22 13:32:30 juju-e4d256-prod-github-runner-207 kernel: [29324.586079] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 13:32:30 juju-e4d256-prod-github-runner-207 kernel: [29324.587163] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 13:32:30 juju-e4d256-prod-github-runner-207 kernel: [29324.588212] Aug 22 13:32:30 juju-e4d256-prod-github-runner-207 kernel: [29324.589069] Aug 22 13:32:30 juju-e4d256-prod-github-runner-207 kernel: [29324.589908] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 13:32:30 juju-e4d256-prod-github-runner-207 kernel: [29324.590953] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:32:30 juju-e4d256-prod-github-runner-207 kernel: [29324.591999] ? _raw_spin_lock+0x22/0x30 Aug 22 13:32:30 juju-e4d256-prod-github-runner-207 kernel: [29324.592945] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:32:30 juju-e4d256-prod-github-runner-207 kernel: [29324.593966] direct_page_fault+0x206/0x310 [kvm] Aug 22 13:32:30 juju-e4d256-prod-github-runner-207 kernel: [29324.595005] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 13:32:30 juju-e4d256-prod-github-runner-207 kernel: [29324.596016] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 13:32:30 juju-e4d256-prod-github-runner-207 kernel: [29324.597016] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 13:32:30 juju-e4d256-prod-github-runner-207 kernel: [29324.598033] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 13:32:30 juju-e4d256-prod-github-runner-207 kernel: [29324.598989] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 13:32:30 juju-e4d256-prod-github-runner-207 kernel: [29324.599975] handle_exit+0x98/0x230 [kvm_amd] Aug 22 13:32:30 juju-e4d256-prod-github-runner-207 kernel: [29324.600868] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 13:32:30 juju-e4d256-prod-github-runner-207 kernel: [29324.601786] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 13:32:30 juju-e4d256-prod-github-runner-207 kernel: [29324.602724] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 13:32:30 juju-e4d256-prod-github-runner-207 kernel: [29324.603632] vcpu_run+0x62/0x2c0 [kvm] Aug 22 13:32:30 juju-e4d256-prod-github-runner-207 kernel: [29324.604457] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 13:32:30 juju-e4d256-prod-github-runner-207 kernel: [29324.605274] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 13:32:30 juju-e4d256-prod-github-runner-207 kernel: [29324.606135] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 13:32:30 juju-e4d256-prod-github-runner-207 kernel: [29324.606953] ? __seccomp_filter+0x4a/0x4a0 Aug 22 13:32:30 juju-e4d256-prod-github-runner-207 kernel: [29324.607701] ? __fget_files+0x86/0xc0 Aug 22 13:32:30 juju-e4d256-prod-github-runner-207 kernel: [29324.608435] __x64_sys_ioctl+0x95/0xd0 Aug 22 13:32:30 juju-e4d256-prod-github-runner-207 kernel: [29324.609146] do_syscall_64+0x5c/0xc0 Aug 22 13:32:30 juju-e4d256-prod-github-runner-207 kernel: [29324.609814] ? do_futex+0x162/0x1f0 Aug 22 13:32:30 juju-e4d256-prod-github-runner-207 kernel: [29324.610462] ? __x64_sys_futex+0x78/0x1e0 Aug 22 13:32:30 juju-e4d256-prod-github-runner-207 kernel: [29324.611159] ? __secure_computing+0xa9/0x120 Aug 22 13:32:30 juju-e4d256-prod-github-runner-207 kernel: [29324.611859] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 13:32:30 juju-e4d256-prod-github-runner-207 kernel: [29324.612624] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:32:30 juju-e4d256-prod-github-runner-207 kernel: [29324.613355] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:32:30 juju-e4d256-prod-github-runner-207 kernel: [29324.614079] ? do_syscall_64+0x69/0xc0 Aug 22 13:32:30 juju-e4d256-prod-github-runner-207 kernel: [29324.614749] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:32:30 juju-e4d256-prod-github-runner-207 kernel: [29324.615460] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:32:30 juju-e4d256-prod-github-runner-207 kernel: [29324.616159] ? do_syscall_64+0x69/0xc0 Aug 22 13:32:30 juju-e4d256-prod-github-runner-207 kernel: [29324.616811] ? do_syscall_64+0x69/0xc0 Aug 22 13:32:30 juju-e4d256-prod-github-runner-207 kernel: [29324.617438] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 13:32:30 juju-e4d256-prod-github-runner-207 kernel: [29324.618338] RIP: 0033:0x7faa5d0edaff Aug 22 13:32:30 juju-e4d256-prod-github-runner-207 kernel: [29324.619111] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 13:32:30 juju-e4d256-prod-github-runner-207 kernel: [29324.621462] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 13:32:30 juju-e4d256-prod-github-runner-207 kernel: [29324.622529] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 13:32:30 juju-e4d256-prod-github-runner-207 kernel: [29324.623576] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 13:32:30 juju-e4d256-prod-github-runner-207 kernel: [29324.624606] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 13:32:30 juju-e4d256-prod-github-runner-207 kernel: [29324.625635] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 13:32:30 juju-e4d256-prod-github-runner-207 kernel: [29324.626683] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 13:32:30 juju-e4d256-prod-github-runner-207 kernel: [29324.627744] Aug 22 13:32:45 juju-e4d256-prod-github-runner-207 kernel: [29339.144714] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 13:32:45 juju-e4d256-prod-github-runner-207 kernel: [29339.145678] rcu: 1-....: (7282673 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=3519620 Aug 22 13:32:45 juju-e4d256-prod-github-runner-207 kernel: [29339.146823] (t=7305486 jiffies g=23269 q=32929) Aug 22 13:32:45 juju-e4d256-prod-github-runner-207 kernel: [29339.147610] NMI backtrace for cpu 1 Aug 22 13:32:45 juju-e4d256-prod-github-runner-207 kernel: [29339.148340] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 13:32:45 juju-e4d256-prod-github-runner-207 kernel: [29339.149465] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 13:32:45 juju-e4d256-prod-github-runner-207 kernel: [29339.150549] Call Trace: Aug 22 13:32:45 juju-e4d256-prod-github-runner-207 kernel: [29339.151223] Aug 22 13:32:45 juju-e4d256-prod-github-runner-207 kernel: [29339.151867] show_stack+0x52/0x5c Aug 22 13:32:45 juju-e4d256-prod-github-runner-207 kernel: [29339.152589] dump_stack_lvl+0x4a/0x63 Aug 22 13:32:45 juju-e4d256-prod-github-runner-207 kernel: [29339.153333] dump_stack+0x10/0x16 Aug 22 13:32:45 juju-e4d256-prod-github-runner-207 kernel: [29339.154054] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 13:32:45 juju-e4d256-prod-github-runner-207 kernel: [29339.154844] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 13:32:45 juju-e4d256-prod-github-runner-207 kernel: [29339.155623] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 13:32:45 juju-e4d256-prod-github-runner-207 kernel: [29339.156442] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 13:32:45 juju-e4d256-prod-github-runner-207 kernel: [29339.157267] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 13:32:45 juju-e4d256-prod-github-runner-207 kernel: [29339.158073] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 13:32:45 juju-e4d256-prod-github-runner-207 kernel: [29339.158875] print_cpu_stall.cold+0x2f/0xe2 Aug 22 13:32:45 juju-e4d256-prod-github-runner-207 kernel: [29339.159640] ? timekeeping_update+0xf7/0x150 Aug 22 13:32:45 juju-e4d256-prod-github-runner-207 kernel: [29339.160413] check_cpu_stall+0x109/0x270 Aug 22 13:32:45 juju-e4d256-prod-github-runner-207 kernel: [29339.161157] rcu_sched_clock_irq+0x9a/0x250 Aug 22 13:32:45 juju-e4d256-prod-github-runner-207 kernel: [29339.161917] update_process_times+0x94/0xd0 Aug 22 13:32:45 juju-e4d256-prod-github-runner-207 kernel: [29339.162688] tick_sched_handle+0x29/0x70 Aug 22 13:32:45 juju-e4d256-prod-github-runner-207 kernel: [29339.163434] tick_sched_timer+0x8c/0xc0 Aug 22 13:32:45 juju-e4d256-prod-github-runner-207 kernel: [29339.164173] ? tick_nohz_handler+0xb0/0xb0 Aug 22 13:32:45 juju-e4d256-prod-github-runner-207 kernel: [29339.165038] __hrtimer_run_queues+0x107/0x230 Aug 22 13:32:45 juju-e4d256-prod-github-runner-207 kernel: [29339.165919] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 13:32:45 juju-e4d256-prod-github-runner-207 kernel: [29339.166813] hrtimer_interrupt+0x101/0x220 Aug 22 13:32:45 juju-e4d256-prod-github-runner-207 kernel: [29339.167652] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 13:32:45 juju-e4d256-prod-github-runner-207 kernel: [29339.168572] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 13:32:45 juju-e4d256-prod-github-runner-207 kernel: [29339.169487] Aug 22 13:32:45 juju-e4d256-prod-github-runner-207 kernel: [29339.170170] Aug 22 13:32:45 juju-e4d256-prod-github-runner-207 kernel: [29339.170856] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 13:32:45 juju-e4d256-prod-github-runner-207 kernel: [29339.171774] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:32:45 juju-e4d256-prod-github-runner-207 kernel: [29339.172760] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 13:32:45 juju-e4d256-prod-github-runner-207 kernel: [29339.175382] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 13:32:45 juju-e4d256-prod-github-runner-207 kernel: [29339.176375] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 13:32:45 juju-e4d256-prod-github-runner-207 kernel: [29339.177501] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 13:32:45 juju-e4d256-prod-github-runner-207 kernel: [29339.178657] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 13:32:45 juju-e4d256-prod-github-runner-207 kernel: [29339.179771] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 13:32:45 juju-e4d256-prod-github-runner-207 kernel: [29339.180854] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 13:32:45 juju-e4d256-prod-github-runner-207 kernel: [29339.181935] ? _raw_spin_lock+0x22/0x30 Aug 22 13:32:45 juju-e4d256-prod-github-runner-207 kernel: [29339.182790] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:32:45 juju-e4d256-prod-github-runner-207 kernel: [29339.183712] direct_page_fault+0x206/0x310 [kvm] Aug 22 13:32:45 juju-e4d256-prod-github-runner-207 kernel: [29339.184644] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 13:32:45 juju-e4d256-prod-github-runner-207 kernel: [29339.185562] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 13:32:45 juju-e4d256-prod-github-runner-207 kernel: [29339.186511] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 13:32:45 juju-e4d256-prod-github-runner-207 kernel: [29339.187425] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 13:32:45 juju-e4d256-prod-github-runner-207 kernel: [29339.188304] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 13:32:45 juju-e4d256-prod-github-runner-207 kernel: [29339.189235] handle_exit+0x98/0x230 [kvm_amd] Aug 22 13:32:45 juju-e4d256-prod-github-runner-207 kernel: [29339.190073] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 13:32:45 juju-e4d256-prod-github-runner-207 kernel: [29339.190977] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 13:32:45 juju-e4d256-prod-github-runner-207 kernel: [29339.191870] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 13:32:45 juju-e4d256-prod-github-runner-207 kernel: [29339.192748] vcpu_run+0x62/0x2c0 [kvm] Aug 22 13:32:45 juju-e4d256-prod-github-runner-207 kernel: [29339.193539] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 13:32:45 juju-e4d256-prod-github-runner-207 kernel: [29339.194356] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 13:32:45 juju-e4d256-prod-github-runner-207 kernel: [29339.195284] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 13:32:45 juju-e4d256-prod-github-runner-207 kernel: [29339.196168] ? __seccomp_filter+0x4a/0x4a0 Aug 22 13:32:45 juju-e4d256-prod-github-runner-207 kernel: [29339.196980] ? __fget_files+0x86/0xc0 Aug 22 13:32:45 juju-e4d256-prod-github-runner-207 kernel: [29339.197748] __x64_sys_ioctl+0x95/0xd0 Aug 22 13:32:45 juju-e4d256-prod-github-runner-207 kernel: [29339.198540] do_syscall_64+0x5c/0xc0 Aug 22 13:32:45 juju-e4d256-prod-github-runner-207 kernel: [29339.199299] ? do_futex+0x162/0x1f0 Aug 22 13:32:45 juju-e4d256-prod-github-runner-207 kernel: [29339.200093] ? __x64_sys_futex+0x78/0x1e0 Aug 22 13:32:45 juju-e4d256-prod-github-runner-207 kernel: [29339.200888] ? __secure_computing+0xa9/0x120 Aug 22 13:32:45 juju-e4d256-prod-github-runner-207 kernel: [29339.201707] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 13:32:45 juju-e4d256-prod-github-runner-207 kernel: [29339.202618] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:32:45 juju-e4d256-prod-github-runner-207 kernel: [29339.203472] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:32:45 juju-e4d256-prod-github-runner-207 kernel: [29339.204327] ? do_syscall_64+0x69/0xc0 Aug 22 13:32:45 juju-e4d256-prod-github-runner-207 kernel: [29339.205100] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:32:45 juju-e4d256-prod-github-runner-207 kernel: [29339.205965] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:32:45 juju-e4d256-prod-github-runner-207 kernel: [29339.206868] ? do_syscall_64+0x69/0xc0 Aug 22 13:32:45 juju-e4d256-prod-github-runner-207 kernel: [29339.207642] ? do_syscall_64+0x69/0xc0 Aug 22 13:32:45 juju-e4d256-prod-github-runner-207 kernel: [29339.208402] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 13:32:45 juju-e4d256-prod-github-runner-207 kernel: [29339.209271] RIP: 0033:0x7faa5d0edaff Aug 22 13:32:45 juju-e4d256-prod-github-runner-207 kernel: [29339.210050] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 13:32:45 juju-e4d256-prod-github-runner-207 kernel: [29339.212506] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 13:32:45 juju-e4d256-prod-github-runner-207 kernel: [29339.213619] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 13:32:45 juju-e4d256-prod-github-runner-207 kernel: [29339.214719] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 13:32:45 juju-e4d256-prod-github-runner-207 kernel: [29339.215797] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 13:32:45 juju-e4d256-prod-github-runner-207 kernel: [29339.216868] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 13:32:45 juju-e4d256-prod-github-runner-207 kernel: [29339.217929] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 13:32:45 juju-e4d256-prod-github-runner-207 kernel: [29339.219017] Aug 22 13:33:10 juju-e4d256-prod-github-runner-207 kernel: [29364.541982] watchdog: BUG: soft lockup - CPU#1 stuck for 27239s! [qemu-system-x86:6715] Aug 22 13:33:10 juju-e4d256-prod-github-runner-207 kernel: [29364.543148] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 13:33:10 juju-e4d256-prod-github-runner-207 kernel: [29364.543224] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 13:33:10 juju-e4d256-prod-github-runner-207 kernel: [29364.558206] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 13:33:10 juju-e4d256-prod-github-runner-207 kernel: [29364.559471] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 13:33:10 juju-e4d256-prod-github-runner-207 kernel: [29364.560688] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:33:10 juju-e4d256-prod-github-runner-207 kernel: [29364.561744] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 13:33:10 juju-e4d256-prod-github-runner-207 kernel: [29364.564336] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 13:33:10 juju-e4d256-prod-github-runner-207 kernel: [29364.565384] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 13:33:10 juju-e4d256-prod-github-runner-207 kernel: [29364.566571] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 13:33:10 juju-e4d256-prod-github-runner-207 kernel: [29364.567732] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 13:33:10 juju-e4d256-prod-github-runner-207 kernel: [29364.568891] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 13:33:10 juju-e4d256-prod-github-runner-207 kernel: [29364.570060] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 13:33:10 juju-e4d256-prod-github-runner-207 kernel: [29364.571255] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 13:33:10 juju-e4d256-prod-github-runner-207 kernel: [29364.572605] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 13:33:10 juju-e4d256-prod-github-runner-207 kernel: [29364.573749] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 13:33:10 juju-e4d256-prod-github-runner-207 kernel: [29364.574973] Call Trace: Aug 22 13:33:10 juju-e4d256-prod-github-runner-207 kernel: [29364.575896] Aug 22 13:33:10 juju-e4d256-prod-github-runner-207 kernel: [29364.576785] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:33:10 juju-e4d256-prod-github-runner-207 kernel: [29364.577820] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:33:10 juju-e4d256-prod-github-runner-207 kernel: [29364.578873] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:33:10 juju-e4d256-prod-github-runner-207 kernel: [29364.580060] ? show_regs.part.0+0x23/0x29 Aug 22 13:33:10 juju-e4d256-prod-github-runner-207 kernel: [29364.581261] ? show_regs.cold+0x8/0xd Aug 22 13:33:10 juju-e4d256-prod-github-runner-207 kernel: [29364.582266] ? watchdog_timer_fn+0x1be/0x220 Aug 22 13:33:10 juju-e4d256-prod-github-runner-207 kernel: [29364.583280] ? lockup_detector_update_enable+0x60/0x60 Aug 22 13:33:10 juju-e4d256-prod-github-runner-207 kernel: [29364.584347] ? __hrtimer_run_queues+0x107/0x230 Aug 22 13:33:10 juju-e4d256-prod-github-runner-207 kernel: [29364.585383] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 13:33:10 juju-e4d256-prod-github-runner-207 kernel: [29364.586427] ? hrtimer_interrupt+0x101/0x220 Aug 22 13:33:10 juju-e4d256-prod-github-runner-207 kernel: [29364.587454] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 13:33:10 juju-e4d256-prod-github-runner-207 kernel: [29364.588673] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 13:33:10 juju-e4d256-prod-github-runner-207 kernel: [29364.589734] Aug 22 13:33:10 juju-e4d256-prod-github-runner-207 kernel: [29364.590613] Aug 22 13:33:10 juju-e4d256-prod-github-runner-207 kernel: [29364.591461] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 13:33:10 juju-e4d256-prod-github-runner-207 kernel: [29364.592497] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:33:10 juju-e4d256-prod-github-runner-207 kernel: [29364.593538] ? _raw_spin_lock+0x22/0x30 Aug 22 13:33:10 juju-e4d256-prod-github-runner-207 kernel: [29364.594508] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:33:10 juju-e4d256-prod-github-runner-207 kernel: [29364.595540] direct_page_fault+0x206/0x310 [kvm] Aug 22 13:33:10 juju-e4d256-prod-github-runner-207 kernel: [29364.596571] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 13:33:10 juju-e4d256-prod-github-runner-207 kernel: [29364.597615] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 13:33:10 juju-e4d256-prod-github-runner-207 kernel: [29364.598646] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 13:33:10 juju-e4d256-prod-github-runner-207 kernel: [29364.599622] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 13:33:10 juju-e4d256-prod-github-runner-207 kernel: [29364.600578] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 13:33:10 juju-e4d256-prod-github-runner-207 kernel: [29364.601607] handle_exit+0x98/0x230 [kvm_amd] Aug 22 13:33:10 juju-e4d256-prod-github-runner-207 kernel: [29364.602525] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 13:33:10 juju-e4d256-prod-github-runner-207 kernel: [29364.603448] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 13:33:10 juju-e4d256-prod-github-runner-207 kernel: [29364.604399] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 13:33:10 juju-e4d256-prod-github-runner-207 kernel: [29364.605336] vcpu_run+0x62/0x2c0 [kvm] Aug 22 13:33:10 juju-e4d256-prod-github-runner-207 kernel: [29364.606168] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 13:33:10 juju-e4d256-prod-github-runner-207 kernel: [29364.606990] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 13:33:10 juju-e4d256-prod-github-runner-207 kernel: [29364.607848] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 13:33:10 juju-e4d256-prod-github-runner-207 kernel: [29364.608648] ? __seccomp_filter+0x4a/0x4a0 Aug 22 13:33:10 juju-e4d256-prod-github-runner-207 kernel: [29364.609395] ? __fget_files+0x86/0xc0 Aug 22 13:33:10 juju-e4d256-prod-github-runner-207 kernel: [29364.610107] __x64_sys_ioctl+0x95/0xd0 Aug 22 13:33:10 juju-e4d256-prod-github-runner-207 kernel: [29364.610821] do_syscall_64+0x5c/0xc0 Aug 22 13:33:10 juju-e4d256-prod-github-runner-207 kernel: [29364.611491] ? do_futex+0x162/0x1f0 Aug 22 13:33:10 juju-e4d256-prod-github-runner-207 kernel: [29364.612145] ? __x64_sys_futex+0x78/0x1e0 Aug 22 13:33:10 juju-e4d256-prod-github-runner-207 kernel: [29364.612834] ? __secure_computing+0xa9/0x120 Aug 22 13:33:10 juju-e4d256-prod-github-runner-207 kernel: [29364.613541] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 13:33:10 juju-e4d256-prod-github-runner-207 kernel: [29364.614333] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:33:10 juju-e4d256-prod-github-runner-207 kernel: [29364.615076] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:33:10 juju-e4d256-prod-github-runner-207 kernel: [29364.615807] ? do_syscall_64+0x69/0xc0 Aug 22 13:33:10 juju-e4d256-prod-github-runner-207 kernel: [29364.616457] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:33:10 juju-e4d256-prod-github-runner-207 kernel: [29364.617169] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:33:10 juju-e4d256-prod-github-runner-207 kernel: [29364.617884] ? do_syscall_64+0x69/0xc0 Aug 22 13:33:10 juju-e4d256-prod-github-runner-207 kernel: [29364.618575] ? do_syscall_64+0x69/0xc0 Aug 22 13:33:10 juju-e4d256-prod-github-runner-207 kernel: [29364.619225] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 13:33:10 juju-e4d256-prod-github-runner-207 kernel: [29364.619937] RIP: 0033:0x7faa5d0edaff Aug 22 13:33:10 juju-e4d256-prod-github-runner-207 kernel: [29364.620567] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 13:33:10 juju-e4d256-prod-github-runner-207 kernel: [29364.623150] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 13:33:10 juju-e4d256-prod-github-runner-207 kernel: [29364.624075] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 13:33:10 juju-e4d256-prod-github-runner-207 kernel: [29364.625420] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 13:33:10 juju-e4d256-prod-github-runner-207 kernel: [29364.626389] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 13:33:10 juju-e4d256-prod-github-runner-207 kernel: [29364.627291] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 13:33:10 juju-e4d256-prod-github-runner-207 kernel: [29364.628231] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 13:33:10 juju-e4d256-prod-github-runner-207 kernel: [29364.629270] Aug 22 13:33:38 juju-e4d256-prod-github-runner-207 kernel: [29392.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 27265s! [qemu-system-x86:6715] Aug 22 13:33:38 juju-e4d256-prod-github-runner-207 kernel: [29392.543120] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 13:33:38 juju-e4d256-prod-github-runner-207 kernel: [29392.543195] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 13:33:38 juju-e4d256-prod-github-runner-207 kernel: [29392.555585] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 13:33:38 juju-e4d256-prod-github-runner-207 kernel: [29392.556882] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 13:33:38 juju-e4d256-prod-github-runner-207 kernel: [29392.558148] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:33:38 juju-e4d256-prod-github-runner-207 kernel: [29392.559235] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 13:33:38 juju-e4d256-prod-github-runner-207 kernel: [29392.561858] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 13:33:38 juju-e4d256-prod-github-runner-207 kernel: [29392.562917] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 13:33:38 juju-e4d256-prod-github-runner-207 kernel: [29392.564099] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 13:33:38 juju-e4d256-prod-github-runner-207 kernel: [29392.565271] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 13:33:38 juju-e4d256-prod-github-runner-207 kernel: [29392.566466] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 13:33:38 juju-e4d256-prod-github-runner-207 kernel: [29392.567645] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 13:33:38 juju-e4d256-prod-github-runner-207 kernel: [29392.568839] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 13:33:38 juju-e4d256-prod-github-runner-207 kernel: [29392.570104] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 13:33:38 juju-e4d256-prod-github-runner-207 kernel: [29392.571236] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 13:33:38 juju-e4d256-prod-github-runner-207 kernel: [29392.572463] Call Trace: Aug 22 13:33:38 juju-e4d256-prod-github-runner-207 kernel: [29392.573393] Aug 22 13:33:38 juju-e4d256-prod-github-runner-207 kernel: [29392.574295] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:33:38 juju-e4d256-prod-github-runner-207 kernel: [29392.575345] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:33:38 juju-e4d256-prod-github-runner-207 kernel: [29392.576378] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:33:38 juju-e4d256-prod-github-runner-207 kernel: [29392.577465] ? show_regs.part.0+0x23/0x29 Aug 22 13:33:38 juju-e4d256-prod-github-runner-207 kernel: [29392.578492] ? show_regs.cold+0x8/0xd Aug 22 13:33:38 juju-e4d256-prod-github-runner-207 kernel: [29392.579474] ? watchdog_timer_fn+0x1be/0x220 Aug 22 13:33:38 juju-e4d256-prod-github-runner-207 kernel: [29392.580497] ? lockup_detector_update_enable+0x60/0x60 Aug 22 13:33:38 juju-e4d256-prod-github-runner-207 kernel: [29392.581584] ? __hrtimer_run_queues+0x107/0x230 Aug 22 13:33:38 juju-e4d256-prod-github-runner-207 kernel: [29392.582647] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 13:33:38 juju-e4d256-prod-github-runner-207 kernel: [29392.583687] ? hrtimer_interrupt+0x101/0x220 Aug 22 13:33:38 juju-e4d256-prod-github-runner-207 kernel: [29392.584719] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 13:33:38 juju-e4d256-prod-github-runner-207 kernel: [29392.585825] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 13:33:38 juju-e4d256-prod-github-runner-207 kernel: [29392.586889] Aug 22 13:33:38 juju-e4d256-prod-github-runner-207 kernel: [29392.587752] Aug 22 13:33:38 juju-e4d256-prod-github-runner-207 kernel: [29392.588602] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 13:33:38 juju-e4d256-prod-github-runner-207 kernel: [29392.589669] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:33:38 juju-e4d256-prod-github-runner-207 kernel: [29392.590743] ? _raw_spin_lock+0x22/0x30 Aug 22 13:33:38 juju-e4d256-prod-github-runner-207 kernel: [29392.591707] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:33:38 juju-e4d256-prod-github-runner-207 kernel: [29392.592801] direct_page_fault+0x206/0x310 [kvm] Aug 22 13:33:38 juju-e4d256-prod-github-runner-207 kernel: [29392.593863] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 13:33:38 juju-e4d256-prod-github-runner-207 kernel: [29392.594889] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 13:33:38 juju-e4d256-prod-github-runner-207 kernel: [29392.595903] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 13:33:38 juju-e4d256-prod-github-runner-207 kernel: [29392.596892] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 13:33:38 juju-e4d256-prod-github-runner-207 kernel: [29392.597862] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 13:33:38 juju-e4d256-prod-github-runner-207 kernel: [29392.598864] handle_exit+0x98/0x230 [kvm_amd] Aug 22 13:33:38 juju-e4d256-prod-github-runner-207 kernel: [29392.599770] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 13:33:38 juju-e4d256-prod-github-runner-207 kernel: [29392.600703] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 13:33:38 juju-e4d256-prod-github-runner-207 kernel: [29392.601655] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 13:33:38 juju-e4d256-prod-github-runner-207 kernel: [29392.602587] vcpu_run+0x62/0x2c0 [kvm] Aug 22 13:33:38 juju-e4d256-prod-github-runner-207 kernel: [29392.603414] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 13:33:38 juju-e4d256-prod-github-runner-207 kernel: [29392.604246] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 13:33:38 juju-e4d256-prod-github-runner-207 kernel: [29392.605113] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 13:33:38 juju-e4d256-prod-github-runner-207 kernel: [29392.605929] ? __seccomp_filter+0x4a/0x4a0 Aug 22 13:33:38 juju-e4d256-prod-github-runner-207 kernel: [29392.606693] ? __fget_files+0x86/0xc0 Aug 22 13:33:38 juju-e4d256-prod-github-runner-207 kernel: [29392.607412] __x64_sys_ioctl+0x95/0xd0 Aug 22 13:33:38 juju-e4d256-prod-github-runner-207 kernel: [29392.608116] do_syscall_64+0x5c/0xc0 Aug 22 13:33:38 juju-e4d256-prod-github-runner-207 kernel: [29392.608789] ? do_futex+0x162/0x1f0 Aug 22 13:33:38 juju-e4d256-prod-github-runner-207 kernel: [29392.609456] ? __x64_sys_futex+0x78/0x1e0 Aug 22 13:33:38 juju-e4d256-prod-github-runner-207 kernel: [29392.610154] ? __secure_computing+0xa9/0x120 Aug 22 13:33:38 juju-e4d256-prod-github-runner-207 kernel: [29392.610856] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 13:33:38 juju-e4d256-prod-github-runner-207 kernel: [29392.611631] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:33:38 juju-e4d256-prod-github-runner-207 kernel: [29392.612374] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:33:38 juju-e4d256-prod-github-runner-207 kernel: [29392.613106] ? do_syscall_64+0x69/0xc0 Aug 22 13:33:38 juju-e4d256-prod-github-runner-207 kernel: [29392.613766] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:33:38 juju-e4d256-prod-github-runner-207 kernel: [29392.614493] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:33:38 juju-e4d256-prod-github-runner-207 kernel: [29392.615198] ? do_syscall_64+0x69/0xc0 Aug 22 13:33:38 juju-e4d256-prod-github-runner-207 kernel: [29392.615842] ? do_syscall_64+0x69/0xc0 Aug 22 13:33:38 juju-e4d256-prod-github-runner-207 kernel: [29392.616483] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 13:33:38 juju-e4d256-prod-github-runner-207 kernel: [29392.617203] RIP: 0033:0x7faa5d0edaff Aug 22 13:33:38 juju-e4d256-prod-github-runner-207 kernel: [29392.617846] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 13:33:38 juju-e4d256-prod-github-runner-207 kernel: [29392.619901] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 13:33:38 juju-e4d256-prod-github-runner-207 kernel: [29392.620839] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 13:33:38 juju-e4d256-prod-github-runner-207 kernel: [29392.621754] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 13:33:38 juju-e4d256-prod-github-runner-207 kernel: [29392.622680] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 13:33:38 juju-e4d256-prod-github-runner-207 kernel: [29392.623596] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 13:33:38 juju-e4d256-prod-github-runner-207 kernel: [29392.624510] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 13:33:38 juju-e4d256-prod-github-runner-207 kernel: [29392.625430] Aug 22 13:34:06 juju-e4d256-prod-github-runner-207 kernel: [29420.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 27292s! [qemu-system-x86:6715] Aug 22 13:34:06 juju-e4d256-prod-github-runner-207 kernel: [29420.543921] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 13:34:06 juju-e4d256-prod-github-runner-207 kernel: [29420.544212] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 13:34:06 juju-e4d256-prod-github-runner-207 kernel: [29420.556352] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 13:34:06 juju-e4d256-prod-github-runner-207 kernel: [29420.557636] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 13:34:06 juju-e4d256-prod-github-runner-207 kernel: [29420.558861] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:34:06 juju-e4d256-prod-github-runner-207 kernel: [29420.559925] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 13:34:06 juju-e4d256-prod-github-runner-207 kernel: [29420.562491] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 13:34:06 juju-e4d256-prod-github-runner-207 kernel: [29420.563536] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 13:34:06 juju-e4d256-prod-github-runner-207 kernel: [29420.564698] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 13:34:06 juju-e4d256-prod-github-runner-207 kernel: [29420.565882] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 13:34:06 juju-e4d256-prod-github-runner-207 kernel: [29420.567048] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 13:34:06 juju-e4d256-prod-github-runner-207 kernel: [29420.568217] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 13:34:06 juju-e4d256-prod-github-runner-207 kernel: [29420.569390] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 13:34:06 juju-e4d256-prod-github-runner-207 kernel: [29420.570645] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 13:34:06 juju-e4d256-prod-github-runner-207 kernel: [29420.571744] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 13:34:06 juju-e4d256-prod-github-runner-207 kernel: [29420.572944] Call Trace: Aug 22 13:34:06 juju-e4d256-prod-github-runner-207 kernel: [29420.573873] Aug 22 13:34:06 juju-e4d256-prod-github-runner-207 kernel: [29420.574770] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:34:06 juju-e4d256-prod-github-runner-207 kernel: [29420.575812] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:34:06 juju-e4d256-prod-github-runner-207 kernel: [29420.576838] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:34:06 juju-e4d256-prod-github-runner-207 kernel: [29420.577954] ? show_regs.part.0+0x23/0x29 Aug 22 13:34:06 juju-e4d256-prod-github-runner-207 kernel: [29420.578957] ? show_regs.cold+0x8/0xd Aug 22 13:34:06 juju-e4d256-prod-github-runner-207 kernel: [29420.579928] ? watchdog_timer_fn+0x1be/0x220 Aug 22 13:34:06 juju-e4d256-prod-github-runner-207 kernel: [29420.580945] ? lockup_detector_update_enable+0x60/0x60 Aug 22 13:34:06 juju-e4d256-prod-github-runner-207 kernel: [29420.582019] ? __hrtimer_run_queues+0x107/0x230 Aug 22 13:34:06 juju-e4d256-prod-github-runner-207 kernel: [29420.583054] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 13:34:06 juju-e4d256-prod-github-runner-207 kernel: [29420.584083] ? hrtimer_interrupt+0x101/0x220 Aug 22 13:34:06 juju-e4d256-prod-github-runner-207 kernel: [29420.585098] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 13:34:06 juju-e4d256-prod-github-runner-207 kernel: [29420.586179] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 13:34:06 juju-e4d256-prod-github-runner-207 kernel: [29420.587235] Aug 22 13:34:06 juju-e4d256-prod-github-runner-207 kernel: [29420.588089] Aug 22 13:34:06 juju-e4d256-prod-github-runner-207 kernel: [29420.588926] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 13:34:06 juju-e4d256-prod-github-runner-207 kernel: [29420.589979] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:34:06 juju-e4d256-prod-github-runner-207 kernel: [29420.591022] ? _raw_spin_lock+0x22/0x30 Aug 22 13:34:06 juju-e4d256-prod-github-runner-207 kernel: [29420.591967] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:34:06 juju-e4d256-prod-github-runner-207 kernel: [29420.592986] direct_page_fault+0x206/0x310 [kvm] Aug 22 13:34:06 juju-e4d256-prod-github-runner-207 kernel: [29420.594020] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 13:34:06 juju-e4d256-prod-github-runner-207 kernel: [29420.595030] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 13:34:06 juju-e4d256-prod-github-runner-207 kernel: [29420.596033] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 13:34:06 juju-e4d256-prod-github-runner-207 kernel: [29420.597028] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 13:34:06 juju-e4d256-prod-github-runner-207 kernel: [29420.597985] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 13:34:06 juju-e4d256-prod-github-runner-207 kernel: [29420.598963] handle_exit+0x98/0x230 [kvm_amd] Aug 22 13:34:06 juju-e4d256-prod-github-runner-207 kernel: [29420.599855] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 13:34:06 juju-e4d256-prod-github-runner-207 kernel: [29420.600774] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 13:34:06 juju-e4d256-prod-github-runner-207 kernel: [29420.601718] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 13:34:06 juju-e4d256-prod-github-runner-207 kernel: [29420.602622] vcpu_run+0x62/0x2c0 [kvm] Aug 22 13:34:06 juju-e4d256-prod-github-runner-207 kernel: [29420.603432] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 13:34:06 juju-e4d256-prod-github-runner-207 kernel: [29420.604241] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 13:34:06 juju-e4d256-prod-github-runner-207 kernel: [29420.605093] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 13:34:06 juju-e4d256-prod-github-runner-207 kernel: [29420.605920] ? __seccomp_filter+0x4a/0x4a0 Aug 22 13:34:06 juju-e4d256-prod-github-runner-207 kernel: [29420.606665] ? __fget_files+0x86/0xc0 Aug 22 13:34:06 juju-e4d256-prod-github-runner-207 kernel: [29420.607369] __x64_sys_ioctl+0x95/0xd0 Aug 22 13:34:06 juju-e4d256-prod-github-runner-207 kernel: [29420.608062] do_syscall_64+0x5c/0xc0 Aug 22 13:34:06 juju-e4d256-prod-github-runner-207 kernel: [29420.608726] ? do_futex+0x162/0x1f0 Aug 22 13:34:06 juju-e4d256-prod-github-runner-207 kernel: [29420.609376] ? __x64_sys_futex+0x78/0x1e0 Aug 22 13:34:06 juju-e4d256-prod-github-runner-207 kernel: [29420.610061] ? __secure_computing+0xa9/0x120 Aug 22 13:34:06 juju-e4d256-prod-github-runner-207 kernel: [29420.610751] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 13:34:06 juju-e4d256-prod-github-runner-207 kernel: [29420.611516] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:34:06 juju-e4d256-prod-github-runner-207 kernel: [29420.612238] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:34:06 juju-e4d256-prod-github-runner-207 kernel: [29420.612956] ? do_syscall_64+0x69/0xc0 Aug 22 13:34:06 juju-e4d256-prod-github-runner-207 kernel: [29420.613614] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:34:06 juju-e4d256-prod-github-runner-207 kernel: [29420.614317] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:34:06 juju-e4d256-prod-github-runner-207 kernel: [29420.615011] ? do_syscall_64+0x69/0xc0 Aug 22 13:34:06 juju-e4d256-prod-github-runner-207 kernel: [29420.615648] ? do_syscall_64+0x69/0xc0 Aug 22 13:34:06 juju-e4d256-prod-github-runner-207 kernel: [29420.616270] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 13:34:06 juju-e4d256-prod-github-runner-207 kernel: [29420.616976] RIP: 0033:0x7faa5d0edaff Aug 22 13:34:06 juju-e4d256-prod-github-runner-207 kernel: [29420.617646] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 13:34:06 juju-e4d256-prod-github-runner-207 kernel: [29420.619637] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 13:34:06 juju-e4d256-prod-github-runner-207 kernel: [29420.620545] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 13:34:06 juju-e4d256-prod-github-runner-207 kernel: [29420.621448] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 13:34:06 juju-e4d256-prod-github-runner-207 kernel: [29420.622379] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 13:34:06 juju-e4d256-prod-github-runner-207 kernel: [29420.623267] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 13:34:06 juju-e4d256-prod-github-runner-207 kernel: [29420.624154] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 13:34:06 juju-e4d256-prod-github-runner-207 kernel: [29420.625049] Aug 22 13:34:34 juju-e4d256-prod-github-runner-207 kernel: [29448.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 27318s! [qemu-system-x86:6715] Aug 22 13:34:34 juju-e4d256-prod-github-runner-207 kernel: [29448.543839] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 13:34:34 juju-e4d256-prod-github-runner-207 kernel: [29448.544137] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 13:34:34 juju-e4d256-prod-github-runner-207 kernel: [29448.556337] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 13:34:34 juju-e4d256-prod-github-runner-207 kernel: [29448.557622] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 13:34:34 juju-e4d256-prod-github-runner-207 kernel: [29448.558849] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:34:34 juju-e4d256-prod-github-runner-207 kernel: [29448.559917] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 13:34:34 juju-e4d256-prod-github-runner-207 kernel: [29448.562495] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 13:34:34 juju-e4d256-prod-github-runner-207 kernel: [29448.563548] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 13:34:34 juju-e4d256-prod-github-runner-207 kernel: [29448.564707] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 13:34:34 juju-e4d256-prod-github-runner-207 kernel: [29448.565940] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 13:34:34 juju-e4d256-prod-github-runner-207 kernel: [29448.567148] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 13:34:34 juju-e4d256-prod-github-runner-207 kernel: [29448.568316] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 13:34:34 juju-e4d256-prod-github-runner-207 kernel: [29448.569491] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 13:34:34 juju-e4d256-prod-github-runner-207 kernel: [29448.570720] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 13:34:34 juju-e4d256-prod-github-runner-207 kernel: [29448.571816] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 13:34:34 juju-e4d256-prod-github-runner-207 kernel: [29448.573006] Call Trace: Aug 22 13:34:34 juju-e4d256-prod-github-runner-207 kernel: [29448.573934] Aug 22 13:34:34 juju-e4d256-prod-github-runner-207 kernel: [29448.574833] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:34:34 juju-e4d256-prod-github-runner-207 kernel: [29448.575861] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:34:34 juju-e4d256-prod-github-runner-207 kernel: [29448.576880] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:34:34 juju-e4d256-prod-github-runner-207 kernel: [29448.577980] ? show_regs.part.0+0x23/0x29 Aug 22 13:34:34 juju-e4d256-prod-github-runner-207 kernel: [29448.578975] ? show_regs.cold+0x8/0xd Aug 22 13:34:34 juju-e4d256-prod-github-runner-207 kernel: [29448.579944] ? watchdog_timer_fn+0x1be/0x220 Aug 22 13:34:34 juju-e4d256-prod-github-runner-207 kernel: [29448.580949] ? lockup_detector_update_enable+0x60/0x60 Aug 22 13:34:34 juju-e4d256-prod-github-runner-207 kernel: [29448.582025] ? __hrtimer_run_queues+0x107/0x230 Aug 22 13:34:34 juju-e4d256-prod-github-runner-207 kernel: [29448.583055] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 13:34:34 juju-e4d256-prod-github-runner-207 kernel: [29448.584076] ? hrtimer_interrupt+0x101/0x220 Aug 22 13:34:34 juju-e4d256-prod-github-runner-207 kernel: [29448.585142] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 13:34:34 juju-e4d256-prod-github-runner-207 kernel: [29448.586211] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 13:34:34 juju-e4d256-prod-github-runner-207 kernel: [29448.587259] Aug 22 13:34:34 juju-e4d256-prod-github-runner-207 kernel: [29448.588125] Aug 22 13:34:34 juju-e4d256-prod-github-runner-207 kernel: [29448.588968] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 13:34:34 juju-e4d256-prod-github-runner-207 kernel: [29448.590239] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:34:34 juju-e4d256-prod-github-runner-207 kernel: [29448.591282] ? _raw_spin_lock+0x22/0x30 Aug 22 13:34:34 juju-e4d256-prod-github-runner-207 kernel: [29448.592250] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:34:34 juju-e4d256-prod-github-runner-207 kernel: [29448.593295] direct_page_fault+0x206/0x310 [kvm] Aug 22 13:34:34 juju-e4d256-prod-github-runner-207 kernel: [29448.594334] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 13:34:34 juju-e4d256-prod-github-runner-207 kernel: [29448.595358] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 13:34:34 juju-e4d256-prod-github-runner-207 kernel: [29448.596357] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 13:34:34 juju-e4d256-prod-github-runner-207 kernel: [29448.597405] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 13:34:34 juju-e4d256-prod-github-runner-207 kernel: [29448.598352] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 13:34:34 juju-e4d256-prod-github-runner-207 kernel: [29448.599345] handle_exit+0x98/0x230 [kvm_amd] Aug 22 13:34:34 juju-e4d256-prod-github-runner-207 kernel: [29448.600239] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 13:34:34 juju-e4d256-prod-github-runner-207 kernel: [29448.601169] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 13:34:34 juju-e4d256-prod-github-runner-207 kernel: [29448.602098] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 13:34:34 juju-e4d256-prod-github-runner-207 kernel: [29448.603000] vcpu_run+0x62/0x2c0 [kvm] Aug 22 13:34:34 juju-e4d256-prod-github-runner-207 kernel: [29448.603814] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 13:34:34 juju-e4d256-prod-github-runner-207 kernel: [29448.604620] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 13:34:34 juju-e4d256-prod-github-runner-207 kernel: [29448.605487] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 13:34:34 juju-e4d256-prod-github-runner-207 kernel: [29448.606283] ? __seccomp_filter+0x4a/0x4a0 Aug 22 13:34:34 juju-e4d256-prod-github-runner-207 kernel: [29448.607032] ? __fget_files+0x86/0xc0 Aug 22 13:34:34 juju-e4d256-prod-github-runner-207 kernel: [29448.607734] __x64_sys_ioctl+0x95/0xd0 Aug 22 13:34:34 juju-e4d256-prod-github-runner-207 kernel: [29448.608427] do_syscall_64+0x5c/0xc0 Aug 22 13:34:34 juju-e4d256-prod-github-runner-207 kernel: [29448.609117] ? do_futex+0x162/0x1f0 Aug 22 13:34:34 juju-e4d256-prod-github-runner-207 kernel: [29448.609766] ? __x64_sys_futex+0x78/0x1e0 Aug 22 13:34:34 juju-e4d256-prod-github-runner-207 kernel: [29448.610442] ? __secure_computing+0xa9/0x120 Aug 22 13:34:34 juju-e4d256-prod-github-runner-207 kernel: [29448.611131] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 13:34:34 juju-e4d256-prod-github-runner-207 kernel: [29448.611890] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:34:34 juju-e4d256-prod-github-runner-207 kernel: [29448.612625] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:34:34 juju-e4d256-prod-github-runner-207 kernel: [29448.613354] ? do_syscall_64+0x69/0xc0 Aug 22 13:34:34 juju-e4d256-prod-github-runner-207 kernel: [29448.614004] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:34:34 juju-e4d256-prod-github-runner-207 kernel: [29448.614706] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:34:34 juju-e4d256-prod-github-runner-207 kernel: [29448.615404] ? do_syscall_64+0x69/0xc0 Aug 22 13:34:34 juju-e4d256-prod-github-runner-207 kernel: [29448.616028] ? do_syscall_64+0x69/0xc0 Aug 22 13:34:34 juju-e4d256-prod-github-runner-207 kernel: [29448.616652] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 13:34:34 juju-e4d256-prod-github-runner-207 kernel: [29448.617457] RIP: 0033:0x7faa5d0edaff Aug 22 13:34:34 juju-e4d256-prod-github-runner-207 kernel: [29448.618127] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 13:34:34 juju-e4d256-prod-github-runner-207 kernel: [29448.620115] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 13:34:34 juju-e4d256-prod-github-runner-207 kernel: [29448.621023] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 13:34:34 juju-e4d256-prod-github-runner-207 kernel: [29448.621938] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 13:34:34 juju-e4d256-prod-github-runner-207 kernel: [29448.622861] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 13:34:34 juju-e4d256-prod-github-runner-207 kernel: [29448.623768] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 13:34:34 juju-e4d256-prod-github-runner-207 kernel: [29448.624658] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 13:34:34 juju-e4d256-prod-github-runner-207 kernel: [29448.625566] Aug 22 13:35:02 juju-e4d256-prod-github-runner-207 kernel: [29476.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 27344s! [qemu-system-x86:6715] Aug 22 13:35:02 juju-e4d256-prod-github-runner-207 kernel: [29476.544076] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 13:35:02 juju-e4d256-prod-github-runner-207 kernel: [29476.544582] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 13:35:02 juju-e4d256-prod-github-runner-207 kernel: [29476.556674] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 13:35:02 juju-e4d256-prod-github-runner-207 kernel: [29476.557950] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 13:35:02 juju-e4d256-prod-github-runner-207 kernel: [29476.559241] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:35:02 juju-e4d256-prod-github-runner-207 kernel: [29476.560297] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 13:35:02 juju-e4d256-prod-github-runner-207 kernel: [29476.562853] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 13:35:02 juju-e4d256-prod-github-runner-207 kernel: [29476.563899] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 13:35:02 juju-e4d256-prod-github-runner-207 kernel: [29476.565078] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 13:35:02 juju-e4d256-prod-github-runner-207 kernel: [29476.566392] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 13:35:02 juju-e4d256-prod-github-runner-207 kernel: [29476.567689] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 13:35:02 juju-e4d256-prod-github-runner-207 kernel: [29476.569003] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 13:35:02 juju-e4d256-prod-github-runner-207 kernel: [29476.570308] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 13:35:02 juju-e4d256-prod-github-runner-207 kernel: [29476.571698] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 13:35:02 juju-e4d256-prod-github-runner-207 kernel: [29476.572937] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 13:35:02 juju-e4d256-prod-github-runner-207 kernel: [29476.574263] Call Trace: Aug 22 13:35:02 juju-e4d256-prod-github-runner-207 kernel: [29476.575229] Aug 22 13:35:02 juju-e4d256-prod-github-runner-207 kernel: [29476.576194] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:35:02 juju-e4d256-prod-github-runner-207 kernel: [29476.577329] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:35:02 juju-e4d256-prod-github-runner-207 kernel: [29476.578438] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:35:02 juju-e4d256-prod-github-runner-207 kernel: [29476.579631] ? show_regs.part.0+0x23/0x29 Aug 22 13:35:02 juju-e4d256-prod-github-runner-207 kernel: [29476.580721] ? show_regs.cold+0x8/0xd Aug 22 13:35:02 juju-e4d256-prod-github-runner-207 kernel: [29476.581778] ? watchdog_timer_fn+0x1be/0x220 Aug 22 13:35:02 juju-e4d256-prod-github-runner-207 kernel: [29476.582872] ? lockup_detector_update_enable+0x60/0x60 Aug 22 13:35:02 juju-e4d256-prod-github-runner-207 kernel: [29476.584038] ? __hrtimer_run_queues+0x107/0x230 Aug 22 13:35:02 juju-e4d256-prod-github-runner-207 kernel: [29476.585171] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 13:35:02 juju-e4d256-prod-github-runner-207 kernel: [29476.586278] ? hrtimer_interrupt+0x101/0x220 Aug 22 13:35:02 juju-e4d256-prod-github-runner-207 kernel: [29476.587374] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 13:35:02 juju-e4d256-prod-github-runner-207 kernel: [29476.588559] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 13:35:02 juju-e4d256-prod-github-runner-207 kernel: [29476.589730] Aug 22 13:35:02 juju-e4d256-prod-github-runner-207 kernel: [29476.590632] Aug 22 13:35:02 juju-e4d256-prod-github-runner-207 kernel: [29476.591517] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 13:35:02 juju-e4d256-prod-github-runner-207 kernel: [29476.592658] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:35:02 juju-e4d256-prod-github-runner-207 kernel: [29476.593812] ? _raw_spin_lock+0x22/0x30 Aug 22 13:35:02 juju-e4d256-prod-github-runner-207 kernel: [29476.594836] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:35:02 juju-e4d256-prod-github-runner-207 kernel: [29476.595944] direct_page_fault+0x206/0x310 [kvm] Aug 22 13:35:02 juju-e4d256-prod-github-runner-207 kernel: [29476.597075] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 13:35:02 juju-e4d256-prod-github-runner-207 kernel: [29476.598171] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 13:35:02 juju-e4d256-prod-github-runner-207 kernel: [29476.599261] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 13:35:02 juju-e4d256-prod-github-runner-207 kernel: [29476.600359] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 13:35:02 juju-e4d256-prod-github-runner-207 kernel: [29476.601417] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 13:35:02 juju-e4d256-prod-github-runner-207 kernel: [29476.602504] handle_exit+0x98/0x230 [kvm_amd] Aug 22 13:35:02 juju-e4d256-prod-github-runner-207 kernel: [29476.603492] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 13:35:02 juju-e4d256-prod-github-runner-207 kernel: [29476.604502] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 13:35:02 juju-e4d256-prod-github-runner-207 kernel: [29476.605531] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 13:35:02 juju-e4d256-prod-github-runner-207 kernel: [29476.606535] vcpu_run+0x62/0x2c0 [kvm] Aug 22 13:35:02 juju-e4d256-prod-github-runner-207 kernel: [29476.607426] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 13:35:02 juju-e4d256-prod-github-runner-207 kernel: [29476.608322] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 13:35:02 juju-e4d256-prod-github-runner-207 kernel: [29476.609296] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 13:35:02 juju-e4d256-prod-github-runner-207 kernel: [29476.610178] ? __seccomp_filter+0x4a/0x4a0 Aug 22 13:35:02 juju-e4d256-prod-github-runner-207 kernel: [29476.611007] ? __fget_files+0x86/0xc0 Aug 22 13:35:02 juju-e4d256-prod-github-runner-207 kernel: [29476.611784] __x64_sys_ioctl+0x95/0xd0 Aug 22 13:35:02 juju-e4d256-prod-github-runner-207 kernel: [29476.612551] do_syscall_64+0x5c/0xc0 Aug 22 13:35:02 juju-e4d256-prod-github-runner-207 kernel: [29476.613300] ? do_futex+0x162/0x1f0 Aug 22 13:35:02 juju-e4d256-prod-github-runner-207 kernel: [29476.614024] ? __x64_sys_futex+0x78/0x1e0 Aug 22 13:35:02 juju-e4d256-prod-github-runner-207 kernel: [29476.614777] ? __secure_computing+0xa9/0x120 Aug 22 13:35:02 juju-e4d256-prod-github-runner-207 kernel: [29476.615550] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 13:35:02 juju-e4d256-prod-github-runner-207 kernel: [29476.616423] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:35:02 juju-e4d256-prod-github-runner-207 kernel: [29476.617264] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:35:02 juju-e4d256-prod-github-runner-207 kernel: [29476.618081] ? do_syscall_64+0x69/0xc0 Aug 22 13:35:02 juju-e4d256-prod-github-runner-207 kernel: [29476.618806] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:35:02 juju-e4d256-prod-github-runner-207 kernel: [29476.619605] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:35:02 juju-e4d256-prod-github-runner-207 kernel: [29476.620394] ? do_syscall_64+0x69/0xc0 Aug 22 13:35:02 juju-e4d256-prod-github-runner-207 kernel: [29476.621111] ? do_syscall_64+0x69/0xc0 Aug 22 13:35:02 juju-e4d256-prod-github-runner-207 kernel: [29476.621810] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 13:35:02 juju-e4d256-prod-github-runner-207 kernel: [29476.622616] RIP: 0033:0x7faa5d0edaff Aug 22 13:35:02 juju-e4d256-prod-github-runner-207 kernel: [29476.623350] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 13:35:02 juju-e4d256-prod-github-runner-207 kernel: [29476.625693] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 13:35:02 juju-e4d256-prod-github-runner-207 kernel: [29476.626796] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 13:35:02 juju-e4d256-prod-github-runner-207 kernel: [29476.627826] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 13:35:02 juju-e4d256-prod-github-runner-207 kernel: [29476.628870] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 13:35:02 juju-e4d256-prod-github-runner-207 kernel: [29476.629888] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 13:35:02 juju-e4d256-prod-github-runner-207 kernel: [29476.630910] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 13:35:02 juju-e4d256-prod-github-runner-207 kernel: [29476.631938] Aug 22 13:35:30 juju-e4d256-prod-github-runner-207 kernel: [29504.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 27370s! [qemu-system-x86:6715] Aug 22 13:35:30 juju-e4d256-prod-github-runner-207 kernel: [29504.543921] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 13:35:30 juju-e4d256-prod-github-runner-207 kernel: [29504.544218] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 13:35:30 juju-e4d256-prod-github-runner-207 kernel: [29504.563769] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 13:35:30 juju-e4d256-prod-github-runner-207 kernel: [29504.565071] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 13:35:30 juju-e4d256-prod-github-runner-207 kernel: [29504.566472] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:35:30 juju-e4d256-prod-github-runner-207 kernel: [29504.567545] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 13:35:30 juju-e4d256-prod-github-runner-207 kernel: [29504.570267] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 13:35:30 juju-e4d256-prod-github-runner-207 kernel: [29504.571309] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 13:35:30 juju-e4d256-prod-github-runner-207 kernel: [29504.572494] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 13:35:30 juju-e4d256-prod-github-runner-207 kernel: [29504.573681] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 13:35:30 juju-e4d256-prod-github-runner-207 kernel: [29504.574840] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 13:35:30 juju-e4d256-prod-github-runner-207 kernel: [29504.576032] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 13:35:30 juju-e4d256-prod-github-runner-207 kernel: [29504.577213] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 13:35:30 juju-e4d256-prod-github-runner-207 kernel: [29504.578462] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 13:35:30 juju-e4d256-prod-github-runner-207 kernel: [29504.579623] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 13:35:30 juju-e4d256-prod-github-runner-207 kernel: [29504.580851] Call Trace: Aug 22 13:35:30 juju-e4d256-prod-github-runner-207 kernel: [29504.581769] Aug 22 13:35:30 juju-e4d256-prod-github-runner-207 kernel: [29504.582668] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:35:30 juju-e4d256-prod-github-runner-207 kernel: [29504.583699] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:35:30 juju-e4d256-prod-github-runner-207 kernel: [29504.584746] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:35:30 juju-e4d256-prod-github-runner-207 kernel: [29504.585883] ? show_regs.part.0+0x23/0x29 Aug 22 13:35:30 juju-e4d256-prod-github-runner-207 kernel: [29504.586965] ? show_regs.cold+0x8/0xd Aug 22 13:35:30 juju-e4d256-prod-github-runner-207 kernel: [29504.587945] ? watchdog_timer_fn+0x1be/0x220 Aug 22 13:35:30 juju-e4d256-prod-github-runner-207 kernel: [29504.588993] ? lockup_detector_update_enable+0x60/0x60 Aug 22 13:35:30 juju-e4d256-prod-github-runner-207 kernel: [29504.590060] ? __hrtimer_run_queues+0x107/0x230 Aug 22 13:35:30 juju-e4d256-prod-github-runner-207 kernel: [29504.591121] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 13:35:30 juju-e4d256-prod-github-runner-207 kernel: [29504.592157] ? hrtimer_interrupt+0x101/0x220 Aug 22 13:35:30 juju-e4d256-prod-github-runner-207 kernel: [29504.593201] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 13:35:30 juju-e4d256-prod-github-runner-207 kernel: [29504.594284] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 13:35:30 juju-e4d256-prod-github-runner-207 kernel: [29504.595335] Aug 22 13:35:30 juju-e4d256-prod-github-runner-207 kernel: [29504.596207] Aug 22 13:35:30 juju-e4d256-prod-github-runner-207 kernel: [29504.597087] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 13:35:30 juju-e4d256-prod-github-runner-207 kernel: [29504.598138] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:35:30 juju-e4d256-prod-github-runner-207 kernel: [29504.599205] ? _raw_spin_lock+0x22/0x30 Aug 22 13:35:30 juju-e4d256-prod-github-runner-207 kernel: [29504.600152] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:35:30 juju-e4d256-prod-github-runner-207 kernel: [29504.601194] direct_page_fault+0x206/0x310 [kvm] Aug 22 13:35:30 juju-e4d256-prod-github-runner-207 kernel: [29504.602222] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 13:35:30 juju-e4d256-prod-github-runner-207 kernel: [29504.603236] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 13:35:30 juju-e4d256-prod-github-runner-207 kernel: [29504.604249] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 13:35:30 juju-e4d256-prod-github-runner-207 kernel: [29504.605299] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 13:35:30 juju-e4d256-prod-github-runner-207 kernel: [29504.606244] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 13:35:30 juju-e4d256-prod-github-runner-207 kernel: [29504.607221] handle_exit+0x98/0x230 [kvm_amd] Aug 22 13:35:30 juju-e4d256-prod-github-runner-207 kernel: [29504.608120] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 13:35:30 juju-e4d256-prod-github-runner-207 kernel: [29504.609061] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 13:35:30 juju-e4d256-prod-github-runner-207 kernel: [29504.609990] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 13:35:30 juju-e4d256-prod-github-runner-207 kernel: [29504.611082] vcpu_run+0x62/0x2c0 [kvm] Aug 22 13:35:30 juju-e4d256-prod-github-runner-207 kernel: [29504.611895] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 13:35:30 juju-e4d256-prod-github-runner-207 kernel: [29504.612732] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 13:35:30 juju-e4d256-prod-github-runner-207 kernel: [29504.613594] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 13:35:30 juju-e4d256-prod-github-runner-207 kernel: [29504.614394] ? __seccomp_filter+0x4a/0x4a0 Aug 22 13:35:30 juju-e4d256-prod-github-runner-207 kernel: [29504.615152] ? __fget_files+0x86/0xc0 Aug 22 13:35:30 juju-e4d256-prod-github-runner-207 kernel: [29504.615875] __x64_sys_ioctl+0x95/0xd0 Aug 22 13:35:30 juju-e4d256-prod-github-runner-207 kernel: [29504.616617] do_syscall_64+0x5c/0xc0 Aug 22 13:35:30 juju-e4d256-prod-github-runner-207 kernel: [29504.617285] ? do_futex+0x162/0x1f0 Aug 22 13:35:30 juju-e4d256-prod-github-runner-207 kernel: [29504.617933] ? __x64_sys_futex+0x78/0x1e0 Aug 22 13:35:30 juju-e4d256-prod-github-runner-207 kernel: [29504.618610] ? __secure_computing+0xa9/0x120 Aug 22 13:35:30 juju-e4d256-prod-github-runner-207 kernel: [29504.619320] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 13:35:30 juju-e4d256-prod-github-runner-207 kernel: [29504.620084] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:35:30 juju-e4d256-prod-github-runner-207 kernel: [29504.620824] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:35:30 juju-e4d256-prod-github-runner-207 kernel: [29504.621548] ? do_syscall_64+0x69/0xc0 Aug 22 13:35:30 juju-e4d256-prod-github-runner-207 kernel: [29504.622192] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:35:30 juju-e4d256-prod-github-runner-207 kernel: [29504.622894] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:35:30 juju-e4d256-prod-github-runner-207 kernel: [29504.623593] ? do_syscall_64+0x69/0xc0 Aug 22 13:35:30 juju-e4d256-prod-github-runner-207 kernel: [29504.624232] ? do_syscall_64+0x69/0xc0 Aug 22 13:35:30 juju-e4d256-prod-github-runner-207 kernel: [29504.624920] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 13:35:30 juju-e4d256-prod-github-runner-207 kernel: [29504.625638] RIP: 0033:0x7faa5d0edaff Aug 22 13:35:30 juju-e4d256-prod-github-runner-207 kernel: [29504.626308] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 13:35:30 juju-e4d256-prod-github-runner-207 kernel: [29504.628301] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 13:35:30 juju-e4d256-prod-github-runner-207 kernel: [29504.629238] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 13:35:30 juju-e4d256-prod-github-runner-207 kernel: [29504.630139] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 13:35:30 juju-e4d256-prod-github-runner-207 kernel: [29504.631040] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 13:35:30 juju-e4d256-prod-github-runner-207 kernel: [29504.631953] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 13:35:30 juju-e4d256-prod-github-runner-207 kernel: [29504.632871] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 13:35:30 juju-e4d256-prod-github-runner-207 kernel: [29504.633763] Aug 22 13:35:45 juju-e4d256-prod-github-runner-207 kernel: [29519.156708] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 13:35:45 juju-e4d256-prod-github-runner-207 kernel: [29519.158473] rcu: 1-....: (7327532 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=3541174 Aug 22 13:35:45 juju-e4d256-prod-github-runner-207 kernel: [29519.159613] (t=7350489 jiffies g=23269 q=33077) Aug 22 13:35:45 juju-e4d256-prod-github-runner-207 kernel: [29519.160433] NMI backtrace for cpu 1 Aug 22 13:35:45 juju-e4d256-prod-github-runner-207 kernel: [29519.161153] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 13:35:45 juju-e4d256-prod-github-runner-207 kernel: [29519.162271] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 13:35:45 juju-e4d256-prod-github-runner-207 kernel: [29519.163364] Call Trace: Aug 22 13:35:45 juju-e4d256-prod-github-runner-207 kernel: [29519.164051] Aug 22 13:35:45 juju-e4d256-prod-github-runner-207 kernel: [29519.164748] show_stack+0x52/0x5c Aug 22 13:35:45 juju-e4d256-prod-github-runner-207 kernel: [29519.165476] dump_stack_lvl+0x4a/0x63 Aug 22 13:35:45 juju-e4d256-prod-github-runner-207 kernel: [29519.166223] dump_stack+0x10/0x16 Aug 22 13:35:45 juju-e4d256-prod-github-runner-207 kernel: [29519.166941] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 13:35:45 juju-e4d256-prod-github-runner-207 kernel: [29519.167723] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 13:35:45 juju-e4d256-prod-github-runner-207 kernel: [29519.168522] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 13:35:45 juju-e4d256-prod-github-runner-207 kernel: [29519.169338] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 13:35:45 juju-e4d256-prod-github-runner-207 kernel: [29519.170171] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 13:35:45 juju-e4d256-prod-github-runner-207 kernel: [29519.170979] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 13:35:45 juju-e4d256-prod-github-runner-207 kernel: [29519.171747] print_cpu_stall.cold+0x2f/0xe2 Aug 22 13:35:45 juju-e4d256-prod-github-runner-207 kernel: [29519.172546] ? timekeeping_update+0xf7/0x150 Aug 22 13:35:45 juju-e4d256-prod-github-runner-207 kernel: [29519.173314] check_cpu_stall+0x109/0x270 Aug 22 13:35:45 juju-e4d256-prod-github-runner-207 kernel: [29519.174065] rcu_sched_clock_irq+0x9a/0x250 Aug 22 13:35:45 juju-e4d256-prod-github-runner-207 kernel: [29519.174825] update_process_times+0x94/0xd0 Aug 22 13:35:45 juju-e4d256-prod-github-runner-207 kernel: [29519.175587] tick_sched_handle+0x29/0x70 Aug 22 13:35:45 juju-e4d256-prod-github-runner-207 kernel: [29519.176345] tick_sched_timer+0x8c/0xc0 Aug 22 13:35:45 juju-e4d256-prod-github-runner-207 kernel: [29519.177088] ? tick_nohz_handler+0xb0/0xb0 Aug 22 13:35:45 juju-e4d256-prod-github-runner-207 kernel: [29519.177839] __hrtimer_run_queues+0x107/0x230 Aug 22 13:35:45 juju-e4d256-prod-github-runner-207 kernel: [29519.178607] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 13:35:45 juju-e4d256-prod-github-runner-207 kernel: [29519.179378] hrtimer_interrupt+0x101/0x220 Aug 22 13:35:45 juju-e4d256-prod-github-runner-207 kernel: [29519.180140] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 13:35:45 juju-e4d256-prod-github-runner-207 kernel: [29519.180970] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 13:35:45 juju-e4d256-prod-github-runner-207 kernel: [29519.181770] Aug 22 13:35:45 juju-e4d256-prod-github-runner-207 kernel: [29519.182402] Aug 22 13:35:45 juju-e4d256-prod-github-runner-207 kernel: [29519.183028] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 13:35:45 juju-e4d256-prod-github-runner-207 kernel: [29519.183844] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:35:45 juju-e4d256-prod-github-runner-207 kernel: [29519.184739] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 13:35:45 juju-e4d256-prod-github-runner-207 kernel: [29519.187130] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 13:35:45 juju-e4d256-prod-github-runner-207 kernel: [29519.188033] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 13:35:45 juju-e4d256-prod-github-runner-207 kernel: [29519.189068] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 13:35:45 juju-e4d256-prod-github-runner-207 kernel: [29519.190073] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 13:35:45 juju-e4d256-prod-github-runner-207 kernel: [29519.191045] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 13:35:45 juju-e4d256-prod-github-runner-207 kernel: [29519.192094] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 13:35:45 juju-e4d256-prod-github-runner-207 kernel: [29519.193064] ? _raw_spin_lock+0x22/0x30 Aug 22 13:35:45 juju-e4d256-prod-github-runner-207 kernel: [29519.193833] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:35:45 juju-e4d256-prod-github-runner-207 kernel: [29519.194695] direct_page_fault+0x206/0x310 [kvm] Aug 22 13:35:45 juju-e4d256-prod-github-runner-207 kernel: [29519.195530] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 13:35:45 juju-e4d256-prod-github-runner-207 kernel: [29519.196377] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 13:35:45 juju-e4d256-prod-github-runner-207 kernel: [29519.197225] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 13:35:45 juju-e4d256-prod-github-runner-207 kernel: [29519.198084] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 13:35:45 juju-e4d256-prod-github-runner-207 kernel: [29519.198866] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 13:35:45 juju-e4d256-prod-github-runner-207 kernel: [29519.199691] handle_exit+0x98/0x230 [kvm_amd] Aug 22 13:35:45 juju-e4d256-prod-github-runner-207 kernel: [29519.200494] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 13:35:45 juju-e4d256-prod-github-runner-207 kernel: [29519.201291] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 13:35:45 juju-e4d256-prod-github-runner-207 kernel: [29519.202094] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 13:35:45 juju-e4d256-prod-github-runner-207 kernel: [29519.202901] vcpu_run+0x62/0x2c0 [kvm] Aug 22 13:35:45 juju-e4d256-prod-github-runner-207 kernel: [29519.203629] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 13:35:45 juju-e4d256-prod-github-runner-207 kernel: [29519.204380] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 13:35:45 juju-e4d256-prod-github-runner-207 kernel: [29519.205219] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 13:35:45 juju-e4d256-prod-github-runner-207 kernel: [29519.205978] ? __seccomp_filter+0x4a/0x4a0 Aug 22 13:35:45 juju-e4d256-prod-github-runner-207 kernel: [29519.206695] ? __fget_files+0x86/0xc0 Aug 22 13:35:45 juju-e4d256-prod-github-runner-207 kernel: [29519.207385] __x64_sys_ioctl+0x95/0xd0 Aug 22 13:35:45 juju-e4d256-prod-github-runner-207 kernel: [29519.208083] do_syscall_64+0x5c/0xc0 Aug 22 13:35:45 juju-e4d256-prod-github-runner-207 kernel: [29519.208778] ? do_futex+0x162/0x1f0 Aug 22 13:35:45 juju-e4d256-prod-github-runner-207 kernel: [29519.209446] ? __x64_sys_futex+0x78/0x1e0 Aug 22 13:35:45 juju-e4d256-prod-github-runner-207 kernel: [29519.210160] ? __secure_computing+0xa9/0x120 Aug 22 13:35:45 juju-e4d256-prod-github-runner-207 kernel: [29519.210885] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 13:35:45 juju-e4d256-prod-github-runner-207 kernel: [29519.211679] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:35:45 juju-e4d256-prod-github-runner-207 kernel: [29519.212447] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:35:45 juju-e4d256-prod-github-runner-207 kernel: [29519.213203] ? do_syscall_64+0x69/0xc0 Aug 22 13:35:45 juju-e4d256-prod-github-runner-207 kernel: [29519.213896] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:35:45 juju-e4d256-prod-github-runner-207 kernel: [29519.214649] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:35:45 juju-e4d256-prod-github-runner-207 kernel: [29519.215407] ? do_syscall_64+0x69/0xc0 Aug 22 13:35:45 juju-e4d256-prod-github-runner-207 kernel: [29519.216100] ? do_syscall_64+0x69/0xc0 Aug 22 13:35:45 juju-e4d256-prod-github-runner-207 kernel: [29519.216807] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 13:35:45 juju-e4d256-prod-github-runner-207 kernel: [29519.217575] RIP: 0033:0x7faa5d0edaff Aug 22 13:35:45 juju-e4d256-prod-github-runner-207 kernel: [29519.218278] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 13:35:45 juju-e4d256-prod-github-runner-207 kernel: [29519.220435] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 13:35:45 juju-e4d256-prod-github-runner-207 kernel: [29519.221431] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 13:35:45 juju-e4d256-prod-github-runner-207 kernel: [29519.222378] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 13:35:45 juju-e4d256-prod-github-runner-207 kernel: [29519.223320] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 13:35:45 juju-e4d256-prod-github-runner-207 kernel: [29519.224285] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 13:35:45 juju-e4d256-prod-github-runner-207 kernel: [29519.225211] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 13:35:45 juju-e4d256-prod-github-runner-207 kernel: [29519.226130] Aug 22 13:36:10 juju-e4d256-prod-github-runner-207 kernel: [29544.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 27407s! [qemu-system-x86:6715] Aug 22 13:36:10 juju-e4d256-prod-github-runner-207 kernel: [29544.543864] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 13:36:10 juju-e4d256-prod-github-runner-207 kernel: [29544.544179] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 13:36:10 juju-e4d256-prod-github-runner-207 kernel: [29544.556624] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 13:36:10 juju-e4d256-prod-github-runner-207 kernel: [29544.557934] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 13:36:10 juju-e4d256-prod-github-runner-207 kernel: [29544.559205] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:36:10 juju-e4d256-prod-github-runner-207 kernel: [29544.560302] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 13:36:10 juju-e4d256-prod-github-runner-207 kernel: [29544.562942] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 13:36:10 juju-e4d256-prod-github-runner-207 kernel: [29544.564064] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 13:36:10 juju-e4d256-prod-github-runner-207 kernel: [29544.565439] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 13:36:10 juju-e4d256-prod-github-runner-207 kernel: [29544.566754] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 13:36:10 juju-e4d256-prod-github-runner-207 kernel: [29544.568071] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 13:36:10 juju-e4d256-prod-github-runner-207 kernel: [29544.569402] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 13:36:10 juju-e4d256-prod-github-runner-207 kernel: [29544.570737] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 13:36:10 juju-e4d256-prod-github-runner-207 kernel: [29544.572165] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 13:36:10 juju-e4d256-prod-github-runner-207 kernel: [29544.573386] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 13:36:10 juju-e4d256-prod-github-runner-207 kernel: [29544.574743] Call Trace: Aug 22 13:36:10 juju-e4d256-prod-github-runner-207 kernel: [29544.575755] Aug 22 13:36:10 juju-e4d256-prod-github-runner-207 kernel: [29544.576745] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:36:10 juju-e4d256-prod-github-runner-207 kernel: [29544.577914] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:36:10 juju-e4d256-prod-github-runner-207 kernel: [29544.579059] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:36:10 juju-e4d256-prod-github-runner-207 kernel: [29544.580293] ? show_regs.part.0+0x23/0x29 Aug 22 13:36:10 juju-e4d256-prod-github-runner-207 kernel: [29544.581378] ? show_regs.cold+0x8/0xd Aug 22 13:36:10 juju-e4d256-prod-github-runner-207 kernel: [29544.582426] ? watchdog_timer_fn+0x1be/0x220 Aug 22 13:36:10 juju-e4d256-prod-github-runner-207 kernel: [29544.583525] ? lockup_detector_update_enable+0x60/0x60 Aug 22 13:36:10 juju-e4d256-prod-github-runner-207 kernel: [29544.584712] ? __hrtimer_run_queues+0x107/0x230 Aug 22 13:36:10 juju-e4d256-prod-github-runner-207 kernel: [29544.585875] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 13:36:10 juju-e4d256-prod-github-runner-207 kernel: [29544.587063] ? hrtimer_interrupt+0x101/0x220 Aug 22 13:36:10 juju-e4d256-prod-github-runner-207 kernel: [29544.588190] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 13:36:10 juju-e4d256-prod-github-runner-207 kernel: [29544.589374] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 13:36:10 juju-e4d256-prod-github-runner-207 kernel: [29544.590550] Aug 22 13:36:10 juju-e4d256-prod-github-runner-207 kernel: [29544.591491] Aug 22 13:36:10 juju-e4d256-prod-github-runner-207 kernel: [29544.592429] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 13:36:10 juju-e4d256-prod-github-runner-207 kernel: [29544.593589] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:36:10 juju-e4d256-prod-github-runner-207 kernel: [29544.594739] ? _raw_spin_lock+0x22/0x30 Aug 22 13:36:10 juju-e4d256-prod-github-runner-207 kernel: [29544.595768] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:36:10 juju-e4d256-prod-github-runner-207 kernel: [29544.596904] direct_page_fault+0x206/0x310 [kvm] Aug 22 13:36:10 juju-e4d256-prod-github-runner-207 kernel: [29544.598028] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 13:36:10 juju-e4d256-prod-github-runner-207 kernel: [29544.599130] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 13:36:10 juju-e4d256-prod-github-runner-207 kernel: [29544.600251] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 13:36:10 juju-e4d256-prod-github-runner-207 kernel: [29544.601369] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 13:36:10 juju-e4d256-prod-github-runner-207 kernel: [29544.602414] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 13:36:10 juju-e4d256-prod-github-runner-207 kernel: [29544.603512] handle_exit+0x98/0x230 [kvm_amd] Aug 22 13:36:10 juju-e4d256-prod-github-runner-207 kernel: [29544.604520] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 13:36:10 juju-e4d256-prod-github-runner-207 kernel: [29544.605531] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 13:36:10 juju-e4d256-prod-github-runner-207 kernel: [29544.606557] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 13:36:10 juju-e4d256-prod-github-runner-207 kernel: [29544.607566] vcpu_run+0x62/0x2c0 [kvm] Aug 22 13:36:10 juju-e4d256-prod-github-runner-207 kernel: [29544.608478] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 13:36:10 juju-e4d256-prod-github-runner-207 kernel: [29544.609385] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 13:36:10 juju-e4d256-prod-github-runner-207 kernel: [29544.610343] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 13:36:10 juju-e4d256-prod-github-runner-207 kernel: [29544.611237] ? __seccomp_filter+0x4a/0x4a0 Aug 22 13:36:10 juju-e4d256-prod-github-runner-207 kernel: [29544.612085] ? __fget_files+0x86/0xc0 Aug 22 13:36:10 juju-e4d256-prod-github-runner-207 kernel: [29544.612871] __x64_sys_ioctl+0x95/0xd0 Aug 22 13:36:10 juju-e4d256-prod-github-runner-207 kernel: [29544.613641] do_syscall_64+0x5c/0xc0 Aug 22 13:36:10 juju-e4d256-prod-github-runner-207 kernel: [29544.614384] ? do_futex+0x162/0x1f0 Aug 22 13:36:10 juju-e4d256-prod-github-runner-207 kernel: [29544.615117] ? __x64_sys_futex+0x78/0x1e0 Aug 22 13:36:10 juju-e4d256-prod-github-runner-207 kernel: [29544.615891] ? __secure_computing+0xa9/0x120 Aug 22 13:36:10 juju-e4d256-prod-github-runner-207 kernel: [29544.616685] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 13:36:10 juju-e4d256-prod-github-runner-207 kernel: [29544.617556] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:36:10 juju-e4d256-prod-github-runner-207 kernel: [29544.618381] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:36:10 juju-e4d256-prod-github-runner-207 kernel: [29544.619198] ? do_syscall_64+0x69/0xc0 Aug 22 13:36:10 juju-e4d256-prod-github-runner-207 kernel: [29544.619951] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:36:10 juju-e4d256-prod-github-runner-207 kernel: [29544.620755] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:36:10 juju-e4d256-prod-github-runner-207 kernel: [29544.621548] ? do_syscall_64+0x69/0xc0 Aug 22 13:36:10 juju-e4d256-prod-github-runner-207 kernel: [29544.622251] ? do_syscall_64+0x69/0xc0 Aug 22 13:36:10 juju-e4d256-prod-github-runner-207 kernel: [29544.622950] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 13:36:10 juju-e4d256-prod-github-runner-207 kernel: [29544.623785] RIP: 0033:0x7faa5d0edaff Aug 22 13:36:10 juju-e4d256-prod-github-runner-207 kernel: [29544.624563] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 13:36:10 juju-e4d256-prod-github-runner-207 kernel: [29544.626951] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 13:36:10 juju-e4d256-prod-github-runner-207 kernel: [29544.627896] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 13:36:10 juju-e4d256-prod-github-runner-207 kernel: [29544.628811] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 13:36:10 juju-e4d256-prod-github-runner-207 kernel: [29544.630447] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 13:36:10 juju-e4d256-prod-github-runner-207 kernel: [29544.631350] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 13:36:10 juju-e4d256-prod-github-runner-207 kernel: [29544.632698] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 13:36:10 juju-e4d256-prod-github-runner-207 kernel: [29544.633822] Aug 22 13:36:38 juju-e4d256-prod-github-runner-207 kernel: [29572.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 27433s! [qemu-system-x86:6715] Aug 22 13:36:38 juju-e4d256-prod-github-runner-207 kernel: [29572.543941] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 13:36:38 juju-e4d256-prod-github-runner-207 kernel: [29572.544250] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 13:36:38 juju-e4d256-prod-github-runner-207 kernel: [29572.556706] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 13:36:38 juju-e4d256-prod-github-runner-207 kernel: [29572.558008] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 13:36:38 juju-e4d256-prod-github-runner-207 kernel: [29572.559272] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:36:38 juju-e4d256-prod-github-runner-207 kernel: [29572.560357] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 13:36:38 juju-e4d256-prod-github-runner-207 kernel: [29572.562971] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 13:36:38 juju-e4d256-prod-github-runner-207 kernel: [29572.564057] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 13:36:38 juju-e4d256-prod-github-runner-207 kernel: [29572.565251] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 13:36:38 juju-e4d256-prod-github-runner-207 kernel: [29572.566477] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 13:36:38 juju-e4d256-prod-github-runner-207 kernel: [29572.567748] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 13:36:38 juju-e4d256-prod-github-runner-207 kernel: [29572.568945] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 13:36:38 juju-e4d256-prod-github-runner-207 kernel: [29572.570144] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 13:36:38 juju-e4d256-prod-github-runner-207 kernel: [29572.571409] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 13:36:38 juju-e4d256-prod-github-runner-207 kernel: [29572.572538] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 13:36:38 juju-e4d256-prod-github-runner-207 kernel: [29572.573756] Call Trace: Aug 22 13:36:38 juju-e4d256-prod-github-runner-207 kernel: [29572.574677] Aug 22 13:36:38 juju-e4d256-prod-github-runner-207 kernel: [29572.575598] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:36:38 juju-e4d256-prod-github-runner-207 kernel: [29572.576675] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:36:38 juju-e4d256-prod-github-runner-207 kernel: [29572.577761] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:36:38 juju-e4d256-prod-github-runner-207 kernel: [29572.578916] ? show_regs.part.0+0x23/0x29 Aug 22 13:36:38 juju-e4d256-prod-github-runner-207 kernel: [29572.580157] ? show_regs.cold+0x8/0xd Aug 22 13:36:38 juju-e4d256-prod-github-runner-207 kernel: [29572.581400] ? watchdog_timer_fn+0x1be/0x220 Aug 22 13:36:38 juju-e4d256-prod-github-runner-207 kernel: [29572.582826] ? lockup_detector_update_enable+0x60/0x60 Aug 22 13:36:38 juju-e4d256-prod-github-runner-207 kernel: [29572.584085] ? __hrtimer_run_queues+0x107/0x230 Aug 22 13:36:38 juju-e4d256-prod-github-runner-207 kernel: [29572.585139] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 13:36:38 juju-e4d256-prod-github-runner-207 kernel: [29572.586180] ? hrtimer_interrupt+0x101/0x220 Aug 22 13:36:38 juju-e4d256-prod-github-runner-207 kernel: [29572.587220] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 13:36:38 juju-e4d256-prod-github-runner-207 kernel: [29572.588320] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 13:36:38 juju-e4d256-prod-github-runner-207 kernel: [29572.589385] Aug 22 13:36:38 juju-e4d256-prod-github-runner-207 kernel: [29572.590248] Aug 22 13:36:38 juju-e4d256-prod-github-runner-207 kernel: [29572.591103] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 13:36:38 juju-e4d256-prod-github-runner-207 kernel: [29572.592187] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:36:38 juju-e4d256-prod-github-runner-207 kernel: [29572.593253] ? _raw_spin_lock+0x22/0x30 Aug 22 13:36:38 juju-e4d256-prod-github-runner-207 kernel: [29572.594215] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:36:38 juju-e4d256-prod-github-runner-207 kernel: [29572.595254] direct_page_fault+0x206/0x310 [kvm] Aug 22 13:36:38 juju-e4d256-prod-github-runner-207 kernel: [29572.596309] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 13:36:38 juju-e4d256-prod-github-runner-207 kernel: [29572.597337] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 13:36:38 juju-e4d256-prod-github-runner-207 kernel: [29572.598352] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 13:36:38 juju-e4d256-prod-github-runner-207 kernel: [29572.599365] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 13:36:38 juju-e4d256-prod-github-runner-207 kernel: [29572.600335] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 13:36:38 juju-e4d256-prod-github-runner-207 kernel: [29572.601330] handle_exit+0x98/0x230 [kvm_amd] Aug 22 13:36:38 juju-e4d256-prod-github-runner-207 kernel: [29572.602280] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 13:36:38 juju-e4d256-prod-github-runner-207 kernel: [29572.603254] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 13:36:38 juju-e4d256-prod-github-runner-207 kernel: [29572.604215] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 13:36:38 juju-e4d256-prod-github-runner-207 kernel: [29572.605133] vcpu_run+0x62/0x2c0 [kvm] Aug 22 13:36:38 juju-e4d256-prod-github-runner-207 kernel: [29572.605958] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 13:36:38 juju-e4d256-prod-github-runner-207 kernel: [29572.606782] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 13:36:38 juju-e4d256-prod-github-runner-207 kernel: [29572.607663] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 13:36:38 juju-e4d256-prod-github-runner-207 kernel: [29572.608483] ? __seccomp_filter+0x4a/0x4a0 Aug 22 13:36:38 juju-e4d256-prod-github-runner-207 kernel: [29572.609241] ? __fget_files+0x86/0xc0 Aug 22 13:36:38 juju-e4d256-prod-github-runner-207 kernel: [29572.609956] __x64_sys_ioctl+0x95/0xd0 Aug 22 13:36:38 juju-e4d256-prod-github-runner-207 kernel: [29572.610667] do_syscall_64+0x5c/0xc0 Aug 22 13:36:38 juju-e4d256-prod-github-runner-207 kernel: [29572.611343] ? do_futex+0x162/0x1f0 Aug 22 13:36:38 juju-e4d256-prod-github-runner-207 kernel: [29572.612012] ? __x64_sys_futex+0x78/0x1e0 Aug 22 13:36:38 juju-e4d256-prod-github-runner-207 kernel: [29572.612699] ? __secure_computing+0xa9/0x120 Aug 22 13:36:38 juju-e4d256-prod-github-runner-207 kernel: [29572.613423] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 13:36:38 juju-e4d256-prod-github-runner-207 kernel: [29572.614198] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:36:38 juju-e4d256-prod-github-runner-207 kernel: [29572.614934] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:36:38 juju-e4d256-prod-github-runner-207 kernel: [29572.615673] ? do_syscall_64+0x69/0xc0 Aug 22 13:36:38 juju-e4d256-prod-github-runner-207 kernel: [29572.616331] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:36:38 juju-e4d256-prod-github-runner-207 kernel: [29572.617048] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:36:38 juju-e4d256-prod-github-runner-207 kernel: [29572.617758] ? do_syscall_64+0x69/0xc0 Aug 22 13:36:38 juju-e4d256-prod-github-runner-207 kernel: [29572.618401] ? do_syscall_64+0x69/0xc0 Aug 22 13:36:38 juju-e4d256-prod-github-runner-207 kernel: [29572.619040] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 13:36:38 juju-e4d256-prod-github-runner-207 kernel: [29572.619768] RIP: 0033:0x7faa5d0edaff Aug 22 13:36:38 juju-e4d256-prod-github-runner-207 kernel: [29572.620500] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 13:36:38 juju-e4d256-prod-github-runner-207 kernel: [29572.622756] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 13:36:38 juju-e4d256-prod-github-runner-207 kernel: [29572.623715] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 13:36:38 juju-e4d256-prod-github-runner-207 kernel: [29572.624631] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 13:36:38 juju-e4d256-prod-github-runner-207 kernel: [29572.625554] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 13:36:38 juju-e4d256-prod-github-runner-207 kernel: [29572.626463] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 13:36:38 juju-e4d256-prod-github-runner-207 kernel: [29572.627374] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 13:36:38 juju-e4d256-prod-github-runner-207 kernel: [29572.628309] Aug 22 13:37:06 juju-e4d256-prod-github-runner-207 kernel: [29600.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 27459s! [qemu-system-x86:6715] Aug 22 13:37:06 juju-e4d256-prod-github-runner-207 kernel: [29600.543919] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 13:37:06 juju-e4d256-prod-github-runner-207 kernel: [29600.544225] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 13:37:06 juju-e4d256-prod-github-runner-207 kernel: [29600.556687] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 13:37:06 juju-e4d256-prod-github-runner-207 kernel: [29600.557982] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 13:37:06 juju-e4d256-prod-github-runner-207 kernel: [29600.559209] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:37:06 juju-e4d256-prod-github-runner-207 kernel: [29600.560285] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 13:37:06 juju-e4d256-prod-github-runner-207 kernel: [29600.562833] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 13:37:06 juju-e4d256-prod-github-runner-207 kernel: [29600.563885] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 13:37:06 juju-e4d256-prod-github-runner-207 kernel: [29600.565046] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 13:37:06 juju-e4d256-prod-github-runner-207 kernel: [29600.566211] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 13:37:06 juju-e4d256-prod-github-runner-207 kernel: [29600.567383] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 13:37:06 juju-e4d256-prod-github-runner-207 kernel: [29600.568658] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 13:37:06 juju-e4d256-prod-github-runner-207 kernel: [29600.569854] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 13:37:06 juju-e4d256-prod-github-runner-207 kernel: [29600.571160] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 13:37:06 juju-e4d256-prod-github-runner-207 kernel: [29600.572558] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 13:37:06 juju-e4d256-prod-github-runner-207 kernel: [29600.573860] Call Trace: Aug 22 13:37:06 juju-e4d256-prod-github-runner-207 kernel: [29600.574788] Aug 22 13:37:06 juju-e4d256-prod-github-runner-207 kernel: [29600.575748] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:37:06 juju-e4d256-prod-github-runner-207 kernel: [29600.576881] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:37:06 juju-e4d256-prod-github-runner-207 kernel: [29600.577926] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:37:06 juju-e4d256-prod-github-runner-207 kernel: [29600.579042] ? show_regs.part.0+0x23/0x29 Aug 22 13:37:06 juju-e4d256-prod-github-runner-207 kernel: [29600.580057] ? show_regs.cold+0x8/0xd Aug 22 13:37:06 juju-e4d256-prod-github-runner-207 kernel: [29600.581030] ? watchdog_timer_fn+0x1be/0x220 Aug 22 13:37:06 juju-e4d256-prod-github-runner-207 kernel: [29600.582041] ? lockup_detector_update_enable+0x60/0x60 Aug 22 13:37:06 juju-e4d256-prod-github-runner-207 kernel: [29600.583113] ? __hrtimer_run_queues+0x107/0x230 Aug 22 13:37:06 juju-e4d256-prod-github-runner-207 kernel: [29600.584160] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 13:37:06 juju-e4d256-prod-github-runner-207 kernel: [29600.585200] ? hrtimer_interrupt+0x101/0x220 Aug 22 13:37:06 juju-e4d256-prod-github-runner-207 kernel: [29600.586277] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 13:37:06 juju-e4d256-prod-github-runner-207 kernel: [29600.587455] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 13:37:06 juju-e4d256-prod-github-runner-207 kernel: [29600.588609] Aug 22 13:37:06 juju-e4d256-prod-github-runner-207 kernel: [29600.589510] Aug 22 13:37:06 juju-e4d256-prod-github-runner-207 kernel: [29600.590397] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 13:37:06 juju-e4d256-prod-github-runner-207 kernel: [29600.591488] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:37:06 juju-e4d256-prod-github-runner-207 kernel: [29600.592545] ? _raw_spin_lock+0x22/0x30 Aug 22 13:37:06 juju-e4d256-prod-github-runner-207 kernel: [29600.593828] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:37:06 juju-e4d256-prod-github-runner-207 kernel: [29600.594952] direct_page_fault+0x206/0x310 [kvm] Aug 22 13:37:06 juju-e4d256-prod-github-runner-207 kernel: [29600.596052] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 13:37:06 juju-e4d256-prod-github-runner-207 kernel: [29600.597094] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 13:37:06 juju-e4d256-prod-github-runner-207 kernel: [29600.598253] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 13:37:06 juju-e4d256-prod-github-runner-207 kernel: [29600.599299] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 13:37:06 juju-e4d256-prod-github-runner-207 kernel: [29600.600258] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 13:37:06 juju-e4d256-prod-github-runner-207 kernel: [29600.601255] handle_exit+0x98/0x230 [kvm_amd] Aug 22 13:37:06 juju-e4d256-prod-github-runner-207 kernel: [29600.602169] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 13:37:06 juju-e4d256-prod-github-runner-207 kernel: [29600.603097] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 13:37:06 juju-e4d256-prod-github-runner-207 kernel: [29600.604046] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 13:37:06 juju-e4d256-prod-github-runner-207 kernel: [29600.604955] vcpu_run+0x62/0x2c0 [kvm] Aug 22 13:37:06 juju-e4d256-prod-github-runner-207 kernel: [29600.605796] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 13:37:06 juju-e4d256-prod-github-runner-207 kernel: [29600.606628] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 13:37:06 juju-e4d256-prod-github-runner-207 kernel: [29600.607677] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 13:37:06 juju-e4d256-prod-github-runner-207 kernel: [29600.608484] ? __seccomp_filter+0x4a/0x4a0 Aug 22 13:37:06 juju-e4d256-prod-github-runner-207 kernel: [29600.609230] ? __fget_files+0x86/0xc0 Aug 22 13:37:06 juju-e4d256-prod-github-runner-207 kernel: [29600.609937] __x64_sys_ioctl+0x95/0xd0 Aug 22 13:37:06 juju-e4d256-prod-github-runner-207 kernel: [29600.610644] do_syscall_64+0x5c/0xc0 Aug 22 13:37:06 juju-e4d256-prod-github-runner-207 kernel: [29600.611344] ? do_futex+0x162/0x1f0 Aug 22 13:37:06 juju-e4d256-prod-github-runner-207 kernel: [29600.612023] ? __x64_sys_futex+0x78/0x1e0 Aug 22 13:37:06 juju-e4d256-prod-github-runner-207 kernel: [29600.612715] ? __secure_computing+0xa9/0x120 Aug 22 13:37:06 juju-e4d256-prod-github-runner-207 kernel: [29600.613409] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 13:37:06 juju-e4d256-prod-github-runner-207 kernel: [29600.614173] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:37:06 juju-e4d256-prod-github-runner-207 kernel: [29600.614902] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:37:06 juju-e4d256-prod-github-runner-207 kernel: [29600.615639] ? do_syscall_64+0x69/0xc0 Aug 22 13:37:06 juju-e4d256-prod-github-runner-207 kernel: [29600.616322] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:37:06 juju-e4d256-prod-github-runner-207 kernel: [29600.617052] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:37:06 juju-e4d256-prod-github-runner-207 kernel: [29600.617767] ? do_syscall_64+0x69/0xc0 Aug 22 13:37:06 juju-e4d256-prod-github-runner-207 kernel: [29600.618398] ? do_syscall_64+0x69/0xc0 Aug 22 13:37:06 juju-e4d256-prod-github-runner-207 kernel: [29600.619022] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 13:37:06 juju-e4d256-prod-github-runner-207 kernel: [29600.619743] RIP: 0033:0x7faa5d0edaff Aug 22 13:37:06 juju-e4d256-prod-github-runner-207 kernel: [29600.620406] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 13:37:06 juju-e4d256-prod-github-runner-207 kernel: [29600.622448] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 13:37:06 juju-e4d256-prod-github-runner-207 kernel: [29600.623387] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 13:37:06 juju-e4d256-prod-github-runner-207 kernel: [29600.624281] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 13:37:06 juju-e4d256-prod-github-runner-207 kernel: [29600.625176] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 13:37:06 juju-e4d256-prod-github-runner-207 kernel: [29600.626090] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 13:37:06 juju-e4d256-prod-github-runner-207 kernel: [29600.626995] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 13:37:06 juju-e4d256-prod-github-runner-207 kernel: [29600.627924] Aug 22 13:37:34 juju-e4d256-prod-github-runner-207 kernel: [29628.541976] watchdog: BUG: soft lockup - CPU#1 stuck for 27485s! [qemu-system-x86:6715] Aug 22 13:37:34 juju-e4d256-prod-github-runner-207 kernel: [29628.543911] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 13:37:34 juju-e4d256-prod-github-runner-207 kernel: [29628.544200] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 13:37:34 juju-e4d256-prod-github-runner-207 kernel: [29628.556598] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 13:37:34 juju-e4d256-prod-github-runner-207 kernel: [29628.557892] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 13:37:34 juju-e4d256-prod-github-runner-207 kernel: [29628.559149] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:37:34 juju-e4d256-prod-github-runner-207 kernel: [29628.560237] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 13:37:34 juju-e4d256-prod-github-runner-207 kernel: [29628.562844] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 13:37:34 juju-e4d256-prod-github-runner-207 kernel: [29628.563909] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 13:37:34 juju-e4d256-prod-github-runner-207 kernel: [29628.565093] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 13:37:34 juju-e4d256-prod-github-runner-207 kernel: [29628.566273] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 13:37:34 juju-e4d256-prod-github-runner-207 kernel: [29628.567460] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 13:37:34 juju-e4d256-prod-github-runner-207 kernel: [29628.568654] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 13:37:34 juju-e4d256-prod-github-runner-207 kernel: [29628.569844] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 13:37:34 juju-e4d256-prod-github-runner-207 kernel: [29628.571114] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 13:37:34 juju-e4d256-prod-github-runner-207 kernel: [29628.572231] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 13:37:34 juju-e4d256-prod-github-runner-207 kernel: [29628.573450] Call Trace: Aug 22 13:37:34 juju-e4d256-prod-github-runner-207 kernel: [29628.574367] Aug 22 13:37:34 juju-e4d256-prod-github-runner-207 kernel: [29628.575281] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:37:34 juju-e4d256-prod-github-runner-207 kernel: [29628.576330] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:37:34 juju-e4d256-prod-github-runner-207 kernel: [29628.577364] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:37:34 juju-e4d256-prod-github-runner-207 kernel: [29628.578484] ? show_regs.part.0+0x23/0x29 Aug 22 13:37:34 juju-e4d256-prod-github-runner-207 kernel: [29628.579503] ? show_regs.cold+0x8/0xd Aug 22 13:37:34 juju-e4d256-prod-github-runner-207 kernel: [29628.580485] ? watchdog_timer_fn+0x1be/0x220 Aug 22 13:37:34 juju-e4d256-prod-github-runner-207 kernel: [29628.581519] ? lockup_detector_update_enable+0x60/0x60 Aug 22 13:37:34 juju-e4d256-prod-github-runner-207 kernel: [29628.582595] ? __hrtimer_run_queues+0x107/0x230 Aug 22 13:37:34 juju-e4d256-prod-github-runner-207 kernel: [29628.583643] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 13:37:34 juju-e4d256-prod-github-runner-207 kernel: [29628.584683] ? hrtimer_interrupt+0x101/0x220 Aug 22 13:37:34 juju-e4d256-prod-github-runner-207 kernel: [29628.585711] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 13:37:34 juju-e4d256-prod-github-runner-207 kernel: [29628.586795] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 13:37:34 juju-e4d256-prod-github-runner-207 kernel: [29628.587864] Aug 22 13:37:34 juju-e4d256-prod-github-runner-207 kernel: [29628.588723] Aug 22 13:37:34 juju-e4d256-prod-github-runner-207 kernel: [29628.589568] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 13:37:34 juju-e4d256-prod-github-runner-207 kernel: [29628.590619] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:37:34 juju-e4d256-prod-github-runner-207 kernel: [29628.591687] ? _raw_spin_lock+0x22/0x30 Aug 22 13:37:34 juju-e4d256-prod-github-runner-207 kernel: [29628.592642] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:37:34 juju-e4d256-prod-github-runner-207 kernel: [29628.593676] direct_page_fault+0x206/0x310 [kvm] Aug 22 13:37:34 juju-e4d256-prod-github-runner-207 kernel: [29628.594714] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 13:37:34 juju-e4d256-prod-github-runner-207 kernel: [29628.595742] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 13:37:34 juju-e4d256-prod-github-runner-207 kernel: [29628.596758] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 13:37:34 juju-e4d256-prod-github-runner-207 kernel: [29628.597778] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 13:37:34 juju-e4d256-prod-github-runner-207 kernel: [29628.598737] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 13:37:34 juju-e4d256-prod-github-runner-207 kernel: [29628.599840] handle_exit+0x98/0x230 [kvm_amd] Aug 22 13:37:34 juju-e4d256-prod-github-runner-207 kernel: [29628.600796] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 13:37:34 juju-e4d256-prod-github-runner-207 kernel: [29628.601732] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 13:37:34 juju-e4d256-prod-github-runner-207 kernel: [29628.602673] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 13:37:34 juju-e4d256-prod-github-runner-207 kernel: [29628.603612] vcpu_run+0x62/0x2c0 [kvm] Aug 22 13:37:34 juju-e4d256-prod-github-runner-207 kernel: [29628.604435] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 13:37:34 juju-e4d256-prod-github-runner-207 kernel: [29628.605259] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 13:37:34 juju-e4d256-prod-github-runner-207 kernel: [29628.606132] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 13:37:34 juju-e4d256-prod-github-runner-207 kernel: [29628.606954] ? __seccomp_filter+0x4a/0x4a0 Aug 22 13:37:34 juju-e4d256-prod-github-runner-207 kernel: [29628.607718] ? __fget_files+0x86/0xc0 Aug 22 13:37:34 juju-e4d256-prod-github-runner-207 kernel: [29628.608437] __x64_sys_ioctl+0x95/0xd0 Aug 22 13:37:34 juju-e4d256-prod-github-runner-207 kernel: [29628.609145] do_syscall_64+0x5c/0xc0 Aug 22 13:37:34 juju-e4d256-prod-github-runner-207 kernel: [29628.609828] ? do_futex+0x162/0x1f0 Aug 22 13:37:34 juju-e4d256-prod-github-runner-207 kernel: [29628.610487] ? __x64_sys_futex+0x78/0x1e0 Aug 22 13:37:34 juju-e4d256-prod-github-runner-207 kernel: [29628.611186] ? __secure_computing+0xa9/0x120 Aug 22 13:37:34 juju-e4d256-prod-github-runner-207 kernel: [29628.611895] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 13:37:34 juju-e4d256-prod-github-runner-207 kernel: [29628.612676] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:37:34 juju-e4d256-prod-github-runner-207 kernel: [29628.613412] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:37:34 juju-e4d256-prod-github-runner-207 kernel: [29628.614149] ? do_syscall_64+0x69/0xc0 Aug 22 13:37:34 juju-e4d256-prod-github-runner-207 kernel: [29628.614806] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:37:34 juju-e4d256-prod-github-runner-207 kernel: [29628.615544] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:37:34 juju-e4d256-prod-github-runner-207 kernel: [29628.616257] ? do_syscall_64+0x69/0xc0 Aug 22 13:37:34 juju-e4d256-prod-github-runner-207 kernel: [29628.616915] ? do_syscall_64+0x69/0xc0 Aug 22 13:37:34 juju-e4d256-prod-github-runner-207 kernel: [29628.617551] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 13:37:34 juju-e4d256-prod-github-runner-207 kernel: [29628.618273] RIP: 0033:0x7faa5d0edaff Aug 22 13:37:34 juju-e4d256-prod-github-runner-207 kernel: [29628.618964] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 13:37:34 juju-e4d256-prod-github-runner-207 kernel: [29628.621011] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 13:37:34 juju-e4d256-prod-github-runner-207 kernel: [29628.621948] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 13:37:34 juju-e4d256-prod-github-runner-207 kernel: [29628.622874] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 13:37:34 juju-e4d256-prod-github-runner-207 kernel: [29628.623792] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 13:37:34 juju-e4d256-prod-github-runner-207 kernel: [29628.624704] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 13:37:34 juju-e4d256-prod-github-runner-207 kernel: [29628.625614] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 13:37:34 juju-e4d256-prod-github-runner-207 kernel: [29628.626541] Aug 22 13:38:02 juju-e4d256-prod-github-runner-207 kernel: [29656.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 27511s! [qemu-system-x86:6715] Aug 22 13:38:02 juju-e4d256-prod-github-runner-207 kernel: [29656.543899] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 13:38:02 juju-e4d256-prod-github-runner-207 kernel: [29656.544221] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 13:38:02 juju-e4d256-prod-github-runner-207 kernel: [29656.556353] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 13:38:02 juju-e4d256-prod-github-runner-207 kernel: [29656.557621] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 13:38:02 juju-e4d256-prod-github-runner-207 kernel: [29656.558862] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:38:02 juju-e4d256-prod-github-runner-207 kernel: [29656.559922] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 13:38:02 juju-e4d256-prod-github-runner-207 kernel: [29656.562463] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 13:38:02 juju-e4d256-prod-github-runner-207 kernel: [29656.563517] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 13:38:02 juju-e4d256-prod-github-runner-207 kernel: [29656.564683] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 13:38:02 juju-e4d256-prod-github-runner-207 kernel: [29656.566091] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 13:38:02 juju-e4d256-prod-github-runner-207 kernel: [29656.567268] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 13:38:02 juju-e4d256-prod-github-runner-207 kernel: [29656.568451] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 13:38:02 juju-e4d256-prod-github-runner-207 kernel: [29656.569734] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 13:38:02 juju-e4d256-prod-github-runner-207 kernel: [29656.571120] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 13:38:02 juju-e4d256-prod-github-runner-207 kernel: [29656.572226] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 13:38:02 juju-e4d256-prod-github-runner-207 kernel: [29656.573418] Call Trace: Aug 22 13:38:02 juju-e4d256-prod-github-runner-207 kernel: [29656.574330] Aug 22 13:38:02 juju-e4d256-prod-github-runner-207 kernel: [29656.575243] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:38:02 juju-e4d256-prod-github-runner-207 kernel: [29656.576279] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:38:02 juju-e4d256-prod-github-runner-207 kernel: [29656.577298] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:38:02 juju-e4d256-prod-github-runner-207 kernel: [29656.578410] ? show_regs.part.0+0x23/0x29 Aug 22 13:38:02 juju-e4d256-prod-github-runner-207 kernel: [29656.579415] ? show_regs.cold+0x8/0xd Aug 22 13:38:02 juju-e4d256-prod-github-runner-207 kernel: [29656.580390] ? watchdog_timer_fn+0x1be/0x220 Aug 22 13:38:02 juju-e4d256-prod-github-runner-207 kernel: [29656.581397] ? lockup_detector_update_enable+0x60/0x60 Aug 22 13:38:02 juju-e4d256-prod-github-runner-207 kernel: [29656.582459] ? __hrtimer_run_queues+0x107/0x230 Aug 22 13:38:02 juju-e4d256-prod-github-runner-207 kernel: [29656.583493] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 13:38:02 juju-e4d256-prod-github-runner-207 kernel: [29656.584515] ? hrtimer_interrupt+0x101/0x220 Aug 22 13:38:02 juju-e4d256-prod-github-runner-207 kernel: [29656.585534] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 13:38:02 juju-e4d256-prod-github-runner-207 kernel: [29656.586634] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 13:38:02 juju-e4d256-prod-github-runner-207 kernel: [29656.587679] Aug 22 13:38:02 juju-e4d256-prod-github-runner-207 kernel: [29656.588583] Aug 22 13:38:02 juju-e4d256-prod-github-runner-207 kernel: [29656.589421] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 13:38:02 juju-e4d256-prod-github-runner-207 kernel: [29656.590461] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:38:02 juju-e4d256-prod-github-runner-207 kernel: [29656.591518] ? _raw_spin_lock+0x22/0x30 Aug 22 13:38:02 juju-e4d256-prod-github-runner-207 kernel: [29656.592470] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:38:02 juju-e4d256-prod-github-runner-207 kernel: [29656.593497] direct_page_fault+0x206/0x310 [kvm] Aug 22 13:38:02 juju-e4d256-prod-github-runner-207 kernel: [29656.594526] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 13:38:02 juju-e4d256-prod-github-runner-207 kernel: [29656.595563] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 13:38:02 juju-e4d256-prod-github-runner-207 kernel: [29656.596574] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 13:38:02 juju-e4d256-prod-github-runner-207 kernel: [29656.597589] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 13:38:02 juju-e4d256-prod-github-runner-207 kernel: [29656.598536] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 13:38:02 juju-e4d256-prod-github-runner-207 kernel: [29656.599529] handle_exit+0x98/0x230 [kvm_amd] Aug 22 13:38:02 juju-e4d256-prod-github-runner-207 kernel: [29656.600573] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 13:38:02 juju-e4d256-prod-github-runner-207 kernel: [29656.601497] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 13:38:02 juju-e4d256-prod-github-runner-207 kernel: [29656.602427] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 13:38:02 juju-e4d256-prod-github-runner-207 kernel: [29656.603357] vcpu_run+0x62/0x2c0 [kvm] Aug 22 13:38:02 juju-e4d256-prod-github-runner-207 kernel: [29656.604336] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 13:38:02 juju-e4d256-prod-github-runner-207 kernel: [29656.605151] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 13:38:02 juju-e4d256-prod-github-runner-207 kernel: [29656.606050] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 13:38:02 juju-e4d256-prod-github-runner-207 kernel: [29656.606871] ? __seccomp_filter+0x4a/0x4a0 Aug 22 13:38:02 juju-e4d256-prod-github-runner-207 kernel: [29656.607767] ? __fget_files+0x86/0xc0 Aug 22 13:38:02 juju-e4d256-prod-github-runner-207 kernel: [29656.608491] __x64_sys_ioctl+0x95/0xd0 Aug 22 13:38:02 juju-e4d256-prod-github-runner-207 kernel: [29656.609190] do_syscall_64+0x5c/0xc0 Aug 22 13:38:02 juju-e4d256-prod-github-runner-207 kernel: [29656.609906] ? do_futex+0x162/0x1f0 Aug 22 13:38:02 juju-e4d256-prod-github-runner-207 kernel: [29656.610584] ? __x64_sys_futex+0x78/0x1e0 Aug 22 13:38:02 juju-e4d256-prod-github-runner-207 kernel: [29656.611269] ? __secure_computing+0xa9/0x120 Aug 22 13:38:02 juju-e4d256-prod-github-runner-207 kernel: [29656.611961] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 13:38:02 juju-e4d256-prod-github-runner-207 kernel: [29656.612728] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:38:02 juju-e4d256-prod-github-runner-207 kernel: [29656.613473] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:38:02 juju-e4d256-prod-github-runner-207 kernel: [29656.614194] ? do_syscall_64+0x69/0xc0 Aug 22 13:38:02 juju-e4d256-prod-github-runner-207 kernel: [29656.614859] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:38:02 juju-e4d256-prod-github-runner-207 kernel: [29656.615568] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:38:02 juju-e4d256-prod-github-runner-207 kernel: [29656.616265] ? do_syscall_64+0x69/0xc0 Aug 22 13:38:02 juju-e4d256-prod-github-runner-207 kernel: [29656.616897] ? do_syscall_64+0x69/0xc0 Aug 22 13:38:02 juju-e4d256-prod-github-runner-207 kernel: [29656.617520] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 13:38:02 juju-e4d256-prod-github-runner-207 kernel: [29656.618228] RIP: 0033:0x7faa5d0edaff Aug 22 13:38:02 juju-e4d256-prod-github-runner-207 kernel: [29656.618900] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 13:38:02 juju-e4d256-prod-github-runner-207 kernel: [29656.620931] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 13:38:02 juju-e4d256-prod-github-runner-207 kernel: [29656.621845] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 13:38:02 juju-e4d256-prod-github-runner-207 kernel: [29656.622759] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 13:38:02 juju-e4d256-prod-github-runner-207 kernel: [29656.623655] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 13:38:02 juju-e4d256-prod-github-runner-207 kernel: [29656.624548] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 13:38:02 juju-e4d256-prod-github-runner-207 kernel: [29656.625440] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 13:38:02 juju-e4d256-prod-github-runner-207 kernel: [29656.626343] Aug 22 13:38:30 juju-e4d256-prod-github-runner-207 kernel: [29684.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 27537s! [qemu-system-x86:6715] Aug 22 13:38:30 juju-e4d256-prod-github-runner-207 kernel: [29684.543101] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 13:38:30 juju-e4d256-prod-github-runner-207 kernel: [29684.543173] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 13:38:30 juju-e4d256-prod-github-runner-207 kernel: [29684.555828] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 13:38:30 juju-e4d256-prod-github-runner-207 kernel: [29684.557098] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 13:38:30 juju-e4d256-prod-github-runner-207 kernel: [29684.558332] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:38:30 juju-e4d256-prod-github-runner-207 kernel: [29684.559388] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 13:38:30 juju-e4d256-prod-github-runner-207 kernel: [29684.561943] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 13:38:30 juju-e4d256-prod-github-runner-207 kernel: [29684.562996] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 13:38:30 juju-e4d256-prod-github-runner-207 kernel: [29684.564169] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 13:38:30 juju-e4d256-prod-github-runner-207 kernel: [29684.565333] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 13:38:30 juju-e4d256-prod-github-runner-207 kernel: [29684.566556] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 13:38:30 juju-e4d256-prod-github-runner-207 kernel: [29684.567725] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 13:38:30 juju-e4d256-prod-github-runner-207 kernel: [29684.568898] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 13:38:30 juju-e4d256-prod-github-runner-207 kernel: [29684.570138] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 13:38:30 juju-e4d256-prod-github-runner-207 kernel: [29684.571257] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 13:38:30 juju-e4d256-prod-github-runner-207 kernel: [29684.572466] Call Trace: Aug 22 13:38:30 juju-e4d256-prod-github-runner-207 kernel: [29684.573388] Aug 22 13:38:30 juju-e4d256-prod-github-runner-207 kernel: [29684.574292] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:38:30 juju-e4d256-prod-github-runner-207 kernel: [29684.575323] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:38:30 juju-e4d256-prod-github-runner-207 kernel: [29684.576541] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:38:30 juju-e4d256-prod-github-runner-207 kernel: [29684.577629] ? show_regs.part.0+0x23/0x29 Aug 22 13:38:30 juju-e4d256-prod-github-runner-207 kernel: [29684.578638] ? show_regs.cold+0x8/0xd Aug 22 13:38:30 juju-e4d256-prod-github-runner-207 kernel: [29684.579610] ? watchdog_timer_fn+0x1be/0x220 Aug 22 13:38:30 juju-e4d256-prod-github-runner-207 kernel: [29684.580623] ? lockup_detector_update_enable+0x60/0x60 Aug 22 13:38:30 juju-e4d256-prod-github-runner-207 kernel: [29684.581693] ? __hrtimer_run_queues+0x107/0x230 Aug 22 13:38:30 juju-e4d256-prod-github-runner-207 kernel: [29684.582939] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 13:38:30 juju-e4d256-prod-github-runner-207 kernel: [29684.584033] ? hrtimer_interrupt+0x101/0x220 Aug 22 13:38:30 juju-e4d256-prod-github-runner-207 kernel: [29684.585073] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 13:38:30 juju-e4d256-prod-github-runner-207 kernel: [29684.586156] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 13:38:30 juju-e4d256-prod-github-runner-207 kernel: [29684.587240] Aug 22 13:38:30 juju-e4d256-prod-github-runner-207 kernel: [29684.588096] Aug 22 13:38:30 juju-e4d256-prod-github-runner-207 kernel: [29684.588953] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 13:38:30 juju-e4d256-prod-github-runner-207 kernel: [29684.589997] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:38:30 juju-e4d256-prod-github-runner-207 kernel: [29684.591050] ? _raw_spin_lock+0x22/0x30 Aug 22 13:38:30 juju-e4d256-prod-github-runner-207 kernel: [29684.591998] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:38:30 juju-e4d256-prod-github-runner-207 kernel: [29684.593019] direct_page_fault+0x206/0x310 [kvm] Aug 22 13:38:30 juju-e4d256-prod-github-runner-207 kernel: [29684.594058] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 13:38:30 juju-e4d256-prod-github-runner-207 kernel: [29684.595077] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 13:38:30 juju-e4d256-prod-github-runner-207 kernel: [29684.596077] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 13:38:30 juju-e4d256-prod-github-runner-207 kernel: [29684.597047] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 13:38:30 juju-e4d256-prod-github-runner-207 kernel: [29684.597996] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 13:38:30 juju-e4d256-prod-github-runner-207 kernel: [29684.598985] handle_exit+0x98/0x230 [kvm_amd] Aug 22 13:38:30 juju-e4d256-prod-github-runner-207 kernel: [29684.599890] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 13:38:30 juju-e4d256-prod-github-runner-207 kernel: [29684.600814] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 13:38:30 juju-e4d256-prod-github-runner-207 kernel: [29684.601745] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 13:38:30 juju-e4d256-prod-github-runner-207 kernel: [29684.602661] vcpu_run+0x62/0x2c0 [kvm] Aug 22 13:38:30 juju-e4d256-prod-github-runner-207 kernel: [29684.603470] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 13:38:30 juju-e4d256-prod-github-runner-207 kernel: [29684.604303] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 13:38:30 juju-e4d256-prod-github-runner-207 kernel: [29684.605167] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 13:38:30 juju-e4d256-prod-github-runner-207 kernel: [29684.605964] ? __seccomp_filter+0x4a/0x4a0 Aug 22 13:38:30 juju-e4d256-prod-github-runner-207 kernel: [29684.606720] ? __fget_files+0x86/0xc0 Aug 22 13:38:30 juju-e4d256-prod-github-runner-207 kernel: [29684.607431] __x64_sys_ioctl+0x95/0xd0 Aug 22 13:38:30 juju-e4d256-prod-github-runner-207 kernel: [29684.608124] do_syscall_64+0x5c/0xc0 Aug 22 13:38:30 juju-e4d256-prod-github-runner-207 kernel: [29684.608796] ? do_futex+0x162/0x1f0 Aug 22 13:38:30 juju-e4d256-prod-github-runner-207 kernel: [29684.609459] ? __x64_sys_futex+0x78/0x1e0 Aug 22 13:38:30 juju-e4d256-prod-github-runner-207 kernel: [29684.610137] ? __secure_computing+0xa9/0x120 Aug 22 13:38:30 juju-e4d256-prod-github-runner-207 kernel: [29684.610849] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 13:38:30 juju-e4d256-prod-github-runner-207 kernel: [29684.611627] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:38:30 juju-e4d256-prod-github-runner-207 kernel: [29684.612356] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:38:30 juju-e4d256-prod-github-runner-207 kernel: [29684.613085] ? do_syscall_64+0x69/0xc0 Aug 22 13:38:30 juju-e4d256-prod-github-runner-207 kernel: [29684.613737] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:38:30 juju-e4d256-prod-github-runner-207 kernel: [29684.614470] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:38:30 juju-e4d256-prod-github-runner-207 kernel: [29684.615184] ? do_syscall_64+0x69/0xc0 Aug 22 13:38:30 juju-e4d256-prod-github-runner-207 kernel: [29684.615811] ? do_syscall_64+0x69/0xc0 Aug 22 13:38:30 juju-e4d256-prod-github-runner-207 kernel: [29684.616435] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 13:38:30 juju-e4d256-prod-github-runner-207 kernel: [29684.617149] RIP: 0033:0x7faa5d0edaff Aug 22 13:38:30 juju-e4d256-prod-github-runner-207 kernel: [29684.617800] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 13:38:30 juju-e4d256-prod-github-runner-207 kernel: [29684.619827] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 13:38:30 juju-e4d256-prod-github-runner-207 kernel: [29684.620764] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 13:38:30 juju-e4d256-prod-github-runner-207 kernel: [29684.621674] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 13:38:30 juju-e4d256-prod-github-runner-207 kernel: [29684.622590] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 13:38:30 juju-e4d256-prod-github-runner-207 kernel: [29684.623488] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 13:38:30 juju-e4d256-prod-github-runner-207 kernel: [29684.624379] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 13:38:30 juju-e4d256-prod-github-runner-207 kernel: [29684.625290] Aug 22 13:38:45 juju-e4d256-prod-github-runner-207 kernel: [29699.168706] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 13:38:45 juju-e4d256-prod-github-runner-207 kernel: [29699.169689] rcu: 1-....: (7372394 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=3562927 Aug 22 13:38:45 juju-e4d256-prod-github-runner-207 kernel: [29699.170845] (t=7395492 jiffies g=23269 q=33179) Aug 22 13:38:45 juju-e4d256-prod-github-runner-207 kernel: [29699.171657] NMI backtrace for cpu 1 Aug 22 13:38:45 juju-e4d256-prod-github-runner-207 kernel: [29699.172384] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 13:38:45 juju-e4d256-prod-github-runner-207 kernel: [29699.173522] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 13:38:45 juju-e4d256-prod-github-runner-207 kernel: [29699.174611] Call Trace: Aug 22 13:38:45 juju-e4d256-prod-github-runner-207 kernel: [29699.175293] Aug 22 13:38:45 juju-e4d256-prod-github-runner-207 kernel: [29699.175943] show_stack+0x52/0x5c Aug 22 13:38:45 juju-e4d256-prod-github-runner-207 kernel: [29699.176675] dump_stack_lvl+0x4a/0x63 Aug 22 13:38:45 juju-e4d256-prod-github-runner-207 kernel: [29699.177427] dump_stack+0x10/0x16 Aug 22 13:38:45 juju-e4d256-prod-github-runner-207 kernel: [29699.178158] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 13:38:45 juju-e4d256-prod-github-runner-207 kernel: [29699.178949] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 13:38:45 juju-e4d256-prod-github-runner-207 kernel: [29699.179732] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 13:38:45 juju-e4d256-prod-github-runner-207 kernel: [29699.180593] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 13:38:45 juju-e4d256-prod-github-runner-207 kernel: [29699.181423] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 13:38:45 juju-e4d256-prod-github-runner-207 kernel: [29699.182247] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 13:38:45 juju-e4d256-prod-github-runner-207 kernel: [29699.183037] print_cpu_stall.cold+0x2f/0xe2 Aug 22 13:38:45 juju-e4d256-prod-github-runner-207 kernel: [29699.183808] ? timekeeping_update+0xf7/0x150 Aug 22 13:38:45 juju-e4d256-prod-github-runner-207 kernel: [29699.184621] check_cpu_stall+0x109/0x270 Aug 22 13:38:45 juju-e4d256-prod-github-runner-207 kernel: [29699.185394] rcu_sched_clock_irq+0x9a/0x250 Aug 22 13:38:45 juju-e4d256-prod-github-runner-207 kernel: [29699.186229] update_process_times+0x94/0xd0 Aug 22 13:38:45 juju-e4d256-prod-github-runner-207 kernel: [29699.187012] tick_sched_handle+0x29/0x70 Aug 22 13:38:45 juju-e4d256-prod-github-runner-207 kernel: [29699.187796] tick_sched_timer+0x8c/0xc0 Aug 22 13:38:45 juju-e4d256-prod-github-runner-207 kernel: [29699.188549] ? tick_nohz_handler+0xb0/0xb0 Aug 22 13:38:45 juju-e4d256-prod-github-runner-207 kernel: [29699.189316] __hrtimer_run_queues+0x107/0x230 Aug 22 13:38:45 juju-e4d256-prod-github-runner-207 kernel: [29699.190128] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 13:38:45 juju-e4d256-prod-github-runner-207 kernel: [29699.190923] hrtimer_interrupt+0x101/0x220 Aug 22 13:38:45 juju-e4d256-prod-github-runner-207 kernel: [29699.191696] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 13:38:45 juju-e4d256-prod-github-runner-207 kernel: [29699.192530] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 13:38:45 juju-e4d256-prod-github-runner-207 kernel: [29699.193374] Aug 22 13:38:45 juju-e4d256-prod-github-runner-207 kernel: [29699.194019] Aug 22 13:38:45 juju-e4d256-prod-github-runner-207 kernel: [29699.194680] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 13:38:45 juju-e4d256-prod-github-runner-207 kernel: [29699.195523] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:38:45 juju-e4d256-prod-github-runner-207 kernel: [29699.196455] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 13:38:45 juju-e4d256-prod-github-runner-207 kernel: [29699.198789] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 13:38:45 juju-e4d256-prod-github-runner-207 kernel: [29699.199693] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 13:38:45 juju-e4d256-prod-github-runner-207 kernel: [29699.200715] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 13:38:45 juju-e4d256-prod-github-runner-207 kernel: [29699.201701] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 13:38:45 juju-e4d256-prod-github-runner-207 kernel: [29699.202702] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 13:38:45 juju-e4d256-prod-github-runner-207 kernel: [29699.203685] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 13:38:45 juju-e4d256-prod-github-runner-207 kernel: [29699.204656] ? _raw_spin_lock+0x22/0x30 Aug 22 13:38:45 juju-e4d256-prod-github-runner-207 kernel: [29699.205427] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:38:45 juju-e4d256-prod-github-runner-207 kernel: [29699.206300] direct_page_fault+0x206/0x310 [kvm] Aug 22 13:38:45 juju-e4d256-prod-github-runner-207 kernel: [29699.207159] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 13:38:45 juju-e4d256-prod-github-runner-207 kernel: [29699.208005] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 13:38:45 juju-e4d256-prod-github-runner-207 kernel: [29699.208841] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 13:38:45 juju-e4d256-prod-github-runner-207 kernel: [29699.209662] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 13:38:45 juju-e4d256-prod-github-runner-207 kernel: [29699.210473] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 13:38:45 juju-e4d256-prod-github-runner-207 kernel: [29699.211307] handle_exit+0x98/0x230 [kvm_amd] Aug 22 13:38:45 juju-e4d256-prod-github-runner-207 kernel: [29699.212071] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 13:38:45 juju-e4d256-prod-github-runner-207 kernel: [29699.212867] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 13:38:45 juju-e4d256-prod-github-runner-207 kernel: [29699.213685] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 13:38:45 juju-e4d256-prod-github-runner-207 kernel: [29699.214495] vcpu_run+0x62/0x2c0 [kvm] Aug 22 13:38:45 juju-e4d256-prod-github-runner-207 kernel: [29699.215218] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 13:38:45 juju-e4d256-prod-github-runner-207 kernel: [29699.215967] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 13:38:45 juju-e4d256-prod-github-runner-207 kernel: [29699.216778] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 13:38:45 juju-e4d256-prod-github-runner-207 kernel: [29699.217552] ? __seccomp_filter+0x4a/0x4a0 Aug 22 13:38:45 juju-e4d256-prod-github-runner-207 kernel: [29699.218299] ? __fget_files+0x86/0xc0 Aug 22 13:38:45 juju-e4d256-prod-github-runner-207 kernel: [29699.219004] __x64_sys_ioctl+0x95/0xd0 Aug 22 13:38:45 juju-e4d256-prod-github-runner-207 kernel: [29699.219721] do_syscall_64+0x5c/0xc0 Aug 22 13:38:45 juju-e4d256-prod-github-runner-207 kernel: [29699.220408] ? do_futex+0x162/0x1f0 Aug 22 13:38:45 juju-e4d256-prod-github-runner-207 kernel: [29699.221088] ? __x64_sys_futex+0x78/0x1e0 Aug 22 13:38:45 juju-e4d256-prod-github-runner-207 kernel: [29699.221811] ? __secure_computing+0xa9/0x120 Aug 22 13:38:45 juju-e4d256-prod-github-runner-207 kernel: [29699.222545] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 13:38:45 juju-e4d256-prod-github-runner-207 kernel: [29699.223370] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:38:45 juju-e4d256-prod-github-runner-207 kernel: [29699.224133] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:38:45 juju-e4d256-prod-github-runner-207 kernel: [29699.224893] ? do_syscall_64+0x69/0xc0 Aug 22 13:38:45 juju-e4d256-prod-github-runner-207 kernel: [29699.225665] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:38:45 juju-e4d256-prod-github-runner-207 kernel: [29699.226455] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:38:45 juju-e4d256-prod-github-runner-207 kernel: [29699.227226] ? do_syscall_64+0x69/0xc0 Aug 22 13:38:45 juju-e4d256-prod-github-runner-207 kernel: [29699.227954] ? do_syscall_64+0x69/0xc0 Aug 22 13:38:45 juju-e4d256-prod-github-runner-207 kernel: [29699.228670] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 13:38:45 juju-e4d256-prod-github-runner-207 kernel: [29699.229529] RIP: 0033:0x7faa5d0edaff Aug 22 13:38:45 juju-e4d256-prod-github-runner-207 kernel: [29699.230249] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 13:38:45 juju-e4d256-prod-github-runner-207 kernel: [29699.232826] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 13:38:45 juju-e4d256-prod-github-runner-207 kernel: [29699.233890] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 13:38:45 juju-e4d256-prod-github-runner-207 kernel: [29699.234937] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 13:38:45 juju-e4d256-prod-github-runner-207 kernel: [29699.235951] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 13:38:45 juju-e4d256-prod-github-runner-207 kernel: [29699.237113] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 13:38:45 juju-e4d256-prod-github-runner-207 kernel: [29699.238133] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 13:38:45 juju-e4d256-prod-github-runner-207 kernel: [29699.239087] Aug 22 13:39:10 juju-e4d256-prod-github-runner-207 kernel: [29724.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 27575s! [qemu-system-x86:6715] Aug 22 13:39:10 juju-e4d256-prod-github-runner-207 kernel: [29724.543866] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 13:39:10 juju-e4d256-prod-github-runner-207 kernel: [29724.544147] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 13:39:10 juju-e4d256-prod-github-runner-207 kernel: [29724.556934] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 13:39:10 juju-e4d256-prod-github-runner-207 kernel: [29724.558273] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 13:39:10 juju-e4d256-prod-github-runner-207 kernel: [29724.559624] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:39:10 juju-e4d256-prod-github-runner-207 kernel: [29724.560802] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 13:39:10 juju-e4d256-prod-github-runner-207 kernel: [29724.563458] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 13:39:10 juju-e4d256-prod-github-runner-207 kernel: [29724.564551] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 13:39:10 juju-e4d256-prod-github-runner-207 kernel: [29724.565764] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 13:39:10 juju-e4d256-prod-github-runner-207 kernel: [29724.566950] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 13:39:10 juju-e4d256-prod-github-runner-207 kernel: [29724.568142] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 13:39:10 juju-e4d256-prod-github-runner-207 kernel: [29724.569339] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 13:39:10 juju-e4d256-prod-github-runner-207 kernel: [29724.570597] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 13:39:10 juju-e4d256-prod-github-runner-207 kernel: [29724.571849] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 13:39:10 juju-e4d256-prod-github-runner-207 kernel: [29724.572965] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 13:39:10 juju-e4d256-prod-github-runner-207 kernel: [29724.574232] Call Trace: Aug 22 13:39:10 juju-e4d256-prod-github-runner-207 kernel: [29724.575173] Aug 22 13:39:10 juju-e4d256-prod-github-runner-207 kernel: [29724.576100] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:39:10 juju-e4d256-prod-github-runner-207 kernel: [29724.577144] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:39:10 juju-e4d256-prod-github-runner-207 kernel: [29724.578202] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:39:10 juju-e4d256-prod-github-runner-207 kernel: [29724.579328] ? show_regs.part.0+0x23/0x29 Aug 22 13:39:10 juju-e4d256-prod-github-runner-207 kernel: [29724.580354] ? show_regs.cold+0x8/0xd Aug 22 13:39:10 juju-e4d256-prod-github-runner-207 kernel: [29724.581345] ? watchdog_timer_fn+0x1be/0x220 Aug 22 13:39:10 juju-e4d256-prod-github-runner-207 kernel: [29724.582418] ? lockup_detector_update_enable+0x60/0x60 Aug 22 13:39:10 juju-e4d256-prod-github-runner-207 kernel: [29724.583515] ? __hrtimer_run_queues+0x107/0x230 Aug 22 13:39:10 juju-e4d256-prod-github-runner-207 kernel: [29724.584581] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 13:39:10 juju-e4d256-prod-github-runner-207 kernel: [29724.585634] ? hrtimer_interrupt+0x101/0x220 Aug 22 13:39:10 juju-e4d256-prod-github-runner-207 kernel: [29724.586700] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 13:39:10 juju-e4d256-prod-github-runner-207 kernel: [29724.587786] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 13:39:10 juju-e4d256-prod-github-runner-207 kernel: [29724.588856] Aug 22 13:39:10 juju-e4d256-prod-github-runner-207 kernel: [29724.589725] Aug 22 13:39:10 juju-e4d256-prod-github-runner-207 kernel: [29724.590702] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 13:39:10 juju-e4d256-prod-github-runner-207 kernel: [29724.591960] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:39:10 juju-e4d256-prod-github-runner-207 kernel: [29724.593187] ? _raw_spin_lock+0x22/0x30 Aug 22 13:39:10 juju-e4d256-prod-github-runner-207 kernel: [29724.594198] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:39:10 juju-e4d256-prod-github-runner-207 kernel: [29724.595292] direct_page_fault+0x206/0x310 [kvm] Aug 22 13:39:10 juju-e4d256-prod-github-runner-207 kernel: [29724.596346] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 13:39:10 juju-e4d256-prod-github-runner-207 kernel: [29724.597521] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 13:39:10 juju-e4d256-prod-github-runner-207 kernel: [29724.598568] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 13:39:10 juju-e4d256-prod-github-runner-207 kernel: [29724.599597] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 13:39:10 juju-e4d256-prod-github-runner-207 kernel: [29724.600603] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 13:39:10 juju-e4d256-prod-github-runner-207 kernel: [29724.601603] handle_exit+0x98/0x230 [kvm_amd] Aug 22 13:39:10 juju-e4d256-prod-github-runner-207 kernel: [29724.602528] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 13:39:10 juju-e4d256-prod-github-runner-207 kernel: [29724.603458] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 13:39:10 juju-e4d256-prod-github-runner-207 kernel: [29724.604431] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 13:39:10 juju-e4d256-prod-github-runner-207 kernel: [29724.605354] vcpu_run+0x62/0x2c0 [kvm] Aug 22 13:39:10 juju-e4d256-prod-github-runner-207 kernel: [29724.606192] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 13:39:10 juju-e4d256-prod-github-runner-207 kernel: [29724.607023] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 13:39:10 juju-e4d256-prod-github-runner-207 kernel: [29724.607895] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 13:39:10 juju-e4d256-prod-github-runner-207 kernel: [29724.608707] ? __seccomp_filter+0x4a/0x4a0 Aug 22 13:39:10 juju-e4d256-prod-github-runner-207 kernel: [29724.609470] ? __fget_files+0x86/0xc0 Aug 22 13:39:10 juju-e4d256-prod-github-runner-207 kernel: [29724.610207] __x64_sys_ioctl+0x95/0xd0 Aug 22 13:39:10 juju-e4d256-prod-github-runner-207 kernel: [29724.610954] do_syscall_64+0x5c/0xc0 Aug 22 13:39:10 juju-e4d256-prod-github-runner-207 kernel: [29724.611642] ? do_futex+0x162/0x1f0 Aug 22 13:39:10 juju-e4d256-prod-github-runner-207 kernel: [29724.612333] ? __x64_sys_futex+0x78/0x1e0 Aug 22 13:39:10 juju-e4d256-prod-github-runner-207 kernel: [29724.613064] ? __secure_computing+0xa9/0x120 Aug 22 13:39:10 juju-e4d256-prod-github-runner-207 kernel: [29724.613797] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 13:39:10 juju-e4d256-prod-github-runner-207 kernel: [29724.615113] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:39:10 juju-e4d256-prod-github-runner-207 kernel: [29724.616067] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:39:10 juju-e4d256-prod-github-runner-207 kernel: [29724.616802] ? do_syscall_64+0x69/0xc0 Aug 22 13:39:10 juju-e4d256-prod-github-runner-207 kernel: [29724.617683] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:39:10 juju-e4d256-prod-github-runner-207 kernel: [29724.618429] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:39:10 juju-e4d256-prod-github-runner-207 kernel: [29724.619139] ? do_syscall_64+0x69/0xc0 Aug 22 13:39:10 juju-e4d256-prod-github-runner-207 kernel: [29724.619777] ? do_syscall_64+0x69/0xc0 Aug 22 13:39:10 juju-e4d256-prod-github-runner-207 kernel: [29724.620409] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 13:39:10 juju-e4d256-prod-github-runner-207 kernel: [29724.621134] RIP: 0033:0x7faa5d0edaff Aug 22 13:39:10 juju-e4d256-prod-github-runner-207 kernel: [29724.621829] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 13:39:10 juju-e4d256-prod-github-runner-207 kernel: [29724.623875] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 13:39:10 juju-e4d256-prod-github-runner-207 kernel: [29724.624808] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 13:39:10 juju-e4d256-prod-github-runner-207 kernel: [29724.625730] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 13:39:10 juju-e4d256-prod-github-runner-207 kernel: [29724.626660] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 13:39:10 juju-e4d256-prod-github-runner-207 kernel: [29724.627571] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 13:39:10 juju-e4d256-prod-github-runner-207 kernel: [29724.628478] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 13:39:10 juju-e4d256-prod-github-runner-207 kernel: [29724.629394] Aug 22 13:39:38 juju-e4d256-prod-github-runner-207 kernel: [29752.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 27601s! [qemu-system-x86:6715] Aug 22 13:39:38 juju-e4d256-prod-github-runner-207 kernel: [29752.543136] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 13:39:38 juju-e4d256-prod-github-runner-207 kernel: [29752.543211] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 13:39:38 juju-e4d256-prod-github-runner-207 kernel: [29752.555526] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 13:39:38 juju-e4d256-prod-github-runner-207 kernel: [29752.556789] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 13:39:38 juju-e4d256-prod-github-runner-207 kernel: [29752.558019] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:39:38 juju-e4d256-prod-github-runner-207 kernel: [29752.559080] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 13:39:38 juju-e4d256-prod-github-runner-207 kernel: [29752.561714] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 13:39:38 juju-e4d256-prod-github-runner-207 kernel: [29752.562757] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 13:39:38 juju-e4d256-prod-github-runner-207 kernel: [29752.563918] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 13:39:38 juju-e4d256-prod-github-runner-207 kernel: [29752.565101] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 13:39:38 juju-e4d256-prod-github-runner-207 kernel: [29752.566280] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 13:39:38 juju-e4d256-prod-github-runner-207 kernel: [29752.567439] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 13:39:38 juju-e4d256-prod-github-runner-207 kernel: [29752.568605] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 13:39:38 juju-e4d256-prod-github-runner-207 kernel: [29752.569861] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 13:39:38 juju-e4d256-prod-github-runner-207 kernel: [29752.570964] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 13:39:38 juju-e4d256-prod-github-runner-207 kernel: [29752.572170] Call Trace: Aug 22 13:39:38 juju-e4d256-prod-github-runner-207 kernel: [29752.573087] Aug 22 13:39:38 juju-e4d256-prod-github-runner-207 kernel: [29752.573984] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:39:38 juju-e4d256-prod-github-runner-207 kernel: [29752.575024] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:39:38 juju-e4d256-prod-github-runner-207 kernel: [29752.576049] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:39:38 juju-e4d256-prod-github-runner-207 kernel: [29752.577123] ? show_regs.part.0+0x23/0x29 Aug 22 13:39:38 juju-e4d256-prod-github-runner-207 kernel: [29752.578188] ? show_regs.cold+0x8/0xd Aug 22 13:39:38 juju-e4d256-prod-github-runner-207 kernel: [29752.579168] ? watchdog_timer_fn+0x1be/0x220 Aug 22 13:39:38 juju-e4d256-prod-github-runner-207 kernel: [29752.580178] ? lockup_detector_update_enable+0x60/0x60 Aug 22 13:39:38 juju-e4d256-prod-github-runner-207 kernel: [29752.581239] ? __hrtimer_run_queues+0x107/0x230 Aug 22 13:39:38 juju-e4d256-prod-github-runner-207 kernel: [29752.582282] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 13:39:38 juju-e4d256-prod-github-runner-207 kernel: [29752.583321] ? hrtimer_interrupt+0x101/0x220 Aug 22 13:39:38 juju-e4d256-prod-github-runner-207 kernel: [29752.584340] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 13:39:38 juju-e4d256-prod-github-runner-207 kernel: [29752.585432] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 13:39:38 juju-e4d256-prod-github-runner-207 kernel: [29752.586482] Aug 22 13:39:38 juju-e4d256-prod-github-runner-207 kernel: [29752.587440] Aug 22 13:39:38 juju-e4d256-prod-github-runner-207 kernel: [29752.588275] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 13:39:38 juju-e4d256-prod-github-runner-207 kernel: [29752.589384] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:39:38 juju-e4d256-prod-github-runner-207 kernel: [29752.590447] ? _raw_spin_lock+0x22/0x30 Aug 22 13:39:38 juju-e4d256-prod-github-runner-207 kernel: [29752.591391] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:39:38 juju-e4d256-prod-github-runner-207 kernel: [29752.592407] direct_page_fault+0x206/0x310 [kvm] Aug 22 13:39:38 juju-e4d256-prod-github-runner-207 kernel: [29752.593449] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 13:39:38 juju-e4d256-prod-github-runner-207 kernel: [29752.594460] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 13:39:38 juju-e4d256-prod-github-runner-207 kernel: [29752.595462] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 13:39:38 juju-e4d256-prod-github-runner-207 kernel: [29752.596431] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 13:39:38 juju-e4d256-prod-github-runner-207 kernel: [29752.597379] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 13:39:38 juju-e4d256-prod-github-runner-207 kernel: [29752.598371] handle_exit+0x98/0x230 [kvm_amd] Aug 22 13:39:38 juju-e4d256-prod-github-runner-207 kernel: [29752.599296] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 13:39:38 juju-e4d256-prod-github-runner-207 kernel: [29752.600210] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 13:39:38 juju-e4d256-prod-github-runner-207 kernel: [29752.601139] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 13:39:38 juju-e4d256-prod-github-runner-207 kernel: [29752.602069] vcpu_run+0x62/0x2c0 [kvm] Aug 22 13:39:38 juju-e4d256-prod-github-runner-207 kernel: [29752.602879] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 13:39:38 juju-e4d256-prod-github-runner-207 kernel: [29752.603686] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 13:39:38 juju-e4d256-prod-github-runner-207 kernel: [29752.604539] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 13:39:38 juju-e4d256-prod-github-runner-207 kernel: [29752.605336] ? __seccomp_filter+0x4a/0x4a0 Aug 22 13:39:38 juju-e4d256-prod-github-runner-207 kernel: [29752.606092] ? __fget_files+0x86/0xc0 Aug 22 13:39:38 juju-e4d256-prod-github-runner-207 kernel: [29752.606798] __x64_sys_ioctl+0x95/0xd0 Aug 22 13:39:38 juju-e4d256-prod-github-runner-207 kernel: [29752.607525] do_syscall_64+0x5c/0xc0 Aug 22 13:39:38 juju-e4d256-prod-github-runner-207 kernel: [29752.608205] ? do_futex+0x162/0x1f0 Aug 22 13:39:38 juju-e4d256-prod-github-runner-207 kernel: [29752.608894] ? __x64_sys_futex+0x78/0x1e0 Aug 22 13:39:38 juju-e4d256-prod-github-runner-207 kernel: [29752.609688] ? __secure_computing+0xa9/0x120 Aug 22 13:39:38 juju-e4d256-prod-github-runner-207 kernel: [29752.610510] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 13:39:38 juju-e4d256-prod-github-runner-207 kernel: [29752.611571] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:39:38 juju-e4d256-prod-github-runner-207 kernel: [29752.612391] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:39:38 juju-e4d256-prod-github-runner-207 kernel: [29752.613237] ? do_syscall_64+0x69/0xc0 Aug 22 13:39:38 juju-e4d256-prod-github-runner-207 kernel: [29752.613978] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:39:38 juju-e4d256-prod-github-runner-207 kernel: [29752.614706] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:39:38 juju-e4d256-prod-github-runner-207 kernel: [29752.615449] ? do_syscall_64+0x69/0xc0 Aug 22 13:39:38 juju-e4d256-prod-github-runner-207 kernel: [29752.616089] ? do_syscall_64+0x69/0xc0 Aug 22 13:39:38 juju-e4d256-prod-github-runner-207 kernel: [29752.616710] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 13:39:38 juju-e4d256-prod-github-runner-207 kernel: [29752.617427] RIP: 0033:0x7faa5d0edaff Aug 22 13:39:38 juju-e4d256-prod-github-runner-207 kernel: [29752.618055] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 13:39:38 juju-e4d256-prod-github-runner-207 kernel: [29752.620047] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 13:39:38 juju-e4d256-prod-github-runner-207 kernel: [29752.620968] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 13:39:38 juju-e4d256-prod-github-runner-207 kernel: [29752.621868] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 13:39:38 juju-e4d256-prod-github-runner-207 kernel: [29752.622753] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 13:39:38 juju-e4d256-prod-github-runner-207 kernel: [29752.623642] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 13:39:38 juju-e4d256-prod-github-runner-207 kernel: [29752.624528] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 13:39:38 juju-e4d256-prod-github-runner-207 kernel: [29752.625430] Aug 22 13:40:06 juju-e4d256-prod-github-runner-207 kernel: [29780.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 27627s! [qemu-system-x86:6715] Aug 22 13:40:06 juju-e4d256-prod-github-runner-207 kernel: [29780.543914] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 13:40:06 juju-e4d256-prod-github-runner-207 kernel: [29780.544214] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 13:40:06 juju-e4d256-prod-github-runner-207 kernel: [29780.556474] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 13:40:06 juju-e4d256-prod-github-runner-207 kernel: [29780.557774] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 13:40:06 juju-e4d256-prod-github-runner-207 kernel: [29780.558995] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:40:06 juju-e4d256-prod-github-runner-207 kernel: [29780.560050] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 13:40:06 juju-e4d256-prod-github-runner-207 kernel: [29780.562740] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 13:40:06 juju-e4d256-prod-github-runner-207 kernel: [29780.563781] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 13:40:06 juju-e4d256-prod-github-runner-207 kernel: [29780.564957] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 13:40:06 juju-e4d256-prod-github-runner-207 kernel: [29780.566199] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 13:40:06 juju-e4d256-prod-github-runner-207 kernel: [29780.567371] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 13:40:06 juju-e4d256-prod-github-runner-207 kernel: [29780.568533] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 13:40:06 juju-e4d256-prod-github-runner-207 kernel: [29780.569735] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 13:40:06 juju-e4d256-prod-github-runner-207 kernel: [29780.571005] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 13:40:06 juju-e4d256-prod-github-runner-207 kernel: [29780.572124] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 13:40:06 juju-e4d256-prod-github-runner-207 kernel: [29780.573345] Call Trace: Aug 22 13:40:06 juju-e4d256-prod-github-runner-207 kernel: [29780.574260] Aug 22 13:40:06 juju-e4d256-prod-github-runner-207 kernel: [29780.575200] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:40:06 juju-e4d256-prod-github-runner-207 kernel: [29780.576240] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:40:06 juju-e4d256-prod-github-runner-207 kernel: [29780.577299] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:40:06 juju-e4d256-prod-github-runner-207 kernel: [29780.578399] ? show_regs.part.0+0x23/0x29 Aug 22 13:40:06 juju-e4d256-prod-github-runner-207 kernel: [29780.579398] ? show_regs.cold+0x8/0xd Aug 22 13:40:06 juju-e4d256-prod-github-runner-207 kernel: [29780.580375] ? watchdog_timer_fn+0x1be/0x220 Aug 22 13:40:06 juju-e4d256-prod-github-runner-207 kernel: [29780.581522] ? lockup_detector_update_enable+0x60/0x60 Aug 22 13:40:06 juju-e4d256-prod-github-runner-207 kernel: [29780.582634] ? __hrtimer_run_queues+0x107/0x230 Aug 22 13:40:06 juju-e4d256-prod-github-runner-207 kernel: [29780.583669] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 13:40:06 juju-e4d256-prod-github-runner-207 kernel: [29780.584717] ? hrtimer_interrupt+0x101/0x220 Aug 22 13:40:06 juju-e4d256-prod-github-runner-207 kernel: [29780.585758] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 13:40:06 juju-e4d256-prod-github-runner-207 kernel: [29780.586868] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 13:40:06 juju-e4d256-prod-github-runner-207 kernel: [29780.587970] Aug 22 13:40:06 juju-e4d256-prod-github-runner-207 kernel: [29780.588827] Aug 22 13:40:06 juju-e4d256-prod-github-runner-207 kernel: [29780.589675] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 13:40:06 juju-e4d256-prod-github-runner-207 kernel: [29780.590715] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:40:06 juju-e4d256-prod-github-runner-207 kernel: [29780.591780] ? _raw_spin_lock+0x22/0x30 Aug 22 13:40:06 juju-e4d256-prod-github-runner-207 kernel: [29780.592727] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:40:06 juju-e4d256-prod-github-runner-207 kernel: [29780.593768] direct_page_fault+0x206/0x310 [kvm] Aug 22 13:40:06 juju-e4d256-prod-github-runner-207 kernel: [29780.594796] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 13:40:06 juju-e4d256-prod-github-runner-207 kernel: [29780.595803] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 13:40:06 juju-e4d256-prod-github-runner-207 kernel: [29780.596859] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 13:40:06 juju-e4d256-prod-github-runner-207 kernel: [29780.597882] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 13:40:06 juju-e4d256-prod-github-runner-207 kernel: [29780.598826] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 13:40:06 juju-e4d256-prod-github-runner-207 kernel: [29780.599803] handle_exit+0x98/0x230 [kvm_amd] Aug 22 13:40:06 juju-e4d256-prod-github-runner-207 kernel: [29780.600704] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 13:40:06 juju-e4d256-prod-github-runner-207 kernel: [29780.601644] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 13:40:06 juju-e4d256-prod-github-runner-207 kernel: [29780.602567] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 13:40:06 juju-e4d256-prod-github-runner-207 kernel: [29780.603472] vcpu_run+0x62/0x2c0 [kvm] Aug 22 13:40:06 juju-e4d256-prod-github-runner-207 kernel: [29780.604280] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 13:40:06 juju-e4d256-prod-github-runner-207 kernel: [29780.605096] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 13:40:06 juju-e4d256-prod-github-runner-207 kernel: [29780.605951] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 13:40:06 juju-e4d256-prod-github-runner-207 kernel: [29780.606744] ? __seccomp_filter+0x4a/0x4a0 Aug 22 13:40:06 juju-e4d256-prod-github-runner-207 kernel: [29780.607490] ? __fget_files+0x86/0xc0 Aug 22 13:40:06 juju-e4d256-prod-github-runner-207 kernel: [29780.608202] __x64_sys_ioctl+0x95/0xd0 Aug 22 13:40:06 juju-e4d256-prod-github-runner-207 kernel: [29780.608892] do_syscall_64+0x5c/0xc0 Aug 22 13:40:06 juju-e4d256-prod-github-runner-207 kernel: [29780.609578] ? do_futex+0x162/0x1f0 Aug 22 13:40:06 juju-e4d256-prod-github-runner-207 kernel: [29780.610231] ? __x64_sys_futex+0x78/0x1e0 Aug 22 13:40:06 juju-e4d256-prod-github-runner-207 kernel: [29780.610903] ? __secure_computing+0xa9/0x120 Aug 22 13:40:06 juju-e4d256-prod-github-runner-207 kernel: [29780.611591] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 13:40:06 juju-e4d256-prod-github-runner-207 kernel: [29780.612354] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:40:06 juju-e4d256-prod-github-runner-207 kernel: [29780.613083] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:40:06 juju-e4d256-prod-github-runner-207 kernel: [29780.613805] ? do_syscall_64+0x69/0xc0 Aug 22 13:40:06 juju-e4d256-prod-github-runner-207 kernel: [29780.614451] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:40:06 juju-e4d256-prod-github-runner-207 kernel: [29780.615158] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:40:06 juju-e4d256-prod-github-runner-207 kernel: [29780.615853] ? do_syscall_64+0x69/0xc0 Aug 22 13:40:06 juju-e4d256-prod-github-runner-207 kernel: [29780.616498] ? do_syscall_64+0x69/0xc0 Aug 22 13:40:06 juju-e4d256-prod-github-runner-207 kernel: [29780.617150] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 13:40:06 juju-e4d256-prod-github-runner-207 kernel: [29780.617855] RIP: 0033:0x7faa5d0edaff Aug 22 13:40:06 juju-e4d256-prod-github-runner-207 kernel: [29780.618508] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 13:40:06 juju-e4d256-prod-github-runner-207 kernel: [29780.620495] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 13:40:06 juju-e4d256-prod-github-runner-207 kernel: [29780.621424] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 13:40:06 juju-e4d256-prod-github-runner-207 kernel: [29780.622314] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 13:40:06 juju-e4d256-prod-github-runner-207 kernel: [29780.623202] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 13:40:06 juju-e4d256-prod-github-runner-207 kernel: [29780.624101] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 13:40:06 juju-e4d256-prod-github-runner-207 kernel: [29780.624991] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 13:40:06 juju-e4d256-prod-github-runner-207 kernel: [29780.625908] Aug 22 13:40:34 juju-e4d256-prod-github-runner-207 kernel: [29808.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 27653s! [qemu-system-x86:6715] Aug 22 13:40:34 juju-e4d256-prod-github-runner-207 kernel: [29808.543278] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 13:40:34 juju-e4d256-prod-github-runner-207 kernel: [29808.543351] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 13:40:34 juju-e4d256-prod-github-runner-207 kernel: [29808.555689] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 13:40:34 juju-e4d256-prod-github-runner-207 kernel: [29808.557074] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 13:40:34 juju-e4d256-prod-github-runner-207 kernel: [29808.558638] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:40:34 juju-e4d256-prod-github-runner-207 kernel: [29808.559758] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 13:40:34 juju-e4d256-prod-github-runner-207 kernel: [29808.562401] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 13:40:34 juju-e4d256-prod-github-runner-207 kernel: [29808.563476] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 13:40:34 juju-e4d256-prod-github-runner-207 kernel: [29808.564733] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 13:40:34 juju-e4d256-prod-github-runner-207 kernel: [29808.565925] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 13:40:34 juju-e4d256-prod-github-runner-207 kernel: [29808.567083] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 13:40:34 juju-e4d256-prod-github-runner-207 kernel: [29808.568281] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 13:40:34 juju-e4d256-prod-github-runner-207 kernel: [29808.569556] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 13:40:34 juju-e4d256-prod-github-runner-207 kernel: [29808.570880] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 13:40:34 juju-e4d256-prod-github-runner-207 kernel: [29808.572028] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 13:40:34 juju-e4d256-prod-github-runner-207 kernel: [29808.573258] Call Trace: Aug 22 13:40:34 juju-e4d256-prod-github-runner-207 kernel: [29808.574176] Aug 22 13:40:34 juju-e4d256-prod-github-runner-207 kernel: [29808.575087] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:40:34 juju-e4d256-prod-github-runner-207 kernel: [29808.576130] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:40:34 juju-e4d256-prod-github-runner-207 kernel: [29808.577212] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:40:34 juju-e4d256-prod-github-runner-207 kernel: [29808.578300] ? show_regs.part.0+0x23/0x29 Aug 22 13:40:34 juju-e4d256-prod-github-runner-207 kernel: [29808.579298] ? show_regs.cold+0x8/0xd Aug 22 13:40:34 juju-e4d256-prod-github-runner-207 kernel: [29808.580313] ? watchdog_timer_fn+0x1be/0x220 Aug 22 13:40:34 juju-e4d256-prod-github-runner-207 kernel: [29808.581346] ? lockup_detector_update_enable+0x60/0x60 Aug 22 13:40:34 juju-e4d256-prod-github-runner-207 kernel: [29808.582535] ? __hrtimer_run_queues+0x107/0x230 Aug 22 13:40:34 juju-e4d256-prod-github-runner-207 kernel: [29808.583677] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 13:40:34 juju-e4d256-prod-github-runner-207 kernel: [29808.584852] ? hrtimer_interrupt+0x101/0x220 Aug 22 13:40:34 juju-e4d256-prod-github-runner-207 kernel: [29808.585983] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 13:40:34 juju-e4d256-prod-github-runner-207 kernel: [29808.587169] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 13:40:34 juju-e4d256-prod-github-runner-207 kernel: [29808.588331] Aug 22 13:40:34 juju-e4d256-prod-github-runner-207 kernel: [29808.589269] Aug 22 13:40:34 juju-e4d256-prod-github-runner-207 kernel: [29808.590152] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 13:40:34 juju-e4d256-prod-github-runner-207 kernel: [29808.591288] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:40:34 juju-e4d256-prod-github-runner-207 kernel: [29808.592441] ? _raw_spin_lock+0x22/0x30 Aug 22 13:40:34 juju-e4d256-prod-github-runner-207 kernel: [29808.593480] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:40:34 juju-e4d256-prod-github-runner-207 kernel: [29808.594589] direct_page_fault+0x206/0x310 [kvm] Aug 22 13:40:34 juju-e4d256-prod-github-runner-207 kernel: [29808.595704] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 13:40:34 juju-e4d256-prod-github-runner-207 kernel: [29808.596841] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 13:40:34 juju-e4d256-prod-github-runner-207 kernel: [29808.598004] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 13:40:34 juju-e4d256-prod-github-runner-207 kernel: [29808.599077] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 13:40:34 juju-e4d256-prod-github-runner-207 kernel: [29808.600139] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 13:40:34 juju-e4d256-prod-github-runner-207 kernel: [29808.601279] handle_exit+0x98/0x230 [kvm_amd] Aug 22 13:40:34 juju-e4d256-prod-github-runner-207 kernel: [29808.602320] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 13:40:34 juju-e4d256-prod-github-runner-207 kernel: [29808.603434] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 13:40:34 juju-e4d256-prod-github-runner-207 kernel: [29808.604514] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 13:40:34 juju-e4d256-prod-github-runner-207 kernel: [29808.605564] vcpu_run+0x62/0x2c0 [kvm] Aug 22 13:40:34 juju-e4d256-prod-github-runner-207 kernel: [29808.606451] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 13:40:34 juju-e4d256-prod-github-runner-207 kernel: [29808.607400] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 13:40:34 juju-e4d256-prod-github-runner-207 kernel: [29808.608362] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 13:40:34 juju-e4d256-prod-github-runner-207 kernel: [29808.609289] ? __seccomp_filter+0x4a/0x4a0 Aug 22 13:40:34 juju-e4d256-prod-github-runner-207 kernel: [29808.610152] ? __fget_files+0x86/0xc0 Aug 22 13:40:34 juju-e4d256-prod-github-runner-207 kernel: [29808.610935] __x64_sys_ioctl+0x95/0xd0 Aug 22 13:40:34 juju-e4d256-prod-github-runner-207 kernel: [29808.611705] do_syscall_64+0x5c/0xc0 Aug 22 13:40:34 juju-e4d256-prod-github-runner-207 kernel: [29808.612447] ? do_futex+0x162/0x1f0 Aug 22 13:40:34 juju-e4d256-prod-github-runner-207 kernel: [29808.613224] ? __x64_sys_futex+0x78/0x1e0 Aug 22 13:40:34 juju-e4d256-prod-github-runner-207 kernel: [29808.613979] ? __secure_computing+0xa9/0x120 Aug 22 13:40:34 juju-e4d256-prod-github-runner-207 kernel: [29808.614764] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 13:40:34 juju-e4d256-prod-github-runner-207 kernel: [29808.615663] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:40:34 juju-e4d256-prod-github-runner-207 kernel: [29808.616483] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:40:34 juju-e4d256-prod-github-runner-207 kernel: [29808.617312] ? do_syscall_64+0x69/0xc0 Aug 22 13:40:34 juju-e4d256-prod-github-runner-207 kernel: [29808.618060] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:40:34 juju-e4d256-prod-github-runner-207 kernel: [29808.618886] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:40:34 juju-e4d256-prod-github-runner-207 kernel: [29808.619682] ? do_syscall_64+0x69/0xc0 Aug 22 13:40:34 juju-e4d256-prod-github-runner-207 kernel: [29808.620424] ? do_syscall_64+0x69/0xc0 Aug 22 13:40:34 juju-e4d256-prod-github-runner-207 kernel: [29808.621169] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 13:40:34 juju-e4d256-prod-github-runner-207 kernel: [29808.621984] RIP: 0033:0x7faa5d0edaff Aug 22 13:40:34 juju-e4d256-prod-github-runner-207 kernel: [29808.622714] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 13:40:34 juju-e4d256-prod-github-runner-207 kernel: [29808.625130] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 13:40:34 juju-e4d256-prod-github-runner-207 kernel: [29808.626205] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 13:40:34 juju-e4d256-prod-github-runner-207 kernel: [29808.627225] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 13:40:34 juju-e4d256-prod-github-runner-207 kernel: [29808.628282] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 13:40:34 juju-e4d256-prod-github-runner-207 kernel: [29808.629309] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 13:40:34 juju-e4d256-prod-github-runner-207 kernel: [29808.630224] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 13:40:34 juju-e4d256-prod-github-runner-207 kernel: [29808.631118] Aug 22 13:41:02 juju-e4d256-prod-github-runner-207 kernel: [29836.541981] watchdog: BUG: soft lockup - CPU#1 stuck for 27679s! [qemu-system-x86:6715] Aug 22 13:41:02 juju-e4d256-prod-github-runner-207 kernel: [29836.543902] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 13:41:02 juju-e4d256-prod-github-runner-207 kernel: [29836.544211] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 13:41:02 juju-e4d256-prod-github-runner-207 kernel: [29836.556957] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 13:41:02 juju-e4d256-prod-github-runner-207 kernel: [29836.558437] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 13:41:02 juju-e4d256-prod-github-runner-207 kernel: [29836.559678] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:41:02 juju-e4d256-prod-github-runner-207 kernel: [29836.560752] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 13:41:02 juju-e4d256-prod-github-runner-207 kernel: [29836.563319] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 13:41:02 juju-e4d256-prod-github-runner-207 kernel: [29836.564428] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 13:41:02 juju-e4d256-prod-github-runner-207 kernel: [29836.565598] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 13:41:02 juju-e4d256-prod-github-runner-207 kernel: [29836.566764] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 13:41:02 juju-e4d256-prod-github-runner-207 kernel: [29836.567932] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 13:41:02 juju-e4d256-prod-github-runner-207 kernel: [29836.569182] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 13:41:02 juju-e4d256-prod-github-runner-207 kernel: [29836.570386] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 13:41:02 juju-e4d256-prod-github-runner-207 kernel: [29836.571635] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 13:41:02 juju-e4d256-prod-github-runner-207 kernel: [29836.572836] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 13:41:02 juju-e4d256-prod-github-runner-207 kernel: [29836.574055] Call Trace: Aug 22 13:41:02 juju-e4d256-prod-github-runner-207 kernel: [29836.575007] Aug 22 13:41:02 juju-e4d256-prod-github-runner-207 kernel: [29836.575927] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:41:02 juju-e4d256-prod-github-runner-207 kernel: [29836.577004] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:41:02 juju-e4d256-prod-github-runner-207 kernel: [29836.578033] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:41:02 juju-e4d256-prod-github-runner-207 kernel: [29836.579127] ? show_regs.part.0+0x23/0x29 Aug 22 13:41:02 juju-e4d256-prod-github-runner-207 kernel: [29836.580174] ? show_regs.cold+0x8/0xd Aug 22 13:41:02 juju-e4d256-prod-github-runner-207 kernel: [29836.581166] ? watchdog_timer_fn+0x1be/0x220 Aug 22 13:41:02 juju-e4d256-prod-github-runner-207 kernel: [29836.582176] ? lockup_detector_update_enable+0x60/0x60 Aug 22 13:41:02 juju-e4d256-prod-github-runner-207 kernel: [29836.583239] ? __hrtimer_run_queues+0x107/0x230 Aug 22 13:41:02 juju-e4d256-prod-github-runner-207 kernel: [29836.584268] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 13:41:02 juju-e4d256-prod-github-runner-207 kernel: [29836.585297] ? hrtimer_interrupt+0x101/0x220 Aug 22 13:41:02 juju-e4d256-prod-github-runner-207 kernel: [29836.586316] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 13:41:02 juju-e4d256-prod-github-runner-207 kernel: [29836.587382] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 13:41:02 juju-e4d256-prod-github-runner-207 kernel: [29836.588441] Aug 22 13:41:02 juju-e4d256-prod-github-runner-207 kernel: [29836.589305] Aug 22 13:41:02 juju-e4d256-prod-github-runner-207 kernel: [29836.590151] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 13:41:02 juju-e4d256-prod-github-runner-207 kernel: [29836.591179] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:41:02 juju-e4d256-prod-github-runner-207 kernel: [29836.592213] ? _raw_spin_lock+0x22/0x30 Aug 22 13:41:02 juju-e4d256-prod-github-runner-207 kernel: [29836.593181] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:41:02 juju-e4d256-prod-github-runner-207 kernel: [29836.594202] direct_page_fault+0x206/0x310 [kvm] Aug 22 13:41:02 juju-e4d256-prod-github-runner-207 kernel: [29836.595231] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 13:41:02 juju-e4d256-prod-github-runner-207 kernel: [29836.596240] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 13:41:02 juju-e4d256-prod-github-runner-207 kernel: [29836.597253] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 13:41:02 juju-e4d256-prod-github-runner-207 kernel: [29836.598263] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 13:41:02 juju-e4d256-prod-github-runner-207 kernel: [29836.599223] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 13:41:02 juju-e4d256-prod-github-runner-207 kernel: [29836.600211] handle_exit+0x98/0x230 [kvm_amd] Aug 22 13:41:02 juju-e4d256-prod-github-runner-207 kernel: [29836.601120] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 13:41:02 juju-e4d256-prod-github-runner-207 kernel: [29836.602064] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 13:41:02 juju-e4d256-prod-github-runner-207 kernel: [29836.603007] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 13:41:02 juju-e4d256-prod-github-runner-207 kernel: [29836.603911] vcpu_run+0x62/0x2c0 [kvm] Aug 22 13:41:02 juju-e4d256-prod-github-runner-207 kernel: [29836.604743] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 13:41:02 juju-e4d256-prod-github-runner-207 kernel: [29836.605551] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 13:41:02 juju-e4d256-prod-github-runner-207 kernel: [29836.606403] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 13:41:02 juju-e4d256-prod-github-runner-207 kernel: [29836.607197] ? __seccomp_filter+0x4a/0x4a0 Aug 22 13:41:02 juju-e4d256-prod-github-runner-207 kernel: [29836.607938] ? __fget_files+0x86/0xc0 Aug 22 13:41:02 juju-e4d256-prod-github-runner-207 kernel: [29836.608680] __x64_sys_ioctl+0x95/0xd0 Aug 22 13:41:02 juju-e4d256-prod-github-runner-207 kernel: [29836.609391] do_syscall_64+0x5c/0xc0 Aug 22 13:41:02 juju-e4d256-prod-github-runner-207 kernel: [29836.610061] ? do_futex+0x162/0x1f0 Aug 22 13:41:02 juju-e4d256-prod-github-runner-207 kernel: [29836.610707] ? __x64_sys_futex+0x78/0x1e0 Aug 22 13:41:02 juju-e4d256-prod-github-runner-207 kernel: [29836.611378] ? __secure_computing+0xa9/0x120 Aug 22 13:41:02 juju-e4d256-prod-github-runner-207 kernel: [29836.612069] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 13:41:02 juju-e4d256-prod-github-runner-207 kernel: [29836.612840] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:41:02 juju-e4d256-prod-github-runner-207 kernel: [29836.613559] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:41:02 juju-e4d256-prod-github-runner-207 kernel: [29836.614274] ? do_syscall_64+0x69/0xc0 Aug 22 13:41:02 juju-e4d256-prod-github-runner-207 kernel: [29836.614915] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:41:02 juju-e4d256-prod-github-runner-207 kernel: [29836.615615] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:41:02 juju-e4d256-prod-github-runner-207 kernel: [29836.616308] ? do_syscall_64+0x69/0xc0 Aug 22 13:41:02 juju-e4d256-prod-github-runner-207 kernel: [29836.616957] ? do_syscall_64+0x69/0xc0 Aug 22 13:41:02 juju-e4d256-prod-github-runner-207 kernel: [29836.617580] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 13:41:02 juju-e4d256-prod-github-runner-207 kernel: [29836.618282] RIP: 0033:0x7faa5d0edaff Aug 22 13:41:02 juju-e4d256-prod-github-runner-207 kernel: [29836.618933] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 13:41:02 juju-e4d256-prod-github-runner-207 kernel: [29836.620934] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 13:41:02 juju-e4d256-prod-github-runner-207 kernel: [29836.621964] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 13:41:02 juju-e4d256-prod-github-runner-207 kernel: [29836.622859] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 13:41:02 juju-e4d256-prod-github-runner-207 kernel: [29836.623746] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 13:41:02 juju-e4d256-prod-github-runner-207 kernel: [29836.624642] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 13:41:02 juju-e4d256-prod-github-runner-207 kernel: [29836.625531] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 13:41:02 juju-e4d256-prod-github-runner-207 kernel: [29836.626428] Aug 22 13:41:30 juju-e4d256-prod-github-runner-207 kernel: [29864.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 27705s! [qemu-system-x86:6715] Aug 22 13:41:30 juju-e4d256-prod-github-runner-207 kernel: [29864.543098] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 13:41:30 juju-e4d256-prod-github-runner-207 kernel: [29864.543172] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 13:41:30 juju-e4d256-prod-github-runner-207 kernel: [29864.555288] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 13:41:30 juju-e4d256-prod-github-runner-207 kernel: [29864.556574] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 13:41:30 juju-e4d256-prod-github-runner-207 kernel: [29864.557804] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:41:30 juju-e4d256-prod-github-runner-207 kernel: [29864.558934] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 13:41:30 juju-e4d256-prod-github-runner-207 kernel: [29864.561532] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 13:41:30 juju-e4d256-prod-github-runner-207 kernel: [29864.562594] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 13:41:30 juju-e4d256-prod-github-runner-207 kernel: [29864.563755] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 13:41:30 juju-e4d256-prod-github-runner-207 kernel: [29864.564936] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 13:41:30 juju-e4d256-prod-github-runner-207 kernel: [29864.566252] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 13:41:30 juju-e4d256-prod-github-runner-207 kernel: [29864.567423] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 13:41:30 juju-e4d256-prod-github-runner-207 kernel: [29864.568676] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 13:41:30 juju-e4d256-prod-github-runner-207 kernel: [29864.569933] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 13:41:30 juju-e4d256-prod-github-runner-207 kernel: [29864.571047] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 13:41:30 juju-e4d256-prod-github-runner-207 kernel: [29864.572280] Call Trace: Aug 22 13:41:30 juju-e4d256-prod-github-runner-207 kernel: [29864.573207] Aug 22 13:41:30 juju-e4d256-prod-github-runner-207 kernel: [29864.574098] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:41:30 juju-e4d256-prod-github-runner-207 kernel: [29864.575132] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:41:30 juju-e4d256-prod-github-runner-207 kernel: [29864.576190] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:41:30 juju-e4d256-prod-github-runner-207 kernel: [29864.577275] ? show_regs.part.0+0x23/0x29 Aug 22 13:41:30 juju-e4d256-prod-github-runner-207 kernel: [29864.578282] ? show_regs.cold+0x8/0xd Aug 22 13:41:30 juju-e4d256-prod-github-runner-207 kernel: [29864.579261] ? watchdog_timer_fn+0x1be/0x220 Aug 22 13:41:30 juju-e4d256-prod-github-runner-207 kernel: [29864.580290] ? lockup_detector_update_enable+0x60/0x60 Aug 22 13:41:30 juju-e4d256-prod-github-runner-207 kernel: [29864.581364] ? __hrtimer_run_queues+0x107/0x230 Aug 22 13:41:30 juju-e4d256-prod-github-runner-207 kernel: [29864.582401] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 13:41:30 juju-e4d256-prod-github-runner-207 kernel: [29864.583428] ? hrtimer_interrupt+0x101/0x220 Aug 22 13:41:30 juju-e4d256-prod-github-runner-207 kernel: [29864.584485] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 13:41:30 juju-e4d256-prod-github-runner-207 kernel: [29864.585578] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 13:41:30 juju-e4d256-prod-github-runner-207 kernel: [29864.586627] Aug 22 13:41:30 juju-e4d256-prod-github-runner-207 kernel: [29864.587491] Aug 22 13:41:30 juju-e4d256-prod-github-runner-207 kernel: [29864.588367] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 13:41:30 juju-e4d256-prod-github-runner-207 kernel: [29864.589427] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:41:30 juju-e4d256-prod-github-runner-207 kernel: [29864.590491] ? _raw_spin_lock+0x22/0x30 Aug 22 13:41:30 juju-e4d256-prod-github-runner-207 kernel: [29864.591469] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:41:30 juju-e4d256-prod-github-runner-207 kernel: [29864.592534] direct_page_fault+0x206/0x310 [kvm] Aug 22 13:41:30 juju-e4d256-prod-github-runner-207 kernel: [29864.593580] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 13:41:30 juju-e4d256-prod-github-runner-207 kernel: [29864.594592] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 13:41:30 juju-e4d256-prod-github-runner-207 kernel: [29864.595601] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 13:41:30 juju-e4d256-prod-github-runner-207 kernel: [29864.596825] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 13:41:30 juju-e4d256-prod-github-runner-207 kernel: [29864.597778] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 13:41:30 juju-e4d256-prod-github-runner-207 kernel: [29864.598770] handle_exit+0x98/0x230 [kvm_amd] Aug 22 13:41:30 juju-e4d256-prod-github-runner-207 kernel: [29864.599719] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 13:41:30 juju-e4d256-prod-github-runner-207 kernel: [29864.600670] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 13:41:30 juju-e4d256-prod-github-runner-207 kernel: [29864.601607] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 13:41:30 juju-e4d256-prod-github-runner-207 kernel: [29864.602516] vcpu_run+0x62/0x2c0 [kvm] Aug 22 13:41:30 juju-e4d256-prod-github-runner-207 kernel: [29864.603337] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 13:41:30 juju-e4d256-prod-github-runner-207 kernel: [29864.604174] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 13:41:30 juju-e4d256-prod-github-runner-207 kernel: [29864.605037] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 13:41:30 juju-e4d256-prod-github-runner-207 kernel: [29864.605841] ? __seccomp_filter+0x4a/0x4a0 Aug 22 13:41:30 juju-e4d256-prod-github-runner-207 kernel: [29864.606590] ? __fget_files+0x86/0xc0 Aug 22 13:41:30 juju-e4d256-prod-github-runner-207 kernel: [29864.607298] __x64_sys_ioctl+0x95/0xd0 Aug 22 13:41:30 juju-e4d256-prod-github-runner-207 kernel: [29864.608002] do_syscall_64+0x5c/0xc0 Aug 22 13:41:30 juju-e4d256-prod-github-runner-207 kernel: [29864.608740] ? do_futex+0x162/0x1f0 Aug 22 13:41:30 juju-e4d256-prod-github-runner-207 kernel: [29864.609405] ? __x64_sys_futex+0x78/0x1e0 Aug 22 13:41:30 juju-e4d256-prod-github-runner-207 kernel: [29864.610084] ? __secure_computing+0xa9/0x120 Aug 22 13:41:30 juju-e4d256-prod-github-runner-207 kernel: [29864.610783] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 13:41:30 juju-e4d256-prod-github-runner-207 kernel: [29864.611554] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:41:30 juju-e4d256-prod-github-runner-207 kernel: [29864.612303] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:41:30 juju-e4d256-prod-github-runner-207 kernel: [29864.613036] ? do_syscall_64+0x69/0xc0 Aug 22 13:41:30 juju-e4d256-prod-github-runner-207 kernel: [29864.613687] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:41:30 juju-e4d256-prod-github-runner-207 kernel: [29864.614401] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:41:30 juju-e4d256-prod-github-runner-207 kernel: [29864.615128] ? do_syscall_64+0x69/0xc0 Aug 22 13:41:30 juju-e4d256-prod-github-runner-207 kernel: [29864.615764] ? do_syscall_64+0x69/0xc0 Aug 22 13:41:30 juju-e4d256-prod-github-runner-207 kernel: [29864.616419] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 13:41:30 juju-e4d256-prod-github-runner-207 kernel: [29864.617132] RIP: 0033:0x7faa5d0edaff Aug 22 13:41:30 juju-e4d256-prod-github-runner-207 kernel: [29864.617782] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 13:41:30 juju-e4d256-prod-github-runner-207 kernel: [29864.619964] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 13:41:30 juju-e4d256-prod-github-runner-207 kernel: [29864.620959] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 13:41:30 juju-e4d256-prod-github-runner-207 kernel: [29864.621867] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 13:41:30 juju-e4d256-prod-github-runner-207 kernel: [29864.622759] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 13:41:30 juju-e4d256-prod-github-runner-207 kernel: [29864.623654] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 13:41:30 juju-e4d256-prod-github-runner-207 kernel: [29864.624568] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 13:41:30 juju-e4d256-prod-github-runner-207 kernel: [29864.625464] Aug 22 13:41:45 juju-e4d256-prod-github-runner-207 kernel: [29879.180705] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 13:41:45 juju-e4d256-prod-github-runner-207 kernel: [29879.181704] rcu: 1-....: (7417259 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=3584570 Aug 22 13:41:45 juju-e4d256-prod-github-runner-207 kernel: [29879.183089] (t=7440495 jiffies g=23269 q=33328) Aug 22 13:41:45 juju-e4d256-prod-github-runner-207 kernel: [29879.183887] NMI backtrace for cpu 1 Aug 22 13:41:45 juju-e4d256-prod-github-runner-207 kernel: [29879.184601] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 13:41:45 juju-e4d256-prod-github-runner-207 kernel: [29879.185975] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 13:41:45 juju-e4d256-prod-github-runner-207 kernel: [29879.187418] Call Trace: Aug 22 13:41:45 juju-e4d256-prod-github-runner-207 kernel: [29879.188117] Aug 22 13:41:45 juju-e4d256-prod-github-runner-207 kernel: [29879.188761] show_stack+0x52/0x5c Aug 22 13:41:45 juju-e4d256-prod-github-runner-207 kernel: [29879.189493] dump_stack_lvl+0x4a/0x63 Aug 22 13:41:45 juju-e4d256-prod-github-runner-207 kernel: [29879.190238] dump_stack+0x10/0x16 Aug 22 13:41:45 juju-e4d256-prod-github-runner-207 kernel: [29879.190955] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 13:41:45 juju-e4d256-prod-github-runner-207 kernel: [29879.191738] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 13:41:45 juju-e4d256-prod-github-runner-207 kernel: [29879.192536] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 13:41:45 juju-e4d256-prod-github-runner-207 kernel: [29879.193361] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 13:41:45 juju-e4d256-prod-github-runner-207 kernel: [29879.194179] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 13:41:45 juju-e4d256-prod-github-runner-207 kernel: [29879.194988] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 13:41:45 juju-e4d256-prod-github-runner-207 kernel: [29879.195766] print_cpu_stall.cold+0x2f/0xe2 Aug 22 13:41:45 juju-e4d256-prod-github-runner-207 kernel: [29879.196614] ? timekeeping_update+0xf7/0x150 Aug 22 13:41:45 juju-e4d256-prod-github-runner-207 kernel: [29879.197401] check_cpu_stall+0x109/0x270 Aug 22 13:41:45 juju-e4d256-prod-github-runner-207 kernel: [29879.198146] rcu_sched_clock_irq+0x9a/0x250 Aug 22 13:41:45 juju-e4d256-prod-github-runner-207 kernel: [29879.198940] update_process_times+0x94/0xd0 Aug 22 13:41:45 juju-e4d256-prod-github-runner-207 kernel: [29879.199712] tick_sched_handle+0x29/0x70 Aug 22 13:41:45 juju-e4d256-prod-github-runner-207 kernel: [29879.200468] tick_sched_timer+0x8c/0xc0 Aug 22 13:41:45 juju-e4d256-prod-github-runner-207 kernel: [29879.201206] ? tick_nohz_handler+0xb0/0xb0 Aug 22 13:41:45 juju-e4d256-prod-github-runner-207 kernel: [29879.201959] __hrtimer_run_queues+0x107/0x230 Aug 22 13:41:45 juju-e4d256-prod-github-runner-207 kernel: [29879.202756] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 13:41:45 juju-e4d256-prod-github-runner-207 kernel: [29879.203530] hrtimer_interrupt+0x101/0x220 Aug 22 13:41:45 juju-e4d256-prod-github-runner-207 kernel: [29879.204297] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 13:41:45 juju-e4d256-prod-github-runner-207 kernel: [29879.205106] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 13:41:45 juju-e4d256-prod-github-runner-207 kernel: [29879.205905] Aug 22 13:41:45 juju-e4d256-prod-github-runner-207 kernel: [29879.206538] Aug 22 13:41:45 juju-e4d256-prod-github-runner-207 kernel: [29879.207166] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 13:41:45 juju-e4d256-prod-github-runner-207 kernel: [29879.207999] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:41:45 juju-e4d256-prod-github-runner-207 kernel: [29879.208880] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 13:41:45 juju-e4d256-prod-github-runner-207 kernel: [29879.211122] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 13:41:45 juju-e4d256-prod-github-runner-207 kernel: [29879.212014] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 13:41:45 juju-e4d256-prod-github-runner-207 kernel: [29879.213005] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 13:41:45 juju-e4d256-prod-github-runner-207 kernel: [29879.213983] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 13:41:45 juju-e4d256-prod-github-runner-207 kernel: [29879.214941] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 13:41:45 juju-e4d256-prod-github-runner-207 kernel: [29879.215905] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 13:41:45 juju-e4d256-prod-github-runner-207 kernel: [29879.216863] ? _raw_spin_lock+0x22/0x30 Aug 22 13:41:45 juju-e4d256-prod-github-runner-207 kernel: [29879.217620] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:41:45 juju-e4d256-prod-github-runner-207 kernel: [29879.218454] direct_page_fault+0x206/0x310 [kvm] Aug 22 13:41:45 juju-e4d256-prod-github-runner-207 kernel: [29879.219292] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 13:41:45 juju-e4d256-prod-github-runner-207 kernel: [29879.220135] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 13:41:45 juju-e4d256-prod-github-runner-207 kernel: [29879.220961] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 13:41:45 juju-e4d256-prod-github-runner-207 kernel: [29879.221767] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 13:41:45 juju-e4d256-prod-github-runner-207 kernel: [29879.222552] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 13:41:45 juju-e4d256-prod-github-runner-207 kernel: [29879.223373] handle_exit+0x98/0x230 [kvm_amd] Aug 22 13:41:45 juju-e4d256-prod-github-runner-207 kernel: [29879.224137] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 13:41:45 juju-e4d256-prod-github-runner-207 kernel: [29879.224920] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 13:41:45 juju-e4d256-prod-github-runner-207 kernel: [29879.225718] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 13:41:45 juju-e4d256-prod-github-runner-207 kernel: [29879.226523] vcpu_run+0x62/0x2c0 [kvm] Aug 22 13:41:45 juju-e4d256-prod-github-runner-207 kernel: [29879.227241] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 13:41:45 juju-e4d256-prod-github-runner-207 kernel: [29879.228004] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 13:41:45 juju-e4d256-prod-github-runner-207 kernel: [29879.228813] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 13:41:45 juju-e4d256-prod-github-runner-207 kernel: [29879.229575] ? __seccomp_filter+0x4a/0x4a0 Aug 22 13:41:45 juju-e4d256-prod-github-runner-207 kernel: [29879.230320] ? __fget_files+0x86/0xc0 Aug 22 13:41:45 juju-e4d256-prod-github-runner-207 kernel: [29879.231018] __x64_sys_ioctl+0x95/0xd0 Aug 22 13:41:45 juju-e4d256-prod-github-runner-207 kernel: [29879.231716] do_syscall_64+0x5c/0xc0 Aug 22 13:41:45 juju-e4d256-prod-github-runner-207 kernel: [29879.232407] ? do_futex+0x162/0x1f0 Aug 22 13:41:45 juju-e4d256-prod-github-runner-207 kernel: [29879.233080] ? __x64_sys_futex+0x78/0x1e0 Aug 22 13:41:45 juju-e4d256-prod-github-runner-207 kernel: [29879.233782] ? __secure_computing+0xa9/0x120 Aug 22 13:41:45 juju-e4d256-prod-github-runner-207 kernel: [29879.234503] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 13:41:45 juju-e4d256-prod-github-runner-207 kernel: [29879.235298] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:41:45 juju-e4d256-prod-github-runner-207 kernel: [29879.236066] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:41:45 juju-e4d256-prod-github-runner-207 kernel: [29879.236825] ? do_syscall_64+0x69/0xc0 Aug 22 13:41:45 juju-e4d256-prod-github-runner-207 kernel: [29879.237527] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:41:45 juju-e4d256-prod-github-runner-207 kernel: [29879.238283] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:41:45 juju-e4d256-prod-github-runner-207 kernel: [29879.239039] ? do_syscall_64+0x69/0xc0 Aug 22 13:41:45 juju-e4d256-prod-github-runner-207 kernel: [29879.239735] ? do_syscall_64+0x69/0xc0 Aug 22 13:41:45 juju-e4d256-prod-github-runner-207 kernel: [29879.240429] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 13:41:45 juju-e4d256-prod-github-runner-207 kernel: [29879.241208] RIP: 0033:0x7faa5d0edaff Aug 22 13:41:45 juju-e4d256-prod-github-runner-207 kernel: [29879.241904] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 13:41:45 juju-e4d256-prod-github-runner-207 kernel: [29879.244012] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 13:41:45 juju-e4d256-prod-github-runner-207 kernel: [29879.244991] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 13:41:45 juju-e4d256-prod-github-runner-207 kernel: [29879.245937] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 13:41:45 juju-e4d256-prod-github-runner-207 kernel: [29879.246881] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 13:41:45 juju-e4d256-prod-github-runner-207 kernel: [29879.247821] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 13:41:45 juju-e4d256-prod-github-runner-207 kernel: [29879.248777] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 13:41:45 juju-e4d256-prod-github-runner-207 kernel: [29879.249689] Aug 22 13:42:10 juju-e4d256-prod-github-runner-207 kernel: [29904.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 27742s! [qemu-system-x86:6715] Aug 22 13:42:10 juju-e4d256-prod-github-runner-207 kernel: [29904.543303] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 13:42:10 juju-e4d256-prod-github-runner-207 kernel: [29904.543384] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 13:42:10 juju-e4d256-prod-github-runner-207 kernel: [29904.557305] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 13:42:10 juju-e4d256-prod-github-runner-207 kernel: [29904.558751] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 13:42:10 juju-e4d256-prod-github-runner-207 kernel: [29904.560206] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:42:10 juju-e4d256-prod-github-runner-207 kernel: [29904.561376] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 13:42:10 juju-e4d256-prod-github-runner-207 kernel: [29904.564276] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 13:42:10 juju-e4d256-prod-github-runner-207 kernel: [29904.565418] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 13:42:10 juju-e4d256-prod-github-runner-207 kernel: [29904.566719] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 13:42:10 juju-e4d256-prod-github-runner-207 kernel: [29904.568165] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 13:42:10 juju-e4d256-prod-github-runner-207 kernel: [29904.569483] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 13:42:10 juju-e4d256-prod-github-runner-207 kernel: [29904.570802] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 13:42:10 juju-e4d256-prod-github-runner-207 kernel: [29904.572121] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 13:42:10 juju-e4d256-prod-github-runner-207 kernel: [29904.573513] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 13:42:10 juju-e4d256-prod-github-runner-207 kernel: [29904.574719] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 13:42:10 juju-e4d256-prod-github-runner-207 kernel: [29904.576059] Call Trace: Aug 22 13:42:10 juju-e4d256-prod-github-runner-207 kernel: [29904.577026] Aug 22 13:42:10 juju-e4d256-prod-github-runner-207 kernel: [29904.577957] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:42:10 juju-e4d256-prod-github-runner-207 kernel: [29904.579074] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:42:10 juju-e4d256-prod-github-runner-207 kernel: [29904.580211] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:42:10 juju-e4d256-prod-github-runner-207 kernel: [29904.581386] ? show_regs.part.0+0x23/0x29 Aug 22 13:42:10 juju-e4d256-prod-github-runner-207 kernel: [29904.582467] ? show_regs.cold+0x8/0xd Aug 22 13:42:10 juju-e4d256-prod-github-runner-207 kernel: [29904.583511] ? watchdog_timer_fn+0x1be/0x220 Aug 22 13:42:10 juju-e4d256-prod-github-runner-207 kernel: [29904.584617] ? lockup_detector_update_enable+0x60/0x60 Aug 22 13:42:10 juju-e4d256-prod-github-runner-207 kernel: [29904.585776] ? __hrtimer_run_queues+0x107/0x230 Aug 22 13:42:10 juju-e4d256-prod-github-runner-207 kernel: [29904.586902] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 13:42:10 juju-e4d256-prod-github-runner-207 kernel: [29904.588028] ? hrtimer_interrupt+0x101/0x220 Aug 22 13:42:10 juju-e4d256-prod-github-runner-207 kernel: [29904.589127] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 13:42:10 juju-e4d256-prod-github-runner-207 kernel: [29904.590307] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 13:42:10 juju-e4d256-prod-github-runner-207 kernel: [29904.591498] Aug 22 13:42:10 juju-e4d256-prod-github-runner-207 kernel: [29904.592415] Aug 22 13:42:10 juju-e4d256-prod-github-runner-207 kernel: [29904.593300] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 13:42:10 juju-e4d256-prod-github-runner-207 kernel: [29904.594442] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:42:10 juju-e4d256-prod-github-runner-207 kernel: [29904.595602] ? _raw_spin_lock+0x22/0x30 Aug 22 13:42:10 juju-e4d256-prod-github-runner-207 kernel: [29904.596620] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:42:10 juju-e4d256-prod-github-runner-207 kernel: [29904.597728] direct_page_fault+0x206/0x310 [kvm] Aug 22 13:42:10 juju-e4d256-prod-github-runner-207 kernel: [29904.598838] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 13:42:10 juju-e4d256-prod-github-runner-207 kernel: [29904.599953] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 13:42:10 juju-e4d256-prod-github-runner-207 kernel: [29904.601042] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 13:42:10 juju-e4d256-prod-github-runner-207 kernel: [29904.602104] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 13:42:10 juju-e4d256-prod-github-runner-207 kernel: [29904.603157] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 13:42:10 juju-e4d256-prod-github-runner-207 kernel: [29904.604272] handle_exit+0x98/0x230 [kvm_amd] Aug 22 13:42:10 juju-e4d256-prod-github-runner-207 kernel: [29904.605246] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 13:42:10 juju-e4d256-prod-github-runner-207 kernel: [29904.606246] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 13:42:10 juju-e4d256-prod-github-runner-207 kernel: [29904.607267] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 13:42:10 juju-e4d256-prod-github-runner-207 kernel: [29904.608293] vcpu_run+0x62/0x2c0 [kvm] Aug 22 13:42:10 juju-e4d256-prod-github-runner-207 kernel: [29904.609175] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 13:42:10 juju-e4d256-prod-github-runner-207 kernel: [29904.610074] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 13:42:10 juju-e4d256-prod-github-runner-207 kernel: [29904.611026] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 13:42:10 juju-e4d256-prod-github-runner-207 kernel: [29904.611929] ? __seccomp_filter+0x4a/0x4a0 Aug 22 13:42:10 juju-e4d256-prod-github-runner-207 kernel: [29904.612760] ? __fget_files+0x86/0xc0 Aug 22 13:42:10 juju-e4d256-prod-github-runner-207 kernel: [29904.613536] __x64_sys_ioctl+0x95/0xd0 Aug 22 13:42:10 juju-e4d256-prod-github-runner-207 kernel: [29904.614347] do_syscall_64+0x5c/0xc0 Aug 22 13:42:10 juju-e4d256-prod-github-runner-207 kernel: [29904.615106] ? do_futex+0x162/0x1f0 Aug 22 13:42:10 juju-e4d256-prod-github-runner-207 kernel: [29904.615895] ? __x64_sys_futex+0x78/0x1e0 Aug 22 13:42:10 juju-e4d256-prod-github-runner-207 kernel: [29904.616713] ? __secure_computing+0xa9/0x120 Aug 22 13:42:10 juju-e4d256-prod-github-runner-207 kernel: [29904.617549] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 13:42:10 juju-e4d256-prod-github-runner-207 kernel: [29904.618448] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:42:10 juju-e4d256-prod-github-runner-207 kernel: [29904.619315] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:42:10 juju-e4d256-prod-github-runner-207 kernel: [29904.620161] ? do_syscall_64+0x69/0xc0 Aug 22 13:42:10 juju-e4d256-prod-github-runner-207 kernel: [29904.620912] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:42:10 juju-e4d256-prod-github-runner-207 kernel: [29904.621789] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:42:10 juju-e4d256-prod-github-runner-207 kernel: [29904.622640] ? do_syscall_64+0x69/0xc0 Aug 22 13:42:10 juju-e4d256-prod-github-runner-207 kernel: [29904.623354] ? do_syscall_64+0x69/0xc0 Aug 22 13:42:10 juju-e4d256-prod-github-runner-207 kernel: [29904.624097] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 13:42:10 juju-e4d256-prod-github-runner-207 kernel: [29904.624930] RIP: 0033:0x7faa5d0edaff Aug 22 13:42:10 juju-e4d256-prod-github-runner-207 kernel: [29904.625641] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 13:42:10 juju-e4d256-prod-github-runner-207 kernel: [29904.628047] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 13:42:10 juju-e4d256-prod-github-runner-207 kernel: [29904.629164] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 13:42:10 juju-e4d256-prod-github-runner-207 kernel: [29904.630244] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 13:42:10 juju-e4d256-prod-github-runner-207 kernel: [29904.631324] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 13:42:10 juju-e4d256-prod-github-runner-207 kernel: [29904.632404] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 13:42:10 juju-e4d256-prod-github-runner-207 kernel: [29904.633491] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 13:42:10 juju-e4d256-prod-github-runner-207 kernel: [29904.634570] Aug 22 13:42:38 juju-e4d256-prod-github-runner-207 kernel: [29932.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 27768s! [qemu-system-x86:6715] Aug 22 13:42:38 juju-e4d256-prod-github-runner-207 kernel: [29932.544152] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 13:42:38 juju-e4d256-prod-github-runner-207 kernel: [29932.544549] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 13:42:38 juju-e4d256-prod-github-runner-207 kernel: [29932.557037] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 13:42:38 juju-e4d256-prod-github-runner-207 kernel: [29932.558302] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 13:42:38 juju-e4d256-prod-github-runner-207 kernel: [29932.559532] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:42:38 juju-e4d256-prod-github-runner-207 kernel: [29932.560587] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 13:42:38 juju-e4d256-prod-github-runner-207 kernel: [29932.563128] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 13:42:38 juju-e4d256-prod-github-runner-207 kernel: [29932.564181] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 13:42:38 juju-e4d256-prod-github-runner-207 kernel: [29932.565343] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 13:42:38 juju-e4d256-prod-github-runner-207 kernel: [29932.566500] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 13:42:38 juju-e4d256-prod-github-runner-207 kernel: [29932.567693] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 13:42:38 juju-e4d256-prod-github-runner-207 kernel: [29932.568917] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 13:42:38 juju-e4d256-prod-github-runner-207 kernel: [29932.570114] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 13:42:38 juju-e4d256-prod-github-runner-207 kernel: [29932.571370] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 13:42:38 juju-e4d256-prod-github-runner-207 kernel: [29932.572475] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 13:42:38 juju-e4d256-prod-github-runner-207 kernel: [29932.573688] Call Trace: Aug 22 13:42:38 juju-e4d256-prod-github-runner-207 kernel: [29932.574632] Aug 22 13:42:38 juju-e4d256-prod-github-runner-207 kernel: [29932.575560] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:42:38 juju-e4d256-prod-github-runner-207 kernel: [29932.576617] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:42:38 juju-e4d256-prod-github-runner-207 kernel: [29932.577652] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:42:38 juju-e4d256-prod-github-runner-207 kernel: [29932.578791] ? show_regs.part.0+0x23/0x29 Aug 22 13:42:38 juju-e4d256-prod-github-runner-207 kernel: [29932.579824] ? show_regs.cold+0x8/0xd Aug 22 13:42:38 juju-e4d256-prod-github-runner-207 kernel: [29932.580802] ? watchdog_timer_fn+0x1be/0x220 Aug 22 13:42:38 juju-e4d256-prod-github-runner-207 kernel: [29932.581812] ? lockup_detector_update_enable+0x60/0x60 Aug 22 13:42:38 juju-e4d256-prod-github-runner-207 kernel: [29932.582881] ? __hrtimer_run_queues+0x107/0x230 Aug 22 13:42:38 juju-e4d256-prod-github-runner-207 kernel: [29932.583935] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 13:42:38 juju-e4d256-prod-github-runner-207 kernel: [29932.584993] ? hrtimer_interrupt+0x101/0x220 Aug 22 13:42:38 juju-e4d256-prod-github-runner-207 kernel: [29932.586018] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 13:42:38 juju-e4d256-prod-github-runner-207 kernel: [29932.587088] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 13:42:38 juju-e4d256-prod-github-runner-207 kernel: [29932.588151] Aug 22 13:42:38 juju-e4d256-prod-github-runner-207 kernel: [29932.589023] Aug 22 13:42:38 juju-e4d256-prod-github-runner-207 kernel: [29932.589883] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 13:42:38 juju-e4d256-prod-github-runner-207 kernel: [29932.590926] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:42:38 juju-e4d256-prod-github-runner-207 kernel: [29932.591979] ? _raw_spin_lock+0x22/0x30 Aug 22 13:42:38 juju-e4d256-prod-github-runner-207 kernel: [29932.592934] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:42:38 juju-e4d256-prod-github-runner-207 kernel: [29932.593973] direct_page_fault+0x206/0x310 [kvm] Aug 22 13:42:38 juju-e4d256-prod-github-runner-207 kernel: [29932.595033] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 13:42:38 juju-e4d256-prod-github-runner-207 kernel: [29932.596066] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 13:42:38 juju-e4d256-prod-github-runner-207 kernel: [29932.597243] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 13:42:38 juju-e4d256-prod-github-runner-207 kernel: [29932.598316] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 13:42:38 juju-e4d256-prod-github-runner-207 kernel: [29932.599305] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 13:42:38 juju-e4d256-prod-github-runner-207 kernel: [29932.600338] handle_exit+0x98/0x230 [kvm_amd] Aug 22 13:42:38 juju-e4d256-prod-github-runner-207 kernel: [29932.601253] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 13:42:38 juju-e4d256-prod-github-runner-207 kernel: [29932.602177] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 13:42:38 juju-e4d256-prod-github-runner-207 kernel: [29932.603115] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 13:42:38 juju-e4d256-prod-github-runner-207 kernel: [29932.604059] vcpu_run+0x62/0x2c0 [kvm] Aug 22 13:42:38 juju-e4d256-prod-github-runner-207 kernel: [29932.604895] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 13:42:38 juju-e4d256-prod-github-runner-207 kernel: [29932.605726] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 13:42:38 juju-e4d256-prod-github-runner-207 kernel: [29932.606597] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 13:42:38 juju-e4d256-prod-github-runner-207 kernel: [29932.607421] ? __seccomp_filter+0x4a/0x4a0 Aug 22 13:42:38 juju-e4d256-prod-github-runner-207 kernel: [29932.608172] ? __fget_files+0x86/0xc0 Aug 22 13:42:38 juju-e4d256-prod-github-runner-207 kernel: [29932.608881] __x64_sys_ioctl+0x95/0xd0 Aug 22 13:42:38 juju-e4d256-prod-github-runner-207 kernel: [29932.609597] do_syscall_64+0x5c/0xc0 Aug 22 13:42:38 juju-e4d256-prod-github-runner-207 kernel: [29932.610280] ? do_futex+0x162/0x1f0 Aug 22 13:42:38 juju-e4d256-prod-github-runner-207 kernel: [29932.610943] ? __x64_sys_futex+0x78/0x1e0 Aug 22 13:42:38 juju-e4d256-prod-github-runner-207 kernel: [29932.611636] ? __secure_computing+0xa9/0x120 Aug 22 13:42:38 juju-e4d256-prod-github-runner-207 kernel: [29932.612335] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 13:42:38 juju-e4d256-prod-github-runner-207 kernel: [29932.613099] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:42:38 juju-e4d256-prod-github-runner-207 kernel: [29932.613829] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:42:38 juju-e4d256-prod-github-runner-207 kernel: [29932.614559] ? do_syscall_64+0x69/0xc0 Aug 22 13:42:38 juju-e4d256-prod-github-runner-207 kernel: [29932.615241] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:42:38 juju-e4d256-prod-github-runner-207 kernel: [29932.615964] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:42:38 juju-e4d256-prod-github-runner-207 kernel: [29932.616678] ? do_syscall_64+0x69/0xc0 Aug 22 13:42:38 juju-e4d256-prod-github-runner-207 kernel: [29932.617393] ? do_syscall_64+0x69/0xc0 Aug 22 13:42:38 juju-e4d256-prod-github-runner-207 kernel: [29932.618025] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 13:42:38 juju-e4d256-prod-github-runner-207 kernel: [29932.618735] RIP: 0033:0x7faa5d0edaff Aug 22 13:42:38 juju-e4d256-prod-github-runner-207 kernel: [29932.619431] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 13:42:38 juju-e4d256-prod-github-runner-207 kernel: [29932.621450] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 13:42:38 juju-e4d256-prod-github-runner-207 kernel: [29932.622371] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 13:42:38 juju-e4d256-prod-github-runner-207 kernel: [29932.623279] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 13:42:38 juju-e4d256-prod-github-runner-207 kernel: [29932.624177] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 13:42:38 juju-e4d256-prod-github-runner-207 kernel: [29932.625080] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 13:42:38 juju-e4d256-prod-github-runner-207 kernel: [29932.626031] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 13:42:38 juju-e4d256-prod-github-runner-207 kernel: [29932.626939] Aug 22 13:43:06 juju-e4d256-prod-github-runner-207 kernel: [29960.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 27794s! [qemu-system-x86:6715] Aug 22 13:43:06 juju-e4d256-prod-github-runner-207 kernel: [29960.543242] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 13:43:06 juju-e4d256-prod-github-runner-207 kernel: [29960.543322] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 13:43:06 juju-e4d256-prod-github-runner-207 kernel: [29960.556532] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 13:43:06 juju-e4d256-prod-github-runner-207 kernel: [29960.557869] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 13:43:06 juju-e4d256-prod-github-runner-207 kernel: [29960.559151] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:43:06 juju-e4d256-prod-github-runner-207 kernel: [29960.560210] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 13:43:06 juju-e4d256-prod-github-runner-207 kernel: [29960.562743] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 13:43:06 juju-e4d256-prod-github-runner-207 kernel: [29960.563792] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 13:43:06 juju-e4d256-prod-github-runner-207 kernel: [29960.564952] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 13:43:06 juju-e4d256-prod-github-runner-207 kernel: [29960.566106] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 13:43:06 juju-e4d256-prod-github-runner-207 kernel: [29960.567272] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 13:43:06 juju-e4d256-prod-github-runner-207 kernel: [29960.568477] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 13:43:06 juju-e4d256-prod-github-runner-207 kernel: [29960.569648] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 13:43:06 juju-e4d256-prod-github-runner-207 kernel: [29960.570898] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 13:43:06 juju-e4d256-prod-github-runner-207 kernel: [29960.571997] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 13:43:06 juju-e4d256-prod-github-runner-207 kernel: [29960.573186] Call Trace: Aug 22 13:43:06 juju-e4d256-prod-github-runner-207 kernel: [29960.574094] Aug 22 13:43:06 juju-e4d256-prod-github-runner-207 kernel: [29960.574996] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:43:06 juju-e4d256-prod-github-runner-207 kernel: [29960.576046] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:43:06 juju-e4d256-prod-github-runner-207 kernel: [29960.577093] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:43:06 juju-e4d256-prod-github-runner-207 kernel: [29960.578171] ? show_regs.part.0+0x23/0x29 Aug 22 13:43:06 juju-e4d256-prod-github-runner-207 kernel: [29960.579180] ? show_regs.cold+0x8/0xd Aug 22 13:43:06 juju-e4d256-prod-github-runner-207 kernel: [29960.580154] ? watchdog_timer_fn+0x1be/0x220 Aug 22 13:43:06 juju-e4d256-prod-github-runner-207 kernel: [29960.581204] ? lockup_detector_update_enable+0x60/0x60 Aug 22 13:43:06 juju-e4d256-prod-github-runner-207 kernel: [29960.582280] ? __hrtimer_run_queues+0x107/0x230 Aug 22 13:43:06 juju-e4d256-prod-github-runner-207 kernel: [29960.583322] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 13:43:06 juju-e4d256-prod-github-runner-207 kernel: [29960.584344] ? hrtimer_interrupt+0x101/0x220 Aug 22 13:43:06 juju-e4d256-prod-github-runner-207 kernel: [29960.585357] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 13:43:06 juju-e4d256-prod-github-runner-207 kernel: [29960.586422] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 13:43:06 juju-e4d256-prod-github-runner-207 kernel: [29960.587487] Aug 22 13:43:06 juju-e4d256-prod-github-runner-207 kernel: [29960.588341] Aug 22 13:43:06 juju-e4d256-prod-github-runner-207 kernel: [29960.589177] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 13:43:06 juju-e4d256-prod-github-runner-207 kernel: [29960.590216] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:43:06 juju-e4d256-prod-github-runner-207 kernel: [29960.591277] ? _raw_spin_lock+0x22/0x30 Aug 22 13:43:06 juju-e4d256-prod-github-runner-207 kernel: [29960.592221] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:43:06 juju-e4d256-prod-github-runner-207 kernel: [29960.593273] direct_page_fault+0x206/0x310 [kvm] Aug 22 13:43:06 juju-e4d256-prod-github-runner-207 kernel: [29960.594440] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 13:43:06 juju-e4d256-prod-github-runner-207 kernel: [29960.595472] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 13:43:06 juju-e4d256-prod-github-runner-207 kernel: [29960.596472] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 13:43:06 juju-e4d256-prod-github-runner-207 kernel: [29960.597444] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 13:43:06 juju-e4d256-prod-github-runner-207 kernel: [29960.598612] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 13:43:06 juju-e4d256-prod-github-runner-207 kernel: [29960.599852] handle_exit+0x98/0x230 [kvm_amd] Aug 22 13:43:06 juju-e4d256-prod-github-runner-207 kernel: [29960.600769] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 13:43:06 juju-e4d256-prod-github-runner-207 kernel: [29960.601703] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 13:43:06 juju-e4d256-prod-github-runner-207 kernel: [29960.602647] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 13:43:06 juju-e4d256-prod-github-runner-207 kernel: [29960.603594] vcpu_run+0x62/0x2c0 [kvm] Aug 22 13:43:06 juju-e4d256-prod-github-runner-207 kernel: [29960.604410] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 13:43:06 juju-e4d256-prod-github-runner-207 kernel: [29960.605222] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 13:43:06 juju-e4d256-prod-github-runner-207 kernel: [29960.606079] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 13:43:06 juju-e4d256-prod-github-runner-207 kernel: [29960.606875] ? __seccomp_filter+0x4a/0x4a0 Aug 22 13:43:06 juju-e4d256-prod-github-runner-207 kernel: [29960.607633] ? __fget_files+0x86/0xc0 Aug 22 13:43:06 juju-e4d256-prod-github-runner-207 kernel: [29960.608378] __x64_sys_ioctl+0x95/0xd0 Aug 22 13:43:06 juju-e4d256-prod-github-runner-207 kernel: [29960.609080] do_syscall_64+0x5c/0xc0 Aug 22 13:43:06 juju-e4d256-prod-github-runner-207 kernel: [29960.609752] ? do_futex+0x162/0x1f0 Aug 22 13:43:06 juju-e4d256-prod-github-runner-207 kernel: [29960.610401] ? __x64_sys_futex+0x78/0x1e0 Aug 22 13:43:06 juju-e4d256-prod-github-runner-207 kernel: [29960.611175] ? __secure_computing+0xa9/0x120 Aug 22 13:43:06 juju-e4d256-prod-github-runner-207 kernel: [29960.611874] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 13:43:06 juju-e4d256-prod-github-runner-207 kernel: [29960.612639] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:43:06 juju-e4d256-prod-github-runner-207 kernel: [29960.613363] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:43:06 juju-e4d256-prod-github-runner-207 kernel: [29960.614083] ? do_syscall_64+0x69/0xc0 Aug 22 13:43:06 juju-e4d256-prod-github-runner-207 kernel: [29960.614728] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:43:06 juju-e4d256-prod-github-runner-207 kernel: [29960.615441] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:43:06 juju-e4d256-prod-github-runner-207 kernel: [29960.616144] ? do_syscall_64+0x69/0xc0 Aug 22 13:43:06 juju-e4d256-prod-github-runner-207 kernel: [29960.616768] ? do_syscall_64+0x69/0xc0 Aug 22 13:43:06 juju-e4d256-prod-github-runner-207 kernel: [29960.617396] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 13:43:06 juju-e4d256-prod-github-runner-207 kernel: [29960.618145] RIP: 0033:0x7faa5d0edaff Aug 22 13:43:06 juju-e4d256-prod-github-runner-207 kernel: [29960.618779] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 13:43:06 juju-e4d256-prod-github-runner-207 kernel: [29960.620793] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 13:43:06 juju-e4d256-prod-github-runner-207 kernel: [29960.621711] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 13:43:06 juju-e4d256-prod-github-runner-207 kernel: [29960.622603] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 13:43:06 juju-e4d256-prod-github-runner-207 kernel: [29960.623519] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 13:43:06 juju-e4d256-prod-github-runner-207 kernel: [29960.624419] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 13:43:06 juju-e4d256-prod-github-runner-207 kernel: [29960.625346] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 13:43:06 juju-e4d256-prod-github-runner-207 kernel: [29960.626301] Aug 22 13:43:34 juju-e4d256-prod-github-runner-207 kernel: [29988.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 27821s! [qemu-system-x86:6715] Aug 22 13:43:34 juju-e4d256-prod-github-runner-207 kernel: [29988.543120] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 13:43:34 juju-e4d256-prod-github-runner-207 kernel: [29988.543192] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 13:43:34 juju-e4d256-prod-github-runner-207 kernel: [29988.555372] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 13:43:34 juju-e4d256-prod-github-runner-207 kernel: [29988.556637] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 13:43:34 juju-e4d256-prod-github-runner-207 kernel: [29988.557855] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:43:34 juju-e4d256-prod-github-runner-207 kernel: [29988.558933] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 13:43:34 juju-e4d256-prod-github-runner-207 kernel: [29988.561503] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 13:43:34 juju-e4d256-prod-github-runner-207 kernel: [29988.562584] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 13:43:34 juju-e4d256-prod-github-runner-207 kernel: [29988.563758] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 13:43:34 juju-e4d256-prod-github-runner-207 kernel: [29988.564953] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 13:43:34 juju-e4d256-prod-github-runner-207 kernel: [29988.566117] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 13:43:34 juju-e4d256-prod-github-runner-207 kernel: [29988.567304] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 13:43:34 juju-e4d256-prod-github-runner-207 kernel: [29988.568489] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 13:43:34 juju-e4d256-prod-github-runner-207 kernel: [29988.569738] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 13:43:34 juju-e4d256-prod-github-runner-207 kernel: [29988.570854] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 13:43:34 juju-e4d256-prod-github-runner-207 kernel: [29988.572057] Call Trace: Aug 22 13:43:34 juju-e4d256-prod-github-runner-207 kernel: [29988.572969] Aug 22 13:43:34 juju-e4d256-prod-github-runner-207 kernel: [29988.573865] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:43:34 juju-e4d256-prod-github-runner-207 kernel: [29988.574937] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:43:34 juju-e4d256-prod-github-runner-207 kernel: [29988.575965] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:43:34 juju-e4d256-prod-github-runner-207 kernel: [29988.577043] ? show_regs.part.0+0x23/0x29 Aug 22 13:43:34 juju-e4d256-prod-github-runner-207 kernel: [29988.578039] ? show_regs.cold+0x8/0xd Aug 22 13:43:34 juju-e4d256-prod-github-runner-207 kernel: [29988.579047] ? watchdog_timer_fn+0x1be/0x220 Aug 22 13:43:34 juju-e4d256-prod-github-runner-207 kernel: [29988.580072] ? lockup_detector_update_enable+0x60/0x60 Aug 22 13:43:34 juju-e4d256-prod-github-runner-207 kernel: [29988.581139] ? __hrtimer_run_queues+0x107/0x230 Aug 22 13:43:34 juju-e4d256-prod-github-runner-207 kernel: [29988.582170] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 13:43:34 juju-e4d256-prod-github-runner-207 kernel: [29988.583210] ? hrtimer_interrupt+0x101/0x220 Aug 22 13:43:34 juju-e4d256-prod-github-runner-207 kernel: [29988.584250] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 13:43:34 juju-e4d256-prod-github-runner-207 kernel: [29988.585368] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 13:43:34 juju-e4d256-prod-github-runner-207 kernel: [29988.586425] Aug 22 13:43:34 juju-e4d256-prod-github-runner-207 kernel: [29988.587289] Aug 22 13:43:34 juju-e4d256-prod-github-runner-207 kernel: [29988.588126] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 13:43:34 juju-e4d256-prod-github-runner-207 kernel: [29988.589167] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:43:34 juju-e4d256-prod-github-runner-207 kernel: [29988.590229] ? _raw_spin_lock+0x22/0x30 Aug 22 13:43:34 juju-e4d256-prod-github-runner-207 kernel: [29988.591185] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:43:34 juju-e4d256-prod-github-runner-207 kernel: [29988.592387] direct_page_fault+0x206/0x310 [kvm] Aug 22 13:43:34 juju-e4d256-prod-github-runner-207 kernel: [29988.593415] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 13:43:34 juju-e4d256-prod-github-runner-207 kernel: [29988.594432] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 13:43:34 juju-e4d256-prod-github-runner-207 kernel: [29988.595564] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 13:43:34 juju-e4d256-prod-github-runner-207 kernel: [29988.596539] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 13:43:34 juju-e4d256-prod-github-runner-207 kernel: [29988.597485] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 13:43:34 juju-e4d256-prod-github-runner-207 kernel: [29988.598468] handle_exit+0x98/0x230 [kvm_amd] Aug 22 13:43:34 juju-e4d256-prod-github-runner-207 kernel: [29988.599525] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 13:43:34 juju-e4d256-prod-github-runner-207 kernel: [29988.600464] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 13:43:34 juju-e4d256-prod-github-runner-207 kernel: [29988.601397] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 13:43:34 juju-e4d256-prod-github-runner-207 kernel: [29988.602301] vcpu_run+0x62/0x2c0 [kvm] Aug 22 13:43:34 juju-e4d256-prod-github-runner-207 kernel: [29988.603135] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 13:43:34 juju-e4d256-prod-github-runner-207 kernel: [29988.603951] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 13:43:34 juju-e4d256-prod-github-runner-207 kernel: [29988.604835] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 13:43:34 juju-e4d256-prod-github-runner-207 kernel: [29988.605678] ? __seccomp_filter+0x4a/0x4a0 Aug 22 13:43:34 juju-e4d256-prod-github-runner-207 kernel: [29988.606425] ? __fget_files+0x86/0xc0 Aug 22 13:43:34 juju-e4d256-prod-github-runner-207 kernel: [29988.607149] __x64_sys_ioctl+0x95/0xd0 Aug 22 13:43:34 juju-e4d256-prod-github-runner-207 kernel: [29988.607843] do_syscall_64+0x5c/0xc0 Aug 22 13:43:34 juju-e4d256-prod-github-runner-207 kernel: [29988.608508] ? do_futex+0x162/0x1f0 Aug 22 13:43:34 juju-e4d256-prod-github-runner-207 kernel: [29988.609156] ? __x64_sys_futex+0x78/0x1e0 Aug 22 13:43:34 juju-e4d256-prod-github-runner-207 kernel: [29988.609838] ? __secure_computing+0xa9/0x120 Aug 22 13:43:34 juju-e4d256-prod-github-runner-207 kernel: [29988.610531] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 13:43:34 juju-e4d256-prod-github-runner-207 kernel: [29988.611320] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:43:34 juju-e4d256-prod-github-runner-207 kernel: [29988.612041] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:43:34 juju-e4d256-prod-github-runner-207 kernel: [29988.612757] ? do_syscall_64+0x69/0xc0 Aug 22 13:43:34 juju-e4d256-prod-github-runner-207 kernel: [29988.613410] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:43:34 juju-e4d256-prod-github-runner-207 kernel: [29988.614118] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:43:34 juju-e4d256-prod-github-runner-207 kernel: [29988.614845] ? do_syscall_64+0x69/0xc0 Aug 22 13:43:34 juju-e4d256-prod-github-runner-207 kernel: [29988.615494] ? do_syscall_64+0x69/0xc0 Aug 22 13:43:34 juju-e4d256-prod-github-runner-207 kernel: [29988.616138] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 13:43:34 juju-e4d256-prod-github-runner-207 kernel: [29988.616872] RIP: 0033:0x7faa5d0edaff Aug 22 13:43:34 juju-e4d256-prod-github-runner-207 kernel: [29988.617503] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 13:43:34 juju-e4d256-prod-github-runner-207 kernel: [29988.619511] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 13:43:34 juju-e4d256-prod-github-runner-207 kernel: [29988.620730] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 13:43:34 juju-e4d256-prod-github-runner-207 kernel: [29988.621627] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 13:43:34 juju-e4d256-prod-github-runner-207 kernel: [29988.622514] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 13:43:34 juju-e4d256-prod-github-runner-207 kernel: [29988.623413] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 13:43:34 juju-e4d256-prod-github-runner-207 kernel: [29988.624313] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 13:43:34 juju-e4d256-prod-github-runner-207 kernel: [29988.625213] Aug 22 13:44:02 juju-e4d256-prod-github-runner-207 kernel: [30016.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 27847s! [qemu-system-x86:6715] Aug 22 13:44:02 juju-e4d256-prod-github-runner-207 kernel: [30016.543893] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 13:44:02 juju-e4d256-prod-github-runner-207 kernel: [30016.544198] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 13:44:02 juju-e4d256-prod-github-runner-207 kernel: [30016.556405] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 13:44:02 juju-e4d256-prod-github-runner-207 kernel: [30016.557690] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 13:44:02 juju-e4d256-prod-github-runner-207 kernel: [30016.558930] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:44:02 juju-e4d256-prod-github-runner-207 kernel: [30016.559995] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 13:44:02 juju-e4d256-prod-github-runner-207 kernel: [30016.562765] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 13:44:02 juju-e4d256-prod-github-runner-207 kernel: [30016.563991] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 13:44:02 juju-e4d256-prod-github-runner-207 kernel: [30016.565154] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 13:44:02 juju-e4d256-prod-github-runner-207 kernel: [30016.566353] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 13:44:02 juju-e4d256-prod-github-runner-207 kernel: [30016.567530] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 13:44:02 juju-e4d256-prod-github-runner-207 kernel: [30016.568696] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 13:44:02 juju-e4d256-prod-github-runner-207 kernel: [30016.569868] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 13:44:02 juju-e4d256-prod-github-runner-207 kernel: [30016.571124] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 13:44:02 juju-e4d256-prod-github-runner-207 kernel: [30016.572275] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 13:44:02 juju-e4d256-prod-github-runner-207 kernel: [30016.573499] Call Trace: Aug 22 13:44:02 juju-e4d256-prod-github-runner-207 kernel: [30016.574437] Aug 22 13:44:02 juju-e4d256-prod-github-runner-207 kernel: [30016.575338] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:44:02 juju-e4d256-prod-github-runner-207 kernel: [30016.576373] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:44:02 juju-e4d256-prod-github-runner-207 kernel: [30016.577417] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:44:02 juju-e4d256-prod-github-runner-207 kernel: [30016.578534] ? show_regs.part.0+0x23/0x29 Aug 22 13:44:02 juju-e4d256-prod-github-runner-207 kernel: [30016.579534] ? show_regs.cold+0x8/0xd Aug 22 13:44:02 juju-e4d256-prod-github-runner-207 kernel: [30016.580509] ? watchdog_timer_fn+0x1be/0x220 Aug 22 13:44:02 juju-e4d256-prod-github-runner-207 kernel: [30016.581537] ? lockup_detector_update_enable+0x60/0x60 Aug 22 13:44:02 juju-e4d256-prod-github-runner-207 kernel: [30016.582823] ? __hrtimer_run_queues+0x107/0x230 Aug 22 13:44:02 juju-e4d256-prod-github-runner-207 kernel: [30016.583858] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 13:44:02 juju-e4d256-prod-github-runner-207 kernel: [30016.584883] ? hrtimer_interrupt+0x101/0x220 Aug 22 13:44:02 juju-e4d256-prod-github-runner-207 kernel: [30016.585903] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 13:44:02 juju-e4d256-prod-github-runner-207 kernel: [30016.587010] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 13:44:02 juju-e4d256-prod-github-runner-207 kernel: [30016.588073] Aug 22 13:44:02 juju-e4d256-prod-github-runner-207 kernel: [30016.588945] Aug 22 13:44:02 juju-e4d256-prod-github-runner-207 kernel: [30016.589790] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 13:44:02 juju-e4d256-prod-github-runner-207 kernel: [30016.590970] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:44:02 juju-e4d256-prod-github-runner-207 kernel: [30016.592030] ? _raw_spin_lock+0x22/0x30 Aug 22 13:44:02 juju-e4d256-prod-github-runner-207 kernel: [30016.592978] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:44:02 juju-e4d256-prod-github-runner-207 kernel: [30016.593995] direct_page_fault+0x206/0x310 [kvm] Aug 22 13:44:02 juju-e4d256-prod-github-runner-207 kernel: [30016.595037] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 13:44:02 juju-e4d256-prod-github-runner-207 kernel: [30016.596048] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 13:44:02 juju-e4d256-prod-github-runner-207 kernel: [30016.597189] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 13:44:02 juju-e4d256-prod-github-runner-207 kernel: [30016.598227] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 13:44:02 juju-e4d256-prod-github-runner-207 kernel: [30016.599178] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 13:44:02 juju-e4d256-prod-github-runner-207 kernel: [30016.600155] handle_exit+0x98/0x230 [kvm_amd] Aug 22 13:44:02 juju-e4d256-prod-github-runner-207 kernel: [30016.601047] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 13:44:02 juju-e4d256-prod-github-runner-207 kernel: [30016.601966] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 13:44:02 juju-e4d256-prod-github-runner-207 kernel: [30016.602902] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 13:44:02 juju-e4d256-prod-github-runner-207 kernel: [30016.603803] vcpu_run+0x62/0x2c0 [kvm] Aug 22 13:44:02 juju-e4d256-prod-github-runner-207 kernel: [30016.604618] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 13:44:02 juju-e4d256-prod-github-runner-207 kernel: [30016.605423] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 13:44:02 juju-e4d256-prod-github-runner-207 kernel: [30016.606284] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 13:44:02 juju-e4d256-prod-github-runner-207 kernel: [30016.607079] ? __seccomp_filter+0x4a/0x4a0 Aug 22 13:44:02 juju-e4d256-prod-github-runner-207 kernel: [30016.607831] ? __fget_files+0x86/0xc0 Aug 22 13:44:02 juju-e4d256-prod-github-runner-207 kernel: [30016.608547] __x64_sys_ioctl+0x95/0xd0 Aug 22 13:44:02 juju-e4d256-prod-github-runner-207 kernel: [30016.609239] do_syscall_64+0x5c/0xc0 Aug 22 13:44:02 juju-e4d256-prod-github-runner-207 kernel: [30016.609903] ? do_futex+0x162/0x1f0 Aug 22 13:44:02 juju-e4d256-prod-github-runner-207 kernel: [30016.610568] ? __x64_sys_futex+0x78/0x1e0 Aug 22 13:44:02 juju-e4d256-prod-github-runner-207 kernel: [30016.611240] ? __secure_computing+0xa9/0x120 Aug 22 13:44:02 juju-e4d256-prod-github-runner-207 kernel: [30016.611934] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 13:44:02 juju-e4d256-prod-github-runner-207 kernel: [30016.612693] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:44:02 juju-e4d256-prod-github-runner-207 kernel: [30016.613414] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:44:02 juju-e4d256-prod-github-runner-207 kernel: [30016.614135] ? do_syscall_64+0x69/0xc0 Aug 22 13:44:02 juju-e4d256-prod-github-runner-207 kernel: [30016.614789] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:44:02 juju-e4d256-prod-github-runner-207 kernel: [30016.615511] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:44:02 juju-e4d256-prod-github-runner-207 kernel: [30016.616204] ? do_syscall_64+0x69/0xc0 Aug 22 13:44:02 juju-e4d256-prod-github-runner-207 kernel: [30016.616827] ? do_syscall_64+0x69/0xc0 Aug 22 13:44:02 juju-e4d256-prod-github-runner-207 kernel: [30016.617447] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 13:44:02 juju-e4d256-prod-github-runner-207 kernel: [30016.618160] RIP: 0033:0x7faa5d0edaff Aug 22 13:44:02 juju-e4d256-prod-github-runner-207 kernel: [30016.618821] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 13:44:02 juju-e4d256-prod-github-runner-207 kernel: [30016.620800] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 13:44:02 juju-e4d256-prod-github-runner-207 kernel: [30016.621707] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 13:44:02 juju-e4d256-prod-github-runner-207 kernel: [30016.622606] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 13:44:02 juju-e4d256-prod-github-runner-207 kernel: [30016.623493] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 13:44:02 juju-e4d256-prod-github-runner-207 kernel: [30016.624379] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 13:44:02 juju-e4d256-prod-github-runner-207 kernel: [30016.625277] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 13:44:02 juju-e4d256-prod-github-runner-207 kernel: [30016.626286] Aug 22 13:44:30 juju-e4d256-prod-github-runner-207 kernel: [30044.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 27873s! [qemu-system-x86:6715] Aug 22 13:44:30 juju-e4d256-prod-github-runner-207 kernel: [30044.543140] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 13:44:30 juju-e4d256-prod-github-runner-207 kernel: [30044.543216] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 13:44:30 juju-e4d256-prod-github-runner-207 kernel: [30044.555426] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 13:44:30 juju-e4d256-prod-github-runner-207 kernel: [30044.556878] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 13:44:30 juju-e4d256-prod-github-runner-207 kernel: [30044.558286] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:44:30 juju-e4d256-prod-github-runner-207 kernel: [30044.559464] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 13:44:30 juju-e4d256-prod-github-runner-207 kernel: [30044.562473] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 13:44:30 juju-e4d256-prod-github-runner-207 kernel: [30044.563671] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 13:44:30 juju-e4d256-prod-github-runner-207 kernel: [30044.565052] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 13:44:30 juju-e4d256-prod-github-runner-207 kernel: [30044.566438] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 13:44:30 juju-e4d256-prod-github-runner-207 kernel: [30044.567793] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 13:44:30 juju-e4d256-prod-github-runner-207 kernel: [30044.569134] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 13:44:30 juju-e4d256-prod-github-runner-207 kernel: [30044.570477] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 13:44:30 juju-e4d256-prod-github-runner-207 kernel: [30044.571889] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 13:44:30 juju-e4d256-prod-github-runner-207 kernel: [30044.573149] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 13:44:30 juju-e4d256-prod-github-runner-207 kernel: [30044.574521] Call Trace: Aug 22 13:44:30 juju-e4d256-prod-github-runner-207 kernel: [30044.575495] Aug 22 13:44:30 juju-e4d256-prod-github-runner-207 kernel: [30044.576428] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:44:30 juju-e4d256-prod-github-runner-207 kernel: [30044.577561] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:44:30 juju-e4d256-prod-github-runner-207 kernel: [30044.578769] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:44:30 juju-e4d256-prod-github-runner-207 kernel: [30044.579954] ? show_regs.part.0+0x23/0x29 Aug 22 13:44:30 juju-e4d256-prod-github-runner-207 kernel: [30044.581033] ? show_regs.cold+0x8/0xd Aug 22 13:44:30 juju-e4d256-prod-github-runner-207 kernel: [30044.582117] ? watchdog_timer_fn+0x1be/0x220 Aug 22 13:44:30 juju-e4d256-prod-github-runner-207 kernel: [30044.583231] ? lockup_detector_update_enable+0x60/0x60 Aug 22 13:44:30 juju-e4d256-prod-github-runner-207 kernel: [30044.584453] ? __hrtimer_run_queues+0x107/0x230 Aug 22 13:44:30 juju-e4d256-prod-github-runner-207 kernel: [30044.585580] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 13:44:30 juju-e4d256-prod-github-runner-207 kernel: [30044.586725] ? hrtimer_interrupt+0x101/0x220 Aug 22 13:44:30 juju-e4d256-prod-github-runner-207 kernel: [30044.587847] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 13:44:30 juju-e4d256-prod-github-runner-207 kernel: [30044.589062] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 13:44:30 juju-e4d256-prod-github-runner-207 kernel: [30044.590242] Aug 22 13:44:30 juju-e4d256-prod-github-runner-207 kernel: [30044.591148] Aug 22 13:44:30 juju-e4d256-prod-github-runner-207 kernel: [30044.592040] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 13:44:30 juju-e4d256-prod-github-runner-207 kernel: [30044.593189] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:44:30 juju-e4d256-prod-github-runner-207 kernel: [30044.594367] ? _raw_spin_lock+0x22/0x30 Aug 22 13:44:30 juju-e4d256-prod-github-runner-207 kernel: [30044.595415] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:44:30 juju-e4d256-prod-github-runner-207 kernel: [30044.596529] direct_page_fault+0x206/0x310 [kvm] Aug 22 13:44:30 juju-e4d256-prod-github-runner-207 kernel: [30044.597653] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 13:44:30 juju-e4d256-prod-github-runner-207 kernel: [30044.598776] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 13:44:30 juju-e4d256-prod-github-runner-207 kernel: [30044.599872] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 13:44:30 juju-e4d256-prod-github-runner-207 kernel: [30044.600938] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 13:44:30 juju-e4d256-prod-github-runner-207 kernel: [30044.602008] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 13:44:30 juju-e4d256-prod-github-runner-207 kernel: [30044.603097] handle_exit+0x98/0x230 [kvm_amd] Aug 22 13:44:30 juju-e4d256-prod-github-runner-207 kernel: [30044.604076] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 13:44:30 juju-e4d256-prod-github-runner-207 kernel: [30044.605077] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 13:44:30 juju-e4d256-prod-github-runner-207 kernel: [30044.606112] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 13:44:30 juju-e4d256-prod-github-runner-207 kernel: [30044.607125] vcpu_run+0x62/0x2c0 [kvm] Aug 22 13:44:30 juju-e4d256-prod-github-runner-207 kernel: [30044.608009] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 13:44:30 juju-e4d256-prod-github-runner-207 kernel: [30044.608907] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 13:44:30 juju-e4d256-prod-github-runner-207 kernel: [30044.609859] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 13:44:30 juju-e4d256-prod-github-runner-207 kernel: [30044.610755] ? __seccomp_filter+0x4a/0x4a0 Aug 22 13:44:30 juju-e4d256-prod-github-runner-207 kernel: [30044.611584] ? __fget_files+0x86/0xc0 Aug 22 13:44:30 juju-e4d256-prod-github-runner-207 kernel: [30044.612361] __x64_sys_ioctl+0x95/0xd0 Aug 22 13:44:30 juju-e4d256-prod-github-runner-207 kernel: [30044.613133] do_syscall_64+0x5c/0xc0 Aug 22 13:44:30 juju-e4d256-prod-github-runner-207 kernel: [30044.613892] ? do_futex+0x162/0x1f0 Aug 22 13:44:30 juju-e4d256-prod-github-runner-207 kernel: [30044.614619] ? __x64_sys_futex+0x78/0x1e0 Aug 22 13:44:30 juju-e4d256-prod-github-runner-207 kernel: [30044.615371] ? __secure_computing+0xa9/0x120 Aug 22 13:44:30 juju-e4d256-prod-github-runner-207 kernel: [30044.616149] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 13:44:30 juju-e4d256-prod-github-runner-207 kernel: [30044.617012] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:44:30 juju-e4d256-prod-github-runner-207 kernel: [30044.617942] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:44:30 juju-e4d256-prod-github-runner-207 kernel: [30044.618759] ? do_syscall_64+0x69/0xc0 Aug 22 13:44:30 juju-e4d256-prod-github-runner-207 kernel: [30044.619654] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:44:30 juju-e4d256-prod-github-runner-207 kernel: [30044.620450] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:44:30 juju-e4d256-prod-github-runner-207 kernel: [30044.621252] ? do_syscall_64+0x69/0xc0 Aug 22 13:44:30 juju-e4d256-prod-github-runner-207 kernel: [30044.621975] ? do_syscall_64+0x69/0xc0 Aug 22 13:44:30 juju-e4d256-prod-github-runner-207 kernel: [30044.622674] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 13:44:30 juju-e4d256-prod-github-runner-207 kernel: [30044.623477] RIP: 0033:0x7faa5d0edaff Aug 22 13:44:30 juju-e4d256-prod-github-runner-207 kernel: [30044.624199] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 13:44:30 juju-e4d256-prod-github-runner-207 kernel: [30044.626539] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 13:44:30 juju-e4d256-prod-github-runner-207 kernel: [30044.627593] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 13:44:30 juju-e4d256-prod-github-runner-207 kernel: [30044.628624] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 13:44:30 juju-e4d256-prod-github-runner-207 kernel: [30044.629558] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 13:44:30 juju-e4d256-prod-github-runner-207 kernel: [30044.630601] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 13:44:30 juju-e4d256-prod-github-runner-207 kernel: [30044.631632] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 13:44:30 juju-e4d256-prod-github-runner-207 kernel: [30044.632690] Aug 22 13:44:45 juju-e4d256-prod-github-runner-207 kernel: [30059.192706] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 13:44:45 juju-e4d256-prod-github-runner-207 kernel: [30059.193849] rcu: 1-....: (7462122 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=3606090 Aug 22 13:44:45 juju-e4d256-prod-github-runner-207 kernel: [30059.195184] (t=7485498 jiffies g=23269 q=33440) Aug 22 13:44:45 juju-e4d256-prod-github-runner-207 kernel: [30059.196077] NMI backtrace for cpu 1 Aug 22 13:44:45 juju-e4d256-prod-github-runner-207 kernel: [30059.196858] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 13:44:45 juju-e4d256-prod-github-runner-207 kernel: [30059.198154] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 13:44:45 juju-e4d256-prod-github-runner-207 kernel: [30059.199402] Call Trace: Aug 22 13:44:45 juju-e4d256-prod-github-runner-207 kernel: [30059.200155] Aug 22 13:44:45 juju-e4d256-prod-github-runner-207 kernel: [30059.200844] show_stack+0x52/0x5c Aug 22 13:44:45 juju-e4d256-prod-github-runner-207 kernel: [30059.201636] dump_stack_lvl+0x4a/0x63 Aug 22 13:44:45 juju-e4d256-prod-github-runner-207 kernel: [30059.202469] dump_stack+0x10/0x16 Aug 22 13:44:45 juju-e4d256-prod-github-runner-207 kernel: [30059.203262] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 13:44:45 juju-e4d256-prod-github-runner-207 kernel: [30059.204127] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 13:44:45 juju-e4d256-prod-github-runner-207 kernel: [30059.204995] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 13:44:45 juju-e4d256-prod-github-runner-207 kernel: [30059.205934] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 13:44:45 juju-e4d256-prod-github-runner-207 kernel: [30059.206943] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 13:44:45 juju-e4d256-prod-github-runner-207 kernel: [30059.207911] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 13:44:45 juju-e4d256-prod-github-runner-207 kernel: [30059.208715] print_cpu_stall.cold+0x2f/0xe2 Aug 22 13:44:45 juju-e4d256-prod-github-runner-207 kernel: [30059.209494] ? timekeeping_update+0xf7/0x150 Aug 22 13:44:45 juju-e4d256-prod-github-runner-207 kernel: [30059.210280] check_cpu_stall+0x109/0x270 Aug 22 13:44:45 juju-e4d256-prod-github-runner-207 kernel: [30059.211052] rcu_sched_clock_irq+0x9a/0x250 Aug 22 13:44:45 juju-e4d256-prod-github-runner-207 kernel: [30059.211821] update_process_times+0x94/0xd0 Aug 22 13:44:45 juju-e4d256-prod-github-runner-207 kernel: [30059.212637] tick_sched_handle+0x29/0x70 Aug 22 13:44:45 juju-e4d256-prod-github-runner-207 kernel: [30059.213386] tick_sched_timer+0x8c/0xc0 Aug 22 13:44:45 juju-e4d256-prod-github-runner-207 kernel: [30059.214139] ? tick_nohz_handler+0xb0/0xb0 Aug 22 13:44:45 juju-e4d256-prod-github-runner-207 kernel: [30059.214908] __hrtimer_run_queues+0x107/0x230 Aug 22 13:44:45 juju-e4d256-prod-github-runner-207 kernel: [30059.215684] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 13:44:45 juju-e4d256-prod-github-runner-207 kernel: [30059.216464] hrtimer_interrupt+0x101/0x220 Aug 22 13:44:45 juju-e4d256-prod-github-runner-207 kernel: [30059.217237] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 13:44:45 juju-e4d256-prod-github-runner-207 kernel: [30059.218059] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 13:44:45 juju-e4d256-prod-github-runner-207 kernel: [30059.218878] Aug 22 13:44:45 juju-e4d256-prod-github-runner-207 kernel: [30059.219544] Aug 22 13:44:45 juju-e4d256-prod-github-runner-207 kernel: [30059.220196] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 13:44:45 juju-e4d256-prod-github-runner-207 kernel: [30059.221025] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:44:45 juju-e4d256-prod-github-runner-207 kernel: [30059.221919] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 13:44:45 juju-e4d256-prod-github-runner-207 kernel: [30059.224333] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 13:44:45 juju-e4d256-prod-github-runner-207 kernel: [30059.225215] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 13:44:45 juju-e4d256-prod-github-runner-207 kernel: [30059.226320] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 13:44:45 juju-e4d256-prod-github-runner-207 kernel: [30059.227567] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 13:44:45 juju-e4d256-prod-github-runner-207 kernel: [30059.228816] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 13:44:45 juju-e4d256-prod-github-runner-207 kernel: [30059.230206] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 13:44:45 juju-e4d256-prod-github-runner-207 kernel: [30059.231569] ? _raw_spin_lock+0x22/0x30 Aug 22 13:44:45 juju-e4d256-prod-github-runner-207 kernel: [30059.232616] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:44:45 juju-e4d256-prod-github-runner-207 kernel: [30059.233743] direct_page_fault+0x206/0x310 [kvm] Aug 22 13:44:45 juju-e4d256-prod-github-runner-207 kernel: [30059.234869] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 13:44:45 juju-e4d256-prod-github-runner-207 kernel: [30059.235972] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 13:44:45 juju-e4d256-prod-github-runner-207 kernel: [30059.237080] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 13:44:45 juju-e4d256-prod-github-runner-207 kernel: [30059.238196] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 13:44:45 juju-e4d256-prod-github-runner-207 kernel: [30059.239292] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 13:44:45 juju-e4d256-prod-github-runner-207 kernel: [30059.240407] handle_exit+0x98/0x230 [kvm_amd] Aug 22 13:44:45 juju-e4d256-prod-github-runner-207 kernel: [30059.241547] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 13:44:45 juju-e4d256-prod-github-runner-207 kernel: [30059.242715] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 13:44:45 juju-e4d256-prod-github-runner-207 kernel: [30059.243768] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 13:44:45 juju-e4d256-prod-github-runner-207 kernel: [30059.244775] vcpu_run+0x62/0x2c0 [kvm] Aug 22 13:44:45 juju-e4d256-prod-github-runner-207 kernel: [30059.245764] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 13:44:45 juju-e4d256-prod-github-runner-207 kernel: [30059.246718] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 13:44:45 juju-e4d256-prod-github-runner-207 kernel: [30059.247798] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 13:44:45 juju-e4d256-prod-github-runner-207 kernel: [30059.248584] ? __seccomp_filter+0x4a/0x4a0 Aug 22 13:44:45 juju-e4d256-prod-github-runner-207 kernel: [30059.249311] ? __fget_files+0x86/0xc0 Aug 22 13:44:45 juju-e4d256-prod-github-runner-207 kernel: [30059.250086] __x64_sys_ioctl+0x95/0xd0 Aug 22 13:44:45 juju-e4d256-prod-github-runner-207 kernel: [30059.250828] do_syscall_64+0x5c/0xc0 Aug 22 13:44:45 juju-e4d256-prod-github-runner-207 kernel: [30059.251543] ? do_futex+0x162/0x1f0 Aug 22 13:44:45 juju-e4d256-prod-github-runner-207 kernel: [30059.252220] ? __x64_sys_futex+0x78/0x1e0 Aug 22 13:44:45 juju-e4d256-prod-github-runner-207 kernel: [30059.252939] ? __secure_computing+0xa9/0x120 Aug 22 13:44:45 juju-e4d256-prod-github-runner-207 kernel: [30059.253667] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 13:44:45 juju-e4d256-prod-github-runner-207 kernel: [30059.254476] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:44:45 juju-e4d256-prod-github-runner-207 kernel: [30059.255243] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:44:45 juju-e4d256-prod-github-runner-207 kernel: [30059.256003] ? do_syscall_64+0x69/0xc0 Aug 22 13:44:45 juju-e4d256-prod-github-runner-207 kernel: [30059.256698] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:44:45 juju-e4d256-prod-github-runner-207 kernel: [30059.257475] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:44:45 juju-e4d256-prod-github-runner-207 kernel: [30059.258253] ? do_syscall_64+0x69/0xc0 Aug 22 13:44:45 juju-e4d256-prod-github-runner-207 kernel: [30059.258962] ? do_syscall_64+0x69/0xc0 Aug 22 13:44:45 juju-e4d256-prod-github-runner-207 kernel: [30059.259654] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 13:44:45 juju-e4d256-prod-github-runner-207 kernel: [30059.260461] RIP: 0033:0x7faa5d0edaff Aug 22 13:44:45 juju-e4d256-prod-github-runner-207 kernel: [30059.261157] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 13:44:45 juju-e4d256-prod-github-runner-207 kernel: [30059.263291] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 13:44:45 juju-e4d256-prod-github-runner-207 kernel: [30059.264257] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 13:44:45 juju-e4d256-prod-github-runner-207 kernel: [30059.265212] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 13:44:45 juju-e4d256-prod-github-runner-207 kernel: [30059.266211] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 13:44:45 juju-e4d256-prod-github-runner-207 kernel: [30059.267195] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 13:44:45 juju-e4d256-prod-github-runner-207 kernel: [30059.268132] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 13:44:45 juju-e4d256-prod-github-runner-207 kernel: [30059.269059] Aug 22 13:45:10 juju-e4d256-prod-github-runner-207 kernel: [30084.541980] watchdog: BUG: soft lockup - CPU#1 stuck for 27910s! [qemu-system-x86:6715] Aug 22 13:45:10 juju-e4d256-prod-github-runner-207 kernel: [30084.543221] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 13:45:10 juju-e4d256-prod-github-runner-207 kernel: [30084.543306] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 13:45:10 juju-e4d256-prod-github-runner-207 kernel: [30084.555859] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 13:45:10 juju-e4d256-prod-github-runner-207 kernel: [30084.557154] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 13:45:10 juju-e4d256-prod-github-runner-207 kernel: [30084.558410] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:45:10 juju-e4d256-prod-github-runner-207 kernel: [30084.559507] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 13:45:10 juju-e4d256-prod-github-runner-207 kernel: [30084.562153] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 13:45:10 juju-e4d256-prod-github-runner-207 kernel: [30084.563219] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 13:45:10 juju-e4d256-prod-github-runner-207 kernel: [30084.564402] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 13:45:10 juju-e4d256-prod-github-runner-207 kernel: [30084.565603] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 13:45:10 juju-e4d256-prod-github-runner-207 kernel: [30084.566804] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 13:45:10 juju-e4d256-prod-github-runner-207 kernel: [30084.567989] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 13:45:10 juju-e4d256-prod-github-runner-207 kernel: [30084.569178] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 13:45:10 juju-e4d256-prod-github-runner-207 kernel: [30084.570460] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 13:45:10 juju-e4d256-prod-github-runner-207 kernel: [30084.571607] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 13:45:10 juju-e4d256-prod-github-runner-207 kernel: [30084.572841] Call Trace: Aug 22 13:45:10 juju-e4d256-prod-github-runner-207 kernel: [30084.573877] Aug 22 13:45:10 juju-e4d256-prod-github-runner-207 kernel: [30084.574839] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:45:10 juju-e4d256-prod-github-runner-207 kernel: [30084.575932] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:45:10 juju-e4d256-prod-github-runner-207 kernel: [30084.576973] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:45:10 juju-e4d256-prod-github-runner-207 kernel: [30084.578092] ? show_regs.part.0+0x23/0x29 Aug 22 13:45:10 juju-e4d256-prod-github-runner-207 kernel: [30084.579115] ? show_regs.cold+0x8/0xd Aug 22 13:45:10 juju-e4d256-prod-github-runner-207 kernel: [30084.580106] ? watchdog_timer_fn+0x1be/0x220 Aug 22 13:45:10 juju-e4d256-prod-github-runner-207 kernel: [30084.581133] ? lockup_detector_update_enable+0x60/0x60 Aug 22 13:45:10 juju-e4d256-prod-github-runner-207 kernel: [30084.582248] ? __hrtimer_run_queues+0x107/0x230 Aug 22 13:45:10 juju-e4d256-prod-github-runner-207 kernel: [30084.583340] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 13:45:10 juju-e4d256-prod-github-runner-207 kernel: [30084.584392] ? hrtimer_interrupt+0x101/0x220 Aug 22 13:45:10 juju-e4d256-prod-github-runner-207 kernel: [30084.585524] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 13:45:10 juju-e4d256-prod-github-runner-207 kernel: [30084.586691] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 13:45:10 juju-e4d256-prod-github-runner-207 kernel: [30084.587785] Aug 22 13:45:10 juju-e4d256-prod-github-runner-207 kernel: [30084.588666] Aug 22 13:45:10 juju-e4d256-prod-github-runner-207 kernel: [30084.589541] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 13:45:10 juju-e4d256-prod-github-runner-207 kernel: [30084.590598] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:45:10 juju-e4d256-prod-github-runner-207 kernel: [30084.591700] ? _raw_spin_lock+0x22/0x30 Aug 22 13:45:10 juju-e4d256-prod-github-runner-207 kernel: [30084.592893] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:45:10 juju-e4d256-prod-github-runner-207 kernel: [30084.593953] direct_page_fault+0x206/0x310 [kvm] Aug 22 13:45:10 juju-e4d256-prod-github-runner-207 kernel: [30084.595015] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 13:45:10 juju-e4d256-prod-github-runner-207 kernel: [30084.596053] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 13:45:10 juju-e4d256-prod-github-runner-207 kernel: [30084.597103] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 13:45:10 juju-e4d256-prod-github-runner-207 kernel: [30084.598129] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 13:45:10 juju-e4d256-prod-github-runner-207 kernel: [30084.599112] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 13:45:10 juju-e4d256-prod-github-runner-207 kernel: [30084.600111] handle_exit+0x98/0x230 [kvm_amd] Aug 22 13:45:10 juju-e4d256-prod-github-runner-207 kernel: [30084.601019] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 13:45:10 juju-e4d256-prod-github-runner-207 kernel: [30084.602035] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 13:45:10 juju-e4d256-prod-github-runner-207 kernel: [30084.602983] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 13:45:10 juju-e4d256-prod-github-runner-207 kernel: [30084.603905] vcpu_run+0x62/0x2c0 [kvm] Aug 22 13:45:10 juju-e4d256-prod-github-runner-207 kernel: [30084.604731] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 13:45:10 juju-e4d256-prod-github-runner-207 kernel: [30084.605645] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 13:45:10 juju-e4d256-prod-github-runner-207 kernel: [30084.606518] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 13:45:10 juju-e4d256-prod-github-runner-207 kernel: [30084.607337] ? __seccomp_filter+0x4a/0x4a0 Aug 22 13:45:10 juju-e4d256-prod-github-runner-207 kernel: [30084.608095] ? __fget_files+0x86/0xc0 Aug 22 13:45:10 juju-e4d256-prod-github-runner-207 kernel: [30084.608816] __x64_sys_ioctl+0x95/0xd0 Aug 22 13:45:10 juju-e4d256-prod-github-runner-207 kernel: [30084.609741] do_syscall_64+0x5c/0xc0 Aug 22 13:45:10 juju-e4d256-prod-github-runner-207 kernel: [30084.610428] ? do_futex+0x162/0x1f0 Aug 22 13:45:10 juju-e4d256-prod-github-runner-207 kernel: [30084.611090] ? __x64_sys_futex+0x78/0x1e0 Aug 22 13:45:10 juju-e4d256-prod-github-runner-207 kernel: [30084.611788] ? __secure_computing+0xa9/0x120 Aug 22 13:45:10 juju-e4d256-prod-github-runner-207 kernel: [30084.612493] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 13:45:10 juju-e4d256-prod-github-runner-207 kernel: [30084.613283] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:45:10 juju-e4d256-prod-github-runner-207 kernel: [30084.614042] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:45:10 juju-e4d256-prod-github-runner-207 kernel: [30084.614776] ? do_syscall_64+0x69/0xc0 Aug 22 13:45:10 juju-e4d256-prod-github-runner-207 kernel: [30084.615432] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:45:10 juju-e4d256-prod-github-runner-207 kernel: [30084.616156] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:45:10 juju-e4d256-prod-github-runner-207 kernel: [30084.616864] ? do_syscall_64+0x69/0xc0 Aug 22 13:45:10 juju-e4d256-prod-github-runner-207 kernel: [30084.617518] ? do_syscall_64+0x69/0xc0 Aug 22 13:45:10 juju-e4d256-prod-github-runner-207 kernel: [30084.618155] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 13:45:10 juju-e4d256-prod-github-runner-207 kernel: [30084.618878] RIP: 0033:0x7faa5d0edaff Aug 22 13:45:10 juju-e4d256-prod-github-runner-207 kernel: [30084.619514] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 13:45:10 juju-e4d256-prod-github-runner-207 kernel: [30084.622044] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 13:45:10 juju-e4d256-prod-github-runner-207 kernel: [30084.622981] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 13:45:10 juju-e4d256-prod-github-runner-207 kernel: [30084.623896] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 13:45:10 juju-e4d256-prod-github-runner-207 kernel: [30084.625063] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 13:45:10 juju-e4d256-prod-github-runner-207 kernel: [30084.625975] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 13:45:10 juju-e4d256-prod-github-runner-207 kernel: [30084.626894] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 13:45:10 juju-e4d256-prod-github-runner-207 kernel: [30084.627808] Aug 22 13:45:38 juju-e4d256-prod-github-runner-207 kernel: [30112.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 27936s! [qemu-system-x86:6715] Aug 22 13:45:38 juju-e4d256-prod-github-runner-207 kernel: [30112.543889] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 13:45:38 juju-e4d256-prod-github-runner-207 kernel: [30112.544173] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 13:45:38 juju-e4d256-prod-github-runner-207 kernel: [30112.556676] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 13:45:38 juju-e4d256-prod-github-runner-207 kernel: [30112.557988] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 13:45:38 juju-e4d256-prod-github-runner-207 kernel: [30112.559240] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:45:38 juju-e4d256-prod-github-runner-207 kernel: [30112.560353] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 13:45:38 juju-e4d256-prod-github-runner-207 kernel: [30112.562996] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 13:45:38 juju-e4d256-prod-github-runner-207 kernel: [30112.564057] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 13:45:38 juju-e4d256-prod-github-runner-207 kernel: [30112.565267] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 13:45:38 juju-e4d256-prod-github-runner-207 kernel: [30112.566454] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 13:45:38 juju-e4d256-prod-github-runner-207 kernel: [30112.567727] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 13:45:38 juju-e4d256-prod-github-runner-207 kernel: [30112.569258] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 13:45:38 juju-e4d256-prod-github-runner-207 kernel: [30112.570664] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 13:45:38 juju-e4d256-prod-github-runner-207 kernel: [30112.572050] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 13:45:38 juju-e4d256-prod-github-runner-207 kernel: [30112.573244] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 13:45:38 juju-e4d256-prod-github-runner-207 kernel: [30112.574479] Call Trace: Aug 22 13:45:38 juju-e4d256-prod-github-runner-207 kernel: [30112.575402] Aug 22 13:45:38 juju-e4d256-prod-github-runner-207 kernel: [30112.576528] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:45:38 juju-e4d256-prod-github-runner-207 kernel: [30112.577618] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:45:38 juju-e4d256-prod-github-runner-207 kernel: [30112.578656] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:45:38 juju-e4d256-prod-github-runner-207 kernel: [30112.579771] ? show_regs.part.0+0x23/0x29 Aug 22 13:45:38 juju-e4d256-prod-github-runner-207 kernel: [30112.580783] ? show_regs.cold+0x8/0xd Aug 22 13:45:38 juju-e4d256-prod-github-runner-207 kernel: [30112.581792] ? watchdog_timer_fn+0x1be/0x220 Aug 22 13:45:38 juju-e4d256-prod-github-runner-207 kernel: [30112.582820] ? lockup_detector_update_enable+0x60/0x60 Aug 22 13:45:38 juju-e4d256-prod-github-runner-207 kernel: [30112.583899] ? __hrtimer_run_queues+0x107/0x230 Aug 22 13:45:38 juju-e4d256-prod-github-runner-207 kernel: [30112.584943] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 13:45:38 juju-e4d256-prod-github-runner-207 kernel: [30112.586000] ? hrtimer_interrupt+0x101/0x220 Aug 22 13:45:38 juju-e4d256-prod-github-runner-207 kernel: [30112.587029] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 13:45:38 juju-e4d256-prod-github-runner-207 kernel: [30112.588265] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 13:45:38 juju-e4d256-prod-github-runner-207 kernel: [30112.589436] Aug 22 13:45:38 juju-e4d256-prod-github-runner-207 kernel: [30112.590296] Aug 22 13:45:38 juju-e4d256-prod-github-runner-207 kernel: [30112.591144] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 13:45:38 juju-e4d256-prod-github-runner-207 kernel: [30112.592197] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:45:38 juju-e4d256-prod-github-runner-207 kernel: [30112.593511] ? _raw_spin_lock+0x22/0x30 Aug 22 13:45:38 juju-e4d256-prod-github-runner-207 kernel: [30112.594528] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:45:38 juju-e4d256-prod-github-runner-207 kernel: [30112.595578] direct_page_fault+0x206/0x310 [kvm] Aug 22 13:45:38 juju-e4d256-prod-github-runner-207 kernel: [30112.596828] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 13:45:38 juju-e4d256-prod-github-runner-207 kernel: [30112.597970] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 13:45:38 juju-e4d256-prod-github-runner-207 kernel: [30112.599374] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 13:45:38 juju-e4d256-prod-github-runner-207 kernel: [30112.600407] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 13:45:38 juju-e4d256-prod-github-runner-207 kernel: [30112.601438] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 13:45:38 juju-e4d256-prod-github-runner-207 kernel: [30112.602450] handle_exit+0x98/0x230 [kvm_amd] Aug 22 13:45:38 juju-e4d256-prod-github-runner-207 kernel: [30112.603361] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 13:45:38 juju-e4d256-prod-github-runner-207 kernel: [30112.604291] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 13:45:38 juju-e4d256-prod-github-runner-207 kernel: [30112.605256] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 13:45:38 juju-e4d256-prod-github-runner-207 kernel: [30112.606177] vcpu_run+0x62/0x2c0 [kvm] Aug 22 13:45:38 juju-e4d256-prod-github-runner-207 kernel: [30112.607051] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 13:45:38 juju-e4d256-prod-github-runner-207 kernel: [30112.607890] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 13:45:38 juju-e4d256-prod-github-runner-207 kernel: [30112.608773] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 13:45:38 juju-e4d256-prod-github-runner-207 kernel: [30112.609612] ? __seccomp_filter+0x4a/0x4a0 Aug 22 13:45:38 juju-e4d256-prod-github-runner-207 kernel: [30112.610375] ? __fget_files+0x86/0xc0 Aug 22 13:45:38 juju-e4d256-prod-github-runner-207 kernel: [30112.611094] __x64_sys_ioctl+0x95/0xd0 Aug 22 13:45:38 juju-e4d256-prod-github-runner-207 kernel: [30112.611801] do_syscall_64+0x5c/0xc0 Aug 22 13:45:38 juju-e4d256-prod-github-runner-207 kernel: [30112.612479] ? do_futex+0x162/0x1f0 Aug 22 13:45:38 juju-e4d256-prod-github-runner-207 kernel: [30112.613156] ? __x64_sys_futex+0x78/0x1e0 Aug 22 13:45:38 juju-e4d256-prod-github-runner-207 kernel: [30112.613844] ? __secure_computing+0xa9/0x120 Aug 22 13:45:38 juju-e4d256-prod-github-runner-207 kernel: [30112.614549] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 13:45:38 juju-e4d256-prod-github-runner-207 kernel: [30112.615332] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:45:38 juju-e4d256-prod-github-runner-207 kernel: [30112.616071] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:45:38 juju-e4d256-prod-github-runner-207 kernel: [30112.616811] ? do_syscall_64+0x69/0xc0 Aug 22 13:45:38 juju-e4d256-prod-github-runner-207 kernel: [30112.617487] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:45:38 juju-e4d256-prod-github-runner-207 kernel: [30112.618213] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:45:38 juju-e4d256-prod-github-runner-207 kernel: [30112.618933] ? do_syscall_64+0x69/0xc0 Aug 22 13:45:38 juju-e4d256-prod-github-runner-207 kernel: [30112.619573] ? do_syscall_64+0x69/0xc0 Aug 22 13:45:38 juju-e4d256-prod-github-runner-207 kernel: [30112.620246] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 13:45:38 juju-e4d256-prod-github-runner-207 kernel: [30112.620973] RIP: 0033:0x7faa5d0edaff Aug 22 13:45:38 juju-e4d256-prod-github-runner-207 kernel: [30112.621654] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 13:45:38 juju-e4d256-prod-github-runner-207 kernel: [30112.623708] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 13:45:38 juju-e4d256-prod-github-runner-207 kernel: [30112.624657] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 13:45:38 juju-e4d256-prod-github-runner-207 kernel: [30112.625588] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 13:45:38 juju-e4d256-prod-github-runner-207 kernel: [30112.626614] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 13:45:38 juju-e4d256-prod-github-runner-207 kernel: [30112.627597] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 13:45:38 juju-e4d256-prod-github-runner-207 kernel: [30112.628520] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 13:45:38 juju-e4d256-prod-github-runner-207 kernel: [30112.629598] Aug 22 13:46:06 juju-e4d256-prod-github-runner-207 kernel: [30140.541976] watchdog: BUG: soft lockup - CPU#1 stuck for 27962s! [qemu-system-x86:6715] Aug 22 13:46:06 juju-e4d256-prod-github-runner-207 kernel: [30140.543090] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 13:46:06 juju-e4d256-prod-github-runner-207 kernel: [30140.543163] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 13:46:06 juju-e4d256-prod-github-runner-207 kernel: [30140.555320] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 13:46:06 juju-e4d256-prod-github-runner-207 kernel: [30140.556581] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 13:46:06 juju-e4d256-prod-github-runner-207 kernel: [30140.557820] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:46:06 juju-e4d256-prod-github-runner-207 kernel: [30140.558877] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 13:46:06 juju-e4d256-prod-github-runner-207 kernel: [30140.561429] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 13:46:06 juju-e4d256-prod-github-runner-207 kernel: [30140.562481] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 13:46:06 juju-e4d256-prod-github-runner-207 kernel: [30140.563654] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 13:46:06 juju-e4d256-prod-github-runner-207 kernel: [30140.564853] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 13:46:06 juju-e4d256-prod-github-runner-207 kernel: [30140.566027] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 13:46:06 juju-e4d256-prod-github-runner-207 kernel: [30140.567197] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 13:46:06 juju-e4d256-prod-github-runner-207 kernel: [30140.568432] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 13:46:06 juju-e4d256-prod-github-runner-207 kernel: [30140.569726] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 13:46:06 juju-e4d256-prod-github-runner-207 kernel: [30140.570845] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 13:46:06 juju-e4d256-prod-github-runner-207 kernel: [30140.572043] Call Trace: Aug 22 13:46:06 juju-e4d256-prod-github-runner-207 kernel: [30140.573007] Aug 22 13:46:06 juju-e4d256-prod-github-runner-207 kernel: [30140.573910] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:46:06 juju-e4d256-prod-github-runner-207 kernel: [30140.574955] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:46:06 juju-e4d256-prod-github-runner-207 kernel: [30140.576039] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:46:06 juju-e4d256-prod-github-runner-207 kernel: [30140.577153] ? show_regs.part.0+0x23/0x29 Aug 22 13:46:06 juju-e4d256-prod-github-runner-207 kernel: [30140.578295] ? show_regs.cold+0x8/0xd Aug 22 13:46:06 juju-e4d256-prod-github-runner-207 kernel: [30140.579288] ? watchdog_timer_fn+0x1be/0x220 Aug 22 13:46:06 juju-e4d256-prod-github-runner-207 kernel: [30140.580314] ? lockup_detector_update_enable+0x60/0x60 Aug 22 13:46:06 juju-e4d256-prod-github-runner-207 kernel: [30140.581401] ? __hrtimer_run_queues+0x107/0x230 Aug 22 13:46:06 juju-e4d256-prod-github-runner-207 kernel: [30140.582587] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 13:46:06 juju-e4d256-prod-github-runner-207 kernel: [30140.583620] ? hrtimer_interrupt+0x101/0x220 Aug 22 13:46:06 juju-e4d256-prod-github-runner-207 kernel: [30140.584652] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 13:46:06 juju-e4d256-prod-github-runner-207 kernel: [30140.585797] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 13:46:06 juju-e4d256-prod-github-runner-207 kernel: [30140.586843] Aug 22 13:46:06 juju-e4d256-prod-github-runner-207 kernel: [30140.587695] Aug 22 13:46:06 juju-e4d256-prod-github-runner-207 kernel: [30140.588552] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 13:46:06 juju-e4d256-prod-github-runner-207 kernel: [30140.589633] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:46:06 juju-e4d256-prod-github-runner-207 kernel: [30140.590861] ? _raw_spin_lock+0x22/0x30 Aug 22 13:46:06 juju-e4d256-prod-github-runner-207 kernel: [30140.591994] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:46:06 juju-e4d256-prod-github-runner-207 kernel: [30140.593038] direct_page_fault+0x206/0x310 [kvm] Aug 22 13:46:06 juju-e4d256-prod-github-runner-207 kernel: [30140.594074] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 13:46:06 juju-e4d256-prod-github-runner-207 kernel: [30140.595090] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 13:46:06 juju-e4d256-prod-github-runner-207 kernel: [30140.596091] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 13:46:06 juju-e4d256-prod-github-runner-207 kernel: [30140.597079] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 13:46:06 juju-e4d256-prod-github-runner-207 kernel: [30140.598027] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 13:46:06 juju-e4d256-prod-github-runner-207 kernel: [30140.599035] handle_exit+0x98/0x230 [kvm_amd] Aug 22 13:46:06 juju-e4d256-prod-github-runner-207 kernel: [30140.599928] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 13:46:06 juju-e4d256-prod-github-runner-207 kernel: [30140.600895] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 13:46:06 juju-e4d256-prod-github-runner-207 kernel: [30140.601847] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 13:46:06 juju-e4d256-prod-github-runner-207 kernel: [30140.603017] vcpu_run+0x62/0x2c0 [kvm] Aug 22 13:46:06 juju-e4d256-prod-github-runner-207 kernel: [30140.604127] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 13:46:06 juju-e4d256-prod-github-runner-207 kernel: [30140.605242] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 13:46:06 juju-e4d256-prod-github-runner-207 kernel: [30140.606409] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 13:46:06 juju-e4d256-prod-github-runner-207 kernel: [30140.607533] ? __seccomp_filter+0x4a/0x4a0 Aug 22 13:46:06 juju-e4d256-prod-github-runner-207 kernel: [30140.608554] ? __fget_files+0x86/0xc0 Aug 22 13:46:06 juju-e4d256-prod-github-runner-207 kernel: [30140.609529] __x64_sys_ioctl+0x95/0xd0 Aug 22 13:46:06 juju-e4d256-prod-github-runner-207 kernel: [30140.610509] do_syscall_64+0x5c/0xc0 Aug 22 13:46:06 juju-e4d256-prod-github-runner-207 kernel: [30140.611421] ? do_futex+0x162/0x1f0 Aug 22 13:46:06 juju-e4d256-prod-github-runner-207 kernel: [30140.612310] ? __x64_sys_futex+0x78/0x1e0 Aug 22 13:46:06 juju-e4d256-prod-github-runner-207 kernel: [30140.613261] ? __secure_computing+0xa9/0x120 Aug 22 13:46:06 juju-e4d256-prod-github-runner-207 kernel: [30140.614198] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 13:46:06 juju-e4d256-prod-github-runner-207 kernel: [30140.615257] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:46:06 juju-e4d256-prod-github-runner-207 kernel: [30140.616261] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:46:06 juju-e4d256-prod-github-runner-207 kernel: [30140.617276] ? do_syscall_64+0x69/0xc0 Aug 22 13:46:06 juju-e4d256-prod-github-runner-207 kernel: [30140.618160] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:46:06 juju-e4d256-prod-github-runner-207 kernel: [30140.619119] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:46:06 juju-e4d256-prod-github-runner-207 kernel: [30140.620064] ? do_syscall_64+0x69/0xc0 Aug 22 13:46:06 juju-e4d256-prod-github-runner-207 kernel: [30140.620928] ? do_syscall_64+0x69/0xc0 Aug 22 13:46:06 juju-e4d256-prod-github-runner-207 kernel: [30140.621784] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 13:46:06 juju-e4d256-prod-github-runner-207 kernel: [30140.622750] RIP: 0033:0x7faa5d0edaff Aug 22 13:46:06 juju-e4d256-prod-github-runner-207 kernel: [30140.623606] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 13:46:06 juju-e4d256-prod-github-runner-207 kernel: [30140.626341] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 13:46:06 juju-e4d256-prod-github-runner-207 kernel: [30140.627573] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 13:46:06 juju-e4d256-prod-github-runner-207 kernel: [30140.628805] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 13:46:06 juju-e4d256-prod-github-runner-207 kernel: [30140.630021] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 13:46:06 juju-e4d256-prod-github-runner-207 kernel: [30140.631233] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 13:46:06 juju-e4d256-prod-github-runner-207 kernel: [30140.632445] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 13:46:06 juju-e4d256-prod-github-runner-207 kernel: [30140.633696] Aug 22 13:46:34 juju-e4d256-prod-github-runner-207 kernel: [30168.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 27988s! [qemu-system-x86:6715] Aug 22 13:46:34 juju-e4d256-prod-github-runner-207 kernel: [30168.543113] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 13:46:34 juju-e4d256-prod-github-runner-207 kernel: [30168.543188] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 13:46:34 juju-e4d256-prod-github-runner-207 kernel: [30168.555601] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 13:46:34 juju-e4d256-prod-github-runner-207 kernel: [30168.556885] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 13:46:34 juju-e4d256-prod-github-runner-207 kernel: [30168.558124] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:46:34 juju-e4d256-prod-github-runner-207 kernel: [30168.559185] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 13:46:34 juju-e4d256-prod-github-runner-207 kernel: [30168.561758] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 13:46:34 juju-e4d256-prod-github-runner-207 kernel: [30168.562815] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 13:46:34 juju-e4d256-prod-github-runner-207 kernel: [30168.563976] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 13:46:34 juju-e4d256-prod-github-runner-207 kernel: [30168.565149] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 13:46:34 juju-e4d256-prod-github-runner-207 kernel: [30168.566310] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 13:46:34 juju-e4d256-prod-github-runner-207 kernel: [30168.567498] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 13:46:34 juju-e4d256-prod-github-runner-207 kernel: [30168.568702] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 13:46:34 juju-e4d256-prod-github-runner-207 kernel: [30168.569947] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 13:46:34 juju-e4d256-prod-github-runner-207 kernel: [30168.571063] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 13:46:34 juju-e4d256-prod-github-runner-207 kernel: [30168.572270] Call Trace: Aug 22 13:46:34 juju-e4d256-prod-github-runner-207 kernel: [30168.573238] Aug 22 13:46:34 juju-e4d256-prod-github-runner-207 kernel: [30168.574142] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:46:34 juju-e4d256-prod-github-runner-207 kernel: [30168.575194] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:46:34 juju-e4d256-prod-github-runner-207 kernel: [30168.576241] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:46:34 juju-e4d256-prod-github-runner-207 kernel: [30168.577328] ? show_regs.part.0+0x23/0x29 Aug 22 13:46:34 juju-e4d256-prod-github-runner-207 kernel: [30168.578333] ? show_regs.cold+0x8/0xd Aug 22 13:46:34 juju-e4d256-prod-github-runner-207 kernel: [30168.579304] ? watchdog_timer_fn+0x1be/0x220 Aug 22 13:46:34 juju-e4d256-prod-github-runner-207 kernel: [30168.580313] ? lockup_detector_update_enable+0x60/0x60 Aug 22 13:46:34 juju-e4d256-prod-github-runner-207 kernel: [30168.581404] ? __hrtimer_run_queues+0x107/0x230 Aug 22 13:46:34 juju-e4d256-prod-github-runner-207 kernel: [30168.582431] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 13:46:34 juju-e4d256-prod-github-runner-207 kernel: [30168.583462] ? hrtimer_interrupt+0x101/0x220 Aug 22 13:46:34 juju-e4d256-prod-github-runner-207 kernel: [30168.584541] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 13:46:34 juju-e4d256-prod-github-runner-207 kernel: [30168.585617] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 13:46:34 juju-e4d256-prod-github-runner-207 kernel: [30168.586787] Aug 22 13:46:34 juju-e4d256-prod-github-runner-207 kernel: [30168.587645] Aug 22 13:46:34 juju-e4d256-prod-github-runner-207 kernel: [30168.588498] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 13:46:34 juju-e4d256-prod-github-runner-207 kernel: [30168.589590] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:46:34 juju-e4d256-prod-github-runner-207 kernel: [30168.590661] ? _raw_spin_lock+0x22/0x30 Aug 22 13:46:34 juju-e4d256-prod-github-runner-207 kernel: [30168.591610] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:46:34 juju-e4d256-prod-github-runner-207 kernel: [30168.592660] direct_page_fault+0x206/0x310 [kvm] Aug 22 13:46:34 juju-e4d256-prod-github-runner-207 kernel: [30168.593688] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 13:46:34 juju-e4d256-prod-github-runner-207 kernel: [30168.594701] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 13:46:34 juju-e4d256-prod-github-runner-207 kernel: [30168.595699] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 13:46:34 juju-e4d256-prod-github-runner-207 kernel: [30168.596707] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 13:46:34 juju-e4d256-prod-github-runner-207 kernel: [30168.597658] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 13:46:34 juju-e4d256-prod-github-runner-207 kernel: [30168.598647] handle_exit+0x98/0x230 [kvm_amd] Aug 22 13:46:34 juju-e4d256-prod-github-runner-207 kernel: [30168.599583] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 13:46:34 juju-e4d256-prod-github-runner-207 kernel: [30168.600539] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 13:46:34 juju-e4d256-prod-github-runner-207 kernel: [30168.601478] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 13:46:34 juju-e4d256-prod-github-runner-207 kernel: [30168.602386] vcpu_run+0x62/0x2c0 [kvm] Aug 22 13:46:34 juju-e4d256-prod-github-runner-207 kernel: [30168.603207] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 13:46:34 juju-e4d256-prod-github-runner-207 kernel: [30168.604039] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 13:46:34 juju-e4d256-prod-github-runner-207 kernel: [30168.604989] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 13:46:34 juju-e4d256-prod-github-runner-207 kernel: [30168.605794] ? __seccomp_filter+0x4a/0x4a0 Aug 22 13:46:34 juju-e4d256-prod-github-runner-207 kernel: [30168.606566] ? __fget_files+0x86/0xc0 Aug 22 13:46:34 juju-e4d256-prod-github-runner-207 kernel: [30168.607408] __x64_sys_ioctl+0x95/0xd0 Aug 22 13:46:34 juju-e4d256-prod-github-runner-207 kernel: [30168.608109] do_syscall_64+0x5c/0xc0 Aug 22 13:46:34 juju-e4d256-prod-github-runner-207 kernel: [30168.608800] ? do_futex+0x162/0x1f0 Aug 22 13:46:34 juju-e4d256-prod-github-runner-207 kernel: [30168.609602] ? __x64_sys_futex+0x78/0x1e0 Aug 22 13:46:34 juju-e4d256-prod-github-runner-207 kernel: [30168.610347] ? __secure_computing+0xa9/0x120 Aug 22 13:46:34 juju-e4d256-prod-github-runner-207 kernel: [30168.611157] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 13:46:34 juju-e4d256-prod-github-runner-207 kernel: [30168.611989] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:46:34 juju-e4d256-prod-github-runner-207 kernel: [30168.612832] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:46:34 juju-e4d256-prod-github-runner-207 kernel: [30168.613649] ? do_syscall_64+0x69/0xc0 Aug 22 13:46:34 juju-e4d256-prod-github-runner-207 kernel: [30168.614301] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:46:34 juju-e4d256-prod-github-runner-207 kernel: [30168.615005] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:46:34 juju-e4d256-prod-github-runner-207 kernel: [30168.615714] ? do_syscall_64+0x69/0xc0 Aug 22 13:46:34 juju-e4d256-prod-github-runner-207 kernel: [30168.616350] ? do_syscall_64+0x69/0xc0 Aug 22 13:46:34 juju-e4d256-prod-github-runner-207 kernel: [30168.616996] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 13:46:34 juju-e4d256-prod-github-runner-207 kernel: [30168.617705] RIP: 0033:0x7faa5d0edaff Aug 22 13:46:34 juju-e4d256-prod-github-runner-207 kernel: [30168.618330] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 13:46:34 juju-e4d256-prod-github-runner-207 kernel: [30168.620428] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 13:46:34 juju-e4d256-prod-github-runner-207 kernel: [30168.621404] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 13:46:34 juju-e4d256-prod-github-runner-207 kernel: [30168.622425] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 13:46:34 juju-e4d256-prod-github-runner-207 kernel: [30168.623356] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 13:46:34 juju-e4d256-prod-github-runner-207 kernel: [30168.624246] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 13:46:34 juju-e4d256-prod-github-runner-207 kernel: [30168.625203] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 13:46:34 juju-e4d256-prod-github-runner-207 kernel: [30168.626188] Aug 22 13:47:02 juju-e4d256-prod-github-runner-207 kernel: [30196.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 28014s! [qemu-system-x86:6715] Aug 22 13:47:02 juju-e4d256-prod-github-runner-207 kernel: [30196.543862] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 13:47:02 juju-e4d256-prod-github-runner-207 kernel: [30196.544193] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 13:47:02 juju-e4d256-prod-github-runner-207 kernel: [30196.556422] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 13:47:02 juju-e4d256-prod-github-runner-207 kernel: [30196.557688] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 13:47:02 juju-e4d256-prod-github-runner-207 kernel: [30196.558914] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:47:02 juju-e4d256-prod-github-runner-207 kernel: [30196.560006] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 13:47:02 juju-e4d256-prod-github-runner-207 kernel: [30196.562728] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 13:47:02 juju-e4d256-prod-github-runner-207 kernel: [30196.563784] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 13:47:02 juju-e4d256-prod-github-runner-207 kernel: [30196.564962] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 13:47:02 juju-e4d256-prod-github-runner-207 kernel: [30196.566121] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 13:47:02 juju-e4d256-prod-github-runner-207 kernel: [30196.567288] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 13:47:02 juju-e4d256-prod-github-runner-207 kernel: [30196.568470] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 13:47:02 juju-e4d256-prod-github-runner-207 kernel: [30196.569648] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 13:47:02 juju-e4d256-prod-github-runner-207 kernel: [30196.570884] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 13:47:02 juju-e4d256-prod-github-runner-207 kernel: [30196.571977] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 13:47:02 juju-e4d256-prod-github-runner-207 kernel: [30196.573178] Call Trace: Aug 22 13:47:02 juju-e4d256-prod-github-runner-207 kernel: [30196.574109] Aug 22 13:47:02 juju-e4d256-prod-github-runner-207 kernel: [30196.575050] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:47:02 juju-e4d256-prod-github-runner-207 kernel: [30196.576105] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:47:02 juju-e4d256-prod-github-runner-207 kernel: [30196.577143] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:47:02 juju-e4d256-prod-github-runner-207 kernel: [30196.578240] ? show_regs.part.0+0x23/0x29 Aug 22 13:47:02 juju-e4d256-prod-github-runner-207 kernel: [30196.579236] ? show_regs.cold+0x8/0xd Aug 22 13:47:02 juju-e4d256-prod-github-runner-207 kernel: [30196.580222] ? watchdog_timer_fn+0x1be/0x220 Aug 22 13:47:02 juju-e4d256-prod-github-runner-207 kernel: [30196.581229] ? lockup_detector_update_enable+0x60/0x60 Aug 22 13:47:02 juju-e4d256-prod-github-runner-207 kernel: [30196.582295] ? __hrtimer_run_queues+0x107/0x230 Aug 22 13:47:02 juju-e4d256-prod-github-runner-207 kernel: [30196.583320] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 13:47:02 juju-e4d256-prod-github-runner-207 kernel: [30196.584354] ? hrtimer_interrupt+0x101/0x220 Aug 22 13:47:02 juju-e4d256-prod-github-runner-207 kernel: [30196.585372] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 13:47:02 juju-e4d256-prod-github-runner-207 kernel: [30196.586488] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 13:47:02 juju-e4d256-prod-github-runner-207 kernel: [30196.587533] Aug 22 13:47:02 juju-e4d256-prod-github-runner-207 kernel: [30196.588408] Aug 22 13:47:02 juju-e4d256-prod-github-runner-207 kernel: [30196.589244] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 13:47:02 juju-e4d256-prod-github-runner-207 kernel: [30196.590277] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:47:02 juju-e4d256-prod-github-runner-207 kernel: [30196.591317] ? _raw_spin_lock+0x22/0x30 Aug 22 13:47:02 juju-e4d256-prod-github-runner-207 kernel: [30196.592291] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:47:02 juju-e4d256-prod-github-runner-207 kernel: [30196.593315] direct_page_fault+0x206/0x310 [kvm] Aug 22 13:47:02 juju-e4d256-prod-github-runner-207 kernel: [30196.594343] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 13:47:02 juju-e4d256-prod-github-runner-207 kernel: [30196.595353] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 13:47:02 juju-e4d256-prod-github-runner-207 kernel: [30196.596386] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 13:47:02 juju-e4d256-prod-github-runner-207 kernel: [30196.597412] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 13:47:02 juju-e4d256-prod-github-runner-207 kernel: [30196.598357] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 13:47:02 juju-e4d256-prod-github-runner-207 kernel: [30196.599365] handle_exit+0x98/0x230 [kvm_amd] Aug 22 13:47:02 juju-e4d256-prod-github-runner-207 kernel: [30196.600280] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 13:47:02 juju-e4d256-prod-github-runner-207 kernel: [30196.601196] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 13:47:02 juju-e4d256-prod-github-runner-207 kernel: [30196.602120] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 13:47:02 juju-e4d256-prod-github-runner-207 kernel: [30196.603038] vcpu_run+0x62/0x2c0 [kvm] Aug 22 13:47:02 juju-e4d256-prod-github-runner-207 kernel: [30196.603854] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 13:47:02 juju-e4d256-prod-github-runner-207 kernel: [30196.604673] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 13:47:02 juju-e4d256-prod-github-runner-207 kernel: [30196.605532] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 13:47:02 juju-e4d256-prod-github-runner-207 kernel: [30196.606384] ? __seccomp_filter+0x4a/0x4a0 Aug 22 13:47:02 juju-e4d256-prod-github-runner-207 kernel: [30196.607158] ? __fget_files+0x86/0xc0 Aug 22 13:47:02 juju-e4d256-prod-github-runner-207 kernel: [30196.607862] __x64_sys_ioctl+0x95/0xd0 Aug 22 13:47:02 juju-e4d256-prod-github-runner-207 kernel: [30196.608571] do_syscall_64+0x5c/0xc0 Aug 22 13:47:02 juju-e4d256-prod-github-runner-207 kernel: [30196.609239] ? do_futex+0x162/0x1f0 Aug 22 13:47:02 juju-e4d256-prod-github-runner-207 kernel: [30196.609890] ? __x64_sys_futex+0x78/0x1e0 Aug 22 13:47:02 juju-e4d256-prod-github-runner-207 kernel: [30196.610574] ? __secure_computing+0xa9/0x120 Aug 22 13:47:02 juju-e4d256-prod-github-runner-207 kernel: [30196.611291] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 13:47:02 juju-e4d256-prod-github-runner-207 kernel: [30196.612061] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:47:02 juju-e4d256-prod-github-runner-207 kernel: [30196.612792] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:47:02 juju-e4d256-prod-github-runner-207 kernel: [30196.613545] ? do_syscall_64+0x69/0xc0 Aug 22 13:47:02 juju-e4d256-prod-github-runner-207 kernel: [30196.614191] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:47:02 juju-e4d256-prod-github-runner-207 kernel: [30196.614893] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:47:02 juju-e4d256-prod-github-runner-207 kernel: [30196.615611] ? do_syscall_64+0x69/0xc0 Aug 22 13:47:02 juju-e4d256-prod-github-runner-207 kernel: [30196.616248] ? do_syscall_64+0x69/0xc0 Aug 22 13:47:02 juju-e4d256-prod-github-runner-207 kernel: [30196.616873] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 13:47:02 juju-e4d256-prod-github-runner-207 kernel: [30196.617728] RIP: 0033:0x7faa5d0edaff Aug 22 13:47:02 juju-e4d256-prod-github-runner-207 kernel: [30196.618383] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 13:47:02 juju-e4d256-prod-github-runner-207 kernel: [30196.620380] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 13:47:02 juju-e4d256-prod-github-runner-207 kernel: [30196.621292] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 13:47:02 juju-e4d256-prod-github-runner-207 kernel: [30196.622271] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 13:47:02 juju-e4d256-prod-github-runner-207 kernel: [30196.623351] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 13:47:02 juju-e4d256-prod-github-runner-207 kernel: [30196.624261] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 13:47:02 juju-e4d256-prod-github-runner-207 kernel: [30196.625191] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 13:47:02 juju-e4d256-prod-github-runner-207 kernel: [30196.626110] Aug 22 13:47:30 juju-e4d256-prod-github-runner-207 kernel: [30224.541976] watchdog: BUG: soft lockup - CPU#1 stuck for 28040s! [qemu-system-x86:6715] Aug 22 13:47:30 juju-e4d256-prod-github-runner-207 kernel: [30224.543103] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 13:47:30 juju-e4d256-prod-github-runner-207 kernel: [30224.543175] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 13:47:30 juju-e4d256-prod-github-runner-207 kernel: [30224.555329] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 13:47:30 juju-e4d256-prod-github-runner-207 kernel: [30224.556623] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 13:47:30 juju-e4d256-prod-github-runner-207 kernel: [30224.557853] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:47:30 juju-e4d256-prod-github-runner-207 kernel: [30224.558925] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 13:47:30 juju-e4d256-prod-github-runner-207 kernel: [30224.561478] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 13:47:30 juju-e4d256-prod-github-runner-207 kernel: [30224.562518] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 13:47:30 juju-e4d256-prod-github-runner-207 kernel: [30224.563682] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 13:47:30 juju-e4d256-prod-github-runner-207 kernel: [30224.564859] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 13:47:30 juju-e4d256-prod-github-runner-207 kernel: [30224.566021] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 13:47:30 juju-e4d256-prod-github-runner-207 kernel: [30224.567178] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 13:47:30 juju-e4d256-prod-github-runner-207 kernel: [30224.568352] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 13:47:30 juju-e4d256-prod-github-runner-207 kernel: [30224.569584] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 13:47:30 juju-e4d256-prod-github-runner-207 kernel: [30224.570679] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 13:47:30 juju-e4d256-prod-github-runner-207 kernel: [30224.571882] Call Trace: Aug 22 13:47:30 juju-e4d256-prod-github-runner-207 kernel: [30224.572796] Aug 22 13:47:30 juju-e4d256-prod-github-runner-207 kernel: [30224.573684] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:47:30 juju-e4d256-prod-github-runner-207 kernel: [30224.574711] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:47:30 juju-e4d256-prod-github-runner-207 kernel: [30224.575730] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:47:30 juju-e4d256-prod-github-runner-207 kernel: [30224.576808] ? show_regs.part.0+0x23/0x29 Aug 22 13:47:30 juju-e4d256-prod-github-runner-207 kernel: [30224.577806] ? show_regs.cold+0x8/0xd Aug 22 13:47:30 juju-e4d256-prod-github-runner-207 kernel: [30224.578787] ? watchdog_timer_fn+0x1be/0x220 Aug 22 13:47:30 juju-e4d256-prod-github-runner-207 kernel: [30224.579800] ? lockup_detector_update_enable+0x60/0x60 Aug 22 13:47:30 juju-e4d256-prod-github-runner-207 kernel: [30224.580897] ? __hrtimer_run_queues+0x107/0x230 Aug 22 13:47:30 juju-e4d256-prod-github-runner-207 kernel: [30224.581924] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 13:47:30 juju-e4d256-prod-github-runner-207 kernel: [30224.582947] ? hrtimer_interrupt+0x101/0x220 Aug 22 13:47:30 juju-e4d256-prod-github-runner-207 kernel: [30224.583984] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 13:47:30 juju-e4d256-prod-github-runner-207 kernel: [30224.585054] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 13:47:30 juju-e4d256-prod-github-runner-207 kernel: [30224.586100] Aug 22 13:47:30 juju-e4d256-prod-github-runner-207 kernel: [30224.586952] Aug 22 13:47:30 juju-e4d256-prod-github-runner-207 kernel: [30224.587788] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 13:47:30 juju-e4d256-prod-github-runner-207 kernel: [30224.588832] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:47:30 juju-e4d256-prod-github-runner-207 kernel: [30224.589871] ? _raw_spin_lock+0x22/0x30 Aug 22 13:47:30 juju-e4d256-prod-github-runner-207 kernel: [30224.590816] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:47:30 juju-e4d256-prod-github-runner-207 kernel: [30224.591834] direct_page_fault+0x206/0x310 [kvm] Aug 22 13:47:30 juju-e4d256-prod-github-runner-207 kernel: [30224.592870] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 13:47:30 juju-e4d256-prod-github-runner-207 kernel: [30224.593880] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 13:47:30 juju-e4d256-prod-github-runner-207 kernel: [30224.594879] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 13:47:30 juju-e4d256-prod-github-runner-207 kernel: [30224.595862] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 13:47:30 juju-e4d256-prod-github-runner-207 kernel: [30224.596807] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 13:47:30 juju-e4d256-prod-github-runner-207 kernel: [30224.597804] handle_exit+0x98/0x230 [kvm_amd] Aug 22 13:47:30 juju-e4d256-prod-github-runner-207 kernel: [30224.598781] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 13:47:30 juju-e4d256-prod-github-runner-207 kernel: [30224.599703] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 13:47:30 juju-e4d256-prod-github-runner-207 kernel: [30224.600647] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 13:47:30 juju-e4d256-prod-github-runner-207 kernel: [30224.601550] vcpu_run+0x62/0x2c0 [kvm] Aug 22 13:47:30 juju-e4d256-prod-github-runner-207 kernel: [30224.602360] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 13:47:30 juju-e4d256-prod-github-runner-207 kernel: [30224.603173] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 13:47:30 juju-e4d256-prod-github-runner-207 kernel: [30224.604039] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 13:47:30 juju-e4d256-prod-github-runner-207 kernel: [30224.604841] ? __seccomp_filter+0x4a/0x4a0 Aug 22 13:47:30 juju-e4d256-prod-github-runner-207 kernel: [30224.605589] ? __fget_files+0x86/0xc0 Aug 22 13:47:30 juju-e4d256-prod-github-runner-207 kernel: [30224.606292] __x64_sys_ioctl+0x95/0xd0 Aug 22 13:47:30 juju-e4d256-prod-github-runner-207 kernel: [30224.606983] do_syscall_64+0x5c/0xc0 Aug 22 13:47:30 juju-e4d256-prod-github-runner-207 kernel: [30224.607647] ? do_futex+0x162/0x1f0 Aug 22 13:47:30 juju-e4d256-prod-github-runner-207 kernel: [30224.608321] ? __x64_sys_futex+0x78/0x1e0 Aug 22 13:47:30 juju-e4d256-prod-github-runner-207 kernel: [30224.608995] ? __secure_computing+0xa9/0x120 Aug 22 13:47:30 juju-e4d256-prod-github-runner-207 kernel: [30224.609685] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 13:47:30 juju-e4d256-prod-github-runner-207 kernel: [30224.610445] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:47:30 juju-e4d256-prod-github-runner-207 kernel: [30224.611166] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:47:30 juju-e4d256-prod-github-runner-207 kernel: [30224.611894] ? do_syscall_64+0x69/0xc0 Aug 22 13:47:30 juju-e4d256-prod-github-runner-207 kernel: [30224.612539] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:47:30 juju-e4d256-prod-github-runner-207 kernel: [30224.613242] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:47:30 juju-e4d256-prod-github-runner-207 kernel: [30224.613938] ? do_syscall_64+0x69/0xc0 Aug 22 13:47:30 juju-e4d256-prod-github-runner-207 kernel: [30224.614563] ? do_syscall_64+0x69/0xc0 Aug 22 13:47:30 juju-e4d256-prod-github-runner-207 kernel: [30224.615185] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 13:47:30 juju-e4d256-prod-github-runner-207 kernel: [30224.615915] RIP: 0033:0x7faa5d0edaff Aug 22 13:47:30 juju-e4d256-prod-github-runner-207 kernel: [30224.616558] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 13:47:30 juju-e4d256-prod-github-runner-207 kernel: [30224.618692] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 13:47:30 juju-e4d256-prod-github-runner-207 kernel: [30224.619604] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 13:47:30 juju-e4d256-prod-github-runner-207 kernel: [30224.620507] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 13:47:30 juju-e4d256-prod-github-runner-207 kernel: [30224.621398] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 13:47:30 juju-e4d256-prod-github-runner-207 kernel: [30224.622287] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 13:47:30 juju-e4d256-prod-github-runner-207 kernel: [30224.623174] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 13:47:30 juju-e4d256-prod-github-runner-207 kernel: [30224.624077] Aug 22 13:47:45 juju-e4d256-prod-github-runner-207 kernel: [30239.204709] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 13:47:45 juju-e4d256-prod-github-runner-207 kernel: [30239.205669] rcu: 1-....: (7506985 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=3627794 Aug 22 13:47:45 juju-e4d256-prod-github-runner-207 kernel: [30239.206783] (t=7530501 jiffies g=23269 q=33578) Aug 22 13:47:45 juju-e4d256-prod-github-runner-207 kernel: [30239.207589] NMI backtrace for cpu 1 Aug 22 13:47:45 juju-e4d256-prod-github-runner-207 kernel: [30239.208331] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 13:47:45 juju-e4d256-prod-github-runner-207 kernel: [30239.209452] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 13:47:45 juju-e4d256-prod-github-runner-207 kernel: [30239.210521] Call Trace: Aug 22 13:47:45 juju-e4d256-prod-github-runner-207 kernel: [30239.211197] Aug 22 13:47:45 juju-e4d256-prod-github-runner-207 kernel: [30239.211856] show_stack+0x52/0x5c Aug 22 13:47:45 juju-e4d256-prod-github-runner-207 kernel: [30239.212645] dump_stack_lvl+0x4a/0x63 Aug 22 13:47:45 juju-e4d256-prod-github-runner-207 kernel: [30239.213436] dump_stack+0x10/0x16 Aug 22 13:47:45 juju-e4d256-prod-github-runner-207 kernel: [30239.214170] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 13:47:45 juju-e4d256-prod-github-runner-207 kernel: [30239.215058] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 13:47:45 juju-e4d256-prod-github-runner-207 kernel: [30239.215899] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 13:47:45 juju-e4d256-prod-github-runner-207 kernel: [30239.216724] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 13:47:45 juju-e4d256-prod-github-runner-207 kernel: [30239.217581] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 13:47:45 juju-e4d256-prod-github-runner-207 kernel: [30239.218492] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 13:47:45 juju-e4d256-prod-github-runner-207 kernel: [30239.219288] print_cpu_stall.cold+0x2f/0xe2 Aug 22 13:47:45 juju-e4d256-prod-github-runner-207 kernel: [30239.220081] ? timekeeping_update+0xf7/0x150 Aug 22 13:47:45 juju-e4d256-prod-github-runner-207 kernel: [30239.220859] check_cpu_stall+0x109/0x270 Aug 22 13:47:45 juju-e4d256-prod-github-runner-207 kernel: [30239.221609] rcu_sched_clock_irq+0x9a/0x250 Aug 22 13:47:45 juju-e4d256-prod-github-runner-207 kernel: [30239.222379] update_process_times+0x94/0xd0 Aug 22 13:47:45 juju-e4d256-prod-github-runner-207 kernel: [30239.223157] tick_sched_handle+0x29/0x70 Aug 22 13:47:45 juju-e4d256-prod-github-runner-207 kernel: [30239.223968] tick_sched_timer+0x8c/0xc0 Aug 22 13:47:45 juju-e4d256-prod-github-runner-207 kernel: [30239.224738] ? tick_nohz_handler+0xb0/0xb0 Aug 22 13:47:45 juju-e4d256-prod-github-runner-207 kernel: [30239.225503] __hrtimer_run_queues+0x107/0x230 Aug 22 13:47:45 juju-e4d256-prod-github-runner-207 kernel: [30239.226281] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 13:47:45 juju-e4d256-prod-github-runner-207 kernel: [30239.227057] hrtimer_interrupt+0x101/0x220 Aug 22 13:47:45 juju-e4d256-prod-github-runner-207 kernel: [30239.227854] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 13:47:45 juju-e4d256-prod-github-runner-207 kernel: [30239.228679] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 13:47:45 juju-e4d256-prod-github-runner-207 kernel: [30239.229500] Aug 22 13:47:45 juju-e4d256-prod-github-runner-207 kernel: [30239.230137] Aug 22 13:47:45 juju-e4d256-prod-github-runner-207 kernel: [30239.230798] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 13:47:45 juju-e4d256-prod-github-runner-207 kernel: [30239.231625] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:47:45 juju-e4d256-prod-github-runner-207 kernel: [30239.232555] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 13:47:45 juju-e4d256-prod-github-runner-207 kernel: [30239.234879] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 13:47:45 juju-e4d256-prod-github-runner-207 kernel: [30239.235806] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 13:47:45 juju-e4d256-prod-github-runner-207 kernel: [30239.236815] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 13:47:45 juju-e4d256-prod-github-runner-207 kernel: [30239.237801] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 13:47:45 juju-e4d256-prod-github-runner-207 kernel: [30239.238817] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 13:47:45 juju-e4d256-prod-github-runner-207 kernel: [30239.239846] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 13:47:45 juju-e4d256-prod-github-runner-207 kernel: [30239.240823] ? _raw_spin_lock+0x22/0x30 Aug 22 13:47:45 juju-e4d256-prod-github-runner-207 kernel: [30239.241611] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:47:45 juju-e4d256-prod-github-runner-207 kernel: [30239.242459] direct_page_fault+0x206/0x310 [kvm] Aug 22 13:47:45 juju-e4d256-prod-github-runner-207 kernel: [30239.243303] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 13:47:45 juju-e4d256-prod-github-runner-207 kernel: [30239.244222] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 13:47:45 juju-e4d256-prod-github-runner-207 kernel: [30239.245146] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 13:47:45 juju-e4d256-prod-github-runner-207 kernel: [30239.245980] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 13:47:45 juju-e4d256-prod-github-runner-207 kernel: [30239.246799] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 13:47:45 juju-e4d256-prod-github-runner-207 kernel: [30239.247630] handle_exit+0x98/0x230 [kvm_amd] Aug 22 13:47:45 juju-e4d256-prod-github-runner-207 kernel: [30239.248411] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 13:47:45 juju-e4d256-prod-github-runner-207 kernel: [30239.249225] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 13:47:45 juju-e4d256-prod-github-runner-207 kernel: [30239.250062] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 13:47:45 juju-e4d256-prod-github-runner-207 kernel: [30239.250870] vcpu_run+0x62/0x2c0 [kvm] Aug 22 13:47:45 juju-e4d256-prod-github-runner-207 kernel: [30239.251594] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 13:47:45 juju-e4d256-prod-github-runner-207 kernel: [30239.252356] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 13:47:45 juju-e4d256-prod-github-runner-207 kernel: [30239.253164] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 13:47:45 juju-e4d256-prod-github-runner-207 kernel: [30239.253945] ? __seccomp_filter+0x4a/0x4a0 Aug 22 13:47:45 juju-e4d256-prod-github-runner-207 kernel: [30239.254684] ? __fget_files+0x86/0xc0 Aug 22 13:47:45 juju-e4d256-prod-github-runner-207 kernel: [30239.255395] __x64_sys_ioctl+0x95/0xd0 Aug 22 13:47:45 juju-e4d256-prod-github-runner-207 kernel: [30239.256125] do_syscall_64+0x5c/0xc0 Aug 22 13:47:45 juju-e4d256-prod-github-runner-207 kernel: [30239.256821] ? do_futex+0x162/0x1f0 Aug 22 13:47:45 juju-e4d256-prod-github-runner-207 kernel: [30239.257498] ? __x64_sys_futex+0x78/0x1e0 Aug 22 13:47:45 juju-e4d256-prod-github-runner-207 kernel: [30239.258203] ? __secure_computing+0xa9/0x120 Aug 22 13:47:45 juju-e4d256-prod-github-runner-207 kernel: [30239.258924] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 13:47:45 juju-e4d256-prod-github-runner-207 kernel: [30239.259762] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:47:45 juju-e4d256-prod-github-runner-207 kernel: [30239.260542] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:47:45 juju-e4d256-prod-github-runner-207 kernel: [30239.261314] ? do_syscall_64+0x69/0xc0 Aug 22 13:47:45 juju-e4d256-prod-github-runner-207 kernel: [30239.262011] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:47:45 juju-e4d256-prod-github-runner-207 kernel: [30239.262774] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:47:45 juju-e4d256-prod-github-runner-207 kernel: [30239.263538] ? do_syscall_64+0x69/0xc0 Aug 22 13:47:45 juju-e4d256-prod-github-runner-207 kernel: [30239.264258] ? do_syscall_64+0x69/0xc0 Aug 22 13:47:45 juju-e4d256-prod-github-runner-207 kernel: [30239.264971] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 13:47:45 juju-e4d256-prod-github-runner-207 kernel: [30239.265759] RIP: 0033:0x7faa5d0edaff Aug 22 13:47:45 juju-e4d256-prod-github-runner-207 kernel: [30239.266472] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 13:47:45 juju-e4d256-prod-github-runner-207 kernel: [30239.268739] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 13:47:45 juju-e4d256-prod-github-runner-207 kernel: [30239.269739] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 13:47:45 juju-e4d256-prod-github-runner-207 kernel: [30239.270765] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 13:47:45 juju-e4d256-prod-github-runner-207 kernel: [30239.271759] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 13:47:45 juju-e4d256-prod-github-runner-207 kernel: [30239.272738] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 13:47:45 juju-e4d256-prod-github-runner-207 kernel: [30239.273682] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 13:47:45 juju-e4d256-prod-github-runner-207 kernel: [30239.274627] Aug 22 13:48:10 juju-e4d256-prod-github-runner-207 kernel: [30264.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 28078s! [qemu-system-x86:6715] Aug 22 13:48:10 juju-e4d256-prod-github-runner-207 kernel: [30264.543111] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 13:48:10 juju-e4d256-prod-github-runner-207 kernel: [30264.543204] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 13:48:10 juju-e4d256-prod-github-runner-207 kernel: [30264.555616] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 13:48:10 juju-e4d256-prod-github-runner-207 kernel: [30264.556934] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 13:48:10 juju-e4d256-prod-github-runner-207 kernel: [30264.558204] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:48:10 juju-e4d256-prod-github-runner-207 kernel: [30264.559267] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 13:48:10 juju-e4d256-prod-github-runner-207 kernel: [30264.561829] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 13:48:10 juju-e4d256-prod-github-runner-207 kernel: [30264.562897] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 13:48:10 juju-e4d256-prod-github-runner-207 kernel: [30264.564103] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 13:48:10 juju-e4d256-prod-github-runner-207 kernel: [30264.565269] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 13:48:10 juju-e4d256-prod-github-runner-207 kernel: [30264.566429] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 13:48:10 juju-e4d256-prod-github-runner-207 kernel: [30264.567620] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 13:48:10 juju-e4d256-prod-github-runner-207 kernel: [30264.569013] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 13:48:10 juju-e4d256-prod-github-runner-207 kernel: [30264.570696] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 13:48:10 juju-e4d256-prod-github-runner-207 kernel: [30264.571845] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 13:48:10 juju-e4d256-prod-github-runner-207 kernel: [30264.573061] Call Trace: Aug 22 13:48:10 juju-e4d256-prod-github-runner-207 kernel: [30264.573997] Aug 22 13:48:10 juju-e4d256-prod-github-runner-207 kernel: [30264.574894] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:48:10 juju-e4d256-prod-github-runner-207 kernel: [30264.575950] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:48:10 juju-e4d256-prod-github-runner-207 kernel: [30264.577002] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:48:10 juju-e4d256-prod-github-runner-207 kernel: [30264.578124] ? show_regs.part.0+0x23/0x29 Aug 22 13:48:10 juju-e4d256-prod-github-runner-207 kernel: [30264.579159] ? show_regs.cold+0x8/0xd Aug 22 13:48:10 juju-e4d256-prod-github-runner-207 kernel: [30264.580159] ? watchdog_timer_fn+0x1be/0x220 Aug 22 13:48:10 juju-e4d256-prod-github-runner-207 kernel: [30264.581170] ? lockup_detector_update_enable+0x60/0x60 Aug 22 13:48:10 juju-e4d256-prod-github-runner-207 kernel: [30264.582237] ? __hrtimer_run_queues+0x107/0x230 Aug 22 13:48:10 juju-e4d256-prod-github-runner-207 kernel: [30264.583274] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 13:48:10 juju-e4d256-prod-github-runner-207 kernel: [30264.584357] ? hrtimer_interrupt+0x101/0x220 Aug 22 13:48:10 juju-e4d256-prod-github-runner-207 kernel: [30264.585396] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 13:48:10 juju-e4d256-prod-github-runner-207 kernel: [30264.586466] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 13:48:10 juju-e4d256-prod-github-runner-207 kernel: [30264.587529] Aug 22 13:48:10 juju-e4d256-prod-github-runner-207 kernel: [30264.588397] Aug 22 13:48:10 juju-e4d256-prod-github-runner-207 kernel: [30264.589262] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 13:48:10 juju-e4d256-prod-github-runner-207 kernel: [30264.590300] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:48:10 juju-e4d256-prod-github-runner-207 kernel: [30264.591387] ? _raw_spin_lock+0x22/0x30 Aug 22 13:48:10 juju-e4d256-prod-github-runner-207 kernel: [30264.592364] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:48:10 juju-e4d256-prod-github-runner-207 kernel: [30264.593472] direct_page_fault+0x206/0x310 [kvm] Aug 22 13:48:10 juju-e4d256-prod-github-runner-207 kernel: [30264.594533] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 13:48:10 juju-e4d256-prod-github-runner-207 kernel: [30264.595583] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 13:48:10 juju-e4d256-prod-github-runner-207 kernel: [30264.596588] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 13:48:10 juju-e4d256-prod-github-runner-207 kernel: [30264.597560] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 13:48:10 juju-e4d256-prod-github-runner-207 kernel: [30264.598581] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 13:48:10 juju-e4d256-prod-github-runner-207 kernel: [30264.599605] handle_exit+0x98/0x230 [kvm_amd] Aug 22 13:48:10 juju-e4d256-prod-github-runner-207 kernel: [30264.600749] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 13:48:10 juju-e4d256-prod-github-runner-207 kernel: [30264.601713] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 13:48:10 juju-e4d256-prod-github-runner-207 kernel: [30264.602643] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 13:48:10 juju-e4d256-prod-github-runner-207 kernel: [30264.603587] vcpu_run+0x62/0x2c0 [kvm] Aug 22 13:48:10 juju-e4d256-prod-github-runner-207 kernel: [30264.604406] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 13:48:10 juju-e4d256-prod-github-runner-207 kernel: [30264.605228] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 13:48:10 juju-e4d256-prod-github-runner-207 kernel: [30264.606084] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 13:48:10 juju-e4d256-prod-github-runner-207 kernel: [30264.606884] ? __seccomp_filter+0x4a/0x4a0 Aug 22 13:48:10 juju-e4d256-prod-github-runner-207 kernel: [30264.607646] ? __fget_files+0x86/0xc0 Aug 22 13:48:10 juju-e4d256-prod-github-runner-207 kernel: [30264.608351] __x64_sys_ioctl+0x95/0xd0 Aug 22 13:48:10 juju-e4d256-prod-github-runner-207 kernel: [30264.609057] do_syscall_64+0x5c/0xc0 Aug 22 13:48:10 juju-e4d256-prod-github-runner-207 kernel: [30264.609745] ? do_futex+0x162/0x1f0 Aug 22 13:48:10 juju-e4d256-prod-github-runner-207 kernel: [30264.610400] ? __x64_sys_futex+0x78/0x1e0 Aug 22 13:48:10 juju-e4d256-prod-github-runner-207 kernel: [30264.611075] ? __secure_computing+0xa9/0x120 Aug 22 13:48:10 juju-e4d256-prod-github-runner-207 kernel: [30264.611783] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 13:48:10 juju-e4d256-prod-github-runner-207 kernel: [30264.612547] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:48:10 juju-e4d256-prod-github-runner-207 kernel: [30264.613275] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:48:10 juju-e4d256-prod-github-runner-207 kernel: [30264.614009] ? do_syscall_64+0x69/0xc0 Aug 22 13:48:10 juju-e4d256-prod-github-runner-207 kernel: [30264.614659] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:48:10 juju-e4d256-prod-github-runner-207 kernel: [30264.615385] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:48:10 juju-e4d256-prod-github-runner-207 kernel: [30264.616100] ? do_syscall_64+0x69/0xc0 Aug 22 13:48:10 juju-e4d256-prod-github-runner-207 kernel: [30264.616739] ? do_syscall_64+0x69/0xc0 Aug 22 13:48:10 juju-e4d256-prod-github-runner-207 kernel: [30264.617368] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 13:48:10 juju-e4d256-prod-github-runner-207 kernel: [30264.618700] RIP: 0033:0x7faa5d0edaff Aug 22 13:48:10 juju-e4d256-prod-github-runner-207 kernel: [30264.619372] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 13:48:10 juju-e4d256-prod-github-runner-207 kernel: [30264.621716] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 13:48:10 juju-e4d256-prod-github-runner-207 kernel: [30264.622634] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 13:48:10 juju-e4d256-prod-github-runner-207 kernel: [30264.623548] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 13:48:10 juju-e4d256-prod-github-runner-207 kernel: [30264.624466] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 13:48:10 juju-e4d256-prod-github-runner-207 kernel: [30264.625515] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 13:48:10 juju-e4d256-prod-github-runner-207 kernel: [30264.626541] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 13:48:10 juju-e4d256-prod-github-runner-207 kernel: [30264.627597] Aug 22 13:48:38 juju-e4d256-prod-github-runner-207 kernel: [30292.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 28104s! [qemu-system-x86:6715] Aug 22 13:48:38 juju-e4d256-prod-github-runner-207 kernel: [30292.543958] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 13:48:38 juju-e4d256-prod-github-runner-207 kernel: [30292.544254] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 13:48:38 juju-e4d256-prod-github-runner-207 kernel: [30292.556677] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 13:48:38 juju-e4d256-prod-github-runner-207 kernel: [30292.557949] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 13:48:38 juju-e4d256-prod-github-runner-207 kernel: [30292.559254] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:48:38 juju-e4d256-prod-github-runner-207 kernel: [30292.560313] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 13:48:38 juju-e4d256-prod-github-runner-207 kernel: [30292.562875] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 13:48:38 juju-e4d256-prod-github-runner-207 kernel: [30292.563930] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 13:48:38 juju-e4d256-prod-github-runner-207 kernel: [30292.565273] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 13:48:38 juju-e4d256-prod-github-runner-207 kernel: [30292.566457] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 13:48:38 juju-e4d256-prod-github-runner-207 kernel: [30292.567646] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 13:48:38 juju-e4d256-prod-github-runner-207 kernel: [30292.568808] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 13:48:38 juju-e4d256-prod-github-runner-207 kernel: [30292.569980] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 13:48:38 juju-e4d256-prod-github-runner-207 kernel: [30292.571218] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 13:48:38 juju-e4d256-prod-github-runner-207 kernel: [30292.572317] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 13:48:38 juju-e4d256-prod-github-runner-207 kernel: [30292.573514] Call Trace: Aug 22 13:48:38 juju-e4d256-prod-github-runner-207 kernel: [30292.574426] Aug 22 13:48:38 juju-e4d256-prod-github-runner-207 kernel: [30292.575339] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:48:38 juju-e4d256-prod-github-runner-207 kernel: [30292.576371] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:48:38 juju-e4d256-prod-github-runner-207 kernel: [30292.577392] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:48:38 juju-e4d256-prod-github-runner-207 kernel: [30292.578516] ? show_regs.part.0+0x23/0x29 Aug 22 13:48:38 juju-e4d256-prod-github-runner-207 kernel: [30292.579533] ? show_regs.cold+0x8/0xd Aug 22 13:48:38 juju-e4d256-prod-github-runner-207 kernel: [30292.580506] ? watchdog_timer_fn+0x1be/0x220 Aug 22 13:48:38 juju-e4d256-prod-github-runner-207 kernel: [30292.581523] ? lockup_detector_update_enable+0x60/0x60 Aug 22 13:48:38 juju-e4d256-prod-github-runner-207 kernel: [30292.582590] ? __hrtimer_run_queues+0x107/0x230 Aug 22 13:48:38 juju-e4d256-prod-github-runner-207 kernel: [30292.583636] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 13:48:38 juju-e4d256-prod-github-runner-207 kernel: [30292.584664] ? hrtimer_interrupt+0x101/0x220 Aug 22 13:48:38 juju-e4d256-prod-github-runner-207 kernel: [30292.585710] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 13:48:38 juju-e4d256-prod-github-runner-207 kernel: [30292.586779] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 13:48:38 juju-e4d256-prod-github-runner-207 kernel: [30292.587833] Aug 22 13:48:38 juju-e4d256-prod-github-runner-207 kernel: [30292.588692] Aug 22 13:48:38 juju-e4d256-prod-github-runner-207 kernel: [30292.589534] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 13:48:38 juju-e4d256-prod-github-runner-207 kernel: [30292.590569] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:48:38 juju-e4d256-prod-github-runner-207 kernel: [30292.591639] ? _raw_spin_lock+0x22/0x30 Aug 22 13:48:38 juju-e4d256-prod-github-runner-207 kernel: [30292.592589] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:48:38 juju-e4d256-prod-github-runner-207 kernel: [30292.593608] direct_page_fault+0x206/0x310 [kvm] Aug 22 13:48:38 juju-e4d256-prod-github-runner-207 kernel: [30292.594636] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 13:48:38 juju-e4d256-prod-github-runner-207 kernel: [30292.595652] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 13:48:38 juju-e4d256-prod-github-runner-207 kernel: [30292.596653] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 13:48:38 juju-e4d256-prod-github-runner-207 kernel: [30292.597663] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 13:48:38 juju-e4d256-prod-github-runner-207 kernel: [30292.598606] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 13:48:38 juju-e4d256-prod-github-runner-207 kernel: [30292.599593] handle_exit+0x98/0x230 [kvm_amd] Aug 22 13:48:38 juju-e4d256-prod-github-runner-207 kernel: [30292.600484] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 13:48:38 juju-e4d256-prod-github-runner-207 kernel: [30292.601399] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 13:48:38 juju-e4d256-prod-github-runner-207 kernel: [30292.602328] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 13:48:38 juju-e4d256-prod-github-runner-207 kernel: [30292.603242] vcpu_run+0x62/0x2c0 [kvm] Aug 22 13:48:38 juju-e4d256-prod-github-runner-207 kernel: [30292.604055] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 13:48:38 juju-e4d256-prod-github-runner-207 kernel: [30292.604868] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 13:48:38 juju-e4d256-prod-github-runner-207 kernel: [30292.605723] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 13:48:38 juju-e4d256-prod-github-runner-207 kernel: [30292.606519] ? __seccomp_filter+0x4a/0x4a0 Aug 22 13:48:38 juju-e4d256-prod-github-runner-207 kernel: [30292.607277] ? __fget_files+0x86/0xc0 Aug 22 13:48:38 juju-e4d256-prod-github-runner-207 kernel: [30292.607981] __x64_sys_ioctl+0x95/0xd0 Aug 22 13:48:38 juju-e4d256-prod-github-runner-207 kernel: [30292.608674] do_syscall_64+0x5c/0xc0 Aug 22 13:48:38 juju-e4d256-prod-github-runner-207 kernel: [30292.609339] ? do_futex+0x162/0x1f0 Aug 22 13:48:38 juju-e4d256-prod-github-runner-207 kernel: [30292.609986] ? __x64_sys_futex+0x78/0x1e0 Aug 22 13:48:38 juju-e4d256-prod-github-runner-207 kernel: [30292.610659] ? __secure_computing+0xa9/0x120 Aug 22 13:48:38 juju-e4d256-prod-github-runner-207 kernel: [30292.611361] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 13:48:38 juju-e4d256-prod-github-runner-207 kernel: [30292.612123] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:48:38 juju-e4d256-prod-github-runner-207 kernel: [30292.612844] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:48:38 juju-e4d256-prod-github-runner-207 kernel: [30292.613562] ? do_syscall_64+0x69/0xc0 Aug 22 13:48:38 juju-e4d256-prod-github-runner-207 kernel: [30292.614214] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:48:38 juju-e4d256-prod-github-runner-207 kernel: [30292.614918] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:48:38 juju-e4d256-prod-github-runner-207 kernel: [30292.615732] ? do_syscall_64+0x69/0xc0 Aug 22 13:48:38 juju-e4d256-prod-github-runner-207 kernel: [30292.616394] ? do_syscall_64+0x69/0xc0 Aug 22 13:48:38 juju-e4d256-prod-github-runner-207 kernel: [30292.617063] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 13:48:38 juju-e4d256-prod-github-runner-207 kernel: [30292.617787] RIP: 0033:0x7faa5d0edaff Aug 22 13:48:38 juju-e4d256-prod-github-runner-207 kernel: [30292.618445] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 13:48:38 juju-e4d256-prod-github-runner-207 kernel: [30292.620452] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 13:48:38 juju-e4d256-prod-github-runner-207 kernel: [30292.621362] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 13:48:38 juju-e4d256-prod-github-runner-207 kernel: [30292.622251] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 13:48:38 juju-e4d256-prod-github-runner-207 kernel: [30292.623162] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 13:48:38 juju-e4d256-prod-github-runner-207 kernel: [30292.624051] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 13:48:38 juju-e4d256-prod-github-runner-207 kernel: [30292.624940] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 13:48:38 juju-e4d256-prod-github-runner-207 kernel: [30292.625833] Aug 22 13:49:06 juju-e4d256-prod-github-runner-207 kernel: [30320.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 28130s! [qemu-system-x86:6715] Aug 22 13:49:06 juju-e4d256-prod-github-runner-207 kernel: [30320.543145] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 13:49:06 juju-e4d256-prod-github-runner-207 kernel: [30320.543220] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 13:49:06 juju-e4d256-prod-github-runner-207 kernel: [30320.555994] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 13:49:06 juju-e4d256-prod-github-runner-207 kernel: [30320.557276] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 13:49:06 juju-e4d256-prod-github-runner-207 kernel: [30320.558493] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:49:06 juju-e4d256-prod-github-runner-207 kernel: [30320.559570] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 13:49:06 juju-e4d256-prod-github-runner-207 kernel: [30320.562122] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 13:49:06 juju-e4d256-prod-github-runner-207 kernel: [30320.563199] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 13:49:06 juju-e4d256-prod-github-runner-207 kernel: [30320.564370] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 13:49:06 juju-e4d256-prod-github-runner-207 kernel: [30320.565534] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 13:49:06 juju-e4d256-prod-github-runner-207 kernel: [30320.566710] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 13:49:06 juju-e4d256-prod-github-runner-207 kernel: [30320.567890] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 13:49:06 juju-e4d256-prod-github-runner-207 kernel: [30320.569056] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 13:49:06 juju-e4d256-prod-github-runner-207 kernel: [30320.570347] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 13:49:06 juju-e4d256-prod-github-runner-207 kernel: [30320.571480] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 13:49:06 juju-e4d256-prod-github-runner-207 kernel: [30320.572680] Call Trace: Aug 22 13:49:06 juju-e4d256-prod-github-runner-207 kernel: [30320.573597] Aug 22 13:49:06 juju-e4d256-prod-github-runner-207 kernel: [30320.574578] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:49:06 juju-e4d256-prod-github-runner-207 kernel: [30320.575678] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:49:06 juju-e4d256-prod-github-runner-207 kernel: [30320.576705] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:49:06 juju-e4d256-prod-github-runner-207 kernel: [30320.577789] ? show_regs.part.0+0x23/0x29 Aug 22 13:49:06 juju-e4d256-prod-github-runner-207 kernel: [30320.578827] ? show_regs.cold+0x8/0xd Aug 22 13:49:06 juju-e4d256-prod-github-runner-207 kernel: [30320.579820] ? watchdog_timer_fn+0x1be/0x220 Aug 22 13:49:06 juju-e4d256-prod-github-runner-207 kernel: [30320.580827] ? lockup_detector_update_enable+0x60/0x60 Aug 22 13:49:06 juju-e4d256-prod-github-runner-207 kernel: [30320.581894] ? __hrtimer_run_queues+0x107/0x230 Aug 22 13:49:06 juju-e4d256-prod-github-runner-207 kernel: [30320.582935] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 13:49:06 juju-e4d256-prod-github-runner-207 kernel: [30320.583963] ? hrtimer_interrupt+0x101/0x220 Aug 22 13:49:06 juju-e4d256-prod-github-runner-207 kernel: [30320.584976] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 13:49:06 juju-e4d256-prod-github-runner-207 kernel: [30320.586060] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 13:49:06 juju-e4d256-prod-github-runner-207 kernel: [30320.587172] Aug 22 13:49:06 juju-e4d256-prod-github-runner-207 kernel: [30320.588030] Aug 22 13:49:06 juju-e4d256-prod-github-runner-207 kernel: [30320.588864] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 13:49:06 juju-e4d256-prod-github-runner-207 kernel: [30320.589903] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:49:06 juju-e4d256-prod-github-runner-207 kernel: [30320.591006] ? _raw_spin_lock+0x22/0x30 Aug 22 13:49:06 juju-e4d256-prod-github-runner-207 kernel: [30320.591960] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:49:06 juju-e4d256-prod-github-runner-207 kernel: [30320.593023] direct_page_fault+0x206/0x310 [kvm] Aug 22 13:49:06 juju-e4d256-prod-github-runner-207 kernel: [30320.594051] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 13:49:06 juju-e4d256-prod-github-runner-207 kernel: [30320.595075] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 13:49:06 juju-e4d256-prod-github-runner-207 kernel: [30320.596078] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 13:49:06 juju-e4d256-prod-github-runner-207 kernel: [30320.597061] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 13:49:06 juju-e4d256-prod-github-runner-207 kernel: [30320.598017] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 13:49:06 juju-e4d256-prod-github-runner-207 kernel: [30320.599000] handle_exit+0x98/0x230 [kvm_amd] Aug 22 13:49:06 juju-e4d256-prod-github-runner-207 kernel: [30320.599889] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 13:49:06 juju-e4d256-prod-github-runner-207 kernel: [30320.600805] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 13:49:06 juju-e4d256-prod-github-runner-207 kernel: [30320.601740] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 13:49:06 juju-e4d256-prod-github-runner-207 kernel: [30320.602644] vcpu_run+0x62/0x2c0 [kvm] Aug 22 13:49:06 juju-e4d256-prod-github-runner-207 kernel: [30320.603584] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 13:49:06 juju-e4d256-prod-github-runner-207 kernel: [30320.604387] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 13:49:06 juju-e4d256-prod-github-runner-207 kernel: [30320.605236] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 13:49:06 juju-e4d256-prod-github-runner-207 kernel: [30320.606033] ? __seccomp_filter+0x4a/0x4a0 Aug 22 13:49:06 juju-e4d256-prod-github-runner-207 kernel: [30320.606832] ? __fget_files+0x86/0xc0 Aug 22 13:49:06 juju-e4d256-prod-github-runner-207 kernel: [30320.607541] __x64_sys_ioctl+0x95/0xd0 Aug 22 13:49:06 juju-e4d256-prod-github-runner-207 kernel: [30320.608237] do_syscall_64+0x5c/0xc0 Aug 22 13:49:06 juju-e4d256-prod-github-runner-207 kernel: [30320.608922] ? do_futex+0x162/0x1f0 Aug 22 13:49:06 juju-e4d256-prod-github-runner-207 kernel: [30320.609574] ? __x64_sys_futex+0x78/0x1e0 Aug 22 13:49:06 juju-e4d256-prod-github-runner-207 kernel: [30320.610245] ? __secure_computing+0xa9/0x120 Aug 22 13:49:06 juju-e4d256-prod-github-runner-207 kernel: [30320.610951] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 13:49:06 juju-e4d256-prod-github-runner-207 kernel: [30320.611709] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:49:06 juju-e4d256-prod-github-runner-207 kernel: [30320.612434] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:49:06 juju-e4d256-prod-github-runner-207 kernel: [30320.613153] ? do_syscall_64+0x69/0xc0 Aug 22 13:49:06 juju-e4d256-prod-github-runner-207 kernel: [30320.613802] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:49:06 juju-e4d256-prod-github-runner-207 kernel: [30320.614503] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:49:06 juju-e4d256-prod-github-runner-207 kernel: [30320.615204] ? do_syscall_64+0x69/0xc0 Aug 22 13:49:06 juju-e4d256-prod-github-runner-207 kernel: [30320.615828] ? do_syscall_64+0x69/0xc0 Aug 22 13:49:06 juju-e4d256-prod-github-runner-207 kernel: [30320.616460] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 13:49:06 juju-e4d256-prod-github-runner-207 kernel: [30320.617189] RIP: 0033:0x7faa5d0edaff Aug 22 13:49:06 juju-e4d256-prod-github-runner-207 kernel: [30320.617833] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 13:49:06 juju-e4d256-prod-github-runner-207 kernel: [30320.619826] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 13:49:06 juju-e4d256-prod-github-runner-207 kernel: [30320.620733] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 13:49:06 juju-e4d256-prod-github-runner-207 kernel: [30320.621618] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 13:49:06 juju-e4d256-prod-github-runner-207 kernel: [30320.622506] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 13:49:06 juju-e4d256-prod-github-runner-207 kernel: [30320.623404] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 13:49:06 juju-e4d256-prod-github-runner-207 kernel: [30320.624294] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 13:49:06 juju-e4d256-prod-github-runner-207 kernel: [30320.625184] Aug 22 13:49:34 juju-e4d256-prod-github-runner-207 kernel: [30348.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 28156s! [qemu-system-x86:6715] Aug 22 13:49:34 juju-e4d256-prod-github-runner-207 kernel: [30348.543154] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 13:49:34 juju-e4d256-prod-github-runner-207 kernel: [30348.543229] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 13:49:34 juju-e4d256-prod-github-runner-207 kernel: [30348.555368] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 13:49:34 juju-e4d256-prod-github-runner-207 kernel: [30348.556639] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 13:49:34 juju-e4d256-prod-github-runner-207 kernel: [30348.557855] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:49:34 juju-e4d256-prod-github-runner-207 kernel: [30348.558999] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 13:49:34 juju-e4d256-prod-github-runner-207 kernel: [30348.561571] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 13:49:34 juju-e4d256-prod-github-runner-207 kernel: [30348.562626] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 13:49:34 juju-e4d256-prod-github-runner-207 kernel: [30348.563793] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 13:49:34 juju-e4d256-prod-github-runner-207 kernel: [30348.564951] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 13:49:34 juju-e4d256-prod-github-runner-207 kernel: [30348.566114] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 13:49:34 juju-e4d256-prod-github-runner-207 kernel: [30348.567289] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 13:49:34 juju-e4d256-prod-github-runner-207 kernel: [30348.568454] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 13:49:34 juju-e4d256-prod-github-runner-207 kernel: [30348.569767] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 13:49:34 juju-e4d256-prod-github-runner-207 kernel: [30348.570896] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 13:49:34 juju-e4d256-prod-github-runner-207 kernel: [30348.572153] Call Trace: Aug 22 13:49:34 juju-e4d256-prod-github-runner-207 kernel: [30348.573066] Aug 22 13:49:34 juju-e4d256-prod-github-runner-207 kernel: [30348.573952] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:49:34 juju-e4d256-prod-github-runner-207 kernel: [30348.574998] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:49:34 juju-e4d256-prod-github-runner-207 kernel: [30348.576021] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:49:34 juju-e4d256-prod-github-runner-207 kernel: [30348.577230] ? show_regs.part.0+0x23/0x29 Aug 22 13:49:34 juju-e4d256-prod-github-runner-207 kernel: [30348.578230] ? show_regs.cold+0x8/0xd Aug 22 13:49:34 juju-e4d256-prod-github-runner-207 kernel: [30348.579212] ? watchdog_timer_fn+0x1be/0x220 Aug 22 13:49:34 juju-e4d256-prod-github-runner-207 kernel: [30348.580218] ? lockup_detector_update_enable+0x60/0x60 Aug 22 13:49:34 juju-e4d256-prod-github-runner-207 kernel: [30348.581280] ? __hrtimer_run_queues+0x107/0x230 Aug 22 13:49:34 juju-e4d256-prod-github-runner-207 kernel: [30348.582311] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 13:49:34 juju-e4d256-prod-github-runner-207 kernel: [30348.583478] ? hrtimer_interrupt+0x101/0x220 Aug 22 13:49:34 juju-e4d256-prod-github-runner-207 kernel: [30348.584594] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 13:49:34 juju-e4d256-prod-github-runner-207 kernel: [30348.585715] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 13:49:34 juju-e4d256-prod-github-runner-207 kernel: [30348.586805] Aug 22 13:49:34 juju-e4d256-prod-github-runner-207 kernel: [30348.587659] Aug 22 13:49:34 juju-e4d256-prod-github-runner-207 kernel: [30348.588500] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 13:49:34 juju-e4d256-prod-github-runner-207 kernel: [30348.589535] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:49:34 juju-e4d256-prod-github-runner-207 kernel: [30348.590590] ? _raw_spin_lock+0x22/0x30 Aug 22 13:49:34 juju-e4d256-prod-github-runner-207 kernel: [30348.591542] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:49:34 juju-e4d256-prod-github-runner-207 kernel: [30348.592562] direct_page_fault+0x206/0x310 [kvm] Aug 22 13:49:34 juju-e4d256-prod-github-runner-207 kernel: [30348.593592] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 13:49:34 juju-e4d256-prod-github-runner-207 kernel: [30348.594615] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 13:49:34 juju-e4d256-prod-github-runner-207 kernel: [30348.595620] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 13:49:34 juju-e4d256-prod-github-runner-207 kernel: [30348.596593] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 13:49:34 juju-e4d256-prod-github-runner-207 kernel: [30348.597545] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 13:49:34 juju-e4d256-prod-github-runner-207 kernel: [30348.598545] handle_exit+0x98/0x230 [kvm_amd] Aug 22 13:49:34 juju-e4d256-prod-github-runner-207 kernel: [30348.599592] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 13:49:34 juju-e4d256-prod-github-runner-207 kernel: [30348.600762] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 13:49:34 juju-e4d256-prod-github-runner-207 kernel: [30348.601692] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 13:49:34 juju-e4d256-prod-github-runner-207 kernel: [30348.602614] vcpu_run+0x62/0x2c0 [kvm] Aug 22 13:49:34 juju-e4d256-prod-github-runner-207 kernel: [30348.603425] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 13:49:34 juju-e4d256-prod-github-runner-207 kernel: [30348.604238] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 13:49:34 juju-e4d256-prod-github-runner-207 kernel: [30348.605096] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 13:49:34 juju-e4d256-prod-github-runner-207 kernel: [30348.605895] ? __seccomp_filter+0x4a/0x4a0 Aug 22 13:49:34 juju-e4d256-prod-github-runner-207 kernel: [30348.606657] ? __fget_files+0x86/0xc0 Aug 22 13:49:34 juju-e4d256-prod-github-runner-207 kernel: [30348.607367] __x64_sys_ioctl+0x95/0xd0 Aug 22 13:49:34 juju-e4d256-prod-github-runner-207 kernel: [30348.608059] do_syscall_64+0x5c/0xc0 Aug 22 13:49:34 juju-e4d256-prod-github-runner-207 kernel: [30348.608723] ? do_futex+0x162/0x1f0 Aug 22 13:49:34 juju-e4d256-prod-github-runner-207 kernel: [30348.609371] ? __x64_sys_futex+0x78/0x1e0 Aug 22 13:49:34 juju-e4d256-prod-github-runner-207 kernel: [30348.610064] ? __secure_computing+0xa9/0x120 Aug 22 13:49:34 juju-e4d256-prod-github-runner-207 kernel: [30348.610867] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 13:49:34 juju-e4d256-prod-github-runner-207 kernel: [30348.611634] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:49:34 juju-e4d256-prod-github-runner-207 kernel: [30348.612358] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:49:34 juju-e4d256-prod-github-runner-207 kernel: [30348.613081] ? do_syscall_64+0x69/0xc0 Aug 22 13:49:34 juju-e4d256-prod-github-runner-207 kernel: [30348.613727] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:49:34 juju-e4d256-prod-github-runner-207 kernel: [30348.614453] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:49:34 juju-e4d256-prod-github-runner-207 kernel: [30348.615148] ? do_syscall_64+0x69/0xc0 Aug 22 13:49:34 juju-e4d256-prod-github-runner-207 kernel: [30348.615776] ? do_syscall_64+0x69/0xc0 Aug 22 13:49:34 juju-e4d256-prod-github-runner-207 kernel: [30348.616401] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 13:49:34 juju-e4d256-prod-github-runner-207 kernel: [30348.617113] RIP: 0033:0x7faa5d0edaff Aug 22 13:49:34 juju-e4d256-prod-github-runner-207 kernel: [30348.617747] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 13:49:34 juju-e4d256-prod-github-runner-207 kernel: [30348.619749] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 13:49:34 juju-e4d256-prod-github-runner-207 kernel: [30348.620671] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 13:49:34 juju-e4d256-prod-github-runner-207 kernel: [30348.621563] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 13:49:34 juju-e4d256-prod-github-runner-207 kernel: [30348.622486] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 13:49:34 juju-e4d256-prod-github-runner-207 kernel: [30348.623383] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 13:49:34 juju-e4d256-prod-github-runner-207 kernel: [30348.624279] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 13:49:34 juju-e4d256-prod-github-runner-207 kernel: [30348.625174] Aug 22 13:50:02 juju-e4d256-prod-github-runner-207 kernel: [30376.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 28182s! [qemu-system-x86:6715] Aug 22 13:50:02 juju-e4d256-prod-github-runner-207 kernel: [30376.543181] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 13:50:02 juju-e4d256-prod-github-runner-207 kernel: [30376.543352] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 13:50:02 juju-e4d256-prod-github-runner-207 kernel: [30376.555446] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 13:50:02 juju-e4d256-prod-github-runner-207 kernel: [30376.556713] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 13:50:02 juju-e4d256-prod-github-runner-207 kernel: [30376.557982] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:50:02 juju-e4d256-prod-github-runner-207 kernel: [30376.559065] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 13:50:02 juju-e4d256-prod-github-runner-207 kernel: [30376.561609] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 13:50:02 juju-e4d256-prod-github-runner-207 kernel: [30376.562810] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 13:50:02 juju-e4d256-prod-github-runner-207 kernel: [30376.564125] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 13:50:02 juju-e4d256-prod-github-runner-207 kernel: [30376.565439] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 13:50:02 juju-e4d256-prod-github-runner-207 kernel: [30376.566678] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 13:50:02 juju-e4d256-prod-github-runner-207 kernel: [30376.567844] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 13:50:02 juju-e4d256-prod-github-runner-207 kernel: [30376.569011] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 13:50:02 juju-e4d256-prod-github-runner-207 kernel: [30376.570268] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 13:50:02 juju-e4d256-prod-github-runner-207 kernel: [30376.571509] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 13:50:02 juju-e4d256-prod-github-runner-207 kernel: [30376.572726] Call Trace: Aug 22 13:50:02 juju-e4d256-prod-github-runner-207 kernel: [30376.573825] Aug 22 13:50:02 juju-e4d256-prod-github-runner-207 kernel: [30376.574732] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:50:02 juju-e4d256-prod-github-runner-207 kernel: [30376.575763] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:50:02 juju-e4d256-prod-github-runner-207 kernel: [30376.576791] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:50:02 juju-e4d256-prod-github-runner-207 kernel: [30376.577904] ? show_regs.part.0+0x23/0x29 Aug 22 13:50:02 juju-e4d256-prod-github-runner-207 kernel: [30376.578919] ? show_regs.cold+0x8/0xd Aug 22 13:50:02 juju-e4d256-prod-github-runner-207 kernel: [30376.579891] ? watchdog_timer_fn+0x1be/0x220 Aug 22 13:50:02 juju-e4d256-prod-github-runner-207 kernel: [30376.580905] ? lockup_detector_update_enable+0x60/0x60 Aug 22 13:50:02 juju-e4d256-prod-github-runner-207 kernel: [30376.581969] ? __hrtimer_run_queues+0x107/0x230 Aug 22 13:50:02 juju-e4d256-prod-github-runner-207 kernel: [30376.583025] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 13:50:02 juju-e4d256-prod-github-runner-207 kernel: [30376.584054] ? hrtimer_interrupt+0x101/0x220 Aug 22 13:50:02 juju-e4d256-prod-github-runner-207 kernel: [30376.585072] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 13:50:02 juju-e4d256-prod-github-runner-207 kernel: [30376.586161] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 13:50:02 juju-e4d256-prod-github-runner-207 kernel: [30376.587213] Aug 22 13:50:02 juju-e4d256-prod-github-runner-207 kernel: [30376.588066] Aug 22 13:50:02 juju-e4d256-prod-github-runner-207 kernel: [30376.588903] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 13:50:02 juju-e4d256-prod-github-runner-207 kernel: [30376.589935] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:50:02 juju-e4d256-prod-github-runner-207 kernel: [30376.590987] ? _raw_spin_lock+0x22/0x30 Aug 22 13:50:02 juju-e4d256-prod-github-runner-207 kernel: [30376.591932] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:50:02 juju-e4d256-prod-github-runner-207 kernel: [30376.592952] direct_page_fault+0x206/0x310 [kvm] Aug 22 13:50:02 juju-e4d256-prod-github-runner-207 kernel: [30376.593982] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 13:50:02 juju-e4d256-prod-github-runner-207 kernel: [30376.595006] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 13:50:02 juju-e4d256-prod-github-runner-207 kernel: [30376.596021] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 13:50:02 juju-e4d256-prod-github-runner-207 kernel: [30376.597044] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 13:50:02 juju-e4d256-prod-github-runner-207 kernel: [30376.598002] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 13:50:02 juju-e4d256-prod-github-runner-207 kernel: [30376.599086] handle_exit+0x98/0x230 [kvm_amd] Aug 22 13:50:02 juju-e4d256-prod-github-runner-207 kernel: [30376.599980] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 13:50:02 juju-e4d256-prod-github-runner-207 kernel: [30376.600894] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 13:50:02 juju-e4d256-prod-github-runner-207 kernel: [30376.601825] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 13:50:02 juju-e4d256-prod-github-runner-207 kernel: [30376.602748] vcpu_run+0x62/0x2c0 [kvm] Aug 22 13:50:02 juju-e4d256-prod-github-runner-207 kernel: [30376.603567] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 13:50:02 juju-e4d256-prod-github-runner-207 kernel: [30376.604381] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 13:50:02 juju-e4d256-prod-github-runner-207 kernel: [30376.605242] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 13:50:02 juju-e4d256-prod-github-runner-207 kernel: [30376.606040] ? __seccomp_filter+0x4a/0x4a0 Aug 22 13:50:02 juju-e4d256-prod-github-runner-207 kernel: [30376.606798] ? __fget_files+0x86/0xc0 Aug 22 13:50:02 juju-e4d256-prod-github-runner-207 kernel: [30376.607509] __x64_sys_ioctl+0x95/0xd0 Aug 22 13:50:02 juju-e4d256-prod-github-runner-207 kernel: [30376.608202] do_syscall_64+0x5c/0xc0 Aug 22 13:50:02 juju-e4d256-prod-github-runner-207 kernel: [30376.608869] ? do_futex+0x162/0x1f0 Aug 22 13:50:02 juju-e4d256-prod-github-runner-207 kernel: [30376.609518] ? __x64_sys_futex+0x78/0x1e0 Aug 22 13:50:02 juju-e4d256-prod-github-runner-207 kernel: [30376.610203] ? __secure_computing+0xa9/0x120 Aug 22 13:50:02 juju-e4d256-prod-github-runner-207 kernel: [30376.610895] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 13:50:02 juju-e4d256-prod-github-runner-207 kernel: [30376.611672] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:50:02 juju-e4d256-prod-github-runner-207 kernel: [30376.612417] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:50:02 juju-e4d256-prod-github-runner-207 kernel: [30376.613144] ? do_syscall_64+0x69/0xc0 Aug 22 13:50:02 juju-e4d256-prod-github-runner-207 kernel: [30376.613791] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:50:02 juju-e4d256-prod-github-runner-207 kernel: [30376.614507] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:50:02 juju-e4d256-prod-github-runner-207 kernel: [30376.615204] ? do_syscall_64+0x69/0xc0 Aug 22 13:50:02 juju-e4d256-prod-github-runner-207 kernel: [30376.615830] ? do_syscall_64+0x69/0xc0 Aug 22 13:50:02 juju-e4d256-prod-github-runner-207 kernel: [30376.616454] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 13:50:02 juju-e4d256-prod-github-runner-207 kernel: [30376.617168] RIP: 0033:0x7faa5d0edaff Aug 22 13:50:02 juju-e4d256-prod-github-runner-207 kernel: [30376.617802] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 13:50:02 juju-e4d256-prod-github-runner-207 kernel: [30376.619816] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 13:50:02 juju-e4d256-prod-github-runner-207 kernel: [30376.620755] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 13:50:02 juju-e4d256-prod-github-runner-207 kernel: [30376.621646] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 13:50:02 juju-e4d256-prod-github-runner-207 kernel: [30376.622547] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 13:50:02 juju-e4d256-prod-github-runner-207 kernel: [30376.623446] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 13:50:02 juju-e4d256-prod-github-runner-207 kernel: [30376.624336] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 13:50:02 juju-e4d256-prod-github-runner-207 kernel: [30376.625260] Aug 22 13:50:30 juju-e4d256-prod-github-runner-207 kernel: [30404.541982] watchdog: BUG: soft lockup - CPU#1 stuck for 28208s! [qemu-system-x86:6715] Aug 22 13:50:30 juju-e4d256-prod-github-runner-207 kernel: [30404.543903] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 13:50:30 juju-e4d256-prod-github-runner-207 kernel: [30404.544153] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 13:50:30 juju-e4d256-prod-github-runner-207 kernel: [30404.556784] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 13:50:30 juju-e4d256-prod-github-runner-207 kernel: [30404.558077] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 13:50:30 juju-e4d256-prod-github-runner-207 kernel: [30404.559299] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:50:30 juju-e4d256-prod-github-runner-207 kernel: [30404.560356] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 13:50:30 juju-e4d256-prod-github-runner-207 kernel: [30404.562934] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 13:50:30 juju-e4d256-prod-github-runner-207 kernel: [30404.563977] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 13:50:30 juju-e4d256-prod-github-runner-207 kernel: [30404.565139] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 13:50:30 juju-e4d256-prod-github-runner-207 kernel: [30404.566318] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 13:50:30 juju-e4d256-prod-github-runner-207 kernel: [30404.567488] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 13:50:30 juju-e4d256-prod-github-runner-207 kernel: [30404.568747] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 13:50:30 juju-e4d256-prod-github-runner-207 kernel: [30404.570106] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 13:50:30 juju-e4d256-prod-github-runner-207 kernel: [30404.571382] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 13:50:30 juju-e4d256-prod-github-runner-207 kernel: [30404.572497] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 13:50:30 juju-e4d256-prod-github-runner-207 kernel: [30404.573699] Call Trace: Aug 22 13:50:30 juju-e4d256-prod-github-runner-207 kernel: [30404.574638] Aug 22 13:50:30 juju-e4d256-prod-github-runner-207 kernel: [30404.575549] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:50:30 juju-e4d256-prod-github-runner-207 kernel: [30404.576582] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:50:30 juju-e4d256-prod-github-runner-207 kernel: [30404.577607] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:50:30 juju-e4d256-prod-github-runner-207 kernel: [30404.578703] ? show_regs.part.0+0x23/0x29 Aug 22 13:50:30 juju-e4d256-prod-github-runner-207 kernel: [30404.579699] ? show_regs.cold+0x8/0xd Aug 22 13:50:30 juju-e4d256-prod-github-runner-207 kernel: [30404.580669] ? watchdog_timer_fn+0x1be/0x220 Aug 22 13:50:30 juju-e4d256-prod-github-runner-207 kernel: [30404.581677] ? lockup_detector_update_enable+0x60/0x60 Aug 22 13:50:30 juju-e4d256-prod-github-runner-207 kernel: [30404.582763] ? __hrtimer_run_queues+0x107/0x230 Aug 22 13:50:30 juju-e4d256-prod-github-runner-207 kernel: [30404.583800] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 13:50:30 juju-e4d256-prod-github-runner-207 kernel: [30404.584828] ? hrtimer_interrupt+0x101/0x220 Aug 22 13:50:30 juju-e4d256-prod-github-runner-207 kernel: [30404.585865] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 13:50:30 juju-e4d256-prod-github-runner-207 kernel: [30404.586933] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 13:50:30 juju-e4d256-prod-github-runner-207 kernel: [30404.587977] Aug 22 13:50:30 juju-e4d256-prod-github-runner-207 kernel: [30404.588830] Aug 22 13:50:30 juju-e4d256-prod-github-runner-207 kernel: [30404.589668] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 13:50:30 juju-e4d256-prod-github-runner-207 kernel: [30404.590734] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:50:30 juju-e4d256-prod-github-runner-207 kernel: [30404.591774] ? _raw_spin_lock+0x22/0x30 Aug 22 13:50:30 juju-e4d256-prod-github-runner-207 kernel: [30404.592728] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:50:30 juju-e4d256-prod-github-runner-207 kernel: [30404.593796] direct_page_fault+0x206/0x310 [kvm] Aug 22 13:50:30 juju-e4d256-prod-github-runner-207 kernel: [30404.594826] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 13:50:30 juju-e4d256-prod-github-runner-207 kernel: [30404.595837] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 13:50:30 juju-e4d256-prod-github-runner-207 kernel: [30404.596838] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 13:50:30 juju-e4d256-prod-github-runner-207 kernel: [30404.597857] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 13:50:30 juju-e4d256-prod-github-runner-207 kernel: [30404.598812] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 13:50:30 juju-e4d256-prod-github-runner-207 kernel: [30404.599818] handle_exit+0x98/0x230 [kvm_amd] Aug 22 13:50:30 juju-e4d256-prod-github-runner-207 kernel: [30404.600711] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 13:50:30 juju-e4d256-prod-github-runner-207 kernel: [30404.601628] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 13:50:30 juju-e4d256-prod-github-runner-207 kernel: [30404.602564] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 13:50:30 juju-e4d256-prod-github-runner-207 kernel: [30404.603473] vcpu_run+0x62/0x2c0 [kvm] Aug 22 13:50:30 juju-e4d256-prod-github-runner-207 kernel: [30404.604302] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 13:50:30 juju-e4d256-prod-github-runner-207 kernel: [30404.605113] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 13:50:30 juju-e4d256-prod-github-runner-207 kernel: [30404.605982] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 13:50:30 juju-e4d256-prod-github-runner-207 kernel: [30404.606795] ? __seccomp_filter+0x4a/0x4a0 Aug 22 13:50:30 juju-e4d256-prod-github-runner-207 kernel: [30404.607606] ? __fget_files+0x86/0xc0 Aug 22 13:50:30 juju-e4d256-prod-github-runner-207 kernel: [30404.608340] __x64_sys_ioctl+0x95/0xd0 Aug 22 13:50:30 juju-e4d256-prod-github-runner-207 kernel: [30404.609033] do_syscall_64+0x5c/0xc0 Aug 22 13:50:30 juju-e4d256-prod-github-runner-207 kernel: [30404.609729] ? do_futex+0x162/0x1f0 Aug 22 13:50:30 juju-e4d256-prod-github-runner-207 kernel: [30404.610403] ? __x64_sys_futex+0x78/0x1e0 Aug 22 13:50:30 juju-e4d256-prod-github-runner-207 kernel: [30404.611133] ? __secure_computing+0xa9/0x120 Aug 22 13:50:30 juju-e4d256-prod-github-runner-207 kernel: [30404.611827] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 13:50:30 juju-e4d256-prod-github-runner-207 kernel: [30404.612654] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:50:30 juju-e4d256-prod-github-runner-207 kernel: [30404.613425] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:50:30 juju-e4d256-prod-github-runner-207 kernel: [30404.614159] ? do_syscall_64+0x69/0xc0 Aug 22 13:50:30 juju-e4d256-prod-github-runner-207 kernel: [30404.614821] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:50:30 juju-e4d256-prod-github-runner-207 kernel: [30404.615581] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:50:30 juju-e4d256-prod-github-runner-207 kernel: [30404.616282] ? do_syscall_64+0x69/0xc0 Aug 22 13:50:30 juju-e4d256-prod-github-runner-207 kernel: [30404.616913] ? do_syscall_64+0x69/0xc0 Aug 22 13:50:30 juju-e4d256-prod-github-runner-207 kernel: [30404.617546] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 13:50:30 juju-e4d256-prod-github-runner-207 kernel: [30404.618288] RIP: 0033:0x7faa5d0edaff Aug 22 13:50:30 juju-e4d256-prod-github-runner-207 kernel: [30404.618966] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 13:50:30 juju-e4d256-prod-github-runner-207 kernel: [30404.620970] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 13:50:30 juju-e4d256-prod-github-runner-207 kernel: [30404.621907] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 13:50:30 juju-e4d256-prod-github-runner-207 kernel: [30404.622811] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 13:50:30 juju-e4d256-prod-github-runner-207 kernel: [30404.623743] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 13:50:30 juju-e4d256-prod-github-runner-207 kernel: [30404.624698] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 13:50:30 juju-e4d256-prod-github-runner-207 kernel: [30404.625591] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 13:50:30 juju-e4d256-prod-github-runner-207 kernel: [30404.626528] Aug 22 13:50:45 juju-e4d256-prod-github-runner-207 kernel: [30419.216706] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 13:50:45 juju-e4d256-prod-github-runner-207 kernel: [30419.217710] rcu: 1-....: (7551852 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=3649400 Aug 22 13:50:45 juju-e4d256-prod-github-runner-207 kernel: [30419.218867] (t=7575504 jiffies g=23269 q=33690) Aug 22 13:50:45 juju-e4d256-prod-github-runner-207 kernel: [30419.219659] NMI backtrace for cpu 1 Aug 22 13:50:45 juju-e4d256-prod-github-runner-207 kernel: [30419.220385] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 13:50:45 juju-e4d256-prod-github-runner-207 kernel: [30419.221537] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 13:50:45 juju-e4d256-prod-github-runner-207 kernel: [30419.222665] Call Trace: Aug 22 13:50:45 juju-e4d256-prod-github-runner-207 kernel: [30419.223620] Aug 22 13:50:45 juju-e4d256-prod-github-runner-207 kernel: [30419.224271] show_stack+0x52/0x5c Aug 22 13:50:45 juju-e4d256-prod-github-runner-207 kernel: [30419.225039] dump_stack_lvl+0x4a/0x63 Aug 22 13:50:45 juju-e4d256-prod-github-runner-207 kernel: [30419.225962] dump_stack+0x10/0x16 Aug 22 13:50:45 juju-e4d256-prod-github-runner-207 kernel: [30419.226943] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 13:50:45 juju-e4d256-prod-github-runner-207 kernel: [30419.228066] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 13:50:45 juju-e4d256-prod-github-runner-207 kernel: [30419.229228] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 13:50:45 juju-e4d256-prod-github-runner-207 kernel: [30419.230580] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 13:50:45 juju-e4d256-prod-github-runner-207 kernel: [30419.231604] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 13:50:45 juju-e4d256-prod-github-runner-207 kernel: [30419.232444] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 13:50:45 juju-e4d256-prod-github-runner-207 kernel: [30419.233228] print_cpu_stall.cold+0x2f/0xe2 Aug 22 13:50:45 juju-e4d256-prod-github-runner-207 kernel: [30419.234151] ? timekeeping_update+0xf7/0x150 Aug 22 13:50:45 juju-e4d256-prod-github-runner-207 kernel: [30419.234970] check_cpu_stall+0x109/0x270 Aug 22 13:50:45 juju-e4d256-prod-github-runner-207 kernel: [30419.235814] rcu_sched_clock_irq+0x9a/0x250 Aug 22 13:50:45 juju-e4d256-prod-github-runner-207 kernel: [30419.236581] update_process_times+0x94/0xd0 Aug 22 13:50:45 juju-e4d256-prod-github-runner-207 kernel: [30419.237350] tick_sched_handle+0x29/0x70 Aug 22 13:50:45 juju-e4d256-prod-github-runner-207 kernel: [30419.238146] tick_sched_timer+0x8c/0xc0 Aug 22 13:50:45 juju-e4d256-prod-github-runner-207 kernel: [30419.238893] ? tick_nohz_handler+0xb0/0xb0 Aug 22 13:50:45 juju-e4d256-prod-github-runner-207 kernel: [30419.239661] __hrtimer_run_queues+0x107/0x230 Aug 22 13:50:45 juju-e4d256-prod-github-runner-207 kernel: [30419.240442] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 13:50:45 juju-e4d256-prod-github-runner-207 kernel: [30419.241227] hrtimer_interrupt+0x101/0x220 Aug 22 13:50:45 juju-e4d256-prod-github-runner-207 kernel: [30419.242014] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 13:50:45 juju-e4d256-prod-github-runner-207 kernel: [30419.242847] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 13:50:45 juju-e4d256-prod-github-runner-207 kernel: [30419.243685] Aug 22 13:50:45 juju-e4d256-prod-github-runner-207 kernel: [30419.244323] Aug 22 13:50:45 juju-e4d256-prod-github-runner-207 kernel: [30419.244968] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 13:50:45 juju-e4d256-prod-github-runner-207 kernel: [30419.245828] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:50:45 juju-e4d256-prod-github-runner-207 kernel: [30419.246728] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 13:50:45 juju-e4d256-prod-github-runner-207 kernel: [30419.248984] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 13:50:45 juju-e4d256-prod-github-runner-207 kernel: [30419.249888] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 13:50:45 juju-e4d256-prod-github-runner-207 kernel: [30419.250895] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 13:50:45 juju-e4d256-prod-github-runner-207 kernel: [30419.251891] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 13:50:45 juju-e4d256-prod-github-runner-207 kernel: [30419.252900] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 13:50:45 juju-e4d256-prod-github-runner-207 kernel: [30419.253866] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 13:50:45 juju-e4d256-prod-github-runner-207 kernel: [30419.254816] ? _raw_spin_lock+0x22/0x30 Aug 22 13:50:45 juju-e4d256-prod-github-runner-207 kernel: [30419.255572] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:50:45 juju-e4d256-prod-github-runner-207 kernel: [30419.256413] direct_page_fault+0x206/0x310 [kvm] Aug 22 13:50:45 juju-e4d256-prod-github-runner-207 kernel: [30419.257248] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 13:50:45 juju-e4d256-prod-github-runner-207 kernel: [30419.258092] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 13:50:45 juju-e4d256-prod-github-runner-207 kernel: [30419.258911] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 13:50:45 juju-e4d256-prod-github-runner-207 kernel: [30419.259712] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 13:50:45 juju-e4d256-prod-github-runner-207 kernel: [30419.260492] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 13:50:45 juju-e4d256-prod-github-runner-207 kernel: [30419.261311] handle_exit+0x98/0x230 [kvm_amd] Aug 22 13:50:45 juju-e4d256-prod-github-runner-207 kernel: [30419.262075] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 13:50:45 juju-e4d256-prod-github-runner-207 kernel: [30419.262855] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 13:50:45 juju-e4d256-prod-github-runner-207 kernel: [30419.263653] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 13:50:45 juju-e4d256-prod-github-runner-207 kernel: [30419.264450] vcpu_run+0x62/0x2c0 [kvm] Aug 22 13:50:45 juju-e4d256-prod-github-runner-207 kernel: [30419.265169] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 13:50:45 juju-e4d256-prod-github-runner-207 kernel: [30419.265916] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 13:50:45 juju-e4d256-prod-github-runner-207 kernel: [30419.266728] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 13:50:45 juju-e4d256-prod-github-runner-207 kernel: [30419.267519] ? __seccomp_filter+0x4a/0x4a0 Aug 22 13:50:45 juju-e4d256-prod-github-runner-207 kernel: [30419.268266] ? __fget_files+0x86/0xc0 Aug 22 13:50:45 juju-e4d256-prod-github-runner-207 kernel: [30419.269042] __x64_sys_ioctl+0x95/0xd0 Aug 22 13:50:45 juju-e4d256-prod-github-runner-207 kernel: [30419.269771] do_syscall_64+0x5c/0xc0 Aug 22 13:50:45 juju-e4d256-prod-github-runner-207 kernel: [30419.270454] ? do_futex+0x162/0x1f0 Aug 22 13:50:45 juju-e4d256-prod-github-runner-207 kernel: [30419.271125] ? __x64_sys_futex+0x78/0x1e0 Aug 22 13:50:45 juju-e4d256-prod-github-runner-207 kernel: [30419.271825] ? __secure_computing+0xa9/0x120 Aug 22 13:50:45 juju-e4d256-prod-github-runner-207 kernel: [30419.272574] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 13:50:45 juju-e4d256-prod-github-runner-207 kernel: [30419.273372] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:50:45 juju-e4d256-prod-github-runner-207 kernel: [30419.274143] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:50:45 juju-e4d256-prod-github-runner-207 kernel: [30419.274899] ? do_syscall_64+0x69/0xc0 Aug 22 13:50:45 juju-e4d256-prod-github-runner-207 kernel: [30419.275583] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:50:45 juju-e4d256-prod-github-runner-207 kernel: [30419.276332] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:50:45 juju-e4d256-prod-github-runner-207 kernel: [30419.277087] ? do_syscall_64+0x69/0xc0 Aug 22 13:50:45 juju-e4d256-prod-github-runner-207 kernel: [30419.277795] ? do_syscall_64+0x69/0xc0 Aug 22 13:50:45 juju-e4d256-prod-github-runner-207 kernel: [30419.278480] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 13:50:45 juju-e4d256-prod-github-runner-207 kernel: [30419.279251] RIP: 0033:0x7faa5d0edaff Aug 22 13:50:45 juju-e4d256-prod-github-runner-207 kernel: [30419.279931] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 13:50:45 juju-e4d256-prod-github-runner-207 kernel: [30419.282030] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 13:50:45 juju-e4d256-prod-github-runner-207 kernel: [30419.282985] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 13:50:45 juju-e4d256-prod-github-runner-207 kernel: [30419.283954] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 13:50:45 juju-e4d256-prod-github-runner-207 kernel: [30419.284902] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 13:50:45 juju-e4d256-prod-github-runner-207 kernel: [30419.285861] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 13:50:45 juju-e4d256-prod-github-runner-207 kernel: [30419.286784] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 13:50:45 juju-e4d256-prod-github-runner-207 kernel: [30419.287694] Aug 22 13:51:10 juju-e4d256-prod-github-runner-207 kernel: [30444.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 28245s! [qemu-system-x86:6715] Aug 22 13:51:10 juju-e4d256-prod-github-runner-207 kernel: [30444.543111] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 13:51:10 juju-e4d256-prod-github-runner-207 kernel: [30444.543185] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 13:51:10 juju-e4d256-prod-github-runner-207 kernel: [30444.555554] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 13:51:10 juju-e4d256-prod-github-runner-207 kernel: [30444.556831] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 13:51:10 juju-e4d256-prod-github-runner-207 kernel: [30444.558064] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:51:10 juju-e4d256-prod-github-runner-207 kernel: [30444.559113] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 13:51:10 juju-e4d256-prod-github-runner-207 kernel: [30444.561714] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 13:51:10 juju-e4d256-prod-github-runner-207 kernel: [30444.562817] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 13:51:10 juju-e4d256-prod-github-runner-207 kernel: [30444.563996] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 13:51:10 juju-e4d256-prod-github-runner-207 kernel: [30444.565159] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 13:51:10 juju-e4d256-prod-github-runner-207 kernel: [30444.566345] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 13:51:10 juju-e4d256-prod-github-runner-207 kernel: [30444.567518] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 13:51:10 juju-e4d256-prod-github-runner-207 kernel: [30444.568684] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 13:51:10 juju-e4d256-prod-github-runner-207 kernel: [30444.569950] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 13:51:10 juju-e4d256-prod-github-runner-207 kernel: [30444.571088] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 13:51:10 juju-e4d256-prod-github-runner-207 kernel: [30444.572307] Call Trace: Aug 22 13:51:10 juju-e4d256-prod-github-runner-207 kernel: [30444.573330] Aug 22 13:51:10 juju-e4d256-prod-github-runner-207 kernel: [30444.574300] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:51:10 juju-e4d256-prod-github-runner-207 kernel: [30444.575335] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:51:10 juju-e4d256-prod-github-runner-207 kernel: [30444.576357] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:51:10 juju-e4d256-prod-github-runner-207 kernel: [30444.577456] ? show_regs.part.0+0x23/0x29 Aug 22 13:51:10 juju-e4d256-prod-github-runner-207 kernel: [30444.578455] ? show_regs.cold+0x8/0xd Aug 22 13:51:10 juju-e4d256-prod-github-runner-207 kernel: [30444.579426] ? watchdog_timer_fn+0x1be/0x220 Aug 22 13:51:10 juju-e4d256-prod-github-runner-207 kernel: [30444.580437] ? lockup_detector_update_enable+0x60/0x60 Aug 22 13:51:10 juju-e4d256-prod-github-runner-207 kernel: [30444.581518] ? __hrtimer_run_queues+0x107/0x230 Aug 22 13:51:10 juju-e4d256-prod-github-runner-207 kernel: [30444.582594] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 13:51:10 juju-e4d256-prod-github-runner-207 kernel: [30444.583624] ? hrtimer_interrupt+0x101/0x220 Aug 22 13:51:10 juju-e4d256-prod-github-runner-207 kernel: [30444.584639] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 13:51:10 juju-e4d256-prod-github-runner-207 kernel: [30444.585722] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 13:51:10 juju-e4d256-prod-github-runner-207 kernel: [30444.586801] Aug 22 13:51:10 juju-e4d256-prod-github-runner-207 kernel: [30444.587666] Aug 22 13:51:10 juju-e4d256-prod-github-runner-207 kernel: [30444.588505] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 13:51:10 juju-e4d256-prod-github-runner-207 kernel: [30444.589551] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:51:10 juju-e4d256-prod-github-runner-207 kernel: [30444.590615] ? _raw_spin_lock+0x22/0x30 Aug 22 13:51:10 juju-e4d256-prod-github-runner-207 kernel: [30444.591584] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:51:10 juju-e4d256-prod-github-runner-207 kernel: [30444.592637] direct_page_fault+0x206/0x310 [kvm] Aug 22 13:51:10 juju-e4d256-prod-github-runner-207 kernel: [30444.593724] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 13:51:10 juju-e4d256-prod-github-runner-207 kernel: [30444.594737] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 13:51:10 juju-e4d256-prod-github-runner-207 kernel: [30444.595874] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 13:51:10 juju-e4d256-prod-github-runner-207 kernel: [30444.597125] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 13:51:10 juju-e4d256-prod-github-runner-207 kernel: [30444.598239] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 13:51:10 juju-e4d256-prod-github-runner-207 kernel: [30444.599225] handle_exit+0x98/0x230 [kvm_amd] Aug 22 13:51:10 juju-e4d256-prod-github-runner-207 kernel: [30444.600146] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 13:51:10 juju-e4d256-prod-github-runner-207 kernel: [30444.601065] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 13:51:10 juju-e4d256-prod-github-runner-207 kernel: [30444.602038] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 13:51:10 juju-e4d256-prod-github-runner-207 kernel: [30444.602954] vcpu_run+0x62/0x2c0 [kvm] Aug 22 13:51:10 juju-e4d256-prod-github-runner-207 kernel: [30444.603774] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 13:51:10 juju-e4d256-prod-github-runner-207 kernel: [30444.604765] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 13:51:10 juju-e4d256-prod-github-runner-207 kernel: [30444.605655] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 13:51:10 juju-e4d256-prod-github-runner-207 kernel: [30444.606466] ? __seccomp_filter+0x4a/0x4a0 Aug 22 13:51:10 juju-e4d256-prod-github-runner-207 kernel: [30444.607226] ? __fget_files+0x86/0xc0 Aug 22 13:51:10 juju-e4d256-prod-github-runner-207 kernel: [30444.607932] __x64_sys_ioctl+0x95/0xd0 Aug 22 13:51:10 juju-e4d256-prod-github-runner-207 kernel: [30444.608636] do_syscall_64+0x5c/0xc0 Aug 22 13:51:10 juju-e4d256-prod-github-runner-207 kernel: [30444.609342] ? do_futex+0x162/0x1f0 Aug 22 13:51:10 juju-e4d256-prod-github-runner-207 kernel: [30444.610005] ? __x64_sys_futex+0x78/0x1e0 Aug 22 13:51:10 juju-e4d256-prod-github-runner-207 kernel: [30444.610800] ? __secure_computing+0xa9/0x120 Aug 22 13:51:10 juju-e4d256-prod-github-runner-207 kernel: [30444.611618] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 13:51:10 juju-e4d256-prod-github-runner-207 kernel: [30444.612385] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:51:10 juju-e4d256-prod-github-runner-207 kernel: [30444.613111] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:51:10 juju-e4d256-prod-github-runner-207 kernel: [30444.613857] ? do_syscall_64+0x69/0xc0 Aug 22 13:51:10 juju-e4d256-prod-github-runner-207 kernel: [30444.614504] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:51:10 juju-e4d256-prod-github-runner-207 kernel: [30444.615227] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:51:10 juju-e4d256-prod-github-runner-207 kernel: [30444.615933] ? do_syscall_64+0x69/0xc0 Aug 22 13:51:10 juju-e4d256-prod-github-runner-207 kernel: [30444.616560] ? do_syscall_64+0x69/0xc0 Aug 22 13:51:10 juju-e4d256-prod-github-runner-207 kernel: [30444.617185] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 13:51:10 juju-e4d256-prod-github-runner-207 kernel: [30444.617914] RIP: 0033:0x7faa5d0edaff Aug 22 13:51:10 juju-e4d256-prod-github-runner-207 kernel: [30444.618544] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 13:51:10 juju-e4d256-prod-github-runner-207 kernel: [30444.620578] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 13:51:10 juju-e4d256-prod-github-runner-207 kernel: [30444.621506] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 13:51:10 juju-e4d256-prod-github-runner-207 kernel: [30444.622396] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 13:51:10 juju-e4d256-prod-github-runner-207 kernel: [30444.623283] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 13:51:10 juju-e4d256-prod-github-runner-207 kernel: [30444.624169] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 13:51:10 juju-e4d256-prod-github-runner-207 kernel: [30444.625077] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 13:51:10 juju-e4d256-prod-github-runner-207 kernel: [30444.626020] Aug 22 13:51:38 juju-e4d256-prod-github-runner-207 kernel: [30472.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 28271s! [qemu-system-x86:6715] Aug 22 13:51:38 juju-e4d256-prod-github-runner-207 kernel: [30472.543211] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 13:51:38 juju-e4d256-prod-github-runner-207 kernel: [30472.543476] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 13:51:38 juju-e4d256-prod-github-runner-207 kernel: [30472.556077] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 13:51:38 juju-e4d256-prod-github-runner-207 kernel: [30472.557460] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 13:51:38 juju-e4d256-prod-github-runner-207 kernel: [30472.558752] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:51:38 juju-e4d256-prod-github-runner-207 kernel: [30472.559841] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 13:51:38 juju-e4d256-prod-github-runner-207 kernel: [30472.562598] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 13:51:38 juju-e4d256-prod-github-runner-207 kernel: [30472.563650] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 13:51:38 juju-e4d256-prod-github-runner-207 kernel: [30472.564833] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 13:51:38 juju-e4d256-prod-github-runner-207 kernel: [30472.566036] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 13:51:38 juju-e4d256-prod-github-runner-207 kernel: [30472.567244] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 13:51:38 juju-e4d256-prod-github-runner-207 kernel: [30472.568442] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 13:51:38 juju-e4d256-prod-github-runner-207 kernel: [30472.569653] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 13:51:38 juju-e4d256-prod-github-runner-207 kernel: [30472.570922] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 13:51:38 juju-e4d256-prod-github-runner-207 kernel: [30472.572046] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 13:51:38 juju-e4d256-prod-github-runner-207 kernel: [30472.573294] Call Trace: Aug 22 13:51:38 juju-e4d256-prod-github-runner-207 kernel: [30472.574235] Aug 22 13:51:38 juju-e4d256-prod-github-runner-207 kernel: [30472.575145] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:51:38 juju-e4d256-prod-github-runner-207 kernel: [30472.576190] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:51:38 juju-e4d256-prod-github-runner-207 kernel: [30472.577255] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:51:38 juju-e4d256-prod-github-runner-207 kernel: [30472.578396] ? show_regs.part.0+0x23/0x29 Aug 22 13:51:38 juju-e4d256-prod-github-runner-207 kernel: [30472.579404] ? show_regs.cold+0x8/0xd Aug 22 13:51:38 juju-e4d256-prod-github-runner-207 kernel: [30472.580385] ? watchdog_timer_fn+0x1be/0x220 Aug 22 13:51:38 juju-e4d256-prod-github-runner-207 kernel: [30472.581424] ? lockup_detector_update_enable+0x60/0x60 Aug 22 13:51:38 juju-e4d256-prod-github-runner-207 kernel: [30472.582508] ? __hrtimer_run_queues+0x107/0x230 Aug 22 13:51:38 juju-e4d256-prod-github-runner-207 kernel: [30472.583554] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 13:51:38 juju-e4d256-prod-github-runner-207 kernel: [30472.584590] ? hrtimer_interrupt+0x101/0x220 Aug 22 13:51:38 juju-e4d256-prod-github-runner-207 kernel: [30472.585661] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 13:51:38 juju-e4d256-prod-github-runner-207 kernel: [30472.586761] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 13:51:38 juju-e4d256-prod-github-runner-207 kernel: [30472.587853] Aug 22 13:51:38 juju-e4d256-prod-github-runner-207 kernel: [30472.588755] Aug 22 13:51:38 juju-e4d256-prod-github-runner-207 kernel: [30472.589625] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 13:51:38 juju-e4d256-prod-github-runner-207 kernel: [30472.590680] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:51:38 juju-e4d256-prod-github-runner-207 kernel: [30472.591738] ? _raw_spin_lock+0x22/0x30 Aug 22 13:51:38 juju-e4d256-prod-github-runner-207 kernel: [30472.592696] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:51:38 juju-e4d256-prod-github-runner-207 kernel: [30472.593743] direct_page_fault+0x206/0x310 [kvm] Aug 22 13:51:38 juju-e4d256-prod-github-runner-207 kernel: [30472.594779] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 13:51:38 juju-e4d256-prod-github-runner-207 kernel: [30472.595799] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 13:51:38 juju-e4d256-prod-github-runner-207 kernel: [30472.596815] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 13:51:38 juju-e4d256-prod-github-runner-207 kernel: [30472.597852] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 13:51:38 juju-e4d256-prod-github-runner-207 kernel: [30472.598841] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 13:51:38 juju-e4d256-prod-github-runner-207 kernel: [30472.599838] handle_exit+0x98/0x230 [kvm_amd] Aug 22 13:51:38 juju-e4d256-prod-github-runner-207 kernel: [30472.600745] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 13:51:38 juju-e4d256-prod-github-runner-207 kernel: [30472.601692] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 13:51:38 juju-e4d256-prod-github-runner-207 kernel: [30472.602641] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 13:51:38 juju-e4d256-prod-github-runner-207 kernel: [30472.603553] vcpu_run+0x62/0x2c0 [kvm] Aug 22 13:51:38 juju-e4d256-prod-github-runner-207 kernel: [30472.604383] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 13:51:38 juju-e4d256-prod-github-runner-207 kernel: [30472.605217] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 13:51:38 juju-e4d256-prod-github-runner-207 kernel: [30472.606089] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 13:51:38 juju-e4d256-prod-github-runner-207 kernel: [30472.606900] ? __seccomp_filter+0x4a/0x4a0 Aug 22 13:51:38 juju-e4d256-prod-github-runner-207 kernel: [30472.607659] ? __fget_files+0x86/0xc0 Aug 22 13:51:38 juju-e4d256-prod-github-runner-207 kernel: [30472.608390] __x64_sys_ioctl+0x95/0xd0 Aug 22 13:51:38 juju-e4d256-prod-github-runner-207 kernel: [30472.609128] do_syscall_64+0x5c/0xc0 Aug 22 13:51:38 juju-e4d256-prod-github-runner-207 kernel: [30472.609810] ? do_futex+0x162/0x1f0 Aug 22 13:51:38 juju-e4d256-prod-github-runner-207 kernel: [30472.610472] ? __x64_sys_futex+0x78/0x1e0 Aug 22 13:51:38 juju-e4d256-prod-github-runner-207 kernel: [30472.611159] ? __secure_computing+0xa9/0x120 Aug 22 13:51:38 juju-e4d256-prod-github-runner-207 kernel: [30472.611859] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 13:51:38 juju-e4d256-prod-github-runner-207 kernel: [30472.612635] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:51:38 juju-e4d256-prod-github-runner-207 kernel: [30472.613387] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:51:38 juju-e4d256-prod-github-runner-207 kernel: [30472.614142] ? do_syscall_64+0x69/0xc0 Aug 22 13:51:38 juju-e4d256-prod-github-runner-207 kernel: [30472.614800] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:51:38 juju-e4d256-prod-github-runner-207 kernel: [30472.615579] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:51:38 juju-e4d256-prod-github-runner-207 kernel: [30472.616302] ? do_syscall_64+0x69/0xc0 Aug 22 13:51:38 juju-e4d256-prod-github-runner-207 kernel: [30472.616931] ? do_syscall_64+0x69/0xc0 Aug 22 13:51:38 juju-e4d256-prod-github-runner-207 kernel: [30472.617571] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 13:51:38 juju-e4d256-prod-github-runner-207 kernel: [30472.618281] RIP: 0033:0x7faa5d0edaff Aug 22 13:51:38 juju-e4d256-prod-github-runner-207 kernel: [30472.618990] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 13:51:38 juju-e4d256-prod-github-runner-207 kernel: [30472.621032] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 13:51:38 juju-e4d256-prod-github-runner-207 kernel: [30472.621970] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 13:51:38 juju-e4d256-prod-github-runner-207 kernel: [30472.622869] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 13:51:38 juju-e4d256-prod-github-runner-207 kernel: [30472.623774] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 13:51:38 juju-e4d256-prod-github-runner-207 kernel: [30472.624660] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 13:51:38 juju-e4d256-prod-github-runner-207 kernel: [30472.625578] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 13:51:38 juju-e4d256-prod-github-runner-207 kernel: [30472.626467] Aug 22 13:52:06 juju-e4d256-prod-github-runner-207 kernel: [30500.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 28297s! [qemu-system-x86:6715] Aug 22 13:52:06 juju-e4d256-prod-github-runner-207 kernel: [30500.543821] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 13:52:06 juju-e4d256-prod-github-runner-207 kernel: [30500.543999] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 13:52:06 juju-e4d256-prod-github-runner-207 kernel: [30500.556095] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 13:52:06 juju-e4d256-prod-github-runner-207 kernel: [30500.557404] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 13:52:06 juju-e4d256-prod-github-runner-207 kernel: [30500.558781] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:52:06 juju-e4d256-prod-github-runner-207 kernel: [30500.560136] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 13:52:06 juju-e4d256-prod-github-runner-207 kernel: [30500.563472] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 13:52:06 juju-e4d256-prod-github-runner-207 kernel: [30500.564828] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 13:52:06 juju-e4d256-prod-github-runner-207 kernel: [30500.566381] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 13:52:06 juju-e4d256-prod-github-runner-207 kernel: [30500.567923] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 13:52:06 juju-e4d256-prod-github-runner-207 kernel: [30500.569431] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 13:52:06 juju-e4d256-prod-github-runner-207 kernel: [30500.570914] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 13:52:06 juju-e4d256-prod-github-runner-207 kernel: [30500.572464] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 13:52:06 juju-e4d256-prod-github-runner-207 kernel: [30500.580357] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 13:52:06 juju-e4d256-prod-github-runner-207 kernel: [30500.585162] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 13:52:06 juju-e4d256-prod-github-runner-207 kernel: [30500.588313] Call Trace: Aug 22 13:52:06 juju-e4d256-prod-github-runner-207 kernel: [30500.589267] Aug 22 13:52:06 juju-e4d256-prod-github-runner-207 kernel: [30500.590162] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:52:06 juju-e4d256-prod-github-runner-207 kernel: [30500.591203] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:52:06 juju-e4d256-prod-github-runner-207 kernel: [30500.592230] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:52:06 juju-e4d256-prod-github-runner-207 kernel: [30500.593317] ? show_regs.part.0+0x23/0x29 Aug 22 13:52:06 juju-e4d256-prod-github-runner-207 kernel: [30500.594331] ? show_regs.cold+0x8/0xd Aug 22 13:52:06 juju-e4d256-prod-github-runner-207 kernel: [30500.595311] ? watchdog_timer_fn+0x1be/0x220 Aug 22 13:52:06 juju-e4d256-prod-github-runner-207 kernel: [30500.596325] ? lockup_detector_update_enable+0x60/0x60 Aug 22 13:52:06 juju-e4d256-prod-github-runner-207 kernel: [30500.597407] ? __hrtimer_run_queues+0x107/0x230 Aug 22 13:52:06 juju-e4d256-prod-github-runner-207 kernel: [30500.598621] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 13:52:06 juju-e4d256-prod-github-runner-207 kernel: [30500.599673] ? hrtimer_interrupt+0x101/0x220 Aug 22 13:52:06 juju-e4d256-prod-github-runner-207 kernel: [30500.600719] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 13:52:06 juju-e4d256-prod-github-runner-207 kernel: [30500.601790] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 13:52:06 juju-e4d256-prod-github-runner-207 kernel: [30500.602837] Aug 22 13:52:06 juju-e4d256-prod-github-runner-207 kernel: [30500.603697] Aug 22 13:52:06 juju-e4d256-prod-github-runner-207 kernel: [30500.604544] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 13:52:06 juju-e4d256-prod-github-runner-207 kernel: [30500.605725] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:52:06 juju-e4d256-prod-github-runner-207 kernel: [30500.606777] ? _raw_spin_lock+0x22/0x30 Aug 22 13:52:06 juju-e4d256-prod-github-runner-207 kernel: [30500.607743] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:52:06 juju-e4d256-prod-github-runner-207 kernel: [30500.608782] direct_page_fault+0x206/0x310 [kvm] Aug 22 13:52:06 juju-e4d256-prod-github-runner-207 kernel: [30500.609828] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 13:52:06 juju-e4d256-prod-github-runner-207 kernel: [30500.610853] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 13:52:06 juju-e4d256-prod-github-runner-207 kernel: [30500.611854] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 13:52:06 juju-e4d256-prod-github-runner-207 kernel: [30500.612868] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 13:52:06 juju-e4d256-prod-github-runner-207 kernel: [30500.613816] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 13:52:06 juju-e4d256-prod-github-runner-207 kernel: [30500.614822] handle_exit+0x98/0x230 [kvm_amd] Aug 22 13:52:06 juju-e4d256-prod-github-runner-207 kernel: [30500.615727] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 13:52:06 juju-e4d256-prod-github-runner-207 kernel: [30500.616687] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 13:52:06 juju-e4d256-prod-github-runner-207 kernel: [30500.617656] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 13:52:06 juju-e4d256-prod-github-runner-207 kernel: [30500.618627] vcpu_run+0x62/0x2c0 [kvm] Aug 22 13:52:06 juju-e4d256-prod-github-runner-207 kernel: [30500.619442] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 13:52:06 juju-e4d256-prod-github-runner-207 kernel: [30500.620300] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 13:52:06 juju-e4d256-prod-github-runner-207 kernel: [30500.621166] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 13:52:06 juju-e4d256-prod-github-runner-207 kernel: [30500.621977] ? __seccomp_filter+0x4a/0x4a0 Aug 22 13:52:06 juju-e4d256-prod-github-runner-207 kernel: [30500.622722] ? __fget_files+0x86/0xc0 Aug 22 13:52:06 juju-e4d256-prod-github-runner-207 kernel: [30500.623431] __x64_sys_ioctl+0x95/0xd0 Aug 22 13:52:06 juju-e4d256-prod-github-runner-207 kernel: [30500.624123] do_syscall_64+0x5c/0xc0 Aug 22 13:52:06 juju-e4d256-prod-github-runner-207 kernel: [30500.624840] ? do_futex+0x162/0x1f0 Aug 22 13:52:06 juju-e4d256-prod-github-runner-207 kernel: [30500.625512] ? __x64_sys_futex+0x78/0x1e0 Aug 22 13:52:06 juju-e4d256-prod-github-runner-207 kernel: [30500.626195] ? __secure_computing+0xa9/0x120 Aug 22 13:52:06 juju-e4d256-prod-github-runner-207 kernel: [30500.626902] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 13:52:06 juju-e4d256-prod-github-runner-207 kernel: [30500.627675] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:52:06 juju-e4d256-prod-github-runner-207 kernel: [30500.628414] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:52:06 juju-e4d256-prod-github-runner-207 kernel: [30500.629167] ? do_syscall_64+0x69/0xc0 Aug 22 13:52:06 juju-e4d256-prod-github-runner-207 kernel: [30500.629829] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:52:06 juju-e4d256-prod-github-runner-207 kernel: [30500.630554] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:52:06 juju-e4d256-prod-github-runner-207 kernel: [30500.631348] ? do_syscall_64+0x69/0xc0 Aug 22 13:52:06 juju-e4d256-prod-github-runner-207 kernel: [30500.631999] ? do_syscall_64+0x69/0xc0 Aug 22 13:52:06 juju-e4d256-prod-github-runner-207 kernel: [30500.632652] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 13:52:06 juju-e4d256-prod-github-runner-207 kernel: [30500.633375] RIP: 0033:0x7faa5d0edaff Aug 22 13:52:06 juju-e4d256-prod-github-runner-207 kernel: [30500.634043] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 13:52:06 juju-e4d256-prod-github-runner-207 kernel: [30500.636093] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 13:52:06 juju-e4d256-prod-github-runner-207 kernel: [30500.637036] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 13:52:06 juju-e4d256-prod-github-runner-207 kernel: [30500.637938] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 13:52:06 juju-e4d256-prod-github-runner-207 kernel: [30500.638845] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 13:52:06 juju-e4d256-prod-github-runner-207 kernel: [30500.639763] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 13:52:06 juju-e4d256-prod-github-runner-207 kernel: [30500.640681] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 13:52:06 juju-e4d256-prod-github-runner-207 kernel: [30500.641580] Aug 22 13:52:34 juju-e4d256-prod-github-runner-207 kernel: [30528.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 28323s! [qemu-system-x86:6715] Aug 22 13:52:34 juju-e4d256-prod-github-runner-207 kernel: [30528.543096] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 13:52:34 juju-e4d256-prod-github-runner-207 kernel: [30528.543173] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 13:52:34 juju-e4d256-prod-github-runner-207 kernel: [30528.555318] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 13:52:34 juju-e4d256-prod-github-runner-207 kernel: [30528.556600] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 13:52:34 juju-e4d256-prod-github-runner-207 kernel: [30528.557825] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:52:34 juju-e4d256-prod-github-runner-207 kernel: [30528.558896] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 13:52:34 juju-e4d256-prod-github-runner-207 kernel: [30528.561464] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 13:52:34 juju-e4d256-prod-github-runner-207 kernel: [30528.562513] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 13:52:34 juju-e4d256-prod-github-runner-207 kernel: [30528.563671] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 13:52:34 juju-e4d256-prod-github-runner-207 kernel: [30528.564841] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 13:52:34 juju-e4d256-prod-github-runner-207 kernel: [30528.565997] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 13:52:34 juju-e4d256-prod-github-runner-207 kernel: [30528.567158] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 13:52:34 juju-e4d256-prod-github-runner-207 kernel: [30528.568331] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 13:52:34 juju-e4d256-prod-github-runner-207 kernel: [30528.569559] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 13:52:34 juju-e4d256-prod-github-runner-207 kernel: [30528.570654] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 13:52:34 juju-e4d256-prod-github-runner-207 kernel: [30528.571933] Call Trace: Aug 22 13:52:34 juju-e4d256-prod-github-runner-207 kernel: [30528.572861] Aug 22 13:52:34 juju-e4d256-prod-github-runner-207 kernel: [30528.573744] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:52:34 juju-e4d256-prod-github-runner-207 kernel: [30528.574774] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:52:34 juju-e4d256-prod-github-runner-207 kernel: [30528.575791] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:52:34 juju-e4d256-prod-github-runner-207 kernel: [30528.576888] ? show_regs.part.0+0x23/0x29 Aug 22 13:52:34 juju-e4d256-prod-github-runner-207 kernel: [30528.577891] ? show_regs.cold+0x8/0xd Aug 22 13:52:34 juju-e4d256-prod-github-runner-207 kernel: [30528.578929] ? watchdog_timer_fn+0x1be/0x220 Aug 22 13:52:34 juju-e4d256-prod-github-runner-207 kernel: [30528.579947] ? lockup_detector_update_enable+0x60/0x60 Aug 22 13:52:34 juju-e4d256-prod-github-runner-207 kernel: [30528.581017] ? __hrtimer_run_queues+0x107/0x230 Aug 22 13:52:34 juju-e4d256-prod-github-runner-207 kernel: [30528.582047] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 13:52:34 juju-e4d256-prod-github-runner-207 kernel: [30528.583109] ? hrtimer_interrupt+0x101/0x220 Aug 22 13:52:34 juju-e4d256-prod-github-runner-207 kernel: [30528.584123] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 13:52:34 juju-e4d256-prod-github-runner-207 kernel: [30528.585201] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 13:52:34 juju-e4d256-prod-github-runner-207 kernel: [30528.586250] Aug 22 13:52:34 juju-e4d256-prod-github-runner-207 kernel: [30528.587154] Aug 22 13:52:34 juju-e4d256-prod-github-runner-207 kernel: [30528.588003] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 13:52:34 juju-e4d256-prod-github-runner-207 kernel: [30528.589063] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:52:34 juju-e4d256-prod-github-runner-207 kernel: [30528.590102] ? _raw_spin_lock+0x22/0x30 Aug 22 13:52:34 juju-e4d256-prod-github-runner-207 kernel: [30528.591046] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:52:34 juju-e4d256-prod-github-runner-207 kernel: [30528.593835] direct_page_fault+0x206/0x310 [kvm] Aug 22 13:52:34 juju-e4d256-prod-github-runner-207 kernel: [30528.595418] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 13:52:34 juju-e4d256-prod-github-runner-207 kernel: [30528.596442] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 13:52:34 juju-e4d256-prod-github-runner-207 kernel: [30528.597443] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 13:52:34 juju-e4d256-prod-github-runner-207 kernel: [30528.598447] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 13:52:34 juju-e4d256-prod-github-runner-207 kernel: [30528.600512] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 13:52:34 juju-e4d256-prod-github-runner-207 kernel: [30528.604810] handle_exit+0x98/0x230 [kvm_amd] Aug 22 13:52:34 juju-e4d256-prod-github-runner-207 kernel: [30528.605711] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 13:52:34 juju-e4d256-prod-github-runner-207 kernel: [30528.606624] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 13:52:34 juju-e4d256-prod-github-runner-207 kernel: [30528.607554] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 13:52:34 juju-e4d256-prod-github-runner-207 kernel: [30528.608467] vcpu_run+0x62/0x2c0 [kvm] Aug 22 13:52:34 juju-e4d256-prod-github-runner-207 kernel: [30528.609275] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 13:52:34 juju-e4d256-prod-github-runner-207 kernel: [30528.610084] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 13:52:34 juju-e4d256-prod-github-runner-207 kernel: [30528.610949] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 13:52:34 juju-e4d256-prod-github-runner-207 kernel: [30528.611750] ? __seccomp_filter+0x4a/0x4a0 Aug 22 13:52:34 juju-e4d256-prod-github-runner-207 kernel: [30528.612506] ? __fget_files+0x86/0xc0 Aug 22 13:52:34 juju-e4d256-prod-github-runner-207 kernel: [30528.613209] __x64_sys_ioctl+0x95/0xd0 Aug 22 13:52:34 juju-e4d256-prod-github-runner-207 kernel: [30528.613900] do_syscall_64+0x5c/0xc0 Aug 22 13:52:34 juju-e4d256-prod-github-runner-207 kernel: [30528.614562] ? do_futex+0x162/0x1f0 Aug 22 13:52:34 juju-e4d256-prod-github-runner-207 kernel: [30528.615208] ? __x64_sys_futex+0x78/0x1e0 Aug 22 13:52:34 juju-e4d256-prod-github-runner-207 kernel: [30528.615879] ? __secure_computing+0xa9/0x120 Aug 22 13:52:34 juju-e4d256-prod-github-runner-207 kernel: [30528.616581] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 13:52:34 juju-e4d256-prod-github-runner-207 kernel: [30528.617352] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:52:34 juju-e4d256-prod-github-runner-207 kernel: [30528.618074] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:52:34 juju-e4d256-prod-github-runner-207 kernel: [30528.618795] ? do_syscall_64+0x69/0xc0 Aug 22 13:52:34 juju-e4d256-prod-github-runner-207 kernel: [30528.619439] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:52:34 juju-e4d256-prod-github-runner-207 kernel: [30528.620150] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:52:34 juju-e4d256-prod-github-runner-207 kernel: [30528.620906] ? do_syscall_64+0x69/0xc0 Aug 22 13:52:34 juju-e4d256-prod-github-runner-207 kernel: [30528.621560] ? do_syscall_64+0x69/0xc0 Aug 22 13:52:34 juju-e4d256-prod-github-runner-207 kernel: [30528.622184] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 13:52:34 juju-e4d256-prod-github-runner-207 kernel: [30528.622887] RIP: 0033:0x7faa5d0edaff Aug 22 13:52:34 juju-e4d256-prod-github-runner-207 kernel: [30528.623509] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 13:52:34 juju-e4d256-prod-github-runner-207 kernel: [30528.625501] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 13:52:34 juju-e4d256-prod-github-runner-207 kernel: [30528.626413] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 13:52:34 juju-e4d256-prod-github-runner-207 kernel: [30528.627298] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 13:52:34 juju-e4d256-prod-github-runner-207 kernel: [30528.628181] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 13:52:34 juju-e4d256-prod-github-runner-207 kernel: [30528.629087] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 13:52:34 juju-e4d256-prod-github-runner-207 kernel: [30528.629974] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 13:52:34 juju-e4d256-prod-github-runner-207 kernel: [30528.630866] Aug 22 13:53:02 juju-e4d256-prod-github-runner-207 kernel: [30556.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 28349s! [qemu-system-x86:6715] Aug 22 13:53:02 juju-e4d256-prod-github-runner-207 kernel: [30556.543159] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 13:53:02 juju-e4d256-prod-github-runner-207 kernel: [30556.543235] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 13:53:02 juju-e4d256-prod-github-runner-207 kernel: [30556.555410] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 13:53:02 juju-e4d256-prod-github-runner-207 kernel: [30556.556718] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 13:53:02 juju-e4d256-prod-github-runner-207 kernel: [30556.557985] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:53:02 juju-e4d256-prod-github-runner-207 kernel: [30556.559074] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 13:53:02 juju-e4d256-prod-github-runner-207 kernel: [30556.561689] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 13:53:02 juju-e4d256-prod-github-runner-207 kernel: [30556.562786] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 13:53:02 juju-e4d256-prod-github-runner-207 kernel: [30556.564002] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 13:53:02 juju-e4d256-prod-github-runner-207 kernel: [30556.565165] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 13:53:02 juju-e4d256-prod-github-runner-207 kernel: [30556.566336] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 13:53:02 juju-e4d256-prod-github-runner-207 kernel: [30556.567503] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 13:53:02 juju-e4d256-prod-github-runner-207 kernel: [30556.568690] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 13:53:02 juju-e4d256-prod-github-runner-207 kernel: [30556.569950] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 13:53:02 juju-e4d256-prod-github-runner-207 kernel: [30556.571057] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 13:53:02 juju-e4d256-prod-github-runner-207 kernel: [30556.572267] Call Trace: Aug 22 13:53:02 juju-e4d256-prod-github-runner-207 kernel: [30556.573187] Aug 22 13:53:02 juju-e4d256-prod-github-runner-207 kernel: [30556.574079] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:53:02 juju-e4d256-prod-github-runner-207 kernel: [30556.575184] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:53:02 juju-e4d256-prod-github-runner-207 kernel: [30556.576245] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:53:02 juju-e4d256-prod-github-runner-207 kernel: [30556.577332] ? show_regs.part.0+0x23/0x29 Aug 22 13:53:02 juju-e4d256-prod-github-runner-207 kernel: [30556.578338] ? show_regs.cold+0x8/0xd Aug 22 13:53:02 juju-e4d256-prod-github-runner-207 kernel: [30556.579335] ? watchdog_timer_fn+0x1be/0x220 Aug 22 13:53:02 juju-e4d256-prod-github-runner-207 kernel: [30556.580380] ? lockup_detector_update_enable+0x60/0x60 Aug 22 13:53:02 juju-e4d256-prod-github-runner-207 kernel: [30556.581472] ? __hrtimer_run_queues+0x107/0x230 Aug 22 13:53:02 juju-e4d256-prod-github-runner-207 kernel: [30556.582502] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 13:53:02 juju-e4d256-prod-github-runner-207 kernel: [30556.583554] ? hrtimer_interrupt+0x101/0x220 Aug 22 13:53:02 juju-e4d256-prod-github-runner-207 kernel: [30556.584621] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 13:53:02 juju-e4d256-prod-github-runner-207 kernel: [30556.585693] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 13:53:02 juju-e4d256-prod-github-runner-207 kernel: [30556.586739] Aug 22 13:53:02 juju-e4d256-prod-github-runner-207 kernel: [30556.587590] Aug 22 13:53:02 juju-e4d256-prod-github-runner-207 kernel: [30556.588452] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 13:53:02 juju-e4d256-prod-github-runner-207 kernel: [30556.589496] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:53:02 juju-e4d256-prod-github-runner-207 kernel: [30556.590568] ? _raw_spin_lock+0x22/0x30 Aug 22 13:53:02 juju-e4d256-prod-github-runner-207 kernel: [30556.591539] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:53:02 juju-e4d256-prod-github-runner-207 kernel: [30556.592602] direct_page_fault+0x206/0x310 [kvm] Aug 22 13:53:02 juju-e4d256-prod-github-runner-207 kernel: [30556.593650] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 13:53:02 juju-e4d256-prod-github-runner-207 kernel: [30556.594671] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 13:53:02 juju-e4d256-prod-github-runner-207 kernel: [30556.595696] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 13:53:02 juju-e4d256-prod-github-runner-207 kernel: [30556.596710] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 13:53:02 juju-e4d256-prod-github-runner-207 kernel: [30556.597674] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 13:53:02 juju-e4d256-prod-github-runner-207 kernel: [30556.598651] handle_exit+0x98/0x230 [kvm_amd] Aug 22 13:53:02 juju-e4d256-prod-github-runner-207 kernel: [30556.599566] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 13:53:02 juju-e4d256-prod-github-runner-207 kernel: [30556.600510] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 13:53:02 juju-e4d256-prod-github-runner-207 kernel: [30556.601459] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 13:53:02 juju-e4d256-prod-github-runner-207 kernel: [30556.602368] vcpu_run+0x62/0x2c0 [kvm] Aug 22 13:53:02 juju-e4d256-prod-github-runner-207 kernel: [30556.603179] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 13:53:02 juju-e4d256-prod-github-runner-207 kernel: [30556.604044] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 13:53:02 juju-e4d256-prod-github-runner-207 kernel: [30556.604905] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 13:53:02 juju-e4d256-prod-github-runner-207 kernel: [30556.605701] ? __seccomp_filter+0x4a/0x4a0 Aug 22 13:53:02 juju-e4d256-prod-github-runner-207 kernel: [30556.606465] ? __fget_files+0x86/0xc0 Aug 22 13:53:02 juju-e4d256-prod-github-runner-207 kernel: [30556.607173] __x64_sys_ioctl+0x95/0xd0 Aug 22 13:53:02 juju-e4d256-prod-github-runner-207 kernel: [30556.607871] do_syscall_64+0x5c/0xc0 Aug 22 13:53:02 juju-e4d256-prod-github-runner-207 kernel: [30556.608551] ? do_futex+0x162/0x1f0 Aug 22 13:53:02 juju-e4d256-prod-github-runner-207 kernel: [30556.609206] ? __x64_sys_futex+0x78/0x1e0 Aug 22 13:53:02 juju-e4d256-prod-github-runner-207 kernel: [30556.609879] ? __secure_computing+0xa9/0x120 Aug 22 13:53:02 juju-e4d256-prod-github-runner-207 kernel: [30556.610570] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 13:53:02 juju-e4d256-prod-github-runner-207 kernel: [30556.611330] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:53:02 juju-e4d256-prod-github-runner-207 kernel: [30556.612063] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:53:02 juju-e4d256-prod-github-runner-207 kernel: [30556.612780] ? do_syscall_64+0x69/0xc0 Aug 22 13:53:02 juju-e4d256-prod-github-runner-207 kernel: [30556.613425] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:53:02 juju-e4d256-prod-github-runner-207 kernel: [30556.614137] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:53:02 juju-e4d256-prod-github-runner-207 kernel: [30556.614849] ? do_syscall_64+0x69/0xc0 Aug 22 13:53:02 juju-e4d256-prod-github-runner-207 kernel: [30556.615491] ? do_syscall_64+0x69/0xc0 Aug 22 13:53:02 juju-e4d256-prod-github-runner-207 kernel: [30556.616127] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 13:53:02 juju-e4d256-prod-github-runner-207 kernel: [30556.616833] RIP: 0033:0x7faa5d0edaff Aug 22 13:53:02 juju-e4d256-prod-github-runner-207 kernel: [30556.617458] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 13:53:02 juju-e4d256-prod-github-runner-207 kernel: [30556.619440] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 13:53:02 juju-e4d256-prod-github-runner-207 kernel: [30556.620380] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 13:53:02 juju-e4d256-prod-github-runner-207 kernel: [30556.621313] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 13:53:02 juju-e4d256-prod-github-runner-207 kernel: [30556.622219] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 13:53:02 juju-e4d256-prod-github-runner-207 kernel: [30556.623127] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 13:53:02 juju-e4d256-prod-github-runner-207 kernel: [30556.624031] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 13:53:02 juju-e4d256-prod-github-runner-207 kernel: [30556.624923] Aug 22 13:53:30 juju-e4d256-prod-github-runner-207 kernel: [30584.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 28376s! [qemu-system-x86:6715] Aug 22 13:53:30 juju-e4d256-prod-github-runner-207 kernel: [30584.543835] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 13:53:30 juju-e4d256-prod-github-runner-207 kernel: [30584.544117] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 13:53:30 juju-e4d256-prod-github-runner-207 kernel: [30584.556294] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 13:53:30 juju-e4d256-prod-github-runner-207 kernel: [30584.557562] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 13:53:30 juju-e4d256-prod-github-runner-207 kernel: [30584.558780] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:53:30 juju-e4d256-prod-github-runner-207 kernel: [30584.559852] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 13:53:30 juju-e4d256-prod-github-runner-207 kernel: [30584.562498] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 13:53:30 juju-e4d256-prod-github-runner-207 kernel: [30584.563550] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 13:53:30 juju-e4d256-prod-github-runner-207 kernel: [30584.564725] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 13:53:30 juju-e4d256-prod-github-runner-207 kernel: [30584.565883] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 13:53:30 juju-e4d256-prod-github-runner-207 kernel: [30584.567048] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 13:53:30 juju-e4d256-prod-github-runner-207 kernel: [30584.568234] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 13:53:30 juju-e4d256-prod-github-runner-207 kernel: [30584.569398] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 13:53:30 juju-e4d256-prod-github-runner-207 kernel: [30584.570673] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 13:53:30 juju-e4d256-prod-github-runner-207 kernel: [30584.571819] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 13:53:30 juju-e4d256-prod-github-runner-207 kernel: [30584.573017] Call Trace: Aug 22 13:53:30 juju-e4d256-prod-github-runner-207 kernel: [30584.573929] Aug 22 13:53:30 juju-e4d256-prod-github-runner-207 kernel: [30584.574830] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:53:30 juju-e4d256-prod-github-runner-207 kernel: [30584.575876] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:53:30 juju-e4d256-prod-github-runner-207 kernel: [30584.576904] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:53:30 juju-e4d256-prod-github-runner-207 kernel: [30584.577999] ? show_regs.part.0+0x23/0x29 Aug 22 13:53:30 juju-e4d256-prod-github-runner-207 kernel: [30584.578996] ? show_regs.cold+0x8/0xd Aug 22 13:53:30 juju-e4d256-prod-github-runner-207 kernel: [30584.579986] ? watchdog_timer_fn+0x1be/0x220 Aug 22 13:53:30 juju-e4d256-prod-github-runner-207 kernel: [30584.581001] ? lockup_detector_update_enable+0x60/0x60 Aug 22 13:53:30 juju-e4d256-prod-github-runner-207 kernel: [30584.582094] ? __hrtimer_run_queues+0x107/0x230 Aug 22 13:53:30 juju-e4d256-prod-github-runner-207 kernel: [30584.583125] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 13:53:30 juju-e4d256-prod-github-runner-207 kernel: [30584.584163] ? hrtimer_interrupt+0x101/0x220 Aug 22 13:53:30 juju-e4d256-prod-github-runner-207 kernel: [30584.585182] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 13:53:30 juju-e4d256-prod-github-runner-207 kernel: [30584.586258] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 13:53:30 juju-e4d256-prod-github-runner-207 kernel: [30584.587315] Aug 22 13:53:30 juju-e4d256-prod-github-runner-207 kernel: [30584.588184] Aug 22 13:53:30 juju-e4d256-prod-github-runner-207 kernel: [30584.589022] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 13:53:30 juju-e4d256-prod-github-runner-207 kernel: [30584.590058] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:53:30 juju-e4d256-prod-github-runner-207 kernel: [30584.591098] ? _raw_spin_lock+0x22/0x30 Aug 22 13:53:30 juju-e4d256-prod-github-runner-207 kernel: [30584.592061] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:53:30 juju-e4d256-prod-github-runner-207 kernel: [30584.593111] direct_page_fault+0x206/0x310 [kvm] Aug 22 13:53:30 juju-e4d256-prod-github-runner-207 kernel: [30584.594142] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 13:53:30 juju-e4d256-prod-github-runner-207 kernel: [30584.595150] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 13:53:30 juju-e4d256-prod-github-runner-207 kernel: [30584.596165] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 13:53:30 juju-e4d256-prod-github-runner-207 kernel: [30584.597168] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 13:53:30 juju-e4d256-prod-github-runner-207 kernel: [30584.598124] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 13:53:30 juju-e4d256-prod-github-runner-207 kernel: [30584.599104] handle_exit+0x98/0x230 [kvm_amd] Aug 22 13:53:30 juju-e4d256-prod-github-runner-207 kernel: [30584.600013] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 13:53:30 juju-e4d256-prod-github-runner-207 kernel: [30584.600927] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 13:53:30 juju-e4d256-prod-github-runner-207 kernel: [30584.601855] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 13:53:30 juju-e4d256-prod-github-runner-207 kernel: [30584.602790] vcpu_run+0x62/0x2c0 [kvm] Aug 22 13:53:30 juju-e4d256-prod-github-runner-207 kernel: [30584.603606] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 13:53:30 juju-e4d256-prod-github-runner-207 kernel: [30584.604432] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 13:53:30 juju-e4d256-prod-github-runner-207 kernel: [30584.605301] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 13:53:30 juju-e4d256-prod-github-runner-207 kernel: [30584.606098] ? __seccomp_filter+0x4a/0x4a0 Aug 22 13:53:30 juju-e4d256-prod-github-runner-207 kernel: [30584.606842] ? __fget_files+0x86/0xc0 Aug 22 13:53:30 juju-e4d256-prod-github-runner-207 kernel: [30584.607542] __x64_sys_ioctl+0x95/0xd0 Aug 22 13:53:30 juju-e4d256-prod-github-runner-207 kernel: [30584.608261] do_syscall_64+0x5c/0xc0 Aug 22 13:53:30 juju-e4d256-prod-github-runner-207 kernel: [30584.609031] ? do_futex+0x162/0x1f0 Aug 22 13:53:30 juju-e4d256-prod-github-runner-207 kernel: [30584.609748] ? __x64_sys_futex+0x78/0x1e0 Aug 22 13:53:30 juju-e4d256-prod-github-runner-207 kernel: [30584.610557] ? __secure_computing+0xa9/0x120 Aug 22 13:53:30 juju-e4d256-prod-github-runner-207 kernel: [30584.611363] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 13:53:30 juju-e4d256-prod-github-runner-207 kernel: [30584.612425] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:53:30 juju-e4d256-prod-github-runner-207 kernel: [30584.613247] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:53:30 juju-e4d256-prod-github-runner-207 kernel: [30584.614088] ? do_syscall_64+0x69/0xc0 Aug 22 13:53:30 juju-e4d256-prod-github-runner-207 kernel: [30584.614875] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:53:30 juju-e4d256-prod-github-runner-207 kernel: [30584.615688] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:53:30 juju-e4d256-prod-github-runner-207 kernel: [30584.616482] ? do_syscall_64+0x69/0xc0 Aug 22 13:53:30 juju-e4d256-prod-github-runner-207 kernel: [30584.617181] ? do_syscall_64+0x69/0xc0 Aug 22 13:53:30 juju-e4d256-prod-github-runner-207 kernel: [30584.617878] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 13:53:30 juju-e4d256-prod-github-runner-207 kernel: [30584.618682] RIP: 0033:0x7faa5d0edaff Aug 22 13:53:30 juju-e4d256-prod-github-runner-207 kernel: [30584.619422] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 13:53:30 juju-e4d256-prod-github-runner-207 kernel: [30584.621785] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 13:53:30 juju-e4d256-prod-github-runner-207 kernel: [30584.622845] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 13:53:30 juju-e4d256-prod-github-runner-207 kernel: [30584.623883] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 13:53:30 juju-e4d256-prod-github-runner-207 kernel: [30584.624909] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 13:53:30 juju-e4d256-prod-github-runner-207 kernel: [30584.625980] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 13:53:30 juju-e4d256-prod-github-runner-207 kernel: [30584.627071] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 13:53:30 juju-e4d256-prod-github-runner-207 kernel: [30584.628115] Aug 22 13:53:45 juju-e4d256-prod-github-runner-207 kernel: [30599.228708] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 13:53:45 juju-e4d256-prod-github-runner-207 kernel: [30599.229685] rcu: 1-....: (7596713 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=3671202 Aug 22 13:53:45 juju-e4d256-prod-github-runner-207 kernel: [30599.230809] (t=7620507 jiffies g=23269 q=33828) Aug 22 13:53:45 juju-e4d256-prod-github-runner-207 kernel: [30599.231618] NMI backtrace for cpu 1 Aug 22 13:53:45 juju-e4d256-prod-github-runner-207 kernel: [30599.232360] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 13:53:45 juju-e4d256-prod-github-runner-207 kernel: [30599.233484] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 13:53:45 juju-e4d256-prod-github-runner-207 kernel: [30599.234549] Call Trace: Aug 22 13:53:45 juju-e4d256-prod-github-runner-207 kernel: [30599.235233] Aug 22 13:53:45 juju-e4d256-prod-github-runner-207 kernel: [30599.235893] show_stack+0x52/0x5c Aug 22 13:53:45 juju-e4d256-prod-github-runner-207 kernel: [30599.236619] dump_stack_lvl+0x4a/0x63 Aug 22 13:53:45 juju-e4d256-prod-github-runner-207 kernel: [30599.237396] dump_stack+0x10/0x16 Aug 22 13:53:45 juju-e4d256-prod-github-runner-207 kernel: [30599.238113] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 13:53:45 juju-e4d256-prod-github-runner-207 kernel: [30599.238892] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 13:53:45 juju-e4d256-prod-github-runner-207 kernel: [30599.239687] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 13:53:45 juju-e4d256-prod-github-runner-207 kernel: [30599.240506] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 13:53:45 juju-e4d256-prod-github-runner-207 kernel: [30599.241323] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 13:53:45 juju-e4d256-prod-github-runner-207 kernel: [30599.242128] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 13:53:45 juju-e4d256-prod-github-runner-207 kernel: [30599.243390] print_cpu_stall.cold+0x2f/0xe2 Aug 22 13:53:45 juju-e4d256-prod-github-runner-207 kernel: [30599.244744] ? timekeeping_update+0xf7/0x150 Aug 22 13:53:45 juju-e4d256-prod-github-runner-207 kernel: [30599.245875] check_cpu_stall+0x109/0x270 Aug 22 13:53:45 juju-e4d256-prod-github-runner-207 kernel: [30599.246628] rcu_sched_clock_irq+0x9a/0x250 Aug 22 13:53:45 juju-e4d256-prod-github-runner-207 kernel: [30599.247391] update_process_times+0x94/0xd0 Aug 22 13:53:45 juju-e4d256-prod-github-runner-207 kernel: [30599.248174] tick_sched_handle+0x29/0x70 Aug 22 13:53:45 juju-e4d256-prod-github-runner-207 kernel: [30599.248924] tick_sched_timer+0x8c/0xc0 Aug 22 13:53:45 juju-e4d256-prod-github-runner-207 kernel: [30599.249759] ? tick_nohz_handler+0xb0/0xb0 Aug 22 13:53:45 juju-e4d256-prod-github-runner-207 kernel: [30599.250668] __hrtimer_run_queues+0x107/0x230 Aug 22 13:53:45 juju-e4d256-prod-github-runner-207 kernel: [30599.251447] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 13:53:45 juju-e4d256-prod-github-runner-207 kernel: [30599.252239] hrtimer_interrupt+0x101/0x220 Aug 22 13:53:45 juju-e4d256-prod-github-runner-207 kernel: [30599.253002] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 13:53:45 juju-e4d256-prod-github-runner-207 kernel: [30599.253816] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 13:53:45 juju-e4d256-prod-github-runner-207 kernel: [30599.254618] Aug 22 13:53:45 juju-e4d256-prod-github-runner-207 kernel: [30599.255253] Aug 22 13:53:45 juju-e4d256-prod-github-runner-207 kernel: [30599.255897] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 13:53:45 juju-e4d256-prod-github-runner-207 kernel: [30599.256728] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:53:45 juju-e4d256-prod-github-runner-207 kernel: [30599.257630] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 13:53:45 juju-e4d256-prod-github-runner-207 kernel: [30599.259921] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 13:53:45 juju-e4d256-prod-github-runner-207 kernel: [30599.260798] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 13:53:45 juju-e4d256-prod-github-runner-207 kernel: [30599.261794] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 13:53:45 juju-e4d256-prod-github-runner-207 kernel: [30599.262808] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 13:53:45 juju-e4d256-prod-github-runner-207 kernel: [30599.263799] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 13:53:45 juju-e4d256-prod-github-runner-207 kernel: [30599.264758] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 13:53:45 juju-e4d256-prod-github-runner-207 kernel: [30599.265734] ? _raw_spin_lock+0x22/0x30 Aug 22 13:53:45 juju-e4d256-prod-github-runner-207 kernel: [30599.266500] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:53:45 juju-e4d256-prod-github-runner-207 kernel: [30599.267340] direct_page_fault+0x206/0x310 [kvm] Aug 22 13:53:45 juju-e4d256-prod-github-runner-207 kernel: [30599.268200] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 13:53:45 juju-e4d256-prod-github-runner-207 kernel: [30599.269053] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 13:53:45 juju-e4d256-prod-github-runner-207 kernel: [30599.269891] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 13:53:45 juju-e4d256-prod-github-runner-207 kernel: [30599.270707] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 13:53:45 juju-e4d256-prod-github-runner-207 kernel: [30599.271502] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 13:53:45 juju-e4d256-prod-github-runner-207 kernel: [30599.272326] handle_exit+0x98/0x230 [kvm_amd] Aug 22 13:53:45 juju-e4d256-prod-github-runner-207 kernel: [30599.273078] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 13:53:45 juju-e4d256-prod-github-runner-207 kernel: [30599.273868] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 13:53:45 juju-e4d256-prod-github-runner-207 kernel: [30599.274668] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 13:53:45 juju-e4d256-prod-github-runner-207 kernel: [30599.275466] vcpu_run+0x62/0x2c0 [kvm] Aug 22 13:53:45 juju-e4d256-prod-github-runner-207 kernel: [30599.276181] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 13:53:45 juju-e4d256-prod-github-runner-207 kernel: [30599.276913] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 13:53:45 juju-e4d256-prod-github-runner-207 kernel: [30599.277711] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 13:53:45 juju-e4d256-prod-github-runner-207 kernel: [30599.278474] ? __seccomp_filter+0x4a/0x4a0 Aug 22 13:53:45 juju-e4d256-prod-github-runner-207 kernel: [30599.279206] ? __fget_files+0x86/0xc0 Aug 22 13:53:45 juju-e4d256-prod-github-runner-207 kernel: [30599.279916] __x64_sys_ioctl+0x95/0xd0 Aug 22 13:53:45 juju-e4d256-prod-github-runner-207 kernel: [30599.280615] do_syscall_64+0x5c/0xc0 Aug 22 13:53:45 juju-e4d256-prod-github-runner-207 kernel: [30599.281295] ? do_futex+0x162/0x1f0 Aug 22 13:53:45 juju-e4d256-prod-github-runner-207 kernel: [30599.281966] ? __x64_sys_futex+0x78/0x1e0 Aug 22 13:53:45 juju-e4d256-prod-github-runner-207 kernel: [30599.282670] ? __secure_computing+0xa9/0x120 Aug 22 13:53:45 juju-e4d256-prod-github-runner-207 kernel: [30599.283397] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 13:53:45 juju-e4d256-prod-github-runner-207 kernel: [30599.284193] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:53:45 juju-e4d256-prod-github-runner-207 kernel: [30599.284951] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:53:45 juju-e4d256-prod-github-runner-207 kernel: [30599.285703] ? do_syscall_64+0x69/0xc0 Aug 22 13:53:45 juju-e4d256-prod-github-runner-207 kernel: [30599.286397] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:53:45 juju-e4d256-prod-github-runner-207 kernel: [30599.287169] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:53:45 juju-e4d256-prod-github-runner-207 kernel: [30599.287937] ? do_syscall_64+0x69/0xc0 Aug 22 13:53:45 juju-e4d256-prod-github-runner-207 kernel: [30599.288633] ? do_syscall_64+0x69/0xc0 Aug 22 13:53:45 juju-e4d256-prod-github-runner-207 kernel: [30599.289372] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 13:53:45 juju-e4d256-prod-github-runner-207 kernel: [30599.290154] RIP: 0033:0x7faa5d0edaff Aug 22 13:53:45 juju-e4d256-prod-github-runner-207 kernel: [30599.290842] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 13:53:45 juju-e4d256-prod-github-runner-207 kernel: [30599.292989] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 13:53:45 juju-e4d256-prod-github-runner-207 kernel: [30599.293957] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 13:53:45 juju-e4d256-prod-github-runner-207 kernel: [30599.294901] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 13:53:45 juju-e4d256-prod-github-runner-207 kernel: [30599.295865] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 13:53:45 juju-e4d256-prod-github-runner-207 kernel: [30599.296806] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 13:53:45 juju-e4d256-prod-github-runner-207 kernel: [30599.297731] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 13:53:45 juju-e4d256-prod-github-runner-207 kernel: [30599.298644] Aug 22 13:54:10 juju-e4d256-prod-github-runner-207 kernel: [30624.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 28413s! [qemu-system-x86:6715] Aug 22 13:54:10 juju-e4d256-prod-github-runner-207 kernel: [30624.543124] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 13:54:10 juju-e4d256-prod-github-runner-207 kernel: [30624.543219] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 13:54:10 juju-e4d256-prod-github-runner-207 kernel: [30624.555590] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 13:54:10 juju-e4d256-prod-github-runner-207 kernel: [30624.556860] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 13:54:10 juju-e4d256-prod-github-runner-207 kernel: [30624.558076] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:54:10 juju-e4d256-prod-github-runner-207 kernel: [30624.559135] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 13:54:10 juju-e4d256-prod-github-runner-207 kernel: [30624.561678] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 13:54:10 juju-e4d256-prod-github-runner-207 kernel: [30624.562718] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 13:54:10 juju-e4d256-prod-github-runner-207 kernel: [30624.563910] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 13:54:10 juju-e4d256-prod-github-runner-207 kernel: [30624.565072] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 13:54:10 juju-e4d256-prod-github-runner-207 kernel: [30624.566233] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 13:54:10 juju-e4d256-prod-github-runner-207 kernel: [30624.567407] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 13:54:10 juju-e4d256-prod-github-runner-207 kernel: [30624.568582] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 13:54:10 juju-e4d256-prod-github-runner-207 kernel: [30624.569816] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 13:54:10 juju-e4d256-prod-github-runner-207 kernel: [30624.570912] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 13:54:10 juju-e4d256-prod-github-runner-207 kernel: [30624.572142] Call Trace: Aug 22 13:54:10 juju-e4d256-prod-github-runner-207 kernel: [30624.573068] Aug 22 13:54:10 juju-e4d256-prod-github-runner-207 kernel: [30624.573953] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:54:10 juju-e4d256-prod-github-runner-207 kernel: [30624.575022] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:54:10 juju-e4d256-prod-github-runner-207 kernel: [30624.576111] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:54:10 juju-e4d256-prod-github-runner-207 kernel: [30624.577281] ? show_regs.part.0+0x23/0x29 Aug 22 13:54:10 juju-e4d256-prod-github-runner-207 kernel: [30624.578301] ? show_regs.cold+0x8/0xd Aug 22 13:54:10 juju-e4d256-prod-github-runner-207 kernel: [30624.579365] ? watchdog_timer_fn+0x1be/0x220 Aug 22 13:54:10 juju-e4d256-prod-github-runner-207 kernel: [30624.580402] ? lockup_detector_update_enable+0x60/0x60 Aug 22 13:54:10 juju-e4d256-prod-github-runner-207 kernel: [30624.581473] ? __hrtimer_run_queues+0x107/0x230 Aug 22 13:54:10 juju-e4d256-prod-github-runner-207 kernel: [30624.582500] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 13:54:10 juju-e4d256-prod-github-runner-207 kernel: [30624.583543] ? hrtimer_interrupt+0x101/0x220 Aug 22 13:54:10 juju-e4d256-prod-github-runner-207 kernel: [30624.584560] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 13:54:10 juju-e4d256-prod-github-runner-207 kernel: [30624.585632] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 13:54:10 juju-e4d256-prod-github-runner-207 kernel: [30624.586684] Aug 22 13:54:10 juju-e4d256-prod-github-runner-207 kernel: [30624.587547] Aug 22 13:54:10 juju-e4d256-prod-github-runner-207 kernel: [30624.588488] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 13:54:10 juju-e4d256-prod-github-runner-207 kernel: [30624.589557] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:54:10 juju-e4d256-prod-github-runner-207 kernel: [30624.590597] ? _raw_spin_lock+0x22/0x30 Aug 22 13:54:10 juju-e4d256-prod-github-runner-207 kernel: [30624.591569] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:54:10 juju-e4d256-prod-github-runner-207 kernel: [30624.592652] direct_page_fault+0x206/0x310 [kvm] Aug 22 13:54:10 juju-e4d256-prod-github-runner-207 kernel: [30624.593680] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 13:54:10 juju-e4d256-prod-github-runner-207 kernel: [30624.594689] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 13:54:10 juju-e4d256-prod-github-runner-207 kernel: [30624.595706] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 13:54:10 juju-e4d256-prod-github-runner-207 kernel: [30624.596719] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 13:54:10 juju-e4d256-prod-github-runner-207 kernel: [30624.597686] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 13:54:10 juju-e4d256-prod-github-runner-207 kernel: [30624.598729] handle_exit+0x98/0x230 [kvm_amd] Aug 22 13:54:10 juju-e4d256-prod-github-runner-207 kernel: [30624.599663] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 13:54:10 juju-e4d256-prod-github-runner-207 kernel: [30624.600578] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 13:54:10 juju-e4d256-prod-github-runner-207 kernel: [30624.601941] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 13:54:10 juju-e4d256-prod-github-runner-207 kernel: [30624.602852] vcpu_run+0x62/0x2c0 [kvm] Aug 22 13:54:10 juju-e4d256-prod-github-runner-207 kernel: [30624.603679] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 13:54:10 juju-e4d256-prod-github-runner-207 kernel: [30624.604491] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 13:54:10 juju-e4d256-prod-github-runner-207 kernel: [30624.605352] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 13:54:10 juju-e4d256-prod-github-runner-207 kernel: [30624.606149] ? __seccomp_filter+0x4a/0x4a0 Aug 22 13:54:10 juju-e4d256-prod-github-runner-207 kernel: [30624.606955] ? __fget_files+0x86/0xc0 Aug 22 13:54:10 juju-e4d256-prod-github-runner-207 kernel: [30624.607940] __x64_sys_ioctl+0x95/0xd0 Aug 22 13:54:10 juju-e4d256-prod-github-runner-207 kernel: [30624.608761] do_syscall_64+0x5c/0xc0 Aug 22 13:54:10 juju-e4d256-prod-github-runner-207 kernel: [30624.609489] ? do_futex+0x162/0x1f0 Aug 22 13:54:10 juju-e4d256-prod-github-runner-207 kernel: [30624.610147] ? __x64_sys_futex+0x78/0x1e0 Aug 22 13:54:10 juju-e4d256-prod-github-runner-207 kernel: [30624.610821] ? __secure_computing+0xa9/0x120 Aug 22 13:54:10 juju-e4d256-prod-github-runner-207 kernel: [30624.611537] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 13:54:10 juju-e4d256-prod-github-runner-207 kernel: [30624.612303] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:54:10 juju-e4d256-prod-github-runner-207 kernel: [30624.613025] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:54:10 juju-e4d256-prod-github-runner-207 kernel: [30624.613748] ? do_syscall_64+0x69/0xc0 Aug 22 13:54:10 juju-e4d256-prod-github-runner-207 kernel: [30624.614397] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:54:10 juju-e4d256-prod-github-runner-207 kernel: [30624.615102] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:54:10 juju-e4d256-prod-github-runner-207 kernel: [30624.615842] ? do_syscall_64+0x69/0xc0 Aug 22 13:54:10 juju-e4d256-prod-github-runner-207 kernel: [30624.616469] ? do_syscall_64+0x69/0xc0 Aug 22 13:54:10 juju-e4d256-prod-github-runner-207 kernel: [30624.617090] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 13:54:10 juju-e4d256-prod-github-runner-207 kernel: [30624.617800] RIP: 0033:0x7faa5d0edaff Aug 22 13:54:10 juju-e4d256-prod-github-runner-207 kernel: [30624.618424] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 13:54:10 juju-e4d256-prod-github-runner-207 kernel: [30624.620424] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 13:54:10 juju-e4d256-prod-github-runner-207 kernel: [30624.621333] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 13:54:10 juju-e4d256-prod-github-runner-207 kernel: [30624.622236] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 13:54:10 juju-e4d256-prod-github-runner-207 kernel: [30624.623129] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 13:54:10 juju-e4d256-prod-github-runner-207 kernel: [30624.624040] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 13:54:10 juju-e4d256-prod-github-runner-207 kernel: [30624.624944] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 13:54:10 juju-e4d256-prod-github-runner-207 kernel: [30624.625934] Aug 22 13:54:38 juju-e4d256-prod-github-runner-207 kernel: [30652.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 28439s! [qemu-system-x86:6715] Aug 22 13:54:38 juju-e4d256-prod-github-runner-207 kernel: [30652.543905] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 13:54:38 juju-e4d256-prod-github-runner-207 kernel: [30652.544232] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 13:54:38 juju-e4d256-prod-github-runner-207 kernel: [30652.556397] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 13:54:38 juju-e4d256-prod-github-runner-207 kernel: [30652.557667] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 13:54:38 juju-e4d256-prod-github-runner-207 kernel: [30652.558926] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:54:38 juju-e4d256-prod-github-runner-207 kernel: [30652.560048] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 13:54:38 juju-e4d256-prod-github-runner-207 kernel: [30652.562606] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 13:54:38 juju-e4d256-prod-github-runner-207 kernel: [30652.563666] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 13:54:38 juju-e4d256-prod-github-runner-207 kernel: [30652.564871] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 13:54:38 juju-e4d256-prod-github-runner-207 kernel: [30652.566065] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 13:54:38 juju-e4d256-prod-github-runner-207 kernel: [30652.567277] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 13:54:38 juju-e4d256-prod-github-runner-207 kernel: [30652.568445] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 13:54:38 juju-e4d256-prod-github-runner-207 kernel: [30652.569610] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 13:54:38 juju-e4d256-prod-github-runner-207 kernel: [30652.570858] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 13:54:38 juju-e4d256-prod-github-runner-207 kernel: [30652.571954] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 13:54:38 juju-e4d256-prod-github-runner-207 kernel: [30652.573145] Call Trace: Aug 22 13:54:38 juju-e4d256-prod-github-runner-207 kernel: [30652.574056] Aug 22 13:54:38 juju-e4d256-prod-github-runner-207 kernel: [30652.574968] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:54:38 juju-e4d256-prod-github-runner-207 kernel: [30652.575996] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:54:38 juju-e4d256-prod-github-runner-207 kernel: [30652.577021] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:54:38 juju-e4d256-prod-github-runner-207 kernel: [30652.578115] ? show_regs.part.0+0x23/0x29 Aug 22 13:54:38 juju-e4d256-prod-github-runner-207 kernel: [30652.579125] ? show_regs.cold+0x8/0xd Aug 22 13:54:38 juju-e4d256-prod-github-runner-207 kernel: [30652.580107] ? watchdog_timer_fn+0x1be/0x220 Aug 22 13:54:38 juju-e4d256-prod-github-runner-207 kernel: [30652.581115] ? lockup_detector_update_enable+0x60/0x60 Aug 22 13:54:38 juju-e4d256-prod-github-runner-207 kernel: [30652.582177] ? __hrtimer_run_queues+0x107/0x230 Aug 22 13:54:38 juju-e4d256-prod-github-runner-207 kernel: [30652.583237] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 13:54:38 juju-e4d256-prod-github-runner-207 kernel: [30652.584270] ? hrtimer_interrupt+0x101/0x220 Aug 22 13:54:38 juju-e4d256-prod-github-runner-207 kernel: [30652.585292] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 13:54:38 juju-e4d256-prod-github-runner-207 kernel: [30652.586362] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 13:54:38 juju-e4d256-prod-github-runner-207 kernel: [30652.587432] Aug 22 13:54:38 juju-e4d256-prod-github-runner-207 kernel: [30652.588293] Aug 22 13:54:38 juju-e4d256-prod-github-runner-207 kernel: [30652.589129] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 13:54:38 juju-e4d256-prod-github-runner-207 kernel: [30652.590163] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:54:38 juju-e4d256-prod-github-runner-207 kernel: [30652.591221] ? _raw_spin_lock+0x22/0x30 Aug 22 13:54:38 juju-e4d256-prod-github-runner-207 kernel: [30652.592169] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:54:38 juju-e4d256-prod-github-runner-207 kernel: [30652.593191] direct_page_fault+0x206/0x310 [kvm] Aug 22 13:54:38 juju-e4d256-prod-github-runner-207 kernel: [30652.594235] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 13:54:38 juju-e4d256-prod-github-runner-207 kernel: [30652.595291] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 13:54:38 juju-e4d256-prod-github-runner-207 kernel: [30652.596299] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 13:54:38 juju-e4d256-prod-github-runner-207 kernel: [30652.597374] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 13:54:38 juju-e4d256-prod-github-runner-207 kernel: [30652.598322] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 13:54:38 juju-e4d256-prod-github-runner-207 kernel: [30652.599350] handle_exit+0x98/0x230 [kvm_amd] Aug 22 13:54:38 juju-e4d256-prod-github-runner-207 kernel: [30652.600264] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 13:54:38 juju-e4d256-prod-github-runner-207 kernel: [30652.601182] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 13:54:38 juju-e4d256-prod-github-runner-207 kernel: [30652.602107] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 13:54:38 juju-e4d256-prod-github-runner-207 kernel: [30652.603025] vcpu_run+0x62/0x2c0 [kvm] Aug 22 13:54:38 juju-e4d256-prod-github-runner-207 kernel: [30652.603857] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 13:54:38 juju-e4d256-prod-github-runner-207 kernel: [30652.604669] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 13:54:38 juju-e4d256-prod-github-runner-207 kernel: [30652.605550] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 13:54:38 juju-e4d256-prod-github-runner-207 kernel: [30652.606352] ? __seccomp_filter+0x4a/0x4a0 Aug 22 13:54:38 juju-e4d256-prod-github-runner-207 kernel: [30652.607129] ? __fget_files+0x86/0xc0 Aug 22 13:54:38 juju-e4d256-prod-github-runner-207 kernel: [30652.607838] __x64_sys_ioctl+0x95/0xd0 Aug 22 13:54:38 juju-e4d256-prod-github-runner-207 kernel: [30652.608532] do_syscall_64+0x5c/0xc0 Aug 22 13:54:38 juju-e4d256-prod-github-runner-207 kernel: [30652.609207] ? do_futex+0x162/0x1f0 Aug 22 13:54:38 juju-e4d256-prod-github-runner-207 kernel: [30652.609857] ? __x64_sys_futex+0x78/0x1e0 Aug 22 13:54:38 juju-e4d256-prod-github-runner-207 kernel: [30652.610534] ? __secure_computing+0xa9/0x120 Aug 22 13:54:38 juju-e4d256-prod-github-runner-207 kernel: [30652.611247] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 13:54:38 juju-e4d256-prod-github-runner-207 kernel: [30652.612017] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:54:38 juju-e4d256-prod-github-runner-207 kernel: [30652.612740] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:54:38 juju-e4d256-prod-github-runner-207 kernel: [30652.613461] ? do_syscall_64+0x69/0xc0 Aug 22 13:54:38 juju-e4d256-prod-github-runner-207 kernel: [30652.614116] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:54:38 juju-e4d256-prod-github-runner-207 kernel: [30652.614833] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:54:38 juju-e4d256-prod-github-runner-207 kernel: [30652.615529] ? do_syscall_64+0x69/0xc0 Aug 22 13:54:38 juju-e4d256-prod-github-runner-207 kernel: [30652.616156] ? do_syscall_64+0x69/0xc0 Aug 22 13:54:38 juju-e4d256-prod-github-runner-207 kernel: [30652.616795] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 13:54:38 juju-e4d256-prod-github-runner-207 kernel: [30652.617514] RIP: 0033:0x7faa5d0edaff Aug 22 13:54:38 juju-e4d256-prod-github-runner-207 kernel: [30652.618174] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 13:54:38 juju-e4d256-prod-github-runner-207 kernel: [30652.620198] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 13:54:38 juju-e4d256-prod-github-runner-207 kernel: [30652.621115] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 13:54:38 juju-e4d256-prod-github-runner-207 kernel: [30652.622009] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 13:54:38 juju-e4d256-prod-github-runner-207 kernel: [30652.622920] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 13:54:38 juju-e4d256-prod-github-runner-207 kernel: [30652.623824] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 13:54:38 juju-e4d256-prod-github-runner-207 kernel: [30652.624716] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 13:54:38 juju-e4d256-prod-github-runner-207 kernel: [30652.625626] Aug 22 13:55:06 juju-e4d256-prod-github-runner-207 kernel: [30680.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 28465s! [qemu-system-x86:6715] Aug 22 13:55:06 juju-e4d256-prod-github-runner-207 kernel: [30680.543134] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 13:55:06 juju-e4d256-prod-github-runner-207 kernel: [30680.543210] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 13:55:06 juju-e4d256-prod-github-runner-207 kernel: [30680.555235] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 13:55:06 juju-e4d256-prod-github-runner-207 kernel: [30680.556513] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 13:55:06 juju-e4d256-prod-github-runner-207 kernel: [30680.557747] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:55:06 juju-e4d256-prod-github-runner-207 kernel: [30680.558829] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 13:55:06 juju-e4d256-prod-github-runner-207 kernel: [30680.561372] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 13:55:06 juju-e4d256-prod-github-runner-207 kernel: [30680.562417] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 13:55:06 juju-e4d256-prod-github-runner-207 kernel: [30680.563585] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 13:55:06 juju-e4d256-prod-github-runner-207 kernel: [30680.564741] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 13:55:06 juju-e4d256-prod-github-runner-207 kernel: [30680.565914] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 13:55:06 juju-e4d256-prod-github-runner-207 kernel: [30680.567084] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 13:55:06 juju-e4d256-prod-github-runner-207 kernel: [30680.568246] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 13:55:06 juju-e4d256-prod-github-runner-207 kernel: [30680.569480] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 13:55:06 juju-e4d256-prod-github-runner-207 kernel: [30680.570588] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 13:55:06 juju-e4d256-prod-github-runner-207 kernel: [30680.571782] Call Trace: Aug 22 13:55:06 juju-e4d256-prod-github-runner-207 kernel: [30680.572692] Aug 22 13:55:06 juju-e4d256-prod-github-runner-207 kernel: [30680.573574] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:55:06 juju-e4d256-prod-github-runner-207 kernel: [30680.574618] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:55:06 juju-e4d256-prod-github-runner-207 kernel: [30680.575696] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:55:06 juju-e4d256-prod-github-runner-207 kernel: [30680.576803] ? show_regs.part.0+0x23/0x29 Aug 22 13:55:06 juju-e4d256-prod-github-runner-207 kernel: [30680.577807] ? show_regs.cold+0x8/0xd Aug 22 13:55:06 juju-e4d256-prod-github-runner-207 kernel: [30680.578806] ? watchdog_timer_fn+0x1be/0x220 Aug 22 13:55:06 juju-e4d256-prod-github-runner-207 kernel: [30680.579813] ? lockup_detector_update_enable+0x60/0x60 Aug 22 13:55:06 juju-e4d256-prod-github-runner-207 kernel: [30680.580873] ? __hrtimer_run_queues+0x107/0x230 Aug 22 13:55:06 juju-e4d256-prod-github-runner-207 kernel: [30680.581899] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 13:55:06 juju-e4d256-prod-github-runner-207 kernel: [30680.582935] ? hrtimer_interrupt+0x101/0x220 Aug 22 13:55:06 juju-e4d256-prod-github-runner-207 kernel: [30680.583950] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 13:55:06 juju-e4d256-prod-github-runner-207 kernel: [30680.585016] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 13:55:06 juju-e4d256-prod-github-runner-207 kernel: [30680.586081] Aug 22 13:55:06 juju-e4d256-prod-github-runner-207 kernel: [30680.586961] Aug 22 13:55:06 juju-e4d256-prod-github-runner-207 kernel: [30680.587820] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 13:55:06 juju-e4d256-prod-github-runner-207 kernel: [30680.588894] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:55:06 juju-e4d256-prod-github-runner-207 kernel: [30680.589943] ? _raw_spin_lock+0x22/0x30 Aug 22 13:55:06 juju-e4d256-prod-github-runner-207 kernel: [30680.590903] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:55:06 juju-e4d256-prod-github-runner-207 kernel: [30680.591921] direct_page_fault+0x206/0x310 [kvm] Aug 22 13:55:06 juju-e4d256-prod-github-runner-207 kernel: [30680.592944] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 13:55:06 juju-e4d256-prod-github-runner-207 kernel: [30680.593961] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 13:55:06 juju-e4d256-prod-github-runner-207 kernel: [30680.594979] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 13:55:06 juju-e4d256-prod-github-runner-207 kernel: [30680.595948] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 13:55:06 juju-e4d256-prod-github-runner-207 kernel: [30680.596898] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 13:55:06 juju-e4d256-prod-github-runner-207 kernel: [30680.597879] handle_exit+0x98/0x230 [kvm_amd] Aug 22 13:55:06 juju-e4d256-prod-github-runner-207 kernel: [30680.598801] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 13:55:06 juju-e4d256-prod-github-runner-207 kernel: [30680.599721] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 13:55:06 juju-e4d256-prod-github-runner-207 kernel: [30680.600642] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 13:55:06 juju-e4d256-prod-github-runner-207 kernel: [30680.601545] vcpu_run+0x62/0x2c0 [kvm] Aug 22 13:55:06 juju-e4d256-prod-github-runner-207 kernel: [30680.602355] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 13:55:06 juju-e4d256-prod-github-runner-207 kernel: [30680.603172] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 13:55:06 juju-e4d256-prod-github-runner-207 kernel: [30680.604025] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 13:55:06 juju-e4d256-prod-github-runner-207 kernel: [30680.604819] ? __seccomp_filter+0x4a/0x4a0 Aug 22 13:55:06 juju-e4d256-prod-github-runner-207 kernel: [30680.605563] ? __fget_files+0x86/0xc0 Aug 22 13:55:06 juju-e4d256-prod-github-runner-207 kernel: [30680.606264] __x64_sys_ioctl+0x95/0xd0 Aug 22 13:55:06 juju-e4d256-prod-github-runner-207 kernel: [30680.606986] do_syscall_64+0x5c/0xc0 Aug 22 13:55:06 juju-e4d256-prod-github-runner-207 kernel: [30680.607650] ? do_futex+0x162/0x1f0 Aug 22 13:55:06 juju-e4d256-prod-github-runner-207 kernel: [30680.608299] ? __x64_sys_futex+0x78/0x1e0 Aug 22 13:55:06 juju-e4d256-prod-github-runner-207 kernel: [30680.608967] ? __secure_computing+0xa9/0x120 Aug 22 13:55:06 juju-e4d256-prod-github-runner-207 kernel: [30680.609651] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 13:55:06 juju-e4d256-prod-github-runner-207 kernel: [30680.610409] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:55:06 juju-e4d256-prod-github-runner-207 kernel: [30680.611152] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:55:06 juju-e4d256-prod-github-runner-207 kernel: [30680.611866] ? do_syscall_64+0x69/0xc0 Aug 22 13:55:06 juju-e4d256-prod-github-runner-207 kernel: [30680.612512] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:55:06 juju-e4d256-prod-github-runner-207 kernel: [30680.613217] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:55:06 juju-e4d256-prod-github-runner-207 kernel: [30680.613908] ? do_syscall_64+0x69/0xc0 Aug 22 13:55:06 juju-e4d256-prod-github-runner-207 kernel: [30680.614538] ? do_syscall_64+0x69/0xc0 Aug 22 13:55:06 juju-e4d256-prod-github-runner-207 kernel: [30680.615163] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 13:55:06 juju-e4d256-prod-github-runner-207 kernel: [30680.615864] RIP: 0033:0x7faa5d0edaff Aug 22 13:55:06 juju-e4d256-prod-github-runner-207 kernel: [30680.616485] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 13:55:06 juju-e4d256-prod-github-runner-207 kernel: [30680.618451] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 13:55:06 juju-e4d256-prod-github-runner-207 kernel: [30680.619365] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 13:55:06 juju-e4d256-prod-github-runner-207 kernel: [30680.620250] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 13:55:06 juju-e4d256-prod-github-runner-207 kernel: [30680.621140] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 13:55:06 juju-e4d256-prod-github-runner-207 kernel: [30680.622022] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 13:55:06 juju-e4d256-prod-github-runner-207 kernel: [30680.622916] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 13:55:06 juju-e4d256-prod-github-runner-207 kernel: [30680.623803] Aug 22 13:55:34 juju-e4d256-prod-github-runner-207 kernel: [30708.541981] watchdog: BUG: soft lockup - CPU#1 stuck for 28491s! [qemu-system-x86:6715] Aug 22 13:55:34 juju-e4d256-prod-github-runner-207 kernel: [30708.543117] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 13:55:34 juju-e4d256-prod-github-runner-207 kernel: [30708.543194] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 13:55:34 juju-e4d256-prod-github-runner-207 kernel: [30708.555248] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 13:55:34 juju-e4d256-prod-github-runner-207 kernel: [30708.556522] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 13:55:34 juju-e4d256-prod-github-runner-207 kernel: [30708.557841] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:55:34 juju-e4d256-prod-github-runner-207 kernel: [30708.558926] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 13:55:34 juju-e4d256-prod-github-runner-207 kernel: [30708.561492] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 13:55:34 juju-e4d256-prod-github-runner-207 kernel: [30708.562589] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 13:55:34 juju-e4d256-prod-github-runner-207 kernel: [30708.563773] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 13:55:34 juju-e4d256-prod-github-runner-207 kernel: [30708.564937] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 13:55:34 juju-e4d256-prod-github-runner-207 kernel: [30708.566313] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 13:55:34 juju-e4d256-prod-github-runner-207 kernel: [30708.567492] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 13:55:34 juju-e4d256-prod-github-runner-207 kernel: [30708.568674] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 13:55:34 juju-e4d256-prod-github-runner-207 kernel: [30708.569919] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 13:55:34 juju-e4d256-prod-github-runner-207 kernel: [30708.571040] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 13:55:34 juju-e4d256-prod-github-runner-207 kernel: [30708.572269] Call Trace: Aug 22 13:55:34 juju-e4d256-prod-github-runner-207 kernel: [30708.573184] Aug 22 13:55:34 juju-e4d256-prod-github-runner-207 kernel: [30708.574074] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:55:34 juju-e4d256-prod-github-runner-207 kernel: [30708.575225] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:55:34 juju-e4d256-prod-github-runner-207 kernel: [30708.576337] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:55:34 juju-e4d256-prod-github-runner-207 kernel: [30708.577529] ? show_regs.part.0+0x23/0x29 Aug 22 13:55:34 juju-e4d256-prod-github-runner-207 kernel: [30708.578648] ? show_regs.cold+0x8/0xd Aug 22 13:55:34 juju-e4d256-prod-github-runner-207 kernel: [30708.579710] ? watchdog_timer_fn+0x1be/0x220 Aug 22 13:55:34 juju-e4d256-prod-github-runner-207 kernel: [30708.580847] ? lockup_detector_update_enable+0x60/0x60 Aug 22 13:55:34 juju-e4d256-prod-github-runner-207 kernel: [30708.582012] ? __hrtimer_run_queues+0x107/0x230 Aug 22 13:55:34 juju-e4d256-prod-github-runner-207 kernel: [30708.583141] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 13:55:34 juju-e4d256-prod-github-runner-207 kernel: [30708.584245] ? hrtimer_interrupt+0x101/0x220 Aug 22 13:55:34 juju-e4d256-prod-github-runner-207 kernel: [30708.585342] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 13:55:34 juju-e4d256-prod-github-runner-207 kernel: [30708.586534] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 13:55:34 juju-e4d256-prod-github-runner-207 kernel: [30708.587674] Aug 22 13:55:34 juju-e4d256-prod-github-runner-207 kernel: [30708.588577] Aug 22 13:55:34 juju-e4d256-prod-github-runner-207 kernel: [30708.589462] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 13:55:34 juju-e4d256-prod-github-runner-207 kernel: [30708.590616] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:55:34 juju-e4d256-prod-github-runner-207 kernel: [30708.591763] ? _raw_spin_lock+0x22/0x30 Aug 22 13:55:34 juju-e4d256-prod-github-runner-207 kernel: [30708.592785] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:55:34 juju-e4d256-prod-github-runner-207 kernel: [30708.593891] direct_page_fault+0x206/0x310 [kvm] Aug 22 13:55:34 juju-e4d256-prod-github-runner-207 kernel: [30708.595025] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 13:55:34 juju-e4d256-prod-github-runner-207 kernel: [30708.596123] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 13:55:34 juju-e4d256-prod-github-runner-207 kernel: [30708.597209] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 13:55:34 juju-e4d256-prod-github-runner-207 kernel: [30708.598291] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 13:55:34 juju-e4d256-prod-github-runner-207 kernel: [30708.599344] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 13:55:34 juju-e4d256-prod-github-runner-207 kernel: [30708.600430] handle_exit+0x98/0x230 [kvm_amd] Aug 22 13:55:34 juju-e4d256-prod-github-runner-207 kernel: [30708.601412] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 13:55:34 juju-e4d256-prod-github-runner-207 kernel: [30708.602436] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 13:55:34 juju-e4d256-prod-github-runner-207 kernel: [30708.603462] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 13:55:34 juju-e4d256-prod-github-runner-207 kernel: [30708.604468] vcpu_run+0x62/0x2c0 [kvm] Aug 22 13:55:34 juju-e4d256-prod-github-runner-207 kernel: [30708.605351] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 13:55:34 juju-e4d256-prod-github-runner-207 kernel: [30708.606261] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 13:55:34 juju-e4d256-prod-github-runner-207 kernel: [30708.607236] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 13:55:34 juju-e4d256-prod-github-runner-207 kernel: [30708.608139] ? __seccomp_filter+0x4a/0x4a0 Aug 22 13:55:34 juju-e4d256-prod-github-runner-207 kernel: [30708.608959] ? __fget_files+0x86/0xc0 Aug 22 13:55:34 juju-e4d256-prod-github-runner-207 kernel: [30708.609744] __x64_sys_ioctl+0x95/0xd0 Aug 22 13:55:34 juju-e4d256-prod-github-runner-207 kernel: [30708.610531] do_syscall_64+0x5c/0xc0 Aug 22 13:55:34 juju-e4d256-prod-github-runner-207 kernel: [30708.611274] ? do_futex+0x162/0x1f0 Aug 22 13:55:34 juju-e4d256-prod-github-runner-207 kernel: [30708.612001] ? __x64_sys_futex+0x78/0x1e0 Aug 22 13:55:34 juju-e4d256-prod-github-runner-207 kernel: [30708.612752] ? __secure_computing+0xa9/0x120 Aug 22 13:55:34 juju-e4d256-prod-github-runner-207 kernel: [30708.613529] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 13:55:34 juju-e4d256-prod-github-runner-207 kernel: [30708.614409] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:55:34 juju-e4d256-prod-github-runner-207 kernel: [30708.615238] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:55:34 juju-e4d256-prod-github-runner-207 kernel: [30708.616057] ? do_syscall_64+0x69/0xc0 Aug 22 13:55:34 juju-e4d256-prod-github-runner-207 kernel: [30708.616781] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:55:34 juju-e4d256-prod-github-runner-207 kernel: [30708.617576] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:55:34 juju-e4d256-prod-github-runner-207 kernel: [30708.618381] ? do_syscall_64+0x69/0xc0 Aug 22 13:55:34 juju-e4d256-prod-github-runner-207 kernel: [30708.619089] ? do_syscall_64+0x69/0xc0 Aug 22 13:55:34 juju-e4d256-prod-github-runner-207 kernel: [30708.619784] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 13:55:34 juju-e4d256-prod-github-runner-207 kernel: [30708.620586] RIP: 0033:0x7faa5d0edaff Aug 22 13:55:34 juju-e4d256-prod-github-runner-207 kernel: [30708.621296] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 13:55:34 juju-e4d256-prod-github-runner-207 kernel: [30708.623619] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 13:55:34 juju-e4d256-prod-github-runner-207 kernel: [30708.624679] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 13:55:34 juju-e4d256-prod-github-runner-207 kernel: [30708.625704] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 13:55:34 juju-e4d256-prod-github-runner-207 kernel: [30708.626766] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 13:55:34 juju-e4d256-prod-github-runner-207 kernel: [30708.627783] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 13:55:34 juju-e4d256-prod-github-runner-207 kernel: [30708.628798] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 13:55:34 juju-e4d256-prod-github-runner-207 kernel: [30708.629818] Aug 22 13:56:02 juju-e4d256-prod-github-runner-207 kernel: [30736.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 28517s! [qemu-system-x86:6715] Aug 22 13:56:02 juju-e4d256-prod-github-runner-207 kernel: [30736.543136] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 13:56:02 juju-e4d256-prod-github-runner-207 kernel: [30736.543211] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 13:56:02 juju-e4d256-prod-github-runner-207 kernel: [30736.555990] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 13:56:02 juju-e4d256-prod-github-runner-207 kernel: [30736.557544] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 13:56:02 juju-e4d256-prod-github-runner-207 kernel: [30736.558833] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:56:02 juju-e4d256-prod-github-runner-207 kernel: [30736.559905] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 13:56:02 juju-e4d256-prod-github-runner-207 kernel: [30736.562506] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 13:56:02 juju-e4d256-prod-github-runner-207 kernel: [30736.563556] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 13:56:02 juju-e4d256-prod-github-runner-207 kernel: [30736.564734] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 13:56:02 juju-e4d256-prod-github-runner-207 kernel: [30736.565934] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 13:56:02 juju-e4d256-prod-github-runner-207 kernel: [30736.567111] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 13:56:02 juju-e4d256-prod-github-runner-207 kernel: [30736.568283] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 13:56:02 juju-e4d256-prod-github-runner-207 kernel: [30736.569489] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 13:56:02 juju-e4d256-prod-github-runner-207 kernel: [30736.570779] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 13:56:02 juju-e4d256-prod-github-runner-207 kernel: [30736.571890] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 13:56:02 juju-e4d256-prod-github-runner-207 kernel: [30736.573099] Call Trace: Aug 22 13:56:02 juju-e4d256-prod-github-runner-207 kernel: [30736.574034] Aug 22 13:56:02 juju-e4d256-prod-github-runner-207 kernel: [30736.574922] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:56:02 juju-e4d256-prod-github-runner-207 kernel: [30736.575960] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:56:02 juju-e4d256-prod-github-runner-207 kernel: [30736.577001] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:56:02 juju-e4d256-prod-github-runner-207 kernel: [30736.578108] ? show_regs.part.0+0x23/0x29 Aug 22 13:56:02 juju-e4d256-prod-github-runner-207 kernel: [30736.579112] ? show_regs.cold+0x8/0xd Aug 22 13:56:02 juju-e4d256-prod-github-runner-207 kernel: [30736.580106] ? watchdog_timer_fn+0x1be/0x220 Aug 22 13:56:02 juju-e4d256-prod-github-runner-207 kernel: [30736.581127] ? lockup_detector_update_enable+0x60/0x60 Aug 22 13:56:02 juju-e4d256-prod-github-runner-207 kernel: [30736.582215] ? __hrtimer_run_queues+0x107/0x230 Aug 22 13:56:02 juju-e4d256-prod-github-runner-207 kernel: [30736.583257] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 13:56:02 juju-e4d256-prod-github-runner-207 kernel: [30736.584290] ? hrtimer_interrupt+0x101/0x220 Aug 22 13:56:02 juju-e4d256-prod-github-runner-207 kernel: [30736.585314] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 13:56:02 juju-e4d256-prod-github-runner-207 kernel: [30736.586410] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 13:56:02 juju-e4d256-prod-github-runner-207 kernel: [30736.587464] Aug 22 13:56:02 juju-e4d256-prod-github-runner-207 kernel: [30736.588327] Aug 22 13:56:02 juju-e4d256-prod-github-runner-207 kernel: [30736.589190] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 13:56:02 juju-e4d256-prod-github-runner-207 kernel: [30736.590262] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:56:02 juju-e4d256-prod-github-runner-207 kernel: [30736.591318] ? _raw_spin_lock+0x22/0x30 Aug 22 13:56:02 juju-e4d256-prod-github-runner-207 kernel: [30736.592270] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:56:02 juju-e4d256-prod-github-runner-207 kernel: [30736.593306] direct_page_fault+0x206/0x310 [kvm] Aug 22 13:56:02 juju-e4d256-prod-github-runner-207 kernel: [30736.594350] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 13:56:02 juju-e4d256-prod-github-runner-207 kernel: [30736.595372] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 13:56:02 juju-e4d256-prod-github-runner-207 kernel: [30736.596385] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 13:56:02 juju-e4d256-prod-github-runner-207 kernel: [30736.597374] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 13:56:02 juju-e4d256-prod-github-runner-207 kernel: [30736.598384] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 13:56:02 juju-e4d256-prod-github-runner-207 kernel: [30736.599409] handle_exit+0x98/0x230 [kvm_amd] Aug 22 13:56:02 juju-e4d256-prod-github-runner-207 kernel: [30736.600322] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 13:56:02 juju-e4d256-prod-github-runner-207 kernel: [30736.601253] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 13:56:02 juju-e4d256-prod-github-runner-207 kernel: [30736.602217] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 13:56:02 juju-e4d256-prod-github-runner-207 kernel: [30736.603137] vcpu_run+0x62/0x2c0 [kvm] Aug 22 13:56:02 juju-e4d256-prod-github-runner-207 kernel: [30736.603960] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 13:56:02 juju-e4d256-prod-github-runner-207 kernel: [30736.604780] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 13:56:02 juju-e4d256-prod-github-runner-207 kernel: [30736.605651] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 13:56:02 juju-e4d256-prod-github-runner-207 kernel: [30736.606476] ? __seccomp_filter+0x4a/0x4a0 Aug 22 13:56:02 juju-e4d256-prod-github-runner-207 kernel: [30736.607231] ? __fget_files+0x86/0xc0 Aug 22 13:56:02 juju-e4d256-prod-github-runner-207 kernel: [30736.607940] __x64_sys_ioctl+0x95/0xd0 Aug 22 13:56:02 juju-e4d256-prod-github-runner-207 kernel: [30736.608640] do_syscall_64+0x5c/0xc0 Aug 22 13:56:02 juju-e4d256-prod-github-runner-207 kernel: [30736.609318] ? do_futex+0x162/0x1f0 Aug 22 13:56:02 juju-e4d256-prod-github-runner-207 kernel: [30736.609999] ? __x64_sys_futex+0x78/0x1e0 Aug 22 13:56:02 juju-e4d256-prod-github-runner-207 kernel: [30736.610687] ? __secure_computing+0xa9/0x120 Aug 22 13:56:02 juju-e4d256-prod-github-runner-207 kernel: [30736.611391] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 13:56:02 juju-e4d256-prod-github-runner-207 kernel: [30736.612165] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:56:02 juju-e4d256-prod-github-runner-207 kernel: [30736.612905] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:56:02 juju-e4d256-prod-github-runner-207 kernel: [30736.613636] ? do_syscall_64+0x69/0xc0 Aug 22 13:56:02 juju-e4d256-prod-github-runner-207 kernel: [30736.614307] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:56:02 juju-e4d256-prod-github-runner-207 kernel: [30736.615031] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:56:02 juju-e4d256-prod-github-runner-207 kernel: [30736.615740] ? do_syscall_64+0x69/0xc0 Aug 22 13:56:02 juju-e4d256-prod-github-runner-207 kernel: [30736.616376] ? do_syscall_64+0x69/0xc0 Aug 22 13:56:02 juju-e4d256-prod-github-runner-207 kernel: [30736.617009] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 13:56:02 juju-e4d256-prod-github-runner-207 kernel: [30736.617736] RIP: 0033:0x7faa5d0edaff Aug 22 13:56:02 juju-e4d256-prod-github-runner-207 kernel: [30736.618389] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 13:56:02 juju-e4d256-prod-github-runner-207 kernel: [30736.620485] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 13:56:02 juju-e4d256-prod-github-runner-207 kernel: [30736.621434] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 13:56:02 juju-e4d256-prod-github-runner-207 kernel: [30736.622381] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 13:56:02 juju-e4d256-prod-github-runner-207 kernel: [30736.623304] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 13:56:02 juju-e4d256-prod-github-runner-207 kernel: [30736.624207] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 13:56:02 juju-e4d256-prod-github-runner-207 kernel: [30736.625105] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 13:56:02 juju-e4d256-prod-github-runner-207 kernel: [30736.626035] Aug 22 13:56:30 juju-e4d256-prod-github-runner-207 kernel: [30764.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 28543s! [qemu-system-x86:6715] Aug 22 13:56:30 juju-e4d256-prod-github-runner-207 kernel: [30764.543888] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 13:56:30 juju-e4d256-prod-github-runner-207 kernel: [30764.544185] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 13:56:30 juju-e4d256-prod-github-runner-207 kernel: [30764.557070] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 13:56:30 juju-e4d256-prod-github-runner-207 kernel: [30764.558348] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 13:56:30 juju-e4d256-prod-github-runner-207 kernel: [30764.559565] RIP: 0010:native_queued_spin_lock_slowpath+0xc/0x40 Aug 22 13:56:30 juju-e4d256-prod-github-runner-207 kernel: [30764.560616] Code: fe ff ff eb af 4c 89 fe 48 c7 c7 20 99 e9 89 e8 ca 69 55 00 e9 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 <8b> 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 eb Aug 22 13:56:30 juju-e4d256-prod-github-runner-207 kernel: [30764.563176] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 13:56:30 juju-e4d256-prod-github-runner-207 kernel: [30764.564215] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 13:56:30 juju-e4d256-prod-github-runner-207 kernel: [30764.565386] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 13:56:30 juju-e4d256-prod-github-runner-207 kernel: [30764.566551] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 13:56:30 juju-e4d256-prod-github-runner-207 kernel: [30764.567707] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 13:56:30 juju-e4d256-prod-github-runner-207 kernel: [30764.568863] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 13:56:30 juju-e4d256-prod-github-runner-207 kernel: [30764.570042] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 13:56:30 juju-e4d256-prod-github-runner-207 kernel: [30764.571290] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 13:56:30 juju-e4d256-prod-github-runner-207 kernel: [30764.572384] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 13:56:30 juju-e4d256-prod-github-runner-207 kernel: [30764.573582] Call Trace: Aug 22 13:56:30 juju-e4d256-prod-github-runner-207 kernel: [30764.574499] Aug 22 13:56:30 juju-e4d256-prod-github-runner-207 kernel: [30764.575406] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:56:30 juju-e4d256-prod-github-runner-207 kernel: [30764.576446] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:56:30 juju-e4d256-prod-github-runner-207 kernel: [30764.577482] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:56:30 juju-e4d256-prod-github-runner-207 kernel: [30764.578584] ? show_regs.part.0+0x23/0x29 Aug 22 13:56:30 juju-e4d256-prod-github-runner-207 kernel: [30764.579581] ? show_regs.cold+0x8/0xd Aug 22 13:56:30 juju-e4d256-prod-github-runner-207 kernel: [30764.580574] ? watchdog_timer_fn+0x1be/0x220 Aug 22 13:56:30 juju-e4d256-prod-github-runner-207 kernel: [30764.581725] ? lockup_detector_update_enable+0x60/0x60 Aug 22 13:56:30 juju-e4d256-prod-github-runner-207 kernel: [30764.582919] ? __hrtimer_run_queues+0x107/0x230 Aug 22 13:56:30 juju-e4d256-prod-github-runner-207 kernel: [30764.584094] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 13:56:30 juju-e4d256-prod-github-runner-207 kernel: [30764.585221] ? hrtimer_interrupt+0x101/0x220 Aug 22 13:56:30 juju-e4d256-prod-github-runner-207 kernel: [30764.586330] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 13:56:30 juju-e4d256-prod-github-runner-207 kernel: [30764.587494] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 13:56:30 juju-e4d256-prod-github-runner-207 kernel: [30764.588633] Aug 22 13:56:30 juju-e4d256-prod-github-runner-207 kernel: [30764.589553] Aug 22 13:56:30 juju-e4d256-prod-github-runner-207 kernel: [30764.590443] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 13:56:30 juju-e4d256-prod-github-runner-207 kernel: [30764.591575] ? native_queued_spin_lock_slowpath+0xc/0x40 Aug 22 13:56:30 juju-e4d256-prod-github-runner-207 kernel: [30764.592706] ? _raw_spin_lock+0x22/0x30 Aug 22 13:56:30 juju-e4d256-prod-github-runner-207 kernel: [30764.593743] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:56:30 juju-e4d256-prod-github-runner-207 kernel: [30764.594851] direct_page_fault+0x206/0x310 [kvm] Aug 22 13:56:30 juju-e4d256-prod-github-runner-207 kernel: [30764.595981] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 13:56:30 juju-e4d256-prod-github-runner-207 kernel: [30764.597080] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 13:56:30 juju-e4d256-prod-github-runner-207 kernel: [30764.598186] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 13:56:30 juju-e4d256-prod-github-runner-207 kernel: [30764.599304] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 13:56:30 juju-e4d256-prod-github-runner-207 kernel: [30764.600403] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 13:56:30 juju-e4d256-prod-github-runner-207 kernel: [30764.601530] handle_exit+0x98/0x230 [kvm_amd] Aug 22 13:56:30 juju-e4d256-prod-github-runner-207 kernel: [30764.602555] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 13:56:30 juju-e4d256-prod-github-runner-207 kernel: [30764.603594] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 13:56:30 juju-e4d256-prod-github-runner-207 kernel: [30764.604626] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 13:56:30 juju-e4d256-prod-github-runner-207 kernel: [30764.605849] vcpu_run+0x62/0x2c0 [kvm] Aug 22 13:56:30 juju-e4d256-prod-github-runner-207 kernel: [30764.606796] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 13:56:30 juju-e4d256-prod-github-runner-207 kernel: [30764.607833] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 13:56:30 juju-e4d256-prod-github-runner-207 kernel: [30764.609279] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 13:56:30 juju-e4d256-prod-github-runner-207 kernel: [30764.610410] ? __seccomp_filter+0x4a/0x4a0 Aug 22 13:56:30 juju-e4d256-prod-github-runner-207 kernel: [30764.611326] ? __fget_files+0x86/0xc0 Aug 22 13:56:30 juju-e4d256-prod-github-runner-207 kernel: [30764.612072] __x64_sys_ioctl+0x95/0xd0 Aug 22 13:56:30 juju-e4d256-prod-github-runner-207 kernel: [30764.613298] do_syscall_64+0x5c/0xc0 Aug 22 13:56:30 juju-e4d256-prod-github-runner-207 kernel: [30764.614202] ? do_futex+0x162/0x1f0 Aug 22 13:56:30 juju-e4d256-prod-github-runner-207 kernel: [30764.614902] ? __x64_sys_futex+0x78/0x1e0 Aug 22 13:56:30 juju-e4d256-prod-github-runner-207 kernel: [30764.615701] ? __secure_computing+0xa9/0x120 Aug 22 13:56:30 juju-e4d256-prod-github-runner-207 kernel: [30764.616459] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 13:56:30 juju-e4d256-prod-github-runner-207 kernel: [30764.617237] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:56:30 juju-e4d256-prod-github-runner-207 kernel: [30764.617974] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:56:30 juju-e4d256-prod-github-runner-207 kernel: [30764.618691] ? do_syscall_64+0x69/0xc0 Aug 22 13:56:30 juju-e4d256-prod-github-runner-207 kernel: [30764.619366] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:56:30 juju-e4d256-prod-github-runner-207 kernel: [30764.620082] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:56:30 juju-e4d256-prod-github-runner-207 kernel: [30764.620810] ? do_syscall_64+0x69/0xc0 Aug 22 13:56:30 juju-e4d256-prod-github-runner-207 kernel: [30764.621435] ? do_syscall_64+0x69/0xc0 Aug 22 13:56:30 juju-e4d256-prod-github-runner-207 kernel: [30764.622086] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 13:56:30 juju-e4d256-prod-github-runner-207 kernel: [30764.622791] RIP: 0033:0x7faa5d0edaff Aug 22 13:56:30 juju-e4d256-prod-github-runner-207 kernel: [30764.623457] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 13:56:30 juju-e4d256-prod-github-runner-207 kernel: [30764.625488] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 13:56:30 juju-e4d256-prod-github-runner-207 kernel: [30764.626408] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 13:56:30 juju-e4d256-prod-github-runner-207 kernel: [30764.627296] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 13:56:30 juju-e4d256-prod-github-runner-207 kernel: [30764.628188] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 13:56:30 juju-e4d256-prod-github-runner-207 kernel: [30764.629071] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 13:56:30 juju-e4d256-prod-github-runner-207 kernel: [30764.629987] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 13:56:30 juju-e4d256-prod-github-runner-207 kernel: [30764.630881] Aug 22 13:56:45 juju-e4d256-prod-github-runner-207 kernel: [30779.240705] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 13:56:45 juju-e4d256-prod-github-runner-207 kernel: [30779.241702] rcu: 1-....: (7641579 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=3692814 Aug 22 13:56:45 juju-e4d256-prod-github-runner-207 kernel: [30779.242819] (t=7665510 jiffies g=23269 q=33940) Aug 22 13:56:45 juju-e4d256-prod-github-runner-207 kernel: [30779.243607] NMI backtrace for cpu 1 Aug 22 13:56:45 juju-e4d256-prod-github-runner-207 kernel: [30779.244317] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 13:56:45 juju-e4d256-prod-github-runner-207 kernel: [30779.245430] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 13:56:45 juju-e4d256-prod-github-runner-207 kernel: [30779.246522] Call Trace: Aug 22 13:56:45 juju-e4d256-prod-github-runner-207 kernel: [30779.247203] Aug 22 13:56:45 juju-e4d256-prod-github-runner-207 kernel: [30779.247850] show_stack+0x52/0x5c Aug 22 13:56:45 juju-e4d256-prod-github-runner-207 kernel: [30779.248577] dump_stack_lvl+0x4a/0x63 Aug 22 13:56:45 juju-e4d256-prod-github-runner-207 kernel: [30779.249341] dump_stack+0x10/0x16 Aug 22 13:56:45 juju-e4d256-prod-github-runner-207 kernel: [30779.250059] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 13:56:45 juju-e4d256-prod-github-runner-207 kernel: [30779.250840] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 13:56:45 juju-e4d256-prod-github-runner-207 kernel: [30779.251618] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 13:56:45 juju-e4d256-prod-github-runner-207 kernel: [30779.252439] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 13:56:45 juju-e4d256-prod-github-runner-207 kernel: [30779.253258] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 13:56:45 juju-e4d256-prod-github-runner-207 kernel: [30779.254076] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 13:56:45 juju-e4d256-prod-github-runner-207 kernel: [30779.254851] print_cpu_stall.cold+0x2f/0xe2 Aug 22 13:56:45 juju-e4d256-prod-github-runner-207 kernel: [30779.255619] ? timekeeping_update+0xf7/0x150 Aug 22 13:56:45 juju-e4d256-prod-github-runner-207 kernel: [30779.256423] check_cpu_stall+0x109/0x270 Aug 22 13:56:45 juju-e4d256-prod-github-runner-207 kernel: [30779.257171] rcu_sched_clock_irq+0x9a/0x250 Aug 22 13:56:45 juju-e4d256-prod-github-runner-207 kernel: [30779.257939] update_process_times+0x94/0xd0 Aug 22 13:56:45 juju-e4d256-prod-github-runner-207 kernel: [30779.258699] tick_sched_handle+0x29/0x70 Aug 22 13:56:45 juju-e4d256-prod-github-runner-207 kernel: [30779.259447] tick_sched_timer+0x8c/0xc0 Aug 22 13:56:45 juju-e4d256-prod-github-runner-207 kernel: [30779.260182] ? tick_nohz_handler+0xb0/0xb0 Aug 22 13:56:45 juju-e4d256-prod-github-runner-207 kernel: [30779.260934] __hrtimer_run_queues+0x107/0x230 Aug 22 13:56:45 juju-e4d256-prod-github-runner-207 kernel: [30779.261719] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 13:56:45 juju-e4d256-prod-github-runner-207 kernel: [30779.262494] hrtimer_interrupt+0x101/0x220 Aug 22 13:56:45 juju-e4d256-prod-github-runner-207 kernel: [30779.263251] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 13:56:45 juju-e4d256-prod-github-runner-207 kernel: [30779.264062] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 13:56:45 juju-e4d256-prod-github-runner-207 kernel: [30779.264864] Aug 22 13:56:45 juju-e4d256-prod-github-runner-207 kernel: [30779.265509] Aug 22 13:56:45 juju-e4d256-prod-github-runner-207 kernel: [30779.266139] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 13:56:45 juju-e4d256-prod-github-runner-207 kernel: [30779.266955] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:56:45 juju-e4d256-prod-github-runner-207 kernel: [30779.267831] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 13:56:45 juju-e4d256-prod-github-runner-207 kernel: [30779.270038] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 13:56:45 juju-e4d256-prod-github-runner-207 kernel: [30779.270910] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 13:56:45 juju-e4d256-prod-github-runner-207 kernel: [30779.271909] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 13:56:45 juju-e4d256-prod-github-runner-207 kernel: [30779.272882] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 13:56:45 juju-e4d256-prod-github-runner-207 kernel: [30779.273850] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 13:56:45 juju-e4d256-prod-github-runner-207 kernel: [30779.274809] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 13:56:45 juju-e4d256-prod-github-runner-207 kernel: [30779.275759] ? _raw_spin_lock+0x22/0x30 Aug 22 13:56:45 juju-e4d256-prod-github-runner-207 kernel: [30779.276515] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:56:45 juju-e4d256-prod-github-runner-207 kernel: [30779.277360] direct_page_fault+0x206/0x310 [kvm] Aug 22 13:56:45 juju-e4d256-prod-github-runner-207 kernel: [30779.278201] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 13:56:45 juju-e4d256-prod-github-runner-207 kernel: [30779.279028] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 13:56:45 juju-e4d256-prod-github-runner-207 kernel: [30779.279855] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 13:56:45 juju-e4d256-prod-github-runner-207 kernel: [30779.280661] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 13:56:45 juju-e4d256-prod-github-runner-207 kernel: [30779.281460] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 13:56:45 juju-e4d256-prod-github-runner-207 kernel: [30779.282288] handle_exit+0x98/0x230 [kvm_amd] Aug 22 13:56:45 juju-e4d256-prod-github-runner-207 kernel: [30779.283040] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 13:56:45 juju-e4d256-prod-github-runner-207 kernel: [30779.283820] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 13:56:45 juju-e4d256-prod-github-runner-207 kernel: [30779.284622] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 13:56:45 juju-e4d256-prod-github-runner-207 kernel: [30779.285417] vcpu_run+0x62/0x2c0 [kvm] Aug 22 13:56:45 juju-e4d256-prod-github-runner-207 kernel: [30779.286132] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 13:56:45 juju-e4d256-prod-github-runner-207 kernel: [30779.286862] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 13:56:45 juju-e4d256-prod-github-runner-207 kernel: [30779.287665] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 13:56:45 juju-e4d256-prod-github-runner-207 kernel: [30779.288423] ? __seccomp_filter+0x4a/0x4a0 Aug 22 13:56:45 juju-e4d256-prod-github-runner-207 kernel: [30779.289139] ? __fget_files+0x86/0xc0 Aug 22 13:56:45 juju-e4d256-prod-github-runner-207 kernel: [30779.289837] __x64_sys_ioctl+0x95/0xd0 Aug 22 13:56:45 juju-e4d256-prod-github-runner-207 kernel: [30779.290535] do_syscall_64+0x5c/0xc0 Aug 22 13:56:45 juju-e4d256-prod-github-runner-207 kernel: [30779.291214] ? do_futex+0x162/0x1f0 Aug 22 13:56:45 juju-e4d256-prod-github-runner-207 kernel: [30779.291883] ? __x64_sys_futex+0x78/0x1e0 Aug 22 13:56:45 juju-e4d256-prod-github-runner-207 kernel: [30779.292580] ? __secure_computing+0xa9/0x120 Aug 22 13:56:45 juju-e4d256-prod-github-runner-207 kernel: [30779.293306] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 13:56:45 juju-e4d256-prod-github-runner-207 kernel: [30779.294094] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:56:45 juju-e4d256-prod-github-runner-207 kernel: [30779.294847] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:56:45 juju-e4d256-prod-github-runner-207 kernel: [30779.295598] ? do_syscall_64+0x69/0xc0 Aug 22 13:56:45 juju-e4d256-prod-github-runner-207 kernel: [30779.296286] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:56:45 juju-e4d256-prod-github-runner-207 kernel: [30779.297039] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:56:45 juju-e4d256-prod-github-runner-207 kernel: [30779.297802] ? do_syscall_64+0x69/0xc0 Aug 22 13:56:45 juju-e4d256-prod-github-runner-207 kernel: [30779.298493] ? do_syscall_64+0x69/0xc0 Aug 22 13:56:45 juju-e4d256-prod-github-runner-207 kernel: [30779.299179] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 13:56:45 juju-e4d256-prod-github-runner-207 kernel: [30779.299952] RIP: 0033:0x7faa5d0edaff Aug 22 13:56:45 juju-e4d256-prod-github-runner-207 kernel: [30779.300633] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 13:56:45 juju-e4d256-prod-github-runner-207 kernel: [30779.302745] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 13:56:45 juju-e4d256-prod-github-runner-207 kernel: [30779.303702] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 13:56:45 juju-e4d256-prod-github-runner-207 kernel: [30779.304651] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 13:56:45 juju-e4d256-prod-github-runner-207 kernel: [30779.305603] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 13:56:45 juju-e4d256-prod-github-runner-207 kernel: [30779.306549] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 13:56:45 juju-e4d256-prod-github-runner-207 kernel: [30779.307472] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 13:56:45 juju-e4d256-prod-github-runner-207 kernel: [30779.308384] Aug 22 13:57:10 juju-e4d256-prod-github-runner-207 kernel: [30804.541981] watchdog: BUG: soft lockup - CPU#1 stuck for 28580s! [qemu-system-x86:6715] Aug 22 13:57:10 juju-e4d256-prod-github-runner-207 kernel: [30804.543124] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 13:57:10 juju-e4d256-prod-github-runner-207 kernel: [30804.543196] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 13:57:10 juju-e4d256-prod-github-runner-207 kernel: [30804.555394] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 13:57:10 juju-e4d256-prod-github-runner-207 kernel: [30804.556683] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 13:57:10 juju-e4d256-prod-github-runner-207 kernel: [30804.557939] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:57:10 juju-e4d256-prod-github-runner-207 kernel: [30804.559016] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 13:57:10 juju-e4d256-prod-github-runner-207 kernel: [30804.561603] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 13:57:10 juju-e4d256-prod-github-runner-207 kernel: [30804.562669] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 13:57:10 juju-e4d256-prod-github-runner-207 kernel: [30804.563857] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 13:57:10 juju-e4d256-prod-github-runner-207 kernel: [30804.565061] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 13:57:10 juju-e4d256-prod-github-runner-207 kernel: [30804.566252] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 13:57:10 juju-e4d256-prod-github-runner-207 kernel: [30804.567447] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 13:57:10 juju-e4d256-prod-github-runner-207 kernel: [30804.568635] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 13:57:10 juju-e4d256-prod-github-runner-207 kernel: [30804.569905] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 13:57:10 juju-e4d256-prod-github-runner-207 kernel: [30804.571030] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 13:57:10 juju-e4d256-prod-github-runner-207 kernel: [30804.572491] Call Trace: Aug 22 13:57:10 juju-e4d256-prod-github-runner-207 kernel: [30804.573438] Aug 22 13:57:10 juju-e4d256-prod-github-runner-207 kernel: [30804.574379] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:57:10 juju-e4d256-prod-github-runner-207 kernel: [30804.575434] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:57:10 juju-e4d256-prod-github-runner-207 kernel: [30804.576466] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:57:10 juju-e4d256-prod-github-runner-207 kernel: [30804.577578] ? show_regs.part.0+0x23/0x29 Aug 22 13:57:10 juju-e4d256-prod-github-runner-207 kernel: [30804.578604] ? show_regs.cold+0x8/0xd Aug 22 13:57:10 juju-e4d256-prod-github-runner-207 kernel: [30804.579595] ? watchdog_timer_fn+0x1be/0x220 Aug 22 13:57:10 juju-e4d256-prod-github-runner-207 kernel: [30804.580625] ? lockup_detector_update_enable+0x60/0x60 Aug 22 13:57:10 juju-e4d256-prod-github-runner-207 kernel: [30804.581729] ? __hrtimer_run_queues+0x107/0x230 Aug 22 13:57:10 juju-e4d256-prod-github-runner-207 kernel: [30804.582784] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 13:57:10 juju-e4d256-prod-github-runner-207 kernel: [30804.583822] ? hrtimer_interrupt+0x101/0x220 Aug 22 13:57:10 juju-e4d256-prod-github-runner-207 kernel: [30804.584859] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 13:57:10 juju-e4d256-prod-github-runner-207 kernel: [30804.586095] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 13:57:10 juju-e4d256-prod-github-runner-207 kernel: [30804.587152] Aug 22 13:57:10 juju-e4d256-prod-github-runner-207 kernel: [30804.588019] Aug 22 13:57:10 juju-e4d256-prod-github-runner-207 kernel: [30804.588878] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 13:57:10 juju-e4d256-prod-github-runner-207 kernel: [30804.589959] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:57:10 juju-e4d256-prod-github-runner-207 kernel: [30804.591010] ? _raw_spin_lock+0x22/0x30 Aug 22 13:57:10 juju-e4d256-prod-github-runner-207 kernel: [30804.591993] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:57:10 juju-e4d256-prod-github-runner-207 kernel: [30804.593112] direct_page_fault+0x206/0x310 [kvm] Aug 22 13:57:10 juju-e4d256-prod-github-runner-207 kernel: [30804.594247] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 13:57:10 juju-e4d256-prod-github-runner-207 kernel: [30804.595306] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 13:57:10 juju-e4d256-prod-github-runner-207 kernel: [30804.596332] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 13:57:10 juju-e4d256-prod-github-runner-207 kernel: [30804.597353] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 13:57:10 juju-e4d256-prod-github-runner-207 kernel: [30804.598327] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 13:57:10 juju-e4d256-prod-github-runner-207 kernel: [30804.599329] handle_exit+0x98/0x230 [kvm_amd] Aug 22 13:57:10 juju-e4d256-prod-github-runner-207 kernel: [30804.600271] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 13:57:10 juju-e4d256-prod-github-runner-207 kernel: [30804.601226] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 13:57:10 juju-e4d256-prod-github-runner-207 kernel: [30804.602187] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 13:57:10 juju-e4d256-prod-github-runner-207 kernel: [30804.603560] vcpu_run+0x62/0x2c0 [kvm] Aug 22 13:57:10 juju-e4d256-prod-github-runner-207 kernel: [30804.604408] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 13:57:10 juju-e4d256-prod-github-runner-207 kernel: [30804.605309] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 13:57:10 juju-e4d256-prod-github-runner-207 kernel: [30804.606518] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 13:57:10 juju-e4d256-prod-github-runner-207 kernel: [30804.607341] ? __seccomp_filter+0x4a/0x4a0 Aug 22 13:57:10 juju-e4d256-prod-github-runner-207 kernel: [30804.608120] ? __fget_files+0x86/0xc0 Aug 22 13:57:10 juju-e4d256-prod-github-runner-207 kernel: [30804.608849] __x64_sys_ioctl+0x95/0xd0 Aug 22 13:57:10 juju-e4d256-prod-github-runner-207 kernel: [30804.609574] do_syscall_64+0x5c/0xc0 Aug 22 13:57:10 juju-e4d256-prod-github-runner-207 kernel: [30804.610277] ? do_futex+0x162/0x1f0 Aug 22 13:57:10 juju-e4d256-prod-github-runner-207 kernel: [30804.610939] ? __x64_sys_futex+0x78/0x1e0 Aug 22 13:57:10 juju-e4d256-prod-github-runner-207 kernel: [30804.611636] ? __secure_computing+0xa9/0x120 Aug 22 13:57:10 juju-e4d256-prod-github-runner-207 kernel: [30804.612356] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 13:57:10 juju-e4d256-prod-github-runner-207 kernel: [30804.613172] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:57:10 juju-e4d256-prod-github-runner-207 kernel: [30804.613912] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:57:10 juju-e4d256-prod-github-runner-207 kernel: [30804.614644] ? do_syscall_64+0x69/0xc0 Aug 22 13:57:10 juju-e4d256-prod-github-runner-207 kernel: [30804.615307] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:57:10 juju-e4d256-prod-github-runner-207 kernel: [30804.616020] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:57:10 juju-e4d256-prod-github-runner-207 kernel: [30804.616732] ? do_syscall_64+0x69/0xc0 Aug 22 13:57:10 juju-e4d256-prod-github-runner-207 kernel: [30804.617417] ? do_syscall_64+0x69/0xc0 Aug 22 13:57:10 juju-e4d256-prod-github-runner-207 kernel: [30804.618059] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 13:57:10 juju-e4d256-prod-github-runner-207 kernel: [30804.618775] RIP: 0033:0x7faa5d0edaff Aug 22 13:57:10 juju-e4d256-prod-github-runner-207 kernel: [30804.619412] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 13:57:10 juju-e4d256-prod-github-runner-207 kernel: [30804.621654] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 13:57:10 juju-e4d256-prod-github-runner-207 kernel: [30804.622622] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 13:57:10 juju-e4d256-prod-github-runner-207 kernel: [30804.623537] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 13:57:10 juju-e4d256-prod-github-runner-207 kernel: [30804.624428] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 13:57:10 juju-e4d256-prod-github-runner-207 kernel: [30804.625372] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 13:57:10 juju-e4d256-prod-github-runner-207 kernel: [30804.626291] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 13:57:10 juju-e4d256-prod-github-runner-207 kernel: [30804.627208] Aug 22 13:57:38 juju-e4d256-prod-github-runner-207 kernel: [30832.541980] watchdog: BUG: soft lockup - CPU#1 stuck for 28607s! [qemu-system-x86:6715] Aug 22 13:57:38 juju-e4d256-prod-github-runner-207 kernel: [30832.543235] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 13:57:38 juju-e4d256-prod-github-runner-207 kernel: [30832.543405] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 13:57:38 juju-e4d256-prod-github-runner-207 kernel: [30832.555801] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 13:57:38 juju-e4d256-prod-github-runner-207 kernel: [30832.557103] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 13:57:38 juju-e4d256-prod-github-runner-207 kernel: [30832.558348] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:57:38 juju-e4d256-prod-github-runner-207 kernel: [30832.559419] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 13:57:38 juju-e4d256-prod-github-runner-207 kernel: [30832.562181] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 13:57:38 juju-e4d256-prod-github-runner-207 kernel: [30832.563235] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 13:57:38 juju-e4d256-prod-github-runner-207 kernel: [30832.564413] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 13:57:38 juju-e4d256-prod-github-runner-207 kernel: [30832.565601] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 13:57:38 juju-e4d256-prod-github-runner-207 kernel: [30832.566792] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 13:57:38 juju-e4d256-prod-github-runner-207 kernel: [30832.567974] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 13:57:38 juju-e4d256-prod-github-runner-207 kernel: [30832.569180] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 13:57:38 juju-e4d256-prod-github-runner-207 kernel: [30832.570434] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 13:57:38 juju-e4d256-prod-github-runner-207 kernel: [30832.571547] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 13:57:38 juju-e4d256-prod-github-runner-207 kernel: [30832.572769] Call Trace: Aug 22 13:57:38 juju-e4d256-prod-github-runner-207 kernel: [30832.573688] Aug 22 13:57:38 juju-e4d256-prod-github-runner-207 kernel: [30832.574575] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:57:38 juju-e4d256-prod-github-runner-207 kernel: [30832.575617] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:57:38 juju-e4d256-prod-github-runner-207 kernel: [30832.576667] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:57:38 juju-e4d256-prod-github-runner-207 kernel: [30832.577792] ? show_regs.part.0+0x23/0x29 Aug 22 13:57:38 juju-e4d256-prod-github-runner-207 kernel: [30832.578805] ? show_regs.cold+0x8/0xd Aug 22 13:57:38 juju-e4d256-prod-github-runner-207 kernel: [30832.579785] ? watchdog_timer_fn+0x1be/0x220 Aug 22 13:57:38 juju-e4d256-prod-github-runner-207 kernel: [30832.580810] ? lockup_detector_update_enable+0x60/0x60 Aug 22 13:57:38 juju-e4d256-prod-github-runner-207 kernel: [30832.581896] ? __hrtimer_run_queues+0x107/0x230 Aug 22 13:57:38 juju-e4d256-prod-github-runner-207 kernel: [30832.582937] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 13:57:38 juju-e4d256-prod-github-runner-207 kernel: [30832.583973] ? hrtimer_interrupt+0x101/0x220 Aug 22 13:57:38 juju-e4d256-prod-github-runner-207 kernel: [30832.585009] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 13:57:38 juju-e4d256-prod-github-runner-207 kernel: [30832.586093] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 13:57:38 juju-e4d256-prod-github-runner-207 kernel: [30832.587153] Aug 22 13:57:38 juju-e4d256-prod-github-runner-207 kernel: [30832.588009] Aug 22 13:57:38 juju-e4d256-prod-github-runner-207 kernel: [30832.588873] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 13:57:38 juju-e4d256-prod-github-runner-207 kernel: [30832.589926] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:57:38 juju-e4d256-prod-github-runner-207 kernel: [30832.590982] ? _raw_spin_lock+0x22/0x30 Aug 22 13:57:38 juju-e4d256-prod-github-runner-207 kernel: [30832.591935] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:57:38 juju-e4d256-prod-github-runner-207 kernel: [30832.592975] direct_page_fault+0x206/0x310 [kvm] Aug 22 13:57:38 juju-e4d256-prod-github-runner-207 kernel: [30832.594011] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 13:57:38 juju-e4d256-prod-github-runner-207 kernel: [30832.595036] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 13:57:38 juju-e4d256-prod-github-runner-207 kernel: [30832.596050] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 13:57:38 juju-e4d256-prod-github-runner-207 kernel: [30832.597085] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 13:57:38 juju-e4d256-prod-github-runner-207 kernel: [30832.598056] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 13:57:38 juju-e4d256-prod-github-runner-207 kernel: [30832.599049] handle_exit+0x98/0x230 [kvm_amd] Aug 22 13:57:38 juju-e4d256-prod-github-runner-207 kernel: [30832.599953] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 13:57:38 juju-e4d256-prod-github-runner-207 kernel: [30832.600891] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 13:57:38 juju-e4d256-prod-github-runner-207 kernel: [30832.601831] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 13:57:38 juju-e4d256-prod-github-runner-207 kernel: [30832.602751] vcpu_run+0x62/0x2c0 [kvm] Aug 22 13:57:38 juju-e4d256-prod-github-runner-207 kernel: [30832.603572] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 13:57:38 juju-e4d256-prod-github-runner-207 kernel: [30832.604393] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 13:57:38 juju-e4d256-prod-github-runner-207 kernel: [30832.605272] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 13:57:38 juju-e4d256-prod-github-runner-207 kernel: [30832.606080] ? __seccomp_filter+0x4a/0x4a0 Aug 22 13:57:38 juju-e4d256-prod-github-runner-207 kernel: [30832.606833] ? __fget_files+0x86/0xc0 Aug 22 13:57:38 juju-e4d256-prod-github-runner-207 kernel: [30832.607545] __x64_sys_ioctl+0x95/0xd0 Aug 22 13:57:38 juju-e4d256-prod-github-runner-207 kernel: [30832.608254] do_syscall_64+0x5c/0xc0 Aug 22 13:57:38 juju-e4d256-prod-github-runner-207 kernel: [30832.608941] ? do_futex+0x162/0x1f0 Aug 22 13:57:38 juju-e4d256-prod-github-runner-207 kernel: [30832.609602] ? __x64_sys_futex+0x78/0x1e0 Aug 22 13:57:38 juju-e4d256-prod-github-runner-207 kernel: [30832.610288] ? __secure_computing+0xa9/0x120 Aug 22 13:57:38 juju-e4d256-prod-github-runner-207 kernel: [30832.610995] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 13:57:38 juju-e4d256-prod-github-runner-207 kernel: [30832.611770] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:57:38 juju-e4d256-prod-github-runner-207 kernel: [30832.612506] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:57:38 juju-e4d256-prod-github-runner-207 kernel: [30832.613240] ? do_syscall_64+0x69/0xc0 Aug 22 13:57:38 juju-e4d256-prod-github-runner-207 kernel: [30832.613897] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:57:38 juju-e4d256-prod-github-runner-207 kernel: [30832.614617] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:57:38 juju-e4d256-prod-github-runner-207 kernel: [30832.615323] ? do_syscall_64+0x69/0xc0 Aug 22 13:57:38 juju-e4d256-prod-github-runner-207 kernel: [30832.615956] ? do_syscall_64+0x69/0xc0 Aug 22 13:57:38 juju-e4d256-prod-github-runner-207 kernel: [30832.616588] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 13:57:38 juju-e4d256-prod-github-runner-207 kernel: [30832.617312] RIP: 0033:0x7faa5d0edaff Aug 22 13:57:38 juju-e4d256-prod-github-runner-207 kernel: [30832.617946] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 13:57:38 juju-e4d256-prod-github-runner-207 kernel: [30832.619989] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 13:57:38 juju-e4d256-prod-github-runner-207 kernel: [30832.620927] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 13:57:38 juju-e4d256-prod-github-runner-207 kernel: [30832.621836] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 13:57:38 juju-e4d256-prod-github-runner-207 kernel: [30832.622750] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 13:57:38 juju-e4d256-prod-github-runner-207 kernel: [30832.623658] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 13:57:38 juju-e4d256-prod-github-runner-207 kernel: [30832.624565] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 13:57:38 juju-e4d256-prod-github-runner-207 kernel: [30832.625484] Aug 22 13:58:06 juju-e4d256-prod-github-runner-207 kernel: [30860.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 28633s! [qemu-system-x86:6715] Aug 22 13:58:06 juju-e4d256-prod-github-runner-207 kernel: [30860.544078] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 13:58:06 juju-e4d256-prod-github-runner-207 kernel: [30860.544367] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 13:58:06 juju-e4d256-prod-github-runner-207 kernel: [30860.558255] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 13:58:06 juju-e4d256-prod-github-runner-207 kernel: [30860.559528] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 13:58:06 juju-e4d256-prod-github-runner-207 kernel: [30860.560770] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:58:06 juju-e4d256-prod-github-runner-207 kernel: [30860.561829] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 13:58:06 juju-e4d256-prod-github-runner-207 kernel: [30860.564393] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 13:58:06 juju-e4d256-prod-github-runner-207 kernel: [30860.565437] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 13:58:06 juju-e4d256-prod-github-runner-207 kernel: [30860.566611] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 13:58:06 juju-e4d256-prod-github-runner-207 kernel: [30860.567771] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 13:58:06 juju-e4d256-prod-github-runner-207 kernel: [30860.568953] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 13:58:06 juju-e4d256-prod-github-runner-207 kernel: [30860.570125] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 13:58:06 juju-e4d256-prod-github-runner-207 kernel: [30860.571297] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 13:58:06 juju-e4d256-prod-github-runner-207 kernel: [30860.572540] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 13:58:06 juju-e4d256-prod-github-runner-207 kernel: [30860.573651] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 13:58:06 juju-e4d256-prod-github-runner-207 kernel: [30860.574855] Call Trace: Aug 22 13:58:06 juju-e4d256-prod-github-runner-207 kernel: [30860.575774] Aug 22 13:58:06 juju-e4d256-prod-github-runner-207 kernel: [30860.576694] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:58:06 juju-e4d256-prod-github-runner-207 kernel: [30860.577730] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:58:06 juju-e4d256-prod-github-runner-207 kernel: [30860.578753] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:58:06 juju-e4d256-prod-github-runner-207 kernel: [30860.579831] ? show_regs.part.0+0x23/0x29 Aug 22 13:58:06 juju-e4d256-prod-github-runner-207 kernel: [30860.580850] ? show_regs.cold+0x8/0xd Aug 22 13:58:06 juju-e4d256-prod-github-runner-207 kernel: [30860.581820] ? watchdog_timer_fn+0x1be/0x220 Aug 22 13:58:06 juju-e4d256-prod-github-runner-207 kernel: [30860.582834] ? lockup_detector_update_enable+0x60/0x60 Aug 22 13:58:06 juju-e4d256-prod-github-runner-207 kernel: [30860.583897] ? __hrtimer_run_queues+0x107/0x230 Aug 22 13:58:06 juju-e4d256-prod-github-runner-207 kernel: [30860.584938] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 13:58:06 juju-e4d256-prod-github-runner-207 kernel: [30860.586015] ? hrtimer_interrupt+0x101/0x220 Aug 22 13:58:06 juju-e4d256-prod-github-runner-207 kernel: [30860.587044] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 13:58:06 juju-e4d256-prod-github-runner-207 kernel: [30860.588110] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 13:58:06 juju-e4d256-prod-github-runner-207 kernel: [30860.589193] Aug 22 13:58:06 juju-e4d256-prod-github-runner-207 kernel: [30860.590048] Aug 22 13:58:06 juju-e4d256-prod-github-runner-207 kernel: [30860.590885] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 13:58:06 juju-e4d256-prod-github-runner-207 kernel: [30860.591921] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:58:06 juju-e4d256-prod-github-runner-207 kernel: [30860.592974] ? _raw_spin_lock+0x22/0x30 Aug 22 13:58:06 juju-e4d256-prod-github-runner-207 kernel: [30860.593920] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:58:06 juju-e4d256-prod-github-runner-207 kernel: [30860.594943] direct_page_fault+0x206/0x310 [kvm] Aug 22 13:58:06 juju-e4d256-prod-github-runner-207 kernel: [30860.595967] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 13:58:06 juju-e4d256-prod-github-runner-207 kernel: [30860.596984] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 13:58:06 juju-e4d256-prod-github-runner-207 kernel: [30860.597985] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 13:58:06 juju-e4d256-prod-github-runner-207 kernel: [30860.598987] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 13:58:06 juju-e4d256-prod-github-runner-207 kernel: [30860.600003] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 13:58:06 juju-e4d256-prod-github-runner-207 kernel: [30860.601055] handle_exit+0x98/0x230 [kvm_amd] Aug 22 13:58:06 juju-e4d256-prod-github-runner-207 kernel: [30860.601975] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 13:58:06 juju-e4d256-prod-github-runner-207 kernel: [30860.602890] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 13:58:06 juju-e4d256-prod-github-runner-207 kernel: [30860.603824] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 13:58:06 juju-e4d256-prod-github-runner-207 kernel: [30860.604737] vcpu_run+0x62/0x2c0 [kvm] Aug 22 13:58:06 juju-e4d256-prod-github-runner-207 kernel: [30860.605550] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 13:58:06 juju-e4d256-prod-github-runner-207 kernel: [30860.606365] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 13:58:06 juju-e4d256-prod-github-runner-207 kernel: [30860.607220] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 13:58:06 juju-e4d256-prod-github-runner-207 kernel: [30860.608017] ? __seccomp_filter+0x4a/0x4a0 Aug 22 13:58:06 juju-e4d256-prod-github-runner-207 kernel: [30860.608771] ? __fget_files+0x86/0xc0 Aug 22 13:58:06 juju-e4d256-prod-github-runner-207 kernel: [30860.609478] __x64_sys_ioctl+0x95/0xd0 Aug 22 13:58:06 juju-e4d256-prod-github-runner-207 kernel: [30860.610176] do_syscall_64+0x5c/0xc0 Aug 22 13:58:06 juju-e4d256-prod-github-runner-207 kernel: [30860.610844] ? do_futex+0x162/0x1f0 Aug 22 13:58:06 juju-e4d256-prod-github-runner-207 kernel: [30860.611496] ? __x64_sys_futex+0x78/0x1e0 Aug 22 13:58:06 juju-e4d256-prod-github-runner-207 kernel: [30860.612178] ? __secure_computing+0xa9/0x120 Aug 22 13:58:06 juju-e4d256-prod-github-runner-207 kernel: [30860.612882] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 13:58:06 juju-e4d256-prod-github-runner-207 kernel: [30860.613645] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:58:06 juju-e4d256-prod-github-runner-207 kernel: [30860.614427] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:58:06 juju-e4d256-prod-github-runner-207 kernel: [30860.615148] ? do_syscall_64+0x69/0xc0 Aug 22 13:58:06 juju-e4d256-prod-github-runner-207 kernel: [30860.615792] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:58:06 juju-e4d256-prod-github-runner-207 kernel: [30860.616523] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:58:06 juju-e4d256-prod-github-runner-207 kernel: [30860.617230] ? do_syscall_64+0x69/0xc0 Aug 22 13:58:06 juju-e4d256-prod-github-runner-207 kernel: [30860.617857] ? do_syscall_64+0x69/0xc0 Aug 22 13:58:06 juju-e4d256-prod-github-runner-207 kernel: [30860.618480] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 13:58:06 juju-e4d256-prod-github-runner-207 kernel: [30860.619184] RIP: 0033:0x7faa5d0edaff Aug 22 13:58:06 juju-e4d256-prod-github-runner-207 kernel: [30860.619842] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 13:58:06 juju-e4d256-prod-github-runner-207 kernel: [30860.621843] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 13:58:06 juju-e4d256-prod-github-runner-207 kernel: [30860.622756] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 13:58:06 juju-e4d256-prod-github-runner-207 kernel: [30860.623645] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 13:58:06 juju-e4d256-prod-github-runner-207 kernel: [30860.624559] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 13:58:06 juju-e4d256-prod-github-runner-207 kernel: [30860.625465] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 13:58:06 juju-e4d256-prod-github-runner-207 kernel: [30860.626375] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 13:58:06 juju-e4d256-prod-github-runner-207 kernel: [30860.627346] Aug 22 13:58:34 juju-e4d256-prod-github-runner-207 kernel: [30888.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 28659s! [qemu-system-x86:6715] Aug 22 13:58:34 juju-e4d256-prod-github-runner-207 kernel: [30888.543093] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 13:58:34 juju-e4d256-prod-github-runner-207 kernel: [30888.543167] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 13:58:34 juju-e4d256-prod-github-runner-207 kernel: [30888.555268] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 13:58:34 juju-e4d256-prod-github-runner-207 kernel: [30888.556569] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 13:58:34 juju-e4d256-prod-github-runner-207 kernel: [30888.557795] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:58:34 juju-e4d256-prod-github-runner-207 kernel: [30888.558876] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 13:58:34 juju-e4d256-prod-github-runner-207 kernel: [30888.561461] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 13:58:34 juju-e4d256-prod-github-runner-207 kernel: [30888.562519] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 13:58:34 juju-e4d256-prod-github-runner-207 kernel: [30888.563736] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 13:58:34 juju-e4d256-prod-github-runner-207 kernel: [30888.564910] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 13:58:34 juju-e4d256-prod-github-runner-207 kernel: [30888.566074] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 13:58:34 juju-e4d256-prod-github-runner-207 kernel: [30888.567240] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 13:58:34 juju-e4d256-prod-github-runner-207 kernel: [30888.568496] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 13:58:34 juju-e4d256-prod-github-runner-207 kernel: [30888.569809] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 13:58:34 juju-e4d256-prod-github-runner-207 kernel: [30888.570913] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 13:58:34 juju-e4d256-prod-github-runner-207 kernel: [30888.572116] Call Trace: Aug 22 13:58:34 juju-e4d256-prod-github-runner-207 kernel: [30888.573028] Aug 22 13:58:34 juju-e4d256-prod-github-runner-207 kernel: [30888.573911] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:58:34 juju-e4d256-prod-github-runner-207 kernel: [30888.574951] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:58:34 juju-e4d256-prod-github-runner-207 kernel: [30888.575996] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:58:34 juju-e4d256-prod-github-runner-207 kernel: [30888.577075] ? show_regs.part.0+0x23/0x29 Aug 22 13:58:34 juju-e4d256-prod-github-runner-207 kernel: [30888.578069] ? show_regs.cold+0x8/0xd Aug 22 13:58:34 juju-e4d256-prod-github-runner-207 kernel: [30888.579037] ? watchdog_timer_fn+0x1be/0x220 Aug 22 13:58:34 juju-e4d256-prod-github-runner-207 kernel: [30888.580063] ? lockup_detector_update_enable+0x60/0x60 Aug 22 13:58:34 juju-e4d256-prod-github-runner-207 kernel: [30888.581124] ? __hrtimer_run_queues+0x107/0x230 Aug 22 13:58:34 juju-e4d256-prod-github-runner-207 kernel: [30888.582147] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 13:58:34 juju-e4d256-prod-github-runner-207 kernel: [30888.583227] ? hrtimer_interrupt+0x101/0x220 Aug 22 13:58:34 juju-e4d256-prod-github-runner-207 kernel: [30888.584292] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 13:58:34 juju-e4d256-prod-github-runner-207 kernel: [30888.585366] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 13:58:34 juju-e4d256-prod-github-runner-207 kernel: [30888.586411] Aug 22 13:58:34 juju-e4d256-prod-github-runner-207 kernel: [30888.587261] Aug 22 13:58:34 juju-e4d256-prod-github-runner-207 kernel: [30888.588106] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 13:58:34 juju-e4d256-prod-github-runner-207 kernel: [30888.589143] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:58:34 juju-e4d256-prod-github-runner-207 kernel: [30888.590185] ? _raw_spin_lock+0x22/0x30 Aug 22 13:58:34 juju-e4d256-prod-github-runner-207 kernel: [30888.591129] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:58:34 juju-e4d256-prod-github-runner-207 kernel: [30888.592174] direct_page_fault+0x206/0x310 [kvm] Aug 22 13:58:34 juju-e4d256-prod-github-runner-207 kernel: [30888.593227] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 13:58:34 juju-e4d256-prod-github-runner-207 kernel: [30888.594240] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 13:58:34 juju-e4d256-prod-github-runner-207 kernel: [30888.595258] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 13:58:34 juju-e4d256-prod-github-runner-207 kernel: [30888.596291] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 13:58:34 juju-e4d256-prod-github-runner-207 kernel: [30888.597242] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 13:58:34 juju-e4d256-prod-github-runner-207 kernel: [30888.598244] handle_exit+0x98/0x230 [kvm_amd] Aug 22 13:58:34 juju-e4d256-prod-github-runner-207 kernel: [30888.599281] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 13:58:34 juju-e4d256-prod-github-runner-207 kernel: [30888.600224] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 13:58:34 juju-e4d256-prod-github-runner-207 kernel: [30888.601193] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 13:58:34 juju-e4d256-prod-github-runner-207 kernel: [30888.602136] vcpu_run+0x62/0x2c0 [kvm] Aug 22 13:58:34 juju-e4d256-prod-github-runner-207 kernel: [30888.602962] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 13:58:34 juju-e4d256-prod-github-runner-207 kernel: [30888.603797] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 13:58:34 juju-e4d256-prod-github-runner-207 kernel: [30888.604687] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 13:58:34 juju-e4d256-prod-github-runner-207 kernel: [30888.605527] ? __seccomp_filter+0x4a/0x4a0 Aug 22 13:58:34 juju-e4d256-prod-github-runner-207 kernel: [30888.606366] ? __fget_files+0x86/0xc0 Aug 22 13:58:34 juju-e4d256-prod-github-runner-207 kernel: [30888.607115] __x64_sys_ioctl+0x95/0xd0 Aug 22 13:58:34 juju-e4d256-prod-github-runner-207 kernel: [30888.607836] do_syscall_64+0x5c/0xc0 Aug 22 13:58:34 juju-e4d256-prod-github-runner-207 kernel: [30888.608694] ? do_futex+0x162/0x1f0 Aug 22 13:58:34 juju-e4d256-prod-github-runner-207 kernel: [30888.609428] ? __x64_sys_futex+0x78/0x1e0 Aug 22 13:58:34 juju-e4d256-prod-github-runner-207 kernel: [30888.610104] ? __secure_computing+0xa9/0x120 Aug 22 13:58:34 juju-e4d256-prod-github-runner-207 kernel: [30888.610798] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 13:58:34 juju-e4d256-prod-github-runner-207 kernel: [30888.611559] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:58:34 juju-e4d256-prod-github-runner-207 kernel: [30888.612323] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:58:34 juju-e4d256-prod-github-runner-207 kernel: [30888.613044] ? do_syscall_64+0x69/0xc0 Aug 22 13:58:34 juju-e4d256-prod-github-runner-207 kernel: [30888.613691] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:58:34 juju-e4d256-prod-github-runner-207 kernel: [30888.614395] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:58:34 juju-e4d256-prod-github-runner-207 kernel: [30888.615091] ? do_syscall_64+0x69/0xc0 Aug 22 13:58:34 juju-e4d256-prod-github-runner-207 kernel: [30888.615723] ? do_syscall_64+0x69/0xc0 Aug 22 13:58:34 juju-e4d256-prod-github-runner-207 kernel: [30888.616362] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 13:58:34 juju-e4d256-prod-github-runner-207 kernel: [30888.617072] RIP: 0033:0x7faa5d0edaff Aug 22 13:58:34 juju-e4d256-prod-github-runner-207 kernel: [30888.617695] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 13:58:34 juju-e4d256-prod-github-runner-207 kernel: [30888.619684] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 13:58:34 juju-e4d256-prod-github-runner-207 kernel: [30888.620606] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 13:58:34 juju-e4d256-prod-github-runner-207 kernel: [30888.621498] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 13:58:34 juju-e4d256-prod-github-runner-207 kernel: [30888.622389] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 13:58:34 juju-e4d256-prod-github-runner-207 kernel: [30888.623281] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 13:58:34 juju-e4d256-prod-github-runner-207 kernel: [30888.624187] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 13:58:34 juju-e4d256-prod-github-runner-207 kernel: [30888.625087] Aug 22 13:59:02 juju-e4d256-prod-github-runner-207 kernel: [30916.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 28685s! [qemu-system-x86:6715] Aug 22 13:59:02 juju-e4d256-prod-github-runner-207 kernel: [30916.543111] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 13:59:02 juju-e4d256-prod-github-runner-207 kernel: [30916.543187] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 13:59:02 juju-e4d256-prod-github-runner-207 kernel: [30916.555225] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 13:59:02 juju-e4d256-prod-github-runner-207 kernel: [30916.556502] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 13:59:02 juju-e4d256-prod-github-runner-207 kernel: [30916.557756] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:59:02 juju-e4d256-prod-github-runner-207 kernel: [30916.558936] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 13:59:02 juju-e4d256-prod-github-runner-207 kernel: [30916.561531] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 13:59:02 juju-e4d256-prod-github-runner-207 kernel: [30916.562579] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 13:59:02 juju-e4d256-prod-github-runner-207 kernel: [30916.563759] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 13:59:02 juju-e4d256-prod-github-runner-207 kernel: [30916.564916] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 13:59:02 juju-e4d256-prod-github-runner-207 kernel: [30916.566077] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 13:59:02 juju-e4d256-prod-github-runner-207 kernel: [30916.567256] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 13:59:02 juju-e4d256-prod-github-runner-207 kernel: [30916.568436] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 13:59:02 juju-e4d256-prod-github-runner-207 kernel: [30916.569670] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 13:59:02 juju-e4d256-prod-github-runner-207 kernel: [30916.570772] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 13:59:02 juju-e4d256-prod-github-runner-207 kernel: [30916.571983] Call Trace: Aug 22 13:59:02 juju-e4d256-prod-github-runner-207 kernel: [30916.572950] Aug 22 13:59:02 juju-e4d256-prod-github-runner-207 kernel: [30916.573844] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:59:02 juju-e4d256-prod-github-runner-207 kernel: [30916.574885] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:59:02 juju-e4d256-prod-github-runner-207 kernel: [30916.575923] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:59:02 juju-e4d256-prod-github-runner-207 kernel: [30916.576999] ? show_regs.part.0+0x23/0x29 Aug 22 13:59:02 juju-e4d256-prod-github-runner-207 kernel: [30916.577992] ? show_regs.cold+0x8/0xd Aug 22 13:59:02 juju-e4d256-prod-github-runner-207 kernel: [30916.578990] ? watchdog_timer_fn+0x1be/0x220 Aug 22 13:59:02 juju-e4d256-prod-github-runner-207 kernel: [30916.580021] ? lockup_detector_update_enable+0x60/0x60 Aug 22 13:59:02 juju-e4d256-prod-github-runner-207 kernel: [30916.581081] ? __hrtimer_run_queues+0x107/0x230 Aug 22 13:59:02 juju-e4d256-prod-github-runner-207 kernel: [30916.582105] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 13:59:02 juju-e4d256-prod-github-runner-207 kernel: [30916.583142] ? hrtimer_interrupt+0x101/0x220 Aug 22 13:59:02 juju-e4d256-prod-github-runner-207 kernel: [30916.584175] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 13:59:02 juju-e4d256-prod-github-runner-207 kernel: [30916.585239] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 13:59:02 juju-e4d256-prod-github-runner-207 kernel: [30916.586285] Aug 22 13:59:02 juju-e4d256-prod-github-runner-207 kernel: [30916.587136] Aug 22 13:59:02 juju-e4d256-prod-github-runner-207 kernel: [30916.587990] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 13:59:02 juju-e4d256-prod-github-runner-207 kernel: [30916.589047] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:59:02 juju-e4d256-prod-github-runner-207 kernel: [30916.590083] ? _raw_spin_lock+0x22/0x30 Aug 22 13:59:02 juju-e4d256-prod-github-runner-207 kernel: [30916.591039] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:59:02 juju-e4d256-prod-github-runner-207 kernel: [30916.592081] direct_page_fault+0x206/0x310 [kvm] Aug 22 13:59:02 juju-e4d256-prod-github-runner-207 kernel: [30916.593103] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 13:59:02 juju-e4d256-prod-github-runner-207 kernel: [30916.594126] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 13:59:02 juju-e4d256-prod-github-runner-207 kernel: [30916.595126] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 13:59:02 juju-e4d256-prod-github-runner-207 kernel: [30916.596104] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 13:59:02 juju-e4d256-prod-github-runner-207 kernel: [30916.597046] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 13:59:02 juju-e4d256-prod-github-runner-207 kernel: [30916.598054] handle_exit+0x98/0x230 [kvm_amd] Aug 22 13:59:02 juju-e4d256-prod-github-runner-207 kernel: [30916.598975] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 13:59:02 juju-e4d256-prod-github-runner-207 kernel: [30916.599912] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 13:59:02 juju-e4d256-prod-github-runner-207 kernel: [30916.600842] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 13:59:02 juju-e4d256-prod-github-runner-207 kernel: [30916.601754] vcpu_run+0x62/0x2c0 [kvm] Aug 22 13:59:02 juju-e4d256-prod-github-runner-207 kernel: [30916.602572] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 13:59:02 juju-e4d256-prod-github-runner-207 kernel: [30916.603375] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 13:59:02 juju-e4d256-prod-github-runner-207 kernel: [30916.604236] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 13:59:02 juju-e4d256-prod-github-runner-207 kernel: [30916.605028] ? __seccomp_filter+0x4a/0x4a0 Aug 22 13:59:02 juju-e4d256-prod-github-runner-207 kernel: [30916.605765] ? __fget_files+0x86/0xc0 Aug 22 13:59:02 juju-e4d256-prod-github-runner-207 kernel: [30916.606479] __x64_sys_ioctl+0x95/0xd0 Aug 22 13:59:02 juju-e4d256-prod-github-runner-207 kernel: [30916.607178] do_syscall_64+0x5c/0xc0 Aug 22 13:59:02 juju-e4d256-prod-github-runner-207 kernel: [30916.607858] ? do_futex+0x162/0x1f0 Aug 22 13:59:02 juju-e4d256-prod-github-runner-207 kernel: [30916.608503] ? __x64_sys_futex+0x78/0x1e0 Aug 22 13:59:02 juju-e4d256-prod-github-runner-207 kernel: [30916.609173] ? __secure_computing+0xa9/0x120 Aug 22 13:59:02 juju-e4d256-prod-github-runner-207 kernel: [30916.609858] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 13:59:02 juju-e4d256-prod-github-runner-207 kernel: [30916.610612] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:59:02 juju-e4d256-prod-github-runner-207 kernel: [30916.611331] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:59:02 juju-e4d256-prod-github-runner-207 kernel: [30916.612068] ? do_syscall_64+0x69/0xc0 Aug 22 13:59:02 juju-e4d256-prod-github-runner-207 kernel: [30916.612718] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:59:02 juju-e4d256-prod-github-runner-207 kernel: [30916.613415] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:59:02 juju-e4d256-prod-github-runner-207 kernel: [30916.614104] ? do_syscall_64+0x69/0xc0 Aug 22 13:59:02 juju-e4d256-prod-github-runner-207 kernel: [30916.614738] ? do_syscall_64+0x69/0xc0 Aug 22 13:59:02 juju-e4d256-prod-github-runner-207 kernel: [30916.615369] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 13:59:02 juju-e4d256-prod-github-runner-207 kernel: [30916.616088] RIP: 0033:0x7faa5d0edaff Aug 22 13:59:02 juju-e4d256-prod-github-runner-207 kernel: [30916.616718] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 13:59:02 juju-e4d256-prod-github-runner-207 kernel: [30916.618798] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 13:59:02 juju-e4d256-prod-github-runner-207 kernel: [30916.619734] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 13:59:02 juju-e4d256-prod-github-runner-207 kernel: [30916.620630] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 13:59:02 juju-e4d256-prod-github-runner-207 kernel: [30916.621669] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 13:59:02 juju-e4d256-prod-github-runner-207 kernel: [30916.622580] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 13:59:02 juju-e4d256-prod-github-runner-207 kernel: [30916.623487] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 13:59:02 juju-e4d256-prod-github-runner-207 kernel: [30916.624389] Aug 22 13:59:30 juju-e4d256-prod-github-runner-207 kernel: [30944.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 28711s! [qemu-system-x86:6715] Aug 22 13:59:30 juju-e4d256-prod-github-runner-207 kernel: [30944.543914] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 13:59:30 juju-e4d256-prod-github-runner-207 kernel: [30944.544223] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 13:59:30 juju-e4d256-prod-github-runner-207 kernel: [30944.556607] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 13:59:30 juju-e4d256-prod-github-runner-207 kernel: [30944.557875] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 13:59:30 juju-e4d256-prod-github-runner-207 kernel: [30944.559097] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:59:30 juju-e4d256-prod-github-runner-207 kernel: [30944.560174] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 13:59:30 juju-e4d256-prod-github-runner-207 kernel: [30944.562714] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 13:59:30 juju-e4d256-prod-github-runner-207 kernel: [30944.563776] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 13:59:30 juju-e4d256-prod-github-runner-207 kernel: [30944.564942] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 13:59:30 juju-e4d256-prod-github-runner-207 kernel: [30944.566100] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 13:59:30 juju-e4d256-prod-github-runner-207 kernel: [30944.567259] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 13:59:30 juju-e4d256-prod-github-runner-207 kernel: [30944.568434] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 13:59:30 juju-e4d256-prod-github-runner-207 kernel: [30944.569598] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 13:59:30 juju-e4d256-prod-github-runner-207 kernel: [30944.570829] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 13:59:30 juju-e4d256-prod-github-runner-207 kernel: [30944.571941] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 13:59:30 juju-e4d256-prod-github-runner-207 kernel: [30944.573173] Call Trace: Aug 22 13:59:30 juju-e4d256-prod-github-runner-207 kernel: [30944.574087] Aug 22 13:59:30 juju-e4d256-prod-github-runner-207 kernel: [30944.574987] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:59:30 juju-e4d256-prod-github-runner-207 kernel: [30944.576038] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 13:59:30 juju-e4d256-prod-github-runner-207 kernel: [30944.577060] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:59:30 juju-e4d256-prod-github-runner-207 kernel: [30944.578156] ? show_regs.part.0+0x23/0x29 Aug 22 13:59:30 juju-e4d256-prod-github-runner-207 kernel: [30944.579151] ? show_regs.cold+0x8/0xd Aug 22 13:59:30 juju-e4d256-prod-github-runner-207 kernel: [30944.580138] ? watchdog_timer_fn+0x1be/0x220 Aug 22 13:59:30 juju-e4d256-prod-github-runner-207 kernel: [30944.581152] ? lockup_detector_update_enable+0x60/0x60 Aug 22 13:59:30 juju-e4d256-prod-github-runner-207 kernel: [30944.582223] ? __hrtimer_run_queues+0x107/0x230 Aug 22 13:59:30 juju-e4d256-prod-github-runner-207 kernel: [30944.583318] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 13:59:30 juju-e4d256-prod-github-runner-207 kernel: [30944.584341] ? hrtimer_interrupt+0x101/0x220 Aug 22 13:59:30 juju-e4d256-prod-github-runner-207 kernel: [30944.585392] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 13:59:30 juju-e4d256-prod-github-runner-207 kernel: [30944.586466] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 13:59:30 juju-e4d256-prod-github-runner-207 kernel: [30944.587528] Aug 22 13:59:30 juju-e4d256-prod-github-runner-207 kernel: [30944.588381] Aug 22 13:59:30 juju-e4d256-prod-github-runner-207 kernel: [30944.589218] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 13:59:30 juju-e4d256-prod-github-runner-207 kernel: [30944.590255] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:59:30 juju-e4d256-prod-github-runner-207 kernel: [30944.591322] ? _raw_spin_lock+0x22/0x30 Aug 22 13:59:30 juju-e4d256-prod-github-runner-207 kernel: [30944.592274] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:59:30 juju-e4d256-prod-github-runner-207 kernel: [30944.593306] direct_page_fault+0x206/0x310 [kvm] Aug 22 13:59:30 juju-e4d256-prod-github-runner-207 kernel: [30944.594332] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 13:59:30 juju-e4d256-prod-github-runner-207 kernel: [30944.595359] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 13:59:30 juju-e4d256-prod-github-runner-207 kernel: [30944.596362] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 13:59:30 juju-e4d256-prod-github-runner-207 kernel: [30944.597379] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 13:59:30 juju-e4d256-prod-github-runner-207 kernel: [30944.598326] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 13:59:30 juju-e4d256-prod-github-runner-207 kernel: [30944.599317] handle_exit+0x98/0x230 [kvm_amd] Aug 22 13:59:30 juju-e4d256-prod-github-runner-207 kernel: [30944.600209] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 13:59:30 juju-e4d256-prod-github-runner-207 kernel: [30944.601125] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 13:59:30 juju-e4d256-prod-github-runner-207 kernel: [30944.602049] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 13:59:30 juju-e4d256-prod-github-runner-207 kernel: [30944.602953] vcpu_run+0x62/0x2c0 [kvm] Aug 22 13:59:30 juju-e4d256-prod-github-runner-207 kernel: [30944.603775] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 13:59:30 juju-e4d256-prod-github-runner-207 kernel: [30944.604593] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 13:59:30 juju-e4d256-prod-github-runner-207 kernel: [30944.605451] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 13:59:30 juju-e4d256-prod-github-runner-207 kernel: [30944.606251] ? __seccomp_filter+0x4a/0x4a0 Aug 22 13:59:30 juju-e4d256-prod-github-runner-207 kernel: [30944.606996] ? __fget_files+0x86/0xc0 Aug 22 13:59:30 juju-e4d256-prod-github-runner-207 kernel: [30944.607711] __x64_sys_ioctl+0x95/0xd0 Aug 22 13:59:30 juju-e4d256-prod-github-runner-207 kernel: [30944.608406] do_syscall_64+0x5c/0xc0 Aug 22 13:59:30 juju-e4d256-prod-github-runner-207 kernel: [30944.609073] ? do_futex+0x162/0x1f0 Aug 22 13:59:30 juju-e4d256-prod-github-runner-207 kernel: [30944.609722] ? __x64_sys_futex+0x78/0x1e0 Aug 22 13:59:30 juju-e4d256-prod-github-runner-207 kernel: [30944.610398] ? __secure_computing+0xa9/0x120 Aug 22 13:59:30 juju-e4d256-prod-github-runner-207 kernel: [30944.611111] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 13:59:30 juju-e4d256-prod-github-runner-207 kernel: [30944.611894] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:59:30 juju-e4d256-prod-github-runner-207 kernel: [30944.612631] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:59:30 juju-e4d256-prod-github-runner-207 kernel: [30944.613354] ? do_syscall_64+0x69/0xc0 Aug 22 13:59:30 juju-e4d256-prod-github-runner-207 kernel: [30944.614002] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:59:30 juju-e4d256-prod-github-runner-207 kernel: [30944.614707] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:59:30 juju-e4d256-prod-github-runner-207 kernel: [30944.615523] ? do_syscall_64+0x69/0xc0 Aug 22 13:59:30 juju-e4d256-prod-github-runner-207 kernel: [30944.616154] ? do_syscall_64+0x69/0xc0 Aug 22 13:59:30 juju-e4d256-prod-github-runner-207 kernel: [30944.616778] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 13:59:30 juju-e4d256-prod-github-runner-207 kernel: [30944.617486] RIP: 0033:0x7faa5d0edaff Aug 22 13:59:30 juju-e4d256-prod-github-runner-207 kernel: [30944.618153] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 13:59:30 juju-e4d256-prod-github-runner-207 kernel: [30944.620165] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 13:59:30 juju-e4d256-prod-github-runner-207 kernel: [30944.621086] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 13:59:30 juju-e4d256-prod-github-runner-207 kernel: [30944.621981] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 13:59:30 juju-e4d256-prod-github-runner-207 kernel: [30944.622876] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 13:59:30 juju-e4d256-prod-github-runner-207 kernel: [30944.623784] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 13:59:30 juju-e4d256-prod-github-runner-207 kernel: [30944.624684] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 13:59:30 juju-e4d256-prod-github-runner-207 kernel: [30944.625580] Aug 22 13:59:45 juju-e4d256-prod-github-runner-207 kernel: [30959.252708] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 13:59:45 juju-e4d256-prod-github-runner-207 kernel: [30959.253688] rcu: 1-....: (7686446 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=3714623 Aug 22 13:59:45 juju-e4d256-prod-github-runner-207 kernel: [30959.254850] (t=7710513 jiffies g=23269 q=34088) Aug 22 13:59:45 juju-e4d256-prod-github-runner-207 kernel: [30959.255678] NMI backtrace for cpu 1 Aug 22 13:59:45 juju-e4d256-prod-github-runner-207 kernel: [30959.256399] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 13:59:45 juju-e4d256-prod-github-runner-207 kernel: [30959.257532] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 13:59:45 juju-e4d256-prod-github-runner-207 kernel: [30959.258660] Call Trace: Aug 22 13:59:45 juju-e4d256-prod-github-runner-207 kernel: [30959.259377] Aug 22 13:59:45 juju-e4d256-prod-github-runner-207 kernel: [30959.260029] show_stack+0x52/0x5c Aug 22 13:59:45 juju-e4d256-prod-github-runner-207 kernel: [30959.260761] dump_stack_lvl+0x4a/0x63 Aug 22 13:59:45 juju-e4d256-prod-github-runner-207 kernel: [30959.261513] dump_stack+0x10/0x16 Aug 22 13:59:45 juju-e4d256-prod-github-runner-207 kernel: [30959.262236] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 13:59:45 juju-e4d256-prod-github-runner-207 kernel: [30959.263030] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 13:59:45 juju-e4d256-prod-github-runner-207 kernel: [30959.263864] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 13:59:45 juju-e4d256-prod-github-runner-207 kernel: [30959.264704] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 13:59:45 juju-e4d256-prod-github-runner-207 kernel: [30959.265542] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 13:59:45 juju-e4d256-prod-github-runner-207 kernel: [30959.266361] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 13:59:45 juju-e4d256-prod-github-runner-207 kernel: [30959.267162] print_cpu_stall.cold+0x2f/0xe2 Aug 22 13:59:45 juju-e4d256-prod-github-runner-207 kernel: [30959.267941] ? timekeeping_update+0xf7/0x150 Aug 22 13:59:45 juju-e4d256-prod-github-runner-207 kernel: [30959.268719] check_cpu_stall+0x109/0x270 Aug 22 13:59:45 juju-e4d256-prod-github-runner-207 kernel: [30959.269475] rcu_sched_clock_irq+0x9a/0x250 Aug 22 13:59:45 juju-e4d256-prod-github-runner-207 kernel: [30959.270250] update_process_times+0x94/0xd0 Aug 22 13:59:45 juju-e4d256-prod-github-runner-207 kernel: [30959.271015] tick_sched_handle+0x29/0x70 Aug 22 13:59:45 juju-e4d256-prod-github-runner-207 kernel: [30959.271795] tick_sched_timer+0x8c/0xc0 Aug 22 13:59:45 juju-e4d256-prod-github-runner-207 kernel: [30959.272573] ? tick_nohz_handler+0xb0/0xb0 Aug 22 13:59:45 juju-e4d256-prod-github-runner-207 kernel: [30959.273337] __hrtimer_run_queues+0x107/0x230 Aug 22 13:59:45 juju-e4d256-prod-github-runner-207 kernel: [30959.274118] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 13:59:45 juju-e4d256-prod-github-runner-207 kernel: [30959.274914] hrtimer_interrupt+0x101/0x220 Aug 22 13:59:45 juju-e4d256-prod-github-runner-207 kernel: [30959.275710] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 13:59:45 juju-e4d256-prod-github-runner-207 kernel: [30959.276528] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 13:59:45 juju-e4d256-prod-github-runner-207 kernel: [30959.277362] Aug 22 13:59:45 juju-e4d256-prod-github-runner-207 kernel: [30959.278005] Aug 22 13:59:45 juju-e4d256-prod-github-runner-207 kernel: [30959.278633] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 13:59:45 juju-e4d256-prod-github-runner-207 kernel: [30959.279475] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 13:59:45 juju-e4d256-prod-github-runner-207 kernel: [30959.280388] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 13:59:45 juju-e4d256-prod-github-runner-207 kernel: [30959.282617] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 13:59:45 juju-e4d256-prod-github-runner-207 kernel: [30959.283512] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 13:59:45 juju-e4d256-prod-github-runner-207 kernel: [30959.284522] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 13:59:45 juju-e4d256-prod-github-runner-207 kernel: [30959.285517] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 13:59:45 juju-e4d256-prod-github-runner-207 kernel: [30959.286491] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 13:59:45 juju-e4d256-prod-github-runner-207 kernel: [30959.287480] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 13:59:45 juju-e4d256-prod-github-runner-207 kernel: [30959.288481] ? _raw_spin_lock+0x22/0x30 Aug 22 13:59:45 juju-e4d256-prod-github-runner-207 kernel: [30959.289255] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 13:59:45 juju-e4d256-prod-github-runner-207 kernel: [30959.290113] direct_page_fault+0x206/0x310 [kvm] Aug 22 13:59:45 juju-e4d256-prod-github-runner-207 kernel: [30959.290982] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 13:59:45 juju-e4d256-prod-github-runner-207 kernel: [30959.291840] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 13:59:45 juju-e4d256-prod-github-runner-207 kernel: [30959.292673] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 13:59:45 juju-e4d256-prod-github-runner-207 kernel: [30959.293485] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 13:59:45 juju-e4d256-prod-github-runner-207 kernel: [30959.294284] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 13:59:45 juju-e4d256-prod-github-runner-207 kernel: [30959.295136] handle_exit+0x98/0x230 [kvm_amd] Aug 22 13:59:45 juju-e4d256-prod-github-runner-207 kernel: [30959.295919] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 13:59:45 juju-e4d256-prod-github-runner-207 kernel: [30959.296717] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 13:59:45 juju-e4d256-prod-github-runner-207 kernel: [30959.297528] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 13:59:45 juju-e4d256-prod-github-runner-207 kernel: [30959.298324] vcpu_run+0x62/0x2c0 [kvm] Aug 22 13:59:45 juju-e4d256-prod-github-runner-207 kernel: [30959.299046] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 13:59:45 juju-e4d256-prod-github-runner-207 kernel: [30959.299808] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 13:59:45 juju-e4d256-prod-github-runner-207 kernel: [30959.300874] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 13:59:45 juju-e4d256-prod-github-runner-207 kernel: [30959.301672] ? __seccomp_filter+0x4a/0x4a0 Aug 22 13:59:45 juju-e4d256-prod-github-runner-207 kernel: [30959.302411] ? __fget_files+0x86/0xc0 Aug 22 13:59:45 juju-e4d256-prod-github-runner-207 kernel: [30959.303176] __x64_sys_ioctl+0x95/0xd0 Aug 22 13:59:45 juju-e4d256-prod-github-runner-207 kernel: [30959.303893] do_syscall_64+0x5c/0xc0 Aug 22 13:59:45 juju-e4d256-prod-github-runner-207 kernel: [30959.304584] ? do_futex+0x162/0x1f0 Aug 22 13:59:45 juju-e4d256-prod-github-runner-207 kernel: [30959.305270] ? __x64_sys_futex+0x78/0x1e0 Aug 22 13:59:45 juju-e4d256-prod-github-runner-207 kernel: [30959.306001] ? __secure_computing+0xa9/0x120 Aug 22 13:59:45 juju-e4d256-prod-github-runner-207 kernel: [30959.306731] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 13:59:45 juju-e4d256-prod-github-runner-207 kernel: [30959.307557] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:59:45 juju-e4d256-prod-github-runner-207 kernel: [30959.308324] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:59:45 juju-e4d256-prod-github-runner-207 kernel: [30959.309098] ? do_syscall_64+0x69/0xc0 Aug 22 13:59:45 juju-e4d256-prod-github-runner-207 kernel: [30959.309792] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 13:59:45 juju-e4d256-prod-github-runner-207 kernel: [30959.310559] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 13:59:45 juju-e4d256-prod-github-runner-207 kernel: [30959.311370] ? do_syscall_64+0x69/0xc0 Aug 22 13:59:45 juju-e4d256-prod-github-runner-207 kernel: [30959.312077] ? do_syscall_64+0x69/0xc0 Aug 22 13:59:45 juju-e4d256-prod-github-runner-207 kernel: [30959.312946] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 13:59:45 juju-e4d256-prod-github-runner-207 kernel: [30959.313732] RIP: 0033:0x7faa5d0edaff Aug 22 13:59:45 juju-e4d256-prod-github-runner-207 kernel: [30959.314424] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 13:59:45 juju-e4d256-prod-github-runner-207 kernel: [30959.316616] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 13:59:45 juju-e4d256-prod-github-runner-207 kernel: [30959.317613] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 13:59:45 juju-e4d256-prod-github-runner-207 kernel: [30959.318586] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 13:59:45 juju-e4d256-prod-github-runner-207 kernel: [30959.319593] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 13:59:45 juju-e4d256-prod-github-runner-207 kernel: [30959.320557] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 13:59:45 juju-e4d256-prod-github-runner-207 kernel: [30959.321508] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 13:59:45 juju-e4d256-prod-github-runner-207 kernel: [30959.322484] Aug 22 14:00:10 juju-e4d256-prod-github-runner-207 kernel: [30984.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 28748s! [qemu-system-x86:6715] Aug 22 14:00:10 juju-e4d256-prod-github-runner-207 kernel: [30984.543162] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 14:00:10 juju-e4d256-prod-github-runner-207 kernel: [30984.543235] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 14:00:10 juju-e4d256-prod-github-runner-207 kernel: [30984.556080] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 14:00:10 juju-e4d256-prod-github-runner-207 kernel: [30984.557391] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 14:00:10 juju-e4d256-prod-github-runner-207 kernel: [30984.558627] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:00:10 juju-e4d256-prod-github-runner-207 kernel: [30984.559711] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 14:00:10 juju-e4d256-prod-github-runner-207 kernel: [30984.562308] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 14:00:10 juju-e4d256-prod-github-runner-207 kernel: [30984.563374] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 14:00:10 juju-e4d256-prod-github-runner-207 kernel: [30984.564571] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 14:00:10 juju-e4d256-prod-github-runner-207 kernel: [30984.565749] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 14:00:10 juju-e4d256-prod-github-runner-207 kernel: [30984.566932] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 14:00:10 juju-e4d256-prod-github-runner-207 kernel: [30984.568107] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 14:00:10 juju-e4d256-prod-github-runner-207 kernel: [30984.569315] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 14:00:10 juju-e4d256-prod-github-runner-207 kernel: [30984.570598] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 14:00:10 juju-e4d256-prod-github-runner-207 kernel: [30984.571741] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 14:00:10 juju-e4d256-prod-github-runner-207 kernel: [30984.572965] Call Trace: Aug 22 14:00:10 juju-e4d256-prod-github-runner-207 kernel: [30984.573891] Aug 22 14:00:10 juju-e4d256-prod-github-runner-207 kernel: [30984.574791] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:00:10 juju-e4d256-prod-github-runner-207 kernel: [30984.575856] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:00:10 juju-e4d256-prod-github-runner-207 kernel: [30984.576892] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:00:10 juju-e4d256-prod-github-runner-207 kernel: [30984.577986] ? show_regs.part.0+0x23/0x29 Aug 22 14:00:10 juju-e4d256-prod-github-runner-207 kernel: [30984.579062] ? show_regs.cold+0x8/0xd Aug 22 14:00:10 juju-e4d256-prod-github-runner-207 kernel: [30984.580073] ? watchdog_timer_fn+0x1be/0x220 Aug 22 14:00:10 juju-e4d256-prod-github-runner-207 kernel: [30984.581101] ? lockup_detector_update_enable+0x60/0x60 Aug 22 14:00:10 juju-e4d256-prod-github-runner-207 kernel: [30984.582250] ? __hrtimer_run_queues+0x107/0x230 Aug 22 14:00:10 juju-e4d256-prod-github-runner-207 kernel: [30984.583337] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 14:00:10 juju-e4d256-prod-github-runner-207 kernel: [30984.584371] ? hrtimer_interrupt+0x101/0x220 Aug 22 14:00:10 juju-e4d256-prod-github-runner-207 kernel: [30984.585392] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 14:00:10 juju-e4d256-prod-github-runner-207 kernel: [30984.586478] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 14:00:10 juju-e4d256-prod-github-runner-207 kernel: [30984.587573] Aug 22 14:00:10 juju-e4d256-prod-github-runner-207 kernel: [30984.588440] Aug 22 14:00:10 juju-e4d256-prod-github-runner-207 kernel: [30984.589370] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 14:00:10 juju-e4d256-prod-github-runner-207 kernel: [30984.590538] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:00:10 juju-e4d256-prod-github-runner-207 kernel: [30984.591724] ? _raw_spin_lock+0x22/0x30 Aug 22 14:00:10 juju-e4d256-prod-github-runner-207 kernel: [30984.592764] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:00:10 juju-e4d256-prod-github-runner-207 kernel: [30984.593890] direct_page_fault+0x206/0x310 [kvm] Aug 22 14:00:10 juju-e4d256-prod-github-runner-207 kernel: [30984.595053] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 14:00:10 juju-e4d256-prod-github-runner-207 kernel: [30984.596170] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 14:00:10 juju-e4d256-prod-github-runner-207 kernel: [30984.597322] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 14:00:10 juju-e4d256-prod-github-runner-207 kernel: [30984.598364] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 14:00:10 juju-e4d256-prod-github-runner-207 kernel: [30984.599332] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 14:00:10 juju-e4d256-prod-github-runner-207 kernel: [30984.600321] handle_exit+0x98/0x230 [kvm_amd] Aug 22 14:00:10 juju-e4d256-prod-github-runner-207 kernel: [30984.601236] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 14:00:10 juju-e4d256-prod-github-runner-207 kernel: [30984.602162] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 14:00:10 juju-e4d256-prod-github-runner-207 kernel: [30984.603105] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 14:00:10 juju-e4d256-prod-github-runner-207 kernel: [30984.604016] vcpu_run+0x62/0x2c0 [kvm] Aug 22 14:00:10 juju-e4d256-prod-github-runner-207 kernel: [30984.604837] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 14:00:10 juju-e4d256-prod-github-runner-207 kernel: [30984.605657] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 14:00:10 juju-e4d256-prod-github-runner-207 kernel: [30984.606516] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 14:00:10 juju-e4d256-prod-github-runner-207 kernel: [30984.607328] ? __seccomp_filter+0x4a/0x4a0 Aug 22 14:00:10 juju-e4d256-prod-github-runner-207 kernel: [30984.608077] ? __fget_files+0x86/0xc0 Aug 22 14:00:10 juju-e4d256-prod-github-runner-207 kernel: [30984.608785] __x64_sys_ioctl+0x95/0xd0 Aug 22 14:00:10 juju-e4d256-prod-github-runner-207 kernel: [30984.609483] do_syscall_64+0x5c/0xc0 Aug 22 14:00:10 juju-e4d256-prod-github-runner-207 kernel: [30984.610168] ? do_futex+0x162/0x1f0 Aug 22 14:00:10 juju-e4d256-prod-github-runner-207 kernel: [30984.610843] ? __x64_sys_futex+0x78/0x1e0 Aug 22 14:00:10 juju-e4d256-prod-github-runner-207 kernel: [30984.611527] ? __secure_computing+0xa9/0x120 Aug 22 14:00:10 juju-e4d256-prod-github-runner-207 kernel: [30984.612219] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 14:00:10 juju-e4d256-prod-github-runner-207 kernel: [30984.612992] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:00:10 juju-e4d256-prod-github-runner-207 kernel: [30984.613746] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:00:10 juju-e4d256-prod-github-runner-207 kernel: [30984.614649] ? do_syscall_64+0x69/0xc0 Aug 22 14:00:10 juju-e4d256-prod-github-runner-207 kernel: [30984.615331] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:00:10 juju-e4d256-prod-github-runner-207 kernel: [30984.616039] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:00:10 juju-e4d256-prod-github-runner-207 kernel: [30984.616751] ? do_syscall_64+0x69/0xc0 Aug 22 14:00:10 juju-e4d256-prod-github-runner-207 kernel: [30984.617395] ? do_syscall_64+0x69/0xc0 Aug 22 14:00:10 juju-e4d256-prod-github-runner-207 kernel: [30984.618021] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 14:00:10 juju-e4d256-prod-github-runner-207 kernel: [30984.618731] RIP: 0033:0x7faa5d0edaff Aug 22 14:00:10 juju-e4d256-prod-github-runner-207 kernel: [30984.619380] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 14:00:10 juju-e4d256-prod-github-runner-207 kernel: [30984.621925] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 14:00:10 juju-e4d256-prod-github-runner-207 kernel: [30984.622862] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 14:00:10 juju-e4d256-prod-github-runner-207 kernel: [30984.624468] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 14:00:10 juju-e4d256-prod-github-runner-207 kernel: [30984.625398] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 14:00:10 juju-e4d256-prod-github-runner-207 kernel: [30984.626402] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 14:00:10 juju-e4d256-prod-github-runner-207 kernel: [30984.627346] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 14:00:10 juju-e4d256-prod-github-runner-207 kernel: [30984.628263] Aug 22 14:00:38 juju-e4d256-prod-github-runner-207 kernel: [31012.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 28774s! [qemu-system-x86:6715] Aug 22 14:00:38 juju-e4d256-prod-github-runner-207 kernel: [31012.543149] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 14:00:38 juju-e4d256-prod-github-runner-207 kernel: [31012.543223] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 14:00:38 juju-e4d256-prod-github-runner-207 kernel: [31012.555869] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 14:00:38 juju-e4d256-prod-github-runner-207 kernel: [31012.557177] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 14:00:38 juju-e4d256-prod-github-runner-207 kernel: [31012.558431] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:00:38 juju-e4d256-prod-github-runner-207 kernel: [31012.559534] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 14:00:38 juju-e4d256-prod-github-runner-207 kernel: [31012.562099] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 14:00:38 juju-e4d256-prod-github-runner-207 kernel: [31012.563164] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 14:00:38 juju-e4d256-prod-github-runner-207 kernel: [31012.564354] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 14:00:38 juju-e4d256-prod-github-runner-207 kernel: [31012.565567] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 14:00:38 juju-e4d256-prod-github-runner-207 kernel: [31012.566761] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 14:00:38 juju-e4d256-prod-github-runner-207 kernel: [31012.567935] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 14:00:38 juju-e4d256-prod-github-runner-207 kernel: [31012.569116] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 14:00:38 juju-e4d256-prod-github-runner-207 kernel: [31012.570355] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 14:00:38 juju-e4d256-prod-github-runner-207 kernel: [31012.571472] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 14:00:38 juju-e4d256-prod-github-runner-207 kernel: [31012.572707] Call Trace: Aug 22 14:00:38 juju-e4d256-prod-github-runner-207 kernel: [31012.573648] Aug 22 14:00:38 juju-e4d256-prod-github-runner-207 kernel: [31012.574617] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:00:38 juju-e4d256-prod-github-runner-207 kernel: [31012.575686] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:00:38 juju-e4d256-prod-github-runner-207 kernel: [31012.576720] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:00:38 juju-e4d256-prod-github-runner-207 kernel: [31012.577810] ? show_regs.part.0+0x23/0x29 Aug 22 14:00:38 juju-e4d256-prod-github-runner-207 kernel: [31012.578834] ? show_regs.cold+0x8/0xd Aug 22 14:00:38 juju-e4d256-prod-github-runner-207 kernel: [31012.579826] ? watchdog_timer_fn+0x1be/0x220 Aug 22 14:00:38 juju-e4d256-prod-github-runner-207 kernel: [31012.580903] ? lockup_detector_update_enable+0x60/0x60 Aug 22 14:00:38 juju-e4d256-prod-github-runner-207 kernel: [31012.581991] ? __hrtimer_run_queues+0x107/0x230 Aug 22 14:00:38 juju-e4d256-prod-github-runner-207 kernel: [31012.583043] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 14:00:38 juju-e4d256-prod-github-runner-207 kernel: [31012.584099] ? hrtimer_interrupt+0x101/0x220 Aug 22 14:00:38 juju-e4d256-prod-github-runner-207 kernel: [31012.585131] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 14:00:38 juju-e4d256-prod-github-runner-207 kernel: [31012.586233] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 14:00:38 juju-e4d256-prod-github-runner-207 kernel: [31012.587302] Aug 22 14:00:38 juju-e4d256-prod-github-runner-207 kernel: [31012.588161] Aug 22 14:00:38 juju-e4d256-prod-github-runner-207 kernel: [31012.589017] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 14:00:38 juju-e4d256-prod-github-runner-207 kernel: [31012.590119] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:00:38 juju-e4d256-prod-github-runner-207 kernel: [31012.591190] ? _raw_spin_lock+0x22/0x30 Aug 22 14:00:38 juju-e4d256-prod-github-runner-207 kernel: [31012.592146] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:00:38 juju-e4d256-prod-github-runner-207 kernel: [31012.593170] direct_page_fault+0x206/0x310 [kvm] Aug 22 14:00:38 juju-e4d256-prod-github-runner-207 kernel: [31012.594303] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 14:00:38 juju-e4d256-prod-github-runner-207 kernel: [31012.595363] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 14:00:38 juju-e4d256-prod-github-runner-207 kernel: [31012.596397] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 14:00:38 juju-e4d256-prod-github-runner-207 kernel: [31012.597382] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 14:00:38 juju-e4d256-prod-github-runner-207 kernel: [31012.598336] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 14:00:38 juju-e4d256-prod-github-runner-207 kernel: [31012.599345] handle_exit+0x98/0x230 [kvm_amd] Aug 22 14:00:38 juju-e4d256-prod-github-runner-207 kernel: [31012.600257] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 14:00:38 juju-e4d256-prod-github-runner-207 kernel: [31012.601197] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 14:00:38 juju-e4d256-prod-github-runner-207 kernel: [31012.602192] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 14:00:38 juju-e4d256-prod-github-runner-207 kernel: [31012.603128] vcpu_run+0x62/0x2c0 [kvm] Aug 22 14:00:38 juju-e4d256-prod-github-runner-207 kernel: [31012.603961] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 14:00:38 juju-e4d256-prod-github-runner-207 kernel: [31012.604776] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 14:00:38 juju-e4d256-prod-github-runner-207 kernel: [31012.605638] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 14:00:38 juju-e4d256-prod-github-runner-207 kernel: [31012.606626] ? __seccomp_filter+0x4a/0x4a0 Aug 22 14:00:38 juju-e4d256-prod-github-runner-207 kernel: [31012.607386] ? __fget_files+0x86/0xc0 Aug 22 14:00:38 juju-e4d256-prod-github-runner-207 kernel: [31012.608110] __x64_sys_ioctl+0x95/0xd0 Aug 22 14:00:38 juju-e4d256-prod-github-runner-207 kernel: [31012.608831] do_syscall_64+0x5c/0xc0 Aug 22 14:00:38 juju-e4d256-prod-github-runner-207 kernel: [31012.609509] ? do_futex+0x162/0x1f0 Aug 22 14:00:38 juju-e4d256-prod-github-runner-207 kernel: [31012.610217] ? __x64_sys_futex+0x78/0x1e0 Aug 22 14:00:38 juju-e4d256-prod-github-runner-207 kernel: [31012.611006] ? __secure_computing+0xa9/0x120 Aug 22 14:00:38 juju-e4d256-prod-github-runner-207 kernel: [31012.611714] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 14:00:38 juju-e4d256-prod-github-runner-207 kernel: [31012.612490] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:00:38 juju-e4d256-prod-github-runner-207 kernel: [31012.613222] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:00:38 juju-e4d256-prod-github-runner-207 kernel: [31012.613967] ? do_syscall_64+0x69/0xc0 Aug 22 14:00:38 juju-e4d256-prod-github-runner-207 kernel: [31012.614646] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:00:38 juju-e4d256-prod-github-runner-207 kernel: [31012.615363] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:00:38 juju-e4d256-prod-github-runner-207 kernel: [31012.616070] ? do_syscall_64+0x69/0xc0 Aug 22 14:00:38 juju-e4d256-prod-github-runner-207 kernel: [31012.616768] ? do_syscall_64+0x69/0xc0 Aug 22 14:00:38 juju-e4d256-prod-github-runner-207 kernel: [31012.617405] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 14:00:38 juju-e4d256-prod-github-runner-207 kernel: [31012.618120] RIP: 0033:0x7faa5d0edaff Aug 22 14:00:38 juju-e4d256-prod-github-runner-207 kernel: [31012.618775] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 14:00:38 juju-e4d256-prod-github-runner-207 kernel: [31012.620786] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 14:00:38 juju-e4d256-prod-github-runner-207 kernel: [31012.621706] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 14:00:38 juju-e4d256-prod-github-runner-207 kernel: [31012.622630] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 14:00:38 juju-e4d256-prod-github-runner-207 kernel: [31012.623522] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 14:00:38 juju-e4d256-prod-github-runner-207 kernel: [31012.624431] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 14:00:38 juju-e4d256-prod-github-runner-207 kernel: [31012.625331] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 14:00:38 juju-e4d256-prod-github-runner-207 kernel: [31012.626221] Aug 22 14:01:06 juju-e4d256-prod-github-runner-207 kernel: [31040.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 28800s! [qemu-system-x86:6715] Aug 22 14:01:06 juju-e4d256-prod-github-runner-207 kernel: [31040.543830] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 14:01:06 juju-e4d256-prod-github-runner-207 kernel: [31040.544124] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 14:01:06 juju-e4d256-prod-github-runner-207 kernel: [31040.556264] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 14:01:06 juju-e4d256-prod-github-runner-207 kernel: [31040.557540] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 14:01:06 juju-e4d256-prod-github-runner-207 kernel: [31040.558822] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:01:06 juju-e4d256-prod-github-runner-207 kernel: [31040.559882] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 14:01:06 juju-e4d256-prod-github-runner-207 kernel: [31040.562467] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 14:01:06 juju-e4d256-prod-github-runner-207 kernel: [31040.563551] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 14:01:06 juju-e4d256-prod-github-runner-207 kernel: [31040.564717] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 14:01:06 juju-e4d256-prod-github-runner-207 kernel: [31040.565873] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 14:01:06 juju-e4d256-prod-github-runner-207 kernel: [31040.567050] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 14:01:06 juju-e4d256-prod-github-runner-207 kernel: [31040.568219] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 14:01:06 juju-e4d256-prod-github-runner-207 kernel: [31040.569386] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 14:01:06 juju-e4d256-prod-github-runner-207 kernel: [31040.570631] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 14:01:06 juju-e4d256-prod-github-runner-207 kernel: [31040.571772] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 14:01:06 juju-e4d256-prod-github-runner-207 kernel: [31040.573011] Call Trace: Aug 22 14:01:06 juju-e4d256-prod-github-runner-207 kernel: [31040.573929] Aug 22 14:01:06 juju-e4d256-prod-github-runner-207 kernel: [31040.574903] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:01:06 juju-e4d256-prod-github-runner-207 kernel: [31040.575966] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:01:06 juju-e4d256-prod-github-runner-207 kernel: [31040.577065] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:01:06 juju-e4d256-prod-github-runner-207 kernel: [31040.578214] ? show_regs.part.0+0x23/0x29 Aug 22 14:01:06 juju-e4d256-prod-github-runner-207 kernel: [31040.579218] ? show_regs.cold+0x8/0xd Aug 22 14:01:06 juju-e4d256-prod-github-runner-207 kernel: [31040.580194] ? watchdog_timer_fn+0x1be/0x220 Aug 22 14:01:06 juju-e4d256-prod-github-runner-207 kernel: [31040.581201] ? lockup_detector_update_enable+0x60/0x60 Aug 22 14:01:06 juju-e4d256-prod-github-runner-207 kernel: [31040.582279] ? __hrtimer_run_queues+0x107/0x230 Aug 22 14:01:06 juju-e4d256-prod-github-runner-207 kernel: [31040.583347] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 14:01:06 juju-e4d256-prod-github-runner-207 kernel: [31040.584387] ? hrtimer_interrupt+0x101/0x220 Aug 22 14:01:06 juju-e4d256-prod-github-runner-207 kernel: [31040.585402] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 14:01:06 juju-e4d256-prod-github-runner-207 kernel: [31040.586505] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 14:01:06 juju-e4d256-prod-github-runner-207 kernel: [31040.587551] Aug 22 14:01:06 juju-e4d256-prod-github-runner-207 kernel: [31040.588403] Aug 22 14:01:06 juju-e4d256-prod-github-runner-207 kernel: [31040.589264] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 14:01:06 juju-e4d256-prod-github-runner-207 kernel: [31040.590480] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:01:06 juju-e4d256-prod-github-runner-207 kernel: [31040.591534] ? _raw_spin_lock+0x22/0x30 Aug 22 14:01:06 juju-e4d256-prod-github-runner-207 kernel: [31040.592536] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:01:06 juju-e4d256-prod-github-runner-207 kernel: [31040.593723] direct_page_fault+0x206/0x310 [kvm] Aug 22 14:01:06 juju-e4d256-prod-github-runner-207 kernel: [31040.594763] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 14:01:06 juju-e4d256-prod-github-runner-207 kernel: [31040.595964] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 14:01:06 juju-e4d256-prod-github-runner-207 kernel: [31040.596963] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 14:01:06 juju-e4d256-prod-github-runner-207 kernel: [31040.597980] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 14:01:06 juju-e4d256-prod-github-runner-207 kernel: [31040.598948] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 14:01:06 juju-e4d256-prod-github-runner-207 kernel: [31040.599934] handle_exit+0x98/0x230 [kvm_amd] Aug 22 14:01:06 juju-e4d256-prod-github-runner-207 kernel: [31040.600834] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 14:01:06 juju-e4d256-prod-github-runner-207 kernel: [31040.601756] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 14:01:06 juju-e4d256-prod-github-runner-207 kernel: [31040.602714] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 14:01:06 juju-e4d256-prod-github-runner-207 kernel: [31040.603619] vcpu_run+0x62/0x2c0 [kvm] Aug 22 14:01:06 juju-e4d256-prod-github-runner-207 kernel: [31040.604432] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 14:01:06 juju-e4d256-prod-github-runner-207 kernel: [31040.605238] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 14:01:06 juju-e4d256-prod-github-runner-207 kernel: [31040.606096] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 14:01:06 juju-e4d256-prod-github-runner-207 kernel: [31040.606927] ? __seccomp_filter+0x4a/0x4a0 Aug 22 14:01:06 juju-e4d256-prod-github-runner-207 kernel: [31040.607667] ? __fget_files+0x86/0xc0 Aug 22 14:01:06 juju-e4d256-prod-github-runner-207 kernel: [31040.608370] __x64_sys_ioctl+0x95/0xd0 Aug 22 14:01:06 juju-e4d256-prod-github-runner-207 kernel: [31040.609065] do_syscall_64+0x5c/0xc0 Aug 22 14:01:06 juju-e4d256-prod-github-runner-207 kernel: [31040.609728] ? do_futex+0x162/0x1f0 Aug 22 14:01:06 juju-e4d256-prod-github-runner-207 kernel: [31040.610394] ? __x64_sys_futex+0x78/0x1e0 Aug 22 14:01:06 juju-e4d256-prod-github-runner-207 kernel: [31040.611066] ? __secure_computing+0xa9/0x120 Aug 22 14:01:06 juju-e4d256-prod-github-runner-207 kernel: [31040.611754] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 14:01:06 juju-e4d256-prod-github-runner-207 kernel: [31040.612511] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:01:06 juju-e4d256-prod-github-runner-207 kernel: [31040.613232] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:01:06 juju-e4d256-prod-github-runner-207 kernel: [31040.613949] ? do_syscall_64+0x69/0xc0 Aug 22 14:01:06 juju-e4d256-prod-github-runner-207 kernel: [31040.614606] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:01:06 juju-e4d256-prod-github-runner-207 kernel: [31040.615315] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:01:06 juju-e4d256-prod-github-runner-207 kernel: [31040.616025] ? do_syscall_64+0x69/0xc0 Aug 22 14:01:06 juju-e4d256-prod-github-runner-207 kernel: [31040.616648] ? do_syscall_64+0x69/0xc0 Aug 22 14:01:06 juju-e4d256-prod-github-runner-207 kernel: [31040.617269] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 14:01:06 juju-e4d256-prod-github-runner-207 kernel: [31040.617971] RIP: 0033:0x7faa5d0edaff Aug 22 14:01:06 juju-e4d256-prod-github-runner-207 kernel: [31040.618644] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 14:01:06 juju-e4d256-prod-github-runner-207 kernel: [31040.620647] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 14:01:06 juju-e4d256-prod-github-runner-207 kernel: [31040.621556] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 14:01:06 juju-e4d256-prod-github-runner-207 kernel: [31040.622498] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 14:01:06 juju-e4d256-prod-github-runner-207 kernel: [31040.623385] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 14:01:06 juju-e4d256-prod-github-runner-207 kernel: [31040.624270] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 14:01:06 juju-e4d256-prod-github-runner-207 kernel: [31040.625160] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 14:01:06 juju-e4d256-prod-github-runner-207 kernel: [31040.626049] Aug 22 14:01:34 juju-e4d256-prod-github-runner-207 kernel: [31068.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 28826s! [qemu-system-x86:6715] Aug 22 14:01:34 juju-e4d256-prod-github-runner-207 kernel: [31068.543141] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 14:01:34 juju-e4d256-prod-github-runner-207 kernel: [31068.543217] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 14:01:34 juju-e4d256-prod-github-runner-207 kernel: [31068.555315] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 14:01:34 juju-e4d256-prod-github-runner-207 kernel: [31068.556579] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 14:01:34 juju-e4d256-prod-github-runner-207 kernel: [31068.557821] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:01:34 juju-e4d256-prod-github-runner-207 kernel: [31068.558878] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 14:01:34 juju-e4d256-prod-github-runner-207 kernel: [31068.561442] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 14:01:34 juju-e4d256-prod-github-runner-207 kernel: [31068.562497] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 14:01:34 juju-e4d256-prod-github-runner-207 kernel: [31068.563657] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 14:01:34 juju-e4d256-prod-github-runner-207 kernel: [31068.564814] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 14:01:34 juju-e4d256-prod-github-runner-207 kernel: [31068.565988] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 14:01:34 juju-e4d256-prod-github-runner-207 kernel: [31068.567148] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 14:01:34 juju-e4d256-prod-github-runner-207 kernel: [31068.568533] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 14:01:34 juju-e4d256-prod-github-runner-207 kernel: [31068.570011] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 14:01:34 juju-e4d256-prod-github-runner-207 kernel: [31068.571172] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 14:01:34 juju-e4d256-prod-github-runner-207 kernel: [31068.572384] Call Trace: Aug 22 14:01:34 juju-e4d256-prod-github-runner-207 kernel: [31068.573295] Aug 22 14:01:34 juju-e4d256-prod-github-runner-207 kernel: [31068.574189] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:01:34 juju-e4d256-prod-github-runner-207 kernel: [31068.575224] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:01:34 juju-e4d256-prod-github-runner-207 kernel: [31068.576274] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:01:34 juju-e4d256-prod-github-runner-207 kernel: [31068.577349] ? show_regs.part.0+0x23/0x29 Aug 22 14:01:34 juju-e4d256-prod-github-runner-207 kernel: [31068.578358] ? show_regs.cold+0x8/0xd Aug 22 14:01:34 juju-e4d256-prod-github-runner-207 kernel: [31068.579329] ? watchdog_timer_fn+0x1be/0x220 Aug 22 14:01:34 juju-e4d256-prod-github-runner-207 kernel: [31068.580335] ? lockup_detector_update_enable+0x60/0x60 Aug 22 14:01:34 juju-e4d256-prod-github-runner-207 kernel: [31068.581401] ? __hrtimer_run_queues+0x107/0x230 Aug 22 14:01:34 juju-e4d256-prod-github-runner-207 kernel: [31068.582468] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 14:01:34 juju-e4d256-prod-github-runner-207 kernel: [31068.583493] ? hrtimer_interrupt+0x101/0x220 Aug 22 14:01:34 juju-e4d256-prod-github-runner-207 kernel: [31068.584531] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 14:01:34 juju-e4d256-prod-github-runner-207 kernel: [31068.585604] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 14:01:34 juju-e4d256-prod-github-runner-207 kernel: [31068.586718] Aug 22 14:01:34 juju-e4d256-prod-github-runner-207 kernel: [31068.587595] Aug 22 14:01:34 juju-e4d256-prod-github-runner-207 kernel: [31068.588454] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 14:01:34 juju-e4d256-prod-github-runner-207 kernel: [31068.589492] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:01:34 juju-e4d256-prod-github-runner-207 kernel: [31068.590550] ? _raw_spin_lock+0x22/0x30 Aug 22 14:01:34 juju-e4d256-prod-github-runner-207 kernel: [31068.591501] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:01:34 juju-e4d256-prod-github-runner-207 kernel: [31068.592519] direct_page_fault+0x206/0x310 [kvm] Aug 22 14:01:34 juju-e4d256-prod-github-runner-207 kernel: [31068.593544] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 14:01:34 juju-e4d256-prod-github-runner-207 kernel: [31068.594559] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 14:01:34 juju-e4d256-prod-github-runner-207 kernel: [31068.595575] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 14:01:34 juju-e4d256-prod-github-runner-207 kernel: [31068.596546] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 14:01:34 juju-e4d256-prod-github-runner-207 kernel: [31068.597498] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 14:01:34 juju-e4d256-prod-github-runner-207 kernel: [31068.598487] handle_exit+0x98/0x230 [kvm_amd] Aug 22 14:01:34 juju-e4d256-prod-github-runner-207 kernel: [31068.599378] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 14:01:34 juju-e4d256-prod-github-runner-207 kernel: [31068.600296] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 14:01:34 juju-e4d256-prod-github-runner-207 kernel: [31068.601223] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 14:01:34 juju-e4d256-prod-github-runner-207 kernel: [31068.602139] vcpu_run+0x62/0x2c0 [kvm] Aug 22 14:01:34 juju-e4d256-prod-github-runner-207 kernel: [31068.602951] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 14:01:34 juju-e4d256-prod-github-runner-207 kernel: [31068.603764] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 14:01:34 juju-e4d256-prod-github-runner-207 kernel: [31068.604619] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 14:01:34 juju-e4d256-prod-github-runner-207 kernel: [31068.605419] ? __seccomp_filter+0x4a/0x4a0 Aug 22 14:01:34 juju-e4d256-prod-github-runner-207 kernel: [31068.606173] ? __fget_files+0x86/0xc0 Aug 22 14:01:34 juju-e4d256-prod-github-runner-207 kernel: [31068.606879] __x64_sys_ioctl+0x95/0xd0 Aug 22 14:01:34 juju-e4d256-prod-github-runner-207 kernel: [31068.607572] do_syscall_64+0x5c/0xc0 Aug 22 14:01:34 juju-e4d256-prod-github-runner-207 kernel: [31068.608240] ? do_futex+0x162/0x1f0 Aug 22 14:01:34 juju-e4d256-prod-github-runner-207 kernel: [31068.608889] ? __x64_sys_futex+0x78/0x1e0 Aug 22 14:01:34 juju-e4d256-prod-github-runner-207 kernel: [31068.609564] ? __secure_computing+0xa9/0x120 Aug 22 14:01:34 juju-e4d256-prod-github-runner-207 kernel: [31068.610268] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 14:01:34 juju-e4d256-prod-github-runner-207 kernel: [31068.611036] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:01:34 juju-e4d256-prod-github-runner-207 kernel: [31068.611759] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:01:34 juju-e4d256-prod-github-runner-207 kernel: [31068.612477] ? do_syscall_64+0x69/0xc0 Aug 22 14:01:34 juju-e4d256-prod-github-runner-207 kernel: [31068.613129] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:01:34 juju-e4d256-prod-github-runner-207 kernel: [31068.613841] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:01:34 juju-e4d256-prod-github-runner-207 kernel: [31068.614544] ? do_syscall_64+0x69/0xc0 Aug 22 14:01:34 juju-e4d256-prod-github-runner-207 kernel: [31068.615170] ? do_syscall_64+0x69/0xc0 Aug 22 14:01:34 juju-e4d256-prod-github-runner-207 kernel: [31068.615792] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 14:01:34 juju-e4d256-prod-github-runner-207 kernel: [31068.616750] RIP: 0033:0x7faa5d0edaff Aug 22 14:01:34 juju-e4d256-prod-github-runner-207 kernel: [31068.617390] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 14:01:34 juju-e4d256-prod-github-runner-207 kernel: [31068.619392] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 14:01:34 juju-e4d256-prod-github-runner-207 kernel: [31068.620306] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 14:01:34 juju-e4d256-prod-github-runner-207 kernel: [31068.621200] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 14:01:34 juju-e4d256-prod-github-runner-207 kernel: [31068.622107] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 14:01:34 juju-e4d256-prod-github-runner-207 kernel: [31068.622994] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 14:01:34 juju-e4d256-prod-github-runner-207 kernel: [31068.623881] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 14:01:34 juju-e4d256-prod-github-runner-207 kernel: [31068.624770] Aug 22 14:02:02 juju-e4d256-prod-github-runner-207 kernel: [31096.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 28852s! [qemu-system-x86:6715] Aug 22 14:02:02 juju-e4d256-prod-github-runner-207 kernel: [31096.543090] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 14:02:02 juju-e4d256-prod-github-runner-207 kernel: [31096.543166] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 14:02:02 juju-e4d256-prod-github-runner-207 kernel: [31096.555364] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 14:02:02 juju-e4d256-prod-github-runner-207 kernel: [31096.556629] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 14:02:02 juju-e4d256-prod-github-runner-207 kernel: [31096.557867] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:02:02 juju-e4d256-prod-github-runner-207 kernel: [31096.558931] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 14:02:02 juju-e4d256-prod-github-runner-207 kernel: [31096.561507] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 14:02:02 juju-e4d256-prod-github-runner-207 kernel: [31096.562552] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 14:02:02 juju-e4d256-prod-github-runner-207 kernel: [31096.563715] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 14:02:02 juju-e4d256-prod-github-runner-207 kernel: [31096.564890] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 14:02:02 juju-e4d256-prod-github-runner-207 kernel: [31096.566075] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 14:02:02 juju-e4d256-prod-github-runner-207 kernel: [31096.567237] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 14:02:02 juju-e4d256-prod-github-runner-207 kernel: [31096.568407] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 14:02:02 juju-e4d256-prod-github-runner-207 kernel: [31096.569668] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 14:02:02 juju-e4d256-prod-github-runner-207 kernel: [31096.570772] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 14:02:02 juju-e4d256-prod-github-runner-207 kernel: [31096.571963] Call Trace: Aug 22 14:02:02 juju-e4d256-prod-github-runner-207 kernel: [31096.572879] Aug 22 14:02:02 juju-e4d256-prod-github-runner-207 kernel: [31096.573811] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:02:02 juju-e4d256-prod-github-runner-207 kernel: [31096.574845] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:02:02 juju-e4d256-prod-github-runner-207 kernel: [31096.575873] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:02:02 juju-e4d256-prod-github-runner-207 kernel: [31096.576948] ? show_regs.part.0+0x23/0x29 Aug 22 14:02:02 juju-e4d256-prod-github-runner-207 kernel: [31096.577962] ? show_regs.cold+0x8/0xd Aug 22 14:02:02 juju-e4d256-prod-github-runner-207 kernel: [31096.578937] ? watchdog_timer_fn+0x1be/0x220 Aug 22 14:02:02 juju-e4d256-prod-github-runner-207 kernel: [31096.579952] ? lockup_detector_update_enable+0x60/0x60 Aug 22 14:02:02 juju-e4d256-prod-github-runner-207 kernel: [31096.581017] ? __hrtimer_run_queues+0x107/0x230 Aug 22 14:02:02 juju-e4d256-prod-github-runner-207 kernel: [31096.582068] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 14:02:02 juju-e4d256-prod-github-runner-207 kernel: [31096.583119] ? hrtimer_interrupt+0x101/0x220 Aug 22 14:02:02 juju-e4d256-prod-github-runner-207 kernel: [31096.584152] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 14:02:02 juju-e4d256-prod-github-runner-207 kernel: [31096.585233] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 14:02:02 juju-e4d256-prod-github-runner-207 kernel: [31096.586319] Aug 22 14:02:02 juju-e4d256-prod-github-runner-207 kernel: [31096.587175] Aug 22 14:02:02 juju-e4d256-prod-github-runner-207 kernel: [31096.588014] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 14:02:02 juju-e4d256-prod-github-runner-207 kernel: [31096.589066] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:02:02 juju-e4d256-prod-github-runner-207 kernel: [31096.590136] ? _raw_spin_lock+0x22/0x30 Aug 22 14:02:02 juju-e4d256-prod-github-runner-207 kernel: [31096.591091] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:02:02 juju-e4d256-prod-github-runner-207 kernel: [31096.592120] direct_page_fault+0x206/0x310 [kvm] Aug 22 14:02:02 juju-e4d256-prod-github-runner-207 kernel: [31096.593152] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 14:02:02 juju-e4d256-prod-github-runner-207 kernel: [31096.594203] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 14:02:02 juju-e4d256-prod-github-runner-207 kernel: [31096.595238] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 14:02:02 juju-e4d256-prod-github-runner-207 kernel: [31096.596225] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 14:02:02 juju-e4d256-prod-github-runner-207 kernel: [31096.597172] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 14:02:02 juju-e4d256-prod-github-runner-207 kernel: [31096.598181] handle_exit+0x98/0x230 [kvm_amd] Aug 22 14:02:02 juju-e4d256-prod-github-runner-207 kernel: [31096.599086] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 14:02:02 juju-e4d256-prod-github-runner-207 kernel: [31096.600005] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 14:02:02 juju-e4d256-prod-github-runner-207 kernel: [31096.600936] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 14:02:02 juju-e4d256-prod-github-runner-207 kernel: [31096.601864] vcpu_run+0x62/0x2c0 [kvm] Aug 22 14:02:02 juju-e4d256-prod-github-runner-207 kernel: [31096.602689] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 14:02:02 juju-e4d256-prod-github-runner-207 kernel: [31096.603506] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 14:02:02 juju-e4d256-prod-github-runner-207 kernel: [31096.604368] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 14:02:02 juju-e4d256-prod-github-runner-207 kernel: [31096.605172] ? __seccomp_filter+0x4a/0x4a0 Aug 22 14:02:02 juju-e4d256-prod-github-runner-207 kernel: [31096.605935] ? __fget_files+0x86/0xc0 Aug 22 14:02:02 juju-e4d256-prod-github-runner-207 kernel: [31096.606644] __x64_sys_ioctl+0x95/0xd0 Aug 22 14:02:02 juju-e4d256-prod-github-runner-207 kernel: [31096.607345] do_syscall_64+0x5c/0xc0 Aug 22 14:02:02 juju-e4d256-prod-github-runner-207 kernel: [31096.608017] ? do_futex+0x162/0x1f0 Aug 22 14:02:02 juju-e4d256-prod-github-runner-207 kernel: [31096.608669] ? __x64_sys_futex+0x78/0x1e0 Aug 22 14:02:02 juju-e4d256-prod-github-runner-207 kernel: [31096.609348] ? __secure_computing+0xa9/0x120 Aug 22 14:02:02 juju-e4d256-prod-github-runner-207 kernel: [31096.610066] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 14:02:02 juju-e4d256-prod-github-runner-207 kernel: [31096.610836] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:02:02 juju-e4d256-prod-github-runner-207 kernel: [31096.611616] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:02:02 juju-e4d256-prod-github-runner-207 kernel: [31096.612346] ? do_syscall_64+0x69/0xc0 Aug 22 14:02:02 juju-e4d256-prod-github-runner-207 kernel: [31096.612994] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:02:02 juju-e4d256-prod-github-runner-207 kernel: [31096.613718] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:02:02 juju-e4d256-prod-github-runner-207 kernel: [31096.614431] ? do_syscall_64+0x69/0xc0 Aug 22 14:02:02 juju-e4d256-prod-github-runner-207 kernel: [31096.615060] ? do_syscall_64+0x69/0xc0 Aug 22 14:02:02 juju-e4d256-prod-github-runner-207 kernel: [31096.615687] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 14:02:02 juju-e4d256-prod-github-runner-207 kernel: [31096.616401] RIP: 0033:0x7faa5d0edaff Aug 22 14:02:02 juju-e4d256-prod-github-runner-207 kernel: [31096.617031] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 14:02:02 juju-e4d256-prod-github-runner-207 kernel: [31096.619046] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 14:02:02 juju-e4d256-prod-github-runner-207 kernel: [31096.619996] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 14:02:02 juju-e4d256-prod-github-runner-207 kernel: [31096.620906] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 14:02:02 juju-e4d256-prod-github-runner-207 kernel: [31096.621819] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 14:02:02 juju-e4d256-prod-github-runner-207 kernel: [31096.622721] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 14:02:02 juju-e4d256-prod-github-runner-207 kernel: [31096.623618] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 14:02:02 juju-e4d256-prod-github-runner-207 kernel: [31096.624528] Aug 22 14:02:30 juju-e4d256-prod-github-runner-207 kernel: [31124.541981] watchdog: BUG: soft lockup - CPU#1 stuck for 28878s! [qemu-system-x86:6715] Aug 22 14:02:30 juju-e4d256-prod-github-runner-207 kernel: [31124.543848] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 14:02:30 juju-e4d256-prod-github-runner-207 kernel: [31124.544144] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 14:02:30 juju-e4d256-prod-github-runner-207 kernel: [31124.557564] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 14:02:30 juju-e4d256-prod-github-runner-207 kernel: [31124.558987] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 14:02:30 juju-e4d256-prod-github-runner-207 kernel: [31124.560226] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:02:30 juju-e4d256-prod-github-runner-207 kernel: [31124.561397] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 14:02:30 juju-e4d256-prod-github-runner-207 kernel: [31124.564015] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 14:02:30 juju-e4d256-prod-github-runner-207 kernel: [31124.565083] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 14:02:30 juju-e4d256-prod-github-runner-207 kernel: [31124.566287] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 14:02:30 juju-e4d256-prod-github-runner-207 kernel: [31124.567475] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 14:02:30 juju-e4d256-prod-github-runner-207 kernel: [31124.568759] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 14:02:30 juju-e4d256-prod-github-runner-207 kernel: [31124.570573] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 14:02:30 juju-e4d256-prod-github-runner-207 kernel: [31124.572381] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 14:02:30 juju-e4d256-prod-github-runner-207 kernel: [31124.573750] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 14:02:30 juju-e4d256-prod-github-runner-207 kernel: [31124.574863] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 14:02:30 juju-e4d256-prod-github-runner-207 kernel: [31124.576087] Call Trace: Aug 22 14:02:30 juju-e4d256-prod-github-runner-207 kernel: [31124.577016] Aug 22 14:02:30 juju-e4d256-prod-github-runner-207 kernel: [31124.578004] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:02:30 juju-e4d256-prod-github-runner-207 kernel: [31124.579076] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:02:30 juju-e4d256-prod-github-runner-207 kernel: [31124.580172] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:02:30 juju-e4d256-prod-github-runner-207 kernel: [31124.581386] ? show_regs.part.0+0x23/0x29 Aug 22 14:02:30 juju-e4d256-prod-github-runner-207 kernel: [31124.582478] ? show_regs.cold+0x8/0xd Aug 22 14:02:30 juju-e4d256-prod-github-runner-207 kernel: [31124.583713] ? watchdog_timer_fn+0x1be/0x220 Aug 22 14:02:30 juju-e4d256-prod-github-runner-207 kernel: [31124.584744] ? lockup_detector_update_enable+0x60/0x60 Aug 22 14:02:30 juju-e4d256-prod-github-runner-207 kernel: [31124.585870] ? __hrtimer_run_queues+0x107/0x230 Aug 22 14:02:30 juju-e4d256-prod-github-runner-207 kernel: [31124.586989] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 14:02:30 juju-e4d256-prod-github-runner-207 kernel: [31124.588037] ? hrtimer_interrupt+0x101/0x220 Aug 22 14:02:30 juju-e4d256-prod-github-runner-207 kernel: [31124.589114] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 14:02:30 juju-e4d256-prod-github-runner-207 kernel: [31124.590367] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 14:02:30 juju-e4d256-prod-github-runner-207 kernel: [31124.592003] Aug 22 14:02:30 juju-e4d256-prod-github-runner-207 kernel: [31124.592915] Aug 22 14:02:30 juju-e4d256-prod-github-runner-207 kernel: [31124.593832] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 14:02:30 juju-e4d256-prod-github-runner-207 kernel: [31124.594891] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:02:30 juju-e4d256-prod-github-runner-207 kernel: [31124.595987] ? _raw_spin_lock+0x22/0x30 Aug 22 14:02:30 juju-e4d256-prod-github-runner-207 kernel: [31124.596969] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:02:30 juju-e4d256-prod-github-runner-207 kernel: [31124.598096] direct_page_fault+0x206/0x310 [kvm] Aug 22 14:02:30 juju-e4d256-prod-github-runner-207 kernel: [31124.599216] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 14:02:30 juju-e4d256-prod-github-runner-207 kernel: [31124.600299] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 14:02:30 juju-e4d256-prod-github-runner-207 kernel: [31124.601329] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 14:02:30 juju-e4d256-prod-github-runner-207 kernel: [31124.602346] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 14:02:30 juju-e4d256-prod-github-runner-207 kernel: [31124.603361] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 14:02:30 juju-e4d256-prod-github-runner-207 kernel: [31124.604372] handle_exit+0x98/0x230 [kvm_amd] Aug 22 14:02:30 juju-e4d256-prod-github-runner-207 kernel: [31124.605356] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 14:02:30 juju-e4d256-prod-github-runner-207 kernel: [31124.606320] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 14:02:30 juju-e4d256-prod-github-runner-207 kernel: [31124.607258] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 14:02:30 juju-e4d256-prod-github-runner-207 kernel: [31124.608172] vcpu_run+0x62/0x2c0 [kvm] Aug 22 14:02:30 juju-e4d256-prod-github-runner-207 kernel: [31124.608995] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 14:02:30 juju-e4d256-prod-github-runner-207 kernel: [31124.609833] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 14:02:30 juju-e4d256-prod-github-runner-207 kernel: [31124.610709] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 14:02:30 juju-e4d256-prod-github-runner-207 kernel: [31124.611522] ? __seccomp_filter+0x4a/0x4a0 Aug 22 14:02:30 juju-e4d256-prod-github-runner-207 kernel: [31124.612315] ? __fget_files+0x86/0xc0 Aug 22 14:02:30 juju-e4d256-prod-github-runner-207 kernel: [31124.613109] __x64_sys_ioctl+0x95/0xd0 Aug 22 14:02:30 juju-e4d256-prod-github-runner-207 kernel: [31124.613825] do_syscall_64+0x5c/0xc0 Aug 22 14:02:30 juju-e4d256-prod-github-runner-207 kernel: [31124.614494] ? do_futex+0x162/0x1f0 Aug 22 14:02:30 juju-e4d256-prod-github-runner-207 kernel: [31124.615147] ? __x64_sys_futex+0x78/0x1e0 Aug 22 14:02:30 juju-e4d256-prod-github-runner-207 kernel: [31124.615928] ? __secure_computing+0xa9/0x120 Aug 22 14:02:30 juju-e4d256-prod-github-runner-207 kernel: [31124.616746] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 14:02:30 juju-e4d256-prod-github-runner-207 kernel: [31124.617645] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:02:30 juju-e4d256-prod-github-runner-207 kernel: [31124.618458] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:02:30 juju-e4d256-prod-github-runner-207 kernel: [31124.619271] ? do_syscall_64+0x69/0xc0 Aug 22 14:02:30 juju-e4d256-prod-github-runner-207 kernel: [31124.619986] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:02:30 juju-e4d256-prod-github-runner-207 kernel: [31124.620792] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:02:30 juju-e4d256-prod-github-runner-207 kernel: [31124.621596] ? do_syscall_64+0x69/0xc0 Aug 22 14:02:30 juju-e4d256-prod-github-runner-207 kernel: [31124.622300] ? do_syscall_64+0x69/0xc0 Aug 22 14:02:30 juju-e4d256-prod-github-runner-207 kernel: [31124.622996] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 14:02:30 juju-e4d256-prod-github-runner-207 kernel: [31124.623804] RIP: 0033:0x7faa5d0edaff Aug 22 14:02:30 juju-e4d256-prod-github-runner-207 kernel: [31124.624574] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 14:02:30 juju-e4d256-prod-github-runner-207 kernel: [31124.627069] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 14:02:30 juju-e4d256-prod-github-runner-207 kernel: [31124.628121] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 14:02:30 juju-e4d256-prod-github-runner-207 kernel: [31124.629190] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 14:02:30 juju-e4d256-prod-github-runner-207 kernel: [31124.630213] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 14:02:30 juju-e4d256-prod-github-runner-207 kernel: [31124.631232] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 14:02:30 juju-e4d256-prod-github-runner-207 kernel: [31124.632251] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 14:02:30 juju-e4d256-prod-github-runner-207 kernel: [31124.633309] Aug 22 14:02:45 juju-e4d256-prod-github-runner-207 kernel: [31139.264707] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 14:02:45 juju-e4d256-prod-github-runner-207 kernel: [31139.265705] rcu: 1-....: (7731310 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=3736075 Aug 22 14:02:45 juju-e4d256-prod-github-runner-207 kernel: [31139.266850] (t=7755516 jiffies g=23269 q=34190) Aug 22 14:02:45 juju-e4d256-prod-github-runner-207 kernel: [31139.267641] NMI backtrace for cpu 1 Aug 22 14:02:45 juju-e4d256-prod-github-runner-207 kernel: [31139.268360] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 14:02:45 juju-e4d256-prod-github-runner-207 kernel: [31139.269496] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 14:02:45 juju-e4d256-prod-github-runner-207 kernel: [31139.270566] Call Trace: Aug 22 14:02:45 juju-e4d256-prod-github-runner-207 kernel: [31139.271248] Aug 22 14:02:45 juju-e4d256-prod-github-runner-207 kernel: [31139.271894] show_stack+0x52/0x5c Aug 22 14:02:45 juju-e4d256-prod-github-runner-207 kernel: [31139.272620] dump_stack_lvl+0x4a/0x63 Aug 22 14:02:45 juju-e4d256-prod-github-runner-207 kernel: [31139.273388] dump_stack+0x10/0x16 Aug 22 14:02:45 juju-e4d256-prod-github-runner-207 kernel: [31139.274109] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 14:02:45 juju-e4d256-prod-github-runner-207 kernel: [31139.274893] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 14:02:45 juju-e4d256-prod-github-runner-207 kernel: [31139.275687] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 14:02:45 juju-e4d256-prod-github-runner-207 kernel: [31139.276512] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 14:02:45 juju-e4d256-prod-github-runner-207 kernel: [31139.277357] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 14:02:45 juju-e4d256-prod-github-runner-207 kernel: [31139.278174] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 14:02:45 juju-e4d256-prod-github-runner-207 kernel: [31139.278958] print_cpu_stall.cold+0x2f/0xe2 Aug 22 14:02:45 juju-e4d256-prod-github-runner-207 kernel: [31139.279727] ? timekeeping_update+0xf7/0x150 Aug 22 14:02:45 juju-e4d256-prod-github-runner-207 kernel: [31139.280502] check_cpu_stall+0x109/0x270 Aug 22 14:02:45 juju-e4d256-prod-github-runner-207 kernel: [31139.281271] rcu_sched_clock_irq+0x9a/0x250 Aug 22 14:02:45 juju-e4d256-prod-github-runner-207 kernel: [31139.282041] update_process_times+0x94/0xd0 Aug 22 14:02:45 juju-e4d256-prod-github-runner-207 kernel: [31139.282817] tick_sched_handle+0x29/0x70 Aug 22 14:02:45 juju-e4d256-prod-github-runner-207 kernel: [31139.283573] tick_sched_timer+0x8c/0xc0 Aug 22 14:02:45 juju-e4d256-prod-github-runner-207 kernel: [31139.284324] ? tick_nohz_handler+0xb0/0xb0 Aug 22 14:02:45 juju-e4d256-prod-github-runner-207 kernel: [31139.285105] __hrtimer_run_queues+0x107/0x230 Aug 22 14:02:45 juju-e4d256-prod-github-runner-207 kernel: [31139.285891] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 14:02:45 juju-e4d256-prod-github-runner-207 kernel: [31139.286714] hrtimer_interrupt+0x101/0x220 Aug 22 14:02:45 juju-e4d256-prod-github-runner-207 kernel: [31139.287477] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 14:02:45 juju-e4d256-prod-github-runner-207 kernel: [31139.288295] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 14:02:45 juju-e4d256-prod-github-runner-207 kernel: [31139.289122] Aug 22 14:02:45 juju-e4d256-prod-github-runner-207 kernel: [31139.289760] Aug 22 14:02:45 juju-e4d256-prod-github-runner-207 kernel: [31139.290389] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 14:02:45 juju-e4d256-prod-github-runner-207 kernel: [31139.291220] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:02:45 juju-e4d256-prod-github-runner-207 kernel: [31139.292117] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 14:02:45 juju-e4d256-prod-github-runner-207 kernel: [31139.294376] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 14:02:45 juju-e4d256-prod-github-runner-207 kernel: [31139.295255] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 14:02:45 juju-e4d256-prod-github-runner-207 kernel: [31139.296256] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 14:02:45 juju-e4d256-prod-github-runner-207 kernel: [31139.297261] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 14:02:45 juju-e4d256-prod-github-runner-207 kernel: [31139.298236] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 14:02:45 juju-e4d256-prod-github-runner-207 kernel: [31139.299205] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 14:02:45 juju-e4d256-prod-github-runner-207 kernel: [31139.300167] ? _raw_spin_lock+0x22/0x30 Aug 22 14:02:45 juju-e4d256-prod-github-runner-207 kernel: [31139.300967] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:02:45 juju-e4d256-prod-github-runner-207 kernel: [31139.301867] direct_page_fault+0x206/0x310 [kvm] Aug 22 14:02:45 juju-e4d256-prod-github-runner-207 kernel: [31139.302712] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 14:02:45 juju-e4d256-prod-github-runner-207 kernel: [31139.303557] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 14:02:45 juju-e4d256-prod-github-runner-207 kernel: [31139.304392] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 14:02:45 juju-e4d256-prod-github-runner-207 kernel: [31139.305224] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 14:02:45 juju-e4d256-prod-github-runner-207 kernel: [31139.306024] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 14:02:45 juju-e4d256-prod-github-runner-207 kernel: [31139.306856] handle_exit+0x98/0x230 [kvm_amd] Aug 22 14:02:45 juju-e4d256-prod-github-runner-207 kernel: [31139.307616] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 14:02:45 juju-e4d256-prod-github-runner-207 kernel: [31139.308448] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 14:02:45 juju-e4d256-prod-github-runner-207 kernel: [31139.309288] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 14:02:45 juju-e4d256-prod-github-runner-207 kernel: [31139.310084] vcpu_run+0x62/0x2c0 [kvm] Aug 22 14:02:45 juju-e4d256-prod-github-runner-207 kernel: [31139.310815] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 14:02:45 juju-e4d256-prod-github-runner-207 kernel: [31139.311555] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 14:02:45 juju-e4d256-prod-github-runner-207 kernel: [31139.312367] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 14:02:45 juju-e4d256-prod-github-runner-207 kernel: [31139.313173] ? __seccomp_filter+0x4a/0x4a0 Aug 22 14:02:45 juju-e4d256-prod-github-runner-207 kernel: [31139.313911] ? __fget_files+0x86/0xc0 Aug 22 14:02:45 juju-e4d256-prod-github-runner-207 kernel: [31139.314607] __x64_sys_ioctl+0x95/0xd0 Aug 22 14:02:45 juju-e4d256-prod-github-runner-207 kernel: [31139.315312] do_syscall_64+0x5c/0xc0 Aug 22 14:02:45 juju-e4d256-prod-github-runner-207 kernel: [31139.315995] ? do_futex+0x162/0x1f0 Aug 22 14:02:45 juju-e4d256-prod-github-runner-207 kernel: [31139.316670] ? __x64_sys_futex+0x78/0x1e0 Aug 22 14:02:45 juju-e4d256-prod-github-runner-207 kernel: [31139.317392] ? __secure_computing+0xa9/0x120 Aug 22 14:02:45 juju-e4d256-prod-github-runner-207 kernel: [31139.318118] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 14:02:45 juju-e4d256-prod-github-runner-207 kernel: [31139.318911] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:02:45 juju-e4d256-prod-github-runner-207 kernel: [31139.319670] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:02:45 juju-e4d256-prod-github-runner-207 kernel: [31139.320429] ? do_syscall_64+0x69/0xc0 Aug 22 14:02:45 juju-e4d256-prod-github-runner-207 kernel: [31139.321144] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:02:45 juju-e4d256-prod-github-runner-207 kernel: [31139.321940] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:02:45 juju-e4d256-prod-github-runner-207 kernel: [31139.322735] ? do_syscall_64+0x69/0xc0 Aug 22 14:02:45 juju-e4d256-prod-github-runner-207 kernel: [31139.323455] ? do_syscall_64+0x69/0xc0 Aug 22 14:02:45 juju-e4d256-prod-github-runner-207 kernel: [31139.324151] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 14:02:45 juju-e4d256-prod-github-runner-207 kernel: [31139.324930] RIP: 0033:0x7faa5d0edaff Aug 22 14:02:45 juju-e4d256-prod-github-runner-207 kernel: [31139.325631] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 14:02:45 juju-e4d256-prod-github-runner-207 kernel: [31139.327811] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 14:02:45 juju-e4d256-prod-github-runner-207 kernel: [31139.329041] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 14:02:45 juju-e4d256-prod-github-runner-207 kernel: [31139.330005] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 14:02:45 juju-e4d256-prod-github-runner-207 kernel: [31139.331094] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 14:02:45 juju-e4d256-prod-github-runner-207 kernel: [31139.332064] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 14:02:45 juju-e4d256-prod-github-runner-207 kernel: [31139.333029] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 14:02:45 juju-e4d256-prod-github-runner-207 kernel: [31139.333994] Aug 22 14:03:10 juju-e4d256-prod-github-runner-207 kernel: [31164.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 28916s! [qemu-system-x86:6715] Aug 22 14:03:10 juju-e4d256-prod-github-runner-207 kernel: [31164.543094] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 14:03:10 juju-e4d256-prod-github-runner-207 kernel: [31164.543166] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 14:03:10 juju-e4d256-prod-github-runner-207 kernel: [31164.555399] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 14:03:10 juju-e4d256-prod-github-runner-207 kernel: [31164.556685] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 14:03:10 juju-e4d256-prod-github-runner-207 kernel: [31164.557917] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:03:10 juju-e4d256-prod-github-runner-207 kernel: [31164.558978] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 14:03:10 juju-e4d256-prod-github-runner-207 kernel: [31164.561523] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 14:03:10 juju-e4d256-prod-github-runner-207 kernel: [31164.562568] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 14:03:10 juju-e4d256-prod-github-runner-207 kernel: [31164.563728] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 14:03:10 juju-e4d256-prod-github-runner-207 kernel: [31164.564898] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 14:03:10 juju-e4d256-prod-github-runner-207 kernel: [31164.566056] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 14:03:10 juju-e4d256-prod-github-runner-207 kernel: [31164.567215] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 14:03:10 juju-e4d256-prod-github-runner-207 kernel: [31164.568383] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 14:03:10 juju-e4d256-prod-github-runner-207 kernel: [31164.569621] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 14:03:10 juju-e4d256-prod-github-runner-207 kernel: [31164.570716] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 14:03:10 juju-e4d256-prod-github-runner-207 kernel: [31164.571906] Call Trace: Aug 22 14:03:10 juju-e4d256-prod-github-runner-207 kernel: [31164.572834] Aug 22 14:03:10 juju-e4d256-prod-github-runner-207 kernel: [31164.573716] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:03:10 juju-e4d256-prod-github-runner-207 kernel: [31164.574743] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:03:10 juju-e4d256-prod-github-runner-207 kernel: [31164.575762] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:03:10 juju-e4d256-prod-github-runner-207 kernel: [31164.576847] ? show_regs.part.0+0x23/0x29 Aug 22 14:03:10 juju-e4d256-prod-github-runner-207 kernel: [31164.577859] ? show_regs.cold+0x8/0xd Aug 22 14:03:10 juju-e4d256-prod-github-runner-207 kernel: [31164.578828] ? watchdog_timer_fn+0x1be/0x220 Aug 22 14:03:10 juju-e4d256-prod-github-runner-207 kernel: [31164.579833] ? lockup_detector_update_enable+0x60/0x60 Aug 22 14:03:10 juju-e4d256-prod-github-runner-207 kernel: [31164.580899] ? __hrtimer_run_queues+0x107/0x230 Aug 22 14:03:10 juju-e4d256-prod-github-runner-207 kernel: [31164.581929] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 14:03:10 juju-e4d256-prod-github-runner-207 kernel: [31164.582949] ? hrtimer_interrupt+0x101/0x220 Aug 22 14:03:10 juju-e4d256-prod-github-runner-207 kernel: [31164.583966] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 14:03:10 juju-e4d256-prod-github-runner-207 kernel: [31164.585067] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 14:03:10 juju-e4d256-prod-github-runner-207 kernel: [31164.586112] Aug 22 14:03:10 juju-e4d256-prod-github-runner-207 kernel: [31164.586967] Aug 22 14:03:10 juju-e4d256-prod-github-runner-207 kernel: [31164.587801] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 14:03:10 juju-e4d256-prod-github-runner-207 kernel: [31164.588839] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:03:10 juju-e4d256-prod-github-runner-207 kernel: [31164.589900] ? _raw_spin_lock+0x22/0x30 Aug 22 14:03:10 juju-e4d256-prod-github-runner-207 kernel: [31164.590870] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:03:10 juju-e4d256-prod-github-runner-207 kernel: [31164.591890] direct_page_fault+0x206/0x310 [kvm] Aug 22 14:03:10 juju-e4d256-prod-github-runner-207 kernel: [31164.592917] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 14:03:10 juju-e4d256-prod-github-runner-207 kernel: [31164.593924] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 14:03:10 juju-e4d256-prod-github-runner-207 kernel: [31164.594927] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 14:03:10 juju-e4d256-prod-github-runner-207 kernel: [31164.595895] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 14:03:10 juju-e4d256-prod-github-runner-207 kernel: [31164.596850] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 14:03:10 juju-e4d256-prod-github-runner-207 kernel: [31164.597825] handle_exit+0x98/0x230 [kvm_amd] Aug 22 14:03:10 juju-e4d256-prod-github-runner-207 kernel: [31164.598949] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 14:03:10 juju-e4d256-prod-github-runner-207 kernel: [31164.599858] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 14:03:10 juju-e4d256-prod-github-runner-207 kernel: [31164.600795] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 14:03:10 juju-e4d256-prod-github-runner-207 kernel: [31164.601696] vcpu_run+0x62/0x2c0 [kvm] Aug 22 14:03:10 juju-e4d256-prod-github-runner-207 kernel: [31164.602505] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 14:03:10 juju-e4d256-prod-github-runner-207 kernel: [31164.603315] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 14:03:10 juju-e4d256-prod-github-runner-207 kernel: [31164.604172] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 14:03:10 juju-e4d256-prod-github-runner-207 kernel: [31164.604975] ? __seccomp_filter+0x4a/0x4a0 Aug 22 14:03:10 juju-e4d256-prod-github-runner-207 kernel: [31164.605716] ? __fget_files+0x86/0xc0 Aug 22 14:03:10 juju-e4d256-prod-github-runner-207 kernel: [31164.606423] __x64_sys_ioctl+0x95/0xd0 Aug 22 14:03:10 juju-e4d256-prod-github-runner-207 kernel: [31164.607113] do_syscall_64+0x5c/0xc0 Aug 22 14:03:10 juju-e4d256-prod-github-runner-207 kernel: [31164.607775] ? do_futex+0x162/0x1f0 Aug 22 14:03:10 juju-e4d256-prod-github-runner-207 kernel: [31164.608421] ? __x64_sys_futex+0x78/0x1e0 Aug 22 14:03:10 juju-e4d256-prod-github-runner-207 kernel: [31164.609099] ? __secure_computing+0xa9/0x120 Aug 22 14:03:10 juju-e4d256-prod-github-runner-207 kernel: [31164.609788] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 14:03:10 juju-e4d256-prod-github-runner-207 kernel: [31164.610551] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:03:10 juju-e4d256-prod-github-runner-207 kernel: [31164.611272] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:03:10 juju-e4d256-prod-github-runner-207 kernel: [31164.611993] ? do_syscall_64+0x69/0xc0 Aug 22 14:03:10 juju-e4d256-prod-github-runner-207 kernel: [31164.612646] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:03:10 juju-e4d256-prod-github-runner-207 kernel: [31164.613355] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:03:10 juju-e4d256-prod-github-runner-207 kernel: [31164.614049] ? do_syscall_64+0x69/0xc0 Aug 22 14:03:10 juju-e4d256-prod-github-runner-207 kernel: [31164.614704] ? do_syscall_64+0x69/0xc0 Aug 22 14:03:10 juju-e4d256-prod-github-runner-207 kernel: [31164.615327] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 14:03:10 juju-e4d256-prod-github-runner-207 kernel: [31164.616032] RIP: 0033:0x7faa5d0edaff Aug 22 14:03:10 juju-e4d256-prod-github-runner-207 kernel: [31164.616667] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 14:03:10 juju-e4d256-prod-github-runner-207 kernel: [31164.618679] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 14:03:10 juju-e4d256-prod-github-runner-207 kernel: [31164.619737] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 14:03:10 juju-e4d256-prod-github-runner-207 kernel: [31164.620650] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 14:03:10 juju-e4d256-prod-github-runner-207 kernel: [31164.621544] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 14:03:10 juju-e4d256-prod-github-runner-207 kernel: [31164.622440] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 14:03:10 juju-e4d256-prod-github-runner-207 kernel: [31164.623335] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 14:03:10 juju-e4d256-prod-github-runner-207 kernel: [31164.624227] Aug 22 14:03:38 juju-e4d256-prod-github-runner-207 kernel: [31192.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 28942s! [qemu-system-x86:6715] Aug 22 14:03:38 juju-e4d256-prod-github-runner-207 kernel: [31192.543145] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 14:03:38 juju-e4d256-prod-github-runner-207 kernel: [31192.543221] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 14:03:38 juju-e4d256-prod-github-runner-207 kernel: [31192.555825] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 14:03:38 juju-e4d256-prod-github-runner-207 kernel: [31192.557134] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 14:03:38 juju-e4d256-prod-github-runner-207 kernel: [31192.558378] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:03:38 juju-e4d256-prod-github-runner-207 kernel: [31192.559457] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 14:03:38 juju-e4d256-prod-github-runner-207 kernel: [31192.562066] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 14:03:38 juju-e4d256-prod-github-runner-207 kernel: [31192.563124] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 14:03:38 juju-e4d256-prod-github-runner-207 kernel: [31192.564505] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 14:03:38 juju-e4d256-prod-github-runner-207 kernel: [31192.565686] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 14:03:38 juju-e4d256-prod-github-runner-207 kernel: [31192.566891] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 14:03:38 juju-e4d256-prod-github-runner-207 kernel: [31192.568081] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 14:03:38 juju-e4d256-prod-github-runner-207 kernel: [31192.569287] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 14:03:38 juju-e4d256-prod-github-runner-207 kernel: [31192.570547] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 14:03:38 juju-e4d256-prod-github-runner-207 kernel: [31192.571676] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 14:03:38 juju-e4d256-prod-github-runner-207 kernel: [31192.572917] Call Trace: Aug 22 14:03:38 juju-e4d256-prod-github-runner-207 kernel: [31192.573970] Aug 22 14:03:38 juju-e4d256-prod-github-runner-207 kernel: [31192.574858] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:03:38 juju-e4d256-prod-github-runner-207 kernel: [31192.575904] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:03:38 juju-e4d256-prod-github-runner-207 kernel: [31192.576954] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:03:38 juju-e4d256-prod-github-runner-207 kernel: [31192.578102] ? show_regs.part.0+0x23/0x29 Aug 22 14:03:38 juju-e4d256-prod-github-runner-207 kernel: [31192.579123] ? show_regs.cold+0x8/0xd Aug 22 14:03:38 juju-e4d256-prod-github-runner-207 kernel: [31192.580108] ? watchdog_timer_fn+0x1be/0x220 Aug 22 14:03:38 juju-e4d256-prod-github-runner-207 kernel: [31192.581142] ? lockup_detector_update_enable+0x60/0x60 Aug 22 14:03:38 juju-e4d256-prod-github-runner-207 kernel: [31192.582226] ? __hrtimer_run_queues+0x107/0x230 Aug 22 14:03:38 juju-e4d256-prod-github-runner-207 kernel: [31192.583264] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 14:03:38 juju-e4d256-prod-github-runner-207 kernel: [31192.584319] ? hrtimer_interrupt+0x101/0x220 Aug 22 14:03:38 juju-e4d256-prod-github-runner-207 kernel: [31192.585361] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 14:03:38 juju-e4d256-prod-github-runner-207 kernel: [31192.586448] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 14:03:38 juju-e4d256-prod-github-runner-207 kernel: [31192.587512] Aug 22 14:03:38 juju-e4d256-prod-github-runner-207 kernel: [31192.588431] Aug 22 14:03:38 juju-e4d256-prod-github-runner-207 kernel: [31192.589282] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 14:03:38 juju-e4d256-prod-github-runner-207 kernel: [31192.590337] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:03:38 juju-e4d256-prod-github-runner-207 kernel: [31192.591392] ? _raw_spin_lock+0x22/0x30 Aug 22 14:03:38 juju-e4d256-prod-github-runner-207 kernel: [31192.592373] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:03:38 juju-e4d256-prod-github-runner-207 kernel: [31192.593412] direct_page_fault+0x206/0x310 [kvm] Aug 22 14:03:38 juju-e4d256-prod-github-runner-207 kernel: [31192.594449] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 14:03:38 juju-e4d256-prod-github-runner-207 kernel: [31192.595462] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 14:03:38 juju-e4d256-prod-github-runner-207 kernel: [31192.596483] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 14:03:38 juju-e4d256-prod-github-runner-207 kernel: [31192.597470] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 14:03:38 juju-e4d256-prod-github-runner-207 kernel: [31192.598452] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 14:03:38 juju-e4d256-prod-github-runner-207 kernel: [31192.599463] handle_exit+0x98/0x230 [kvm_amd] Aug 22 14:03:38 juju-e4d256-prod-github-runner-207 kernel: [31192.600387] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 14:03:38 juju-e4d256-prod-github-runner-207 kernel: [31192.601316] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 14:03:38 juju-e4d256-prod-github-runner-207 kernel: [31192.602255] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 14:03:38 juju-e4d256-prod-github-runner-207 kernel: [31192.603176] vcpu_run+0x62/0x2c0 [kvm] Aug 22 14:03:38 juju-e4d256-prod-github-runner-207 kernel: [31192.604025] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 14:03:38 juju-e4d256-prod-github-runner-207 kernel: [31192.604975] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 14:03:38 juju-e4d256-prod-github-runner-207 kernel: [31192.605930] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 14:03:38 juju-e4d256-prod-github-runner-207 kernel: [31192.606745] ? __seccomp_filter+0x4a/0x4a0 Aug 22 14:03:38 juju-e4d256-prod-github-runner-207 kernel: [31192.607504] ? __fget_files+0x86/0xc0 Aug 22 14:03:38 juju-e4d256-prod-github-runner-207 kernel: [31192.608221] __x64_sys_ioctl+0x95/0xd0 Aug 22 14:03:38 juju-e4d256-prod-github-runner-207 kernel: [31192.608992] do_syscall_64+0x5c/0xc0 Aug 22 14:03:38 juju-e4d256-prod-github-runner-207 kernel: [31192.609684] ? do_futex+0x162/0x1f0 Aug 22 14:03:38 juju-e4d256-prod-github-runner-207 kernel: [31192.610345] ? __x64_sys_futex+0x78/0x1e0 Aug 22 14:03:38 juju-e4d256-prod-github-runner-207 kernel: [31192.611025] ? __secure_computing+0xa9/0x120 Aug 22 14:03:38 juju-e4d256-prod-github-runner-207 kernel: [31192.611733] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 14:03:38 juju-e4d256-prod-github-runner-207 kernel: [31192.612527] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:03:38 juju-e4d256-prod-github-runner-207 kernel: [31192.613265] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:03:38 juju-e4d256-prod-github-runner-207 kernel: [31192.614005] ? do_syscall_64+0x69/0xc0 Aug 22 14:03:38 juju-e4d256-prod-github-runner-207 kernel: [31192.614667] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:03:38 juju-e4d256-prod-github-runner-207 kernel: [31192.615387] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:03:38 juju-e4d256-prod-github-runner-207 kernel: [31192.616101] ? do_syscall_64+0x69/0xc0 Aug 22 14:03:38 juju-e4d256-prod-github-runner-207 kernel: [31192.616766] ? do_syscall_64+0x69/0xc0 Aug 22 14:03:38 juju-e4d256-prod-github-runner-207 kernel: [31192.617402] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 14:03:38 juju-e4d256-prod-github-runner-207 kernel: [31192.618129] RIP: 0033:0x7faa5d0edaff Aug 22 14:03:38 juju-e4d256-prod-github-runner-207 kernel: [31192.618809] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 14:03:38 juju-e4d256-prod-github-runner-207 kernel: [31192.620919] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 14:03:38 juju-e4d256-prod-github-runner-207 kernel: [31192.621851] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 14:03:38 juju-e4d256-prod-github-runner-207 kernel: [31192.622759] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 14:03:38 juju-e4d256-prod-github-runner-207 kernel: [31192.623673] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 14:03:38 juju-e4d256-prod-github-runner-207 kernel: [31192.624801] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 14:03:38 juju-e4d256-prod-github-runner-207 kernel: [31192.625719] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 14:03:38 juju-e4d256-prod-github-runner-207 kernel: [31192.626836] Aug 22 14:04:06 juju-e4d256-prod-github-runner-207 kernel: [31220.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 28968s! [qemu-system-x86:6715] Aug 22 14:04:06 juju-e4d256-prod-github-runner-207 kernel: [31220.543887] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 14:04:06 juju-e4d256-prod-github-runner-207 kernel: [31220.544201] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 14:04:06 juju-e4d256-prod-github-runner-207 kernel: [31220.556577] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 14:04:06 juju-e4d256-prod-github-runner-207 kernel: [31220.557851] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 14:04:06 juju-e4d256-prod-github-runner-207 kernel: [31220.559073] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:04:06 juju-e4d256-prod-github-runner-207 kernel: [31220.560158] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 14:04:06 juju-e4d256-prod-github-runner-207 kernel: [31220.562722] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 14:04:06 juju-e4d256-prod-github-runner-207 kernel: [31220.563781] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 14:04:06 juju-e4d256-prod-github-runner-207 kernel: [31220.564963] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 14:04:06 juju-e4d256-prod-github-runner-207 kernel: [31220.566136] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 14:04:06 juju-e4d256-prod-github-runner-207 kernel: [31220.567379] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 14:04:06 juju-e4d256-prod-github-runner-207 kernel: [31220.568566] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 14:04:06 juju-e4d256-prod-github-runner-207 kernel: [31220.569752] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 14:04:06 juju-e4d256-prod-github-runner-207 kernel: [31220.571004] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 14:04:06 juju-e4d256-prod-github-runner-207 kernel: [31220.572171] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 14:04:06 juju-e4d256-prod-github-runner-207 kernel: [31220.573389] Call Trace: Aug 22 14:04:06 juju-e4d256-prod-github-runner-207 kernel: [31220.574422] Aug 22 14:04:06 juju-e4d256-prod-github-runner-207 kernel: [31220.575319] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:04:06 juju-e4d256-prod-github-runner-207 kernel: [31220.576420] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:04:06 juju-e4d256-prod-github-runner-207 kernel: [31220.577507] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:04:06 juju-e4d256-prod-github-runner-207 kernel: [31220.578614] ? show_regs.part.0+0x23/0x29 Aug 22 14:04:06 juju-e4d256-prod-github-runner-207 kernel: [31220.579619] ? show_regs.cold+0x8/0xd Aug 22 14:04:06 juju-e4d256-prod-github-runner-207 kernel: [31220.580622] ? watchdog_timer_fn+0x1be/0x220 Aug 22 14:04:06 juju-e4d256-prod-github-runner-207 kernel: [31220.581639] ? lockup_detector_update_enable+0x60/0x60 Aug 22 14:04:06 juju-e4d256-prod-github-runner-207 kernel: [31220.582769] ? __hrtimer_run_queues+0x107/0x230 Aug 22 14:04:06 juju-e4d256-prod-github-runner-207 kernel: [31220.584010] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 14:04:06 juju-e4d256-prod-github-runner-207 kernel: [31220.585047] ? hrtimer_interrupt+0x101/0x220 Aug 22 14:04:06 juju-e4d256-prod-github-runner-207 kernel: [31220.586069] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 14:04:06 juju-e4d256-prod-github-runner-207 kernel: [31220.587139] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 14:04:06 juju-e4d256-prod-github-runner-207 kernel: [31220.588207] Aug 22 14:04:06 juju-e4d256-prod-github-runner-207 kernel: [31220.589064] Aug 22 14:04:06 juju-e4d256-prod-github-runner-207 kernel: [31220.589919] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 14:04:06 juju-e4d256-prod-github-runner-207 kernel: [31220.590966] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:04:06 juju-e4d256-prod-github-runner-207 kernel: [31220.592023] ? _raw_spin_lock+0x22/0x30 Aug 22 14:04:06 juju-e4d256-prod-github-runner-207 kernel: [31220.592989] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:04:06 juju-e4d256-prod-github-runner-207 kernel: [31220.594014] direct_page_fault+0x206/0x310 [kvm] Aug 22 14:04:06 juju-e4d256-prod-github-runner-207 kernel: [31220.595039] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 14:04:06 juju-e4d256-prod-github-runner-207 kernel: [31220.596071] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 14:04:06 juju-e4d256-prod-github-runner-207 kernel: [31220.597078] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 14:04:06 juju-e4d256-prod-github-runner-207 kernel: [31220.598095] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 14:04:06 juju-e4d256-prod-github-runner-207 kernel: [31220.599043] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 14:04:06 juju-e4d256-prod-github-runner-207 kernel: [31220.600041] handle_exit+0x98/0x230 [kvm_amd] Aug 22 14:04:06 juju-e4d256-prod-github-runner-207 kernel: [31220.600937] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 14:04:06 juju-e4d256-prod-github-runner-207 kernel: [31220.601853] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 14:04:06 juju-e4d256-prod-github-runner-207 kernel: [31220.602778] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 14:04:06 juju-e4d256-prod-github-runner-207 kernel: [31220.603683] vcpu_run+0x62/0x2c0 [kvm] Aug 22 14:04:06 juju-e4d256-prod-github-runner-207 kernel: [31220.604508] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 14:04:06 juju-e4d256-prod-github-runner-207 kernel: [31220.605320] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 14:04:06 juju-e4d256-prod-github-runner-207 kernel: [31220.606181] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 14:04:06 juju-e4d256-prod-github-runner-207 kernel: [31220.606979] ? __seccomp_filter+0x4a/0x4a0 Aug 22 14:04:06 juju-e4d256-prod-github-runner-207 kernel: [31220.607724] ? __fget_files+0x86/0xc0 Aug 22 14:04:06 juju-e4d256-prod-github-runner-207 kernel: [31220.608438] __x64_sys_ioctl+0x95/0xd0 Aug 22 14:04:06 juju-e4d256-prod-github-runner-207 kernel: [31220.609133] do_syscall_64+0x5c/0xc0 Aug 22 14:04:06 juju-e4d256-prod-github-runner-207 kernel: [31220.609799] ? do_futex+0x162/0x1f0 Aug 22 14:04:06 juju-e4d256-prod-github-runner-207 kernel: [31220.610449] ? __x64_sys_futex+0x78/0x1e0 Aug 22 14:04:06 juju-e4d256-prod-github-runner-207 kernel: [31220.611140] ? __secure_computing+0xa9/0x120 Aug 22 14:04:06 juju-e4d256-prod-github-runner-207 kernel: [31220.611837] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 14:04:06 juju-e4d256-prod-github-runner-207 kernel: [31220.612619] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:04:06 juju-e4d256-prod-github-runner-207 kernel: [31220.613341] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:04:06 juju-e4d256-prod-github-runner-207 kernel: [31220.614058] ? do_syscall_64+0x69/0xc0 Aug 22 14:04:06 juju-e4d256-prod-github-runner-207 kernel: [31220.614700] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:04:06 juju-e4d256-prod-github-runner-207 kernel: [31220.615400] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:04:06 juju-e4d256-prod-github-runner-207 kernel: [31220.616109] ? do_syscall_64+0x69/0xc0 Aug 22 14:04:06 juju-e4d256-prod-github-runner-207 kernel: [31220.616731] ? do_syscall_64+0x69/0xc0 Aug 22 14:04:06 juju-e4d256-prod-github-runner-207 kernel: [31220.617350] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 14:04:06 juju-e4d256-prod-github-runner-207 kernel: [31220.618059] RIP: 0033:0x7faa5d0edaff Aug 22 14:04:06 juju-e4d256-prod-github-runner-207 kernel: [31220.618713] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 14:04:06 juju-e4d256-prod-github-runner-207 kernel: [31220.620715] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 14:04:06 juju-e4d256-prod-github-runner-207 kernel: [31220.621625] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 14:04:06 juju-e4d256-prod-github-runner-207 kernel: [31220.622511] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 14:04:06 juju-e4d256-prod-github-runner-207 kernel: [31220.623399] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 14:04:06 juju-e4d256-prod-github-runner-207 kernel: [31220.624298] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 14:04:06 juju-e4d256-prod-github-runner-207 kernel: [31220.625185] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 14:04:06 juju-e4d256-prod-github-runner-207 kernel: [31220.626081] Aug 22 14:04:34 juju-e4d256-prod-github-runner-207 kernel: [31248.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 28994s! [qemu-system-x86:6715] Aug 22 14:04:34 juju-e4d256-prod-github-runner-207 kernel: [31248.543281] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 14:04:34 juju-e4d256-prod-github-runner-207 kernel: [31248.543352] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 14:04:34 juju-e4d256-prod-github-runner-207 kernel: [31248.555929] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 14:04:34 juju-e4d256-prod-github-runner-207 kernel: [31248.557349] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 14:04:34 juju-e4d256-prod-github-runner-207 kernel: [31248.558595] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:04:34 juju-e4d256-prod-github-runner-207 kernel: [31248.559688] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 14:04:34 juju-e4d256-prod-github-runner-207 kernel: [31248.562285] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 14:04:34 juju-e4d256-prod-github-runner-207 kernel: [31248.563334] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 14:04:34 juju-e4d256-prod-github-runner-207 kernel: [31248.564512] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 14:04:34 juju-e4d256-prod-github-runner-207 kernel: [31248.565690] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 14:04:34 juju-e4d256-prod-github-runner-207 kernel: [31248.566876] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 14:04:34 juju-e4d256-prod-github-runner-207 kernel: [31248.568245] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 14:04:34 juju-e4d256-prod-github-runner-207 kernel: [31248.569426] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 14:04:34 juju-e4d256-prod-github-runner-207 kernel: [31248.570666] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 14:04:34 juju-e4d256-prod-github-runner-207 kernel: [31248.571797] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 14:04:34 juju-e4d256-prod-github-runner-207 kernel: [31248.573005] Call Trace: Aug 22 14:04:34 juju-e4d256-prod-github-runner-207 kernel: [31248.573919] Aug 22 14:04:34 juju-e4d256-prod-github-runner-207 kernel: [31248.574803] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:04:34 juju-e4d256-prod-github-runner-207 kernel: [31248.575846] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:04:34 juju-e4d256-prod-github-runner-207 kernel: [31248.576884] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:04:34 juju-e4d256-prod-github-runner-207 kernel: [31248.577996] ? show_regs.part.0+0x23/0x29 Aug 22 14:04:34 juju-e4d256-prod-github-runner-207 kernel: [31248.579002] ? show_regs.cold+0x8/0xd Aug 22 14:04:34 juju-e4d256-prod-github-runner-207 kernel: [31248.579993] ? watchdog_timer_fn+0x1be/0x220 Aug 22 14:04:34 juju-e4d256-prod-github-runner-207 kernel: [31248.581009] ? lockup_detector_update_enable+0x60/0x60 Aug 22 14:04:34 juju-e4d256-prod-github-runner-207 kernel: [31248.582085] ? __hrtimer_run_queues+0x107/0x230 Aug 22 14:04:34 juju-e4d256-prod-github-runner-207 kernel: [31248.583130] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 14:04:34 juju-e4d256-prod-github-runner-207 kernel: [31248.584175] ? hrtimer_interrupt+0x101/0x220 Aug 22 14:04:34 juju-e4d256-prod-github-runner-207 kernel: [31248.585220] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 14:04:34 juju-e4d256-prod-github-runner-207 kernel: [31248.586325] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 14:04:34 juju-e4d256-prod-github-runner-207 kernel: [31248.587409] Aug 22 14:04:34 juju-e4d256-prod-github-runner-207 kernel: [31248.588309] Aug 22 14:04:34 juju-e4d256-prod-github-runner-207 kernel: [31248.589156] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 14:04:34 juju-e4d256-prod-github-runner-207 kernel: [31248.590191] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:04:34 juju-e4d256-prod-github-runner-207 kernel: [31248.591238] ? _raw_spin_lock+0x22/0x30 Aug 22 14:04:34 juju-e4d256-prod-github-runner-207 kernel: [31248.592337] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:04:34 juju-e4d256-prod-github-runner-207 kernel: [31248.593585] direct_page_fault+0x206/0x310 [kvm] Aug 22 14:04:34 juju-e4d256-prod-github-runner-207 kernel: [31248.594634] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 14:04:34 juju-e4d256-prod-github-runner-207 kernel: [31248.595659] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 14:04:34 juju-e4d256-prod-github-runner-207 kernel: [31248.596661] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 14:04:34 juju-e4d256-prod-github-runner-207 kernel: [31248.597657] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 14:04:34 juju-e4d256-prod-github-runner-207 kernel: [31248.598636] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 14:04:34 juju-e4d256-prod-github-runner-207 kernel: [31248.599632] handle_exit+0x98/0x230 [kvm_amd] Aug 22 14:04:34 juju-e4d256-prod-github-runner-207 kernel: [31248.600528] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 14:04:34 juju-e4d256-prod-github-runner-207 kernel: [31248.601450] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 14:04:34 juju-e4d256-prod-github-runner-207 kernel: [31248.602390] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 14:04:34 juju-e4d256-prod-github-runner-207 kernel: [31248.603314] vcpu_run+0x62/0x2c0 [kvm] Aug 22 14:04:34 juju-e4d256-prod-github-runner-207 kernel: [31248.604142] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 14:04:34 juju-e4d256-prod-github-runner-207 kernel: [31248.604964] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 14:04:34 juju-e4d256-prod-github-runner-207 kernel: [31248.605824] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 14:04:34 juju-e4d256-prod-github-runner-207 kernel: [31248.606625] ? __seccomp_filter+0x4a/0x4a0 Aug 22 14:04:34 juju-e4d256-prod-github-runner-207 kernel: [31248.607380] ? __fget_files+0x86/0xc0 Aug 22 14:04:34 juju-e4d256-prod-github-runner-207 kernel: [31248.608165] __x64_sys_ioctl+0x95/0xd0 Aug 22 14:04:34 juju-e4d256-prod-github-runner-207 kernel: [31248.608880] do_syscall_64+0x5c/0xc0 Aug 22 14:04:34 juju-e4d256-prod-github-runner-207 kernel: [31248.609555] ? do_futex+0x162/0x1f0 Aug 22 14:04:34 juju-e4d256-prod-github-runner-207 kernel: [31248.610216] ? __x64_sys_futex+0x78/0x1e0 Aug 22 14:04:34 juju-e4d256-prod-github-runner-207 kernel: [31248.610896] ? __secure_computing+0xa9/0x120 Aug 22 14:04:34 juju-e4d256-prod-github-runner-207 kernel: [31248.611590] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 14:04:34 juju-e4d256-prod-github-runner-207 kernel: [31248.612454] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:04:34 juju-e4d256-prod-github-runner-207 kernel: [31248.613195] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:04:34 juju-e4d256-prod-github-runner-207 kernel: [31248.613926] ? do_syscall_64+0x69/0xc0 Aug 22 14:04:34 juju-e4d256-prod-github-runner-207 kernel: [31248.614578] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:04:34 juju-e4d256-prod-github-runner-207 kernel: [31248.615289] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:04:34 juju-e4d256-prod-github-runner-207 kernel: [31248.616002] ? do_syscall_64+0x69/0xc0 Aug 22 14:04:34 juju-e4d256-prod-github-runner-207 kernel: [31248.616637] ? do_syscall_64+0x69/0xc0 Aug 22 14:04:34 juju-e4d256-prod-github-runner-207 kernel: [31248.617270] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 14:04:34 juju-e4d256-prod-github-runner-207 kernel: [31248.617989] RIP: 0033:0x7faa5d0edaff Aug 22 14:04:34 juju-e4d256-prod-github-runner-207 kernel: [31248.618646] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 14:04:34 juju-e4d256-prod-github-runner-207 kernel: [31248.620667] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 14:04:34 juju-e4d256-prod-github-runner-207 kernel: [31248.621589] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 14:04:34 juju-e4d256-prod-github-runner-207 kernel: [31248.622503] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 14:04:34 juju-e4d256-prod-github-runner-207 kernel: [31248.623403] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 14:04:34 juju-e4d256-prod-github-runner-207 kernel: [31248.624324] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 14:04:34 juju-e4d256-prod-github-runner-207 kernel: [31248.625220] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 14:04:34 juju-e4d256-prod-github-runner-207 kernel: [31248.626117] Aug 22 14:05:02 juju-e4d256-prod-github-runner-207 kernel: [31276.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 29020s! [qemu-system-x86:6715] Aug 22 14:05:02 juju-e4d256-prod-github-runner-207 kernel: [31276.543117] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 14:05:02 juju-e4d256-prod-github-runner-207 kernel: [31276.543193] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 14:05:02 juju-e4d256-prod-github-runner-207 kernel: [31276.555894] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 14:05:02 juju-e4d256-prod-github-runner-207 kernel: [31276.557329] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 14:05:02 juju-e4d256-prod-github-runner-207 kernel: [31276.558592] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:05:02 juju-e4d256-prod-github-runner-207 kernel: [31276.559701] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 14:05:02 juju-e4d256-prod-github-runner-207 kernel: [31276.562306] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 14:05:02 juju-e4d256-prod-github-runner-207 kernel: [31276.563383] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 14:05:02 juju-e4d256-prod-github-runner-207 kernel: [31276.564552] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 14:05:02 juju-e4d256-prod-github-runner-207 kernel: [31276.565715] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 14:05:02 juju-e4d256-prod-github-runner-207 kernel: [31276.566870] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 14:05:02 juju-e4d256-prod-github-runner-207 kernel: [31276.568050] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 14:05:02 juju-e4d256-prod-github-runner-207 kernel: [31276.569271] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 14:05:02 juju-e4d256-prod-github-runner-207 kernel: [31276.570516] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 14:05:02 juju-e4d256-prod-github-runner-207 kernel: [31276.571636] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 14:05:02 juju-e4d256-prod-github-runner-207 kernel: [31276.572833] Call Trace: Aug 22 14:05:02 juju-e4d256-prod-github-runner-207 kernel: [31276.573745] Aug 22 14:05:02 juju-e4d256-prod-github-runner-207 kernel: [31276.574680] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:05:02 juju-e4d256-prod-github-runner-207 kernel: [31276.575752] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:05:02 juju-e4d256-prod-github-runner-207 kernel: [31276.576798] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:05:02 juju-e4d256-prod-github-runner-207 kernel: [31276.577878] ? show_regs.part.0+0x23/0x29 Aug 22 14:05:02 juju-e4d256-prod-github-runner-207 kernel: [31276.578874] ? show_regs.cold+0x8/0xd Aug 22 14:05:02 juju-e4d256-prod-github-runner-207 kernel: [31276.579862] ? watchdog_timer_fn+0x1be/0x220 Aug 22 14:05:02 juju-e4d256-prod-github-runner-207 kernel: [31276.580985] ? lockup_detector_update_enable+0x60/0x60 Aug 22 14:05:02 juju-e4d256-prod-github-runner-207 kernel: [31276.582078] ? __hrtimer_run_queues+0x107/0x230 Aug 22 14:05:02 juju-e4d256-prod-github-runner-207 kernel: [31276.583107] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 14:05:02 juju-e4d256-prod-github-runner-207 kernel: [31276.584155] ? hrtimer_interrupt+0x101/0x220 Aug 22 14:05:02 juju-e4d256-prod-github-runner-207 kernel: [31276.585174] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 14:05:02 juju-e4d256-prod-github-runner-207 kernel: [31276.586241] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 14:05:02 juju-e4d256-prod-github-runner-207 kernel: [31276.587299] Aug 22 14:05:02 juju-e4d256-prod-github-runner-207 kernel: [31276.588154] Aug 22 14:05:02 juju-e4d256-prod-github-runner-207 kernel: [31276.588993] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 14:05:02 juju-e4d256-prod-github-runner-207 kernel: [31276.590026] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:05:02 juju-e4d256-prod-github-runner-207 kernel: [31276.591066] ? _raw_spin_lock+0x22/0x30 Aug 22 14:05:02 juju-e4d256-prod-github-runner-207 kernel: [31276.592025] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:05:02 juju-e4d256-prod-github-runner-207 kernel: [31276.593040] direct_page_fault+0x206/0x310 [kvm] Aug 22 14:05:02 juju-e4d256-prod-github-runner-207 kernel: [31276.594122] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 14:05:02 juju-e4d256-prod-github-runner-207 kernel: [31276.595137] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 14:05:02 juju-e4d256-prod-github-runner-207 kernel: [31276.596167] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 14:05:02 juju-e4d256-prod-github-runner-207 kernel: [31276.597150] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 14:05:02 juju-e4d256-prod-github-runner-207 kernel: [31276.598093] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 14:05:02 juju-e4d256-prod-github-runner-207 kernel: [31276.599068] handle_exit+0x98/0x230 [kvm_amd] Aug 22 14:05:02 juju-e4d256-prod-github-runner-207 kernel: [31276.599975] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 14:05:02 juju-e4d256-prod-github-runner-207 kernel: [31276.600887] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 14:05:02 juju-e4d256-prod-github-runner-207 kernel: [31276.601808] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 14:05:02 juju-e4d256-prod-github-runner-207 kernel: [31276.602719] vcpu_run+0x62/0x2c0 [kvm] Aug 22 14:05:02 juju-e4d256-prod-github-runner-207 kernel: [31276.603544] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 14:05:02 juju-e4d256-prod-github-runner-207 kernel: [31276.604352] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 14:05:02 juju-e4d256-prod-github-runner-207 kernel: [31276.605209] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 14:05:02 juju-e4d256-prod-github-runner-207 kernel: [31276.606004] ? __seccomp_filter+0x4a/0x4a0 Aug 22 14:05:02 juju-e4d256-prod-github-runner-207 kernel: [31276.606750] ? __fget_files+0x86/0xc0 Aug 22 14:05:02 juju-e4d256-prod-github-runner-207 kernel: [31276.607468] __x64_sys_ioctl+0x95/0xd0 Aug 22 14:05:02 juju-e4d256-prod-github-runner-207 kernel: [31276.608162] do_syscall_64+0x5c/0xc0 Aug 22 14:05:02 juju-e4d256-prod-github-runner-207 kernel: [31276.608824] ? do_futex+0x162/0x1f0 Aug 22 14:05:02 juju-e4d256-prod-github-runner-207 kernel: [31276.609476] ? __x64_sys_futex+0x78/0x1e0 Aug 22 14:05:02 juju-e4d256-prod-github-runner-207 kernel: [31276.610149] ? __secure_computing+0xa9/0x120 Aug 22 14:05:02 juju-e4d256-prod-github-runner-207 kernel: [31276.610857] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 14:05:02 juju-e4d256-prod-github-runner-207 kernel: [31276.611631] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:05:02 juju-e4d256-prod-github-runner-207 kernel: [31276.612362] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:05:02 juju-e4d256-prod-github-runner-207 kernel: [31276.613090] ? do_syscall_64+0x69/0xc0 Aug 22 14:05:02 juju-e4d256-prod-github-runner-207 kernel: [31276.613736] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:05:02 juju-e4d256-prod-github-runner-207 kernel: [31276.614442] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:05:02 juju-e4d256-prod-github-runner-207 kernel: [31276.615149] ? do_syscall_64+0x69/0xc0 Aug 22 14:05:02 juju-e4d256-prod-github-runner-207 kernel: [31276.615781] ? do_syscall_64+0x69/0xc0 Aug 22 14:05:02 juju-e4d256-prod-github-runner-207 kernel: [31276.616450] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 14:05:02 juju-e4d256-prod-github-runner-207 kernel: [31276.617158] RIP: 0033:0x7faa5d0edaff Aug 22 14:05:02 juju-e4d256-prod-github-runner-207 kernel: [31276.617778] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 14:05:02 juju-e4d256-prod-github-runner-207 kernel: [31276.619793] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 14:05:02 juju-e4d256-prod-github-runner-207 kernel: [31276.620706] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 14:05:02 juju-e4d256-prod-github-runner-207 kernel: [31276.621610] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 14:05:02 juju-e4d256-prod-github-runner-207 kernel: [31276.622498] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 14:05:02 juju-e4d256-prod-github-runner-207 kernel: [31276.623385] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 14:05:02 juju-e4d256-prod-github-runner-207 kernel: [31276.624271] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 14:05:02 juju-e4d256-prod-github-runner-207 kernel: [31276.625168] Aug 22 14:05:30 juju-e4d256-prod-github-runner-207 kernel: [31304.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 29046s! [qemu-system-x86:6715] Aug 22 14:05:30 juju-e4d256-prod-github-runner-207 kernel: [31304.543861] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 14:05:30 juju-e4d256-prod-github-runner-207 kernel: [31304.544169] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 14:05:30 juju-e4d256-prod-github-runner-207 kernel: [31304.556314] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 14:05:30 juju-e4d256-prod-github-runner-207 kernel: [31304.557609] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 14:05:30 juju-e4d256-prod-github-runner-207 kernel: [31304.558838] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:05:30 juju-e4d256-prod-github-runner-207 kernel: [31304.559917] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 14:05:30 juju-e4d256-prod-github-runner-207 kernel: [31304.562463] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 14:05:30 juju-e4d256-prod-github-runner-207 kernel: [31304.563531] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 14:05:30 juju-e4d256-prod-github-runner-207 kernel: [31304.564694] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 14:05:30 juju-e4d256-prod-github-runner-207 kernel: [31304.565889] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 14:05:30 juju-e4d256-prod-github-runner-207 kernel: [31304.567070] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 14:05:30 juju-e4d256-prod-github-runner-207 kernel: [31304.568249] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 14:05:30 juju-e4d256-prod-github-runner-207 kernel: [31304.569414] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 14:05:30 juju-e4d256-prod-github-runner-207 kernel: [31304.570642] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 14:05:30 juju-e4d256-prod-github-runner-207 kernel: [31304.571746] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 14:05:30 juju-e4d256-prod-github-runner-207 kernel: [31304.572989] Call Trace: Aug 22 14:05:30 juju-e4d256-prod-github-runner-207 kernel: [31304.573900] Aug 22 14:05:30 juju-e4d256-prod-github-runner-207 kernel: [31304.574980] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:05:30 juju-e4d256-prod-github-runner-207 kernel: [31304.576009] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:05:30 juju-e4d256-prod-github-runner-207 kernel: [31304.577049] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:05:30 juju-e4d256-prod-github-runner-207 kernel: [31304.578160] ? show_regs.part.0+0x23/0x29 Aug 22 14:05:30 juju-e4d256-prod-github-runner-207 kernel: [31304.579173] ? show_regs.cold+0x8/0xd Aug 22 14:05:30 juju-e4d256-prod-github-runner-207 kernel: [31304.580144] ? watchdog_timer_fn+0x1be/0x220 Aug 22 14:05:30 juju-e4d256-prod-github-runner-207 kernel: [31304.581152] ? lockup_detector_update_enable+0x60/0x60 Aug 22 14:05:30 juju-e4d256-prod-github-runner-207 kernel: [31304.582218] ? __hrtimer_run_queues+0x107/0x230 Aug 22 14:05:30 juju-e4d256-prod-github-runner-207 kernel: [31304.583255] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 14:05:30 juju-e4d256-prod-github-runner-207 kernel: [31304.584277] ? hrtimer_interrupt+0x101/0x220 Aug 22 14:05:30 juju-e4d256-prod-github-runner-207 kernel: [31304.585290] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 14:05:30 juju-e4d256-prod-github-runner-207 kernel: [31304.586361] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 14:05:30 juju-e4d256-prod-github-runner-207 kernel: [31304.587414] Aug 22 14:05:30 juju-e4d256-prod-github-runner-207 kernel: [31304.588267] Aug 22 14:05:30 juju-e4d256-prod-github-runner-207 kernel: [31304.589102] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 14:05:30 juju-e4d256-prod-github-runner-207 kernel: [31304.590134] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:05:30 juju-e4d256-prod-github-runner-207 kernel: [31304.591226] ? _raw_spin_lock+0x22/0x30 Aug 22 14:05:30 juju-e4d256-prod-github-runner-207 kernel: [31304.592174] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:05:30 juju-e4d256-prod-github-runner-207 kernel: [31304.593195] direct_page_fault+0x206/0x310 [kvm] Aug 22 14:05:30 juju-e4d256-prod-github-runner-207 kernel: [31304.594217] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 14:05:30 juju-e4d256-prod-github-runner-207 kernel: [31304.595280] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 14:05:30 juju-e4d256-prod-github-runner-207 kernel: [31304.596311] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 14:05:30 juju-e4d256-prod-github-runner-207 kernel: [31304.597307] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 14:05:30 juju-e4d256-prod-github-runner-207 kernel: [31304.598251] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 14:05:30 juju-e4d256-prod-github-runner-207 kernel: [31304.599246] handle_exit+0x98/0x230 [kvm_amd] Aug 22 14:05:30 juju-e4d256-prod-github-runner-207 kernel: [31304.600139] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 14:05:30 juju-e4d256-prod-github-runner-207 kernel: [31304.601081] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 14:05:30 juju-e4d256-prod-github-runner-207 kernel: [31304.602004] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 14:05:30 juju-e4d256-prod-github-runner-207 kernel: [31304.602904] vcpu_run+0x62/0x2c0 [kvm] Aug 22 14:05:30 juju-e4d256-prod-github-runner-207 kernel: [31304.603724] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 14:05:30 juju-e4d256-prod-github-runner-207 kernel: [31304.604533] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 14:05:30 juju-e4d256-prod-github-runner-207 kernel: [31304.605386] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 14:05:30 juju-e4d256-prod-github-runner-207 kernel: [31304.606188] ? __seccomp_filter+0x4a/0x4a0 Aug 22 14:05:30 juju-e4d256-prod-github-runner-207 kernel: [31304.606998] ? __fget_files+0x86/0xc0 Aug 22 14:05:30 juju-e4d256-prod-github-runner-207 kernel: [31304.607730] __x64_sys_ioctl+0x95/0xd0 Aug 22 14:05:30 juju-e4d256-prod-github-runner-207 kernel: [31304.608442] do_syscall_64+0x5c/0xc0 Aug 22 14:05:30 juju-e4d256-prod-github-runner-207 kernel: [31304.609104] ? do_futex+0x162/0x1f0 Aug 22 14:05:30 juju-e4d256-prod-github-runner-207 kernel: [31304.609773] ? __x64_sys_futex+0x78/0x1e0 Aug 22 14:05:30 juju-e4d256-prod-github-runner-207 kernel: [31304.610445] ? __secure_computing+0xa9/0x120 Aug 22 14:05:30 juju-e4d256-prod-github-runner-207 kernel: [31304.611149] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 14:05:30 juju-e4d256-prod-github-runner-207 kernel: [31304.611909] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:05:30 juju-e4d256-prod-github-runner-207 kernel: [31304.612629] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:05:30 juju-e4d256-prod-github-runner-207 kernel: [31304.613345] ? do_syscall_64+0x69/0xc0 Aug 22 14:05:30 juju-e4d256-prod-github-runner-207 kernel: [31304.613987] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:05:30 juju-e4d256-prod-github-runner-207 kernel: [31304.614688] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:05:30 juju-e4d256-prod-github-runner-207 kernel: [31304.615391] ? do_syscall_64+0x69/0xc0 Aug 22 14:05:30 juju-e4d256-prod-github-runner-207 kernel: [31304.616015] ? do_syscall_64+0x69/0xc0 Aug 22 14:05:30 juju-e4d256-prod-github-runner-207 kernel: [31304.616641] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 14:05:30 juju-e4d256-prod-github-runner-207 kernel: [31304.617350] RIP: 0033:0x7faa5d0edaff Aug 22 14:05:30 juju-e4d256-prod-github-runner-207 kernel: [31304.617998] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 14:05:30 juju-e4d256-prod-github-runner-207 kernel: [31304.619998] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 14:05:30 juju-e4d256-prod-github-runner-207 kernel: [31304.620905] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 14:05:30 juju-e4d256-prod-github-runner-207 kernel: [31304.621792] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 14:05:30 juju-e4d256-prod-github-runner-207 kernel: [31304.622684] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 14:05:30 juju-e4d256-prod-github-runner-207 kernel: [31304.623614] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 14:05:30 juju-e4d256-prod-github-runner-207 kernel: [31304.624506] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 14:05:30 juju-e4d256-prod-github-runner-207 kernel: [31304.625406] Aug 22 14:05:45 juju-e4d256-prod-github-runner-207 kernel: [31319.276706] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 14:05:45 juju-e4d256-prod-github-runner-207 kernel: [31319.277659] rcu: 1-....: (7776177 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=3757787 Aug 22 14:05:45 juju-e4d256-prod-github-runner-207 kernel: [31319.278794] (t=7800519 jiffies g=23269 q=34302) Aug 22 14:05:45 juju-e4d256-prod-github-runner-207 kernel: [31319.279584] NMI backtrace for cpu 1 Aug 22 14:05:45 juju-e4d256-prod-github-runner-207 kernel: [31319.280291] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 14:05:45 juju-e4d256-prod-github-runner-207 kernel: [31319.281391] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 14:05:45 juju-e4d256-prod-github-runner-207 kernel: [31319.282445] Call Trace: Aug 22 14:05:45 juju-e4d256-prod-github-runner-207 kernel: [31319.283142] Aug 22 14:05:45 juju-e4d256-prod-github-runner-207 kernel: [31319.283785] show_stack+0x52/0x5c Aug 22 14:05:45 juju-e4d256-prod-github-runner-207 kernel: [31319.284516] dump_stack_lvl+0x4a/0x63 Aug 22 14:05:45 juju-e4d256-prod-github-runner-207 kernel: [31319.285259] dump_stack+0x10/0x16 Aug 22 14:05:45 juju-e4d256-prod-github-runner-207 kernel: [31319.285974] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 14:05:45 juju-e4d256-prod-github-runner-207 kernel: [31319.286757] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 14:05:45 juju-e4d256-prod-github-runner-207 kernel: [31319.287551] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 14:05:45 juju-e4d256-prod-github-runner-207 kernel: [31319.288374] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 14:05:45 juju-e4d256-prod-github-runner-207 kernel: [31319.289207] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 14:05:45 juju-e4d256-prod-github-runner-207 kernel: [31319.290019] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 14:05:45 juju-e4d256-prod-github-runner-207 kernel: [31319.290813] print_cpu_stall.cold+0x2f/0xe2 Aug 22 14:05:45 juju-e4d256-prod-github-runner-207 kernel: [31319.291587] ? timekeeping_update+0xf7/0x150 Aug 22 14:05:45 juju-e4d256-prod-github-runner-207 kernel: [31319.292364] check_cpu_stall+0x109/0x270 Aug 22 14:05:45 juju-e4d256-prod-github-runner-207 kernel: [31319.293118] rcu_sched_clock_irq+0x9a/0x250 Aug 22 14:05:45 juju-e4d256-prod-github-runner-207 kernel: [31319.293883] update_process_times+0x94/0xd0 Aug 22 14:05:45 juju-e4d256-prod-github-runner-207 kernel: [31319.294641] tick_sched_handle+0x29/0x70 Aug 22 14:05:45 juju-e4d256-prod-github-runner-207 kernel: [31319.295405] tick_sched_timer+0x8c/0xc0 Aug 22 14:05:45 juju-e4d256-prod-github-runner-207 kernel: [31319.296147] ? tick_nohz_handler+0xb0/0xb0 Aug 22 14:05:45 juju-e4d256-prod-github-runner-207 kernel: [31319.296904] __hrtimer_run_queues+0x107/0x230 Aug 22 14:05:45 juju-e4d256-prod-github-runner-207 kernel: [31319.297675] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 14:05:45 juju-e4d256-prod-github-runner-207 kernel: [31319.298455] hrtimer_interrupt+0x101/0x220 Aug 22 14:05:45 juju-e4d256-prod-github-runner-207 kernel: [31319.299244] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 14:05:45 juju-e4d256-prod-github-runner-207 kernel: [31319.300074] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 14:05:45 juju-e4d256-prod-github-runner-207 kernel: [31319.300886] Aug 22 14:05:45 juju-e4d256-prod-github-runner-207 kernel: [31319.301528] Aug 22 14:05:45 juju-e4d256-prod-github-runner-207 kernel: [31319.302159] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 14:05:45 juju-e4d256-prod-github-runner-207 kernel: [31319.303005] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:05:45 juju-e4d256-prod-github-runner-207 kernel: [31319.303897] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 14:05:45 juju-e4d256-prod-github-runner-207 kernel: [31319.306129] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 14:05:45 juju-e4d256-prod-github-runner-207 kernel: [31319.307029] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 14:05:45 juju-e4d256-prod-github-runner-207 kernel: [31319.308036] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 14:05:45 juju-e4d256-prod-github-runner-207 kernel: [31319.309021] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 14:05:45 juju-e4d256-prod-github-runner-207 kernel: [31319.309993] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 14:05:45 juju-e4d256-prod-github-runner-207 kernel: [31319.310975] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 14:05:45 juju-e4d256-prod-github-runner-207 kernel: [31319.311927] ? _raw_spin_lock+0x22/0x30 Aug 22 14:05:45 juju-e4d256-prod-github-runner-207 kernel: [31319.312684] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:05:45 juju-e4d256-prod-github-runner-207 kernel: [31319.313593] direct_page_fault+0x206/0x310 [kvm] Aug 22 14:05:45 juju-e4d256-prod-github-runner-207 kernel: [31319.314444] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 14:05:45 juju-e4d256-prod-github-runner-207 kernel: [31319.315307] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 14:05:45 juju-e4d256-prod-github-runner-207 kernel: [31319.316130] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 14:05:45 juju-e4d256-prod-github-runner-207 kernel: [31319.316932] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 14:05:45 juju-e4d256-prod-github-runner-207 kernel: [31319.317714] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 14:05:45 juju-e4d256-prod-github-runner-207 kernel: [31319.318540] handle_exit+0x98/0x230 [kvm_amd] Aug 22 14:05:45 juju-e4d256-prod-github-runner-207 kernel: [31319.319308] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 14:05:45 juju-e4d256-prod-github-runner-207 kernel: [31319.320091] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 14:05:45 juju-e4d256-prod-github-runner-207 kernel: [31319.320895] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 14:05:45 juju-e4d256-prod-github-runner-207 kernel: [31319.321680] vcpu_run+0x62/0x2c0 [kvm] Aug 22 14:05:45 juju-e4d256-prod-github-runner-207 kernel: [31319.322395] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 14:05:45 juju-e4d256-prod-github-runner-207 kernel: [31319.323148] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 14:05:45 juju-e4d256-prod-github-runner-207 kernel: [31319.323953] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 14:05:45 juju-e4d256-prod-github-runner-207 kernel: [31319.324723] ? __seccomp_filter+0x4a/0x4a0 Aug 22 14:05:45 juju-e4d256-prod-github-runner-207 kernel: [31319.325442] ? __fget_files+0x86/0xc0 Aug 22 14:05:45 juju-e4d256-prod-github-runner-207 kernel: [31319.326145] __x64_sys_ioctl+0x95/0xd0 Aug 22 14:05:45 juju-e4d256-prod-github-runner-207 kernel: [31319.326861] do_syscall_64+0x5c/0xc0 Aug 22 14:05:45 juju-e4d256-prod-github-runner-207 kernel: [31319.327541] ? do_futex+0x162/0x1f0 Aug 22 14:05:45 juju-e4d256-prod-github-runner-207 kernel: [31319.328212] ? __x64_sys_futex+0x78/0x1e0 Aug 22 14:05:45 juju-e4d256-prod-github-runner-207 kernel: [31319.328911] ? __secure_computing+0xa9/0x120 Aug 22 14:05:45 juju-e4d256-prod-github-runner-207 kernel: [31319.329631] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 14:05:45 juju-e4d256-prod-github-runner-207 kernel: [31319.330417] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:05:45 juju-e4d256-prod-github-runner-207 kernel: [31319.331197] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:05:45 juju-e4d256-prod-github-runner-207 kernel: [31319.331954] ? do_syscall_64+0x69/0xc0 Aug 22 14:05:45 juju-e4d256-prod-github-runner-207 kernel: [31319.332648] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:05:45 juju-e4d256-prod-github-runner-207 kernel: [31319.333403] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:05:45 juju-e4d256-prod-github-runner-207 kernel: [31319.334158] ? do_syscall_64+0x69/0xc0 Aug 22 14:05:45 juju-e4d256-prod-github-runner-207 kernel: [31319.334872] ? do_syscall_64+0x69/0xc0 Aug 22 14:05:45 juju-e4d256-prod-github-runner-207 kernel: [31319.335566] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 14:05:45 juju-e4d256-prod-github-runner-207 kernel: [31319.336334] RIP: 0033:0x7faa5d0edaff Aug 22 14:05:45 juju-e4d256-prod-github-runner-207 kernel: [31319.337016] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 14:05:45 juju-e4d256-prod-github-runner-207 kernel: [31319.339127] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 14:05:45 juju-e4d256-prod-github-runner-207 kernel: [31319.340100] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 14:05:45 juju-e4d256-prod-github-runner-207 kernel: [31319.341049] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 14:05:45 juju-e4d256-prod-github-runner-207 kernel: [31319.342003] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 14:05:45 juju-e4d256-prod-github-runner-207 kernel: [31319.342967] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 14:05:45 juju-e4d256-prod-github-runner-207 kernel: [31319.343895] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 14:05:45 juju-e4d256-prod-github-runner-207 kernel: [31319.344810] Aug 22 14:06:10 juju-e4d256-prod-github-runner-207 kernel: [31344.541980] watchdog: BUG: soft lockup - CPU#1 stuck for 29083s! [qemu-system-x86:6715] Aug 22 14:06:10 juju-e4d256-prod-github-runner-207 kernel: [31344.543352] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 14:06:10 juju-e4d256-prod-github-runner-207 kernel: [31344.543446] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 14:06:10 juju-e4d256-prod-github-runner-207 kernel: [31344.558097] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 14:06:10 juju-e4d256-prod-github-runner-207 kernel: [31344.559411] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 14:06:10 juju-e4d256-prod-github-runner-207 kernel: [31344.560905] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:06:10 juju-e4d256-prod-github-runner-207 kernel: [31344.562360] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 14:06:10 juju-e4d256-prod-github-runner-207 kernel: [31344.565068] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 14:06:10 juju-e4d256-prod-github-runner-207 kernel: [31344.566119] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 14:06:10 juju-e4d256-prod-github-runner-207 kernel: [31344.567331] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 14:06:10 juju-e4d256-prod-github-runner-207 kernel: [31344.568527] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 14:06:10 juju-e4d256-prod-github-runner-207 kernel: [31344.569933] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 14:06:10 juju-e4d256-prod-github-runner-207 kernel: [31344.571331] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 14:06:10 juju-e4d256-prod-github-runner-207 kernel: [31344.572747] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 14:06:10 juju-e4d256-prod-github-runner-207 kernel: [31344.574026] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 14:06:10 juju-e4d256-prod-github-runner-207 kernel: [31344.575248] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 14:06:10 juju-e4d256-prod-github-runner-207 kernel: [31344.576769] Call Trace: Aug 22 14:06:10 juju-e4d256-prod-github-runner-207 kernel: [31344.577699] Aug 22 14:06:10 juju-e4d256-prod-github-runner-207 kernel: [31344.578757] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:06:10 juju-e4d256-prod-github-runner-207 kernel: [31344.579952] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:06:10 juju-e4d256-prod-github-runner-207 kernel: [31344.581093] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:06:10 juju-e4d256-prod-github-runner-207 kernel: [31344.582595] ? show_regs.part.0+0x23/0x29 Aug 22 14:06:10 juju-e4d256-prod-github-runner-207 kernel: [31344.583611] ? show_regs.cold+0x8/0xd Aug 22 14:06:10 juju-e4d256-prod-github-runner-207 kernel: [31344.584594] ? watchdog_timer_fn+0x1be/0x220 Aug 22 14:06:10 juju-e4d256-prod-github-runner-207 kernel: [31344.585607] ? lockup_detector_update_enable+0x60/0x60 Aug 22 14:06:10 juju-e4d256-prod-github-runner-207 kernel: [31344.586705] ? __hrtimer_run_queues+0x107/0x230 Aug 22 14:06:10 juju-e4d256-prod-github-runner-207 kernel: [31344.587859] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 14:06:10 juju-e4d256-prod-github-runner-207 kernel: [31344.589049] ? hrtimer_interrupt+0x101/0x220 Aug 22 14:06:10 juju-e4d256-prod-github-runner-207 kernel: [31344.590195] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 14:06:10 juju-e4d256-prod-github-runner-207 kernel: [31344.591684] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 14:06:10 juju-e4d256-prod-github-runner-207 kernel: [31344.592749] Aug 22 14:06:10 juju-e4d256-prod-github-runner-207 kernel: [31344.593767] Aug 22 14:06:10 juju-e4d256-prod-github-runner-207 kernel: [31344.594852] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 14:06:10 juju-e4d256-prod-github-runner-207 kernel: [31344.595906] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:06:10 juju-e4d256-prod-github-runner-207 kernel: [31344.596974] ? _raw_spin_lock+0x22/0x30 Aug 22 14:06:10 juju-e4d256-prod-github-runner-207 kernel: [31344.597928] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:06:10 juju-e4d256-prod-github-runner-207 kernel: [31344.599224] direct_page_fault+0x206/0x310 [kvm] Aug 22 14:06:10 juju-e4d256-prod-github-runner-207 kernel: [31344.600436] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 14:06:10 juju-e4d256-prod-github-runner-207 kernel: [31344.601936] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 14:06:10 juju-e4d256-prod-github-runner-207 kernel: [31344.603028] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 14:06:10 juju-e4d256-prod-github-runner-207 kernel: [31344.604009] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 14:06:10 juju-e4d256-prod-github-runner-207 kernel: [31344.604976] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 14:06:10 juju-e4d256-prod-github-runner-207 kernel: [31344.605995] handle_exit+0x98/0x230 [kvm_amd] Aug 22 14:06:10 juju-e4d256-prod-github-runner-207 kernel: [31344.606935] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 14:06:10 juju-e4d256-prod-github-runner-207 kernel: [31344.608012] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 14:06:10 juju-e4d256-prod-github-runner-207 kernel: [31344.609074] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 14:06:10 juju-e4d256-prod-github-runner-207 kernel: [31344.610261] vcpu_run+0x62/0x2c0 [kvm] Aug 22 14:06:10 juju-e4d256-prod-github-runner-207 kernel: [31344.611453] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 14:06:10 juju-e4d256-prod-github-runner-207 kernel: [31344.612286] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 14:06:10 juju-e4d256-prod-github-runner-207 kernel: [31344.613245] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 14:06:10 juju-e4d256-prod-github-runner-207 kernel: [31344.614081] ? __seccomp_filter+0x4a/0x4a0 Aug 22 14:06:10 juju-e4d256-prod-github-runner-207 kernel: [31344.614884] ? __fget_files+0x86/0xc0 Aug 22 14:06:10 juju-e4d256-prod-github-runner-207 kernel: [31344.615598] __x64_sys_ioctl+0x95/0xd0 Aug 22 14:06:10 juju-e4d256-prod-github-runner-207 kernel: [31344.616320] do_syscall_64+0x5c/0xc0 Aug 22 14:06:10 juju-e4d256-prod-github-runner-207 kernel: [31344.617031] ? do_futex+0x162/0x1f0 Aug 22 14:06:10 juju-e4d256-prod-github-runner-207 kernel: [31344.617682] ? __x64_sys_futex+0x78/0x1e0 Aug 22 14:06:10 juju-e4d256-prod-github-runner-207 kernel: [31344.618370] ? __secure_computing+0xa9/0x120 Aug 22 14:06:10 juju-e4d256-prod-github-runner-207 kernel: [31344.619107] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 14:06:10 juju-e4d256-prod-github-runner-207 kernel: [31344.619867] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:06:10 juju-e4d256-prod-github-runner-207 kernel: [31344.620591] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:06:10 juju-e4d256-prod-github-runner-207 kernel: [31344.621315] ? do_syscall_64+0x69/0xc0 Aug 22 14:06:10 juju-e4d256-prod-github-runner-207 kernel: [31344.621959] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:06:10 juju-e4d256-prod-github-runner-207 kernel: [31344.622704] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:06:10 juju-e4d256-prod-github-runner-207 kernel: [31344.623656] ? do_syscall_64+0x69/0xc0 Aug 22 14:06:10 juju-e4d256-prod-github-runner-207 kernel: [31344.624456] ? do_syscall_64+0x69/0xc0 Aug 22 14:06:10 juju-e4d256-prod-github-runner-207 kernel: [31344.625120] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 14:06:10 juju-e4d256-prod-github-runner-207 kernel: [31344.625882] RIP: 0033:0x7faa5d0edaff Aug 22 14:06:10 juju-e4d256-prod-github-runner-207 kernel: [31344.626536] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 14:06:10 juju-e4d256-prod-github-runner-207 kernel: [31344.628530] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 14:06:10 juju-e4d256-prod-github-runner-207 kernel: [31344.629441] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 14:06:10 juju-e4d256-prod-github-runner-207 kernel: [31344.630332] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 14:06:10 juju-e4d256-prod-github-runner-207 kernel: [31344.631262] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 14:06:10 juju-e4d256-prod-github-runner-207 kernel: [31344.632157] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 14:06:10 juju-e4d256-prod-github-runner-207 kernel: [31344.633054] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 14:06:10 juju-e4d256-prod-github-runner-207 kernel: [31344.633958] Aug 22 14:06:38 juju-e4d256-prod-github-runner-207 kernel: [31372.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 29109s! [qemu-system-x86:6715] Aug 22 14:06:38 juju-e4d256-prod-github-runner-207 kernel: [31372.543138] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 14:06:38 juju-e4d256-prod-github-runner-207 kernel: [31372.543213] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 14:06:38 juju-e4d256-prod-github-runner-207 kernel: [31372.555725] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 14:06:38 juju-e4d256-prod-github-runner-207 kernel: [31372.557040] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 14:06:38 juju-e4d256-prod-github-runner-207 kernel: [31372.558486] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:06:38 juju-e4d256-prod-github-runner-207 kernel: [31372.559558] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 14:06:38 juju-e4d256-prod-github-runner-207 kernel: [31372.562351] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 14:06:38 juju-e4d256-prod-github-runner-207 kernel: [31372.563399] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 14:06:38 juju-e4d256-prod-github-runner-207 kernel: [31372.564574] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 14:06:38 juju-e4d256-prod-github-runner-207 kernel: [31372.565752] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 14:06:38 juju-e4d256-prod-github-runner-207 kernel: [31372.566950] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 14:06:38 juju-e4d256-prod-github-runner-207 kernel: [31372.568133] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 14:06:38 juju-e4d256-prod-github-runner-207 kernel: [31372.569478] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 14:06:38 juju-e4d256-prod-github-runner-207 kernel: [31372.570748] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 14:06:38 juju-e4d256-prod-github-runner-207 kernel: [31372.571866] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 14:06:38 juju-e4d256-prod-github-runner-207 kernel: [31372.573104] Call Trace: Aug 22 14:06:38 juju-e4d256-prod-github-runner-207 kernel: [31372.574051] Aug 22 14:06:38 juju-e4d256-prod-github-runner-207 kernel: [31372.575026] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:06:38 juju-e4d256-prod-github-runner-207 kernel: [31372.576089] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:06:38 juju-e4d256-prod-github-runner-207 kernel: [31372.577166] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:06:38 juju-e4d256-prod-github-runner-207 kernel: [31372.578319] ? show_regs.part.0+0x23/0x29 Aug 22 14:06:38 juju-e4d256-prod-github-runner-207 kernel: [31372.579325] ? show_regs.cold+0x8/0xd Aug 22 14:06:38 juju-e4d256-prod-github-runner-207 kernel: [31372.580303] ? watchdog_timer_fn+0x1be/0x220 Aug 22 14:06:38 juju-e4d256-prod-github-runner-207 kernel: [31372.581364] ? lockup_detector_update_enable+0x60/0x60 Aug 22 14:06:38 juju-e4d256-prod-github-runner-207 kernel: [31372.582541] ? __hrtimer_run_queues+0x107/0x230 Aug 22 14:06:38 juju-e4d256-prod-github-runner-207 kernel: [31372.583619] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 14:06:38 juju-e4d256-prod-github-runner-207 kernel: [31372.584652] ? hrtimer_interrupt+0x101/0x220 Aug 22 14:06:38 juju-e4d256-prod-github-runner-207 kernel: [31372.585677] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 14:06:38 juju-e4d256-prod-github-runner-207 kernel: [31372.586764] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 14:06:38 juju-e4d256-prod-github-runner-207 kernel: [31372.587819] Aug 22 14:06:38 juju-e4d256-prod-github-runner-207 kernel: [31372.588675] Aug 22 14:06:38 juju-e4d256-prod-github-runner-207 kernel: [31372.589556] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 14:06:38 juju-e4d256-prod-github-runner-207 kernel: [31372.590686] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:06:38 juju-e4d256-prod-github-runner-207 kernel: [31372.591836] ? _raw_spin_lock+0x22/0x30 Aug 22 14:06:38 juju-e4d256-prod-github-runner-207 kernel: [31372.592803] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:06:38 juju-e4d256-prod-github-runner-207 kernel: [31372.593844] direct_page_fault+0x206/0x310 [kvm] Aug 22 14:06:38 juju-e4d256-prod-github-runner-207 kernel: [31372.594991] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 14:06:38 juju-e4d256-prod-github-runner-207 kernel: [31372.596035] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 14:06:38 juju-e4d256-prod-github-runner-207 kernel: [31372.597069] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 14:06:38 juju-e4d256-prod-github-runner-207 kernel: [31372.598104] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 14:06:38 juju-e4d256-prod-github-runner-207 kernel: [31372.599094] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 14:06:38 juju-e4d256-prod-github-runner-207 kernel: [31372.600086] handle_exit+0x98/0x230 [kvm_amd] Aug 22 14:06:38 juju-e4d256-prod-github-runner-207 kernel: [31372.600999] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 14:06:38 juju-e4d256-prod-github-runner-207 kernel: [31372.601931] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 14:06:38 juju-e4d256-prod-github-runner-207 kernel: [31372.602919] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 14:06:38 juju-e4d256-prod-github-runner-207 kernel: [31372.603851] vcpu_run+0x62/0x2c0 [kvm] Aug 22 14:06:38 juju-e4d256-prod-github-runner-207 kernel: [31372.604684] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 14:06:38 juju-e4d256-prod-github-runner-207 kernel: [31372.605509] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 14:06:38 juju-e4d256-prod-github-runner-207 kernel: [31372.606434] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 14:06:38 juju-e4d256-prod-github-runner-207 kernel: [31372.607376] ? __seccomp_filter+0x4a/0x4a0 Aug 22 14:06:38 juju-e4d256-prod-github-runner-207 kernel: [31372.608223] ? __fget_files+0x86/0xc0 Aug 22 14:06:38 juju-e4d256-prod-github-runner-207 kernel: [31372.608939] __x64_sys_ioctl+0x95/0xd0 Aug 22 14:06:38 juju-e4d256-prod-github-runner-207 kernel: [31372.609645] do_syscall_64+0x5c/0xc0 Aug 22 14:06:38 juju-e4d256-prod-github-runner-207 kernel: [31372.610362] ? do_futex+0x162/0x1f0 Aug 22 14:06:38 juju-e4d256-prod-github-runner-207 kernel: [31372.611063] ? __x64_sys_futex+0x78/0x1e0 Aug 22 14:06:38 juju-e4d256-prod-github-runner-207 kernel: [31372.611770] ? __secure_computing+0xa9/0x120 Aug 22 14:06:38 juju-e4d256-prod-github-runner-207 kernel: [31372.612481] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 14:06:38 juju-e4d256-prod-github-runner-207 kernel: [31372.613253] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:06:38 juju-e4d256-prod-github-runner-207 kernel: [31372.614059] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:06:38 juju-e4d256-prod-github-runner-207 kernel: [31372.614817] ? do_syscall_64+0x69/0xc0 Aug 22 14:06:38 juju-e4d256-prod-github-runner-207 kernel: [31372.615471] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:06:38 juju-e4d256-prod-github-runner-207 kernel: [31372.616198] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:06:38 juju-e4d256-prod-github-runner-207 kernel: [31372.616905] ? do_syscall_64+0x69/0xc0 Aug 22 14:06:38 juju-e4d256-prod-github-runner-207 kernel: [31372.617539] ? do_syscall_64+0x69/0xc0 Aug 22 14:06:38 juju-e4d256-prod-github-runner-207 kernel: [31372.618211] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 14:06:38 juju-e4d256-prod-github-runner-207 kernel: [31372.618994] RIP: 0033:0x7faa5d0edaff Aug 22 14:06:38 juju-e4d256-prod-github-runner-207 kernel: [31372.619630] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 14:06:38 juju-e4d256-prod-github-runner-207 kernel: [31372.621625] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 14:06:38 juju-e4d256-prod-github-runner-207 kernel: [31372.622713] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 14:06:38 juju-e4d256-prod-github-runner-207 kernel: [31372.623807] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 14:06:38 juju-e4d256-prod-github-runner-207 kernel: [31372.624920] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 14:06:38 juju-e4d256-prod-github-runner-207 kernel: [31372.626114] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 14:06:38 juju-e4d256-prod-github-runner-207 kernel: [31372.627257] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 14:06:38 juju-e4d256-prod-github-runner-207 kernel: [31372.628187] Aug 22 14:07:06 juju-e4d256-prod-github-runner-207 kernel: [31400.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 29136s! [qemu-system-x86:6715] Aug 22 14:07:06 juju-e4d256-prod-github-runner-207 kernel: [31400.543889] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 14:07:06 juju-e4d256-prod-github-runner-207 kernel: [31400.544189] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 14:07:06 juju-e4d256-prod-github-runner-207 kernel: [31400.556768] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 14:07:06 juju-e4d256-prod-github-runner-207 kernel: [31400.558108] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 14:07:06 juju-e4d256-prod-github-runner-207 kernel: [31400.559366] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:07:06 juju-e4d256-prod-github-runner-207 kernel: [31400.560461] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 14:07:06 juju-e4d256-prod-github-runner-207 kernel: [31400.563092] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 14:07:06 juju-e4d256-prod-github-runner-207 kernel: [31400.564153] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 14:07:06 juju-e4d256-prod-github-runner-207 kernel: [31400.565365] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 14:07:06 juju-e4d256-prod-github-runner-207 kernel: [31400.566586] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 14:07:06 juju-e4d256-prod-github-runner-207 kernel: [31400.567783] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 14:07:06 juju-e4d256-prod-github-runner-207 kernel: [31400.568968] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 14:07:06 juju-e4d256-prod-github-runner-207 kernel: [31400.570178] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 14:07:06 juju-e4d256-prod-github-runner-207 kernel: [31400.571456] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 14:07:06 juju-e4d256-prod-github-runner-207 kernel: [31400.572575] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 14:07:06 juju-e4d256-prod-github-runner-207 kernel: [31400.573800] Call Trace: Aug 22 14:07:06 juju-e4d256-prod-github-runner-207 kernel: [31400.574723] Aug 22 14:07:06 juju-e4d256-prod-github-runner-207 kernel: [31400.575666] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:07:06 juju-e4d256-prod-github-runner-207 kernel: [31400.576733] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:07:06 juju-e4d256-prod-github-runner-207 kernel: [31400.577770] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:07:06 juju-e4d256-prod-github-runner-207 kernel: [31400.578907] ? show_regs.part.0+0x23/0x29 Aug 22 14:07:06 juju-e4d256-prod-github-runner-207 kernel: [31400.579933] ? show_regs.cold+0x8/0xd Aug 22 14:07:06 juju-e4d256-prod-github-runner-207 kernel: [31400.580930] ? watchdog_timer_fn+0x1be/0x220 Aug 22 14:07:06 juju-e4d256-prod-github-runner-207 kernel: [31400.581986] ? lockup_detector_update_enable+0x60/0x60 Aug 22 14:07:06 juju-e4d256-prod-github-runner-207 kernel: [31400.583069] ? __hrtimer_run_queues+0x107/0x230 Aug 22 14:07:06 juju-e4d256-prod-github-runner-207 kernel: [31400.584112] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 14:07:06 juju-e4d256-prod-github-runner-207 kernel: [31400.585155] ? hrtimer_interrupt+0x101/0x220 Aug 22 14:07:06 juju-e4d256-prod-github-runner-207 kernel: [31400.586207] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 14:07:06 juju-e4d256-prod-github-runner-207 kernel: [31400.587555] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 14:07:06 juju-e4d256-prod-github-runner-207 kernel: [31400.588632] Aug 22 14:07:06 juju-e4d256-prod-github-runner-207 kernel: [31400.589493] Aug 22 14:07:06 juju-e4d256-prod-github-runner-207 kernel: [31400.590366] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 14:07:06 juju-e4d256-prod-github-runner-207 kernel: [31400.591441] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:07:06 juju-e4d256-prod-github-runner-207 kernel: [31400.592517] ? _raw_spin_lock+0x22/0x30 Aug 22 14:07:06 juju-e4d256-prod-github-runner-207 kernel: [31400.593483] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:07:06 juju-e4d256-prod-github-runner-207 kernel: [31400.594769] direct_page_fault+0x206/0x310 [kvm] Aug 22 14:07:06 juju-e4d256-prod-github-runner-207 kernel: [31400.595815] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 14:07:06 juju-e4d256-prod-github-runner-207 kernel: [31400.596860] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 14:07:06 juju-e4d256-prod-github-runner-207 kernel: [31400.597915] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 14:07:06 juju-e4d256-prod-github-runner-207 kernel: [31400.598967] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 14:07:06 juju-e4d256-prod-github-runner-207 kernel: [31400.599932] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 14:07:06 juju-e4d256-prod-github-runner-207 kernel: [31400.600927] handle_exit+0x98/0x230 [kvm_amd] Aug 22 14:07:06 juju-e4d256-prod-github-runner-207 kernel: [31400.601869] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 14:07:06 juju-e4d256-prod-github-runner-207 kernel: [31400.602821] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 14:07:06 juju-e4d256-prod-github-runner-207 kernel: [31400.603770] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 14:07:06 juju-e4d256-prod-github-runner-207 kernel: [31400.604698] vcpu_run+0x62/0x2c0 [kvm] Aug 22 14:07:06 juju-e4d256-prod-github-runner-207 kernel: [31400.605524] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 14:07:06 juju-e4d256-prod-github-runner-207 kernel: [31400.606362] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 14:07:06 juju-e4d256-prod-github-runner-207 kernel: [31400.607240] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 14:07:06 juju-e4d256-prod-github-runner-207 kernel: [31400.608072] ? __seccomp_filter+0x4a/0x4a0 Aug 22 14:07:06 juju-e4d256-prod-github-runner-207 kernel: [31400.608836] ? __fget_files+0x86/0xc0 Aug 22 14:07:06 juju-e4d256-prod-github-runner-207 kernel: [31400.609557] __x64_sys_ioctl+0x95/0xd0 Aug 22 14:07:06 juju-e4d256-prod-github-runner-207 kernel: [31400.610276] do_syscall_64+0x5c/0xc0 Aug 22 14:07:06 juju-e4d256-prod-github-runner-207 kernel: [31400.610976] ? do_futex+0x162/0x1f0 Aug 22 14:07:06 juju-e4d256-prod-github-runner-207 kernel: [31400.611667] ? __x64_sys_futex+0x78/0x1e0 Aug 22 14:07:06 juju-e4d256-prod-github-runner-207 kernel: [31400.612365] ? __secure_computing+0xa9/0x120 Aug 22 14:07:06 juju-e4d256-prod-github-runner-207 kernel: [31400.613128] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 14:07:06 juju-e4d256-prod-github-runner-207 kernel: [31400.613930] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:07:06 juju-e4d256-prod-github-runner-207 kernel: [31400.614667] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:07:06 juju-e4d256-prod-github-runner-207 kernel: [31400.615400] ? do_syscall_64+0x69/0xc0 Aug 22 14:07:06 juju-e4d256-prod-github-runner-207 kernel: [31400.616055] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:07:06 juju-e4d256-prod-github-runner-207 kernel: [31400.616783] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:07:06 juju-e4d256-prod-github-runner-207 kernel: [31400.617503] ? do_syscall_64+0x69/0xc0 Aug 22 14:07:06 juju-e4d256-prod-github-runner-207 kernel: [31400.618165] ? do_syscall_64+0x69/0xc0 Aug 22 14:07:06 juju-e4d256-prod-github-runner-207 kernel: [31400.618808] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 14:07:06 juju-e4d256-prod-github-runner-207 kernel: [31400.619537] RIP: 0033:0x7faa5d0edaff Aug 22 14:07:06 juju-e4d256-prod-github-runner-207 kernel: [31400.620205] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 14:07:06 juju-e4d256-prod-github-runner-207 kernel: [31400.622451] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 14:07:06 juju-e4d256-prod-github-runner-207 kernel: [31400.623412] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 14:07:06 juju-e4d256-prod-github-runner-207 kernel: [31400.624333] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 14:07:06 juju-e4d256-prod-github-runner-207 kernel: [31400.625243] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 14:07:06 juju-e4d256-prod-github-runner-207 kernel: [31400.626168] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 14:07:06 juju-e4d256-prod-github-runner-207 kernel: [31400.627098] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 14:07:06 juju-e4d256-prod-github-runner-207 kernel: [31400.628022] Aug 22 14:07:34 juju-e4d256-prod-github-runner-207 kernel: [31428.541980] watchdog: BUG: soft lockup - CPU#1 stuck for 29162s! [qemu-system-x86:6715] Aug 22 14:07:34 juju-e4d256-prod-github-runner-207 kernel: [31428.543270] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 14:07:34 juju-e4d256-prod-github-runner-207 kernel: [31428.543342] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 14:07:34 juju-e4d256-prod-github-runner-207 kernel: [31428.557406] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 14:07:34 juju-e4d256-prod-github-runner-207 kernel: [31428.558875] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 14:07:34 juju-e4d256-prod-github-runner-207 kernel: [31428.560270] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:07:34 juju-e4d256-prod-github-runner-207 kernel: [31428.561466] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 14:07:34 juju-e4d256-prod-github-runner-207 kernel: [31428.564359] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 14:07:34 juju-e4d256-prod-github-runner-207 kernel: [31428.565528] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 14:07:34 juju-e4d256-prod-github-runner-207 kernel: [31428.566846] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 14:07:34 juju-e4d256-prod-github-runner-207 kernel: [31428.568147] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 14:07:34 juju-e4d256-prod-github-runner-207 kernel: [31428.569439] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 14:07:34 juju-e4d256-prod-github-runner-207 kernel: [31428.570772] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 14:07:34 juju-e4d256-prod-github-runner-207 kernel: [31428.572084] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 14:07:34 juju-e4d256-prod-github-runner-207 kernel: [31428.573486] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 14:07:34 juju-e4d256-prod-github-runner-207 kernel: [31428.574706] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 14:07:34 juju-e4d256-prod-github-runner-207 kernel: [31428.576041] Call Trace: Aug 22 14:07:34 juju-e4d256-prod-github-runner-207 kernel: [31428.577012] Aug 22 14:07:34 juju-e4d256-prod-github-runner-207 kernel: [31428.577960] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:07:34 juju-e4d256-prod-github-runner-207 kernel: [31428.579077] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:07:34 juju-e4d256-prod-github-runner-207 kernel: [31428.580182] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:07:34 juju-e4d256-prod-github-runner-207 kernel: [31428.581351] ? show_regs.part.0+0x23/0x29 Aug 22 14:07:34 juju-e4d256-prod-github-runner-207 kernel: [31428.582463] ? show_regs.cold+0x8/0xd Aug 22 14:07:34 juju-e4d256-prod-github-runner-207 kernel: [31428.583531] ? watchdog_timer_fn+0x1be/0x220 Aug 22 14:07:34 juju-e4d256-prod-github-runner-207 kernel: [31428.584623] ? lockup_detector_update_enable+0x60/0x60 Aug 22 14:07:34 juju-e4d256-prod-github-runner-207 kernel: [31428.585813] ? __hrtimer_run_queues+0x107/0x230 Aug 22 14:07:34 juju-e4d256-prod-github-runner-207 kernel: [31428.586934] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 14:07:34 juju-e4d256-prod-github-runner-207 kernel: [31428.588042] ? hrtimer_interrupt+0x101/0x220 Aug 22 14:07:34 juju-e4d256-prod-github-runner-207 kernel: [31428.589141] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 14:07:34 juju-e4d256-prod-github-runner-207 kernel: [31428.590332] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 14:07:34 juju-e4d256-prod-github-runner-207 kernel: [31428.591496] Aug 22 14:07:34 juju-e4d256-prod-github-runner-207 kernel: [31428.592418] Aug 22 14:07:34 juju-e4d256-prod-github-runner-207 kernel: [31428.593272] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 14:07:34 juju-e4d256-prod-github-runner-207 kernel: [31428.594474] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:07:34 juju-e4d256-prod-github-runner-207 kernel: [31428.595635] ? _raw_spin_lock+0x22/0x30 Aug 22 14:07:34 juju-e4d256-prod-github-runner-207 kernel: [31428.596678] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:07:34 juju-e4d256-prod-github-runner-207 kernel: [31428.597834] direct_page_fault+0x206/0x310 [kvm] Aug 22 14:07:34 juju-e4d256-prod-github-runner-207 kernel: [31428.598975] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 14:07:34 juju-e4d256-prod-github-runner-207 kernel: [31428.600144] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 14:07:34 juju-e4d256-prod-github-runner-207 kernel: [31428.601328] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 14:07:34 juju-e4d256-prod-github-runner-207 kernel: [31428.602455] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 14:07:34 juju-e4d256-prod-github-runner-207 kernel: [31428.603514] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 14:07:34 juju-e4d256-prod-github-runner-207 kernel: [31428.604619] handle_exit+0x98/0x230 [kvm_amd] Aug 22 14:07:34 juju-e4d256-prod-github-runner-207 kernel: [31428.605640] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 14:07:34 juju-e4d256-prod-github-runner-207 kernel: [31428.606674] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 14:07:34 juju-e4d256-prod-github-runner-207 kernel: [31428.607713] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 14:07:34 juju-e4d256-prod-github-runner-207 kernel: [31428.608728] vcpu_run+0x62/0x2c0 [kvm] Aug 22 14:07:34 juju-e4d256-prod-github-runner-207 kernel: [31428.609655] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 14:07:34 juju-e4d256-prod-github-runner-207 kernel: [31428.610558] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 14:07:34 juju-e4d256-prod-github-runner-207 kernel: [31428.611532] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 14:07:34 juju-e4d256-prod-github-runner-207 kernel: [31428.612442] ? __seccomp_filter+0x4a/0x4a0 Aug 22 14:07:34 juju-e4d256-prod-github-runner-207 kernel: [31428.613299] ? __fget_files+0x86/0xc0 Aug 22 14:07:34 juju-e4d256-prod-github-runner-207 kernel: [31428.614117] __x64_sys_ioctl+0x95/0xd0 Aug 22 14:07:34 juju-e4d256-prod-github-runner-207 kernel: [31428.614896] do_syscall_64+0x5c/0xc0 Aug 22 14:07:34 juju-e4d256-prod-github-runner-207 kernel: [31428.615642] ? do_futex+0x162/0x1f0 Aug 22 14:07:34 juju-e4d256-prod-github-runner-207 kernel: [31428.616363] ? __x64_sys_futex+0x78/0x1e0 Aug 22 14:07:34 juju-e4d256-prod-github-runner-207 kernel: [31428.617116] ? __secure_computing+0xa9/0x120 Aug 22 14:07:34 juju-e4d256-prod-github-runner-207 kernel: [31428.617923] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 14:07:34 juju-e4d256-prod-github-runner-207 kernel: [31428.618788] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:07:34 juju-e4d256-prod-github-runner-207 kernel: [31428.619614] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:07:34 juju-e4d256-prod-github-runner-207 kernel: [31428.620442] ? do_syscall_64+0x69/0xc0 Aug 22 14:07:34 juju-e4d256-prod-github-runner-207 kernel: [31428.621198] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:07:34 juju-e4d256-prod-github-runner-207 kernel: [31428.622063] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:07:34 juju-e4d256-prod-github-runner-207 kernel: [31428.622865] ? do_syscall_64+0x69/0xc0 Aug 22 14:07:34 juju-e4d256-prod-github-runner-207 kernel: [31428.623573] ? do_syscall_64+0x69/0xc0 Aug 22 14:07:34 juju-e4d256-prod-github-runner-207 kernel: [31428.624348] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 14:07:34 juju-e4d256-prod-github-runner-207 kernel: [31428.625175] RIP: 0033:0x7faa5d0edaff Aug 22 14:07:34 juju-e4d256-prod-github-runner-207 kernel: [31428.625912] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 14:07:34 juju-e4d256-prod-github-runner-207 kernel: [31428.628240] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 14:07:34 juju-e4d256-prod-github-runner-207 kernel: [31428.629304] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 14:07:34 juju-e4d256-prod-github-runner-207 kernel: [31428.630384] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 14:07:34 juju-e4d256-prod-github-runner-207 kernel: [31428.631432] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 14:07:34 juju-e4d256-prod-github-runner-207 kernel: [31428.632464] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 14:07:34 juju-e4d256-prod-github-runner-207 kernel: [31428.633512] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 14:07:34 juju-e4d256-prod-github-runner-207 kernel: [31428.634553] Aug 22 14:08:02 juju-e4d256-prod-github-runner-207 kernel: [31456.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 29188s! [qemu-system-x86:6715] Aug 22 14:08:02 juju-e4d256-prod-github-runner-207 kernel: [31456.543090] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 14:08:02 juju-e4d256-prod-github-runner-207 kernel: [31456.543163] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 14:08:02 juju-e4d256-prod-github-runner-207 kernel: [31456.555206] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 14:08:02 juju-e4d256-prod-github-runner-207 kernel: [31456.556467] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 14:08:02 juju-e4d256-prod-github-runner-207 kernel: [31456.557724] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:08:02 juju-e4d256-prod-github-runner-207 kernel: [31456.558786] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 14:08:02 juju-e4d256-prod-github-runner-207 kernel: [31456.561338] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 14:08:02 juju-e4d256-prod-github-runner-207 kernel: [31456.562381] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 14:08:02 juju-e4d256-prod-github-runner-207 kernel: [31456.563543] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 14:08:02 juju-e4d256-prod-github-runner-207 kernel: [31456.564708] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 14:08:02 juju-e4d256-prod-github-runner-207 kernel: [31456.565895] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 14:08:02 juju-e4d256-prod-github-runner-207 kernel: [31456.567186] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 14:08:02 juju-e4d256-prod-github-runner-207 kernel: [31456.568387] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 14:08:02 juju-e4d256-prod-github-runner-207 kernel: [31456.569636] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 14:08:02 juju-e4d256-prod-github-runner-207 kernel: [31456.570735] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 14:08:02 juju-e4d256-prod-github-runner-207 kernel: [31456.571926] Call Trace: Aug 22 14:08:02 juju-e4d256-prod-github-runner-207 kernel: [31456.572838] Aug 22 14:08:02 juju-e4d256-prod-github-runner-207 kernel: [31456.573733] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:08:02 juju-e4d256-prod-github-runner-207 kernel: [31456.574770] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:08:02 juju-e4d256-prod-github-runner-207 kernel: [31456.575790] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:08:02 juju-e4d256-prod-github-runner-207 kernel: [31456.576869] ? show_regs.part.0+0x23/0x29 Aug 22 14:08:02 juju-e4d256-prod-github-runner-207 kernel: [31456.577878] ? show_regs.cold+0x8/0xd Aug 22 14:08:02 juju-e4d256-prod-github-runner-207 kernel: [31456.578848] ? watchdog_timer_fn+0x1be/0x220 Aug 22 14:08:02 juju-e4d256-prod-github-runner-207 kernel: [31456.579854] ? lockup_detector_update_enable+0x60/0x60 Aug 22 14:08:02 juju-e4d256-prod-github-runner-207 kernel: [31456.580914] ? __hrtimer_run_queues+0x107/0x230 Aug 22 14:08:02 juju-e4d256-prod-github-runner-207 kernel: [31456.581950] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 14:08:02 juju-e4d256-prod-github-runner-207 kernel: [31456.582978] ? hrtimer_interrupt+0x101/0x220 Aug 22 14:08:02 juju-e4d256-prod-github-runner-207 kernel: [31456.583990] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 14:08:02 juju-e4d256-prod-github-runner-207 kernel: [31456.585056] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 14:08:02 juju-e4d256-prod-github-runner-207 kernel: [31456.586110] Aug 22 14:08:02 juju-e4d256-prod-github-runner-207 kernel: [31456.586961] Aug 22 14:08:02 juju-e4d256-prod-github-runner-207 kernel: [31456.587814] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 14:08:02 juju-e4d256-prod-github-runner-207 kernel: [31456.588849] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:08:02 juju-e4d256-prod-github-runner-207 kernel: [31456.589903] ? _raw_spin_lock+0x22/0x30 Aug 22 14:08:02 juju-e4d256-prod-github-runner-207 kernel: [31456.590846] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:08:02 juju-e4d256-prod-github-runner-207 kernel: [31456.591864] direct_page_fault+0x206/0x310 [kvm] Aug 22 14:08:02 juju-e4d256-prod-github-runner-207 kernel: [31456.592886] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 14:08:02 juju-e4d256-prod-github-runner-207 kernel: [31456.593951] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 14:08:02 juju-e4d256-prod-github-runner-207 kernel: [31456.594964] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 14:08:02 juju-e4d256-prod-github-runner-207 kernel: [31456.595941] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 14:08:02 juju-e4d256-prod-github-runner-207 kernel: [31456.596893] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 14:08:02 juju-e4d256-prod-github-runner-207 kernel: [31456.597890] handle_exit+0x98/0x230 [kvm_amd] Aug 22 14:08:02 juju-e4d256-prod-github-runner-207 kernel: [31456.598783] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 14:08:02 juju-e4d256-prod-github-runner-207 kernel: [31456.599740] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 14:08:02 juju-e4d256-prod-github-runner-207 kernel: [31456.600667] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 14:08:02 juju-e4d256-prod-github-runner-207 kernel: [31456.601596] vcpu_run+0x62/0x2c0 [kvm] Aug 22 14:08:02 juju-e4d256-prod-github-runner-207 kernel: [31456.602413] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 14:08:02 juju-e4d256-prod-github-runner-207 kernel: [31456.603284] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 14:08:02 juju-e4d256-prod-github-runner-207 kernel: [31456.604153] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 14:08:02 juju-e4d256-prod-github-runner-207 kernel: [31456.604961] ? __seccomp_filter+0x4a/0x4a0 Aug 22 14:08:02 juju-e4d256-prod-github-runner-207 kernel: [31456.605720] ? __fget_files+0x86/0xc0 Aug 22 14:08:02 juju-e4d256-prod-github-runner-207 kernel: [31456.606428] __x64_sys_ioctl+0x95/0xd0 Aug 22 14:08:02 juju-e4d256-prod-github-runner-207 kernel: [31456.607121] do_syscall_64+0x5c/0xc0 Aug 22 14:08:02 juju-e4d256-prod-github-runner-207 kernel: [31456.607790] ? do_futex+0x162/0x1f0 Aug 22 14:08:02 juju-e4d256-prod-github-runner-207 kernel: [31456.608443] ? __x64_sys_futex+0x78/0x1e0 Aug 22 14:08:02 juju-e4d256-prod-github-runner-207 kernel: [31456.609128] ? __secure_computing+0xa9/0x120 Aug 22 14:08:02 juju-e4d256-prod-github-runner-207 kernel: [31456.609821] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 14:08:02 juju-e4d256-prod-github-runner-207 kernel: [31456.610586] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:08:02 juju-e4d256-prod-github-runner-207 kernel: [31456.611313] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:08:02 juju-e4d256-prod-github-runner-207 kernel: [31456.612031] ? do_syscall_64+0x69/0xc0 Aug 22 14:08:02 juju-e4d256-prod-github-runner-207 kernel: [31456.612676] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:08:02 juju-e4d256-prod-github-runner-207 kernel: [31456.613394] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:08:02 juju-e4d256-prod-github-runner-207 kernel: [31456.614091] ? do_syscall_64+0x69/0xc0 Aug 22 14:08:02 juju-e4d256-prod-github-runner-207 kernel: [31456.614718] ? do_syscall_64+0x69/0xc0 Aug 22 14:08:02 juju-e4d256-prod-github-runner-207 kernel: [31456.615346] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 14:08:02 juju-e4d256-prod-github-runner-207 kernel: [31456.616052] RIP: 0033:0x7faa5d0edaff Aug 22 14:08:02 juju-e4d256-prod-github-runner-207 kernel: [31456.616677] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 14:08:02 juju-e4d256-prod-github-runner-207 kernel: [31456.618679] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 14:08:02 juju-e4d256-prod-github-runner-207 kernel: [31456.619596] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 14:08:02 juju-e4d256-prod-github-runner-207 kernel: [31456.620489] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 14:08:02 juju-e4d256-prod-github-runner-207 kernel: [31456.621402] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 14:08:02 juju-e4d256-prod-github-runner-207 kernel: [31456.622292] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 14:08:02 juju-e4d256-prod-github-runner-207 kernel: [31456.623181] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 14:08:02 juju-e4d256-prod-github-runner-207 kernel: [31456.624076] Aug 22 14:08:30 juju-e4d256-prod-github-runner-207 kernel: [31484.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 29214s! [qemu-system-x86:6715] Aug 22 14:08:30 juju-e4d256-prod-github-runner-207 kernel: [31484.543812] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 14:08:30 juju-e4d256-prod-github-runner-207 kernel: [31484.544098] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 14:08:30 juju-e4d256-prod-github-runner-207 kernel: [31484.556483] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 14:08:30 juju-e4d256-prod-github-runner-207 kernel: [31484.557801] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 14:08:30 juju-e4d256-prod-github-runner-207 kernel: [31484.559024] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:08:30 juju-e4d256-prod-github-runner-207 kernel: [31484.560081] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 14:08:30 juju-e4d256-prod-github-runner-207 kernel: [31484.562893] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 14:08:30 juju-e4d256-prod-github-runner-207 kernel: [31484.564226] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 14:08:30 juju-e4d256-prod-github-runner-207 kernel: [31484.565890] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 14:08:30 juju-e4d256-prod-github-runner-207 kernel: [31484.567365] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 14:08:30 juju-e4d256-prod-github-runner-207 kernel: [31484.568840] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 14:08:30 juju-e4d256-prod-github-runner-207 kernel: [31484.570586] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 14:08:30 juju-e4d256-prod-github-runner-207 kernel: [31484.572243] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 14:08:30 juju-e4d256-prod-github-runner-207 kernel: [31484.573942] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 14:08:30 juju-e4d256-prod-github-runner-207 kernel: [31484.575512] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 14:08:30 juju-e4d256-prod-github-runner-207 kernel: [31484.576949] Call Trace: Aug 22 14:08:30 juju-e4d256-prod-github-runner-207 kernel: [31484.577922] Aug 22 14:08:30 juju-e4d256-prod-github-runner-207 kernel: [31484.578985] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:08:30 juju-e4d256-prod-github-runner-207 kernel: [31484.580094] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:08:30 juju-e4d256-prod-github-runner-207 kernel: [31484.581147] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:08:30 juju-e4d256-prod-github-runner-207 kernel: [31484.582274] ? show_regs.part.0+0x23/0x29 Aug 22 14:08:30 juju-e4d256-prod-github-runner-207 kernel: [31484.583325] ? show_regs.cold+0x8/0xd Aug 22 14:08:30 juju-e4d256-prod-github-runner-207 kernel: [31484.584310] ? watchdog_timer_fn+0x1be/0x220 Aug 22 14:08:30 juju-e4d256-prod-github-runner-207 kernel: [31484.585364] ? lockup_detector_update_enable+0x60/0x60 Aug 22 14:08:30 juju-e4d256-prod-github-runner-207 kernel: [31484.586436] ? __hrtimer_run_queues+0x107/0x230 Aug 22 14:08:30 juju-e4d256-prod-github-runner-207 kernel: [31484.587477] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 14:08:30 juju-e4d256-prod-github-runner-207 kernel: [31484.588508] ? hrtimer_interrupt+0x101/0x220 Aug 22 14:08:30 juju-e4d256-prod-github-runner-207 kernel: [31484.589613] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 14:08:30 juju-e4d256-prod-github-runner-207 kernel: [31484.590818] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 14:08:30 juju-e4d256-prod-github-runner-207 kernel: [31484.592194] Aug 22 14:08:30 juju-e4d256-prod-github-runner-207 kernel: [31484.593457] Aug 22 14:08:30 juju-e4d256-prod-github-runner-207 kernel: [31484.594716] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 14:08:30 juju-e4d256-prod-github-runner-207 kernel: [31484.595790] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:08:30 juju-e4d256-prod-github-runner-207 kernel: [31484.597068] ? _raw_spin_lock+0x22/0x30 Aug 22 14:08:30 juju-e4d256-prod-github-runner-207 kernel: [31484.598237] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:08:30 juju-e4d256-prod-github-runner-207 kernel: [31484.599452] direct_page_fault+0x206/0x310 [kvm] Aug 22 14:08:30 juju-e4d256-prod-github-runner-207 kernel: [31484.600644] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 14:08:30 juju-e4d256-prod-github-runner-207 kernel: [31484.601897] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 14:08:30 juju-e4d256-prod-github-runner-207 kernel: [31484.603102] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 14:08:30 juju-e4d256-prod-github-runner-207 kernel: [31484.604323] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 14:08:30 juju-e4d256-prod-github-runner-207 kernel: [31484.605478] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 14:08:30 juju-e4d256-prod-github-runner-207 kernel: [31484.606682] handle_exit+0x98/0x230 [kvm_amd] Aug 22 14:08:30 juju-e4d256-prod-github-runner-207 kernel: [31484.607780] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 14:08:30 juju-e4d256-prod-github-runner-207 kernel: [31484.609072] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 14:08:30 juju-e4d256-prod-github-runner-207 kernel: [31484.610233] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 14:08:30 juju-e4d256-prod-github-runner-207 kernel: [31484.611154] vcpu_run+0x62/0x2c0 [kvm] Aug 22 14:08:30 juju-e4d256-prod-github-runner-207 kernel: [31484.611992] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 14:08:30 juju-e4d256-prod-github-runner-207 kernel: [31484.612849] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 14:08:30 juju-e4d256-prod-github-runner-207 kernel: [31484.613731] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 14:08:30 juju-e4d256-prod-github-runner-207 kernel: [31484.614723] ? __seccomp_filter+0x4a/0x4a0 Aug 22 14:08:30 juju-e4d256-prod-github-runner-207 kernel: [31484.615482] ? __fget_files+0x86/0xc0 Aug 22 14:08:30 juju-e4d256-prod-github-runner-207 kernel: [31484.616192] __x64_sys_ioctl+0x95/0xd0 Aug 22 14:08:30 juju-e4d256-prod-github-runner-207 kernel: [31484.617059] do_syscall_64+0x5c/0xc0 Aug 22 14:08:30 juju-e4d256-prod-github-runner-207 kernel: [31484.617735] ? do_futex+0x162/0x1f0 Aug 22 14:08:30 juju-e4d256-prod-github-runner-207 kernel: [31484.618404] ? __x64_sys_futex+0x78/0x1e0 Aug 22 14:08:30 juju-e4d256-prod-github-runner-207 kernel: [31484.619082] ? __secure_computing+0xa9/0x120 Aug 22 14:08:30 juju-e4d256-prod-github-runner-207 kernel: [31484.619780] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 14:08:30 juju-e4d256-prod-github-runner-207 kernel: [31484.620549] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:08:30 juju-e4d256-prod-github-runner-207 kernel: [31484.621300] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:08:30 juju-e4d256-prod-github-runner-207 kernel: [31484.622021] ? do_syscall_64+0x69/0xc0 Aug 22 14:08:30 juju-e4d256-prod-github-runner-207 kernel: [31484.622668] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:08:30 juju-e4d256-prod-github-runner-207 kernel: [31484.623401] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:08:30 juju-e4d256-prod-github-runner-207 kernel: [31484.624104] ? do_syscall_64+0x69/0xc0 Aug 22 14:08:30 juju-e4d256-prod-github-runner-207 kernel: [31484.624732] ? do_syscall_64+0x69/0xc0 Aug 22 14:08:30 juju-e4d256-prod-github-runner-207 kernel: [31484.625379] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 14:08:30 juju-e4d256-prod-github-runner-207 kernel: [31484.626088] RIP: 0033:0x7faa5d0edaff Aug 22 14:08:30 juju-e4d256-prod-github-runner-207 kernel: [31484.626762] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 14:08:30 juju-e4d256-prod-github-runner-207 kernel: [31484.629302] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 14:08:30 juju-e4d256-prod-github-runner-207 kernel: [31484.630221] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 14:08:30 juju-e4d256-prod-github-runner-207 kernel: [31484.631116] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 14:08:30 juju-e4d256-prod-github-runner-207 kernel: [31484.632014] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 14:08:30 juju-e4d256-prod-github-runner-207 kernel: [31484.632921] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 14:08:30 juju-e4d256-prod-github-runner-207 kernel: [31484.633820] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 14:08:30 juju-e4d256-prod-github-runner-207 kernel: [31484.634715] Aug 22 14:08:45 juju-e4d256-prod-github-runner-207 kernel: [31499.288710] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 14:08:45 juju-e4d256-prod-github-runner-207 kernel: [31499.289684] rcu: 1-....: (7821038 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=3779366 Aug 22 14:08:45 juju-e4d256-prod-github-runner-207 kernel: [31499.290842] (t=7845522 jiffies g=23269 q=34440) Aug 22 14:08:45 juju-e4d256-prod-github-runner-207 kernel: [31499.291642] NMI backtrace for cpu 1 Aug 22 14:08:45 juju-e4d256-prod-github-runner-207 kernel: [31499.292358] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 14:08:45 juju-e4d256-prod-github-runner-207 kernel: [31499.293497] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 14:08:45 juju-e4d256-prod-github-runner-207 kernel: [31499.294583] Call Trace: Aug 22 14:08:45 juju-e4d256-prod-github-runner-207 kernel: [31499.295260] Aug 22 14:08:45 juju-e4d256-prod-github-runner-207 kernel: [31499.295908] show_stack+0x52/0x5c Aug 22 14:08:45 juju-e4d256-prod-github-runner-207 kernel: [31499.296647] dump_stack_lvl+0x4a/0x63 Aug 22 14:08:45 juju-e4d256-prod-github-runner-207 kernel: [31499.297399] dump_stack+0x10/0x16 Aug 22 14:08:45 juju-e4d256-prod-github-runner-207 kernel: [31499.298121] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 14:08:45 juju-e4d256-prod-github-runner-207 kernel: [31499.298908] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 14:08:45 juju-e4d256-prod-github-runner-207 kernel: [31499.299697] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 14:08:45 juju-e4d256-prod-github-runner-207 kernel: [31499.300527] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 14:08:45 juju-e4d256-prod-github-runner-207 kernel: [31499.301370] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 14:08:45 juju-e4d256-prod-github-runner-207 kernel: [31499.302191] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 14:08:45 juju-e4d256-prod-github-runner-207 kernel: [31499.302970] print_cpu_stall.cold+0x2f/0xe2 Aug 22 14:08:45 juju-e4d256-prod-github-runner-207 kernel: [31499.303747] ? timekeeping_update+0xf7/0x150 Aug 22 14:08:45 juju-e4d256-prod-github-runner-207 kernel: [31499.304526] check_cpu_stall+0x109/0x270 Aug 22 14:08:45 juju-e4d256-prod-github-runner-207 kernel: [31499.305297] rcu_sched_clock_irq+0x9a/0x250 Aug 22 14:08:45 juju-e4d256-prod-github-runner-207 kernel: [31499.306069] update_process_times+0x94/0xd0 Aug 22 14:08:45 juju-e4d256-prod-github-runner-207 kernel: [31499.306840] tick_sched_handle+0x29/0x70 Aug 22 14:08:45 juju-e4d256-prod-github-runner-207 kernel: [31499.307597] tick_sched_timer+0x8c/0xc0 Aug 22 14:08:45 juju-e4d256-prod-github-runner-207 kernel: [31499.308351] ? tick_nohz_handler+0xb0/0xb0 Aug 22 14:08:45 juju-e4d256-prod-github-runner-207 kernel: [31499.309126] __hrtimer_run_queues+0x107/0x230 Aug 22 14:08:45 juju-e4d256-prod-github-runner-207 kernel: [31499.309939] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 14:08:45 juju-e4d256-prod-github-runner-207 kernel: [31499.310726] hrtimer_interrupt+0x101/0x220 Aug 22 14:08:45 juju-e4d256-prod-github-runner-207 kernel: [31499.311492] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 14:08:45 juju-e4d256-prod-github-runner-207 kernel: [31499.312314] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 14:08:45 juju-e4d256-prod-github-runner-207 kernel: [31499.313136] Aug 22 14:08:45 juju-e4d256-prod-github-runner-207 kernel: [31499.313779] Aug 22 14:08:45 juju-e4d256-prod-github-runner-207 kernel: [31499.314411] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 14:08:45 juju-e4d256-prod-github-runner-207 kernel: [31499.315240] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:08:45 juju-e4d256-prod-github-runner-207 kernel: [31499.316134] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 14:08:45 juju-e4d256-prod-github-runner-207 kernel: [31499.318389] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 14:08:45 juju-e4d256-prod-github-runner-207 kernel: [31499.319306] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 14:08:45 juju-e4d256-prod-github-runner-207 kernel: [31499.320316] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 14:08:45 juju-e4d256-prod-github-runner-207 kernel: [31499.321319] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 14:08:45 juju-e4d256-prod-github-runner-207 kernel: [31499.322300] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 14:08:45 juju-e4d256-prod-github-runner-207 kernel: [31499.323280] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 14:08:45 juju-e4d256-prod-github-runner-207 kernel: [31499.324251] ? _raw_spin_lock+0x22/0x30 Aug 22 14:08:45 juju-e4d256-prod-github-runner-207 kernel: [31499.325026] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:08:45 juju-e4d256-prod-github-runner-207 kernel: [31499.325886] direct_page_fault+0x206/0x310 [kvm] Aug 22 14:08:45 juju-e4d256-prod-github-runner-207 kernel: [31499.326733] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 14:08:45 juju-e4d256-prod-github-runner-207 kernel: [31499.327569] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 14:08:45 juju-e4d256-prod-github-runner-207 kernel: [31499.328407] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 14:08:45 juju-e4d256-prod-github-runner-207 kernel: [31499.329241] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 14:08:45 juju-e4d256-prod-github-runner-207 kernel: [31499.330034] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 14:08:45 juju-e4d256-prod-github-runner-207 kernel: [31499.330867] handle_exit+0x98/0x230 [kvm_amd] Aug 22 14:08:45 juju-e4d256-prod-github-runner-207 kernel: [31499.331633] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 14:08:45 juju-e4d256-prod-github-runner-207 kernel: [31499.332437] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 14:08:45 juju-e4d256-prod-github-runner-207 kernel: [31499.333256] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 14:08:45 juju-e4d256-prod-github-runner-207 kernel: [31499.334056] vcpu_run+0x62/0x2c0 [kvm] Aug 22 14:08:45 juju-e4d256-prod-github-runner-207 kernel: [31499.334779] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 14:08:45 juju-e4d256-prod-github-runner-207 kernel: [31499.335523] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 14:08:45 juju-e4d256-prod-github-runner-207 kernel: [31499.336335] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 14:08:45 juju-e4d256-prod-github-runner-207 kernel: [31499.337110] ? __seccomp_filter+0x4a/0x4a0 Aug 22 14:08:45 juju-e4d256-prod-github-runner-207 kernel: [31499.337839] ? __fget_files+0x86/0xc0 Aug 22 14:08:45 juju-e4d256-prod-github-runner-207 kernel: [31499.338544] __x64_sys_ioctl+0x95/0xd0 Aug 22 14:08:45 juju-e4d256-prod-github-runner-207 kernel: [31499.339253] do_syscall_64+0x5c/0xc0 Aug 22 14:08:45 juju-e4d256-prod-github-runner-207 kernel: [31499.339933] ? do_futex+0x162/0x1f0 Aug 22 14:08:45 juju-e4d256-prod-github-runner-207 kernel: [31499.340612] ? __x64_sys_futex+0x78/0x1e0 Aug 22 14:08:45 juju-e4d256-prod-github-runner-207 kernel: [31499.341312] ? __secure_computing+0xa9/0x120 Aug 22 14:08:45 juju-e4d256-prod-github-runner-207 kernel: [31499.342027] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 14:08:45 juju-e4d256-prod-github-runner-207 kernel: [31499.342819] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:08:45 juju-e4d256-prod-github-runner-207 kernel: [31499.343569] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:08:45 juju-e4d256-prod-github-runner-207 kernel: [31499.344323] ? do_syscall_64+0x69/0xc0 Aug 22 14:08:45 juju-e4d256-prod-github-runner-207 kernel: [31499.345022] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:08:45 juju-e4d256-prod-github-runner-207 kernel: [31499.345774] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:08:45 juju-e4d256-prod-github-runner-207 kernel: [31499.346526] ? do_syscall_64+0x69/0xc0 Aug 22 14:08:45 juju-e4d256-prod-github-runner-207 kernel: [31499.347217] ? do_syscall_64+0x69/0xc0 Aug 22 14:08:45 juju-e4d256-prod-github-runner-207 kernel: [31499.347901] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 14:08:45 juju-e4d256-prod-github-runner-207 kernel: [31499.348936] RIP: 0033:0x7faa5d0edaff Aug 22 14:08:45 juju-e4d256-prod-github-runner-207 kernel: [31499.349682] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 14:08:45 juju-e4d256-prod-github-runner-207 kernel: [31499.351809] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 14:08:45 juju-e4d256-prod-github-runner-207 kernel: [31499.352787] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 14:08:45 juju-e4d256-prod-github-runner-207 kernel: [31499.353732] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 14:08:45 juju-e4d256-prod-github-runner-207 kernel: [31499.354677] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 14:08:45 juju-e4d256-prod-github-runner-207 kernel: [31499.355610] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 14:08:45 juju-e4d256-prod-github-runner-207 kernel: [31499.356675] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 14:08:45 juju-e4d256-prod-github-runner-207 kernel: [31499.357684] Aug 22 14:09:10 juju-e4d256-prod-github-runner-207 kernel: [31524.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 29251s! [qemu-system-x86:6715] Aug 22 14:09:10 juju-e4d256-prod-github-runner-207 kernel: [31524.543123] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 14:09:10 juju-e4d256-prod-github-runner-207 kernel: [31524.543198] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 14:09:10 juju-e4d256-prod-github-runner-207 kernel: [31524.555745] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 14:09:10 juju-e4d256-prod-github-runner-207 kernel: [31524.557091] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 14:09:10 juju-e4d256-prod-github-runner-207 kernel: [31524.558352] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:09:10 juju-e4d256-prod-github-runner-207 kernel: [31524.559424] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 14:09:10 juju-e4d256-prod-github-runner-207 kernel: [31524.562040] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 14:09:10 juju-e4d256-prod-github-runner-207 kernel: [31524.563103] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 14:09:10 juju-e4d256-prod-github-runner-207 kernel: [31524.564339] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 14:09:10 juju-e4d256-prod-github-runner-207 kernel: [31524.565530] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 14:09:10 juju-e4d256-prod-github-runner-207 kernel: [31524.566735] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 14:09:10 juju-e4d256-prod-github-runner-207 kernel: [31524.567959] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 14:09:10 juju-e4d256-prod-github-runner-207 kernel: [31524.569356] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 14:09:10 juju-e4d256-prod-github-runner-207 kernel: [31524.570683] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 14:09:10 juju-e4d256-prod-github-runner-207 kernel: [31524.571812] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 14:09:10 juju-e4d256-prod-github-runner-207 kernel: [31524.573057] Call Trace: Aug 22 14:09:10 juju-e4d256-prod-github-runner-207 kernel: [31524.573980] Aug 22 14:09:10 juju-e4d256-prod-github-runner-207 kernel: [31524.574872] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:09:10 juju-e4d256-prod-github-runner-207 kernel: [31524.575935] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:09:10 juju-e4d256-prod-github-runner-207 kernel: [31524.577020] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:09:10 juju-e4d256-prod-github-runner-207 kernel: [31524.578119] ? show_regs.part.0+0x23/0x29 Aug 22 14:09:10 juju-e4d256-prod-github-runner-207 kernel: [31524.579130] ? show_regs.cold+0x8/0xd Aug 22 14:09:10 juju-e4d256-prod-github-runner-207 kernel: [31524.580115] ? watchdog_timer_fn+0x1be/0x220 Aug 22 14:09:10 juju-e4d256-prod-github-runner-207 kernel: [31524.581159] ? lockup_detector_update_enable+0x60/0x60 Aug 22 14:09:10 juju-e4d256-prod-github-runner-207 kernel: [31524.582367] ? __hrtimer_run_queues+0x107/0x230 Aug 22 14:09:10 juju-e4d256-prod-github-runner-207 kernel: [31524.583513] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 14:09:10 juju-e4d256-prod-github-runner-207 kernel: [31524.584585] ? hrtimer_interrupt+0x101/0x220 Aug 22 14:09:10 juju-e4d256-prod-github-runner-207 kernel: [31524.585625] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 14:09:10 juju-e4d256-prod-github-runner-207 kernel: [31524.586711] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 14:09:10 juju-e4d256-prod-github-runner-207 kernel: [31524.587788] Aug 22 14:09:10 juju-e4d256-prod-github-runner-207 kernel: [31524.588666] Aug 22 14:09:10 juju-e4d256-prod-github-runner-207 kernel: [31524.589514] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 14:09:10 juju-e4d256-prod-github-runner-207 kernel: [31524.590565] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:09:10 juju-e4d256-prod-github-runner-207 kernel: [31524.591622] ? _raw_spin_lock+0x22/0x30 Aug 22 14:09:10 juju-e4d256-prod-github-runner-207 kernel: [31524.592610] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:09:10 juju-e4d256-prod-github-runner-207 kernel: [31524.593697] direct_page_fault+0x206/0x310 [kvm] Aug 22 14:09:10 juju-e4d256-prod-github-runner-207 kernel: [31524.594752] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 14:09:10 juju-e4d256-prod-github-runner-207 kernel: [31524.596058] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 14:09:10 juju-e4d256-prod-github-runner-207 kernel: [31524.597091] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 14:09:10 juju-e4d256-prod-github-runner-207 kernel: [31524.598092] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 14:09:10 juju-e4d256-prod-github-runner-207 kernel: [31524.599143] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 14:09:10 juju-e4d256-prod-github-runner-207 kernel: [31524.600248] handle_exit+0x98/0x230 [kvm_amd] Aug 22 14:09:10 juju-e4d256-prod-github-runner-207 kernel: [31524.601181] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 14:09:10 juju-e4d256-prod-github-runner-207 kernel: [31524.602118] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 14:09:10 juju-e4d256-prod-github-runner-207 kernel: [31524.603082] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 14:09:10 juju-e4d256-prod-github-runner-207 kernel: [31524.604014] vcpu_run+0x62/0x2c0 [kvm] Aug 22 14:09:10 juju-e4d256-prod-github-runner-207 kernel: [31524.604863] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 14:09:10 juju-e4d256-prod-github-runner-207 kernel: [31524.605756] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 14:09:10 juju-e4d256-prod-github-runner-207 kernel: [31524.606631] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 14:09:10 juju-e4d256-prod-github-runner-207 kernel: [31524.607462] ? __seccomp_filter+0x4a/0x4a0 Aug 22 14:09:10 juju-e4d256-prod-github-runner-207 kernel: [31524.608240] ? __fget_files+0x86/0xc0 Aug 22 14:09:10 juju-e4d256-prod-github-runner-207 kernel: [31524.608982] __x64_sys_ioctl+0x95/0xd0 Aug 22 14:09:10 juju-e4d256-prod-github-runner-207 kernel: [31524.609688] do_syscall_64+0x5c/0xc0 Aug 22 14:09:10 juju-e4d256-prod-github-runner-207 kernel: [31524.610397] ? do_futex+0x162/0x1f0 Aug 22 14:09:10 juju-e4d256-prod-github-runner-207 kernel: [31524.611133] ? __x64_sys_futex+0x78/0x1e0 Aug 22 14:09:10 juju-e4d256-prod-github-runner-207 kernel: [31524.611898] ? __secure_computing+0xa9/0x120 Aug 22 14:09:10 juju-e4d256-prod-github-runner-207 kernel: [31524.612660] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 14:09:10 juju-e4d256-prod-github-runner-207 kernel: [31524.613468] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:09:10 juju-e4d256-prod-github-runner-207 kernel: [31524.614226] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:09:10 juju-e4d256-prod-github-runner-207 kernel: [31524.614960] ? do_syscall_64+0x69/0xc0 Aug 22 14:09:10 juju-e4d256-prod-github-runner-207 kernel: [31524.615634] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:09:10 juju-e4d256-prod-github-runner-207 kernel: [31524.616372] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:09:10 juju-e4d256-prod-github-runner-207 kernel: [31524.617086] ? do_syscall_64+0x69/0xc0 Aug 22 14:09:10 juju-e4d256-prod-github-runner-207 kernel: [31524.617724] ? do_syscall_64+0x69/0xc0 Aug 22 14:09:10 juju-e4d256-prod-github-runner-207 kernel: [31524.618366] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 14:09:10 juju-e4d256-prod-github-runner-207 kernel: [31524.619094] RIP: 0033:0x7faa5d0edaff Aug 22 14:09:10 juju-e4d256-prod-github-runner-207 kernel: [31524.619735] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 14:09:10 juju-e4d256-prod-github-runner-207 kernel: [31524.621824] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 14:09:10 juju-e4d256-prod-github-runner-207 kernel: [31524.622767] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 14:09:10 juju-e4d256-prod-github-runner-207 kernel: [31524.623698] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 14:09:10 juju-e4d256-prod-github-runner-207 kernel: [31524.624629] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 14:09:10 juju-e4d256-prod-github-runner-207 kernel: [31524.625608] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 14:09:10 juju-e4d256-prod-github-runner-207 kernel: [31524.626543] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 14:09:10 juju-e4d256-prod-github-runner-207 kernel: [31524.627460] Aug 22 14:09:38 juju-e4d256-prod-github-runner-207 kernel: [31552.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 29277s! [qemu-system-x86:6715] Aug 22 14:09:38 juju-e4d256-prod-github-runner-207 kernel: [31552.543118] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 14:09:38 juju-e4d256-prod-github-runner-207 kernel: [31552.543190] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 14:09:38 juju-e4d256-prod-github-runner-207 kernel: [31552.555918] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 14:09:38 juju-e4d256-prod-github-runner-207 kernel: [31552.557223] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 14:09:38 juju-e4d256-prod-github-runner-207 kernel: [31552.558441] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:09:38 juju-e4d256-prod-github-runner-207 kernel: [31552.559498] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 14:09:38 juju-e4d256-prod-github-runner-207 kernel: [31552.562113] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 14:09:38 juju-e4d256-prod-github-runner-207 kernel: [31552.563162] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 14:09:38 juju-e4d256-prod-github-runner-207 kernel: [31552.564348] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 14:09:38 juju-e4d256-prod-github-runner-207 kernel: [31552.565506] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 14:09:38 juju-e4d256-prod-github-runner-207 kernel: [31552.566661] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 14:09:38 juju-e4d256-prod-github-runner-207 kernel: [31552.567822] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 14:09:38 juju-e4d256-prod-github-runner-207 kernel: [31552.569076] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 14:09:38 juju-e4d256-prod-github-runner-207 kernel: [31552.570306] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 14:09:38 juju-e4d256-prod-github-runner-207 kernel: [31552.571430] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 14:09:38 juju-e4d256-prod-github-runner-207 kernel: [31552.572679] Call Trace: Aug 22 14:09:38 juju-e4d256-prod-github-runner-207 kernel: [31552.573604] Aug 22 14:09:38 juju-e4d256-prod-github-runner-207 kernel: [31552.574489] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:09:38 juju-e4d256-prod-github-runner-207 kernel: [31552.575533] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:09:38 juju-e4d256-prod-github-runner-207 kernel: [31552.576582] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:09:38 juju-e4d256-prod-github-runner-207 kernel: [31552.577665] ? show_regs.part.0+0x23/0x29 Aug 22 14:09:38 juju-e4d256-prod-github-runner-207 kernel: [31552.578667] ? show_regs.cold+0x8/0xd Aug 22 14:09:38 juju-e4d256-prod-github-runner-207 kernel: [31552.579647] ? watchdog_timer_fn+0x1be/0x220 Aug 22 14:09:38 juju-e4d256-prod-github-runner-207 kernel: [31552.580678] ? lockup_detector_update_enable+0x60/0x60 Aug 22 14:09:38 juju-e4d256-prod-github-runner-207 kernel: [31552.581742] ? __hrtimer_run_queues+0x107/0x230 Aug 22 14:09:38 juju-e4d256-prod-github-runner-207 kernel: [31552.582770] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 14:09:38 juju-e4d256-prod-github-runner-207 kernel: [31552.583875] ? hrtimer_interrupt+0x101/0x220 Aug 22 14:09:38 juju-e4d256-prod-github-runner-207 kernel: [31552.584952] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 14:09:38 juju-e4d256-prod-github-runner-207 kernel: [31552.586037] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 14:09:38 juju-e4d256-prod-github-runner-207 kernel: [31552.587161] Aug 22 14:09:38 juju-e4d256-prod-github-runner-207 kernel: [31552.588044] Aug 22 14:09:38 juju-e4d256-prod-github-runner-207 kernel: [31552.588921] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 14:09:38 juju-e4d256-prod-github-runner-207 kernel: [31552.589955] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:09:38 juju-e4d256-prod-github-runner-207 kernel: [31552.591030] ? _raw_spin_lock+0x22/0x30 Aug 22 14:09:38 juju-e4d256-prod-github-runner-207 kernel: [31552.592118] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:09:38 juju-e4d256-prod-github-runner-207 kernel: [31552.593195] direct_page_fault+0x206/0x310 [kvm] Aug 22 14:09:38 juju-e4d256-prod-github-runner-207 kernel: [31552.594250] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 14:09:38 juju-e4d256-prod-github-runner-207 kernel: [31552.595275] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 14:09:38 juju-e4d256-prod-github-runner-207 kernel: [31552.596321] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 14:09:38 juju-e4d256-prod-github-runner-207 kernel: [31552.597297] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 14:09:38 juju-e4d256-prod-github-runner-207 kernel: [31552.598245] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 14:09:38 juju-e4d256-prod-github-runner-207 kernel: [31552.599229] handle_exit+0x98/0x230 [kvm_amd] Aug 22 14:09:38 juju-e4d256-prod-github-runner-207 kernel: [31552.600142] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 14:09:38 juju-e4d256-prod-github-runner-207 kernel: [31552.601062] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 14:09:38 juju-e4d256-prod-github-runner-207 kernel: [31552.602004] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 14:09:38 juju-e4d256-prod-github-runner-207 kernel: [31552.602977] vcpu_run+0x62/0x2c0 [kvm] Aug 22 14:09:38 juju-e4d256-prod-github-runner-207 kernel: [31552.603889] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 14:09:38 juju-e4d256-prod-github-runner-207 kernel: [31552.604721] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 14:09:38 juju-e4d256-prod-github-runner-207 kernel: [31552.605667] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 14:09:38 juju-e4d256-prod-github-runner-207 kernel: [31552.606491] ? __seccomp_filter+0x4a/0x4a0 Aug 22 14:09:38 juju-e4d256-prod-github-runner-207 kernel: [31552.607252] ? __fget_files+0x86/0xc0 Aug 22 14:09:38 juju-e4d256-prod-github-runner-207 kernel: [31552.607990] __x64_sys_ioctl+0x95/0xd0 Aug 22 14:09:38 juju-e4d256-prod-github-runner-207 kernel: [31552.608802] do_syscall_64+0x5c/0xc0 Aug 22 14:09:38 juju-e4d256-prod-github-runner-207 kernel: [31552.609549] ? do_futex+0x162/0x1f0 Aug 22 14:09:38 juju-e4d256-prod-github-runner-207 kernel: [31552.610280] ? __x64_sys_futex+0x78/0x1e0 Aug 22 14:09:38 juju-e4d256-prod-github-runner-207 kernel: [31552.611050] ? __secure_computing+0xa9/0x120 Aug 22 14:09:38 juju-e4d256-prod-github-runner-207 kernel: [31552.611829] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 14:09:38 juju-e4d256-prod-github-runner-207 kernel: [31552.612722] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:09:38 juju-e4d256-prod-github-runner-207 kernel: [31552.613557] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:09:38 juju-e4d256-prod-github-runner-207 kernel: [31552.614370] ? do_syscall_64+0x69/0xc0 Aug 22 14:09:38 juju-e4d256-prod-github-runner-207 kernel: [31552.615089] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:09:38 juju-e4d256-prod-github-runner-207 kernel: [31552.615887] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:09:38 juju-e4d256-prod-github-runner-207 kernel: [31552.616700] ? do_syscall_64+0x69/0xc0 Aug 22 14:09:38 juju-e4d256-prod-github-runner-207 kernel: [31552.617401] ? do_syscall_64+0x69/0xc0 Aug 22 14:09:38 juju-e4d256-prod-github-runner-207 kernel: [31552.618098] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 14:09:38 juju-e4d256-prod-github-runner-207 kernel: [31552.618902] RIP: 0033:0x7faa5d0edaff Aug 22 14:09:38 juju-e4d256-prod-github-runner-207 kernel: [31552.619602] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 14:09:38 juju-e4d256-prod-github-runner-207 kernel: [31552.621951] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 14:09:38 juju-e4d256-prod-github-runner-207 kernel: [31552.623010] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 14:09:38 juju-e4d256-prod-github-runner-207 kernel: [31552.624098] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 14:09:38 juju-e4d256-prod-github-runner-207 kernel: [31552.625126] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 14:09:38 juju-e4d256-prod-github-runner-207 kernel: [31552.626153] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 14:09:38 juju-e4d256-prod-github-runner-207 kernel: [31552.627180] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 14:09:38 juju-e4d256-prod-github-runner-207 kernel: [31552.628225] Aug 22 14:10:06 juju-e4d256-prod-github-runner-207 kernel: [31580.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 29303s! [qemu-system-x86:6715] Aug 22 14:10:06 juju-e4d256-prod-github-runner-207 kernel: [31580.543914] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 14:10:06 juju-e4d256-prod-github-runner-207 kernel: [31580.544202] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 14:10:06 juju-e4d256-prod-github-runner-207 kernel: [31580.556545] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 14:10:06 juju-e4d256-prod-github-runner-207 kernel: [31580.557819] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 14:10:06 juju-e4d256-prod-github-runner-207 kernel: [31580.559039] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:10:06 juju-e4d256-prod-github-runner-207 kernel: [31580.560130] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 14:10:06 juju-e4d256-prod-github-runner-207 kernel: [31580.562681] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 14:10:06 juju-e4d256-prod-github-runner-207 kernel: [31580.563735] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 14:10:06 juju-e4d256-prod-github-runner-207 kernel: [31580.564903] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 14:10:06 juju-e4d256-prod-github-runner-207 kernel: [31580.566071] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 14:10:06 juju-e4d256-prod-github-runner-207 kernel: [31580.567231] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 14:10:06 juju-e4d256-prod-github-runner-207 kernel: [31580.568399] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 14:10:06 juju-e4d256-prod-github-runner-207 kernel: [31580.569579] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 14:10:06 juju-e4d256-prod-github-runner-207 kernel: [31580.570867] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 14:10:06 juju-e4d256-prod-github-runner-207 kernel: [31580.571986] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 14:10:06 juju-e4d256-prod-github-runner-207 kernel: [31580.573239] Call Trace: Aug 22 14:10:06 juju-e4d256-prod-github-runner-207 kernel: [31580.574174] Aug 22 14:10:06 juju-e4d256-prod-github-runner-207 kernel: [31580.575087] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:10:06 juju-e4d256-prod-github-runner-207 kernel: [31580.576166] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:10:06 juju-e4d256-prod-github-runner-207 kernel: [31580.577194] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:10:06 juju-e4d256-prod-github-runner-207 kernel: [31580.578289] ? show_regs.part.0+0x23/0x29 Aug 22 14:10:06 juju-e4d256-prod-github-runner-207 kernel: [31580.579301] ? show_regs.cold+0x8/0xd Aug 22 14:10:06 juju-e4d256-prod-github-runner-207 kernel: [31580.580343] ? watchdog_timer_fn+0x1be/0x220 Aug 22 14:10:06 juju-e4d256-prod-github-runner-207 kernel: [31580.581388] ? lockup_detector_update_enable+0x60/0x60 Aug 22 14:10:06 juju-e4d256-prod-github-runner-207 kernel: [31580.582474] ? __hrtimer_run_queues+0x107/0x230 Aug 22 14:10:06 juju-e4d256-prod-github-runner-207 kernel: [31580.583512] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 14:10:06 juju-e4d256-prod-github-runner-207 kernel: [31580.584558] ? hrtimer_interrupt+0x101/0x220 Aug 22 14:10:06 juju-e4d256-prod-github-runner-207 kernel: [31580.585572] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 14:10:06 juju-e4d256-prod-github-runner-207 kernel: [31580.586644] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 14:10:06 juju-e4d256-prod-github-runner-207 kernel: [31580.587702] Aug 22 14:10:06 juju-e4d256-prod-github-runner-207 kernel: [31580.588562] Aug 22 14:10:06 juju-e4d256-prod-github-runner-207 kernel: [31580.589429] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 14:10:06 juju-e4d256-prod-github-runner-207 kernel: [31580.590495] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:10:06 juju-e4d256-prod-github-runner-207 kernel: [31580.591562] ? _raw_spin_lock+0x22/0x30 Aug 22 14:10:06 juju-e4d256-prod-github-runner-207 kernel: [31580.592548] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:10:06 juju-e4d256-prod-github-runner-207 kernel: [31580.593598] direct_page_fault+0x206/0x310 [kvm] Aug 22 14:10:06 juju-e4d256-prod-github-runner-207 kernel: [31580.594635] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 14:10:06 juju-e4d256-prod-github-runner-207 kernel: [31580.595661] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 14:10:06 juju-e4d256-prod-github-runner-207 kernel: [31580.596669] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 14:10:06 juju-e4d256-prod-github-runner-207 kernel: [31580.597676] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 14:10:06 juju-e4d256-prod-github-runner-207 kernel: [31580.598627] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 14:10:06 juju-e4d256-prod-github-runner-207 kernel: [31580.599630] handle_exit+0x98/0x230 [kvm_amd] Aug 22 14:10:06 juju-e4d256-prod-github-runner-207 kernel: [31580.600530] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 14:10:06 juju-e4d256-prod-github-runner-207 kernel: [31580.601477] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 14:10:06 juju-e4d256-prod-github-runner-207 kernel: [31580.602408] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 14:10:06 juju-e4d256-prod-github-runner-207 kernel: [31580.603318] vcpu_run+0x62/0x2c0 [kvm] Aug 22 14:10:06 juju-e4d256-prod-github-runner-207 kernel: [31580.604147] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 14:10:06 juju-e4d256-prod-github-runner-207 kernel: [31580.604955] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 14:10:06 juju-e4d256-prod-github-runner-207 kernel: [31580.605857] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 14:10:06 juju-e4d256-prod-github-runner-207 kernel: [31580.606706] ? __seccomp_filter+0x4a/0x4a0 Aug 22 14:10:06 juju-e4d256-prod-github-runner-207 kernel: [31580.607557] ? __fget_files+0x86/0xc0 Aug 22 14:10:06 juju-e4d256-prod-github-runner-207 kernel: [31580.608344] __x64_sys_ioctl+0x95/0xd0 Aug 22 14:10:06 juju-e4d256-prod-github-runner-207 kernel: [31580.609062] do_syscall_64+0x5c/0xc0 Aug 22 14:10:06 juju-e4d256-prod-github-runner-207 kernel: [31580.609750] ? do_futex+0x162/0x1f0 Aug 22 14:10:06 juju-e4d256-prod-github-runner-207 kernel: [31580.610427] ? __x64_sys_futex+0x78/0x1e0 Aug 22 14:10:06 juju-e4d256-prod-github-runner-207 kernel: [31580.611118] ? __secure_computing+0xa9/0x120 Aug 22 14:10:06 juju-e4d256-prod-github-runner-207 kernel: [31580.611844] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 14:10:06 juju-e4d256-prod-github-runner-207 kernel: [31580.612636] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:10:06 juju-e4d256-prod-github-runner-207 kernel: [31580.613381] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:10:06 juju-e4d256-prod-github-runner-207 kernel: [31580.614112] ? do_syscall_64+0x69/0xc0 Aug 22 14:10:06 juju-e4d256-prod-github-runner-207 kernel: [31580.614763] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:10:06 juju-e4d256-prod-github-runner-207 kernel: [31580.615487] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:10:06 juju-e4d256-prod-github-runner-207 kernel: [31580.616213] ? do_syscall_64+0x69/0xc0 Aug 22 14:10:06 juju-e4d256-prod-github-runner-207 kernel: [31580.616843] ? do_syscall_64+0x69/0xc0 Aug 22 14:10:06 juju-e4d256-prod-github-runner-207 kernel: [31580.617471] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 14:10:06 juju-e4d256-prod-github-runner-207 kernel: [31580.618185] RIP: 0033:0x7faa5d0edaff Aug 22 14:10:06 juju-e4d256-prod-github-runner-207 kernel: [31580.618837] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 14:10:06 juju-e4d256-prod-github-runner-207 kernel: [31580.620965] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 14:10:06 juju-e4d256-prod-github-runner-207 kernel: [31580.622026] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 14:10:06 juju-e4d256-prod-github-runner-207 kernel: [31580.622933] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 14:10:06 juju-e4d256-prod-github-runner-207 kernel: [31580.623956] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 14:10:06 juju-e4d256-prod-github-runner-207 kernel: [31580.624886] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 14:10:06 juju-e4d256-prod-github-runner-207 kernel: [31580.625883] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 14:10:06 juju-e4d256-prod-github-runner-207 kernel: [31580.626811] Aug 22 14:10:34 juju-e4d256-prod-github-runner-207 kernel: [31608.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 29329s! [qemu-system-x86:6715] Aug 22 14:10:34 juju-e4d256-prod-github-runner-207 kernel: [31608.543100] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 14:10:34 juju-e4d256-prod-github-runner-207 kernel: [31608.543175] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 14:10:34 juju-e4d256-prod-github-runner-207 kernel: [31608.555492] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 14:10:34 juju-e4d256-prod-github-runner-207 kernel: [31608.556760] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 14:10:34 juju-e4d256-prod-github-runner-207 kernel: [31608.557980] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:10:34 juju-e4d256-prod-github-runner-207 kernel: [31608.559039] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 14:10:34 juju-e4d256-prod-github-runner-207 kernel: [31608.561631] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 14:10:34 juju-e4d256-prod-github-runner-207 kernel: [31608.562732] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 14:10:34 juju-e4d256-prod-github-runner-207 kernel: [31608.563968] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 14:10:34 juju-e4d256-prod-github-runner-207 kernel: [31608.565127] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 14:10:34 juju-e4d256-prod-github-runner-207 kernel: [31608.566284] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 14:10:34 juju-e4d256-prod-github-runner-207 kernel: [31608.567465] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 14:10:34 juju-e4d256-prod-github-runner-207 kernel: [31608.568721] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 14:10:34 juju-e4d256-prod-github-runner-207 kernel: [31608.569953] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 14:10:34 juju-e4d256-prod-github-runner-207 kernel: [31608.571049] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 14:10:34 juju-e4d256-prod-github-runner-207 kernel: [31608.572251] Call Trace: Aug 22 14:10:34 juju-e4d256-prod-github-runner-207 kernel: [31608.573181] Aug 22 14:10:34 juju-e4d256-prod-github-runner-207 kernel: [31608.574070] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:10:34 juju-e4d256-prod-github-runner-207 kernel: [31608.575106] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:10:34 juju-e4d256-prod-github-runner-207 kernel: [31608.576137] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:10:34 juju-e4d256-prod-github-runner-207 kernel: [31608.577223] ? show_regs.part.0+0x23/0x29 Aug 22 14:10:34 juju-e4d256-prod-github-runner-207 kernel: [31608.578226] ? show_regs.cold+0x8/0xd Aug 22 14:10:34 juju-e4d256-prod-github-runner-207 kernel: [31608.579203] ? watchdog_timer_fn+0x1be/0x220 Aug 22 14:10:34 juju-e4d256-prod-github-runner-207 kernel: [31608.580233] ? lockup_detector_update_enable+0x60/0x60 Aug 22 14:10:34 juju-e4d256-prod-github-runner-207 kernel: [31608.581294] ? __hrtimer_run_queues+0x107/0x230 Aug 22 14:10:34 juju-e4d256-prod-github-runner-207 kernel: [31608.582320] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 14:10:34 juju-e4d256-prod-github-runner-207 kernel: [31608.583363] ? hrtimer_interrupt+0x101/0x220 Aug 22 14:10:34 juju-e4d256-prod-github-runner-207 kernel: [31608.584400] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 14:10:34 juju-e4d256-prod-github-runner-207 kernel: [31608.585481] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 14:10:34 juju-e4d256-prod-github-runner-207 kernel: [31608.586527] Aug 22 14:10:34 juju-e4d256-prod-github-runner-207 kernel: [31608.587396] Aug 22 14:10:34 juju-e4d256-prod-github-runner-207 kernel: [31608.588287] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 14:10:34 juju-e4d256-prod-github-runner-207 kernel: [31608.589336] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:10:34 juju-e4d256-prod-github-runner-207 kernel: [31608.590371] ? _raw_spin_lock+0x22/0x30 Aug 22 14:10:34 juju-e4d256-prod-github-runner-207 kernel: [31608.591334] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:10:34 juju-e4d256-prod-github-runner-207 kernel: [31608.592355] direct_page_fault+0x206/0x310 [kvm] Aug 22 14:10:34 juju-e4d256-prod-github-runner-207 kernel: [31608.593376] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 14:10:34 juju-e4d256-prod-github-runner-207 kernel: [31608.594382] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 14:10:34 juju-e4d256-prod-github-runner-207 kernel: [31608.595399] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 14:10:34 juju-e4d256-prod-github-runner-207 kernel: [31608.596370] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 14:10:34 juju-e4d256-prod-github-runner-207 kernel: [31608.597314] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 14:10:34 juju-e4d256-prod-github-runner-207 kernel: [31608.598289] handle_exit+0x98/0x230 [kvm_amd] Aug 22 14:10:34 juju-e4d256-prod-github-runner-207 kernel: [31608.599184] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 14:10:34 juju-e4d256-prod-github-runner-207 kernel: [31608.600105] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 14:10:34 juju-e4d256-prod-github-runner-207 kernel: [31608.601025] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 14:10:34 juju-e4d256-prod-github-runner-207 kernel: [31608.601930] vcpu_run+0x62/0x2c0 [kvm] Aug 22 14:10:34 juju-e4d256-prod-github-runner-207 kernel: [31608.602737] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 14:10:34 juju-e4d256-prod-github-runner-207 kernel: [31608.603562] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 14:10:34 juju-e4d256-prod-github-runner-207 kernel: [31608.604455] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 14:10:34 juju-e4d256-prod-github-runner-207 kernel: [31608.605250] ? __seccomp_filter+0x4a/0x4a0 Aug 22 14:10:34 juju-e4d256-prod-github-runner-207 kernel: [31608.605989] ? __fget_files+0x86/0xc0 Aug 22 14:10:34 juju-e4d256-prod-github-runner-207 kernel: [31608.606707] __x64_sys_ioctl+0x95/0xd0 Aug 22 14:10:34 juju-e4d256-prod-github-runner-207 kernel: [31608.607415] do_syscall_64+0x5c/0xc0 Aug 22 14:10:34 juju-e4d256-prod-github-runner-207 kernel: [31608.608080] ? do_futex+0x162/0x1f0 Aug 22 14:10:34 juju-e4d256-prod-github-runner-207 kernel: [31608.608727] ? __x64_sys_futex+0x78/0x1e0 Aug 22 14:10:34 juju-e4d256-prod-github-runner-207 kernel: [31608.609400] ? __secure_computing+0xa9/0x120 Aug 22 14:10:34 juju-e4d256-prod-github-runner-207 kernel: [31608.610087] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 14:10:34 juju-e4d256-prod-github-runner-207 kernel: [31608.610850] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:10:34 juju-e4d256-prod-github-runner-207 kernel: [31608.611586] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:10:34 juju-e4d256-prod-github-runner-207 kernel: [31608.612301] ? do_syscall_64+0x69/0xc0 Aug 22 14:10:34 juju-e4d256-prod-github-runner-207 kernel: [31608.612950] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:10:34 juju-e4d256-prod-github-runner-207 kernel: [31608.613655] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:10:34 juju-e4d256-prod-github-runner-207 kernel: [31608.614351] ? do_syscall_64+0x69/0xc0 Aug 22 14:10:34 juju-e4d256-prod-github-runner-207 kernel: [31608.614974] ? do_syscall_64+0x69/0xc0 Aug 22 14:10:34 juju-e4d256-prod-github-runner-207 kernel: [31608.615613] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 14:10:34 juju-e4d256-prod-github-runner-207 kernel: [31608.616317] RIP: 0033:0x7faa5d0edaff Aug 22 14:10:34 juju-e4d256-prod-github-runner-207 kernel: [31608.616946] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 14:10:34 juju-e4d256-prod-github-runner-207 kernel: [31608.618917] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 14:10:34 juju-e4d256-prod-github-runner-207 kernel: [31608.619837] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 14:10:34 juju-e4d256-prod-github-runner-207 kernel: [31608.620722] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 14:10:34 juju-e4d256-prod-github-runner-207 kernel: [31608.621614] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 14:10:34 juju-e4d256-prod-github-runner-207 kernel: [31608.622567] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 14:10:34 juju-e4d256-prod-github-runner-207 kernel: [31608.623513] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 14:10:34 juju-e4d256-prod-github-runner-207 kernel: [31608.624411] Aug 22 14:11:02 juju-e4d256-prod-github-runner-207 kernel: [31636.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 29355s! [qemu-system-x86:6715] Aug 22 14:11:02 juju-e4d256-prod-github-runner-207 kernel: [31636.543106] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 14:11:02 juju-e4d256-prod-github-runner-207 kernel: [31636.543178] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 14:11:02 juju-e4d256-prod-github-runner-207 kernel: [31636.555270] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 14:11:02 juju-e4d256-prod-github-runner-207 kernel: [31636.556534] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 14:11:02 juju-e4d256-prod-github-runner-207 kernel: [31636.557760] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:11:02 juju-e4d256-prod-github-runner-207 kernel: [31636.558816] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 14:11:02 juju-e4d256-prod-github-runner-207 kernel: [31636.561365] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 14:11:02 juju-e4d256-prod-github-runner-207 kernel: [31636.562406] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 14:11:02 juju-e4d256-prod-github-runner-207 kernel: [31636.563573] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 14:11:02 juju-e4d256-prod-github-runner-207 kernel: [31636.564743] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 14:11:02 juju-e4d256-prod-github-runner-207 kernel: [31636.565901] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 14:11:02 juju-e4d256-prod-github-runner-207 kernel: [31636.567075] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 14:11:02 juju-e4d256-prod-github-runner-207 kernel: [31636.568405] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 14:11:02 juju-e4d256-prod-github-runner-207 kernel: [31636.569642] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 14:11:02 juju-e4d256-prod-github-runner-207 kernel: [31636.570738] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 14:11:02 juju-e4d256-prod-github-runner-207 kernel: [31636.571941] Call Trace: Aug 22 14:11:02 juju-e4d256-prod-github-runner-207 kernel: [31636.572852] Aug 22 14:11:02 juju-e4d256-prod-github-runner-207 kernel: [31636.573735] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:11:02 juju-e4d256-prod-github-runner-207 kernel: [31636.574764] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:11:02 juju-e4d256-prod-github-runner-207 kernel: [31636.575809] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:11:02 juju-e4d256-prod-github-runner-207 kernel: [31636.576889] ? show_regs.part.0+0x23/0x29 Aug 22 14:11:02 juju-e4d256-prod-github-runner-207 kernel: [31636.577891] ? show_regs.cold+0x8/0xd Aug 22 14:11:02 juju-e4d256-prod-github-runner-207 kernel: [31636.578876] ? watchdog_timer_fn+0x1be/0x220 Aug 22 14:11:02 juju-e4d256-prod-github-runner-207 kernel: [31636.579895] ? lockup_detector_update_enable+0x60/0x60 Aug 22 14:11:02 juju-e4d256-prod-github-runner-207 kernel: [31636.580963] ? __hrtimer_run_queues+0x107/0x230 Aug 22 14:11:02 juju-e4d256-prod-github-runner-207 kernel: [31636.581992] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 14:11:02 juju-e4d256-prod-github-runner-207 kernel: [31636.583028] ? hrtimer_interrupt+0x101/0x220 Aug 22 14:11:02 juju-e4d256-prod-github-runner-207 kernel: [31636.584043] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 14:11:02 juju-e4d256-prod-github-runner-207 kernel: [31636.585110] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 14:11:02 juju-e4d256-prod-github-runner-207 kernel: [31636.586156] Aug 22 14:11:02 juju-e4d256-prod-github-runner-207 kernel: [31636.587030] Aug 22 14:11:02 juju-e4d256-prod-github-runner-207 kernel: [31636.587883] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 14:11:02 juju-e4d256-prod-github-runner-207 kernel: [31636.588920] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:11:02 juju-e4d256-prod-github-runner-207 kernel: [31636.589963] ? _raw_spin_lock+0x22/0x30 Aug 22 14:11:02 juju-e4d256-prod-github-runner-207 kernel: [31636.590926] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:11:02 juju-e4d256-prod-github-runner-207 kernel: [31636.591958] direct_page_fault+0x206/0x310 [kvm] Aug 22 14:11:02 juju-e4d256-prod-github-runner-207 kernel: [31636.592986] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 14:11:02 juju-e4d256-prod-github-runner-207 kernel: [31636.593997] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 14:11:02 juju-e4d256-prod-github-runner-207 kernel: [31636.595006] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 14:11:02 juju-e4d256-prod-github-runner-207 kernel: [31636.595977] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 14:11:02 juju-e4d256-prod-github-runner-207 kernel: [31636.596922] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 14:11:02 juju-e4d256-prod-github-runner-207 kernel: [31636.597908] handle_exit+0x98/0x230 [kvm_amd] Aug 22 14:11:02 juju-e4d256-prod-github-runner-207 kernel: [31636.598804] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 14:11:02 juju-e4d256-prod-github-runner-207 kernel: [31636.599727] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 14:11:02 juju-e4d256-prod-github-runner-207 kernel: [31636.600651] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 14:11:02 juju-e4d256-prod-github-runner-207 kernel: [31636.601559] vcpu_run+0x62/0x2c0 [kvm] Aug 22 14:11:02 juju-e4d256-prod-github-runner-207 kernel: [31636.602382] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 14:11:02 juju-e4d256-prod-github-runner-207 kernel: [31636.603201] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 14:11:02 juju-e4d256-prod-github-runner-207 kernel: [31636.604066] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 14:11:02 juju-e4d256-prod-github-runner-207 kernel: [31636.604876] ? __seccomp_filter+0x4a/0x4a0 Aug 22 14:11:02 juju-e4d256-prod-github-runner-207 kernel: [31636.605628] ? __fget_files+0x86/0xc0 Aug 22 14:11:02 juju-e4d256-prod-github-runner-207 kernel: [31636.606337] __x64_sys_ioctl+0x95/0xd0 Aug 22 14:11:02 juju-e4d256-prod-github-runner-207 kernel: [31636.607038] do_syscall_64+0x5c/0xc0 Aug 22 14:11:02 juju-e4d256-prod-github-runner-207 kernel: [31636.607703] ? do_futex+0x162/0x1f0 Aug 22 14:11:02 juju-e4d256-prod-github-runner-207 kernel: [31636.608349] ? __x64_sys_futex+0x78/0x1e0 Aug 22 14:11:02 juju-e4d256-prod-github-runner-207 kernel: [31636.609026] ? __secure_computing+0xa9/0x120 Aug 22 14:11:02 juju-e4d256-prod-github-runner-207 kernel: [31636.609716] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 14:11:02 juju-e4d256-prod-github-runner-207 kernel: [31636.610474] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:11:02 juju-e4d256-prod-github-runner-207 kernel: [31636.611224] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:11:02 juju-e4d256-prod-github-runner-207 kernel: [31636.611947] ? do_syscall_64+0x69/0xc0 Aug 22 14:11:02 juju-e4d256-prod-github-runner-207 kernel: [31636.612593] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:11:02 juju-e4d256-prod-github-runner-207 kernel: [31636.613301] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:11:02 juju-e4d256-prod-github-runner-207 kernel: [31636.614000] ? do_syscall_64+0x69/0xc0 Aug 22 14:11:02 juju-e4d256-prod-github-runner-207 kernel: [31636.614624] ? do_syscall_64+0x69/0xc0 Aug 22 14:11:02 juju-e4d256-prod-github-runner-207 kernel: [31636.615259] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 14:11:02 juju-e4d256-prod-github-runner-207 kernel: [31636.615964] RIP: 0033:0x7faa5d0edaff Aug 22 14:11:02 juju-e4d256-prod-github-runner-207 kernel: [31636.616585] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 14:11:02 juju-e4d256-prod-github-runner-207 kernel: [31636.618570] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 14:11:02 juju-e4d256-prod-github-runner-207 kernel: [31636.619507] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 14:11:02 juju-e4d256-prod-github-runner-207 kernel: [31636.620400] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 14:11:02 juju-e4d256-prod-github-runner-207 kernel: [31636.621289] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 14:11:02 juju-e4d256-prod-github-runner-207 kernel: [31636.622176] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 14:11:02 juju-e4d256-prod-github-runner-207 kernel: [31636.623076] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 14:11:02 juju-e4d256-prod-github-runner-207 kernel: [31636.623975] Aug 22 14:11:30 juju-e4d256-prod-github-runner-207 kernel: [31664.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 29381s! [qemu-system-x86:6715] Aug 22 14:11:30 juju-e4d256-prod-github-runner-207 kernel: [31664.543869] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 14:11:30 juju-e4d256-prod-github-runner-207 kernel: [31664.544171] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 14:11:30 juju-e4d256-prod-github-runner-207 kernel: [31664.556318] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 14:11:30 juju-e4d256-prod-github-runner-207 kernel: [31664.557616] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 14:11:30 juju-e4d256-prod-github-runner-207 kernel: [31664.558851] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:11:30 juju-e4d256-prod-github-runner-207 kernel: [31664.559916] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 14:11:30 juju-e4d256-prod-github-runner-207 kernel: [31664.562518] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 14:11:30 juju-e4d256-prod-github-runner-207 kernel: [31664.563595] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 14:11:30 juju-e4d256-prod-github-runner-207 kernel: [31664.564756] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 14:11:30 juju-e4d256-prod-github-runner-207 kernel: [31664.565920] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 14:11:30 juju-e4d256-prod-github-runner-207 kernel: [31664.567109] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 14:11:30 juju-e4d256-prod-github-runner-207 kernel: [31664.568275] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 14:11:30 juju-e4d256-prod-github-runner-207 kernel: [31664.569439] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 14:11:30 juju-e4d256-prod-github-runner-207 kernel: [31664.570767] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 14:11:30 juju-e4d256-prod-github-runner-207 kernel: [31664.571879] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 14:11:30 juju-e4d256-prod-github-runner-207 kernel: [31664.573089] Call Trace: Aug 22 14:11:30 juju-e4d256-prod-github-runner-207 kernel: [31664.574005] Aug 22 14:11:30 juju-e4d256-prod-github-runner-207 kernel: [31664.574921] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:11:30 juju-e4d256-prod-github-runner-207 kernel: [31664.575952] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:11:30 juju-e4d256-prod-github-runner-207 kernel: [31664.576981] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:11:30 juju-e4d256-prod-github-runner-207 kernel: [31664.578094] ? show_regs.part.0+0x23/0x29 Aug 22 14:11:30 juju-e4d256-prod-github-runner-207 kernel: [31664.579133] ? show_regs.cold+0x8/0xd Aug 22 14:11:30 juju-e4d256-prod-github-runner-207 kernel: [31664.580105] ? watchdog_timer_fn+0x1be/0x220 Aug 22 14:11:30 juju-e4d256-prod-github-runner-207 kernel: [31664.581111] ? lockup_detector_update_enable+0x60/0x60 Aug 22 14:11:30 juju-e4d256-prod-github-runner-207 kernel: [31664.582246] ? __hrtimer_run_queues+0x107/0x230 Aug 22 14:11:30 juju-e4d256-prod-github-runner-207 kernel: [31664.583358] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 14:11:30 juju-e4d256-prod-github-runner-207 kernel: [31664.584400] ? hrtimer_interrupt+0x101/0x220 Aug 22 14:11:30 juju-e4d256-prod-github-runner-207 kernel: [31664.585414] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 14:11:30 juju-e4d256-prod-github-runner-207 kernel: [31664.586480] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 14:11:30 juju-e4d256-prod-github-runner-207 kernel: [31664.587570] Aug 22 14:11:30 juju-e4d256-prod-github-runner-207 kernel: [31664.588421] Aug 22 14:11:30 juju-e4d256-prod-github-runner-207 kernel: [31664.589315] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 14:11:30 juju-e4d256-prod-github-runner-207 kernel: [31664.590429] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:11:30 juju-e4d256-prod-github-runner-207 kernel: [31664.591528] ? _raw_spin_lock+0x22/0x30 Aug 22 14:11:30 juju-e4d256-prod-github-runner-207 kernel: [31664.592477] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:11:30 juju-e4d256-prod-github-runner-207 kernel: [31664.593500] direct_page_fault+0x206/0x310 [kvm] Aug 22 14:11:30 juju-e4d256-prod-github-runner-207 kernel: [31664.594521] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 14:11:30 juju-e4d256-prod-github-runner-207 kernel: [31664.595576] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 14:11:30 juju-e4d256-prod-github-runner-207 kernel: [31664.596589] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 14:11:30 juju-e4d256-prod-github-runner-207 kernel: [31664.597605] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 14:11:30 juju-e4d256-prod-github-runner-207 kernel: [31664.598573] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 14:11:30 juju-e4d256-prod-github-runner-207 kernel: [31664.599601] handle_exit+0x98/0x230 [kvm_amd] Aug 22 14:11:30 juju-e4d256-prod-github-runner-207 kernel: [31664.600812] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 14:11:30 juju-e4d256-prod-github-runner-207 kernel: [31664.601738] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 14:11:30 juju-e4d256-prod-github-runner-207 kernel: [31664.602711] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 14:11:30 juju-e4d256-prod-github-runner-207 kernel: [31664.603620] vcpu_run+0x62/0x2c0 [kvm] Aug 22 14:11:30 juju-e4d256-prod-github-runner-207 kernel: [31664.604429] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 14:11:30 juju-e4d256-prod-github-runner-207 kernel: [31664.605242] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 14:11:30 juju-e4d256-prod-github-runner-207 kernel: [31664.606096] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 14:11:30 juju-e4d256-prod-github-runner-207 kernel: [31664.606934] ? __seccomp_filter+0x4a/0x4a0 Aug 22 14:11:30 juju-e4d256-prod-github-runner-207 kernel: [31664.607723] ? __fget_files+0x86/0xc0 Aug 22 14:11:30 juju-e4d256-prod-github-runner-207 kernel: [31664.608429] __x64_sys_ioctl+0x95/0xd0 Aug 22 14:11:30 juju-e4d256-prod-github-runner-207 kernel: [31664.609121] do_syscall_64+0x5c/0xc0 Aug 22 14:11:30 juju-e4d256-prod-github-runner-207 kernel: [31664.609787] ? do_futex+0x162/0x1f0 Aug 22 14:11:30 juju-e4d256-prod-github-runner-207 kernel: [31664.610446] ? __x64_sys_futex+0x78/0x1e0 Aug 22 14:11:30 juju-e4d256-prod-github-runner-207 kernel: [31664.611166] ? __secure_computing+0xa9/0x120 Aug 22 14:11:30 juju-e4d256-prod-github-runner-207 kernel: [31664.611876] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 14:11:30 juju-e4d256-prod-github-runner-207 kernel: [31664.612636] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:11:30 juju-e4d256-prod-github-runner-207 kernel: [31664.613360] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:11:30 juju-e4d256-prod-github-runner-207 kernel: [31664.614077] ? do_syscall_64+0x69/0xc0 Aug 22 14:11:30 juju-e4d256-prod-github-runner-207 kernel: [31664.614749] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:11:30 juju-e4d256-prod-github-runner-207 kernel: [31664.615454] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:11:30 juju-e4d256-prod-github-runner-207 kernel: [31664.616148] ? do_syscall_64+0x69/0xc0 Aug 22 14:11:30 juju-e4d256-prod-github-runner-207 kernel: [31664.616773] ? do_syscall_64+0x69/0xc0 Aug 22 14:11:30 juju-e4d256-prod-github-runner-207 kernel: [31664.617395] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 14:11:30 juju-e4d256-prod-github-runner-207 kernel: [31664.618099] RIP: 0033:0x7faa5d0edaff Aug 22 14:11:30 juju-e4d256-prod-github-runner-207 kernel: [31664.618872] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 14:11:30 juju-e4d256-prod-github-runner-207 kernel: [31664.620946] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 14:11:30 juju-e4d256-prod-github-runner-207 kernel: [31664.621860] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 14:11:30 juju-e4d256-prod-github-runner-207 kernel: [31664.622792] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 14:11:30 juju-e4d256-prod-github-runner-207 kernel: [31664.623688] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 14:11:30 juju-e4d256-prod-github-runner-207 kernel: [31664.624620] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 14:11:30 juju-e4d256-prod-github-runner-207 kernel: [31664.625536] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 14:11:30 juju-e4d256-prod-github-runner-207 kernel: [31664.626431] Aug 22 14:11:45 juju-e4d256-prod-github-runner-207 kernel: [31679.300709] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 14:11:45 juju-e4d256-prod-github-runner-207 kernel: [31679.301710] rcu: 1-....: (7865905 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=3801051 Aug 22 14:11:45 juju-e4d256-prod-github-runner-207 kernel: [31679.302995] (t=7890525 jiffies g=23269 q=34552) Aug 22 14:11:45 juju-e4d256-prod-github-runner-207 kernel: [31679.303805] NMI backtrace for cpu 1 Aug 22 14:11:45 juju-e4d256-prod-github-runner-207 kernel: [31679.304540] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 14:11:45 juju-e4d256-prod-github-runner-207 kernel: [31679.305855] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 14:11:45 juju-e4d256-prod-github-runner-207 kernel: [31679.307114] Call Trace: Aug 22 14:11:45 juju-e4d256-prod-github-runner-207 kernel: [31679.307861] Aug 22 14:11:45 juju-e4d256-prod-github-runner-207 kernel: [31679.308549] show_stack+0x52/0x5c Aug 22 14:11:45 juju-e4d256-prod-github-runner-207 kernel: [31679.309346] dump_stack_lvl+0x4a/0x63 Aug 22 14:11:45 juju-e4d256-prod-github-runner-207 kernel: [31679.310167] dump_stack+0x10/0x16 Aug 22 14:11:45 juju-e4d256-prod-github-runner-207 kernel: [31679.310999] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 14:11:45 juju-e4d256-prod-github-runner-207 kernel: [31679.311860] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 14:11:45 juju-e4d256-prod-github-runner-207 kernel: [31679.312724] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 14:11:45 juju-e4d256-prod-github-runner-207 kernel: [31679.313637] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 14:11:45 juju-e4d256-prod-github-runner-207 kernel: [31679.314568] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 14:11:45 juju-e4d256-prod-github-runner-207 kernel: [31679.315468] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 14:11:45 juju-e4d256-prod-github-runner-207 kernel: [31679.316323] print_cpu_stall.cold+0x2f/0xe2 Aug 22 14:11:45 juju-e4d256-prod-github-runner-207 kernel: [31679.317170] ? timekeeping_update+0xf7/0x150 Aug 22 14:11:45 juju-e4d256-prod-github-runner-207 kernel: [31679.318019] check_cpu_stall+0x109/0x270 Aug 22 14:11:45 juju-e4d256-prod-github-runner-207 kernel: [31679.318852] rcu_sched_clock_irq+0x9a/0x250 Aug 22 14:11:45 juju-e4d256-prod-github-runner-207 kernel: [31679.319696] update_process_times+0x94/0xd0 Aug 22 14:11:45 juju-e4d256-prod-github-runner-207 kernel: [31679.320536] tick_sched_handle+0x29/0x70 Aug 22 14:11:45 juju-e4d256-prod-github-runner-207 kernel: [31679.321356] tick_sched_timer+0x8c/0xc0 Aug 22 14:11:45 juju-e4d256-prod-github-runner-207 kernel: [31679.322174] ? tick_nohz_handler+0xb0/0xb0 Aug 22 14:11:45 juju-e4d256-prod-github-runner-207 kernel: [31679.323016] __hrtimer_run_queues+0x107/0x230 Aug 22 14:11:45 juju-e4d256-prod-github-runner-207 kernel: [31679.323873] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 14:11:45 juju-e4d256-prod-github-runner-207 kernel: [31679.324728] hrtimer_interrupt+0x101/0x220 Aug 22 14:11:45 juju-e4d256-prod-github-runner-207 kernel: [31679.325573] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 14:11:45 juju-e4d256-prod-github-runner-207 kernel: [31679.326501] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 14:11:45 juju-e4d256-prod-github-runner-207 kernel: [31679.327397] Aug 22 14:11:45 juju-e4d256-prod-github-runner-207 kernel: [31679.328113] Aug 22 14:11:45 juju-e4d256-prod-github-runner-207 kernel: [31679.328800] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 14:11:45 juju-e4d256-prod-github-runner-207 kernel: [31679.329714] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:11:45 juju-e4d256-prod-github-runner-207 kernel: [31679.330713] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 14:11:45 juju-e4d256-prod-github-runner-207 kernel: [31679.333235] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 14:11:45 juju-e4d256-prod-github-runner-207 kernel: [31679.334213] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 14:11:45 juju-e4d256-prod-github-runner-207 kernel: [31679.335348] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 14:11:45 juju-e4d256-prod-github-runner-207 kernel: [31679.336468] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 14:11:45 juju-e4d256-prod-github-runner-207 kernel: [31679.337572] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 14:11:45 juju-e4d256-prod-github-runner-207 kernel: [31679.338715] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 14:11:45 juju-e4d256-prod-github-runner-207 kernel: [31679.339821] ? _raw_spin_lock+0x22/0x30 Aug 22 14:11:45 juju-e4d256-prod-github-runner-207 kernel: [31679.340658] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:11:45 juju-e4d256-prod-github-runner-207 kernel: [31679.341608] direct_page_fault+0x206/0x310 [kvm] Aug 22 14:11:45 juju-e4d256-prod-github-runner-207 kernel: [31679.342560] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 14:11:45 juju-e4d256-prod-github-runner-207 kernel: [31679.343490] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 14:11:45 juju-e4d256-prod-github-runner-207 kernel: [31679.344408] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 14:11:45 juju-e4d256-prod-github-runner-207 kernel: [31679.345301] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 14:11:45 juju-e4d256-prod-github-runner-207 kernel: [31679.346181] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 14:11:45 juju-e4d256-prod-github-runner-207 kernel: [31679.347127] handle_exit+0x98/0x230 [kvm_amd] Aug 22 14:11:45 juju-e4d256-prod-github-runner-207 kernel: [31679.347965] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 14:11:45 juju-e4d256-prod-github-runner-207 kernel: [31679.348839] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 14:11:45 juju-e4d256-prod-github-runner-207 kernel: [31679.349733] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 14:11:45 juju-e4d256-prod-github-runner-207 kernel: [31679.350650] vcpu_run+0x62/0x2c0 [kvm] Aug 22 14:11:45 juju-e4d256-prod-github-runner-207 kernel: [31679.351450] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 14:11:45 juju-e4d256-prod-github-runner-207 kernel: [31679.352298] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 14:11:45 juju-e4d256-prod-github-runner-207 kernel: [31679.353196] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 14:11:45 juju-e4d256-prod-github-runner-207 kernel: [31679.354047] ? __seccomp_filter+0x4a/0x4a0 Aug 22 14:11:45 juju-e4d256-prod-github-runner-207 kernel: [31679.354868] ? __fget_files+0x86/0xc0 Aug 22 14:11:45 juju-e4d256-prod-github-runner-207 kernel: [31679.355631] __x64_sys_ioctl+0x95/0xd0 Aug 22 14:11:45 juju-e4d256-prod-github-runner-207 kernel: [31679.356394] do_syscall_64+0x5c/0xc0 Aug 22 14:11:45 juju-e4d256-prod-github-runner-207 kernel: [31679.357145] ? do_futex+0x162/0x1f0 Aug 22 14:11:45 juju-e4d256-prod-github-runner-207 kernel: [31679.357887] ? __x64_sys_futex+0x78/0x1e0 Aug 22 14:11:45 juju-e4d256-prod-github-runner-207 kernel: [31679.358651] ? __secure_computing+0xa9/0x120 Aug 22 14:11:45 juju-e4d256-prod-github-runner-207 kernel: [31679.359370] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 14:11:45 juju-e4d256-prod-github-runner-207 kernel: [31679.360156] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:11:45 juju-e4d256-prod-github-runner-207 kernel: [31679.360906] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:11:45 juju-e4d256-prod-github-runner-207 kernel: [31679.361657] ? do_syscall_64+0x69/0xc0 Aug 22 14:11:45 juju-e4d256-prod-github-runner-207 kernel: [31679.362346] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:11:45 juju-e4d256-prod-github-runner-207 kernel: [31679.363113] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:11:45 juju-e4d256-prod-github-runner-207 kernel: [31679.363866] ? do_syscall_64+0x69/0xc0 Aug 22 14:11:45 juju-e4d256-prod-github-runner-207 kernel: [31679.364562] ? do_syscall_64+0x69/0xc0 Aug 22 14:11:45 juju-e4d256-prod-github-runner-207 kernel: [31679.365246] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 14:11:45 juju-e4d256-prod-github-runner-207 kernel: [31679.366017] RIP: 0033:0x7faa5d0edaff Aug 22 14:11:45 juju-e4d256-prod-github-runner-207 kernel: [31679.366721] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 14:11:45 juju-e4d256-prod-github-runner-207 kernel: [31679.368815] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 14:11:45 juju-e4d256-prod-github-runner-207 kernel: [31679.369781] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 14:11:45 juju-e4d256-prod-github-runner-207 kernel: [31679.370763] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 14:11:45 juju-e4d256-prod-github-runner-207 kernel: [31679.371735] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 14:11:45 juju-e4d256-prod-github-runner-207 kernel: [31679.372684] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 14:11:45 juju-e4d256-prod-github-runner-207 kernel: [31679.373610] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 14:11:45 juju-e4d256-prod-github-runner-207 kernel: [31679.374567] Aug 22 14:12:10 juju-e4d256-prod-github-runner-207 kernel: [31704.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 29419s! [qemu-system-x86:6715] Aug 22 14:12:10 juju-e4d256-prod-github-runner-207 kernel: [31704.543136] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 14:12:10 juju-e4d256-prod-github-runner-207 kernel: [31704.543211] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 14:12:10 juju-e4d256-prod-github-runner-207 kernel: [31704.556119] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 14:12:10 juju-e4d256-prod-github-runner-207 kernel: [31704.557600] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 14:12:10 juju-e4d256-prod-github-runner-207 kernel: [31704.559061] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:12:10 juju-e4d256-prod-github-runner-207 kernel: [31704.560253] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 14:12:10 juju-e4d256-prod-github-runner-207 kernel: [31704.563292] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 14:12:10 juju-e4d256-prod-github-runner-207 kernel: [31704.564599] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 14:12:10 juju-e4d256-prod-github-runner-207 kernel: [31704.565902] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 14:12:10 juju-e4d256-prod-github-runner-207 kernel: [31704.567220] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 14:12:10 juju-e4d256-prod-github-runner-207 kernel: [31704.568517] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 14:12:10 juju-e4d256-prod-github-runner-207 kernel: [31704.569819] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 14:12:10 juju-e4d256-prod-github-runner-207 kernel: [31704.571148] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 14:12:10 juju-e4d256-prod-github-runner-207 kernel: [31704.572540] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 14:12:10 juju-e4d256-prod-github-runner-207 kernel: [31704.573756] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 14:12:10 juju-e4d256-prod-github-runner-207 kernel: [31704.575132] Call Trace: Aug 22 14:12:10 juju-e4d256-prod-github-runner-207 kernel: [31704.576105] Aug 22 14:12:10 juju-e4d256-prod-github-runner-207 kernel: [31704.577047] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:12:10 juju-e4d256-prod-github-runner-207 kernel: [31704.578210] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:12:10 juju-e4d256-prod-github-runner-207 kernel: [31704.579657] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:12:10 juju-e4d256-prod-github-runner-207 kernel: [31704.580862] ? show_regs.part.0+0x23/0x29 Aug 22 14:12:10 juju-e4d256-prod-github-runner-207 kernel: [31704.582006] ? show_regs.cold+0x8/0xd Aug 22 14:12:10 juju-e4d256-prod-github-runner-207 kernel: [31704.583083] ? watchdog_timer_fn+0x1be/0x220 Aug 22 14:12:10 juju-e4d256-prod-github-runner-207 kernel: [31704.584177] ? lockup_detector_update_enable+0x60/0x60 Aug 22 14:12:10 juju-e4d256-prod-github-runner-207 kernel: [31704.585345] ? __hrtimer_run_queues+0x107/0x230 Aug 22 14:12:10 juju-e4d256-prod-github-runner-207 kernel: [31704.586496] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 14:12:10 juju-e4d256-prod-github-runner-207 kernel: [31704.587610] ? hrtimer_interrupt+0x101/0x220 Aug 22 14:12:10 juju-e4d256-prod-github-runner-207 kernel: [31704.588714] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 14:12:10 juju-e4d256-prod-github-runner-207 kernel: [31704.589801] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 14:12:10 juju-e4d256-prod-github-runner-207 kernel: [31704.590891] Aug 22 14:12:10 juju-e4d256-prod-github-runner-207 kernel: [31704.591750] Aug 22 14:12:10 juju-e4d256-prod-github-runner-207 kernel: [31704.592588] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 14:12:10 juju-e4d256-prod-github-runner-207 kernel: [31704.593631] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:12:10 juju-e4d256-prod-github-runner-207 kernel: [31704.594708] ? _raw_spin_lock+0x22/0x30 Aug 22 14:12:10 juju-e4d256-prod-github-runner-207 kernel: [31704.595667] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:12:10 juju-e4d256-prod-github-runner-207 kernel: [31704.596696] direct_page_fault+0x206/0x310 [kvm] Aug 22 14:12:10 juju-e4d256-prod-github-runner-207 kernel: [31704.597752] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 14:12:10 juju-e4d256-prod-github-runner-207 kernel: [31704.598794] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 14:12:10 juju-e4d256-prod-github-runner-207 kernel: [31704.599795] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 14:12:10 juju-e4d256-prod-github-runner-207 kernel: [31704.600763] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 14:12:10 juju-e4d256-prod-github-runner-207 kernel: [31704.601709] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 14:12:10 juju-e4d256-prod-github-runner-207 kernel: [31704.602703] handle_exit+0x98/0x230 [kvm_amd] Aug 22 14:12:10 juju-e4d256-prod-github-runner-207 kernel: [31704.603599] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 14:12:10 juju-e4d256-prod-github-runner-207 kernel: [31704.604523] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 14:12:10 juju-e4d256-prod-github-runner-207 kernel: [31704.605448] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 14:12:10 juju-e4d256-prod-github-runner-207 kernel: [31704.606369] vcpu_run+0x62/0x2c0 [kvm] Aug 22 14:12:10 juju-e4d256-prod-github-runner-207 kernel: [31704.607181] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 14:12:10 juju-e4d256-prod-github-runner-207 kernel: [31704.607993] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 14:12:10 juju-e4d256-prod-github-runner-207 kernel: [31704.608860] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 14:12:10 juju-e4d256-prod-github-runner-207 kernel: [31704.609656] ? __seccomp_filter+0x4a/0x4a0 Aug 22 14:12:10 juju-e4d256-prod-github-runner-207 kernel: [31704.610424] ? __fget_files+0x86/0xc0 Aug 22 14:12:10 juju-e4d256-prod-github-runner-207 kernel: [31704.611134] __x64_sys_ioctl+0x95/0xd0 Aug 22 14:12:10 juju-e4d256-prod-github-runner-207 kernel: [31704.612351] do_syscall_64+0x5c/0xc0 Aug 22 14:12:10 juju-e4d256-prod-github-runner-207 kernel: [31704.613033] ? do_futex+0x162/0x1f0 Aug 22 14:12:10 juju-e4d256-prod-github-runner-207 kernel: [31704.613698] ? __x64_sys_futex+0x78/0x1e0 Aug 22 14:12:10 juju-e4d256-prod-github-runner-207 kernel: [31704.614496] ? __secure_computing+0xa9/0x120 Aug 22 14:12:10 juju-e4d256-prod-github-runner-207 kernel: [31704.615189] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 14:12:10 juju-e4d256-prod-github-runner-207 kernel: [31704.616100] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:12:10 juju-e4d256-prod-github-runner-207 kernel: [31704.616823] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:12:10 juju-e4d256-prod-github-runner-207 kernel: [31704.617654] ? do_syscall_64+0x69/0xc0 Aug 22 14:12:10 juju-e4d256-prod-github-runner-207 kernel: [31704.618388] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:12:10 juju-e4d256-prod-github-runner-207 kernel: [31704.619246] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:12:10 juju-e4d256-prod-github-runner-207 kernel: [31704.619999] ? do_syscall_64+0x69/0xc0 Aug 22 14:12:10 juju-e4d256-prod-github-runner-207 kernel: [31704.620681] ? do_syscall_64+0x69/0xc0 Aug 22 14:12:10 juju-e4d256-prod-github-runner-207 kernel: [31704.621395] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 14:12:10 juju-e4d256-prod-github-runner-207 kernel: [31704.622177] RIP: 0033:0x7faa5d0edaff Aug 22 14:12:10 juju-e4d256-prod-github-runner-207 kernel: [31704.622896] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 14:12:10 juju-e4d256-prod-github-runner-207 kernel: [31704.625081] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 14:12:10 juju-e4d256-prod-github-runner-207 kernel: [31704.626045] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 14:12:10 juju-e4d256-prod-github-runner-207 kernel: [31704.626964] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 14:12:10 juju-e4d256-prod-github-runner-207 kernel: [31704.627877] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 14:12:10 juju-e4d256-prod-github-runner-207 kernel: [31704.628770] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 14:12:10 juju-e4d256-prod-github-runner-207 kernel: [31704.629722] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 14:12:10 juju-e4d256-prod-github-runner-207 kernel: [31704.630661] Aug 22 14:12:38 juju-e4d256-prod-github-runner-207 kernel: [31732.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 29445s! [qemu-system-x86:6715] Aug 22 14:12:38 juju-e4d256-prod-github-runner-207 kernel: [31732.543144] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 14:12:38 juju-e4d256-prod-github-runner-207 kernel: [31732.543220] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 14:12:38 juju-e4d256-prod-github-runner-207 kernel: [31732.555289] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 14:12:38 juju-e4d256-prod-github-runner-207 kernel: [31732.556557] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 14:12:38 juju-e4d256-prod-github-runner-207 kernel: [31732.557791] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:12:38 juju-e4d256-prod-github-runner-207 kernel: [31732.558857] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 14:12:38 juju-e4d256-prod-github-runner-207 kernel: [31732.561411] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 14:12:38 juju-e4d256-prod-github-runner-207 kernel: [31732.562464] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 14:12:38 juju-e4d256-prod-github-runner-207 kernel: [31732.563632] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 14:12:38 juju-e4d256-prod-github-runner-207 kernel: [31732.564803] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 14:12:38 juju-e4d256-prod-github-runner-207 kernel: [31732.565984] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 14:12:38 juju-e4d256-prod-github-runner-207 kernel: [31732.567147] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 14:12:38 juju-e4d256-prod-github-runner-207 kernel: [31732.568317] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 14:12:38 juju-e4d256-prod-github-runner-207 kernel: [31732.569651] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 14:12:38 juju-e4d256-prod-github-runner-207 kernel: [31732.570764] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 14:12:38 juju-e4d256-prod-github-runner-207 kernel: [31732.571984] Call Trace: Aug 22 14:12:38 juju-e4d256-prod-github-runner-207 kernel: [31732.572917] Aug 22 14:12:38 juju-e4d256-prod-github-runner-207 kernel: [31732.573829] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:12:38 juju-e4d256-prod-github-runner-207 kernel: [31732.574890] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:12:38 juju-e4d256-prod-github-runner-207 kernel: [31732.575933] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:12:38 juju-e4d256-prod-github-runner-207 kernel: [31732.577030] ? show_regs.part.0+0x23/0x29 Aug 22 14:12:38 juju-e4d256-prod-github-runner-207 kernel: [31732.578075] ? show_regs.cold+0x8/0xd Aug 22 14:12:38 juju-e4d256-prod-github-runner-207 kernel: [31732.579048] ? watchdog_timer_fn+0x1be/0x220 Aug 22 14:12:38 juju-e4d256-prod-github-runner-207 kernel: [31732.580055] ? lockup_detector_update_enable+0x60/0x60 Aug 22 14:12:38 juju-e4d256-prod-github-runner-207 kernel: [31732.581122] ? __hrtimer_run_queues+0x107/0x230 Aug 22 14:12:38 juju-e4d256-prod-github-runner-207 kernel: [31732.582169] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 14:12:38 juju-e4d256-prod-github-runner-207 kernel: [31732.583191] ? hrtimer_interrupt+0x101/0x220 Aug 22 14:12:38 juju-e4d256-prod-github-runner-207 kernel: [31732.584209] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 14:12:38 juju-e4d256-prod-github-runner-207 kernel: [31732.585279] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 14:12:38 juju-e4d256-prod-github-runner-207 kernel: [31732.586358] Aug 22 14:12:38 juju-e4d256-prod-github-runner-207 kernel: [31732.587228] Aug 22 14:12:38 juju-e4d256-prod-github-runner-207 kernel: [31732.588071] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 14:12:38 juju-e4d256-prod-github-runner-207 kernel: [31732.589102] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:12:38 juju-e4d256-prod-github-runner-207 kernel: [31732.590152] ? _raw_spin_lock+0x22/0x30 Aug 22 14:12:38 juju-e4d256-prod-github-runner-207 kernel: [31732.591099] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:12:38 juju-e4d256-prod-github-runner-207 kernel: [31732.592114] direct_page_fault+0x206/0x310 [kvm] Aug 22 14:12:38 juju-e4d256-prod-github-runner-207 kernel: [31732.593154] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 14:12:38 juju-e4d256-prod-github-runner-207 kernel: [31732.594186] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 14:12:38 juju-e4d256-prod-github-runner-207 kernel: [31732.595189] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 14:12:38 juju-e4d256-prod-github-runner-207 kernel: [31732.596164] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 14:12:38 juju-e4d256-prod-github-runner-207 kernel: [31732.597108] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 14:12:38 juju-e4d256-prod-github-runner-207 kernel: [31732.598095] handle_exit+0x98/0x230 [kvm_amd] Aug 22 14:12:38 juju-e4d256-prod-github-runner-207 kernel: [31732.598992] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 14:12:38 juju-e4d256-prod-github-runner-207 kernel: [31732.599910] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 14:12:38 juju-e4d256-prod-github-runner-207 kernel: [31732.600835] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 14:12:38 juju-e4d256-prod-github-runner-207 kernel: [31732.601746] vcpu_run+0x62/0x2c0 [kvm] Aug 22 14:12:38 juju-e4d256-prod-github-runner-207 kernel: [31732.602555] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 14:12:38 juju-e4d256-prod-github-runner-207 kernel: [31732.603367] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 14:12:38 juju-e4d256-prod-github-runner-207 kernel: [31732.604218] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 14:12:38 juju-e4d256-prod-github-runner-207 kernel: [31732.605014] ? __seccomp_filter+0x4a/0x4a0 Aug 22 14:12:38 juju-e4d256-prod-github-runner-207 kernel: [31732.605767] ? __fget_files+0x86/0xc0 Aug 22 14:12:38 juju-e4d256-prod-github-runner-207 kernel: [31732.606468] __x64_sys_ioctl+0x95/0xd0 Aug 22 14:12:38 juju-e4d256-prod-github-runner-207 kernel: [31732.607159] do_syscall_64+0x5c/0xc0 Aug 22 14:12:38 juju-e4d256-prod-github-runner-207 kernel: [31732.607820] ? do_futex+0x162/0x1f0 Aug 22 14:12:38 juju-e4d256-prod-github-runner-207 kernel: [31732.608479] ? __x64_sys_futex+0x78/0x1e0 Aug 22 14:12:38 juju-e4d256-prod-github-runner-207 kernel: [31732.609166] ? __secure_computing+0xa9/0x120 Aug 22 14:12:38 juju-e4d256-prod-github-runner-207 kernel: [31732.609896] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 14:12:38 juju-e4d256-prod-github-runner-207 kernel: [31732.610652] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:12:38 juju-e4d256-prod-github-runner-207 kernel: [31732.611369] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:12:38 juju-e4d256-prod-github-runner-207 kernel: [31732.612089] ? do_syscall_64+0x69/0xc0 Aug 22 14:12:38 juju-e4d256-prod-github-runner-207 kernel: [31732.612736] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:12:38 juju-e4d256-prod-github-runner-207 kernel: [31732.613449] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:12:38 juju-e4d256-prod-github-runner-207 kernel: [31732.614152] ? do_syscall_64+0x69/0xc0 Aug 22 14:12:38 juju-e4d256-prod-github-runner-207 kernel: [31732.614779] ? do_syscall_64+0x69/0xc0 Aug 22 14:12:38 juju-e4d256-prod-github-runner-207 kernel: [31732.615398] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 14:12:38 juju-e4d256-prod-github-runner-207 kernel: [31732.616105] RIP: 0033:0x7faa5d0edaff Aug 22 14:12:38 juju-e4d256-prod-github-runner-207 kernel: [31732.616726] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 14:12:38 juju-e4d256-prod-github-runner-207 kernel: [31732.618714] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 14:12:38 juju-e4d256-prod-github-runner-207 kernel: [31732.619617] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 14:12:38 juju-e4d256-prod-github-runner-207 kernel: [31732.620506] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 14:12:38 juju-e4d256-prod-github-runner-207 kernel: [31732.621409] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 14:12:38 juju-e4d256-prod-github-runner-207 kernel: [31732.622304] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 14:12:38 juju-e4d256-prod-github-runner-207 kernel: [31732.623188] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 14:12:38 juju-e4d256-prod-github-runner-207 kernel: [31732.624075] Aug 22 14:13:06 juju-e4d256-prod-github-runner-207 kernel: [31760.541981] watchdog: BUG: soft lockup - CPU#1 stuck for 29471s! [qemu-system-x86:6715] Aug 22 14:13:06 juju-e4d256-prod-github-runner-207 kernel: [31760.543894] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 14:13:06 juju-e4d256-prod-github-runner-207 kernel: [31760.544219] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 14:13:06 juju-e4d256-prod-github-runner-207 kernel: [31760.557043] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 14:13:06 juju-e4d256-prod-github-runner-207 kernel: [31760.558356] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 14:13:06 juju-e4d256-prod-github-runner-207 kernel: [31760.559609] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:13:06 juju-e4d256-prod-github-runner-207 kernel: [31760.560998] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 14:13:06 juju-e4d256-prod-github-runner-207 kernel: [31760.563638] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 14:13:06 juju-e4d256-prod-github-runner-207 kernel: [31760.564703] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 14:13:06 juju-e4d256-prod-github-runner-207 kernel: [31760.565900] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 14:13:06 juju-e4d256-prod-github-runner-207 kernel: [31760.567087] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 14:13:06 juju-e4d256-prod-github-runner-207 kernel: [31760.568262] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 14:13:06 juju-e4d256-prod-github-runner-207 kernel: [31760.569463] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 14:13:06 juju-e4d256-prod-github-runner-207 kernel: [31760.570664] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 14:13:06 juju-e4d256-prod-github-runner-207 kernel: [31760.571931] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 14:13:06 juju-e4d256-prod-github-runner-207 kernel: [31760.573241] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 14:13:06 juju-e4d256-prod-github-runner-207 kernel: [31760.574478] Call Trace: Aug 22 14:13:06 juju-e4d256-prod-github-runner-207 kernel: [31760.575398] Aug 22 14:13:06 juju-e4d256-prod-github-runner-207 kernel: [31760.576301] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:13:06 juju-e4d256-prod-github-runner-207 kernel: [31760.577348] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:13:06 juju-e4d256-prod-github-runner-207 kernel: [31760.578389] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:13:06 juju-e4d256-prod-github-runner-207 kernel: [31760.579495] ? show_regs.part.0+0x23/0x29 Aug 22 14:13:06 juju-e4d256-prod-github-runner-207 kernel: [31760.580500] ? show_regs.cold+0x8/0xd Aug 22 14:13:06 juju-e4d256-prod-github-runner-207 kernel: [31760.581497] ? watchdog_timer_fn+0x1be/0x220 Aug 22 14:13:06 juju-e4d256-prod-github-runner-207 kernel: [31760.582521] ? lockup_detector_update_enable+0x60/0x60 Aug 22 14:13:06 juju-e4d256-prod-github-runner-207 kernel: [31760.583599] ? __hrtimer_run_queues+0x107/0x230 Aug 22 14:13:06 juju-e4d256-prod-github-runner-207 kernel: [31760.584643] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 14:13:06 juju-e4d256-prod-github-runner-207 kernel: [31760.585695] ? hrtimer_interrupt+0x101/0x220 Aug 22 14:13:06 juju-e4d256-prod-github-runner-207 kernel: [31760.586722] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 14:13:06 juju-e4d256-prod-github-runner-207 kernel: [31760.587809] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 14:13:06 juju-e4d256-prod-github-runner-207 kernel: [31760.588868] Aug 22 14:13:06 juju-e4d256-prod-github-runner-207 kernel: [31760.589774] Aug 22 14:13:06 juju-e4d256-prod-github-runner-207 kernel: [31760.590680] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 14:13:06 juju-e4d256-prod-github-runner-207 kernel: [31760.592455] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:13:06 juju-e4d256-prod-github-runner-207 kernel: [31760.593793] ? _raw_spin_lock+0x22/0x30 Aug 22 14:13:06 juju-e4d256-prod-github-runner-207 kernel: [31760.594950] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:13:06 juju-e4d256-prod-github-runner-207 kernel: [31760.596004] direct_page_fault+0x206/0x310 [kvm] Aug 22 14:13:06 juju-e4d256-prod-github-runner-207 kernel: [31760.597080] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 14:13:06 juju-e4d256-prod-github-runner-207 kernel: [31760.598325] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 14:13:06 juju-e4d256-prod-github-runner-207 kernel: [31760.599709] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 14:13:06 juju-e4d256-prod-github-runner-207 kernel: [31760.600752] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 14:13:06 juju-e4d256-prod-github-runner-207 kernel: [31760.601766] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 14:13:06 juju-e4d256-prod-github-runner-207 kernel: [31760.602795] handle_exit+0x98/0x230 [kvm_amd] Aug 22 14:13:06 juju-e4d256-prod-github-runner-207 kernel: [31760.603734] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 14:13:06 juju-e4d256-prod-github-runner-207 kernel: [31760.604708] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 14:13:06 juju-e4d256-prod-github-runner-207 kernel: [31760.605894] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 14:13:06 juju-e4d256-prod-github-runner-207 kernel: [31760.606820] vcpu_run+0x62/0x2c0 [kvm] Aug 22 14:13:06 juju-e4d256-prod-github-runner-207 kernel: [31760.607648] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 14:13:06 juju-e4d256-prod-github-runner-207 kernel: [31760.608471] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 14:13:06 juju-e4d256-prod-github-runner-207 kernel: [31760.609347] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 14:13:06 juju-e4d256-prod-github-runner-207 kernel: [31760.610200] ? __seccomp_filter+0x4a/0x4a0 Aug 22 14:13:06 juju-e4d256-prod-github-runner-207 kernel: [31760.611036] ? __fget_files+0x86/0xc0 Aug 22 14:13:06 juju-e4d256-prod-github-runner-207 kernel: [31760.611756] __x64_sys_ioctl+0x95/0xd0 Aug 22 14:13:06 juju-e4d256-prod-github-runner-207 kernel: [31760.612462] do_syscall_64+0x5c/0xc0 Aug 22 14:13:06 juju-e4d256-prod-github-runner-207 kernel: [31760.613140] ? do_futex+0x162/0x1f0 Aug 22 14:13:06 juju-e4d256-prod-github-runner-207 kernel: [31760.613830] ? __x64_sys_futex+0x78/0x1e0 Aug 22 14:13:06 juju-e4d256-prod-github-runner-207 kernel: [31760.614536] ? __secure_computing+0xa9/0x120 Aug 22 14:13:06 juju-e4d256-prod-github-runner-207 kernel: [31760.615245] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 14:13:06 juju-e4d256-prod-github-runner-207 kernel: [31760.616025] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:13:06 juju-e4d256-prod-github-runner-207 kernel: [31760.616761] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:13:06 juju-e4d256-prod-github-runner-207 kernel: [31760.617509] ? do_syscall_64+0x69/0xc0 Aug 22 14:13:06 juju-e4d256-prod-github-runner-207 kernel: [31760.618175] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:13:06 juju-e4d256-prod-github-runner-207 kernel: [31760.618892] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:13:06 juju-e4d256-prod-github-runner-207 kernel: [31760.619626] ? do_syscall_64+0x69/0xc0 Aug 22 14:13:06 juju-e4d256-prod-github-runner-207 kernel: [31760.620269] ? do_syscall_64+0x69/0xc0 Aug 22 14:13:06 juju-e4d256-prod-github-runner-207 kernel: [31760.620968] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 14:13:06 juju-e4d256-prod-github-runner-207 kernel: [31760.621729] RIP: 0033:0x7faa5d0edaff Aug 22 14:13:06 juju-e4d256-prod-github-runner-207 kernel: [31760.622473] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 14:13:06 juju-e4d256-prod-github-runner-207 kernel: [31760.624903] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 14:13:06 juju-e4d256-prod-github-runner-207 kernel: [31760.625884] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 14:13:06 juju-e4d256-prod-github-runner-207 kernel: [31760.626802] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 14:13:06 juju-e4d256-prod-github-runner-207 kernel: [31760.627717] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 14:13:06 juju-e4d256-prod-github-runner-207 kernel: [31760.628629] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 14:13:06 juju-e4d256-prod-github-runner-207 kernel: [31760.629561] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 14:13:06 juju-e4d256-prod-github-runner-207 kernel: [31760.630475] Aug 22 14:13:34 juju-e4d256-prod-github-runner-207 kernel: [31788.541985] watchdog: BUG: soft lockup - CPU#1 stuck for 29497s! [qemu-system-x86:6715] Aug 22 14:13:34 juju-e4d256-prod-github-runner-207 kernel: [31788.543265] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 14:13:34 juju-e4d256-prod-github-runner-207 kernel: [31788.543339] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 14:13:34 juju-e4d256-prod-github-runner-207 kernel: [31788.556565] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 14:13:34 juju-e4d256-prod-github-runner-207 kernel: [31788.557921] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 14:13:34 juju-e4d256-prod-github-runner-207 kernel: [31788.559190] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:13:34 juju-e4d256-prod-github-runner-207 kernel: [31788.560268] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 14:13:34 juju-e4d256-prod-github-runner-207 kernel: [31788.562884] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 14:13:34 juju-e4d256-prod-github-runner-207 kernel: [31788.563947] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 14:13:34 juju-e4d256-prod-github-runner-207 kernel: [31788.565151] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 14:13:34 juju-e4d256-prod-github-runner-207 kernel: [31788.566339] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 14:13:34 juju-e4d256-prod-github-runner-207 kernel: [31788.567518] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 14:13:34 juju-e4d256-prod-github-runner-207 kernel: [31788.568704] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 14:13:34 juju-e4d256-prod-github-runner-207 kernel: [31788.569914] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 14:13:34 juju-e4d256-prod-github-runner-207 kernel: [31788.571167] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 14:13:34 juju-e4d256-prod-github-runner-207 kernel: [31788.572278] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 14:13:34 juju-e4d256-prod-github-runner-207 kernel: [31788.573509] Call Trace: Aug 22 14:13:34 juju-e4d256-prod-github-runner-207 kernel: [31788.574433] Aug 22 14:13:34 juju-e4d256-prod-github-runner-207 kernel: [31788.575329] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:13:34 juju-e4d256-prod-github-runner-207 kernel: [31788.576562] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:13:34 juju-e4d256-prod-github-runner-207 kernel: [31788.577625] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:13:34 juju-e4d256-prod-github-runner-207 kernel: [31788.578714] ? show_regs.part.0+0x23/0x29 Aug 22 14:13:34 juju-e4d256-prod-github-runner-207 kernel: [31788.579731] ? show_regs.cold+0x8/0xd Aug 22 14:13:34 juju-e4d256-prod-github-runner-207 kernel: [31788.580724] ? watchdog_timer_fn+0x1be/0x220 Aug 22 14:13:34 juju-e4d256-prod-github-runner-207 kernel: [31788.581769] ? lockup_detector_update_enable+0x60/0x60 Aug 22 14:13:34 juju-e4d256-prod-github-runner-207 kernel: [31788.582852] ? __hrtimer_run_queues+0x107/0x230 Aug 22 14:13:34 juju-e4d256-prod-github-runner-207 kernel: [31788.583889] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 14:13:34 juju-e4d256-prod-github-runner-207 kernel: [31788.584923] ? hrtimer_interrupt+0x101/0x220 Aug 22 14:13:34 juju-e4d256-prod-github-runner-207 kernel: [31788.585966] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 14:13:34 juju-e4d256-prod-github-runner-207 kernel: [31788.587046] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 14:13:34 juju-e4d256-prod-github-runner-207 kernel: [31788.588107] Aug 22 14:13:34 juju-e4d256-prod-github-runner-207 kernel: [31788.588964] Aug 22 14:13:34 juju-e4d256-prod-github-runner-207 kernel: [31788.589865] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 14:13:34 juju-e4d256-prod-github-runner-207 kernel: [31788.590939] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:13:34 juju-e4d256-prod-github-runner-207 kernel: [31788.591992] ? _raw_spin_lock+0x22/0x30 Aug 22 14:13:34 juju-e4d256-prod-github-runner-207 kernel: [31788.592954] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:13:34 juju-e4d256-prod-github-runner-207 kernel: [31788.594030] direct_page_fault+0x206/0x310 [kvm] Aug 22 14:13:34 juju-e4d256-prod-github-runner-207 kernel: [31788.595072] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 14:13:34 juju-e4d256-prod-github-runner-207 kernel: [31788.596090] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 14:13:34 juju-e4d256-prod-github-runner-207 kernel: [31788.597118] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 14:13:34 juju-e4d256-prod-github-runner-207 kernel: [31788.598099] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 14:13:34 juju-e4d256-prod-github-runner-207 kernel: [31788.599062] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 14:13:34 juju-e4d256-prod-github-runner-207 kernel: [31788.600055] handle_exit+0x98/0x230 [kvm_amd] Aug 22 14:13:34 juju-e4d256-prod-github-runner-207 kernel: [31788.600964] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 14:13:34 juju-e4d256-prod-github-runner-207 kernel: [31788.601902] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 14:13:34 juju-e4d256-prod-github-runner-207 kernel: [31788.602839] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 14:13:34 juju-e4d256-prod-github-runner-207 kernel: [31788.603755] vcpu_run+0x62/0x2c0 [kvm] Aug 22 14:13:34 juju-e4d256-prod-github-runner-207 kernel: [31788.604576] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 14:13:34 juju-e4d256-prod-github-runner-207 kernel: [31788.605460] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 14:13:34 juju-e4d256-prod-github-runner-207 kernel: [31788.606416] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 14:13:34 juju-e4d256-prod-github-runner-207 kernel: [31788.607254] ? __seccomp_filter+0x4a/0x4a0 Aug 22 14:13:34 juju-e4d256-prod-github-runner-207 kernel: [31788.608015] ? __fget_files+0x86/0xc0 Aug 22 14:13:34 juju-e4d256-prod-github-runner-207 kernel: [31788.608728] __x64_sys_ioctl+0x95/0xd0 Aug 22 14:13:34 juju-e4d256-prod-github-runner-207 kernel: [31788.609453] do_syscall_64+0x5c/0xc0 Aug 22 14:13:34 juju-e4d256-prod-github-runner-207 kernel: [31788.610130] ? do_futex+0x162/0x1f0 Aug 22 14:13:34 juju-e4d256-prod-github-runner-207 kernel: [31788.610835] ? __x64_sys_futex+0x78/0x1e0 Aug 22 14:13:34 juju-e4d256-prod-github-runner-207 kernel: [31788.611522] ? __secure_computing+0xa9/0x120 Aug 22 14:13:34 juju-e4d256-prod-github-runner-207 kernel: [31788.612245] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 14:13:34 juju-e4d256-prod-github-runner-207 kernel: [31788.613100] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:13:34 juju-e4d256-prod-github-runner-207 kernel: [31788.613897] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:13:34 juju-e4d256-prod-github-runner-207 kernel: [31788.614696] ? do_syscall_64+0x69/0xc0 Aug 22 14:13:34 juju-e4d256-prod-github-runner-207 kernel: [31788.615368] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:13:34 juju-e4d256-prod-github-runner-207 kernel: [31788.616093] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:13:34 juju-e4d256-prod-github-runner-207 kernel: [31788.616802] ? do_syscall_64+0x69/0xc0 Aug 22 14:13:34 juju-e4d256-prod-github-runner-207 kernel: [31788.617458] ? do_syscall_64+0x69/0xc0 Aug 22 14:13:34 juju-e4d256-prod-github-runner-207 kernel: [31788.618091] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 14:13:34 juju-e4d256-prod-github-runner-207 kernel: [31788.618905] RIP: 0033:0x7faa5d0edaff Aug 22 14:13:34 juju-e4d256-prod-github-runner-207 kernel: [31788.619605] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 14:13:34 juju-e4d256-prod-github-runner-207 kernel: [31788.621820] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 14:13:34 juju-e4d256-prod-github-runner-207 kernel: [31788.622756] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 14:13:34 juju-e4d256-prod-github-runner-207 kernel: [31788.623674] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 14:13:34 juju-e4d256-prod-github-runner-207 kernel: [31788.624594] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 14:13:34 juju-e4d256-prod-github-runner-207 kernel: [31788.625528] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 14:13:34 juju-e4d256-prod-github-runner-207 kernel: [31788.626431] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 14:13:34 juju-e4d256-prod-github-runner-207 kernel: [31788.627434] Aug 22 14:14:02 juju-e4d256-prod-github-runner-207 kernel: [31816.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 29523s! [qemu-system-x86:6715] Aug 22 14:14:02 juju-e4d256-prod-github-runner-207 kernel: [31816.543280] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 14:14:02 juju-e4d256-prod-github-runner-207 kernel: [31816.543365] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 14:14:02 juju-e4d256-prod-github-runner-207 kernel: [31816.556097] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 14:14:02 juju-e4d256-prod-github-runner-207 kernel: [31816.557484] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 14:14:02 juju-e4d256-prod-github-runner-207 kernel: [31816.558747] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:14:02 juju-e4d256-prod-github-runner-207 kernel: [31816.559838] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 14:14:02 juju-e4d256-prod-github-runner-207 kernel: [31816.562504] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 14:14:02 juju-e4d256-prod-github-runner-207 kernel: [31816.563572] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 14:14:02 juju-e4d256-prod-github-runner-207 kernel: [31816.564777] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 14:14:02 juju-e4d256-prod-github-runner-207 kernel: [31816.565965] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 14:14:02 juju-e4d256-prod-github-runner-207 kernel: [31816.567172] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 14:14:02 juju-e4d256-prod-github-runner-207 kernel: [31816.568398] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 14:14:02 juju-e4d256-prod-github-runner-207 kernel: [31816.569616] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 14:14:02 juju-e4d256-prod-github-runner-207 kernel: [31816.570869] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 14:14:02 juju-e4d256-prod-github-runner-207 kernel: [31816.571992] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 14:14:02 juju-e4d256-prod-github-runner-207 kernel: [31816.573358] Call Trace: Aug 22 14:14:02 juju-e4d256-prod-github-runner-207 kernel: [31816.574380] Aug 22 14:14:02 juju-e4d256-prod-github-runner-207 kernel: [31816.575288] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:14:02 juju-e4d256-prod-github-runner-207 kernel: [31816.576343] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:14:02 juju-e4d256-prod-github-runner-207 kernel: [31816.577488] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:14:02 juju-e4d256-prod-github-runner-207 kernel: [31816.578637] ? show_regs.part.0+0x23/0x29 Aug 22 14:14:02 juju-e4d256-prod-github-runner-207 kernel: [31816.579647] ? show_regs.cold+0x8/0xd Aug 22 14:14:02 juju-e4d256-prod-github-runner-207 kernel: [31816.580642] ? watchdog_timer_fn+0x1be/0x220 Aug 22 14:14:02 juju-e4d256-prod-github-runner-207 kernel: [31816.581688] ? lockup_detector_update_enable+0x60/0x60 Aug 22 14:14:02 juju-e4d256-prod-github-runner-207 kernel: [31816.582776] ? __hrtimer_run_queues+0x107/0x230 Aug 22 14:14:02 juju-e4d256-prod-github-runner-207 kernel: [31816.583834] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 14:14:02 juju-e4d256-prod-github-runner-207 kernel: [31816.584904] ? hrtimer_interrupt+0x101/0x220 Aug 22 14:14:02 juju-e4d256-prod-github-runner-207 kernel: [31816.585936] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 14:14:02 juju-e4d256-prod-github-runner-207 kernel: [31816.587076] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 14:14:02 juju-e4d256-prod-github-runner-207 kernel: [31816.588190] Aug 22 14:14:02 juju-e4d256-prod-github-runner-207 kernel: [31816.589090] Aug 22 14:14:02 juju-e4d256-prod-github-runner-207 kernel: [31816.589940] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 14:14:02 juju-e4d256-prod-github-runner-207 kernel: [31816.590991] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:14:02 juju-e4d256-prod-github-runner-207 kernel: [31816.592150] ? _raw_spin_lock+0x22/0x30 Aug 22 14:14:02 juju-e4d256-prod-github-runner-207 kernel: [31816.593143] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:14:02 juju-e4d256-prod-github-runner-207 kernel: [31816.594202] direct_page_fault+0x206/0x310 [kvm] Aug 22 14:14:02 juju-e4d256-prod-github-runner-207 kernel: [31816.595243] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 14:14:02 juju-e4d256-prod-github-runner-207 kernel: [31816.596267] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 14:14:02 juju-e4d256-prod-github-runner-207 kernel: [31816.597316] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 14:14:02 juju-e4d256-prod-github-runner-207 kernel: [31816.598342] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 14:14:02 juju-e4d256-prod-github-runner-207 kernel: [31816.599519] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 14:14:02 juju-e4d256-prod-github-runner-207 kernel: [31816.600729] handle_exit+0x98/0x230 [kvm_amd] Aug 22 14:14:02 juju-e4d256-prod-github-runner-207 kernel: [31816.601641] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 14:14:02 juju-e4d256-prod-github-runner-207 kernel: [31816.602640] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 14:14:02 juju-e4d256-prod-github-runner-207 kernel: [31816.603607] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 14:14:02 juju-e4d256-prod-github-runner-207 kernel: [31816.604761] vcpu_run+0x62/0x2c0 [kvm] Aug 22 14:14:02 juju-e4d256-prod-github-runner-207 kernel: [31816.605633] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 14:14:02 juju-e4d256-prod-github-runner-207 kernel: [31816.606467] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 14:14:02 juju-e4d256-prod-github-runner-207 kernel: [31816.607343] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 14:14:02 juju-e4d256-prod-github-runner-207 kernel: [31816.608193] ? __seccomp_filter+0x4a/0x4a0 Aug 22 14:14:02 juju-e4d256-prod-github-runner-207 kernel: [31816.609000] ? __fget_files+0x86/0xc0 Aug 22 14:14:02 juju-e4d256-prod-github-runner-207 kernel: [31816.609768] __x64_sys_ioctl+0x95/0xd0 Aug 22 14:14:02 juju-e4d256-prod-github-runner-207 kernel: [31816.610479] do_syscall_64+0x5c/0xc0 Aug 22 14:14:02 juju-e4d256-prod-github-runner-207 kernel: [31816.611259] ? do_futex+0x162/0x1f0 Aug 22 14:14:02 juju-e4d256-prod-github-runner-207 kernel: [31816.611935] ? __x64_sys_futex+0x78/0x1e0 Aug 22 14:14:02 juju-e4d256-prod-github-runner-207 kernel: [31816.612630] ? __secure_computing+0xa9/0x120 Aug 22 14:14:02 juju-e4d256-prod-github-runner-207 kernel: [31816.613385] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 14:14:02 juju-e4d256-prod-github-runner-207 kernel: [31816.614180] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:14:02 juju-e4d256-prod-github-runner-207 kernel: [31816.615215] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:14:02 juju-e4d256-prod-github-runner-207 kernel: [31816.615957] ? do_syscall_64+0x69/0xc0 Aug 22 14:14:02 juju-e4d256-prod-github-runner-207 kernel: [31816.616617] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:14:02 juju-e4d256-prod-github-runner-207 kernel: [31816.617380] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:14:02 juju-e4d256-prod-github-runner-207 kernel: [31816.618106] ? do_syscall_64+0x69/0xc0 Aug 22 14:14:02 juju-e4d256-prod-github-runner-207 kernel: [31816.618768] ? do_syscall_64+0x69/0xc0 Aug 22 14:14:02 juju-e4d256-prod-github-runner-207 kernel: [31816.619458] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 14:14:02 juju-e4d256-prod-github-runner-207 kernel: [31816.620197] RIP: 0033:0x7faa5d0edaff Aug 22 14:14:02 juju-e4d256-prod-github-runner-207 kernel: [31816.620854] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 14:14:02 juju-e4d256-prod-github-runner-207 kernel: [31816.622891] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 14:14:02 juju-e4d256-prod-github-runner-207 kernel: [31816.623848] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 14:14:02 juju-e4d256-prod-github-runner-207 kernel: [31816.624827] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 14:14:02 juju-e4d256-prod-github-runner-207 kernel: [31816.625743] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 14:14:02 juju-e4d256-prod-github-runner-207 kernel: [31816.626690] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 14:14:02 juju-e4d256-prod-github-runner-207 kernel: [31816.627610] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 14:14:02 juju-e4d256-prod-github-runner-207 kernel: [31816.628536] Aug 22 14:14:30 juju-e4d256-prod-github-runner-207 kernel: [31844.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 29549s! [qemu-system-x86:6715] Aug 22 14:14:30 juju-e4d256-prod-github-runner-207 kernel: [31844.543850] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 14:14:30 juju-e4d256-prod-github-runner-207 kernel: [31844.544147] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 14:14:30 juju-e4d256-prod-github-runner-207 kernel: [31844.556445] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 14:14:30 juju-e4d256-prod-github-runner-207 kernel: [31844.557750] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 14:14:30 juju-e4d256-prod-github-runner-207 kernel: [31844.559282] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:14:30 juju-e4d256-prod-github-runner-207 kernel: [31844.560494] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 14:14:30 juju-e4d256-prod-github-runner-207 kernel: [31844.563085] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 14:14:30 juju-e4d256-prod-github-runner-207 kernel: [31844.564130] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 14:14:30 juju-e4d256-prod-github-runner-207 kernel: [31844.565310] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 14:14:30 juju-e4d256-prod-github-runner-207 kernel: [31844.566646] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 14:14:30 juju-e4d256-prod-github-runner-207 kernel: [31844.567811] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 14:14:30 juju-e4d256-prod-github-runner-207 kernel: [31844.569029] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 14:14:30 juju-e4d256-prod-github-runner-207 kernel: [31844.570208] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 14:14:30 juju-e4d256-prod-github-runner-207 kernel: [31844.571444] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 14:14:30 juju-e4d256-prod-github-runner-207 kernel: [31844.572563] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 14:14:30 juju-e4d256-prod-github-runner-207 kernel: [31844.573776] Call Trace: Aug 22 14:14:30 juju-e4d256-prod-github-runner-207 kernel: [31844.574691] Aug 22 14:14:30 juju-e4d256-prod-github-runner-207 kernel: [31844.575600] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:14:30 juju-e4d256-prod-github-runner-207 kernel: [31844.576656] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:14:30 juju-e4d256-prod-github-runner-207 kernel: [31844.577686] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:14:30 juju-e4d256-prod-github-runner-207 kernel: [31844.578819] ? show_regs.part.0+0x23/0x29 Aug 22 14:14:30 juju-e4d256-prod-github-runner-207 kernel: [31844.579836] ? show_regs.cold+0x8/0xd Aug 22 14:14:30 juju-e4d256-prod-github-runner-207 kernel: [31844.580849] ? watchdog_timer_fn+0x1be/0x220 Aug 22 14:14:30 juju-e4d256-prod-github-runner-207 kernel: [31844.581864] ? lockup_detector_update_enable+0x60/0x60 Aug 22 14:14:30 juju-e4d256-prod-github-runner-207 kernel: [31844.583113] ? __hrtimer_run_queues+0x107/0x230 Aug 22 14:14:30 juju-e4d256-prod-github-runner-207 kernel: [31844.584151] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 14:14:30 juju-e4d256-prod-github-runner-207 kernel: [31844.585196] ? hrtimer_interrupt+0x101/0x220 Aug 22 14:14:30 juju-e4d256-prod-github-runner-207 kernel: [31844.586214] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 14:14:30 juju-e4d256-prod-github-runner-207 kernel: [31844.587288] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 14:14:30 juju-e4d256-prod-github-runner-207 kernel: [31844.588348] Aug 22 14:14:30 juju-e4d256-prod-github-runner-207 kernel: [31844.589217] Aug 22 14:14:30 juju-e4d256-prod-github-runner-207 kernel: [31844.590072] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 14:14:30 juju-e4d256-prod-github-runner-207 kernel: [31844.591121] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:14:30 juju-e4d256-prod-github-runner-207 kernel: [31844.592176] ? _raw_spin_lock+0x22/0x30 Aug 22 14:14:30 juju-e4d256-prod-github-runner-207 kernel: [31844.593140] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:14:30 juju-e4d256-prod-github-runner-207 kernel: [31844.594165] direct_page_fault+0x206/0x310 [kvm] Aug 22 14:14:30 juju-e4d256-prod-github-runner-207 kernel: [31844.595202] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 14:14:30 juju-e4d256-prod-github-runner-207 kernel: [31844.596271] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 14:14:30 juju-e4d256-prod-github-runner-207 kernel: [31844.597292] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 14:14:30 juju-e4d256-prod-github-runner-207 kernel: [31844.598302] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 14:14:30 juju-e4d256-prod-github-runner-207 kernel: [31844.599247] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 14:14:30 juju-e4d256-prod-github-runner-207 kernel: [31844.600226] handle_exit+0x98/0x230 [kvm_amd] Aug 22 14:14:30 juju-e4d256-prod-github-runner-207 kernel: [31844.601136] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 14:14:30 juju-e4d256-prod-github-runner-207 kernel: [31844.602059] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 14:14:30 juju-e4d256-prod-github-runner-207 kernel: [31844.602984] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 14:14:30 juju-e4d256-prod-github-runner-207 kernel: [31844.603891] vcpu_run+0x62/0x2c0 [kvm] Aug 22 14:14:30 juju-e4d256-prod-github-runner-207 kernel: [31844.604722] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 14:14:30 juju-e4d256-prod-github-runner-207 kernel: [31844.605530] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 14:14:30 juju-e4d256-prod-github-runner-207 kernel: [31844.606383] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 14:14:30 juju-e4d256-prod-github-runner-207 kernel: [31844.607186] ? __seccomp_filter+0x4a/0x4a0 Aug 22 14:14:30 juju-e4d256-prod-github-runner-207 kernel: [31844.607935] ? __fget_files+0x86/0xc0 Aug 22 14:14:30 juju-e4d256-prod-github-runner-207 kernel: [31844.608647] __x64_sys_ioctl+0x95/0xd0 Aug 22 14:14:30 juju-e4d256-prod-github-runner-207 kernel: [31844.609341] do_syscall_64+0x5c/0xc0 Aug 22 14:14:30 juju-e4d256-prod-github-runner-207 kernel: [31844.610010] ? do_futex+0x162/0x1f0 Aug 22 14:14:30 juju-e4d256-prod-github-runner-207 kernel: [31844.610666] ? __x64_sys_futex+0x78/0x1e0 Aug 22 14:14:30 juju-e4d256-prod-github-runner-207 kernel: [31844.611343] ? __secure_computing+0xa9/0x120 Aug 22 14:14:30 juju-e4d256-prod-github-runner-207 kernel: [31844.612033] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 14:14:30 juju-e4d256-prod-github-runner-207 kernel: [31844.612805] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:14:30 juju-e4d256-prod-github-runner-207 kernel: [31844.613537] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:14:30 juju-e4d256-prod-github-runner-207 kernel: [31844.614259] ? do_syscall_64+0x69/0xc0 Aug 22 14:14:30 juju-e4d256-prod-github-runner-207 kernel: [31844.614906] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:14:30 juju-e4d256-prod-github-runner-207 kernel: [31844.615608] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:14:30 juju-e4d256-prod-github-runner-207 kernel: [31844.616303] ? do_syscall_64+0x69/0xc0 Aug 22 14:14:30 juju-e4d256-prod-github-runner-207 kernel: [31844.616946] ? do_syscall_64+0x69/0xc0 Aug 22 14:14:30 juju-e4d256-prod-github-runner-207 kernel: [31844.617572] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 14:14:30 juju-e4d256-prod-github-runner-207 kernel: [31844.618285] RIP: 0033:0x7faa5d0edaff Aug 22 14:14:30 juju-e4d256-prod-github-runner-207 kernel: [31844.618959] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 14:14:30 juju-e4d256-prod-github-runner-207 kernel: [31844.620965] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 14:14:30 juju-e4d256-prod-github-runner-207 kernel: [31844.621887] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 14:14:30 juju-e4d256-prod-github-runner-207 kernel: [31844.622798] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 14:14:30 juju-e4d256-prod-github-runner-207 kernel: [31844.623708] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 14:14:30 juju-e4d256-prod-github-runner-207 kernel: [31844.624625] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 14:14:30 juju-e4d256-prod-github-runner-207 kernel: [31844.625524] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 14:14:30 juju-e4d256-prod-github-runner-207 kernel: [31844.626420] Aug 22 14:14:45 juju-e4d256-prod-github-runner-207 kernel: [31859.312709] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 14:14:45 juju-e4d256-prod-github-runner-207 kernel: [31859.313689] rcu: 1-....: (7910769 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=3822730 Aug 22 14:14:45 juju-e4d256-prod-github-runner-207 kernel: [31859.314810] (t=7935528 jiffies g=23269 q=34700) Aug 22 14:14:45 juju-e4d256-prod-github-runner-207 kernel: [31859.315609] NMI backtrace for cpu 1 Aug 22 14:14:45 juju-e4d256-prod-github-runner-207 kernel: [31859.316331] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 14:14:45 juju-e4d256-prod-github-runner-207 kernel: [31859.317430] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 14:14:45 juju-e4d256-prod-github-runner-207 kernel: [31859.318490] Call Trace: Aug 22 14:14:45 juju-e4d256-prod-github-runner-207 kernel: [31859.319161] Aug 22 14:14:45 juju-e4d256-prod-github-runner-207 kernel: [31859.319808] show_stack+0x52/0x5c Aug 22 14:14:45 juju-e4d256-prod-github-runner-207 kernel: [31859.320538] dump_stack_lvl+0x4a/0x63 Aug 22 14:14:45 juju-e4d256-prod-github-runner-207 kernel: [31859.321287] dump_stack+0x10/0x16 Aug 22 14:14:45 juju-e4d256-prod-github-runner-207 kernel: [31859.322004] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 14:14:45 juju-e4d256-prod-github-runner-207 kernel: [31859.322841] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 14:14:45 juju-e4d256-prod-github-runner-207 kernel: [31859.323622] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 14:14:45 juju-e4d256-prod-github-runner-207 kernel: [31859.324447] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 14:14:45 juju-e4d256-prod-github-runner-207 kernel: [31859.325266] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 14:14:45 juju-e4d256-prod-github-runner-207 kernel: [31859.326077] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 14:14:45 juju-e4d256-prod-github-runner-207 kernel: [31859.326849] print_cpu_stall.cold+0x2f/0xe2 Aug 22 14:14:45 juju-e4d256-prod-github-runner-207 kernel: [31859.327616] ? timekeeping_update+0xf7/0x150 Aug 22 14:14:45 juju-e4d256-prod-github-runner-207 kernel: [31859.328402] check_cpu_stall+0x109/0x270 Aug 22 14:14:45 juju-e4d256-prod-github-runner-207 kernel: [31859.329151] rcu_sched_clock_irq+0x9a/0x250 Aug 22 14:14:45 juju-e4d256-prod-github-runner-207 kernel: [31859.329911] update_process_times+0x94/0xd0 Aug 22 14:14:45 juju-e4d256-prod-github-runner-207 kernel: [31859.330670] tick_sched_handle+0x29/0x70 Aug 22 14:14:45 juju-e4d256-prod-github-runner-207 kernel: [31859.331419] tick_sched_timer+0x8c/0xc0 Aug 22 14:14:45 juju-e4d256-prod-github-runner-207 kernel: [31859.332164] ? tick_nohz_handler+0xb0/0xb0 Aug 22 14:14:45 juju-e4d256-prod-github-runner-207 kernel: [31859.332918] __hrtimer_run_queues+0x107/0x230 Aug 22 14:14:45 juju-e4d256-prod-github-runner-207 kernel: [31859.333688] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 14:14:45 juju-e4d256-prod-github-runner-207 kernel: [31859.334471] hrtimer_interrupt+0x101/0x220 Aug 22 14:14:45 juju-e4d256-prod-github-runner-207 kernel: [31859.335228] ? handle_edge_irq+0x8c/0x230 Aug 22 14:14:45 juju-e4d256-prod-github-runner-207 kernel: [31859.335977] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 14:14:45 juju-e4d256-prod-github-runner-207 kernel: [31859.336794] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 14:14:45 juju-e4d256-prod-github-runner-207 kernel: [31859.337598] Aug 22 14:14:45 juju-e4d256-prod-github-runner-207 kernel: [31859.338229] Aug 22 14:14:45 juju-e4d256-prod-github-runner-207 kernel: [31859.338854] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 14:14:45 juju-e4d256-prod-github-runner-207 kernel: [31859.339677] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:14:45 juju-e4d256-prod-github-runner-207 kernel: [31859.340567] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 14:14:45 juju-e4d256-prod-github-runner-207 kernel: [31859.342788] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 14:14:45 juju-e4d256-prod-github-runner-207 kernel: [31859.343668] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 14:14:45 juju-e4d256-prod-github-runner-207 kernel: [31859.344655] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 14:14:45 juju-e4d256-prod-github-runner-207 kernel: [31859.345612] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 14:14:45 juju-e4d256-prod-github-runner-207 kernel: [31859.346560] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 14:14:45 juju-e4d256-prod-github-runner-207 kernel: [31859.347502] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 14:14:45 juju-e4d256-prod-github-runner-207 kernel: [31859.348458] ? _raw_spin_lock+0x22/0x30 Aug 22 14:14:45 juju-e4d256-prod-github-runner-207 kernel: [31859.349214] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:14:45 juju-e4d256-prod-github-runner-207 kernel: [31859.350070] direct_page_fault+0x206/0x310 [kvm] Aug 22 14:14:45 juju-e4d256-prod-github-runner-207 kernel: [31859.350903] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 14:14:45 juju-e4d256-prod-github-runner-207 kernel: [31859.351720] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 14:14:45 juju-e4d256-prod-github-runner-207 kernel: [31859.352544] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 14:14:45 juju-e4d256-prod-github-runner-207 kernel: [31859.353332] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 14:14:45 juju-e4d256-prod-github-runner-207 kernel: [31859.354100] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 14:14:45 juju-e4d256-prod-github-runner-207 kernel: [31859.354920] handle_exit+0x98/0x230 [kvm_amd] Aug 22 14:14:45 juju-e4d256-prod-github-runner-207 kernel: [31859.355659] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 14:14:45 juju-e4d256-prod-github-runner-207 kernel: [31859.356439] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 14:14:45 juju-e4d256-prod-github-runner-207 kernel: [31859.357223] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 14:14:45 juju-e4d256-prod-github-runner-207 kernel: [31859.358008] vcpu_run+0x62/0x2c0 [kvm] Aug 22 14:14:45 juju-e4d256-prod-github-runner-207 kernel: [31859.358722] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 14:14:45 juju-e4d256-prod-github-runner-207 kernel: [31859.359460] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 14:14:45 juju-e4d256-prod-github-runner-207 kernel: [31859.360274] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 14:14:45 juju-e4d256-prod-github-runner-207 kernel: [31859.361033] ? __seccomp_filter+0x4a/0x4a0 Aug 22 14:14:45 juju-e4d256-prod-github-runner-207 kernel: [31859.361752] ? __fget_files+0x86/0xc0 Aug 22 14:14:45 juju-e4d256-prod-github-runner-207 kernel: [31859.362441] __x64_sys_ioctl+0x95/0xd0 Aug 22 14:14:45 juju-e4d256-prod-github-runner-207 kernel: [31859.363193] do_syscall_64+0x5c/0xc0 Aug 22 14:14:45 juju-e4d256-prod-github-runner-207 kernel: [31859.363920] ? do_futex+0x162/0x1f0 Aug 22 14:14:45 juju-e4d256-prod-github-runner-207 kernel: [31859.364642] ? __x64_sys_futex+0x78/0x1e0 Aug 22 14:14:45 juju-e4d256-prod-github-runner-207 kernel: [31859.365354] ? __secure_computing+0xa9/0x120 Aug 22 14:14:45 juju-e4d256-prod-github-runner-207 kernel: [31859.366070] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 14:14:45 juju-e4d256-prod-github-runner-207 kernel: [31859.366875] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:14:45 juju-e4d256-prod-github-runner-207 kernel: [31859.367627] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:14:45 juju-e4d256-prod-github-runner-207 kernel: [31859.368404] ? do_syscall_64+0x69/0xc0 Aug 22 14:14:45 juju-e4d256-prod-github-runner-207 kernel: [31859.369098] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:14:45 juju-e4d256-prod-github-runner-207 kernel: [31859.369853] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:14:45 juju-e4d256-prod-github-runner-207 kernel: [31859.370611] ? do_syscall_64+0x69/0xc0 Aug 22 14:14:45 juju-e4d256-prod-github-runner-207 kernel: [31859.371315] ? do_syscall_64+0x69/0xc0 Aug 22 14:14:45 juju-e4d256-prod-github-runner-207 kernel: [31859.372012] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 14:14:45 juju-e4d256-prod-github-runner-207 kernel: [31859.372802] RIP: 0033:0x7faa5d0edaff Aug 22 14:14:45 juju-e4d256-prod-github-runner-207 kernel: [31859.373482] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 14:14:45 juju-e4d256-prod-github-runner-207 kernel: [31859.375573] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 14:14:45 juju-e4d256-prod-github-runner-207 kernel: [31859.376543] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 14:14:45 juju-e4d256-prod-github-runner-207 kernel: [31859.377486] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 14:14:45 juju-e4d256-prod-github-runner-207 kernel: [31859.378427] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 14:14:45 juju-e4d256-prod-github-runner-207 kernel: [31859.379364] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 14:14:45 juju-e4d256-prod-github-runner-207 kernel: [31859.380298] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 14:14:45 juju-e4d256-prod-github-runner-207 kernel: [31859.381218] Aug 22 14:15:10 juju-e4d256-prod-github-runner-207 kernel: [31884.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 29586s! [qemu-system-x86:6715] Aug 22 14:15:10 juju-e4d256-prod-github-runner-207 kernel: [31884.543132] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 14:15:10 juju-e4d256-prod-github-runner-207 kernel: [31884.543207] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 14:15:10 juju-e4d256-prod-github-runner-207 kernel: [31884.556222] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 14:15:10 juju-e4d256-prod-github-runner-207 kernel: [31884.557533] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 14:15:10 juju-e4d256-prod-github-runner-207 kernel: [31884.558776] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:15:10 juju-e4d256-prod-github-runner-207 kernel: [31884.559869] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 14:15:10 juju-e4d256-prod-github-runner-207 kernel: [31884.562570] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 14:15:10 juju-e4d256-prod-github-runner-207 kernel: [31884.563649] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 14:15:10 juju-e4d256-prod-github-runner-207 kernel: [31884.564864] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 14:15:10 juju-e4d256-prod-github-runner-207 kernel: [31884.566074] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 14:15:10 juju-e4d256-prod-github-runner-207 kernel: [31884.567446] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 14:15:10 juju-e4d256-prod-github-runner-207 kernel: [31884.568675] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 14:15:10 juju-e4d256-prod-github-runner-207 kernel: [31884.569869] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 14:15:10 juju-e4d256-prod-github-runner-207 kernel: [31884.571126] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 14:15:10 juju-e4d256-prod-github-runner-207 kernel: [31884.572458] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 14:15:10 juju-e4d256-prod-github-runner-207 kernel: [31884.573687] Call Trace: Aug 22 14:15:10 juju-e4d256-prod-github-runner-207 kernel: [31884.574600] Aug 22 14:15:10 juju-e4d256-prod-github-runner-207 kernel: [31884.575521] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:15:10 juju-e4d256-prod-github-runner-207 kernel: [31884.576617] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:15:10 juju-e4d256-prod-github-runner-207 kernel: [31884.577653] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:15:10 juju-e4d256-prod-github-runner-207 kernel: [31884.578814] ? show_regs.part.0+0x23/0x29 Aug 22 14:15:10 juju-e4d256-prod-github-runner-207 kernel: [31884.579868] ? show_regs.cold+0x8/0xd Aug 22 14:15:10 juju-e4d256-prod-github-runner-207 kernel: [31884.580872] ? watchdog_timer_fn+0x1be/0x220 Aug 22 14:15:10 juju-e4d256-prod-github-runner-207 kernel: [31884.581897] ? lockup_detector_update_enable+0x60/0x60 Aug 22 14:15:10 juju-e4d256-prod-github-runner-207 kernel: [31884.582969] ? __hrtimer_run_queues+0x107/0x230 Aug 22 14:15:10 juju-e4d256-prod-github-runner-207 kernel: [31884.584017] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 14:15:10 juju-e4d256-prod-github-runner-207 kernel: [31884.585054] ? hrtimer_interrupt+0x101/0x220 Aug 22 14:15:10 juju-e4d256-prod-github-runner-207 kernel: [31884.586628] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 14:15:10 juju-e4d256-prod-github-runner-207 kernel: [31884.587721] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 14:15:10 juju-e4d256-prod-github-runner-207 kernel: [31884.589033] Aug 22 14:15:10 juju-e4d256-prod-github-runner-207 kernel: [31884.589996] Aug 22 14:15:10 juju-e4d256-prod-github-runner-207 kernel: [31884.590891] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 14:15:10 juju-e4d256-prod-github-runner-207 kernel: [31884.591962] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:15:10 juju-e4d256-prod-github-runner-207 kernel: [31884.593017] ? _raw_spin_lock+0x22/0x30 Aug 22 14:15:10 juju-e4d256-prod-github-runner-207 kernel: [31884.594000] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:15:10 juju-e4d256-prod-github-runner-207 kernel: [31884.595036] direct_page_fault+0x206/0x310 [kvm] Aug 22 14:15:10 juju-e4d256-prod-github-runner-207 kernel: [31884.596090] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 14:15:10 juju-e4d256-prod-github-runner-207 kernel: [31884.597114] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 14:15:10 juju-e4d256-prod-github-runner-207 kernel: [31884.598126] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 14:15:10 juju-e4d256-prod-github-runner-207 kernel: [31884.599110] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 14:15:10 juju-e4d256-prod-github-runner-207 kernel: [31884.600086] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 14:15:10 juju-e4d256-prod-github-runner-207 kernel: [31884.601083] handle_exit+0x98/0x230 [kvm_amd] Aug 22 14:15:10 juju-e4d256-prod-github-runner-207 kernel: [31884.601996] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 14:15:10 juju-e4d256-prod-github-runner-207 kernel: [31884.602990] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 14:15:10 juju-e4d256-prod-github-runner-207 kernel: [31884.603967] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 14:15:10 juju-e4d256-prod-github-runner-207 kernel: [31884.604897] vcpu_run+0x62/0x2c0 [kvm] Aug 22 14:15:10 juju-e4d256-prod-github-runner-207 kernel: [31884.605718] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 14:15:10 juju-e4d256-prod-github-runner-207 kernel: [31884.606537] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 14:15:10 juju-e4d256-prod-github-runner-207 kernel: [31884.607403] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 14:15:10 juju-e4d256-prod-github-runner-207 kernel: [31884.608230] ? __seccomp_filter+0x4a/0x4a0 Aug 22 14:15:10 juju-e4d256-prod-github-runner-207 kernel: [31884.608984] ? __fget_files+0x86/0xc0 Aug 22 14:15:10 juju-e4d256-prod-github-runner-207 kernel: [31884.609746] __x64_sys_ioctl+0x95/0xd0 Aug 22 14:15:10 juju-e4d256-prod-github-runner-207 kernel: [31884.610490] do_syscall_64+0x5c/0xc0 Aug 22 14:15:10 juju-e4d256-prod-github-runner-207 kernel: [31884.611168] ? do_futex+0x162/0x1f0 Aug 22 14:15:10 juju-e4d256-prod-github-runner-207 kernel: [31884.611824] ? __x64_sys_futex+0x78/0x1e0 Aug 22 14:15:10 juju-e4d256-prod-github-runner-207 kernel: [31884.612523] ? __secure_computing+0xa9/0x120 Aug 22 14:15:10 juju-e4d256-prod-github-runner-207 kernel: [31884.613230] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 14:15:10 juju-e4d256-prod-github-runner-207 kernel: [31884.614003] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:15:10 juju-e4d256-prod-github-runner-207 kernel: [31884.614738] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:15:10 juju-e4d256-prod-github-runner-207 kernel: [31884.615470] ? do_syscall_64+0x69/0xc0 Aug 22 14:15:10 juju-e4d256-prod-github-runner-207 kernel: [31884.616154] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:15:10 juju-e4d256-prod-github-runner-207 kernel: [31884.616872] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:15:10 juju-e4d256-prod-github-runner-207 kernel: [31884.617586] ? do_syscall_64+0x69/0xc0 Aug 22 14:15:10 juju-e4d256-prod-github-runner-207 kernel: [31884.618220] ? do_syscall_64+0x69/0xc0 Aug 22 14:15:10 juju-e4d256-prod-github-runner-207 kernel: [31884.618858] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 14:15:10 juju-e4d256-prod-github-runner-207 kernel: [31884.619666] RIP: 0033:0x7faa5d0edaff Aug 22 14:15:10 juju-e4d256-prod-github-runner-207 kernel: [31884.620330] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 14:15:10 juju-e4d256-prod-github-runner-207 kernel: [31884.622373] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 14:15:10 juju-e4d256-prod-github-runner-207 kernel: [31884.623311] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 14:15:10 juju-e4d256-prod-github-runner-207 kernel: [31884.624231] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 14:15:10 juju-e4d256-prod-github-runner-207 kernel: [31884.625131] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 14:15:10 juju-e4d256-prod-github-runner-207 kernel: [31884.626032] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 14:15:10 juju-e4d256-prod-github-runner-207 kernel: [31884.626928] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 14:15:10 juju-e4d256-prod-github-runner-207 kernel: [31884.627840] Aug 22 14:15:38 juju-e4d256-prod-github-runner-207 kernel: [31912.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 29612s! [qemu-system-x86:6715] Aug 22 14:15:38 juju-e4d256-prod-github-runner-207 kernel: [31912.543153] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 14:15:38 juju-e4d256-prod-github-runner-207 kernel: [31912.543229] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 14:15:38 juju-e4d256-prod-github-runner-207 kernel: [31912.555711] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 14:15:38 juju-e4d256-prod-github-runner-207 kernel: [31912.556992] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 14:15:38 juju-e4d256-prod-github-runner-207 kernel: [31912.558238] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:15:38 juju-e4d256-prod-github-runner-207 kernel: [31912.559304] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 14:15:38 juju-e4d256-prod-github-runner-207 kernel: [31912.562070] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 14:15:38 juju-e4d256-prod-github-runner-207 kernel: [31912.563137] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 14:15:38 juju-e4d256-prod-github-runner-207 kernel: [31912.564365] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 14:15:38 juju-e4d256-prod-github-runner-207 kernel: [31912.565530] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 14:15:38 juju-e4d256-prod-github-runner-207 kernel: [31912.566697] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 14:15:38 juju-e4d256-prod-github-runner-207 kernel: [31912.567880] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 14:15:38 juju-e4d256-prod-github-runner-207 kernel: [31912.569053] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 14:15:38 juju-e4d256-prod-github-runner-207 kernel: [31912.570325] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 14:15:38 juju-e4d256-prod-github-runner-207 kernel: [31912.571493] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 14:15:38 juju-e4d256-prod-github-runner-207 kernel: [31912.572740] Call Trace: Aug 22 14:15:38 juju-e4d256-prod-github-runner-207 kernel: [31912.573655] Aug 22 14:15:38 juju-e4d256-prod-github-runner-207 kernel: [31912.574547] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:15:38 juju-e4d256-prod-github-runner-207 kernel: [31912.575673] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:15:38 juju-e4d256-prod-github-runner-207 kernel: [31912.576752] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:15:38 juju-e4d256-prod-github-runner-207 kernel: [31912.577866] ? show_regs.part.0+0x23/0x29 Aug 22 14:15:38 juju-e4d256-prod-github-runner-207 kernel: [31912.578925] ? show_regs.cold+0x8/0xd Aug 22 14:15:38 juju-e4d256-prod-github-runner-207 kernel: [31912.579999] ? watchdog_timer_fn+0x1be/0x220 Aug 22 14:15:38 juju-e4d256-prod-github-runner-207 kernel: [31912.581096] ? lockup_detector_update_enable+0x60/0x60 Aug 22 14:15:38 juju-e4d256-prod-github-runner-207 kernel: [31912.582234] ? __hrtimer_run_queues+0x107/0x230 Aug 22 14:15:38 juju-e4d256-prod-github-runner-207 kernel: [31912.583292] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 14:15:38 juju-e4d256-prod-github-runner-207 kernel: [31912.584352] ? hrtimer_interrupt+0x101/0x220 Aug 22 14:15:38 juju-e4d256-prod-github-runner-207 kernel: [31912.585376] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 14:15:38 juju-e4d256-prod-github-runner-207 kernel: [31912.586454] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 14:15:38 juju-e4d256-prod-github-runner-207 kernel: [31912.587550] Aug 22 14:15:38 juju-e4d256-prod-github-runner-207 kernel: [31912.588418] Aug 22 14:15:38 juju-e4d256-prod-github-runner-207 kernel: [31912.589262] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 14:15:38 juju-e4d256-prod-github-runner-207 kernel: [31912.590329] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:15:38 juju-e4d256-prod-github-runner-207 kernel: [31912.591410] ? _raw_spin_lock+0x22/0x30 Aug 22 14:15:38 juju-e4d256-prod-github-runner-207 kernel: [31912.592391] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:15:38 juju-e4d256-prod-github-runner-207 kernel: [31912.593424] direct_page_fault+0x206/0x310 [kvm] Aug 22 14:15:38 juju-e4d256-prod-github-runner-207 kernel: [31912.594456] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 14:15:38 juju-e4d256-prod-github-runner-207 kernel: [31912.595478] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 14:15:38 juju-e4d256-prod-github-runner-207 kernel: [31912.596507] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 14:15:38 juju-e4d256-prod-github-runner-207 kernel: [31912.597488] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 14:15:38 juju-e4d256-prod-github-runner-207 kernel: [31912.598472] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 14:15:38 juju-e4d256-prod-github-runner-207 kernel: [31912.599634] handle_exit+0x98/0x230 [kvm_amd] Aug 22 14:15:38 juju-e4d256-prod-github-runner-207 kernel: [31912.600571] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 14:15:38 juju-e4d256-prod-github-runner-207 kernel: [31912.601583] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 14:15:38 juju-e4d256-prod-github-runner-207 kernel: [31912.602563] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 14:15:38 juju-e4d256-prod-github-runner-207 kernel: [31912.603479] vcpu_run+0x62/0x2c0 [kvm] Aug 22 14:15:38 juju-e4d256-prod-github-runner-207 kernel: [31912.604343] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 14:15:38 juju-e4d256-prod-github-runner-207 kernel: [31912.605179] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 14:15:38 juju-e4d256-prod-github-runner-207 kernel: [31912.606044] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 14:15:38 juju-e4d256-prod-github-runner-207 kernel: [31912.606858] ? __seccomp_filter+0x4a/0x4a0 Aug 22 14:15:38 juju-e4d256-prod-github-runner-207 kernel: [31912.607652] ? __fget_files+0x86/0xc0 Aug 22 14:15:38 juju-e4d256-prod-github-runner-207 kernel: [31912.608415] __x64_sys_ioctl+0x95/0xd0 Aug 22 14:15:38 juju-e4d256-prod-github-runner-207 kernel: [31912.609141] do_syscall_64+0x5c/0xc0 Aug 22 14:15:38 juju-e4d256-prod-github-runner-207 kernel: [31912.609832] ? do_futex+0x162/0x1f0 Aug 22 14:15:38 juju-e4d256-prod-github-runner-207 kernel: [31912.610490] ? __x64_sys_futex+0x78/0x1e0 Aug 22 14:15:38 juju-e4d256-prod-github-runner-207 kernel: [31912.611173] ? __secure_computing+0xa9/0x120 Aug 22 14:15:38 juju-e4d256-prod-github-runner-207 kernel: [31912.611939] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 14:15:38 juju-e4d256-prod-github-runner-207 kernel: [31912.612753] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:15:38 juju-e4d256-prod-github-runner-207 kernel: [31912.613487] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:15:38 juju-e4d256-prod-github-runner-207 kernel: [31912.614214] ? do_syscall_64+0x69/0xc0 Aug 22 14:15:38 juju-e4d256-prod-github-runner-207 kernel: [31912.614866] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:15:38 juju-e4d256-prod-github-runner-207 kernel: [31912.615610] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:15:38 juju-e4d256-prod-github-runner-207 kernel: [31912.616410] ? do_syscall_64+0x69/0xc0 Aug 22 14:15:38 juju-e4d256-prod-github-runner-207 kernel: [31912.617131] ? do_syscall_64+0x69/0xc0 Aug 22 14:15:38 juju-e4d256-prod-github-runner-207 kernel: [31912.617765] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 14:15:38 juju-e4d256-prod-github-runner-207 kernel: [31912.618484] RIP: 0033:0x7faa5d0edaff Aug 22 14:15:38 juju-e4d256-prod-github-runner-207 kernel: [31912.619120] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 14:15:38 juju-e4d256-prod-github-runner-207 kernel: [31912.621174] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 14:15:38 juju-e4d256-prod-github-runner-207 kernel: [31912.622163] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 14:15:38 juju-e4d256-prod-github-runner-207 kernel: [31912.623093] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 14:15:38 juju-e4d256-prod-github-runner-207 kernel: [31912.624023] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 14:15:38 juju-e4d256-prod-github-runner-207 kernel: [31912.624944] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 14:15:38 juju-e4d256-prod-github-runner-207 kernel: [31912.625852] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 14:15:38 juju-e4d256-prod-github-runner-207 kernel: [31912.626761] Aug 22 14:16:06 juju-e4d256-prod-github-runner-207 kernel: [31940.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 29638s! [qemu-system-x86:6715] Aug 22 14:16:06 juju-e4d256-prod-github-runner-207 kernel: [31940.543839] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 14:16:06 juju-e4d256-prod-github-runner-207 kernel: [31940.544112] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 14:16:06 juju-e4d256-prod-github-runner-207 kernel: [31940.556520] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 14:16:06 juju-e4d256-prod-github-runner-207 kernel: [31940.557801] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 14:16:06 juju-e4d256-prod-github-runner-207 kernel: [31940.559040] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:16:06 juju-e4d256-prod-github-runner-207 kernel: [31940.560129] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 14:16:06 juju-e4d256-prod-github-runner-207 kernel: [31940.562704] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 14:16:06 juju-e4d256-prod-github-runner-207 kernel: [31940.563770] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 14:16:06 juju-e4d256-prod-github-runner-207 kernel: [31940.564975] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 14:16:06 juju-e4d256-prod-github-runner-207 kernel: [31940.566157] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 14:16:06 juju-e4d256-prod-github-runner-207 kernel: [31940.567363] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 14:16:06 juju-e4d256-prod-github-runner-207 kernel: [31940.568544] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 14:16:06 juju-e4d256-prod-github-runner-207 kernel: [31940.569734] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 14:16:06 juju-e4d256-prod-github-runner-207 kernel: [31940.570987] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 14:16:06 juju-e4d256-prod-github-runner-207 kernel: [31940.572121] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 14:16:06 juju-e4d256-prod-github-runner-207 kernel: [31940.573340] Call Trace: Aug 22 14:16:06 juju-e4d256-prod-github-runner-207 kernel: [31940.574262] Aug 22 14:16:06 juju-e4d256-prod-github-runner-207 kernel: [31940.575178] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:16:06 juju-e4d256-prod-github-runner-207 kernel: [31940.576308] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:16:06 juju-e4d256-prod-github-runner-207 kernel: [31940.577346] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:16:06 juju-e4d256-prod-github-runner-207 kernel: [31940.578458] ? show_regs.part.0+0x23/0x29 Aug 22 14:16:06 juju-e4d256-prod-github-runner-207 kernel: [31940.579492] ? show_regs.cold+0x8/0xd Aug 22 14:16:06 juju-e4d256-prod-github-runner-207 kernel: [31940.580475] ? watchdog_timer_fn+0x1be/0x220 Aug 22 14:16:06 juju-e4d256-prod-github-runner-207 kernel: [31940.581507] ? lockup_detector_update_enable+0x60/0x60 Aug 22 14:16:06 juju-e4d256-prod-github-runner-207 kernel: [31940.582607] ? __hrtimer_run_queues+0x107/0x230 Aug 22 14:16:06 juju-e4d256-prod-github-runner-207 kernel: [31940.583699] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 14:16:06 juju-e4d256-prod-github-runner-207 kernel: [31940.584737] ? hrtimer_interrupt+0x101/0x220 Aug 22 14:16:06 juju-e4d256-prod-github-runner-207 kernel: [31940.585778] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 14:16:06 juju-e4d256-prod-github-runner-207 kernel: [31940.586862] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 14:16:06 juju-e4d256-prod-github-runner-207 kernel: [31940.587936] Aug 22 14:16:06 juju-e4d256-prod-github-runner-207 kernel: [31940.588801] Aug 22 14:16:06 juju-e4d256-prod-github-runner-207 kernel: [31940.589642] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 14:16:06 juju-e4d256-prod-github-runner-207 kernel: [31940.590683] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:16:06 juju-e4d256-prod-github-runner-207 kernel: [31940.591789] ? _raw_spin_lock+0x22/0x30 Aug 22 14:16:06 juju-e4d256-prod-github-runner-207 kernel: [31940.592751] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:16:06 juju-e4d256-prod-github-runner-207 kernel: [31940.593967] direct_page_fault+0x206/0x310 [kvm] Aug 22 14:16:06 juju-e4d256-prod-github-runner-207 kernel: [31940.595005] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 14:16:06 juju-e4d256-prod-github-runner-207 kernel: [31940.596046] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 14:16:06 juju-e4d256-prod-github-runner-207 kernel: [31940.597063] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 14:16:06 juju-e4d256-prod-github-runner-207 kernel: [31940.598098] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 14:16:06 juju-e4d256-prod-github-runner-207 kernel: [31940.599059] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 14:16:06 juju-e4d256-prod-github-runner-207 kernel: [31940.600063] handle_exit+0x98/0x230 [kvm_amd] Aug 22 14:16:06 juju-e4d256-prod-github-runner-207 kernel: [31940.600968] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 14:16:06 juju-e4d256-prod-github-runner-207 kernel: [31940.601902] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 14:16:06 juju-e4d256-prod-github-runner-207 kernel: [31940.602855] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 14:16:06 juju-e4d256-prod-github-runner-207 kernel: [31940.603789] vcpu_run+0x62/0x2c0 [kvm] Aug 22 14:16:06 juju-e4d256-prod-github-runner-207 kernel: [31940.604605] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 14:16:06 juju-e4d256-prod-github-runner-207 kernel: [31940.605425] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 14:16:06 juju-e4d256-prod-github-runner-207 kernel: [31940.606290] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 14:16:06 juju-e4d256-prod-github-runner-207 kernel: [31940.607101] ? __seccomp_filter+0x4a/0x4a0 Aug 22 14:16:06 juju-e4d256-prod-github-runner-207 kernel: [31940.607864] ? __fget_files+0x86/0xc0 Aug 22 14:16:06 juju-e4d256-prod-github-runner-207 kernel: [31940.608577] __x64_sys_ioctl+0x95/0xd0 Aug 22 14:16:06 juju-e4d256-prod-github-runner-207 kernel: [31940.609278] do_syscall_64+0x5c/0xc0 Aug 22 14:16:06 juju-e4d256-prod-github-runner-207 kernel: [31940.609950] ? do_futex+0x162/0x1f0 Aug 22 14:16:06 juju-e4d256-prod-github-runner-207 kernel: [31940.610605] ? __x64_sys_futex+0x78/0x1e0 Aug 22 14:16:06 juju-e4d256-prod-github-runner-207 kernel: [31940.611297] ? __secure_computing+0xa9/0x120 Aug 22 14:16:06 juju-e4d256-prod-github-runner-207 kernel: [31940.612000] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 14:16:06 juju-e4d256-prod-github-runner-207 kernel: [31940.612770] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:16:06 juju-e4d256-prod-github-runner-207 kernel: [31940.613497] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:16:06 juju-e4d256-prod-github-runner-207 kernel: [31940.614229] ? do_syscall_64+0x69/0xc0 Aug 22 14:16:06 juju-e4d256-prod-github-runner-207 kernel: [31940.614880] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:16:06 juju-e4d256-prod-github-runner-207 kernel: [31940.615632] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:16:06 juju-e4d256-prod-github-runner-207 kernel: [31940.616413] ? do_syscall_64+0x69/0xc0 Aug 22 14:16:06 juju-e4d256-prod-github-runner-207 kernel: [31940.617050] ? do_syscall_64+0x69/0xc0 Aug 22 14:16:06 juju-e4d256-prod-github-runner-207 kernel: [31940.617682] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 14:16:06 juju-e4d256-prod-github-runner-207 kernel: [31940.618403] RIP: 0033:0x7faa5d0edaff Aug 22 14:16:06 juju-e4d256-prod-github-runner-207 kernel: [31940.619069] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 14:16:06 juju-e4d256-prod-github-runner-207 kernel: [31940.621141] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 14:16:06 juju-e4d256-prod-github-runner-207 kernel: [31940.622066] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 14:16:06 juju-e4d256-prod-github-runner-207 kernel: [31940.622984] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 14:16:06 juju-e4d256-prod-github-runner-207 kernel: [31940.623903] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 14:16:06 juju-e4d256-prod-github-runner-207 kernel: [31940.624822] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 14:16:06 juju-e4d256-prod-github-runner-207 kernel: [31940.625738] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 14:16:06 juju-e4d256-prod-github-runner-207 kernel: [31940.626644] Aug 22 14:16:34 juju-e4d256-prod-github-runner-207 kernel: [31968.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 29665s! [qemu-system-x86:6715] Aug 22 14:16:34 juju-e4d256-prod-github-runner-207 kernel: [31968.543135] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 14:16:34 juju-e4d256-prod-github-runner-207 kernel: [31968.543207] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 14:16:34 juju-e4d256-prod-github-runner-207 kernel: [31968.555769] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 14:16:34 juju-e4d256-prod-github-runner-207 kernel: [31968.557086] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 14:16:34 juju-e4d256-prod-github-runner-207 kernel: [31968.558328] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:16:34 juju-e4d256-prod-github-runner-207 kernel: [31968.559434] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 14:16:34 juju-e4d256-prod-github-runner-207 kernel: [31968.562154] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 14:16:34 juju-e4d256-prod-github-runner-207 kernel: [31968.563253] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 14:16:34 juju-e4d256-prod-github-runner-207 kernel: [31968.564441] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 14:16:34 juju-e4d256-prod-github-runner-207 kernel: [31968.565624] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 14:16:34 juju-e4d256-prod-github-runner-207 kernel: [31968.566807] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 14:16:34 juju-e4d256-prod-github-runner-207 kernel: [31968.568006] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 14:16:34 juju-e4d256-prod-github-runner-207 kernel: [31968.569187] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 14:16:34 juju-e4d256-prod-github-runner-207 kernel: [31968.570456] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 14:16:34 juju-e4d256-prod-github-runner-207 kernel: [31968.571585] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 14:16:34 juju-e4d256-prod-github-runner-207 kernel: [31968.572793] Call Trace: Aug 22 14:16:34 juju-e4d256-prod-github-runner-207 kernel: [31968.573711] Aug 22 14:16:34 juju-e4d256-prod-github-runner-207 kernel: [31968.574598] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:16:34 juju-e4d256-prod-github-runner-207 kernel: [31968.575651] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:16:34 juju-e4d256-prod-github-runner-207 kernel: [31968.576684] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:16:34 juju-e4d256-prod-github-runner-207 kernel: [31968.577768] ? show_regs.part.0+0x23/0x29 Aug 22 14:16:34 juju-e4d256-prod-github-runner-207 kernel: [31968.578775] ? show_regs.cold+0x8/0xd Aug 22 14:16:34 juju-e4d256-prod-github-runner-207 kernel: [31968.579767] ? watchdog_timer_fn+0x1be/0x220 Aug 22 14:16:34 juju-e4d256-prod-github-runner-207 kernel: [31968.580782] ? lockup_detector_update_enable+0x60/0x60 Aug 22 14:16:34 juju-e4d256-prod-github-runner-207 kernel: [31968.581858] ? __hrtimer_run_queues+0x107/0x230 Aug 22 14:16:34 juju-e4d256-prod-github-runner-207 kernel: [31968.582909] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 14:16:34 juju-e4d256-prod-github-runner-207 kernel: [31968.583944] ? hrtimer_interrupt+0x101/0x220 Aug 22 14:16:34 juju-e4d256-prod-github-runner-207 kernel: [31968.584972] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 14:16:34 juju-e4d256-prod-github-runner-207 kernel: [31968.586052] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 14:16:34 juju-e4d256-prod-github-runner-207 kernel: [31968.587150] Aug 22 14:16:34 juju-e4d256-prod-github-runner-207 kernel: [31968.588028] Aug 22 14:16:34 juju-e4d256-prod-github-runner-207 kernel: [31968.588872] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 14:16:34 juju-e4d256-prod-github-runner-207 kernel: [31968.590005] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:16:34 juju-e4d256-prod-github-runner-207 kernel: [31968.591159] ? _raw_spin_lock+0x22/0x30 Aug 22 14:16:34 juju-e4d256-prod-github-runner-207 kernel: [31968.592152] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:16:34 juju-e4d256-prod-github-runner-207 kernel: [31968.593189] direct_page_fault+0x206/0x310 [kvm] Aug 22 14:16:34 juju-e4d256-prod-github-runner-207 kernel: [31968.594221] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 14:16:34 juju-e4d256-prod-github-runner-207 kernel: [31968.595261] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 14:16:34 juju-e4d256-prod-github-runner-207 kernel: [31968.596340] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 14:16:34 juju-e4d256-prod-github-runner-207 kernel: [31968.597333] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 14:16:34 juju-e4d256-prod-github-runner-207 kernel: [31968.598314] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 14:16:34 juju-e4d256-prod-github-runner-207 kernel: [31968.599348] handle_exit+0x98/0x230 [kvm_amd] Aug 22 14:16:34 juju-e4d256-prod-github-runner-207 kernel: [31968.600271] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 14:16:34 juju-e4d256-prod-github-runner-207 kernel: [31968.601233] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 14:16:34 juju-e4d256-prod-github-runner-207 kernel: [31968.602190] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 14:16:34 juju-e4d256-prod-github-runner-207 kernel: [31968.603137] vcpu_run+0x62/0x2c0 [kvm] Aug 22 14:16:34 juju-e4d256-prod-github-runner-207 kernel: [31968.604016] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 14:16:34 juju-e4d256-prod-github-runner-207 kernel: [31968.604885] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 14:16:34 juju-e4d256-prod-github-runner-207 kernel: [31968.605758] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 14:16:34 juju-e4d256-prod-github-runner-207 kernel: [31968.606570] ? __seccomp_filter+0x4a/0x4a0 Aug 22 14:16:34 juju-e4d256-prod-github-runner-207 kernel: [31968.607339] ? __fget_files+0x86/0xc0 Aug 22 14:16:34 juju-e4d256-prod-github-runner-207 kernel: [31968.608051] __x64_sys_ioctl+0x95/0xd0 Aug 22 14:16:34 juju-e4d256-prod-github-runner-207 kernel: [31968.608747] do_syscall_64+0x5c/0xc0 Aug 22 14:16:34 juju-e4d256-prod-github-runner-207 kernel: [31968.609466] ? do_futex+0x162/0x1f0 Aug 22 14:16:34 juju-e4d256-prod-github-runner-207 kernel: [31968.610147] ? __x64_sys_futex+0x78/0x1e0 Aug 22 14:16:34 juju-e4d256-prod-github-runner-207 kernel: [31968.610848] ? __secure_computing+0xa9/0x120 Aug 22 14:16:34 juju-e4d256-prod-github-runner-207 kernel: [31968.611538] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 14:16:34 juju-e4d256-prod-github-runner-207 kernel: [31968.612299] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:16:34 juju-e4d256-prod-github-runner-207 kernel: [31968.613021] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:16:34 juju-e4d256-prod-github-runner-207 kernel: [31968.613739] ? do_syscall_64+0x69/0xc0 Aug 22 14:16:34 juju-e4d256-prod-github-runner-207 kernel: [31968.614396] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:16:34 juju-e4d256-prod-github-runner-207 kernel: [31968.615139] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:16:34 juju-e4d256-prod-github-runner-207 kernel: [31968.615839] ? do_syscall_64+0x69/0xc0 Aug 22 14:16:34 juju-e4d256-prod-github-runner-207 kernel: [31968.616468] ? do_syscall_64+0x69/0xc0 Aug 22 14:16:34 juju-e4d256-prod-github-runner-207 kernel: [31968.617091] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 14:16:34 juju-e4d256-prod-github-runner-207 kernel: [31968.617798] RIP: 0033:0x7faa5d0edaff Aug 22 14:16:34 juju-e4d256-prod-github-runner-207 kernel: [31968.618428] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 14:16:34 juju-e4d256-prod-github-runner-207 kernel: [31968.620436] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 14:16:34 juju-e4d256-prod-github-runner-207 kernel: [31968.621355] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 14:16:34 juju-e4d256-prod-github-runner-207 kernel: [31968.622255] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 14:16:34 juju-e4d256-prod-github-runner-207 kernel: [31968.623216] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 14:16:34 juju-e4d256-prod-github-runner-207 kernel: [31968.624176] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 14:16:34 juju-e4d256-prod-github-runner-207 kernel: [31968.625164] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 14:16:34 juju-e4d256-prod-github-runner-207 kernel: [31968.626067] Aug 22 14:17:02 juju-e4d256-prod-github-runner-207 kernel: [31996.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 29691s! [qemu-system-x86:6715] Aug 22 14:17:02 juju-e4d256-prod-github-runner-207 kernel: [31996.543124] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 14:17:02 juju-e4d256-prod-github-runner-207 kernel: [31996.543199] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 14:17:02 juju-e4d256-prod-github-runner-207 kernel: [31996.555801] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 14:17:02 juju-e4d256-prod-github-runner-207 kernel: [31996.557284] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 14:17:02 juju-e4d256-prod-github-runner-207 kernel: [31996.558538] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:17:02 juju-e4d256-prod-github-runner-207 kernel: [31996.559596] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 14:17:02 juju-e4d256-prod-github-runner-207 kernel: [31996.562190] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 14:17:02 juju-e4d256-prod-github-runner-207 kernel: [31996.563307] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 14:17:02 juju-e4d256-prod-github-runner-207 kernel: [31996.564488] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 14:17:02 juju-e4d256-prod-github-runner-207 kernel: [31996.565750] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 14:17:02 juju-e4d256-prod-github-runner-207 kernel: [31996.566994] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 14:17:02 juju-e4d256-prod-github-runner-207 kernel: [31996.568203] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 14:17:02 juju-e4d256-prod-github-runner-207 kernel: [31996.569393] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 14:17:02 juju-e4d256-prod-github-runner-207 kernel: [31996.570668] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 14:17:02 juju-e4d256-prod-github-runner-207 kernel: [31996.571764] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 14:17:02 juju-e4d256-prod-github-runner-207 kernel: [31996.572959] Call Trace: Aug 22 14:17:02 juju-e4d256-prod-github-runner-207 kernel: [31996.573870] Aug 22 14:17:02 juju-e4d256-prod-github-runner-207 kernel: [31996.574777] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:17:02 juju-e4d256-prod-github-runner-207 kernel: [31996.575814] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:17:02 juju-e4d256-prod-github-runner-207 kernel: [31996.576836] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:17:02 juju-e4d256-prod-github-runner-207 kernel: [31996.577915] ? show_regs.part.0+0x23/0x29 Aug 22 14:17:02 juju-e4d256-prod-github-runner-207 kernel: [31996.578933] ? show_regs.cold+0x8/0xd Aug 22 14:17:02 juju-e4d256-prod-github-runner-207 kernel: [31996.579954] ? watchdog_timer_fn+0x1be/0x220 Aug 22 14:17:02 juju-e4d256-prod-github-runner-207 kernel: [31996.580960] ? lockup_detector_update_enable+0x60/0x60 Aug 22 14:17:02 juju-e4d256-prod-github-runner-207 kernel: [31996.582020] ? __hrtimer_run_queues+0x107/0x230 Aug 22 14:17:02 juju-e4d256-prod-github-runner-207 kernel: [31996.583062] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 14:17:02 juju-e4d256-prod-github-runner-207 kernel: [31996.584088] ? hrtimer_interrupt+0x101/0x220 Aug 22 14:17:02 juju-e4d256-prod-github-runner-207 kernel: [31996.585125] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 14:17:02 juju-e4d256-prod-github-runner-207 kernel: [31996.586208] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 14:17:02 juju-e4d256-prod-github-runner-207 kernel: [31996.587308] Aug 22 14:17:02 juju-e4d256-prod-github-runner-207 kernel: [31996.588190] Aug 22 14:17:02 juju-e4d256-prod-github-runner-207 kernel: [31996.589212] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 14:17:02 juju-e4d256-prod-github-runner-207 kernel: [31996.590270] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:17:02 juju-e4d256-prod-github-runner-207 kernel: [31996.591334] ? _raw_spin_lock+0x22/0x30 Aug 22 14:17:02 juju-e4d256-prod-github-runner-207 kernel: [31996.592281] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:17:02 juju-e4d256-prod-github-runner-207 kernel: [31996.593302] direct_page_fault+0x206/0x310 [kvm] Aug 22 14:17:02 juju-e4d256-prod-github-runner-207 kernel: [31996.594347] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 14:17:02 juju-e4d256-prod-github-runner-207 kernel: [31996.595400] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 14:17:02 juju-e4d256-prod-github-runner-207 kernel: [31996.596410] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 14:17:02 juju-e4d256-prod-github-runner-207 kernel: [31996.597395] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 14:17:02 juju-e4d256-prod-github-runner-207 kernel: [31996.598401] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 14:17:02 juju-e4d256-prod-github-runner-207 kernel: [31996.599427] handle_exit+0x98/0x230 [kvm_amd] Aug 22 14:17:02 juju-e4d256-prod-github-runner-207 kernel: [31996.600321] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 14:17:02 juju-e4d256-prod-github-runner-207 kernel: [31996.601238] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 14:17:02 juju-e4d256-prod-github-runner-207 kernel: [31996.602165] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 14:17:02 juju-e4d256-prod-github-runner-207 kernel: [31996.603101] vcpu_run+0x62/0x2c0 [kvm] Aug 22 14:17:02 juju-e4d256-prod-github-runner-207 kernel: [31996.603929] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 14:17:02 juju-e4d256-prod-github-runner-207 kernel: [31996.604757] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 14:17:02 juju-e4d256-prod-github-runner-207 kernel: [31996.605623] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 14:17:02 juju-e4d256-prod-github-runner-207 kernel: [31996.606423] ? __seccomp_filter+0x4a/0x4a0 Aug 22 14:17:02 juju-e4d256-prod-github-runner-207 kernel: [31996.607185] ? __fget_files+0x86/0xc0 Aug 22 14:17:02 juju-e4d256-prod-github-runner-207 kernel: [31996.607890] __x64_sys_ioctl+0x95/0xd0 Aug 22 14:17:02 juju-e4d256-prod-github-runner-207 kernel: [31996.608584] do_syscall_64+0x5c/0xc0 Aug 22 14:17:02 juju-e4d256-prod-github-runner-207 kernel: [31996.609252] ? do_futex+0x162/0x1f0 Aug 22 14:17:02 juju-e4d256-prod-github-runner-207 kernel: [31996.609933] ? __x64_sys_futex+0x78/0x1e0 Aug 22 14:17:02 juju-e4d256-prod-github-runner-207 kernel: [31996.610657] ? __secure_computing+0xa9/0x120 Aug 22 14:17:02 juju-e4d256-prod-github-runner-207 kernel: [31996.611368] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 14:17:02 juju-e4d256-prod-github-runner-207 kernel: [31996.612169] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:17:02 juju-e4d256-prod-github-runner-207 kernel: [31996.612925] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:17:02 juju-e4d256-prod-github-runner-207 kernel: [31996.613652] ? do_syscall_64+0x69/0xc0 Aug 22 14:17:02 juju-e4d256-prod-github-runner-207 kernel: [31996.614341] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:17:02 juju-e4d256-prod-github-runner-207 kernel: [31996.615079] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:17:02 juju-e4d256-prod-github-runner-207 kernel: [31996.615776] ? do_syscall_64+0x69/0xc0 Aug 22 14:17:02 juju-e4d256-prod-github-runner-207 kernel: [31996.616403] ? do_syscall_64+0x69/0xc0 Aug 22 14:17:02 juju-e4d256-prod-github-runner-207 kernel: [31996.617027] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 14:17:02 juju-e4d256-prod-github-runner-207 kernel: [31996.617736] RIP: 0033:0x7faa5d0edaff Aug 22 14:17:02 juju-e4d256-prod-github-runner-207 kernel: [31996.618364] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 14:17:02 juju-e4d256-prod-github-runner-207 kernel: [31996.620408] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 14:17:02 juju-e4d256-prod-github-runner-207 kernel: [31996.621324] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 14:17:02 juju-e4d256-prod-github-runner-207 kernel: [31996.622228] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 14:17:02 juju-e4d256-prod-github-runner-207 kernel: [31996.623140] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 14:17:02 juju-e4d256-prod-github-runner-207 kernel: [31996.624067] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 14:17:02 juju-e4d256-prod-github-runner-207 kernel: [31996.624973] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 14:17:02 juju-e4d256-prod-github-runner-207 kernel: [31996.625897] Aug 22 14:17:30 juju-e4d256-prod-github-runner-207 kernel: [32024.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 29717s! [qemu-system-x86:6715] Aug 22 14:17:30 juju-e4d256-prod-github-runner-207 kernel: [32024.543805] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 14:17:30 juju-e4d256-prod-github-runner-207 kernel: [32024.544099] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 14:17:30 juju-e4d256-prod-github-runner-207 kernel: [32024.556362] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 14:17:30 juju-e4d256-prod-github-runner-207 kernel: [32024.557627] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 14:17:30 juju-e4d256-prod-github-runner-207 kernel: [32024.558886] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:17:30 juju-e4d256-prod-github-runner-207 kernel: [32024.559946] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 14:17:30 juju-e4d256-prod-github-runner-207 kernel: [32024.562505] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 14:17:30 juju-e4d256-prod-github-runner-207 kernel: [32024.563559] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 14:17:30 juju-e4d256-prod-github-runner-207 kernel: [32024.564712] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 14:17:30 juju-e4d256-prod-github-runner-207 kernel: [32024.565865] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 14:17:30 juju-e4d256-prod-github-runner-207 kernel: [32024.567049] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 14:17:30 juju-e4d256-prod-github-runner-207 kernel: [32024.568208] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 14:17:30 juju-e4d256-prod-github-runner-207 kernel: [32024.569371] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 14:17:30 juju-e4d256-prod-github-runner-207 kernel: [32024.570623] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 14:17:30 juju-e4d256-prod-github-runner-207 kernel: [32024.571725] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 14:17:30 juju-e4d256-prod-github-runner-207 kernel: [32024.572928] Call Trace: Aug 22 14:17:30 juju-e4d256-prod-github-runner-207 kernel: [32024.573842] Aug 22 14:17:30 juju-e4d256-prod-github-runner-207 kernel: [32024.574783] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:17:30 juju-e4d256-prod-github-runner-207 kernel: [32024.575841] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:17:30 juju-e4d256-prod-github-runner-207 kernel: [32024.576898] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:17:30 juju-e4d256-prod-github-runner-207 kernel: [32024.578043] ? show_regs.part.0+0x23/0x29 Aug 22 14:17:30 juju-e4d256-prod-github-runner-207 kernel: [32024.579076] ? show_regs.cold+0x8/0xd Aug 22 14:17:30 juju-e4d256-prod-github-runner-207 kernel: [32024.580050] ? watchdog_timer_fn+0x1be/0x220 Aug 22 14:17:30 juju-e4d256-prod-github-runner-207 kernel: [32024.581061] ? lockup_detector_update_enable+0x60/0x60 Aug 22 14:17:30 juju-e4d256-prod-github-runner-207 kernel: [32024.582126] ? __hrtimer_run_queues+0x107/0x230 Aug 22 14:17:30 juju-e4d256-prod-github-runner-207 kernel: [32024.583175] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 14:17:30 juju-e4d256-prod-github-runner-207 kernel: [32024.584205] ? hrtimer_interrupt+0x101/0x220 Aug 22 14:17:30 juju-e4d256-prod-github-runner-207 kernel: [32024.585222] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 14:17:30 juju-e4d256-prod-github-runner-207 kernel: [32024.586306] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 14:17:30 juju-e4d256-prod-github-runner-207 kernel: [32024.587360] Aug 22 14:17:30 juju-e4d256-prod-github-runner-207 kernel: [32024.588229] Aug 22 14:17:30 juju-e4d256-prod-github-runner-207 kernel: [32024.589087] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 14:17:30 juju-e4d256-prod-github-runner-207 kernel: [32024.590361] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:17:30 juju-e4d256-prod-github-runner-207 kernel: [32024.591413] ? _raw_spin_lock+0x22/0x30 Aug 22 14:17:30 juju-e4d256-prod-github-runner-207 kernel: [32024.592359] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:17:30 juju-e4d256-prod-github-runner-207 kernel: [32024.593388] direct_page_fault+0x206/0x310 [kvm] Aug 22 14:17:30 juju-e4d256-prod-github-runner-207 kernel: [32024.594430] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 14:17:30 juju-e4d256-prod-github-runner-207 kernel: [32024.595443] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 14:17:30 juju-e4d256-prod-github-runner-207 kernel: [32024.596496] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 14:17:30 juju-e4d256-prod-github-runner-207 kernel: [32024.597525] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 14:17:30 juju-e4d256-prod-github-runner-207 kernel: [32024.598496] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 14:17:30 juju-e4d256-prod-github-runner-207 kernel: [32024.599485] handle_exit+0x98/0x230 [kvm_amd] Aug 22 14:17:30 juju-e4d256-prod-github-runner-207 kernel: [32024.600378] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 14:17:30 juju-e4d256-prod-github-runner-207 kernel: [32024.601295] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 14:17:30 juju-e4d256-prod-github-runner-207 kernel: [32024.602287] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 14:17:30 juju-e4d256-prod-github-runner-207 kernel: [32024.603402] vcpu_run+0x62/0x2c0 [kvm] Aug 22 14:17:30 juju-e4d256-prod-github-runner-207 kernel: [32024.604336] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 14:17:30 juju-e4d256-prod-github-runner-207 kernel: [32024.605147] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 14:17:30 juju-e4d256-prod-github-runner-207 kernel: [32024.606004] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 14:17:30 juju-e4d256-prod-github-runner-207 kernel: [32024.606832] ? __seccomp_filter+0x4a/0x4a0 Aug 22 14:17:30 juju-e4d256-prod-github-runner-207 kernel: [32024.607615] ? __fget_files+0x86/0xc0 Aug 22 14:17:30 juju-e4d256-prod-github-runner-207 kernel: [32024.608429] __x64_sys_ioctl+0x95/0xd0 Aug 22 14:17:30 juju-e4d256-prod-github-runner-207 kernel: [32024.609129] do_syscall_64+0x5c/0xc0 Aug 22 14:17:30 juju-e4d256-prod-github-runner-207 kernel: [32024.609799] ? do_futex+0x162/0x1f0 Aug 22 14:17:30 juju-e4d256-prod-github-runner-207 kernel: [32024.610542] ? __x64_sys_futex+0x78/0x1e0 Aug 22 14:17:30 juju-e4d256-prod-github-runner-207 kernel: [32024.611250] ? __secure_computing+0xa9/0x120 Aug 22 14:17:30 juju-e4d256-prod-github-runner-207 kernel: [32024.612024] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 14:17:30 juju-e4d256-prod-github-runner-207 kernel: [32024.612860] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:17:30 juju-e4d256-prod-github-runner-207 kernel: [32024.613653] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:17:30 juju-e4d256-prod-github-runner-207 kernel: [32024.614400] ? do_syscall_64+0x69/0xc0 Aug 22 14:17:30 juju-e4d256-prod-github-runner-207 kernel: [32024.615110] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:17:30 juju-e4d256-prod-github-runner-207 kernel: [32024.615817] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:17:30 juju-e4d256-prod-github-runner-207 kernel: [32024.616517] ? do_syscall_64+0x69/0xc0 Aug 22 14:17:30 juju-e4d256-prod-github-runner-207 kernel: [32024.617157] ? do_syscall_64+0x69/0xc0 Aug 22 14:17:30 juju-e4d256-prod-github-runner-207 kernel: [32024.617824] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 14:17:30 juju-e4d256-prod-github-runner-207 kernel: [32024.618584] RIP: 0033:0x7faa5d0edaff Aug 22 14:17:30 juju-e4d256-prod-github-runner-207 kernel: [32024.619247] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 14:17:30 juju-e4d256-prod-github-runner-207 kernel: [32024.621650] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 14:17:30 juju-e4d256-prod-github-runner-207 kernel: [32024.622782] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 14:17:30 juju-e4d256-prod-github-runner-207 kernel: [32024.624105] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 14:17:30 juju-e4d256-prod-github-runner-207 kernel: [32024.625189] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 14:17:30 juju-e4d256-prod-github-runner-207 kernel: [32024.626481] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 14:17:30 juju-e4d256-prod-github-runner-207 kernel: [32024.627457] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 14:17:30 juju-e4d256-prod-github-runner-207 kernel: [32024.628417] Aug 22 14:17:45 juju-e4d256-prod-github-runner-207 kernel: [32039.324716] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 14:17:45 juju-e4d256-prod-github-runner-207 kernel: [32039.325784] rcu: 1-....: (7955635 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=3844366 Aug 22 14:17:45 juju-e4d256-prod-github-runner-207 kernel: [32039.326958] (t=7980531 jiffies g=23269 q=34931) Aug 22 14:17:45 juju-e4d256-prod-github-runner-207 kernel: [32039.327752] NMI backtrace for cpu 1 Aug 22 14:17:45 juju-e4d256-prod-github-runner-207 kernel: [32039.328471] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 14:17:45 juju-e4d256-prod-github-runner-207 kernel: [32039.329653] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 14:17:45 juju-e4d256-prod-github-runner-207 kernel: [32039.330759] Call Trace: Aug 22 14:17:45 juju-e4d256-prod-github-runner-207 kernel: [32039.331442] Aug 22 14:17:45 juju-e4d256-prod-github-runner-207 kernel: [32039.332141] show_stack+0x52/0x5c Aug 22 14:17:45 juju-e4d256-prod-github-runner-207 kernel: [32039.332924] dump_stack_lvl+0x4a/0x63 Aug 22 14:17:45 juju-e4d256-prod-github-runner-207 kernel: [32039.333687] dump_stack+0x10/0x16 Aug 22 14:17:45 juju-e4d256-prod-github-runner-207 kernel: [32039.334483] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 14:17:45 juju-e4d256-prod-github-runner-207 kernel: [32039.335292] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 14:17:45 juju-e4d256-prod-github-runner-207 kernel: [32039.336252] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 14:17:45 juju-e4d256-prod-github-runner-207 kernel: [32039.337103] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 14:17:45 juju-e4d256-prod-github-runner-207 kernel: [32039.338016] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 14:17:45 juju-e4d256-prod-github-runner-207 kernel: [32039.338867] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 14:17:45 juju-e4d256-prod-github-runner-207 kernel: [32039.339699] print_cpu_stall.cold+0x2f/0xe2 Aug 22 14:17:45 juju-e4d256-prod-github-runner-207 kernel: [32039.340681] ? timekeeping_update+0xf7/0x150 Aug 22 14:17:45 juju-e4d256-prod-github-runner-207 kernel: [32039.341470] check_cpu_stall+0x109/0x270 Aug 22 14:17:45 juju-e4d256-prod-github-runner-207 kernel: [32039.342248] rcu_sched_clock_irq+0x9a/0x250 Aug 22 14:17:45 juju-e4d256-prod-github-runner-207 kernel: [32039.343031] update_process_times+0x94/0xd0 Aug 22 14:17:45 juju-e4d256-prod-github-runner-207 kernel: [32039.343814] tick_sched_handle+0x29/0x70 Aug 22 14:17:45 juju-e4d256-prod-github-runner-207 kernel: [32039.344600] tick_sched_timer+0x8c/0xc0 Aug 22 14:17:45 juju-e4d256-prod-github-runner-207 kernel: [32039.345479] ? tick_nohz_handler+0xb0/0xb0 Aug 22 14:17:45 juju-e4d256-prod-github-runner-207 kernel: [32039.346314] __hrtimer_run_queues+0x107/0x230 Aug 22 14:17:45 juju-e4d256-prod-github-runner-207 kernel: [32039.347117] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 14:17:45 juju-e4d256-prod-github-runner-207 kernel: [32039.347915] hrtimer_interrupt+0x101/0x220 Aug 22 14:17:45 juju-e4d256-prod-github-runner-207 kernel: [32039.348693] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 14:17:45 juju-e4d256-prod-github-runner-207 kernel: [32039.349552] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 14:17:45 juju-e4d256-prod-github-runner-207 kernel: [32039.350476] Aug 22 14:17:45 juju-e4d256-prod-github-runner-207 kernel: [32039.351146] Aug 22 14:17:45 juju-e4d256-prod-github-runner-207 kernel: [32039.351795] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 14:17:45 juju-e4d256-prod-github-runner-207 kernel: [32039.352630] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:17:45 juju-e4d256-prod-github-runner-207 kernel: [32039.353531] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 14:17:45 juju-e4d256-prod-github-runner-207 kernel: [32039.355841] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 14:17:45 juju-e4d256-prod-github-runner-207 kernel: [32039.356751] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 14:17:45 juju-e4d256-prod-github-runner-207 kernel: [32039.357781] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 14:17:45 juju-e4d256-prod-github-runner-207 kernel: [32039.358804] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 14:17:45 juju-e4d256-prod-github-runner-207 kernel: [32039.359822] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 14:17:45 juju-e4d256-prod-github-runner-207 kernel: [32039.360817] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 14:17:45 juju-e4d256-prod-github-runner-207 kernel: [32039.361824] ? _raw_spin_lock+0x22/0x30 Aug 22 14:17:45 juju-e4d256-prod-github-runner-207 kernel: [32039.362652] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:17:45 juju-e4d256-prod-github-runner-207 kernel: [32039.363605] direct_page_fault+0x206/0x310 [kvm] Aug 22 14:17:45 juju-e4d256-prod-github-runner-207 kernel: [32039.364462] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 14:17:45 juju-e4d256-prod-github-runner-207 kernel: [32039.365309] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 14:17:45 juju-e4d256-prod-github-runner-207 kernel: [32039.366208] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 14:17:45 juju-e4d256-prod-github-runner-207 kernel: [32039.367044] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 14:17:45 juju-e4d256-prod-github-runner-207 kernel: [32039.367931] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 14:17:45 juju-e4d256-prod-github-runner-207 kernel: [32039.368772] handle_exit+0x98/0x230 [kvm_amd] Aug 22 14:17:45 juju-e4d256-prod-github-runner-207 kernel: [32039.369537] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 14:17:45 juju-e4d256-prod-github-runner-207 kernel: [32039.370408] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 14:17:45 juju-e4d256-prod-github-runner-207 kernel: [32039.371286] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 14:17:45 juju-e4d256-prod-github-runner-207 kernel: [32039.372112] vcpu_run+0x62/0x2c0 [kvm] Aug 22 14:17:45 juju-e4d256-prod-github-runner-207 kernel: [32039.372847] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 14:17:45 juju-e4d256-prod-github-runner-207 kernel: [32039.373610] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 14:17:45 juju-e4d256-prod-github-runner-207 kernel: [32039.374462] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 14:17:45 juju-e4d256-prod-github-runner-207 kernel: [32039.375231] ? __seccomp_filter+0x4a/0x4a0 Aug 22 14:17:45 juju-e4d256-prod-github-runner-207 kernel: [32039.375971] ? __fget_files+0x86/0xc0 Aug 22 14:17:45 juju-e4d256-prod-github-runner-207 kernel: [32039.376680] __x64_sys_ioctl+0x95/0xd0 Aug 22 14:17:45 juju-e4d256-prod-github-runner-207 kernel: [32039.377395] do_syscall_64+0x5c/0xc0 Aug 22 14:17:45 juju-e4d256-prod-github-runner-207 kernel: [32039.378114] ? do_futex+0x162/0x1f0 Aug 22 14:17:45 juju-e4d256-prod-github-runner-207 kernel: [32039.378798] ? __x64_sys_futex+0x78/0x1e0 Aug 22 14:17:45 juju-e4d256-prod-github-runner-207 kernel: [32039.379507] ? __secure_computing+0xa9/0x120 Aug 22 14:17:45 juju-e4d256-prod-github-runner-207 kernel: [32039.380270] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 14:17:45 juju-e4d256-prod-github-runner-207 kernel: [32039.381086] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:17:45 juju-e4d256-prod-github-runner-207 kernel: [32039.381927] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:17:45 juju-e4d256-prod-github-runner-207 kernel: [32039.382762] ? do_syscall_64+0x69/0xc0 Aug 22 14:17:45 juju-e4d256-prod-github-runner-207 kernel: [32039.383617] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:17:45 juju-e4d256-prod-github-runner-207 kernel: [32039.384396] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:17:45 juju-e4d256-prod-github-runner-207 kernel: [32039.385181] ? do_syscall_64+0x69/0xc0 Aug 22 14:17:45 juju-e4d256-prod-github-runner-207 kernel: [32039.385917] ? do_syscall_64+0x69/0xc0 Aug 22 14:17:45 juju-e4d256-prod-github-runner-207 kernel: [32039.386680] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 14:17:45 juju-e4d256-prod-github-runner-207 kernel: [32039.387484] RIP: 0033:0x7faa5d0edaff Aug 22 14:17:45 juju-e4d256-prod-github-runner-207 kernel: [32039.388180] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 14:17:45 juju-e4d256-prod-github-runner-207 kernel: [32039.390349] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 14:17:45 juju-e4d256-prod-github-runner-207 kernel: [32039.391328] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 14:17:45 juju-e4d256-prod-github-runner-207 kernel: [32039.392305] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 14:17:45 juju-e4d256-prod-github-runner-207 kernel: [32039.393296] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 14:17:45 juju-e4d256-prod-github-runner-207 kernel: [32039.394256] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 14:17:45 juju-e4d256-prod-github-runner-207 kernel: [32039.395192] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 14:17:45 juju-e4d256-prod-github-runner-207 kernel: [32039.396120] Aug 22 14:18:10 juju-e4d256-prod-github-runner-207 kernel: [32064.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 29754s! [qemu-system-x86:6715] Aug 22 14:18:10 juju-e4d256-prod-github-runner-207 kernel: [32064.543100] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 14:18:10 juju-e4d256-prod-github-runner-207 kernel: [32064.543172] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 14:18:10 juju-e4d256-prod-github-runner-207 kernel: [32064.557255] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 14:18:10 juju-e4d256-prod-github-runner-207 kernel: [32064.558781] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 14:18:10 juju-e4d256-prod-github-runner-207 kernel: [32064.560251] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:18:10 juju-e4d256-prod-github-runner-207 kernel: [32064.561310] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 14:18:10 juju-e4d256-prod-github-runner-207 kernel: [32064.563881] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 14:18:10 juju-e4d256-prod-github-runner-207 kernel: [32064.564945] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 14:18:10 juju-e4d256-prod-github-runner-207 kernel: [32064.566144] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 14:18:10 juju-e4d256-prod-github-runner-207 kernel: [32064.567319] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 14:18:10 juju-e4d256-prod-github-runner-207 kernel: [32064.568848] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 14:18:10 juju-e4d256-prod-github-runner-207 kernel: [32064.570517] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 14:18:10 juju-e4d256-prod-github-runner-207 kernel: [32064.572166] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 14:18:10 juju-e4d256-prod-github-runner-207 kernel: [32064.574029] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 14:18:10 juju-e4d256-prod-github-runner-207 kernel: [32064.575523] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 14:18:10 juju-e4d256-prod-github-runner-207 kernel: [32064.577175] Call Trace: Aug 22 14:18:10 juju-e4d256-prod-github-runner-207 kernel: [32064.578371] Aug 22 14:18:10 juju-e4d256-prod-github-runner-207 kernel: [32064.579328] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:18:10 juju-e4d256-prod-github-runner-207 kernel: [32064.580430] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:18:10 juju-e4d256-prod-github-runner-207 kernel: [32064.581458] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:18:10 juju-e4d256-prod-github-runner-207 kernel: [32064.582545] ? show_regs.part.0+0x23/0x29 Aug 22 14:18:10 juju-e4d256-prod-github-runner-207 kernel: [32064.583552] ? show_regs.cold+0x8/0xd Aug 22 14:18:10 juju-e4d256-prod-github-runner-207 kernel: [32064.584527] ? watchdog_timer_fn+0x1be/0x220 Aug 22 14:18:10 juju-e4d256-prod-github-runner-207 kernel: [32064.585536] ? lockup_detector_update_enable+0x60/0x60 Aug 22 14:18:10 juju-e4d256-prod-github-runner-207 kernel: [32064.586606] ? __hrtimer_run_queues+0x107/0x230 Aug 22 14:18:10 juju-e4d256-prod-github-runner-207 kernel: [32064.587650] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 14:18:10 juju-e4d256-prod-github-runner-207 kernel: [32064.588672] ? hrtimer_interrupt+0x101/0x220 Aug 22 14:18:10 juju-e4d256-prod-github-runner-207 kernel: [32064.589913] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 14:18:10 juju-e4d256-prod-github-runner-207 kernel: [32064.590993] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 14:18:10 juju-e4d256-prod-github-runner-207 kernel: [32064.592167] Aug 22 14:18:10 juju-e4d256-prod-github-runner-207 kernel: [32064.593020] Aug 22 14:18:10 juju-e4d256-prod-github-runner-207 kernel: [32064.593974] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 14:18:10 juju-e4d256-prod-github-runner-207 kernel: [32064.595012] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:18:10 juju-e4d256-prod-github-runner-207 kernel: [32064.596055] ? _raw_spin_lock+0x22/0x30 Aug 22 14:18:10 juju-e4d256-prod-github-runner-207 kernel: [32064.597001] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:18:10 juju-e4d256-prod-github-runner-207 kernel: [32064.598027] direct_page_fault+0x206/0x310 [kvm] Aug 22 14:18:10 juju-e4d256-prod-github-runner-207 kernel: [32064.599050] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 14:18:10 juju-e4d256-prod-github-runner-207 kernel: [32064.600056] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 14:18:10 juju-e4d256-prod-github-runner-207 kernel: [32064.601057] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 14:18:10 juju-e4d256-prod-github-runner-207 kernel: [32064.602042] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 14:18:10 juju-e4d256-prod-github-runner-207 kernel: [32064.602992] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 14:18:10 juju-e4d256-prod-github-runner-207 kernel: [32064.603975] handle_exit+0x98/0x230 [kvm_amd] Aug 22 14:18:10 juju-e4d256-prod-github-runner-207 kernel: [32064.604868] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 14:18:10 juju-e4d256-prod-github-runner-207 kernel: [32064.605917] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 14:18:10 juju-e4d256-prod-github-runner-207 kernel: [32064.606943] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 14:18:10 juju-e4d256-prod-github-runner-207 kernel: [32064.607960] vcpu_run+0x62/0x2c0 [kvm] Aug 22 14:18:10 juju-e4d256-prod-github-runner-207 kernel: [32064.608844] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 14:18:10 juju-e4d256-prod-github-runner-207 kernel: [32064.609770] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 14:18:10 juju-e4d256-prod-github-runner-207 kernel: [32064.610733] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 14:18:10 juju-e4d256-prod-github-runner-207 kernel: [32064.611618] ? __seccomp_filter+0x4a/0x4a0 Aug 22 14:18:10 juju-e4d256-prod-github-runner-207 kernel: [32064.612442] ? __fget_files+0x86/0xc0 Aug 22 14:18:10 juju-e4d256-prod-github-runner-207 kernel: [32064.613215] __x64_sys_ioctl+0x95/0xd0 Aug 22 14:18:10 juju-e4d256-prod-github-runner-207 kernel: [32064.613999] do_syscall_64+0x5c/0xc0 Aug 22 14:18:10 juju-e4d256-prod-github-runner-207 kernel: [32064.614926] ? do_futex+0x162/0x1f0 Aug 22 14:18:10 juju-e4d256-prod-github-runner-207 kernel: [32064.615930] ? __x64_sys_futex+0x78/0x1e0 Aug 22 14:18:10 juju-e4d256-prod-github-runner-207 kernel: [32064.616695] ? __secure_computing+0xa9/0x120 Aug 22 14:18:10 juju-e4d256-prod-github-runner-207 kernel: [32064.617467] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 14:18:10 juju-e4d256-prod-github-runner-207 kernel: [32064.618340] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:18:10 juju-e4d256-prod-github-runner-207 kernel: [32064.619157] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:18:10 juju-e4d256-prod-github-runner-207 kernel: [32064.619976] ? do_syscall_64+0x69/0xc0 Aug 22 14:18:10 juju-e4d256-prod-github-runner-207 kernel: [32064.620697] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:18:10 juju-e4d256-prod-github-runner-207 kernel: [32064.621491] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:18:10 juju-e4d256-prod-github-runner-207 kernel: [32064.622292] ? do_syscall_64+0x69/0xc0 Aug 22 14:18:10 juju-e4d256-prod-github-runner-207 kernel: [32064.622994] ? do_syscall_64+0x69/0xc0 Aug 22 14:18:10 juju-e4d256-prod-github-runner-207 kernel: [32064.623690] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 14:18:10 juju-e4d256-prod-github-runner-207 kernel: [32064.624489] RIP: 0033:0x7faa5d0edaff Aug 22 14:18:10 juju-e4d256-prod-github-runner-207 kernel: [32064.625190] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 14:18:10 juju-e4d256-prod-github-runner-207 kernel: [32064.627512] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 14:18:10 juju-e4d256-prod-github-runner-207 kernel: [32064.628565] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 14:18:10 juju-e4d256-prod-github-runner-207 kernel: [32064.629590] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 14:18:10 juju-e4d256-prod-github-runner-207 kernel: [32064.630621] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 14:18:10 juju-e4d256-prod-github-runner-207 kernel: [32064.631645] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 14:18:10 juju-e4d256-prod-github-runner-207 kernel: [32064.632661] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 14:18:10 juju-e4d256-prod-github-runner-207 kernel: [32064.633711] Aug 22 14:18:38 juju-e4d256-prod-github-runner-207 kernel: [32092.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 29780s! [qemu-system-x86:6715] Aug 22 14:18:38 juju-e4d256-prod-github-runner-207 kernel: [32092.543111] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 14:18:38 juju-e4d256-prod-github-runner-207 kernel: [32092.543185] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 14:18:38 juju-e4d256-prod-github-runner-207 kernel: [32092.555551] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 14:18:38 juju-e4d256-prod-github-runner-207 kernel: [32092.556866] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 14:18:38 juju-e4d256-prod-github-runner-207 kernel: [32092.558122] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:18:38 juju-e4d256-prod-github-runner-207 kernel: [32092.559193] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 14:18:38 juju-e4d256-prod-github-runner-207 kernel: [32092.561760] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 14:18:38 juju-e4d256-prod-github-runner-207 kernel: [32092.562830] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 14:18:38 juju-e4d256-prod-github-runner-207 kernel: [32092.563992] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 14:18:38 juju-e4d256-prod-github-runner-207 kernel: [32092.565151] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 14:18:38 juju-e4d256-prod-github-runner-207 kernel: [32092.566439] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 14:18:38 juju-e4d256-prod-github-runner-207 kernel: [32092.567687] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 14:18:38 juju-e4d256-prod-github-runner-207 kernel: [32092.568850] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 14:18:38 juju-e4d256-prod-github-runner-207 kernel: [32092.570103] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 14:18:38 juju-e4d256-prod-github-runner-207 kernel: [32092.571198] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 14:18:38 juju-e4d256-prod-github-runner-207 kernel: [32092.572388] Call Trace: Aug 22 14:18:38 juju-e4d256-prod-github-runner-207 kernel: [32092.573314] Aug 22 14:18:38 juju-e4d256-prod-github-runner-207 kernel: [32092.574201] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:18:38 juju-e4d256-prod-github-runner-207 kernel: [32092.575229] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:18:38 juju-e4d256-prod-github-runner-207 kernel: [32092.576252] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:18:38 juju-e4d256-prod-github-runner-207 kernel: [32092.577340] ? show_regs.part.0+0x23/0x29 Aug 22 14:18:38 juju-e4d256-prod-github-runner-207 kernel: [32092.578371] ? show_regs.cold+0x8/0xd Aug 22 14:18:38 juju-e4d256-prod-github-runner-207 kernel: [32092.579343] ? watchdog_timer_fn+0x1be/0x220 Aug 22 14:18:38 juju-e4d256-prod-github-runner-207 kernel: [32092.580350] ? lockup_detector_update_enable+0x60/0x60 Aug 22 14:18:38 juju-e4d256-prod-github-runner-207 kernel: [32092.581424] ? __hrtimer_run_queues+0x107/0x230 Aug 22 14:18:38 juju-e4d256-prod-github-runner-207 kernel: [32092.582465] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 14:18:38 juju-e4d256-prod-github-runner-207 kernel: [32092.583497] ? hrtimer_interrupt+0x101/0x220 Aug 22 14:18:38 juju-e4d256-prod-github-runner-207 kernel: [32092.584550] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 14:18:38 juju-e4d256-prod-github-runner-207 kernel: [32092.585629] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 14:18:38 juju-e4d256-prod-github-runner-207 kernel: [32092.586672] Aug 22 14:18:38 juju-e4d256-prod-github-runner-207 kernel: [32092.587559] Aug 22 14:18:38 juju-e4d256-prod-github-runner-207 kernel: [32092.588403] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 14:18:38 juju-e4d256-prod-github-runner-207 kernel: [32092.589454] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:18:38 juju-e4d256-prod-github-runner-207 kernel: [32092.590497] ? _raw_spin_lock+0x22/0x30 Aug 22 14:18:38 juju-e4d256-prod-github-runner-207 kernel: [32092.591439] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:18:38 juju-e4d256-prod-github-runner-207 kernel: [32092.592470] direct_page_fault+0x206/0x310 [kvm] Aug 22 14:18:38 juju-e4d256-prod-github-runner-207 kernel: [32092.593505] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 14:18:38 juju-e4d256-prod-github-runner-207 kernel: [32092.594531] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 14:18:38 juju-e4d256-prod-github-runner-207 kernel: [32092.595540] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 14:18:38 juju-e4d256-prod-github-runner-207 kernel: [32092.596508] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 14:18:38 juju-e4d256-prod-github-runner-207 kernel: [32092.597459] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 14:18:38 juju-e4d256-prod-github-runner-207 kernel: [32092.598443] handle_exit+0x98/0x230 [kvm_amd] Aug 22 14:18:38 juju-e4d256-prod-github-runner-207 kernel: [32092.599345] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 14:18:38 juju-e4d256-prod-github-runner-207 kernel: [32092.600255] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 14:18:38 juju-e4d256-prod-github-runner-207 kernel: [32092.601177] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 14:18:38 juju-e4d256-prod-github-runner-207 kernel: [32092.602095] vcpu_run+0x62/0x2c0 [kvm] Aug 22 14:18:38 juju-e4d256-prod-github-runner-207 kernel: [32092.602905] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 14:18:38 juju-e4d256-prod-github-runner-207 kernel: [32092.603711] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 14:18:38 juju-e4d256-prod-github-runner-207 kernel: [32092.604563] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 14:18:38 juju-e4d256-prod-github-runner-207 kernel: [32092.605370] ? __seccomp_filter+0x4a/0x4a0 Aug 22 14:18:38 juju-e4d256-prod-github-runner-207 kernel: [32092.606110] ? __fget_files+0x86/0xc0 Aug 22 14:18:38 juju-e4d256-prod-github-runner-207 kernel: [32092.606816] __x64_sys_ioctl+0x95/0xd0 Aug 22 14:18:38 juju-e4d256-prod-github-runner-207 kernel: [32092.607506] do_syscall_64+0x5c/0xc0 Aug 22 14:18:38 juju-e4d256-prod-github-runner-207 kernel: [32092.608169] ? do_futex+0x162/0x1f0 Aug 22 14:18:38 juju-e4d256-prod-github-runner-207 kernel: [32092.608816] ? __x64_sys_futex+0x78/0x1e0 Aug 22 14:18:38 juju-e4d256-prod-github-runner-207 kernel: [32092.609664] ? __secure_computing+0xa9/0x120 Aug 22 14:18:38 juju-e4d256-prod-github-runner-207 kernel: [32092.610357] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 14:18:38 juju-e4d256-prod-github-runner-207 kernel: [32092.611113] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:18:38 juju-e4d256-prod-github-runner-207 kernel: [32092.611832] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:18:38 juju-e4d256-prod-github-runner-207 kernel: [32092.612548] ? do_syscall_64+0x69/0xc0 Aug 22 14:18:38 juju-e4d256-prod-github-runner-207 kernel: [32092.613192] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:18:38 juju-e4d256-prod-github-runner-207 kernel: [32092.613966] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:18:38 juju-e4d256-prod-github-runner-207 kernel: [32092.614659] ? do_syscall_64+0x69/0xc0 Aug 22 14:18:38 juju-e4d256-prod-github-runner-207 kernel: [32092.615282] ? do_syscall_64+0x69/0xc0 Aug 22 14:18:38 juju-e4d256-prod-github-runner-207 kernel: [32092.615908] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 14:18:38 juju-e4d256-prod-github-runner-207 kernel: [32092.616612] RIP: 0033:0x7faa5d0edaff Aug 22 14:18:38 juju-e4d256-prod-github-runner-207 kernel: [32092.617233] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 14:18:38 juju-e4d256-prod-github-runner-207 kernel: [32092.619226] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 14:18:38 juju-e4d256-prod-github-runner-207 kernel: [32092.620133] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 14:18:38 juju-e4d256-prod-github-runner-207 kernel: [32092.621025] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 14:18:38 juju-e4d256-prod-github-runner-207 kernel: [32092.621931] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 14:18:38 juju-e4d256-prod-github-runner-207 kernel: [32092.622837] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 14:18:38 juju-e4d256-prod-github-runner-207 kernel: [32092.623728] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 14:18:38 juju-e4d256-prod-github-runner-207 kernel: [32092.624618] Aug 22 14:19:06 juju-e4d256-prod-github-runner-207 kernel: [32120.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 29806s! [qemu-system-x86:6715] Aug 22 14:19:06 juju-e4d256-prod-github-runner-207 kernel: [32120.543861] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 14:19:06 juju-e4d256-prod-github-runner-207 kernel: [32120.544166] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 14:19:06 juju-e4d256-prod-github-runner-207 kernel: [32120.556651] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 14:19:06 juju-e4d256-prod-github-runner-207 kernel: [32120.557978] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 14:19:06 juju-e4d256-prod-github-runner-207 kernel: [32120.559222] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:19:06 juju-e4d256-prod-github-runner-207 kernel: [32120.560294] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 14:19:06 juju-e4d256-prod-github-runner-207 kernel: [32120.562861] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 14:19:06 juju-e4d256-prod-github-runner-207 kernel: [32120.563909] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 14:19:06 juju-e4d256-prod-github-runner-207 kernel: [32120.565141] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 14:19:06 juju-e4d256-prod-github-runner-207 kernel: [32120.566334] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 14:19:06 juju-e4d256-prod-github-runner-207 kernel: [32120.567502] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 14:19:06 juju-e4d256-prod-github-runner-207 kernel: [32120.568671] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 14:19:06 juju-e4d256-prod-github-runner-207 kernel: [32120.569852] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 14:19:06 juju-e4d256-prod-github-runner-207 kernel: [32120.571086] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 14:19:06 juju-e4d256-prod-github-runner-207 kernel: [32120.572184] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 14:19:06 juju-e4d256-prod-github-runner-207 kernel: [32120.573402] Call Trace: Aug 22 14:19:06 juju-e4d256-prod-github-runner-207 kernel: [32120.574319] Aug 22 14:19:06 juju-e4d256-prod-github-runner-207 kernel: [32120.575215] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:19:06 juju-e4d256-prod-github-runner-207 kernel: [32120.576338] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:19:06 juju-e4d256-prod-github-runner-207 kernel: [32120.577393] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:19:06 juju-e4d256-prod-github-runner-207 kernel: [32120.578526] ? show_regs.part.0+0x23/0x29 Aug 22 14:19:06 juju-e4d256-prod-github-runner-207 kernel: [32120.579540] ? show_regs.cold+0x8/0xd Aug 22 14:19:06 juju-e4d256-prod-github-runner-207 kernel: [32120.580525] ? watchdog_timer_fn+0x1be/0x220 Aug 22 14:19:06 juju-e4d256-prod-github-runner-207 kernel: [32120.581553] ? lockup_detector_update_enable+0x60/0x60 Aug 22 14:19:06 juju-e4d256-prod-github-runner-207 kernel: [32120.582617] ? __hrtimer_run_queues+0x107/0x230 Aug 22 14:19:06 juju-e4d256-prod-github-runner-207 kernel: [32120.583752] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 14:19:06 juju-e4d256-prod-github-runner-207 kernel: [32120.584846] ? hrtimer_interrupt+0x101/0x220 Aug 22 14:19:06 juju-e4d256-prod-github-runner-207 kernel: [32120.585903] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 14:19:06 juju-e4d256-prod-github-runner-207 kernel: [32120.586998] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 14:19:06 juju-e4d256-prod-github-runner-207 kernel: [32120.588083] Aug 22 14:19:06 juju-e4d256-prod-github-runner-207 kernel: [32120.588944] Aug 22 14:19:06 juju-e4d256-prod-github-runner-207 kernel: [32120.589808] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 14:19:06 juju-e4d256-prod-github-runner-207 kernel: [32120.590861] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:19:06 juju-e4d256-prod-github-runner-207 kernel: [32120.591906] ? _raw_spin_lock+0x22/0x30 Aug 22 14:19:06 juju-e4d256-prod-github-runner-207 kernel: [32120.592873] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:19:06 juju-e4d256-prod-github-runner-207 kernel: [32120.593934] direct_page_fault+0x206/0x310 [kvm] Aug 22 14:19:06 juju-e4d256-prod-github-runner-207 kernel: [32120.594980] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 14:19:06 juju-e4d256-prod-github-runner-207 kernel: [32120.595995] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 14:19:06 juju-e4d256-prod-github-runner-207 kernel: [32120.597013] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 14:19:06 juju-e4d256-prod-github-runner-207 kernel: [32120.598067] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 14:19:06 juju-e4d256-prod-github-runner-207 kernel: [32120.599022] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 14:19:06 juju-e4d256-prod-github-runner-207 kernel: [32120.600011] handle_exit+0x98/0x230 [kvm_amd] Aug 22 14:19:06 juju-e4d256-prod-github-runner-207 kernel: [32120.600929] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 14:19:06 juju-e4d256-prod-github-runner-207 kernel: [32120.601870] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 14:19:06 juju-e4d256-prod-github-runner-207 kernel: [32120.602801] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 14:19:06 juju-e4d256-prod-github-runner-207 kernel: [32120.603708] vcpu_run+0x62/0x2c0 [kvm] Aug 22 14:19:06 juju-e4d256-prod-github-runner-207 kernel: [32120.604527] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 14:19:06 juju-e4d256-prod-github-runner-207 kernel: [32120.605374] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 14:19:06 juju-e4d256-prod-github-runner-207 kernel: [32120.606238] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 14:19:06 juju-e4d256-prod-github-runner-207 kernel: [32120.607050] ? __seccomp_filter+0x4a/0x4a0 Aug 22 14:19:06 juju-e4d256-prod-github-runner-207 kernel: [32120.607798] ? __fget_files+0x86/0xc0 Aug 22 14:19:06 juju-e4d256-prod-github-runner-207 kernel: [32120.608543] __x64_sys_ioctl+0x95/0xd0 Aug 22 14:19:06 juju-e4d256-prod-github-runner-207 kernel: [32120.609273] do_syscall_64+0x5c/0xc0 Aug 22 14:19:06 juju-e4d256-prod-github-runner-207 kernel: [32120.609961] ? do_futex+0x162/0x1f0 Aug 22 14:19:06 juju-e4d256-prod-github-runner-207 kernel: [32120.610626] ? __x64_sys_futex+0x78/0x1e0 Aug 22 14:19:06 juju-e4d256-prod-github-runner-207 kernel: [32120.611302] ? __secure_computing+0xa9/0x120 Aug 22 14:19:06 juju-e4d256-prod-github-runner-207 kernel: [32120.611992] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 14:19:06 juju-e4d256-prod-github-runner-207 kernel: [32120.612769] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:19:06 juju-e4d256-prod-github-runner-207 kernel: [32120.613506] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:19:06 juju-e4d256-prod-github-runner-207 kernel: [32120.614237] ? do_syscall_64+0x69/0xc0 Aug 22 14:19:06 juju-e4d256-prod-github-runner-207 kernel: [32120.614905] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:19:06 juju-e4d256-prod-github-runner-207 kernel: [32120.615639] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:19:06 juju-e4d256-prod-github-runner-207 kernel: [32120.616357] ? do_syscall_64+0x69/0xc0 Aug 22 14:19:06 juju-e4d256-prod-github-runner-207 kernel: [32120.617008] ? do_syscall_64+0x69/0xc0 Aug 22 14:19:06 juju-e4d256-prod-github-runner-207 kernel: [32120.617637] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 14:19:06 juju-e4d256-prod-github-runner-207 kernel: [32120.618508] RIP: 0033:0x7faa5d0edaff Aug 22 14:19:06 juju-e4d256-prod-github-runner-207 kernel: [32120.619185] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 14:19:06 juju-e4d256-prod-github-runner-207 kernel: [32120.621197] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 14:19:06 juju-e4d256-prod-github-runner-207 kernel: [32120.622141] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 14:19:06 juju-e4d256-prod-github-runner-207 kernel: [32120.623054] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 14:19:06 juju-e4d256-prod-github-runner-207 kernel: [32120.623966] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 14:19:06 juju-e4d256-prod-github-runner-207 kernel: [32120.624869] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 14:19:06 juju-e4d256-prod-github-runner-207 kernel: [32120.625780] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 14:19:06 juju-e4d256-prod-github-runner-207 kernel: [32120.626683] Aug 22 14:19:34 juju-e4d256-prod-github-runner-207 kernel: [32148.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 29832s! [qemu-system-x86:6715] Aug 22 14:19:34 juju-e4d256-prod-github-runner-207 kernel: [32148.543113] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 14:19:34 juju-e4d256-prod-github-runner-207 kernel: [32148.543188] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 14:19:34 juju-e4d256-prod-github-runner-207 kernel: [32148.555379] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 14:19:34 juju-e4d256-prod-github-runner-207 kernel: [32148.556659] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 14:19:34 juju-e4d256-prod-github-runner-207 kernel: [32148.557885] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:19:34 juju-e4d256-prod-github-runner-207 kernel: [32148.558944] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 14:19:34 juju-e4d256-prod-github-runner-207 kernel: [32148.561533] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 14:19:34 juju-e4d256-prod-github-runner-207 kernel: [32148.562588] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 14:19:34 juju-e4d256-prod-github-runner-207 kernel: [32148.563750] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 14:19:34 juju-e4d256-prod-github-runner-207 kernel: [32148.565045] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 14:19:34 juju-e4d256-prod-github-runner-207 kernel: [32148.566364] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 14:19:34 juju-e4d256-prod-github-runner-207 kernel: [32148.567584] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 14:19:34 juju-e4d256-prod-github-runner-207 kernel: [32148.568871] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 14:19:34 juju-e4d256-prod-github-runner-207 kernel: [32148.570140] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 14:19:34 juju-e4d256-prod-github-runner-207 kernel: [32148.571268] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 14:19:34 juju-e4d256-prod-github-runner-207 kernel: [32148.572495] Call Trace: Aug 22 14:19:34 juju-e4d256-prod-github-runner-207 kernel: [32148.573442] Aug 22 14:19:34 juju-e4d256-prod-github-runner-207 kernel: [32148.574486] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:19:34 juju-e4d256-prod-github-runner-207 kernel: [32148.575523] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:19:34 juju-e4d256-prod-github-runner-207 kernel: [32148.576559] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:19:34 juju-e4d256-prod-github-runner-207 kernel: [32148.577671] ? show_regs.part.0+0x23/0x29 Aug 22 14:19:34 juju-e4d256-prod-github-runner-207 kernel: [32148.578715] ? show_regs.cold+0x8/0xd Aug 22 14:19:34 juju-e4d256-prod-github-runner-207 kernel: [32148.579714] ? watchdog_timer_fn+0x1be/0x220 Aug 22 14:19:34 juju-e4d256-prod-github-runner-207 kernel: [32148.580748] ? lockup_detector_update_enable+0x60/0x60 Aug 22 14:19:34 juju-e4d256-prod-github-runner-207 kernel: [32148.581853] ? __hrtimer_run_queues+0x107/0x230 Aug 22 14:19:34 juju-e4d256-prod-github-runner-207 kernel: [32148.582898] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 14:19:34 juju-e4d256-prod-github-runner-207 kernel: [32148.583925] ? hrtimer_interrupt+0x101/0x220 Aug 22 14:19:34 juju-e4d256-prod-github-runner-207 kernel: [32148.584983] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 14:19:34 juju-e4d256-prod-github-runner-207 kernel: [32148.586060] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 14:19:34 juju-e4d256-prod-github-runner-207 kernel: [32148.587107] Aug 22 14:19:34 juju-e4d256-prod-github-runner-207 kernel: [32148.587965] Aug 22 14:19:34 juju-e4d256-prod-github-runner-207 kernel: [32148.588818] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 14:19:34 juju-e4d256-prod-github-runner-207 kernel: [32148.589860] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:19:34 juju-e4d256-prod-github-runner-207 kernel: [32148.590908] ? _raw_spin_lock+0x22/0x30 Aug 22 14:19:34 juju-e4d256-prod-github-runner-207 kernel: [32148.591860] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:19:34 juju-e4d256-prod-github-runner-207 kernel: [32148.592892] direct_page_fault+0x206/0x310 [kvm] Aug 22 14:19:34 juju-e4d256-prod-github-runner-207 kernel: [32148.593916] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 14:19:34 juju-e4d256-prod-github-runner-207 kernel: [32148.594931] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 14:19:34 juju-e4d256-prod-github-runner-207 kernel: [32148.595933] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 14:19:34 juju-e4d256-prod-github-runner-207 kernel: [32148.596911] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 14:19:34 juju-e4d256-prod-github-runner-207 kernel: [32148.597866] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 14:19:34 juju-e4d256-prod-github-runner-207 kernel: [32148.598878] handle_exit+0x98/0x230 [kvm_amd] Aug 22 14:19:34 juju-e4d256-prod-github-runner-207 kernel: [32148.599801] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 14:19:34 juju-e4d256-prod-github-runner-207 kernel: [32148.600740] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 14:19:34 juju-e4d256-prod-github-runner-207 kernel: [32148.601690] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 14:19:34 juju-e4d256-prod-github-runner-207 kernel: [32148.602844] vcpu_run+0x62/0x2c0 [kvm] Aug 22 14:19:34 juju-e4d256-prod-github-runner-207 kernel: [32148.603689] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 14:19:34 juju-e4d256-prod-github-runner-207 kernel: [32148.604502] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 14:19:34 juju-e4d256-prod-github-runner-207 kernel: [32148.605420] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 14:19:34 juju-e4d256-prod-github-runner-207 kernel: [32148.606232] ? __seccomp_filter+0x4a/0x4a0 Aug 22 14:19:34 juju-e4d256-prod-github-runner-207 kernel: [32148.606980] ? __fget_files+0x86/0xc0 Aug 22 14:19:34 juju-e4d256-prod-github-runner-207 kernel: [32148.607684] __x64_sys_ioctl+0x95/0xd0 Aug 22 14:19:34 juju-e4d256-prod-github-runner-207 kernel: [32148.608388] do_syscall_64+0x5c/0xc0 Aug 22 14:19:34 juju-e4d256-prod-github-runner-207 kernel: [32148.609072] ? do_futex+0x162/0x1f0 Aug 22 14:19:34 juju-e4d256-prod-github-runner-207 kernel: [32148.609724] ? __x64_sys_futex+0x78/0x1e0 Aug 22 14:19:34 juju-e4d256-prod-github-runner-207 kernel: [32148.610398] ? __secure_computing+0xa9/0x120 Aug 22 14:19:34 juju-e4d256-prod-github-runner-207 kernel: [32148.611087] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 14:19:34 juju-e4d256-prod-github-runner-207 kernel: [32148.611854] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:19:34 juju-e4d256-prod-github-runner-207 kernel: [32148.612576] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:19:34 juju-e4d256-prod-github-runner-207 kernel: [32148.613309] ? do_syscall_64+0x69/0xc0 Aug 22 14:19:34 juju-e4d256-prod-github-runner-207 kernel: [32148.613959] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:19:34 juju-e4d256-prod-github-runner-207 kernel: [32148.614662] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:19:34 juju-e4d256-prod-github-runner-207 kernel: [32148.615363] ? do_syscall_64+0x69/0xc0 Aug 22 14:19:34 juju-e4d256-prod-github-runner-207 kernel: [32148.615992] ? do_syscall_64+0x69/0xc0 Aug 22 14:19:34 juju-e4d256-prod-github-runner-207 kernel: [32148.616649] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 14:19:34 juju-e4d256-prod-github-runner-207 kernel: [32148.617383] RIP: 0033:0x7faa5d0edaff Aug 22 14:19:34 juju-e4d256-prod-github-runner-207 kernel: [32148.618057] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 14:19:34 juju-e4d256-prod-github-runner-207 kernel: [32148.620047] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 14:19:34 juju-e4d256-prod-github-runner-207 kernel: [32148.621002] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 14:19:34 juju-e4d256-prod-github-runner-207 kernel: [32148.621924] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 14:19:34 juju-e4d256-prod-github-runner-207 kernel: [32148.622825] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 14:19:34 juju-e4d256-prod-github-runner-207 kernel: [32148.623716] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 14:19:34 juju-e4d256-prod-github-runner-207 kernel: [32148.624609] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 14:19:34 juju-e4d256-prod-github-runner-207 kernel: [32148.625519] Aug 22 14:20:02 juju-e4d256-prod-github-runner-207 kernel: [32176.541980] watchdog: BUG: soft lockup - CPU#1 stuck for 29858s! [qemu-system-x86:6715] Aug 22 14:20:02 juju-e4d256-prod-github-runner-207 kernel: [32176.543105] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 14:20:02 juju-e4d256-prod-github-runner-207 kernel: [32176.543181] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 14:20:02 juju-e4d256-prod-github-runner-207 kernel: [32176.555249] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 14:20:02 juju-e4d256-prod-github-runner-207 kernel: [32176.556546] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 14:20:02 juju-e4d256-prod-github-runner-207 kernel: [32176.557773] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:20:02 juju-e4d256-prod-github-runner-207 kernel: [32176.558837] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 14:20:02 juju-e4d256-prod-github-runner-207 kernel: [32176.561398] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 14:20:02 juju-e4d256-prod-github-runner-207 kernel: [32176.562441] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 14:20:02 juju-e4d256-prod-github-runner-207 kernel: [32176.563603] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 14:20:02 juju-e4d256-prod-github-runner-207 kernel: [32176.564775] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 14:20:02 juju-e4d256-prod-github-runner-207 kernel: [32176.565937] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 14:20:02 juju-e4d256-prod-github-runner-207 kernel: [32176.567105] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 14:20:02 juju-e4d256-prod-github-runner-207 kernel: [32176.568274] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 14:20:02 juju-e4d256-prod-github-runner-207 kernel: [32176.569524] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 14:20:02 juju-e4d256-prod-github-runner-207 kernel: [32176.570620] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 14:20:02 juju-e4d256-prod-github-runner-207 kernel: [32176.571819] Call Trace: Aug 22 14:20:02 juju-e4d256-prod-github-runner-207 kernel: [32176.572761] Aug 22 14:20:02 juju-e4d256-prod-github-runner-207 kernel: [32176.573647] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:20:02 juju-e4d256-prod-github-runner-207 kernel: [32176.574680] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:20:02 juju-e4d256-prod-github-runner-207 kernel: [32176.575698] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:20:02 juju-e4d256-prod-github-runner-207 kernel: [32176.576785] ? show_regs.part.0+0x23/0x29 Aug 22 14:20:02 juju-e4d256-prod-github-runner-207 kernel: [32176.577871] ? show_regs.cold+0x8/0xd Aug 22 14:20:02 juju-e4d256-prod-github-runner-207 kernel: [32176.578846] ? watchdog_timer_fn+0x1be/0x220 Aug 22 14:20:02 juju-e4d256-prod-github-runner-207 kernel: [32176.579858] ? lockup_detector_update_enable+0x60/0x60 Aug 22 14:20:02 juju-e4d256-prod-github-runner-207 kernel: [32176.580937] ? __hrtimer_run_queues+0x107/0x230 Aug 22 14:20:02 juju-e4d256-prod-github-runner-207 kernel: [32176.581966] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 14:20:02 juju-e4d256-prod-github-runner-207 kernel: [32176.582989] ? hrtimer_interrupt+0x101/0x220 Aug 22 14:20:02 juju-e4d256-prod-github-runner-207 kernel: [32176.584007] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 14:20:02 juju-e4d256-prod-github-runner-207 kernel: [32176.585101] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 14:20:02 juju-e4d256-prod-github-runner-207 kernel: [32176.586145] Aug 22 14:20:02 juju-e4d256-prod-github-runner-207 kernel: [32176.586997] Aug 22 14:20:02 juju-e4d256-prod-github-runner-207 kernel: [32176.587835] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 14:20:02 juju-e4d256-prod-github-runner-207 kernel: [32176.588887] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:20:02 juju-e4d256-prod-github-runner-207 kernel: [32176.589933] ? _raw_spin_lock+0x22/0x30 Aug 22 14:20:02 juju-e4d256-prod-github-runner-207 kernel: [32176.590880] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:20:02 juju-e4d256-prod-github-runner-207 kernel: [32176.591923] direct_page_fault+0x206/0x310 [kvm] Aug 22 14:20:02 juju-e4d256-prod-github-runner-207 kernel: [32176.593119] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 14:20:02 juju-e4d256-prod-github-runner-207 kernel: [32176.594135] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 14:20:02 juju-e4d256-prod-github-runner-207 kernel: [32176.595133] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 14:20:02 juju-e4d256-prod-github-runner-207 kernel: [32176.596101] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 14:20:02 juju-e4d256-prod-github-runner-207 kernel: [32176.597052] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 14:20:02 juju-e4d256-prod-github-runner-207 kernel: [32176.598052] handle_exit+0x98/0x230 [kvm_amd] Aug 22 14:20:02 juju-e4d256-prod-github-runner-207 kernel: [32176.598944] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 14:20:02 juju-e4d256-prod-github-runner-207 kernel: [32176.599860] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 14:20:02 juju-e4d256-prod-github-runner-207 kernel: [32176.600796] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 14:20:02 juju-e4d256-prod-github-runner-207 kernel: [32176.601700] vcpu_run+0x62/0x2c0 [kvm] Aug 22 14:20:02 juju-e4d256-prod-github-runner-207 kernel: [32176.602515] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 14:20:02 juju-e4d256-prod-github-runner-207 kernel: [32176.603322] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 14:20:02 juju-e4d256-prod-github-runner-207 kernel: [32176.604182] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 14:20:02 juju-e4d256-prod-github-runner-207 kernel: [32176.605023] ? __seccomp_filter+0x4a/0x4a0 Aug 22 14:20:02 juju-e4d256-prod-github-runner-207 kernel: [32176.605781] ? __fget_files+0x86/0xc0 Aug 22 14:20:02 juju-e4d256-prod-github-runner-207 kernel: [32176.606484] __x64_sys_ioctl+0x95/0xd0 Aug 22 14:20:02 juju-e4d256-prod-github-runner-207 kernel: [32176.607176] do_syscall_64+0x5c/0xc0 Aug 22 14:20:02 juju-e4d256-prod-github-runner-207 kernel: [32176.607840] ? do_futex+0x162/0x1f0 Aug 22 14:20:02 juju-e4d256-prod-github-runner-207 kernel: [32176.608499] ? __x64_sys_futex+0x78/0x1e0 Aug 22 14:20:02 juju-e4d256-prod-github-runner-207 kernel: [32176.609185] ? __secure_computing+0xa9/0x120 Aug 22 14:20:02 juju-e4d256-prod-github-runner-207 kernel: [32176.609886] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 14:20:02 juju-e4d256-prod-github-runner-207 kernel: [32176.610643] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:20:02 juju-e4d256-prod-github-runner-207 kernel: [32176.611362] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:20:02 juju-e4d256-prod-github-runner-207 kernel: [32176.612081] ? do_syscall_64+0x69/0xc0 Aug 22 14:20:02 juju-e4d256-prod-github-runner-207 kernel: [32176.612741] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:20:02 juju-e4d256-prod-github-runner-207 kernel: [32176.613442] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:20:02 juju-e4d256-prod-github-runner-207 kernel: [32176.614134] ? do_syscall_64+0x69/0xc0 Aug 22 14:20:02 juju-e4d256-prod-github-runner-207 kernel: [32176.614755] ? do_syscall_64+0x69/0xc0 Aug 22 14:20:02 juju-e4d256-prod-github-runner-207 kernel: [32176.615376] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 14:20:02 juju-e4d256-prod-github-runner-207 kernel: [32176.616131] RIP: 0033:0x7faa5d0edaff Aug 22 14:20:02 juju-e4d256-prod-github-runner-207 kernel: [32176.616768] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 14:20:02 juju-e4d256-prod-github-runner-207 kernel: [32176.619027] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 14:20:02 juju-e4d256-prod-github-runner-207 kernel: [32176.620234] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 14:20:02 juju-e4d256-prod-github-runner-207 kernel: [32176.621474] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 14:20:02 juju-e4d256-prod-github-runner-207 kernel: [32176.622694] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 14:20:02 juju-e4d256-prod-github-runner-207 kernel: [32176.623996] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 14:20:02 juju-e4d256-prod-github-runner-207 kernel: [32176.625319] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 14:20:02 juju-e4d256-prod-github-runner-207 kernel: [32176.626379] Aug 22 14:20:30 juju-e4d256-prod-github-runner-207 kernel: [32204.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 29884s! [qemu-system-x86:6715] Aug 22 14:20:30 juju-e4d256-prod-github-runner-207 kernel: [32204.543884] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 14:20:30 juju-e4d256-prod-github-runner-207 kernel: [32204.544228] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 14:20:30 juju-e4d256-prod-github-runner-207 kernel: [32204.557183] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 14:20:30 juju-e4d256-prod-github-runner-207 kernel: [32204.558457] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 14:20:30 juju-e4d256-prod-github-runner-207 kernel: [32204.559679] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:20:30 juju-e4d256-prod-github-runner-207 kernel: [32204.560744] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 14:20:30 juju-e4d256-prod-github-runner-207 kernel: [32204.563323] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 14:20:30 juju-e4d256-prod-github-runner-207 kernel: [32204.564401] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 14:20:30 juju-e4d256-prod-github-runner-207 kernel: [32204.565564] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 14:20:30 juju-e4d256-prod-github-runner-207 kernel: [32204.566721] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 14:20:30 juju-e4d256-prod-github-runner-207 kernel: [32204.567923] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 14:20:30 juju-e4d256-prod-github-runner-207 kernel: [32204.569134] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 14:20:30 juju-e4d256-prod-github-runner-207 kernel: [32204.570300] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 14:20:30 juju-e4d256-prod-github-runner-207 kernel: [32204.571545] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 14:20:30 juju-e4d256-prod-github-runner-207 kernel: [32204.572693] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 14:20:30 juju-e4d256-prod-github-runner-207 kernel: [32204.573903] Call Trace: Aug 22 14:20:30 juju-e4d256-prod-github-runner-207 kernel: [32204.574838] Aug 22 14:20:30 juju-e4d256-prod-github-runner-207 kernel: [32204.575766] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:20:30 juju-e4d256-prod-github-runner-207 kernel: [32204.576873] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:20:30 juju-e4d256-prod-github-runner-207 kernel: [32204.577896] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:20:30 juju-e4d256-prod-github-runner-207 kernel: [32204.578992] ? show_regs.part.0+0x23/0x29 Aug 22 14:20:30 juju-e4d256-prod-github-runner-207 kernel: [32204.580003] ? show_regs.cold+0x8/0xd Aug 22 14:20:30 juju-e4d256-prod-github-runner-207 kernel: [32204.580979] ? watchdog_timer_fn+0x1be/0x220 Aug 22 14:20:30 juju-e4d256-prod-github-runner-207 kernel: [32204.581987] ? lockup_detector_update_enable+0x60/0x60 Aug 22 14:20:30 juju-e4d256-prod-github-runner-207 kernel: [32204.583054] ? __hrtimer_run_queues+0x107/0x230 Aug 22 14:20:30 juju-e4d256-prod-github-runner-207 kernel: [32204.584118] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 14:20:30 juju-e4d256-prod-github-runner-207 kernel: [32204.585146] ? hrtimer_interrupt+0x101/0x220 Aug 22 14:20:30 juju-e4d256-prod-github-runner-207 kernel: [32204.586165] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 14:20:30 juju-e4d256-prod-github-runner-207 kernel: [32204.587233] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 14:20:30 juju-e4d256-prod-github-runner-207 kernel: [32204.588292] Aug 22 14:20:30 juju-e4d256-prod-github-runner-207 kernel: [32204.589144] Aug 22 14:20:30 juju-e4d256-prod-github-runner-207 kernel: [32204.590006] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 14:20:30 juju-e4d256-prod-github-runner-207 kernel: [32204.591038] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:20:30 juju-e4d256-prod-github-runner-207 kernel: [32204.592136] ? _raw_spin_lock+0x22/0x30 Aug 22 14:20:30 juju-e4d256-prod-github-runner-207 kernel: [32204.593083] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:20:30 juju-e4d256-prod-github-runner-207 kernel: [32204.594103] direct_page_fault+0x206/0x310 [kvm] Aug 22 14:20:30 juju-e4d256-prod-github-runner-207 kernel: [32204.595144] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 14:20:30 juju-e4d256-prod-github-runner-207 kernel: [32204.596180] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 14:20:30 juju-e4d256-prod-github-runner-207 kernel: [32204.597192] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 14:20:30 juju-e4d256-prod-github-runner-207 kernel: [32204.598223] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 14:20:30 juju-e4d256-prod-github-runner-207 kernel: [32204.599169] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 14:20:30 juju-e4d256-prod-github-runner-207 kernel: [32204.600166] handle_exit+0x98/0x230 [kvm_amd] Aug 22 14:20:30 juju-e4d256-prod-github-runner-207 kernel: [32204.601055] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 14:20:30 juju-e4d256-prod-github-runner-207 kernel: [32204.601968] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 14:20:30 juju-e4d256-prod-github-runner-207 kernel: [32204.602889] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 14:20:30 juju-e4d256-prod-github-runner-207 kernel: [32204.603794] vcpu_run+0x62/0x2c0 [kvm] Aug 22 14:20:30 juju-e4d256-prod-github-runner-207 kernel: [32204.604630] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 14:20:30 juju-e4d256-prod-github-runner-207 kernel: [32204.605452] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 14:20:30 juju-e4d256-prod-github-runner-207 kernel: [32204.606306] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 14:20:30 juju-e4d256-prod-github-runner-207 kernel: [32204.607102] ? __seccomp_filter+0x4a/0x4a0 Aug 22 14:20:30 juju-e4d256-prod-github-runner-207 kernel: [32204.607868] ? __fget_files+0x86/0xc0 Aug 22 14:20:30 juju-e4d256-prod-github-runner-207 kernel: [32204.608593] __x64_sys_ioctl+0x95/0xd0 Aug 22 14:20:30 juju-e4d256-prod-github-runner-207 kernel: [32204.609285] do_syscall_64+0x5c/0xc0 Aug 22 14:20:30 juju-e4d256-prod-github-runner-207 kernel: [32204.609948] ? do_futex+0x162/0x1f0 Aug 22 14:20:30 juju-e4d256-prod-github-runner-207 kernel: [32204.610600] ? __x64_sys_futex+0x78/0x1e0 Aug 22 14:20:30 juju-e4d256-prod-github-runner-207 kernel: [32204.611271] ? __secure_computing+0xa9/0x120 Aug 22 14:20:30 juju-e4d256-prod-github-runner-207 kernel: [32204.611967] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 14:20:30 juju-e4d256-prod-github-runner-207 kernel: [32204.612725] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:20:30 juju-e4d256-prod-github-runner-207 kernel: [32204.613445] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:20:30 juju-e4d256-prod-github-runner-207 kernel: [32204.614159] ? do_syscall_64+0x69/0xc0 Aug 22 14:20:30 juju-e4d256-prod-github-runner-207 kernel: [32204.614905] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:20:30 juju-e4d256-prod-github-runner-207 kernel: [32204.615619] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:20:30 juju-e4d256-prod-github-runner-207 kernel: [32204.616329] ? do_syscall_64+0x69/0xc0 Aug 22 14:20:30 juju-e4d256-prod-github-runner-207 kernel: [32204.616959] ? do_syscall_64+0x69/0xc0 Aug 22 14:20:30 juju-e4d256-prod-github-runner-207 kernel: [32204.617580] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 14:20:30 juju-e4d256-prod-github-runner-207 kernel: [32204.618282] RIP: 0033:0x7faa5d0edaff Aug 22 14:20:30 juju-e4d256-prod-github-runner-207 kernel: [32204.618947] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 14:20:30 juju-e4d256-prod-github-runner-207 kernel: [32204.620959] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 14:20:30 juju-e4d256-prod-github-runner-207 kernel: [32204.621872] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 14:20:30 juju-e4d256-prod-github-runner-207 kernel: [32204.622759] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 14:20:30 juju-e4d256-prod-github-runner-207 kernel: [32204.623646] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 14:20:30 juju-e4d256-prod-github-runner-207 kernel: [32204.624540] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 14:20:30 juju-e4d256-prod-github-runner-207 kernel: [32204.625433] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 14:20:30 juju-e4d256-prod-github-runner-207 kernel: [32204.626329] Aug 22 14:20:45 juju-e4d256-prod-github-runner-207 kernel: [32219.336706] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 14:20:45 juju-e4d256-prod-github-runner-207 kernel: [32219.338480] rcu: 1-....: (8000496 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=3865872 Aug 22 14:20:45 juju-e4d256-prod-github-runner-207 kernel: [32219.339600] (t=8025534 jiffies g=23269 q=35079) Aug 22 14:20:45 juju-e4d256-prod-github-runner-207 kernel: [32219.340395] NMI backtrace for cpu 1 Aug 22 14:20:45 juju-e4d256-prod-github-runner-207 kernel: [32219.341149] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 14:20:45 juju-e4d256-prod-github-runner-207 kernel: [32219.342266] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 14:20:45 juju-e4d256-prod-github-runner-207 kernel: [32219.343334] Call Trace: Aug 22 14:20:45 juju-e4d256-prod-github-runner-207 kernel: [32219.344022] Aug 22 14:20:45 juju-e4d256-prod-github-runner-207 kernel: [32219.344684] show_stack+0x52/0x5c Aug 22 14:20:45 juju-e4d256-prod-github-runner-207 kernel: [32219.345407] dump_stack_lvl+0x4a/0x63 Aug 22 14:20:45 juju-e4d256-prod-github-runner-207 kernel: [32219.346150] dump_stack+0x10/0x16 Aug 22 14:20:45 juju-e4d256-prod-github-runner-207 kernel: [32219.346873] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 14:20:45 juju-e4d256-prod-github-runner-207 kernel: [32219.347671] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 14:20:45 juju-e4d256-prod-github-runner-207 kernel: [32219.348458] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 14:20:45 juju-e4d256-prod-github-runner-207 kernel: [32219.349279] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 14:20:45 juju-e4d256-prod-github-runner-207 kernel: [32219.350093] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 14:20:45 juju-e4d256-prod-github-runner-207 kernel: [32219.350897] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 14:20:45 juju-e4d256-prod-github-runner-207 kernel: [32219.351671] print_cpu_stall.cold+0x2f/0xe2 Aug 22 14:20:45 juju-e4d256-prod-github-runner-207 kernel: [32219.352444] ? timekeeping_update+0xf7/0x150 Aug 22 14:20:45 juju-e4d256-prod-github-runner-207 kernel: [32219.353212] check_cpu_stall+0x109/0x270 Aug 22 14:20:45 juju-e4d256-prod-github-runner-207 kernel: [32219.353955] rcu_sched_clock_irq+0x9a/0x250 Aug 22 14:20:45 juju-e4d256-prod-github-runner-207 kernel: [32219.354717] update_process_times+0x94/0xd0 Aug 22 14:20:45 juju-e4d256-prod-github-runner-207 kernel: [32219.355474] tick_sched_handle+0x29/0x70 Aug 22 14:20:45 juju-e4d256-prod-github-runner-207 kernel: [32219.356227] tick_sched_timer+0x8c/0xc0 Aug 22 14:20:45 juju-e4d256-prod-github-runner-207 kernel: [32219.356996] ? tick_nohz_handler+0xb0/0xb0 Aug 22 14:20:45 juju-e4d256-prod-github-runner-207 kernel: [32219.357754] __hrtimer_run_queues+0x107/0x230 Aug 22 14:20:45 juju-e4d256-prod-github-runner-207 kernel: [32219.358532] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 14:20:45 juju-e4d256-prod-github-runner-207 kernel: [32219.359306] hrtimer_interrupt+0x101/0x220 Aug 22 14:20:45 juju-e4d256-prod-github-runner-207 kernel: [32219.360087] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 14:20:45 juju-e4d256-prod-github-runner-207 kernel: [32219.361001] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 14:20:45 juju-e4d256-prod-github-runner-207 kernel: [32219.361811] Aug 22 14:20:45 juju-e4d256-prod-github-runner-207 kernel: [32219.362445] Aug 22 14:20:45 juju-e4d256-prod-github-runner-207 kernel: [32219.363071] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 14:20:45 juju-e4d256-prod-github-runner-207 kernel: [32219.363916] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:20:45 juju-e4d256-prod-github-runner-207 kernel: [32219.364835] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 14:20:45 juju-e4d256-prod-github-runner-207 kernel: [32219.367055] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 14:20:45 juju-e4d256-prod-github-runner-207 kernel: [32219.367948] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 14:20:45 juju-e4d256-prod-github-runner-207 kernel: [32219.368940] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 14:20:45 juju-e4d256-prod-github-runner-207 kernel: [32219.369916] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 14:20:45 juju-e4d256-prod-github-runner-207 kernel: [32219.370876] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 14:20:45 juju-e4d256-prod-github-runner-207 kernel: [32219.371837] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 14:20:45 juju-e4d256-prod-github-runner-207 kernel: [32219.372795] ? _raw_spin_lock+0x22/0x30 Aug 22 14:20:45 juju-e4d256-prod-github-runner-207 kernel: [32219.373563] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:20:45 juju-e4d256-prod-github-runner-207 kernel: [32219.374411] direct_page_fault+0x206/0x310 [kvm] Aug 22 14:20:45 juju-e4d256-prod-github-runner-207 kernel: [32219.375247] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 14:20:45 juju-e4d256-prod-github-runner-207 kernel: [32219.376088] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 14:20:45 juju-e4d256-prod-github-runner-207 kernel: [32219.376942] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 14:20:45 juju-e4d256-prod-github-runner-207 kernel: [32219.377766] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 14:20:45 juju-e4d256-prod-github-runner-207 kernel: [32219.378550] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 14:20:45 juju-e4d256-prod-github-runner-207 kernel: [32219.379371] handle_exit+0x98/0x230 [kvm_amd] Aug 22 14:20:45 juju-e4d256-prod-github-runner-207 kernel: [32219.380143] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 14:20:45 juju-e4d256-prod-github-runner-207 kernel: [32219.380931] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 14:20:45 juju-e4d256-prod-github-runner-207 kernel: [32219.381728] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 14:20:45 juju-e4d256-prod-github-runner-207 kernel: [32219.382511] vcpu_run+0x62/0x2c0 [kvm] Aug 22 14:20:45 juju-e4d256-prod-github-runner-207 kernel: [32219.383226] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 14:20:45 juju-e4d256-prod-github-runner-207 kernel: [32219.383973] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 14:20:45 juju-e4d256-prod-github-runner-207 kernel: [32219.384779] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 14:20:45 juju-e4d256-prod-github-runner-207 kernel: [32219.385545] ? __seccomp_filter+0x4a/0x4a0 Aug 22 14:20:45 juju-e4d256-prod-github-runner-207 kernel: [32219.386265] ? __fget_files+0x86/0xc0 Aug 22 14:20:45 juju-e4d256-prod-github-runner-207 kernel: [32219.386962] __x64_sys_ioctl+0x95/0xd0 Aug 22 14:20:45 juju-e4d256-prod-github-runner-207 kernel: [32219.387675] do_syscall_64+0x5c/0xc0 Aug 22 14:20:45 juju-e4d256-prod-github-runner-207 kernel: [32219.388369] ? do_futex+0x162/0x1f0 Aug 22 14:20:45 juju-e4d256-prod-github-runner-207 kernel: [32219.389040] ? __x64_sys_futex+0x78/0x1e0 Aug 22 14:20:45 juju-e4d256-prod-github-runner-207 kernel: [32219.389747] ? __secure_computing+0xa9/0x120 Aug 22 14:20:45 juju-e4d256-prod-github-runner-207 kernel: [32219.390461] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 14:20:45 juju-e4d256-prod-github-runner-207 kernel: [32219.391250] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:20:45 juju-e4d256-prod-github-runner-207 kernel: [32219.392031] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:20:45 juju-e4d256-prod-github-runner-207 kernel: [32219.392788] ? do_syscall_64+0x69/0xc0 Aug 22 14:20:45 juju-e4d256-prod-github-runner-207 kernel: [32219.393475] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:20:45 juju-e4d256-prod-github-runner-207 kernel: [32219.394243] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:20:45 juju-e4d256-prod-github-runner-207 kernel: [32219.395007] ? do_syscall_64+0x69/0xc0 Aug 22 14:20:45 juju-e4d256-prod-github-runner-207 kernel: [32219.395698] ? do_syscall_64+0x69/0xc0 Aug 22 14:20:45 juju-e4d256-prod-github-runner-207 kernel: [32219.396403] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 14:20:45 juju-e4d256-prod-github-runner-207 kernel: [32219.397176] RIP: 0033:0x7faa5d0edaff Aug 22 14:20:45 juju-e4d256-prod-github-runner-207 kernel: [32219.397882] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 14:20:45 juju-e4d256-prod-github-runner-207 kernel: [32219.400005] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 14:20:45 juju-e4d256-prod-github-runner-207 kernel: [32219.400966] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 14:20:45 juju-e4d256-prod-github-runner-207 kernel: [32219.401911] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 14:20:45 juju-e4d256-prod-github-runner-207 kernel: [32219.402885] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 14:20:45 juju-e4d256-prod-github-runner-207 kernel: [32219.403838] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 14:20:45 juju-e4d256-prod-github-runner-207 kernel: [32219.404757] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 14:20:45 juju-e4d256-prod-github-runner-207 kernel: [32219.405665] Aug 22 14:21:10 juju-e4d256-prod-github-runner-207 kernel: [32244.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 29922s! [qemu-system-x86:6715] Aug 22 14:21:10 juju-e4d256-prod-github-runner-207 kernel: [32244.544005] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 14:21:10 juju-e4d256-prod-github-runner-207 kernel: [32244.544296] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 14:21:10 juju-e4d256-prod-github-runner-207 kernel: [32244.559016] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 14:21:10 juju-e4d256-prod-github-runner-207 kernel: [32244.560477] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 14:21:10 juju-e4d256-prod-github-runner-207 kernel: [32244.561860] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:21:10 juju-e4d256-prod-github-runner-207 kernel: [32244.563028] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 14:21:10 juju-e4d256-prod-github-runner-207 kernel: [32244.565914] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 14:21:10 juju-e4d256-prod-github-runner-207 kernel: [32244.567078] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 14:21:10 juju-e4d256-prod-github-runner-207 kernel: [32244.568400] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 14:21:10 juju-e4d256-prod-github-runner-207 kernel: [32244.569698] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 14:21:10 juju-e4d256-prod-github-runner-207 kernel: [32244.571018] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 14:21:10 juju-e4d256-prod-github-runner-207 kernel: [32244.572354] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 14:21:10 juju-e4d256-prod-github-runner-207 kernel: [32244.573686] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 14:21:10 juju-e4d256-prod-github-runner-207 kernel: [32244.575094] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 14:21:10 juju-e4d256-prod-github-runner-207 kernel: [32244.576681] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 14:21:10 juju-e4d256-prod-github-runner-207 kernel: [32244.578552] Call Trace: Aug 22 14:21:10 juju-e4d256-prod-github-runner-207 kernel: [32244.579540] Aug 22 14:21:10 juju-e4d256-prod-github-runner-207 kernel: [32244.580549] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:21:10 juju-e4d256-prod-github-runner-207 kernel: [32244.581746] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:21:10 juju-e4d256-prod-github-runner-207 kernel: [32244.582876] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:21:10 juju-e4d256-prod-github-runner-207 kernel: [32244.584112] ? show_regs.part.0+0x23/0x29 Aug 22 14:21:10 juju-e4d256-prod-github-runner-207 kernel: [32244.585207] ? show_regs.cold+0x8/0xd Aug 22 14:21:10 juju-e4d256-prod-github-runner-207 kernel: [32244.586263] ? watchdog_timer_fn+0x1be/0x220 Aug 22 14:21:10 juju-e4d256-prod-github-runner-207 kernel: [32244.587370] ? lockup_detector_update_enable+0x60/0x60 Aug 22 14:21:10 juju-e4d256-prod-github-runner-207 kernel: [32244.588560] ? __hrtimer_run_queues+0x107/0x230 Aug 22 14:21:10 juju-e4d256-prod-github-runner-207 kernel: [32244.589716] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 14:21:10 juju-e4d256-prod-github-runner-207 kernel: [32244.590847] ? hrtimer_interrupt+0x101/0x220 Aug 22 14:21:10 juju-e4d256-prod-github-runner-207 kernel: [32244.591978] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 14:21:10 juju-e4d256-prod-github-runner-207 kernel: [32244.593158] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 14:21:10 juju-e4d256-prod-github-runner-207 kernel: [32244.594302] Aug 22 14:21:10 juju-e4d256-prod-github-runner-207 kernel: [32244.595203] Aug 22 14:21:10 juju-e4d256-prod-github-runner-207 kernel: [32244.596117] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 14:21:10 juju-e4d256-prod-github-runner-207 kernel: [32244.597256] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:21:10 juju-e4d256-prod-github-runner-207 kernel: [32244.598403] ? _raw_spin_lock+0x22/0x30 Aug 22 14:21:10 juju-e4d256-prod-github-runner-207 kernel: [32244.599493] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:21:10 juju-e4d256-prod-github-runner-207 kernel: [32244.600614] direct_page_fault+0x206/0x310 [kvm] Aug 22 14:21:10 juju-e4d256-prod-github-runner-207 kernel: [32244.601741] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 14:21:10 juju-e4d256-prod-github-runner-207 kernel: [32244.602852] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 14:21:10 juju-e4d256-prod-github-runner-207 kernel: [32244.603976] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 14:21:10 juju-e4d256-prod-github-runner-207 kernel: [32244.605089] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 14:21:10 juju-e4d256-prod-github-runner-207 kernel: [32244.606128] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 14:21:10 juju-e4d256-prod-github-runner-207 kernel: [32244.607261] handle_exit+0x98/0x230 [kvm_amd] Aug 22 14:21:10 juju-e4d256-prod-github-runner-207 kernel: [32244.608258] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 14:21:10 juju-e4d256-prod-github-runner-207 kernel: [32244.609265] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 14:21:10 juju-e4d256-prod-github-runner-207 kernel: [32244.610305] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 14:21:10 juju-e4d256-prod-github-runner-207 kernel: [32244.611318] vcpu_run+0x62/0x2c0 [kvm] Aug 22 14:21:10 juju-e4d256-prod-github-runner-207 kernel: [32244.612232] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 14:21:10 juju-e4d256-prod-github-runner-207 kernel: [32244.613131] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 14:21:10 juju-e4d256-prod-github-runner-207 kernel: [32244.614092] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 14:21:10 juju-e4d256-prod-github-runner-207 kernel: [32244.614980] ? __seccomp_filter+0x4a/0x4a0 Aug 22 14:21:10 juju-e4d256-prod-github-runner-207 kernel: [32244.615826] ? __fget_files+0x86/0xc0 Aug 22 14:21:10 juju-e4d256-prod-github-runner-207 kernel: [32244.616609] __x64_sys_ioctl+0x95/0xd0 Aug 22 14:21:10 juju-e4d256-prod-github-runner-207 kernel: [32244.617393] do_syscall_64+0x5c/0xc0 Aug 22 14:21:10 juju-e4d256-prod-github-runner-207 kernel: [32244.618097] ? do_futex+0x162/0x1f0 Aug 22 14:21:10 juju-e4d256-prod-github-runner-207 kernel: [32244.618753] ? __x64_sys_futex+0x78/0x1e0 Aug 22 14:21:10 juju-e4d256-prod-github-runner-207 kernel: [32244.619561] ? __secure_computing+0xa9/0x120 Aug 22 14:21:10 juju-e4d256-prod-github-runner-207 kernel: [32244.620348] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 14:21:10 juju-e4d256-prod-github-runner-207 kernel: [32244.621218] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:21:10 juju-e4d256-prod-github-runner-207 kernel: [32244.622046] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:21:10 juju-e4d256-prod-github-runner-207 kernel: [32244.622863] ? do_syscall_64+0x69/0xc0 Aug 22 14:21:10 juju-e4d256-prod-github-runner-207 kernel: [32244.623646] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:21:10 juju-e4d256-prod-github-runner-207 kernel: [32244.624451] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:21:10 juju-e4d256-prod-github-runner-207 kernel: [32244.625245] ? do_syscall_64+0x69/0xc0 Aug 22 14:21:10 juju-e4d256-prod-github-runner-207 kernel: [32244.625951] ? do_syscall_64+0x69/0xc0 Aug 22 14:21:10 juju-e4d256-prod-github-runner-207 kernel: [32244.626656] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 14:21:10 juju-e4d256-prod-github-runner-207 kernel: [32244.627476] RIP: 0033:0x7faa5d0edaff Aug 22 14:21:10 juju-e4d256-prod-github-runner-207 kernel: [32244.628216] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 14:21:10 juju-e4d256-prod-github-runner-207 kernel: [32244.630752] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 14:21:10 juju-e4d256-prod-github-runner-207 kernel: [32244.632031] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 14:21:10 juju-e4d256-prod-github-runner-207 kernel: [32244.633254] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 14:21:10 juju-e4d256-prod-github-runner-207 kernel: [32244.634490] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 14:21:10 juju-e4d256-prod-github-runner-207 kernel: [32244.635744] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 14:21:10 juju-e4d256-prod-github-runner-207 kernel: [32244.637006] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 14:21:10 juju-e4d256-prod-github-runner-207 kernel: [32244.638280] Aug 22 14:21:38 juju-e4d256-prod-github-runner-207 kernel: [32272.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 29948s! [qemu-system-x86:6715] Aug 22 14:21:38 juju-e4d256-prod-github-runner-207 kernel: [32272.543935] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 14:21:38 juju-e4d256-prod-github-runner-207 kernel: [32272.544297] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 14:21:38 juju-e4d256-prod-github-runner-207 kernel: [32272.556573] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 14:21:38 juju-e4d256-prod-github-runner-207 kernel: [32272.557838] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 14:21:38 juju-e4d256-prod-github-runner-207 kernel: [32272.559058] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:21:38 juju-e4d256-prod-github-runner-207 kernel: [32272.560141] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 14:21:38 juju-e4d256-prod-github-runner-207 kernel: [32272.562716] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 14:21:38 juju-e4d256-prod-github-runner-207 kernel: [32272.563808] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 14:21:38 juju-e4d256-prod-github-runner-207 kernel: [32272.565049] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 14:21:38 juju-e4d256-prod-github-runner-207 kernel: [32272.566227] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 14:21:38 juju-e4d256-prod-github-runner-207 kernel: [32272.567394] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 14:21:38 juju-e4d256-prod-github-runner-207 kernel: [32272.568571] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 14:21:38 juju-e4d256-prod-github-runner-207 kernel: [32272.569737] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 14:21:38 juju-e4d256-prod-github-runner-207 kernel: [32272.570967] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 14:21:38 juju-e4d256-prod-github-runner-207 kernel: [32272.572074] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 14:21:38 juju-e4d256-prod-github-runner-207 kernel: [32272.573273] Call Trace: Aug 22 14:21:38 juju-e4d256-prod-github-runner-207 kernel: [32272.574202] Aug 22 14:21:38 juju-e4d256-prod-github-runner-207 kernel: [32272.575105] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:21:38 juju-e4d256-prod-github-runner-207 kernel: [32272.576177] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:21:38 juju-e4d256-prod-github-runner-207 kernel: [32272.577349] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:21:38 juju-e4d256-prod-github-runner-207 kernel: [32272.578448] ? show_regs.part.0+0x23/0x29 Aug 22 14:21:38 juju-e4d256-prod-github-runner-207 kernel: [32272.579530] ? show_regs.cold+0x8/0xd Aug 22 14:21:38 juju-e4d256-prod-github-runner-207 kernel: [32272.580509] ? watchdog_timer_fn+0x1be/0x220 Aug 22 14:21:38 juju-e4d256-prod-github-runner-207 kernel: [32272.581519] ? lockup_detector_update_enable+0x60/0x60 Aug 22 14:21:38 juju-e4d256-prod-github-runner-207 kernel: [32272.582581] ? __hrtimer_run_queues+0x107/0x230 Aug 22 14:21:38 juju-e4d256-prod-github-runner-207 kernel: [32272.583621] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 14:21:38 juju-e4d256-prod-github-runner-207 kernel: [32272.584645] ? hrtimer_interrupt+0x101/0x220 Aug 22 14:21:38 juju-e4d256-prod-github-runner-207 kernel: [32272.585661] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 14:21:38 juju-e4d256-prod-github-runner-207 kernel: [32272.586728] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 14:21:38 juju-e4d256-prod-github-runner-207 kernel: [32272.587847] Aug 22 14:21:38 juju-e4d256-prod-github-runner-207 kernel: [32272.588702] Aug 22 14:21:38 juju-e4d256-prod-github-runner-207 kernel: [32272.589544] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 14:21:38 juju-e4d256-prod-github-runner-207 kernel: [32272.590576] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:21:38 juju-e4d256-prod-github-runner-207 kernel: [32272.591622] ? _raw_spin_lock+0x22/0x30 Aug 22 14:21:38 juju-e4d256-prod-github-runner-207 kernel: [32272.592573] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:21:38 juju-e4d256-prod-github-runner-207 kernel: [32272.593591] direct_page_fault+0x206/0x310 [kvm] Aug 22 14:21:38 juju-e4d256-prod-github-runner-207 kernel: [32272.594614] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 14:21:38 juju-e4d256-prod-github-runner-207 kernel: [32272.595652] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 14:21:38 juju-e4d256-prod-github-runner-207 kernel: [32272.596672] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 14:21:38 juju-e4d256-prod-github-runner-207 kernel: [32272.597681] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 14:21:38 juju-e4d256-prod-github-runner-207 kernel: [32272.598631] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 14:21:38 juju-e4d256-prod-github-runner-207 kernel: [32272.599631] handle_exit+0x98/0x230 [kvm_amd] Aug 22 14:21:38 juju-e4d256-prod-github-runner-207 kernel: [32272.600522] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 14:21:38 juju-e4d256-prod-github-runner-207 kernel: [32272.601434] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 14:21:38 juju-e4d256-prod-github-runner-207 kernel: [32272.602360] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 14:21:38 juju-e4d256-prod-github-runner-207 kernel: [32272.603285] vcpu_run+0x62/0x2c0 [kvm] Aug 22 14:21:38 juju-e4d256-prod-github-runner-207 kernel: [32272.604095] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 14:21:38 juju-e4d256-prod-github-runner-207 kernel: [32272.604902] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 14:21:38 juju-e4d256-prod-github-runner-207 kernel: [32272.605755] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 14:21:38 juju-e4d256-prod-github-runner-207 kernel: [32272.606550] ? __seccomp_filter+0x4a/0x4a0 Aug 22 14:21:38 juju-e4d256-prod-github-runner-207 kernel: [32272.607301] ? __fget_files+0x86/0xc0 Aug 22 14:21:38 juju-e4d256-prod-github-runner-207 kernel: [32272.608004] __x64_sys_ioctl+0x95/0xd0 Aug 22 14:21:38 juju-e4d256-prod-github-runner-207 kernel: [32272.608695] do_syscall_64+0x5c/0xc0 Aug 22 14:21:38 juju-e4d256-prod-github-runner-207 kernel: [32272.609359] ? do_futex+0x162/0x1f0 Aug 22 14:21:38 juju-e4d256-prod-github-runner-207 kernel: [32272.610017] ? __x64_sys_futex+0x78/0x1e0 Aug 22 14:21:38 juju-e4d256-prod-github-runner-207 kernel: [32272.610743] ? __secure_computing+0xa9/0x120 Aug 22 14:21:38 juju-e4d256-prod-github-runner-207 kernel: [32272.611475] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 14:21:38 juju-e4d256-prod-github-runner-207 kernel: [32272.612289] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:21:38 juju-e4d256-prod-github-runner-207 kernel: [32272.613012] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:21:38 juju-e4d256-prod-github-runner-207 kernel: [32272.613729] ? do_syscall_64+0x69/0xc0 Aug 22 14:21:38 juju-e4d256-prod-github-runner-207 kernel: [32272.614378] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:21:38 juju-e4d256-prod-github-runner-207 kernel: [32272.615091] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:21:38 juju-e4d256-prod-github-runner-207 kernel: [32272.615824] ? do_syscall_64+0x69/0xc0 Aug 22 14:21:38 juju-e4d256-prod-github-runner-207 kernel: [32272.616454] ? do_syscall_64+0x69/0xc0 Aug 22 14:21:38 juju-e4d256-prod-github-runner-207 kernel: [32272.617121] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 14:21:38 juju-e4d256-prod-github-runner-207 kernel: [32272.617826] RIP: 0033:0x7faa5d0edaff Aug 22 14:21:38 juju-e4d256-prod-github-runner-207 kernel: [32272.618507] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 14:21:38 juju-e4d256-prod-github-runner-207 kernel: [32272.620507] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 14:21:38 juju-e4d256-prod-github-runner-207 kernel: [32272.621420] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 14:21:38 juju-e4d256-prod-github-runner-207 kernel: [32272.622315] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 14:21:38 juju-e4d256-prod-github-runner-207 kernel: [32272.623212] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 14:21:38 juju-e4d256-prod-github-runner-207 kernel: [32272.624102] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 14:21:38 juju-e4d256-prod-github-runner-207 kernel: [32272.624988] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 14:21:38 juju-e4d256-prod-github-runner-207 kernel: [32272.625895] Aug 22 14:22:06 juju-e4d256-prod-github-runner-207 kernel: [32300.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 29974s! [qemu-system-x86:6715] Aug 22 14:22:06 juju-e4d256-prod-github-runner-207 kernel: [32300.543906] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 14:22:06 juju-e4d256-prod-github-runner-207 kernel: [32300.544216] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 14:22:06 juju-e4d256-prod-github-runner-207 kernel: [32300.556334] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 14:22:06 juju-e4d256-prod-github-runner-207 kernel: [32300.557604] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 14:22:06 juju-e4d256-prod-github-runner-207 kernel: [32300.558845] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:22:06 juju-e4d256-prod-github-runner-207 kernel: [32300.559912] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 14:22:06 juju-e4d256-prod-github-runner-207 kernel: [32300.562464] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 14:22:06 juju-e4d256-prod-github-runner-207 kernel: [32300.563517] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 14:22:06 juju-e4d256-prod-github-runner-207 kernel: [32300.564705] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 14:22:06 juju-e4d256-prod-github-runner-207 kernel: [32300.565882] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 14:22:06 juju-e4d256-prod-github-runner-207 kernel: [32300.567075] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 14:22:06 juju-e4d256-prod-github-runner-207 kernel: [32300.568289] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 14:22:06 juju-e4d256-prod-github-runner-207 kernel: [32300.569490] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 14:22:06 juju-e4d256-prod-github-runner-207 kernel: [32300.570725] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 14:22:06 juju-e4d256-prod-github-runner-207 kernel: [32300.571833] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 14:22:06 juju-e4d256-prod-github-runner-207 kernel: [32300.573025] Call Trace: Aug 22 14:22:06 juju-e4d256-prod-github-runner-207 kernel: [32300.573939] Aug 22 14:22:06 juju-e4d256-prod-github-runner-207 kernel: [32300.574848] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:22:06 juju-e4d256-prod-github-runner-207 kernel: [32300.575888] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:22:06 juju-e4d256-prod-github-runner-207 kernel: [32300.576926] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:22:06 juju-e4d256-prod-github-runner-207 kernel: [32300.578055] ? show_regs.part.0+0x23/0x29 Aug 22 14:22:06 juju-e4d256-prod-github-runner-207 kernel: [32300.579097] ? show_regs.cold+0x8/0xd Aug 22 14:22:06 juju-e4d256-prod-github-runner-207 kernel: [32300.580090] ? watchdog_timer_fn+0x1be/0x220 Aug 22 14:22:06 juju-e4d256-prod-github-runner-207 kernel: [32300.581130] ? lockup_detector_update_enable+0x60/0x60 Aug 22 14:22:06 juju-e4d256-prod-github-runner-207 kernel: [32300.582208] ? __hrtimer_run_queues+0x107/0x230 Aug 22 14:22:06 juju-e4d256-prod-github-runner-207 kernel: [32300.583297] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 14:22:06 juju-e4d256-prod-github-runner-207 kernel: [32300.584325] ? hrtimer_interrupt+0x101/0x220 Aug 22 14:22:06 juju-e4d256-prod-github-runner-207 kernel: [32300.585340] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 14:22:06 juju-e4d256-prod-github-runner-207 kernel: [32300.586410] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 14:22:06 juju-e4d256-prod-github-runner-207 kernel: [32300.587467] Aug 22 14:22:06 juju-e4d256-prod-github-runner-207 kernel: [32300.588321] Aug 22 14:22:06 juju-e4d256-prod-github-runner-207 kernel: [32300.589158] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 14:22:06 juju-e4d256-prod-github-runner-207 kernel: [32300.590193] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:22:06 juju-e4d256-prod-github-runner-207 kernel: [32300.591236] ? _raw_spin_lock+0x22/0x30 Aug 22 14:22:06 juju-e4d256-prod-github-runner-207 kernel: [32300.592184] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:22:06 juju-e4d256-prod-github-runner-207 kernel: [32300.593206] direct_page_fault+0x206/0x310 [kvm] Aug 22 14:22:06 juju-e4d256-prod-github-runner-207 kernel: [32300.594232] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 14:22:06 juju-e4d256-prod-github-runner-207 kernel: [32300.595249] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 14:22:06 juju-e4d256-prod-github-runner-207 kernel: [32300.596253] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 14:22:06 juju-e4d256-prod-github-runner-207 kernel: [32300.597262] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 14:22:06 juju-e4d256-prod-github-runner-207 kernel: [32300.598212] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 14:22:06 juju-e4d256-prod-github-runner-207 kernel: [32300.599213] handle_exit+0x98/0x230 [kvm_amd] Aug 22 14:22:06 juju-e4d256-prod-github-runner-207 kernel: [32300.600108] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 14:22:06 juju-e4d256-prod-github-runner-207 kernel: [32300.601028] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 14:22:06 juju-e4d256-prod-github-runner-207 kernel: [32300.601954] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 14:22:06 juju-e4d256-prod-github-runner-207 kernel: [32300.602873] vcpu_run+0x62/0x2c0 [kvm] Aug 22 14:22:06 juju-e4d256-prod-github-runner-207 kernel: [32300.603686] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 14:22:06 juju-e4d256-prod-github-runner-207 kernel: [32300.604504] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 14:22:06 juju-e4d256-prod-github-runner-207 kernel: [32300.605365] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 14:22:06 juju-e4d256-prod-github-runner-207 kernel: [32300.606164] ? __seccomp_filter+0x4a/0x4a0 Aug 22 14:22:06 juju-e4d256-prod-github-runner-207 kernel: [32300.606924] ? __fget_files+0x86/0xc0 Aug 22 14:22:06 juju-e4d256-prod-github-runner-207 kernel: [32300.607635] __x64_sys_ioctl+0x95/0xd0 Aug 22 14:22:06 juju-e4d256-prod-github-runner-207 kernel: [32300.608329] do_syscall_64+0x5c/0xc0 Aug 22 14:22:06 juju-e4d256-prod-github-runner-207 kernel: [32300.608999] ? do_futex+0x162/0x1f0 Aug 22 14:22:06 juju-e4d256-prod-github-runner-207 kernel: [32300.609654] ? __x64_sys_futex+0x78/0x1e0 Aug 22 14:22:06 juju-e4d256-prod-github-runner-207 kernel: [32300.610330] ? __secure_computing+0xa9/0x120 Aug 22 14:22:06 juju-e4d256-prod-github-runner-207 kernel: [32300.611044] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 14:22:06 juju-e4d256-prod-github-runner-207 kernel: [32300.611812] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:22:06 juju-e4d256-prod-github-runner-207 kernel: [32300.612539] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:22:06 juju-e4d256-prod-github-runner-207 kernel: [32300.613266] ? do_syscall_64+0x69/0xc0 Aug 22 14:22:06 juju-e4d256-prod-github-runner-207 kernel: [32300.613967] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:22:06 juju-e4d256-prod-github-runner-207 kernel: [32300.614937] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:22:06 juju-e4d256-prod-github-runner-207 kernel: [32300.615739] ? do_syscall_64+0x69/0xc0 Aug 22 14:22:06 juju-e4d256-prod-github-runner-207 kernel: [32300.616379] ? do_syscall_64+0x69/0xc0 Aug 22 14:22:06 juju-e4d256-prod-github-runner-207 kernel: [32300.617006] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 14:22:06 juju-e4d256-prod-github-runner-207 kernel: [32300.617715] RIP: 0033:0x7faa5d0edaff Aug 22 14:22:06 juju-e4d256-prod-github-runner-207 kernel: [32300.618377] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 14:22:06 juju-e4d256-prod-github-runner-207 kernel: [32300.620480] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 14:22:06 juju-e4d256-prod-github-runner-207 kernel: [32300.621407] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 14:22:06 juju-e4d256-prod-github-runner-207 kernel: [32300.622299] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 14:22:06 juju-e4d256-prod-github-runner-207 kernel: [32300.623248] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 14:22:06 juju-e4d256-prod-github-runner-207 kernel: [32300.624167] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 14:22:06 juju-e4d256-prod-github-runner-207 kernel: [32300.625055] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 14:22:06 juju-e4d256-prod-github-runner-207 kernel: [32300.625979] Aug 22 14:22:34 juju-e4d256-prod-github-runner-207 kernel: [32328.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 30000s! [qemu-system-x86:6715] Aug 22 14:22:34 juju-e4d256-prod-github-runner-207 kernel: [32328.546180] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 14:22:34 juju-e4d256-prod-github-runner-207 kernel: [32328.546517] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 14:22:34 juju-e4d256-prod-github-runner-207 kernel: [32328.559411] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 14:22:34 juju-e4d256-prod-github-runner-207 kernel: [32328.560737] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 14:22:34 juju-e4d256-prod-github-runner-207 kernel: [32328.562014] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:22:34 juju-e4d256-prod-github-runner-207 kernel: [32328.563131] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 14:22:34 juju-e4d256-prod-github-runner-207 kernel: [32328.565778] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 14:22:34 juju-e4d256-prod-github-runner-207 kernel: [32328.566880] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 14:22:34 juju-e4d256-prod-github-runner-207 kernel: [32328.568150] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 14:22:34 juju-e4d256-prod-github-runner-207 kernel: [32328.569495] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 14:22:34 juju-e4d256-prod-github-runner-207 kernel: [32328.570861] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 14:22:34 juju-e4d256-prod-github-runner-207 kernel: [32328.572182] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 14:22:34 juju-e4d256-prod-github-runner-207 kernel: [32328.573691] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 14:22:34 juju-e4d256-prod-github-runner-207 kernel: [32328.575101] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 14:22:34 juju-e4d256-prod-github-runner-207 kernel: [32328.576358] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 14:22:34 juju-e4d256-prod-github-runner-207 kernel: [32328.577705] Call Trace: Aug 22 14:22:34 juju-e4d256-prod-github-runner-207 kernel: [32328.578690] Aug 22 14:22:34 juju-e4d256-prod-github-runner-207 kernel: [32328.579639] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:22:34 juju-e4d256-prod-github-runner-207 kernel: [32328.580770] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:22:34 juju-e4d256-prod-github-runner-207 kernel: [32328.581884] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:22:34 juju-e4d256-prod-github-runner-207 kernel: [32328.583104] ? show_regs.part.0+0x23/0x29 Aug 22 14:22:34 juju-e4d256-prod-github-runner-207 kernel: [32328.584190] ? show_regs.cold+0x8/0xd Aug 22 14:22:34 juju-e4d256-prod-github-runner-207 kernel: [32328.585236] ? watchdog_timer_fn+0x1be/0x220 Aug 22 14:22:34 juju-e4d256-prod-github-runner-207 kernel: [32328.586368] ? lockup_detector_update_enable+0x60/0x60 Aug 22 14:22:34 juju-e4d256-prod-github-runner-207 kernel: [32328.587549] ? __hrtimer_run_queues+0x107/0x230 Aug 22 14:22:34 juju-e4d256-prod-github-runner-207 kernel: [32328.588666] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 14:22:34 juju-e4d256-prod-github-runner-207 kernel: [32328.589776] ? hrtimer_interrupt+0x101/0x220 Aug 22 14:22:34 juju-e4d256-prod-github-runner-207 kernel: [32328.590896] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 14:22:34 juju-e4d256-prod-github-runner-207 kernel: [32328.592076] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 14:22:34 juju-e4d256-prod-github-runner-207 kernel: [32328.593225] Aug 22 14:22:34 juju-e4d256-prod-github-runner-207 kernel: [32328.594132] Aug 22 14:22:34 juju-e4d256-prod-github-runner-207 kernel: [32328.595037] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 14:22:34 juju-e4d256-prod-github-runner-207 kernel: [32328.596201] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:22:34 juju-e4d256-prod-github-runner-207 kernel: [32328.597372] ? _raw_spin_lock+0x22/0x30 Aug 22 14:22:34 juju-e4d256-prod-github-runner-207 kernel: [32328.598414] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:22:34 juju-e4d256-prod-github-runner-207 kernel: [32328.599543] direct_page_fault+0x206/0x310 [kvm] Aug 22 14:22:34 juju-e4d256-prod-github-runner-207 kernel: [32328.600665] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 14:22:34 juju-e4d256-prod-github-runner-207 kernel: [32328.601769] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 14:22:34 juju-e4d256-prod-github-runner-207 kernel: [32328.602957] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 14:22:34 juju-e4d256-prod-github-runner-207 kernel: [32328.604084] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 14:22:34 juju-e4d256-prod-github-runner-207 kernel: [32328.605129] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 14:22:34 juju-e4d256-prod-github-runner-207 kernel: [32328.606249] handle_exit+0x98/0x230 [kvm_amd] Aug 22 14:22:34 juju-e4d256-prod-github-runner-207 kernel: [32328.607280] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 14:22:34 juju-e4d256-prod-github-runner-207 kernel: [32328.608291] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 14:22:34 juju-e4d256-prod-github-runner-207 kernel: [32328.609314] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 14:22:34 juju-e4d256-prod-github-runner-207 kernel: [32328.610333] vcpu_run+0x62/0x2c0 [kvm] Aug 22 14:22:34 juju-e4d256-prod-github-runner-207 kernel: [32328.611246] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 14:22:34 juju-e4d256-prod-github-runner-207 kernel: [32328.612142] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 14:22:34 juju-e4d256-prod-github-runner-207 kernel: [32328.613095] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 14:22:34 juju-e4d256-prod-github-runner-207 kernel: [32328.613983] ? __seccomp_filter+0x4a/0x4a0 Aug 22 14:22:34 juju-e4d256-prod-github-runner-207 kernel: [32328.614827] ? __fget_files+0x86/0xc0 Aug 22 14:22:34 juju-e4d256-prod-github-runner-207 kernel: [32328.615610] __x64_sys_ioctl+0x95/0xd0 Aug 22 14:22:34 juju-e4d256-prod-github-runner-207 kernel: [32328.616382] do_syscall_64+0x5c/0xc0 Aug 22 14:22:34 juju-e4d256-prod-github-runner-207 kernel: [32328.617128] ? do_futex+0x162/0x1f0 Aug 22 14:22:34 juju-e4d256-prod-github-runner-207 kernel: [32328.617850] ? __x64_sys_futex+0x78/0x1e0 Aug 22 14:22:34 juju-e4d256-prod-github-runner-207 kernel: [32328.618624] ? __secure_computing+0xa9/0x120 Aug 22 14:22:34 juju-e4d256-prod-github-runner-207 kernel: [32328.619401] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 14:22:34 juju-e4d256-prod-github-runner-207 kernel: [32328.620261] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:22:34 juju-e4d256-prod-github-runner-207 kernel: [32328.621078] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:22:34 juju-e4d256-prod-github-runner-207 kernel: [32328.621894] ? do_syscall_64+0x69/0xc0 Aug 22 14:22:34 juju-e4d256-prod-github-runner-207 kernel: [32328.622644] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:22:34 juju-e4d256-prod-github-runner-207 kernel: [32328.623447] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:22:34 juju-e4d256-prod-github-runner-207 kernel: [32328.624238] ? do_syscall_64+0x69/0xc0 Aug 22 14:22:34 juju-e4d256-prod-github-runner-207 kernel: [32328.624949] ? do_syscall_64+0x69/0xc0 Aug 22 14:22:34 juju-e4d256-prod-github-runner-207 kernel: [32328.625652] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 14:22:34 juju-e4d256-prod-github-runner-207 kernel: [32328.626475] RIP: 0033:0x7faa5d0edaff Aug 22 14:22:34 juju-e4d256-prod-github-runner-207 kernel: [32328.627276] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 14:22:34 juju-e4d256-prod-github-runner-207 kernel: [32328.629665] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 14:22:34 juju-e4d256-prod-github-runner-207 kernel: [32328.630739] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 14:22:34 juju-e4d256-prod-github-runner-207 kernel: [32328.631957] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 14:22:34 juju-e4d256-prod-github-runner-207 kernel: [32328.633018] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 14:22:34 juju-e4d256-prod-github-runner-207 kernel: [32328.634058] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 14:22:34 juju-e4d256-prod-github-runner-207 kernel: [32328.635104] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 14:22:34 juju-e4d256-prod-github-runner-207 kernel: [32328.636192] Aug 22 14:23:02 juju-e4d256-prod-github-runner-207 kernel: [32356.541981] watchdog: BUG: soft lockup - CPU#1 stuck for 30026s! [qemu-system-x86:6715] Aug 22 14:23:02 juju-e4d256-prod-github-runner-207 kernel: [32356.544075] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 14:23:02 juju-e4d256-prod-github-runner-207 kernel: [32356.544380] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 14:23:02 juju-e4d256-prod-github-runner-207 kernel: [32356.556612] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 14:23:02 juju-e4d256-prod-github-runner-207 kernel: [32356.557876] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 14:23:02 juju-e4d256-prod-github-runner-207 kernel: [32356.559111] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:23:02 juju-e4d256-prod-github-runner-207 kernel: [32356.560168] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 14:23:02 juju-e4d256-prod-github-runner-207 kernel: [32356.562734] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 14:23:02 juju-e4d256-prod-github-runner-207 kernel: [32356.563779] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 14:23:02 juju-e4d256-prod-github-runner-207 kernel: [32356.564951] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 14:23:02 juju-e4d256-prod-github-runner-207 kernel: [32356.566127] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 14:23:02 juju-e4d256-prod-github-runner-207 kernel: [32356.567497] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 14:23:02 juju-e4d256-prod-github-runner-207 kernel: [32356.568745] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 14:23:02 juju-e4d256-prod-github-runner-207 kernel: [32356.569966] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 14:23:02 juju-e4d256-prod-github-runner-207 kernel: [32356.571229] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 14:23:02 juju-e4d256-prod-github-runner-207 kernel: [32356.572343] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 14:23:02 juju-e4d256-prod-github-runner-207 kernel: [32356.573554] Call Trace: Aug 22 14:23:02 juju-e4d256-prod-github-runner-207 kernel: [32356.574491] Aug 22 14:23:02 juju-e4d256-prod-github-runner-207 kernel: [32356.575399] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:23:02 juju-e4d256-prod-github-runner-207 kernel: [32356.576431] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:23:02 juju-e4d256-prod-github-runner-207 kernel: [32356.577456] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:23:02 juju-e4d256-prod-github-runner-207 kernel: [32356.578567] ? show_regs.part.0+0x23/0x29 Aug 22 14:23:02 juju-e4d256-prod-github-runner-207 kernel: [32356.579565] ? show_regs.cold+0x8/0xd Aug 22 14:23:02 juju-e4d256-prod-github-runner-207 kernel: [32356.580535] ? watchdog_timer_fn+0x1be/0x220 Aug 22 14:23:02 juju-e4d256-prod-github-runner-207 kernel: [32356.581544] ? lockup_detector_update_enable+0x60/0x60 Aug 22 14:23:02 juju-e4d256-prod-github-runner-207 kernel: [32356.582649] ? __hrtimer_run_queues+0x107/0x230 Aug 22 14:23:02 juju-e4d256-prod-github-runner-207 kernel: [32356.583780] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 14:23:02 juju-e4d256-prod-github-runner-207 kernel: [32356.584816] ? hrtimer_interrupt+0x101/0x220 Aug 22 14:23:02 juju-e4d256-prod-github-runner-207 kernel: [32356.585838] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 14:23:02 juju-e4d256-prod-github-runner-207 kernel: [32356.586948] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 14:23:02 juju-e4d256-prod-github-runner-207 kernel: [32356.587996] Aug 22 14:23:02 juju-e4d256-prod-github-runner-207 kernel: [32356.588850] Aug 22 14:23:02 juju-e4d256-prod-github-runner-207 kernel: [32356.589687] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 14:23:02 juju-e4d256-prod-github-runner-207 kernel: [32356.590736] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:23:02 juju-e4d256-prod-github-runner-207 kernel: [32356.591837] ? _raw_spin_lock+0x22/0x30 Aug 22 14:23:02 juju-e4d256-prod-github-runner-207 kernel: [32356.592941] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:23:02 juju-e4d256-prod-github-runner-207 kernel: [32356.594293] direct_page_fault+0x206/0x310 [kvm] Aug 22 14:23:02 juju-e4d256-prod-github-runner-207 kernel: [32356.595573] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 14:23:02 juju-e4d256-prod-github-runner-207 kernel: [32356.596586] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 14:23:02 juju-e4d256-prod-github-runner-207 kernel: [32356.597589] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 14:23:02 juju-e4d256-prod-github-runner-207 kernel: [32356.598613] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 14:23:02 juju-e4d256-prod-github-runner-207 kernel: [32356.599735] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 14:23:02 juju-e4d256-prod-github-runner-207 kernel: [32356.600717] handle_exit+0x98/0x230 [kvm_amd] Aug 22 14:23:02 juju-e4d256-prod-github-runner-207 kernel: [32356.601610] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 14:23:02 juju-e4d256-prod-github-runner-207 kernel: [32356.602562] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 14:23:02 juju-e4d256-prod-github-runner-207 kernel: [32356.603494] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 14:23:02 juju-e4d256-prod-github-runner-207 kernel: [32356.604399] vcpu_run+0x62/0x2c0 [kvm] Aug 22 14:23:02 juju-e4d256-prod-github-runner-207 kernel: [32356.605216] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 14:23:02 juju-e4d256-prod-github-runner-207 kernel: [32356.606031] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 14:23:02 juju-e4d256-prod-github-runner-207 kernel: [32356.606901] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 14:23:02 juju-e4d256-prod-github-runner-207 kernel: [32356.607699] ? __seccomp_filter+0x4a/0x4a0 Aug 22 14:23:02 juju-e4d256-prod-github-runner-207 kernel: [32356.608443] ? __fget_files+0x86/0xc0 Aug 22 14:23:02 juju-e4d256-prod-github-runner-207 kernel: [32356.609149] __x64_sys_ioctl+0x95/0xd0 Aug 22 14:23:02 juju-e4d256-prod-github-runner-207 kernel: [32356.609844] do_syscall_64+0x5c/0xc0 Aug 22 14:23:02 juju-e4d256-prod-github-runner-207 kernel: [32356.610519] ? do_futex+0x162/0x1f0 Aug 22 14:23:02 juju-e4d256-prod-github-runner-207 kernel: [32356.611176] ? __x64_sys_futex+0x78/0x1e0 Aug 22 14:23:02 juju-e4d256-prod-github-runner-207 kernel: [32356.611851] ? __secure_computing+0xa9/0x120 Aug 22 14:23:02 juju-e4d256-prod-github-runner-207 kernel: [32356.612541] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 14:23:02 juju-e4d256-prod-github-runner-207 kernel: [32356.613305] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:23:02 juju-e4d256-prod-github-runner-207 kernel: [32356.614031] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:23:02 juju-e4d256-prod-github-runner-207 kernel: [32356.614762] ? do_syscall_64+0x69/0xc0 Aug 22 14:23:02 juju-e4d256-prod-github-runner-207 kernel: [32356.615411] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:23:02 juju-e4d256-prod-github-runner-207 kernel: [32356.616161] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:23:02 juju-e4d256-prod-github-runner-207 kernel: [32356.616882] ? do_syscall_64+0x69/0xc0 Aug 22 14:23:02 juju-e4d256-prod-github-runner-207 kernel: [32356.617521] ? do_syscall_64+0x69/0xc0 Aug 22 14:23:02 juju-e4d256-prod-github-runner-207 kernel: [32356.618159] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 14:23:02 juju-e4d256-prod-github-runner-207 kernel: [32356.618870] RIP: 0033:0x7faa5d0edaff Aug 22 14:23:02 juju-e4d256-prod-github-runner-207 kernel: [32356.619550] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 14:23:02 juju-e4d256-prod-github-runner-207 kernel: [32356.621544] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 14:23:02 juju-e4d256-prod-github-runner-207 kernel: [32356.622473] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 14:23:02 juju-e4d256-prod-github-runner-207 kernel: [32356.623361] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 14:23:02 juju-e4d256-prod-github-runner-207 kernel: [32356.624279] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 14:23:02 juju-e4d256-prod-github-runner-207 kernel: [32356.625188] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 14:23:02 juju-e4d256-prod-github-runner-207 kernel: [32356.626130] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 14:23:02 juju-e4d256-prod-github-runner-207 kernel: [32356.627024] Aug 22 14:23:30 juju-e4d256-prod-github-runner-207 kernel: [32384.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 30052s! [qemu-system-x86:6715] Aug 22 14:23:30 juju-e4d256-prod-github-runner-207 kernel: [32384.544334] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 14:23:30 juju-e4d256-prod-github-runner-207 kernel: [32384.544683] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 14:23:30 juju-e4d256-prod-github-runner-207 kernel: [32384.556886] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 14:23:30 juju-e4d256-prod-github-runner-207 kernel: [32384.558168] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 14:23:30 juju-e4d256-prod-github-runner-207 kernel: [32384.559390] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:23:30 juju-e4d256-prod-github-runner-207 kernel: [32384.560452] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 14:23:30 juju-e4d256-prod-github-runner-207 kernel: [32384.563021] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 14:23:30 juju-e4d256-prod-github-runner-207 kernel: [32384.564173] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 14:23:30 juju-e4d256-prod-github-runner-207 kernel: [32384.565334] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 14:23:30 juju-e4d256-prod-github-runner-207 kernel: [32384.566505] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 14:23:30 juju-e4d256-prod-github-runner-207 kernel: [32384.567669] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 14:23:30 juju-e4d256-prod-github-runner-207 kernel: [32384.568829] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 14:23:30 juju-e4d256-prod-github-runner-207 kernel: [32384.570001] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 14:23:30 juju-e4d256-prod-github-runner-207 kernel: [32384.571238] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 14:23:30 juju-e4d256-prod-github-runner-207 kernel: [32384.572334] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 14:23:30 juju-e4d256-prod-github-runner-207 kernel: [32384.573528] Call Trace: Aug 22 14:23:30 juju-e4d256-prod-github-runner-207 kernel: [32384.574465] Aug 22 14:23:30 juju-e4d256-prod-github-runner-207 kernel: [32384.575374] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:23:30 juju-e4d256-prod-github-runner-207 kernel: [32384.576436] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:23:30 juju-e4d256-prod-github-runner-207 kernel: [32384.577459] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:23:30 juju-e4d256-prod-github-runner-207 kernel: [32384.578587] ? show_regs.part.0+0x23/0x29 Aug 22 14:23:30 juju-e4d256-prod-github-runner-207 kernel: [32384.579583] ? show_regs.cold+0x8/0xd Aug 22 14:23:30 juju-e4d256-prod-github-runner-207 kernel: [32384.580562] ? watchdog_timer_fn+0x1be/0x220 Aug 22 14:23:30 juju-e4d256-prod-github-runner-207 kernel: [32384.581575] ? lockup_detector_update_enable+0x60/0x60 Aug 22 14:23:30 juju-e4d256-prod-github-runner-207 kernel: [32384.582758] ? __hrtimer_run_queues+0x107/0x230 Aug 22 14:23:30 juju-e4d256-prod-github-runner-207 kernel: [32384.583804] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 14:23:30 juju-e4d256-prod-github-runner-207 kernel: [32384.584827] ? hrtimer_interrupt+0x101/0x220 Aug 22 14:23:30 juju-e4d256-prod-github-runner-207 kernel: [32384.585862] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 14:23:30 juju-e4d256-prod-github-runner-207 kernel: [32384.586965] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 14:23:30 juju-e4d256-prod-github-runner-207 kernel: [32384.588013] Aug 22 14:23:30 juju-e4d256-prod-github-runner-207 kernel: [32384.588867] Aug 22 14:23:30 juju-e4d256-prod-github-runner-207 kernel: [32384.589705] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 14:23:30 juju-e4d256-prod-github-runner-207 kernel: [32384.590752] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:23:30 juju-e4d256-prod-github-runner-207 kernel: [32384.591807] ? _raw_spin_lock+0x22/0x30 Aug 22 14:23:30 juju-e4d256-prod-github-runner-207 kernel: [32384.592925] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:23:30 juju-e4d256-prod-github-runner-207 kernel: [32384.593973] direct_page_fault+0x206/0x310 [kvm] Aug 22 14:23:30 juju-e4d256-prod-github-runner-207 kernel: [32384.595022] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 14:23:30 juju-e4d256-prod-github-runner-207 kernel: [32384.596039] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 14:23:30 juju-e4d256-prod-github-runner-207 kernel: [32384.597107] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 14:23:30 juju-e4d256-prod-github-runner-207 kernel: [32384.598154] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 14:23:30 juju-e4d256-prod-github-runner-207 kernel: [32384.599155] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 14:23:30 juju-e4d256-prod-github-runner-207 kernel: [32384.600303] handle_exit+0x98/0x230 [kvm_amd] Aug 22 14:23:30 juju-e4d256-prod-github-runner-207 kernel: [32384.601235] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 14:23:30 juju-e4d256-prod-github-runner-207 kernel: [32384.602313] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 14:23:30 juju-e4d256-prod-github-runner-207 kernel: [32384.603259] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 14:23:30 juju-e4d256-prod-github-runner-207 kernel: [32384.604169] vcpu_run+0x62/0x2c0 [kvm] Aug 22 14:23:30 juju-e4d256-prod-github-runner-207 kernel: [32384.604996] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 14:23:30 juju-e4d256-prod-github-runner-207 kernel: [32384.605852] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 14:23:30 juju-e4d256-prod-github-runner-207 kernel: [32384.606713] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 14:23:30 juju-e4d256-prod-github-runner-207 kernel: [32384.607526] ? __seccomp_filter+0x4a/0x4a0 Aug 22 14:23:30 juju-e4d256-prod-github-runner-207 kernel: [32384.608272] ? __fget_files+0x86/0xc0 Aug 22 14:23:30 juju-e4d256-prod-github-runner-207 kernel: [32384.608979] __x64_sys_ioctl+0x95/0xd0 Aug 22 14:23:30 juju-e4d256-prod-github-runner-207 kernel: [32384.609672] do_syscall_64+0x5c/0xc0 Aug 22 14:23:30 juju-e4d256-prod-github-runner-207 kernel: [32384.610345] ? do_futex+0x162/0x1f0 Aug 22 14:23:30 juju-e4d256-prod-github-runner-207 kernel: [32384.610994] ? __x64_sys_futex+0x78/0x1e0 Aug 22 14:23:30 juju-e4d256-prod-github-runner-207 kernel: [32384.611673] ? __secure_computing+0xa9/0x120 Aug 22 14:23:30 juju-e4d256-prod-github-runner-207 kernel: [32384.612362] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 14:23:30 juju-e4d256-prod-github-runner-207 kernel: [32384.613123] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:23:30 juju-e4d256-prod-github-runner-207 kernel: [32384.613865] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:23:30 juju-e4d256-prod-github-runner-207 kernel: [32384.614587] ? do_syscall_64+0x69/0xc0 Aug 22 14:23:30 juju-e4d256-prod-github-runner-207 kernel: [32384.615230] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:23:30 juju-e4d256-prod-github-runner-207 kernel: [32384.615939] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:23:30 juju-e4d256-prod-github-runner-207 kernel: [32384.616634] ? do_syscall_64+0x69/0xc0 Aug 22 14:23:30 juju-e4d256-prod-github-runner-207 kernel: [32384.617269] ? do_syscall_64+0x69/0xc0 Aug 22 14:23:30 juju-e4d256-prod-github-runner-207 kernel: [32384.617910] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 14:23:30 juju-e4d256-prod-github-runner-207 kernel: [32384.618617] RIP: 0033:0x7faa5d0edaff Aug 22 14:23:30 juju-e4d256-prod-github-runner-207 kernel: [32384.619278] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 14:23:30 juju-e4d256-prod-github-runner-207 kernel: [32384.621266] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 14:23:30 juju-e4d256-prod-github-runner-207 kernel: [32384.622200] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 14:23:30 juju-e4d256-prod-github-runner-207 kernel: [32384.623094] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 14:23:30 juju-e4d256-prod-github-runner-207 kernel: [32384.623985] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 14:23:30 juju-e4d256-prod-github-runner-207 kernel: [32384.624880] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 14:23:30 juju-e4d256-prod-github-runner-207 kernel: [32384.625805] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 14:23:30 juju-e4d256-prod-github-runner-207 kernel: [32384.626702] Aug 22 14:23:45 juju-e4d256-prod-github-runner-207 kernel: [32399.348706] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 14:23:45 juju-e4d256-prod-github-runner-207 kernel: [32399.350439] rcu: 1-....: (8045340 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=3887176 Aug 22 14:23:45 juju-e4d256-prod-github-runner-207 kernel: [32399.351565] (t=8070537 jiffies g=23269 q=35181) Aug 22 14:23:45 juju-e4d256-prod-github-runner-207 kernel: [32399.352349] NMI backtrace for cpu 1 Aug 22 14:23:45 juju-e4d256-prod-github-runner-207 kernel: [32399.353096] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 14:23:45 juju-e4d256-prod-github-runner-207 kernel: [32399.354206] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 14:23:45 juju-e4d256-prod-github-runner-207 kernel: [32399.355277] Call Trace: Aug 22 14:23:45 juju-e4d256-prod-github-runner-207 kernel: [32399.355954] Aug 22 14:23:45 juju-e4d256-prod-github-runner-207 kernel: [32399.356617] show_stack+0x52/0x5c Aug 22 14:23:45 juju-e4d256-prod-github-runner-207 kernel: [32399.357346] dump_stack_lvl+0x4a/0x63 Aug 22 14:23:45 juju-e4d256-prod-github-runner-207 kernel: [32399.358179] dump_stack+0x10/0x16 Aug 22 14:23:45 juju-e4d256-prod-github-runner-207 kernel: [32399.358902] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 14:23:45 juju-e4d256-prod-github-runner-207 kernel: [32399.359680] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 14:23:45 juju-e4d256-prod-github-runner-207 kernel: [32399.360482] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 14:23:45 juju-e4d256-prod-github-runner-207 kernel: [32399.361383] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 14:23:45 juju-e4d256-prod-github-runner-207 kernel: [32399.362327] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 14:23:45 juju-e4d256-prod-github-runner-207 kernel: [32399.363143] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 14:23:45 juju-e4d256-prod-github-runner-207 kernel: [32399.363913] print_cpu_stall.cold+0x2f/0xe2 Aug 22 14:23:45 juju-e4d256-prod-github-runner-207 kernel: [32399.364673] ? timekeeping_update+0xf7/0x150 Aug 22 14:23:45 juju-e4d256-prod-github-runner-207 kernel: [32399.365440] check_cpu_stall+0x109/0x270 Aug 22 14:23:45 juju-e4d256-prod-github-runner-207 kernel: [32399.366198] rcu_sched_clock_irq+0x9a/0x250 Aug 22 14:23:45 juju-e4d256-prod-github-runner-207 kernel: [32399.366956] update_process_times+0x94/0xd0 Aug 22 14:23:45 juju-e4d256-prod-github-runner-207 kernel: [32399.367717] tick_sched_handle+0x29/0x70 Aug 22 14:23:45 juju-e4d256-prod-github-runner-207 kernel: [32399.368457] tick_sched_timer+0x8c/0xc0 Aug 22 14:23:45 juju-e4d256-prod-github-runner-207 kernel: [32399.369190] ? tick_nohz_handler+0xb0/0xb0 Aug 22 14:23:45 juju-e4d256-prod-github-runner-207 kernel: [32399.369959] __hrtimer_run_queues+0x107/0x230 Aug 22 14:23:45 juju-e4d256-prod-github-runner-207 kernel: [32399.370734] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 14:23:45 juju-e4d256-prod-github-runner-207 kernel: [32399.371503] hrtimer_interrupt+0x101/0x220 Aug 22 14:23:45 juju-e4d256-prod-github-runner-207 kernel: [32399.372258] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 14:23:45 juju-e4d256-prod-github-runner-207 kernel: [32399.373063] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 14:23:45 juju-e4d256-prod-github-runner-207 kernel: [32399.373875] Aug 22 14:23:45 juju-e4d256-prod-github-runner-207 kernel: [32399.374507] Aug 22 14:23:45 juju-e4d256-prod-github-runner-207 kernel: [32399.375131] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 14:23:45 juju-e4d256-prod-github-runner-207 kernel: [32399.375944] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:23:45 juju-e4d256-prod-github-runner-207 kernel: [32399.376819] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 14:23:45 juju-e4d256-prod-github-runner-207 kernel: [32399.379139] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 14:23:45 juju-e4d256-prod-github-runner-207 kernel: [32399.380021] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 14:23:45 juju-e4d256-prod-github-runner-207 kernel: [32399.381025] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 14:23:45 juju-e4d256-prod-github-runner-207 kernel: [32399.382031] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 14:23:45 juju-e4d256-prod-github-runner-207 kernel: [32399.383003] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 14:23:45 juju-e4d256-prod-github-runner-207 kernel: [32399.383975] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 14:23:45 juju-e4d256-prod-github-runner-207 kernel: [32399.384941] ? _raw_spin_lock+0x22/0x30 Aug 22 14:23:45 juju-e4d256-prod-github-runner-207 kernel: [32399.386628] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:23:45 juju-e4d256-prod-github-runner-207 kernel: [32399.387516] direct_page_fault+0x206/0x310 [kvm] Aug 22 14:23:45 juju-e4d256-prod-github-runner-207 kernel: [32399.388364] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 14:23:45 juju-e4d256-prod-github-runner-207 kernel: [32399.389198] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 14:23:45 juju-e4d256-prod-github-runner-207 kernel: [32399.390058] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 14:23:45 juju-e4d256-prod-github-runner-207 kernel: [32399.390908] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 14:23:45 juju-e4d256-prod-github-runner-207 kernel: [32399.391703] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 14:23:45 juju-e4d256-prod-github-runner-207 kernel: [32399.392558] handle_exit+0x98/0x230 [kvm_amd] Aug 22 14:23:45 juju-e4d256-prod-github-runner-207 kernel: [32399.393360] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 14:23:45 juju-e4d256-prod-github-runner-207 kernel: [32399.394329] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 14:23:45 juju-e4d256-prod-github-runner-207 kernel: [32399.395167] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 14:23:45 juju-e4d256-prod-github-runner-207 kernel: [32399.396008] vcpu_run+0x62/0x2c0 [kvm] Aug 22 14:23:45 juju-e4d256-prod-github-runner-207 kernel: [32399.396784] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 14:23:45 juju-e4d256-prod-github-runner-207 kernel: [32399.397553] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 14:23:45 juju-e4d256-prod-github-runner-207 kernel: [32399.398433] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 14:23:45 juju-e4d256-prod-github-runner-207 kernel: [32399.399210] ? __seccomp_filter+0x4a/0x4a0 Aug 22 14:23:45 juju-e4d256-prod-github-runner-207 kernel: [32399.400129] ? __fget_files+0x86/0xc0 Aug 22 14:23:45 juju-e4d256-prod-github-runner-207 kernel: [32399.401002] __x64_sys_ioctl+0x95/0xd0 Aug 22 14:23:45 juju-e4d256-prod-github-runner-207 kernel: [32399.401734] do_syscall_64+0x5c/0xc0 Aug 22 14:23:45 juju-e4d256-prod-github-runner-207 kernel: [32399.402434] ? do_futex+0x162/0x1f0 Aug 22 14:23:45 juju-e4d256-prod-github-runner-207 kernel: [32399.403117] ? __x64_sys_futex+0x78/0x1e0 Aug 22 14:23:45 juju-e4d256-prod-github-runner-207 kernel: [32399.403829] ? __secure_computing+0xa9/0x120 Aug 22 14:23:45 juju-e4d256-prod-github-runner-207 kernel: [32399.404560] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 14:23:45 juju-e4d256-prod-github-runner-207 kernel: [32399.405373] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:23:45 juju-e4d256-prod-github-runner-207 kernel: [32399.406209] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:23:45 juju-e4d256-prod-github-runner-207 kernel: [32399.407023] ? do_syscall_64+0x69/0xc0 Aug 22 14:23:45 juju-e4d256-prod-github-runner-207 kernel: [32399.407732] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:23:45 juju-e4d256-prod-github-runner-207 kernel: [32399.408508] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:23:45 juju-e4d256-prod-github-runner-207 kernel: [32399.409284] ? do_syscall_64+0x69/0xc0 Aug 22 14:23:45 juju-e4d256-prod-github-runner-207 kernel: [32399.410002] ? do_syscall_64+0x69/0xc0 Aug 22 14:23:45 juju-e4d256-prod-github-runner-207 kernel: [32399.410701] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 14:23:45 juju-e4d256-prod-github-runner-207 kernel: [32399.411492] RIP: 0033:0x7faa5d0edaff Aug 22 14:23:45 juju-e4d256-prod-github-runner-207 kernel: [32399.412232] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 14:23:45 juju-e4d256-prod-github-runner-207 kernel: [32399.414399] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 14:23:45 juju-e4d256-prod-github-runner-207 kernel: [32399.415386] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 14:23:45 juju-e4d256-prod-github-runner-207 kernel: [32399.416372] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 14:23:45 juju-e4d256-prod-github-runner-207 kernel: [32399.417333] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 14:23:45 juju-e4d256-prod-github-runner-207 kernel: [32399.418343] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 14:23:45 juju-e4d256-prod-github-runner-207 kernel: [32399.419294] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 14:23:45 juju-e4d256-prod-github-runner-207 kernel: [32399.420222] Aug 22 14:24:10 juju-e4d256-prod-github-runner-207 kernel: [32424.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 30089s! [qemu-system-x86:6715] Aug 22 14:24:10 juju-e4d256-prod-github-runner-207 kernel: [32424.543155] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 14:24:10 juju-e4d256-prod-github-runner-207 kernel: [32424.543533] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 14:24:10 juju-e4d256-prod-github-runner-207 kernel: [32424.556178] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 14:24:10 juju-e4d256-prod-github-runner-207 kernel: [32424.557491] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 14:24:10 juju-e4d256-prod-github-runner-207 kernel: [32424.558741] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:24:10 juju-e4d256-prod-github-runner-207 kernel: [32424.559840] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 14:24:10 juju-e4d256-prod-github-runner-207 kernel: [32424.562580] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 14:24:10 juju-e4d256-prod-github-runner-207 kernel: [32424.563667] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 14:24:10 juju-e4d256-prod-github-runner-207 kernel: [32424.564909] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 14:24:10 juju-e4d256-prod-github-runner-207 kernel: [32424.566139] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 14:24:10 juju-e4d256-prod-github-runner-207 kernel: [32424.567367] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 14:24:10 juju-e4d256-prod-github-runner-207 kernel: [32424.568560] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 14:24:10 juju-e4d256-prod-github-runner-207 kernel: [32424.569773] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 14:24:10 juju-e4d256-prod-github-runner-207 kernel: [32424.571021] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 14:24:10 juju-e4d256-prod-github-runner-207 kernel: [32424.572132] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 14:24:10 juju-e4d256-prod-github-runner-207 kernel: [32424.573381] Call Trace: Aug 22 14:24:10 juju-e4d256-prod-github-runner-207 kernel: [32424.574303] Aug 22 14:24:10 juju-e4d256-prod-github-runner-207 kernel: [32424.575190] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:24:10 juju-e4d256-prod-github-runner-207 kernel: [32424.576232] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:24:10 juju-e4d256-prod-github-runner-207 kernel: [32424.577286] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:24:10 juju-e4d256-prod-github-runner-207 kernel: [32424.578383] ? show_regs.part.0+0x23/0x29 Aug 22 14:24:10 juju-e4d256-prod-github-runner-207 kernel: [32424.579398] ? show_regs.cold+0x8/0xd Aug 22 14:24:10 juju-e4d256-prod-github-runner-207 kernel: [32424.580379] ? watchdog_timer_fn+0x1be/0x220 Aug 22 14:24:10 juju-e4d256-prod-github-runner-207 kernel: [32424.581427] ? lockup_detector_update_enable+0x60/0x60 Aug 22 14:24:10 juju-e4d256-prod-github-runner-207 kernel: [32424.582506] ? __hrtimer_run_queues+0x107/0x230 Aug 22 14:24:10 juju-e4d256-prod-github-runner-207 kernel: [32424.583585] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 14:24:10 juju-e4d256-prod-github-runner-207 kernel: [32424.584631] ? hrtimer_interrupt+0x101/0x220 Aug 22 14:24:10 juju-e4d256-prod-github-runner-207 kernel: [32424.585704] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 14:24:10 juju-e4d256-prod-github-runner-207 kernel: [32424.586797] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 14:24:10 juju-e4d256-prod-github-runner-207 kernel: [32424.587858] Aug 22 14:24:10 juju-e4d256-prod-github-runner-207 kernel: [32424.588722] Aug 22 14:24:10 juju-e4d256-prod-github-runner-207 kernel: [32424.589619] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 14:24:10 juju-e4d256-prod-github-runner-207 kernel: [32424.590683] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:24:10 juju-e4d256-prod-github-runner-207 kernel: [32424.591764] ? _raw_spin_lock+0x22/0x30 Aug 22 14:24:10 juju-e4d256-prod-github-runner-207 kernel: [32424.592735] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:24:10 juju-e4d256-prod-github-runner-207 kernel: [32424.593789] direct_page_fault+0x206/0x310 [kvm] Aug 22 14:24:10 juju-e4d256-prod-github-runner-207 kernel: [32424.594851] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 14:24:10 juju-e4d256-prod-github-runner-207 kernel: [32424.595877] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 14:24:10 juju-e4d256-prod-github-runner-207 kernel: [32424.596907] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 14:24:10 juju-e4d256-prod-github-runner-207 kernel: [32424.597915] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 14:24:10 juju-e4d256-prod-github-runner-207 kernel: [32424.598876] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 14:24:10 juju-e4d256-prod-github-runner-207 kernel: [32424.599874] handle_exit+0x98/0x230 [kvm_amd] Aug 22 14:24:10 juju-e4d256-prod-github-runner-207 kernel: [32424.600783] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 14:24:10 juju-e4d256-prod-github-runner-207 kernel: [32424.601728] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 14:24:10 juju-e4d256-prod-github-runner-207 kernel: [32424.602671] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 14:24:10 juju-e4d256-prod-github-runner-207 kernel: [32424.603592] vcpu_run+0x62/0x2c0 [kvm] Aug 22 14:24:10 juju-e4d256-prod-github-runner-207 kernel: [32424.604473] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 14:24:10 juju-e4d256-prod-github-runner-207 kernel: [32424.605347] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 14:24:10 juju-e4d256-prod-github-runner-207 kernel: [32424.606285] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 14:24:10 juju-e4d256-prod-github-runner-207 kernel: [32424.607140] ? __seccomp_filter+0x4a/0x4a0 Aug 22 14:24:10 juju-e4d256-prod-github-runner-207 kernel: [32424.607907] ? __fget_files+0x86/0xc0 Aug 22 14:24:10 juju-e4d256-prod-github-runner-207 kernel: [32424.608635] __x64_sys_ioctl+0x95/0xd0 Aug 22 14:24:10 juju-e4d256-prod-github-runner-207 kernel: [32424.609387] do_syscall_64+0x5c/0xc0 Aug 22 14:24:10 juju-e4d256-prod-github-runner-207 kernel: [32424.610090] ? do_futex+0x162/0x1f0 Aug 22 14:24:10 juju-e4d256-prod-github-runner-207 kernel: [32424.610788] ? __x64_sys_futex+0x78/0x1e0 Aug 22 14:24:10 juju-e4d256-prod-github-runner-207 kernel: [32424.611475] ? __secure_computing+0xa9/0x120 Aug 22 14:24:10 juju-e4d256-prod-github-runner-207 kernel: [32424.612275] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 14:24:10 juju-e4d256-prod-github-runner-207 kernel: [32424.613075] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:24:10 juju-e4d256-prod-github-runner-207 kernel: [32424.613842] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:24:10 juju-e4d256-prod-github-runner-207 kernel: [32424.614579] ? do_syscall_64+0x69/0xc0 Aug 22 14:24:10 juju-e4d256-prod-github-runner-207 kernel: [32424.615239] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:24:10 juju-e4d256-prod-github-runner-207 kernel: [32424.615984] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:24:10 juju-e4d256-prod-github-runner-207 kernel: [32424.616698] ? do_syscall_64+0x69/0xc0 Aug 22 14:24:10 juju-e4d256-prod-github-runner-207 kernel: [32424.617372] ? do_syscall_64+0x69/0xc0 Aug 22 14:24:10 juju-e4d256-prod-github-runner-207 kernel: [32424.618009] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 14:24:10 juju-e4d256-prod-github-runner-207 kernel: [32424.618731] RIP: 0033:0x7faa5d0edaff Aug 22 14:24:10 juju-e4d256-prod-github-runner-207 kernel: [32424.619423] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 14:24:10 juju-e4d256-prod-github-runner-207 kernel: [32424.621537] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 14:24:10 juju-e4d256-prod-github-runner-207 kernel: [32424.622671] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 14:24:10 juju-e4d256-prod-github-runner-207 kernel: [32424.623628] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 14:24:10 juju-e4d256-prod-github-runner-207 kernel: [32424.624742] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 14:24:10 juju-e4d256-prod-github-runner-207 kernel: [32424.625678] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 14:24:10 juju-e4d256-prod-github-runner-207 kernel: [32424.626593] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 14:24:10 juju-e4d256-prod-github-runner-207 kernel: [32424.627510] Aug 22 14:24:38 juju-e4d256-prod-github-runner-207 kernel: [32452.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 30115s! [qemu-system-x86:6715] Aug 22 14:24:38 juju-e4d256-prod-github-runner-207 kernel: [32452.543851] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 14:24:38 juju-e4d256-prod-github-runner-207 kernel: [32452.544144] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 14:24:38 juju-e4d256-prod-github-runner-207 kernel: [32452.556548] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 14:24:38 juju-e4d256-prod-github-runner-207 kernel: [32452.557841] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 14:24:38 juju-e4d256-prod-github-runner-207 kernel: [32452.559053] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:24:38 juju-e4d256-prod-github-runner-207 kernel: [32452.560113] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 14:24:38 juju-e4d256-prod-github-runner-207 kernel: [32452.562782] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 14:24:38 juju-e4d256-prod-github-runner-207 kernel: [32452.563833] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 14:24:38 juju-e4d256-prod-github-runner-207 kernel: [32452.565012] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 14:24:38 juju-e4d256-prod-github-runner-207 kernel: [32452.566174] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 14:24:38 juju-e4d256-prod-github-runner-207 kernel: [32452.567337] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 14:24:38 juju-e4d256-prod-github-runner-207 kernel: [32452.568510] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 14:24:38 juju-e4d256-prod-github-runner-207 kernel: [32452.569772] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 14:24:38 juju-e4d256-prod-github-runner-207 kernel: [32452.571401] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 14:24:38 juju-e4d256-prod-github-runner-207 kernel: [32452.572509] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 14:24:38 juju-e4d256-prod-github-runner-207 kernel: [32452.573731] Call Trace: Aug 22 14:24:38 juju-e4d256-prod-github-runner-207 kernel: [32452.574644] Aug 22 14:24:38 juju-e4d256-prod-github-runner-207 kernel: [32452.575550] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:24:38 juju-e4d256-prod-github-runner-207 kernel: [32452.576581] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:24:38 juju-e4d256-prod-github-runner-207 kernel: [32452.577621] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:24:38 juju-e4d256-prod-github-runner-207 kernel: [32452.578722] ? show_regs.part.0+0x23/0x29 Aug 22 14:24:38 juju-e4d256-prod-github-runner-207 kernel: [32452.579720] ? show_regs.cold+0x8/0xd Aug 22 14:24:38 juju-e4d256-prod-github-runner-207 kernel: [32452.580698] ? watchdog_timer_fn+0x1be/0x220 Aug 22 14:24:38 juju-e4d256-prod-github-runner-207 kernel: [32452.581727] ? lockup_detector_update_enable+0x60/0x60 Aug 22 14:24:38 juju-e4d256-prod-github-runner-207 kernel: [32452.582795] ? __hrtimer_run_queues+0x107/0x230 Aug 22 14:24:38 juju-e4d256-prod-github-runner-207 kernel: [32452.583826] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 14:24:38 juju-e4d256-prod-github-runner-207 kernel: [32452.584949] ? hrtimer_interrupt+0x101/0x220 Aug 22 14:24:38 juju-e4d256-prod-github-runner-207 kernel: [32452.585971] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 14:24:38 juju-e4d256-prod-github-runner-207 kernel: [32452.587039] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 14:24:38 juju-e4d256-prod-github-runner-207 kernel: [32452.588084] Aug 22 14:24:38 juju-e4d256-prod-github-runner-207 kernel: [32452.588956] Aug 22 14:24:38 juju-e4d256-prod-github-runner-207 kernel: [32452.589794] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 14:24:38 juju-e4d256-prod-github-runner-207 kernel: [32452.590827] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:24:38 juju-e4d256-prod-github-runner-207 kernel: [32452.591867] ? _raw_spin_lock+0x22/0x30 Aug 22 14:24:38 juju-e4d256-prod-github-runner-207 kernel: [32452.592811] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:24:38 juju-e4d256-prod-github-runner-207 kernel: [32452.593839] direct_page_fault+0x206/0x310 [kvm] Aug 22 14:24:38 juju-e4d256-prod-github-runner-207 kernel: [32452.594867] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 14:24:38 juju-e4d256-prod-github-runner-207 kernel: [32452.595876] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 14:24:38 juju-e4d256-prod-github-runner-207 kernel: [32452.596875] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 14:24:38 juju-e4d256-prod-github-runner-207 kernel: [32452.597907] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 14:24:38 juju-e4d256-prod-github-runner-207 kernel: [32452.598851] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 14:24:38 juju-e4d256-prod-github-runner-207 kernel: [32452.599888] handle_exit+0x98/0x230 [kvm_amd] Aug 22 14:24:38 juju-e4d256-prod-github-runner-207 kernel: [32452.600806] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 14:24:38 juju-e4d256-prod-github-runner-207 kernel: [32452.601761] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 14:24:38 juju-e4d256-prod-github-runner-207 kernel: [32452.602695] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 14:24:38 juju-e4d256-prod-github-runner-207 kernel: [32452.603631] vcpu_run+0x62/0x2c0 [kvm] Aug 22 14:24:38 juju-e4d256-prod-github-runner-207 kernel: [32452.604455] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 14:24:38 juju-e4d256-prod-github-runner-207 kernel: [32452.605276] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 14:24:38 juju-e4d256-prod-github-runner-207 kernel: [32452.606136] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 14:24:38 juju-e4d256-prod-github-runner-207 kernel: [32452.606933] ? __seccomp_filter+0x4a/0x4a0 Aug 22 14:24:38 juju-e4d256-prod-github-runner-207 kernel: [32452.607675] ? __fget_files+0x86/0xc0 Aug 22 14:24:38 juju-e4d256-prod-github-runner-207 kernel: [32452.608383] __x64_sys_ioctl+0x95/0xd0 Aug 22 14:24:38 juju-e4d256-prod-github-runner-207 kernel: [32452.609087] do_syscall_64+0x5c/0xc0 Aug 22 14:24:38 juju-e4d256-prod-github-runner-207 kernel: [32452.609754] ? do_futex+0x162/0x1f0 Aug 22 14:24:38 juju-e4d256-prod-github-runner-207 kernel: [32452.610404] ? __x64_sys_futex+0x78/0x1e0 Aug 22 14:24:38 juju-e4d256-prod-github-runner-207 kernel: [32452.611082] ? __secure_computing+0xa9/0x120 Aug 22 14:24:38 juju-e4d256-prod-github-runner-207 kernel: [32452.611776] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 14:24:38 juju-e4d256-prod-github-runner-207 kernel: [32452.612536] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:24:38 juju-e4d256-prod-github-runner-207 kernel: [32452.613268] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:24:38 juju-e4d256-prod-github-runner-207 kernel: [32452.613987] ? do_syscall_64+0x69/0xc0 Aug 22 14:24:38 juju-e4d256-prod-github-runner-207 kernel: [32452.614634] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:24:38 juju-e4d256-prod-github-runner-207 kernel: [32452.615336] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:24:38 juju-e4d256-prod-github-runner-207 kernel: [32452.616031] ? do_syscall_64+0x69/0xc0 Aug 22 14:24:38 juju-e4d256-prod-github-runner-207 kernel: [32452.616654] ? do_syscall_64+0x69/0xc0 Aug 22 14:24:38 juju-e4d256-prod-github-runner-207 kernel: [32452.617288] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 14:24:38 juju-e4d256-prod-github-runner-207 kernel: [32452.617993] RIP: 0033:0x7faa5d0edaff Aug 22 14:24:38 juju-e4d256-prod-github-runner-207 kernel: [32452.618659] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 14:24:38 juju-e4d256-prod-github-runner-207 kernel: [32452.620661] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 14:24:38 juju-e4d256-prod-github-runner-207 kernel: [32452.621601] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 14:24:38 juju-e4d256-prod-github-runner-207 kernel: [32452.622489] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 14:24:38 juju-e4d256-prod-github-runner-207 kernel: [32452.623374] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 14:24:38 juju-e4d256-prod-github-runner-207 kernel: [32452.624263] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 14:24:38 juju-e4d256-prod-github-runner-207 kernel: [32452.625158] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 14:24:38 juju-e4d256-prod-github-runner-207 kernel: [32452.626057] Aug 22 14:25:06 juju-e4d256-prod-github-runner-207 kernel: [32480.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 30141s! [qemu-system-x86:6715] Aug 22 14:25:06 juju-e4d256-prod-github-runner-207 kernel: [32480.544093] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 14:25:06 juju-e4d256-prod-github-runner-207 kernel: [32480.544413] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 14:25:06 juju-e4d256-prod-github-runner-207 kernel: [32480.556853] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 14:25:06 juju-e4d256-prod-github-runner-207 kernel: [32480.558162] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 14:25:06 juju-e4d256-prod-github-runner-207 kernel: [32480.559723] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:25:06 juju-e4d256-prod-github-runner-207 kernel: [32480.561090] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 14:25:06 juju-e4d256-prod-github-runner-207 kernel: [32480.563948] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 14:25:06 juju-e4d256-prod-github-runner-207 kernel: [32480.565054] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 14:25:06 juju-e4d256-prod-github-runner-207 kernel: [32480.566384] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 14:25:06 juju-e4d256-prod-github-runner-207 kernel: [32480.567679] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 14:25:06 juju-e4d256-prod-github-runner-207 kernel: [32480.568928] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 14:25:06 juju-e4d256-prod-github-runner-207 kernel: [32480.570172] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 14:25:06 juju-e4d256-prod-github-runner-207 kernel: [32480.571432] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 14:25:06 juju-e4d256-prod-github-runner-207 kernel: [32480.572935] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 14:25:06 juju-e4d256-prod-github-runner-207 kernel: [32480.574216] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 14:25:06 juju-e4d256-prod-github-runner-207 kernel: [32480.575429] Call Trace: Aug 22 14:25:06 juju-e4d256-prod-github-runner-207 kernel: [32480.576428] Aug 22 14:25:06 juju-e4d256-prod-github-runner-207 kernel: [32480.577426] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:25:06 juju-e4d256-prod-github-runner-207 kernel: [32480.578481] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:25:06 juju-e4d256-prod-github-runner-207 kernel: [32480.579512] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:25:06 juju-e4d256-prod-github-runner-207 kernel: [32480.580632] ? show_regs.part.0+0x23/0x29 Aug 22 14:25:06 juju-e4d256-prod-github-runner-207 kernel: [32480.581630] ? show_regs.cold+0x8/0xd Aug 22 14:25:06 juju-e4d256-prod-github-runner-207 kernel: [32480.582602] ? watchdog_timer_fn+0x1be/0x220 Aug 22 14:25:06 juju-e4d256-prod-github-runner-207 kernel: [32480.583611] ? lockup_detector_update_enable+0x60/0x60 Aug 22 14:25:06 juju-e4d256-prod-github-runner-207 kernel: [32480.584685] ? __hrtimer_run_queues+0x107/0x230 Aug 22 14:25:06 juju-e4d256-prod-github-runner-207 kernel: [32480.585715] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 14:25:06 juju-e4d256-prod-github-runner-207 kernel: [32480.586742] ? hrtimer_interrupt+0x101/0x220 Aug 22 14:25:06 juju-e4d256-prod-github-runner-207 kernel: [32480.587754] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 14:25:06 juju-e4d256-prod-github-runner-207 kernel: [32480.588840] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 14:25:06 juju-e4d256-prod-github-runner-207 kernel: [32480.589891] Aug 22 14:25:06 juju-e4d256-prod-github-runner-207 kernel: [32480.590782] Aug 22 14:25:06 juju-e4d256-prod-github-runner-207 kernel: [32480.591639] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 14:25:06 juju-e4d256-prod-github-runner-207 kernel: [32480.592802] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:25:06 juju-e4d256-prod-github-runner-207 kernel: [32480.593934] ? _raw_spin_lock+0x22/0x30 Aug 22 14:25:06 juju-e4d256-prod-github-runner-207 kernel: [32480.594903] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:25:06 juju-e4d256-prod-github-runner-207 kernel: [32480.595928] direct_page_fault+0x206/0x310 [kvm] Aug 22 14:25:06 juju-e4d256-prod-github-runner-207 kernel: [32480.596988] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 14:25:06 juju-e4d256-prod-github-runner-207 kernel: [32480.598068] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 14:25:06 juju-e4d256-prod-github-runner-207 kernel: [32480.599079] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 14:25:06 juju-e4d256-prod-github-runner-207 kernel: [32480.600090] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 14:25:06 juju-e4d256-prod-github-runner-207 kernel: [32480.601077] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 14:25:06 juju-e4d256-prod-github-runner-207 kernel: [32480.602131] handle_exit+0x98/0x230 [kvm_amd] Aug 22 14:25:06 juju-e4d256-prod-github-runner-207 kernel: [32480.603127] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 14:25:06 juju-e4d256-prod-github-runner-207 kernel: [32480.604096] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 14:25:06 juju-e4d256-prod-github-runner-207 kernel: [32480.605065] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 14:25:06 juju-e4d256-prod-github-runner-207 kernel: [32480.605978] vcpu_run+0x62/0x2c0 [kvm] Aug 22 14:25:06 juju-e4d256-prod-github-runner-207 kernel: [32480.606796] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 14:25:06 juju-e4d256-prod-github-runner-207 kernel: [32480.607615] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 14:25:06 juju-e4d256-prod-github-runner-207 kernel: [32480.608483] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 14:25:06 juju-e4d256-prod-github-runner-207 kernel: [32480.609313] ? __seccomp_filter+0x4a/0x4a0 Aug 22 14:25:06 juju-e4d256-prod-github-runner-207 kernel: [32480.610065] ? __fget_files+0x86/0xc0 Aug 22 14:25:06 juju-e4d256-prod-github-runner-207 kernel: [32480.610793] __x64_sys_ioctl+0x95/0xd0 Aug 22 14:25:06 juju-e4d256-prod-github-runner-207 kernel: [32480.611509] do_syscall_64+0x5c/0xc0 Aug 22 14:25:06 juju-e4d256-prod-github-runner-207 kernel: [32480.612198] ? do_futex+0x162/0x1f0 Aug 22 14:25:06 juju-e4d256-prod-github-runner-207 kernel: [32480.612986] ? __x64_sys_futex+0x78/0x1e0 Aug 22 14:25:06 juju-e4d256-prod-github-runner-207 kernel: [32480.613744] ? __secure_computing+0xa9/0x120 Aug 22 14:25:06 juju-e4d256-prod-github-runner-207 kernel: [32480.614461] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 14:25:06 juju-e4d256-prod-github-runner-207 kernel: [32480.615236] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:25:06 juju-e4d256-prod-github-runner-207 kernel: [32480.615962] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:25:06 juju-e4d256-prod-github-runner-207 kernel: [32480.616862] ? do_syscall_64+0x69/0xc0 Aug 22 14:25:06 juju-e4d256-prod-github-runner-207 kernel: [32480.617517] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:25:06 juju-e4d256-prod-github-runner-207 kernel: [32480.618240] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:25:06 juju-e4d256-prod-github-runner-207 kernel: [32480.619028] ? do_syscall_64+0x69/0xc0 Aug 22 14:25:06 juju-e4d256-prod-github-runner-207 kernel: [32480.619735] ? do_syscall_64+0x69/0xc0 Aug 22 14:25:06 juju-e4d256-prod-github-runner-207 kernel: [32480.620508] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 14:25:06 juju-e4d256-prod-github-runner-207 kernel: [32480.621368] RIP: 0033:0x7faa5d0edaff Aug 22 14:25:06 juju-e4d256-prod-github-runner-207 kernel: [32480.622189] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 14:25:06 juju-e4d256-prod-github-runner-207 kernel: [32480.624653] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 14:25:06 juju-e4d256-prod-github-runner-207 kernel: [32480.625776] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 14:25:06 juju-e4d256-prod-github-runner-207 kernel: [32480.626673] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 14:25:06 juju-e4d256-prod-github-runner-207 kernel: [32480.627573] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 14:25:06 juju-e4d256-prod-github-runner-207 kernel: [32480.628464] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 14:25:06 juju-e4d256-prod-github-runner-207 kernel: [32480.629418] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 14:25:06 juju-e4d256-prod-github-runner-207 kernel: [32480.630329] Aug 22 14:25:34 juju-e4d256-prod-github-runner-207 kernel: [32508.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 30167s! [qemu-system-x86:6715] Aug 22 14:25:34 juju-e4d256-prod-github-runner-207 kernel: [32508.543111] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 14:25:34 juju-e4d256-prod-github-runner-207 kernel: [32508.543186] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 14:25:34 juju-e4d256-prod-github-runner-207 kernel: [32508.555345] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 14:25:34 juju-e4d256-prod-github-runner-207 kernel: [32508.556693] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 14:25:34 juju-e4d256-prod-github-runner-207 kernel: [32508.557928] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:25:34 juju-e4d256-prod-github-runner-207 kernel: [32508.558987] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 14:25:34 juju-e4d256-prod-github-runner-207 kernel: [32508.561559] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 14:25:34 juju-e4d256-prod-github-runner-207 kernel: [32508.562606] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 14:25:34 juju-e4d256-prod-github-runner-207 kernel: [32508.563768] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 14:25:34 juju-e4d256-prod-github-runner-207 kernel: [32508.564944] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 14:25:34 juju-e4d256-prod-github-runner-207 kernel: [32508.566104] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 14:25:34 juju-e4d256-prod-github-runner-207 kernel: [32508.567276] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 14:25:34 juju-e4d256-prod-github-runner-207 kernel: [32508.568448] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 14:25:34 juju-e4d256-prod-github-runner-207 kernel: [32508.569680] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 14:25:34 juju-e4d256-prod-github-runner-207 kernel: [32508.570784] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 14:25:34 juju-e4d256-prod-github-runner-207 kernel: [32508.571977] Call Trace: Aug 22 14:25:34 juju-e4d256-prod-github-runner-207 kernel: [32508.572921] Aug 22 14:25:34 juju-e4d256-prod-github-runner-207 kernel: [32508.573865] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:25:34 juju-e4d256-prod-github-runner-207 kernel: [32508.574970] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:25:34 juju-e4d256-prod-github-runner-207 kernel: [32508.575999] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:25:34 juju-e4d256-prod-github-runner-207 kernel: [32508.577083] ? show_regs.part.0+0x23/0x29 Aug 22 14:25:34 juju-e4d256-prod-github-runner-207 kernel: [32508.578080] ? show_regs.cold+0x8/0xd Aug 22 14:25:34 juju-e4d256-prod-github-runner-207 kernel: [32508.579051] ? watchdog_timer_fn+0x1be/0x220 Aug 22 14:25:34 juju-e4d256-prod-github-runner-207 kernel: [32508.580113] ? lockup_detector_update_enable+0x60/0x60 Aug 22 14:25:34 juju-e4d256-prod-github-runner-207 kernel: [32508.581244] ? __hrtimer_run_queues+0x107/0x230 Aug 22 14:25:34 juju-e4d256-prod-github-runner-207 kernel: [32508.582292] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 14:25:34 juju-e4d256-prod-github-runner-207 kernel: [32508.583358] ? hrtimer_interrupt+0x101/0x220 Aug 22 14:25:34 juju-e4d256-prod-github-runner-207 kernel: [32508.584463] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 14:25:34 juju-e4d256-prod-github-runner-207 kernel: [32508.585553] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 14:25:34 juju-e4d256-prod-github-runner-207 kernel: [32508.586764] Aug 22 14:25:34 juju-e4d256-prod-github-runner-207 kernel: [32508.587640] Aug 22 14:25:34 juju-e4d256-prod-github-runner-207 kernel: [32508.588496] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 14:25:34 juju-e4d256-prod-github-runner-207 kernel: [32508.589543] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:25:34 juju-e4d256-prod-github-runner-207 kernel: [32508.590580] ? _raw_spin_lock+0x22/0x30 Aug 22 14:25:34 juju-e4d256-prod-github-runner-207 kernel: [32508.591525] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:25:34 juju-e4d256-prod-github-runner-207 kernel: [32508.592561] direct_page_fault+0x206/0x310 [kvm] Aug 22 14:25:34 juju-e4d256-prod-github-runner-207 kernel: [32508.593587] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 14:25:34 juju-e4d256-prod-github-runner-207 kernel: [32508.594594] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 14:25:34 juju-e4d256-prod-github-runner-207 kernel: [32508.595600] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 14:25:34 juju-e4d256-prod-github-runner-207 kernel: [32508.596582] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 14:25:34 juju-e4d256-prod-github-runner-207 kernel: [32508.597533] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 14:25:34 juju-e4d256-prod-github-runner-207 kernel: [32508.598523] handle_exit+0x98/0x230 [kvm_amd] Aug 22 14:25:34 juju-e4d256-prod-github-runner-207 kernel: [32508.599425] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 14:25:34 juju-e4d256-prod-github-runner-207 kernel: [32508.600356] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 14:25:34 juju-e4d256-prod-github-runner-207 kernel: [32508.601286] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 14:25:34 juju-e4d256-prod-github-runner-207 kernel: [32508.602193] vcpu_run+0x62/0x2c0 [kvm] Aug 22 14:25:34 juju-e4d256-prod-github-runner-207 kernel: [32508.603012] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 14:25:34 juju-e4d256-prod-github-runner-207 kernel: [32508.603819] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 14:25:34 juju-e4d256-prod-github-runner-207 kernel: [32508.604681] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 14:25:34 juju-e4d256-prod-github-runner-207 kernel: [32508.605483] ? __seccomp_filter+0x4a/0x4a0 Aug 22 14:25:34 juju-e4d256-prod-github-runner-207 kernel: [32508.606254] ? __fget_files+0x86/0xc0 Aug 22 14:25:34 juju-e4d256-prod-github-runner-207 kernel: [32508.607016] __x64_sys_ioctl+0x95/0xd0 Aug 22 14:25:34 juju-e4d256-prod-github-runner-207 kernel: [32508.607717] do_syscall_64+0x5c/0xc0 Aug 22 14:25:34 juju-e4d256-prod-github-runner-207 kernel: [32508.608407] ? do_futex+0x162/0x1f0 Aug 22 14:25:34 juju-e4d256-prod-github-runner-207 kernel: [32508.609058] ? __x64_sys_futex+0x78/0x1e0 Aug 22 14:25:34 juju-e4d256-prod-github-runner-207 kernel: [32508.609731] ? __secure_computing+0xa9/0x120 Aug 22 14:25:34 juju-e4d256-prod-github-runner-207 kernel: [32508.610420] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 14:25:34 juju-e4d256-prod-github-runner-207 kernel: [32508.611239] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:25:34 juju-e4d256-prod-github-runner-207 kernel: [32508.611979] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:25:34 juju-e4d256-prod-github-runner-207 kernel: [32508.612714] ? do_syscall_64+0x69/0xc0 Aug 22 14:25:34 juju-e4d256-prod-github-runner-207 kernel: [32508.613360] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:25:34 juju-e4d256-prod-github-runner-207 kernel: [32508.614064] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:25:34 juju-e4d256-prod-github-runner-207 kernel: [32508.614759] ? do_syscall_64+0x69/0xc0 Aug 22 14:25:34 juju-e4d256-prod-github-runner-207 kernel: [32508.615384] ? do_syscall_64+0x69/0xc0 Aug 22 14:25:34 juju-e4d256-prod-github-runner-207 kernel: [32508.616012] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 14:25:34 juju-e4d256-prod-github-runner-207 kernel: [32508.616734] RIP: 0033:0x7faa5d0edaff Aug 22 14:25:34 juju-e4d256-prod-github-runner-207 kernel: [32508.617359] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 14:25:34 juju-e4d256-prod-github-runner-207 kernel: [32508.619347] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 14:25:34 juju-e4d256-prod-github-runner-207 kernel: [32508.620269] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 14:25:34 juju-e4d256-prod-github-runner-207 kernel: [32508.621159] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 14:25:34 juju-e4d256-prod-github-runner-207 kernel: [32508.622059] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 14:25:34 juju-e4d256-prod-github-runner-207 kernel: [32508.622947] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 14:25:34 juju-e4d256-prod-github-runner-207 kernel: [32508.623840] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 14:25:34 juju-e4d256-prod-github-runner-207 kernel: [32508.624837] Aug 22 14:26:02 juju-e4d256-prod-github-runner-207 kernel: [32536.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 30194s! [qemu-system-x86:6715] Aug 22 14:26:02 juju-e4d256-prod-github-runner-207 kernel: [32536.543927] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 14:26:02 juju-e4d256-prod-github-runner-207 kernel: [32536.544243] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 14:26:02 juju-e4d256-prod-github-runner-207 kernel: [32536.556881] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 14:26:02 juju-e4d256-prod-github-runner-207 kernel: [32536.558203] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 14:26:02 juju-e4d256-prod-github-runner-207 kernel: [32536.559791] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:26:02 juju-e4d256-prod-github-runner-207 kernel: [32536.560969] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 14:26:02 juju-e4d256-prod-github-runner-207 kernel: [32536.563581] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 14:26:02 juju-e4d256-prod-github-runner-207 kernel: [32536.564695] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 14:26:02 juju-e4d256-prod-github-runner-207 kernel: [32536.565878] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 14:26:02 juju-e4d256-prod-github-runner-207 kernel: [32536.567056] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 14:26:02 juju-e4d256-prod-github-runner-207 kernel: [32536.568248] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 14:26:02 juju-e4d256-prod-github-runner-207 kernel: [32536.569444] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 14:26:02 juju-e4d256-prod-github-runner-207 kernel: [32536.570636] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 14:26:02 juju-e4d256-prod-github-runner-207 kernel: [32536.571897] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 14:26:02 juju-e4d256-prod-github-runner-207 kernel: [32536.573022] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 14:26:02 juju-e4d256-prod-github-runner-207 kernel: [32536.574249] Call Trace: Aug 22 14:26:02 juju-e4d256-prod-github-runner-207 kernel: [32536.575208] Aug 22 14:26:02 juju-e4d256-prod-github-runner-207 kernel: [32536.576164] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:26:02 juju-e4d256-prod-github-runner-207 kernel: [32536.577208] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:26:02 juju-e4d256-prod-github-runner-207 kernel: [32536.578254] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:26:02 juju-e4d256-prod-github-runner-207 kernel: [32536.579370] ? show_regs.part.0+0x23/0x29 Aug 22 14:26:02 juju-e4d256-prod-github-runner-207 kernel: [32536.580391] ? show_regs.cold+0x8/0xd Aug 22 14:26:02 juju-e4d256-prod-github-runner-207 kernel: [32536.581381] ? watchdog_timer_fn+0x1be/0x220 Aug 22 14:26:02 juju-e4d256-prod-github-runner-207 kernel: [32536.582404] ? lockup_detector_update_enable+0x60/0x60 Aug 22 14:26:02 juju-e4d256-prod-github-runner-207 kernel: [32536.583487] ? __hrtimer_run_queues+0x107/0x230 Aug 22 14:26:02 juju-e4d256-prod-github-runner-207 kernel: [32536.584540] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 14:26:02 juju-e4d256-prod-github-runner-207 kernel: [32536.585589] ? hrtimer_interrupt+0x101/0x220 Aug 22 14:26:02 juju-e4d256-prod-github-runner-207 kernel: [32536.586650] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 14:26:02 juju-e4d256-prod-github-runner-207 kernel: [32536.587749] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 14:26:02 juju-e4d256-prod-github-runner-207 kernel: [32536.588844] Aug 22 14:26:02 juju-e4d256-prod-github-runner-207 kernel: [32536.589807] Aug 22 14:26:02 juju-e4d256-prod-github-runner-207 kernel: [32536.590829] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 14:26:02 juju-e4d256-prod-github-runner-207 kernel: [32536.591937] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:26:02 juju-e4d256-prod-github-runner-207 kernel: [32536.593039] ? _raw_spin_lock+0x22/0x30 Aug 22 14:26:02 juju-e4d256-prod-github-runner-207 kernel: [32536.593995] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:26:02 juju-e4d256-prod-github-runner-207 kernel: [32536.595191] direct_page_fault+0x206/0x310 [kvm] Aug 22 14:26:02 juju-e4d256-prod-github-runner-207 kernel: [32536.596320] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 14:26:02 juju-e4d256-prod-github-runner-207 kernel: [32536.597503] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 14:26:02 juju-e4d256-prod-github-runner-207 kernel: [32536.598528] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 14:26:02 juju-e4d256-prod-github-runner-207 kernel: [32536.599565] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 14:26:02 juju-e4d256-prod-github-runner-207 kernel: [32536.600557] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 14:26:02 juju-e4d256-prod-github-runner-207 kernel: [32536.601553] handle_exit+0x98/0x230 [kvm_amd] Aug 22 14:26:02 juju-e4d256-prod-github-runner-207 kernel: [32536.602481] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 14:26:02 juju-e4d256-prod-github-runner-207 kernel: [32536.603407] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 14:26:02 juju-e4d256-prod-github-runner-207 kernel: [32536.604359] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 14:26:02 juju-e4d256-prod-github-runner-207 kernel: [32536.605273] vcpu_run+0x62/0x2c0 [kvm] Aug 22 14:26:02 juju-e4d256-prod-github-runner-207 kernel: [32536.606097] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 14:26:02 juju-e4d256-prod-github-runner-207 kernel: [32536.606919] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 14:26:02 juju-e4d256-prod-github-runner-207 kernel: [32536.607789] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 14:26:02 juju-e4d256-prod-github-runner-207 kernel: [32536.608608] ? __seccomp_filter+0x4a/0x4a0 Aug 22 14:26:02 juju-e4d256-prod-github-runner-207 kernel: [32536.609371] ? __fget_files+0x86/0xc0 Aug 22 14:26:02 juju-e4d256-prod-github-runner-207 kernel: [32536.610090] __x64_sys_ioctl+0x95/0xd0 Aug 22 14:26:02 juju-e4d256-prod-github-runner-207 kernel: [32536.610792] do_syscall_64+0x5c/0xc0 Aug 22 14:26:02 juju-e4d256-prod-github-runner-207 kernel: [32536.611465] ? do_futex+0x162/0x1f0 Aug 22 14:26:02 juju-e4d256-prod-github-runner-207 kernel: [32536.612130] ? __x64_sys_futex+0x78/0x1e0 Aug 22 14:26:02 juju-e4d256-prod-github-runner-207 kernel: [32536.612817] ? __secure_computing+0xa9/0x120 Aug 22 14:26:02 juju-e4d256-prod-github-runner-207 kernel: [32536.613515] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 14:26:02 juju-e4d256-prod-github-runner-207 kernel: [32536.614317] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:26:02 juju-e4d256-prod-github-runner-207 kernel: [32536.615062] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:26:02 juju-e4d256-prod-github-runner-207 kernel: [32536.615804] ? do_syscall_64+0x69/0xc0 Aug 22 14:26:02 juju-e4d256-prod-github-runner-207 kernel: [32536.616532] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:26:02 juju-e4d256-prod-github-runner-207 kernel: [32536.617270] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:26:02 juju-e4d256-prod-github-runner-207 kernel: [32536.617985] ? do_syscall_64+0x69/0xc0 Aug 22 14:26:02 juju-e4d256-prod-github-runner-207 kernel: [32536.618624] ? do_syscall_64+0x69/0xc0 Aug 22 14:26:02 juju-e4d256-prod-github-runner-207 kernel: [32536.619267] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 14:26:02 juju-e4d256-prod-github-runner-207 kernel: [32536.620081] RIP: 0033:0x7faa5d0edaff Aug 22 14:26:02 juju-e4d256-prod-github-runner-207 kernel: [32536.620913] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 14:26:02 juju-e4d256-prod-github-runner-207 kernel: [32536.623221] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 14:26:02 juju-e4d256-prod-github-runner-207 kernel: [32536.624220] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 14:26:02 juju-e4d256-prod-github-runner-207 kernel: [32536.625133] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 14:26:02 juju-e4d256-prod-github-runner-207 kernel: [32536.626053] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 14:26:02 juju-e4d256-prod-github-runner-207 kernel: [32536.626981] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 14:26:02 juju-e4d256-prod-github-runner-207 kernel: [32536.627902] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 14:26:02 juju-e4d256-prod-github-runner-207 kernel: [32536.628835] Aug 22 14:26:30 juju-e4d256-prod-github-runner-207 kernel: [32564.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 30220s! [qemu-system-x86:6715] Aug 22 14:26:30 juju-e4d256-prod-github-runner-207 kernel: [32564.543110] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 14:26:30 juju-e4d256-prod-github-runner-207 kernel: [32564.543188] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 14:26:30 juju-e4d256-prod-github-runner-207 kernel: [32564.555519] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 14:26:30 juju-e4d256-prod-github-runner-207 kernel: [32564.556803] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 14:26:30 juju-e4d256-prod-github-runner-207 kernel: [32564.558029] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:26:30 juju-e4d256-prod-github-runner-207 kernel: [32564.559091] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 14:26:30 juju-e4d256-prod-github-runner-207 kernel: [32564.561653] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 14:26:30 juju-e4d256-prod-github-runner-207 kernel: [32564.562696] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 14:26:30 juju-e4d256-prod-github-runner-207 kernel: [32564.563874] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 14:26:30 juju-e4d256-prod-github-runner-207 kernel: [32564.565040] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 14:26:30 juju-e4d256-prod-github-runner-207 kernel: [32564.566206] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 14:26:30 juju-e4d256-prod-github-runner-207 kernel: [32564.567371] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 14:26:30 juju-e4d256-prod-github-runner-207 kernel: [32564.568562] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 14:26:30 juju-e4d256-prod-github-runner-207 kernel: [32564.569798] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 14:26:30 juju-e4d256-prod-github-runner-207 kernel: [32564.570896] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 14:26:30 juju-e4d256-prod-github-runner-207 kernel: [32564.572105] Call Trace: Aug 22 14:26:30 juju-e4d256-prod-github-runner-207 kernel: [32564.573024] Aug 22 14:26:30 juju-e4d256-prod-github-runner-207 kernel: [32564.573908] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:26:30 juju-e4d256-prod-github-runner-207 kernel: [32564.574934] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:26:30 juju-e4d256-prod-github-runner-207 kernel: [32564.575962] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:26:30 juju-e4d256-prod-github-runner-207 kernel: [32564.577035] ? show_regs.part.0+0x23/0x29 Aug 22 14:26:30 juju-e4d256-prod-github-runner-207 kernel: [32564.578029] ? show_regs.cold+0x8/0xd Aug 22 14:26:30 juju-e4d256-prod-github-runner-207 kernel: [32564.578997] ? watchdog_timer_fn+0x1be/0x220 Aug 22 14:26:30 juju-e4d256-prod-github-runner-207 kernel: [32564.580018] ? lockup_detector_update_enable+0x60/0x60 Aug 22 14:26:30 juju-e4d256-prod-github-runner-207 kernel: [32564.581081] ? __hrtimer_run_queues+0x107/0x230 Aug 22 14:26:30 juju-e4d256-prod-github-runner-207 kernel: [32564.582121] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 14:26:30 juju-e4d256-prod-github-runner-207 kernel: [32564.583156] ? hrtimer_interrupt+0x101/0x220 Aug 22 14:26:30 juju-e4d256-prod-github-runner-207 kernel: [32564.584190] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 14:26:30 juju-e4d256-prod-github-runner-207 kernel: [32564.585261] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 14:26:30 juju-e4d256-prod-github-runner-207 kernel: [32564.586311] Aug 22 14:26:30 juju-e4d256-prod-github-runner-207 kernel: [32564.587164] Aug 22 14:26:30 juju-e4d256-prod-github-runner-207 kernel: [32564.588089] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 14:26:30 juju-e4d256-prod-github-runner-207 kernel: [32564.589169] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:26:30 juju-e4d256-prod-github-runner-207 kernel: [32564.590223] ? _raw_spin_lock+0x22/0x30 Aug 22 14:26:30 juju-e4d256-prod-github-runner-207 kernel: [32564.591180] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:26:30 juju-e4d256-prod-github-runner-207 kernel: [32564.592223] direct_page_fault+0x206/0x310 [kvm] Aug 22 14:26:30 juju-e4d256-prod-github-runner-207 kernel: [32564.593255] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 14:26:30 juju-e4d256-prod-github-runner-207 kernel: [32564.594261] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 14:26:30 juju-e4d256-prod-github-runner-207 kernel: [32564.595276] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 14:26:30 juju-e4d256-prod-github-runner-207 kernel: [32564.596266] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 14:26:30 juju-e4d256-prod-github-runner-207 kernel: [32564.597210] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 14:26:30 juju-e4d256-prod-github-runner-207 kernel: [32564.598185] handle_exit+0x98/0x230 [kvm_amd] Aug 22 14:26:30 juju-e4d256-prod-github-runner-207 kernel: [32564.599075] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 14:26:30 juju-e4d256-prod-github-runner-207 kernel: [32564.600002] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 14:26:30 juju-e4d256-prod-github-runner-207 kernel: [32564.600927] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 14:26:30 juju-e4d256-prod-github-runner-207 kernel: [32564.601886] vcpu_run+0x62/0x2c0 [kvm] Aug 22 14:26:30 juju-e4d256-prod-github-runner-207 kernel: [32564.602702] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 14:26:30 juju-e4d256-prod-github-runner-207 kernel: [32564.603512] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 14:26:30 juju-e4d256-prod-github-runner-207 kernel: [32564.604377] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 14:26:30 juju-e4d256-prod-github-runner-207 kernel: [32564.605178] ? __seccomp_filter+0x4a/0x4a0 Aug 22 14:26:30 juju-e4d256-prod-github-runner-207 kernel: [32564.605921] ? __fget_files+0x86/0xc0 Aug 22 14:26:30 juju-e4d256-prod-github-runner-207 kernel: [32564.606626] __x64_sys_ioctl+0x95/0xd0 Aug 22 14:26:30 juju-e4d256-prod-github-runner-207 kernel: [32564.607318] do_syscall_64+0x5c/0xc0 Aug 22 14:26:30 juju-e4d256-prod-github-runner-207 kernel: [32564.607994] ? do_futex+0x162/0x1f0 Aug 22 14:26:30 juju-e4d256-prod-github-runner-207 kernel: [32564.608642] ? __x64_sys_futex+0x78/0x1e0 Aug 22 14:26:30 juju-e4d256-prod-github-runner-207 kernel: [32564.609317] ? __secure_computing+0xa9/0x120 Aug 22 14:26:30 juju-e4d256-prod-github-runner-207 kernel: [32564.610005] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 14:26:30 juju-e4d256-prod-github-runner-207 kernel: [32564.610766] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:26:30 juju-e4d256-prod-github-runner-207 kernel: [32564.611527] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:26:30 juju-e4d256-prod-github-runner-207 kernel: [32564.612265] ? do_syscall_64+0x69/0xc0 Aug 22 14:26:30 juju-e4d256-prod-github-runner-207 kernel: [32564.612911] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:26:30 juju-e4d256-prod-github-runner-207 kernel: [32564.613612] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:26:30 juju-e4d256-prod-github-runner-207 kernel: [32564.614308] ? do_syscall_64+0x69/0xc0 Aug 22 14:26:30 juju-e4d256-prod-github-runner-207 kernel: [32564.614952] ? do_syscall_64+0x69/0xc0 Aug 22 14:26:30 juju-e4d256-prod-github-runner-207 kernel: [32564.615610] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 14:26:30 juju-e4d256-prod-github-runner-207 kernel: [32564.616314] RIP: 0033:0x7faa5d0edaff Aug 22 14:26:30 juju-e4d256-prod-github-runner-207 kernel: [32564.616938] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 14:26:30 juju-e4d256-prod-github-runner-207 kernel: [32564.618954] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 14:26:30 juju-e4d256-prod-github-runner-207 kernel: [32564.619881] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 14:26:30 juju-e4d256-prod-github-runner-207 kernel: [32564.620771] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 14:26:30 juju-e4d256-prod-github-runner-207 kernel: [32564.621659] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 14:26:30 juju-e4d256-prod-github-runner-207 kernel: [32564.622707] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 14:26:30 juju-e4d256-prod-github-runner-207 kernel: [32564.623642] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 14:26:30 juju-e4d256-prod-github-runner-207 kernel: [32564.624594] Aug 22 14:26:45 juju-e4d256-prod-github-runner-207 kernel: [32579.360707] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 14:26:45 juju-e4d256-prod-github-runner-207 kernel: [32579.361688] rcu: 1-....: (8090203 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=3908860 Aug 22 14:26:45 juju-e4d256-prod-github-runner-207 kernel: [32579.362802] (t=8115540 jiffies g=23269 q=35330) Aug 22 14:26:45 juju-e4d256-prod-github-runner-207 kernel: [32579.363593] NMI backtrace for cpu 1 Aug 22 14:26:45 juju-e4d256-prod-github-runner-207 kernel: [32579.364309] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 14:26:45 juju-e4d256-prod-github-runner-207 kernel: [32579.365411] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 14:26:45 juju-e4d256-prod-github-runner-207 kernel: [32579.366466] Call Trace: Aug 22 14:26:45 juju-e4d256-prod-github-runner-207 kernel: [32579.367173] Aug 22 14:26:45 juju-e4d256-prod-github-runner-207 kernel: [32579.367857] show_stack+0x52/0x5c Aug 22 14:26:45 juju-e4d256-prod-github-runner-207 kernel: [32579.368610] dump_stack_lvl+0x4a/0x63 Aug 22 14:26:45 juju-e4d256-prod-github-runner-207 kernel: [32579.369438] dump_stack+0x10/0x16 Aug 22 14:26:45 juju-e4d256-prod-github-runner-207 kernel: [32579.370220] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 14:26:45 juju-e4d256-prod-github-runner-207 kernel: [32579.371044] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 14:26:45 juju-e4d256-prod-github-runner-207 kernel: [32579.371879] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 14:26:45 juju-e4d256-prod-github-runner-207 kernel: [32579.372715] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 14:26:45 juju-e4d256-prod-github-runner-207 kernel: [32579.373554] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 14:26:45 juju-e4d256-prod-github-runner-207 kernel: [32579.374370] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 14:26:45 juju-e4d256-prod-github-runner-207 kernel: [32579.375149] print_cpu_stall.cold+0x2f/0xe2 Aug 22 14:26:45 juju-e4d256-prod-github-runner-207 kernel: [32579.375927] ? timekeeping_update+0xf7/0x150 Aug 22 14:26:45 juju-e4d256-prod-github-runner-207 kernel: [32579.376699] check_cpu_stall+0x109/0x270 Aug 22 14:26:45 juju-e4d256-prod-github-runner-207 kernel: [32579.377454] rcu_sched_clock_irq+0x9a/0x250 Aug 22 14:26:45 juju-e4d256-prod-github-runner-207 kernel: [32579.378221] update_process_times+0x94/0xd0 Aug 22 14:26:45 juju-e4d256-prod-github-runner-207 kernel: [32579.379023] tick_sched_handle+0x29/0x70 Aug 22 14:26:45 juju-e4d256-prod-github-runner-207 kernel: [32579.379807] tick_sched_timer+0x8c/0xc0 Aug 22 14:26:45 juju-e4d256-prod-github-runner-207 kernel: [32579.380580] ? tick_nohz_handler+0xb0/0xb0 Aug 22 14:26:45 juju-e4d256-prod-github-runner-207 kernel: [32579.381362] __hrtimer_run_queues+0x107/0x230 Aug 22 14:26:45 juju-e4d256-prod-github-runner-207 kernel: [32579.382133] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 14:26:45 juju-e4d256-prod-github-runner-207 kernel: [32579.382910] hrtimer_interrupt+0x101/0x220 Aug 22 14:26:45 juju-e4d256-prod-github-runner-207 kernel: [32579.383683] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 14:26:45 juju-e4d256-prod-github-runner-207 kernel: [32579.384502] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 14:26:45 juju-e4d256-prod-github-runner-207 kernel: [32579.385304] Aug 22 14:26:45 juju-e4d256-prod-github-runner-207 kernel: [32579.385938] Aug 22 14:26:45 juju-e4d256-prod-github-runner-207 kernel: [32579.386570] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 14:26:45 juju-e4d256-prod-github-runner-207 kernel: [32579.387388] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:26:45 juju-e4d256-prod-github-runner-207 kernel: [32579.388275] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 14:26:45 juju-e4d256-prod-github-runner-207 kernel: [32579.390471] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 14:26:45 juju-e4d256-prod-github-runner-207 kernel: [32579.391345] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 14:26:45 juju-e4d256-prod-github-runner-207 kernel: [32579.392390] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 14:26:45 juju-e4d256-prod-github-runner-207 kernel: [32579.393372] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 14:26:45 juju-e4d256-prod-github-runner-207 kernel: [32579.394357] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 14:26:45 juju-e4d256-prod-github-runner-207 kernel: [32579.395333] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 14:26:45 juju-e4d256-prod-github-runner-207 kernel: [32579.396298] ? _raw_spin_lock+0x22/0x30 Aug 22 14:26:45 juju-e4d256-prod-github-runner-207 kernel: [32579.397088] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:26:45 juju-e4d256-prod-github-runner-207 kernel: [32579.397986] direct_page_fault+0x206/0x310 [kvm] Aug 22 14:26:45 juju-e4d256-prod-github-runner-207 kernel: [32579.398931] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 14:26:45 juju-e4d256-prod-github-runner-207 kernel: [32579.399834] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 14:26:45 juju-e4d256-prod-github-runner-207 kernel: [32579.400673] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 14:26:45 juju-e4d256-prod-github-runner-207 kernel: [32579.401480] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 14:26:45 juju-e4d256-prod-github-runner-207 kernel: [32579.402272] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 14:26:45 juju-e4d256-prod-github-runner-207 kernel: [32579.403093] handle_exit+0x98/0x230 [kvm_amd] Aug 22 14:26:45 juju-e4d256-prod-github-runner-207 kernel: [32579.403855] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 14:26:45 juju-e4d256-prod-github-runner-207 kernel: [32579.404657] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 14:26:45 juju-e4d256-prod-github-runner-207 kernel: [32579.405461] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 14:26:45 juju-e4d256-prod-github-runner-207 kernel: [32579.406250] vcpu_run+0x62/0x2c0 [kvm] Aug 22 14:26:45 juju-e4d256-prod-github-runner-207 kernel: [32579.406986] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 14:26:45 juju-e4d256-prod-github-runner-207 kernel: [32579.407790] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 14:26:45 juju-e4d256-prod-github-runner-207 kernel: [32579.408668] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 14:26:45 juju-e4d256-prod-github-runner-207 kernel: [32579.409442] ? __seccomp_filter+0x4a/0x4a0 Aug 22 14:26:45 juju-e4d256-prod-github-runner-207 kernel: [32579.410186] ? __fget_files+0x86/0xc0 Aug 22 14:26:45 juju-e4d256-prod-github-runner-207 kernel: [32579.410886] __x64_sys_ioctl+0x95/0xd0 Aug 22 14:26:45 juju-e4d256-prod-github-runner-207 kernel: [32579.411601] do_syscall_64+0x5c/0xc0 Aug 22 14:26:45 juju-e4d256-prod-github-runner-207 kernel: [32579.412281] ? do_futex+0x162/0x1f0 Aug 22 14:26:45 juju-e4d256-prod-github-runner-207 kernel: [32579.412958] ? __x64_sys_futex+0x78/0x1e0 Aug 22 14:26:45 juju-e4d256-prod-github-runner-207 kernel: [32579.413657] ? __secure_computing+0xa9/0x120 Aug 22 14:26:45 juju-e4d256-prod-github-runner-207 kernel: [32579.414378] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 14:26:45 juju-e4d256-prod-github-runner-207 kernel: [32579.415192] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:26:45 juju-e4d256-prod-github-runner-207 kernel: [32579.416175] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:26:45 juju-e4d256-prod-github-runner-207 kernel: [32579.416931] ? do_syscall_64+0x69/0xc0 Aug 22 14:26:45 juju-e4d256-prod-github-runner-207 kernel: [32579.417622] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:26:45 juju-e4d256-prod-github-runner-207 kernel: [32579.418377] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:26:45 juju-e4d256-prod-github-runner-207 kernel: [32579.419135] ? do_syscall_64+0x69/0xc0 Aug 22 14:26:45 juju-e4d256-prod-github-runner-207 kernel: [32579.419838] ? do_syscall_64+0x69/0xc0 Aug 22 14:26:45 juju-e4d256-prod-github-runner-207 kernel: [32579.420531] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 14:26:45 juju-e4d256-prod-github-runner-207 kernel: [32579.421306] RIP: 0033:0x7faa5d0edaff Aug 22 14:26:45 juju-e4d256-prod-github-runner-207 kernel: [32579.421990] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 14:26:45 juju-e4d256-prod-github-runner-207 kernel: [32579.424118] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 14:26:45 juju-e4d256-prod-github-runner-207 kernel: [32579.425082] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 14:26:45 juju-e4d256-prod-github-runner-207 kernel: [32579.426029] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 14:26:45 juju-e4d256-prod-github-runner-207 kernel: [32579.426980] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 14:26:45 juju-e4d256-prod-github-runner-207 kernel: [32579.427932] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 14:26:45 juju-e4d256-prod-github-runner-207 kernel: [32579.428854] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 14:26:45 juju-e4d256-prod-github-runner-207 kernel: [32579.429764] Aug 22 14:27:10 juju-e4d256-prod-github-runner-207 kernel: [32604.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 30257s! [qemu-system-x86:6715] Aug 22 14:27:10 juju-e4d256-prod-github-runner-207 kernel: [32604.543844] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 14:27:10 juju-e4d256-prod-github-runner-207 kernel: [32604.544158] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 14:27:10 juju-e4d256-prod-github-runner-207 kernel: [32604.556471] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 14:27:10 juju-e4d256-prod-github-runner-207 kernel: [32604.557740] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 14:27:10 juju-e4d256-prod-github-runner-207 kernel: [32604.559020] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:27:10 juju-e4d256-prod-github-runner-207 kernel: [32604.560089] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 14:27:10 juju-e4d256-prod-github-runner-207 kernel: [32604.562662] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 14:27:10 juju-e4d256-prod-github-runner-207 kernel: [32604.563740] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 14:27:10 juju-e4d256-prod-github-runner-207 kernel: [32604.564902] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 14:27:10 juju-e4d256-prod-github-runner-207 kernel: [32604.566065] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 14:27:10 juju-e4d256-prod-github-runner-207 kernel: [32604.567245] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 14:27:10 juju-e4d256-prod-github-runner-207 kernel: [32604.568408] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 14:27:10 juju-e4d256-prod-github-runner-207 kernel: [32604.569577] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 14:27:10 juju-e4d256-prod-github-runner-207 kernel: [32604.570808] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 14:27:10 juju-e4d256-prod-github-runner-207 kernel: [32604.571928] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 14:27:10 juju-e4d256-prod-github-runner-207 kernel: [32604.573158] Call Trace: Aug 22 14:27:10 juju-e4d256-prod-github-runner-207 kernel: [32604.574077] Aug 22 14:27:10 juju-e4d256-prod-github-runner-207 kernel: [32604.575279] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:27:10 juju-e4d256-prod-github-runner-207 kernel: [32604.576329] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:27:10 juju-e4d256-prod-github-runner-207 kernel: [32604.577354] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:27:10 juju-e4d256-prod-github-runner-207 kernel: [32604.578454] ? show_regs.part.0+0x23/0x29 Aug 22 14:27:10 juju-e4d256-prod-github-runner-207 kernel: [32604.579467] ? show_regs.cold+0x8/0xd Aug 22 14:27:10 juju-e4d256-prod-github-runner-207 kernel: [32604.580437] ? watchdog_timer_fn+0x1be/0x220 Aug 22 14:27:10 juju-e4d256-prod-github-runner-207 kernel: [32604.581448] ? lockup_detector_update_enable+0x60/0x60 Aug 22 14:27:10 juju-e4d256-prod-github-runner-207 kernel: [32604.582531] ? __hrtimer_run_queues+0x107/0x230 Aug 22 14:27:10 juju-e4d256-prod-github-runner-207 kernel: [32604.583574] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 14:27:10 juju-e4d256-prod-github-runner-207 kernel: [32604.584609] ? hrtimer_interrupt+0x101/0x220 Aug 22 14:27:10 juju-e4d256-prod-github-runner-207 kernel: [32604.585629] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 14:27:10 juju-e4d256-prod-github-runner-207 kernel: [32604.586694] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 14:27:10 juju-e4d256-prod-github-runner-207 kernel: [32604.587753] Aug 22 14:27:10 juju-e4d256-prod-github-runner-207 kernel: [32604.588609] Aug 22 14:27:10 juju-e4d256-prod-github-runner-207 kernel: [32604.589444] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 14:27:10 juju-e4d256-prod-github-runner-207 kernel: [32604.590497] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:27:10 juju-e4d256-prod-github-runner-207 kernel: [32604.591552] ? _raw_spin_lock+0x22/0x30 Aug 22 14:27:10 juju-e4d256-prod-github-runner-207 kernel: [32604.592494] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:27:10 juju-e4d256-prod-github-runner-207 kernel: [32604.593508] direct_page_fault+0x206/0x310 [kvm] Aug 22 14:27:10 juju-e4d256-prod-github-runner-207 kernel: [32604.594533] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 14:27:10 juju-e4d256-prod-github-runner-207 kernel: [32604.595545] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 14:27:10 juju-e4d256-prod-github-runner-207 kernel: [32604.597085] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 14:27:10 juju-e4d256-prod-github-runner-207 kernel: [32604.598092] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 14:27:10 juju-e4d256-prod-github-runner-207 kernel: [32604.599255] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 14:27:10 juju-e4d256-prod-github-runner-207 kernel: [32604.600230] handle_exit+0x98/0x230 [kvm_amd] Aug 22 14:27:10 juju-e4d256-prod-github-runner-207 kernel: [32604.601164] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 14:27:10 juju-e4d256-prod-github-runner-207 kernel: [32604.602299] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 14:27:10 juju-e4d256-prod-github-runner-207 kernel: [32604.603247] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 14:27:10 juju-e4d256-prod-github-runner-207 kernel: [32604.604150] vcpu_run+0x62/0x2c0 [kvm] Aug 22 14:27:10 juju-e4d256-prod-github-runner-207 kernel: [32604.604966] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 14:27:10 juju-e4d256-prod-github-runner-207 kernel: [32604.605785] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 14:27:10 juju-e4d256-prod-github-runner-207 kernel: [32604.606658] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 14:27:10 juju-e4d256-prod-github-runner-207 kernel: [32604.607486] ? __seccomp_filter+0x4a/0x4a0 Aug 22 14:27:10 juju-e4d256-prod-github-runner-207 kernel: [32604.608229] ? __fget_files+0x86/0xc0 Aug 22 14:27:10 juju-e4d256-prod-github-runner-207 kernel: [32604.608937] __x64_sys_ioctl+0x95/0xd0 Aug 22 14:27:10 juju-e4d256-prod-github-runner-207 kernel: [32604.609628] do_syscall_64+0x5c/0xc0 Aug 22 14:27:10 juju-e4d256-prod-github-runner-207 kernel: [32604.610290] ? do_futex+0x162/0x1f0 Aug 22 14:27:10 juju-e4d256-prod-github-runner-207 kernel: [32604.610938] ? __x64_sys_futex+0x78/0x1e0 Aug 22 14:27:10 juju-e4d256-prod-github-runner-207 kernel: [32604.611619] ? __secure_computing+0xa9/0x120 Aug 22 14:27:10 juju-e4d256-prod-github-runner-207 kernel: [32604.612307] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 14:27:10 juju-e4d256-prod-github-runner-207 kernel: [32604.613068] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:27:10 juju-e4d256-prod-github-runner-207 kernel: [32604.613801] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:27:10 juju-e4d256-prod-github-runner-207 kernel: [32604.614536] ? do_syscall_64+0x69/0xc0 Aug 22 14:27:10 juju-e4d256-prod-github-runner-207 kernel: [32604.615187] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:27:10 juju-e4d256-prod-github-runner-207 kernel: [32604.615889] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:27:10 juju-e4d256-prod-github-runner-207 kernel: [32604.616582] ? do_syscall_64+0x69/0xc0 Aug 22 14:27:10 juju-e4d256-prod-github-runner-207 kernel: [32604.617208] ? do_syscall_64+0x69/0xc0 Aug 22 14:27:10 juju-e4d256-prod-github-runner-207 kernel: [32604.617829] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 14:27:10 juju-e4d256-prod-github-runner-207 kernel: [32604.618534] RIP: 0033:0x7faa5d0edaff Aug 22 14:27:10 juju-e4d256-prod-github-runner-207 kernel: [32604.619204] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 14:27:10 juju-e4d256-prod-github-runner-207 kernel: [32604.621216] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 14:27:10 juju-e4d256-prod-github-runner-207 kernel: [32604.622126] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 14:27:10 juju-e4d256-prod-github-runner-207 kernel: [32604.623013] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 14:27:10 juju-e4d256-prod-github-runner-207 kernel: [32604.623915] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 14:27:10 juju-e4d256-prod-github-runner-207 kernel: [32604.624802] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 14:27:10 juju-e4d256-prod-github-runner-207 kernel: [32604.625688] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 14:27:10 juju-e4d256-prod-github-runner-207 kernel: [32604.626582] Aug 22 14:27:38 juju-e4d256-prod-github-runner-207 kernel: [32632.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 30283s! [qemu-system-x86:6715] Aug 22 14:27:38 juju-e4d256-prod-github-runner-207 kernel: [32632.543109] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 14:27:38 juju-e4d256-prod-github-runner-207 kernel: [32632.543181] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 14:27:38 juju-e4d256-prod-github-runner-207 kernel: [32632.555541] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 14:27:38 juju-e4d256-prod-github-runner-207 kernel: [32632.556986] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 14:27:38 juju-e4d256-prod-github-runner-207 kernel: [32632.558223] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:27:38 juju-e4d256-prod-github-runner-207 kernel: [32632.559303] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 14:27:38 juju-e4d256-prod-github-runner-207 kernel: [32632.561854] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 14:27:38 juju-e4d256-prod-github-runner-207 kernel: [32632.562930] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 14:27:38 juju-e4d256-prod-github-runner-207 kernel: [32632.564176] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 14:27:38 juju-e4d256-prod-github-runner-207 kernel: [32632.565364] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 14:27:38 juju-e4d256-prod-github-runner-207 kernel: [32632.566544] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 14:27:38 juju-e4d256-prod-github-runner-207 kernel: [32632.567751] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 14:27:38 juju-e4d256-prod-github-runner-207 kernel: [32632.568925] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 14:27:38 juju-e4d256-prod-github-runner-207 kernel: [32632.570169] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 14:27:38 juju-e4d256-prod-github-runner-207 kernel: [32632.571287] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 14:27:38 juju-e4d256-prod-github-runner-207 kernel: [32632.572495] Call Trace: Aug 22 14:27:38 juju-e4d256-prod-github-runner-207 kernel: [32632.573411] Aug 22 14:27:38 juju-e4d256-prod-github-runner-207 kernel: [32632.574294] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:27:38 juju-e4d256-prod-github-runner-207 kernel: [32632.575351] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:27:38 juju-e4d256-prod-github-runner-207 kernel: [32632.576533] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:27:38 juju-e4d256-prod-github-runner-207 kernel: [32632.577609] ? show_regs.part.0+0x23/0x29 Aug 22 14:27:38 juju-e4d256-prod-github-runner-207 kernel: [32632.578607] ? show_regs.cold+0x8/0xd Aug 22 14:27:38 juju-e4d256-prod-github-runner-207 kernel: [32632.579597] ? watchdog_timer_fn+0x1be/0x220 Aug 22 14:27:38 juju-e4d256-prod-github-runner-207 kernel: [32632.580606] ? lockup_detector_update_enable+0x60/0x60 Aug 22 14:27:38 juju-e4d256-prod-github-runner-207 kernel: [32632.581668] ? __hrtimer_run_queues+0x107/0x230 Aug 22 14:27:38 juju-e4d256-prod-github-runner-207 kernel: [32632.582699] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 14:27:38 juju-e4d256-prod-github-runner-207 kernel: [32632.583748] ? hrtimer_interrupt+0x101/0x220 Aug 22 14:27:38 juju-e4d256-prod-github-runner-207 kernel: [32632.584797] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 14:27:38 juju-e4d256-prod-github-runner-207 kernel: [32632.585875] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 14:27:38 juju-e4d256-prod-github-runner-207 kernel: [32632.586947] Aug 22 14:27:38 juju-e4d256-prod-github-runner-207 kernel: [32632.587805] Aug 22 14:27:38 juju-e4d256-prod-github-runner-207 kernel: [32632.588644] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 14:27:38 juju-e4d256-prod-github-runner-207 kernel: [32632.589679] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:27:38 juju-e4d256-prod-github-runner-207 kernel: [32632.590717] ? _raw_spin_lock+0x22/0x30 Aug 22 14:27:38 juju-e4d256-prod-github-runner-207 kernel: [32632.591675] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:27:38 juju-e4d256-prod-github-runner-207 kernel: [32632.592696] direct_page_fault+0x206/0x310 [kvm] Aug 22 14:27:38 juju-e4d256-prod-github-runner-207 kernel: [32632.593719] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 14:27:38 juju-e4d256-prod-github-runner-207 kernel: [32632.594729] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 14:27:38 juju-e4d256-prod-github-runner-207 kernel: [32632.595746] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 14:27:38 juju-e4d256-prod-github-runner-207 kernel: [32632.596720] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 14:27:38 juju-e4d256-prod-github-runner-207 kernel: [32632.597666] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 14:27:38 juju-e4d256-prod-github-runner-207 kernel: [32632.598668] handle_exit+0x98/0x230 [kvm_amd] Aug 22 14:27:38 juju-e4d256-prod-github-runner-207 kernel: [32632.599602] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 14:27:38 juju-e4d256-prod-github-runner-207 kernel: [32632.600519] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 14:27:38 juju-e4d256-prod-github-runner-207 kernel: [32632.601444] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 14:27:38 juju-e4d256-prod-github-runner-207 kernel: [32632.602347] vcpu_run+0x62/0x2c0 [kvm] Aug 22 14:27:38 juju-e4d256-prod-github-runner-207 kernel: [32632.603173] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 14:27:38 juju-e4d256-prod-github-runner-207 kernel: [32632.603983] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 14:27:38 juju-e4d256-prod-github-runner-207 kernel: [32632.604839] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 14:27:38 juju-e4d256-prod-github-runner-207 kernel: [32632.605635] ? __seccomp_filter+0x4a/0x4a0 Aug 22 14:27:38 juju-e4d256-prod-github-runner-207 kernel: [32632.606379] ? __fget_files+0x86/0xc0 Aug 22 14:27:38 juju-e4d256-prod-github-runner-207 kernel: [32632.607153] __x64_sys_ioctl+0x95/0xd0 Aug 22 14:27:38 juju-e4d256-prod-github-runner-207 kernel: [32632.607853] do_syscall_64+0x5c/0xc0 Aug 22 14:27:38 juju-e4d256-prod-github-runner-207 kernel: [32632.608520] ? do_futex+0x162/0x1f0 Aug 22 14:27:38 juju-e4d256-prod-github-runner-207 kernel: [32632.609170] ? __x64_sys_futex+0x78/0x1e0 Aug 22 14:27:38 juju-e4d256-prod-github-runner-207 kernel: [32632.609845] ? __secure_computing+0xa9/0x120 Aug 22 14:27:38 juju-e4d256-prod-github-runner-207 kernel: [32632.610542] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 14:27:38 juju-e4d256-prod-github-runner-207 kernel: [32632.611343] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:27:38 juju-e4d256-prod-github-runner-207 kernel: [32632.612077] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:27:38 juju-e4d256-prod-github-runner-207 kernel: [32632.612835] ? do_syscall_64+0x69/0xc0 Aug 22 14:27:38 juju-e4d256-prod-github-runner-207 kernel: [32632.613480] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:27:38 juju-e4d256-prod-github-runner-207 kernel: [32632.614193] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:27:38 juju-e4d256-prod-github-runner-207 kernel: [32632.614947] ? do_syscall_64+0x69/0xc0 Aug 22 14:27:38 juju-e4d256-prod-github-runner-207 kernel: [32632.615575] ? do_syscall_64+0x69/0xc0 Aug 22 14:27:38 juju-e4d256-prod-github-runner-207 kernel: [32632.616202] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 14:27:38 juju-e4d256-prod-github-runner-207 kernel: [32632.616907] RIP: 0033:0x7faa5d0edaff Aug 22 14:27:38 juju-e4d256-prod-github-runner-207 kernel: [32632.617533] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 14:27:38 juju-e4d256-prod-github-runner-207 kernel: [32632.619532] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 14:27:38 juju-e4d256-prod-github-runner-207 kernel: [32632.620451] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 14:27:38 juju-e4d256-prod-github-runner-207 kernel: [32632.621360] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 14:27:38 juju-e4d256-prod-github-runner-207 kernel: [32632.622253] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 14:27:38 juju-e4d256-prod-github-runner-207 kernel: [32632.623161] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 14:27:38 juju-e4d256-prod-github-runner-207 kernel: [32632.624054] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 14:27:38 juju-e4d256-prod-github-runner-207 kernel: [32632.624948] Aug 22 14:28:06 juju-e4d256-prod-github-runner-207 kernel: [32660.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 30309s! [qemu-system-x86:6715] Aug 22 14:28:06 juju-e4d256-prod-github-runner-207 kernel: [32660.543274] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 14:28:06 juju-e4d256-prod-github-runner-207 kernel: [32660.543350] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 14:28:06 juju-e4d256-prod-github-runner-207 kernel: [32660.556390] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 14:28:06 juju-e4d256-prod-github-runner-207 kernel: [32660.557702] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 14:28:06 juju-e4d256-prod-github-runner-207 kernel: [32660.558996] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:28:06 juju-e4d256-prod-github-runner-207 kernel: [32660.560069] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 14:28:06 juju-e4d256-prod-github-runner-207 kernel: [32660.562645] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 14:28:06 juju-e4d256-prod-github-runner-207 kernel: [32660.563699] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 14:28:06 juju-e4d256-prod-github-runner-207 kernel: [32660.564897] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 14:28:06 juju-e4d256-prod-github-runner-207 kernel: [32660.566078] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 14:28:06 juju-e4d256-prod-github-runner-207 kernel: [32660.567265] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 14:28:06 juju-e4d256-prod-github-runner-207 kernel: [32660.568467] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 14:28:06 juju-e4d256-prod-github-runner-207 kernel: [32660.569648] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 14:28:06 juju-e4d256-prod-github-runner-207 kernel: [32660.570893] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 14:28:06 juju-e4d256-prod-github-runner-207 kernel: [32660.572028] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 14:28:06 juju-e4d256-prod-github-runner-207 kernel: [32660.573322] Call Trace: Aug 22 14:28:06 juju-e4d256-prod-github-runner-207 kernel: [32660.574245] Aug 22 14:28:06 juju-e4d256-prod-github-runner-207 kernel: [32660.575207] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:28:06 juju-e4d256-prod-github-runner-207 kernel: [32660.576274] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:28:06 juju-e4d256-prod-github-runner-207 kernel: [32660.577321] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:28:06 juju-e4d256-prod-github-runner-207 kernel: [32660.578452] ? show_regs.part.0+0x23/0x29 Aug 22 14:28:06 juju-e4d256-prod-github-runner-207 kernel: [32660.579487] ? show_regs.cold+0x8/0xd Aug 22 14:28:06 juju-e4d256-prod-github-runner-207 kernel: [32660.580469] ? watchdog_timer_fn+0x1be/0x220 Aug 22 14:28:06 juju-e4d256-prod-github-runner-207 kernel: [32660.581517] ? lockup_detector_update_enable+0x60/0x60 Aug 22 14:28:06 juju-e4d256-prod-github-runner-207 kernel: [32660.582599] ? __hrtimer_run_queues+0x107/0x230 Aug 22 14:28:06 juju-e4d256-prod-github-runner-207 kernel: [32660.583627] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 14:28:06 juju-e4d256-prod-github-runner-207 kernel: [32660.584661] ? hrtimer_interrupt+0x101/0x220 Aug 22 14:28:06 juju-e4d256-prod-github-runner-207 kernel: [32660.585731] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 14:28:06 juju-e4d256-prod-github-runner-207 kernel: [32660.586986] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 14:28:06 juju-e4d256-prod-github-runner-207 kernel: [32660.588031] Aug 22 14:28:06 juju-e4d256-prod-github-runner-207 kernel: [32660.588884] Aug 22 14:28:06 juju-e4d256-prod-github-runner-207 kernel: [32660.589729] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 14:28:06 juju-e4d256-prod-github-runner-207 kernel: [32660.590887] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:28:06 juju-e4d256-prod-github-runner-207 kernel: [32660.591950] ? _raw_spin_lock+0x22/0x30 Aug 22 14:28:06 juju-e4d256-prod-github-runner-207 kernel: [32660.592982] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:28:06 juju-e4d256-prod-github-runner-207 kernel: [32660.594020] direct_page_fault+0x206/0x310 [kvm] Aug 22 14:28:06 juju-e4d256-prod-github-runner-207 kernel: [32660.595112] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 14:28:06 juju-e4d256-prod-github-runner-207 kernel: [32660.596140] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 14:28:06 juju-e4d256-prod-github-runner-207 kernel: [32660.597141] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 14:28:06 juju-e4d256-prod-github-runner-207 kernel: [32660.598109] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 14:28:06 juju-e4d256-prod-github-runner-207 kernel: [32660.599081] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 14:28:06 juju-e4d256-prod-github-runner-207 kernel: [32660.600083] handle_exit+0x98/0x230 [kvm_amd] Aug 22 14:28:06 juju-e4d256-prod-github-runner-207 kernel: [32660.601017] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 14:28:06 juju-e4d256-prod-github-runner-207 kernel: [32660.601936] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 14:28:06 juju-e4d256-prod-github-runner-207 kernel: [32660.602889] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 14:28:06 juju-e4d256-prod-github-runner-207 kernel: [32660.603796] vcpu_run+0x62/0x2c0 [kvm] Aug 22 14:28:06 juju-e4d256-prod-github-runner-207 kernel: [32660.604646] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 14:28:06 juju-e4d256-prod-github-runner-207 kernel: [32660.605459] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 14:28:06 juju-e4d256-prod-github-runner-207 kernel: [32660.606345] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 14:28:06 juju-e4d256-prod-github-runner-207 kernel: [32660.607179] ? __seccomp_filter+0x4a/0x4a0 Aug 22 14:28:06 juju-e4d256-prod-github-runner-207 kernel: [32660.607923] ? __fget_files+0x86/0xc0 Aug 22 14:28:06 juju-e4d256-prod-github-runner-207 kernel: [32660.608626] __x64_sys_ioctl+0x95/0xd0 Aug 22 14:28:06 juju-e4d256-prod-github-runner-207 kernel: [32660.609319] do_syscall_64+0x5c/0xc0 Aug 22 14:28:06 juju-e4d256-prod-github-runner-207 kernel: [32660.609985] ? do_futex+0x162/0x1f0 Aug 22 14:28:06 juju-e4d256-prod-github-runner-207 kernel: [32660.610644] ? __x64_sys_futex+0x78/0x1e0 Aug 22 14:28:06 juju-e4d256-prod-github-runner-207 kernel: [32660.611323] ? __secure_computing+0xa9/0x120 Aug 22 14:28:06 juju-e4d256-prod-github-runner-207 kernel: [32660.612014] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 14:28:06 juju-e4d256-prod-github-runner-207 kernel: [32660.612773] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:28:06 juju-e4d256-prod-github-runner-207 kernel: [32660.613495] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:28:06 juju-e4d256-prod-github-runner-207 kernel: [32660.614213] ? do_syscall_64+0x69/0xc0 Aug 22 14:28:06 juju-e4d256-prod-github-runner-207 kernel: [32660.614871] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:28:06 juju-e4d256-prod-github-runner-207 kernel: [32660.615575] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:28:06 juju-e4d256-prod-github-runner-207 kernel: [32660.616272] ? do_syscall_64+0x69/0xc0 Aug 22 14:28:06 juju-e4d256-prod-github-runner-207 kernel: [32660.616897] ? do_syscall_64+0x69/0xc0 Aug 22 14:28:06 juju-e4d256-prod-github-runner-207 kernel: [32660.617520] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 14:28:06 juju-e4d256-prod-github-runner-207 kernel: [32660.618225] RIP: 0033:0x7faa5d0edaff Aug 22 14:28:06 juju-e4d256-prod-github-runner-207 kernel: [32660.618860] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 14:28:06 juju-e4d256-prod-github-runner-207 kernel: [32660.620840] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 14:28:06 juju-e4d256-prod-github-runner-207 kernel: [32660.621750] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 14:28:06 juju-e4d256-prod-github-runner-207 kernel: [32660.622654] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 14:28:06 juju-e4d256-prod-github-runner-207 kernel: [32660.623543] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 14:28:06 juju-e4d256-prod-github-runner-207 kernel: [32660.624443] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 14:28:06 juju-e4d256-prod-github-runner-207 kernel: [32660.625357] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 14:28:06 juju-e4d256-prod-github-runner-207 kernel: [32660.626263] Aug 22 14:28:34 juju-e4d256-prod-github-runner-207 kernel: [32688.541976] watchdog: BUG: soft lockup - CPU#1 stuck for 30335s! [qemu-system-x86:6715] Aug 22 14:28:34 juju-e4d256-prod-github-runner-207 kernel: [32688.543907] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 14:28:34 juju-e4d256-prod-github-runner-207 kernel: [32688.544207] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 14:28:34 juju-e4d256-prod-github-runner-207 kernel: [32688.556632] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 14:28:34 juju-e4d256-prod-github-runner-207 kernel: [32688.557894] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 14:28:34 juju-e4d256-prod-github-runner-207 kernel: [32688.559119] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:28:34 juju-e4d256-prod-github-runner-207 kernel: [32688.560177] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 14:28:34 juju-e4d256-prod-github-runner-207 kernel: [32688.562728] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 14:28:34 juju-e4d256-prod-github-runner-207 kernel: [32688.563774] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 14:28:34 juju-e4d256-prod-github-runner-207 kernel: [32688.564933] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 14:28:34 juju-e4d256-prod-github-runner-207 kernel: [32688.566119] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 14:28:34 juju-e4d256-prod-github-runner-207 kernel: [32688.567281] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 14:28:34 juju-e4d256-prod-github-runner-207 kernel: [32688.568446] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 14:28:34 juju-e4d256-prod-github-runner-207 kernel: [32688.569610] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 14:28:34 juju-e4d256-prod-github-runner-207 kernel: [32688.570852] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 14:28:34 juju-e4d256-prod-github-runner-207 kernel: [32688.571951] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 14:28:34 juju-e4d256-prod-github-runner-207 kernel: [32688.573140] Call Trace: Aug 22 14:28:34 juju-e4d256-prod-github-runner-207 kernel: [32688.574052] Aug 22 14:28:34 juju-e4d256-prod-github-runner-207 kernel: [32688.574961] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:28:34 juju-e4d256-prod-github-runner-207 kernel: [32688.575994] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:28:34 juju-e4d256-prod-github-runner-207 kernel: [32688.577016] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:28:34 juju-e4d256-prod-github-runner-207 kernel: [32688.578128] ? show_regs.part.0+0x23/0x29 Aug 22 14:28:34 juju-e4d256-prod-github-runner-207 kernel: [32688.579130] ? show_regs.cold+0x8/0xd Aug 22 14:28:34 juju-e4d256-prod-github-runner-207 kernel: [32688.580099] ? watchdog_timer_fn+0x1be/0x220 Aug 22 14:28:34 juju-e4d256-prod-github-runner-207 kernel: [32688.581105] ? lockup_detector_update_enable+0x60/0x60 Aug 22 14:28:34 juju-e4d256-prod-github-runner-207 kernel: [32688.582187] ? __hrtimer_run_queues+0x107/0x230 Aug 22 14:28:34 juju-e4d256-prod-github-runner-207 kernel: [32688.583215] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 14:28:34 juju-e4d256-prod-github-runner-207 kernel: [32688.584242] ? hrtimer_interrupt+0x101/0x220 Aug 22 14:28:34 juju-e4d256-prod-github-runner-207 kernel: [32688.585256] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 14:28:34 juju-e4d256-prod-github-runner-207 kernel: [32688.586340] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 14:28:34 juju-e4d256-prod-github-runner-207 kernel: [32688.587389] Aug 22 14:28:34 juju-e4d256-prod-github-runner-207 kernel: [32688.588241] Aug 22 14:28:34 juju-e4d256-prod-github-runner-207 kernel: [32688.589081] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 14:28:34 juju-e4d256-prod-github-runner-207 kernel: [32688.590133] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:28:34 juju-e4d256-prod-github-runner-207 kernel: [32688.591173] ? _raw_spin_lock+0x22/0x30 Aug 22 14:28:34 juju-e4d256-prod-github-runner-207 kernel: [32688.592119] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:28:34 juju-e4d256-prod-github-runner-207 kernel: [32688.593140] direct_page_fault+0x206/0x310 [kvm] Aug 22 14:28:34 juju-e4d256-prod-github-runner-207 kernel: [32688.594183] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 14:28:34 juju-e4d256-prod-github-runner-207 kernel: [32688.595196] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 14:28:34 juju-e4d256-prod-github-runner-207 kernel: [32688.596202] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 14:28:34 juju-e4d256-prod-github-runner-207 kernel: [32688.597205] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 14:28:34 juju-e4d256-prod-github-runner-207 kernel: [32688.598161] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 14:28:34 juju-e4d256-prod-github-runner-207 kernel: [32688.599146] handle_exit+0x98/0x230 [kvm_amd] Aug 22 14:28:34 juju-e4d256-prod-github-runner-207 kernel: [32688.600037] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 14:28:34 juju-e4d256-prod-github-runner-207 kernel: [32688.600953] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 14:28:34 juju-e4d256-prod-github-runner-207 kernel: [32688.601878] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 14:28:34 juju-e4d256-prod-github-runner-207 kernel: [32688.602789] vcpu_run+0x62/0x2c0 [kvm] Aug 22 14:28:34 juju-e4d256-prod-github-runner-207 kernel: [32688.603600] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 14:28:34 juju-e4d256-prod-github-runner-207 kernel: [32688.604413] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 14:28:34 juju-e4d256-prod-github-runner-207 kernel: [32688.605268] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 14:28:34 juju-e4d256-prod-github-runner-207 kernel: [32688.606075] ? __seccomp_filter+0x4a/0x4a0 Aug 22 14:28:34 juju-e4d256-prod-github-runner-207 kernel: [32688.606828] ? __fget_files+0x86/0xc0 Aug 22 14:28:34 juju-e4d256-prod-github-runner-207 kernel: [32688.607532] __x64_sys_ioctl+0x95/0xd0 Aug 22 14:28:34 juju-e4d256-prod-github-runner-207 kernel: [32688.608227] do_syscall_64+0x5c/0xc0 Aug 22 14:28:34 juju-e4d256-prod-github-runner-207 kernel: [32688.608894] ? do_futex+0x162/0x1f0 Aug 22 14:28:34 juju-e4d256-prod-github-runner-207 kernel: [32688.609549] ? __x64_sys_futex+0x78/0x1e0 Aug 22 14:28:34 juju-e4d256-prod-github-runner-207 kernel: [32688.610241] ? __secure_computing+0xa9/0x120 Aug 22 14:28:34 juju-e4d256-prod-github-runner-207 kernel: [32688.610933] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 14:28:34 juju-e4d256-prod-github-runner-207 kernel: [32688.611698] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:28:34 juju-e4d256-prod-github-runner-207 kernel: [32688.612421] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:28:34 juju-e4d256-prod-github-runner-207 kernel: [32688.613140] ? do_syscall_64+0x69/0xc0 Aug 22 14:28:34 juju-e4d256-prod-github-runner-207 kernel: [32688.613792] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:28:34 juju-e4d256-prod-github-runner-207 kernel: [32688.614509] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:28:34 juju-e4d256-prod-github-runner-207 kernel: [32688.615205] ? do_syscall_64+0x69/0xc0 Aug 22 14:28:34 juju-e4d256-prod-github-runner-207 kernel: [32688.615830] ? do_syscall_64+0x69/0xc0 Aug 22 14:28:34 juju-e4d256-prod-github-runner-207 kernel: [32688.616458] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 14:28:34 juju-e4d256-prod-github-runner-207 kernel: [32688.617164] RIP: 0033:0x7faa5d0edaff Aug 22 14:28:34 juju-e4d256-prod-github-runner-207 kernel: [32688.617817] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 14:28:34 juju-e4d256-prod-github-runner-207 kernel: [32688.619809] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 14:28:34 juju-e4d256-prod-github-runner-207 kernel: [32688.620724] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 14:28:34 juju-e4d256-prod-github-runner-207 kernel: [32688.621615] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 14:28:34 juju-e4d256-prod-github-runner-207 kernel: [32688.622518] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 14:28:34 juju-e4d256-prod-github-runner-207 kernel: [32688.623405] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 14:28:34 juju-e4d256-prod-github-runner-207 kernel: [32688.624294] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 14:28:34 juju-e4d256-prod-github-runner-207 kernel: [32688.625299] Aug 22 14:29:02 juju-e4d256-prod-github-runner-207 kernel: [32716.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 30361s! [qemu-system-x86:6715] Aug 22 14:29:02 juju-e4d256-prod-github-runner-207 kernel: [32716.543105] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 14:29:02 juju-e4d256-prod-github-runner-207 kernel: [32716.543178] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 14:29:02 juju-e4d256-prod-github-runner-207 kernel: [32716.555807] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 14:29:02 juju-e4d256-prod-github-runner-207 kernel: [32716.557091] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 14:29:02 juju-e4d256-prod-github-runner-207 kernel: [32716.558352] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:29:02 juju-e4d256-prod-github-runner-207 kernel: [32716.559533] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 14:29:02 juju-e4d256-prod-github-runner-207 kernel: [32716.562193] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 14:29:02 juju-e4d256-prod-github-runner-207 kernel: [32716.563250] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 14:29:02 juju-e4d256-prod-github-runner-207 kernel: [32716.564429] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 14:29:02 juju-e4d256-prod-github-runner-207 kernel: [32716.565613] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 14:29:02 juju-e4d256-prod-github-runner-207 kernel: [32716.566828] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 14:29:02 juju-e4d256-prod-github-runner-207 kernel: [32716.568172] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 14:29:02 juju-e4d256-prod-github-runner-207 kernel: [32716.569360] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 14:29:02 juju-e4d256-prod-github-runner-207 kernel: [32716.570700] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 14:29:02 juju-e4d256-prod-github-runner-207 kernel: [32716.571825] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 14:29:02 juju-e4d256-prod-github-runner-207 kernel: [32716.573031] Call Trace: Aug 22 14:29:02 juju-e4d256-prod-github-runner-207 kernel: [32716.574136] Aug 22 14:29:02 juju-e4d256-prod-github-runner-207 kernel: [32716.575034] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:29:02 juju-e4d256-prod-github-runner-207 kernel: [32716.576081] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:29:02 juju-e4d256-prod-github-runner-207 kernel: [32716.577113] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:29:02 juju-e4d256-prod-github-runner-207 kernel: [32716.578220] ? show_regs.part.0+0x23/0x29 Aug 22 14:29:02 juju-e4d256-prod-github-runner-207 kernel: [32716.579235] ? show_regs.cold+0x8/0xd Aug 22 14:29:02 juju-e4d256-prod-github-runner-207 kernel: [32716.580240] ? watchdog_timer_fn+0x1be/0x220 Aug 22 14:29:02 juju-e4d256-prod-github-runner-207 kernel: [32716.581279] ? lockup_detector_update_enable+0x60/0x60 Aug 22 14:29:02 juju-e4d256-prod-github-runner-207 kernel: [32716.582379] ? __hrtimer_run_queues+0x107/0x230 Aug 22 14:29:02 juju-e4d256-prod-github-runner-207 kernel: [32716.583419] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 14:29:02 juju-e4d256-prod-github-runner-207 kernel: [32716.584453] ? hrtimer_interrupt+0x101/0x220 Aug 22 14:29:02 juju-e4d256-prod-github-runner-207 kernel: [32716.585485] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 14:29:02 juju-e4d256-prod-github-runner-207 kernel: [32716.586589] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 14:29:02 juju-e4d256-prod-github-runner-207 kernel: [32716.587646] Aug 22 14:29:02 juju-e4d256-prod-github-runner-207 kernel: [32716.588513] Aug 22 14:29:02 juju-e4d256-prod-github-runner-207 kernel: [32716.589367] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 14:29:02 juju-e4d256-prod-github-runner-207 kernel: [32716.590442] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:29:02 juju-e4d256-prod-github-runner-207 kernel: [32716.591537] ? _raw_spin_lock+0x22/0x30 Aug 22 14:29:02 juju-e4d256-prod-github-runner-207 kernel: [32716.592503] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:29:02 juju-e4d256-prod-github-runner-207 kernel: [32716.593539] direct_page_fault+0x206/0x310 [kvm] Aug 22 14:29:02 juju-e4d256-prod-github-runner-207 kernel: [32716.594594] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 14:29:02 juju-e4d256-prod-github-runner-207 kernel: [32716.595658] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 14:29:02 juju-e4d256-prod-github-runner-207 kernel: [32716.596693] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 14:29:02 juju-e4d256-prod-github-runner-207 kernel: [32716.597687] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 14:29:02 juju-e4d256-prod-github-runner-207 kernel: [32716.598668] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 14:29:02 juju-e4d256-prod-github-runner-207 kernel: [32716.599658] handle_exit+0x98/0x230 [kvm_amd] Aug 22 14:29:02 juju-e4d256-prod-github-runner-207 kernel: [32716.600561] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 14:29:02 juju-e4d256-prod-github-runner-207 kernel: [32716.601525] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 14:29:02 juju-e4d256-prod-github-runner-207 kernel: [32716.602505] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 14:29:02 juju-e4d256-prod-github-runner-207 kernel: [32716.603510] vcpu_run+0x62/0x2c0 [kvm] Aug 22 14:29:02 juju-e4d256-prod-github-runner-207 kernel: [32716.604605] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 14:29:02 juju-e4d256-prod-github-runner-207 kernel: [32716.605444] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 14:29:02 juju-e4d256-prod-github-runner-207 kernel: [32716.606346] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 14:29:02 juju-e4d256-prod-github-runner-207 kernel: [32716.607154] ? __seccomp_filter+0x4a/0x4a0 Aug 22 14:29:02 juju-e4d256-prod-github-runner-207 kernel: [32716.607908] ? __fget_files+0x86/0xc0 Aug 22 14:29:02 juju-e4d256-prod-github-runner-207 kernel: [32716.608622] __x64_sys_ioctl+0x95/0xd0 Aug 22 14:29:02 juju-e4d256-prod-github-runner-207 kernel: [32716.609346] do_syscall_64+0x5c/0xc0 Aug 22 14:29:02 juju-e4d256-prod-github-runner-207 kernel: [32716.610073] ? do_futex+0x162/0x1f0 Aug 22 14:29:02 juju-e4d256-prod-github-runner-207 kernel: [32716.610731] ? __x64_sys_futex+0x78/0x1e0 Aug 22 14:29:02 juju-e4d256-prod-github-runner-207 kernel: [32716.611428] ? __secure_computing+0xa9/0x120 Aug 22 14:29:02 juju-e4d256-prod-github-runner-207 kernel: [32716.612175] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 14:29:02 juju-e4d256-prod-github-runner-207 kernel: [32716.612953] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:29:02 juju-e4d256-prod-github-runner-207 kernel: [32716.613688] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:29:02 juju-e4d256-prod-github-runner-207 kernel: [32716.614436] ? do_syscall_64+0x69/0xc0 Aug 22 14:29:02 juju-e4d256-prod-github-runner-207 kernel: [32716.615090] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:29:02 juju-e4d256-prod-github-runner-207 kernel: [32716.615804] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:29:02 juju-e4d256-prod-github-runner-207 kernel: [32716.616509] ? do_syscall_64+0x69/0xc0 Aug 22 14:29:02 juju-e4d256-prod-github-runner-207 kernel: [32716.617143] ? do_syscall_64+0x69/0xc0 Aug 22 14:29:02 juju-e4d256-prod-github-runner-207 kernel: [32716.617795] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 14:29:02 juju-e4d256-prod-github-runner-207 kernel: [32716.618535] RIP: 0033:0x7faa5d0edaff Aug 22 14:29:02 juju-e4d256-prod-github-runner-207 kernel: [32716.619215] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 14:29:02 juju-e4d256-prod-github-runner-207 kernel: [32716.621256] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 14:29:02 juju-e4d256-prod-github-runner-207 kernel: [32716.622262] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 14:29:02 juju-e4d256-prod-github-runner-207 kernel: [32716.623178] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 14:29:02 juju-e4d256-prod-github-runner-207 kernel: [32716.624085] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 14:29:02 juju-e4d256-prod-github-runner-207 kernel: [32716.625000] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 14:29:02 juju-e4d256-prod-github-runner-207 kernel: [32716.625935] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 14:29:02 juju-e4d256-prod-github-runner-207 kernel: [32716.626892] Aug 22 14:29:30 juju-e4d256-prod-github-runner-207 kernel: [32744.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 30387s! [qemu-system-x86:6715] Aug 22 14:29:30 juju-e4d256-prod-github-runner-207 kernel: [32744.543317] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 14:29:30 juju-e4d256-prod-github-runner-207 kernel: [32744.543393] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 14:29:30 juju-e4d256-prod-github-runner-207 kernel: [32744.556178] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 14:29:30 juju-e4d256-prod-github-runner-207 kernel: [32744.557558] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 14:29:30 juju-e4d256-prod-github-runner-207 kernel: [32744.558811] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:29:30 juju-e4d256-prod-github-runner-207 kernel: [32744.559886] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 14:29:30 juju-e4d256-prod-github-runner-207 kernel: [32744.562745] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 14:29:30 juju-e4d256-prod-github-runner-207 kernel: [32744.563812] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 14:29:30 juju-e4d256-prod-github-runner-207 kernel: [32744.565000] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 14:29:30 juju-e4d256-prod-github-runner-207 kernel: [32744.566219] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 14:29:30 juju-e4d256-prod-github-runner-207 kernel: [32744.567402] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 14:29:30 juju-e4d256-prod-github-runner-207 kernel: [32744.568585] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 14:29:30 juju-e4d256-prod-github-runner-207 kernel: [32744.569787] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 14:29:30 juju-e4d256-prod-github-runner-207 kernel: [32744.571046] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 14:29:30 juju-e4d256-prod-github-runner-207 kernel: [32744.572157] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 14:29:30 juju-e4d256-prod-github-runner-207 kernel: [32744.573389] Call Trace: Aug 22 14:29:30 juju-e4d256-prod-github-runner-207 kernel: [32744.574309] Aug 22 14:29:30 juju-e4d256-prod-github-runner-207 kernel: [32744.575204] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:29:30 juju-e4d256-prod-github-runner-207 kernel: [32744.576260] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:29:30 juju-e4d256-prod-github-runner-207 kernel: [32744.577313] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:29:30 juju-e4d256-prod-github-runner-207 kernel: [32744.578618] ? show_regs.part.0+0x23/0x29 Aug 22 14:29:30 juju-e4d256-prod-github-runner-207 kernel: [32744.579629] ? show_regs.cold+0x8/0xd Aug 22 14:29:30 juju-e4d256-prod-github-runner-207 kernel: [32744.580612] ? watchdog_timer_fn+0x1be/0x220 Aug 22 14:29:30 juju-e4d256-prod-github-runner-207 kernel: [32744.581653] ? lockup_detector_update_enable+0x60/0x60 Aug 22 14:29:30 juju-e4d256-prod-github-runner-207 kernel: [32744.582738] ? __hrtimer_run_queues+0x107/0x230 Aug 22 14:29:30 juju-e4d256-prod-github-runner-207 kernel: [32744.583986] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 14:29:30 juju-e4d256-prod-github-runner-207 kernel: [32744.585023] ? hrtimer_interrupt+0x101/0x220 Aug 22 14:29:30 juju-e4d256-prod-github-runner-207 kernel: [32744.586078] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 14:29:30 juju-e4d256-prod-github-runner-207 kernel: [32744.587165] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 14:29:30 juju-e4d256-prod-github-runner-207 kernel: [32744.588228] Aug 22 14:29:30 juju-e4d256-prod-github-runner-207 kernel: [32744.589094] Aug 22 14:29:30 juju-e4d256-prod-github-runner-207 kernel: [32744.589949] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 14:29:30 juju-e4d256-prod-github-runner-207 kernel: [32744.591003] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:29:30 juju-e4d256-prod-github-runner-207 kernel: [32744.592043] ? _raw_spin_lock+0x22/0x30 Aug 22 14:29:30 juju-e4d256-prod-github-runner-207 kernel: [32744.592988] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:29:30 juju-e4d256-prod-github-runner-207 kernel: [32744.594027] direct_page_fault+0x206/0x310 [kvm] Aug 22 14:29:30 juju-e4d256-prod-github-runner-207 kernel: [32744.595053] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 14:29:30 juju-e4d256-prod-github-runner-207 kernel: [32744.596060] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 14:29:30 juju-e4d256-prod-github-runner-207 kernel: [32744.597065] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 14:29:30 juju-e4d256-prod-github-runner-207 kernel: [32744.598051] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 14:29:30 juju-e4d256-prod-github-runner-207 kernel: [32744.599027] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 14:29:30 juju-e4d256-prod-github-runner-207 kernel: [32744.600010] handle_exit+0x98/0x230 [kvm_amd] Aug 22 14:29:30 juju-e4d256-prod-github-runner-207 kernel: [32744.600906] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 14:29:30 juju-e4d256-prod-github-runner-207 kernel: [32744.601852] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 14:29:30 juju-e4d256-prod-github-runner-207 kernel: [32744.602783] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 14:29:30 juju-e4d256-prod-github-runner-207 kernel: [32744.603689] vcpu_run+0x62/0x2c0 [kvm] Aug 22 14:29:30 juju-e4d256-prod-github-runner-207 kernel: [32744.604599] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 14:29:30 juju-e4d256-prod-github-runner-207 kernel: [32744.605590] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 14:29:30 juju-e4d256-prod-github-runner-207 kernel: [32744.606561] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 14:29:30 juju-e4d256-prod-github-runner-207 kernel: [32744.607458] ? __seccomp_filter+0x4a/0x4a0 Aug 22 14:29:30 juju-e4d256-prod-github-runner-207 kernel: [32744.608291] ? __fget_files+0x86/0xc0 Aug 22 14:29:30 juju-e4d256-prod-github-runner-207 kernel: [32744.609071] __x64_sys_ioctl+0x95/0xd0 Aug 22 14:29:30 juju-e4d256-prod-github-runner-207 kernel: [32744.609898] do_syscall_64+0x5c/0xc0 Aug 22 14:29:30 juju-e4d256-prod-github-runner-207 kernel: [32744.610643] ? do_futex+0x162/0x1f0 Aug 22 14:29:30 juju-e4d256-prod-github-runner-207 kernel: [32744.611368] ? __x64_sys_futex+0x78/0x1e0 Aug 22 14:29:30 juju-e4d256-prod-github-runner-207 kernel: [32744.612200] ? __secure_computing+0xa9/0x120 Aug 22 14:29:30 juju-e4d256-prod-github-runner-207 kernel: [32744.613017] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 14:29:30 juju-e4d256-prod-github-runner-207 kernel: [32744.613903] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:29:30 juju-e4d256-prod-github-runner-207 kernel: [32744.614733] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:29:30 juju-e4d256-prod-github-runner-207 kernel: [32744.615556] ? do_syscall_64+0x69/0xc0 Aug 22 14:29:30 juju-e4d256-prod-github-runner-207 kernel: [32744.616281] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:29:30 juju-e4d256-prod-github-runner-207 kernel: [32744.617091] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:29:30 juju-e4d256-prod-github-runner-207 kernel: [32744.617934] ? do_syscall_64+0x69/0xc0 Aug 22 14:29:30 juju-e4d256-prod-github-runner-207 kernel: [32744.618644] ? do_syscall_64+0x69/0xc0 Aug 22 14:29:30 juju-e4d256-prod-github-runner-207 kernel: [32744.619357] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 14:29:30 juju-e4d256-prod-github-runner-207 kernel: [32744.620166] RIP: 0033:0x7faa5d0edaff Aug 22 14:29:30 juju-e4d256-prod-github-runner-207 kernel: [32744.620866] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 14:29:30 juju-e4d256-prod-github-runner-207 kernel: [32744.623246] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 14:29:30 juju-e4d256-prod-github-runner-207 kernel: [32744.624311] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 14:29:30 juju-e4d256-prod-github-runner-207 kernel: [32744.625354] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 14:29:30 juju-e4d256-prod-github-runner-207 kernel: [32744.626395] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 14:29:30 juju-e4d256-prod-github-runner-207 kernel: [32744.627428] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 14:29:30 juju-e4d256-prod-github-runner-207 kernel: [32744.628463] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 14:29:30 juju-e4d256-prod-github-runner-207 kernel: [32744.629527] Aug 22 14:29:45 juju-e4d256-prod-github-runner-207 kernel: [32759.372706] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 14:29:45 juju-e4d256-prod-github-runner-207 kernel: [32759.373689] rcu: 1-....: (8135069 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=3930207 Aug 22 14:29:45 juju-e4d256-prod-github-runner-207 kernel: [32759.374802] (t=8160543 jiffies g=23269 q=35442) Aug 22 14:29:45 juju-e4d256-prod-github-runner-207 kernel: [32759.375581] NMI backtrace for cpu 1 Aug 22 14:29:45 juju-e4d256-prod-github-runner-207 kernel: [32759.376287] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 14:29:45 juju-e4d256-prod-github-runner-207 kernel: [32759.377415] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 14:29:45 juju-e4d256-prod-github-runner-207 kernel: [32759.378474] Call Trace: Aug 22 14:29:45 juju-e4d256-prod-github-runner-207 kernel: [32759.379149] Aug 22 14:29:45 juju-e4d256-prod-github-runner-207 kernel: [32759.379792] show_stack+0x52/0x5c Aug 22 14:29:45 juju-e4d256-prod-github-runner-207 kernel: [32759.380513] dump_stack_lvl+0x4a/0x63 Aug 22 14:29:45 juju-e4d256-prod-github-runner-207 kernel: [32759.381280] dump_stack+0x10/0x16 Aug 22 14:29:45 juju-e4d256-prod-github-runner-207 kernel: [32759.381996] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 14:29:45 juju-e4d256-prod-github-runner-207 kernel: [32759.382774] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 14:29:45 juju-e4d256-prod-github-runner-207 kernel: [32759.383550] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 14:29:45 juju-e4d256-prod-github-runner-207 kernel: [32759.384404] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 14:29:45 juju-e4d256-prod-github-runner-207 kernel: [32759.385364] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 14:29:45 juju-e4d256-prod-github-runner-207 kernel: [32759.386265] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 14:29:45 juju-e4d256-prod-github-runner-207 kernel: [32759.387123] print_cpu_stall.cold+0x2f/0xe2 Aug 22 14:29:45 juju-e4d256-prod-github-runner-207 kernel: [32759.387971] ? timekeeping_update+0xf7/0x150 Aug 22 14:29:45 juju-e4d256-prod-github-runner-207 kernel: [32759.388824] check_cpu_stall+0x109/0x270 Aug 22 14:29:45 juju-e4d256-prod-github-runner-207 kernel: [32759.389674] rcu_sched_clock_irq+0x9a/0x250 Aug 22 14:29:45 juju-e4d256-prod-github-runner-207 kernel: [32759.390522] update_process_times+0x94/0xd0 Aug 22 14:29:45 juju-e4d256-prod-github-runner-207 kernel: [32759.391367] tick_sched_handle+0x29/0x70 Aug 22 14:29:45 juju-e4d256-prod-github-runner-207 kernel: [32759.392192] tick_sched_timer+0x8c/0xc0 Aug 22 14:29:45 juju-e4d256-prod-github-runner-207 kernel: [32759.393008] ? tick_nohz_handler+0xb0/0xb0 Aug 22 14:29:45 juju-e4d256-prod-github-runner-207 kernel: [32759.393873] __hrtimer_run_queues+0x107/0x230 Aug 22 14:29:45 juju-e4d256-prod-github-runner-207 kernel: [32759.394727] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 14:29:45 juju-e4d256-prod-github-runner-207 kernel: [32759.395594] hrtimer_interrupt+0x101/0x220 Aug 22 14:29:45 juju-e4d256-prod-github-runner-207 kernel: [32759.396437] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 14:29:45 juju-e4d256-prod-github-runner-207 kernel: [32759.397377] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 14:29:45 juju-e4d256-prod-github-runner-207 kernel: [32759.398282] Aug 22 14:29:45 juju-e4d256-prod-github-runner-207 kernel: [32759.398965] Aug 22 14:29:45 juju-e4d256-prod-github-runner-207 kernel: [32759.399638] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 14:29:45 juju-e4d256-prod-github-runner-207 kernel: [32759.400553] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:29:45 juju-e4d256-prod-github-runner-207 kernel: [32759.401572] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 14:29:45 juju-e4d256-prod-github-runner-207 kernel: [32759.404120] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 14:29:45 juju-e4d256-prod-github-runner-207 kernel: [32759.405101] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 14:29:45 juju-e4d256-prod-github-runner-207 kernel: [32759.406254] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 14:29:45 juju-e4d256-prod-github-runner-207 kernel: [32759.407369] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 14:29:45 juju-e4d256-prod-github-runner-207 kernel: [32759.408470] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 14:29:45 juju-e4d256-prod-github-runner-207 kernel: [32759.409611] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 14:29:45 juju-e4d256-prod-github-runner-207 kernel: [32759.410707] ? _raw_spin_lock+0x22/0x30 Aug 22 14:29:45 juju-e4d256-prod-github-runner-207 kernel: [32759.411561] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:29:45 juju-e4d256-prod-github-runner-207 kernel: [32759.412497] direct_page_fault+0x206/0x310 [kvm] Aug 22 14:29:45 juju-e4d256-prod-github-runner-207 kernel: [32759.413451] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 14:29:45 juju-e4d256-prod-github-runner-207 kernel: [32759.414374] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 14:29:45 juju-e4d256-prod-github-runner-207 kernel: [32759.415295] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 14:29:45 juju-e4d256-prod-github-runner-207 kernel: [32759.416200] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 14:29:45 juju-e4d256-prod-github-runner-207 kernel: [32759.417082] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 14:29:45 juju-e4d256-prod-github-runner-207 kernel: [32759.418032] handle_exit+0x98/0x230 [kvm_amd] Aug 22 14:29:45 juju-e4d256-prod-github-runner-207 kernel: [32759.418878] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 14:29:45 juju-e4d256-prod-github-runner-207 kernel: [32759.419755] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 14:29:45 juju-e4d256-prod-github-runner-207 kernel: [32759.420659] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 14:29:45 juju-e4d256-prod-github-runner-207 kernel: [32759.421573] vcpu_run+0x62/0x2c0 [kvm] Aug 22 14:29:45 juju-e4d256-prod-github-runner-207 kernel: [32759.422373] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 14:29:45 juju-e4d256-prod-github-runner-207 kernel: [32759.423196] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 14:29:45 juju-e4d256-prod-github-runner-207 kernel: [32759.424102] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 14:29:45 juju-e4d256-prod-github-runner-207 kernel: [32759.424965] ? __seccomp_filter+0x4a/0x4a0 Aug 22 14:29:45 juju-e4d256-prod-github-runner-207 kernel: [32759.425798] ? __fget_files+0x86/0xc0 Aug 22 14:29:45 juju-e4d256-prod-github-runner-207 kernel: [32759.426572] __x64_sys_ioctl+0x95/0xd0 Aug 22 14:29:45 juju-e4d256-prod-github-runner-207 kernel: [32759.427349] do_syscall_64+0x5c/0xc0 Aug 22 14:29:45 juju-e4d256-prod-github-runner-207 kernel: [32759.428117] ? do_futex+0x162/0x1f0 Aug 22 14:29:45 juju-e4d256-prod-github-runner-207 kernel: [32759.428884] ? __x64_sys_futex+0x78/0x1e0 Aug 22 14:29:45 juju-e4d256-prod-github-runner-207 kernel: [32759.429698] ? __secure_computing+0xa9/0x120 Aug 22 14:29:45 juju-e4d256-prod-github-runner-207 kernel: [32759.430506] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 14:29:45 juju-e4d256-prod-github-runner-207 kernel: [32759.431463] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:29:45 juju-e4d256-prod-github-runner-207 kernel: [32759.432316] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:29:45 juju-e4d256-prod-github-runner-207 kernel: [32759.433168] ? do_syscall_64+0x69/0xc0 Aug 22 14:29:45 juju-e4d256-prod-github-runner-207 kernel: [32759.433962] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:29:45 juju-e4d256-prod-github-runner-207 kernel: [32759.434815] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:29:45 juju-e4d256-prod-github-runner-207 kernel: [32759.435672] ? do_syscall_64+0x69/0xc0 Aug 22 14:29:45 juju-e4d256-prod-github-runner-207 kernel: [32759.436456] ? do_syscall_64+0x69/0xc0 Aug 22 14:29:45 juju-e4d256-prod-github-runner-207 kernel: [32759.437255] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 14:29:45 juju-e4d256-prod-github-runner-207 kernel: [32759.438135] RIP: 0033:0x7faa5d0edaff Aug 22 14:29:45 juju-e4d256-prod-github-runner-207 kernel: [32759.438895] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 14:29:45 juju-e4d256-prod-github-runner-207 kernel: [32759.441383] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 14:29:45 juju-e4d256-prod-github-runner-207 kernel: [32759.442499] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 14:29:45 juju-e4d256-prod-github-runner-207 kernel: [32759.443589] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 14:29:45 juju-e4d256-prod-github-runner-207 kernel: [32759.444673] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 14:29:45 juju-e4d256-prod-github-runner-207 kernel: [32759.445776] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 14:29:45 juju-e4d256-prod-github-runner-207 kernel: [32759.446875] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 14:29:45 juju-e4d256-prod-github-runner-207 kernel: [32759.447963] Aug 22 14:30:10 juju-e4d256-prod-github-runner-207 kernel: [32784.541981] watchdog: BUG: soft lockup - CPU#1 stuck for 30424s! [qemu-system-x86:6715] Aug 22 14:30:10 juju-e4d256-prod-github-runner-207 kernel: [32784.543860] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 14:30:10 juju-e4d256-prod-github-runner-207 kernel: [32784.544156] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 14:30:10 juju-e4d256-prod-github-runner-207 kernel: [32784.556873] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 14:30:10 juju-e4d256-prod-github-runner-207 kernel: [32784.558236] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 14:30:10 juju-e4d256-prod-github-runner-207 kernel: [32784.559469] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:30:10 juju-e4d256-prod-github-runner-207 kernel: [32784.560527] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 14:30:10 juju-e4d256-prod-github-runner-207 kernel: [32784.563109] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 14:30:10 juju-e4d256-prod-github-runner-207 kernel: [32784.564160] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 14:30:10 juju-e4d256-prod-github-runner-207 kernel: [32784.565343] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 14:30:10 juju-e4d256-prod-github-runner-207 kernel: [32784.566509] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 14:30:10 juju-e4d256-prod-github-runner-207 kernel: [32784.567666] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 14:30:10 juju-e4d256-prod-github-runner-207 kernel: [32784.568836] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 14:30:10 juju-e4d256-prod-github-runner-207 kernel: [32784.570022] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 14:30:10 juju-e4d256-prod-github-runner-207 kernel: [32784.571257] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 14:30:10 juju-e4d256-prod-github-runner-207 kernel: [32784.572354] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 14:30:10 juju-e4d256-prod-github-runner-207 kernel: [32784.573613] Call Trace: Aug 22 14:30:10 juju-e4d256-prod-github-runner-207 kernel: [32784.574540] Aug 22 14:30:10 juju-e4d256-prod-github-runner-207 kernel: [32784.575445] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:30:10 juju-e4d256-prod-github-runner-207 kernel: [32784.576483] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:30:10 juju-e4d256-prod-github-runner-207 kernel: [32784.577523] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:30:10 juju-e4d256-prod-github-runner-207 kernel: [32784.578724] ? show_regs.part.0+0x23/0x29 Aug 22 14:30:10 juju-e4d256-prod-github-runner-207 kernel: [32784.579738] ? show_regs.cold+0x8/0xd Aug 22 14:30:10 juju-e4d256-prod-github-runner-207 kernel: [32784.580788] ? watchdog_timer_fn+0x1be/0x220 Aug 22 14:30:10 juju-e4d256-prod-github-runner-207 kernel: [32784.581903] ? lockup_detector_update_enable+0x60/0x60 Aug 22 14:30:10 juju-e4d256-prod-github-runner-207 kernel: [32784.582979] ? __hrtimer_run_queues+0x107/0x230 Aug 22 14:30:10 juju-e4d256-prod-github-runner-207 kernel: [32784.584028] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 14:30:10 juju-e4d256-prod-github-runner-207 kernel: [32784.585073] ? hrtimer_interrupt+0x101/0x220 Aug 22 14:30:10 juju-e4d256-prod-github-runner-207 kernel: [32784.586090] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 14:30:10 juju-e4d256-prod-github-runner-207 kernel: [32784.587213] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 14:30:10 juju-e4d256-prod-github-runner-207 kernel: [32784.588298] Aug 22 14:30:10 juju-e4d256-prod-github-runner-207 kernel: [32784.589225] Aug 22 14:30:10 juju-e4d256-prod-github-runner-207 kernel: [32784.590066] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 14:30:10 juju-e4d256-prod-github-runner-207 kernel: [32784.591108] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:30:10 juju-e4d256-prod-github-runner-207 kernel: [32784.592154] ? _raw_spin_lock+0x22/0x30 Aug 22 14:30:10 juju-e4d256-prod-github-runner-207 kernel: [32784.593125] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:30:10 juju-e4d256-prod-github-runner-207 kernel: [32784.594152] direct_page_fault+0x206/0x310 [kvm] Aug 22 14:30:10 juju-e4d256-prod-github-runner-207 kernel: [32784.595565] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 14:30:10 juju-e4d256-prod-github-runner-207 kernel: [32784.596575] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 14:30:10 juju-e4d256-prod-github-runner-207 kernel: [32784.597650] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 14:30:10 juju-e4d256-prod-github-runner-207 kernel: [32784.598663] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 14:30:10 juju-e4d256-prod-github-runner-207 kernel: [32784.599617] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 14:30:10 juju-e4d256-prod-github-runner-207 kernel: [32784.600596] handle_exit+0x98/0x230 [kvm_amd] Aug 22 14:30:10 juju-e4d256-prod-github-runner-207 kernel: [32784.601522] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 14:30:10 juju-e4d256-prod-github-runner-207 kernel: [32784.602551] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 14:30:10 juju-e4d256-prod-github-runner-207 kernel: [32784.603523] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 14:30:10 juju-e4d256-prod-github-runner-207 kernel: [32784.604504] vcpu_run+0x62/0x2c0 [kvm] Aug 22 14:30:10 juju-e4d256-prod-github-runner-207 kernel: [32784.605352] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 14:30:10 juju-e4d256-prod-github-runner-207 kernel: [32784.606239] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 14:30:10 juju-e4d256-prod-github-runner-207 kernel: [32784.607109] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 14:30:10 juju-e4d256-prod-github-runner-207 kernel: [32784.608008] ? __seccomp_filter+0x4a/0x4a0 Aug 22 14:30:10 juju-e4d256-prod-github-runner-207 kernel: [32784.608810] ? __fget_files+0x86/0xc0 Aug 22 14:30:10 juju-e4d256-prod-github-runner-207 kernel: [32784.609591] __x64_sys_ioctl+0x95/0xd0 Aug 22 14:30:10 juju-e4d256-prod-github-runner-207 kernel: [32784.610289] do_syscall_64+0x5c/0xc0 Aug 22 14:30:10 juju-e4d256-prod-github-runner-207 kernel: [32784.610976] ? do_futex+0x162/0x1f0 Aug 22 14:30:10 juju-e4d256-prod-github-runner-207 kernel: [32784.611643] ? __x64_sys_futex+0x78/0x1e0 Aug 22 14:30:10 juju-e4d256-prod-github-runner-207 kernel: [32784.612317] ? __secure_computing+0xa9/0x120 Aug 22 14:30:10 juju-e4d256-prod-github-runner-207 kernel: [32784.613028] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 14:30:10 juju-e4d256-prod-github-runner-207 kernel: [32784.613810] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:30:10 juju-e4d256-prod-github-runner-207 kernel: [32784.614575] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:30:10 juju-e4d256-prod-github-runner-207 kernel: [32784.615326] ? do_syscall_64+0x69/0xc0 Aug 22 14:30:10 juju-e4d256-prod-github-runner-207 kernel: [32784.615989] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:30:10 juju-e4d256-prod-github-runner-207 kernel: [32784.616730] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:30:10 juju-e4d256-prod-github-runner-207 kernel: [32784.617462] ? do_syscall_64+0x69/0xc0 Aug 22 14:30:10 juju-e4d256-prod-github-runner-207 kernel: [32784.618090] ? do_syscall_64+0x69/0xc0 Aug 22 14:30:10 juju-e4d256-prod-github-runner-207 kernel: [32784.618741] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 14:30:10 juju-e4d256-prod-github-runner-207 kernel: [32784.619469] RIP: 0033:0x7faa5d0edaff Aug 22 14:30:10 juju-e4d256-prod-github-runner-207 kernel: [32784.620140] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 14:30:10 juju-e4d256-prod-github-runner-207 kernel: [32784.622145] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 14:30:10 juju-e4d256-prod-github-runner-207 kernel: [32784.623061] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 14:30:10 juju-e4d256-prod-github-runner-207 kernel: [32784.623963] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 14:30:10 juju-e4d256-prod-github-runner-207 kernel: [32784.624928] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 14:30:10 juju-e4d256-prod-github-runner-207 kernel: [32784.625830] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 14:30:10 juju-e4d256-prod-github-runner-207 kernel: [32784.626721] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 14:30:10 juju-e4d256-prod-github-runner-207 kernel: [32784.627618] Aug 22 14:30:38 juju-e4d256-prod-github-runner-207 kernel: [32812.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 30451s! [qemu-system-x86:6715] Aug 22 14:30:38 juju-e4d256-prod-github-runner-207 kernel: [32812.543091] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 14:30:38 juju-e4d256-prod-github-runner-207 kernel: [32812.543162] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 14:30:38 juju-e4d256-prod-github-runner-207 kernel: [32812.555465] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 14:30:38 juju-e4d256-prod-github-runner-207 kernel: [32812.556762] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 14:30:38 juju-e4d256-prod-github-runner-207 kernel: [32812.558005] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:30:38 juju-e4d256-prod-github-runner-207 kernel: [32812.559075] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 14:30:38 juju-e4d256-prod-github-runner-207 kernel: [32812.561720] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 14:30:38 juju-e4d256-prod-github-runner-207 kernel: [32812.562948] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 14:30:38 juju-e4d256-prod-github-runner-207 kernel: [32812.564133] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 14:30:38 juju-e4d256-prod-github-runner-207 kernel: [32812.565324] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 14:30:38 juju-e4d256-prod-github-runner-207 kernel: [32812.566868] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 14:30:38 juju-e4d256-prod-github-runner-207 kernel: [32812.568045] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 14:30:38 juju-e4d256-prod-github-runner-207 kernel: [32812.569231] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 14:30:38 juju-e4d256-prod-github-runner-207 kernel: [32812.570484] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 14:30:38 juju-e4d256-prod-github-runner-207 kernel: [32812.571593] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 14:30:38 juju-e4d256-prod-github-runner-207 kernel: [32812.572811] Call Trace: Aug 22 14:30:38 juju-e4d256-prod-github-runner-207 kernel: [32812.573728] Aug 22 14:30:38 juju-e4d256-prod-github-runner-207 kernel: [32812.574616] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:30:38 juju-e4d256-prod-github-runner-207 kernel: [32812.575656] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:30:38 juju-e4d256-prod-github-runner-207 kernel: [32812.576712] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:30:38 juju-e4d256-prod-github-runner-207 kernel: [32812.577799] ? show_regs.part.0+0x23/0x29 Aug 22 14:30:38 juju-e4d256-prod-github-runner-207 kernel: [32812.578809] ? show_regs.cold+0x8/0xd Aug 22 14:30:38 juju-e4d256-prod-github-runner-207 kernel: [32812.579787] ? watchdog_timer_fn+0x1be/0x220 Aug 22 14:30:38 juju-e4d256-prod-github-runner-207 kernel: [32812.580816] ? lockup_detector_update_enable+0x60/0x60 Aug 22 14:30:38 juju-e4d256-prod-github-runner-207 kernel: [32812.581924] ? __hrtimer_run_queues+0x107/0x230 Aug 22 14:30:38 juju-e4d256-prod-github-runner-207 kernel: [32812.582957] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 14:30:38 juju-e4d256-prod-github-runner-207 kernel: [32812.583999] ? hrtimer_interrupt+0x101/0x220 Aug 22 14:30:38 juju-e4d256-prod-github-runner-207 kernel: [32812.585034] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 14:30:38 juju-e4d256-prod-github-runner-207 kernel: [32812.586168] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 14:30:38 juju-e4d256-prod-github-runner-207 kernel: [32812.587223] Aug 22 14:30:38 juju-e4d256-prod-github-runner-207 kernel: [32812.588087] Aug 22 14:30:38 juju-e4d256-prod-github-runner-207 kernel: [32812.588943] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 14:30:38 juju-e4d256-prod-github-runner-207 kernel: [32812.589993] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:30:38 juju-e4d256-prod-github-runner-207 kernel: [32812.591054] ? _raw_spin_lock+0x22/0x30 Aug 22 14:30:38 juju-e4d256-prod-github-runner-207 kernel: [32812.592012] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:30:38 juju-e4d256-prod-github-runner-207 kernel: [32812.593052] direct_page_fault+0x206/0x310 [kvm] Aug 22 14:30:38 juju-e4d256-prod-github-runner-207 kernel: [32812.594092] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 14:30:38 juju-e4d256-prod-github-runner-207 kernel: [32812.595108] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 14:30:38 juju-e4d256-prod-github-runner-207 kernel: [32812.596119] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 14:30:38 juju-e4d256-prod-github-runner-207 kernel: [32812.597106] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 14:30:38 juju-e4d256-prod-github-runner-207 kernel: [32812.598061] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 14:30:38 juju-e4d256-prod-github-runner-207 kernel: [32812.599048] handle_exit+0x98/0x230 [kvm_amd] Aug 22 14:30:38 juju-e4d256-prod-github-runner-207 kernel: [32812.599947] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 14:30:38 juju-e4d256-prod-github-runner-207 kernel: [32812.600885] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 14:30:38 juju-e4d256-prod-github-runner-207 kernel: [32812.601825] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 14:30:38 juju-e4d256-prod-github-runner-207 kernel: [32812.602740] vcpu_run+0x62/0x2c0 [kvm] Aug 22 14:30:38 juju-e4d256-prod-github-runner-207 kernel: [32812.603567] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 14:30:38 juju-e4d256-prod-github-runner-207 kernel: [32812.604381] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 14:30:38 juju-e4d256-prod-github-runner-207 kernel: [32812.605252] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 14:30:38 juju-e4d256-prod-github-runner-207 kernel: [32812.606055] ? __seccomp_filter+0x4a/0x4a0 Aug 22 14:30:38 juju-e4d256-prod-github-runner-207 kernel: [32812.606819] ? __fget_files+0x86/0xc0 Aug 22 14:30:38 juju-e4d256-prod-github-runner-207 kernel: [32812.607527] __x64_sys_ioctl+0x95/0xd0 Aug 22 14:30:38 juju-e4d256-prod-github-runner-207 kernel: [32812.608222] do_syscall_64+0x5c/0xc0 Aug 22 14:30:38 juju-e4d256-prod-github-runner-207 kernel: [32812.608902] ? do_futex+0x162/0x1f0 Aug 22 14:30:38 juju-e4d256-prod-github-runner-207 kernel: [32812.609561] ? __x64_sys_futex+0x78/0x1e0 Aug 22 14:30:38 juju-e4d256-prod-github-runner-207 kernel: [32812.610240] ? __secure_computing+0xa9/0x120 Aug 22 14:30:38 juju-e4d256-prod-github-runner-207 kernel: [32812.610935] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 14:30:38 juju-e4d256-prod-github-runner-207 kernel: [32812.611714] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:30:38 juju-e4d256-prod-github-runner-207 kernel: [32812.612458] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:30:38 juju-e4d256-prod-github-runner-207 kernel: [32812.613194] ? do_syscall_64+0x69/0xc0 Aug 22 14:30:38 juju-e4d256-prod-github-runner-207 kernel: [32812.613845] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:30:38 juju-e4d256-prod-github-runner-207 kernel: [32812.614553] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:30:38 juju-e4d256-prod-github-runner-207 kernel: [32812.615254] ? do_syscall_64+0x69/0xc0 Aug 22 14:30:38 juju-e4d256-prod-github-runner-207 kernel: [32812.615886] ? do_syscall_64+0x69/0xc0 Aug 22 14:30:38 juju-e4d256-prod-github-runner-207 kernel: [32812.616516] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 14:30:38 juju-e4d256-prod-github-runner-207 kernel: [32812.617236] RIP: 0033:0x7faa5d0edaff Aug 22 14:30:38 juju-e4d256-prod-github-runner-207 kernel: [32812.617884] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 14:30:38 juju-e4d256-prod-github-runner-207 kernel: [32812.619895] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 14:30:38 juju-e4d256-prod-github-runner-207 kernel: [32812.620898] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 14:30:38 juju-e4d256-prod-github-runner-207 kernel: [32812.621808] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 14:30:38 juju-e4d256-prod-github-runner-207 kernel: [32812.622720] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 14:30:38 juju-e4d256-prod-github-runner-207 kernel: [32812.623619] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 14:30:38 juju-e4d256-prod-github-runner-207 kernel: [32812.624512] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 14:30:38 juju-e4d256-prod-github-runner-207 kernel: [32812.625437] Aug 22 14:31:06 juju-e4d256-prod-github-runner-207 kernel: [32840.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 30477s! [qemu-system-x86:6715] Aug 22 14:31:06 juju-e4d256-prod-github-runner-207 kernel: [32840.543141] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 14:31:06 juju-e4d256-prod-github-runner-207 kernel: [32840.543216] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 14:31:06 juju-e4d256-prod-github-runner-207 kernel: [32840.555960] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 14:31:06 juju-e4d256-prod-github-runner-207 kernel: [32840.557318] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 14:31:06 juju-e4d256-prod-github-runner-207 kernel: [32840.558559] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:31:06 juju-e4d256-prod-github-runner-207 kernel: [32840.559634] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 14:31:06 juju-e4d256-prod-github-runner-207 kernel: [32840.562220] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 14:31:06 juju-e4d256-prod-github-runner-207 kernel: [32840.563264] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 14:31:06 juju-e4d256-prod-github-runner-207 kernel: [32840.564453] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 14:31:06 juju-e4d256-prod-github-runner-207 kernel: [32840.565626] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 14:31:06 juju-e4d256-prod-github-runner-207 kernel: [32840.566806] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 14:31:06 juju-e4d256-prod-github-runner-207 kernel: [32840.567975] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 14:31:06 juju-e4d256-prod-github-runner-207 kernel: [32840.569156] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 14:31:06 juju-e4d256-prod-github-runner-207 kernel: [32840.570394] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 14:31:06 juju-e4d256-prod-github-runner-207 kernel: [32840.571510] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 14:31:06 juju-e4d256-prod-github-runner-207 kernel: [32840.572772] Call Trace: Aug 22 14:31:06 juju-e4d256-prod-github-runner-207 kernel: [32840.573693] Aug 22 14:31:06 juju-e4d256-prod-github-runner-207 kernel: [32840.574591] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:31:06 juju-e4d256-prod-github-runner-207 kernel: [32840.575640] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:31:06 juju-e4d256-prod-github-runner-207 kernel: [32840.576677] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:31:06 juju-e4d256-prod-github-runner-207 kernel: [32840.577759] ? show_regs.part.0+0x23/0x29 Aug 22 14:31:06 juju-e4d256-prod-github-runner-207 kernel: [32840.578758] ? show_regs.cold+0x8/0xd Aug 22 14:31:06 juju-e4d256-prod-github-runner-207 kernel: [32840.579733] ? watchdog_timer_fn+0x1be/0x220 Aug 22 14:31:06 juju-e4d256-prod-github-runner-207 kernel: [32840.580821] ? lockup_detector_update_enable+0x60/0x60 Aug 22 14:31:06 juju-e4d256-prod-github-runner-207 kernel: [32840.581905] ? __hrtimer_run_queues+0x107/0x230 Aug 22 14:31:06 juju-e4d256-prod-github-runner-207 kernel: [32840.582950] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 14:31:06 juju-e4d256-prod-github-runner-207 kernel: [32840.583984] ? hrtimer_interrupt+0x101/0x220 Aug 22 14:31:06 juju-e4d256-prod-github-runner-207 kernel: [32840.585019] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 14:31:06 juju-e4d256-prod-github-runner-207 kernel: [32840.586111] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 14:31:06 juju-e4d256-prod-github-runner-207 kernel: [32840.587163] Aug 22 14:31:06 juju-e4d256-prod-github-runner-207 kernel: [32840.588020] Aug 22 14:31:06 juju-e4d256-prod-github-runner-207 kernel: [32840.588874] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 14:31:06 juju-e4d256-prod-github-runner-207 kernel: [32840.589911] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:31:06 juju-e4d256-prod-github-runner-207 kernel: [32840.590955] ? _raw_spin_lock+0x22/0x30 Aug 22 14:31:06 juju-e4d256-prod-github-runner-207 kernel: [32840.591957] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:31:06 juju-e4d256-prod-github-runner-207 kernel: [32840.593001] direct_page_fault+0x206/0x310 [kvm] Aug 22 14:31:06 juju-e4d256-prod-github-runner-207 kernel: [32840.594040] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 14:31:06 juju-e4d256-prod-github-runner-207 kernel: [32840.595060] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 14:31:06 juju-e4d256-prod-github-runner-207 kernel: [32840.596121] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 14:31:06 juju-e4d256-prod-github-runner-207 kernel: [32840.597169] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 14:31:06 juju-e4d256-prod-github-runner-207 kernel: [32840.598134] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 14:31:06 juju-e4d256-prod-github-runner-207 kernel: [32840.599127] handle_exit+0x98/0x230 [kvm_amd] Aug 22 14:31:06 juju-e4d256-prod-github-runner-207 kernel: [32840.600024] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 14:31:06 juju-e4d256-prod-github-runner-207 kernel: [32840.600961] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 14:31:06 juju-e4d256-prod-github-runner-207 kernel: [32840.601905] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 14:31:06 juju-e4d256-prod-github-runner-207 kernel: [32840.602828] vcpu_run+0x62/0x2c0 [kvm] Aug 22 14:31:06 juju-e4d256-prod-github-runner-207 kernel: [32840.603650] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 14:31:06 juju-e4d256-prod-github-runner-207 kernel: [32840.604486] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 14:31:06 juju-e4d256-prod-github-runner-207 kernel: [32840.605346] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 14:31:06 juju-e4d256-prod-github-runner-207 kernel: [32840.606141] ? __seccomp_filter+0x4a/0x4a0 Aug 22 14:31:06 juju-e4d256-prod-github-runner-207 kernel: [32840.606883] ? __fget_files+0x86/0xc0 Aug 22 14:31:06 juju-e4d256-prod-github-runner-207 kernel: [32840.607584] __x64_sys_ioctl+0x95/0xd0 Aug 22 14:31:06 juju-e4d256-prod-github-runner-207 kernel: [32840.608288] do_syscall_64+0x5c/0xc0 Aug 22 14:31:06 juju-e4d256-prod-github-runner-207 kernel: [32840.608955] ? do_futex+0x162/0x1f0 Aug 22 14:31:06 juju-e4d256-prod-github-runner-207 kernel: [32840.609644] ? __x64_sys_futex+0x78/0x1e0 Aug 22 14:31:06 juju-e4d256-prod-github-runner-207 kernel: [32840.610319] ? __secure_computing+0xa9/0x120 Aug 22 14:31:06 juju-e4d256-prod-github-runner-207 kernel: [32840.611032] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 14:31:06 juju-e4d256-prod-github-runner-207 kernel: [32840.611791] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:31:06 juju-e4d256-prod-github-runner-207 kernel: [32840.612520] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:31:06 juju-e4d256-prod-github-runner-207 kernel: [32840.613239] ? do_syscall_64+0x69/0xc0 Aug 22 14:31:06 juju-e4d256-prod-github-runner-207 kernel: [32840.614026] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:31:06 juju-e4d256-prod-github-runner-207 kernel: [32840.614759] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:31:06 juju-e4d256-prod-github-runner-207 kernel: [32840.615469] ? do_syscall_64+0x69/0xc0 Aug 22 14:31:06 juju-e4d256-prod-github-runner-207 kernel: [32840.616185] ? do_syscall_64+0x69/0xc0 Aug 22 14:31:06 juju-e4d256-prod-github-runner-207 kernel: [32840.616840] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 14:31:06 juju-e4d256-prod-github-runner-207 kernel: [32840.617547] RIP: 0033:0x7faa5d0edaff Aug 22 14:31:06 juju-e4d256-prod-github-runner-207 kernel: [32840.618185] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 14:31:06 juju-e4d256-prod-github-runner-207 kernel: [32840.620192] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 14:31:06 juju-e4d256-prod-github-runner-207 kernel: [32840.621147] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 14:31:06 juju-e4d256-prod-github-runner-207 kernel: [32840.622104] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 14:31:06 juju-e4d256-prod-github-runner-207 kernel: [32840.622990] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 14:31:06 juju-e4d256-prod-github-runner-207 kernel: [32840.623878] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 14:31:06 juju-e4d256-prod-github-runner-207 kernel: [32840.624783] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 14:31:06 juju-e4d256-prod-github-runner-207 kernel: [32840.625672] Aug 22 14:31:34 juju-e4d256-prod-github-runner-207 kernel: [32868.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 30503s! [qemu-system-x86:6715] Aug 22 14:31:34 juju-e4d256-prod-github-runner-207 kernel: [32868.543863] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 14:31:34 juju-e4d256-prod-github-runner-207 kernel: [32868.544158] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 14:31:34 juju-e4d256-prod-github-runner-207 kernel: [32868.558562] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 14:31:34 juju-e4d256-prod-github-runner-207 kernel: [32868.560690] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 14:31:34 juju-e4d256-prod-github-runner-207 kernel: [32868.562540] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:31:34 juju-e4d256-prod-github-runner-207 kernel: [32868.564147] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 14:31:34 juju-e4d256-prod-github-runner-207 kernel: [32868.567376] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 14:31:34 juju-e4d256-prod-github-runner-207 kernel: [32868.568487] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 14:31:34 juju-e4d256-prod-github-runner-207 kernel: [32868.569660] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 14:31:34 juju-e4d256-prod-github-runner-207 kernel: [32868.570824] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 14:31:34 juju-e4d256-prod-github-runner-207 kernel: [32868.572031] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 14:31:34 juju-e4d256-prod-github-runner-207 kernel: [32868.573195] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 14:31:34 juju-e4d256-prod-github-runner-207 kernel: [32868.574357] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 14:31:34 juju-e4d256-prod-github-runner-207 kernel: [32868.575585] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 14:31:34 juju-e4d256-prod-github-runner-207 kernel: [32868.576692] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 14:31:34 juju-e4d256-prod-github-runner-207 kernel: [32868.577887] Call Trace: Aug 22 14:31:34 juju-e4d256-prod-github-runner-207 kernel: [32868.578804] Aug 22 14:31:34 juju-e4d256-prod-github-runner-207 kernel: [32868.579709] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:31:34 juju-e4d256-prod-github-runner-207 kernel: [32868.580754] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:31:34 juju-e4d256-prod-github-runner-207 kernel: [32868.581784] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:31:34 juju-e4d256-prod-github-runner-207 kernel: [32868.582895] ? show_regs.part.0+0x23/0x29 Aug 22 14:31:34 juju-e4d256-prod-github-runner-207 kernel: [32868.583904] ? show_regs.cold+0x8/0xd Aug 22 14:31:34 juju-e4d256-prod-github-runner-207 kernel: [32868.584874] ? watchdog_timer_fn+0x1be/0x220 Aug 22 14:31:34 juju-e4d256-prod-github-runner-207 kernel: [32868.585881] ? lockup_detector_update_enable+0x60/0x60 Aug 22 14:31:34 juju-e4d256-prod-github-runner-207 kernel: [32868.586946] ? __hrtimer_run_queues+0x107/0x230 Aug 22 14:31:34 juju-e4d256-prod-github-runner-207 kernel: [32868.587984] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 14:31:34 juju-e4d256-prod-github-runner-207 kernel: [32868.589011] ? hrtimer_interrupt+0x101/0x220 Aug 22 14:31:34 juju-e4d256-prod-github-runner-207 kernel: [32868.590024] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 14:31:34 juju-e4d256-prod-github-runner-207 kernel: [32868.591094] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 14:31:34 juju-e4d256-prod-github-runner-207 kernel: [32868.592156] Aug 22 14:31:34 juju-e4d256-prod-github-runner-207 kernel: [32868.593007] Aug 22 14:31:34 juju-e4d256-prod-github-runner-207 kernel: [32868.593844] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 14:31:34 juju-e4d256-prod-github-runner-207 kernel: [32868.594875] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:31:34 juju-e4d256-prod-github-runner-207 kernel: [32868.595933] ? _raw_spin_lock+0x22/0x30 Aug 22 14:31:34 juju-e4d256-prod-github-runner-207 kernel: [32868.596877] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:31:34 juju-e4d256-prod-github-runner-207 kernel: [32868.597898] direct_page_fault+0x206/0x310 [kvm] Aug 22 14:31:34 juju-e4d256-prod-github-runner-207 kernel: [32868.599300] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 14:31:34 juju-e4d256-prod-github-runner-207 kernel: [32868.600823] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 14:31:34 juju-e4d256-prod-github-runner-207 kernel: [32868.602235] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 14:31:34 juju-e4d256-prod-github-runner-207 kernel: [32868.603253] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 14:31:34 juju-e4d256-prod-github-runner-207 kernel: [32868.604218] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 14:31:34 juju-e4d256-prod-github-runner-207 kernel: [32868.605196] handle_exit+0x98/0x230 [kvm_amd] Aug 22 14:31:34 juju-e4d256-prod-github-runner-207 kernel: [32868.606094] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 14:31:34 juju-e4d256-prod-github-runner-207 kernel: [32868.607007] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 14:31:34 juju-e4d256-prod-github-runner-207 kernel: [32868.607939] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 14:31:34 juju-e4d256-prod-github-runner-207 kernel: [32868.608874] vcpu_run+0x62/0x2c0 [kvm] Aug 22 14:31:34 juju-e4d256-prod-github-runner-207 kernel: [32868.609686] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 14:31:34 juju-e4d256-prod-github-runner-207 kernel: [32868.610493] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 14:31:34 juju-e4d256-prod-github-runner-207 kernel: [32868.611346] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 14:31:34 juju-e4d256-prod-github-runner-207 kernel: [32868.612157] ? __seccomp_filter+0x4a/0x4a0 Aug 22 14:31:34 juju-e4d256-prod-github-runner-207 kernel: [32868.612900] ? __fget_files+0x86/0xc0 Aug 22 14:31:34 juju-e4d256-prod-github-runner-207 kernel: [32868.613602] __x64_sys_ioctl+0x95/0xd0 Aug 22 14:31:34 juju-e4d256-prod-github-runner-207 kernel: [32868.614294] do_syscall_64+0x5c/0xc0 Aug 22 14:31:34 juju-e4d256-prod-github-runner-207 kernel: [32868.614958] ? do_futex+0x162/0x1f0 Aug 22 14:31:34 juju-e4d256-prod-github-runner-207 kernel: [32868.615605] ? __x64_sys_futex+0x78/0x1e0 Aug 22 14:31:34 juju-e4d256-prod-github-runner-207 kernel: [32868.616295] ? __secure_computing+0xa9/0x120 Aug 22 14:31:34 juju-e4d256-prod-github-runner-207 kernel: [32868.616983] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 14:31:34 juju-e4d256-prod-github-runner-207 kernel: [32868.617741] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:31:34 juju-e4d256-prod-github-runner-207 kernel: [32868.618461] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:31:34 juju-e4d256-prod-github-runner-207 kernel: [32868.619176] ? do_syscall_64+0x69/0xc0 Aug 22 14:31:34 juju-e4d256-prod-github-runner-207 kernel: [32868.619831] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:31:34 juju-e4d256-prod-github-runner-207 kernel: [32868.620531] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:31:34 juju-e4d256-prod-github-runner-207 kernel: [32868.621228] ? do_syscall_64+0x69/0xc0 Aug 22 14:31:34 juju-e4d256-prod-github-runner-207 kernel: [32868.621851] ? do_syscall_64+0x69/0xc0 Aug 22 14:31:34 juju-e4d256-prod-github-runner-207 kernel: [32868.622472] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 14:31:34 juju-e4d256-prod-github-runner-207 kernel: [32868.623200] RIP: 0033:0x7faa5d0edaff Aug 22 14:31:34 juju-e4d256-prod-github-runner-207 kernel: [32868.623859] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 14:31:34 juju-e4d256-prod-github-runner-207 kernel: [32868.625845] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 14:31:34 juju-e4d256-prod-github-runner-207 kernel: [32868.626758] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 14:31:34 juju-e4d256-prod-github-runner-207 kernel: [32868.627648] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 14:31:34 juju-e4d256-prod-github-runner-207 kernel: [32868.628568] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 14:31:34 juju-e4d256-prod-github-runner-207 kernel: [32868.629453] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 14:31:34 juju-e4d256-prod-github-runner-207 kernel: [32868.630336] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 14:31:34 juju-e4d256-prod-github-runner-207 kernel: [32868.631222] Aug 22 14:32:02 juju-e4d256-prod-github-runner-207 kernel: [32896.541982] watchdog: BUG: soft lockup - CPU#1 stuck for 30529s! [qemu-system-x86:6715] Aug 22 14:32:02 juju-e4d256-prod-github-runner-207 kernel: [32896.543133] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 14:32:02 juju-e4d256-prod-github-runner-207 kernel: [32896.543209] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 14:32:02 juju-e4d256-prod-github-runner-207 kernel: [32896.555297] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 14:32:02 juju-e4d256-prod-github-runner-207 kernel: [32896.556619] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 14:32:02 juju-e4d256-prod-github-runner-207 kernel: [32896.557920] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:32:02 juju-e4d256-prod-github-runner-207 kernel: [32896.559015] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 14:32:02 juju-e4d256-prod-github-runner-207 kernel: [32896.561625] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 14:32:02 juju-e4d256-prod-github-runner-207 kernel: [32896.562678] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 14:32:02 juju-e4d256-prod-github-runner-207 kernel: [32896.563872] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 14:32:02 juju-e4d256-prod-github-runner-207 kernel: [32896.565231] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 14:32:02 juju-e4d256-prod-github-runner-207 kernel: [32896.566612] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 14:32:02 juju-e4d256-prod-github-runner-207 kernel: [32896.567803] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 14:32:02 juju-e4d256-prod-github-runner-207 kernel: [32896.568994] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 14:32:02 juju-e4d256-prod-github-runner-207 kernel: [32896.570232] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 14:32:02 juju-e4d256-prod-github-runner-207 kernel: [32896.571354] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 14:32:02 juju-e4d256-prod-github-runner-207 kernel: [32896.572585] Call Trace: Aug 22 14:32:02 juju-e4d256-prod-github-runner-207 kernel: [32896.573523] Aug 22 14:32:02 juju-e4d256-prod-github-runner-207 kernel: [32896.574422] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:32:02 juju-e4d256-prod-github-runner-207 kernel: [32896.575484] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:32:02 juju-e4d256-prod-github-runner-207 kernel: [32896.576520] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:32:02 juju-e4d256-prod-github-runner-207 kernel: [32896.577611] ? show_regs.part.0+0x23/0x29 Aug 22 14:32:02 juju-e4d256-prod-github-runner-207 kernel: [32896.578610] ? show_regs.cold+0x8/0xd Aug 22 14:32:02 juju-e4d256-prod-github-runner-207 kernel: [32896.579610] ? watchdog_timer_fn+0x1be/0x220 Aug 22 14:32:02 juju-e4d256-prod-github-runner-207 kernel: [32896.580626] ? lockup_detector_update_enable+0x60/0x60 Aug 22 14:32:02 juju-e4d256-prod-github-runner-207 kernel: [32896.581726] ? __hrtimer_run_queues+0x107/0x230 Aug 22 14:32:02 juju-e4d256-prod-github-runner-207 kernel: [32896.582762] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 14:32:02 juju-e4d256-prod-github-runner-207 kernel: [32896.583819] ? hrtimer_interrupt+0x101/0x220 Aug 22 14:32:02 juju-e4d256-prod-github-runner-207 kernel: [32896.584841] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 14:32:02 juju-e4d256-prod-github-runner-207 kernel: [32896.585910] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 14:32:02 juju-e4d256-prod-github-runner-207 kernel: [32896.586956] Aug 22 14:32:02 juju-e4d256-prod-github-runner-207 kernel: [32896.587828] Aug 22 14:32:02 juju-e4d256-prod-github-runner-207 kernel: [32896.588669] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 14:32:02 juju-e4d256-prod-github-runner-207 kernel: [32896.589705] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:32:02 juju-e4d256-prod-github-runner-207 kernel: [32896.590750] ? _raw_spin_lock+0x22/0x30 Aug 22 14:32:02 juju-e4d256-prod-github-runner-207 kernel: [32896.591758] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:32:02 juju-e4d256-prod-github-runner-207 kernel: [32896.592823] direct_page_fault+0x206/0x310 [kvm] Aug 22 14:32:02 juju-e4d256-prod-github-runner-207 kernel: [32896.593858] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 14:32:02 juju-e4d256-prod-github-runner-207 kernel: [32896.594878] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 14:32:02 juju-e4d256-prod-github-runner-207 kernel: [32896.596020] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 14:32:02 juju-e4d256-prod-github-runner-207 kernel: [32896.597023] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 14:32:02 juju-e4d256-prod-github-runner-207 kernel: [32896.597997] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 14:32:02 juju-e4d256-prod-github-runner-207 kernel: [32896.598990] handle_exit+0x98/0x230 [kvm_amd] Aug 22 14:32:02 juju-e4d256-prod-github-runner-207 kernel: [32896.599907] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 14:32:02 juju-e4d256-prod-github-runner-207 kernel: [32896.601062] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 14:32:02 juju-e4d256-prod-github-runner-207 kernel: [32896.602358] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 14:32:02 juju-e4d256-prod-github-runner-207 kernel: [32896.603615] vcpu_run+0x62/0x2c0 [kvm] Aug 22 14:32:02 juju-e4d256-prod-github-runner-207 kernel: [32896.604491] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 14:32:02 juju-e4d256-prod-github-runner-207 kernel: [32896.605317] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 14:32:02 juju-e4d256-prod-github-runner-207 kernel: [32896.606188] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 14:32:02 juju-e4d256-prod-github-runner-207 kernel: [32896.607006] ? __seccomp_filter+0x4a/0x4a0 Aug 22 14:32:02 juju-e4d256-prod-github-runner-207 kernel: [32896.607778] ? __fget_files+0x86/0xc0 Aug 22 14:32:02 juju-e4d256-prod-github-runner-207 kernel: [32896.608495] __x64_sys_ioctl+0x95/0xd0 Aug 22 14:32:02 juju-e4d256-prod-github-runner-207 kernel: [32896.609192] do_syscall_64+0x5c/0xc0 Aug 22 14:32:02 juju-e4d256-prod-github-runner-207 kernel: [32896.609879] ? do_futex+0x162/0x1f0 Aug 22 14:32:02 juju-e4d256-prod-github-runner-207 kernel: [32896.610568] ? __x64_sys_futex+0x78/0x1e0 Aug 22 14:32:02 juju-e4d256-prod-github-runner-207 kernel: [32896.611249] ? __secure_computing+0xa9/0x120 Aug 22 14:32:02 juju-e4d256-prod-github-runner-207 kernel: [32896.611960] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 14:32:02 juju-e4d256-prod-github-runner-207 kernel: [32896.612726] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:32:02 juju-e4d256-prod-github-runner-207 kernel: [32896.613453] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:32:02 juju-e4d256-prod-github-runner-207 kernel: [32896.614181] ? do_syscall_64+0x69/0xc0 Aug 22 14:32:02 juju-e4d256-prod-github-runner-207 kernel: [32896.614828] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:32:02 juju-e4d256-prod-github-runner-207 kernel: [32896.615560] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:32:02 juju-e4d256-prod-github-runner-207 kernel: [32896.616257] ? do_syscall_64+0x69/0xc0 Aug 22 14:32:02 juju-e4d256-prod-github-runner-207 kernel: [32896.616885] ? do_syscall_64+0x69/0xc0 Aug 22 14:32:02 juju-e4d256-prod-github-runner-207 kernel: [32896.617507] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 14:32:02 juju-e4d256-prod-github-runner-207 kernel: [32896.618213] RIP: 0033:0x7faa5d0edaff Aug 22 14:32:02 juju-e4d256-prod-github-runner-207 kernel: [32896.618859] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 14:32:02 juju-e4d256-prod-github-runner-207 kernel: [32896.621042] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 14:32:02 juju-e4d256-prod-github-runner-207 kernel: [32896.621957] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 14:32:02 juju-e4d256-prod-github-runner-207 kernel: [32896.622859] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 14:32:02 juju-e4d256-prod-github-runner-207 kernel: [32896.623776] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 14:32:02 juju-e4d256-prod-github-runner-207 kernel: [32896.624672] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 14:32:02 juju-e4d256-prod-github-runner-207 kernel: [32896.625597] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 14:32:02 juju-e4d256-prod-github-runner-207 kernel: [32896.626495] Aug 22 14:32:30 juju-e4d256-prod-github-runner-207 kernel: [32924.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 30555s! [qemu-system-x86:6715] Aug 22 14:32:30 juju-e4d256-prod-github-runner-207 kernel: [32924.543296] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 14:32:30 juju-e4d256-prod-github-runner-207 kernel: [32924.543369] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 14:32:30 juju-e4d256-prod-github-runner-207 kernel: [32924.557395] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 14:32:30 juju-e4d256-prod-github-runner-207 kernel: [32924.558857] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 14:32:30 juju-e4d256-prod-github-runner-207 kernel: [32924.560287] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:32:30 juju-e4d256-prod-github-runner-207 kernel: [32924.561563] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 14:32:30 juju-e4d256-prod-github-runner-207 kernel: [32924.564530] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 14:32:30 juju-e4d256-prod-github-runner-207 kernel: [32924.565741] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 14:32:30 juju-e4d256-prod-github-runner-207 kernel: [32924.567103] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 14:32:30 juju-e4d256-prod-github-runner-207 kernel: [32924.568403] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 14:32:30 juju-e4d256-prod-github-runner-207 kernel: [32924.569703] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 14:32:30 juju-e4d256-prod-github-runner-207 kernel: [32924.571091] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 14:32:30 juju-e4d256-prod-github-runner-207 kernel: [32924.572401] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 14:32:30 juju-e4d256-prod-github-runner-207 kernel: [32924.573813] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 14:32:30 juju-e4d256-prod-github-runner-207 kernel: [32924.575044] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 14:32:30 juju-e4d256-prod-github-runner-207 kernel: [32924.576377] Call Trace: Aug 22 14:32:30 juju-e4d256-prod-github-runner-207 kernel: [32924.577398] Aug 22 14:32:30 juju-e4d256-prod-github-runner-207 kernel: [32924.578330] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:32:30 juju-e4d256-prod-github-runner-207 kernel: [32924.579473] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:32:30 juju-e4d256-prod-github-runner-207 kernel: [32924.580613] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:32:30 juju-e4d256-prod-github-runner-207 kernel: [32924.581793] ? show_regs.part.0+0x23/0x29 Aug 22 14:32:30 juju-e4d256-prod-github-runner-207 kernel: [32924.582872] ? show_regs.cold+0x8/0xd Aug 22 14:32:30 juju-e4d256-prod-github-runner-207 kernel: [32924.583930] ? watchdog_timer_fn+0x1be/0x220 Aug 22 14:32:30 juju-e4d256-prod-github-runner-207 kernel: [32924.585029] ? lockup_detector_update_enable+0x60/0x60 Aug 22 14:32:30 juju-e4d256-prod-github-runner-207 kernel: [32924.586194] ? __hrtimer_run_queues+0x107/0x230 Aug 22 14:32:30 juju-e4d256-prod-github-runner-207 kernel: [32924.587399] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 14:32:30 juju-e4d256-prod-github-runner-207 kernel: [32924.588537] ? hrtimer_interrupt+0x101/0x220 Aug 22 14:32:30 juju-e4d256-prod-github-runner-207 kernel: [32924.589643] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 14:32:30 juju-e4d256-prod-github-runner-207 kernel: [32924.590810] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 14:32:30 juju-e4d256-prod-github-runner-207 kernel: [32924.592011] Aug 22 14:32:30 juju-e4d256-prod-github-runner-207 kernel: [32924.592950] Aug 22 14:32:30 juju-e4d256-prod-github-runner-207 kernel: [32924.593870] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 14:32:30 juju-e4d256-prod-github-runner-207 kernel: [32924.595063] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:32:30 juju-e4d256-prod-github-runner-207 kernel: [32924.596214] ? _raw_spin_lock+0x22/0x30 Aug 22 14:32:30 juju-e4d256-prod-github-runner-207 kernel: [32924.597243] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:32:30 juju-e4d256-prod-github-runner-207 kernel: [32924.598363] direct_page_fault+0x206/0x310 [kvm] Aug 22 14:32:30 juju-e4d256-prod-github-runner-207 kernel: [32924.599525] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 14:32:30 juju-e4d256-prod-github-runner-207 kernel: [32924.600661] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 14:32:30 juju-e4d256-prod-github-runner-207 kernel: [32924.601863] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 14:32:30 juju-e4d256-prod-github-runner-207 kernel: [32924.602947] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 14:32:30 juju-e4d256-prod-github-runner-207 kernel: [32924.604089] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 14:32:30 juju-e4d256-prod-github-runner-207 kernel: [32924.605276] handle_exit+0x98/0x230 [kvm_amd] Aug 22 14:32:30 juju-e4d256-prod-github-runner-207 kernel: [32924.606271] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 14:32:30 juju-e4d256-prod-github-runner-207 kernel: [32924.607314] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 14:32:30 juju-e4d256-prod-github-runner-207 kernel: [32924.608404] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 14:32:30 juju-e4d256-prod-github-runner-207 kernel: [32924.609422] vcpu_run+0x62/0x2c0 [kvm] Aug 22 14:32:30 juju-e4d256-prod-github-runner-207 kernel: [32924.610309] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 14:32:30 juju-e4d256-prod-github-runner-207 kernel: [32924.611227] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 14:32:30 juju-e4d256-prod-github-runner-207 kernel: [32924.612189] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 14:32:30 juju-e4d256-prod-github-runner-207 kernel: [32924.613084] ? __seccomp_filter+0x4a/0x4a0 Aug 22 14:32:30 juju-e4d256-prod-github-runner-207 kernel: [32924.613920] ? __fget_files+0x86/0xc0 Aug 22 14:32:30 juju-e4d256-prod-github-runner-207 kernel: [32924.614755] __x64_sys_ioctl+0x95/0xd0 Aug 22 14:32:30 juju-e4d256-prod-github-runner-207 kernel: [32924.615569] do_syscall_64+0x5c/0xc0 Aug 22 14:32:30 juju-e4d256-prod-github-runner-207 kernel: [32924.616309] ? do_futex+0x162/0x1f0 Aug 22 14:32:30 juju-e4d256-prod-github-runner-207 kernel: [32924.617026] ? __x64_sys_futex+0x78/0x1e0 Aug 22 14:32:30 juju-e4d256-prod-github-runner-207 kernel: [32924.617779] ? __secure_computing+0xa9/0x120 Aug 22 14:32:30 juju-e4d256-prod-github-runner-207 kernel: [32924.618558] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 14:32:30 juju-e4d256-prod-github-runner-207 kernel: [32924.619452] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:32:30 juju-e4d256-prod-github-runner-207 kernel: [32924.620275] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:32:30 juju-e4d256-prod-github-runner-207 kernel: [32924.621091] ? do_syscall_64+0x69/0xc0 Aug 22 14:32:30 juju-e4d256-prod-github-runner-207 kernel: [32924.621814] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:32:30 juju-e4d256-prod-github-runner-207 kernel: [32924.622613] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:32:30 juju-e4d256-prod-github-runner-207 kernel: [32924.623434] ? do_syscall_64+0x69/0xc0 Aug 22 14:32:30 juju-e4d256-prod-github-runner-207 kernel: [32924.624143] ? do_syscall_64+0x69/0xc0 Aug 22 14:32:30 juju-e4d256-prod-github-runner-207 kernel: [32924.624846] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 14:32:30 juju-e4d256-prod-github-runner-207 kernel: [32924.625651] RIP: 0033:0x7faa5d0edaff Aug 22 14:32:30 juju-e4d256-prod-github-runner-207 kernel: [32924.626349] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 14:32:30 juju-e4d256-prod-github-runner-207 kernel: [32924.628702] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 14:32:30 juju-e4d256-prod-github-runner-207 kernel: [32924.629757] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 14:32:30 juju-e4d256-prod-github-runner-207 kernel: [32924.630784] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 14:32:30 juju-e4d256-prod-github-runner-207 kernel: [32924.631859] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 14:32:30 juju-e4d256-prod-github-runner-207 kernel: [32924.632889] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 14:32:30 juju-e4d256-prod-github-runner-207 kernel: [32924.633912] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 14:32:30 juju-e4d256-prod-github-runner-207 kernel: [32924.634949] Aug 22 14:32:45 juju-e4d256-prod-github-runner-207 kernel: [32939.384710] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 14:32:45 juju-e4d256-prod-github-runner-207 kernel: [32939.385667] rcu: 1-....: (8179932 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=3951725 Aug 22 14:32:45 juju-e4d256-prod-github-runner-207 kernel: [32939.386779] (t=8205546 jiffies g=23269 q=35578) Aug 22 14:32:45 juju-e4d256-prod-github-runner-207 kernel: [32939.387584] NMI backtrace for cpu 1 Aug 22 14:32:45 juju-e4d256-prod-github-runner-207 kernel: [32939.388300] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 14:32:45 juju-e4d256-prod-github-runner-207 kernel: [32939.389400] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 14:32:45 juju-e4d256-prod-github-runner-207 kernel: [32939.390455] Call Trace: Aug 22 14:32:45 juju-e4d256-prod-github-runner-207 kernel: [32939.391144] Aug 22 14:32:45 juju-e4d256-prod-github-runner-207 kernel: [32939.391803] show_stack+0x52/0x5c Aug 22 14:32:45 juju-e4d256-prod-github-runner-207 kernel: [32939.392529] dump_stack_lvl+0x4a/0x63 Aug 22 14:32:45 juju-e4d256-prod-github-runner-207 kernel: [32939.393272] dump_stack+0x10/0x16 Aug 22 14:32:45 juju-e4d256-prod-github-runner-207 kernel: [32939.394094] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 14:32:45 juju-e4d256-prod-github-runner-207 kernel: [32939.394871] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 14:32:45 juju-e4d256-prod-github-runner-207 kernel: [32939.395766] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 14:32:45 juju-e4d256-prod-github-runner-207 kernel: [32939.396584] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 14:32:45 juju-e4d256-prod-github-runner-207 kernel: [32939.397402] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 14:32:45 juju-e4d256-prod-github-runner-207 kernel: [32939.398303] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 14:32:45 juju-e4d256-prod-github-runner-207 kernel: [32939.399093] print_cpu_stall.cold+0x2f/0xe2 Aug 22 14:32:45 juju-e4d256-prod-github-runner-207 kernel: [32939.399875] ? timekeeping_update+0xf7/0x150 Aug 22 14:32:45 juju-e4d256-prod-github-runner-207 kernel: [32939.400815] check_cpu_stall+0x109/0x270 Aug 22 14:32:45 juju-e4d256-prod-github-runner-207 kernel: [32939.401671] rcu_sched_clock_irq+0x9a/0x250 Aug 22 14:32:45 juju-e4d256-prod-github-runner-207 kernel: [32939.402437] update_process_times+0x94/0xd0 Aug 22 14:32:45 juju-e4d256-prod-github-runner-207 kernel: [32939.403224] tick_sched_handle+0x29/0x70 Aug 22 14:32:45 juju-e4d256-prod-github-runner-207 kernel: [32939.404128] tick_sched_timer+0x8c/0xc0 Aug 22 14:32:45 juju-e4d256-prod-github-runner-207 kernel: [32939.404868] ? tick_nohz_handler+0xb0/0xb0 Aug 22 14:32:45 juju-e4d256-prod-github-runner-207 kernel: [32939.405624] __hrtimer_run_queues+0x107/0x230 Aug 22 14:32:45 juju-e4d256-prod-github-runner-207 kernel: [32939.406403] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 14:32:45 juju-e4d256-prod-github-runner-207 kernel: [32939.407195] hrtimer_interrupt+0x101/0x220 Aug 22 14:32:45 juju-e4d256-prod-github-runner-207 kernel: [32939.407985] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 14:32:45 juju-e4d256-prod-github-runner-207 kernel: [32939.408801] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 14:32:45 juju-e4d256-prod-github-runner-207 kernel: [32939.409608] Aug 22 14:32:45 juju-e4d256-prod-github-runner-207 kernel: [32939.410244] Aug 22 14:32:45 juju-e4d256-prod-github-runner-207 kernel: [32939.410896] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 14:32:45 juju-e4d256-prod-github-runner-207 kernel: [32939.411749] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:32:45 juju-e4d256-prod-github-runner-207 kernel: [32939.412633] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 14:32:45 juju-e4d256-prod-github-runner-207 kernel: [32939.414854] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 14:32:45 juju-e4d256-prod-github-runner-207 kernel: [32939.415748] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 14:32:45 juju-e4d256-prod-github-runner-207 kernel: [32939.416751] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 14:32:45 juju-e4d256-prod-github-runner-207 kernel: [32939.417734] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 14:32:45 juju-e4d256-prod-github-runner-207 kernel: [32939.418889] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 14:32:45 juju-e4d256-prod-github-runner-207 kernel: [32939.419868] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 14:32:45 juju-e4d256-prod-github-runner-207 kernel: [32939.420830] ? _raw_spin_lock+0x22/0x30 Aug 22 14:32:45 juju-e4d256-prod-github-runner-207 kernel: [32939.421591] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:32:45 juju-e4d256-prod-github-runner-207 kernel: [32939.422429] direct_page_fault+0x206/0x310 [kvm] Aug 22 14:32:45 juju-e4d256-prod-github-runner-207 kernel: [32939.423333] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 14:32:45 juju-e4d256-prod-github-runner-207 kernel: [32939.424198] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 14:32:45 juju-e4d256-prod-github-runner-207 kernel: [32939.425019] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 14:32:45 juju-e4d256-prod-github-runner-207 kernel: [32939.425824] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 14:32:45 juju-e4d256-prod-github-runner-207 kernel: [32939.426605] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 14:32:45 juju-e4d256-prod-github-runner-207 kernel: [32939.427450] handle_exit+0x98/0x230 [kvm_amd] Aug 22 14:32:45 juju-e4d256-prod-github-runner-207 kernel: [32939.428202] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 14:32:45 juju-e4d256-prod-github-runner-207 kernel: [32939.428983] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 14:32:45 juju-e4d256-prod-github-runner-207 kernel: [32939.429780] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 14:32:45 juju-e4d256-prod-github-runner-207 kernel: [32939.430564] vcpu_run+0x62/0x2c0 [kvm] Aug 22 14:32:45 juju-e4d256-prod-github-runner-207 kernel: [32939.431284] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 14:32:45 juju-e4d256-prod-github-runner-207 kernel: [32939.432016] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 14:32:45 juju-e4d256-prod-github-runner-207 kernel: [32939.432814] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 14:32:45 juju-e4d256-prod-github-runner-207 kernel: [32939.433572] ? __seccomp_filter+0x4a/0x4a0 Aug 22 14:32:45 juju-e4d256-prod-github-runner-207 kernel: [32939.434291] ? __fget_files+0x86/0xc0 Aug 22 14:32:45 juju-e4d256-prod-github-runner-207 kernel: [32939.434988] __x64_sys_ioctl+0x95/0xd0 Aug 22 14:32:45 juju-e4d256-prod-github-runner-207 kernel: [32939.435682] do_syscall_64+0x5c/0xc0 Aug 22 14:32:45 juju-e4d256-prod-github-runner-207 kernel: [32939.436361] ? do_futex+0x162/0x1f0 Aug 22 14:32:45 juju-e4d256-prod-github-runner-207 kernel: [32939.437037] ? __x64_sys_futex+0x78/0x1e0 Aug 22 14:32:45 juju-e4d256-prod-github-runner-207 kernel: [32939.437741] ? __secure_computing+0xa9/0x120 Aug 22 14:32:45 juju-e4d256-prod-github-runner-207 kernel: [32939.438457] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 14:32:45 juju-e4d256-prod-github-runner-207 kernel: [32939.439261] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:32:45 juju-e4d256-prod-github-runner-207 kernel: [32939.440015] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:32:45 juju-e4d256-prod-github-runner-207 kernel: [32939.440773] ? do_syscall_64+0x69/0xc0 Aug 22 14:32:45 juju-e4d256-prod-github-runner-207 kernel: [32939.441462] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:32:45 juju-e4d256-prod-github-runner-207 kernel: [32939.442215] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:32:45 juju-e4d256-prod-github-runner-207 kernel: [32939.443099] ? do_syscall_64+0x69/0xc0 Aug 22 14:32:45 juju-e4d256-prod-github-runner-207 kernel: [32939.443808] ? do_syscall_64+0x69/0xc0 Aug 22 14:32:45 juju-e4d256-prod-github-runner-207 kernel: [32939.444498] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 14:32:45 juju-e4d256-prod-github-runner-207 kernel: [32939.445273] RIP: 0033:0x7faa5d0edaff Aug 22 14:32:45 juju-e4d256-prod-github-runner-207 kernel: [32939.445956] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 14:32:45 juju-e4d256-prod-github-runner-207 kernel: [32939.448076] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 14:32:45 juju-e4d256-prod-github-runner-207 kernel: [32939.449044] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 14:32:45 juju-e4d256-prod-github-runner-207 kernel: [32939.449989] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 14:32:45 juju-e4d256-prod-github-runner-207 kernel: [32939.451035] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 14:32:45 juju-e4d256-prod-github-runner-207 kernel: [32939.452010] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 14:32:45 juju-e4d256-prod-github-runner-207 kernel: [32939.452942] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 14:32:45 juju-e4d256-prod-github-runner-207 kernel: [32939.453898] Aug 22 14:33:10 juju-e4d256-prod-github-runner-207 kernel: [32964.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 30592s! [qemu-system-x86:6715] Aug 22 14:33:10 juju-e4d256-prod-github-runner-207 kernel: [32964.543891] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 14:33:10 juju-e4d256-prod-github-runner-207 kernel: [32964.544208] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 14:33:10 juju-e4d256-prod-github-runner-207 kernel: [32964.557240] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 14:33:10 juju-e4d256-prod-github-runner-207 kernel: [32964.558807] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 14:33:10 juju-e4d256-prod-github-runner-207 kernel: [32964.560216] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:33:10 juju-e4d256-prod-github-runner-207 kernel: [32964.561396] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 14:33:10 juju-e4d256-prod-github-runner-207 kernel: [32964.564358] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 14:33:10 juju-e4d256-prod-github-runner-207 kernel: [32964.565544] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 14:33:10 juju-e4d256-prod-github-runner-207 kernel: [32964.566894] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 14:33:10 juju-e4d256-prod-github-runner-207 kernel: [32964.568220] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 14:33:10 juju-e4d256-prod-github-runner-207 kernel: [32964.569561] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 14:33:10 juju-e4d256-prod-github-runner-207 kernel: [32964.570947] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 14:33:10 juju-e4d256-prod-github-runner-207 kernel: [32964.572290] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 14:33:10 juju-e4d256-prod-github-runner-207 kernel: [32964.573723] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 14:33:10 juju-e4d256-prod-github-runner-207 kernel: [32964.575077] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 14:33:10 juju-e4d256-prod-github-runner-207 kernel: [32964.576457] Call Trace: Aug 22 14:33:10 juju-e4d256-prod-github-runner-207 kernel: [32964.577452] Aug 22 14:33:10 juju-e4d256-prod-github-runner-207 kernel: [32964.578426] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:33:10 juju-e4d256-prod-github-runner-207 kernel: [32964.579584] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:33:10 juju-e4d256-prod-github-runner-207 kernel: [32964.580883] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:33:10 juju-e4d256-prod-github-runner-207 kernel: [32964.582097] ? show_regs.part.0+0x23/0x29 Aug 22 14:33:10 juju-e4d256-prod-github-runner-207 kernel: [32964.583230] ? show_regs.cold+0x8/0xd Aug 22 14:33:10 juju-e4d256-prod-github-runner-207 kernel: [32964.584484] ? watchdog_timer_fn+0x1be/0x220 Aug 22 14:33:10 juju-e4d256-prod-github-runner-207 kernel: [32964.585713] ? lockup_detector_update_enable+0x60/0x60 Aug 22 14:33:10 juju-e4d256-prod-github-runner-207 kernel: [32964.586929] ? __hrtimer_run_queues+0x107/0x230 Aug 22 14:33:10 juju-e4d256-prod-github-runner-207 kernel: [32964.588065] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 14:33:10 juju-e4d256-prod-github-runner-207 kernel: [32964.589197] ? hrtimer_interrupt+0x101/0x220 Aug 22 14:33:10 juju-e4d256-prod-github-runner-207 kernel: [32964.590235] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 14:33:10 juju-e4d256-prod-github-runner-207 kernel: [32964.591344] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 14:33:10 juju-e4d256-prod-github-runner-207 kernel: [32964.592463] Aug 22 14:33:10 juju-e4d256-prod-github-runner-207 kernel: [32964.593555] Aug 22 14:33:10 juju-e4d256-prod-github-runner-207 kernel: [32964.594411] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 14:33:10 juju-e4d256-prod-github-runner-207 kernel: [32964.595488] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:33:10 juju-e4d256-prod-github-runner-207 kernel: [32964.596531] ? _raw_spin_lock+0x22/0x30 Aug 22 14:33:10 juju-e4d256-prod-github-runner-207 kernel: [32964.597491] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:33:10 juju-e4d256-prod-github-runner-207 kernel: [32964.598592] direct_page_fault+0x206/0x310 [kvm] Aug 22 14:33:10 juju-e4d256-prod-github-runner-207 kernel: [32964.599665] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 14:33:10 juju-e4d256-prod-github-runner-207 kernel: [32964.600695] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 14:33:10 juju-e4d256-prod-github-runner-207 kernel: [32964.601709] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 14:33:10 juju-e4d256-prod-github-runner-207 kernel: [32964.602798] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 14:33:10 juju-e4d256-prod-github-runner-207 kernel: [32964.603767] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 14:33:10 juju-e4d256-prod-github-runner-207 kernel: [32964.604786] handle_exit+0x98/0x230 [kvm_amd] Aug 22 14:33:10 juju-e4d256-prod-github-runner-207 kernel: [32964.606723] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 14:33:10 juju-e4d256-prod-github-runner-207 kernel: [32964.608774] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 14:33:10 juju-e4d256-prod-github-runner-207 kernel: [32964.609740] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 14:33:10 juju-e4d256-prod-github-runner-207 kernel: [32964.610683] vcpu_run+0x62/0x2c0 [kvm] Aug 22 14:33:10 juju-e4d256-prod-github-runner-207 kernel: [32964.611506] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 14:33:10 juju-e4d256-prod-github-runner-207 kernel: [32964.612327] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 14:33:10 juju-e4d256-prod-github-runner-207 kernel: [32964.613205] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 14:33:10 juju-e4d256-prod-github-runner-207 kernel: [32964.614019] ? __seccomp_filter+0x4a/0x4a0 Aug 22 14:33:10 juju-e4d256-prod-github-runner-207 kernel: [32964.614986] ? __fget_files+0x86/0xc0 Aug 22 14:33:10 juju-e4d256-prod-github-runner-207 kernel: [32964.615719] __x64_sys_ioctl+0x95/0xd0 Aug 22 14:33:10 juju-e4d256-prod-github-runner-207 kernel: [32964.616413] do_syscall_64+0x5c/0xc0 Aug 22 14:33:10 juju-e4d256-prod-github-runner-207 kernel: [32964.617081] ? do_futex+0x162/0x1f0 Aug 22 14:33:10 juju-e4d256-prod-github-runner-207 kernel: [32964.617732] ? __x64_sys_futex+0x78/0x1e0 Aug 22 14:33:10 juju-e4d256-prod-github-runner-207 kernel: [32964.618407] ? __secure_computing+0xa9/0x120 Aug 22 14:33:10 juju-e4d256-prod-github-runner-207 kernel: [32964.619120] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 14:33:10 juju-e4d256-prod-github-runner-207 kernel: [32964.619882] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:33:10 juju-e4d256-prod-github-runner-207 kernel: [32964.620605] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:33:10 juju-e4d256-prod-github-runner-207 kernel: [32964.621325] ? do_syscall_64+0x69/0xc0 Aug 22 14:33:10 juju-e4d256-prod-github-runner-207 kernel: [32964.621971] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:33:10 juju-e4d256-prod-github-runner-207 kernel: [32964.622695] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:33:10 juju-e4d256-prod-github-runner-207 kernel: [32964.623395] ? do_syscall_64+0x69/0xc0 Aug 22 14:33:10 juju-e4d256-prod-github-runner-207 kernel: [32964.624084] ? do_syscall_64+0x69/0xc0 Aug 22 14:33:10 juju-e4d256-prod-github-runner-207 kernel: [32964.624722] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 14:33:10 juju-e4d256-prod-github-runner-207 kernel: [32964.626140] RIP: 0033:0x7faa5d0edaff Aug 22 14:33:10 juju-e4d256-prod-github-runner-207 kernel: [32964.626838] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 14:33:10 juju-e4d256-prod-github-runner-207 kernel: [32964.628844] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 14:33:10 juju-e4d256-prod-github-runner-207 kernel: [32964.630069] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 14:33:10 juju-e4d256-prod-github-runner-207 kernel: [32964.630989] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 14:33:10 juju-e4d256-prod-github-runner-207 kernel: [32964.631928] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 14:33:10 juju-e4d256-prod-github-runner-207 kernel: [32964.632828] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 14:33:10 juju-e4d256-prod-github-runner-207 kernel: [32964.633734] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 14:33:10 juju-e4d256-prod-github-runner-207 kernel: [32964.634682] Aug 22 14:33:38 juju-e4d256-prod-github-runner-207 kernel: [32992.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 30618s! [qemu-system-x86:6715] Aug 22 14:33:38 juju-e4d256-prod-github-runner-207 kernel: [32992.543935] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 14:33:38 juju-e4d256-prod-github-runner-207 kernel: [32992.544257] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 14:33:38 juju-e4d256-prod-github-runner-207 kernel: [32992.556467] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 14:33:38 juju-e4d256-prod-github-runner-207 kernel: [32992.557758] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 14:33:38 juju-e4d256-prod-github-runner-207 kernel: [32992.559001] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:33:38 juju-e4d256-prod-github-runner-207 kernel: [32992.560055] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 14:33:38 juju-e4d256-prod-github-runner-207 kernel: [32992.562638] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 14:33:38 juju-e4d256-prod-github-runner-207 kernel: [32992.563689] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 14:33:38 juju-e4d256-prod-github-runner-207 kernel: [32992.564873] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 14:33:38 juju-e4d256-prod-github-runner-207 kernel: [32992.566038] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 14:33:38 juju-e4d256-prod-github-runner-207 kernel: [32992.567236] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 14:33:38 juju-e4d256-prod-github-runner-207 kernel: [32992.568398] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 14:33:38 juju-e4d256-prod-github-runner-207 kernel: [32992.569583] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 14:33:38 juju-e4d256-prod-github-runner-207 kernel: [32992.570843] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 14:33:38 juju-e4d256-prod-github-runner-207 kernel: [32992.571941] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 14:33:38 juju-e4d256-prod-github-runner-207 kernel: [32992.573133] Call Trace: Aug 22 14:33:38 juju-e4d256-prod-github-runner-207 kernel: [32992.574059] Aug 22 14:33:38 juju-e4d256-prod-github-runner-207 kernel: [32992.574973] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:33:38 juju-e4d256-prod-github-runner-207 kernel: [32992.576007] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:33:38 juju-e4d256-prod-github-runner-207 kernel: [32992.577024] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:33:38 juju-e4d256-prod-github-runner-207 kernel: [32992.578114] ? show_regs.part.0+0x23/0x29 Aug 22 14:33:38 juju-e4d256-prod-github-runner-207 kernel: [32992.579123] ? show_regs.cold+0x8/0xd Aug 22 14:33:38 juju-e4d256-prod-github-runner-207 kernel: [32992.580091] ? watchdog_timer_fn+0x1be/0x220 Aug 22 14:33:38 juju-e4d256-prod-github-runner-207 kernel: [32992.581102] ? lockup_detector_update_enable+0x60/0x60 Aug 22 14:33:38 juju-e4d256-prod-github-runner-207 kernel: [32992.582174] ? __hrtimer_run_queues+0x107/0x230 Aug 22 14:33:38 juju-e4d256-prod-github-runner-207 kernel: [32992.583198] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 14:33:38 juju-e4d256-prod-github-runner-207 kernel: [32992.584224] ? hrtimer_interrupt+0x101/0x220 Aug 22 14:33:38 juju-e4d256-prod-github-runner-207 kernel: [32992.585240] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 14:33:38 juju-e4d256-prod-github-runner-207 kernel: [32992.586332] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 14:33:38 juju-e4d256-prod-github-runner-207 kernel: [32992.587393] Aug 22 14:33:38 juju-e4d256-prod-github-runner-207 kernel: [32992.588245] Aug 22 14:33:38 juju-e4d256-prod-github-runner-207 kernel: [32992.589102] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 14:33:38 juju-e4d256-prod-github-runner-207 kernel: [32992.590181] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:33:38 juju-e4d256-prod-github-runner-207 kernel: [32992.591220] ? _raw_spin_lock+0x22/0x30 Aug 22 14:33:38 juju-e4d256-prod-github-runner-207 kernel: [32992.592163] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:33:38 juju-e4d256-prod-github-runner-207 kernel: [32992.593193] direct_page_fault+0x206/0x310 [kvm] Aug 22 14:33:38 juju-e4d256-prod-github-runner-207 kernel: [32992.594261] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 14:33:38 juju-e4d256-prod-github-runner-207 kernel: [32992.595282] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 14:33:38 juju-e4d256-prod-github-runner-207 kernel: [32992.596311] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 14:33:38 juju-e4d256-prod-github-runner-207 kernel: [32992.597341] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 14:33:38 juju-e4d256-prod-github-runner-207 kernel: [32992.598328] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 14:33:38 juju-e4d256-prod-github-runner-207 kernel: [32992.599329] handle_exit+0x98/0x230 [kvm_amd] Aug 22 14:33:38 juju-e4d256-prod-github-runner-207 kernel: [32992.600227] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 14:33:38 juju-e4d256-prod-github-runner-207 kernel: [32992.601140] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 14:33:38 juju-e4d256-prod-github-runner-207 kernel: [32992.602065] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 14:33:38 juju-e4d256-prod-github-runner-207 kernel: [32992.603004] vcpu_run+0x62/0x2c0 [kvm] Aug 22 14:33:38 juju-e4d256-prod-github-runner-207 kernel: [32992.603819] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 14:33:38 juju-e4d256-prod-github-runner-207 kernel: [32992.604629] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 14:33:38 juju-e4d256-prod-github-runner-207 kernel: [32992.605484] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 14:33:38 juju-e4d256-prod-github-runner-207 kernel: [32992.606294] ? __seccomp_filter+0x4a/0x4a0 Aug 22 14:33:38 juju-e4d256-prod-github-runner-207 kernel: [32992.607082] ? __fget_files+0x86/0xc0 Aug 22 14:33:38 juju-e4d256-prod-github-runner-207 kernel: [32992.607786] __x64_sys_ioctl+0x95/0xd0 Aug 22 14:33:38 juju-e4d256-prod-github-runner-207 kernel: [32992.608480] do_syscall_64+0x5c/0xc0 Aug 22 14:33:38 juju-e4d256-prod-github-runner-207 kernel: [32992.609148] ? do_futex+0x162/0x1f0 Aug 22 14:33:38 juju-e4d256-prod-github-runner-207 kernel: [32992.609808] ? __x64_sys_futex+0x78/0x1e0 Aug 22 14:33:38 juju-e4d256-prod-github-runner-207 kernel: [32992.610534] ? __secure_computing+0xa9/0x120 Aug 22 14:33:38 juju-e4d256-prod-github-runner-207 kernel: [32992.611222] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 14:33:38 juju-e4d256-prod-github-runner-207 kernel: [32992.611978] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:33:38 juju-e4d256-prod-github-runner-207 kernel: [32992.612695] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:33:38 juju-e4d256-prod-github-runner-207 kernel: [32992.613407] ? do_syscall_64+0x69/0xc0 Aug 22 14:33:38 juju-e4d256-prod-github-runner-207 kernel: [32992.614049] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:33:38 juju-e4d256-prod-github-runner-207 kernel: [32992.614765] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:33:38 juju-e4d256-prod-github-runner-207 kernel: [32992.615457] ? do_syscall_64+0x69/0xc0 Aug 22 14:33:38 juju-e4d256-prod-github-runner-207 kernel: [32992.616078] ? do_syscall_64+0x69/0xc0 Aug 22 14:33:38 juju-e4d256-prod-github-runner-207 kernel: [32992.616695] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 14:33:38 juju-e4d256-prod-github-runner-207 kernel: [32992.617396] RIP: 0033:0x7faa5d0edaff Aug 22 14:33:38 juju-e4d256-prod-github-runner-207 kernel: [32992.618085] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 14:33:38 juju-e4d256-prod-github-runner-207 kernel: [32992.620106] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 14:33:38 juju-e4d256-prod-github-runner-207 kernel: [32992.621015] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 14:33:38 juju-e4d256-prod-github-runner-207 kernel: [32992.621909] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 14:33:38 juju-e4d256-prod-github-runner-207 kernel: [32992.622815] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 14:33:38 juju-e4d256-prod-github-runner-207 kernel: [32992.623717] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 14:33:38 juju-e4d256-prod-github-runner-207 kernel: [32992.624628] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 14:33:38 juju-e4d256-prod-github-runner-207 kernel: [32992.625517] Aug 22 14:34:06 juju-e4d256-prod-github-runner-207 kernel: [33020.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 30644s! [qemu-system-x86:6715] Aug 22 14:34:06 juju-e4d256-prod-github-runner-207 kernel: [33020.543931] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 14:34:06 juju-e4d256-prod-github-runner-207 kernel: [33020.544265] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 14:34:06 juju-e4d256-prod-github-runner-207 kernel: [33020.556706] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 14:34:06 juju-e4d256-prod-github-runner-207 kernel: [33020.557988] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 14:34:06 juju-e4d256-prod-github-runner-207 kernel: [33020.559207] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:34:06 juju-e4d256-prod-github-runner-207 kernel: [33020.560264] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 14:34:06 juju-e4d256-prod-github-runner-207 kernel: [33020.562818] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 14:34:06 juju-e4d256-prod-github-runner-207 kernel: [33020.563858] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 14:34:06 juju-e4d256-prod-github-runner-207 kernel: [33020.565017] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 14:34:06 juju-e4d256-prod-github-runner-207 kernel: [33020.566201] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 14:34:06 juju-e4d256-prod-github-runner-207 kernel: [33020.567487] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 14:34:06 juju-e4d256-prod-github-runner-207 kernel: [33020.569066] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 14:34:06 juju-e4d256-prod-github-runner-207 kernel: [33020.570255] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 14:34:06 juju-e4d256-prod-github-runner-207 kernel: [33020.571491] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 14:34:06 juju-e4d256-prod-github-runner-207 kernel: [33020.572648] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 14:34:06 juju-e4d256-prod-github-runner-207 kernel: [33020.573873] Call Trace: Aug 22 14:34:06 juju-e4d256-prod-github-runner-207 kernel: [33020.574791] Aug 22 14:34:06 juju-e4d256-prod-github-runner-207 kernel: [33020.575702] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:34:06 juju-e4d256-prod-github-runner-207 kernel: [33020.576736] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:34:06 juju-e4d256-prod-github-runner-207 kernel: [33020.577788] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:34:06 juju-e4d256-prod-github-runner-207 kernel: [33020.578911] ? show_regs.part.0+0x23/0x29 Aug 22 14:34:06 juju-e4d256-prod-github-runner-207 kernel: [33020.579915] ? show_regs.cold+0x8/0xd Aug 22 14:34:06 juju-e4d256-prod-github-runner-207 kernel: [33020.580889] ? watchdog_timer_fn+0x1be/0x220 Aug 22 14:34:06 juju-e4d256-prod-github-runner-207 kernel: [33020.581925] ? lockup_detector_update_enable+0x60/0x60 Aug 22 14:34:06 juju-e4d256-prod-github-runner-207 kernel: [33020.583025] ? __hrtimer_run_queues+0x107/0x230 Aug 22 14:34:06 juju-e4d256-prod-github-runner-207 kernel: [33020.584056] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 14:34:06 juju-e4d256-prod-github-runner-207 kernel: [33020.585077] ? hrtimer_interrupt+0x101/0x220 Aug 22 14:34:06 juju-e4d256-prod-github-runner-207 kernel: [33020.586107] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 14:34:06 juju-e4d256-prod-github-runner-207 kernel: [33020.587174] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 14:34:06 juju-e4d256-prod-github-runner-207 kernel: [33020.588235] Aug 22 14:34:06 juju-e4d256-prod-github-runner-207 kernel: [33020.589093] Aug 22 14:34:06 juju-e4d256-prod-github-runner-207 kernel: [33020.589941] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 14:34:06 juju-e4d256-prod-github-runner-207 kernel: [33020.590972] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:34:06 juju-e4d256-prod-github-runner-207 kernel: [33020.592008] ? _raw_spin_lock+0x22/0x30 Aug 22 14:34:06 juju-e4d256-prod-github-runner-207 kernel: [33020.592964] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:34:06 juju-e4d256-prod-github-runner-207 kernel: [33020.593994] direct_page_fault+0x206/0x310 [kvm] Aug 22 14:34:06 juju-e4d256-prod-github-runner-207 kernel: [33020.595018] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 14:34:06 juju-e4d256-prod-github-runner-207 kernel: [33020.596024] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 14:34:06 juju-e4d256-prod-github-runner-207 kernel: [33020.597027] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 14:34:06 juju-e4d256-prod-github-runner-207 kernel: [33020.598053] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 14:34:06 juju-e4d256-prod-github-runner-207 kernel: [33020.599003] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 14:34:06 juju-e4d256-prod-github-runner-207 kernel: [33020.599981] handle_exit+0x98/0x230 [kvm_amd] Aug 22 14:34:06 juju-e4d256-prod-github-runner-207 kernel: [33020.600908] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 14:34:06 juju-e4d256-prod-github-runner-207 kernel: [33020.601891] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 14:34:06 juju-e4d256-prod-github-runner-207 kernel: [33020.602822] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 14:34:06 juju-e4d256-prod-github-runner-207 kernel: [33020.603728] vcpu_run+0x62/0x2c0 [kvm] Aug 22 14:34:06 juju-e4d256-prod-github-runner-207 kernel: [33020.604548] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 14:34:06 juju-e4d256-prod-github-runner-207 kernel: [33020.605369] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 14:34:06 juju-e4d256-prod-github-runner-207 kernel: [33020.606245] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 14:34:06 juju-e4d256-prod-github-runner-207 kernel: [33020.607070] ? __seccomp_filter+0x4a/0x4a0 Aug 22 14:34:06 juju-e4d256-prod-github-runner-207 kernel: [33020.607850] ? __fget_files+0x86/0xc0 Aug 22 14:34:06 juju-e4d256-prod-github-runner-207 kernel: [33020.608569] __x64_sys_ioctl+0x95/0xd0 Aug 22 14:34:06 juju-e4d256-prod-github-runner-207 kernel: [33020.609458] do_syscall_64+0x5c/0xc0 Aug 22 14:34:06 juju-e4d256-prod-github-runner-207 kernel: [33020.610457] ? do_futex+0x162/0x1f0 Aug 22 14:34:06 juju-e4d256-prod-github-runner-207 kernel: [33020.611179] ? __x64_sys_futex+0x78/0x1e0 Aug 22 14:34:06 juju-e4d256-prod-github-runner-207 kernel: [33020.611932] ? __secure_computing+0xa9/0x120 Aug 22 14:34:06 juju-e4d256-prod-github-runner-207 kernel: [33020.612703] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 14:34:06 juju-e4d256-prod-github-runner-207 kernel: [33020.613564] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:34:06 juju-e4d256-prod-github-runner-207 kernel: [33020.614387] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:34:06 juju-e4d256-prod-github-runner-207 kernel: [33020.615204] ? do_syscall_64+0x69/0xc0 Aug 22 14:34:06 juju-e4d256-prod-github-runner-207 kernel: [33020.615921] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:34:06 juju-e4d256-prod-github-runner-207 kernel: [33020.616714] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:34:06 juju-e4d256-prod-github-runner-207 kernel: [33020.617499] ? do_syscall_64+0x69/0xc0 Aug 22 14:34:06 juju-e4d256-prod-github-runner-207 kernel: [33020.618205] ? do_syscall_64+0x69/0xc0 Aug 22 14:34:06 juju-e4d256-prod-github-runner-207 kernel: [33020.618900] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 14:34:06 juju-e4d256-prod-github-runner-207 kernel: [33020.619700] RIP: 0033:0x7faa5d0edaff Aug 22 14:34:06 juju-e4d256-prod-github-runner-207 kernel: [33020.620431] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 14:34:06 juju-e4d256-prod-github-runner-207 kernel: [33020.622767] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 14:34:06 juju-e4d256-prod-github-runner-207 kernel: [33020.623852] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 14:34:06 juju-e4d256-prod-github-runner-207 kernel: [33020.625005] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 14:34:06 juju-e4d256-prod-github-runner-207 kernel: [33020.626042] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 14:34:06 juju-e4d256-prod-github-runner-207 kernel: [33020.627059] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 14:34:06 juju-e4d256-prod-github-runner-207 kernel: [33020.628075] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 14:34:06 juju-e4d256-prod-github-runner-207 kernel: [33020.629107] Aug 22 14:34:34 juju-e4d256-prod-github-runner-207 kernel: [33048.542029] watchdog: BUG: soft lockup - CPU#1 stuck for 30670s! [qemu-system-x86:6715] Aug 22 14:34:34 juju-e4d256-prod-github-runner-207 kernel: [33048.545698] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 14:34:34 juju-e4d256-prod-github-runner-207 kernel: [33048.547563] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 14:34:34 juju-e4d256-prod-github-runner-207 kernel: [33048.572930] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 14:34:34 juju-e4d256-prod-github-runner-207 kernel: [33048.575749] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 14:34:34 juju-e4d256-prod-github-runner-207 kernel: [33048.577584] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:34:34 juju-e4d256-prod-github-runner-207 kernel: [33048.580724] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 14:34:34 juju-e4d256-prod-github-runner-207 kernel: [33048.585353] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 14:34:34 juju-e4d256-prod-github-runner-207 kernel: [33048.588975] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 14:34:34 juju-e4d256-prod-github-runner-207 kernel: [33048.592229] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 14:34:34 juju-e4d256-prod-github-runner-207 kernel: [33048.595098] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 14:34:34 juju-e4d256-prod-github-runner-207 kernel: [33048.596820] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 14:34:34 juju-e4d256-prod-github-runner-207 kernel: [33048.600151] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 14:34:34 juju-e4d256-prod-github-runner-207 kernel: [33048.603600] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 14:34:34 juju-e4d256-prod-github-runner-207 kernel: [33048.604912] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 14:34:34 juju-e4d256-prod-github-runner-207 kernel: [33048.608239] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 14:34:34 juju-e4d256-prod-github-runner-207 kernel: [33048.611719] Call Trace: Aug 22 14:34:34 juju-e4d256-prod-github-runner-207 kernel: [33048.612678] Aug 22 14:34:34 juju-e4d256-prod-github-runner-207 kernel: [33048.615973] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:34:34 juju-e4d256-prod-github-runner-207 kernel: [33048.617124] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:34:34 juju-e4d256-prod-github-runner-207 kernel: [33048.620385] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:34:34 juju-e4d256-prod-github-runner-207 kernel: [33048.621542] ? show_regs.part.0+0x23/0x29 Aug 22 14:34:34 juju-e4d256-prod-github-runner-207 kernel: [33048.624791] ? show_regs.cold+0x8/0xd Aug 22 14:34:34 juju-e4d256-prod-github-runner-207 kernel: [33048.625926] ? watchdog_timer_fn+0x1be/0x220 Aug 22 14:34:34 juju-e4d256-prod-github-runner-207 kernel: [33048.629275] ? lockup_detector_update_enable+0x60/0x60 Aug 22 14:34:34 juju-e4d256-prod-github-runner-207 kernel: [33048.632664] ? __hrtimer_run_queues+0x107/0x230 Aug 22 14:34:34 juju-e4d256-prod-github-runner-207 kernel: [33048.633836] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 14:34:34 juju-e4d256-prod-github-runner-207 kernel: [33048.637166] ? hrtimer_interrupt+0x101/0x220 Aug 22 14:34:34 juju-e4d256-prod-github-runner-207 kernel: [33048.640651] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 14:34:34 juju-e4d256-prod-github-runner-207 kernel: [33048.641822] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 14:34:34 juju-e4d256-prod-github-runner-207 kernel: [33048.644568] Aug 22 14:34:34 juju-e4d256-prod-github-runner-207 kernel: [33048.645989] Aug 22 14:34:34 juju-e4d256-prod-github-runner-207 kernel: [33048.648201] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 14:34:34 juju-e4d256-prod-github-runner-207 kernel: [33048.650264] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:34:34 juju-e4d256-prod-github-runner-207 kernel: [33048.651309] ? _raw_spin_lock+0x22/0x30 Aug 22 14:34:34 juju-e4d256-prod-github-runner-207 kernel: [33048.652261] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:34:34 juju-e4d256-prod-github-runner-207 kernel: [33048.653290] direct_page_fault+0x206/0x310 [kvm] Aug 22 14:34:34 juju-e4d256-prod-github-runner-207 kernel: [33048.654364] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 14:34:34 juju-e4d256-prod-github-runner-207 kernel: [33048.655397] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 14:34:34 juju-e4d256-prod-github-runner-207 kernel: [33048.656430] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 14:34:34 juju-e4d256-prod-github-runner-207 kernel: [33048.657487] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 14:34:34 juju-e4d256-prod-github-runner-207 kernel: [33048.658436] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 14:34:34 juju-e4d256-prod-github-runner-207 kernel: [33048.659436] handle_exit+0x98/0x230 [kvm_amd] Aug 22 14:34:34 juju-e4d256-prod-github-runner-207 kernel: [33048.660331] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 14:34:34 juju-e4d256-prod-github-runner-207 kernel: [33048.661252] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 14:34:34 juju-e4d256-prod-github-runner-207 kernel: [33048.662209] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 14:34:34 juju-e4d256-prod-github-runner-207 kernel: [33048.663125] vcpu_run+0x62/0x2c0 [kvm] Aug 22 14:34:34 juju-e4d256-prod-github-runner-207 kernel: [33048.663938] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 14:34:34 juju-e4d256-prod-github-runner-207 kernel: [33048.664765] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 14:34:34 juju-e4d256-prod-github-runner-207 kernel: [33048.665776] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 14:34:34 juju-e4d256-prod-github-runner-207 kernel: [33048.666609] ? __seccomp_filter+0x4a/0x4a0 Aug 22 14:34:34 juju-e4d256-prod-github-runner-207 kernel: [33048.667531] ? __fget_files+0x86/0xc0 Aug 22 14:34:34 juju-e4d256-prod-github-runner-207 kernel: [33048.668260] __x64_sys_ioctl+0x95/0xd0 Aug 22 14:34:34 juju-e4d256-prod-github-runner-207 kernel: [33048.668958] do_syscall_64+0x5c/0xc0 Aug 22 14:34:34 juju-e4d256-prod-github-runner-207 kernel: [33048.669658] ? do_futex+0x162/0x1f0 Aug 22 14:34:34 juju-e4d256-prod-github-runner-207 kernel: [33048.670312] ? __x64_sys_futex+0x78/0x1e0 Aug 22 14:34:34 juju-e4d256-prod-github-runner-207 kernel: [33048.670993] ? __secure_computing+0xa9/0x120 Aug 22 14:34:34 juju-e4d256-prod-github-runner-207 kernel: [33048.671685] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 14:34:34 juju-e4d256-prod-github-runner-207 kernel: [33048.672456] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:34:34 juju-e4d256-prod-github-runner-207 kernel: [33048.673180] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:34:34 juju-e4d256-prod-github-runner-207 kernel: [33048.673929] ? do_syscall_64+0x69/0xc0 Aug 22 14:34:34 juju-e4d256-prod-github-runner-207 kernel: [33048.674597] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:34:34 juju-e4d256-prod-github-runner-207 kernel: [33048.675389] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:34:34 juju-e4d256-prod-github-runner-207 kernel: [33048.676346] ? do_syscall_64+0x69/0xc0 Aug 22 14:34:34 juju-e4d256-prod-github-runner-207 kernel: [33048.677019] ? do_syscall_64+0x69/0xc0 Aug 22 14:34:34 juju-e4d256-prod-github-runner-207 kernel: [33048.677669] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 14:34:34 juju-e4d256-prod-github-runner-207 kernel: [33048.678379] RIP: 0033:0x7faa5d0edaff Aug 22 14:34:34 juju-e4d256-prod-github-runner-207 kernel: [33048.679066] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 14:34:34 juju-e4d256-prod-github-runner-207 kernel: [33048.681074] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 14:34:34 juju-e4d256-prod-github-runner-207 kernel: [33048.682019] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 14:34:34 juju-e4d256-prod-github-runner-207 kernel: [33048.682924] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 14:34:34 juju-e4d256-prod-github-runner-207 kernel: [33048.683812] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 14:34:34 juju-e4d256-prod-github-runner-207 kernel: [33048.684700] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 14:34:34 juju-e4d256-prod-github-runner-207 kernel: [33048.685630] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 14:34:34 juju-e4d256-prod-github-runner-207 kernel: [33048.686583] Aug 22 14:35:02 juju-e4d256-prod-github-runner-207 kernel: [33076.541980] watchdog: BUG: soft lockup - CPU#1 stuck for 30696s! [qemu-system-x86:6715] Aug 22 14:35:02 juju-e4d256-prod-github-runner-207 kernel: [33076.544039] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 14:35:02 juju-e4d256-prod-github-runner-207 kernel: [33076.544349] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 14:35:02 juju-e4d256-prod-github-runner-207 kernel: [33076.557907] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 14:35:02 juju-e4d256-prod-github-runner-207 kernel: [33076.559342] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 14:35:02 juju-e4d256-prod-github-runner-207 kernel: [33076.560672] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:35:02 juju-e4d256-prod-github-runner-207 kernel: [33076.561814] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 14:35:02 juju-e4d256-prod-github-runner-207 kernel: [33076.564538] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 14:35:02 juju-e4d256-prod-github-runner-207 kernel: [33076.565651] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 14:35:02 juju-e4d256-prod-github-runner-207 kernel: [33076.566879] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 14:35:02 juju-e4d256-prod-github-runner-207 kernel: [33076.568166] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 14:35:02 juju-e4d256-prod-github-runner-207 kernel: [33076.569446] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 14:35:02 juju-e4d256-prod-github-runner-207 kernel: [33076.570665] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 14:35:02 juju-e4d256-prod-github-runner-207 kernel: [33076.571902] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 14:35:02 juju-e4d256-prod-github-runner-207 kernel: [33076.573232] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 14:35:02 juju-e4d256-prod-github-runner-207 kernel: [33076.574427] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 14:35:02 juju-e4d256-prod-github-runner-207 kernel: [33076.575765] Call Trace: Aug 22 14:35:02 juju-e4d256-prod-github-runner-207 kernel: [33076.576727] Aug 22 14:35:02 juju-e4d256-prod-github-runner-207 kernel: [33076.577710] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:35:02 juju-e4d256-prod-github-runner-207 kernel: [33076.578779] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:35:02 juju-e4d256-prod-github-runner-207 kernel: [33076.579895] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:35:02 juju-e4d256-prod-github-runner-207 kernel: [33076.581035] ? show_regs.part.0+0x23/0x29 Aug 22 14:35:02 juju-e4d256-prod-github-runner-207 kernel: [33076.582086] ? show_regs.cold+0x8/0xd Aug 22 14:35:02 juju-e4d256-prod-github-runner-207 kernel: [33076.583143] ? watchdog_timer_fn+0x1be/0x220 Aug 22 14:35:02 juju-e4d256-prod-github-runner-207 kernel: [33076.584185] ? lockup_detector_update_enable+0x60/0x60 Aug 22 14:35:02 juju-e4d256-prod-github-runner-207 kernel: [33076.585325] ? __hrtimer_run_queues+0x107/0x230 Aug 22 14:35:02 juju-e4d256-prod-github-runner-207 kernel: [33076.586397] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 14:35:02 juju-e4d256-prod-github-runner-207 kernel: [33076.587463] ? hrtimer_interrupt+0x101/0x220 Aug 22 14:35:02 juju-e4d256-prod-github-runner-207 kernel: [33076.588522] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 14:35:02 juju-e4d256-prod-github-runner-207 kernel: [33076.589657] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 14:35:02 juju-e4d256-prod-github-runner-207 kernel: [33076.590740] Aug 22 14:35:02 juju-e4d256-prod-github-runner-207 kernel: [33076.591616] Aug 22 14:35:02 juju-e4d256-prod-github-runner-207 kernel: [33076.592467] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 14:35:02 juju-e4d256-prod-github-runner-207 kernel: [33076.593585] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:35:02 juju-e4d256-prod-github-runner-207 kernel: [33076.594676] ? _raw_spin_lock+0x22/0x30 Aug 22 14:35:02 juju-e4d256-prod-github-runner-207 kernel: [33076.595662] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:35:02 juju-e4d256-prod-github-runner-207 kernel: [33076.596740] direct_page_fault+0x206/0x310 [kvm] Aug 22 14:35:02 juju-e4d256-prod-github-runner-207 kernel: [33076.597834] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 14:35:02 juju-e4d256-prod-github-runner-207 kernel: [33076.598914] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 14:35:02 juju-e4d256-prod-github-runner-207 kernel: [33076.599981] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 14:35:02 juju-e4d256-prod-github-runner-207 kernel: [33076.601040] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 14:35:02 juju-e4d256-prod-github-runner-207 kernel: [33076.602070] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 14:35:02 juju-e4d256-prod-github-runner-207 kernel: [33076.603120] handle_exit+0x98/0x230 [kvm_amd] Aug 22 14:35:02 juju-e4d256-prod-github-runner-207 kernel: [33076.604078] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 14:35:02 juju-e4d256-prod-github-runner-207 kernel: [33076.605053] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 14:35:02 juju-e4d256-prod-github-runner-207 kernel: [33076.606086] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 14:35:02 juju-e4d256-prod-github-runner-207 kernel: [33076.607053] vcpu_run+0x62/0x2c0 [kvm] Aug 22 14:35:02 juju-e4d256-prod-github-runner-207 kernel: [33076.607922] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 14:35:02 juju-e4d256-prod-github-runner-207 kernel: [33076.608775] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 14:35:02 juju-e4d256-prod-github-runner-207 kernel: [33076.609683] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 14:35:02 juju-e4d256-prod-github-runner-207 kernel: [33076.610541] ? __seccomp_filter+0x4a/0x4a0 Aug 22 14:35:02 juju-e4d256-prod-github-runner-207 kernel: [33076.611341] ? __fget_files+0x86/0xc0 Aug 22 14:35:02 juju-e4d256-prod-github-runner-207 kernel: [33076.612096] __x64_sys_ioctl+0x95/0xd0 Aug 22 14:35:02 juju-e4d256-prod-github-runner-207 kernel: [33076.612836] do_syscall_64+0x5c/0xc0 Aug 22 14:35:02 juju-e4d256-prod-github-runner-207 kernel: [33076.613556] ? do_futex+0x162/0x1f0 Aug 22 14:35:02 juju-e4d256-prod-github-runner-207 kernel: [33076.614234] ? __x64_sys_futex+0x78/0x1e0 Aug 22 14:35:02 juju-e4d256-prod-github-runner-207 kernel: [33076.614952] ? __secure_computing+0xa9/0x120 Aug 22 14:35:02 juju-e4d256-prod-github-runner-207 kernel: [33076.615682] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 14:35:02 juju-e4d256-prod-github-runner-207 kernel: [33076.616507] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:35:02 juju-e4d256-prod-github-runner-207 kernel: [33076.617291] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:35:02 juju-e4d256-prod-github-runner-207 kernel: [33076.618065] ? do_syscall_64+0x69/0xc0 Aug 22 14:35:02 juju-e4d256-prod-github-runner-207 kernel: [33076.618740] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:35:02 juju-e4d256-prod-github-runner-207 kernel: [33076.619546] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:35:02 juju-e4d256-prod-github-runner-207 kernel: [33076.620310] ? do_syscall_64+0x69/0xc0 Aug 22 14:35:02 juju-e4d256-prod-github-runner-207 kernel: [33076.621027] ? do_syscall_64+0x69/0xc0 Aug 22 14:35:02 juju-e4d256-prod-github-runner-207 kernel: [33076.621706] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 14:35:02 juju-e4d256-prod-github-runner-207 kernel: [33076.622485] RIP: 0033:0x7faa5d0edaff Aug 22 14:35:02 juju-e4d256-prod-github-runner-207 kernel: [33076.623222] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 14:35:02 juju-e4d256-prod-github-runner-207 kernel: [33076.625529] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 14:35:02 juju-e4d256-prod-github-runner-207 kernel: [33076.626548] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 14:35:02 juju-e4d256-prod-github-runner-207 kernel: [33076.627495] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 14:35:02 juju-e4d256-prod-github-runner-207 kernel: [33076.628440] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 14:35:02 juju-e4d256-prod-github-runner-207 kernel: [33076.629445] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 14:35:02 juju-e4d256-prod-github-runner-207 kernel: [33076.630441] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 14:35:02 juju-e4d256-prod-github-runner-207 kernel: [33076.631403] Aug 22 14:35:30 juju-e4d256-prod-github-runner-207 kernel: [33104.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 30723s! [qemu-system-x86:6715] Aug 22 14:35:30 juju-e4d256-prod-github-runner-207 kernel: [33104.543866] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 14:35:30 juju-e4d256-prod-github-runner-207 kernel: [33104.544155] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 14:35:30 juju-e4d256-prod-github-runner-207 kernel: [33104.556673] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 14:35:30 juju-e4d256-prod-github-runner-207 kernel: [33104.557987] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 14:35:30 juju-e4d256-prod-github-runner-207 kernel: [33104.559247] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:35:30 juju-e4d256-prod-github-runner-207 kernel: [33104.560359] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 14:35:30 juju-e4d256-prod-github-runner-207 kernel: [33104.562977] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 14:35:30 juju-e4d256-prod-github-runner-207 kernel: [33104.564038] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 14:35:30 juju-e4d256-prod-github-runner-207 kernel: [33104.565250] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 14:35:30 juju-e4d256-prod-github-runner-207 kernel: [33104.566452] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 14:35:30 juju-e4d256-prod-github-runner-207 kernel: [33104.567638] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 14:35:30 juju-e4d256-prod-github-runner-207 kernel: [33104.568846] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 14:35:30 juju-e4d256-prod-github-runner-207 kernel: [33104.570075] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 14:35:30 juju-e4d256-prod-github-runner-207 kernel: [33104.571352] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 14:35:30 juju-e4d256-prod-github-runner-207 kernel: [33104.572464] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 14:35:30 juju-e4d256-prod-github-runner-207 kernel: [33104.573697] Call Trace: Aug 22 14:35:30 juju-e4d256-prod-github-runner-207 kernel: [33104.574630] Aug 22 14:35:30 juju-e4d256-prod-github-runner-207 kernel: [33104.575545] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:35:30 juju-e4d256-prod-github-runner-207 kernel: [33104.576655] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:35:30 juju-e4d256-prod-github-runner-207 kernel: [33104.577703] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:35:30 juju-e4d256-prod-github-runner-207 kernel: [33104.578811] ? show_regs.part.0+0x23/0x29 Aug 22 14:35:30 juju-e4d256-prod-github-runner-207 kernel: [33104.579829] ? show_regs.cold+0x8/0xd Aug 22 14:35:30 juju-e4d256-prod-github-runner-207 kernel: [33104.580858] ? watchdog_timer_fn+0x1be/0x220 Aug 22 14:35:30 juju-e4d256-prod-github-runner-207 kernel: [33104.581884] ? lockup_detector_update_enable+0x60/0x60 Aug 22 14:35:30 juju-e4d256-prod-github-runner-207 kernel: [33104.582957] ? __hrtimer_run_queues+0x107/0x230 Aug 22 14:35:30 juju-e4d256-prod-github-runner-207 kernel: [33104.583996] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 14:35:30 juju-e4d256-prod-github-runner-207 kernel: [33104.585057] ? hrtimer_interrupt+0x101/0x220 Aug 22 14:35:30 juju-e4d256-prod-github-runner-207 kernel: [33104.586122] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 14:35:30 juju-e4d256-prod-github-runner-207 kernel: [33104.587222] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 14:35:30 juju-e4d256-prod-github-runner-207 kernel: [33104.588303] Aug 22 14:35:30 juju-e4d256-prod-github-runner-207 kernel: [33104.589221] Aug 22 14:35:30 juju-e4d256-prod-github-runner-207 kernel: [33104.590087] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 14:35:30 juju-e4d256-prod-github-runner-207 kernel: [33104.591175] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:35:30 juju-e4d256-prod-github-runner-207 kernel: [33104.592238] ? _raw_spin_lock+0x22/0x30 Aug 22 14:35:30 juju-e4d256-prod-github-runner-207 kernel: [33104.593211] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:35:30 juju-e4d256-prod-github-runner-207 kernel: [33104.594252] direct_page_fault+0x206/0x310 [kvm] Aug 22 14:35:30 juju-e4d256-prod-github-runner-207 kernel: [33104.595299] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 14:35:30 juju-e4d256-prod-github-runner-207 kernel: [33104.596337] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 14:35:30 juju-e4d256-prod-github-runner-207 kernel: [33104.597374] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 14:35:30 juju-e4d256-prod-github-runner-207 kernel: [33104.598394] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 14:35:30 juju-e4d256-prod-github-runner-207 kernel: [33104.599355] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 14:35:30 juju-e4d256-prod-github-runner-207 kernel: [33104.600368] handle_exit+0x98/0x230 [kvm_amd] Aug 22 14:35:30 juju-e4d256-prod-github-runner-207 kernel: [33104.601314] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 14:35:30 juju-e4d256-prod-github-runner-207 kernel: [33104.602252] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 14:35:30 juju-e4d256-prod-github-runner-207 kernel: [33104.603195] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 14:35:30 juju-e4d256-prod-github-runner-207 kernel: [33104.604122] vcpu_run+0x62/0x2c0 [kvm] Aug 22 14:35:30 juju-e4d256-prod-github-runner-207 kernel: [33104.605205] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 14:35:30 juju-e4d256-prod-github-runner-207 kernel: [33104.606055] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 14:35:30 juju-e4d256-prod-github-runner-207 kernel: [33104.606948] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 14:35:30 juju-e4d256-prod-github-runner-207 kernel: [33104.607760] ? __seccomp_filter+0x4a/0x4a0 Aug 22 14:35:30 juju-e4d256-prod-github-runner-207 kernel: [33104.608511] ? __fget_files+0x86/0xc0 Aug 22 14:35:30 juju-e4d256-prod-github-runner-207 kernel: [33104.609244] __x64_sys_ioctl+0x95/0xd0 Aug 22 14:35:30 juju-e4d256-prod-github-runner-207 kernel: [33104.609949] do_syscall_64+0x5c/0xc0 Aug 22 14:35:30 juju-e4d256-prod-github-runner-207 kernel: [33104.610631] ? do_futex+0x162/0x1f0 Aug 22 14:35:30 juju-e4d256-prod-github-runner-207 kernel: [33104.611299] ? __x64_sys_futex+0x78/0x1e0 Aug 22 14:35:30 juju-e4d256-prod-github-runner-207 kernel: [33104.612006] ? __secure_computing+0xa9/0x120 Aug 22 14:35:30 juju-e4d256-prod-github-runner-207 kernel: [33104.612706] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 14:35:30 juju-e4d256-prod-github-runner-207 kernel: [33104.613488] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:35:30 juju-e4d256-prod-github-runner-207 kernel: [33104.614222] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:35:30 juju-e4d256-prod-github-runner-207 kernel: [33104.614964] ? do_syscall_64+0x69/0xc0 Aug 22 14:35:30 juju-e4d256-prod-github-runner-207 kernel: [33104.615635] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:35:30 juju-e4d256-prod-github-runner-207 kernel: [33104.616374] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:35:30 juju-e4d256-prod-github-runner-207 kernel: [33104.617132] ? do_syscall_64+0x69/0xc0 Aug 22 14:35:30 juju-e4d256-prod-github-runner-207 kernel: [33104.617773] ? do_syscall_64+0x69/0xc0 Aug 22 14:35:30 juju-e4d256-prod-github-runner-207 kernel: [33104.618409] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 14:35:30 juju-e4d256-prod-github-runner-207 kernel: [33104.619129] RIP: 0033:0x7faa5d0edaff Aug 22 14:35:30 juju-e4d256-prod-github-runner-207 kernel: [33104.619808] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 14:35:30 juju-e4d256-prod-github-runner-207 kernel: [33104.621900] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 14:35:30 juju-e4d256-prod-github-runner-207 kernel: [33104.622841] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 14:35:30 juju-e4d256-prod-github-runner-207 kernel: [33104.623755] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 14:35:30 juju-e4d256-prod-github-runner-207 kernel: [33104.624672] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 14:35:30 juju-e4d256-prod-github-runner-207 kernel: [33104.625602] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 14:35:30 juju-e4d256-prod-github-runner-207 kernel: [33104.626519] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 14:35:30 juju-e4d256-prod-github-runner-207 kernel: [33104.627442] Aug 22 14:35:45 juju-e4d256-prod-github-runner-207 kernel: [33119.396706] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 14:35:45 juju-e4d256-prod-github-runner-207 kernel: [33119.398502] rcu: 1-....: (8224777 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=3973163 Aug 22 14:35:45 juju-e4d256-prod-github-runner-207 kernel: [33119.399648] (t=8250549 jiffies g=23269 q=35704) Aug 22 14:35:45 juju-e4d256-prod-github-runner-207 kernel: [33119.400444] NMI backtrace for cpu 1 Aug 22 14:35:45 juju-e4d256-prod-github-runner-207 kernel: [33119.401183] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 14:35:45 juju-e4d256-prod-github-runner-207 kernel: [33119.402309] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 14:35:45 juju-e4d256-prod-github-runner-207 kernel: [33119.403393] Call Trace: Aug 22 14:35:45 juju-e4d256-prod-github-runner-207 kernel: [33119.404077] Aug 22 14:35:45 juju-e4d256-prod-github-runner-207 kernel: [33119.404759] show_stack+0x52/0x5c Aug 22 14:35:45 juju-e4d256-prod-github-runner-207 kernel: [33119.405492] dump_stack_lvl+0x4a/0x63 Aug 22 14:35:45 juju-e4d256-prod-github-runner-207 kernel: [33119.406263] dump_stack+0x10/0x16 Aug 22 14:35:45 juju-e4d256-prod-github-runner-207 kernel: [33119.407100] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 14:35:45 juju-e4d256-prod-github-runner-207 kernel: [33119.407888] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 14:35:45 juju-e4d256-prod-github-runner-207 kernel: [33119.408689] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 14:35:45 juju-e4d256-prod-github-runner-207 kernel: [33119.409519] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 14:35:45 juju-e4d256-prod-github-runner-207 kernel: [33119.410348] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 14:35:45 juju-e4d256-prod-github-runner-207 kernel: [33119.411175] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 14:35:45 juju-e4d256-prod-github-runner-207 kernel: [33119.411960] print_cpu_stall.cold+0x2f/0xe2 Aug 22 14:35:45 juju-e4d256-prod-github-runner-207 kernel: [33119.412763] ? timekeeping_update+0xf7/0x150 Aug 22 14:35:45 juju-e4d256-prod-github-runner-207 kernel: [33119.413552] check_cpu_stall+0x109/0x270 Aug 22 14:35:45 juju-e4d256-prod-github-runner-207 kernel: [33119.414310] rcu_sched_clock_irq+0x9a/0x250 Aug 22 14:35:45 juju-e4d256-prod-github-runner-207 kernel: [33119.415090] update_process_times+0x94/0xd0 Aug 22 14:35:45 juju-e4d256-prod-github-runner-207 kernel: [33119.415864] tick_sched_handle+0x29/0x70 Aug 22 14:35:45 juju-e4d256-prod-github-runner-207 kernel: [33119.416658] tick_sched_timer+0x8c/0xc0 Aug 22 14:35:45 juju-e4d256-prod-github-runner-207 kernel: [33119.417407] ? tick_nohz_handler+0xb0/0xb0 Aug 22 14:35:45 juju-e4d256-prod-github-runner-207 kernel: [33119.418173] __hrtimer_run_queues+0x107/0x230 Aug 22 14:35:45 juju-e4d256-prod-github-runner-207 kernel: [33119.418980] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 14:35:45 juju-e4d256-prod-github-runner-207 kernel: [33119.419765] hrtimer_interrupt+0x101/0x220 Aug 22 14:35:45 juju-e4d256-prod-github-runner-207 kernel: [33119.420524] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 14:35:45 juju-e4d256-prod-github-runner-207 kernel: [33119.421373] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 14:35:45 juju-e4d256-prod-github-runner-207 kernel: [33119.422178] Aug 22 14:35:45 juju-e4d256-prod-github-runner-207 kernel: [33119.422819] Aug 22 14:35:45 juju-e4d256-prod-github-runner-207 kernel: [33119.423448] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 14:35:45 juju-e4d256-prod-github-runner-207 kernel: [33119.424265] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:35:45 juju-e4d256-prod-github-runner-207 kernel: [33119.425166] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 14:35:45 juju-e4d256-prod-github-runner-207 kernel: [33119.427371] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 14:35:45 juju-e4d256-prod-github-runner-207 kernel: [33119.428249] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 14:35:45 juju-e4d256-prod-github-runner-207 kernel: [33119.429281] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 14:35:45 juju-e4d256-prod-github-runner-207 kernel: [33119.430262] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 14:35:45 juju-e4d256-prod-github-runner-207 kernel: [33119.431225] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 14:35:45 juju-e4d256-prod-github-runner-207 kernel: [33119.432181] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 14:35:45 juju-e4d256-prod-github-runner-207 kernel: [33119.433159] ? _raw_spin_lock+0x22/0x30 Aug 22 14:35:45 juju-e4d256-prod-github-runner-207 kernel: [33119.433932] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:35:45 juju-e4d256-prod-github-runner-207 kernel: [33119.434789] direct_page_fault+0x206/0x310 [kvm] Aug 22 14:35:45 juju-e4d256-prod-github-runner-207 kernel: [33119.435634] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 14:35:45 juju-e4d256-prod-github-runner-207 kernel: [33119.436462] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 14:35:45 juju-e4d256-prod-github-runner-207 kernel: [33119.437350] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 14:35:45 juju-e4d256-prod-github-runner-207 kernel: [33119.438191] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 14:35:45 juju-e4d256-prod-github-runner-207 kernel: [33119.438982] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 14:35:45 juju-e4d256-prod-github-runner-207 kernel: [33119.439807] handle_exit+0x98/0x230 [kvm_amd] Aug 22 14:35:45 juju-e4d256-prod-github-runner-207 kernel: [33119.440565] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 14:35:45 juju-e4d256-prod-github-runner-207 kernel: [33119.441380] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 14:35:45 juju-e4d256-prod-github-runner-207 kernel: [33119.442188] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 14:35:45 juju-e4d256-prod-github-runner-207 kernel: [33119.442976] vcpu_run+0x62/0x2c0 [kvm] Aug 22 14:35:45 juju-e4d256-prod-github-runner-207 kernel: [33119.443695] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 14:35:45 juju-e4d256-prod-github-runner-207 kernel: [33119.444432] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 14:35:45 juju-e4d256-prod-github-runner-207 kernel: [33119.445256] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 14:35:45 juju-e4d256-prod-github-runner-207 kernel: [33119.446019] ? __seccomp_filter+0x4a/0x4a0 Aug 22 14:35:45 juju-e4d256-prod-github-runner-207 kernel: [33119.446739] ? __fget_files+0x86/0xc0 Aug 22 14:35:45 juju-e4d256-prod-github-runner-207 kernel: [33119.447432] __x64_sys_ioctl+0x95/0xd0 Aug 22 14:35:45 juju-e4d256-prod-github-runner-207 kernel: [33119.448329] do_syscall_64+0x5c/0xc0 Aug 22 14:35:45 juju-e4d256-prod-github-runner-207 kernel: [33119.449028] ? do_futex+0x162/0x1f0 Aug 22 14:35:45 juju-e4d256-prod-github-runner-207 kernel: [33119.449701] ? __x64_sys_futex+0x78/0x1e0 Aug 22 14:35:45 juju-e4d256-prod-github-runner-207 kernel: [33119.450401] ? __secure_computing+0xa9/0x120 Aug 22 14:35:45 juju-e4d256-prod-github-runner-207 kernel: [33119.451116] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 14:35:45 juju-e4d256-prod-github-runner-207 kernel: [33119.451924] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:35:45 juju-e4d256-prod-github-runner-207 kernel: [33119.452699] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:35:45 juju-e4d256-prod-github-runner-207 kernel: [33119.453464] ? do_syscall_64+0x69/0xc0 Aug 22 14:35:45 juju-e4d256-prod-github-runner-207 kernel: [33119.454161] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:35:45 juju-e4d256-prod-github-runner-207 kernel: [33119.454952] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:35:45 juju-e4d256-prod-github-runner-207 kernel: [33119.455727] ? do_syscall_64+0x69/0xc0 Aug 22 14:35:45 juju-e4d256-prod-github-runner-207 kernel: [33119.456422] ? do_syscall_64+0x69/0xc0 Aug 22 14:35:45 juju-e4d256-prod-github-runner-207 kernel: [33119.457154] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 14:35:45 juju-e4d256-prod-github-runner-207 kernel: [33119.457928] RIP: 0033:0x7faa5d0edaff Aug 22 14:35:45 juju-e4d256-prod-github-runner-207 kernel: [33119.458635] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 14:35:45 juju-e4d256-prod-github-runner-207 kernel: [33119.460739] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 14:35:45 juju-e4d256-prod-github-runner-207 kernel: [33119.461701] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 14:35:45 juju-e4d256-prod-github-runner-207 kernel: [33119.462645] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 14:35:45 juju-e4d256-prod-github-runner-207 kernel: [33119.463591] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 14:35:45 juju-e4d256-prod-github-runner-207 kernel: [33119.464536] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 14:35:45 juju-e4d256-prod-github-runner-207 kernel: [33119.465477] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 14:35:45 juju-e4d256-prod-github-runner-207 kernel: [33119.466422] Aug 22 14:36:10 juju-e4d256-prod-github-runner-207 kernel: [33144.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 30760s! [qemu-system-x86:6715] Aug 22 14:36:10 juju-e4d256-prod-github-runner-207 kernel: [33144.543312] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 14:36:10 juju-e4d256-prod-github-runner-207 kernel: [33144.543685] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 14:36:10 juju-e4d256-prod-github-runner-207 kernel: [33144.557708] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 14:36:10 juju-e4d256-prod-github-runner-207 kernel: [33144.559151] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 14:36:10 juju-e4d256-prod-github-runner-207 kernel: [33144.560559] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:36:10 juju-e4d256-prod-github-runner-207 kernel: [33144.561632] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 14:36:10 juju-e4d256-prod-github-runner-207 kernel: [33144.564285] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 14:36:10 juju-e4d256-prod-github-runner-207 kernel: [33144.565366] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 14:36:10 juju-e4d256-prod-github-runner-207 kernel: [33144.566552] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 14:36:10 juju-e4d256-prod-github-runner-207 kernel: [33144.567733] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 14:36:10 juju-e4d256-prod-github-runner-207 kernel: [33144.568920] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 14:36:10 juju-e4d256-prod-github-runner-207 kernel: [33144.570087] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 14:36:10 juju-e4d256-prod-github-runner-207 kernel: [33144.571319] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 14:36:10 juju-e4d256-prod-github-runner-207 kernel: [33144.572573] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 14:36:10 juju-e4d256-prod-github-runner-207 kernel: [33144.573670] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 14:36:10 juju-e4d256-prod-github-runner-207 kernel: [33144.574865] Call Trace: Aug 22 14:36:10 juju-e4d256-prod-github-runner-207 kernel: [33144.575781] Aug 22 14:36:10 juju-e4d256-prod-github-runner-207 kernel: [33144.576680] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:36:10 juju-e4d256-prod-github-runner-207 kernel: [33144.577716] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:36:10 juju-e4d256-prod-github-runner-207 kernel: [33144.578737] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:36:10 juju-e4d256-prod-github-runner-207 kernel: [33144.579817] ? show_regs.part.0+0x23/0x29 Aug 22 14:36:10 juju-e4d256-prod-github-runner-207 kernel: [33144.580825] ? show_regs.cold+0x8/0xd Aug 22 14:36:10 juju-e4d256-prod-github-runner-207 kernel: [33144.581812] ? watchdog_timer_fn+0x1be/0x220 Aug 22 14:36:10 juju-e4d256-prod-github-runner-207 kernel: [33144.582834] ? lockup_detector_update_enable+0x60/0x60 Aug 22 14:36:10 juju-e4d256-prod-github-runner-207 kernel: [33144.583896] ? __hrtimer_run_queues+0x107/0x230 Aug 22 14:36:10 juju-e4d256-prod-github-runner-207 kernel: [33144.584938] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 14:36:10 juju-e4d256-prod-github-runner-207 kernel: [33144.585961] ? hrtimer_interrupt+0x101/0x220 Aug 22 14:36:10 juju-e4d256-prod-github-runner-207 kernel: [33144.586975] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 14:36:10 juju-e4d256-prod-github-runner-207 kernel: [33144.588042] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 14:36:10 juju-e4d256-prod-github-runner-207 kernel: [33144.589106] Aug 22 14:36:10 juju-e4d256-prod-github-runner-207 kernel: [33144.589958] Aug 22 14:36:10 juju-e4d256-prod-github-runner-207 kernel: [33144.590795] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 14:36:10 juju-e4d256-prod-github-runner-207 kernel: [33144.591834] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:36:10 juju-e4d256-prod-github-runner-207 kernel: [33144.592883] ? _raw_spin_lock+0x22/0x30 Aug 22 14:36:10 juju-e4d256-prod-github-runner-207 kernel: [33144.593827] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:36:10 juju-e4d256-prod-github-runner-207 kernel: [33144.594846] direct_page_fault+0x206/0x310 [kvm] Aug 22 14:36:10 juju-e4d256-prod-github-runner-207 kernel: [33144.595870] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 14:36:10 juju-e4d256-prod-github-runner-207 kernel: [33144.596886] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 14:36:10 juju-e4d256-prod-github-runner-207 kernel: [33144.597892] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 14:36:10 juju-e4d256-prod-github-runner-207 kernel: [33144.598862] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 14:36:10 juju-e4d256-prod-github-runner-207 kernel: [33144.599961] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 14:36:10 juju-e4d256-prod-github-runner-207 kernel: [33144.601074] handle_exit+0x98/0x230 [kvm_amd] Aug 22 14:36:10 juju-e4d256-prod-github-runner-207 kernel: [33144.601970] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 14:36:10 juju-e4d256-prod-github-runner-207 kernel: [33144.602880] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 14:36:10 juju-e4d256-prod-github-runner-207 kernel: [33144.603807] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 14:36:10 juju-e4d256-prod-github-runner-207 kernel: [33144.604727] vcpu_run+0x62/0x2c0 [kvm] Aug 22 14:36:10 juju-e4d256-prod-github-runner-207 kernel: [33144.605542] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 14:36:10 juju-e4d256-prod-github-runner-207 kernel: [33144.606347] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 14:36:10 juju-e4d256-prod-github-runner-207 kernel: [33144.607200] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 14:36:10 juju-e4d256-prod-github-runner-207 kernel: [33144.608005] ? __seccomp_filter+0x4a/0x4a0 Aug 22 14:36:10 juju-e4d256-prod-github-runner-207 kernel: [33144.608798] ? __fget_files+0x86/0xc0 Aug 22 14:36:10 juju-e4d256-prod-github-runner-207 kernel: [33144.609501] __x64_sys_ioctl+0x95/0xd0 Aug 22 14:36:10 juju-e4d256-prod-github-runner-207 kernel: [33144.610192] do_syscall_64+0x5c/0xc0 Aug 22 14:36:10 juju-e4d256-prod-github-runner-207 kernel: [33144.610861] ? do_futex+0x162/0x1f0 Aug 22 14:36:10 juju-e4d256-prod-github-runner-207 kernel: [33144.611508] ? __x64_sys_futex+0x78/0x1e0 Aug 22 14:36:10 juju-e4d256-prod-github-runner-207 kernel: [33144.612181] ? __secure_computing+0xa9/0x120 Aug 22 14:36:10 juju-e4d256-prod-github-runner-207 kernel: [33144.612889] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 14:36:10 juju-e4d256-prod-github-runner-207 kernel: [33144.613650] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:36:10 juju-e4d256-prod-github-runner-207 kernel: [33144.614374] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:36:10 juju-e4d256-prod-github-runner-207 kernel: [33144.615095] ? do_syscall_64+0x69/0xc0 Aug 22 14:36:10 juju-e4d256-prod-github-runner-207 kernel: [33144.615737] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:36:10 juju-e4d256-prod-github-runner-207 kernel: [33144.616471] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:36:10 juju-e4d256-prod-github-runner-207 kernel: [33144.617166] ? do_syscall_64+0x69/0xc0 Aug 22 14:36:10 juju-e4d256-prod-github-runner-207 kernel: [33144.617794] ? do_syscall_64+0x69/0xc0 Aug 22 14:36:10 juju-e4d256-prod-github-runner-207 kernel: [33144.618415] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 14:36:10 juju-e4d256-prod-github-runner-207 kernel: [33144.619118] RIP: 0033:0x7faa5d0edaff Aug 22 14:36:10 juju-e4d256-prod-github-runner-207 kernel: [33144.619742] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 14:36:10 juju-e4d256-prod-github-runner-207 kernel: [33144.621757] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 14:36:10 juju-e4d256-prod-github-runner-207 kernel: [33144.622695] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 14:36:10 juju-e4d256-prod-github-runner-207 kernel: [33144.623617] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 14:36:10 juju-e4d256-prod-github-runner-207 kernel: [33144.624663] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 14:36:10 juju-e4d256-prod-github-runner-207 kernel: [33144.625697] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 14:36:10 juju-e4d256-prod-github-runner-207 kernel: [33144.626751] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 14:36:10 juju-e4d256-prod-github-runner-207 kernel: [33144.627781] Aug 22 14:36:38 juju-e4d256-prod-github-runner-207 kernel: [33172.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 30786s! [qemu-system-x86:6715] Aug 22 14:36:38 juju-e4d256-prod-github-runner-207 kernel: [33172.543940] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 14:36:38 juju-e4d256-prod-github-runner-207 kernel: [33172.544241] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 14:36:38 juju-e4d256-prod-github-runner-207 kernel: [33172.556437] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 14:36:38 juju-e4d256-prod-github-runner-207 kernel: [33172.557711] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 14:36:38 juju-e4d256-prod-github-runner-207 kernel: [33172.558934] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:36:38 juju-e4d256-prod-github-runner-207 kernel: [33172.560046] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 14:36:38 juju-e4d256-prod-github-runner-207 kernel: [33172.562606] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 14:36:38 juju-e4d256-prod-github-runner-207 kernel: [33172.563719] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 14:36:38 juju-e4d256-prod-github-runner-207 kernel: [33172.564930] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 14:36:38 juju-e4d256-prod-github-runner-207 kernel: [33172.566106] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 14:36:38 juju-e4d256-prod-github-runner-207 kernel: [33172.567270] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 14:36:38 juju-e4d256-prod-github-runner-207 kernel: [33172.568452] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 14:36:38 juju-e4d256-prod-github-runner-207 kernel: [33172.569661] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 14:36:38 juju-e4d256-prod-github-runner-207 kernel: [33172.570923] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 14:36:38 juju-e4d256-prod-github-runner-207 kernel: [33172.572062] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 14:36:38 juju-e4d256-prod-github-runner-207 kernel: [33172.573281] Call Trace: Aug 22 14:36:38 juju-e4d256-prod-github-runner-207 kernel: [33172.574227] Aug 22 14:36:38 juju-e4d256-prod-github-runner-207 kernel: [33172.575180] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:36:38 juju-e4d256-prod-github-runner-207 kernel: [33172.576292] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:36:38 juju-e4d256-prod-github-runner-207 kernel: [33172.577337] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:36:38 juju-e4d256-prod-github-runner-207 kernel: [33172.578456] ? show_regs.part.0+0x23/0x29 Aug 22 14:36:38 juju-e4d256-prod-github-runner-207 kernel: [33172.579458] ? show_regs.cold+0x8/0xd Aug 22 14:36:38 juju-e4d256-prod-github-runner-207 kernel: [33172.580482] ? watchdog_timer_fn+0x1be/0x220 Aug 22 14:36:38 juju-e4d256-prod-github-runner-207 kernel: [33172.581502] ? lockup_detector_update_enable+0x60/0x60 Aug 22 14:36:38 juju-e4d256-prod-github-runner-207 kernel: [33172.582569] ? __hrtimer_run_queues+0x107/0x230 Aug 22 14:36:38 juju-e4d256-prod-github-runner-207 kernel: [33172.583601] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 14:36:38 juju-e4d256-prod-github-runner-207 kernel: [33172.584644] ? hrtimer_interrupt+0x101/0x220 Aug 22 14:36:38 juju-e4d256-prod-github-runner-207 kernel: [33172.585696] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 14:36:38 juju-e4d256-prod-github-runner-207 kernel: [33172.586872] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 14:36:38 juju-e4d256-prod-github-runner-207 kernel: [33172.587961] Aug 22 14:36:38 juju-e4d256-prod-github-runner-207 kernel: [33172.588870] Aug 22 14:36:38 juju-e4d256-prod-github-runner-207 kernel: [33172.589768] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 14:36:38 juju-e4d256-prod-github-runner-207 kernel: [33172.590891] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:36:38 juju-e4d256-prod-github-runner-207 kernel: [33172.591985] ? _raw_spin_lock+0x22/0x30 Aug 22 14:36:38 juju-e4d256-prod-github-runner-207 kernel: [33172.592947] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:36:38 juju-e4d256-prod-github-runner-207 kernel: [33172.593974] direct_page_fault+0x206/0x310 [kvm] Aug 22 14:36:38 juju-e4d256-prod-github-runner-207 kernel: [33172.595055] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 14:36:38 juju-e4d256-prod-github-runner-207 kernel: [33172.596131] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 14:36:38 juju-e4d256-prod-github-runner-207 kernel: [33172.597215] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 14:36:38 juju-e4d256-prod-github-runner-207 kernel: [33172.598267] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 14:36:38 juju-e4d256-prod-github-runner-207 kernel: [33172.599220] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 14:36:38 juju-e4d256-prod-github-runner-207 kernel: [33172.600237] handle_exit+0x98/0x230 [kvm_amd] Aug 22 14:36:38 juju-e4d256-prod-github-runner-207 kernel: [33172.601171] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 14:36:38 juju-e4d256-prod-github-runner-207 kernel: [33172.602103] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 14:36:38 juju-e4d256-prod-github-runner-207 kernel: [33172.603172] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 14:36:38 juju-e4d256-prod-github-runner-207 kernel: [33172.604109] vcpu_run+0x62/0x2c0 [kvm] Aug 22 14:36:38 juju-e4d256-prod-github-runner-207 kernel: [33172.604960] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 14:36:38 juju-e4d256-prod-github-runner-207 kernel: [33172.605808] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 14:36:38 juju-e4d256-prod-github-runner-207 kernel: [33172.606696] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 14:36:38 juju-e4d256-prod-github-runner-207 kernel: [33172.607514] ? __seccomp_filter+0x4a/0x4a0 Aug 22 14:36:38 juju-e4d256-prod-github-runner-207 kernel: [33172.608283] ? __fget_files+0x86/0xc0 Aug 22 14:36:38 juju-e4d256-prod-github-runner-207 kernel: [33172.608994] __x64_sys_ioctl+0x95/0xd0 Aug 22 14:36:38 juju-e4d256-prod-github-runner-207 kernel: [33172.609743] do_syscall_64+0x5c/0xc0 Aug 22 14:36:38 juju-e4d256-prod-github-runner-207 kernel: [33172.610455] ? do_futex+0x162/0x1f0 Aug 22 14:36:38 juju-e4d256-prod-github-runner-207 kernel: [33172.611159] ? __x64_sys_futex+0x78/0x1e0 Aug 22 14:36:38 juju-e4d256-prod-github-runner-207 kernel: [33172.611878] ? __secure_computing+0xa9/0x120 Aug 22 14:36:38 juju-e4d256-prod-github-runner-207 kernel: [33172.612616] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 14:36:38 juju-e4d256-prod-github-runner-207 kernel: [33172.613402] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:36:38 juju-e4d256-prod-github-runner-207 kernel: [33172.614160] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:36:38 juju-e4d256-prod-github-runner-207 kernel: [33172.614905] ? do_syscall_64+0x69/0xc0 Aug 22 14:36:38 juju-e4d256-prod-github-runner-207 kernel: [33172.615613] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:36:38 juju-e4d256-prod-github-runner-207 kernel: [33172.616339] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:36:38 juju-e4d256-prod-github-runner-207 kernel: [33172.617063] ? do_syscall_64+0x69/0xc0 Aug 22 14:36:38 juju-e4d256-prod-github-runner-207 kernel: [33172.617707] ? do_syscall_64+0x69/0xc0 Aug 22 14:36:38 juju-e4d256-prod-github-runner-207 kernel: [33172.618332] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 14:36:38 juju-e4d256-prod-github-runner-207 kernel: [33172.619043] RIP: 0033:0x7faa5d0edaff Aug 22 14:36:38 juju-e4d256-prod-github-runner-207 kernel: [33172.619722] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 14:36:38 juju-e4d256-prod-github-runner-207 kernel: [33172.621802] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 14:36:38 juju-e4d256-prod-github-runner-207 kernel: [33172.622732] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 14:36:38 juju-e4d256-prod-github-runner-207 kernel: [33172.623656] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 14:36:38 juju-e4d256-prod-github-runner-207 kernel: [33172.624616] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 14:36:38 juju-e4d256-prod-github-runner-207 kernel: [33172.625509] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 14:36:38 juju-e4d256-prod-github-runner-207 kernel: [33172.626411] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 14:36:38 juju-e4d256-prod-github-runner-207 kernel: [33172.627309] Aug 22 14:37:06 juju-e4d256-prod-github-runner-207 kernel: [33200.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 30812s! [qemu-system-x86:6715] Aug 22 14:37:06 juju-e4d256-prod-github-runner-207 kernel: [33200.543980] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 14:37:06 juju-e4d256-prod-github-runner-207 kernel: [33200.544305] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 14:37:06 juju-e4d256-prod-github-runner-207 kernel: [33200.556971] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 14:37:06 juju-e4d256-prod-github-runner-207 kernel: [33200.558241] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 14:37:06 juju-e4d256-prod-github-runner-207 kernel: [33200.559481] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:37:06 juju-e4d256-prod-github-runner-207 kernel: [33200.560553] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 14:37:06 juju-e4d256-prod-github-runner-207 kernel: [33200.563123] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 14:37:06 juju-e4d256-prod-github-runner-207 kernel: [33200.564177] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 14:37:06 juju-e4d256-prod-github-runner-207 kernel: [33200.565339] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 14:37:06 juju-e4d256-prod-github-runner-207 kernel: [33200.566502] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 14:37:06 juju-e4d256-prod-github-runner-207 kernel: [33200.567671] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 14:37:06 juju-e4d256-prod-github-runner-207 kernel: [33200.568900] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 14:37:06 juju-e4d256-prod-github-runner-207 kernel: [33200.570094] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 14:37:06 juju-e4d256-prod-github-runner-207 kernel: [33200.571337] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 14:37:06 juju-e4d256-prod-github-runner-207 kernel: [33200.572439] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 14:37:06 juju-e4d256-prod-github-runner-207 kernel: [33200.573634] Call Trace: Aug 22 14:37:06 juju-e4d256-prod-github-runner-207 kernel: [33200.574550] Aug 22 14:37:06 juju-e4d256-prod-github-runner-207 kernel: [33200.575449] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:37:06 juju-e4d256-prod-github-runner-207 kernel: [33200.576500] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:37:06 juju-e4d256-prod-github-runner-207 kernel: [33200.577551] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:37:06 juju-e4d256-prod-github-runner-207 kernel: [33200.578673] ? show_regs.part.0+0x23/0x29 Aug 22 14:37:06 juju-e4d256-prod-github-runner-207 kernel: [33200.579688] ? show_regs.cold+0x8/0xd Aug 22 14:37:06 juju-e4d256-prod-github-runner-207 kernel: [33200.580659] ? watchdog_timer_fn+0x1be/0x220 Aug 22 14:37:06 juju-e4d256-prod-github-runner-207 kernel: [33200.581667] ? lockup_detector_update_enable+0x60/0x60 Aug 22 14:37:06 juju-e4d256-prod-github-runner-207 kernel: [33200.582761] ? __hrtimer_run_queues+0x107/0x230 Aug 22 14:37:06 juju-e4d256-prod-github-runner-207 kernel: [33200.583818] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 14:37:06 juju-e4d256-prod-github-runner-207 kernel: [33200.584855] ? hrtimer_interrupt+0x101/0x220 Aug 22 14:37:06 juju-e4d256-prod-github-runner-207 kernel: [33200.585867] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 14:37:06 juju-e4d256-prod-github-runner-207 kernel: [33200.586933] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 14:37:06 juju-e4d256-prod-github-runner-207 kernel: [33200.588097] Aug 22 14:37:06 juju-e4d256-prod-github-runner-207 kernel: [33200.588955] Aug 22 14:37:06 juju-e4d256-prod-github-runner-207 kernel: [33200.589792] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 14:37:06 juju-e4d256-prod-github-runner-207 kernel: [33200.590861] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:37:06 juju-e4d256-prod-github-runner-207 kernel: [33200.591905] ? _raw_spin_lock+0x22/0x30 Aug 22 14:37:06 juju-e4d256-prod-github-runner-207 kernel: [33200.592857] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:37:06 juju-e4d256-prod-github-runner-207 kernel: [33200.593880] direct_page_fault+0x206/0x310 [kvm] Aug 22 14:37:06 juju-e4d256-prod-github-runner-207 kernel: [33200.594909] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 14:37:06 juju-e4d256-prod-github-runner-207 kernel: [33200.595933] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 14:37:06 juju-e4d256-prod-github-runner-207 kernel: [33200.596932] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 14:37:06 juju-e4d256-prod-github-runner-207 kernel: [33200.597928] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 14:37:06 juju-e4d256-prod-github-runner-207 kernel: [33200.598885] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 14:37:06 juju-e4d256-prod-github-runner-207 kernel: [33200.599884] handle_exit+0x98/0x230 [kvm_amd] Aug 22 14:37:06 juju-e4d256-prod-github-runner-207 kernel: [33200.600776] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 14:37:06 juju-e4d256-prod-github-runner-207 kernel: [33200.601692] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 14:37:06 juju-e4d256-prod-github-runner-207 kernel: [33200.602612] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 14:37:06 juju-e4d256-prod-github-runner-207 kernel: [33200.603512] vcpu_run+0x62/0x2c0 [kvm] Aug 22 14:37:06 juju-e4d256-prod-github-runner-207 kernel: [33200.604340] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 14:37:06 juju-e4d256-prod-github-runner-207 kernel: [33200.605148] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 14:37:06 juju-e4d256-prod-github-runner-207 kernel: [33200.606010] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 14:37:06 juju-e4d256-prod-github-runner-207 kernel: [33200.606804] ? __seccomp_filter+0x4a/0x4a0 Aug 22 14:37:06 juju-e4d256-prod-github-runner-207 kernel: [33200.607564] ? __fget_files+0x86/0xc0 Aug 22 14:37:06 juju-e4d256-prod-github-runner-207 kernel: [33200.608281] __x64_sys_ioctl+0x95/0xd0 Aug 22 14:37:06 juju-e4d256-prod-github-runner-207 kernel: [33200.609004] do_syscall_64+0x5c/0xc0 Aug 22 14:37:06 juju-e4d256-prod-github-runner-207 kernel: [33200.609693] ? do_futex+0x162/0x1f0 Aug 22 14:37:06 juju-e4d256-prod-github-runner-207 kernel: [33200.610345] ? __x64_sys_futex+0x78/0x1e0 Aug 22 14:37:06 juju-e4d256-prod-github-runner-207 kernel: [33200.611019] ? __secure_computing+0xa9/0x120 Aug 22 14:37:06 juju-e4d256-prod-github-runner-207 kernel: [33200.611726] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 14:37:06 juju-e4d256-prod-github-runner-207 kernel: [33200.612485] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:37:06 juju-e4d256-prod-github-runner-207 kernel: [33200.613205] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:37:06 juju-e4d256-prod-github-runner-207 kernel: [33200.613927] ? do_syscall_64+0x69/0xc0 Aug 22 14:37:06 juju-e4d256-prod-github-runner-207 kernel: [33200.614576] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:37:06 juju-e4d256-prod-github-runner-207 kernel: [33200.615287] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:37:06 juju-e4d256-prod-github-runner-207 kernel: [33200.616000] ? do_syscall_64+0x69/0xc0 Aug 22 14:37:06 juju-e4d256-prod-github-runner-207 kernel: [33200.616623] ? do_syscall_64+0x69/0xc0 Aug 22 14:37:06 juju-e4d256-prod-github-runner-207 kernel: [33200.617244] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 14:37:06 juju-e4d256-prod-github-runner-207 kernel: [33200.617963] RIP: 0033:0x7faa5d0edaff Aug 22 14:37:06 juju-e4d256-prod-github-runner-207 kernel: [33200.618606] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 14:37:06 juju-e4d256-prod-github-runner-207 kernel: [33200.620599] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 14:37:06 juju-e4d256-prod-github-runner-207 kernel: [33200.621517] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 14:37:06 juju-e4d256-prod-github-runner-207 kernel: [33200.622404] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 14:37:06 juju-e4d256-prod-github-runner-207 kernel: [33200.623294] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 14:37:06 juju-e4d256-prod-github-runner-207 kernel: [33200.624208] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 14:37:06 juju-e4d256-prod-github-runner-207 kernel: [33200.625119] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 14:37:06 juju-e4d256-prod-github-runner-207 kernel: [33200.626008] Aug 22 14:37:34 juju-e4d256-prod-github-runner-207 kernel: [33228.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 30838s! [qemu-system-x86:6715] Aug 22 14:37:34 juju-e4d256-prod-github-runner-207 kernel: [33228.543116] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 14:37:34 juju-e4d256-prod-github-runner-207 kernel: [33228.543215] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 14:37:34 juju-e4d256-prod-github-runner-207 kernel: [33228.555383] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 14:37:34 juju-e4d256-prod-github-runner-207 kernel: [33228.556653] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 14:37:34 juju-e4d256-prod-github-runner-207 kernel: [33228.557876] RIP: 0010:native_queued_spin_lock_slowpath+0xc/0x40 Aug 22 14:37:34 juju-e4d256-prod-github-runner-207 kernel: [33228.558930] Code: fe ff ff eb af 4c 89 fe 48 c7 c7 20 99 e9 89 e8 ca 69 55 00 e9 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 <8b> 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 eb Aug 22 14:37:34 juju-e4d256-prod-github-runner-207 kernel: [33228.561661] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 14:37:34 juju-e4d256-prod-github-runner-207 kernel: [33228.562881] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 14:37:34 juju-e4d256-prod-github-runner-207 kernel: [33228.564125] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 14:37:34 juju-e4d256-prod-github-runner-207 kernel: [33228.565457] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 14:37:34 juju-e4d256-prod-github-runner-207 kernel: [33228.566634] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 14:37:34 juju-e4d256-prod-github-runner-207 kernel: [33228.567978] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 14:37:34 juju-e4d256-prod-github-runner-207 kernel: [33228.569212] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 14:37:34 juju-e4d256-prod-github-runner-207 kernel: [33228.570455] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 14:37:34 juju-e4d256-prod-github-runner-207 kernel: [33228.571581] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 14:37:34 juju-e4d256-prod-github-runner-207 kernel: [33228.572776] Call Trace: Aug 22 14:37:34 juju-e4d256-prod-github-runner-207 kernel: [33228.573693] Aug 22 14:37:34 juju-e4d256-prod-github-runner-207 kernel: [33228.574607] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:37:34 juju-e4d256-prod-github-runner-207 kernel: [33228.575696] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:37:34 juju-e4d256-prod-github-runner-207 kernel: [33228.576722] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:37:34 juju-e4d256-prod-github-runner-207 kernel: [33228.577822] ? show_regs.part.0+0x23/0x29 Aug 22 14:37:34 juju-e4d256-prod-github-runner-207 kernel: [33228.578819] ? show_regs.cold+0x8/0xd Aug 22 14:37:34 juju-e4d256-prod-github-runner-207 kernel: [33228.579815] ? watchdog_timer_fn+0x1be/0x220 Aug 22 14:37:34 juju-e4d256-prod-github-runner-207 kernel: [33228.580825] ? lockup_detector_update_enable+0x60/0x60 Aug 22 14:37:34 juju-e4d256-prod-github-runner-207 kernel: [33228.581886] ? __hrtimer_run_queues+0x107/0x230 Aug 22 14:37:34 juju-e4d256-prod-github-runner-207 kernel: [33228.582916] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 14:37:34 juju-e4d256-prod-github-runner-207 kernel: [33228.583951] ? hrtimer_interrupt+0x101/0x220 Aug 22 14:37:34 juju-e4d256-prod-github-runner-207 kernel: [33228.584968] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 14:37:34 juju-e4d256-prod-github-runner-207 kernel: [33228.586032] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 14:37:34 juju-e4d256-prod-github-runner-207 kernel: [33228.587073] Aug 22 14:37:34 juju-e4d256-prod-github-runner-207 kernel: [33228.587929] Aug 22 14:37:34 juju-e4d256-prod-github-runner-207 kernel: [33228.588767] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 14:37:34 juju-e4d256-prod-github-runner-207 kernel: [33228.589801] ? native_queued_spin_lock_slowpath+0xc/0x40 Aug 22 14:37:34 juju-e4d256-prod-github-runner-207 kernel: [33228.590830] ? _raw_spin_lock+0x22/0x30 Aug 22 14:37:34 juju-e4d256-prod-github-runner-207 kernel: [33228.591793] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:37:34 juju-e4d256-prod-github-runner-207 kernel: [33228.592810] direct_page_fault+0x206/0x310 [kvm] Aug 22 14:37:34 juju-e4d256-prod-github-runner-207 kernel: [33228.593831] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 14:37:34 juju-e4d256-prod-github-runner-207 kernel: [33228.594836] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 14:37:34 juju-e4d256-prod-github-runner-207 kernel: [33228.595845] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 14:37:34 juju-e4d256-prod-github-runner-207 kernel: [33228.596823] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 14:37:34 juju-e4d256-prod-github-runner-207 kernel: [33228.597764] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 14:37:34 juju-e4d256-prod-github-runner-207 kernel: [33228.598742] handle_exit+0x98/0x230 [kvm_amd] Aug 22 14:37:34 juju-e4d256-prod-github-runner-207 kernel: [33228.599689] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 14:37:34 juju-e4d256-prod-github-runner-207 kernel: [33228.600611] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 14:37:34 juju-e4d256-prod-github-runner-207 kernel: [33228.601532] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 14:37:34 juju-e4d256-prod-github-runner-207 kernel: [33228.602436] vcpu_run+0x62/0x2c0 [kvm] Aug 22 14:37:34 juju-e4d256-prod-github-runner-207 kernel: [33228.603261] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 14:37:34 juju-e4d256-prod-github-runner-207 kernel: [33228.604065] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 14:37:34 juju-e4d256-prod-github-runner-207 kernel: [33228.604921] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 14:37:34 juju-e4d256-prod-github-runner-207 kernel: [33228.605713] ? __seccomp_filter+0x4a/0x4a0 Aug 22 14:37:34 juju-e4d256-prod-github-runner-207 kernel: [33228.606453] ? __fget_files+0x86/0xc0 Aug 22 14:37:34 juju-e4d256-prod-github-runner-207 kernel: [33228.607171] __x64_sys_ioctl+0x95/0xd0 Aug 22 14:37:34 juju-e4d256-prod-github-runner-207 kernel: [33228.607886] do_syscall_64+0x5c/0xc0 Aug 22 14:37:34 juju-e4d256-prod-github-runner-207 kernel: [33228.608556] ? do_futex+0x162/0x1f0 Aug 22 14:37:34 juju-e4d256-prod-github-runner-207 kernel: [33228.609222] ? __x64_sys_futex+0x78/0x1e0 Aug 22 14:37:34 juju-e4d256-prod-github-runner-207 kernel: [33228.609892] ? __secure_computing+0xa9/0x120 Aug 22 14:37:34 juju-e4d256-prod-github-runner-207 kernel: [33228.610578] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 14:37:34 juju-e4d256-prod-github-runner-207 kernel: [33228.611352] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:37:34 juju-e4d256-prod-github-runner-207 kernel: [33228.612096] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:37:34 juju-e4d256-prod-github-runner-207 kernel: [33228.612827] ? do_syscall_64+0x69/0xc0 Aug 22 14:37:34 juju-e4d256-prod-github-runner-207 kernel: [33228.613476] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:37:34 juju-e4d256-prod-github-runner-207 kernel: [33228.614181] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:37:34 juju-e4d256-prod-github-runner-207 kernel: [33228.614876] ? do_syscall_64+0x69/0xc0 Aug 22 14:37:34 juju-e4d256-prod-github-runner-207 kernel: [33228.615510] ? do_syscall_64+0x69/0xc0 Aug 22 14:37:34 juju-e4d256-prod-github-runner-207 kernel: [33228.616130] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 14:37:34 juju-e4d256-prod-github-runner-207 kernel: [33228.616831] RIP: 0033:0x7faa5d0edaff Aug 22 14:37:34 juju-e4d256-prod-github-runner-207 kernel: [33228.617473] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 14:37:34 juju-e4d256-prod-github-runner-207 kernel: [33228.619503] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 14:37:34 juju-e4d256-prod-github-runner-207 kernel: [33228.620423] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 14:37:34 juju-e4d256-prod-github-runner-207 kernel: [33228.621318] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 14:37:34 juju-e4d256-prod-github-runner-207 kernel: [33228.622207] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 14:37:34 juju-e4d256-prod-github-runner-207 kernel: [33228.623114] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 14:37:34 juju-e4d256-prod-github-runner-207 kernel: [33228.624031] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 14:37:34 juju-e4d256-prod-github-runner-207 kernel: [33228.624933] Aug 22 14:38:02 juju-e4d256-prod-github-runner-207 kernel: [33256.541981] watchdog: BUG: soft lockup - CPU#1 stuck for 30864s! [qemu-system-x86:6715] Aug 22 14:38:02 juju-e4d256-prod-github-runner-207 kernel: [33256.543885] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 14:38:02 juju-e4d256-prod-github-runner-207 kernel: [33256.544193] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 14:38:02 juju-e4d256-prod-github-runner-207 kernel: [33256.557251] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 14:38:02 juju-e4d256-prod-github-runner-207 kernel: [33256.558529] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 14:38:02 juju-e4d256-prod-github-runner-207 kernel: [33256.559762] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:38:02 juju-e4d256-prod-github-runner-207 kernel: [33256.560818] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 14:38:02 juju-e4d256-prod-github-runner-207 kernel: [33256.563379] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 14:38:02 juju-e4d256-prod-github-runner-207 kernel: [33256.564423] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 14:38:02 juju-e4d256-prod-github-runner-207 kernel: [33256.565589] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 14:38:02 juju-e4d256-prod-github-runner-207 kernel: [33256.566762] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 14:38:02 juju-e4d256-prod-github-runner-207 kernel: [33256.567941] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 14:38:02 juju-e4d256-prod-github-runner-207 kernel: [33256.569105] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 14:38:02 juju-e4d256-prod-github-runner-207 kernel: [33256.570273] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 14:38:02 juju-e4d256-prod-github-runner-207 kernel: [33256.571551] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 14:38:02 juju-e4d256-prod-github-runner-207 kernel: [33256.572657] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 14:38:02 juju-e4d256-prod-github-runner-207 kernel: [33256.573854] Call Trace: Aug 22 14:38:02 juju-e4d256-prod-github-runner-207 kernel: [33256.574768] Aug 22 14:38:02 juju-e4d256-prod-github-runner-207 kernel: [33256.575676] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:38:02 juju-e4d256-prod-github-runner-207 kernel: [33256.576705] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:38:02 juju-e4d256-prod-github-runner-207 kernel: [33256.577730] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:38:02 juju-e4d256-prod-github-runner-207 kernel: [33256.578846] ? show_regs.part.0+0x23/0x29 Aug 22 14:38:02 juju-e4d256-prod-github-runner-207 kernel: [33256.579845] ? show_regs.cold+0x8/0xd Aug 22 14:38:02 juju-e4d256-prod-github-runner-207 kernel: [33256.580821] ? watchdog_timer_fn+0x1be/0x220 Aug 22 14:38:02 juju-e4d256-prod-github-runner-207 kernel: [33256.581828] ? lockup_detector_update_enable+0x60/0x60 Aug 22 14:38:02 juju-e4d256-prod-github-runner-207 kernel: [33256.582907] ? __hrtimer_run_queues+0x107/0x230 Aug 22 14:38:02 juju-e4d256-prod-github-runner-207 kernel: [33256.583939] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 14:38:02 juju-e4d256-prod-github-runner-207 kernel: [33256.584974] ? hrtimer_interrupt+0x101/0x220 Aug 22 14:38:02 juju-e4d256-prod-github-runner-207 kernel: [33256.585987] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 14:38:02 juju-e4d256-prod-github-runner-207 kernel: [33256.587120] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 14:38:02 juju-e4d256-prod-github-runner-207 kernel: [33256.588176] Aug 22 14:38:02 juju-e4d256-prod-github-runner-207 kernel: [33256.589034] Aug 22 14:38:02 juju-e4d256-prod-github-runner-207 kernel: [33256.589885] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 14:38:02 juju-e4d256-prod-github-runner-207 kernel: [33256.591043] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:38:02 juju-e4d256-prod-github-runner-207 kernel: [33256.592231] ? _raw_spin_lock+0x22/0x30 Aug 22 14:38:02 juju-e4d256-prod-github-runner-207 kernel: [33256.593188] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:38:02 juju-e4d256-prod-github-runner-207 kernel: [33256.594288] direct_page_fault+0x206/0x310 [kvm] Aug 22 14:38:02 juju-e4d256-prod-github-runner-207 kernel: [33256.595345] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 14:38:02 juju-e4d256-prod-github-runner-207 kernel: [33256.596357] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 14:38:02 juju-e4d256-prod-github-runner-207 kernel: [33256.597358] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 14:38:02 juju-e4d256-prod-github-runner-207 kernel: [33256.598370] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 14:38:02 juju-e4d256-prod-github-runner-207 kernel: [33256.599449] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 14:38:02 juju-e4d256-prod-github-runner-207 kernel: [33256.600440] handle_exit+0x98/0x230 [kvm_amd] Aug 22 14:38:02 juju-e4d256-prod-github-runner-207 kernel: [33256.601334] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 14:38:02 juju-e4d256-prod-github-runner-207 kernel: [33256.602283] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 14:38:02 juju-e4d256-prod-github-runner-207 kernel: [33256.603240] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 14:38:02 juju-e4d256-prod-github-runner-207 kernel: [33256.604144] vcpu_run+0x62/0x2c0 [kvm] Aug 22 14:38:02 juju-e4d256-prod-github-runner-207 kernel: [33256.604953] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 14:38:02 juju-e4d256-prod-github-runner-207 kernel: [33256.605775] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 14:38:02 juju-e4d256-prod-github-runner-207 kernel: [33256.606632] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 14:38:02 juju-e4d256-prod-github-runner-207 kernel: [33256.607436] ? __seccomp_filter+0x4a/0x4a0 Aug 22 14:38:02 juju-e4d256-prod-github-runner-207 kernel: [33256.608177] ? __fget_files+0x86/0xc0 Aug 22 14:38:02 juju-e4d256-prod-github-runner-207 kernel: [33256.608884] __x64_sys_ioctl+0x95/0xd0 Aug 22 14:38:02 juju-e4d256-prod-github-runner-207 kernel: [33256.609619] do_syscall_64+0x5c/0xc0 Aug 22 14:38:02 juju-e4d256-prod-github-runner-207 kernel: [33256.610296] ? do_futex+0x162/0x1f0 Aug 22 14:38:02 juju-e4d256-prod-github-runner-207 kernel: [33256.610973] ? __x64_sys_futex+0x78/0x1e0 Aug 22 14:38:02 juju-e4d256-prod-github-runner-207 kernel: [33256.611647] ? __secure_computing+0xa9/0x120 Aug 22 14:38:02 juju-e4d256-prod-github-runner-207 kernel: [33256.612337] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 14:38:02 juju-e4d256-prod-github-runner-207 kernel: [33256.613104] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:38:02 juju-e4d256-prod-github-runner-207 kernel: [33256.613824] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:38:02 juju-e4d256-prod-github-runner-207 kernel: [33256.614539] ? do_syscall_64+0x69/0xc0 Aug 22 14:38:02 juju-e4d256-prod-github-runner-207 kernel: [33256.615191] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:38:02 juju-e4d256-prod-github-runner-207 kernel: [33256.615897] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:38:02 juju-e4d256-prod-github-runner-207 kernel: [33256.616591] ? do_syscall_64+0x69/0xc0 Aug 22 14:38:02 juju-e4d256-prod-github-runner-207 kernel: [33256.617213] ? do_syscall_64+0x69/0xc0 Aug 22 14:38:02 juju-e4d256-prod-github-runner-207 kernel: [33256.617834] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 14:38:02 juju-e4d256-prod-github-runner-207 kernel: [33256.618541] RIP: 0033:0x7faa5d0edaff Aug 22 14:38:02 juju-e4d256-prod-github-runner-207 kernel: [33256.619205] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 14:38:02 juju-e4d256-prod-github-runner-207 kernel: [33256.621195] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 14:38:02 juju-e4d256-prod-github-runner-207 kernel: [33256.622281] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 14:38:02 juju-e4d256-prod-github-runner-207 kernel: [33256.623256] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 14:38:02 juju-e4d256-prod-github-runner-207 kernel: [33256.624155] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 14:38:02 juju-e4d256-prod-github-runner-207 kernel: [33256.625054] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 14:38:02 juju-e4d256-prod-github-runner-207 kernel: [33256.625990] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 14:38:02 juju-e4d256-prod-github-runner-207 kernel: [33256.626997] Aug 22 14:38:30 juju-e4d256-prod-github-runner-207 kernel: [33284.541976] watchdog: BUG: soft lockup - CPU#1 stuck for 30890s! [qemu-system-x86:6715] Aug 22 14:38:30 juju-e4d256-prod-github-runner-207 kernel: [33284.543505] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 14:38:30 juju-e4d256-prod-github-runner-207 kernel: [33284.543577] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 14:38:30 juju-e4d256-prod-github-runner-207 kernel: [33284.556122] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 14:38:30 juju-e4d256-prod-github-runner-207 kernel: [33284.557392] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 14:38:30 juju-e4d256-prod-github-runner-207 kernel: [33284.558627] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:38:30 juju-e4d256-prod-github-runner-207 kernel: [33284.559688] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 14:38:30 juju-e4d256-prod-github-runner-207 kernel: [33284.562236] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 14:38:30 juju-e4d256-prod-github-runner-207 kernel: [33284.563295] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 14:38:30 juju-e4d256-prod-github-runner-207 kernel: [33284.564453] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 14:38:30 juju-e4d256-prod-github-runner-207 kernel: [33284.565638] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 14:38:30 juju-e4d256-prod-github-runner-207 kernel: [33284.566825] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 14:38:30 juju-e4d256-prod-github-runner-207 kernel: [33284.567991] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 14:38:30 juju-e4d256-prod-github-runner-207 kernel: [33284.569159] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 14:38:30 juju-e4d256-prod-github-runner-207 kernel: [33284.570395] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 14:38:30 juju-e4d256-prod-github-runner-207 kernel: [33284.571530] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 14:38:30 juju-e4d256-prod-github-runner-207 kernel: [33284.572938] Call Trace: Aug 22 14:38:30 juju-e4d256-prod-github-runner-207 kernel: [33284.573876] Aug 22 14:38:30 juju-e4d256-prod-github-runner-207 kernel: [33284.574795] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:38:30 juju-e4d256-prod-github-runner-207 kernel: [33284.575829] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:38:30 juju-e4d256-prod-github-runner-207 kernel: [33284.576852] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:38:30 juju-e4d256-prod-github-runner-207 kernel: [33284.577927] ? show_regs.part.0+0x23/0x29 Aug 22 14:38:30 juju-e4d256-prod-github-runner-207 kernel: [33284.578957] ? show_regs.cold+0x8/0xd Aug 22 14:38:30 juju-e4d256-prod-github-runner-207 kernel: [33284.579959] ? watchdog_timer_fn+0x1be/0x220 Aug 22 14:38:30 juju-e4d256-prod-github-runner-207 kernel: [33284.580978] ? lockup_detector_update_enable+0x60/0x60 Aug 22 14:38:30 juju-e4d256-prod-github-runner-207 kernel: [33284.582044] ? __hrtimer_run_queues+0x107/0x230 Aug 22 14:38:30 juju-e4d256-prod-github-runner-207 kernel: [33284.583083] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 14:38:30 juju-e4d256-prod-github-runner-207 kernel: [33284.584116] ? hrtimer_interrupt+0x101/0x220 Aug 22 14:38:30 juju-e4d256-prod-github-runner-207 kernel: [33284.585163] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 14:38:30 juju-e4d256-prod-github-runner-207 kernel: [33284.586232] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 14:38:30 juju-e4d256-prod-github-runner-207 kernel: [33284.587290] Aug 22 14:38:30 juju-e4d256-prod-github-runner-207 kernel: [33284.588142] Aug 22 14:38:30 juju-e4d256-prod-github-runner-207 kernel: [33284.588978] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 14:38:30 juju-e4d256-prod-github-runner-207 kernel: [33284.590008] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:38:30 juju-e4d256-prod-github-runner-207 kernel: [33284.591068] ? _raw_spin_lock+0x22/0x30 Aug 22 14:38:30 juju-e4d256-prod-github-runner-207 kernel: [33284.592012] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:38:30 juju-e4d256-prod-github-runner-207 kernel: [33284.593029] direct_page_fault+0x206/0x310 [kvm] Aug 22 14:38:30 juju-e4d256-prod-github-runner-207 kernel: [33284.594060] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 14:38:30 juju-e4d256-prod-github-runner-207 kernel: [33284.595136] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 14:38:30 juju-e4d256-prod-github-runner-207 kernel: [33284.596139] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 14:38:30 juju-e4d256-prod-github-runner-207 kernel: [33284.597170] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 14:38:30 juju-e4d256-prod-github-runner-207 kernel: [33284.598123] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 14:38:30 juju-e4d256-prod-github-runner-207 kernel: [33284.599123] handle_exit+0x98/0x230 [kvm_amd] Aug 22 14:38:30 juju-e4d256-prod-github-runner-207 kernel: [33284.600021] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 14:38:30 juju-e4d256-prod-github-runner-207 kernel: [33284.600942] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 14:38:30 juju-e4d256-prod-github-runner-207 kernel: [33284.601866] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 14:38:30 juju-e4d256-prod-github-runner-207 kernel: [33284.602790] vcpu_run+0x62/0x2c0 [kvm] Aug 22 14:38:30 juju-e4d256-prod-github-runner-207 kernel: [33284.603608] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 14:38:30 juju-e4d256-prod-github-runner-207 kernel: [33284.604422] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 14:38:30 juju-e4d256-prod-github-runner-207 kernel: [33284.605282] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 14:38:30 juju-e4d256-prod-github-runner-207 kernel: [33284.606079] ? __seccomp_filter+0x4a/0x4a0 Aug 22 14:38:30 juju-e4d256-prod-github-runner-207 kernel: [33284.606836] ? __fget_files+0x86/0xc0 Aug 22 14:38:30 juju-e4d256-prod-github-runner-207 kernel: [33284.607552] __x64_sys_ioctl+0x95/0xd0 Aug 22 14:38:30 juju-e4d256-prod-github-runner-207 kernel: [33284.608251] do_syscall_64+0x5c/0xc0 Aug 22 14:38:30 juju-e4d256-prod-github-runner-207 kernel: [33284.608916] ? do_futex+0x162/0x1f0 Aug 22 14:38:30 juju-e4d256-prod-github-runner-207 kernel: [33284.609593] ? __x64_sys_futex+0x78/0x1e0 Aug 22 14:38:30 juju-e4d256-prod-github-runner-207 kernel: [33284.610278] ? __secure_computing+0xa9/0x120 Aug 22 14:38:30 juju-e4d256-prod-github-runner-207 kernel: [33284.610983] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 14:38:30 juju-e4d256-prod-github-runner-207 kernel: [33284.611750] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:38:30 juju-e4d256-prod-github-runner-207 kernel: [33284.612470] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:38:30 juju-e4d256-prod-github-runner-207 kernel: [33284.613188] ? do_syscall_64+0x69/0xc0 Aug 22 14:38:30 juju-e4d256-prod-github-runner-207 kernel: [33284.613831] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:38:30 juju-e4d256-prod-github-runner-207 kernel: [33284.614550] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:38:30 juju-e4d256-prod-github-runner-207 kernel: [33284.615251] ? do_syscall_64+0x69/0xc0 Aug 22 14:38:30 juju-e4d256-prod-github-runner-207 kernel: [33284.615874] ? do_syscall_64+0x69/0xc0 Aug 22 14:38:30 juju-e4d256-prod-github-runner-207 kernel: [33284.616502] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 14:38:30 juju-e4d256-prod-github-runner-207 kernel: [33284.617221] RIP: 0033:0x7faa5d0edaff Aug 22 14:38:30 juju-e4d256-prod-github-runner-207 kernel: [33284.617873] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 14:38:30 juju-e4d256-prod-github-runner-207 kernel: [33284.619871] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 14:38:30 juju-e4d256-prod-github-runner-207 kernel: [33284.620786] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 14:38:30 juju-e4d256-prod-github-runner-207 kernel: [33284.621675] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 14:38:30 juju-e4d256-prod-github-runner-207 kernel: [33284.622579] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 14:38:30 juju-e4d256-prod-github-runner-207 kernel: [33284.623473] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 14:38:30 juju-e4d256-prod-github-runner-207 kernel: [33284.624360] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 14:38:30 juju-e4d256-prod-github-runner-207 kernel: [33284.625253] Aug 22 14:38:45 juju-e4d256-prod-github-runner-207 kernel: [33299.408892] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 14:38:45 juju-e4d256-prod-github-runner-207 kernel: [33299.412791] rcu: 1-....: (8269593 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=3994906 Aug 22 14:38:45 juju-e4d256-prod-github-runner-207 kernel: [33299.422190] (t=8295552 jiffies g=23269 q=35806) Aug 22 14:38:45 juju-e4d256-prod-github-runner-207 kernel: [33299.424325] NMI backtrace for cpu 1 Aug 22 14:38:45 juju-e4d256-prod-github-runner-207 kernel: [33299.426265] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 14:38:45 juju-e4d256-prod-github-runner-207 kernel: [33299.449309] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 14:38:45 juju-e4d256-prod-github-runner-207 kernel: [33299.457785] Call Trace: Aug 22 14:38:45 juju-e4d256-prod-github-runner-207 kernel: [33299.460473] Aug 22 14:38:45 juju-e4d256-prod-github-runner-207 kernel: [33299.462205] show_stack+0x52/0x5c Aug 22 14:38:45 juju-e4d256-prod-github-runner-207 kernel: [33299.464134] dump_stack_lvl+0x4a/0x63 Aug 22 14:38:45 juju-e4d256-prod-github-runner-207 kernel: [33299.472740] dump_stack+0x10/0x16 Aug 22 14:38:45 juju-e4d256-prod-github-runner-207 kernel: [33299.473912] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 14:38:45 juju-e4d256-prod-github-runner-207 kernel: [33299.475094] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 14:38:45 juju-e4d256-prod-github-runner-207 kernel: [33299.476172] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 14:38:45 juju-e4d256-prod-github-runner-207 kernel: [33299.477120] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 14:38:45 juju-e4d256-prod-github-runner-207 kernel: [33299.478098] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 14:38:45 juju-e4d256-prod-github-runner-207 kernel: [33299.479038] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 14:38:45 juju-e4d256-prod-github-runner-207 kernel: [33299.479907] print_cpu_stall.cold+0x2f/0xe2 Aug 22 14:38:45 juju-e4d256-prod-github-runner-207 kernel: [33299.480763] ? timekeeping_update+0xf7/0x150 Aug 22 14:38:45 juju-e4d256-prod-github-runner-207 kernel: [33299.481622] check_cpu_stall+0x109/0x270 Aug 22 14:38:45 juju-e4d256-prod-github-runner-207 kernel: [33299.482471] rcu_sched_clock_irq+0x9a/0x250 Aug 22 14:38:45 juju-e4d256-prod-github-runner-207 kernel: [33299.483323] update_process_times+0x94/0xd0 Aug 22 14:38:45 juju-e4d256-prod-github-runner-207 kernel: [33299.484171] tick_sched_handle+0x29/0x70 Aug 22 14:38:45 juju-e4d256-prod-github-runner-207 kernel: [33299.485008] tick_sched_timer+0x8c/0xc0 Aug 22 14:38:45 juju-e4d256-prod-github-runner-207 kernel: [33299.485836] ? tick_nohz_handler+0xb0/0xb0 Aug 22 14:38:45 juju-e4d256-prod-github-runner-207 kernel: [33299.486829] __hrtimer_run_queues+0x107/0x230 Aug 22 14:38:45 juju-e4d256-prod-github-runner-207 kernel: [33299.487847] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 14:38:45 juju-e4d256-prod-github-runner-207 kernel: [33299.488664] hrtimer_interrupt+0x101/0x220 Aug 22 14:38:45 juju-e4d256-prod-github-runner-207 kernel: [33299.489430] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 14:38:45 juju-e4d256-prod-github-runner-207 kernel: [33299.490247] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 14:38:45 juju-e4d256-prod-github-runner-207 kernel: [33299.491079] Aug 22 14:38:45 juju-e4d256-prod-github-runner-207 kernel: [33299.491716] Aug 22 14:38:45 juju-e4d256-prod-github-runner-207 kernel: [33299.492346] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 14:38:45 juju-e4d256-prod-github-runner-207 kernel: [33299.493167] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:38:45 juju-e4d256-prod-github-runner-207 kernel: [33299.494049] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 14:38:45 juju-e4d256-prod-github-runner-207 kernel: [33299.496282] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 14:38:45 juju-e4d256-prod-github-runner-207 kernel: [33299.497158] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 14:38:45 juju-e4d256-prod-github-runner-207 kernel: [33299.498153] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 14:38:45 juju-e4d256-prod-github-runner-207 kernel: [33299.499151] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 14:38:45 juju-e4d256-prod-github-runner-207 kernel: [33299.500124] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 14:38:45 juju-e4d256-prod-github-runner-207 kernel: [33299.501080] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 14:38:45 juju-e4d256-prod-github-runner-207 kernel: [33299.502036] ? _raw_spin_lock+0x22/0x30 Aug 22 14:38:45 juju-e4d256-prod-github-runner-207 kernel: [33299.502823] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:38:45 juju-e4d256-prod-github-runner-207 kernel: [33299.503665] direct_page_fault+0x206/0x310 [kvm] Aug 22 14:38:45 juju-e4d256-prod-github-runner-207 kernel: [33299.504514] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 14:38:45 juju-e4d256-prod-github-runner-207 kernel: [33299.505345] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 14:38:45 juju-e4d256-prod-github-runner-207 kernel: [33299.506173] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 14:38:45 juju-e4d256-prod-github-runner-207 kernel: [33299.507004] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 14:38:45 juju-e4d256-prod-github-runner-207 kernel: [33299.507797] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 14:38:45 juju-e4d256-prod-github-runner-207 kernel: [33299.508625] handle_exit+0x98/0x230 [kvm_amd] Aug 22 14:38:45 juju-e4d256-prod-github-runner-207 kernel: [33299.509385] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 14:38:45 juju-e4d256-prod-github-runner-207 kernel: [33299.510174] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 14:38:45 juju-e4d256-prod-github-runner-207 kernel: [33299.511000] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 14:38:45 juju-e4d256-prod-github-runner-207 kernel: [33299.511787] vcpu_run+0x62/0x2c0 [kvm] Aug 22 14:38:45 juju-e4d256-prod-github-runner-207 kernel: [33299.512502] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 14:38:45 juju-e4d256-prod-github-runner-207 kernel: [33299.513235] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 14:38:45 juju-e4d256-prod-github-runner-207 kernel: [33299.514036] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 14:38:45 juju-e4d256-prod-github-runner-207 kernel: [33299.514806] ? __seccomp_filter+0x4a/0x4a0 Aug 22 14:38:45 juju-e4d256-prod-github-runner-207 kernel: [33299.515526] ? __fget_files+0x86/0xc0 Aug 22 14:38:45 juju-e4d256-prod-github-runner-207 kernel: [33299.516217] __x64_sys_ioctl+0x95/0xd0 Aug 22 14:38:45 juju-e4d256-prod-github-runner-207 kernel: [33299.516940] do_syscall_64+0x5c/0xc0 Aug 22 14:38:45 juju-e4d256-prod-github-runner-207 kernel: [33299.517622] ? do_futex+0x162/0x1f0 Aug 22 14:38:45 juju-e4d256-prod-github-runner-207 kernel: [33299.518304] ? __x64_sys_futex+0x78/0x1e0 Aug 22 14:38:45 juju-e4d256-prod-github-runner-207 kernel: [33299.519007] ? __secure_computing+0xa9/0x120 Aug 22 14:38:45 juju-e4d256-prod-github-runner-207 kernel: [33299.519724] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 14:38:45 juju-e4d256-prod-github-runner-207 kernel: [33299.520524] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:38:45 juju-e4d256-prod-github-runner-207 kernel: [33299.521277] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:38:45 juju-e4d256-prod-github-runner-207 kernel: [33299.522026] ? do_syscall_64+0x69/0xc0 Aug 22 14:38:45 juju-e4d256-prod-github-runner-207 kernel: [33299.522719] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:38:45 juju-e4d256-prod-github-runner-207 kernel: [33299.523479] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:38:45 juju-e4d256-prod-github-runner-207 kernel: [33299.524236] ? do_syscall_64+0x69/0xc0 Aug 22 14:38:45 juju-e4d256-prod-github-runner-207 kernel: [33299.524928] ? do_syscall_64+0x69/0xc0 Aug 22 14:38:45 juju-e4d256-prod-github-runner-207 kernel: [33299.525613] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 14:38:45 juju-e4d256-prod-github-runner-207 kernel: [33299.526397] RIP: 0033:0x7faa5d0edaff Aug 22 14:38:45 juju-e4d256-prod-github-runner-207 kernel: [33299.527080] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 14:38:45 juju-e4d256-prod-github-runner-207 kernel: [33299.529185] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 14:38:45 juju-e4d256-prod-github-runner-207 kernel: [33299.530208] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 14:38:45 juju-e4d256-prod-github-runner-207 kernel: [33299.531236] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 14:38:45 juju-e4d256-prod-github-runner-207 kernel: [33299.532211] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 14:38:45 juju-e4d256-prod-github-runner-207 kernel: [33299.533187] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 14:38:45 juju-e4d256-prod-github-runner-207 kernel: [33299.534152] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 14:38:45 juju-e4d256-prod-github-runner-207 kernel: [33299.535084] Aug 22 14:39:10 juju-e4d256-prod-github-runner-207 kernel: [33324.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 30927s! [qemu-system-x86:6715] Aug 22 14:39:10 juju-e4d256-prod-github-runner-207 kernel: [33324.543887] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 14:39:10 juju-e4d256-prod-github-runner-207 kernel: [33324.544191] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 14:39:10 juju-e4d256-prod-github-runner-207 kernel: [33324.561764] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 14:39:10 juju-e4d256-prod-github-runner-207 kernel: [33324.563037] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 14:39:10 juju-e4d256-prod-github-runner-207 kernel: [33324.564260] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:39:10 juju-e4d256-prod-github-runner-207 kernel: [33324.565354] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 14:39:10 juju-e4d256-prod-github-runner-207 kernel: [33324.567927] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 14:39:10 juju-e4d256-prod-github-runner-207 kernel: [33324.568973] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 14:39:10 juju-e4d256-prod-github-runner-207 kernel: [33324.570156] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 14:39:10 juju-e4d256-prod-github-runner-207 kernel: [33324.571315] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 14:39:10 juju-e4d256-prod-github-runner-207 kernel: [33324.572477] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 14:39:10 juju-e4d256-prod-github-runner-207 kernel: [33324.573636] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 14:39:10 juju-e4d256-prod-github-runner-207 kernel: [33324.574816] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 14:39:10 juju-e4d256-prod-github-runner-207 kernel: [33324.576054] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 14:39:10 juju-e4d256-prod-github-runner-207 kernel: [33324.577148] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 14:39:10 juju-e4d256-prod-github-runner-207 kernel: [33324.578758] Call Trace: Aug 22 14:39:10 juju-e4d256-prod-github-runner-207 kernel: [33324.580002] Aug 22 14:39:10 juju-e4d256-prod-github-runner-207 kernel: [33324.581264] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:39:10 juju-e4d256-prod-github-runner-207 kernel: [33324.582820] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:39:10 juju-e4d256-prod-github-runner-207 kernel: [33324.584370] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:39:10 juju-e4d256-prod-github-runner-207 kernel: [33324.585945] ? show_regs.part.0+0x23/0x29 Aug 22 14:39:10 juju-e4d256-prod-github-runner-207 kernel: [33324.587533] ? show_regs.cold+0x8/0xd Aug 22 14:39:10 juju-e4d256-prod-github-runner-207 kernel: [33324.588786] ? watchdog_timer_fn+0x1be/0x220 Aug 22 14:39:10 juju-e4d256-prod-github-runner-207 kernel: [33324.589812] ? lockup_detector_update_enable+0x60/0x60 Aug 22 14:39:10 juju-e4d256-prod-github-runner-207 kernel: [33324.590907] ? __hrtimer_run_queues+0x107/0x230 Aug 22 14:39:10 juju-e4d256-prod-github-runner-207 kernel: [33324.591936] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 14:39:10 juju-e4d256-prod-github-runner-207 kernel: [33324.592962] ? hrtimer_interrupt+0x101/0x220 Aug 22 14:39:10 juju-e4d256-prod-github-runner-207 kernel: [33324.593996] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 14:39:10 juju-e4d256-prod-github-runner-207 kernel: [33324.595068] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 14:39:10 juju-e4d256-prod-github-runner-207 kernel: [33324.596113] Aug 22 14:39:10 juju-e4d256-prod-github-runner-207 kernel: [33324.596967] Aug 22 14:39:10 juju-e4d256-prod-github-runner-207 kernel: [33324.597805] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 14:39:10 juju-e4d256-prod-github-runner-207 kernel: [33324.598871] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:39:10 juju-e4d256-prod-github-runner-207 kernel: [33324.599917] ? _raw_spin_lock+0x22/0x30 Aug 22 14:39:10 juju-e4d256-prod-github-runner-207 kernel: [33324.600875] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:39:10 juju-e4d256-prod-github-runner-207 kernel: [33324.601913] direct_page_fault+0x206/0x310 [kvm] Aug 22 14:39:10 juju-e4d256-prod-github-runner-207 kernel: [33324.602964] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 14:39:10 juju-e4d256-prod-github-runner-207 kernel: [33324.603980] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 14:39:10 juju-e4d256-prod-github-runner-207 kernel: [33324.604983] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 14:39:10 juju-e4d256-prod-github-runner-207 kernel: [33324.606014] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 14:39:10 juju-e4d256-prod-github-runner-207 kernel: [33324.606967] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 14:39:10 juju-e4d256-prod-github-runner-207 kernel: [33324.607947] handle_exit+0x98/0x230 [kvm_amd] Aug 22 14:39:10 juju-e4d256-prod-github-runner-207 kernel: [33324.608846] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 14:39:10 juju-e4d256-prod-github-runner-207 kernel: [33324.609762] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 14:39:10 juju-e4d256-prod-github-runner-207 kernel: [33324.610698] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 14:39:10 juju-e4d256-prod-github-runner-207 kernel: [33324.611606] vcpu_run+0x62/0x2c0 [kvm] Aug 22 14:39:10 juju-e4d256-prod-github-runner-207 kernel: [33324.612420] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 14:39:10 juju-e4d256-prod-github-runner-207 kernel: [33324.613320] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 14:39:10 juju-e4d256-prod-github-runner-207 kernel: [33324.614584] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 14:39:10 juju-e4d256-prod-github-runner-207 kernel: [33324.615671] ? __seccomp_filter+0x4a/0x4a0 Aug 22 14:39:10 juju-e4d256-prod-github-runner-207 kernel: [33324.616874] ? __fget_files+0x86/0xc0 Aug 22 14:39:10 juju-e4d256-prod-github-runner-207 kernel: [33324.617946] __x64_sys_ioctl+0x95/0xd0 Aug 22 14:39:10 juju-e4d256-prod-github-runner-207 kernel: [33324.619083] do_syscall_64+0x5c/0xc0 Aug 22 14:39:10 juju-e4d256-prod-github-runner-207 kernel: [33324.620105] ? do_futex+0x162/0x1f0 Aug 22 14:39:10 juju-e4d256-prod-github-runner-207 kernel: [33324.621058] ? __x64_sys_futex+0x78/0x1e0 Aug 22 14:39:10 juju-e4d256-prod-github-runner-207 kernel: [33324.622056] ? __secure_computing+0xa9/0x120 Aug 22 14:39:10 juju-e4d256-prod-github-runner-207 kernel: [33324.623056] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 14:39:10 juju-e4d256-prod-github-runner-207 kernel: [33324.624086] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:39:10 juju-e4d256-prod-github-runner-207 kernel: [33324.624846] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:39:10 juju-e4d256-prod-github-runner-207 kernel: [33324.625922] ? do_syscall_64+0x69/0xc0 Aug 22 14:39:10 juju-e4d256-prod-github-runner-207 kernel: [33324.626900] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:39:10 juju-e4d256-prod-github-runner-207 kernel: [33324.627938] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:39:10 juju-e4d256-prod-github-runner-207 kernel: [33324.628940] ? do_syscall_64+0x69/0xc0 Aug 22 14:39:10 juju-e4d256-prod-github-runner-207 kernel: [33324.629757] ? do_syscall_64+0x69/0xc0 Aug 22 14:39:10 juju-e4d256-prod-github-runner-207 kernel: [33324.630563] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 14:39:10 juju-e4d256-prod-github-runner-207 kernel: [33324.631312] RIP: 0033:0x7faa5d0edaff Aug 22 14:39:10 juju-e4d256-prod-github-runner-207 kernel: [33324.632024] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 14:39:10 juju-e4d256-prod-github-runner-207 kernel: [33324.634111] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 14:39:10 juju-e4d256-prod-github-runner-207 kernel: [33324.635039] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 14:39:10 juju-e4d256-prod-github-runner-207 kernel: [33324.635942] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 14:39:10 juju-e4d256-prod-github-runner-207 kernel: [33324.636833] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 14:39:10 juju-e4d256-prod-github-runner-207 kernel: [33324.637728] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 14:39:10 juju-e4d256-prod-github-runner-207 kernel: [33324.638645] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 14:39:10 juju-e4d256-prod-github-runner-207 kernel: [33324.639551] Aug 22 14:39:38 juju-e4d256-prod-github-runner-207 kernel: [33352.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 30953s! [qemu-system-x86:6715] Aug 22 14:39:38 juju-e4d256-prod-github-runner-207 kernel: [33352.543103] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 14:39:38 juju-e4d256-prod-github-runner-207 kernel: [33352.543177] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 14:39:38 juju-e4d256-prod-github-runner-207 kernel: [33352.555352] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 14:39:38 juju-e4d256-prod-github-runner-207 kernel: [33352.556616] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 14:39:38 juju-e4d256-prod-github-runner-207 kernel: [33352.557856] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:39:38 juju-e4d256-prod-github-runner-207 kernel: [33352.558914] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 14:39:38 juju-e4d256-prod-github-runner-207 kernel: [33352.561489] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 14:39:38 juju-e4d256-prod-github-runner-207 kernel: [33352.562545] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 14:39:38 juju-e4d256-prod-github-runner-207 kernel: [33352.563707] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 14:39:38 juju-e4d256-prod-github-runner-207 kernel: [33352.564867] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 14:39:38 juju-e4d256-prod-github-runner-207 kernel: [33352.566044] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 14:39:38 juju-e4d256-prod-github-runner-207 kernel: [33352.567210] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 14:39:38 juju-e4d256-prod-github-runner-207 kernel: [33352.568543] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 14:39:38 juju-e4d256-prod-github-runner-207 kernel: [33352.569957] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 14:39:38 juju-e4d256-prod-github-runner-207 kernel: [33352.571089] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 14:39:38 juju-e4d256-prod-github-runner-207 kernel: [33352.572295] Call Trace: Aug 22 14:39:38 juju-e4d256-prod-github-runner-207 kernel: [33352.573343] Aug 22 14:39:38 juju-e4d256-prod-github-runner-207 kernel: [33352.574246] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:39:38 juju-e4d256-prod-github-runner-207 kernel: [33352.575288] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:39:38 juju-e4d256-prod-github-runner-207 kernel: [33352.576306] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:39:38 juju-e4d256-prod-github-runner-207 kernel: [33352.577386] ? show_regs.part.0+0x23/0x29 Aug 22 14:39:38 juju-e4d256-prod-github-runner-207 kernel: [33352.578397] ? show_regs.cold+0x8/0xd Aug 22 14:39:38 juju-e4d256-prod-github-runner-207 kernel: [33352.579367] ? watchdog_timer_fn+0x1be/0x220 Aug 22 14:39:38 juju-e4d256-prod-github-runner-207 kernel: [33352.580372] ? lockup_detector_update_enable+0x60/0x60 Aug 22 14:39:38 juju-e4d256-prod-github-runner-207 kernel: [33352.581431] ? __hrtimer_run_queues+0x107/0x230 Aug 22 14:39:38 juju-e4d256-prod-github-runner-207 kernel: [33352.582606] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 14:39:38 juju-e4d256-prod-github-runner-207 kernel: [33352.583627] ? hrtimer_interrupt+0x101/0x220 Aug 22 14:39:38 juju-e4d256-prod-github-runner-207 kernel: [33352.584642] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 14:39:38 juju-e4d256-prod-github-runner-207 kernel: [33352.585751] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 14:39:38 juju-e4d256-prod-github-runner-207 kernel: [33352.586803] Aug 22 14:39:38 juju-e4d256-prod-github-runner-207 kernel: [33352.587665] Aug 22 14:39:38 juju-e4d256-prod-github-runner-207 kernel: [33352.588502] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 14:39:38 juju-e4d256-prod-github-runner-207 kernel: [33352.589530] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:39:38 juju-e4d256-prod-github-runner-207 kernel: [33352.590599] ? _raw_spin_lock+0x22/0x30 Aug 22 14:39:38 juju-e4d256-prod-github-runner-207 kernel: [33352.591546] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:39:38 juju-e4d256-prod-github-runner-207 kernel: [33352.592561] direct_page_fault+0x206/0x310 [kvm] Aug 22 14:39:38 juju-e4d256-prod-github-runner-207 kernel: [33352.593583] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 14:39:38 juju-e4d256-prod-github-runner-207 kernel: [33352.594609] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 14:39:38 juju-e4d256-prod-github-runner-207 kernel: [33352.595609] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 14:39:38 juju-e4d256-prod-github-runner-207 kernel: [33352.596576] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 14:39:38 juju-e4d256-prod-github-runner-207 kernel: [33352.597520] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 14:39:38 juju-e4d256-prod-github-runner-207 kernel: [33352.598512] handle_exit+0x98/0x230 [kvm_amd] Aug 22 14:39:38 juju-e4d256-prod-github-runner-207 kernel: [33352.599403] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 14:39:38 juju-e4d256-prod-github-runner-207 kernel: [33352.600315] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 14:39:38 juju-e4d256-prod-github-runner-207 kernel: [33352.601248] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 14:39:38 juju-e4d256-prod-github-runner-207 kernel: [33352.602165] vcpu_run+0x62/0x2c0 [kvm] Aug 22 14:39:38 juju-e4d256-prod-github-runner-207 kernel: [33352.602977] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 14:39:38 juju-e4d256-prod-github-runner-207 kernel: [33352.603786] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 14:39:38 juju-e4d256-prod-github-runner-207 kernel: [33352.604889] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 14:39:38 juju-e4d256-prod-github-runner-207 kernel: [33352.605728] ? __seccomp_filter+0x4a/0x4a0 Aug 22 14:39:38 juju-e4d256-prod-github-runner-207 kernel: [33352.606489] ? __fget_files+0x86/0xc0 Aug 22 14:39:38 juju-e4d256-prod-github-runner-207 kernel: [33352.607200] __x64_sys_ioctl+0x95/0xd0 Aug 22 14:39:38 juju-e4d256-prod-github-runner-207 kernel: [33352.607903] do_syscall_64+0x5c/0xc0 Aug 22 14:39:38 juju-e4d256-prod-github-runner-207 kernel: [33352.608603] ? do_futex+0x162/0x1f0 Aug 22 14:39:38 juju-e4d256-prod-github-runner-207 kernel: [33352.609258] ? __x64_sys_futex+0x78/0x1e0 Aug 22 14:39:38 juju-e4d256-prod-github-runner-207 kernel: [33352.609952] ? __secure_computing+0xa9/0x120 Aug 22 14:39:38 juju-e4d256-prod-github-runner-207 kernel: [33352.610874] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 14:39:38 juju-e4d256-prod-github-runner-207 kernel: [33352.612036] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:39:38 juju-e4d256-prod-github-runner-207 kernel: [33352.613111] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:39:38 juju-e4d256-prod-github-runner-207 kernel: [33352.614248] ? do_syscall_64+0x69/0xc0 Aug 22 14:39:38 juju-e4d256-prod-github-runner-207 kernel: [33352.615210] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:39:38 juju-e4d256-prod-github-runner-207 kernel: [33352.616265] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:39:38 juju-e4d256-prod-github-runner-207 kernel: [33352.617342] ? do_syscall_64+0x69/0xc0 Aug 22 14:39:38 juju-e4d256-prod-github-runner-207 kernel: [33352.618508] ? do_syscall_64+0x69/0xc0 Aug 22 14:39:38 juju-e4d256-prod-github-runner-207 kernel: [33352.619391] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 14:39:38 juju-e4d256-prod-github-runner-207 kernel: [33352.620588] RIP: 0033:0x7faa5d0edaff Aug 22 14:39:38 juju-e4d256-prod-github-runner-207 kernel: [33352.621530] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 14:39:38 juju-e4d256-prod-github-runner-207 kernel: [33352.624520] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 14:39:38 juju-e4d256-prod-github-runner-207 kernel: [33352.625439] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 14:39:38 juju-e4d256-prod-github-runner-207 kernel: [33352.626347] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 14:39:38 juju-e4d256-prod-github-runner-207 kernel: [33352.627245] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 14:39:38 juju-e4d256-prod-github-runner-207 kernel: [33352.628136] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 14:39:38 juju-e4d256-prod-github-runner-207 kernel: [33352.629024] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 14:39:38 juju-e4d256-prod-github-runner-207 kernel: [33352.629999] Aug 22 14:40:06 juju-e4d256-prod-github-runner-207 kernel: [33380.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 30980s! [qemu-system-x86:6715] Aug 22 14:40:06 juju-e4d256-prod-github-runner-207 kernel: [33380.543935] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 14:40:06 juju-e4d256-prod-github-runner-207 kernel: [33380.544304] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 14:40:06 juju-e4d256-prod-github-runner-207 kernel: [33380.556474] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 14:40:06 juju-e4d256-prod-github-runner-207 kernel: [33380.557756] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 14:40:06 juju-e4d256-prod-github-runner-207 kernel: [33380.558988] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:40:06 juju-e4d256-prod-github-runner-207 kernel: [33380.560059] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 14:40:06 juju-e4d256-prod-github-runner-207 kernel: [33380.562636] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 14:40:06 juju-e4d256-prod-github-runner-207 kernel: [33380.563700] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 14:40:06 juju-e4d256-prod-github-runner-207 kernel: [33380.564881] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 14:40:06 juju-e4d256-prod-github-runner-207 kernel: [33380.566082] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 14:40:06 juju-e4d256-prod-github-runner-207 kernel: [33380.567247] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 14:40:06 juju-e4d256-prod-github-runner-207 kernel: [33380.568408] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 14:40:06 juju-e4d256-prod-github-runner-207 kernel: [33380.569603] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 14:40:06 juju-e4d256-prod-github-runner-207 kernel: [33380.571028] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 14:40:06 juju-e4d256-prod-github-runner-207 kernel: [33380.572149] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 14:40:06 juju-e4d256-prod-github-runner-207 kernel: [33380.573366] Call Trace: Aug 22 14:40:06 juju-e4d256-prod-github-runner-207 kernel: [33380.574294] Aug 22 14:40:06 juju-e4d256-prod-github-runner-207 kernel: [33380.575216] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:40:06 juju-e4d256-prod-github-runner-207 kernel: [33380.576263] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:40:06 juju-e4d256-prod-github-runner-207 kernel: [33380.577311] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:40:06 juju-e4d256-prod-github-runner-207 kernel: [33380.578415] ? show_regs.part.0+0x23/0x29 Aug 22 14:40:06 juju-e4d256-prod-github-runner-207 kernel: [33380.579424] ? show_regs.cold+0x8/0xd Aug 22 14:40:06 juju-e4d256-prod-github-runner-207 kernel: [33380.580411] ? watchdog_timer_fn+0x1be/0x220 Aug 22 14:40:06 juju-e4d256-prod-github-runner-207 kernel: [33380.581437] ? lockup_detector_update_enable+0x60/0x60 Aug 22 14:40:06 juju-e4d256-prod-github-runner-207 kernel: [33380.582504] ? __hrtimer_run_queues+0x107/0x230 Aug 22 14:40:06 juju-e4d256-prod-github-runner-207 kernel: [33380.583541] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 14:40:06 juju-e4d256-prod-github-runner-207 kernel: [33380.584581] ? hrtimer_interrupt+0x101/0x220 Aug 22 14:40:06 juju-e4d256-prod-github-runner-207 kernel: [33380.585629] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 14:40:06 juju-e4d256-prod-github-runner-207 kernel: [33380.586703] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 14:40:06 juju-e4d256-prod-github-runner-207 kernel: [33380.587749] Aug 22 14:40:06 juju-e4d256-prod-github-runner-207 kernel: [33380.588607] Aug 22 14:40:06 juju-e4d256-prod-github-runner-207 kernel: [33380.589469] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 14:40:06 juju-e4d256-prod-github-runner-207 kernel: [33380.590518] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:40:06 juju-e4d256-prod-github-runner-207 kernel: [33380.591558] ? _raw_spin_lock+0x22/0x30 Aug 22 14:40:06 juju-e4d256-prod-github-runner-207 kernel: [33380.592503] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:40:06 juju-e4d256-prod-github-runner-207 kernel: [33380.593530] direct_page_fault+0x206/0x310 [kvm] Aug 22 14:40:06 juju-e4d256-prod-github-runner-207 kernel: [33380.594563] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 14:40:06 juju-e4d256-prod-github-runner-207 kernel: [33380.595592] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 14:40:06 juju-e4d256-prod-github-runner-207 kernel: [33380.596596] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 14:40:06 juju-e4d256-prod-github-runner-207 kernel: [33380.597616] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 14:40:06 juju-e4d256-prod-github-runner-207 kernel: [33380.598569] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 14:40:06 juju-e4d256-prod-github-runner-207 kernel: [33380.599556] handle_exit+0x98/0x230 [kvm_amd] Aug 22 14:40:06 juju-e4d256-prod-github-runner-207 kernel: [33380.600603] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 14:40:06 juju-e4d256-prod-github-runner-207 kernel: [33380.601592] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 14:40:06 juju-e4d256-prod-github-runner-207 kernel: [33380.604723] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 14:40:06 juju-e4d256-prod-github-runner-207 kernel: [33380.605666] vcpu_run+0x62/0x2c0 [kvm] Aug 22 14:40:06 juju-e4d256-prod-github-runner-207 kernel: [33380.606497] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 14:40:06 juju-e4d256-prod-github-runner-207 kernel: [33380.609471] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 14:40:06 juju-e4d256-prod-github-runner-207 kernel: [33380.610344] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 14:40:06 juju-e4d256-prod-github-runner-207 kernel: [33380.613370] ? __seccomp_filter+0x4a/0x4a0 Aug 22 14:40:06 juju-e4d256-prod-github-runner-207 kernel: [33380.614122] ? __fget_files+0x86/0xc0 Aug 22 14:40:06 juju-e4d256-prod-github-runner-207 kernel: [33380.614837] __x64_sys_ioctl+0x95/0xd0 Aug 22 14:40:06 juju-e4d256-prod-github-runner-207 kernel: [33380.617996] do_syscall_64+0x5c/0xc0 Aug 22 14:40:06 juju-e4d256-prod-github-runner-207 kernel: [33380.618674] ? do_futex+0x162/0x1f0 Aug 22 14:40:06 juju-e4d256-prod-github-runner-207 kernel: [33380.619847] ? __x64_sys_futex+0x78/0x1e0 Aug 22 14:40:06 juju-e4d256-prod-github-runner-207 kernel: [33380.622345] ? __secure_computing+0xa9/0x120 Aug 22 14:40:06 juju-e4d256-prod-github-runner-207 kernel: [33380.623576] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 14:40:06 juju-e4d256-prod-github-runner-207 kernel: [33380.626100] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:40:06 juju-e4d256-prod-github-runner-207 kernel: [33380.628027] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:40:06 juju-e4d256-prod-github-runner-207 kernel: [33380.629979] ? do_syscall_64+0x69/0xc0 Aug 22 14:40:06 juju-e4d256-prod-github-runner-207 kernel: [33380.632689] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:40:06 juju-e4d256-prod-github-runner-207 kernel: [33380.634006] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:40:06 juju-e4d256-prod-github-runner-207 kernel: [33380.636917] ? do_syscall_64+0x69/0xc0 Aug 22 14:40:06 juju-e4d256-prod-github-runner-207 kernel: [33380.637623] ? do_syscall_64+0x69/0xc0 Aug 22 14:40:06 juju-e4d256-prod-github-runner-207 kernel: [33380.639960] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 14:40:06 juju-e4d256-prod-github-runner-207 kernel: [33380.641217] RIP: 0033:0x7faa5d0edaff Aug 22 14:40:06 juju-e4d256-prod-github-runner-207 kernel: [33380.641899] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 14:40:06 juju-e4d256-prod-github-runner-207 kernel: [33380.646321] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 14:40:06 juju-e4d256-prod-github-runner-207 kernel: [33380.649486] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 14:40:06 juju-e4d256-prod-github-runner-207 kernel: [33380.650410] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 14:40:06 juju-e4d256-prod-github-runner-207 kernel: [33380.653566] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 14:40:06 juju-e4d256-prod-github-runner-207 kernel: [33380.654638] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 14:40:06 juju-e4d256-prod-github-runner-207 kernel: [33380.657888] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 14:40:06 juju-e4d256-prod-github-runner-207 kernel: [33380.659885] Aug 22 14:40:34 juju-e4d256-prod-github-runner-207 kernel: [33408.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 31006s! [qemu-system-x86:6715] Aug 22 14:40:34 juju-e4d256-prod-github-runner-207 kernel: [33408.543116] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 14:40:34 juju-e4d256-prod-github-runner-207 kernel: [33408.543188] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 14:40:34 juju-e4d256-prod-github-runner-207 kernel: [33408.555616] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 14:40:34 juju-e4d256-prod-github-runner-207 kernel: [33408.556881] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 14:40:34 juju-e4d256-prod-github-runner-207 kernel: [33408.558141] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:40:34 juju-e4d256-prod-github-runner-207 kernel: [33408.559208] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 14:40:34 juju-e4d256-prod-github-runner-207 kernel: [33408.561767] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 14:40:34 juju-e4d256-prod-github-runner-207 kernel: [33408.562808] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 14:40:34 juju-e4d256-prod-github-runner-207 kernel: [33408.563970] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 14:40:34 juju-e4d256-prod-github-runner-207 kernel: [33408.565139] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 14:40:34 juju-e4d256-prod-github-runner-207 kernel: [33408.566304] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 14:40:34 juju-e4d256-prod-github-runner-207 kernel: [33408.567472] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 14:40:34 juju-e4d256-prod-github-runner-207 kernel: [33408.568651] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 14:40:34 juju-e4d256-prod-github-runner-207 kernel: [33408.569893] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 14:40:34 juju-e4d256-prod-github-runner-207 kernel: [33408.570993] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 14:40:34 juju-e4d256-prod-github-runner-207 kernel: [33408.572187] Call Trace: Aug 22 14:40:34 juju-e4d256-prod-github-runner-207 kernel: [33408.573116] Aug 22 14:40:34 juju-e4d256-prod-github-runner-207 kernel: [33408.573999] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:40:34 juju-e4d256-prod-github-runner-207 kernel: [33408.575026] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:40:34 juju-e4d256-prod-github-runner-207 kernel: [33408.576043] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:40:34 juju-e4d256-prod-github-runner-207 kernel: [33408.577124] ? show_regs.part.0+0x23/0x29 Aug 22 14:40:34 juju-e4d256-prod-github-runner-207 kernel: [33408.578125] ? show_regs.cold+0x8/0xd Aug 22 14:40:34 juju-e4d256-prod-github-runner-207 kernel: [33408.579093] ? watchdog_timer_fn+0x1be/0x220 Aug 22 14:40:34 juju-e4d256-prod-github-runner-207 kernel: [33408.580099] ? lockup_detector_update_enable+0x60/0x60 Aug 22 14:40:34 juju-e4d256-prod-github-runner-207 kernel: [33408.581173] ? __hrtimer_run_queues+0x107/0x230 Aug 22 14:40:34 juju-e4d256-prod-github-runner-207 kernel: [33408.582198] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 14:40:34 juju-e4d256-prod-github-runner-207 kernel: [33408.583407] ? hrtimer_interrupt+0x101/0x220 Aug 22 14:40:34 juju-e4d256-prod-github-runner-207 kernel: [33408.584419] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 14:40:34 juju-e4d256-prod-github-runner-207 kernel: [33408.585496] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 14:40:34 juju-e4d256-prod-github-runner-207 kernel: [33408.586545] Aug 22 14:40:34 juju-e4d256-prod-github-runner-207 kernel: [33408.587395] Aug 22 14:40:34 juju-e4d256-prod-github-runner-207 kernel: [33408.588229] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 14:40:34 juju-e4d256-prod-github-runner-207 kernel: [33408.589278] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:40:34 juju-e4d256-prod-github-runner-207 kernel: [33408.590339] ? _raw_spin_lock+0x22/0x30 Aug 22 14:40:34 juju-e4d256-prod-github-runner-207 kernel: [33408.591289] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:40:34 juju-e4d256-prod-github-runner-207 kernel: [33408.592315] direct_page_fault+0x206/0x310 [kvm] Aug 22 14:40:34 juju-e4d256-prod-github-runner-207 kernel: [33408.593358] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 14:40:34 juju-e4d256-prod-github-runner-207 kernel: [33408.594381] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 14:40:34 juju-e4d256-prod-github-runner-207 kernel: [33408.595392] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 14:40:34 juju-e4d256-prod-github-runner-207 kernel: [33408.596363] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 14:40:34 juju-e4d256-prod-github-runner-207 kernel: [33408.597328] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 14:40:34 juju-e4d256-prod-github-runner-207 kernel: [33408.598319] handle_exit+0x98/0x230 [kvm_amd] Aug 22 14:40:34 juju-e4d256-prod-github-runner-207 kernel: [33408.599227] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 14:40:34 juju-e4d256-prod-github-runner-207 kernel: [33408.600152] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 14:40:34 juju-e4d256-prod-github-runner-207 kernel: [33408.601104] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 14:40:34 juju-e4d256-prod-github-runner-207 kernel: [33408.602020] vcpu_run+0x62/0x2c0 [kvm] Aug 22 14:40:34 juju-e4d256-prod-github-runner-207 kernel: [33408.602844] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 14:40:34 juju-e4d256-prod-github-runner-207 kernel: [33408.603665] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 14:40:34 juju-e4d256-prod-github-runner-207 kernel: [33408.604534] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 14:40:34 juju-e4d256-prod-github-runner-207 kernel: [33408.605367] ? __seccomp_filter+0x4a/0x4a0 Aug 22 14:40:34 juju-e4d256-prod-github-runner-207 kernel: [33408.606140] ? __fget_files+0x86/0xc0 Aug 22 14:40:34 juju-e4d256-prod-github-runner-207 kernel: [33408.606882] __x64_sys_ioctl+0x95/0xd0 Aug 22 14:40:34 juju-e4d256-prod-github-runner-207 kernel: [33408.607586] do_syscall_64+0x5c/0xc0 Aug 22 14:40:34 juju-e4d256-prod-github-runner-207 kernel: [33408.608263] ? do_futex+0x162/0x1f0 Aug 22 14:40:34 juju-e4d256-prod-github-runner-207 kernel: [33408.608938] ? __x64_sys_futex+0x78/0x1e0 Aug 22 14:40:34 juju-e4d256-prod-github-runner-207 kernel: [33408.609625] ? __secure_computing+0xa9/0x120 Aug 22 14:40:34 juju-e4d256-prod-github-runner-207 kernel: [33408.610325] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 14:40:34 juju-e4d256-prod-github-runner-207 kernel: [33408.611099] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:40:34 juju-e4d256-prod-github-runner-207 kernel: [33408.611838] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:40:34 juju-e4d256-prod-github-runner-207 kernel: [33408.612572] ? do_syscall_64+0x69/0xc0 Aug 22 14:40:34 juju-e4d256-prod-github-runner-207 kernel: [33408.613233] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:40:34 juju-e4d256-prod-github-runner-207 kernel: [33408.613949] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:40:34 juju-e4d256-prod-github-runner-207 kernel: [33408.614661] ? do_syscall_64+0x69/0xc0 Aug 22 14:40:34 juju-e4d256-prod-github-runner-207 kernel: [33408.615293] ? do_syscall_64+0x69/0xc0 Aug 22 14:40:34 juju-e4d256-prod-github-runner-207 kernel: [33408.615931] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 14:40:34 juju-e4d256-prod-github-runner-207 kernel: [33408.616650] RIP: 0033:0x7faa5d0edaff Aug 22 14:40:34 juju-e4d256-prod-github-runner-207 kernel: [33408.617314] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 14:40:34 juju-e4d256-prod-github-runner-207 kernel: [33408.619350] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 14:40:34 juju-e4d256-prod-github-runner-207 kernel: [33408.620285] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 14:40:34 juju-e4d256-prod-github-runner-207 kernel: [33408.621209] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 14:40:34 juju-e4d256-prod-github-runner-207 kernel: [33408.622121] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 14:40:34 juju-e4d256-prod-github-runner-207 kernel: [33408.623029] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 14:40:34 juju-e4d256-prod-github-runner-207 kernel: [33408.623934] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 14:40:34 juju-e4d256-prod-github-runner-207 kernel: [33408.624851] Aug 22 14:41:02 juju-e4d256-prod-github-runner-207 kernel: [33436.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 31032s! [qemu-system-x86:6715] Aug 22 14:41:02 juju-e4d256-prod-github-runner-207 kernel: [33436.543138] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 14:41:02 juju-e4d256-prod-github-runner-207 kernel: [33436.543214] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 14:41:02 juju-e4d256-prod-github-runner-207 kernel: [33436.555563] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 14:41:02 juju-e4d256-prod-github-runner-207 kernel: [33436.556879] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 14:41:02 juju-e4d256-prod-github-runner-207 kernel: [33436.558106] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:41:02 juju-e4d256-prod-github-runner-207 kernel: [33436.559177] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 14:41:02 juju-e4d256-prod-github-runner-207 kernel: [33436.561727] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 14:41:02 juju-e4d256-prod-github-runner-207 kernel: [33436.562781] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 14:41:02 juju-e4d256-prod-github-runner-207 kernel: [33436.563975] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 14:41:02 juju-e4d256-prod-github-runner-207 kernel: [33436.565163] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 14:41:02 juju-e4d256-prod-github-runner-207 kernel: [33436.566331] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 14:41:02 juju-e4d256-prod-github-runner-207 kernel: [33436.567511] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 14:41:02 juju-e4d256-prod-github-runner-207 kernel: [33436.568708] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 14:41:02 juju-e4d256-prod-github-runner-207 kernel: [33436.569953] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 14:41:02 juju-e4d256-prod-github-runner-207 kernel: [33436.571057] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 14:41:02 juju-e4d256-prod-github-runner-207 kernel: [33436.572249] Call Trace: Aug 22 14:41:02 juju-e4d256-prod-github-runner-207 kernel: [33436.573182] Aug 22 14:41:02 juju-e4d256-prod-github-runner-207 kernel: [33436.574067] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:41:02 juju-e4d256-prod-github-runner-207 kernel: [33436.575111] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:41:02 juju-e4d256-prod-github-runner-207 kernel: [33436.576144] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:41:02 juju-e4d256-prod-github-runner-207 kernel: [33436.577249] ? show_regs.part.0+0x23/0x29 Aug 22 14:41:02 juju-e4d256-prod-github-runner-207 kernel: [33436.578259] ? show_regs.cold+0x8/0xd Aug 22 14:41:02 juju-e4d256-prod-github-runner-207 kernel: [33436.579234] ? watchdog_timer_fn+0x1be/0x220 Aug 22 14:41:02 juju-e4d256-prod-github-runner-207 kernel: [33436.580245] ? lockup_detector_update_enable+0x60/0x60 Aug 22 14:41:02 juju-e4d256-prod-github-runner-207 kernel: [33436.581320] ? __hrtimer_run_queues+0x107/0x230 Aug 22 14:41:02 juju-e4d256-prod-github-runner-207 kernel: [33436.582349] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 14:41:02 juju-e4d256-prod-github-runner-207 kernel: [33436.583373] ? hrtimer_interrupt+0x101/0x220 Aug 22 14:41:02 juju-e4d256-prod-github-runner-207 kernel: [33436.584407] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 14:41:02 juju-e4d256-prod-github-runner-207 kernel: [33436.585544] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 14:41:02 juju-e4d256-prod-github-runner-207 kernel: [33436.586596] Aug 22 14:41:02 juju-e4d256-prod-github-runner-207 kernel: [33436.587450] Aug 22 14:41:02 juju-e4d256-prod-github-runner-207 kernel: [33436.588316] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 14:41:02 juju-e4d256-prod-github-runner-207 kernel: [33436.589408] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:41:02 juju-e4d256-prod-github-runner-207 kernel: [33436.590453] ? _raw_spin_lock+0x22/0x30 Aug 22 14:41:02 juju-e4d256-prod-github-runner-207 kernel: [33436.591400] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:41:02 juju-e4d256-prod-github-runner-207 kernel: [33436.592419] direct_page_fault+0x206/0x310 [kvm] Aug 22 14:41:02 juju-e4d256-prod-github-runner-207 kernel: [33436.593462] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 14:41:02 juju-e4d256-prod-github-runner-207 kernel: [33436.594471] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 14:41:02 juju-e4d256-prod-github-runner-207 kernel: [33436.595473] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 14:41:02 juju-e4d256-prod-github-runner-207 kernel: [33436.596448] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 14:41:02 juju-e4d256-prod-github-runner-207 kernel: [33436.597415] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 14:41:02 juju-e4d256-prod-github-runner-207 kernel: [33436.598403] handle_exit+0x98/0x230 [kvm_amd] Aug 22 14:41:02 juju-e4d256-prod-github-runner-207 kernel: [33436.599299] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 14:41:02 juju-e4d256-prod-github-runner-207 kernel: [33436.600211] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 14:41:02 juju-e4d256-prod-github-runner-207 kernel: [33436.601169] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 14:41:02 juju-e4d256-prod-github-runner-207 kernel: [33436.602075] vcpu_run+0x62/0x2c0 [kvm] Aug 22 14:41:02 juju-e4d256-prod-github-runner-207 kernel: [33436.602887] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 14:41:02 juju-e4d256-prod-github-runner-207 kernel: [33436.603721] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 14:41:02 juju-e4d256-prod-github-runner-207 kernel: [33436.604627] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 14:41:02 juju-e4d256-prod-github-runner-207 kernel: [33436.605467] ? __seccomp_filter+0x4a/0x4a0 Aug 22 14:41:02 juju-e4d256-prod-github-runner-207 kernel: [33436.606230] ? __fget_files+0x86/0xc0 Aug 22 14:41:02 juju-e4d256-prod-github-runner-207 kernel: [33436.606940] __x64_sys_ioctl+0x95/0xd0 Aug 22 14:41:02 juju-e4d256-prod-github-runner-207 kernel: [33436.607629] do_syscall_64+0x5c/0xc0 Aug 22 14:41:02 juju-e4d256-prod-github-runner-207 kernel: [33436.608296] ? do_futex+0x162/0x1f0 Aug 22 14:41:02 juju-e4d256-prod-github-runner-207 kernel: [33436.608964] ? __x64_sys_futex+0x78/0x1e0 Aug 22 14:41:02 juju-e4d256-prod-github-runner-207 kernel: [33436.609641] ? __secure_computing+0xa9/0x120 Aug 22 14:41:02 juju-e4d256-prod-github-runner-207 kernel: [33436.610338] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 14:41:02 juju-e4d256-prod-github-runner-207 kernel: [33436.611109] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:41:02 juju-e4d256-prod-github-runner-207 kernel: [33436.611837] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:41:02 juju-e4d256-prod-github-runner-207 kernel: [33436.612553] ? do_syscall_64+0x69/0xc0 Aug 22 14:41:02 juju-e4d256-prod-github-runner-207 kernel: [33436.613208] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:41:02 juju-e4d256-prod-github-runner-207 kernel: [33436.613915] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:41:02 juju-e4d256-prod-github-runner-207 kernel: [33436.614609] ? do_syscall_64+0x69/0xc0 Aug 22 14:41:02 juju-e4d256-prod-github-runner-207 kernel: [33436.615231] ? do_syscall_64+0x69/0xc0 Aug 22 14:41:02 juju-e4d256-prod-github-runner-207 kernel: [33436.615858] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 14:41:02 juju-e4d256-prod-github-runner-207 kernel: [33436.616579] RIP: 0033:0x7faa5d0edaff Aug 22 14:41:02 juju-e4d256-prod-github-runner-207 kernel: [33436.617220] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 14:41:02 juju-e4d256-prod-github-runner-207 kernel: [33436.619218] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 14:41:02 juju-e4d256-prod-github-runner-207 kernel: [33436.620125] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 14:41:02 juju-e4d256-prod-github-runner-207 kernel: [33436.621021] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 14:41:02 juju-e4d256-prod-github-runner-207 kernel: [33436.621908] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 14:41:02 juju-e4d256-prod-github-runner-207 kernel: [33436.622797] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 14:41:02 juju-e4d256-prod-github-runner-207 kernel: [33436.623682] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 14:41:02 juju-e4d256-prod-github-runner-207 kernel: [33436.624580] Aug 22 14:41:30 juju-e4d256-prod-github-runner-207 kernel: [33464.541976] watchdog: BUG: soft lockup - CPU#1 stuck for 31058s! [qemu-system-x86:6715] Aug 22 14:41:30 juju-e4d256-prod-github-runner-207 kernel: [33464.543889] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 14:41:30 juju-e4d256-prod-github-runner-207 kernel: [33464.544193] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 14:41:30 juju-e4d256-prod-github-runner-207 kernel: [33464.556318] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 14:41:30 juju-e4d256-prod-github-runner-207 kernel: [33464.557591] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 14:41:30 juju-e4d256-prod-github-runner-207 kernel: [33464.558810] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:41:30 juju-e4d256-prod-github-runner-207 kernel: [33464.559873] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 14:41:30 juju-e4d256-prod-github-runner-207 kernel: [33464.562439] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 14:41:30 juju-e4d256-prod-github-runner-207 kernel: [33464.563479] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 14:41:30 juju-e4d256-prod-github-runner-207 kernel: [33464.564661] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 14:41:30 juju-e4d256-prod-github-runner-207 kernel: [33464.565820] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 14:41:30 juju-e4d256-prod-github-runner-207 kernel: [33464.567021] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 14:41:30 juju-e4d256-prod-github-runner-207 kernel: [33464.568184] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 14:41:30 juju-e4d256-prod-github-runner-207 kernel: [33464.569376] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 14:41:30 juju-e4d256-prod-github-runner-207 kernel: [33464.570654] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 14:41:30 juju-e4d256-prod-github-runner-207 kernel: [33464.571752] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 14:41:30 juju-e4d256-prod-github-runner-207 kernel: [33464.572969] Call Trace: Aug 22 14:41:30 juju-e4d256-prod-github-runner-207 kernel: [33464.573880] Aug 22 14:41:30 juju-e4d256-prod-github-runner-207 kernel: [33464.574778] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:41:30 juju-e4d256-prod-github-runner-207 kernel: [33464.575812] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:41:30 juju-e4d256-prod-github-runner-207 kernel: [33464.576844] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:41:30 juju-e4d256-prod-github-runner-207 kernel: [33464.577935] ? show_regs.part.0+0x23/0x29 Aug 22 14:41:30 juju-e4d256-prod-github-runner-207 kernel: [33464.578934] ? show_regs.cold+0x8/0xd Aug 22 14:41:30 juju-e4d256-prod-github-runner-207 kernel: [33464.579903] ? watchdog_timer_fn+0x1be/0x220 Aug 22 14:41:30 juju-e4d256-prod-github-runner-207 kernel: [33464.580920] ? lockup_detector_update_enable+0x60/0x60 Aug 22 14:41:30 juju-e4d256-prod-github-runner-207 kernel: [33464.581987] ? __hrtimer_run_queues+0x107/0x230 Aug 22 14:41:30 juju-e4d256-prod-github-runner-207 kernel: [33464.583021] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 14:41:30 juju-e4d256-prod-github-runner-207 kernel: [33464.584053] ? hrtimer_interrupt+0x101/0x220 Aug 22 14:41:30 juju-e4d256-prod-github-runner-207 kernel: [33464.585088] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 14:41:30 juju-e4d256-prod-github-runner-207 kernel: [33464.586159] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 14:41:30 juju-e4d256-prod-github-runner-207 kernel: [33464.587349] Aug 22 14:41:30 juju-e4d256-prod-github-runner-207 kernel: [33464.588204] Aug 22 14:41:30 juju-e4d256-prod-github-runner-207 kernel: [33464.589051] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 14:41:30 juju-e4d256-prod-github-runner-207 kernel: [33464.590081] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:41:30 juju-e4d256-prod-github-runner-207 kernel: [33464.591124] ? _raw_spin_lock+0x22/0x30 Aug 22 14:41:30 juju-e4d256-prod-github-runner-207 kernel: [33464.592068] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:41:30 juju-e4d256-prod-github-runner-207 kernel: [33464.593125] direct_page_fault+0x206/0x310 [kvm] Aug 22 14:41:30 juju-e4d256-prod-github-runner-207 kernel: [33464.594154] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 14:41:30 juju-e4d256-prod-github-runner-207 kernel: [33464.595161] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 14:41:30 juju-e4d256-prod-github-runner-207 kernel: [33464.596160] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 14:41:30 juju-e4d256-prod-github-runner-207 kernel: [33464.597184] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 14:41:30 juju-e4d256-prod-github-runner-207 kernel: [33464.598136] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 14:41:30 juju-e4d256-prod-github-runner-207 kernel: [33464.599113] handle_exit+0x98/0x230 [kvm_amd] Aug 22 14:41:30 juju-e4d256-prod-github-runner-207 kernel: [33464.600003] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 14:41:30 juju-e4d256-prod-github-runner-207 kernel: [33464.600946] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 14:41:30 juju-e4d256-prod-github-runner-207 kernel: [33464.601869] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 14:41:30 juju-e4d256-prod-github-runner-207 kernel: [33464.602775] vcpu_run+0x62/0x2c0 [kvm] Aug 22 14:41:30 juju-e4d256-prod-github-runner-207 kernel: [33464.603589] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 14:41:30 juju-e4d256-prod-github-runner-207 kernel: [33464.604410] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 14:41:30 juju-e4d256-prod-github-runner-207 kernel: [33464.605262] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 14:41:30 juju-e4d256-prod-github-runner-207 kernel: [33464.606057] ? __seccomp_filter+0x4a/0x4a0 Aug 22 14:41:30 juju-e4d256-prod-github-runner-207 kernel: [33464.606800] ? __fget_files+0x86/0xc0 Aug 22 14:41:30 juju-e4d256-prod-github-runner-207 kernel: [33464.607504] __x64_sys_ioctl+0x95/0xd0 Aug 22 14:41:30 juju-e4d256-prod-github-runner-207 kernel: [33464.608194] do_syscall_64+0x5c/0xc0 Aug 22 14:41:30 juju-e4d256-prod-github-runner-207 kernel: [33464.608874] ? do_futex+0x162/0x1f0 Aug 22 14:41:30 juju-e4d256-prod-github-runner-207 kernel: [33464.609539] ? __x64_sys_futex+0x78/0x1e0 Aug 22 14:41:30 juju-e4d256-prod-github-runner-207 kernel: [33464.610219] ? __secure_computing+0xa9/0x120 Aug 22 14:41:30 juju-e4d256-prod-github-runner-207 kernel: [33464.610911] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 14:41:30 juju-e4d256-prod-github-runner-207 kernel: [33464.611674] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:41:30 juju-e4d256-prod-github-runner-207 kernel: [33464.612415] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:41:30 juju-e4d256-prod-github-runner-207 kernel: [33464.613133] ? do_syscall_64+0x69/0xc0 Aug 22 14:41:30 juju-e4d256-prod-github-runner-207 kernel: [33464.613783] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:41:30 juju-e4d256-prod-github-runner-207 kernel: [33464.614485] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:41:30 juju-e4d256-prod-github-runner-207 kernel: [33464.615180] ? do_syscall_64+0x69/0xc0 Aug 22 14:41:30 juju-e4d256-prod-github-runner-207 kernel: [33464.615804] ? do_syscall_64+0x69/0xc0 Aug 22 14:41:30 juju-e4d256-prod-github-runner-207 kernel: [33464.616446] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 14:41:30 juju-e4d256-prod-github-runner-207 kernel: [33464.617150] RIP: 0033:0x7faa5d0edaff Aug 22 14:41:30 juju-e4d256-prod-github-runner-207 kernel: [33464.617797] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 14:41:30 juju-e4d256-prod-github-runner-207 kernel: [33464.619779] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 14:41:30 juju-e4d256-prod-github-runner-207 kernel: [33464.620707] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 14:41:30 juju-e4d256-prod-github-runner-207 kernel: [33464.621594] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 14:41:30 juju-e4d256-prod-github-runner-207 kernel: [33464.622481] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 14:41:30 juju-e4d256-prod-github-runner-207 kernel: [33464.623372] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 14:41:30 juju-e4d256-prod-github-runner-207 kernel: [33464.624288] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 14:41:30 juju-e4d256-prod-github-runner-207 kernel: [33464.625182] Aug 22 14:41:45 juju-e4d256-prod-github-runner-207 kernel: [33479.420707] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 14:41:45 juju-e4d256-prod-github-runner-207 kernel: [33479.421675] rcu: 1-....: (8314433 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=4016564 Aug 22 14:41:45 juju-e4d256-prod-github-runner-207 kernel: [33479.422791] (t=8340555 jiffies g=23269 q=35954) Aug 22 14:41:45 juju-e4d256-prod-github-runner-207 kernel: [33479.423577] NMI backtrace for cpu 1 Aug 22 14:41:45 juju-e4d256-prod-github-runner-207 kernel: [33479.424302] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 14:41:45 juju-e4d256-prod-github-runner-207 kernel: [33479.425444] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 14:41:45 juju-e4d256-prod-github-runner-207 kernel: [33479.426519] Call Trace: Aug 22 14:41:45 juju-e4d256-prod-github-runner-207 kernel: [33479.427210] Aug 22 14:41:45 juju-e4d256-prod-github-runner-207 kernel: [33479.427855] show_stack+0x52/0x5c Aug 22 14:41:45 juju-e4d256-prod-github-runner-207 kernel: [33479.428607] dump_stack_lvl+0x4a/0x63 Aug 22 14:41:45 juju-e4d256-prod-github-runner-207 kernel: [33479.429353] dump_stack+0x10/0x16 Aug 22 14:41:45 juju-e4d256-prod-github-runner-207 kernel: [33479.430210] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 14:41:45 juju-e4d256-prod-github-runner-207 kernel: [33479.430988] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 14:41:45 juju-e4d256-prod-github-runner-207 kernel: [33479.431764] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 14:41:45 juju-e4d256-prod-github-runner-207 kernel: [33479.432619] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 14:41:45 juju-e4d256-prod-github-runner-207 kernel: [33479.433443] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 14:41:45 juju-e4d256-prod-github-runner-207 kernel: [33479.434250] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 14:41:45 juju-e4d256-prod-github-runner-207 kernel: [33479.435281] print_cpu_stall.cold+0x2f/0xe2 Aug 22 14:41:45 juju-e4d256-prod-github-runner-207 kernel: [33479.436108] ? timekeeping_update+0xf7/0x150 Aug 22 14:41:45 juju-e4d256-prod-github-runner-207 kernel: [33479.436891] check_cpu_stall+0x109/0x270 Aug 22 14:41:45 juju-e4d256-prod-github-runner-207 kernel: [33479.437642] rcu_sched_clock_irq+0x9a/0x250 Aug 22 14:41:45 juju-e4d256-prod-github-runner-207 kernel: [33479.438410] update_process_times+0x94/0xd0 Aug 22 14:41:45 juju-e4d256-prod-github-runner-207 kernel: [33479.439188] tick_sched_handle+0x29/0x70 Aug 22 14:41:45 juju-e4d256-prod-github-runner-207 kernel: [33479.439930] tick_sched_timer+0x8c/0xc0 Aug 22 14:41:45 juju-e4d256-prod-github-runner-207 kernel: [33479.440680] ? tick_nohz_handler+0xb0/0xb0 Aug 22 14:41:45 juju-e4d256-prod-github-runner-207 kernel: [33479.441438] __hrtimer_run_queues+0x107/0x230 Aug 22 14:41:45 juju-e4d256-prod-github-runner-207 kernel: [33479.442208] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 14:41:45 juju-e4d256-prod-github-runner-207 kernel: [33479.442980] hrtimer_interrupt+0x101/0x220 Aug 22 14:41:45 juju-e4d256-prod-github-runner-207 kernel: [33479.443736] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 14:41:45 juju-e4d256-prod-github-runner-207 kernel: [33479.444554] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 14:41:45 juju-e4d256-prod-github-runner-207 kernel: [33479.445380] Aug 22 14:41:45 juju-e4d256-prod-github-runner-207 kernel: [33479.446041] Aug 22 14:41:45 juju-e4d256-prod-github-runner-207 kernel: [33479.446688] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 14:41:45 juju-e4d256-prod-github-runner-207 kernel: [33479.447508] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:41:45 juju-e4d256-prod-github-runner-207 kernel: [33479.448413] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 14:41:45 juju-e4d256-prod-github-runner-207 kernel: [33479.450639] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 14:41:45 juju-e4d256-prod-github-runner-207 kernel: [33479.451542] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 14:41:45 juju-e4d256-prod-github-runner-207 kernel: [33479.452557] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 14:41:45 juju-e4d256-prod-github-runner-207 kernel: [33479.453539] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 14:41:45 juju-e4d256-prod-github-runner-207 kernel: [33479.454509] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 14:41:45 juju-e4d256-prod-github-runner-207 kernel: [33479.455472] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 14:41:45 juju-e4d256-prod-github-runner-207 kernel: [33479.456459] ? _raw_spin_lock+0x22/0x30 Aug 22 14:41:45 juju-e4d256-prod-github-runner-207 kernel: [33479.457238] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:41:45 juju-e4d256-prod-github-runner-207 kernel: [33479.458073] direct_page_fault+0x206/0x310 [kvm] Aug 22 14:41:45 juju-e4d256-prod-github-runner-207 kernel: [33479.458908] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 14:41:45 juju-e4d256-prod-github-runner-207 kernel: [33479.459733] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 14:41:45 juju-e4d256-prod-github-runner-207 kernel: [33479.460570] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 14:41:45 juju-e4d256-prod-github-runner-207 kernel: [33479.461380] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 14:41:45 juju-e4d256-prod-github-runner-207 kernel: [33479.462167] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 14:41:45 juju-e4d256-prod-github-runner-207 kernel: [33479.462994] handle_exit+0x98/0x230 [kvm_amd] Aug 22 14:41:45 juju-e4d256-prod-github-runner-207 kernel: [33479.463805] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 14:41:45 juju-e4d256-prod-github-runner-207 kernel: [33479.464648] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 14:41:45 juju-e4d256-prod-github-runner-207 kernel: [33479.465454] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 14:41:45 juju-e4d256-prod-github-runner-207 kernel: [33479.466251] vcpu_run+0x62/0x2c0 [kvm] Aug 22 14:41:45 juju-e4d256-prod-github-runner-207 kernel: [33479.466995] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 14:41:45 juju-e4d256-prod-github-runner-207 kernel: [33479.467740] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 14:41:45 juju-e4d256-prod-github-runner-207 kernel: [33479.468561] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 14:41:45 juju-e4d256-prod-github-runner-207 kernel: [33479.469326] ? __seccomp_filter+0x4a/0x4a0 Aug 22 14:41:45 juju-e4d256-prod-github-runner-207 kernel: [33479.470047] ? __fget_files+0x86/0xc0 Aug 22 14:41:45 juju-e4d256-prod-github-runner-207 kernel: [33479.470742] __x64_sys_ioctl+0x95/0xd0 Aug 22 14:41:45 juju-e4d256-prod-github-runner-207 kernel: [33479.471443] do_syscall_64+0x5c/0xc0 Aug 22 14:41:45 juju-e4d256-prod-github-runner-207 kernel: [33479.472161] ? do_futex+0x162/0x1f0 Aug 22 14:41:45 juju-e4d256-prod-github-runner-207 kernel: [33479.472836] ? __x64_sys_futex+0x78/0x1e0 Aug 22 14:41:45 juju-e4d256-prod-github-runner-207 kernel: [33479.473537] ? __secure_computing+0xa9/0x120 Aug 22 14:41:45 juju-e4d256-prod-github-runner-207 kernel: [33479.474261] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 14:41:45 juju-e4d256-prod-github-runner-207 kernel: [33479.475052] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:41:45 juju-e4d256-prod-github-runner-207 kernel: [33479.475809] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:41:45 juju-e4d256-prod-github-runner-207 kernel: [33479.476572] ? do_syscall_64+0x69/0xc0 Aug 22 14:41:45 juju-e4d256-prod-github-runner-207 kernel: [33479.477285] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:41:45 juju-e4d256-prod-github-runner-207 kernel: [33479.478042] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:41:45 juju-e4d256-prod-github-runner-207 kernel: [33479.478797] ? do_syscall_64+0x69/0xc0 Aug 22 14:41:45 juju-e4d256-prod-github-runner-207 kernel: [33479.479490] ? do_syscall_64+0x69/0xc0 Aug 22 14:41:45 juju-e4d256-prod-github-runner-207 kernel: [33479.480188] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 14:41:45 juju-e4d256-prod-github-runner-207 kernel: [33479.480958] RIP: 0033:0x7faa5d0edaff Aug 22 14:41:45 juju-e4d256-prod-github-runner-207 kernel: [33479.481639] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 14:41:45 juju-e4d256-prod-github-runner-207 kernel: [33479.483748] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 14:41:45 juju-e4d256-prod-github-runner-207 kernel: [33479.484755] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 14:41:45 juju-e4d256-prod-github-runner-207 kernel: [33479.485698] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 14:41:45 juju-e4d256-prod-github-runner-207 kernel: [33479.486654] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 14:41:45 juju-e4d256-prod-github-runner-207 kernel: [33479.487610] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 14:41:45 juju-e4d256-prod-github-runner-207 kernel: [33479.488600] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 14:41:45 juju-e4d256-prod-github-runner-207 kernel: [33479.489512] Aug 22 14:42:10 juju-e4d256-prod-github-runner-207 kernel: [33504.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 31095s! [qemu-system-x86:6715] Aug 22 14:42:10 juju-e4d256-prod-github-runner-207 kernel: [33504.543117] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 14:42:10 juju-e4d256-prod-github-runner-207 kernel: [33504.543192] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 14:42:10 juju-e4d256-prod-github-runner-207 kernel: [33504.555766] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 14:42:10 juju-e4d256-prod-github-runner-207 kernel: [33504.557036] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 14:42:10 juju-e4d256-prod-github-runner-207 kernel: [33504.558290] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:42:10 juju-e4d256-prod-github-runner-207 kernel: [33504.559366] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 14:42:10 juju-e4d256-prod-github-runner-207 kernel: [33504.561993] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 14:42:10 juju-e4d256-prod-github-runner-207 kernel: [33504.563062] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 14:42:10 juju-e4d256-prod-github-runner-207 kernel: [33504.564259] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 14:42:10 juju-e4d256-prod-github-runner-207 kernel: [33504.565451] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 14:42:10 juju-e4d256-prod-github-runner-207 kernel: [33504.567200] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 14:42:10 juju-e4d256-prod-github-runner-207 kernel: [33504.568387] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 14:42:10 juju-e4d256-prod-github-runner-207 kernel: [33504.569945] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 14:42:10 juju-e4d256-prod-github-runner-207 kernel: [33504.571222] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 14:42:10 juju-e4d256-prod-github-runner-207 kernel: [33504.572372] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 14:42:10 juju-e4d256-prod-github-runner-207 kernel: [33504.573695] Call Trace: Aug 22 14:42:10 juju-e4d256-prod-github-runner-207 kernel: [33504.574628] Aug 22 14:42:10 juju-e4d256-prod-github-runner-207 kernel: [33504.575582] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:42:10 juju-e4d256-prod-github-runner-207 kernel: [33504.576763] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:42:10 juju-e4d256-prod-github-runner-207 kernel: [33504.577814] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:42:10 juju-e4d256-prod-github-runner-207 kernel: [33504.578903] ? show_regs.part.0+0x23/0x29 Aug 22 14:42:10 juju-e4d256-prod-github-runner-207 kernel: [33504.579920] ? show_regs.cold+0x8/0xd Aug 22 14:42:10 juju-e4d256-prod-github-runner-207 kernel: [33504.580924] ? watchdog_timer_fn+0x1be/0x220 Aug 22 14:42:10 juju-e4d256-prod-github-runner-207 kernel: [33504.581956] ? lockup_detector_update_enable+0x60/0x60 Aug 22 14:42:10 juju-e4d256-prod-github-runner-207 kernel: [33504.583029] ? __hrtimer_run_queues+0x107/0x230 Aug 22 14:42:10 juju-e4d256-prod-github-runner-207 kernel: [33504.584081] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 14:42:10 juju-e4d256-prod-github-runner-207 kernel: [33504.585117] ? hrtimer_interrupt+0x101/0x220 Aug 22 14:42:10 juju-e4d256-prod-github-runner-207 kernel: [33504.586140] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 14:42:10 juju-e4d256-prod-github-runner-207 kernel: [33504.587216] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 14:42:10 juju-e4d256-prod-github-runner-207 kernel: [33504.588296] Aug 22 14:42:10 juju-e4d256-prod-github-runner-207 kernel: [33504.589151] Aug 22 14:42:10 juju-e4d256-prod-github-runner-207 kernel: [33504.589995] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 14:42:10 juju-e4d256-prod-github-runner-207 kernel: [33504.591028] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:42:10 juju-e4d256-prod-github-runner-207 kernel: [33504.592075] ? _raw_spin_lock+0x22/0x30 Aug 22 14:42:10 juju-e4d256-prod-github-runner-207 kernel: [33504.593023] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:42:10 juju-e4d256-prod-github-runner-207 kernel: [33504.594047] direct_page_fault+0x206/0x310 [kvm] Aug 22 14:42:10 juju-e4d256-prod-github-runner-207 kernel: [33504.595080] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 14:42:10 juju-e4d256-prod-github-runner-207 kernel: [33504.596138] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 14:42:10 juju-e4d256-prod-github-runner-207 kernel: [33504.597154] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 14:42:10 juju-e4d256-prod-github-runner-207 kernel: [33504.598123] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 14:42:10 juju-e4d256-prod-github-runner-207 kernel: [33504.599081] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 14:42:10 juju-e4d256-prod-github-runner-207 kernel: [33504.600083] handle_exit+0x98/0x230 [kvm_amd] Aug 22 14:42:10 juju-e4d256-prod-github-runner-207 kernel: [33504.600980] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 14:42:10 juju-e4d256-prod-github-runner-207 kernel: [33504.601915] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 14:42:10 juju-e4d256-prod-github-runner-207 kernel: [33504.602858] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 14:42:10 juju-e4d256-prod-github-runner-207 kernel: [33504.603784] vcpu_run+0x62/0x2c0 [kvm] Aug 22 14:42:10 juju-e4d256-prod-github-runner-207 kernel: [33504.604614] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 14:42:10 juju-e4d256-prod-github-runner-207 kernel: [33504.605425] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 14:42:10 juju-e4d256-prod-github-runner-207 kernel: [33504.606292] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 14:42:10 juju-e4d256-prod-github-runner-207 kernel: [33504.607095] ? __seccomp_filter+0x4a/0x4a0 Aug 22 14:42:10 juju-e4d256-prod-github-runner-207 kernel: [33504.607878] ? __fget_files+0x86/0xc0 Aug 22 14:42:10 juju-e4d256-prod-github-runner-207 kernel: [33504.608591] __x64_sys_ioctl+0x95/0xd0 Aug 22 14:42:10 juju-e4d256-prod-github-runner-207 kernel: [33504.609289] do_syscall_64+0x5c/0xc0 Aug 22 14:42:10 juju-e4d256-prod-github-runner-207 kernel: [33504.609960] ? do_futex+0x162/0x1f0 Aug 22 14:42:10 juju-e4d256-prod-github-runner-207 kernel: [33504.610625] ? __x64_sys_futex+0x78/0x1e0 Aug 22 14:42:10 juju-e4d256-prod-github-runner-207 kernel: [33504.611342] ? __secure_computing+0xa9/0x120 Aug 22 14:42:10 juju-e4d256-prod-github-runner-207 kernel: [33504.612087] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 14:42:10 juju-e4d256-prod-github-runner-207 kernel: [33504.612874] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:42:10 juju-e4d256-prod-github-runner-207 kernel: [33504.613601] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:42:10 juju-e4d256-prod-github-runner-207 kernel: [33504.614332] ? do_syscall_64+0x69/0xc0 Aug 22 14:42:10 juju-e4d256-prod-github-runner-207 kernel: [33504.614983] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:42:10 juju-e4d256-prod-github-runner-207 kernel: [33504.615705] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:42:10 juju-e4d256-prod-github-runner-207 kernel: [33504.616420] ? do_syscall_64+0x69/0xc0 Aug 22 14:42:10 juju-e4d256-prod-github-runner-207 kernel: [33504.617052] ? do_syscall_64+0x69/0xc0 Aug 22 14:42:10 juju-e4d256-prod-github-runner-207 kernel: [33504.617721] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 14:42:10 juju-e4d256-prod-github-runner-207 kernel: [33504.618455] RIP: 0033:0x7faa5d0edaff Aug 22 14:42:10 juju-e4d256-prod-github-runner-207 kernel: [33504.619083] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 14:42:10 juju-e4d256-prod-github-runner-207 kernel: [33504.621459] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 14:42:10 juju-e4d256-prod-github-runner-207 kernel: [33504.622405] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 14:42:10 juju-e4d256-prod-github-runner-207 kernel: [33504.623301] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 14:42:10 juju-e4d256-prod-github-runner-207 kernel: [33504.624258] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 14:42:10 juju-e4d256-prod-github-runner-207 kernel: [33504.625152] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 14:42:10 juju-e4d256-prod-github-runner-207 kernel: [33504.626061] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 14:42:10 juju-e4d256-prod-github-runner-207 kernel: [33504.626970] Aug 22 14:42:38 juju-e4d256-prod-github-runner-207 kernel: [33532.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 31121s! [qemu-system-x86:6715] Aug 22 14:42:38 juju-e4d256-prod-github-runner-207 kernel: [33532.543132] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 14:42:38 juju-e4d256-prod-github-runner-207 kernel: [33532.543209] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 14:42:38 juju-e4d256-prod-github-runner-207 kernel: [33532.555503] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 14:42:38 juju-e4d256-prod-github-runner-207 kernel: [33532.556852] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 14:42:38 juju-e4d256-prod-github-runner-207 kernel: [33532.558114] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:42:38 juju-e4d256-prod-github-runner-207 kernel: [33532.559184] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 14:42:38 juju-e4d256-prod-github-runner-207 kernel: [33532.561783] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 14:42:38 juju-e4d256-prod-github-runner-207 kernel: [33532.562837] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 14:42:38 juju-e4d256-prod-github-runner-207 kernel: [33532.564019] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 14:42:38 juju-e4d256-prod-github-runner-207 kernel: [33532.565198] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 14:42:38 juju-e4d256-prod-github-runner-207 kernel: [33532.566387] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 14:42:38 juju-e4d256-prod-github-runner-207 kernel: [33532.567604] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 14:42:38 juju-e4d256-prod-github-runner-207 kernel: [33532.568788] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 14:42:38 juju-e4d256-prod-github-runner-207 kernel: [33532.570065] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 14:42:38 juju-e4d256-prod-github-runner-207 kernel: [33532.571179] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 14:42:38 juju-e4d256-prod-github-runner-207 kernel: [33532.572424] Call Trace: Aug 22 14:42:38 juju-e4d256-prod-github-runner-207 kernel: [33532.573337] Aug 22 14:42:38 juju-e4d256-prod-github-runner-207 kernel: [33532.574229] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:42:38 juju-e4d256-prod-github-runner-207 kernel: [33532.575267] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:42:38 juju-e4d256-prod-github-runner-207 kernel: [33532.576327] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:42:38 juju-e4d256-prod-github-runner-207 kernel: [33532.577462] ? show_regs.part.0+0x23/0x29 Aug 22 14:42:38 juju-e4d256-prod-github-runner-207 kernel: [33532.578698] ? show_regs.cold+0x8/0xd Aug 22 14:42:38 juju-e4d256-prod-github-runner-207 kernel: [33532.579802] ? watchdog_timer_fn+0x1be/0x220 Aug 22 14:42:38 juju-e4d256-prod-github-runner-207 kernel: [33532.580869] ? lockup_detector_update_enable+0x60/0x60 Aug 22 14:42:38 juju-e4d256-prod-github-runner-207 kernel: [33532.581947] ? __hrtimer_run_queues+0x107/0x230 Aug 22 14:42:38 juju-e4d256-prod-github-runner-207 kernel: [33532.582994] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 14:42:38 juju-e4d256-prod-github-runner-207 kernel: [33532.584072] ? hrtimer_interrupt+0x101/0x220 Aug 22 14:42:38 juju-e4d256-prod-github-runner-207 kernel: [33532.585107] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 14:42:38 juju-e4d256-prod-github-runner-207 kernel: [33532.586280] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 14:42:38 juju-e4d256-prod-github-runner-207 kernel: [33532.587439] Aug 22 14:42:38 juju-e4d256-prod-github-runner-207 kernel: [33532.588306] Aug 22 14:42:38 juju-e4d256-prod-github-runner-207 kernel: [33532.589356] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 14:42:38 juju-e4d256-prod-github-runner-207 kernel: [33532.590449] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:42:38 juju-e4d256-prod-github-runner-207 kernel: [33532.591538] ? _raw_spin_lock+0x22/0x30 Aug 22 14:42:38 juju-e4d256-prod-github-runner-207 kernel: [33532.592518] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:42:38 juju-e4d256-prod-github-runner-207 kernel: [33532.593612] direct_page_fault+0x206/0x310 [kvm] Aug 22 14:42:38 juju-e4d256-prod-github-runner-207 kernel: [33532.594647] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 14:42:38 juju-e4d256-prod-github-runner-207 kernel: [33532.595684] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 14:42:38 juju-e4d256-prod-github-runner-207 kernel: [33532.596695] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 14:42:38 juju-e4d256-prod-github-runner-207 kernel: [33532.597682] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 14:42:38 juju-e4d256-prod-github-runner-207 kernel: [33532.598645] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 14:42:38 juju-e4d256-prod-github-runner-207 kernel: [33532.599706] handle_exit+0x98/0x230 [kvm_amd] Aug 22 14:42:38 juju-e4d256-prod-github-runner-207 kernel: [33532.600632] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 14:42:38 juju-e4d256-prod-github-runner-207 kernel: [33532.601560] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 14:42:38 juju-e4d256-prod-github-runner-207 kernel: [33532.602535] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 14:42:38 juju-e4d256-prod-github-runner-207 kernel: [33532.603523] vcpu_run+0x62/0x2c0 [kvm] Aug 22 14:42:38 juju-e4d256-prod-github-runner-207 kernel: [33532.604362] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 14:42:38 juju-e4d256-prod-github-runner-207 kernel: [33532.605182] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 14:42:38 juju-e4d256-prod-github-runner-207 kernel: [33532.606090] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 14:42:38 juju-e4d256-prod-github-runner-207 kernel: [33532.606900] ? __seccomp_filter+0x4a/0x4a0 Aug 22 14:42:38 juju-e4d256-prod-github-runner-207 kernel: [33532.607686] ? __fget_files+0x86/0xc0 Aug 22 14:42:38 juju-e4d256-prod-github-runner-207 kernel: [33532.608402] __x64_sys_ioctl+0x95/0xd0 Aug 22 14:42:38 juju-e4d256-prod-github-runner-207 kernel: [33532.609120] do_syscall_64+0x5c/0xc0 Aug 22 14:42:38 juju-e4d256-prod-github-runner-207 kernel: [33532.609810] ? do_futex+0x162/0x1f0 Aug 22 14:42:38 juju-e4d256-prod-github-runner-207 kernel: [33532.610541] ? __x64_sys_futex+0x78/0x1e0 Aug 22 14:42:38 juju-e4d256-prod-github-runner-207 kernel: [33532.611238] ? __secure_computing+0xa9/0x120 Aug 22 14:42:38 juju-e4d256-prod-github-runner-207 kernel: [33532.611968] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 14:42:38 juju-e4d256-prod-github-runner-207 kernel: [33532.612744] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:42:38 juju-e4d256-prod-github-runner-207 kernel: [33532.613505] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:42:38 juju-e4d256-prod-github-runner-207 kernel: [33532.614265] ? do_syscall_64+0x69/0xc0 Aug 22 14:42:38 juju-e4d256-prod-github-runner-207 kernel: [33532.614969] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:42:38 juju-e4d256-prod-github-runner-207 kernel: [33532.615722] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:42:38 juju-e4d256-prod-github-runner-207 kernel: [33532.616484] ? do_syscall_64+0x69/0xc0 Aug 22 14:42:38 juju-e4d256-prod-github-runner-207 kernel: [33532.617134] ? do_syscall_64+0x69/0xc0 Aug 22 14:42:38 juju-e4d256-prod-github-runner-207 kernel: [33532.617774] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 14:42:38 juju-e4d256-prod-github-runner-207 kernel: [33532.618505] RIP: 0033:0x7faa5d0edaff Aug 22 14:42:38 juju-e4d256-prod-github-runner-207 kernel: [33532.619163] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 14:42:38 juju-e4d256-prod-github-runner-207 kernel: [33532.621223] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 14:42:38 juju-e4d256-prod-github-runner-207 kernel: [33532.622160] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 14:42:38 juju-e4d256-prod-github-runner-207 kernel: [33532.623067] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 14:42:38 juju-e4d256-prod-github-runner-207 kernel: [33532.623987] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 14:42:38 juju-e4d256-prod-github-runner-207 kernel: [33532.624901] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 14:42:38 juju-e4d256-prod-github-runner-207 kernel: [33532.625959] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 14:42:38 juju-e4d256-prod-github-runner-207 kernel: [33532.626894] Aug 22 14:43:06 juju-e4d256-prod-github-runner-207 kernel: [33560.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 31147s! [qemu-system-x86:6715] Aug 22 14:43:06 juju-e4d256-prod-github-runner-207 kernel: [33560.543877] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 14:43:06 juju-e4d256-prod-github-runner-207 kernel: [33560.544190] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 14:43:06 juju-e4d256-prod-github-runner-207 kernel: [33560.556496] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 14:43:06 juju-e4d256-prod-github-runner-207 kernel: [33560.557791] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 14:43:06 juju-e4d256-prod-github-runner-207 kernel: [33560.559026] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:43:06 juju-e4d256-prod-github-runner-207 kernel: [33560.560105] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 14:43:06 juju-e4d256-prod-github-runner-207 kernel: [33560.562687] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 14:43:06 juju-e4d256-prod-github-runner-207 kernel: [33560.563753] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 14:43:06 juju-e4d256-prod-github-runner-207 kernel: [33560.564936] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 14:43:06 juju-e4d256-prod-github-runner-207 kernel: [33560.566104] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 14:43:06 juju-e4d256-prod-github-runner-207 kernel: [33560.567290] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 14:43:06 juju-e4d256-prod-github-runner-207 kernel: [33560.568465] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 14:43:06 juju-e4d256-prod-github-runner-207 kernel: [33560.569643] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 14:43:06 juju-e4d256-prod-github-runner-207 kernel: [33560.570888] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 14:43:06 juju-e4d256-prod-github-runner-207 kernel: [33560.572011] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 14:43:06 juju-e4d256-prod-github-runner-207 kernel: [33560.573218] Call Trace: Aug 22 14:43:06 juju-e4d256-prod-github-runner-207 kernel: [33560.574132] Aug 22 14:43:06 juju-e4d256-prod-github-runner-207 kernel: [33560.575036] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:43:06 juju-e4d256-prod-github-runner-207 kernel: [33560.576078] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:43:06 juju-e4d256-prod-github-runner-207 kernel: [33560.577107] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:43:06 juju-e4d256-prod-github-runner-207 kernel: [33560.578225] ? show_regs.part.0+0x23/0x29 Aug 22 14:43:06 juju-e4d256-prod-github-runner-207 kernel: [33560.579249] ? show_regs.cold+0x8/0xd Aug 22 14:43:06 juju-e4d256-prod-github-runner-207 kernel: [33560.580227] ? watchdog_timer_fn+0x1be/0x220 Aug 22 14:43:06 juju-e4d256-prod-github-runner-207 kernel: [33560.581246] ? lockup_detector_update_enable+0x60/0x60 Aug 22 14:43:06 juju-e4d256-prod-github-runner-207 kernel: [33560.582319] ? __hrtimer_run_queues+0x107/0x230 Aug 22 14:43:06 juju-e4d256-prod-github-runner-207 kernel: [33560.583365] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 14:43:06 juju-e4d256-prod-github-runner-207 kernel: [33560.584397] ? hrtimer_interrupt+0x101/0x220 Aug 22 14:43:06 juju-e4d256-prod-github-runner-207 kernel: [33560.585420] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 14:43:06 juju-e4d256-prod-github-runner-207 kernel: [33560.586514] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 14:43:06 juju-e4d256-prod-github-runner-207 kernel: [33560.587583] Aug 22 14:43:06 juju-e4d256-prod-github-runner-207 kernel: [33560.588446] Aug 22 14:43:06 juju-e4d256-prod-github-runner-207 kernel: [33560.589286] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 14:43:06 juju-e4d256-prod-github-runner-207 kernel: [33560.590333] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:43:06 juju-e4d256-prod-github-runner-207 kernel: [33560.591387] ? _raw_spin_lock+0x22/0x30 Aug 22 14:43:06 juju-e4d256-prod-github-runner-207 kernel: [33560.592342] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:43:06 juju-e4d256-prod-github-runner-207 kernel: [33560.593367] direct_page_fault+0x206/0x310 [kvm] Aug 22 14:43:06 juju-e4d256-prod-github-runner-207 kernel: [33560.594399] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 14:43:06 juju-e4d256-prod-github-runner-207 kernel: [33560.595426] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 14:43:06 juju-e4d256-prod-github-runner-207 kernel: [33560.596445] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 14:43:06 juju-e4d256-prod-github-runner-207 kernel: [33560.597458] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 14:43:06 juju-e4d256-prod-github-runner-207 kernel: [33560.598410] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 14:43:06 juju-e4d256-prod-github-runner-207 kernel: [33560.599408] handle_exit+0x98/0x230 [kvm_amd] Aug 22 14:43:06 juju-e4d256-prod-github-runner-207 kernel: [33560.600316] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 14:43:06 juju-e4d256-prod-github-runner-207 kernel: [33560.601241] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 14:43:06 juju-e4d256-prod-github-runner-207 kernel: [33560.602177] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 14:43:06 juju-e4d256-prod-github-runner-207 kernel: [33560.603107] vcpu_run+0x62/0x2c0 [kvm] Aug 22 14:43:06 juju-e4d256-prod-github-runner-207 kernel: [33560.603925] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 14:43:06 juju-e4d256-prod-github-runner-207 kernel: [33560.604741] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 14:43:06 juju-e4d256-prod-github-runner-207 kernel: [33560.605603] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 14:43:06 juju-e4d256-prod-github-runner-207 kernel: [33560.606411] ? __seccomp_filter+0x4a/0x4a0 Aug 22 14:43:06 juju-e4d256-prod-github-runner-207 kernel: [33560.607168] ? __fget_files+0x86/0xc0 Aug 22 14:43:06 juju-e4d256-prod-github-runner-207 kernel: [33560.607896] __x64_sys_ioctl+0x95/0xd0 Aug 22 14:43:06 juju-e4d256-prod-github-runner-207 kernel: [33560.608610] do_syscall_64+0x5c/0xc0 Aug 22 14:43:06 juju-e4d256-prod-github-runner-207 kernel: [33560.609285] ? do_futex+0x162/0x1f0 Aug 22 14:43:06 juju-e4d256-prod-github-runner-207 kernel: [33560.609942] ? __x64_sys_futex+0x78/0x1e0 Aug 22 14:43:06 juju-e4d256-prod-github-runner-207 kernel: [33560.610622] ? __secure_computing+0xa9/0x120 Aug 22 14:43:06 juju-e4d256-prod-github-runner-207 kernel: [33560.611341] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 14:43:06 juju-e4d256-prod-github-runner-207 kernel: [33560.612118] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:43:06 juju-e4d256-prod-github-runner-207 kernel: [33560.612848] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:43:06 juju-e4d256-prod-github-runner-207 kernel: [33560.613580] ? do_syscall_64+0x69/0xc0 Aug 22 14:43:06 juju-e4d256-prod-github-runner-207 kernel: [33560.614234] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:43:06 juju-e4d256-prod-github-runner-207 kernel: [33560.614948] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:43:06 juju-e4d256-prod-github-runner-207 kernel: [33560.615677] ? do_syscall_64+0x69/0xc0 Aug 22 14:43:06 juju-e4d256-prod-github-runner-207 kernel: [33560.616328] ? do_syscall_64+0x69/0xc0 Aug 22 14:43:06 juju-e4d256-prod-github-runner-207 kernel: [33560.616961] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 14:43:06 juju-e4d256-prod-github-runner-207 kernel: [33560.617720] RIP: 0033:0x7faa5d0edaff Aug 22 14:43:06 juju-e4d256-prod-github-runner-207 kernel: [33560.618585] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 14:43:06 juju-e4d256-prod-github-runner-207 kernel: [33560.620739] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 14:43:06 juju-e4d256-prod-github-runner-207 kernel: [33560.621680] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 14:43:06 juju-e4d256-prod-github-runner-207 kernel: [33560.622597] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 14:43:06 juju-e4d256-prod-github-runner-207 kernel: [33560.623534] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 14:43:06 juju-e4d256-prod-github-runner-207 kernel: [33560.624449] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 14:43:06 juju-e4d256-prod-github-runner-207 kernel: [33560.625364] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 14:43:06 juju-e4d256-prod-github-runner-207 kernel: [33560.626318] Aug 22 14:43:34 juju-e4d256-prod-github-runner-207 kernel: [33588.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 31173s! [qemu-system-x86:6715] Aug 22 14:43:34 juju-e4d256-prod-github-runner-207 kernel: [33588.543143] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 14:43:34 juju-e4d256-prod-github-runner-207 kernel: [33588.543219] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 14:43:34 juju-e4d256-prod-github-runner-207 kernel: [33588.555844] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 14:43:34 juju-e4d256-prod-github-runner-207 kernel: [33588.557116] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 14:43:34 juju-e4d256-prod-github-runner-207 kernel: [33588.558341] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:43:34 juju-e4d256-prod-github-runner-207 kernel: [33588.559435] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 14:43:34 juju-e4d256-prod-github-runner-207 kernel: [33588.562025] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 14:43:34 juju-e4d256-prod-github-runner-207 kernel: [33588.563103] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 14:43:34 juju-e4d256-prod-github-runner-207 kernel: [33588.564286] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 14:43:34 juju-e4d256-prod-github-runner-207 kernel: [33588.565476] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 14:43:34 juju-e4d256-prod-github-runner-207 kernel: [33588.566655] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 14:43:34 juju-e4d256-prod-github-runner-207 kernel: [33588.567839] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 14:43:34 juju-e4d256-prod-github-runner-207 kernel: [33588.569041] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 14:43:34 juju-e4d256-prod-github-runner-207 kernel: [33588.570334] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 14:43:34 juju-e4d256-prod-github-runner-207 kernel: [33588.571481] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 14:43:34 juju-e4d256-prod-github-runner-207 kernel: [33588.572674] Call Trace: Aug 22 14:43:34 juju-e4d256-prod-github-runner-207 kernel: [33588.573604] Aug 22 14:43:34 juju-e4d256-prod-github-runner-207 kernel: [33588.574503] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:43:34 juju-e4d256-prod-github-runner-207 kernel: [33588.575566] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:43:34 juju-e4d256-prod-github-runner-207 kernel: [33588.576624] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:43:34 juju-e4d256-prod-github-runner-207 kernel: [33588.577747] ? show_regs.part.0+0x23/0x29 Aug 22 14:43:34 juju-e4d256-prod-github-runner-207 kernel: [33588.578791] ? show_regs.cold+0x8/0xd Aug 22 14:43:34 juju-e4d256-prod-github-runner-207 kernel: [33588.579797] ? watchdog_timer_fn+0x1be/0x220 Aug 22 14:43:34 juju-e4d256-prod-github-runner-207 kernel: [33588.580868] ? lockup_detector_update_enable+0x60/0x60 Aug 22 14:43:34 juju-e4d256-prod-github-runner-207 kernel: [33588.581953] ? __hrtimer_run_queues+0x107/0x230 Aug 22 14:43:34 juju-e4d256-prod-github-runner-207 kernel: [33588.583060] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 14:43:34 juju-e4d256-prod-github-runner-207 kernel: [33588.584095] ? hrtimer_interrupt+0x101/0x220 Aug 22 14:43:34 juju-e4d256-prod-github-runner-207 kernel: [33588.585152] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 14:43:34 juju-e4d256-prod-github-runner-207 kernel: [33588.586235] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 14:43:34 juju-e4d256-prod-github-runner-207 kernel: [33588.587301] Aug 22 14:43:34 juju-e4d256-prod-github-runner-207 kernel: [33588.588302] Aug 22 14:43:34 juju-e4d256-prod-github-runner-207 kernel: [33588.589138] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 14:43:34 juju-e4d256-prod-github-runner-207 kernel: [33588.590170] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:43:34 juju-e4d256-prod-github-runner-207 kernel: [33588.591218] ? _raw_spin_lock+0x22/0x30 Aug 22 14:43:34 juju-e4d256-prod-github-runner-207 kernel: [33588.592169] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:43:34 juju-e4d256-prod-github-runner-207 kernel: [33588.593212] direct_page_fault+0x206/0x310 [kvm] Aug 22 14:43:34 juju-e4d256-prod-github-runner-207 kernel: [33588.594237] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 14:43:34 juju-e4d256-prod-github-runner-207 kernel: [33588.595447] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 14:43:34 juju-e4d256-prod-github-runner-207 kernel: [33588.596448] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 14:43:34 juju-e4d256-prod-github-runner-207 kernel: [33588.597425] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 14:43:34 juju-e4d256-prod-github-runner-207 kernel: [33588.598405] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 14:43:34 juju-e4d256-prod-github-runner-207 kernel: [33588.599408] handle_exit+0x98/0x230 [kvm_amd] Aug 22 14:43:34 juju-e4d256-prod-github-runner-207 kernel: [33588.600305] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 14:43:34 juju-e4d256-prod-github-runner-207 kernel: [33588.601223] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 14:43:34 juju-e4d256-prod-github-runner-207 kernel: [33588.602148] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 14:43:34 juju-e4d256-prod-github-runner-207 kernel: [33588.603334] vcpu_run+0x62/0x2c0 [kvm] Aug 22 14:43:34 juju-e4d256-prod-github-runner-207 kernel: [33588.604236] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 14:43:34 juju-e4d256-prod-github-runner-207 kernel: [33588.605078] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 14:43:34 juju-e4d256-prod-github-runner-207 kernel: [33588.605956] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 14:43:34 juju-e4d256-prod-github-runner-207 kernel: [33588.606845] ? __seccomp_filter+0x4a/0x4a0 Aug 22 14:43:34 juju-e4d256-prod-github-runner-207 kernel: [33588.607603] ? __fget_files+0x86/0xc0 Aug 22 14:43:34 juju-e4d256-prod-github-runner-207 kernel: [33588.608347] __x64_sys_ioctl+0x95/0xd0 Aug 22 14:43:34 juju-e4d256-prod-github-runner-207 kernel: [33588.609090] do_syscall_64+0x5c/0xc0 Aug 22 14:43:34 juju-e4d256-prod-github-runner-207 kernel: [33588.609771] ? do_futex+0x162/0x1f0 Aug 22 14:43:34 juju-e4d256-prod-github-runner-207 kernel: [33588.610420] ? __x64_sys_futex+0x78/0x1e0 Aug 22 14:43:34 juju-e4d256-prod-github-runner-207 kernel: [33588.611122] ? __secure_computing+0xa9/0x120 Aug 22 14:43:34 juju-e4d256-prod-github-runner-207 kernel: [33588.611832] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 14:43:34 juju-e4d256-prod-github-runner-207 kernel: [33588.612606] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:43:34 juju-e4d256-prod-github-runner-207 kernel: [33588.613363] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:43:34 juju-e4d256-prod-github-runner-207 kernel: [33588.614090] ? do_syscall_64+0x69/0xc0 Aug 22 14:43:34 juju-e4d256-prod-github-runner-207 kernel: [33588.614778] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:43:34 juju-e4d256-prod-github-runner-207 kernel: [33588.615530] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:43:34 juju-e4d256-prod-github-runner-207 kernel: [33588.616250] ? do_syscall_64+0x69/0xc0 Aug 22 14:43:34 juju-e4d256-prod-github-runner-207 kernel: [33588.616926] ? do_syscall_64+0x69/0xc0 Aug 22 14:43:34 juju-e4d256-prod-github-runner-207 kernel: [33588.617559] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 14:43:34 juju-e4d256-prod-github-runner-207 kernel: [33588.618273] RIP: 0033:0x7faa5d0edaff Aug 22 14:43:34 juju-e4d256-prod-github-runner-207 kernel: [33588.618970] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 14:43:34 juju-e4d256-prod-github-runner-207 kernel: [33588.620991] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 14:43:34 juju-e4d256-prod-github-runner-207 kernel: [33588.621974] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 14:43:34 juju-e4d256-prod-github-runner-207 kernel: [33588.622913] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 14:43:34 juju-e4d256-prod-github-runner-207 kernel: [33588.623810] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 14:43:34 juju-e4d256-prod-github-runner-207 kernel: [33588.624700] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 14:43:34 juju-e4d256-prod-github-runner-207 kernel: [33588.625588] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 14:43:34 juju-e4d256-prod-github-runner-207 kernel: [33588.626504] Aug 22 14:44:02 juju-e4d256-prod-github-runner-207 kernel: [33616.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 31199s! [qemu-system-x86:6715] Aug 22 14:44:02 juju-e4d256-prod-github-runner-207 kernel: [33616.543188] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 14:44:02 juju-e4d256-prod-github-runner-207 kernel: [33616.543263] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 14:44:02 juju-e4d256-prod-github-runner-207 kernel: [33616.555566] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 14:44:02 juju-e4d256-prod-github-runner-207 kernel: [33616.556831] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 14:44:02 juju-e4d256-prod-github-runner-207 kernel: [33616.558075] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:44:02 juju-e4d256-prod-github-runner-207 kernel: [33616.559162] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 14:44:02 juju-e4d256-prod-github-runner-207 kernel: [33616.561715] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 14:44:02 juju-e4d256-prod-github-runner-207 kernel: [33616.562778] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 14:44:02 juju-e4d256-prod-github-runner-207 kernel: [33616.563981] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 14:44:02 juju-e4d256-prod-github-runner-207 kernel: [33616.565154] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 14:44:02 juju-e4d256-prod-github-runner-207 kernel: [33616.566311] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 14:44:02 juju-e4d256-prod-github-runner-207 kernel: [33616.567513] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 14:44:02 juju-e4d256-prod-github-runner-207 kernel: [33616.568696] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 14:44:02 juju-e4d256-prod-github-runner-207 kernel: [33616.569962] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 14:44:02 juju-e4d256-prod-github-runner-207 kernel: [33616.571087] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 14:44:02 juju-e4d256-prod-github-runner-207 kernel: [33616.572279] Call Trace: Aug 22 14:44:02 juju-e4d256-prod-github-runner-207 kernel: [33616.573195] Aug 22 14:44:02 juju-e4d256-prod-github-runner-207 kernel: [33616.574077] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:44:02 juju-e4d256-prod-github-runner-207 kernel: [33616.575113] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:44:02 juju-e4d256-prod-github-runner-207 kernel: [33616.576149] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:44:02 juju-e4d256-prod-github-runner-207 kernel: [33616.577235] ? show_regs.part.0+0x23/0x29 Aug 22 14:44:02 juju-e4d256-prod-github-runner-207 kernel: [33616.578239] ? show_regs.cold+0x8/0xd Aug 22 14:44:02 juju-e4d256-prod-github-runner-207 kernel: [33616.579231] ? watchdog_timer_fn+0x1be/0x220 Aug 22 14:44:02 juju-e4d256-prod-github-runner-207 kernel: [33616.580243] ? lockup_detector_update_enable+0x60/0x60 Aug 22 14:44:02 juju-e4d256-prod-github-runner-207 kernel: [33616.581303] ? __hrtimer_run_queues+0x107/0x230 Aug 22 14:44:02 juju-e4d256-prod-github-runner-207 kernel: [33616.582329] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 14:44:02 juju-e4d256-prod-github-runner-207 kernel: [33616.583382] ? hrtimer_interrupt+0x101/0x220 Aug 22 14:44:02 juju-e4d256-prod-github-runner-207 kernel: [33616.584421] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 14:44:02 juju-e4d256-prod-github-runner-207 kernel: [33616.585506] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 14:44:02 juju-e4d256-prod-github-runner-207 kernel: [33616.586586] Aug 22 14:44:02 juju-e4d256-prod-github-runner-207 kernel: [33616.587451] Aug 22 14:44:02 juju-e4d256-prod-github-runner-207 kernel: [33616.588303] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 14:44:02 juju-e4d256-prod-github-runner-207 kernel: [33616.589335] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:44:02 juju-e4d256-prod-github-runner-207 kernel: [33616.590425] ? _raw_spin_lock+0x22/0x30 Aug 22 14:44:02 juju-e4d256-prod-github-runner-207 kernel: [33616.591382] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:44:02 juju-e4d256-prod-github-runner-207 kernel: [33616.592404] direct_page_fault+0x206/0x310 [kvm] Aug 22 14:44:02 juju-e4d256-prod-github-runner-207 kernel: [33616.593429] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 14:44:02 juju-e4d256-prod-github-runner-207 kernel: [33616.594487] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 14:44:02 juju-e4d256-prod-github-runner-207 kernel: [33616.595502] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 14:44:02 juju-e4d256-prod-github-runner-207 kernel: [33616.596476] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 14:44:02 juju-e4d256-prod-github-runner-207 kernel: [33616.597477] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 14:44:02 juju-e4d256-prod-github-runner-207 kernel: [33616.598484] handle_exit+0x98/0x230 [kvm_amd] Aug 22 14:44:02 juju-e4d256-prod-github-runner-207 kernel: [33616.599387] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 14:44:02 juju-e4d256-prod-github-runner-207 kernel: [33616.600305] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 14:44:02 juju-e4d256-prod-github-runner-207 kernel: [33616.601228] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 14:44:02 juju-e4d256-prod-github-runner-207 kernel: [33616.602137] vcpu_run+0x62/0x2c0 [kvm] Aug 22 14:44:02 juju-e4d256-prod-github-runner-207 kernel: [33616.603003] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 14:44:02 juju-e4d256-prod-github-runner-207 kernel: [33616.603818] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 14:44:02 juju-e4d256-prod-github-runner-207 kernel: [33616.604676] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 14:44:02 juju-e4d256-prod-github-runner-207 kernel: [33616.605479] ? __seccomp_filter+0x4a/0x4a0 Aug 22 14:44:02 juju-e4d256-prod-github-runner-207 kernel: [33616.606220] ? __fget_files+0x86/0xc0 Aug 22 14:44:02 juju-e4d256-prod-github-runner-207 kernel: [33616.606965] __x64_sys_ioctl+0x95/0xd0 Aug 22 14:44:02 juju-e4d256-prod-github-runner-207 kernel: [33616.607661] do_syscall_64+0x5c/0xc0 Aug 22 14:44:02 juju-e4d256-prod-github-runner-207 kernel: [33616.608349] ? do_futex+0x162/0x1f0 Aug 22 14:44:02 juju-e4d256-prod-github-runner-207 kernel: [33616.608998] ? __x64_sys_futex+0x78/0x1e0 Aug 22 14:44:02 juju-e4d256-prod-github-runner-207 kernel: [33616.609679] ? __secure_computing+0xa9/0x120 Aug 22 14:44:02 juju-e4d256-prod-github-runner-207 kernel: [33616.610391] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 14:44:02 juju-e4d256-prod-github-runner-207 kernel: [33616.611159] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:44:02 juju-e4d256-prod-github-runner-207 kernel: [33616.611882] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:44:02 juju-e4d256-prod-github-runner-207 kernel: [33616.612634] ? do_syscall_64+0x69/0xc0 Aug 22 14:44:02 juju-e4d256-prod-github-runner-207 kernel: [33616.613282] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:44:02 juju-e4d256-prod-github-runner-207 kernel: [33616.613992] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:44:02 juju-e4d256-prod-github-runner-207 kernel: [33616.614767] ? do_syscall_64+0x69/0xc0 Aug 22 14:44:02 juju-e4d256-prod-github-runner-207 kernel: [33616.615406] ? do_syscall_64+0x69/0xc0 Aug 22 14:44:02 juju-e4d256-prod-github-runner-207 kernel: [33616.616058] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 14:44:02 juju-e4d256-prod-github-runner-207 kernel: [33616.616801] RIP: 0033:0x7faa5d0edaff Aug 22 14:44:02 juju-e4d256-prod-github-runner-207 kernel: [33616.617427] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 14:44:02 juju-e4d256-prod-github-runner-207 kernel: [33616.619426] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 14:44:02 juju-e4d256-prod-github-runner-207 kernel: [33616.620338] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 14:44:02 juju-e4d256-prod-github-runner-207 kernel: [33616.621250] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 14:44:02 juju-e4d256-prod-github-runner-207 kernel: [33616.622143] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 14:44:02 juju-e4d256-prod-github-runner-207 kernel: [33616.623078] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 14:44:02 juju-e4d256-prod-github-runner-207 kernel: [33616.623994] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 14:44:02 juju-e4d256-prod-github-runner-207 kernel: [33616.624906] Aug 22 14:44:30 juju-e4d256-prod-github-runner-207 kernel: [33644.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 31225s! [qemu-system-x86:6715] Aug 22 14:44:30 juju-e4d256-prod-github-runner-207 kernel: [33644.544047] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 14:44:30 juju-e4d256-prod-github-runner-207 kernel: [33644.544382] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 14:44:30 juju-e4d256-prod-github-runner-207 kernel: [33644.556554] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 14:44:30 juju-e4d256-prod-github-runner-207 kernel: [33644.557933] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 14:44:30 juju-e4d256-prod-github-runner-207 kernel: [33644.559203] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:44:30 juju-e4d256-prod-github-runner-207 kernel: [33644.560282] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 14:44:30 juju-e4d256-prod-github-runner-207 kernel: [33644.562880] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 14:44:30 juju-e4d256-prod-github-runner-207 kernel: [33644.563924] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 14:44:30 juju-e4d256-prod-github-runner-207 kernel: [33644.565088] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 14:44:30 juju-e4d256-prod-github-runner-207 kernel: [33644.566287] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 14:44:30 juju-e4d256-prod-github-runner-207 kernel: [33644.567446] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 14:44:30 juju-e4d256-prod-github-runner-207 kernel: [33644.568605] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 14:44:30 juju-e4d256-prod-github-runner-207 kernel: [33644.569783] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 14:44:30 juju-e4d256-prod-github-runner-207 kernel: [33644.571033] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 14:44:30 juju-e4d256-prod-github-runner-207 kernel: [33644.572128] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 14:44:30 juju-e4d256-prod-github-runner-207 kernel: [33644.573318] Call Trace: Aug 22 14:44:30 juju-e4d256-prod-github-runner-207 kernel: [33644.574246] Aug 22 14:44:30 juju-e4d256-prod-github-runner-207 kernel: [33644.575152] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:44:30 juju-e4d256-prod-github-runner-207 kernel: [33644.576183] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:44:30 juju-e4d256-prod-github-runner-207 kernel: [33644.577208] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:44:30 juju-e4d256-prod-github-runner-207 kernel: [33644.578333] ? show_regs.part.0+0x23/0x29 Aug 22 14:44:30 juju-e4d256-prod-github-runner-207 kernel: [33644.579332] ? show_regs.cold+0x8/0xd Aug 22 14:44:30 juju-e4d256-prod-github-runner-207 kernel: [33644.580304] ? watchdog_timer_fn+0x1be/0x220 Aug 22 14:44:30 juju-e4d256-prod-github-runner-207 kernel: [33644.581311] ? lockup_detector_update_enable+0x60/0x60 Aug 22 14:44:30 juju-e4d256-prod-github-runner-207 kernel: [33644.582398] ? __hrtimer_run_queues+0x107/0x230 Aug 22 14:44:30 juju-e4d256-prod-github-runner-207 kernel: [33644.583425] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 14:44:30 juju-e4d256-prod-github-runner-207 kernel: [33644.584452] ? hrtimer_interrupt+0x101/0x220 Aug 22 14:44:30 juju-e4d256-prod-github-runner-207 kernel: [33644.585472] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 14:44:30 juju-e4d256-prod-github-runner-207 kernel: [33644.586812] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 14:44:30 juju-e4d256-prod-github-runner-207 kernel: [33644.587860] Aug 22 14:44:30 juju-e4d256-prod-github-runner-207 kernel: [33644.588712] Aug 22 14:44:30 juju-e4d256-prod-github-runner-207 kernel: [33644.589548] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 14:44:30 juju-e4d256-prod-github-runner-207 kernel: [33644.590594] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:44:30 juju-e4d256-prod-github-runner-207 kernel: [33644.591635] ? _raw_spin_lock+0x22/0x30 Aug 22 14:44:30 juju-e4d256-prod-github-runner-207 kernel: [33644.592581] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:44:30 juju-e4d256-prod-github-runner-207 kernel: [33644.593601] direct_page_fault+0x206/0x310 [kvm] Aug 22 14:44:30 juju-e4d256-prod-github-runner-207 kernel: [33644.594684] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 14:44:30 juju-e4d256-prod-github-runner-207 kernel: [33644.595693] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 14:44:30 juju-e4d256-prod-github-runner-207 kernel: [33644.596697] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 14:44:30 juju-e4d256-prod-github-runner-207 kernel: [33644.597725] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 14:44:30 juju-e4d256-prod-github-runner-207 kernel: [33644.598682] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 14:44:30 juju-e4d256-prod-github-runner-207 kernel: [33644.599668] handle_exit+0x98/0x230 [kvm_amd] Aug 22 14:44:30 juju-e4d256-prod-github-runner-207 kernel: [33644.600561] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 14:44:30 juju-e4d256-prod-github-runner-207 kernel: [33644.601479] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 14:44:30 juju-e4d256-prod-github-runner-207 kernel: [33644.602416] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 14:44:30 juju-e4d256-prod-github-runner-207 kernel: [33644.603361] vcpu_run+0x62/0x2c0 [kvm] Aug 22 14:44:30 juju-e4d256-prod-github-runner-207 kernel: [33644.604171] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 14:44:30 juju-e4d256-prod-github-runner-207 kernel: [33644.604985] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 14:44:30 juju-e4d256-prod-github-runner-207 kernel: [33644.605839] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 14:44:30 juju-e4d256-prod-github-runner-207 kernel: [33644.606675] ? __seccomp_filter+0x4a/0x4a0 Aug 22 14:44:30 juju-e4d256-prod-github-runner-207 kernel: [33644.607538] ? __fget_files+0x86/0xc0 Aug 22 14:44:30 juju-e4d256-prod-github-runner-207 kernel: [33644.608244] __x64_sys_ioctl+0x95/0xd0 Aug 22 14:44:30 juju-e4d256-prod-github-runner-207 kernel: [33644.608935] do_syscall_64+0x5c/0xc0 Aug 22 14:44:30 juju-e4d256-prod-github-runner-207 kernel: [33644.609598] ? do_futex+0x162/0x1f0 Aug 22 14:44:30 juju-e4d256-prod-github-runner-207 kernel: [33644.610471] ? __x64_sys_futex+0x78/0x1e0 Aug 22 14:44:30 juju-e4d256-prod-github-runner-207 kernel: [33644.611145] ? __secure_computing+0xa9/0x120 Aug 22 14:44:30 juju-e4d256-prod-github-runner-207 kernel: [33644.611834] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 14:44:30 juju-e4d256-prod-github-runner-207 kernel: [33644.612592] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:44:30 juju-e4d256-prod-github-runner-207 kernel: [33644.613349] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:44:30 juju-e4d256-prod-github-runner-207 kernel: [33644.614090] ? do_syscall_64+0x69/0xc0 Aug 22 14:44:30 juju-e4d256-prod-github-runner-207 kernel: [33644.614735] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:44:30 juju-e4d256-prod-github-runner-207 kernel: [33644.615437] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:44:30 juju-e4d256-prod-github-runner-207 kernel: [33644.616131] ? do_syscall_64+0x69/0xc0 Aug 22 14:44:30 juju-e4d256-prod-github-runner-207 kernel: [33644.616755] ? do_syscall_64+0x69/0xc0 Aug 22 14:44:30 juju-e4d256-prod-github-runner-207 kernel: [33644.617398] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 14:44:30 juju-e4d256-prod-github-runner-207 kernel: [33644.618122] RIP: 0033:0x7faa5d0edaff Aug 22 14:44:30 juju-e4d256-prod-github-runner-207 kernel: [33644.618792] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 14:44:30 juju-e4d256-prod-github-runner-207 kernel: [33644.620791] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 14:44:30 juju-e4d256-prod-github-runner-207 kernel: [33644.621702] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 14:44:30 juju-e4d256-prod-github-runner-207 kernel: [33644.622616] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 14:44:30 juju-e4d256-prod-github-runner-207 kernel: [33644.623508] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 14:44:30 juju-e4d256-prod-github-runner-207 kernel: [33644.624414] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 14:44:30 juju-e4d256-prod-github-runner-207 kernel: [33644.625304] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 14:44:30 juju-e4d256-prod-github-runner-207 kernel: [33644.626221] Aug 22 14:44:45 juju-e4d256-prod-github-runner-207 kernel: [33659.432705] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 14:44:45 juju-e4d256-prod-github-runner-207 kernel: [33659.433677] rcu: 1-....: (8359300 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=4038250 Aug 22 14:44:45 juju-e4d256-prod-github-runner-207 kernel: [33659.434805] (t=8385558 jiffies g=23269 q=36067) Aug 22 14:44:45 juju-e4d256-prod-github-runner-207 kernel: [33659.435586] NMI backtrace for cpu 1 Aug 22 14:44:45 juju-e4d256-prod-github-runner-207 kernel: [33659.436305] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 14:44:45 juju-e4d256-prod-github-runner-207 kernel: [33659.437421] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 14:44:45 juju-e4d256-prod-github-runner-207 kernel: [33659.438493] Call Trace: Aug 22 14:44:45 juju-e4d256-prod-github-runner-207 kernel: [33659.439173] Aug 22 14:44:45 juju-e4d256-prod-github-runner-207 kernel: [33659.439818] show_stack+0x52/0x5c Aug 22 14:44:45 juju-e4d256-prod-github-runner-207 kernel: [33659.440548] dump_stack_lvl+0x4a/0x63 Aug 22 14:44:45 juju-e4d256-prod-github-runner-207 kernel: [33659.441292] dump_stack+0x10/0x16 Aug 22 14:44:45 juju-e4d256-prod-github-runner-207 kernel: [33659.442024] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 14:44:45 juju-e4d256-prod-github-runner-207 kernel: [33659.442805] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 14:44:45 juju-e4d256-prod-github-runner-207 kernel: [33659.443583] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 14:44:45 juju-e4d256-prod-github-runner-207 kernel: [33659.444404] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 14:44:45 juju-e4d256-prod-github-runner-207 kernel: [33659.445237] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 14:44:45 juju-e4d256-prod-github-runner-207 kernel: [33659.446058] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 14:44:45 juju-e4d256-prod-github-runner-207 kernel: [33659.446849] print_cpu_stall.cold+0x2f/0xe2 Aug 22 14:44:45 juju-e4d256-prod-github-runner-207 kernel: [33659.447614] ? timekeeping_update+0xf7/0x150 Aug 22 14:44:45 juju-e4d256-prod-github-runner-207 kernel: [33659.448389] check_cpu_stall+0x109/0x270 Aug 22 14:44:45 juju-e4d256-prod-github-runner-207 kernel: [33659.449135] rcu_sched_clock_irq+0x9a/0x250 Aug 22 14:44:45 juju-e4d256-prod-github-runner-207 kernel: [33659.449907] update_process_times+0x94/0xd0 Aug 22 14:44:45 juju-e4d256-prod-github-runner-207 kernel: [33659.450702] tick_sched_handle+0x29/0x70 Aug 22 14:44:45 juju-e4d256-prod-github-runner-207 kernel: [33659.451462] tick_sched_timer+0x8c/0xc0 Aug 22 14:44:45 juju-e4d256-prod-github-runner-207 kernel: [33659.452198] ? tick_nohz_handler+0xb0/0xb0 Aug 22 14:44:45 juju-e4d256-prod-github-runner-207 kernel: [33659.452952] __hrtimer_run_queues+0x107/0x230 Aug 22 14:44:45 juju-e4d256-prod-github-runner-207 kernel: [33659.453721] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 14:44:45 juju-e4d256-prod-github-runner-207 kernel: [33659.454511] hrtimer_interrupt+0x101/0x220 Aug 22 14:44:45 juju-e4d256-prod-github-runner-207 kernel: [33659.455268] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 14:44:45 juju-e4d256-prod-github-runner-207 kernel: [33659.456076] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 14:44:45 juju-e4d256-prod-github-runner-207 kernel: [33659.456874] Aug 22 14:44:45 juju-e4d256-prod-github-runner-207 kernel: [33659.457506] Aug 22 14:44:45 juju-e4d256-prod-github-runner-207 kernel: [33659.458156] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 14:44:45 juju-e4d256-prod-github-runner-207 kernel: [33659.458973] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:44:45 juju-e4d256-prod-github-runner-207 kernel: [33659.459850] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 14:44:45 juju-e4d256-prod-github-runner-207 kernel: [33659.462076] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 14:44:45 juju-e4d256-prod-github-runner-207 kernel: [33659.462953] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 14:44:45 juju-e4d256-prod-github-runner-207 kernel: [33659.463950] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 14:44:45 juju-e4d256-prod-github-runner-207 kernel: [33659.464925] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 14:44:45 juju-e4d256-prod-github-runner-207 kernel: [33659.465905] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 14:44:45 juju-e4d256-prod-github-runner-207 kernel: [33659.466859] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 14:44:45 juju-e4d256-prod-github-runner-207 kernel: [33659.467810] ? _raw_spin_lock+0x22/0x30 Aug 22 14:44:45 juju-e4d256-prod-github-runner-207 kernel: [33659.468574] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:44:45 juju-e4d256-prod-github-runner-207 kernel: [33659.469584] direct_page_fault+0x206/0x310 [kvm] Aug 22 14:44:45 juju-e4d256-prod-github-runner-207 kernel: [33659.470430] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 14:44:45 juju-e4d256-prod-github-runner-207 kernel: [33659.471259] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 14:44:45 juju-e4d256-prod-github-runner-207 kernel: [33659.472080] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 14:44:45 juju-e4d256-prod-github-runner-207 kernel: [33659.472886] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 14:44:45 juju-e4d256-prod-github-runner-207 kernel: [33659.473672] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 14:44:45 juju-e4d256-prod-github-runner-207 kernel: [33659.474513] handle_exit+0x98/0x230 [kvm_amd] Aug 22 14:44:45 juju-e4d256-prod-github-runner-207 kernel: [33659.475265] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 14:44:45 juju-e4d256-prod-github-runner-207 kernel: [33659.476052] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 14:44:45 juju-e4d256-prod-github-runner-207 kernel: [33659.476848] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 14:44:45 juju-e4d256-prod-github-runner-207 kernel: [33659.477632] vcpu_run+0x62/0x2c0 [kvm] Aug 22 14:44:45 juju-e4d256-prod-github-runner-207 kernel: [33659.478359] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 14:44:45 juju-e4d256-prod-github-runner-207 kernel: [33659.479098] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 14:44:45 juju-e4d256-prod-github-runner-207 kernel: [33659.479898] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 14:44:45 juju-e4d256-prod-github-runner-207 kernel: [33659.480657] ? __seccomp_filter+0x4a/0x4a0 Aug 22 14:44:45 juju-e4d256-prod-github-runner-207 kernel: [33659.481377] ? __fget_files+0x86/0xc0 Aug 22 14:44:45 juju-e4d256-prod-github-runner-207 kernel: [33659.482077] __x64_sys_ioctl+0x95/0xd0 Aug 22 14:44:45 juju-e4d256-prod-github-runner-207 kernel: [33659.482770] do_syscall_64+0x5c/0xc0 Aug 22 14:44:45 juju-e4d256-prod-github-runner-207 kernel: [33659.483455] ? do_futex+0x162/0x1f0 Aug 22 14:44:45 juju-e4d256-prod-github-runner-207 kernel: [33659.484129] ? __x64_sys_futex+0x78/0x1e0 Aug 22 14:44:45 juju-e4d256-prod-github-runner-207 kernel: [33659.484829] ? __secure_computing+0xa9/0x120 Aug 22 14:44:45 juju-e4d256-prod-github-runner-207 kernel: [33659.485559] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 14:44:45 juju-e4d256-prod-github-runner-207 kernel: [33659.486364] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:44:45 juju-e4d256-prod-github-runner-207 kernel: [33659.487116] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:44:45 juju-e4d256-prod-github-runner-207 kernel: [33659.487867] ? do_syscall_64+0x69/0xc0 Aug 22 14:44:45 juju-e4d256-prod-github-runner-207 kernel: [33659.488555] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:44:45 juju-e4d256-prod-github-runner-207 kernel: [33659.489308] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:44:45 juju-e4d256-prod-github-runner-207 kernel: [33659.490110] ? do_syscall_64+0x69/0xc0 Aug 22 14:44:45 juju-e4d256-prod-github-runner-207 kernel: [33659.490808] ? do_syscall_64+0x69/0xc0 Aug 22 14:44:45 juju-e4d256-prod-github-runner-207 kernel: [33659.491494] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 14:44:45 juju-e4d256-prod-github-runner-207 kernel: [33659.492301] RIP: 0033:0x7faa5d0edaff Aug 22 14:44:45 juju-e4d256-prod-github-runner-207 kernel: [33659.493006] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 14:44:45 juju-e4d256-prod-github-runner-207 kernel: [33659.495130] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 14:44:45 juju-e4d256-prod-github-runner-207 kernel: [33659.496096] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 14:44:45 juju-e4d256-prod-github-runner-207 kernel: [33659.497040] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 14:44:45 juju-e4d256-prod-github-runner-207 kernel: [33659.498013] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 14:44:45 juju-e4d256-prod-github-runner-207 kernel: [33659.498953] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 14:44:45 juju-e4d256-prod-github-runner-207 kernel: [33659.499878] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 14:44:45 juju-e4d256-prod-github-runner-207 kernel: [33659.500791] Aug 22 14:45:10 juju-e4d256-prod-github-runner-207 kernel: [33684.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 31263s! [qemu-system-x86:6715] Aug 22 14:45:10 juju-e4d256-prod-github-runner-207 kernel: [33684.543123] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 14:45:10 juju-e4d256-prod-github-runner-207 kernel: [33684.543196] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 14:45:10 juju-e4d256-prod-github-runner-207 kernel: [33684.555785] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 14:45:10 juju-e4d256-prod-github-runner-207 kernel: [33684.557084] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 14:45:10 juju-e4d256-prod-github-runner-207 kernel: [33684.558337] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:45:10 juju-e4d256-prod-github-runner-207 kernel: [33684.559412] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 14:45:10 juju-e4d256-prod-github-runner-207 kernel: [33684.562619] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 14:45:10 juju-e4d256-prod-github-runner-207 kernel: [33684.563737] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 14:45:10 juju-e4d256-prod-github-runner-207 kernel: [33684.564922] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 14:45:10 juju-e4d256-prod-github-runner-207 kernel: [33684.566123] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 14:45:10 juju-e4d256-prod-github-runner-207 kernel: [33684.567306] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 14:45:10 juju-e4d256-prod-github-runner-207 kernel: [33684.568535] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 14:45:10 juju-e4d256-prod-github-runner-207 kernel: [33684.569755] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 14:45:10 juju-e4d256-prod-github-runner-207 kernel: [33684.571023] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 14:45:10 juju-e4d256-prod-github-runner-207 kernel: [33684.572133] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 14:45:10 juju-e4d256-prod-github-runner-207 kernel: [33684.573403] Call Trace: Aug 22 14:45:10 juju-e4d256-prod-github-runner-207 kernel: [33684.574377] Aug 22 14:45:10 juju-e4d256-prod-github-runner-207 kernel: [33684.575282] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:45:10 juju-e4d256-prod-github-runner-207 kernel: [33684.576334] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:45:10 juju-e4d256-prod-github-runner-207 kernel: [33684.577367] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:45:10 juju-e4d256-prod-github-runner-207 kernel: [33684.578469] ? show_regs.part.0+0x23/0x29 Aug 22 14:45:10 juju-e4d256-prod-github-runner-207 kernel: [33684.579481] ? show_regs.cold+0x8/0xd Aug 22 14:45:10 juju-e4d256-prod-github-runner-207 kernel: [33684.580524] ? watchdog_timer_fn+0x1be/0x220 Aug 22 14:45:10 juju-e4d256-prod-github-runner-207 kernel: [33684.581598] ? lockup_detector_update_enable+0x60/0x60 Aug 22 14:45:10 juju-e4d256-prod-github-runner-207 kernel: [33684.582696] ? __hrtimer_run_queues+0x107/0x230 Aug 22 14:45:10 juju-e4d256-prod-github-runner-207 kernel: [33684.583764] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 14:45:10 juju-e4d256-prod-github-runner-207 kernel: [33684.584810] ? hrtimer_interrupt+0x101/0x220 Aug 22 14:45:10 juju-e4d256-prod-github-runner-207 kernel: [33684.585928] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 14:45:10 juju-e4d256-prod-github-runner-207 kernel: [33684.587038] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 14:45:10 juju-e4d256-prod-github-runner-207 kernel: [33684.588102] Aug 22 14:45:10 juju-e4d256-prod-github-runner-207 kernel: [33684.588969] Aug 22 14:45:10 juju-e4d256-prod-github-runner-207 kernel: [33684.589851] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 14:45:10 juju-e4d256-prod-github-runner-207 kernel: [33684.590962] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:45:10 juju-e4d256-prod-github-runner-207 kernel: [33684.592052] ? _raw_spin_lock+0x22/0x30 Aug 22 14:45:10 juju-e4d256-prod-github-runner-207 kernel: [33684.593070] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:45:10 juju-e4d256-prod-github-runner-207 kernel: [33684.594147] direct_page_fault+0x206/0x310 [kvm] Aug 22 14:45:10 juju-e4d256-prod-github-runner-207 kernel: [33684.595208] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 14:45:10 juju-e4d256-prod-github-runner-207 kernel: [33684.596304] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 14:45:10 juju-e4d256-prod-github-runner-207 kernel: [33684.597337] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 14:45:10 juju-e4d256-prod-github-runner-207 kernel: [33684.598350] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 14:45:10 juju-e4d256-prod-github-runner-207 kernel: [33684.599450] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 14:45:10 juju-e4d256-prod-github-runner-207 kernel: [33684.600460] handle_exit+0x98/0x230 [kvm_amd] Aug 22 14:45:10 juju-e4d256-prod-github-runner-207 kernel: [33684.601879] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 14:45:10 juju-e4d256-prod-github-runner-207 kernel: [33684.602868] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 14:45:10 juju-e4d256-prod-github-runner-207 kernel: [33684.603883] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 14:45:10 juju-e4d256-prod-github-runner-207 kernel: [33684.604934] vcpu_run+0x62/0x2c0 [kvm] Aug 22 14:45:10 juju-e4d256-prod-github-runner-207 kernel: [33684.605833] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 14:45:10 juju-e4d256-prod-github-runner-207 kernel: [33684.606694] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 14:45:10 juju-e4d256-prod-github-runner-207 kernel: [33684.607655] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 14:45:10 juju-e4d256-prod-github-runner-207 kernel: [33684.608485] ? __seccomp_filter+0x4a/0x4a0 Aug 22 14:45:10 juju-e4d256-prod-github-runner-207 kernel: [33684.609244] ? __fget_files+0x86/0xc0 Aug 22 14:45:10 juju-e4d256-prod-github-runner-207 kernel: [33684.609993] __x64_sys_ioctl+0x95/0xd0 Aug 22 14:45:10 juju-e4d256-prod-github-runner-207 kernel: [33684.610714] do_syscall_64+0x5c/0xc0 Aug 22 14:45:10 juju-e4d256-prod-github-runner-207 kernel: [33684.611415] ? do_futex+0x162/0x1f0 Aug 22 14:45:10 juju-e4d256-prod-github-runner-207 kernel: [33684.612146] ? __x64_sys_futex+0x78/0x1e0 Aug 22 14:45:10 juju-e4d256-prod-github-runner-207 kernel: [33684.612840] ? __secure_computing+0xa9/0x120 Aug 22 14:45:10 juju-e4d256-prod-github-runner-207 kernel: [33684.613577] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 14:45:10 juju-e4d256-prod-github-runner-207 kernel: [33684.614363] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:45:10 juju-e4d256-prod-github-runner-207 kernel: [33684.615099] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:45:10 juju-e4d256-prod-github-runner-207 kernel: [33684.615851] ? do_syscall_64+0x69/0xc0 Aug 22 14:45:10 juju-e4d256-prod-github-runner-207 kernel: [33684.616551] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:45:10 juju-e4d256-prod-github-runner-207 kernel: [33684.617470] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:45:10 juju-e4d256-prod-github-runner-207 kernel: [33684.618251] ? do_syscall_64+0x69/0xc0 Aug 22 14:45:10 juju-e4d256-prod-github-runner-207 kernel: [33684.618897] ? do_syscall_64+0x69/0xc0 Aug 22 14:45:10 juju-e4d256-prod-github-runner-207 kernel: [33684.619537] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 14:45:10 juju-e4d256-prod-github-runner-207 kernel: [33684.620349] RIP: 0033:0x7faa5d0edaff Aug 22 14:45:10 juju-e4d256-prod-github-runner-207 kernel: [33684.621161] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 14:45:10 juju-e4d256-prod-github-runner-207 kernel: [33684.623229] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 14:45:10 juju-e4d256-prod-github-runner-207 kernel: [33684.624206] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 14:45:10 juju-e4d256-prod-github-runner-207 kernel: [33684.625150] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 14:45:10 juju-e4d256-prod-github-runner-207 kernel: [33684.626084] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 14:45:10 juju-e4d256-prod-github-runner-207 kernel: [33684.627013] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 14:45:10 juju-e4d256-prod-github-runner-207 kernel: [33684.628016] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 14:45:10 juju-e4d256-prod-github-runner-207 kernel: [33684.628960] Aug 22 14:45:38 juju-e4d256-prod-github-runner-207 kernel: [33712.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 31289s! [qemu-system-x86:6715] Aug 22 14:45:38 juju-e4d256-prod-github-runner-207 kernel: [33712.543090] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 14:45:38 juju-e4d256-prod-github-runner-207 kernel: [33712.543162] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 14:45:38 juju-e4d256-prod-github-runner-207 kernel: [33712.556350] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 14:45:38 juju-e4d256-prod-github-runner-207 kernel: [33712.557693] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 14:45:38 juju-e4d256-prod-github-runner-207 kernel: [33712.558942] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:45:38 juju-e4d256-prod-github-runner-207 kernel: [33712.560134] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 14:45:38 juju-e4d256-prod-github-runner-207 kernel: [33712.562829] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 14:45:38 juju-e4d256-prod-github-runner-207 kernel: [33712.563888] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 14:45:38 juju-e4d256-prod-github-runner-207 kernel: [33712.565178] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 14:45:38 juju-e4d256-prod-github-runner-207 kernel: [33712.566396] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 14:45:38 juju-e4d256-prod-github-runner-207 kernel: [33712.567617] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 14:45:38 juju-e4d256-prod-github-runner-207 kernel: [33712.568794] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 14:45:38 juju-e4d256-prod-github-runner-207 kernel: [33712.570084] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 14:45:38 juju-e4d256-prod-github-runner-207 kernel: [33712.571470] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 14:45:38 juju-e4d256-prod-github-runner-207 kernel: [33712.572742] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 14:45:38 juju-e4d256-prod-github-runner-207 kernel: [33712.574055] Call Trace: Aug 22 14:45:38 juju-e4d256-prod-github-runner-207 kernel: [33712.575009] Aug 22 14:45:38 juju-e4d256-prod-github-runner-207 kernel: [33712.576012] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:45:38 juju-e4d256-prod-github-runner-207 kernel: [33712.577189] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:45:38 juju-e4d256-prod-github-runner-207 kernel: [33712.578274] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:45:38 juju-e4d256-prod-github-runner-207 kernel: [33712.579415] ? show_regs.part.0+0x23/0x29 Aug 22 14:45:38 juju-e4d256-prod-github-runner-207 kernel: [33712.580501] ? show_regs.cold+0x8/0xd Aug 22 14:45:38 juju-e4d256-prod-github-runner-207 kernel: [33712.581525] ? watchdog_timer_fn+0x1be/0x220 Aug 22 14:45:38 juju-e4d256-prod-github-runner-207 kernel: [33712.582730] ? lockup_detector_update_enable+0x60/0x60 Aug 22 14:45:38 juju-e4d256-prod-github-runner-207 kernel: [33712.583947] ? __hrtimer_run_queues+0x107/0x230 Aug 22 14:45:38 juju-e4d256-prod-github-runner-207 kernel: [33712.585094] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 14:45:38 juju-e4d256-prod-github-runner-207 kernel: [33712.586197] ? hrtimer_interrupt+0x101/0x220 Aug 22 14:45:38 juju-e4d256-prod-github-runner-207 kernel: [33712.587293] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 14:45:38 juju-e4d256-prod-github-runner-207 kernel: [33712.588497] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 14:45:38 juju-e4d256-prod-github-runner-207 kernel: [33712.589619] Aug 22 14:45:38 juju-e4d256-prod-github-runner-207 kernel: [33712.590489] Aug 22 14:45:38 juju-e4d256-prod-github-runner-207 kernel: [33712.591392] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 14:45:38 juju-e4d256-prod-github-runner-207 kernel: [33712.592541] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:45:38 juju-e4d256-prod-github-runner-207 kernel: [33712.593679] ? _raw_spin_lock+0x22/0x30 Aug 22 14:45:38 juju-e4d256-prod-github-runner-207 kernel: [33712.594649] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:45:38 juju-e4d256-prod-github-runner-207 kernel: [33712.595685] direct_page_fault+0x206/0x310 [kvm] Aug 22 14:45:38 juju-e4d256-prod-github-runner-207 kernel: [33712.596732] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 14:45:38 juju-e4d256-prod-github-runner-207 kernel: [33712.597809] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 14:45:38 juju-e4d256-prod-github-runner-207 kernel: [33712.598844] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 14:45:38 juju-e4d256-prod-github-runner-207 kernel: [33712.599826] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 14:45:38 juju-e4d256-prod-github-runner-207 kernel: [33712.600814] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 14:45:38 juju-e4d256-prod-github-runner-207 kernel: [33712.601943] handle_exit+0x98/0x230 [kvm_amd] Aug 22 14:45:38 juju-e4d256-prod-github-runner-207 kernel: [33712.602859] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 14:45:38 juju-e4d256-prod-github-runner-207 kernel: [33712.603798] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 14:45:38 juju-e4d256-prod-github-runner-207 kernel: [33712.604734] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 14:45:38 juju-e4d256-prod-github-runner-207 kernel: [33712.605855] vcpu_run+0x62/0x2c0 [kvm] Aug 22 14:45:38 juju-e4d256-prod-github-runner-207 kernel: [33712.606691] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 14:45:38 juju-e4d256-prod-github-runner-207 kernel: [33712.607516] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 14:45:38 juju-e4d256-prod-github-runner-207 kernel: [33712.608389] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 14:45:38 juju-e4d256-prod-github-runner-207 kernel: [33712.609217] ? __seccomp_filter+0x4a/0x4a0 Aug 22 14:45:38 juju-e4d256-prod-github-runner-207 kernel: [33712.609994] ? __fget_files+0x86/0xc0 Aug 22 14:45:38 juju-e4d256-prod-github-runner-207 kernel: [33712.610709] __x64_sys_ioctl+0x95/0xd0 Aug 22 14:45:38 juju-e4d256-prod-github-runner-207 kernel: [33712.611413] do_syscall_64+0x5c/0xc0 Aug 22 14:45:38 juju-e4d256-prod-github-runner-207 kernel: [33712.612287] ? do_futex+0x162/0x1f0 Aug 22 14:45:38 juju-e4d256-prod-github-runner-207 kernel: [33712.612948] ? __x64_sys_futex+0x78/0x1e0 Aug 22 14:45:38 juju-e4d256-prod-github-runner-207 kernel: [33712.613657] ? __secure_computing+0xa9/0x120 Aug 22 14:45:38 juju-e4d256-prod-github-runner-207 kernel: [33712.614365] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 14:45:38 juju-e4d256-prod-github-runner-207 kernel: [33712.615142] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:45:38 juju-e4d256-prod-github-runner-207 kernel: [33712.615878] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:45:38 juju-e4d256-prod-github-runner-207 kernel: [33712.616611] ? do_syscall_64+0x69/0xc0 Aug 22 14:45:38 juju-e4d256-prod-github-runner-207 kernel: [33712.617298] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:45:38 juju-e4d256-prod-github-runner-207 kernel: [33712.618027] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:45:38 juju-e4d256-prod-github-runner-207 kernel: [33712.618747] ? do_syscall_64+0x69/0xc0 Aug 22 14:45:38 juju-e4d256-prod-github-runner-207 kernel: [33712.619382] ? do_syscall_64+0x69/0xc0 Aug 22 14:45:38 juju-e4d256-prod-github-runner-207 kernel: [33712.620022] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 14:45:38 juju-e4d256-prod-github-runner-207 kernel: [33712.620743] RIP: 0033:0x7faa5d0edaff Aug 22 14:45:38 juju-e4d256-prod-github-runner-207 kernel: [33712.621405] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 14:45:38 juju-e4d256-prod-github-runner-207 kernel: [33712.623482] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 14:45:38 juju-e4d256-prod-github-runner-207 kernel: [33712.624418] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 14:45:38 juju-e4d256-prod-github-runner-207 kernel: [33712.625350] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 14:45:38 juju-e4d256-prod-github-runner-207 kernel: [33712.626266] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 14:45:38 juju-e4d256-prod-github-runner-207 kernel: [33712.627174] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 14:45:38 juju-e4d256-prod-github-runner-207 kernel: [33712.628096] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 14:45:38 juju-e4d256-prod-github-runner-207 kernel: [33712.629014] Aug 22 14:46:06 juju-e4d256-prod-github-runner-207 kernel: [33740.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 31315s! [qemu-system-x86:6715] Aug 22 14:46:06 juju-e4d256-prod-github-runner-207 kernel: [33740.543834] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 14:46:06 juju-e4d256-prod-github-runner-207 kernel: [33740.544133] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 14:46:06 juju-e4d256-prod-github-runner-207 kernel: [33740.556493] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 14:46:06 juju-e4d256-prod-github-runner-207 kernel: [33740.557797] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 14:46:06 juju-e4d256-prod-github-runner-207 kernel: [33740.559040] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:46:06 juju-e4d256-prod-github-runner-207 kernel: [33740.560124] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 14:46:06 juju-e4d256-prod-github-runner-207 kernel: [33740.562753] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 14:46:06 juju-e4d256-prod-github-runner-207 kernel: [33740.563816] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 14:46:06 juju-e4d256-prod-github-runner-207 kernel: [33740.565011] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 14:46:06 juju-e4d256-prod-github-runner-207 kernel: [33740.566194] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 14:46:06 juju-e4d256-prod-github-runner-207 kernel: [33740.567387] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 14:46:06 juju-e4d256-prod-github-runner-207 kernel: [33740.568592] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 14:46:06 juju-e4d256-prod-github-runner-207 kernel: [33740.569790] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 14:46:06 juju-e4d256-prod-github-runner-207 kernel: [33740.571053] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 14:46:06 juju-e4d256-prod-github-runner-207 kernel: [33740.572170] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 14:46:06 juju-e4d256-prod-github-runner-207 kernel: [33740.573428] Call Trace: Aug 22 14:46:06 juju-e4d256-prod-github-runner-207 kernel: [33740.574356] Aug 22 14:46:06 juju-e4d256-prod-github-runner-207 kernel: [33740.575257] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:46:06 juju-e4d256-prod-github-runner-207 kernel: [33740.576311] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:46:06 juju-e4d256-prod-github-runner-207 kernel: [33740.577356] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:46:06 juju-e4d256-prod-github-runner-207 kernel: [33740.578460] ? show_regs.part.0+0x23/0x29 Aug 22 14:46:06 juju-e4d256-prod-github-runner-207 kernel: [33740.579477] ? show_regs.cold+0x8/0xd Aug 22 14:46:06 juju-e4d256-prod-github-runner-207 kernel: [33740.580465] ? watchdog_timer_fn+0x1be/0x220 Aug 22 14:46:06 juju-e4d256-prod-github-runner-207 kernel: [33740.581496] ? lockup_detector_update_enable+0x60/0x60 Aug 22 14:46:06 juju-e4d256-prod-github-runner-207 kernel: [33740.582583] ? __hrtimer_run_queues+0x107/0x230 Aug 22 14:46:06 juju-e4d256-prod-github-runner-207 kernel: [33740.583622] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 14:46:06 juju-e4d256-prod-github-runner-207 kernel: [33740.584666] ? hrtimer_interrupt+0x101/0x220 Aug 22 14:46:06 juju-e4d256-prod-github-runner-207 kernel: [33740.585727] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 14:46:06 juju-e4d256-prod-github-runner-207 kernel: [33740.586825] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 14:46:06 juju-e4d256-prod-github-runner-207 kernel: [33740.587896] Aug 22 14:46:06 juju-e4d256-prod-github-runner-207 kernel: [33740.588753] Aug 22 14:46:06 juju-e4d256-prod-github-runner-207 kernel: [33740.589613] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 14:46:06 juju-e4d256-prod-github-runner-207 kernel: [33740.590660] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:46:06 juju-e4d256-prod-github-runner-207 kernel: [33740.591721] ? _raw_spin_lock+0x22/0x30 Aug 22 14:46:06 juju-e4d256-prod-github-runner-207 kernel: [33740.592676] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:46:06 juju-e4d256-prod-github-runner-207 kernel: [33740.593716] direct_page_fault+0x206/0x310 [kvm] Aug 22 14:46:06 juju-e4d256-prod-github-runner-207 kernel: [33740.594752] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 14:46:06 juju-e4d256-prod-github-runner-207 kernel: [33740.595827] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 14:46:06 juju-e4d256-prod-github-runner-207 kernel: [33740.596839] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 14:46:06 juju-e4d256-prod-github-runner-207 kernel: [33740.597862] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 14:46:06 juju-e4d256-prod-github-runner-207 kernel: [33740.598838] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 14:46:06 juju-e4d256-prod-github-runner-207 kernel: [33740.599855] handle_exit+0x98/0x230 [kvm_amd] Aug 22 14:46:06 juju-e4d256-prod-github-runner-207 kernel: [33740.600767] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 14:46:06 juju-e4d256-prod-github-runner-207 kernel: [33740.601706] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 14:46:06 juju-e4d256-prod-github-runner-207 kernel: [33740.602651] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 14:46:06 juju-e4d256-prod-github-runner-207 kernel: [33740.603594] vcpu_run+0x62/0x2c0 [kvm] Aug 22 14:46:06 juju-e4d256-prod-github-runner-207 kernel: [33740.604420] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 14:46:06 juju-e4d256-prod-github-runner-207 kernel: [33740.605259] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 14:46:06 juju-e4d256-prod-github-runner-207 kernel: [33740.606128] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 14:46:06 juju-e4d256-prod-github-runner-207 kernel: [33740.606979] ? __seccomp_filter+0x4a/0x4a0 Aug 22 14:46:06 juju-e4d256-prod-github-runner-207 kernel: [33740.607751] ? __fget_files+0x86/0xc0 Aug 22 14:46:06 juju-e4d256-prod-github-runner-207 kernel: [33740.608466] __x64_sys_ioctl+0x95/0xd0 Aug 22 14:46:06 juju-e4d256-prod-github-runner-207 kernel: [33740.609181] do_syscall_64+0x5c/0xc0 Aug 22 14:46:06 juju-e4d256-prod-github-runner-207 kernel: [33740.609859] ? do_futex+0x162/0x1f0 Aug 22 14:46:06 juju-e4d256-prod-github-runner-207 kernel: [33740.610521] ? __x64_sys_futex+0x78/0x1e0 Aug 22 14:46:06 juju-e4d256-prod-github-runner-207 kernel: [33740.611212] ? __secure_computing+0xa9/0x120 Aug 22 14:46:06 juju-e4d256-prod-github-runner-207 kernel: [33740.611922] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 14:46:06 juju-e4d256-prod-github-runner-207 kernel: [33740.612713] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:46:06 juju-e4d256-prod-github-runner-207 kernel: [33740.613473] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:46:06 juju-e4d256-prod-github-runner-207 kernel: [33740.614210] ? do_syscall_64+0x69/0xc0 Aug 22 14:46:06 juju-e4d256-prod-github-runner-207 kernel: [33740.614960] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:46:06 juju-e4d256-prod-github-runner-207 kernel: [33740.615676] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:46:06 juju-e4d256-prod-github-runner-207 kernel: [33740.616383] ? do_syscall_64+0x69/0xc0 Aug 22 14:46:06 juju-e4d256-prod-github-runner-207 kernel: [33740.617037] ? do_syscall_64+0x69/0xc0 Aug 22 14:46:06 juju-e4d256-prod-github-runner-207 kernel: [33740.617675] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 14:46:06 juju-e4d256-prod-github-runner-207 kernel: [33740.618405] RIP: 0033:0x7faa5d0edaff Aug 22 14:46:06 juju-e4d256-prod-github-runner-207 kernel: [33740.619070] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 14:46:06 juju-e4d256-prod-github-runner-207 kernel: [33740.621223] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 14:46:06 juju-e4d256-prod-github-runner-207 kernel: [33740.622182] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 14:46:06 juju-e4d256-prod-github-runner-207 kernel: [33740.623105] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 14:46:06 juju-e4d256-prod-github-runner-207 kernel: [33740.624009] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 14:46:06 juju-e4d256-prod-github-runner-207 kernel: [33740.624943] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 14:46:06 juju-e4d256-prod-github-runner-207 kernel: [33740.625929] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 14:46:06 juju-e4d256-prod-github-runner-207 kernel: [33740.626863] Aug 22 14:46:34 juju-e4d256-prod-github-runner-207 kernel: [33768.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 31341s! [qemu-system-x86:6715] Aug 22 14:46:34 juju-e4d256-prod-github-runner-207 kernel: [33768.543134] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 14:46:34 juju-e4d256-prod-github-runner-207 kernel: [33768.543210] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 14:46:34 juju-e4d256-prod-github-runner-207 kernel: [33768.555777] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 14:46:34 juju-e4d256-prod-github-runner-207 kernel: [33768.557094] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 14:46:34 juju-e4d256-prod-github-runner-207 kernel: [33768.558386] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:46:34 juju-e4d256-prod-github-runner-207 kernel: [33768.559460] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 14:46:34 juju-e4d256-prod-github-runner-207 kernel: [33768.562171] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 14:46:34 juju-e4d256-prod-github-runner-207 kernel: [33768.563453] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 14:46:34 juju-e4d256-prod-github-runner-207 kernel: [33768.564636] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 14:46:34 juju-e4d256-prod-github-runner-207 kernel: [33768.565815] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 14:46:34 juju-e4d256-prod-github-runner-207 kernel: [33768.567016] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 14:46:34 juju-e4d256-prod-github-runner-207 kernel: [33768.568230] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 14:46:34 juju-e4d256-prod-github-runner-207 kernel: [33768.569431] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 14:46:34 juju-e4d256-prod-github-runner-207 kernel: [33768.570684] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 14:46:34 juju-e4d256-prod-github-runner-207 kernel: [33768.571831] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 14:46:34 juju-e4d256-prod-github-runner-207 kernel: [33768.573081] Call Trace: Aug 22 14:46:34 juju-e4d256-prod-github-runner-207 kernel: [33768.574010] Aug 22 14:46:34 juju-e4d256-prod-github-runner-207 kernel: [33768.574897] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:46:34 juju-e4d256-prod-github-runner-207 kernel: [33768.575943] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:46:34 juju-e4d256-prod-github-runner-207 kernel: [33768.577003] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:46:34 juju-e4d256-prod-github-runner-207 kernel: [33768.578125] ? show_regs.part.0+0x23/0x29 Aug 22 14:46:34 juju-e4d256-prod-github-runner-207 kernel: [33768.579198] ? show_regs.cold+0x8/0xd Aug 22 14:46:34 juju-e4d256-prod-github-runner-207 kernel: [33768.580192] ? watchdog_timer_fn+0x1be/0x220 Aug 22 14:46:34 juju-e4d256-prod-github-runner-207 kernel: [33768.581243] ? lockup_detector_update_enable+0x60/0x60 Aug 22 14:46:34 juju-e4d256-prod-github-runner-207 kernel: [33768.582344] ? __hrtimer_run_queues+0x107/0x230 Aug 22 14:46:34 juju-e4d256-prod-github-runner-207 kernel: [33768.583393] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 14:46:34 juju-e4d256-prod-github-runner-207 kernel: [33768.584455] ? hrtimer_interrupt+0x101/0x220 Aug 22 14:46:34 juju-e4d256-prod-github-runner-207 kernel: [33768.585494] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 14:46:34 juju-e4d256-prod-github-runner-207 kernel: [33768.586584] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 14:46:34 juju-e4d256-prod-github-runner-207 kernel: [33768.587666] Aug 22 14:46:34 juju-e4d256-prod-github-runner-207 kernel: [33768.588542] Aug 22 14:46:34 juju-e4d256-prod-github-runner-207 kernel: [33768.589430] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 14:46:34 juju-e4d256-prod-github-runner-207 kernel: [33768.590470] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:46:34 juju-e4d256-prod-github-runner-207 kernel: [33768.591534] ? _raw_spin_lock+0x22/0x30 Aug 22 14:46:34 juju-e4d256-prod-github-runner-207 kernel: [33768.592523] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:46:34 juju-e4d256-prod-github-runner-207 kernel: [33768.593584] direct_page_fault+0x206/0x310 [kvm] Aug 22 14:46:34 juju-e4d256-prod-github-runner-207 kernel: [33768.594630] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 14:46:34 juju-e4d256-prod-github-runner-207 kernel: [33768.595643] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 14:46:34 juju-e4d256-prod-github-runner-207 kernel: [33768.596675] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 14:46:34 juju-e4d256-prod-github-runner-207 kernel: [33768.597668] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 14:46:34 juju-e4d256-prod-github-runner-207 kernel: [33768.598645] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 14:46:34 juju-e4d256-prod-github-runner-207 kernel: [33768.599656] handle_exit+0x98/0x230 [kvm_amd] Aug 22 14:46:34 juju-e4d256-prod-github-runner-207 kernel: [33768.600557] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 14:46:34 juju-e4d256-prod-github-runner-207 kernel: [33768.601517] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 14:46:34 juju-e4d256-prod-github-runner-207 kernel: [33768.602483] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 14:46:34 juju-e4d256-prod-github-runner-207 kernel: [33768.603416] vcpu_run+0x62/0x2c0 [kvm] Aug 22 14:46:34 juju-e4d256-prod-github-runner-207 kernel: [33768.604254] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 14:46:34 juju-e4d256-prod-github-runner-207 kernel: [33768.605107] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 14:46:34 juju-e4d256-prod-github-runner-207 kernel: [33768.605977] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 14:46:34 juju-e4d256-prod-github-runner-207 kernel: [33768.606794] ? __seccomp_filter+0x4a/0x4a0 Aug 22 14:46:34 juju-e4d256-prod-github-runner-207 kernel: [33768.607561] ? __fget_files+0x86/0xc0 Aug 22 14:46:34 juju-e4d256-prod-github-runner-207 kernel: [33768.608291] __x64_sys_ioctl+0x95/0xd0 Aug 22 14:46:34 juju-e4d256-prod-github-runner-207 kernel: [33768.609020] do_syscall_64+0x5c/0xc0 Aug 22 14:46:34 juju-e4d256-prod-github-runner-207 kernel: [33768.609732] ? do_futex+0x162/0x1f0 Aug 22 14:46:34 juju-e4d256-prod-github-runner-207 kernel: [33768.610388] ? __x64_sys_futex+0x78/0x1e0 Aug 22 14:46:34 juju-e4d256-prod-github-runner-207 kernel: [33768.611065] ? __secure_computing+0xa9/0x120 Aug 22 14:46:34 juju-e4d256-prod-github-runner-207 kernel: [33768.611772] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 14:46:34 juju-e4d256-prod-github-runner-207 kernel: [33768.612580] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:46:34 juju-e4d256-prod-github-runner-207 kernel: [33768.613342] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:46:34 juju-e4d256-prod-github-runner-207 kernel: [33768.614086] ? do_syscall_64+0x69/0xc0 Aug 22 14:46:34 juju-e4d256-prod-github-runner-207 kernel: [33768.614759] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:46:34 juju-e4d256-prod-github-runner-207 kernel: [33768.615475] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:46:34 juju-e4d256-prod-github-runner-207 kernel: [33768.616175] ? do_syscall_64+0x69/0xc0 Aug 22 14:46:34 juju-e4d256-prod-github-runner-207 kernel: [33768.616847] ? do_syscall_64+0x69/0xc0 Aug 22 14:46:34 juju-e4d256-prod-github-runner-207 kernel: [33768.617504] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 14:46:34 juju-e4d256-prod-github-runner-207 kernel: [33768.618234] RIP: 0033:0x7faa5d0edaff Aug 22 14:46:34 juju-e4d256-prod-github-runner-207 kernel: [33768.618896] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 14:46:34 juju-e4d256-prod-github-runner-207 kernel: [33768.620982] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 14:46:34 juju-e4d256-prod-github-runner-207 kernel: [33768.621926] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 14:46:34 juju-e4d256-prod-github-runner-207 kernel: [33768.623002] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 14:46:34 juju-e4d256-prod-github-runner-207 kernel: [33768.624044] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 14:46:34 juju-e4d256-prod-github-runner-207 kernel: [33768.625129] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 14:46:34 juju-e4d256-prod-github-runner-207 kernel: [33768.626169] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 14:46:34 juju-e4d256-prod-github-runner-207 kernel: [33768.627203] Aug 22 14:47:02 juju-e4d256-prod-github-runner-207 kernel: [33796.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 31367s! [qemu-system-x86:6715] Aug 22 14:47:02 juju-e4d256-prod-github-runner-207 kernel: [33796.543113] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 14:47:02 juju-e4d256-prod-github-runner-207 kernel: [33796.543189] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 14:47:02 juju-e4d256-prod-github-runner-207 kernel: [33796.555882] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 14:47:02 juju-e4d256-prod-github-runner-207 kernel: [33796.557177] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 14:47:02 juju-e4d256-prod-github-runner-207 kernel: [33796.558395] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:47:02 juju-e4d256-prod-github-runner-207 kernel: [33796.559485] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 14:47:02 juju-e4d256-prod-github-runner-207 kernel: [33796.562066] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 14:47:02 juju-e4d256-prod-github-runner-207 kernel: [33796.563124] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 14:47:02 juju-e4d256-prod-github-runner-207 kernel: [33796.564320] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 14:47:02 juju-e4d256-prod-github-runner-207 kernel: [33796.565485] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 14:47:02 juju-e4d256-prod-github-runner-207 kernel: [33796.566679] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 14:47:02 juju-e4d256-prod-github-runner-207 kernel: [33796.567862] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 14:47:02 juju-e4d256-prod-github-runner-207 kernel: [33796.569057] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 14:47:02 juju-e4d256-prod-github-runner-207 kernel: [33796.570314] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 14:47:02 juju-e4d256-prod-github-runner-207 kernel: [33796.571424] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 14:47:02 juju-e4d256-prod-github-runner-207 kernel: [33796.572666] Call Trace: Aug 22 14:47:02 juju-e4d256-prod-github-runner-207 kernel: [33796.573588] Aug 22 14:47:02 juju-e4d256-prod-github-runner-207 kernel: [33796.574476] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:47:02 juju-e4d256-prod-github-runner-207 kernel: [33796.575504] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:47:02 juju-e4d256-prod-github-runner-207 kernel: [33796.576576] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:47:02 juju-e4d256-prod-github-runner-207 kernel: [33796.577659] ? show_regs.part.0+0x23/0x29 Aug 22 14:47:02 juju-e4d256-prod-github-runner-207 kernel: [33796.578655] ? show_regs.cold+0x8/0xd Aug 22 14:47:02 juju-e4d256-prod-github-runner-207 kernel: [33796.579624] ? watchdog_timer_fn+0x1be/0x220 Aug 22 14:47:02 juju-e4d256-prod-github-runner-207 kernel: [33796.580664] ? lockup_detector_update_enable+0x60/0x60 Aug 22 14:47:02 juju-e4d256-prod-github-runner-207 kernel: [33796.581732] ? __hrtimer_run_queues+0x107/0x230 Aug 22 14:47:02 juju-e4d256-prod-github-runner-207 kernel: [33796.582804] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 14:47:02 juju-e4d256-prod-github-runner-207 kernel: [33796.583856] ? hrtimer_interrupt+0x101/0x220 Aug 22 14:47:02 juju-e4d256-prod-github-runner-207 kernel: [33796.584932] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 14:47:02 juju-e4d256-prod-github-runner-207 kernel: [33796.586015] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 14:47:02 juju-e4d256-prod-github-runner-207 kernel: [33796.587073] Aug 22 14:47:02 juju-e4d256-prod-github-runner-207 kernel: [33796.588042] Aug 22 14:47:02 juju-e4d256-prod-github-runner-207 kernel: [33796.589058] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 14:47:02 juju-e4d256-prod-github-runner-207 kernel: [33796.590329] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:47:02 juju-e4d256-prod-github-runner-207 kernel: [33796.591522] ? _raw_spin_lock+0x22/0x30 Aug 22 14:47:02 juju-e4d256-prod-github-runner-207 kernel: [33796.592770] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:47:02 juju-e4d256-prod-github-runner-207 kernel: [33796.593906] direct_page_fault+0x206/0x310 [kvm] Aug 22 14:47:02 juju-e4d256-prod-github-runner-207 kernel: [33796.594943] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 14:47:02 juju-e4d256-prod-github-runner-207 kernel: [33796.595960] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 14:47:02 juju-e4d256-prod-github-runner-207 kernel: [33796.597015] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 14:47:02 juju-e4d256-prod-github-runner-207 kernel: [33796.598006] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 14:47:02 juju-e4d256-prod-github-runner-207 kernel: [33796.598949] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 14:47:02 juju-e4d256-prod-github-runner-207 kernel: [33796.599933] handle_exit+0x98/0x230 [kvm_amd] Aug 22 14:47:02 juju-e4d256-prod-github-runner-207 kernel: [33796.600850] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 14:47:02 juju-e4d256-prod-github-runner-207 kernel: [33796.601779] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 14:47:02 juju-e4d256-prod-github-runner-207 kernel: [33796.602715] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 14:47:02 juju-e4d256-prod-github-runner-207 kernel: [33796.603625] vcpu_run+0x62/0x2c0 [kvm] Aug 22 14:47:02 juju-e4d256-prod-github-runner-207 kernel: [33796.604489] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 14:47:02 juju-e4d256-prod-github-runner-207 kernel: [33796.605300] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 14:47:02 juju-e4d256-prod-github-runner-207 kernel: [33796.606155] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 14:47:02 juju-e4d256-prod-github-runner-207 kernel: [33796.606955] ? __seccomp_filter+0x4a/0x4a0 Aug 22 14:47:02 juju-e4d256-prod-github-runner-207 kernel: [33796.607718] ? __fget_files+0x86/0xc0 Aug 22 14:47:02 juju-e4d256-prod-github-runner-207 kernel: [33796.608453] __x64_sys_ioctl+0x95/0xd0 Aug 22 14:47:02 juju-e4d256-prod-github-runner-207 kernel: [33796.609146] do_syscall_64+0x5c/0xc0 Aug 22 14:47:02 juju-e4d256-prod-github-runner-207 kernel: [33796.609818] ? do_futex+0x162/0x1f0 Aug 22 14:47:02 juju-e4d256-prod-github-runner-207 kernel: [33796.610465] ? __x64_sys_futex+0x78/0x1e0 Aug 22 14:47:02 juju-e4d256-prod-github-runner-207 kernel: [33796.611157] ? __secure_computing+0xa9/0x120 Aug 22 14:47:02 juju-e4d256-prod-github-runner-207 kernel: [33796.611905] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 14:47:02 juju-e4d256-prod-github-runner-207 kernel: [33796.612704] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:47:02 juju-e4d256-prod-github-runner-207 kernel: [33796.613442] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:47:02 juju-e4d256-prod-github-runner-207 kernel: [33796.614171] ? do_syscall_64+0x69/0xc0 Aug 22 14:47:02 juju-e4d256-prod-github-runner-207 kernel: [33796.614820] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:47:02 juju-e4d256-prod-github-runner-207 kernel: [33796.615525] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:47:02 juju-e4d256-prod-github-runner-207 kernel: [33796.616240] ? do_syscall_64+0x69/0xc0 Aug 22 14:47:02 juju-e4d256-prod-github-runner-207 kernel: [33796.616892] ? do_syscall_64+0x69/0xc0 Aug 22 14:47:02 juju-e4d256-prod-github-runner-207 kernel: [33796.617533] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 14:47:02 juju-e4d256-prod-github-runner-207 kernel: [33796.618245] RIP: 0033:0x7faa5d0edaff Aug 22 14:47:02 juju-e4d256-prod-github-runner-207 kernel: [33796.618879] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 14:47:02 juju-e4d256-prod-github-runner-207 kernel: [33796.620944] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 14:47:02 juju-e4d256-prod-github-runner-207 kernel: [33796.621863] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 14:47:02 juju-e4d256-prod-github-runner-207 kernel: [33796.622778] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 14:47:02 juju-e4d256-prod-github-runner-207 kernel: [33796.623701] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 14:47:02 juju-e4d256-prod-github-runner-207 kernel: [33796.624625] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 14:47:02 juju-e4d256-prod-github-runner-207 kernel: [33796.625563] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 14:47:02 juju-e4d256-prod-github-runner-207 kernel: [33796.626476] Aug 22 14:47:30 juju-e4d256-prod-github-runner-207 kernel: [33824.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 31393s! [qemu-system-x86:6715] Aug 22 14:47:30 juju-e4d256-prod-github-runner-207 kernel: [33824.543199] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 14:47:30 juju-e4d256-prod-github-runner-207 kernel: [33824.543432] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 14:47:30 juju-e4d256-prod-github-runner-207 kernel: [33824.555846] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 14:47:30 juju-e4d256-prod-github-runner-207 kernel: [33824.557144] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 14:47:30 juju-e4d256-prod-github-runner-207 kernel: [33824.558383] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:47:30 juju-e4d256-prod-github-runner-207 kernel: [33824.559460] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 14:47:30 juju-e4d256-prod-github-runner-207 kernel: [33824.562070] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 14:47:30 juju-e4d256-prod-github-runner-207 kernel: [33824.563122] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 14:47:30 juju-e4d256-prod-github-runner-207 kernel: [33824.564336] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 14:47:30 juju-e4d256-prod-github-runner-207 kernel: [33824.565636] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 14:47:30 juju-e4d256-prod-github-runner-207 kernel: [33824.566992] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 14:47:30 juju-e4d256-prod-github-runner-207 kernel: [33824.568183] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 14:47:30 juju-e4d256-prod-github-runner-207 kernel: [33824.569427] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 14:47:30 juju-e4d256-prod-github-runner-207 kernel: [33824.571223] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 14:47:30 juju-e4d256-prod-github-runner-207 kernel: [33824.572549] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 14:47:30 juju-e4d256-prod-github-runner-207 kernel: [33824.573771] Call Trace: Aug 22 14:47:30 juju-e4d256-prod-github-runner-207 kernel: [33824.574705] Aug 22 14:47:30 juju-e4d256-prod-github-runner-207 kernel: [33824.575626] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:47:30 juju-e4d256-prod-github-runner-207 kernel: [33824.576693] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:47:30 juju-e4d256-prod-github-runner-207 kernel: [33824.577732] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:47:30 juju-e4d256-prod-github-runner-207 kernel: [33824.578847] ? show_regs.part.0+0x23/0x29 Aug 22 14:47:30 juju-e4d256-prod-github-runner-207 kernel: [33824.579844] ? show_regs.cold+0x8/0xd Aug 22 14:47:30 juju-e4d256-prod-github-runner-207 kernel: [33824.580827] ? watchdog_timer_fn+0x1be/0x220 Aug 22 14:47:30 juju-e4d256-prod-github-runner-207 kernel: [33824.581858] ? lockup_detector_update_enable+0x60/0x60 Aug 22 14:47:30 juju-e4d256-prod-github-runner-207 kernel: [33824.582988] ? __hrtimer_run_queues+0x107/0x230 Aug 22 14:47:30 juju-e4d256-prod-github-runner-207 kernel: [33824.584067] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 14:47:30 juju-e4d256-prod-github-runner-207 kernel: [33824.585124] ? hrtimer_interrupt+0x101/0x220 Aug 22 14:47:30 juju-e4d256-prod-github-runner-207 kernel: [33824.586156] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 14:47:30 juju-e4d256-prod-github-runner-207 kernel: [33824.587237] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 14:47:30 juju-e4d256-prod-github-runner-207 kernel: [33824.588305] Aug 22 14:47:30 juju-e4d256-prod-github-runner-207 kernel: [33824.589160] Aug 22 14:47:30 juju-e4d256-prod-github-runner-207 kernel: [33824.589999] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 14:47:30 juju-e4d256-prod-github-runner-207 kernel: [33824.591042] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:47:30 juju-e4d256-prod-github-runner-207 kernel: [33824.592105] ? _raw_spin_lock+0x22/0x30 Aug 22 14:47:30 juju-e4d256-prod-github-runner-207 kernel: [33824.593060] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:47:30 juju-e4d256-prod-github-runner-207 kernel: [33824.594078] direct_page_fault+0x206/0x310 [kvm] Aug 22 14:47:30 juju-e4d256-prod-github-runner-207 kernel: [33824.595112] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 14:47:30 juju-e4d256-prod-github-runner-207 kernel: [33824.596141] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 14:47:30 juju-e4d256-prod-github-runner-207 kernel: [33824.597143] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 14:47:30 juju-e4d256-prod-github-runner-207 kernel: [33824.598137] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 14:47:30 juju-e4d256-prod-github-runner-207 kernel: [33824.599082] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 14:47:30 juju-e4d256-prod-github-runner-207 kernel: [33824.600069] handle_exit+0x98/0x230 [kvm_amd] Aug 22 14:47:30 juju-e4d256-prod-github-runner-207 kernel: [33824.600968] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 14:47:30 juju-e4d256-prod-github-runner-207 kernel: [33824.601881] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 14:47:30 juju-e4d256-prod-github-runner-207 kernel: [33824.602802] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 14:47:30 juju-e4d256-prod-github-runner-207 kernel: [33824.603709] vcpu_run+0x62/0x2c0 [kvm] Aug 22 14:47:30 juju-e4d256-prod-github-runner-207 kernel: [33824.604551] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 14:47:30 juju-e4d256-prod-github-runner-207 kernel: [33824.605361] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 14:47:30 juju-e4d256-prod-github-runner-207 kernel: [33824.606214] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 14:47:30 juju-e4d256-prod-github-runner-207 kernel: [33824.607016] ? __seccomp_filter+0x4a/0x4a0 Aug 22 14:47:30 juju-e4d256-prod-github-runner-207 kernel: [33824.607763] ? __fget_files+0x86/0xc0 Aug 22 14:47:30 juju-e4d256-prod-github-runner-207 kernel: [33824.608485] __x64_sys_ioctl+0x95/0xd0 Aug 22 14:47:30 juju-e4d256-prod-github-runner-207 kernel: [33824.609186] do_syscall_64+0x5c/0xc0 Aug 22 14:47:30 juju-e4d256-prod-github-runner-207 kernel: [33824.609853] ? do_futex+0x162/0x1f0 Aug 22 14:47:30 juju-e4d256-prod-github-runner-207 kernel: [33824.610501] ? __x64_sys_futex+0x78/0x1e0 Aug 22 14:47:30 juju-e4d256-prod-github-runner-207 kernel: [33824.611171] ? __secure_computing+0xa9/0x120 Aug 22 14:47:30 juju-e4d256-prod-github-runner-207 kernel: [33824.611861] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 14:47:30 juju-e4d256-prod-github-runner-207 kernel: [33824.612667] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:47:30 juju-e4d256-prod-github-runner-207 kernel: [33824.613397] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:47:30 juju-e4d256-prod-github-runner-207 kernel: [33824.614115] ? do_syscall_64+0x69/0xc0 Aug 22 14:47:30 juju-e4d256-prod-github-runner-207 kernel: [33824.614758] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:47:30 juju-e4d256-prod-github-runner-207 kernel: [33824.615461] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:47:30 juju-e4d256-prod-github-runner-207 kernel: [33824.616169] ? do_syscall_64+0x69/0xc0 Aug 22 14:47:30 juju-e4d256-prod-github-runner-207 kernel: [33824.616795] ? do_syscall_64+0x69/0xc0 Aug 22 14:47:30 juju-e4d256-prod-github-runner-207 kernel: [33824.617447] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 14:47:30 juju-e4d256-prod-github-runner-207 kernel: [33824.618149] RIP: 0033:0x7faa5d0edaff Aug 22 14:47:30 juju-e4d256-prod-github-runner-207 kernel: [33824.618861] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 14:47:30 juju-e4d256-prod-github-runner-207 kernel: [33824.620845] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 14:47:30 juju-e4d256-prod-github-runner-207 kernel: [33824.621754] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 14:47:30 juju-e4d256-prod-github-runner-207 kernel: [33824.622641] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 14:47:30 juju-e4d256-prod-github-runner-207 kernel: [33824.623525] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 14:47:30 juju-e4d256-prod-github-runner-207 kernel: [33824.624422] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 14:47:30 juju-e4d256-prod-github-runner-207 kernel: [33824.625352] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 14:47:30 juju-e4d256-prod-github-runner-207 kernel: [33824.626265] Aug 22 14:47:45 juju-e4d256-prod-github-runner-207 kernel: [33839.444707] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 14:47:45 juju-e4d256-prod-github-runner-207 kernel: [33839.446456] rcu: 1-....: (8404164 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=4059985 Aug 22 14:47:45 juju-e4d256-prod-github-runner-207 kernel: [33839.447575] (t=8430561 jiffies g=23269 q=36205) Aug 22 14:47:45 juju-e4d256-prod-github-runner-207 kernel: [33839.448425] NMI backtrace for cpu 1 Aug 22 14:47:45 juju-e4d256-prod-github-runner-207 kernel: [33839.449150] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 14:47:45 juju-e4d256-prod-github-runner-207 kernel: [33839.450252] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 14:47:45 juju-e4d256-prod-github-runner-207 kernel: [33839.451389] Call Trace: Aug 22 14:47:45 juju-e4d256-prod-github-runner-207 kernel: [33839.452260] Aug 22 14:47:45 juju-e4d256-prod-github-runner-207 kernel: [33839.452944] show_stack+0x52/0x5c Aug 22 14:47:45 juju-e4d256-prod-github-runner-207 kernel: [33839.453702] dump_stack_lvl+0x4a/0x63 Aug 22 14:47:45 juju-e4d256-prod-github-runner-207 kernel: [33839.454455] dump_stack+0x10/0x16 Aug 22 14:47:45 juju-e4d256-prod-github-runner-207 kernel: [33839.455320] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 14:47:45 juju-e4d256-prod-github-runner-207 kernel: [33839.456148] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 14:47:45 juju-e4d256-prod-github-runner-207 kernel: [33839.456936] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 14:47:45 juju-e4d256-prod-github-runner-207 kernel: [33839.457768] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 14:47:45 juju-e4d256-prod-github-runner-207 kernel: [33839.458593] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 14:47:45 juju-e4d256-prod-github-runner-207 kernel: [33839.459405] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 14:47:45 juju-e4d256-prod-github-runner-207 kernel: [33839.460199] print_cpu_stall.cold+0x2f/0xe2 Aug 22 14:47:45 juju-e4d256-prod-github-runner-207 kernel: [33839.460970] ? timekeeping_update+0xf7/0x150 Aug 22 14:47:45 juju-e4d256-prod-github-runner-207 kernel: [33839.461756] check_cpu_stall+0x109/0x270 Aug 22 14:47:45 juju-e4d256-prod-github-runner-207 kernel: [33839.462518] rcu_sched_clock_irq+0x9a/0x250 Aug 22 14:47:45 juju-e4d256-prod-github-runner-207 kernel: [33839.463286] update_process_times+0x94/0xd0 Aug 22 14:47:45 juju-e4d256-prod-github-runner-207 kernel: [33839.464063] tick_sched_handle+0x29/0x70 Aug 22 14:47:45 juju-e4d256-prod-github-runner-207 kernel: [33839.464820] tick_sched_timer+0x8c/0xc0 Aug 22 14:47:45 juju-e4d256-prod-github-runner-207 kernel: [33839.465592] ? tick_nohz_handler+0xb0/0xb0 Aug 22 14:47:45 juju-e4d256-prod-github-runner-207 kernel: [33839.466355] __hrtimer_run_queues+0x107/0x230 Aug 22 14:47:45 juju-e4d256-prod-github-runner-207 kernel: [33839.467161] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 14:47:45 juju-e4d256-prod-github-runner-207 kernel: [33839.467972] hrtimer_interrupt+0x101/0x220 Aug 22 14:47:45 juju-e4d256-prod-github-runner-207 kernel: [33839.468739] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 14:47:45 juju-e4d256-prod-github-runner-207 kernel: [33839.469556] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 14:47:45 juju-e4d256-prod-github-runner-207 kernel: [33839.470363] Aug 22 14:47:45 juju-e4d256-prod-github-runner-207 kernel: [33839.471002] Aug 22 14:47:45 juju-e4d256-prod-github-runner-207 kernel: [33839.471644] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 14:47:45 juju-e4d256-prod-github-runner-207 kernel: [33839.472478] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:47:45 juju-e4d256-prod-github-runner-207 kernel: [33839.473373] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 14:47:45 juju-e4d256-prod-github-runner-207 kernel: [33839.475587] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 14:47:45 juju-e4d256-prod-github-runner-207 kernel: [33839.476480] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 14:47:45 juju-e4d256-prod-github-runner-207 kernel: [33839.477483] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 14:47:45 juju-e4d256-prod-github-runner-207 kernel: [33839.478472] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 14:47:45 juju-e4d256-prod-github-runner-207 kernel: [33839.479442] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 14:47:45 juju-e4d256-prod-github-runner-207 kernel: [33839.480523] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 14:47:45 juju-e4d256-prod-github-runner-207 kernel: [33839.481509] ? _raw_spin_lock+0x22/0x30 Aug 22 14:47:45 juju-e4d256-prod-github-runner-207 kernel: [33839.482315] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:47:45 juju-e4d256-prod-github-runner-207 kernel: [33839.483211] direct_page_fault+0x206/0x310 [kvm] Aug 22 14:47:45 juju-e4d256-prod-github-runner-207 kernel: [33839.484212] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 14:47:45 juju-e4d256-prod-github-runner-207 kernel: [33839.485555] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 14:47:45 juju-e4d256-prod-github-runner-207 kernel: [33839.486887] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 14:47:45 juju-e4d256-prod-github-runner-207 kernel: [33839.487894] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 14:47:45 juju-e4d256-prod-github-runner-207 kernel: [33839.488705] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 14:47:45 juju-e4d256-prod-github-runner-207 kernel: [33839.489590] handle_exit+0x98/0x230 [kvm_amd] Aug 22 14:47:45 juju-e4d256-prod-github-runner-207 kernel: [33839.490440] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 14:47:45 juju-e4d256-prod-github-runner-207 kernel: [33839.491233] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 14:47:45 juju-e4d256-prod-github-runner-207 kernel: [33839.492071] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 14:47:45 juju-e4d256-prod-github-runner-207 kernel: [33839.492878] vcpu_run+0x62/0x2c0 [kvm] Aug 22 14:47:45 juju-e4d256-prod-github-runner-207 kernel: [33839.493611] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 14:47:45 juju-e4d256-prod-github-runner-207 kernel: [33839.494357] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 14:47:45 juju-e4d256-prod-github-runner-207 kernel: [33839.495162] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 14:47:45 juju-e4d256-prod-github-runner-207 kernel: [33839.495945] ? __seccomp_filter+0x4a/0x4a0 Aug 22 14:47:45 juju-e4d256-prod-github-runner-207 kernel: [33839.496668] ? __fget_files+0x86/0xc0 Aug 22 14:47:45 juju-e4d256-prod-github-runner-207 kernel: [33839.497384] __x64_sys_ioctl+0x95/0xd0 Aug 22 14:47:45 juju-e4d256-prod-github-runner-207 kernel: [33839.498117] do_syscall_64+0x5c/0xc0 Aug 22 14:47:45 juju-e4d256-prod-github-runner-207 kernel: [33839.498865] ? do_futex+0x162/0x1f0 Aug 22 14:47:45 juju-e4d256-prod-github-runner-207 kernel: [33839.499552] ? __x64_sys_futex+0x78/0x1e0 Aug 22 14:47:45 juju-e4d256-prod-github-runner-207 kernel: [33839.500324] ? __secure_computing+0xa9/0x120 Aug 22 14:47:45 juju-e4d256-prod-github-runner-207 kernel: [33839.501058] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 14:47:45 juju-e4d256-prod-github-runner-207 kernel: [33839.501860] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:47:45 juju-e4d256-prod-github-runner-207 kernel: [33839.502643] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:47:45 juju-e4d256-prod-github-runner-207 kernel: [33839.503443] ? do_syscall_64+0x69/0xc0 Aug 22 14:47:45 juju-e4d256-prod-github-runner-207 kernel: [33839.504179] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:47:45 juju-e4d256-prod-github-runner-207 kernel: [33839.504940] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:47:45 juju-e4d256-prod-github-runner-207 kernel: [33839.505707] ? do_syscall_64+0x69/0xc0 Aug 22 14:47:45 juju-e4d256-prod-github-runner-207 kernel: [33839.506407] ? do_syscall_64+0x69/0xc0 Aug 22 14:47:45 juju-e4d256-prod-github-runner-207 kernel: [33839.507105] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 14:47:45 juju-e4d256-prod-github-runner-207 kernel: [33839.507923] RIP: 0033:0x7faa5d0edaff Aug 22 14:47:45 juju-e4d256-prod-github-runner-207 kernel: [33839.508653] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 14:47:45 juju-e4d256-prod-github-runner-207 kernel: [33839.510872] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 14:47:45 juju-e4d256-prod-github-runner-207 kernel: [33839.511873] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 14:47:45 juju-e4d256-prod-github-runner-207 kernel: [33839.512842] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 14:47:45 juju-e4d256-prod-github-runner-207 kernel: [33839.513807] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 14:47:45 juju-e4d256-prod-github-runner-207 kernel: [33839.514770] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 14:47:45 juju-e4d256-prod-github-runner-207 kernel: [33839.515700] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 14:47:45 juju-e4d256-prod-github-runner-207 kernel: [33839.516675] Aug 22 14:48:10 juju-e4d256-prod-github-runner-207 kernel: [33864.541981] watchdog: BUG: soft lockup - CPU#1 stuck for 31430s! [qemu-system-x86:6715] Aug 22 14:48:10 juju-e4d256-prod-github-runner-207 kernel: [33864.543944] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 14:48:10 juju-e4d256-prod-github-runner-207 kernel: [33864.544278] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 14:48:10 juju-e4d256-prod-github-runner-207 kernel: [33864.556444] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 14:48:10 juju-e4d256-prod-github-runner-207 kernel: [33864.557817] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 14:48:10 juju-e4d256-prod-github-runner-207 kernel: [33864.559651] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:48:10 juju-e4d256-prod-github-runner-207 kernel: [33864.560718] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 14:48:10 juju-e4d256-prod-github-runner-207 kernel: [33864.563268] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 14:48:10 juju-e4d256-prod-github-runner-207 kernel: [33864.564341] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 14:48:10 juju-e4d256-prod-github-runner-207 kernel: [33864.565524] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 14:48:10 juju-e4d256-prod-github-runner-207 kernel: [33864.566687] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 14:48:10 juju-e4d256-prod-github-runner-207 kernel: [33864.567859] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 14:48:10 juju-e4d256-prod-github-runner-207 kernel: [33864.569039] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 14:48:10 juju-e4d256-prod-github-runner-207 kernel: [33864.570234] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 14:48:10 juju-e4d256-prod-github-runner-207 kernel: [33864.571625] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 14:48:10 juju-e4d256-prod-github-runner-207 kernel: [33864.572785] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 14:48:10 juju-e4d256-prod-github-runner-207 kernel: [33864.574004] Call Trace: Aug 22 14:48:10 juju-e4d256-prod-github-runner-207 kernel: [33864.575027] Aug 22 14:48:10 juju-e4d256-prod-github-runner-207 kernel: [33864.576198] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:48:10 juju-e4d256-prod-github-runner-207 kernel: [33864.577243] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:48:10 juju-e4d256-prod-github-runner-207 kernel: [33864.578267] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:48:10 juju-e4d256-prod-github-runner-207 kernel: [33864.579388] ? show_regs.part.0+0x23/0x29 Aug 22 14:48:10 juju-e4d256-prod-github-runner-207 kernel: [33864.580444] ? show_regs.cold+0x8/0xd Aug 22 14:48:10 juju-e4d256-prod-github-runner-207 kernel: [33864.581428] ? watchdog_timer_fn+0x1be/0x220 Aug 22 14:48:10 juju-e4d256-prod-github-runner-207 kernel: [33864.582439] ? lockup_detector_update_enable+0x60/0x60 Aug 22 14:48:10 juju-e4d256-prod-github-runner-207 kernel: [33864.583538] ? __hrtimer_run_queues+0x107/0x230 Aug 22 14:48:10 juju-e4d256-prod-github-runner-207 kernel: [33864.584578] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 14:48:10 juju-e4d256-prod-github-runner-207 kernel: [33864.585634] ? hrtimer_interrupt+0x101/0x220 Aug 22 14:48:10 juju-e4d256-prod-github-runner-207 kernel: [33864.586665] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 14:48:10 juju-e4d256-prod-github-runner-207 kernel: [33864.587755] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 14:48:10 juju-e4d256-prod-github-runner-207 kernel: [33864.588808] Aug 22 14:48:10 juju-e4d256-prod-github-runner-207 kernel: [33864.589674] Aug 22 14:48:10 juju-e4d256-prod-github-runner-207 kernel: [33864.590536] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 14:48:10 juju-e4d256-prod-github-runner-207 kernel: [33864.591595] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:48:10 juju-e4d256-prod-github-runner-207 kernel: [33864.592720] ? _raw_spin_lock+0x22/0x30 Aug 22 14:48:10 juju-e4d256-prod-github-runner-207 kernel: [33864.593872] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:48:10 juju-e4d256-prod-github-runner-207 kernel: [33864.594914] direct_page_fault+0x206/0x310 [kvm] Aug 22 14:48:10 juju-e4d256-prod-github-runner-207 kernel: [33864.596012] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 14:48:10 juju-e4d256-prod-github-runner-207 kernel: [33864.597035] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 14:48:10 juju-e4d256-prod-github-runner-207 kernel: [33864.598042] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 14:48:10 juju-e4d256-prod-github-runner-207 kernel: [33864.599061] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 14:48:10 juju-e4d256-prod-github-runner-207 kernel: [33864.600038] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 14:48:10 juju-e4d256-prod-github-runner-207 kernel: [33864.601041] handle_exit+0x98/0x230 [kvm_amd] Aug 22 14:48:10 juju-e4d256-prod-github-runner-207 kernel: [33864.601981] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 14:48:10 juju-e4d256-prod-github-runner-207 kernel: [33864.602917] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 14:48:10 juju-e4d256-prod-github-runner-207 kernel: [33864.603869] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 14:48:10 juju-e4d256-prod-github-runner-207 kernel: [33864.604805] vcpu_run+0x62/0x2c0 [kvm] Aug 22 14:48:10 juju-e4d256-prod-github-runner-207 kernel: [33864.605656] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 14:48:10 juju-e4d256-prod-github-runner-207 kernel: [33864.606603] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 14:48:10 juju-e4d256-prod-github-runner-207 kernel: [33864.607463] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 14:48:10 juju-e4d256-prod-github-runner-207 kernel: [33864.608282] ? __seccomp_filter+0x4a/0x4a0 Aug 22 14:48:10 juju-e4d256-prod-github-runner-207 kernel: [33864.609051] ? __fget_files+0x86/0xc0 Aug 22 14:48:10 juju-e4d256-prod-github-runner-207 kernel: [33864.609769] __x64_sys_ioctl+0x95/0xd0 Aug 22 14:48:10 juju-e4d256-prod-github-runner-207 kernel: [33864.610467] do_syscall_64+0x5c/0xc0 Aug 22 14:48:10 juju-e4d256-prod-github-runner-207 kernel: [33864.611137] ? do_futex+0x162/0x1f0 Aug 22 14:48:10 juju-e4d256-prod-github-runner-207 kernel: [33864.611811] ? __x64_sys_futex+0x78/0x1e0 Aug 22 14:48:10 juju-e4d256-prod-github-runner-207 kernel: [33864.612489] ? __secure_computing+0xa9/0x120 Aug 22 14:48:10 juju-e4d256-prod-github-runner-207 kernel: [33864.613183] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 14:48:10 juju-e4d256-prod-github-runner-207 kernel: [33864.613941] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:48:10 juju-e4d256-prod-github-runner-207 kernel: [33864.614667] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:48:10 juju-e4d256-prod-github-runner-207 kernel: [33864.615385] ? do_syscall_64+0x69/0xc0 Aug 22 14:48:10 juju-e4d256-prod-github-runner-207 kernel: [33864.616037] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:48:10 juju-e4d256-prod-github-runner-207 kernel: [33864.616739] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:48:10 juju-e4d256-prod-github-runner-207 kernel: [33864.617439] ? do_syscall_64+0x69/0xc0 Aug 22 14:48:10 juju-e4d256-prod-github-runner-207 kernel: [33864.618067] ? do_syscall_64+0x69/0xc0 Aug 22 14:48:10 juju-e4d256-prod-github-runner-207 kernel: [33864.618729] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 14:48:10 juju-e4d256-prod-github-runner-207 kernel: [33864.619440] RIP: 0033:0x7faa5d0edaff Aug 22 14:48:10 juju-e4d256-prod-github-runner-207 kernel: [33864.620155] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 14:48:10 juju-e4d256-prod-github-runner-207 kernel: [33864.622215] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 14:48:10 juju-e4d256-prod-github-runner-207 kernel: [33864.623312] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 14:48:10 juju-e4d256-prod-github-runner-207 kernel: [33864.624227] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 14:48:10 juju-e4d256-prod-github-runner-207 kernel: [33864.625139] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 14:48:10 juju-e4d256-prod-github-runner-207 kernel: [33864.626042] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 14:48:10 juju-e4d256-prod-github-runner-207 kernel: [33864.626939] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 14:48:10 juju-e4d256-prod-github-runner-207 kernel: [33864.627855] Aug 22 14:48:38 juju-e4d256-prod-github-runner-207 kernel: [33892.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 31456s! [qemu-system-x86:6715] Aug 22 14:48:38 juju-e4d256-prod-github-runner-207 kernel: [33892.543938] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 14:48:38 juju-e4d256-prod-github-runner-207 kernel: [33892.544261] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 14:48:38 juju-e4d256-prod-github-runner-207 kernel: [33892.556490] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 14:48:38 juju-e4d256-prod-github-runner-207 kernel: [33892.557756] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 14:48:38 juju-e4d256-prod-github-runner-207 kernel: [33892.559120] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:48:38 juju-e4d256-prod-github-runner-207 kernel: [33892.560244] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 14:48:38 juju-e4d256-prod-github-runner-207 kernel: [33892.562932] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 14:48:38 juju-e4d256-prod-github-runner-207 kernel: [33892.564026] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 14:48:38 juju-e4d256-prod-github-runner-207 kernel: [33892.565255] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 14:48:38 juju-e4d256-prod-github-runner-207 kernel: [33892.566610] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 14:48:38 juju-e4d256-prod-github-runner-207 kernel: [33892.567795] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 14:48:38 juju-e4d256-prod-github-runner-207 kernel: [33892.568965] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 14:48:38 juju-e4d256-prod-github-runner-207 kernel: [33892.570165] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 14:48:38 juju-e4d256-prod-github-runner-207 kernel: [33892.571438] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 14:48:38 juju-e4d256-prod-github-runner-207 kernel: [33892.572585] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 14:48:38 juju-e4d256-prod-github-runner-207 kernel: [33892.573868] Call Trace: Aug 22 14:48:38 juju-e4d256-prod-github-runner-207 kernel: [33892.574883] Aug 22 14:48:38 juju-e4d256-prod-github-runner-207 kernel: [33892.575840] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:48:38 juju-e4d256-prod-github-runner-207 kernel: [33892.576883] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:48:38 juju-e4d256-prod-github-runner-207 kernel: [33892.577932] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:48:38 juju-e4d256-prod-github-runner-207 kernel: [33892.579037] ? show_regs.part.0+0x23/0x29 Aug 22 14:48:38 juju-e4d256-prod-github-runner-207 kernel: [33892.580064] ? show_regs.cold+0x8/0xd Aug 22 14:48:38 juju-e4d256-prod-github-runner-207 kernel: [33892.581068] ? watchdog_timer_fn+0x1be/0x220 Aug 22 14:48:38 juju-e4d256-prod-github-runner-207 kernel: [33892.582141] ? lockup_detector_update_enable+0x60/0x60 Aug 22 14:48:38 juju-e4d256-prod-github-runner-207 kernel: [33892.583237] ? __hrtimer_run_queues+0x107/0x230 Aug 22 14:48:38 juju-e4d256-prod-github-runner-207 kernel: [33892.584274] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 14:48:38 juju-e4d256-prod-github-runner-207 kernel: [33892.585337] ? hrtimer_interrupt+0x101/0x220 Aug 22 14:48:38 juju-e4d256-prod-github-runner-207 kernel: [33892.586413] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 14:48:38 juju-e4d256-prod-github-runner-207 kernel: [33892.587510] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 14:48:38 juju-e4d256-prod-github-runner-207 kernel: [33892.588583] Aug 22 14:48:38 juju-e4d256-prod-github-runner-207 kernel: [33892.589448] Aug 22 14:48:38 juju-e4d256-prod-github-runner-207 kernel: [33892.590286] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 14:48:38 juju-e4d256-prod-github-runner-207 kernel: [33892.591329] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:48:38 juju-e4d256-prod-github-runner-207 kernel: [33892.592377] ? _raw_spin_lock+0x22/0x30 Aug 22 14:48:38 juju-e4d256-prod-github-runner-207 kernel: [33892.593335] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:48:38 juju-e4d256-prod-github-runner-207 kernel: [33892.594402] direct_page_fault+0x206/0x310 [kvm] Aug 22 14:48:38 juju-e4d256-prod-github-runner-207 kernel: [33892.595497] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 14:48:38 juju-e4d256-prod-github-runner-207 kernel: [33892.596522] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 14:48:38 juju-e4d256-prod-github-runner-207 kernel: [33892.597532] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 14:48:38 juju-e4d256-prod-github-runner-207 kernel: [33892.598544] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 14:48:38 juju-e4d256-prod-github-runner-207 kernel: [33892.599502] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 14:48:38 juju-e4d256-prod-github-runner-207 kernel: [33892.600485] handle_exit+0x98/0x230 [kvm_amd] Aug 22 14:48:38 juju-e4d256-prod-github-runner-207 kernel: [33892.601379] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 14:48:38 juju-e4d256-prod-github-runner-207 kernel: [33892.602317] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 14:48:38 juju-e4d256-prod-github-runner-207 kernel: [33892.603264] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 14:48:38 juju-e4d256-prod-github-runner-207 kernel: [33892.604211] vcpu_run+0x62/0x2c0 [kvm] Aug 22 14:48:38 juju-e4d256-prod-github-runner-207 kernel: [33892.605076] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 14:48:38 juju-e4d256-prod-github-runner-207 kernel: [33892.605893] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 14:48:38 juju-e4d256-prod-github-runner-207 kernel: [33892.606755] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 14:48:38 juju-e4d256-prod-github-runner-207 kernel: [33892.607583] ? __seccomp_filter+0x4a/0x4a0 Aug 22 14:48:38 juju-e4d256-prod-github-runner-207 kernel: [33892.608333] ? __fget_files+0x86/0xc0 Aug 22 14:48:38 juju-e4d256-prod-github-runner-207 kernel: [33892.609038] __x64_sys_ioctl+0x95/0xd0 Aug 22 14:48:38 juju-e4d256-prod-github-runner-207 kernel: [33892.609759] do_syscall_64+0x5c/0xc0 Aug 22 14:48:38 juju-e4d256-prod-github-runner-207 kernel: [33892.610430] ? do_futex+0x162/0x1f0 Aug 22 14:48:38 juju-e4d256-prod-github-runner-207 kernel: [33892.611105] ? __x64_sys_futex+0x78/0x1e0 Aug 22 14:48:38 juju-e4d256-prod-github-runner-207 kernel: [33892.611857] ? __secure_computing+0xa9/0x120 Aug 22 14:48:38 juju-e4d256-prod-github-runner-207 kernel: [33892.612613] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 14:48:38 juju-e4d256-prod-github-runner-207 kernel: [33892.613394] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:48:38 juju-e4d256-prod-github-runner-207 kernel: [33892.614118] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:48:38 juju-e4d256-prod-github-runner-207 kernel: [33892.614837] ? do_syscall_64+0x69/0xc0 Aug 22 14:48:38 juju-e4d256-prod-github-runner-207 kernel: [33892.615544] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:48:38 juju-e4d256-prod-github-runner-207 kernel: [33892.616252] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:48:38 juju-e4d256-prod-github-runner-207 kernel: [33892.616949] ? do_syscall_64+0x69/0xc0 Aug 22 14:48:38 juju-e4d256-prod-github-runner-207 kernel: [33892.617601] ? do_syscall_64+0x69/0xc0 Aug 22 14:48:38 juju-e4d256-prod-github-runner-207 kernel: [33892.618229] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 14:48:38 juju-e4d256-prod-github-runner-207 kernel: [33892.619023] RIP: 0033:0x7faa5d0edaff Aug 22 14:48:38 juju-e4d256-prod-github-runner-207 kernel: [33892.619730] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 14:48:38 juju-e4d256-prod-github-runner-207 kernel: [33892.621751] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 14:48:38 juju-e4d256-prod-github-runner-207 kernel: [33892.622668] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 14:48:38 juju-e4d256-prod-github-runner-207 kernel: [33892.623620] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 14:48:38 juju-e4d256-prod-github-runner-207 kernel: [33892.624513] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 14:48:38 juju-e4d256-prod-github-runner-207 kernel: [33892.625412] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 14:48:38 juju-e4d256-prod-github-runner-207 kernel: [33892.626313] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 14:48:38 juju-e4d256-prod-github-runner-207 kernel: [33892.627290] Aug 22 14:49:06 juju-e4d256-prod-github-runner-207 kernel: [33920.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 31482s! [qemu-system-x86:6715] Aug 22 14:49:06 juju-e4d256-prod-github-runner-207 kernel: [33920.543947] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 14:49:06 juju-e4d256-prod-github-runner-207 kernel: [33920.544261] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 14:49:06 juju-e4d256-prod-github-runner-207 kernel: [33920.556535] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 14:49:06 juju-e4d256-prod-github-runner-207 kernel: [33920.557814] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 14:49:06 juju-e4d256-prod-github-runner-207 kernel: [33920.559069] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:49:06 juju-e4d256-prod-github-runner-207 kernel: [33920.560141] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 14:49:06 juju-e4d256-prod-github-runner-207 kernel: [33920.562741] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 14:49:06 juju-e4d256-prod-github-runner-207 kernel: [33920.564253] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 14:49:06 juju-e4d256-prod-github-runner-207 kernel: [33920.565441] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 14:49:06 juju-e4d256-prod-github-runner-207 kernel: [33920.566613] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 14:49:06 juju-e4d256-prod-github-runner-207 kernel: [33920.567836] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 14:49:06 juju-e4d256-prod-github-runner-207 kernel: [33920.569019] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 14:49:06 juju-e4d256-prod-github-runner-207 kernel: [33920.570206] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 14:49:06 juju-e4d256-prod-github-runner-207 kernel: [33920.571515] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 14:49:06 juju-e4d256-prod-github-runner-207 kernel: [33920.572654] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 14:49:06 juju-e4d256-prod-github-runner-207 kernel: [33920.574021] Call Trace: Aug 22 14:49:06 juju-e4d256-prod-github-runner-207 kernel: [33920.574965] Aug 22 14:49:06 juju-e4d256-prod-github-runner-207 kernel: [33920.575886] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:49:06 juju-e4d256-prod-github-runner-207 kernel: [33920.576996] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:49:06 juju-e4d256-prod-github-runner-207 kernel: [33920.578053] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:49:06 juju-e4d256-prod-github-runner-207 kernel: [33920.579219] ? show_regs.part.0+0x23/0x29 Aug 22 14:49:06 juju-e4d256-prod-github-runner-207 kernel: [33920.580230] ? show_regs.cold+0x8/0xd Aug 22 14:49:06 juju-e4d256-prod-github-runner-207 kernel: [33920.581227] ? watchdog_timer_fn+0x1be/0x220 Aug 22 14:49:06 juju-e4d256-prod-github-runner-207 kernel: [33920.582249] ? lockup_detector_update_enable+0x60/0x60 Aug 22 14:49:06 juju-e4d256-prod-github-runner-207 kernel: [33920.583351] ? __hrtimer_run_queues+0x107/0x230 Aug 22 14:49:06 juju-e4d256-prod-github-runner-207 kernel: [33920.584388] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 14:49:06 juju-e4d256-prod-github-runner-207 kernel: [33920.585420] ? hrtimer_interrupt+0x101/0x220 Aug 22 14:49:06 juju-e4d256-prod-github-runner-207 kernel: [33920.586445] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 14:49:06 juju-e4d256-prod-github-runner-207 kernel: [33920.587533] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 14:49:06 juju-e4d256-prod-github-runner-207 kernel: [33920.588590] Aug 22 14:49:06 juju-e4d256-prod-github-runner-207 kernel: [33920.589453] Aug 22 14:49:06 juju-e4d256-prod-github-runner-207 kernel: [33920.590298] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 14:49:06 juju-e4d256-prod-github-runner-207 kernel: [33920.591349] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:49:06 juju-e4d256-prod-github-runner-207 kernel: [33920.592425] ? _raw_spin_lock+0x22/0x30 Aug 22 14:49:06 juju-e4d256-prod-github-runner-207 kernel: [33920.593399] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:49:06 juju-e4d256-prod-github-runner-207 kernel: [33920.594431] direct_page_fault+0x206/0x310 [kvm] Aug 22 14:49:06 juju-e4d256-prod-github-runner-207 kernel: [33920.595522] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 14:49:06 juju-e4d256-prod-github-runner-207 kernel: [33920.596575] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 14:49:06 juju-e4d256-prod-github-runner-207 kernel: [33920.597585] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 14:49:06 juju-e4d256-prod-github-runner-207 kernel: [33920.598599] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 14:49:06 juju-e4d256-prod-github-runner-207 kernel: [33920.599562] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 14:49:06 juju-e4d256-prod-github-runner-207 kernel: [33920.600546] handle_exit+0x98/0x230 [kvm_amd] Aug 22 14:49:06 juju-e4d256-prod-github-runner-207 kernel: [33920.601445] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 14:49:06 juju-e4d256-prod-github-runner-207 kernel: [33920.602384] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 14:49:06 juju-e4d256-prod-github-runner-207 kernel: [33920.603332] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 14:49:06 juju-e4d256-prod-github-runner-207 kernel: [33920.604239] vcpu_run+0x62/0x2c0 [kvm] Aug 22 14:49:06 juju-e4d256-prod-github-runner-207 kernel: [33920.605059] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 14:49:06 juju-e4d256-prod-github-runner-207 kernel: [33920.605871] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 14:49:06 juju-e4d256-prod-github-runner-207 kernel: [33920.606732] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 14:49:06 juju-e4d256-prod-github-runner-207 kernel: [33920.607545] ? __seccomp_filter+0x4a/0x4a0 Aug 22 14:49:06 juju-e4d256-prod-github-runner-207 kernel: [33920.608296] ? __fget_files+0x86/0xc0 Aug 22 14:49:06 juju-e4d256-prod-github-runner-207 kernel: [33920.609002] __x64_sys_ioctl+0x95/0xd0 Aug 22 14:49:06 juju-e4d256-prod-github-runner-207 kernel: [33920.609744] do_syscall_64+0x5c/0xc0 Aug 22 14:49:06 juju-e4d256-prod-github-runner-207 kernel: [33920.610420] ? do_futex+0x162/0x1f0 Aug 22 14:49:06 juju-e4d256-prod-github-runner-207 kernel: [33920.611187] ? __x64_sys_futex+0x78/0x1e0 Aug 22 14:49:06 juju-e4d256-prod-github-runner-207 kernel: [33920.611888] ? __secure_computing+0xa9/0x120 Aug 22 14:49:06 juju-e4d256-prod-github-runner-207 kernel: [33920.612582] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 14:49:06 juju-e4d256-prod-github-runner-207 kernel: [33920.613346] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:49:06 juju-e4d256-prod-github-runner-207 kernel: [33920.614074] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:49:06 juju-e4d256-prod-github-runner-207 kernel: [33920.614812] ? do_syscall_64+0x69/0xc0 Aug 22 14:49:06 juju-e4d256-prod-github-runner-207 kernel: [33920.615519] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:49:06 juju-e4d256-prod-github-runner-207 kernel: [33920.616293] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:49:06 juju-e4d256-prod-github-runner-207 kernel: [33920.617023] ? do_syscall_64+0x69/0xc0 Aug 22 14:49:06 juju-e4d256-prod-github-runner-207 kernel: [33920.617653] ? do_syscall_64+0x69/0xc0 Aug 22 14:49:06 juju-e4d256-prod-github-runner-207 kernel: [33920.618278] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 14:49:06 juju-e4d256-prod-github-runner-207 kernel: [33920.619018] RIP: 0033:0x7faa5d0edaff Aug 22 14:49:06 juju-e4d256-prod-github-runner-207 kernel: [33920.619698] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 14:49:06 juju-e4d256-prod-github-runner-207 kernel: [33920.621687] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 14:49:06 juju-e4d256-prod-github-runner-207 kernel: [33920.622608] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 14:49:06 juju-e4d256-prod-github-runner-207 kernel: [33920.623506] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 14:49:06 juju-e4d256-prod-github-runner-207 kernel: [33920.624433] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 14:49:06 juju-e4d256-prod-github-runner-207 kernel: [33920.625339] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 14:49:06 juju-e4d256-prod-github-runner-207 kernel: [33920.626232] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 14:49:06 juju-e4d256-prod-github-runner-207 kernel: [33920.627135] Aug 22 14:49:34 juju-e4d256-prod-github-runner-207 kernel: [33948.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 31509s! [qemu-system-x86:6715] Aug 22 14:49:34 juju-e4d256-prod-github-runner-207 kernel: [33948.544704] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 14:49:34 juju-e4d256-prod-github-runner-207 kernel: [33948.545025] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 14:49:34 juju-e4d256-prod-github-runner-207 kernel: [33948.557080] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 14:49:34 juju-e4d256-prod-github-runner-207 kernel: [33948.558340] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 14:49:34 juju-e4d256-prod-github-runner-207 kernel: [33948.559609] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:49:34 juju-e4d256-prod-github-runner-207 kernel: [33948.560666] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 14:49:34 juju-e4d256-prod-github-runner-207 kernel: [33948.563242] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 14:49:34 juju-e4d256-prod-github-runner-207 kernel: [33948.564315] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 14:49:34 juju-e4d256-prod-github-runner-207 kernel: [33948.565482] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 14:49:34 juju-e4d256-prod-github-runner-207 kernel: [33948.566692] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 14:49:34 juju-e4d256-prod-github-runner-207 kernel: [33948.567859] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 14:49:34 juju-e4d256-prod-github-runner-207 kernel: [33948.569030] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 14:49:34 juju-e4d256-prod-github-runner-207 kernel: [33948.570219] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 14:49:34 juju-e4d256-prod-github-runner-207 kernel: [33948.571479] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 14:49:34 juju-e4d256-prod-github-runner-207 kernel: [33948.572581] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 14:49:34 juju-e4d256-prod-github-runner-207 kernel: [33948.573874] Call Trace: Aug 22 14:49:34 juju-e4d256-prod-github-runner-207 kernel: [33948.574855] Aug 22 14:49:34 juju-e4d256-prod-github-runner-207 kernel: [33948.575850] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:49:34 juju-e4d256-prod-github-runner-207 kernel: [33948.577108] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:49:34 juju-e4d256-prod-github-runner-207 kernel: [33948.578178] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:49:34 juju-e4d256-prod-github-runner-207 kernel: [33948.579421] ? show_regs.part.0+0x23/0x29 Aug 22 14:49:34 juju-e4d256-prod-github-runner-207 kernel: [33948.580477] ? show_regs.cold+0x8/0xd Aug 22 14:49:34 juju-e4d256-prod-github-runner-207 kernel: [33948.581474] ? watchdog_timer_fn+0x1be/0x220 Aug 22 14:49:34 juju-e4d256-prod-github-runner-207 kernel: [33948.582525] ? lockup_detector_update_enable+0x60/0x60 Aug 22 14:49:34 juju-e4d256-prod-github-runner-207 kernel: [33948.583615] ? __hrtimer_run_queues+0x107/0x230 Aug 22 14:49:34 juju-e4d256-prod-github-runner-207 kernel: [33948.584691] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 14:49:34 juju-e4d256-prod-github-runner-207 kernel: [33948.585762] ? hrtimer_interrupt+0x101/0x220 Aug 22 14:49:34 juju-e4d256-prod-github-runner-207 kernel: [33948.586821] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 14:49:34 juju-e4d256-prod-github-runner-207 kernel: [33948.587939] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 14:49:34 juju-e4d256-prod-github-runner-207 kernel: [33948.589020] Aug 22 14:49:34 juju-e4d256-prod-github-runner-207 kernel: [33948.589890] Aug 22 14:49:34 juju-e4d256-prod-github-runner-207 kernel: [33948.590767] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 14:49:34 juju-e4d256-prod-github-runner-207 kernel: [33948.591823] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:49:34 juju-e4d256-prod-github-runner-207 kernel: [33948.592926] ? _raw_spin_lock+0x22/0x30 Aug 22 14:49:34 juju-e4d256-prod-github-runner-207 kernel: [33948.593899] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:49:34 juju-e4d256-prod-github-runner-207 kernel: [33948.594983] direct_page_fault+0x206/0x310 [kvm] Aug 22 14:49:34 juju-e4d256-prod-github-runner-207 kernel: [33948.596035] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 14:49:34 juju-e4d256-prod-github-runner-207 kernel: [33948.597089] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 14:49:34 juju-e4d256-prod-github-runner-207 kernel: [33948.598100] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 14:49:34 juju-e4d256-prod-github-runner-207 kernel: [33948.599153] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 14:49:34 juju-e4d256-prod-github-runner-207 kernel: [33948.600115] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 14:49:34 juju-e4d256-prod-github-runner-207 kernel: [33948.601098] handle_exit+0x98/0x230 [kvm_amd] Aug 22 14:49:34 juju-e4d256-prod-github-runner-207 kernel: [33948.601999] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 14:49:34 juju-e4d256-prod-github-runner-207 kernel: [33948.602934] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 14:49:34 juju-e4d256-prod-github-runner-207 kernel: [33948.603879] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 14:49:34 juju-e4d256-prod-github-runner-207 kernel: [33948.604804] vcpu_run+0x62/0x2c0 [kvm] Aug 22 14:49:34 juju-e4d256-prod-github-runner-207 kernel: [33948.605624] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 14:49:34 juju-e4d256-prod-github-runner-207 kernel: [33948.606449] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 14:49:34 juju-e4d256-prod-github-runner-207 kernel: [33948.607339] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 14:49:34 juju-e4d256-prod-github-runner-207 kernel: [33948.608140] ? __seccomp_filter+0x4a/0x4a0 Aug 22 14:49:34 juju-e4d256-prod-github-runner-207 kernel: [33948.608915] ? __fget_files+0x86/0xc0 Aug 22 14:49:34 juju-e4d256-prod-github-runner-207 kernel: [33948.609639] __x64_sys_ioctl+0x95/0xd0 Aug 22 14:49:34 juju-e4d256-prod-github-runner-207 kernel: [33948.610356] do_syscall_64+0x5c/0xc0 Aug 22 14:49:34 juju-e4d256-prod-github-runner-207 kernel: [33948.611050] ? do_futex+0x162/0x1f0 Aug 22 14:49:34 juju-e4d256-prod-github-runner-207 kernel: [33948.611708] ? __x64_sys_futex+0x78/0x1e0 Aug 22 14:49:34 juju-e4d256-prod-github-runner-207 kernel: [33948.612441] ? __secure_computing+0xa9/0x120 Aug 22 14:49:34 juju-e4d256-prod-github-runner-207 kernel: [33948.613160] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 14:49:34 juju-e4d256-prod-github-runner-207 kernel: [33948.613940] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:49:34 juju-e4d256-prod-github-runner-207 kernel: [33948.614693] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:49:34 juju-e4d256-prod-github-runner-207 kernel: [33948.615428] ? do_syscall_64+0x69/0xc0 Aug 22 14:49:34 juju-e4d256-prod-github-runner-207 kernel: [33948.616082] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:49:34 juju-e4d256-prod-github-runner-207 kernel: [33948.616787] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:49:34 juju-e4d256-prod-github-runner-207 kernel: [33948.617486] ? do_syscall_64+0x69/0xc0 Aug 22 14:49:34 juju-e4d256-prod-github-runner-207 kernel: [33948.618113] ? do_syscall_64+0x69/0xc0 Aug 22 14:49:34 juju-e4d256-prod-github-runner-207 kernel: [33948.618755] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 14:49:34 juju-e4d256-prod-github-runner-207 kernel: [33948.619475] RIP: 0033:0x7faa5d0edaff Aug 22 14:49:34 juju-e4d256-prod-github-runner-207 kernel: [33948.620153] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 14:49:34 juju-e4d256-prod-github-runner-207 kernel: [33948.622153] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 14:49:34 juju-e4d256-prod-github-runner-207 kernel: [33948.623119] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 14:49:34 juju-e4d256-prod-github-runner-207 kernel: [33948.624095] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 14:49:34 juju-e4d256-prod-github-runner-207 kernel: [33948.625012] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 14:49:34 juju-e4d256-prod-github-runner-207 kernel: [33948.625940] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 14:49:34 juju-e4d256-prod-github-runner-207 kernel: [33948.626895] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 14:49:34 juju-e4d256-prod-github-runner-207 kernel: [33948.627801] Aug 22 14:50:02 juju-e4d256-prod-github-runner-207 kernel: [33976.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 31535s! [qemu-system-x86:6715] Aug 22 14:50:02 juju-e4d256-prod-github-runner-207 kernel: [33976.543886] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 14:50:02 juju-e4d256-prod-github-runner-207 kernel: [33976.544202] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 14:50:02 juju-e4d256-prod-github-runner-207 kernel: [33976.556468] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 14:50:02 juju-e4d256-prod-github-runner-207 kernel: [33976.557733] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 14:50:02 juju-e4d256-prod-github-runner-207 kernel: [33976.559009] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:50:02 juju-e4d256-prod-github-runner-207 kernel: [33976.560071] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 14:50:02 juju-e4d256-prod-github-runner-207 kernel: [33976.562629] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 14:50:02 juju-e4d256-prod-github-runner-207 kernel: [33976.563675] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 14:50:02 juju-e4d256-prod-github-runner-207 kernel: [33976.564902] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 14:50:02 juju-e4d256-prod-github-runner-207 kernel: [33976.566079] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 14:50:02 juju-e4d256-prod-github-runner-207 kernel: [33976.567286] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 14:50:02 juju-e4d256-prod-github-runner-207 kernel: [33976.568508] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 14:50:02 juju-e4d256-prod-github-runner-207 kernel: [33976.569683] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 14:50:02 juju-e4d256-prod-github-runner-207 kernel: [33976.570941] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 14:50:02 juju-e4d256-prod-github-runner-207 kernel: [33976.572079] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 14:50:02 juju-e4d256-prod-github-runner-207 kernel: [33976.573340] Call Trace: Aug 22 14:50:02 juju-e4d256-prod-github-runner-207 kernel: [33976.574294] Aug 22 14:50:02 juju-e4d256-prod-github-runner-207 kernel: [33976.575208] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:50:02 juju-e4d256-prod-github-runner-207 kernel: [33976.576248] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:50:02 juju-e4d256-prod-github-runner-207 kernel: [33976.577275] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:50:02 juju-e4d256-prod-github-runner-207 kernel: [33976.578404] ? show_regs.part.0+0x23/0x29 Aug 22 14:50:02 juju-e4d256-prod-github-runner-207 kernel: [33976.579411] ? show_regs.cold+0x8/0xd Aug 22 14:50:02 juju-e4d256-prod-github-runner-207 kernel: [33976.580402] ? watchdog_timer_fn+0x1be/0x220 Aug 22 14:50:02 juju-e4d256-prod-github-runner-207 kernel: [33976.581434] ? lockup_detector_update_enable+0x60/0x60 Aug 22 14:50:02 juju-e4d256-prod-github-runner-207 kernel: [33976.582530] ? __hrtimer_run_queues+0x107/0x230 Aug 22 14:50:02 juju-e4d256-prod-github-runner-207 kernel: [33976.583585] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 14:50:02 juju-e4d256-prod-github-runner-207 kernel: [33976.584633] ? hrtimer_interrupt+0x101/0x220 Aug 22 14:50:02 juju-e4d256-prod-github-runner-207 kernel: [33976.585665] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 14:50:02 juju-e4d256-prod-github-runner-207 kernel: [33976.586779] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 14:50:02 juju-e4d256-prod-github-runner-207 kernel: [33976.587828] Aug 22 14:50:02 juju-e4d256-prod-github-runner-207 kernel: [33976.588680] Aug 22 14:50:02 juju-e4d256-prod-github-runner-207 kernel: [33976.589518] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 14:50:02 juju-e4d256-prod-github-runner-207 kernel: [33976.590571] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:50:02 juju-e4d256-prod-github-runner-207 kernel: [33976.591618] ? _raw_spin_lock+0x22/0x30 Aug 22 14:50:02 juju-e4d256-prod-github-runner-207 kernel: [33976.592565] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:50:02 juju-e4d256-prod-github-runner-207 kernel: [33976.593584] direct_page_fault+0x206/0x310 [kvm] Aug 22 14:50:02 juju-e4d256-prod-github-runner-207 kernel: [33976.594631] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 14:50:02 juju-e4d256-prod-github-runner-207 kernel: [33976.595642] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 14:50:02 juju-e4d256-prod-github-runner-207 kernel: [33976.596645] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 14:50:02 juju-e4d256-prod-github-runner-207 kernel: [33976.597658] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 14:50:02 juju-e4d256-prod-github-runner-207 kernel: [33976.598621] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 14:50:02 juju-e4d256-prod-github-runner-207 kernel: [33976.599600] handle_exit+0x98/0x230 [kvm_amd] Aug 22 14:50:02 juju-e4d256-prod-github-runner-207 kernel: [33976.600492] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 14:50:02 juju-e4d256-prod-github-runner-207 kernel: [33976.601409] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 14:50:02 juju-e4d256-prod-github-runner-207 kernel: [33976.602350] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 14:50:02 juju-e4d256-prod-github-runner-207 kernel: [33976.603260] vcpu_run+0x62/0x2c0 [kvm] Aug 22 14:50:02 juju-e4d256-prod-github-runner-207 kernel: [33976.604070] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 14:50:02 juju-e4d256-prod-github-runner-207 kernel: [33976.604892] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 14:50:02 juju-e4d256-prod-github-runner-207 kernel: [33976.605751] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 14:50:02 juju-e4d256-prod-github-runner-207 kernel: [33976.606562] ? __seccomp_filter+0x4a/0x4a0 Aug 22 14:50:02 juju-e4d256-prod-github-runner-207 kernel: [33976.607312] ? __fget_files+0x86/0xc0 Aug 22 14:50:02 juju-e4d256-prod-github-runner-207 kernel: [33976.608016] __x64_sys_ioctl+0x95/0xd0 Aug 22 14:50:02 juju-e4d256-prod-github-runner-207 kernel: [33976.608714] do_syscall_64+0x5c/0xc0 Aug 22 14:50:02 juju-e4d256-prod-github-runner-207 kernel: [33976.609383] ? do_futex+0x162/0x1f0 Aug 22 14:50:02 juju-e4d256-prod-github-runner-207 kernel: [33976.610032] ? __x64_sys_futex+0x78/0x1e0 Aug 22 14:50:02 juju-e4d256-prod-github-runner-207 kernel: [33976.610717] ? __secure_computing+0xa9/0x120 Aug 22 14:50:02 juju-e4d256-prod-github-runner-207 kernel: [33976.611411] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 14:50:02 juju-e4d256-prod-github-runner-207 kernel: [33976.612174] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:50:02 juju-e4d256-prod-github-runner-207 kernel: [33976.612895] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:50:02 juju-e4d256-prod-github-runner-207 kernel: [33976.613612] ? do_syscall_64+0x69/0xc0 Aug 22 14:50:02 juju-e4d256-prod-github-runner-207 kernel: [33976.614269] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:50:02 juju-e4d256-prod-github-runner-207 kernel: [33976.614973] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:50:02 juju-e4d256-prod-github-runner-207 kernel: [33976.615672] ? do_syscall_64+0x69/0xc0 Aug 22 14:50:02 juju-e4d256-prod-github-runner-207 kernel: [33976.616302] ? do_syscall_64+0x69/0xc0 Aug 22 14:50:02 juju-e4d256-prod-github-runner-207 kernel: [33976.616923] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 14:50:02 juju-e4d256-prod-github-runner-207 kernel: [33976.617661] RIP: 0033:0x7faa5d0edaff Aug 22 14:50:02 juju-e4d256-prod-github-runner-207 kernel: [33976.618362] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 14:50:02 juju-e4d256-prod-github-runner-207 kernel: [33976.620413] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 14:50:02 juju-e4d256-prod-github-runner-207 kernel: [33976.621342] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 14:50:02 juju-e4d256-prod-github-runner-207 kernel: [33976.622247] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 14:50:02 juju-e4d256-prod-github-runner-207 kernel: [33976.623139] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 14:50:02 juju-e4d256-prod-github-runner-207 kernel: [33976.624025] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 14:50:02 juju-e4d256-prod-github-runner-207 kernel: [33976.624910] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 14:50:02 juju-e4d256-prod-github-runner-207 kernel: [33976.625800] Aug 22 14:50:30 juju-e4d256-prod-github-runner-207 kernel: [34004.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 31561s! [qemu-system-x86:6715] Aug 22 14:50:30 juju-e4d256-prod-github-runner-207 kernel: [34004.543870] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 14:50:30 juju-e4d256-prod-github-runner-207 kernel: [34004.544175] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 14:50:30 juju-e4d256-prod-github-runner-207 kernel: [34004.556276] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 14:50:30 juju-e4d256-prod-github-runner-207 kernel: [34004.557543] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 14:50:30 juju-e4d256-prod-github-runner-207 kernel: [34004.558782] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:50:30 juju-e4d256-prod-github-runner-207 kernel: [34004.559839] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 14:50:30 juju-e4d256-prod-github-runner-207 kernel: [34004.562398] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 14:50:30 juju-e4d256-prod-github-runner-207 kernel: [34004.563436] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 14:50:30 juju-e4d256-prod-github-runner-207 kernel: [34004.564592] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 14:50:30 juju-e4d256-prod-github-runner-207 kernel: [34004.565746] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 14:50:30 juju-e4d256-prod-github-runner-207 kernel: [34004.566922] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 14:50:30 juju-e4d256-prod-github-runner-207 kernel: [34004.568076] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 14:50:30 juju-e4d256-prod-github-runner-207 kernel: [34004.569237] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 14:50:30 juju-e4d256-prod-github-runner-207 kernel: [34004.570478] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 14:50:30 juju-e4d256-prod-github-runner-207 kernel: [34004.571577] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 14:50:30 juju-e4d256-prod-github-runner-207 kernel: [34004.572771] Call Trace: Aug 22 14:50:30 juju-e4d256-prod-github-runner-207 kernel: [34004.573680] Aug 22 14:50:30 juju-e4d256-prod-github-runner-207 kernel: [34004.574589] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:50:30 juju-e4d256-prod-github-runner-207 kernel: [34004.575618] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:50:30 juju-e4d256-prod-github-runner-207 kernel: [34004.576636] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:50:30 juju-e4d256-prod-github-runner-207 kernel: [34004.577724] ? show_regs.part.0+0x23/0x29 Aug 22 14:50:30 juju-e4d256-prod-github-runner-207 kernel: [34004.578732] ? show_regs.cold+0x8/0xd Aug 22 14:50:30 juju-e4d256-prod-github-runner-207 kernel: [34004.579708] ? watchdog_timer_fn+0x1be/0x220 Aug 22 14:50:30 juju-e4d256-prod-github-runner-207 kernel: [34004.580724] ? lockup_detector_update_enable+0x60/0x60 Aug 22 14:50:30 juju-e4d256-prod-github-runner-207 kernel: [34004.581797] ? __hrtimer_run_queues+0x107/0x230 Aug 22 14:50:30 juju-e4d256-prod-github-runner-207 kernel: [34004.582856] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 14:50:30 juju-e4d256-prod-github-runner-207 kernel: [34004.583877] ? hrtimer_interrupt+0x101/0x220 Aug 22 14:50:30 juju-e4d256-prod-github-runner-207 kernel: [34004.584893] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 14:50:30 juju-e4d256-prod-github-runner-207 kernel: [34004.585969] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 14:50:30 juju-e4d256-prod-github-runner-207 kernel: [34004.587012] Aug 22 14:50:30 juju-e4d256-prod-github-runner-207 kernel: [34004.587863] Aug 22 14:50:30 juju-e4d256-prod-github-runner-207 kernel: [34004.588706] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 14:50:30 juju-e4d256-prod-github-runner-207 kernel: [34004.589743] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:50:30 juju-e4d256-prod-github-runner-207 kernel: [34004.590789] ? _raw_spin_lock+0x22/0x30 Aug 22 14:50:30 juju-e4d256-prod-github-runner-207 kernel: [34004.591738] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:50:30 juju-e4d256-prod-github-runner-207 kernel: [34004.592806] direct_page_fault+0x206/0x310 [kvm] Aug 22 14:50:30 juju-e4d256-prod-github-runner-207 kernel: [34004.593861] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 14:50:30 juju-e4d256-prod-github-runner-207 kernel: [34004.595773] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 14:50:30 juju-e4d256-prod-github-runner-207 kernel: [34004.596780] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 14:50:30 juju-e4d256-prod-github-runner-207 kernel: [34004.597783] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 14:50:30 juju-e4d256-prod-github-runner-207 kernel: [34004.598744] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 14:50:30 juju-e4d256-prod-github-runner-207 kernel: [34004.599719] handle_exit+0x98/0x230 [kvm_amd] Aug 22 14:50:30 juju-e4d256-prod-github-runner-207 kernel: [34004.600609] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 14:50:30 juju-e4d256-prod-github-runner-207 kernel: [34004.601525] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 14:50:30 juju-e4d256-prod-github-runner-207 kernel: [34004.602463] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 14:50:30 juju-e4d256-prod-github-runner-207 kernel: [34004.603370] vcpu_run+0x62/0x2c0 [kvm] Aug 22 14:50:30 juju-e4d256-prod-github-runner-207 kernel: [34004.604179] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 14:50:30 juju-e4d256-prod-github-runner-207 kernel: [34004.604992] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 14:50:30 juju-e4d256-prod-github-runner-207 kernel: [34004.605843] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 14:50:30 juju-e4d256-prod-github-runner-207 kernel: [34004.606652] ? __seccomp_filter+0x4a/0x4a0 Aug 22 14:50:30 juju-e4d256-prod-github-runner-207 kernel: [34004.607399] ? __fget_files+0x86/0xc0 Aug 22 14:50:30 juju-e4d256-prod-github-runner-207 kernel: [34004.608105] __x64_sys_ioctl+0x95/0xd0 Aug 22 14:50:30 juju-e4d256-prod-github-runner-207 kernel: [34004.608798] do_syscall_64+0x5c/0xc0 Aug 22 14:50:30 juju-e4d256-prod-github-runner-207 kernel: [34004.609462] ? do_futex+0x162/0x1f0 Aug 22 14:50:30 juju-e4d256-prod-github-runner-207 kernel: [34004.610128] ? __x64_sys_futex+0x78/0x1e0 Aug 22 14:50:30 juju-e4d256-prod-github-runner-207 kernel: [34004.610803] ? __secure_computing+0xa9/0x120 Aug 22 14:50:30 juju-e4d256-prod-github-runner-207 kernel: [34004.611493] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 14:50:30 juju-e4d256-prod-github-runner-207 kernel: [34004.612253] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:50:30 juju-e4d256-prod-github-runner-207 kernel: [34004.612980] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:50:30 juju-e4d256-prod-github-runner-207 kernel: [34004.613702] ? do_syscall_64+0x69/0xc0 Aug 22 14:50:30 juju-e4d256-prod-github-runner-207 kernel: [34004.614358] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:50:30 juju-e4d256-prod-github-runner-207 kernel: [34004.615069] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:50:30 juju-e4d256-prod-github-runner-207 kernel: [34004.615765] ? do_syscall_64+0x69/0xc0 Aug 22 14:50:30 juju-e4d256-prod-github-runner-207 kernel: [34004.616394] ? do_syscall_64+0x69/0xc0 Aug 22 14:50:30 juju-e4d256-prod-github-runner-207 kernel: [34004.617015] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 14:50:30 juju-e4d256-prod-github-runner-207 kernel: [34004.617720] RIP: 0033:0x7faa5d0edaff Aug 22 14:50:30 juju-e4d256-prod-github-runner-207 kernel: [34004.618385] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 14:50:30 juju-e4d256-prod-github-runner-207 kernel: [34004.620372] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 14:50:30 juju-e4d256-prod-github-runner-207 kernel: [34004.621282] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 14:50:30 juju-e4d256-prod-github-runner-207 kernel: [34004.622180] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 14:50:30 juju-e4d256-prod-github-runner-207 kernel: [34004.623074] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 14:50:30 juju-e4d256-prod-github-runner-207 kernel: [34004.623963] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 14:50:30 juju-e4d256-prod-github-runner-207 kernel: [34004.624856] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 14:50:30 juju-e4d256-prod-github-runner-207 kernel: [34004.625751] Aug 22 14:50:45 juju-e4d256-prod-github-runner-207 kernel: [34019.456705] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 14:50:45 juju-e4d256-prod-github-runner-207 kernel: [34019.458436] rcu: 1-....: (8449011 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=4081685 Aug 22 14:50:45 juju-e4d256-prod-github-runner-207 kernel: [34019.459587] (t=8475564 jiffies g=23269 q=36375) Aug 22 14:50:45 juju-e4d256-prod-github-runner-207 kernel: [34019.460382] NMI backtrace for cpu 1 Aug 22 14:50:45 juju-e4d256-prod-github-runner-207 kernel: [34019.461128] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 14:50:45 juju-e4d256-prod-github-runner-207 kernel: [34019.462736] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 14:50:45 juju-e4d256-prod-github-runner-207 kernel: [34019.463829] Call Trace: Aug 22 14:50:45 juju-e4d256-prod-github-runner-207 kernel: [34019.464514] Aug 22 14:50:45 juju-e4d256-prod-github-runner-207 kernel: [34019.465211] show_stack+0x52/0x5c Aug 22 14:50:45 juju-e4d256-prod-github-runner-207 kernel: [34019.465983] dump_stack_lvl+0x4a/0x63 Aug 22 14:50:45 juju-e4d256-prod-github-runner-207 kernel: [34019.466771] dump_stack+0x10/0x16 Aug 22 14:50:45 juju-e4d256-prod-github-runner-207 kernel: [34019.467519] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 14:50:45 juju-e4d256-prod-github-runner-207 kernel: [34019.468331] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 14:50:45 juju-e4d256-prod-github-runner-207 kernel: [34019.469151] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 14:50:45 juju-e4d256-prod-github-runner-207 kernel: [34019.470101] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 14:50:45 juju-e4d256-prod-github-runner-207 kernel: [34019.470965] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 14:50:45 juju-e4d256-prod-github-runner-207 kernel: [34019.471811] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 14:50:45 juju-e4d256-prod-github-runner-207 kernel: [34019.472631] print_cpu_stall.cold+0x2f/0xe2 Aug 22 14:50:45 juju-e4d256-prod-github-runner-207 kernel: [34019.473422] ? timekeeping_update+0xf7/0x150 Aug 22 14:50:45 juju-e4d256-prod-github-runner-207 kernel: [34019.474267] check_cpu_stall+0x109/0x270 Aug 22 14:50:45 juju-e4d256-prod-github-runner-207 kernel: [34019.475037] rcu_sched_clock_irq+0x9a/0x250 Aug 22 14:50:45 juju-e4d256-prod-github-runner-207 kernel: [34019.475813] update_process_times+0x94/0xd0 Aug 22 14:50:45 juju-e4d256-prod-github-runner-207 kernel: [34019.476599] tick_sched_handle+0x29/0x70 Aug 22 14:50:45 juju-e4d256-prod-github-runner-207 kernel: [34019.477362] tick_sched_timer+0x8c/0xc0 Aug 22 14:50:45 juju-e4d256-prod-github-runner-207 kernel: [34019.478177] ? tick_nohz_handler+0xb0/0xb0 Aug 22 14:50:45 juju-e4d256-prod-github-runner-207 kernel: [34019.478962] __hrtimer_run_queues+0x107/0x230 Aug 22 14:50:45 juju-e4d256-prod-github-runner-207 kernel: [34019.479760] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 14:50:45 juju-e4d256-prod-github-runner-207 kernel: [34019.480557] hrtimer_interrupt+0x101/0x220 Aug 22 14:50:45 juju-e4d256-prod-github-runner-207 kernel: [34019.481328] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 14:50:45 juju-e4d256-prod-github-runner-207 kernel: [34019.482174] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 14:50:45 juju-e4d256-prod-github-runner-207 kernel: [34019.482991] Aug 22 14:50:45 juju-e4d256-prod-github-runner-207 kernel: [34019.483636] Aug 22 14:50:45 juju-e4d256-prod-github-runner-207 kernel: [34019.484270] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 14:50:45 juju-e4d256-prod-github-runner-207 kernel: [34019.485109] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:50:45 juju-e4d256-prod-github-runner-207 kernel: [34019.486018] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 14:50:45 juju-e4d256-prod-github-runner-207 kernel: [34019.488318] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 14:50:45 juju-e4d256-prod-github-runner-207 kernel: [34019.489269] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 14:50:45 juju-e4d256-prod-github-runner-207 kernel: [34019.490382] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 14:50:45 juju-e4d256-prod-github-runner-207 kernel: [34019.491382] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 14:50:45 juju-e4d256-prod-github-runner-207 kernel: [34019.492363] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 14:50:45 juju-e4d256-prod-github-runner-207 kernel: [34019.493337] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 14:50:45 juju-e4d256-prod-github-runner-207 kernel: [34019.494330] ? _raw_spin_lock+0x22/0x30 Aug 22 14:50:45 juju-e4d256-prod-github-runner-207 kernel: [34019.495245] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:50:45 juju-e4d256-prod-github-runner-207 kernel: [34019.496117] direct_page_fault+0x206/0x310 [kvm] Aug 22 14:50:45 juju-e4d256-prod-github-runner-207 kernel: [34019.496974] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 14:50:45 juju-e4d256-prod-github-runner-207 kernel: [34019.497829] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 14:50:45 juju-e4d256-prod-github-runner-207 kernel: [34019.498683] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 14:50:45 juju-e4d256-prod-github-runner-207 kernel: [34019.499543] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 14:50:45 juju-e4d256-prod-github-runner-207 kernel: [34019.500341] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 14:50:45 juju-e4d256-prod-github-runner-207 kernel: [34019.501180] handle_exit+0x98/0x230 [kvm_amd] Aug 22 14:50:45 juju-e4d256-prod-github-runner-207 kernel: [34019.502066] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 14:50:45 juju-e4d256-prod-github-runner-207 kernel: [34019.502868] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 14:50:45 juju-e4d256-prod-github-runner-207 kernel: [34019.503688] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 14:50:45 juju-e4d256-prod-github-runner-207 kernel: [34019.504494] vcpu_run+0x62/0x2c0 [kvm] Aug 22 14:50:45 juju-e4d256-prod-github-runner-207 kernel: [34019.505220] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 14:50:45 juju-e4d256-prod-github-runner-207 kernel: [34019.505993] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 14:50:45 juju-e4d256-prod-github-runner-207 kernel: [34019.506809] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 14:50:45 juju-e4d256-prod-github-runner-207 kernel: [34019.507580] ? __seccomp_filter+0x4a/0x4a0 Aug 22 14:50:45 juju-e4d256-prod-github-runner-207 kernel: [34019.508312] ? __fget_files+0x86/0xc0 Aug 22 14:50:45 juju-e4d256-prod-github-runner-207 kernel: [34019.509015] __x64_sys_ioctl+0x95/0xd0 Aug 22 14:50:45 juju-e4d256-prod-github-runner-207 kernel: [34019.509724] do_syscall_64+0x5c/0xc0 Aug 22 14:50:45 juju-e4d256-prod-github-runner-207 kernel: [34019.510421] ? do_futex+0x162/0x1f0 Aug 22 14:50:45 juju-e4d256-prod-github-runner-207 kernel: [34019.511115] ? __x64_sys_futex+0x78/0x1e0 Aug 22 14:50:45 juju-e4d256-prod-github-runner-207 kernel: [34019.511833] ? __secure_computing+0xa9/0x120 Aug 22 14:50:45 juju-e4d256-prod-github-runner-207 kernel: [34019.512559] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 14:50:45 juju-e4d256-prod-github-runner-207 kernel: [34019.513364] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:50:45 juju-e4d256-prod-github-runner-207 kernel: [34019.514146] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:50:45 juju-e4d256-prod-github-runner-207 kernel: [34019.514967] ? do_syscall_64+0x69/0xc0 Aug 22 14:50:45 juju-e4d256-prod-github-runner-207 kernel: [34019.515678] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:50:45 juju-e4d256-prod-github-runner-207 kernel: [34019.516464] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:50:45 juju-e4d256-prod-github-runner-207 kernel: [34019.517236] ? do_syscall_64+0x69/0xc0 Aug 22 14:50:45 juju-e4d256-prod-github-runner-207 kernel: [34019.517962] ? do_syscall_64+0x69/0xc0 Aug 22 14:50:45 juju-e4d256-prod-github-runner-207 kernel: [34019.518668] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 14:50:45 juju-e4d256-prod-github-runner-207 kernel: [34019.519455] RIP: 0033:0x7faa5d0edaff Aug 22 14:50:45 juju-e4d256-prod-github-runner-207 kernel: [34019.520189] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 14:50:45 juju-e4d256-prod-github-runner-207 kernel: [34019.522370] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 14:50:45 juju-e4d256-prod-github-runner-207 kernel: [34019.523354] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 14:50:45 juju-e4d256-prod-github-runner-207 kernel: [34019.524330] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 14:50:45 juju-e4d256-prod-github-runner-207 kernel: [34019.525302] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 14:50:45 juju-e4d256-prod-github-runner-207 kernel: [34019.526273] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 14:50:45 juju-e4d256-prod-github-runner-207 kernel: [34019.527219] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 14:50:45 juju-e4d256-prod-github-runner-207 kernel: [34019.528150] Aug 22 14:51:10 juju-e4d256-prod-github-runner-207 kernel: [34044.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 31598s! [qemu-system-x86:6715] Aug 22 14:51:10 juju-e4d256-prod-github-runner-207 kernel: [34044.543965] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 14:51:10 juju-e4d256-prod-github-runner-207 kernel: [34044.544254] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 14:51:10 juju-e4d256-prod-github-runner-207 kernel: [34044.557831] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 14:51:10 juju-e4d256-prod-github-runner-207 kernel: [34044.559142] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 14:51:10 juju-e4d256-prod-github-runner-207 kernel: [34044.560399] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:51:10 juju-e4d256-prod-github-runner-207 kernel: [34044.561480] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 14:51:10 juju-e4d256-prod-github-runner-207 kernel: [34044.564109] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 14:51:10 juju-e4d256-prod-github-runner-207 kernel: [34044.565174] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 14:51:10 juju-e4d256-prod-github-runner-207 kernel: [34044.566380] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 14:51:10 juju-e4d256-prod-github-runner-207 kernel: [34044.567567] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 14:51:10 juju-e4d256-prod-github-runner-207 kernel: [34044.568784] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 14:51:10 juju-e4d256-prod-github-runner-207 kernel: [34044.570039] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 14:51:10 juju-e4d256-prod-github-runner-207 kernel: [34044.571242] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 14:51:10 juju-e4d256-prod-github-runner-207 kernel: [34044.572497] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 14:51:10 juju-e4d256-prod-github-runner-207 kernel: [34044.573829] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 14:51:10 juju-e4d256-prod-github-runner-207 kernel: [34044.575046] Call Trace: Aug 22 14:51:10 juju-e4d256-prod-github-runner-207 kernel: [34044.575971] Aug 22 14:51:10 juju-e4d256-prod-github-runner-207 kernel: [34044.577031] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:51:10 juju-e4d256-prod-github-runner-207 kernel: [34044.578094] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:51:10 juju-e4d256-prod-github-runner-207 kernel: [34044.579135] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:51:10 juju-e4d256-prod-github-runner-207 kernel: [34044.580269] ? show_regs.part.0+0x23/0x29 Aug 22 14:51:10 juju-e4d256-prod-github-runner-207 kernel: [34044.581282] ? show_regs.cold+0x8/0xd Aug 22 14:51:10 juju-e4d256-prod-github-runner-207 kernel: [34044.582290] ? watchdog_timer_fn+0x1be/0x220 Aug 22 14:51:10 juju-e4d256-prod-github-runner-207 kernel: [34044.583317] ? lockup_detector_update_enable+0x60/0x60 Aug 22 14:51:10 juju-e4d256-prod-github-runner-207 kernel: [34044.584449] ? __hrtimer_run_queues+0x107/0x230 Aug 22 14:51:10 juju-e4d256-prod-github-runner-207 kernel: [34044.585526] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 14:51:10 juju-e4d256-prod-github-runner-207 kernel: [34044.586589] ? hrtimer_interrupt+0x101/0x220 Aug 22 14:51:10 juju-e4d256-prod-github-runner-207 kernel: [34044.588145] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 14:51:10 juju-e4d256-prod-github-runner-207 kernel: [34044.589368] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 14:51:10 juju-e4d256-prod-github-runner-207 kernel: [34044.590604] Aug 22 14:51:10 juju-e4d256-prod-github-runner-207 kernel: [34044.591682] Aug 22 14:51:10 juju-e4d256-prod-github-runner-207 kernel: [34044.592686] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 14:51:10 juju-e4d256-prod-github-runner-207 kernel: [34044.593872] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:51:10 juju-e4d256-prod-github-runner-207 kernel: [34044.594943] ? _raw_spin_lock+0x22/0x30 Aug 22 14:51:10 juju-e4d256-prod-github-runner-207 kernel: [34044.595910] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:51:10 juju-e4d256-prod-github-runner-207 kernel: [34044.596957] direct_page_fault+0x206/0x310 [kvm] Aug 22 14:51:10 juju-e4d256-prod-github-runner-207 kernel: [34044.598015] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 14:51:10 juju-e4d256-prod-github-runner-207 kernel: [34044.599047] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 14:51:10 juju-e4d256-prod-github-runner-207 kernel: [34044.600084] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 14:51:10 juju-e4d256-prod-github-runner-207 kernel: [34044.601151] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 14:51:10 juju-e4d256-prod-github-runner-207 kernel: [34044.602134] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 14:51:10 juju-e4d256-prod-github-runner-207 kernel: [34044.603134] handle_exit+0x98/0x230 [kvm_amd] Aug 22 14:51:10 juju-e4d256-prod-github-runner-207 kernel: [34044.604042] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 14:51:10 juju-e4d256-prod-github-runner-207 kernel: [34044.605011] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 14:51:10 juju-e4d256-prod-github-runner-207 kernel: [34044.606029] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 14:51:10 juju-e4d256-prod-github-runner-207 kernel: [34044.606998] vcpu_run+0x62/0x2c0 [kvm] Aug 22 14:51:10 juju-e4d256-prod-github-runner-207 kernel: [34044.607863] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 14:51:10 juju-e4d256-prod-github-runner-207 kernel: [34044.608714] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 14:51:10 juju-e4d256-prod-github-runner-207 kernel: [34044.609625] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 14:51:10 juju-e4d256-prod-github-runner-207 kernel: [34044.610459] ? __seccomp_filter+0x4a/0x4a0 Aug 22 14:51:10 juju-e4d256-prod-github-runner-207 kernel: [34044.611221] ? __fget_files+0x86/0xc0 Aug 22 14:51:10 juju-e4d256-prod-github-runner-207 kernel: [34044.611940] __x64_sys_ioctl+0x95/0xd0 Aug 22 14:51:10 juju-e4d256-prod-github-runner-207 kernel: [34044.612647] do_syscall_64+0x5c/0xc0 Aug 22 14:51:10 juju-e4d256-prod-github-runner-207 kernel: [34044.613332] ? do_futex+0x162/0x1f0 Aug 22 14:51:10 juju-e4d256-prod-github-runner-207 kernel: [34044.614022] ? __x64_sys_futex+0x78/0x1e0 Aug 22 14:51:10 juju-e4d256-prod-github-runner-207 kernel: [34044.614708] ? __secure_computing+0xa9/0x120 Aug 22 14:51:10 juju-e4d256-prod-github-runner-207 kernel: [34044.615415] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 14:51:10 juju-e4d256-prod-github-runner-207 kernel: [34044.616190] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:51:10 juju-e4d256-prod-github-runner-207 kernel: [34044.616929] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:51:10 juju-e4d256-prod-github-runner-207 kernel: [34044.617671] ? do_syscall_64+0x69/0xc0 Aug 22 14:51:10 juju-e4d256-prod-github-runner-207 kernel: [34044.618344] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:51:10 juju-e4d256-prod-github-runner-207 kernel: [34044.619065] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:51:10 juju-e4d256-prod-github-runner-207 kernel: [34044.619777] ? do_syscall_64+0x69/0xc0 Aug 22 14:51:10 juju-e4d256-prod-github-runner-207 kernel: [34044.620412] ? do_syscall_64+0x69/0xc0 Aug 22 14:51:10 juju-e4d256-prod-github-runner-207 kernel: [34044.621060] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 14:51:10 juju-e4d256-prod-github-runner-207 kernel: [34044.621798] RIP: 0033:0x7faa5d0edaff Aug 22 14:51:10 juju-e4d256-prod-github-runner-207 kernel: [34044.622489] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 14:51:10 juju-e4d256-prod-github-runner-207 kernel: [34044.624555] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 14:51:10 juju-e4d256-prod-github-runner-207 kernel: [34044.625502] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 14:51:10 juju-e4d256-prod-github-runner-207 kernel: [34044.626413] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 14:51:10 juju-e4d256-prod-github-runner-207 kernel: [34044.627324] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 14:51:10 juju-e4d256-prod-github-runner-207 kernel: [34044.628229] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 14:51:10 juju-e4d256-prod-github-runner-207 kernel: [34044.629136] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 14:51:10 juju-e4d256-prod-github-runner-207 kernel: [34044.630076] Aug 22 14:51:38 juju-e4d256-prod-github-runner-207 kernel: [34072.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 31624s! [qemu-system-x86:6715] Aug 22 14:51:38 juju-e4d256-prod-github-runner-207 kernel: [34072.543875] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 14:51:38 juju-e4d256-prod-github-runner-207 kernel: [34072.544183] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 14:51:38 juju-e4d256-prod-github-runner-207 kernel: [34072.556328] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 14:51:38 juju-e4d256-prod-github-runner-207 kernel: [34072.557604] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 14:51:38 juju-e4d256-prod-github-runner-207 kernel: [34072.558822] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:51:38 juju-e4d256-prod-github-runner-207 kernel: [34072.559882] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 14:51:38 juju-e4d256-prod-github-runner-207 kernel: [34072.562445] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 14:51:38 juju-e4d256-prod-github-runner-207 kernel: [34072.563490] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 14:51:38 juju-e4d256-prod-github-runner-207 kernel: [34072.564657] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 14:51:38 juju-e4d256-prod-github-runner-207 kernel: [34072.565825] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 14:51:38 juju-e4d256-prod-github-runner-207 kernel: [34072.566987] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 14:51:38 juju-e4d256-prod-github-runner-207 kernel: [34072.568149] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 14:51:38 juju-e4d256-prod-github-runner-207 kernel: [34072.569324] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 14:51:38 juju-e4d256-prod-github-runner-207 kernel: [34072.570561] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 14:51:38 juju-e4d256-prod-github-runner-207 kernel: [34072.571658] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 14:51:38 juju-e4d256-prod-github-runner-207 kernel: [34072.572851] Call Trace: Aug 22 14:51:38 juju-e4d256-prod-github-runner-207 kernel: [34072.573772] Aug 22 14:51:38 juju-e4d256-prod-github-runner-207 kernel: [34072.574668] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:51:38 juju-e4d256-prod-github-runner-207 kernel: [34072.575703] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:51:38 juju-e4d256-prod-github-runner-207 kernel: [34072.576727] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:51:38 juju-e4d256-prod-github-runner-207 kernel: [34072.577835] ? show_regs.part.0+0x23/0x29 Aug 22 14:51:38 juju-e4d256-prod-github-runner-207 kernel: [34072.578833] ? show_regs.cold+0x8/0xd Aug 22 14:51:38 juju-e4d256-prod-github-runner-207 kernel: [34072.579804] ? watchdog_timer_fn+0x1be/0x220 Aug 22 14:51:38 juju-e4d256-prod-github-runner-207 kernel: [34072.580816] ? lockup_detector_update_enable+0x60/0x60 Aug 22 14:51:38 juju-e4d256-prod-github-runner-207 kernel: [34072.581926] ? __hrtimer_run_queues+0x107/0x230 Aug 22 14:51:38 juju-e4d256-prod-github-runner-207 kernel: [34072.582958] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 14:51:38 juju-e4d256-prod-github-runner-207 kernel: [34072.584009] ? hrtimer_interrupt+0x101/0x220 Aug 22 14:51:38 juju-e4d256-prod-github-runner-207 kernel: [34072.585027] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 14:51:38 juju-e4d256-prod-github-runner-207 kernel: [34072.586105] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 14:51:38 juju-e4d256-prod-github-runner-207 kernel: [34072.587154] Aug 22 14:51:38 juju-e4d256-prod-github-runner-207 kernel: [34072.588011] Aug 22 14:51:38 juju-e4d256-prod-github-runner-207 kernel: [34072.588881] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 14:51:38 juju-e4d256-prod-github-runner-207 kernel: [34072.589954] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:51:38 juju-e4d256-prod-github-runner-207 kernel: [34072.590996] ? _raw_spin_lock+0x22/0x30 Aug 22 14:51:38 juju-e4d256-prod-github-runner-207 kernel: [34072.591953] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:51:38 juju-e4d256-prod-github-runner-207 kernel: [34072.592972] direct_page_fault+0x206/0x310 [kvm] Aug 22 14:51:38 juju-e4d256-prod-github-runner-207 kernel: [34072.594009] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 14:51:38 juju-e4d256-prod-github-runner-207 kernel: [34072.595014] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 14:51:38 juju-e4d256-prod-github-runner-207 kernel: [34072.596014] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 14:51:38 juju-e4d256-prod-github-runner-207 kernel: [34072.597009] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 14:51:38 juju-e4d256-prod-github-runner-207 kernel: [34072.597959] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 14:51:38 juju-e4d256-prod-github-runner-207 kernel: [34072.598944] handle_exit+0x98/0x230 [kvm_amd] Aug 22 14:51:38 juju-e4d256-prod-github-runner-207 kernel: [34072.599840] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 14:51:38 juju-e4d256-prod-github-runner-207 kernel: [34072.600752] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 14:51:38 juju-e4d256-prod-github-runner-207 kernel: [34072.601691] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 14:51:38 juju-e4d256-prod-github-runner-207 kernel: [34072.602593] vcpu_run+0x62/0x2c0 [kvm] Aug 22 14:51:38 juju-e4d256-prod-github-runner-207 kernel: [34072.603404] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 14:51:38 juju-e4d256-prod-github-runner-207 kernel: [34072.604210] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 14:51:38 juju-e4d256-prod-github-runner-207 kernel: [34072.605062] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 14:51:38 juju-e4d256-prod-github-runner-207 kernel: [34072.605867] ? __seccomp_filter+0x4a/0x4a0 Aug 22 14:51:38 juju-e4d256-prod-github-runner-207 kernel: [34072.606608] ? __fget_files+0x86/0xc0 Aug 22 14:51:38 juju-e4d256-prod-github-runner-207 kernel: [34072.607309] __x64_sys_ioctl+0x95/0xd0 Aug 22 14:51:38 juju-e4d256-prod-github-runner-207 kernel: [34072.607999] do_syscall_64+0x5c/0xc0 Aug 22 14:51:38 juju-e4d256-prod-github-runner-207 kernel: [34072.608660] ? do_futex+0x162/0x1f0 Aug 22 14:51:38 juju-e4d256-prod-github-runner-207 kernel: [34072.609323] ? __x64_sys_futex+0x78/0x1e0 Aug 22 14:51:38 juju-e4d256-prod-github-runner-207 kernel: [34072.609995] ? __secure_computing+0xa9/0x120 Aug 22 14:51:38 juju-e4d256-prod-github-runner-207 kernel: [34072.610683] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 14:51:38 juju-e4d256-prod-github-runner-207 kernel: [34072.611447] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:51:38 juju-e4d256-prod-github-runner-207 kernel: [34072.612202] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:51:38 juju-e4d256-prod-github-runner-207 kernel: [34072.612922] ? do_syscall_64+0x69/0xc0 Aug 22 14:51:38 juju-e4d256-prod-github-runner-207 kernel: [34072.613586] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:51:38 juju-e4d256-prod-github-runner-207 kernel: [34072.614312] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:51:38 juju-e4d256-prod-github-runner-207 kernel: [34072.615014] ? do_syscall_64+0x69/0xc0 Aug 22 14:51:38 juju-e4d256-prod-github-runner-207 kernel: [34072.615648] ? do_syscall_64+0x69/0xc0 Aug 22 14:51:38 juju-e4d256-prod-github-runner-207 kernel: [34072.616305] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 14:51:38 juju-e4d256-prod-github-runner-207 kernel: [34072.617046] RIP: 0033:0x7faa5d0edaff Aug 22 14:51:38 juju-e4d256-prod-github-runner-207 kernel: [34072.617742] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 14:51:38 juju-e4d256-prod-github-runner-207 kernel: [34072.619865] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 14:51:38 juju-e4d256-prod-github-runner-207 kernel: [34072.620777] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 14:51:38 juju-e4d256-prod-github-runner-207 kernel: [34072.621685] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 14:51:38 juju-e4d256-prod-github-runner-207 kernel: [34072.622571] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 14:51:38 juju-e4d256-prod-github-runner-207 kernel: [34072.623455] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 14:51:38 juju-e4d256-prod-github-runner-207 kernel: [34072.624345] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 14:51:38 juju-e4d256-prod-github-runner-207 kernel: [34072.625252] Aug 22 14:52:06 juju-e4d256-prod-github-runner-207 kernel: [34100.541980] watchdog: BUG: soft lockup - CPU#1 stuck for 31650s! [qemu-system-x86:6715] Aug 22 14:52:06 juju-e4d256-prod-github-runner-207 kernel: [34100.543866] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 14:52:06 juju-e4d256-prod-github-runner-207 kernel: [34100.544173] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 14:52:06 juju-e4d256-prod-github-runner-207 kernel: [34100.556296] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 14:52:06 juju-e4d256-prod-github-runner-207 kernel: [34100.557619] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 14:52:06 juju-e4d256-prod-github-runner-207 kernel: [34100.558858] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:52:06 juju-e4d256-prod-github-runner-207 kernel: [34100.559922] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 14:52:06 juju-e4d256-prod-github-runner-207 kernel: [34100.562532] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 14:52:06 juju-e4d256-prod-github-runner-207 kernel: [34100.563590] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 14:52:06 juju-e4d256-prod-github-runner-207 kernel: [34100.564749] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 14:52:06 juju-e4d256-prod-github-runner-207 kernel: [34100.565926] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 14:52:06 juju-e4d256-prod-github-runner-207 kernel: [34100.567088] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 14:52:06 juju-e4d256-prod-github-runner-207 kernel: [34100.568250] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 14:52:06 juju-e4d256-prod-github-runner-207 kernel: [34100.569433] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 14:52:06 juju-e4d256-prod-github-runner-207 kernel: [34100.570664] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 14:52:06 juju-e4d256-prod-github-runner-207 kernel: [34100.571766] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 14:52:06 juju-e4d256-prod-github-runner-207 kernel: [34100.572965] Call Trace: Aug 22 14:52:06 juju-e4d256-prod-github-runner-207 kernel: [34100.573876] Aug 22 14:52:06 juju-e4d256-prod-github-runner-207 kernel: [34100.574781] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:52:06 juju-e4d256-prod-github-runner-207 kernel: [34100.575813] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:52:06 juju-e4d256-prod-github-runner-207 kernel: [34100.576837] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:52:06 juju-e4d256-prod-github-runner-207 kernel: [34100.577954] ? show_regs.part.0+0x23/0x29 Aug 22 14:52:06 juju-e4d256-prod-github-runner-207 kernel: [34100.578959] ? show_regs.cold+0x8/0xd Aug 22 14:52:06 juju-e4d256-prod-github-runner-207 kernel: [34100.579929] ? watchdog_timer_fn+0x1be/0x220 Aug 22 14:52:06 juju-e4d256-prod-github-runner-207 kernel: [34100.580946] ? lockup_detector_update_enable+0x60/0x60 Aug 22 14:52:06 juju-e4d256-prod-github-runner-207 kernel: [34100.582014] ? __hrtimer_run_queues+0x107/0x230 Aug 22 14:52:06 juju-e4d256-prod-github-runner-207 kernel: [34100.583041] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 14:52:06 juju-e4d256-prod-github-runner-207 kernel: [34100.584070] ? hrtimer_interrupt+0x101/0x220 Aug 22 14:52:06 juju-e4d256-prod-github-runner-207 kernel: [34100.585124] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 14:52:06 juju-e4d256-prod-github-runner-207 kernel: [34100.586206] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 14:52:06 juju-e4d256-prod-github-runner-207 kernel: [34100.587277] Aug 22 14:52:06 juju-e4d256-prod-github-runner-207 kernel: [34100.588132] Aug 22 14:52:06 juju-e4d256-prod-github-runner-207 kernel: [34100.588979] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 14:52:06 juju-e4d256-prod-github-runner-207 kernel: [34100.590011] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:52:06 juju-e4d256-prod-github-runner-207 kernel: [34100.591061] ? _raw_spin_lock+0x22/0x30 Aug 22 14:52:06 juju-e4d256-prod-github-runner-207 kernel: [34100.592005] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:52:06 juju-e4d256-prod-github-runner-207 kernel: [34100.593040] direct_page_fault+0x206/0x310 [kvm] Aug 22 14:52:06 juju-e4d256-prod-github-runner-207 kernel: [34100.594062] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 14:52:06 juju-e4d256-prod-github-runner-207 kernel: [34100.595068] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 14:52:06 juju-e4d256-prod-github-runner-207 kernel: [34100.596064] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 14:52:06 juju-e4d256-prod-github-runner-207 kernel: [34100.597102] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 14:52:06 juju-e4d256-prod-github-runner-207 kernel: [34100.598062] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 14:52:06 juju-e4d256-prod-github-runner-207 kernel: [34100.599038] handle_exit+0x98/0x230 [kvm_amd] Aug 22 14:52:06 juju-e4d256-prod-github-runner-207 kernel: [34100.599952] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 14:52:06 juju-e4d256-prod-github-runner-207 kernel: [34100.600873] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 14:52:06 juju-e4d256-prod-github-runner-207 kernel: [34100.601818] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 14:52:06 juju-e4d256-prod-github-runner-207 kernel: [34100.602720] vcpu_run+0x62/0x2c0 [kvm] Aug 22 14:52:06 juju-e4d256-prod-github-runner-207 kernel: [34100.603529] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 14:52:06 juju-e4d256-prod-github-runner-207 kernel: [34100.604334] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 14:52:06 juju-e4d256-prod-github-runner-207 kernel: [34100.605195] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 14:52:06 juju-e4d256-prod-github-runner-207 kernel: [34100.605991] ? __seccomp_filter+0x4a/0x4a0 Aug 22 14:52:06 juju-e4d256-prod-github-runner-207 kernel: [34100.606732] ? __fget_files+0x86/0xc0 Aug 22 14:52:06 juju-e4d256-prod-github-runner-207 kernel: [34100.607453] __x64_sys_ioctl+0x95/0xd0 Aug 22 14:52:06 juju-e4d256-prod-github-runner-207 kernel: [34100.608156] do_syscall_64+0x5c/0xc0 Aug 22 14:52:06 juju-e4d256-prod-github-runner-207 kernel: [34100.608824] ? do_futex+0x162/0x1f0 Aug 22 14:52:06 juju-e4d256-prod-github-runner-207 kernel: [34100.609487] ? __x64_sys_futex+0x78/0x1e0 Aug 22 14:52:06 juju-e4d256-prod-github-runner-207 kernel: [34100.610158] ? __secure_computing+0xa9/0x120 Aug 22 14:52:06 juju-e4d256-prod-github-runner-207 kernel: [34100.610845] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 14:52:06 juju-e4d256-prod-github-runner-207 kernel: [34100.611602] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:52:06 juju-e4d256-prod-github-runner-207 kernel: [34100.612326] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:52:06 juju-e4d256-prod-github-runner-207 kernel: [34100.613062] ? do_syscall_64+0x69/0xc0 Aug 22 14:52:06 juju-e4d256-prod-github-runner-207 kernel: [34100.613713] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:52:06 juju-e4d256-prod-github-runner-207 kernel: [34100.614427] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:52:06 juju-e4d256-prod-github-runner-207 kernel: [34100.615120] ? do_syscall_64+0x69/0xc0 Aug 22 14:52:06 juju-e4d256-prod-github-runner-207 kernel: [34100.615748] ? do_syscall_64+0x69/0xc0 Aug 22 14:52:06 juju-e4d256-prod-github-runner-207 kernel: [34100.616369] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 14:52:06 juju-e4d256-prod-github-runner-207 kernel: [34100.617106] RIP: 0033:0x7faa5d0edaff Aug 22 14:52:06 juju-e4d256-prod-github-runner-207 kernel: [34100.617760] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 14:52:06 juju-e4d256-prod-github-runner-207 kernel: [34100.619779] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 14:52:06 juju-e4d256-prod-github-runner-207 kernel: [34100.620728] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 14:52:06 juju-e4d256-prod-github-runner-207 kernel: [34100.621641] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 14:52:06 juju-e4d256-prod-github-runner-207 kernel: [34100.622536] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 14:52:06 juju-e4d256-prod-github-runner-207 kernel: [34100.623425] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 14:52:06 juju-e4d256-prod-github-runner-207 kernel: [34100.624319] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 14:52:06 juju-e4d256-prod-github-runner-207 kernel: [34100.625228] Aug 22 14:52:34 juju-e4d256-prod-github-runner-207 kernel: [34128.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 31676s! [qemu-system-x86:6715] Aug 22 14:52:34 juju-e4d256-prod-github-runner-207 kernel: [34128.543108] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 14:52:34 juju-e4d256-prod-github-runner-207 kernel: [34128.543181] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 14:52:34 juju-e4d256-prod-github-runner-207 kernel: [34128.555400] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 14:52:34 juju-e4d256-prod-github-runner-207 kernel: [34128.556671] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 14:52:34 juju-e4d256-prod-github-runner-207 kernel: [34128.557897] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:52:34 juju-e4d256-prod-github-runner-207 kernel: [34128.558961] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 14:52:34 juju-e4d256-prod-github-runner-207 kernel: [34128.561566] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 14:52:34 juju-e4d256-prod-github-runner-207 kernel: [34128.562611] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 14:52:34 juju-e4d256-prod-github-runner-207 kernel: [34128.563771] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 14:52:34 juju-e4d256-prod-github-runner-207 kernel: [34128.564943] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 14:52:34 juju-e4d256-prod-github-runner-207 kernel: [34128.566103] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 14:52:34 juju-e4d256-prod-github-runner-207 kernel: [34128.567268] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 14:52:34 juju-e4d256-prod-github-runner-207 kernel: [34128.568434] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 14:52:34 juju-e4d256-prod-github-runner-207 kernel: [34128.569683] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 14:52:34 juju-e4d256-prod-github-runner-207 kernel: [34128.570783] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 14:52:34 juju-e4d256-prod-github-runner-207 kernel: [34128.572007] Call Trace: Aug 22 14:52:34 juju-e4d256-prod-github-runner-207 kernel: [34128.572946] Aug 22 14:52:34 juju-e4d256-prod-github-runner-207 kernel: [34128.573837] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:52:34 juju-e4d256-prod-github-runner-207 kernel: [34128.574871] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:52:34 juju-e4d256-prod-github-runner-207 kernel: [34128.575898] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:52:34 juju-e4d256-prod-github-runner-207 kernel: [34128.576995] ? show_regs.part.0+0x23/0x29 Aug 22 14:52:34 juju-e4d256-prod-github-runner-207 kernel: [34128.577995] ? show_regs.cold+0x8/0xd Aug 22 14:52:34 juju-e4d256-prod-github-runner-207 kernel: [34128.578973] ? watchdog_timer_fn+0x1be/0x220 Aug 22 14:52:34 juju-e4d256-prod-github-runner-207 kernel: [34128.579982] ? lockup_detector_update_enable+0x60/0x60 Aug 22 14:52:34 juju-e4d256-prod-github-runner-207 kernel: [34128.581065] ? __hrtimer_run_queues+0x107/0x230 Aug 22 14:52:34 juju-e4d256-prod-github-runner-207 kernel: [34128.582138] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 14:52:34 juju-e4d256-prod-github-runner-207 kernel: [34128.583171] ? hrtimer_interrupt+0x101/0x220 Aug 22 14:52:34 juju-e4d256-prod-github-runner-207 kernel: [34128.584184] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 14:52:34 juju-e4d256-prod-github-runner-207 kernel: [34128.585257] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 14:52:34 juju-e4d256-prod-github-runner-207 kernel: [34128.586300] Aug 22 14:52:34 juju-e4d256-prod-github-runner-207 kernel: [34128.587156] Aug 22 14:52:34 juju-e4d256-prod-github-runner-207 kernel: [34128.587991] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 14:52:34 juju-e4d256-prod-github-runner-207 kernel: [34128.589033] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:52:34 juju-e4d256-prod-github-runner-207 kernel: [34128.590069] ? _raw_spin_lock+0x22/0x30 Aug 22 14:52:34 juju-e4d256-prod-github-runner-207 kernel: [34128.591010] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:52:34 juju-e4d256-prod-github-runner-207 kernel: [34128.592038] direct_page_fault+0x206/0x310 [kvm] Aug 22 14:52:34 juju-e4d256-prod-github-runner-207 kernel: [34128.593090] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 14:52:34 juju-e4d256-prod-github-runner-207 kernel: [34128.594134] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 14:52:34 juju-e4d256-prod-github-runner-207 kernel: [34128.595143] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 14:52:34 juju-e4d256-prod-github-runner-207 kernel: [34128.596110] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 14:52:34 juju-e4d256-prod-github-runner-207 kernel: [34128.597066] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 14:52:34 juju-e4d256-prod-github-runner-207 kernel: [34128.598052] handle_exit+0x98/0x230 [kvm_amd] Aug 22 14:52:34 juju-e4d256-prod-github-runner-207 kernel: [34128.598945] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 14:52:34 juju-e4d256-prod-github-runner-207 kernel: [34128.599855] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 14:52:34 juju-e4d256-prod-github-runner-207 kernel: [34128.600789] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 14:52:34 juju-e4d256-prod-github-runner-207 kernel: [34128.601694] vcpu_run+0x62/0x2c0 [kvm] Aug 22 14:52:34 juju-e4d256-prod-github-runner-207 kernel: [34128.602524] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 14:52:34 juju-e4d256-prod-github-runner-207 kernel: [34128.603362] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 14:52:34 juju-e4d256-prod-github-runner-207 kernel: [34128.604226] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 14:52:34 juju-e4d256-prod-github-runner-207 kernel: [34128.605035] ? __seccomp_filter+0x4a/0x4a0 Aug 22 14:52:34 juju-e4d256-prod-github-runner-207 kernel: [34128.605779] ? __fget_files+0x86/0xc0 Aug 22 14:52:34 juju-e4d256-prod-github-runner-207 kernel: [34128.606482] __x64_sys_ioctl+0x95/0xd0 Aug 22 14:52:34 juju-e4d256-prod-github-runner-207 kernel: [34128.607174] do_syscall_64+0x5c/0xc0 Aug 22 14:52:34 juju-e4d256-prod-github-runner-207 kernel: [34128.607846] ? do_futex+0x162/0x1f0 Aug 22 14:52:34 juju-e4d256-prod-github-runner-207 kernel: [34128.608496] ? __x64_sys_futex+0x78/0x1e0 Aug 22 14:52:34 juju-e4d256-prod-github-runner-207 kernel: [34128.609183] ? __secure_computing+0xa9/0x120 Aug 22 14:52:34 juju-e4d256-prod-github-runner-207 kernel: [34128.609871] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 14:52:34 juju-e4d256-prod-github-runner-207 kernel: [34128.610648] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:52:34 juju-e4d256-prod-github-runner-207 kernel: [34128.611377] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:52:34 juju-e4d256-prod-github-runner-207 kernel: [34128.612089] ? do_syscall_64+0x69/0xc0 Aug 22 14:52:34 juju-e4d256-prod-github-runner-207 kernel: [34128.612768] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:52:34 juju-e4d256-prod-github-runner-207 kernel: [34128.613487] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:52:34 juju-e4d256-prod-github-runner-207 kernel: [34128.614189] ? do_syscall_64+0x69/0xc0 Aug 22 14:52:34 juju-e4d256-prod-github-runner-207 kernel: [34128.614812] ? do_syscall_64+0x69/0xc0 Aug 22 14:52:34 juju-e4d256-prod-github-runner-207 kernel: [34128.615433] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 14:52:34 juju-e4d256-prod-github-runner-207 kernel: [34128.616142] RIP: 0033:0x7faa5d0edaff Aug 22 14:52:34 juju-e4d256-prod-github-runner-207 kernel: [34128.616782] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 14:52:34 juju-e4d256-prod-github-runner-207 kernel: [34128.618770] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 14:52:34 juju-e4d256-prod-github-runner-207 kernel: [34128.619688] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 14:52:34 juju-e4d256-prod-github-runner-207 kernel: [34128.620584] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 14:52:34 juju-e4d256-prod-github-runner-207 kernel: [34128.621493] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 14:52:34 juju-e4d256-prod-github-runner-207 kernel: [34128.622378] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 14:52:34 juju-e4d256-prod-github-runner-207 kernel: [34128.623285] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 14:52:34 juju-e4d256-prod-github-runner-207 kernel: [34128.624186] Aug 22 14:53:02 juju-e4d256-prod-github-runner-207 kernel: [34156.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 31702s! [qemu-system-x86:6715] Aug 22 14:53:02 juju-e4d256-prod-github-runner-207 kernel: [34156.543890] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 14:53:02 juju-e4d256-prod-github-runner-207 kernel: [34156.544182] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 14:53:02 juju-e4d256-prod-github-runner-207 kernel: [34156.556380] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 14:53:02 juju-e4d256-prod-github-runner-207 kernel: [34156.557651] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 14:53:02 juju-e4d256-prod-github-runner-207 kernel: [34156.559085] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:53:02 juju-e4d256-prod-github-runner-207 kernel: [34156.560154] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 14:53:02 juju-e4d256-prod-github-runner-207 kernel: [34156.562737] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 14:53:02 juju-e4d256-prod-github-runner-207 kernel: [34156.563865] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 14:53:02 juju-e4d256-prod-github-runner-207 kernel: [34156.565064] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 14:53:02 juju-e4d256-prod-github-runner-207 kernel: [34156.566323] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 14:53:02 juju-e4d256-prod-github-runner-207 kernel: [34156.567537] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 14:53:02 juju-e4d256-prod-github-runner-207 kernel: [34156.568751] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 14:53:02 juju-e4d256-prod-github-runner-207 kernel: [34156.569926] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 14:53:02 juju-e4d256-prod-github-runner-207 kernel: [34156.571163] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 14:53:02 juju-e4d256-prod-github-runner-207 kernel: [34156.572273] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 14:53:02 juju-e4d256-prod-github-runner-207 kernel: [34156.573477] Call Trace: Aug 22 14:53:02 juju-e4d256-prod-github-runner-207 kernel: [34156.574395] Aug 22 14:53:02 juju-e4d256-prod-github-runner-207 kernel: [34156.575321] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:53:02 juju-e4d256-prod-github-runner-207 kernel: [34156.576391] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:53:02 juju-e4d256-prod-github-runner-207 kernel: [34156.577417] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:53:02 juju-e4d256-prod-github-runner-207 kernel: [34156.578518] ? show_regs.part.0+0x23/0x29 Aug 22 14:53:02 juju-e4d256-prod-github-runner-207 kernel: [34156.579518] ? show_regs.cold+0x8/0xd Aug 22 14:53:02 juju-e4d256-prod-github-runner-207 kernel: [34156.580502] ? watchdog_timer_fn+0x1be/0x220 Aug 22 14:53:02 juju-e4d256-prod-github-runner-207 kernel: [34156.581515] ? lockup_detector_update_enable+0x60/0x60 Aug 22 14:53:02 juju-e4d256-prod-github-runner-207 kernel: [34156.582579] ? __hrtimer_run_queues+0x107/0x230 Aug 22 14:53:02 juju-e4d256-prod-github-runner-207 kernel: [34156.583612] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 14:53:02 juju-e4d256-prod-github-runner-207 kernel: [34156.584656] ? hrtimer_interrupt+0x101/0x220 Aug 22 14:53:02 juju-e4d256-prod-github-runner-207 kernel: [34156.585704] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 14:53:02 juju-e4d256-prod-github-runner-207 kernel: [34156.586790] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 14:53:02 juju-e4d256-prod-github-runner-207 kernel: [34156.587858] Aug 22 14:53:02 juju-e4d256-prod-github-runner-207 kernel: [34156.588737] Aug 22 14:53:02 juju-e4d256-prod-github-runner-207 kernel: [34156.589578] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 14:53:02 juju-e4d256-prod-github-runner-207 kernel: [34156.590625] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:53:02 juju-e4d256-prod-github-runner-207 kernel: [34156.591671] ? _raw_spin_lock+0x22/0x30 Aug 22 14:53:02 juju-e4d256-prod-github-runner-207 kernel: [34156.592649] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:53:02 juju-e4d256-prod-github-runner-207 kernel: [34156.593696] direct_page_fault+0x206/0x310 [kvm] Aug 22 14:53:02 juju-e4d256-prod-github-runner-207 kernel: [34156.594738] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 14:53:02 juju-e4d256-prod-github-runner-207 kernel: [34156.595762] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 14:53:02 juju-e4d256-prod-github-runner-207 kernel: [34156.596812] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 14:53:02 juju-e4d256-prod-github-runner-207 kernel: [34156.597824] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 14:53:02 juju-e4d256-prod-github-runner-207 kernel: [34156.598772] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 14:53:02 juju-e4d256-prod-github-runner-207 kernel: [34156.599753] handle_exit+0x98/0x230 [kvm_amd] Aug 22 14:53:02 juju-e4d256-prod-github-runner-207 kernel: [34156.600654] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 14:53:02 juju-e4d256-prod-github-runner-207 kernel: [34156.601596] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 14:53:02 juju-e4d256-prod-github-runner-207 kernel: [34156.602525] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 14:53:02 juju-e4d256-prod-github-runner-207 kernel: [34156.603436] vcpu_run+0x62/0x2c0 [kvm] Aug 22 14:53:02 juju-e4d256-prod-github-runner-207 kernel: [34156.604274] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 14:53:02 juju-e4d256-prod-github-runner-207 kernel: [34156.605085] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 14:53:02 juju-e4d256-prod-github-runner-207 kernel: [34156.605944] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 14:53:02 juju-e4d256-prod-github-runner-207 kernel: [34156.606743] ? __seccomp_filter+0x4a/0x4a0 Aug 22 14:53:02 juju-e4d256-prod-github-runner-207 kernel: [34156.607489] ? __fget_files+0x86/0xc0 Aug 22 14:53:02 juju-e4d256-prod-github-runner-207 kernel: [34156.608199] __x64_sys_ioctl+0x95/0xd0 Aug 22 14:53:02 juju-e4d256-prod-github-runner-207 kernel: [34156.608906] do_syscall_64+0x5c/0xc0 Aug 22 14:53:02 juju-e4d256-prod-github-runner-207 kernel: [34156.609577] ? do_futex+0x162/0x1f0 Aug 22 14:53:02 juju-e4d256-prod-github-runner-207 kernel: [34156.610226] ? __x64_sys_futex+0x78/0x1e0 Aug 22 14:53:02 juju-e4d256-prod-github-runner-207 kernel: [34156.610904] ? __secure_computing+0xa9/0x120 Aug 22 14:53:02 juju-e4d256-prod-github-runner-207 kernel: [34156.611594] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 14:53:02 juju-e4d256-prod-github-runner-207 kernel: [34156.612368] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:53:02 juju-e4d256-prod-github-runner-207 kernel: [34156.613092] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:53:02 juju-e4d256-prod-github-runner-207 kernel: [34156.613837] ? do_syscall_64+0x69/0xc0 Aug 22 14:53:02 juju-e4d256-prod-github-runner-207 kernel: [34156.614497] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:53:02 juju-e4d256-prod-github-runner-207 kernel: [34156.615231] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:53:02 juju-e4d256-prod-github-runner-207 kernel: [34156.615930] ? do_syscall_64+0x69/0xc0 Aug 22 14:53:02 juju-e4d256-prod-github-runner-207 kernel: [34156.616572] ? do_syscall_64+0x69/0xc0 Aug 22 14:53:02 juju-e4d256-prod-github-runner-207 kernel: [34156.617199] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 14:53:02 juju-e4d256-prod-github-runner-207 kernel: [34156.617904] RIP: 0033:0x7faa5d0edaff Aug 22 14:53:02 juju-e4d256-prod-github-runner-207 kernel: [34156.618606] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 14:53:02 juju-e4d256-prod-github-runner-207 kernel: [34156.620654] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 14:53:02 juju-e4d256-prod-github-runner-207 kernel: [34156.621578] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 14:53:02 juju-e4d256-prod-github-runner-207 kernel: [34156.622464] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 14:53:02 juju-e4d256-prod-github-runner-207 kernel: [34156.623356] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 14:53:02 juju-e4d256-prod-github-runner-207 kernel: [34156.624286] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 14:53:02 juju-e4d256-prod-github-runner-207 kernel: [34156.625199] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 14:53:02 juju-e4d256-prod-github-runner-207 kernel: [34156.626108] Aug 22 14:53:30 juju-e4d256-prod-github-runner-207 kernel: [34184.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 31728s! [qemu-system-x86:6715] Aug 22 14:53:30 juju-e4d256-prod-github-runner-207 kernel: [34184.543245] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 14:53:30 juju-e4d256-prod-github-runner-207 kernel: [34184.543457] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 14:53:30 juju-e4d256-prod-github-runner-207 kernel: [34184.556245] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 14:53:30 juju-e4d256-prod-github-runner-207 kernel: [34184.557520] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 14:53:30 juju-e4d256-prod-github-runner-207 kernel: [34184.558766] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:53:30 juju-e4d256-prod-github-runner-207 kernel: [34184.559828] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 14:53:30 juju-e4d256-prod-github-runner-207 kernel: [34184.562386] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 14:53:30 juju-e4d256-prod-github-runner-207 kernel: [34184.563464] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 14:53:30 juju-e4d256-prod-github-runner-207 kernel: [34184.564643] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 14:53:30 juju-e4d256-prod-github-runner-207 kernel: [34184.565843] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 14:53:30 juju-e4d256-prod-github-runner-207 kernel: [34184.567020] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 14:53:30 juju-e4d256-prod-github-runner-207 kernel: [34184.568204] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 14:53:30 juju-e4d256-prod-github-runner-207 kernel: [34184.569367] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 14:53:30 juju-e4d256-prod-github-runner-207 kernel: [34184.570605] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 14:53:30 juju-e4d256-prod-github-runner-207 kernel: [34184.571701] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 14:53:30 juju-e4d256-prod-github-runner-207 kernel: [34184.574261] Call Trace: Aug 22 14:53:30 juju-e4d256-prod-github-runner-207 kernel: [34184.575179] Aug 22 14:53:30 juju-e4d256-prod-github-runner-207 kernel: [34184.576092] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:53:30 juju-e4d256-prod-github-runner-207 kernel: [34184.577137] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:53:30 juju-e4d256-prod-github-runner-207 kernel: [34184.578203] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:53:30 juju-e4d256-prod-github-runner-207 kernel: [34184.579319] ? show_regs.part.0+0x23/0x29 Aug 22 14:53:30 juju-e4d256-prod-github-runner-207 kernel: [34184.580349] ? show_regs.cold+0x8/0xd Aug 22 14:53:30 juju-e4d256-prod-github-runner-207 kernel: [34184.581332] ? watchdog_timer_fn+0x1be/0x220 Aug 22 14:53:30 juju-e4d256-prod-github-runner-207 kernel: [34184.582359] ? lockup_detector_update_enable+0x60/0x60 Aug 22 14:53:30 juju-e4d256-prod-github-runner-207 kernel: [34184.583425] ? __hrtimer_run_queues+0x107/0x230 Aug 22 14:53:30 juju-e4d256-prod-github-runner-207 kernel: [34184.584482] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 14:53:30 juju-e4d256-prod-github-runner-207 kernel: [34184.585515] ? hrtimer_interrupt+0x101/0x220 Aug 22 14:53:30 juju-e4d256-prod-github-runner-207 kernel: [34184.586534] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 14:53:30 juju-e4d256-prod-github-runner-207 kernel: [34184.587609] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 14:53:30 juju-e4d256-prod-github-runner-207 kernel: [34184.588868] Aug 22 14:53:30 juju-e4d256-prod-github-runner-207 kernel: [34184.589728] Aug 22 14:53:30 juju-e4d256-prod-github-runner-207 kernel: [34184.590577] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 14:53:30 juju-e4d256-prod-github-runner-207 kernel: [34184.591624] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:53:30 juju-e4d256-prod-github-runner-207 kernel: [34184.592696] ? _raw_spin_lock+0x22/0x30 Aug 22 14:53:30 juju-e4d256-prod-github-runner-207 kernel: [34184.593637] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:53:30 juju-e4d256-prod-github-runner-207 kernel: [34184.594661] direct_page_fault+0x206/0x310 [kvm] Aug 22 14:53:30 juju-e4d256-prod-github-runner-207 kernel: [34184.595683] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 14:53:30 juju-e4d256-prod-github-runner-207 kernel: [34184.596715] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 14:53:30 juju-e4d256-prod-github-runner-207 kernel: [34184.597755] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 14:53:30 juju-e4d256-prod-github-runner-207 kernel: [34184.598786] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 14:53:30 juju-e4d256-prod-github-runner-207 kernel: [34184.599754] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 14:53:30 juju-e4d256-prod-github-runner-207 kernel: [34184.600753] handle_exit+0x98/0x230 [kvm_amd] Aug 22 14:53:30 juju-e4d256-prod-github-runner-207 kernel: [34184.601645] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 14:53:30 juju-e4d256-prod-github-runner-207 kernel: [34184.602559] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 14:53:30 juju-e4d256-prod-github-runner-207 kernel: [34184.603519] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 14:53:30 juju-e4d256-prod-github-runner-207 kernel: [34184.604440] vcpu_run+0x62/0x2c0 [kvm] Aug 22 14:53:30 juju-e4d256-prod-github-runner-207 kernel: [34184.605250] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 14:53:30 juju-e4d256-prod-github-runner-207 kernel: [34184.606063] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 14:53:30 juju-e4d256-prod-github-runner-207 kernel: [34184.606915] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 14:53:30 juju-e4d256-prod-github-runner-207 kernel: [34184.607717] ? __seccomp_filter+0x4a/0x4a0 Aug 22 14:53:30 juju-e4d256-prod-github-runner-207 kernel: [34184.608537] ? __fget_files+0x86/0xc0 Aug 22 14:53:30 juju-e4d256-prod-github-runner-207 kernel: [34184.609249] __x64_sys_ioctl+0x95/0xd0 Aug 22 14:53:30 juju-e4d256-prod-github-runner-207 kernel: [34184.609943] do_syscall_64+0x5c/0xc0 Aug 22 14:53:30 juju-e4d256-prod-github-runner-207 kernel: [34184.610629] ? do_futex+0x162/0x1f0 Aug 22 14:53:30 juju-e4d256-prod-github-runner-207 kernel: [34184.611285] ? __x64_sys_futex+0x78/0x1e0 Aug 22 14:53:30 juju-e4d256-prod-github-runner-207 kernel: [34184.611974] ? __secure_computing+0xa9/0x120 Aug 22 14:53:30 juju-e4d256-prod-github-runner-207 kernel: [34184.612663] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 14:53:30 juju-e4d256-prod-github-runner-207 kernel: [34184.613425] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:53:30 juju-e4d256-prod-github-runner-207 kernel: [34184.614150] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:53:30 juju-e4d256-prod-github-runner-207 kernel: [34184.614871] ? do_syscall_64+0x69/0xc0 Aug 22 14:53:30 juju-e4d256-prod-github-runner-207 kernel: [34184.615517] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:53:30 juju-e4d256-prod-github-runner-207 kernel: [34184.616242] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:53:30 juju-e4d256-prod-github-runner-207 kernel: [34184.616939] ? do_syscall_64+0x69/0xc0 Aug 22 14:53:30 juju-e4d256-prod-github-runner-207 kernel: [34184.617570] ? do_syscall_64+0x69/0xc0 Aug 22 14:53:30 juju-e4d256-prod-github-runner-207 kernel: [34184.618193] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 14:53:30 juju-e4d256-prod-github-runner-207 kernel: [34184.618909] RIP: 0033:0x7faa5d0edaff Aug 22 14:53:30 juju-e4d256-prod-github-runner-207 kernel: [34184.619577] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 14:53:30 juju-e4d256-prod-github-runner-207 kernel: [34184.621589] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 14:53:30 juju-e4d256-prod-github-runner-207 kernel: [34184.622504] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 14:53:30 juju-e4d256-prod-github-runner-207 kernel: [34184.623394] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 14:53:30 juju-e4d256-prod-github-runner-207 kernel: [34184.624317] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 14:53:30 juju-e4d256-prod-github-runner-207 kernel: [34184.625205] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 14:53:30 juju-e4d256-prod-github-runner-207 kernel: [34184.626093] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 14:53:30 juju-e4d256-prod-github-runner-207 kernel: [34184.626991] Aug 22 14:53:45 juju-e4d256-prod-github-runner-207 kernel: [34199.468705] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 14:53:45 juju-e4d256-prod-github-runner-207 kernel: [34199.470221] rcu: 1-....: (8493875 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=4103396 Aug 22 14:53:45 juju-e4d256-prod-github-runner-207 kernel: [34199.471365] (t=8520567 jiffies g=23269 q=36513) Aug 22 14:53:45 juju-e4d256-prod-github-runner-207 kernel: [34199.472181] NMI backtrace for cpu 1 Aug 22 14:53:45 juju-e4d256-prod-github-runner-207 kernel: [34199.473016] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 14:53:45 juju-e4d256-prod-github-runner-207 kernel: [34199.474124] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 14:53:45 juju-e4d256-prod-github-runner-207 kernel: [34199.475182] Call Trace: Aug 22 14:53:45 juju-e4d256-prod-github-runner-207 kernel: [34199.475994] Aug 22 14:53:45 juju-e4d256-prod-github-runner-207 kernel: [34199.476638] show_stack+0x52/0x5c Aug 22 14:53:45 juju-e4d256-prod-github-runner-207 kernel: [34199.477369] dump_stack_lvl+0x4a/0x63 Aug 22 14:53:45 juju-e4d256-prod-github-runner-207 kernel: [34199.478142] dump_stack+0x10/0x16 Aug 22 14:53:45 juju-e4d256-prod-github-runner-207 kernel: [34199.478872] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 14:53:45 juju-e4d256-prod-github-runner-207 kernel: [34199.479658] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 14:53:45 juju-e4d256-prod-github-runner-207 kernel: [34199.480452] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 14:53:45 juju-e4d256-prod-github-runner-207 kernel: [34199.481270] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 14:53:45 juju-e4d256-prod-github-runner-207 kernel: [34199.482249] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 14:53:45 juju-e4d256-prod-github-runner-207 kernel: [34199.483095] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 14:53:45 juju-e4d256-prod-github-runner-207 kernel: [34199.483890] print_cpu_stall.cold+0x2f/0xe2 Aug 22 14:53:45 juju-e4d256-prod-github-runner-207 kernel: [34199.484659] ? timekeeping_update+0xf7/0x150 Aug 22 14:53:45 juju-e4d256-prod-github-runner-207 kernel: [34199.485430] check_cpu_stall+0x109/0x270 Aug 22 14:53:45 juju-e4d256-prod-github-runner-207 kernel: [34199.486175] rcu_sched_clock_irq+0x9a/0x250 Aug 22 14:53:45 juju-e4d256-prod-github-runner-207 kernel: [34199.486936] update_process_times+0x94/0xd0 Aug 22 14:53:45 juju-e4d256-prod-github-runner-207 kernel: [34199.487719] tick_sched_handle+0x29/0x70 Aug 22 14:53:45 juju-e4d256-prod-github-runner-207 kernel: [34199.488488] tick_sched_timer+0x8c/0xc0 Aug 22 14:53:45 juju-e4d256-prod-github-runner-207 kernel: [34199.489230] ? tick_nohz_handler+0xb0/0xb0 Aug 22 14:53:45 juju-e4d256-prod-github-runner-207 kernel: [34199.490030] __hrtimer_run_queues+0x107/0x230 Aug 22 14:53:45 juju-e4d256-prod-github-runner-207 kernel: [34199.490806] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 14:53:45 juju-e4d256-prod-github-runner-207 kernel: [34199.491577] hrtimer_interrupt+0x101/0x220 Aug 22 14:53:45 juju-e4d256-prod-github-runner-207 kernel: [34199.492345] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 14:53:45 juju-e4d256-prod-github-runner-207 kernel: [34199.493195] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 14:53:45 juju-e4d256-prod-github-runner-207 kernel: [34199.494014] Aug 22 14:53:45 juju-e4d256-prod-github-runner-207 kernel: [34199.494651] Aug 22 14:53:45 juju-e4d256-prod-github-runner-207 kernel: [34199.495304] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 14:53:45 juju-e4d256-prod-github-runner-207 kernel: [34199.496143] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:53:45 juju-e4d256-prod-github-runner-207 kernel: [34199.497026] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 14:53:45 juju-e4d256-prod-github-runner-207 kernel: [34199.499221] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 14:53:45 juju-e4d256-prod-github-runner-207 kernel: [34199.500138] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 14:53:45 juju-e4d256-prod-github-runner-207 kernel: [34199.501148] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 14:53:45 juju-e4d256-prod-github-runner-207 kernel: [34199.502118] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 14:53:45 juju-e4d256-prod-github-runner-207 kernel: [34199.503076] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 14:53:45 juju-e4d256-prod-github-runner-207 kernel: [34199.504041] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 14:53:45 juju-e4d256-prod-github-runner-207 kernel: [34199.504990] ? _raw_spin_lock+0x22/0x30 Aug 22 14:53:45 juju-e4d256-prod-github-runner-207 kernel: [34199.505745] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:53:45 juju-e4d256-prod-github-runner-207 kernel: [34199.506580] direct_page_fault+0x206/0x310 [kvm] Aug 22 14:53:45 juju-e4d256-prod-github-runner-207 kernel: [34199.507418] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 14:53:45 juju-e4d256-prod-github-runner-207 kernel: [34199.508266] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 14:53:45 juju-e4d256-prod-github-runner-207 kernel: [34199.509090] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 14:53:45 juju-e4d256-prod-github-runner-207 kernel: [34199.509891] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 14:53:45 juju-e4d256-prod-github-runner-207 kernel: [34199.510682] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 14:53:45 juju-e4d256-prod-github-runner-207 kernel: [34199.511501] handle_exit+0x98/0x230 [kvm_amd] Aug 22 14:53:45 juju-e4d256-prod-github-runner-207 kernel: [34199.512264] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 14:53:45 juju-e4d256-prod-github-runner-207 kernel: [34199.513049] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 14:53:45 juju-e4d256-prod-github-runner-207 kernel: [34199.513897] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 14:53:45 juju-e4d256-prod-github-runner-207 kernel: [34199.514679] vcpu_run+0x62/0x2c0 [kvm] Aug 22 14:53:45 juju-e4d256-prod-github-runner-207 kernel: [34199.515400] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 14:53:45 juju-e4d256-prod-github-runner-207 kernel: [34199.516155] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 14:53:45 juju-e4d256-prod-github-runner-207 kernel: [34199.516956] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 14:53:45 juju-e4d256-prod-github-runner-207 kernel: [34199.517715] ? __seccomp_filter+0x4a/0x4a0 Aug 22 14:53:45 juju-e4d256-prod-github-runner-207 kernel: [34199.518433] ? __fget_files+0x86/0xc0 Aug 22 14:53:45 juju-e4d256-prod-github-runner-207 kernel: [34199.519128] __x64_sys_ioctl+0x95/0xd0 Aug 22 14:53:45 juju-e4d256-prod-github-runner-207 kernel: [34199.519828] do_syscall_64+0x5c/0xc0 Aug 22 14:53:45 juju-e4d256-prod-github-runner-207 kernel: [34199.520507] ? do_futex+0x162/0x1f0 Aug 22 14:53:45 juju-e4d256-prod-github-runner-207 kernel: [34199.521178] ? __x64_sys_futex+0x78/0x1e0 Aug 22 14:53:45 juju-e4d256-prod-github-runner-207 kernel: [34199.521876] ? __secure_computing+0xa9/0x120 Aug 22 14:53:45 juju-e4d256-prod-github-runner-207 kernel: [34199.522590] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 14:53:45 juju-e4d256-prod-github-runner-207 kernel: [34199.523382] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:53:45 juju-e4d256-prod-github-runner-207 kernel: [34199.524143] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:53:45 juju-e4d256-prod-github-runner-207 kernel: [34199.524895] ? do_syscall_64+0x69/0xc0 Aug 22 14:53:45 juju-e4d256-prod-github-runner-207 kernel: [34199.525589] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:53:45 juju-e4d256-prod-github-runner-207 kernel: [34199.526341] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:53:45 juju-e4d256-prod-github-runner-207 kernel: [34199.527102] ? do_syscall_64+0x69/0xc0 Aug 22 14:53:45 juju-e4d256-prod-github-runner-207 kernel: [34199.527810] ? do_syscall_64+0x69/0xc0 Aug 22 14:53:45 juju-e4d256-prod-github-runner-207 kernel: [34199.528498] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 14:53:45 juju-e4d256-prod-github-runner-207 kernel: [34199.529268] RIP: 0033:0x7faa5d0edaff Aug 22 14:53:45 juju-e4d256-prod-github-runner-207 kernel: [34199.529970] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 14:53:45 juju-e4d256-prod-github-runner-207 kernel: [34199.532085] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 14:53:45 juju-e4d256-prod-github-runner-207 kernel: [34199.533043] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 14:53:45 juju-e4d256-prod-github-runner-207 kernel: [34199.533987] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 14:53:45 juju-e4d256-prod-github-runner-207 kernel: [34199.534934] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 14:53:45 juju-e4d256-prod-github-runner-207 kernel: [34199.535892] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 14:53:45 juju-e4d256-prod-github-runner-207 kernel: [34199.536826] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 14:53:45 juju-e4d256-prod-github-runner-207 kernel: [34199.537739] Aug 22 14:54:10 juju-e4d256-prod-github-runner-207 kernel: [34224.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 31766s! [qemu-system-x86:6715] Aug 22 14:54:10 juju-e4d256-prod-github-runner-207 kernel: [34224.543122] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 14:54:10 juju-e4d256-prod-github-runner-207 kernel: [34224.543415] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 14:54:10 juju-e4d256-prod-github-runner-207 kernel: [34224.556805] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 14:54:10 juju-e4d256-prod-github-runner-207 kernel: [34224.558066] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 14:54:10 juju-e4d256-prod-github-runner-207 kernel: [34224.559282] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:54:10 juju-e4d256-prod-github-runner-207 kernel: [34224.560380] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 14:54:10 juju-e4d256-prod-github-runner-207 kernel: [34224.562927] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 14:54:10 juju-e4d256-prod-github-runner-207 kernel: [34224.563985] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 14:54:10 juju-e4d256-prod-github-runner-207 kernel: [34224.565174] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 14:54:10 juju-e4d256-prod-github-runner-207 kernel: [34224.566336] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 14:54:10 juju-e4d256-prod-github-runner-207 kernel: [34224.567519] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 14:54:10 juju-e4d256-prod-github-runner-207 kernel: [34224.568677] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 14:54:10 juju-e4d256-prod-github-runner-207 kernel: [34224.569842] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 14:54:10 juju-e4d256-prod-github-runner-207 kernel: [34224.571090] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 14:54:10 juju-e4d256-prod-github-runner-207 kernel: [34224.572348] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 14:54:10 juju-e4d256-prod-github-runner-207 kernel: [34224.573677] Call Trace: Aug 22 14:54:10 juju-e4d256-prod-github-runner-207 kernel: [34224.574648] Aug 22 14:54:10 juju-e4d256-prod-github-runner-207 kernel: [34224.575581] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:54:10 juju-e4d256-prod-github-runner-207 kernel: [34224.576697] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:54:10 juju-e4d256-prod-github-runner-207 kernel: [34224.577811] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:54:10 juju-e4d256-prod-github-runner-207 kernel: [34224.578979] ? show_regs.part.0+0x23/0x29 Aug 22 14:54:10 juju-e4d256-prod-github-runner-207 kernel: [34224.580073] ? show_regs.cold+0x8/0xd Aug 22 14:54:10 juju-e4d256-prod-github-runner-207 kernel: [34224.581121] ? watchdog_timer_fn+0x1be/0x220 Aug 22 14:54:10 juju-e4d256-prod-github-runner-207 kernel: [34224.582223] ? lockup_detector_update_enable+0x60/0x60 Aug 22 14:54:10 juju-e4d256-prod-github-runner-207 kernel: [34224.583386] ? __hrtimer_run_queues+0x107/0x230 Aug 22 14:54:10 juju-e4d256-prod-github-runner-207 kernel: [34224.584514] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 14:54:10 juju-e4d256-prod-github-runner-207 kernel: [34224.585623] ? hrtimer_interrupt+0x101/0x220 Aug 22 14:54:10 juju-e4d256-prod-github-runner-207 kernel: [34224.586724] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 14:54:10 juju-e4d256-prod-github-runner-207 kernel: [34224.587905] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 14:54:10 juju-e4d256-prod-github-runner-207 kernel: [34224.589050] Aug 22 14:54:10 juju-e4d256-prod-github-runner-207 kernel: [34224.589957] Aug 22 14:54:10 juju-e4d256-prod-github-runner-207 kernel: [34224.590844] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 14:54:10 juju-e4d256-prod-github-runner-207 kernel: [34224.592001] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:54:10 juju-e4d256-prod-github-runner-207 kernel: [34224.593147] ? _raw_spin_lock+0x22/0x30 Aug 22 14:54:10 juju-e4d256-prod-github-runner-207 kernel: [34224.594171] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:54:10 juju-e4d256-prod-github-runner-207 kernel: [34224.595288] direct_page_fault+0x206/0x310 [kvm] Aug 22 14:54:10 juju-e4d256-prod-github-runner-207 kernel: [34224.596428] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 14:54:10 juju-e4d256-prod-github-runner-207 kernel: [34224.597531] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 14:54:10 juju-e4d256-prod-github-runner-207 kernel: [34224.598632] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 14:54:10 juju-e4d256-prod-github-runner-207 kernel: [34224.599773] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 14:54:10 juju-e4d256-prod-github-runner-207 kernel: [34224.600817] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 14:54:10 juju-e4d256-prod-github-runner-207 kernel: [34224.601968] handle_exit+0x98/0x230 [kvm_amd] Aug 22 14:54:10 juju-e4d256-prod-github-runner-207 kernel: [34224.602963] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 14:54:10 juju-e4d256-prod-github-runner-207 kernel: [34224.603990] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 14:54:10 juju-e4d256-prod-github-runner-207 kernel: [34224.605014] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 14:54:10 juju-e4d256-prod-github-runner-207 kernel: [34224.606024] vcpu_run+0x62/0x2c0 [kvm] Aug 22 14:54:10 juju-e4d256-prod-github-runner-207 kernel: [34224.606925] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 14:54:10 juju-e4d256-prod-github-runner-207 kernel: [34224.607846] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 14:54:10 juju-e4d256-prod-github-runner-207 kernel: [34224.608807] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 14:54:10 juju-e4d256-prod-github-runner-207 kernel: [34224.609695] ? __seccomp_filter+0x4a/0x4a0 Aug 22 14:54:10 juju-e4d256-prod-github-runner-207 kernel: [34224.610533] ? __fget_files+0x86/0xc0 Aug 22 14:54:10 juju-e4d256-prod-github-runner-207 kernel: [34224.611326] __x64_sys_ioctl+0x95/0xd0 Aug 22 14:54:10 juju-e4d256-prod-github-runner-207 kernel: [34224.612121] do_syscall_64+0x5c/0xc0 Aug 22 14:54:10 juju-e4d256-prod-github-runner-207 kernel: [34224.612862] ? do_futex+0x162/0x1f0 Aug 22 14:54:10 juju-e4d256-prod-github-runner-207 kernel: [34224.613581] ? __x64_sys_futex+0x78/0x1e0 Aug 22 14:54:10 juju-e4d256-prod-github-runner-207 kernel: [34224.614350] ? __secure_computing+0xa9/0x120 Aug 22 14:54:10 juju-e4d256-prod-github-runner-207 kernel: [34224.615126] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 14:54:10 juju-e4d256-prod-github-runner-207 kernel: [34224.616008] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:54:10 juju-e4d256-prod-github-runner-207 kernel: [34224.616824] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:54:10 juju-e4d256-prod-github-runner-207 kernel: [34224.617635] ? do_syscall_64+0x69/0xc0 Aug 22 14:54:10 juju-e4d256-prod-github-runner-207 kernel: [34224.618355] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:54:10 juju-e4d256-prod-github-runner-207 kernel: [34224.619150] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:54:10 juju-e4d256-prod-github-runner-207 kernel: [34224.619951] ? do_syscall_64+0x69/0xc0 Aug 22 14:54:10 juju-e4d256-prod-github-runner-207 kernel: [34224.620649] ? do_syscall_64+0x69/0xc0 Aug 22 14:54:10 juju-e4d256-prod-github-runner-207 kernel: [34224.621345] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 14:54:10 juju-e4d256-prod-github-runner-207 kernel: [34224.622150] RIP: 0033:0x7faa5d0edaff Aug 22 14:54:10 juju-e4d256-prod-github-runner-207 kernel: [34224.622849] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 14:54:10 juju-e4d256-prod-github-runner-207 kernel: [34224.625177] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 14:54:10 juju-e4d256-prod-github-runner-207 kernel: [34224.626234] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 14:54:10 juju-e4d256-prod-github-runner-207 kernel: [34224.627260] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 14:54:10 juju-e4d256-prod-github-runner-207 kernel: [34224.628299] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 14:54:10 juju-e4d256-prod-github-runner-207 kernel: [34224.629331] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 14:54:10 juju-e4d256-prod-github-runner-207 kernel: [34224.630456] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 14:54:10 juju-e4d256-prod-github-runner-207 kernel: [34224.631505] Aug 22 14:54:38 juju-e4d256-prod-github-runner-207 kernel: [34252.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 31792s! [qemu-system-x86:6715] Aug 22 14:54:38 juju-e4d256-prod-github-runner-207 kernel: [34252.543224] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 14:54:38 juju-e4d256-prod-github-runner-207 kernel: [34252.543393] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 14:54:38 juju-e4d256-prod-github-runner-207 kernel: [34252.555602] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 14:54:38 juju-e4d256-prod-github-runner-207 kernel: [34252.556874] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 14:54:38 juju-e4d256-prod-github-runner-207 kernel: [34252.558090] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:54:38 juju-e4d256-prod-github-runner-207 kernel: [34252.559145] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 14:54:38 juju-e4d256-prod-github-runner-207 kernel: [34252.561726] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 14:54:38 juju-e4d256-prod-github-runner-207 kernel: [34252.562780] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 14:54:38 juju-e4d256-prod-github-runner-207 kernel: [34252.563964] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 14:54:38 juju-e4d256-prod-github-runner-207 kernel: [34252.565130] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 14:54:38 juju-e4d256-prod-github-runner-207 kernel: [34252.566293] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 14:54:38 juju-e4d256-prod-github-runner-207 kernel: [34252.567481] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 14:54:38 juju-e4d256-prod-github-runner-207 kernel: [34252.568652] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 14:54:38 juju-e4d256-prod-github-runner-207 kernel: [34252.569892] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 14:54:38 juju-e4d256-prod-github-runner-207 kernel: [34252.570994] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 14:54:38 juju-e4d256-prod-github-runner-207 kernel: [34252.572242] Call Trace: Aug 22 14:54:38 juju-e4d256-prod-github-runner-207 kernel: [34252.573163] Aug 22 14:54:38 juju-e4d256-prod-github-runner-207 kernel: [34252.574047] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:54:38 juju-e4d256-prod-github-runner-207 kernel: [34252.575077] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:54:38 juju-e4d256-prod-github-runner-207 kernel: [34252.576109] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:54:38 juju-e4d256-prod-github-runner-207 kernel: [34252.577214] ? show_regs.part.0+0x23/0x29 Aug 22 14:54:38 juju-e4d256-prod-github-runner-207 kernel: [34252.578254] ? show_regs.cold+0x8/0xd Aug 22 14:54:38 juju-e4d256-prod-github-runner-207 kernel: [34252.579263] ? watchdog_timer_fn+0x1be/0x220 Aug 22 14:54:38 juju-e4d256-prod-github-runner-207 kernel: [34252.580273] ? lockup_detector_update_enable+0x60/0x60 Aug 22 14:54:38 juju-e4d256-prod-github-runner-207 kernel: [34252.581341] ? __hrtimer_run_queues+0x107/0x230 Aug 22 14:54:38 juju-e4d256-prod-github-runner-207 kernel: [34252.582409] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 14:54:38 juju-e4d256-prod-github-runner-207 kernel: [34252.583459] ? hrtimer_interrupt+0x101/0x220 Aug 22 14:54:38 juju-e4d256-prod-github-runner-207 kernel: [34252.584475] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 14:54:38 juju-e4d256-prod-github-runner-207 kernel: [34252.585543] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 14:54:38 juju-e4d256-prod-github-runner-207 kernel: [34252.586596] Aug 22 14:54:38 juju-e4d256-prod-github-runner-207 kernel: [34252.587459] Aug 22 14:54:38 juju-e4d256-prod-github-runner-207 kernel: [34252.588301] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 14:54:38 juju-e4d256-prod-github-runner-207 kernel: [34252.589337] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:54:38 juju-e4d256-prod-github-runner-207 kernel: [34252.590375] ? _raw_spin_lock+0x22/0x30 Aug 22 14:54:38 juju-e4d256-prod-github-runner-207 kernel: [34252.591327] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:54:38 juju-e4d256-prod-github-runner-207 kernel: [34252.592373] direct_page_fault+0x206/0x310 [kvm] Aug 22 14:54:38 juju-e4d256-prod-github-runner-207 kernel: [34252.593405] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 14:54:38 juju-e4d256-prod-github-runner-207 kernel: [34252.594412] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 14:54:38 juju-e4d256-prod-github-runner-207 kernel: [34252.595423] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 14:54:38 juju-e4d256-prod-github-runner-207 kernel: [34252.596419] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 14:54:38 juju-e4d256-prod-github-runner-207 kernel: [34252.597366] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 14:54:38 juju-e4d256-prod-github-runner-207 kernel: [34252.598342] handle_exit+0x98/0x230 [kvm_amd] Aug 22 14:54:38 juju-e4d256-prod-github-runner-207 kernel: [34252.599242] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 14:54:38 juju-e4d256-prod-github-runner-207 kernel: [34252.600154] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 14:54:38 juju-e4d256-prod-github-runner-207 kernel: [34252.601076] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 14:54:38 juju-e4d256-prod-github-runner-207 kernel: [34252.601984] vcpu_run+0x62/0x2c0 [kvm] Aug 22 14:54:38 juju-e4d256-prod-github-runner-207 kernel: [34252.602814] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 14:54:38 juju-e4d256-prod-github-runner-207 kernel: [34252.603633] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 14:54:38 juju-e4d256-prod-github-runner-207 kernel: [34252.604487] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 14:54:38 juju-e4d256-prod-github-runner-207 kernel: [34252.605290] ? __seccomp_filter+0x4a/0x4a0 Aug 22 14:54:38 juju-e4d256-prod-github-runner-207 kernel: [34252.606032] ? __fget_files+0x86/0xc0 Aug 22 14:54:38 juju-e4d256-prod-github-runner-207 kernel: [34252.606735] __x64_sys_ioctl+0x95/0xd0 Aug 22 14:54:38 juju-e4d256-prod-github-runner-207 kernel: [34252.607446] do_syscall_64+0x5c/0xc0 Aug 22 14:54:38 juju-e4d256-prod-github-runner-207 kernel: [34252.608158] ? do_futex+0x162/0x1f0 Aug 22 14:54:38 juju-e4d256-prod-github-runner-207 kernel: [34252.608818] ? __x64_sys_futex+0x78/0x1e0 Aug 22 14:54:38 juju-e4d256-prod-github-runner-207 kernel: [34252.609492] ? __secure_computing+0xa9/0x120 Aug 22 14:54:38 juju-e4d256-prod-github-runner-207 kernel: [34252.610182] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 14:54:38 juju-e4d256-prod-github-runner-207 kernel: [34252.611125] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:54:38 juju-e4d256-prod-github-runner-207 kernel: [34252.611863] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:54:38 juju-e4d256-prod-github-runner-207 kernel: [34252.612666] ? do_syscall_64+0x69/0xc0 Aug 22 14:54:38 juju-e4d256-prod-github-runner-207 kernel: [34252.613336] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:54:38 juju-e4d256-prod-github-runner-207 kernel: [34252.614044] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:54:38 juju-e4d256-prod-github-runner-207 kernel: [34252.614739] ? do_syscall_64+0x69/0xc0 Aug 22 14:54:38 juju-e4d256-prod-github-runner-207 kernel: [34252.615387] ? do_syscall_64+0x69/0xc0 Aug 22 14:54:38 juju-e4d256-prod-github-runner-207 kernel: [34252.616010] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 14:54:38 juju-e4d256-prod-github-runner-207 kernel: [34252.616713] RIP: 0033:0x7faa5d0edaff Aug 22 14:54:38 juju-e4d256-prod-github-runner-207 kernel: [34252.617345] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 14:54:38 juju-e4d256-prod-github-runner-207 kernel: [34252.619338] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 14:54:38 juju-e4d256-prod-github-runner-207 kernel: [34252.620251] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 14:54:38 juju-e4d256-prod-github-runner-207 kernel: [34252.621140] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 14:54:38 juju-e4d256-prod-github-runner-207 kernel: [34252.622027] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 14:54:38 juju-e4d256-prod-github-runner-207 kernel: [34252.622915] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 14:54:38 juju-e4d256-prod-github-runner-207 kernel: [34252.623834] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 14:54:38 juju-e4d256-prod-github-runner-207 kernel: [34252.624725] Aug 22 14:55:06 juju-e4d256-prod-github-runner-207 kernel: [34280.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 31818s! [qemu-system-x86:6715] Aug 22 14:55:06 juju-e4d256-prod-github-runner-207 kernel: [34280.543836] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 14:55:06 juju-e4d256-prod-github-runner-207 kernel: [34280.544085] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 14:55:06 juju-e4d256-prod-github-runner-207 kernel: [34280.556255] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 14:55:06 juju-e4d256-prod-github-runner-207 kernel: [34280.557530] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 14:55:06 juju-e4d256-prod-github-runner-207 kernel: [34280.558794] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:55:06 juju-e4d256-prod-github-runner-207 kernel: [34280.559871] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 14:55:06 juju-e4d256-prod-github-runner-207 kernel: [34280.562443] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 14:55:06 juju-e4d256-prod-github-runner-207 kernel: [34280.563506] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 14:55:06 juju-e4d256-prod-github-runner-207 kernel: [34280.564675] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 14:55:06 juju-e4d256-prod-github-runner-207 kernel: [34280.565852] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 14:55:06 juju-e4d256-prod-github-runner-207 kernel: [34280.567050] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 14:55:06 juju-e4d256-prod-github-runner-207 kernel: [34280.568221] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 14:55:06 juju-e4d256-prod-github-runner-207 kernel: [34280.569388] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 14:55:06 juju-e4d256-prod-github-runner-207 kernel: [34280.570632] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 14:55:06 juju-e4d256-prod-github-runner-207 kernel: [34280.571773] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 14:55:06 juju-e4d256-prod-github-runner-207 kernel: [34280.572975] Call Trace: Aug 22 14:55:06 juju-e4d256-prod-github-runner-207 kernel: [34280.573889] Aug 22 14:55:06 juju-e4d256-prod-github-runner-207 kernel: [34280.574796] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:55:06 juju-e4d256-prod-github-runner-207 kernel: [34280.575863] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:55:06 juju-e4d256-prod-github-runner-207 kernel: [34280.576901] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:55:06 juju-e4d256-prod-github-runner-207 kernel: [34280.578015] ? show_regs.part.0+0x23/0x29 Aug 22 14:55:06 juju-e4d256-prod-github-runner-207 kernel: [34280.579121] ? show_regs.cold+0x8/0xd Aug 22 14:55:06 juju-e4d256-prod-github-runner-207 kernel: [34280.580103] ? watchdog_timer_fn+0x1be/0x220 Aug 22 14:55:06 juju-e4d256-prod-github-runner-207 kernel: [34280.581209] ? lockup_detector_update_enable+0x60/0x60 Aug 22 14:55:06 juju-e4d256-prod-github-runner-207 kernel: [34280.582363] ? __hrtimer_run_queues+0x107/0x230 Aug 22 14:55:06 juju-e4d256-prod-github-runner-207 kernel: [34280.583450] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 14:55:06 juju-e4d256-prod-github-runner-207 kernel: [34280.584500] ? hrtimer_interrupt+0x101/0x220 Aug 22 14:55:06 juju-e4d256-prod-github-runner-207 kernel: [34280.585524] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 14:55:06 juju-e4d256-prod-github-runner-207 kernel: [34280.586607] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 14:55:06 juju-e4d256-prod-github-runner-207 kernel: [34280.587714] Aug 22 14:55:06 juju-e4d256-prod-github-runner-207 kernel: [34280.588607] Aug 22 14:55:06 juju-e4d256-prod-github-runner-207 kernel: [34280.589450] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 14:55:06 juju-e4d256-prod-github-runner-207 kernel: [34280.590536] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:55:06 juju-e4d256-prod-github-runner-207 kernel: [34280.591667] ? _raw_spin_lock+0x22/0x30 Aug 22 14:55:06 juju-e4d256-prod-github-runner-207 kernel: [34280.592634] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:55:06 juju-e4d256-prod-github-runner-207 kernel: [34280.593669] direct_page_fault+0x206/0x310 [kvm] Aug 22 14:55:06 juju-e4d256-prod-github-runner-207 kernel: [34280.594758] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 14:55:06 juju-e4d256-prod-github-runner-207 kernel: [34280.595807] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 14:55:06 juju-e4d256-prod-github-runner-207 kernel: [34280.596834] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 14:55:06 juju-e4d256-prod-github-runner-207 kernel: [34280.597867] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 14:55:06 juju-e4d256-prod-github-runner-207 kernel: [34280.598870] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 14:55:06 juju-e4d256-prod-github-runner-207 kernel: [34280.599853] handle_exit+0x98/0x230 [kvm_amd] Aug 22 14:55:06 juju-e4d256-prod-github-runner-207 kernel: [34280.600750] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 14:55:06 juju-e4d256-prod-github-runner-207 kernel: [34280.601818] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 14:55:06 juju-e4d256-prod-github-runner-207 kernel: [34280.602766] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 14:55:06 juju-e4d256-prod-github-runner-207 kernel: [34280.603694] vcpu_run+0x62/0x2c0 [kvm] Aug 22 14:55:06 juju-e4d256-prod-github-runner-207 kernel: [34280.604509] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 14:55:06 juju-e4d256-prod-github-runner-207 kernel: [34280.605340] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 14:55:06 juju-e4d256-prod-github-runner-207 kernel: [34280.606211] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 14:55:06 juju-e4d256-prod-github-runner-207 kernel: [34280.607038] ? __seccomp_filter+0x4a/0x4a0 Aug 22 14:55:06 juju-e4d256-prod-github-runner-207 kernel: [34280.607806] ? __fget_files+0x86/0xc0 Aug 22 14:55:06 juju-e4d256-prod-github-runner-207 kernel: [34280.608515] __x64_sys_ioctl+0x95/0xd0 Aug 22 14:55:06 juju-e4d256-prod-github-runner-207 kernel: [34280.609218] do_syscall_64+0x5c/0xc0 Aug 22 14:55:06 juju-e4d256-prod-github-runner-207 kernel: [34280.609884] ? do_futex+0x162/0x1f0 Aug 22 14:55:06 juju-e4d256-prod-github-runner-207 kernel: [34280.610540] ? __x64_sys_futex+0x78/0x1e0 Aug 22 14:55:06 juju-e4d256-prod-github-runner-207 kernel: [34280.611244] ? __secure_computing+0xa9/0x120 Aug 22 14:55:06 juju-e4d256-prod-github-runner-207 kernel: [34280.611957] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 14:55:06 juju-e4d256-prod-github-runner-207 kernel: [34280.612726] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:55:06 juju-e4d256-prod-github-runner-207 kernel: [34280.613461] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:55:06 juju-e4d256-prod-github-runner-207 kernel: [34280.614181] ? do_syscall_64+0x69/0xc0 Aug 22 14:55:06 juju-e4d256-prod-github-runner-207 kernel: [34280.614827] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:55:06 juju-e4d256-prod-github-runner-207 kernel: [34280.615555] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:55:06 juju-e4d256-prod-github-runner-207 kernel: [34280.616406] ? do_syscall_64+0x69/0xc0 Aug 22 14:55:06 juju-e4d256-prod-github-runner-207 kernel: [34280.617051] ? do_syscall_64+0x69/0xc0 Aug 22 14:55:06 juju-e4d256-prod-github-runner-207 kernel: [34280.617796] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 14:55:06 juju-e4d256-prod-github-runner-207 kernel: [34280.618571] RIP: 0033:0x7faa5d0edaff Aug 22 14:55:06 juju-e4d256-prod-github-runner-207 kernel: [34280.619264] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 14:55:06 juju-e4d256-prod-github-runner-207 kernel: [34280.621266] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 14:55:06 juju-e4d256-prod-github-runner-207 kernel: [34280.622195] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 14:55:06 juju-e4d256-prod-github-runner-207 kernel: [34280.623107] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 14:55:06 juju-e4d256-prod-github-runner-207 kernel: [34280.624011] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 14:55:06 juju-e4d256-prod-github-runner-207 kernel: [34280.624910] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 14:55:06 juju-e4d256-prod-github-runner-207 kernel: [34280.625801] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 14:55:06 juju-e4d256-prod-github-runner-207 kernel: [34280.626696] Aug 22 14:55:34 juju-e4d256-prod-github-runner-207 kernel: [34308.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 31844s! [qemu-system-x86:6715] Aug 22 14:55:34 juju-e4d256-prod-github-runner-207 kernel: [34308.543280] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 14:55:34 juju-e4d256-prod-github-runner-207 kernel: [34308.543353] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 14:55:34 juju-e4d256-prod-github-runner-207 kernel: [34308.557335] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 14:55:34 juju-e4d256-prod-github-runner-207 kernel: [34308.558812] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 14:55:34 juju-e4d256-prod-github-runner-207 kernel: [34308.560209] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:55:34 juju-e4d256-prod-github-runner-207 kernel: [34308.561387] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 14:55:34 juju-e4d256-prod-github-runner-207 kernel: [34308.564296] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 14:55:34 juju-e4d256-prod-github-runner-207 kernel: [34308.565443] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 14:55:34 juju-e4d256-prod-github-runner-207 kernel: [34308.566762] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 14:55:34 juju-e4d256-prod-github-runner-207 kernel: [34308.568055] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 14:55:34 juju-e4d256-prod-github-runner-207 kernel: [34308.569351] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 14:55:34 juju-e4d256-prod-github-runner-207 kernel: [34308.570667] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 14:55:34 juju-e4d256-prod-github-runner-207 kernel: [34308.571970] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 14:55:34 juju-e4d256-prod-github-runner-207 kernel: [34308.573358] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 14:55:34 juju-e4d256-prod-github-runner-207 kernel: [34308.574579] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 14:55:34 juju-e4d256-prod-github-runner-207 kernel: [34308.575902] Call Trace: Aug 22 14:55:34 juju-e4d256-prod-github-runner-207 kernel: [34308.576865] Aug 22 14:55:34 juju-e4d256-prod-github-runner-207 kernel: [34308.577788] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:55:34 juju-e4d256-prod-github-runner-207 kernel: [34308.578917] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:55:34 juju-e4d256-prod-github-runner-207 kernel: [34308.580027] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:55:34 juju-e4d256-prod-github-runner-207 kernel: [34308.581195] ? show_regs.part.0+0x23/0x29 Aug 22 14:55:34 juju-e4d256-prod-github-runner-207 kernel: [34308.582273] ? show_regs.cold+0x8/0xd Aug 22 14:55:34 juju-e4d256-prod-github-runner-207 kernel: [34308.583328] ? watchdog_timer_fn+0x1be/0x220 Aug 22 14:55:34 juju-e4d256-prod-github-runner-207 kernel: [34308.584428] ? lockup_detector_update_enable+0x60/0x60 Aug 22 14:55:34 juju-e4d256-prod-github-runner-207 kernel: [34308.585591] ? __hrtimer_run_queues+0x107/0x230 Aug 22 14:55:34 juju-e4d256-prod-github-runner-207 kernel: [34308.586722] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 14:55:34 juju-e4d256-prod-github-runner-207 kernel: [34308.587833] ? hrtimer_interrupt+0x101/0x220 Aug 22 14:55:34 juju-e4d256-prod-github-runner-207 kernel: [34308.588933] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 14:55:34 juju-e4d256-prod-github-runner-207 kernel: [34308.590119] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 14:55:34 juju-e4d256-prod-github-runner-207 kernel: [34308.591286] Aug 22 14:55:34 juju-e4d256-prod-github-runner-207 kernel: [34308.592189] Aug 22 14:55:34 juju-e4d256-prod-github-runner-207 kernel: [34308.593084] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 14:55:34 juju-e4d256-prod-github-runner-207 kernel: [34308.594232] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:55:34 juju-e4d256-prod-github-runner-207 kernel: [34308.595400] ? _raw_spin_lock+0x22/0x30 Aug 22 14:55:34 juju-e4d256-prod-github-runner-207 kernel: [34308.596439] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:55:34 juju-e4d256-prod-github-runner-207 kernel: [34308.597558] direct_page_fault+0x206/0x310 [kvm] Aug 22 14:55:34 juju-e4d256-prod-github-runner-207 kernel: [34308.598688] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 14:55:34 juju-e4d256-prod-github-runner-207 kernel: [34308.599787] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 14:55:34 juju-e4d256-prod-github-runner-207 kernel: [34308.600904] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 14:55:34 juju-e4d256-prod-github-runner-207 kernel: [34308.601906] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 14:55:34 juju-e4d256-prod-github-runner-207 kernel: [34308.602886] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 14:55:34 juju-e4d256-prod-github-runner-207 kernel: [34308.603882] handle_exit+0x98/0x230 [kvm_amd] Aug 22 14:55:34 juju-e4d256-prod-github-runner-207 kernel: [34308.604864] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 14:55:34 juju-e4d256-prod-github-runner-207 kernel: [34308.605873] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 14:55:34 juju-e4d256-prod-github-runner-207 kernel: [34308.606937] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 14:55:34 juju-e4d256-prod-github-runner-207 kernel: [34308.607959] vcpu_run+0x62/0x2c0 [kvm] Aug 22 14:55:34 juju-e4d256-prod-github-runner-207 kernel: [34308.608847] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 14:55:34 juju-e4d256-prod-github-runner-207 kernel: [34308.609744] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 14:55:34 juju-e4d256-prod-github-runner-207 kernel: [34308.610846] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 14:55:34 juju-e4d256-prod-github-runner-207 kernel: [34308.611729] ? __seccomp_filter+0x4a/0x4a0 Aug 22 14:55:34 juju-e4d256-prod-github-runner-207 kernel: [34308.612556] ? __fget_files+0x86/0xc0 Aug 22 14:55:34 juju-e4d256-prod-github-runner-207 kernel: [34308.613450] __x64_sys_ioctl+0x95/0xd0 Aug 22 14:55:34 juju-e4d256-prod-github-runner-207 kernel: [34308.614207] do_syscall_64+0x5c/0xc0 Aug 22 14:55:34 juju-e4d256-prod-github-runner-207 kernel: [34308.614954] ? do_futex+0x162/0x1f0 Aug 22 14:55:34 juju-e4d256-prod-github-runner-207 kernel: [34308.615673] ? __x64_sys_futex+0x78/0x1e0 Aug 22 14:55:34 juju-e4d256-prod-github-runner-207 kernel: [34308.616424] ? __secure_computing+0xa9/0x120 Aug 22 14:55:34 juju-e4d256-prod-github-runner-207 kernel: [34308.617197] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 14:55:34 juju-e4d256-prod-github-runner-207 kernel: [34308.618057] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:55:34 juju-e4d256-prod-github-runner-207 kernel: [34308.618879] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:55:34 juju-e4d256-prod-github-runner-207 kernel: [34308.619696] ? do_syscall_64+0x69/0xc0 Aug 22 14:55:34 juju-e4d256-prod-github-runner-207 kernel: [34308.620417] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:55:34 juju-e4d256-prod-github-runner-207 kernel: [34308.621210] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:55:34 juju-e4d256-prod-github-runner-207 kernel: [34308.621995] ? do_syscall_64+0x69/0xc0 Aug 22 14:55:34 juju-e4d256-prod-github-runner-207 kernel: [34308.622716] ? do_syscall_64+0x69/0xc0 Aug 22 14:55:34 juju-e4d256-prod-github-runner-207 kernel: [34308.623415] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 14:55:34 juju-e4d256-prod-github-runner-207 kernel: [34308.624216] RIP: 0033:0x7faa5d0edaff Aug 22 14:55:34 juju-e4d256-prod-github-runner-207 kernel: [34308.624913] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 14:55:34 juju-e4d256-prod-github-runner-207 kernel: [34308.627239] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 14:55:34 juju-e4d256-prod-github-runner-207 kernel: [34308.628290] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 14:55:34 juju-e4d256-prod-github-runner-207 kernel: [34308.629321] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 14:55:34 juju-e4d256-prod-github-runner-207 kernel: [34308.630342] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 14:55:34 juju-e4d256-prod-github-runner-207 kernel: [34308.631377] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 14:55:34 juju-e4d256-prod-github-runner-207 kernel: [34308.632397] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 14:55:34 juju-e4d256-prod-github-runner-207 kernel: [34308.633428] Aug 22 14:56:02 juju-e4d256-prod-github-runner-207 kernel: [34336.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 31870s! [qemu-system-x86:6715] Aug 22 14:56:02 juju-e4d256-prod-github-runner-207 kernel: [34336.543896] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 14:56:02 juju-e4d256-prod-github-runner-207 kernel: [34336.544213] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 14:56:02 juju-e4d256-prod-github-runner-207 kernel: [34336.556696] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 14:56:02 juju-e4d256-prod-github-runner-207 kernel: [34336.557965] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 14:56:02 juju-e4d256-prod-github-runner-207 kernel: [34336.559197] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:56:02 juju-e4d256-prod-github-runner-207 kernel: [34336.560261] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 14:56:02 juju-e4d256-prod-github-runner-207 kernel: [34336.562821] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 14:56:02 juju-e4d256-prod-github-runner-207 kernel: [34336.563915] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 14:56:02 juju-e4d256-prod-github-runner-207 kernel: [34336.565107] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 14:56:02 juju-e4d256-prod-github-runner-207 kernel: [34336.566303] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 14:56:02 juju-e4d256-prod-github-runner-207 kernel: [34336.567492] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 14:56:02 juju-e4d256-prod-github-runner-207 kernel: [34336.568719] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 14:56:02 juju-e4d256-prod-github-runner-207 kernel: [34336.569889] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 14:56:02 juju-e4d256-prod-github-runner-207 kernel: [34336.571142] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 14:56:02 juju-e4d256-prod-github-runner-207 kernel: [34336.572243] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 14:56:02 juju-e4d256-prod-github-runner-207 kernel: [34336.573435] Call Trace: Aug 22 14:56:02 juju-e4d256-prod-github-runner-207 kernel: [34336.574375] Aug 22 14:56:02 juju-e4d256-prod-github-runner-207 kernel: [34336.575279] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:56:02 juju-e4d256-prod-github-runner-207 kernel: [34336.576358] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:56:02 juju-e4d256-prod-github-runner-207 kernel: [34336.577408] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:56:02 juju-e4d256-prod-github-runner-207 kernel: [34336.578526] ? show_regs.part.0+0x23/0x29 Aug 22 14:56:02 juju-e4d256-prod-github-runner-207 kernel: [34336.579535] ? show_regs.cold+0x8/0xd Aug 22 14:56:02 juju-e4d256-prod-github-runner-207 kernel: [34336.580522] ? watchdog_timer_fn+0x1be/0x220 Aug 22 14:56:02 juju-e4d256-prod-github-runner-207 kernel: [34336.581538] ? lockup_detector_update_enable+0x60/0x60 Aug 22 14:56:02 juju-e4d256-prod-github-runner-207 kernel: [34336.582627] ? __hrtimer_run_queues+0x107/0x230 Aug 22 14:56:02 juju-e4d256-prod-github-runner-207 kernel: [34336.583663] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 14:56:02 juju-e4d256-prod-github-runner-207 kernel: [34336.584703] ? hrtimer_interrupt+0x101/0x220 Aug 22 14:56:02 juju-e4d256-prod-github-runner-207 kernel: [34336.585720] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 14:56:02 juju-e4d256-prod-github-runner-207 kernel: [34336.586803] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 14:56:02 juju-e4d256-prod-github-runner-207 kernel: [34336.587877] Aug 22 14:56:02 juju-e4d256-prod-github-runner-207 kernel: [34336.588755] Aug 22 14:56:02 juju-e4d256-prod-github-runner-207 kernel: [34336.589613] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 14:56:02 juju-e4d256-prod-github-runner-207 kernel: [34336.590725] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:56:02 juju-e4d256-prod-github-runner-207 kernel: [34336.591774] ? _raw_spin_lock+0x22/0x30 Aug 22 14:56:02 juju-e4d256-prod-github-runner-207 kernel: [34336.592720] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:56:02 juju-e4d256-prod-github-runner-207 kernel: [34336.593778] direct_page_fault+0x206/0x310 [kvm] Aug 22 14:56:02 juju-e4d256-prod-github-runner-207 kernel: [34336.594821] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 14:56:02 juju-e4d256-prod-github-runner-207 kernel: [34336.595835] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 14:56:02 juju-e4d256-prod-github-runner-207 kernel: [34336.596843] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 14:56:02 juju-e4d256-prod-github-runner-207 kernel: [34336.597893] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 14:56:02 juju-e4d256-prod-github-runner-207 kernel: [34336.598854] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 14:56:02 juju-e4d256-prod-github-runner-207 kernel: [34336.599835] handle_exit+0x98/0x230 [kvm_amd] Aug 22 14:56:02 juju-e4d256-prod-github-runner-207 kernel: [34336.600788] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 14:56:02 juju-e4d256-prod-github-runner-207 kernel: [34336.601719] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 14:56:02 juju-e4d256-prod-github-runner-207 kernel: [34336.602712] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 14:56:02 juju-e4d256-prod-github-runner-207 kernel: [34336.603633] vcpu_run+0x62/0x2c0 [kvm] Aug 22 14:56:02 juju-e4d256-prod-github-runner-207 kernel: [34336.604454] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 14:56:02 juju-e4d256-prod-github-runner-207 kernel: [34336.605266] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 14:56:02 juju-e4d256-prod-github-runner-207 kernel: [34336.606124] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 14:56:02 juju-e4d256-prod-github-runner-207 kernel: [34336.606954] ? __seccomp_filter+0x4a/0x4a0 Aug 22 14:56:02 juju-e4d256-prod-github-runner-207 kernel: [34336.607820] ? __fget_files+0x86/0xc0 Aug 22 14:56:02 juju-e4d256-prod-github-runner-207 kernel: [34336.608522] __x64_sys_ioctl+0x95/0xd0 Aug 22 14:56:02 juju-e4d256-prod-github-runner-207 kernel: [34336.609227] do_syscall_64+0x5c/0xc0 Aug 22 14:56:02 juju-e4d256-prod-github-runner-207 kernel: [34336.609901] ? do_futex+0x162/0x1f0 Aug 22 14:56:02 juju-e4d256-prod-github-runner-207 kernel: [34336.610584] ? __x64_sys_futex+0x78/0x1e0 Aug 22 14:56:02 juju-e4d256-prod-github-runner-207 kernel: [34336.611258] ? __secure_computing+0xa9/0x120 Aug 22 14:56:02 juju-e4d256-prod-github-runner-207 kernel: [34336.611946] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 14:56:02 juju-e4d256-prod-github-runner-207 kernel: [34336.612704] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:56:02 juju-e4d256-prod-github-runner-207 kernel: [34336.613454] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:56:02 juju-e4d256-prod-github-runner-207 kernel: [34336.614174] ? do_syscall_64+0x69/0xc0 Aug 22 14:56:02 juju-e4d256-prod-github-runner-207 kernel: [34336.614841] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:56:02 juju-e4d256-prod-github-runner-207 kernel: [34336.615543] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:56:02 juju-e4d256-prod-github-runner-207 kernel: [34336.616238] ? do_syscall_64+0x69/0xc0 Aug 22 14:56:02 juju-e4d256-prod-github-runner-207 kernel: [34336.616860] ? do_syscall_64+0x69/0xc0 Aug 22 14:56:02 juju-e4d256-prod-github-runner-207 kernel: [34336.617674] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 14:56:02 juju-e4d256-prod-github-runner-207 kernel: [34336.618392] RIP: 0033:0x7faa5d0edaff Aug 22 14:56:02 juju-e4d256-prod-github-runner-207 kernel: [34336.619054] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 14:56:02 juju-e4d256-prod-github-runner-207 kernel: [34336.621127] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 14:56:02 juju-e4d256-prod-github-runner-207 kernel: [34336.622041] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 14:56:02 juju-e4d256-prod-github-runner-207 kernel: [34336.622948] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 14:56:02 juju-e4d256-prod-github-runner-207 kernel: [34336.623838] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 14:56:02 juju-e4d256-prod-github-runner-207 kernel: [34336.624729] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 14:56:02 juju-e4d256-prod-github-runner-207 kernel: [34336.625634] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 14:56:02 juju-e4d256-prod-github-runner-207 kernel: [34336.626597] Aug 22 14:56:30 juju-e4d256-prod-github-runner-207 kernel: [34364.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 31896s! [qemu-system-x86:6715] Aug 22 14:56:30 juju-e4d256-prod-github-runner-207 kernel: [34364.543095] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 14:56:30 juju-e4d256-prod-github-runner-207 kernel: [34364.543166] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 14:56:30 juju-e4d256-prod-github-runner-207 kernel: [34364.555256] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 14:56:30 juju-e4d256-prod-github-runner-207 kernel: [34364.556542] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 14:56:30 juju-e4d256-prod-github-runner-207 kernel: [34364.557776] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:56:30 juju-e4d256-prod-github-runner-207 kernel: [34364.558845] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 14:56:30 juju-e4d256-prod-github-runner-207 kernel: [34364.561446] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 14:56:30 juju-e4d256-prod-github-runner-207 kernel: [34364.562518] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 14:56:30 juju-e4d256-prod-github-runner-207 kernel: [34364.563681] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 14:56:30 juju-e4d256-prod-github-runner-207 kernel: [34364.564840] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 14:56:30 juju-e4d256-prod-github-runner-207 kernel: [34364.566024] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 14:56:30 juju-e4d256-prod-github-runner-207 kernel: [34364.567229] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 14:56:30 juju-e4d256-prod-github-runner-207 kernel: [34364.568397] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 14:56:30 juju-e4d256-prod-github-runner-207 kernel: [34364.569630] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 14:56:30 juju-e4d256-prod-github-runner-207 kernel: [34364.570759] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 14:56:30 juju-e4d256-prod-github-runner-207 kernel: [34364.571971] Call Trace: Aug 22 14:56:30 juju-e4d256-prod-github-runner-207 kernel: [34364.572906] Aug 22 14:56:30 juju-e4d256-prod-github-runner-207 kernel: [34364.573801] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:56:30 juju-e4d256-prod-github-runner-207 kernel: [34364.574856] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:56:30 juju-e4d256-prod-github-runner-207 kernel: [34364.575884] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:56:30 juju-e4d256-prod-github-runner-207 kernel: [34364.576995] ? show_regs.part.0+0x23/0x29 Aug 22 14:56:30 juju-e4d256-prod-github-runner-207 kernel: [34364.578027] ? show_regs.cold+0x8/0xd Aug 22 14:56:30 juju-e4d256-prod-github-runner-207 kernel: [34364.579014] ? watchdog_timer_fn+0x1be/0x220 Aug 22 14:56:30 juju-e4d256-prod-github-runner-207 kernel: [34364.580031] ? lockup_detector_update_enable+0x60/0x60 Aug 22 14:56:30 juju-e4d256-prod-github-runner-207 kernel: [34364.581116] ? __hrtimer_run_queues+0x107/0x230 Aug 22 14:56:30 juju-e4d256-prod-github-runner-207 kernel: [34364.582169] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 14:56:30 juju-e4d256-prod-github-runner-207 kernel: [34364.583241] ? hrtimer_interrupt+0x101/0x220 Aug 22 14:56:30 juju-e4d256-prod-github-runner-207 kernel: [34364.584277] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 14:56:30 juju-e4d256-prod-github-runner-207 kernel: [34364.585419] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 14:56:30 juju-e4d256-prod-github-runner-207 kernel: [34364.586480] Aug 22 14:56:30 juju-e4d256-prod-github-runner-207 kernel: [34364.587367] Aug 22 14:56:30 juju-e4d256-prod-github-runner-207 kernel: [34364.588269] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 14:56:30 juju-e4d256-prod-github-runner-207 kernel: [34364.589564] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:56:30 juju-e4d256-prod-github-runner-207 kernel: [34364.590624] ? _raw_spin_lock+0x22/0x30 Aug 22 14:56:30 juju-e4d256-prod-github-runner-207 kernel: [34364.591593] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:56:30 juju-e4d256-prod-github-runner-207 kernel: [34364.592631] direct_page_fault+0x206/0x310 [kvm] Aug 22 14:56:30 juju-e4d256-prod-github-runner-207 kernel: [34364.593659] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 14:56:30 juju-e4d256-prod-github-runner-207 kernel: [34364.594690] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 14:56:30 juju-e4d256-prod-github-runner-207 kernel: [34364.595708] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 14:56:30 juju-e4d256-prod-github-runner-207 kernel: [34364.596680] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 14:56:30 juju-e4d256-prod-github-runner-207 kernel: [34364.597632] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 14:56:30 juju-e4d256-prod-github-runner-207 kernel: [34364.598629] handle_exit+0x98/0x230 [kvm_amd] Aug 22 14:56:30 juju-e4d256-prod-github-runner-207 kernel: [34364.599607] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 14:56:30 juju-e4d256-prod-github-runner-207 kernel: [34364.600544] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 14:56:30 juju-e4d256-prod-github-runner-207 kernel: [34364.601478] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 14:56:30 juju-e4d256-prod-github-runner-207 kernel: [34364.602410] vcpu_run+0x62/0x2c0 [kvm] Aug 22 14:56:30 juju-e4d256-prod-github-runner-207 kernel: [34364.603227] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 14:56:30 juju-e4d256-prod-github-runner-207 kernel: [34364.604040] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 14:56:30 juju-e4d256-prod-github-runner-207 kernel: [34364.604933] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 14:56:30 juju-e4d256-prod-github-runner-207 kernel: [34364.605731] ? __seccomp_filter+0x4a/0x4a0 Aug 22 14:56:30 juju-e4d256-prod-github-runner-207 kernel: [34364.606485] ? __fget_files+0x86/0xc0 Aug 22 14:56:30 juju-e4d256-prod-github-runner-207 kernel: [34364.607192] __x64_sys_ioctl+0x95/0xd0 Aug 22 14:56:30 juju-e4d256-prod-github-runner-207 kernel: [34364.607886] do_syscall_64+0x5c/0xc0 Aug 22 14:56:30 juju-e4d256-prod-github-runner-207 kernel: [34364.608553] ? do_futex+0x162/0x1f0 Aug 22 14:56:30 juju-e4d256-prod-github-runner-207 kernel: [34364.609203] ? __x64_sys_futex+0x78/0x1e0 Aug 22 14:56:30 juju-e4d256-prod-github-runner-207 kernel: [34364.609894] ? __secure_computing+0xa9/0x120 Aug 22 14:56:30 juju-e4d256-prod-github-runner-207 kernel: [34364.610710] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 14:56:30 juju-e4d256-prod-github-runner-207 kernel: [34364.611653] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:56:30 juju-e4d256-prod-github-runner-207 kernel: [34364.612388] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:56:30 juju-e4d256-prod-github-runner-207 kernel: [34364.613114] ? do_syscall_64+0x69/0xc0 Aug 22 14:56:30 juju-e4d256-prod-github-runner-207 kernel: [34364.613762] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:56:30 juju-e4d256-prod-github-runner-207 kernel: [34364.614486] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:56:30 juju-e4d256-prod-github-runner-207 kernel: [34364.615185] ? do_syscall_64+0x69/0xc0 Aug 22 14:56:30 juju-e4d256-prod-github-runner-207 kernel: [34364.615812] ? do_syscall_64+0x69/0xc0 Aug 22 14:56:30 juju-e4d256-prod-github-runner-207 kernel: [34364.616459] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 14:56:30 juju-e4d256-prod-github-runner-207 kernel: [34364.617185] RIP: 0033:0x7faa5d0edaff Aug 22 14:56:30 juju-e4d256-prod-github-runner-207 kernel: [34364.617823] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 14:56:30 juju-e4d256-prod-github-runner-207 kernel: [34364.619819] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 14:56:30 juju-e4d256-prod-github-runner-207 kernel: [34364.620727] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 14:56:30 juju-e4d256-prod-github-runner-207 kernel: [34364.621616] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 14:56:30 juju-e4d256-prod-github-runner-207 kernel: [34364.622539] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 14:56:30 juju-e4d256-prod-github-runner-207 kernel: [34364.623443] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 14:56:30 juju-e4d256-prod-github-runner-207 kernel: [34364.624369] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 14:56:30 juju-e4d256-prod-github-runner-207 kernel: [34364.625274] Aug 22 14:56:45 juju-e4d256-prod-github-runner-207 kernel: [34379.480707] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 14:56:45 juju-e4d256-prod-github-runner-207 kernel: [34379.481688] rcu: 1-....: (8538739 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=4125137 Aug 22 14:56:45 juju-e4d256-prod-github-runner-207 kernel: [34379.482838] (t=8565570 jiffies g=23269 q=36625) Aug 22 14:56:45 juju-e4d256-prod-github-runner-207 kernel: [34379.483622] NMI backtrace for cpu 1 Aug 22 14:56:45 juju-e4d256-prod-github-runner-207 kernel: [34379.484330] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 14:56:45 juju-e4d256-prod-github-runner-207 kernel: [34379.485435] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 14:56:45 juju-e4d256-prod-github-runner-207 kernel: [34379.486512] Call Trace: Aug 22 14:56:45 juju-e4d256-prod-github-runner-207 kernel: [34379.487192] Aug 22 14:56:45 juju-e4d256-prod-github-runner-207 kernel: [34379.487847] show_stack+0x52/0x5c Aug 22 14:56:45 juju-e4d256-prod-github-runner-207 kernel: [34379.488578] dump_stack_lvl+0x4a/0x63 Aug 22 14:56:45 juju-e4d256-prod-github-runner-207 kernel: [34379.489325] dump_stack+0x10/0x16 Aug 22 14:56:45 juju-e4d256-prod-github-runner-207 kernel: [34379.490056] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 14:56:45 juju-e4d256-prod-github-runner-207 kernel: [34379.490836] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 14:56:45 juju-e4d256-prod-github-runner-207 kernel: [34379.491621] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 14:56:45 juju-e4d256-prod-github-runner-207 kernel: [34379.492447] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 14:56:45 juju-e4d256-prod-github-runner-207 kernel: [34379.493277] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 14:56:45 juju-e4d256-prod-github-runner-207 kernel: [34379.494099] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 14:56:45 juju-e4d256-prod-github-runner-207 kernel: [34379.494873] print_cpu_stall.cold+0x2f/0xe2 Aug 22 14:56:45 juju-e4d256-prod-github-runner-207 kernel: [34379.495635] ? timekeeping_update+0xf7/0x150 Aug 22 14:56:45 juju-e4d256-prod-github-runner-207 kernel: [34379.496403] check_cpu_stall+0x109/0x270 Aug 22 14:56:45 juju-e4d256-prod-github-runner-207 kernel: [34379.497158] rcu_sched_clock_irq+0x9a/0x250 Aug 22 14:56:45 juju-e4d256-prod-github-runner-207 kernel: [34379.497954] update_process_times+0x94/0xd0 Aug 22 14:56:45 juju-e4d256-prod-github-runner-207 kernel: [34379.498714] tick_sched_handle+0x29/0x70 Aug 22 14:56:45 juju-e4d256-prod-github-runner-207 kernel: [34379.499460] tick_sched_timer+0x8c/0xc0 Aug 22 14:56:45 juju-e4d256-prod-github-runner-207 kernel: [34379.500198] ? tick_nohz_handler+0xb0/0xb0 Aug 22 14:56:45 juju-e4d256-prod-github-runner-207 kernel: [34379.500952] __hrtimer_run_queues+0x107/0x230 Aug 22 14:56:45 juju-e4d256-prod-github-runner-207 kernel: [34379.501737] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 14:56:45 juju-e4d256-prod-github-runner-207 kernel: [34379.502521] hrtimer_interrupt+0x101/0x220 Aug 22 14:56:45 juju-e4d256-prod-github-runner-207 kernel: [34379.503290] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 14:56:45 juju-e4d256-prod-github-runner-207 kernel: [34379.504157] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 14:56:45 juju-e4d256-prod-github-runner-207 kernel: [34379.505028] Aug 22 14:56:45 juju-e4d256-prod-github-runner-207 kernel: [34379.505903] Aug 22 14:56:45 juju-e4d256-prod-github-runner-207 kernel: [34379.506732] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 14:56:45 juju-e4d256-prod-github-runner-207 kernel: [34379.507680] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:56:45 juju-e4d256-prod-github-runner-207 kernel: [34379.508851] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 14:56:45 juju-e4d256-prod-github-runner-207 kernel: [34379.511219] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 14:56:45 juju-e4d256-prod-github-runner-207 kernel: [34379.512094] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 14:56:45 juju-e4d256-prod-github-runner-207 kernel: [34379.513088] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 14:56:45 juju-e4d256-prod-github-runner-207 kernel: [34379.514077] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 14:56:45 juju-e4d256-prod-github-runner-207 kernel: [34379.515044] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 14:56:45 juju-e4d256-prod-github-runner-207 kernel: [34379.515998] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 14:56:45 juju-e4d256-prod-github-runner-207 kernel: [34379.516948] ? _raw_spin_lock+0x22/0x30 Aug 22 14:56:45 juju-e4d256-prod-github-runner-207 kernel: [34379.517725] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:56:45 juju-e4d256-prod-github-runner-207 kernel: [34379.518577] direct_page_fault+0x206/0x310 [kvm] Aug 22 14:56:45 juju-e4d256-prod-github-runner-207 kernel: [34379.519421] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 14:56:45 juju-e4d256-prod-github-runner-207 kernel: [34379.520251] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 14:56:45 juju-e4d256-prod-github-runner-207 kernel: [34379.521070] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 14:56:45 juju-e4d256-prod-github-runner-207 kernel: [34379.521890] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 14:56:45 juju-e4d256-prod-github-runner-207 kernel: [34379.522673] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 14:56:45 juju-e4d256-prod-github-runner-207 kernel: [34379.523493] handle_exit+0x98/0x230 [kvm_amd] Aug 22 14:56:45 juju-e4d256-prod-github-runner-207 kernel: [34379.524243] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 14:56:45 juju-e4d256-prod-github-runner-207 kernel: [34379.525023] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 14:56:45 juju-e4d256-prod-github-runner-207 kernel: [34379.525833] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 14:56:45 juju-e4d256-prod-github-runner-207 kernel: [34379.526614] vcpu_run+0x62/0x2c0 [kvm] Aug 22 14:56:45 juju-e4d256-prod-github-runner-207 kernel: [34379.527325] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 14:56:45 juju-e4d256-prod-github-runner-207 kernel: [34379.528055] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 14:56:45 juju-e4d256-prod-github-runner-207 kernel: [34379.528857] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 14:56:45 juju-e4d256-prod-github-runner-207 kernel: [34379.529620] ? __seccomp_filter+0x4a/0x4a0 Aug 22 14:56:45 juju-e4d256-prod-github-runner-207 kernel: [34379.530346] ? __fget_files+0x86/0xc0 Aug 22 14:56:45 juju-e4d256-prod-github-runner-207 kernel: [34379.531037] __x64_sys_ioctl+0x95/0xd0 Aug 22 14:56:45 juju-e4d256-prod-github-runner-207 kernel: [34379.531729] do_syscall_64+0x5c/0xc0 Aug 22 14:56:45 juju-e4d256-prod-github-runner-207 kernel: [34379.532413] ? do_futex+0x162/0x1f0 Aug 22 14:56:45 juju-e4d256-prod-github-runner-207 kernel: [34379.533083] ? __x64_sys_futex+0x78/0x1e0 Aug 22 14:56:45 juju-e4d256-prod-github-runner-207 kernel: [34379.533798] ? __secure_computing+0xa9/0x120 Aug 22 14:56:45 juju-e4d256-prod-github-runner-207 kernel: [34379.534519] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 14:56:45 juju-e4d256-prod-github-runner-207 kernel: [34379.535314] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:56:45 juju-e4d256-prod-github-runner-207 kernel: [34379.536066] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:56:45 juju-e4d256-prod-github-runner-207 kernel: [34379.536820] ? do_syscall_64+0x69/0xc0 Aug 22 14:56:45 juju-e4d256-prod-github-runner-207 kernel: [34379.537507] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:56:45 juju-e4d256-prod-github-runner-207 kernel: [34379.538271] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:56:45 juju-e4d256-prod-github-runner-207 kernel: [34379.539032] ? do_syscall_64+0x69/0xc0 Aug 22 14:56:45 juju-e4d256-prod-github-runner-207 kernel: [34379.539729] ? do_syscall_64+0x69/0xc0 Aug 22 14:56:45 juju-e4d256-prod-github-runner-207 kernel: [34379.540414] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 14:56:45 juju-e4d256-prod-github-runner-207 kernel: [34379.541183] RIP: 0033:0x7faa5d0edaff Aug 22 14:56:45 juju-e4d256-prod-github-runner-207 kernel: [34379.541872] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 14:56:45 juju-e4d256-prod-github-runner-207 kernel: [34379.543962] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 14:56:45 juju-e4d256-prod-github-runner-207 kernel: [34379.544921] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 14:56:45 juju-e4d256-prod-github-runner-207 kernel: [34379.545877] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 14:56:45 juju-e4d256-prod-github-runner-207 kernel: [34379.546818] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 14:56:45 juju-e4d256-prod-github-runner-207 kernel: [34379.547754] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 14:56:45 juju-e4d256-prod-github-runner-207 kernel: [34379.548681] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 14:56:45 juju-e4d256-prod-github-runner-207 kernel: [34379.549600] Aug 22 14:57:10 juju-e4d256-prod-github-runner-207 kernel: [34404.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 31933s! [qemu-system-x86:6715] Aug 22 14:57:10 juju-e4d256-prod-github-runner-207 kernel: [34404.543144] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 14:57:10 juju-e4d256-prod-github-runner-207 kernel: [34404.543221] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 14:57:10 juju-e4d256-prod-github-runner-207 kernel: [34404.555854] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 14:57:10 juju-e4d256-prod-github-runner-207 kernel: [34404.557342] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 14:57:10 juju-e4d256-prod-github-runner-207 kernel: [34404.558594] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:57:10 juju-e4d256-prod-github-runner-207 kernel: [34404.559720] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 14:57:10 juju-e4d256-prod-github-runner-207 kernel: [34404.562326] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 14:57:10 juju-e4d256-prod-github-runner-207 kernel: [34404.563373] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 14:57:10 juju-e4d256-prod-github-runner-207 kernel: [34404.564549] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 14:57:10 juju-e4d256-prod-github-runner-207 kernel: [34404.565759] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 14:57:10 juju-e4d256-prod-github-runner-207 kernel: [34404.566918] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 14:57:10 juju-e4d256-prod-github-runner-207 kernel: [34404.568077] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 14:57:10 juju-e4d256-prod-github-runner-207 kernel: [34404.569281] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 14:57:10 juju-e4d256-prod-github-runner-207 kernel: [34404.570595] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 14:57:10 juju-e4d256-prod-github-runner-207 kernel: [34404.571768] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 14:57:10 juju-e4d256-prod-github-runner-207 kernel: [34404.572980] Call Trace: Aug 22 14:57:10 juju-e4d256-prod-github-runner-207 kernel: [34404.573919] Aug 22 14:57:10 juju-e4d256-prod-github-runner-207 kernel: [34404.574811] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:57:10 juju-e4d256-prod-github-runner-207 kernel: [34404.575855] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:57:10 juju-e4d256-prod-github-runner-207 kernel: [34404.576913] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:57:10 juju-e4d256-prod-github-runner-207 kernel: [34404.578065] ? show_regs.part.0+0x23/0x29 Aug 22 14:57:10 juju-e4d256-prod-github-runner-207 kernel: [34404.579110] ? show_regs.cold+0x8/0xd Aug 22 14:57:10 juju-e4d256-prod-github-runner-207 kernel: [34404.580114] ? watchdog_timer_fn+0x1be/0x220 Aug 22 14:57:10 juju-e4d256-prod-github-runner-207 kernel: [34404.581148] ? lockup_detector_update_enable+0x60/0x60 Aug 22 14:57:10 juju-e4d256-prod-github-runner-207 kernel: [34404.582234] ? __hrtimer_run_queues+0x107/0x230 Aug 22 14:57:10 juju-e4d256-prod-github-runner-207 kernel: [34404.583264] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 14:57:10 juju-e4d256-prod-github-runner-207 kernel: [34404.584288] ? hrtimer_interrupt+0x101/0x220 Aug 22 14:57:10 juju-e4d256-prod-github-runner-207 kernel: [34404.585310] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 14:57:10 juju-e4d256-prod-github-runner-207 kernel: [34404.586409] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 14:57:10 juju-e4d256-prod-github-runner-207 kernel: [34404.587455] Aug 22 14:57:10 juju-e4d256-prod-github-runner-207 kernel: [34404.588313] Aug 22 14:57:10 juju-e4d256-prod-github-runner-207 kernel: [34404.589157] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 14:57:10 juju-e4d256-prod-github-runner-207 kernel: [34404.590214] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:57:10 juju-e4d256-prod-github-runner-207 kernel: [34404.591259] ? _raw_spin_lock+0x22/0x30 Aug 22 14:57:10 juju-e4d256-prod-github-runner-207 kernel: [34404.592205] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:57:10 juju-e4d256-prod-github-runner-207 kernel: [34404.593224] direct_page_fault+0x206/0x310 [kvm] Aug 22 14:57:10 juju-e4d256-prod-github-runner-207 kernel: [34404.594272] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 14:57:10 juju-e4d256-prod-github-runner-207 kernel: [34404.595285] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 14:57:10 juju-e4d256-prod-github-runner-207 kernel: [34404.596290] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 14:57:10 juju-e4d256-prod-github-runner-207 kernel: [34404.597259] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 14:57:10 juju-e4d256-prod-github-runner-207 kernel: [34404.598227] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 14:57:10 juju-e4d256-prod-github-runner-207 kernel: [34404.599205] handle_exit+0x98/0x230 [kvm_amd] Aug 22 14:57:10 juju-e4d256-prod-github-runner-207 kernel: [34404.600111] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 14:57:10 juju-e4d256-prod-github-runner-207 kernel: [34404.601036] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 14:57:10 juju-e4d256-prod-github-runner-207 kernel: [34404.601975] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 14:57:10 juju-e4d256-prod-github-runner-207 kernel: [34404.602882] vcpu_run+0x62/0x2c0 [kvm] Aug 22 14:57:10 juju-e4d256-prod-github-runner-207 kernel: [34404.603692] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 14:57:10 juju-e4d256-prod-github-runner-207 kernel: [34404.604499] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 14:57:10 juju-e4d256-prod-github-runner-207 kernel: [34404.605355] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 14:57:10 juju-e4d256-prod-github-runner-207 kernel: [34404.606162] ? __seccomp_filter+0x4a/0x4a0 Aug 22 14:57:10 juju-e4d256-prod-github-runner-207 kernel: [34404.606911] ? __fget_files+0x86/0xc0 Aug 22 14:57:10 juju-e4d256-prod-github-runner-207 kernel: [34404.607613] __x64_sys_ioctl+0x95/0xd0 Aug 22 14:57:10 juju-e4d256-prod-github-runner-207 kernel: [34404.608302] do_syscall_64+0x5c/0xc0 Aug 22 14:57:10 juju-e4d256-prod-github-runner-207 kernel: [34404.608965] ? do_futex+0x162/0x1f0 Aug 22 14:57:10 juju-e4d256-prod-github-runner-207 kernel: [34404.609624] ? __x64_sys_futex+0x78/0x1e0 Aug 22 14:57:10 juju-e4d256-prod-github-runner-207 kernel: [34404.610296] ? __secure_computing+0xa9/0x120 Aug 22 14:57:10 juju-e4d256-prod-github-runner-207 kernel: [34404.610986] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 14:57:10 juju-e4d256-prod-github-runner-207 kernel: [34404.611746] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:57:10 juju-e4d256-prod-github-runner-207 kernel: [34404.612476] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:57:10 juju-e4d256-prod-github-runner-207 kernel: [34404.613211] ? do_syscall_64+0x69/0xc0 Aug 22 14:57:10 juju-e4d256-prod-github-runner-207 kernel: [34404.613884] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:57:10 juju-e4d256-prod-github-runner-207 kernel: [34404.614600] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:57:10 juju-e4d256-prod-github-runner-207 kernel: [34404.615296] ? do_syscall_64+0x69/0xc0 Aug 22 14:57:10 juju-e4d256-prod-github-runner-207 kernel: [34404.615923] ? do_syscall_64+0x69/0xc0 Aug 22 14:57:10 juju-e4d256-prod-github-runner-207 kernel: [34404.616547] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 14:57:10 juju-e4d256-prod-github-runner-207 kernel: [34404.617259] RIP: 0033:0x7faa5d0edaff Aug 22 14:57:10 juju-e4d256-prod-github-runner-207 kernel: [34404.617907] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 14:57:10 juju-e4d256-prod-github-runner-207 kernel: [34404.619904] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 14:57:10 juju-e4d256-prod-github-runner-207 kernel: [34404.620822] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 14:57:10 juju-e4d256-prod-github-runner-207 kernel: [34404.621739] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 14:57:10 juju-e4d256-prod-github-runner-207 kernel: [34404.622631] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 14:57:10 juju-e4d256-prod-github-runner-207 kernel: [34404.623530] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 14:57:10 juju-e4d256-prod-github-runner-207 kernel: [34404.624422] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 14:57:10 juju-e4d256-prod-github-runner-207 kernel: [34404.625311] Aug 22 14:57:38 juju-e4d256-prod-github-runner-207 kernel: [34432.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 31959s! [qemu-system-x86:6715] Aug 22 14:57:38 juju-e4d256-prod-github-runner-207 kernel: [34432.543942] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 14:57:38 juju-e4d256-prod-github-runner-207 kernel: [34432.544239] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 14:57:38 juju-e4d256-prod-github-runner-207 kernel: [34432.556619] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 14:57:38 juju-e4d256-prod-github-runner-207 kernel: [34432.557920] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 14:57:38 juju-e4d256-prod-github-runner-207 kernel: [34432.559155] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:57:38 juju-e4d256-prod-github-runner-207 kernel: [34432.560252] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 14:57:38 juju-e4d256-prod-github-runner-207 kernel: [34432.562849] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 14:57:38 juju-e4d256-prod-github-runner-207 kernel: [34432.563958] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 14:57:38 juju-e4d256-prod-github-runner-207 kernel: [34432.565141] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 14:57:38 juju-e4d256-prod-github-runner-207 kernel: [34432.566306] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 14:57:38 juju-e4d256-prod-github-runner-207 kernel: [34432.567481] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 14:57:38 juju-e4d256-prod-github-runner-207 kernel: [34432.568657] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 14:57:38 juju-e4d256-prod-github-runner-207 kernel: [34432.569855] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 14:57:38 juju-e4d256-prod-github-runner-207 kernel: [34432.571098] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 14:57:38 juju-e4d256-prod-github-runner-207 kernel: [34432.572212] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 14:57:38 juju-e4d256-prod-github-runner-207 kernel: [34432.573438] Call Trace: Aug 22 14:57:38 juju-e4d256-prod-github-runner-207 kernel: [34432.574362] Aug 22 14:57:38 juju-e4d256-prod-github-runner-207 kernel: [34432.575272] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:57:38 juju-e4d256-prod-github-runner-207 kernel: [34432.576322] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:57:38 juju-e4d256-prod-github-runner-207 kernel: [34432.577375] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:57:38 juju-e4d256-prod-github-runner-207 kernel: [34432.578475] ? show_regs.part.0+0x23/0x29 Aug 22 14:57:38 juju-e4d256-prod-github-runner-207 kernel: [34432.579477] ? show_regs.cold+0x8/0xd Aug 22 14:57:38 juju-e4d256-prod-github-runner-207 kernel: [34432.580451] ? watchdog_timer_fn+0x1be/0x220 Aug 22 14:57:38 juju-e4d256-prod-github-runner-207 kernel: [34432.581511] ? lockup_detector_update_enable+0x60/0x60 Aug 22 14:57:38 juju-e4d256-prod-github-runner-207 kernel: [34432.582608] ? __hrtimer_run_queues+0x107/0x230 Aug 22 14:57:38 juju-e4d256-prod-github-runner-207 kernel: [34432.583644] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 14:57:38 juju-e4d256-prod-github-runner-207 kernel: [34432.584666] ? hrtimer_interrupt+0x101/0x220 Aug 22 14:57:38 juju-e4d256-prod-github-runner-207 kernel: [34432.585699] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 14:57:38 juju-e4d256-prod-github-runner-207 kernel: [34432.586798] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 14:57:38 juju-e4d256-prod-github-runner-207 kernel: [34432.587872] Aug 22 14:57:38 juju-e4d256-prod-github-runner-207 kernel: [34432.588728] Aug 22 14:57:38 juju-e4d256-prod-github-runner-207 kernel: [34432.589599] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 14:57:38 juju-e4d256-prod-github-runner-207 kernel: [34432.590642] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:57:38 juju-e4d256-prod-github-runner-207 kernel: [34432.591686] ? _raw_spin_lock+0x22/0x30 Aug 22 14:57:38 juju-e4d256-prod-github-runner-207 kernel: [34432.592629] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:57:38 juju-e4d256-prod-github-runner-207 kernel: [34432.593663] direct_page_fault+0x206/0x310 [kvm] Aug 22 14:57:38 juju-e4d256-prod-github-runner-207 kernel: [34432.594692] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 14:57:38 juju-e4d256-prod-github-runner-207 kernel: [34432.595696] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 14:57:38 juju-e4d256-prod-github-runner-207 kernel: [34432.596696] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 14:57:38 juju-e4d256-prod-github-runner-207 kernel: [34432.597703] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 14:57:38 juju-e4d256-prod-github-runner-207 kernel: [34432.598649] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 14:57:38 juju-e4d256-prod-github-runner-207 kernel: [34432.599623] handle_exit+0x98/0x230 [kvm_amd] Aug 22 14:57:38 juju-e4d256-prod-github-runner-207 kernel: [34432.600513] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 14:57:38 juju-e4d256-prod-github-runner-207 kernel: [34432.601440] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 14:57:38 juju-e4d256-prod-github-runner-207 kernel: [34432.602372] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 14:57:38 juju-e4d256-prod-github-runner-207 kernel: [34432.603283] vcpu_run+0x62/0x2c0 [kvm] Aug 22 14:57:38 juju-e4d256-prod-github-runner-207 kernel: [34432.604110] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 14:57:38 juju-e4d256-prod-github-runner-207 kernel: [34432.604922] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 14:57:38 juju-e4d256-prod-github-runner-207 kernel: [34432.605796] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 14:57:38 juju-e4d256-prod-github-runner-207 kernel: [34432.606594] ? __seccomp_filter+0x4a/0x4a0 Aug 22 14:57:38 juju-e4d256-prod-github-runner-207 kernel: [34432.607334] ? __fget_files+0x86/0xc0 Aug 22 14:57:38 juju-e4d256-prod-github-runner-207 kernel: [34432.608034] __x64_sys_ioctl+0x95/0xd0 Aug 22 14:57:38 juju-e4d256-prod-github-runner-207 kernel: [34432.608724] do_syscall_64+0x5c/0xc0 Aug 22 14:57:38 juju-e4d256-prod-github-runner-207 kernel: [34432.609404] ? do_futex+0x162/0x1f0 Aug 22 14:57:38 juju-e4d256-prod-github-runner-207 kernel: [34432.610051] ? __x64_sys_futex+0x78/0x1e0 Aug 22 14:57:38 juju-e4d256-prod-github-runner-207 kernel: [34432.610741] ? __secure_computing+0xa9/0x120 Aug 22 14:57:38 juju-e4d256-prod-github-runner-207 kernel: [34432.611438] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 14:57:38 juju-e4d256-prod-github-runner-207 kernel: [34432.612193] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:57:38 juju-e4d256-prod-github-runner-207 kernel: [34432.612910] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:57:38 juju-e4d256-prod-github-runner-207 kernel: [34432.613632] ? do_syscall_64+0x69/0xc0 Aug 22 14:57:38 juju-e4d256-prod-github-runner-207 kernel: [34432.614274] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:57:38 juju-e4d256-prod-github-runner-207 kernel: [34432.614973] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:57:38 juju-e4d256-prod-github-runner-207 kernel: [34432.615775] ? do_syscall_64+0x69/0xc0 Aug 22 14:57:38 juju-e4d256-prod-github-runner-207 kernel: [34432.616470] ? do_syscall_64+0x69/0xc0 Aug 22 14:57:38 juju-e4d256-prod-github-runner-207 kernel: [34432.617171] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 14:57:38 juju-e4d256-prod-github-runner-207 kernel: [34432.617971] RIP: 0033:0x7faa5d0edaff Aug 22 14:57:38 juju-e4d256-prod-github-runner-207 kernel: [34432.618695] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 14:57:38 juju-e4d256-prod-github-runner-207 kernel: [34432.621003] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 14:57:38 juju-e4d256-prod-github-runner-207 kernel: [34432.622057] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 14:57:38 juju-e4d256-prod-github-runner-207 kernel: [34432.623073] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 14:57:38 juju-e4d256-prod-github-runner-207 kernel: [34432.624091] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 14:57:38 juju-e4d256-prod-github-runner-207 kernel: [34432.625125] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 14:57:38 juju-e4d256-prod-github-runner-207 kernel: [34432.626146] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 14:57:38 juju-e4d256-prod-github-runner-207 kernel: [34432.627165] Aug 22 14:58:06 juju-e4d256-prod-github-runner-207 kernel: [34460.541980] watchdog: BUG: soft lockup - CPU#1 stuck for 31985s! [qemu-system-x86:6715] Aug 22 14:58:06 juju-e4d256-prod-github-runner-207 kernel: [34460.543159] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 14:58:06 juju-e4d256-prod-github-runner-207 kernel: [34460.543234] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 14:58:06 juju-e4d256-prod-github-runner-207 kernel: [34460.555706] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 14:58:06 juju-e4d256-prod-github-runner-207 kernel: [34460.557039] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 14:58:06 juju-e4d256-prod-github-runner-207 kernel: [34460.558305] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:58:06 juju-e4d256-prod-github-runner-207 kernel: [34460.559368] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 14:58:06 juju-e4d256-prod-github-runner-207 kernel: [34460.561982] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 14:58:06 juju-e4d256-prod-github-runner-207 kernel: [34460.563064] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 14:58:06 juju-e4d256-prod-github-runner-207 kernel: [34460.564241] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 14:58:06 juju-e4d256-prod-github-runner-207 kernel: [34460.565424] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 14:58:06 juju-e4d256-prod-github-runner-207 kernel: [34460.566661] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 14:58:06 juju-e4d256-prod-github-runner-207 kernel: [34460.567865] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 14:58:06 juju-e4d256-prod-github-runner-207 kernel: [34460.569064] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 14:58:06 juju-e4d256-prod-github-runner-207 kernel: [34460.570297] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 14:58:06 juju-e4d256-prod-github-runner-207 kernel: [34460.571414] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 14:58:06 juju-e4d256-prod-github-runner-207 kernel: [34460.572645] Call Trace: Aug 22 14:58:06 juju-e4d256-prod-github-runner-207 kernel: [34460.573574] Aug 22 14:58:06 juju-e4d256-prod-github-runner-207 kernel: [34460.574466] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:58:06 juju-e4d256-prod-github-runner-207 kernel: [34460.575496] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:58:06 juju-e4d256-prod-github-runner-207 kernel: [34460.576536] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:58:06 juju-e4d256-prod-github-runner-207 kernel: [34460.577664] ? show_regs.part.0+0x23/0x29 Aug 22 14:58:06 juju-e4d256-prod-github-runner-207 kernel: [34460.578670] ? show_regs.cold+0x8/0xd Aug 22 14:58:06 juju-e4d256-prod-github-runner-207 kernel: [34460.579648] ? watchdog_timer_fn+0x1be/0x220 Aug 22 14:58:06 juju-e4d256-prod-github-runner-207 kernel: [34460.580662] ? lockup_detector_update_enable+0x60/0x60 Aug 22 14:58:06 juju-e4d256-prod-github-runner-207 kernel: [34460.581857] ? __hrtimer_run_queues+0x107/0x230 Aug 22 14:58:06 juju-e4d256-prod-github-runner-207 kernel: [34460.582973] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 14:58:06 juju-e4d256-prod-github-runner-207 kernel: [34460.584041] ? hrtimer_interrupt+0x101/0x220 Aug 22 14:58:06 juju-e4d256-prod-github-runner-207 kernel: [34460.585079] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 14:58:06 juju-e4d256-prod-github-runner-207 kernel: [34460.586157] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 14:58:06 juju-e4d256-prod-github-runner-207 kernel: [34460.587406] Aug 22 14:58:06 juju-e4d256-prod-github-runner-207 kernel: [34460.588339] Aug 22 14:58:06 juju-e4d256-prod-github-runner-207 kernel: [34460.589205] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 14:58:06 juju-e4d256-prod-github-runner-207 kernel: [34460.590275] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:58:06 juju-e4d256-prod-github-runner-207 kernel: [34460.591360] ? _raw_spin_lock+0x22/0x30 Aug 22 14:58:06 juju-e4d256-prod-github-runner-207 kernel: [34460.592343] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:58:06 juju-e4d256-prod-github-runner-207 kernel: [34460.593399] direct_page_fault+0x206/0x310 [kvm] Aug 22 14:58:06 juju-e4d256-prod-github-runner-207 kernel: [34460.594483] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 14:58:06 juju-e4d256-prod-github-runner-207 kernel: [34460.595518] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 14:58:06 juju-e4d256-prod-github-runner-207 kernel: [34460.596555] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 14:58:06 juju-e4d256-prod-github-runner-207 kernel: [34460.597579] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 14:58:06 juju-e4d256-prod-github-runner-207 kernel: [34460.598554] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 14:58:06 juju-e4d256-prod-github-runner-207 kernel: [34460.599551] handle_exit+0x98/0x230 [kvm_amd] Aug 22 14:58:06 juju-e4d256-prod-github-runner-207 kernel: [34460.600459] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 14:58:06 juju-e4d256-prod-github-runner-207 kernel: [34460.601401] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 14:58:06 juju-e4d256-prod-github-runner-207 kernel: [34460.602351] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 14:58:06 juju-e4d256-prod-github-runner-207 kernel: [34460.603296] vcpu_run+0x62/0x2c0 [kvm] Aug 22 14:58:06 juju-e4d256-prod-github-runner-207 kernel: [34460.604117] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 14:58:06 juju-e4d256-prod-github-runner-207 kernel: [34460.604979] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 14:58:06 juju-e4d256-prod-github-runner-207 kernel: [34460.605886] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 14:58:06 juju-e4d256-prod-github-runner-207 kernel: [34460.606697] ? __seccomp_filter+0x4a/0x4a0 Aug 22 14:58:06 juju-e4d256-prod-github-runner-207 kernel: [34460.607470] ? __fget_files+0x86/0xc0 Aug 22 14:58:06 juju-e4d256-prod-github-runner-207 kernel: [34460.608220] __x64_sys_ioctl+0x95/0xd0 Aug 22 14:58:06 juju-e4d256-prod-github-runner-207 kernel: [34460.608953] do_syscall_64+0x5c/0xc0 Aug 22 14:58:06 juju-e4d256-prod-github-runner-207 kernel: [34460.609626] ? do_futex+0x162/0x1f0 Aug 22 14:58:06 juju-e4d256-prod-github-runner-207 kernel: [34460.610304] ? __x64_sys_futex+0x78/0x1e0 Aug 22 14:58:06 juju-e4d256-prod-github-runner-207 kernel: [34460.611008] ? __secure_computing+0xa9/0x120 Aug 22 14:58:06 juju-e4d256-prod-github-runner-207 kernel: [34460.611794] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 14:58:06 juju-e4d256-prod-github-runner-207 kernel: [34460.612644] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:58:06 juju-e4d256-prod-github-runner-207 kernel: [34460.613414] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:58:06 juju-e4d256-prod-github-runner-207 kernel: [34460.614146] ? do_syscall_64+0x69/0xc0 Aug 22 14:58:06 juju-e4d256-prod-github-runner-207 kernel: [34460.614807] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:58:06 juju-e4d256-prod-github-runner-207 kernel: [34460.615534] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:58:06 juju-e4d256-prod-github-runner-207 kernel: [34460.616275] ? do_syscall_64+0x69/0xc0 Aug 22 14:58:06 juju-e4d256-prod-github-runner-207 kernel: [34460.616950] ? do_syscall_64+0x69/0xc0 Aug 22 14:58:06 juju-e4d256-prod-github-runner-207 kernel: [34460.617607] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 14:58:06 juju-e4d256-prod-github-runner-207 kernel: [34460.618371] RIP: 0033:0x7faa5d0edaff Aug 22 14:58:06 juju-e4d256-prod-github-runner-207 kernel: [34460.619012] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 14:58:06 juju-e4d256-prod-github-runner-207 kernel: [34460.621100] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 14:58:06 juju-e4d256-prod-github-runner-207 kernel: [34460.622024] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 14:58:06 juju-e4d256-prod-github-runner-207 kernel: [34460.622940] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 14:58:06 juju-e4d256-prod-github-runner-207 kernel: [34460.623868] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 14:58:06 juju-e4d256-prod-github-runner-207 kernel: [34460.624780] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 14:58:06 juju-e4d256-prod-github-runner-207 kernel: [34460.625697] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 14:58:06 juju-e4d256-prod-github-runner-207 kernel: [34460.626596] Aug 22 14:58:34 juju-e4d256-prod-github-runner-207 kernel: [34488.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 32011s! [qemu-system-x86:6715] Aug 22 14:58:34 juju-e4d256-prod-github-runner-207 kernel: [34488.543122] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 14:58:34 juju-e4d256-prod-github-runner-207 kernel: [34488.543197] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 14:58:34 juju-e4d256-prod-github-runner-207 kernel: [34488.555849] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 14:58:34 juju-e4d256-prod-github-runner-207 kernel: [34488.557157] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 14:58:34 juju-e4d256-prod-github-runner-207 kernel: [34488.558376] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:58:34 juju-e4d256-prod-github-runner-207 kernel: [34488.559433] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 14:58:34 juju-e4d256-prod-github-runner-207 kernel: [34488.561992] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 14:58:34 juju-e4d256-prod-github-runner-207 kernel: [34488.563115] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 14:58:34 juju-e4d256-prod-github-runner-207 kernel: [34488.564350] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 14:58:34 juju-e4d256-prod-github-runner-207 kernel: [34488.565544] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 14:58:34 juju-e4d256-prod-github-runner-207 kernel: [34488.566716] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 14:58:34 juju-e4d256-prod-github-runner-207 kernel: [34488.567896] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 14:58:34 juju-e4d256-prod-github-runner-207 kernel: [34488.569086] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 14:58:34 juju-e4d256-prod-github-runner-207 kernel: [34488.570323] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 14:58:34 juju-e4d256-prod-github-runner-207 kernel: [34488.571423] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 14:58:34 juju-e4d256-prod-github-runner-207 kernel: [34488.572648] Call Trace: Aug 22 14:58:34 juju-e4d256-prod-github-runner-207 kernel: [34488.573643] Aug 22 14:58:34 juju-e4d256-prod-github-runner-207 kernel: [34488.574573] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:58:34 juju-e4d256-prod-github-runner-207 kernel: [34488.575705] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:58:34 juju-e4d256-prod-github-runner-207 kernel: [34488.576838] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:58:34 juju-e4d256-prod-github-runner-207 kernel: [34488.578027] ? show_regs.part.0+0x23/0x29 Aug 22 14:58:34 juju-e4d256-prod-github-runner-207 kernel: [34488.579103] ? show_regs.cold+0x8/0xd Aug 22 14:58:34 juju-e4d256-prod-github-runner-207 kernel: [34488.580153] ? watchdog_timer_fn+0x1be/0x220 Aug 22 14:58:34 juju-e4d256-prod-github-runner-207 kernel: [34488.581275] ? lockup_detector_update_enable+0x60/0x60 Aug 22 14:58:34 juju-e4d256-prod-github-runner-207 kernel: [34488.582453] ? __hrtimer_run_queues+0x107/0x230 Aug 22 14:58:34 juju-e4d256-prod-github-runner-207 kernel: [34488.583570] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 14:58:34 juju-e4d256-prod-github-runner-207 kernel: [34488.584694] ? hrtimer_interrupt+0x101/0x220 Aug 22 14:58:34 juju-e4d256-prod-github-runner-207 kernel: [34488.585795] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 14:58:34 juju-e4d256-prod-github-runner-207 kernel: [34488.586974] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 14:58:34 juju-e4d256-prod-github-runner-207 kernel: [34488.588114] Aug 22 14:58:34 juju-e4d256-prod-github-runner-207 kernel: [34488.589036] Aug 22 14:58:34 juju-e4d256-prod-github-runner-207 kernel: [34488.589918] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 14:58:34 juju-e4d256-prod-github-runner-207 kernel: [34488.591058] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:58:34 juju-e4d256-prod-github-runner-207 kernel: [34488.592203] ? _raw_spin_lock+0x22/0x30 Aug 22 14:58:34 juju-e4d256-prod-github-runner-207 kernel: [34488.593237] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:58:34 juju-e4d256-prod-github-runner-207 kernel: [34488.594353] direct_page_fault+0x206/0x310 [kvm] Aug 22 14:58:34 juju-e4d256-prod-github-runner-207 kernel: [34488.595474] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 14:58:34 juju-e4d256-prod-github-runner-207 kernel: [34488.596582] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 14:58:34 juju-e4d256-prod-github-runner-207 kernel: [34488.597674] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 14:58:34 juju-e4d256-prod-github-runner-207 kernel: [34488.598744] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 14:58:34 juju-e4d256-prod-github-runner-207 kernel: [34488.599788] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 14:58:34 juju-e4d256-prod-github-runner-207 kernel: [34488.600882] handle_exit+0x98/0x230 [kvm_amd] Aug 22 14:58:34 juju-e4d256-prod-github-runner-207 kernel: [34488.601866] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 14:58:34 juju-e4d256-prod-github-runner-207 kernel: [34488.602867] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 14:58:34 juju-e4d256-prod-github-runner-207 kernel: [34488.603883] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 14:58:34 juju-e4d256-prod-github-runner-207 kernel: [34488.604893] vcpu_run+0x62/0x2c0 [kvm] Aug 22 14:58:34 juju-e4d256-prod-github-runner-207 kernel: [34488.605813] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 14:58:34 juju-e4d256-prod-github-runner-207 kernel: [34488.606703] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 14:58:34 juju-e4d256-prod-github-runner-207 kernel: [34488.607671] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 14:58:34 juju-e4d256-prod-github-runner-207 kernel: [34488.608572] ? __seccomp_filter+0x4a/0x4a0 Aug 22 14:58:34 juju-e4d256-prod-github-runner-207 kernel: [34488.609407] ? __fget_files+0x86/0xc0 Aug 22 14:58:34 juju-e4d256-prod-github-runner-207 kernel: [34488.610189] __x64_sys_ioctl+0x95/0xd0 Aug 22 14:58:34 juju-e4d256-prod-github-runner-207 kernel: [34488.610952] do_syscall_64+0x5c/0xc0 Aug 22 14:58:34 juju-e4d256-prod-github-runner-207 kernel: [34488.611693] ? do_futex+0x162/0x1f0 Aug 22 14:58:34 juju-e4d256-prod-github-runner-207 kernel: [34488.612412] ? __x64_sys_futex+0x78/0x1e0 Aug 22 14:58:34 juju-e4d256-prod-github-runner-207 kernel: [34488.613188] ? __secure_computing+0xa9/0x120 Aug 22 14:58:34 juju-e4d256-prod-github-runner-207 kernel: [34488.613966] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 14:58:34 juju-e4d256-prod-github-runner-207 kernel: [34488.614831] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:58:34 juju-e4d256-prod-github-runner-207 kernel: [34488.615647] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:58:34 juju-e4d256-prod-github-runner-207 kernel: [34488.616462] ? do_syscall_64+0x69/0xc0 Aug 22 14:58:34 juju-e4d256-prod-github-runner-207 kernel: [34488.617200] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:58:34 juju-e4d256-prod-github-runner-207 kernel: [34488.617995] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:58:34 juju-e4d256-prod-github-runner-207 kernel: [34488.618780] ? do_syscall_64+0x69/0xc0 Aug 22 14:58:34 juju-e4d256-prod-github-runner-207 kernel: [34488.619475] ? do_syscall_64+0x69/0xc0 Aug 22 14:58:34 juju-e4d256-prod-github-runner-207 kernel: [34488.620168] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 14:58:34 juju-e4d256-prod-github-runner-207 kernel: [34488.620979] RIP: 0033:0x7faa5d0edaff Aug 22 14:58:34 juju-e4d256-prod-github-runner-207 kernel: [34488.621683] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 14:58:34 juju-e4d256-prod-github-runner-207 kernel: [34488.623997] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 14:58:34 juju-e4d256-prod-github-runner-207 kernel: [34488.625364] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 14:58:34 juju-e4d256-prod-github-runner-207 kernel: [34488.626410] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 14:58:34 juju-e4d256-prod-github-runner-207 kernel: [34488.627445] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 14:58:34 juju-e4d256-prod-github-runner-207 kernel: [34488.628467] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 14:58:34 juju-e4d256-prod-github-runner-207 kernel: [34488.629507] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 14:58:34 juju-e4d256-prod-github-runner-207 kernel: [34488.630531] Aug 22 14:59:02 juju-e4d256-prod-github-runner-207 kernel: [34516.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 32038s! [qemu-system-x86:6715] Aug 22 14:59:02 juju-e4d256-prod-github-runner-207 kernel: [34516.543889] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 14:59:02 juju-e4d256-prod-github-runner-207 kernel: [34516.544210] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 14:59:02 juju-e4d256-prod-github-runner-207 kernel: [34516.556453] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 14:59:02 juju-e4d256-prod-github-runner-207 kernel: [34516.557746] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 14:59:02 juju-e4d256-prod-github-runner-207 kernel: [34516.558971] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:59:02 juju-e4d256-prod-github-runner-207 kernel: [34516.560122] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 14:59:02 juju-e4d256-prod-github-runner-207 kernel: [34516.563181] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 14:59:02 juju-e4d256-prod-github-runner-207 kernel: [34516.564247] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 14:59:02 juju-e4d256-prod-github-runner-207 kernel: [34516.565416] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 14:59:02 juju-e4d256-prod-github-runner-207 kernel: [34516.566578] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 14:59:02 juju-e4d256-prod-github-runner-207 kernel: [34516.567761] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 14:59:02 juju-e4d256-prod-github-runner-207 kernel: [34516.568995] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 14:59:02 juju-e4d256-prod-github-runner-207 kernel: [34516.570225] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 14:59:02 juju-e4d256-prod-github-runner-207 kernel: [34516.571581] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 14:59:02 juju-e4d256-prod-github-runner-207 kernel: [34516.572737] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 14:59:02 juju-e4d256-prod-github-runner-207 kernel: [34516.573962] Call Trace: Aug 22 14:59:02 juju-e4d256-prod-github-runner-207 kernel: [34516.574875] Aug 22 14:59:02 juju-e4d256-prod-github-runner-207 kernel: [34516.575781] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:59:02 juju-e4d256-prod-github-runner-207 kernel: [34516.576837] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:59:02 juju-e4d256-prod-github-runner-207 kernel: [34516.577910] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:59:02 juju-e4d256-prod-github-runner-207 kernel: [34516.579094] ? show_regs.part.0+0x23/0x29 Aug 22 14:59:02 juju-e4d256-prod-github-runner-207 kernel: [34516.580203] ? show_regs.cold+0x8/0xd Aug 22 14:59:02 juju-e4d256-prod-github-runner-207 kernel: [34516.581265] ? watchdog_timer_fn+0x1be/0x220 Aug 22 14:59:02 juju-e4d256-prod-github-runner-207 kernel: [34516.582294] ? lockup_detector_update_enable+0x60/0x60 Aug 22 14:59:02 juju-e4d256-prod-github-runner-207 kernel: [34516.583367] ? __hrtimer_run_queues+0x107/0x230 Aug 22 14:59:02 juju-e4d256-prod-github-runner-207 kernel: [34516.584448] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 14:59:02 juju-e4d256-prod-github-runner-207 kernel: [34516.585492] ? hrtimer_interrupt+0x101/0x220 Aug 22 14:59:02 juju-e4d256-prod-github-runner-207 kernel: [34516.586529] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 14:59:02 juju-e4d256-prod-github-runner-207 kernel: [34516.587608] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 14:59:02 juju-e4d256-prod-github-runner-207 kernel: [34516.588678] Aug 22 14:59:02 juju-e4d256-prod-github-runner-207 kernel: [34516.589536] Aug 22 14:59:02 juju-e4d256-prod-github-runner-207 kernel: [34516.590376] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 14:59:02 juju-e4d256-prod-github-runner-207 kernel: [34516.591411] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:59:02 juju-e4d256-prod-github-runner-207 kernel: [34516.592464] ? _raw_spin_lock+0x22/0x30 Aug 22 14:59:02 juju-e4d256-prod-github-runner-207 kernel: [34516.593413] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:59:02 juju-e4d256-prod-github-runner-207 kernel: [34516.594433] direct_page_fault+0x206/0x310 [kvm] Aug 22 14:59:02 juju-e4d256-prod-github-runner-207 kernel: [34516.595461] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 14:59:02 juju-e4d256-prod-github-runner-207 kernel: [34516.596483] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 14:59:02 juju-e4d256-prod-github-runner-207 kernel: [34516.597487] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 14:59:02 juju-e4d256-prod-github-runner-207 kernel: [34516.598503] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 14:59:02 juju-e4d256-prod-github-runner-207 kernel: [34516.599451] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 14:59:02 juju-e4d256-prod-github-runner-207 kernel: [34516.600450] handle_exit+0x98/0x230 [kvm_amd] Aug 22 14:59:02 juju-e4d256-prod-github-runner-207 kernel: [34516.601347] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 14:59:02 juju-e4d256-prod-github-runner-207 kernel: [34516.602269] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 14:59:02 juju-e4d256-prod-github-runner-207 kernel: [34516.603196] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 14:59:02 juju-e4d256-prod-github-runner-207 kernel: [34516.604101] vcpu_run+0x62/0x2c0 [kvm] Aug 22 14:59:02 juju-e4d256-prod-github-runner-207 kernel: [34516.604924] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 14:59:02 juju-e4d256-prod-github-runner-207 kernel: [34516.605737] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 14:59:02 juju-e4d256-prod-github-runner-207 kernel: [34516.606596] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 14:59:02 juju-e4d256-prod-github-runner-207 kernel: [34516.607393] ? __seccomp_filter+0x4a/0x4a0 Aug 22 14:59:02 juju-e4d256-prod-github-runner-207 kernel: [34516.608136] ? __fget_files+0x86/0xc0 Aug 22 14:59:02 juju-e4d256-prod-github-runner-207 kernel: [34516.608848] __x64_sys_ioctl+0x95/0xd0 Aug 22 14:59:02 juju-e4d256-prod-github-runner-207 kernel: [34516.609571] do_syscall_64+0x5c/0xc0 Aug 22 14:59:02 juju-e4d256-prod-github-runner-207 kernel: [34516.610251] ? do_futex+0x162/0x1f0 Aug 22 14:59:02 juju-e4d256-prod-github-runner-207 kernel: [34516.610900] ? __x64_sys_futex+0x78/0x1e0 Aug 22 14:59:02 juju-e4d256-prod-github-runner-207 kernel: [34516.611589] ? __secure_computing+0xa9/0x120 Aug 22 14:59:02 juju-e4d256-prod-github-runner-207 kernel: [34516.612304] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 14:59:02 juju-e4d256-prod-github-runner-207 kernel: [34516.613070] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:59:02 juju-e4d256-prod-github-runner-207 kernel: [34516.613797] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:59:02 juju-e4d256-prod-github-runner-207 kernel: [34516.614534] ? do_syscall_64+0x69/0xc0 Aug 22 14:59:02 juju-e4d256-prod-github-runner-207 kernel: [34516.615203] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:59:02 juju-e4d256-prod-github-runner-207 kernel: [34516.615909] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:59:02 juju-e4d256-prod-github-runner-207 kernel: [34516.616618] ? do_syscall_64+0x69/0xc0 Aug 22 14:59:02 juju-e4d256-prod-github-runner-207 kernel: [34516.617252] ? do_syscall_64+0x69/0xc0 Aug 22 14:59:02 juju-e4d256-prod-github-runner-207 kernel: [34516.617908] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 14:59:02 juju-e4d256-prod-github-runner-207 kernel: [34516.618611] RIP: 0033:0x7faa5d0edaff Aug 22 14:59:02 juju-e4d256-prod-github-runner-207 kernel: [34516.619263] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 14:59:02 juju-e4d256-prod-github-runner-207 kernel: [34516.621262] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 14:59:02 juju-e4d256-prod-github-runner-207 kernel: [34516.622177] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 14:59:02 juju-e4d256-prod-github-runner-207 kernel: [34516.623069] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 14:59:02 juju-e4d256-prod-github-runner-207 kernel: [34516.623964] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 14:59:02 juju-e4d256-prod-github-runner-207 kernel: [34516.624861] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 14:59:02 juju-e4d256-prod-github-runner-207 kernel: [34516.625758] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 14:59:02 juju-e4d256-prod-github-runner-207 kernel: [34516.626650] Aug 22 14:59:30 juju-e4d256-prod-github-runner-207 kernel: [34544.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 32064s! [qemu-system-x86:6715] Aug 22 14:59:30 juju-e4d256-prod-github-runner-207 kernel: [34544.543276] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 14:59:30 juju-e4d256-prod-github-runner-207 kernel: [34544.543351] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 14:59:30 juju-e4d256-prod-github-runner-207 kernel: [34544.555499] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 14:59:30 juju-e4d256-prod-github-runner-207 kernel: [34544.556773] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 14:59:30 juju-e4d256-prod-github-runner-207 kernel: [34544.557999] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:59:30 juju-e4d256-prod-github-runner-207 kernel: [34544.559063] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 14:59:30 juju-e4d256-prod-github-runner-207 kernel: [34544.561712] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 14:59:30 juju-e4d256-prod-github-runner-207 kernel: [34544.562753] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 14:59:30 juju-e4d256-prod-github-runner-207 kernel: [34544.563935] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 14:59:30 juju-e4d256-prod-github-runner-207 kernel: [34544.565098] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 14:59:30 juju-e4d256-prod-github-runner-207 kernel: [34544.566259] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 14:59:30 juju-e4d256-prod-github-runner-207 kernel: [34544.567419] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 14:59:30 juju-e4d256-prod-github-runner-207 kernel: [34544.568597] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 14:59:30 juju-e4d256-prod-github-runner-207 kernel: [34544.569832] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 14:59:30 juju-e4d256-prod-github-runner-207 kernel: [34544.570934] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 14:59:30 juju-e4d256-prod-github-runner-207 kernel: [34544.572137] Call Trace: Aug 22 14:59:30 juju-e4d256-prod-github-runner-207 kernel: [34544.573047] Aug 22 14:59:30 juju-e4d256-prod-github-runner-207 kernel: [34544.573930] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:59:30 juju-e4d256-prod-github-runner-207 kernel: [34544.574958] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 14:59:30 juju-e4d256-prod-github-runner-207 kernel: [34544.575987] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:59:30 juju-e4d256-prod-github-runner-207 kernel: [34544.577064] ? show_regs.part.0+0x23/0x29 Aug 22 14:59:30 juju-e4d256-prod-github-runner-207 kernel: [34544.578060] ? show_regs.cold+0x8/0xd Aug 22 14:59:30 juju-e4d256-prod-github-runner-207 kernel: [34544.579029] ? watchdog_timer_fn+0x1be/0x220 Aug 22 14:59:30 juju-e4d256-prod-github-runner-207 kernel: [34544.580057] ? lockup_detector_update_enable+0x60/0x60 Aug 22 14:59:30 juju-e4d256-prod-github-runner-207 kernel: [34544.581120] ? __hrtimer_run_queues+0x107/0x230 Aug 22 14:59:30 juju-e4d256-prod-github-runner-207 kernel: [34544.582148] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 14:59:30 juju-e4d256-prod-github-runner-207 kernel: [34544.583170] ? hrtimer_interrupt+0x101/0x220 Aug 22 14:59:30 juju-e4d256-prod-github-runner-207 kernel: [34544.584193] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 14:59:30 juju-e4d256-prod-github-runner-207 kernel: [34544.585274] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 14:59:30 juju-e4d256-prod-github-runner-207 kernel: [34544.586357] Aug 22 14:59:30 juju-e4d256-prod-github-runner-207 kernel: [34544.587363] Aug 22 14:59:30 juju-e4d256-prod-github-runner-207 kernel: [34544.588358] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 14:59:30 juju-e4d256-prod-github-runner-207 kernel: [34544.589409] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:59:30 juju-e4d256-prod-github-runner-207 kernel: [34544.590451] ? _raw_spin_lock+0x22/0x30 Aug 22 14:59:30 juju-e4d256-prod-github-runner-207 kernel: [34544.591395] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:59:30 juju-e4d256-prod-github-runner-207 kernel: [34544.592431] direct_page_fault+0x206/0x310 [kvm] Aug 22 14:59:30 juju-e4d256-prod-github-runner-207 kernel: [34544.593457] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 14:59:30 juju-e4d256-prod-github-runner-207 kernel: [34544.594465] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 14:59:30 juju-e4d256-prod-github-runner-207 kernel: [34544.595464] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 14:59:30 juju-e4d256-prod-github-runner-207 kernel: [34544.596452] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 14:59:30 juju-e4d256-prod-github-runner-207 kernel: [34544.597398] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 14:59:30 juju-e4d256-prod-github-runner-207 kernel: [34544.598375] handle_exit+0x98/0x230 [kvm_amd] Aug 22 14:59:30 juju-e4d256-prod-github-runner-207 kernel: [34544.599266] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 14:59:30 juju-e4d256-prod-github-runner-207 kernel: [34544.600196] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 14:59:30 juju-e4d256-prod-github-runner-207 kernel: [34544.601123] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 14:59:30 juju-e4d256-prod-github-runner-207 kernel: [34544.602027] vcpu_run+0x62/0x2c0 [kvm] Aug 22 14:59:30 juju-e4d256-prod-github-runner-207 kernel: [34544.602846] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 14:59:30 juju-e4d256-prod-github-runner-207 kernel: [34544.603657] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 14:59:30 juju-e4d256-prod-github-runner-207 kernel: [34544.604529] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 14:59:30 juju-e4d256-prod-github-runner-207 kernel: [34544.605327] ? __seccomp_filter+0x4a/0x4a0 Aug 22 14:59:30 juju-e4d256-prod-github-runner-207 kernel: [34544.606075] ? __fget_files+0x86/0xc0 Aug 22 14:59:30 juju-e4d256-prod-github-runner-207 kernel: [34544.606778] __x64_sys_ioctl+0x95/0xd0 Aug 22 14:59:30 juju-e4d256-prod-github-runner-207 kernel: [34544.607468] do_syscall_64+0x5c/0xc0 Aug 22 14:59:30 juju-e4d256-prod-github-runner-207 kernel: [34544.608144] ? do_futex+0x162/0x1f0 Aug 22 14:59:30 juju-e4d256-prod-github-runner-207 kernel: [34544.608798] ? __x64_sys_futex+0x78/0x1e0 Aug 22 14:59:30 juju-e4d256-prod-github-runner-207 kernel: [34544.609471] ? __secure_computing+0xa9/0x120 Aug 22 14:59:30 juju-e4d256-prod-github-runner-207 kernel: [34544.610159] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 14:59:30 juju-e4d256-prod-github-runner-207 kernel: [34544.610920] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:59:30 juju-e4d256-prod-github-runner-207 kernel: [34544.611648] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:59:30 juju-e4d256-prod-github-runner-207 kernel: [34544.612378] ? do_syscall_64+0x69/0xc0 Aug 22 14:59:30 juju-e4d256-prod-github-runner-207 kernel: [34544.613023] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:59:30 juju-e4d256-prod-github-runner-207 kernel: [34544.613725] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:59:30 juju-e4d256-prod-github-runner-207 kernel: [34544.614418] ? do_syscall_64+0x69/0xc0 Aug 22 14:59:30 juju-e4d256-prod-github-runner-207 kernel: [34544.615042] ? do_syscall_64+0x69/0xc0 Aug 22 14:59:30 juju-e4d256-prod-github-runner-207 kernel: [34544.615662] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 14:59:30 juju-e4d256-prod-github-runner-207 kernel: [34544.616383] RIP: 0033:0x7faa5d0edaff Aug 22 14:59:30 juju-e4d256-prod-github-runner-207 kernel: [34544.617025] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 14:59:30 juju-e4d256-prod-github-runner-207 kernel: [34544.619072] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 14:59:30 juju-e4d256-prod-github-runner-207 kernel: [34544.620082] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 14:59:30 juju-e4d256-prod-github-runner-207 kernel: [34544.620997] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 14:59:30 juju-e4d256-prod-github-runner-207 kernel: [34544.621885] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 14:59:30 juju-e4d256-prod-github-runner-207 kernel: [34544.622770] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 14:59:30 juju-e4d256-prod-github-runner-207 kernel: [34544.623659] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 14:59:30 juju-e4d256-prod-github-runner-207 kernel: [34544.624575] Aug 22 14:59:45 juju-e4d256-prod-github-runner-207 kernel: [34559.492705] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 14:59:45 juju-e4d256-prod-github-runner-207 kernel: [34559.493681] rcu: 1-....: (8583605 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=4146830 Aug 22 14:59:45 juju-e4d256-prod-github-runner-207 kernel: [34559.494819] (t=8610573 jiffies g=23269 q=36773) Aug 22 14:59:45 juju-e4d256-prod-github-runner-207 kernel: [34559.495601] NMI backtrace for cpu 1 Aug 22 14:59:45 juju-e4d256-prod-github-runner-207 kernel: [34559.496326] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 14:59:45 juju-e4d256-prod-github-runner-207 kernel: [34559.497431] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 14:59:45 juju-e4d256-prod-github-runner-207 kernel: [34559.498725] Call Trace: Aug 22 14:59:45 juju-e4d256-prod-github-runner-207 kernel: [34559.499443] Aug 22 14:59:45 juju-e4d256-prod-github-runner-207 kernel: [34559.500106] show_stack+0x52/0x5c Aug 22 14:59:45 juju-e4d256-prod-github-runner-207 kernel: [34559.500831] dump_stack_lvl+0x4a/0x63 Aug 22 14:59:45 juju-e4d256-prod-github-runner-207 kernel: [34559.501634] dump_stack+0x10/0x16 Aug 22 14:59:45 juju-e4d256-prod-github-runner-207 kernel: [34559.502447] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 14:59:45 juju-e4d256-prod-github-runner-207 kernel: [34559.503271] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 14:59:45 juju-e4d256-prod-github-runner-207 kernel: [34559.504069] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 14:59:45 juju-e4d256-prod-github-runner-207 kernel: [34559.504943] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 14:59:45 juju-e4d256-prod-github-runner-207 kernel: [34559.505778] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 14:59:45 juju-e4d256-prod-github-runner-207 kernel: [34559.506592] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 14:59:45 juju-e4d256-prod-github-runner-207 kernel: [34559.507381] print_cpu_stall.cold+0x2f/0xe2 Aug 22 14:59:45 juju-e4d256-prod-github-runner-207 kernel: [34559.508197] ? timekeeping_update+0xf7/0x150 Aug 22 14:59:45 juju-e4d256-prod-github-runner-207 kernel: [34559.508975] check_cpu_stall+0x109/0x270 Aug 22 14:59:45 juju-e4d256-prod-github-runner-207 kernel: [34559.509725] rcu_sched_clock_irq+0x9a/0x250 Aug 22 14:59:45 juju-e4d256-prod-github-runner-207 kernel: [34559.510524] update_process_times+0x94/0xd0 Aug 22 14:59:45 juju-e4d256-prod-github-runner-207 kernel: [34559.511293] tick_sched_handle+0x29/0x70 Aug 22 14:59:45 juju-e4d256-prod-github-runner-207 kernel: [34559.512085] tick_sched_timer+0x8c/0xc0 Aug 22 14:59:45 juju-e4d256-prod-github-runner-207 kernel: [34559.512837] ? tick_nohz_handler+0xb0/0xb0 Aug 22 14:59:45 juju-e4d256-prod-github-runner-207 kernel: [34559.513601] __hrtimer_run_queues+0x107/0x230 Aug 22 14:59:45 juju-e4d256-prod-github-runner-207 kernel: [34559.514374] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 14:59:45 juju-e4d256-prod-github-runner-207 kernel: [34559.515167] hrtimer_interrupt+0x101/0x220 Aug 22 14:59:45 juju-e4d256-prod-github-runner-207 kernel: [34559.515958] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 14:59:45 juju-e4d256-prod-github-runner-207 kernel: [34559.516870] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 14:59:45 juju-e4d256-prod-github-runner-207 kernel: [34559.517691] Aug 22 14:59:45 juju-e4d256-prod-github-runner-207 kernel: [34559.518358] Aug 22 14:59:45 juju-e4d256-prod-github-runner-207 kernel: [34559.518986] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 14:59:45 juju-e4d256-prod-github-runner-207 kernel: [34559.519830] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 14:59:45 juju-e4d256-prod-github-runner-207 kernel: [34559.520710] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 14:59:45 juju-e4d256-prod-github-runner-207 kernel: [34559.522953] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 14:59:45 juju-e4d256-prod-github-runner-207 kernel: [34559.523842] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 14:59:45 juju-e4d256-prod-github-runner-207 kernel: [34559.524843] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 14:59:45 juju-e4d256-prod-github-runner-207 kernel: [34559.525817] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 14:59:45 juju-e4d256-prod-github-runner-207 kernel: [34559.526775] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 14:59:45 juju-e4d256-prod-github-runner-207 kernel: [34559.527746] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 14:59:45 juju-e4d256-prod-github-runner-207 kernel: [34559.528699] ? _raw_spin_lock+0x22/0x30 Aug 22 14:59:45 juju-e4d256-prod-github-runner-207 kernel: [34559.529499] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 14:59:45 juju-e4d256-prod-github-runner-207 kernel: [34559.530372] direct_page_fault+0x206/0x310 [kvm] Aug 22 14:59:45 juju-e4d256-prod-github-runner-207 kernel: [34559.531232] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 14:59:45 juju-e4d256-prod-github-runner-207 kernel: [34559.532105] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 14:59:45 juju-e4d256-prod-github-runner-207 kernel: [34559.532953] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 14:59:45 juju-e4d256-prod-github-runner-207 kernel: [34559.533766] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 14:59:45 juju-e4d256-prod-github-runner-207 kernel: [34559.534564] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 14:59:45 juju-e4d256-prod-github-runner-207 kernel: [34559.535394] handle_exit+0x98/0x230 [kvm_amd] Aug 22 14:59:45 juju-e4d256-prod-github-runner-207 kernel: [34559.536167] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 14:59:45 juju-e4d256-prod-github-runner-207 kernel: [34559.536957] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 14:59:45 juju-e4d256-prod-github-runner-207 kernel: [34559.537770] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 14:59:45 juju-e4d256-prod-github-runner-207 kernel: [34559.538555] vcpu_run+0x62/0x2c0 [kvm] Aug 22 14:59:45 juju-e4d256-prod-github-runner-207 kernel: [34559.539268] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 14:59:45 juju-e4d256-prod-github-runner-207 kernel: [34559.540008] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 14:59:45 juju-e4d256-prod-github-runner-207 kernel: [34559.540806] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 14:59:45 juju-e4d256-prod-github-runner-207 kernel: [34559.541564] ? __seccomp_filter+0x4a/0x4a0 Aug 22 14:59:45 juju-e4d256-prod-github-runner-207 kernel: [34559.542317] ? __fget_files+0x86/0xc0 Aug 22 14:59:45 juju-e4d256-prod-github-runner-207 kernel: [34559.543020] __x64_sys_ioctl+0x95/0xd0 Aug 22 14:59:45 juju-e4d256-prod-github-runner-207 kernel: [34559.543760] do_syscall_64+0x5c/0xc0 Aug 22 14:59:45 juju-e4d256-prod-github-runner-207 kernel: [34559.544463] ? do_futex+0x162/0x1f0 Aug 22 14:59:45 juju-e4d256-prod-github-runner-207 kernel: [34559.545147] ? __x64_sys_futex+0x78/0x1e0 Aug 22 14:59:45 juju-e4d256-prod-github-runner-207 kernel: [34559.545851] ? __secure_computing+0xa9/0x120 Aug 22 14:59:45 juju-e4d256-prod-github-runner-207 kernel: [34559.546570] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 14:59:45 juju-e4d256-prod-github-runner-207 kernel: [34559.547358] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:59:45 juju-e4d256-prod-github-runner-207 kernel: [34559.548139] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:59:45 juju-e4d256-prod-github-runner-207 kernel: [34559.548894] ? do_syscall_64+0x69/0xc0 Aug 22 14:59:45 juju-e4d256-prod-github-runner-207 kernel: [34559.549596] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 14:59:45 juju-e4d256-prod-github-runner-207 kernel: [34559.550353] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 14:59:45 juju-e4d256-prod-github-runner-207 kernel: [34559.551150] ? do_syscall_64+0x69/0xc0 Aug 22 14:59:45 juju-e4d256-prod-github-runner-207 kernel: [34559.551871] ? do_syscall_64+0x69/0xc0 Aug 22 14:59:45 juju-e4d256-prod-github-runner-207 kernel: [34559.552558] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 14:59:45 juju-e4d256-prod-github-runner-207 kernel: [34559.553326] RIP: 0033:0x7faa5d0edaff Aug 22 14:59:45 juju-e4d256-prod-github-runner-207 kernel: [34559.554015] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 14:59:45 juju-e4d256-prod-github-runner-207 kernel: [34559.556159] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 14:59:45 juju-e4d256-prod-github-runner-207 kernel: [34559.557124] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 14:59:45 juju-e4d256-prod-github-runner-207 kernel: [34559.558069] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 14:59:45 juju-e4d256-prod-github-runner-207 kernel: [34559.559014] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 14:59:45 juju-e4d256-prod-github-runner-207 kernel: [34559.559958] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 14:59:45 juju-e4d256-prod-github-runner-207 kernel: [34559.560882] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 14:59:45 juju-e4d256-prod-github-runner-207 kernel: [34559.561819] Aug 22 15:00:10 juju-e4d256-prod-github-runner-207 kernel: [34584.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 32101s! [qemu-system-x86:6715] Aug 22 15:00:10 juju-e4d256-prod-github-runner-207 kernel: [34584.543158] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 15:00:10 juju-e4d256-prod-github-runner-207 kernel: [34584.543234] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 15:00:10 juju-e4d256-prod-github-runner-207 kernel: [34584.556682] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 15:00:10 juju-e4d256-prod-github-runner-207 kernel: [34584.558243] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 15:00:10 juju-e4d256-prod-github-runner-207 kernel: [34584.559534] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:00:10 juju-e4d256-prod-github-runner-207 kernel: [34584.560610] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 15:00:10 juju-e4d256-prod-github-runner-207 kernel: [34584.563180] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 15:00:10 juju-e4d256-prod-github-runner-207 kernel: [34584.564239] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 15:00:10 juju-e4d256-prod-github-runner-207 kernel: [34584.565406] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 15:00:10 juju-e4d256-prod-github-runner-207 kernel: [34584.566568] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 15:00:10 juju-e4d256-prod-github-runner-207 kernel: [34584.567746] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 15:00:10 juju-e4d256-prod-github-runner-207 kernel: [34584.568909] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 15:00:10 juju-e4d256-prod-github-runner-207 kernel: [34584.570081] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 15:00:10 juju-e4d256-prod-github-runner-207 kernel: [34584.571321] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 15:00:10 juju-e4d256-prod-github-runner-207 kernel: [34584.572450] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 15:00:10 juju-e4d256-prod-github-runner-207 kernel: [34584.573671] Call Trace: Aug 22 15:00:10 juju-e4d256-prod-github-runner-207 kernel: [34584.574594] Aug 22 15:00:10 juju-e4d256-prod-github-runner-207 kernel: [34584.575500] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:00:10 juju-e4d256-prod-github-runner-207 kernel: [34584.576601] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:00:10 juju-e4d256-prod-github-runner-207 kernel: [34584.577634] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:00:10 juju-e4d256-prod-github-runner-207 kernel: [34584.578712] ? show_regs.part.0+0x23/0x29 Aug 22 15:00:10 juju-e4d256-prod-github-runner-207 kernel: [34584.579737] ? show_regs.cold+0x8/0xd Aug 22 15:00:10 juju-e4d256-prod-github-runner-207 kernel: [34584.580713] ? watchdog_timer_fn+0x1be/0x220 Aug 22 15:00:10 juju-e4d256-prod-github-runner-207 kernel: [34584.581721] ? lockup_detector_update_enable+0x60/0x60 Aug 22 15:00:10 juju-e4d256-prod-github-runner-207 kernel: [34584.582810] ? __hrtimer_run_queues+0x107/0x230 Aug 22 15:00:10 juju-e4d256-prod-github-runner-207 kernel: [34584.583860] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 15:00:10 juju-e4d256-prod-github-runner-207 kernel: [34584.584886] ? hrtimer_interrupt+0x101/0x220 Aug 22 15:00:10 juju-e4d256-prod-github-runner-207 kernel: [34584.585900] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 15:00:10 juju-e4d256-prod-github-runner-207 kernel: [34584.586966] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 15:00:10 juju-e4d256-prod-github-runner-207 kernel: [34584.588024] Aug 22 15:00:10 juju-e4d256-prod-github-runner-207 kernel: [34584.588880] Aug 22 15:00:10 juju-e4d256-prod-github-runner-207 kernel: [34584.589717] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 15:00:10 juju-e4d256-prod-github-runner-207 kernel: [34584.590748] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:00:10 juju-e4d256-prod-github-runner-207 kernel: [34584.591801] ? _raw_spin_lock+0x22/0x30 Aug 22 15:00:10 juju-e4d256-prod-github-runner-207 kernel: [34584.592747] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:00:10 juju-e4d256-prod-github-runner-207 kernel: [34584.593761] direct_page_fault+0x206/0x310 [kvm] Aug 22 15:00:10 juju-e4d256-prod-github-runner-207 kernel: [34584.594783] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 15:00:10 juju-e4d256-prod-github-runner-207 kernel: [34584.595800] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 15:00:10 juju-e4d256-prod-github-runner-207 kernel: [34584.596806] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 15:00:10 juju-e4d256-prod-github-runner-207 kernel: [34584.597777] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 15:00:10 juju-e4d256-prod-github-runner-207 kernel: [34584.598722] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 15:00:10 juju-e4d256-prod-github-runner-207 kernel: [34584.599753] handle_exit+0x98/0x230 [kvm_amd] Aug 22 15:00:10 juju-e4d256-prod-github-runner-207 kernel: [34584.600658] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 15:00:10 juju-e4d256-prod-github-runner-207 kernel: [34584.601577] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 15:00:10 juju-e4d256-prod-github-runner-207 kernel: [34584.602601] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 15:00:10 juju-e4d256-prod-github-runner-207 kernel: [34584.603561] vcpu_run+0x62/0x2c0 [kvm] Aug 22 15:00:10 juju-e4d256-prod-github-runner-207 kernel: [34584.604404] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 15:00:10 juju-e4d256-prod-github-runner-207 kernel: [34584.605270] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 15:00:10 juju-e4d256-prod-github-runner-207 kernel: [34584.606127] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 15:00:10 juju-e4d256-prod-github-runner-207 kernel: [34584.606955] ? __seccomp_filter+0x4a/0x4a0 Aug 22 15:00:10 juju-e4d256-prod-github-runner-207 kernel: [34584.607719] ? __fget_files+0x86/0xc0 Aug 22 15:00:10 juju-e4d256-prod-github-runner-207 kernel: [34584.608437] __x64_sys_ioctl+0x95/0xd0 Aug 22 15:00:10 juju-e4d256-prod-github-runner-207 kernel: [34584.609130] do_syscall_64+0x5c/0xc0 Aug 22 15:00:10 juju-e4d256-prod-github-runner-207 kernel: [34584.609811] ? do_futex+0x162/0x1f0 Aug 22 15:00:10 juju-e4d256-prod-github-runner-207 kernel: [34584.610463] ? __x64_sys_futex+0x78/0x1e0 Aug 22 15:00:10 juju-e4d256-prod-github-runner-207 kernel: [34584.611137] ? __secure_computing+0xa9/0x120 Aug 22 15:00:10 juju-e4d256-prod-github-runner-207 kernel: [34584.611841] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 15:00:10 juju-e4d256-prod-github-runner-207 kernel: [34584.612603] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:00:10 juju-e4d256-prod-github-runner-207 kernel: [34584.613329] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:00:10 juju-e4d256-prod-github-runner-207 kernel: [34584.614060] ? do_syscall_64+0x69/0xc0 Aug 22 15:00:10 juju-e4d256-prod-github-runner-207 kernel: [34584.614788] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:00:10 juju-e4d256-prod-github-runner-207 kernel: [34584.615565] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:00:10 juju-e4d256-prod-github-runner-207 kernel: [34584.616303] ? do_syscall_64+0x69/0xc0 Aug 22 15:00:10 juju-e4d256-prod-github-runner-207 kernel: [34584.616956] ? do_syscall_64+0x69/0xc0 Aug 22 15:00:10 juju-e4d256-prod-github-runner-207 kernel: [34584.617613] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 15:00:10 juju-e4d256-prod-github-runner-207 kernel: [34584.618327] RIP: 0033:0x7faa5d0edaff Aug 22 15:00:10 juju-e4d256-prod-github-runner-207 kernel: [34584.618951] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 15:00:10 juju-e4d256-prod-github-runner-207 kernel: [34584.620956] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 15:00:10 juju-e4d256-prod-github-runner-207 kernel: [34584.621872] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 15:00:10 juju-e4d256-prod-github-runner-207 kernel: [34584.622761] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 15:00:10 juju-e4d256-prod-github-runner-207 kernel: [34584.623699] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 15:00:10 juju-e4d256-prod-github-runner-207 kernel: [34584.624599] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 15:00:10 juju-e4d256-prod-github-runner-207 kernel: [34584.625485] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 15:00:10 juju-e4d256-prod-github-runner-207 kernel: [34584.626412] Aug 22 15:00:38 juju-e4d256-prod-github-runner-207 kernel: [34612.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 32127s! [qemu-system-x86:6715] Aug 22 15:00:38 juju-e4d256-prod-github-runner-207 kernel: [34612.543881] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 15:00:38 juju-e4d256-prod-github-runner-207 kernel: [34612.544179] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 15:00:38 juju-e4d256-prod-github-runner-207 kernel: [34612.556675] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 15:00:38 juju-e4d256-prod-github-runner-207 kernel: [34612.557977] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 15:00:38 juju-e4d256-prod-github-runner-207 kernel: [34612.559258] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:00:38 juju-e4d256-prod-github-runner-207 kernel: [34612.560366] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 15:00:38 juju-e4d256-prod-github-runner-207 kernel: [34612.562986] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 15:00:38 juju-e4d256-prod-github-runner-207 kernel: [34612.564075] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 15:00:38 juju-e4d256-prod-github-runner-207 kernel: [34612.565263] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 15:00:38 juju-e4d256-prod-github-runner-207 kernel: [34612.566509] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 15:00:38 juju-e4d256-prod-github-runner-207 kernel: [34612.567759] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 15:00:38 juju-e4d256-prod-github-runner-207 kernel: [34612.568951] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 15:00:38 juju-e4d256-prod-github-runner-207 kernel: [34612.570141] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 15:00:38 juju-e4d256-prod-github-runner-207 kernel: [34612.571430] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 15:00:38 juju-e4d256-prod-github-runner-207 kernel: [34612.572559] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 15:00:38 juju-e4d256-prod-github-runner-207 kernel: [34612.573772] Call Trace: Aug 22 15:00:38 juju-e4d256-prod-github-runner-207 kernel: [34612.574691] Aug 22 15:00:38 juju-e4d256-prod-github-runner-207 kernel: [34612.575607] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:00:38 juju-e4d256-prod-github-runner-207 kernel: [34612.576656] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:00:38 juju-e4d256-prod-github-runner-207 kernel: [34612.577695] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:00:38 juju-e4d256-prod-github-runner-207 kernel: [34612.578812] ? show_regs.part.0+0x23/0x29 Aug 22 15:00:38 juju-e4d256-prod-github-runner-207 kernel: [34612.579836] ? show_regs.cold+0x8/0xd Aug 22 15:00:38 juju-e4d256-prod-github-runner-207 kernel: [34612.580818] ? watchdog_timer_fn+0x1be/0x220 Aug 22 15:00:38 juju-e4d256-prod-github-runner-207 kernel: [34612.581839] ? lockup_detector_update_enable+0x60/0x60 Aug 22 15:00:38 juju-e4d256-prod-github-runner-207 kernel: [34612.582917] ? __hrtimer_run_queues+0x107/0x230 Aug 22 15:00:38 juju-e4d256-prod-github-runner-207 kernel: [34612.583967] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 15:00:38 juju-e4d256-prod-github-runner-207 kernel: [34612.585063] ? hrtimer_interrupt+0x101/0x220 Aug 22 15:00:38 juju-e4d256-prod-github-runner-207 kernel: [34612.586301] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 15:00:38 juju-e4d256-prod-github-runner-207 kernel: [34612.587416] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 15:00:38 juju-e4d256-prod-github-runner-207 kernel: [34612.588481] Aug 22 15:00:38 juju-e4d256-prod-github-runner-207 kernel: [34612.589352] Aug 22 15:00:38 juju-e4d256-prod-github-runner-207 kernel: [34612.590202] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 15:00:38 juju-e4d256-prod-github-runner-207 kernel: [34612.591268] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:00:38 juju-e4d256-prod-github-runner-207 kernel: [34612.592327] ? _raw_spin_lock+0x22/0x30 Aug 22 15:00:38 juju-e4d256-prod-github-runner-207 kernel: [34612.593285] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:00:38 juju-e4d256-prod-github-runner-207 kernel: [34612.594317] direct_page_fault+0x206/0x310 [kvm] Aug 22 15:00:38 juju-e4d256-prod-github-runner-207 kernel: [34612.595371] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 15:00:38 juju-e4d256-prod-github-runner-207 kernel: [34612.596399] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 15:00:38 juju-e4d256-prod-github-runner-207 kernel: [34612.597417] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 15:00:38 juju-e4d256-prod-github-runner-207 kernel: [34612.598453] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 15:00:38 juju-e4d256-prod-github-runner-207 kernel: [34612.599412] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 15:00:38 juju-e4d256-prod-github-runner-207 kernel: [34612.600412] handle_exit+0x98/0x230 [kvm_amd] Aug 22 15:00:38 juju-e4d256-prod-github-runner-207 kernel: [34612.601330] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 15:00:38 juju-e4d256-prod-github-runner-207 kernel: [34612.602270] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 15:00:38 juju-e4d256-prod-github-runner-207 kernel: [34612.603227] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 15:00:38 juju-e4d256-prod-github-runner-207 kernel: [34612.604152] vcpu_run+0x62/0x2c0 [kvm] Aug 22 15:00:38 juju-e4d256-prod-github-runner-207 kernel: [34612.604977] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 15:00:38 juju-e4d256-prod-github-runner-207 kernel: [34612.605807] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 15:00:38 juju-e4d256-prod-github-runner-207 kernel: [34612.606686] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 15:00:38 juju-e4d256-prod-github-runner-207 kernel: [34612.607503] ? __seccomp_filter+0x4a/0x4a0 Aug 22 15:00:38 juju-e4d256-prod-github-runner-207 kernel: [34612.608262] ? __fget_files+0x86/0xc0 Aug 22 15:00:38 juju-e4d256-prod-github-runner-207 kernel: [34612.608983] __x64_sys_ioctl+0x95/0xd0 Aug 22 15:00:38 juju-e4d256-prod-github-runner-207 kernel: [34612.609695] do_syscall_64+0x5c/0xc0 Aug 22 15:00:38 juju-e4d256-prod-github-runner-207 kernel: [34612.610373] ? do_futex+0x162/0x1f0 Aug 22 15:00:38 juju-e4d256-prod-github-runner-207 kernel: [34612.611035] ? __x64_sys_futex+0x78/0x1e0 Aug 22 15:00:38 juju-e4d256-prod-github-runner-207 kernel: [34612.611736] ? __secure_computing+0xa9/0x120 Aug 22 15:00:38 juju-e4d256-prod-github-runner-207 kernel: [34612.612439] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 15:00:38 juju-e4d256-prod-github-runner-207 kernel: [34612.613220] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:00:38 juju-e4d256-prod-github-runner-207 kernel: [34612.613960] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:00:38 juju-e4d256-prod-github-runner-207 kernel: [34612.614694] ? do_syscall_64+0x69/0xc0 Aug 22 15:00:38 juju-e4d256-prod-github-runner-207 kernel: [34612.615361] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:00:38 juju-e4d256-prod-github-runner-207 kernel: [34612.616086] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:00:38 juju-e4d256-prod-github-runner-207 kernel: [34612.616800] ? do_syscall_64+0x69/0xc0 Aug 22 15:00:38 juju-e4d256-prod-github-runner-207 kernel: [34612.617438] ? do_syscall_64+0x69/0xc0 Aug 22 15:00:38 juju-e4d256-prod-github-runner-207 kernel: [34612.618076] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 15:00:38 juju-e4d256-prod-github-runner-207 kernel: [34612.618801] RIP: 0033:0x7faa5d0edaff Aug 22 15:00:38 juju-e4d256-prod-github-runner-207 kernel: [34612.619491] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 15:00:38 juju-e4d256-prod-github-runner-207 kernel: [34612.621550] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 15:00:38 juju-e4d256-prod-github-runner-207 kernel: [34612.622484] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 15:00:38 juju-e4d256-prod-github-runner-207 kernel: [34612.623407] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 15:00:38 juju-e4d256-prod-github-runner-207 kernel: [34612.624380] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 15:00:38 juju-e4d256-prod-github-runner-207 kernel: [34612.625365] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 15:00:38 juju-e4d256-prod-github-runner-207 kernel: [34612.626328] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 15:00:38 juju-e4d256-prod-github-runner-207 kernel: [34612.627307] Aug 22 15:01:06 juju-e4d256-prod-github-runner-207 kernel: [34640.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 32153s! [qemu-system-x86:6715] Aug 22 15:01:06 juju-e4d256-prod-github-runner-207 kernel: [34640.543129] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 15:01:06 juju-e4d256-prod-github-runner-207 kernel: [34640.543205] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 15:01:06 juju-e4d256-prod-github-runner-207 kernel: [34640.555369] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 15:01:06 juju-e4d256-prod-github-runner-207 kernel: [34640.556649] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 15:01:06 juju-e4d256-prod-github-runner-207 kernel: [34640.557862] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:01:06 juju-e4d256-prod-github-runner-207 kernel: [34640.558949] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 15:01:06 juju-e4d256-prod-github-runner-207 kernel: [34640.561478] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 15:01:06 juju-e4d256-prod-github-runner-207 kernel: [34640.562521] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 15:01:06 juju-e4d256-prod-github-runner-207 kernel: [34640.563699] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 15:01:06 juju-e4d256-prod-github-runner-207 kernel: [34640.564870] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 15:01:06 juju-e4d256-prod-github-runner-207 kernel: [34640.566023] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 15:01:06 juju-e4d256-prod-github-runner-207 kernel: [34640.567247] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 15:01:06 juju-e4d256-prod-github-runner-207 kernel: [34640.568435] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 15:01:06 juju-e4d256-prod-github-runner-207 kernel: [34640.569670] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 15:01:06 juju-e4d256-prod-github-runner-207 kernel: [34640.570796] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 15:01:06 juju-e4d256-prod-github-runner-207 kernel: [34640.571995] Call Trace: Aug 22 15:01:06 juju-e4d256-prod-github-runner-207 kernel: [34640.572906] Aug 22 15:01:06 juju-e4d256-prod-github-runner-207 kernel: [34640.573794] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:01:06 juju-e4d256-prod-github-runner-207 kernel: [34640.574841] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:01:06 juju-e4d256-prod-github-runner-207 kernel: [34640.575866] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:01:06 juju-e4d256-prod-github-runner-207 kernel: [34640.576938] ? show_regs.part.0+0x23/0x29 Aug 22 15:01:06 juju-e4d256-prod-github-runner-207 kernel: [34640.577964] ? show_regs.cold+0x8/0xd Aug 22 15:01:06 juju-e4d256-prod-github-runner-207 kernel: [34640.579052] ? watchdog_timer_fn+0x1be/0x220 Aug 22 15:01:06 juju-e4d256-prod-github-runner-207 kernel: [34640.580063] ? lockup_detector_update_enable+0x60/0x60 Aug 22 15:01:06 juju-e4d256-prod-github-runner-207 kernel: [34640.581127] ? __hrtimer_run_queues+0x107/0x230 Aug 22 15:01:06 juju-e4d256-prod-github-runner-207 kernel: [34640.582179] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 15:01:06 juju-e4d256-prod-github-runner-207 kernel: [34640.583253] ? hrtimer_interrupt+0x101/0x220 Aug 22 15:01:06 juju-e4d256-prod-github-runner-207 kernel: [34640.584287] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 15:01:06 juju-e4d256-prod-github-runner-207 kernel: [34640.585376] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 15:01:06 juju-e4d256-prod-github-runner-207 kernel: [34640.586453] Aug 22 15:01:06 juju-e4d256-prod-github-runner-207 kernel: [34640.587321] Aug 22 15:01:06 juju-e4d256-prod-github-runner-207 kernel: [34640.588198] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 15:01:06 juju-e4d256-prod-github-runner-207 kernel: [34640.589271] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:01:06 juju-e4d256-prod-github-runner-207 kernel: [34640.590322] ? _raw_spin_lock+0x22/0x30 Aug 22 15:01:06 juju-e4d256-prod-github-runner-207 kernel: [34640.591298] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:01:06 juju-e4d256-prod-github-runner-207 kernel: [34640.592368] direct_page_fault+0x206/0x310 [kvm] Aug 22 15:01:06 juju-e4d256-prod-github-runner-207 kernel: [34640.593399] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 15:01:06 juju-e4d256-prod-github-runner-207 kernel: [34640.594410] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 15:01:06 juju-e4d256-prod-github-runner-207 kernel: [34640.595448] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 15:01:06 juju-e4d256-prod-github-runner-207 kernel: [34640.596438] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 15:01:06 juju-e4d256-prod-github-runner-207 kernel: [34640.597389] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 15:01:06 juju-e4d256-prod-github-runner-207 kernel: [34640.598366] handle_exit+0x98/0x230 [kvm_amd] Aug 22 15:01:06 juju-e4d256-prod-github-runner-207 kernel: [34640.599284] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 15:01:06 juju-e4d256-prod-github-runner-207 kernel: [34640.600207] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 15:01:06 juju-e4d256-prod-github-runner-207 kernel: [34640.601131] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 15:01:06 juju-e4d256-prod-github-runner-207 kernel: [34640.602034] vcpu_run+0x62/0x2c0 [kvm] Aug 22 15:01:06 juju-e4d256-prod-github-runner-207 kernel: [34640.602862] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 15:01:06 juju-e4d256-prod-github-runner-207 kernel: [34640.603670] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 15:01:06 juju-e4d256-prod-github-runner-207 kernel: [34640.604535] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 15:01:06 juju-e4d256-prod-github-runner-207 kernel: [34640.605337] ? __seccomp_filter+0x4a/0x4a0 Aug 22 15:01:06 juju-e4d256-prod-github-runner-207 kernel: [34640.606077] ? __fget_files+0x86/0xc0 Aug 22 15:01:06 juju-e4d256-prod-github-runner-207 kernel: [34640.606798] __x64_sys_ioctl+0x95/0xd0 Aug 22 15:01:06 juju-e4d256-prod-github-runner-207 kernel: [34640.607490] do_syscall_64+0x5c/0xc0 Aug 22 15:01:06 juju-e4d256-prod-github-runner-207 kernel: [34640.608151] ? do_futex+0x162/0x1f0 Aug 22 15:01:06 juju-e4d256-prod-github-runner-207 kernel: [34640.608804] ? __x64_sys_futex+0x78/0x1e0 Aug 22 15:01:06 juju-e4d256-prod-github-runner-207 kernel: [34640.609475] ? __secure_computing+0xa9/0x120 Aug 22 15:01:06 juju-e4d256-prod-github-runner-207 kernel: [34640.610163] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 15:01:06 juju-e4d256-prod-github-runner-207 kernel: [34640.610932] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:01:06 juju-e4d256-prod-github-runner-207 kernel: [34640.611653] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:01:06 juju-e4d256-prod-github-runner-207 kernel: [34640.612375] ? do_syscall_64+0x69/0xc0 Aug 22 15:01:06 juju-e4d256-prod-github-runner-207 kernel: [34640.613019] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:01:06 juju-e4d256-prod-github-runner-207 kernel: [34640.613723] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:01:06 juju-e4d256-prod-github-runner-207 kernel: [34640.614417] ? do_syscall_64+0x69/0xc0 Aug 22 15:01:06 juju-e4d256-prod-github-runner-207 kernel: [34640.615062] ? do_syscall_64+0x69/0xc0 Aug 22 15:01:06 juju-e4d256-prod-github-runner-207 kernel: [34640.615685] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 15:01:06 juju-e4d256-prod-github-runner-207 kernel: [34640.616394] RIP: 0033:0x7faa5d0edaff Aug 22 15:01:06 juju-e4d256-prod-github-runner-207 kernel: [34640.617016] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 15:01:06 juju-e4d256-prod-github-runner-207 kernel: [34640.619035] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 15:01:06 juju-e4d256-prod-github-runner-207 kernel: [34640.619945] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 15:01:06 juju-e4d256-prod-github-runner-207 kernel: [34640.620832] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 15:01:06 juju-e4d256-prod-github-runner-207 kernel: [34640.621716] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 15:01:06 juju-e4d256-prod-github-runner-207 kernel: [34640.622598] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 15:01:06 juju-e4d256-prod-github-runner-207 kernel: [34640.623498] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 15:01:06 juju-e4d256-prod-github-runner-207 kernel: [34640.624395] Aug 22 15:01:34 juju-e4d256-prod-github-runner-207 kernel: [34668.541982] watchdog: BUG: soft lockup - CPU#1 stuck for 32179s! [qemu-system-x86:6715] Aug 22 15:01:34 juju-e4d256-prod-github-runner-207 kernel: [34668.543638] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 15:01:34 juju-e4d256-prod-github-runner-207 kernel: [34668.543732] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 15:01:34 juju-e4d256-prod-github-runner-207 kernel: [34668.561319] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 15:01:34 juju-e4d256-prod-github-runner-207 kernel: [34668.563166] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 15:01:34 juju-e4d256-prod-github-runner-207 kernel: [34668.564961] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:01:34 juju-e4d256-prod-github-runner-207 kernel: [34668.566574] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 15:01:34 juju-e4d256-prod-github-runner-207 kernel: [34668.570265] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 15:01:34 juju-e4d256-prod-github-runner-207 kernel: [34668.571845] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 15:01:34 juju-e4d256-prod-github-runner-207 kernel: [34668.573554] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 15:01:34 juju-e4d256-prod-github-runner-207 kernel: [34668.575017] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 15:01:34 juju-e4d256-prod-github-runner-207 kernel: [34668.576229] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 15:01:34 juju-e4d256-prod-github-runner-207 kernel: [34668.577403] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 15:01:34 juju-e4d256-prod-github-runner-207 kernel: [34668.578587] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 15:01:34 juju-e4d256-prod-github-runner-207 kernel: [34668.579825] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 15:01:34 juju-e4d256-prod-github-runner-207 kernel: [34668.581022] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 15:01:34 juju-e4d256-prod-github-runner-207 kernel: [34668.582223] Call Trace: Aug 22 15:01:34 juju-e4d256-prod-github-runner-207 kernel: [34668.583152] Aug 22 15:01:34 juju-e4d256-prod-github-runner-207 kernel: [34668.584041] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:01:34 juju-e4d256-prod-github-runner-207 kernel: [34668.585076] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:01:34 juju-e4d256-prod-github-runner-207 kernel: [34668.586096] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:01:34 juju-e4d256-prod-github-runner-207 kernel: [34668.587181] ? show_regs.part.0+0x23/0x29 Aug 22 15:01:34 juju-e4d256-prod-github-runner-207 kernel: [34668.588182] ? show_regs.cold+0x8/0xd Aug 22 15:01:34 juju-e4d256-prod-github-runner-207 kernel: [34668.589170] ? watchdog_timer_fn+0x1be/0x220 Aug 22 15:01:34 juju-e4d256-prod-github-runner-207 kernel: [34668.590176] ? lockup_detector_update_enable+0x60/0x60 Aug 22 15:01:34 juju-e4d256-prod-github-runner-207 kernel: [34668.591256] ? __hrtimer_run_queues+0x107/0x230 Aug 22 15:01:34 juju-e4d256-prod-github-runner-207 kernel: [34668.592285] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 15:01:34 juju-e4d256-prod-github-runner-207 kernel: [34668.593306] ? hrtimer_interrupt+0x101/0x220 Aug 22 15:01:34 juju-e4d256-prod-github-runner-207 kernel: [34668.594317] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 15:01:34 juju-e4d256-prod-github-runner-207 kernel: [34668.595401] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 15:01:34 juju-e4d256-prod-github-runner-207 kernel: [34668.596443] Aug 22 15:01:34 juju-e4d256-prod-github-runner-207 kernel: [34668.597293] Aug 22 15:01:34 juju-e4d256-prod-github-runner-207 kernel: [34668.598134] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 15:01:34 juju-e4d256-prod-github-runner-207 kernel: [34668.599183] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:01:34 juju-e4d256-prod-github-runner-207 kernel: [34668.600219] ? _raw_spin_lock+0x22/0x30 Aug 22 15:01:34 juju-e4d256-prod-github-runner-207 kernel: [34668.601193] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:01:34 juju-e4d256-prod-github-runner-207 kernel: [34668.602211] direct_page_fault+0x206/0x310 [kvm] Aug 22 15:01:34 juju-e4d256-prod-github-runner-207 kernel: [34668.603245] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 15:01:34 juju-e4d256-prod-github-runner-207 kernel: [34668.604264] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 15:01:34 juju-e4d256-prod-github-runner-207 kernel: [34668.605270] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 15:01:34 juju-e4d256-prod-github-runner-207 kernel: [34668.606239] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 15:01:34 juju-e4d256-prod-github-runner-207 kernel: [34668.607278] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 15:01:34 juju-e4d256-prod-github-runner-207 kernel: [34668.608343] handle_exit+0x98/0x230 [kvm_amd] Aug 22 15:01:34 juju-e4d256-prod-github-runner-207 kernel: [34668.609298] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 15:01:34 juju-e4d256-prod-github-runner-207 kernel: [34668.610218] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 15:01:34 juju-e4d256-prod-github-runner-207 kernel: [34668.611167] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 15:01:34 juju-e4d256-prod-github-runner-207 kernel: [34668.612075] vcpu_run+0x62/0x2c0 [kvm] Aug 22 15:01:34 juju-e4d256-prod-github-runner-207 kernel: [34668.612884] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 15:01:34 juju-e4d256-prod-github-runner-207 kernel: [34668.613695] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 15:01:34 juju-e4d256-prod-github-runner-207 kernel: [34668.614561] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 15:01:34 juju-e4d256-prod-github-runner-207 kernel: [34668.615356] ? __seccomp_filter+0x4a/0x4a0 Aug 22 15:01:34 juju-e4d256-prod-github-runner-207 kernel: [34668.616096] ? __fget_files+0x86/0xc0 Aug 22 15:01:34 juju-e4d256-prod-github-runner-207 kernel: [34668.616796] __x64_sys_ioctl+0x95/0xd0 Aug 22 15:01:34 juju-e4d256-prod-github-runner-207 kernel: [34668.617485] do_syscall_64+0x5c/0xc0 Aug 22 15:01:34 juju-e4d256-prod-github-runner-207 kernel: [34668.618152] ? do_futex+0x162/0x1f0 Aug 22 15:01:34 juju-e4d256-prod-github-runner-207 kernel: [34668.618865] ? __x64_sys_futex+0x78/0x1e0 Aug 22 15:01:34 juju-e4d256-prod-github-runner-207 kernel: [34668.619552] ? __secure_computing+0xa9/0x120 Aug 22 15:01:34 juju-e4d256-prod-github-runner-207 kernel: [34668.620250] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 15:01:34 juju-e4d256-prod-github-runner-207 kernel: [34668.621011] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:01:34 juju-e4d256-prod-github-runner-207 kernel: [34668.621735] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:01:34 juju-e4d256-prod-github-runner-207 kernel: [34668.622517] ? do_syscall_64+0x69/0xc0 Aug 22 15:01:34 juju-e4d256-prod-github-runner-207 kernel: [34668.623176] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:01:34 juju-e4d256-prod-github-runner-207 kernel: [34668.623887] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:01:34 juju-e4d256-prod-github-runner-207 kernel: [34668.624583] ? do_syscall_64+0x69/0xc0 Aug 22 15:01:34 juju-e4d256-prod-github-runner-207 kernel: [34668.625208] ? do_syscall_64+0x69/0xc0 Aug 22 15:01:34 juju-e4d256-prod-github-runner-207 kernel: [34668.625833] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 15:01:34 juju-e4d256-prod-github-runner-207 kernel: [34668.626553] RIP: 0033:0x7faa5d0edaff Aug 22 15:01:34 juju-e4d256-prod-github-runner-207 kernel: [34668.627179] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 15:01:34 juju-e4d256-prod-github-runner-207 kernel: [34668.629160] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 15:01:34 juju-e4d256-prod-github-runner-207 kernel: [34668.630071] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 15:01:34 juju-e4d256-prod-github-runner-207 kernel: [34668.630996] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 15:01:34 juju-e4d256-prod-github-runner-207 kernel: [34668.631909] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 15:01:34 juju-e4d256-prod-github-runner-207 kernel: [34668.632809] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 15:01:34 juju-e4d256-prod-github-runner-207 kernel: [34668.633698] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 15:01:34 juju-e4d256-prod-github-runner-207 kernel: [34668.634656] Aug 22 15:02:02 juju-e4d256-prod-github-runner-207 kernel: [34696.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 32205s! [qemu-system-x86:6715] Aug 22 15:02:02 juju-e4d256-prod-github-runner-207 kernel: [34696.543933] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 15:02:02 juju-e4d256-prod-github-runner-207 kernel: [34696.544246] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 15:02:02 juju-e4d256-prod-github-runner-207 kernel: [34696.557198] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 15:02:02 juju-e4d256-prod-github-runner-207 kernel: [34696.558539] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 15:02:02 juju-e4d256-prod-github-runner-207 kernel: [34696.559788] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:02:02 juju-e4d256-prod-github-runner-207 kernel: [34696.560886] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 15:02:02 juju-e4d256-prod-github-runner-207 kernel: [34696.563485] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 15:02:02 juju-e4d256-prod-github-runner-207 kernel: [34696.564533] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 15:02:02 juju-e4d256-prod-github-runner-207 kernel: [34696.565700] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 15:02:02 juju-e4d256-prod-github-runner-207 kernel: [34696.566870] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 15:02:02 juju-e4d256-prod-github-runner-207 kernel: [34696.568032] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 15:02:02 juju-e4d256-prod-github-runner-207 kernel: [34696.569218] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 15:02:02 juju-e4d256-prod-github-runner-207 kernel: [34696.570430] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 15:02:02 juju-e4d256-prod-github-runner-207 kernel: [34696.571704] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 15:02:02 juju-e4d256-prod-github-runner-207 kernel: [34696.572804] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 15:02:02 juju-e4d256-prod-github-runner-207 kernel: [34696.574000] Call Trace: Aug 22 15:02:02 juju-e4d256-prod-github-runner-207 kernel: [34696.574988] Aug 22 15:02:02 juju-e4d256-prod-github-runner-207 kernel: [34696.576112] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:02:02 juju-e4d256-prod-github-runner-207 kernel: [34696.577151] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:02:02 juju-e4d256-prod-github-runner-207 kernel: [34696.578199] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:02:02 juju-e4d256-prod-github-runner-207 kernel: [34696.579302] ? show_regs.part.0+0x23/0x29 Aug 22 15:02:02 juju-e4d256-prod-github-runner-207 kernel: [34696.580303] ? show_regs.cold+0x8/0xd Aug 22 15:02:02 juju-e4d256-prod-github-runner-207 kernel: [34696.581294] ? watchdog_timer_fn+0x1be/0x220 Aug 22 15:02:02 juju-e4d256-prod-github-runner-207 kernel: [34696.582428] ? lockup_detector_update_enable+0x60/0x60 Aug 22 15:02:02 juju-e4d256-prod-github-runner-207 kernel: [34696.583524] ? __hrtimer_run_queues+0x107/0x230 Aug 22 15:02:02 juju-e4d256-prod-github-runner-207 kernel: [34696.584555] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 15:02:02 juju-e4d256-prod-github-runner-207 kernel: [34696.585584] ? hrtimer_interrupt+0x101/0x220 Aug 22 15:02:02 juju-e4d256-prod-github-runner-207 kernel: [34696.586630] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 15:02:02 juju-e4d256-prod-github-runner-207 kernel: [34696.587709] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 15:02:02 juju-e4d256-prod-github-runner-207 kernel: [34696.588755] Aug 22 15:02:02 juju-e4d256-prod-github-runner-207 kernel: [34696.589608] Aug 22 15:02:02 juju-e4d256-prod-github-runner-207 kernel: [34696.590491] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 15:02:02 juju-e4d256-prod-github-runner-207 kernel: [34696.591578] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:02:02 juju-e4d256-prod-github-runner-207 kernel: [34696.592623] ? _raw_spin_lock+0x22/0x30 Aug 22 15:02:02 juju-e4d256-prod-github-runner-207 kernel: [34696.593574] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:02:02 juju-e4d256-prod-github-runner-207 kernel: [34696.594622] direct_page_fault+0x206/0x310 [kvm] Aug 22 15:02:02 juju-e4d256-prod-github-runner-207 kernel: [34696.595654] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 15:02:02 juju-e4d256-prod-github-runner-207 kernel: [34696.596667] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 15:02:02 juju-e4d256-prod-github-runner-207 kernel: [34696.597674] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 15:02:02 juju-e4d256-prod-github-runner-207 kernel: [34696.598813] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 15:02:02 juju-e4d256-prod-github-runner-207 kernel: [34696.599837] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 15:02:02 juju-e4d256-prod-github-runner-207 kernel: [34696.600906] handle_exit+0x98/0x230 [kvm_amd] Aug 22 15:02:02 juju-e4d256-prod-github-runner-207 kernel: [34696.601849] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 15:02:02 juju-e4d256-prod-github-runner-207 kernel: [34696.602806] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 15:02:02 juju-e4d256-prod-github-runner-207 kernel: [34696.603751] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 15:02:02 juju-e4d256-prod-github-runner-207 kernel: [34696.604660] vcpu_run+0x62/0x2c0 [kvm] Aug 22 15:02:02 juju-e4d256-prod-github-runner-207 kernel: [34696.605472] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 15:02:02 juju-e4d256-prod-github-runner-207 kernel: [34696.606301] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 15:02:02 juju-e4d256-prod-github-runner-207 kernel: [34696.607158] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 15:02:02 juju-e4d256-prod-github-runner-207 kernel: [34696.607962] ? __seccomp_filter+0x4a/0x4a0 Aug 22 15:02:02 juju-e4d256-prod-github-runner-207 kernel: [34696.608708] ? __fget_files+0x86/0xc0 Aug 22 15:02:02 juju-e4d256-prod-github-runner-207 kernel: [34696.609415] __x64_sys_ioctl+0x95/0xd0 Aug 22 15:02:02 juju-e4d256-prod-github-runner-207 kernel: [34696.610127] do_syscall_64+0x5c/0xc0 Aug 22 15:02:02 juju-e4d256-prod-github-runner-207 kernel: [34696.610805] ? do_futex+0x162/0x1f0 Aug 22 15:02:02 juju-e4d256-prod-github-runner-207 kernel: [34696.611461] ? __x64_sys_futex+0x78/0x1e0 Aug 22 15:02:02 juju-e4d256-prod-github-runner-207 kernel: [34696.612171] ? __secure_computing+0xa9/0x120 Aug 22 15:02:02 juju-e4d256-prod-github-runner-207 kernel: [34696.612881] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 15:02:02 juju-e4d256-prod-github-runner-207 kernel: [34696.613658] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:02:02 juju-e4d256-prod-github-runner-207 kernel: [34696.614404] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:02:02 juju-e4d256-prod-github-runner-207 kernel: [34696.615154] ? do_syscall_64+0x69/0xc0 Aug 22 15:02:02 juju-e4d256-prod-github-runner-207 kernel: [34696.615810] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:02:02 juju-e4d256-prod-github-runner-207 kernel: [34696.616520] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:02:02 juju-e4d256-prod-github-runner-207 kernel: [34696.617219] ? do_syscall_64+0x69/0xc0 Aug 22 15:02:02 juju-e4d256-prod-github-runner-207 kernel: [34696.617895] ? do_syscall_64+0x69/0xc0 Aug 22 15:02:02 juju-e4d256-prod-github-runner-207 kernel: [34696.618592] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 15:02:02 juju-e4d256-prod-github-runner-207 kernel: [34696.619310] RIP: 0033:0x7faa5d0edaff Aug 22 15:02:02 juju-e4d256-prod-github-runner-207 kernel: [34696.619978] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 15:02:02 juju-e4d256-prod-github-runner-207 kernel: [34696.621973] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 15:02:02 juju-e4d256-prod-github-runner-207 kernel: [34696.622914] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 15:02:02 juju-e4d256-prod-github-runner-207 kernel: [34696.623810] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 15:02:02 juju-e4d256-prod-github-runner-207 kernel: [34696.624702] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 15:02:02 juju-e4d256-prod-github-runner-207 kernel: [34696.625594] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 15:02:02 juju-e4d256-prod-github-runner-207 kernel: [34696.626560] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 15:02:02 juju-e4d256-prod-github-runner-207 kernel: [34696.627463] Aug 22 15:02:30 juju-e4d256-prod-github-runner-207 kernel: [34724.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 32231s! [qemu-system-x86:6715] Aug 22 15:02:30 juju-e4d256-prod-github-runner-207 kernel: [34724.543109] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 15:02:30 juju-e4d256-prod-github-runner-207 kernel: [34724.543184] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 15:02:30 juju-e4d256-prod-github-runner-207 kernel: [34724.555314] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 15:02:30 juju-e4d256-prod-github-runner-207 kernel: [34724.556579] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 15:02:30 juju-e4d256-prod-github-runner-207 kernel: [34724.557822] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:02:30 juju-e4d256-prod-github-runner-207 kernel: [34724.558883] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 15:02:30 juju-e4d256-prod-github-runner-207 kernel: [34724.561431] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 15:02:30 juju-e4d256-prod-github-runner-207 kernel: [34724.562488] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 15:02:30 juju-e4d256-prod-github-runner-207 kernel: [34724.563653] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 15:02:30 juju-e4d256-prod-github-runner-207 kernel: [34724.564829] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 15:02:30 juju-e4d256-prod-github-runner-207 kernel: [34724.566027] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 15:02:30 juju-e4d256-prod-github-runner-207 kernel: [34724.567190] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 15:02:30 juju-e4d256-prod-github-runner-207 kernel: [34724.568356] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 15:02:30 juju-e4d256-prod-github-runner-207 kernel: [34724.569598] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 15:02:30 juju-e4d256-prod-github-runner-207 kernel: [34724.570709] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 15:02:30 juju-e4d256-prod-github-runner-207 kernel: [34724.571906] Call Trace: Aug 22 15:02:30 juju-e4d256-prod-github-runner-207 kernel: [34724.572821] Aug 22 15:02:30 juju-e4d256-prod-github-runner-207 kernel: [34724.573703] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:02:30 juju-e4d256-prod-github-runner-207 kernel: [34724.574741] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:02:30 juju-e4d256-prod-github-runner-207 kernel: [34724.575771] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:02:30 juju-e4d256-prod-github-runner-207 kernel: [34724.576855] ? show_regs.part.0+0x23/0x29 Aug 22 15:02:30 juju-e4d256-prod-github-runner-207 kernel: [34724.577869] ? show_regs.cold+0x8/0xd Aug 22 15:02:30 juju-e4d256-prod-github-runner-207 kernel: [34724.578845] ? watchdog_timer_fn+0x1be/0x220 Aug 22 15:02:30 juju-e4d256-prod-github-runner-207 kernel: [34724.579852] ? lockup_detector_update_enable+0x60/0x60 Aug 22 15:02:30 juju-e4d256-prod-github-runner-207 kernel: [34724.580912] ? __hrtimer_run_queues+0x107/0x230 Aug 22 15:02:30 juju-e4d256-prod-github-runner-207 kernel: [34724.581958] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 15:02:30 juju-e4d256-prod-github-runner-207 kernel: [34724.583002] ? hrtimer_interrupt+0x101/0x220 Aug 22 15:02:30 juju-e4d256-prod-github-runner-207 kernel: [34724.584030] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 15:02:30 juju-e4d256-prod-github-runner-207 kernel: [34724.585103] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 15:02:30 juju-e4d256-prod-github-runner-207 kernel: [34724.586176] Aug 22 15:02:30 juju-e4d256-prod-github-runner-207 kernel: [34724.587029] Aug 22 15:02:30 juju-e4d256-prod-github-runner-207 kernel: [34724.587870] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 15:02:30 juju-e4d256-prod-github-runner-207 kernel: [34724.588903] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:02:30 juju-e4d256-prod-github-runner-207 kernel: [34724.589952] ? _raw_spin_lock+0x22/0x30 Aug 22 15:02:30 juju-e4d256-prod-github-runner-207 kernel: [34724.590898] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:02:30 juju-e4d256-prod-github-runner-207 kernel: [34724.591914] direct_page_fault+0x206/0x310 [kvm] Aug 22 15:02:30 juju-e4d256-prod-github-runner-207 kernel: [34724.592936] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 15:02:30 juju-e4d256-prod-github-runner-207 kernel: [34724.593959] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 15:02:30 juju-e4d256-prod-github-runner-207 kernel: [34724.594972] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 15:02:30 juju-e4d256-prod-github-runner-207 kernel: [34724.595946] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 15:02:30 juju-e4d256-prod-github-runner-207 kernel: [34724.596891] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 15:02:30 juju-e4d256-prod-github-runner-207 kernel: [34724.597889] handle_exit+0x98/0x230 [kvm_amd] Aug 22 15:02:30 juju-e4d256-prod-github-runner-207 kernel: [34724.598781] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 15:02:30 juju-e4d256-prod-github-runner-207 kernel: [34724.599693] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 15:02:30 juju-e4d256-prod-github-runner-207 kernel: [34724.600619] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 15:02:30 juju-e4d256-prod-github-runner-207 kernel: [34724.601521] vcpu_run+0x62/0x2c0 [kvm] Aug 22 15:02:30 juju-e4d256-prod-github-runner-207 kernel: [34724.602340] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 15:02:30 juju-e4d256-prod-github-runner-207 kernel: [34724.603153] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 15:02:30 juju-e4d256-prod-github-runner-207 kernel: [34724.604011] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 15:02:30 juju-e4d256-prod-github-runner-207 kernel: [34724.604813] ? __seccomp_filter+0x4a/0x4a0 Aug 22 15:02:30 juju-e4d256-prod-github-runner-207 kernel: [34724.605558] ? __fget_files+0x86/0xc0 Aug 22 15:02:30 juju-e4d256-prod-github-runner-207 kernel: [34724.606271] __x64_sys_ioctl+0x95/0xd0 Aug 22 15:02:30 juju-e4d256-prod-github-runner-207 kernel: [34724.606968] do_syscall_64+0x5c/0xc0 Aug 22 15:02:30 juju-e4d256-prod-github-runner-207 kernel: [34724.607630] ? do_futex+0x162/0x1f0 Aug 22 15:02:30 juju-e4d256-prod-github-runner-207 kernel: [34724.608277] ? __x64_sys_futex+0x78/0x1e0 Aug 22 15:02:30 juju-e4d256-prod-github-runner-207 kernel: [34724.608948] ? __secure_computing+0xa9/0x120 Aug 22 15:02:30 juju-e4d256-prod-github-runner-207 kernel: [34724.609642] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 15:02:30 juju-e4d256-prod-github-runner-207 kernel: [34724.610413] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:02:30 juju-e4d256-prod-github-runner-207 kernel: [34724.611136] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:02:30 juju-e4d256-prod-github-runner-207 kernel: [34724.611861] ? do_syscall_64+0x69/0xc0 Aug 22 15:02:30 juju-e4d256-prod-github-runner-207 kernel: [34724.612513] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:02:30 juju-e4d256-prod-github-runner-207 kernel: [34724.613222] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:02:30 juju-e4d256-prod-github-runner-207 kernel: [34724.613953] ? do_syscall_64+0x69/0xc0 Aug 22 15:02:30 juju-e4d256-prod-github-runner-207 kernel: [34724.614578] ? do_syscall_64+0x69/0xc0 Aug 22 15:02:30 juju-e4d256-prod-github-runner-207 kernel: [34724.615200] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 15:02:30 juju-e4d256-prod-github-runner-207 kernel: [34724.615974] RIP: 0033:0x7faa5d0edaff Aug 22 15:02:30 juju-e4d256-prod-github-runner-207 kernel: [34724.616619] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 15:02:30 juju-e4d256-prod-github-runner-207 kernel: [34724.618619] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 15:02:30 juju-e4d256-prod-github-runner-207 kernel: [34724.619534] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 15:02:30 juju-e4d256-prod-github-runner-207 kernel: [34724.620428] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 15:02:30 juju-e4d256-prod-github-runner-207 kernel: [34724.621331] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 15:02:30 juju-e4d256-prod-github-runner-207 kernel: [34724.622236] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 15:02:30 juju-e4d256-prod-github-runner-207 kernel: [34724.623127] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 15:02:30 juju-e4d256-prod-github-runner-207 kernel: [34724.624025] Aug 22 15:02:45 juju-e4d256-prod-github-runner-207 kernel: [34739.504705] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 15:02:45 juju-e4d256-prod-github-runner-207 kernel: [34739.505679] rcu: 1-....: (8628471 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=4168498 Aug 22 15:02:45 juju-e4d256-prod-github-runner-207 kernel: [34739.506843] (t=8655576 jiffies g=23269 q=36875) Aug 22 15:02:45 juju-e4d256-prod-github-runner-207 kernel: [34739.507625] NMI backtrace for cpu 1 Aug 22 15:02:45 juju-e4d256-prod-github-runner-207 kernel: [34739.508338] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 15:02:45 juju-e4d256-prod-github-runner-207 kernel: [34739.509440] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 15:02:45 juju-e4d256-prod-github-runner-207 kernel: [34739.510508] Call Trace: Aug 22 15:02:45 juju-e4d256-prod-github-runner-207 kernel: [34739.511183] Aug 22 15:02:45 juju-e4d256-prod-github-runner-207 kernel: [34739.511828] show_stack+0x52/0x5c Aug 22 15:02:45 juju-e4d256-prod-github-runner-207 kernel: [34739.512552] dump_stack_lvl+0x4a/0x63 Aug 22 15:02:45 juju-e4d256-prod-github-runner-207 kernel: [34739.513299] dump_stack+0x10/0x16 Aug 22 15:02:45 juju-e4d256-prod-github-runner-207 kernel: [34739.514034] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 15:02:45 juju-e4d256-prod-github-runner-207 kernel: [34739.514816] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 15:02:45 juju-e4d256-prod-github-runner-207 kernel: [34739.515594] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 15:02:45 juju-e4d256-prod-github-runner-207 kernel: [34739.516414] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 15:02:45 juju-e4d256-prod-github-runner-207 kernel: [34739.517242] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 15:02:45 juju-e4d256-prod-github-runner-207 kernel: [34739.518076] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 15:02:45 juju-e4d256-prod-github-runner-207 kernel: [34739.518867] print_cpu_stall.cold+0x2f/0xe2 Aug 22 15:02:45 juju-e4d256-prod-github-runner-207 kernel: [34739.519633] ? timekeeping_update+0xf7/0x150 Aug 22 15:02:45 juju-e4d256-prod-github-runner-207 kernel: [34739.520409] check_cpu_stall+0x109/0x270 Aug 22 15:02:45 juju-e4d256-prod-github-runner-207 kernel: [34739.521158] rcu_sched_clock_irq+0x9a/0x250 Aug 22 15:02:45 juju-e4d256-prod-github-runner-207 kernel: [34739.521928] update_process_times+0x94/0xd0 Aug 22 15:02:45 juju-e4d256-prod-github-runner-207 kernel: [34739.522690] tick_sched_handle+0x29/0x70 Aug 22 15:02:45 juju-e4d256-prod-github-runner-207 kernel: [34739.523437] tick_sched_timer+0x8c/0xc0 Aug 22 15:02:45 juju-e4d256-prod-github-runner-207 kernel: [34739.524174] ? tick_nohz_handler+0xb0/0xb0 Aug 22 15:02:45 juju-e4d256-prod-github-runner-207 kernel: [34739.524929] __hrtimer_run_queues+0x107/0x230 Aug 22 15:02:45 juju-e4d256-prod-github-runner-207 kernel: [34739.525710] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 15:02:45 juju-e4d256-prod-github-runner-207 kernel: [34739.526485] hrtimer_interrupt+0x101/0x220 Aug 22 15:02:45 juju-e4d256-prod-github-runner-207 kernel: [34739.527243] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 15:02:45 juju-e4d256-prod-github-runner-207 kernel: [34739.528054] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 15:02:45 juju-e4d256-prod-github-runner-207 kernel: [34739.528856] Aug 22 15:02:45 juju-e4d256-prod-github-runner-207 kernel: [34739.529489] Aug 22 15:02:45 juju-e4d256-prod-github-runner-207 kernel: [34739.530125] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 15:02:45 juju-e4d256-prod-github-runner-207 kernel: [34739.530944] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:02:45 juju-e4d256-prod-github-runner-207 kernel: [34739.531822] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 15:02:45 juju-e4d256-prod-github-runner-207 kernel: [34739.534056] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 15:02:45 juju-e4d256-prod-github-runner-207 kernel: [34739.534948] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 15:02:45 juju-e4d256-prod-github-runner-207 kernel: [34739.535938] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 15:02:45 juju-e4d256-prod-github-runner-207 kernel: [34739.536912] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 15:02:45 juju-e4d256-prod-github-runner-207 kernel: [34739.537886] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 15:02:45 juju-e4d256-prod-github-runner-207 kernel: [34739.538840] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 15:02:45 juju-e4d256-prod-github-runner-207 kernel: [34739.539789] ? _raw_spin_lock+0x22/0x30 Aug 22 15:02:45 juju-e4d256-prod-github-runner-207 kernel: [34739.540544] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:02:45 juju-e4d256-prod-github-runner-207 kernel: [34739.541380] direct_page_fault+0x206/0x310 [kvm] Aug 22 15:02:45 juju-e4d256-prod-github-runner-207 kernel: [34739.542228] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 15:02:45 juju-e4d256-prod-github-runner-207 kernel: [34739.543063] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 15:02:45 juju-e4d256-prod-github-runner-207 kernel: [34739.543885] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 15:02:45 juju-e4d256-prod-github-runner-207 kernel: [34739.544688] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 15:02:45 juju-e4d256-prod-github-runner-207 kernel: [34739.545471] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 15:02:45 juju-e4d256-prod-github-runner-207 kernel: [34739.546299] handle_exit+0x98/0x230 [kvm_amd] Aug 22 15:02:45 juju-e4d256-prod-github-runner-207 kernel: [34739.547051] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 15:02:45 juju-e4d256-prod-github-runner-207 kernel: [34739.547832] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 15:02:45 juju-e4d256-prod-github-runner-207 kernel: [34739.548628] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 15:02:45 juju-e4d256-prod-github-runner-207 kernel: [34739.549412] vcpu_run+0x62/0x2c0 [kvm] Aug 22 15:02:45 juju-e4d256-prod-github-runner-207 kernel: [34739.550152] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 15:02:45 juju-e4d256-prod-github-runner-207 kernel: [34739.550896] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 15:02:45 juju-e4d256-prod-github-runner-207 kernel: [34739.551696] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 15:02:45 juju-e4d256-prod-github-runner-207 kernel: [34739.552468] ? __seccomp_filter+0x4a/0x4a0 Aug 22 15:02:45 juju-e4d256-prod-github-runner-207 kernel: [34739.553193] ? __fget_files+0x86/0xc0 Aug 22 15:02:45 juju-e4d256-prod-github-runner-207 kernel: [34739.553901] __x64_sys_ioctl+0x95/0xd0 Aug 22 15:02:45 juju-e4d256-prod-github-runner-207 kernel: [34739.554594] do_syscall_64+0x5c/0xc0 Aug 22 15:02:45 juju-e4d256-prod-github-runner-207 kernel: [34739.555272] ? do_futex+0x162/0x1f0 Aug 22 15:02:45 juju-e4d256-prod-github-runner-207 kernel: [34739.555943] ? __x64_sys_futex+0x78/0x1e0 Aug 22 15:02:45 juju-e4d256-prod-github-runner-207 kernel: [34739.556642] ? __secure_computing+0xa9/0x120 Aug 22 15:02:45 juju-e4d256-prod-github-runner-207 kernel: [34739.557362] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 15:02:45 juju-e4d256-prod-github-runner-207 kernel: [34739.558169] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:02:45 juju-e4d256-prod-github-runner-207 kernel: [34739.558924] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:02:45 juju-e4d256-prod-github-runner-207 kernel: [34739.559678] ? do_syscall_64+0x69/0xc0 Aug 22 15:02:45 juju-e4d256-prod-github-runner-207 kernel: [34739.560374] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:02:45 juju-e4d256-prod-github-runner-207 kernel: [34739.561131] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:02:45 juju-e4d256-prod-github-runner-207 kernel: [34739.561898] ? do_syscall_64+0x69/0xc0 Aug 22 15:02:45 juju-e4d256-prod-github-runner-207 kernel: [34739.562595] ? do_syscall_64+0x69/0xc0 Aug 22 15:02:45 juju-e4d256-prod-github-runner-207 kernel: [34739.563288] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 15:02:45 juju-e4d256-prod-github-runner-207 kernel: [34739.564060] RIP: 0033:0x7faa5d0edaff Aug 22 15:02:45 juju-e4d256-prod-github-runner-207 kernel: [34739.564743] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 15:02:45 juju-e4d256-prod-github-runner-207 kernel: [34739.566898] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 15:02:45 juju-e4d256-prod-github-runner-207 kernel: [34739.567862] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 15:02:45 juju-e4d256-prod-github-runner-207 kernel: [34739.568810] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 15:02:45 juju-e4d256-prod-github-runner-207 kernel: [34739.569765] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 15:02:45 juju-e4d256-prod-github-runner-207 kernel: [34739.570710] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 15:02:45 juju-e4d256-prod-github-runner-207 kernel: [34739.571640] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 15:02:45 juju-e4d256-prod-github-runner-207 kernel: [34739.572561] Aug 22 15:03:10 juju-e4d256-prod-github-runner-207 kernel: [34764.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 32269s! [qemu-system-x86:6715] Aug 22 15:03:10 juju-e4d256-prod-github-runner-207 kernel: [34764.543145] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 15:03:10 juju-e4d256-prod-github-runner-207 kernel: [34764.543219] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 15:03:10 juju-e4d256-prod-github-runner-207 kernel: [34764.555969] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 15:03:10 juju-e4d256-prod-github-runner-207 kernel: [34764.557297] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 15:03:10 juju-e4d256-prod-github-runner-207 kernel: [34764.558536] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:03:10 juju-e4d256-prod-github-runner-207 kernel: [34764.559673] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 15:03:10 juju-e4d256-prod-github-runner-207 kernel: [34764.562381] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 15:03:10 juju-e4d256-prod-github-runner-207 kernel: [34764.563613] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 15:03:10 juju-e4d256-prod-github-runner-207 kernel: [34764.564775] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 15:03:10 juju-e4d256-prod-github-runner-207 kernel: [34764.565962] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 15:03:10 juju-e4d256-prod-github-runner-207 kernel: [34764.567351] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 15:03:10 juju-e4d256-prod-github-runner-207 kernel: [34764.568708] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 15:03:10 juju-e4d256-prod-github-runner-207 kernel: [34764.569891] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 15:03:10 juju-e4d256-prod-github-runner-207 kernel: [34764.571131] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 15:03:10 juju-e4d256-prod-github-runner-207 kernel: [34764.572231] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 15:03:10 juju-e4d256-prod-github-runner-207 kernel: [34764.573438] Call Trace: Aug 22 15:03:10 juju-e4d256-prod-github-runner-207 kernel: [34764.574351] Aug 22 15:03:10 juju-e4d256-prod-github-runner-207 kernel: [34764.575236] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:03:10 juju-e4d256-prod-github-runner-207 kernel: [34764.576271] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:03:10 juju-e4d256-prod-github-runner-207 kernel: [34764.577291] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:03:10 juju-e4d256-prod-github-runner-207 kernel: [34764.578379] ? show_regs.part.0+0x23/0x29 Aug 22 15:03:10 juju-e4d256-prod-github-runner-207 kernel: [34764.579382] ? show_regs.cold+0x8/0xd Aug 22 15:03:10 juju-e4d256-prod-github-runner-207 kernel: [34764.580354] ? watchdog_timer_fn+0x1be/0x220 Aug 22 15:03:10 juju-e4d256-prod-github-runner-207 kernel: [34764.581376] ? lockup_detector_update_enable+0x60/0x60 Aug 22 15:03:10 juju-e4d256-prod-github-runner-207 kernel: [34764.582471] ? __hrtimer_run_queues+0x107/0x230 Aug 22 15:03:10 juju-e4d256-prod-github-runner-207 kernel: [34764.583555] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 15:03:10 juju-e4d256-prod-github-runner-207 kernel: [34764.584648] ? hrtimer_interrupt+0x101/0x220 Aug 22 15:03:10 juju-e4d256-prod-github-runner-207 kernel: [34764.585755] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 15:03:10 juju-e4d256-prod-github-runner-207 kernel: [34764.586826] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 15:03:10 juju-e4d256-prod-github-runner-207 kernel: [34764.587889] Aug 22 15:03:10 juju-e4d256-prod-github-runner-207 kernel: [34764.588744] Aug 22 15:03:10 juju-e4d256-prod-github-runner-207 kernel: [34764.589597] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 15:03:10 juju-e4d256-prod-github-runner-207 kernel: [34764.590665] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:03:10 juju-e4d256-prod-github-runner-207 kernel: [34764.591764] ? _raw_spin_lock+0x22/0x30 Aug 22 15:03:10 juju-e4d256-prod-github-runner-207 kernel: [34764.592721] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:03:10 juju-e4d256-prod-github-runner-207 kernel: [34764.593757] direct_page_fault+0x206/0x310 [kvm] Aug 22 15:03:10 juju-e4d256-prod-github-runner-207 kernel: [34764.594785] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 15:03:10 juju-e4d256-prod-github-runner-207 kernel: [34764.595795] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 15:03:10 juju-e4d256-prod-github-runner-207 kernel: [34764.596801] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 15:03:10 juju-e4d256-prod-github-runner-207 kernel: [34764.597799] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 15:03:10 juju-e4d256-prod-github-runner-207 kernel: [34764.598778] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 15:03:10 juju-e4d256-prod-github-runner-207 kernel: [34764.599779] handle_exit+0x98/0x230 [kvm_amd] Aug 22 15:03:10 juju-e4d256-prod-github-runner-207 kernel: [34764.600741] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 15:03:10 juju-e4d256-prod-github-runner-207 kernel: [34764.601721] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 15:03:10 juju-e4d256-prod-github-runner-207 kernel: [34764.602791] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 15:03:10 juju-e4d256-prod-github-runner-207 kernel: [34764.603721] vcpu_run+0x62/0x2c0 [kvm] Aug 22 15:03:10 juju-e4d256-prod-github-runner-207 kernel: [34764.604539] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 15:03:10 juju-e4d256-prod-github-runner-207 kernel: [34764.605380] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 15:03:10 juju-e4d256-prod-github-runner-207 kernel: [34764.606242] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 15:03:10 juju-e4d256-prod-github-runner-207 kernel: [34764.607040] ? __seccomp_filter+0x4a/0x4a0 Aug 22 15:03:10 juju-e4d256-prod-github-runner-207 kernel: [34764.607784] ? __fget_files+0x86/0xc0 Aug 22 15:03:10 juju-e4d256-prod-github-runner-207 kernel: [34764.608496] __x64_sys_ioctl+0x95/0xd0 Aug 22 15:03:10 juju-e4d256-prod-github-runner-207 kernel: [34764.609236] do_syscall_64+0x5c/0xc0 Aug 22 15:03:10 juju-e4d256-prod-github-runner-207 kernel: [34764.609916] ? do_futex+0x162/0x1f0 Aug 22 15:03:10 juju-e4d256-prod-github-runner-207 kernel: [34764.610565] ? __x64_sys_futex+0x78/0x1e0 Aug 22 15:03:10 juju-e4d256-prod-github-runner-207 kernel: [34764.611238] ? __secure_computing+0xa9/0x120 Aug 22 15:03:10 juju-e4d256-prod-github-runner-207 kernel: [34764.611934] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 15:03:10 juju-e4d256-prod-github-runner-207 kernel: [34764.612696] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:03:10 juju-e4d256-prod-github-runner-207 kernel: [34764.613440] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:03:10 juju-e4d256-prod-github-runner-207 kernel: [34764.614164] ? do_syscall_64+0x69/0xc0 Aug 22 15:03:10 juju-e4d256-prod-github-runner-207 kernel: [34764.614813] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:03:10 juju-e4d256-prod-github-runner-207 kernel: [34764.615599] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:03:10 juju-e4d256-prod-github-runner-207 kernel: [34764.616311] ? do_syscall_64+0x69/0xc0 Aug 22 15:03:10 juju-e4d256-prod-github-runner-207 kernel: [34764.616940] ? do_syscall_64+0x69/0xc0 Aug 22 15:03:10 juju-e4d256-prod-github-runner-207 kernel: [34764.617594] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 15:03:10 juju-e4d256-prod-github-runner-207 kernel: [34764.618302] RIP: 0033:0x7faa5d0edaff Aug 22 15:03:10 juju-e4d256-prod-github-runner-207 kernel: [34764.618981] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 15:03:10 juju-e4d256-prod-github-runner-207 kernel: [34764.621040] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 15:03:10 juju-e4d256-prod-github-runner-207 kernel: [34764.621987] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 15:03:10 juju-e4d256-prod-github-runner-207 kernel: [34764.622875] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 15:03:10 juju-e4d256-prod-github-runner-207 kernel: [34764.623766] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 15:03:10 juju-e4d256-prod-github-runner-207 kernel: [34764.624653] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 15:03:10 juju-e4d256-prod-github-runner-207 kernel: [34764.625565] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 15:03:10 juju-e4d256-prod-github-runner-207 kernel: [34764.626460] Aug 22 15:03:38 juju-e4d256-prod-github-runner-207 kernel: [34792.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 32295s! [qemu-system-x86:6715] Aug 22 15:03:38 juju-e4d256-prod-github-runner-207 kernel: [34792.543930] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 15:03:38 juju-e4d256-prod-github-runner-207 kernel: [34792.544217] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 15:03:38 juju-e4d256-prod-github-runner-207 kernel: [34792.556300] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 15:03:38 juju-e4d256-prod-github-runner-207 kernel: [34792.557571] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 15:03:38 juju-e4d256-prod-github-runner-207 kernel: [34792.558795] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:03:38 juju-e4d256-prod-github-runner-207 kernel: [34792.559850] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 15:03:38 juju-e4d256-prod-github-runner-207 kernel: [34792.562451] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 15:03:38 juju-e4d256-prod-github-runner-207 kernel: [34792.563507] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 15:03:38 juju-e4d256-prod-github-runner-207 kernel: [34792.564667] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 15:03:38 juju-e4d256-prod-github-runner-207 kernel: [34792.565837] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 15:03:38 juju-e4d256-prod-github-runner-207 kernel: [34792.566994] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 15:03:38 juju-e4d256-prod-github-runner-207 kernel: [34792.568150] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 15:03:38 juju-e4d256-prod-github-runner-207 kernel: [34792.569339] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 15:03:38 juju-e4d256-prod-github-runner-207 kernel: [34792.570588] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 15:03:38 juju-e4d256-prod-github-runner-207 kernel: [34792.571681] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 15:03:38 juju-e4d256-prod-github-runner-207 kernel: [34792.572880] Call Trace: Aug 22 15:03:38 juju-e4d256-prod-github-runner-207 kernel: [34792.573801] Aug 22 15:03:38 juju-e4d256-prod-github-runner-207 kernel: [34792.574695] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:03:38 juju-e4d256-prod-github-runner-207 kernel: [34792.575730] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:03:38 juju-e4d256-prod-github-runner-207 kernel: [34792.576753] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:03:38 juju-e4d256-prod-github-runner-207 kernel: [34792.577859] ? show_regs.part.0+0x23/0x29 Aug 22 15:03:38 juju-e4d256-prod-github-runner-207 kernel: [34792.578852] ? show_regs.cold+0x8/0xd Aug 22 15:03:38 juju-e4d256-prod-github-runner-207 kernel: [34792.579825] ? watchdog_timer_fn+0x1be/0x220 Aug 22 15:03:38 juju-e4d256-prod-github-runner-207 kernel: [34792.580829] ? lockup_detector_update_enable+0x60/0x60 Aug 22 15:03:38 juju-e4d256-prod-github-runner-207 kernel: [34792.581895] ? __hrtimer_run_queues+0x107/0x230 Aug 22 15:03:38 juju-e4d256-prod-github-runner-207 kernel: [34792.582934] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 15:03:38 juju-e4d256-prod-github-runner-207 kernel: [34792.583959] ? hrtimer_interrupt+0x101/0x220 Aug 22 15:03:38 juju-e4d256-prod-github-runner-207 kernel: [34792.584995] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 15:03:38 juju-e4d256-prod-github-runner-207 kernel: [34792.586086] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 15:03:38 juju-e4d256-prod-github-runner-207 kernel: [34792.587130] Aug 22 15:03:38 juju-e4d256-prod-github-runner-207 kernel: [34792.588004] Aug 22 15:03:38 juju-e4d256-prod-github-runner-207 kernel: [34792.588844] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 15:03:38 juju-e4d256-prod-github-runner-207 kernel: [34792.589896] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:03:38 juju-e4d256-prod-github-runner-207 kernel: [34792.590937] ? _raw_spin_lock+0x22/0x30 Aug 22 15:03:38 juju-e4d256-prod-github-runner-207 kernel: [34792.591885] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:03:38 juju-e4d256-prod-github-runner-207 kernel: [34792.592948] direct_page_fault+0x206/0x310 [kvm] Aug 22 15:03:38 juju-e4d256-prod-github-runner-207 kernel: [34792.594056] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 15:03:38 juju-e4d256-prod-github-runner-207 kernel: [34792.595076] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 15:03:38 juju-e4d256-prod-github-runner-207 kernel: [34792.596083] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 15:03:38 juju-e4d256-prod-github-runner-207 kernel: [34792.597102] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 15:03:38 juju-e4d256-prod-github-runner-207 kernel: [34792.598058] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 15:03:38 juju-e4d256-prod-github-runner-207 kernel: [34792.599043] handle_exit+0x98/0x230 [kvm_amd] Aug 22 15:03:38 juju-e4d256-prod-github-runner-207 kernel: [34792.599941] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 15:03:38 juju-e4d256-prod-github-runner-207 kernel: [34792.600959] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 15:03:38 juju-e4d256-prod-github-runner-207 kernel: [34792.601995] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 15:03:38 juju-e4d256-prod-github-runner-207 kernel: [34792.602989] vcpu_run+0x62/0x2c0 [kvm] Aug 22 15:03:38 juju-e4d256-prod-github-runner-207 kernel: [34792.603872] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 15:03:38 juju-e4d256-prod-github-runner-207 kernel: [34792.604783] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 15:03:38 juju-e4d256-prod-github-runner-207 kernel: [34792.605750] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 15:03:38 juju-e4d256-prod-github-runner-207 kernel: [34792.606646] ? __seccomp_filter+0x4a/0x4a0 Aug 22 15:03:38 juju-e4d256-prod-github-runner-207 kernel: [34792.607522] ? __fget_files+0x86/0xc0 Aug 22 15:03:38 juju-e4d256-prod-github-runner-207 kernel: [34792.608312] __x64_sys_ioctl+0x95/0xd0 Aug 22 15:03:38 juju-e4d256-prod-github-runner-207 kernel: [34792.609147] do_syscall_64+0x5c/0xc0 Aug 22 15:03:38 juju-e4d256-prod-github-runner-207 kernel: [34792.609888] ? do_futex+0x162/0x1f0 Aug 22 15:03:38 juju-e4d256-prod-github-runner-207 kernel: [34792.610620] ? __x64_sys_futex+0x78/0x1e0 Aug 22 15:03:38 juju-e4d256-prod-github-runner-207 kernel: [34792.611386] ? __secure_computing+0xa9/0x120 Aug 22 15:03:38 juju-e4d256-prod-github-runner-207 kernel: [34792.612164] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 15:03:38 juju-e4d256-prod-github-runner-207 kernel: [34792.613043] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:03:38 juju-e4d256-prod-github-runner-207 kernel: [34792.613860] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:03:38 juju-e4d256-prod-github-runner-207 kernel: [34792.614672] ? do_syscall_64+0x69/0xc0 Aug 22 15:03:38 juju-e4d256-prod-github-runner-207 kernel: [34792.615390] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:03:38 juju-e4d256-prod-github-runner-207 kernel: [34792.616187] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:03:38 juju-e4d256-prod-github-runner-207 kernel: [34792.616976] ? do_syscall_64+0x69/0xc0 Aug 22 15:03:38 juju-e4d256-prod-github-runner-207 kernel: [34792.617698] ? do_syscall_64+0x69/0xc0 Aug 22 15:03:38 juju-e4d256-prod-github-runner-207 kernel: [34792.618417] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 15:03:38 juju-e4d256-prod-github-runner-207 kernel: [34792.619242] RIP: 0033:0x7faa5d0edaff Aug 22 15:03:38 juju-e4d256-prod-github-runner-207 kernel: [34792.619968] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 15:03:38 juju-e4d256-prod-github-runner-207 kernel: [34792.622297] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 15:03:38 juju-e4d256-prod-github-runner-207 kernel: [34792.623344] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 15:03:38 juju-e4d256-prod-github-runner-207 kernel: [34792.624370] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 15:03:38 juju-e4d256-prod-github-runner-207 kernel: [34792.625400] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 15:03:38 juju-e4d256-prod-github-runner-207 kernel: [34792.626427] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 15:03:38 juju-e4d256-prod-github-runner-207 kernel: [34792.627456] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 15:03:38 juju-e4d256-prod-github-runner-207 kernel: [34792.628488] Aug 22 15:04:06 juju-e4d256-prod-github-runner-207 kernel: [34820.541976] watchdog: BUG: soft lockup - CPU#1 stuck for 32321s! [qemu-system-x86:6715] Aug 22 15:04:06 juju-e4d256-prod-github-runner-207 kernel: [34820.543096] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 15:04:06 juju-e4d256-prod-github-runner-207 kernel: [34820.543167] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 15:04:06 juju-e4d256-prod-github-runner-207 kernel: [34820.555308] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 15:04:06 juju-e4d256-prod-github-runner-207 kernel: [34820.556582] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 15:04:06 juju-e4d256-prod-github-runner-207 kernel: [34820.557851] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:04:06 juju-e4d256-prod-github-runner-207 kernel: [34820.558920] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 15:04:06 juju-e4d256-prod-github-runner-207 kernel: [34820.561500] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 15:04:06 juju-e4d256-prod-github-runner-207 kernel: [34820.562544] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 15:04:06 juju-e4d256-prod-github-runner-207 kernel: [34820.563742] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 15:04:06 juju-e4d256-prod-github-runner-207 kernel: [34820.564928] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 15:04:06 juju-e4d256-prod-github-runner-207 kernel: [34820.566092] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 15:04:06 juju-e4d256-prod-github-runner-207 kernel: [34820.567266] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 15:04:06 juju-e4d256-prod-github-runner-207 kernel: [34820.568486] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 15:04:06 juju-e4d256-prod-github-runner-207 kernel: [34820.569739] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 15:04:06 juju-e4d256-prod-github-runner-207 kernel: [34820.570856] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 15:04:06 juju-e4d256-prod-github-runner-207 kernel: [34820.572077] Call Trace: Aug 22 15:04:06 juju-e4d256-prod-github-runner-207 kernel: [34820.573013] Aug 22 15:04:06 juju-e4d256-prod-github-runner-207 kernel: [34820.573912] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:04:06 juju-e4d256-prod-github-runner-207 kernel: [34820.574955] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:04:06 juju-e4d256-prod-github-runner-207 kernel: [34820.575983] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:04:06 juju-e4d256-prod-github-runner-207 kernel: [34820.577079] ? show_regs.part.0+0x23/0x29 Aug 22 15:04:06 juju-e4d256-prod-github-runner-207 kernel: [34820.578087] ? show_regs.cold+0x8/0xd Aug 22 15:04:06 juju-e4d256-prod-github-runner-207 kernel: [34820.579066] ? watchdog_timer_fn+0x1be/0x220 Aug 22 15:04:06 juju-e4d256-prod-github-runner-207 kernel: [34820.580079] ? lockup_detector_update_enable+0x60/0x60 Aug 22 15:04:06 juju-e4d256-prod-github-runner-207 kernel: [34820.581178] ? __hrtimer_run_queues+0x107/0x230 Aug 22 15:04:06 juju-e4d256-prod-github-runner-207 kernel: [34820.582216] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 15:04:06 juju-e4d256-prod-github-runner-207 kernel: [34820.583253] ? hrtimer_interrupt+0x101/0x220 Aug 22 15:04:06 juju-e4d256-prod-github-runner-207 kernel: [34820.584277] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 15:04:06 juju-e4d256-prod-github-runner-207 kernel: [34820.585367] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 15:04:06 juju-e4d256-prod-github-runner-207 kernel: [34820.586434] Aug 22 15:04:06 juju-e4d256-prod-github-runner-207 kernel: [34820.587300] Aug 22 15:04:06 juju-e4d256-prod-github-runner-207 kernel: [34820.588157] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 15:04:06 juju-e4d256-prod-github-runner-207 kernel: [34820.589214] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:04:06 juju-e4d256-prod-github-runner-207 kernel: [34820.590265] ? _raw_spin_lock+0x22/0x30 Aug 22 15:04:06 juju-e4d256-prod-github-runner-207 kernel: [34820.591222] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:04:06 juju-e4d256-prod-github-runner-207 kernel: [34820.592263] direct_page_fault+0x206/0x310 [kvm] Aug 22 15:04:06 juju-e4d256-prod-github-runner-207 kernel: [34820.593308] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 15:04:06 juju-e4d256-prod-github-runner-207 kernel: [34820.594321] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 15:04:06 juju-e4d256-prod-github-runner-207 kernel: [34820.595321] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 15:04:06 juju-e4d256-prod-github-runner-207 kernel: [34820.596308] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 15:04:06 juju-e4d256-prod-github-runner-207 kernel: [34820.597264] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 15:04:06 juju-e4d256-prod-github-runner-207 kernel: [34820.598381] handle_exit+0x98/0x230 [kvm_amd] Aug 22 15:04:06 juju-e4d256-prod-github-runner-207 kernel: [34820.599368] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 15:04:06 juju-e4d256-prod-github-runner-207 kernel: [34820.600375] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 15:04:06 juju-e4d256-prod-github-runner-207 kernel: [34820.601346] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 15:04:06 juju-e4d256-prod-github-runner-207 kernel: [34820.602281] vcpu_run+0x62/0x2c0 [kvm] Aug 22 15:04:06 juju-e4d256-prod-github-runner-207 kernel: [34820.603107] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 15:04:06 juju-e4d256-prod-github-runner-207 kernel: [34820.603924] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 15:04:06 juju-e4d256-prod-github-runner-207 kernel: [34820.604802] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 15:04:06 juju-e4d256-prod-github-runner-207 kernel: [34820.605607] ? __seccomp_filter+0x4a/0x4a0 Aug 22 15:04:06 juju-e4d256-prod-github-runner-207 kernel: [34820.606375] ? __fget_files+0x86/0xc0 Aug 22 15:04:06 juju-e4d256-prod-github-runner-207 kernel: [34820.607101] __x64_sys_ioctl+0x95/0xd0 Aug 22 15:04:06 juju-e4d256-prod-github-runner-207 kernel: [34820.607882] do_syscall_64+0x5c/0xc0 Aug 22 15:04:06 juju-e4d256-prod-github-runner-207 kernel: [34820.608653] ? do_futex+0x162/0x1f0 Aug 22 15:04:06 juju-e4d256-prod-github-runner-207 kernel: [34820.609391] ? __x64_sys_futex+0x78/0x1e0 Aug 22 15:04:06 juju-e4d256-prod-github-runner-207 kernel: [34820.610266] ? __secure_computing+0xa9/0x120 Aug 22 15:04:06 juju-e4d256-prod-github-runner-207 kernel: [34820.611175] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 15:04:06 juju-e4d256-prod-github-runner-207 kernel: [34820.611941] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:04:06 juju-e4d256-prod-github-runner-207 kernel: [34820.612668] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:04:06 juju-e4d256-prod-github-runner-207 kernel: [34820.613414] ? do_syscall_64+0x69/0xc0 Aug 22 15:04:06 juju-e4d256-prod-github-runner-207 kernel: [34820.614068] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:04:06 juju-e4d256-prod-github-runner-207 kernel: [34820.614781] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:04:06 juju-e4d256-prod-github-runner-207 kernel: [34820.615503] ? do_syscall_64+0x69/0xc0 Aug 22 15:04:06 juju-e4d256-prod-github-runner-207 kernel: [34820.616149] ? do_syscall_64+0x69/0xc0 Aug 22 15:04:06 juju-e4d256-prod-github-runner-207 kernel: [34820.616816] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 15:04:06 juju-e4d256-prod-github-runner-207 kernel: [34820.617634] RIP: 0033:0x7faa5d0edaff Aug 22 15:04:06 juju-e4d256-prod-github-runner-207 kernel: [34820.618361] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 15:04:06 juju-e4d256-prod-github-runner-207 kernel: [34820.620674] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 15:04:06 juju-e4d256-prod-github-runner-207 kernel: [34820.621742] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 15:04:06 juju-e4d256-prod-github-runner-207 kernel: [34820.622770] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 15:04:06 juju-e4d256-prod-github-runner-207 kernel: [34820.623795] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 15:04:06 juju-e4d256-prod-github-runner-207 kernel: [34820.624828] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 15:04:06 juju-e4d256-prod-github-runner-207 kernel: [34820.625868] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 15:04:06 juju-e4d256-prod-github-runner-207 kernel: [34820.626905] Aug 22 15:04:34 juju-e4d256-prod-github-runner-207 kernel: [34848.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 32347s! [qemu-system-x86:6715] Aug 22 15:04:34 juju-e4d256-prod-github-runner-207 kernel: [34848.543111] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 15:04:34 juju-e4d256-prod-github-runner-207 kernel: [34848.543186] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 15:04:34 juju-e4d256-prod-github-runner-207 kernel: [34848.555536] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 15:04:34 juju-e4d256-prod-github-runner-207 kernel: [34848.556834] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 15:04:34 juju-e4d256-prod-github-runner-207 kernel: [34848.558055] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:04:34 juju-e4d256-prod-github-runner-207 kernel: [34848.559110] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 15:04:34 juju-e4d256-prod-github-runner-207 kernel: [34848.561676] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 15:04:34 juju-e4d256-prod-github-runner-207 kernel: [34848.562717] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 15:04:34 juju-e4d256-prod-github-runner-207 kernel: [34848.563880] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 15:04:34 juju-e4d256-prod-github-runner-207 kernel: [34848.565060] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 15:04:34 juju-e4d256-prod-github-runner-207 kernel: [34848.566218] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 15:04:34 juju-e4d256-prod-github-runner-207 kernel: [34848.567381] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 15:04:34 juju-e4d256-prod-github-runner-207 kernel: [34848.568555] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 15:04:34 juju-e4d256-prod-github-runner-207 kernel: [34848.569790] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 15:04:34 juju-e4d256-prod-github-runner-207 kernel: [34848.570889] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 15:04:34 juju-e4d256-prod-github-runner-207 kernel: [34848.572080] Call Trace: Aug 22 15:04:34 juju-e4d256-prod-github-runner-207 kernel: [34848.572996] Aug 22 15:04:34 juju-e4d256-prod-github-runner-207 kernel: [34848.573890] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:04:34 juju-e4d256-prod-github-runner-207 kernel: [34848.574921] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:04:34 juju-e4d256-prod-github-runner-207 kernel: [34848.576158] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:04:34 juju-e4d256-prod-github-runner-207 kernel: [34848.577263] ? show_regs.part.0+0x23/0x29 Aug 22 15:04:34 juju-e4d256-prod-github-runner-207 kernel: [34848.578261] ? show_regs.cold+0x8/0xd Aug 22 15:04:34 juju-e4d256-prod-github-runner-207 kernel: [34848.579230] ? watchdog_timer_fn+0x1be/0x220 Aug 22 15:04:34 juju-e4d256-prod-github-runner-207 kernel: [34848.580236] ? lockup_detector_update_enable+0x60/0x60 Aug 22 15:04:34 juju-e4d256-prod-github-runner-207 kernel: [34848.581358] ? __hrtimer_run_queues+0x107/0x230 Aug 22 15:04:34 juju-e4d256-prod-github-runner-207 kernel: [34848.582448] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 15:04:34 juju-e4d256-prod-github-runner-207 kernel: [34848.583494] ? hrtimer_interrupt+0x101/0x220 Aug 22 15:04:34 juju-e4d256-prod-github-runner-207 kernel: [34848.584547] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 15:04:34 juju-e4d256-prod-github-runner-207 kernel: [34848.585632] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 15:04:34 juju-e4d256-prod-github-runner-207 kernel: [34848.586698] Aug 22 15:04:34 juju-e4d256-prod-github-runner-207 kernel: [34848.587602] Aug 22 15:04:34 juju-e4d256-prod-github-runner-207 kernel: [34848.588493] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 15:04:34 juju-e4d256-prod-github-runner-207 kernel: [34848.589531] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:04:34 juju-e4d256-prod-github-runner-207 kernel: [34848.590589] ? _raw_spin_lock+0x22/0x30 Aug 22 15:04:34 juju-e4d256-prod-github-runner-207 kernel: [34848.591556] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:04:34 juju-e4d256-prod-github-runner-207 kernel: [34848.592585] direct_page_fault+0x206/0x310 [kvm] Aug 22 15:04:34 juju-e4d256-prod-github-runner-207 kernel: [34848.593613] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 15:04:34 juju-e4d256-prod-github-runner-207 kernel: [34848.594623] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 15:04:34 juju-e4d256-prod-github-runner-207 kernel: [34848.595626] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 15:04:34 juju-e4d256-prod-github-runner-207 kernel: [34848.596622] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 15:04:34 juju-e4d256-prod-github-runner-207 kernel: [34848.597569] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 15:04:34 juju-e4d256-prod-github-runner-207 kernel: [34848.598549] handle_exit+0x98/0x230 [kvm_amd] Aug 22 15:04:34 juju-e4d256-prod-github-runner-207 kernel: [34848.599445] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 15:04:34 juju-e4d256-prod-github-runner-207 kernel: [34848.600364] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 15:04:34 juju-e4d256-prod-github-runner-207 kernel: [34848.601300] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 15:04:34 juju-e4d256-prod-github-runner-207 kernel: [34848.602203] vcpu_run+0x62/0x2c0 [kvm] Aug 22 15:04:34 juju-e4d256-prod-github-runner-207 kernel: [34848.603135] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 15:04:34 juju-e4d256-prod-github-runner-207 kernel: [34848.603946] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 15:04:34 juju-e4d256-prod-github-runner-207 kernel: [34848.604834] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 15:04:34 juju-e4d256-prod-github-runner-207 kernel: [34848.605639] ? __seccomp_filter+0x4a/0x4a0 Aug 22 15:04:34 juju-e4d256-prod-github-runner-207 kernel: [34848.606381] ? __fget_files+0x86/0xc0 Aug 22 15:04:34 juju-e4d256-prod-github-runner-207 kernel: [34848.607085] __x64_sys_ioctl+0x95/0xd0 Aug 22 15:04:34 juju-e4d256-prod-github-runner-207 kernel: [34848.607867] do_syscall_64+0x5c/0xc0 Aug 22 15:04:34 juju-e4d256-prod-github-runner-207 kernel: [34848.608726] ? do_futex+0x162/0x1f0 Aug 22 15:04:34 juju-e4d256-prod-github-runner-207 kernel: [34848.609376] ? __x64_sys_futex+0x78/0x1e0 Aug 22 15:04:34 juju-e4d256-prod-github-runner-207 kernel: [34848.610047] ? __secure_computing+0xa9/0x120 Aug 22 15:04:34 juju-e4d256-prod-github-runner-207 kernel: [34848.610734] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 15:04:34 juju-e4d256-prod-github-runner-207 kernel: [34848.611493] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:04:34 juju-e4d256-prod-github-runner-207 kernel: [34848.612212] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:04:34 juju-e4d256-prod-github-runner-207 kernel: [34848.612945] ? do_syscall_64+0x69/0xc0 Aug 22 15:04:34 juju-e4d256-prod-github-runner-207 kernel: [34848.613588] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:04:34 juju-e4d256-prod-github-runner-207 kernel: [34848.614290] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:04:34 juju-e4d256-prod-github-runner-207 kernel: [34848.614982] ? do_syscall_64+0x69/0xc0 Aug 22 15:04:34 juju-e4d256-prod-github-runner-207 kernel: [34848.615604] ? do_syscall_64+0x69/0xc0 Aug 22 15:04:34 juju-e4d256-prod-github-runner-207 kernel: [34848.616224] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 15:04:34 juju-e4d256-prod-github-runner-207 kernel: [34848.616940] RIP: 0033:0x7faa5d0edaff Aug 22 15:04:34 juju-e4d256-prod-github-runner-207 kernel: [34848.617563] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 15:04:34 juju-e4d256-prod-github-runner-207 kernel: [34848.619550] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 15:04:34 juju-e4d256-prod-github-runner-207 kernel: [34848.620482] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 15:04:34 juju-e4d256-prod-github-runner-207 kernel: [34848.621372] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 15:04:34 juju-e4d256-prod-github-runner-207 kernel: [34848.622263] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 15:04:34 juju-e4d256-prod-github-runner-207 kernel: [34848.623147] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 15:04:34 juju-e4d256-prod-github-runner-207 kernel: [34848.624036] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 15:04:34 juju-e4d256-prod-github-runner-207 kernel: [34848.624939] Aug 22 15:05:02 juju-e4d256-prod-github-runner-207 kernel: [34876.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 32373s! [qemu-system-x86:6715] Aug 22 15:05:02 juju-e4d256-prod-github-runner-207 kernel: [34876.543219] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 15:05:02 juju-e4d256-prod-github-runner-207 kernel: [34876.543470] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 15:05:02 juju-e4d256-prod-github-runner-207 kernel: [34876.555868] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 15:05:02 juju-e4d256-prod-github-runner-207 kernel: [34876.557179] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 15:05:02 juju-e4d256-prod-github-runner-207 kernel: [34876.558428] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:05:02 juju-e4d256-prod-github-runner-207 kernel: [34876.559499] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 15:05:02 juju-e4d256-prod-github-runner-207 kernel: [34876.562159] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 15:05:02 juju-e4d256-prod-github-runner-207 kernel: [34876.563216] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 15:05:02 juju-e4d256-prod-github-runner-207 kernel: [34876.564413] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 15:05:02 juju-e4d256-prod-github-runner-207 kernel: [34876.565593] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 15:05:02 juju-e4d256-prod-github-runner-207 kernel: [34876.566813] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 15:05:02 juju-e4d256-prod-github-runner-207 kernel: [34876.568006] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 15:05:02 juju-e4d256-prod-github-runner-207 kernel: [34876.569216] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 15:05:02 juju-e4d256-prod-github-runner-207 kernel: [34876.570463] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 15:05:02 juju-e4d256-prod-github-runner-207 kernel: [34876.571583] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 15:05:02 juju-e4d256-prod-github-runner-207 kernel: [34876.572811] Call Trace: Aug 22 15:05:02 juju-e4d256-prod-github-runner-207 kernel: [34876.573741] Aug 22 15:05:02 juju-e4d256-prod-github-runner-207 kernel: [34876.574645] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:05:02 juju-e4d256-prod-github-runner-207 kernel: [34876.575680] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:05:02 juju-e4d256-prod-github-runner-207 kernel: [34876.576755] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:05:02 juju-e4d256-prod-github-runner-207 kernel: [34876.577867] ? show_regs.part.0+0x23/0x29 Aug 22 15:05:02 juju-e4d256-prod-github-runner-207 kernel: [34876.578914] ? show_regs.cold+0x8/0xd Aug 22 15:05:02 juju-e4d256-prod-github-runner-207 kernel: [34876.580142] ? watchdog_timer_fn+0x1be/0x220 Aug 22 15:05:02 juju-e4d256-prod-github-runner-207 kernel: [34876.581223] ? lockup_detector_update_enable+0x60/0x60 Aug 22 15:05:02 juju-e4d256-prod-github-runner-207 kernel: [34876.582298] ? __hrtimer_run_queues+0x107/0x230 Aug 22 15:05:02 juju-e4d256-prod-github-runner-207 kernel: [34876.583349] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 15:05:02 juju-e4d256-prod-github-runner-207 kernel: [34876.584406] ? hrtimer_interrupt+0x101/0x220 Aug 22 15:05:02 juju-e4d256-prod-github-runner-207 kernel: [34876.585452] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 15:05:02 juju-e4d256-prod-github-runner-207 kernel: [34876.586543] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 15:05:02 juju-e4d256-prod-github-runner-207 kernel: [34876.587621] Aug 22 15:05:02 juju-e4d256-prod-github-runner-207 kernel: [34876.588496] Aug 22 15:05:02 juju-e4d256-prod-github-runner-207 kernel: [34876.589343] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 15:05:02 juju-e4d256-prod-github-runner-207 kernel: [34876.590392] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:05:02 juju-e4d256-prod-github-runner-207 kernel: [34876.591452] ? _raw_spin_lock+0x22/0x30 Aug 22 15:05:02 juju-e4d256-prod-github-runner-207 kernel: [34876.592425] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:05:02 juju-e4d256-prod-github-runner-207 kernel: [34876.593501] direct_page_fault+0x206/0x310 [kvm] Aug 22 15:05:02 juju-e4d256-prod-github-runner-207 kernel: [34876.594546] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 15:05:02 juju-e4d256-prod-github-runner-207 kernel: [34876.595606] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 15:05:02 juju-e4d256-prod-github-runner-207 kernel: [34876.596657] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 15:05:02 juju-e4d256-prod-github-runner-207 kernel: [34876.597683] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 15:05:02 juju-e4d256-prod-github-runner-207 kernel: [34876.598645] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 15:05:02 juju-e4d256-prod-github-runner-207 kernel: [34876.599635] handle_exit+0x98/0x230 [kvm_amd] Aug 22 15:05:02 juju-e4d256-prod-github-runner-207 kernel: [34876.600557] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 15:05:02 juju-e4d256-prod-github-runner-207 kernel: [34876.601488] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 15:05:02 juju-e4d256-prod-github-runner-207 kernel: [34876.602431] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 15:05:02 juju-e4d256-prod-github-runner-207 kernel: [34876.603355] vcpu_run+0x62/0x2c0 [kvm] Aug 22 15:05:02 juju-e4d256-prod-github-runner-207 kernel: [34876.604258] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 15:05:02 juju-e4d256-prod-github-runner-207 kernel: [34876.605086] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 15:05:02 juju-e4d256-prod-github-runner-207 kernel: [34876.605958] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 15:05:02 juju-e4d256-prod-github-runner-207 kernel: [34876.606772] ? __seccomp_filter+0x4a/0x4a0 Aug 22 15:05:02 juju-e4d256-prod-github-runner-207 kernel: [34876.607550] ? __fget_files+0x86/0xc0 Aug 22 15:05:02 juju-e4d256-prod-github-runner-207 kernel: [34876.608292] __x64_sys_ioctl+0x95/0xd0 Aug 22 15:05:02 juju-e4d256-prod-github-runner-207 kernel: [34876.608995] do_syscall_64+0x5c/0xc0 Aug 22 15:05:02 juju-e4d256-prod-github-runner-207 kernel: [34876.609686] ? do_futex+0x162/0x1f0 Aug 22 15:05:02 juju-e4d256-prod-github-runner-207 kernel: [34876.610342] ? __x64_sys_futex+0x78/0x1e0 Aug 22 15:05:02 juju-e4d256-prod-github-runner-207 kernel: [34876.611023] ? __secure_computing+0xa9/0x120 Aug 22 15:05:02 juju-e4d256-prod-github-runner-207 kernel: [34876.611728] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 15:05:02 juju-e4d256-prod-github-runner-207 kernel: [34876.612519] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:05:02 juju-e4d256-prod-github-runner-207 kernel: [34876.613256] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:05:02 juju-e4d256-prod-github-runner-207 kernel: [34876.613988] ? do_syscall_64+0x69/0xc0 Aug 22 15:05:02 juju-e4d256-prod-github-runner-207 kernel: [34876.614646] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:05:02 juju-e4d256-prod-github-runner-207 kernel: [34876.615357] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:05:02 juju-e4d256-prod-github-runner-207 kernel: [34876.616083] ? do_syscall_64+0x69/0xc0 Aug 22 15:05:02 juju-e4d256-prod-github-runner-207 kernel: [34876.616725] ? do_syscall_64+0x69/0xc0 Aug 22 15:05:02 juju-e4d256-prod-github-runner-207 kernel: [34876.617375] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 15:05:02 juju-e4d256-prod-github-runner-207 kernel: [34876.618133] RIP: 0033:0x7faa5d0edaff Aug 22 15:05:02 juju-e4d256-prod-github-runner-207 kernel: [34876.618801] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 15:05:02 juju-e4d256-prod-github-runner-207 kernel: [34876.620859] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 15:05:02 juju-e4d256-prod-github-runner-207 kernel: [34876.621792] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 15:05:02 juju-e4d256-prod-github-runner-207 kernel: [34876.622707] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 15:05:02 juju-e4d256-prod-github-runner-207 kernel: [34876.623623] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 15:05:02 juju-e4d256-prod-github-runner-207 kernel: [34876.624555] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 15:05:02 juju-e4d256-prod-github-runner-207 kernel: [34876.625484] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 15:05:02 juju-e4d256-prod-github-runner-207 kernel: [34876.626396] Aug 22 15:05:30 juju-e4d256-prod-github-runner-207 kernel: [34904.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 32399s! [qemu-system-x86:6715] Aug 22 15:05:30 juju-e4d256-prod-github-runner-207 kernel: [34904.543867] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 15:05:30 juju-e4d256-prod-github-runner-207 kernel: [34904.544044] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 15:05:30 juju-e4d256-prod-github-runner-207 kernel: [34904.556482] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 15:05:30 juju-e4d256-prod-github-runner-207 kernel: [34904.557778] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 15:05:30 juju-e4d256-prod-github-runner-207 kernel: [34904.559040] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:05:30 juju-e4d256-prod-github-runner-207 kernel: [34904.560139] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 15:05:30 juju-e4d256-prod-github-runner-207 kernel: [34904.562753] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 15:05:30 juju-e4d256-prod-github-runner-207 kernel: [34904.563839] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 15:05:30 juju-e4d256-prod-github-runner-207 kernel: [34904.565031] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 15:05:30 juju-e4d256-prod-github-runner-207 kernel: [34904.566213] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 15:05:30 juju-e4d256-prod-github-runner-207 kernel: [34904.567411] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 15:05:30 juju-e4d256-prod-github-runner-207 kernel: [34904.568613] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 15:05:30 juju-e4d256-prod-github-runner-207 kernel: [34904.569804] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 15:05:30 juju-e4d256-prod-github-runner-207 kernel: [34904.571063] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 15:05:30 juju-e4d256-prod-github-runner-207 kernel: [34904.572275] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 15:05:30 juju-e4d256-prod-github-runner-207 kernel: [34904.573624] Call Trace: Aug 22 15:05:30 juju-e4d256-prod-github-runner-207 kernel: [34904.574543] Aug 22 15:05:30 juju-e4d256-prod-github-runner-207 kernel: [34904.575432] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:05:30 juju-e4d256-prod-github-runner-207 kernel: [34904.576490] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:05:30 juju-e4d256-prod-github-runner-207 kernel: [34904.577523] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:05:30 juju-e4d256-prod-github-runner-207 kernel: [34904.578625] ? show_regs.part.0+0x23/0x29 Aug 22 15:05:30 juju-e4d256-prod-github-runner-207 kernel: [34904.579636] ? show_regs.cold+0x8/0xd Aug 22 15:05:30 juju-e4d256-prod-github-runner-207 kernel: [34904.580628] ? watchdog_timer_fn+0x1be/0x220 Aug 22 15:05:30 juju-e4d256-prod-github-runner-207 kernel: [34904.581648] ? lockup_detector_update_enable+0x60/0x60 Aug 22 15:05:30 juju-e4d256-prod-github-runner-207 kernel: [34904.582846] ? __hrtimer_run_queues+0x107/0x230 Aug 22 15:05:30 juju-e4d256-prod-github-runner-207 kernel: [34904.583899] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 15:05:30 juju-e4d256-prod-github-runner-207 kernel: [34904.584938] ? hrtimer_interrupt+0x101/0x220 Aug 22 15:05:30 juju-e4d256-prod-github-runner-207 kernel: [34904.585971] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 15:05:30 juju-e4d256-prod-github-runner-207 kernel: [34904.587362] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 15:05:30 juju-e4d256-prod-github-runner-207 kernel: [34904.588460] Aug 22 15:05:30 juju-e4d256-prod-github-runner-207 kernel: [34904.589324] Aug 22 15:05:30 juju-e4d256-prod-github-runner-207 kernel: [34904.590172] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 15:05:30 juju-e4d256-prod-github-runner-207 kernel: [34904.591338] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:05:30 juju-e4d256-prod-github-runner-207 kernel: [34904.592514] ? _raw_spin_lock+0x22/0x30 Aug 22 15:05:30 juju-e4d256-prod-github-runner-207 kernel: [34904.593487] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:05:30 juju-e4d256-prod-github-runner-207 kernel: [34904.594525] direct_page_fault+0x206/0x310 [kvm] Aug 22 15:05:30 juju-e4d256-prod-github-runner-207 kernel: [34904.595564] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 15:05:30 juju-e4d256-prod-github-runner-207 kernel: [34904.596625] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 15:05:30 juju-e4d256-prod-github-runner-207 kernel: [34904.597640] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 15:05:30 juju-e4d256-prod-github-runner-207 kernel: [34904.598644] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 15:05:30 juju-e4d256-prod-github-runner-207 kernel: [34904.599609] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 15:05:30 juju-e4d256-prod-github-runner-207 kernel: [34904.600616] handle_exit+0x98/0x230 [kvm_amd] Aug 22 15:05:30 juju-e4d256-prod-github-runner-207 kernel: [34904.601521] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 15:05:30 juju-e4d256-prod-github-runner-207 kernel: [34904.602474] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 15:05:30 juju-e4d256-prod-github-runner-207 kernel: [34904.603437] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 15:05:30 juju-e4d256-prod-github-runner-207 kernel: [34904.604390] vcpu_run+0x62/0x2c0 [kvm] Aug 22 15:05:30 juju-e4d256-prod-github-runner-207 kernel: [34904.605241] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 15:05:30 juju-e4d256-prod-github-runner-207 kernel: [34904.606074] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 15:05:30 juju-e4d256-prod-github-runner-207 kernel: [34904.606948] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 15:05:30 juju-e4d256-prod-github-runner-207 kernel: [34904.607782] ? __seccomp_filter+0x4a/0x4a0 Aug 22 15:05:30 juju-e4d256-prod-github-runner-207 kernel: [34904.608537] ? __fget_files+0x86/0xc0 Aug 22 15:05:30 juju-e4d256-prod-github-runner-207 kernel: [34904.609270] __x64_sys_ioctl+0x95/0xd0 Aug 22 15:05:30 juju-e4d256-prod-github-runner-207 kernel: [34904.610051] do_syscall_64+0x5c/0xc0 Aug 22 15:05:30 juju-e4d256-prod-github-runner-207 kernel: [34904.610961] ? do_futex+0x162/0x1f0 Aug 22 15:05:30 juju-e4d256-prod-github-runner-207 kernel: [34904.611890] ? __x64_sys_futex+0x78/0x1e0 Aug 22 15:05:30 juju-e4d256-prod-github-runner-207 kernel: [34904.612600] ? __secure_computing+0xa9/0x120 Aug 22 15:05:30 juju-e4d256-prod-github-runner-207 kernel: [34904.613323] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 15:05:30 juju-e4d256-prod-github-runner-207 kernel: [34904.614120] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:05:30 juju-e4d256-prod-github-runner-207 kernel: [34904.614870] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:05:30 juju-e4d256-prod-github-runner-207 kernel: [34904.615622] ? do_syscall_64+0x69/0xc0 Aug 22 15:05:30 juju-e4d256-prod-github-runner-207 kernel: [34904.616308] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:05:30 juju-e4d256-prod-github-runner-207 kernel: [34904.617038] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:05:30 juju-e4d256-prod-github-runner-207 kernel: [34904.617765] ? do_syscall_64+0x69/0xc0 Aug 22 15:05:30 juju-e4d256-prod-github-runner-207 kernel: [34904.618424] ? do_syscall_64+0x69/0xc0 Aug 22 15:05:30 juju-e4d256-prod-github-runner-207 kernel: [34904.619101] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 15:05:30 juju-e4d256-prod-github-runner-207 kernel: [34904.619916] RIP: 0033:0x7faa5d0edaff Aug 22 15:05:30 juju-e4d256-prod-github-runner-207 kernel: [34904.620619] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 15:05:30 juju-e4d256-prod-github-runner-207 kernel: [34904.622857] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 15:05:30 juju-e4d256-prod-github-runner-207 kernel: [34904.623865] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 15:05:30 juju-e4d256-prod-github-runner-207 kernel: [34904.624787] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 15:05:30 juju-e4d256-prod-github-runner-207 kernel: [34904.625704] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 15:05:30 juju-e4d256-prod-github-runner-207 kernel: [34904.626639] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 15:05:30 juju-e4d256-prod-github-runner-207 kernel: [34904.627562] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 15:05:30 juju-e4d256-prod-github-runner-207 kernel: [34904.628494] Aug 22 15:05:45 juju-e4d256-prod-github-runner-207 kernel: [34919.516706] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 15:05:45 juju-e4d256-prod-github-runner-207 kernel: [34919.517673] rcu: 1-....: (8673336 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=4190251 Aug 22 15:05:45 juju-e4d256-prod-github-runner-207 kernel: [34919.518793] (t=8700579 jiffies g=23269 q=37023) Aug 22 15:05:45 juju-e4d256-prod-github-runner-207 kernel: [34919.519603] NMI backtrace for cpu 1 Aug 22 15:05:45 juju-e4d256-prod-github-runner-207 kernel: [34919.520314] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 15:05:45 juju-e4d256-prod-github-runner-207 kernel: [34919.521420] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 15:05:45 juju-e4d256-prod-github-runner-207 kernel: [34919.522480] Call Trace: Aug 22 15:05:45 juju-e4d256-prod-github-runner-207 kernel: [34919.523234] Aug 22 15:05:45 juju-e4d256-prod-github-runner-207 kernel: [34919.523908] show_stack+0x52/0x5c Aug 22 15:05:45 juju-e4d256-prod-github-runner-207 kernel: [34919.524636] dump_stack_lvl+0x4a/0x63 Aug 22 15:05:45 juju-e4d256-prod-github-runner-207 kernel: [34919.525384] dump_stack+0x10/0x16 Aug 22 15:05:45 juju-e4d256-prod-github-runner-207 kernel: [34919.526107] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 15:05:45 juju-e4d256-prod-github-runner-207 kernel: [34919.526914] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 15:05:45 juju-e4d256-prod-github-runner-207 kernel: [34919.527717] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 15:05:45 juju-e4d256-prod-github-runner-207 kernel: [34919.528537] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 15:05:45 juju-e4d256-prod-github-runner-207 kernel: [34919.529383] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 15:05:45 juju-e4d256-prod-github-runner-207 kernel: [34919.530211] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 15:05:45 juju-e4d256-prod-github-runner-207 kernel: [34919.530983] print_cpu_stall.cold+0x2f/0xe2 Aug 22 15:05:45 juju-e4d256-prod-github-runner-207 kernel: [34919.531760] ? timekeeping_update+0xf7/0x150 Aug 22 15:05:45 juju-e4d256-prod-github-runner-207 kernel: [34919.532531] check_cpu_stall+0x109/0x270 Aug 22 15:05:45 juju-e4d256-prod-github-runner-207 kernel: [34919.533404] rcu_sched_clock_irq+0x9a/0x250 Aug 22 15:05:45 juju-e4d256-prod-github-runner-207 kernel: [34919.534172] update_process_times+0x94/0xd0 Aug 22 15:05:45 juju-e4d256-prod-github-runner-207 kernel: [34919.534929] tick_sched_handle+0x29/0x70 Aug 22 15:05:45 juju-e4d256-prod-github-runner-207 kernel: [34919.535699] tick_sched_timer+0x8c/0xc0 Aug 22 15:05:45 juju-e4d256-prod-github-runner-207 kernel: [34919.536438] ? tick_nohz_handler+0xb0/0xb0 Aug 22 15:05:45 juju-e4d256-prod-github-runner-207 kernel: [34919.537190] __hrtimer_run_queues+0x107/0x230 Aug 22 15:05:45 juju-e4d256-prod-github-runner-207 kernel: [34919.537966] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 15:05:45 juju-e4d256-prod-github-runner-207 kernel: [34919.538748] hrtimer_interrupt+0x101/0x220 Aug 22 15:05:45 juju-e4d256-prod-github-runner-207 kernel: [34919.539554] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 15:05:45 juju-e4d256-prod-github-runner-207 kernel: [34919.540427] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 15:05:45 juju-e4d256-prod-github-runner-207 kernel: [34919.541229] Aug 22 15:05:45 juju-e4d256-prod-github-runner-207 kernel: [34919.541868] Aug 22 15:05:45 juju-e4d256-prod-github-runner-207 kernel: [34919.542496] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 15:05:45 juju-e4d256-prod-github-runner-207 kernel: [34919.543382] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:05:45 juju-e4d256-prod-github-runner-207 kernel: [34919.544285] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 15:05:45 juju-e4d256-prod-github-runner-207 kernel: [34919.546492] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 15:05:45 juju-e4d256-prod-github-runner-207 kernel: [34919.547371] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 15:05:45 juju-e4d256-prod-github-runner-207 kernel: [34919.548380] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 15:05:45 juju-e4d256-prod-github-runner-207 kernel: [34919.549369] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 15:05:45 juju-e4d256-prod-github-runner-207 kernel: [34919.550329] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 15:05:45 juju-e4d256-prod-github-runner-207 kernel: [34919.551292] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 15:05:45 juju-e4d256-prod-github-runner-207 kernel: [34919.552292] ? _raw_spin_lock+0x22/0x30 Aug 22 15:05:45 juju-e4d256-prod-github-runner-207 kernel: [34919.553054] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:05:45 juju-e4d256-prod-github-runner-207 kernel: [34919.553888] direct_page_fault+0x206/0x310 [kvm] Aug 22 15:05:45 juju-e4d256-prod-github-runner-207 kernel: [34919.554730] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 15:05:45 juju-e4d256-prod-github-runner-207 kernel: [34919.555593] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 15:05:45 juju-e4d256-prod-github-runner-207 kernel: [34919.556419] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 15:05:45 juju-e4d256-prod-github-runner-207 kernel: [34919.557223] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 15:05:45 juju-e4d256-prod-github-runner-207 kernel: [34919.558027] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 15:05:45 juju-e4d256-prod-github-runner-207 kernel: [34919.558849] handle_exit+0x98/0x230 [kvm_amd] Aug 22 15:05:45 juju-e4d256-prod-github-runner-207 kernel: [34919.559624] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 15:05:45 juju-e4d256-prod-github-runner-207 kernel: [34919.560449] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 15:05:45 juju-e4d256-prod-github-runner-207 kernel: [34919.561255] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 15:05:45 juju-e4d256-prod-github-runner-207 kernel: [34919.562044] vcpu_run+0x62/0x2c0 [kvm] Aug 22 15:05:45 juju-e4d256-prod-github-runner-207 kernel: [34919.562761] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 15:05:45 juju-e4d256-prod-github-runner-207 kernel: [34919.563499] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 15:05:45 juju-e4d256-prod-github-runner-207 kernel: [34919.564317] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 15:05:45 juju-e4d256-prod-github-runner-207 kernel: [34919.565076] ? __seccomp_filter+0x4a/0x4a0 Aug 22 15:05:45 juju-e4d256-prod-github-runner-207 kernel: [34919.565794] ? __fget_files+0x86/0xc0 Aug 22 15:05:45 juju-e4d256-prod-github-runner-207 kernel: [34919.566486] __x64_sys_ioctl+0x95/0xd0 Aug 22 15:05:45 juju-e4d256-prod-github-runner-207 kernel: [34919.567179] do_syscall_64+0x5c/0xc0 Aug 22 15:05:45 juju-e4d256-prod-github-runner-207 kernel: [34919.567882] ? do_futex+0x162/0x1f0 Aug 22 15:05:45 juju-e4d256-prod-github-runner-207 kernel: [34919.568555] ? __x64_sys_futex+0x78/0x1e0 Aug 22 15:05:45 juju-e4d256-prod-github-runner-207 kernel: [34919.569255] ? __secure_computing+0xa9/0x120 Aug 22 15:05:45 juju-e4d256-prod-github-runner-207 kernel: [34919.569972] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 15:05:45 juju-e4d256-prod-github-runner-207 kernel: [34919.570761] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:05:45 juju-e4d256-prod-github-runner-207 kernel: [34919.571513] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:05:45 juju-e4d256-prod-github-runner-207 kernel: [34919.572298] ? do_syscall_64+0x69/0xc0 Aug 22 15:05:45 juju-e4d256-prod-github-runner-207 kernel: [34919.573002] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:05:45 juju-e4d256-prod-github-runner-207 kernel: [34919.573760] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:05:45 juju-e4d256-prod-github-runner-207 kernel: [34919.574516] ? do_syscall_64+0x69/0xc0 Aug 22 15:05:45 juju-e4d256-prod-github-runner-207 kernel: [34919.575210] ? do_syscall_64+0x69/0xc0 Aug 22 15:05:45 juju-e4d256-prod-github-runner-207 kernel: [34919.575914] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 15:05:45 juju-e4d256-prod-github-runner-207 kernel: [34919.576749] RIP: 0033:0x7faa5d0edaff Aug 22 15:05:45 juju-e4d256-prod-github-runner-207 kernel: [34919.577435] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 15:05:45 juju-e4d256-prod-github-runner-207 kernel: [34919.579546] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 15:05:45 juju-e4d256-prod-github-runner-207 kernel: [34919.580530] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 15:05:45 juju-e4d256-prod-github-runner-207 kernel: [34919.581479] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 15:05:45 juju-e4d256-prod-github-runner-207 kernel: [34919.582442] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 15:05:45 juju-e4d256-prod-github-runner-207 kernel: [34919.583389] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 15:05:45 juju-e4d256-prod-github-runner-207 kernel: [34919.584357] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 15:05:45 juju-e4d256-prod-github-runner-207 kernel: [34919.585273] Aug 22 15:06:10 juju-e4d256-prod-github-runner-207 kernel: [34944.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 32436s! [qemu-system-x86:6715] Aug 22 15:06:10 juju-e4d256-prod-github-runner-207 kernel: [34944.543419] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 15:06:10 juju-e4d256-prod-github-runner-207 kernel: [34944.543494] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 15:06:10 juju-e4d256-prod-github-runner-207 kernel: [34944.556758] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 15:06:10 juju-e4d256-prod-github-runner-207 kernel: [34944.558043] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 15:06:10 juju-e4d256-prod-github-runner-207 kernel: [34944.559258] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:06:10 juju-e4d256-prod-github-runner-207 kernel: [34944.560332] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 15:06:10 juju-e4d256-prod-github-runner-207 kernel: [34944.562863] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 15:06:10 juju-e4d256-prod-github-runner-207 kernel: [34944.563923] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 15:06:10 juju-e4d256-prod-github-runner-207 kernel: [34944.565080] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 15:06:10 juju-e4d256-prod-github-runner-207 kernel: [34944.566235] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 15:06:10 juju-e4d256-prod-github-runner-207 kernel: [34944.567652] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 15:06:10 juju-e4d256-prod-github-runner-207 kernel: [34944.568837] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 15:06:10 juju-e4d256-prod-github-runner-207 kernel: [34944.570005] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 15:06:10 juju-e4d256-prod-github-runner-207 kernel: [34944.571238] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 15:06:10 juju-e4d256-prod-github-runner-207 kernel: [34944.572368] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 15:06:10 juju-e4d256-prod-github-runner-207 kernel: [34944.573580] Call Trace: Aug 22 15:06:10 juju-e4d256-prod-github-runner-207 kernel: [34944.574503] Aug 22 15:06:10 juju-e4d256-prod-github-runner-207 kernel: [34944.575412] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:06:10 juju-e4d256-prod-github-runner-207 kernel: [34944.576471] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:06:10 juju-e4d256-prod-github-runner-207 kernel: [34944.577521] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:06:10 juju-e4d256-prod-github-runner-207 kernel: [34944.578645] ? show_regs.part.0+0x23/0x29 Aug 22 15:06:10 juju-e4d256-prod-github-runner-207 kernel: [34944.579685] ? show_regs.cold+0x8/0xd Aug 22 15:06:10 juju-e4d256-prod-github-runner-207 kernel: [34944.580661] ? watchdog_timer_fn+0x1be/0x220 Aug 22 15:06:10 juju-e4d256-prod-github-runner-207 kernel: [34944.581670] ? lockup_detector_update_enable+0x60/0x60 Aug 22 15:06:10 juju-e4d256-prod-github-runner-207 kernel: [34944.582759] ? __hrtimer_run_queues+0x107/0x230 Aug 22 15:06:10 juju-e4d256-prod-github-runner-207 kernel: [34944.583840] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 15:06:10 juju-e4d256-prod-github-runner-207 kernel: [34944.584875] ? hrtimer_interrupt+0x101/0x220 Aug 22 15:06:10 juju-e4d256-prod-github-runner-207 kernel: [34944.585920] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 15:06:10 juju-e4d256-prod-github-runner-207 kernel: [34944.587006] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 15:06:10 juju-e4d256-prod-github-runner-207 kernel: [34944.588113] Aug 22 15:06:10 juju-e4d256-prod-github-runner-207 kernel: [34944.588987] Aug 22 15:06:10 juju-e4d256-prod-github-runner-207 kernel: [34944.589828] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 15:06:10 juju-e4d256-prod-github-runner-207 kernel: [34944.590864] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:06:10 juju-e4d256-prod-github-runner-207 kernel: [34944.591924] ? _raw_spin_lock+0x22/0x30 Aug 22 15:06:10 juju-e4d256-prod-github-runner-207 kernel: [34944.592884] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:06:10 juju-e4d256-prod-github-runner-207 kernel: [34944.593922] direct_page_fault+0x206/0x310 [kvm] Aug 22 15:06:10 juju-e4d256-prod-github-runner-207 kernel: [34944.594952] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 15:06:10 juju-e4d256-prod-github-runner-207 kernel: [34944.595979] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 15:06:10 juju-e4d256-prod-github-runner-207 kernel: [34944.596984] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 15:06:10 juju-e4d256-prod-github-runner-207 kernel: [34944.597971] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 15:06:10 juju-e4d256-prod-github-runner-207 kernel: [34944.598978] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 15:06:10 juju-e4d256-prod-github-runner-207 kernel: [34944.600001] handle_exit+0x98/0x230 [kvm_amd] Aug 22 15:06:10 juju-e4d256-prod-github-runner-207 kernel: [34944.600901] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 15:06:10 juju-e4d256-prod-github-runner-207 kernel: [34944.601827] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 15:06:10 juju-e4d256-prod-github-runner-207 kernel: [34944.602765] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 15:06:10 juju-e4d256-prod-github-runner-207 kernel: [34944.603706] vcpu_run+0x62/0x2c0 [kvm] Aug 22 15:06:10 juju-e4d256-prod-github-runner-207 kernel: [34944.604523] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 15:06:10 juju-e4d256-prod-github-runner-207 kernel: [34944.605337] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 15:06:10 juju-e4d256-prod-github-runner-207 kernel: [34944.606197] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 15:06:10 juju-e4d256-prod-github-runner-207 kernel: [34944.606999] ? __seccomp_filter+0x4a/0x4a0 Aug 22 15:06:10 juju-e4d256-prod-github-runner-207 kernel: [34944.607772] ? __fget_files+0x86/0xc0 Aug 22 15:06:10 juju-e4d256-prod-github-runner-207 kernel: [34944.608491] __x64_sys_ioctl+0x95/0xd0 Aug 22 15:06:10 juju-e4d256-prod-github-runner-207 kernel: [34944.609209] do_syscall_64+0x5c/0xc0 Aug 22 15:06:10 juju-e4d256-prod-github-runner-207 kernel: [34944.609883] ? do_futex+0x162/0x1f0 Aug 22 15:06:10 juju-e4d256-prod-github-runner-207 kernel: [34944.610537] ? __x64_sys_futex+0x78/0x1e0 Aug 22 15:06:10 juju-e4d256-prod-github-runner-207 kernel: [34944.611214] ? __secure_computing+0xa9/0x120 Aug 22 15:06:10 juju-e4d256-prod-github-runner-207 kernel: [34944.611929] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 15:06:10 juju-e4d256-prod-github-runner-207 kernel: [34944.612708] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:06:10 juju-e4d256-prod-github-runner-207 kernel: [34944.613463] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:06:10 juju-e4d256-prod-github-runner-207 kernel: [34944.614197] ? do_syscall_64+0x69/0xc0 Aug 22 15:06:10 juju-e4d256-prod-github-runner-207 kernel: [34944.614856] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:06:10 juju-e4d256-prod-github-runner-207 kernel: [34944.615603] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:06:10 juju-e4d256-prod-github-runner-207 kernel: [34944.616305] ? do_syscall_64+0x69/0xc0 Aug 22 15:06:10 juju-e4d256-prod-github-runner-207 kernel: [34944.616940] ? do_syscall_64+0x69/0xc0 Aug 22 15:06:10 juju-e4d256-prod-github-runner-207 kernel: [34944.617568] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 15:06:10 juju-e4d256-prod-github-runner-207 kernel: [34944.618305] RIP: 0033:0x7faa5d0edaff Aug 22 15:06:10 juju-e4d256-prod-github-runner-207 kernel: [34944.618956] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 15:06:10 juju-e4d256-prod-github-runner-207 kernel: [34944.621007] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 15:06:10 juju-e4d256-prod-github-runner-207 kernel: [34944.621969] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 15:06:10 juju-e4d256-prod-github-runner-207 kernel: [34944.622863] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 15:06:10 juju-e4d256-prod-github-runner-207 kernel: [34944.623796] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 15:06:10 juju-e4d256-prod-github-runner-207 kernel: [34944.624701] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 15:06:10 juju-e4d256-prod-github-runner-207 kernel: [34944.625598] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 15:06:10 juju-e4d256-prod-github-runner-207 kernel: [34944.626494] Aug 22 15:06:38 juju-e4d256-prod-github-runner-207 kernel: [34972.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 32462s! [qemu-system-x86:6715] Aug 22 15:06:38 juju-e4d256-prod-github-runner-207 kernel: [34972.543897] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 15:06:38 juju-e4d256-prod-github-runner-207 kernel: [34972.544194] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 15:06:38 juju-e4d256-prod-github-runner-207 kernel: [34972.556601] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 15:06:38 juju-e4d256-prod-github-runner-207 kernel: [34972.557894] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 15:06:38 juju-e4d256-prod-github-runner-207 kernel: [34972.559142] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:06:38 juju-e4d256-prod-github-runner-207 kernel: [34972.560215] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 15:06:38 juju-e4d256-prod-github-runner-207 kernel: [34972.562807] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 15:06:38 juju-e4d256-prod-github-runner-207 kernel: [34972.563882] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 15:06:38 juju-e4d256-prod-github-runner-207 kernel: [34972.565065] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 15:06:38 juju-e4d256-prod-github-runner-207 kernel: [34972.566245] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 15:06:38 juju-e4d256-prod-github-runner-207 kernel: [34972.567437] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 15:06:38 juju-e4d256-prod-github-runner-207 kernel: [34972.568620] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 15:06:38 juju-e4d256-prod-github-runner-207 kernel: [34972.569808] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 15:06:38 juju-e4d256-prod-github-runner-207 kernel: [34972.571074] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 15:06:38 juju-e4d256-prod-github-runner-207 kernel: [34972.572190] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 15:06:38 juju-e4d256-prod-github-runner-207 kernel: [34972.573404] Call Trace: Aug 22 15:06:38 juju-e4d256-prod-github-runner-207 kernel: [34972.574323] Aug 22 15:06:38 juju-e4d256-prod-github-runner-207 kernel: [34972.575236] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:06:38 juju-e4d256-prod-github-runner-207 kernel: [34972.576281] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:06:38 juju-e4d256-prod-github-runner-207 kernel: [34972.577313] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:06:38 juju-e4d256-prod-github-runner-207 kernel: [34972.578418] ? show_regs.part.0+0x23/0x29 Aug 22 15:06:38 juju-e4d256-prod-github-runner-207 kernel: [34972.579437] ? show_regs.cold+0x8/0xd Aug 22 15:06:38 juju-e4d256-prod-github-runner-207 kernel: [34972.580421] ? watchdog_timer_fn+0x1be/0x220 Aug 22 15:06:38 juju-e4d256-prod-github-runner-207 kernel: [34972.581440] ? lockup_detector_update_enable+0x60/0x60 Aug 22 15:06:38 juju-e4d256-prod-github-runner-207 kernel: [34972.582598] ? __hrtimer_run_queues+0x107/0x230 Aug 22 15:06:38 juju-e4d256-prod-github-runner-207 kernel: [34972.583933] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 15:06:38 juju-e4d256-prod-github-runner-207 kernel: [34972.585001] ? hrtimer_interrupt+0x101/0x220 Aug 22 15:06:38 juju-e4d256-prod-github-runner-207 kernel: [34972.586031] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 15:06:38 juju-e4d256-prod-github-runner-207 kernel: [34972.587128] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 15:06:38 juju-e4d256-prod-github-runner-207 kernel: [34972.588188] Aug 22 15:06:38 juju-e4d256-prod-github-runner-207 kernel: [34972.589053] Aug 22 15:06:38 juju-e4d256-prod-github-runner-207 kernel: [34972.589895] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 15:06:38 juju-e4d256-prod-github-runner-207 kernel: [34972.590958] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:06:38 juju-e4d256-prod-github-runner-207 kernel: [34972.592012] ? _raw_spin_lock+0x22/0x30 Aug 22 15:06:38 juju-e4d256-prod-github-runner-207 kernel: [34972.592977] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:06:38 juju-e4d256-prod-github-runner-207 kernel: [34972.594017] direct_page_fault+0x206/0x310 [kvm] Aug 22 15:06:38 juju-e4d256-prod-github-runner-207 kernel: [34972.595069] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 15:06:38 juju-e4d256-prod-github-runner-207 kernel: [34972.596090] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 15:06:38 juju-e4d256-prod-github-runner-207 kernel: [34972.597102] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 15:06:38 juju-e4d256-prod-github-runner-207 kernel: [34972.598113] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 15:06:38 juju-e4d256-prod-github-runner-207 kernel: [34972.599097] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 15:06:38 juju-e4d256-prod-github-runner-207 kernel: [34972.600090] handle_exit+0x98/0x230 [kvm_amd] Aug 22 15:06:38 juju-e4d256-prod-github-runner-207 kernel: [34972.600995] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 15:06:38 juju-e4d256-prod-github-runner-207 kernel: [34972.601926] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 15:06:38 juju-e4d256-prod-github-runner-207 kernel: [34972.602864] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 15:06:38 juju-e4d256-prod-github-runner-207 kernel: [34972.603787] vcpu_run+0x62/0x2c0 [kvm] Aug 22 15:06:38 juju-e4d256-prod-github-runner-207 kernel: [34972.604606] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 15:06:38 juju-e4d256-prod-github-runner-207 kernel: [34972.605431] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 15:06:38 juju-e4d256-prod-github-runner-207 kernel: [34972.606303] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 15:06:38 juju-e4d256-prod-github-runner-207 kernel: [34972.607121] ? __seccomp_filter+0x4a/0x4a0 Aug 22 15:06:38 juju-e4d256-prod-github-runner-207 kernel: [34972.607874] ? __fget_files+0x86/0xc0 Aug 22 15:06:38 juju-e4d256-prod-github-runner-207 kernel: [34972.608590] __x64_sys_ioctl+0x95/0xd0 Aug 22 15:06:38 juju-e4d256-prod-github-runner-207 kernel: [34972.609294] do_syscall_64+0x5c/0xc0 Aug 22 15:06:38 juju-e4d256-prod-github-runner-207 kernel: [34972.609968] ? do_futex+0x162/0x1f0 Aug 22 15:06:38 juju-e4d256-prod-github-runner-207 kernel: [34972.610630] ? __x64_sys_futex+0x78/0x1e0 Aug 22 15:06:38 juju-e4d256-prod-github-runner-207 kernel: [34972.611330] ? __secure_computing+0xa9/0x120 Aug 22 15:06:38 juju-e4d256-prod-github-runner-207 kernel: [34972.612035] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 15:06:38 juju-e4d256-prod-github-runner-207 kernel: [34972.612808] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:06:38 juju-e4d256-prod-github-runner-207 kernel: [34972.613540] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:06:38 juju-e4d256-prod-github-runner-207 kernel: [34972.614273] ? do_syscall_64+0x69/0xc0 Aug 22 15:06:38 juju-e4d256-prod-github-runner-207 kernel: [34972.614928] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:06:38 juju-e4d256-prod-github-runner-207 kernel: [34972.615651] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:06:38 juju-e4d256-prod-github-runner-207 kernel: [34972.616358] ? do_syscall_64+0x69/0xc0 Aug 22 15:06:38 juju-e4d256-prod-github-runner-207 kernel: [34972.616991] ? do_syscall_64+0x69/0xc0 Aug 22 15:06:38 juju-e4d256-prod-github-runner-207 kernel: [34972.617621] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 15:06:38 juju-e4d256-prod-github-runner-207 kernel: [34972.618343] RIP: 0033:0x7faa5d0edaff Aug 22 15:06:38 juju-e4d256-prod-github-runner-207 kernel: [34972.619006] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 15:06:38 juju-e4d256-prod-github-runner-207 kernel: [34972.621073] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 15:06:38 juju-e4d256-prod-github-runner-207 kernel: [34972.622018] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 15:06:38 juju-e4d256-prod-github-runner-207 kernel: [34972.622962] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 15:06:38 juju-e4d256-prod-github-runner-207 kernel: [34972.624051] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 15:06:38 juju-e4d256-prod-github-runner-207 kernel: [34972.624963] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 15:06:38 juju-e4d256-prod-github-runner-207 kernel: [34972.625877] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 15:06:38 juju-e4d256-prod-github-runner-207 kernel: [34972.626814] Aug 22 15:07:06 juju-e4d256-prod-github-runner-207 kernel: [35000.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 32488s! [qemu-system-x86:6715] Aug 22 15:07:06 juju-e4d256-prod-github-runner-207 kernel: [35000.543203] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 15:07:06 juju-e4d256-prod-github-runner-207 kernel: [35000.543278] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 15:07:06 juju-e4d256-prod-github-runner-207 kernel: [35000.555836] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 15:07:06 juju-e4d256-prod-github-runner-207 kernel: [35000.557109] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 15:07:06 juju-e4d256-prod-github-runner-207 kernel: [35000.558329] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:07:06 juju-e4d256-prod-github-runner-207 kernel: [35000.559428] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 15:07:06 juju-e4d256-prod-github-runner-207 kernel: [35000.561975] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 15:07:06 juju-e4d256-prod-github-runner-207 kernel: [35000.563031] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 15:07:06 juju-e4d256-prod-github-runner-207 kernel: [35000.564190] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 15:07:06 juju-e4d256-prod-github-runner-207 kernel: [35000.565364] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 15:07:06 juju-e4d256-prod-github-runner-207 kernel: [35000.566528] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 15:07:06 juju-e4d256-prod-github-runner-207 kernel: [35000.567696] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 15:07:06 juju-e4d256-prod-github-runner-207 kernel: [35000.568859] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 15:07:06 juju-e4d256-prod-github-runner-207 kernel: [35000.570085] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 15:07:06 juju-e4d256-prod-github-runner-207 kernel: [35000.571191] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 15:07:06 juju-e4d256-prod-github-runner-207 kernel: [35000.572389] Call Trace: Aug 22 15:07:06 juju-e4d256-prod-github-runner-207 kernel: [35000.573300] Aug 22 15:07:06 juju-e4d256-prod-github-runner-207 kernel: [35000.574182] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:07:06 juju-e4d256-prod-github-runner-207 kernel: [35000.575218] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:07:06 juju-e4d256-prod-github-runner-207 kernel: [35000.576238] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:07:06 juju-e4d256-prod-github-runner-207 kernel: [35000.577322] ? show_regs.part.0+0x23/0x29 Aug 22 15:07:06 juju-e4d256-prod-github-runner-207 kernel: [35000.578318] ? show_regs.cold+0x8/0xd Aug 22 15:07:06 juju-e4d256-prod-github-runner-207 kernel: [35000.579301] ? watchdog_timer_fn+0x1be/0x220 Aug 22 15:07:06 juju-e4d256-prod-github-runner-207 kernel: [35000.580309] ? lockup_detector_update_enable+0x60/0x60 Aug 22 15:07:06 juju-e4d256-prod-github-runner-207 kernel: [35000.581370] ? __hrtimer_run_queues+0x107/0x230 Aug 22 15:07:06 juju-e4d256-prod-github-runner-207 kernel: [35000.582394] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 15:07:06 juju-e4d256-prod-github-runner-207 kernel: [35000.583430] ? hrtimer_interrupt+0x101/0x220 Aug 22 15:07:06 juju-e4d256-prod-github-runner-207 kernel: [35000.584443] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 15:07:06 juju-e4d256-prod-github-runner-207 kernel: [35000.585515] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 15:07:06 juju-e4d256-prod-github-runner-207 kernel: [35000.586559] Aug 22 15:07:06 juju-e4d256-prod-github-runner-207 kernel: [35000.587421] Aug 22 15:07:06 juju-e4d256-prod-github-runner-207 kernel: [35000.588268] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 15:07:06 juju-e4d256-prod-github-runner-207 kernel: [35000.589422] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:07:06 juju-e4d256-prod-github-runner-207 kernel: [35000.590571] ? _raw_spin_lock+0x22/0x30 Aug 22 15:07:06 juju-e4d256-prod-github-runner-207 kernel: [35000.591616] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:07:06 juju-e4d256-prod-github-runner-207 kernel: [35000.592728] direct_page_fault+0x206/0x310 [kvm] Aug 22 15:07:06 juju-e4d256-prod-github-runner-207 kernel: [35000.593850] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 15:07:06 juju-e4d256-prod-github-runner-207 kernel: [35000.594976] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 15:07:06 juju-e4d256-prod-github-runner-207 kernel: [35000.596070] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 15:07:06 juju-e4d256-prod-github-runner-207 kernel: [35000.597137] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 15:07:06 juju-e4d256-prod-github-runner-207 kernel: [35000.598173] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 15:07:06 juju-e4d256-prod-github-runner-207 kernel: [35000.599274] handle_exit+0x98/0x230 [kvm_amd] Aug 22 15:07:06 juju-e4d256-prod-github-runner-207 kernel: [35000.600280] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 15:07:06 juju-e4d256-prod-github-runner-207 kernel: [35000.601289] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 15:07:06 juju-e4d256-prod-github-runner-207 kernel: [35000.602319] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 15:07:06 juju-e4d256-prod-github-runner-207 kernel: [35000.603341] vcpu_run+0x62/0x2c0 [kvm] Aug 22 15:07:06 juju-e4d256-prod-github-runner-207 kernel: [35000.604226] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 15:07:06 juju-e4d256-prod-github-runner-207 kernel: [35000.605122] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 15:07:06 juju-e4d256-prod-github-runner-207 kernel: [35000.606081] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 15:07:06 juju-e4d256-prod-github-runner-207 kernel: [35000.606988] ? __seccomp_filter+0x4a/0x4a0 Aug 22 15:07:06 juju-e4d256-prod-github-runner-207 kernel: [35000.607814] ? __fget_files+0x86/0xc0 Aug 22 15:07:06 juju-e4d256-prod-github-runner-207 kernel: [35000.608589] __x64_sys_ioctl+0x95/0xd0 Aug 22 15:07:06 juju-e4d256-prod-github-runner-207 kernel: [35000.609378] do_syscall_64+0x5c/0xc0 Aug 22 15:07:06 juju-e4d256-prod-github-runner-207 kernel: [35000.610114] ? do_futex+0x162/0x1f0 Aug 22 15:07:06 juju-e4d256-prod-github-runner-207 kernel: [35000.610863] ? __x64_sys_futex+0x78/0x1e0 Aug 22 15:07:06 juju-e4d256-prod-github-runner-207 kernel: [35000.611620] ? __secure_computing+0xa9/0x120 Aug 22 15:07:06 juju-e4d256-prod-github-runner-207 kernel: [35000.612397] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 15:07:06 juju-e4d256-prod-github-runner-207 kernel: [35000.613257] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:07:06 juju-e4d256-prod-github-runner-207 kernel: [35000.614069] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:07:06 juju-e4d256-prod-github-runner-207 kernel: [35000.614900] ? do_syscall_64+0x69/0xc0 Aug 22 15:07:06 juju-e4d256-prod-github-runner-207 kernel: [35000.615621] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:07:06 juju-e4d256-prod-github-runner-207 kernel: [35000.616416] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:07:06 juju-e4d256-prod-github-runner-207 kernel: [35000.617202] ? do_syscall_64+0x69/0xc0 Aug 22 15:07:06 juju-e4d256-prod-github-runner-207 kernel: [35000.617966] ? do_syscall_64+0x69/0xc0 Aug 22 15:07:06 juju-e4d256-prod-github-runner-207 kernel: [35000.618677] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 15:07:06 juju-e4d256-prod-github-runner-207 kernel: [35000.619479] RIP: 0033:0x7faa5d0edaff Aug 22 15:07:06 juju-e4d256-prod-github-runner-207 kernel: [35000.620198] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 15:07:06 juju-e4d256-prod-github-runner-207 kernel: [35000.622495] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 15:07:06 juju-e4d256-prod-github-runner-207 kernel: [35000.623563] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 15:07:06 juju-e4d256-prod-github-runner-207 kernel: [35000.624579] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 15:07:06 juju-e4d256-prod-github-runner-207 kernel: [35000.625601] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 15:07:06 juju-e4d256-prod-github-runner-207 kernel: [35000.626618] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 15:07:06 juju-e4d256-prod-github-runner-207 kernel: [35000.627659] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 15:07:06 juju-e4d256-prod-github-runner-207 kernel: [35000.628678] Aug 22 15:07:34 juju-e4d256-prod-github-runner-207 kernel: [35028.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 32514s! [qemu-system-x86:6715] Aug 22 15:07:34 juju-e4d256-prod-github-runner-207 kernel: [35028.543136] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 15:07:34 juju-e4d256-prod-github-runner-207 kernel: [35028.543210] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 15:07:34 juju-e4d256-prod-github-runner-207 kernel: [35028.555292] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 15:07:34 juju-e4d256-prod-github-runner-207 kernel: [35028.556565] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 15:07:34 juju-e4d256-prod-github-runner-207 kernel: [35028.557797] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:07:34 juju-e4d256-prod-github-runner-207 kernel: [35028.558884] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 15:07:34 juju-e4d256-prod-github-runner-207 kernel: [35028.561453] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 15:07:34 juju-e4d256-prod-github-runner-207 kernel: [35028.562517] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 15:07:34 juju-e4d256-prod-github-runner-207 kernel: [35028.563753] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 15:07:34 juju-e4d256-prod-github-runner-207 kernel: [35028.564965] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 15:07:34 juju-e4d256-prod-github-runner-207 kernel: [35028.566135] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 15:07:34 juju-e4d256-prod-github-runner-207 kernel: [35028.567309] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 15:07:34 juju-e4d256-prod-github-runner-207 kernel: [35028.568479] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 15:07:34 juju-e4d256-prod-github-runner-207 kernel: [35028.569715] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 15:07:34 juju-e4d256-prod-github-runner-207 kernel: [35028.570853] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 15:07:34 juju-e4d256-prod-github-runner-207 kernel: [35028.572061] Call Trace: Aug 22 15:07:34 juju-e4d256-prod-github-runner-207 kernel: [35028.572982] Aug 22 15:07:34 juju-e4d256-prod-github-runner-207 kernel: [35028.573869] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:07:34 juju-e4d256-prod-github-runner-207 kernel: [35028.574918] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:07:34 juju-e4d256-prod-github-runner-207 kernel: [35028.575965] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:07:34 juju-e4d256-prod-github-runner-207 kernel: [35028.577046] ? show_regs.part.0+0x23/0x29 Aug 22 15:07:34 juju-e4d256-prod-github-runner-207 kernel: [35028.578041] ? show_regs.cold+0x8/0xd Aug 22 15:07:34 juju-e4d256-prod-github-runner-207 kernel: [35028.579046] ? watchdog_timer_fn+0x1be/0x220 Aug 22 15:07:34 juju-e4d256-prod-github-runner-207 kernel: [35028.580058] ? lockup_detector_update_enable+0x60/0x60 Aug 22 15:07:34 juju-e4d256-prod-github-runner-207 kernel: [35028.581133] ? __hrtimer_run_queues+0x107/0x230 Aug 22 15:07:34 juju-e4d256-prod-github-runner-207 kernel: [35028.582160] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 15:07:34 juju-e4d256-prod-github-runner-207 kernel: [35028.583225] ? hrtimer_interrupt+0x101/0x220 Aug 22 15:07:34 juju-e4d256-prod-github-runner-207 kernel: [35028.584242] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 15:07:34 juju-e4d256-prod-github-runner-207 kernel: [35028.585317] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 15:07:34 juju-e4d256-prod-github-runner-207 kernel: [35028.586385] Aug 22 15:07:34 juju-e4d256-prod-github-runner-207 kernel: [35028.587236] Aug 22 15:07:34 juju-e4d256-prod-github-runner-207 kernel: [35028.588075] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 15:07:34 juju-e4d256-prod-github-runner-207 kernel: [35028.589117] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:07:34 juju-e4d256-prod-github-runner-207 kernel: [35028.590154] ? _raw_spin_lock+0x22/0x30 Aug 22 15:07:34 juju-e4d256-prod-github-runner-207 kernel: [35028.591129] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:07:34 juju-e4d256-prod-github-runner-207 kernel: [35028.592148] direct_page_fault+0x206/0x310 [kvm] Aug 22 15:07:34 juju-e4d256-prod-github-runner-207 kernel: [35028.593269] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 15:07:34 juju-e4d256-prod-github-runner-207 kernel: [35028.594288] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 15:07:34 juju-e4d256-prod-github-runner-207 kernel: [35028.595305] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 15:07:34 juju-e4d256-prod-github-runner-207 kernel: [35028.596294] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 15:07:34 juju-e4d256-prod-github-runner-207 kernel: [35028.597239] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 15:07:34 juju-e4d256-prod-github-runner-207 kernel: [35028.598219] handle_exit+0x98/0x230 [kvm_amd] Aug 22 15:07:34 juju-e4d256-prod-github-runner-207 kernel: [35028.599127] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 15:07:34 juju-e4d256-prod-github-runner-207 kernel: [35028.600038] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 15:07:34 juju-e4d256-prod-github-runner-207 kernel: [35028.600970] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 15:07:34 juju-e4d256-prod-github-runner-207 kernel: [35028.601874] vcpu_run+0x62/0x2c0 [kvm] Aug 22 15:07:34 juju-e4d256-prod-github-runner-207 kernel: [35028.602702] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 15:07:34 juju-e4d256-prod-github-runner-207 kernel: [35028.603510] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 15:07:34 juju-e4d256-prod-github-runner-207 kernel: [35028.604364] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 15:07:34 juju-e4d256-prod-github-runner-207 kernel: [35028.605160] ? __seccomp_filter+0x4a/0x4a0 Aug 22 15:07:34 juju-e4d256-prod-github-runner-207 kernel: [35028.605903] ? __fget_files+0x86/0xc0 Aug 22 15:07:34 juju-e4d256-prod-github-runner-207 kernel: [35028.606628] __x64_sys_ioctl+0x95/0xd0 Aug 22 15:07:34 juju-e4d256-prod-github-runner-207 kernel: [35028.607320] do_syscall_64+0x5c/0xc0 Aug 22 15:07:34 juju-e4d256-prod-github-runner-207 kernel: [35028.607989] ? do_futex+0x162/0x1f0 Aug 22 15:07:34 juju-e4d256-prod-github-runner-207 kernel: [35028.608636] ? __x64_sys_futex+0x78/0x1e0 Aug 22 15:07:34 juju-e4d256-prod-github-runner-207 kernel: [35028.609310] ? __secure_computing+0xa9/0x120 Aug 22 15:07:34 juju-e4d256-prod-github-runner-207 kernel: [35028.610000] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 15:07:34 juju-e4d256-prod-github-runner-207 kernel: [35028.610788] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:07:34 juju-e4d256-prod-github-runner-207 kernel: [35028.611519] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:07:34 juju-e4d256-prod-github-runner-207 kernel: [35028.612248] ? do_syscall_64+0x69/0xc0 Aug 22 15:07:34 juju-e4d256-prod-github-runner-207 kernel: [35028.612893] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:07:34 juju-e4d256-prod-github-runner-207 kernel: [35028.613595] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:07:34 juju-e4d256-prod-github-runner-207 kernel: [35028.614294] ? do_syscall_64+0x69/0xc0 Aug 22 15:07:34 juju-e4d256-prod-github-runner-207 kernel: [35028.614939] ? do_syscall_64+0x69/0xc0 Aug 22 15:07:34 juju-e4d256-prod-github-runner-207 kernel: [35028.615562] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 15:07:34 juju-e4d256-prod-github-runner-207 kernel: [35028.616275] RIP: 0033:0x7faa5d0edaff Aug 22 15:07:34 juju-e4d256-prod-github-runner-207 kernel: [35028.616927] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 15:07:34 juju-e4d256-prod-github-runner-207 kernel: [35028.618950] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 15:07:34 juju-e4d256-prod-github-runner-207 kernel: [35028.619989] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 15:07:34 juju-e4d256-prod-github-runner-207 kernel: [35028.620880] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 15:07:34 juju-e4d256-prod-github-runner-207 kernel: [35028.621781] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 15:07:34 juju-e4d256-prod-github-runner-207 kernel: [35028.622695] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 15:07:34 juju-e4d256-prod-github-runner-207 kernel: [35028.623812] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 15:07:34 juju-e4d256-prod-github-runner-207 kernel: [35028.624704] Aug 22 15:08:02 juju-e4d256-prod-github-runner-207 kernel: [35056.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 32540s! [qemu-system-x86:6715] Aug 22 15:08:02 juju-e4d256-prod-github-runner-207 kernel: [35056.543166] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 15:08:02 juju-e4d256-prod-github-runner-207 kernel: [35056.543268] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 15:08:02 juju-e4d256-prod-github-runner-207 kernel: [35056.555864] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 15:08:02 juju-e4d256-prod-github-runner-207 kernel: [35056.557157] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 15:08:02 juju-e4d256-prod-github-runner-207 kernel: [35056.558428] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:08:02 juju-e4d256-prod-github-runner-207 kernel: [35056.559502] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 15:08:02 juju-e4d256-prod-github-runner-207 kernel: [35056.562117] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 15:08:02 juju-e4d256-prod-github-runner-207 kernel: [35056.563176] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 15:08:02 juju-e4d256-prod-github-runner-207 kernel: [35056.564361] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 15:08:02 juju-e4d256-prod-github-runner-207 kernel: [35056.565537] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 15:08:02 juju-e4d256-prod-github-runner-207 kernel: [35056.566733] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 15:08:02 juju-e4d256-prod-github-runner-207 kernel: [35056.567909] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 15:08:02 juju-e4d256-prod-github-runner-207 kernel: [35056.569091] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 15:08:02 juju-e4d256-prod-github-runner-207 kernel: [35056.570356] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 15:08:02 juju-e4d256-prod-github-runner-207 kernel: [35056.571467] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 15:08:02 juju-e4d256-prod-github-runner-207 kernel: [35056.572682] Call Trace: Aug 22 15:08:02 juju-e4d256-prod-github-runner-207 kernel: [35056.573620] Aug 22 15:08:02 juju-e4d256-prod-github-runner-207 kernel: [35056.574533] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:08:02 juju-e4d256-prod-github-runner-207 kernel: [35056.575574] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:08:02 juju-e4d256-prod-github-runner-207 kernel: [35056.576608] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:08:02 juju-e4d256-prod-github-runner-207 kernel: [35056.577701] ? show_regs.part.0+0x23/0x29 Aug 22 15:08:02 juju-e4d256-prod-github-runner-207 kernel: [35056.578786] ? show_regs.cold+0x8/0xd Aug 22 15:08:02 juju-e4d256-prod-github-runner-207 kernel: [35056.579823] ? watchdog_timer_fn+0x1be/0x220 Aug 22 15:08:02 juju-e4d256-prod-github-runner-207 kernel: [35056.580839] ? lockup_detector_update_enable+0x60/0x60 Aug 22 15:08:02 juju-e4d256-prod-github-runner-207 kernel: [35056.581926] ? __hrtimer_run_queues+0x107/0x230 Aug 22 15:08:02 juju-e4d256-prod-github-runner-207 kernel: [35056.582979] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 15:08:02 juju-e4d256-prod-github-runner-207 kernel: [35056.584019] ? hrtimer_interrupt+0x101/0x220 Aug 22 15:08:02 juju-e4d256-prod-github-runner-207 kernel: [35056.585067] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 15:08:02 juju-e4d256-prod-github-runner-207 kernel: [35056.586427] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 15:08:02 juju-e4d256-prod-github-runner-207 kernel: [35056.587492] Aug 22 15:08:02 juju-e4d256-prod-github-runner-207 kernel: [35056.588348] Aug 22 15:08:02 juju-e4d256-prod-github-runner-207 kernel: [35056.589205] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 15:08:02 juju-e4d256-prod-github-runner-207 kernel: [35056.590267] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:08:02 juju-e4d256-prod-github-runner-207 kernel: [35056.591323] ? _raw_spin_lock+0x22/0x30 Aug 22 15:08:02 juju-e4d256-prod-github-runner-207 kernel: [35056.592278] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:08:02 juju-e4d256-prod-github-runner-207 kernel: [35056.593308] direct_page_fault+0x206/0x310 [kvm] Aug 22 15:08:02 juju-e4d256-prod-github-runner-207 kernel: [35056.594361] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 15:08:02 juju-e4d256-prod-github-runner-207 kernel: [35056.595385] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 15:08:02 juju-e4d256-prod-github-runner-207 kernel: [35056.596524] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 15:08:02 juju-e4d256-prod-github-runner-207 kernel: [35056.597635] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 15:08:02 juju-e4d256-prod-github-runner-207 kernel: [35056.598615] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 15:08:02 juju-e4d256-prod-github-runner-207 kernel: [35056.599610] handle_exit+0x98/0x230 [kvm_amd] Aug 22 15:08:02 juju-e4d256-prod-github-runner-207 kernel: [35056.600520] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 15:08:02 juju-e4d256-prod-github-runner-207 kernel: [35056.601446] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 15:08:02 juju-e4d256-prod-github-runner-207 kernel: [35056.602532] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 15:08:02 juju-e4d256-prod-github-runner-207 kernel: [35056.603475] vcpu_run+0x62/0x2c0 [kvm] Aug 22 15:08:02 juju-e4d256-prod-github-runner-207 kernel: [35056.604306] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 15:08:02 juju-e4d256-prod-github-runner-207 kernel: [35056.605136] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 15:08:02 juju-e4d256-prod-github-runner-207 kernel: [35056.606031] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 15:08:02 juju-e4d256-prod-github-runner-207 kernel: [35056.606841] ? __seccomp_filter+0x4a/0x4a0 Aug 22 15:08:02 juju-e4d256-prod-github-runner-207 kernel: [35056.607594] ? __fget_files+0x86/0xc0 Aug 22 15:08:02 juju-e4d256-prod-github-runner-207 kernel: [35056.608311] __x64_sys_ioctl+0x95/0xd0 Aug 22 15:08:02 juju-e4d256-prod-github-runner-207 kernel: [35056.609012] do_syscall_64+0x5c/0xc0 Aug 22 15:08:02 juju-e4d256-prod-github-runner-207 kernel: [35056.609685] ? do_futex+0x162/0x1f0 Aug 22 15:08:02 juju-e4d256-prod-github-runner-207 kernel: [35056.610360] ? __x64_sys_futex+0x78/0x1e0 Aug 22 15:08:02 juju-e4d256-prod-github-runner-207 kernel: [35056.611050] ? __secure_computing+0xa9/0x120 Aug 22 15:08:02 juju-e4d256-prod-github-runner-207 kernel: [35056.611751] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 15:08:02 juju-e4d256-prod-github-runner-207 kernel: [35056.612532] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:08:02 juju-e4d256-prod-github-runner-207 kernel: [35056.613269] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:08:02 juju-e4d256-prod-github-runner-207 kernel: [35056.614017] ? do_syscall_64+0x69/0xc0 Aug 22 15:08:02 juju-e4d256-prod-github-runner-207 kernel: [35056.614674] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:08:02 juju-e4d256-prod-github-runner-207 kernel: [35056.615507] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:08:02 juju-e4d256-prod-github-runner-207 kernel: [35056.616222] ? do_syscall_64+0x69/0xc0 Aug 22 15:08:02 juju-e4d256-prod-github-runner-207 kernel: [35056.616860] ? do_syscall_64+0x69/0xc0 Aug 22 15:08:02 juju-e4d256-prod-github-runner-207 kernel: [35056.617688] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 15:08:02 juju-e4d256-prod-github-runner-207 kernel: [35056.618441] RIP: 0033:0x7faa5d0edaff Aug 22 15:08:02 juju-e4d256-prod-github-runner-207 kernel: [35056.619075] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 15:08:02 juju-e4d256-prod-github-runner-207 kernel: [35056.621125] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 15:08:02 juju-e4d256-prod-github-runner-207 kernel: [35056.622072] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 15:08:02 juju-e4d256-prod-github-runner-207 kernel: [35056.622997] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 15:08:02 juju-e4d256-prod-github-runner-207 kernel: [35056.623905] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 15:08:02 juju-e4d256-prod-github-runner-207 kernel: [35056.624816] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 15:08:02 juju-e4d256-prod-github-runner-207 kernel: [35056.625721] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 15:08:02 juju-e4d256-prod-github-runner-207 kernel: [35056.626646] Aug 22 15:08:30 juju-e4d256-prod-github-runner-207 kernel: [35084.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 32567s! [qemu-system-x86:6715] Aug 22 15:08:30 juju-e4d256-prod-github-runner-207 kernel: [35084.543858] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 15:08:30 juju-e4d256-prod-github-runner-207 kernel: [35084.544145] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 15:08:30 juju-e4d256-prod-github-runner-207 kernel: [35084.556538] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 15:08:30 juju-e4d256-prod-github-runner-207 kernel: [35084.557902] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 15:08:30 juju-e4d256-prod-github-runner-207 kernel: [35084.559135] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:08:30 juju-e4d256-prod-github-runner-207 kernel: [35084.560197] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 15:08:30 juju-e4d256-prod-github-runner-207 kernel: [35084.562796] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 15:08:30 juju-e4d256-prod-github-runner-207 kernel: [35084.563858] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 15:08:30 juju-e4d256-prod-github-runner-207 kernel: [35084.565019] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 15:08:30 juju-e4d256-prod-github-runner-207 kernel: [35084.566214] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 15:08:30 juju-e4d256-prod-github-runner-207 kernel: [35084.567376] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 15:08:30 juju-e4d256-prod-github-runner-207 kernel: [35084.568546] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 15:08:30 juju-e4d256-prod-github-runner-207 kernel: [35084.569730] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 15:08:30 juju-e4d256-prod-github-runner-207 kernel: [35084.570974] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 15:08:30 juju-e4d256-prod-github-runner-207 kernel: [35084.572083] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 15:08:30 juju-e4d256-prod-github-runner-207 kernel: [35084.573294] Call Trace: Aug 22 15:08:30 juju-e4d256-prod-github-runner-207 kernel: [35084.574224] Aug 22 15:08:30 juju-e4d256-prod-github-runner-207 kernel: [35084.575109] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:08:30 juju-e4d256-prod-github-runner-207 kernel: [35084.576138] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:08:30 juju-e4d256-prod-github-runner-207 kernel: [35084.577164] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:08:30 juju-e4d256-prod-github-runner-207 kernel: [35084.578281] ? show_regs.part.0+0x23/0x29 Aug 22 15:08:30 juju-e4d256-prod-github-runner-207 kernel: [35084.579288] ? show_regs.cold+0x8/0xd Aug 22 15:08:30 juju-e4d256-prod-github-runner-207 kernel: [35084.580260] ? watchdog_timer_fn+0x1be/0x220 Aug 22 15:08:30 juju-e4d256-prod-github-runner-207 kernel: [35084.581267] ? lockup_detector_update_enable+0x60/0x60 Aug 22 15:08:30 juju-e4d256-prod-github-runner-207 kernel: [35084.582362] ? __hrtimer_run_queues+0x107/0x230 Aug 22 15:08:30 juju-e4d256-prod-github-runner-207 kernel: [35084.583401] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 15:08:30 juju-e4d256-prod-github-runner-207 kernel: [35084.584425] ? hrtimer_interrupt+0x101/0x220 Aug 22 15:08:30 juju-e4d256-prod-github-runner-207 kernel: [35084.585439] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 15:08:30 juju-e4d256-prod-github-runner-207 kernel: [35084.586517] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 15:08:30 juju-e4d256-prod-github-runner-207 kernel: [35084.587567] Aug 22 15:08:30 juju-e4d256-prod-github-runner-207 kernel: [35084.588417] Aug 22 15:08:30 juju-e4d256-prod-github-runner-207 kernel: [35084.589254] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 15:08:30 juju-e4d256-prod-github-runner-207 kernel: [35084.590300] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:08:30 juju-e4d256-prod-github-runner-207 kernel: [35084.591338] ? _raw_spin_lock+0x22/0x30 Aug 22 15:08:30 juju-e4d256-prod-github-runner-207 kernel: [35084.592280] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:08:30 juju-e4d256-prod-github-runner-207 kernel: [35084.593312] direct_page_fault+0x206/0x310 [kvm] Aug 22 15:08:30 juju-e4d256-prod-github-runner-207 kernel: [35084.594346] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 15:08:30 juju-e4d256-prod-github-runner-207 kernel: [35084.595356] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 15:08:30 juju-e4d256-prod-github-runner-207 kernel: [35084.596355] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 15:08:30 juju-e4d256-prod-github-runner-207 kernel: [35084.597353] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 15:08:30 juju-e4d256-prod-github-runner-207 kernel: [35084.598317] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 15:08:30 juju-e4d256-prod-github-runner-207 kernel: [35084.599297] handle_exit+0x98/0x230 [kvm_amd] Aug 22 15:08:30 juju-e4d256-prod-github-runner-207 kernel: [35084.600210] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 15:08:30 juju-e4d256-prod-github-runner-207 kernel: [35084.601121] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 15:08:30 juju-e4d256-prod-github-runner-207 kernel: [35084.602058] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 15:08:30 juju-e4d256-prod-github-runner-207 kernel: [35084.602980] vcpu_run+0x62/0x2c0 [kvm] Aug 22 15:08:30 juju-e4d256-prod-github-runner-207 kernel: [35084.603798] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 15:08:30 juju-e4d256-prod-github-runner-207 kernel: [35084.604606] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 15:08:30 juju-e4d256-prod-github-runner-207 kernel: [35084.605466] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 15:08:30 juju-e4d256-prod-github-runner-207 kernel: [35084.606284] ? __seccomp_filter+0x4a/0x4a0 Aug 22 15:08:30 juju-e4d256-prod-github-runner-207 kernel: [35084.607039] ? __fget_files+0x86/0xc0 Aug 22 15:08:30 juju-e4d256-prod-github-runner-207 kernel: [35084.607751] __x64_sys_ioctl+0x95/0xd0 Aug 22 15:08:30 juju-e4d256-prod-github-runner-207 kernel: [35084.608480] do_syscall_64+0x5c/0xc0 Aug 22 15:08:30 juju-e4d256-prod-github-runner-207 kernel: [35084.609152] ? do_futex+0x162/0x1f0 Aug 22 15:08:30 juju-e4d256-prod-github-runner-207 kernel: [35084.609816] ? __x64_sys_futex+0x78/0x1e0 Aug 22 15:08:30 juju-e4d256-prod-github-runner-207 kernel: [35084.610493] ? __secure_computing+0xa9/0x120 Aug 22 15:08:30 juju-e4d256-prod-github-runner-207 kernel: [35084.611185] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 15:08:30 juju-e4d256-prod-github-runner-207 kernel: [35084.611959] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:08:30 juju-e4d256-prod-github-runner-207 kernel: [35084.612690] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:08:30 juju-e4d256-prod-github-runner-207 kernel: [35084.613456] ? do_syscall_64+0x69/0xc0 Aug 22 15:08:30 juju-e4d256-prod-github-runner-207 kernel: [35084.614134] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:08:30 juju-e4d256-prod-github-runner-207 kernel: [35084.614862] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:08:30 juju-e4d256-prod-github-runner-207 kernel: [35084.615565] ? do_syscall_64+0x69/0xc0 Aug 22 15:08:30 juju-e4d256-prod-github-runner-207 kernel: [35084.616193] ? do_syscall_64+0x69/0xc0 Aug 22 15:08:30 juju-e4d256-prod-github-runner-207 kernel: [35084.616818] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 15:08:30 juju-e4d256-prod-github-runner-207 kernel: [35084.617527] RIP: 0033:0x7faa5d0edaff Aug 22 15:08:30 juju-e4d256-prod-github-runner-207 kernel: [35084.618208] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 15:08:30 juju-e4d256-prod-github-runner-207 kernel: [35084.620208] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 15:08:30 juju-e4d256-prod-github-runner-207 kernel: [35084.621357] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 15:08:30 juju-e4d256-prod-github-runner-207 kernel: [35084.622270] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 15:08:30 juju-e4d256-prod-github-runner-207 kernel: [35084.623164] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 15:08:30 juju-e4d256-prod-github-runner-207 kernel: [35084.624083] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 15:08:30 juju-e4d256-prod-github-runner-207 kernel: [35084.624976] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 15:08:30 juju-e4d256-prod-github-runner-207 kernel: [35084.625893] Aug 22 15:08:45 juju-e4d256-prod-github-runner-207 kernel: [35099.528706] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 15:08:45 juju-e4d256-prod-github-runner-207 kernel: [35099.529731] rcu: 1-....: (8718202 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=4212018 Aug 22 15:08:45 juju-e4d256-prod-github-runner-207 kernel: [35099.530866] (t=8745582 jiffies g=23269 q=37125) Aug 22 15:08:45 juju-e4d256-prod-github-runner-207 kernel: [35099.531648] NMI backtrace for cpu 1 Aug 22 15:08:45 juju-e4d256-prod-github-runner-207 kernel: [35099.532365] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 15:08:45 juju-e4d256-prod-github-runner-207 kernel: [35099.533467] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 15:08:45 juju-e4d256-prod-github-runner-207 kernel: [35099.534561] Call Trace: Aug 22 15:08:45 juju-e4d256-prod-github-runner-207 kernel: [35099.535252] Aug 22 15:08:45 juju-e4d256-prod-github-runner-207 kernel: [35099.535897] show_stack+0x52/0x5c Aug 22 15:08:45 juju-e4d256-prod-github-runner-207 kernel: [35099.536622] dump_stack_lvl+0x4a/0x63 Aug 22 15:08:45 juju-e4d256-prod-github-runner-207 kernel: [35099.537429] dump_stack+0x10/0x16 Aug 22 15:08:45 juju-e4d256-prod-github-runner-207 kernel: [35099.538206] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 15:08:45 juju-e4d256-prod-github-runner-207 kernel: [35099.538995] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 15:08:45 juju-e4d256-prod-github-runner-207 kernel: [35099.539777] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 15:08:45 juju-e4d256-prod-github-runner-207 kernel: [35099.540601] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 15:08:45 juju-e4d256-prod-github-runner-207 kernel: [35099.541428] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 15:08:45 juju-e4d256-prod-github-runner-207 kernel: [35099.542253] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 15:08:45 juju-e4d256-prod-github-runner-207 kernel: [35099.543034] print_cpu_stall.cold+0x2f/0xe2 Aug 22 15:08:45 juju-e4d256-prod-github-runner-207 kernel: [35099.543799] ? timekeeping_update+0xf7/0x150 Aug 22 15:08:45 juju-e4d256-prod-github-runner-207 kernel: [35099.544576] check_cpu_stall+0x109/0x270 Aug 22 15:08:45 juju-e4d256-prod-github-runner-207 kernel: [35099.545331] rcu_sched_clock_irq+0x9a/0x250 Aug 22 15:08:45 juju-e4d256-prod-github-runner-207 kernel: [35099.546111] update_process_times+0x94/0xd0 Aug 22 15:08:45 juju-e4d256-prod-github-runner-207 kernel: [35099.546871] tick_sched_handle+0x29/0x70 Aug 22 15:08:45 juju-e4d256-prod-github-runner-207 kernel: [35099.547618] tick_sched_timer+0x8c/0xc0 Aug 22 15:08:45 juju-e4d256-prod-github-runner-207 kernel: [35099.548359] ? tick_nohz_handler+0xb0/0xb0 Aug 22 15:08:45 juju-e4d256-prod-github-runner-207 kernel: [35099.549114] __hrtimer_run_queues+0x107/0x230 Aug 22 15:08:45 juju-e4d256-prod-github-runner-207 kernel: [35099.549895] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 15:08:45 juju-e4d256-prod-github-runner-207 kernel: [35099.550671] hrtimer_interrupt+0x101/0x220 Aug 22 15:08:45 juju-e4d256-prod-github-runner-207 kernel: [35099.551433] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 15:08:45 juju-e4d256-prod-github-runner-207 kernel: [35099.552269] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 15:08:45 juju-e4d256-prod-github-runner-207 kernel: [35099.553091] Aug 22 15:08:45 juju-e4d256-prod-github-runner-207 kernel: [35099.553736] Aug 22 15:08:45 juju-e4d256-prod-github-runner-207 kernel: [35099.554399] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 15:08:45 juju-e4d256-prod-github-runner-207 kernel: [35099.555229] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:08:45 juju-e4d256-prod-github-runner-207 kernel: [35099.556111] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 15:08:45 juju-e4d256-prod-github-runner-207 kernel: [35099.558368] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 15:08:45 juju-e4d256-prod-github-runner-207 kernel: [35099.559252] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 15:08:45 juju-e4d256-prod-github-runner-207 kernel: [35099.560300] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 15:08:45 juju-e4d256-prod-github-runner-207 kernel: [35099.561290] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 15:08:45 juju-e4d256-prod-github-runner-207 kernel: [35099.562262] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 15:08:45 juju-e4d256-prod-github-runner-207 kernel: [35099.563217] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 15:08:45 juju-e4d256-prod-github-runner-207 kernel: [35099.564169] ? _raw_spin_lock+0x22/0x30 Aug 22 15:08:45 juju-e4d256-prod-github-runner-207 kernel: [35099.564965] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:08:45 juju-e4d256-prod-github-runner-207 kernel: [35099.565870] direct_page_fault+0x206/0x310 [kvm] Aug 22 15:08:45 juju-e4d256-prod-github-runner-207 kernel: [35099.566716] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 15:08:45 juju-e4d256-prod-github-runner-207 kernel: [35099.567543] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 15:08:45 juju-e4d256-prod-github-runner-207 kernel: [35099.568366] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 15:08:45 juju-e4d256-prod-github-runner-207 kernel: [35099.569169] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 15:08:45 juju-e4d256-prod-github-runner-207 kernel: [35099.570005] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 15:08:45 juju-e4d256-prod-github-runner-207 kernel: [35099.570830] handle_exit+0x98/0x230 [kvm_amd] Aug 22 15:08:45 juju-e4d256-prod-github-runner-207 kernel: [35099.571601] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 15:08:45 juju-e4d256-prod-github-runner-207 kernel: [35099.572413] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 15:08:45 juju-e4d256-prod-github-runner-207 kernel: [35099.573212] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 15:08:45 juju-e4d256-prod-github-runner-207 kernel: [35099.574007] vcpu_run+0x62/0x2c0 [kvm] Aug 22 15:08:45 juju-e4d256-prod-github-runner-207 kernel: [35099.574769] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 15:08:45 juju-e4d256-prod-github-runner-207 kernel: [35099.575551] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 15:08:45 juju-e4d256-prod-github-runner-207 kernel: [35099.576430] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 15:08:45 juju-e4d256-prod-github-runner-207 kernel: [35099.577213] ? __seccomp_filter+0x4a/0x4a0 Aug 22 15:08:45 juju-e4d256-prod-github-runner-207 kernel: [35099.577970] ? __fget_files+0x86/0xc0 Aug 22 15:08:45 juju-e4d256-prod-github-runner-207 kernel: [35099.578690] __x64_sys_ioctl+0x95/0xd0 Aug 22 15:08:45 juju-e4d256-prod-github-runner-207 kernel: [35099.579395] do_syscall_64+0x5c/0xc0 Aug 22 15:08:45 juju-e4d256-prod-github-runner-207 kernel: [35099.580073] ? do_futex+0x162/0x1f0 Aug 22 15:08:45 juju-e4d256-prod-github-runner-207 kernel: [35099.580746] ? __x64_sys_futex+0x78/0x1e0 Aug 22 15:08:45 juju-e4d256-prod-github-runner-207 kernel: [35099.581466] ? __secure_computing+0xa9/0x120 Aug 22 15:08:45 juju-e4d256-prod-github-runner-207 kernel: [35099.582218] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 15:08:45 juju-e4d256-prod-github-runner-207 kernel: [35099.583042] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:08:45 juju-e4d256-prod-github-runner-207 kernel: [35099.583795] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:08:45 juju-e4d256-prod-github-runner-207 kernel: [35099.584546] ? do_syscall_64+0x69/0xc0 Aug 22 15:08:45 juju-e4d256-prod-github-runner-207 kernel: [35099.585261] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:08:45 juju-e4d256-prod-github-runner-207 kernel: [35099.586031] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:08:45 juju-e4d256-prod-github-runner-207 kernel: [35099.586794] ? do_syscall_64+0x69/0xc0 Aug 22 15:08:45 juju-e4d256-prod-github-runner-207 kernel: [35099.587488] ? do_syscall_64+0x69/0xc0 Aug 22 15:08:45 juju-e4d256-prod-github-runner-207 kernel: [35099.588218] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 15:08:45 juju-e4d256-prod-github-runner-207 kernel: [35099.589006] RIP: 0033:0x7faa5d0edaff Aug 22 15:08:45 juju-e4d256-prod-github-runner-207 kernel: [35099.589708] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 15:08:45 juju-e4d256-prod-github-runner-207 kernel: [35099.591832] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 15:08:45 juju-e4d256-prod-github-runner-207 kernel: [35099.592811] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 15:08:45 juju-e4d256-prod-github-runner-207 kernel: [35099.593801] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 15:08:45 juju-e4d256-prod-github-runner-207 kernel: [35099.594944] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 15:08:45 juju-e4d256-prod-github-runner-207 kernel: [35099.595981] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 15:08:45 juju-e4d256-prod-github-runner-207 kernel: [35099.596937] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 15:08:45 juju-e4d256-prod-github-runner-207 kernel: [35099.597885] Aug 22 15:09:10 juju-e4d256-prod-github-runner-207 kernel: [35124.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 32604s! [qemu-system-x86:6715] Aug 22 15:09:10 juju-e4d256-prod-github-runner-207 kernel: [35124.543126] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 15:09:10 juju-e4d256-prod-github-runner-207 kernel: [35124.543201] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 15:09:10 juju-e4d256-prod-github-runner-207 kernel: [35124.555307] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 15:09:10 juju-e4d256-prod-github-runner-207 kernel: [35124.556583] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 15:09:10 juju-e4d256-prod-github-runner-207 kernel: [35124.557827] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:09:10 juju-e4d256-prod-github-runner-207 kernel: [35124.558883] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 15:09:10 juju-e4d256-prod-github-runner-207 kernel: [35124.561446] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 15:09:10 juju-e4d256-prod-github-runner-207 kernel: [35124.562498] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 15:09:10 juju-e4d256-prod-github-runner-207 kernel: [35124.563667] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 15:09:10 juju-e4d256-prod-github-runner-207 kernel: [35124.564825] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 15:09:10 juju-e4d256-prod-github-runner-207 kernel: [35124.566073] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 15:09:10 juju-e4d256-prod-github-runner-207 kernel: [35124.567685] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 15:09:10 juju-e4d256-prod-github-runner-207 kernel: [35124.568873] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 15:09:10 juju-e4d256-prod-github-runner-207 kernel: [35124.570157] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 15:09:10 juju-e4d256-prod-github-runner-207 kernel: [35124.571271] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 15:09:10 juju-e4d256-prod-github-runner-207 kernel: [35124.572481] Call Trace: Aug 22 15:09:10 juju-e4d256-prod-github-runner-207 kernel: [35124.573420] Aug 22 15:09:10 juju-e4d256-prod-github-runner-207 kernel: [35124.574307] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:09:10 juju-e4d256-prod-github-runner-207 kernel: [35124.575345] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:09:10 juju-e4d256-prod-github-runner-207 kernel: [35124.576374] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:09:10 juju-e4d256-prod-github-runner-207 kernel: [35124.577494] ? show_regs.part.0+0x23/0x29 Aug 22 15:09:10 juju-e4d256-prod-github-runner-207 kernel: [35124.578502] ? show_regs.cold+0x8/0xd Aug 22 15:09:10 juju-e4d256-prod-github-runner-207 kernel: [35124.579492] ? watchdog_timer_fn+0x1be/0x220 Aug 22 15:09:10 juju-e4d256-prod-github-runner-207 kernel: [35124.580533] ? lockup_detector_update_enable+0x60/0x60 Aug 22 15:09:10 juju-e4d256-prod-github-runner-207 kernel: [35124.581627] ? __hrtimer_run_queues+0x107/0x230 Aug 22 15:09:10 juju-e4d256-prod-github-runner-207 kernel: [35124.582785] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 15:09:10 juju-e4d256-prod-github-runner-207 kernel: [35124.583847] ? hrtimer_interrupt+0x101/0x220 Aug 22 15:09:10 juju-e4d256-prod-github-runner-207 kernel: [35124.584889] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 15:09:10 juju-e4d256-prod-github-runner-207 kernel: [35124.585996] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 15:09:10 juju-e4d256-prod-github-runner-207 kernel: [35124.587052] Aug 22 15:09:10 juju-e4d256-prod-github-runner-207 kernel: [35124.587913] Aug 22 15:09:10 juju-e4d256-prod-github-runner-207 kernel: [35124.588757] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 15:09:10 juju-e4d256-prod-github-runner-207 kernel: [35124.589818] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:09:10 juju-e4d256-prod-github-runner-207 kernel: [35124.590870] ? _raw_spin_lock+0x22/0x30 Aug 22 15:09:10 juju-e4d256-prod-github-runner-207 kernel: [35124.591821] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:09:10 juju-e4d256-prod-github-runner-207 kernel: [35124.592866] direct_page_fault+0x206/0x310 [kvm] Aug 22 15:09:10 juju-e4d256-prod-github-runner-207 kernel: [35124.593918] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 15:09:10 juju-e4d256-prod-github-runner-207 kernel: [35124.594941] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 15:09:10 juju-e4d256-prod-github-runner-207 kernel: [35124.595999] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 15:09:10 juju-e4d256-prod-github-runner-207 kernel: [35124.596989] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 15:09:10 juju-e4d256-prod-github-runner-207 kernel: [35124.597968] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 15:09:10 juju-e4d256-prod-github-runner-207 kernel: [35124.598958] handle_exit+0x98/0x230 [kvm_amd] Aug 22 15:09:10 juju-e4d256-prod-github-runner-207 kernel: [35124.599859] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 15:09:10 juju-e4d256-prod-github-runner-207 kernel: [35124.600780] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 15:09:10 juju-e4d256-prod-github-runner-207 kernel: [35124.601872] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 15:09:10 juju-e4d256-prod-github-runner-207 kernel: [35124.602833] vcpu_run+0x62/0x2c0 [kvm] Aug 22 15:09:10 juju-e4d256-prod-github-runner-207 kernel: [35124.603680] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 15:09:10 juju-e4d256-prod-github-runner-207 kernel: [35124.604496] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 15:09:10 juju-e4d256-prod-github-runner-207 kernel: [35124.605386] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 15:09:10 juju-e4d256-prod-github-runner-207 kernel: [35124.606192] ? __seccomp_filter+0x4a/0x4a0 Aug 22 15:09:10 juju-e4d256-prod-github-runner-207 kernel: [35124.606943] ? __fget_files+0x86/0xc0 Aug 22 15:09:10 juju-e4d256-prod-github-runner-207 kernel: [35124.607653] __x64_sys_ioctl+0x95/0xd0 Aug 22 15:09:10 juju-e4d256-prod-github-runner-207 kernel: [35124.608361] do_syscall_64+0x5c/0xc0 Aug 22 15:09:10 juju-e4d256-prod-github-runner-207 kernel: [35124.609039] ? do_futex+0x162/0x1f0 Aug 22 15:09:10 juju-e4d256-prod-github-runner-207 kernel: [35124.609713] ? __x64_sys_futex+0x78/0x1e0 Aug 22 15:09:10 juju-e4d256-prod-github-runner-207 kernel: [35124.610391] ? __secure_computing+0xa9/0x120 Aug 22 15:09:10 juju-e4d256-prod-github-runner-207 kernel: [35124.611209] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 15:09:10 juju-e4d256-prod-github-runner-207 kernel: [35124.611974] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:09:10 juju-e4d256-prod-github-runner-207 kernel: [35124.612703] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:09:10 juju-e4d256-prod-github-runner-207 kernel: [35124.613439] ? do_syscall_64+0x69/0xc0 Aug 22 15:09:10 juju-e4d256-prod-github-runner-207 kernel: [35124.614228] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:09:10 juju-e4d256-prod-github-runner-207 kernel: [35124.614974] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:09:10 juju-e4d256-prod-github-runner-207 kernel: [35124.615679] ? do_syscall_64+0x69/0xc0 Aug 22 15:09:10 juju-e4d256-prod-github-runner-207 kernel: [35124.616311] ? do_syscall_64+0x69/0xc0 Aug 22 15:09:10 juju-e4d256-prod-github-runner-207 kernel: [35124.616939] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 15:09:10 juju-e4d256-prod-github-runner-207 kernel: [35124.617693] RIP: 0033:0x7faa5d0edaff Aug 22 15:09:10 juju-e4d256-prod-github-runner-207 kernel: [35124.618325] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 15:09:10 juju-e4d256-prod-github-runner-207 kernel: [35124.620378] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 15:09:10 juju-e4d256-prod-github-runner-207 kernel: [35124.621331] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 15:09:10 juju-e4d256-prod-github-runner-207 kernel: [35124.622237] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 15:09:10 juju-e4d256-prod-github-runner-207 kernel: [35124.623145] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 15:09:10 juju-e4d256-prod-github-runner-207 kernel: [35124.624052] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 15:09:10 juju-e4d256-prod-github-runner-207 kernel: [35124.624961] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 15:09:10 juju-e4d256-prod-github-runner-207 kernel: [35124.625892] Aug 22 15:09:38 juju-e4d256-prod-github-runner-207 kernel: [35152.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 32630s! [qemu-system-x86:6715] Aug 22 15:09:38 juju-e4d256-prod-github-runner-207 kernel: [35152.543205] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 15:09:38 juju-e4d256-prod-github-runner-207 kernel: [35152.543371] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 15:09:38 juju-e4d256-prod-github-runner-207 kernel: [35152.555952] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 15:09:38 juju-e4d256-prod-github-runner-207 kernel: [35152.557430] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 15:09:38 juju-e4d256-prod-github-runner-207 kernel: [35152.558689] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:09:38 juju-e4d256-prod-github-runner-207 kernel: [35152.559769] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 15:09:38 juju-e4d256-prod-github-runner-207 kernel: [35152.562461] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 15:09:38 juju-e4d256-prod-github-runner-207 kernel: [35152.563545] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 15:09:38 juju-e4d256-prod-github-runner-207 kernel: [35152.564742] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 15:09:38 juju-e4d256-prod-github-runner-207 kernel: [35152.565938] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 15:09:38 juju-e4d256-prod-github-runner-207 kernel: [35152.567144] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 15:09:38 juju-e4d256-prod-github-runner-207 kernel: [35152.568329] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 15:09:38 juju-e4d256-prod-github-runner-207 kernel: [35152.569540] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 15:09:38 juju-e4d256-prod-github-runner-207 kernel: [35152.570806] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 15:09:38 juju-e4d256-prod-github-runner-207 kernel: [35152.571932] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 15:09:38 juju-e4d256-prod-github-runner-207 kernel: [35152.573163] Call Trace: Aug 22 15:09:38 juju-e4d256-prod-github-runner-207 kernel: [35152.574087] Aug 22 15:09:38 juju-e4d256-prod-github-runner-207 kernel: [35152.574999] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:09:38 juju-e4d256-prod-github-runner-207 kernel: [35152.576164] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:09:38 juju-e4d256-prod-github-runner-207 kernel: [35152.577214] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:09:38 juju-e4d256-prod-github-runner-207 kernel: [35152.578330] ? show_regs.part.0+0x23/0x29 Aug 22 15:09:38 juju-e4d256-prod-github-runner-207 kernel: [35152.579342] ? show_regs.cold+0x8/0xd Aug 22 15:09:38 juju-e4d256-prod-github-runner-207 kernel: [35152.580322] ? watchdog_timer_fn+0x1be/0x220 Aug 22 15:09:38 juju-e4d256-prod-github-runner-207 kernel: [35152.581361] ? lockup_detector_update_enable+0x60/0x60 Aug 22 15:09:38 juju-e4d256-prod-github-runner-207 kernel: [35152.582434] ? __hrtimer_run_queues+0x107/0x230 Aug 22 15:09:38 juju-e4d256-prod-github-runner-207 kernel: [35152.583475] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 15:09:38 juju-e4d256-prod-github-runner-207 kernel: [35152.584513] ? hrtimer_interrupt+0x101/0x220 Aug 22 15:09:38 juju-e4d256-prod-github-runner-207 kernel: [35152.585587] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 15:09:38 juju-e4d256-prod-github-runner-207 kernel: [35152.586731] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 15:09:38 juju-e4d256-prod-github-runner-207 kernel: [35152.587794] Aug 22 15:09:38 juju-e4d256-prod-github-runner-207 kernel: [35152.588654] Aug 22 15:09:38 juju-e4d256-prod-github-runner-207 kernel: [35152.589548] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 15:09:38 juju-e4d256-prod-github-runner-207 kernel: [35152.590600] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:09:38 juju-e4d256-prod-github-runner-207 kernel: [35152.591735] ? _raw_spin_lock+0x22/0x30 Aug 22 15:09:38 juju-e4d256-prod-github-runner-207 kernel: [35152.592707] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:09:38 juju-e4d256-prod-github-runner-207 kernel: [35152.593780] direct_page_fault+0x206/0x310 [kvm] Aug 22 15:09:38 juju-e4d256-prod-github-runner-207 kernel: [35152.594834] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 15:09:38 juju-e4d256-prod-github-runner-207 kernel: [35152.595867] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 15:09:38 juju-e4d256-prod-github-runner-207 kernel: [35152.596898] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 15:09:38 juju-e4d256-prod-github-runner-207 kernel: [35152.597938] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 15:09:38 juju-e4d256-prod-github-runner-207 kernel: [35152.598921] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 15:09:38 juju-e4d256-prod-github-runner-207 kernel: [35152.599929] handle_exit+0x98/0x230 [kvm_amd] Aug 22 15:09:38 juju-e4d256-prod-github-runner-207 kernel: [35152.600860] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 15:09:38 juju-e4d256-prod-github-runner-207 kernel: [35152.601814] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 15:09:38 juju-e4d256-prod-github-runner-207 kernel: [35152.602757] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 15:09:38 juju-e4d256-prod-github-runner-207 kernel: [35152.603677] vcpu_run+0x62/0x2c0 [kvm] Aug 22 15:09:38 juju-e4d256-prod-github-runner-207 kernel: [35152.604545] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 15:09:38 juju-e4d256-prod-github-runner-207 kernel: [35152.605449] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 15:09:38 juju-e4d256-prod-github-runner-207 kernel: [35152.606379] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 15:09:38 juju-e4d256-prod-github-runner-207 kernel: [35152.607220] ? __seccomp_filter+0x4a/0x4a0 Aug 22 15:09:38 juju-e4d256-prod-github-runner-207 kernel: [35152.608034] ? __fget_files+0x86/0xc0 Aug 22 15:09:38 juju-e4d256-prod-github-runner-207 kernel: [35152.608783] __x64_sys_ioctl+0x95/0xd0 Aug 22 15:09:38 juju-e4d256-prod-github-runner-207 kernel: [35152.609593] do_syscall_64+0x5c/0xc0 Aug 22 15:09:38 juju-e4d256-prod-github-runner-207 kernel: [35152.610317] ? do_futex+0x162/0x1f0 Aug 22 15:09:38 juju-e4d256-prod-github-runner-207 kernel: [35152.611083] ? __x64_sys_futex+0x78/0x1e0 Aug 22 15:09:38 juju-e4d256-prod-github-runner-207 kernel: [35152.611772] ? __secure_computing+0xa9/0x120 Aug 22 15:09:38 juju-e4d256-prod-github-runner-207 kernel: [35152.612516] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 15:09:38 juju-e4d256-prod-github-runner-207 kernel: [35152.613399] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:09:38 juju-e4d256-prod-github-runner-207 kernel: [35152.614176] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:09:38 juju-e4d256-prod-github-runner-207 kernel: [35152.614939] ? do_syscall_64+0x69/0xc0 Aug 22 15:09:38 juju-e4d256-prod-github-runner-207 kernel: [35152.615641] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:09:38 juju-e4d256-prod-github-runner-207 kernel: [35152.616410] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:09:38 juju-e4d256-prod-github-runner-207 kernel: [35152.617149] ? do_syscall_64+0x69/0xc0 Aug 22 15:09:38 juju-e4d256-prod-github-runner-207 kernel: [35152.617792] ? do_syscall_64+0x69/0xc0 Aug 22 15:09:38 juju-e4d256-prod-github-runner-207 kernel: [35152.618431] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 15:09:38 juju-e4d256-prod-github-runner-207 kernel: [35152.619173] RIP: 0033:0x7faa5d0edaff Aug 22 15:09:38 juju-e4d256-prod-github-runner-207 kernel: [35152.619828] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 15:09:38 juju-e4d256-prod-github-runner-207 kernel: [35152.622002] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 15:09:38 juju-e4d256-prod-github-runner-207 kernel: [35152.622942] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 15:09:38 juju-e4d256-prod-github-runner-207 kernel: [35152.623853] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 15:09:38 juju-e4d256-prod-github-runner-207 kernel: [35152.624766] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 15:09:38 juju-e4d256-prod-github-runner-207 kernel: [35152.625794] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 15:09:38 juju-e4d256-prod-github-runner-207 kernel: [35152.626749] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 15:09:38 juju-e4d256-prod-github-runner-207 kernel: [35152.627822] Aug 22 15:10:06 juju-e4d256-prod-github-runner-207 kernel: [35180.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 32656s! [qemu-system-x86:6715] Aug 22 15:10:06 juju-e4d256-prod-github-runner-207 kernel: [35180.544015] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 15:10:06 juju-e4d256-prod-github-runner-207 kernel: [35180.544263] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 15:10:06 juju-e4d256-prod-github-runner-207 kernel: [35180.556411] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 15:10:06 juju-e4d256-prod-github-runner-207 kernel: [35180.557692] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 15:10:06 juju-e4d256-prod-github-runner-207 kernel: [35180.558953] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:10:06 juju-e4d256-prod-github-runner-207 kernel: [35180.560020] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 15:10:06 juju-e4d256-prod-github-runner-207 kernel: [35180.562616] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 15:10:06 juju-e4d256-prod-github-runner-207 kernel: [35180.563655] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 15:10:06 juju-e4d256-prod-github-runner-207 kernel: [35180.564827] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 15:10:06 juju-e4d256-prod-github-runner-207 kernel: [35180.565983] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 15:10:06 juju-e4d256-prod-github-runner-207 kernel: [35180.567139] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 15:10:06 juju-e4d256-prod-github-runner-207 kernel: [35180.568298] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 15:10:06 juju-e4d256-prod-github-runner-207 kernel: [35180.569475] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 15:10:06 juju-e4d256-prod-github-runner-207 kernel: [35180.570767] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 15:10:06 juju-e4d256-prod-github-runner-207 kernel: [35180.571958] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 15:10:06 juju-e4d256-prod-github-runner-207 kernel: [35180.573216] Call Trace: Aug 22 15:10:06 juju-e4d256-prod-github-runner-207 kernel: [35180.574156] Aug 22 15:10:06 juju-e4d256-prod-github-runner-207 kernel: [35180.575067] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:10:06 juju-e4d256-prod-github-runner-207 kernel: [35180.576102] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:10:06 juju-e4d256-prod-github-runner-207 kernel: [35180.577189] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:10:06 juju-e4d256-prod-github-runner-207 kernel: [35180.578268] ? show_regs.part.0+0x23/0x29 Aug 22 15:10:06 juju-e4d256-prod-github-runner-207 kernel: [35180.579264] ? show_regs.cold+0x8/0xd Aug 22 15:10:06 juju-e4d256-prod-github-runner-207 kernel: [35180.580237] ? watchdog_timer_fn+0x1be/0x220 Aug 22 15:10:06 juju-e4d256-prod-github-runner-207 kernel: [35180.581255] ? lockup_detector_update_enable+0x60/0x60 Aug 22 15:10:06 juju-e4d256-prod-github-runner-207 kernel: [35180.582320] ? __hrtimer_run_queues+0x107/0x230 Aug 22 15:10:06 juju-e4d256-prod-github-runner-207 kernel: [35180.583372] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 15:10:06 juju-e4d256-prod-github-runner-207 kernel: [35180.584406] ? hrtimer_interrupt+0x101/0x220 Aug 22 15:10:06 juju-e4d256-prod-github-runner-207 kernel: [35180.585431] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 15:10:06 juju-e4d256-prod-github-runner-207 kernel: [35180.586511] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 15:10:06 juju-e4d256-prod-github-runner-207 kernel: [35180.587575] Aug 22 15:10:06 juju-e4d256-prod-github-runner-207 kernel: [35180.588443] Aug 22 15:10:06 juju-e4d256-prod-github-runner-207 kernel: [35180.589302] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 15:10:06 juju-e4d256-prod-github-runner-207 kernel: [35180.590332] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:10:06 juju-e4d256-prod-github-runner-207 kernel: [35180.591368] ? _raw_spin_lock+0x22/0x30 Aug 22 15:10:06 juju-e4d256-prod-github-runner-207 kernel: [35180.592317] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:10:06 juju-e4d256-prod-github-runner-207 kernel: [35180.593350] direct_page_fault+0x206/0x310 [kvm] Aug 22 15:10:06 juju-e4d256-prod-github-runner-207 kernel: [35180.594389] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 15:10:06 juju-e4d256-prod-github-runner-207 kernel: [35180.595401] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 15:10:06 juju-e4d256-prod-github-runner-207 kernel: [35180.596406] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 15:10:06 juju-e4d256-prod-github-runner-207 kernel: [35180.597441] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 15:10:06 juju-e4d256-prod-github-runner-207 kernel: [35180.598401] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 15:10:06 juju-e4d256-prod-github-runner-207 kernel: [35180.599382] handle_exit+0x98/0x230 [kvm_amd] Aug 22 15:10:06 juju-e4d256-prod-github-runner-207 kernel: [35180.600272] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 15:10:06 juju-e4d256-prod-github-runner-207 kernel: [35180.601202] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 15:10:06 juju-e4d256-prod-github-runner-207 kernel: [35180.602126] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 15:10:06 juju-e4d256-prod-github-runner-207 kernel: [35180.603027] vcpu_run+0x62/0x2c0 [kvm] Aug 22 15:10:06 juju-e4d256-prod-github-runner-207 kernel: [35180.603836] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 15:10:06 juju-e4d256-prod-github-runner-207 kernel: [35180.604663] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 15:10:06 juju-e4d256-prod-github-runner-207 kernel: [35180.605578] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 15:10:06 juju-e4d256-prod-github-runner-207 kernel: [35180.606385] ? __seccomp_filter+0x4a/0x4a0 Aug 22 15:10:06 juju-e4d256-prod-github-runner-207 kernel: [35180.607129] ? __fget_files+0x86/0xc0 Aug 22 15:10:06 juju-e4d256-prod-github-runner-207 kernel: [35180.607832] __x64_sys_ioctl+0x95/0xd0 Aug 22 15:10:06 juju-e4d256-prod-github-runner-207 kernel: [35180.608524] do_syscall_64+0x5c/0xc0 Aug 22 15:10:06 juju-e4d256-prod-github-runner-207 kernel: [35180.609193] ? do_futex+0x162/0x1f0 Aug 22 15:10:06 juju-e4d256-prod-github-runner-207 kernel: [35180.609846] ? __x64_sys_futex+0x78/0x1e0 Aug 22 15:10:06 juju-e4d256-prod-github-runner-207 kernel: [35180.610517] ? __secure_computing+0xa9/0x120 Aug 22 15:10:06 juju-e4d256-prod-github-runner-207 kernel: [35180.611210] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 15:10:06 juju-e4d256-prod-github-runner-207 kernel: [35180.611969] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:10:06 juju-e4d256-prod-github-runner-207 kernel: [35180.612709] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:10:06 juju-e4d256-prod-github-runner-207 kernel: [35180.613457] ? do_syscall_64+0x69/0xc0 Aug 22 15:10:06 juju-e4d256-prod-github-runner-207 kernel: [35180.614121] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:10:06 juju-e4d256-prod-github-runner-207 kernel: [35180.614824] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:10:06 juju-e4d256-prod-github-runner-207 kernel: [35180.615520] ? do_syscall_64+0x69/0xc0 Aug 22 15:10:06 juju-e4d256-prod-github-runner-207 kernel: [35180.616143] ? do_syscall_64+0x69/0xc0 Aug 22 15:10:06 juju-e4d256-prod-github-runner-207 kernel: [35180.616782] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 15:10:06 juju-e4d256-prod-github-runner-207 kernel: [35180.617489] RIP: 0033:0x7faa5d0edaff Aug 22 15:10:06 juju-e4d256-prod-github-runner-207 kernel: [35180.618190] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 15:10:06 juju-e4d256-prod-github-runner-207 kernel: [35180.620194] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 15:10:06 juju-e4d256-prod-github-runner-207 kernel: [35180.621120] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 15:10:06 juju-e4d256-prod-github-runner-207 kernel: [35180.622006] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 15:10:06 juju-e4d256-prod-github-runner-207 kernel: [35180.622893] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 15:10:06 juju-e4d256-prod-github-runner-207 kernel: [35180.623777] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 15:10:06 juju-e4d256-prod-github-runner-207 kernel: [35180.624680] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 15:10:06 juju-e4d256-prod-github-runner-207 kernel: [35180.625576] Aug 22 15:10:34 juju-e4d256-prod-github-runner-207 kernel: [35208.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 32682s! [qemu-system-x86:6715] Aug 22 15:10:34 juju-e4d256-prod-github-runner-207 kernel: [35208.543105] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 15:10:34 juju-e4d256-prod-github-runner-207 kernel: [35208.543180] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 15:10:34 juju-e4d256-prod-github-runner-207 kernel: [35208.555695] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 15:10:34 juju-e4d256-prod-github-runner-207 kernel: [35208.557033] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 15:10:34 juju-e4d256-prod-github-runner-207 kernel: [35208.558314] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:10:34 juju-e4d256-prod-github-runner-207 kernel: [35208.559419] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 15:10:34 juju-e4d256-prod-github-runner-207 kernel: [35208.562108] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 15:10:34 juju-e4d256-prod-github-runner-207 kernel: [35208.563181] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 15:10:34 juju-e4d256-prod-github-runner-207 kernel: [35208.564436] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 15:10:34 juju-e4d256-prod-github-runner-207 kernel: [35208.565681] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 15:10:34 juju-e4d256-prod-github-runner-207 kernel: [35208.566898] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 15:10:34 juju-e4d256-prod-github-runner-207 kernel: [35208.568144] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 15:10:34 juju-e4d256-prod-github-runner-207 kernel: [35208.569413] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 15:10:34 juju-e4d256-prod-github-runner-207 kernel: [35208.570716] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 15:10:34 juju-e4d256-prod-github-runner-207 kernel: [35208.571867] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 15:10:34 juju-e4d256-prod-github-runner-207 kernel: [35208.573071] Call Trace: Aug 22 15:10:34 juju-e4d256-prod-github-runner-207 kernel: [35208.573984] Aug 22 15:10:34 juju-e4d256-prod-github-runner-207 kernel: [35208.574867] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:10:34 juju-e4d256-prod-github-runner-207 kernel: [35208.575896] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:10:34 juju-e4d256-prod-github-runner-207 kernel: [35208.576941] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:10:34 juju-e4d256-prod-github-runner-207 kernel: [35208.578014] ? show_regs.part.0+0x23/0x29 Aug 22 15:10:34 juju-e4d256-prod-github-runner-207 kernel: [35208.579241] ? show_regs.cold+0x8/0xd Aug 22 15:10:34 juju-e4d256-prod-github-runner-207 kernel: [35208.580597] ? watchdog_timer_fn+0x1be/0x220 Aug 22 15:10:34 juju-e4d256-prod-github-runner-207 kernel: [35208.581990] ? lockup_detector_update_enable+0x60/0x60 Aug 22 15:10:34 juju-e4d256-prod-github-runner-207 kernel: [35208.583298] ? __hrtimer_run_queues+0x107/0x230 Aug 22 15:10:34 juju-e4d256-prod-github-runner-207 kernel: [35208.584368] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 15:10:34 juju-e4d256-prod-github-runner-207 kernel: [35208.585400] ? hrtimer_interrupt+0x101/0x220 Aug 22 15:10:34 juju-e4d256-prod-github-runner-207 kernel: [35208.586420] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 15:10:34 juju-e4d256-prod-github-runner-207 kernel: [35208.587493] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 15:10:34 juju-e4d256-prod-github-runner-207 kernel: [35208.588562] Aug 22 15:10:34 juju-e4d256-prod-github-runner-207 kernel: [35208.589421] Aug 22 15:10:34 juju-e4d256-prod-github-runner-207 kernel: [35208.590256] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 15:10:34 juju-e4d256-prod-github-runner-207 kernel: [35208.591292] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:10:34 juju-e4d256-prod-github-runner-207 kernel: [35208.592371] ? _raw_spin_lock+0x22/0x30 Aug 22 15:10:34 juju-e4d256-prod-github-runner-207 kernel: [35208.593318] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:10:34 juju-e4d256-prod-github-runner-207 kernel: [35208.594336] direct_page_fault+0x206/0x310 [kvm] Aug 22 15:10:34 juju-e4d256-prod-github-runner-207 kernel: [35208.595357] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 15:10:34 juju-e4d256-prod-github-runner-207 kernel: [35208.596375] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 15:10:34 juju-e4d256-prod-github-runner-207 kernel: [35208.597397] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 15:10:34 juju-e4d256-prod-github-runner-207 kernel: [35208.598386] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 15:10:34 juju-e4d256-prod-github-runner-207 kernel: [35208.599337] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 15:10:34 juju-e4d256-prod-github-runner-207 kernel: [35208.600357] handle_exit+0x98/0x230 [kvm_amd] Aug 22 15:10:34 juju-e4d256-prod-github-runner-207 kernel: [35208.601257] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 15:10:34 juju-e4d256-prod-github-runner-207 kernel: [35208.602174] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 15:10:34 juju-e4d256-prod-github-runner-207 kernel: [35208.603100] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 15:10:34 juju-e4d256-prod-github-runner-207 kernel: [35208.604014] vcpu_run+0x62/0x2c0 [kvm] Aug 22 15:10:34 juju-e4d256-prod-github-runner-207 kernel: [35208.604853] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 15:10:34 juju-e4d256-prod-github-runner-207 kernel: [35208.605660] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 15:10:34 juju-e4d256-prod-github-runner-207 kernel: [35208.606538] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 15:10:34 juju-e4d256-prod-github-runner-207 kernel: [35208.607336] ? __seccomp_filter+0x4a/0x4a0 Aug 22 15:10:34 juju-e4d256-prod-github-runner-207 kernel: [35208.608079] ? __fget_files+0x86/0xc0 Aug 22 15:10:34 juju-e4d256-prod-github-runner-207 kernel: [35208.608800] __x64_sys_ioctl+0x95/0xd0 Aug 22 15:10:34 juju-e4d256-prod-github-runner-207 kernel: [35208.609499] do_syscall_64+0x5c/0xc0 Aug 22 15:10:34 juju-e4d256-prod-github-runner-207 kernel: [35208.610163] ? do_futex+0x162/0x1f0 Aug 22 15:10:34 juju-e4d256-prod-github-runner-207 kernel: [35208.610813] ? __x64_sys_futex+0x78/0x1e0 Aug 22 15:10:34 juju-e4d256-prod-github-runner-207 kernel: [35208.611492] ? __secure_computing+0xa9/0x120 Aug 22 15:10:34 juju-e4d256-prod-github-runner-207 kernel: [35208.612195] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 15:10:34 juju-e4d256-prod-github-runner-207 kernel: [35208.612987] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:10:34 juju-e4d256-prod-github-runner-207 kernel: [35208.613707] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:10:34 juju-e4d256-prod-github-runner-207 kernel: [35208.614424] ? do_syscall_64+0x69/0xc0 Aug 22 15:10:34 juju-e4d256-prod-github-runner-207 kernel: [35208.615091] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:10:34 juju-e4d256-prod-github-runner-207 kernel: [35208.615826] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:10:34 juju-e4d256-prod-github-runner-207 kernel: [35208.616556] ? do_syscall_64+0x69/0xc0 Aug 22 15:10:34 juju-e4d256-prod-github-runner-207 kernel: [35208.617181] ? do_syscall_64+0x69/0xc0 Aug 22 15:10:34 juju-e4d256-prod-github-runner-207 kernel: [35208.617815] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 15:10:34 juju-e4d256-prod-github-runner-207 kernel: [35208.618520] RIP: 0033:0x7faa5d0edaff Aug 22 15:10:34 juju-e4d256-prod-github-runner-207 kernel: [35208.619159] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 15:10:34 juju-e4d256-prod-github-runner-207 kernel: [35208.621261] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 15:10:34 juju-e4d256-prod-github-runner-207 kernel: [35208.622251] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 15:10:34 juju-e4d256-prod-github-runner-207 kernel: [35208.623167] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 15:10:34 juju-e4d256-prod-github-runner-207 kernel: [35208.624308] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 15:10:34 juju-e4d256-prod-github-runner-207 kernel: [35208.625234] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 15:10:34 juju-e4d256-prod-github-runner-207 kernel: [35208.626170] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 15:10:34 juju-e4d256-prod-github-runner-207 kernel: [35208.627107] Aug 22 15:11:02 juju-e4d256-prod-github-runner-207 kernel: [35236.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 32708s! [qemu-system-x86:6715] Aug 22 15:11:02 juju-e4d256-prod-github-runner-207 kernel: [35236.543100] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 15:11:02 juju-e4d256-prod-github-runner-207 kernel: [35236.543171] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 15:11:02 juju-e4d256-prod-github-runner-207 kernel: [35236.555648] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 15:11:02 juju-e4d256-prod-github-runner-207 kernel: [35236.556936] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 15:11:02 juju-e4d256-prod-github-runner-207 kernel: [35236.558150] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:11:02 juju-e4d256-prod-github-runner-207 kernel: [35236.559202] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 15:11:02 juju-e4d256-prod-github-runner-207 kernel: [35236.561773] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 15:11:02 juju-e4d256-prod-github-runner-207 kernel: [35236.562817] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 15:11:02 juju-e4d256-prod-github-runner-207 kernel: [35236.563997] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 15:11:02 juju-e4d256-prod-github-runner-207 kernel: [35236.565158] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 15:11:02 juju-e4d256-prod-github-runner-207 kernel: [35236.566325] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 15:11:02 juju-e4d256-prod-github-runner-207 kernel: [35236.567491] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 15:11:02 juju-e4d256-prod-github-runner-207 kernel: [35236.568819] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 15:11:02 juju-e4d256-prod-github-runner-207 kernel: [35236.570247] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 15:11:02 juju-e4d256-prod-github-runner-207 kernel: [35236.571455] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 15:11:02 juju-e4d256-prod-github-runner-207 kernel: [35236.572844] Call Trace: Aug 22 15:11:02 juju-e4d256-prod-github-runner-207 kernel: [35236.573814] Aug 22 15:11:02 juju-e4d256-prod-github-runner-207 kernel: [35236.574749] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:11:02 juju-e4d256-prod-github-runner-207 kernel: [35236.576079] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:11:02 juju-e4d256-prod-github-runner-207 kernel: [35236.577190] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:11:02 juju-e4d256-prod-github-runner-207 kernel: [35236.578350] ? show_regs.part.0+0x23/0x29 Aug 22 15:11:02 juju-e4d256-prod-github-runner-207 kernel: [35236.579422] ? show_regs.cold+0x8/0xd Aug 22 15:11:02 juju-e4d256-prod-github-runner-207 kernel: [35236.580491] ? watchdog_timer_fn+0x1be/0x220 Aug 22 15:11:02 juju-e4d256-prod-github-runner-207 kernel: [35236.581602] ? lockup_detector_update_enable+0x60/0x60 Aug 22 15:11:02 juju-e4d256-prod-github-runner-207 kernel: [35236.582767] ? __hrtimer_run_queues+0x107/0x230 Aug 22 15:11:02 juju-e4d256-prod-github-runner-207 kernel: [35236.583920] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 15:11:02 juju-e4d256-prod-github-runner-207 kernel: [35236.585038] ? hrtimer_interrupt+0x101/0x220 Aug 22 15:11:02 juju-e4d256-prod-github-runner-207 kernel: [35236.586232] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 15:11:02 juju-e4d256-prod-github-runner-207 kernel: [35236.587444] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 15:11:02 juju-e4d256-prod-github-runner-207 kernel: [35236.588503] Aug 22 15:11:02 juju-e4d256-prod-github-runner-207 kernel: [35236.589382] Aug 22 15:11:02 juju-e4d256-prod-github-runner-207 kernel: [35236.590221] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 15:11:02 juju-e4d256-prod-github-runner-207 kernel: [35236.591257] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:11:02 juju-e4d256-prod-github-runner-207 kernel: [35236.592307] ? _raw_spin_lock+0x22/0x30 Aug 22 15:11:02 juju-e4d256-prod-github-runner-207 kernel: [35236.593255] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:11:02 juju-e4d256-prod-github-runner-207 kernel: [35236.594280] direct_page_fault+0x206/0x310 [kvm] Aug 22 15:11:02 juju-e4d256-prod-github-runner-207 kernel: [35236.595311] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 15:11:02 juju-e4d256-prod-github-runner-207 kernel: [35236.596335] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 15:11:02 juju-e4d256-prod-github-runner-207 kernel: [35236.597341] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 15:11:02 juju-e4d256-prod-github-runner-207 kernel: [35236.598328] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 15:11:02 juju-e4d256-prod-github-runner-207 kernel: [35236.599277] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 15:11:02 juju-e4d256-prod-github-runner-207 kernel: [35236.600275] handle_exit+0x98/0x230 [kvm_amd] Aug 22 15:11:02 juju-e4d256-prod-github-runner-207 kernel: [35236.601177] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 15:11:02 juju-e4d256-prod-github-runner-207 kernel: [35236.602094] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 15:11:02 juju-e4d256-prod-github-runner-207 kernel: [35236.603021] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 15:11:02 juju-e4d256-prod-github-runner-207 kernel: [35236.603936] vcpu_run+0x62/0x2c0 [kvm] Aug 22 15:11:02 juju-e4d256-prod-github-runner-207 kernel: [35236.604751] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 15:11:02 juju-e4d256-prod-github-runner-207 kernel: [35236.605562] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 15:11:02 juju-e4d256-prod-github-runner-207 kernel: [35236.606422] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 15:11:02 juju-e4d256-prod-github-runner-207 kernel: [35236.607254] ? __seccomp_filter+0x4a/0x4a0 Aug 22 15:11:02 juju-e4d256-prod-github-runner-207 kernel: [35236.608063] ? __fget_files+0x86/0xc0 Aug 22 15:11:02 juju-e4d256-prod-github-runner-207 kernel: [35236.608897] __x64_sys_ioctl+0x95/0xd0 Aug 22 15:11:02 juju-e4d256-prod-github-runner-207 kernel: [35236.609604] do_syscall_64+0x5c/0xc0 Aug 22 15:11:02 juju-e4d256-prod-github-runner-207 kernel: [35236.610280] ? do_futex+0x162/0x1f0 Aug 22 15:11:02 juju-e4d256-prod-github-runner-207 kernel: [35236.610977] ? __x64_sys_futex+0x78/0x1e0 Aug 22 15:11:02 juju-e4d256-prod-github-runner-207 kernel: [35236.611678] ? __secure_computing+0xa9/0x120 Aug 22 15:11:02 juju-e4d256-prod-github-runner-207 kernel: [35236.612447] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 15:11:02 juju-e4d256-prod-github-runner-207 kernel: [35236.613212] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:11:02 juju-e4d256-prod-github-runner-207 kernel: [35236.613940] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:11:02 juju-e4d256-prod-github-runner-207 kernel: [35236.614659] ? do_syscall_64+0x69/0xc0 Aug 22 15:11:02 juju-e4d256-prod-github-runner-207 kernel: [35236.615320] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:11:02 juju-e4d256-prod-github-runner-207 kernel: [35236.616036] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:11:02 juju-e4d256-prod-github-runner-207 kernel: [35236.616737] ? do_syscall_64+0x69/0xc0 Aug 22 15:11:02 juju-e4d256-prod-github-runner-207 kernel: [35236.617365] ? do_syscall_64+0x69/0xc0 Aug 22 15:11:02 juju-e4d256-prod-github-runner-207 kernel: [35236.617988] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 15:11:02 juju-e4d256-prod-github-runner-207 kernel: [35236.618696] RIP: 0033:0x7faa5d0edaff Aug 22 15:11:02 juju-e4d256-prod-github-runner-207 kernel: [35236.619335] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 15:11:02 juju-e4d256-prod-github-runner-207 kernel: [35236.621380] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 15:11:02 juju-e4d256-prod-github-runner-207 kernel: [35236.622291] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 15:11:02 juju-e4d256-prod-github-runner-207 kernel: [35236.623205] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 15:11:02 juju-e4d256-prod-github-runner-207 kernel: [35236.624134] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 15:11:02 juju-e4d256-prod-github-runner-207 kernel: [35236.625035] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 15:11:02 juju-e4d256-prod-github-runner-207 kernel: [35236.625937] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 15:11:02 juju-e4d256-prod-github-runner-207 kernel: [35236.626826] Aug 22 15:11:30 juju-e4d256-prod-github-runner-207 kernel: [35264.541976] watchdog: BUG: soft lockup - CPU#1 stuck for 32734s! [qemu-system-x86:6715] Aug 22 15:11:30 juju-e4d256-prod-github-runner-207 kernel: [35264.543880] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 15:11:30 juju-e4d256-prod-github-runner-207 kernel: [35264.544173] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 15:11:30 juju-e4d256-prod-github-runner-207 kernel: [35264.556717] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 15:11:30 juju-e4d256-prod-github-runner-207 kernel: [35264.557991] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 15:11:30 juju-e4d256-prod-github-runner-207 kernel: [35264.559211] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:11:30 juju-e4d256-prod-github-runner-207 kernel: [35264.560274] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 15:11:30 juju-e4d256-prod-github-runner-207 kernel: [35264.562821] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 15:11:30 juju-e4d256-prod-github-runner-207 kernel: [35264.563870] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 15:11:30 juju-e4d256-prod-github-runner-207 kernel: [35264.565033] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 15:11:30 juju-e4d256-prod-github-runner-207 kernel: [35264.566198] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 15:11:30 juju-e4d256-prod-github-runner-207 kernel: [35264.567369] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 15:11:30 juju-e4d256-prod-github-runner-207 kernel: [35264.568541] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 15:11:30 juju-e4d256-prod-github-runner-207 kernel: [35264.569705] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 15:11:30 juju-e4d256-prod-github-runner-207 kernel: [35264.570935] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 15:11:30 juju-e4d256-prod-github-runner-207 kernel: [35264.572049] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 15:11:30 juju-e4d256-prod-github-runner-207 kernel: [35264.573241] Call Trace: Aug 22 15:11:30 juju-e4d256-prod-github-runner-207 kernel: [35264.574173] Aug 22 15:11:30 juju-e4d256-prod-github-runner-207 kernel: [35264.575073] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:11:30 juju-e4d256-prod-github-runner-207 kernel: [35264.576137] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:11:30 juju-e4d256-prod-github-runner-207 kernel: [35264.577163] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:11:30 juju-e4d256-prod-github-runner-207 kernel: [35264.578275] ? show_regs.part.0+0x23/0x29 Aug 22 15:11:30 juju-e4d256-prod-github-runner-207 kernel: [35264.579272] ? show_regs.cold+0x8/0xd Aug 22 15:11:30 juju-e4d256-prod-github-runner-207 kernel: [35264.580253] ? watchdog_timer_fn+0x1be/0x220 Aug 22 15:11:30 juju-e4d256-prod-github-runner-207 kernel: [35264.581259] ? lockup_detector_update_enable+0x60/0x60 Aug 22 15:11:30 juju-e4d256-prod-github-runner-207 kernel: [35264.582366] ? __hrtimer_run_queues+0x107/0x230 Aug 22 15:11:30 juju-e4d256-prod-github-runner-207 kernel: [35264.583393] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 15:11:30 juju-e4d256-prod-github-runner-207 kernel: [35264.584432] ? hrtimer_interrupt+0x101/0x220 Aug 22 15:11:30 juju-e4d256-prod-github-runner-207 kernel: [35264.585450] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 15:11:30 juju-e4d256-prod-github-runner-207 kernel: [35264.586537] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 15:11:30 juju-e4d256-prod-github-runner-207 kernel: [35264.587609] Aug 22 15:11:30 juju-e4d256-prod-github-runner-207 kernel: [35264.588462] Aug 22 15:11:30 juju-e4d256-prod-github-runner-207 kernel: [35264.589299] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 15:11:30 juju-e4d256-prod-github-runner-207 kernel: [35264.590379] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:11:30 juju-e4d256-prod-github-runner-207 kernel: [35264.591421] ? _raw_spin_lock+0x22/0x30 Aug 22 15:11:30 juju-e4d256-prod-github-runner-207 kernel: [35264.592385] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:11:30 juju-e4d256-prod-github-runner-207 kernel: [35264.593406] direct_page_fault+0x206/0x310 [kvm] Aug 22 15:11:30 juju-e4d256-prod-github-runner-207 kernel: [35264.594450] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 15:11:30 juju-e4d256-prod-github-runner-207 kernel: [35264.595474] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 15:11:30 juju-e4d256-prod-github-runner-207 kernel: [35264.596498] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 15:11:30 juju-e4d256-prod-github-runner-207 kernel: [35264.597536] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 15:11:30 juju-e4d256-prod-github-runner-207 kernel: [35264.598483] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 15:11:30 juju-e4d256-prod-github-runner-207 kernel: [35264.599477] handle_exit+0x98/0x230 [kvm_amd] Aug 22 15:11:30 juju-e4d256-prod-github-runner-207 kernel: [35264.600399] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 15:11:30 juju-e4d256-prod-github-runner-207 kernel: [35264.601316] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 15:11:30 juju-e4d256-prod-github-runner-207 kernel: [35264.602246] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 15:11:30 juju-e4d256-prod-github-runner-207 kernel: [35264.603149] vcpu_run+0x62/0x2c0 [kvm] Aug 22 15:11:30 juju-e4d256-prod-github-runner-207 kernel: [35264.603975] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 15:11:30 juju-e4d256-prod-github-runner-207 kernel: [35264.604783] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 15:11:30 juju-e4d256-prod-github-runner-207 kernel: [35264.605636] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 15:11:30 juju-e4d256-prod-github-runner-207 kernel: [35264.606438] ? __seccomp_filter+0x4a/0x4a0 Aug 22 15:11:30 juju-e4d256-prod-github-runner-207 kernel: [35264.607181] ? __fget_files+0x86/0xc0 Aug 22 15:11:30 juju-e4d256-prod-github-runner-207 kernel: [35264.607894] __x64_sys_ioctl+0x95/0xd0 Aug 22 15:11:30 juju-e4d256-prod-github-runner-207 kernel: [35264.608589] do_syscall_64+0x5c/0xc0 Aug 22 15:11:30 juju-e4d256-prod-github-runner-207 kernel: [35264.609254] ? do_futex+0x162/0x1f0 Aug 22 15:11:30 juju-e4d256-prod-github-runner-207 kernel: [35264.609903] ? __x64_sys_futex+0x78/0x1e0 Aug 22 15:11:30 juju-e4d256-prod-github-runner-207 kernel: [35264.610576] ? __secure_computing+0xa9/0x120 Aug 22 15:11:30 juju-e4d256-prod-github-runner-207 kernel: [35264.611265] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 15:11:30 juju-e4d256-prod-github-runner-207 kernel: [35264.612038] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:11:30 juju-e4d256-prod-github-runner-207 kernel: [35264.612760] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:11:30 juju-e4d256-prod-github-runner-207 kernel: [35264.613476] ? do_syscall_64+0x69/0xc0 Aug 22 15:11:30 juju-e4d256-prod-github-runner-207 kernel: [35264.614120] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:11:30 juju-e4d256-prod-github-runner-207 kernel: [35264.614842] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:11:30 juju-e4d256-prod-github-runner-207 kernel: [35264.615541] ? do_syscall_64+0x69/0xc0 Aug 22 15:11:30 juju-e4d256-prod-github-runner-207 kernel: [35264.616178] ? do_syscall_64+0x69/0xc0 Aug 22 15:11:30 juju-e4d256-prod-github-runner-207 kernel: [35264.616801] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 15:11:30 juju-e4d256-prod-github-runner-207 kernel: [35264.617508] RIP: 0033:0x7faa5d0edaff Aug 22 15:11:30 juju-e4d256-prod-github-runner-207 kernel: [35264.618184] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 15:11:30 juju-e4d256-prod-github-runner-207 kernel: [35264.620177] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 15:11:30 juju-e4d256-prod-github-runner-207 kernel: [35264.621091] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 15:11:30 juju-e4d256-prod-github-runner-207 kernel: [35264.621982] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 15:11:30 juju-e4d256-prod-github-runner-207 kernel: [35264.622932] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 15:11:30 juju-e4d256-prod-github-runner-207 kernel: [35264.623957] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 15:11:30 juju-e4d256-prod-github-runner-207 kernel: [35264.624941] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 15:11:30 juju-e4d256-prod-github-runner-207 kernel: [35264.625857] Aug 22 15:11:45 juju-e4d256-prod-github-runner-207 kernel: [35279.540705] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 15:11:45 juju-e4d256-prod-github-runner-207 kernel: [35279.541669] rcu: 1-....: (8763069 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=4233769 Aug 22 15:11:45 juju-e4d256-prod-github-runner-207 kernel: [35279.542816] (t=8790585 jiffies g=23269 q=37273) Aug 22 15:11:45 juju-e4d256-prod-github-runner-207 kernel: [35279.543646] NMI backtrace for cpu 1 Aug 22 15:11:45 juju-e4d256-prod-github-runner-207 kernel: [35279.544353] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 15:11:45 juju-e4d256-prod-github-runner-207 kernel: [35279.545453] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 15:11:45 juju-e4d256-prod-github-runner-207 kernel: [35279.546504] Call Trace: Aug 22 15:11:45 juju-e4d256-prod-github-runner-207 kernel: [35279.547194] Aug 22 15:11:45 juju-e4d256-prod-github-runner-207 kernel: [35279.547848] show_stack+0x52/0x5c Aug 22 15:11:45 juju-e4d256-prod-github-runner-207 kernel: [35279.548572] dump_stack_lvl+0x4a/0x63 Aug 22 15:11:45 juju-e4d256-prod-github-runner-207 kernel: [35279.549447] dump_stack+0x10/0x16 Aug 22 15:11:45 juju-e4d256-prod-github-runner-207 kernel: [35279.550168] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 15:11:45 juju-e4d256-prod-github-runner-207 kernel: [35279.550944] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 15:11:45 juju-e4d256-prod-github-runner-207 kernel: [35279.551731] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 15:11:45 juju-e4d256-prod-github-runner-207 kernel: [35279.552550] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 15:11:45 juju-e4d256-prod-github-runner-207 kernel: [35279.553364] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 15:11:45 juju-e4d256-prod-github-runner-207 kernel: [35279.554166] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 15:11:45 juju-e4d256-prod-github-runner-207 kernel: [35279.554934] print_cpu_stall.cold+0x2f/0xe2 Aug 22 15:11:45 juju-e4d256-prod-github-runner-207 kernel: [35279.555705] ? timekeeping_update+0xf7/0x150 Aug 22 15:11:45 juju-e4d256-prod-github-runner-207 kernel: [35279.556475] check_cpu_stall+0x109/0x270 Aug 22 15:11:45 juju-e4d256-prod-github-runner-207 kernel: [35279.557220] rcu_sched_clock_irq+0x9a/0x250 Aug 22 15:11:45 juju-e4d256-prod-github-runner-207 kernel: [35279.557980] update_process_times+0x94/0xd0 Aug 22 15:11:45 juju-e4d256-prod-github-runner-207 kernel: [35279.558743] tick_sched_handle+0x29/0x70 Aug 22 15:11:45 juju-e4d256-prod-github-runner-207 kernel: [35279.559576] tick_sched_timer+0x8c/0xc0 Aug 22 15:11:45 juju-e4d256-prod-github-runner-207 kernel: [35279.560685] ? tick_nohz_handler+0xb0/0xb0 Aug 22 15:11:45 juju-e4d256-prod-github-runner-207 kernel: [35279.561840] __hrtimer_run_queues+0x107/0x230 Aug 22 15:11:45 juju-e4d256-prod-github-runner-207 kernel: [35279.562976] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 15:11:45 juju-e4d256-prod-github-runner-207 kernel: [35279.564191] hrtimer_interrupt+0x101/0x220 Aug 22 15:11:45 juju-e4d256-prod-github-runner-207 kernel: [35279.565330] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 15:11:45 juju-e4d256-prod-github-runner-207 kernel: [35279.566565] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 15:11:45 juju-e4d256-prod-github-runner-207 kernel: [35279.567516] Aug 22 15:11:45 juju-e4d256-prod-github-runner-207 kernel: [35279.568155] Aug 22 15:11:45 juju-e4d256-prod-github-runner-207 kernel: [35279.568781] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 15:11:45 juju-e4d256-prod-github-runner-207 kernel: [35279.569615] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:11:45 juju-e4d256-prod-github-runner-207 kernel: [35279.570492] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 15:11:45 juju-e4d256-prod-github-runner-207 kernel: [35279.572719] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 15:11:45 juju-e4d256-prod-github-runner-207 kernel: [35279.573596] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 15:11:45 juju-e4d256-prod-github-runner-207 kernel: [35279.574616] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 15:11:45 juju-e4d256-prod-github-runner-207 kernel: [35279.575609] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 15:11:45 juju-e4d256-prod-github-runner-207 kernel: [35279.576569] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 15:11:45 juju-e4d256-prod-github-runner-207 kernel: [35279.577520] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 15:11:45 juju-e4d256-prod-github-runner-207 kernel: [35279.578474] ? _raw_spin_lock+0x22/0x30 Aug 22 15:11:45 juju-e4d256-prod-github-runner-207 kernel: [35279.579229] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:11:45 juju-e4d256-prod-github-runner-207 kernel: [35279.580097] direct_page_fault+0x206/0x310 [kvm] Aug 22 15:11:45 juju-e4d256-prod-github-runner-207 kernel: [35279.580951] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 15:11:45 juju-e4d256-prod-github-runner-207 kernel: [35279.581781] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 15:11:45 juju-e4d256-prod-github-runner-207 kernel: [35279.582613] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 15:11:45 juju-e4d256-prod-github-runner-207 kernel: [35279.583438] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 15:11:45 juju-e4d256-prod-github-runner-207 kernel: [35279.584223] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 15:11:45 juju-e4d256-prod-github-runner-207 kernel: [35279.585051] handle_exit+0x98/0x230 [kvm_amd] Aug 22 15:11:45 juju-e4d256-prod-github-runner-207 kernel: [35279.585802] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 15:11:45 juju-e4d256-prod-github-runner-207 kernel: [35279.586611] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 15:11:45 juju-e4d256-prod-github-runner-207 kernel: [35279.587436] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 15:11:45 juju-e4d256-prod-github-runner-207 kernel: [35279.588238] vcpu_run+0x62/0x2c0 [kvm] Aug 22 15:11:45 juju-e4d256-prod-github-runner-207 kernel: [35279.588954] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 15:11:45 juju-e4d256-prod-github-runner-207 kernel: [35279.589689] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 15:11:45 juju-e4d256-prod-github-runner-207 kernel: [35279.590494] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 15:11:45 juju-e4d256-prod-github-runner-207 kernel: [35279.591255] ? __seccomp_filter+0x4a/0x4a0 Aug 22 15:11:45 juju-e4d256-prod-github-runner-207 kernel: [35279.591981] ? __fget_files+0x86/0xc0 Aug 22 15:11:45 juju-e4d256-prod-github-runner-207 kernel: [35279.592690] __x64_sys_ioctl+0x95/0xd0 Aug 22 15:11:45 juju-e4d256-prod-github-runner-207 kernel: [35279.593387] do_syscall_64+0x5c/0xc0 Aug 22 15:11:45 juju-e4d256-prod-github-runner-207 kernel: [35279.594243] ? do_futex+0x162/0x1f0 Aug 22 15:11:45 juju-e4d256-prod-github-runner-207 kernel: [35279.595281] ? __x64_sys_futex+0x78/0x1e0 Aug 22 15:11:45 juju-e4d256-prod-github-runner-207 kernel: [35279.596367] ? __secure_computing+0xa9/0x120 Aug 22 15:11:45 juju-e4d256-prod-github-runner-207 kernel: [35279.597490] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 15:11:45 juju-e4d256-prod-github-runner-207 kernel: [35279.598780] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:11:45 juju-e4d256-prod-github-runner-207 kernel: [35279.600001] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:11:45 juju-e4d256-prod-github-runner-207 kernel: [35279.601199] ? do_syscall_64+0x69/0xc0 Aug 22 15:11:45 juju-e4d256-prod-github-runner-207 kernel: [35279.602249] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:11:45 juju-e4d256-prod-github-runner-207 kernel: [35279.603442] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:11:45 juju-e4d256-prod-github-runner-207 kernel: [35279.604681] ? do_syscall_64+0x69/0xc0 Aug 22 15:11:45 juju-e4d256-prod-github-runner-207 kernel: [35279.605754] ? do_syscall_64+0x69/0xc0 Aug 22 15:11:45 juju-e4d256-prod-github-runner-207 kernel: [35279.606803] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 15:11:45 juju-e4d256-prod-github-runner-207 kernel: [35279.608017] RIP: 0033:0x7faa5d0edaff Aug 22 15:11:45 juju-e4d256-prod-github-runner-207 kernel: [35279.609037] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 15:11:45 juju-e4d256-prod-github-runner-207 kernel: [35279.611615] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 15:11:45 juju-e4d256-prod-github-runner-207 kernel: [35279.612590] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 15:11:45 juju-e4d256-prod-github-runner-207 kernel: [35279.613538] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 15:11:45 juju-e4d256-prod-github-runner-207 kernel: [35279.614484] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 15:11:45 juju-e4d256-prod-github-runner-207 kernel: [35279.615458] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 15:11:45 juju-e4d256-prod-github-runner-207 kernel: [35279.616404] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 15:11:45 juju-e4d256-prod-github-runner-207 kernel: [35279.617324] Aug 22 15:12:10 juju-e4d256-prod-github-runner-207 kernel: [35304.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 32771s! [qemu-system-x86:6715] Aug 22 15:12:10 juju-e4d256-prod-github-runner-207 kernel: [35304.543229] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 15:12:10 juju-e4d256-prod-github-runner-207 kernel: [35304.543303] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 15:12:10 juju-e4d256-prod-github-runner-207 kernel: [35304.555381] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 15:12:10 juju-e4d256-prod-github-runner-207 kernel: [35304.556651] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 15:12:10 juju-e4d256-prod-github-runner-207 kernel: [35304.557871] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:12:10 juju-e4d256-prod-github-runner-207 kernel: [35304.558935] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 15:12:10 juju-e4d256-prod-github-runner-207 kernel: [35304.561497] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 15:12:10 juju-e4d256-prod-github-runner-207 kernel: [35304.562547] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 15:12:10 juju-e4d256-prod-github-runner-207 kernel: [35304.563726] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 15:12:10 juju-e4d256-prod-github-runner-207 kernel: [35304.564895] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 15:12:10 juju-e4d256-prod-github-runner-207 kernel: [35304.566056] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 15:12:10 juju-e4d256-prod-github-runner-207 kernel: [35304.567227] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 15:12:10 juju-e4d256-prod-github-runner-207 kernel: [35304.568396] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 15:12:10 juju-e4d256-prod-github-runner-207 kernel: [35304.569629] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 15:12:10 juju-e4d256-prod-github-runner-207 kernel: [35304.570731] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 15:12:10 juju-e4d256-prod-github-runner-207 kernel: [35304.571960] Call Trace: Aug 22 15:12:10 juju-e4d256-prod-github-runner-207 kernel: [35304.572879] Aug 22 15:12:10 juju-e4d256-prod-github-runner-207 kernel: [35304.573769] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:12:10 juju-e4d256-prod-github-runner-207 kernel: [35304.574799] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:12:10 juju-e4d256-prod-github-runner-207 kernel: [35304.575825] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:12:10 juju-e4d256-prod-github-runner-207 kernel: [35304.576911] ? show_regs.part.0+0x23/0x29 Aug 22 15:12:10 juju-e4d256-prod-github-runner-207 kernel: [35304.577909] ? show_regs.cold+0x8/0xd Aug 22 15:12:10 juju-e4d256-prod-github-runner-207 kernel: [35304.578882] ? watchdog_timer_fn+0x1be/0x220 Aug 22 15:12:10 juju-e4d256-prod-github-runner-207 kernel: [35304.579905] ? lockup_detector_update_enable+0x60/0x60 Aug 22 15:12:10 juju-e4d256-prod-github-runner-207 kernel: [35304.580970] ? __hrtimer_run_queues+0x107/0x230 Aug 22 15:12:10 juju-e4d256-prod-github-runner-207 kernel: [35304.581999] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 15:12:10 juju-e4d256-prod-github-runner-207 kernel: [35304.583022] ? hrtimer_interrupt+0x101/0x220 Aug 22 15:12:10 juju-e4d256-prod-github-runner-207 kernel: [35304.584061] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 15:12:10 juju-e4d256-prod-github-runner-207 kernel: [35304.585129] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 15:12:10 juju-e4d256-prod-github-runner-207 kernel: [35304.586173] Aug 22 15:12:10 juju-e4d256-prod-github-runner-207 kernel: [35304.587030] Aug 22 15:12:10 juju-e4d256-prod-github-runner-207 kernel: [35304.587875] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 15:12:10 juju-e4d256-prod-github-runner-207 kernel: [35304.588909] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:12:10 juju-e4d256-prod-github-runner-207 kernel: [35304.589947] ? _raw_spin_lock+0x22/0x30 Aug 22 15:12:10 juju-e4d256-prod-github-runner-207 kernel: [35304.590890] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:12:10 juju-e4d256-prod-github-runner-207 kernel: [35304.591916] direct_page_fault+0x206/0x310 [kvm] Aug 22 15:12:10 juju-e4d256-prod-github-runner-207 kernel: [35304.592939] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 15:12:10 juju-e4d256-prod-github-runner-207 kernel: [35304.593953] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 15:12:10 juju-e4d256-prod-github-runner-207 kernel: [35304.595024] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 15:12:10 juju-e4d256-prod-github-runner-207 kernel: [35304.596067] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 15:12:10 juju-e4d256-prod-github-runner-207 kernel: [35304.597026] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 15:12:10 juju-e4d256-prod-github-runner-207 kernel: [35304.598013] handle_exit+0x98/0x230 [kvm_amd] Aug 22 15:12:10 juju-e4d256-prod-github-runner-207 kernel: [35304.598907] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 15:12:10 juju-e4d256-prod-github-runner-207 kernel: [35304.599846] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 15:12:10 juju-e4d256-prod-github-runner-207 kernel: [35304.600771] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 15:12:10 juju-e4d256-prod-github-runner-207 kernel: [35304.601675] vcpu_run+0x62/0x2c0 [kvm] Aug 22 15:12:10 juju-e4d256-prod-github-runner-207 kernel: [35304.602486] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 15:12:10 juju-e4d256-prod-github-runner-207 kernel: [35304.603344] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 15:12:10 juju-e4d256-prod-github-runner-207 kernel: [35304.604227] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 15:12:10 juju-e4d256-prod-github-runner-207 kernel: [35304.605029] ? __seccomp_filter+0x4a/0x4a0 Aug 22 15:12:10 juju-e4d256-prod-github-runner-207 kernel: [35304.605772] ? __fget_files+0x86/0xc0 Aug 22 15:12:10 juju-e4d256-prod-github-runner-207 kernel: [35304.606476] __x64_sys_ioctl+0x95/0xd0 Aug 22 15:12:10 juju-e4d256-prod-github-runner-207 kernel: [35304.607188] do_syscall_64+0x5c/0xc0 Aug 22 15:12:10 juju-e4d256-prod-github-runner-207 kernel: [35304.607860] ? do_futex+0x162/0x1f0 Aug 22 15:12:10 juju-e4d256-prod-github-runner-207 kernel: [35304.608529] ? __x64_sys_futex+0x78/0x1e0 Aug 22 15:12:10 juju-e4d256-prod-github-runner-207 kernel: [35304.609205] ? __secure_computing+0xa9/0x120 Aug 22 15:12:10 juju-e4d256-prod-github-runner-207 kernel: [35304.609895] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 15:12:10 juju-e4d256-prod-github-runner-207 kernel: [35304.610655] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:12:10 juju-e4d256-prod-github-runner-207 kernel: [35304.611397] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:12:10 juju-e4d256-prod-github-runner-207 kernel: [35304.612116] ? do_syscall_64+0x69/0xc0 Aug 22 15:12:10 juju-e4d256-prod-github-runner-207 kernel: [35304.612779] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:12:10 juju-e4d256-prod-github-runner-207 kernel: [35304.613482] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:12:10 juju-e4d256-prod-github-runner-207 kernel: [35304.614176] ? do_syscall_64+0x69/0xc0 Aug 22 15:12:10 juju-e4d256-prod-github-runner-207 kernel: [35304.614801] ? do_syscall_64+0x69/0xc0 Aug 22 15:12:10 juju-e4d256-prod-github-runner-207 kernel: [35304.615445] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 15:12:10 juju-e4d256-prod-github-runner-207 kernel: [35304.616151] RIP: 0033:0x7faa5d0edaff Aug 22 15:12:10 juju-e4d256-prod-github-runner-207 kernel: [35304.616808] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 15:12:10 juju-e4d256-prod-github-runner-207 kernel: [35304.618795] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 15:12:10 juju-e4d256-prod-github-runner-207 kernel: [35304.619722] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 15:12:10 juju-e4d256-prod-github-runner-207 kernel: [35304.620611] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 15:12:10 juju-e4d256-prod-github-runner-207 kernel: [35304.621499] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 15:12:10 juju-e4d256-prod-github-runner-207 kernel: [35304.622381] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 15:12:10 juju-e4d256-prod-github-runner-207 kernel: [35304.623274] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 15:12:10 juju-e4d256-prod-github-runner-207 kernel: [35304.624164] Aug 22 15:12:38 juju-e4d256-prod-github-runner-207 kernel: [35332.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 32797s! [qemu-system-x86:6715] Aug 22 15:12:38 juju-e4d256-prod-github-runner-207 kernel: [35332.543250] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 15:12:38 juju-e4d256-prod-github-runner-207 kernel: [35332.543379] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 15:12:38 juju-e4d256-prod-github-runner-207 kernel: [35332.557793] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 15:12:38 juju-e4d256-prod-github-runner-207 kernel: [35332.559282] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 15:12:38 juju-e4d256-prod-github-runner-207 kernel: [35332.560780] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:12:38 juju-e4d256-prod-github-runner-207 kernel: [35332.562011] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 15:12:38 juju-e4d256-prod-github-runner-207 kernel: [35332.564943] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 15:12:38 juju-e4d256-prod-github-runner-207 kernel: [35332.566129] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 15:12:38 juju-e4d256-prod-github-runner-207 kernel: [35332.567486] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 15:12:38 juju-e4d256-prod-github-runner-207 kernel: [35332.568779] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 15:12:38 juju-e4d256-prod-github-runner-207 kernel: [35332.570077] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 15:12:38 juju-e4d256-prod-github-runner-207 kernel: [35332.571384] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 15:12:38 juju-e4d256-prod-github-runner-207 kernel: [35332.572713] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 15:12:38 juju-e4d256-prod-github-runner-207 kernel: [35332.574105] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 15:12:38 juju-e4d256-prod-github-runner-207 kernel: [35332.575415] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 15:12:38 juju-e4d256-prod-github-runner-207 kernel: [35332.576748] Call Trace: Aug 22 15:12:38 juju-e4d256-prod-github-runner-207 kernel: [35332.577714] Aug 22 15:12:38 juju-e4d256-prod-github-runner-207 kernel: [35332.578638] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:12:38 juju-e4d256-prod-github-runner-207 kernel: [35332.579765] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:12:38 juju-e4d256-prod-github-runner-207 kernel: [35332.580873] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:12:38 juju-e4d256-prod-github-runner-207 kernel: [35332.582035] ? show_regs.part.0+0x23/0x29 Aug 22 15:12:38 juju-e4d256-prod-github-runner-207 kernel: [35332.583122] ? show_regs.cold+0x8/0xd Aug 22 15:12:38 juju-e4d256-prod-github-runner-207 kernel: [35332.584174] ? watchdog_timer_fn+0x1be/0x220 Aug 22 15:12:38 juju-e4d256-prod-github-runner-207 kernel: [35332.585263] ? lockup_detector_update_enable+0x60/0x60 Aug 22 15:12:38 juju-e4d256-prod-github-runner-207 kernel: [35332.586431] ? __hrtimer_run_queues+0x107/0x230 Aug 22 15:12:38 juju-e4d256-prod-github-runner-207 kernel: [35332.587574] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 15:12:38 juju-e4d256-prod-github-runner-207 kernel: [35332.588685] ? hrtimer_interrupt+0x101/0x220 Aug 22 15:12:38 juju-e4d256-prod-github-runner-207 kernel: [35332.589788] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 15:12:38 juju-e4d256-prod-github-runner-207 kernel: [35332.590979] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 15:12:38 juju-e4d256-prod-github-runner-207 kernel: [35332.592129] Aug 22 15:12:38 juju-e4d256-prod-github-runner-207 kernel: [35332.593037] Aug 22 15:12:38 juju-e4d256-prod-github-runner-207 kernel: [35332.593927] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 15:12:38 juju-e4d256-prod-github-runner-207 kernel: [35332.595095] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:12:38 juju-e4d256-prod-github-runner-207 kernel: [35332.596238] ? _raw_spin_lock+0x22/0x30 Aug 22 15:12:38 juju-e4d256-prod-github-runner-207 kernel: [35332.597271] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:12:38 juju-e4d256-prod-github-runner-207 kernel: [35332.598430] direct_page_fault+0x206/0x310 [kvm] Aug 22 15:12:38 juju-e4d256-prod-github-runner-207 kernel: [35332.599588] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 15:12:38 juju-e4d256-prod-github-runner-207 kernel: [35332.600702] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 15:12:38 juju-e4d256-prod-github-runner-207 kernel: [35332.601807] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 15:12:38 juju-e4d256-prod-github-runner-207 kernel: [35332.602932] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 15:12:38 juju-e4d256-prod-github-runner-207 kernel: [35332.603990] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 15:12:38 juju-e4d256-prod-github-runner-207 kernel: [35332.605080] handle_exit+0x98/0x230 [kvm_amd] Aug 22 15:12:38 juju-e4d256-prod-github-runner-207 kernel: [35332.606060] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 15:12:38 juju-e4d256-prod-github-runner-207 kernel: [35332.607121] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 15:12:38 juju-e4d256-prod-github-runner-207 kernel: [35332.608155] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 15:12:38 juju-e4d256-prod-github-runner-207 kernel: [35332.609299] vcpu_run+0x62/0x2c0 [kvm] Aug 22 15:12:38 juju-e4d256-prod-github-runner-207 kernel: [35332.610189] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 15:12:38 juju-e4d256-prod-github-runner-207 kernel: [35332.611124] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 15:12:38 juju-e4d256-prod-github-runner-207 kernel: [35332.612086] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 15:12:38 juju-e4d256-prod-github-runner-207 kernel: [35332.612973] ? __seccomp_filter+0x4a/0x4a0 Aug 22 15:12:38 juju-e4d256-prod-github-runner-207 kernel: [35332.613798] ? __fget_files+0x86/0xc0 Aug 22 15:12:38 juju-e4d256-prod-github-runner-207 kernel: [35332.614577] __x64_sys_ioctl+0x95/0xd0 Aug 22 15:12:38 juju-e4d256-prod-github-runner-207 kernel: [35332.615375] do_syscall_64+0x5c/0xc0 Aug 22 15:12:38 juju-e4d256-prod-github-runner-207 kernel: [35332.616120] ? do_futex+0x162/0x1f0 Aug 22 15:12:38 juju-e4d256-prod-github-runner-207 kernel: [35332.616841] ? __x64_sys_futex+0x78/0x1e0 Aug 22 15:12:38 juju-e4d256-prod-github-runner-207 kernel: [35332.617597] ? __secure_computing+0xa9/0x120 Aug 22 15:12:38 juju-e4d256-prod-github-runner-207 kernel: [35332.618373] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 15:12:38 juju-e4d256-prod-github-runner-207 kernel: [35332.619339] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:12:38 juju-e4d256-prod-github-runner-207 kernel: [35332.620158] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:12:38 juju-e4d256-prod-github-runner-207 kernel: [35332.620972] ? do_syscall_64+0x69/0xc0 Aug 22 15:12:38 juju-e4d256-prod-github-runner-207 kernel: [35332.621689] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:12:38 juju-e4d256-prod-github-runner-207 kernel: [35332.622492] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:12:38 juju-e4d256-prod-github-runner-207 kernel: [35332.623306] ? do_syscall_64+0x69/0xc0 Aug 22 15:12:38 juju-e4d256-prod-github-runner-207 kernel: [35332.624012] ? do_syscall_64+0x69/0xc0 Aug 22 15:12:38 juju-e4d256-prod-github-runner-207 kernel: [35332.624728] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 15:12:38 juju-e4d256-prod-github-runner-207 kernel: [35332.625538] RIP: 0033:0x7faa5d0edaff Aug 22 15:12:38 juju-e4d256-prod-github-runner-207 kernel: [35332.626238] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 15:12:38 juju-e4d256-prod-github-runner-207 kernel: [35332.628570] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 15:12:38 juju-e4d256-prod-github-runner-207 kernel: [35332.629623] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 15:12:38 juju-e4d256-prod-github-runner-207 kernel: [35332.630645] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 15:12:38 juju-e4d256-prod-github-runner-207 kernel: [35332.631675] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 15:12:38 juju-e4d256-prod-github-runner-207 kernel: [35332.632773] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 15:12:38 juju-e4d256-prod-github-runner-207 kernel: [35332.633791] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 15:12:38 juju-e4d256-prod-github-runner-207 kernel: [35332.634826] Aug 22 15:13:06 juju-e4d256-prod-github-runner-207 kernel: [35360.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 32824s! [qemu-system-x86:6715] Aug 22 15:13:06 juju-e4d256-prod-github-runner-207 kernel: [35360.543883] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 15:13:06 juju-e4d256-prod-github-runner-207 kernel: [35360.544165] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 15:13:06 juju-e4d256-prod-github-runner-207 kernel: [35360.556310] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 15:13:06 juju-e4d256-prod-github-runner-207 kernel: [35360.557588] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 15:13:06 juju-e4d256-prod-github-runner-207 kernel: [35360.558813] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:13:06 juju-e4d256-prod-github-runner-207 kernel: [35360.559867] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 15:13:06 juju-e4d256-prod-github-runner-207 kernel: [35360.562399] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 15:13:06 juju-e4d256-prod-github-runner-207 kernel: [35360.563456] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 15:13:06 juju-e4d256-prod-github-runner-207 kernel: [35360.564612] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 15:13:06 juju-e4d256-prod-github-runner-207 kernel: [35360.565766] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 15:13:06 juju-e4d256-prod-github-runner-207 kernel: [35360.566944] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 15:13:06 juju-e4d256-prod-github-runner-207 kernel: [35360.568103] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 15:13:06 juju-e4d256-prod-github-runner-207 kernel: [35360.569282] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 15:13:06 juju-e4d256-prod-github-runner-207 kernel: [35360.570547] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 15:13:06 juju-e4d256-prod-github-runner-207 kernel: [35360.571659] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 15:13:06 juju-e4d256-prod-github-runner-207 kernel: [35360.572856] Call Trace: Aug 22 15:13:06 juju-e4d256-prod-github-runner-207 kernel: [35360.573772] Aug 22 15:13:06 juju-e4d256-prod-github-runner-207 kernel: [35360.574688] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:13:06 juju-e4d256-prod-github-runner-207 kernel: [35360.575719] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:13:06 juju-e4d256-prod-github-runner-207 kernel: [35360.576744] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:13:06 juju-e4d256-prod-github-runner-207 kernel: [35360.577862] ? show_regs.part.0+0x23/0x29 Aug 22 15:13:06 juju-e4d256-prod-github-runner-207 kernel: [35360.578892] ? show_regs.cold+0x8/0xd Aug 22 15:13:06 juju-e4d256-prod-github-runner-207 kernel: [35360.579868] ? watchdog_timer_fn+0x1be/0x220 Aug 22 15:13:06 juju-e4d256-prod-github-runner-207 kernel: [35360.580877] ? lockup_detector_update_enable+0x60/0x60 Aug 22 15:13:06 juju-e4d256-prod-github-runner-207 kernel: [35360.581945] ? __hrtimer_run_queues+0x107/0x230 Aug 22 15:13:06 juju-e4d256-prod-github-runner-207 kernel: [35360.582983] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 15:13:06 juju-e4d256-prod-github-runner-207 kernel: [35360.584006] ? hrtimer_interrupt+0x101/0x220 Aug 22 15:13:06 juju-e4d256-prod-github-runner-207 kernel: [35360.585021] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 15:13:06 juju-e4d256-prod-github-runner-207 kernel: [35360.586104] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 15:13:06 juju-e4d256-prod-github-runner-207 kernel: [35360.587164] Aug 22 15:13:06 juju-e4d256-prod-github-runner-207 kernel: [35360.588022] Aug 22 15:13:06 juju-e4d256-prod-github-runner-207 kernel: [35360.588859] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 15:13:06 juju-e4d256-prod-github-runner-207 kernel: [35360.589912] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:13:06 juju-e4d256-prod-github-runner-207 kernel: [35360.590973] ? _raw_spin_lock+0x22/0x30 Aug 22 15:13:06 juju-e4d256-prod-github-runner-207 kernel: [35360.591923] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:13:06 juju-e4d256-prod-github-runner-207 kernel: [35360.592948] direct_page_fault+0x206/0x310 [kvm] Aug 22 15:13:06 juju-e4d256-prod-github-runner-207 kernel: [35360.593975] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 15:13:06 juju-e4d256-prod-github-runner-207 kernel: [35360.594991] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 15:13:06 juju-e4d256-prod-github-runner-207 kernel: [35360.595990] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 15:13:06 juju-e4d256-prod-github-runner-207 kernel: [35360.596998] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 15:13:06 juju-e4d256-prod-github-runner-207 kernel: [35360.597965] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 15:13:06 juju-e4d256-prod-github-runner-207 kernel: [35360.598951] handle_exit+0x98/0x230 [kvm_amd] Aug 22 15:13:06 juju-e4d256-prod-github-runner-207 kernel: [35360.599875] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 15:13:06 juju-e4d256-prod-github-runner-207 kernel: [35360.600807] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 15:13:06 juju-e4d256-prod-github-runner-207 kernel: [35360.601731] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 15:13:06 juju-e4d256-prod-github-runner-207 kernel: [35360.602648] vcpu_run+0x62/0x2c0 [kvm] Aug 22 15:13:06 juju-e4d256-prod-github-runner-207 kernel: [35360.603460] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 15:13:06 juju-e4d256-prod-github-runner-207 kernel: [35360.604273] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 15:13:06 juju-e4d256-prod-github-runner-207 kernel: [35360.605127] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 15:13:06 juju-e4d256-prod-github-runner-207 kernel: [35360.605925] ? __seccomp_filter+0x4a/0x4a0 Aug 22 15:13:06 juju-e4d256-prod-github-runner-207 kernel: [35360.606686] ? __fget_files+0x86/0xc0 Aug 22 15:13:06 juju-e4d256-prod-github-runner-207 kernel: [35360.607399] __x64_sys_ioctl+0x95/0xd0 Aug 22 15:13:06 juju-e4d256-prod-github-runner-207 kernel: [35360.608092] do_syscall_64+0x5c/0xc0 Aug 22 15:13:06 juju-e4d256-prod-github-runner-207 kernel: [35360.608802] ? do_futex+0x162/0x1f0 Aug 22 15:13:06 juju-e4d256-prod-github-runner-207 kernel: [35360.609454] ? __x64_sys_futex+0x78/0x1e0 Aug 22 15:13:06 juju-e4d256-prod-github-runner-207 kernel: [35360.610127] ? __secure_computing+0xa9/0x120 Aug 22 15:13:06 juju-e4d256-prod-github-runner-207 kernel: [35360.610831] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 15:13:06 juju-e4d256-prod-github-runner-207 kernel: [35360.611593] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:13:06 juju-e4d256-prod-github-runner-207 kernel: [35360.612314] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:13:06 juju-e4d256-prod-github-runner-207 kernel: [35360.613037] ? do_syscall_64+0x69/0xc0 Aug 22 15:13:06 juju-e4d256-prod-github-runner-207 kernel: [35360.613682] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:13:06 juju-e4d256-prod-github-runner-207 kernel: [35360.614385] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:13:06 juju-e4d256-prod-github-runner-207 kernel: [35360.615087] ? do_syscall_64+0x69/0xc0 Aug 22 15:13:06 juju-e4d256-prod-github-runner-207 kernel: [35360.615712] ? do_syscall_64+0x69/0xc0 Aug 22 15:13:06 juju-e4d256-prod-github-runner-207 kernel: [35360.616338] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 15:13:06 juju-e4d256-prod-github-runner-207 kernel: [35360.617044] RIP: 0033:0x7faa5d0edaff Aug 22 15:13:06 juju-e4d256-prod-github-runner-207 kernel: [35360.617723] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 15:13:06 juju-e4d256-prod-github-runner-207 kernel: [35360.619735] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 15:13:06 juju-e4d256-prod-github-runner-207 kernel: [35360.620648] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 15:13:06 juju-e4d256-prod-github-runner-207 kernel: [35360.621536] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 15:13:06 juju-e4d256-prod-github-runner-207 kernel: [35360.622574] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 15:13:06 juju-e4d256-prod-github-runner-207 kernel: [35360.623468] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 15:13:06 juju-e4d256-prod-github-runner-207 kernel: [35360.624379] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 15:13:06 juju-e4d256-prod-github-runner-207 kernel: [35360.625272] Aug 22 15:13:34 juju-e4d256-prod-github-runner-207 kernel: [35388.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 32850s! [qemu-system-x86:6715] Aug 22 15:13:34 juju-e4d256-prod-github-runner-207 kernel: [35388.543106] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 15:13:34 juju-e4d256-prod-github-runner-207 kernel: [35388.543180] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 15:13:34 juju-e4d256-prod-github-runner-207 kernel: [35388.555242] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 15:13:34 juju-e4d256-prod-github-runner-207 kernel: [35388.556507] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 15:13:34 juju-e4d256-prod-github-runner-207 kernel: [35388.557728] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:13:34 juju-e4d256-prod-github-runner-207 kernel: [35388.558803] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 15:13:34 juju-e4d256-prod-github-runner-207 kernel: [35388.561354] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 15:13:34 juju-e4d256-prod-github-runner-207 kernel: [35388.562566] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 15:13:34 juju-e4d256-prod-github-runner-207 kernel: [35388.563870] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 15:13:34 juju-e4d256-prod-github-runner-207 kernel: [35388.565159] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 15:13:34 juju-e4d256-prod-github-runner-207 kernel: [35388.566466] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 15:13:34 juju-e4d256-prod-github-runner-207 kernel: [35388.567766] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 15:13:34 juju-e4d256-prod-github-runner-207 kernel: [35388.569074] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 15:13:34 juju-e4d256-prod-github-runner-207 kernel: [35388.570476] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 15:13:34 juju-e4d256-prod-github-runner-207 kernel: [35388.571682] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 15:13:34 juju-e4d256-prod-github-runner-207 kernel: [35388.573008] Call Trace: Aug 22 15:13:34 juju-e4d256-prod-github-runner-207 kernel: [35388.573989] Aug 22 15:13:34 juju-e4d256-prod-github-runner-207 kernel: [35388.574932] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:13:34 juju-e4d256-prod-github-runner-207 kernel: [35388.576044] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:13:34 juju-e4d256-prod-github-runner-207 kernel: [35388.577153] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:13:34 juju-e4d256-prod-github-runner-207 kernel: [35388.578330] ? show_regs.part.0+0x23/0x29 Aug 22 15:13:34 juju-e4d256-prod-github-runner-207 kernel: [35388.579411] ? show_regs.cold+0x8/0xd Aug 22 15:13:34 juju-e4d256-prod-github-runner-207 kernel: [35388.580456] ? watchdog_timer_fn+0x1be/0x220 Aug 22 15:13:34 juju-e4d256-prod-github-runner-207 kernel: [35388.581546] ? lockup_detector_update_enable+0x60/0x60 Aug 22 15:13:34 juju-e4d256-prod-github-runner-207 kernel: [35388.582728] ? __hrtimer_run_queues+0x107/0x230 Aug 22 15:13:34 juju-e4d256-prod-github-runner-207 kernel: [35388.583846] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 15:13:34 juju-e4d256-prod-github-runner-207 kernel: [35388.585066] ? hrtimer_interrupt+0x101/0x220 Aug 22 15:13:34 juju-e4d256-prod-github-runner-207 kernel: [35388.586381] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 15:13:34 juju-e4d256-prod-github-runner-207 kernel: [35388.587451] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 15:13:34 juju-e4d256-prod-github-runner-207 kernel: [35388.588494] Aug 22 15:13:34 juju-e4d256-prod-github-runner-207 kernel: [35388.589351] Aug 22 15:13:34 juju-e4d256-prod-github-runner-207 kernel: [35388.590194] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 15:13:34 juju-e4d256-prod-github-runner-207 kernel: [35388.591233] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:13:34 juju-e4d256-prod-github-runner-207 kernel: [35388.592274] ? _raw_spin_lock+0x22/0x30 Aug 22 15:13:34 juju-e4d256-prod-github-runner-207 kernel: [35388.593215] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:13:34 juju-e4d256-prod-github-runner-207 kernel: [35388.594255] direct_page_fault+0x206/0x310 [kvm] Aug 22 15:13:34 juju-e4d256-prod-github-runner-207 kernel: [35388.595305] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 15:13:34 juju-e4d256-prod-github-runner-207 kernel: [35388.596488] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 15:13:34 juju-e4d256-prod-github-runner-207 kernel: [35388.597490] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 15:13:34 juju-e4d256-prod-github-runner-207 kernel: [35388.598484] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 15:13:34 juju-e4d256-prod-github-runner-207 kernel: [35388.599429] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 15:13:34 juju-e4d256-prod-github-runner-207 kernel: [35388.600409] handle_exit+0x98/0x230 [kvm_amd] Aug 22 15:13:34 juju-e4d256-prod-github-runner-207 kernel: [35388.601307] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 15:13:34 juju-e4d256-prod-github-runner-207 kernel: [35388.602229] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 15:13:34 juju-e4d256-prod-github-runner-207 kernel: [35388.603151] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 15:13:34 juju-e4d256-prod-github-runner-207 kernel: [35388.604054] vcpu_run+0x62/0x2c0 [kvm] Aug 22 15:13:34 juju-e4d256-prod-github-runner-207 kernel: [35388.604870] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 15:13:34 juju-e4d256-prod-github-runner-207 kernel: [35388.605678] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 15:13:34 juju-e4d256-prod-github-runner-207 kernel: [35388.606544] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 15:13:34 juju-e4d256-prod-github-runner-207 kernel: [35388.607370] ? __seccomp_filter+0x4a/0x4a0 Aug 22 15:13:34 juju-e4d256-prod-github-runner-207 kernel: [35388.608114] ? __fget_files+0x86/0xc0 Aug 22 15:13:34 juju-e4d256-prod-github-runner-207 kernel: [35388.608818] __x64_sys_ioctl+0x95/0xd0 Aug 22 15:13:34 juju-e4d256-prod-github-runner-207 kernel: [35388.609514] do_syscall_64+0x5c/0xc0 Aug 22 15:13:34 juju-e4d256-prod-github-runner-207 kernel: [35388.610190] ? do_futex+0x162/0x1f0 Aug 22 15:13:34 juju-e4d256-prod-github-runner-207 kernel: [35388.610841] ? __x64_sys_futex+0x78/0x1e0 Aug 22 15:13:34 juju-e4d256-prod-github-runner-207 kernel: [35388.611524] ? __secure_computing+0xa9/0x120 Aug 22 15:13:34 juju-e4d256-prod-github-runner-207 kernel: [35388.612213] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 15:13:34 juju-e4d256-prod-github-runner-207 kernel: [35388.612973] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:13:34 juju-e4d256-prod-github-runner-207 kernel: [35388.613708] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:13:34 juju-e4d256-prod-github-runner-207 kernel: [35388.614447] ? do_syscall_64+0x69/0xc0 Aug 22 15:13:34 juju-e4d256-prod-github-runner-207 kernel: [35388.615094] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:13:34 juju-e4d256-prod-github-runner-207 kernel: [35388.615799] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:13:34 juju-e4d256-prod-github-runner-207 kernel: [35388.616493] ? do_syscall_64+0x69/0xc0 Aug 22 15:13:34 juju-e4d256-prod-github-runner-207 kernel: [35388.617118] ? do_syscall_64+0x69/0xc0 Aug 22 15:13:34 juju-e4d256-prod-github-runner-207 kernel: [35388.617761] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 15:13:34 juju-e4d256-prod-github-runner-207 kernel: [35388.618478] RIP: 0033:0x7faa5d0edaff Aug 22 15:13:34 juju-e4d256-prod-github-runner-207 kernel: [35388.619106] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 15:13:34 juju-e4d256-prod-github-runner-207 kernel: [35388.621104] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 15:13:34 juju-e4d256-prod-github-runner-207 kernel: [35388.622023] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 15:13:34 juju-e4d256-prod-github-runner-207 kernel: [35388.622927] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 15:13:34 juju-e4d256-prod-github-runner-207 kernel: [35388.623814] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 15:13:34 juju-e4d256-prod-github-runner-207 kernel: [35388.624716] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 15:13:34 juju-e4d256-prod-github-runner-207 kernel: [35388.625606] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 15:13:34 juju-e4d256-prod-github-runner-207 kernel: [35388.626535] Aug 22 15:14:02 juju-e4d256-prod-github-runner-207 kernel: [35416.541980] watchdog: BUG: soft lockup - CPU#1 stuck for 32876s! [qemu-system-x86:6715] Aug 22 15:14:02 juju-e4d256-prod-github-runner-207 kernel: [35416.543099] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 15:14:02 juju-e4d256-prod-github-runner-207 kernel: [35416.543176] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 15:14:02 juju-e4d256-prod-github-runner-207 kernel: [35416.556409] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 15:14:02 juju-e4d256-prod-github-runner-207 kernel: [35416.557998] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 15:14:02 juju-e4d256-prod-github-runner-207 kernel: [35416.559341] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:14:02 juju-e4d256-prod-github-runner-207 kernel: [35416.560640] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 15:14:02 juju-e4d256-prod-github-runner-207 kernel: [35416.564010] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 15:14:02 juju-e4d256-prod-github-runner-207 kernel: [35416.565060] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 15:14:02 juju-e4d256-prod-github-runner-207 kernel: [35416.566230] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 15:14:02 juju-e4d256-prod-github-runner-207 kernel: [35416.567388] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 15:14:02 juju-e4d256-prod-github-runner-207 kernel: [35416.568591] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 15:14:02 juju-e4d256-prod-github-runner-207 kernel: [35416.569789] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 15:14:02 juju-e4d256-prod-github-runner-207 kernel: [35416.570985] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 15:14:02 juju-e4d256-prod-github-runner-207 kernel: [35416.572455] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 15:14:02 juju-e4d256-prod-github-runner-207 kernel: [35416.573559] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 15:14:02 juju-e4d256-prod-github-runner-207 kernel: [35416.574831] Call Trace: Aug 22 15:14:02 juju-e4d256-prod-github-runner-207 kernel: [35416.575745] Aug 22 15:14:02 juju-e4d256-prod-github-runner-207 kernel: [35416.576640] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:14:02 juju-e4d256-prod-github-runner-207 kernel: [35416.577671] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:14:02 juju-e4d256-prod-github-runner-207 kernel: [35416.579666] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:14:02 juju-e4d256-prod-github-runner-207 kernel: [35416.580743] ? show_regs.part.0+0x23/0x29 Aug 22 15:14:02 juju-e4d256-prod-github-runner-207 kernel: [35416.581739] ? show_regs.cold+0x8/0xd Aug 22 15:14:02 juju-e4d256-prod-github-runner-207 kernel: [35416.582731] ? watchdog_timer_fn+0x1be/0x220 Aug 22 15:14:02 juju-e4d256-prod-github-runner-207 kernel: [35416.583892] ? lockup_detector_update_enable+0x60/0x60 Aug 22 15:14:02 juju-e4d256-prod-github-runner-207 kernel: [35416.584973] ? __hrtimer_run_queues+0x107/0x230 Aug 22 15:14:02 juju-e4d256-prod-github-runner-207 kernel: [35416.586024] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 15:14:02 juju-e4d256-prod-github-runner-207 kernel: [35416.587073] ? hrtimer_interrupt+0x101/0x220 Aug 22 15:14:02 juju-e4d256-prod-github-runner-207 kernel: [35416.588088] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 15:14:02 juju-e4d256-prod-github-runner-207 kernel: [35416.589161] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 15:14:02 juju-e4d256-prod-github-runner-207 kernel: [35416.590218] Aug 22 15:14:02 juju-e4d256-prod-github-runner-207 kernel: [35416.591089] Aug 22 15:14:02 juju-e4d256-prod-github-runner-207 kernel: [35416.591942] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 15:14:02 juju-e4d256-prod-github-runner-207 kernel: [35416.592979] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:14:02 juju-e4d256-prod-github-runner-207 kernel: [35416.594036] ? _raw_spin_lock+0x22/0x30 Aug 22 15:14:02 juju-e4d256-prod-github-runner-207 kernel: [35416.594981] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:14:02 juju-e4d256-prod-github-runner-207 kernel: [35416.596261] direct_page_fault+0x206/0x310 [kvm] Aug 22 15:14:02 juju-e4d256-prod-github-runner-207 kernel: [35416.597458] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 15:14:02 juju-e4d256-prod-github-runner-207 kernel: [35416.598562] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 15:14:02 juju-e4d256-prod-github-runner-207 kernel: [35416.599693] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 15:14:02 juju-e4d256-prod-github-runner-207 kernel: [35416.600868] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 15:14:02 juju-e4d256-prod-github-runner-207 kernel: [35416.601986] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 15:14:02 juju-e4d256-prod-github-runner-207 kernel: [35416.602992] handle_exit+0x98/0x230 [kvm_amd] Aug 22 15:14:02 juju-e4d256-prod-github-runner-207 kernel: [35416.603886] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 15:14:02 juju-e4d256-prod-github-runner-207 kernel: [35416.604803] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 15:14:02 juju-e4d256-prod-github-runner-207 kernel: [35416.605736] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 15:14:02 juju-e4d256-prod-github-runner-207 kernel: [35416.606735] vcpu_run+0x62/0x2c0 [kvm] Aug 22 15:14:02 juju-e4d256-prod-github-runner-207 kernel: [35416.607553] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 15:14:02 juju-e4d256-prod-github-runner-207 kernel: [35416.608363] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 15:14:02 juju-e4d256-prod-github-runner-207 kernel: [35416.609217] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 15:14:02 juju-e4d256-prod-github-runner-207 kernel: [35416.610027] ? __seccomp_filter+0x4a/0x4a0 Aug 22 15:14:02 juju-e4d256-prod-github-runner-207 kernel: [35416.610775] ? __fget_files+0x86/0xc0 Aug 22 15:14:02 juju-e4d256-prod-github-runner-207 kernel: [35416.611481] __x64_sys_ioctl+0x95/0xd0 Aug 22 15:14:02 juju-e4d256-prod-github-runner-207 kernel: [35416.612174] do_syscall_64+0x5c/0xc0 Aug 22 15:14:02 juju-e4d256-prod-github-runner-207 kernel: [35416.612853] ? do_futex+0x162/0x1f0 Aug 22 15:14:02 juju-e4d256-prod-github-runner-207 kernel: [35416.613504] ? __x64_sys_futex+0x78/0x1e0 Aug 22 15:14:02 juju-e4d256-prod-github-runner-207 kernel: [35416.614213] ? __secure_computing+0xa9/0x120 Aug 22 15:14:02 juju-e4d256-prod-github-runner-207 kernel: [35416.614914] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 15:14:02 juju-e4d256-prod-github-runner-207 kernel: [35416.615753] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:14:02 juju-e4d256-prod-github-runner-207 kernel: [35416.616476] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:14:02 juju-e4d256-prod-github-runner-207 kernel: [35416.617197] ? do_syscall_64+0x69/0xc0 Aug 22 15:14:02 juju-e4d256-prod-github-runner-207 kernel: [35416.617871] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:14:02 juju-e4d256-prod-github-runner-207 kernel: [35416.618579] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:14:02 juju-e4d256-prod-github-runner-207 kernel: [35416.619275] ? do_syscall_64+0x69/0xc0 Aug 22 15:14:02 juju-e4d256-prod-github-runner-207 kernel: [35416.619902] ? do_syscall_64+0x69/0xc0 Aug 22 15:14:02 juju-e4d256-prod-github-runner-207 kernel: [35416.620545] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 15:14:02 juju-e4d256-prod-github-runner-207 kernel: [35416.621268] RIP: 0033:0x7faa5d0edaff Aug 22 15:14:02 juju-e4d256-prod-github-runner-207 kernel: [35416.622057] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 15:14:02 juju-e4d256-prod-github-runner-207 kernel: [35416.624125] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 15:14:02 juju-e4d256-prod-github-runner-207 kernel: [35416.625117] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 15:14:02 juju-e4d256-prod-github-runner-207 kernel: [35416.626199] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 15:14:02 juju-e4d256-prod-github-runner-207 kernel: [35416.627110] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 15:14:02 juju-e4d256-prod-github-runner-207 kernel: [35416.628026] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 15:14:02 juju-e4d256-prod-github-runner-207 kernel: [35416.628916] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 15:14:02 juju-e4d256-prod-github-runner-207 kernel: [35416.629835] Aug 22 15:14:30 juju-e4d256-prod-github-runner-207 kernel: [35444.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 32902s! [qemu-system-x86:6715] Aug 22 15:14:30 juju-e4d256-prod-github-runner-207 kernel: [35444.543890] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 15:14:30 juju-e4d256-prod-github-runner-207 kernel: [35444.544215] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 15:14:30 juju-e4d256-prod-github-runner-207 kernel: [35444.556463] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 15:14:30 juju-e4d256-prod-github-runner-207 kernel: [35444.557766] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 15:14:30 juju-e4d256-prod-github-runner-207 kernel: [35444.559014] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:14:30 juju-e4d256-prod-github-runner-207 kernel: [35444.560073] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 15:14:30 juju-e4d256-prod-github-runner-207 kernel: [35444.562628] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 15:14:30 juju-e4d256-prod-github-runner-207 kernel: [35444.563677] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 15:14:30 juju-e4d256-prod-github-runner-207 kernel: [35444.564841] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 15:14:30 juju-e4d256-prod-github-runner-207 kernel: [35444.566016] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 15:14:30 juju-e4d256-prod-github-runner-207 kernel: [35444.567179] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 15:14:30 juju-e4d256-prod-github-runner-207 kernel: [35444.568358] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 15:14:30 juju-e4d256-prod-github-runner-207 kernel: [35444.569544] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 15:14:30 juju-e4d256-prod-github-runner-207 kernel: [35444.570789] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 15:14:30 juju-e4d256-prod-github-runner-207 kernel: [35444.571889] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 15:14:30 juju-e4d256-prod-github-runner-207 kernel: [35444.573112] Call Trace: Aug 22 15:14:30 juju-e4d256-prod-github-runner-207 kernel: [35444.574031] Aug 22 15:14:30 juju-e4d256-prod-github-runner-207 kernel: [35444.574930] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:14:30 juju-e4d256-prod-github-runner-207 kernel: [35444.575961] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:14:30 juju-e4d256-prod-github-runner-207 kernel: [35444.577000] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:14:30 juju-e4d256-prod-github-runner-207 kernel: [35444.578136] ? show_regs.part.0+0x23/0x29 Aug 22 15:14:30 juju-e4d256-prod-github-runner-207 kernel: [35444.579152] ? show_regs.cold+0x8/0xd Aug 22 15:14:30 juju-e4d256-prod-github-runner-207 kernel: [35444.580130] ? watchdog_timer_fn+0x1be/0x220 Aug 22 15:14:30 juju-e4d256-prod-github-runner-207 kernel: [35444.581150] ? lockup_detector_update_enable+0x60/0x60 Aug 22 15:14:30 juju-e4d256-prod-github-runner-207 kernel: [35444.582233] ? __hrtimer_run_queues+0x107/0x230 Aug 22 15:14:30 juju-e4d256-prod-github-runner-207 kernel: [35444.583269] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 15:14:30 juju-e4d256-prod-github-runner-207 kernel: [35444.584305] ? hrtimer_interrupt+0x101/0x220 Aug 22 15:14:30 juju-e4d256-prod-github-runner-207 kernel: [35444.585320] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 15:14:30 juju-e4d256-prod-github-runner-207 kernel: [35444.586543] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 15:14:30 juju-e4d256-prod-github-runner-207 kernel: [35444.587718] Aug 22 15:14:30 juju-e4d256-prod-github-runner-207 kernel: [35444.588580] Aug 22 15:14:30 juju-e4d256-prod-github-runner-207 kernel: [35444.589421] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 15:14:30 juju-e4d256-prod-github-runner-207 kernel: [35444.590484] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:14:30 juju-e4d256-prod-github-runner-207 kernel: [35444.591524] ? _raw_spin_lock+0x22/0x30 Aug 22 15:14:30 juju-e4d256-prod-github-runner-207 kernel: [35444.592480] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:14:30 juju-e4d256-prod-github-runner-207 kernel: [35444.593515] direct_page_fault+0x206/0x310 [kvm] Aug 22 15:14:30 juju-e4d256-prod-github-runner-207 kernel: [35444.594543] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 15:14:30 juju-e4d256-prod-github-runner-207 kernel: [35444.595566] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 15:14:30 juju-e4d256-prod-github-runner-207 kernel: [35444.596568] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 15:14:30 juju-e4d256-prod-github-runner-207 kernel: [35444.597594] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 15:14:30 juju-e4d256-prod-github-runner-207 kernel: [35444.598543] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 15:14:30 juju-e4d256-prod-github-runner-207 kernel: [35444.599521] handle_exit+0x98/0x230 [kvm_amd] Aug 22 15:14:30 juju-e4d256-prod-github-runner-207 kernel: [35444.600414] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 15:14:30 juju-e4d256-prod-github-runner-207 kernel: [35444.601329] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 15:14:30 juju-e4d256-prod-github-runner-207 kernel: [35444.602261] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 15:14:30 juju-e4d256-prod-github-runner-207 kernel: [35444.603163] vcpu_run+0x62/0x2c0 [kvm] Aug 22 15:14:30 juju-e4d256-prod-github-runner-207 kernel: [35444.603972] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 15:14:30 juju-e4d256-prod-github-runner-207 kernel: [35444.604779] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 15:14:30 juju-e4d256-prod-github-runner-207 kernel: [35444.605642] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 15:14:30 juju-e4d256-prod-github-runner-207 kernel: [35444.606445] ? __seccomp_filter+0x4a/0x4a0 Aug 22 15:14:30 juju-e4d256-prod-github-runner-207 kernel: [35444.607189] ? __fget_files+0x86/0xc0 Aug 22 15:14:30 juju-e4d256-prod-github-runner-207 kernel: [35444.607898] __x64_sys_ioctl+0x95/0xd0 Aug 22 15:14:30 juju-e4d256-prod-github-runner-207 kernel: [35444.608591] do_syscall_64+0x5c/0xc0 Aug 22 15:14:30 juju-e4d256-prod-github-runner-207 kernel: [35444.609258] ? do_futex+0x162/0x1f0 Aug 22 15:14:30 juju-e4d256-prod-github-runner-207 kernel: [35444.609918] ? __x64_sys_futex+0x78/0x1e0 Aug 22 15:14:30 juju-e4d256-prod-github-runner-207 kernel: [35444.610591] ? __secure_computing+0xa9/0x120 Aug 22 15:14:30 juju-e4d256-prod-github-runner-207 kernel: [35444.611286] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 15:14:30 juju-e4d256-prod-github-runner-207 kernel: [35444.612046] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:14:30 juju-e4d256-prod-github-runner-207 kernel: [35444.612767] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:14:30 juju-e4d256-prod-github-runner-207 kernel: [35444.613494] ? do_syscall_64+0x69/0xc0 Aug 22 15:14:30 juju-e4d256-prod-github-runner-207 kernel: [35444.614145] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:14:30 juju-e4d256-prod-github-runner-207 kernel: [35444.614854] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:14:30 juju-e4d256-prod-github-runner-207 kernel: [35444.615549] ? do_syscall_64+0x69/0xc0 Aug 22 15:14:30 juju-e4d256-prod-github-runner-207 kernel: [35444.616182] ? do_syscall_64+0x69/0xc0 Aug 22 15:14:30 juju-e4d256-prod-github-runner-207 kernel: [35444.616809] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 15:14:30 juju-e4d256-prod-github-runner-207 kernel: [35444.617528] RIP: 0033:0x7faa5d0edaff Aug 22 15:14:30 juju-e4d256-prod-github-runner-207 kernel: [35444.618181] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 15:14:30 juju-e4d256-prod-github-runner-207 kernel: [35444.620216] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 15:14:30 juju-e4d256-prod-github-runner-207 kernel: [35444.621142] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 15:14:30 juju-e4d256-prod-github-runner-207 kernel: [35444.622053] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 15:14:30 juju-e4d256-prod-github-runner-207 kernel: [35444.622944] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 15:14:30 juju-e4d256-prod-github-runner-207 kernel: [35444.623837] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 15:14:30 juju-e4d256-prod-github-runner-207 kernel: [35444.624731] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 15:14:30 juju-e4d256-prod-github-runner-207 kernel: [35444.625646] Aug 22 15:14:45 juju-e4d256-prod-github-runner-207 kernel: [35459.552706] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 15:14:45 juju-e4d256-prod-github-runner-207 kernel: [35459.553701] rcu: 1-....: (8807931 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=4255333 Aug 22 15:14:45 juju-e4d256-prod-github-runner-207 kernel: [35459.554849] (t=8835588 jiffies g=23269 q=37385) Aug 22 15:14:45 juju-e4d256-prod-github-runner-207 kernel: [35459.555635] NMI backtrace for cpu 1 Aug 22 15:14:45 juju-e4d256-prod-github-runner-207 kernel: [35459.556353] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 15:14:45 juju-e4d256-prod-github-runner-207 kernel: [35459.557470] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 15:14:45 juju-e4d256-prod-github-runner-207 kernel: [35459.558680] Call Trace: Aug 22 15:14:45 juju-e4d256-prod-github-runner-207 kernel: [35459.559352] Aug 22 15:14:45 juju-e4d256-prod-github-runner-207 kernel: [35459.560000] show_stack+0x52/0x5c Aug 22 15:14:45 juju-e4d256-prod-github-runner-207 kernel: [35459.560733] dump_stack_lvl+0x4a/0x63 Aug 22 15:14:45 juju-e4d256-prod-github-runner-207 kernel: [35459.561504] dump_stack+0x10/0x16 Aug 22 15:14:45 juju-e4d256-prod-github-runner-207 kernel: [35459.562222] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 15:14:45 juju-e4d256-prod-github-runner-207 kernel: [35459.563010] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 15:14:45 juju-e4d256-prod-github-runner-207 kernel: [35459.563802] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 15:14:45 juju-e4d256-prod-github-runner-207 kernel: [35459.564666] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 15:14:45 juju-e4d256-prod-github-runner-207 kernel: [35459.565509] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 15:14:45 juju-e4d256-prod-github-runner-207 kernel: [35459.566336] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 15:14:45 juju-e4d256-prod-github-runner-207 kernel: [35459.567149] print_cpu_stall.cold+0x2f/0xe2 Aug 22 15:14:45 juju-e4d256-prod-github-runner-207 kernel: [35459.567914] ? timekeeping_update+0xf7/0x150 Aug 22 15:14:45 juju-e4d256-prod-github-runner-207 kernel: [35459.568682] check_cpu_stall+0x109/0x270 Aug 22 15:14:45 juju-e4d256-prod-github-runner-207 kernel: [35459.569441] rcu_sched_clock_irq+0x9a/0x250 Aug 22 15:14:45 juju-e4d256-prod-github-runner-207 kernel: [35459.570211] update_process_times+0x94/0xd0 Aug 22 15:14:45 juju-e4d256-prod-github-runner-207 kernel: [35459.570982] tick_sched_handle+0x29/0x70 Aug 22 15:14:45 juju-e4d256-prod-github-runner-207 kernel: [35459.571727] tick_sched_timer+0x8c/0xc0 Aug 22 15:14:45 juju-e4d256-prod-github-runner-207 kernel: [35459.572465] ? tick_nohz_handler+0xb0/0xb0 Aug 22 15:14:45 juju-e4d256-prod-github-runner-207 kernel: [35459.573221] __hrtimer_run_queues+0x107/0x230 Aug 22 15:14:45 juju-e4d256-prod-github-runner-207 kernel: [35459.574007] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 15:14:45 juju-e4d256-prod-github-runner-207 kernel: [35459.574781] hrtimer_interrupt+0x101/0x220 Aug 22 15:14:45 juju-e4d256-prod-github-runner-207 kernel: [35459.575543] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 15:14:45 juju-e4d256-prod-github-runner-207 kernel: [35459.576356] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 15:14:45 juju-e4d256-prod-github-runner-207 kernel: [35459.577155] Aug 22 15:14:45 juju-e4d256-prod-github-runner-207 kernel: [35459.577798] Aug 22 15:14:45 juju-e4d256-prod-github-runner-207 kernel: [35459.578425] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 15:14:45 juju-e4d256-prod-github-runner-207 kernel: [35459.579239] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:14:45 juju-e4d256-prod-github-runner-207 kernel: [35459.580121] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 15:14:45 juju-e4d256-prod-github-runner-207 kernel: [35459.582328] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 15:14:45 juju-e4d256-prod-github-runner-207 kernel: [35459.583201] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 15:14:45 juju-e4d256-prod-github-runner-207 kernel: [35459.584190] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 15:14:45 juju-e4d256-prod-github-runner-207 kernel: [35459.585163] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 15:14:45 juju-e4d256-prod-github-runner-207 kernel: [35459.586128] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 15:14:45 juju-e4d256-prod-github-runner-207 kernel: [35459.587092] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 15:14:45 juju-e4d256-prod-github-runner-207 kernel: [35459.588052] ? _raw_spin_lock+0x22/0x30 Aug 22 15:14:45 juju-e4d256-prod-github-runner-207 kernel: [35459.588855] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:14:45 juju-e4d256-prod-github-runner-207 kernel: [35459.589725] direct_page_fault+0x206/0x310 [kvm] Aug 22 15:14:45 juju-e4d256-prod-github-runner-207 kernel: [35459.590561] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 15:14:45 juju-e4d256-prod-github-runner-207 kernel: [35459.591386] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 15:14:45 juju-e4d256-prod-github-runner-207 kernel: [35459.592221] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 15:14:45 juju-e4d256-prod-github-runner-207 kernel: [35459.593051] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 15:14:45 juju-e4d256-prod-github-runner-207 kernel: [35459.593853] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 15:14:45 juju-e4d256-prod-github-runner-207 kernel: [35459.594674] handle_exit+0x98/0x230 [kvm_amd] Aug 22 15:14:45 juju-e4d256-prod-github-runner-207 kernel: [35459.595431] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 15:14:45 juju-e4d256-prod-github-runner-207 kernel: [35459.596221] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 15:14:45 juju-e4d256-prod-github-runner-207 kernel: [35459.597021] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 15:14:45 juju-e4d256-prod-github-runner-207 kernel: [35459.597831] vcpu_run+0x62/0x2c0 [kvm] Aug 22 15:14:45 juju-e4d256-prod-github-runner-207 kernel: [35459.598545] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 15:14:45 juju-e4d256-prod-github-runner-207 kernel: [35459.599278] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 15:14:45 juju-e4d256-prod-github-runner-207 kernel: [35459.600078] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 15:14:45 juju-e4d256-prod-github-runner-207 kernel: [35459.600836] ? __seccomp_filter+0x4a/0x4a0 Aug 22 15:14:45 juju-e4d256-prod-github-runner-207 kernel: [35459.601562] ? __fget_files+0x86/0xc0 Aug 22 15:14:45 juju-e4d256-prod-github-runner-207 kernel: [35459.602266] __x64_sys_ioctl+0x95/0xd0 Aug 22 15:14:45 juju-e4d256-prod-github-runner-207 kernel: [35459.602971] do_syscall_64+0x5c/0xc0 Aug 22 15:14:45 juju-e4d256-prod-github-runner-207 kernel: [35459.603650] ? do_futex+0x162/0x1f0 Aug 22 15:14:45 juju-e4d256-prod-github-runner-207 kernel: [35459.604320] ? __x64_sys_futex+0x78/0x1e0 Aug 22 15:14:45 juju-e4d256-prod-github-runner-207 kernel: [35459.605018] ? __secure_computing+0xa9/0x120 Aug 22 15:14:45 juju-e4d256-prod-github-runner-207 kernel: [35459.605738] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 15:14:45 juju-e4d256-prod-github-runner-207 kernel: [35459.606532] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:14:45 juju-e4d256-prod-github-runner-207 kernel: [35459.607293] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:14:45 juju-e4d256-prod-github-runner-207 kernel: [35459.608322] ? do_syscall_64+0x69/0xc0 Aug 22 15:14:45 juju-e4d256-prod-github-runner-207 kernel: [35459.609322] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:14:45 juju-e4d256-prod-github-runner-207 kernel: [35459.610393] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:14:45 juju-e4d256-prod-github-runner-207 kernel: [35459.611419] ? do_syscall_64+0x69/0xc0 Aug 22 15:14:45 juju-e4d256-prod-github-runner-207 kernel: [35459.612264] ? do_syscall_64+0x69/0xc0 Aug 22 15:14:45 juju-e4d256-prod-github-runner-207 kernel: [35459.613155] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 15:14:45 juju-e4d256-prod-github-runner-207 kernel: [35459.614200] RIP: 0033:0x7faa5d0edaff Aug 22 15:14:45 juju-e4d256-prod-github-runner-207 kernel: [35459.615105] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 15:14:45 juju-e4d256-prod-github-runner-207 kernel: [35459.617298] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 15:14:45 juju-e4d256-prod-github-runner-207 kernel: [35459.618279] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 15:14:45 juju-e4d256-prod-github-runner-207 kernel: [35459.619226] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 15:14:45 juju-e4d256-prod-github-runner-207 kernel: [35459.620171] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 15:14:45 juju-e4d256-prod-github-runner-207 kernel: [35459.621113] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 15:14:45 juju-e4d256-prod-github-runner-207 kernel: [35459.622061] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 15:14:45 juju-e4d256-prod-github-runner-207 kernel: [35459.623318] Aug 22 15:15:10 juju-e4d256-prod-github-runner-207 kernel: [35484.541981] watchdog: BUG: soft lockup - CPU#1 stuck for 32939s! [qemu-system-x86:6715] Aug 22 15:15:10 juju-e4d256-prod-github-runner-207 kernel: [35484.543580] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 15:15:10 juju-e4d256-prod-github-runner-207 kernel: [35484.543672] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 15:15:10 juju-e4d256-prod-github-runner-207 kernel: [35484.557171] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 15:15:10 juju-e4d256-prod-github-runner-207 kernel: [35484.558446] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 15:15:10 juju-e4d256-prod-github-runner-207 kernel: [35484.559688] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:15:10 juju-e4d256-prod-github-runner-207 kernel: [35484.560757] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 15:15:10 juju-e4d256-prod-github-runner-207 kernel: [35484.563342] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 15:15:10 juju-e4d256-prod-github-runner-207 kernel: [35484.564410] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 15:15:10 juju-e4d256-prod-github-runner-207 kernel: [35484.565610] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 15:15:10 juju-e4d256-prod-github-runner-207 kernel: [35484.566785] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 15:15:10 juju-e4d256-prod-github-runner-207 kernel: [35484.567997] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 15:15:10 juju-e4d256-prod-github-runner-207 kernel: [35484.569188] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 15:15:10 juju-e4d256-prod-github-runner-207 kernel: [35484.570381] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 15:15:10 juju-e4d256-prod-github-runner-207 kernel: [35484.571643] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 15:15:10 juju-e4d256-prod-github-runner-207 kernel: [35484.572751] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 15:15:10 juju-e4d256-prod-github-runner-207 kernel: [35484.573974] Call Trace: Aug 22 15:15:10 juju-e4d256-prod-github-runner-207 kernel: [35484.574892] Aug 22 15:15:10 juju-e4d256-prod-github-runner-207 kernel: [35484.575788] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:15:10 juju-e4d256-prod-github-runner-207 kernel: [35484.576834] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:15:10 juju-e4d256-prod-github-runner-207 kernel: [35484.578255] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:15:10 juju-e4d256-prod-github-runner-207 kernel: [35484.579362] ? show_regs.part.0+0x23/0x29 Aug 22 15:15:10 juju-e4d256-prod-github-runner-207 kernel: [35484.580690] ? show_regs.cold+0x8/0xd Aug 22 15:15:10 juju-e4d256-prod-github-runner-207 kernel: [35484.581690] ? watchdog_timer_fn+0x1be/0x220 Aug 22 15:15:10 juju-e4d256-prod-github-runner-207 kernel: [35484.582704] ? lockup_detector_update_enable+0x60/0x60 Aug 22 15:15:10 juju-e4d256-prod-github-runner-207 kernel: [35484.583789] ? __hrtimer_run_queues+0x107/0x230 Aug 22 15:15:10 juju-e4d256-prod-github-runner-207 kernel: [35484.584825] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 15:15:10 juju-e4d256-prod-github-runner-207 kernel: [35484.585890] ? hrtimer_interrupt+0x101/0x220 Aug 22 15:15:10 juju-e4d256-prod-github-runner-207 kernel: [35484.586913] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 15:15:10 juju-e4d256-prod-github-runner-207 kernel: [35484.587990] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 15:15:10 juju-e4d256-prod-github-runner-207 kernel: [35484.589080] Aug 22 15:15:10 juju-e4d256-prod-github-runner-207 kernel: [35484.589966] Aug 22 15:15:10 juju-e4d256-prod-github-runner-207 kernel: [35484.590865] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 15:15:10 juju-e4d256-prod-github-runner-207 kernel: [35484.591918] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:15:10 juju-e4d256-prod-github-runner-207 kernel: [35484.592965] ? _raw_spin_lock+0x22/0x30 Aug 22 15:15:10 juju-e4d256-prod-github-runner-207 kernel: [35484.593937] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:15:10 juju-e4d256-prod-github-runner-207 kernel: [35484.594966] direct_page_fault+0x206/0x310 [kvm] Aug 22 15:15:10 juju-e4d256-prod-github-runner-207 kernel: [35484.596028] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 15:15:10 juju-e4d256-prod-github-runner-207 kernel: [35484.597068] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 15:15:10 juju-e4d256-prod-github-runner-207 kernel: [35484.598083] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 15:15:10 juju-e4d256-prod-github-runner-207 kernel: [35484.599058] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 15:15:10 juju-e4d256-prod-github-runner-207 kernel: [35484.600008] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 15:15:10 juju-e4d256-prod-github-runner-207 kernel: [35484.600992] handle_exit+0x98/0x230 [kvm_amd] Aug 22 15:15:10 juju-e4d256-prod-github-runner-207 kernel: [35484.601919] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 15:15:10 juju-e4d256-prod-github-runner-207 kernel: [35484.602845] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 15:15:10 juju-e4d256-prod-github-runner-207 kernel: [35484.603788] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 15:15:10 juju-e4d256-prod-github-runner-207 kernel: [35484.604749] vcpu_run+0x62/0x2c0 [kvm] Aug 22 15:15:10 juju-e4d256-prod-github-runner-207 kernel: [35484.605608] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 15:15:10 juju-e4d256-prod-github-runner-207 kernel: [35484.606464] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 15:15:10 juju-e4d256-prod-github-runner-207 kernel: [35484.607369] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 15:15:10 juju-e4d256-prod-github-runner-207 kernel: [35484.608181] ? __seccomp_filter+0x4a/0x4a0 Aug 22 15:15:10 juju-e4d256-prod-github-runner-207 kernel: [35484.608946] ? __fget_files+0x86/0xc0 Aug 22 15:15:10 juju-e4d256-prod-github-runner-207 kernel: [35484.609684] __x64_sys_ioctl+0x95/0xd0 Aug 22 15:15:10 juju-e4d256-prod-github-runner-207 kernel: [35484.610383] do_syscall_64+0x5c/0xc0 Aug 22 15:15:10 juju-e4d256-prod-github-runner-207 kernel: [35484.611053] ? do_futex+0x162/0x1f0 Aug 22 15:15:10 juju-e4d256-prod-github-runner-207 kernel: [35484.611705] ? __x64_sys_futex+0x78/0x1e0 Aug 22 15:15:10 juju-e4d256-prod-github-runner-207 kernel: [35484.612389] ? __secure_computing+0xa9/0x120 Aug 22 15:15:10 juju-e4d256-prod-github-runner-207 kernel: [35484.613111] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 15:15:10 juju-e4d256-prod-github-runner-207 kernel: [35484.613876] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:15:10 juju-e4d256-prod-github-runner-207 kernel: [35484.614625] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:15:10 juju-e4d256-prod-github-runner-207 kernel: [35484.615377] ? do_syscall_64+0x69/0xc0 Aug 22 15:15:10 juju-e4d256-prod-github-runner-207 kernel: [35484.616026] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:15:10 juju-e4d256-prod-github-runner-207 kernel: [35484.616730] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:15:10 juju-e4d256-prod-github-runner-207 kernel: [35484.617440] ? do_syscall_64+0x69/0xc0 Aug 22 15:15:10 juju-e4d256-prod-github-runner-207 kernel: [35484.618068] ? do_syscall_64+0x69/0xc0 Aug 22 15:15:10 juju-e4d256-prod-github-runner-207 kernel: [35484.618699] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 15:15:10 juju-e4d256-prod-github-runner-207 kernel: [35484.619411] RIP: 0033:0x7faa5d0edaff Aug 22 15:15:10 juju-e4d256-prod-github-runner-207 kernel: [35484.620036] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 15:15:10 juju-e4d256-prod-github-runner-207 kernel: [35484.622038] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 15:15:10 juju-e4d256-prod-github-runner-207 kernel: [35484.622950] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 15:15:10 juju-e4d256-prod-github-runner-207 kernel: [35484.623880] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 15:15:10 juju-e4d256-prod-github-runner-207 kernel: [35484.624880] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 15:15:10 juju-e4d256-prod-github-runner-207 kernel: [35484.625793] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 15:15:10 juju-e4d256-prod-github-runner-207 kernel: [35484.626691] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 15:15:10 juju-e4d256-prod-github-runner-207 kernel: [35484.627588] Aug 22 15:15:38 juju-e4d256-prod-github-runner-207 kernel: [35512.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 32965s! [qemu-system-x86:6715] Aug 22 15:15:38 juju-e4d256-prod-github-runner-207 kernel: [35512.543306] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 15:15:38 juju-e4d256-prod-github-runner-207 kernel: [35512.543382] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 15:15:38 juju-e4d256-prod-github-runner-207 kernel: [35512.555830] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 15:15:38 juju-e4d256-prod-github-runner-207 kernel: [35512.557136] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 15:15:38 juju-e4d256-prod-github-runner-207 kernel: [35512.558405] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:15:38 juju-e4d256-prod-github-runner-207 kernel: [35512.559498] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 15:15:38 juju-e4d256-prod-github-runner-207 kernel: [35512.562171] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 15:15:38 juju-e4d256-prod-github-runner-207 kernel: [35512.563256] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 15:15:38 juju-e4d256-prod-github-runner-207 kernel: [35512.564464] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 15:15:38 juju-e4d256-prod-github-runner-207 kernel: [35512.565685] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 15:15:38 juju-e4d256-prod-github-runner-207 kernel: [35512.566883] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 15:15:38 juju-e4d256-prod-github-runner-207 kernel: [35512.568073] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 15:15:38 juju-e4d256-prod-github-runner-207 kernel: [35512.569282] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 15:15:38 juju-e4d256-prod-github-runner-207 kernel: [35512.570574] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 15:15:38 juju-e4d256-prod-github-runner-207 kernel: [35512.571720] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 15:15:38 juju-e4d256-prod-github-runner-207 kernel: [35512.572954] Call Trace: Aug 22 15:15:38 juju-e4d256-prod-github-runner-207 kernel: [35512.573879] Aug 22 15:15:38 juju-e4d256-prod-github-runner-207 kernel: [35512.574766] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:15:38 juju-e4d256-prod-github-runner-207 kernel: [35512.575828] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:15:38 juju-e4d256-prod-github-runner-207 kernel: [35512.576915] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:15:38 juju-e4d256-prod-github-runner-207 kernel: [35512.578016] ? show_regs.part.0+0x23/0x29 Aug 22 15:15:38 juju-e4d256-prod-github-runner-207 kernel: [35512.579026] ? show_regs.cold+0x8/0xd Aug 22 15:15:38 juju-e4d256-prod-github-runner-207 kernel: [35512.580011] ? watchdog_timer_fn+0x1be/0x220 Aug 22 15:15:38 juju-e4d256-prod-github-runner-207 kernel: [35512.581052] ? lockup_detector_update_enable+0x60/0x60 Aug 22 15:15:38 juju-e4d256-prod-github-runner-207 kernel: [35512.582137] ? __hrtimer_run_queues+0x107/0x230 Aug 22 15:15:38 juju-e4d256-prod-github-runner-207 kernel: [35512.583194] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 15:15:38 juju-e4d256-prod-github-runner-207 kernel: [35512.584257] ? hrtimer_interrupt+0x101/0x220 Aug 22 15:15:38 juju-e4d256-prod-github-runner-207 kernel: [35512.585297] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 15:15:38 juju-e4d256-prod-github-runner-207 kernel: [35512.586387] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 15:15:38 juju-e4d256-prod-github-runner-207 kernel: [35512.587443] Aug 22 15:15:38 juju-e4d256-prod-github-runner-207 kernel: [35512.588304] Aug 22 15:15:38 juju-e4d256-prod-github-runner-207 kernel: [35512.589164] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 15:15:38 juju-e4d256-prod-github-runner-207 kernel: [35512.590210] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:15:38 juju-e4d256-prod-github-runner-207 kernel: [35512.591263] ? _raw_spin_lock+0x22/0x30 Aug 22 15:15:38 juju-e4d256-prod-github-runner-207 kernel: [35512.592219] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:15:38 juju-e4d256-prod-github-runner-207 kernel: [35512.593252] direct_page_fault+0x206/0x310 [kvm] Aug 22 15:15:38 juju-e4d256-prod-github-runner-207 kernel: [35512.594286] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 15:15:38 juju-e4d256-prod-github-runner-207 kernel: [35512.595305] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 15:15:38 juju-e4d256-prod-github-runner-207 kernel: [35512.596316] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 15:15:38 juju-e4d256-prod-github-runner-207 kernel: [35512.597313] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 15:15:38 juju-e4d256-prod-github-runner-207 kernel: [35512.598272] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 15:15:38 juju-e4d256-prod-github-runner-207 kernel: [35512.599266] handle_exit+0x98/0x230 [kvm_amd] Aug 22 15:15:38 juju-e4d256-prod-github-runner-207 kernel: [35512.600167] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 15:15:38 juju-e4d256-prod-github-runner-207 kernel: [35512.601157] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 15:15:38 juju-e4d256-prod-github-runner-207 kernel: [35512.602102] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 15:15:38 juju-e4d256-prod-github-runner-207 kernel: [35512.603020] vcpu_run+0x62/0x2c0 [kvm] Aug 22 15:15:38 juju-e4d256-prod-github-runner-207 kernel: [35512.603843] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 15:15:38 juju-e4d256-prod-github-runner-207 kernel: [35512.604664] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 15:15:38 juju-e4d256-prod-github-runner-207 kernel: [35512.605554] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 15:15:38 juju-e4d256-prod-github-runner-207 kernel: [35512.606364] ? __seccomp_filter+0x4a/0x4a0 Aug 22 15:15:38 juju-e4d256-prod-github-runner-207 kernel: [35512.607117] ? __fget_files+0x86/0xc0 Aug 22 15:15:38 juju-e4d256-prod-github-runner-207 kernel: [35512.607829] __x64_sys_ioctl+0x95/0xd0 Aug 22 15:15:38 juju-e4d256-prod-github-runner-207 kernel: [35512.608547] do_syscall_64+0x5c/0xc0 Aug 22 15:15:38 juju-e4d256-prod-github-runner-207 kernel: [35512.609245] ? do_futex+0x162/0x1f0 Aug 22 15:15:38 juju-e4d256-prod-github-runner-207 kernel: [35512.609910] ? __x64_sys_futex+0x78/0x1e0 Aug 22 15:15:38 juju-e4d256-prod-github-runner-207 kernel: [35512.610597] ? __secure_computing+0xa9/0x120 Aug 22 15:15:38 juju-e4d256-prod-github-runner-207 kernel: [35512.611299] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 15:15:38 juju-e4d256-prod-github-runner-207 kernel: [35512.612088] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:15:38 juju-e4d256-prod-github-runner-207 kernel: [35512.612847] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:15:38 juju-e4d256-prod-github-runner-207 kernel: [35512.613579] ? do_syscall_64+0x69/0xc0 Aug 22 15:15:38 juju-e4d256-prod-github-runner-207 kernel: [35512.614234] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:15:38 juju-e4d256-prod-github-runner-207 kernel: [35512.614955] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:15:38 juju-e4d256-prod-github-runner-207 kernel: [35512.615665] ? do_syscall_64+0x69/0xc0 Aug 22 15:15:38 juju-e4d256-prod-github-runner-207 kernel: [35512.616301] ? do_syscall_64+0x69/0xc0 Aug 22 15:15:38 juju-e4d256-prod-github-runner-207 kernel: [35512.616998] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 15:15:38 juju-e4d256-prod-github-runner-207 kernel: [35512.617721] RIP: 0033:0x7faa5d0edaff Aug 22 15:15:38 juju-e4d256-prod-github-runner-207 kernel: [35512.618361] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 15:15:38 juju-e4d256-prod-github-runner-207 kernel: [35512.620402] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 15:15:38 juju-e4d256-prod-github-runner-207 kernel: [35512.621348] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 15:15:38 juju-e4d256-prod-github-runner-207 kernel: [35512.622256] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 15:15:38 juju-e4d256-prod-github-runner-207 kernel: [35512.623173] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 15:15:38 juju-e4d256-prod-github-runner-207 kernel: [35512.624078] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 15:15:38 juju-e4d256-prod-github-runner-207 kernel: [35512.625001] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 15:15:38 juju-e4d256-prod-github-runner-207 kernel: [35512.625916] Aug 22 15:16:06 juju-e4d256-prod-github-runner-207 kernel: [35540.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 32991s! [qemu-system-x86:6715] Aug 22 15:16:06 juju-e4d256-prod-github-runner-207 kernel: [35540.543906] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 15:16:06 juju-e4d256-prod-github-runner-207 kernel: [35540.544215] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 15:16:06 juju-e4d256-prod-github-runner-207 kernel: [35540.556846] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 15:16:06 juju-e4d256-prod-github-runner-207 kernel: [35540.558153] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 15:16:06 juju-e4d256-prod-github-runner-207 kernel: [35540.559391] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:16:06 juju-e4d256-prod-github-runner-207 kernel: [35540.560482] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 15:16:06 juju-e4d256-prod-github-runner-207 kernel: [35540.563144] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 15:16:06 juju-e4d256-prod-github-runner-207 kernel: [35540.564208] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 15:16:06 juju-e4d256-prod-github-runner-207 kernel: [35540.565415] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 15:16:06 juju-e4d256-prod-github-runner-207 kernel: [35540.566618] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 15:16:06 juju-e4d256-prod-github-runner-207 kernel: [35540.567842] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 15:16:06 juju-e4d256-prod-github-runner-207 kernel: [35540.569051] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 15:16:06 juju-e4d256-prod-github-runner-207 kernel: [35540.570243] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 15:16:06 juju-e4d256-prod-github-runner-207 kernel: [35540.571517] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 15:16:06 juju-e4d256-prod-github-runner-207 kernel: [35540.572679] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 15:16:06 juju-e4d256-prod-github-runner-207 kernel: [35540.573935] Call Trace: Aug 22 15:16:06 juju-e4d256-prod-github-runner-207 kernel: [35540.574892] Aug 22 15:16:06 juju-e4d256-prod-github-runner-207 kernel: [35540.575841] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:16:06 juju-e4d256-prod-github-runner-207 kernel: [35540.576934] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:16:06 juju-e4d256-prod-github-runner-207 kernel: [35540.577988] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:16:06 juju-e4d256-prod-github-runner-207 kernel: [35540.579110] ? show_regs.part.0+0x23/0x29 Aug 22 15:16:06 juju-e4d256-prod-github-runner-207 kernel: [35540.580147] ? show_regs.cold+0x8/0xd Aug 22 15:16:06 juju-e4d256-prod-github-runner-207 kernel: [35540.581182] ? watchdog_timer_fn+0x1be/0x220 Aug 22 15:16:06 juju-e4d256-prod-github-runner-207 kernel: [35540.582223] ? lockup_detector_update_enable+0x60/0x60 Aug 22 15:16:06 juju-e4d256-prod-github-runner-207 kernel: [35540.583347] ? __hrtimer_run_queues+0x107/0x230 Aug 22 15:16:06 juju-e4d256-prod-github-runner-207 kernel: [35540.584426] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 15:16:06 juju-e4d256-prod-github-runner-207 kernel: [35540.585465] ? hrtimer_interrupt+0x101/0x220 Aug 22 15:16:06 juju-e4d256-prod-github-runner-207 kernel: [35540.586496] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 15:16:06 juju-e4d256-prod-github-runner-207 kernel: [35540.587648] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 15:16:06 juju-e4d256-prod-github-runner-207 kernel: [35540.588734] Aug 22 15:16:06 juju-e4d256-prod-github-runner-207 kernel: [35540.589598] Aug 22 15:16:06 juju-e4d256-prod-github-runner-207 kernel: [35540.590451] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 15:16:06 juju-e4d256-prod-github-runner-207 kernel: [35540.591509] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:16:06 juju-e4d256-prod-github-runner-207 kernel: [35540.592594] ? _raw_spin_lock+0x22/0x30 Aug 22 15:16:06 juju-e4d256-prod-github-runner-207 kernel: [35540.593584] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:16:06 juju-e4d256-prod-github-runner-207 kernel: [35540.594664] direct_page_fault+0x206/0x310 [kvm] Aug 22 15:16:06 juju-e4d256-prod-github-runner-207 kernel: [35540.595778] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 15:16:06 juju-e4d256-prod-github-runner-207 kernel: [35540.596845] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 15:16:06 juju-e4d256-prod-github-runner-207 kernel: [35540.597894] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 15:16:06 juju-e4d256-prod-github-runner-207 kernel: [35540.598947] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 15:16:06 juju-e4d256-prod-github-runner-207 kernel: [35540.599911] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 15:16:06 juju-e4d256-prod-github-runner-207 kernel: [35540.600926] handle_exit+0x98/0x230 [kvm_amd] Aug 22 15:16:06 juju-e4d256-prod-github-runner-207 kernel: [35540.601847] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 15:16:06 juju-e4d256-prod-github-runner-207 kernel: [35540.602791] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 15:16:06 juju-e4d256-prod-github-runner-207 kernel: [35540.603768] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 15:16:06 juju-e4d256-prod-github-runner-207 kernel: [35540.604800] vcpu_run+0x62/0x2c0 [kvm] Aug 22 15:16:06 juju-e4d256-prod-github-runner-207 kernel: [35540.605659] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 15:16:06 juju-e4d256-prod-github-runner-207 kernel: [35540.606498] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 15:16:06 juju-e4d256-prod-github-runner-207 kernel: [35540.607373] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 15:16:06 juju-e4d256-prod-github-runner-207 kernel: [35540.608212] ? __seccomp_filter+0x4a/0x4a0 Aug 22 15:16:06 juju-e4d256-prod-github-runner-207 kernel: [35540.609018] ? __fget_files+0x86/0xc0 Aug 22 15:16:06 juju-e4d256-prod-github-runner-207 kernel: [35540.609770] __x64_sys_ioctl+0x95/0xd0 Aug 22 15:16:06 juju-e4d256-prod-github-runner-207 kernel: [35540.610475] do_syscall_64+0x5c/0xc0 Aug 22 15:16:06 juju-e4d256-prod-github-runner-207 kernel: [35540.611178] ? do_futex+0x162/0x1f0 Aug 22 15:16:06 juju-e4d256-prod-github-runner-207 kernel: [35540.611860] ? __x64_sys_futex+0x78/0x1e0 Aug 22 15:16:06 juju-e4d256-prod-github-runner-207 kernel: [35540.612569] ? __secure_computing+0xa9/0x120 Aug 22 15:16:06 juju-e4d256-prod-github-runner-207 kernel: [35540.613305] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 15:16:06 juju-e4d256-prod-github-runner-207 kernel: [35540.614114] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:16:06 juju-e4d256-prod-github-runner-207 kernel: [35540.614861] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:16:06 juju-e4d256-prod-github-runner-207 kernel: [35540.615599] ? do_syscall_64+0x69/0xc0 Aug 22 15:16:06 juju-e4d256-prod-github-runner-207 kernel: [35540.616265] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:16:06 juju-e4d256-prod-github-runner-207 kernel: [35540.617017] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:16:06 juju-e4d256-prod-github-runner-207 kernel: [35540.617742] ? do_syscall_64+0x69/0xc0 Aug 22 15:16:06 juju-e4d256-prod-github-runner-207 kernel: [35540.618402] ? do_syscall_64+0x69/0xc0 Aug 22 15:16:06 juju-e4d256-prod-github-runner-207 kernel: [35540.619053] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 15:16:06 juju-e4d256-prod-github-runner-207 kernel: [35540.619783] RIP: 0033:0x7faa5d0edaff Aug 22 15:16:06 juju-e4d256-prod-github-runner-207 kernel: [35540.620490] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 15:16:06 juju-e4d256-prod-github-runner-207 kernel: [35540.622549] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 15:16:06 juju-e4d256-prod-github-runner-207 kernel: [35540.623504] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 15:16:06 juju-e4d256-prod-github-runner-207 kernel: [35540.624480] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 15:16:06 juju-e4d256-prod-github-runner-207 kernel: [35540.625427] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 15:16:06 juju-e4d256-prod-github-runner-207 kernel: [35540.626429] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 15:16:06 juju-e4d256-prod-github-runner-207 kernel: [35540.627356] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 15:16:06 juju-e4d256-prod-github-runner-207 kernel: [35540.628303] Aug 22 15:16:34 juju-e4d256-prod-github-runner-207 kernel: [35568.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 33017s! [qemu-system-x86:6715] Aug 22 15:16:34 juju-e4d256-prod-github-runner-207 kernel: [35568.543154] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 15:16:34 juju-e4d256-prod-github-runner-207 kernel: [35568.543232] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 15:16:34 juju-e4d256-prod-github-runner-207 kernel: [35568.555605] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 15:16:34 juju-e4d256-prod-github-runner-207 kernel: [35568.556875] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 15:16:34 juju-e4d256-prod-github-runner-207 kernel: [35568.558104] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:16:34 juju-e4d256-prod-github-runner-207 kernel: [35568.559163] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 15:16:34 juju-e4d256-prod-github-runner-207 kernel: [35568.561730] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 15:16:34 juju-e4d256-prod-github-runner-207 kernel: [35568.562771] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 15:16:34 juju-e4d256-prod-github-runner-207 kernel: [35568.563936] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 15:16:34 juju-e4d256-prod-github-runner-207 kernel: [35568.565183] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 15:16:34 juju-e4d256-prod-github-runner-207 kernel: [35568.566377] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 15:16:34 juju-e4d256-prod-github-runner-207 kernel: [35568.567558] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 15:16:34 juju-e4d256-prod-github-runner-207 kernel: [35568.568862] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 15:16:34 juju-e4d256-prod-github-runner-207 kernel: [35568.570148] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 15:16:34 juju-e4d256-prod-github-runner-207 kernel: [35568.571252] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 15:16:34 juju-e4d256-prod-github-runner-207 kernel: [35568.572496] Call Trace: Aug 22 15:16:34 juju-e4d256-prod-github-runner-207 kernel: [35568.573439] Aug 22 15:16:34 juju-e4d256-prod-github-runner-207 kernel: [35568.574349] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:16:34 juju-e4d256-prod-github-runner-207 kernel: [35568.575450] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:16:34 juju-e4d256-prod-github-runner-207 kernel: [35568.576496] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:16:34 juju-e4d256-prod-github-runner-207 kernel: [35568.577575] ? show_regs.part.0+0x23/0x29 Aug 22 15:16:34 juju-e4d256-prod-github-runner-207 kernel: [35568.578573] ? show_regs.cold+0x8/0xd Aug 22 15:16:34 juju-e4d256-prod-github-runner-207 kernel: [35568.579555] ? watchdog_timer_fn+0x1be/0x220 Aug 22 15:16:34 juju-e4d256-prod-github-runner-207 kernel: [35568.580592] ? lockup_detector_update_enable+0x60/0x60 Aug 22 15:16:34 juju-e4d256-prod-github-runner-207 kernel: [35568.581660] ? __hrtimer_run_queues+0x107/0x230 Aug 22 15:16:34 juju-e4d256-prod-github-runner-207 kernel: [35568.582689] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 15:16:34 juju-e4d256-prod-github-runner-207 kernel: [35568.583716] ? hrtimer_interrupt+0x101/0x220 Aug 22 15:16:34 juju-e4d256-prod-github-runner-207 kernel: [35568.584743] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 15:16:34 juju-e4d256-prod-github-runner-207 kernel: [35568.585815] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 15:16:34 juju-e4d256-prod-github-runner-207 kernel: [35568.586864] Aug 22 15:16:34 juju-e4d256-prod-github-runner-207 kernel: [35568.587719] Aug 22 15:16:34 juju-e4d256-prod-github-runner-207 kernel: [35568.588574] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 15:16:34 juju-e4d256-prod-github-runner-207 kernel: [35568.589616] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:16:34 juju-e4d256-prod-github-runner-207 kernel: [35568.590656] ? _raw_spin_lock+0x22/0x30 Aug 22 15:16:34 juju-e4d256-prod-github-runner-207 kernel: [35568.591610] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:16:34 juju-e4d256-prod-github-runner-207 kernel: [35568.592645] direct_page_fault+0x206/0x310 [kvm] Aug 22 15:16:34 juju-e4d256-prod-github-runner-207 kernel: [35568.593674] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 15:16:34 juju-e4d256-prod-github-runner-207 kernel: [35568.594690] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 15:16:34 juju-e4d256-prod-github-runner-207 kernel: [35568.595694] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 15:16:34 juju-e4d256-prod-github-runner-207 kernel: [35568.596675] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 15:16:34 juju-e4d256-prod-github-runner-207 kernel: [35568.597638] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 15:16:34 juju-e4d256-prod-github-runner-207 kernel: [35568.598626] handle_exit+0x98/0x230 [kvm_amd] Aug 22 15:16:34 juju-e4d256-prod-github-runner-207 kernel: [35568.599525] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 15:16:34 juju-e4d256-prod-github-runner-207 kernel: [35568.600480] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 15:16:34 juju-e4d256-prod-github-runner-207 kernel: [35568.601410] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 15:16:34 juju-e4d256-prod-github-runner-207 kernel: [35568.602311] vcpu_run+0x62/0x2c0 [kvm] Aug 22 15:16:34 juju-e4d256-prod-github-runner-207 kernel: [35568.603126] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 15:16:34 juju-e4d256-prod-github-runner-207 kernel: [35568.603932] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 15:16:34 juju-e4d256-prod-github-runner-207 kernel: [35568.604814] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 15:16:34 juju-e4d256-prod-github-runner-207 kernel: [35568.605616] ? __seccomp_filter+0x4a/0x4a0 Aug 22 15:16:34 juju-e4d256-prod-github-runner-207 kernel: [35568.606358] ? __fget_files+0x86/0xc0 Aug 22 15:16:34 juju-e4d256-prod-github-runner-207 kernel: [35568.607065] __x64_sys_ioctl+0x95/0xd0 Aug 22 15:16:34 juju-e4d256-prod-github-runner-207 kernel: [35568.607765] do_syscall_64+0x5c/0xc0 Aug 22 15:16:34 juju-e4d256-prod-github-runner-207 kernel: [35568.608449] ? do_futex+0x162/0x1f0 Aug 22 15:16:34 juju-e4d256-prod-github-runner-207 kernel: [35568.609097] ? __x64_sys_futex+0x78/0x1e0 Aug 22 15:16:34 juju-e4d256-prod-github-runner-207 kernel: [35568.609767] ? __secure_computing+0xa9/0x120 Aug 22 15:16:34 juju-e4d256-prod-github-runner-207 kernel: [35568.610458] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 15:16:34 juju-e4d256-prod-github-runner-207 kernel: [35568.611219] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:16:34 juju-e4d256-prod-github-runner-207 kernel: [35568.611937] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:16:34 juju-e4d256-prod-github-runner-207 kernel: [35568.612683] ? do_syscall_64+0x69/0xc0 Aug 22 15:16:34 juju-e4d256-prod-github-runner-207 kernel: [35568.613425] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:16:34 juju-e4d256-prod-github-runner-207 kernel: [35568.614129] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:16:34 juju-e4d256-prod-github-runner-207 kernel: [35568.614824] ? do_syscall_64+0x69/0xc0 Aug 22 15:16:34 juju-e4d256-prod-github-runner-207 kernel: [35568.615449] ? do_syscall_64+0x69/0xc0 Aug 22 15:16:34 juju-e4d256-prod-github-runner-207 kernel: [35568.616113] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 15:16:34 juju-e4d256-prod-github-runner-207 kernel: [35568.616820] RIP: 0033:0x7faa5d0edaff Aug 22 15:16:34 juju-e4d256-prod-github-runner-207 kernel: [35568.617470] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 15:16:34 juju-e4d256-prod-github-runner-207 kernel: [35568.619457] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 15:16:34 juju-e4d256-prod-github-runner-207 kernel: [35568.620392] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 15:16:34 juju-e4d256-prod-github-runner-207 kernel: [35568.621286] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 15:16:34 juju-e4d256-prod-github-runner-207 kernel: [35568.622184] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 15:16:34 juju-e4d256-prod-github-runner-207 kernel: [35568.623081] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 15:16:34 juju-e4d256-prod-github-runner-207 kernel: [35568.623972] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 15:16:34 juju-e4d256-prod-github-runner-207 kernel: [35568.624890] Aug 22 15:17:02 juju-e4d256-prod-github-runner-207 kernel: [35596.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 33043s! [qemu-system-x86:6715] Aug 22 15:17:02 juju-e4d256-prod-github-runner-207 kernel: [35596.543108] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 15:17:02 juju-e4d256-prod-github-runner-207 kernel: [35596.543183] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 15:17:02 juju-e4d256-prod-github-runner-207 kernel: [35596.555561] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 15:17:02 juju-e4d256-prod-github-runner-207 kernel: [35596.556874] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 15:17:02 juju-e4d256-prod-github-runner-207 kernel: [35596.558122] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:17:02 juju-e4d256-prod-github-runner-207 kernel: [35596.559199] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 15:17:02 juju-e4d256-prod-github-runner-207 kernel: [35596.561984] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 15:17:02 juju-e4d256-prod-github-runner-207 kernel: [35596.563038] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 15:17:02 juju-e4d256-prod-github-runner-207 kernel: [35596.564231] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 15:17:02 juju-e4d256-prod-github-runner-207 kernel: [35596.565416] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 15:17:02 juju-e4d256-prod-github-runner-207 kernel: [35596.566611] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 15:17:02 juju-e4d256-prod-github-runner-207 kernel: [35596.567804] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 15:17:02 juju-e4d256-prod-github-runner-207 kernel: [35596.568991] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 15:17:02 juju-e4d256-prod-github-runner-207 kernel: [35596.570252] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 15:17:02 juju-e4d256-prod-github-runner-207 kernel: [35596.571368] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 15:17:02 juju-e4d256-prod-github-runner-207 kernel: [35596.572589] Call Trace: Aug 22 15:17:02 juju-e4d256-prod-github-runner-207 kernel: [35596.573507] Aug 22 15:17:02 juju-e4d256-prod-github-runner-207 kernel: [35596.574401] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:17:02 juju-e4d256-prod-github-runner-207 kernel: [35596.575490] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:17:02 juju-e4d256-prod-github-runner-207 kernel: [35596.576550] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:17:02 juju-e4d256-prod-github-runner-207 kernel: [35596.577639] ? show_regs.part.0+0x23/0x29 Aug 22 15:17:02 juju-e4d256-prod-github-runner-207 kernel: [35596.578646] ? show_regs.cold+0x8/0xd Aug 22 15:17:02 juju-e4d256-prod-github-runner-207 kernel: [35596.579625] ? watchdog_timer_fn+0x1be/0x220 Aug 22 15:17:02 juju-e4d256-prod-github-runner-207 kernel: [35596.580656] ? lockup_detector_update_enable+0x60/0x60 Aug 22 15:17:02 juju-e4d256-prod-github-runner-207 kernel: [35596.581734] ? __hrtimer_run_queues+0x107/0x230 Aug 22 15:17:02 juju-e4d256-prod-github-runner-207 kernel: [35596.582773] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 15:17:02 juju-e4d256-prod-github-runner-207 kernel: [35596.583817] ? hrtimer_interrupt+0x101/0x220 Aug 22 15:17:02 juju-e4d256-prod-github-runner-207 kernel: [35596.584851] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 15:17:02 juju-e4d256-prod-github-runner-207 kernel: [35596.585939] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 15:17:02 juju-e4d256-prod-github-runner-207 kernel: [35596.587012] Aug 22 15:17:02 juju-e4d256-prod-github-runner-207 kernel: [35596.587886] Aug 22 15:17:02 juju-e4d256-prod-github-runner-207 kernel: [35596.588741] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 15:17:02 juju-e4d256-prod-github-runner-207 kernel: [35596.589799] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:17:02 juju-e4d256-prod-github-runner-207 kernel: [35596.590855] ? _raw_spin_lock+0x22/0x30 Aug 22 15:17:02 juju-e4d256-prod-github-runner-207 kernel: [35596.591821] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:17:02 juju-e4d256-prod-github-runner-207 kernel: [35596.592853] direct_page_fault+0x206/0x310 [kvm] Aug 22 15:17:02 juju-e4d256-prod-github-runner-207 kernel: [35596.593894] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 15:17:02 juju-e4d256-prod-github-runner-207 kernel: [35596.594930] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 15:17:02 juju-e4d256-prod-github-runner-207 kernel: [35596.595958] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 15:17:02 juju-e4d256-prod-github-runner-207 kernel: [35596.596951] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 15:17:02 juju-e4d256-prod-github-runner-207 kernel: [35596.597911] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 15:17:02 juju-e4d256-prod-github-runner-207 kernel: [35596.598945] handle_exit+0x98/0x230 [kvm_amd] Aug 22 15:17:02 juju-e4d256-prod-github-runner-207 kernel: [35596.599896] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 15:17:02 juju-e4d256-prod-github-runner-207 kernel: [35596.600828] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 15:17:02 juju-e4d256-prod-github-runner-207 kernel: [35596.601771] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 15:17:02 juju-e4d256-prod-github-runner-207 kernel: [35596.602686] vcpu_run+0x62/0x2c0 [kvm] Aug 22 15:17:02 juju-e4d256-prod-github-runner-207 kernel: [35596.603505] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 15:17:02 juju-e4d256-prod-github-runner-207 kernel: [35596.604336] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 15:17:02 juju-e4d256-prod-github-runner-207 kernel: [35596.605202] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 15:17:02 juju-e4d256-prod-github-runner-207 kernel: [35596.606005] ? __seccomp_filter+0x4a/0x4a0 Aug 22 15:17:02 juju-e4d256-prod-github-runner-207 kernel: [35596.606771] ? __fget_files+0x86/0xc0 Aug 22 15:17:02 juju-e4d256-prod-github-runner-207 kernel: [35596.607528] __x64_sys_ioctl+0x95/0xd0 Aug 22 15:17:02 juju-e4d256-prod-github-runner-207 kernel: [35596.608262] do_syscall_64+0x5c/0xc0 Aug 22 15:17:02 juju-e4d256-prod-github-runner-207 kernel: [35596.609000] ? do_futex+0x162/0x1f0 Aug 22 15:17:02 juju-e4d256-prod-github-runner-207 kernel: [35596.609695] ? __x64_sys_futex+0x78/0x1e0 Aug 22 15:17:02 juju-e4d256-prod-github-runner-207 kernel: [35596.610388] ? __secure_computing+0xa9/0x120 Aug 22 15:17:02 juju-e4d256-prod-github-runner-207 kernel: [35596.611080] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 15:17:02 juju-e4d256-prod-github-runner-207 kernel: [35596.611857] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:17:02 juju-e4d256-prod-github-runner-207 kernel: [35596.612582] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:17:02 juju-e4d256-prod-github-runner-207 kernel: [35596.613300] ? do_syscall_64+0x69/0xc0 Aug 22 15:17:02 juju-e4d256-prod-github-runner-207 kernel: [35596.613945] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:17:02 juju-e4d256-prod-github-runner-207 kernel: [35596.614653] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:17:02 juju-e4d256-prod-github-runner-207 kernel: [35596.615357] ? do_syscall_64+0x69/0xc0 Aug 22 15:17:02 juju-e4d256-prod-github-runner-207 kernel: [35596.616035] ? do_syscall_64+0x69/0xc0 Aug 22 15:17:02 juju-e4d256-prod-github-runner-207 kernel: [35596.616660] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 15:17:02 juju-e4d256-prod-github-runner-207 kernel: [35596.617371] RIP: 0033:0x7faa5d0edaff Aug 22 15:17:02 juju-e4d256-prod-github-runner-207 kernel: [35596.617996] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 15:17:02 juju-e4d256-prod-github-runner-207 kernel: [35596.620014] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 15:17:02 juju-e4d256-prod-github-runner-207 kernel: [35596.620925] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 15:17:02 juju-e4d256-prod-github-runner-207 kernel: [35596.621813] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 15:17:02 juju-e4d256-prod-github-runner-207 kernel: [35596.622702] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 15:17:02 juju-e4d256-prod-github-runner-207 kernel: [35596.623588] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 15:17:02 juju-e4d256-prod-github-runner-207 kernel: [35596.624485] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 15:17:02 juju-e4d256-prod-github-runner-207 kernel: [35596.625381] Aug 22 15:17:30 juju-e4d256-prod-github-runner-207 kernel: [35624.541981] watchdog: BUG: soft lockup - CPU#1 stuck for 33069s! [qemu-system-x86:6715] Aug 22 15:17:30 juju-e4d256-prod-github-runner-207 kernel: [35624.543184] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 15:17:30 juju-e4d256-prod-github-runner-207 kernel: [35624.543459] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 15:17:30 juju-e4d256-prod-github-runner-207 kernel: [35624.555765] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 15:17:30 juju-e4d256-prod-github-runner-207 kernel: [35624.557053] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 15:17:30 juju-e4d256-prod-github-runner-207 kernel: [35624.558282] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:17:30 juju-e4d256-prod-github-runner-207 kernel: [35624.559360] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 15:17:30 juju-e4d256-prod-github-runner-207 kernel: [35624.561925] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 15:17:30 juju-e4d256-prod-github-runner-207 kernel: [35624.562991] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 15:17:30 juju-e4d256-prod-github-runner-207 kernel: [35624.564164] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 15:17:30 juju-e4d256-prod-github-runner-207 kernel: [35624.565329] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 15:17:30 juju-e4d256-prod-github-runner-207 kernel: [35624.566489] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 15:17:30 juju-e4d256-prod-github-runner-207 kernel: [35624.567666] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 15:17:30 juju-e4d256-prod-github-runner-207 kernel: [35624.568833] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 15:17:30 juju-e4d256-prod-github-runner-207 kernel: [35624.570066] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 15:17:30 juju-e4d256-prod-github-runner-207 kernel: [35624.571207] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 15:17:30 juju-e4d256-prod-github-runner-207 kernel: [35624.572429] Call Trace: Aug 22 15:17:30 juju-e4d256-prod-github-runner-207 kernel: [35624.573341] Aug 22 15:17:30 juju-e4d256-prod-github-runner-207 kernel: [35624.574243] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:17:30 juju-e4d256-prod-github-runner-207 kernel: [35624.575279] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:17:30 juju-e4d256-prod-github-runner-207 kernel: [35624.576310] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:17:30 juju-e4d256-prod-github-runner-207 kernel: [35624.577406] ? show_regs.part.0+0x23/0x29 Aug 22 15:17:30 juju-e4d256-prod-github-runner-207 kernel: [35624.578406] ? show_regs.cold+0x8/0xd Aug 22 15:17:30 juju-e4d256-prod-github-runner-207 kernel: [35624.579416] ? watchdog_timer_fn+0x1be/0x220 Aug 22 15:17:30 juju-e4d256-prod-github-runner-207 kernel: [35624.580439] ? lockup_detector_update_enable+0x60/0x60 Aug 22 15:17:30 juju-e4d256-prod-github-runner-207 kernel: [35624.581507] ? __hrtimer_run_queues+0x107/0x230 Aug 22 15:17:30 juju-e4d256-prod-github-runner-207 kernel: [35624.582532] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 15:17:30 juju-e4d256-prod-github-runner-207 kernel: [35624.583562] ? hrtimer_interrupt+0x101/0x220 Aug 22 15:17:30 juju-e4d256-prod-github-runner-207 kernel: [35624.584574] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 15:17:30 juju-e4d256-prod-github-runner-207 kernel: [35624.585656] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 15:17:30 juju-e4d256-prod-github-runner-207 kernel: [35624.586704] Aug 22 15:17:30 juju-e4d256-prod-github-runner-207 kernel: [35624.587562] Aug 22 15:17:30 juju-e4d256-prod-github-runner-207 kernel: [35624.588399] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 15:17:30 juju-e4d256-prod-github-runner-207 kernel: [35624.589430] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:17:30 juju-e4d256-prod-github-runner-207 kernel: [35624.590466] ? _raw_spin_lock+0x22/0x30 Aug 22 15:17:30 juju-e4d256-prod-github-runner-207 kernel: [35624.591432] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:17:30 juju-e4d256-prod-github-runner-207 kernel: [35624.592450] direct_page_fault+0x206/0x310 [kvm] Aug 22 15:17:30 juju-e4d256-prod-github-runner-207 kernel: [35624.593473] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 15:17:30 juju-e4d256-prod-github-runner-207 kernel: [35624.594485] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 15:17:30 juju-e4d256-prod-github-runner-207 kernel: [35624.595598] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 15:17:30 juju-e4d256-prod-github-runner-207 kernel: [35624.596606] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 15:17:30 juju-e4d256-prod-github-runner-207 kernel: [35624.597558] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 15:17:30 juju-e4d256-prod-github-runner-207 kernel: [35624.598535] handle_exit+0x98/0x230 [kvm_amd] Aug 22 15:17:30 juju-e4d256-prod-github-runner-207 kernel: [35624.599436] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 15:17:30 juju-e4d256-prod-github-runner-207 kernel: [35624.600355] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 15:17:30 juju-e4d256-prod-github-runner-207 kernel: [35624.601332] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 15:17:30 juju-e4d256-prod-github-runner-207 kernel: [35624.602256] vcpu_run+0x62/0x2c0 [kvm] Aug 22 15:17:30 juju-e4d256-prod-github-runner-207 kernel: [35624.603072] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 15:17:30 juju-e4d256-prod-github-runner-207 kernel: [35624.603897] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 15:17:30 juju-e4d256-prod-github-runner-207 kernel: [35624.604758] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 15:17:30 juju-e4d256-prod-github-runner-207 kernel: [35624.605561] ? __seccomp_filter+0x4a/0x4a0 Aug 22 15:17:30 juju-e4d256-prod-github-runner-207 kernel: [35624.606308] ? __fget_files+0x86/0xc0 Aug 22 15:17:30 juju-e4d256-prod-github-runner-207 kernel: [35624.607017] __x64_sys_ioctl+0x95/0xd0 Aug 22 15:17:30 juju-e4d256-prod-github-runner-207 kernel: [35624.607727] do_syscall_64+0x5c/0xc0 Aug 22 15:17:30 juju-e4d256-prod-github-runner-207 kernel: [35624.608396] ? do_futex+0x162/0x1f0 Aug 22 15:17:30 juju-e4d256-prod-github-runner-207 kernel: [35624.609048] ? __x64_sys_futex+0x78/0x1e0 Aug 22 15:17:30 juju-e4d256-prod-github-runner-207 kernel: [35624.609725] ? __secure_computing+0xa9/0x120 Aug 22 15:17:30 juju-e4d256-prod-github-runner-207 kernel: [35624.610416] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 15:17:30 juju-e4d256-prod-github-runner-207 kernel: [35624.611177] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:17:30 juju-e4d256-prod-github-runner-207 kernel: [35624.611919] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:17:30 juju-e4d256-prod-github-runner-207 kernel: [35624.612644] ? do_syscall_64+0x69/0xc0 Aug 22 15:17:30 juju-e4d256-prod-github-runner-207 kernel: [35624.613290] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:17:30 juju-e4d256-prod-github-runner-207 kernel: [35624.613994] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:17:30 juju-e4d256-prod-github-runner-207 kernel: [35624.614689] ? do_syscall_64+0x69/0xc0 Aug 22 15:17:30 juju-e4d256-prod-github-runner-207 kernel: [35624.615313] ? do_syscall_64+0x69/0xc0 Aug 22 15:17:30 juju-e4d256-prod-github-runner-207 kernel: [35624.615956] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 15:17:30 juju-e4d256-prod-github-runner-207 kernel: [35624.616663] RIP: 0033:0x7faa5d0edaff Aug 22 15:17:30 juju-e4d256-prod-github-runner-207 kernel: [35624.617328] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 15:17:30 juju-e4d256-prod-github-runner-207 kernel: [35624.619367] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 15:17:30 juju-e4d256-prod-github-runner-207 kernel: [35624.620326] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 15:17:30 juju-e4d256-prod-github-runner-207 kernel: [35624.621221] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 15:17:30 juju-e4d256-prod-github-runner-207 kernel: [35624.622141] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 15:17:30 juju-e4d256-prod-github-runner-207 kernel: [35624.623028] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 15:17:30 juju-e4d256-prod-github-runner-207 kernel: [35624.623958] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 15:17:30 juju-e4d256-prod-github-runner-207 kernel: [35624.624860] Aug 22 15:17:45 juju-e4d256-prod-github-runner-207 kernel: [35639.564705] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 15:17:45 juju-e4d256-prod-github-runner-207 kernel: [35639.566452] rcu: 1-....: (8852797 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=4277062 Aug 22 15:17:45 juju-e4d256-prod-github-runner-207 kernel: [35639.567592] (t=8880591 jiffies g=23269 q=37653) Aug 22 15:17:45 juju-e4d256-prod-github-runner-207 kernel: [35639.568381] NMI backtrace for cpu 1 Aug 22 15:17:45 juju-e4d256-prod-github-runner-207 kernel: [35639.569091] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 15:17:45 juju-e4d256-prod-github-runner-207 kernel: [35639.570189] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 15:17:45 juju-e4d256-prod-github-runner-207 kernel: [35639.571256] Call Trace: Aug 22 15:17:45 juju-e4d256-prod-github-runner-207 kernel: [35639.571929] Aug 22 15:17:45 juju-e4d256-prod-github-runner-207 kernel: [35639.572572] show_stack+0x52/0x5c Aug 22 15:17:45 juju-e4d256-prod-github-runner-207 kernel: [35639.573294] dump_stack_lvl+0x4a/0x63 Aug 22 15:17:45 juju-e4d256-prod-github-runner-207 kernel: [35639.574043] dump_stack+0x10/0x16 Aug 22 15:17:45 juju-e4d256-prod-github-runner-207 kernel: [35639.574760] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 15:17:45 juju-e4d256-prod-github-runner-207 kernel: [35639.575545] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 15:17:45 juju-e4d256-prod-github-runner-207 kernel: [35639.576323] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 15:17:45 juju-e4d256-prod-github-runner-207 kernel: [35639.577140] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 15:17:45 juju-e4d256-prod-github-runner-207 kernel: [35639.577957] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 15:17:45 juju-e4d256-prod-github-runner-207 kernel: [35639.578765] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 15:17:45 juju-e4d256-prod-github-runner-207 kernel: [35639.579545] print_cpu_stall.cold+0x2f/0xe2 Aug 22 15:17:45 juju-e4d256-prod-github-runner-207 kernel: [35639.580324] ? timekeeping_update+0xf7/0x150 Aug 22 15:17:45 juju-e4d256-prod-github-runner-207 kernel: [35639.581095] check_cpu_stall+0x109/0x270 Aug 22 15:17:45 juju-e4d256-prod-github-runner-207 kernel: [35639.581867] rcu_sched_clock_irq+0x9a/0x250 Aug 22 15:17:45 juju-e4d256-prod-github-runner-207 kernel: [35639.582631] update_process_times+0x94/0xd0 Aug 22 15:17:45 juju-e4d256-prod-github-runner-207 kernel: [35639.583421] tick_sched_handle+0x29/0x70 Aug 22 15:17:45 juju-e4d256-prod-github-runner-207 kernel: [35639.584196] tick_sched_timer+0x8c/0xc0 Aug 22 15:17:45 juju-e4d256-prod-github-runner-207 kernel: [35639.584978] ? tick_nohz_handler+0xb0/0xb0 Aug 22 15:17:45 juju-e4d256-prod-github-runner-207 kernel: [35639.585747] __hrtimer_run_queues+0x107/0x230 Aug 22 15:17:45 juju-e4d256-prod-github-runner-207 kernel: [35639.586526] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 15:17:45 juju-e4d256-prod-github-runner-207 kernel: [35639.587319] hrtimer_interrupt+0x101/0x220 Aug 22 15:17:45 juju-e4d256-prod-github-runner-207 kernel: [35639.588077] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 15:17:45 juju-e4d256-prod-github-runner-207 kernel: [35639.588891] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 15:17:45 juju-e4d256-prod-github-runner-207 kernel: [35639.589688] Aug 22 15:17:45 juju-e4d256-prod-github-runner-207 kernel: [35639.590320] Aug 22 15:17:45 juju-e4d256-prod-github-runner-207 kernel: [35639.590945] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 15:17:45 juju-e4d256-prod-github-runner-207 kernel: [35639.591771] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:17:45 juju-e4d256-prod-github-runner-207 kernel: [35639.592647] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 15:17:45 juju-e4d256-prod-github-runner-207 kernel: [35639.594861] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 15:17:45 juju-e4d256-prod-github-runner-207 kernel: [35639.595748] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 15:17:45 juju-e4d256-prod-github-runner-207 kernel: [35639.596737] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 15:17:45 juju-e4d256-prod-github-runner-207 kernel: [35639.597706] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 15:17:45 juju-e4d256-prod-github-runner-207 kernel: [35639.598683] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 15:17:45 juju-e4d256-prod-github-runner-207 kernel: [35639.599660] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 15:17:45 juju-e4d256-prod-github-runner-207 kernel: [35639.600619] ? _raw_spin_lock+0x22/0x30 Aug 22 15:17:45 juju-e4d256-prod-github-runner-207 kernel: [35639.601375] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:17:45 juju-e4d256-prod-github-runner-207 kernel: [35639.602214] direct_page_fault+0x206/0x310 [kvm] Aug 22 15:17:45 juju-e4d256-prod-github-runner-207 kernel: [35639.603060] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 15:17:45 juju-e4d256-prod-github-runner-207 kernel: [35639.603901] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 15:17:45 juju-e4d256-prod-github-runner-207 kernel: [35639.604730] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 15:17:45 juju-e4d256-prod-github-runner-207 kernel: [35639.605548] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 15:17:45 juju-e4d256-prod-github-runner-207 kernel: [35639.606357] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 15:17:45 juju-e4d256-prod-github-runner-207 kernel: [35639.607185] handle_exit+0x98/0x230 [kvm_amd] Aug 22 15:17:45 juju-e4d256-prod-github-runner-207 kernel: [35639.607943] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 15:17:45 juju-e4d256-prod-github-runner-207 kernel: [35639.608730] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 15:17:45 juju-e4d256-prod-github-runner-207 kernel: [35639.609549] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 15:17:45 juju-e4d256-prod-github-runner-207 kernel: [35639.610338] vcpu_run+0x62/0x2c0 [kvm] Aug 22 15:17:45 juju-e4d256-prod-github-runner-207 kernel: [35639.611057] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 15:17:45 juju-e4d256-prod-github-runner-207 kernel: [35639.611805] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 15:17:45 juju-e4d256-prod-github-runner-207 kernel: [35639.612603] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 15:17:45 juju-e4d256-prod-github-runner-207 kernel: [35639.613394] ? __seccomp_filter+0x4a/0x4a0 Aug 22 15:17:45 juju-e4d256-prod-github-runner-207 kernel: [35639.614111] ? __fget_files+0x86/0xc0 Aug 22 15:17:45 juju-e4d256-prod-github-runner-207 kernel: [35639.614830] __x64_sys_ioctl+0x95/0xd0 Aug 22 15:17:45 juju-e4d256-prod-github-runner-207 kernel: [35639.615543] do_syscall_64+0x5c/0xc0 Aug 22 15:17:45 juju-e4d256-prod-github-runner-207 kernel: [35639.616224] ? do_futex+0x162/0x1f0 Aug 22 15:17:45 juju-e4d256-prod-github-runner-207 kernel: [35639.616894] ? __x64_sys_futex+0x78/0x1e0 Aug 22 15:17:45 juju-e4d256-prod-github-runner-207 kernel: [35639.617728] ? __secure_computing+0xa9/0x120 Aug 22 15:17:45 juju-e4d256-prod-github-runner-207 kernel: [35639.618443] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 15:17:45 juju-e4d256-prod-github-runner-207 kernel: [35639.619249] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:17:45 juju-e4d256-prod-github-runner-207 kernel: [35639.620008] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:17:45 juju-e4d256-prod-github-runner-207 kernel: [35639.620760] ? do_syscall_64+0x69/0xc0 Aug 22 15:17:45 juju-e4d256-prod-github-runner-207 kernel: [35639.621450] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:17:45 juju-e4d256-prod-github-runner-207 kernel: [35639.622208] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:17:45 juju-e4d256-prod-github-runner-207 kernel: [35639.622964] ? do_syscall_64+0x69/0xc0 Aug 22 15:17:45 juju-e4d256-prod-github-runner-207 kernel: [35639.623662] ? do_syscall_64+0x69/0xc0 Aug 22 15:17:45 juju-e4d256-prod-github-runner-207 kernel: [35639.624353] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 15:17:45 juju-e4d256-prod-github-runner-207 kernel: [35639.625125] RIP: 0033:0x7faa5d0edaff Aug 22 15:17:45 juju-e4d256-prod-github-runner-207 kernel: [35639.625826] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 15:17:45 juju-e4d256-prod-github-runner-207 kernel: [35639.627933] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 15:17:45 juju-e4d256-prod-github-runner-207 kernel: [35639.628899] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 15:17:45 juju-e4d256-prod-github-runner-207 kernel: [35639.629842] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 15:17:45 juju-e4d256-prod-github-runner-207 kernel: [35639.630784] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 15:17:45 juju-e4d256-prod-github-runner-207 kernel: [35639.631742] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 15:17:45 juju-e4d256-prod-github-runner-207 kernel: [35639.632664] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 15:17:45 juju-e4d256-prod-github-runner-207 kernel: [35639.633579] Aug 22 15:18:10 juju-e4d256-prod-github-runner-207 kernel: [35664.541982] watchdog: BUG: soft lockup - CPU#1 stuck for 33107s! [qemu-system-x86:6715] Aug 22 15:18:10 juju-e4d256-prod-github-runner-207 kernel: [35664.543162] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 15:18:10 juju-e4d256-prod-github-runner-207 kernel: [35664.543387] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 15:18:10 juju-e4d256-prod-github-runner-207 kernel: [35664.555669] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 15:18:10 juju-e4d256-prod-github-runner-207 kernel: [35664.556990] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 15:18:10 juju-e4d256-prod-github-runner-207 kernel: [35664.558249] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:18:10 juju-e4d256-prod-github-runner-207 kernel: [35664.559484] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 15:18:10 juju-e4d256-prod-github-runner-207 kernel: [35664.562258] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 15:18:10 juju-e4d256-prod-github-runner-207 kernel: [35664.563472] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 15:18:10 juju-e4d256-prod-github-runner-207 kernel: [35664.564748] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 15:18:10 juju-e4d256-prod-github-runner-207 kernel: [35664.566091] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 15:18:10 juju-e4d256-prod-github-runner-207 kernel: [35664.567380] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 15:18:10 juju-e4d256-prod-github-runner-207 kernel: [35664.568592] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 15:18:10 juju-e4d256-prod-github-runner-207 kernel: [35664.569800] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 15:18:10 juju-e4d256-prod-github-runner-207 kernel: [35664.571109] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 15:18:10 juju-e4d256-prod-github-runner-207 kernel: [35664.572241] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 15:18:10 juju-e4d256-prod-github-runner-207 kernel: [35664.573448] Call Trace: Aug 22 15:18:10 juju-e4d256-prod-github-runner-207 kernel: [35664.574364] Aug 22 15:18:10 juju-e4d256-prod-github-runner-207 kernel: [35664.575322] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:18:10 juju-e4d256-prod-github-runner-207 kernel: [35664.576375] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:18:10 juju-e4d256-prod-github-runner-207 kernel: [35664.577411] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:18:10 juju-e4d256-prod-github-runner-207 kernel: [35664.578510] ? show_regs.part.0+0x23/0x29 Aug 22 15:18:10 juju-e4d256-prod-github-runner-207 kernel: [35664.579740] ? show_regs.cold+0x8/0xd Aug 22 15:18:10 juju-e4d256-prod-github-runner-207 kernel: [35664.581086] ? watchdog_timer_fn+0x1be/0x220 Aug 22 15:18:10 juju-e4d256-prod-github-runner-207 kernel: [35664.582580] ? lockup_detector_update_enable+0x60/0x60 Aug 22 15:18:10 juju-e4d256-prod-github-runner-207 kernel: [35664.584089] ? __hrtimer_run_queues+0x107/0x230 Aug 22 15:18:10 juju-e4d256-prod-github-runner-207 kernel: [35664.585210] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 15:18:10 juju-e4d256-prod-github-runner-207 kernel: [35664.586272] ? hrtimer_interrupt+0x101/0x220 Aug 22 15:18:10 juju-e4d256-prod-github-runner-207 kernel: [35664.587343] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 15:18:10 juju-e4d256-prod-github-runner-207 kernel: [35664.588433] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 15:18:10 juju-e4d256-prod-github-runner-207 kernel: [35664.589512] Aug 22 15:18:10 juju-e4d256-prod-github-runner-207 kernel: [35664.590397] Aug 22 15:18:10 juju-e4d256-prod-github-runner-207 kernel: [35664.591401] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 15:18:10 juju-e4d256-prod-github-runner-207 kernel: [35664.592456] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:18:10 juju-e4d256-prod-github-runner-207 kernel: [35664.593525] ? _raw_spin_lock+0x22/0x30 Aug 22 15:18:10 juju-e4d256-prod-github-runner-207 kernel: [35664.594654] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:18:10 juju-e4d256-prod-github-runner-207 kernel: [35664.595714] direct_page_fault+0x206/0x310 [kvm] Aug 22 15:18:10 juju-e4d256-prod-github-runner-207 kernel: [35664.596943] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 15:18:10 juju-e4d256-prod-github-runner-207 kernel: [35664.597998] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 15:18:10 juju-e4d256-prod-github-runner-207 kernel: [35664.599051] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 15:18:10 juju-e4d256-prod-github-runner-207 kernel: [35664.600042] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 15:18:10 juju-e4d256-prod-github-runner-207 kernel: [35664.601065] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 15:18:10 juju-e4d256-prod-github-runner-207 kernel: [35664.602084] handle_exit+0x98/0x230 [kvm_amd] Aug 22 15:18:10 juju-e4d256-prod-github-runner-207 kernel: [35664.603050] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 15:18:10 juju-e4d256-prod-github-runner-207 kernel: [35664.603981] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 15:18:10 juju-e4d256-prod-github-runner-207 kernel: [35664.604954] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 15:18:10 juju-e4d256-prod-github-runner-207 kernel: [35664.605867] vcpu_run+0x62/0x2c0 [kvm] Aug 22 15:18:10 juju-e4d256-prod-github-runner-207 kernel: [35664.606687] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 15:18:10 juju-e4d256-prod-github-runner-207 kernel: [35664.607568] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 15:18:10 juju-e4d256-prod-github-runner-207 kernel: [35664.608431] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 15:18:10 juju-e4d256-prod-github-runner-207 kernel: [35664.609246] ? __seccomp_filter+0x4a/0x4a0 Aug 22 15:18:10 juju-e4d256-prod-github-runner-207 kernel: [35664.610009] ? __fget_files+0x86/0xc0 Aug 22 15:18:10 juju-e4d256-prod-github-runner-207 kernel: [35664.610739] __x64_sys_ioctl+0x95/0xd0 Aug 22 15:18:10 juju-e4d256-prod-github-runner-207 kernel: [35664.611474] do_syscall_64+0x5c/0xc0 Aug 22 15:18:10 juju-e4d256-prod-github-runner-207 kernel: [35664.612155] ? do_futex+0x162/0x1f0 Aug 22 15:18:10 juju-e4d256-prod-github-runner-207 kernel: [35664.612838] ? __x64_sys_futex+0x78/0x1e0 Aug 22 15:18:10 juju-e4d256-prod-github-runner-207 kernel: [35664.613531] ? __secure_computing+0xa9/0x120 Aug 22 15:18:10 juju-e4d256-prod-github-runner-207 kernel: [35664.614231] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 15:18:10 juju-e4d256-prod-github-runner-207 kernel: [35664.615008] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:18:10 juju-e4d256-prod-github-runner-207 kernel: [35664.615729] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:18:10 juju-e4d256-prod-github-runner-207 kernel: [35664.616448] ? do_syscall_64+0x69/0xc0 Aug 22 15:18:10 juju-e4d256-prod-github-runner-207 kernel: [35664.617119] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:18:10 juju-e4d256-prod-github-runner-207 kernel: [35664.617831] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:18:10 juju-e4d256-prod-github-runner-207 kernel: [35664.618529] ? do_syscall_64+0x69/0xc0 Aug 22 15:18:10 juju-e4d256-prod-github-runner-207 kernel: [35664.619176] ? do_syscall_64+0x69/0xc0 Aug 22 15:18:10 juju-e4d256-prod-github-runner-207 kernel: [35664.619799] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 15:18:10 juju-e4d256-prod-github-runner-207 kernel: [35664.620509] RIP: 0033:0x7faa5d0edaff Aug 22 15:18:10 juju-e4d256-prod-github-runner-207 kernel: [35664.621143] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 15:18:10 juju-e4d256-prod-github-runner-207 kernel: [35664.623172] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 15:18:10 juju-e4d256-prod-github-runner-207 kernel: [35664.624137] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 15:18:10 juju-e4d256-prod-github-runner-207 kernel: [35664.625054] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 15:18:10 juju-e4d256-prod-github-runner-207 kernel: [35664.625978] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 15:18:10 juju-e4d256-prod-github-runner-207 kernel: [35664.626891] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 15:18:10 juju-e4d256-prod-github-runner-207 kernel: [35664.627784] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 15:18:10 juju-e4d256-prod-github-runner-207 kernel: [35664.628680] Aug 22 15:18:38 juju-e4d256-prod-github-runner-207 kernel: [35692.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 33133s! [qemu-system-x86:6715] Aug 22 15:18:38 juju-e4d256-prod-github-runner-207 kernel: [35692.543161] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 15:18:38 juju-e4d256-prod-github-runner-207 kernel: [35692.543237] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 15:18:38 juju-e4d256-prod-github-runner-207 kernel: [35692.555270] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 15:18:38 juju-e4d256-prod-github-runner-207 kernel: [35692.556529] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 15:18:38 juju-e4d256-prod-github-runner-207 kernel: [35692.557749] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:18:38 juju-e4d256-prod-github-runner-207 kernel: [35692.558815] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 15:18:38 juju-e4d256-prod-github-runner-207 kernel: [35692.561347] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 15:18:38 juju-e4d256-prod-github-runner-207 kernel: [35692.562575] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 15:18:38 juju-e4d256-prod-github-runner-207 kernel: [35692.563753] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 15:18:38 juju-e4d256-prod-github-runner-207 kernel: [35692.565018] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 15:18:38 juju-e4d256-prod-github-runner-207 kernel: [35692.566182] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 15:18:38 juju-e4d256-prod-github-runner-207 kernel: [35692.567355] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 15:18:38 juju-e4d256-prod-github-runner-207 kernel: [35692.568590] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 15:18:38 juju-e4d256-prod-github-runner-207 kernel: [35692.570005] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 15:18:38 juju-e4d256-prod-github-runner-207 kernel: [35692.571199] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 15:18:38 juju-e4d256-prod-github-runner-207 kernel: [35692.572397] Call Trace: Aug 22 15:18:38 juju-e4d256-prod-github-runner-207 kernel: [35692.573315] Aug 22 15:18:38 juju-e4d256-prod-github-runner-207 kernel: [35692.574197] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:18:38 juju-e4d256-prod-github-runner-207 kernel: [35692.575239] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:18:38 juju-e4d256-prod-github-runner-207 kernel: [35692.576263] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:18:38 juju-e4d256-prod-github-runner-207 kernel: [35692.577334] ? show_regs.part.0+0x23/0x29 Aug 22 15:18:38 juju-e4d256-prod-github-runner-207 kernel: [35692.578334] ? show_regs.cold+0x8/0xd Aug 22 15:18:38 juju-e4d256-prod-github-runner-207 kernel: [35692.579310] ? watchdog_timer_fn+0x1be/0x220 Aug 22 15:18:38 juju-e4d256-prod-github-runner-207 kernel: [35692.580316] ? lockup_detector_update_enable+0x60/0x60 Aug 22 15:18:38 juju-e4d256-prod-github-runner-207 kernel: [35692.581374] ? __hrtimer_run_queues+0x107/0x230 Aug 22 15:18:38 juju-e4d256-prod-github-runner-207 kernel: [35692.582398] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 15:18:38 juju-e4d256-prod-github-runner-207 kernel: [35692.583428] ? hrtimer_interrupt+0x101/0x220 Aug 22 15:18:38 juju-e4d256-prod-github-runner-207 kernel: [35692.584439] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 15:18:38 juju-e4d256-prod-github-runner-207 kernel: [35692.585513] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 15:18:38 juju-e4d256-prod-github-runner-207 kernel: [35692.586565] Aug 22 15:18:38 juju-e4d256-prod-github-runner-207 kernel: [35692.587416] Aug 22 15:18:38 juju-e4d256-prod-github-runner-207 kernel: [35692.588252] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 15:18:38 juju-e4d256-prod-github-runner-207 kernel: [35692.589282] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:18:38 juju-e4d256-prod-github-runner-207 kernel: [35692.590477] ? _raw_spin_lock+0x22/0x30 Aug 22 15:18:38 juju-e4d256-prod-github-runner-207 kernel: [35692.591457] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:18:38 juju-e4d256-prod-github-runner-207 kernel: [35692.592624] direct_page_fault+0x206/0x310 [kvm] Aug 22 15:18:38 juju-e4d256-prod-github-runner-207 kernel: [35692.593657] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 15:18:38 juju-e4d256-prod-github-runner-207 kernel: [35692.594681] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 15:18:38 juju-e4d256-prod-github-runner-207 kernel: [35692.595682] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 15:18:38 juju-e4d256-prod-github-runner-207 kernel: [35692.596651] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 15:18:38 juju-e4d256-prod-github-runner-207 kernel: [35692.597600] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 15:18:38 juju-e4d256-prod-github-runner-207 kernel: [35692.598587] handle_exit+0x98/0x230 [kvm_amd] Aug 22 15:18:38 juju-e4d256-prod-github-runner-207 kernel: [35692.599486] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 15:18:38 juju-e4d256-prod-github-runner-207 kernel: [35692.600409] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 15:18:38 juju-e4d256-prod-github-runner-207 kernel: [35692.601348] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 15:18:38 juju-e4d256-prod-github-runner-207 kernel: [35692.602256] vcpu_run+0x62/0x2c0 [kvm] Aug 22 15:18:38 juju-e4d256-prod-github-runner-207 kernel: [35692.603123] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 15:18:38 juju-e4d256-prod-github-runner-207 kernel: [35692.603935] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 15:18:38 juju-e4d256-prod-github-runner-207 kernel: [35692.604785] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 15:18:38 juju-e4d256-prod-github-runner-207 kernel: [35692.605579] ? __seccomp_filter+0x4a/0x4a0 Aug 22 15:18:38 juju-e4d256-prod-github-runner-207 kernel: [35692.606325] ? __fget_files+0x86/0xc0 Aug 22 15:18:38 juju-e4d256-prod-github-runner-207 kernel: [35692.607044] __x64_sys_ioctl+0x95/0xd0 Aug 22 15:18:38 juju-e4d256-prod-github-runner-207 kernel: [35692.607735] do_syscall_64+0x5c/0xc0 Aug 22 15:18:38 juju-e4d256-prod-github-runner-207 kernel: [35692.608397] ? do_futex+0x162/0x1f0 Aug 22 15:18:38 juju-e4d256-prod-github-runner-207 kernel: [35692.609043] ? __x64_sys_futex+0x78/0x1e0 Aug 22 15:18:38 juju-e4d256-prod-github-runner-207 kernel: [35692.609713] ? __secure_computing+0xa9/0x120 Aug 22 15:18:38 juju-e4d256-prod-github-runner-207 kernel: [35692.610404] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 15:18:38 juju-e4d256-prod-github-runner-207 kernel: [35692.611173] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:18:38 juju-e4d256-prod-github-runner-207 kernel: [35692.611895] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:18:38 juju-e4d256-prod-github-runner-207 kernel: [35692.612611] ? do_syscall_64+0x69/0xc0 Aug 22 15:18:38 juju-e4d256-prod-github-runner-207 kernel: [35692.613259] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:18:38 juju-e4d256-prod-github-runner-207 kernel: [35692.613958] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:18:38 juju-e4d256-prod-github-runner-207 kernel: [35692.614702] ? do_syscall_64+0x69/0xc0 Aug 22 15:18:38 juju-e4d256-prod-github-runner-207 kernel: [35692.615325] ? do_syscall_64+0x69/0xc0 Aug 22 15:18:38 juju-e4d256-prod-github-runner-207 kernel: [35692.615943] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 15:18:38 juju-e4d256-prod-github-runner-207 kernel: [35692.616649] RIP: 0033:0x7faa5d0edaff Aug 22 15:18:38 juju-e4d256-prod-github-runner-207 kernel: [35692.617276] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 15:18:38 juju-e4d256-prod-github-runner-207 kernel: [35692.619269] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 15:18:38 juju-e4d256-prod-github-runner-207 kernel: [35692.620178] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 15:18:38 juju-e4d256-prod-github-runner-207 kernel: [35692.621068] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 15:18:38 juju-e4d256-prod-github-runner-207 kernel: [35692.622094] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 15:18:38 juju-e4d256-prod-github-runner-207 kernel: [35692.623010] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 15:18:38 juju-e4d256-prod-github-runner-207 kernel: [35692.623941] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 15:18:38 juju-e4d256-prod-github-runner-207 kernel: [35692.624833] Aug 22 15:19:06 juju-e4d256-prod-github-runner-207 kernel: [35720.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 33159s! [qemu-system-x86:6715] Aug 22 15:19:06 juju-e4d256-prod-github-runner-207 kernel: [35720.543963] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 15:19:06 juju-e4d256-prod-github-runner-207 kernel: [35720.544304] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 15:19:06 juju-e4d256-prod-github-runner-207 kernel: [35720.556458] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 15:19:06 juju-e4d256-prod-github-runner-207 kernel: [35720.557728] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 15:19:06 juju-e4d256-prod-github-runner-207 kernel: [35720.558957] RIP: 0010:native_queued_spin_lock_slowpath+0xc/0x40 Aug 22 15:19:06 juju-e4d256-prod-github-runner-207 kernel: [35720.560018] Code: fe ff ff eb af 4c 89 fe 48 c7 c7 20 99 e9 89 e8 ca 69 55 00 e9 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 <8b> 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 eb Aug 22 15:19:06 juju-e4d256-prod-github-runner-207 kernel: [35720.562599] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 15:19:06 juju-e4d256-prod-github-runner-207 kernel: [35720.563638] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 15:19:06 juju-e4d256-prod-github-runner-207 kernel: [35720.564794] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 15:19:06 juju-e4d256-prod-github-runner-207 kernel: [35720.565951] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 15:19:06 juju-e4d256-prod-github-runner-207 kernel: [35720.567150] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 15:19:06 juju-e4d256-prod-github-runner-207 kernel: [35720.568310] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 15:19:06 juju-e4d256-prod-github-runner-207 kernel: [35720.569475] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 15:19:06 juju-e4d256-prod-github-runner-207 kernel: [35720.570726] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 15:19:06 juju-e4d256-prod-github-runner-207 kernel: [35720.571821] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 15:19:06 juju-e4d256-prod-github-runner-207 kernel: [35720.573018] Call Trace: Aug 22 15:19:06 juju-e4d256-prod-github-runner-207 kernel: [35720.573927] Aug 22 15:19:06 juju-e4d256-prod-github-runner-207 kernel: [35720.574839] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:19:06 juju-e4d256-prod-github-runner-207 kernel: [35720.575909] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:19:06 juju-e4d256-prod-github-runner-207 kernel: [35720.576932] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:19:06 juju-e4d256-prod-github-runner-207 kernel: [35720.578033] ? show_regs.part.0+0x23/0x29 Aug 22 15:19:06 juju-e4d256-prod-github-runner-207 kernel: [35720.579049] ? show_regs.cold+0x8/0xd Aug 22 15:19:06 juju-e4d256-prod-github-runner-207 kernel: [35720.580018] ? watchdog_timer_fn+0x1be/0x220 Aug 22 15:19:06 juju-e4d256-prod-github-runner-207 kernel: [35720.581024] ? lockup_detector_update_enable+0x60/0x60 Aug 22 15:19:06 juju-e4d256-prod-github-runner-207 kernel: [35720.582087] ? __hrtimer_run_queues+0x107/0x230 Aug 22 15:19:06 juju-e4d256-prod-github-runner-207 kernel: [35720.583162] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 15:19:06 juju-e4d256-prod-github-runner-207 kernel: [35720.584187] ? hrtimer_interrupt+0x101/0x220 Aug 22 15:19:06 juju-e4d256-prod-github-runner-207 kernel: [35720.585200] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 15:19:06 juju-e4d256-prod-github-runner-207 kernel: [35720.586282] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 15:19:06 juju-e4d256-prod-github-runner-207 kernel: [35720.587327] Aug 22 15:19:06 juju-e4d256-prod-github-runner-207 kernel: [35720.588178] Aug 22 15:19:06 juju-e4d256-prod-github-runner-207 kernel: [35720.589018] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 15:19:06 juju-e4d256-prod-github-runner-207 kernel: [35720.590071] ? native_queued_spin_lock_slowpath+0xc/0x40 Aug 22 15:19:06 juju-e4d256-prod-github-runner-207 kernel: [35720.591132] ? _raw_spin_lock+0x22/0x30 Aug 22 15:19:06 juju-e4d256-prod-github-runner-207 kernel: [35720.592086] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:19:06 juju-e4d256-prod-github-runner-207 kernel: [35720.593104] direct_page_fault+0x206/0x310 [kvm] Aug 22 15:19:06 juju-e4d256-prod-github-runner-207 kernel: [35720.594130] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 15:19:06 juju-e4d256-prod-github-runner-207 kernel: [35720.595147] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 15:19:06 juju-e4d256-prod-github-runner-207 kernel: [35720.596149] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 15:19:06 juju-e4d256-prod-github-runner-207 kernel: [35720.597151] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 15:19:06 juju-e4d256-prod-github-runner-207 kernel: [35720.598099] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 15:19:06 juju-e4d256-prod-github-runner-207 kernel: [35720.599085] handle_exit+0x98/0x230 [kvm_amd] Aug 22 15:19:06 juju-e4d256-prod-github-runner-207 kernel: [35720.599973] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 15:19:06 juju-e4d256-prod-github-runner-207 kernel: [35720.600882] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 15:19:06 juju-e4d256-prod-github-runner-207 kernel: [35720.601802] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 15:19:06 juju-e4d256-prod-github-runner-207 kernel: [35720.602712] vcpu_run+0x62/0x2c0 [kvm] Aug 22 15:19:06 juju-e4d256-prod-github-runner-207 kernel: [35720.603520] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 15:19:06 juju-e4d256-prod-github-runner-207 kernel: [35720.604323] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 15:19:06 juju-e4d256-prod-github-runner-207 kernel: [35720.605179] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 15:19:06 juju-e4d256-prod-github-runner-207 kernel: [35720.605973] ? __seccomp_filter+0x4a/0x4a0 Aug 22 15:19:06 juju-e4d256-prod-github-runner-207 kernel: [35720.606721] ? __fget_files+0x86/0xc0 Aug 22 15:19:06 juju-e4d256-prod-github-runner-207 kernel: [35720.607423] __x64_sys_ioctl+0x95/0xd0 Aug 22 15:19:06 juju-e4d256-prod-github-runner-207 kernel: [35720.608118] do_syscall_64+0x5c/0xc0 Aug 22 15:19:06 juju-e4d256-prod-github-runner-207 kernel: [35720.608779] ? do_futex+0x162/0x1f0 Aug 22 15:19:06 juju-e4d256-prod-github-runner-207 kernel: [35720.609423] ? __x64_sys_futex+0x78/0x1e0 Aug 22 15:19:06 juju-e4d256-prod-github-runner-207 kernel: [35720.610093] ? __secure_computing+0xa9/0x120 Aug 22 15:19:06 juju-e4d256-prod-github-runner-207 kernel: [35720.610787] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 15:19:06 juju-e4d256-prod-github-runner-207 kernel: [35720.611542] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:19:06 juju-e4d256-prod-github-runner-207 kernel: [35720.612295] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:19:06 juju-e4d256-prod-github-runner-207 kernel: [35720.613035] ? do_syscall_64+0x69/0xc0 Aug 22 15:19:06 juju-e4d256-prod-github-runner-207 kernel: [35720.613687] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:19:06 juju-e4d256-prod-github-runner-207 kernel: [35720.614423] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:19:06 juju-e4d256-prod-github-runner-207 kernel: [35720.615124] ? do_syscall_64+0x69/0xc0 Aug 22 15:19:06 juju-e4d256-prod-github-runner-207 kernel: [35720.615744] ? do_syscall_64+0x69/0xc0 Aug 22 15:19:06 juju-e4d256-prod-github-runner-207 kernel: [35720.616361] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 15:19:06 juju-e4d256-prod-github-runner-207 kernel: [35720.617066] RIP: 0033:0x7faa5d0edaff Aug 22 15:19:06 juju-e4d256-prod-github-runner-207 kernel: [35720.617718] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 15:19:06 juju-e4d256-prod-github-runner-207 kernel: [35720.619727] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 15:19:06 juju-e4d256-prod-github-runner-207 kernel: [35720.620634] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 15:19:06 juju-e4d256-prod-github-runner-207 kernel: [35720.621520] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 15:19:06 juju-e4d256-prod-github-runner-207 kernel: [35720.622422] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 15:19:06 juju-e4d256-prod-github-runner-207 kernel: [35720.623331] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 15:19:06 juju-e4d256-prod-github-runner-207 kernel: [35720.624215] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 15:19:06 juju-e4d256-prod-github-runner-207 kernel: [35720.625101] Aug 22 15:19:34 juju-e4d256-prod-github-runner-207 kernel: [35748.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 33185s! [qemu-system-x86:6715] Aug 22 15:19:34 juju-e4d256-prod-github-runner-207 kernel: [35748.543108] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 15:19:34 juju-e4d256-prod-github-runner-207 kernel: [35748.543183] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 15:19:34 juju-e4d256-prod-github-runner-207 kernel: [35748.555240] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 15:19:34 juju-e4d256-prod-github-runner-207 kernel: [35748.556506] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 15:19:34 juju-e4d256-prod-github-runner-207 kernel: [35748.557734] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:19:34 juju-e4d256-prod-github-runner-207 kernel: [35748.558858] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 15:19:34 juju-e4d256-prod-github-runner-207 kernel: [35748.561542] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 15:19:34 juju-e4d256-prod-github-runner-207 kernel: [35748.562615] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 15:19:34 juju-e4d256-prod-github-runner-207 kernel: [35748.563792] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 15:19:34 juju-e4d256-prod-github-runner-207 kernel: [35748.565193] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 15:19:34 juju-e4d256-prod-github-runner-207 kernel: [35748.566414] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 15:19:34 juju-e4d256-prod-github-runner-207 kernel: [35748.567581] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 15:19:34 juju-e4d256-prod-github-runner-207 kernel: [35748.568798] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 15:19:34 juju-e4d256-prod-github-runner-207 kernel: [35748.570097] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 15:19:34 juju-e4d256-prod-github-runner-207 kernel: [35748.571198] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 15:19:34 juju-e4d256-prod-github-runner-207 kernel: [35748.572525] Call Trace: Aug 22 15:19:34 juju-e4d256-prod-github-runner-207 kernel: [35748.573448] Aug 22 15:19:34 juju-e4d256-prod-github-runner-207 kernel: [35748.574341] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:19:34 juju-e4d256-prod-github-runner-207 kernel: [35748.575397] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:19:34 juju-e4d256-prod-github-runner-207 kernel: [35748.576419] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:19:34 juju-e4d256-prod-github-runner-207 kernel: [35748.577493] ? show_regs.part.0+0x23/0x29 Aug 22 15:19:34 juju-e4d256-prod-github-runner-207 kernel: [35748.578520] ? show_regs.cold+0x8/0xd Aug 22 15:19:34 juju-e4d256-prod-github-runner-207 kernel: [35748.579492] ? watchdog_timer_fn+0x1be/0x220 Aug 22 15:19:34 juju-e4d256-prod-github-runner-207 kernel: [35748.580519] ? lockup_detector_update_enable+0x60/0x60 Aug 22 15:19:34 juju-e4d256-prod-github-runner-207 kernel: [35748.581580] ? __hrtimer_run_queues+0x107/0x230 Aug 22 15:19:34 juju-e4d256-prod-github-runner-207 kernel: [35748.582617] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 15:19:34 juju-e4d256-prod-github-runner-207 kernel: [35748.583641] ? hrtimer_interrupt+0x101/0x220 Aug 22 15:19:34 juju-e4d256-prod-github-runner-207 kernel: [35748.584657] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 15:19:34 juju-e4d256-prod-github-runner-207 kernel: [35748.585723] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 15:19:34 juju-e4d256-prod-github-runner-207 kernel: [35748.586786] Aug 22 15:19:34 juju-e4d256-prod-github-runner-207 kernel: [35748.587641] Aug 22 15:19:34 juju-e4d256-prod-github-runner-207 kernel: [35748.588483] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 15:19:34 juju-e4d256-prod-github-runner-207 kernel: [35748.589645] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:19:34 juju-e4d256-prod-github-runner-207 kernel: [35748.590707] ? _raw_spin_lock+0x22/0x30 Aug 22 15:19:34 juju-e4d256-prod-github-runner-207 kernel: [35748.591658] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:19:34 juju-e4d256-prod-github-runner-207 kernel: [35748.592675] direct_page_fault+0x206/0x310 [kvm] Aug 22 15:19:34 juju-e4d256-prod-github-runner-207 kernel: [35748.593698] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 15:19:34 juju-e4d256-prod-github-runner-207 kernel: [35748.594757] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 15:19:34 juju-e4d256-prod-github-runner-207 kernel: [35748.596009] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 15:19:34 juju-e4d256-prod-github-runner-207 kernel: [35748.597040] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 15:19:34 juju-e4d256-prod-github-runner-207 kernel: [35748.598081] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 15:19:34 juju-e4d256-prod-github-runner-207 kernel: [35748.599064] handle_exit+0x98/0x230 [kvm_amd] Aug 22 15:19:34 juju-e4d256-prod-github-runner-207 kernel: [35748.599964] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 15:19:34 juju-e4d256-prod-github-runner-207 kernel: [35748.600886] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 15:19:34 juju-e4d256-prod-github-runner-207 kernel: [35748.601901] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 15:19:34 juju-e4d256-prod-github-runner-207 kernel: [35748.602820] vcpu_run+0x62/0x2c0 [kvm] Aug 22 15:19:34 juju-e4d256-prod-github-runner-207 kernel: [35748.603638] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 15:19:34 juju-e4d256-prod-github-runner-207 kernel: [35748.604453] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 15:19:34 juju-e4d256-prod-github-runner-207 kernel: [35748.605325] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 15:19:34 juju-e4d256-prod-github-runner-207 kernel: [35748.606159] ? __seccomp_filter+0x4a/0x4a0 Aug 22 15:19:34 juju-e4d256-prod-github-runner-207 kernel: [35748.606909] ? __fget_files+0x86/0xc0 Aug 22 15:19:34 juju-e4d256-prod-github-runner-207 kernel: [35748.607616] __x64_sys_ioctl+0x95/0xd0 Aug 22 15:19:34 juju-e4d256-prod-github-runner-207 kernel: [35748.608313] do_syscall_64+0x5c/0xc0 Aug 22 15:19:34 juju-e4d256-prod-github-runner-207 kernel: [35748.608983] ? do_futex+0x162/0x1f0 Aug 22 15:19:34 juju-e4d256-prod-github-runner-207 kernel: [35748.609638] ? __x64_sys_futex+0x78/0x1e0 Aug 22 15:19:34 juju-e4d256-prod-github-runner-207 kernel: [35748.610324] ? __secure_computing+0xa9/0x120 Aug 22 15:19:34 juju-e4d256-prod-github-runner-207 kernel: [35748.611030] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 15:19:34 juju-e4d256-prod-github-runner-207 kernel: [35748.611805] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:19:34 juju-e4d256-prod-github-runner-207 kernel: [35748.612530] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:19:34 juju-e4d256-prod-github-runner-207 kernel: [35748.613256] ? do_syscall_64+0x69/0xc0 Aug 22 15:19:34 juju-e4d256-prod-github-runner-207 kernel: [35748.613917] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:19:34 juju-e4d256-prod-github-runner-207 kernel: [35748.614624] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:19:34 juju-e4d256-prod-github-runner-207 kernel: [35748.615320] ? do_syscall_64+0x69/0xc0 Aug 22 15:19:34 juju-e4d256-prod-github-runner-207 kernel: [35748.615951] ? do_syscall_64+0x69/0xc0 Aug 22 15:19:34 juju-e4d256-prod-github-runner-207 kernel: [35748.616576] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 15:19:34 juju-e4d256-prod-github-runner-207 kernel: [35748.617284] RIP: 0033:0x7faa5d0edaff Aug 22 15:19:34 juju-e4d256-prod-github-runner-207 kernel: [35748.617949] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 15:19:34 juju-e4d256-prod-github-runner-207 kernel: [35748.619949] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 15:19:34 juju-e4d256-prod-github-runner-207 kernel: [35748.620869] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 15:19:34 juju-e4d256-prod-github-runner-207 kernel: [35748.621997] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 15:19:34 juju-e4d256-prod-github-runner-207 kernel: [35748.623251] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 15:19:34 juju-e4d256-prod-github-runner-207 kernel: [35748.624450] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 15:19:34 juju-e4d256-prod-github-runner-207 kernel: [35748.625453] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 15:19:34 juju-e4d256-prod-github-runner-207 kernel: [35748.626517] Aug 22 15:20:02 juju-e4d256-prod-github-runner-207 kernel: [35776.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 33211s! [qemu-system-x86:6715] Aug 22 15:20:02 juju-e4d256-prod-github-runner-207 kernel: [35776.543083] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 15:20:02 juju-e4d256-prod-github-runner-207 kernel: [35776.543155] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 15:20:02 juju-e4d256-prod-github-runner-207 kernel: [35776.555209] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 15:20:02 juju-e4d256-prod-github-runner-207 kernel: [35776.556477] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 15:20:02 juju-e4d256-prod-github-runner-207 kernel: [35776.557708] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:20:02 juju-e4d256-prod-github-runner-207 kernel: [35776.558771] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 15:20:02 juju-e4d256-prod-github-runner-207 kernel: [35776.561343] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 15:20:02 juju-e4d256-prod-github-runner-207 kernel: [35776.562395] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 15:20:02 juju-e4d256-prod-github-runner-207 kernel: [35776.563553] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 15:20:02 juju-e4d256-prod-github-runner-207 kernel: [35776.564712] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 15:20:02 juju-e4d256-prod-github-runner-207 kernel: [35776.565885] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 15:20:02 juju-e4d256-prod-github-runner-207 kernel: [35776.567050] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 15:20:02 juju-e4d256-prod-github-runner-207 kernel: [35776.568214] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 15:20:02 juju-e4d256-prod-github-runner-207 kernel: [35776.569464] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 15:20:02 juju-e4d256-prod-github-runner-207 kernel: [35776.570577] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 15:20:02 juju-e4d256-prod-github-runner-207 kernel: [35776.571772] Call Trace: Aug 22 15:20:02 juju-e4d256-prod-github-runner-207 kernel: [35776.572681] Aug 22 15:20:02 juju-e4d256-prod-github-runner-207 kernel: [35776.573588] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:20:02 juju-e4d256-prod-github-runner-207 kernel: [35776.574633] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:20:02 juju-e4d256-prod-github-runner-207 kernel: [35776.575653] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:20:02 juju-e4d256-prod-github-runner-207 kernel: [35776.576726] ? show_regs.part.0+0x23/0x29 Aug 22 15:20:02 juju-e4d256-prod-github-runner-207 kernel: [35776.577729] ? show_regs.cold+0x8/0xd Aug 22 15:20:02 juju-e4d256-prod-github-runner-207 kernel: [35776.578698] ? watchdog_timer_fn+0x1be/0x220 Aug 22 15:20:02 juju-e4d256-prod-github-runner-207 kernel: [35776.579706] ? lockup_detector_update_enable+0x60/0x60 Aug 22 15:20:02 juju-e4d256-prod-github-runner-207 kernel: [35776.580767] ? __hrtimer_run_queues+0x107/0x230 Aug 22 15:20:02 juju-e4d256-prod-github-runner-207 kernel: [35776.581802] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 15:20:02 juju-e4d256-prod-github-runner-207 kernel: [35776.583023] ? hrtimer_interrupt+0x101/0x220 Aug 22 15:20:02 juju-e4d256-prod-github-runner-207 kernel: [35776.584106] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 15:20:02 juju-e4d256-prod-github-runner-207 kernel: [35776.585361] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 15:20:02 juju-e4d256-prod-github-runner-207 kernel: [35776.586421] Aug 22 15:20:02 juju-e4d256-prod-github-runner-207 kernel: [35776.587276] Aug 22 15:20:02 juju-e4d256-prod-github-runner-207 kernel: [35776.588112] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 15:20:02 juju-e4d256-prod-github-runner-207 kernel: [35776.589142] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:20:02 juju-e4d256-prod-github-runner-207 kernel: [35776.590196] ? _raw_spin_lock+0x22/0x30 Aug 22 15:20:02 juju-e4d256-prod-github-runner-207 kernel: [35776.591152] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:20:02 juju-e4d256-prod-github-runner-207 kernel: [35776.592168] direct_page_fault+0x206/0x310 [kvm] Aug 22 15:20:02 juju-e4d256-prod-github-runner-207 kernel: [35776.593190] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 15:20:02 juju-e4d256-prod-github-runner-207 kernel: [35776.594224] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 15:20:02 juju-e4d256-prod-github-runner-207 kernel: [35776.595247] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 15:20:02 juju-e4d256-prod-github-runner-207 kernel: [35776.596234] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 15:20:02 juju-e4d256-prod-github-runner-207 kernel: [35776.597182] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 15:20:02 juju-e4d256-prod-github-runner-207 kernel: [35776.598176] handle_exit+0x98/0x230 [kvm_amd] Aug 22 15:20:02 juju-e4d256-prod-github-runner-207 kernel: [35776.599070] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 15:20:02 juju-e4d256-prod-github-runner-207 kernel: [35776.599989] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 15:20:02 juju-e4d256-prod-github-runner-207 kernel: [35776.600917] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 15:20:02 juju-e4d256-prod-github-runner-207 kernel: [35776.601860] vcpu_run+0x62/0x2c0 [kvm] Aug 22 15:20:02 juju-e4d256-prod-github-runner-207 kernel: [35776.602676] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 15:20:02 juju-e4d256-prod-github-runner-207 kernel: [35776.603500] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 15:20:02 juju-e4d256-prod-github-runner-207 kernel: [35776.604367] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 15:20:02 juju-e4d256-prod-github-runner-207 kernel: [35776.605171] ? __seccomp_filter+0x4a/0x4a0 Aug 22 15:20:02 juju-e4d256-prod-github-runner-207 kernel: [35776.605940] ? __fget_files+0x86/0xc0 Aug 22 15:20:02 juju-e4d256-prod-github-runner-207 kernel: [35776.606655] __x64_sys_ioctl+0x95/0xd0 Aug 22 15:20:02 juju-e4d256-prod-github-runner-207 kernel: [35776.607353] do_syscall_64+0x5c/0xc0 Aug 22 15:20:02 juju-e4d256-prod-github-runner-207 kernel: [35776.608040] ? do_futex+0x162/0x1f0 Aug 22 15:20:02 juju-e4d256-prod-github-runner-207 kernel: [35776.608708] ? __x64_sys_futex+0x78/0x1e0 Aug 22 15:20:02 juju-e4d256-prod-github-runner-207 kernel: [35776.609417] ? __secure_computing+0xa9/0x120 Aug 22 15:20:02 juju-e4d256-prod-github-runner-207 kernel: [35776.610132] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 15:20:02 juju-e4d256-prod-github-runner-207 kernel: [35776.610899] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:20:02 juju-e4d256-prod-github-runner-207 kernel: [35776.611623] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:20:02 juju-e4d256-prod-github-runner-207 kernel: [35776.612344] ? do_syscall_64+0x69/0xc0 Aug 22 15:20:02 juju-e4d256-prod-github-runner-207 kernel: [35776.613001] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:20:02 juju-e4d256-prod-github-runner-207 kernel: [35776.613725] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:20:02 juju-e4d256-prod-github-runner-207 kernel: [35776.614426] ? do_syscall_64+0x69/0xc0 Aug 22 15:20:02 juju-e4d256-prod-github-runner-207 kernel: [35776.615062] ? do_syscall_64+0x69/0xc0 Aug 22 15:20:02 juju-e4d256-prod-github-runner-207 kernel: [35776.615690] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 15:20:02 juju-e4d256-prod-github-runner-207 kernel: [35776.616419] RIP: 0033:0x7faa5d0edaff Aug 22 15:20:02 juju-e4d256-prod-github-runner-207 kernel: [35776.617048] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 15:20:02 juju-e4d256-prod-github-runner-207 kernel: [35776.619064] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 15:20:02 juju-e4d256-prod-github-runner-207 kernel: [35776.619974] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 15:20:02 juju-e4d256-prod-github-runner-207 kernel: [35776.620861] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 15:20:02 juju-e4d256-prod-github-runner-207 kernel: [35776.621759] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 15:20:02 juju-e4d256-prod-github-runner-207 kernel: [35776.622648] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 15:20:02 juju-e4d256-prod-github-runner-207 kernel: [35776.623533] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 15:20:02 juju-e4d256-prod-github-runner-207 kernel: [35776.624423] Aug 22 15:20:30 juju-e4d256-prod-github-runner-207 kernel: [35804.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 33237s! [qemu-system-x86:6715] Aug 22 15:20:30 juju-e4d256-prod-github-runner-207 kernel: [35804.543189] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 15:20:30 juju-e4d256-prod-github-runner-207 kernel: [35804.543354] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 15:20:30 juju-e4d256-prod-github-runner-207 kernel: [35804.555501] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 15:20:30 juju-e4d256-prod-github-runner-207 kernel: [35804.556912] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 15:20:30 juju-e4d256-prod-github-runner-207 kernel: [35804.558361] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:20:30 juju-e4d256-prod-github-runner-207 kernel: [35804.559619] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 15:20:30 juju-e4d256-prod-github-runner-207 kernel: [35804.562419] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 15:20:30 juju-e4d256-prod-github-runner-207 kernel: [35804.563509] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 15:20:30 juju-e4d256-prod-github-runner-207 kernel: [35804.564781] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 15:20:30 juju-e4d256-prod-github-runner-207 kernel: [35804.566058] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 15:20:30 juju-e4d256-prod-github-runner-207 kernel: [35804.567278] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 15:20:30 juju-e4d256-prod-github-runner-207 kernel: [35804.568463] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 15:20:30 juju-e4d256-prod-github-runner-207 kernel: [35804.569649] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 15:20:30 juju-e4d256-prod-github-runner-207 kernel: [35804.570888] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 15:20:30 juju-e4d256-prod-github-runner-207 kernel: [35804.571996] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 15:20:30 juju-e4d256-prod-github-runner-207 kernel: [35804.573220] Call Trace: Aug 22 15:20:30 juju-e4d256-prod-github-runner-207 kernel: [35804.574147] Aug 22 15:20:30 juju-e4d256-prod-github-runner-207 kernel: [35804.575052] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:20:30 juju-e4d256-prod-github-runner-207 kernel: [35804.576092] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:20:30 juju-e4d256-prod-github-runner-207 kernel: [35804.577116] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:20:30 juju-e4d256-prod-github-runner-207 kernel: [35804.578253] ? show_regs.part.0+0x23/0x29 Aug 22 15:20:30 juju-e4d256-prod-github-runner-207 kernel: [35804.579258] ? show_regs.cold+0x8/0xd Aug 22 15:20:30 juju-e4d256-prod-github-runner-207 kernel: [35804.580231] ? watchdog_timer_fn+0x1be/0x220 Aug 22 15:20:30 juju-e4d256-prod-github-runner-207 kernel: [35804.581273] ? lockup_detector_update_enable+0x60/0x60 Aug 22 15:20:30 juju-e4d256-prod-github-runner-207 kernel: [35804.582339] ? __hrtimer_run_queues+0x107/0x230 Aug 22 15:20:30 juju-e4d256-prod-github-runner-207 kernel: [35804.583368] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 15:20:30 juju-e4d256-prod-github-runner-207 kernel: [35804.584395] ? hrtimer_interrupt+0x101/0x220 Aug 22 15:20:30 juju-e4d256-prod-github-runner-207 kernel: [35804.585426] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 15:20:30 juju-e4d256-prod-github-runner-207 kernel: [35804.586500] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 15:20:30 juju-e4d256-prod-github-runner-207 kernel: [35804.587577] Aug 22 15:20:30 juju-e4d256-prod-github-runner-207 kernel: [35804.588466] Aug 22 15:20:30 juju-e4d256-prod-github-runner-207 kernel: [35804.589342] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 15:20:30 juju-e4d256-prod-github-runner-207 kernel: [35804.590384] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:20:30 juju-e4d256-prod-github-runner-207 kernel: [35804.591430] ? _raw_spin_lock+0x22/0x30 Aug 22 15:20:30 juju-e4d256-prod-github-runner-207 kernel: [35804.592378] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:20:30 juju-e4d256-prod-github-runner-207 kernel: [35804.593433] direct_page_fault+0x206/0x310 [kvm] Aug 22 15:20:30 juju-e4d256-prod-github-runner-207 kernel: [35804.594465] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 15:20:30 juju-e4d256-prod-github-runner-207 kernel: [35804.595479] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 15:20:30 juju-e4d256-prod-github-runner-207 kernel: [35804.596481] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 15:20:30 juju-e4d256-prod-github-runner-207 kernel: [35804.597490] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 15:20:30 juju-e4d256-prod-github-runner-207 kernel: [35804.598476] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 15:20:30 juju-e4d256-prod-github-runner-207 kernel: [35804.599459] handle_exit+0x98/0x230 [kvm_amd] Aug 22 15:20:30 juju-e4d256-prod-github-runner-207 kernel: [35804.600399] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 15:20:30 juju-e4d256-prod-github-runner-207 kernel: [35804.601401] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 15:20:30 juju-e4d256-prod-github-runner-207 kernel: [35804.602421] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 15:20:30 juju-e4d256-prod-github-runner-207 kernel: [35804.603461] vcpu_run+0x62/0x2c0 [kvm] Aug 22 15:20:30 juju-e4d256-prod-github-runner-207 kernel: [35804.604398] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 15:20:30 juju-e4d256-prod-github-runner-207 kernel: [35804.605351] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 15:20:30 juju-e4d256-prod-github-runner-207 kernel: [35804.606265] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 15:20:30 juju-e4d256-prod-github-runner-207 kernel: [35804.607144] ? __seccomp_filter+0x4a/0x4a0 Aug 22 15:20:30 juju-e4d256-prod-github-runner-207 kernel: [35804.607925] ? __fget_files+0x86/0xc0 Aug 22 15:20:30 juju-e4d256-prod-github-runner-207 kernel: [35804.608689] __x64_sys_ioctl+0x95/0xd0 Aug 22 15:20:30 juju-e4d256-prod-github-runner-207 kernel: [35804.609465] do_syscall_64+0x5c/0xc0 Aug 22 15:20:30 juju-e4d256-prod-github-runner-207 kernel: [35804.610263] ? do_futex+0x162/0x1f0 Aug 22 15:20:30 juju-e4d256-prod-github-runner-207 kernel: [35804.611012] ? __x64_sys_futex+0x78/0x1e0 Aug 22 15:20:30 juju-e4d256-prod-github-runner-207 kernel: [35804.611773] ? __secure_computing+0xa9/0x120 Aug 22 15:20:30 juju-e4d256-prod-github-runner-207 kernel: [35804.612557] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 15:20:30 juju-e4d256-prod-github-runner-207 kernel: [35804.613442] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:20:30 juju-e4d256-prod-github-runner-207 kernel: [35804.614259] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:20:30 juju-e4d256-prod-github-runner-207 kernel: [35804.615070] ? do_syscall_64+0x69/0xc0 Aug 22 15:20:30 juju-e4d256-prod-github-runner-207 kernel: [35804.615795] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:20:30 juju-e4d256-prod-github-runner-207 kernel: [35804.616598] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:20:30 juju-e4d256-prod-github-runner-207 kernel: [35804.617404] ? do_syscall_64+0x69/0xc0 Aug 22 15:20:30 juju-e4d256-prod-github-runner-207 kernel: [35804.618105] ? do_syscall_64+0x69/0xc0 Aug 22 15:20:30 juju-e4d256-prod-github-runner-207 kernel: [35804.618801] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 15:20:30 juju-e4d256-prod-github-runner-207 kernel: [35804.619606] RIP: 0033:0x7faa5d0edaff Aug 22 15:20:30 juju-e4d256-prod-github-runner-207 kernel: [35804.620302] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 15:20:30 juju-e4d256-prod-github-runner-207 kernel: [35804.622629] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 15:20:30 juju-e4d256-prod-github-runner-207 kernel: [35804.623688] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 15:20:30 juju-e4d256-prod-github-runner-207 kernel: [35804.624710] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 15:20:30 juju-e4d256-prod-github-runner-207 kernel: [35804.625746] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 15:20:30 juju-e4d256-prod-github-runner-207 kernel: [35804.626765] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 15:20:30 juju-e4d256-prod-github-runner-207 kernel: [35804.627784] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 15:20:30 juju-e4d256-prod-github-runner-207 kernel: [35804.628837] Aug 22 15:20:45 juju-e4d256-prod-github-runner-207 kernel: [35819.576705] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 15:20:45 juju-e4d256-prod-github-runner-207 kernel: [35819.578397] rcu: 1-....: (8897662 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=4298660 Aug 22 15:20:45 juju-e4d256-prod-github-runner-207 kernel: [35819.579515] (t=8925594 jiffies g=23269 q=37765) Aug 22 15:20:45 juju-e4d256-prod-github-runner-207 kernel: [35819.580299] NMI backtrace for cpu 1 Aug 22 15:20:45 juju-e4d256-prod-github-runner-207 kernel: [35819.581178] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 15:20:45 juju-e4d256-prod-github-runner-207 kernel: [35819.582511] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 15:20:45 juju-e4d256-prod-github-runner-207 kernel: [35819.583595] Call Trace: Aug 22 15:20:45 juju-e4d256-prod-github-runner-207 kernel: [35819.584289] Aug 22 15:20:45 juju-e4d256-prod-github-runner-207 kernel: [35819.584945] show_stack+0x52/0x5c Aug 22 15:20:45 juju-e4d256-prod-github-runner-207 kernel: [35819.585682] dump_stack_lvl+0x4a/0x63 Aug 22 15:20:45 juju-e4d256-prod-github-runner-207 kernel: [35819.586424] dump_stack+0x10/0x16 Aug 22 15:20:45 juju-e4d256-prod-github-runner-207 kernel: [35819.587173] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 15:20:45 juju-e4d256-prod-github-runner-207 kernel: [35819.587968] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 15:20:45 juju-e4d256-prod-github-runner-207 kernel: [35819.588753] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 15:20:45 juju-e4d256-prod-github-runner-207 kernel: [35819.589596] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 15:20:45 juju-e4d256-prod-github-runner-207 kernel: [35819.590420] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 15:20:45 juju-e4d256-prod-github-runner-207 kernel: [35819.591231] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 15:20:45 juju-e4d256-prod-github-runner-207 kernel: [35819.592012] print_cpu_stall.cold+0x2f/0xe2 Aug 22 15:20:45 juju-e4d256-prod-github-runner-207 kernel: [35819.592938] ? timekeeping_update+0xf7/0x150 Aug 22 15:20:45 juju-e4d256-prod-github-runner-207 kernel: [35819.593845] check_cpu_stall+0x109/0x270 Aug 22 15:20:45 juju-e4d256-prod-github-runner-207 kernel: [35819.594878] rcu_sched_clock_irq+0x9a/0x250 Aug 22 15:20:45 juju-e4d256-prod-github-runner-207 kernel: [35819.595710] update_process_times+0x94/0xd0 Aug 22 15:20:45 juju-e4d256-prod-github-runner-207 kernel: [35819.596475] tick_sched_handle+0x29/0x70 Aug 22 15:20:45 juju-e4d256-prod-github-runner-207 kernel: [35819.597279] tick_sched_timer+0x8c/0xc0 Aug 22 15:20:45 juju-e4d256-prod-github-runner-207 kernel: [35819.598044] ? tick_nohz_handler+0xb0/0xb0 Aug 22 15:20:45 juju-e4d256-prod-github-runner-207 kernel: [35819.598813] __hrtimer_run_queues+0x107/0x230 Aug 22 15:20:45 juju-e4d256-prod-github-runner-207 kernel: [35819.599650] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 15:20:45 juju-e4d256-prod-github-runner-207 kernel: [35819.600430] hrtimer_interrupt+0x101/0x220 Aug 22 15:20:45 juju-e4d256-prod-github-runner-207 kernel: [35819.601265] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 15:20:45 juju-e4d256-prod-github-runner-207 kernel: [35819.602127] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 15:20:45 juju-e4d256-prod-github-runner-207 kernel: [35819.602949] Aug 22 15:20:45 juju-e4d256-prod-github-runner-207 kernel: [35819.603635] Aug 22 15:20:45 juju-e4d256-prod-github-runner-207 kernel: [35819.604274] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 15:20:45 juju-e4d256-prod-github-runner-207 kernel: [35819.605112] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:20:45 juju-e4d256-prod-github-runner-207 kernel: [35819.606000] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 15:20:45 juju-e4d256-prod-github-runner-207 kernel: [35819.608212] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 15:20:45 juju-e4d256-prod-github-runner-207 kernel: [35819.609129] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 15:20:45 juju-e4d256-prod-github-runner-207 kernel: [35819.610133] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 15:20:45 juju-e4d256-prod-github-runner-207 kernel: [35819.611112] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 15:20:45 juju-e4d256-prod-github-runner-207 kernel: [35819.612078] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 15:20:45 juju-e4d256-prod-github-runner-207 kernel: [35819.613064] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 15:20:45 juju-e4d256-prod-github-runner-207 kernel: [35819.614073] ? _raw_spin_lock+0x22/0x30 Aug 22 15:20:45 juju-e4d256-prod-github-runner-207 kernel: [35819.614909] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:20:45 juju-e4d256-prod-github-runner-207 kernel: [35819.615876] direct_page_fault+0x206/0x310 [kvm] Aug 22 15:20:45 juju-e4d256-prod-github-runner-207 kernel: [35819.616731] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 15:20:45 juju-e4d256-prod-github-runner-207 kernel: [35819.617604] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 15:20:45 juju-e4d256-prod-github-runner-207 kernel: [35819.618464] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 15:20:45 juju-e4d256-prod-github-runner-207 kernel: [35819.619298] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 15:20:45 juju-e4d256-prod-github-runner-207 kernel: [35819.620086] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 15:20:45 juju-e4d256-prod-github-runner-207 kernel: [35819.620917] handle_exit+0x98/0x230 [kvm_amd] Aug 22 15:20:45 juju-e4d256-prod-github-runner-207 kernel: [35819.621747] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 15:20:45 juju-e4d256-prod-github-runner-207 kernel: [35819.622583] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 15:20:45 juju-e4d256-prod-github-runner-207 kernel: [35819.623415] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 15:20:45 juju-e4d256-prod-github-runner-207 kernel: [35819.624234] vcpu_run+0x62/0x2c0 [kvm] Aug 22 15:20:45 juju-e4d256-prod-github-runner-207 kernel: [35819.625025] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 15:20:45 juju-e4d256-prod-github-runner-207 kernel: [35819.625766] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 15:20:45 juju-e4d256-prod-github-runner-207 kernel: [35819.626572] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 15:20:45 juju-e4d256-prod-github-runner-207 kernel: [35819.627337] ? __seccomp_filter+0x4a/0x4a0 Aug 22 15:20:45 juju-e4d256-prod-github-runner-207 kernel: [35819.628071] ? __fget_files+0x86/0xc0 Aug 22 15:20:45 juju-e4d256-prod-github-runner-207 kernel: [35819.628770] __x64_sys_ioctl+0x95/0xd0 Aug 22 15:20:45 juju-e4d256-prod-github-runner-207 kernel: [35819.629497] do_syscall_64+0x5c/0xc0 Aug 22 15:20:45 juju-e4d256-prod-github-runner-207 kernel: [35819.630183] ? do_futex+0x162/0x1f0 Aug 22 15:20:45 juju-e4d256-prod-github-runner-207 kernel: [35819.630860] ? __x64_sys_futex+0x78/0x1e0 Aug 22 15:20:45 juju-e4d256-prod-github-runner-207 kernel: [35819.631564] ? __secure_computing+0xa9/0x120 Aug 22 15:20:45 juju-e4d256-prod-github-runner-207 kernel: [35819.632283] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 15:20:45 juju-e4d256-prod-github-runner-207 kernel: [35819.633106] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:20:45 juju-e4d256-prod-github-runner-207 kernel: [35819.633886] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:20:45 juju-e4d256-prod-github-runner-207 kernel: [35819.634779] ? do_syscall_64+0x69/0xc0 Aug 22 15:20:45 juju-e4d256-prod-github-runner-207 kernel: [35819.635616] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:20:45 juju-e4d256-prod-github-runner-207 kernel: [35819.636466] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:20:45 juju-e4d256-prod-github-runner-207 kernel: [35819.637355] ? do_syscall_64+0x69/0xc0 Aug 22 15:20:45 juju-e4d256-prod-github-runner-207 kernel: [35819.638138] ? do_syscall_64+0x69/0xc0 Aug 22 15:20:45 juju-e4d256-prod-github-runner-207 kernel: [35819.638920] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 15:20:45 juju-e4d256-prod-github-runner-207 kernel: [35819.639827] RIP: 0033:0x7faa5d0edaff Aug 22 15:20:45 juju-e4d256-prod-github-runner-207 kernel: [35819.640630] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 15:20:45 juju-e4d256-prod-github-runner-207 kernel: [35819.643075] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 15:20:45 juju-e4d256-prod-github-runner-207 kernel: [35819.644257] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 15:20:45 juju-e4d256-prod-github-runner-207 kernel: [35819.645393] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 15:20:45 juju-e4d256-prod-github-runner-207 kernel: [35819.646361] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 15:20:45 juju-e4d256-prod-github-runner-207 kernel: [35819.647323] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 15:20:45 juju-e4d256-prod-github-runner-207 kernel: [35819.648278] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 15:20:45 juju-e4d256-prod-github-runner-207 kernel: [35819.649236] Aug 22 15:21:10 juju-e4d256-prod-github-runner-207 kernel: [35844.541976] watchdog: BUG: soft lockup - CPU#1 stuck for 33274s! [qemu-system-x86:6715] Aug 22 15:21:10 juju-e4d256-prod-github-runner-207 kernel: [35844.543080] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 15:21:10 juju-e4d256-prod-github-runner-207 kernel: [35844.543379] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 15:21:10 juju-e4d256-prod-github-runner-207 kernel: [35844.555571] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 15:21:10 juju-e4d256-prod-github-runner-207 kernel: [35844.556884] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 15:21:10 juju-e4d256-prod-github-runner-207 kernel: [35844.558107] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:21:10 juju-e4d256-prod-github-runner-207 kernel: [35844.559166] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 15:21:10 juju-e4d256-prod-github-runner-207 kernel: [35844.561739] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 15:21:10 juju-e4d256-prod-github-runner-207 kernel: [35844.562782] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 15:21:10 juju-e4d256-prod-github-runner-207 kernel: [35844.563944] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 15:21:10 juju-e4d256-prod-github-runner-207 kernel: [35844.565118] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 15:21:10 juju-e4d256-prod-github-runner-207 kernel: [35844.566273] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 15:21:10 juju-e4d256-prod-github-runner-207 kernel: [35844.567436] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 15:21:10 juju-e4d256-prod-github-runner-207 kernel: [35844.568599] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 15:21:10 juju-e4d256-prod-github-runner-207 kernel: [35844.569841] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 15:21:10 juju-e4d256-prod-github-runner-207 kernel: [35844.570936] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 15:21:10 juju-e4d256-prod-github-runner-207 kernel: [35844.572136] Call Trace: Aug 22 15:21:10 juju-e4d256-prod-github-runner-207 kernel: [35844.573066] Aug 22 15:21:10 juju-e4d256-prod-github-runner-207 kernel: [35844.573947] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:21:10 juju-e4d256-prod-github-runner-207 kernel: [35844.574973] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:21:10 juju-e4d256-prod-github-runner-207 kernel: [35844.576005] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:21:10 juju-e4d256-prod-github-runner-207 kernel: [35844.577097] ? show_regs.part.0+0x23/0x29 Aug 22 15:21:10 juju-e4d256-prod-github-runner-207 kernel: [35844.578113] ? show_regs.cold+0x8/0xd Aug 22 15:21:10 juju-e4d256-prod-github-runner-207 kernel: [35844.579084] ? watchdog_timer_fn+0x1be/0x220 Aug 22 15:21:10 juju-e4d256-prod-github-runner-207 kernel: [35844.580089] ? lockup_detector_update_enable+0x60/0x60 Aug 22 15:21:10 juju-e4d256-prod-github-runner-207 kernel: [35844.581170] ? __hrtimer_run_queues+0x107/0x230 Aug 22 15:21:10 juju-e4d256-prod-github-runner-207 kernel: [35844.582198] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 15:21:10 juju-e4d256-prod-github-runner-207 kernel: [35844.583219] ? hrtimer_interrupt+0x101/0x220 Aug 22 15:21:10 juju-e4d256-prod-github-runner-207 kernel: [35844.584233] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 15:21:10 juju-e4d256-prod-github-runner-207 kernel: [35844.585305] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 15:21:10 juju-e4d256-prod-github-runner-207 kernel: [35844.586348] Aug 22 15:21:10 juju-e4d256-prod-github-runner-207 kernel: [35844.587199] Aug 22 15:21:10 juju-e4d256-prod-github-runner-207 kernel: [35844.588034] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 15:21:10 juju-e4d256-prod-github-runner-207 kernel: [35844.589091] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:21:10 juju-e4d256-prod-github-runner-207 kernel: [35844.590136] ? _raw_spin_lock+0x22/0x30 Aug 22 15:21:10 juju-e4d256-prod-github-runner-207 kernel: [35844.591089] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:21:10 juju-e4d256-prod-github-runner-207 kernel: [35844.592124] direct_page_fault+0x206/0x310 [kvm] Aug 22 15:21:10 juju-e4d256-prod-github-runner-207 kernel: [35844.593185] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 15:21:10 juju-e4d256-prod-github-runner-207 kernel: [35844.594327] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 15:21:10 juju-e4d256-prod-github-runner-207 kernel: [35844.595328] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 15:21:10 juju-e4d256-prod-github-runner-207 kernel: [35844.596299] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 15:21:10 juju-e4d256-prod-github-runner-207 kernel: [35844.597262] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 15:21:10 juju-e4d256-prod-github-runner-207 kernel: [35844.598275] handle_exit+0x98/0x230 [kvm_amd] Aug 22 15:21:10 juju-e4d256-prod-github-runner-207 kernel: [35844.599230] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 15:21:10 juju-e4d256-prod-github-runner-207 kernel: [35844.600187] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 15:21:10 juju-e4d256-prod-github-runner-207 kernel: [35844.601139] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 15:21:10 juju-e4d256-prod-github-runner-207 kernel: [35844.602059] vcpu_run+0x62/0x2c0 [kvm] Aug 22 15:21:10 juju-e4d256-prod-github-runner-207 kernel: [35844.602881] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 15:21:10 juju-e4d256-prod-github-runner-207 kernel: [35844.603712] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 15:21:10 juju-e4d256-prod-github-runner-207 kernel: [35844.604779] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 15:21:10 juju-e4d256-prod-github-runner-207 kernel: [35844.605578] ? __seccomp_filter+0x4a/0x4a0 Aug 22 15:21:10 juju-e4d256-prod-github-runner-207 kernel: [35844.606320] ? __fget_files+0x86/0xc0 Aug 22 15:21:10 juju-e4d256-prod-github-runner-207 kernel: [35844.607022] __x64_sys_ioctl+0x95/0xd0 Aug 22 15:21:10 juju-e4d256-prod-github-runner-207 kernel: [35844.607715] do_syscall_64+0x5c/0xc0 Aug 22 15:21:10 juju-e4d256-prod-github-runner-207 kernel: [35844.608424] ? do_futex+0x162/0x1f0 Aug 22 15:21:10 juju-e4d256-prod-github-runner-207 kernel: [35844.609171] ? __x64_sys_futex+0x78/0x1e0 Aug 22 15:21:10 juju-e4d256-prod-github-runner-207 kernel: [35844.609860] ? __secure_computing+0xa9/0x120 Aug 22 15:21:10 juju-e4d256-prod-github-runner-207 kernel: [35844.610561] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 15:21:10 juju-e4d256-prod-github-runner-207 kernel: [35844.611340] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:21:10 juju-e4d256-prod-github-runner-207 kernel: [35844.612065] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:21:10 juju-e4d256-prod-github-runner-207 kernel: [35844.612804] ? do_syscall_64+0x69/0xc0 Aug 22 15:21:10 juju-e4d256-prod-github-runner-207 kernel: [35844.613456] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:21:10 juju-e4d256-prod-github-runner-207 kernel: [35844.614163] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:21:10 juju-e4d256-prod-github-runner-207 kernel: [35844.614873] ? do_syscall_64+0x69/0xc0 Aug 22 15:21:10 juju-e4d256-prod-github-runner-207 kernel: [35844.615514] ? do_syscall_64+0x69/0xc0 Aug 22 15:21:10 juju-e4d256-prod-github-runner-207 kernel: [35844.616163] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 15:21:10 juju-e4d256-prod-github-runner-207 kernel: [35844.616912] RIP: 0033:0x7faa5d0edaff Aug 22 15:21:10 juju-e4d256-prod-github-runner-207 kernel: [35844.617575] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 15:21:10 juju-e4d256-prod-github-runner-207 kernel: [35844.619776] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 15:21:10 juju-e4d256-prod-github-runner-207 kernel: [35844.620703] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 15:21:10 juju-e4d256-prod-github-runner-207 kernel: [35844.621599] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 15:21:10 juju-e4d256-prod-github-runner-207 kernel: [35844.622526] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 15:21:10 juju-e4d256-prod-github-runner-207 kernel: [35844.623681] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 15:21:10 juju-e4d256-prod-github-runner-207 kernel: [35844.624652] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 15:21:10 juju-e4d256-prod-github-runner-207 kernel: [35844.625589] Aug 22 15:21:38 juju-e4d256-prod-github-runner-207 kernel: [35872.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 33300s! [qemu-system-x86:6715] Aug 22 15:21:38 juju-e4d256-prod-github-runner-207 kernel: [35872.543120] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 15:21:38 juju-e4d256-prod-github-runner-207 kernel: [35872.543198] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 15:21:38 juju-e4d256-prod-github-runner-207 kernel: [35872.555457] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 15:21:38 juju-e4d256-prod-github-runner-207 kernel: [35872.556728] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 15:21:38 juju-e4d256-prod-github-runner-207 kernel: [35872.557946] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:21:38 juju-e4d256-prod-github-runner-207 kernel: [35872.559004] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 15:21:38 juju-e4d256-prod-github-runner-207 kernel: [35872.561554] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 15:21:38 juju-e4d256-prod-github-runner-207 kernel: [35872.562596] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 15:21:38 juju-e4d256-prod-github-runner-207 kernel: [35872.563802] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 15:21:38 juju-e4d256-prod-github-runner-207 kernel: [35872.564976] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 15:21:38 juju-e4d256-prod-github-runner-207 kernel: [35872.566136] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 15:21:38 juju-e4d256-prod-github-runner-207 kernel: [35872.567300] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 15:21:38 juju-e4d256-prod-github-runner-207 kernel: [35872.568474] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 15:21:38 juju-e4d256-prod-github-runner-207 kernel: [35872.569714] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 15:21:38 juju-e4d256-prod-github-runner-207 kernel: [35872.570809] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 15:21:38 juju-e4d256-prod-github-runner-207 kernel: [35872.571999] Call Trace: Aug 22 15:21:38 juju-e4d256-prod-github-runner-207 kernel: [35872.572924] Aug 22 15:21:38 juju-e4d256-prod-github-runner-207 kernel: [35872.573807] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:21:38 juju-e4d256-prod-github-runner-207 kernel: [35872.574836] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:21:38 juju-e4d256-prod-github-runner-207 kernel: [35872.575860] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:21:38 juju-e4d256-prod-github-runner-207 kernel: [35872.576945] ? show_regs.part.0+0x23/0x29 Aug 22 15:21:38 juju-e4d256-prod-github-runner-207 kernel: [35872.577946] ? show_regs.cold+0x8/0xd Aug 22 15:21:38 juju-e4d256-prod-github-runner-207 kernel: [35872.578940] ? watchdog_timer_fn+0x1be/0x220 Aug 22 15:21:38 juju-e4d256-prod-github-runner-207 kernel: [35872.579951] ? lockup_detector_update_enable+0x60/0x60 Aug 22 15:21:38 juju-e4d256-prod-github-runner-207 kernel: [35872.581020] ? __hrtimer_run_queues+0x107/0x230 Aug 22 15:21:38 juju-e4d256-prod-github-runner-207 kernel: [35872.582073] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 15:21:38 juju-e4d256-prod-github-runner-207 kernel: [35872.583096] ? hrtimer_interrupt+0x101/0x220 Aug 22 15:21:38 juju-e4d256-prod-github-runner-207 kernel: [35872.584109] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 15:21:38 juju-e4d256-prod-github-runner-207 kernel: [35872.585184] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 15:21:38 juju-e4d256-prod-github-runner-207 kernel: [35872.586233] Aug 22 15:21:38 juju-e4d256-prod-github-runner-207 kernel: [35872.587082] Aug 22 15:21:38 juju-e4d256-prod-github-runner-207 kernel: [35872.587916] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 15:21:38 juju-e4d256-prod-github-runner-207 kernel: [35872.588953] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:21:38 juju-e4d256-prod-github-runner-207 kernel: [35872.589990] ? _raw_spin_lock+0x22/0x30 Aug 22 15:21:38 juju-e4d256-prod-github-runner-207 kernel: [35872.590933] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:21:38 juju-e4d256-prod-github-runner-207 kernel: [35872.591954] direct_page_fault+0x206/0x310 [kvm] Aug 22 15:21:38 juju-e4d256-prod-github-runner-207 kernel: [35872.592991] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 15:21:38 juju-e4d256-prod-github-runner-207 kernel: [35872.594012] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 15:21:38 juju-e4d256-prod-github-runner-207 kernel: [35872.595013] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 15:21:38 juju-e4d256-prod-github-runner-207 kernel: [35872.595979] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 15:21:38 juju-e4d256-prod-github-runner-207 kernel: [35872.596930] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 15:21:38 juju-e4d256-prod-github-runner-207 kernel: [35872.597907] handle_exit+0x98/0x230 [kvm_amd] Aug 22 15:21:38 juju-e4d256-prod-github-runner-207 kernel: [35872.598801] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 15:21:38 juju-e4d256-prod-github-runner-207 kernel: [35872.599711] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 15:21:38 juju-e4d256-prod-github-runner-207 kernel: [35872.600642] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 15:21:38 juju-e4d256-prod-github-runner-207 kernel: [35872.601541] vcpu_run+0x62/0x2c0 [kvm] Aug 22 15:21:38 juju-e4d256-prod-github-runner-207 kernel: [35872.602352] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 15:21:38 juju-e4d256-prod-github-runner-207 kernel: [35872.603155] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 15:21:38 juju-e4d256-prod-github-runner-207 kernel: [35872.604004] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 15:21:38 juju-e4d256-prod-github-runner-207 kernel: [35872.604881] ? __seccomp_filter+0x4a/0x4a0 Aug 22 15:21:38 juju-e4d256-prod-github-runner-207 kernel: [35872.605627] ? __fget_files+0x86/0xc0 Aug 22 15:21:38 juju-e4d256-prod-github-runner-207 kernel: [35872.606328] __x64_sys_ioctl+0x95/0xd0 Aug 22 15:21:38 juju-e4d256-prod-github-runner-207 kernel: [35872.607017] do_syscall_64+0x5c/0xc0 Aug 22 15:21:38 juju-e4d256-prod-github-runner-207 kernel: [35872.607680] ? do_futex+0x162/0x1f0 Aug 22 15:21:38 juju-e4d256-prod-github-runner-207 kernel: [35872.608336] ? __x64_sys_futex+0x78/0x1e0 Aug 22 15:21:38 juju-e4d256-prod-github-runner-207 kernel: [35872.609006] ? __secure_computing+0xa9/0x120 Aug 22 15:21:38 juju-e4d256-prod-github-runner-207 kernel: [35872.609694] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 15:21:38 juju-e4d256-prod-github-runner-207 kernel: [35872.610455] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:21:38 juju-e4d256-prod-github-runner-207 kernel: [35872.611173] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:21:38 juju-e4d256-prod-github-runner-207 kernel: [35872.611886] ? do_syscall_64+0x69/0xc0 Aug 22 15:21:38 juju-e4d256-prod-github-runner-207 kernel: [35872.612536] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:21:38 juju-e4d256-prod-github-runner-207 kernel: [35872.613236] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:21:38 juju-e4d256-prod-github-runner-207 kernel: [35872.613942] ? do_syscall_64+0x69/0xc0 Aug 22 15:21:38 juju-e4d256-prod-github-runner-207 kernel: [35872.614581] ? do_syscall_64+0x69/0xc0 Aug 22 15:21:38 juju-e4d256-prod-github-runner-207 kernel: [35872.615207] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 15:21:38 juju-e4d256-prod-github-runner-207 kernel: [35872.615923] RIP: 0033:0x7faa5d0edaff Aug 22 15:21:38 juju-e4d256-prod-github-runner-207 kernel: [35872.616580] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 15:21:38 juju-e4d256-prod-github-runner-207 kernel: [35872.618555] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 15:21:38 juju-e4d256-prod-github-runner-207 kernel: [35872.619460] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 15:21:38 juju-e4d256-prod-github-runner-207 kernel: [35872.620373] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 15:21:38 juju-e4d256-prod-github-runner-207 kernel: [35872.621305] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 15:21:38 juju-e4d256-prod-github-runner-207 kernel: [35872.622194] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 15:21:38 juju-e4d256-prod-github-runner-207 kernel: [35872.623083] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 15:21:38 juju-e4d256-prod-github-runner-207 kernel: [35872.623971] Aug 22 15:22:06 juju-e4d256-prod-github-runner-207 kernel: [35900.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 33326s! [qemu-system-x86:6715] Aug 22 15:22:06 juju-e4d256-prod-github-runner-207 kernel: [35900.543238] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 15:22:06 juju-e4d256-prod-github-runner-207 kernel: [35900.543524] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 15:22:06 juju-e4d256-prod-github-runner-207 kernel: [35900.555651] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 15:22:06 juju-e4d256-prod-github-runner-207 kernel: [35900.556934] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 15:22:06 juju-e4d256-prod-github-runner-207 kernel: [35900.558154] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:22:06 juju-e4d256-prod-github-runner-207 kernel: [35900.559216] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 15:22:06 juju-e4d256-prod-github-runner-207 kernel: [35900.561771] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 15:22:06 juju-e4d256-prod-github-runner-207 kernel: [35900.562809] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 15:22:06 juju-e4d256-prod-github-runner-207 kernel: [35900.563974] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 15:22:06 juju-e4d256-prod-github-runner-207 kernel: [35900.565137] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 15:22:06 juju-e4d256-prod-github-runner-207 kernel: [35900.566320] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 15:22:06 juju-e4d256-prod-github-runner-207 kernel: [35900.567479] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 15:22:06 juju-e4d256-prod-github-runner-207 kernel: [35900.568655] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 15:22:06 juju-e4d256-prod-github-runner-207 kernel: [35900.569889] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 15:22:06 juju-e4d256-prod-github-runner-207 kernel: [35900.570985] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 15:22:06 juju-e4d256-prod-github-runner-207 kernel: [35900.572187] Call Trace: Aug 22 15:22:06 juju-e4d256-prod-github-runner-207 kernel: [35900.573098] Aug 22 15:22:06 juju-e4d256-prod-github-runner-207 kernel: [35900.573998] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:22:06 juju-e4d256-prod-github-runner-207 kernel: [35900.575025] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:22:06 juju-e4d256-prod-github-runner-207 kernel: [35900.576061] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:22:06 juju-e4d256-prod-github-runner-207 kernel: [35900.577156] ? show_regs.part.0+0x23/0x29 Aug 22 15:22:06 juju-e4d256-prod-github-runner-207 kernel: [35900.578150] ? show_regs.cold+0x8/0xd Aug 22 15:22:06 juju-e4d256-prod-github-runner-207 kernel: [35900.579119] ? watchdog_timer_fn+0x1be/0x220 Aug 22 15:22:06 juju-e4d256-prod-github-runner-207 kernel: [35900.580173] ? lockup_detector_update_enable+0x60/0x60 Aug 22 15:22:06 juju-e4d256-prod-github-runner-207 kernel: [35900.581240] ? __hrtimer_run_queues+0x107/0x230 Aug 22 15:22:06 juju-e4d256-prod-github-runner-207 kernel: [35900.582378] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 15:22:06 juju-e4d256-prod-github-runner-207 kernel: [35900.583400] ? hrtimer_interrupt+0x101/0x220 Aug 22 15:22:06 juju-e4d256-prod-github-runner-207 kernel: [35900.584432] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 15:22:06 juju-e4d256-prod-github-runner-207 kernel: [35900.585501] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 15:22:06 juju-e4d256-prod-github-runner-207 kernel: [35900.586546] Aug 22 15:22:06 juju-e4d256-prod-github-runner-207 kernel: [35900.587397] Aug 22 15:22:06 juju-e4d256-prod-github-runner-207 kernel: [35900.588251] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 15:22:06 juju-e4d256-prod-github-runner-207 kernel: [35900.589282] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:22:06 juju-e4d256-prod-github-runner-207 kernel: [35900.590322] ? _raw_spin_lock+0x22/0x30 Aug 22 15:22:06 juju-e4d256-prod-github-runner-207 kernel: [35900.591265] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:22:06 juju-e4d256-prod-github-runner-207 kernel: [35900.592325] direct_page_fault+0x206/0x310 [kvm] Aug 22 15:22:06 juju-e4d256-prod-github-runner-207 kernel: [35900.593354] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 15:22:06 juju-e4d256-prod-github-runner-207 kernel: [35900.594367] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 15:22:06 juju-e4d256-prod-github-runner-207 kernel: [35900.595367] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 15:22:06 juju-e4d256-prod-github-runner-207 kernel: [35900.596375] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 15:22:06 juju-e4d256-prod-github-runner-207 kernel: [35900.597331] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 15:22:06 juju-e4d256-prod-github-runner-207 kernel: [35900.598309] handle_exit+0x98/0x230 [kvm_amd] Aug 22 15:22:06 juju-e4d256-prod-github-runner-207 kernel: [35900.599201] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 15:22:06 juju-e4d256-prod-github-runner-207 kernel: [35900.600132] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 15:22:06 juju-e4d256-prod-github-runner-207 kernel: [35900.601056] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 15:22:06 juju-e4d256-prod-github-runner-207 kernel: [35900.601958] vcpu_run+0x62/0x2c0 [kvm] Aug 22 15:22:06 juju-e4d256-prod-github-runner-207 kernel: [35900.602771] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 15:22:06 juju-e4d256-prod-github-runner-207 kernel: [35900.603622] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 15:22:06 juju-e4d256-prod-github-runner-207 kernel: [35900.604503] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 15:22:06 juju-e4d256-prod-github-runner-207 kernel: [35900.605307] ? __seccomp_filter+0x4a/0x4a0 Aug 22 15:22:06 juju-e4d256-prod-github-runner-207 kernel: [35900.606052] ? __fget_files+0x86/0xc0 Aug 22 15:22:06 juju-e4d256-prod-github-runner-207 kernel: [35900.606756] __x64_sys_ioctl+0x95/0xd0 Aug 22 15:22:06 juju-e4d256-prod-github-runner-207 kernel: [35900.607461] do_syscall_64+0x5c/0xc0 Aug 22 15:22:06 juju-e4d256-prod-github-runner-207 kernel: [35900.608154] ? do_futex+0x162/0x1f0 Aug 22 15:22:06 juju-e4d256-prod-github-runner-207 kernel: [35900.608814] ? __x64_sys_futex+0x78/0x1e0 Aug 22 15:22:06 juju-e4d256-prod-github-runner-207 kernel: [35900.609489] ? __secure_computing+0xa9/0x120 Aug 22 15:22:06 juju-e4d256-prod-github-runner-207 kernel: [35900.610187] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 15:22:06 juju-e4d256-prod-github-runner-207 kernel: [35900.610954] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:22:06 juju-e4d256-prod-github-runner-207 kernel: [35900.611677] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:22:06 juju-e4d256-prod-github-runner-207 kernel: [35900.612419] ? do_syscall_64+0x69/0xc0 Aug 22 15:22:06 juju-e4d256-prod-github-runner-207 kernel: [35900.613067] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:22:06 juju-e4d256-prod-github-runner-207 kernel: [35900.613772] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:22:06 juju-e4d256-prod-github-runner-207 kernel: [35900.614467] ? do_syscall_64+0x69/0xc0 Aug 22 15:22:06 juju-e4d256-prod-github-runner-207 kernel: [35900.615114] ? do_syscall_64+0x69/0xc0 Aug 22 15:22:06 juju-e4d256-prod-github-runner-207 kernel: [35900.615765] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 15:22:06 juju-e4d256-prod-github-runner-207 kernel: [35900.616510] RIP: 0033:0x7faa5d0edaff Aug 22 15:22:06 juju-e4d256-prod-github-runner-207 kernel: [35900.617174] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 15:22:06 juju-e4d256-prod-github-runner-207 kernel: [35900.619177] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 15:22:06 juju-e4d256-prod-github-runner-207 kernel: [35900.620109] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 15:22:06 juju-e4d256-prod-github-runner-207 kernel: [35900.621036] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 15:22:06 juju-e4d256-prod-github-runner-207 kernel: [35900.621926] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 15:22:06 juju-e4d256-prod-github-runner-207 kernel: [35900.622812] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 15:22:06 juju-e4d256-prod-github-runner-207 kernel: [35900.623704] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 15:22:06 juju-e4d256-prod-github-runner-207 kernel: [35900.624618] Aug 22 15:22:34 juju-e4d256-prod-github-runner-207 kernel: [35928.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 33353s! [qemu-system-x86:6715] Aug 22 15:22:34 juju-e4d256-prod-github-runner-207 kernel: [35928.543840] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 15:22:34 juju-e4d256-prod-github-runner-207 kernel: [35928.544021] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 15:22:34 juju-e4d256-prod-github-runner-207 kernel: [35928.556342] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 15:22:34 juju-e4d256-prod-github-runner-207 kernel: [35928.557606] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 15:22:34 juju-e4d256-prod-github-runner-207 kernel: [35928.558821] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:22:34 juju-e4d256-prod-github-runner-207 kernel: [35928.559889] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 15:22:34 juju-e4d256-prod-github-runner-207 kernel: [35928.562429] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 15:22:34 juju-e4d256-prod-github-runner-207 kernel: [35928.563501] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 15:22:34 juju-e4d256-prod-github-runner-207 kernel: [35928.564672] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 15:22:34 juju-e4d256-prod-github-runner-207 kernel: [35928.565833] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 15:22:34 juju-e4d256-prod-github-runner-207 kernel: [35928.566990] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 15:22:34 juju-e4d256-prod-github-runner-207 kernel: [35928.568153] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 15:22:34 juju-e4d256-prod-github-runner-207 kernel: [35928.569316] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 15:22:34 juju-e4d256-prod-github-runner-207 kernel: [35928.570545] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 15:22:34 juju-e4d256-prod-github-runner-207 kernel: [35928.571645] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 15:22:34 juju-e4d256-prod-github-runner-207 kernel: [35928.572843] Call Trace: Aug 22 15:22:34 juju-e4d256-prod-github-runner-207 kernel: [35928.573751] Aug 22 15:22:34 juju-e4d256-prod-github-runner-207 kernel: [35928.574632] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:22:34 juju-e4d256-prod-github-runner-207 kernel: [35928.575685] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:22:34 juju-e4d256-prod-github-runner-207 kernel: [35928.576705] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:22:34 juju-e4d256-prod-github-runner-207 kernel: [35928.577783] ? show_regs.part.0+0x23/0x29 Aug 22 15:22:34 juju-e4d256-prod-github-runner-207 kernel: [35928.578777] ? show_regs.cold+0x8/0xd Aug 22 15:22:34 juju-e4d256-prod-github-runner-207 kernel: [35928.579751] ? watchdog_timer_fn+0x1be/0x220 Aug 22 15:22:34 juju-e4d256-prod-github-runner-207 kernel: [35928.580758] ? lockup_detector_update_enable+0x60/0x60 Aug 22 15:22:34 juju-e4d256-prod-github-runner-207 kernel: [35928.581875] ? __hrtimer_run_queues+0x107/0x230 Aug 22 15:22:34 juju-e4d256-prod-github-runner-207 kernel: [35928.583415] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 15:22:34 juju-e4d256-prod-github-runner-207 kernel: [35928.584459] ? hrtimer_interrupt+0x101/0x220 Aug 22 15:22:34 juju-e4d256-prod-github-runner-207 kernel: [35928.585474] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 15:22:34 juju-e4d256-prod-github-runner-207 kernel: [35928.586892] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 15:22:34 juju-e4d256-prod-github-runner-207 kernel: [35928.587959] Aug 22 15:22:34 juju-e4d256-prod-github-runner-207 kernel: [35928.588823] Aug 22 15:22:34 juju-e4d256-prod-github-runner-207 kernel: [35928.589682] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 15:22:34 juju-e4d256-prod-github-runner-207 kernel: [35928.590773] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:22:34 juju-e4d256-prod-github-runner-207 kernel: [35928.591932] ? _raw_spin_lock+0x22/0x30 Aug 22 15:22:34 juju-e4d256-prod-github-runner-207 kernel: [35928.592969] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:22:34 juju-e4d256-prod-github-runner-207 kernel: [35928.594580] direct_page_fault+0x206/0x310 [kvm] Aug 22 15:22:34 juju-e4d256-prod-github-runner-207 kernel: [35928.595641] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 15:22:34 juju-e4d256-prod-github-runner-207 kernel: [35928.596836] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 15:22:34 juju-e4d256-prod-github-runner-207 kernel: [35928.597939] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 15:22:34 juju-e4d256-prod-github-runner-207 kernel: [35928.599039] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 15:22:34 juju-e4d256-prod-github-runner-207 kernel: [35928.600044] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 15:22:34 juju-e4d256-prod-github-runner-207 kernel: [35928.601067] handle_exit+0x98/0x230 [kvm_amd] Aug 22 15:22:34 juju-e4d256-prod-github-runner-207 kernel: [35928.601975] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 15:22:34 juju-e4d256-prod-github-runner-207 kernel: [35928.602899] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 15:22:34 juju-e4d256-prod-github-runner-207 kernel: [35928.603852] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 15:22:34 juju-e4d256-prod-github-runner-207 kernel: [35928.604756] vcpu_run+0x62/0x2c0 [kvm] Aug 22 15:22:34 juju-e4d256-prod-github-runner-207 kernel: [35928.605583] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 15:22:34 juju-e4d256-prod-github-runner-207 kernel: [35928.606421] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 15:22:34 juju-e4d256-prod-github-runner-207 kernel: [35928.607281] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 15:22:34 juju-e4d256-prod-github-runner-207 kernel: [35928.608094] ? __seccomp_filter+0x4a/0x4a0 Aug 22 15:22:34 juju-e4d256-prod-github-runner-207 kernel: [35928.608839] ? __fget_files+0x86/0xc0 Aug 22 15:22:34 juju-e4d256-prod-github-runner-207 kernel: [35928.609544] __x64_sys_ioctl+0x95/0xd0 Aug 22 15:22:34 juju-e4d256-prod-github-runner-207 kernel: [35928.610236] do_syscall_64+0x5c/0xc0 Aug 22 15:22:34 juju-e4d256-prod-github-runner-207 kernel: [35928.610900] ? do_futex+0x162/0x1f0 Aug 22 15:22:34 juju-e4d256-prod-github-runner-207 kernel: [35928.611550] ? __x64_sys_futex+0x78/0x1e0 Aug 22 15:22:34 juju-e4d256-prod-github-runner-207 kernel: [35928.612235] ? __secure_computing+0xa9/0x120 Aug 22 15:22:34 juju-e4d256-prod-github-runner-207 kernel: [35928.612939] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 15:22:34 juju-e4d256-prod-github-runner-207 kernel: [35928.613710] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:22:34 juju-e4d256-prod-github-runner-207 kernel: [35928.614433] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:22:34 juju-e4d256-prod-github-runner-207 kernel: [35928.615150] ? do_syscall_64+0x69/0xc0 Aug 22 15:22:34 juju-e4d256-prod-github-runner-207 kernel: [35928.615810] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:22:34 juju-e4d256-prod-github-runner-207 kernel: [35928.616513] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:22:34 juju-e4d256-prod-github-runner-207 kernel: [35928.617217] ? do_syscall_64+0x69/0xc0 Aug 22 15:22:34 juju-e4d256-prod-github-runner-207 kernel: [35928.617843] ? do_syscall_64+0x69/0xc0 Aug 22 15:22:34 juju-e4d256-prod-github-runner-207 kernel: [35928.618713] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 15:22:34 juju-e4d256-prod-github-runner-207 kernel: [35928.619418] RIP: 0033:0x7faa5d0edaff Aug 22 15:22:34 juju-e4d256-prod-github-runner-207 kernel: [35928.620066] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 15:22:34 juju-e4d256-prod-github-runner-207 kernel: [35928.622049] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 15:22:34 juju-e4d256-prod-github-runner-207 kernel: [35928.622967] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 15:22:34 juju-e4d256-prod-github-runner-207 kernel: [35928.623878] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 15:22:34 juju-e4d256-prod-github-runner-207 kernel: [35928.624767] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 15:22:34 juju-e4d256-prod-github-runner-207 kernel: [35928.625660] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 15:22:34 juju-e4d256-prod-github-runner-207 kernel: [35928.626554] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 15:22:34 juju-e4d256-prod-github-runner-207 kernel: [35928.627450] Aug 22 15:23:02 juju-e4d256-prod-github-runner-207 kernel: [35956.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 33379s! [qemu-system-x86:6715] Aug 22 15:23:02 juju-e4d256-prod-github-runner-207 kernel: [35956.543168] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 15:23:02 juju-e4d256-prod-github-runner-207 kernel: [35956.543244] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 15:23:02 juju-e4d256-prod-github-runner-207 kernel: [35956.555726] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 15:23:02 juju-e4d256-prod-github-runner-207 kernel: [35956.556999] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 15:23:02 juju-e4d256-prod-github-runner-207 kernel: [35956.558221] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:23:02 juju-e4d256-prod-github-runner-207 kernel: [35956.559295] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 15:23:02 juju-e4d256-prod-github-runner-207 kernel: [35956.561868] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 15:23:02 juju-e4d256-prod-github-runner-207 kernel: [35956.562924] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 15:23:02 juju-e4d256-prod-github-runner-207 kernel: [35956.564104] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 15:23:02 juju-e4d256-prod-github-runner-207 kernel: [35956.565263] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 15:23:02 juju-e4d256-prod-github-runner-207 kernel: [35956.566426] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 15:23:02 juju-e4d256-prod-github-runner-207 kernel: [35956.567600] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 15:23:02 juju-e4d256-prod-github-runner-207 kernel: [35956.568772] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 15:23:02 juju-e4d256-prod-github-runner-207 kernel: [35956.570003] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 15:23:02 juju-e4d256-prod-github-runner-207 kernel: [35956.571100] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 15:23:02 juju-e4d256-prod-github-runner-207 kernel: [35956.572301] Call Trace: Aug 22 15:23:02 juju-e4d256-prod-github-runner-207 kernel: [35956.573217] Aug 22 15:23:02 juju-e4d256-prod-github-runner-207 kernel: [35956.574103] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:23:02 juju-e4d256-prod-github-runner-207 kernel: [35956.575151] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:23:02 juju-e4d256-prod-github-runner-207 kernel: [35956.576186] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:23:02 juju-e4d256-prod-github-runner-207 kernel: [35956.577262] ? show_regs.part.0+0x23/0x29 Aug 22 15:23:02 juju-e4d256-prod-github-runner-207 kernel: [35956.578275] ? show_regs.cold+0x8/0xd Aug 22 15:23:02 juju-e4d256-prod-github-runner-207 kernel: [35956.579245] ? watchdog_timer_fn+0x1be/0x220 Aug 22 15:23:02 juju-e4d256-prod-github-runner-207 kernel: [35956.580274] ? lockup_detector_update_enable+0x60/0x60 Aug 22 15:23:02 juju-e4d256-prod-github-runner-207 kernel: [35956.581336] ? __hrtimer_run_queues+0x107/0x230 Aug 22 15:23:02 juju-e4d256-prod-github-runner-207 kernel: [35956.582362] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 15:23:02 juju-e4d256-prod-github-runner-207 kernel: [35956.583401] ? hrtimer_interrupt+0x101/0x220 Aug 22 15:23:02 juju-e4d256-prod-github-runner-207 kernel: [35956.584414] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 15:23:02 juju-e4d256-prod-github-runner-207 kernel: [35956.585483] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 15:23:02 juju-e4d256-prod-github-runner-207 kernel: [35956.586526] Aug 22 15:23:02 juju-e4d256-prod-github-runner-207 kernel: [35956.587394] Aug 22 15:23:02 juju-e4d256-prod-github-runner-207 kernel: [35956.588300] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 15:23:02 juju-e4d256-prod-github-runner-207 kernel: [35956.589351] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:23:02 juju-e4d256-prod-github-runner-207 kernel: [35956.590392] ? _raw_spin_lock+0x22/0x30 Aug 22 15:23:02 juju-e4d256-prod-github-runner-207 kernel: [35956.591359] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:23:02 juju-e4d256-prod-github-runner-207 kernel: [35956.592398] direct_page_fault+0x206/0x310 [kvm] Aug 22 15:23:02 juju-e4d256-prod-github-runner-207 kernel: [35956.593425] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 15:23:02 juju-e4d256-prod-github-runner-207 kernel: [35956.594498] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 15:23:02 juju-e4d256-prod-github-runner-207 kernel: [35956.595530] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 15:23:02 juju-e4d256-prod-github-runner-207 kernel: [35956.596502] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 15:23:02 juju-e4d256-prod-github-runner-207 kernel: [35956.597453] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 15:23:02 juju-e4d256-prod-github-runner-207 kernel: [35956.598436] handle_exit+0x98/0x230 [kvm_amd] Aug 22 15:23:02 juju-e4d256-prod-github-runner-207 kernel: [35956.599353] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 15:23:02 juju-e4d256-prod-github-runner-207 kernel: [35956.600269] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 15:23:02 juju-e4d256-prod-github-runner-207 kernel: [35956.601196] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 15:23:02 juju-e4d256-prod-github-runner-207 kernel: [35956.602099] vcpu_run+0x62/0x2c0 [kvm] Aug 22 15:23:02 juju-e4d256-prod-github-runner-207 kernel: [35956.602915] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 15:23:02 juju-e4d256-prod-github-runner-207 kernel: [35956.603733] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 15:23:02 juju-e4d256-prod-github-runner-207 kernel: [35956.604599] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 15:23:02 juju-e4d256-prod-github-runner-207 kernel: [35956.605399] ? __seccomp_filter+0x4a/0x4a0 Aug 22 15:23:02 juju-e4d256-prod-github-runner-207 kernel: [35956.606147] ? __fget_files+0x86/0xc0 Aug 22 15:23:02 juju-e4d256-prod-github-runner-207 kernel: [35956.606849] __x64_sys_ioctl+0x95/0xd0 Aug 22 15:23:02 juju-e4d256-prod-github-runner-207 kernel: [35956.607556] do_syscall_64+0x5c/0xc0 Aug 22 15:23:02 juju-e4d256-prod-github-runner-207 kernel: [35956.608224] ? do_futex+0x162/0x1f0 Aug 22 15:23:02 juju-e4d256-prod-github-runner-207 kernel: [35956.608878] ? __x64_sys_futex+0x78/0x1e0 Aug 22 15:23:02 juju-e4d256-prod-github-runner-207 kernel: [35956.609551] ? __secure_computing+0xa9/0x120 Aug 22 15:23:02 juju-e4d256-prod-github-runner-207 kernel: [35956.610242] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 15:23:02 juju-e4d256-prod-github-runner-207 kernel: [35956.611002] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:23:02 juju-e4d256-prod-github-runner-207 kernel: [35956.611767] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:23:02 juju-e4d256-prod-github-runner-207 kernel: [35956.612486] ? do_syscall_64+0x69/0xc0 Aug 22 15:23:02 juju-e4d256-prod-github-runner-207 kernel: [35956.613136] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:23:02 juju-e4d256-prod-github-runner-207 kernel: [35956.613838] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:23:02 juju-e4d256-prod-github-runner-207 kernel: [35956.614537] ? do_syscall_64+0x69/0xc0 Aug 22 15:23:02 juju-e4d256-prod-github-runner-207 kernel: [35956.615165] ? do_syscall_64+0x69/0xc0 Aug 22 15:23:02 juju-e4d256-prod-github-runner-207 kernel: [35956.615806] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 15:23:02 juju-e4d256-prod-github-runner-207 kernel: [35956.616529] RIP: 0033:0x7faa5d0edaff Aug 22 15:23:02 juju-e4d256-prod-github-runner-207 kernel: [35956.617168] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 15:23:02 juju-e4d256-prod-github-runner-207 kernel: [35956.619187] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 15:23:02 juju-e4d256-prod-github-runner-207 kernel: [35956.620161] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 15:23:02 juju-e4d256-prod-github-runner-207 kernel: [35956.621056] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 15:23:02 juju-e4d256-prod-github-runner-207 kernel: [35956.621956] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 15:23:02 juju-e4d256-prod-github-runner-207 kernel: [35956.622844] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 15:23:02 juju-e4d256-prod-github-runner-207 kernel: [35956.623745] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 15:23:02 juju-e4d256-prod-github-runner-207 kernel: [35956.624643] Aug 22 15:23:30 juju-e4d256-prod-github-runner-207 kernel: [35984.541980] watchdog: BUG: soft lockup - CPU#1 stuck for 33405s! [qemu-system-x86:6715] Aug 22 15:23:30 juju-e4d256-prod-github-runner-207 kernel: [35984.543142] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 15:23:30 juju-e4d256-prod-github-runner-207 kernel: [35984.543216] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 15:23:30 juju-e4d256-prod-github-runner-207 kernel: [35984.555465] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 15:23:30 juju-e4d256-prod-github-runner-207 kernel: [35984.556732] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 15:23:30 juju-e4d256-prod-github-runner-207 kernel: [35984.557952] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:23:30 juju-e4d256-prod-github-runner-207 kernel: [35984.559046] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 15:23:30 juju-e4d256-prod-github-runner-207 kernel: [35984.561596] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 15:23:30 juju-e4d256-prod-github-runner-207 kernel: [35984.562637] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 15:23:30 juju-e4d256-prod-github-runner-207 kernel: [35984.563810] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 15:23:30 juju-e4d256-prod-github-runner-207 kernel: [35984.564966] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 15:23:30 juju-e4d256-prod-github-runner-207 kernel: [35984.566128] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 15:23:30 juju-e4d256-prod-github-runner-207 kernel: [35984.567517] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 15:23:30 juju-e4d256-prod-github-runner-207 kernel: [35984.568682] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 15:23:30 juju-e4d256-prod-github-runner-207 kernel: [35984.569927] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 15:23:30 juju-e4d256-prod-github-runner-207 kernel: [35984.571041] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 15:23:30 juju-e4d256-prod-github-runner-207 kernel: [35984.572238] Call Trace: Aug 22 15:23:30 juju-e4d256-prod-github-runner-207 kernel: [35984.573148] Aug 22 15:23:30 juju-e4d256-prod-github-runner-207 kernel: [35984.574031] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:23:30 juju-e4d256-prod-github-runner-207 kernel: [35984.575073] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:23:30 juju-e4d256-prod-github-runner-207 kernel: [35984.576095] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:23:30 juju-e4d256-prod-github-runner-207 kernel: [35984.577169] ? show_regs.part.0+0x23/0x29 Aug 22 15:23:30 juju-e4d256-prod-github-runner-207 kernel: [35984.578175] ? show_regs.cold+0x8/0xd Aug 22 15:23:30 juju-e4d256-prod-github-runner-207 kernel: [35984.579326] ? watchdog_timer_fn+0x1be/0x220 Aug 22 15:23:30 juju-e4d256-prod-github-runner-207 kernel: [35984.580342] ? lockup_detector_update_enable+0x60/0x60 Aug 22 15:23:30 juju-e4d256-prod-github-runner-207 kernel: [35984.581409] ? __hrtimer_run_queues+0x107/0x230 Aug 22 15:23:30 juju-e4d256-prod-github-runner-207 kernel: [35984.582445] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 15:23:30 juju-e4d256-prod-github-runner-207 kernel: [35984.583507] ? hrtimer_interrupt+0x101/0x220 Aug 22 15:23:30 juju-e4d256-prod-github-runner-207 kernel: [35984.584526] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 15:23:30 juju-e4d256-prod-github-runner-207 kernel: [35984.585597] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 15:23:30 juju-e4d256-prod-github-runner-207 kernel: [35984.586642] Aug 22 15:23:30 juju-e4d256-prod-github-runner-207 kernel: [35984.587510] Aug 22 15:23:30 juju-e4d256-prod-github-runner-207 kernel: [35984.588347] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 15:23:30 juju-e4d256-prod-github-runner-207 kernel: [35984.589384] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:23:30 juju-e4d256-prod-github-runner-207 kernel: [35984.590453] ? _raw_spin_lock+0x22/0x30 Aug 22 15:23:30 juju-e4d256-prod-github-runner-207 kernel: [35984.591464] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:23:30 juju-e4d256-prod-github-runner-207 kernel: [35984.592508] direct_page_fault+0x206/0x310 [kvm] Aug 22 15:23:30 juju-e4d256-prod-github-runner-207 kernel: [35984.593537] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 15:23:30 juju-e4d256-prod-github-runner-207 kernel: [35984.594545] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 15:23:30 juju-e4d256-prod-github-runner-207 kernel: [35984.595559] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 15:23:30 juju-e4d256-prod-github-runner-207 kernel: [35984.596671] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 15:23:30 juju-e4d256-prod-github-runner-207 kernel: [35984.597626] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 15:23:30 juju-e4d256-prod-github-runner-207 kernel: [35984.598611] handle_exit+0x98/0x230 [kvm_amd] Aug 22 15:23:30 juju-e4d256-prod-github-runner-207 kernel: [35984.599535] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 15:23:30 juju-e4d256-prod-github-runner-207 kernel: [35984.600520] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 15:23:30 juju-e4d256-prod-github-runner-207 kernel: [35984.601470] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 15:23:30 juju-e4d256-prod-github-runner-207 kernel: [35984.602388] vcpu_run+0x62/0x2c0 [kvm] Aug 22 15:23:30 juju-e4d256-prod-github-runner-207 kernel: [35984.603230] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 15:23:30 juju-e4d256-prod-github-runner-207 kernel: [35984.604040] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 15:23:30 juju-e4d256-prod-github-runner-207 kernel: [35984.604903] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 15:23:30 juju-e4d256-prod-github-runner-207 kernel: [35984.605702] ? __seccomp_filter+0x4a/0x4a0 Aug 22 15:23:30 juju-e4d256-prod-github-runner-207 kernel: [35984.606447] ? __fget_files+0x86/0xc0 Aug 22 15:23:30 juju-e4d256-prod-github-runner-207 kernel: [35984.607183] __x64_sys_ioctl+0x95/0xd0 Aug 22 15:23:30 juju-e4d256-prod-github-runner-207 kernel: [35984.607877] do_syscall_64+0x5c/0xc0 Aug 22 15:23:30 juju-e4d256-prod-github-runner-207 kernel: [35984.608548] ? do_futex+0x162/0x1f0 Aug 22 15:23:30 juju-e4d256-prod-github-runner-207 kernel: [35984.609197] ? __x64_sys_futex+0x78/0x1e0 Aug 22 15:23:30 juju-e4d256-prod-github-runner-207 kernel: [35984.609872] ? __secure_computing+0xa9/0x120 Aug 22 15:23:30 juju-e4d256-prod-github-runner-207 kernel: [35984.610566] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 15:23:30 juju-e4d256-prod-github-runner-207 kernel: [35984.611383] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:23:30 juju-e4d256-prod-github-runner-207 kernel: [35984.612120] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:23:30 juju-e4d256-prod-github-runner-207 kernel: [35984.612841] ? do_syscall_64+0x69/0xc0 Aug 22 15:23:30 juju-e4d256-prod-github-runner-207 kernel: [35984.613487] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:23:30 juju-e4d256-prod-github-runner-207 kernel: [35984.614196] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:23:30 juju-e4d256-prod-github-runner-207 kernel: [35984.614892] ? do_syscall_64+0x69/0xc0 Aug 22 15:23:30 juju-e4d256-prod-github-runner-207 kernel: [35984.615535] ? do_syscall_64+0x69/0xc0 Aug 22 15:23:30 juju-e4d256-prod-github-runner-207 kernel: [35984.616158] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 15:23:30 juju-e4d256-prod-github-runner-207 kernel: [35984.616869] RIP: 0033:0x7faa5d0edaff Aug 22 15:23:30 juju-e4d256-prod-github-runner-207 kernel: [35984.617493] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 15:23:30 juju-e4d256-prod-github-runner-207 kernel: [35984.619522] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 15:23:30 juju-e4d256-prod-github-runner-207 kernel: [35984.620452] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 15:23:30 juju-e4d256-prod-github-runner-207 kernel: [35984.621362] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 15:23:30 juju-e4d256-prod-github-runner-207 kernel: [35984.622251] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 15:23:30 juju-e4d256-prod-github-runner-207 kernel: [35984.623163] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 15:23:30 juju-e4d256-prod-github-runner-207 kernel: [35984.624048] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 15:23:30 juju-e4d256-prod-github-runner-207 kernel: [35984.624936] Aug 22 15:23:45 juju-e4d256-prod-github-runner-207 kernel: [35999.588706] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 15:23:45 juju-e4d256-prod-github-runner-207 kernel: [35999.590419] rcu: 1-....: (8942529 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=4320479 Aug 22 15:23:45 juju-e4d256-prod-github-runner-207 kernel: [35999.591737] (t=8970597 jiffies g=23269 q=37904) Aug 22 15:23:45 juju-e4d256-prod-github-runner-207 kernel: [35999.592769] NMI backtrace for cpu 1 Aug 22 15:23:45 juju-e4d256-prod-github-runner-207 kernel: [35999.593479] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 15:23:45 juju-e4d256-prod-github-runner-207 kernel: [35999.594578] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 15:23:45 juju-e4d256-prod-github-runner-207 kernel: [35999.595642] Call Trace: Aug 22 15:23:45 juju-e4d256-prod-github-runner-207 kernel: [35999.596320] Aug 22 15:23:45 juju-e4d256-prod-github-runner-207 kernel: [35999.596975] show_stack+0x52/0x5c Aug 22 15:23:45 juju-e4d256-prod-github-runner-207 kernel: [35999.597698] dump_stack_lvl+0x4a/0x63 Aug 22 15:23:45 juju-e4d256-prod-github-runner-207 kernel: [35999.598441] dump_stack+0x10/0x16 Aug 22 15:23:45 juju-e4d256-prod-github-runner-207 kernel: [35999.599167] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 15:23:45 juju-e4d256-prod-github-runner-207 kernel: [35999.599946] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 15:23:45 juju-e4d256-prod-github-runner-207 kernel: [35999.600722] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 15:23:45 juju-e4d256-prod-github-runner-207 kernel: [35999.601539] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 15:23:45 juju-e4d256-prod-github-runner-207 kernel: [35999.602367] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 15:23:45 juju-e4d256-prod-github-runner-207 kernel: [35999.603200] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 15:23:45 juju-e4d256-prod-github-runner-207 kernel: [35999.603971] print_cpu_stall.cold+0x2f/0xe2 Aug 22 15:23:45 juju-e4d256-prod-github-runner-207 kernel: [35999.604733] ? timekeeping_update+0xf7/0x150 Aug 22 15:23:45 juju-e4d256-prod-github-runner-207 kernel: [35999.605507] check_cpu_stall+0x109/0x270 Aug 22 15:23:45 juju-e4d256-prod-github-runner-207 kernel: [35999.606273] rcu_sched_clock_irq+0x9a/0x250 Aug 22 15:23:45 juju-e4d256-prod-github-runner-207 kernel: [35999.607065] update_process_times+0x94/0xd0 Aug 22 15:23:45 juju-e4d256-prod-github-runner-207 kernel: [35999.607824] tick_sched_handle+0x29/0x70 Aug 22 15:23:45 juju-e4d256-prod-github-runner-207 kernel: [35999.608567] tick_sched_timer+0x8c/0xc0 Aug 22 15:23:45 juju-e4d256-prod-github-runner-207 kernel: [35999.609303] ? tick_nohz_handler+0xb0/0xb0 Aug 22 15:23:45 juju-e4d256-prod-github-runner-207 kernel: [35999.610058] __hrtimer_run_queues+0x107/0x230 Aug 22 15:23:45 juju-e4d256-prod-github-runner-207 kernel: [35999.610837] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 15:23:45 juju-e4d256-prod-github-runner-207 kernel: [35999.611621] hrtimer_interrupt+0x101/0x220 Aug 22 15:23:45 juju-e4d256-prod-github-runner-207 kernel: [35999.612397] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 15:23:45 juju-e4d256-prod-github-runner-207 kernel: [35999.613206] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 15:23:45 juju-e4d256-prod-github-runner-207 kernel: [35999.614013] Aug 22 15:23:45 juju-e4d256-prod-github-runner-207 kernel: [35999.614647] Aug 22 15:23:45 juju-e4d256-prod-github-runner-207 kernel: [35999.615367] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 15:23:45 juju-e4d256-prod-github-runner-207 kernel: [35999.616341] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:23:45 juju-e4d256-prod-github-runner-207 kernel: [35999.617222] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 15:23:45 juju-e4d256-prod-github-runner-207 kernel: [35999.619500] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 15:23:45 juju-e4d256-prod-github-runner-207 kernel: [35999.620414] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 15:23:45 juju-e4d256-prod-github-runner-207 kernel: [35999.621418] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 15:23:45 juju-e4d256-prod-github-runner-207 kernel: [35999.622399] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 15:23:45 juju-e4d256-prod-github-runner-207 kernel: [35999.623370] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 15:23:45 juju-e4d256-prod-github-runner-207 kernel: [35999.624323] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 15:23:45 juju-e4d256-prod-github-runner-207 kernel: [35999.625277] ? _raw_spin_lock+0x22/0x30 Aug 22 15:23:45 juju-e4d256-prod-github-runner-207 kernel: [35999.626049] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:23:45 juju-e4d256-prod-github-runner-207 kernel: [35999.626917] direct_page_fault+0x206/0x310 [kvm] Aug 22 15:23:45 juju-e4d256-prod-github-runner-207 kernel: [35999.627755] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 15:23:45 juju-e4d256-prod-github-runner-207 kernel: [35999.628582] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 15:23:45 juju-e4d256-prod-github-runner-207 kernel: [35999.629434] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 15:23:45 juju-e4d256-prod-github-runner-207 kernel: [35999.630280] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 15:23:45 juju-e4d256-prod-github-runner-207 kernel: [35999.631105] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 15:23:45 juju-e4d256-prod-github-runner-207 kernel: [35999.631931] handle_exit+0x98/0x230 [kvm_amd] Aug 22 15:23:45 juju-e4d256-prod-github-runner-207 kernel: [35999.632685] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 15:23:45 juju-e4d256-prod-github-runner-207 kernel: [35999.633470] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 15:23:45 juju-e4d256-prod-github-runner-207 kernel: [35999.634269] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 15:23:45 juju-e4d256-prod-github-runner-207 kernel: [35999.635065] vcpu_run+0x62/0x2c0 [kvm] Aug 22 15:23:45 juju-e4d256-prod-github-runner-207 kernel: [35999.635783] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 15:23:45 juju-e4d256-prod-github-runner-207 kernel: [35999.636516] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 15:23:45 juju-e4d256-prod-github-runner-207 kernel: [35999.637323] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 15:23:45 juju-e4d256-prod-github-runner-207 kernel: [35999.638099] ? __seccomp_filter+0x4a/0x4a0 Aug 22 15:23:45 juju-e4d256-prod-github-runner-207 kernel: [35999.638877] ? __fget_files+0x86/0xc0 Aug 22 15:23:45 juju-e4d256-prod-github-runner-207 kernel: [35999.639802] __x64_sys_ioctl+0x95/0xd0 Aug 22 15:23:45 juju-e4d256-prod-github-runner-207 kernel: [35999.640570] do_syscall_64+0x5c/0xc0 Aug 22 15:23:45 juju-e4d256-prod-github-runner-207 kernel: [35999.641255] ? do_futex+0x162/0x1f0 Aug 22 15:23:45 juju-e4d256-prod-github-runner-207 kernel: [35999.641932] ? __x64_sys_futex+0x78/0x1e0 Aug 22 15:23:45 juju-e4d256-prod-github-runner-207 kernel: [35999.642631] ? __secure_computing+0xa9/0x120 Aug 22 15:23:45 juju-e4d256-prod-github-runner-207 kernel: [35999.643367] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 15:23:45 juju-e4d256-prod-github-runner-207 kernel: [35999.644156] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:23:45 juju-e4d256-prod-github-runner-207 kernel: [35999.644913] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:23:45 juju-e4d256-prod-github-runner-207 kernel: [35999.645672] ? do_syscall_64+0x69/0xc0 Aug 22 15:23:45 juju-e4d256-prod-github-runner-207 kernel: [35999.646363] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:23:45 juju-e4d256-prod-github-runner-207 kernel: [35999.647131] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:23:45 juju-e4d256-prod-github-runner-207 kernel: [35999.647889] ? do_syscall_64+0x69/0xc0 Aug 22 15:23:45 juju-e4d256-prod-github-runner-207 kernel: [35999.648582] ? do_syscall_64+0x69/0xc0 Aug 22 15:23:45 juju-e4d256-prod-github-runner-207 kernel: [35999.649269] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 15:23:45 juju-e4d256-prod-github-runner-207 kernel: [35999.650039] RIP: 0033:0x7faa5d0edaff Aug 22 15:23:45 juju-e4d256-prod-github-runner-207 kernel: [35999.650748] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 15:23:45 juju-e4d256-prod-github-runner-207 kernel: [35999.652866] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 15:23:45 juju-e4d256-prod-github-runner-207 kernel: [35999.653830] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 15:23:45 juju-e4d256-prod-github-runner-207 kernel: [35999.654770] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 15:23:45 juju-e4d256-prod-github-runner-207 kernel: [35999.655746] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 15:23:45 juju-e4d256-prod-github-runner-207 kernel: [35999.656685] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 15:23:45 juju-e4d256-prod-github-runner-207 kernel: [35999.657614] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 15:23:45 juju-e4d256-prod-github-runner-207 kernel: [35999.658525] Aug 22 15:24:10 juju-e4d256-prod-github-runner-207 kernel: [36024.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 33442s! [qemu-system-x86:6715] Aug 22 15:24:10 juju-e4d256-prod-github-runner-207 kernel: [36024.543141] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 15:24:10 juju-e4d256-prod-github-runner-207 kernel: [36024.543518] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 15:24:10 juju-e4d256-prod-github-runner-207 kernel: [36024.555969] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 15:24:10 juju-e4d256-prod-github-runner-207 kernel: [36024.557257] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 15:24:10 juju-e4d256-prod-github-runner-207 kernel: [36024.558499] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:24:10 juju-e4d256-prod-github-runner-207 kernel: [36024.559583] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 15:24:10 juju-e4d256-prod-github-runner-207 kernel: [36024.562166] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 15:24:10 juju-e4d256-prod-github-runner-207 kernel: [36024.563228] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 15:24:10 juju-e4d256-prod-github-runner-207 kernel: [36024.564535] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 15:24:10 juju-e4d256-prod-github-runner-207 kernel: [36024.565708] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 15:24:10 juju-e4d256-prod-github-runner-207 kernel: [36024.566879] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 15:24:10 juju-e4d256-prod-github-runner-207 kernel: [36024.568049] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 15:24:10 juju-e4d256-prod-github-runner-207 kernel: [36024.569215] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 15:24:10 juju-e4d256-prod-github-runner-207 kernel: [36024.570447] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 15:24:10 juju-e4d256-prod-github-runner-207 kernel: [36024.571557] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 15:24:10 juju-e4d256-prod-github-runner-207 kernel: [36024.572750] Call Trace: Aug 22 15:24:10 juju-e4d256-prod-github-runner-207 kernel: [36024.573661] Aug 22 15:24:10 juju-e4d256-prod-github-runner-207 kernel: [36024.574560] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:24:10 juju-e4d256-prod-github-runner-207 kernel: [36024.575600] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:24:10 juju-e4d256-prod-github-runner-207 kernel: [36024.576619] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:24:10 juju-e4d256-prod-github-runner-207 kernel: [36024.577710] ? show_regs.part.0+0x23/0x29 Aug 22 15:24:10 juju-e4d256-prod-github-runner-207 kernel: [36024.578726] ? show_regs.cold+0x8/0xd Aug 22 15:24:10 juju-e4d256-prod-github-runner-207 kernel: [36024.579701] ? watchdog_timer_fn+0x1be/0x220 Aug 22 15:24:10 juju-e4d256-prod-github-runner-207 kernel: [36024.580707] ? lockup_detector_update_enable+0x60/0x60 Aug 22 15:24:10 juju-e4d256-prod-github-runner-207 kernel: [36024.581769] ? __hrtimer_run_queues+0x107/0x230 Aug 22 15:24:10 juju-e4d256-prod-github-runner-207 kernel: [36024.582807] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 15:24:10 juju-e4d256-prod-github-runner-207 kernel: [36024.583830] ? hrtimer_interrupt+0x101/0x220 Aug 22 15:24:10 juju-e4d256-prod-github-runner-207 kernel: [36024.584853] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 15:24:10 juju-e4d256-prod-github-runner-207 kernel: [36024.585919] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 15:24:10 juju-e4d256-prod-github-runner-207 kernel: [36024.586985] Aug 22 15:24:10 juju-e4d256-prod-github-runner-207 kernel: [36024.587838] Aug 22 15:24:10 juju-e4d256-prod-github-runner-207 kernel: [36024.588675] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 15:24:10 juju-e4d256-prod-github-runner-207 kernel: [36024.589706] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:24:10 juju-e4d256-prod-github-runner-207 kernel: [36024.590753] ? _raw_spin_lock+0x22/0x30 Aug 22 15:24:10 juju-e4d256-prod-github-runner-207 kernel: [36024.591702] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:24:10 juju-e4d256-prod-github-runner-207 kernel: [36024.592718] direct_page_fault+0x206/0x310 [kvm] Aug 22 15:24:10 juju-e4d256-prod-github-runner-207 kernel: [36024.593744] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 15:24:10 juju-e4d256-prod-github-runner-207 kernel: [36024.594767] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 15:24:10 juju-e4d256-prod-github-runner-207 kernel: [36024.595767] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 15:24:10 juju-e4d256-prod-github-runner-207 kernel: [36024.596754] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 15:24:10 juju-e4d256-prod-github-runner-207 kernel: [36024.597704] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 15:24:10 juju-e4d256-prod-github-runner-207 kernel: [36024.598695] handle_exit+0x98/0x230 [kvm_amd] Aug 22 15:24:10 juju-e4d256-prod-github-runner-207 kernel: [36024.599591] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 15:24:10 juju-e4d256-prod-github-runner-207 kernel: [36024.600502] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 15:24:10 juju-e4d256-prod-github-runner-207 kernel: [36024.601425] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 15:24:10 juju-e4d256-prod-github-runner-207 kernel: [36024.602325] vcpu_run+0x62/0x2c0 [kvm] Aug 22 15:24:10 juju-e4d256-prod-github-runner-207 kernel: [36024.603145] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 15:24:10 juju-e4d256-prod-github-runner-207 kernel: [36024.603957] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 15:24:10 juju-e4d256-prod-github-runner-207 kernel: [36024.604808] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 15:24:10 juju-e4d256-prod-github-runner-207 kernel: [36024.605605] ? __seccomp_filter+0x4a/0x4a0 Aug 22 15:24:10 juju-e4d256-prod-github-runner-207 kernel: [36024.606345] ? __fget_files+0x86/0xc0 Aug 22 15:24:10 juju-e4d256-prod-github-runner-207 kernel: [36024.607058] __x64_sys_ioctl+0x95/0xd0 Aug 22 15:24:10 juju-e4d256-prod-github-runner-207 kernel: [36024.607748] do_syscall_64+0x5c/0xc0 Aug 22 15:24:10 juju-e4d256-prod-github-runner-207 kernel: [36024.608412] ? do_futex+0x162/0x1f0 Aug 22 15:24:10 juju-e4d256-prod-github-runner-207 kernel: [36024.609058] ? __x64_sys_futex+0x78/0x1e0 Aug 22 15:24:10 juju-e4d256-prod-github-runner-207 kernel: [36024.609734] ? __secure_computing+0xa9/0x120 Aug 22 15:24:10 juju-e4d256-prod-github-runner-207 kernel: [36024.610420] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 15:24:10 juju-e4d256-prod-github-runner-207 kernel: [36024.611192] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:24:10 juju-e4d256-prod-github-runner-207 kernel: [36024.611911] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:24:10 juju-e4d256-prod-github-runner-207 kernel: [36024.612629] ? do_syscall_64+0x69/0xc0 Aug 22 15:24:10 juju-e4d256-prod-github-runner-207 kernel: [36024.613271] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:24:10 juju-e4d256-prod-github-runner-207 kernel: [36024.613976] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:24:10 juju-e4d256-prod-github-runner-207 kernel: [36024.614678] ? do_syscall_64+0x69/0xc0 Aug 22 15:24:10 juju-e4d256-prod-github-runner-207 kernel: [36024.615300] ? do_syscall_64+0x69/0xc0 Aug 22 15:24:10 juju-e4d256-prod-github-runner-207 kernel: [36024.615919] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 15:24:10 juju-e4d256-prod-github-runner-207 kernel: [36024.616625] RIP: 0033:0x7faa5d0edaff Aug 22 15:24:10 juju-e4d256-prod-github-runner-207 kernel: [36024.617256] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 15:24:10 juju-e4d256-prod-github-runner-207 kernel: [36024.619299] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 15:24:10 juju-e4d256-prod-github-runner-207 kernel: [36024.620206] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 15:24:10 juju-e4d256-prod-github-runner-207 kernel: [36024.621090] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 15:24:10 juju-e4d256-prod-github-runner-207 kernel: [36024.621972] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 15:24:10 juju-e4d256-prod-github-runner-207 kernel: [36024.622874] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 15:24:10 juju-e4d256-prod-github-runner-207 kernel: [36024.623761] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 15:24:10 juju-e4d256-prod-github-runner-207 kernel: [36024.624649] Aug 22 15:24:38 juju-e4d256-prod-github-runner-207 kernel: [36052.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 33468s! [qemu-system-x86:6715] Aug 22 15:24:38 juju-e4d256-prod-github-runner-207 kernel: [36052.543116] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 15:24:38 juju-e4d256-prod-github-runner-207 kernel: [36052.543191] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 15:24:38 juju-e4d256-prod-github-runner-207 kernel: [36052.555242] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 15:24:38 juju-e4d256-prod-github-runner-207 kernel: [36052.556505] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 15:24:38 juju-e4d256-prod-github-runner-207 kernel: [36052.557726] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:24:38 juju-e4d256-prod-github-runner-207 kernel: [36052.558804] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 15:24:38 juju-e4d256-prod-github-runner-207 kernel: [36052.561354] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 15:24:38 juju-e4d256-prod-github-runner-207 kernel: [36052.562411] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 15:24:38 juju-e4d256-prod-github-runner-207 kernel: [36052.563571] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 15:24:38 juju-e4d256-prod-github-runner-207 kernel: [36052.564726] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 15:24:38 juju-e4d256-prod-github-runner-207 kernel: [36052.565883] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 15:24:38 juju-e4d256-prod-github-runner-207 kernel: [36052.567067] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 15:24:38 juju-e4d256-prod-github-runner-207 kernel: [36052.568242] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 15:24:38 juju-e4d256-prod-github-runner-207 kernel: [36052.569485] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 15:24:38 juju-e4d256-prod-github-runner-207 kernel: [36052.570620] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 15:24:38 juju-e4d256-prod-github-runner-207 kernel: [36052.571848] Call Trace: Aug 22 15:24:38 juju-e4d256-prod-github-runner-207 kernel: [36052.572778] Aug 22 15:24:38 juju-e4d256-prod-github-runner-207 kernel: [36052.573671] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:24:38 juju-e4d256-prod-github-runner-207 kernel: [36052.574710] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:24:38 juju-e4d256-prod-github-runner-207 kernel: [36052.575742] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:24:38 juju-e4d256-prod-github-runner-207 kernel: [36052.576897] ? show_regs.part.0+0x23/0x29 Aug 22 15:24:38 juju-e4d256-prod-github-runner-207 kernel: [36052.577934] ? show_regs.cold+0x8/0xd Aug 22 15:24:38 juju-e4d256-prod-github-runner-207 kernel: [36052.578921] ? watchdog_timer_fn+0x1be/0x220 Aug 22 15:24:38 juju-e4d256-prod-github-runner-207 kernel: [36052.579943] ? lockup_detector_update_enable+0x60/0x60 Aug 22 15:24:38 juju-e4d256-prod-github-runner-207 kernel: [36052.581015] ? __hrtimer_run_queues+0x107/0x230 Aug 22 15:24:38 juju-e4d256-prod-github-runner-207 kernel: [36052.582045] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 15:24:38 juju-e4d256-prod-github-runner-207 kernel: [36052.583088] ? hrtimer_interrupt+0x101/0x220 Aug 22 15:24:38 juju-e4d256-prod-github-runner-207 kernel: [36052.584114] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 15:24:38 juju-e4d256-prod-github-runner-207 kernel: [36052.585184] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 15:24:38 juju-e4d256-prod-github-runner-207 kernel: [36052.586251] Aug 22 15:24:38 juju-e4d256-prod-github-runner-207 kernel: [36052.587107] Aug 22 15:24:38 juju-e4d256-prod-github-runner-207 kernel: [36052.587955] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 15:24:38 juju-e4d256-prod-github-runner-207 kernel: [36052.588989] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:24:38 juju-e4d256-prod-github-runner-207 kernel: [36052.590029] ? _raw_spin_lock+0x22/0x30 Aug 22 15:24:38 juju-e4d256-prod-github-runner-207 kernel: [36052.590986] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:24:38 juju-e4d256-prod-github-runner-207 kernel: [36052.592104] direct_page_fault+0x206/0x310 [kvm] Aug 22 15:24:38 juju-e4d256-prod-github-runner-207 kernel: [36052.593138] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 15:24:38 juju-e4d256-prod-github-runner-207 kernel: [36052.594148] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 15:24:38 juju-e4d256-prod-github-runner-207 kernel: [36052.595163] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 15:24:38 juju-e4d256-prod-github-runner-207 kernel: [36052.596134] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 15:24:38 juju-e4d256-prod-github-runner-207 kernel: [36052.597079] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 15:24:38 juju-e4d256-prod-github-runner-207 kernel: [36052.598146] handle_exit+0x98/0x230 [kvm_amd] Aug 22 15:24:38 juju-e4d256-prod-github-runner-207 kernel: [36052.599055] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 15:24:38 juju-e4d256-prod-github-runner-207 kernel: [36052.599969] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 15:24:38 juju-e4d256-prod-github-runner-207 kernel: [36052.600896] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 15:24:38 juju-e4d256-prod-github-runner-207 kernel: [36052.601804] vcpu_run+0x62/0x2c0 [kvm] Aug 22 15:24:38 juju-e4d256-prod-github-runner-207 kernel: [36052.602630] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 15:24:38 juju-e4d256-prod-github-runner-207 kernel: [36052.603443] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 15:24:38 juju-e4d256-prod-github-runner-207 kernel: [36052.604301] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 15:24:38 juju-e4d256-prod-github-runner-207 kernel: [36052.605099] ? __seccomp_filter+0x4a/0x4a0 Aug 22 15:24:38 juju-e4d256-prod-github-runner-207 kernel: [36052.605843] ? __fget_files+0x86/0xc0 Aug 22 15:24:38 juju-e4d256-prod-github-runner-207 kernel: [36052.606622] __x64_sys_ioctl+0x95/0xd0 Aug 22 15:24:38 juju-e4d256-prod-github-runner-207 kernel: [36052.607316] do_syscall_64+0x5c/0xc0 Aug 22 15:24:38 juju-e4d256-prod-github-runner-207 kernel: [36052.607983] ? do_futex+0x162/0x1f0 Aug 22 15:24:38 juju-e4d256-prod-github-runner-207 kernel: [36052.608631] ? __x64_sys_futex+0x78/0x1e0 Aug 22 15:24:38 juju-e4d256-prod-github-runner-207 kernel: [36052.609311] ? __secure_computing+0xa9/0x120 Aug 22 15:24:38 juju-e4d256-prod-github-runner-207 kernel: [36052.610002] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 15:24:38 juju-e4d256-prod-github-runner-207 kernel: [36052.610772] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:24:38 juju-e4d256-prod-github-runner-207 kernel: [36052.611496] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:24:38 juju-e4d256-prod-github-runner-207 kernel: [36052.612221] ? do_syscall_64+0x69/0xc0 Aug 22 15:24:38 juju-e4d256-prod-github-runner-207 kernel: [36052.612867] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:24:38 juju-e4d256-prod-github-runner-207 kernel: [36052.613570] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:24:38 juju-e4d256-prod-github-runner-207 kernel: [36052.614281] ? do_syscall_64+0x69/0xc0 Aug 22 15:24:38 juju-e4d256-prod-github-runner-207 kernel: [36052.614909] ? do_syscall_64+0x69/0xc0 Aug 22 15:24:38 juju-e4d256-prod-github-runner-207 kernel: [36052.615532] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 15:24:38 juju-e4d256-prod-github-runner-207 kernel: [36052.616237] RIP: 0033:0x7faa5d0edaff Aug 22 15:24:38 juju-e4d256-prod-github-runner-207 kernel: [36052.616862] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 15:24:38 juju-e4d256-prod-github-runner-207 kernel: [36052.618860] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 15:24:38 juju-e4d256-prod-github-runner-207 kernel: [36052.619770] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 15:24:38 juju-e4d256-prod-github-runner-207 kernel: [36052.620659] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 15:24:38 juju-e4d256-prod-github-runner-207 kernel: [36052.621554] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 15:24:38 juju-e4d256-prod-github-runner-207 kernel: [36052.622455] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 15:24:38 juju-e4d256-prod-github-runner-207 kernel: [36052.623344] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 15:24:38 juju-e4d256-prod-github-runner-207 kernel: [36052.624241] Aug 22 15:25:06 juju-e4d256-prod-github-runner-207 kernel: [36080.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 33494s! [qemu-system-x86:6715] Aug 22 15:25:06 juju-e4d256-prod-github-runner-207 kernel: [36080.543153] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 15:25:06 juju-e4d256-prod-github-runner-207 kernel: [36080.543229] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 15:25:06 juju-e4d256-prod-github-runner-207 kernel: [36080.555441] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 15:25:06 juju-e4d256-prod-github-runner-207 kernel: [36080.556707] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 15:25:06 juju-e4d256-prod-github-runner-207 kernel: [36080.557940] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:25:06 juju-e4d256-prod-github-runner-207 kernel: [36080.559004] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 15:25:06 juju-e4d256-prod-github-runner-207 kernel: [36080.561559] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 15:25:06 juju-e4d256-prod-github-runner-207 kernel: [36080.562630] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 15:25:06 juju-e4d256-prod-github-runner-207 kernel: [36080.563797] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 15:25:06 juju-e4d256-prod-github-runner-207 kernel: [36080.564959] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 15:25:06 juju-e4d256-prod-github-runner-207 kernel: [36080.566132] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 15:25:06 juju-e4d256-prod-github-runner-207 kernel: [36080.567295] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 15:25:06 juju-e4d256-prod-github-runner-207 kernel: [36080.568459] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 15:25:06 juju-e4d256-prod-github-runner-207 kernel: [36080.569691] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 15:25:06 juju-e4d256-prod-github-runner-207 kernel: [36080.570801] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 15:25:06 juju-e4d256-prod-github-runner-207 kernel: [36080.571993] Call Trace: Aug 22 15:25:06 juju-e4d256-prod-github-runner-207 kernel: [36080.572909] Aug 22 15:25:06 juju-e4d256-prod-github-runner-207 kernel: [36080.573798] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:25:06 juju-e4d256-prod-github-runner-207 kernel: [36080.574850] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:25:06 juju-e4d256-prod-github-runner-207 kernel: [36080.575877] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:25:06 juju-e4d256-prod-github-runner-207 kernel: [36080.577008] ? show_regs.part.0+0x23/0x29 Aug 22 15:25:06 juju-e4d256-prod-github-runner-207 kernel: [36080.578068] ? show_regs.cold+0x8/0xd Aug 22 15:25:06 juju-e4d256-prod-github-runner-207 kernel: [36080.579132] ? watchdog_timer_fn+0x1be/0x220 Aug 22 15:25:06 juju-e4d256-prod-github-runner-207 kernel: [36080.580143] ? lockup_detector_update_enable+0x60/0x60 Aug 22 15:25:06 juju-e4d256-prod-github-runner-207 kernel: [36080.581209] ? __hrtimer_run_queues+0x107/0x230 Aug 22 15:25:06 juju-e4d256-prod-github-runner-207 kernel: [36080.582280] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 15:25:06 juju-e4d256-prod-github-runner-207 kernel: [36080.583319] ? hrtimer_interrupt+0x101/0x220 Aug 22 15:25:06 juju-e4d256-prod-github-runner-207 kernel: [36080.584344] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 15:25:06 juju-e4d256-prod-github-runner-207 kernel: [36080.585424] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 15:25:06 juju-e4d256-prod-github-runner-207 kernel: [36080.586513] Aug 22 15:25:06 juju-e4d256-prod-github-runner-207 kernel: [36080.587385] Aug 22 15:25:06 juju-e4d256-prod-github-runner-207 kernel: [36080.588232] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 15:25:06 juju-e4d256-prod-github-runner-207 kernel: [36080.589278] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:25:06 juju-e4d256-prod-github-runner-207 kernel: [36080.590339] ? _raw_spin_lock+0x22/0x30 Aug 22 15:25:06 juju-e4d256-prod-github-runner-207 kernel: [36080.591285] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:25:06 juju-e4d256-prod-github-runner-207 kernel: [36080.592308] direct_page_fault+0x206/0x310 [kvm] Aug 22 15:25:06 juju-e4d256-prod-github-runner-207 kernel: [36080.593329] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 15:25:06 juju-e4d256-prod-github-runner-207 kernel: [36080.594347] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 15:25:06 juju-e4d256-prod-github-runner-207 kernel: [36080.595347] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 15:25:06 juju-e4d256-prod-github-runner-207 kernel: [36080.596317] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 15:25:06 juju-e4d256-prod-github-runner-207 kernel: [36080.597265] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 15:25:06 juju-e4d256-prod-github-runner-207 kernel: [36080.598274] handle_exit+0x98/0x230 [kvm_amd] Aug 22 15:25:06 juju-e4d256-prod-github-runner-207 kernel: [36080.599166] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 15:25:06 juju-e4d256-prod-github-runner-207 kernel: [36080.600173] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 15:25:06 juju-e4d256-prod-github-runner-207 kernel: [36080.601180] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 15:25:06 juju-e4d256-prod-github-runner-207 kernel: [36080.602112] vcpu_run+0x62/0x2c0 [kvm] Aug 22 15:25:06 juju-e4d256-prod-github-runner-207 kernel: [36080.602925] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 15:25:06 juju-e4d256-prod-github-runner-207 kernel: [36080.603734] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 15:25:06 juju-e4d256-prod-github-runner-207 kernel: [36080.604597] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 15:25:06 juju-e4d256-prod-github-runner-207 kernel: [36080.605398] ? __seccomp_filter+0x4a/0x4a0 Aug 22 15:25:06 juju-e4d256-prod-github-runner-207 kernel: [36080.606151] ? __fget_files+0x86/0xc0 Aug 22 15:25:06 juju-e4d256-prod-github-runner-207 kernel: [36080.606860] __x64_sys_ioctl+0x95/0xd0 Aug 22 15:25:06 juju-e4d256-prod-github-runner-207 kernel: [36080.607617] do_syscall_64+0x5c/0xc0 Aug 22 15:25:06 juju-e4d256-prod-github-runner-207 kernel: [36080.608786] ? do_futex+0x162/0x1f0 Aug 22 15:25:06 juju-e4d256-prod-github-runner-207 kernel: [36080.609437] ? __x64_sys_futex+0x78/0x1e0 Aug 22 15:25:06 juju-e4d256-prod-github-runner-207 kernel: [36080.610139] ? __secure_computing+0xa9/0x120 Aug 22 15:25:06 juju-e4d256-prod-github-runner-207 kernel: [36080.610834] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 15:25:06 juju-e4d256-prod-github-runner-207 kernel: [36080.611600] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:25:06 juju-e4d256-prod-github-runner-207 kernel: [36080.612326] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:25:06 juju-e4d256-prod-github-runner-207 kernel: [36080.613054] ? do_syscall_64+0x69/0xc0 Aug 22 15:25:06 juju-e4d256-prod-github-runner-207 kernel: [36080.613707] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:25:06 juju-e4d256-prod-github-runner-207 kernel: [36080.614417] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:25:06 juju-e4d256-prod-github-runner-207 kernel: [36080.615113] ? do_syscall_64+0x69/0xc0 Aug 22 15:25:06 juju-e4d256-prod-github-runner-207 kernel: [36080.615737] ? do_syscall_64+0x69/0xc0 Aug 22 15:25:06 juju-e4d256-prod-github-runner-207 kernel: [36080.616358] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 15:25:06 juju-e4d256-prod-github-runner-207 kernel: [36080.617062] RIP: 0033:0x7faa5d0edaff Aug 22 15:25:06 juju-e4d256-prod-github-runner-207 kernel: [36080.617687] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 15:25:06 juju-e4d256-prod-github-runner-207 kernel: [36080.619684] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 15:25:06 juju-e4d256-prod-github-runner-207 kernel: [36080.620598] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 15:25:06 juju-e4d256-prod-github-runner-207 kernel: [36080.621486] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 15:25:06 juju-e4d256-prod-github-runner-207 kernel: [36080.622398] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 15:25:06 juju-e4d256-prod-github-runner-207 kernel: [36080.623303] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 15:25:06 juju-e4d256-prod-github-runner-207 kernel: [36080.624200] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 15:25:06 juju-e4d256-prod-github-runner-207 kernel: [36080.625091] Aug 22 15:25:34 juju-e4d256-prod-github-runner-207 kernel: [36108.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 33520s! [qemu-system-x86:6715] Aug 22 15:25:34 juju-e4d256-prod-github-runner-207 kernel: [36108.543850] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 15:25:34 juju-e4d256-prod-github-runner-207 kernel: [36108.544140] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 15:25:34 juju-e4d256-prod-github-runner-207 kernel: [36108.556461] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 15:25:34 juju-e4d256-prod-github-runner-207 kernel: [36108.557754] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 15:25:34 juju-e4d256-prod-github-runner-207 kernel: [36108.558977] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:25:34 juju-e4d256-prod-github-runner-207 kernel: [36108.560035] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 15:25:34 juju-e4d256-prod-github-runner-207 kernel: [36108.562671] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 15:25:34 juju-e4d256-prod-github-runner-207 kernel: [36108.563729] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 15:25:34 juju-e4d256-prod-github-runner-207 kernel: [36108.564902] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 15:25:34 juju-e4d256-prod-github-runner-207 kernel: [36108.566080] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 15:25:34 juju-e4d256-prod-github-runner-207 kernel: [36108.567263] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 15:25:34 juju-e4d256-prod-github-runner-207 kernel: [36108.568433] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 15:25:34 juju-e4d256-prod-github-runner-207 kernel: [36108.569823] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 15:25:34 juju-e4d256-prod-github-runner-207 kernel: [36108.571081] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 15:25:34 juju-e4d256-prod-github-runner-207 kernel: [36108.572183] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 15:25:34 juju-e4d256-prod-github-runner-207 kernel: [36108.573382] Call Trace: Aug 22 15:25:34 juju-e4d256-prod-github-runner-207 kernel: [36108.574329] Aug 22 15:25:34 juju-e4d256-prod-github-runner-207 kernel: [36108.575232] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:25:34 juju-e4d256-prod-github-runner-207 kernel: [36108.576265] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:25:34 juju-e4d256-prod-github-runner-207 kernel: [36108.577290] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:25:34 juju-e4d256-prod-github-runner-207 kernel: [36108.578396] ? show_regs.part.0+0x23/0x29 Aug 22 15:25:34 juju-e4d256-prod-github-runner-207 kernel: [36108.579396] ? show_regs.cold+0x8/0xd Aug 22 15:25:34 juju-e4d256-prod-github-runner-207 kernel: [36108.580364] ? watchdog_timer_fn+0x1be/0x220 Aug 22 15:25:34 juju-e4d256-prod-github-runner-207 kernel: [36108.581377] ? lockup_detector_update_enable+0x60/0x60 Aug 22 15:25:34 juju-e4d256-prod-github-runner-207 kernel: [36108.582447] ? __hrtimer_run_queues+0x107/0x230 Aug 22 15:25:34 juju-e4d256-prod-github-runner-207 kernel: [36108.583477] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 15:25:34 juju-e4d256-prod-github-runner-207 kernel: [36108.584499] ? hrtimer_interrupt+0x101/0x220 Aug 22 15:25:34 juju-e4d256-prod-github-runner-207 kernel: [36108.585523] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 15:25:34 juju-e4d256-prod-github-runner-207 kernel: [36108.586588] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 15:25:34 juju-e4d256-prod-github-runner-207 kernel: [36108.587633] Aug 22 15:25:34 juju-e4d256-prod-github-runner-207 kernel: [36108.588505] Aug 22 15:25:34 juju-e4d256-prod-github-runner-207 kernel: [36108.589355] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 15:25:34 juju-e4d256-prod-github-runner-207 kernel: [36108.590398] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:25:34 juju-e4d256-prod-github-runner-207 kernel: [36108.591458] ? _raw_spin_lock+0x22/0x30 Aug 22 15:25:34 juju-e4d256-prod-github-runner-207 kernel: [36108.592417] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:25:34 juju-e4d256-prod-github-runner-207 kernel: [36108.593439] direct_page_fault+0x206/0x310 [kvm] Aug 22 15:25:34 juju-e4d256-prod-github-runner-207 kernel: [36108.594474] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 15:25:34 juju-e4d256-prod-github-runner-207 kernel: [36108.595486] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 15:25:34 juju-e4d256-prod-github-runner-207 kernel: [36108.596517] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 15:25:34 juju-e4d256-prod-github-runner-207 kernel: [36108.597537] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 15:25:34 juju-e4d256-prod-github-runner-207 kernel: [36108.598497] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 15:25:34 juju-e4d256-prod-github-runner-207 kernel: [36108.599495] handle_exit+0x98/0x230 [kvm_amd] Aug 22 15:25:34 juju-e4d256-prod-github-runner-207 kernel: [36108.600407] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 15:25:34 juju-e4d256-prod-github-runner-207 kernel: [36108.601319] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 15:25:34 juju-e4d256-prod-github-runner-207 kernel: [36108.602250] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 15:25:34 juju-e4d256-prod-github-runner-207 kernel: [36108.603154] vcpu_run+0x62/0x2c0 [kvm] Aug 22 15:25:34 juju-e4d256-prod-github-runner-207 kernel: [36108.603962] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 15:25:34 juju-e4d256-prod-github-runner-207 kernel: [36108.604772] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 15:25:34 juju-e4d256-prod-github-runner-207 kernel: [36108.605649] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 15:25:34 juju-e4d256-prod-github-runner-207 kernel: [36108.606451] ? __seccomp_filter+0x4a/0x4a0 Aug 22 15:25:34 juju-e4d256-prod-github-runner-207 kernel: [36108.607191] ? __fget_files+0x86/0xc0 Aug 22 15:25:34 juju-e4d256-prod-github-runner-207 kernel: [36108.607892] __x64_sys_ioctl+0x95/0xd0 Aug 22 15:25:34 juju-e4d256-prod-github-runner-207 kernel: [36108.608587] do_syscall_64+0x5c/0xc0 Aug 22 15:25:34 juju-e4d256-prod-github-runner-207 kernel: [36108.609249] ? do_futex+0x162/0x1f0 Aug 22 15:25:34 juju-e4d256-prod-github-runner-207 kernel: [36108.609901] ? __x64_sys_futex+0x78/0x1e0 Aug 22 15:25:34 juju-e4d256-prod-github-runner-207 kernel: [36108.610572] ? __secure_computing+0xa9/0x120 Aug 22 15:25:34 juju-e4d256-prod-github-runner-207 kernel: [36108.611258] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 15:25:34 juju-e4d256-prod-github-runner-207 kernel: [36108.612027] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:25:34 juju-e4d256-prod-github-runner-207 kernel: [36108.612755] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:25:34 juju-e4d256-prod-github-runner-207 kernel: [36108.613483] ? do_syscall_64+0x69/0xc0 Aug 22 15:25:34 juju-e4d256-prod-github-runner-207 kernel: [36108.614152] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:25:34 juju-e4d256-prod-github-runner-207 kernel: [36108.614861] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:25:34 juju-e4d256-prod-github-runner-207 kernel: [36108.615573] ? do_syscall_64+0x69/0xc0 Aug 22 15:25:34 juju-e4d256-prod-github-runner-207 kernel: [36108.616203] ? do_syscall_64+0x69/0xc0 Aug 22 15:25:34 juju-e4d256-prod-github-runner-207 kernel: [36108.616840] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 15:25:34 juju-e4d256-prod-github-runner-207 kernel: [36108.617561] RIP: 0033:0x7faa5d0edaff Aug 22 15:25:34 juju-e4d256-prod-github-runner-207 kernel: [36108.618245] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 15:25:34 juju-e4d256-prod-github-runner-207 kernel: [36108.620262] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 15:25:34 juju-e4d256-prod-github-runner-207 kernel: [36108.621185] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 15:25:34 juju-e4d256-prod-github-runner-207 kernel: [36108.622104] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 15:25:34 juju-e4d256-prod-github-runner-207 kernel: [36108.623002] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 15:25:34 juju-e4d256-prod-github-runner-207 kernel: [36108.623895] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 15:25:34 juju-e4d256-prod-github-runner-207 kernel: [36108.624785] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 15:25:34 juju-e4d256-prod-github-runner-207 kernel: [36108.625698] Aug 22 15:26:02 juju-e4d256-prod-github-runner-207 kernel: [36136.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 33546s! [qemu-system-x86:6715] Aug 22 15:26:02 juju-e4d256-prod-github-runner-207 kernel: [36136.543114] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 15:26:02 juju-e4d256-prod-github-runner-207 kernel: [36136.543187] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 15:26:02 juju-e4d256-prod-github-runner-207 kernel: [36136.555500] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 15:26:02 juju-e4d256-prod-github-runner-207 kernel: [36136.556764] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 15:26:02 juju-e4d256-prod-github-runner-207 kernel: [36136.558218] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:26:02 juju-e4d256-prod-github-runner-207 kernel: [36136.559297] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 15:26:02 juju-e4d256-prod-github-runner-207 kernel: [36136.561865] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 15:26:02 juju-e4d256-prod-github-runner-207 kernel: [36136.562930] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 15:26:02 juju-e4d256-prod-github-runner-207 kernel: [36136.564119] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 15:26:02 juju-e4d256-prod-github-runner-207 kernel: [36136.565319] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 15:26:02 juju-e4d256-prod-github-runner-207 kernel: [36136.566511] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 15:26:02 juju-e4d256-prod-github-runner-207 kernel: [36136.567751] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 15:26:02 juju-e4d256-prod-github-runner-207 kernel: [36136.568945] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 15:26:02 juju-e4d256-prod-github-runner-207 kernel: [36136.570239] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 15:26:02 juju-e4d256-prod-github-runner-207 kernel: [36136.571344] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 15:26:02 juju-e4d256-prod-github-runner-207 kernel: [36136.572551] Call Trace: Aug 22 15:26:02 juju-e4d256-prod-github-runner-207 kernel: [36136.573529] Aug 22 15:26:02 juju-e4d256-prod-github-runner-207 kernel: [36136.574434] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:26:02 juju-e4d256-prod-github-runner-207 kernel: [36136.575471] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:26:02 juju-e4d256-prod-github-runner-207 kernel: [36136.576502] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:26:02 juju-e4d256-prod-github-runner-207 kernel: [36136.577608] ? show_regs.part.0+0x23/0x29 Aug 22 15:26:02 juju-e4d256-prod-github-runner-207 kernel: [36136.578628] ? show_regs.cold+0x8/0xd Aug 22 15:26:02 juju-e4d256-prod-github-runner-207 kernel: [36136.579606] ? watchdog_timer_fn+0x1be/0x220 Aug 22 15:26:02 juju-e4d256-prod-github-runner-207 kernel: [36136.580619] ? lockup_detector_update_enable+0x60/0x60 Aug 22 15:26:02 juju-e4d256-prod-github-runner-207 kernel: [36136.581706] ? __hrtimer_run_queues+0x107/0x230 Aug 22 15:26:02 juju-e4d256-prod-github-runner-207 kernel: [36136.582762] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 15:26:02 juju-e4d256-prod-github-runner-207 kernel: [36136.583830] ? hrtimer_interrupt+0x101/0x220 Aug 22 15:26:02 juju-e4d256-prod-github-runner-207 kernel: [36136.584871] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 15:26:02 juju-e4d256-prod-github-runner-207 kernel: [36136.585957] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 15:26:02 juju-e4d256-prod-github-runner-207 kernel: [36136.587013] Aug 22 15:26:02 juju-e4d256-prod-github-runner-207 kernel: [36136.587883] Aug 22 15:26:02 juju-e4d256-prod-github-runner-207 kernel: [36136.588726] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 15:26:02 juju-e4d256-prod-github-runner-207 kernel: [36136.589821] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:26:02 juju-e4d256-prod-github-runner-207 kernel: [36136.590869] ? _raw_spin_lock+0x22/0x30 Aug 22 15:26:02 juju-e4d256-prod-github-runner-207 kernel: [36136.591824] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:26:02 juju-e4d256-prod-github-runner-207 kernel: [36136.592851] direct_page_fault+0x206/0x310 [kvm] Aug 22 15:26:02 juju-e4d256-prod-github-runner-207 kernel: [36136.593931] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 15:26:02 juju-e4d256-prod-github-runner-207 kernel: [36136.594987] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 15:26:02 juju-e4d256-prod-github-runner-207 kernel: [36136.595993] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 15:26:02 juju-e4d256-prod-github-runner-207 kernel: [36136.596969] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 15:26:02 juju-e4d256-prod-github-runner-207 kernel: [36136.597933] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 15:26:02 juju-e4d256-prod-github-runner-207 kernel: [36136.599016] handle_exit+0x98/0x230 [kvm_amd] Aug 22 15:26:02 juju-e4d256-prod-github-runner-207 kernel: [36136.599950] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 15:26:02 juju-e4d256-prod-github-runner-207 kernel: [36136.600873] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 15:26:02 juju-e4d256-prod-github-runner-207 kernel: [36136.601812] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 15:26:02 juju-e4d256-prod-github-runner-207 kernel: [36136.602719] vcpu_run+0x62/0x2c0 [kvm] Aug 22 15:26:02 juju-e4d256-prod-github-runner-207 kernel: [36136.603541] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 15:26:02 juju-e4d256-prod-github-runner-207 kernel: [36136.604371] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 15:26:02 juju-e4d256-prod-github-runner-207 kernel: [36136.605268] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 15:26:02 juju-e4d256-prod-github-runner-207 kernel: [36136.606076] ? __seccomp_filter+0x4a/0x4a0 Aug 22 15:26:02 juju-e4d256-prod-github-runner-207 kernel: [36136.606826] ? __fget_files+0x86/0xc0 Aug 22 15:26:02 juju-e4d256-prod-github-runner-207 kernel: [36136.607535] __x64_sys_ioctl+0x95/0xd0 Aug 22 15:26:02 juju-e4d256-prod-github-runner-207 kernel: [36136.608237] do_syscall_64+0x5c/0xc0 Aug 22 15:26:02 juju-e4d256-prod-github-runner-207 kernel: [36136.608928] ? do_futex+0x162/0x1f0 Aug 22 15:26:02 juju-e4d256-prod-github-runner-207 kernel: [36136.609608] ? __x64_sys_futex+0x78/0x1e0 Aug 22 15:26:02 juju-e4d256-prod-github-runner-207 kernel: [36136.610288] ? __secure_computing+0xa9/0x120 Aug 22 15:26:02 juju-e4d256-prod-github-runner-207 kernel: [36136.610980] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 15:26:02 juju-e4d256-prod-github-runner-207 kernel: [36136.611749] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:26:02 juju-e4d256-prod-github-runner-207 kernel: [36136.612481] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:26:02 juju-e4d256-prod-github-runner-207 kernel: [36136.613243] ? do_syscall_64+0x69/0xc0 Aug 22 15:26:02 juju-e4d256-prod-github-runner-207 kernel: [36136.613991] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:26:02 juju-e4d256-prod-github-runner-207 kernel: [36136.614804] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:26:02 juju-e4d256-prod-github-runner-207 kernel: [36136.615517] ? do_syscall_64+0x69/0xc0 Aug 22 15:26:02 juju-e4d256-prod-github-runner-207 kernel: [36136.616178] ? do_syscall_64+0x69/0xc0 Aug 22 15:26:02 juju-e4d256-prod-github-runner-207 kernel: [36136.616819] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 15:26:02 juju-e4d256-prod-github-runner-207 kernel: [36136.617553] RIP: 0033:0x7faa5d0edaff Aug 22 15:26:02 juju-e4d256-prod-github-runner-207 kernel: [36136.618191] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 15:26:02 juju-e4d256-prod-github-runner-207 kernel: [36136.620247] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 15:26:02 juju-e4d256-prod-github-runner-207 kernel: [36136.621203] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 15:26:02 juju-e4d256-prod-github-runner-207 kernel: [36136.622149] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 15:26:02 juju-e4d256-prod-github-runner-207 kernel: [36136.623053] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 15:26:02 juju-e4d256-prod-github-runner-207 kernel: [36136.623955] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 15:26:02 juju-e4d256-prod-github-runner-207 kernel: [36136.624871] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 15:26:02 juju-e4d256-prod-github-runner-207 kernel: [36136.625858] Aug 22 15:26:30 juju-e4d256-prod-github-runner-207 kernel: [36164.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 33572s! [qemu-system-x86:6715] Aug 22 15:26:30 juju-e4d256-prod-github-runner-207 kernel: [36164.543122] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 15:26:30 juju-e4d256-prod-github-runner-207 kernel: [36164.543195] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 15:26:30 juju-e4d256-prod-github-runner-207 kernel: [36164.555273] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 15:26:30 juju-e4d256-prod-github-runner-207 kernel: [36164.556536] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 15:26:30 juju-e4d256-prod-github-runner-207 kernel: [36164.557772] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:26:30 juju-e4d256-prod-github-runner-207 kernel: [36164.558834] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 15:26:30 juju-e4d256-prod-github-runner-207 kernel: [36164.561392] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 15:26:30 juju-e4d256-prod-github-runner-207 kernel: [36164.562439] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 15:26:30 juju-e4d256-prod-github-runner-207 kernel: [36164.563603] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 15:26:30 juju-e4d256-prod-github-runner-207 kernel: [36164.564765] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 15:26:30 juju-e4d256-prod-github-runner-207 kernel: [36164.565933] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 15:26:30 juju-e4d256-prod-github-runner-207 kernel: [36164.567098] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 15:26:30 juju-e4d256-prod-github-runner-207 kernel: [36164.568326] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 15:26:30 juju-e4d256-prod-github-runner-207 kernel: [36164.569613] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 15:26:30 juju-e4d256-prod-github-runner-207 kernel: [36164.570934] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 15:26:30 juju-e4d256-prod-github-runner-207 kernel: [36164.572134] Call Trace: Aug 22 15:26:30 juju-e4d256-prod-github-runner-207 kernel: [36164.573072] Aug 22 15:26:30 juju-e4d256-prod-github-runner-207 kernel: [36164.573960] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:26:30 juju-e4d256-prod-github-runner-207 kernel: [36164.575047] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:26:30 juju-e4d256-prod-github-runner-207 kernel: [36164.576089] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:26:30 juju-e4d256-prod-github-runner-207 kernel: [36164.577183] ? show_regs.part.0+0x23/0x29 Aug 22 15:26:30 juju-e4d256-prod-github-runner-207 kernel: [36164.578183] ? show_regs.cold+0x8/0xd Aug 22 15:26:30 juju-e4d256-prod-github-runner-207 kernel: [36164.579152] ? watchdog_timer_fn+0x1be/0x220 Aug 22 15:26:30 juju-e4d256-prod-github-runner-207 kernel: [36164.580158] ? lockup_detector_update_enable+0x60/0x60 Aug 22 15:26:30 juju-e4d256-prod-github-runner-207 kernel: [36164.581230] ? __hrtimer_run_queues+0x107/0x230 Aug 22 15:26:30 juju-e4d256-prod-github-runner-207 kernel: [36164.582262] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 15:26:30 juju-e4d256-prod-github-runner-207 kernel: [36164.583280] ? hrtimer_interrupt+0x101/0x220 Aug 22 15:26:30 juju-e4d256-prod-github-runner-207 kernel: [36164.584291] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 15:26:30 juju-e4d256-prod-github-runner-207 kernel: [36164.585373] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 15:26:30 juju-e4d256-prod-github-runner-207 kernel: [36164.586418] Aug 22 15:26:30 juju-e4d256-prod-github-runner-207 kernel: [36164.587348] Aug 22 15:26:30 juju-e4d256-prod-github-runner-207 kernel: [36164.588221] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 15:26:30 juju-e4d256-prod-github-runner-207 kernel: [36164.589284] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:26:30 juju-e4d256-prod-github-runner-207 kernel: [36164.590328] ? _raw_spin_lock+0x22/0x30 Aug 22 15:26:30 juju-e4d256-prod-github-runner-207 kernel: [36164.591279] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:26:30 juju-e4d256-prod-github-runner-207 kernel: [36164.592301] direct_page_fault+0x206/0x310 [kvm] Aug 22 15:26:30 juju-e4d256-prod-github-runner-207 kernel: [36164.593335] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 15:26:30 juju-e4d256-prod-github-runner-207 kernel: [36164.594349] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 15:26:30 juju-e4d256-prod-github-runner-207 kernel: [36164.595350] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 15:26:30 juju-e4d256-prod-github-runner-207 kernel: [36164.596321] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 15:26:30 juju-e4d256-prod-github-runner-207 kernel: [36164.597279] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 15:26:30 juju-e4d256-prod-github-runner-207 kernel: [36164.598256] handle_exit+0x98/0x230 [kvm_amd] Aug 22 15:26:30 juju-e4d256-prod-github-runner-207 kernel: [36164.599167] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 15:26:30 juju-e4d256-prod-github-runner-207 kernel: [36164.600082] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 15:26:30 juju-e4d256-prod-github-runner-207 kernel: [36164.601016] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 15:26:30 juju-e4d256-prod-github-runner-207 kernel: [36164.601921] vcpu_run+0x62/0x2c0 [kvm] Aug 22 15:26:30 juju-e4d256-prod-github-runner-207 kernel: [36164.602736] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 15:26:30 juju-e4d256-prod-github-runner-207 kernel: [36164.603548] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 15:26:30 juju-e4d256-prod-github-runner-207 kernel: [36164.604399] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 15:26:30 juju-e4d256-prod-github-runner-207 kernel: [36164.605211] ? __seccomp_filter+0x4a/0x4a0 Aug 22 15:26:30 juju-e4d256-prod-github-runner-207 kernel: [36164.605956] ? __fget_files+0x86/0xc0 Aug 22 15:26:30 juju-e4d256-prod-github-runner-207 kernel: [36164.606745] __x64_sys_ioctl+0x95/0xd0 Aug 22 15:26:30 juju-e4d256-prod-github-runner-207 kernel: [36164.607440] do_syscall_64+0x5c/0xc0 Aug 22 15:26:30 juju-e4d256-prod-github-runner-207 kernel: [36164.608105] ? do_futex+0x162/0x1f0 Aug 22 15:26:30 juju-e4d256-prod-github-runner-207 kernel: [36164.608753] ? __x64_sys_futex+0x78/0x1e0 Aug 22 15:26:30 juju-e4d256-prod-github-runner-207 kernel: [36164.609447] ? __secure_computing+0xa9/0x120 Aug 22 15:26:30 juju-e4d256-prod-github-runner-207 kernel: [36164.610145] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 15:26:30 juju-e4d256-prod-github-runner-207 kernel: [36164.610907] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:26:30 juju-e4d256-prod-github-runner-207 kernel: [36164.611628] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:26:30 juju-e4d256-prod-github-runner-207 kernel: [36164.612346] ? do_syscall_64+0x69/0xc0 Aug 22 15:26:30 juju-e4d256-prod-github-runner-207 kernel: [36164.613005] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:26:30 juju-e4d256-prod-github-runner-207 kernel: [36164.613712] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:26:30 juju-e4d256-prod-github-runner-207 kernel: [36164.614412] ? do_syscall_64+0x69/0xc0 Aug 22 15:26:30 juju-e4d256-prod-github-runner-207 kernel: [36164.615037] ? do_syscall_64+0x69/0xc0 Aug 22 15:26:30 juju-e4d256-prod-github-runner-207 kernel: [36164.615984] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 15:26:30 juju-e4d256-prod-github-runner-207 kernel: [36164.616717] RIP: 0033:0x7faa5d0edaff Aug 22 15:26:30 juju-e4d256-prod-github-runner-207 kernel: [36164.617356] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 15:26:30 juju-e4d256-prod-github-runner-207 kernel: [36164.619348] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 15:26:30 juju-e4d256-prod-github-runner-207 kernel: [36164.620265] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 15:26:30 juju-e4d256-prod-github-runner-207 kernel: [36164.621171] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 15:26:30 juju-e4d256-prod-github-runner-207 kernel: [36164.622061] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 15:26:30 juju-e4d256-prod-github-runner-207 kernel: [36164.622949] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 15:26:30 juju-e4d256-prod-github-runner-207 kernel: [36164.623835] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 15:26:30 juju-e4d256-prod-github-runner-207 kernel: [36164.624732] Aug 22 15:26:45 juju-e4d256-prod-github-runner-207 kernel: [36179.600705] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 15:26:45 juju-e4d256-prod-github-runner-207 kernel: [36179.602469] rcu: 1-....: (8987396 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=4342042 Aug 22 15:26:45 juju-e4d256-prod-github-runner-207 kernel: [36179.603770] (t=9015600 jiffies g=23269 q=38016) Aug 22 15:26:45 juju-e4d256-prod-github-runner-207 kernel: [36179.604569] NMI backtrace for cpu 1 Aug 22 15:26:45 juju-e4d256-prod-github-runner-207 kernel: [36179.605302] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 15:26:45 juju-e4d256-prod-github-runner-207 kernel: [36179.606422] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 15:26:45 juju-e4d256-prod-github-runner-207 kernel: [36179.607515] Call Trace: Aug 22 15:26:45 juju-e4d256-prod-github-runner-207 kernel: [36179.608207] Aug 22 15:26:45 juju-e4d256-prod-github-runner-207 kernel: [36179.608892] show_stack+0x52/0x5c Aug 22 15:26:45 juju-e4d256-prod-github-runner-207 kernel: [36179.609646] dump_stack_lvl+0x4a/0x63 Aug 22 15:26:45 juju-e4d256-prod-github-runner-207 kernel: [36179.610420] dump_stack+0x10/0x16 Aug 22 15:26:45 juju-e4d256-prod-github-runner-207 kernel: [36179.611152] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 15:26:45 juju-e4d256-prod-github-runner-207 kernel: [36179.611946] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 15:26:45 juju-e4d256-prod-github-runner-207 kernel: [36179.612748] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 15:26:45 juju-e4d256-prod-github-runner-207 kernel: [36179.613583] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 15:26:45 juju-e4d256-prod-github-runner-207 kernel: [36179.614454] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 15:26:45 juju-e4d256-prod-github-runner-207 kernel: [36179.615447] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 15:26:45 juju-e4d256-prod-github-runner-207 kernel: [36179.616263] print_cpu_stall.cold+0x2f/0xe2 Aug 22 15:26:45 juju-e4d256-prod-github-runner-207 kernel: [36179.617068] ? timekeeping_update+0xf7/0x150 Aug 22 15:26:45 juju-e4d256-prod-github-runner-207 kernel: [36179.617854] check_cpu_stall+0x109/0x270 Aug 22 15:26:45 juju-e4d256-prod-github-runner-207 kernel: [36179.618613] rcu_sched_clock_irq+0x9a/0x250 Aug 22 15:26:45 juju-e4d256-prod-github-runner-207 kernel: [36179.619389] update_process_times+0x94/0xd0 Aug 22 15:26:45 juju-e4d256-prod-github-runner-207 kernel: [36179.620218] tick_sched_handle+0x29/0x70 Aug 22 15:26:45 juju-e4d256-prod-github-runner-207 kernel: [36179.621003] tick_sched_timer+0x8c/0xc0 Aug 22 15:26:45 juju-e4d256-prod-github-runner-207 kernel: [36179.621751] ? tick_nohz_handler+0xb0/0xb0 Aug 22 15:26:45 juju-e4d256-prod-github-runner-207 kernel: [36179.622533] __hrtimer_run_queues+0x107/0x230 Aug 22 15:26:45 juju-e4d256-prod-github-runner-207 kernel: [36179.623320] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 15:26:45 juju-e4d256-prod-github-runner-207 kernel: [36179.624108] hrtimer_interrupt+0x101/0x220 Aug 22 15:26:45 juju-e4d256-prod-github-runner-207 kernel: [36179.624887] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 15:26:45 juju-e4d256-prod-github-runner-207 kernel: [36179.625712] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 15:26:45 juju-e4d256-prod-github-runner-207 kernel: [36179.626526] Aug 22 15:26:45 juju-e4d256-prod-github-runner-207 kernel: [36179.627168] Aug 22 15:26:45 juju-e4d256-prod-github-runner-207 kernel: [36179.627838] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 15:26:45 juju-e4d256-prod-github-runner-207 kernel: [36179.628715] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:26:45 juju-e4d256-prod-github-runner-207 kernel: [36179.629619] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 15:26:45 juju-e4d256-prod-github-runner-207 kernel: [36179.631866] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 15:26:45 juju-e4d256-prod-github-runner-207 kernel: [36179.632766] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 15:26:45 juju-e4d256-prod-github-runner-207 kernel: [36179.633795] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 15:26:45 juju-e4d256-prod-github-runner-207 kernel: [36179.634799] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 15:26:45 juju-e4d256-prod-github-runner-207 kernel: [36179.635801] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 15:26:45 juju-e4d256-prod-github-runner-207 kernel: [36179.636843] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 15:26:45 juju-e4d256-prod-github-runner-207 kernel: [36179.637820] ? _raw_spin_lock+0x22/0x30 Aug 22 15:26:45 juju-e4d256-prod-github-runner-207 kernel: [36179.638599] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:26:45 juju-e4d256-prod-github-runner-207 kernel: [36179.639475] direct_page_fault+0x206/0x310 [kvm] Aug 22 15:26:45 juju-e4d256-prod-github-runner-207 kernel: [36179.640368] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 15:26:45 juju-e4d256-prod-github-runner-207 kernel: [36179.641261] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 15:26:45 juju-e4d256-prod-github-runner-207 kernel: [36179.642120] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 15:26:45 juju-e4d256-prod-github-runner-207 kernel: [36179.642965] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 15:26:45 juju-e4d256-prod-github-runner-207 kernel: [36179.643761] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 15:26:45 juju-e4d256-prod-github-runner-207 kernel: [36179.644603] handle_exit+0x98/0x230 [kvm_amd] Aug 22 15:26:45 juju-e4d256-prod-github-runner-207 kernel: [36179.645382] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 15:26:45 juju-e4d256-prod-github-runner-207 kernel: [36179.646172] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 15:26:45 juju-e4d256-prod-github-runner-207 kernel: [36179.647008] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 15:26:45 juju-e4d256-prod-github-runner-207 kernel: [36179.647821] vcpu_run+0x62/0x2c0 [kvm] Aug 22 15:26:45 juju-e4d256-prod-github-runner-207 kernel: [36179.648552] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 15:26:45 juju-e4d256-prod-github-runner-207 kernel: [36179.649314] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 15:26:45 juju-e4d256-prod-github-runner-207 kernel: [36179.650131] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 15:26:45 juju-e4d256-prod-github-runner-207 kernel: [36179.650900] ? __seccomp_filter+0x4a/0x4a0 Aug 22 15:26:45 juju-e4d256-prod-github-runner-207 kernel: [36179.651632] ? __fget_files+0x86/0xc0 Aug 22 15:26:45 juju-e4d256-prod-github-runner-207 kernel: [36179.652334] __x64_sys_ioctl+0x95/0xd0 Aug 22 15:26:45 juju-e4d256-prod-github-runner-207 kernel: [36179.653092] do_syscall_64+0x5c/0xc0 Aug 22 15:26:45 juju-e4d256-prod-github-runner-207 kernel: [36179.653983] ? do_futex+0x162/0x1f0 Aug 22 15:26:45 juju-e4d256-prod-github-runner-207 kernel: [36179.654717] ? __x64_sys_futex+0x78/0x1e0 Aug 22 15:26:45 juju-e4d256-prod-github-runner-207 kernel: [36179.655484] ? __secure_computing+0xa9/0x120 Aug 22 15:26:45 juju-e4d256-prod-github-runner-207 kernel: [36179.656235] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 15:26:45 juju-e4d256-prod-github-runner-207 kernel: [36179.657069] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:26:45 juju-e4d256-prod-github-runner-207 kernel: [36179.657857] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:26:45 juju-e4d256-prod-github-runner-207 kernel: [36179.658629] ? do_syscall_64+0x69/0xc0 Aug 22 15:26:45 juju-e4d256-prod-github-runner-207 kernel: [36179.659340] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:26:45 juju-e4d256-prod-github-runner-207 kernel: [36179.660113] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:26:45 juju-e4d256-prod-github-runner-207 kernel: [36179.660968] ? do_syscall_64+0x69/0xc0 Aug 22 15:26:45 juju-e4d256-prod-github-runner-207 kernel: [36179.661683] ? do_syscall_64+0x69/0xc0 Aug 22 15:26:45 juju-e4d256-prod-github-runner-207 kernel: [36179.662385] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 15:26:45 juju-e4d256-prod-github-runner-207 kernel: [36179.663178] RIP: 0033:0x7faa5d0edaff Aug 22 15:26:45 juju-e4d256-prod-github-runner-207 kernel: [36179.663920] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 15:26:45 juju-e4d256-prod-github-runner-207 kernel: [36179.666099] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 15:26:45 juju-e4d256-prod-github-runner-207 kernel: [36179.667130] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 15:26:45 juju-e4d256-prod-github-runner-207 kernel: [36179.668133] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 15:26:45 juju-e4d256-prod-github-runner-207 kernel: [36179.669112] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 15:26:45 juju-e4d256-prod-github-runner-207 kernel: [36179.670097] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 15:26:45 juju-e4d256-prod-github-runner-207 kernel: [36179.671067] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 15:26:45 juju-e4d256-prod-github-runner-207 kernel: [36179.672008] Aug 22 15:27:10 juju-e4d256-prod-github-runner-207 kernel: [36204.541982] watchdog: BUG: soft lockup - CPU#1 stuck for 33610s! [qemu-system-x86:6715] Aug 22 15:27:10 juju-e4d256-prod-github-runner-207 kernel: [36204.543138] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 15:27:10 juju-e4d256-prod-github-runner-207 kernel: [36204.543490] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 15:27:10 juju-e4d256-prod-github-runner-207 kernel: [36204.555973] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 15:27:10 juju-e4d256-prod-github-runner-207 kernel: [36204.557264] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 15:27:10 juju-e4d256-prod-github-runner-207 kernel: [36204.558503] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:27:10 juju-e4d256-prod-github-runner-207 kernel: [36204.559571] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 15:27:10 juju-e4d256-prod-github-runner-207 kernel: [36204.562185] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 15:27:10 juju-e4d256-prod-github-runner-207 kernel: [36204.563241] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 15:27:10 juju-e4d256-prod-github-runner-207 kernel: [36204.564436] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 15:27:10 juju-e4d256-prod-github-runner-207 kernel: [36204.565617] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 15:27:10 juju-e4d256-prod-github-runner-207 kernel: [36204.566796] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 15:27:10 juju-e4d256-prod-github-runner-207 kernel: [36204.567983] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 15:27:10 juju-e4d256-prod-github-runner-207 kernel: [36204.569174] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 15:27:10 juju-e4d256-prod-github-runner-207 kernel: [36204.570432] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 15:27:10 juju-e4d256-prod-github-runner-207 kernel: [36204.571542] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 15:27:10 juju-e4d256-prod-github-runner-207 kernel: [36204.572757] Call Trace: Aug 22 15:27:10 juju-e4d256-prod-github-runner-207 kernel: [36204.573681] Aug 22 15:27:10 juju-e4d256-prod-github-runner-207 kernel: [36204.574569] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:27:10 juju-e4d256-prod-github-runner-207 kernel: [36204.575622] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:27:10 juju-e4d256-prod-github-runner-207 kernel: [36204.576668] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:27:10 juju-e4d256-prod-github-runner-207 kernel: [36204.577756] ? show_regs.part.0+0x23/0x29 Aug 22 15:27:10 juju-e4d256-prod-github-runner-207 kernel: [36204.578761] ? show_regs.cold+0x8/0xd Aug 22 15:27:10 juju-e4d256-prod-github-runner-207 kernel: [36204.579751] ? watchdog_timer_fn+0x1be/0x220 Aug 22 15:27:10 juju-e4d256-prod-github-runner-207 kernel: [36204.580799] ? lockup_detector_update_enable+0x60/0x60 Aug 22 15:27:10 juju-e4d256-prod-github-runner-207 kernel: [36204.581882] ? __hrtimer_run_queues+0x107/0x230 Aug 22 15:27:10 juju-e4d256-prod-github-runner-207 kernel: [36204.582934] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 15:27:10 juju-e4d256-prod-github-runner-207 kernel: [36204.583978] ? hrtimer_interrupt+0x101/0x220 Aug 22 15:27:10 juju-e4d256-prod-github-runner-207 kernel: [36204.585286] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 15:27:10 juju-e4d256-prod-github-runner-207 kernel: [36204.586479] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 15:27:10 juju-e4d256-prod-github-runner-207 kernel: [36204.587745] Aug 22 15:27:10 juju-e4d256-prod-github-runner-207 kernel: [36204.588621] Aug 22 15:27:10 juju-e4d256-prod-github-runner-207 kernel: [36204.589473] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 15:27:10 juju-e4d256-prod-github-runner-207 kernel: [36204.590537] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:27:10 juju-e4d256-prod-github-runner-207 kernel: [36204.591619] ? _raw_spin_lock+0x22/0x30 Aug 22 15:27:10 juju-e4d256-prod-github-runner-207 kernel: [36204.592616] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:27:10 juju-e4d256-prod-github-runner-207 kernel: [36204.593664] direct_page_fault+0x206/0x310 [kvm] Aug 22 15:27:10 juju-e4d256-prod-github-runner-207 kernel: [36204.594710] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 15:27:10 juju-e4d256-prod-github-runner-207 kernel: [36204.595738] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 15:27:10 juju-e4d256-prod-github-runner-207 kernel: [36204.596834] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 15:27:10 juju-e4d256-prod-github-runner-207 kernel: [36204.597836] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 15:27:10 juju-e4d256-prod-github-runner-207 kernel: [36204.598794] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 15:27:10 juju-e4d256-prod-github-runner-207 kernel: [36204.599794] handle_exit+0x98/0x230 [kvm_amd] Aug 22 15:27:10 juju-e4d256-prod-github-runner-207 kernel: [36204.600719] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 15:27:10 juju-e4d256-prod-github-runner-207 kernel: [36204.601655] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 15:27:10 juju-e4d256-prod-github-runner-207 kernel: [36204.602603] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 15:27:10 juju-e4d256-prod-github-runner-207 kernel: [36204.603529] vcpu_run+0x62/0x2c0 [kvm] Aug 22 15:27:10 juju-e4d256-prod-github-runner-207 kernel: [36204.604371] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 15:27:10 juju-e4d256-prod-github-runner-207 kernel: [36204.607319] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 15:27:10 juju-e4d256-prod-github-runner-207 kernel: [36204.608226] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 15:27:10 juju-e4d256-prod-github-runner-207 kernel: [36204.609058] ? __seccomp_filter+0x4a/0x4a0 Aug 22 15:27:10 juju-e4d256-prod-github-runner-207 kernel: [36204.609827] ? __fget_files+0x86/0xc0 Aug 22 15:27:10 juju-e4d256-prod-github-runner-207 kernel: [36204.610754] __x64_sys_ioctl+0x95/0xd0 Aug 22 15:27:10 juju-e4d256-prod-github-runner-207 kernel: [36204.611463] do_syscall_64+0x5c/0xc0 Aug 22 15:27:10 juju-e4d256-prod-github-runner-207 kernel: [36204.612141] ? do_futex+0x162/0x1f0 Aug 22 15:27:10 juju-e4d256-prod-github-runner-207 kernel: [36204.612830] ? __x64_sys_futex+0x78/0x1e0 Aug 22 15:27:10 juju-e4d256-prod-github-runner-207 kernel: [36204.613533] ? __secure_computing+0xa9/0x120 Aug 22 15:27:10 juju-e4d256-prod-github-runner-207 kernel: [36204.614259] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 15:27:10 juju-e4d256-prod-github-runner-207 kernel: [36204.615044] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:27:10 juju-e4d256-prod-github-runner-207 kernel: [36204.615785] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:27:10 juju-e4d256-prod-github-runner-207 kernel: [36204.616541] ? do_syscall_64+0x69/0xc0 Aug 22 15:27:10 juju-e4d256-prod-github-runner-207 kernel: [36204.617205] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:27:10 juju-e4d256-prod-github-runner-207 kernel: [36204.617931] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:27:10 juju-e4d256-prod-github-runner-207 kernel: [36204.618651] ? do_syscall_64+0x69/0xc0 Aug 22 15:27:10 juju-e4d256-prod-github-runner-207 kernel: [36204.619310] ? do_syscall_64+0x69/0xc0 Aug 22 15:27:10 juju-e4d256-prod-github-runner-207 kernel: [36204.619953] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 15:27:10 juju-e4d256-prod-github-runner-207 kernel: [36204.620712] RIP: 0033:0x7faa5d0edaff Aug 22 15:27:10 juju-e4d256-prod-github-runner-207 kernel: [36204.621348] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 15:27:10 juju-e4d256-prod-github-runner-207 kernel: [36204.623399] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 15:27:10 juju-e4d256-prod-github-runner-207 kernel: [36204.624347] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 15:27:10 juju-e4d256-prod-github-runner-207 kernel: [36204.625258] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 15:27:10 juju-e4d256-prod-github-runner-207 kernel: [36204.626182] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 15:27:10 juju-e4d256-prod-github-runner-207 kernel: [36204.627112] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 15:27:10 juju-e4d256-prod-github-runner-207 kernel: [36204.628032] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 15:27:10 juju-e4d256-prod-github-runner-207 kernel: [36204.628992] Aug 22 15:27:38 juju-e4d256-prod-github-runner-207 kernel: [36232.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 33636s! [qemu-system-x86:6715] Aug 22 15:27:38 juju-e4d256-prod-github-runner-207 kernel: [36232.543909] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 15:27:38 juju-e4d256-prod-github-runner-207 kernel: [36232.544240] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 15:27:38 juju-e4d256-prod-github-runner-207 kernel: [36232.556455] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 15:27:38 juju-e4d256-prod-github-runner-207 kernel: [36232.557736] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 15:27:38 juju-e4d256-prod-github-runner-207 kernel: [36232.558973] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:27:38 juju-e4d256-prod-github-runner-207 kernel: [36232.560039] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 15:27:38 juju-e4d256-prod-github-runner-207 kernel: [36232.562583] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 15:27:38 juju-e4d256-prod-github-runner-207 kernel: [36232.563633] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 15:27:38 juju-e4d256-prod-github-runner-207 kernel: [36232.564810] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 15:27:38 juju-e4d256-prod-github-runner-207 kernel: [36232.566007] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 15:27:38 juju-e4d256-prod-github-runner-207 kernel: [36232.567170] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 15:27:38 juju-e4d256-prod-github-runner-207 kernel: [36232.568342] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 15:27:38 juju-e4d256-prod-github-runner-207 kernel: [36232.569580] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 15:27:38 juju-e4d256-prod-github-runner-207 kernel: [36232.570812] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 15:27:38 juju-e4d256-prod-github-runner-207 kernel: [36232.571909] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 15:27:38 juju-e4d256-prod-github-runner-207 kernel: [36232.573109] Call Trace: Aug 22 15:27:38 juju-e4d256-prod-github-runner-207 kernel: [36232.574019] Aug 22 15:27:38 juju-e4d256-prod-github-runner-207 kernel: [36232.574916] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:27:38 juju-e4d256-prod-github-runner-207 kernel: [36232.575944] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:27:38 juju-e4d256-prod-github-runner-207 kernel: [36232.576972] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:27:38 juju-e4d256-prod-github-runner-207 kernel: [36232.578064] ? show_regs.part.0+0x23/0x29 Aug 22 15:27:38 juju-e4d256-prod-github-runner-207 kernel: [36232.579059] ? show_regs.cold+0x8/0xd Aug 22 15:27:38 juju-e4d256-prod-github-runner-207 kernel: [36232.580037] ? watchdog_timer_fn+0x1be/0x220 Aug 22 15:27:38 juju-e4d256-prod-github-runner-207 kernel: [36232.581064] ? lockup_detector_update_enable+0x60/0x60 Aug 22 15:27:38 juju-e4d256-prod-github-runner-207 kernel: [36232.582126] ? __hrtimer_run_queues+0x107/0x230 Aug 22 15:27:38 juju-e4d256-prod-github-runner-207 kernel: [36232.583152] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 15:27:38 juju-e4d256-prod-github-runner-207 kernel: [36232.584183] ? hrtimer_interrupt+0x101/0x220 Aug 22 15:27:38 juju-e4d256-prod-github-runner-207 kernel: [36232.585203] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 15:27:38 juju-e4d256-prod-github-runner-207 kernel: [36232.586269] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 15:27:38 juju-e4d256-prod-github-runner-207 kernel: [36232.587314] Aug 22 15:27:38 juju-e4d256-prod-github-runner-207 kernel: [36232.588176] Aug 22 15:27:38 juju-e4d256-prod-github-runner-207 kernel: [36232.589011] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 15:27:38 juju-e4d256-prod-github-runner-207 kernel: [36232.590043] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:27:38 juju-e4d256-prod-github-runner-207 kernel: [36232.591085] ? _raw_spin_lock+0x22/0x30 Aug 22 15:27:38 juju-e4d256-prod-github-runner-207 kernel: [36232.592042] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:27:38 juju-e4d256-prod-github-runner-207 kernel: [36232.593057] direct_page_fault+0x206/0x310 [kvm] Aug 22 15:27:38 juju-e4d256-prod-github-runner-207 kernel: [36232.594079] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 15:27:38 juju-e4d256-prod-github-runner-207 kernel: [36232.595086] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 15:27:38 juju-e4d256-prod-github-runner-207 kernel: [36232.596092] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 15:27:38 juju-e4d256-prod-github-runner-207 kernel: [36232.597088] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 15:27:38 juju-e4d256-prod-github-runner-207 kernel: [36232.598031] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 15:27:38 juju-e4d256-prod-github-runner-207 kernel: [36232.599008] handle_exit+0x98/0x230 [kvm_amd] Aug 22 15:27:38 juju-e4d256-prod-github-runner-207 kernel: [36232.599899] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 15:27:38 juju-e4d256-prod-github-runner-207 kernel: [36232.600830] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 15:27:38 juju-e4d256-prod-github-runner-207 kernel: [36232.601759] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 15:27:38 juju-e4d256-prod-github-runner-207 kernel: [36232.602665] vcpu_run+0x62/0x2c0 [kvm] Aug 22 15:27:38 juju-e4d256-prod-github-runner-207 kernel: [36232.603473] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 15:27:38 juju-e4d256-prod-github-runner-207 kernel: [36232.604287] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 15:27:38 juju-e4d256-prod-github-runner-207 kernel: [36232.605141] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 15:27:38 juju-e4d256-prod-github-runner-207 kernel: [36232.605947] ? __seccomp_filter+0x4a/0x4a0 Aug 22 15:27:38 juju-e4d256-prod-github-runner-207 kernel: [36232.606700] ? __fget_files+0x86/0xc0 Aug 22 15:27:38 juju-e4d256-prod-github-runner-207 kernel: [36232.607402] __x64_sys_ioctl+0x95/0xd0 Aug 22 15:27:38 juju-e4d256-prod-github-runner-207 kernel: [36232.608109] do_syscall_64+0x5c/0xc0 Aug 22 15:27:38 juju-e4d256-prod-github-runner-207 kernel: [36232.608784] ? do_futex+0x162/0x1f0 Aug 22 15:27:38 juju-e4d256-prod-github-runner-207 kernel: [36232.609431] ? __x64_sys_futex+0x78/0x1e0 Aug 22 15:27:38 juju-e4d256-prod-github-runner-207 kernel: [36232.610104] ? __secure_computing+0xa9/0x120 Aug 22 15:27:38 juju-e4d256-prod-github-runner-207 kernel: [36232.610797] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 15:27:38 juju-e4d256-prod-github-runner-207 kernel: [36232.611555] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:27:38 juju-e4d256-prod-github-runner-207 kernel: [36232.612289] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:27:38 juju-e4d256-prod-github-runner-207 kernel: [36232.613006] ? do_syscall_64+0x69/0xc0 Aug 22 15:27:38 juju-e4d256-prod-github-runner-207 kernel: [36232.613650] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:27:38 juju-e4d256-prod-github-runner-207 kernel: [36232.614380] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:27:38 juju-e4d256-prod-github-runner-207 kernel: [36232.615072] ? do_syscall_64+0x69/0xc0 Aug 22 15:27:38 juju-e4d256-prod-github-runner-207 kernel: [36232.615696] ? do_syscall_64+0x69/0xc0 Aug 22 15:27:38 juju-e4d256-prod-github-runner-207 kernel: [36232.616373] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 15:27:38 juju-e4d256-prod-github-runner-207 kernel: [36232.617077] RIP: 0033:0x7faa5d0edaff Aug 22 15:27:38 juju-e4d256-prod-github-runner-207 kernel: [36232.617730] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 15:27:38 juju-e4d256-prod-github-runner-207 kernel: [36232.619718] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 15:27:38 juju-e4d256-prod-github-runner-207 kernel: [36232.620637] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 15:27:38 juju-e4d256-prod-github-runner-207 kernel: [36232.621528] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 15:27:38 juju-e4d256-prod-github-runner-207 kernel: [36232.622421] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 15:27:38 juju-e4d256-prod-github-runner-207 kernel: [36232.623308] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 15:27:38 juju-e4d256-prod-github-runner-207 kernel: [36232.624203] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 15:27:38 juju-e4d256-prod-github-runner-207 kernel: [36232.625111] Aug 22 15:28:06 juju-e4d256-prod-github-runner-207 kernel: [36260.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 33662s! [qemu-system-x86:6715] Aug 22 15:28:06 juju-e4d256-prod-github-runner-207 kernel: [36260.543861] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 15:28:06 juju-e4d256-prod-github-runner-207 kernel: [36260.544168] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 15:28:06 juju-e4d256-prod-github-runner-207 kernel: [36260.556295] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 15:28:06 juju-e4d256-prod-github-runner-207 kernel: [36260.557576] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 15:28:06 juju-e4d256-prod-github-runner-207 kernel: [36260.558799] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:28:06 juju-e4d256-prod-github-runner-207 kernel: [36260.559881] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 15:28:06 juju-e4d256-prod-github-runner-207 kernel: [36260.562435] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 15:28:06 juju-e4d256-prod-github-runner-207 kernel: [36260.563491] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 15:28:06 juju-e4d256-prod-github-runner-207 kernel: [36260.564675] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 15:28:06 juju-e4d256-prod-github-runner-207 kernel: [36260.565836] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 15:28:06 juju-e4d256-prod-github-runner-207 kernel: [36260.567006] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 15:28:06 juju-e4d256-prod-github-runner-207 kernel: [36260.568177] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 15:28:06 juju-e4d256-prod-github-runner-207 kernel: [36260.569344] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 15:28:06 juju-e4d256-prod-github-runner-207 kernel: [36260.570580] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 15:28:06 juju-e4d256-prod-github-runner-207 kernel: [36260.571691] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 15:28:06 juju-e4d256-prod-github-runner-207 kernel: [36260.572885] Call Trace: Aug 22 15:28:06 juju-e4d256-prod-github-runner-207 kernel: [36260.573806] Aug 22 15:28:06 juju-e4d256-prod-github-runner-207 kernel: [36260.574704] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:28:06 juju-e4d256-prod-github-runner-207 kernel: [36260.575747] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:28:06 juju-e4d256-prod-github-runner-207 kernel: [36260.576773] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:28:06 juju-e4d256-prod-github-runner-207 kernel: [36260.577867] ? show_regs.part.0+0x23/0x29 Aug 22 15:28:06 juju-e4d256-prod-github-runner-207 kernel: [36260.578866] ? show_regs.cold+0x8/0xd Aug 22 15:28:06 juju-e4d256-prod-github-runner-207 kernel: [36260.579847] ? watchdog_timer_fn+0x1be/0x220 Aug 22 15:28:06 juju-e4d256-prod-github-runner-207 kernel: [36260.580854] ? lockup_detector_update_enable+0x60/0x60 Aug 22 15:28:06 juju-e4d256-prod-github-runner-207 kernel: [36260.581925] ? __hrtimer_run_queues+0x107/0x230 Aug 22 15:28:06 juju-e4d256-prod-github-runner-207 kernel: [36260.582958] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 15:28:06 juju-e4d256-prod-github-runner-207 kernel: [36260.584004] ? hrtimer_interrupt+0x101/0x220 Aug 22 15:28:06 juju-e4d256-prod-github-runner-207 kernel: [36260.585027] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 15:28:06 juju-e4d256-prod-github-runner-207 kernel: [36260.586097] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 15:28:06 juju-e4d256-prod-github-runner-207 kernel: [36260.587143] Aug 22 15:28:06 juju-e4d256-prod-github-runner-207 kernel: [36260.588006] Aug 22 15:28:06 juju-e4d256-prod-github-runner-207 kernel: [36260.588848] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 15:28:06 juju-e4d256-prod-github-runner-207 kernel: [36260.589888] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:28:06 juju-e4d256-prod-github-runner-207 kernel: [36260.590925] ? _raw_spin_lock+0x22/0x30 Aug 22 15:28:06 juju-e4d256-prod-github-runner-207 kernel: [36260.591878] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:28:06 juju-e4d256-prod-github-runner-207 kernel: [36260.592902] direct_page_fault+0x206/0x310 [kvm] Aug 22 15:28:06 juju-e4d256-prod-github-runner-207 kernel: [36260.593933] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 15:28:06 juju-e4d256-prod-github-runner-207 kernel: [36260.594948] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 15:28:06 juju-e4d256-prod-github-runner-207 kernel: [36260.595963] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 15:28:06 juju-e4d256-prod-github-runner-207 kernel: [36260.596967] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 15:28:06 juju-e4d256-prod-github-runner-207 kernel: [36260.597932] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 15:28:06 juju-e4d256-prod-github-runner-207 kernel: [36260.598909] handle_exit+0x98/0x230 [kvm_amd] Aug 22 15:28:06 juju-e4d256-prod-github-runner-207 kernel: [36260.599816] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 15:28:06 juju-e4d256-prod-github-runner-207 kernel: [36260.600730] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 15:28:06 juju-e4d256-prod-github-runner-207 kernel: [36260.601668] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 15:28:06 juju-e4d256-prod-github-runner-207 kernel: [36260.602587] vcpu_run+0x62/0x2c0 [kvm] Aug 22 15:28:06 juju-e4d256-prod-github-runner-207 kernel: [36260.603402] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 15:28:06 juju-e4d256-prod-github-runner-207 kernel: [36260.604217] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 15:28:06 juju-e4d256-prod-github-runner-207 kernel: [36260.605071] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 15:28:06 juju-e4d256-prod-github-runner-207 kernel: [36260.605867] ? __seccomp_filter+0x4a/0x4a0 Aug 22 15:28:06 juju-e4d256-prod-github-runner-207 kernel: [36260.606610] ? __fget_files+0x86/0xc0 Aug 22 15:28:06 juju-e4d256-prod-github-runner-207 kernel: [36260.607318] __x64_sys_ioctl+0x95/0xd0 Aug 22 15:28:06 juju-e4d256-prod-github-runner-207 kernel: [36260.608021] do_syscall_64+0x5c/0xc0 Aug 22 15:28:06 juju-e4d256-prod-github-runner-207 kernel: [36260.608917] ? do_futex+0x162/0x1f0 Aug 22 15:28:06 juju-e4d256-prod-github-runner-207 kernel: [36260.609575] ? __x64_sys_futex+0x78/0x1e0 Aug 22 15:28:06 juju-e4d256-prod-github-runner-207 kernel: [36260.610251] ? __secure_computing+0xa9/0x120 Aug 22 15:28:06 juju-e4d256-prod-github-runner-207 kernel: [36260.610947] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 15:28:06 juju-e4d256-prod-github-runner-207 kernel: [36260.611723] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:28:06 juju-e4d256-prod-github-runner-207 kernel: [36260.612449] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:28:06 juju-e4d256-prod-github-runner-207 kernel: [36260.613170] ? do_syscall_64+0x69/0xc0 Aug 22 15:28:06 juju-e4d256-prod-github-runner-207 kernel: [36260.613819] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:28:06 juju-e4d256-prod-github-runner-207 kernel: [36260.614533] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:28:06 juju-e4d256-prod-github-runner-207 kernel: [36260.615235] ? do_syscall_64+0x69/0xc0 Aug 22 15:28:06 juju-e4d256-prod-github-runner-207 kernel: [36260.615872] ? do_syscall_64+0x69/0xc0 Aug 22 15:28:06 juju-e4d256-prod-github-runner-207 kernel: [36260.616500] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 15:28:06 juju-e4d256-prod-github-runner-207 kernel: [36260.617208] RIP: 0033:0x7faa5d0edaff Aug 22 15:28:06 juju-e4d256-prod-github-runner-207 kernel: [36260.617875] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 15:28:06 juju-e4d256-prod-github-runner-207 kernel: [36260.619877] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 15:28:06 juju-e4d256-prod-github-runner-207 kernel: [36260.620820] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 15:28:06 juju-e4d256-prod-github-runner-207 kernel: [36260.621723] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 15:28:06 juju-e4d256-prod-github-runner-207 kernel: [36260.622656] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 15:28:06 juju-e4d256-prod-github-runner-207 kernel: [36260.623543] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 15:28:06 juju-e4d256-prod-github-runner-207 kernel: [36260.624451] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 15:28:06 juju-e4d256-prod-github-runner-207 kernel: [36260.625348] Aug 22 15:28:34 juju-e4d256-prod-github-runner-207 kernel: [36288.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 33688s! [qemu-system-x86:6715] Aug 22 15:28:34 juju-e4d256-prod-github-runner-207 kernel: [36288.543934] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 15:28:34 juju-e4d256-prod-github-runner-207 kernel: [36288.544243] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 15:28:34 juju-e4d256-prod-github-runner-207 kernel: [36288.556781] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 15:28:34 juju-e4d256-prod-github-runner-207 kernel: [36288.558055] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 15:28:34 juju-e4d256-prod-github-runner-207 kernel: [36288.559274] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:28:34 juju-e4d256-prod-github-runner-207 kernel: [36288.560355] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 15:28:34 juju-e4d256-prod-github-runner-207 kernel: [36288.563010] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 15:28:34 juju-e4d256-prod-github-runner-207 kernel: [36288.564168] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 15:28:34 juju-e4d256-prod-github-runner-207 kernel: [36288.565658] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 15:28:34 juju-e4d256-prod-github-runner-207 kernel: [36288.566850] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 15:28:34 juju-e4d256-prod-github-runner-207 kernel: [36288.568035] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 15:28:34 juju-e4d256-prod-github-runner-207 kernel: [36288.569199] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 15:28:34 juju-e4d256-prod-github-runner-207 kernel: [36288.570365] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 15:28:34 juju-e4d256-prod-github-runner-207 kernel: [36288.571613] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 15:28:34 juju-e4d256-prod-github-runner-207 kernel: [36288.572716] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 15:28:34 juju-e4d256-prod-github-runner-207 kernel: [36288.573909] Call Trace: Aug 22 15:28:34 juju-e4d256-prod-github-runner-207 kernel: [36288.574822] Aug 22 15:28:34 juju-e4d256-prod-github-runner-207 kernel: [36288.575733] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:28:34 juju-e4d256-prod-github-runner-207 kernel: [36288.576766] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:28:34 juju-e4d256-prod-github-runner-207 kernel: [36288.577819] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:28:34 juju-e4d256-prod-github-runner-207 kernel: [36288.578937] ? show_regs.part.0+0x23/0x29 Aug 22 15:28:34 juju-e4d256-prod-github-runner-207 kernel: [36288.579957] ? show_regs.cold+0x8/0xd Aug 22 15:28:34 juju-e4d256-prod-github-runner-207 kernel: [36288.580930] ? watchdog_timer_fn+0x1be/0x220 Aug 22 15:28:34 juju-e4d256-prod-github-runner-207 kernel: [36288.581943] ? lockup_detector_update_enable+0x60/0x60 Aug 22 15:28:34 juju-e4d256-prod-github-runner-207 kernel: [36288.583004] ? __hrtimer_run_queues+0x107/0x230 Aug 22 15:28:34 juju-e4d256-prod-github-runner-207 kernel: [36288.584039] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 15:28:34 juju-e4d256-prod-github-runner-207 kernel: [36288.585069] ? hrtimer_interrupt+0x101/0x220 Aug 22 15:28:34 juju-e4d256-prod-github-runner-207 kernel: [36288.586086] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 15:28:34 juju-e4d256-prod-github-runner-207 kernel: [36288.587160] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 15:28:34 juju-e4d256-prod-github-runner-207 kernel: [36288.588299] Aug 22 15:28:34 juju-e4d256-prod-github-runner-207 kernel: [36288.589152] Aug 22 15:28:34 juju-e4d256-prod-github-runner-207 kernel: [36288.589997] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 15:28:34 juju-e4d256-prod-github-runner-207 kernel: [36288.591038] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:28:34 juju-e4d256-prod-github-runner-207 kernel: [36288.592103] ? _raw_spin_lock+0x22/0x30 Aug 22 15:28:34 juju-e4d256-prod-github-runner-207 kernel: [36288.593051] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:28:34 juju-e4d256-prod-github-runner-207 kernel: [36288.594076] direct_page_fault+0x206/0x310 [kvm] Aug 22 15:28:34 juju-e4d256-prod-github-runner-207 kernel: [36288.595150] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 15:28:34 juju-e4d256-prod-github-runner-207 kernel: [36288.596181] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 15:28:34 juju-e4d256-prod-github-runner-207 kernel: [36288.597191] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 15:28:34 juju-e4d256-prod-github-runner-207 kernel: [36288.598204] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 15:28:34 juju-e4d256-prod-github-runner-207 kernel: [36288.599153] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 15:28:34 juju-e4d256-prod-github-runner-207 kernel: [36288.600192] handle_exit+0x98/0x230 [kvm_amd] Aug 22 15:28:34 juju-e4d256-prod-github-runner-207 kernel: [36288.601090] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 15:28:34 juju-e4d256-prod-github-runner-207 kernel: [36288.602014] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 15:28:34 juju-e4d256-prod-github-runner-207 kernel: [36288.602943] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 15:28:34 juju-e4d256-prod-github-runner-207 kernel: [36288.603872] vcpu_run+0x62/0x2c0 [kvm] Aug 22 15:28:34 juju-e4d256-prod-github-runner-207 kernel: [36288.604686] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 15:28:34 juju-e4d256-prod-github-runner-207 kernel: [36288.605497] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 15:28:34 juju-e4d256-prod-github-runner-207 kernel: [36288.606355] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 15:28:34 juju-e4d256-prod-github-runner-207 kernel: [36288.607156] ? __seccomp_filter+0x4a/0x4a0 Aug 22 15:28:34 juju-e4d256-prod-github-runner-207 kernel: [36288.607934] ? __fget_files+0x86/0xc0 Aug 22 15:28:34 juju-e4d256-prod-github-runner-207 kernel: [36288.608656] __x64_sys_ioctl+0x95/0xd0 Aug 22 15:28:34 juju-e4d256-prod-github-runner-207 kernel: [36288.609355] do_syscall_64+0x5c/0xc0 Aug 22 15:28:34 juju-e4d256-prod-github-runner-207 kernel: [36288.610024] ? do_futex+0x162/0x1f0 Aug 22 15:28:34 juju-e4d256-prod-github-runner-207 kernel: [36288.610684] ? __x64_sys_futex+0x78/0x1e0 Aug 22 15:28:34 juju-e4d256-prod-github-runner-207 kernel: [36288.611379] ? __secure_computing+0xa9/0x120 Aug 22 15:28:34 juju-e4d256-prod-github-runner-207 kernel: [36288.612075] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 15:28:34 juju-e4d256-prod-github-runner-207 kernel: [36288.612838] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:28:34 juju-e4d256-prod-github-runner-207 kernel: [36288.613565] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:28:34 juju-e4d256-prod-github-runner-207 kernel: [36288.614283] ? do_syscall_64+0x69/0xc0 Aug 22 15:28:34 juju-e4d256-prod-github-runner-207 kernel: [36288.614939] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:28:34 juju-e4d256-prod-github-runner-207 kernel: [36288.615650] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:28:34 juju-e4d256-prod-github-runner-207 kernel: [36288.616351] ? do_syscall_64+0x69/0xc0 Aug 22 15:28:34 juju-e4d256-prod-github-runner-207 kernel: [36288.616976] ? do_syscall_64+0x69/0xc0 Aug 22 15:28:34 juju-e4d256-prod-github-runner-207 kernel: [36288.617617] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 15:28:34 juju-e4d256-prod-github-runner-207 kernel: [36288.618332] RIP: 0033:0x7faa5d0edaff Aug 22 15:28:34 juju-e4d256-prod-github-runner-207 kernel: [36288.619006] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 15:28:34 juju-e4d256-prod-github-runner-207 kernel: [36288.621015] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 15:28:34 juju-e4d256-prod-github-runner-207 kernel: [36288.621926] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 15:28:34 juju-e4d256-prod-github-runner-207 kernel: [36288.622821] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 15:28:34 juju-e4d256-prod-github-runner-207 kernel: [36288.623730] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 15:28:34 juju-e4d256-prod-github-runner-207 kernel: [36288.624618] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 15:28:34 juju-e4d256-prod-github-runner-207 kernel: [36288.625515] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 15:28:34 juju-e4d256-prod-github-runner-207 kernel: [36288.626408] Aug 22 15:29:02 juju-e4d256-prod-github-runner-207 kernel: [36316.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 33714s! [qemu-system-x86:6715] Aug 22 15:29:02 juju-e4d256-prod-github-runner-207 kernel: [36316.543895] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 15:29:02 juju-e4d256-prod-github-runner-207 kernel: [36316.544199] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 15:29:02 juju-e4d256-prod-github-runner-207 kernel: [36316.556821] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 15:29:02 juju-e4d256-prod-github-runner-207 kernel: [36316.558118] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 15:29:02 juju-e4d256-prod-github-runner-207 kernel: [36316.559386] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:29:02 juju-e4d256-prod-github-runner-207 kernel: [36316.560458] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 15:29:02 juju-e4d256-prod-github-runner-207 kernel: [36316.563062] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 15:29:02 juju-e4d256-prod-github-runner-207 kernel: [36316.564120] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 15:29:02 juju-e4d256-prod-github-runner-207 kernel: [36316.565302] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 15:29:02 juju-e4d256-prod-github-runner-207 kernel: [36316.566495] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 15:29:02 juju-e4d256-prod-github-runner-207 kernel: [36316.567689] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 15:29:02 juju-e4d256-prod-github-runner-207 kernel: [36316.568880] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 15:29:02 juju-e4d256-prod-github-runner-207 kernel: [36316.570070] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 15:29:02 juju-e4d256-prod-github-runner-207 kernel: [36316.571325] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 15:29:02 juju-e4d256-prod-github-runner-207 kernel: [36316.572428] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 15:29:02 juju-e4d256-prod-github-runner-207 kernel: [36316.573629] Call Trace: Aug 22 15:29:02 juju-e4d256-prod-github-runner-207 kernel: [36316.574548] Aug 22 15:29:02 juju-e4d256-prod-github-runner-207 kernel: [36316.575457] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:29:02 juju-e4d256-prod-github-runner-207 kernel: [36316.576493] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:29:02 juju-e4d256-prod-github-runner-207 kernel: [36316.577519] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:29:02 juju-e4d256-prod-github-runner-207 kernel: [36316.578621] ? show_regs.part.0+0x23/0x29 Aug 22 15:29:02 juju-e4d256-prod-github-runner-207 kernel: [36316.579637] ? show_regs.cold+0x8/0xd Aug 22 15:29:02 juju-e4d256-prod-github-runner-207 kernel: [36316.580616] ? watchdog_timer_fn+0x1be/0x220 Aug 22 15:29:02 juju-e4d256-prod-github-runner-207 kernel: [36316.581626] ? lockup_detector_update_enable+0x60/0x60 Aug 22 15:29:02 juju-e4d256-prod-github-runner-207 kernel: [36316.582690] ? __hrtimer_run_queues+0x107/0x230 Aug 22 15:29:02 juju-e4d256-prod-github-runner-207 kernel: [36316.583725] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 15:29:02 juju-e4d256-prod-github-runner-207 kernel: [36316.584749] ? hrtimer_interrupt+0x101/0x220 Aug 22 15:29:02 juju-e4d256-prod-github-runner-207 kernel: [36316.585763] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 15:29:02 juju-e4d256-prod-github-runner-207 kernel: [36316.586841] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 15:29:02 juju-e4d256-prod-github-runner-207 kernel: [36316.587909] Aug 22 15:29:02 juju-e4d256-prod-github-runner-207 kernel: [36316.588762] Aug 22 15:29:02 juju-e4d256-prod-github-runner-207 kernel: [36316.589600] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 15:29:02 juju-e4d256-prod-github-runner-207 kernel: [36316.590644] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:29:02 juju-e4d256-prod-github-runner-207 kernel: [36316.591710] ? _raw_spin_lock+0x22/0x30 Aug 22 15:29:02 juju-e4d256-prod-github-runner-207 kernel: [36316.592656] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:29:02 juju-e4d256-prod-github-runner-207 kernel: [36316.593687] direct_page_fault+0x206/0x310 [kvm] Aug 22 15:29:02 juju-e4d256-prod-github-runner-207 kernel: [36316.594713] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 15:29:02 juju-e4d256-prod-github-runner-207 kernel: [36316.595742] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 15:29:02 juju-e4d256-prod-github-runner-207 kernel: [36316.596755] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 15:29:02 juju-e4d256-prod-github-runner-207 kernel: [36316.597769] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 15:29:02 juju-e4d256-prod-github-runner-207 kernel: [36316.598718] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 15:29:02 juju-e4d256-prod-github-runner-207 kernel: [36316.599714] handle_exit+0x98/0x230 [kvm_amd] Aug 22 15:29:02 juju-e4d256-prod-github-runner-207 kernel: [36316.600611] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 15:29:02 juju-e4d256-prod-github-runner-207 kernel: [36316.601534] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 15:29:02 juju-e4d256-prod-github-runner-207 kernel: [36316.602465] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 15:29:02 juju-e4d256-prod-github-runner-207 kernel: [36316.603383] vcpu_run+0x62/0x2c0 [kvm] Aug 22 15:29:02 juju-e4d256-prod-github-runner-207 kernel: [36316.604205] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 15:29:02 juju-e4d256-prod-github-runner-207 kernel: [36316.605015] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 15:29:02 juju-e4d256-prod-github-runner-207 kernel: [36316.605876] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 15:29:02 juju-e4d256-prod-github-runner-207 kernel: [36316.606679] ? __seccomp_filter+0x4a/0x4a0 Aug 22 15:29:02 juju-e4d256-prod-github-runner-207 kernel: [36316.607442] ? __fget_files+0x86/0xc0 Aug 22 15:29:02 juju-e4d256-prod-github-runner-207 kernel: [36316.608151] __x64_sys_ioctl+0x95/0xd0 Aug 22 15:29:02 juju-e4d256-prod-github-runner-207 kernel: [36316.608860] do_syscall_64+0x5c/0xc0 Aug 22 15:29:02 juju-e4d256-prod-github-runner-207 kernel: [36316.609537] ? do_futex+0x162/0x1f0 Aug 22 15:29:02 juju-e4d256-prod-github-runner-207 kernel: [36316.610187] ? __x64_sys_futex+0x78/0x1e0 Aug 22 15:29:02 juju-e4d256-prod-github-runner-207 kernel: [36316.610862] ? __secure_computing+0xa9/0x120 Aug 22 15:29:02 juju-e4d256-prod-github-runner-207 kernel: [36316.611564] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 15:29:02 juju-e4d256-prod-github-runner-207 kernel: [36316.612335] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:29:02 juju-e4d256-prod-github-runner-207 kernel: [36316.613075] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:29:02 juju-e4d256-prod-github-runner-207 kernel: [36316.613791] ? do_syscall_64+0x69/0xc0 Aug 22 15:29:02 juju-e4d256-prod-github-runner-207 kernel: [36316.614436] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:29:02 juju-e4d256-prod-github-runner-207 kernel: [36316.615149] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:29:02 juju-e4d256-prod-github-runner-207 kernel: [36316.615848] ? do_syscall_64+0x69/0xc0 Aug 22 15:29:02 juju-e4d256-prod-github-runner-207 kernel: [36316.616470] ? do_syscall_64+0x69/0xc0 Aug 22 15:29:02 juju-e4d256-prod-github-runner-207 kernel: [36316.617106] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 15:29:02 juju-e4d256-prod-github-runner-207 kernel: [36316.617820] RIP: 0033:0x7faa5d0edaff Aug 22 15:29:02 juju-e4d256-prod-github-runner-207 kernel: [36316.618497] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 15:29:02 juju-e4d256-prod-github-runner-207 kernel: [36316.620493] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 15:29:02 juju-e4d256-prod-github-runner-207 kernel: [36316.621403] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 15:29:02 juju-e4d256-prod-github-runner-207 kernel: [36316.622296] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 15:29:02 juju-e4d256-prod-github-runner-207 kernel: [36316.623201] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 15:29:02 juju-e4d256-prod-github-runner-207 kernel: [36316.624088] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 15:29:02 juju-e4d256-prod-github-runner-207 kernel: [36316.624979] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 15:29:02 juju-e4d256-prod-github-runner-207 kernel: [36316.625883] Aug 22 15:29:30 juju-e4d256-prod-github-runner-207 kernel: [36344.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 33740s! [qemu-system-x86:6715] Aug 22 15:29:30 juju-e4d256-prod-github-runner-207 kernel: [36344.543808] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 15:29:30 juju-e4d256-prod-github-runner-207 kernel: [36344.544082] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 15:29:30 juju-e4d256-prod-github-runner-207 kernel: [36344.556724] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 15:29:30 juju-e4d256-prod-github-runner-207 kernel: [36344.558099] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 15:29:30 juju-e4d256-prod-github-runner-207 kernel: [36344.559402] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:29:30 juju-e4d256-prod-github-runner-207 kernel: [36344.560630] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 15:29:30 juju-e4d256-prod-github-runner-207 kernel: [36344.563265] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 15:29:30 juju-e4d256-prod-github-runner-207 kernel: [36344.564322] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 15:29:30 juju-e4d256-prod-github-runner-207 kernel: [36344.565486] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 15:29:30 juju-e4d256-prod-github-runner-207 kernel: [36344.566664] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 15:29:30 juju-e4d256-prod-github-runner-207 kernel: [36344.567828] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 15:29:30 juju-e4d256-prod-github-runner-207 kernel: [36344.568993] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 15:29:30 juju-e4d256-prod-github-runner-207 kernel: [36344.570161] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 15:29:30 juju-e4d256-prod-github-runner-207 kernel: [36344.571402] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 15:29:30 juju-e4d256-prod-github-runner-207 kernel: [36344.572498] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 15:29:30 juju-e4d256-prod-github-runner-207 kernel: [36344.573686] Call Trace: Aug 22 15:29:30 juju-e4d256-prod-github-runner-207 kernel: [36344.574595] Aug 22 15:29:30 juju-e4d256-prod-github-runner-207 kernel: [36344.575515] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:29:30 juju-e4d256-prod-github-runner-207 kernel: [36344.576546] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:29:30 juju-e4d256-prod-github-runner-207 kernel: [36344.577565] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:29:30 juju-e4d256-prod-github-runner-207 kernel: [36344.578667] ? show_regs.part.0+0x23/0x29 Aug 22 15:29:30 juju-e4d256-prod-github-runner-207 kernel: [36344.579662] ? show_regs.cold+0x8/0xd Aug 22 15:29:30 juju-e4d256-prod-github-runner-207 kernel: [36344.580632] ? watchdog_timer_fn+0x1be/0x220 Aug 22 15:29:30 juju-e4d256-prod-github-runner-207 kernel: [36344.581641] ? lockup_detector_update_enable+0x60/0x60 Aug 22 15:29:30 juju-e4d256-prod-github-runner-207 kernel: [36344.582713] ? __hrtimer_run_queues+0x107/0x230 Aug 22 15:29:30 juju-e4d256-prod-github-runner-207 kernel: [36344.583742] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 15:29:30 juju-e4d256-prod-github-runner-207 kernel: [36344.584768] ? hrtimer_interrupt+0x101/0x220 Aug 22 15:29:30 juju-e4d256-prod-github-runner-207 kernel: [36344.585780] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 15:29:30 juju-e4d256-prod-github-runner-207 kernel: [36344.586861] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 15:29:30 juju-e4d256-prod-github-runner-207 kernel: [36344.587909] Aug 22 15:29:30 juju-e4d256-prod-github-runner-207 kernel: [36344.588760] Aug 22 15:29:30 juju-e4d256-prod-github-runner-207 kernel: [36344.589595] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 15:29:30 juju-e4d256-prod-github-runner-207 kernel: [36344.590661] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:29:30 juju-e4d256-prod-github-runner-207 kernel: [36344.591712] ? _raw_spin_lock+0x22/0x30 Aug 22 15:29:30 juju-e4d256-prod-github-runner-207 kernel: [36344.592660] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:29:30 juju-e4d256-prod-github-runner-207 kernel: [36344.593688] direct_page_fault+0x206/0x310 [kvm] Aug 22 15:29:30 juju-e4d256-prod-github-runner-207 kernel: [36344.594806] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 15:29:30 juju-e4d256-prod-github-runner-207 kernel: [36344.595827] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 15:29:30 juju-e4d256-prod-github-runner-207 kernel: [36344.596826] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 15:29:30 juju-e4d256-prod-github-runner-207 kernel: [36344.597827] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 15:29:30 juju-e4d256-prod-github-runner-207 kernel: [36344.598794] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 15:29:30 juju-e4d256-prod-github-runner-207 kernel: [36344.599771] handle_exit+0x98/0x230 [kvm_amd] Aug 22 15:29:30 juju-e4d256-prod-github-runner-207 kernel: [36344.600663] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 15:29:30 juju-e4d256-prod-github-runner-207 kernel: [36344.601577] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 15:29:30 juju-e4d256-prod-github-runner-207 kernel: [36344.602499] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 15:29:30 juju-e4d256-prod-github-runner-207 kernel: [36344.603421] vcpu_run+0x62/0x2c0 [kvm] Aug 22 15:29:30 juju-e4d256-prod-github-runner-207 kernel: [36344.604390] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 15:29:30 juju-e4d256-prod-github-runner-207 kernel: [36344.605196] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 15:29:30 juju-e4d256-prod-github-runner-207 kernel: [36344.606125] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 15:29:30 juju-e4d256-prod-github-runner-207 kernel: [36344.606944] ? __seccomp_filter+0x4a/0x4a0 Aug 22 15:29:30 juju-e4d256-prod-github-runner-207 kernel: [36344.607695] ? __fget_files+0x86/0xc0 Aug 22 15:29:30 juju-e4d256-prod-github-runner-207 kernel: [36344.608398] __x64_sys_ioctl+0x95/0xd0 Aug 22 15:29:30 juju-e4d256-prod-github-runner-207 kernel: [36344.609089] do_syscall_64+0x5c/0xc0 Aug 22 15:29:30 juju-e4d256-prod-github-runner-207 kernel: [36344.609762] ? do_futex+0x162/0x1f0 Aug 22 15:29:30 juju-e4d256-prod-github-runner-207 kernel: [36344.610420] ? __x64_sys_futex+0x78/0x1e0 Aug 22 15:29:30 juju-e4d256-prod-github-runner-207 kernel: [36344.611108] ? __secure_computing+0xa9/0x120 Aug 22 15:29:30 juju-e4d256-prod-github-runner-207 kernel: [36344.611796] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 15:29:30 juju-e4d256-prod-github-runner-207 kernel: [36344.612558] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:29:30 juju-e4d256-prod-github-runner-207 kernel: [36344.613278] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:29:30 juju-e4d256-prod-github-runner-207 kernel: [36344.613999] ? do_syscall_64+0x69/0xc0 Aug 22 15:29:30 juju-e4d256-prod-github-runner-207 kernel: [36344.614663] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:29:30 juju-e4d256-prod-github-runner-207 kernel: [36344.615365] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:29:30 juju-e4d256-prod-github-runner-207 kernel: [36344.616063] ? do_syscall_64+0x69/0xc0 Aug 22 15:29:30 juju-e4d256-prod-github-runner-207 kernel: [36344.616686] ? do_syscall_64+0x69/0xc0 Aug 22 15:29:30 juju-e4d256-prod-github-runner-207 kernel: [36344.617312] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 15:29:30 juju-e4d256-prod-github-runner-207 kernel: [36344.618024] RIP: 0033:0x7faa5d0edaff Aug 22 15:29:30 juju-e4d256-prod-github-runner-207 kernel: [36344.618693] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 15:29:30 juju-e4d256-prod-github-runner-207 kernel: [36344.620669] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 15:29:30 juju-e4d256-prod-github-runner-207 kernel: [36344.621590] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 15:29:30 juju-e4d256-prod-github-runner-207 kernel: [36344.622478] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 15:29:30 juju-e4d256-prod-github-runner-207 kernel: [36344.623377] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 15:29:30 juju-e4d256-prod-github-runner-207 kernel: [36344.624262] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 15:29:30 juju-e4d256-prod-github-runner-207 kernel: [36344.625152] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 15:29:30 juju-e4d256-prod-github-runner-207 kernel: [36344.626048] Aug 22 15:29:45 juju-e4d256-prod-github-runner-207 kernel: [36359.612705] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 15:29:45 juju-e4d256-prod-github-runner-207 kernel: [36359.614435] rcu: 1-....: (9032160 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=4363773 Aug 22 15:29:45 juju-e4d256-prod-github-runner-207 kernel: [36359.615580] (t=9060603 jiffies g=23269 q=38164) Aug 22 15:29:45 juju-e4d256-prod-github-runner-207 kernel: [36359.616400] NMI backtrace for cpu 1 Aug 22 15:29:45 juju-e4d256-prod-github-runner-207 kernel: [36359.617153] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 15:29:45 juju-e4d256-prod-github-runner-207 kernel: [36359.618314] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 15:29:45 juju-e4d256-prod-github-runner-207 kernel: [36359.619445] Call Trace: Aug 22 15:29:45 juju-e4d256-prod-github-runner-207 kernel: [36359.620133] Aug 22 15:29:45 juju-e4d256-prod-github-runner-207 kernel: [36359.620792] show_stack+0x52/0x5c Aug 22 15:29:45 juju-e4d256-prod-github-runner-207 kernel: [36359.621538] dump_stack_lvl+0x4a/0x63 Aug 22 15:29:45 juju-e4d256-prod-github-runner-207 kernel: [36359.622288] dump_stack+0x10/0x16 Aug 22 15:29:45 juju-e4d256-prod-github-runner-207 kernel: [36359.623011] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 15:29:45 juju-e4d256-prod-github-runner-207 kernel: [36359.623799] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 15:29:45 juju-e4d256-prod-github-runner-207 kernel: [36359.624586] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 15:29:45 juju-e4d256-prod-github-runner-207 kernel: [36359.625463] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 15:29:45 juju-e4d256-prod-github-runner-207 kernel: [36359.626286] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 15:29:45 juju-e4d256-prod-github-runner-207 kernel: [36359.627150] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 15:29:45 juju-e4d256-prod-github-runner-207 kernel: [36359.627922] print_cpu_stall.cold+0x2f/0xe2 Aug 22 15:29:45 juju-e4d256-prod-github-runner-207 kernel: [36359.628686] ? timekeeping_update+0xf7/0x150 Aug 22 15:29:45 juju-e4d256-prod-github-runner-207 kernel: [36359.629457] check_cpu_stall+0x109/0x270 Aug 22 15:29:45 juju-e4d256-prod-github-runner-207 kernel: [36359.630203] rcu_sched_clock_irq+0x9a/0x250 Aug 22 15:29:45 juju-e4d256-prod-github-runner-207 kernel: [36359.630988] update_process_times+0x94/0xd0 Aug 22 15:29:45 juju-e4d256-prod-github-runner-207 kernel: [36359.631756] tick_sched_handle+0x29/0x70 Aug 22 15:29:45 juju-e4d256-prod-github-runner-207 kernel: [36359.632502] tick_sched_timer+0x8c/0xc0 Aug 22 15:29:45 juju-e4d256-prod-github-runner-207 kernel: [36359.633240] ? tick_nohz_handler+0xb0/0xb0 Aug 22 15:29:45 juju-e4d256-prod-github-runner-207 kernel: [36359.633994] __hrtimer_run_queues+0x107/0x230 Aug 22 15:29:45 juju-e4d256-prod-github-runner-207 kernel: [36359.634778] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 15:29:45 juju-e4d256-prod-github-runner-207 kernel: [36359.635553] hrtimer_interrupt+0x101/0x220 Aug 22 15:29:45 juju-e4d256-prod-github-runner-207 kernel: [36359.636318] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 15:29:45 juju-e4d256-prod-github-runner-207 kernel: [36359.637131] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 15:29:45 juju-e4d256-prod-github-runner-207 kernel: [36359.637936] Aug 22 15:29:45 juju-e4d256-prod-github-runner-207 kernel: [36359.638577] Aug 22 15:29:45 juju-e4d256-prod-github-runner-207 kernel: [36359.639205] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 15:29:45 juju-e4d256-prod-github-runner-207 kernel: [36359.640028] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:29:45 juju-e4d256-prod-github-runner-207 kernel: [36359.640905] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 15:29:45 juju-e4d256-prod-github-runner-207 kernel: [36359.643112] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 15:29:45 juju-e4d256-prod-github-runner-207 kernel: [36359.643990] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 15:29:45 juju-e4d256-prod-github-runner-207 kernel: [36359.644991] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 15:29:45 juju-e4d256-prod-github-runner-207 kernel: [36359.645978] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 15:29:45 juju-e4d256-prod-github-runner-207 kernel: [36359.646962] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 15:29:45 juju-e4d256-prod-github-runner-207 kernel: [36359.647924] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 15:29:45 juju-e4d256-prod-github-runner-207 kernel: [36359.648874] ? _raw_spin_lock+0x22/0x30 Aug 22 15:29:45 juju-e4d256-prod-github-runner-207 kernel: [36359.649637] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:29:45 juju-e4d256-prod-github-runner-207 kernel: [36359.650505] direct_page_fault+0x206/0x310 [kvm] Aug 22 15:29:45 juju-e4d256-prod-github-runner-207 kernel: [36359.651342] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 15:29:45 juju-e4d256-prod-github-runner-207 kernel: [36359.652169] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 15:29:45 juju-e4d256-prod-github-runner-207 kernel: [36359.653011] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 15:29:45 juju-e4d256-prod-github-runner-207 kernel: [36359.653938] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 15:29:45 juju-e4d256-prod-github-runner-207 kernel: [36359.654827] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 15:29:45 juju-e4d256-prod-github-runner-207 kernel: [36359.655753] handle_exit+0x98/0x230 [kvm_amd] Aug 22 15:29:45 juju-e4d256-prod-github-runner-207 kernel: [36359.656604] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 15:29:45 juju-e4d256-prod-github-runner-207 kernel: [36359.657477] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 15:29:45 juju-e4d256-prod-github-runner-207 kernel: [36359.658373] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 15:29:45 juju-e4d256-prod-github-runner-207 kernel: [36359.659260] vcpu_run+0x62/0x2c0 [kvm] Aug 22 15:29:45 juju-e4d256-prod-github-runner-207 kernel: [36359.660048] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 15:29:45 juju-e4d256-prod-github-runner-207 kernel: [36359.660869] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 15:29:45 juju-e4d256-prod-github-runner-207 kernel: [36359.661777] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 15:29:45 juju-e4d256-prod-github-runner-207 kernel: [36359.662655] ? __seccomp_filter+0x4a/0x4a0 Aug 22 15:29:45 juju-e4d256-prod-github-runner-207 kernel: [36359.663463] ? __fget_files+0x86/0xc0 Aug 22 15:29:45 juju-e4d256-prod-github-runner-207 kernel: [36359.664256] __x64_sys_ioctl+0x95/0xd0 Aug 22 15:29:45 juju-e4d256-prod-github-runner-207 kernel: [36359.665038] do_syscall_64+0x5c/0xc0 Aug 22 15:29:45 juju-e4d256-prod-github-runner-207 kernel: [36359.665796] ? do_futex+0x162/0x1f0 Aug 22 15:29:45 juju-e4d256-prod-github-runner-207 kernel: [36359.666568] ? __x64_sys_futex+0x78/0x1e0 Aug 22 15:29:45 juju-e4d256-prod-github-runner-207 kernel: [36359.667351] ? __secure_computing+0xa9/0x120 Aug 22 15:29:45 juju-e4d256-prod-github-runner-207 kernel: [36359.668154] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 15:29:45 juju-e4d256-prod-github-runner-207 kernel: [36359.669046] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:29:45 juju-e4d256-prod-github-runner-207 kernel: [36359.669925] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:29:45 juju-e4d256-prod-github-runner-207 kernel: [36359.670780] ? do_syscall_64+0x69/0xc0 Aug 22 15:29:45 juju-e4d256-prod-github-runner-207 kernel: [36359.671548] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:29:45 juju-e4d256-prod-github-runner-207 kernel: [36359.672396] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:29:45 juju-e4d256-prod-github-runner-207 kernel: [36359.673248] ? do_syscall_64+0x69/0xc0 Aug 22 15:29:45 juju-e4d256-prod-github-runner-207 kernel: [36359.674014] ? do_syscall_64+0x69/0xc0 Aug 22 15:29:45 juju-e4d256-prod-github-runner-207 kernel: [36359.674784] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 15:29:45 juju-e4d256-prod-github-runner-207 kernel: [36359.675648] RIP: 0033:0x7faa5d0edaff Aug 22 15:29:45 juju-e4d256-prod-github-runner-207 kernel: [36359.676431] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 15:29:45 juju-e4d256-prod-github-runner-207 kernel: [36359.678903] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 15:29:45 juju-e4d256-prod-github-runner-207 kernel: [36359.680002] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 15:29:45 juju-e4d256-prod-github-runner-207 kernel: [36359.681083] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 15:29:45 juju-e4d256-prod-github-runner-207 kernel: [36359.682170] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 15:29:45 juju-e4d256-prod-github-runner-207 kernel: [36359.683256] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 15:29:45 juju-e4d256-prod-github-runner-207 kernel: [36359.684315] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 15:29:45 juju-e4d256-prod-github-runner-207 kernel: [36359.685360] Aug 22 15:30:10 juju-e4d256-prod-github-runner-207 kernel: [36384.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 33777s! [qemu-system-x86:6715] Aug 22 15:30:10 juju-e4d256-prod-github-runner-207 kernel: [36384.543172] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 15:30:10 juju-e4d256-prod-github-runner-207 kernel: [36384.543569] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 15:30:10 juju-e4d256-prod-github-runner-207 kernel: [36384.555696] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 15:30:10 juju-e4d256-prod-github-runner-207 kernel: [36384.556959] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 15:30:10 juju-e4d256-prod-github-runner-207 kernel: [36384.558190] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:30:10 juju-e4d256-prod-github-runner-207 kernel: [36384.559245] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 15:30:10 juju-e4d256-prod-github-runner-207 kernel: [36384.561827] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 15:30:10 juju-e4d256-prod-github-runner-207 kernel: [36384.562900] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 15:30:10 juju-e4d256-prod-github-runner-207 kernel: [36384.564079] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 15:30:10 juju-e4d256-prod-github-runner-207 kernel: [36384.565238] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 15:30:10 juju-e4d256-prod-github-runner-207 kernel: [36384.566425] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 15:30:10 juju-e4d256-prod-github-runner-207 kernel: [36384.567588] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 15:30:10 juju-e4d256-prod-github-runner-207 kernel: [36384.568758] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 15:30:10 juju-e4d256-prod-github-runner-207 kernel: [36384.569992] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 15:30:10 juju-e4d256-prod-github-runner-207 kernel: [36384.571107] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 15:30:10 juju-e4d256-prod-github-runner-207 kernel: [36384.572296] Call Trace: Aug 22 15:30:10 juju-e4d256-prod-github-runner-207 kernel: [36384.573212] Aug 22 15:30:10 juju-e4d256-prod-github-runner-207 kernel: [36384.574095] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:30:10 juju-e4d256-prod-github-runner-207 kernel: [36384.575147] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:30:10 juju-e4d256-prod-github-runner-207 kernel: [36384.576167] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:30:10 juju-e4d256-prod-github-runner-207 kernel: [36384.577241] ? show_regs.part.0+0x23/0x29 Aug 22 15:30:10 juju-e4d256-prod-github-runner-207 kernel: [36384.578251] ? show_regs.cold+0x8/0xd Aug 22 15:30:10 juju-e4d256-prod-github-runner-207 kernel: [36384.579223] ? watchdog_timer_fn+0x1be/0x220 Aug 22 15:30:10 juju-e4d256-prod-github-runner-207 kernel: [36384.580236] ? lockup_detector_update_enable+0x60/0x60 Aug 22 15:30:10 juju-e4d256-prod-github-runner-207 kernel: [36384.581297] ? __hrtimer_run_queues+0x107/0x230 Aug 22 15:30:10 juju-e4d256-prod-github-runner-207 kernel: [36384.582345] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 15:30:10 juju-e4d256-prod-github-runner-207 kernel: [36384.583400] ? hrtimer_interrupt+0x101/0x220 Aug 22 15:30:10 juju-e4d256-prod-github-runner-207 kernel: [36384.584415] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 15:30:10 juju-e4d256-prod-github-runner-207 kernel: [36384.585483] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 15:30:10 juju-e4d256-prod-github-runner-207 kernel: [36384.586552] Aug 22 15:30:10 juju-e4d256-prod-github-runner-207 kernel: [36384.587406] Aug 22 15:30:10 juju-e4d256-prod-github-runner-207 kernel: [36384.588241] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 15:30:10 juju-e4d256-prod-github-runner-207 kernel: [36384.589277] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:30:10 juju-e4d256-prod-github-runner-207 kernel: [36384.590331] ? _raw_spin_lock+0x22/0x30 Aug 22 15:30:10 juju-e4d256-prod-github-runner-207 kernel: [36384.591276] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:30:10 juju-e4d256-prod-github-runner-207 kernel: [36384.592333] direct_page_fault+0x206/0x310 [kvm] Aug 22 15:30:10 juju-e4d256-prod-github-runner-207 kernel: [36384.593373] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 15:30:10 juju-e4d256-prod-github-runner-207 kernel: [36384.594397] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 15:30:10 juju-e4d256-prod-github-runner-207 kernel: [36384.595402] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 15:30:10 juju-e4d256-prod-github-runner-207 kernel: [36384.596378] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 15:30:10 juju-e4d256-prod-github-runner-207 kernel: [36384.597324] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 15:30:10 juju-e4d256-prod-github-runner-207 kernel: [36384.598324] handle_exit+0x98/0x230 [kvm_amd] Aug 22 15:30:10 juju-e4d256-prod-github-runner-207 kernel: [36384.599221] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 15:30:10 juju-e4d256-prod-github-runner-207 kernel: [36384.600305] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 15:30:10 juju-e4d256-prod-github-runner-207 kernel: [36384.601232] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 15:30:10 juju-e4d256-prod-github-runner-207 kernel: [36384.602196] vcpu_run+0x62/0x2c0 [kvm] Aug 22 15:30:10 juju-e4d256-prod-github-runner-207 kernel: [36384.603040] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 15:30:10 juju-e4d256-prod-github-runner-207 kernel: [36384.603849] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 15:30:10 juju-e4d256-prod-github-runner-207 kernel: [36384.604702] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 15:30:10 juju-e4d256-prod-github-runner-207 kernel: [36384.605598] ? __seccomp_filter+0x4a/0x4a0 Aug 22 15:30:10 juju-e4d256-prod-github-runner-207 kernel: [36384.606462] ? __fget_files+0x86/0xc0 Aug 22 15:30:10 juju-e4d256-prod-github-runner-207 kernel: [36384.607173] __x64_sys_ioctl+0x95/0xd0 Aug 22 15:30:10 juju-e4d256-prod-github-runner-207 kernel: [36384.607935] do_syscall_64+0x5c/0xc0 Aug 22 15:30:10 juju-e4d256-prod-github-runner-207 kernel: [36384.608819] ? do_futex+0x162/0x1f0 Aug 22 15:30:10 juju-e4d256-prod-github-runner-207 kernel: [36384.609472] ? __x64_sys_futex+0x78/0x1e0 Aug 22 15:30:10 juju-e4d256-prod-github-runner-207 kernel: [36384.610148] ? __secure_computing+0xa9/0x120 Aug 22 15:30:10 juju-e4d256-prod-github-runner-207 kernel: [36384.610870] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 15:30:10 juju-e4d256-prod-github-runner-207 kernel: [36384.611639] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:30:10 juju-e4d256-prod-github-runner-207 kernel: [36384.612365] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:30:10 juju-e4d256-prod-github-runner-207 kernel: [36384.613084] ? do_syscall_64+0x69/0xc0 Aug 22 15:30:10 juju-e4d256-prod-github-runner-207 kernel: [36384.613730] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:30:10 juju-e4d256-prod-github-runner-207 kernel: [36384.614455] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:30:10 juju-e4d256-prod-github-runner-207 kernel: [36384.615153] ? do_syscall_64+0x69/0xc0 Aug 22 15:30:10 juju-e4d256-prod-github-runner-207 kernel: [36384.615781] ? do_syscall_64+0x69/0xc0 Aug 22 15:30:10 juju-e4d256-prod-github-runner-207 kernel: [36384.616406] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 15:30:10 juju-e4d256-prod-github-runner-207 kernel: [36384.617114] RIP: 0033:0x7faa5d0edaff Aug 22 15:30:10 juju-e4d256-prod-github-runner-207 kernel: [36384.617739] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 15:30:10 juju-e4d256-prod-github-runner-207 kernel: [36384.619746] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 15:30:10 juju-e4d256-prod-github-runner-207 kernel: [36384.620660] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 15:30:10 juju-e4d256-prod-github-runner-207 kernel: [36384.621571] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 15:30:10 juju-e4d256-prod-github-runner-207 kernel: [36384.622483] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 15:30:10 juju-e4d256-prod-github-runner-207 kernel: [36384.623374] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 15:30:10 juju-e4d256-prod-github-runner-207 kernel: [36384.624273] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 15:30:10 juju-e4d256-prod-github-runner-207 kernel: [36384.625173] Aug 22 15:30:38 juju-e4d256-prod-github-runner-207 kernel: [36412.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 33803s! [qemu-system-x86:6715] Aug 22 15:30:38 juju-e4d256-prod-github-runner-207 kernel: [36412.544591] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 15:30:38 juju-e4d256-prod-github-runner-207 kernel: [36412.545814] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 15:30:38 juju-e4d256-prod-github-runner-207 kernel: [36412.558004] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 15:30:38 juju-e4d256-prod-github-runner-207 kernel: [36412.559270] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 15:30:38 juju-e4d256-prod-github-runner-207 kernel: [36412.560497] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:30:38 juju-e4d256-prod-github-runner-207 kernel: [36412.561558] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 15:30:38 juju-e4d256-prod-github-runner-207 kernel: [36412.564139] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 15:30:38 juju-e4d256-prod-github-runner-207 kernel: [36412.565193] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 15:30:38 juju-e4d256-prod-github-runner-207 kernel: [36412.566368] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 15:30:38 juju-e4d256-prod-github-runner-207 kernel: [36412.567536] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 15:30:38 juju-e4d256-prod-github-runner-207 kernel: [36412.568698] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 15:30:38 juju-e4d256-prod-github-runner-207 kernel: [36412.569871] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 15:30:38 juju-e4d256-prod-github-runner-207 kernel: [36412.571046] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 15:30:38 juju-e4d256-prod-github-runner-207 kernel: [36412.572281] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 15:30:38 juju-e4d256-prod-github-runner-207 kernel: [36412.573378] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 15:30:38 juju-e4d256-prod-github-runner-207 kernel: [36412.574578] Call Trace: Aug 22 15:30:38 juju-e4d256-prod-github-runner-207 kernel: [36412.575490] Aug 22 15:30:38 juju-e4d256-prod-github-runner-207 kernel: [36412.576385] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:30:38 juju-e4d256-prod-github-runner-207 kernel: [36412.577414] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:30:38 juju-e4d256-prod-github-runner-207 kernel: [36412.578441] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:30:38 juju-e4d256-prod-github-runner-207 kernel: [36412.579531] ? show_regs.part.0+0x23/0x29 Aug 22 15:30:38 juju-e4d256-prod-github-runner-207 kernel: [36412.580526] ? show_regs.cold+0x8/0xd Aug 22 15:30:38 juju-e4d256-prod-github-runner-207 kernel: [36412.581498] ? watchdog_timer_fn+0x1be/0x220 Aug 22 15:30:38 juju-e4d256-prod-github-runner-207 kernel: [36412.582515] ? lockup_detector_update_enable+0x60/0x60 Aug 22 15:30:38 juju-e4d256-prod-github-runner-207 kernel: [36412.583578] ? __hrtimer_run_queues+0x107/0x230 Aug 22 15:30:38 juju-e4d256-prod-github-runner-207 kernel: [36412.584605] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 15:30:38 juju-e4d256-prod-github-runner-207 kernel: [36412.585629] ? hrtimer_interrupt+0x101/0x220 Aug 22 15:30:38 juju-e4d256-prod-github-runner-207 kernel: [36412.586655] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 15:30:38 juju-e4d256-prod-github-runner-207 kernel: [36412.587727] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 15:30:38 juju-e4d256-prod-github-runner-207 kernel: [36412.588772] Aug 22 15:30:38 juju-e4d256-prod-github-runner-207 kernel: [36412.589631] Aug 22 15:30:38 juju-e4d256-prod-github-runner-207 kernel: [36412.590479] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 15:30:38 juju-e4d256-prod-github-runner-207 kernel: [36412.591512] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:30:38 juju-e4d256-prod-github-runner-207 kernel: [36412.592553] ? _raw_spin_lock+0x22/0x30 Aug 22 15:30:38 juju-e4d256-prod-github-runner-207 kernel: [36412.593524] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:30:38 juju-e4d256-prod-github-runner-207 kernel: [36412.594561] direct_page_fault+0x206/0x310 [kvm] Aug 22 15:30:38 juju-e4d256-prod-github-runner-207 kernel: [36412.595585] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 15:30:38 juju-e4d256-prod-github-runner-207 kernel: [36412.596593] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 15:30:38 juju-e4d256-prod-github-runner-207 kernel: [36412.597592] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 15:30:38 juju-e4d256-prod-github-runner-207 kernel: [36412.598608] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 15:30:38 juju-e4d256-prod-github-runner-207 kernel: [36412.599553] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 15:30:38 juju-e4d256-prod-github-runner-207 kernel: [36412.600529] handle_exit+0x98/0x230 [kvm_amd] Aug 22 15:30:38 juju-e4d256-prod-github-runner-207 kernel: [36412.601422] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 15:30:38 juju-e4d256-prod-github-runner-207 kernel: [36412.602345] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 15:30:38 juju-e4d256-prod-github-runner-207 kernel: [36412.603276] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 15:30:38 juju-e4d256-prod-github-runner-207 kernel: [36412.604179] vcpu_run+0x62/0x2c0 [kvm] Aug 22 15:30:38 juju-e4d256-prod-github-runner-207 kernel: [36412.604993] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 15:30:38 juju-e4d256-prod-github-runner-207 kernel: [36412.605806] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 15:30:38 juju-e4d256-prod-github-runner-207 kernel: [36412.606670] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 15:30:38 juju-e4d256-prod-github-runner-207 kernel: [36412.607472] ? __seccomp_filter+0x4a/0x4a0 Aug 22 15:30:38 juju-e4d256-prod-github-runner-207 kernel: [36412.608213] ? __fget_files+0x86/0xc0 Aug 22 15:30:38 juju-e4d256-prod-github-runner-207 kernel: [36412.608917] __x64_sys_ioctl+0x95/0xd0 Aug 22 15:30:38 juju-e4d256-prod-github-runner-207 kernel: [36412.609613] do_syscall_64+0x5c/0xc0 Aug 22 15:30:38 juju-e4d256-prod-github-runner-207 kernel: [36412.610283] ? do_futex+0x162/0x1f0 Aug 22 15:30:38 juju-e4d256-prod-github-runner-207 kernel: [36412.610932] ? __x64_sys_futex+0x78/0x1e0 Aug 22 15:30:38 juju-e4d256-prod-github-runner-207 kernel: [36412.611611] ? __secure_computing+0xa9/0x120 Aug 22 15:30:38 juju-e4d256-prod-github-runner-207 kernel: [36412.612300] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 15:30:38 juju-e4d256-prod-github-runner-207 kernel: [36412.613062] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:30:38 juju-e4d256-prod-github-runner-207 kernel: [36412.613792] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:30:38 juju-e4d256-prod-github-runner-207 kernel: [36412.614526] ? do_syscall_64+0x69/0xc0 Aug 22 15:30:38 juju-e4d256-prod-github-runner-207 kernel: [36412.615173] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:30:38 juju-e4d256-prod-github-runner-207 kernel: [36412.615876] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:30:38 juju-e4d256-prod-github-runner-207 kernel: [36412.616571] ? do_syscall_64+0x69/0xc0 Aug 22 15:30:38 juju-e4d256-prod-github-runner-207 kernel: [36412.617197] ? do_syscall_64+0x69/0xc0 Aug 22 15:30:38 juju-e4d256-prod-github-runner-207 kernel: [36412.617835] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 15:30:38 juju-e4d256-prod-github-runner-207 kernel: [36412.618543] RIP: 0033:0x7faa5d0edaff Aug 22 15:30:38 juju-e4d256-prod-github-runner-207 kernel: [36412.619198] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 15:30:38 juju-e4d256-prod-github-runner-207 kernel: [36412.621191] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 15:30:38 juju-e4d256-prod-github-runner-207 kernel: [36412.622118] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 15:30:38 juju-e4d256-prod-github-runner-207 kernel: [36412.623009] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 15:30:38 juju-e4d256-prod-github-runner-207 kernel: [36412.623934] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 15:30:38 juju-e4d256-prod-github-runner-207 kernel: [36412.624826] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 15:30:38 juju-e4d256-prod-github-runner-207 kernel: [36412.625717] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 15:30:38 juju-e4d256-prod-github-runner-207 kernel: [36412.626616] Aug 22 15:31:06 juju-e4d256-prod-github-runner-207 kernel: [36440.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 33829s! [qemu-system-x86:6715] Aug 22 15:31:06 juju-e4d256-prod-github-runner-207 kernel: [36440.544147] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 15:31:06 juju-e4d256-prod-github-runner-207 kernel: [36440.544408] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 15:31:06 juju-e4d256-prod-github-runner-207 kernel: [36440.556452] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 15:31:06 juju-e4d256-prod-github-runner-207 kernel: [36440.557733] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 15:31:06 juju-e4d256-prod-github-runner-207 kernel: [36440.558956] RIP: 0010:native_queued_spin_lock_slowpath+0xc/0x40 Aug 22 15:31:06 juju-e4d256-prod-github-runner-207 kernel: [36440.560005] Code: fe ff ff eb af 4c 89 fe 48 c7 c7 20 99 e9 89 e8 ca 69 55 00 e9 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 <8b> 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 eb Aug 22 15:31:06 juju-e4d256-prod-github-runner-207 kernel: [36440.562578] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 15:31:06 juju-e4d256-prod-github-runner-207 kernel: [36440.563619] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 15:31:06 juju-e4d256-prod-github-runner-207 kernel: [36440.564779] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 15:31:06 juju-e4d256-prod-github-runner-207 kernel: [36440.565955] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 15:31:06 juju-e4d256-prod-github-runner-207 kernel: [36440.567114] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 15:31:06 juju-e4d256-prod-github-runner-207 kernel: [36440.568279] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 15:31:06 juju-e4d256-prod-github-runner-207 kernel: [36440.569444] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 15:31:06 juju-e4d256-prod-github-runner-207 kernel: [36440.570690] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 15:31:06 juju-e4d256-prod-github-runner-207 kernel: [36440.571786] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 15:31:06 juju-e4d256-prod-github-runner-207 kernel: [36440.572977] Call Trace: Aug 22 15:31:06 juju-e4d256-prod-github-runner-207 kernel: [36440.573904] Aug 22 15:31:06 juju-e4d256-prod-github-runner-207 kernel: [36440.574800] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:31:06 juju-e4d256-prod-github-runner-207 kernel: [36440.575830] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:31:06 juju-e4d256-prod-github-runner-207 kernel: [36440.577033] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:31:06 juju-e4d256-prod-github-runner-207 kernel: [36440.578134] ? show_regs.part.0+0x23/0x29 Aug 22 15:31:06 juju-e4d256-prod-github-runner-207 kernel: [36440.579130] ? show_regs.cold+0x8/0xd Aug 22 15:31:06 juju-e4d256-prod-github-runner-207 kernel: [36440.580100] ? watchdog_timer_fn+0x1be/0x220 Aug 22 15:31:06 juju-e4d256-prod-github-runner-207 kernel: [36440.581108] ? lockup_detector_update_enable+0x60/0x60 Aug 22 15:31:06 juju-e4d256-prod-github-runner-207 kernel: [36440.582184] ? __hrtimer_run_queues+0x107/0x230 Aug 22 15:31:06 juju-e4d256-prod-github-runner-207 kernel: [36440.583210] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 15:31:06 juju-e4d256-prod-github-runner-207 kernel: [36440.584237] ? hrtimer_interrupt+0x101/0x220 Aug 22 15:31:06 juju-e4d256-prod-github-runner-207 kernel: [36440.585250] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 15:31:06 juju-e4d256-prod-github-runner-207 kernel: [36440.586328] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 15:31:06 juju-e4d256-prod-github-runner-207 kernel: [36440.587371] Aug 22 15:31:06 juju-e4d256-prod-github-runner-207 kernel: [36440.588222] Aug 22 15:31:06 juju-e4d256-prod-github-runner-207 kernel: [36440.589058] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 15:31:06 juju-e4d256-prod-github-runner-207 kernel: [36440.590102] ? native_queued_spin_lock_slowpath+0xc/0x40 Aug 22 15:31:06 juju-e4d256-prod-github-runner-207 kernel: [36440.591140] ? _raw_spin_lock+0x22/0x30 Aug 22 15:31:06 juju-e4d256-prod-github-runner-207 kernel: [36440.592083] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:31:06 juju-e4d256-prod-github-runner-207 kernel: [36440.593104] direct_page_fault+0x206/0x310 [kvm] Aug 22 15:31:06 juju-e4d256-prod-github-runner-207 kernel: [36440.594138] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 15:31:06 juju-e4d256-prod-github-runner-207 kernel: [36440.595147] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 15:31:06 juju-e4d256-prod-github-runner-207 kernel: [36440.596146] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 15:31:06 juju-e4d256-prod-github-runner-207 kernel: [36440.597132] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 15:31:06 juju-e4d256-prod-github-runner-207 kernel: [36440.598089] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 15:31:06 juju-e4d256-prod-github-runner-207 kernel: [36440.599066] handle_exit+0x98/0x230 [kvm_amd] Aug 22 15:31:06 juju-e4d256-prod-github-runner-207 kernel: [36440.599961] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 15:31:06 juju-e4d256-prod-github-runner-207 kernel: [36440.600871] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 15:31:06 juju-e4d256-prod-github-runner-207 kernel: [36440.601801] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 15:31:06 juju-e4d256-prod-github-runner-207 kernel: [36440.602706] vcpu_run+0x62/0x2c0 [kvm] Aug 22 15:31:06 juju-e4d256-prod-github-runner-207 kernel: [36440.603515] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 15:31:06 juju-e4d256-prod-github-runner-207 kernel: [36440.604320] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 15:31:06 juju-e4d256-prod-github-runner-207 kernel: [36440.605170] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 15:31:06 juju-e4d256-prod-github-runner-207 kernel: [36440.605976] ? __seccomp_filter+0x4a/0x4a0 Aug 22 15:31:06 juju-e4d256-prod-github-runner-207 kernel: [36440.606718] ? __fget_files+0x86/0xc0 Aug 22 15:31:06 juju-e4d256-prod-github-runner-207 kernel: [36440.607419] __x64_sys_ioctl+0x95/0xd0 Aug 22 15:31:06 juju-e4d256-prod-github-runner-207 kernel: [36440.608108] do_syscall_64+0x5c/0xc0 Aug 22 15:31:06 juju-e4d256-prod-github-runner-207 kernel: [36440.608774] ? do_futex+0x162/0x1f0 Aug 22 15:31:06 juju-e4d256-prod-github-runner-207 kernel: [36440.609420] ? __x64_sys_futex+0x78/0x1e0 Aug 22 15:31:06 juju-e4d256-prod-github-runner-207 kernel: [36440.610104] ? __secure_computing+0xa9/0x120 Aug 22 15:31:06 juju-e4d256-prod-github-runner-207 kernel: [36440.610815] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 15:31:06 juju-e4d256-prod-github-runner-207 kernel: [36440.611576] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:31:06 juju-e4d256-prod-github-runner-207 kernel: [36440.612303] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:31:06 juju-e4d256-prod-github-runner-207 kernel: [36440.613018] ? do_syscall_64+0x69/0xc0 Aug 22 15:31:06 juju-e4d256-prod-github-runner-207 kernel: [36440.613674] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:31:06 juju-e4d256-prod-github-runner-207 kernel: [36440.614380] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:31:06 juju-e4d256-prod-github-runner-207 kernel: [36440.615077] ? do_syscall_64+0x69/0xc0 Aug 22 15:31:06 juju-e4d256-prod-github-runner-207 kernel: [36440.615701] ? do_syscall_64+0x69/0xc0 Aug 22 15:31:06 juju-e4d256-prod-github-runner-207 kernel: [36440.616321] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 15:31:06 juju-e4d256-prod-github-runner-207 kernel: [36440.617023] RIP: 0033:0x7faa5d0edaff Aug 22 15:31:06 juju-e4d256-prod-github-runner-207 kernel: [36440.618055] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 15:31:06 juju-e4d256-prod-github-runner-207 kernel: [36440.620039] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 15:31:06 juju-e4d256-prod-github-runner-207 kernel: [36440.620954] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 15:31:06 juju-e4d256-prod-github-runner-207 kernel: [36440.621856] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 15:31:06 juju-e4d256-prod-github-runner-207 kernel: [36440.622746] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 15:31:06 juju-e4d256-prod-github-runner-207 kernel: [36440.623633] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 15:31:06 juju-e4d256-prod-github-runner-207 kernel: [36440.624519] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 15:31:06 juju-e4d256-prod-github-runner-207 kernel: [36440.625410] Aug 22 15:31:34 juju-e4d256-prod-github-runner-207 kernel: [36468.541976] watchdog: BUG: soft lockup - CPU#1 stuck for 33855s! [qemu-system-x86:6715] Aug 22 15:31:34 juju-e4d256-prod-github-runner-207 kernel: [36468.543710] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 15:31:34 juju-e4d256-prod-github-runner-207 kernel: [36468.543954] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 15:31:34 juju-e4d256-prod-github-runner-207 kernel: [36468.556157] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 15:31:34 juju-e4d256-prod-github-runner-207 kernel: [36468.557444] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 15:31:34 juju-e4d256-prod-github-runner-207 kernel: [36468.558666] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:31:34 juju-e4d256-prod-github-runner-207 kernel: [36468.559715] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 15:31:34 juju-e4d256-prod-github-runner-207 kernel: [36468.562283] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 15:31:34 juju-e4d256-prod-github-runner-207 kernel: [36468.563321] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 15:31:34 juju-e4d256-prod-github-runner-207 kernel: [36468.564488] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 15:31:34 juju-e4d256-prod-github-runner-207 kernel: [36468.565656] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 15:31:34 juju-e4d256-prod-github-runner-207 kernel: [36468.566818] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 15:31:34 juju-e4d256-prod-github-runner-207 kernel: [36468.567989] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 15:31:34 juju-e4d256-prod-github-runner-207 kernel: [36468.569167] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 15:31:34 juju-e4d256-prod-github-runner-207 kernel: [36468.570398] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 15:31:34 juju-e4d256-prod-github-runner-207 kernel: [36468.571490] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 15:31:34 juju-e4d256-prod-github-runner-207 kernel: [36468.572680] Call Trace: Aug 22 15:31:34 juju-e4d256-prod-github-runner-207 kernel: [36468.573601] Aug 22 15:31:34 juju-e4d256-prod-github-runner-207 kernel: [36468.574500] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:31:34 juju-e4d256-prod-github-runner-207 kernel: [36468.575573] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:31:34 juju-e4d256-prod-github-runner-207 kernel: [36468.576601] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:31:34 juju-e4d256-prod-github-runner-207 kernel: [36468.577704] ? show_regs.part.0+0x23/0x29 Aug 22 15:31:34 juju-e4d256-prod-github-runner-207 kernel: [36468.578698] ? show_regs.cold+0x8/0xd Aug 22 15:31:34 juju-e4d256-prod-github-runner-207 kernel: [36468.579864] ? watchdog_timer_fn+0x1be/0x220 Aug 22 15:31:34 juju-e4d256-prod-github-runner-207 kernel: [36468.580872] ? lockup_detector_update_enable+0x60/0x60 Aug 22 15:31:34 juju-e4d256-prod-github-runner-207 kernel: [36468.581948] ? __hrtimer_run_queues+0x107/0x230 Aug 22 15:31:34 juju-e4d256-prod-github-runner-207 kernel: [36468.582975] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 15:31:34 juju-e4d256-prod-github-runner-207 kernel: [36468.583997] ? hrtimer_interrupt+0x101/0x220 Aug 22 15:31:34 juju-e4d256-prod-github-runner-207 kernel: [36468.585010] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 15:31:34 juju-e4d256-prod-github-runner-207 kernel: [36468.586086] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 15:31:34 juju-e4d256-prod-github-runner-207 kernel: [36468.587128] Aug 22 15:31:34 juju-e4d256-prod-github-runner-207 kernel: [36468.587979] Aug 22 15:31:34 juju-e4d256-prod-github-runner-207 kernel: [36468.588816] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 15:31:34 juju-e4d256-prod-github-runner-207 kernel: [36468.589871] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:31:34 juju-e4d256-prod-github-runner-207 kernel: [36468.590989] ? _raw_spin_lock+0x22/0x30 Aug 22 15:31:34 juju-e4d256-prod-github-runner-207 kernel: [36468.592124] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:31:34 juju-e4d256-prod-github-runner-207 kernel: [36468.593140] direct_page_fault+0x206/0x310 [kvm] Aug 22 15:31:34 juju-e4d256-prod-github-runner-207 kernel: [36468.594224] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 15:31:34 juju-e4d256-prod-github-runner-207 kernel: [36468.595242] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 15:31:34 juju-e4d256-prod-github-runner-207 kernel: [36468.596261] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 15:31:34 juju-e4d256-prod-github-runner-207 kernel: [36468.597285] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 15:31:34 juju-e4d256-prod-github-runner-207 kernel: [36468.598252] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 15:31:34 juju-e4d256-prod-github-runner-207 kernel: [36468.599252] handle_exit+0x98/0x230 [kvm_amd] Aug 22 15:31:34 juju-e4d256-prod-github-runner-207 kernel: [36468.600149] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 15:31:34 juju-e4d256-prod-github-runner-207 kernel: [36468.601061] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 15:31:34 juju-e4d256-prod-github-runner-207 kernel: [36468.601999] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 15:31:34 juju-e4d256-prod-github-runner-207 kernel: [36468.602907] vcpu_run+0x62/0x2c0 [kvm] Aug 22 15:31:34 juju-e4d256-prod-github-runner-207 kernel: [36468.603715] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 15:31:34 juju-e4d256-prod-github-runner-207 kernel: [36468.604520] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 15:31:34 juju-e4d256-prod-github-runner-207 kernel: [36468.605381] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 15:31:34 juju-e4d256-prod-github-runner-207 kernel: [36468.606179] ? __seccomp_filter+0x4a/0x4a0 Aug 22 15:31:34 juju-e4d256-prod-github-runner-207 kernel: [36468.606929] ? __fget_files+0x86/0xc0 Aug 22 15:31:34 juju-e4d256-prod-github-runner-207 kernel: [36468.607631] __x64_sys_ioctl+0x95/0xd0 Aug 22 15:31:34 juju-e4d256-prod-github-runner-207 kernel: [36468.608322] do_syscall_64+0x5c/0xc0 Aug 22 15:31:34 juju-e4d256-prod-github-runner-207 kernel: [36468.608985] ? do_futex+0x162/0x1f0 Aug 22 15:31:34 juju-e4d256-prod-github-runner-207 kernel: [36468.609644] ? __x64_sys_futex+0x78/0x1e0 Aug 22 15:31:34 juju-e4d256-prod-github-runner-207 kernel: [36468.610319] ? __secure_computing+0xa9/0x120 Aug 22 15:31:34 juju-e4d256-prod-github-runner-207 kernel: [36468.611009] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 15:31:34 juju-e4d256-prod-github-runner-207 kernel: [36468.611767] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:31:34 juju-e4d256-prod-github-runner-207 kernel: [36468.612486] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:31:34 juju-e4d256-prod-github-runner-207 kernel: [36468.613213] ? do_syscall_64+0x69/0xc0 Aug 22 15:31:34 juju-e4d256-prod-github-runner-207 kernel: [36468.613856] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:31:34 juju-e4d256-prod-github-runner-207 kernel: [36468.614557] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:31:34 juju-e4d256-prod-github-runner-207 kernel: [36468.615248] ? do_syscall_64+0x69/0xc0 Aug 22 15:31:34 juju-e4d256-prod-github-runner-207 kernel: [36468.615871] ? do_syscall_64+0x69/0xc0 Aug 22 15:31:34 juju-e4d256-prod-github-runner-207 kernel: [36468.616491] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 15:31:34 juju-e4d256-prod-github-runner-207 kernel: [36468.617204] RIP: 0033:0x7faa5d0edaff Aug 22 15:31:34 juju-e4d256-prod-github-runner-207 kernel: [36468.617857] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 15:31:34 juju-e4d256-prod-github-runner-207 kernel: [36468.619846] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 15:31:34 juju-e4d256-prod-github-runner-207 kernel: [36468.620776] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 15:31:34 juju-e4d256-prod-github-runner-207 kernel: [36468.621724] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 15:31:34 juju-e4d256-prod-github-runner-207 kernel: [36468.622633] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 15:31:34 juju-e4d256-prod-github-runner-207 kernel: [36468.623529] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 15:31:34 juju-e4d256-prod-github-runner-207 kernel: [36468.624420] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 15:31:34 juju-e4d256-prod-github-runner-207 kernel: [36468.625336] Aug 22 15:32:02 juju-e4d256-prod-github-runner-207 kernel: [36496.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 33882s! [qemu-system-x86:6715] Aug 22 15:32:02 juju-e4d256-prod-github-runner-207 kernel: [36496.543721] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 15:32:02 juju-e4d256-prod-github-runner-207 kernel: [36496.543984] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 15:32:02 juju-e4d256-prod-github-runner-207 kernel: [36496.556088] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 15:32:02 juju-e4d256-prod-github-runner-207 kernel: [36496.557373] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 15:32:02 juju-e4d256-prod-github-runner-207 kernel: [36496.558594] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:32:02 juju-e4d256-prod-github-runner-207 kernel: [36496.559652] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 15:32:02 juju-e4d256-prod-github-runner-207 kernel: [36496.562210] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 15:32:02 juju-e4d256-prod-github-runner-207 kernel: [36496.563255] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 15:32:02 juju-e4d256-prod-github-runner-207 kernel: [36496.564419] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 15:32:02 juju-e4d256-prod-github-runner-207 kernel: [36496.565597] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 15:32:02 juju-e4d256-prod-github-runner-207 kernel: [36496.566759] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 15:32:02 juju-e4d256-prod-github-runner-207 kernel: [36496.567921] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 15:32:02 juju-e4d256-prod-github-runner-207 kernel: [36496.569100] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 15:32:02 juju-e4d256-prod-github-runner-207 kernel: [36496.570338] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 15:32:02 juju-e4d256-prod-github-runner-207 kernel: [36496.571434] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 15:32:02 juju-e4d256-prod-github-runner-207 kernel: [36496.572629] Call Trace: Aug 22 15:32:02 juju-e4d256-prod-github-runner-207 kernel: [36496.573558] Aug 22 15:32:02 juju-e4d256-prod-github-runner-207 kernel: [36496.574452] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:32:02 juju-e4d256-prod-github-runner-207 kernel: [36496.575480] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:32:02 juju-e4d256-prod-github-runner-207 kernel: [36496.576505] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:32:02 juju-e4d256-prod-github-runner-207 kernel: [36496.577607] ? show_regs.part.0+0x23/0x29 Aug 22 15:32:02 juju-e4d256-prod-github-runner-207 kernel: [36496.578603] ? show_regs.cold+0x8/0xd Aug 22 15:32:02 juju-e4d256-prod-github-runner-207 kernel: [36496.579573] ? watchdog_timer_fn+0x1be/0x220 Aug 22 15:32:02 juju-e4d256-prod-github-runner-207 kernel: [36496.580578] ? lockup_detector_update_enable+0x60/0x60 Aug 22 15:32:02 juju-e4d256-prod-github-runner-207 kernel: [36496.581656] ? __hrtimer_run_queues+0x107/0x230 Aug 22 15:32:02 juju-e4d256-prod-github-runner-207 kernel: [36496.582683] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 15:32:02 juju-e4d256-prod-github-runner-207 kernel: [36496.583710] ? hrtimer_interrupt+0x101/0x220 Aug 22 15:32:02 juju-e4d256-prod-github-runner-207 kernel: [36496.584729] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 15:32:02 juju-e4d256-prod-github-runner-207 kernel: [36496.585810] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 15:32:02 juju-e4d256-prod-github-runner-207 kernel: [36496.586854] Aug 22 15:32:02 juju-e4d256-prod-github-runner-207 kernel: [36496.587707] Aug 22 15:32:02 juju-e4d256-prod-github-runner-207 kernel: [36496.588543] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 15:32:02 juju-e4d256-prod-github-runner-207 kernel: [36496.589590] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:32:02 juju-e4d256-prod-github-runner-207 kernel: [36496.590627] ? _raw_spin_lock+0x22/0x30 Aug 22 15:32:02 juju-e4d256-prod-github-runner-207 kernel: [36496.591570] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:32:02 juju-e4d256-prod-github-runner-207 kernel: [36496.592589] direct_page_fault+0x206/0x310 [kvm] Aug 22 15:32:02 juju-e4d256-prod-github-runner-207 kernel: [36496.593625] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 15:32:02 juju-e4d256-prod-github-runner-207 kernel: [36496.594637] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 15:32:02 juju-e4d256-prod-github-runner-207 kernel: [36496.595641] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 15:32:02 juju-e4d256-prod-github-runner-207 kernel: [36496.596632] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 15:32:02 juju-e4d256-prod-github-runner-207 kernel: [36496.597593] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 15:32:02 juju-e4d256-prod-github-runner-207 kernel: [36496.598575] handle_exit+0x98/0x230 [kvm_amd] Aug 22 15:32:02 juju-e4d256-prod-github-runner-207 kernel: [36496.599468] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 15:32:02 juju-e4d256-prod-github-runner-207 kernel: [36496.600384] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 15:32:02 juju-e4d256-prod-github-runner-207 kernel: [36496.601323] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 15:32:02 juju-e4d256-prod-github-runner-207 kernel: [36496.602227] vcpu_run+0x62/0x2c0 [kvm] Aug 22 15:32:02 juju-e4d256-prod-github-runner-207 kernel: [36496.603042] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 15:32:02 juju-e4d256-prod-github-runner-207 kernel: [36496.603854] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 15:32:02 juju-e4d256-prod-github-runner-207 kernel: [36496.604707] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 15:32:02 juju-e4d256-prod-github-runner-207 kernel: [36496.605516] ? __seccomp_filter+0x4a/0x4a0 Aug 22 15:32:02 juju-e4d256-prod-github-runner-207 kernel: [36496.606257] ? __fget_files+0x86/0xc0 Aug 22 15:32:02 juju-e4d256-prod-github-runner-207 kernel: [36496.606960] __x64_sys_ioctl+0x95/0xd0 Aug 22 15:32:02 juju-e4d256-prod-github-runner-207 kernel: [36496.607653] do_syscall_64+0x5c/0xc0 Aug 22 15:32:02 juju-e4d256-prod-github-runner-207 kernel: [36496.608315] ? do_futex+0x162/0x1f0 Aug 22 15:32:02 juju-e4d256-prod-github-runner-207 kernel: [36496.608976] ? __x64_sys_futex+0x78/0x1e0 Aug 22 15:32:02 juju-e4d256-prod-github-runner-207 kernel: [36496.609653] ? __secure_computing+0xa9/0x120 Aug 22 15:32:02 juju-e4d256-prod-github-runner-207 kernel: [36496.610344] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 15:32:02 juju-e4d256-prod-github-runner-207 kernel: [36496.611104] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:32:02 juju-e4d256-prod-github-runner-207 kernel: [36496.611830] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:32:02 juju-e4d256-prod-github-runner-207 kernel: [36496.612547] ? do_syscall_64+0x69/0xc0 Aug 22 15:32:02 juju-e4d256-prod-github-runner-207 kernel: [36496.613249] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:32:02 juju-e4d256-prod-github-runner-207 kernel: [36496.613952] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:32:02 juju-e4d256-prod-github-runner-207 kernel: [36496.614645] ? do_syscall_64+0x69/0xc0 Aug 22 15:32:02 juju-e4d256-prod-github-runner-207 kernel: [36496.615269] ? do_syscall_64+0x69/0xc0 Aug 22 15:32:02 juju-e4d256-prod-github-runner-207 kernel: [36496.615889] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 15:32:02 juju-e4d256-prod-github-runner-207 kernel: [36496.616725] RIP: 0033:0x7faa5d0edaff Aug 22 15:32:02 juju-e4d256-prod-github-runner-207 kernel: [36496.617383] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 15:32:02 juju-e4d256-prod-github-runner-207 kernel: [36496.619557] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 15:32:02 juju-e4d256-prod-github-runner-207 kernel: [36496.620468] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 15:32:02 juju-e4d256-prod-github-runner-207 kernel: [36496.621371] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 15:32:02 juju-e4d256-prod-github-runner-207 kernel: [36496.622257] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 15:32:02 juju-e4d256-prod-github-runner-207 kernel: [36496.623144] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 15:32:02 juju-e4d256-prod-github-runner-207 kernel: [36496.624032] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 15:32:02 juju-e4d256-prod-github-runner-207 kernel: [36496.624934] Aug 22 15:32:30 juju-e4d256-prod-github-runner-207 kernel: [36524.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 33908s! [qemu-system-x86:6715] Aug 22 15:32:30 juju-e4d256-prod-github-runner-207 kernel: [36524.543772] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 15:32:30 juju-e4d256-prod-github-runner-207 kernel: [36524.544042] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 15:32:30 juju-e4d256-prod-github-runner-207 kernel: [36524.556567] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 15:32:30 juju-e4d256-prod-github-runner-207 kernel: [36524.557851] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 15:32:30 juju-e4d256-prod-github-runner-207 kernel: [36524.559089] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:32:30 juju-e4d256-prod-github-runner-207 kernel: [36524.560180] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 15:32:30 juju-e4d256-prod-github-runner-207 kernel: [36524.562779] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 15:32:30 juju-e4d256-prod-github-runner-207 kernel: [36524.563826] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 15:32:30 juju-e4d256-prod-github-runner-207 kernel: [36524.565178] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 15:32:30 juju-e4d256-prod-github-runner-207 kernel: [36524.566478] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 15:32:30 juju-e4d256-prod-github-runner-207 kernel: [36524.567776] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 15:32:30 juju-e4d256-prod-github-runner-207 kernel: [36524.569106] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 15:32:30 juju-e4d256-prod-github-runner-207 kernel: [36524.570408] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 15:32:30 juju-e4d256-prod-github-runner-207 kernel: [36524.571954] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 15:32:30 juju-e4d256-prod-github-runner-207 kernel: [36524.573178] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 15:32:30 juju-e4d256-prod-github-runner-207 kernel: [36524.574677] Call Trace: Aug 22 15:32:30 juju-e4d256-prod-github-runner-207 kernel: [36524.575677] Aug 22 15:32:30 juju-e4d256-prod-github-runner-207 kernel: [36524.576675] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:32:30 juju-e4d256-prod-github-runner-207 kernel: [36524.577797] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:32:30 juju-e4d256-prod-github-runner-207 kernel: [36524.578902] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:32:30 juju-e4d256-prod-github-runner-207 kernel: [36524.580089] ? show_regs.part.0+0x23/0x29 Aug 22 15:32:30 juju-e4d256-prod-github-runner-207 kernel: [36524.581210] ? show_regs.cold+0x8/0xd Aug 22 15:32:30 juju-e4d256-prod-github-runner-207 kernel: [36524.582281] ? watchdog_timer_fn+0x1be/0x220 Aug 22 15:32:30 juju-e4d256-prod-github-runner-207 kernel: [36524.583387] ? lockup_detector_update_enable+0x60/0x60 Aug 22 15:32:30 juju-e4d256-prod-github-runner-207 kernel: [36524.584569] ? __hrtimer_run_queues+0x107/0x230 Aug 22 15:32:30 juju-e4d256-prod-github-runner-207 kernel: [36524.585687] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 15:32:30 juju-e4d256-prod-github-runner-207 kernel: [36524.586808] ? hrtimer_interrupt+0x101/0x220 Aug 22 15:32:30 juju-e4d256-prod-github-runner-207 kernel: [36524.587903] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 15:32:30 juju-e4d256-prod-github-runner-207 kernel: [36524.589078] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 15:32:30 juju-e4d256-prod-github-runner-207 kernel: [36524.590241] Aug 22 15:32:30 juju-e4d256-prod-github-runner-207 kernel: [36524.591154] Aug 22 15:32:30 juju-e4d256-prod-github-runner-207 kernel: [36524.592044] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 15:32:30 juju-e4d256-prod-github-runner-207 kernel: [36524.593208] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:32:30 juju-e4d256-prod-github-runner-207 kernel: [36524.594354] ? _raw_spin_lock+0x22/0x30 Aug 22 15:32:30 juju-e4d256-prod-github-runner-207 kernel: [36524.595386] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:32:30 juju-e4d256-prod-github-runner-207 kernel: [36524.596532] direct_page_fault+0x206/0x310 [kvm] Aug 22 15:32:30 juju-e4d256-prod-github-runner-207 kernel: [36524.597705] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 15:32:30 juju-e4d256-prod-github-runner-207 kernel: [36524.598820] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 15:32:30 juju-e4d256-prod-github-runner-207 kernel: [36524.599937] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 15:32:30 juju-e4d256-prod-github-runner-207 kernel: [36524.601087] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 15:32:30 juju-e4d256-prod-github-runner-207 kernel: [36524.602153] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 15:32:30 juju-e4d256-prod-github-runner-207 kernel: [36524.603248] handle_exit+0x98/0x230 [kvm_amd] Aug 22 15:32:30 juju-e4d256-prod-github-runner-207 kernel: [36524.604236] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 15:32:30 juju-e4d256-prod-github-runner-207 kernel: [36524.605292] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 15:32:30 juju-e4d256-prod-github-runner-207 kernel: [36524.606348] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 15:32:30 juju-e4d256-prod-github-runner-207 kernel: [36524.607368] vcpu_run+0x62/0x2c0 [kvm] Aug 22 15:32:30 juju-e4d256-prod-github-runner-207 kernel: [36524.608260] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 15:32:30 juju-e4d256-prod-github-runner-207 kernel: [36524.609181] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 15:32:30 juju-e4d256-prod-github-runner-207 kernel: [36524.610142] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 15:32:30 juju-e4d256-prod-github-runner-207 kernel: [36524.611056] ? __seccomp_filter+0x4a/0x4a0 Aug 22 15:32:30 juju-e4d256-prod-github-runner-207 kernel: [36524.611837] ? __fget_files+0x86/0xc0 Aug 22 15:32:30 juju-e4d256-prod-github-runner-207 kernel: [36524.612564] __x64_sys_ioctl+0x95/0xd0 Aug 22 15:32:30 juju-e4d256-prod-github-runner-207 kernel: [36524.613304] do_syscall_64+0x5c/0xc0 Aug 22 15:32:30 juju-e4d256-prod-github-runner-207 kernel: [36524.613975] ? do_futex+0x162/0x1f0 Aug 22 15:32:30 juju-e4d256-prod-github-runner-207 kernel: [36524.614631] ? __x64_sys_futex+0x78/0x1e0 Aug 22 15:32:30 juju-e4d256-prod-github-runner-207 kernel: [36524.615308] ? __secure_computing+0xa9/0x120 Aug 22 15:32:30 juju-e4d256-prod-github-runner-207 kernel: [36524.616000] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 15:32:30 juju-e4d256-prod-github-runner-207 kernel: [36524.616795] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:32:30 juju-e4d256-prod-github-runner-207 kernel: [36524.617541] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:32:30 juju-e4d256-prod-github-runner-207 kernel: [36524.618263] ? do_syscall_64+0x69/0xc0 Aug 22 15:32:30 juju-e4d256-prod-github-runner-207 kernel: [36524.618911] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:32:30 juju-e4d256-prod-github-runner-207 kernel: [36524.619621] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:32:30 juju-e4d256-prod-github-runner-207 kernel: [36524.620331] ? do_syscall_64+0x69/0xc0 Aug 22 15:32:30 juju-e4d256-prod-github-runner-207 kernel: [36524.620992] ? do_syscall_64+0x69/0xc0 Aug 22 15:32:30 juju-e4d256-prod-github-runner-207 kernel: [36524.621622] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 15:32:30 juju-e4d256-prod-github-runner-207 kernel: [36524.622330] RIP: 0033:0x7faa5d0edaff Aug 22 15:32:30 juju-e4d256-prod-github-runner-207 kernel: [36524.623013] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 15:32:30 juju-e4d256-prod-github-runner-207 kernel: [36524.625040] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 15:32:30 juju-e4d256-prod-github-runner-207 kernel: [36524.625959] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 15:32:30 juju-e4d256-prod-github-runner-207 kernel: [36524.626886] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 15:32:30 juju-e4d256-prod-github-runner-207 kernel: [36524.627780] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 15:32:30 juju-e4d256-prod-github-runner-207 kernel: [36524.628692] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 15:32:30 juju-e4d256-prod-github-runner-207 kernel: [36524.629587] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 15:32:30 juju-e4d256-prod-github-runner-207 kernel: [36524.630479] Aug 22 15:32:45 juju-e4d256-prod-github-runner-207 kernel: [36539.624707] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 15:32:45 juju-e4d256-prod-github-runner-207 kernel: [36539.625671] rcu: 1-....: (9077019 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=4385586 Aug 22 15:32:45 juju-e4d256-prod-github-runner-207 kernel: [36539.626799] (t=9105606 jiffies g=23269 q=38266) Aug 22 15:32:45 juju-e4d256-prod-github-runner-207 kernel: [36539.627593] NMI backtrace for cpu 1 Aug 22 15:32:45 juju-e4d256-prod-github-runner-207 kernel: [36539.628302] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 15:32:45 juju-e4d256-prod-github-runner-207 kernel: [36539.629420] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 15:32:45 juju-e4d256-prod-github-runner-207 kernel: [36539.630482] Call Trace: Aug 22 15:32:45 juju-e4d256-prod-github-runner-207 kernel: [36539.631207] Aug 22 15:32:45 juju-e4d256-prod-github-runner-207 kernel: [36539.631932] show_stack+0x52/0x5c Aug 22 15:32:45 juju-e4d256-prod-github-runner-207 kernel: [36539.632684] dump_stack_lvl+0x4a/0x63 Aug 22 15:32:45 juju-e4d256-prod-github-runner-207 kernel: [36539.633434] dump_stack+0x10/0x16 Aug 22 15:32:45 juju-e4d256-prod-github-runner-207 kernel: [36539.634149] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 15:32:45 juju-e4d256-prod-github-runner-207 kernel: [36539.634928] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 15:32:45 juju-e4d256-prod-github-runner-207 kernel: [36539.635708] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 15:32:45 juju-e4d256-prod-github-runner-207 kernel: [36539.636543] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 15:32:45 juju-e4d256-prod-github-runner-207 kernel: [36539.637361] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 15:32:45 juju-e4d256-prod-github-runner-207 kernel: [36539.638166] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 15:32:45 juju-e4d256-prod-github-runner-207 kernel: [36539.638936] print_cpu_stall.cold+0x2f/0xe2 Aug 22 15:32:45 juju-e4d256-prod-github-runner-207 kernel: [36539.639745] ? timekeeping_update+0xf7/0x150 Aug 22 15:32:45 juju-e4d256-prod-github-runner-207 kernel: [36539.640537] check_cpu_stall+0x109/0x270 Aug 22 15:32:45 juju-e4d256-prod-github-runner-207 kernel: [36539.641285] rcu_sched_clock_irq+0x9a/0x250 Aug 22 15:32:45 juju-e4d256-prod-github-runner-207 kernel: [36539.642045] update_process_times+0x94/0xd0 Aug 22 15:32:45 juju-e4d256-prod-github-runner-207 kernel: [36539.642807] tick_sched_handle+0x29/0x70 Aug 22 15:32:45 juju-e4d256-prod-github-runner-207 kernel: [36539.643550] tick_sched_timer+0x8c/0xc0 Aug 22 15:32:45 juju-e4d256-prod-github-runner-207 kernel: [36539.644285] ? tick_nohz_handler+0xb0/0xb0 Aug 22 15:32:45 juju-e4d256-prod-github-runner-207 kernel: [36539.645051] __hrtimer_run_queues+0x107/0x230 Aug 22 15:32:45 juju-e4d256-prod-github-runner-207 kernel: [36539.645831] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 15:32:45 juju-e4d256-prod-github-runner-207 kernel: [36539.646613] hrtimer_interrupt+0x101/0x220 Aug 22 15:32:45 juju-e4d256-prod-github-runner-207 kernel: [36539.647369] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 15:32:45 juju-e4d256-prod-github-runner-207 kernel: [36539.648175] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 15:32:45 juju-e4d256-prod-github-runner-207 kernel: [36539.648999] Aug 22 15:32:45 juju-e4d256-prod-github-runner-207 kernel: [36539.649632] Aug 22 15:32:45 juju-e4d256-prod-github-runner-207 kernel: [36539.650258] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 15:32:45 juju-e4d256-prod-github-runner-207 kernel: [36539.651110] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:32:45 juju-e4d256-prod-github-runner-207 kernel: [36539.651993] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 15:32:45 juju-e4d256-prod-github-runner-207 kernel: [36539.654219] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 15:32:45 juju-e4d256-prod-github-runner-207 kernel: [36539.655095] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 15:32:45 juju-e4d256-prod-github-runner-207 kernel: [36539.656084] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 15:32:45 juju-e4d256-prod-github-runner-207 kernel: [36539.657080] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 15:32:45 juju-e4d256-prod-github-runner-207 kernel: [36539.658040] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 15:32:45 juju-e4d256-prod-github-runner-207 kernel: [36539.658989] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 15:32:45 juju-e4d256-prod-github-runner-207 kernel: [36539.659939] ? _raw_spin_lock+0x22/0x30 Aug 22 15:32:45 juju-e4d256-prod-github-runner-207 kernel: [36539.660708] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:32:45 juju-e4d256-prod-github-runner-207 kernel: [36539.661541] direct_page_fault+0x206/0x310 [kvm] Aug 22 15:32:45 juju-e4d256-prod-github-runner-207 kernel: [36539.662377] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 15:32:45 juju-e4d256-prod-github-runner-207 kernel: [36539.663199] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 15:32:45 juju-e4d256-prod-github-runner-207 kernel: [36539.664017] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 15:32:45 juju-e4d256-prod-github-runner-207 kernel: [36539.664833] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 15:32:45 juju-e4d256-prod-github-runner-207 kernel: [36539.665615] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 15:32:45 juju-e4d256-prod-github-runner-207 kernel: [36539.666435] handle_exit+0x98/0x230 [kvm_amd] Aug 22 15:32:45 juju-e4d256-prod-github-runner-207 kernel: [36539.667187] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 15:32:45 juju-e4d256-prod-github-runner-207 kernel: [36539.667981] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 15:32:45 juju-e4d256-prod-github-runner-207 kernel: [36539.668802] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 15:32:45 juju-e4d256-prod-github-runner-207 kernel: [36539.669585] vcpu_run+0x62/0x2c0 [kvm] Aug 22 15:32:45 juju-e4d256-prod-github-runner-207 kernel: [36539.670303] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 15:32:45 juju-e4d256-prod-github-runner-207 kernel: [36539.671036] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 15:32:45 juju-e4d256-prod-github-runner-207 kernel: [36539.671841] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 15:32:45 juju-e4d256-prod-github-runner-207 kernel: [36539.672625] ? __seccomp_filter+0x4a/0x4a0 Aug 22 15:32:45 juju-e4d256-prod-github-runner-207 kernel: [36539.673347] ? __fget_files+0x86/0xc0 Aug 22 15:32:45 juju-e4d256-prod-github-runner-207 kernel: [36539.674038] __x64_sys_ioctl+0x95/0xd0 Aug 22 15:32:45 juju-e4d256-prod-github-runner-207 kernel: [36539.674732] do_syscall_64+0x5c/0xc0 Aug 22 15:32:45 juju-e4d256-prod-github-runner-207 kernel: [36539.675411] ? do_futex+0x162/0x1f0 Aug 22 15:32:45 juju-e4d256-prod-github-runner-207 kernel: [36539.676086] ? __x64_sys_futex+0x78/0x1e0 Aug 22 15:32:45 juju-e4d256-prod-github-runner-207 kernel: [36539.676798] ? __secure_computing+0xa9/0x120 Aug 22 15:32:45 juju-e4d256-prod-github-runner-207 kernel: [36539.677514] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 15:32:45 juju-e4d256-prod-github-runner-207 kernel: [36539.678303] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:32:45 juju-e4d256-prod-github-runner-207 kernel: [36539.679055] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:32:45 juju-e4d256-prod-github-runner-207 kernel: [36539.679806] ? do_syscall_64+0x69/0xc0 Aug 22 15:32:45 juju-e4d256-prod-github-runner-207 kernel: [36539.680503] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:32:45 juju-e4d256-prod-github-runner-207 kernel: [36539.681264] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:32:45 juju-e4d256-prod-github-runner-207 kernel: [36539.682020] ? do_syscall_64+0x69/0xc0 Aug 22 15:32:45 juju-e4d256-prod-github-runner-207 kernel: [36539.682714] ? do_syscall_64+0x69/0xc0 Aug 22 15:32:45 juju-e4d256-prod-github-runner-207 kernel: [36539.683399] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 15:32:45 juju-e4d256-prod-github-runner-207 kernel: [36539.684174] RIP: 0033:0x7faa5d0edaff Aug 22 15:32:45 juju-e4d256-prod-github-runner-207 kernel: [36539.684896] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 15:32:45 juju-e4d256-prod-github-runner-207 kernel: [36539.686990] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 15:32:45 juju-e4d256-prod-github-runner-207 kernel: [36539.687953] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 15:32:45 juju-e4d256-prod-github-runner-207 kernel: [36539.688912] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 15:32:45 juju-e4d256-prod-github-runner-207 kernel: [36539.689860] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 15:32:45 juju-e4d256-prod-github-runner-207 kernel: [36539.690805] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 15:32:45 juju-e4d256-prod-github-runner-207 kernel: [36539.691729] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 15:32:45 juju-e4d256-prod-github-runner-207 kernel: [36539.692687] Aug 22 15:33:10 juju-e4d256-prod-github-runner-207 kernel: [36564.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 33945s! [qemu-system-x86:6715] Aug 22 15:33:10 juju-e4d256-prod-github-runner-207 kernel: [36564.543764] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 15:33:10 juju-e4d256-prod-github-runner-207 kernel: [36564.544028] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 15:33:10 juju-e4d256-prod-github-runner-207 kernel: [36564.556294] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 15:33:10 juju-e4d256-prod-github-runner-207 kernel: [36564.557581] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 15:33:10 juju-e4d256-prod-github-runner-207 kernel: [36564.558819] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:33:10 juju-e4d256-prod-github-runner-207 kernel: [36564.559876] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 15:33:10 juju-e4d256-prod-github-runner-207 kernel: [36564.562455] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 15:33:10 juju-e4d256-prod-github-runner-207 kernel: [36564.563540] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 15:33:10 juju-e4d256-prod-github-runner-207 kernel: [36564.564727] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 15:33:10 juju-e4d256-prod-github-runner-207 kernel: [36564.565889] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 15:33:10 juju-e4d256-prod-github-runner-207 kernel: [36564.567048] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 15:33:10 juju-e4d256-prod-github-runner-207 kernel: [36564.568230] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 15:33:10 juju-e4d256-prod-github-runner-207 kernel: [36564.569411] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 15:33:10 juju-e4d256-prod-github-runner-207 kernel: [36564.570651] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 15:33:10 juju-e4d256-prod-github-runner-207 kernel: [36564.571754] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 15:33:10 juju-e4d256-prod-github-runner-207 kernel: [36564.572980] Call Trace: Aug 22 15:33:10 juju-e4d256-prod-github-runner-207 kernel: [36564.573942] Aug 22 15:33:10 juju-e4d256-prod-github-runner-207 kernel: [36564.574836] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:33:10 juju-e4d256-prod-github-runner-207 kernel: [36564.575869] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:33:10 juju-e4d256-prod-github-runner-207 kernel: [36564.576914] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:33:10 juju-e4d256-prod-github-runner-207 kernel: [36564.578027] ? show_regs.part.0+0x23/0x29 Aug 22 15:33:10 juju-e4d256-prod-github-runner-207 kernel: [36564.579042] ? show_regs.cold+0x8/0xd Aug 22 15:33:10 juju-e4d256-prod-github-runner-207 kernel: [36564.580034] ? watchdog_timer_fn+0x1be/0x220 Aug 22 15:33:10 juju-e4d256-prod-github-runner-207 kernel: [36564.581048] ? lockup_detector_update_enable+0x60/0x60 Aug 22 15:33:10 juju-e4d256-prod-github-runner-207 kernel: [36564.582117] ? __hrtimer_run_queues+0x107/0x230 Aug 22 15:33:10 juju-e4d256-prod-github-runner-207 kernel: [36564.583152] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 15:33:10 juju-e4d256-prod-github-runner-207 kernel: [36564.584216] ? hrtimer_interrupt+0x101/0x220 Aug 22 15:33:10 juju-e4d256-prod-github-runner-207 kernel: [36564.585242] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 15:33:10 juju-e4d256-prod-github-runner-207 kernel: [36564.586317] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 15:33:10 juju-e4d256-prod-github-runner-207 kernel: [36564.587362] Aug 22 15:33:10 juju-e4d256-prod-github-runner-207 kernel: [36564.588237] Aug 22 15:33:10 juju-e4d256-prod-github-runner-207 kernel: [36564.589111] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 15:33:10 juju-e4d256-prod-github-runner-207 kernel: [36564.590148] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:33:10 juju-e4d256-prod-github-runner-207 kernel: [36564.591188] ? _raw_spin_lock+0x22/0x30 Aug 22 15:33:10 juju-e4d256-prod-github-runner-207 kernel: [36564.592147] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:33:10 juju-e4d256-prod-github-runner-207 kernel: [36564.593195] direct_page_fault+0x206/0x310 [kvm] Aug 22 15:33:10 juju-e4d256-prod-github-runner-207 kernel: [36564.594258] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 15:33:10 juju-e4d256-prod-github-runner-207 kernel: [36564.595278] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 15:33:10 juju-e4d256-prod-github-runner-207 kernel: [36564.596298] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 15:33:10 juju-e4d256-prod-github-runner-207 kernel: [36564.597307] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 15:33:10 juju-e4d256-prod-github-runner-207 kernel: [36564.598269] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 15:33:10 juju-e4d256-prod-github-runner-207 kernel: [36564.599260] handle_exit+0x98/0x230 [kvm_amd] Aug 22 15:33:10 juju-e4d256-prod-github-runner-207 kernel: [36564.600170] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 15:33:10 juju-e4d256-prod-github-runner-207 kernel: [36564.601093] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 15:33:10 juju-e4d256-prod-github-runner-207 kernel: [36564.602025] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 15:33:10 juju-e4d256-prod-github-runner-207 kernel: [36564.602931] vcpu_run+0x62/0x2c0 [kvm] Aug 22 15:33:10 juju-e4d256-prod-github-runner-207 kernel: [36564.603753] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 15:33:10 juju-e4d256-prod-github-runner-207 kernel: [36564.604629] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 15:33:10 juju-e4d256-prod-github-runner-207 kernel: [36564.605503] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 15:33:10 juju-e4d256-prod-github-runner-207 kernel: [36564.606303] ? __seccomp_filter+0x4a/0x4a0 Aug 22 15:33:10 juju-e4d256-prod-github-runner-207 kernel: [36564.607047] ? __fget_files+0x86/0xc0 Aug 22 15:33:10 juju-e4d256-prod-github-runner-207 kernel: [36564.607751] __x64_sys_ioctl+0x95/0xd0 Aug 22 15:33:10 juju-e4d256-prod-github-runner-207 kernel: [36564.608479] do_syscall_64+0x5c/0xc0 Aug 22 15:33:10 juju-e4d256-prod-github-runner-207 kernel: [36564.609160] ? do_futex+0x162/0x1f0 Aug 22 15:33:10 juju-e4d256-prod-github-runner-207 kernel: [36564.609820] ? __x64_sys_futex+0x78/0x1e0 Aug 22 15:33:10 juju-e4d256-prod-github-runner-207 kernel: [36564.610524] ? __secure_computing+0xa9/0x120 Aug 22 15:33:10 juju-e4d256-prod-github-runner-207 kernel: [36564.611230] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 15:33:10 juju-e4d256-prod-github-runner-207 kernel: [36564.611987] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:33:10 juju-e4d256-prod-github-runner-207 kernel: [36564.612733] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:33:10 juju-e4d256-prod-github-runner-207 kernel: [36564.613485] ? do_syscall_64+0x69/0xc0 Aug 22 15:33:10 juju-e4d256-prod-github-runner-207 kernel: [36564.614144] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:33:10 juju-e4d256-prod-github-runner-207 kernel: [36564.614902] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:33:10 juju-e4d256-prod-github-runner-207 kernel: [36564.615603] ? do_syscall_64+0x69/0xc0 Aug 22 15:33:10 juju-e4d256-prod-github-runner-207 kernel: [36564.616247] ? do_syscall_64+0x69/0xc0 Aug 22 15:33:10 juju-e4d256-prod-github-runner-207 kernel: [36564.616879] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 15:33:10 juju-e4d256-prod-github-runner-207 kernel: [36564.617587] RIP: 0033:0x7faa5d0edaff Aug 22 15:33:10 juju-e4d256-prod-github-runner-207 kernel: [36564.618237] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 15:33:10 juju-e4d256-prod-github-runner-207 kernel: [36564.620260] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 15:33:10 juju-e4d256-prod-github-runner-207 kernel: [36564.621183] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 15:33:10 juju-e4d256-prod-github-runner-207 kernel: [36564.622074] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 15:33:10 juju-e4d256-prod-github-runner-207 kernel: [36564.622965] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 15:33:10 juju-e4d256-prod-github-runner-207 kernel: [36564.623859] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 15:33:10 juju-e4d256-prod-github-runner-207 kernel: [36564.624779] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 15:33:10 juju-e4d256-prod-github-runner-207 kernel: [36564.625713] Aug 22 15:33:38 juju-e4d256-prod-github-runner-207 kernel: [36592.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 33971s! [qemu-system-x86:6715] Aug 22 15:33:38 juju-e4d256-prod-github-runner-207 kernel: [36592.543746] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 15:33:38 juju-e4d256-prod-github-runner-207 kernel: [36592.543990] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 15:33:38 juju-e4d256-prod-github-runner-207 kernel: [36592.556090] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 15:33:38 juju-e4d256-prod-github-runner-207 kernel: [36592.557384] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 15:33:38 juju-e4d256-prod-github-runner-207 kernel: [36592.558603] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:33:38 juju-e4d256-prod-github-runner-207 kernel: [36592.559660] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 15:33:38 juju-e4d256-prod-github-runner-207 kernel: [36592.562221] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 15:33:38 juju-e4d256-prod-github-runner-207 kernel: [36592.563262] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 15:33:38 juju-e4d256-prod-github-runner-207 kernel: [36592.564442] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 15:33:38 juju-e4d256-prod-github-runner-207 kernel: [36592.565600] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 15:33:38 juju-e4d256-prod-github-runner-207 kernel: [36592.566765] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 15:33:38 juju-e4d256-prod-github-runner-207 kernel: [36592.567942] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 15:33:38 juju-e4d256-prod-github-runner-207 kernel: [36592.569105] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 15:33:38 juju-e4d256-prod-github-runner-207 kernel: [36592.570342] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 15:33:38 juju-e4d256-prod-github-runner-207 kernel: [36592.571437] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 15:33:38 juju-e4d256-prod-github-runner-207 kernel: [36592.572636] Call Trace: Aug 22 15:33:38 juju-e4d256-prod-github-runner-207 kernel: [36592.573549] Aug 22 15:33:38 juju-e4d256-prod-github-runner-207 kernel: [36592.574439] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:33:38 juju-e4d256-prod-github-runner-207 kernel: [36592.575465] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:33:38 juju-e4d256-prod-github-runner-207 kernel: [36592.576506] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:33:38 juju-e4d256-prod-github-runner-207 kernel: [36592.577613] ? show_regs.part.0+0x23/0x29 Aug 22 15:33:38 juju-e4d256-prod-github-runner-207 kernel: [36592.578607] ? show_regs.cold+0x8/0xd Aug 22 15:33:38 juju-e4d256-prod-github-runner-207 kernel: [36592.579575] ? watchdog_timer_fn+0x1be/0x220 Aug 22 15:33:38 juju-e4d256-prod-github-runner-207 kernel: [36592.580595] ? lockup_detector_update_enable+0x60/0x60 Aug 22 15:33:38 juju-e4d256-prod-github-runner-207 kernel: [36592.581658] ? __hrtimer_run_queues+0x107/0x230 Aug 22 15:33:38 juju-e4d256-prod-github-runner-207 kernel: [36592.582684] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 15:33:38 juju-e4d256-prod-github-runner-207 kernel: [36592.583728] ? hrtimer_interrupt+0x101/0x220 Aug 22 15:33:38 juju-e4d256-prod-github-runner-207 kernel: [36592.584759] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 15:33:38 juju-e4d256-prod-github-runner-207 kernel: [36592.585841] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 15:33:38 juju-e4d256-prod-github-runner-207 kernel: [36592.586895] Aug 22 15:33:38 juju-e4d256-prod-github-runner-207 kernel: [36592.587761] Aug 22 15:33:38 juju-e4d256-prod-github-runner-207 kernel: [36592.588599] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 15:33:38 juju-e4d256-prod-github-runner-207 kernel: [36592.589636] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:33:38 juju-e4d256-prod-github-runner-207 kernel: [36592.590672] ? _raw_spin_lock+0x22/0x30 Aug 22 15:33:38 juju-e4d256-prod-github-runner-207 kernel: [36592.591616] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:33:38 juju-e4d256-prod-github-runner-207 kernel: [36592.592642] direct_page_fault+0x206/0x310 [kvm] Aug 22 15:33:38 juju-e4d256-prod-github-runner-207 kernel: [36592.593665] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 15:33:38 juju-e4d256-prod-github-runner-207 kernel: [36592.594671] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 15:33:38 juju-e4d256-prod-github-runner-207 kernel: [36592.595668] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 15:33:38 juju-e4d256-prod-github-runner-207 kernel: [36592.596732] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 15:33:38 juju-e4d256-prod-github-runner-207 kernel: [36592.597681] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 15:33:38 juju-e4d256-prod-github-runner-207 kernel: [36592.598664] handle_exit+0x98/0x230 [kvm_amd] Aug 22 15:33:38 juju-e4d256-prod-github-runner-207 kernel: [36592.599556] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 15:33:38 juju-e4d256-prod-github-runner-207 kernel: [36592.600477] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 15:33:38 juju-e4d256-prod-github-runner-207 kernel: [36592.601400] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 15:33:38 juju-e4d256-prod-github-runner-207 kernel: [36592.602379] vcpu_run+0x62/0x2c0 [kvm] Aug 22 15:33:38 juju-e4d256-prod-github-runner-207 kernel: [36592.603188] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 15:33:38 juju-e4d256-prod-github-runner-207 kernel: [36592.604003] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 15:33:38 juju-e4d256-prod-github-runner-207 kernel: [36592.604867] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 15:33:38 juju-e4d256-prod-github-runner-207 kernel: [36592.605668] ? __seccomp_filter+0x4a/0x4a0 Aug 22 15:33:38 juju-e4d256-prod-github-runner-207 kernel: [36592.606408] ? __fget_files+0x86/0xc0 Aug 22 15:33:38 juju-e4d256-prod-github-runner-207 kernel: [36592.607108] __x64_sys_ioctl+0x95/0xd0 Aug 22 15:33:38 juju-e4d256-prod-github-runner-207 kernel: [36592.607818] do_syscall_64+0x5c/0xc0 Aug 22 15:33:38 juju-e4d256-prod-github-runner-207 kernel: [36592.608486] ? do_futex+0x162/0x1f0 Aug 22 15:33:38 juju-e4d256-prod-github-runner-207 kernel: [36592.609133] ? __x64_sys_futex+0x78/0x1e0 Aug 22 15:33:38 juju-e4d256-prod-github-runner-207 kernel: [36592.609804] ? __secure_computing+0xa9/0x120 Aug 22 15:33:38 juju-e4d256-prod-github-runner-207 kernel: [36592.610491] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 15:33:38 juju-e4d256-prod-github-runner-207 kernel: [36592.611252] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:33:38 juju-e4d256-prod-github-runner-207 kernel: [36592.612031] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:33:38 juju-e4d256-prod-github-runner-207 kernel: [36592.612750] ? do_syscall_64+0x69/0xc0 Aug 22 15:33:38 juju-e4d256-prod-github-runner-207 kernel: [36592.613398] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:33:38 juju-e4d256-prod-github-runner-207 kernel: [36592.614099] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:33:38 juju-e4d256-prod-github-runner-207 kernel: [36592.614817] ? do_syscall_64+0x69/0xc0 Aug 22 15:33:38 juju-e4d256-prod-github-runner-207 kernel: [36592.615443] ? do_syscall_64+0x69/0xc0 Aug 22 15:33:38 juju-e4d256-prod-github-runner-207 kernel: [36592.616081] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 15:33:38 juju-e4d256-prod-github-runner-207 kernel: [36592.616784] RIP: 0033:0x7faa5d0edaff Aug 22 15:33:38 juju-e4d256-prod-github-runner-207 kernel: [36592.617431] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 15:33:38 juju-e4d256-prod-github-runner-207 kernel: [36592.619419] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 15:33:38 juju-e4d256-prod-github-runner-207 kernel: [36592.620345] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 15:33:38 juju-e4d256-prod-github-runner-207 kernel: [36592.621234] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 15:33:38 juju-e4d256-prod-github-runner-207 kernel: [36592.622119] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 15:33:38 juju-e4d256-prod-github-runner-207 kernel: [36592.623004] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 15:33:38 juju-e4d256-prod-github-runner-207 kernel: [36592.623909] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 15:33:38 juju-e4d256-prod-github-runner-207 kernel: [36592.624804] Aug 22 15:34:06 juju-e4d256-prod-github-runner-207 kernel: [36620.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 33997s! [qemu-system-x86:6715] Aug 22 15:34:06 juju-e4d256-prod-github-runner-207 kernel: [36620.543775] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 15:34:06 juju-e4d256-prod-github-runner-207 kernel: [36620.544037] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 15:34:06 juju-e4d256-prod-github-runner-207 kernel: [36620.556380] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 15:34:06 juju-e4d256-prod-github-runner-207 kernel: [36620.557681] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 15:34:06 juju-e4d256-prod-github-runner-207 kernel: [36620.558947] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:34:06 juju-e4d256-prod-github-runner-207 kernel: [36620.560029] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 15:34:06 juju-e4d256-prod-github-runner-207 kernel: [36620.562575] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 15:34:06 juju-e4d256-prod-github-runner-207 kernel: [36620.563631] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 15:34:06 juju-e4d256-prod-github-runner-207 kernel: [36620.564791] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 15:34:06 juju-e4d256-prod-github-runner-207 kernel: [36620.565951] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 15:34:06 juju-e4d256-prod-github-runner-207 kernel: [36620.567109] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 15:34:06 juju-e4d256-prod-github-runner-207 kernel: [36620.568277] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 15:34:06 juju-e4d256-prod-github-runner-207 kernel: [36620.569443] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 15:34:06 juju-e4d256-prod-github-runner-207 kernel: [36620.570678] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 15:34:06 juju-e4d256-prod-github-runner-207 kernel: [36620.571786] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 15:34:06 juju-e4d256-prod-github-runner-207 kernel: [36620.572980] Call Trace: Aug 22 15:34:06 juju-e4d256-prod-github-runner-207 kernel: [36620.573896] Aug 22 15:34:06 juju-e4d256-prod-github-runner-207 kernel: [36620.574787] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:34:06 juju-e4d256-prod-github-runner-207 kernel: [36620.575823] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:34:06 juju-e4d256-prod-github-runner-207 kernel: [36620.576844] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:34:06 juju-e4d256-prod-github-runner-207 kernel: [36620.577943] ? show_regs.part.0+0x23/0x29 Aug 22 15:34:06 juju-e4d256-prod-github-runner-207 kernel: [36620.578939] ? show_regs.cold+0x8/0xd Aug 22 15:34:06 juju-e4d256-prod-github-runner-207 kernel: [36620.579925] ? watchdog_timer_fn+0x1be/0x220 Aug 22 15:34:06 juju-e4d256-prod-github-runner-207 kernel: [36620.580931] ? lockup_detector_update_enable+0x60/0x60 Aug 22 15:34:06 juju-e4d256-prod-github-runner-207 kernel: [36620.581995] ? __hrtimer_run_queues+0x107/0x230 Aug 22 15:34:06 juju-e4d256-prod-github-runner-207 kernel: [36620.583028] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 15:34:06 juju-e4d256-prod-github-runner-207 kernel: [36620.584171] ? hrtimer_interrupt+0x101/0x220 Aug 22 15:34:06 juju-e4d256-prod-github-runner-207 kernel: [36620.585201] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 15:34:06 juju-e4d256-prod-github-runner-207 kernel: [36620.586280] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 15:34:06 juju-e4d256-prod-github-runner-207 kernel: [36620.587329] Aug 22 15:34:06 juju-e4d256-prod-github-runner-207 kernel: [36620.588220] Aug 22 15:34:06 juju-e4d256-prod-github-runner-207 kernel: [36620.589113] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 15:34:06 juju-e4d256-prod-github-runner-207 kernel: [36620.590358] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:34:06 juju-e4d256-prod-github-runner-207 kernel: [36620.591501] ? _raw_spin_lock+0x22/0x30 Aug 22 15:34:06 juju-e4d256-prod-github-runner-207 kernel: [36620.592470] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:34:06 juju-e4d256-prod-github-runner-207 kernel: [36620.593535] direct_page_fault+0x206/0x310 [kvm] Aug 22 15:34:06 juju-e4d256-prod-github-runner-207 kernel: [36620.594573] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 15:34:06 juju-e4d256-prod-github-runner-207 kernel: [36620.595606] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 15:34:06 juju-e4d256-prod-github-runner-207 kernel: [36620.596612] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 15:34:06 juju-e4d256-prod-github-runner-207 kernel: [36620.597635] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 15:34:06 juju-e4d256-prod-github-runner-207 kernel: [36620.598613] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 15:34:06 juju-e4d256-prod-github-runner-207 kernel: [36620.599611] handle_exit+0x98/0x230 [kvm_amd] Aug 22 15:34:06 juju-e4d256-prod-github-runner-207 kernel: [36620.600507] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 15:34:06 juju-e4d256-prod-github-runner-207 kernel: [36620.601427] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 15:34:06 juju-e4d256-prod-github-runner-207 kernel: [36620.602367] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 15:34:06 juju-e4d256-prod-github-runner-207 kernel: [36620.603293] vcpu_run+0x62/0x2c0 [kvm] Aug 22 15:34:06 juju-e4d256-prod-github-runner-207 kernel: [36620.604125] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 15:34:06 juju-e4d256-prod-github-runner-207 kernel: [36620.604944] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 15:34:06 juju-e4d256-prod-github-runner-207 kernel: [36620.605811] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 15:34:06 juju-e4d256-prod-github-runner-207 kernel: [36620.606622] ? __seccomp_filter+0x4a/0x4a0 Aug 22 15:34:06 juju-e4d256-prod-github-runner-207 kernel: [36620.607399] ? __fget_files+0x86/0xc0 Aug 22 15:34:06 juju-e4d256-prod-github-runner-207 kernel: [36620.608128] __x64_sys_ioctl+0x95/0xd0 Aug 22 15:34:06 juju-e4d256-prod-github-runner-207 kernel: [36620.608855] do_syscall_64+0x5c/0xc0 Aug 22 15:34:06 juju-e4d256-prod-github-runner-207 kernel: [36620.609528] ? do_futex+0x162/0x1f0 Aug 22 15:34:06 juju-e4d256-prod-github-runner-207 kernel: [36620.610180] ? __x64_sys_futex+0x78/0x1e0 Aug 22 15:34:06 juju-e4d256-prod-github-runner-207 kernel: [36620.610861] ? __secure_computing+0xa9/0x120 Aug 22 15:34:06 juju-e4d256-prod-github-runner-207 kernel: [36620.611569] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 15:34:06 juju-e4d256-prod-github-runner-207 kernel: [36620.612331] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:34:06 juju-e4d256-prod-github-runner-207 kernel: [36620.613063] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:34:06 juju-e4d256-prod-github-runner-207 kernel: [36620.613796] ? do_syscall_64+0x69/0xc0 Aug 22 15:34:06 juju-e4d256-prod-github-runner-207 kernel: [36620.614445] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:34:06 juju-e4d256-prod-github-runner-207 kernel: [36620.615160] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:34:06 juju-e4d256-prod-github-runner-207 kernel: [36620.615871] ? do_syscall_64+0x69/0xc0 Aug 22 15:34:06 juju-e4d256-prod-github-runner-207 kernel: [36620.616501] ? do_syscall_64+0x69/0xc0 Aug 22 15:34:06 juju-e4d256-prod-github-runner-207 kernel: [36620.617127] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 15:34:06 juju-e4d256-prod-github-runner-207 kernel: [36620.617851] RIP: 0033:0x7faa5d0edaff Aug 22 15:34:06 juju-e4d256-prod-github-runner-207 kernel: [36620.618525] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 15:34:06 juju-e4d256-prod-github-runner-207 kernel: [36620.620603] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 15:34:06 juju-e4d256-prod-github-runner-207 kernel: [36620.621518] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 15:34:06 juju-e4d256-prod-github-runner-207 kernel: [36620.622412] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 15:34:06 juju-e4d256-prod-github-runner-207 kernel: [36620.623320] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 15:34:06 juju-e4d256-prod-github-runner-207 kernel: [36620.624247] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 15:34:06 juju-e4d256-prod-github-runner-207 kernel: [36620.625149] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 15:34:06 juju-e4d256-prod-github-runner-207 kernel: [36620.626047] Aug 22 15:34:34 juju-e4d256-prod-github-runner-207 kernel: [36648.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 34023s! [qemu-system-x86:6715] Aug 22 15:34:34 juju-e4d256-prod-github-runner-207 kernel: [36648.543102] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 15:34:34 juju-e4d256-prod-github-runner-207 kernel: [36648.543169] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 15:34:34 juju-e4d256-prod-github-runner-207 kernel: [36648.555210] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 15:34:34 juju-e4d256-prod-github-runner-207 kernel: [36648.556479] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 15:34:34 juju-e4d256-prod-github-runner-207 kernel: [36648.557705] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:34:34 juju-e4d256-prod-github-runner-207 kernel: [36648.558770] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 15:34:34 juju-e4d256-prod-github-runner-207 kernel: [36648.561329] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 15:34:34 juju-e4d256-prod-github-runner-207 kernel: [36648.562370] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 15:34:34 juju-e4d256-prod-github-runner-207 kernel: [36648.563536] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 15:34:34 juju-e4d256-prod-github-runner-207 kernel: [36648.564696] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 15:34:34 juju-e4d256-prod-github-runner-207 kernel: [36648.565856] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 15:34:34 juju-e4d256-prod-github-runner-207 kernel: [36648.567034] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 15:34:34 juju-e4d256-prod-github-runner-207 kernel: [36648.568198] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 15:34:34 juju-e4d256-prod-github-runner-207 kernel: [36648.569432] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 15:34:34 juju-e4d256-prod-github-runner-207 kernel: [36648.570528] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 15:34:34 juju-e4d256-prod-github-runner-207 kernel: [36648.571727] Call Trace: Aug 22 15:34:34 juju-e4d256-prod-github-runner-207 kernel: [36648.572637] Aug 22 15:34:34 juju-e4d256-prod-github-runner-207 kernel: [36648.573519] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:34:34 juju-e4d256-prod-github-runner-207 kernel: [36648.574547] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:34:34 juju-e4d256-prod-github-runner-207 kernel: [36648.575577] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:34:34 juju-e4d256-prod-github-runner-207 kernel: [36648.576649] ? show_regs.part.0+0x23/0x29 Aug 22 15:34:34 juju-e4d256-prod-github-runner-207 kernel: [36648.577649] ? show_regs.cold+0x8/0xd Aug 22 15:34:34 juju-e4d256-prod-github-runner-207 kernel: [36648.578616] ? watchdog_timer_fn+0x1be/0x220 Aug 22 15:34:34 juju-e4d256-prod-github-runner-207 kernel: [36648.579630] ? lockup_detector_update_enable+0x60/0x60 Aug 22 15:34:34 juju-e4d256-prod-github-runner-207 kernel: [36648.580692] ? __hrtimer_run_queues+0x107/0x230 Aug 22 15:34:34 juju-e4d256-prod-github-runner-207 kernel: [36648.581717] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 15:34:34 juju-e4d256-prod-github-runner-207 kernel: [36648.582737] ? hrtimer_interrupt+0x101/0x220 Aug 22 15:34:34 juju-e4d256-prod-github-runner-207 kernel: [36648.583755] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 15:34:34 juju-e4d256-prod-github-runner-207 kernel: [36648.584821] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 15:34:34 juju-e4d256-prod-github-runner-207 kernel: [36648.585869] Aug 22 15:34:34 juju-e4d256-prod-github-runner-207 kernel: [36648.586720] Aug 22 15:34:34 juju-e4d256-prod-github-runner-207 kernel: [36648.587567] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 15:34:34 juju-e4d256-prod-github-runner-207 kernel: [36648.588596] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:34:34 juju-e4d256-prod-github-runner-207 kernel: [36648.589638] ? _raw_spin_lock+0x22/0x30 Aug 22 15:34:34 juju-e4d256-prod-github-runner-207 kernel: [36648.590579] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:34:34 juju-e4d256-prod-github-runner-207 kernel: [36648.591600] direct_page_fault+0x206/0x310 [kvm] Aug 22 15:34:34 juju-e4d256-prod-github-runner-207 kernel: [36648.592621] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 15:34:34 juju-e4d256-prod-github-runner-207 kernel: [36648.593632] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 15:34:34 juju-e4d256-prod-github-runner-207 kernel: [36648.594629] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 15:34:34 juju-e4d256-prod-github-runner-207 kernel: [36648.595601] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 15:34:34 juju-e4d256-prod-github-runner-207 kernel: [36648.596546] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 15:34:34 juju-e4d256-prod-github-runner-207 kernel: [36648.597527] handle_exit+0x98/0x230 [kvm_amd] Aug 22 15:34:34 juju-e4d256-prod-github-runner-207 kernel: [36648.598417] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 15:34:34 juju-e4d256-prod-github-runner-207 kernel: [36648.599338] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 15:34:34 juju-e4d256-prod-github-runner-207 kernel: [36648.600259] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 15:34:34 juju-e4d256-prod-github-runner-207 kernel: [36648.601165] vcpu_run+0x62/0x2c0 [kvm] Aug 22 15:34:34 juju-e4d256-prod-github-runner-207 kernel: [36648.601977] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 15:34:34 juju-e4d256-prod-github-runner-207 kernel: [36648.602781] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 15:34:34 juju-e4d256-prod-github-runner-207 kernel: [36648.603636] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 15:34:34 juju-e4d256-prod-github-runner-207 kernel: [36648.604429] ? __seccomp_filter+0x4a/0x4a0 Aug 22 15:34:34 juju-e4d256-prod-github-runner-207 kernel: [36648.605168] ? __fget_files+0x86/0xc0 Aug 22 15:34:34 juju-e4d256-prod-github-runner-207 kernel: [36648.605869] __x64_sys_ioctl+0x95/0xd0 Aug 22 15:34:34 juju-e4d256-prod-github-runner-207 kernel: [36648.606558] do_syscall_64+0x5c/0xc0 Aug 22 15:34:34 juju-e4d256-prod-github-runner-207 kernel: [36648.607230] ? do_futex+0x162/0x1f0 Aug 22 15:34:34 juju-e4d256-prod-github-runner-207 kernel: [36648.607876] ? __x64_sys_futex+0x78/0x1e0 Aug 22 15:34:34 juju-e4d256-prod-github-runner-207 kernel: [36648.608546] ? __secure_computing+0xa9/0x120 Aug 22 15:34:34 juju-e4d256-prod-github-runner-207 kernel: [36648.609233] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 15:34:34 juju-e4d256-prod-github-runner-207 kernel: [36648.609992] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:34:34 juju-e4d256-prod-github-runner-207 kernel: [36648.610711] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:34:34 juju-e4d256-prod-github-runner-207 kernel: [36648.611436] ? do_syscall_64+0x69/0xc0 Aug 22 15:34:34 juju-e4d256-prod-github-runner-207 kernel: [36648.612085] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:34:34 juju-e4d256-prod-github-runner-207 kernel: [36648.612787] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:34:34 juju-e4d256-prod-github-runner-207 kernel: [36648.613479] ? do_syscall_64+0x69/0xc0 Aug 22 15:34:34 juju-e4d256-prod-github-runner-207 kernel: [36648.614101] ? do_syscall_64+0x69/0xc0 Aug 22 15:34:34 juju-e4d256-prod-github-runner-207 kernel: [36648.614721] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 15:34:34 juju-e4d256-prod-github-runner-207 kernel: [36648.615437] RIP: 0033:0x7faa5d0edaff Aug 22 15:34:34 juju-e4d256-prod-github-runner-207 kernel: [36648.616079] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 15:34:34 juju-e4d256-prod-github-runner-207 kernel: [36648.618062] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 15:34:34 juju-e4d256-prod-github-runner-207 kernel: [36648.618974] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 15:34:34 juju-e4d256-prod-github-runner-207 kernel: [36648.619869] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 15:34:34 juju-e4d256-prod-github-runner-207 kernel: [36648.620755] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 15:34:34 juju-e4d256-prod-github-runner-207 kernel: [36648.621647] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 15:34:34 juju-e4d256-prod-github-runner-207 kernel: [36648.622532] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 15:34:34 juju-e4d256-prod-github-runner-207 kernel: [36648.623428] Aug 22 15:35:02 juju-e4d256-prod-github-runner-207 kernel: [36676.541976] watchdog: BUG: soft lockup - CPU#1 stuck for 34049s! [qemu-system-x86:6715] Aug 22 15:35:02 juju-e4d256-prod-github-runner-207 kernel: [36676.543698] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 15:35:02 juju-e4d256-prod-github-runner-207 kernel: [36676.543935] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 15:35:02 juju-e4d256-prod-github-runner-207 kernel: [36676.556081] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 15:35:02 juju-e4d256-prod-github-runner-207 kernel: [36676.557353] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 15:35:02 juju-e4d256-prod-github-runner-207 kernel: [36676.558580] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:35:02 juju-e4d256-prod-github-runner-207 kernel: [36676.559673] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 15:35:02 juju-e4d256-prod-github-runner-207 kernel: [36676.562234] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 15:35:02 juju-e4d256-prod-github-runner-207 kernel: [36676.563285] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 15:35:02 juju-e4d256-prod-github-runner-207 kernel: [36676.564450] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 15:35:02 juju-e4d256-prod-github-runner-207 kernel: [36676.565606] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 15:35:02 juju-e4d256-prod-github-runner-207 kernel: [36676.566777] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 15:35:02 juju-e4d256-prod-github-runner-207 kernel: [36676.567941] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 15:35:02 juju-e4d256-prod-github-runner-207 kernel: [36676.569104] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 15:35:02 juju-e4d256-prod-github-runner-207 kernel: [36676.570340] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 15:35:02 juju-e4d256-prod-github-runner-207 kernel: [36676.571448] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 15:35:02 juju-e4d256-prod-github-runner-207 kernel: [36676.572638] Call Trace: Aug 22 15:35:02 juju-e4d256-prod-github-runner-207 kernel: [36676.573553] Aug 22 15:35:02 juju-e4d256-prod-github-runner-207 kernel: [36676.574443] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:35:02 juju-e4d256-prod-github-runner-207 kernel: [36676.575483] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:35:02 juju-e4d256-prod-github-runner-207 kernel: [36676.576508] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:35:02 juju-e4d256-prod-github-runner-207 kernel: [36676.577594] ? show_regs.part.0+0x23/0x29 Aug 22 15:35:02 juju-e4d256-prod-github-runner-207 kernel: [36676.578589] ? show_regs.cold+0x8/0xd Aug 22 15:35:02 juju-e4d256-prod-github-runner-207 kernel: [36676.579571] ? watchdog_timer_fn+0x1be/0x220 Aug 22 15:35:02 juju-e4d256-prod-github-runner-207 kernel: [36676.580583] ? lockup_detector_update_enable+0x60/0x60 Aug 22 15:35:02 juju-e4d256-prod-github-runner-207 kernel: [36676.581647] ? __hrtimer_run_queues+0x107/0x230 Aug 22 15:35:02 juju-e4d256-prod-github-runner-207 kernel: [36676.582673] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 15:35:02 juju-e4d256-prod-github-runner-207 kernel: [36676.583709] ? hrtimer_interrupt+0x101/0x220 Aug 22 15:35:02 juju-e4d256-prod-github-runner-207 kernel: [36676.584721] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 15:35:02 juju-e4d256-prod-github-runner-207 kernel: [36676.585789] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 15:35:02 juju-e4d256-prod-github-runner-207 kernel: [36676.586840] Aug 22 15:35:02 juju-e4d256-prod-github-runner-207 kernel: [36676.587693] Aug 22 15:35:02 juju-e4d256-prod-github-runner-207 kernel: [36676.588533] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 15:35:02 juju-e4d256-prod-github-runner-207 kernel: [36676.589570] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:35:02 juju-e4d256-prod-github-runner-207 kernel: [36676.590609] ? _raw_spin_lock+0x22/0x30 Aug 22 15:35:02 juju-e4d256-prod-github-runner-207 kernel: [36676.591570] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:35:02 juju-e4d256-prod-github-runner-207 kernel: [36676.592585] direct_page_fault+0x206/0x310 [kvm] Aug 22 15:35:02 juju-e4d256-prod-github-runner-207 kernel: [36676.593613] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 15:35:02 juju-e4d256-prod-github-runner-207 kernel: [36676.594622] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 15:35:02 juju-e4d256-prod-github-runner-207 kernel: [36676.595632] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 15:35:02 juju-e4d256-prod-github-runner-207 kernel: [36676.596617] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 15:35:02 juju-e4d256-prod-github-runner-207 kernel: [36676.597561] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 15:35:02 juju-e4d256-prod-github-runner-207 kernel: [36676.598538] handle_exit+0x98/0x230 [kvm_amd] Aug 22 15:35:02 juju-e4d256-prod-github-runner-207 kernel: [36676.599439] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 15:35:02 juju-e4d256-prod-github-runner-207 kernel: [36676.600351] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 15:35:02 juju-e4d256-prod-github-runner-207 kernel: [36676.601274] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 15:35:02 juju-e4d256-prod-github-runner-207 kernel: [36676.602181] vcpu_run+0x62/0x2c0 [kvm] Aug 22 15:35:02 juju-e4d256-prod-github-runner-207 kernel: [36676.603001] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 15:35:02 juju-e4d256-prod-github-runner-207 kernel: [36676.603811] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 15:35:02 juju-e4d256-prod-github-runner-207 kernel: [36676.604663] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 15:35:02 juju-e4d256-prod-github-runner-207 kernel: [36676.605464] ? __seccomp_filter+0x4a/0x4a0 Aug 22 15:35:02 juju-e4d256-prod-github-runner-207 kernel: [36676.606204] ? __fget_files+0x86/0xc0 Aug 22 15:35:02 juju-e4d256-prod-github-runner-207 kernel: [36676.606923] __x64_sys_ioctl+0x95/0xd0 Aug 22 15:35:02 juju-e4d256-prod-github-runner-207 kernel: [36676.607613] do_syscall_64+0x5c/0xc0 Aug 22 15:35:02 juju-e4d256-prod-github-runner-207 kernel: [36676.608281] ? do_futex+0x162/0x1f0 Aug 22 15:35:02 juju-e4d256-prod-github-runner-207 kernel: [36676.608926] ? __x64_sys_futex+0x78/0x1e0 Aug 22 15:35:02 juju-e4d256-prod-github-runner-207 kernel: [36676.609603] ? __secure_computing+0xa9/0x120 Aug 22 15:35:02 juju-e4d256-prod-github-runner-207 kernel: [36676.610289] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 15:35:02 juju-e4d256-prod-github-runner-207 kernel: [36676.611124] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:35:02 juju-e4d256-prod-github-runner-207 kernel: [36676.611847] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:35:02 juju-e4d256-prod-github-runner-207 kernel: [36676.612564] ? do_syscall_64+0x69/0xc0 Aug 22 15:35:02 juju-e4d256-prod-github-runner-207 kernel: [36676.613208] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:35:02 juju-e4d256-prod-github-runner-207 kernel: [36676.613910] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:35:02 juju-e4d256-prod-github-runner-207 kernel: [36676.614604] ? do_syscall_64+0x69/0xc0 Aug 22 15:35:02 juju-e4d256-prod-github-runner-207 kernel: [36676.615235] ? do_syscall_64+0x69/0xc0 Aug 22 15:35:02 juju-e4d256-prod-github-runner-207 kernel: [36676.616043] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 15:35:02 juju-e4d256-prod-github-runner-207 kernel: [36676.616775] RIP: 0033:0x7faa5d0edaff Aug 22 15:35:02 juju-e4d256-prod-github-runner-207 kernel: [36676.617437] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 15:35:02 juju-e4d256-prod-github-runner-207 kernel: [36676.619511] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 15:35:02 juju-e4d256-prod-github-runner-207 kernel: [36676.620455] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 15:35:02 juju-e4d256-prod-github-runner-207 kernel: [36676.621361] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 15:35:02 juju-e4d256-prod-github-runner-207 kernel: [36676.622260] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 15:35:02 juju-e4d256-prod-github-runner-207 kernel: [36676.623169] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 15:35:02 juju-e4d256-prod-github-runner-207 kernel: [36676.624073] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 15:35:02 juju-e4d256-prod-github-runner-207 kernel: [36676.624973] Aug 22 15:35:30 juju-e4d256-prod-github-runner-207 kernel: [36704.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 34075s! [qemu-system-x86:6715] Aug 22 15:35:30 juju-e4d256-prod-github-runner-207 kernel: [36704.543767] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 15:35:30 juju-e4d256-prod-github-runner-207 kernel: [36704.544032] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 15:35:30 juju-e4d256-prod-github-runner-207 kernel: [36704.556179] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 15:35:30 juju-e4d256-prod-github-runner-207 kernel: [36704.557442] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 15:35:30 juju-e4d256-prod-github-runner-207 kernel: [36704.558671] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:35:30 juju-e4d256-prod-github-runner-207 kernel: [36704.559729] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 15:35:30 juju-e4d256-prod-github-runner-207 kernel: [36704.562275] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 15:35:30 juju-e4d256-prod-github-runner-207 kernel: [36704.563328] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 15:35:30 juju-e4d256-prod-github-runner-207 kernel: [36704.564503] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 15:35:30 juju-e4d256-prod-github-runner-207 kernel: [36704.565670] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 15:35:30 juju-e4d256-prod-github-runner-207 kernel: [36704.566839] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 15:35:30 juju-e4d256-prod-github-runner-207 kernel: [36704.568006] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 15:35:30 juju-e4d256-prod-github-runner-207 kernel: [36704.569175] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 15:35:30 juju-e4d256-prod-github-runner-207 kernel: [36704.570419] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 15:35:30 juju-e4d256-prod-github-runner-207 kernel: [36704.571517] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 15:35:30 juju-e4d256-prod-github-runner-207 kernel: [36704.572713] Call Trace: Aug 22 15:35:30 juju-e4d256-prod-github-runner-207 kernel: [36704.573626] Aug 22 15:35:30 juju-e4d256-prod-github-runner-207 kernel: [36704.574700] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:35:30 juju-e4d256-prod-github-runner-207 kernel: [36704.575775] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:35:30 juju-e4d256-prod-github-runner-207 kernel: [36704.576798] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:35:30 juju-e4d256-prod-github-runner-207 kernel: [36704.577884] ? show_regs.part.0+0x23/0x29 Aug 22 15:35:30 juju-e4d256-prod-github-runner-207 kernel: [36704.578895] ? show_regs.cold+0x8/0xd Aug 22 15:35:30 juju-e4d256-prod-github-runner-207 kernel: [36704.579874] ? watchdog_timer_fn+0x1be/0x220 Aug 22 15:35:30 juju-e4d256-prod-github-runner-207 kernel: [36704.580897] ? lockup_detector_update_enable+0x60/0x60 Aug 22 15:35:30 juju-e4d256-prod-github-runner-207 kernel: [36704.581962] ? __hrtimer_run_queues+0x107/0x230 Aug 22 15:35:30 juju-e4d256-prod-github-runner-207 kernel: [36704.583072] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 15:35:30 juju-e4d256-prod-github-runner-207 kernel: [36704.584103] ? hrtimer_interrupt+0x101/0x220 Aug 22 15:35:30 juju-e4d256-prod-github-runner-207 kernel: [36704.585118] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 15:35:30 juju-e4d256-prod-github-runner-207 kernel: [36704.586185] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 15:35:30 juju-e4d256-prod-github-runner-207 kernel: [36704.587260] Aug 22 15:35:30 juju-e4d256-prod-github-runner-207 kernel: [36704.588145] Aug 22 15:35:30 juju-e4d256-prod-github-runner-207 kernel: [36704.588999] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 15:35:30 juju-e4d256-prod-github-runner-207 kernel: [36704.590033] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:35:30 juju-e4d256-prod-github-runner-207 kernel: [36704.591095] ? _raw_spin_lock+0x22/0x30 Aug 22 15:35:30 juju-e4d256-prod-github-runner-207 kernel: [36704.592068] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:35:30 juju-e4d256-prod-github-runner-207 kernel: [36704.593108] direct_page_fault+0x206/0x310 [kvm] Aug 22 15:35:30 juju-e4d256-prod-github-runner-207 kernel: [36704.594135] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 15:35:30 juju-e4d256-prod-github-runner-207 kernel: [36704.595169] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 15:35:30 juju-e4d256-prod-github-runner-207 kernel: [36704.596175] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 15:35:30 juju-e4d256-prod-github-runner-207 kernel: [36704.597187] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 15:35:30 juju-e4d256-prod-github-runner-207 kernel: [36704.598148] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 15:35:30 juju-e4d256-prod-github-runner-207 kernel: [36704.599149] handle_exit+0x98/0x230 [kvm_amd] Aug 22 15:35:30 juju-e4d256-prod-github-runner-207 kernel: [36704.600046] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 15:35:30 juju-e4d256-prod-github-runner-207 kernel: [36704.600967] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 15:35:30 juju-e4d256-prod-github-runner-207 kernel: [36704.601906] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 15:35:30 juju-e4d256-prod-github-runner-207 kernel: [36704.602835] vcpu_run+0x62/0x2c0 [kvm] Aug 22 15:35:30 juju-e4d256-prod-github-runner-207 kernel: [36704.603659] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 15:35:30 juju-e4d256-prod-github-runner-207 kernel: [36704.604468] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 15:35:30 juju-e4d256-prod-github-runner-207 kernel: [36704.605325] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 15:35:30 juju-e4d256-prod-github-runner-207 kernel: [36704.606128] ? __seccomp_filter+0x4a/0x4a0 Aug 22 15:35:30 juju-e4d256-prod-github-runner-207 kernel: [36704.606882] ? __fget_files+0x86/0xc0 Aug 22 15:35:30 juju-e4d256-prod-github-runner-207 kernel: [36704.607596] __x64_sys_ioctl+0x95/0xd0 Aug 22 15:35:30 juju-e4d256-prod-github-runner-207 kernel: [36704.608299] do_syscall_64+0x5c/0xc0 Aug 22 15:35:30 juju-e4d256-prod-github-runner-207 kernel: [36704.608968] ? do_futex+0x162/0x1f0 Aug 22 15:35:30 juju-e4d256-prod-github-runner-207 kernel: [36704.609618] ? __x64_sys_futex+0x78/0x1e0 Aug 22 15:35:30 juju-e4d256-prod-github-runner-207 kernel: [36704.610294] ? __secure_computing+0xa9/0x120 Aug 22 15:35:30 juju-e4d256-prod-github-runner-207 kernel: [36704.610999] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 15:35:30 juju-e4d256-prod-github-runner-207 kernel: [36704.611764] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:35:30 juju-e4d256-prod-github-runner-207 kernel: [36704.612494] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:35:30 juju-e4d256-prod-github-runner-207 kernel: [36704.613225] ? do_syscall_64+0x69/0xc0 Aug 22 15:35:30 juju-e4d256-prod-github-runner-207 kernel: [36704.613874] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:35:30 juju-e4d256-prod-github-runner-207 kernel: [36704.614596] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:35:30 juju-e4d256-prod-github-runner-207 kernel: [36704.615295] ? do_syscall_64+0x69/0xc0 Aug 22 15:35:30 juju-e4d256-prod-github-runner-207 kernel: [36704.615925] ? do_syscall_64+0x69/0xc0 Aug 22 15:35:30 juju-e4d256-prod-github-runner-207 kernel: [36704.616550] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 15:35:30 juju-e4d256-prod-github-runner-207 kernel: [36704.617267] RIP: 0033:0x7faa5d0edaff Aug 22 15:35:30 juju-e4d256-prod-github-runner-207 kernel: [36704.617911] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 15:35:30 juju-e4d256-prod-github-runner-207 kernel: [36704.619918] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 15:35:30 juju-e4d256-prod-github-runner-207 kernel: [36704.620839] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 15:35:30 juju-e4d256-prod-github-runner-207 kernel: [36704.621746] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 15:35:30 juju-e4d256-prod-github-runner-207 kernel: [36704.622689] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 15:35:30 juju-e4d256-prod-github-runner-207 kernel: [36704.623600] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 15:35:30 juju-e4d256-prod-github-runner-207 kernel: [36704.624493] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 15:35:30 juju-e4d256-prod-github-runner-207 kernel: [36704.625390] Aug 22 15:35:45 juju-e4d256-prod-github-runner-207 kernel: [36719.636705] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 15:35:45 juju-e4d256-prod-github-runner-207 kernel: [36719.637676] rcu: 1-....: (9121885 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=4407570 Aug 22 15:35:45 juju-e4d256-prod-github-runner-207 kernel: [36719.638873] (t=9150609 jiffies g=23269 q=38424) Aug 22 15:35:45 juju-e4d256-prod-github-runner-207 kernel: [36719.639667] NMI backtrace for cpu 1 Aug 22 15:35:45 juju-e4d256-prod-github-runner-207 kernel: [36719.640376] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 15:35:45 juju-e4d256-prod-github-runner-207 kernel: [36719.641518] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 15:35:45 juju-e4d256-prod-github-runner-207 kernel: [36719.642592] Call Trace: Aug 22 15:35:45 juju-e4d256-prod-github-runner-207 kernel: [36719.643267] Aug 22 15:35:45 juju-e4d256-prod-github-runner-207 kernel: [36719.643916] show_stack+0x52/0x5c Aug 22 15:35:45 juju-e4d256-prod-github-runner-207 kernel: [36719.644639] dump_stack_lvl+0x4a/0x63 Aug 22 15:35:45 juju-e4d256-prod-github-runner-207 kernel: [36719.645385] dump_stack+0x10/0x16 Aug 22 15:35:45 juju-e4d256-prod-github-runner-207 kernel: [36719.646101] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 15:35:45 juju-e4d256-prod-github-runner-207 kernel: [36719.646903] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 15:35:45 juju-e4d256-prod-github-runner-207 kernel: [36719.647682] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 15:35:45 juju-e4d256-prod-github-runner-207 kernel: [36719.648501] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 15:35:45 juju-e4d256-prod-github-runner-207 kernel: [36719.649319] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 15:35:45 juju-e4d256-prod-github-runner-207 kernel: [36719.650126] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 15:35:45 juju-e4d256-prod-github-runner-207 kernel: [36719.650912] print_cpu_stall.cold+0x2f/0xe2 Aug 22 15:35:45 juju-e4d256-prod-github-runner-207 kernel: [36719.651678] ? timekeeping_update+0xf7/0x150 Aug 22 15:35:45 juju-e4d256-prod-github-runner-207 kernel: [36719.652447] check_cpu_stall+0x109/0x270 Aug 22 15:35:45 juju-e4d256-prod-github-runner-207 kernel: [36719.653193] rcu_sched_clock_irq+0x9a/0x250 Aug 22 15:35:45 juju-e4d256-prod-github-runner-207 kernel: [36719.653959] update_process_times+0x94/0xd0 Aug 22 15:35:45 juju-e4d256-prod-github-runner-207 kernel: [36719.654733] tick_sched_handle+0x29/0x70 Aug 22 15:35:45 juju-e4d256-prod-github-runner-207 kernel: [36719.655478] tick_sched_timer+0x8c/0xc0 Aug 22 15:35:45 juju-e4d256-prod-github-runner-207 kernel: [36719.656213] ? tick_nohz_handler+0xb0/0xb0 Aug 22 15:35:45 juju-e4d256-prod-github-runner-207 kernel: [36719.656967] __hrtimer_run_queues+0x107/0x230 Aug 22 15:35:45 juju-e4d256-prod-github-runner-207 kernel: [36719.657739] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 15:35:45 juju-e4d256-prod-github-runner-207 kernel: [36719.658522] hrtimer_interrupt+0x101/0x220 Aug 22 15:35:45 juju-e4d256-prod-github-runner-207 kernel: [36719.659282] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 15:35:45 juju-e4d256-prod-github-runner-207 kernel: [36719.660102] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 15:35:45 juju-e4d256-prod-github-runner-207 kernel: [36719.660903] Aug 22 15:35:45 juju-e4d256-prod-github-runner-207 kernel: [36719.661538] Aug 22 15:35:45 juju-e4d256-prod-github-runner-207 kernel: [36719.662166] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 15:35:45 juju-e4d256-prod-github-runner-207 kernel: [36719.663005] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:35:45 juju-e4d256-prod-github-runner-207 kernel: [36719.663882] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 15:35:45 juju-e4d256-prod-github-runner-207 kernel: [36719.666102] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 15:35:45 juju-e4d256-prod-github-runner-207 kernel: [36719.666985] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 15:35:45 juju-e4d256-prod-github-runner-207 kernel: [36719.667978] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 15:35:45 juju-e4d256-prod-github-runner-207 kernel: [36719.668959] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 15:35:45 juju-e4d256-prod-github-runner-207 kernel: [36719.669924] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 15:35:45 juju-e4d256-prod-github-runner-207 kernel: [36719.670901] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 15:35:45 juju-e4d256-prod-github-runner-207 kernel: [36719.671859] ? _raw_spin_lock+0x22/0x30 Aug 22 15:35:45 juju-e4d256-prod-github-runner-207 kernel: [36719.672617] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:35:45 juju-e4d256-prod-github-runner-207 kernel: [36719.673465] direct_page_fault+0x206/0x310 [kvm] Aug 22 15:35:45 juju-e4d256-prod-github-runner-207 kernel: [36719.674318] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 15:35:45 juju-e4d256-prod-github-runner-207 kernel: [36719.675148] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 15:35:45 juju-e4d256-prod-github-runner-207 kernel: [36719.675975] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 15:35:45 juju-e4d256-prod-github-runner-207 kernel: [36719.676777] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 15:35:45 juju-e4d256-prod-github-runner-207 kernel: [36719.677568] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 15:35:45 juju-e4d256-prod-github-runner-207 kernel: [36719.678401] handle_exit+0x98/0x230 [kvm_amd] Aug 22 15:35:45 juju-e4d256-prod-github-runner-207 kernel: [36719.679161] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 15:35:45 juju-e4d256-prod-github-runner-207 kernel: [36719.679945] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 15:35:45 juju-e4d256-prod-github-runner-207 kernel: [36719.680742] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 15:35:45 juju-e4d256-prod-github-runner-207 kernel: [36719.681526] vcpu_run+0x62/0x2c0 [kvm] Aug 22 15:35:45 juju-e4d256-prod-github-runner-207 kernel: [36719.682249] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 15:35:45 juju-e4d256-prod-github-runner-207 kernel: [36719.682984] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 15:35:45 juju-e4d256-prod-github-runner-207 kernel: [36719.683786] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 15:35:45 juju-e4d256-prod-github-runner-207 kernel: [36719.684553] ? __seccomp_filter+0x4a/0x4a0 Aug 22 15:35:45 juju-e4d256-prod-github-runner-207 kernel: [36719.685273] ? __fget_files+0x86/0xc0 Aug 22 15:35:45 juju-e4d256-prod-github-runner-207 kernel: [36719.685966] __x64_sys_ioctl+0x95/0xd0 Aug 22 15:35:45 juju-e4d256-prod-github-runner-207 kernel: [36719.686668] do_syscall_64+0x5c/0xc0 Aug 22 15:35:45 juju-e4d256-prod-github-runner-207 kernel: [36719.687348] ? do_futex+0x162/0x1f0 Aug 22 15:35:45 juju-e4d256-prod-github-runner-207 kernel: [36719.688024] ? __x64_sys_futex+0x78/0x1e0 Aug 22 15:35:45 juju-e4d256-prod-github-runner-207 kernel: [36719.688723] ? __secure_computing+0xa9/0x120 Aug 22 15:35:45 juju-e4d256-prod-github-runner-207 kernel: [36719.689440] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 15:35:45 juju-e4d256-prod-github-runner-207 kernel: [36719.690242] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:35:45 juju-e4d256-prod-github-runner-207 kernel: [36719.690999] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:35:45 juju-e4d256-prod-github-runner-207 kernel: [36719.691758] ? do_syscall_64+0x69/0xc0 Aug 22 15:35:45 juju-e4d256-prod-github-runner-207 kernel: [36719.692448] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:35:45 juju-e4d256-prod-github-runner-207 kernel: [36719.693205] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:35:45 juju-e4d256-prod-github-runner-207 kernel: [36719.693963] ? do_syscall_64+0x69/0xc0 Aug 22 15:35:45 juju-e4d256-prod-github-runner-207 kernel: [36719.694675] ? do_syscall_64+0x69/0xc0 Aug 22 15:35:45 juju-e4d256-prod-github-runner-207 kernel: [36719.695361] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 15:35:45 juju-e4d256-prod-github-runner-207 kernel: [36719.696135] RIP: 0033:0x7faa5d0edaff Aug 22 15:35:45 juju-e4d256-prod-github-runner-207 kernel: [36719.696818] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 15:35:45 juju-e4d256-prod-github-runner-207 kernel: [36719.698929] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 15:35:45 juju-e4d256-prod-github-runner-207 kernel: [36719.699893] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 15:35:45 juju-e4d256-prod-github-runner-207 kernel: [36719.700841] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 15:35:45 juju-e4d256-prod-github-runner-207 kernel: [36719.701787] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 15:35:45 juju-e4d256-prod-github-runner-207 kernel: [36719.702742] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 15:35:45 juju-e4d256-prod-github-runner-207 kernel: [36719.703668] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 15:35:45 juju-e4d256-prod-github-runner-207 kernel: [36719.704588] Aug 22 15:36:10 juju-e4d256-prod-github-runner-207 kernel: [36744.541983] watchdog: BUG: soft lockup - CPU#1 stuck for 34113s! [qemu-system-x86:6715] Aug 22 15:36:10 juju-e4d256-prod-github-runner-207 kernel: [36744.543606] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 15:36:10 juju-e4d256-prod-github-runner-207 kernel: [36744.543687] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 15:36:10 juju-e4d256-prod-github-runner-207 kernel: [36744.560132] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 15:36:10 juju-e4d256-prod-github-runner-207 kernel: [36744.561411] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 15:36:10 juju-e4d256-prod-github-runner-207 kernel: [36744.562651] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:36:10 juju-e4d256-prod-github-runner-207 kernel: [36744.563708] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 15:36:10 juju-e4d256-prod-github-runner-207 kernel: [36744.566288] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 15:36:10 juju-e4d256-prod-github-runner-207 kernel: [36744.567344] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 15:36:10 juju-e4d256-prod-github-runner-207 kernel: [36744.568503] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 15:36:10 juju-e4d256-prod-github-runner-207 kernel: [36744.569667] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 15:36:10 juju-e4d256-prod-github-runner-207 kernel: [36744.570858] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 15:36:10 juju-e4d256-prod-github-runner-207 kernel: [36744.572026] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 15:36:10 juju-e4d256-prod-github-runner-207 kernel: [36744.573213] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 15:36:10 juju-e4d256-prod-github-runner-207 kernel: [36744.574478] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 15:36:10 juju-e4d256-prod-github-runner-207 kernel: [36744.575601] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 15:36:10 juju-e4d256-prod-github-runner-207 kernel: [36744.576814] Call Trace: Aug 22 15:36:10 juju-e4d256-prod-github-runner-207 kernel: [36744.577732] Aug 22 15:36:10 juju-e4d256-prod-github-runner-207 kernel: [36744.578632] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:36:10 juju-e4d256-prod-github-runner-207 kernel: [36744.579667] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:36:10 juju-e4d256-prod-github-runner-207 kernel: [36744.580688] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:36:10 juju-e4d256-prod-github-runner-207 kernel: [36744.581767] ? show_regs.part.0+0x23/0x29 Aug 22 15:36:10 juju-e4d256-prod-github-runner-207 kernel: [36744.582788] ? show_regs.cold+0x8/0xd Aug 22 15:36:10 juju-e4d256-prod-github-runner-207 kernel: [36744.583773] ? watchdog_timer_fn+0x1be/0x220 Aug 22 15:36:10 juju-e4d256-prod-github-runner-207 kernel: [36744.584793] ? lockup_detector_update_enable+0x60/0x60 Aug 22 15:36:10 juju-e4d256-prod-github-runner-207 kernel: [36744.585911] ? __hrtimer_run_queues+0x107/0x230 Aug 22 15:36:10 juju-e4d256-prod-github-runner-207 kernel: [36744.586945] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 15:36:10 juju-e4d256-prod-github-runner-207 kernel: [36744.587984] ? hrtimer_interrupt+0x101/0x220 Aug 22 15:36:10 juju-e4d256-prod-github-runner-207 kernel: [36744.589148] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 15:36:10 juju-e4d256-prod-github-runner-207 kernel: [36744.590296] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 15:36:10 juju-e4d256-prod-github-runner-207 kernel: [36744.591360] Aug 22 15:36:10 juju-e4d256-prod-github-runner-207 kernel: [36744.592220] Aug 22 15:36:10 juju-e4d256-prod-github-runner-207 kernel: [36744.593061] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 15:36:10 juju-e4d256-prod-github-runner-207 kernel: [36744.594119] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:36:10 juju-e4d256-prod-github-runner-207 kernel: [36744.595335] ? _raw_spin_lock+0x22/0x30 Aug 22 15:36:10 juju-e4d256-prod-github-runner-207 kernel: [36744.596283] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:36:10 juju-e4d256-prod-github-runner-207 kernel: [36744.597667] direct_page_fault+0x206/0x310 [kvm] Aug 22 15:36:10 juju-e4d256-prod-github-runner-207 kernel: [36744.599138] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 15:36:10 juju-e4d256-prod-github-runner-207 kernel: [36744.600159] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 15:36:10 juju-e4d256-prod-github-runner-207 kernel: [36744.601162] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 15:36:10 juju-e4d256-prod-github-runner-207 kernel: [36744.602163] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 15:36:10 juju-e4d256-prod-github-runner-207 kernel: [36744.603116] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 15:36:10 juju-e4d256-prod-github-runner-207 kernel: [36744.604105] handle_exit+0x98/0x230 [kvm_amd] Aug 22 15:36:10 juju-e4d256-prod-github-runner-207 kernel: [36744.605007] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 15:36:10 juju-e4d256-prod-github-runner-207 kernel: [36744.605957] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 15:36:10 juju-e4d256-prod-github-runner-207 kernel: [36744.606882] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 15:36:10 juju-e4d256-prod-github-runner-207 kernel: [36744.607784] vcpu_run+0x62/0x2c0 [kvm] Aug 22 15:36:10 juju-e4d256-prod-github-runner-207 kernel: [36744.608605] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 15:36:10 juju-e4d256-prod-github-runner-207 kernel: [36744.609425] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 15:36:10 juju-e4d256-prod-github-runner-207 kernel: [36744.610294] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 15:36:10 juju-e4d256-prod-github-runner-207 kernel: [36744.611121] ? __seccomp_filter+0x4a/0x4a0 Aug 22 15:36:10 juju-e4d256-prod-github-runner-207 kernel: [36744.611866] ? __fget_files+0x86/0xc0 Aug 22 15:36:10 juju-e4d256-prod-github-runner-207 kernel: [36744.612571] __x64_sys_ioctl+0x95/0xd0 Aug 22 15:36:10 juju-e4d256-prod-github-runner-207 kernel: [36744.613279] do_syscall_64+0x5c/0xc0 Aug 22 15:36:10 juju-e4d256-prod-github-runner-207 kernel: [36744.613973] ? do_futex+0x162/0x1f0 Aug 22 15:36:10 juju-e4d256-prod-github-runner-207 kernel: [36744.614623] ? __x64_sys_futex+0x78/0x1e0 Aug 22 15:36:10 juju-e4d256-prod-github-runner-207 kernel: [36744.615303] ? __secure_computing+0xa9/0x120 Aug 22 15:36:10 juju-e4d256-prod-github-runner-207 kernel: [36744.615996] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 15:36:10 juju-e4d256-prod-github-runner-207 kernel: [36744.616758] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:36:10 juju-e4d256-prod-github-runner-207 kernel: [36744.617519] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:36:10 juju-e4d256-prod-github-runner-207 kernel: [36744.618265] ? do_syscall_64+0x69/0xc0 Aug 22 15:36:10 juju-e4d256-prod-github-runner-207 kernel: [36744.618912] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:36:10 juju-e4d256-prod-github-runner-207 kernel: [36744.619629] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:36:10 juju-e4d256-prod-github-runner-207 kernel: [36744.620328] ? do_syscall_64+0x69/0xc0 Aug 22 15:36:10 juju-e4d256-prod-github-runner-207 kernel: [36744.620954] ? do_syscall_64+0x69/0xc0 Aug 22 15:36:10 juju-e4d256-prod-github-runner-207 kernel: [36744.621582] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 15:36:10 juju-e4d256-prod-github-runner-207 kernel: [36744.622322] RIP: 0033:0x7faa5d0edaff Aug 22 15:36:10 juju-e4d256-prod-github-runner-207 kernel: [36744.622949] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 15:36:10 juju-e4d256-prod-github-runner-207 kernel: [36744.624957] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 15:36:10 juju-e4d256-prod-github-runner-207 kernel: [36744.625879] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 15:36:10 juju-e4d256-prod-github-runner-207 kernel: [36744.626804] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 15:36:10 juju-e4d256-prod-github-runner-207 kernel: [36744.627696] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 15:36:10 juju-e4d256-prod-github-runner-207 kernel: [36744.628587] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 15:36:10 juju-e4d256-prod-github-runner-207 kernel: [36744.629484] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 15:36:10 juju-e4d256-prod-github-runner-207 kernel: [36744.630413] Aug 22 15:36:38 juju-e4d256-prod-github-runner-207 kernel: [36772.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 34139s! [qemu-system-x86:6715] Aug 22 15:36:38 juju-e4d256-prod-github-runner-207 kernel: [36772.543747] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 15:36:38 juju-e4d256-prod-github-runner-207 kernel: [36772.544000] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 15:36:38 juju-e4d256-prod-github-runner-207 kernel: [36772.556089] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 15:36:38 juju-e4d256-prod-github-runner-207 kernel: [36772.557356] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 15:36:38 juju-e4d256-prod-github-runner-207 kernel: [36772.558590] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:36:38 juju-e4d256-prod-github-runner-207 kernel: [36772.559644] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 15:36:38 juju-e4d256-prod-github-runner-207 kernel: [36772.562227] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 15:36:38 juju-e4d256-prod-github-runner-207 kernel: [36772.563279] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 15:36:38 juju-e4d256-prod-github-runner-207 kernel: [36772.564440] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 15:36:38 juju-e4d256-prod-github-runner-207 kernel: [36772.565624] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 15:36:38 juju-e4d256-prod-github-runner-207 kernel: [36772.566781] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 15:36:38 juju-e4d256-prod-github-runner-207 kernel: [36772.567940] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 15:36:38 juju-e4d256-prod-github-runner-207 kernel: [36772.569107] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 15:36:38 juju-e4d256-prod-github-runner-207 kernel: [36772.570381] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 15:36:38 juju-e4d256-prod-github-runner-207 kernel: [36772.571478] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 15:36:38 juju-e4d256-prod-github-runner-207 kernel: [36772.572667] Call Trace: Aug 22 15:36:38 juju-e4d256-prod-github-runner-207 kernel: [36772.573629] Aug 22 15:36:38 juju-e4d256-prod-github-runner-207 kernel: [36772.574567] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:36:38 juju-e4d256-prod-github-runner-207 kernel: [36772.575610] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:36:38 juju-e4d256-prod-github-runner-207 kernel: [36772.576635] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:36:38 juju-e4d256-prod-github-runner-207 kernel: [36772.577750] ? show_regs.part.0+0x23/0x29 Aug 22 15:36:38 juju-e4d256-prod-github-runner-207 kernel: [36772.578755] ? show_regs.cold+0x8/0xd Aug 22 15:36:38 juju-e4d256-prod-github-runner-207 kernel: [36772.579739] ? watchdog_timer_fn+0x1be/0x220 Aug 22 15:36:38 juju-e4d256-prod-github-runner-207 kernel: [36772.580751] ? lockup_detector_update_enable+0x60/0x60 Aug 22 15:36:38 juju-e4d256-prod-github-runner-207 kernel: [36772.581839] ? __hrtimer_run_queues+0x107/0x230 Aug 22 15:36:38 juju-e4d256-prod-github-runner-207 kernel: [36772.582868] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 15:36:38 juju-e4d256-prod-github-runner-207 kernel: [36772.583891] ? hrtimer_interrupt+0x101/0x220 Aug 22 15:36:38 juju-e4d256-prod-github-runner-207 kernel: [36772.584920] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 15:36:38 juju-e4d256-prod-github-runner-207 kernel: [36772.586013] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 15:36:38 juju-e4d256-prod-github-runner-207 kernel: [36772.587081] Aug 22 15:36:38 juju-e4d256-prod-github-runner-207 kernel: [36772.588065] Aug 22 15:36:38 juju-e4d256-prod-github-runner-207 kernel: [36772.588901] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 15:36:38 juju-e4d256-prod-github-runner-207 kernel: [36772.589954] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:36:38 juju-e4d256-prod-github-runner-207 kernel: [36772.590992] ? _raw_spin_lock+0x22/0x30 Aug 22 15:36:38 juju-e4d256-prod-github-runner-207 kernel: [36772.591941] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:36:38 juju-e4d256-prod-github-runner-207 kernel: [36772.592956] direct_page_fault+0x206/0x310 [kvm] Aug 22 15:36:38 juju-e4d256-prod-github-runner-207 kernel: [36772.593993] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 15:36:38 juju-e4d256-prod-github-runner-207 kernel: [36772.594998] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 15:36:38 juju-e4d256-prod-github-runner-207 kernel: [36772.596072] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 15:36:38 juju-e4d256-prod-github-runner-207 kernel: [36772.597181] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 15:36:38 juju-e4d256-prod-github-runner-207 kernel: [36772.598159] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 15:36:38 juju-e4d256-prod-github-runner-207 kernel: [36772.599137] handle_exit+0x98/0x230 [kvm_amd] Aug 22 15:36:38 juju-e4d256-prod-github-runner-207 kernel: [36772.600045] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 15:36:38 juju-e4d256-prod-github-runner-207 kernel: [36772.600962] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 15:36:38 juju-e4d256-prod-github-runner-207 kernel: [36772.601908] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 15:36:38 juju-e4d256-prod-github-runner-207 kernel: [36772.602812] vcpu_run+0x62/0x2c0 [kvm] Aug 22 15:36:38 juju-e4d256-prod-github-runner-207 kernel: [36772.603622] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 15:36:38 juju-e4d256-prod-github-runner-207 kernel: [36772.604433] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 15:36:38 juju-e4d256-prod-github-runner-207 kernel: [36772.605305] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 15:36:38 juju-e4d256-prod-github-runner-207 kernel: [36772.606124] ? __seccomp_filter+0x4a/0x4a0 Aug 22 15:36:38 juju-e4d256-prod-github-runner-207 kernel: [36772.606872] ? __fget_files+0x86/0xc0 Aug 22 15:36:38 juju-e4d256-prod-github-runner-207 kernel: [36772.607579] __x64_sys_ioctl+0x95/0xd0 Aug 22 15:36:38 juju-e4d256-prod-github-runner-207 kernel: [36772.608271] do_syscall_64+0x5c/0xc0 Aug 22 15:36:38 juju-e4d256-prod-github-runner-207 kernel: [36772.608936] ? do_futex+0x162/0x1f0 Aug 22 15:36:38 juju-e4d256-prod-github-runner-207 kernel: [36772.609647] ? __x64_sys_futex+0x78/0x1e0 Aug 22 15:36:38 juju-e4d256-prod-github-runner-207 kernel: [36772.610329] ? __secure_computing+0xa9/0x120 Aug 22 15:36:38 juju-e4d256-prod-github-runner-207 kernel: [36772.611030] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 15:36:38 juju-e4d256-prod-github-runner-207 kernel: [36772.611949] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:36:38 juju-e4d256-prod-github-runner-207 kernel: [36772.612675] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:36:38 juju-e4d256-prod-github-runner-207 kernel: [36772.613400] ? do_syscall_64+0x69/0xc0 Aug 22 15:36:38 juju-e4d256-prod-github-runner-207 kernel: [36772.614063] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:36:38 juju-e4d256-prod-github-runner-207 kernel: [36772.614765] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:36:38 juju-e4d256-prod-github-runner-207 kernel: [36772.615458] ? do_syscall_64+0x69/0xc0 Aug 22 15:36:38 juju-e4d256-prod-github-runner-207 kernel: [36772.616084] ? do_syscall_64+0x69/0xc0 Aug 22 15:36:38 juju-e4d256-prod-github-runner-207 kernel: [36772.616706] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 15:36:38 juju-e4d256-prod-github-runner-207 kernel: [36772.617411] RIP: 0033:0x7faa5d0edaff Aug 22 15:36:38 juju-e4d256-prod-github-runner-207 kernel: [36772.618093] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 15:36:38 juju-e4d256-prod-github-runner-207 kernel: [36772.620124] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 15:36:38 juju-e4d256-prod-github-runner-207 kernel: [36772.621035] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 15:36:38 juju-e4d256-prod-github-runner-207 kernel: [36772.621939] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 15:36:38 juju-e4d256-prod-github-runner-207 kernel: [36772.622828] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 15:36:38 juju-e4d256-prod-github-runner-207 kernel: [36772.623767] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 15:36:38 juju-e4d256-prod-github-runner-207 kernel: [36772.624660] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 15:36:38 juju-e4d256-prod-github-runner-207 kernel: [36772.625557] Aug 22 15:37:06 juju-e4d256-prod-github-runner-207 kernel: [36800.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 34165s! [qemu-system-x86:6715] Aug 22 15:37:06 juju-e4d256-prod-github-runner-207 kernel: [36800.543099] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 15:37:06 juju-e4d256-prod-github-runner-207 kernel: [36800.543168] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 15:37:06 juju-e4d256-prod-github-runner-207 kernel: [36800.555241] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 15:37:06 juju-e4d256-prod-github-runner-207 kernel: [36800.556500] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 15:37:06 juju-e4d256-prod-github-runner-207 kernel: [36800.557740] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:37:06 juju-e4d256-prod-github-runner-207 kernel: [36800.558799] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 15:37:06 juju-e4d256-prod-github-runner-207 kernel: [36800.561354] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 15:37:06 juju-e4d256-prod-github-runner-207 kernel: [36800.562393] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 15:37:06 juju-e4d256-prod-github-runner-207 kernel: [36800.563587] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 15:37:06 juju-e4d256-prod-github-runner-207 kernel: [36800.564740] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 15:37:06 juju-e4d256-prod-github-runner-207 kernel: [36800.566025] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 15:37:06 juju-e4d256-prod-github-runner-207 kernel: [36800.567182] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 15:37:06 juju-e4d256-prod-github-runner-207 kernel: [36800.568349] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 15:37:06 juju-e4d256-prod-github-runner-207 kernel: [36800.569596] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 15:37:06 juju-e4d256-prod-github-runner-207 kernel: [36800.570697] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 15:37:06 juju-e4d256-prod-github-runner-207 kernel: [36800.571886] Call Trace: Aug 22 15:37:06 juju-e4d256-prod-github-runner-207 kernel: [36800.572800] Aug 22 15:37:06 juju-e4d256-prod-github-runner-207 kernel: [36800.573733] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:37:06 juju-e4d256-prod-github-runner-207 kernel: [36800.574770] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:37:06 juju-e4d256-prod-github-runner-207 kernel: [36800.575794] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:37:06 juju-e4d256-prod-github-runner-207 kernel: [36800.576871] ? show_regs.part.0+0x23/0x29 Aug 22 15:37:06 juju-e4d256-prod-github-runner-207 kernel: [36800.577882] ? show_regs.cold+0x8/0xd Aug 22 15:37:06 juju-e4d256-prod-github-runner-207 kernel: [36800.578853] ? watchdog_timer_fn+0x1be/0x220 Aug 22 15:37:06 juju-e4d256-prod-github-runner-207 kernel: [36800.579859] ? lockup_detector_update_enable+0x60/0x60 Aug 22 15:37:06 juju-e4d256-prod-github-runner-207 kernel: [36800.580920] ? __hrtimer_run_queues+0x107/0x230 Aug 22 15:37:06 juju-e4d256-prod-github-runner-207 kernel: [36800.581958] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 15:37:06 juju-e4d256-prod-github-runner-207 kernel: [36800.582980] ? hrtimer_interrupt+0x101/0x220 Aug 22 15:37:06 juju-e4d256-prod-github-runner-207 kernel: [36800.583993] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 15:37:06 juju-e4d256-prod-github-runner-207 kernel: [36800.585059] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 15:37:06 juju-e4d256-prod-github-runner-207 kernel: [36800.586115] Aug 22 15:37:06 juju-e4d256-prod-github-runner-207 kernel: [36800.586966] Aug 22 15:37:06 juju-e4d256-prod-github-runner-207 kernel: [36800.587801] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 15:37:06 juju-e4d256-prod-github-runner-207 kernel: [36800.588838] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:37:06 juju-e4d256-prod-github-runner-207 kernel: [36800.589886] ? _raw_spin_lock+0x22/0x30 Aug 22 15:37:06 juju-e4d256-prod-github-runner-207 kernel: [36800.590833] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:37:06 juju-e4d256-prod-github-runner-207 kernel: [36800.591845] direct_page_fault+0x206/0x310 [kvm] Aug 22 15:37:06 juju-e4d256-prod-github-runner-207 kernel: [36800.592871] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 15:37:06 juju-e4d256-prod-github-runner-207 kernel: [36800.593899] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 15:37:06 juju-e4d256-prod-github-runner-207 kernel: [36800.594898] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 15:37:06 juju-e4d256-prod-github-runner-207 kernel: [36800.595865] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 15:37:06 juju-e4d256-prod-github-runner-207 kernel: [36800.596807] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 15:37:06 juju-e4d256-prod-github-runner-207 kernel: [36800.597792] handle_exit+0x98/0x230 [kvm_amd] Aug 22 15:37:06 juju-e4d256-prod-github-runner-207 kernel: [36800.598683] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 15:37:06 juju-e4d256-prod-github-runner-207 kernel: [36800.599597] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 15:37:06 juju-e4d256-prod-github-runner-207 kernel: [36800.600519] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 15:37:06 juju-e4d256-prod-github-runner-207 kernel: [36800.601507] vcpu_run+0x62/0x2c0 [kvm] Aug 22 15:37:06 juju-e4d256-prod-github-runner-207 kernel: [36800.602447] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 15:37:06 juju-e4d256-prod-github-runner-207 kernel: [36800.603267] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 15:37:06 juju-e4d256-prod-github-runner-207 kernel: [36800.604124] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 15:37:06 juju-e4d256-prod-github-runner-207 kernel: [36800.604926] ? __seccomp_filter+0x4a/0x4a0 Aug 22 15:37:06 juju-e4d256-prod-github-runner-207 kernel: [36800.605686] ? __fget_files+0x86/0xc0 Aug 22 15:37:06 juju-e4d256-prod-github-runner-207 kernel: [36800.606395] __x64_sys_ioctl+0x95/0xd0 Aug 22 15:37:06 juju-e4d256-prod-github-runner-207 kernel: [36800.607086] do_syscall_64+0x5c/0xc0 Aug 22 15:37:06 juju-e4d256-prod-github-runner-207 kernel: [36800.607749] ? do_futex+0x162/0x1f0 Aug 22 15:37:06 juju-e4d256-prod-github-runner-207 kernel: [36800.608396] ? __x64_sys_futex+0x78/0x1e0 Aug 22 15:37:06 juju-e4d256-prod-github-runner-207 kernel: [36800.609069] ? __secure_computing+0xa9/0x120 Aug 22 15:37:06 juju-e4d256-prod-github-runner-207 kernel: [36800.609771] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 15:37:06 juju-e4d256-prod-github-runner-207 kernel: [36800.610529] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:37:06 juju-e4d256-prod-github-runner-207 kernel: [36800.611249] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:37:06 juju-e4d256-prod-github-runner-207 kernel: [36800.611972] ? do_syscall_64+0x69/0xc0 Aug 22 15:37:06 juju-e4d256-prod-github-runner-207 kernel: [36800.612615] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:37:06 juju-e4d256-prod-github-runner-207 kernel: [36800.613333] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:37:06 juju-e4d256-prod-github-runner-207 kernel: [36800.614028] ? do_syscall_64+0x69/0xc0 Aug 22 15:37:06 juju-e4d256-prod-github-runner-207 kernel: [36800.614651] ? do_syscall_64+0x69/0xc0 Aug 22 15:37:06 juju-e4d256-prod-github-runner-207 kernel: [36800.615272] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 15:37:06 juju-e4d256-prod-github-runner-207 kernel: [36800.615975] RIP: 0033:0x7faa5d0edaff Aug 22 15:37:06 juju-e4d256-prod-github-runner-207 kernel: [36800.616600] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 15:37:06 juju-e4d256-prod-github-runner-207 kernel: [36800.618776] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 15:37:06 juju-e4d256-prod-github-runner-207 kernel: [36800.619783] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 15:37:06 juju-e4d256-prod-github-runner-207 kernel: [36800.620788] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 15:37:06 juju-e4d256-prod-github-runner-207 kernel: [36800.621797] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 15:37:06 juju-e4d256-prod-github-runner-207 kernel: [36800.622757] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 15:37:06 juju-e4d256-prod-github-runner-207 kernel: [36800.623721] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 15:37:06 juju-e4d256-prod-github-runner-207 kernel: [36800.624715] Aug 22 15:37:34 juju-e4d256-prod-github-runner-207 kernel: [36828.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 34191s! [qemu-system-x86:6715] Aug 22 15:37:34 juju-e4d256-prod-github-runner-207 kernel: [36828.543778] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 15:37:34 juju-e4d256-prod-github-runner-207 kernel: [36828.544038] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 15:37:34 juju-e4d256-prod-github-runner-207 kernel: [36828.556291] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 15:37:34 juju-e4d256-prod-github-runner-207 kernel: [36828.557615] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 15:37:34 juju-e4d256-prod-github-runner-207 kernel: [36828.558855] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:37:34 juju-e4d256-prod-github-runner-207 kernel: [36828.559906] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 15:37:34 juju-e4d256-prod-github-runner-207 kernel: [36828.562463] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 15:37:34 juju-e4d256-prod-github-runner-207 kernel: [36828.563505] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 15:37:34 juju-e4d256-prod-github-runner-207 kernel: [36828.564673] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 15:37:34 juju-e4d256-prod-github-runner-207 kernel: [36828.565840] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 15:37:34 juju-e4d256-prod-github-runner-207 kernel: [36828.566994] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 15:37:34 juju-e4d256-prod-github-runner-207 kernel: [36828.568151] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 15:37:34 juju-e4d256-prod-github-runner-207 kernel: [36828.569326] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 15:37:34 juju-e4d256-prod-github-runner-207 kernel: [36828.570556] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 15:37:34 juju-e4d256-prod-github-runner-207 kernel: [36828.571650] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 15:37:34 juju-e4d256-prod-github-runner-207 kernel: [36828.572842] Call Trace: Aug 22 15:37:34 juju-e4d256-prod-github-runner-207 kernel: [36828.573760] Aug 22 15:37:34 juju-e4d256-prod-github-runner-207 kernel: [36828.574653] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:37:34 juju-e4d256-prod-github-runner-207 kernel: [36828.575681] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:37:34 juju-e4d256-prod-github-runner-207 kernel: [36828.576698] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:37:34 juju-e4d256-prod-github-runner-207 kernel: [36828.577812] ? show_regs.part.0+0x23/0x29 Aug 22 15:37:34 juju-e4d256-prod-github-runner-207 kernel: [36828.578806] ? show_regs.cold+0x8/0xd Aug 22 15:37:34 juju-e4d256-prod-github-runner-207 kernel: [36828.579774] ? watchdog_timer_fn+0x1be/0x220 Aug 22 15:37:34 juju-e4d256-prod-github-runner-207 kernel: [36828.580784] ? lockup_detector_update_enable+0x60/0x60 Aug 22 15:37:34 juju-e4d256-prod-github-runner-207 kernel: [36828.581860] ? __hrtimer_run_queues+0x107/0x230 Aug 22 15:37:34 juju-e4d256-prod-github-runner-207 kernel: [36828.582885] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 15:37:34 juju-e4d256-prod-github-runner-207 kernel: [36828.583911] ? hrtimer_interrupt+0x101/0x220 Aug 22 15:37:34 juju-e4d256-prod-github-runner-207 kernel: [36828.584940] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 15:37:34 juju-e4d256-prod-github-runner-207 kernel: [36828.586011] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 15:37:34 juju-e4d256-prod-github-runner-207 kernel: [36828.587058] Aug 22 15:37:34 juju-e4d256-prod-github-runner-207 kernel: [36828.587908] Aug 22 15:37:34 juju-e4d256-prod-github-runner-207 kernel: [36828.588743] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 15:37:34 juju-e4d256-prod-github-runner-207 kernel: [36828.589788] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:37:34 juju-e4d256-prod-github-runner-207 kernel: [36828.590823] ? _raw_spin_lock+0x22/0x30 Aug 22 15:37:34 juju-e4d256-prod-github-runner-207 kernel: [36828.591764] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:37:34 juju-e4d256-prod-github-runner-207 kernel: [36828.592777] direct_page_fault+0x206/0x310 [kvm] Aug 22 15:37:34 juju-e4d256-prod-github-runner-207 kernel: [36828.593819] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 15:37:34 juju-e4d256-prod-github-runner-207 kernel: [36828.594839] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 15:37:34 juju-e4d256-prod-github-runner-207 kernel: [36828.595861] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 15:37:34 juju-e4d256-prod-github-runner-207 kernel: [36828.596862] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 15:37:34 juju-e4d256-prod-github-runner-207 kernel: [36828.597823] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 15:37:34 juju-e4d256-prod-github-runner-207 kernel: [36828.598797] handle_exit+0x98/0x230 [kvm_amd] Aug 22 15:37:34 juju-e4d256-prod-github-runner-207 kernel: [36828.599697] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 15:37:34 juju-e4d256-prod-github-runner-207 kernel: [36828.600606] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 15:37:34 juju-e4d256-prod-github-runner-207 kernel: [36828.601537] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 15:37:34 juju-e4d256-prod-github-runner-207 kernel: [36828.602437] vcpu_run+0x62/0x2c0 [kvm] Aug 22 15:37:34 juju-e4d256-prod-github-runner-207 kernel: [36828.603245] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 15:37:34 juju-e4d256-prod-github-runner-207 kernel: [36828.604051] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 15:37:34 juju-e4d256-prod-github-runner-207 kernel: [36828.604904] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 15:37:34 juju-e4d256-prod-github-runner-207 kernel: [36828.605713] ? __seccomp_filter+0x4a/0x4a0 Aug 22 15:37:34 juju-e4d256-prod-github-runner-207 kernel: [36828.606453] ? __fget_files+0x86/0xc0 Aug 22 15:37:34 juju-e4d256-prod-github-runner-207 kernel: [36828.607154] __x64_sys_ioctl+0x95/0xd0 Aug 22 15:37:34 juju-e4d256-prod-github-runner-207 kernel: [36828.607843] do_syscall_64+0x5c/0xc0 Aug 22 15:37:34 juju-e4d256-prod-github-runner-207 kernel: [36828.608506] ? do_futex+0x162/0x1f0 Aug 22 15:37:34 juju-e4d256-prod-github-runner-207 kernel: [36828.609168] ? __x64_sys_futex+0x78/0x1e0 Aug 22 15:37:34 juju-e4d256-prod-github-runner-207 kernel: [36828.609843] ? __secure_computing+0xa9/0x120 Aug 22 15:37:34 juju-e4d256-prod-github-runner-207 kernel: [36828.610549] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 15:37:34 juju-e4d256-prod-github-runner-207 kernel: [36828.611307] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:37:34 juju-e4d256-prod-github-runner-207 kernel: [36828.612025] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:37:34 juju-e4d256-prod-github-runner-207 kernel: [36828.612738] ? do_syscall_64+0x69/0xc0 Aug 22 15:37:34 juju-e4d256-prod-github-runner-207 kernel: [36828.613393] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:37:34 juju-e4d256-prod-github-runner-207 kernel: [36828.614096] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:37:34 juju-e4d256-prod-github-runner-207 kernel: [36828.614788] ? do_syscall_64+0x69/0xc0 Aug 22 15:37:34 juju-e4d256-prod-github-runner-207 kernel: [36828.615485] ? do_syscall_64+0x69/0xc0 Aug 22 15:37:34 juju-e4d256-prod-github-runner-207 kernel: [36828.616107] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 15:37:34 juju-e4d256-prod-github-runner-207 kernel: [36828.616807] RIP: 0033:0x7faa5d0edaff Aug 22 15:37:34 juju-e4d256-prod-github-runner-207 kernel: [36828.617454] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 15:37:34 juju-e4d256-prod-github-runner-207 kernel: [36828.619427] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 15:37:34 juju-e4d256-prod-github-runner-207 kernel: [36828.620336] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 15:37:34 juju-e4d256-prod-github-runner-207 kernel: [36828.621234] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 15:37:34 juju-e4d256-prod-github-runner-207 kernel: [36828.622118] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 15:37:34 juju-e4d256-prod-github-runner-207 kernel: [36828.623000] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 15:37:34 juju-e4d256-prod-github-runner-207 kernel: [36828.623884] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 15:37:34 juju-e4d256-prod-github-runner-207 kernel: [36828.624780] Aug 22 15:38:02 juju-e4d256-prod-github-runner-207 kernel: [36856.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 34217s! [qemu-system-x86:6715] Aug 22 15:38:02 juju-e4d256-prod-github-runner-207 kernel: [36856.543091] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 15:38:02 juju-e4d256-prod-github-runner-207 kernel: [36856.543159] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 15:38:02 juju-e4d256-prod-github-runner-207 kernel: [36856.555669] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 15:38:02 juju-e4d256-prod-github-runner-207 kernel: [36856.557027] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 15:38:02 juju-e4d256-prod-github-runner-207 kernel: [36856.558268] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:38:02 juju-e4d256-prod-github-runner-207 kernel: [36856.559413] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 15:38:02 juju-e4d256-prod-github-runner-207 kernel: [36856.562192] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 15:38:02 juju-e4d256-prod-github-runner-207 kernel: [36856.563248] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 15:38:02 juju-e4d256-prod-github-runner-207 kernel: [36856.564410] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 15:38:02 juju-e4d256-prod-github-runner-207 kernel: [36856.565587] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 15:38:02 juju-e4d256-prod-github-runner-207 kernel: [36856.566750] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 15:38:02 juju-e4d256-prod-github-runner-207 kernel: [36856.567908] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 15:38:02 juju-e4d256-prod-github-runner-207 kernel: [36856.569090] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 15:38:02 juju-e4d256-prod-github-runner-207 kernel: [36856.570321] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 15:38:02 juju-e4d256-prod-github-runner-207 kernel: [36856.571416] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 15:38:02 juju-e4d256-prod-github-runner-207 kernel: [36856.572619] Call Trace: Aug 22 15:38:02 juju-e4d256-prod-github-runner-207 kernel: [36856.573530] Aug 22 15:38:02 juju-e4d256-prod-github-runner-207 kernel: [36856.574437] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:38:02 juju-e4d256-prod-github-runner-207 kernel: [36856.575694] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:38:02 juju-e4d256-prod-github-runner-207 kernel: [36856.576791] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:38:02 juju-e4d256-prod-github-runner-207 kernel: [36856.577899] ? show_regs.part.0+0x23/0x29 Aug 22 15:38:02 juju-e4d256-prod-github-runner-207 kernel: [36856.579002] ? show_regs.cold+0x8/0xd Aug 22 15:38:02 juju-e4d256-prod-github-runner-207 kernel: [36856.580088] ? watchdog_timer_fn+0x1be/0x220 Aug 22 15:38:02 juju-e4d256-prod-github-runner-207 kernel: [36856.581326] ? lockup_detector_update_enable+0x60/0x60 Aug 22 15:38:02 juju-e4d256-prod-github-runner-207 kernel: [36856.582415] ? __hrtimer_run_queues+0x107/0x230 Aug 22 15:38:02 juju-e4d256-prod-github-runner-207 kernel: [36856.583445] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 15:38:02 juju-e4d256-prod-github-runner-207 kernel: [36856.584474] ? hrtimer_interrupt+0x101/0x220 Aug 22 15:38:02 juju-e4d256-prod-github-runner-207 kernel: [36856.585519] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 15:38:02 juju-e4d256-prod-github-runner-207 kernel: [36856.586597] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 15:38:02 juju-e4d256-prod-github-runner-207 kernel: [36856.587664] Aug 22 15:38:02 juju-e4d256-prod-github-runner-207 kernel: [36856.588536] Aug 22 15:38:02 juju-e4d256-prod-github-runner-207 kernel: [36856.589401] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 15:38:02 juju-e4d256-prod-github-runner-207 kernel: [36856.590461] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:38:02 juju-e4d256-prod-github-runner-207 kernel: [36856.591700] ? _raw_spin_lock+0x22/0x30 Aug 22 15:38:02 juju-e4d256-prod-github-runner-207 kernel: [36856.592748] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:38:02 juju-e4d256-prod-github-runner-207 kernel: [36856.593776] direct_page_fault+0x206/0x310 [kvm] Aug 22 15:38:02 juju-e4d256-prod-github-runner-207 kernel: [36856.594833] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 15:38:02 juju-e4d256-prod-github-runner-207 kernel: [36856.595967] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 15:38:02 juju-e4d256-prod-github-runner-207 kernel: [36856.597126] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 15:38:02 juju-e4d256-prod-github-runner-207 kernel: [36856.598117] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 15:38:02 juju-e4d256-prod-github-runner-207 kernel: [36856.599064] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 15:38:02 juju-e4d256-prod-github-runner-207 kernel: [36856.600043] handle_exit+0x98/0x230 [kvm_amd] Aug 22 15:38:02 juju-e4d256-prod-github-runner-207 kernel: [36856.600958] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 15:38:02 juju-e4d256-prod-github-runner-207 kernel: [36856.601983] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 15:38:02 juju-e4d256-prod-github-runner-207 kernel: [36856.603088] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 15:38:02 juju-e4d256-prod-github-runner-207 kernel: [36856.604046] vcpu_run+0x62/0x2c0 [kvm] Aug 22 15:38:02 juju-e4d256-prod-github-runner-207 kernel: [36856.604876] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 15:38:02 juju-e4d256-prod-github-runner-207 kernel: [36856.605688] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 15:38:02 juju-e4d256-prod-github-runner-207 kernel: [36856.606557] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 15:38:02 juju-e4d256-prod-github-runner-207 kernel: [36856.607359] ? __seccomp_filter+0x4a/0x4a0 Aug 22 15:38:02 juju-e4d256-prod-github-runner-207 kernel: [36856.608127] ? __fget_files+0x86/0xc0 Aug 22 15:38:02 juju-e4d256-prod-github-runner-207 kernel: [36856.609013] __x64_sys_ioctl+0x95/0xd0 Aug 22 15:38:02 juju-e4d256-prod-github-runner-207 kernel: [36856.609801] do_syscall_64+0x5c/0xc0 Aug 22 15:38:02 juju-e4d256-prod-github-runner-207 kernel: [36856.610648] ? do_futex+0x162/0x1f0 Aug 22 15:38:02 juju-e4d256-prod-github-runner-207 kernel: [36856.611514] ? __x64_sys_futex+0x78/0x1e0 Aug 22 15:38:02 juju-e4d256-prod-github-runner-207 kernel: [36856.612416] ? __secure_computing+0xa9/0x120 Aug 22 15:38:02 juju-e4d256-prod-github-runner-207 kernel: [36856.613298] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 15:38:02 juju-e4d256-prod-github-runner-207 kernel: [36856.614101] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:38:02 juju-e4d256-prod-github-runner-207 kernel: [36856.615083] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:38:02 juju-e4d256-prod-github-runner-207 kernel: [36856.615894] ? do_syscall_64+0x69/0xc0 Aug 22 15:38:02 juju-e4d256-prod-github-runner-207 kernel: [36856.616554] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:38:02 juju-e4d256-prod-github-runner-207 kernel: [36856.617301] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:38:02 juju-e4d256-prod-github-runner-207 kernel: [36856.618076] ? do_syscall_64+0x69/0xc0 Aug 22 15:38:02 juju-e4d256-prod-github-runner-207 kernel: [36856.618704] ? do_syscall_64+0x69/0xc0 Aug 22 15:38:02 juju-e4d256-prod-github-runner-207 kernel: [36856.619327] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 15:38:02 juju-e4d256-prod-github-runner-207 kernel: [36856.620053] RIP: 0033:0x7faa5d0edaff Aug 22 15:38:02 juju-e4d256-prod-github-runner-207 kernel: [36856.620831] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 15:38:02 juju-e4d256-prod-github-runner-207 kernel: [36856.622879] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 15:38:02 juju-e4d256-prod-github-runner-207 kernel: [36856.623866] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 15:38:02 juju-e4d256-prod-github-runner-207 kernel: [36856.624824] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 15:38:02 juju-e4d256-prod-github-runner-207 kernel: [36856.625718] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 15:38:02 juju-e4d256-prod-github-runner-207 kernel: [36856.626699] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 15:38:02 juju-e4d256-prod-github-runner-207 kernel: [36856.627690] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 15:38:02 juju-e4d256-prod-github-runner-207 kernel: [36856.628617] Aug 22 15:38:30 juju-e4d256-prod-github-runner-207 kernel: [36884.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 34243s! [qemu-system-x86:6715] Aug 22 15:38:30 juju-e4d256-prod-github-runner-207 kernel: [36884.544223] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 15:38:30 juju-e4d256-prod-github-runner-207 kernel: [36884.544308] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 15:38:30 juju-e4d256-prod-github-runner-207 kernel: [36884.570845] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 15:38:30 juju-e4d256-prod-github-runner-207 kernel: [36884.573717] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 15:38:30 juju-e4d256-prod-github-runner-207 kernel: [36884.575499] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:38:30 juju-e4d256-prod-github-runner-207 kernel: [36884.578901] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 15:38:30 juju-e4d256-prod-github-runner-207 kernel: [36884.581461] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 15:38:30 juju-e4d256-prod-github-runner-207 kernel: [36884.582507] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 15:38:30 juju-e4d256-prod-github-runner-207 kernel: [36884.583688] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 15:38:30 juju-e4d256-prod-github-runner-207 kernel: [36884.584870] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 15:38:30 juju-e4d256-prod-github-runner-207 kernel: [36884.586031] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 15:38:30 juju-e4d256-prod-github-runner-207 kernel: [36884.587194] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 15:38:30 juju-e4d256-prod-github-runner-207 kernel: [36884.588367] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 15:38:30 juju-e4d256-prod-github-runner-207 kernel: [36884.589604] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 15:38:30 juju-e4d256-prod-github-runner-207 kernel: [36884.590703] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 15:38:30 juju-e4d256-prod-github-runner-207 kernel: [36884.591889] Call Trace: Aug 22 15:38:30 juju-e4d256-prod-github-runner-207 kernel: [36884.592808] Aug 22 15:38:30 juju-e4d256-prod-github-runner-207 kernel: [36884.593694] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:38:30 juju-e4d256-prod-github-runner-207 kernel: [36884.594725] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:38:30 juju-e4d256-prod-github-runner-207 kernel: [36884.595744] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:38:30 juju-e4d256-prod-github-runner-207 kernel: [36884.596825] ? show_regs.part.0+0x23/0x29 Aug 22 15:38:30 juju-e4d256-prod-github-runner-207 kernel: [36884.597830] ? show_regs.cold+0x8/0xd Aug 22 15:38:30 juju-e4d256-prod-github-runner-207 kernel: [36884.598802] ? watchdog_timer_fn+0x1be/0x220 Aug 22 15:38:30 juju-e4d256-prod-github-runner-207 kernel: [36884.599808] ? lockup_detector_update_enable+0x60/0x60 Aug 22 15:38:30 juju-e4d256-prod-github-runner-207 kernel: [36884.600883] ? __hrtimer_run_queues+0x107/0x230 Aug 22 15:38:30 juju-e4d256-prod-github-runner-207 kernel: [36884.601910] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 15:38:30 juju-e4d256-prod-github-runner-207 kernel: [36884.602933] ? hrtimer_interrupt+0x101/0x220 Aug 22 15:38:30 juju-e4d256-prod-github-runner-207 kernel: [36884.603952] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 15:38:30 juju-e4d256-prod-github-runner-207 kernel: [36884.605029] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 15:38:30 juju-e4d256-prod-github-runner-207 kernel: [36884.606076] Aug 22 15:38:30 juju-e4d256-prod-github-runner-207 kernel: [36884.606926] Aug 22 15:38:30 juju-e4d256-prod-github-runner-207 kernel: [36884.607768] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 15:38:30 juju-e4d256-prod-github-runner-207 kernel: [36884.608812] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:38:30 juju-e4d256-prod-github-runner-207 kernel: [36884.609851] ? _raw_spin_lock+0x22/0x30 Aug 22 15:38:30 juju-e4d256-prod-github-runner-207 kernel: [36884.610794] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:38:30 juju-e4d256-prod-github-runner-207 kernel: [36884.611809] direct_page_fault+0x206/0x310 [kvm] Aug 22 15:38:30 juju-e4d256-prod-github-runner-207 kernel: [36884.612882] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 15:38:30 juju-e4d256-prod-github-runner-207 kernel: [36884.613960] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 15:38:30 juju-e4d256-prod-github-runner-207 kernel: [36884.614964] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 15:38:30 juju-e4d256-prod-github-runner-207 kernel: [36884.615945] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 15:38:30 juju-e4d256-prod-github-runner-207 kernel: [36884.616939] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 15:38:30 juju-e4d256-prod-github-runner-207 kernel: [36884.617927] handle_exit+0x98/0x230 [kvm_amd] Aug 22 15:38:30 juju-e4d256-prod-github-runner-207 kernel: [36884.618859] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 15:38:30 juju-e4d256-prod-github-runner-207 kernel: [36884.619777] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 15:38:30 juju-e4d256-prod-github-runner-207 kernel: [36884.620754] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 15:38:30 juju-e4d256-prod-github-runner-207 kernel: [36884.621701] vcpu_run+0x62/0x2c0 [kvm] Aug 22 15:38:30 juju-e4d256-prod-github-runner-207 kernel: [36884.622534] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 15:38:30 juju-e4d256-prod-github-runner-207 kernel: [36884.623365] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 15:38:30 juju-e4d256-prod-github-runner-207 kernel: [36884.624275] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 15:38:30 juju-e4d256-prod-github-runner-207 kernel: [36884.625117] ? __seccomp_filter+0x4a/0x4a0 Aug 22 15:38:30 juju-e4d256-prod-github-runner-207 kernel: [36884.625895] ? __fget_files+0x86/0xc0 Aug 22 15:38:30 juju-e4d256-prod-github-runner-207 kernel: [36884.626641] __x64_sys_ioctl+0x95/0xd0 Aug 22 15:38:30 juju-e4d256-prod-github-runner-207 kernel: [36884.627365] do_syscall_64+0x5c/0xc0 Aug 22 15:38:30 juju-e4d256-prod-github-runner-207 kernel: [36884.628065] ? do_futex+0x162/0x1f0 Aug 22 15:38:30 juju-e4d256-prod-github-runner-207 kernel: [36884.628748] ? __x64_sys_futex+0x78/0x1e0 Aug 22 15:38:30 juju-e4d256-prod-github-runner-207 kernel: [36884.629435] ? __secure_computing+0xa9/0x120 Aug 22 15:38:30 juju-e4d256-prod-github-runner-207 kernel: [36884.630157] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 15:38:30 juju-e4d256-prod-github-runner-207 kernel: [36884.630941] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:38:30 juju-e4d256-prod-github-runner-207 kernel: [36884.631668] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:38:30 juju-e4d256-prod-github-runner-207 kernel: [36884.632430] ? do_syscall_64+0x69/0xc0 Aug 22 15:38:30 juju-e4d256-prod-github-runner-207 kernel: [36884.633075] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:38:30 juju-e4d256-prod-github-runner-207 kernel: [36884.633792] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:38:30 juju-e4d256-prod-github-runner-207 kernel: [36884.634522] ? do_syscall_64+0x69/0xc0 Aug 22 15:38:30 juju-e4d256-prod-github-runner-207 kernel: [36884.635160] ? do_syscall_64+0x69/0xc0 Aug 22 15:38:30 juju-e4d256-prod-github-runner-207 kernel: [36884.635784] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 15:38:30 juju-e4d256-prod-github-runner-207 kernel: [36884.636506] RIP: 0033:0x7faa5d0edaff Aug 22 15:38:30 juju-e4d256-prod-github-runner-207 kernel: [36884.637146] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 15:38:30 juju-e4d256-prod-github-runner-207 kernel: [36884.639190] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 15:38:30 juju-e4d256-prod-github-runner-207 kernel: [36884.640131] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 15:38:30 juju-e4d256-prod-github-runner-207 kernel: [36884.641065] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 15:38:30 juju-e4d256-prod-github-runner-207 kernel: [36884.641962] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 15:38:30 juju-e4d256-prod-github-runner-207 kernel: [36884.642878] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 15:38:30 juju-e4d256-prod-github-runner-207 kernel: [36884.643775] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 15:38:30 juju-e4d256-prod-github-runner-207 kernel: [36884.644719] Aug 22 15:38:45 juju-e4d256-prod-github-runner-207 kernel: [36899.648705] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 15:38:45 juju-e4d256-prod-github-runner-207 kernel: [36899.649654] rcu: 1-....: (9166745 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=4429479 Aug 22 15:38:45 juju-e4d256-prod-github-runner-207 kernel: [36899.650766] (t=9195612 jiffies g=23269 q=38526) Aug 22 15:38:45 juju-e4d256-prod-github-runner-207 kernel: [36899.651543] NMI backtrace for cpu 1 Aug 22 15:38:45 juju-e4d256-prod-github-runner-207 kernel: [36899.652256] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 15:38:45 juju-e4d256-prod-github-runner-207 kernel: [36899.653362] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 15:38:45 juju-e4d256-prod-github-runner-207 kernel: [36899.654424] Call Trace: Aug 22 15:38:45 juju-e4d256-prod-github-runner-207 kernel: [36899.655148] Aug 22 15:38:45 juju-e4d256-prod-github-runner-207 kernel: [36899.655788] show_stack+0x52/0x5c Aug 22 15:38:45 juju-e4d256-prod-github-runner-207 kernel: [36899.656520] dump_stack_lvl+0x4a/0x63 Aug 22 15:38:45 juju-e4d256-prod-github-runner-207 kernel: [36899.657264] dump_stack+0x10/0x16 Aug 22 15:38:45 juju-e4d256-prod-github-runner-207 kernel: [36899.657983] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 15:38:45 juju-e4d256-prod-github-runner-207 kernel: [36899.658759] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 15:38:45 juju-e4d256-prod-github-runner-207 kernel: [36899.659539] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 15:38:45 juju-e4d256-prod-github-runner-207 kernel: [36899.660367] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 15:38:45 juju-e4d256-prod-github-runner-207 kernel: [36899.661185] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 15:38:45 juju-e4d256-prod-github-runner-207 kernel: [36899.661992] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 15:38:45 juju-e4d256-prod-github-runner-207 kernel: [36899.662762] print_cpu_stall.cold+0x2f/0xe2 Aug 22 15:38:45 juju-e4d256-prod-github-runner-207 kernel: [36899.663524] ? timekeeping_update+0xf7/0x150 Aug 22 15:38:45 juju-e4d256-prod-github-runner-207 kernel: [36899.664299] check_cpu_stall+0x109/0x270 Aug 22 15:38:45 juju-e4d256-prod-github-runner-207 kernel: [36899.665045] rcu_sched_clock_irq+0x9a/0x250 Aug 22 15:38:45 juju-e4d256-prod-github-runner-207 kernel: [36899.665806] update_process_times+0x94/0xd0 Aug 22 15:38:45 juju-e4d256-prod-github-runner-207 kernel: [36899.666565] tick_sched_handle+0x29/0x70 Aug 22 15:38:45 juju-e4d256-prod-github-runner-207 kernel: [36899.667309] tick_sched_timer+0x8c/0xc0 Aug 22 15:38:45 juju-e4d256-prod-github-runner-207 kernel: [36899.668045] ? tick_nohz_handler+0xb0/0xb0 Aug 22 15:38:45 juju-e4d256-prod-github-runner-207 kernel: [36899.668806] __hrtimer_run_queues+0x107/0x230 Aug 22 15:38:45 juju-e4d256-prod-github-runner-207 kernel: [36899.669582] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 15:38:45 juju-e4d256-prod-github-runner-207 kernel: [36899.670356] hrtimer_interrupt+0x101/0x220 Aug 22 15:38:45 juju-e4d256-prod-github-runner-207 kernel: [36899.671112] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 15:38:45 juju-e4d256-prod-github-runner-207 kernel: [36899.671922] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 15:38:45 juju-e4d256-prod-github-runner-207 kernel: [36899.672733] Aug 22 15:38:45 juju-e4d256-prod-github-runner-207 kernel: [36899.673371] Aug 22 15:38:45 juju-e4d256-prod-github-runner-207 kernel: [36899.673997] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 15:38:45 juju-e4d256-prod-github-runner-207 kernel: [36899.674814] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:38:45 juju-e4d256-prod-github-runner-207 kernel: [36899.675696] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 15:38:45 juju-e4d256-prod-github-runner-207 kernel: [36899.677912] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 15:38:45 juju-e4d256-prod-github-runner-207 kernel: [36899.678789] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 15:38:45 juju-e4d256-prod-github-runner-207 kernel: [36899.679782] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 15:38:45 juju-e4d256-prod-github-runner-207 kernel: [36899.680769] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 15:38:45 juju-e4d256-prod-github-runner-207 kernel: [36899.681729] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 15:38:45 juju-e4d256-prod-github-runner-207 kernel: [36899.682682] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 15:38:45 juju-e4d256-prod-github-runner-207 kernel: [36899.683633] ? _raw_spin_lock+0x22/0x30 Aug 22 15:38:45 juju-e4d256-prod-github-runner-207 kernel: [36899.684409] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:38:45 juju-e4d256-prod-github-runner-207 kernel: [36899.685245] direct_page_fault+0x206/0x310 [kvm] Aug 22 15:38:45 juju-e4d256-prod-github-runner-207 kernel: [36899.686086] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 15:38:45 juju-e4d256-prod-github-runner-207 kernel: [36899.686916] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 15:38:45 juju-e4d256-prod-github-runner-207 kernel: [36899.687741] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 15:38:45 juju-e4d256-prod-github-runner-207 kernel: [36899.688555] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 15:38:45 juju-e4d256-prod-github-runner-207 kernel: [36899.689341] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 15:38:45 juju-e4d256-prod-github-runner-207 kernel: [36899.690161] handle_exit+0x98/0x230 [kvm_amd] Aug 22 15:38:45 juju-e4d256-prod-github-runner-207 kernel: [36899.690914] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 15:38:45 juju-e4d256-prod-github-runner-207 kernel: [36899.691700] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 15:38:45 juju-e4d256-prod-github-runner-207 kernel: [36899.692517] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 15:38:45 juju-e4d256-prod-github-runner-207 kernel: [36899.693304] vcpu_run+0x62/0x2c0 [kvm] Aug 22 15:38:45 juju-e4d256-prod-github-runner-207 kernel: [36899.694017] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 15:38:45 juju-e4d256-prod-github-runner-207 kernel: [36899.694749] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 15:38:45 juju-e4d256-prod-github-runner-207 kernel: [36899.695547] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 15:38:45 juju-e4d256-prod-github-runner-207 kernel: [36899.696316] ? __seccomp_filter+0x4a/0x4a0 Aug 22 15:38:45 juju-e4d256-prod-github-runner-207 kernel: [36899.697036] ? __fget_files+0x86/0xc0 Aug 22 15:38:45 juju-e4d256-prod-github-runner-207 kernel: [36899.697733] __x64_sys_ioctl+0x95/0xd0 Aug 22 15:38:45 juju-e4d256-prod-github-runner-207 kernel: [36899.698428] do_syscall_64+0x5c/0xc0 Aug 22 15:38:45 juju-e4d256-prod-github-runner-207 kernel: [36899.699108] ? do_futex+0x162/0x1f0 Aug 22 15:38:45 juju-e4d256-prod-github-runner-207 kernel: [36899.699783] ? __x64_sys_futex+0x78/0x1e0 Aug 22 15:38:45 juju-e4d256-prod-github-runner-207 kernel: [36899.700497] ? __secure_computing+0xa9/0x120 Aug 22 15:38:45 juju-e4d256-prod-github-runner-207 kernel: [36899.701215] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 15:38:45 juju-e4d256-prod-github-runner-207 kernel: [36899.702004] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:38:45 juju-e4d256-prod-github-runner-207 kernel: [36899.702757] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:38:45 juju-e4d256-prod-github-runner-207 kernel: [36899.703512] ? do_syscall_64+0x69/0xc0 Aug 22 15:38:45 juju-e4d256-prod-github-runner-207 kernel: [36899.704207] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:38:45 juju-e4d256-prod-github-runner-207 kernel: [36899.704962] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:38:45 juju-e4d256-prod-github-runner-207 kernel: [36899.705717] ? do_syscall_64+0x69/0xc0 Aug 22 15:38:45 juju-e4d256-prod-github-runner-207 kernel: [36899.706410] ? do_syscall_64+0x69/0xc0 Aug 22 15:38:45 juju-e4d256-prod-github-runner-207 kernel: [36899.707096] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 15:38:45 juju-e4d256-prod-github-runner-207 kernel: [36899.707870] RIP: 0033:0x7faa5d0edaff Aug 22 15:38:45 juju-e4d256-prod-github-runner-207 kernel: [36899.708560] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 15:38:45 juju-e4d256-prod-github-runner-207 kernel: [36899.710660] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 15:38:45 juju-e4d256-prod-github-runner-207 kernel: [36899.711619] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 15:38:45 juju-e4d256-prod-github-runner-207 kernel: [36899.712572] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 15:38:45 juju-e4d256-prod-github-runner-207 kernel: [36899.713520] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 15:38:45 juju-e4d256-prod-github-runner-207 kernel: [36899.714461] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 15:38:45 juju-e4d256-prod-github-runner-207 kernel: [36899.715386] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 15:38:45 juju-e4d256-prod-github-runner-207 kernel: [36899.716315] Aug 22 15:39:10 juju-e4d256-prod-github-runner-207 kernel: [36924.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 34280s! [qemu-system-x86:6715] Aug 22 15:39:10 juju-e4d256-prod-github-runner-207 kernel: [36924.543712] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 15:39:10 juju-e4d256-prod-github-runner-207 kernel: [36924.543976] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 15:39:10 juju-e4d256-prod-github-runner-207 kernel: [36924.556353] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 15:39:10 juju-e4d256-prod-github-runner-207 kernel: [36924.557644] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 15:39:10 juju-e4d256-prod-github-runner-207 kernel: [36924.558876] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:39:10 juju-e4d256-prod-github-runner-207 kernel: [36924.559943] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 15:39:10 juju-e4d256-prod-github-runner-207 kernel: [36924.562495] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 15:39:10 juju-e4d256-prod-github-runner-207 kernel: [36924.563542] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 15:39:10 juju-e4d256-prod-github-runner-207 kernel: [36924.564716] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 15:39:10 juju-e4d256-prod-github-runner-207 kernel: [36924.565874] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 15:39:10 juju-e4d256-prod-github-runner-207 kernel: [36924.567040] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 15:39:10 juju-e4d256-prod-github-runner-207 kernel: [36924.568206] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 15:39:10 juju-e4d256-prod-github-runner-207 kernel: [36924.569370] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 15:39:10 juju-e4d256-prod-github-runner-207 kernel: [36924.570605] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 15:39:10 juju-e4d256-prod-github-runner-207 kernel: [36924.571701] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 15:39:10 juju-e4d256-prod-github-runner-207 kernel: [36924.572901] Call Trace: Aug 22 15:39:10 juju-e4d256-prod-github-runner-207 kernel: [36924.573818] Aug 22 15:39:10 juju-e4d256-prod-github-runner-207 kernel: [36924.574706] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:39:10 juju-e4d256-prod-github-runner-207 kernel: [36924.575737] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:39:10 juju-e4d256-prod-github-runner-207 kernel: [36924.576765] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:39:10 juju-e4d256-prod-github-runner-207 kernel: [36924.577864] ? show_regs.part.0+0x23/0x29 Aug 22 15:39:10 juju-e4d256-prod-github-runner-207 kernel: [36924.578865] ? show_regs.cold+0x8/0xd Aug 22 15:39:10 juju-e4d256-prod-github-runner-207 kernel: [36924.579847] ? watchdog_timer_fn+0x1be/0x220 Aug 22 15:39:10 juju-e4d256-prod-github-runner-207 kernel: [36924.580936] ? lockup_detector_update_enable+0x60/0x60 Aug 22 15:39:10 juju-e4d256-prod-github-runner-207 kernel: [36924.581997] ? __hrtimer_run_queues+0x107/0x230 Aug 22 15:39:10 juju-e4d256-prod-github-runner-207 kernel: [36924.583021] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 15:39:10 juju-e4d256-prod-github-runner-207 kernel: [36924.584050] ? hrtimer_interrupt+0x101/0x220 Aug 22 15:39:10 juju-e4d256-prod-github-runner-207 kernel: [36924.585073] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 15:39:10 juju-e4d256-prod-github-runner-207 kernel: [36924.586142] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 15:39:10 juju-e4d256-prod-github-runner-207 kernel: [36924.587188] Aug 22 15:39:10 juju-e4d256-prod-github-runner-207 kernel: [36924.588052] Aug 22 15:39:10 juju-e4d256-prod-github-runner-207 kernel: [36924.588889] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 15:39:10 juju-e4d256-prod-github-runner-207 kernel: [36924.590369] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:39:10 juju-e4d256-prod-github-runner-207 kernel: [36924.591412] ? _raw_spin_lock+0x22/0x30 Aug 22 15:39:10 juju-e4d256-prod-github-runner-207 kernel: [36924.592603] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:39:10 juju-e4d256-prod-github-runner-207 kernel: [36924.593624] direct_page_fault+0x206/0x310 [kvm] Aug 22 15:39:10 juju-e4d256-prod-github-runner-207 kernel: [36924.594653] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 15:39:10 juju-e4d256-prod-github-runner-207 kernel: [36924.595663] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 15:39:10 juju-e4d256-prod-github-runner-207 kernel: [36924.596694] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 15:39:10 juju-e4d256-prod-github-runner-207 kernel: [36924.597695] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 15:39:10 juju-e4d256-prod-github-runner-207 kernel: [36924.598642] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 15:39:10 juju-e4d256-prod-github-runner-207 kernel: [36924.599615] handle_exit+0x98/0x230 [kvm_amd] Aug 22 15:39:10 juju-e4d256-prod-github-runner-207 kernel: [36924.600516] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 15:39:10 juju-e4d256-prod-github-runner-207 kernel: [36924.601432] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 15:39:10 juju-e4d256-prod-github-runner-207 kernel: [36924.602366] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 15:39:10 juju-e4d256-prod-github-runner-207 kernel: [36924.603289] vcpu_run+0x62/0x2c0 [kvm] Aug 22 15:39:10 juju-e4d256-prod-github-runner-207 kernel: [36924.604117] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 15:39:10 juju-e4d256-prod-github-runner-207 kernel: [36924.604927] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 15:39:10 juju-e4d256-prod-github-runner-207 kernel: [36924.605781] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 15:39:10 juju-e4d256-prod-github-runner-207 kernel: [36924.606578] ? __seccomp_filter+0x4a/0x4a0 Aug 22 15:39:10 juju-e4d256-prod-github-runner-207 kernel: [36924.607317] ? __fget_files+0x86/0xc0 Aug 22 15:39:10 juju-e4d256-prod-github-runner-207 kernel: [36924.608034] __x64_sys_ioctl+0x95/0xd0 Aug 22 15:39:10 juju-e4d256-prod-github-runner-207 kernel: [36924.608724] do_syscall_64+0x5c/0xc0 Aug 22 15:39:10 juju-e4d256-prod-github-runner-207 kernel: [36924.609387] ? do_futex+0x162/0x1f0 Aug 22 15:39:10 juju-e4d256-prod-github-runner-207 kernel: [36924.610033] ? __x64_sys_futex+0x78/0x1e0 Aug 22 15:39:10 juju-e4d256-prod-github-runner-207 kernel: [36924.610701] ? __secure_computing+0xa9/0x120 Aug 22 15:39:10 juju-e4d256-prod-github-runner-207 kernel: [36924.611385] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 15:39:10 juju-e4d256-prod-github-runner-207 kernel: [36924.612163] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:39:10 juju-e4d256-prod-github-runner-207 kernel: [36924.612890] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:39:10 juju-e4d256-prod-github-runner-207 kernel: [36924.613609] ? do_syscall_64+0x69/0xc0 Aug 22 15:39:10 juju-e4d256-prod-github-runner-207 kernel: [36924.614256] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:39:10 juju-e4d256-prod-github-runner-207 kernel: [36924.614962] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:39:10 juju-e4d256-prod-github-runner-207 kernel: [36924.615656] ? do_syscall_64+0x69/0xc0 Aug 22 15:39:10 juju-e4d256-prod-github-runner-207 kernel: [36924.616287] ? do_syscall_64+0x69/0xc0 Aug 22 15:39:10 juju-e4d256-prod-github-runner-207 kernel: [36924.616912] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 15:39:10 juju-e4d256-prod-github-runner-207 kernel: [36924.617619] RIP: 0033:0x7faa5d0edaff Aug 22 15:39:10 juju-e4d256-prod-github-runner-207 kernel: [36924.618271] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 15:39:10 juju-e4d256-prod-github-runner-207 kernel: [36924.620261] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 15:39:10 juju-e4d256-prod-github-runner-207 kernel: [36924.621168] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 15:39:10 juju-e4d256-prod-github-runner-207 kernel: [36924.622059] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 15:39:10 juju-e4d256-prod-github-runner-207 kernel: [36924.622944] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 15:39:10 juju-e4d256-prod-github-runner-207 kernel: [36924.623842] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 15:39:10 juju-e4d256-prod-github-runner-207 kernel: [36924.624728] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 15:39:10 juju-e4d256-prod-github-runner-207 kernel: [36924.625616] Aug 22 15:39:38 juju-e4d256-prod-github-runner-207 kernel: [36952.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 34306s! [qemu-system-x86:6715] Aug 22 15:39:38 juju-e4d256-prod-github-runner-207 kernel: [36952.543099] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 15:39:38 juju-e4d256-prod-github-runner-207 kernel: [36952.543168] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 15:39:38 juju-e4d256-prod-github-runner-207 kernel: [36952.555603] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 15:39:38 juju-e4d256-prod-github-runner-207 kernel: [36952.556877] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 15:39:38 juju-e4d256-prod-github-runner-207 kernel: [36952.558098] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:39:38 juju-e4d256-prod-github-runner-207 kernel: [36952.559157] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 15:39:38 juju-e4d256-prod-github-runner-207 kernel: [36952.561719] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 15:39:38 juju-e4d256-prod-github-runner-207 kernel: [36952.562765] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 15:39:38 juju-e4d256-prod-github-runner-207 kernel: [36952.563934] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 15:39:38 juju-e4d256-prod-github-runner-207 kernel: [36952.565094] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 15:39:38 juju-e4d256-prod-github-runner-207 kernel: [36952.566260] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 15:39:38 juju-e4d256-prod-github-runner-207 kernel: [36952.567424] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 15:39:38 juju-e4d256-prod-github-runner-207 kernel: [36952.568638] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 15:39:38 juju-e4d256-prod-github-runner-207 kernel: [36952.569913] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 15:39:38 juju-e4d256-prod-github-runner-207 kernel: [36952.571012] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 15:39:38 juju-e4d256-prod-github-runner-207 kernel: [36952.572218] Call Trace: Aug 22 15:39:38 juju-e4d256-prod-github-runner-207 kernel: [36952.573274] Aug 22 15:39:38 juju-e4d256-prod-github-runner-207 kernel: [36952.574157] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:39:38 juju-e4d256-prod-github-runner-207 kernel: [36952.575190] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:39:38 juju-e4d256-prod-github-runner-207 kernel: [36952.576222] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:39:38 juju-e4d256-prod-github-runner-207 kernel: [36952.577297] ? show_regs.part.0+0x23/0x29 Aug 22 15:39:38 juju-e4d256-prod-github-runner-207 kernel: [36952.578299] ? show_regs.cold+0x8/0xd Aug 22 15:39:38 juju-e4d256-prod-github-runner-207 kernel: [36952.579292] ? watchdog_timer_fn+0x1be/0x220 Aug 22 15:39:38 juju-e4d256-prod-github-runner-207 kernel: [36952.580323] ? lockup_detector_update_enable+0x60/0x60 Aug 22 15:39:38 juju-e4d256-prod-github-runner-207 kernel: [36952.581404] ? __hrtimer_run_queues+0x107/0x230 Aug 22 15:39:38 juju-e4d256-prod-github-runner-207 kernel: [36952.582440] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 15:39:38 juju-e4d256-prod-github-runner-207 kernel: [36952.583513] ? hrtimer_interrupt+0x101/0x220 Aug 22 15:39:38 juju-e4d256-prod-github-runner-207 kernel: [36952.584526] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 15:39:38 juju-e4d256-prod-github-runner-207 kernel: [36952.585610] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 15:39:38 juju-e4d256-prod-github-runner-207 kernel: [36952.586665] Aug 22 15:39:38 juju-e4d256-prod-github-runner-207 kernel: [36952.587544] Aug 22 15:39:38 juju-e4d256-prod-github-runner-207 kernel: [36952.588463] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 15:39:38 juju-e4d256-prod-github-runner-207 kernel: [36952.589622] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:39:38 juju-e4d256-prod-github-runner-207 kernel: [36952.590780] ? _raw_spin_lock+0x22/0x30 Aug 22 15:39:38 juju-e4d256-prod-github-runner-207 kernel: [36952.591819] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:39:38 juju-e4d256-prod-github-runner-207 kernel: [36952.592923] direct_page_fault+0x206/0x310 [kvm] Aug 22 15:39:38 juju-e4d256-prod-github-runner-207 kernel: [36952.594033] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 15:39:38 juju-e4d256-prod-github-runner-207 kernel: [36952.595130] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 15:39:38 juju-e4d256-prod-github-runner-207 kernel: [36952.596240] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 15:39:38 juju-e4d256-prod-github-runner-207 kernel: [36952.597304] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 15:39:38 juju-e4d256-prod-github-runner-207 kernel: [36952.598346] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 15:39:38 juju-e4d256-prod-github-runner-207 kernel: [36952.599427] handle_exit+0x98/0x230 [kvm_amd] Aug 22 15:39:38 juju-e4d256-prod-github-runner-207 kernel: [36952.600418] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 15:39:38 juju-e4d256-prod-github-runner-207 kernel: [36952.601425] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 15:39:38 juju-e4d256-prod-github-runner-207 kernel: [36952.602458] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 15:39:38 juju-e4d256-prod-github-runner-207 kernel: [36952.603456] vcpu_run+0x62/0x2c0 [kvm] Aug 22 15:39:38 juju-e4d256-prod-github-runner-207 kernel: [36952.604363] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 15:39:38 juju-e4d256-prod-github-runner-207 kernel: [36952.605257] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 15:39:38 juju-e4d256-prod-github-runner-207 kernel: [36952.606212] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 15:39:38 juju-e4d256-prod-github-runner-207 kernel: [36952.607096] ? __seccomp_filter+0x4a/0x4a0 Aug 22 15:39:38 juju-e4d256-prod-github-runner-207 kernel: [36952.607929] ? __fget_files+0x86/0xc0 Aug 22 15:39:38 juju-e4d256-prod-github-runner-207 kernel: [36952.608704] __x64_sys_ioctl+0x95/0xd0 Aug 22 15:39:38 juju-e4d256-prod-github-runner-207 kernel: [36952.609471] do_syscall_64+0x5c/0xc0 Aug 22 15:39:38 juju-e4d256-prod-github-runner-207 kernel: [36952.610222] ? do_futex+0x162/0x1f0 Aug 22 15:39:38 juju-e4d256-prod-github-runner-207 kernel: [36952.610958] ? __x64_sys_futex+0x78/0x1e0 Aug 22 15:39:38 juju-e4d256-prod-github-runner-207 kernel: [36952.611729] ? __secure_computing+0xa9/0x120 Aug 22 15:39:38 juju-e4d256-prod-github-runner-207 kernel: [36952.612510] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 15:39:38 juju-e4d256-prod-github-runner-207 kernel: [36952.613377] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:39:38 juju-e4d256-prod-github-runner-207 kernel: [36952.614187] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:39:38 juju-e4d256-prod-github-runner-207 kernel: [36952.614999] ? do_syscall_64+0x69/0xc0 Aug 22 15:39:38 juju-e4d256-prod-github-runner-207 kernel: [36952.615749] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:39:38 juju-e4d256-prod-github-runner-207 kernel: [36952.616568] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:39:38 juju-e4d256-prod-github-runner-207 kernel: [36952.617363] ? do_syscall_64+0x69/0xc0 Aug 22 15:39:38 juju-e4d256-prod-github-runner-207 kernel: [36952.618065] ? do_syscall_64+0x69/0xc0 Aug 22 15:39:38 juju-e4d256-prod-github-runner-207 kernel: [36952.618764] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 15:39:38 juju-e4d256-prod-github-runner-207 kernel: [36952.619585] RIP: 0033:0x7faa5d0edaff Aug 22 15:39:38 juju-e4d256-prod-github-runner-207 kernel: [36952.620282] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 15:39:38 juju-e4d256-prod-github-runner-207 kernel: [36952.622607] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 15:39:38 juju-e4d256-prod-github-runner-207 kernel: [36952.623710] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 15:39:38 juju-e4d256-prod-github-runner-207 kernel: [36952.624754] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 15:39:38 juju-e4d256-prod-github-runner-207 kernel: [36952.625784] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 15:39:38 juju-e4d256-prod-github-runner-207 kernel: [36952.626799] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 15:39:38 juju-e4d256-prod-github-runner-207 kernel: [36952.627840] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 15:39:38 juju-e4d256-prod-github-runner-207 kernel: [36952.628864] Aug 22 15:40:06 juju-e4d256-prod-github-runner-207 kernel: [36980.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 34332s! [qemu-system-x86:6715] Aug 22 15:40:06 juju-e4d256-prod-github-runner-207 kernel: [36980.543091] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 15:40:06 juju-e4d256-prod-github-runner-207 kernel: [36980.543178] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 15:40:06 juju-e4d256-prod-github-runner-207 kernel: [36980.555310] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 15:40:06 juju-e4d256-prod-github-runner-207 kernel: [36980.556572] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 15:40:06 juju-e4d256-prod-github-runner-207 kernel: [36980.557789] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:40:06 juju-e4d256-prod-github-runner-207 kernel: [36980.558843] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 15:40:06 juju-e4d256-prod-github-runner-207 kernel: [36980.561390] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 15:40:06 juju-e4d256-prod-github-runner-207 kernel: [36980.562429] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 15:40:06 juju-e4d256-prod-github-runner-207 kernel: [36980.563601] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 15:40:06 juju-e4d256-prod-github-runner-207 kernel: [36980.564760] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 15:40:06 juju-e4d256-prod-github-runner-207 kernel: [36980.565916] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 15:40:06 juju-e4d256-prod-github-runner-207 kernel: [36980.567075] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 15:40:06 juju-e4d256-prod-github-runner-207 kernel: [36980.568250] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 15:40:06 juju-e4d256-prod-github-runner-207 kernel: [36980.569484] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 15:40:06 juju-e4d256-prod-github-runner-207 kernel: [36980.570583] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 15:40:06 juju-e4d256-prod-github-runner-207 kernel: [36980.571784] Call Trace: Aug 22 15:40:06 juju-e4d256-prod-github-runner-207 kernel: [36980.572703] Aug 22 15:40:06 juju-e4d256-prod-github-runner-207 kernel: [36980.573591] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:40:06 juju-e4d256-prod-github-runner-207 kernel: [36980.574617] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:40:06 juju-e4d256-prod-github-runner-207 kernel: [36980.575650] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:40:06 juju-e4d256-prod-github-runner-207 kernel: [36980.576724] ? show_regs.part.0+0x23/0x29 Aug 22 15:40:06 juju-e4d256-prod-github-runner-207 kernel: [36980.577719] ? show_regs.cold+0x8/0xd Aug 22 15:40:06 juju-e4d256-prod-github-runner-207 kernel: [36980.578693] ? watchdog_timer_fn+0x1be/0x220 Aug 22 15:40:06 juju-e4d256-prod-github-runner-207 kernel: [36980.579732] ? lockup_detector_update_enable+0x60/0x60 Aug 22 15:40:06 juju-e4d256-prod-github-runner-207 kernel: [36980.580812] ? __hrtimer_run_queues+0x107/0x230 Aug 22 15:40:06 juju-e4d256-prod-github-runner-207 kernel: [36980.581840] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 15:40:06 juju-e4d256-prod-github-runner-207 kernel: [36980.582867] ? hrtimer_interrupt+0x101/0x220 Aug 22 15:40:06 juju-e4d256-prod-github-runner-207 kernel: [36980.583925] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 15:40:06 juju-e4d256-prod-github-runner-207 kernel: [36980.585004] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 15:40:06 juju-e4d256-prod-github-runner-207 kernel: [36980.586055] Aug 22 15:40:06 juju-e4d256-prod-github-runner-207 kernel: [36980.586912] Aug 22 15:40:06 juju-e4d256-prod-github-runner-207 kernel: [36980.587764] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 15:40:06 juju-e4d256-prod-github-runner-207 kernel: [36980.588799] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:40:06 juju-e4d256-prod-github-runner-207 kernel: [36980.589836] ? _raw_spin_lock+0x22/0x30 Aug 22 15:40:06 juju-e4d256-prod-github-runner-207 kernel: [36980.590781] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:40:06 juju-e4d256-prod-github-runner-207 kernel: [36980.591808] direct_page_fault+0x206/0x310 [kvm] Aug 22 15:40:06 juju-e4d256-prod-github-runner-207 kernel: [36980.592831] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 15:40:06 juju-e4d256-prod-github-runner-207 kernel: [36980.593838] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 15:40:06 juju-e4d256-prod-github-runner-207 kernel: [36980.594837] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 15:40:06 juju-e4d256-prod-github-runner-207 kernel: [36980.595817] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 15:40:06 juju-e4d256-prod-github-runner-207 kernel: [36980.596763] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 15:40:06 juju-e4d256-prod-github-runner-207 kernel: [36980.597742] handle_exit+0x98/0x230 [kvm_amd] Aug 22 15:40:06 juju-e4d256-prod-github-runner-207 kernel: [36980.598634] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 15:40:06 juju-e4d256-prod-github-runner-207 kernel: [36980.599555] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 15:40:06 juju-e4d256-prod-github-runner-207 kernel: [36980.600478] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 15:40:06 juju-e4d256-prod-github-runner-207 kernel: [36980.601383] vcpu_run+0x62/0x2c0 [kvm] Aug 22 15:40:06 juju-e4d256-prod-github-runner-207 kernel: [36980.602194] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 15:40:06 juju-e4d256-prod-github-runner-207 kernel: [36980.603001] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 15:40:06 juju-e4d256-prod-github-runner-207 kernel: [36980.603862] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 15:40:06 juju-e4d256-prod-github-runner-207 kernel: [36980.604659] ? __seccomp_filter+0x4a/0x4a0 Aug 22 15:40:06 juju-e4d256-prod-github-runner-207 kernel: [36980.605401] ? __fget_files+0x86/0xc0 Aug 22 15:40:06 juju-e4d256-prod-github-runner-207 kernel: [36980.606105] __x64_sys_ioctl+0x95/0xd0 Aug 22 15:40:06 juju-e4d256-prod-github-runner-207 kernel: [36980.606796] do_syscall_64+0x5c/0xc0 Aug 22 15:40:06 juju-e4d256-prod-github-runner-207 kernel: [36980.607472] ? do_futex+0x162/0x1f0 Aug 22 15:40:06 juju-e4d256-prod-github-runner-207 kernel: [36980.608121] ? __x64_sys_futex+0x78/0x1e0 Aug 22 15:40:06 juju-e4d256-prod-github-runner-207 kernel: [36980.608794] ? __secure_computing+0xa9/0x120 Aug 22 15:40:06 juju-e4d256-prod-github-runner-207 kernel: [36980.609489] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 15:40:06 juju-e4d256-prod-github-runner-207 kernel: [36980.610276] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:40:06 juju-e4d256-prod-github-runner-207 kernel: [36980.610999] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:40:06 juju-e4d256-prod-github-runner-207 kernel: [36980.611734] ? do_syscall_64+0x69/0xc0 Aug 22 15:40:06 juju-e4d256-prod-github-runner-207 kernel: [36980.612383] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:40:06 juju-e4d256-prod-github-runner-207 kernel: [36980.613084] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:40:06 juju-e4d256-prod-github-runner-207 kernel: [36980.613800] ? do_syscall_64+0x69/0xc0 Aug 22 15:40:06 juju-e4d256-prod-github-runner-207 kernel: [36980.614436] ? do_syscall_64+0x69/0xc0 Aug 22 15:40:06 juju-e4d256-prod-github-runner-207 kernel: [36980.615059] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 15:40:06 juju-e4d256-prod-github-runner-207 kernel: [36980.615781] RIP: 0033:0x7faa5d0edaff Aug 22 15:40:06 juju-e4d256-prod-github-runner-207 kernel: [36980.616410] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 15:40:06 juju-e4d256-prod-github-runner-207 kernel: [36980.618403] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 15:40:06 juju-e4d256-prod-github-runner-207 kernel: [36980.619326] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 15:40:06 juju-e4d256-prod-github-runner-207 kernel: [36980.620221] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 15:40:06 juju-e4d256-prod-github-runner-207 kernel: [36980.621110] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 15:40:06 juju-e4d256-prod-github-runner-207 kernel: [36980.621997] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 15:40:06 juju-e4d256-prod-github-runner-207 kernel: [36980.622885] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 15:40:06 juju-e4d256-prod-github-runner-207 kernel: [36980.623780] Aug 22 15:40:34 juju-e4d256-prod-github-runner-207 kernel: [37008.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 34358s! [qemu-system-x86:6715] Aug 22 15:40:34 juju-e4d256-prod-github-runner-207 kernel: [37008.543753] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 15:40:34 juju-e4d256-prod-github-runner-207 kernel: [37008.544003] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 15:40:34 juju-e4d256-prod-github-runner-207 kernel: [37008.556636] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 15:40:34 juju-e4d256-prod-github-runner-207 kernel: [37008.557922] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 15:40:34 juju-e4d256-prod-github-runner-207 kernel: [37008.559213] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:40:34 juju-e4d256-prod-github-runner-207 kernel: [37008.560272] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 15:40:34 juju-e4d256-prod-github-runner-207 kernel: [37008.562815] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 15:40:34 juju-e4d256-prod-github-runner-207 kernel: [37008.563870] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 15:40:34 juju-e4d256-prod-github-runner-207 kernel: [37008.565058] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 15:40:34 juju-e4d256-prod-github-runner-207 kernel: [37008.566234] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 15:40:34 juju-e4d256-prod-github-runner-207 kernel: [37008.567427] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 15:40:34 juju-e4d256-prod-github-runner-207 kernel: [37008.568588] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 15:40:34 juju-e4d256-prod-github-runner-207 kernel: [37008.569753] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 15:40:34 juju-e4d256-prod-github-runner-207 kernel: [37008.570998] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 15:40:34 juju-e4d256-prod-github-runner-207 kernel: [37008.572100] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 15:40:34 juju-e4d256-prod-github-runner-207 kernel: [37008.573297] Call Trace: Aug 22 15:40:34 juju-e4d256-prod-github-runner-207 kernel: [37008.574209] Aug 22 15:40:34 juju-e4d256-prod-github-runner-207 kernel: [37008.575119] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:40:34 juju-e4d256-prod-github-runner-207 kernel: [37008.576153] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:40:34 juju-e4d256-prod-github-runner-207 kernel: [37008.577175] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:40:34 juju-e4d256-prod-github-runner-207 kernel: [37008.578269] ? show_regs.part.0+0x23/0x29 Aug 22 15:40:34 juju-e4d256-prod-github-runner-207 kernel: [37008.579282] ? show_regs.cold+0x8/0xd Aug 22 15:40:34 juju-e4d256-prod-github-runner-207 kernel: [37008.580258] ? watchdog_timer_fn+0x1be/0x220 Aug 22 15:40:34 juju-e4d256-prod-github-runner-207 kernel: [37008.581269] ? lockup_detector_update_enable+0x60/0x60 Aug 22 15:40:34 juju-e4d256-prod-github-runner-207 kernel: [37008.582333] ? __hrtimer_run_queues+0x107/0x230 Aug 22 15:40:34 juju-e4d256-prod-github-runner-207 kernel: [37008.583379] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 15:40:34 juju-e4d256-prod-github-runner-207 kernel: [37008.584411] ? hrtimer_interrupt+0x101/0x220 Aug 22 15:40:34 juju-e4d256-prod-github-runner-207 kernel: [37008.585426] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 15:40:34 juju-e4d256-prod-github-runner-207 kernel: [37008.586497] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 15:40:34 juju-e4d256-prod-github-runner-207 kernel: [37008.587557] Aug 22 15:40:34 juju-e4d256-prod-github-runner-207 kernel: [37008.588485] Aug 22 15:40:34 juju-e4d256-prod-github-runner-207 kernel: [37008.589333] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 15:40:34 juju-e4d256-prod-github-runner-207 kernel: [37008.590365] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:40:34 juju-e4d256-prod-github-runner-207 kernel: [37008.591420] ? _raw_spin_lock+0x22/0x30 Aug 22 15:40:34 juju-e4d256-prod-github-runner-207 kernel: [37008.592363] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:40:34 juju-e4d256-prod-github-runner-207 kernel: [37008.593383] direct_page_fault+0x206/0x310 [kvm] Aug 22 15:40:34 juju-e4d256-prod-github-runner-207 kernel: [37008.594410] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 15:40:34 juju-e4d256-prod-github-runner-207 kernel: [37008.595429] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 15:40:34 juju-e4d256-prod-github-runner-207 kernel: [37008.596432] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 15:40:34 juju-e4d256-prod-github-runner-207 kernel: [37008.597418] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 15:40:34 juju-e4d256-prod-github-runner-207 kernel: [37008.598361] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 15:40:34 juju-e4d256-prod-github-runner-207 kernel: [37008.599350] handle_exit+0x98/0x230 [kvm_amd] Aug 22 15:40:34 juju-e4d256-prod-github-runner-207 kernel: [37008.600241] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 15:40:34 juju-e4d256-prod-github-runner-207 kernel: [37008.601152] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 15:40:34 juju-e4d256-prod-github-runner-207 kernel: [37008.602076] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 15:40:34 juju-e4d256-prod-github-runner-207 kernel: [37008.602987] vcpu_run+0x62/0x2c0 [kvm] Aug 22 15:40:34 juju-e4d256-prod-github-runner-207 kernel: [37008.603796] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 15:40:34 juju-e4d256-prod-github-runner-207 kernel: [37008.604601] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 15:40:34 juju-e4d256-prod-github-runner-207 kernel: [37008.605458] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 15:40:34 juju-e4d256-prod-github-runner-207 kernel: [37008.606253] ? __seccomp_filter+0x4a/0x4a0 Aug 22 15:40:34 juju-e4d256-prod-github-runner-207 kernel: [37008.607001] ? __fget_files+0x86/0xc0 Aug 22 15:40:34 juju-e4d256-prod-github-runner-207 kernel: [37008.607710] __x64_sys_ioctl+0x95/0xd0 Aug 22 15:40:34 juju-e4d256-prod-github-runner-207 kernel: [37008.608404] do_syscall_64+0x5c/0xc0 Aug 22 15:40:34 juju-e4d256-prod-github-runner-207 kernel: [37008.609066] ? do_futex+0x162/0x1f0 Aug 22 15:40:34 juju-e4d256-prod-github-runner-207 kernel: [37008.609712] ? __x64_sys_futex+0x78/0x1e0 Aug 22 15:40:34 juju-e4d256-prod-github-runner-207 kernel: [37008.610381] ? __secure_computing+0xa9/0x120 Aug 22 15:40:34 juju-e4d256-prod-github-runner-207 kernel: [37008.611086] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 15:40:34 juju-e4d256-prod-github-runner-207 kernel: [37008.611844] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:40:34 juju-e4d256-prod-github-runner-207 kernel: [37008.612568] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:40:34 juju-e4d256-prod-github-runner-207 kernel: [37008.613285] ? do_syscall_64+0x69/0xc0 Aug 22 15:40:34 juju-e4d256-prod-github-runner-207 kernel: [37008.613934] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:40:34 juju-e4d256-prod-github-runner-207 kernel: [37008.614634] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:40:34 juju-e4d256-prod-github-runner-207 kernel: [37008.615338] ? do_syscall_64+0x69/0xc0 Aug 22 15:40:34 juju-e4d256-prod-github-runner-207 kernel: [37008.615965] ? do_syscall_64+0x69/0xc0 Aug 22 15:40:34 juju-e4d256-prod-github-runner-207 kernel: [37008.616590] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 15:40:34 juju-e4d256-prod-github-runner-207 kernel: [37008.617294] RIP: 0033:0x7faa5d0edaff Aug 22 15:40:34 juju-e4d256-prod-github-runner-207 kernel: [37008.617967] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 15:40:34 juju-e4d256-prod-github-runner-207 kernel: [37008.620003] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 15:40:34 juju-e4d256-prod-github-runner-207 kernel: [37008.620908] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 15:40:34 juju-e4d256-prod-github-runner-207 kernel: [37008.621796] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 15:40:34 juju-e4d256-prod-github-runner-207 kernel: [37008.622681] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 15:40:34 juju-e4d256-prod-github-runner-207 kernel: [37008.623576] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 15:40:34 juju-e4d256-prod-github-runner-207 kernel: [37008.624464] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 15:40:34 juju-e4d256-prod-github-runner-207 kernel: [37008.625351] Aug 22 15:41:02 juju-e4d256-prod-github-runner-207 kernel: [37036.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 34384s! [qemu-system-x86:6715] Aug 22 15:41:02 juju-e4d256-prod-github-runner-207 kernel: [37036.543112] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 15:41:02 juju-e4d256-prod-github-runner-207 kernel: [37036.543180] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 15:41:02 juju-e4d256-prod-github-runner-207 kernel: [37036.555275] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 15:41:02 juju-e4d256-prod-github-runner-207 kernel: [37036.556536] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 15:41:02 juju-e4d256-prod-github-runner-207 kernel: [37036.557759] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:41:02 juju-e4d256-prod-github-runner-207 kernel: [37036.558828] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 15:41:02 juju-e4d256-prod-github-runner-207 kernel: [37036.561376] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 15:41:02 juju-e4d256-prod-github-runner-207 kernel: [37036.562424] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 15:41:02 juju-e4d256-prod-github-runner-207 kernel: [37036.563600] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 15:41:02 juju-e4d256-prod-github-runner-207 kernel: [37036.564764] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 15:41:02 juju-e4d256-prod-github-runner-207 kernel: [37036.565927] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 15:41:02 juju-e4d256-prod-github-runner-207 kernel: [37036.567142] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 15:41:02 juju-e4d256-prod-github-runner-207 kernel: [37036.568313] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 15:41:02 juju-e4d256-prod-github-runner-207 kernel: [37036.569546] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 15:41:02 juju-e4d256-prod-github-runner-207 kernel: [37036.570665] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 15:41:02 juju-e4d256-prod-github-runner-207 kernel: [37036.571863] Call Trace: Aug 22 15:41:02 juju-e4d256-prod-github-runner-207 kernel: [37036.572774] Aug 22 15:41:02 juju-e4d256-prod-github-runner-207 kernel: [37036.573859] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:41:02 juju-e4d256-prod-github-runner-207 kernel: [37036.575034] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:41:02 juju-e4d256-prod-github-runner-207 kernel: [37036.576058] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:41:02 juju-e4d256-prod-github-runner-207 kernel: [37036.577135] ? show_regs.part.0+0x23/0x29 Aug 22 15:41:02 juju-e4d256-prod-github-runner-207 kernel: [37036.578141] ? show_regs.cold+0x8/0xd Aug 22 15:41:02 juju-e4d256-prod-github-runner-207 kernel: [37036.579132] ? watchdog_timer_fn+0x1be/0x220 Aug 22 15:41:02 juju-e4d256-prod-github-runner-207 kernel: [37036.580144] ? lockup_detector_update_enable+0x60/0x60 Aug 22 15:41:02 juju-e4d256-prod-github-runner-207 kernel: [37036.581209] ? __hrtimer_run_queues+0x107/0x230 Aug 22 15:41:02 juju-e4d256-prod-github-runner-207 kernel: [37036.582236] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 15:41:02 juju-e4d256-prod-github-runner-207 kernel: [37036.583274] ? hrtimer_interrupt+0x101/0x220 Aug 22 15:41:02 juju-e4d256-prod-github-runner-207 kernel: [37036.584294] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 15:41:02 juju-e4d256-prod-github-runner-207 kernel: [37036.585369] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 15:41:02 juju-e4d256-prod-github-runner-207 kernel: [37036.586416] Aug 22 15:41:02 juju-e4d256-prod-github-runner-207 kernel: [37036.587327] Aug 22 15:41:02 juju-e4d256-prod-github-runner-207 kernel: [37036.588164] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 15:41:02 juju-e4d256-prod-github-runner-207 kernel: [37036.589201] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:41:02 juju-e4d256-prod-github-runner-207 kernel: [37036.590239] ? _raw_spin_lock+0x22/0x30 Aug 22 15:41:02 juju-e4d256-prod-github-runner-207 kernel: [37036.591217] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:41:02 juju-e4d256-prod-github-runner-207 kernel: [37036.592252] direct_page_fault+0x206/0x310 [kvm] Aug 22 15:41:02 juju-e4d256-prod-github-runner-207 kernel: [37036.593280] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 15:41:02 juju-e4d256-prod-github-runner-207 kernel: [37036.594286] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 15:41:02 juju-e4d256-prod-github-runner-207 kernel: [37036.595311] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 15:41:02 juju-e4d256-prod-github-runner-207 kernel: [37036.596279] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 15:41:02 juju-e4d256-prod-github-runner-207 kernel: [37036.597255] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 15:41:02 juju-e4d256-prod-github-runner-207 kernel: [37036.598244] handle_exit+0x98/0x230 [kvm_amd] Aug 22 15:41:02 juju-e4d256-prod-github-runner-207 kernel: [37036.599162] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 15:41:02 juju-e4d256-prod-github-runner-207 kernel: [37036.600079] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 15:41:02 juju-e4d256-prod-github-runner-207 kernel: [37036.601001] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 15:41:02 juju-e4d256-prod-github-runner-207 kernel: [37036.601910] vcpu_run+0x62/0x2c0 [kvm] Aug 22 15:41:02 juju-e4d256-prod-github-runner-207 kernel: [37036.602730] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 15:41:02 juju-e4d256-prod-github-runner-207 kernel: [37036.603536] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 15:41:02 juju-e4d256-prod-github-runner-207 kernel: [37036.604388] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 15:41:02 juju-e4d256-prod-github-runner-207 kernel: [37036.605189] ? __seccomp_filter+0x4a/0x4a0 Aug 22 15:41:02 juju-e4d256-prod-github-runner-207 kernel: [37036.605933] ? __fget_files+0x86/0xc0 Aug 22 15:41:02 juju-e4d256-prod-github-runner-207 kernel: [37036.606654] __x64_sys_ioctl+0x95/0xd0 Aug 22 15:41:02 juju-e4d256-prod-github-runner-207 kernel: [37036.607350] do_syscall_64+0x5c/0xc0 Aug 22 15:41:02 juju-e4d256-prod-github-runner-207 kernel: [37036.608022] ? do_futex+0x162/0x1f0 Aug 22 15:41:02 juju-e4d256-prod-github-runner-207 kernel: [37036.608674] ? __x64_sys_futex+0x78/0x1e0 Aug 22 15:41:02 juju-e4d256-prod-github-runner-207 kernel: [37036.609349] ? __secure_computing+0xa9/0x120 Aug 22 15:41:02 juju-e4d256-prod-github-runner-207 kernel: [37036.610043] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 15:41:02 juju-e4d256-prod-github-runner-207 kernel: [37036.610817] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:41:02 juju-e4d256-prod-github-runner-207 kernel: [37036.611538] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:41:02 juju-e4d256-prod-github-runner-207 kernel: [37036.612260] ? do_syscall_64+0x69/0xc0 Aug 22 15:41:02 juju-e4d256-prod-github-runner-207 kernel: [37036.612902] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:41:02 juju-e4d256-prod-github-runner-207 kernel: [37036.613604] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:41:02 juju-e4d256-prod-github-runner-207 kernel: [37036.614296] ? do_syscall_64+0x69/0xc0 Aug 22 15:41:02 juju-e4d256-prod-github-runner-207 kernel: [37036.614947] ? do_syscall_64+0x69/0xc0 Aug 22 15:41:02 juju-e4d256-prod-github-runner-207 kernel: [37036.615569] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 15:41:02 juju-e4d256-prod-github-runner-207 kernel: [37036.616273] RIP: 0033:0x7faa5d0edaff Aug 22 15:41:02 juju-e4d256-prod-github-runner-207 kernel: [37036.616922] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 15:41:02 juju-e4d256-prod-github-runner-207 kernel: [37036.618918] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 15:41:02 juju-e4d256-prod-github-runner-207 kernel: [37036.619834] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 15:41:02 juju-e4d256-prod-github-runner-207 kernel: [37036.620751] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 15:41:02 juju-e4d256-prod-github-runner-207 kernel: [37036.621655] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 15:41:02 juju-e4d256-prod-github-runner-207 kernel: [37036.622553] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 15:41:02 juju-e4d256-prod-github-runner-207 kernel: [37036.623441] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 15:41:02 juju-e4d256-prod-github-runner-207 kernel: [37036.624338] Aug 22 15:41:30 juju-e4d256-prod-github-runner-207 kernel: [37064.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 34411s! [qemu-system-x86:6715] Aug 22 15:41:30 juju-e4d256-prod-github-runner-207 kernel: [37064.543109] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 15:41:30 juju-e4d256-prod-github-runner-207 kernel: [37064.543177] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 15:41:30 juju-e4d256-prod-github-runner-207 kernel: [37064.555274] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 15:41:30 juju-e4d256-prod-github-runner-207 kernel: [37064.556543] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 15:41:30 juju-e4d256-prod-github-runner-207 kernel: [37064.557762] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:41:30 juju-e4d256-prod-github-runner-207 kernel: [37064.558828] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 15:41:30 juju-e4d256-prod-github-runner-207 kernel: [37064.561492] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 15:41:30 juju-e4d256-prod-github-runner-207 kernel: [37064.562573] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 15:41:30 juju-e4d256-prod-github-runner-207 kernel: [37064.563742] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 15:41:30 juju-e4d256-prod-github-runner-207 kernel: [37064.564996] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 15:41:30 juju-e4d256-prod-github-runner-207 kernel: [37064.566165] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 15:41:30 juju-e4d256-prod-github-runner-207 kernel: [37064.567362] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 15:41:30 juju-e4d256-prod-github-runner-207 kernel: [37064.568525] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 15:41:30 juju-e4d256-prod-github-runner-207 kernel: [37064.569762] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 15:41:30 juju-e4d256-prod-github-runner-207 kernel: [37064.570863] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 15:41:30 juju-e4d256-prod-github-runner-207 kernel: [37064.572079] Call Trace: Aug 22 15:41:30 juju-e4d256-prod-github-runner-207 kernel: [37064.573008] Aug 22 15:41:30 juju-e4d256-prod-github-runner-207 kernel: [37064.573893] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:41:30 juju-e4d256-prod-github-runner-207 kernel: [37064.574951] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:41:30 juju-e4d256-prod-github-runner-207 kernel: [37064.575975] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:41:30 juju-e4d256-prod-github-runner-207 kernel: [37064.577047] ? show_regs.part.0+0x23/0x29 Aug 22 15:41:30 juju-e4d256-prod-github-runner-207 kernel: [37064.578046] ? show_regs.cold+0x8/0xd Aug 22 15:41:30 juju-e4d256-prod-github-runner-207 kernel: [37064.579028] ? watchdog_timer_fn+0x1be/0x220 Aug 22 15:41:30 juju-e4d256-prod-github-runner-207 kernel: [37064.580037] ? lockup_detector_update_enable+0x60/0x60 Aug 22 15:41:30 juju-e4d256-prod-github-runner-207 kernel: [37064.581102] ? __hrtimer_run_queues+0x107/0x230 Aug 22 15:41:30 juju-e4d256-prod-github-runner-207 kernel: [37064.582159] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 15:41:30 juju-e4d256-prod-github-runner-207 kernel: [37064.583251] ? hrtimer_interrupt+0x101/0x220 Aug 22 15:41:30 juju-e4d256-prod-github-runner-207 kernel: [37064.584277] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 15:41:30 juju-e4d256-prod-github-runner-207 kernel: [37064.585346] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 15:41:30 juju-e4d256-prod-github-runner-207 kernel: [37064.586407] Aug 22 15:41:30 juju-e4d256-prod-github-runner-207 kernel: [37064.587260] Aug 22 15:41:30 juju-e4d256-prod-github-runner-207 kernel: [37064.588101] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 15:41:30 juju-e4d256-prod-github-runner-207 kernel: [37064.589133] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:41:30 juju-e4d256-prod-github-runner-207 kernel: [37064.590188] ? _raw_spin_lock+0x22/0x30 Aug 22 15:41:30 juju-e4d256-prod-github-runner-207 kernel: [37064.591140] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:41:30 juju-e4d256-prod-github-runner-207 kernel: [37064.592168] direct_page_fault+0x206/0x310 [kvm] Aug 22 15:41:30 juju-e4d256-prod-github-runner-207 kernel: [37064.593210] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 15:41:30 juju-e4d256-prod-github-runner-207 kernel: [37064.594434] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 15:41:30 juju-e4d256-prod-github-runner-207 kernel: [37064.595743] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 15:41:30 juju-e4d256-prod-github-runner-207 kernel: [37064.596775] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 15:41:30 juju-e4d256-prod-github-runner-207 kernel: [37064.597733] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 15:41:30 juju-e4d256-prod-github-runner-207 kernel: [37064.598737] handle_exit+0x98/0x230 [kvm_amd] Aug 22 15:41:30 juju-e4d256-prod-github-runner-207 kernel: [37064.599644] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 15:41:30 juju-e4d256-prod-github-runner-207 kernel: [37064.600852] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 15:41:30 juju-e4d256-prod-github-runner-207 kernel: [37064.602142] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 15:41:30 juju-e4d256-prod-github-runner-207 kernel: [37064.603416] vcpu_run+0x62/0x2c0 [kvm] Aug 22 15:41:30 juju-e4d256-prod-github-runner-207 kernel: [37064.604551] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 15:41:30 juju-e4d256-prod-github-runner-207 kernel: [37064.605673] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 15:41:30 juju-e4d256-prod-github-runner-207 kernel: [37064.606911] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 15:41:30 juju-e4d256-prod-github-runner-207 kernel: [37064.608074] ? __seccomp_filter+0x4a/0x4a0 Aug 22 15:41:30 juju-e4d256-prod-github-runner-207 kernel: [37064.609142] ? __fget_files+0x86/0xc0 Aug 22 15:41:30 juju-e4d256-prod-github-runner-207 kernel: [37064.610142] __x64_sys_ioctl+0x95/0xd0 Aug 22 15:41:30 juju-e4d256-prod-github-runner-207 kernel: [37064.611160] do_syscall_64+0x5c/0xc0 Aug 22 15:41:30 juju-e4d256-prod-github-runner-207 kernel: [37064.612145] ? do_futex+0x162/0x1f0 Aug 22 15:41:30 juju-e4d256-prod-github-runner-207 kernel: [37064.613042] ? __x64_sys_futex+0x78/0x1e0 Aug 22 15:41:30 juju-e4d256-prod-github-runner-207 kernel: [37064.613964] ? __secure_computing+0xa9/0x120 Aug 22 15:41:30 juju-e4d256-prod-github-runner-207 kernel: [37064.614973] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 15:41:30 juju-e4d256-prod-github-runner-207 kernel: [37064.616068] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:41:30 juju-e4d256-prod-github-runner-207 kernel: [37064.617078] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:41:30 juju-e4d256-prod-github-runner-207 kernel: [37064.618129] ? do_syscall_64+0x69/0xc0 Aug 22 15:41:30 juju-e4d256-prod-github-runner-207 kernel: [37064.619093] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:41:30 juju-e4d256-prod-github-runner-207 kernel: [37064.620123] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:41:30 juju-e4d256-prod-github-runner-207 kernel: [37064.621094] ? do_syscall_64+0x69/0xc0 Aug 22 15:41:30 juju-e4d256-prod-github-runner-207 kernel: [37064.621936] ? do_syscall_64+0x69/0xc0 Aug 22 15:41:30 juju-e4d256-prod-github-runner-207 kernel: [37064.622805] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 15:41:30 juju-e4d256-prod-github-runner-207 kernel: [37064.623802] RIP: 0033:0x7faa5d0edaff Aug 22 15:41:30 juju-e4d256-prod-github-runner-207 kernel: [37064.624716] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 15:41:30 juju-e4d256-prod-github-runner-207 kernel: [37064.627603] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 15:41:30 juju-e4d256-prod-github-runner-207 kernel: [37064.628985] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 15:41:30 juju-e4d256-prod-github-runner-207 kernel: [37064.630273] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 15:41:30 juju-e4d256-prod-github-runner-207 kernel: [37064.631624] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 15:41:30 juju-e4d256-prod-github-runner-207 kernel: [37064.632897] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 15:41:30 juju-e4d256-prod-github-runner-207 kernel: [37064.634231] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 15:41:30 juju-e4d256-prod-github-runner-207 kernel: [37064.635475] Aug 22 15:41:45 juju-e4d256-prod-github-runner-207 kernel: [37079.660706] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 15:41:45 juju-e4d256-prod-github-runner-207 kernel: [37079.661655] rcu: 1-....: (9211610 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=4451434 Aug 22 15:41:45 juju-e4d256-prod-github-runner-207 kernel: [37079.662779] (t=9240615 jiffies g=23269 q=38675) Aug 22 15:41:45 juju-e4d256-prod-github-runner-207 kernel: [37079.663564] NMI backtrace for cpu 1 Aug 22 15:41:45 juju-e4d256-prod-github-runner-207 kernel: [37079.664271] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 15:41:45 juju-e4d256-prod-github-runner-207 kernel: [37079.665370] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 15:41:45 juju-e4d256-prod-github-runner-207 kernel: [37079.666437] Call Trace: Aug 22 15:41:45 juju-e4d256-prod-github-runner-207 kernel: [37079.667112] Aug 22 15:41:45 juju-e4d256-prod-github-runner-207 kernel: [37079.667757] show_stack+0x52/0x5c Aug 22 15:41:45 juju-e4d256-prod-github-runner-207 kernel: [37079.668483] dump_stack_lvl+0x4a/0x63 Aug 22 15:41:45 juju-e4d256-prod-github-runner-207 kernel: [37079.669234] dump_stack+0x10/0x16 Aug 22 15:41:45 juju-e4d256-prod-github-runner-207 kernel: [37079.669950] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 15:41:45 juju-e4d256-prod-github-runner-207 kernel: [37079.670740] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 15:41:45 juju-e4d256-prod-github-runner-207 kernel: [37079.671521] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 15:41:45 juju-e4d256-prod-github-runner-207 kernel: [37079.672342] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 15:41:45 juju-e4d256-prod-github-runner-207 kernel: [37079.673171] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 15:41:45 juju-e4d256-prod-github-runner-207 kernel: [37079.673986] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 15:41:45 juju-e4d256-prod-github-runner-207 kernel: [37079.674781] print_cpu_stall.cold+0x2f/0xe2 Aug 22 15:41:45 juju-e4d256-prod-github-runner-207 kernel: [37079.675557] ? timekeeping_update+0xf7/0x150 Aug 22 15:41:45 juju-e4d256-prod-github-runner-207 kernel: [37079.676332] check_cpu_stall+0x109/0x270 Aug 22 15:41:45 juju-e4d256-prod-github-runner-207 kernel: [37079.677085] rcu_sched_clock_irq+0x9a/0x250 Aug 22 15:41:45 juju-e4d256-prod-github-runner-207 kernel: [37079.677845] update_process_times+0x94/0xd0 Aug 22 15:41:45 juju-e4d256-prod-github-runner-207 kernel: [37079.678620] tick_sched_handle+0x29/0x70 Aug 22 15:41:45 juju-e4d256-prod-github-runner-207 kernel: [37079.679363] tick_sched_timer+0x8c/0xc0 Aug 22 15:41:45 juju-e4d256-prod-github-runner-207 kernel: [37079.680098] ? tick_nohz_handler+0xb0/0xb0 Aug 22 15:41:45 juju-e4d256-prod-github-runner-207 kernel: [37079.680850] __hrtimer_run_queues+0x107/0x230 Aug 22 15:41:45 juju-e4d256-prod-github-runner-207 kernel: [37079.681623] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 15:41:45 juju-e4d256-prod-github-runner-207 kernel: [37079.682419] hrtimer_interrupt+0x101/0x220 Aug 22 15:41:45 juju-e4d256-prod-github-runner-207 kernel: [37079.683179] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 15:41:45 juju-e4d256-prod-github-runner-207 kernel: [37079.683995] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 15:41:45 juju-e4d256-prod-github-runner-207 kernel: [37079.684794] Aug 22 15:41:45 juju-e4d256-prod-github-runner-207 kernel: [37079.685433] Aug 22 15:41:45 juju-e4d256-prod-github-runner-207 kernel: [37079.686079] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 15:41:45 juju-e4d256-prod-github-runner-207 kernel: [37079.687019] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:41:45 juju-e4d256-prod-github-runner-207 kernel: [37079.687899] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 15:41:45 juju-e4d256-prod-github-runner-207 kernel: [37079.690114] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 15:41:45 juju-e4d256-prod-github-runner-207 kernel: [37079.690988] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 15:41:45 juju-e4d256-prod-github-runner-207 kernel: [37079.691984] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 15:41:45 juju-e4d256-prod-github-runner-207 kernel: [37079.692960] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 15:41:45 juju-e4d256-prod-github-runner-207 kernel: [37079.693918] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 15:41:45 juju-e4d256-prod-github-runner-207 kernel: [37079.694909] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 15:41:45 juju-e4d256-prod-github-runner-207 kernel: [37079.695862] ? _raw_spin_lock+0x22/0x30 Aug 22 15:41:45 juju-e4d256-prod-github-runner-207 kernel: [37079.696620] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:41:45 juju-e4d256-prod-github-runner-207 kernel: [37079.697450] direct_page_fault+0x206/0x310 [kvm] Aug 22 15:41:45 juju-e4d256-prod-github-runner-207 kernel: [37079.698295] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 15:41:45 juju-e4d256-prod-github-runner-207 kernel: [37079.699119] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 15:41:45 juju-e4d256-prod-github-runner-207 kernel: [37079.699937] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 15:41:45 juju-e4d256-prod-github-runner-207 kernel: [37079.700735] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 15:41:45 juju-e4d256-prod-github-runner-207 kernel: [37079.701518] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 15:41:45 juju-e4d256-prod-github-runner-207 kernel: [37079.702348] handle_exit+0x98/0x230 [kvm_amd] Aug 22 15:41:45 juju-e4d256-prod-github-runner-207 kernel: [37079.703099] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 15:41:45 juju-e4d256-prod-github-runner-207 kernel: [37079.703878] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 15:41:45 juju-e4d256-prod-github-runner-207 kernel: [37079.704679] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 15:41:45 juju-e4d256-prod-github-runner-207 kernel: [37079.705467] vcpu_run+0x62/0x2c0 [kvm] Aug 22 15:41:45 juju-e4d256-prod-github-runner-207 kernel: [37079.706197] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 15:41:45 juju-e4d256-prod-github-runner-207 kernel: [37079.706927] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 15:41:45 juju-e4d256-prod-github-runner-207 kernel: [37079.707724] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 15:41:45 juju-e4d256-prod-github-runner-207 kernel: [37079.708483] ? __seccomp_filter+0x4a/0x4a0 Aug 22 15:41:45 juju-e4d256-prod-github-runner-207 kernel: [37079.709201] ? __fget_files+0x86/0xc0 Aug 22 15:41:45 juju-e4d256-prod-github-runner-207 kernel: [37079.709890] __x64_sys_ioctl+0x95/0xd0 Aug 22 15:41:45 juju-e4d256-prod-github-runner-207 kernel: [37079.710588] do_syscall_64+0x5c/0xc0 Aug 22 15:41:45 juju-e4d256-prod-github-runner-207 kernel: [37079.711265] ? do_futex+0x162/0x1f0 Aug 22 15:41:45 juju-e4d256-prod-github-runner-207 kernel: [37079.711933] ? __x64_sys_futex+0x78/0x1e0 Aug 22 15:41:45 juju-e4d256-prod-github-runner-207 kernel: [37079.712630] ? __secure_computing+0xa9/0x120 Aug 22 15:41:45 juju-e4d256-prod-github-runner-207 kernel: [37079.713349] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 15:41:45 juju-e4d256-prod-github-runner-207 kernel: [37079.714145] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:41:45 juju-e4d256-prod-github-runner-207 kernel: [37079.714899] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:41:45 juju-e4d256-prod-github-runner-207 kernel: [37079.715658] ? do_syscall_64+0x69/0xc0 Aug 22 15:41:45 juju-e4d256-prod-github-runner-207 kernel: [37079.716363] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:41:45 juju-e4d256-prod-github-runner-207 kernel: [37079.717114] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:41:45 juju-e4d256-prod-github-runner-207 kernel: [37079.717867] ? do_syscall_64+0x69/0xc0 Aug 22 15:41:45 juju-e4d256-prod-github-runner-207 kernel: [37079.718816] ? do_syscall_64+0x69/0xc0 Aug 22 15:41:45 juju-e4d256-prod-github-runner-207 kernel: [37079.719648] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 15:41:45 juju-e4d256-prod-github-runner-207 kernel: [37079.720446] RIP: 0033:0x7faa5d0edaff Aug 22 15:41:45 juju-e4d256-prod-github-runner-207 kernel: [37079.721165] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 15:41:45 juju-e4d256-prod-github-runner-207 kernel: [37079.723301] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 15:41:45 juju-e4d256-prod-github-runner-207 kernel: [37079.724271] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 15:41:45 juju-e4d256-prod-github-runner-207 kernel: [37079.725246] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 15:41:45 juju-e4d256-prod-github-runner-207 kernel: [37079.726221] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 15:41:45 juju-e4d256-prod-github-runner-207 kernel: [37079.727169] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 15:41:45 juju-e4d256-prod-github-runner-207 kernel: [37079.728083] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 15:41:45 juju-e4d256-prod-github-runner-207 kernel: [37079.729022] Aug 22 15:42:10 juju-e4d256-prod-github-runner-207 kernel: [37104.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 34448s! [qemu-system-x86:6715] Aug 22 15:42:10 juju-e4d256-prod-github-runner-207 kernel: [37104.543692] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 15:42:10 juju-e4d256-prod-github-runner-207 kernel: [37104.543938] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 15:42:10 juju-e4d256-prod-github-runner-207 kernel: [37104.557029] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 15:42:10 juju-e4d256-prod-github-runner-207 kernel: [37104.558366] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 15:42:10 juju-e4d256-prod-github-runner-207 kernel: [37104.559738] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:42:10 juju-e4d256-prod-github-runner-207 kernel: [37104.560951] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 15:42:10 juju-e4d256-prod-github-runner-207 kernel: [37104.563693] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 15:42:10 juju-e4d256-prod-github-runner-207 kernel: [37104.564862] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 15:42:10 juju-e4d256-prod-github-runner-207 kernel: [37104.566142] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 15:42:10 juju-e4d256-prod-github-runner-207 kernel: [37104.567389] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 15:42:10 juju-e4d256-prod-github-runner-207 kernel: [37104.568575] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 15:42:10 juju-e4d256-prod-github-runner-207 kernel: [37104.569811] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 15:42:10 juju-e4d256-prod-github-runner-207 kernel: [37104.571081] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 15:42:10 juju-e4d256-prod-github-runner-207 kernel: [37104.572425] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 15:42:10 juju-e4d256-prod-github-runner-207 kernel: [37104.573594] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 15:42:10 juju-e4d256-prod-github-runner-207 kernel: [37104.574802] Call Trace: Aug 22 15:42:10 juju-e4d256-prod-github-runner-207 kernel: [37104.575714] Aug 22 15:42:10 juju-e4d256-prod-github-runner-207 kernel: [37104.576659] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:42:10 juju-e4d256-prod-github-runner-207 kernel: [37104.577900] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:42:10 juju-e4d256-prod-github-runner-207 kernel: [37104.579097] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:42:10 juju-e4d256-prod-github-runner-207 kernel: [37104.580332] ? show_regs.part.0+0x23/0x29 Aug 22 15:42:10 juju-e4d256-prod-github-runner-207 kernel: [37104.581454] ? show_regs.cold+0x8/0xd Aug 22 15:42:10 juju-e4d256-prod-github-runner-207 kernel: [37104.582571] ? watchdog_timer_fn+0x1be/0x220 Aug 22 15:42:10 juju-e4d256-prod-github-runner-207 kernel: [37104.583792] ? lockup_detector_update_enable+0x60/0x60 Aug 22 15:42:10 juju-e4d256-prod-github-runner-207 kernel: [37104.585007] ? __hrtimer_run_queues+0x107/0x230 Aug 22 15:42:10 juju-e4d256-prod-github-runner-207 kernel: [37104.586126] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 15:42:10 juju-e4d256-prod-github-runner-207 kernel: [37104.587220] ? hrtimer_interrupt+0x101/0x220 Aug 22 15:42:10 juju-e4d256-prod-github-runner-207 kernel: [37104.588344] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 15:42:10 juju-e4d256-prod-github-runner-207 kernel: [37104.589494] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 15:42:10 juju-e4d256-prod-github-runner-207 kernel: [37104.590595] Aug 22 15:42:10 juju-e4d256-prod-github-runner-207 kernel: [37104.591455] Aug 22 15:42:10 juju-e4d256-prod-github-runner-207 kernel: [37104.592292] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 15:42:10 juju-e4d256-prod-github-runner-207 kernel: [37104.593325] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:42:10 juju-e4d256-prod-github-runner-207 kernel: [37104.594382] ? _raw_spin_lock+0x22/0x30 Aug 22 15:42:10 juju-e4d256-prod-github-runner-207 kernel: [37104.595329] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:42:10 juju-e4d256-prod-github-runner-207 kernel: [37104.596350] direct_page_fault+0x206/0x310 [kvm] Aug 22 15:42:10 juju-e4d256-prod-github-runner-207 kernel: [37104.597373] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 15:42:10 juju-e4d256-prod-github-runner-207 kernel: [37104.598397] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 15:42:10 juju-e4d256-prod-github-runner-207 kernel: [37104.599399] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 15:42:10 juju-e4d256-prod-github-runner-207 kernel: [37104.600400] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 15:42:10 juju-e4d256-prod-github-runner-207 kernel: [37104.601351] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 15:42:10 juju-e4d256-prod-github-runner-207 kernel: [37104.602341] handle_exit+0x98/0x230 [kvm_amd] Aug 22 15:42:10 juju-e4d256-prod-github-runner-207 kernel: [37104.603235] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 15:42:10 juju-e4d256-prod-github-runner-207 kernel: [37104.604150] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 15:42:10 juju-e4d256-prod-github-runner-207 kernel: [37104.605079] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 15:42:10 juju-e4d256-prod-github-runner-207 kernel: [37104.605990] vcpu_run+0x62/0x2c0 [kvm] Aug 22 15:42:10 juju-e4d256-prod-github-runner-207 kernel: [37104.606802] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 15:42:10 juju-e4d256-prod-github-runner-207 kernel: [37104.607608] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 15:42:10 juju-e4d256-prod-github-runner-207 kernel: [37104.608468] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 15:42:10 juju-e4d256-prod-github-runner-207 kernel: [37104.609265] ? __seccomp_filter+0x4a/0x4a0 Aug 22 15:42:10 juju-e4d256-prod-github-runner-207 kernel: [37104.610029] ? __fget_files+0x86/0xc0 Aug 22 15:42:10 juju-e4d256-prod-github-runner-207 kernel: [37104.610798] __x64_sys_ioctl+0x95/0xd0 Aug 22 15:42:10 juju-e4d256-prod-github-runner-207 kernel: [37104.611649] do_syscall_64+0x5c/0xc0 Aug 22 15:42:10 juju-e4d256-prod-github-runner-207 kernel: [37104.612434] ? do_futex+0x162/0x1f0 Aug 22 15:42:10 juju-e4d256-prod-github-runner-207 kernel: [37104.613148] ? __x64_sys_futex+0x78/0x1e0 Aug 22 15:42:10 juju-e4d256-prod-github-runner-207 kernel: [37104.613841] ? __secure_computing+0xa9/0x120 Aug 22 15:42:10 juju-e4d256-prod-github-runner-207 kernel: [37104.614533] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 15:42:10 juju-e4d256-prod-github-runner-207 kernel: [37104.615381] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:42:10 juju-e4d256-prod-github-runner-207 kernel: [37104.616227] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:42:10 juju-e4d256-prod-github-runner-207 kernel: [37104.617064] ? do_syscall_64+0x69/0xc0 Aug 22 15:42:10 juju-e4d256-prod-github-runner-207 kernel: [37104.617817] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:42:10 juju-e4d256-prod-github-runner-207 kernel: [37104.618614] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:42:10 juju-e4d256-prod-github-runner-207 kernel: [37104.619406] ? do_syscall_64+0x69/0xc0 Aug 22 15:42:10 juju-e4d256-prod-github-runner-207 kernel: [37104.620104] ? do_syscall_64+0x69/0xc0 Aug 22 15:42:10 juju-e4d256-prod-github-runner-207 kernel: [37104.620806] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 15:42:10 juju-e4d256-prod-github-runner-207 kernel: [37104.621609] RIP: 0033:0x7faa5d0edaff Aug 22 15:42:10 juju-e4d256-prod-github-runner-207 kernel: [37104.622346] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 15:42:10 juju-e4d256-prod-github-runner-207 kernel: [37104.624669] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 15:42:10 juju-e4d256-prod-github-runner-207 kernel: [37104.625737] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 15:42:10 juju-e4d256-prod-github-runner-207 kernel: [37104.626761] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 15:42:10 juju-e4d256-prod-github-runner-207 kernel: [37104.627787] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 15:42:10 juju-e4d256-prod-github-runner-207 kernel: [37104.628818] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 15:42:10 juju-e4d256-prod-github-runner-207 kernel: [37104.629874] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 15:42:10 juju-e4d256-prod-github-runner-207 kernel: [37104.630899] Aug 22 15:42:38 juju-e4d256-prod-github-runner-207 kernel: [37132.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 34474s! [qemu-system-x86:6715] Aug 22 15:42:38 juju-e4d256-prod-github-runner-207 kernel: [37132.543093] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 15:42:38 juju-e4d256-prod-github-runner-207 kernel: [37132.543161] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 15:42:38 juju-e4d256-prod-github-runner-207 kernel: [37132.555208] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 15:42:38 juju-e4d256-prod-github-runner-207 kernel: [37132.556471] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 15:42:38 juju-e4d256-prod-github-runner-207 kernel: [37132.557715] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:42:38 juju-e4d256-prod-github-runner-207 kernel: [37132.558774] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 15:42:38 juju-e4d256-prod-github-runner-207 kernel: [37132.561320] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 15:42:38 juju-e4d256-prod-github-runner-207 kernel: [37132.562427] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 15:42:38 juju-e4d256-prod-github-runner-207 kernel: [37132.563701] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 15:42:38 juju-e4d256-prod-github-runner-207 kernel: [37132.564865] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 15:42:38 juju-e4d256-prod-github-runner-207 kernel: [37132.566044] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 15:42:38 juju-e4d256-prod-github-runner-207 kernel: [37132.567216] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 15:42:38 juju-e4d256-prod-github-runner-207 kernel: [37132.568392] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 15:42:38 juju-e4d256-prod-github-runner-207 kernel: [37132.569641] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 15:42:38 juju-e4d256-prod-github-runner-207 kernel: [37132.570736] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 15:42:38 juju-e4d256-prod-github-runner-207 kernel: [37132.571930] Call Trace: Aug 22 15:42:38 juju-e4d256-prod-github-runner-207 kernel: [37132.572846] Aug 22 15:42:38 juju-e4d256-prod-github-runner-207 kernel: [37132.573747] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:42:38 juju-e4d256-prod-github-runner-207 kernel: [37132.574775] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:42:38 juju-e4d256-prod-github-runner-207 kernel: [37132.575793] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:42:38 juju-e4d256-prod-github-runner-207 kernel: [37132.576880] ? show_regs.part.0+0x23/0x29 Aug 22 15:42:38 juju-e4d256-prod-github-runner-207 kernel: [37132.577911] ? show_regs.cold+0x8/0xd Aug 22 15:42:38 juju-e4d256-prod-github-runner-207 kernel: [37132.578890] ? watchdog_timer_fn+0x1be/0x220 Aug 22 15:42:38 juju-e4d256-prod-github-runner-207 kernel: [37132.579894] ? lockup_detector_update_enable+0x60/0x60 Aug 22 15:42:38 juju-e4d256-prod-github-runner-207 kernel: [37132.580952] ? __hrtimer_run_queues+0x107/0x230 Aug 22 15:42:38 juju-e4d256-prod-github-runner-207 kernel: [37132.581986] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 15:42:38 juju-e4d256-prod-github-runner-207 kernel: [37132.583020] ? hrtimer_interrupt+0x101/0x220 Aug 22 15:42:38 juju-e4d256-prod-github-runner-207 kernel: [37132.584039] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 15:42:38 juju-e4d256-prod-github-runner-207 kernel: [37132.585105] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 15:42:38 juju-e4d256-prod-github-runner-207 kernel: [37132.586155] Aug 22 15:42:38 juju-e4d256-prod-github-runner-207 kernel: [37132.587007] Aug 22 15:42:38 juju-e4d256-prod-github-runner-207 kernel: [37132.587846] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 15:42:38 juju-e4d256-prod-github-runner-207 kernel: [37132.588877] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:42:38 juju-e4d256-prod-github-runner-207 kernel: [37132.589933] ? _raw_spin_lock+0x22/0x30 Aug 22 15:42:38 juju-e4d256-prod-github-runner-207 kernel: [37132.590876] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:42:38 juju-e4d256-prod-github-runner-207 kernel: [37132.591889] direct_page_fault+0x206/0x310 [kvm] Aug 22 15:42:38 juju-e4d256-prod-github-runner-207 kernel: [37132.592960] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 15:42:38 juju-e4d256-prod-github-runner-207 kernel: [37132.593994] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 15:42:38 juju-e4d256-prod-github-runner-207 kernel: [37132.594995] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 15:42:38 juju-e4d256-prod-github-runner-207 kernel: [37132.595967] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 15:42:38 juju-e4d256-prod-github-runner-207 kernel: [37132.596911] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 15:42:38 juju-e4d256-prod-github-runner-207 kernel: [37132.597942] handle_exit+0x98/0x230 [kvm_amd] Aug 22 15:42:38 juju-e4d256-prod-github-runner-207 kernel: [37132.598838] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 15:42:38 juju-e4d256-prod-github-runner-207 kernel: [37132.599750] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 15:42:38 juju-e4d256-prod-github-runner-207 kernel: [37132.600671] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 15:42:38 juju-e4d256-prod-github-runner-207 kernel: [37132.601595] vcpu_run+0x62/0x2c0 [kvm] Aug 22 15:42:38 juju-e4d256-prod-github-runner-207 kernel: [37132.602406] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 15:42:38 juju-e4d256-prod-github-runner-207 kernel: [37132.603223] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 15:42:38 juju-e4d256-prod-github-runner-207 kernel: [37132.604085] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 15:42:38 juju-e4d256-prod-github-runner-207 kernel: [37132.604914] ? __seccomp_filter+0x4a/0x4a0 Aug 22 15:42:38 juju-e4d256-prod-github-runner-207 kernel: [37132.605688] ? __fget_files+0x86/0xc0 Aug 22 15:42:38 juju-e4d256-prod-github-runner-207 kernel: [37132.606404] __x64_sys_ioctl+0x95/0xd0 Aug 22 15:42:38 juju-e4d256-prod-github-runner-207 kernel: [37132.607105] do_syscall_64+0x5c/0xc0 Aug 22 15:42:38 juju-e4d256-prod-github-runner-207 kernel: [37132.607786] ? do_futex+0x162/0x1f0 Aug 22 15:42:38 juju-e4d256-prod-github-runner-207 kernel: [37132.608446] ? __x64_sys_futex+0x78/0x1e0 Aug 22 15:42:38 juju-e4d256-prod-github-runner-207 kernel: [37132.609116] ? __secure_computing+0xa9/0x120 Aug 22 15:42:38 juju-e4d256-prod-github-runner-207 kernel: [37132.609815] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 15:42:38 juju-e4d256-prod-github-runner-207 kernel: [37132.610573] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:42:38 juju-e4d256-prod-github-runner-207 kernel: [37132.611296] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:42:38 juju-e4d256-prod-github-runner-207 kernel: [37132.612011] ? do_syscall_64+0x69/0xc0 Aug 22 15:42:38 juju-e4d256-prod-github-runner-207 kernel: [37132.612653] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:42:38 juju-e4d256-prod-github-runner-207 kernel: [37132.613360] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:42:38 juju-e4d256-prod-github-runner-207 kernel: [37132.614070] ? do_syscall_64+0x69/0xc0 Aug 22 15:42:38 juju-e4d256-prod-github-runner-207 kernel: [37132.614696] ? do_syscall_64+0x69/0xc0 Aug 22 15:42:38 juju-e4d256-prod-github-runner-207 kernel: [37132.615315] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 15:42:38 juju-e4d256-prod-github-runner-207 kernel: [37132.616016] RIP: 0033:0x7faa5d0edaff Aug 22 15:42:38 juju-e4d256-prod-github-runner-207 kernel: [37132.616656] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 15:42:38 juju-e4d256-prod-github-runner-207 kernel: [37132.618719] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 15:42:38 juju-e4d256-prod-github-runner-207 kernel: [37132.619669] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 15:42:38 juju-e4d256-prod-github-runner-207 kernel: [37132.620560] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 15:42:38 juju-e4d256-prod-github-runner-207 kernel: [37132.621469] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 15:42:38 juju-e4d256-prod-github-runner-207 kernel: [37132.622363] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 15:42:38 juju-e4d256-prod-github-runner-207 kernel: [37132.623299] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 15:42:38 juju-e4d256-prod-github-runner-207 kernel: [37132.624206] Aug 22 15:43:06 juju-e4d256-prod-github-runner-207 kernel: [37160.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 34500s! [qemu-system-x86:6715] Aug 22 15:43:06 juju-e4d256-prod-github-runner-207 kernel: [37160.543103] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 15:43:06 juju-e4d256-prod-github-runner-207 kernel: [37160.543171] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 15:43:06 juju-e4d256-prod-github-runner-207 kernel: [37160.555231] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 15:43:06 juju-e4d256-prod-github-runner-207 kernel: [37160.556504] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 15:43:06 juju-e4d256-prod-github-runner-207 kernel: [37160.557752] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:43:06 juju-e4d256-prod-github-runner-207 kernel: [37160.558829] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 15:43:06 juju-e4d256-prod-github-runner-207 kernel: [37160.561402] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 15:43:06 juju-e4d256-prod-github-runner-207 kernel: [37160.562449] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 15:43:06 juju-e4d256-prod-github-runner-207 kernel: [37160.563607] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 15:43:06 juju-e4d256-prod-github-runner-207 kernel: [37160.564770] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 15:43:06 juju-e4d256-prod-github-runner-207 kernel: [37160.565946] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 15:43:06 juju-e4d256-prod-github-runner-207 kernel: [37160.567109] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 15:43:06 juju-e4d256-prod-github-runner-207 kernel: [37160.568271] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 15:43:06 juju-e4d256-prod-github-runner-207 kernel: [37160.569526] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 15:43:06 juju-e4d256-prod-github-runner-207 kernel: [37160.570633] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 15:43:06 juju-e4d256-prod-github-runner-207 kernel: [37160.571832] Call Trace: Aug 22 15:43:06 juju-e4d256-prod-github-runner-207 kernel: [37160.572747] Aug 22 15:43:06 juju-e4d256-prod-github-runner-207 kernel: [37160.573636] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:43:06 juju-e4d256-prod-github-runner-207 kernel: [37160.574669] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:43:06 juju-e4d256-prod-github-runner-207 kernel: [37160.575689] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:43:06 juju-e4d256-prod-github-runner-207 kernel: [37160.576761] ? show_regs.part.0+0x23/0x29 Aug 22 15:43:06 juju-e4d256-prod-github-runner-207 kernel: [37160.577766] ? show_regs.cold+0x8/0xd Aug 22 15:43:06 juju-e4d256-prod-github-runner-207 kernel: [37160.578741] ? watchdog_timer_fn+0x1be/0x220 Aug 22 15:43:06 juju-e4d256-prod-github-runner-207 kernel: [37160.579766] ? lockup_detector_update_enable+0x60/0x60 Aug 22 15:43:06 juju-e4d256-prod-github-runner-207 kernel: [37160.580834] ? __hrtimer_run_queues+0x107/0x230 Aug 22 15:43:06 juju-e4d256-prod-github-runner-207 kernel: [37160.581878] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 15:43:06 juju-e4d256-prod-github-runner-207 kernel: [37160.582900] ? hrtimer_interrupt+0x101/0x220 Aug 22 15:43:06 juju-e4d256-prod-github-runner-207 kernel: [37160.583913] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 15:43:06 juju-e4d256-prod-github-runner-207 kernel: [37160.584982] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 15:43:06 juju-e4d256-prod-github-runner-207 kernel: [37160.586035] Aug 22 15:43:06 juju-e4d256-prod-github-runner-207 kernel: [37160.586885] Aug 22 15:43:06 juju-e4d256-prod-github-runner-207 kernel: [37160.587725] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 15:43:06 juju-e4d256-prod-github-runner-207 kernel: [37160.588754] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:43:06 juju-e4d256-prod-github-runner-207 kernel: [37160.589809] ? _raw_spin_lock+0x22/0x30 Aug 22 15:43:06 juju-e4d256-prod-github-runner-207 kernel: [37160.590766] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:43:06 juju-e4d256-prod-github-runner-207 kernel: [37160.591780] direct_page_fault+0x206/0x310 [kvm] Aug 22 15:43:06 juju-e4d256-prod-github-runner-207 kernel: [37160.592802] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 15:43:06 juju-e4d256-prod-github-runner-207 kernel: [37160.593823] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 15:43:06 juju-e4d256-prod-github-runner-207 kernel: [37160.594827] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 15:43:06 juju-e4d256-prod-github-runner-207 kernel: [37160.595802] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 15:43:06 juju-e4d256-prod-github-runner-207 kernel: [37160.596751] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 15:43:06 juju-e4d256-prod-github-runner-207 kernel: [37160.597735] handle_exit+0x98/0x230 [kvm_amd] Aug 22 15:43:06 juju-e4d256-prod-github-runner-207 kernel: [37160.598627] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 15:43:06 juju-e4d256-prod-github-runner-207 kernel: [37160.599543] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 15:43:06 juju-e4d256-prod-github-runner-207 kernel: [37160.600481] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 15:43:06 juju-e4d256-prod-github-runner-207 kernel: [37160.601406] vcpu_run+0x62/0x2c0 [kvm] Aug 22 15:43:06 juju-e4d256-prod-github-runner-207 kernel: [37160.602219] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 15:43:06 juju-e4d256-prod-github-runner-207 kernel: [37160.603031] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 15:43:06 juju-e4d256-prod-github-runner-207 kernel: [37160.603885] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 15:43:06 juju-e4d256-prod-github-runner-207 kernel: [37160.604685] ? __seccomp_filter+0x4a/0x4a0 Aug 22 15:43:06 juju-e4d256-prod-github-runner-207 kernel: [37160.605449] ? __fget_files+0x86/0xc0 Aug 22 15:43:06 juju-e4d256-prod-github-runner-207 kernel: [37160.606152] __x64_sys_ioctl+0x95/0xd0 Aug 22 15:43:06 juju-e4d256-prod-github-runner-207 kernel: [37160.606843] do_syscall_64+0x5c/0xc0 Aug 22 15:43:06 juju-e4d256-prod-github-runner-207 kernel: [37160.607511] ? do_futex+0x162/0x1f0 Aug 22 15:43:06 juju-e4d256-prod-github-runner-207 kernel: [37160.608164] ? __x64_sys_futex+0x78/0x1e0 Aug 22 15:43:06 juju-e4d256-prod-github-runner-207 kernel: [37160.608836] ? __secure_computing+0xa9/0x120 Aug 22 15:43:06 juju-e4d256-prod-github-runner-207 kernel: [37160.609537] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 15:43:06 juju-e4d256-prod-github-runner-207 kernel: [37160.610301] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:43:06 juju-e4d256-prod-github-runner-207 kernel: [37160.611046] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:43:06 juju-e4d256-prod-github-runner-207 kernel: [37160.611765] ? do_syscall_64+0x69/0xc0 Aug 22 15:43:06 juju-e4d256-prod-github-runner-207 kernel: [37160.612409] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:43:06 juju-e4d256-prod-github-runner-207 kernel: [37160.613141] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:43:06 juju-e4d256-prod-github-runner-207 kernel: [37160.613843] ? do_syscall_64+0x69/0xc0 Aug 22 15:43:06 juju-e4d256-prod-github-runner-207 kernel: [37160.614470] ? do_syscall_64+0x69/0xc0 Aug 22 15:43:06 juju-e4d256-prod-github-runner-207 kernel: [37160.615095] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 15:43:06 juju-e4d256-prod-github-runner-207 kernel: [37160.615801] RIP: 0033:0x7faa5d0edaff Aug 22 15:43:06 juju-e4d256-prod-github-runner-207 kernel: [37160.616427] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 15:43:06 juju-e4d256-prod-github-runner-207 kernel: [37160.618420] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 15:43:06 juju-e4d256-prod-github-runner-207 kernel: [37160.619328] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 15:43:06 juju-e4d256-prod-github-runner-207 kernel: [37160.620213] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 15:43:06 juju-e4d256-prod-github-runner-207 kernel: [37160.621138] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 15:43:06 juju-e4d256-prod-github-runner-207 kernel: [37160.622042] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 15:43:06 juju-e4d256-prod-github-runner-207 kernel: [37160.622938] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 15:43:06 juju-e4d256-prod-github-runner-207 kernel: [37160.623829] Aug 22 15:43:34 juju-e4d256-prod-github-runner-207 kernel: [37188.541984] watchdog: BUG: soft lockup - CPU#1 stuck for 34526s! [qemu-system-x86:6715] Aug 22 15:43:34 juju-e4d256-prod-github-runner-207 kernel: [37188.543743] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 15:43:34 juju-e4d256-prod-github-runner-207 kernel: [37188.543988] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 15:43:34 juju-e4d256-prod-github-runner-207 kernel: [37188.556146] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 15:43:34 juju-e4d256-prod-github-runner-207 kernel: [37188.557452] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 15:43:34 juju-e4d256-prod-github-runner-207 kernel: [37188.558675] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:43:34 juju-e4d256-prod-github-runner-207 kernel: [37188.559732] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 15:43:34 juju-e4d256-prod-github-runner-207 kernel: [37188.562341] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 15:43:34 juju-e4d256-prod-github-runner-207 kernel: [37188.563387] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 15:43:34 juju-e4d256-prod-github-runner-207 kernel: [37188.564551] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 15:43:34 juju-e4d256-prod-github-runner-207 kernel: [37188.565732] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 15:43:34 juju-e4d256-prod-github-runner-207 kernel: [37188.566908] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 15:43:34 juju-e4d256-prod-github-runner-207 kernel: [37188.568074] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 15:43:34 juju-e4d256-prod-github-runner-207 kernel: [37188.569259] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 15:43:34 juju-e4d256-prod-github-runner-207 kernel: [37188.570493] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 15:43:34 juju-e4d256-prod-github-runner-207 kernel: [37188.571604] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 15:43:34 juju-e4d256-prod-github-runner-207 kernel: [37188.572816] Call Trace: Aug 22 15:43:34 juju-e4d256-prod-github-runner-207 kernel: [37188.573734] Aug 22 15:43:34 juju-e4d256-prod-github-runner-207 kernel: [37188.574634] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:43:34 juju-e4d256-prod-github-runner-207 kernel: [37188.575665] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:43:34 juju-e4d256-prod-github-runner-207 kernel: [37188.576696] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:43:34 juju-e4d256-prod-github-runner-207 kernel: [37188.577819] ? show_regs.part.0+0x23/0x29 Aug 22 15:43:34 juju-e4d256-prod-github-runner-207 kernel: [37188.578819] ? show_regs.cold+0x8/0xd Aug 22 15:43:34 juju-e4d256-prod-github-runner-207 kernel: [37188.579790] ? watchdog_timer_fn+0x1be/0x220 Aug 22 15:43:34 juju-e4d256-prod-github-runner-207 kernel: [37188.580813] ? lockup_detector_update_enable+0x60/0x60 Aug 22 15:43:34 juju-e4d256-prod-github-runner-207 kernel: [37188.581894] ? __hrtimer_run_queues+0x107/0x230 Aug 22 15:43:34 juju-e4d256-prod-github-runner-207 kernel: [37188.582934] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 15:43:34 juju-e4d256-prod-github-runner-207 kernel: [37188.583960] ? hrtimer_interrupt+0x101/0x220 Aug 22 15:43:34 juju-e4d256-prod-github-runner-207 kernel: [37188.585001] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 15:43:34 juju-e4d256-prod-github-runner-207 kernel: [37188.586072] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 15:43:34 juju-e4d256-prod-github-runner-207 kernel: [37188.587126] Aug 22 15:43:34 juju-e4d256-prod-github-runner-207 kernel: [37188.587991] Aug 22 15:43:34 juju-e4d256-prod-github-runner-207 kernel: [37188.588842] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 15:43:34 juju-e4d256-prod-github-runner-207 kernel: [37188.589876] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:43:34 juju-e4d256-prod-github-runner-207 kernel: [37188.590932] ? _raw_spin_lock+0x22/0x30 Aug 22 15:43:34 juju-e4d256-prod-github-runner-207 kernel: [37188.591900] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:43:34 juju-e4d256-prod-github-runner-207 kernel: [37188.592954] direct_page_fault+0x206/0x310 [kvm] Aug 22 15:43:34 juju-e4d256-prod-github-runner-207 kernel: [37188.593987] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 15:43:34 juju-e4d256-prod-github-runner-207 kernel: [37188.595000] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 15:43:34 juju-e4d256-prod-github-runner-207 kernel: [37188.595998] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 15:43:34 juju-e4d256-prod-github-runner-207 kernel: [37188.597005] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 15:43:34 juju-e4d256-prod-github-runner-207 kernel: [37188.597966] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 15:43:34 juju-e4d256-prod-github-runner-207 kernel: [37188.598947] handle_exit+0x98/0x230 [kvm_amd] Aug 22 15:43:34 juju-e4d256-prod-github-runner-207 kernel: [37188.599839] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 15:43:34 juju-e4d256-prod-github-runner-207 kernel: [37188.600779] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 15:43:34 juju-e4d256-prod-github-runner-207 kernel: [37188.601707] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 15:43:34 juju-e4d256-prod-github-runner-207 kernel: [37188.602620] vcpu_run+0x62/0x2c0 [kvm] Aug 22 15:43:34 juju-e4d256-prod-github-runner-207 kernel: [37188.603447] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 15:43:34 juju-e4d256-prod-github-runner-207 kernel: [37188.604256] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 15:43:34 juju-e4d256-prod-github-runner-207 kernel: [37188.605128] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 15:43:34 juju-e4d256-prod-github-runner-207 kernel: [37188.605929] ? __seccomp_filter+0x4a/0x4a0 Aug 22 15:43:34 juju-e4d256-prod-github-runner-207 kernel: [37188.606678] ? __fget_files+0x86/0xc0 Aug 22 15:43:34 juju-e4d256-prod-github-runner-207 kernel: [37188.607393] __x64_sys_ioctl+0x95/0xd0 Aug 22 15:43:34 juju-e4d256-prod-github-runner-207 kernel: [37188.608090] do_syscall_64+0x5c/0xc0 Aug 22 15:43:34 juju-e4d256-prod-github-runner-207 kernel: [37188.608772] ? do_futex+0x162/0x1f0 Aug 22 15:43:34 juju-e4d256-prod-github-runner-207 kernel: [37188.609427] ? __x64_sys_futex+0x78/0x1e0 Aug 22 15:43:34 juju-e4d256-prod-github-runner-207 kernel: [37188.610100] ? __secure_computing+0xa9/0x120 Aug 22 15:43:34 juju-e4d256-prod-github-runner-207 kernel: [37188.610791] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 15:43:34 juju-e4d256-prod-github-runner-207 kernel: [37188.611555] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:43:34 juju-e4d256-prod-github-runner-207 kernel: [37188.612291] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:43:34 juju-e4d256-prod-github-runner-207 kernel: [37188.613023] ? do_syscall_64+0x69/0xc0 Aug 22 15:43:34 juju-e4d256-prod-github-runner-207 kernel: [37188.613679] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:43:34 juju-e4d256-prod-github-runner-207 kernel: [37188.614383] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:43:34 juju-e4d256-prod-github-runner-207 kernel: [37188.615078] ? do_syscall_64+0x69/0xc0 Aug 22 15:43:34 juju-e4d256-prod-github-runner-207 kernel: [37188.615707] ? do_syscall_64+0x69/0xc0 Aug 22 15:43:34 juju-e4d256-prod-github-runner-207 kernel: [37188.616335] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 15:43:34 juju-e4d256-prod-github-runner-207 kernel: [37188.617056] RIP: 0033:0x7faa5d0edaff Aug 22 15:43:34 juju-e4d256-prod-github-runner-207 kernel: [37188.617706] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 15:43:34 juju-e4d256-prod-github-runner-207 kernel: [37188.619703] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 15:43:34 juju-e4d256-prod-github-runner-207 kernel: [37188.620627] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 15:43:34 juju-e4d256-prod-github-runner-207 kernel: [37188.621545] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 15:43:34 juju-e4d256-prod-github-runner-207 kernel: [37188.622467] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 15:43:34 juju-e4d256-prod-github-runner-207 kernel: [37188.623361] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 15:43:34 juju-e4d256-prod-github-runner-207 kernel: [37188.624258] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 15:43:34 juju-e4d256-prod-github-runner-207 kernel: [37188.625165] Aug 22 15:44:02 juju-e4d256-prod-github-runner-207 kernel: [37216.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 34552s! [qemu-system-x86:6715] Aug 22 15:44:02 juju-e4d256-prod-github-runner-207 kernel: [37216.543082] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 15:44:02 juju-e4d256-prod-github-runner-207 kernel: [37216.543150] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 15:44:02 juju-e4d256-prod-github-runner-207 kernel: [37216.555225] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 15:44:02 juju-e4d256-prod-github-runner-207 kernel: [37216.556500] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 15:44:02 juju-e4d256-prod-github-runner-207 kernel: [37216.557721] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:44:02 juju-e4d256-prod-github-runner-207 kernel: [37216.558802] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 15:44:02 juju-e4d256-prod-github-runner-207 kernel: [37216.561352] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 15:44:02 juju-e4d256-prod-github-runner-207 kernel: [37216.562399] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 15:44:02 juju-e4d256-prod-github-runner-207 kernel: [37216.563558] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 15:44:02 juju-e4d256-prod-github-runner-207 kernel: [37216.564729] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 15:44:02 juju-e4d256-prod-github-runner-207 kernel: [37216.565887] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 15:44:02 juju-e4d256-prod-github-runner-207 kernel: [37216.567046] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 15:44:02 juju-e4d256-prod-github-runner-207 kernel: [37216.568214] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 15:44:02 juju-e4d256-prod-github-runner-207 kernel: [37216.569458] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 15:44:02 juju-e4d256-prod-github-runner-207 kernel: [37216.570556] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 15:44:02 juju-e4d256-prod-github-runner-207 kernel: [37216.571746] Call Trace: Aug 22 15:44:02 juju-e4d256-prod-github-runner-207 kernel: [37216.572665] Aug 22 15:44:02 juju-e4d256-prod-github-runner-207 kernel: [37216.573551] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:44:02 juju-e4d256-prod-github-runner-207 kernel: [37216.574582] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:44:02 juju-e4d256-prod-github-runner-207 kernel: [37216.575602] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:44:02 juju-e4d256-prod-github-runner-207 kernel: [37216.576683] ? show_regs.part.0+0x23/0x29 Aug 22 15:44:02 juju-e4d256-prod-github-runner-207 kernel: [37216.577682] ? show_regs.cold+0x8/0xd Aug 22 15:44:02 juju-e4d256-prod-github-runner-207 kernel: [37216.578655] ? watchdog_timer_fn+0x1be/0x220 Aug 22 15:44:02 juju-e4d256-prod-github-runner-207 kernel: [37216.579663] ? lockup_detector_update_enable+0x60/0x60 Aug 22 15:44:02 juju-e4d256-prod-github-runner-207 kernel: [37216.580737] ? __hrtimer_run_queues+0x107/0x230 Aug 22 15:44:02 juju-e4d256-prod-github-runner-207 kernel: [37216.581763] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 15:44:02 juju-e4d256-prod-github-runner-207 kernel: [37216.582785] ? hrtimer_interrupt+0x101/0x220 Aug 22 15:44:02 juju-e4d256-prod-github-runner-207 kernel: [37216.583801] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 15:44:02 juju-e4d256-prod-github-runner-207 kernel: [37216.587001] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 15:44:02 juju-e4d256-prod-github-runner-207 kernel: [37216.588061] Aug 22 15:44:02 juju-e4d256-prod-github-runner-207 kernel: [37216.591032] Aug 22 15:44:02 juju-e4d256-prod-github-runner-207 kernel: [37216.591875] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 15:44:02 juju-e4d256-prod-github-runner-207 kernel: [37216.594453] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:44:02 juju-e4d256-prod-github-runner-207 kernel: [37216.596072] ? _raw_spin_lock+0x22/0x30 Aug 22 15:44:02 juju-e4d256-prod-github-runner-207 kernel: [37216.599144] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:44:02 juju-e4d256-prod-github-runner-207 kernel: [37216.600171] direct_page_fault+0x206/0x310 [kvm] Aug 22 15:44:02 juju-e4d256-prod-github-runner-207 kernel: [37216.603212] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 15:44:02 juju-e4d256-prod-github-runner-207 kernel: [37216.604223] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 15:44:02 juju-e4d256-prod-github-runner-207 kernel: [37216.607336] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 15:44:02 juju-e4d256-prod-github-runner-207 kernel: [37216.609361] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 15:44:02 juju-e4d256-prod-github-runner-207 kernel: [37216.611384] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 15:44:02 juju-e4d256-prod-github-runner-207 kernel: [37216.613359] handle_exit+0x98/0x230 [kvm_amd] Aug 22 15:44:02 juju-e4d256-prod-github-runner-207 kernel: [37216.615287] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 15:44:02 juju-e4d256-prod-github-runner-207 kernel: [37216.616206] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 15:44:02 juju-e4d256-prod-github-runner-207 kernel: [37216.619323] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 15:44:02 juju-e4d256-prod-github-runner-207 kernel: [37216.620233] vcpu_run+0x62/0x2c0 [kvm] Aug 22 15:44:02 juju-e4d256-prod-github-runner-207 kernel: [37216.622140] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 15:44:02 juju-e4d256-prod-github-runner-207 kernel: [37216.624066] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 15:44:02 juju-e4d256-prod-github-runner-207 kernel: [37216.624933] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 15:44:02 juju-e4d256-prod-github-runner-207 kernel: [37216.627879] ? __seccomp_filter+0x4a/0x4a0 Aug 22 15:44:02 juju-e4d256-prod-github-runner-207 kernel: [37216.628655] ? __fget_files+0x86/0xc0 Aug 22 15:44:02 juju-e4d256-prod-github-runner-207 kernel: [37216.629507] __x64_sys_ioctl+0x95/0xd0 Aug 22 15:44:02 juju-e4d256-prod-github-runner-207 kernel: [37216.632245] do_syscall_64+0x5c/0xc0 Aug 22 15:44:02 juju-e4d256-prod-github-runner-207 kernel: [37216.632925] ? do_futex+0x162/0x1f0 Aug 22 15:44:02 juju-e4d256-prod-github-runner-207 kernel: [37216.633575] ? __x64_sys_futex+0x78/0x1e0 Aug 22 15:44:02 juju-e4d256-prod-github-runner-207 kernel: [37216.635816] ? __secure_computing+0xa9/0x120 Aug 22 15:44:02 juju-e4d256-prod-github-runner-207 kernel: [37216.637069] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 15:44:02 juju-e4d256-prod-github-runner-207 kernel: [37216.638052] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:44:02 juju-e4d256-prod-github-runner-207 kernel: [37216.640949] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:44:02 juju-e4d256-prod-github-runner-207 kernel: [37216.641676] ? do_syscall_64+0x69/0xc0 Aug 22 15:44:02 juju-e4d256-prod-github-runner-207 kernel: [37216.642323] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:44:02 juju-e4d256-prod-github-runner-207 kernel: [37216.644533] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:44:02 juju-e4d256-prod-github-runner-207 kernel: [37216.645731] ? do_syscall_64+0x69/0xc0 Aug 22 15:44:02 juju-e4d256-prod-github-runner-207 kernel: [37216.646359] ? do_syscall_64+0x69/0xc0 Aug 22 15:44:02 juju-e4d256-prod-github-runner-207 kernel: [37216.649110] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 15:44:02 juju-e4d256-prod-github-runner-207 kernel: [37216.649835] RIP: 0033:0x7faa5d0edaff Aug 22 15:44:02 juju-e4d256-prod-github-runner-207 kernel: [37216.651007] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 15:44:02 juju-e4d256-prod-github-runner-207 kernel: [37216.656716] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 15:44:02 juju-e4d256-prod-github-runner-207 kernel: [37216.657632] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 15:44:02 juju-e4d256-prod-github-runner-207 kernel: [37216.659480] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 15:44:02 juju-e4d256-prod-github-runner-207 kernel: [37216.661363] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 15:44:02 juju-e4d256-prod-github-runner-207 kernel: [37216.662253] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 15:44:02 juju-e4d256-prod-github-runner-207 kernel: [37216.665267] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 15:44:02 juju-e4d256-prod-github-runner-207 kernel: [37216.666161] Aug 22 15:44:30 juju-e4d256-prod-github-runner-207 kernel: [37244.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 34578s! [qemu-system-x86:6715] Aug 22 15:44:30 juju-e4d256-prod-github-runner-207 kernel: [37244.543276] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 15:44:30 juju-e4d256-prod-github-runner-207 kernel: [37244.543342] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 15:44:30 juju-e4d256-prod-github-runner-207 kernel: [37244.557414] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 15:44:30 juju-e4d256-prod-github-runner-207 kernel: [37244.558867] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 15:44:30 juju-e4d256-prod-github-runner-207 kernel: [37244.560281] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:44:30 juju-e4d256-prod-github-runner-207 kernel: [37244.561457] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 15:44:30 juju-e4d256-prod-github-runner-207 kernel: [37244.564368] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 15:44:30 juju-e4d256-prod-github-runner-207 kernel: [37244.565519] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 15:44:30 juju-e4d256-prod-github-runner-207 kernel: [37244.566822] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 15:44:30 juju-e4d256-prod-github-runner-207 kernel: [37244.568148] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 15:44:30 juju-e4d256-prod-github-runner-207 kernel: [37244.569447] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 15:44:30 juju-e4d256-prod-github-runner-207 kernel: [37244.570740] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 15:44:30 juju-e4d256-prod-github-runner-207 kernel: [37244.572054] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 15:44:30 juju-e4d256-prod-github-runner-207 kernel: [37244.573457] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 15:44:30 juju-e4d256-prod-github-runner-207 kernel: [37244.574664] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 15:44:30 juju-e4d256-prod-github-runner-207 kernel: [37244.576004] Call Trace: Aug 22 15:44:30 juju-e4d256-prod-github-runner-207 kernel: [37244.577001] Aug 22 15:44:30 juju-e4d256-prod-github-runner-207 kernel: [37244.577945] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:44:30 juju-e4d256-prod-github-runner-207 kernel: [37244.579064] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:44:30 juju-e4d256-prod-github-runner-207 kernel: [37244.580194] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:44:30 juju-e4d256-prod-github-runner-207 kernel: [37244.581365] ? show_regs.part.0+0x23/0x29 Aug 22 15:44:30 juju-e4d256-prod-github-runner-207 kernel: [37244.582446] ? show_regs.cold+0x8/0xd Aug 22 15:44:30 juju-e4d256-prod-github-runner-207 kernel: [37244.583527] ? watchdog_timer_fn+0x1be/0x220 Aug 22 15:44:30 juju-e4d256-prod-github-runner-207 kernel: [37244.584647] ? lockup_detector_update_enable+0x60/0x60 Aug 22 15:44:30 juju-e4d256-prod-github-runner-207 kernel: [37244.585827] ? __hrtimer_run_queues+0x107/0x230 Aug 22 15:44:30 juju-e4d256-prod-github-runner-207 kernel: [37244.586948] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 15:44:30 juju-e4d256-prod-github-runner-207 kernel: [37244.588064] ? hrtimer_interrupt+0x101/0x220 Aug 22 15:44:30 juju-e4d256-prod-github-runner-207 kernel: [37244.589384] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 15:44:30 juju-e4d256-prod-github-runner-207 kernel: [37244.590555] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 15:44:30 juju-e4d256-prod-github-runner-207 kernel: [37244.591705] Aug 22 15:44:30 juju-e4d256-prod-github-runner-207 kernel: [37244.592802] Aug 22 15:44:30 juju-e4d256-prod-github-runner-207 kernel: [37244.593691] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 15:44:30 juju-e4d256-prod-github-runner-207 kernel: [37244.594827] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:44:30 juju-e4d256-prod-github-runner-207 kernel: [37244.595965] ? _raw_spin_lock+0x22/0x30 Aug 22 15:44:30 juju-e4d256-prod-github-runner-207 kernel: [37244.597001] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:44:30 juju-e4d256-prod-github-runner-207 kernel: [37244.598110] direct_page_fault+0x206/0x310 [kvm] Aug 22 15:44:30 juju-e4d256-prod-github-runner-207 kernel: [37244.599226] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 15:44:30 juju-e4d256-prod-github-runner-207 kernel: [37244.600347] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 15:44:30 juju-e4d256-prod-github-runner-207 kernel: [37244.601450] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 15:44:30 juju-e4d256-prod-github-runner-207 kernel: [37244.602510] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 15:44:30 juju-e4d256-prod-github-runner-207 kernel: [37244.603549] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 15:44:30 juju-e4d256-prod-github-runner-207 kernel: [37244.604708] handle_exit+0x98/0x230 [kvm_amd] Aug 22 15:44:30 juju-e4d256-prod-github-runner-207 kernel: [37244.605706] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 15:44:30 juju-e4d256-prod-github-runner-207 kernel: [37244.606719] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 15:44:30 juju-e4d256-prod-github-runner-207 kernel: [37244.607744] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 15:44:30 juju-e4d256-prod-github-runner-207 kernel: [37244.608774] vcpu_run+0x62/0x2c0 [kvm] Aug 22 15:44:30 juju-e4d256-prod-github-runner-207 kernel: [37244.609663] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 15:44:30 juju-e4d256-prod-github-runner-207 kernel: [37244.610579] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 15:44:30 juju-e4d256-prod-github-runner-207 kernel: [37244.611527] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 15:44:30 juju-e4d256-prod-github-runner-207 kernel: [37244.612426] ? __seccomp_filter+0x4a/0x4a0 Aug 22 15:44:30 juju-e4d256-prod-github-runner-207 kernel: [37244.613260] ? __fget_files+0x86/0xc0 Aug 22 15:44:30 juju-e4d256-prod-github-runner-207 kernel: [37244.614042] __x64_sys_ioctl+0x95/0xd0 Aug 22 15:44:30 juju-e4d256-prod-github-runner-207 kernel: [37244.614811] do_syscall_64+0x5c/0xc0 Aug 22 15:44:30 juju-e4d256-prod-github-runner-207 kernel: [37244.615560] ? do_futex+0x162/0x1f0 Aug 22 15:44:30 juju-e4d256-prod-github-runner-207 kernel: [37244.616329] ? __x64_sys_futex+0x78/0x1e0 Aug 22 15:44:30 juju-e4d256-prod-github-runner-207 kernel: [37244.617094] ? __secure_computing+0xa9/0x120 Aug 22 15:44:30 juju-e4d256-prod-github-runner-207 kernel: [37244.617870] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 15:44:30 juju-e4d256-prod-github-runner-207 kernel: [37244.618728] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:44:30 juju-e4d256-prod-github-runner-207 kernel: [37244.619537] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:44:30 juju-e4d256-prod-github-runner-207 kernel: [37244.620394] ? do_syscall_64+0x69/0xc0 Aug 22 15:44:30 juju-e4d256-prod-github-runner-207 kernel: [37244.621125] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:44:30 juju-e4d256-prod-github-runner-207 kernel: [37244.621924] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:44:30 juju-e4d256-prod-github-runner-207 kernel: [37244.622708] ? do_syscall_64+0x69/0xc0 Aug 22 15:44:30 juju-e4d256-prod-github-runner-207 kernel: [37244.623411] ? do_syscall_64+0x69/0xc0 Aug 22 15:44:30 juju-e4d256-prod-github-runner-207 kernel: [37244.624130] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 15:44:30 juju-e4d256-prod-github-runner-207 kernel: [37244.624940] RIP: 0033:0x7faa5d0edaff Aug 22 15:44:30 juju-e4d256-prod-github-runner-207 kernel: [37244.625637] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 15:44:30 juju-e4d256-prod-github-runner-207 kernel: [37244.627964] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 15:44:30 juju-e4d256-prod-github-runner-207 kernel: [37244.629044] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 15:44:30 juju-e4d256-prod-github-runner-207 kernel: [37244.630067] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 15:44:30 juju-e4d256-prod-github-runner-207 kernel: [37244.631091] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 15:44:30 juju-e4d256-prod-github-runner-207 kernel: [37244.632136] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 15:44:30 juju-e4d256-prod-github-runner-207 kernel: [37244.633161] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 15:44:30 juju-e4d256-prod-github-runner-207 kernel: [37244.634190] Aug 22 15:44:45 juju-e4d256-prod-github-runner-207 kernel: [37259.672705] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 15:44:45 juju-e4d256-prod-github-runner-207 kernel: [37259.673664] rcu: 1-....: (9256464 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=4473309 Aug 22 15:44:45 juju-e4d256-prod-github-runner-207 kernel: [37259.674778] (t=9285618 jiffies g=23269 q=38787) Aug 22 15:44:45 juju-e4d256-prod-github-runner-207 kernel: [37259.675598] NMI backtrace for cpu 1 Aug 22 15:44:45 juju-e4d256-prod-github-runner-207 kernel: [37259.676329] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 15:44:45 juju-e4d256-prod-github-runner-207 kernel: [37259.677438] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 15:44:45 juju-e4d256-prod-github-runner-207 kernel: [37259.678498] Call Trace: Aug 22 15:44:45 juju-e4d256-prod-github-runner-207 kernel: [37259.679171] Aug 22 15:44:45 juju-e4d256-prod-github-runner-207 kernel: [37259.679814] show_stack+0x52/0x5c Aug 22 15:44:45 juju-e4d256-prod-github-runner-207 kernel: [37259.680551] dump_stack_lvl+0x4a/0x63 Aug 22 15:44:45 juju-e4d256-prod-github-runner-207 kernel: [37259.681295] dump_stack+0x10/0x16 Aug 22 15:44:45 juju-e4d256-prod-github-runner-207 kernel: [37259.682011] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 15:44:45 juju-e4d256-prod-github-runner-207 kernel: [37259.682793] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 15:44:45 juju-e4d256-prod-github-runner-207 kernel: [37259.683569] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 15:44:45 juju-e4d256-prod-github-runner-207 kernel: [37259.684409] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 15:44:45 juju-e4d256-prod-github-runner-207 kernel: [37259.685229] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 15:44:45 juju-e4d256-prod-github-runner-207 kernel: [37259.686066] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 15:44:45 juju-e4d256-prod-github-runner-207 kernel: [37259.686911] print_cpu_stall.cold+0x2f/0xe2 Aug 22 15:44:45 juju-e4d256-prod-github-runner-207 kernel: [37259.687673] ? timekeeping_update+0xf7/0x150 Aug 22 15:44:45 juju-e4d256-prod-github-runner-207 kernel: [37259.688461] check_cpu_stall+0x109/0x270 Aug 22 15:44:45 juju-e4d256-prod-github-runner-207 kernel: [37259.689203] rcu_sched_clock_irq+0x9a/0x250 Aug 22 15:44:45 juju-e4d256-prod-github-runner-207 kernel: [37259.689959] update_process_times+0x94/0xd0 Aug 22 15:44:45 juju-e4d256-prod-github-runner-207 kernel: [37259.690713] tick_sched_handle+0x29/0x70 Aug 22 15:44:45 juju-e4d256-prod-github-runner-207 kernel: [37259.691454] tick_sched_timer+0x8c/0xc0 Aug 22 15:44:45 juju-e4d256-prod-github-runner-207 kernel: [37259.692196] ? tick_nohz_handler+0xb0/0xb0 Aug 22 15:44:45 juju-e4d256-prod-github-runner-207 kernel: [37259.692952] __hrtimer_run_queues+0x107/0x230 Aug 22 15:44:45 juju-e4d256-prod-github-runner-207 kernel: [37259.693723] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 15:44:45 juju-e4d256-prod-github-runner-207 kernel: [37259.694508] hrtimer_interrupt+0x101/0x220 Aug 22 15:44:45 juju-e4d256-prod-github-runner-207 kernel: [37259.695278] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 15:44:45 juju-e4d256-prod-github-runner-207 kernel: [37259.696109] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 15:44:45 juju-e4d256-prod-github-runner-207 kernel: [37259.696907] Aug 22 15:44:45 juju-e4d256-prod-github-runner-207 kernel: [37259.697540] Aug 22 15:44:45 juju-e4d256-prod-github-runner-207 kernel: [37259.698170] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 15:44:45 juju-e4d256-prod-github-runner-207 kernel: [37259.698983] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:44:45 juju-e4d256-prod-github-runner-207 kernel: [37259.699856] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 15:44:45 juju-e4d256-prod-github-runner-207 kernel: [37259.702056] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 15:44:45 juju-e4d256-prod-github-runner-207 kernel: [37259.702923] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 15:44:45 juju-e4d256-prod-github-runner-207 kernel: [37259.703912] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 15:44:45 juju-e4d256-prod-github-runner-207 kernel: [37259.704901] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 15:44:45 juju-e4d256-prod-github-runner-207 kernel: [37259.705861] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 15:44:45 juju-e4d256-prod-github-runner-207 kernel: [37259.706809] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 15:44:45 juju-e4d256-prod-github-runner-207 kernel: [37259.707756] ? _raw_spin_lock+0x22/0x30 Aug 22 15:44:45 juju-e4d256-prod-github-runner-207 kernel: [37259.708517] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:44:45 juju-e4d256-prod-github-runner-207 kernel: [37259.709351] direct_page_fault+0x206/0x310 [kvm] Aug 22 15:44:45 juju-e4d256-prod-github-runner-207 kernel: [37259.710183] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 15:44:45 juju-e4d256-prod-github-runner-207 kernel: [37259.711007] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 15:44:45 juju-e4d256-prod-github-runner-207 kernel: [37259.711825] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 15:44:45 juju-e4d256-prod-github-runner-207 kernel: [37259.712641] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 15:44:45 juju-e4d256-prod-github-runner-207 kernel: [37259.713427] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 15:44:45 juju-e4d256-prod-github-runner-207 kernel: [37259.714244] handle_exit+0x98/0x230 [kvm_amd] Aug 22 15:44:45 juju-e4d256-prod-github-runner-207 kernel: [37259.714997] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 15:44:45 juju-e4d256-prod-github-runner-207 kernel: [37259.715777] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 15:44:45 juju-e4d256-prod-github-runner-207 kernel: [37259.716714] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 15:44:45 juju-e4d256-prod-github-runner-207 kernel: [37259.717507] vcpu_run+0x62/0x2c0 [kvm] Aug 22 15:44:45 juju-e4d256-prod-github-runner-207 kernel: [37259.718221] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 15:44:45 juju-e4d256-prod-github-runner-207 kernel: [37259.718951] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 15:44:45 juju-e4d256-prod-github-runner-207 kernel: [37259.719771] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 15:44:45 juju-e4d256-prod-github-runner-207 kernel: [37259.720546] ? __seccomp_filter+0x4a/0x4a0 Aug 22 15:44:45 juju-e4d256-prod-github-runner-207 kernel: [37259.721266] ? __fget_files+0x86/0xc0 Aug 22 15:44:45 juju-e4d256-prod-github-runner-207 kernel: [37259.721953] __x64_sys_ioctl+0x95/0xd0 Aug 22 15:44:45 juju-e4d256-prod-github-runner-207 kernel: [37259.722642] do_syscall_64+0x5c/0xc0 Aug 22 15:44:45 juju-e4d256-prod-github-runner-207 kernel: [37259.723318] ? do_futex+0x162/0x1f0 Aug 22 15:44:45 juju-e4d256-prod-github-runner-207 kernel: [37259.724012] ? __x64_sys_futex+0x78/0x1e0 Aug 22 15:44:45 juju-e4d256-prod-github-runner-207 kernel: [37259.724734] ? __secure_computing+0xa9/0x120 Aug 22 15:44:45 juju-e4d256-prod-github-runner-207 kernel: [37259.725544] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 15:44:45 juju-e4d256-prod-github-runner-207 kernel: [37259.726330] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:44:45 juju-e4d256-prod-github-runner-207 kernel: [37259.727085] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:44:45 juju-e4d256-prod-github-runner-207 kernel: [37259.727833] ? do_syscall_64+0x69/0xc0 Aug 22 15:44:45 juju-e4d256-prod-github-runner-207 kernel: [37259.728540] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:44:45 juju-e4d256-prod-github-runner-207 kernel: [37259.729291] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:44:45 juju-e4d256-prod-github-runner-207 kernel: [37259.730042] ? do_syscall_64+0x69/0xc0 Aug 22 15:44:45 juju-e4d256-prod-github-runner-207 kernel: [37259.730731] ? do_syscall_64+0x69/0xc0 Aug 22 15:44:45 juju-e4d256-prod-github-runner-207 kernel: [37259.731420] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 15:44:45 juju-e4d256-prod-github-runner-207 kernel: [37259.732192] RIP: 0033:0x7faa5d0edaff Aug 22 15:44:45 juju-e4d256-prod-github-runner-207 kernel: [37259.732871] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 15:44:45 juju-e4d256-prod-github-runner-207 kernel: [37259.734964] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 15:44:45 juju-e4d256-prod-github-runner-207 kernel: [37259.735938] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 15:44:45 juju-e4d256-prod-github-runner-207 kernel: [37259.736880] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 15:44:45 juju-e4d256-prod-github-runner-207 kernel: [37259.737820] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 15:44:45 juju-e4d256-prod-github-runner-207 kernel: [37259.738755] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 15:44:45 juju-e4d256-prod-github-runner-207 kernel: [37259.739676] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 15:44:45 juju-e4d256-prod-github-runner-207 kernel: [37259.740749] Aug 22 15:45:10 juju-e4d256-prod-github-runner-207 kernel: [37284.541981] watchdog: BUG: soft lockup - CPU#1 stuck for 34615s! [qemu-system-x86:6715] Aug 22 15:45:10 juju-e4d256-prod-github-runner-207 kernel: [37284.543732] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 15:45:10 juju-e4d256-prod-github-runner-207 kernel: [37284.543991] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 15:45:10 juju-e4d256-prod-github-runner-207 kernel: [37284.556075] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 15:45:10 juju-e4d256-prod-github-runner-207 kernel: [37284.557342] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 15:45:10 juju-e4d256-prod-github-runner-207 kernel: [37284.558559] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:45:10 juju-e4d256-prod-github-runner-207 kernel: [37284.559617] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 15:45:10 juju-e4d256-prod-github-runner-207 kernel: [37284.562185] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 15:45:10 juju-e4d256-prod-github-runner-207 kernel: [37284.563240] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 15:45:10 juju-e4d256-prod-github-runner-207 kernel: [37284.564428] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 15:45:10 juju-e4d256-prod-github-runner-207 kernel: [37284.565583] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 15:45:10 juju-e4d256-prod-github-runner-207 kernel: [37284.566738] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 15:45:10 juju-e4d256-prod-github-runner-207 kernel: [37284.567914] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 15:45:10 juju-e4d256-prod-github-runner-207 kernel: [37284.569079] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 15:45:10 juju-e4d256-prod-github-runner-207 kernel: [37284.570314] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 15:45:10 juju-e4d256-prod-github-runner-207 kernel: [37284.571426] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 15:45:10 juju-e4d256-prod-github-runner-207 kernel: [37284.572649] Call Trace: Aug 22 15:45:10 juju-e4d256-prod-github-runner-207 kernel: [37284.573567] Aug 22 15:45:10 juju-e4d256-prod-github-runner-207 kernel: [37284.574460] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:45:10 juju-e4d256-prod-github-runner-207 kernel: [37284.575487] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:45:10 juju-e4d256-prod-github-runner-207 kernel: [37284.576526] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:45:10 juju-e4d256-prod-github-runner-207 kernel: [37284.577616] ? show_regs.part.0+0x23/0x29 Aug 22 15:45:10 juju-e4d256-prod-github-runner-207 kernel: [37284.578614] ? show_regs.cold+0x8/0xd Aug 22 15:45:10 juju-e4d256-prod-github-runner-207 kernel: [37284.579589] ? watchdog_timer_fn+0x1be/0x220 Aug 22 15:45:10 juju-e4d256-prod-github-runner-207 kernel: [37284.580617] ? lockup_detector_update_enable+0x60/0x60 Aug 22 15:45:10 juju-e4d256-prod-github-runner-207 kernel: [37284.581686] ? __hrtimer_run_queues+0x107/0x230 Aug 22 15:45:10 juju-e4d256-prod-github-runner-207 kernel: [37284.582718] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 15:45:10 juju-e4d256-prod-github-runner-207 kernel: [37284.583766] ? hrtimer_interrupt+0x101/0x220 Aug 22 15:45:10 juju-e4d256-prod-github-runner-207 kernel: [37284.584786] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 15:45:10 juju-e4d256-prod-github-runner-207 kernel: [37284.585855] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 15:45:10 juju-e4d256-prod-github-runner-207 kernel: [37284.586899] Aug 22 15:45:10 juju-e4d256-prod-github-runner-207 kernel: [37284.587773] Aug 22 15:45:10 juju-e4d256-prod-github-runner-207 kernel: [37284.588612] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 15:45:10 juju-e4d256-prod-github-runner-207 kernel: [37284.589645] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:45:10 juju-e4d256-prod-github-runner-207 kernel: [37284.590687] ? _raw_spin_lock+0x22/0x30 Aug 22 15:45:10 juju-e4d256-prod-github-runner-207 kernel: [37284.591662] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:45:10 juju-e4d256-prod-github-runner-207 kernel: [37284.592687] direct_page_fault+0x206/0x310 [kvm] Aug 22 15:45:10 juju-e4d256-prod-github-runner-207 kernel: [37284.593711] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 15:45:10 juju-e4d256-prod-github-runner-207 kernel: [37284.594721] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 15:45:10 juju-e4d256-prod-github-runner-207 kernel: [37284.595737] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 15:45:10 juju-e4d256-prod-github-runner-207 kernel: [37284.596727] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 15:45:10 juju-e4d256-prod-github-runner-207 kernel: [37284.597671] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 15:45:10 juju-e4d256-prod-github-runner-207 kernel: [37284.598655] handle_exit+0x98/0x230 [kvm_amd] Aug 22 15:45:10 juju-e4d256-prod-github-runner-207 kernel: [37284.599545] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 15:45:10 juju-e4d256-prod-github-runner-207 kernel: [37284.600482] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 15:45:10 juju-e4d256-prod-github-runner-207 kernel: [37284.601416] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 15:45:10 juju-e4d256-prod-github-runner-207 kernel: [37284.602327] vcpu_run+0x62/0x2c0 [kvm] Aug 22 15:45:10 juju-e4d256-prod-github-runner-207 kernel: [37284.603139] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 15:45:10 juju-e4d256-prod-github-runner-207 kernel: [37284.603972] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 15:45:10 juju-e4d256-prod-github-runner-207 kernel: [37284.604826] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 15:45:10 juju-e4d256-prod-github-runner-207 kernel: [37284.605621] ? __seccomp_filter+0x4a/0x4a0 Aug 22 15:45:10 juju-e4d256-prod-github-runner-207 kernel: [37284.606367] ? __fget_files+0x86/0xc0 Aug 22 15:45:10 juju-e4d256-prod-github-runner-207 kernel: [37284.607069] __x64_sys_ioctl+0x95/0xd0 Aug 22 15:45:10 juju-e4d256-prod-github-runner-207 kernel: [37284.607779] do_syscall_64+0x5c/0xc0 Aug 22 15:45:10 juju-e4d256-prod-github-runner-207 kernel: [37284.608443] ? do_futex+0x162/0x1f0 Aug 22 15:45:10 juju-e4d256-prod-github-runner-207 kernel: [37284.609090] ? __x64_sys_futex+0x78/0x1e0 Aug 22 15:45:10 juju-e4d256-prod-github-runner-207 kernel: [37284.609768] ? __secure_computing+0xa9/0x120 Aug 22 15:45:10 juju-e4d256-prod-github-runner-207 kernel: [37284.610454] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 15:45:10 juju-e4d256-prod-github-runner-207 kernel: [37284.611212] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:45:10 juju-e4d256-prod-github-runner-207 kernel: [37284.611944] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:45:10 juju-e4d256-prod-github-runner-207 kernel: [37284.612660] ? do_syscall_64+0x69/0xc0 Aug 22 15:45:10 juju-e4d256-prod-github-runner-207 kernel: [37284.613310] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:45:10 juju-e4d256-prod-github-runner-207 kernel: [37284.614011] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:45:10 juju-e4d256-prod-github-runner-207 kernel: [37284.614713] ? do_syscall_64+0x69/0xc0 Aug 22 15:45:10 juju-e4d256-prod-github-runner-207 kernel: [37284.615340] ? do_syscall_64+0x69/0xc0 Aug 22 15:45:10 juju-e4d256-prod-github-runner-207 kernel: [37284.615974] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 15:45:10 juju-e4d256-prod-github-runner-207 kernel: [37284.616683] RIP: 0033:0x7faa5d0edaff Aug 22 15:45:10 juju-e4d256-prod-github-runner-207 kernel: [37284.617320] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 15:45:10 juju-e4d256-prod-github-runner-207 kernel: [37284.619303] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 15:45:10 juju-e4d256-prod-github-runner-207 kernel: [37284.620231] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 15:45:10 juju-e4d256-prod-github-runner-207 kernel: [37284.621119] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 15:45:10 juju-e4d256-prod-github-runner-207 kernel: [37284.622018] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 15:45:10 juju-e4d256-prod-github-runner-207 kernel: [37284.622910] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 15:45:10 juju-e4d256-prod-github-runner-207 kernel: [37284.623815] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 15:45:10 juju-e4d256-prod-github-runner-207 kernel: [37284.624705] Aug 22 15:45:38 juju-e4d256-prod-github-runner-207 kernel: [37312.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 34642s! [qemu-system-x86:6715] Aug 22 15:45:38 juju-e4d256-prod-github-runner-207 kernel: [37312.543115] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 15:45:38 juju-e4d256-prod-github-runner-207 kernel: [37312.543186] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 15:45:38 juju-e4d256-prod-github-runner-207 kernel: [37312.555657] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 15:45:38 juju-e4d256-prod-github-runner-207 kernel: [37312.556943] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 15:45:38 juju-e4d256-prod-github-runner-207 kernel: [37312.558168] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:45:38 juju-e4d256-prod-github-runner-207 kernel: [37312.559230] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 15:45:38 juju-e4d256-prod-github-runner-207 kernel: [37312.561802] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 15:45:38 juju-e4d256-prod-github-runner-207 kernel: [37312.562845] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 15:45:38 juju-e4d256-prod-github-runner-207 kernel: [37312.564054] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 15:45:38 juju-e4d256-prod-github-runner-207 kernel: [37312.565228] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 15:45:38 juju-e4d256-prod-github-runner-207 kernel: [37312.566386] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 15:45:38 juju-e4d256-prod-github-runner-207 kernel: [37312.567562] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 15:45:38 juju-e4d256-prod-github-runner-207 kernel: [37312.568748] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 15:45:38 juju-e4d256-prod-github-runner-207 kernel: [37312.569986] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 15:45:38 juju-e4d256-prod-github-runner-207 kernel: [37312.571080] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 15:45:38 juju-e4d256-prod-github-runner-207 kernel: [37312.572289] Call Trace: Aug 22 15:45:38 juju-e4d256-prod-github-runner-207 kernel: [37312.573200] Aug 22 15:45:38 juju-e4d256-prod-github-runner-207 kernel: [37312.574090] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:45:38 juju-e4d256-prod-github-runner-207 kernel: [37312.575121] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:45:38 juju-e4d256-prod-github-runner-207 kernel: [37312.576162] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:45:38 juju-e4d256-prod-github-runner-207 kernel: [37312.577241] ? show_regs.part.0+0x23/0x29 Aug 22 15:45:38 juju-e4d256-prod-github-runner-207 kernel: [37312.578238] ? show_regs.cold+0x8/0xd Aug 22 15:45:38 juju-e4d256-prod-github-runner-207 kernel: [37312.579217] ? watchdog_timer_fn+0x1be/0x220 Aug 22 15:45:38 juju-e4d256-prod-github-runner-207 kernel: [37312.580242] ? lockup_detector_update_enable+0x60/0x60 Aug 22 15:45:38 juju-e4d256-prod-github-runner-207 kernel: [37312.581305] ? __hrtimer_run_queues+0x107/0x230 Aug 22 15:45:38 juju-e4d256-prod-github-runner-207 kernel: [37312.582334] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 15:45:38 juju-e4d256-prod-github-runner-207 kernel: [37312.583379] ? hrtimer_interrupt+0x101/0x220 Aug 22 15:45:38 juju-e4d256-prod-github-runner-207 kernel: [37312.584403] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 15:45:38 juju-e4d256-prod-github-runner-207 kernel: [37312.585475] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 15:45:38 juju-e4d256-prod-github-runner-207 kernel: [37312.586521] Aug 22 15:45:38 juju-e4d256-prod-github-runner-207 kernel: [37312.587387] Aug 22 15:45:38 juju-e4d256-prod-github-runner-207 kernel: [37312.588225] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 15:45:38 juju-e4d256-prod-github-runner-207 kernel: [37312.589276] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:45:38 juju-e4d256-prod-github-runner-207 kernel: [37312.590316] ? _raw_spin_lock+0x22/0x30 Aug 22 15:45:38 juju-e4d256-prod-github-runner-207 kernel: [37312.591260] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:45:38 juju-e4d256-prod-github-runner-207 kernel: [37312.592289] direct_page_fault+0x206/0x310 [kvm] Aug 22 15:45:38 juju-e4d256-prod-github-runner-207 kernel: [37312.593324] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 15:45:38 juju-e4d256-prod-github-runner-207 kernel: [37312.594357] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 15:45:38 juju-e4d256-prod-github-runner-207 kernel: [37312.595392] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 15:45:38 juju-e4d256-prod-github-runner-207 kernel: [37312.596367] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 15:45:38 juju-e4d256-prod-github-runner-207 kernel: [37312.597311] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 15:45:38 juju-e4d256-prod-github-runner-207 kernel: [37312.598287] handle_exit+0x98/0x230 [kvm_amd] Aug 22 15:45:38 juju-e4d256-prod-github-runner-207 kernel: [37312.599178] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 15:45:38 juju-e4d256-prod-github-runner-207 kernel: [37312.600115] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 15:45:38 juju-e4d256-prod-github-runner-207 kernel: [37312.601040] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 15:45:38 juju-e4d256-prod-github-runner-207 kernel: [37312.601943] vcpu_run+0x62/0x2c0 [kvm] Aug 22 15:45:38 juju-e4d256-prod-github-runner-207 kernel: [37312.602755] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 15:45:38 juju-e4d256-prod-github-runner-207 kernel: [37312.603585] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 15:45:38 juju-e4d256-prod-github-runner-207 kernel: [37312.604451] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 15:45:38 juju-e4d256-prod-github-runner-207 kernel: [37312.605257] ? __seccomp_filter+0x4a/0x4a0 Aug 22 15:45:38 juju-e4d256-prod-github-runner-207 kernel: [37312.605999] ? __fget_files+0x86/0xc0 Aug 22 15:45:38 juju-e4d256-prod-github-runner-207 kernel: [37312.606702] __x64_sys_ioctl+0x95/0xd0 Aug 22 15:45:38 juju-e4d256-prod-github-runner-207 kernel: [37312.607409] do_syscall_64+0x5c/0xc0 Aug 22 15:45:38 juju-e4d256-prod-github-runner-207 kernel: [37312.608075] ? do_futex+0x162/0x1f0 Aug 22 15:45:38 juju-e4d256-prod-github-runner-207 kernel: [37312.608724] ? __x64_sys_futex+0x78/0x1e0 Aug 22 15:45:38 juju-e4d256-prod-github-runner-207 kernel: [37312.609397] ? __secure_computing+0xa9/0x120 Aug 22 15:45:38 juju-e4d256-prod-github-runner-207 kernel: [37312.610093] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 15:45:38 juju-e4d256-prod-github-runner-207 kernel: [37312.610861] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:45:38 juju-e4d256-prod-github-runner-207 kernel: [37312.611603] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:45:38 juju-e4d256-prod-github-runner-207 kernel: [37312.612322] ? do_syscall_64+0x69/0xc0 Aug 22 15:45:38 juju-e4d256-prod-github-runner-207 kernel: [37312.612967] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:45:38 juju-e4d256-prod-github-runner-207 kernel: [37312.613672] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:45:38 juju-e4d256-prod-github-runner-207 kernel: [37312.614368] ? do_syscall_64+0x69/0xc0 Aug 22 15:45:38 juju-e4d256-prod-github-runner-207 kernel: [37312.615005] ? do_syscall_64+0x69/0xc0 Aug 22 15:45:38 juju-e4d256-prod-github-runner-207 kernel: [37312.615672] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 15:45:38 juju-e4d256-prod-github-runner-207 kernel: [37312.616380] RIP: 0033:0x7faa5d0edaff Aug 22 15:45:38 juju-e4d256-prod-github-runner-207 kernel: [37312.617022] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 15:45:38 juju-e4d256-prod-github-runner-207 kernel: [37312.619054] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 15:45:38 juju-e4d256-prod-github-runner-207 kernel: [37312.619987] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 15:45:38 juju-e4d256-prod-github-runner-207 kernel: [37312.620890] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 15:45:38 juju-e4d256-prod-github-runner-207 kernel: [37312.621777] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 15:45:38 juju-e4d256-prod-github-runner-207 kernel: [37312.622663] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 15:45:38 juju-e4d256-prod-github-runner-207 kernel: [37312.623591] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 15:45:38 juju-e4d256-prod-github-runner-207 kernel: [37312.624494] Aug 22 15:46:06 juju-e4d256-prod-github-runner-207 kernel: [37340.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 34668s! [qemu-system-x86:6715] Aug 22 15:46:06 juju-e4d256-prod-github-runner-207 kernel: [37340.543127] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 15:46:06 juju-e4d256-prod-github-runner-207 kernel: [37340.543198] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 15:46:06 juju-e4d256-prod-github-runner-207 kernel: [37340.555315] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 15:46:06 juju-e4d256-prod-github-runner-207 kernel: [37340.556602] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 15:46:06 juju-e4d256-prod-github-runner-207 kernel: [37340.557867] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:46:06 juju-e4d256-prod-github-runner-207 kernel: [37340.558947] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 15:46:06 juju-e4d256-prod-github-runner-207 kernel: [37340.561543] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 15:46:06 juju-e4d256-prod-github-runner-207 kernel: [37340.562700] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 15:46:06 juju-e4d256-prod-github-runner-207 kernel: [37340.563916] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 15:46:06 juju-e4d256-prod-github-runner-207 kernel: [37340.565239] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 15:46:06 juju-e4d256-prod-github-runner-207 kernel: [37340.566441] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 15:46:06 juju-e4d256-prod-github-runner-207 kernel: [37340.567639] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 15:46:06 juju-e4d256-prod-github-runner-207 kernel: [37340.568819] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 15:46:06 juju-e4d256-prod-github-runner-207 kernel: [37340.570078] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 15:46:06 juju-e4d256-prod-github-runner-207 kernel: [37340.571231] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 15:46:06 juju-e4d256-prod-github-runner-207 kernel: [37340.572434] Call Trace: Aug 22 15:46:06 juju-e4d256-prod-github-runner-207 kernel: [37340.573463] Aug 22 15:46:06 juju-e4d256-prod-github-runner-207 kernel: [37340.574447] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:46:06 juju-e4d256-prod-github-runner-207 kernel: [37340.575620] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:46:06 juju-e4d256-prod-github-runner-207 kernel: [37340.576750] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:46:06 juju-e4d256-prod-github-runner-207 kernel: [37340.577922] ? show_regs.part.0+0x23/0x29 Aug 22 15:46:06 juju-e4d256-prod-github-runner-207 kernel: [37340.579026] ? show_regs.cold+0x8/0xd Aug 22 15:46:06 juju-e4d256-prod-github-runner-207 kernel: [37340.580109] ? watchdog_timer_fn+0x1be/0x220 Aug 22 15:46:06 juju-e4d256-prod-github-runner-207 kernel: [37340.581225] ? lockup_detector_update_enable+0x60/0x60 Aug 22 15:46:06 juju-e4d256-prod-github-runner-207 kernel: [37340.582394] ? __hrtimer_run_queues+0x107/0x230 Aug 22 15:46:06 juju-e4d256-prod-github-runner-207 kernel: [37340.583530] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 15:46:06 juju-e4d256-prod-github-runner-207 kernel: [37340.584640] ? hrtimer_interrupt+0x101/0x220 Aug 22 15:46:06 juju-e4d256-prod-github-runner-207 kernel: [37340.585749] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 15:46:06 juju-e4d256-prod-github-runner-207 kernel: [37340.586932] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 15:46:06 juju-e4d256-prod-github-runner-207 kernel: [37340.588087] Aug 22 15:46:06 juju-e4d256-prod-github-runner-207 kernel: [37340.588989] Aug 22 15:46:06 juju-e4d256-prod-github-runner-207 kernel: [37340.589873] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 15:46:06 juju-e4d256-prod-github-runner-207 kernel: [37340.591023] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:46:06 juju-e4d256-prod-github-runner-207 kernel: [37340.592184] ? _raw_spin_lock+0x22/0x30 Aug 22 15:46:06 juju-e4d256-prod-github-runner-207 kernel: [37340.593207] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:46:06 juju-e4d256-prod-github-runner-207 kernel: [37340.594314] direct_page_fault+0x206/0x310 [kvm] Aug 22 15:46:06 juju-e4d256-prod-github-runner-207 kernel: [37340.595454] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 15:46:06 juju-e4d256-prod-github-runner-207 kernel: [37340.596556] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 15:46:06 juju-e4d256-prod-github-runner-207 kernel: [37340.597645] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 15:46:06 juju-e4d256-prod-github-runner-207 kernel: [37340.598708] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 15:46:06 juju-e4d256-prod-github-runner-207 kernel: [37340.599760] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 15:46:06 juju-e4d256-prod-github-runner-207 kernel: [37340.600844] handle_exit+0x98/0x230 [kvm_amd] Aug 22 15:46:06 juju-e4d256-prod-github-runner-207 kernel: [37340.601832] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 15:46:06 juju-e4d256-prod-github-runner-207 kernel: [37340.602848] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 15:46:06 juju-e4d256-prod-github-runner-207 kernel: [37340.603891] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 15:46:06 juju-e4d256-prod-github-runner-207 kernel: [37340.604902] vcpu_run+0x62/0x2c0 [kvm] Aug 22 15:46:06 juju-e4d256-prod-github-runner-207 kernel: [37340.605793] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 15:46:06 juju-e4d256-prod-github-runner-207 kernel: [37340.606695] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 15:46:06 juju-e4d256-prod-github-runner-207 kernel: [37340.607660] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 15:46:06 juju-e4d256-prod-github-runner-207 kernel: [37340.608747] ? __seccomp_filter+0x4a/0x4a0 Aug 22 15:46:06 juju-e4d256-prod-github-runner-207 kernel: [37340.609723] ? __fget_files+0x86/0xc0 Aug 22 15:46:06 juju-e4d256-prod-github-runner-207 kernel: [37340.610504] __x64_sys_ioctl+0x95/0xd0 Aug 22 15:46:06 juju-e4d256-prod-github-runner-207 kernel: [37340.611302] do_syscall_64+0x5c/0xc0 Aug 22 15:46:06 juju-e4d256-prod-github-runner-207 kernel: [37340.612051] ? do_futex+0x162/0x1f0 Aug 22 15:46:06 juju-e4d256-prod-github-runner-207 kernel: [37340.612772] ? __x64_sys_futex+0x78/0x1e0 Aug 22 15:46:06 juju-e4d256-prod-github-runner-207 kernel: [37340.613528] ? __secure_computing+0xa9/0x120 Aug 22 15:46:06 juju-e4d256-prod-github-runner-207 kernel: [37340.614305] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 15:46:06 juju-e4d256-prod-github-runner-207 kernel: [37340.615228] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:46:06 juju-e4d256-prod-github-runner-207 kernel: [37340.616050] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:46:06 juju-e4d256-prod-github-runner-207 kernel: [37340.616872] ? do_syscall_64+0x69/0xc0 Aug 22 15:46:06 juju-e4d256-prod-github-runner-207 kernel: [37340.617595] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:46:06 juju-e4d256-prod-github-runner-207 kernel: [37340.618395] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:46:06 juju-e4d256-prod-github-runner-207 kernel: [37340.619205] ? do_syscall_64+0x69/0xc0 Aug 22 15:46:06 juju-e4d256-prod-github-runner-207 kernel: [37340.619911] ? do_syscall_64+0x69/0xc0 Aug 22 15:46:06 juju-e4d256-prod-github-runner-207 kernel: [37340.620610] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 15:46:06 juju-e4d256-prod-github-runner-207 kernel: [37340.621425] RIP: 0033:0x7faa5d0edaff Aug 22 15:46:06 juju-e4d256-prod-github-runner-207 kernel: [37340.622124] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 15:46:06 juju-e4d256-prod-github-runner-207 kernel: [37340.624461] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 15:46:06 juju-e4d256-prod-github-runner-207 kernel: [37340.625517] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 15:46:06 juju-e4d256-prod-github-runner-207 kernel: [37340.626553] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 15:46:06 juju-e4d256-prod-github-runner-207 kernel: [37340.627599] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 15:46:06 juju-e4d256-prod-github-runner-207 kernel: [37340.628629] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 15:46:06 juju-e4d256-prod-github-runner-207 kernel: [37340.629660] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 15:46:06 juju-e4d256-prod-github-runner-207 kernel: [37340.630699] Aug 22 15:46:34 juju-e4d256-prod-github-runner-207 kernel: [37368.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 34694s! [qemu-system-x86:6715] Aug 22 15:46:34 juju-e4d256-prod-github-runner-207 kernel: [37368.543735] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 15:46:34 juju-e4d256-prod-github-runner-207 kernel: [37368.544017] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 15:46:34 juju-e4d256-prod-github-runner-207 kernel: [37368.556106] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 15:46:34 juju-e4d256-prod-github-runner-207 kernel: [37368.557374] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 15:46:34 juju-e4d256-prod-github-runner-207 kernel: [37368.558599] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:46:34 juju-e4d256-prod-github-runner-207 kernel: [37368.559660] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 15:46:34 juju-e4d256-prod-github-runner-207 kernel: [37368.562208] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 15:46:34 juju-e4d256-prod-github-runner-207 kernel: [37368.563259] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 15:46:34 juju-e4d256-prod-github-runner-207 kernel: [37368.564427] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 15:46:34 juju-e4d256-prod-github-runner-207 kernel: [37368.565591] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 15:46:34 juju-e4d256-prod-github-runner-207 kernel: [37368.566761] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 15:46:34 juju-e4d256-prod-github-runner-207 kernel: [37368.567925] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 15:46:34 juju-e4d256-prod-github-runner-207 kernel: [37368.569104] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 15:46:34 juju-e4d256-prod-github-runner-207 kernel: [37368.570337] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 15:46:34 juju-e4d256-prod-github-runner-207 kernel: [37368.571444] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 15:46:34 juju-e4d256-prod-github-runner-207 kernel: [37368.572634] Call Trace: Aug 22 15:46:34 juju-e4d256-prod-github-runner-207 kernel: [37368.573550] Aug 22 15:46:34 juju-e4d256-prod-github-runner-207 kernel: [37368.574448] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:46:34 juju-e4d256-prod-github-runner-207 kernel: [37368.575484] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:46:34 juju-e4d256-prod-github-runner-207 kernel: [37368.576502] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:46:34 juju-e4d256-prod-github-runner-207 kernel: [37368.577607] ? show_regs.part.0+0x23/0x29 Aug 22 15:46:34 juju-e4d256-prod-github-runner-207 kernel: [37368.578603] ? show_regs.cold+0x8/0xd Aug 22 15:46:34 juju-e4d256-prod-github-runner-207 kernel: [37368.579586] ? watchdog_timer_fn+0x1be/0x220 Aug 22 15:46:34 juju-e4d256-prod-github-runner-207 kernel: [37368.580595] ? lockup_detector_update_enable+0x60/0x60 Aug 22 15:46:34 juju-e4d256-prod-github-runner-207 kernel: [37368.581658] ? __hrtimer_run_queues+0x107/0x230 Aug 22 15:46:34 juju-e4d256-prod-github-runner-207 kernel: [37368.582694] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 15:46:34 juju-e4d256-prod-github-runner-207 kernel: [37368.583719] ? hrtimer_interrupt+0x101/0x220 Aug 22 15:46:34 juju-e4d256-prod-github-runner-207 kernel: [37368.584782] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 15:46:34 juju-e4d256-prod-github-runner-207 kernel: [37368.585848] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 15:46:34 juju-e4d256-prod-github-runner-207 kernel: [37368.586906] Aug 22 15:46:34 juju-e4d256-prod-github-runner-207 kernel: [37368.587759] Aug 22 15:46:34 juju-e4d256-prod-github-runner-207 kernel: [37368.588596] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 15:46:34 juju-e4d256-prod-github-runner-207 kernel: [37368.589628] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:46:34 juju-e4d256-prod-github-runner-207 kernel: [37368.590682] ? _raw_spin_lock+0x22/0x30 Aug 22 15:46:34 juju-e4d256-prod-github-runner-207 kernel: [37368.591626] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:46:34 juju-e4d256-prod-github-runner-207 kernel: [37368.592642] direct_page_fault+0x206/0x310 [kvm] Aug 22 15:46:34 juju-e4d256-prod-github-runner-207 kernel: [37368.593671] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 15:46:34 juju-e4d256-prod-github-runner-207 kernel: [37368.594686] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 15:46:34 juju-e4d256-prod-github-runner-207 kernel: [37368.595687] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 15:46:34 juju-e4d256-prod-github-runner-207 kernel: [37368.596683] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 15:46:34 juju-e4d256-prod-github-runner-207 kernel: [37368.597627] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 15:46:34 juju-e4d256-prod-github-runner-207 kernel: [37368.598602] handle_exit+0x98/0x230 [kvm_amd] Aug 22 15:46:34 juju-e4d256-prod-github-runner-207 kernel: [37368.599507] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 15:46:34 juju-e4d256-prod-github-runner-207 kernel: [37368.600420] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 15:46:34 juju-e4d256-prod-github-runner-207 kernel: [37368.601343] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 15:46:34 juju-e4d256-prod-github-runner-207 kernel: [37368.602247] vcpu_run+0x62/0x2c0 [kvm] Aug 22 15:46:34 juju-e4d256-prod-github-runner-207 kernel: [37368.603069] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 15:46:34 juju-e4d256-prod-github-runner-207 kernel: [37368.603875] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 15:46:34 juju-e4d256-prod-github-runner-207 kernel: [37368.604726] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 15:46:34 juju-e4d256-prod-github-runner-207 kernel: [37368.605528] ? __seccomp_filter+0x4a/0x4a0 Aug 22 15:46:34 juju-e4d256-prod-github-runner-207 kernel: [37368.606273] ? __fget_files+0x86/0xc0 Aug 22 15:46:34 juju-e4d256-prod-github-runner-207 kernel: [37368.606983] __x64_sys_ioctl+0x95/0xd0 Aug 22 15:46:34 juju-e4d256-prod-github-runner-207 kernel: [37368.607675] do_syscall_64+0x5c/0xc0 Aug 22 15:46:34 juju-e4d256-prod-github-runner-207 kernel: [37368.608338] ? do_futex+0x162/0x1f0 Aug 22 15:46:34 juju-e4d256-prod-github-runner-207 kernel: [37368.608985] ? __x64_sys_futex+0x78/0x1e0 Aug 22 15:46:34 juju-e4d256-prod-github-runner-207 kernel: [37368.609656] ? __secure_computing+0xa9/0x120 Aug 22 15:46:34 juju-e4d256-prod-github-runner-207 kernel: [37368.610342] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 15:46:34 juju-e4d256-prod-github-runner-207 kernel: [37368.611111] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:46:34 juju-e4d256-prod-github-runner-207 kernel: [37368.611831] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:46:34 juju-e4d256-prod-github-runner-207 kernel: [37368.612549] ? do_syscall_64+0x69/0xc0 Aug 22 15:46:34 juju-e4d256-prod-github-runner-207 kernel: [37368.613194] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:46:34 juju-e4d256-prod-github-runner-207 kernel: [37368.613894] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:46:34 juju-e4d256-prod-github-runner-207 kernel: [37368.614587] ? do_syscall_64+0x69/0xc0 Aug 22 15:46:34 juju-e4d256-prod-github-runner-207 kernel: [37368.615224] ? do_syscall_64+0x69/0xc0 Aug 22 15:46:34 juju-e4d256-prod-github-runner-207 kernel: [37368.615845] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 15:46:34 juju-e4d256-prod-github-runner-207 kernel: [37368.616550] RIP: 0033:0x7faa5d0edaff Aug 22 15:46:34 juju-e4d256-prod-github-runner-207 kernel: [37368.617194] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 15:46:34 juju-e4d256-prod-github-runner-207 kernel: [37368.619174] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 15:46:34 juju-e4d256-prod-github-runner-207 kernel: [37368.620083] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 15:46:34 juju-e4d256-prod-github-runner-207 kernel: [37368.620971] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 15:46:34 juju-e4d256-prod-github-runner-207 kernel: [37368.621862] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 15:46:34 juju-e4d256-prod-github-runner-207 kernel: [37368.622757] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 15:46:34 juju-e4d256-prod-github-runner-207 kernel: [37368.623642] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 15:46:34 juju-e4d256-prod-github-runner-207 kernel: [37368.624535] Aug 22 15:47:02 juju-e4d256-prod-github-runner-207 kernel: [37396.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 34720s! [qemu-system-x86:6715] Aug 22 15:47:02 juju-e4d256-prod-github-runner-207 kernel: [37396.543118] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 15:47:02 juju-e4d256-prod-github-runner-207 kernel: [37396.543187] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 15:47:02 juju-e4d256-prod-github-runner-207 kernel: [37396.555461] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 15:47:02 juju-e4d256-prod-github-runner-207 kernel: [37396.556730] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 15:47:02 juju-e4d256-prod-github-runner-207 kernel: [37396.557954] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:47:02 juju-e4d256-prod-github-runner-207 kernel: [37396.559025] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 15:47:02 juju-e4d256-prod-github-runner-207 kernel: [37396.561578] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 15:47:02 juju-e4d256-prod-github-runner-207 kernel: [37396.562644] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 15:47:02 juju-e4d256-prod-github-runner-207 kernel: [37396.563807] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 15:47:02 juju-e4d256-prod-github-runner-207 kernel: [37396.564966] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 15:47:02 juju-e4d256-prod-github-runner-207 kernel: [37396.566126] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 15:47:02 juju-e4d256-prod-github-runner-207 kernel: [37396.567300] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 15:47:02 juju-e4d256-prod-github-runner-207 kernel: [37396.568467] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 15:47:02 juju-e4d256-prod-github-runner-207 kernel: [37396.569704] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 15:47:02 juju-e4d256-prod-github-runner-207 kernel: [37396.570815] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 15:47:02 juju-e4d256-prod-github-runner-207 kernel: [37396.572010] Call Trace: Aug 22 15:47:02 juju-e4d256-prod-github-runner-207 kernel: [37396.572920] Aug 22 15:47:02 juju-e4d256-prod-github-runner-207 kernel: [37396.573803] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:47:02 juju-e4d256-prod-github-runner-207 kernel: [37396.574848] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:47:02 juju-e4d256-prod-github-runner-207 kernel: [37396.575867] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:47:02 juju-e4d256-prod-github-runner-207 kernel: [37396.576939] ? show_regs.part.0+0x23/0x29 Aug 22 15:47:02 juju-e4d256-prod-github-runner-207 kernel: [37396.577935] ? show_regs.cold+0x8/0xd Aug 22 15:47:02 juju-e4d256-prod-github-runner-207 kernel: [37396.578931] ? watchdog_timer_fn+0x1be/0x220 Aug 22 15:47:02 juju-e4d256-prod-github-runner-207 kernel: [37396.579939] ? lockup_detector_update_enable+0x60/0x60 Aug 22 15:47:02 juju-e4d256-prod-github-runner-207 kernel: [37396.581000] ? __hrtimer_run_queues+0x107/0x230 Aug 22 15:47:02 juju-e4d256-prod-github-runner-207 kernel: [37396.582032] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 15:47:02 juju-e4d256-prod-github-runner-207 kernel: [37396.583073] ? hrtimer_interrupt+0x101/0x220 Aug 22 15:47:02 juju-e4d256-prod-github-runner-207 kernel: [37396.584087] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 15:47:02 juju-e4d256-prod-github-runner-207 kernel: [37396.585160] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 15:47:02 juju-e4d256-prod-github-runner-207 kernel: [37396.586205] Aug 22 15:47:02 juju-e4d256-prod-github-runner-207 kernel: [37396.587071] Aug 22 15:47:02 juju-e4d256-prod-github-runner-207 kernel: [37396.587911] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 15:47:02 juju-e4d256-prod-github-runner-207 kernel: [37396.588948] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:47:02 juju-e4d256-prod-github-runner-207 kernel: [37396.589988] ? _raw_spin_lock+0x22/0x30 Aug 22 15:47:02 juju-e4d256-prod-github-runner-207 kernel: [37396.590948] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:47:02 juju-e4d256-prod-github-runner-207 kernel: [37396.591972] direct_page_fault+0x206/0x310 [kvm] Aug 22 15:47:02 juju-e4d256-prod-github-runner-207 kernel: [37396.592997] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 15:47:02 juju-e4d256-prod-github-runner-207 kernel: [37396.594004] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 15:47:02 juju-e4d256-prod-github-runner-207 kernel: [37396.595016] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 15:47:02 juju-e4d256-prod-github-runner-207 kernel: [37396.595986] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 15:47:02 juju-e4d256-prod-github-runner-207 kernel: [37396.596929] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 15:47:02 juju-e4d256-prod-github-runner-207 kernel: [37396.597906] handle_exit+0x98/0x230 [kvm_amd] Aug 22 15:47:02 juju-e4d256-prod-github-runner-207 kernel: [37396.598815] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 15:47:02 juju-e4d256-prod-github-runner-207 kernel: [37396.599731] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 15:47:02 juju-e4d256-prod-github-runner-207 kernel: [37396.600653] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 15:47:02 juju-e4d256-prod-github-runner-207 kernel: [37396.601554] vcpu_run+0x62/0x2c0 [kvm] Aug 22 15:47:02 juju-e4d256-prod-github-runner-207 kernel: [37396.602375] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 15:47:02 juju-e4d256-prod-github-runner-207 kernel: [37396.603180] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 15:47:02 juju-e4d256-prod-github-runner-207 kernel: [37396.604031] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 15:47:02 juju-e4d256-prod-github-runner-207 kernel: [37396.604825] ? __seccomp_filter+0x4a/0x4a0 Aug 22 15:47:02 juju-e4d256-prod-github-runner-207 kernel: [37396.605564] ? __fget_files+0x86/0xc0 Aug 22 15:47:02 juju-e4d256-prod-github-runner-207 kernel: [37396.606267] __x64_sys_ioctl+0x95/0xd0 Aug 22 15:47:02 juju-e4d256-prod-github-runner-207 kernel: [37396.606971] do_syscall_64+0x5c/0xc0 Aug 22 15:47:02 juju-e4d256-prod-github-runner-207 kernel: [37396.607632] ? do_futex+0x162/0x1f0 Aug 22 15:47:02 juju-e4d256-prod-github-runner-207 kernel: [37396.608278] ? __x64_sys_futex+0x78/0x1e0 Aug 22 15:47:02 juju-e4d256-prod-github-runner-207 kernel: [37396.608949] ? __secure_computing+0xa9/0x120 Aug 22 15:47:02 juju-e4d256-prod-github-runner-207 kernel: [37396.609641] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 15:47:02 juju-e4d256-prod-github-runner-207 kernel: [37396.610420] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:47:02 juju-e4d256-prod-github-runner-207 kernel: [37396.611140] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:47:02 juju-e4d256-prod-github-runner-207 kernel: [37396.611854] ? do_syscall_64+0x69/0xc0 Aug 22 15:47:02 juju-e4d256-prod-github-runner-207 kernel: [37396.612496] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:47:02 juju-e4d256-prod-github-runner-207 kernel: [37396.613196] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:47:02 juju-e4d256-prod-github-runner-207 kernel: [37396.613891] ? do_syscall_64+0x69/0xc0 Aug 22 15:47:02 juju-e4d256-prod-github-runner-207 kernel: [37396.614533] ? do_syscall_64+0x69/0xc0 Aug 22 15:47:02 juju-e4d256-prod-github-runner-207 kernel: [37396.615155] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 15:47:02 juju-e4d256-prod-github-runner-207 kernel: [37396.615857] RIP: 0033:0x7faa5d0edaff Aug 22 15:47:02 juju-e4d256-prod-github-runner-207 kernel: [37396.616500] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 15:47:02 juju-e4d256-prod-github-runner-207 kernel: [37396.618506] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 15:47:02 juju-e4d256-prod-github-runner-207 kernel: [37396.619416] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 15:47:02 juju-e4d256-prod-github-runner-207 kernel: [37396.620307] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 15:47:02 juju-e4d256-prod-github-runner-207 kernel: [37396.621196] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 15:47:02 juju-e4d256-prod-github-runner-207 kernel: [37396.622083] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 15:47:02 juju-e4d256-prod-github-runner-207 kernel: [37396.622986] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 15:47:02 juju-e4d256-prod-github-runner-207 kernel: [37396.623877] Aug 22 15:47:30 juju-e4d256-prod-github-runner-207 kernel: [37424.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 34746s! [qemu-system-x86:6715] Aug 22 15:47:30 juju-e4d256-prod-github-runner-207 kernel: [37424.543111] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 15:47:30 juju-e4d256-prod-github-runner-207 kernel: [37424.543180] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 15:47:30 juju-e4d256-prod-github-runner-207 kernel: [37424.555298] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 15:47:30 juju-e4d256-prod-github-runner-207 kernel: [37424.556578] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 15:47:30 juju-e4d256-prod-github-runner-207 kernel: [37424.557804] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:47:30 juju-e4d256-prod-github-runner-207 kernel: [37424.558884] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 15:47:30 juju-e4d256-prod-github-runner-207 kernel: [37424.561458] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 15:47:30 juju-e4d256-prod-github-runner-207 kernel: [37424.562513] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 15:47:30 juju-e4d256-prod-github-runner-207 kernel: [37424.563698] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 15:47:30 juju-e4d256-prod-github-runner-207 kernel: [37424.564881] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 15:47:30 juju-e4d256-prod-github-runner-207 kernel: [37424.566063] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 15:47:30 juju-e4d256-prod-github-runner-207 kernel: [37424.567240] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 15:47:30 juju-e4d256-prod-github-runner-207 kernel: [37424.568451] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 15:47:30 juju-e4d256-prod-github-runner-207 kernel: [37424.569731] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 15:47:30 juju-e4d256-prod-github-runner-207 kernel: [37424.570863] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 15:47:30 juju-e4d256-prod-github-runner-207 kernel: [37424.572060] Call Trace: Aug 22 15:47:30 juju-e4d256-prod-github-runner-207 kernel: [37424.572974] Aug 22 15:47:30 juju-e4d256-prod-github-runner-207 kernel: [37424.573877] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:47:30 juju-e4d256-prod-github-runner-207 kernel: [37424.574940] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:47:30 juju-e4d256-prod-github-runner-207 kernel: [37424.575977] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:47:30 juju-e4d256-prod-github-runner-207 kernel: [37424.577093] ? show_regs.part.0+0x23/0x29 Aug 22 15:47:30 juju-e4d256-prod-github-runner-207 kernel: [37424.578112] ? show_regs.cold+0x8/0xd Aug 22 15:47:30 juju-e4d256-prod-github-runner-207 kernel: [37424.579096] ? watchdog_timer_fn+0x1be/0x220 Aug 22 15:47:30 juju-e4d256-prod-github-runner-207 kernel: [37424.580136] ? lockup_detector_update_enable+0x60/0x60 Aug 22 15:47:30 juju-e4d256-prod-github-runner-207 kernel: [37424.581218] ? __hrtimer_run_queues+0x107/0x230 Aug 22 15:47:30 juju-e4d256-prod-github-runner-207 kernel: [37424.582269] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 15:47:30 juju-e4d256-prod-github-runner-207 kernel: [37424.583297] ? hrtimer_interrupt+0x101/0x220 Aug 22 15:47:30 juju-e4d256-prod-github-runner-207 kernel: [37424.584323] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 15:47:30 juju-e4d256-prod-github-runner-207 kernel: [37424.585425] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 15:47:30 juju-e4d256-prod-github-runner-207 kernel: [37424.586506] Aug 22 15:47:30 juju-e4d256-prod-github-runner-207 kernel: [37424.587370] Aug 22 15:47:30 juju-e4d256-prod-github-runner-207 kernel: [37424.588212] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 15:47:30 juju-e4d256-prod-github-runner-207 kernel: [37424.589263] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:47:30 juju-e4d256-prod-github-runner-207 kernel: [37424.590327] ? _raw_spin_lock+0x22/0x30 Aug 22 15:47:30 juju-e4d256-prod-github-runner-207 kernel: [37424.591279] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:47:30 juju-e4d256-prod-github-runner-207 kernel: [37424.592295] direct_page_fault+0x206/0x310 [kvm] Aug 22 15:47:30 juju-e4d256-prod-github-runner-207 kernel: [37424.593325] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 15:47:30 juju-e4d256-prod-github-runner-207 kernel: [37424.594359] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 15:47:30 juju-e4d256-prod-github-runner-207 kernel: [37424.595527] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 15:47:30 juju-e4d256-prod-github-runner-207 kernel: [37424.596506] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 15:47:30 juju-e4d256-prod-github-runner-207 kernel: [37424.597475] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 15:47:30 juju-e4d256-prod-github-runner-207 kernel: [37424.598487] handle_exit+0x98/0x230 [kvm_amd] Aug 22 15:47:30 juju-e4d256-prod-github-runner-207 kernel: [37424.599410] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 15:47:30 juju-e4d256-prod-github-runner-207 kernel: [37424.600441] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 15:47:30 juju-e4d256-prod-github-runner-207 kernel: [37424.601380] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 15:47:30 juju-e4d256-prod-github-runner-207 kernel: [37424.602305] vcpu_run+0x62/0x2c0 [kvm] Aug 22 15:47:30 juju-e4d256-prod-github-runner-207 kernel: [37424.603120] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 15:47:30 juju-e4d256-prod-github-runner-207 kernel: [37424.603937] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 15:47:30 juju-e4d256-prod-github-runner-207 kernel: [37424.604805] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 15:47:30 juju-e4d256-prod-github-runner-207 kernel: [37424.605623] ? __seccomp_filter+0x4a/0x4a0 Aug 22 15:47:30 juju-e4d256-prod-github-runner-207 kernel: [37424.606392] ? __fget_files+0x86/0xc0 Aug 22 15:47:30 juju-e4d256-prod-github-runner-207 kernel: [37424.607105] __x64_sys_ioctl+0x95/0xd0 Aug 22 15:47:30 juju-e4d256-prod-github-runner-207 kernel: [37424.607806] do_syscall_64+0x5c/0xc0 Aug 22 15:47:30 juju-e4d256-prod-github-runner-207 kernel: [37424.608474] ? do_futex+0x162/0x1f0 Aug 22 15:47:30 juju-e4d256-prod-github-runner-207 kernel: [37424.609131] ? __x64_sys_futex+0x78/0x1e0 Aug 22 15:47:30 juju-e4d256-prod-github-runner-207 kernel: [37424.609816] ? __secure_computing+0xa9/0x120 Aug 22 15:47:30 juju-e4d256-prod-github-runner-207 kernel: [37424.610522] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 15:47:30 juju-e4d256-prod-github-runner-207 kernel: [37424.611310] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:47:30 juju-e4d256-prod-github-runner-207 kernel: [37424.612038] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:47:30 juju-e4d256-prod-github-runner-207 kernel: [37424.612759] ? do_syscall_64+0x69/0xc0 Aug 22 15:47:30 juju-e4d256-prod-github-runner-207 kernel: [37424.613407] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:47:30 juju-e4d256-prod-github-runner-207 kernel: [37424.614126] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:47:30 juju-e4d256-prod-github-runner-207 kernel: [37424.614841] ? do_syscall_64+0x69/0xc0 Aug 22 15:47:30 juju-e4d256-prod-github-runner-207 kernel: [37424.615472] ? do_syscall_64+0x69/0xc0 Aug 22 15:47:30 juju-e4d256-prod-github-runner-207 kernel: [37424.616112] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 15:47:30 juju-e4d256-prod-github-runner-207 kernel: [37424.616828] RIP: 0033:0x7faa5d0edaff Aug 22 15:47:30 juju-e4d256-prod-github-runner-207 kernel: [37424.617456] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 15:47:30 juju-e4d256-prod-github-runner-207 kernel: [37424.619474] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 15:47:30 juju-e4d256-prod-github-runner-207 kernel: [37424.620394] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 15:47:30 juju-e4d256-prod-github-runner-207 kernel: [37424.621297] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 15:47:30 juju-e4d256-prod-github-runner-207 kernel: [37424.622204] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 15:47:30 juju-e4d256-prod-github-runner-207 kernel: [37424.623101] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 15:47:30 juju-e4d256-prod-github-runner-207 kernel: [37424.623991] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 15:47:30 juju-e4d256-prod-github-runner-207 kernel: [37424.624886] Aug 22 15:47:45 juju-e4d256-prod-github-runner-207 kernel: [37439.684705] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 15:47:45 juju-e4d256-prod-github-runner-207 kernel: [37439.685692] rcu: 1-....: (9301331 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=4495222 Aug 22 15:47:45 juju-e4d256-prod-github-runner-207 kernel: [37439.686842] (t=9330621 jiffies g=23269 q=38925) Aug 22 15:47:45 juju-e4d256-prod-github-runner-207 kernel: [37439.687622] NMI backtrace for cpu 1 Aug 22 15:47:45 juju-e4d256-prod-github-runner-207 kernel: [37439.688330] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 15:47:45 juju-e4d256-prod-github-runner-207 kernel: [37439.689436] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 15:47:45 juju-e4d256-prod-github-runner-207 kernel: [37439.690503] Call Trace: Aug 22 15:47:45 juju-e4d256-prod-github-runner-207 kernel: [37439.691178] Aug 22 15:47:45 juju-e4d256-prod-github-runner-207 kernel: [37439.691821] show_stack+0x52/0x5c Aug 22 15:47:45 juju-e4d256-prod-github-runner-207 kernel: [37439.692546] dump_stack_lvl+0x4a/0x63 Aug 22 15:47:45 juju-e4d256-prod-github-runner-207 kernel: [37439.693292] dump_stack+0x10/0x16 Aug 22 15:47:45 juju-e4d256-prod-github-runner-207 kernel: [37439.694022] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 15:47:45 juju-e4d256-prod-github-runner-207 kernel: [37439.694807] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 15:47:45 juju-e4d256-prod-github-runner-207 kernel: [37439.695587] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 15:47:45 juju-e4d256-prod-github-runner-207 kernel: [37439.696411] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 15:47:45 juju-e4d256-prod-github-runner-207 kernel: [37439.697230] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 15:47:45 juju-e4d256-prod-github-runner-207 kernel: [37439.698054] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 15:47:45 juju-e4d256-prod-github-runner-207 kernel: [37439.698834] print_cpu_stall.cold+0x2f/0xe2 Aug 22 15:47:45 juju-e4d256-prod-github-runner-207 kernel: [37439.699597] ? timekeeping_update+0xf7/0x150 Aug 22 15:47:45 juju-e4d256-prod-github-runner-207 kernel: [37439.700366] check_cpu_stall+0x109/0x270 Aug 22 15:47:45 juju-e4d256-prod-github-runner-207 kernel: [37439.701225] rcu_sched_clock_irq+0x9a/0x250 Aug 22 15:47:45 juju-e4d256-prod-github-runner-207 kernel: [37439.702002] update_process_times+0x94/0xd0 Aug 22 15:47:45 juju-e4d256-prod-github-runner-207 kernel: [37439.702762] tick_sched_handle+0x29/0x70 Aug 22 15:47:45 juju-e4d256-prod-github-runner-207 kernel: [37439.703505] tick_sched_timer+0x8c/0xc0 Aug 22 15:47:45 juju-e4d256-prod-github-runner-207 kernel: [37439.704241] ? tick_nohz_handler+0xb0/0xb0 Aug 22 15:47:45 juju-e4d256-prod-github-runner-207 kernel: [37439.704995] __hrtimer_run_queues+0x107/0x230 Aug 22 15:47:45 juju-e4d256-prod-github-runner-207 kernel: [37439.705768] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 15:47:45 juju-e4d256-prod-github-runner-207 kernel: [37439.706554] hrtimer_interrupt+0x101/0x220 Aug 22 15:47:45 juju-e4d256-prod-github-runner-207 kernel: [37439.707310] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 15:47:45 juju-e4d256-prod-github-runner-207 kernel: [37439.708125] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 15:47:45 juju-e4d256-prod-github-runner-207 kernel: [37439.708924] Aug 22 15:47:45 juju-e4d256-prod-github-runner-207 kernel: [37439.709557] Aug 22 15:47:45 juju-e4d256-prod-github-runner-207 kernel: [37439.710200] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 15:47:45 juju-e4d256-prod-github-runner-207 kernel: [37439.711153] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:47:45 juju-e4d256-prod-github-runner-207 kernel: [37439.712033] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 15:47:45 juju-e4d256-prod-github-runner-207 kernel: [37439.714249] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 15:47:45 juju-e4d256-prod-github-runner-207 kernel: [37439.715128] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 15:47:45 juju-e4d256-prod-github-runner-207 kernel: [37439.716120] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 15:47:45 juju-e4d256-prod-github-runner-207 kernel: [37439.717094] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 15:47:45 juju-e4d256-prod-github-runner-207 kernel: [37439.718073] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 15:47:45 juju-e4d256-prod-github-runner-207 kernel: [37439.719027] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 15:47:45 juju-e4d256-prod-github-runner-207 kernel: [37439.719982] ? _raw_spin_lock+0x22/0x30 Aug 22 15:47:45 juju-e4d256-prod-github-runner-207 kernel: [37439.720748] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:47:45 juju-e4d256-prod-github-runner-207 kernel: [37439.721582] direct_page_fault+0x206/0x310 [kvm] Aug 22 15:47:45 juju-e4d256-prod-github-runner-207 kernel: [37439.722430] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 15:47:45 juju-e4d256-prod-github-runner-207 kernel: [37439.723257] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 15:47:45 juju-e4d256-prod-github-runner-207 kernel: [37439.724083] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 15:47:45 juju-e4d256-prod-github-runner-207 kernel: [37439.724887] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 15:47:45 juju-e4d256-prod-github-runner-207 kernel: [37439.725674] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 15:47:45 juju-e4d256-prod-github-runner-207 kernel: [37439.726510] handle_exit+0x98/0x230 [kvm_amd] Aug 22 15:47:45 juju-e4d256-prod-github-runner-207 kernel: [37439.727270] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 15:47:45 juju-e4d256-prod-github-runner-207 kernel: [37439.728057] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 15:47:45 juju-e4d256-prod-github-runner-207 kernel: [37439.728856] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 15:47:45 juju-e4d256-prod-github-runner-207 kernel: [37439.729646] vcpu_run+0x62/0x2c0 [kvm] Aug 22 15:47:45 juju-e4d256-prod-github-runner-207 kernel: [37439.730381] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 15:47:45 juju-e4d256-prod-github-runner-207 kernel: [37439.731117] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 15:47:45 juju-e4d256-prod-github-runner-207 kernel: [37439.731919] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 15:47:45 juju-e4d256-prod-github-runner-207 kernel: [37439.732680] ? __seccomp_filter+0x4a/0x4a0 Aug 22 15:47:45 juju-e4d256-prod-github-runner-207 kernel: [37439.733400] ? __fget_files+0x86/0xc0 Aug 22 15:47:45 juju-e4d256-prod-github-runner-207 kernel: [37439.734108] __x64_sys_ioctl+0x95/0xd0 Aug 22 15:47:45 juju-e4d256-prod-github-runner-207 kernel: [37439.734804] do_syscall_64+0x5c/0xc0 Aug 22 15:47:45 juju-e4d256-prod-github-runner-207 kernel: [37439.735486] ? do_futex+0x162/0x1f0 Aug 22 15:47:45 juju-e4d256-prod-github-runner-207 kernel: [37439.736161] ? __x64_sys_futex+0x78/0x1e0 Aug 22 15:47:45 juju-e4d256-prod-github-runner-207 kernel: [37439.736868] ? __secure_computing+0xa9/0x120 Aug 22 15:47:45 juju-e4d256-prod-github-runner-207 kernel: [37439.737584] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 15:47:45 juju-e4d256-prod-github-runner-207 kernel: [37439.738386] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:47:45 juju-e4d256-prod-github-runner-207 kernel: [37439.739139] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:47:45 juju-e4d256-prod-github-runner-207 kernel: [37439.739896] ? do_syscall_64+0x69/0xc0 Aug 22 15:47:45 juju-e4d256-prod-github-runner-207 kernel: [37439.740584] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:47:45 juju-e4d256-prod-github-runner-207 kernel: [37439.741348] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:47:45 juju-e4d256-prod-github-runner-207 kernel: [37439.742118] ? do_syscall_64+0x69/0xc0 Aug 22 15:47:45 juju-e4d256-prod-github-runner-207 kernel: [37439.742811] ? do_syscall_64+0x69/0xc0 Aug 22 15:47:45 juju-e4d256-prod-github-runner-207 kernel: [37439.743497] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 15:47:45 juju-e4d256-prod-github-runner-207 kernel: [37439.744267] RIP: 0033:0x7faa5d0edaff Aug 22 15:47:45 juju-e4d256-prod-github-runner-207 kernel: [37439.744950] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 15:47:45 juju-e4d256-prod-github-runner-207 kernel: [37439.747064] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 15:47:45 juju-e4d256-prod-github-runner-207 kernel: [37439.748024] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 15:47:45 juju-e4d256-prod-github-runner-207 kernel: [37439.748968] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 15:47:45 juju-e4d256-prod-github-runner-207 kernel: [37439.749921] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 15:47:45 juju-e4d256-prod-github-runner-207 kernel: [37439.750861] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 15:47:45 juju-e4d256-prod-github-runner-207 kernel: [37439.751791] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 15:47:45 juju-e4d256-prod-github-runner-207 kernel: [37439.752704] Aug 22 15:48:10 juju-e4d256-prod-github-runner-207 kernel: [37464.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 34783s! [qemu-system-x86:6715] Aug 22 15:48:10 juju-e4d256-prod-github-runner-207 kernel: [37464.543167] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 15:48:10 juju-e4d256-prod-github-runner-207 kernel: [37464.543305] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 15:48:10 juju-e4d256-prod-github-runner-207 kernel: [37464.555381] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 15:48:10 juju-e4d256-prod-github-runner-207 kernel: [37464.556643] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 15:48:10 juju-e4d256-prod-github-runner-207 kernel: [37464.557874] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:48:10 juju-e4d256-prod-github-runner-207 kernel: [37464.558934] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 15:48:10 juju-e4d256-prod-github-runner-207 kernel: [37464.561477] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 15:48:10 juju-e4d256-prod-github-runner-207 kernel: [37464.562529] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 15:48:10 juju-e4d256-prod-github-runner-207 kernel: [37464.563689] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 15:48:10 juju-e4d256-prod-github-runner-207 kernel: [37464.564863] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 15:48:10 juju-e4d256-prod-github-runner-207 kernel: [37464.566034] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 15:48:10 juju-e4d256-prod-github-runner-207 kernel: [37464.567195] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 15:48:10 juju-e4d256-prod-github-runner-207 kernel: [37464.568378] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 15:48:10 juju-e4d256-prod-github-runner-207 kernel: [37464.569624] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 15:48:10 juju-e4d256-prod-github-runner-207 kernel: [37464.570720] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 15:48:10 juju-e4d256-prod-github-runner-207 kernel: [37464.571912] Call Trace: Aug 22 15:48:10 juju-e4d256-prod-github-runner-207 kernel: [37464.572822] Aug 22 15:48:10 juju-e4d256-prod-github-runner-207 kernel: [37464.573714] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:48:10 juju-e4d256-prod-github-runner-207 kernel: [37464.574745] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:48:10 juju-e4d256-prod-github-runner-207 kernel: [37464.575765] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:48:10 juju-e4d256-prod-github-runner-207 kernel: [37464.576856] ? show_regs.part.0+0x23/0x29 Aug 22 15:48:10 juju-e4d256-prod-github-runner-207 kernel: [37464.577862] ? show_regs.cold+0x8/0xd Aug 22 15:48:10 juju-e4d256-prod-github-runner-207 kernel: [37464.578839] ? watchdog_timer_fn+0x1be/0x220 Aug 22 15:48:10 juju-e4d256-prod-github-runner-207 kernel: [37464.579863] ? lockup_detector_update_enable+0x60/0x60 Aug 22 15:48:10 juju-e4d256-prod-github-runner-207 kernel: [37464.580925] ? __hrtimer_run_queues+0x107/0x230 Aug 22 15:48:10 juju-e4d256-prod-github-runner-207 kernel: [37464.581960] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 15:48:10 juju-e4d256-prod-github-runner-207 kernel: [37464.582983] ? hrtimer_interrupt+0x101/0x220 Aug 22 15:48:10 juju-e4d256-prod-github-runner-207 kernel: [37464.583995] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 15:48:10 juju-e4d256-prod-github-runner-207 kernel: [37464.585062] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 15:48:10 juju-e4d256-prod-github-runner-207 kernel: [37464.586114] Aug 22 15:48:10 juju-e4d256-prod-github-runner-207 kernel: [37464.586967] Aug 22 15:48:10 juju-e4d256-prod-github-runner-207 kernel: [37464.587801] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 15:48:10 juju-e4d256-prod-github-runner-207 kernel: [37464.588837] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:48:10 juju-e4d256-prod-github-runner-207 kernel: [37464.589957] ? _raw_spin_lock+0x22/0x30 Aug 22 15:48:10 juju-e4d256-prod-github-runner-207 kernel: [37464.590901] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:48:10 juju-e4d256-prod-github-runner-207 kernel: [37464.591925] direct_page_fault+0x206/0x310 [kvm] Aug 22 15:48:10 juju-e4d256-prod-github-runner-207 kernel: [37464.592950] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 15:48:10 juju-e4d256-prod-github-runner-207 kernel: [37464.593974] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 15:48:10 juju-e4d256-prod-github-runner-207 kernel: [37464.594980] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 15:48:10 juju-e4d256-prod-github-runner-207 kernel: [37464.595968] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 15:48:10 juju-e4d256-prod-github-runner-207 kernel: [37464.596913] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 15:48:10 juju-e4d256-prod-github-runner-207 kernel: [37464.597909] handle_exit+0x98/0x230 [kvm_amd] Aug 22 15:48:10 juju-e4d256-prod-github-runner-207 kernel: [37464.598803] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 15:48:10 juju-e4d256-prod-github-runner-207 kernel: [37464.599717] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 15:48:10 juju-e4d256-prod-github-runner-207 kernel: [37464.600647] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 15:48:10 juju-e4d256-prod-github-runner-207 kernel: [37464.601569] vcpu_run+0x62/0x2c0 [kvm] Aug 22 15:48:10 juju-e4d256-prod-github-runner-207 kernel: [37464.602381] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 15:48:10 juju-e4d256-prod-github-runner-207 kernel: [37464.603189] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 15:48:10 juju-e4d256-prod-github-runner-207 kernel: [37464.604048] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 15:48:10 juju-e4d256-prod-github-runner-207 kernel: [37464.604847] ? __seccomp_filter+0x4a/0x4a0 Aug 22 15:48:10 juju-e4d256-prod-github-runner-207 kernel: [37464.605598] ? __fget_files+0x86/0xc0 Aug 22 15:48:10 juju-e4d256-prod-github-runner-207 kernel: [37464.606302] __x64_sys_ioctl+0x95/0xd0 Aug 22 15:48:10 juju-e4d256-prod-github-runner-207 kernel: [37464.607000] do_syscall_64+0x5c/0xc0 Aug 22 15:48:10 juju-e4d256-prod-github-runner-207 kernel: [37464.607665] ? do_futex+0x162/0x1f0 Aug 22 15:48:10 juju-e4d256-prod-github-runner-207 kernel: [37464.608314] ? __x64_sys_futex+0x78/0x1e0 Aug 22 15:48:10 juju-e4d256-prod-github-runner-207 kernel: [37464.608987] ? __secure_computing+0xa9/0x120 Aug 22 15:48:10 juju-e4d256-prod-github-runner-207 kernel: [37464.609685] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 15:48:10 juju-e4d256-prod-github-runner-207 kernel: [37464.610456] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:48:10 juju-e4d256-prod-github-runner-207 kernel: [37464.611177] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:48:10 juju-e4d256-prod-github-runner-207 kernel: [37464.611895] ? do_syscall_64+0x69/0xc0 Aug 22 15:48:10 juju-e4d256-prod-github-runner-207 kernel: [37464.612539] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:48:10 juju-e4d256-prod-github-runner-207 kernel: [37464.613242] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:48:10 juju-e4d256-prod-github-runner-207 kernel: [37464.613948] ? do_syscall_64+0x69/0xc0 Aug 22 15:48:10 juju-e4d256-prod-github-runner-207 kernel: [37464.614573] ? do_syscall_64+0x69/0xc0 Aug 22 15:48:10 juju-e4d256-prod-github-runner-207 kernel: [37464.615195] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 15:48:10 juju-e4d256-prod-github-runner-207 kernel: [37464.615901] RIP: 0033:0x7faa5d0edaff Aug 22 15:48:10 juju-e4d256-prod-github-runner-207 kernel: [37464.616532] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 15:48:10 juju-e4d256-prod-github-runner-207 kernel: [37464.618526] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 15:48:10 juju-e4d256-prod-github-runner-207 kernel: [37464.619441] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 15:48:10 juju-e4d256-prod-github-runner-207 kernel: [37464.620342] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 15:48:10 juju-e4d256-prod-github-runner-207 kernel: [37464.621284] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 15:48:10 juju-e4d256-prod-github-runner-207 kernel: [37464.622484] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 15:48:10 juju-e4d256-prod-github-runner-207 kernel: [37464.623409] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 15:48:10 juju-e4d256-prod-github-runner-207 kernel: [37464.624303] Aug 22 15:48:38 juju-e4d256-prod-github-runner-207 kernel: [37492.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 34809s! [qemu-system-x86:6715] Aug 22 15:48:38 juju-e4d256-prod-github-runner-207 kernel: [37492.543718] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 15:48:38 juju-e4d256-prod-github-runner-207 kernel: [37492.543930] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 15:48:38 juju-e4d256-prod-github-runner-207 kernel: [37492.556295] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 15:48:38 juju-e4d256-prod-github-runner-207 kernel: [37492.557592] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 15:48:38 juju-e4d256-prod-github-runner-207 kernel: [37492.558829] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:48:38 juju-e4d256-prod-github-runner-207 kernel: [37492.559894] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 15:48:38 juju-e4d256-prod-github-runner-207 kernel: [37492.562476] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 15:48:38 juju-e4d256-prod-github-runner-207 kernel: [37492.563562] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 15:48:38 juju-e4d256-prod-github-runner-207 kernel: [37492.564734] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 15:48:38 juju-e4d256-prod-github-runner-207 kernel: [37492.565914] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 15:48:38 juju-e4d256-prod-github-runner-207 kernel: [37492.567093] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 15:48:38 juju-e4d256-prod-github-runner-207 kernel: [37492.568271] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 15:48:38 juju-e4d256-prod-github-runner-207 kernel: [37492.569462] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 15:48:38 juju-e4d256-prod-github-runner-207 kernel: [37492.570700] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 15:48:38 juju-e4d256-prod-github-runner-207 kernel: [37492.571833] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 15:48:38 juju-e4d256-prod-github-runner-207 kernel: [37492.573065] Call Trace: Aug 22 15:48:38 juju-e4d256-prod-github-runner-207 kernel: [37492.574020] Aug 22 15:48:38 juju-e4d256-prod-github-runner-207 kernel: [37492.574923] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:48:38 juju-e4d256-prod-github-runner-207 kernel: [37492.575963] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:48:38 juju-e4d256-prod-github-runner-207 kernel: [37492.576992] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:48:38 juju-e4d256-prod-github-runner-207 kernel: [37492.578104] ? show_regs.part.0+0x23/0x29 Aug 22 15:48:38 juju-e4d256-prod-github-runner-207 kernel: [37492.579123] ? show_regs.cold+0x8/0xd Aug 22 15:48:38 juju-e4d256-prod-github-runner-207 kernel: [37492.580101] ? watchdog_timer_fn+0x1be/0x220 Aug 22 15:48:38 juju-e4d256-prod-github-runner-207 kernel: [37492.581115] ? lockup_detector_update_enable+0x60/0x60 Aug 22 15:48:38 juju-e4d256-prod-github-runner-207 kernel: [37492.582202] ? __hrtimer_run_queues+0x107/0x230 Aug 22 15:48:38 juju-e4d256-prod-github-runner-207 kernel: [37492.583244] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 15:48:38 juju-e4d256-prod-github-runner-207 kernel: [37492.584298] ? hrtimer_interrupt+0x101/0x220 Aug 22 15:48:38 juju-e4d256-prod-github-runner-207 kernel: [37492.585332] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 15:48:38 juju-e4d256-prod-github-runner-207 kernel: [37492.586406] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 15:48:38 juju-e4d256-prod-github-runner-207 kernel: [37492.587455] Aug 22 15:48:38 juju-e4d256-prod-github-runner-207 kernel: [37492.588320] Aug 22 15:48:38 juju-e4d256-prod-github-runner-207 kernel: [37492.589172] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 15:48:38 juju-e4d256-prod-github-runner-207 kernel: [37492.590223] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:48:38 juju-e4d256-prod-github-runner-207 kernel: [37492.591265] ? _raw_spin_lock+0x22/0x30 Aug 22 15:48:38 juju-e4d256-prod-github-runner-207 kernel: [37492.592217] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:48:38 juju-e4d256-prod-github-runner-207 kernel: [37492.593279] direct_page_fault+0x206/0x310 [kvm] Aug 22 15:48:38 juju-e4d256-prod-github-runner-207 kernel: [37492.594353] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 15:48:38 juju-e4d256-prod-github-runner-207 kernel: [37492.595376] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 15:48:38 juju-e4d256-prod-github-runner-207 kernel: [37492.596382] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 15:48:38 juju-e4d256-prod-github-runner-207 kernel: [37492.597385] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 15:48:38 juju-e4d256-prod-github-runner-207 kernel: [37492.598347] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 15:48:38 juju-e4d256-prod-github-runner-207 kernel: [37492.599344] handle_exit+0x98/0x230 [kvm_amd] Aug 22 15:48:38 juju-e4d256-prod-github-runner-207 kernel: [37492.600244] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 15:48:38 juju-e4d256-prod-github-runner-207 kernel: [37492.601168] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 15:48:38 juju-e4d256-prod-github-runner-207 kernel: [37492.602133] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 15:48:38 juju-e4d256-prod-github-runner-207 kernel: [37492.603053] vcpu_run+0x62/0x2c0 [kvm] Aug 22 15:48:38 juju-e4d256-prod-github-runner-207 kernel: [37492.603896] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 15:48:38 juju-e4d256-prod-github-runner-207 kernel: [37492.604733] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 15:48:38 juju-e4d256-prod-github-runner-207 kernel: [37492.605605] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 15:48:38 juju-e4d256-prod-github-runner-207 kernel: [37492.606411] ? __seccomp_filter+0x4a/0x4a0 Aug 22 15:48:38 juju-e4d256-prod-github-runner-207 kernel: [37492.607153] ? __fget_files+0x86/0xc0 Aug 22 15:48:38 juju-e4d256-prod-github-runner-207 kernel: [37492.607878] __x64_sys_ioctl+0x95/0xd0 Aug 22 15:48:38 juju-e4d256-prod-github-runner-207 kernel: [37492.608659] do_syscall_64+0x5c/0xc0 Aug 22 15:48:38 juju-e4d256-prod-github-runner-207 kernel: [37492.609416] ? do_futex+0x162/0x1f0 Aug 22 15:48:38 juju-e4d256-prod-github-runner-207 kernel: [37492.610080] ? __x64_sys_futex+0x78/0x1e0 Aug 22 15:48:38 juju-e4d256-prod-github-runner-207 kernel: [37492.610762] ? __secure_computing+0xa9/0x120 Aug 22 15:48:38 juju-e4d256-prod-github-runner-207 kernel: [37492.611456] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 15:48:38 juju-e4d256-prod-github-runner-207 kernel: [37492.612218] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:48:38 juju-e4d256-prod-github-runner-207 kernel: [37492.612944] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:48:38 juju-e4d256-prod-github-runner-207 kernel: [37492.613704] ? do_syscall_64+0x69/0xc0 Aug 22 15:48:38 juju-e4d256-prod-github-runner-207 kernel: [37492.614364] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:48:38 juju-e4d256-prod-github-runner-207 kernel: [37492.615088] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:48:38 juju-e4d256-prod-github-runner-207 kernel: [37492.615787] ? do_syscall_64+0x69/0xc0 Aug 22 15:48:38 juju-e4d256-prod-github-runner-207 kernel: [37492.616419] ? do_syscall_64+0x69/0xc0 Aug 22 15:48:38 juju-e4d256-prod-github-runner-207 kernel: [37492.617043] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 15:48:38 juju-e4d256-prod-github-runner-207 kernel: [37492.617769] RIP: 0033:0x7faa5d0edaff Aug 22 15:48:38 juju-e4d256-prod-github-runner-207 kernel: [37492.618445] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 15:48:38 juju-e4d256-prod-github-runner-207 kernel: [37492.620451] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 15:48:38 juju-e4d256-prod-github-runner-207 kernel: [37492.621390] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 15:48:38 juju-e4d256-prod-github-runner-207 kernel: [37492.622287] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 15:48:38 juju-e4d256-prod-github-runner-207 kernel: [37492.623187] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 15:48:38 juju-e4d256-prod-github-runner-207 kernel: [37492.624101] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 15:48:38 juju-e4d256-prod-github-runner-207 kernel: [37492.625210] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 15:48:38 juju-e4d256-prod-github-runner-207 kernel: [37492.626425] Aug 22 15:49:06 juju-e4d256-prod-github-runner-207 kernel: [37520.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 34835s! [qemu-system-x86:6715] Aug 22 15:49:06 juju-e4d256-prod-github-runner-207 kernel: [37520.543271] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 15:49:06 juju-e4d256-prod-github-runner-207 kernel: [37520.543340] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 15:49:06 juju-e4d256-prod-github-runner-207 kernel: [37520.557299] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 15:49:06 juju-e4d256-prod-github-runner-207 kernel: [37520.558763] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 15:49:06 juju-e4d256-prod-github-runner-207 kernel: [37520.560159] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:49:06 juju-e4d256-prod-github-runner-207 kernel: [37520.561346] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 15:49:06 juju-e4d256-prod-github-runner-207 kernel: [37520.564228] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 15:49:06 juju-e4d256-prod-github-runner-207 kernel: [37520.565404] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 15:49:06 juju-e4d256-prod-github-runner-207 kernel: [37520.566594] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 15:49:06 juju-e4d256-prod-github-runner-207 kernel: [37520.567744] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 15:49:06 juju-e4d256-prod-github-runner-207 kernel: [37520.568932] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 15:49:06 juju-e4d256-prod-github-runner-207 kernel: [37520.570091] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 15:49:06 juju-e4d256-prod-github-runner-207 kernel: [37520.571256] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 15:49:06 juju-e4d256-prod-github-runner-207 kernel: [37520.572486] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 15:49:06 juju-e4d256-prod-github-runner-207 kernel: [37520.573592] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 15:49:06 juju-e4d256-prod-github-runner-207 kernel: [37520.574781] Call Trace: Aug 22 15:49:06 juju-e4d256-prod-github-runner-207 kernel: [37520.575690] Aug 22 15:49:06 juju-e4d256-prod-github-runner-207 kernel: [37520.576571] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:49:06 juju-e4d256-prod-github-runner-207 kernel: [37520.577614] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:49:06 juju-e4d256-prod-github-runner-207 kernel: [37520.578687] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:49:06 juju-e4d256-prod-github-runner-207 kernel: [37520.579795] ? show_regs.part.0+0x23/0x29 Aug 22 15:49:06 juju-e4d256-prod-github-runner-207 kernel: [37520.580819] ? show_regs.cold+0x8/0xd Aug 22 15:49:06 juju-e4d256-prod-github-runner-207 kernel: [37520.581825] ? watchdog_timer_fn+0x1be/0x220 Aug 22 15:49:06 juju-e4d256-prod-github-runner-207 kernel: [37520.582833] ? lockup_detector_update_enable+0x60/0x60 Aug 22 15:49:06 juju-e4d256-prod-github-runner-207 kernel: [37520.583898] ? __hrtimer_run_queues+0x107/0x230 Aug 22 15:49:06 juju-e4d256-prod-github-runner-207 kernel: [37520.584933] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 15:49:06 juju-e4d256-prod-github-runner-207 kernel: [37520.585956] ? hrtimer_interrupt+0x101/0x220 Aug 22 15:49:06 juju-e4d256-prod-github-runner-207 kernel: [37520.586970] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 15:49:06 juju-e4d256-prod-github-runner-207 kernel: [37520.588037] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 15:49:06 juju-e4d256-prod-github-runner-207 kernel: [37520.589091] Aug 22 15:49:06 juju-e4d256-prod-github-runner-207 kernel: [37520.589944] Aug 22 15:49:06 juju-e4d256-prod-github-runner-207 kernel: [37520.590781] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 15:49:06 juju-e4d256-prod-github-runner-207 kernel: [37520.591815] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:49:06 juju-e4d256-prod-github-runner-207 kernel: [37520.592904] ? _raw_spin_lock+0x22/0x30 Aug 22 15:49:06 juju-e4d256-prod-github-runner-207 kernel: [37520.593853] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:49:06 juju-e4d256-prod-github-runner-207 kernel: [37520.594869] direct_page_fault+0x206/0x310 [kvm] Aug 22 15:49:06 juju-e4d256-prod-github-runner-207 kernel: [37520.595891] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 15:49:06 juju-e4d256-prod-github-runner-207 kernel: [37520.596952] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 15:49:06 juju-e4d256-prod-github-runner-207 kernel: [37520.597953] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 15:49:06 juju-e4d256-prod-github-runner-207 kernel: [37520.598920] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 15:49:06 juju-e4d256-prod-github-runner-207 kernel: [37520.599865] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 15:49:06 juju-e4d256-prod-github-runner-207 kernel: [37520.600856] handle_exit+0x98/0x230 [kvm_amd] Aug 22 15:49:06 juju-e4d256-prod-github-runner-207 kernel: [37520.601761] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 15:49:06 juju-e4d256-prod-github-runner-207 kernel: [37520.602673] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 15:49:06 juju-e4d256-prod-github-runner-207 kernel: [37520.603600] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 15:49:06 juju-e4d256-prod-github-runner-207 kernel: [37520.604501] vcpu_run+0x62/0x2c0 [kvm] Aug 22 15:49:06 juju-e4d256-prod-github-runner-207 kernel: [37520.605318] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 15:49:06 juju-e4d256-prod-github-runner-207 kernel: [37520.606125] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 15:49:06 juju-e4d256-prod-github-runner-207 kernel: [37520.606981] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 15:49:06 juju-e4d256-prod-github-runner-207 kernel: [37520.607781] ? __seccomp_filter+0x4a/0x4a0 Aug 22 15:49:06 juju-e4d256-prod-github-runner-207 kernel: [37520.608529] ? __fget_files+0x86/0xc0 Aug 22 15:49:06 juju-e4d256-prod-github-runner-207 kernel: [37520.609268] __x64_sys_ioctl+0x95/0xd0 Aug 22 15:49:06 juju-e4d256-prod-github-runner-207 kernel: [37520.609985] do_syscall_64+0x5c/0xc0 Aug 22 15:49:06 juju-e4d256-prod-github-runner-207 kernel: [37520.610680] ? do_futex+0x162/0x1f0 Aug 22 15:49:06 juju-e4d256-prod-github-runner-207 kernel: [37520.611339] ? __x64_sys_futex+0x78/0x1e0 Aug 22 15:49:06 juju-e4d256-prod-github-runner-207 kernel: [37520.612016] ? __secure_computing+0xa9/0x120 Aug 22 15:49:06 juju-e4d256-prod-github-runner-207 kernel: [37520.612753] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 15:49:06 juju-e4d256-prod-github-runner-207 kernel: [37520.613550] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:49:06 juju-e4d256-prod-github-runner-207 kernel: [37520.614272] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:49:06 juju-e4d256-prod-github-runner-207 kernel: [37520.614989] ? do_syscall_64+0x69/0xc0 Aug 22 15:49:06 juju-e4d256-prod-github-runner-207 kernel: [37520.615632] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:49:06 juju-e4d256-prod-github-runner-207 kernel: [37520.616334] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:49:06 juju-e4d256-prod-github-runner-207 kernel: [37520.617046] ? do_syscall_64+0x69/0xc0 Aug 22 15:49:06 juju-e4d256-prod-github-runner-207 kernel: [37520.617675] ? do_syscall_64+0x69/0xc0 Aug 22 15:49:06 juju-e4d256-prod-github-runner-207 kernel: [37520.618296] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 15:49:06 juju-e4d256-prod-github-runner-207 kernel: [37520.619004] RIP: 0033:0x7faa5d0edaff Aug 22 15:49:06 juju-e4d256-prod-github-runner-207 kernel: [37520.619631] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 15:49:06 juju-e4d256-prod-github-runner-207 kernel: [37520.621625] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 15:49:06 juju-e4d256-prod-github-runner-207 kernel: [37520.622548] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 15:49:06 juju-e4d256-prod-github-runner-207 kernel: [37520.623439] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 15:49:06 juju-e4d256-prod-github-runner-207 kernel: [37520.624326] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 15:49:06 juju-e4d256-prod-github-runner-207 kernel: [37520.625220] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 15:49:06 juju-e4d256-prod-github-runner-207 kernel: [37520.626113] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 15:49:06 juju-e4d256-prod-github-runner-207 kernel: [37520.627003] Aug 22 15:49:34 juju-e4d256-prod-github-runner-207 kernel: [37548.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 34861s! [qemu-system-x86:6715] Aug 22 15:49:34 juju-e4d256-prod-github-runner-207 kernel: [37548.543106] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 15:49:34 juju-e4d256-prod-github-runner-207 kernel: [37548.543174] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 15:49:34 juju-e4d256-prod-github-runner-207 kernel: [37548.555663] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 15:49:34 juju-e4d256-prod-github-runner-207 kernel: [37548.557016] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 15:49:34 juju-e4d256-prod-github-runner-207 kernel: [37548.558253] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:49:34 juju-e4d256-prod-github-runner-207 kernel: [37548.559315] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 15:49:34 juju-e4d256-prod-github-runner-207 kernel: [37548.562051] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 15:49:34 juju-e4d256-prod-github-runner-207 kernel: [37548.563107] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 15:49:34 juju-e4d256-prod-github-runner-207 kernel: [37548.564271] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 15:49:34 juju-e4d256-prod-github-runner-207 kernel: [37548.565553] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 15:49:34 juju-e4d256-prod-github-runner-207 kernel: [37548.566722] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 15:49:34 juju-e4d256-prod-github-runner-207 kernel: [37548.567892] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 15:49:34 juju-e4d256-prod-github-runner-207 kernel: [37548.569157] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 15:49:34 juju-e4d256-prod-github-runner-207 kernel: [37548.570418] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 15:49:34 juju-e4d256-prod-github-runner-207 kernel: [37548.571519] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 15:49:34 juju-e4d256-prod-github-runner-207 kernel: [37548.572820] Call Trace: Aug 22 15:49:34 juju-e4d256-prod-github-runner-207 kernel: [37548.573808] Aug 22 15:49:34 juju-e4d256-prod-github-runner-207 kernel: [37548.574696] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:49:34 juju-e4d256-prod-github-runner-207 kernel: [37548.575731] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:49:34 juju-e4d256-prod-github-runner-207 kernel: [37548.576843] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:49:34 juju-e4d256-prod-github-runner-207 kernel: [37548.577950] ? show_regs.part.0+0x23/0x29 Aug 22 15:49:34 juju-e4d256-prod-github-runner-207 kernel: [37548.578949] ? show_regs.cold+0x8/0xd Aug 22 15:49:34 juju-e4d256-prod-github-runner-207 kernel: [37548.579929] ? watchdog_timer_fn+0x1be/0x220 Aug 22 15:49:34 juju-e4d256-prod-github-runner-207 kernel: [37548.581023] ? lockup_detector_update_enable+0x60/0x60 Aug 22 15:49:34 juju-e4d256-prod-github-runner-207 kernel: [37548.582094] ? __hrtimer_run_queues+0x107/0x230 Aug 22 15:49:34 juju-e4d256-prod-github-runner-207 kernel: [37548.583131] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 15:49:34 juju-e4d256-prod-github-runner-207 kernel: [37548.584156] ? hrtimer_interrupt+0x101/0x220 Aug 22 15:49:34 juju-e4d256-prod-github-runner-207 kernel: [37548.585250] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 15:49:34 juju-e4d256-prod-github-runner-207 kernel: [37548.586332] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 15:49:34 juju-e4d256-prod-github-runner-207 kernel: [37548.587379] Aug 22 15:49:34 juju-e4d256-prod-github-runner-207 kernel: [37548.588235] Aug 22 15:49:34 juju-e4d256-prod-github-runner-207 kernel: [37548.589152] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 15:49:34 juju-e4d256-prod-github-runner-207 kernel: [37548.590199] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:49:34 juju-e4d256-prod-github-runner-207 kernel: [37548.591242] ? _raw_spin_lock+0x22/0x30 Aug 22 15:49:34 juju-e4d256-prod-github-runner-207 kernel: [37548.592195] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:49:34 juju-e4d256-prod-github-runner-207 kernel: [37548.593579] direct_page_fault+0x206/0x310 [kvm] Aug 22 15:49:34 juju-e4d256-prod-github-runner-207 kernel: [37548.594626] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 15:49:34 juju-e4d256-prod-github-runner-207 kernel: [37548.595640] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 15:49:34 juju-e4d256-prod-github-runner-207 kernel: [37548.596690] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 15:49:34 juju-e4d256-prod-github-runner-207 kernel: [37548.597725] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 15:49:34 juju-e4d256-prod-github-runner-207 kernel: [37548.598674] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 15:49:34 juju-e4d256-prod-github-runner-207 kernel: [37548.599651] handle_exit+0x98/0x230 [kvm_amd] Aug 22 15:49:34 juju-e4d256-prod-github-runner-207 kernel: [37548.600561] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 15:49:34 juju-e4d256-prod-github-runner-207 kernel: [37548.601762] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 15:49:34 juju-e4d256-prod-github-runner-207 kernel: [37548.602696] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 15:49:34 juju-e4d256-prod-github-runner-207 kernel: [37548.603604] vcpu_run+0x62/0x2c0 [kvm] Aug 22 15:49:34 juju-e4d256-prod-github-runner-207 kernel: [37548.604417] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 15:49:34 juju-e4d256-prod-github-runner-207 kernel: [37548.605391] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 15:49:34 juju-e4d256-prod-github-runner-207 kernel: [37548.606260] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 15:49:34 juju-e4d256-prod-github-runner-207 kernel: [37548.607058] ? __seccomp_filter+0x4a/0x4a0 Aug 22 15:49:34 juju-e4d256-prod-github-runner-207 kernel: [37548.607804] ? __fget_files+0x86/0xc0 Aug 22 15:49:34 juju-e4d256-prod-github-runner-207 kernel: [37548.608514] __x64_sys_ioctl+0x95/0xd0 Aug 22 15:49:34 juju-e4d256-prod-github-runner-207 kernel: [37548.609350] do_syscall_64+0x5c/0xc0 Aug 22 15:49:34 juju-e4d256-prod-github-runner-207 kernel: [37548.610022] ? do_futex+0x162/0x1f0 Aug 22 15:49:34 juju-e4d256-prod-github-runner-207 kernel: [37548.610672] ? __x64_sys_futex+0x78/0x1e0 Aug 22 15:49:34 juju-e4d256-prod-github-runner-207 kernel: [37548.611352] ? __secure_computing+0xa9/0x120 Aug 22 15:49:34 juju-e4d256-prod-github-runner-207 kernel: [37548.612042] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 15:49:34 juju-e4d256-prod-github-runner-207 kernel: [37548.612901] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:49:34 juju-e4d256-prod-github-runner-207 kernel: [37548.613718] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:49:34 juju-e4d256-prod-github-runner-207 kernel: [37548.614448] ? do_syscall_64+0x69/0xc0 Aug 22 15:49:34 juju-e4d256-prod-github-runner-207 kernel: [37548.615094] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:49:34 juju-e4d256-prod-github-runner-207 kernel: [37548.615802] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:49:34 juju-e4d256-prod-github-runner-207 kernel: [37548.616498] ? do_syscall_64+0x69/0xc0 Aug 22 15:49:34 juju-e4d256-prod-github-runner-207 kernel: [37548.617249] ? do_syscall_64+0x69/0xc0 Aug 22 15:49:34 juju-e4d256-prod-github-runner-207 kernel: [37548.617888] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 15:49:34 juju-e4d256-prod-github-runner-207 kernel: [37548.618595] RIP: 0033:0x7faa5d0edaff Aug 22 15:49:34 juju-e4d256-prod-github-runner-207 kernel: [37548.619222] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 15:49:34 juju-e4d256-prod-github-runner-207 kernel: [37548.621331] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 15:49:34 juju-e4d256-prod-github-runner-207 kernel: [37548.622253] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 15:49:34 juju-e4d256-prod-github-runner-207 kernel: [37548.623146] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 15:49:34 juju-e4d256-prod-github-runner-207 kernel: [37548.624049] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 15:49:34 juju-e4d256-prod-github-runner-207 kernel: [37548.625014] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 15:49:34 juju-e4d256-prod-github-runner-207 kernel: [37548.625919] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 15:49:34 juju-e4d256-prod-github-runner-207 kernel: [37548.626822] Aug 22 15:50:02 juju-e4d256-prod-github-runner-207 kernel: [37576.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 34887s! [qemu-system-x86:6715] Aug 22 15:50:02 juju-e4d256-prod-github-runner-207 kernel: [37576.543715] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 15:50:02 juju-e4d256-prod-github-runner-207 kernel: [37576.543963] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 15:50:02 juju-e4d256-prod-github-runner-207 kernel: [37576.556059] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 15:50:02 juju-e4d256-prod-github-runner-207 kernel: [37576.557352] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 15:50:02 juju-e4d256-prod-github-runner-207 kernel: [37576.558574] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:50:02 juju-e4d256-prod-github-runner-207 kernel: [37576.559630] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 15:50:02 juju-e4d256-prod-github-runner-207 kernel: [37576.562190] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 15:50:02 juju-e4d256-prod-github-runner-207 kernel: [37576.563231] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 15:50:02 juju-e4d256-prod-github-runner-207 kernel: [37576.564404] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 15:50:02 juju-e4d256-prod-github-runner-207 kernel: [37576.565571] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 15:50:02 juju-e4d256-prod-github-runner-207 kernel: [37576.566729] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 15:50:02 juju-e4d256-prod-github-runner-207 kernel: [37576.567893] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 15:50:02 juju-e4d256-prod-github-runner-207 kernel: [37576.569078] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 15:50:02 juju-e4d256-prod-github-runner-207 kernel: [37576.570307] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 15:50:02 juju-e4d256-prod-github-runner-207 kernel: [37576.571436] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 15:50:02 juju-e4d256-prod-github-runner-207 kernel: [37576.572638] Call Trace: Aug 22 15:50:02 juju-e4d256-prod-github-runner-207 kernel: [37576.573550] Aug 22 15:50:02 juju-e4d256-prod-github-runner-207 kernel: [37576.574445] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:50:02 juju-e4d256-prod-github-runner-207 kernel: [37576.575479] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:50:02 juju-e4d256-prod-github-runner-207 kernel: [37576.576517] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:50:02 juju-e4d256-prod-github-runner-207 kernel: [37576.577612] ? show_regs.part.0+0x23/0x29 Aug 22 15:50:02 juju-e4d256-prod-github-runner-207 kernel: [37576.578608] ? show_regs.cold+0x8/0xd Aug 22 15:50:02 juju-e4d256-prod-github-runner-207 kernel: [37576.579577] ? watchdog_timer_fn+0x1be/0x220 Aug 22 15:50:02 juju-e4d256-prod-github-runner-207 kernel: [37576.580596] ? lockup_detector_update_enable+0x60/0x60 Aug 22 15:50:02 juju-e4d256-prod-github-runner-207 kernel: [37576.581664] ? __hrtimer_run_queues+0x107/0x230 Aug 22 15:50:02 juju-e4d256-prod-github-runner-207 kernel: [37576.582695] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 15:50:02 juju-e4d256-prod-github-runner-207 kernel: [37576.583723] ? hrtimer_interrupt+0x101/0x220 Aug 22 15:50:02 juju-e4d256-prod-github-runner-207 kernel: [37576.584753] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 15:50:02 juju-e4d256-prod-github-runner-207 kernel: [37576.585829] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 15:50:02 juju-e4d256-prod-github-runner-207 kernel: [37576.586878] Aug 22 15:50:02 juju-e4d256-prod-github-runner-207 kernel: [37576.587736] Aug 22 15:50:02 juju-e4d256-prod-github-runner-207 kernel: [37576.588587] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 15:50:02 juju-e4d256-prod-github-runner-207 kernel: [37576.589620] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:50:02 juju-e4d256-prod-github-runner-207 kernel: [37576.590664] ? _raw_spin_lock+0x22/0x30 Aug 22 15:50:02 juju-e4d256-prod-github-runner-207 kernel: [37576.591615] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:50:02 juju-e4d256-prod-github-runner-207 kernel: [37576.592644] direct_page_fault+0x206/0x310 [kvm] Aug 22 15:50:02 juju-e4d256-prod-github-runner-207 kernel: [37576.593669] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 15:50:02 juju-e4d256-prod-github-runner-207 kernel: [37576.594683] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 15:50:02 juju-e4d256-prod-github-runner-207 kernel: [37576.595685] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 15:50:02 juju-e4d256-prod-github-runner-207 kernel: [37576.596692] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 15:50:02 juju-e4d256-prod-github-runner-207 kernel: [37576.597644] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 15:50:02 juju-e4d256-prod-github-runner-207 kernel: [37576.598622] handle_exit+0x98/0x230 [kvm_amd] Aug 22 15:50:02 juju-e4d256-prod-github-runner-207 kernel: [37576.599514] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 15:50:02 juju-e4d256-prod-github-runner-207 kernel: [37576.600446] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 15:50:02 juju-e4d256-prod-github-runner-207 kernel: [37576.601379] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 15:50:02 juju-e4d256-prod-github-runner-207 kernel: [37576.602288] vcpu_run+0x62/0x2c0 [kvm] Aug 22 15:50:02 juju-e4d256-prod-github-runner-207 kernel: [37576.603104] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 15:50:02 juju-e4d256-prod-github-runner-207 kernel: [37576.603910] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 15:50:02 juju-e4d256-prod-github-runner-207 kernel: [37576.604773] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 15:50:02 juju-e4d256-prod-github-runner-207 kernel: [37576.605579] ? __seccomp_filter+0x4a/0x4a0 Aug 22 15:50:02 juju-e4d256-prod-github-runner-207 kernel: [37576.606328] ? __fget_files+0x86/0xc0 Aug 22 15:50:02 juju-e4d256-prod-github-runner-207 kernel: [37576.607032] __x64_sys_ioctl+0x95/0xd0 Aug 22 15:50:02 juju-e4d256-prod-github-runner-207 kernel: [37576.607724] do_syscall_64+0x5c/0xc0 Aug 22 15:50:02 juju-e4d256-prod-github-runner-207 kernel: [37576.608407] ? do_futex+0x162/0x1f0 Aug 22 15:50:02 juju-e4d256-prod-github-runner-207 kernel: [37576.609058] ? __x64_sys_futex+0x78/0x1e0 Aug 22 15:50:02 juju-e4d256-prod-github-runner-207 kernel: [37576.609735] ? __secure_computing+0xa9/0x120 Aug 22 15:50:02 juju-e4d256-prod-github-runner-207 kernel: [37576.610431] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 15:50:02 juju-e4d256-prod-github-runner-207 kernel: [37576.611189] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:50:02 juju-e4d256-prod-github-runner-207 kernel: [37576.611911] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:50:02 juju-e4d256-prod-github-runner-207 kernel: [37576.612652] ? do_syscall_64+0x69/0xc0 Aug 22 15:50:02 juju-e4d256-prod-github-runner-207 kernel: [37576.613302] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:50:02 juju-e4d256-prod-github-runner-207 kernel: [37576.614004] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:50:02 juju-e4d256-prod-github-runner-207 kernel: [37576.614724] ? do_syscall_64+0x69/0xc0 Aug 22 15:50:02 juju-e4d256-prod-github-runner-207 kernel: [37576.615359] ? do_syscall_64+0x69/0xc0 Aug 22 15:50:02 juju-e4d256-prod-github-runner-207 kernel: [37576.615981] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 15:50:02 juju-e4d256-prod-github-runner-207 kernel: [37576.616696] RIP: 0033:0x7faa5d0edaff Aug 22 15:50:02 juju-e4d256-prod-github-runner-207 kernel: [37576.617341] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 15:50:02 juju-e4d256-prod-github-runner-207 kernel: [37576.619338] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 15:50:02 juju-e4d256-prod-github-runner-207 kernel: [37576.620262] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 15:50:02 juju-e4d256-prod-github-runner-207 kernel: [37576.621154] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 15:50:02 juju-e4d256-prod-github-runner-207 kernel: [37576.622043] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 15:50:02 juju-e4d256-prod-github-runner-207 kernel: [37576.622941] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 15:50:02 juju-e4d256-prod-github-runner-207 kernel: [37576.623830] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 15:50:02 juju-e4d256-prod-github-runner-207 kernel: [37576.624729] Aug 22 15:50:30 juju-e4d256-prod-github-runner-207 kernel: [37604.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 34913s! [qemu-system-x86:6715] Aug 22 15:50:30 juju-e4d256-prod-github-runner-207 kernel: [37604.543075] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 15:50:30 juju-e4d256-prod-github-runner-207 kernel: [37604.543142] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 15:50:30 juju-e4d256-prod-github-runner-207 kernel: [37604.555314] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 15:50:30 juju-e4d256-prod-github-runner-207 kernel: [37604.556621] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 15:50:30 juju-e4d256-prod-github-runner-207 kernel: [37604.557848] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:50:30 juju-e4d256-prod-github-runner-207 kernel: [37604.558906] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 15:50:30 juju-e4d256-prod-github-runner-207 kernel: [37604.561471] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 15:50:30 juju-e4d256-prod-github-runner-207 kernel: [37604.562638] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 15:50:30 juju-e4d256-prod-github-runner-207 kernel: [37604.563968] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 15:50:30 juju-e4d256-prod-github-runner-207 kernel: [37604.565273] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 15:50:30 juju-e4d256-prod-github-runner-207 kernel: [37604.566578] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 15:50:30 juju-e4d256-prod-github-runner-207 kernel: [37604.567952] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 15:50:30 juju-e4d256-prod-github-runner-207 kernel: [37604.569269] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 15:50:30 juju-e4d256-prod-github-runner-207 kernel: [37604.570514] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 15:50:30 juju-e4d256-prod-github-runner-207 kernel: [37604.571629] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 15:50:30 juju-e4d256-prod-github-runner-207 kernel: [37604.572851] Call Trace: Aug 22 15:50:30 juju-e4d256-prod-github-runner-207 kernel: [37604.573830] Aug 22 15:50:30 juju-e4d256-prod-github-runner-207 kernel: [37604.574731] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:50:30 juju-e4d256-prod-github-runner-207 kernel: [37604.575973] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:50:30 juju-e4d256-prod-github-runner-207 kernel: [37604.577023] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:50:30 juju-e4d256-prod-github-runner-207 kernel: [37604.578109] ? show_regs.part.0+0x23/0x29 Aug 22 15:50:30 juju-e4d256-prod-github-runner-207 kernel: [37604.579113] ? show_regs.cold+0x8/0xd Aug 22 15:50:30 juju-e4d256-prod-github-runner-207 kernel: [37604.580131] ? watchdog_timer_fn+0x1be/0x220 Aug 22 15:50:30 juju-e4d256-prod-github-runner-207 kernel: [37604.581170] ? lockup_detector_update_enable+0x60/0x60 Aug 22 15:50:30 juju-e4d256-prod-github-runner-207 kernel: [37604.582269] ? __hrtimer_run_queues+0x107/0x230 Aug 22 15:50:30 juju-e4d256-prod-github-runner-207 kernel: [37604.583391] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 15:50:30 juju-e4d256-prod-github-runner-207 kernel: [37604.584450] ? hrtimer_interrupt+0x101/0x220 Aug 22 15:50:30 juju-e4d256-prod-github-runner-207 kernel: [37604.585475] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 15:50:30 juju-e4d256-prod-github-runner-207 kernel: [37604.586569] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 15:50:30 juju-e4d256-prod-github-runner-207 kernel: [37604.587644] Aug 22 15:50:30 juju-e4d256-prod-github-runner-207 kernel: [37604.588565] Aug 22 15:50:30 juju-e4d256-prod-github-runner-207 kernel: [37604.589420] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 15:50:30 juju-e4d256-prod-github-runner-207 kernel: [37604.590459] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:50:30 juju-e4d256-prod-github-runner-207 kernel: [37604.591519] ? _raw_spin_lock+0x22/0x30 Aug 22 15:50:30 juju-e4d256-prod-github-runner-207 kernel: [37604.592498] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:50:30 juju-e4d256-prod-github-runner-207 kernel: [37604.593531] direct_page_fault+0x206/0x310 [kvm] Aug 22 15:50:30 juju-e4d256-prod-github-runner-207 kernel: [37604.594619] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 15:50:30 juju-e4d256-prod-github-runner-207 kernel: [37604.595842] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 15:50:30 juju-e4d256-prod-github-runner-207 kernel: [37604.597000] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 15:50:30 juju-e4d256-prod-github-runner-207 kernel: [37604.598082] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 15:50:30 juju-e4d256-prod-github-runner-207 kernel: [37604.599146] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 15:50:30 juju-e4d256-prod-github-runner-207 kernel: [37604.600306] handle_exit+0x98/0x230 [kvm_amd] Aug 22 15:50:30 juju-e4d256-prod-github-runner-207 kernel: [37604.601296] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 15:50:30 juju-e4d256-prod-github-runner-207 kernel: [37604.602455] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 15:50:30 juju-e4d256-prod-github-runner-207 kernel: [37604.603473] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 15:50:30 juju-e4d256-prod-github-runner-207 kernel: [37604.604500] vcpu_run+0x62/0x2c0 [kvm] Aug 22 15:50:30 juju-e4d256-prod-github-runner-207 kernel: [37604.605393] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 15:50:30 juju-e4d256-prod-github-runner-207 kernel: [37604.606285] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 15:50:30 juju-e4d256-prod-github-runner-207 kernel: [37604.607241] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 15:50:30 juju-e4d256-prod-github-runner-207 kernel: [37604.608143] ? __seccomp_filter+0x4a/0x4a0 Aug 22 15:50:30 juju-e4d256-prod-github-runner-207 kernel: [37604.608983] ? __fget_files+0x86/0xc0 Aug 22 15:50:30 juju-e4d256-prod-github-runner-207 kernel: [37604.609761] __x64_sys_ioctl+0x95/0xd0 Aug 22 15:50:30 juju-e4d256-prod-github-runner-207 kernel: [37604.610526] do_syscall_64+0x5c/0xc0 Aug 22 15:50:30 juju-e4d256-prod-github-runner-207 kernel: [37604.611259] ? do_futex+0x162/0x1f0 Aug 22 15:50:30 juju-e4d256-prod-github-runner-207 kernel: [37604.611998] ? __x64_sys_futex+0x78/0x1e0 Aug 22 15:50:30 juju-e4d256-prod-github-runner-207 kernel: [37604.612763] ? __secure_computing+0xa9/0x120 Aug 22 15:50:30 juju-e4d256-prod-github-runner-207 kernel: [37604.613540] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 15:50:30 juju-e4d256-prod-github-runner-207 kernel: [37604.614418] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:50:30 juju-e4d256-prod-github-runner-207 kernel: [37604.615233] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:50:30 juju-e4d256-prod-github-runner-207 kernel: [37604.616069] ? do_syscall_64+0x69/0xc0 Aug 22 15:50:30 juju-e4d256-prod-github-runner-207 kernel: [37604.616791] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:50:30 juju-e4d256-prod-github-runner-207 kernel: [37604.617589] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:50:30 juju-e4d256-prod-github-runner-207 kernel: [37604.618381] ? do_syscall_64+0x69/0xc0 Aug 22 15:50:30 juju-e4d256-prod-github-runner-207 kernel: [37604.619081] ? do_syscall_64+0x69/0xc0 Aug 22 15:50:30 juju-e4d256-prod-github-runner-207 kernel: [37604.619780] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 15:50:30 juju-e4d256-prod-github-runner-207 kernel: [37604.620652] RIP: 0033:0x7faa5d0edaff Aug 22 15:50:30 juju-e4d256-prod-github-runner-207 kernel: [37604.621352] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 15:50:30 juju-e4d256-prod-github-runner-207 kernel: [37604.623773] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 15:50:30 juju-e4d256-prod-github-runner-207 kernel: [37604.624840] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 15:50:30 juju-e4d256-prod-github-runner-207 kernel: [37604.625874] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 15:50:30 juju-e4d256-prod-github-runner-207 kernel: [37604.626894] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 15:50:30 juju-e4d256-prod-github-runner-207 kernel: [37604.627944] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 15:50:30 juju-e4d256-prod-github-runner-207 kernel: [37604.628972] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 15:50:30 juju-e4d256-prod-github-runner-207 kernel: [37604.630000] Aug 22 15:50:45 juju-e4d256-prod-github-runner-207 kernel: [37619.696706] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 15:50:45 juju-e4d256-prod-github-runner-207 kernel: [37619.697678] rcu: 1-....: (9346197 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=4517178 Aug 22 15:50:45 juju-e4d256-prod-github-runner-207 kernel: [37619.698806] (t=9375624 jiffies g=23269 q=39037) Aug 22 15:50:45 juju-e4d256-prod-github-runner-207 kernel: [37619.699592] NMI backtrace for cpu 1 Aug 22 15:50:45 juju-e4d256-prod-github-runner-207 kernel: [37619.700335] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 15:50:45 juju-e4d256-prod-github-runner-207 kernel: [37619.701436] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 15:50:45 juju-e4d256-prod-github-runner-207 kernel: [37619.702506] Call Trace: Aug 22 15:50:45 juju-e4d256-prod-github-runner-207 kernel: [37619.703199] Aug 22 15:50:45 juju-e4d256-prod-github-runner-207 kernel: [37619.703864] show_stack+0x52/0x5c Aug 22 15:50:45 juju-e4d256-prod-github-runner-207 kernel: [37619.704593] dump_stack_lvl+0x4a/0x63 Aug 22 15:50:45 juju-e4d256-prod-github-runner-207 kernel: [37619.705347] dump_stack+0x10/0x16 Aug 22 15:50:45 juju-e4d256-prod-github-runner-207 kernel: [37619.706071] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 15:50:45 juju-e4d256-prod-github-runner-207 kernel: [37619.706848] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 15:50:45 juju-e4d256-prod-github-runner-207 kernel: [37619.707633] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 15:50:45 juju-e4d256-prod-github-runner-207 kernel: [37619.708465] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 15:50:45 juju-e4d256-prod-github-runner-207 kernel: [37619.709280] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 15:50:45 juju-e4d256-prod-github-runner-207 kernel: [37619.710093] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 15:50:45 juju-e4d256-prod-github-runner-207 kernel: [37619.710864] print_cpu_stall.cold+0x2f/0xe2 Aug 22 15:50:45 juju-e4d256-prod-github-runner-207 kernel: [37619.711626] ? timekeeping_update+0xf7/0x150 Aug 22 15:50:45 juju-e4d256-prod-github-runner-207 kernel: [37619.712404] check_cpu_stall+0x109/0x270 Aug 22 15:50:45 juju-e4d256-prod-github-runner-207 kernel: [37619.713149] rcu_sched_clock_irq+0x9a/0x250 Aug 22 15:50:45 juju-e4d256-prod-github-runner-207 kernel: [37619.713917] update_process_times+0x94/0xd0 Aug 22 15:50:45 juju-e4d256-prod-github-runner-207 kernel: [37619.714674] tick_sched_handle+0x29/0x70 Aug 22 15:50:45 juju-e4d256-prod-github-runner-207 kernel: [37619.715432] tick_sched_timer+0x8c/0xc0 Aug 22 15:50:45 juju-e4d256-prod-github-runner-207 kernel: [37619.716184] ? tick_nohz_handler+0xb0/0xb0 Aug 22 15:50:45 juju-e4d256-prod-github-runner-207 kernel: [37619.716944] __hrtimer_run_queues+0x107/0x230 Aug 22 15:50:45 juju-e4d256-prod-github-runner-207 kernel: [37619.717723] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 15:50:45 juju-e4d256-prod-github-runner-207 kernel: [37619.718497] hrtimer_interrupt+0x101/0x220 Aug 22 15:50:45 juju-e4d256-prod-github-runner-207 kernel: [37619.719254] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 15:50:45 juju-e4d256-prod-github-runner-207 kernel: [37619.720081] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 15:50:45 juju-e4d256-prod-github-runner-207 kernel: [37619.720892] Aug 22 15:50:45 juju-e4d256-prod-github-runner-207 kernel: [37619.721527] Aug 22 15:50:45 juju-e4d256-prod-github-runner-207 kernel: [37619.722153] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 15:50:45 juju-e4d256-prod-github-runner-207 kernel: [37619.722977] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:50:45 juju-e4d256-prod-github-runner-207 kernel: [37619.723878] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 15:50:45 juju-e4d256-prod-github-runner-207 kernel: [37619.726085] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 15:50:45 juju-e4d256-prod-github-runner-207 kernel: [37619.726966] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 15:50:45 juju-e4d256-prod-github-runner-207 kernel: [37619.727973] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 15:50:45 juju-e4d256-prod-github-runner-207 kernel: [37619.728950] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 15:50:45 juju-e4d256-prod-github-runner-207 kernel: [37619.729913] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 15:50:45 juju-e4d256-prod-github-runner-207 kernel: [37619.730881] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 15:50:45 juju-e4d256-prod-github-runner-207 kernel: [37619.731854] ? _raw_spin_lock+0x22/0x30 Aug 22 15:50:45 juju-e4d256-prod-github-runner-207 kernel: [37619.732618] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:50:45 juju-e4d256-prod-github-runner-207 kernel: [37619.733467] direct_page_fault+0x206/0x310 [kvm] Aug 22 15:50:45 juju-e4d256-prod-github-runner-207 kernel: [37619.734309] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 15:50:45 juju-e4d256-prod-github-runner-207 kernel: [37619.735138] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 15:50:45 juju-e4d256-prod-github-runner-207 kernel: [37619.735992] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 15:50:45 juju-e4d256-prod-github-runner-207 kernel: [37619.736799] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 15:50:45 juju-e4d256-prod-github-runner-207 kernel: [37619.737584] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 15:50:45 juju-e4d256-prod-github-runner-207 kernel: [37619.738408] handle_exit+0x98/0x230 [kvm_amd] Aug 22 15:50:45 juju-e4d256-prod-github-runner-207 kernel: [37619.739163] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 15:50:45 juju-e4d256-prod-github-runner-207 kernel: [37619.739968] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 15:50:45 juju-e4d256-prod-github-runner-207 kernel: [37619.740767] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 15:50:45 juju-e4d256-prod-github-runner-207 kernel: [37619.741564] vcpu_run+0x62/0x2c0 [kvm] Aug 22 15:50:45 juju-e4d256-prod-github-runner-207 kernel: [37619.742281] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 15:50:45 juju-e4d256-prod-github-runner-207 kernel: [37619.743018] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 15:50:45 juju-e4d256-prod-github-runner-207 kernel: [37619.743840] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 15:50:45 juju-e4d256-prod-github-runner-207 kernel: [37619.744603] ? __seccomp_filter+0x4a/0x4a0 Aug 22 15:50:45 juju-e4d256-prod-github-runner-207 kernel: [37619.745324] ? __fget_files+0x86/0xc0 Aug 22 15:50:45 juju-e4d256-prod-github-runner-207 kernel: [37619.746021] __x64_sys_ioctl+0x95/0xd0 Aug 22 15:50:45 juju-e4d256-prod-github-runner-207 kernel: [37619.746727] do_syscall_64+0x5c/0xc0 Aug 22 15:50:45 juju-e4d256-prod-github-runner-207 kernel: [37619.747410] ? do_futex+0x162/0x1f0 Aug 22 15:50:45 juju-e4d256-prod-github-runner-207 kernel: [37619.748104] ? __x64_sys_futex+0x78/0x1e0 Aug 22 15:50:45 juju-e4d256-prod-github-runner-207 kernel: [37619.748816] ? __secure_computing+0xa9/0x120 Aug 22 15:50:45 juju-e4d256-prod-github-runner-207 kernel: [37619.749532] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 15:50:45 juju-e4d256-prod-github-runner-207 kernel: [37619.750322] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:50:45 juju-e4d256-prod-github-runner-207 kernel: [37619.751075] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:50:45 juju-e4d256-prod-github-runner-207 kernel: [37619.751858] ? do_syscall_64+0x69/0xc0 Aug 22 15:50:45 juju-e4d256-prod-github-runner-207 kernel: [37619.752553] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:50:45 juju-e4d256-prod-github-runner-207 kernel: [37619.753309] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:50:45 juju-e4d256-prod-github-runner-207 kernel: [37619.754094] ? do_syscall_64+0x69/0xc0 Aug 22 15:50:45 juju-e4d256-prod-github-runner-207 kernel: [37619.754812] ? do_syscall_64+0x69/0xc0 Aug 22 15:50:45 juju-e4d256-prod-github-runner-207 kernel: [37619.755499] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 15:50:45 juju-e4d256-prod-github-runner-207 kernel: [37619.756304] RIP: 0033:0x7faa5d0edaff Aug 22 15:50:45 juju-e4d256-prod-github-runner-207 kernel: [37619.757011] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 15:50:45 juju-e4d256-prod-github-runner-207 kernel: [37619.759109] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 15:50:45 juju-e4d256-prod-github-runner-207 kernel: [37619.760105] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 15:50:45 juju-e4d256-prod-github-runner-207 kernel: [37619.761048] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 15:50:45 juju-e4d256-prod-github-runner-207 kernel: [37619.762011] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 15:50:45 juju-e4d256-prod-github-runner-207 kernel: [37619.762963] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 15:50:45 juju-e4d256-prod-github-runner-207 kernel: [37619.763902] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 15:50:45 juju-e4d256-prod-github-runner-207 kernel: [37619.764829] Aug 22 15:51:10 juju-e4d256-prod-github-runner-207 kernel: [37644.541981] watchdog: BUG: soft lockup - CPU#1 stuck for 34951s! [qemu-system-x86:6715] Aug 22 15:51:10 juju-e4d256-prod-github-runner-207 kernel: [37644.543101] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 15:51:10 juju-e4d256-prod-github-runner-207 kernel: [37644.543169] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 15:51:10 juju-e4d256-prod-github-runner-207 kernel: [37644.555605] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 15:51:10 juju-e4d256-prod-github-runner-207 kernel: [37644.557088] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 15:51:10 juju-e4d256-prod-github-runner-207 kernel: [37644.558493] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:51:10 juju-e4d256-prod-github-runner-207 kernel: [37644.559846] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 15:51:10 juju-e4d256-prod-github-runner-207 kernel: [37644.562741] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 15:51:10 juju-e4d256-prod-github-runner-207 kernel: [37644.563909] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 15:51:10 juju-e4d256-prod-github-runner-207 kernel: [37644.565225] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 15:51:10 juju-e4d256-prod-github-runner-207 kernel: [37644.566530] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 15:51:10 juju-e4d256-prod-github-runner-207 kernel: [37644.567828] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 15:51:10 juju-e4d256-prod-github-runner-207 kernel: [37644.569239] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 15:51:10 juju-e4d256-prod-github-runner-207 kernel: [37644.570555] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 15:51:10 juju-e4d256-prod-github-runner-207 kernel: [37644.571980] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 15:51:10 juju-e4d256-prod-github-runner-207 kernel: [37644.573200] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 15:51:10 juju-e4d256-prod-github-runner-207 kernel: [37644.574541] Call Trace: Aug 22 15:51:10 juju-e4d256-prod-github-runner-207 kernel: [37644.575584] Aug 22 15:51:10 juju-e4d256-prod-github-runner-207 kernel: [37644.576569] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:51:10 juju-e4d256-prod-github-runner-207 kernel: [37644.577702] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:51:10 juju-e4d256-prod-github-runner-207 kernel: [37644.578814] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:51:10 juju-e4d256-prod-github-runner-207 kernel: [37644.580040] ? show_regs.part.0+0x23/0x29 Aug 22 15:51:10 juju-e4d256-prod-github-runner-207 kernel: [37644.581065] ? show_regs.cold+0x8/0xd Aug 22 15:51:10 juju-e4d256-prod-github-runner-207 kernel: [37644.582045] ? watchdog_timer_fn+0x1be/0x220 Aug 22 15:51:10 juju-e4d256-prod-github-runner-207 kernel: [37644.583056] ? lockup_detector_update_enable+0x60/0x60 Aug 22 15:51:10 juju-e4d256-prod-github-runner-207 kernel: [37644.584144] ? __hrtimer_run_queues+0x107/0x230 Aug 22 15:51:10 juju-e4d256-prod-github-runner-207 kernel: [37644.585174] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 15:51:10 juju-e4d256-prod-github-runner-207 kernel: [37644.586202] ? hrtimer_interrupt+0x101/0x220 Aug 22 15:51:10 juju-e4d256-prod-github-runner-207 kernel: [37644.587364] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 15:51:10 juju-e4d256-prod-github-runner-207 kernel: [37644.588454] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 15:51:10 juju-e4d256-prod-github-runner-207 kernel: [37644.589503] Aug 22 15:51:10 juju-e4d256-prod-github-runner-207 kernel: [37644.590363] Aug 22 15:51:10 juju-e4d256-prod-github-runner-207 kernel: [37644.591202] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 15:51:10 juju-e4d256-prod-github-runner-207 kernel: [37644.592256] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:51:10 juju-e4d256-prod-github-runner-207 kernel: [37644.593303] ? _raw_spin_lock+0x22/0x30 Aug 22 15:51:10 juju-e4d256-prod-github-runner-207 kernel: [37644.594248] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:51:10 juju-e4d256-prod-github-runner-207 kernel: [37644.595268] direct_page_fault+0x206/0x310 [kvm] Aug 22 15:51:10 juju-e4d256-prod-github-runner-207 kernel: [37644.596311] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 15:51:10 juju-e4d256-prod-github-runner-207 kernel: [37644.597326] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 15:51:10 juju-e4d256-prod-github-runner-207 kernel: [37644.598330] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 15:51:10 juju-e4d256-prod-github-runner-207 kernel: [37644.599300] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 15:51:10 juju-e4d256-prod-github-runner-207 kernel: [37644.600270] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 15:51:10 juju-e4d256-prod-github-runner-207 kernel: [37644.601250] handle_exit+0x98/0x230 [kvm_amd] Aug 22 15:51:10 juju-e4d256-prod-github-runner-207 kernel: [37644.602149] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 15:51:10 juju-e4d256-prod-github-runner-207 kernel: [37644.603069] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 15:51:10 juju-e4d256-prod-github-runner-207 kernel: [37644.604008] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 15:51:10 juju-e4d256-prod-github-runner-207 kernel: [37644.604915] vcpu_run+0x62/0x2c0 [kvm] Aug 22 15:51:10 juju-e4d256-prod-github-runner-207 kernel: [37644.605724] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 15:51:10 juju-e4d256-prod-github-runner-207 kernel: [37644.606529] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 15:51:10 juju-e4d256-prod-github-runner-207 kernel: [37644.607385] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 15:51:10 juju-e4d256-prod-github-runner-207 kernel: [37644.608198] ? __seccomp_filter+0x4a/0x4a0 Aug 22 15:51:10 juju-e4d256-prod-github-runner-207 kernel: [37644.608944] ? __fget_files+0x86/0xc0 Aug 22 15:51:10 juju-e4d256-prod-github-runner-207 kernel: [37644.609647] __x64_sys_ioctl+0x95/0xd0 Aug 22 15:51:10 juju-e4d256-prod-github-runner-207 kernel: [37644.610342] do_syscall_64+0x5c/0xc0 Aug 22 15:51:10 juju-e4d256-prod-github-runner-207 kernel: [37644.611005] ? do_futex+0x162/0x1f0 Aug 22 15:51:10 juju-e4d256-prod-github-runner-207 kernel: [37644.611664] ? __x64_sys_futex+0x78/0x1e0 Aug 22 15:51:10 juju-e4d256-prod-github-runner-207 kernel: [37644.612336] ? __secure_computing+0xa9/0x120 Aug 22 15:51:10 juju-e4d256-prod-github-runner-207 kernel: [37644.613024] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 15:51:10 juju-e4d256-prod-github-runner-207 kernel: [37644.613783] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:51:10 juju-e4d256-prod-github-runner-207 kernel: [37644.614502] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:51:10 juju-e4d256-prod-github-runner-207 kernel: [37644.615222] ? do_syscall_64+0x69/0xc0 Aug 22 15:51:10 juju-e4d256-prod-github-runner-207 kernel: [37644.615873] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:51:10 juju-e4d256-prod-github-runner-207 kernel: [37644.616573] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:51:10 juju-e4d256-prod-github-runner-207 kernel: [37644.617274] ? do_syscall_64+0x69/0xc0 Aug 22 15:51:10 juju-e4d256-prod-github-runner-207 kernel: [37644.617902] ? do_syscall_64+0x69/0xc0 Aug 22 15:51:10 juju-e4d256-prod-github-runner-207 kernel: [37644.618526] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 15:51:10 juju-e4d256-prod-github-runner-207 kernel: [37644.619229] RIP: 0033:0x7faa5d0edaff Aug 22 15:51:10 juju-e4d256-prod-github-runner-207 kernel: [37644.619863] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 15:51:10 juju-e4d256-prod-github-runner-207 kernel: [37644.621842] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 15:51:10 juju-e4d256-prod-github-runner-207 kernel: [37644.622755] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 15:51:10 juju-e4d256-prod-github-runner-207 kernel: [37644.623655] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 15:51:10 juju-e4d256-prod-github-runner-207 kernel: [37644.624540] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 15:51:10 juju-e4d256-prod-github-runner-207 kernel: [37644.625428] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 15:51:10 juju-e4d256-prod-github-runner-207 kernel: [37644.626311] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 15:51:10 juju-e4d256-prod-github-runner-207 kernel: [37644.627199] Aug 22 15:51:38 juju-e4d256-prod-github-runner-207 kernel: [37672.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 34977s! [qemu-system-x86:6715] Aug 22 15:51:38 juju-e4d256-prod-github-runner-207 kernel: [37672.543735] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 15:51:38 juju-e4d256-prod-github-runner-207 kernel: [37672.543980] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 15:51:38 juju-e4d256-prod-github-runner-207 kernel: [37672.556058] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 15:51:38 juju-e4d256-prod-github-runner-207 kernel: [37672.557328] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 15:51:38 juju-e4d256-prod-github-runner-207 kernel: [37672.558542] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:51:38 juju-e4d256-prod-github-runner-207 kernel: [37672.559614] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 15:51:38 juju-e4d256-prod-github-runner-207 kernel: [37672.562165] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 15:51:38 juju-e4d256-prod-github-runner-207 kernel: [37672.563213] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 15:51:38 juju-e4d256-prod-github-runner-207 kernel: [37672.564372] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 15:51:38 juju-e4d256-prod-github-runner-207 kernel: [37672.565532] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 15:51:38 juju-e4d256-prod-github-runner-207 kernel: [37672.566696] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 15:51:38 juju-e4d256-prod-github-runner-207 kernel: [37672.567863] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 15:51:38 juju-e4d256-prod-github-runner-207 kernel: [37672.569032] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 15:51:38 juju-e4d256-prod-github-runner-207 kernel: [37672.570262] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 15:51:38 juju-e4d256-prod-github-runner-207 kernel: [37672.571375] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 15:51:38 juju-e4d256-prod-github-runner-207 kernel: [37672.572567] Call Trace: Aug 22 15:51:38 juju-e4d256-prod-github-runner-207 kernel: [37672.573478] Aug 22 15:51:38 juju-e4d256-prod-github-runner-207 kernel: [37672.574374] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:51:38 juju-e4d256-prod-github-runner-207 kernel: [37672.575414] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:51:38 juju-e4d256-prod-github-runner-207 kernel: [37672.576438] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:51:38 juju-e4d256-prod-github-runner-207 kernel: [37672.577534] ? show_regs.part.0+0x23/0x29 Aug 22 15:51:38 juju-e4d256-prod-github-runner-207 kernel: [37672.578527] ? show_regs.cold+0x8/0xd Aug 22 15:51:38 juju-e4d256-prod-github-runner-207 kernel: [37672.579516] ? watchdog_timer_fn+0x1be/0x220 Aug 22 15:51:38 juju-e4d256-prod-github-runner-207 kernel: [37672.580529] ? lockup_detector_update_enable+0x60/0x60 Aug 22 15:51:38 juju-e4d256-prod-github-runner-207 kernel: [37672.581592] ? __hrtimer_run_queues+0x107/0x230 Aug 22 15:51:38 juju-e4d256-prod-github-runner-207 kernel: [37672.582618] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 15:51:38 juju-e4d256-prod-github-runner-207 kernel: [37672.583650] ? hrtimer_interrupt+0x101/0x220 Aug 22 15:51:38 juju-e4d256-prod-github-runner-207 kernel: [37672.584669] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 15:51:38 juju-e4d256-prod-github-runner-207 kernel: [37672.585741] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 15:51:38 juju-e4d256-prod-github-runner-207 kernel: [37672.586789] Aug 22 15:51:38 juju-e4d256-prod-github-runner-207 kernel: [37672.587658] Aug 22 15:51:38 juju-e4d256-prod-github-runner-207 kernel: [37672.588494] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 15:51:38 juju-e4d256-prod-github-runner-207 kernel: [37672.589527] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:51:38 juju-e4d256-prod-github-runner-207 kernel: [37672.590570] ? _raw_spin_lock+0x22/0x30 Aug 22 15:51:38 juju-e4d256-prod-github-runner-207 kernel: [37672.591529] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:51:38 juju-e4d256-prod-github-runner-207 kernel: [37672.592543] direct_page_fault+0x206/0x310 [kvm] Aug 22 15:51:38 juju-e4d256-prod-github-runner-207 kernel: [37672.593571] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 15:51:38 juju-e4d256-prod-github-runner-207 kernel: [37672.594579] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 15:51:38 juju-e4d256-prod-github-runner-207 kernel: [37672.595599] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 15:51:38 juju-e4d256-prod-github-runner-207 kernel: [37672.596586] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 15:51:38 juju-e4d256-prod-github-runner-207 kernel: [37672.597548] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 15:51:38 juju-e4d256-prod-github-runner-207 kernel: [37672.598526] handle_exit+0x98/0x230 [kvm_amd] Aug 22 15:51:38 juju-e4d256-prod-github-runner-207 kernel: [37672.599434] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 15:51:38 juju-e4d256-prod-github-runner-207 kernel: [37672.600353] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 15:51:38 juju-e4d256-prod-github-runner-207 kernel: [37672.601277] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 15:51:38 juju-e4d256-prod-github-runner-207 kernel: [37672.602186] vcpu_run+0x62/0x2c0 [kvm] Aug 22 15:51:38 juju-e4d256-prod-github-runner-207 kernel: [37672.602996] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 15:51:38 juju-e4d256-prod-github-runner-207 kernel: [37672.603810] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 15:51:38 juju-e4d256-prod-github-runner-207 kernel: [37672.604663] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 15:51:38 juju-e4d256-prod-github-runner-207 kernel: [37672.605460] ? __seccomp_filter+0x4a/0x4a0 Aug 22 15:51:38 juju-e4d256-prod-github-runner-207 kernel: [37672.606200] ? __fget_files+0x86/0xc0 Aug 22 15:51:38 juju-e4d256-prod-github-runner-207 kernel: [37672.606902] __x64_sys_ioctl+0x95/0xd0 Aug 22 15:51:38 juju-e4d256-prod-github-runner-207 kernel: [37672.607608] do_syscall_64+0x5c/0xc0 Aug 22 15:51:38 juju-e4d256-prod-github-runner-207 kernel: [37672.608271] ? do_futex+0x162/0x1f0 Aug 22 15:51:38 juju-e4d256-prod-github-runner-207 kernel: [37672.608918] ? __x64_sys_futex+0x78/0x1e0 Aug 22 15:51:38 juju-e4d256-prod-github-runner-207 kernel: [37672.609594] ? __secure_computing+0xa9/0x120 Aug 22 15:51:38 juju-e4d256-prod-github-runner-207 kernel: [37672.610282] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 15:51:38 juju-e4d256-prod-github-runner-207 kernel: [37672.611041] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:51:38 juju-e4d256-prod-github-runner-207 kernel: [37672.611775] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:51:38 juju-e4d256-prod-github-runner-207 kernel: [37672.612491] ? do_syscall_64+0x69/0xc0 Aug 22 15:51:38 juju-e4d256-prod-github-runner-207 kernel: [37672.613139] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:51:38 juju-e4d256-prod-github-runner-207 kernel: [37672.613841] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:51:38 juju-e4d256-prod-github-runner-207 kernel: [37672.614540] ? do_syscall_64+0x69/0xc0 Aug 22 15:51:38 juju-e4d256-prod-github-runner-207 kernel: [37672.615180] ? do_syscall_64+0x69/0xc0 Aug 22 15:51:38 juju-e4d256-prod-github-runner-207 kernel: [37672.615801] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 15:51:38 juju-e4d256-prod-github-runner-207 kernel: [37672.616504] RIP: 0033:0x7faa5d0edaff Aug 22 15:51:38 juju-e4d256-prod-github-runner-207 kernel: [37672.617148] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 15:51:38 juju-e4d256-prod-github-runner-207 kernel: [37672.619171] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 15:51:38 juju-e4d256-prod-github-runner-207 kernel: [37672.620088] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 15:51:38 juju-e4d256-prod-github-runner-207 kernel: [37672.620979] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 15:51:38 juju-e4d256-prod-github-runner-207 kernel: [37672.621882] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 15:51:38 juju-e4d256-prod-github-runner-207 kernel: [37672.622768] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 15:51:38 juju-e4d256-prod-github-runner-207 kernel: [37672.623667] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 15:51:38 juju-e4d256-prod-github-runner-207 kernel: [37672.624558] Aug 22 15:52:06 juju-e4d256-prod-github-runner-207 kernel: [37700.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 35003s! [qemu-system-x86:6715] Aug 22 15:52:06 juju-e4d256-prod-github-runner-207 kernel: [37700.543116] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 15:52:06 juju-e4d256-prod-github-runner-207 kernel: [37700.543184] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 15:52:06 juju-e4d256-prod-github-runner-207 kernel: [37700.555262] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 15:52:06 juju-e4d256-prod-github-runner-207 kernel: [37700.556533] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 15:52:06 juju-e4d256-prod-github-runner-207 kernel: [37700.557749] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:52:06 juju-e4d256-prod-github-runner-207 kernel: [37700.558826] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 15:52:06 juju-e4d256-prod-github-runner-207 kernel: [37700.561395] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 15:52:06 juju-e4d256-prod-github-runner-207 kernel: [37700.562446] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 15:52:06 juju-e4d256-prod-github-runner-207 kernel: [37700.563626] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 15:52:06 juju-e4d256-prod-github-runner-207 kernel: [37700.564783] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 15:52:06 juju-e4d256-prod-github-runner-207 kernel: [37700.565953] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 15:52:06 juju-e4d256-prod-github-runner-207 kernel: [37700.567126] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 15:52:06 juju-e4d256-prod-github-runner-207 kernel: [37700.568295] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 15:52:06 juju-e4d256-prod-github-runner-207 kernel: [37700.569525] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 15:52:06 juju-e4d256-prod-github-runner-207 kernel: [37700.570626] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 15:52:06 juju-e4d256-prod-github-runner-207 kernel: [37700.571836] Call Trace: Aug 22 15:52:06 juju-e4d256-prod-github-runner-207 kernel: [37700.572746] Aug 22 15:52:06 juju-e4d256-prod-github-runner-207 kernel: [37700.573631] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:52:06 juju-e4d256-prod-github-runner-207 kernel: [37700.574664] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:52:06 juju-e4d256-prod-github-runner-207 kernel: [37700.575692] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:52:06 juju-e4d256-prod-github-runner-207 kernel: [37700.576824] ? show_regs.part.0+0x23/0x29 Aug 22 15:52:06 juju-e4d256-prod-github-runner-207 kernel: [37700.577834] ? show_regs.cold+0x8/0xd Aug 22 15:52:06 juju-e4d256-prod-github-runner-207 kernel: [37700.578852] ? watchdog_timer_fn+0x1be/0x220 Aug 22 15:52:06 juju-e4d256-prod-github-runner-207 kernel: [37700.579864] ? lockup_detector_update_enable+0x60/0x60 Aug 22 15:52:06 juju-e4d256-prod-github-runner-207 kernel: [37700.580940] ? __hrtimer_run_queues+0x107/0x230 Aug 22 15:52:06 juju-e4d256-prod-github-runner-207 kernel: [37700.581980] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 15:52:06 juju-e4d256-prod-github-runner-207 kernel: [37700.583031] ? hrtimer_interrupt+0x101/0x220 Aug 22 15:52:06 juju-e4d256-prod-github-runner-207 kernel: [37700.584049] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 15:52:06 juju-e4d256-prod-github-runner-207 kernel: [37700.585116] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 15:52:06 juju-e4d256-prod-github-runner-207 kernel: [37700.586181] Aug 22 15:52:06 juju-e4d256-prod-github-runner-207 kernel: [37700.587069] Aug 22 15:52:06 juju-e4d256-prod-github-runner-207 kernel: [37700.587909] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 15:52:06 juju-e4d256-prod-github-runner-207 kernel: [37700.588945] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:52:06 juju-e4d256-prod-github-runner-207 kernel: [37700.589983] ? _raw_spin_lock+0x22/0x30 Aug 22 15:52:06 juju-e4d256-prod-github-runner-207 kernel: [37700.590949] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:52:06 juju-e4d256-prod-github-runner-207 kernel: [37700.591994] direct_page_fault+0x206/0x310 [kvm] Aug 22 15:52:06 juju-e4d256-prod-github-runner-207 kernel: [37700.593024] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 15:52:06 juju-e4d256-prod-github-runner-207 kernel: [37700.594032] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 15:52:06 juju-e4d256-prod-github-runner-207 kernel: [37700.595048] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 15:52:06 juju-e4d256-prod-github-runner-207 kernel: [37700.596026] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 15:52:06 juju-e4d256-prod-github-runner-207 kernel: [37700.597002] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 15:52:06 juju-e4d256-prod-github-runner-207 kernel: [37700.597982] handle_exit+0x98/0x230 [kvm_amd] Aug 22 15:52:06 juju-e4d256-prod-github-runner-207 kernel: [37700.598891] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 15:52:06 juju-e4d256-prod-github-runner-207 kernel: [37700.599803] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 15:52:06 juju-e4d256-prod-github-runner-207 kernel: [37700.600724] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 15:52:06 juju-e4d256-prod-github-runner-207 kernel: [37700.601636] vcpu_run+0x62/0x2c0 [kvm] Aug 22 15:52:06 juju-e4d256-prod-github-runner-207 kernel: [37700.602455] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 15:52:06 juju-e4d256-prod-github-runner-207 kernel: [37700.603275] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 15:52:06 juju-e4d256-prod-github-runner-207 kernel: [37700.604127] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 15:52:06 juju-e4d256-prod-github-runner-207 kernel: [37700.604921] ? __seccomp_filter+0x4a/0x4a0 Aug 22 15:52:06 juju-e4d256-prod-github-runner-207 kernel: [37700.605661] ? __fget_files+0x86/0xc0 Aug 22 15:52:06 juju-e4d256-prod-github-runner-207 kernel: [37700.606371] __x64_sys_ioctl+0x95/0xd0 Aug 22 15:52:06 juju-e4d256-prod-github-runner-207 kernel: [37700.607121] do_syscall_64+0x5c/0xc0 Aug 22 15:52:06 juju-e4d256-prod-github-runner-207 kernel: [37700.607792] ? do_futex+0x162/0x1f0 Aug 22 15:52:06 juju-e4d256-prod-github-runner-207 kernel: [37700.608440] ? __x64_sys_futex+0x78/0x1e0 Aug 22 15:52:06 juju-e4d256-prod-github-runner-207 kernel: [37700.609145] ? __secure_computing+0xa9/0x120 Aug 22 15:52:06 juju-e4d256-prod-github-runner-207 kernel: [37700.609847] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 15:52:06 juju-e4d256-prod-github-runner-207 kernel: [37700.610608] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:52:06 juju-e4d256-prod-github-runner-207 kernel: [37700.611384] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:52:06 juju-e4d256-prod-github-runner-207 kernel: [37700.612112] ? do_syscall_64+0x69/0xc0 Aug 22 15:52:06 juju-e4d256-prod-github-runner-207 kernel: [37700.612772] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:52:06 juju-e4d256-prod-github-runner-207 kernel: [37700.613474] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:52:06 juju-e4d256-prod-github-runner-207 kernel: [37700.614165] ? do_syscall_64+0x69/0xc0 Aug 22 15:52:06 juju-e4d256-prod-github-runner-207 kernel: [37700.614811] ? do_syscall_64+0x69/0xc0 Aug 22 15:52:06 juju-e4d256-prod-github-runner-207 kernel: [37700.615594] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 15:52:06 juju-e4d256-prod-github-runner-207 kernel: [37700.616304] RIP: 0033:0x7faa5d0edaff Aug 22 15:52:06 juju-e4d256-prod-github-runner-207 kernel: [37700.616931] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 15:52:06 juju-e4d256-prod-github-runner-207 kernel: [37700.618955] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 15:52:06 juju-e4d256-prod-github-runner-207 kernel: [37700.619867] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 15:52:06 juju-e4d256-prod-github-runner-207 kernel: [37700.620761] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 15:52:06 juju-e4d256-prod-github-runner-207 kernel: [37700.621659] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 15:52:06 juju-e4d256-prod-github-runner-207 kernel: [37700.622557] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 15:52:06 juju-e4d256-prod-github-runner-207 kernel: [37700.623465] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 15:52:06 juju-e4d256-prod-github-runner-207 kernel: [37700.624354] Aug 22 15:52:34 juju-e4d256-prod-github-runner-207 kernel: [37728.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 35029s! [qemu-system-x86:6715] Aug 22 15:52:34 juju-e4d256-prod-github-runner-207 kernel: [37728.543152] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 15:52:34 juju-e4d256-prod-github-runner-207 kernel: [37728.543230] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 15:52:34 juju-e4d256-prod-github-runner-207 kernel: [37728.555472] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 15:52:34 juju-e4d256-prod-github-runner-207 kernel: [37728.556741] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 15:52:34 juju-e4d256-prod-github-runner-207 kernel: [37728.557977] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:52:34 juju-e4d256-prod-github-runner-207 kernel: [37728.559051] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 15:52:34 juju-e4d256-prod-github-runner-207 kernel: [37728.561616] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 15:52:34 juju-e4d256-prod-github-runner-207 kernel: [37728.562694] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 15:52:34 juju-e4d256-prod-github-runner-207 kernel: [37728.563870] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 15:52:34 juju-e4d256-prod-github-runner-207 kernel: [37728.565023] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 15:52:34 juju-e4d256-prod-github-runner-207 kernel: [37728.566192] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 15:52:34 juju-e4d256-prod-github-runner-207 kernel: [37728.567375] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 15:52:34 juju-e4d256-prod-github-runner-207 kernel: [37728.568541] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 15:52:34 juju-e4d256-prod-github-runner-207 kernel: [37728.569779] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 15:52:34 juju-e4d256-prod-github-runner-207 kernel: [37728.570895] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 15:52:34 juju-e4d256-prod-github-runner-207 kernel: [37728.572095] Call Trace: Aug 22 15:52:34 juju-e4d256-prod-github-runner-207 kernel: [37728.573049] Aug 22 15:52:34 juju-e4d256-prod-github-runner-207 kernel: [37728.573935] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:52:34 juju-e4d256-prod-github-runner-207 kernel: [37728.575231] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:52:34 juju-e4d256-prod-github-runner-207 kernel: [37728.576328] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:52:34 juju-e4d256-prod-github-runner-207 kernel: [37728.577420] ? show_regs.part.0+0x23/0x29 Aug 22 15:52:34 juju-e4d256-prod-github-runner-207 kernel: [37728.578416] ? show_regs.cold+0x8/0xd Aug 22 15:52:34 juju-e4d256-prod-github-runner-207 kernel: [37728.579403] ? watchdog_timer_fn+0x1be/0x220 Aug 22 15:52:34 juju-e4d256-prod-github-runner-207 kernel: [37728.580414] ? lockup_detector_update_enable+0x60/0x60 Aug 22 15:52:34 juju-e4d256-prod-github-runner-207 kernel: [37728.581514] ? __hrtimer_run_queues+0x107/0x230 Aug 22 15:52:34 juju-e4d256-prod-github-runner-207 kernel: [37728.582555] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 15:52:34 juju-e4d256-prod-github-runner-207 kernel: [37728.583578] ? hrtimer_interrupt+0x101/0x220 Aug 22 15:52:34 juju-e4d256-prod-github-runner-207 kernel: [37728.584599] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 15:52:34 juju-e4d256-prod-github-runner-207 kernel: [37728.585667] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 15:52:34 juju-e4d256-prod-github-runner-207 kernel: [37728.586735] Aug 22 15:52:34 juju-e4d256-prod-github-runner-207 kernel: [37728.587589] Aug 22 15:52:34 juju-e4d256-prod-github-runner-207 kernel: [37728.588510] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 15:52:34 juju-e4d256-prod-github-runner-207 kernel: [37728.589542] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:52:34 juju-e4d256-prod-github-runner-207 kernel: [37728.590594] ? _raw_spin_lock+0x22/0x30 Aug 22 15:52:34 juju-e4d256-prod-github-runner-207 kernel: [37728.591538] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:52:34 juju-e4d256-prod-github-runner-207 kernel: [37728.592567] direct_page_fault+0x206/0x310 [kvm] Aug 22 15:52:34 juju-e4d256-prod-github-runner-207 kernel: [37728.593611] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 15:52:34 juju-e4d256-prod-github-runner-207 kernel: [37728.594632] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 15:52:34 juju-e4d256-prod-github-runner-207 kernel: [37728.595636] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 15:52:34 juju-e4d256-prod-github-runner-207 kernel: [37728.596602] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 15:52:34 juju-e4d256-prod-github-runner-207 kernel: [37728.597546] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 15:52:34 juju-e4d256-prod-github-runner-207 kernel: [37728.598543] handle_exit+0x98/0x230 [kvm_amd] Aug 22 15:52:34 juju-e4d256-prod-github-runner-207 kernel: [37728.599433] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 15:52:34 juju-e4d256-prod-github-runner-207 kernel: [37728.600347] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 15:52:34 juju-e4d256-prod-github-runner-207 kernel: [37728.601267] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 15:52:34 juju-e4d256-prod-github-runner-207 kernel: [37728.602169] vcpu_run+0x62/0x2c0 [kvm] Aug 22 15:52:34 juju-e4d256-prod-github-runner-207 kernel: [37728.602999] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 15:52:34 juju-e4d256-prod-github-runner-207 kernel: [37728.603804] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 15:52:34 juju-e4d256-prod-github-runner-207 kernel: [37728.604658] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 15:52:34 juju-e4d256-prod-github-runner-207 kernel: [37728.605570] ? __seccomp_filter+0x4a/0x4a0 Aug 22 15:52:34 juju-e4d256-prod-github-runner-207 kernel: [37728.606355] ? __fget_files+0x86/0xc0 Aug 22 15:52:34 juju-e4d256-prod-github-runner-207 kernel: [37728.607082] __x64_sys_ioctl+0x95/0xd0 Aug 22 15:52:34 juju-e4d256-prod-github-runner-207 kernel: [37728.607773] do_syscall_64+0x5c/0xc0 Aug 22 15:52:34 juju-e4d256-prod-github-runner-207 kernel: [37728.608438] ? do_futex+0x162/0x1f0 Aug 22 15:52:34 juju-e4d256-prod-github-runner-207 kernel: [37728.609085] ? __x64_sys_futex+0x78/0x1e0 Aug 22 15:52:34 juju-e4d256-prod-github-runner-207 kernel: [37728.609757] ? __secure_computing+0xa9/0x120 Aug 22 15:52:34 juju-e4d256-prod-github-runner-207 kernel: [37728.610465] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 15:52:34 juju-e4d256-prod-github-runner-207 kernel: [37728.611221] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:52:34 juju-e4d256-prod-github-runner-207 kernel: [37728.611946] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:52:34 juju-e4d256-prod-github-runner-207 kernel: [37728.612667] ? do_syscall_64+0x69/0xc0 Aug 22 15:52:34 juju-e4d256-prod-github-runner-207 kernel: [37728.613311] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:52:34 juju-e4d256-prod-github-runner-207 kernel: [37728.614017] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:52:34 juju-e4d256-prod-github-runner-207 kernel: [37728.614729] ? do_syscall_64+0x69/0xc0 Aug 22 15:52:34 juju-e4d256-prod-github-runner-207 kernel: [37728.615352] ? do_syscall_64+0x69/0xc0 Aug 22 15:52:34 juju-e4d256-prod-github-runner-207 kernel: [37728.615976] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 15:52:34 juju-e4d256-prod-github-runner-207 kernel: [37728.616683] RIP: 0033:0x7faa5d0edaff Aug 22 15:52:34 juju-e4d256-prod-github-runner-207 kernel: [37728.617305] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 15:52:34 juju-e4d256-prod-github-runner-207 kernel: [37728.619302] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 15:52:34 juju-e4d256-prod-github-runner-207 kernel: [37728.620215] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 15:52:34 juju-e4d256-prod-github-runner-207 kernel: [37728.621116] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 15:52:34 juju-e4d256-prod-github-runner-207 kernel: [37728.622001] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 15:52:34 juju-e4d256-prod-github-runner-207 kernel: [37728.622917] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 15:52:34 juju-e4d256-prod-github-runner-207 kernel: [37728.623809] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 15:52:34 juju-e4d256-prod-github-runner-207 kernel: [37728.624695] Aug 22 15:53:02 juju-e4d256-prod-github-runner-207 kernel: [37756.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 35055s! [qemu-system-x86:6715] Aug 22 15:53:02 juju-e4d256-prod-github-runner-207 kernel: [37756.543717] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 15:53:02 juju-e4d256-prod-github-runner-207 kernel: [37756.543979] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 15:53:02 juju-e4d256-prod-github-runner-207 kernel: [37756.556027] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 15:53:02 juju-e4d256-prod-github-runner-207 kernel: [37756.557294] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 15:53:02 juju-e4d256-prod-github-runner-207 kernel: [37756.558525] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:53:02 juju-e4d256-prod-github-runner-207 kernel: [37756.559613] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 15:53:02 juju-e4d256-prod-github-runner-207 kernel: [37756.562161] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 15:53:02 juju-e4d256-prod-github-runner-207 kernel: [37756.563279] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 15:53:02 juju-e4d256-prod-github-runner-207 kernel: [37756.564441] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 15:53:02 juju-e4d256-prod-github-runner-207 kernel: [37756.565599] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 15:53:02 juju-e4d256-prod-github-runner-207 kernel: [37756.566776] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 15:53:02 juju-e4d256-prod-github-runner-207 kernel: [37756.567939] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 15:53:02 juju-e4d256-prod-github-runner-207 kernel: [37756.569101] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 15:53:02 juju-e4d256-prod-github-runner-207 kernel: [37756.570348] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 15:53:02 juju-e4d256-prod-github-runner-207 kernel: [37756.571460] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 15:53:02 juju-e4d256-prod-github-runner-207 kernel: [37756.572658] Call Trace: Aug 22 15:53:02 juju-e4d256-prod-github-runner-207 kernel: [37756.573572] Aug 22 15:53:02 juju-e4d256-prod-github-runner-207 kernel: [37756.574486] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:53:02 juju-e4d256-prod-github-runner-207 kernel: [37756.575517] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:53:02 juju-e4d256-prod-github-runner-207 kernel: [37756.576543] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:53:02 juju-e4d256-prod-github-runner-207 kernel: [37756.577632] ? show_regs.part.0+0x23/0x29 Aug 22 15:53:02 juju-e4d256-prod-github-runner-207 kernel: [37756.578637] ? show_regs.cold+0x8/0xd Aug 22 15:53:02 juju-e4d256-prod-github-runner-207 kernel: [37756.579609] ? watchdog_timer_fn+0x1be/0x220 Aug 22 15:53:02 juju-e4d256-prod-github-runner-207 kernel: [37756.580617] ? lockup_detector_update_enable+0x60/0x60 Aug 22 15:53:02 juju-e4d256-prod-github-runner-207 kernel: [37756.581680] ? __hrtimer_run_queues+0x107/0x230 Aug 22 15:53:02 juju-e4d256-prod-github-runner-207 kernel: [37756.582727] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 15:53:02 juju-e4d256-prod-github-runner-207 kernel: [37756.583752] ? hrtimer_interrupt+0x101/0x220 Aug 22 15:53:02 juju-e4d256-prod-github-runner-207 kernel: [37756.584778] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 15:53:02 juju-e4d256-prod-github-runner-207 kernel: [37756.585847] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 15:53:02 juju-e4d256-prod-github-runner-207 kernel: [37756.586905] Aug 22 15:53:02 juju-e4d256-prod-github-runner-207 kernel: [37756.587758] Aug 22 15:53:02 juju-e4d256-prod-github-runner-207 kernel: [37756.588595] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 15:53:02 juju-e4d256-prod-github-runner-207 kernel: [37756.589627] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:53:02 juju-e4d256-prod-github-runner-207 kernel: [37756.590677] ? _raw_spin_lock+0x22/0x30 Aug 22 15:53:02 juju-e4d256-prod-github-runner-207 kernel: [37756.591622] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:53:02 juju-e4d256-prod-github-runner-207 kernel: [37756.592642] direct_page_fault+0x206/0x310 [kvm] Aug 22 15:53:02 juju-e4d256-prod-github-runner-207 kernel: [37756.593666] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 15:53:02 juju-e4d256-prod-github-runner-207 kernel: [37756.594683] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 15:53:02 juju-e4d256-prod-github-runner-207 kernel: [37756.595683] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 15:53:02 juju-e4d256-prod-github-runner-207 kernel: [37756.596687] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 15:53:02 juju-e4d256-prod-github-runner-207 kernel: [37756.597634] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 15:53:02 juju-e4d256-prod-github-runner-207 kernel: [37756.598637] handle_exit+0x98/0x230 [kvm_amd] Aug 22 15:53:02 juju-e4d256-prod-github-runner-207 kernel: [37756.599528] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 15:53:02 juju-e4d256-prod-github-runner-207 kernel: [37756.600446] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 15:53:02 juju-e4d256-prod-github-runner-207 kernel: [37756.601375] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 15:53:02 juju-e4d256-prod-github-runner-207 kernel: [37756.602293] vcpu_run+0x62/0x2c0 [kvm] Aug 22 15:53:02 juju-e4d256-prod-github-runner-207 kernel: [37756.603104] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 15:53:02 juju-e4d256-prod-github-runner-207 kernel: [37756.603910] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 15:53:02 juju-e4d256-prod-github-runner-207 kernel: [37756.604762] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 15:53:02 juju-e4d256-prod-github-runner-207 kernel: [37756.605561] ? __seccomp_filter+0x4a/0x4a0 Aug 22 15:53:02 juju-e4d256-prod-github-runner-207 kernel: [37756.606314] ? __fget_files+0x86/0xc0 Aug 22 15:53:02 juju-e4d256-prod-github-runner-207 kernel: [37756.607017] __x64_sys_ioctl+0x95/0xd0 Aug 22 15:53:02 juju-e4d256-prod-github-runner-207 kernel: [37756.607709] do_syscall_64+0x5c/0xc0 Aug 22 15:53:02 juju-e4d256-prod-github-runner-207 kernel: [37756.608392] ? do_futex+0x162/0x1f0 Aug 22 15:53:02 juju-e4d256-prod-github-runner-207 kernel: [37756.609043] ? __x64_sys_futex+0x78/0x1e0 Aug 22 15:53:02 juju-e4d256-prod-github-runner-207 kernel: [37756.609716] ? __secure_computing+0xa9/0x120 Aug 22 15:53:02 juju-e4d256-prod-github-runner-207 kernel: [37756.610419] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 15:53:02 juju-e4d256-prod-github-runner-207 kernel: [37756.611184] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:53:02 juju-e4d256-prod-github-runner-207 kernel: [37756.611905] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:53:02 juju-e4d256-prod-github-runner-207 kernel: [37756.612621] ? do_syscall_64+0x69/0xc0 Aug 22 15:53:02 juju-e4d256-prod-github-runner-207 kernel: [37756.613267] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:53:02 juju-e4d256-prod-github-runner-207 kernel: [37756.613975] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:53:02 juju-e4d256-prod-github-runner-207 kernel: [37756.614684] ? do_syscall_64+0x69/0xc0 Aug 22 15:53:02 juju-e4d256-prod-github-runner-207 kernel: [37756.615308] ? do_syscall_64+0x69/0xc0 Aug 22 15:53:02 juju-e4d256-prod-github-runner-207 kernel: [37756.615930] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 15:53:02 juju-e4d256-prod-github-runner-207 kernel: [37756.616636] RIP: 0033:0x7faa5d0edaff Aug 22 15:53:02 juju-e4d256-prod-github-runner-207 kernel: [37756.617282] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 15:53:02 juju-e4d256-prod-github-runner-207 kernel: [37756.619277] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 15:53:02 juju-e4d256-prod-github-runner-207 kernel: [37756.620186] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 15:53:02 juju-e4d256-prod-github-runner-207 kernel: [37756.621093] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 15:53:02 juju-e4d256-prod-github-runner-207 kernel: [37756.621987] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 15:53:02 juju-e4d256-prod-github-runner-207 kernel: [37756.622893] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 15:53:02 juju-e4d256-prod-github-runner-207 kernel: [37756.623782] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 15:53:02 juju-e4d256-prod-github-runner-207 kernel: [37756.624681] Aug 22 15:53:30 juju-e4d256-prod-github-runner-207 kernel: [37784.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 35081s! [qemu-system-x86:6715] Aug 22 15:53:30 juju-e4d256-prod-github-runner-207 kernel: [37784.543099] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 15:53:30 juju-e4d256-prod-github-runner-207 kernel: [37784.543168] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 15:53:30 juju-e4d256-prod-github-runner-207 kernel: [37784.555293] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 15:53:30 juju-e4d256-prod-github-runner-207 kernel: [37784.556568] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 15:53:30 juju-e4d256-prod-github-runner-207 kernel: [37784.557809] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:53:30 juju-e4d256-prod-github-runner-207 kernel: [37784.558876] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 15:53:30 juju-e4d256-prod-github-runner-207 kernel: [37784.561443] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 15:53:30 juju-e4d256-prod-github-runner-207 kernel: [37784.562504] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 15:53:30 juju-e4d256-prod-github-runner-207 kernel: [37784.563685] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 15:53:30 juju-e4d256-prod-github-runner-207 kernel: [37784.564858] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 15:53:30 juju-e4d256-prod-github-runner-207 kernel: [37784.566033] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 15:53:30 juju-e4d256-prod-github-runner-207 kernel: [37784.567194] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 15:53:30 juju-e4d256-prod-github-runner-207 kernel: [37784.568367] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 15:53:30 juju-e4d256-prod-github-runner-207 kernel: [37784.569597] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 15:53:30 juju-e4d256-prod-github-runner-207 kernel: [37784.570721] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 15:53:30 juju-e4d256-prod-github-runner-207 kernel: [37784.571924] Call Trace: Aug 22 15:53:30 juju-e4d256-prod-github-runner-207 kernel: [37784.572850] Aug 22 15:53:30 juju-e4d256-prod-github-runner-207 kernel: [37784.573743] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:53:30 juju-e4d256-prod-github-runner-207 kernel: [37784.574791] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:53:30 juju-e4d256-prod-github-runner-207 kernel: [37784.575820] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:53:30 juju-e4d256-prod-github-runner-207 kernel: [37784.576893] ? show_regs.part.0+0x23/0x29 Aug 22 15:53:30 juju-e4d256-prod-github-runner-207 kernel: [37784.577903] ? show_regs.cold+0x8/0xd Aug 22 15:53:30 juju-e4d256-prod-github-runner-207 kernel: [37784.578930] ? watchdog_timer_fn+0x1be/0x220 Aug 22 15:53:30 juju-e4d256-prod-github-runner-207 kernel: [37784.579939] ? lockup_detector_update_enable+0x60/0x60 Aug 22 15:53:30 juju-e4d256-prod-github-runner-207 kernel: [37784.581008] ? __hrtimer_run_queues+0x107/0x230 Aug 22 15:53:30 juju-e4d256-prod-github-runner-207 kernel: [37784.582062] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 15:53:30 juju-e4d256-prod-github-runner-207 kernel: [37784.583102] ? hrtimer_interrupt+0x101/0x220 Aug 22 15:53:30 juju-e4d256-prod-github-runner-207 kernel: [37784.584124] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 15:53:30 juju-e4d256-prod-github-runner-207 kernel: [37784.585197] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 15:53:30 juju-e4d256-prod-github-runner-207 kernel: [37784.586268] Aug 22 15:53:30 juju-e4d256-prod-github-runner-207 kernel: [37784.587123] Aug 22 15:53:30 juju-e4d256-prod-github-runner-207 kernel: [37784.587976] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 15:53:30 juju-e4d256-prod-github-runner-207 kernel: [37784.589023] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:53:30 juju-e4d256-prod-github-runner-207 kernel: [37784.590085] ? _raw_spin_lock+0x22/0x30 Aug 22 15:53:30 juju-e4d256-prod-github-runner-207 kernel: [37784.591198] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:53:30 juju-e4d256-prod-github-runner-207 kernel: [37784.592292] direct_page_fault+0x206/0x310 [kvm] Aug 22 15:53:30 juju-e4d256-prod-github-runner-207 kernel: [37784.593329] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 15:53:30 juju-e4d256-prod-github-runner-207 kernel: [37784.594357] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 15:53:30 juju-e4d256-prod-github-runner-207 kernel: [37784.595359] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 15:53:30 juju-e4d256-prod-github-runner-207 kernel: [37784.596337] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 15:53:30 juju-e4d256-prod-github-runner-207 kernel: [37784.597288] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 15:53:30 juju-e4d256-prod-github-runner-207 kernel: [37784.598283] handle_exit+0x98/0x230 [kvm_amd] Aug 22 15:53:30 juju-e4d256-prod-github-runner-207 kernel: [37784.599176] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 15:53:30 juju-e4d256-prod-github-runner-207 kernel: [37784.600115] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 15:53:30 juju-e4d256-prod-github-runner-207 kernel: [37784.601051] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 15:53:30 juju-e4d256-prod-github-runner-207 kernel: [37784.601977] vcpu_run+0x62/0x2c0 [kvm] Aug 22 15:53:30 juju-e4d256-prod-github-runner-207 kernel: [37784.602803] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 15:53:30 juju-e4d256-prod-github-runner-207 kernel: [37784.603613] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 15:53:30 juju-e4d256-prod-github-runner-207 kernel: [37784.604474] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 15:53:30 juju-e4d256-prod-github-runner-207 kernel: [37784.605275] ? __seccomp_filter+0x4a/0x4a0 Aug 22 15:53:30 juju-e4d256-prod-github-runner-207 kernel: [37784.606034] ? __fget_files+0x86/0xc0 Aug 22 15:53:30 juju-e4d256-prod-github-runner-207 kernel: [37784.606743] __x64_sys_ioctl+0x95/0xd0 Aug 22 15:53:30 juju-e4d256-prod-github-runner-207 kernel: [37784.607440] do_syscall_64+0x5c/0xc0 Aug 22 15:53:30 juju-e4d256-prod-github-runner-207 kernel: [37784.608104] ? do_futex+0x162/0x1f0 Aug 22 15:53:30 juju-e4d256-prod-github-runner-207 kernel: [37784.608756] ? __x64_sys_futex+0x78/0x1e0 Aug 22 15:53:30 juju-e4d256-prod-github-runner-207 kernel: [37784.609439] ? __secure_computing+0xa9/0x120 Aug 22 15:53:30 juju-e4d256-prod-github-runner-207 kernel: [37784.610147] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 15:53:30 juju-e4d256-prod-github-runner-207 kernel: [37784.610924] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:53:30 juju-e4d256-prod-github-runner-207 kernel: [37784.611657] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:53:30 juju-e4d256-prod-github-runner-207 kernel: [37784.612378] ? do_syscall_64+0x69/0xc0 Aug 22 15:53:30 juju-e4d256-prod-github-runner-207 kernel: [37784.613033] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:53:30 juju-e4d256-prod-github-runner-207 kernel: [37784.613747] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:53:30 juju-e4d256-prod-github-runner-207 kernel: [37784.614451] ? do_syscall_64+0x69/0xc0 Aug 22 15:53:30 juju-e4d256-prod-github-runner-207 kernel: [37784.615082] ? do_syscall_64+0x69/0xc0 Aug 22 15:53:30 juju-e4d256-prod-github-runner-207 kernel: [37784.615703] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 15:53:30 juju-e4d256-prod-github-runner-207 kernel: [37784.616412] RIP: 0033:0x7faa5d0edaff Aug 22 15:53:30 juju-e4d256-prod-github-runner-207 kernel: [37784.617039] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 15:53:30 juju-e4d256-prod-github-runner-207 kernel: [37784.619067] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 15:53:30 juju-e4d256-prod-github-runner-207 kernel: [37784.619985] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 15:53:30 juju-e4d256-prod-github-runner-207 kernel: [37784.620882] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 15:53:30 juju-e4d256-prod-github-runner-207 kernel: [37784.621782] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 15:53:30 juju-e4d256-prod-github-runner-207 kernel: [37784.622691] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 15:53:30 juju-e4d256-prod-github-runner-207 kernel: [37784.623604] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 15:53:30 juju-e4d256-prod-github-runner-207 kernel: [37784.624500] Aug 22 15:53:45 juju-e4d256-prod-github-runner-207 kernel: [37799.708706] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 15:53:45 juju-e4d256-prod-github-runner-207 kernel: [37799.709674] rcu: 1-....: (9391059 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=4539103 Aug 22 15:53:45 juju-e4d256-prod-github-runner-207 kernel: [37799.710791] (t=9420627 jiffies g=23269 q=39136) Aug 22 15:53:45 juju-e4d256-prod-github-runner-207 kernel: [37799.711572] NMI backtrace for cpu 1 Aug 22 15:53:45 juju-e4d256-prod-github-runner-207 kernel: [37799.712280] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 15:53:45 juju-e4d256-prod-github-runner-207 kernel: [37799.713383] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 15:53:45 juju-e4d256-prod-github-runner-207 kernel: [37799.714472] Call Trace: Aug 22 15:53:45 juju-e4d256-prod-github-runner-207 kernel: [37799.715150] Aug 22 15:53:45 juju-e4d256-prod-github-runner-207 kernel: [37799.715799] show_stack+0x52/0x5c Aug 22 15:53:45 juju-e4d256-prod-github-runner-207 kernel: [37799.716521] dump_stack_lvl+0x4a/0x63 Aug 22 15:53:45 juju-e4d256-prod-github-runner-207 kernel: [37799.717263] dump_stack+0x10/0x16 Aug 22 15:53:45 juju-e4d256-prod-github-runner-207 kernel: [37799.717991] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 15:53:45 juju-e4d256-prod-github-runner-207 kernel: [37799.718769] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 15:53:45 juju-e4d256-prod-github-runner-207 kernel: [37799.719544] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 15:53:45 juju-e4d256-prod-github-runner-207 kernel: [37799.720359] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 15:53:45 juju-e4d256-prod-github-runner-207 kernel: [37799.721175] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 15:53:45 juju-e4d256-prod-github-runner-207 kernel: [37799.721989] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 15:53:45 juju-e4d256-prod-github-runner-207 kernel: [37799.722759] print_cpu_stall.cold+0x2f/0xe2 Aug 22 15:53:45 juju-e4d256-prod-github-runner-207 kernel: [37799.723520] ? timekeeping_update+0xf7/0x150 Aug 22 15:53:45 juju-e4d256-prod-github-runner-207 kernel: [37799.724287] check_cpu_stall+0x109/0x270 Aug 22 15:53:45 juju-e4d256-prod-github-runner-207 kernel: [37799.725033] rcu_sched_clock_irq+0x9a/0x250 Aug 22 15:53:45 juju-e4d256-prod-github-runner-207 kernel: [37799.725806] update_process_times+0x94/0xd0 Aug 22 15:53:45 juju-e4d256-prod-github-runner-207 kernel: [37799.726568] tick_sched_handle+0x29/0x70 Aug 22 15:53:45 juju-e4d256-prod-github-runner-207 kernel: [37799.727313] tick_sched_timer+0x8c/0xc0 Aug 22 15:53:45 juju-e4d256-prod-github-runner-207 kernel: [37799.728048] ? tick_nohz_handler+0xb0/0xb0 Aug 22 15:53:45 juju-e4d256-prod-github-runner-207 kernel: [37799.728805] __hrtimer_run_queues+0x107/0x230 Aug 22 15:53:45 juju-e4d256-prod-github-runner-207 kernel: [37799.729586] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 15:53:45 juju-e4d256-prod-github-runner-207 kernel: [37799.730371] hrtimer_interrupt+0x101/0x220 Aug 22 15:53:45 juju-e4d256-prod-github-runner-207 kernel: [37799.731129] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 15:53:45 juju-e4d256-prod-github-runner-207 kernel: [37799.731947] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 15:53:45 juju-e4d256-prod-github-runner-207 kernel: [37799.732748] Aug 22 15:53:45 juju-e4d256-prod-github-runner-207 kernel: [37799.733382] Aug 22 15:53:45 juju-e4d256-prod-github-runner-207 kernel: [37799.734018] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 15:53:45 juju-e4d256-prod-github-runner-207 kernel: [37799.734841] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:53:45 juju-e4d256-prod-github-runner-207 kernel: [37799.735719] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 15:53:45 juju-e4d256-prod-github-runner-207 kernel: [37799.737936] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 15:53:45 juju-e4d256-prod-github-runner-207 kernel: [37799.738808] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 15:53:45 juju-e4d256-prod-github-runner-207 kernel: [37799.739799] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 15:53:45 juju-e4d256-prod-github-runner-207 kernel: [37799.740772] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 15:53:45 juju-e4d256-prod-github-runner-207 kernel: [37799.741744] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 15:53:45 juju-e4d256-prod-github-runner-207 kernel: [37799.742698] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 15:53:45 juju-e4d256-prod-github-runner-207 kernel: [37799.743648] ? _raw_spin_lock+0x22/0x30 Aug 22 15:53:45 juju-e4d256-prod-github-runner-207 kernel: [37799.744409] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:53:45 juju-e4d256-prod-github-runner-207 kernel: [37799.745243] direct_page_fault+0x206/0x310 [kvm] Aug 22 15:53:45 juju-e4d256-prod-github-runner-207 kernel: [37799.746086] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 15:53:45 juju-e4d256-prod-github-runner-207 kernel: [37799.746919] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 15:53:45 juju-e4d256-prod-github-runner-207 kernel: [37799.747746] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 15:53:45 juju-e4d256-prod-github-runner-207 kernel: [37799.748546] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 15:53:45 juju-e4d256-prod-github-runner-207 kernel: [37799.749331] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 15:53:45 juju-e4d256-prod-github-runner-207 kernel: [37799.750160] handle_exit+0x98/0x230 [kvm_amd] Aug 22 15:53:45 juju-e4d256-prod-github-runner-207 kernel: [37799.750918] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 15:53:45 juju-e4d256-prod-github-runner-207 kernel: [37799.751698] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 15:53:45 juju-e4d256-prod-github-runner-207 kernel: [37799.752496] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 15:53:45 juju-e4d256-prod-github-runner-207 kernel: [37799.753280] vcpu_run+0x62/0x2c0 [kvm] Aug 22 15:53:45 juju-e4d256-prod-github-runner-207 kernel: [37799.754009] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 15:53:45 juju-e4d256-prod-github-runner-207 kernel: [37799.754742] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 15:53:45 juju-e4d256-prod-github-runner-207 kernel: [37799.755541] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 15:53:45 juju-e4d256-prod-github-runner-207 kernel: [37799.756298] ? __seccomp_filter+0x4a/0x4a0 Aug 22 15:53:45 juju-e4d256-prod-github-runner-207 kernel: [37799.757015] ? __fget_files+0x86/0xc0 Aug 22 15:53:45 juju-e4d256-prod-github-runner-207 kernel: [37799.757721] __x64_sys_ioctl+0x95/0xd0 Aug 22 15:53:45 juju-e4d256-prod-github-runner-207 kernel: [37799.758414] do_syscall_64+0x5c/0xc0 Aug 22 15:53:45 juju-e4d256-prod-github-runner-207 kernel: [37799.759093] ? do_futex+0x162/0x1f0 Aug 22 15:53:45 juju-e4d256-prod-github-runner-207 kernel: [37799.759772] ? __x64_sys_futex+0x78/0x1e0 Aug 22 15:53:45 juju-e4d256-prod-github-runner-207 kernel: [37799.760488] ? __secure_computing+0xa9/0x120 Aug 22 15:53:45 juju-e4d256-prod-github-runner-207 kernel: [37799.761200] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 15:53:45 juju-e4d256-prod-github-runner-207 kernel: [37799.762002] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:53:45 juju-e4d256-prod-github-runner-207 kernel: [37799.762756] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:53:45 juju-e4d256-prod-github-runner-207 kernel: [37799.763509] ? do_syscall_64+0x69/0xc0 Aug 22 15:53:45 juju-e4d256-prod-github-runner-207 kernel: [37799.764193] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:53:45 juju-e4d256-prod-github-runner-207 kernel: [37799.764941] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:53:45 juju-e4d256-prod-github-runner-207 kernel: [37799.765701] ? do_syscall_64+0x69/0xc0 Aug 22 15:53:45 juju-e4d256-prod-github-runner-207 kernel: [37799.766395] ? do_syscall_64+0x69/0xc0 Aug 22 15:53:45 juju-e4d256-prod-github-runner-207 kernel: [37799.767079] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 15:53:45 juju-e4d256-prod-github-runner-207 kernel: [37799.767847] RIP: 0033:0x7faa5d0edaff Aug 22 15:53:45 juju-e4d256-prod-github-runner-207 kernel: [37799.768524] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 15:53:45 juju-e4d256-prod-github-runner-207 kernel: [37799.770620] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 15:53:45 juju-e4d256-prod-github-runner-207 kernel: [37799.771581] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 15:53:45 juju-e4d256-prod-github-runner-207 kernel: [37799.772527] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 15:53:45 juju-e4d256-prod-github-runner-207 kernel: [37799.773468] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 15:53:45 juju-e4d256-prod-github-runner-207 kernel: [37799.774411] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 15:53:45 juju-e4d256-prod-github-runner-207 kernel: [37799.775335] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 15:53:45 juju-e4d256-prod-github-runner-207 kernel: [37799.776243] Aug 22 15:54:10 juju-e4d256-prod-github-runner-207 kernel: [37824.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 35118s! [qemu-system-x86:6715] Aug 22 15:54:10 juju-e4d256-prod-github-runner-207 kernel: [37824.543125] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 15:54:10 juju-e4d256-prod-github-runner-207 kernel: [37824.543192] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 15:54:10 juju-e4d256-prod-github-runner-207 kernel: [37824.555283] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 15:54:10 juju-e4d256-prod-github-runner-207 kernel: [37824.556556] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 15:54:10 juju-e4d256-prod-github-runner-207 kernel: [37824.557815] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:54:10 juju-e4d256-prod-github-runner-207 kernel: [37824.558876] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 15:54:10 juju-e4d256-prod-github-runner-207 kernel: [37824.561446] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 15:54:10 juju-e4d256-prod-github-runner-207 kernel: [37824.562494] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 15:54:10 juju-e4d256-prod-github-runner-207 kernel: [37824.563655] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 15:54:10 juju-e4d256-prod-github-runner-207 kernel: [37824.564819] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 15:54:10 juju-e4d256-prod-github-runner-207 kernel: [37824.566002] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 15:54:10 juju-e4d256-prod-github-runner-207 kernel: [37824.567162] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 15:54:10 juju-e4d256-prod-github-runner-207 kernel: [37824.568357] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 15:54:10 juju-e4d256-prod-github-runner-207 kernel: [37824.569613] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 15:54:10 juju-e4d256-prod-github-runner-207 kernel: [37824.570740] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 15:54:10 juju-e4d256-prod-github-runner-207 kernel: [37824.571937] Call Trace: Aug 22 15:54:10 juju-e4d256-prod-github-runner-207 kernel: [37824.572848] Aug 22 15:54:10 juju-e4d256-prod-github-runner-207 kernel: [37824.573758] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:54:10 juju-e4d256-prod-github-runner-207 kernel: [37824.574790] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:54:10 juju-e4d256-prod-github-runner-207 kernel: [37824.575810] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:54:10 juju-e4d256-prod-github-runner-207 kernel: [37824.576888] ? show_regs.part.0+0x23/0x29 Aug 22 15:54:10 juju-e4d256-prod-github-runner-207 kernel: [37824.577906] ? show_regs.cold+0x8/0xd Aug 22 15:54:10 juju-e4d256-prod-github-runner-207 kernel: [37824.578887] ? watchdog_timer_fn+0x1be/0x220 Aug 22 15:54:10 juju-e4d256-prod-github-runner-207 kernel: [37824.579897] ? lockup_detector_update_enable+0x60/0x60 Aug 22 15:54:10 juju-e4d256-prod-github-runner-207 kernel: [37824.580979] ? __hrtimer_run_queues+0x107/0x230 Aug 22 15:54:10 juju-e4d256-prod-github-runner-207 kernel: [37824.582042] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 15:54:10 juju-e4d256-prod-github-runner-207 kernel: [37824.583065] ? hrtimer_interrupt+0x101/0x220 Aug 22 15:54:10 juju-e4d256-prod-github-runner-207 kernel: [37824.584100] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 15:54:10 juju-e4d256-prod-github-runner-207 kernel: [37824.585174] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 15:54:10 juju-e4d256-prod-github-runner-207 kernel: [37824.586247] Aug 22 15:54:10 juju-e4d256-prod-github-runner-207 kernel: [37824.587100] Aug 22 15:54:10 juju-e4d256-prod-github-runner-207 kernel: [37824.587936] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 15:54:10 juju-e4d256-prod-github-runner-207 kernel: [37824.589106] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:54:10 juju-e4d256-prod-github-runner-207 kernel: [37824.590178] ? _raw_spin_lock+0x22/0x30 Aug 22 15:54:10 juju-e4d256-prod-github-runner-207 kernel: [37824.591122] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:54:10 juju-e4d256-prod-github-runner-207 kernel: [37824.592139] direct_page_fault+0x206/0x310 [kvm] Aug 22 15:54:10 juju-e4d256-prod-github-runner-207 kernel: [37824.593161] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 15:54:10 juju-e4d256-prod-github-runner-207 kernel: [37824.594205] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 15:54:10 juju-e4d256-prod-github-runner-207 kernel: [37824.595218] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 15:54:10 juju-e4d256-prod-github-runner-207 kernel: [37824.596190] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 15:54:10 juju-e4d256-prod-github-runner-207 kernel: [37824.597151] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 15:54:10 juju-e4d256-prod-github-runner-207 kernel: [37824.598151] handle_exit+0x98/0x230 [kvm_amd] Aug 22 15:54:10 juju-e4d256-prod-github-runner-207 kernel: [37824.599044] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 15:54:10 juju-e4d256-prod-github-runner-207 kernel: [37824.599958] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 15:54:10 juju-e4d256-prod-github-runner-207 kernel: [37824.600885] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 15:54:10 juju-e4d256-prod-github-runner-207 kernel: [37824.601809] vcpu_run+0x62/0x2c0 [kvm] Aug 22 15:54:10 juju-e4d256-prod-github-runner-207 kernel: [37824.602620] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 15:54:10 juju-e4d256-prod-github-runner-207 kernel: [37824.603427] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 15:54:10 juju-e4d256-prod-github-runner-207 kernel: [37824.604280] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 15:54:10 juju-e4d256-prod-github-runner-207 kernel: [37824.605076] ? __seccomp_filter+0x4a/0x4a0 Aug 22 15:54:10 juju-e4d256-prod-github-runner-207 kernel: [37824.605841] ? __fget_files+0x86/0xc0 Aug 22 15:54:10 juju-e4d256-prod-github-runner-207 kernel: [37824.606543] __x64_sys_ioctl+0x95/0xd0 Aug 22 15:54:10 juju-e4d256-prod-github-runner-207 kernel: [37824.607252] do_syscall_64+0x5c/0xc0 Aug 22 15:54:10 juju-e4d256-prod-github-runner-207 kernel: [37824.607917] ? do_futex+0x162/0x1f0 Aug 22 15:54:10 juju-e4d256-prod-github-runner-207 kernel: [37824.608563] ? __x64_sys_futex+0x78/0x1e0 Aug 22 15:54:10 juju-e4d256-prod-github-runner-207 kernel: [37824.609236] ? __secure_computing+0xa9/0x120 Aug 22 15:54:10 juju-e4d256-prod-github-runner-207 kernel: [37824.609948] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 15:54:10 juju-e4d256-prod-github-runner-207 kernel: [37824.610715] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:54:10 juju-e4d256-prod-github-runner-207 kernel: [37824.611436] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:54:10 juju-e4d256-prod-github-runner-207 kernel: [37824.612160] ? do_syscall_64+0x69/0xc0 Aug 22 15:54:10 juju-e4d256-prod-github-runner-207 kernel: [37824.612803] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:54:10 juju-e4d256-prod-github-runner-207 kernel: [37824.613517] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:54:10 juju-e4d256-prod-github-runner-207 kernel: [37824.614214] ? do_syscall_64+0x69/0xc0 Aug 22 15:54:10 juju-e4d256-prod-github-runner-207 kernel: [37824.614837] ? do_syscall_64+0x69/0xc0 Aug 22 15:54:10 juju-e4d256-prod-github-runner-207 kernel: [37824.615459] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 15:54:10 juju-e4d256-prod-github-runner-207 kernel: [37824.616167] RIP: 0033:0x7faa5d0edaff Aug 22 15:54:10 juju-e4d256-prod-github-runner-207 kernel: [37824.616789] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 15:54:10 juju-e4d256-prod-github-runner-207 kernel: [37824.618795] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 15:54:10 juju-e4d256-prod-github-runner-207 kernel: [37824.619716] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 15:54:10 juju-e4d256-prod-github-runner-207 kernel: [37824.620628] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 15:54:10 juju-e4d256-prod-github-runner-207 kernel: [37824.621547] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 15:54:10 juju-e4d256-prod-github-runner-207 kernel: [37824.622440] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 15:54:10 juju-e4d256-prod-github-runner-207 kernel: [37824.623336] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 15:54:10 juju-e4d256-prod-github-runner-207 kernel: [37824.624240] Aug 22 15:54:38 juju-e4d256-prod-github-runner-207 kernel: [37852.541981] watchdog: BUG: soft lockup - CPU#1 stuck for 35144s! [qemu-system-x86:6715] Aug 22 15:54:38 juju-e4d256-prod-github-runner-207 kernel: [37852.543673] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 15:54:38 juju-e4d256-prod-github-runner-207 kernel: [37852.543924] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 15:54:38 juju-e4d256-prod-github-runner-207 kernel: [37852.555666] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 15:54:38 juju-e4d256-prod-github-runner-207 kernel: [37852.556894] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 15:54:38 juju-e4d256-prod-github-runner-207 kernel: [37852.558134] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:54:38 juju-e4d256-prod-github-runner-207 kernel: [37852.559175] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 15:54:38 juju-e4d256-prod-github-runner-207 kernel: [37852.561660] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 15:54:38 juju-e4d256-prod-github-runner-207 kernel: [37852.562680] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 15:54:38 juju-e4d256-prod-github-runner-207 kernel: [37852.563818] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 15:54:38 juju-e4d256-prod-github-runner-207 kernel: [37852.564949] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 15:54:38 juju-e4d256-prod-github-runner-207 kernel: [37852.566094] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 15:54:38 juju-e4d256-prod-github-runner-207 kernel: [37852.567270] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 15:54:38 juju-e4d256-prod-github-runner-207 kernel: [37852.568460] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 15:54:38 juju-e4d256-prod-github-runner-207 kernel: [37852.569746] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 15:54:38 juju-e4d256-prod-github-runner-207 kernel: [37852.570831] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 15:54:38 juju-e4d256-prod-github-runner-207 kernel: [37852.572082] Call Trace: Aug 22 15:54:38 juju-e4d256-prod-github-runner-207 kernel: [37852.573003] Aug 22 15:54:38 juju-e4d256-prod-github-runner-207 kernel: [37852.573905] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:54:38 juju-e4d256-prod-github-runner-207 kernel: [37852.574914] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:54:38 juju-e4d256-prod-github-runner-207 kernel: [37852.575912] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:54:38 juju-e4d256-prod-github-runner-207 kernel: [37852.576991] ? show_regs.part.0+0x23/0x29 Aug 22 15:54:38 juju-e4d256-prod-github-runner-207 kernel: [37852.578047] ? show_regs.cold+0x8/0xd Aug 22 15:54:38 juju-e4d256-prod-github-runner-207 kernel: [37852.579000] ? watchdog_timer_fn+0x1be/0x220 Aug 22 15:54:38 juju-e4d256-prod-github-runner-207 kernel: [37852.579992] ? lockup_detector_update_enable+0x60/0x60 Aug 22 15:54:38 juju-e4d256-prod-github-runner-207 kernel: [37852.581043] ? __hrtimer_run_queues+0x107/0x230 Aug 22 15:54:38 juju-e4d256-prod-github-runner-207 kernel: [37852.582056] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 15:54:38 juju-e4d256-prod-github-runner-207 kernel: [37852.583059] ? hrtimer_interrupt+0x101/0x220 Aug 22 15:54:38 juju-e4d256-prod-github-runner-207 kernel: [37852.584057] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 15:54:38 juju-e4d256-prod-github-runner-207 kernel: [37852.585121] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 15:54:38 juju-e4d256-prod-github-runner-207 kernel: [37852.586148] Aug 22 15:54:38 juju-e4d256-prod-github-runner-207 kernel: [37852.586992] Aug 22 15:54:38 juju-e4d256-prod-github-runner-207 kernel: [37852.587846] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 15:54:38 juju-e4d256-prod-github-runner-207 kernel: [37852.588865] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:54:38 juju-e4d256-prod-github-runner-207 kernel: [37852.589896] ? _raw_spin_lock+0x22/0x30 Aug 22 15:54:38 juju-e4d256-prod-github-runner-207 kernel: [37852.590820] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:54:38 juju-e4d256-prod-github-runner-207 kernel: [37852.591816] direct_page_fault+0x206/0x310 [kvm] Aug 22 15:54:38 juju-e4d256-prod-github-runner-207 kernel: [37852.592818] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 15:54:38 juju-e4d256-prod-github-runner-207 kernel: [37852.593820] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 15:54:38 juju-e4d256-prod-github-runner-207 kernel: [37852.594798] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 15:54:38 juju-e4d256-prod-github-runner-207 kernel: [37852.595769] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 15:54:38 juju-e4d256-prod-github-runner-207 kernel: [37852.596701] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 15:54:38 juju-e4d256-prod-github-runner-207 kernel: [37852.597664] handle_exit+0x98/0x230 [kvm_amd] Aug 22 15:54:38 juju-e4d256-prod-github-runner-207 kernel: [37852.598536] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 15:54:38 juju-e4d256-prod-github-runner-207 kernel: [37852.599432] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 15:54:38 juju-e4d256-prod-github-runner-207 kernel: [37852.600336] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 15:54:38 juju-e4d256-prod-github-runner-207 kernel: [37852.602975] vcpu_run+0x62/0x2c0 [kvm] Aug 22 15:54:38 juju-e4d256-prod-github-runner-207 kernel: [37852.603786] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 15:54:38 juju-e4d256-prod-github-runner-207 kernel: [37852.604572] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 15:54:38 juju-e4d256-prod-github-runner-207 kernel: [37852.605423] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 15:54:38 juju-e4d256-prod-github-runner-207 kernel: [37852.606223] ? __seccomp_filter+0x4a/0x4a0 Aug 22 15:54:38 juju-e4d256-prod-github-runner-207 kernel: [37852.606954] ? __fget_files+0x86/0xc0 Aug 22 15:54:38 juju-e4d256-prod-github-runner-207 kernel: [37852.607638] __x64_sys_ioctl+0x95/0xd0 Aug 22 15:54:38 juju-e4d256-prod-github-runner-207 kernel: [37852.608311] do_syscall_64+0x5c/0xc0 Aug 22 15:54:38 juju-e4d256-prod-github-runner-207 kernel: [37852.608962] ? do_futex+0x162/0x1f0 Aug 22 15:54:38 juju-e4d256-prod-github-runner-207 kernel: [37852.609600] ? __x64_sys_futex+0x78/0x1e0 Aug 22 15:54:38 juju-e4d256-prod-github-runner-207 kernel: [37852.610259] ? __secure_computing+0xa9/0x120 Aug 22 15:54:38 juju-e4d256-prod-github-runner-207 kernel: [37852.610927] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 15:54:38 juju-e4d256-prod-github-runner-207 kernel: [37852.611661] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:54:38 juju-e4d256-prod-github-runner-207 kernel: [37852.612365] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:54:38 juju-e4d256-prod-github-runner-207 kernel: [37852.613079] ? do_syscall_64+0x69/0xc0 Aug 22 15:54:38 juju-e4d256-prod-github-runner-207 kernel: [37852.613706] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:54:38 juju-e4d256-prod-github-runner-207 kernel: [37852.614396] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:54:38 juju-e4d256-prod-github-runner-207 kernel: [37852.615084] ? do_syscall_64+0x69/0xc0 Aug 22 15:54:38 juju-e4d256-prod-github-runner-207 kernel: [37852.615691] ? do_syscall_64+0x69/0xc0 Aug 22 15:54:38 juju-e4d256-prod-github-runner-207 kernel: [37852.616294] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 15:54:38 juju-e4d256-prod-github-runner-207 kernel: [37852.616973] RIP: 0033:0x7faa5d0edaff Aug 22 15:54:38 juju-e4d256-prod-github-runner-207 kernel: [37852.617738] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 15:54:38 juju-e4d256-prod-github-runner-207 kernel: [37852.619707] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 15:54:38 juju-e4d256-prod-github-runner-207 kernel: [37852.620585] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 15:54:38 juju-e4d256-prod-github-runner-207 kernel: [37852.621457] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 15:54:38 juju-e4d256-prod-github-runner-207 kernel: [37852.622324] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 15:54:38 juju-e4d256-prod-github-runner-207 kernel: [37852.623183] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 15:54:38 juju-e4d256-prod-github-runner-207 kernel: [37852.624044] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 15:54:38 juju-e4d256-prod-github-runner-207 kernel: [37852.624908] Aug 22 15:55:06 juju-e4d256-prod-github-runner-207 kernel: [37880.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 35171s! [qemu-system-x86:6715] Aug 22 15:55:06 juju-e4d256-prod-github-runner-207 kernel: [37880.543126] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 15:55:06 juju-e4d256-prod-github-runner-207 kernel: [37880.543192] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 15:55:06 juju-e4d256-prod-github-runner-207 kernel: [37880.555467] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 15:55:06 juju-e4d256-prod-github-runner-207 kernel: [37880.556765] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 15:55:06 juju-e4d256-prod-github-runner-207 kernel: [37880.557986] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:55:06 juju-e4d256-prod-github-runner-207 kernel: [37880.559039] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 15:55:06 juju-e4d256-prod-github-runner-207 kernel: [37880.561737] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 15:55:06 juju-e4d256-prod-github-runner-207 kernel: [37880.562795] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 15:55:06 juju-e4d256-prod-github-runner-207 kernel: [37880.563957] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 15:55:06 juju-e4d256-prod-github-runner-207 kernel: [37880.565128] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 15:55:06 juju-e4d256-prod-github-runner-207 kernel: [37880.566295] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 15:55:06 juju-e4d256-prod-github-runner-207 kernel: [37880.567457] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 15:55:06 juju-e4d256-prod-github-runner-207 kernel: [37880.568657] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 15:55:06 juju-e4d256-prod-github-runner-207 kernel: [37880.569909] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 15:55:06 juju-e4d256-prod-github-runner-207 kernel: [37880.571014] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 15:55:06 juju-e4d256-prod-github-runner-207 kernel: [37880.572209] Call Trace: Aug 22 15:55:06 juju-e4d256-prod-github-runner-207 kernel: [37880.573137] Aug 22 15:55:06 juju-e4d256-prod-github-runner-207 kernel: [37880.574021] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:55:06 juju-e4d256-prod-github-runner-207 kernel: [37880.575049] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:55:06 juju-e4d256-prod-github-runner-207 kernel: [37880.576072] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:55:06 juju-e4d256-prod-github-runner-207 kernel: [37880.577166] ? show_regs.part.0+0x23/0x29 Aug 22 15:55:06 juju-e4d256-prod-github-runner-207 kernel: [37880.578170] ? show_regs.cold+0x8/0xd Aug 22 15:55:06 juju-e4d256-prod-github-runner-207 kernel: [37880.579140] ? watchdog_timer_fn+0x1be/0x220 Aug 22 15:55:06 juju-e4d256-prod-github-runner-207 kernel: [37880.580146] ? lockup_detector_update_enable+0x60/0x60 Aug 22 15:55:06 juju-e4d256-prod-github-runner-207 kernel: [37880.581240] ? __hrtimer_run_queues+0x107/0x230 Aug 22 15:55:06 juju-e4d256-prod-github-runner-207 kernel: [37880.582269] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 15:55:06 juju-e4d256-prod-github-runner-207 kernel: [37880.583291] ? hrtimer_interrupt+0x101/0x220 Aug 22 15:55:06 juju-e4d256-prod-github-runner-207 kernel: [37880.584314] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 15:55:06 juju-e4d256-prod-github-runner-207 kernel: [37880.585418] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 15:55:06 juju-e4d256-prod-github-runner-207 kernel: [37880.586465] Aug 22 15:55:06 juju-e4d256-prod-github-runner-207 kernel: [37880.587318] Aug 22 15:55:06 juju-e4d256-prod-github-runner-207 kernel: [37880.588161] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 15:55:06 juju-e4d256-prod-github-runner-207 kernel: [37880.589204] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:55:06 juju-e4d256-prod-github-runner-207 kernel: [37880.590242] ? _raw_spin_lock+0x22/0x30 Aug 22 15:55:06 juju-e4d256-prod-github-runner-207 kernel: [37880.591219] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:55:06 juju-e4d256-prod-github-runner-207 kernel: [37880.592292] direct_page_fault+0x206/0x310 [kvm] Aug 22 15:55:06 juju-e4d256-prod-github-runner-207 kernel: [37880.593386] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 15:55:06 juju-e4d256-prod-github-runner-207 kernel: [37880.594409] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 15:55:06 juju-e4d256-prod-github-runner-207 kernel: [37880.595412] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 15:55:06 juju-e4d256-prod-github-runner-207 kernel: [37880.596393] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 15:55:06 juju-e4d256-prod-github-runner-207 kernel: [37880.597366] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 15:55:06 juju-e4d256-prod-github-runner-207 kernel: [37880.598345] handle_exit+0x98/0x230 [kvm_amd] Aug 22 15:55:06 juju-e4d256-prod-github-runner-207 kernel: [37880.599237] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 15:55:06 juju-e4d256-prod-github-runner-207 kernel: [37880.600150] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 15:55:06 juju-e4d256-prod-github-runner-207 kernel: [37880.601096] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 15:55:06 juju-e4d256-prod-github-runner-207 kernel: [37880.602006] vcpu_run+0x62/0x2c0 [kvm] Aug 22 15:55:06 juju-e4d256-prod-github-runner-207 kernel: [37880.602817] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 15:55:06 juju-e4d256-prod-github-runner-207 kernel: [37880.603666] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 15:55:06 juju-e4d256-prod-github-runner-207 kernel: [37880.604530] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 15:55:06 juju-e4d256-prod-github-runner-207 kernel: [37880.605352] ? __seccomp_filter+0x4a/0x4a0 Aug 22 15:55:06 juju-e4d256-prod-github-runner-207 kernel: [37880.606096] ? __fget_files+0x86/0xc0 Aug 22 15:55:06 juju-e4d256-prod-github-runner-207 kernel: [37880.606806] __x64_sys_ioctl+0x95/0xd0 Aug 22 15:55:06 juju-e4d256-prod-github-runner-207 kernel: [37880.607501] do_syscall_64+0x5c/0xc0 Aug 22 15:55:06 juju-e4d256-prod-github-runner-207 kernel: [37880.608235] ? do_futex+0x162/0x1f0 Aug 22 15:55:06 juju-e4d256-prod-github-runner-207 kernel: [37880.608949] ? __x64_sys_futex+0x78/0x1e0 Aug 22 15:55:06 juju-e4d256-prod-github-runner-207 kernel: [37880.609679] ? __secure_computing+0xa9/0x120 Aug 22 15:55:06 juju-e4d256-prod-github-runner-207 kernel: [37880.610383] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 15:55:06 juju-e4d256-prod-github-runner-207 kernel: [37880.611161] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:55:06 juju-e4d256-prod-github-runner-207 kernel: [37880.611888] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:55:06 juju-e4d256-prod-github-runner-207 kernel: [37880.612606] ? do_syscall_64+0x69/0xc0 Aug 22 15:55:06 juju-e4d256-prod-github-runner-207 kernel: [37880.613265] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:55:06 juju-e4d256-prod-github-runner-207 kernel: [37880.613968] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:55:06 juju-e4d256-prod-github-runner-207 kernel: [37880.614692] ? do_syscall_64+0x69/0xc0 Aug 22 15:55:06 juju-e4d256-prod-github-runner-207 kernel: [37880.615333] ? do_syscall_64+0x69/0xc0 Aug 22 15:55:06 juju-e4d256-prod-github-runner-207 kernel: [37880.615954] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 15:55:06 juju-e4d256-prod-github-runner-207 kernel: [37880.616664] RIP: 0033:0x7faa5d0edaff Aug 22 15:55:06 juju-e4d256-prod-github-runner-207 kernel: [37880.617308] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 15:55:06 juju-e4d256-prod-github-runner-207 kernel: [37880.619309] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 15:55:06 juju-e4d256-prod-github-runner-207 kernel: [37880.620217] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 15:55:06 juju-e4d256-prod-github-runner-207 kernel: [37880.621159] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 15:55:06 juju-e4d256-prod-github-runner-207 kernel: [37880.622093] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 15:55:06 juju-e4d256-prod-github-runner-207 kernel: [37880.622990] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 15:55:06 juju-e4d256-prod-github-runner-207 kernel: [37880.623878] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 15:55:06 juju-e4d256-prod-github-runner-207 kernel: [37880.624791] Aug 22 15:55:34 juju-e4d256-prod-github-runner-207 kernel: [37908.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 35197s! [qemu-system-x86:6715] Aug 22 15:55:34 juju-e4d256-prod-github-runner-207 kernel: [37908.543096] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 15:55:34 juju-e4d256-prod-github-runner-207 kernel: [37908.543165] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 15:55:34 juju-e4d256-prod-github-runner-207 kernel: [37908.555298] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 15:55:34 juju-e4d256-prod-github-runner-207 kernel: [37908.556587] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 15:55:34 juju-e4d256-prod-github-runner-207 kernel: [37908.557809] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:55:34 juju-e4d256-prod-github-runner-207 kernel: [37908.558871] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 15:55:34 juju-e4d256-prod-github-runner-207 kernel: [37908.561434] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 15:55:34 juju-e4d256-prod-github-runner-207 kernel: [37908.562476] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 15:55:34 juju-e4d256-prod-github-runner-207 kernel: [37908.563637] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 15:55:34 juju-e4d256-prod-github-runner-207 kernel: [37908.564819] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 15:55:34 juju-e4d256-prod-github-runner-207 kernel: [37908.565979] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 15:55:34 juju-e4d256-prod-github-runner-207 kernel: [37908.567146] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 15:55:34 juju-e4d256-prod-github-runner-207 kernel: [37908.568311] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 15:55:34 juju-e4d256-prod-github-runner-207 kernel: [37908.569565] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 15:55:34 juju-e4d256-prod-github-runner-207 kernel: [37908.570665] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 15:55:34 juju-e4d256-prod-github-runner-207 kernel: [37908.571863] Call Trace: Aug 22 15:55:34 juju-e4d256-prod-github-runner-207 kernel: [37908.572796] Aug 22 15:55:34 juju-e4d256-prod-github-runner-207 kernel: [37908.573680] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:55:34 juju-e4d256-prod-github-runner-207 kernel: [37908.574715] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:55:34 juju-e4d256-prod-github-runner-207 kernel: [37908.575735] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:55:34 juju-e4d256-prod-github-runner-207 kernel: [37908.576852] ? show_regs.part.0+0x23/0x29 Aug 22 15:55:34 juju-e4d256-prod-github-runner-207 kernel: [37908.577858] ? show_regs.cold+0x8/0xd Aug 22 15:55:34 juju-e4d256-prod-github-runner-207 kernel: [37908.578830] ? watchdog_timer_fn+0x1be/0x220 Aug 22 15:55:34 juju-e4d256-prod-github-runner-207 kernel: [37908.579861] ? lockup_detector_update_enable+0x60/0x60 Aug 22 15:55:34 juju-e4d256-prod-github-runner-207 kernel: [37908.580957] ? __hrtimer_run_queues+0x107/0x230 Aug 22 15:55:34 juju-e4d256-prod-github-runner-207 kernel: [37908.581985] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 15:55:34 juju-e4d256-prod-github-runner-207 kernel: [37908.583010] ? hrtimer_interrupt+0x101/0x220 Aug 22 15:55:34 juju-e4d256-prod-github-runner-207 kernel: [37908.584031] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 15:55:34 juju-e4d256-prod-github-runner-207 kernel: [37908.585121] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 15:55:34 juju-e4d256-prod-github-runner-207 kernel: [37908.586167] Aug 22 15:55:34 juju-e4d256-prod-github-runner-207 kernel: [37908.587028] Aug 22 15:55:34 juju-e4d256-prod-github-runner-207 kernel: [37908.587868] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 15:55:34 juju-e4d256-prod-github-runner-207 kernel: [37908.588922] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:55:34 juju-e4d256-prod-github-runner-207 kernel: [37908.589998] ? _raw_spin_lock+0x22/0x30 Aug 22 15:55:34 juju-e4d256-prod-github-runner-207 kernel: [37908.590958] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:55:34 juju-e4d256-prod-github-runner-207 kernel: [37908.591979] direct_page_fault+0x206/0x310 [kvm] Aug 22 15:55:34 juju-e4d256-prod-github-runner-207 kernel: [37908.593025] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 15:55:34 juju-e4d256-prod-github-runner-207 kernel: [37908.594042] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 15:55:34 juju-e4d256-prod-github-runner-207 kernel: [37908.595042] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 15:55:34 juju-e4d256-prod-github-runner-207 kernel: [37908.596015] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 15:55:34 juju-e4d256-prod-github-runner-207 kernel: [37908.596993] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 15:55:34 juju-e4d256-prod-github-runner-207 kernel: [37908.597991] handle_exit+0x98/0x230 [kvm_amd] Aug 22 15:55:34 juju-e4d256-prod-github-runner-207 kernel: [37908.598881] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 15:55:34 juju-e4d256-prod-github-runner-207 kernel: [37908.599791] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 15:55:34 juju-e4d256-prod-github-runner-207 kernel: [37908.600731] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 15:55:34 juju-e4d256-prod-github-runner-207 kernel: [37908.601631] vcpu_run+0x62/0x2c0 [kvm] Aug 22 15:55:34 juju-e4d256-prod-github-runner-207 kernel: [37908.602444] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 15:55:34 juju-e4d256-prod-github-runner-207 kernel: [37908.603274] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 15:55:34 juju-e4d256-prod-github-runner-207 kernel: [37908.604127] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 15:55:34 juju-e4d256-prod-github-runner-207 kernel: [37908.604934] ? __seccomp_filter+0x4a/0x4a0 Aug 22 15:55:34 juju-e4d256-prod-github-runner-207 kernel: [37908.605693] ? __fget_files+0x86/0xc0 Aug 22 15:55:34 juju-e4d256-prod-github-runner-207 kernel: [37908.606395] __x64_sys_ioctl+0x95/0xd0 Aug 22 15:55:34 juju-e4d256-prod-github-runner-207 kernel: [37908.607088] do_syscall_64+0x5c/0xc0 Aug 22 15:55:34 juju-e4d256-prod-github-runner-207 kernel: [37908.607753] ? do_futex+0x162/0x1f0 Aug 22 15:55:34 juju-e4d256-prod-github-runner-207 kernel: [37908.608424] ? __x64_sys_futex+0x78/0x1e0 Aug 22 15:55:34 juju-e4d256-prod-github-runner-207 kernel: [37908.609097] ? __secure_computing+0xa9/0x120 Aug 22 15:55:34 juju-e4d256-prod-github-runner-207 kernel: [37908.609786] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 15:55:34 juju-e4d256-prod-github-runner-207 kernel: [37908.610545] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:55:34 juju-e4d256-prod-github-runner-207 kernel: [37908.611266] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:55:34 juju-e4d256-prod-github-runner-207 kernel: [37908.611982] ? do_syscall_64+0x69/0xc0 Aug 22 15:55:34 juju-e4d256-prod-github-runner-207 kernel: [37908.612646] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:55:34 juju-e4d256-prod-github-runner-207 kernel: [37908.613353] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:55:34 juju-e4d256-prod-github-runner-207 kernel: [37908.614048] ? do_syscall_64+0x69/0xc0 Aug 22 15:55:34 juju-e4d256-prod-github-runner-207 kernel: [37908.614672] ? do_syscall_64+0x69/0xc0 Aug 22 15:55:34 juju-e4d256-prod-github-runner-207 kernel: [37908.615293] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 15:55:34 juju-e4d256-prod-github-runner-207 kernel: [37908.615998] RIP: 0033:0x7faa5d0edaff Aug 22 15:55:34 juju-e4d256-prod-github-runner-207 kernel: [37908.616638] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 15:55:34 juju-e4d256-prod-github-runner-207 kernel: [37908.618638] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 15:55:34 juju-e4d256-prod-github-runner-207 kernel: [37908.619554] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 15:55:34 juju-e4d256-prod-github-runner-207 kernel: [37908.620454] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 15:55:34 juju-e4d256-prod-github-runner-207 kernel: [37908.621343] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 15:55:34 juju-e4d256-prod-github-runner-207 kernel: [37908.622234] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 15:55:34 juju-e4d256-prod-github-runner-207 kernel: [37908.623121] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 15:55:34 juju-e4d256-prod-github-runner-207 kernel: [37908.624192] Aug 22 15:56:02 juju-e4d256-prod-github-runner-207 kernel: [37936.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 35223s! [qemu-system-x86:6715] Aug 22 15:56:02 juju-e4d256-prod-github-runner-207 kernel: [37936.544103] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 15:56:02 juju-e4d256-prod-github-runner-207 kernel: [37936.544343] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 15:56:02 juju-e4d256-prod-github-runner-207 kernel: [37936.556471] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 15:56:02 juju-e4d256-prod-github-runner-207 kernel: [37936.557752] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 15:56:02 juju-e4d256-prod-github-runner-207 kernel: [37936.558974] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:56:02 juju-e4d256-prod-github-runner-207 kernel: [37936.560063] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 15:56:02 juju-e4d256-prod-github-runner-207 kernel: [37936.562628] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 15:56:02 juju-e4d256-prod-github-runner-207 kernel: [37936.563676] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 15:56:02 juju-e4d256-prod-github-runner-207 kernel: [37936.564855] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 15:56:02 juju-e4d256-prod-github-runner-207 kernel: [37936.566029] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 15:56:02 juju-e4d256-prod-github-runner-207 kernel: [37936.567199] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 15:56:02 juju-e4d256-prod-github-runner-207 kernel: [37936.568383] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 15:56:02 juju-e4d256-prod-github-runner-207 kernel: [37936.569573] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 15:56:02 juju-e4d256-prod-github-runner-207 kernel: [37936.570834] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 15:56:02 juju-e4d256-prod-github-runner-207 kernel: [37936.572027] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 15:56:02 juju-e4d256-prod-github-runner-207 kernel: [37936.573321] Call Trace: Aug 22 15:56:02 juju-e4d256-prod-github-runner-207 kernel: [37936.574340] Aug 22 15:56:02 juju-e4d256-prod-github-runner-207 kernel: [37936.575288] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:56:02 juju-e4d256-prod-github-runner-207 kernel: [37936.576408] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:56:02 juju-e4d256-prod-github-runner-207 kernel: [37936.577494] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:56:02 juju-e4d256-prod-github-runner-207 kernel: [37936.578663] ? show_regs.part.0+0x23/0x29 Aug 22 15:56:02 juju-e4d256-prod-github-runner-207 kernel: [37936.579744] ? show_regs.cold+0x8/0xd Aug 22 15:56:02 juju-e4d256-prod-github-runner-207 kernel: [37936.580850] ? watchdog_timer_fn+0x1be/0x220 Aug 22 15:56:02 juju-e4d256-prod-github-runner-207 kernel: [37936.581974] ? lockup_detector_update_enable+0x60/0x60 Aug 22 15:56:02 juju-e4d256-prod-github-runner-207 kernel: [37936.583095] ? __hrtimer_run_queues+0x107/0x230 Aug 22 15:56:02 juju-e4d256-prod-github-runner-207 kernel: [37936.584191] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 15:56:02 juju-e4d256-prod-github-runner-207 kernel: [37936.585221] ? hrtimer_interrupt+0x101/0x220 Aug 22 15:56:02 juju-e4d256-prod-github-runner-207 kernel: [37936.586257] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 15:56:02 juju-e4d256-prod-github-runner-207 kernel: [37936.587446] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 15:56:02 juju-e4d256-prod-github-runner-207 kernel: [37936.588566] Aug 22 15:56:02 juju-e4d256-prod-github-runner-207 kernel: [37936.589507] Aug 22 15:56:02 juju-e4d256-prod-github-runner-207 kernel: [37936.590402] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 15:56:02 juju-e4d256-prod-github-runner-207 kernel: [37936.591564] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:56:02 juju-e4d256-prod-github-runner-207 kernel: [37936.592687] ? _raw_spin_lock+0x22/0x30 Aug 22 15:56:02 juju-e4d256-prod-github-runner-207 kernel: [37936.593675] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:56:02 juju-e4d256-prod-github-runner-207 kernel: [37936.594701] direct_page_fault+0x206/0x310 [kvm] Aug 22 15:56:02 juju-e4d256-prod-github-runner-207 kernel: [37936.595735] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 15:56:02 juju-e4d256-prod-github-runner-207 kernel: [37936.596769] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 15:56:02 juju-e4d256-prod-github-runner-207 kernel: [37936.597773] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 15:56:02 juju-e4d256-prod-github-runner-207 kernel: [37936.598809] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 15:56:02 juju-e4d256-prod-github-runner-207 kernel: [37936.599866] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 15:56:02 juju-e4d256-prod-github-runner-207 kernel: [37936.600926] handle_exit+0x98/0x230 [kvm_amd] Aug 22 15:56:02 juju-e4d256-prod-github-runner-207 kernel: [37936.601907] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 15:56:02 juju-e4d256-prod-github-runner-207 kernel: [37936.602906] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 15:56:02 juju-e4d256-prod-github-runner-207 kernel: [37936.603908] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 15:56:02 juju-e4d256-prod-github-runner-207 kernel: [37936.604890] vcpu_run+0x62/0x2c0 [kvm] Aug 22 15:56:02 juju-e4d256-prod-github-runner-207 kernel: [37936.605786] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 15:56:02 juju-e4d256-prod-github-runner-207 kernel: [37936.606650] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 15:56:02 juju-e4d256-prod-github-runner-207 kernel: [37936.607587] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 15:56:02 juju-e4d256-prod-github-runner-207 kernel: [37936.608447] ? __seccomp_filter+0x4a/0x4a0 Aug 22 15:56:02 juju-e4d256-prod-github-runner-207 kernel: [37936.609201] ? __fget_files+0x86/0xc0 Aug 22 15:56:02 juju-e4d256-prod-github-runner-207 kernel: [37936.609907] __x64_sys_ioctl+0x95/0xd0 Aug 22 15:56:02 juju-e4d256-prod-github-runner-207 kernel: [37936.610601] do_syscall_64+0x5c/0xc0 Aug 22 15:56:02 juju-e4d256-prod-github-runner-207 kernel: [37936.611286] ? do_futex+0x162/0x1f0 Aug 22 15:56:02 juju-e4d256-prod-github-runner-207 kernel: [37936.611957] ? __x64_sys_futex+0x78/0x1e0 Aug 22 15:56:02 juju-e4d256-prod-github-runner-207 kernel: [37936.612661] ? __secure_computing+0xa9/0x120 Aug 22 15:56:02 juju-e4d256-prod-github-runner-207 kernel: [37936.613350] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 15:56:02 juju-e4d256-prod-github-runner-207 kernel: [37936.614107] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:56:02 juju-e4d256-prod-github-runner-207 kernel: [37936.614829] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:56:02 juju-e4d256-prod-github-runner-207 kernel: [37936.615543] ? do_syscall_64+0x69/0xc0 Aug 22 15:56:02 juju-e4d256-prod-github-runner-207 kernel: [37936.616209] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:56:02 juju-e4d256-prod-github-runner-207 kernel: [37936.616916] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:56:02 juju-e4d256-prod-github-runner-207 kernel: [37936.617612] ? do_syscall_64+0x69/0xc0 Aug 22 15:56:02 juju-e4d256-prod-github-runner-207 kernel: [37936.618234] ? do_syscall_64+0x69/0xc0 Aug 22 15:56:02 juju-e4d256-prod-github-runner-207 kernel: [37936.618862] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 15:56:02 juju-e4d256-prod-github-runner-207 kernel: [37936.619567] RIP: 0033:0x7faa5d0edaff Aug 22 15:56:02 juju-e4d256-prod-github-runner-207 kernel: [37936.620229] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 15:56:02 juju-e4d256-prod-github-runner-207 kernel: [37936.622248] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 15:56:02 juju-e4d256-prod-github-runner-207 kernel: [37936.623180] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 15:56:02 juju-e4d256-prod-github-runner-207 kernel: [37936.624086] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 15:56:02 juju-e4d256-prod-github-runner-207 kernel: [37936.624977] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 15:56:02 juju-e4d256-prod-github-runner-207 kernel: [37936.625870] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 15:56:02 juju-e4d256-prod-github-runner-207 kernel: [37936.626765] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 15:56:02 juju-e4d256-prod-github-runner-207 kernel: [37936.627659] Aug 22 15:56:30 juju-e4d256-prod-github-runner-207 kernel: [37964.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 35249s! [qemu-system-x86:6715] Aug 22 15:56:30 juju-e4d256-prod-github-runner-207 kernel: [37964.543102] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 15:56:30 juju-e4d256-prod-github-runner-207 kernel: [37964.543171] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 15:56:30 juju-e4d256-prod-github-runner-207 kernel: [37964.555268] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 15:56:30 juju-e4d256-prod-github-runner-207 kernel: [37964.556558] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 15:56:30 juju-e4d256-prod-github-runner-207 kernel: [37964.557776] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:56:30 juju-e4d256-prod-github-runner-207 kernel: [37964.558831] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 15:56:30 juju-e4d256-prod-github-runner-207 kernel: [37964.561382] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 15:56:30 juju-e4d256-prod-github-runner-207 kernel: [37964.562421] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 15:56:30 juju-e4d256-prod-github-runner-207 kernel: [37964.563639] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 15:56:30 juju-e4d256-prod-github-runner-207 kernel: [37964.564816] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 15:56:30 juju-e4d256-prod-github-runner-207 kernel: [37964.565984] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 15:56:30 juju-e4d256-prod-github-runner-207 kernel: [37964.567148] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 15:56:30 juju-e4d256-prod-github-runner-207 kernel: [37964.568334] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 15:56:30 juju-e4d256-prod-github-runner-207 kernel: [37964.569567] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 15:56:30 juju-e4d256-prod-github-runner-207 kernel: [37964.570667] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 15:56:30 juju-e4d256-prod-github-runner-207 kernel: [37964.571875] Call Trace: Aug 22 15:56:30 juju-e4d256-prod-github-runner-207 kernel: [37964.572792] Aug 22 15:56:30 juju-e4d256-prod-github-runner-207 kernel: [37964.573676] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:56:30 juju-e4d256-prod-github-runner-207 kernel: [37964.574705] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:56:30 juju-e4d256-prod-github-runner-207 kernel: [37964.575741] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:56:30 juju-e4d256-prod-github-runner-207 kernel: [37964.576817] ? show_regs.part.0+0x23/0x29 Aug 22 15:56:30 juju-e4d256-prod-github-runner-207 kernel: [37964.577814] ? show_regs.cold+0x8/0xd Aug 22 15:56:30 juju-e4d256-prod-github-runner-207 kernel: [37964.578791] ? watchdog_timer_fn+0x1be/0x220 Aug 22 15:56:30 juju-e4d256-prod-github-runner-207 kernel: [37964.579811] ? lockup_detector_update_enable+0x60/0x60 Aug 22 15:56:30 juju-e4d256-prod-github-runner-207 kernel: [37964.580876] ? __hrtimer_run_queues+0x107/0x230 Aug 22 15:56:30 juju-e4d256-prod-github-runner-207 kernel: [37964.581910] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 15:56:30 juju-e4d256-prod-github-runner-207 kernel: [37964.582942] ? hrtimer_interrupt+0x101/0x220 Aug 22 15:56:30 juju-e4d256-prod-github-runner-207 kernel: [37964.583967] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 15:56:30 juju-e4d256-prod-github-runner-207 kernel: [37964.585037] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 15:56:30 juju-e4d256-prod-github-runner-207 kernel: [37964.586081] Aug 22 15:56:30 juju-e4d256-prod-github-runner-207 kernel: [37964.587100] Aug 22 15:56:30 juju-e4d256-prod-github-runner-207 kernel: [37964.587959] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 15:56:30 juju-e4d256-prod-github-runner-207 kernel: [37964.588992] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:56:30 juju-e4d256-prod-github-runner-207 kernel: [37964.590030] ? _raw_spin_lock+0x22/0x30 Aug 22 15:56:30 juju-e4d256-prod-github-runner-207 kernel: [37964.590975] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:56:30 juju-e4d256-prod-github-runner-207 kernel: [37964.592004] direct_page_fault+0x206/0x310 [kvm] Aug 22 15:56:30 juju-e4d256-prod-github-runner-207 kernel: [37964.593029] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 15:56:30 juju-e4d256-prod-github-runner-207 kernel: [37964.594036] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 15:56:30 juju-e4d256-prod-github-runner-207 kernel: [37964.595038] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 15:56:30 juju-e4d256-prod-github-runner-207 kernel: [37964.596015] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 15:56:30 juju-e4d256-prod-github-runner-207 kernel: [37964.596962] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 15:56:30 juju-e4d256-prod-github-runner-207 kernel: [37964.597941] handle_exit+0x98/0x230 [kvm_amd] Aug 22 15:56:30 juju-e4d256-prod-github-runner-207 kernel: [37964.598832] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 15:56:30 juju-e4d256-prod-github-runner-207 kernel: [37964.599762] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 15:56:30 juju-e4d256-prod-github-runner-207 kernel: [37964.600684] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 15:56:30 juju-e4d256-prod-github-runner-207 kernel: [37964.601585] vcpu_run+0x62/0x2c0 [kvm] Aug 22 15:56:30 juju-e4d256-prod-github-runner-207 kernel: [37964.602394] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 15:56:30 juju-e4d256-prod-github-runner-207 kernel: [37964.603209] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 15:56:30 juju-e4d256-prod-github-runner-207 kernel: [37964.604081] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 15:56:30 juju-e4d256-prod-github-runner-207 kernel: [37964.604879] ? __seccomp_filter+0x4a/0x4a0 Aug 22 15:56:30 juju-e4d256-prod-github-runner-207 kernel: [37964.605620] ? __fget_files+0x86/0xc0 Aug 22 15:56:30 juju-e4d256-prod-github-runner-207 kernel: [37964.606331] __x64_sys_ioctl+0x95/0xd0 Aug 22 15:56:30 juju-e4d256-prod-github-runner-207 kernel: [37964.607032] do_syscall_64+0x5c/0xc0 Aug 22 15:56:30 juju-e4d256-prod-github-runner-207 kernel: [37964.607696] ? do_futex+0x162/0x1f0 Aug 22 15:56:30 juju-e4d256-prod-github-runner-207 kernel: [37964.608363] ? __x64_sys_futex+0x78/0x1e0 Aug 22 15:56:30 juju-e4d256-prod-github-runner-207 kernel: [37964.609035] ? __secure_computing+0xa9/0x120 Aug 22 15:56:30 juju-e4d256-prod-github-runner-207 kernel: [37964.609723] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 15:56:30 juju-e4d256-prod-github-runner-207 kernel: [37964.610483] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:56:30 juju-e4d256-prod-github-runner-207 kernel: [37964.611205] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:56:30 juju-e4d256-prod-github-runner-207 kernel: [37964.611934] ? do_syscall_64+0x69/0xc0 Aug 22 15:56:30 juju-e4d256-prod-github-runner-207 kernel: [37964.612578] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:56:30 juju-e4d256-prod-github-runner-207 kernel: [37964.613295] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:56:30 juju-e4d256-prod-github-runner-207 kernel: [37964.613997] ? do_syscall_64+0x69/0xc0 Aug 22 15:56:30 juju-e4d256-prod-github-runner-207 kernel: [37964.614619] ? do_syscall_64+0x69/0xc0 Aug 22 15:56:30 juju-e4d256-prod-github-runner-207 kernel: [37964.615238] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 15:56:30 juju-e4d256-prod-github-runner-207 kernel: [37964.615959] RIP: 0033:0x7faa5d0edaff Aug 22 15:56:30 juju-e4d256-prod-github-runner-207 kernel: [37964.616603] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 15:56:30 juju-e4d256-prod-github-runner-207 kernel: [37964.618585] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 15:56:30 juju-e4d256-prod-github-runner-207 kernel: [37964.619541] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 15:56:30 juju-e4d256-prod-github-runner-207 kernel: [37964.620450] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 15:56:30 juju-e4d256-prod-github-runner-207 kernel: [37964.621346] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 15:56:30 juju-e4d256-prod-github-runner-207 kernel: [37964.622235] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 15:56:30 juju-e4d256-prod-github-runner-207 kernel: [37964.623127] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 15:56:30 juju-e4d256-prod-github-runner-207 kernel: [37964.624042] Aug 22 15:56:45 juju-e4d256-prod-github-runner-207 kernel: [37979.720706] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 15:56:45 juju-e4d256-prod-github-runner-207 kernel: [37979.721669] rcu: 1-....: (9435927 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=4561103 Aug 22 15:56:45 juju-e4d256-prod-github-runner-207 kernel: [37979.722787] (t=9465630 jiffies g=23269 q=39284) Aug 22 15:56:45 juju-e4d256-prod-github-runner-207 kernel: [37979.723584] NMI backtrace for cpu 1 Aug 22 15:56:45 juju-e4d256-prod-github-runner-207 kernel: [37979.724299] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 15:56:45 juju-e4d256-prod-github-runner-207 kernel: [37979.725402] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 15:56:45 juju-e4d256-prod-github-runner-207 kernel: [37979.726467] Call Trace: Aug 22 15:56:45 juju-e4d256-prod-github-runner-207 kernel: [37979.727148] Aug 22 15:56:45 juju-e4d256-prod-github-runner-207 kernel: [37979.727808] show_stack+0x52/0x5c Aug 22 15:56:45 juju-e4d256-prod-github-runner-207 kernel: [37979.728540] dump_stack_lvl+0x4a/0x63 Aug 22 15:56:45 juju-e4d256-prod-github-runner-207 kernel: [37979.729286] dump_stack+0x10/0x16 Aug 22 15:56:45 juju-e4d256-prod-github-runner-207 kernel: [37979.730004] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 15:56:45 juju-e4d256-prod-github-runner-207 kernel: [37979.730786] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 15:56:45 juju-e4d256-prod-github-runner-207 kernel: [37979.731582] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 15:56:45 juju-e4d256-prod-github-runner-207 kernel: [37979.732405] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 15:56:45 juju-e4d256-prod-github-runner-207 kernel: [37979.733230] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 15:56:45 juju-e4d256-prod-github-runner-207 kernel: [37979.734040] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 15:56:45 juju-e4d256-prod-github-runner-207 kernel: [37979.734817] print_cpu_stall.cold+0x2f/0xe2 Aug 22 15:56:45 juju-e4d256-prod-github-runner-207 kernel: [37979.735597] ? timekeeping_update+0xf7/0x150 Aug 22 15:56:45 juju-e4d256-prod-github-runner-207 kernel: [37979.736370] check_cpu_stall+0x109/0x270 Aug 22 15:56:45 juju-e4d256-prod-github-runner-207 kernel: [37979.737122] rcu_sched_clock_irq+0x9a/0x250 Aug 22 15:56:45 juju-e4d256-prod-github-runner-207 kernel: [37979.737885] update_process_times+0x94/0xd0 Aug 22 15:56:45 juju-e4d256-prod-github-runner-207 kernel: [37979.738645] tick_sched_handle+0x29/0x70 Aug 22 15:56:45 juju-e4d256-prod-github-runner-207 kernel: [37979.739390] tick_sched_timer+0x8c/0xc0 Aug 22 15:56:45 juju-e4d256-prod-github-runner-207 kernel: [37979.740136] ? tick_nohz_handler+0xb0/0xb0 Aug 22 15:56:45 juju-e4d256-prod-github-runner-207 kernel: [37979.740891] __hrtimer_run_queues+0x107/0x230 Aug 22 15:56:45 juju-e4d256-prod-github-runner-207 kernel: [37979.741674] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 15:56:45 juju-e4d256-prod-github-runner-207 kernel: [37979.742448] hrtimer_interrupt+0x101/0x220 Aug 22 15:56:45 juju-e4d256-prod-github-runner-207 kernel: [37979.743210] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 15:56:45 juju-e4d256-prod-github-runner-207 kernel: [37979.744034] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 15:56:45 juju-e4d256-prod-github-runner-207 kernel: [37979.744836] Aug 22 15:56:45 juju-e4d256-prod-github-runner-207 kernel: [37979.745469] Aug 22 15:56:45 juju-e4d256-prod-github-runner-207 kernel: [37979.746097] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 15:56:45 juju-e4d256-prod-github-runner-207 kernel: [37979.746918] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:56:45 juju-e4d256-prod-github-runner-207 kernel: [37979.747821] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 15:56:45 juju-e4d256-prod-github-runner-207 kernel: [37979.750028] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 15:56:45 juju-e4d256-prod-github-runner-207 kernel: [37979.750911] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 15:56:45 juju-e4d256-prod-github-runner-207 kernel: [37979.751921] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 15:56:45 juju-e4d256-prod-github-runner-207 kernel: [37979.752902] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 15:56:45 juju-e4d256-prod-github-runner-207 kernel: [37979.753865] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 15:56:45 juju-e4d256-prod-github-runner-207 kernel: [37979.754823] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 15:56:45 juju-e4d256-prod-github-runner-207 kernel: [37979.755791] ? _raw_spin_lock+0x22/0x30 Aug 22 15:56:45 juju-e4d256-prod-github-runner-207 kernel: [37979.756555] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:56:45 juju-e4d256-prod-github-runner-207 kernel: [37979.757524] direct_page_fault+0x206/0x310 [kvm] Aug 22 15:56:45 juju-e4d256-prod-github-runner-207 kernel: [37979.758363] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 15:56:45 juju-e4d256-prod-github-runner-207 kernel: [37979.759194] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 15:56:45 juju-e4d256-prod-github-runner-207 kernel: [37979.760027] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 15:56:45 juju-e4d256-prod-github-runner-207 kernel: [37979.760828] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 15:56:45 juju-e4d256-prod-github-runner-207 kernel: [37979.761616] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 15:56:45 juju-e4d256-prod-github-runner-207 kernel: [37979.762438] handle_exit+0x98/0x230 [kvm_amd] Aug 22 15:56:45 juju-e4d256-prod-github-runner-207 kernel: [37979.763192] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 15:56:45 juju-e4d256-prod-github-runner-207 kernel: [37979.763987] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 15:56:45 juju-e4d256-prod-github-runner-207 kernel: [37979.764783] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 15:56:45 juju-e4d256-prod-github-runner-207 kernel: [37979.765566] vcpu_run+0x62/0x2c0 [kvm] Aug 22 15:56:45 juju-e4d256-prod-github-runner-207 kernel: [37979.766279] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 15:56:45 juju-e4d256-prod-github-runner-207 kernel: [37979.767013] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 15:56:45 juju-e4d256-prod-github-runner-207 kernel: [37979.767827] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 15:56:45 juju-e4d256-prod-github-runner-207 kernel: [37979.768590] ? __seccomp_filter+0x4a/0x4a0 Aug 22 15:56:45 juju-e4d256-prod-github-runner-207 kernel: [37979.769308] ? __fget_files+0x86/0xc0 Aug 22 15:56:45 juju-e4d256-prod-github-runner-207 kernel: [37979.770000] __x64_sys_ioctl+0x95/0xd0 Aug 22 15:56:45 juju-e4d256-prod-github-runner-207 kernel: [37979.770698] do_syscall_64+0x5c/0xc0 Aug 22 15:56:45 juju-e4d256-prod-github-runner-207 kernel: [37979.771378] ? do_futex+0x162/0x1f0 Aug 22 15:56:45 juju-e4d256-prod-github-runner-207 kernel: [37979.772065] ? __x64_sys_futex+0x78/0x1e0 Aug 22 15:56:45 juju-e4d256-prod-github-runner-207 kernel: [37979.772772] ? __secure_computing+0xa9/0x120 Aug 22 15:56:45 juju-e4d256-prod-github-runner-207 kernel: [37979.773493] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 15:56:45 juju-e4d256-prod-github-runner-207 kernel: [37979.774282] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:56:45 juju-e4d256-prod-github-runner-207 kernel: [37979.775036] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:56:45 juju-e4d256-prod-github-runner-207 kernel: [37979.775802] ? do_syscall_64+0x69/0xc0 Aug 22 15:56:45 juju-e4d256-prod-github-runner-207 kernel: [37979.776497] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:56:45 juju-e4d256-prod-github-runner-207 kernel: [37979.777252] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:56:45 juju-e4d256-prod-github-runner-207 kernel: [37979.778012] ? do_syscall_64+0x69/0xc0 Aug 22 15:56:45 juju-e4d256-prod-github-runner-207 kernel: [37979.778712] ? do_syscall_64+0x69/0xc0 Aug 22 15:56:45 juju-e4d256-prod-github-runner-207 kernel: [37979.779397] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 15:56:45 juju-e4d256-prod-github-runner-207 kernel: [37979.780175] RIP: 0033:0x7faa5d0edaff Aug 22 15:56:45 juju-e4d256-prod-github-runner-207 kernel: [37979.780857] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 15:56:45 juju-e4d256-prod-github-runner-207 kernel: [37979.782956] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 15:56:45 juju-e4d256-prod-github-runner-207 kernel: [37979.783933] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 15:56:45 juju-e4d256-prod-github-runner-207 kernel: [37979.784878] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 15:56:45 juju-e4d256-prod-github-runner-207 kernel: [37979.785820] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 15:56:45 juju-e4d256-prod-github-runner-207 kernel: [37979.786757] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 15:56:45 juju-e4d256-prod-github-runner-207 kernel: [37979.787695] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 15:56:45 juju-e4d256-prod-github-runner-207 kernel: [37979.788615] Aug 22 15:57:10 juju-e4d256-prod-github-runner-207 kernel: [38004.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 35286s! [qemu-system-x86:6715] Aug 22 15:57:10 juju-e4d256-prod-github-runner-207 kernel: [38004.543120] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 15:57:10 juju-e4d256-prod-github-runner-207 kernel: [38004.543187] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 15:57:10 juju-e4d256-prod-github-runner-207 kernel: [38004.555283] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 15:57:10 juju-e4d256-prod-github-runner-207 kernel: [38004.556544] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 15:57:10 juju-e4d256-prod-github-runner-207 kernel: [38004.557765] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:57:10 juju-e4d256-prod-github-runner-207 kernel: [38004.558825] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 15:57:10 juju-e4d256-prod-github-runner-207 kernel: [38004.561408] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 15:57:10 juju-e4d256-prod-github-runner-207 kernel: [38004.562459] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 15:57:10 juju-e4d256-prod-github-runner-207 kernel: [38004.563634] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 15:57:10 juju-e4d256-prod-github-runner-207 kernel: [38004.564801] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 15:57:10 juju-e4d256-prod-github-runner-207 kernel: [38004.566122] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 15:57:10 juju-e4d256-prod-github-runner-207 kernel: [38004.567440] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 15:57:10 juju-e4d256-prod-github-runner-207 kernel: [38004.568745] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 15:57:10 juju-e4d256-prod-github-runner-207 kernel: [38004.570136] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 15:57:10 juju-e4d256-prod-github-runner-207 kernel: [38004.571360] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 15:57:10 juju-e4d256-prod-github-runner-207 kernel: [38004.572691] Call Trace: Aug 22 15:57:10 juju-e4d256-prod-github-runner-207 kernel: [38004.573674] Aug 22 15:57:10 juju-e4d256-prod-github-runner-207 kernel: [38004.574600] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:57:10 juju-e4d256-prod-github-runner-207 kernel: [38004.575742] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:57:10 juju-e4d256-prod-github-runner-207 kernel: [38004.576846] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:57:10 juju-e4d256-prod-github-runner-207 kernel: [38004.578015] ? show_regs.part.0+0x23/0x29 Aug 22 15:57:10 juju-e4d256-prod-github-runner-207 kernel: [38004.579097] ? show_regs.cold+0x8/0xd Aug 22 15:57:10 juju-e4d256-prod-github-runner-207 kernel: [38004.580155] ? watchdog_timer_fn+0x1be/0x220 Aug 22 15:57:10 juju-e4d256-prod-github-runner-207 kernel: [38004.581252] ? lockup_detector_update_enable+0x60/0x60 Aug 22 15:57:10 juju-e4d256-prod-github-runner-207 kernel: [38004.582457] ? __hrtimer_run_queues+0x107/0x230 Aug 22 15:57:10 juju-e4d256-prod-github-runner-207 kernel: [38004.583779] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 15:57:10 juju-e4d256-prod-github-runner-207 kernel: [38004.584892] ? hrtimer_interrupt+0x101/0x220 Aug 22 15:57:10 juju-e4d256-prod-github-runner-207 kernel: [38004.585988] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 15:57:10 juju-e4d256-prod-github-runner-207 kernel: [38004.587160] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 15:57:10 juju-e4d256-prod-github-runner-207 kernel: [38004.588307] Aug 22 15:57:10 juju-e4d256-prod-github-runner-207 kernel: [38004.589203] Aug 22 15:57:10 juju-e4d256-prod-github-runner-207 kernel: [38004.590092] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 15:57:10 juju-e4d256-prod-github-runner-207 kernel: [38004.591230] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:57:10 juju-e4d256-prod-github-runner-207 kernel: [38004.592396] ? _raw_spin_lock+0x22/0x30 Aug 22 15:57:10 juju-e4d256-prod-github-runner-207 kernel: [38004.593425] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:57:10 juju-e4d256-prod-github-runner-207 kernel: [38004.594534] direct_page_fault+0x206/0x310 [kvm] Aug 22 15:57:10 juju-e4d256-prod-github-runner-207 kernel: [38004.595878] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 15:57:10 juju-e4d256-prod-github-runner-207 kernel: [38004.596985] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 15:57:10 juju-e4d256-prod-github-runner-207 kernel: [38004.598096] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 15:57:10 juju-e4d256-prod-github-runner-207 kernel: [38004.599167] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 15:57:10 juju-e4d256-prod-github-runner-207 kernel: [38004.600219] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 15:57:10 juju-e4d256-prod-github-runner-207 kernel: [38004.601308] handle_exit+0x98/0x230 [kvm_amd] Aug 22 15:57:10 juju-e4d256-prod-github-runner-207 kernel: [38004.602291] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 15:57:10 juju-e4d256-prod-github-runner-207 kernel: [38004.603311] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 15:57:10 juju-e4d256-prod-github-runner-207 kernel: [38004.604341] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 15:57:10 juju-e4d256-prod-github-runner-207 kernel: [38004.605349] vcpu_run+0x62/0x2c0 [kvm] Aug 22 15:57:10 juju-e4d256-prod-github-runner-207 kernel: [38004.606237] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 15:57:10 juju-e4d256-prod-github-runner-207 kernel: [38004.607133] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 15:57:10 juju-e4d256-prod-github-runner-207 kernel: [38004.608101] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 15:57:10 juju-e4d256-prod-github-runner-207 kernel: [38004.608990] ? __seccomp_filter+0x4a/0x4a0 Aug 22 15:57:10 juju-e4d256-prod-github-runner-207 kernel: [38004.609814] ? __fget_files+0x86/0xc0 Aug 22 15:57:10 juju-e4d256-prod-github-runner-207 kernel: [38004.610596] __x64_sys_ioctl+0x95/0xd0 Aug 22 15:57:10 juju-e4d256-prod-github-runner-207 kernel: [38004.611389] do_syscall_64+0x5c/0xc0 Aug 22 15:57:10 juju-e4d256-prod-github-runner-207 kernel: [38004.612221] ? do_futex+0x162/0x1f0 Aug 22 15:57:10 juju-e4d256-prod-github-runner-207 kernel: [38004.613210] ? __x64_sys_futex+0x78/0x1e0 Aug 22 15:57:10 juju-e4d256-prod-github-runner-207 kernel: [38004.613979] ? __secure_computing+0xa9/0x120 Aug 22 15:57:10 juju-e4d256-prod-github-runner-207 kernel: [38004.614757] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 15:57:10 juju-e4d256-prod-github-runner-207 kernel: [38004.615643] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:57:10 juju-e4d256-prod-github-runner-207 kernel: [38004.616458] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:57:10 juju-e4d256-prod-github-runner-207 kernel: [38004.617271] ? do_syscall_64+0x69/0xc0 Aug 22 15:57:10 juju-e4d256-prod-github-runner-207 kernel: [38004.617996] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:57:10 juju-e4d256-prod-github-runner-207 kernel: [38004.618788] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:57:10 juju-e4d256-prod-github-runner-207 kernel: [38004.619599] ? do_syscall_64+0x69/0xc0 Aug 22 15:57:10 juju-e4d256-prod-github-runner-207 kernel: [38004.620301] ? do_syscall_64+0x69/0xc0 Aug 22 15:57:10 juju-e4d256-prod-github-runner-207 kernel: [38004.621004] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 15:57:10 juju-e4d256-prod-github-runner-207 kernel: [38004.621806] RIP: 0033:0x7faa5d0edaff Aug 22 15:57:10 juju-e4d256-prod-github-runner-207 kernel: [38004.622500] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 15:57:10 juju-e4d256-prod-github-runner-207 kernel: [38004.624860] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 15:57:10 juju-e4d256-prod-github-runner-207 kernel: [38004.625922] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 15:57:10 juju-e4d256-prod-github-runner-207 kernel: [38004.626943] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 15:57:10 juju-e4d256-prod-github-runner-207 kernel: [38004.627983] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 15:57:10 juju-e4d256-prod-github-runner-207 kernel: [38004.629005] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 15:57:10 juju-e4d256-prod-github-runner-207 kernel: [38004.630030] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 15:57:10 juju-e4d256-prod-github-runner-207 kernel: [38004.631074] Aug 22 15:57:38 juju-e4d256-prod-github-runner-207 kernel: [38032.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 35312s! [qemu-system-x86:6715] Aug 22 15:57:38 juju-e4d256-prod-github-runner-207 kernel: [38032.543719] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 15:57:38 juju-e4d256-prod-github-runner-207 kernel: [38032.543966] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 15:57:38 juju-e4d256-prod-github-runner-207 kernel: [38032.556075] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 15:57:38 juju-e4d256-prod-github-runner-207 kernel: [38032.557346] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 15:57:38 juju-e4d256-prod-github-runner-207 kernel: [38032.558560] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:57:38 juju-e4d256-prod-github-runner-207 kernel: [38032.559620] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 15:57:38 juju-e4d256-prod-github-runner-207 kernel: [38032.562157] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 15:57:38 juju-e4d256-prod-github-runner-207 kernel: [38032.563211] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 15:57:38 juju-e4d256-prod-github-runner-207 kernel: [38032.564372] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 15:57:38 juju-e4d256-prod-github-runner-207 kernel: [38032.565531] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 15:57:38 juju-e4d256-prod-github-runner-207 kernel: [38032.566693] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 15:57:38 juju-e4d256-prod-github-runner-207 kernel: [38032.567907] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 15:57:38 juju-e4d256-prod-github-runner-207 kernel: [38032.569076] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 15:57:38 juju-e4d256-prod-github-runner-207 kernel: [38032.570306] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 15:57:38 juju-e4d256-prod-github-runner-207 kernel: [38032.571411] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 15:57:38 juju-e4d256-prod-github-runner-207 kernel: [38032.572608] Call Trace: Aug 22 15:57:38 juju-e4d256-prod-github-runner-207 kernel: [38032.573520] Aug 22 15:57:38 juju-e4d256-prod-github-runner-207 kernel: [38032.574409] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:57:38 juju-e4d256-prod-github-runner-207 kernel: [38032.575448] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:57:38 juju-e4d256-prod-github-runner-207 kernel: [38032.576473] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:57:38 juju-e4d256-prod-github-runner-207 kernel: [38032.577561] ? show_regs.part.0+0x23/0x29 Aug 22 15:57:38 juju-e4d256-prod-github-runner-207 kernel: [38032.578555] ? show_regs.cold+0x8/0xd Aug 22 15:57:38 juju-e4d256-prod-github-runner-207 kernel: [38032.579532] ? watchdog_timer_fn+0x1be/0x220 Aug 22 15:57:38 juju-e4d256-prod-github-runner-207 kernel: [38032.580539] ? lockup_detector_update_enable+0x60/0x60 Aug 22 15:57:38 juju-e4d256-prod-github-runner-207 kernel: [38032.581601] ? __hrtimer_run_queues+0x107/0x230 Aug 22 15:57:38 juju-e4d256-prod-github-runner-207 kernel: [38032.582630] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 15:57:38 juju-e4d256-prod-github-runner-207 kernel: [38032.583662] ? hrtimer_interrupt+0x101/0x220 Aug 22 15:57:38 juju-e4d256-prod-github-runner-207 kernel: [38032.584676] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 15:57:38 juju-e4d256-prod-github-runner-207 kernel: [38032.585743] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 15:57:38 juju-e4d256-prod-github-runner-207 kernel: [38032.586786] Aug 22 15:57:38 juju-e4d256-prod-github-runner-207 kernel: [38032.587646] Aug 22 15:57:38 juju-e4d256-prod-github-runner-207 kernel: [38032.588483] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 15:57:38 juju-e4d256-prod-github-runner-207 kernel: [38032.589519] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:57:38 juju-e4d256-prod-github-runner-207 kernel: [38032.590555] ? _raw_spin_lock+0x22/0x30 Aug 22 15:57:38 juju-e4d256-prod-github-runner-207 kernel: [38032.591510] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:57:38 juju-e4d256-prod-github-runner-207 kernel: [38032.592525] direct_page_fault+0x206/0x310 [kvm] Aug 22 15:57:38 juju-e4d256-prod-github-runner-207 kernel: [38032.593548] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 15:57:38 juju-e4d256-prod-github-runner-207 kernel: [38032.594571] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 15:57:38 juju-e4d256-prod-github-runner-207 kernel: [38032.595581] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 15:57:38 juju-e4d256-prod-github-runner-207 kernel: [38032.596568] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 15:57:38 juju-e4d256-prod-github-runner-207 kernel: [38032.597522] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 15:57:38 juju-e4d256-prod-github-runner-207 kernel: [38032.598505] handle_exit+0x98/0x230 [kvm_amd] Aug 22 15:57:38 juju-e4d256-prod-github-runner-207 kernel: [38032.599402] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 15:57:38 juju-e4d256-prod-github-runner-207 kernel: [38032.600327] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 15:57:38 juju-e4d256-prod-github-runner-207 kernel: [38032.601414] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 15:57:38 juju-e4d256-prod-github-runner-207 kernel: [38032.602318] vcpu_run+0x62/0x2c0 [kvm] Aug 22 15:57:38 juju-e4d256-prod-github-runner-207 kernel: [38032.603191] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 15:57:38 juju-e4d256-prod-github-runner-207 kernel: [38032.604012] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 15:57:38 juju-e4d256-prod-github-runner-207 kernel: [38032.604862] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 15:57:38 juju-e4d256-prod-github-runner-207 kernel: [38032.605656] ? __seccomp_filter+0x4a/0x4a0 Aug 22 15:57:38 juju-e4d256-prod-github-runner-207 kernel: [38032.606394] ? __fget_files+0x86/0xc0 Aug 22 15:57:38 juju-e4d256-prod-github-runner-207 kernel: [38032.607124] __x64_sys_ioctl+0x95/0xd0 Aug 22 15:57:38 juju-e4d256-prod-github-runner-207 kernel: [38032.607824] do_syscall_64+0x5c/0xc0 Aug 22 15:57:38 juju-e4d256-prod-github-runner-207 kernel: [38032.608487] ? do_futex+0x162/0x1f0 Aug 22 15:57:38 juju-e4d256-prod-github-runner-207 kernel: [38032.609133] ? __x64_sys_futex+0x78/0x1e0 Aug 22 15:57:38 juju-e4d256-prod-github-runner-207 kernel: [38032.609804] ? __secure_computing+0xa9/0x120 Aug 22 15:57:38 juju-e4d256-prod-github-runner-207 kernel: [38032.610496] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 15:57:38 juju-e4d256-prod-github-runner-207 kernel: [38032.611259] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:57:38 juju-e4d256-prod-github-runner-207 kernel: [38032.611978] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:57:38 juju-e4d256-prod-github-runner-207 kernel: [38032.612694] ? do_syscall_64+0x69/0xc0 Aug 22 15:57:38 juju-e4d256-prod-github-runner-207 kernel: [38032.613337] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:57:38 juju-e4d256-prod-github-runner-207 kernel: [38032.614037] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:57:38 juju-e4d256-prod-github-runner-207 kernel: [38032.614730] ? do_syscall_64+0x69/0xc0 Aug 22 15:57:38 juju-e4d256-prod-github-runner-207 kernel: [38032.615357] ? do_syscall_64+0x69/0xc0 Aug 22 15:57:38 juju-e4d256-prod-github-runner-207 kernel: [38032.615980] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 15:57:38 juju-e4d256-prod-github-runner-207 kernel: [38032.616681] RIP: 0033:0x7faa5d0edaff Aug 22 15:57:38 juju-e4d256-prod-github-runner-207 kernel: [38032.617318] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 15:57:38 juju-e4d256-prod-github-runner-207 kernel: [38032.619349] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 15:57:38 juju-e4d256-prod-github-runner-207 kernel: [38032.620255] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 15:57:38 juju-e4d256-prod-github-runner-207 kernel: [38032.621139] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 15:57:38 juju-e4d256-prod-github-runner-207 kernel: [38032.622027] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 15:57:38 juju-e4d256-prod-github-runner-207 kernel: [38032.622923] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 15:57:38 juju-e4d256-prod-github-runner-207 kernel: [38032.623809] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 15:57:38 juju-e4d256-prod-github-runner-207 kernel: [38032.624702] Aug 22 15:58:06 juju-e4d256-prod-github-runner-207 kernel: [38060.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 35338s! [qemu-system-x86:6715] Aug 22 15:58:06 juju-e4d256-prod-github-runner-207 kernel: [38060.543098] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 15:58:06 juju-e4d256-prod-github-runner-207 kernel: [38060.543163] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 15:58:06 juju-e4d256-prod-github-runner-207 kernel: [38060.555286] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 15:58:06 juju-e4d256-prod-github-runner-207 kernel: [38060.556566] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 15:58:06 juju-e4d256-prod-github-runner-207 kernel: [38060.557789] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:58:06 juju-e4d256-prod-github-runner-207 kernel: [38060.558852] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 15:58:06 juju-e4d256-prod-github-runner-207 kernel: [38060.561579] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 15:58:06 juju-e4d256-prod-github-runner-207 kernel: [38060.562644] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 15:58:06 juju-e4d256-prod-github-runner-207 kernel: [38060.563804] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 15:58:06 juju-e4d256-prod-github-runner-207 kernel: [38060.564961] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 15:58:06 juju-e4d256-prod-github-runner-207 kernel: [38060.566118] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 15:58:06 juju-e4d256-prod-github-runner-207 kernel: [38060.567286] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 15:58:06 juju-e4d256-prod-github-runner-207 kernel: [38060.568451] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 15:58:06 juju-e4d256-prod-github-runner-207 kernel: [38060.569683] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 15:58:06 juju-e4d256-prod-github-runner-207 kernel: [38060.570790] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 15:58:06 juju-e4d256-prod-github-runner-207 kernel: [38060.571982] Call Trace: Aug 22 15:58:06 juju-e4d256-prod-github-runner-207 kernel: [38060.572891] Aug 22 15:58:06 juju-e4d256-prod-github-runner-207 kernel: [38060.573774] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:58:06 juju-e4d256-prod-github-runner-207 kernel: [38060.574984] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:58:06 juju-e4d256-prod-github-runner-207 kernel: [38060.576003] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:58:06 juju-e4d256-prod-github-runner-207 kernel: [38060.577091] ? show_regs.part.0+0x23/0x29 Aug 22 15:58:06 juju-e4d256-prod-github-runner-207 kernel: [38060.578123] ? show_regs.cold+0x8/0xd Aug 22 15:58:06 juju-e4d256-prod-github-runner-207 kernel: [38060.579110] ? watchdog_timer_fn+0x1be/0x220 Aug 22 15:58:06 juju-e4d256-prod-github-runner-207 kernel: [38060.580116] ? lockup_detector_update_enable+0x60/0x60 Aug 22 15:58:06 juju-e4d256-prod-github-runner-207 kernel: [38060.581179] ? __hrtimer_run_queues+0x107/0x230 Aug 22 15:58:06 juju-e4d256-prod-github-runner-207 kernel: [38060.582203] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 15:58:06 juju-e4d256-prod-github-runner-207 kernel: [38060.583233] ? hrtimer_interrupt+0x101/0x220 Aug 22 15:58:06 juju-e4d256-prod-github-runner-207 kernel: [38060.584246] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 15:58:06 juju-e4d256-prod-github-runner-207 kernel: [38060.585316] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 15:58:06 juju-e4d256-prod-github-runner-207 kernel: [38060.586362] Aug 22 15:58:06 juju-e4d256-prod-github-runner-207 kernel: [38060.587219] Aug 22 15:58:06 juju-e4d256-prod-github-runner-207 kernel: [38060.588153] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 15:58:06 juju-e4d256-prod-github-runner-207 kernel: [38060.589184] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:58:06 juju-e4d256-prod-github-runner-207 kernel: [38060.590220] ? _raw_spin_lock+0x22/0x30 Aug 22 15:58:06 juju-e4d256-prod-github-runner-207 kernel: [38060.591169] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:58:06 juju-e4d256-prod-github-runner-207 kernel: [38060.592192] direct_page_fault+0x206/0x310 [kvm] Aug 22 15:58:06 juju-e4d256-prod-github-runner-207 kernel: [38060.593212] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 15:58:06 juju-e4d256-prod-github-runner-207 kernel: [38060.594223] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 15:58:06 juju-e4d256-prod-github-runner-207 kernel: [38060.595230] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 15:58:06 juju-e4d256-prod-github-runner-207 kernel: [38060.596197] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 15:58:06 juju-e4d256-prod-github-runner-207 kernel: [38060.597145] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 15:58:06 juju-e4d256-prod-github-runner-207 kernel: [38060.598120] handle_exit+0x98/0x230 [kvm_amd] Aug 22 15:58:06 juju-e4d256-prod-github-runner-207 kernel: [38060.599023] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 15:58:06 juju-e4d256-prod-github-runner-207 kernel: [38060.599940] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 15:58:06 juju-e4d256-prod-github-runner-207 kernel: [38060.600860] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 15:58:06 juju-e4d256-prod-github-runner-207 kernel: [38060.601762] vcpu_run+0x62/0x2c0 [kvm] Aug 22 15:58:06 juju-e4d256-prod-github-runner-207 kernel: [38060.602571] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 15:58:06 juju-e4d256-prod-github-runner-207 kernel: [38060.603380] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 15:58:06 juju-e4d256-prod-github-runner-207 kernel: [38060.604230] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 15:58:06 juju-e4d256-prod-github-runner-207 kernel: [38060.605030] ? __seccomp_filter+0x4a/0x4a0 Aug 22 15:58:06 juju-e4d256-prod-github-runner-207 kernel: [38060.605769] ? __fget_files+0x86/0xc0 Aug 22 15:58:06 juju-e4d256-prod-github-runner-207 kernel: [38060.606470] __x64_sys_ioctl+0x95/0xd0 Aug 22 15:58:06 juju-e4d256-prod-github-runner-207 kernel: [38060.607179] do_syscall_64+0x5c/0xc0 Aug 22 15:58:06 juju-e4d256-prod-github-runner-207 kernel: [38060.607844] ? do_futex+0x162/0x1f0 Aug 22 15:58:06 juju-e4d256-prod-github-runner-207 kernel: [38060.608490] ? __x64_sys_futex+0x78/0x1e0 Aug 22 15:58:06 juju-e4d256-prod-github-runner-207 kernel: [38060.609161] ? __secure_computing+0xa9/0x120 Aug 22 15:58:06 juju-e4d256-prod-github-runner-207 kernel: [38060.609848] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 15:58:06 juju-e4d256-prod-github-runner-207 kernel: [38060.610620] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:58:06 juju-e4d256-prod-github-runner-207 kernel: [38060.611339] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:58:06 juju-e4d256-prod-github-runner-207 kernel: [38060.612057] ? do_syscall_64+0x69/0xc0 Aug 22 15:58:06 juju-e4d256-prod-github-runner-207 kernel: [38060.612699] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:58:06 juju-e4d256-prod-github-runner-207 kernel: [38060.613402] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:58:06 juju-e4d256-prod-github-runner-207 kernel: [38060.614094] ? do_syscall_64+0x69/0xc0 Aug 22 15:58:06 juju-e4d256-prod-github-runner-207 kernel: [38060.614725] ? do_syscall_64+0x69/0xc0 Aug 22 15:58:06 juju-e4d256-prod-github-runner-207 kernel: [38060.615347] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 15:58:06 juju-e4d256-prod-github-runner-207 kernel: [38060.616055] RIP: 0033:0x7faa5d0edaff Aug 22 15:58:06 juju-e4d256-prod-github-runner-207 kernel: [38060.616695] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 15:58:06 juju-e4d256-prod-github-runner-207 kernel: [38060.618685] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 15:58:06 juju-e4d256-prod-github-runner-207 kernel: [38060.619601] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 15:58:06 juju-e4d256-prod-github-runner-207 kernel: [38060.620493] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 15:58:06 juju-e4d256-prod-github-runner-207 kernel: [38060.621383] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 15:58:06 juju-e4d256-prod-github-runner-207 kernel: [38060.622277] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 15:58:06 juju-e4d256-prod-github-runner-207 kernel: [38060.623173] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 15:58:06 juju-e4d256-prod-github-runner-207 kernel: [38060.624063] Aug 22 15:58:34 juju-e4d256-prod-github-runner-207 kernel: [38088.541976] watchdog: BUG: soft lockup - CPU#1 stuck for 35364s! [qemu-system-x86:6715] Aug 22 15:58:34 juju-e4d256-prod-github-runner-207 kernel: [38088.543122] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 15:58:34 juju-e4d256-prod-github-runner-207 kernel: [38088.543193] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 15:58:34 juju-e4d256-prod-github-runner-207 kernel: [38088.555306] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 15:58:34 juju-e4d256-prod-github-runner-207 kernel: [38088.556586] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 15:58:34 juju-e4d256-prod-github-runner-207 kernel: [38088.557837] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:58:34 juju-e4d256-prod-github-runner-207 kernel: [38088.558920] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 15:58:34 juju-e4d256-prod-github-runner-207 kernel: [38088.561519] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 15:58:34 juju-e4d256-prod-github-runner-207 kernel: [38088.562595] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 15:58:34 juju-e4d256-prod-github-runner-207 kernel: [38088.563768] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 15:58:34 juju-e4d256-prod-github-runner-207 kernel: [38088.564943] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 15:58:34 juju-e4d256-prod-github-runner-207 kernel: [38088.566115] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 15:58:34 juju-e4d256-prod-github-runner-207 kernel: [38088.567304] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 15:58:34 juju-e4d256-prod-github-runner-207 kernel: [38088.568500] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 15:58:34 juju-e4d256-prod-github-runner-207 kernel: [38088.569738] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 15:58:34 juju-e4d256-prod-github-runner-207 kernel: [38088.570853] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 15:58:34 juju-e4d256-prod-github-runner-207 kernel: [38088.572049] Call Trace: Aug 22 15:58:34 juju-e4d256-prod-github-runner-207 kernel: [38088.572960] Aug 22 15:58:34 juju-e4d256-prod-github-runner-207 kernel: [38088.573858] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:58:34 juju-e4d256-prod-github-runner-207 kernel: [38088.574909] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:58:34 juju-e4d256-prod-github-runner-207 kernel: [38088.575929] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:58:34 juju-e4d256-prod-github-runner-207 kernel: [38088.577007] ? show_regs.part.0+0x23/0x29 Aug 22 15:58:34 juju-e4d256-prod-github-runner-207 kernel: [38088.578023] ? show_regs.cold+0x8/0xd Aug 22 15:58:34 juju-e4d256-prod-github-runner-207 kernel: [38088.579019] ? watchdog_timer_fn+0x1be/0x220 Aug 22 15:58:34 juju-e4d256-prod-github-runner-207 kernel: [38088.580057] ? lockup_detector_update_enable+0x60/0x60 Aug 22 15:58:34 juju-e4d256-prod-github-runner-207 kernel: [38088.581127] ? __hrtimer_run_queues+0x107/0x230 Aug 22 15:58:34 juju-e4d256-prod-github-runner-207 kernel: [38088.582161] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 15:58:34 juju-e4d256-prod-github-runner-207 kernel: [38088.583233] ? hrtimer_interrupt+0x101/0x220 Aug 22 15:58:34 juju-e4d256-prod-github-runner-207 kernel: [38088.584252] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 15:58:34 juju-e4d256-prod-github-runner-207 kernel: [38088.585328] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 15:58:34 juju-e4d256-prod-github-runner-207 kernel: [38088.586418] Aug 22 15:58:34 juju-e4d256-prod-github-runner-207 kernel: [38088.587276] Aug 22 15:58:34 juju-e4d256-prod-github-runner-207 kernel: [38088.588331] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 15:58:34 juju-e4d256-prod-github-runner-207 kernel: [38088.589390] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:58:34 juju-e4d256-prod-github-runner-207 kernel: [38088.590458] ? _raw_spin_lock+0x22/0x30 Aug 22 15:58:34 juju-e4d256-prod-github-runner-207 kernel: [38088.591442] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:58:34 juju-e4d256-prod-github-runner-207 kernel: [38088.592485] direct_page_fault+0x206/0x310 [kvm] Aug 22 15:58:34 juju-e4d256-prod-github-runner-207 kernel: [38088.593523] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 15:58:34 juju-e4d256-prod-github-runner-207 kernel: [38088.594554] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 15:58:34 juju-e4d256-prod-github-runner-207 kernel: [38088.595561] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 15:58:34 juju-e4d256-prod-github-runner-207 kernel: [38088.596537] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 15:58:34 juju-e4d256-prod-github-runner-207 kernel: [38088.597489] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 15:58:34 juju-e4d256-prod-github-runner-207 kernel: [38088.598501] handle_exit+0x98/0x230 [kvm_amd] Aug 22 15:58:34 juju-e4d256-prod-github-runner-207 kernel: [38088.599400] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 15:58:34 juju-e4d256-prod-github-runner-207 kernel: [38088.600313] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 15:58:34 juju-e4d256-prod-github-runner-207 kernel: [38088.601240] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 15:58:34 juju-e4d256-prod-github-runner-207 kernel: [38088.602140] vcpu_run+0x62/0x2c0 [kvm] Aug 22 15:58:34 juju-e4d256-prod-github-runner-207 kernel: [38088.602969] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 15:58:34 juju-e4d256-prod-github-runner-207 kernel: [38088.603775] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 15:58:34 juju-e4d256-prod-github-runner-207 kernel: [38088.604626] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 15:58:34 juju-e4d256-prod-github-runner-207 kernel: [38088.605426] ? __seccomp_filter+0x4a/0x4a0 Aug 22 15:58:34 juju-e4d256-prod-github-runner-207 kernel: [38088.606166] ? __fget_files+0x86/0xc0 Aug 22 15:58:34 juju-e4d256-prod-github-runner-207 kernel: [38088.606885] __x64_sys_ioctl+0x95/0xd0 Aug 22 15:58:34 juju-e4d256-prod-github-runner-207 kernel: [38088.607579] do_syscall_64+0x5c/0xc0 Aug 22 15:58:34 juju-e4d256-prod-github-runner-207 kernel: [38088.608260] ? do_futex+0x162/0x1f0 Aug 22 15:58:34 juju-e4d256-prod-github-runner-207 kernel: [38088.608926] ? __x64_sys_futex+0x78/0x1e0 Aug 22 15:58:34 juju-e4d256-prod-github-runner-207 kernel: [38088.609604] ? __secure_computing+0xa9/0x120 Aug 22 15:58:34 juju-e4d256-prod-github-runner-207 kernel: [38088.610307] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 15:58:34 juju-e4d256-prod-github-runner-207 kernel: [38088.611080] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:58:34 juju-e4d256-prod-github-runner-207 kernel: [38088.611808] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:58:34 juju-e4d256-prod-github-runner-207 kernel: [38088.612542] ? do_syscall_64+0x69/0xc0 Aug 22 15:58:34 juju-e4d256-prod-github-runner-207 kernel: [38088.613240] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:58:34 juju-e4d256-prod-github-runner-207 kernel: [38088.613982] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:58:34 juju-e4d256-prod-github-runner-207 kernel: [38088.614701] ? do_syscall_64+0x69/0xc0 Aug 22 15:58:34 juju-e4d256-prod-github-runner-207 kernel: [38088.615333] ? do_syscall_64+0x69/0xc0 Aug 22 15:58:34 juju-e4d256-prod-github-runner-207 kernel: [38088.615954] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 15:58:34 juju-e4d256-prod-github-runner-207 kernel: [38088.616668] RIP: 0033:0x7faa5d0edaff Aug 22 15:58:34 juju-e4d256-prod-github-runner-207 kernel: [38088.617298] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 15:58:34 juju-e4d256-prod-github-runner-207 kernel: [38088.619321] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 15:58:34 juju-e4d256-prod-github-runner-207 kernel: [38088.620238] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 15:58:34 juju-e4d256-prod-github-runner-207 kernel: [38088.621130] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 15:58:34 juju-e4d256-prod-github-runner-207 kernel: [38088.622029] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 15:58:34 juju-e4d256-prod-github-runner-207 kernel: [38088.622948] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 15:58:34 juju-e4d256-prod-github-runner-207 kernel: [38088.623848] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 15:58:34 juju-e4d256-prod-github-runner-207 kernel: [38088.624748] Aug 22 15:59:02 juju-e4d256-prod-github-runner-207 kernel: [38116.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 35390s! [qemu-system-x86:6715] Aug 22 15:59:02 juju-e4d256-prod-github-runner-207 kernel: [38116.543176] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 15:59:02 juju-e4d256-prod-github-runner-207 kernel: [38116.543316] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 15:59:02 juju-e4d256-prod-github-runner-207 kernel: [38116.555421] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 15:59:02 juju-e4d256-prod-github-runner-207 kernel: [38116.556693] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 15:59:02 juju-e4d256-prod-github-runner-207 kernel: [38116.557961] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:59:02 juju-e4d256-prod-github-runner-207 kernel: [38116.559018] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 15:59:02 juju-e4d256-prod-github-runner-207 kernel: [38116.561562] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 15:59:02 juju-e4d256-prod-github-runner-207 kernel: [38116.562619] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 15:59:02 juju-e4d256-prod-github-runner-207 kernel: [38116.563779] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 15:59:02 juju-e4d256-prod-github-runner-207 kernel: [38116.564941] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 15:59:02 juju-e4d256-prod-github-runner-207 kernel: [38116.566132] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 15:59:02 juju-e4d256-prod-github-runner-207 kernel: [38116.567297] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 15:59:02 juju-e4d256-prod-github-runner-207 kernel: [38116.568466] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 15:59:02 juju-e4d256-prod-github-runner-207 kernel: [38116.569702] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 15:59:02 juju-e4d256-prod-github-runner-207 kernel: [38116.570810] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 15:59:02 juju-e4d256-prod-github-runner-207 kernel: [38116.572006] Call Trace: Aug 22 15:59:02 juju-e4d256-prod-github-runner-207 kernel: [38116.572919] Aug 22 15:59:02 juju-e4d256-prod-github-runner-207 kernel: [38116.573803] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:59:02 juju-e4d256-prod-github-runner-207 kernel: [38116.574848] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:59:02 juju-e4d256-prod-github-runner-207 kernel: [38116.575872] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:59:02 juju-e4d256-prod-github-runner-207 kernel: [38116.576968] ? show_regs.part.0+0x23/0x29 Aug 22 15:59:02 juju-e4d256-prod-github-runner-207 kernel: [38116.577982] ? show_regs.cold+0x8/0xd Aug 22 15:59:02 juju-e4d256-prod-github-runner-207 kernel: [38116.578993] ? watchdog_timer_fn+0x1be/0x220 Aug 22 15:59:02 juju-e4d256-prod-github-runner-207 kernel: [38116.580005] ? lockup_detector_update_enable+0x60/0x60 Aug 22 15:59:02 juju-e4d256-prod-github-runner-207 kernel: [38116.581069] ? __hrtimer_run_queues+0x107/0x230 Aug 22 15:59:02 juju-e4d256-prod-github-runner-207 kernel: [38116.582106] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 15:59:02 juju-e4d256-prod-github-runner-207 kernel: [38116.583134] ? hrtimer_interrupt+0x101/0x220 Aug 22 15:59:02 juju-e4d256-prod-github-runner-207 kernel: [38116.584150] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 15:59:02 juju-e4d256-prod-github-runner-207 kernel: [38116.585217] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 15:59:02 juju-e4d256-prod-github-runner-207 kernel: [38116.586279] Aug 22 15:59:02 juju-e4d256-prod-github-runner-207 kernel: [38116.587137] Aug 22 15:59:02 juju-e4d256-prod-github-runner-207 kernel: [38116.587973] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 15:59:02 juju-e4d256-prod-github-runner-207 kernel: [38116.589042] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:59:02 juju-e4d256-prod-github-runner-207 kernel: [38116.590089] ? _raw_spin_lock+0x22/0x30 Aug 22 15:59:02 juju-e4d256-prod-github-runner-207 kernel: [38116.591032] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:59:02 juju-e4d256-prod-github-runner-207 kernel: [38116.592045] direct_page_fault+0x206/0x310 [kvm] Aug 22 15:59:02 juju-e4d256-prod-github-runner-207 kernel: [38116.593068] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 15:59:02 juju-e4d256-prod-github-runner-207 kernel: [38116.594089] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 15:59:02 juju-e4d256-prod-github-runner-207 kernel: [38116.595095] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 15:59:02 juju-e4d256-prod-github-runner-207 kernel: [38116.596085] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 15:59:02 juju-e4d256-prod-github-runner-207 kernel: [38116.597033] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 15:59:02 juju-e4d256-prod-github-runner-207 kernel: [38116.598039] handle_exit+0x98/0x230 [kvm_amd] Aug 22 15:59:02 juju-e4d256-prod-github-runner-207 kernel: [38116.598941] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 15:59:02 juju-e4d256-prod-github-runner-207 kernel: [38116.599853] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 15:59:02 juju-e4d256-prod-github-runner-207 kernel: [38116.600773] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 15:59:02 juju-e4d256-prod-github-runner-207 kernel: [38116.601677] vcpu_run+0x62/0x2c0 [kvm] Aug 22 15:59:02 juju-e4d256-prod-github-runner-207 kernel: [38116.602514] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 15:59:02 juju-e4d256-prod-github-runner-207 kernel: [38116.603333] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 15:59:02 juju-e4d256-prod-github-runner-207 kernel: [38116.604222] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 15:59:02 juju-e4d256-prod-github-runner-207 kernel: [38116.605020] ? __seccomp_filter+0x4a/0x4a0 Aug 22 15:59:02 juju-e4d256-prod-github-runner-207 kernel: [38116.605761] ? __fget_files+0x86/0xc0 Aug 22 15:59:02 juju-e4d256-prod-github-runner-207 kernel: [38116.606478] __x64_sys_ioctl+0x95/0xd0 Aug 22 15:59:02 juju-e4d256-prod-github-runner-207 kernel: [38116.607168] do_syscall_64+0x5c/0xc0 Aug 22 15:59:02 juju-e4d256-prod-github-runner-207 kernel: [38116.607834] ? do_futex+0x162/0x1f0 Aug 22 15:59:02 juju-e4d256-prod-github-runner-207 kernel: [38116.608479] ? __x64_sys_futex+0x78/0x1e0 Aug 22 15:59:02 juju-e4d256-prod-github-runner-207 kernel: [38116.609151] ? __secure_computing+0xa9/0x120 Aug 22 15:59:02 juju-e4d256-prod-github-runner-207 kernel: [38116.609836] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 15:59:02 juju-e4d256-prod-github-runner-207 kernel: [38116.610640] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:59:02 juju-e4d256-prod-github-runner-207 kernel: [38116.611358] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:59:02 juju-e4d256-prod-github-runner-207 kernel: [38116.612076] ? do_syscall_64+0x69/0xc0 Aug 22 15:59:02 juju-e4d256-prod-github-runner-207 kernel: [38116.612717] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:59:02 juju-e4d256-prod-github-runner-207 kernel: [38116.613416] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:59:02 juju-e4d256-prod-github-runner-207 kernel: [38116.614125] ? do_syscall_64+0x69/0xc0 Aug 22 15:59:02 juju-e4d256-prod-github-runner-207 kernel: [38116.614751] ? do_syscall_64+0x69/0xc0 Aug 22 15:59:02 juju-e4d256-prod-github-runner-207 kernel: [38116.615370] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 15:59:02 juju-e4d256-prod-github-runner-207 kernel: [38116.616071] RIP: 0033:0x7faa5d0edaff Aug 22 15:59:02 juju-e4d256-prod-github-runner-207 kernel: [38116.616692] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 15:59:02 juju-e4d256-prod-github-runner-207 kernel: [38116.618681] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 15:59:02 juju-e4d256-prod-github-runner-207 kernel: [38116.619587] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 15:59:02 juju-e4d256-prod-github-runner-207 kernel: [38116.620473] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 15:59:02 juju-e4d256-prod-github-runner-207 kernel: [38116.621356] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 15:59:02 juju-e4d256-prod-github-runner-207 kernel: [38116.622250] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 15:59:02 juju-e4d256-prod-github-runner-207 kernel: [38116.623133] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 15:59:02 juju-e4d256-prod-github-runner-207 kernel: [38116.624025] Aug 22 15:59:30 juju-e4d256-prod-github-runner-207 kernel: [38144.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 35416s! [qemu-system-x86:6715] Aug 22 15:59:30 juju-e4d256-prod-github-runner-207 kernel: [38144.543808] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 15:59:30 juju-e4d256-prod-github-runner-207 kernel: [38144.544024] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 15:59:30 juju-e4d256-prod-github-runner-207 kernel: [38144.556083] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 15:59:30 juju-e4d256-prod-github-runner-207 kernel: [38144.557343] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 15:59:30 juju-e4d256-prod-github-runner-207 kernel: [38144.558575] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:59:30 juju-e4d256-prod-github-runner-207 kernel: [38144.559653] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 15:59:30 juju-e4d256-prod-github-runner-207 kernel: [38144.562248] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 15:59:30 juju-e4d256-prod-github-runner-207 kernel: [38144.563400] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 15:59:30 juju-e4d256-prod-github-runner-207 kernel: [38144.564693] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 15:59:30 juju-e4d256-prod-github-runner-207 kernel: [38144.566210] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 15:59:30 juju-e4d256-prod-github-runner-207 kernel: [38144.567502] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 15:59:30 juju-e4d256-prod-github-runner-207 kernel: [38144.568795] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 15:59:30 juju-e4d256-prod-github-runner-207 kernel: [38144.570106] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 15:59:30 juju-e4d256-prod-github-runner-207 kernel: [38144.571501] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 15:59:30 juju-e4d256-prod-github-runner-207 kernel: [38144.572714] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 15:59:30 juju-e4d256-prod-github-runner-207 kernel: [38144.574065] Call Trace: Aug 22 15:59:30 juju-e4d256-prod-github-runner-207 kernel: [38144.575034] Aug 22 15:59:30 juju-e4d256-prod-github-runner-207 kernel: [38144.576044] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:59:30 juju-e4d256-prod-github-runner-207 kernel: [38144.577153] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 15:59:30 juju-e4d256-prod-github-runner-207 kernel: [38144.578205] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:59:30 juju-e4d256-prod-github-runner-207 kernel: [38144.579282] ? show_regs.part.0+0x23/0x29 Aug 22 15:59:30 juju-e4d256-prod-github-runner-207 kernel: [38144.580279] ? show_regs.cold+0x8/0xd Aug 22 15:59:30 juju-e4d256-prod-github-runner-207 kernel: [38144.581255] ? watchdog_timer_fn+0x1be/0x220 Aug 22 15:59:30 juju-e4d256-prod-github-runner-207 kernel: [38144.582276] ? lockup_detector_update_enable+0x60/0x60 Aug 22 15:59:30 juju-e4d256-prod-github-runner-207 kernel: [38144.583339] ? __hrtimer_run_queues+0x107/0x230 Aug 22 15:59:30 juju-e4d256-prod-github-runner-207 kernel: [38144.584378] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 15:59:30 juju-e4d256-prod-github-runner-207 kernel: [38144.585407] ? hrtimer_interrupt+0x101/0x220 Aug 22 15:59:30 juju-e4d256-prod-github-runner-207 kernel: [38144.586434] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 15:59:30 juju-e4d256-prod-github-runner-207 kernel: [38144.587501] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 15:59:30 juju-e4d256-prod-github-runner-207 kernel: [38144.588545] Aug 22 15:59:30 juju-e4d256-prod-github-runner-207 kernel: [38144.589397] Aug 22 15:59:30 juju-e4d256-prod-github-runner-207 kernel: [38144.590247] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 15:59:30 juju-e4d256-prod-github-runner-207 kernel: [38144.591284] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:59:30 juju-e4d256-prod-github-runner-207 kernel: [38144.592325] ? _raw_spin_lock+0x22/0x30 Aug 22 15:59:30 juju-e4d256-prod-github-runner-207 kernel: [38144.593269] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:59:30 juju-e4d256-prod-github-runner-207 kernel: [38144.594289] direct_page_fault+0x206/0x310 [kvm] Aug 22 15:59:30 juju-e4d256-prod-github-runner-207 kernel: [38144.595316] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 15:59:30 juju-e4d256-prod-github-runner-207 kernel: [38144.596324] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 15:59:30 juju-e4d256-prod-github-runner-207 kernel: [38144.597327] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 15:59:30 juju-e4d256-prod-github-runner-207 kernel: [38144.598319] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 15:59:30 juju-e4d256-prod-github-runner-207 kernel: [38144.599263] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 15:59:30 juju-e4d256-prod-github-runner-207 kernel: [38144.600242] handle_exit+0x98/0x230 [kvm_amd] Aug 22 15:59:30 juju-e4d256-prod-github-runner-207 kernel: [38144.601134] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 15:59:30 juju-e4d256-prod-github-runner-207 kernel: [38144.602056] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 15:59:30 juju-e4d256-prod-github-runner-207 kernel: [38144.602985] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 15:59:30 juju-e4d256-prod-github-runner-207 kernel: [38144.603886] vcpu_run+0x62/0x2c0 [kvm] Aug 22 15:59:30 juju-e4d256-prod-github-runner-207 kernel: [38144.604695] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 15:59:30 juju-e4d256-prod-github-runner-207 kernel: [38144.605503] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 15:59:30 juju-e4d256-prod-github-runner-207 kernel: [38144.606364] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 15:59:30 juju-e4d256-prod-github-runner-207 kernel: [38144.607159] ? __seccomp_filter+0x4a/0x4a0 Aug 22 15:59:30 juju-e4d256-prod-github-runner-207 kernel: [38144.607899] ? __fget_files+0x86/0xc0 Aug 22 15:59:30 juju-e4d256-prod-github-runner-207 kernel: [38144.608601] __x64_sys_ioctl+0x95/0xd0 Aug 22 15:59:30 juju-e4d256-prod-github-runner-207 kernel: [38144.609293] do_syscall_64+0x5c/0xc0 Aug 22 15:59:30 juju-e4d256-prod-github-runner-207 kernel: [38144.609968] ? do_futex+0x162/0x1f0 Aug 22 15:59:30 juju-e4d256-prod-github-runner-207 kernel: [38144.610616] ? __x64_sys_futex+0x78/0x1e0 Aug 22 15:59:30 juju-e4d256-prod-github-runner-207 kernel: [38144.611290] ? __secure_computing+0xa9/0x120 Aug 22 15:59:30 juju-e4d256-prod-github-runner-207 kernel: [38144.611977] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 15:59:30 juju-e4d256-prod-github-runner-207 kernel: [38144.612736] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:59:30 juju-e4d256-prod-github-runner-207 kernel: [38144.613459] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:59:30 juju-e4d256-prod-github-runner-207 kernel: [38144.614186] ? do_syscall_64+0x69/0xc0 Aug 22 15:59:30 juju-e4d256-prod-github-runner-207 kernel: [38144.614829] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:59:30 juju-e4d256-prod-github-runner-207 kernel: [38144.615531] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:59:30 juju-e4d256-prod-github-runner-207 kernel: [38144.616232] ? do_syscall_64+0x69/0xc0 Aug 22 15:59:30 juju-e4d256-prod-github-runner-207 kernel: [38144.616855] ? do_syscall_64+0x69/0xc0 Aug 22 15:59:30 juju-e4d256-prod-github-runner-207 kernel: [38144.617476] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 15:59:30 juju-e4d256-prod-github-runner-207 kernel: [38144.618186] RIP: 0033:0x7faa5d0edaff Aug 22 15:59:30 juju-e4d256-prod-github-runner-207 kernel: [38144.618846] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 15:59:30 juju-e4d256-prod-github-runner-207 kernel: [38144.620835] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 15:59:30 juju-e4d256-prod-github-runner-207 kernel: [38144.621762] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 15:59:30 juju-e4d256-prod-github-runner-207 kernel: [38144.622649] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 15:59:30 juju-e4d256-prod-github-runner-207 kernel: [38144.623536] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 15:59:30 juju-e4d256-prod-github-runner-207 kernel: [38144.624420] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 15:59:30 juju-e4d256-prod-github-runner-207 kernel: [38144.625311] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 15:59:30 juju-e4d256-prod-github-runner-207 kernel: [38144.626224] Aug 22 15:59:45 juju-e4d256-prod-github-runner-207 kernel: [38159.732707] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 15:59:45 juju-e4d256-prod-github-runner-207 kernel: [38159.733871] rcu: 1-....: (9480795 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=4583123 Aug 22 15:59:45 juju-e4d256-prod-github-runner-207 kernel: [38159.734998] (t=9510633 jiffies g=23269 q=39396) Aug 22 15:59:45 juju-e4d256-prod-github-runner-207 kernel: [38159.735783] NMI backtrace for cpu 1 Aug 22 15:59:45 juju-e4d256-prod-github-runner-207 kernel: [38159.736496] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 15:59:45 juju-e4d256-prod-github-runner-207 kernel: [38159.737613] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 15:59:45 juju-e4d256-prod-github-runner-207 kernel: [38159.738674] Call Trace: Aug 22 15:59:45 juju-e4d256-prod-github-runner-207 kernel: [38159.739351] Aug 22 15:59:45 juju-e4d256-prod-github-runner-207 kernel: [38159.739999] show_stack+0x52/0x5c Aug 22 15:59:45 juju-e4d256-prod-github-runner-207 kernel: [38159.740722] dump_stack_lvl+0x4a/0x63 Aug 22 15:59:45 juju-e4d256-prod-github-runner-207 kernel: [38159.741478] dump_stack+0x10/0x16 Aug 22 15:59:45 juju-e4d256-prod-github-runner-207 kernel: [38159.742194] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 15:59:45 juju-e4d256-prod-github-runner-207 kernel: [38159.742971] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 15:59:45 juju-e4d256-prod-github-runner-207 kernel: [38159.743747] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 15:59:45 juju-e4d256-prod-github-runner-207 kernel: [38159.744567] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 15:59:45 juju-e4d256-prod-github-runner-207 kernel: [38159.745387] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 15:59:45 juju-e4d256-prod-github-runner-207 kernel: [38159.746205] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 15:59:45 juju-e4d256-prod-github-runner-207 kernel: [38159.746974] print_cpu_stall.cold+0x2f/0xe2 Aug 22 15:59:45 juju-e4d256-prod-github-runner-207 kernel: [38159.747736] ? timekeeping_update+0xf7/0x150 Aug 22 15:59:45 juju-e4d256-prod-github-runner-207 kernel: [38159.748508] check_cpu_stall+0x109/0x270 Aug 22 15:59:45 juju-e4d256-prod-github-runner-207 kernel: [38159.749254] rcu_sched_clock_irq+0x9a/0x250 Aug 22 15:59:45 juju-e4d256-prod-github-runner-207 kernel: [38159.750027] update_process_times+0x94/0xd0 Aug 22 15:59:45 juju-e4d256-prod-github-runner-207 kernel: [38159.750786] tick_sched_handle+0x29/0x70 Aug 22 15:59:45 juju-e4d256-prod-github-runner-207 kernel: [38159.751532] tick_sched_timer+0x8c/0xc0 Aug 22 15:59:45 juju-e4d256-prod-github-runner-207 kernel: [38159.752267] ? tick_nohz_handler+0xb0/0xb0 Aug 22 15:59:45 juju-e4d256-prod-github-runner-207 kernel: [38159.753024] __hrtimer_run_queues+0x107/0x230 Aug 22 15:59:45 juju-e4d256-prod-github-runner-207 kernel: [38159.753804] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 15:59:45 juju-e4d256-prod-github-runner-207 kernel: [38159.754581] hrtimer_interrupt+0x101/0x220 Aug 22 15:59:45 juju-e4d256-prod-github-runner-207 kernel: [38159.755336] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 15:59:45 juju-e4d256-prod-github-runner-207 kernel: [38159.756145] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 15:59:45 juju-e4d256-prod-github-runner-207 kernel: [38159.756944] Aug 22 15:59:45 juju-e4d256-prod-github-runner-207 kernel: [38159.757585] Aug 22 15:59:45 juju-e4d256-prod-github-runner-207 kernel: [38159.758212] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 15:59:45 juju-e4d256-prod-github-runner-207 kernel: [38159.759031] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 15:59:45 juju-e4d256-prod-github-runner-207 kernel: [38159.759910] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 15:59:45 juju-e4d256-prod-github-runner-207 kernel: [38159.762122] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 15:59:45 juju-e4d256-prod-github-runner-207 kernel: [38159.762993] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 15:59:45 juju-e4d256-prod-github-runner-207 kernel: [38159.763982] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 15:59:45 juju-e4d256-prod-github-runner-207 kernel: [38159.764960] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 15:59:45 juju-e4d256-prod-github-runner-207 kernel: [38159.765939] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 15:59:45 juju-e4d256-prod-github-runner-207 kernel: [38159.766893] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 15:59:45 juju-e4d256-prod-github-runner-207 kernel: [38159.767843] ? _raw_spin_lock+0x22/0x30 Aug 22 15:59:45 juju-e4d256-prod-github-runner-207 kernel: [38159.768597] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 15:59:45 juju-e4d256-prod-github-runner-207 kernel: [38159.769448] direct_page_fault+0x206/0x310 [kvm] Aug 22 15:59:45 juju-e4d256-prod-github-runner-207 kernel: [38159.770283] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 15:59:45 juju-e4d256-prod-github-runner-207 kernel: [38159.771113] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 15:59:45 juju-e4d256-prod-github-runner-207 kernel: [38159.771935] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 15:59:45 juju-e4d256-prod-github-runner-207 kernel: [38159.772736] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 15:59:45 juju-e4d256-prod-github-runner-207 kernel: [38159.773527] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 15:59:45 juju-e4d256-prod-github-runner-207 kernel: [38159.774367] handle_exit+0x98/0x230 [kvm_amd] Aug 22 15:59:45 juju-e4d256-prod-github-runner-207 kernel: [38159.775127] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 15:59:45 juju-e4d256-prod-github-runner-207 kernel: [38159.775908] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 15:59:45 juju-e4d256-prod-github-runner-207 kernel: [38159.776705] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 15:59:45 juju-e4d256-prod-github-runner-207 kernel: [38159.777502] vcpu_run+0x62/0x2c0 [kvm] Aug 22 15:59:45 juju-e4d256-prod-github-runner-207 kernel: [38159.778216] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 15:59:45 juju-e4d256-prod-github-runner-207 kernel: [38159.778951] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 15:59:45 juju-e4d256-prod-github-runner-207 kernel: [38159.779749] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 15:59:45 juju-e4d256-prod-github-runner-207 kernel: [38159.780508] ? __seccomp_filter+0x4a/0x4a0 Aug 22 15:59:45 juju-e4d256-prod-github-runner-207 kernel: [38159.781231] ? __fget_files+0x86/0xc0 Aug 22 15:59:45 juju-e4d256-prod-github-runner-207 kernel: [38159.781934] __x64_sys_ioctl+0x95/0xd0 Aug 22 15:59:45 juju-e4d256-prod-github-runner-207 kernel: [38159.782627] do_syscall_64+0x5c/0xc0 Aug 22 15:59:45 juju-e4d256-prod-github-runner-207 kernel: [38159.783304] ? do_futex+0x162/0x1f0 Aug 22 15:59:45 juju-e4d256-prod-github-runner-207 kernel: [38159.783973] ? __x64_sys_futex+0x78/0x1e0 Aug 22 15:59:45 juju-e4d256-prod-github-runner-207 kernel: [38159.784672] ? __secure_computing+0xa9/0x120 Aug 22 15:59:45 juju-e4d256-prod-github-runner-207 kernel: [38159.785388] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 15:59:45 juju-e4d256-prod-github-runner-207 kernel: [38159.786184] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:59:45 juju-e4d256-prod-github-runner-207 kernel: [38159.786941] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:59:45 juju-e4d256-prod-github-runner-207 kernel: [38159.787691] ? do_syscall_64+0x69/0xc0 Aug 22 15:59:45 juju-e4d256-prod-github-runner-207 kernel: [38159.788384] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 15:59:45 juju-e4d256-prod-github-runner-207 kernel: [38159.789137] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 15:59:45 juju-e4d256-prod-github-runner-207 kernel: [38159.789899] ? do_syscall_64+0x69/0xc0 Aug 22 15:59:45 juju-e4d256-prod-github-runner-207 kernel: [38159.790589] ? do_syscall_64+0x69/0xc0 Aug 22 15:59:45 juju-e4d256-prod-github-runner-207 kernel: [38159.791274] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 15:59:45 juju-e4d256-prod-github-runner-207 kernel: [38159.792042] RIP: 0033:0x7faa5d0edaff Aug 22 15:59:45 juju-e4d256-prod-github-runner-207 kernel: [38159.792722] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 15:59:45 juju-e4d256-prod-github-runner-207 kernel: [38159.794818] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 15:59:45 juju-e4d256-prod-github-runner-207 kernel: [38159.795782] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 15:59:45 juju-e4d256-prod-github-runner-207 kernel: [38159.796725] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 15:59:45 juju-e4d256-prod-github-runner-207 kernel: [38159.797679] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 15:59:45 juju-e4d256-prod-github-runner-207 kernel: [38159.798617] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 15:59:45 juju-e4d256-prod-github-runner-207 kernel: [38159.799537] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 15:59:45 juju-e4d256-prod-github-runner-207 kernel: [38159.800451] Aug 22 16:00:10 juju-e4d256-prod-github-runner-207 kernel: [38184.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 35454s! [qemu-system-x86:6715] Aug 22 16:00:10 juju-e4d256-prod-github-runner-207 kernel: [38184.543124] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 16:00:10 juju-e4d256-prod-github-runner-207 kernel: [38184.543196] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 16:00:10 juju-e4d256-prod-github-runner-207 kernel: [38184.555326] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 16:00:10 juju-e4d256-prod-github-runner-207 kernel: [38184.556594] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 16:00:10 juju-e4d256-prod-github-runner-207 kernel: [38184.557828] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:00:10 juju-e4d256-prod-github-runner-207 kernel: [38184.558885] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 16:00:10 juju-e4d256-prod-github-runner-207 kernel: [38184.561443] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 16:00:10 juju-e4d256-prod-github-runner-207 kernel: [38184.562489] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 16:00:10 juju-e4d256-prod-github-runner-207 kernel: [38184.563652] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 16:00:10 juju-e4d256-prod-github-runner-207 kernel: [38184.564810] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 16:00:10 juju-e4d256-prod-github-runner-207 kernel: [38184.565988] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 16:00:10 juju-e4d256-prod-github-runner-207 kernel: [38184.567157] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 16:00:10 juju-e4d256-prod-github-runner-207 kernel: [38184.568334] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 16:00:10 juju-e4d256-prod-github-runner-207 kernel: [38184.569592] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 16:00:10 juju-e4d256-prod-github-runner-207 kernel: [38184.570700] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 16:00:10 juju-e4d256-prod-github-runner-207 kernel: [38184.571899] Call Trace: Aug 22 16:00:10 juju-e4d256-prod-github-runner-207 kernel: [38184.572820] Aug 22 16:00:10 juju-e4d256-prod-github-runner-207 kernel: [38184.573719] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:00:10 juju-e4d256-prod-github-runner-207 kernel: [38184.574760] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:00:10 juju-e4d256-prod-github-runner-207 kernel: [38184.575782] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:00:10 juju-e4d256-prod-github-runner-207 kernel: [38184.576864] ? show_regs.part.0+0x23/0x29 Aug 22 16:00:10 juju-e4d256-prod-github-runner-207 kernel: [38184.577878] ? show_regs.cold+0x8/0xd Aug 22 16:00:10 juju-e4d256-prod-github-runner-207 kernel: [38184.578853] ? watchdog_timer_fn+0x1be/0x220 Aug 22 16:00:10 juju-e4d256-prod-github-runner-207 kernel: [38184.579863] ? lockup_detector_update_enable+0x60/0x60 Aug 22 16:00:10 juju-e4d256-prod-github-runner-207 kernel: [38184.580927] ? __hrtimer_run_queues+0x107/0x230 Aug 22 16:00:10 juju-e4d256-prod-github-runner-207 kernel: [38184.581973] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 16:00:10 juju-e4d256-prod-github-runner-207 kernel: [38184.582998] ? hrtimer_interrupt+0x101/0x220 Aug 22 16:00:10 juju-e4d256-prod-github-runner-207 kernel: [38184.584012] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 16:00:10 juju-e4d256-prod-github-runner-207 kernel: [38184.585085] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 16:00:10 juju-e4d256-prod-github-runner-207 kernel: [38184.586143] Aug 22 16:00:10 juju-e4d256-prod-github-runner-207 kernel: [38184.586996] Aug 22 16:00:10 juju-e4d256-prod-github-runner-207 kernel: [38184.587834] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 16:00:10 juju-e4d256-prod-github-runner-207 kernel: [38184.588866] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:00:10 juju-e4d256-prod-github-runner-207 kernel: [38184.589911] ? _raw_spin_lock+0x22/0x30 Aug 22 16:00:10 juju-e4d256-prod-github-runner-207 kernel: [38184.591073] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:00:10 juju-e4d256-prod-github-runner-207 kernel: [38184.592097] direct_page_fault+0x206/0x310 [kvm] Aug 22 16:00:10 juju-e4d256-prod-github-runner-207 kernel: [38184.593137] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 16:00:10 juju-e4d256-prod-github-runner-207 kernel: [38184.594146] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 16:00:10 juju-e4d256-prod-github-runner-207 kernel: [38184.595146] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 16:00:10 juju-e4d256-prod-github-runner-207 kernel: [38184.596115] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 16:00:10 juju-e4d256-prod-github-runner-207 kernel: [38184.597060] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 16:00:10 juju-e4d256-prod-github-runner-207 kernel: [38184.598085] handle_exit+0x98/0x230 [kvm_amd] Aug 22 16:00:10 juju-e4d256-prod-github-runner-207 kernel: [38184.599012] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 16:00:10 juju-e4d256-prod-github-runner-207 kernel: [38184.599923] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 16:00:10 juju-e4d256-prod-github-runner-207 kernel: [38184.600845] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 16:00:10 juju-e4d256-prod-github-runner-207 kernel: [38184.601762] vcpu_run+0x62/0x2c0 [kvm] Aug 22 16:00:10 juju-e4d256-prod-github-runner-207 kernel: [38184.602572] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 16:00:10 juju-e4d256-prod-github-runner-207 kernel: [38184.603379] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 16:00:10 juju-e4d256-prod-github-runner-207 kernel: [38184.604237] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 16:00:10 juju-e4d256-prod-github-runner-207 kernel: [38184.605034] ? __seccomp_filter+0x4a/0x4a0 Aug 22 16:00:10 juju-e4d256-prod-github-runner-207 kernel: [38184.605785] ? __fget_files+0x86/0xc0 Aug 22 16:00:10 juju-e4d256-prod-github-runner-207 kernel: [38184.606487] __x64_sys_ioctl+0x95/0xd0 Aug 22 16:00:10 juju-e4d256-prod-github-runner-207 kernel: [38184.607179] do_syscall_64+0x5c/0xc0 Aug 22 16:00:10 juju-e4d256-prod-github-runner-207 kernel: [38184.607844] ? do_futex+0x162/0x1f0 Aug 22 16:00:10 juju-e4d256-prod-github-runner-207 kernel: [38184.608492] ? __x64_sys_futex+0x78/0x1e0 Aug 22 16:00:10 juju-e4d256-prod-github-runner-207 kernel: [38184.609173] ? __secure_computing+0xa9/0x120 Aug 22 16:00:10 juju-e4d256-prod-github-runner-207 kernel: [38184.609862] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 16:00:10 juju-e4d256-prod-github-runner-207 kernel: [38184.610621] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:00:10 juju-e4d256-prod-github-runner-207 kernel: [38184.611342] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:00:10 juju-e4d256-prod-github-runner-207 kernel: [38184.612058] ? do_syscall_64+0x69/0xc0 Aug 22 16:00:10 juju-e4d256-prod-github-runner-207 kernel: [38184.612701] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:00:10 juju-e4d256-prod-github-runner-207 kernel: [38184.613417] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:00:10 juju-e4d256-prod-github-runner-207 kernel: [38184.614111] ? do_syscall_64+0x69/0xc0 Aug 22 16:00:10 juju-e4d256-prod-github-runner-207 kernel: [38184.614739] ? do_syscall_64+0x69/0xc0 Aug 22 16:00:10 juju-e4d256-prod-github-runner-207 kernel: [38184.615360] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 16:00:10 juju-e4d256-prod-github-runner-207 kernel: [38184.616061] RIP: 0033:0x7faa5d0edaff Aug 22 16:00:10 juju-e4d256-prod-github-runner-207 kernel: [38184.616689] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 16:00:10 juju-e4d256-prod-github-runner-207 kernel: [38184.618680] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 16:00:10 juju-e4d256-prod-github-runner-207 kernel: [38184.619593] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 16:00:10 juju-e4d256-prod-github-runner-207 kernel: [38184.620484] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 16:00:10 juju-e4d256-prod-github-runner-207 kernel: [38184.621380] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 16:00:10 juju-e4d256-prod-github-runner-207 kernel: [38184.622267] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 16:00:10 juju-e4d256-prod-github-runner-207 kernel: [38184.623153] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 16:00:10 juju-e4d256-prod-github-runner-207 kernel: [38184.624042] Aug 22 16:00:38 juju-e4d256-prod-github-runner-207 kernel: [38212.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 35480s! [qemu-system-x86:6715] Aug 22 16:00:38 juju-e4d256-prod-github-runner-207 kernel: [38212.543751] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 16:00:38 juju-e4d256-prod-github-runner-207 kernel: [38212.544012] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 16:00:38 juju-e4d256-prod-github-runner-207 kernel: [38212.556188] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 16:00:38 juju-e4d256-prod-github-runner-207 kernel: [38212.557476] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 16:00:38 juju-e4d256-prod-github-runner-207 kernel: [38212.558704] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:00:38 juju-e4d256-prod-github-runner-207 kernel: [38212.559766] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 16:00:38 juju-e4d256-prod-github-runner-207 kernel: [38212.562331] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 16:00:38 juju-e4d256-prod-github-runner-207 kernel: [38212.563408] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 16:00:38 juju-e4d256-prod-github-runner-207 kernel: [38212.564576] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 16:00:38 juju-e4d256-prod-github-runner-207 kernel: [38212.565754] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 16:00:38 juju-e4d256-prod-github-runner-207 kernel: [38212.566955] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 16:00:38 juju-e4d256-prod-github-runner-207 kernel: [38212.568117] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 16:00:38 juju-e4d256-prod-github-runner-207 kernel: [38212.569295] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 16:00:38 juju-e4d256-prod-github-runner-207 kernel: [38212.570569] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 16:00:38 juju-e4d256-prod-github-runner-207 kernel: [38212.571674] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 16:00:38 juju-e4d256-prod-github-runner-207 kernel: [38212.572890] Call Trace: Aug 22 16:00:38 juju-e4d256-prod-github-runner-207 kernel: [38212.573876] Aug 22 16:00:38 juju-e4d256-prod-github-runner-207 kernel: [38212.574773] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:00:38 juju-e4d256-prod-github-runner-207 kernel: [38212.575808] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:00:38 juju-e4d256-prod-github-runner-207 kernel: [38212.576845] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:00:38 juju-e4d256-prod-github-runner-207 kernel: [38212.577942] ? show_regs.part.0+0x23/0x29 Aug 22 16:00:38 juju-e4d256-prod-github-runner-207 kernel: [38212.578981] ? show_regs.cold+0x8/0xd Aug 22 16:00:38 juju-e4d256-prod-github-runner-207 kernel: [38212.579959] ? watchdog_timer_fn+0x1be/0x220 Aug 22 16:00:38 juju-e4d256-prod-github-runner-207 kernel: [38212.580983] ? lockup_detector_update_enable+0x60/0x60 Aug 22 16:00:38 juju-e4d256-prod-github-runner-207 kernel: [38212.582047] ? __hrtimer_run_queues+0x107/0x230 Aug 22 16:00:38 juju-e4d256-prod-github-runner-207 kernel: [38212.583115] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 16:00:38 juju-e4d256-prod-github-runner-207 kernel: [38212.584146] ? hrtimer_interrupt+0x101/0x220 Aug 22 16:00:38 juju-e4d256-prod-github-runner-207 kernel: [38212.585178] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 16:00:38 juju-e4d256-prod-github-runner-207 kernel: [38212.586253] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 16:00:38 juju-e4d256-prod-github-runner-207 kernel: [38212.587300] Aug 22 16:00:38 juju-e4d256-prod-github-runner-207 kernel: [38212.588162] Aug 22 16:00:38 juju-e4d256-prod-github-runner-207 kernel: [38212.589017] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 16:00:38 juju-e4d256-prod-github-runner-207 kernel: [38212.590093] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:00:38 juju-e4d256-prod-github-runner-207 kernel: [38212.591133] ? _raw_spin_lock+0x22/0x30 Aug 22 16:00:38 juju-e4d256-prod-github-runner-207 kernel: [38212.592084] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:00:38 juju-e4d256-prod-github-runner-207 kernel: [38212.593121] direct_page_fault+0x206/0x310 [kvm] Aug 22 16:00:38 juju-e4d256-prod-github-runner-207 kernel: [38212.594176] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 16:00:38 juju-e4d256-prod-github-runner-207 kernel: [38212.595221] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 16:00:38 juju-e4d256-prod-github-runner-207 kernel: [38212.596221] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 16:00:38 juju-e4d256-prod-github-runner-207 kernel: [38212.597219] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 16:00:38 juju-e4d256-prod-github-runner-207 kernel: [38212.598206] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 16:00:38 juju-e4d256-prod-github-runner-207 kernel: [38212.599216] handle_exit+0x98/0x230 [kvm_amd] Aug 22 16:00:38 juju-e4d256-prod-github-runner-207 kernel: [38212.600113] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 16:00:38 juju-e4d256-prod-github-runner-207 kernel: [38212.601038] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 16:00:38 juju-e4d256-prod-github-runner-207 kernel: [38212.601971] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 16:00:38 juju-e4d256-prod-github-runner-207 kernel: [38212.602880] vcpu_run+0x62/0x2c0 [kvm] Aug 22 16:00:38 juju-e4d256-prod-github-runner-207 kernel: [38212.603692] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 16:00:38 juju-e4d256-prod-github-runner-207 kernel: [38212.604506] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 16:00:38 juju-e4d256-prod-github-runner-207 kernel: [38212.605372] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 16:00:38 juju-e4d256-prod-github-runner-207 kernel: [38212.606175] ? __seccomp_filter+0x4a/0x4a0 Aug 22 16:00:38 juju-e4d256-prod-github-runner-207 kernel: [38212.606917] ? __fget_files+0x86/0xc0 Aug 22 16:00:38 juju-e4d256-prod-github-runner-207 kernel: [38212.607625] __x64_sys_ioctl+0x95/0xd0 Aug 22 16:00:38 juju-e4d256-prod-github-runner-207 kernel: [38212.608318] do_syscall_64+0x5c/0xc0 Aug 22 16:00:38 juju-e4d256-prod-github-runner-207 kernel: [38212.609002] ? do_futex+0x162/0x1f0 Aug 22 16:00:38 juju-e4d256-prod-github-runner-207 kernel: [38212.609695] ? __x64_sys_futex+0x78/0x1e0 Aug 22 16:00:38 juju-e4d256-prod-github-runner-207 kernel: [38212.610368] ? __secure_computing+0xa9/0x120 Aug 22 16:00:38 juju-e4d256-prod-github-runner-207 kernel: [38212.611093] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 16:00:38 juju-e4d256-prod-github-runner-207 kernel: [38212.611858] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:00:38 juju-e4d256-prod-github-runner-207 kernel: [38212.612585] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:00:38 juju-e4d256-prod-github-runner-207 kernel: [38212.613313] ? do_syscall_64+0x69/0xc0 Aug 22 16:00:38 juju-e4d256-prod-github-runner-207 kernel: [38212.613963] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:00:38 juju-e4d256-prod-github-runner-207 kernel: [38212.614671] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:00:38 juju-e4d256-prod-github-runner-207 kernel: [38212.615366] ? do_syscall_64+0x69/0xc0 Aug 22 16:00:38 juju-e4d256-prod-github-runner-207 kernel: [38212.615995] ? do_syscall_64+0x69/0xc0 Aug 22 16:00:38 juju-e4d256-prod-github-runner-207 kernel: [38212.616618] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 16:00:38 juju-e4d256-prod-github-runner-207 kernel: [38212.617385] RIP: 0033:0x7faa5d0edaff Aug 22 16:00:38 juju-e4d256-prod-github-runner-207 kernel: [38212.618030] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 16:00:38 juju-e4d256-prod-github-runner-207 kernel: [38212.620058] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 16:00:38 juju-e4d256-prod-github-runner-207 kernel: [38212.620985] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 16:00:38 juju-e4d256-prod-github-runner-207 kernel: [38212.621909] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 16:00:38 juju-e4d256-prod-github-runner-207 kernel: [38212.622798] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 16:00:38 juju-e4d256-prod-github-runner-207 kernel: [38212.623692] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 16:00:38 juju-e4d256-prod-github-runner-207 kernel: [38212.624586] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 16:00:38 juju-e4d256-prod-github-runner-207 kernel: [38212.625490] Aug 22 16:01:06 juju-e4d256-prod-github-runner-207 kernel: [38240.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 35506s! [qemu-system-x86:6715] Aug 22 16:01:06 juju-e4d256-prod-github-runner-207 kernel: [38240.543100] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 16:01:06 juju-e4d256-prod-github-runner-207 kernel: [38240.543168] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 16:01:06 juju-e4d256-prod-github-runner-207 kernel: [38240.555300] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 16:01:06 juju-e4d256-prod-github-runner-207 kernel: [38240.556574] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 16:01:06 juju-e4d256-prod-github-runner-207 kernel: [38240.557800] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:01:06 juju-e4d256-prod-github-runner-207 kernel: [38240.558870] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 16:01:06 juju-e4d256-prod-github-runner-207 kernel: [38240.561439] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 16:01:06 juju-e4d256-prod-github-runner-207 kernel: [38240.562483] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 16:01:06 juju-e4d256-prod-github-runner-207 kernel: [38240.563642] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 16:01:06 juju-e4d256-prod-github-runner-207 kernel: [38240.564825] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 16:01:06 juju-e4d256-prod-github-runner-207 kernel: [38240.565984] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 16:01:06 juju-e4d256-prod-github-runner-207 kernel: [38240.567145] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 16:01:06 juju-e4d256-prod-github-runner-207 kernel: [38240.568314] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 16:01:06 juju-e4d256-prod-github-runner-207 kernel: [38240.569645] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 16:01:06 juju-e4d256-prod-github-runner-207 kernel: [38240.570747] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 16:01:06 juju-e4d256-prod-github-runner-207 kernel: [38240.571944] Call Trace: Aug 22 16:01:06 juju-e4d256-prod-github-runner-207 kernel: [38240.572876] Aug 22 16:01:06 juju-e4d256-prod-github-runner-207 kernel: [38240.573760] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:01:06 juju-e4d256-prod-github-runner-207 kernel: [38240.574788] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:01:06 juju-e4d256-prod-github-runner-207 kernel: [38240.575806] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:01:06 juju-e4d256-prod-github-runner-207 kernel: [38240.576906] ? show_regs.part.0+0x23/0x29 Aug 22 16:01:06 juju-e4d256-prod-github-runner-207 kernel: [38240.577912] ? show_regs.cold+0x8/0xd Aug 22 16:01:06 juju-e4d256-prod-github-runner-207 kernel: [38240.578881] ? watchdog_timer_fn+0x1be/0x220 Aug 22 16:01:06 juju-e4d256-prod-github-runner-207 kernel: [38240.579893] ? lockup_detector_update_enable+0x60/0x60 Aug 22 16:01:06 juju-e4d256-prod-github-runner-207 kernel: [38240.580967] ? __hrtimer_run_queues+0x107/0x230 Aug 22 16:01:06 juju-e4d256-prod-github-runner-207 kernel: [38240.581996] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 16:01:06 juju-e4d256-prod-github-runner-207 kernel: [38240.583020] ? hrtimer_interrupt+0x101/0x220 Aug 22 16:01:06 juju-e4d256-prod-github-runner-207 kernel: [38240.584038] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 16:01:06 juju-e4d256-prod-github-runner-207 kernel: [38240.585123] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 16:01:06 juju-e4d256-prod-github-runner-207 kernel: [38240.586168] Aug 22 16:01:06 juju-e4d256-prod-github-runner-207 kernel: [38240.587026] Aug 22 16:01:06 juju-e4d256-prod-github-runner-207 kernel: [38240.587862] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 16:01:06 juju-e4d256-prod-github-runner-207 kernel: [38240.588910] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:01:06 juju-e4d256-prod-github-runner-207 kernel: [38240.589953] ? _raw_spin_lock+0x22/0x30 Aug 22 16:01:06 juju-e4d256-prod-github-runner-207 kernel: [38240.590901] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:01:06 juju-e4d256-prod-github-runner-207 kernel: [38240.591923] direct_page_fault+0x206/0x310 [kvm] Aug 22 16:01:06 juju-e4d256-prod-github-runner-207 kernel: [38240.592966] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 16:01:06 juju-e4d256-prod-github-runner-207 kernel: [38240.594040] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 16:01:06 juju-e4d256-prod-github-runner-207 kernel: [38240.595043] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 16:01:06 juju-e4d256-prod-github-runner-207 kernel: [38240.596012] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 16:01:06 juju-e4d256-prod-github-runner-207 kernel: [38240.596971] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 16:01:06 juju-e4d256-prod-github-runner-207 kernel: [38240.597950] handle_exit+0x98/0x230 [kvm_amd] Aug 22 16:01:06 juju-e4d256-prod-github-runner-207 kernel: [38240.598847] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 16:01:06 juju-e4d256-prod-github-runner-207 kernel: [38240.599759] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 16:01:06 juju-e4d256-prod-github-runner-207 kernel: [38240.600710] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 16:01:06 juju-e4d256-prod-github-runner-207 kernel: [38240.601613] vcpu_run+0x62/0x2c0 [kvm] Aug 22 16:01:06 juju-e4d256-prod-github-runner-207 kernel: [38240.602429] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 16:01:06 juju-e4d256-prod-github-runner-207 kernel: [38240.603240] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 16:01:06 juju-e4d256-prod-github-runner-207 kernel: [38240.604097] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 16:01:06 juju-e4d256-prod-github-runner-207 kernel: [38240.604910] ? __seccomp_filter+0x4a/0x4a0 Aug 22 16:01:06 juju-e4d256-prod-github-runner-207 kernel: [38240.605650] ? __fget_files+0x86/0xc0 Aug 22 16:01:06 juju-e4d256-prod-github-runner-207 kernel: [38240.606354] __x64_sys_ioctl+0x95/0xd0 Aug 22 16:01:06 juju-e4d256-prod-github-runner-207 kernel: [38240.607052] do_syscall_64+0x5c/0xc0 Aug 22 16:01:06 juju-e4d256-prod-github-runner-207 kernel: [38240.607716] ? do_futex+0x162/0x1f0 Aug 22 16:01:06 juju-e4d256-prod-github-runner-207 kernel: [38240.608369] ? __x64_sys_futex+0x78/0x1e0 Aug 22 16:01:06 juju-e4d256-prod-github-runner-207 kernel: [38240.609051] ? __secure_computing+0xa9/0x120 Aug 22 16:01:06 juju-e4d256-prod-github-runner-207 kernel: [38240.609742] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 16:01:06 juju-e4d256-prod-github-runner-207 kernel: [38240.610500] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:01:06 juju-e4d256-prod-github-runner-207 kernel: [38240.611226] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:01:06 juju-e4d256-prod-github-runner-207 kernel: [38240.611945] ? do_syscall_64+0x69/0xc0 Aug 22 16:01:06 juju-e4d256-prod-github-runner-207 kernel: [38240.612612] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:01:06 juju-e4d256-prod-github-runner-207 kernel: [38240.613323] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:01:06 juju-e4d256-prod-github-runner-207 kernel: [38240.614016] ? do_syscall_64+0x69/0xc0 Aug 22 16:01:06 juju-e4d256-prod-github-runner-207 kernel: [38240.614638] ? do_syscall_64+0x69/0xc0 Aug 22 16:01:06 juju-e4d256-prod-github-runner-207 kernel: [38240.615257] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 16:01:06 juju-e4d256-prod-github-runner-207 kernel: [38240.615959] RIP: 0033:0x7faa5d0edaff Aug 22 16:01:06 juju-e4d256-prod-github-runner-207 kernel: [38240.616614] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 16:01:06 juju-e4d256-prod-github-runner-207 kernel: [38240.618609] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 16:01:06 juju-e4d256-prod-github-runner-207 kernel: [38240.619517] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 16:01:06 juju-e4d256-prod-github-runner-207 kernel: [38240.620404] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 16:01:06 juju-e4d256-prod-github-runner-207 kernel: [38240.621305] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 16:01:06 juju-e4d256-prod-github-runner-207 kernel: [38240.622188] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 16:01:06 juju-e4d256-prod-github-runner-207 kernel: [38240.623073] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 16:01:06 juju-e4d256-prod-github-runner-207 kernel: [38240.623967] Aug 22 16:01:34 juju-e4d256-prod-github-runner-207 kernel: [38268.541980] watchdog: BUG: soft lockup - CPU#1 stuck for 35532s! [qemu-system-x86:6715] Aug 22 16:01:34 juju-e4d256-prod-github-runner-207 kernel: [38268.543509] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 16:01:34 juju-e4d256-prod-github-runner-207 kernel: [38268.543590] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 16:01:34 juju-e4d256-prod-github-runner-207 kernel: [38268.560470] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 16:01:34 juju-e4d256-prod-github-runner-207 kernel: [38268.561756] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 16:01:34 juju-e4d256-prod-github-runner-207 kernel: [38268.562982] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:01:34 juju-e4d256-prod-github-runner-207 kernel: [38268.564158] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 16:01:34 juju-e4d256-prod-github-runner-207 kernel: [38268.566975] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 16:01:34 juju-e4d256-prod-github-runner-207 kernel: [38268.568030] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 16:01:34 juju-e4d256-prod-github-runner-207 kernel: [38268.569216] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 16:01:34 juju-e4d256-prod-github-runner-207 kernel: [38268.570464] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 16:01:34 juju-e4d256-prod-github-runner-207 kernel: [38268.572059] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 16:01:34 juju-e4d256-prod-github-runner-207 kernel: [38268.573665] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 16:01:34 juju-e4d256-prod-github-runner-207 kernel: [38268.574948] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 16:01:34 juju-e4d256-prod-github-runner-207 kernel: [38268.576241] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 16:01:34 juju-e4d256-prod-github-runner-207 kernel: [38268.577346] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 16:01:34 juju-e4d256-prod-github-runner-207 kernel: [38268.578542] Call Trace: Aug 22 16:01:34 juju-e4d256-prod-github-runner-207 kernel: [38268.579469] Aug 22 16:01:34 juju-e4d256-prod-github-runner-207 kernel: [38268.580373] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:01:34 juju-e4d256-prod-github-runner-207 kernel: [38268.581407] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:01:34 juju-e4d256-prod-github-runner-207 kernel: [38268.582436] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:01:34 juju-e4d256-prod-github-runner-207 kernel: [38268.583522] ? show_regs.part.0+0x23/0x29 Aug 22 16:01:34 juju-e4d256-prod-github-runner-207 kernel: [38268.584537] ? show_regs.cold+0x8/0xd Aug 22 16:01:34 juju-e4d256-prod-github-runner-207 kernel: [38268.585519] ? watchdog_timer_fn+0x1be/0x220 Aug 22 16:01:34 juju-e4d256-prod-github-runner-207 kernel: [38268.586531] ? lockup_detector_update_enable+0x60/0x60 Aug 22 16:01:34 juju-e4d256-prod-github-runner-207 kernel: [38268.587609] ? __hrtimer_run_queues+0x107/0x230 Aug 22 16:01:34 juju-e4d256-prod-github-runner-207 kernel: [38268.588659] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 16:01:34 juju-e4d256-prod-github-runner-207 kernel: [38268.589689] ? hrtimer_interrupt+0x101/0x220 Aug 22 16:01:34 juju-e4d256-prod-github-runner-207 kernel: [38268.590750] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 16:01:34 juju-e4d256-prod-github-runner-207 kernel: [38268.591920] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 16:01:34 juju-e4d256-prod-github-runner-207 kernel: [38268.593003] Aug 22 16:01:34 juju-e4d256-prod-github-runner-207 kernel: [38268.593860] Aug 22 16:01:34 juju-e4d256-prod-github-runner-207 kernel: [38268.594703] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 16:01:34 juju-e4d256-prod-github-runner-207 kernel: [38268.595760] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:01:34 juju-e4d256-prod-github-runner-207 kernel: [38268.596818] ? _raw_spin_lock+0x22/0x30 Aug 22 16:01:34 juju-e4d256-prod-github-runner-207 kernel: [38268.597768] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:01:34 juju-e4d256-prod-github-runner-207 kernel: [38268.598849] direct_page_fault+0x206/0x310 [kvm] Aug 22 16:01:34 juju-e4d256-prod-github-runner-207 kernel: [38268.599896] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 16:01:34 juju-e4d256-prod-github-runner-207 kernel: [38268.600928] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 16:01:34 juju-e4d256-prod-github-runner-207 kernel: [38268.601942] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 16:01:34 juju-e4d256-prod-github-runner-207 kernel: [38268.602918] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 16:01:34 juju-e4d256-prod-github-runner-207 kernel: [38268.603875] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 16:01:34 juju-e4d256-prod-github-runner-207 kernel: [38268.604878] handle_exit+0x98/0x230 [kvm_amd] Aug 22 16:01:34 juju-e4d256-prod-github-runner-207 kernel: [38268.605776] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 16:01:34 juju-e4d256-prod-github-runner-207 kernel: [38268.606702] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 16:01:34 juju-e4d256-prod-github-runner-207 kernel: [38268.607641] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 16:01:34 juju-e4d256-prod-github-runner-207 kernel: [38268.608634] vcpu_run+0x62/0x2c0 [kvm] Aug 22 16:01:34 juju-e4d256-prod-github-runner-207 kernel: [38268.609453] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 16:01:34 juju-e4d256-prod-github-runner-207 kernel: [38268.610270] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 16:01:34 juju-e4d256-prod-github-runner-207 kernel: [38268.611127] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 16:01:34 juju-e4d256-prod-github-runner-207 kernel: [38268.611927] ? __seccomp_filter+0x4a/0x4a0 Aug 22 16:01:34 juju-e4d256-prod-github-runner-207 kernel: [38268.612685] ? __fget_files+0x86/0xc0 Aug 22 16:01:34 juju-e4d256-prod-github-runner-207 kernel: [38268.613391] __x64_sys_ioctl+0x95/0xd0 Aug 22 16:01:34 juju-e4d256-prod-github-runner-207 kernel: [38268.614084] do_syscall_64+0x5c/0xc0 Aug 22 16:01:34 juju-e4d256-prod-github-runner-207 kernel: [38268.614751] ? do_futex+0x162/0x1f0 Aug 22 16:01:34 juju-e4d256-prod-github-runner-207 kernel: [38268.615453] ? __x64_sys_futex+0x78/0x1e0 Aug 22 16:01:34 juju-e4d256-prod-github-runner-207 kernel: [38268.616233] ? __secure_computing+0xa9/0x120 Aug 22 16:01:34 juju-e4d256-prod-github-runner-207 kernel: [38268.616932] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 16:01:34 juju-e4d256-prod-github-runner-207 kernel: [38268.617698] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:01:34 juju-e4d256-prod-github-runner-207 kernel: [38268.618421] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:01:34 juju-e4d256-prod-github-runner-207 kernel: [38268.619141] ? do_syscall_64+0x69/0xc0 Aug 22 16:01:34 juju-e4d256-prod-github-runner-207 kernel: [38268.619786] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:01:34 juju-e4d256-prod-github-runner-207 kernel: [38268.620532] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:01:34 juju-e4d256-prod-github-runner-207 kernel: [38268.621295] ? do_syscall_64+0x69/0xc0 Aug 22 16:01:34 juju-e4d256-prod-github-runner-207 kernel: [38268.621935] ? do_syscall_64+0x69/0xc0 Aug 22 16:01:34 juju-e4d256-prod-github-runner-207 kernel: [38268.622556] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 16:01:34 juju-e4d256-prod-github-runner-207 kernel: [38268.623265] RIP: 0033:0x7faa5d0edaff Aug 22 16:01:34 juju-e4d256-prod-github-runner-207 kernel: [38268.623888] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 16:01:34 juju-e4d256-prod-github-runner-207 kernel: [38268.625932] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 16:01:34 juju-e4d256-prod-github-runner-207 kernel: [38268.626843] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 16:01:34 juju-e4d256-prod-github-runner-207 kernel: [38268.627736] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 16:01:34 juju-e4d256-prod-github-runner-207 kernel: [38268.628644] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 16:01:34 juju-e4d256-prod-github-runner-207 kernel: [38268.629531] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 16:01:34 juju-e4d256-prod-github-runner-207 kernel: [38268.630417] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 16:01:34 juju-e4d256-prod-github-runner-207 kernel: [38268.631308] Aug 22 16:02:02 juju-e4d256-prod-github-runner-207 kernel: [38296.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 35558s! [qemu-system-x86:6715] Aug 22 16:02:02 juju-e4d256-prod-github-runner-207 kernel: [38296.543089] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 16:02:02 juju-e4d256-prod-github-runner-207 kernel: [38296.543154] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 16:02:02 juju-e4d256-prod-github-runner-207 kernel: [38296.555451] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 16:02:02 juju-e4d256-prod-github-runner-207 kernel: [38296.556722] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 16:02:02 juju-e4d256-prod-github-runner-207 kernel: [38296.557933] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:02:02 juju-e4d256-prod-github-runner-207 kernel: [38296.558984] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 16:02:02 juju-e4d256-prod-github-runner-207 kernel: [38296.561526] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 16:02:02 juju-e4d256-prod-github-runner-207 kernel: [38296.562590] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 16:02:02 juju-e4d256-prod-github-runner-207 kernel: [38296.563823] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 16:02:02 juju-e4d256-prod-github-runner-207 kernel: [38296.564988] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 16:02:02 juju-e4d256-prod-github-runner-207 kernel: [38296.566149] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 16:02:02 juju-e4d256-prod-github-runner-207 kernel: [38296.567312] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 16:02:02 juju-e4d256-prod-github-runner-207 kernel: [38296.568487] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 16:02:02 juju-e4d256-prod-github-runner-207 kernel: [38296.569719] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 16:02:02 juju-e4d256-prod-github-runner-207 kernel: [38296.570816] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 16:02:02 juju-e4d256-prod-github-runner-207 kernel: [38296.572017] Call Trace: Aug 22 16:02:02 juju-e4d256-prod-github-runner-207 kernel: [38296.572930] Aug 22 16:02:02 juju-e4d256-prod-github-runner-207 kernel: [38296.573814] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:02:02 juju-e4d256-prod-github-runner-207 kernel: [38296.574843] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:02:02 juju-e4d256-prod-github-runner-207 kernel: [38296.575877] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:02:02 juju-e4d256-prod-github-runner-207 kernel: [38296.576957] ? show_regs.part.0+0x23/0x29 Aug 22 16:02:02 juju-e4d256-prod-github-runner-207 kernel: [38296.578116] ? show_regs.cold+0x8/0xd Aug 22 16:02:02 juju-e4d256-prod-github-runner-207 kernel: [38296.579088] ? watchdog_timer_fn+0x1be/0x220 Aug 22 16:02:02 juju-e4d256-prod-github-runner-207 kernel: [38296.580110] ? lockup_detector_update_enable+0x60/0x60 Aug 22 16:02:02 juju-e4d256-prod-github-runner-207 kernel: [38296.581212] ? __hrtimer_run_queues+0x107/0x230 Aug 22 16:02:02 juju-e4d256-prod-github-runner-207 kernel: [38296.582245] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 16:02:02 juju-e4d256-prod-github-runner-207 kernel: [38296.583268] ? hrtimer_interrupt+0x101/0x220 Aug 22 16:02:02 juju-e4d256-prod-github-runner-207 kernel: [38296.584322] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 16:02:02 juju-e4d256-prod-github-runner-207 kernel: [38296.585397] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 16:02:02 juju-e4d256-prod-github-runner-207 kernel: [38296.586450] Aug 22 16:02:02 juju-e4d256-prod-github-runner-207 kernel: [38296.587303] Aug 22 16:02:02 juju-e4d256-prod-github-runner-207 kernel: [38296.588149] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 16:02:02 juju-e4d256-prod-github-runner-207 kernel: [38296.589184] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:02:02 juju-e4d256-prod-github-runner-207 kernel: [38296.590229] ? _raw_spin_lock+0x22/0x30 Aug 22 16:02:02 juju-e4d256-prod-github-runner-207 kernel: [38296.591175] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:02:02 juju-e4d256-prod-github-runner-207 kernel: [38296.592201] direct_page_fault+0x206/0x310 [kvm] Aug 22 16:02:02 juju-e4d256-prod-github-runner-207 kernel: [38296.593244] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 16:02:02 juju-e4d256-prod-github-runner-207 kernel: [38296.594254] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 16:02:02 juju-e4d256-prod-github-runner-207 kernel: [38296.595254] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 16:02:02 juju-e4d256-prod-github-runner-207 kernel: [38296.596244] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 16:02:02 juju-e4d256-prod-github-runner-207 kernel: [38296.597189] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 16:02:02 juju-e4d256-prod-github-runner-207 kernel: [38296.598165] handle_exit+0x98/0x230 [kvm_amd] Aug 22 16:02:02 juju-e4d256-prod-github-runner-207 kernel: [38296.599056] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 16:02:02 juju-e4d256-prod-github-runner-207 kernel: [38296.599981] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 16:02:02 juju-e4d256-prod-github-runner-207 kernel: [38296.600904] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 16:02:02 juju-e4d256-prod-github-runner-207 kernel: [38296.601806] vcpu_run+0x62/0x2c0 [kvm] Aug 22 16:02:02 juju-e4d256-prod-github-runner-207 kernel: [38296.602621] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 16:02:02 juju-e4d256-prod-github-runner-207 kernel: [38296.603427] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 16:02:02 juju-e4d256-prod-github-runner-207 kernel: [38296.604291] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 16:02:02 juju-e4d256-prod-github-runner-207 kernel: [38296.605168] ? __seccomp_filter+0x4a/0x4a0 Aug 22 16:02:02 juju-e4d256-prod-github-runner-207 kernel: [38296.605981] ? __fget_files+0x86/0xc0 Aug 22 16:02:02 juju-e4d256-prod-github-runner-207 kernel: [38296.606747] __x64_sys_ioctl+0x95/0xd0 Aug 22 16:02:02 juju-e4d256-prod-github-runner-207 kernel: [38296.607479] do_syscall_64+0x5c/0xc0 Aug 22 16:02:02 juju-e4d256-prod-github-runner-207 kernel: [38296.608223] ? do_futex+0x162/0x1f0 Aug 22 16:02:02 juju-e4d256-prod-github-runner-207 kernel: [38296.608922] ? __x64_sys_futex+0x78/0x1e0 Aug 22 16:02:02 juju-e4d256-prod-github-runner-207 kernel: [38296.609657] ? __secure_computing+0xa9/0x120 Aug 22 16:02:02 juju-e4d256-prod-github-runner-207 kernel: [38296.610410] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 16:02:02 juju-e4d256-prod-github-runner-207 kernel: [38296.611196] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:02:02 juju-e4d256-prod-github-runner-207 kernel: [38296.611944] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:02:02 juju-e4d256-prod-github-runner-207 kernel: [38296.612663] ? do_syscall_64+0x69/0xc0 Aug 22 16:02:02 juju-e4d256-prod-github-runner-207 kernel: [38296.613309] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:02:02 juju-e4d256-prod-github-runner-207 kernel: [38296.614012] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:02:02 juju-e4d256-prod-github-runner-207 kernel: [38296.614713] ? do_syscall_64+0x69/0xc0 Aug 22 16:02:02 juju-e4d256-prod-github-runner-207 kernel: [38296.615337] ? do_syscall_64+0x69/0xc0 Aug 22 16:02:02 juju-e4d256-prod-github-runner-207 kernel: [38296.615973] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 16:02:02 juju-e4d256-prod-github-runner-207 kernel: [38296.616681] RIP: 0033:0x7faa5d0edaff Aug 22 16:02:02 juju-e4d256-prod-github-runner-207 kernel: [38296.617313] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 16:02:02 juju-e4d256-prod-github-runner-207 kernel: [38296.619304] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 16:02:02 juju-e4d256-prod-github-runner-207 kernel: [38296.620227] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 16:02:02 juju-e4d256-prod-github-runner-207 kernel: [38296.621119] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 16:02:02 juju-e4d256-prod-github-runner-207 kernel: [38296.622008] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 16:02:02 juju-e4d256-prod-github-runner-207 kernel: [38296.622912] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 16:02:02 juju-e4d256-prod-github-runner-207 kernel: [38296.623800] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 16:02:02 juju-e4d256-prod-github-runner-207 kernel: [38296.624699] Aug 22 16:02:30 juju-e4d256-prod-github-runner-207 kernel: [38324.541983] watchdog: BUG: soft lockup - CPU#1 stuck for 35584s! [qemu-system-x86:6715] Aug 22 16:02:30 juju-e4d256-prod-github-runner-207 kernel: [38324.543677] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 16:02:30 juju-e4d256-prod-github-runner-207 kernel: [38324.543904] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 16:02:30 juju-e4d256-prod-github-runner-207 kernel: [38324.556765] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 16:02:30 juju-e4d256-prod-github-runner-207 kernel: [38324.558236] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 16:02:30 juju-e4d256-prod-github-runner-207 kernel: [38324.559642] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:02:30 juju-e4d256-prod-github-runner-207 kernel: [38324.560818] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 16:02:30 juju-e4d256-prod-github-runner-207 kernel: [38324.563717] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 16:02:30 juju-e4d256-prod-github-runner-207 kernel: [38324.564868] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 16:02:30 juju-e4d256-prod-github-runner-207 kernel: [38324.566161] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 16:02:30 juju-e4d256-prod-github-runner-207 kernel: [38324.567469] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 16:02:30 juju-e4d256-prod-github-runner-207 kernel: [38324.568774] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 16:02:30 juju-e4d256-prod-github-runner-207 kernel: [38324.570080] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 16:02:30 juju-e4d256-prod-github-runner-207 kernel: [38324.571375] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 16:02:30 juju-e4d256-prod-github-runner-207 kernel: [38324.572793] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 16:02:30 juju-e4d256-prod-github-runner-207 kernel: [38324.574004] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 16:02:30 juju-e4d256-prod-github-runner-207 kernel: [38324.575335] Call Trace: Aug 22 16:02:30 juju-e4d256-prod-github-runner-207 kernel: [38324.576325] Aug 22 16:02:30 juju-e4d256-prod-github-runner-207 kernel: [38324.577271] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:02:30 juju-e4d256-prod-github-runner-207 kernel: [38324.578387] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:02:30 juju-e4d256-prod-github-runner-207 kernel: [38324.579520] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:02:30 juju-e4d256-prod-github-runner-207 kernel: [38324.580710] ? show_regs.part.0+0x23/0x29 Aug 22 16:02:30 juju-e4d256-prod-github-runner-207 kernel: [38324.581792] ? show_regs.cold+0x8/0xd Aug 22 16:02:30 juju-e4d256-prod-github-runner-207 kernel: [38324.582839] ? watchdog_timer_fn+0x1be/0x220 Aug 22 16:02:30 juju-e4d256-prod-github-runner-207 kernel: [38324.583939] ? lockup_detector_update_enable+0x60/0x60 Aug 22 16:02:30 juju-e4d256-prod-github-runner-207 kernel: [38324.585106] ? __hrtimer_run_queues+0x107/0x230 Aug 22 16:02:30 juju-e4d256-prod-github-runner-207 kernel: [38324.586231] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 16:02:30 juju-e4d256-prod-github-runner-207 kernel: [38324.587342] ? hrtimer_interrupt+0x101/0x220 Aug 22 16:02:30 juju-e4d256-prod-github-runner-207 kernel: [38324.588464] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 16:02:30 juju-e4d256-prod-github-runner-207 kernel: [38324.589653] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 16:02:30 juju-e4d256-prod-github-runner-207 kernel: [38324.590811] Aug 22 16:02:30 juju-e4d256-prod-github-runner-207 kernel: [38324.591718] Aug 22 16:02:30 juju-e4d256-prod-github-runner-207 kernel: [38324.592599] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 16:02:30 juju-e4d256-prod-github-runner-207 kernel: [38324.593736] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:02:30 juju-e4d256-prod-github-runner-207 kernel: [38324.594930] ? _raw_spin_lock+0x22/0x30 Aug 22 16:02:30 juju-e4d256-prod-github-runner-207 kernel: [38324.595991] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:02:30 juju-e4d256-prod-github-runner-207 kernel: [38324.597095] direct_page_fault+0x206/0x310 [kvm] Aug 22 16:02:30 juju-e4d256-prod-github-runner-207 kernel: [38324.598206] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 16:02:30 juju-e4d256-prod-github-runner-207 kernel: [38324.599304] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 16:02:30 juju-e4d256-prod-github-runner-207 kernel: [38324.600400] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 16:02:30 juju-e4d256-prod-github-runner-207 kernel: [38324.601497] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 16:02:30 juju-e4d256-prod-github-runner-207 kernel: [38324.602530] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 16:02:30 juju-e4d256-prod-github-runner-207 kernel: [38324.603635] handle_exit+0x98/0x230 [kvm_amd] Aug 22 16:02:30 juju-e4d256-prod-github-runner-207 kernel: [38324.604614] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 16:02:30 juju-e4d256-prod-github-runner-207 kernel: [38324.605616] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 16:02:30 juju-e4d256-prod-github-runner-207 kernel: [38324.606630] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 16:02:30 juju-e4d256-prod-github-runner-207 kernel: [38324.607758] vcpu_run+0x62/0x2c0 [kvm] Aug 22 16:02:30 juju-e4d256-prod-github-runner-207 kernel: [38324.608652] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 16:02:30 juju-e4d256-prod-github-runner-207 kernel: [38324.609553] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 16:02:30 juju-e4d256-prod-github-runner-207 kernel: [38324.610512] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 16:02:30 juju-e4d256-prod-github-runner-207 kernel: [38324.611402] ? __seccomp_filter+0x4a/0x4a0 Aug 22 16:02:30 juju-e4d256-prod-github-runner-207 kernel: [38324.612259] ? __fget_files+0x86/0xc0 Aug 22 16:02:30 juju-e4d256-prod-github-runner-207 kernel: [38324.613041] __x64_sys_ioctl+0x95/0xd0 Aug 22 16:02:30 juju-e4d256-prod-github-runner-207 kernel: [38324.613805] do_syscall_64+0x5c/0xc0 Aug 22 16:02:30 juju-e4d256-prod-github-runner-207 kernel: [38324.614544] ? do_futex+0x162/0x1f0 Aug 22 16:02:30 juju-e4d256-prod-github-runner-207 kernel: [38324.615267] ? __x64_sys_futex+0x78/0x1e0 Aug 22 16:02:30 juju-e4d256-prod-github-runner-207 kernel: [38324.616033] ? __secure_computing+0xa9/0x120 Aug 22 16:02:30 juju-e4d256-prod-github-runner-207 kernel: [38324.616811] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 16:02:30 juju-e4d256-prod-github-runner-207 kernel: [38324.617672] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:02:30 juju-e4d256-prod-github-runner-207 kernel: [38324.618486] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:02:30 juju-e4d256-prod-github-runner-207 kernel: [38324.619298] ? do_syscall_64+0x69/0xc0 Aug 22 16:02:30 juju-e4d256-prod-github-runner-207 kernel: [38324.620032] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:02:30 juju-e4d256-prod-github-runner-207 kernel: [38324.620826] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:02:30 juju-e4d256-prod-github-runner-207 kernel: [38324.621614] ? do_syscall_64+0x69/0xc0 Aug 22 16:02:30 juju-e4d256-prod-github-runner-207 kernel: [38324.622311] ? do_syscall_64+0x69/0xc0 Aug 22 16:02:30 juju-e4d256-prod-github-runner-207 kernel: [38324.623006] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 16:02:30 juju-e4d256-prod-github-runner-207 kernel: [38324.623833] RIP: 0033:0x7faa5d0edaff Aug 22 16:02:30 juju-e4d256-prod-github-runner-207 kernel: [38324.624566] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 16:02:30 juju-e4d256-prod-github-runner-207 kernel: [38324.626893] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 16:02:30 juju-e4d256-prod-github-runner-207 kernel: [38324.627969] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 16:02:30 juju-e4d256-prod-github-runner-207 kernel: [38324.628991] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 16:02:30 juju-e4d256-prod-github-runner-207 kernel: [38324.630018] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 16:02:30 juju-e4d256-prod-github-runner-207 kernel: [38324.631036] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 16:02:30 juju-e4d256-prod-github-runner-207 kernel: [38324.632074] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 16:02:30 juju-e4d256-prod-github-runner-207 kernel: [38324.633097] Aug 22 16:02:45 juju-e4d256-prod-github-runner-207 kernel: [38339.744706] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 16:02:45 juju-e4d256-prod-github-runner-207 kernel: [38339.745686] rcu: 1-....: (9525661 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=4605121 Aug 22 16:02:45 juju-e4d256-prod-github-runner-207 kernel: [38339.746859] (t=9555636 jiffies g=23269 q=39534) Aug 22 16:02:45 juju-e4d256-prod-github-runner-207 kernel: [38339.747656] NMI backtrace for cpu 1 Aug 22 16:02:45 juju-e4d256-prod-github-runner-207 kernel: [38339.748369] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 16:02:45 juju-e4d256-prod-github-runner-207 kernel: [38339.749478] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 16:02:45 juju-e4d256-prod-github-runner-207 kernel: [38339.750540] Call Trace: Aug 22 16:02:45 juju-e4d256-prod-github-runner-207 kernel: [38339.751219] Aug 22 16:02:45 juju-e4d256-prod-github-runner-207 kernel: [38339.751871] show_stack+0x52/0x5c Aug 22 16:02:45 juju-e4d256-prod-github-runner-207 kernel: [38339.752595] dump_stack_lvl+0x4a/0x63 Aug 22 16:02:45 juju-e4d256-prod-github-runner-207 kernel: [38339.753483] dump_stack+0x10/0x16 Aug 22 16:02:45 juju-e4d256-prod-github-runner-207 kernel: [38339.754214] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 16:02:45 juju-e4d256-prod-github-runner-207 kernel: [38339.754992] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 16:02:45 juju-e4d256-prod-github-runner-207 kernel: [38339.755779] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 16:02:45 juju-e4d256-prod-github-runner-207 kernel: [38339.756595] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 16:02:45 juju-e4d256-prod-github-runner-207 kernel: [38339.757497] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 16:02:45 juju-e4d256-prod-github-runner-207 kernel: [38339.758318] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 16:02:45 juju-e4d256-prod-github-runner-207 kernel: [38339.759112] print_cpu_stall.cold+0x2f/0xe2 Aug 22 16:02:45 juju-e4d256-prod-github-runner-207 kernel: [38339.759904] ? timekeeping_update+0xf7/0x150 Aug 22 16:02:45 juju-e4d256-prod-github-runner-207 kernel: [38339.760672] check_cpu_stall+0x109/0x270 Aug 22 16:02:45 juju-e4d256-prod-github-runner-207 kernel: [38339.761441] rcu_sched_clock_irq+0x9a/0x250 Aug 22 16:02:45 juju-e4d256-prod-github-runner-207 kernel: [38339.762205] update_process_times+0x94/0xd0 Aug 22 16:02:45 juju-e4d256-prod-github-runner-207 kernel: [38339.762964] tick_sched_handle+0x29/0x70 Aug 22 16:02:45 juju-e4d256-prod-github-runner-207 kernel: [38339.763789] tick_sched_timer+0x8c/0xc0 Aug 22 16:02:45 juju-e4d256-prod-github-runner-207 kernel: [38339.764532] ? tick_nohz_handler+0xb0/0xb0 Aug 22 16:02:45 juju-e4d256-prod-github-runner-207 kernel: [38339.765293] __hrtimer_run_queues+0x107/0x230 Aug 22 16:02:45 juju-e4d256-prod-github-runner-207 kernel: [38339.766067] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 16:02:45 juju-e4d256-prod-github-runner-207 kernel: [38339.766843] hrtimer_interrupt+0x101/0x220 Aug 22 16:02:45 juju-e4d256-prod-github-runner-207 kernel: [38339.767616] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 16:02:45 juju-e4d256-prod-github-runner-207 kernel: [38339.768440] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 16:02:45 juju-e4d256-prod-github-runner-207 kernel: [38339.769244] Aug 22 16:02:45 juju-e4d256-prod-github-runner-207 kernel: [38339.769878] Aug 22 16:02:45 juju-e4d256-prod-github-runner-207 kernel: [38339.770507] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 16:02:45 juju-e4d256-prod-github-runner-207 kernel: [38339.771344] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:02:45 juju-e4d256-prod-github-runner-207 kernel: [38339.772221] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 16:02:45 juju-e4d256-prod-github-runner-207 kernel: [38339.774431] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 16:02:45 juju-e4d256-prod-github-runner-207 kernel: [38339.775325] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 16:02:45 juju-e4d256-prod-github-runner-207 kernel: [38339.776318] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 16:02:45 juju-e4d256-prod-github-runner-207 kernel: [38339.777296] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 16:02:45 juju-e4d256-prod-github-runner-207 kernel: [38339.778264] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 16:02:45 juju-e4d256-prod-github-runner-207 kernel: [38339.779255] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 16:02:45 juju-e4d256-prod-github-runner-207 kernel: [38339.780260] ? _raw_spin_lock+0x22/0x30 Aug 22 16:02:45 juju-e4d256-prod-github-runner-207 kernel: [38339.781021] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:02:45 juju-e4d256-prod-github-runner-207 kernel: [38339.781863] direct_page_fault+0x206/0x310 [kvm] Aug 22 16:02:45 juju-e4d256-prod-github-runner-207 kernel: [38339.782702] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 16:02:45 juju-e4d256-prod-github-runner-207 kernel: [38339.783549] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 16:02:45 juju-e4d256-prod-github-runner-207 kernel: [38339.784380] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 16:02:45 juju-e4d256-prod-github-runner-207 kernel: [38339.785234] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 16:02:45 juju-e4d256-prod-github-runner-207 kernel: [38339.786038] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 16:02:45 juju-e4d256-prod-github-runner-207 kernel: [38339.786866] handle_exit+0x98/0x230 [kvm_amd] Aug 22 16:02:45 juju-e4d256-prod-github-runner-207 kernel: [38339.787639] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 16:02:45 juju-e4d256-prod-github-runner-207 kernel: [38339.788425] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 16:02:45 juju-e4d256-prod-github-runner-207 kernel: [38339.789246] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 16:02:45 juju-e4d256-prod-github-runner-207 kernel: [38339.790049] vcpu_run+0x62/0x2c0 [kvm] Aug 22 16:02:45 juju-e4d256-prod-github-runner-207 kernel: [38339.790843] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 16:02:45 juju-e4d256-prod-github-runner-207 kernel: [38339.791614] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 16:02:45 juju-e4d256-prod-github-runner-207 kernel: [38339.792417] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 16:02:45 juju-e4d256-prod-github-runner-207 kernel: [38339.793179] ? __seccomp_filter+0x4a/0x4a0 Aug 22 16:02:45 juju-e4d256-prod-github-runner-207 kernel: [38339.793899] ? __fget_files+0x86/0xc0 Aug 22 16:02:45 juju-e4d256-prod-github-runner-207 kernel: [38339.794591] __x64_sys_ioctl+0x95/0xd0 Aug 22 16:02:45 juju-e4d256-prod-github-runner-207 kernel: [38339.795288] do_syscall_64+0x5c/0xc0 Aug 22 16:02:45 juju-e4d256-prod-github-runner-207 kernel: [38339.795984] ? do_futex+0x162/0x1f0 Aug 22 16:02:45 juju-e4d256-prod-github-runner-207 kernel: [38339.796654] ? __x64_sys_futex+0x78/0x1e0 Aug 22 16:02:45 juju-e4d256-prod-github-runner-207 kernel: [38339.797360] ? __secure_computing+0xa9/0x120 Aug 22 16:02:45 juju-e4d256-prod-github-runner-207 kernel: [38339.798077] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 16:02:45 juju-e4d256-prod-github-runner-207 kernel: [38339.798882] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:02:45 juju-e4d256-prod-github-runner-207 kernel: [38339.799652] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:02:45 juju-e4d256-prod-github-runner-207 kernel: [38339.800410] ? do_syscall_64+0x69/0xc0 Aug 22 16:02:45 juju-e4d256-prod-github-runner-207 kernel: [38339.801098] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:02:45 juju-e4d256-prod-github-runner-207 kernel: [38339.801858] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:02:45 juju-e4d256-prod-github-runner-207 kernel: [38339.802617] ? do_syscall_64+0x69/0xc0 Aug 22 16:02:45 juju-e4d256-prod-github-runner-207 kernel: [38339.803322] ? do_syscall_64+0x69/0xc0 Aug 22 16:02:45 juju-e4d256-prod-github-runner-207 kernel: [38339.804008] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 16:02:45 juju-e4d256-prod-github-runner-207 kernel: [38339.804776] RIP: 0033:0x7faa5d0edaff Aug 22 16:02:45 juju-e4d256-prod-github-runner-207 kernel: [38339.805463] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 16:02:45 juju-e4d256-prod-github-runner-207 kernel: [38339.807562] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 16:02:45 juju-e4d256-prod-github-runner-207 kernel: [38339.808520] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 16:02:45 juju-e4d256-prod-github-runner-207 kernel: [38339.809461] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 16:02:45 juju-e4d256-prod-github-runner-207 kernel: [38339.810404] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 16:02:45 juju-e4d256-prod-github-runner-207 kernel: [38339.811355] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 16:02:45 juju-e4d256-prod-github-runner-207 kernel: [38339.812280] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 16:02:45 juju-e4d256-prod-github-runner-207 kernel: [38339.813190] Aug 22 16:03:10 juju-e4d256-prod-github-runner-207 kernel: [38364.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 35621s! [qemu-system-x86:6715] Aug 22 16:03:10 juju-e4d256-prod-github-runner-207 kernel: [38364.543122] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 16:03:10 juju-e4d256-prod-github-runner-207 kernel: [38364.543189] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 16:03:10 juju-e4d256-prod-github-runner-207 kernel: [38364.555333] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 16:03:10 juju-e4d256-prod-github-runner-207 kernel: [38364.556594] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 16:03:10 juju-e4d256-prod-github-runner-207 kernel: [38364.557813] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:03:10 juju-e4d256-prod-github-runner-207 kernel: [38364.558868] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 16:03:10 juju-e4d256-prod-github-runner-207 kernel: [38364.561425] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 16:03:10 juju-e4d256-prod-github-runner-207 kernel: [38364.562467] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 16:03:10 juju-e4d256-prod-github-runner-207 kernel: [38364.563648] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 16:03:10 juju-e4d256-prod-github-runner-207 kernel: [38364.564810] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 16:03:10 juju-e4d256-prod-github-runner-207 kernel: [38364.565971] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 16:03:10 juju-e4d256-prod-github-runner-207 kernel: [38364.567154] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 16:03:10 juju-e4d256-prod-github-runner-207 kernel: [38364.568320] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 16:03:10 juju-e4d256-prod-github-runner-207 kernel: [38364.569672] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 16:03:10 juju-e4d256-prod-github-runner-207 kernel: [38364.570902] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 16:03:10 juju-e4d256-prod-github-runner-207 kernel: [38364.572121] Call Trace: Aug 22 16:03:10 juju-e4d256-prod-github-runner-207 kernel: [38364.573040] Aug 22 16:03:10 juju-e4d256-prod-github-runner-207 kernel: [38364.573926] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:03:10 juju-e4d256-prod-github-runner-207 kernel: [38364.574961] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:03:10 juju-e4d256-prod-github-runner-207 kernel: [38364.576014] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:03:10 juju-e4d256-prod-github-runner-207 kernel: [38364.577090] ? show_regs.part.0+0x23/0x29 Aug 22 16:03:10 juju-e4d256-prod-github-runner-207 kernel: [38364.578089] ? show_regs.cold+0x8/0xd Aug 22 16:03:10 juju-e4d256-prod-github-runner-207 kernel: [38364.579074] ? watchdog_timer_fn+0x1be/0x220 Aug 22 16:03:10 juju-e4d256-prod-github-runner-207 kernel: [38364.580088] ? lockup_detector_update_enable+0x60/0x60 Aug 22 16:03:10 juju-e4d256-prod-github-runner-207 kernel: [38364.581152] ? __hrtimer_run_queues+0x107/0x230 Aug 22 16:03:10 juju-e4d256-prod-github-runner-207 kernel: [38364.582178] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 16:03:10 juju-e4d256-prod-github-runner-207 kernel: [38364.583214] ? hrtimer_interrupt+0x101/0x220 Aug 22 16:03:10 juju-e4d256-prod-github-runner-207 kernel: [38364.584229] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 16:03:10 juju-e4d256-prod-github-runner-207 kernel: [38364.585300] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 16:03:10 juju-e4d256-prod-github-runner-207 kernel: [38364.586533] Aug 22 16:03:10 juju-e4d256-prod-github-runner-207 kernel: [38364.587402] Aug 22 16:03:10 juju-e4d256-prod-github-runner-207 kernel: [38364.588409] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 16:03:10 juju-e4d256-prod-github-runner-207 kernel: [38364.589443] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:03:10 juju-e4d256-prod-github-runner-207 kernel: [38364.590482] ? _raw_spin_lock+0x22/0x30 Aug 22 16:03:10 juju-e4d256-prod-github-runner-207 kernel: [38364.591444] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:03:10 juju-e4d256-prod-github-runner-207 kernel: [38364.592477] direct_page_fault+0x206/0x310 [kvm] Aug 22 16:03:10 juju-e4d256-prod-github-runner-207 kernel: [38364.593513] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 16:03:10 juju-e4d256-prod-github-runner-207 kernel: [38364.594519] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 16:03:10 juju-e4d256-prod-github-runner-207 kernel: [38364.595547] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 16:03:10 juju-e4d256-prod-github-runner-207 kernel: [38364.596520] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 16:03:10 juju-e4d256-prod-github-runner-207 kernel: [38364.597463] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 16:03:10 juju-e4d256-prod-github-runner-207 kernel: [38364.598440] handle_exit+0x98/0x230 [kvm_amd] Aug 22 16:03:10 juju-e4d256-prod-github-runner-207 kernel: [38364.599403] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 16:03:10 juju-e4d256-prod-github-runner-207 kernel: [38364.600517] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 16:03:10 juju-e4d256-prod-github-runner-207 kernel: [38364.601460] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 16:03:10 juju-e4d256-prod-github-runner-207 kernel: [38364.602371] vcpu_run+0x62/0x2c0 [kvm] Aug 22 16:03:10 juju-e4d256-prod-github-runner-207 kernel: [38364.603203] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 16:03:10 juju-e4d256-prod-github-runner-207 kernel: [38364.604018] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 16:03:10 juju-e4d256-prod-github-runner-207 kernel: [38364.604875] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 16:03:10 juju-e4d256-prod-github-runner-207 kernel: [38364.605675] ? __seccomp_filter+0x4a/0x4a0 Aug 22 16:03:10 juju-e4d256-prod-github-runner-207 kernel: [38364.606422] ? __fget_files+0x86/0xc0 Aug 22 16:03:10 juju-e4d256-prod-github-runner-207 kernel: [38364.607147] __x64_sys_ioctl+0x95/0xd0 Aug 22 16:03:10 juju-e4d256-prod-github-runner-207 kernel: [38364.607842] do_syscall_64+0x5c/0xc0 Aug 22 16:03:10 juju-e4d256-prod-github-runner-207 kernel: [38364.608509] ? do_futex+0x162/0x1f0 Aug 22 16:03:10 juju-e4d256-prod-github-runner-207 kernel: [38364.609161] ? __x64_sys_futex+0x78/0x1e0 Aug 22 16:03:10 juju-e4d256-prod-github-runner-207 kernel: [38364.609836] ? __secure_computing+0xa9/0x120 Aug 22 16:03:10 juju-e4d256-prod-github-runner-207 kernel: [38364.610535] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 16:03:10 juju-e4d256-prod-github-runner-207 kernel: [38364.611322] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:03:10 juju-e4d256-prod-github-runner-207 kernel: [38364.612052] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:03:10 juju-e4d256-prod-github-runner-207 kernel: [38364.612771] ? do_syscall_64+0x69/0xc0 Aug 22 16:03:10 juju-e4d256-prod-github-runner-207 kernel: [38364.613417] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:03:10 juju-e4d256-prod-github-runner-207 kernel: [38364.614127] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:03:10 juju-e4d256-prod-github-runner-207 kernel: [38364.614823] ? do_syscall_64+0x69/0xc0 Aug 22 16:03:10 juju-e4d256-prod-github-runner-207 kernel: [38364.615577] ? do_syscall_64+0x69/0xc0 Aug 22 16:03:10 juju-e4d256-prod-github-runner-207 kernel: [38364.616245] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 16:03:10 juju-e4d256-prod-github-runner-207 kernel: [38364.616951] RIP: 0033:0x7faa5d0edaff Aug 22 16:03:10 juju-e4d256-prod-github-runner-207 kernel: [38364.617574] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 16:03:10 juju-e4d256-prod-github-runner-207 kernel: [38364.619567] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 16:03:10 juju-e4d256-prod-github-runner-207 kernel: [38364.620481] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 16:03:10 juju-e4d256-prod-github-runner-207 kernel: [38364.621370] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 16:03:10 juju-e4d256-prod-github-runner-207 kernel: [38364.622257] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 16:03:10 juju-e4d256-prod-github-runner-207 kernel: [38364.623162] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 16:03:10 juju-e4d256-prod-github-runner-207 kernel: [38364.624048] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 16:03:10 juju-e4d256-prod-github-runner-207 kernel: [38364.624943] Aug 22 16:03:38 juju-e4d256-prod-github-runner-207 kernel: [38392.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 35647s! [qemu-system-x86:6715] Aug 22 16:03:38 juju-e4d256-prod-github-runner-207 kernel: [38392.543203] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 16:03:38 juju-e4d256-prod-github-runner-207 kernel: [38392.543340] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 16:03:38 juju-e4d256-prod-github-runner-207 kernel: [38392.555686] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 16:03:38 juju-e4d256-prod-github-runner-207 kernel: [38392.557012] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 16:03:38 juju-e4d256-prod-github-runner-207 kernel: [38392.558314] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:03:38 juju-e4d256-prod-github-runner-207 kernel: [38392.559440] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 16:03:38 juju-e4d256-prod-github-runner-207 kernel: [38392.561990] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 16:03:38 juju-e4d256-prod-github-runner-207 kernel: [38392.563046] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 16:03:38 juju-e4d256-prod-github-runner-207 kernel: [38392.564214] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 16:03:38 juju-e4d256-prod-github-runner-207 kernel: [38392.565377] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 16:03:38 juju-e4d256-prod-github-runner-207 kernel: [38392.566539] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 16:03:38 juju-e4d256-prod-github-runner-207 kernel: [38392.567724] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 16:03:38 juju-e4d256-prod-github-runner-207 kernel: [38392.568896] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 16:03:38 juju-e4d256-prod-github-runner-207 kernel: [38392.570134] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 16:03:38 juju-e4d256-prod-github-runner-207 kernel: [38392.571252] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 16:03:38 juju-e4d256-prod-github-runner-207 kernel: [38392.572452] Call Trace: Aug 22 16:03:38 juju-e4d256-prod-github-runner-207 kernel: [38392.573363] Aug 22 16:03:38 juju-e4d256-prod-github-runner-207 kernel: [38392.574251] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:03:38 juju-e4d256-prod-github-runner-207 kernel: [38392.575301] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:03:38 juju-e4d256-prod-github-runner-207 kernel: [38392.576326] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:03:38 juju-e4d256-prod-github-runner-207 kernel: [38392.577418] ? show_regs.part.0+0x23/0x29 Aug 22 16:03:38 juju-e4d256-prod-github-runner-207 kernel: [38392.578414] ? show_regs.cold+0x8/0xd Aug 22 16:03:38 juju-e4d256-prod-github-runner-207 kernel: [38392.579401] ? watchdog_timer_fn+0x1be/0x220 Aug 22 16:03:38 juju-e4d256-prod-github-runner-207 kernel: [38392.580418] ? lockup_detector_update_enable+0x60/0x60 Aug 22 16:03:38 juju-e4d256-prod-github-runner-207 kernel: [38392.581492] ? __hrtimer_run_queues+0x107/0x230 Aug 22 16:03:38 juju-e4d256-prod-github-runner-207 kernel: [38392.582526] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 16:03:38 juju-e4d256-prod-github-runner-207 kernel: [38392.583560] ? hrtimer_interrupt+0x101/0x220 Aug 22 16:03:38 juju-e4d256-prod-github-runner-207 kernel: [38392.584574] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 16:03:38 juju-e4d256-prod-github-runner-207 kernel: [38392.585646] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 16:03:38 juju-e4d256-prod-github-runner-207 kernel: [38392.586719] Aug 22 16:03:38 juju-e4d256-prod-github-runner-207 kernel: [38392.587576] Aug 22 16:03:38 juju-e4d256-prod-github-runner-207 kernel: [38392.588419] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 16:03:38 juju-e4d256-prod-github-runner-207 kernel: [38392.589453] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:03:38 juju-e4d256-prod-github-runner-207 kernel: [38392.590489] ? _raw_spin_lock+0x22/0x30 Aug 22 16:03:38 juju-e4d256-prod-github-runner-207 kernel: [38392.591440] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:03:38 juju-e4d256-prod-github-runner-207 kernel: [38392.592455] direct_page_fault+0x206/0x310 [kvm] Aug 22 16:03:38 juju-e4d256-prod-github-runner-207 kernel: [38392.593529] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 16:03:38 juju-e4d256-prod-github-runner-207 kernel: [38392.594577] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 16:03:38 juju-e4d256-prod-github-runner-207 kernel: [38392.595600] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 16:03:38 juju-e4d256-prod-github-runner-207 kernel: [38392.596593] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 16:03:38 juju-e4d256-prod-github-runner-207 kernel: [38392.597539] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 16:03:38 juju-e4d256-prod-github-runner-207 kernel: [38392.598546] handle_exit+0x98/0x230 [kvm_amd] Aug 22 16:03:38 juju-e4d256-prod-github-runner-207 kernel: [38392.599450] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 16:03:38 juju-e4d256-prod-github-runner-207 kernel: [38392.600362] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 16:03:38 juju-e4d256-prod-github-runner-207 kernel: [38392.601283] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 16:03:38 juju-e4d256-prod-github-runner-207 kernel: [38392.602185] vcpu_run+0x62/0x2c0 [kvm] Aug 22 16:03:38 juju-e4d256-prod-github-runner-207 kernel: [38392.603003] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 16:03:38 juju-e4d256-prod-github-runner-207 kernel: [38392.603810] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 16:03:38 juju-e4d256-prod-github-runner-207 kernel: [38392.604664] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 16:03:38 juju-e4d256-prod-github-runner-207 kernel: [38392.605461] ? __seccomp_filter+0x4a/0x4a0 Aug 22 16:03:38 juju-e4d256-prod-github-runner-207 kernel: [38392.606201] ? __fget_files+0x86/0xc0 Aug 22 16:03:38 juju-e4d256-prod-github-runner-207 kernel: [38392.606909] __x64_sys_ioctl+0x95/0xd0 Aug 22 16:03:38 juju-e4d256-prod-github-runner-207 kernel: [38392.607603] do_syscall_64+0x5c/0xc0 Aug 22 16:03:38 juju-e4d256-prod-github-runner-207 kernel: [38392.608267] ? do_futex+0x162/0x1f0 Aug 22 16:03:38 juju-e4d256-prod-github-runner-207 kernel: [38392.608953] ? __x64_sys_futex+0x78/0x1e0 Aug 22 16:03:38 juju-e4d256-prod-github-runner-207 kernel: [38392.609672] ? __secure_computing+0xa9/0x120 Aug 22 16:03:38 juju-e4d256-prod-github-runner-207 kernel: [38392.610407] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 16:03:38 juju-e4d256-prod-github-runner-207 kernel: [38392.611216] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:03:38 juju-e4d256-prod-github-runner-207 kernel: [38392.611943] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:03:38 juju-e4d256-prod-github-runner-207 kernel: [38392.612714] ? do_syscall_64+0x69/0xc0 Aug 22 16:03:38 juju-e4d256-prod-github-runner-207 kernel: [38392.613406] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:03:38 juju-e4d256-prod-github-runner-207 kernel: [38392.614154] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:03:38 juju-e4d256-prod-github-runner-207 kernel: [38392.614882] ? do_syscall_64+0x69/0xc0 Aug 22 16:03:38 juju-e4d256-prod-github-runner-207 kernel: [38392.615521] ? do_syscall_64+0x69/0xc0 Aug 22 16:03:38 juju-e4d256-prod-github-runner-207 kernel: [38392.616187] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 16:03:38 juju-e4d256-prod-github-runner-207 kernel: [38392.616926] RIP: 0033:0x7faa5d0edaff Aug 22 16:03:38 juju-e4d256-prod-github-runner-207 kernel: [38392.617557] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 16:03:38 juju-e4d256-prod-github-runner-207 kernel: [38392.619600] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 16:03:38 juju-e4d256-prod-github-runner-207 kernel: [38392.620510] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 16:03:38 juju-e4d256-prod-github-runner-207 kernel: [38392.621397] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 16:03:38 juju-e4d256-prod-github-runner-207 kernel: [38392.622457] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 16:03:38 juju-e4d256-prod-github-runner-207 kernel: [38392.623367] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 16:03:38 juju-e4d256-prod-github-runner-207 kernel: [38392.624264] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 16:03:38 juju-e4d256-prod-github-runner-207 kernel: [38392.625155] Aug 22 16:04:06 juju-e4d256-prod-github-runner-207 kernel: [38420.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 35673s! [qemu-system-x86:6715] Aug 22 16:04:06 juju-e4d256-prod-github-runner-207 kernel: [38420.543905] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 16:04:06 juju-e4d256-prod-github-runner-207 kernel: [38420.544112] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 16:04:06 juju-e4d256-prod-github-runner-207 kernel: [38420.556195] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 16:04:06 juju-e4d256-prod-github-runner-207 kernel: [38420.557466] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 16:04:06 juju-e4d256-prod-github-runner-207 kernel: [38420.558704] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:04:06 juju-e4d256-prod-github-runner-207 kernel: [38420.559775] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 16:04:06 juju-e4d256-prod-github-runner-207 kernel: [38420.562319] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 16:04:06 juju-e4d256-prod-github-runner-207 kernel: [38420.563371] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 16:04:06 juju-e4d256-prod-github-runner-207 kernel: [38420.564537] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 16:04:06 juju-e4d256-prod-github-runner-207 kernel: [38420.565697] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 16:04:06 juju-e4d256-prod-github-runner-207 kernel: [38420.566869] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 16:04:06 juju-e4d256-prod-github-runner-207 kernel: [38420.568033] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 16:04:06 juju-e4d256-prod-github-runner-207 kernel: [38420.569197] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 16:04:06 juju-e4d256-prod-github-runner-207 kernel: [38420.570435] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 16:04:06 juju-e4d256-prod-github-runner-207 kernel: [38420.571536] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 16:04:06 juju-e4d256-prod-github-runner-207 kernel: [38420.572731] Call Trace: Aug 22 16:04:06 juju-e4d256-prod-github-runner-207 kernel: [38420.573647] Aug 22 16:04:06 juju-e4d256-prod-github-runner-207 kernel: [38420.574553] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:04:06 juju-e4d256-prod-github-runner-207 kernel: [38420.575582] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:04:06 juju-e4d256-prod-github-runner-207 kernel: [38420.576606] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:04:06 juju-e4d256-prod-github-runner-207 kernel: [38420.577681] ? show_regs.part.0+0x23/0x29 Aug 22 16:04:06 juju-e4d256-prod-github-runner-207 kernel: [38420.578693] ? show_regs.cold+0x8/0xd Aug 22 16:04:06 juju-e4d256-prod-github-runner-207 kernel: [38420.579670] ? watchdog_timer_fn+0x1be/0x220 Aug 22 16:04:06 juju-e4d256-prod-github-runner-207 kernel: [38420.580684] ? lockup_detector_update_enable+0x60/0x60 Aug 22 16:04:06 juju-e4d256-prod-github-runner-207 kernel: [38420.581753] ? __hrtimer_run_queues+0x107/0x230 Aug 22 16:04:06 juju-e4d256-prod-github-runner-207 kernel: [38420.582899] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 16:04:06 juju-e4d256-prod-github-runner-207 kernel: [38420.584017] ? hrtimer_interrupt+0x101/0x220 Aug 22 16:04:06 juju-e4d256-prod-github-runner-207 kernel: [38420.585115] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 16:04:06 juju-e4d256-prod-github-runner-207 kernel: [38420.586298] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 16:04:06 juju-e4d256-prod-github-runner-207 kernel: [38420.587460] Aug 22 16:04:06 juju-e4d256-prod-github-runner-207 kernel: [38420.588361] Aug 22 16:04:06 juju-e4d256-prod-github-runner-207 kernel: [38420.589262] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 16:04:06 juju-e4d256-prod-github-runner-207 kernel: [38420.590420] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:04:06 juju-e4d256-prod-github-runner-207 kernel: [38420.591564] ? _raw_spin_lock+0x22/0x30 Aug 22 16:04:06 juju-e4d256-prod-github-runner-207 kernel: [38420.592593] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:04:06 juju-e4d256-prod-github-runner-207 kernel: [38420.593696] direct_page_fault+0x206/0x310 [kvm] Aug 22 16:04:06 juju-e4d256-prod-github-runner-207 kernel: [38420.594822] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 16:04:06 juju-e4d256-prod-github-runner-207 kernel: [38420.595933] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 16:04:06 juju-e4d256-prod-github-runner-207 kernel: [38420.597023] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 16:04:06 juju-e4d256-prod-github-runner-207 kernel: [38420.598094] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 16:04:06 juju-e4d256-prod-github-runner-207 kernel: [38420.599140] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 16:04:06 juju-e4d256-prod-github-runner-207 kernel: [38420.600226] handle_exit+0x98/0x230 [kvm_amd] Aug 22 16:04:06 juju-e4d256-prod-github-runner-207 kernel: [38420.601204] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 16:04:06 juju-e4d256-prod-github-runner-207 kernel: [38420.602222] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 16:04:06 juju-e4d256-prod-github-runner-207 kernel: [38420.603273] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 16:04:06 juju-e4d256-prod-github-runner-207 kernel: [38420.604298] vcpu_run+0x62/0x2c0 [kvm] Aug 22 16:04:06 juju-e4d256-prod-github-runner-207 kernel: [38420.605191] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 16:04:06 juju-e4d256-prod-github-runner-207 kernel: [38420.606088] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 16:04:06 juju-e4d256-prod-github-runner-207 kernel: [38420.607054] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 16:04:06 juju-e4d256-prod-github-runner-207 kernel: [38420.607948] ? __seccomp_filter+0x4a/0x4a0 Aug 22 16:04:06 juju-e4d256-prod-github-runner-207 kernel: [38420.608775] ? __fget_files+0x86/0xc0 Aug 22 16:04:06 juju-e4d256-prod-github-runner-207 kernel: [38420.609550] __x64_sys_ioctl+0x95/0xd0 Aug 22 16:04:06 juju-e4d256-prod-github-runner-207 kernel: [38420.610316] do_syscall_64+0x5c/0xc0 Aug 22 16:04:06 juju-e4d256-prod-github-runner-207 kernel: [38420.611061] ? do_futex+0x162/0x1f0 Aug 22 16:04:06 juju-e4d256-prod-github-runner-207 kernel: [38420.611792] ? __x64_sys_futex+0x78/0x1e0 Aug 22 16:04:06 juju-e4d256-prod-github-runner-207 kernel: [38420.612542] ? __secure_computing+0xa9/0x120 Aug 22 16:04:06 juju-e4d256-prod-github-runner-207 kernel: [38420.613320] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 16:04:06 juju-e4d256-prod-github-runner-207 kernel: [38420.614188] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:04:06 juju-e4d256-prod-github-runner-207 kernel: [38420.615026] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:04:06 juju-e4d256-prod-github-runner-207 kernel: [38420.615843] ? do_syscall_64+0x69/0xc0 Aug 22 16:04:06 juju-e4d256-prod-github-runner-207 kernel: [38420.616562] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:04:06 juju-e4d256-prod-github-runner-207 kernel: [38420.617357] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:04:06 juju-e4d256-prod-github-runner-207 kernel: [38420.618148] ? do_syscall_64+0x69/0xc0 Aug 22 16:04:06 juju-e4d256-prod-github-runner-207 kernel: [38420.618867] ? do_syscall_64+0x69/0xc0 Aug 22 16:04:06 juju-e4d256-prod-github-runner-207 kernel: [38420.619561] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 16:04:06 juju-e4d256-prod-github-runner-207 kernel: [38420.620362] RIP: 0033:0x7faa5d0edaff Aug 22 16:04:06 juju-e4d256-prod-github-runner-207 kernel: [38420.621097] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 16:04:06 juju-e4d256-prod-github-runner-207 kernel: [38420.623434] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 16:04:06 juju-e4d256-prod-github-runner-207 kernel: [38420.624496] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 16:04:06 juju-e4d256-prod-github-runner-207 kernel: [38420.625515] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 16:04:06 juju-e4d256-prod-github-runner-207 kernel: [38420.626554] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 16:04:06 juju-e4d256-prod-github-runner-207 kernel: [38420.627574] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 16:04:06 juju-e4d256-prod-github-runner-207 kernel: [38420.628592] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 16:04:06 juju-e4d256-prod-github-runner-207 kernel: [38420.629621] Aug 22 16:04:34 juju-e4d256-prod-github-runner-207 kernel: [38448.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 35699s! [qemu-system-x86:6715] Aug 22 16:04:34 juju-e4d256-prod-github-runner-207 kernel: [38448.543127] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 16:04:34 juju-e4d256-prod-github-runner-207 kernel: [38448.543196] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 16:04:34 juju-e4d256-prod-github-runner-207 kernel: [38448.555505] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 16:04:34 juju-e4d256-prod-github-runner-207 kernel: [38448.556780] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 16:04:34 juju-e4d256-prod-github-runner-207 kernel: [38448.558009] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:04:34 juju-e4d256-prod-github-runner-207 kernel: [38448.559079] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 16:04:34 juju-e4d256-prod-github-runner-207 kernel: [38448.561634] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 16:04:34 juju-e4d256-prod-github-runner-207 kernel: [38448.562689] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 16:04:34 juju-e4d256-prod-github-runner-207 kernel: [38448.563856] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 16:04:34 juju-e4d256-prod-github-runner-207 kernel: [38448.565016] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 16:04:34 juju-e4d256-prod-github-runner-207 kernel: [38448.566186] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 16:04:34 juju-e4d256-prod-github-runner-207 kernel: [38448.567354] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 16:04:34 juju-e4d256-prod-github-runner-207 kernel: [38448.568519] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 16:04:34 juju-e4d256-prod-github-runner-207 kernel: [38448.569754] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 16:04:34 juju-e4d256-prod-github-runner-207 kernel: [38448.570861] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 16:04:34 juju-e4d256-prod-github-runner-207 kernel: [38448.572052] Call Trace: Aug 22 16:04:34 juju-e4d256-prod-github-runner-207 kernel: [38448.572963] Aug 22 16:04:34 juju-e4d256-prod-github-runner-207 kernel: [38448.573846] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:04:34 juju-e4d256-prod-github-runner-207 kernel: [38448.574883] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:04:34 juju-e4d256-prod-github-runner-207 kernel: [38448.575901] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:04:34 juju-e4d256-prod-github-runner-207 kernel: [38448.576974] ? show_regs.part.0+0x23/0x29 Aug 22 16:04:34 juju-e4d256-prod-github-runner-207 kernel: [38448.577968] ? show_regs.cold+0x8/0xd Aug 22 16:04:34 juju-e4d256-prod-github-runner-207 kernel: [38448.578946] ? watchdog_timer_fn+0x1be/0x220 Aug 22 16:04:34 juju-e4d256-prod-github-runner-207 kernel: [38448.579958] ? lockup_detector_update_enable+0x60/0x60 Aug 22 16:04:34 juju-e4d256-prod-github-runner-207 kernel: [38448.581020] ? __hrtimer_run_queues+0x107/0x230 Aug 22 16:04:34 juju-e4d256-prod-github-runner-207 kernel: [38448.582056] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 16:04:34 juju-e4d256-prod-github-runner-207 kernel: [38448.583084] ? hrtimer_interrupt+0x101/0x220 Aug 22 16:04:34 juju-e4d256-prod-github-runner-207 kernel: [38448.584162] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 16:04:34 juju-e4d256-prod-github-runner-207 kernel: [38448.585244] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 16:04:34 juju-e4d256-prod-github-runner-207 kernel: [38448.586302] Aug 22 16:04:34 juju-e4d256-prod-github-runner-207 kernel: [38448.587154] Aug 22 16:04:34 juju-e4d256-prod-github-runner-207 kernel: [38448.587989] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 16:04:34 juju-e4d256-prod-github-runner-207 kernel: [38448.589025] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:04:34 juju-e4d256-prod-github-runner-207 kernel: [38448.590071] ? _raw_spin_lock+0x22/0x30 Aug 22 16:04:34 juju-e4d256-prod-github-runner-207 kernel: [38448.591020] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:04:34 juju-e4d256-prod-github-runner-207 kernel: [38448.592040] direct_page_fault+0x206/0x310 [kvm] Aug 22 16:04:34 juju-e4d256-prod-github-runner-207 kernel: [38448.593062] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 16:04:34 juju-e4d256-prod-github-runner-207 kernel: [38448.594078] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 16:04:34 juju-e4d256-prod-github-runner-207 kernel: [38448.595083] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 16:04:34 juju-e4d256-prod-github-runner-207 kernel: [38448.596053] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 16:04:34 juju-e4d256-prod-github-runner-207 kernel: [38448.597003] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 16:04:34 juju-e4d256-prod-github-runner-207 kernel: [38448.597979] handle_exit+0x98/0x230 [kvm_amd] Aug 22 16:04:34 juju-e4d256-prod-github-runner-207 kernel: [38448.598885] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 16:04:34 juju-e4d256-prod-github-runner-207 kernel: [38448.599800] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 16:04:34 juju-e4d256-prod-github-runner-207 kernel: [38448.600725] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 16:04:34 juju-e4d256-prod-github-runner-207 kernel: [38448.601626] vcpu_run+0x62/0x2c0 [kvm] Aug 22 16:04:34 juju-e4d256-prod-github-runner-207 kernel: [38448.602448] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 16:04:34 juju-e4d256-prod-github-runner-207 kernel: [38448.603259] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 16:04:34 juju-e4d256-prod-github-runner-207 kernel: [38448.604112] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 16:04:34 juju-e4d256-prod-github-runner-207 kernel: [38448.604914] ? __seccomp_filter+0x4a/0x4a0 Aug 22 16:04:34 juju-e4d256-prod-github-runner-207 kernel: [38448.605655] ? __fget_files+0x86/0xc0 Aug 22 16:04:34 juju-e4d256-prod-github-runner-207 kernel: [38448.606367] __x64_sys_ioctl+0x95/0xd0 Aug 22 16:04:34 juju-e4d256-prod-github-runner-207 kernel: [38448.607062] do_syscall_64+0x5c/0xc0 Aug 22 16:04:34 juju-e4d256-prod-github-runner-207 kernel: [38448.607725] ? do_futex+0x162/0x1f0 Aug 22 16:04:34 juju-e4d256-prod-github-runner-207 kernel: [38448.608372] ? __x64_sys_futex+0x78/0x1e0 Aug 22 16:04:34 juju-e4d256-prod-github-runner-207 kernel: [38448.609044] ? __secure_computing+0xa9/0x120 Aug 22 16:04:34 juju-e4d256-prod-github-runner-207 kernel: [38448.609734] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 16:04:34 juju-e4d256-prod-github-runner-207 kernel: [38448.610500] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:04:34 juju-e4d256-prod-github-runner-207 kernel: [38448.611220] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:04:34 juju-e4d256-prod-github-runner-207 kernel: [38448.611941] ? do_syscall_64+0x69/0xc0 Aug 22 16:04:34 juju-e4d256-prod-github-runner-207 kernel: [38448.612589] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:04:34 juju-e4d256-prod-github-runner-207 kernel: [38448.613312] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:04:34 juju-e4d256-prod-github-runner-207 kernel: [38448.614081] ? do_syscall_64+0x69/0xc0 Aug 22 16:04:34 juju-e4d256-prod-github-runner-207 kernel: [38448.614713] ? do_syscall_64+0x69/0xc0 Aug 22 16:04:34 juju-e4d256-prod-github-runner-207 kernel: [38448.615339] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 16:04:34 juju-e4d256-prod-github-runner-207 kernel: [38448.616043] RIP: 0033:0x7faa5d0edaff Aug 22 16:04:34 juju-e4d256-prod-github-runner-207 kernel: [38448.616671] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 16:04:34 juju-e4d256-prod-github-runner-207 kernel: [38448.618677] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 16:04:34 juju-e4d256-prod-github-runner-207 kernel: [38448.619592] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 16:04:34 juju-e4d256-prod-github-runner-207 kernel: [38448.620483] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 16:04:34 juju-e4d256-prod-github-runner-207 kernel: [38448.621379] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 16:04:34 juju-e4d256-prod-github-runner-207 kernel: [38448.622282] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 16:04:34 juju-e4d256-prod-github-runner-207 kernel: [38448.623176] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 16:04:34 juju-e4d256-prod-github-runner-207 kernel: [38448.624072] Aug 22 16:05:02 juju-e4d256-prod-github-runner-207 kernel: [38476.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 35726s! [qemu-system-x86:6715] Aug 22 16:05:02 juju-e4d256-prod-github-runner-207 kernel: [38476.543086] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 16:05:02 juju-e4d256-prod-github-runner-207 kernel: [38476.543153] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 16:05:02 juju-e4d256-prod-github-runner-207 kernel: [38476.555223] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 16:05:02 juju-e4d256-prod-github-runner-207 kernel: [38476.556485] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 16:05:02 juju-e4d256-prod-github-runner-207 kernel: [38476.557712] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:05:02 juju-e4d256-prod-github-runner-207 kernel: [38476.558769] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 16:05:02 juju-e4d256-prod-github-runner-207 kernel: [38476.561317] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 16:05:02 juju-e4d256-prod-github-runner-207 kernel: [38476.562366] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 16:05:02 juju-e4d256-prod-github-runner-207 kernel: [38476.563527] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 16:05:02 juju-e4d256-prod-github-runner-207 kernel: [38476.564689] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 16:05:02 juju-e4d256-prod-github-runner-207 kernel: [38476.565858] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 16:05:02 juju-e4d256-prod-github-runner-207 kernel: [38476.567019] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 16:05:02 juju-e4d256-prod-github-runner-207 kernel: [38476.568192] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 16:05:02 juju-e4d256-prod-github-runner-207 kernel: [38476.569422] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 16:05:02 juju-e4d256-prod-github-runner-207 kernel: [38476.570537] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 16:05:02 juju-e4d256-prod-github-runner-207 kernel: [38476.571726] Call Trace: Aug 22 16:05:02 juju-e4d256-prod-github-runner-207 kernel: [38476.572637] Aug 22 16:05:02 juju-e4d256-prod-github-runner-207 kernel: [38476.573521] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:05:02 juju-e4d256-prod-github-runner-207 kernel: [38476.574563] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:05:02 juju-e4d256-prod-github-runner-207 kernel: [38476.575586] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:05:02 juju-e4d256-prod-github-runner-207 kernel: [38476.576660] ? show_regs.part.0+0x23/0x29 Aug 22 16:05:02 juju-e4d256-prod-github-runner-207 kernel: [38476.577658] ? show_regs.cold+0x8/0xd Aug 22 16:05:02 juju-e4d256-prod-github-runner-207 kernel: [38476.578642] ? watchdog_timer_fn+0x1be/0x220 Aug 22 16:05:02 juju-e4d256-prod-github-runner-207 kernel: [38476.579651] ? lockup_detector_update_enable+0x60/0x60 Aug 22 16:05:02 juju-e4d256-prod-github-runner-207 kernel: [38476.580716] ? __hrtimer_run_queues+0x107/0x230 Aug 22 16:05:02 juju-e4d256-prod-github-runner-207 kernel: [38476.581752] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 16:05:02 juju-e4d256-prod-github-runner-207 kernel: [38476.582776] ? hrtimer_interrupt+0x101/0x220 Aug 22 16:05:02 juju-e4d256-prod-github-runner-207 kernel: [38476.583790] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 16:05:02 juju-e4d256-prod-github-runner-207 kernel: [38476.584858] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 16:05:02 juju-e4d256-prod-github-runner-207 kernel: [38476.585921] Aug 22 16:05:02 juju-e4d256-prod-github-runner-207 kernel: [38476.586775] Aug 22 16:05:02 juju-e4d256-prod-github-runner-207 kernel: [38476.587612] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 16:05:02 juju-e4d256-prod-github-runner-207 kernel: [38476.588647] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:05:02 juju-e4d256-prod-github-runner-207 kernel: [38476.589703] ? _raw_spin_lock+0x22/0x30 Aug 22 16:05:02 juju-e4d256-prod-github-runner-207 kernel: [38476.590646] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:05:02 juju-e4d256-prod-github-runner-207 kernel: [38476.591660] direct_page_fault+0x206/0x310 [kvm] Aug 22 16:05:02 juju-e4d256-prod-github-runner-207 kernel: [38476.592682] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 16:05:02 juju-e4d256-prod-github-runner-207 kernel: [38476.593702] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 16:05:02 juju-e4d256-prod-github-runner-207 kernel: [38476.594707] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 16:05:02 juju-e4d256-prod-github-runner-207 kernel: [38476.595676] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 16:05:02 juju-e4d256-prod-github-runner-207 kernel: [38476.596626] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 16:05:02 juju-e4d256-prod-github-runner-207 kernel: [38476.597611] handle_exit+0x98/0x230 [kvm_amd] Aug 22 16:05:02 juju-e4d256-prod-github-runner-207 kernel: [38476.598512] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 16:05:02 juju-e4d256-prod-github-runner-207 kernel: [38476.599429] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 16:05:02 juju-e4d256-prod-github-runner-207 kernel: [38476.600352] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 16:05:02 juju-e4d256-prod-github-runner-207 kernel: [38476.601257] vcpu_run+0x62/0x2c0 [kvm] Aug 22 16:05:02 juju-e4d256-prod-github-runner-207 kernel: [38476.602108] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 16:05:02 juju-e4d256-prod-github-runner-207 kernel: [38476.602917] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 16:05:02 juju-e4d256-prod-github-runner-207 kernel: [38476.603770] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 16:05:02 juju-e4d256-prod-github-runner-207 kernel: [38476.604566] ? __seccomp_filter+0x4a/0x4a0 Aug 22 16:05:02 juju-e4d256-prod-github-runner-207 kernel: [38476.605314] ? __fget_files+0x86/0xc0 Aug 22 16:05:02 juju-e4d256-prod-github-runner-207 kernel: [38476.606027] __x64_sys_ioctl+0x95/0xd0 Aug 22 16:05:02 juju-e4d256-prod-github-runner-207 kernel: [38476.606719] do_syscall_64+0x5c/0xc0 Aug 22 16:05:02 juju-e4d256-prod-github-runner-207 kernel: [38476.607382] ? do_futex+0x162/0x1f0 Aug 22 16:05:02 juju-e4d256-prod-github-runner-207 kernel: [38476.608032] ? __x64_sys_futex+0x78/0x1e0 Aug 22 16:05:02 juju-e4d256-prod-github-runner-207 kernel: [38476.608706] ? __secure_computing+0xa9/0x120 Aug 22 16:05:02 juju-e4d256-prod-github-runner-207 kernel: [38476.609393] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 16:05:02 juju-e4d256-prod-github-runner-207 kernel: [38476.610160] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:05:02 juju-e4d256-prod-github-runner-207 kernel: [38476.610880] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:05:02 juju-e4d256-prod-github-runner-207 kernel: [38476.611595] ? do_syscall_64+0x69/0xc0 Aug 22 16:05:02 juju-e4d256-prod-github-runner-207 kernel: [38476.612238] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:05:02 juju-e4d256-prod-github-runner-207 kernel: [38476.612940] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:05:02 juju-e4d256-prod-github-runner-207 kernel: [38476.613632] ? do_syscall_64+0x69/0xc0 Aug 22 16:05:02 juju-e4d256-prod-github-runner-207 kernel: [38476.614266] ? do_syscall_64+0x69/0xc0 Aug 22 16:05:02 juju-e4d256-prod-github-runner-207 kernel: [38476.614889] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 16:05:02 juju-e4d256-prod-github-runner-207 kernel: [38476.615592] RIP: 0033:0x7faa5d0edaff Aug 22 16:05:02 juju-e4d256-prod-github-runner-207 kernel: [38476.616222] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 16:05:02 juju-e4d256-prod-github-runner-207 kernel: [38476.618220] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 16:05:02 juju-e4d256-prod-github-runner-207 kernel: [38476.619128] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 16:05:02 juju-e4d256-prod-github-runner-207 kernel: [38476.620014] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 16:05:02 juju-e4d256-prod-github-runner-207 kernel: [38476.620901] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 16:05:02 juju-e4d256-prod-github-runner-207 kernel: [38476.621804] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 16:05:02 juju-e4d256-prod-github-runner-207 kernel: [38476.622691] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 16:05:02 juju-e4d256-prod-github-runner-207 kernel: [38476.623580] Aug 22 16:05:30 juju-e4d256-prod-github-runner-207 kernel: [38504.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 35752s! [qemu-system-x86:6715] Aug 22 16:05:30 juju-e4d256-prod-github-runner-207 kernel: [38504.543718] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 16:05:30 juju-e4d256-prod-github-runner-207 kernel: [38504.543970] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 16:05:30 juju-e4d256-prod-github-runner-207 kernel: [38504.556067] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 16:05:30 juju-e4d256-prod-github-runner-207 kernel: [38504.557337] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 16:05:30 juju-e4d256-prod-github-runner-207 kernel: [38504.558572] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:05:30 juju-e4d256-prod-github-runner-207 kernel: [38504.559634] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 16:05:30 juju-e4d256-prod-github-runner-207 kernel: [38504.562195] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 16:05:30 juju-e4d256-prod-github-runner-207 kernel: [38504.563241] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 16:05:30 juju-e4d256-prod-github-runner-207 kernel: [38504.564584] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 16:05:30 juju-e4d256-prod-github-runner-207 kernel: [38504.566046] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 16:05:30 juju-e4d256-prod-github-runner-207 kernel: [38504.568770] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 16:05:30 juju-e4d256-prod-github-runner-207 kernel: [38504.569964] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 16:05:30 juju-e4d256-prod-github-runner-207 kernel: [38504.571141] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 16:05:30 juju-e4d256-prod-github-runner-207 kernel: [38504.572372] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 16:05:30 juju-e4d256-prod-github-runner-207 kernel: [38504.573490] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 16:05:30 juju-e4d256-prod-github-runner-207 kernel: [38504.574681] Call Trace: Aug 22 16:05:30 juju-e4d256-prod-github-runner-207 kernel: [38504.575598] Aug 22 16:05:30 juju-e4d256-prod-github-runner-207 kernel: [38504.576497] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:05:30 juju-e4d256-prod-github-runner-207 kernel: [38504.577545] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:05:30 juju-e4d256-prod-github-runner-207 kernel: [38504.578570] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:05:30 juju-e4d256-prod-github-runner-207 kernel: [38504.579658] ? show_regs.part.0+0x23/0x29 Aug 22 16:05:30 juju-e4d256-prod-github-runner-207 kernel: [38504.580654] ? show_regs.cold+0x8/0xd Aug 22 16:05:30 juju-e4d256-prod-github-runner-207 kernel: [38504.581642] ? watchdog_timer_fn+0x1be/0x220 Aug 22 16:05:30 juju-e4d256-prod-github-runner-207 kernel: [38504.582655] ? lockup_detector_update_enable+0x60/0x60 Aug 22 16:05:30 juju-e4d256-prod-github-runner-207 kernel: [38504.583717] ? __hrtimer_run_queues+0x107/0x230 Aug 22 16:05:30 juju-e4d256-prod-github-runner-207 kernel: [38504.584743] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 16:05:30 juju-e4d256-prod-github-runner-207 kernel: [38504.585790] ? hrtimer_interrupt+0x101/0x220 Aug 22 16:05:30 juju-e4d256-prod-github-runner-207 kernel: [38504.586809] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 16:05:30 juju-e4d256-prod-github-runner-207 kernel: [38504.587876] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 16:05:30 juju-e4d256-prod-github-runner-207 kernel: [38504.588921] Aug 22 16:05:30 juju-e4d256-prod-github-runner-207 kernel: [38504.589787] Aug 22 16:05:30 juju-e4d256-prod-github-runner-207 kernel: [38504.590626] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 16:05:30 juju-e4d256-prod-github-runner-207 kernel: [38504.591662] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:05:30 juju-e4d256-prod-github-runner-207 kernel: [38504.592702] ? _raw_spin_lock+0x22/0x30 Aug 22 16:05:30 juju-e4d256-prod-github-runner-207 kernel: [38504.593660] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:05:30 juju-e4d256-prod-github-runner-207 kernel: [38504.594678] direct_page_fault+0x206/0x310 [kvm] Aug 22 16:05:30 juju-e4d256-prod-github-runner-207 kernel: [38504.595703] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 16:05:30 juju-e4d256-prod-github-runner-207 kernel: [38504.596715] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 16:05:30 juju-e4d256-prod-github-runner-207 kernel: [38504.597735] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 16:05:30 juju-e4d256-prod-github-runner-207 kernel: [38504.598729] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 16:05:30 juju-e4d256-prod-github-runner-207 kernel: [38504.599675] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 16:05:30 juju-e4d256-prod-github-runner-207 kernel: [38504.600651] handle_exit+0x98/0x230 [kvm_amd] Aug 22 16:05:30 juju-e4d256-prod-github-runner-207 kernel: [38504.601569] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 16:05:30 juju-e4d256-prod-github-runner-207 kernel: [38504.602484] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 16:05:30 juju-e4d256-prod-github-runner-207 kernel: [38504.603408] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 16:05:30 juju-e4d256-prod-github-runner-207 kernel: [38504.604309] vcpu_run+0x62/0x2c0 [kvm] Aug 22 16:05:30 juju-e4d256-prod-github-runner-207 kernel: [38504.605119] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 16:05:30 juju-e4d256-prod-github-runner-207 kernel: [38504.605947] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 16:05:30 juju-e4d256-prod-github-runner-207 kernel: [38504.606803] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 16:05:30 juju-e4d256-prod-github-runner-207 kernel: [38504.607603] ? __seccomp_filter+0x4a/0x4a0 Aug 22 16:05:30 juju-e4d256-prod-github-runner-207 kernel: [38504.608344] ? __fget_files+0x86/0xc0 Aug 22 16:05:30 juju-e4d256-prod-github-runner-207 kernel: [38504.609046] __x64_sys_ioctl+0x95/0xd0 Aug 22 16:05:30 juju-e4d256-prod-github-runner-207 kernel: [38504.609750] do_syscall_64+0x5c/0xc0 Aug 22 16:05:30 juju-e4d256-prod-github-runner-207 kernel: [38504.610414] ? do_futex+0x162/0x1f0 Aug 22 16:05:30 juju-e4d256-prod-github-runner-207 kernel: [38504.611061] ? __x64_sys_futex+0x78/0x1e0 Aug 22 16:05:30 juju-e4d256-prod-github-runner-207 kernel: [38504.611735] ? __secure_computing+0xa9/0x120 Aug 22 16:05:30 juju-e4d256-prod-github-runner-207 kernel: [38504.612423] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 16:05:30 juju-e4d256-prod-github-runner-207 kernel: [38504.613183] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:05:30 juju-e4d256-prod-github-runner-207 kernel: [38504.613912] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:05:30 juju-e4d256-prod-github-runner-207 kernel: [38504.614633] ? do_syscall_64+0x69/0xc0 Aug 22 16:05:30 juju-e4d256-prod-github-runner-207 kernel: [38504.615276] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:05:30 juju-e4d256-prod-github-runner-207 kernel: [38504.615979] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:05:30 juju-e4d256-prod-github-runner-207 kernel: [38504.616678] ? do_syscall_64+0x69/0xc0 Aug 22 16:05:30 juju-e4d256-prod-github-runner-207 kernel: [38504.617301] ? do_syscall_64+0x69/0xc0 Aug 22 16:05:30 juju-e4d256-prod-github-runner-207 kernel: [38504.617932] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 16:05:30 juju-e4d256-prod-github-runner-207 kernel: [38504.618635] RIP: 0033:0x7faa5d0edaff Aug 22 16:05:30 juju-e4d256-prod-github-runner-207 kernel: [38504.619287] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 16:05:30 juju-e4d256-prod-github-runner-207 kernel: [38504.621266] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 16:05:30 juju-e4d256-prod-github-runner-207 kernel: [38504.622187] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 16:05:30 juju-e4d256-prod-github-runner-207 kernel: [38504.623074] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 16:05:30 juju-e4d256-prod-github-runner-207 kernel: [38504.623965] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 16:05:30 juju-e4d256-prod-github-runner-207 kernel: [38504.624849] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 16:05:30 juju-e4d256-prod-github-runner-207 kernel: [38504.625745] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 16:05:30 juju-e4d256-prod-github-runner-207 kernel: [38504.626639] Aug 22 16:05:45 juju-e4d256-prod-github-runner-207 kernel: [38519.756706] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 16:05:45 juju-e4d256-prod-github-runner-207 kernel: [38519.757678] rcu: 1-....: (9570529 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=4627009 Aug 22 16:05:45 juju-e4d256-prod-github-runner-207 kernel: [38519.758800] (t=9600639 jiffies g=23269 q=39646) Aug 22 16:05:45 juju-e4d256-prod-github-runner-207 kernel: [38519.759580] NMI backtrace for cpu 1 Aug 22 16:05:45 juju-e4d256-prod-github-runner-207 kernel: [38519.760289] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 16:05:45 juju-e4d256-prod-github-runner-207 kernel: [38519.761400] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 16:05:45 juju-e4d256-prod-github-runner-207 kernel: [38519.762464] Call Trace: Aug 22 16:05:45 juju-e4d256-prod-github-runner-207 kernel: [38519.763137] Aug 22 16:05:45 juju-e4d256-prod-github-runner-207 kernel: [38519.763780] show_stack+0x52/0x5c Aug 22 16:05:45 juju-e4d256-prod-github-runner-207 kernel: [38519.764506] dump_stack_lvl+0x4a/0x63 Aug 22 16:05:45 juju-e4d256-prod-github-runner-207 kernel: [38519.765261] dump_stack+0x10/0x16 Aug 22 16:05:45 juju-e4d256-prod-github-runner-207 kernel: [38519.765977] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 16:05:45 juju-e4d256-prod-github-runner-207 kernel: [38519.766879] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 16:05:45 juju-e4d256-prod-github-runner-207 kernel: [38519.767657] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 16:05:45 juju-e4d256-prod-github-runner-207 kernel: [38519.768473] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 16:05:45 juju-e4d256-prod-github-runner-207 kernel: [38519.769310] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 16:05:45 juju-e4d256-prod-github-runner-207 kernel: [38519.770116] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 16:05:45 juju-e4d256-prod-github-runner-207 kernel: [38519.770888] print_cpu_stall.cold+0x2f/0xe2 Aug 22 16:05:45 juju-e4d256-prod-github-runner-207 kernel: [38519.771657] ? timekeeping_update+0xf7/0x150 Aug 22 16:05:45 juju-e4d256-prod-github-runner-207 kernel: [38519.772426] check_cpu_stall+0x109/0x270 Aug 22 16:05:45 juju-e4d256-prod-github-runner-207 kernel: [38519.773185] rcu_sched_clock_irq+0x9a/0x250 Aug 22 16:05:45 juju-e4d256-prod-github-runner-207 kernel: [38519.773946] update_process_times+0x94/0xd0 Aug 22 16:05:45 juju-e4d256-prod-github-runner-207 kernel: [38519.774712] tick_sched_handle+0x29/0x70 Aug 22 16:05:45 juju-e4d256-prod-github-runner-207 kernel: [38519.775456] tick_sched_timer+0x8c/0xc0 Aug 22 16:05:45 juju-e4d256-prod-github-runner-207 kernel: [38519.776193] ? tick_nohz_handler+0xb0/0xb0 Aug 22 16:05:45 juju-e4d256-prod-github-runner-207 kernel: [38519.776949] __hrtimer_run_queues+0x107/0x230 Aug 22 16:05:45 juju-e4d256-prod-github-runner-207 kernel: [38519.777736] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 16:05:45 juju-e4d256-prod-github-runner-207 kernel: [38519.778515] hrtimer_interrupt+0x101/0x220 Aug 22 16:05:45 juju-e4d256-prod-github-runner-207 kernel: [38519.779274] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 16:05:45 juju-e4d256-prod-github-runner-207 kernel: [38519.780085] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 16:05:45 juju-e4d256-prod-github-runner-207 kernel: [38519.780890] Aug 22 16:05:45 juju-e4d256-prod-github-runner-207 kernel: [38519.781531] Aug 22 16:05:45 juju-e4d256-prod-github-runner-207 kernel: [38519.782159] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 16:05:45 juju-e4d256-prod-github-runner-207 kernel: [38519.782978] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:05:45 juju-e4d256-prod-github-runner-207 kernel: [38519.783865] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 16:05:45 juju-e4d256-prod-github-runner-207 kernel: [38519.786085] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 16:05:45 juju-e4d256-prod-github-runner-207 kernel: [38519.786957] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 16:05:45 juju-e4d256-prod-github-runner-207 kernel: [38519.787948] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 16:05:45 juju-e4d256-prod-github-runner-207 kernel: [38519.788926] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 16:05:45 juju-e4d256-prod-github-runner-207 kernel: [38519.789904] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 16:05:45 juju-e4d256-prod-github-runner-207 kernel: [38519.790858] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 16:05:45 juju-e4d256-prod-github-runner-207 kernel: [38519.791808] ? _raw_spin_lock+0x22/0x30 Aug 22 16:05:45 juju-e4d256-prod-github-runner-207 kernel: [38519.792566] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:05:45 juju-e4d256-prod-github-runner-207 kernel: [38519.793409] direct_page_fault+0x206/0x310 [kvm] Aug 22 16:05:45 juju-e4d256-prod-github-runner-207 kernel: [38519.794251] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 16:05:45 juju-e4d256-prod-github-runner-207 kernel: [38519.795082] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 16:05:45 juju-e4d256-prod-github-runner-207 kernel: [38519.795901] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 16:05:45 juju-e4d256-prod-github-runner-207 kernel: [38519.796703] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 16:05:45 juju-e4d256-prod-github-runner-207 kernel: [38519.797498] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 16:05:45 juju-e4d256-prod-github-runner-207 kernel: [38519.798321] handle_exit+0x98/0x230 [kvm_amd] Aug 22 16:05:45 juju-e4d256-prod-github-runner-207 kernel: [38519.799077] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 16:05:45 juju-e4d256-prod-github-runner-207 kernel: [38519.799863] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 16:05:45 juju-e4d256-prod-github-runner-207 kernel: [38519.800659] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 16:05:45 juju-e4d256-prod-github-runner-207 kernel: [38519.801454] vcpu_run+0x62/0x2c0 [kvm] Aug 22 16:05:45 juju-e4d256-prod-github-runner-207 kernel: [38519.802170] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 16:05:45 juju-e4d256-prod-github-runner-207 kernel: [38519.802903] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 16:05:45 juju-e4d256-prod-github-runner-207 kernel: [38519.803704] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 16:05:45 juju-e4d256-prod-github-runner-207 kernel: [38519.804465] ? __seccomp_filter+0x4a/0x4a0 Aug 22 16:05:45 juju-e4d256-prod-github-runner-207 kernel: [38519.805194] ? __fget_files+0x86/0xc0 Aug 22 16:05:45 juju-e4d256-prod-github-runner-207 kernel: [38519.805892] __x64_sys_ioctl+0x95/0xd0 Aug 22 16:05:45 juju-e4d256-prod-github-runner-207 kernel: [38519.806586] do_syscall_64+0x5c/0xc0 Aug 22 16:05:45 juju-e4d256-prod-github-runner-207 kernel: [38519.807265] ? do_futex+0x162/0x1f0 Aug 22 16:05:45 juju-e4d256-prod-github-runner-207 kernel: [38519.807948] ? __x64_sys_futex+0x78/0x1e0 Aug 22 16:05:45 juju-e4d256-prod-github-runner-207 kernel: [38519.808650] ? __secure_computing+0xa9/0x120 Aug 22 16:05:45 juju-e4d256-prod-github-runner-207 kernel: [38519.809380] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 16:05:45 juju-e4d256-prod-github-runner-207 kernel: [38519.810175] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:05:45 juju-e4d256-prod-github-runner-207 kernel: [38519.810930] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:05:45 juju-e4d256-prod-github-runner-207 kernel: [38519.811682] ? do_syscall_64+0x69/0xc0 Aug 22 16:05:45 juju-e4d256-prod-github-runner-207 kernel: [38519.812371] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:05:45 juju-e4d256-prod-github-runner-207 kernel: [38519.813132] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:05:45 juju-e4d256-prod-github-runner-207 kernel: [38519.813903] ? do_syscall_64+0x69/0xc0 Aug 22 16:05:45 juju-e4d256-prod-github-runner-207 kernel: [38519.814601] ? do_syscall_64+0x69/0xc0 Aug 22 16:05:45 juju-e4d256-prod-github-runner-207 kernel: [38519.815287] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 16:05:45 juju-e4d256-prod-github-runner-207 kernel: [38519.816062] RIP: 0033:0x7faa5d0edaff Aug 22 16:05:45 juju-e4d256-prod-github-runner-207 kernel: [38519.816744] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 16:05:45 juju-e4d256-prod-github-runner-207 kernel: [38519.818856] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 16:05:45 juju-e4d256-prod-github-runner-207 kernel: [38519.819822] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 16:05:45 juju-e4d256-prod-github-runner-207 kernel: [38519.820770] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 16:05:45 juju-e4d256-prod-github-runner-207 kernel: [38519.821727] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 16:05:45 juju-e4d256-prod-github-runner-207 kernel: [38519.822673] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 16:05:45 juju-e4d256-prod-github-runner-207 kernel: [38519.823599] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 16:05:45 juju-e4d256-prod-github-runner-207 kernel: [38519.824520] Aug 22 16:06:10 juju-e4d256-prod-github-runner-207 kernel: [38544.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 35789s! [qemu-system-x86:6715] Aug 22 16:06:10 juju-e4d256-prod-github-runner-207 kernel: [38544.543151] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 16:06:10 juju-e4d256-prod-github-runner-207 kernel: [38544.543220] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 16:06:10 juju-e4d256-prod-github-runner-207 kernel: [38544.555627] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 16:06:10 juju-e4d256-prod-github-runner-207 kernel: [38544.556927] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 16:06:10 juju-e4d256-prod-github-runner-207 kernel: [38544.558148] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:06:10 juju-e4d256-prod-github-runner-207 kernel: [38544.559206] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 16:06:10 juju-e4d256-prod-github-runner-207 kernel: [38544.561792] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 16:06:10 juju-e4d256-prod-github-runner-207 kernel: [38544.562835] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 16:06:10 juju-e4d256-prod-github-runner-207 kernel: [38544.563999] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 16:06:10 juju-e4d256-prod-github-runner-207 kernel: [38544.565197] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 16:06:10 juju-e4d256-prod-github-runner-207 kernel: [38544.566363] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 16:06:10 juju-e4d256-prod-github-runner-207 kernel: [38544.567526] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 16:06:10 juju-e4d256-prod-github-runner-207 kernel: [38544.568696] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 16:06:10 juju-e4d256-prod-github-runner-207 kernel: [38544.569946] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 16:06:10 juju-e4d256-prod-github-runner-207 kernel: [38544.571061] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 16:06:10 juju-e4d256-prod-github-runner-207 kernel: [38544.572256] Call Trace: Aug 22 16:06:10 juju-e4d256-prod-github-runner-207 kernel: [38544.573217] Aug 22 16:06:10 juju-e4d256-prod-github-runner-207 kernel: [38544.574217] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:06:10 juju-e4d256-prod-github-runner-207 kernel: [38544.575267] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:06:10 juju-e4d256-prod-github-runner-207 kernel: [38544.576323] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:06:10 juju-e4d256-prod-github-runner-207 kernel: [38544.577448] ? show_regs.part.0+0x23/0x29 Aug 22 16:06:10 juju-e4d256-prod-github-runner-207 kernel: [38544.578485] ? show_regs.cold+0x8/0xd Aug 22 16:06:10 juju-e4d256-prod-github-runner-207 kernel: [38544.579470] ? watchdog_timer_fn+0x1be/0x220 Aug 22 16:06:10 juju-e4d256-prod-github-runner-207 kernel: [38544.580477] ? lockup_detector_update_enable+0x60/0x60 Aug 22 16:06:10 juju-e4d256-prod-github-runner-207 kernel: [38544.581603] ? __hrtimer_run_queues+0x107/0x230 Aug 22 16:06:10 juju-e4d256-prod-github-runner-207 kernel: [38544.582637] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 16:06:10 juju-e4d256-prod-github-runner-207 kernel: [38544.583659] ? hrtimer_interrupt+0x101/0x220 Aug 22 16:06:10 juju-e4d256-prod-github-runner-207 kernel: [38544.584671] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 16:06:10 juju-e4d256-prod-github-runner-207 kernel: [38544.585778] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 16:06:10 juju-e4d256-prod-github-runner-207 kernel: [38544.586824] Aug 22 16:06:10 juju-e4d256-prod-github-runner-207 kernel: [38544.587676] Aug 22 16:06:10 juju-e4d256-prod-github-runner-207 kernel: [38544.588517] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 16:06:10 juju-e4d256-prod-github-runner-207 kernel: [38544.589568] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:06:10 juju-e4d256-prod-github-runner-207 kernel: [38544.590606] ? _raw_spin_lock+0x22/0x30 Aug 22 16:06:10 juju-e4d256-prod-github-runner-207 kernel: [38544.591564] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:06:10 juju-e4d256-prod-github-runner-207 kernel: [38544.592592] direct_page_fault+0x206/0x310 [kvm] Aug 22 16:06:10 juju-e4d256-prod-github-runner-207 kernel: [38544.593641] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 16:06:10 juju-e4d256-prod-github-runner-207 kernel: [38544.594649] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 16:06:10 juju-e4d256-prod-github-runner-207 kernel: [38544.595648] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 16:06:10 juju-e4d256-prod-github-runner-207 kernel: [38544.596624] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 16:06:10 juju-e4d256-prod-github-runner-207 kernel: [38544.597604] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 16:06:10 juju-e4d256-prod-github-runner-207 kernel: [38544.598580] handle_exit+0x98/0x230 [kvm_amd] Aug 22 16:06:10 juju-e4d256-prod-github-runner-207 kernel: [38544.599477] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 16:06:10 juju-e4d256-prod-github-runner-207 kernel: [38544.600389] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 16:06:10 juju-e4d256-prod-github-runner-207 kernel: [38544.601351] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 16:06:10 juju-e4d256-prod-github-runner-207 kernel: [38544.602260] vcpu_run+0x62/0x2c0 [kvm] Aug 22 16:06:10 juju-e4d256-prod-github-runner-207 kernel: [38544.603103] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 16:06:10 juju-e4d256-prod-github-runner-207 kernel: [38544.603911] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 16:06:10 juju-e4d256-prod-github-runner-207 kernel: [38544.604763] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 16:06:10 juju-e4d256-prod-github-runner-207 kernel: [38544.605572] ? __seccomp_filter+0x4a/0x4a0 Aug 22 16:06:10 juju-e4d256-prod-github-runner-207 kernel: [38544.606314] ? __fget_files+0x86/0xc0 Aug 22 16:06:10 juju-e4d256-prod-github-runner-207 kernel: [38544.607059] __x64_sys_ioctl+0x95/0xd0 Aug 22 16:06:10 juju-e4d256-prod-github-runner-207 kernel: [38544.607757] do_syscall_64+0x5c/0xc0 Aug 22 16:06:10 juju-e4d256-prod-github-runner-207 kernel: [38544.608419] ? do_futex+0x162/0x1f0 Aug 22 16:06:10 juju-e4d256-prod-github-runner-207 kernel: [38544.609086] ? __x64_sys_futex+0x78/0x1e0 Aug 22 16:06:10 juju-e4d256-prod-github-runner-207 kernel: [38544.609758] ? __secure_computing+0xa9/0x120 Aug 22 16:06:10 juju-e4d256-prod-github-runner-207 kernel: [38544.610445] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 16:06:10 juju-e4d256-prod-github-runner-207 kernel: [38544.611211] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:06:10 juju-e4d256-prod-github-runner-207 kernel: [38544.611956] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:06:10 juju-e4d256-prod-github-runner-207 kernel: [38544.612675] ? do_syscall_64+0x69/0xc0 Aug 22 16:06:10 juju-e4d256-prod-github-runner-207 kernel: [38544.613344] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:06:10 juju-e4d256-prod-github-runner-207 kernel: [38544.614046] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:06:10 juju-e4d256-prod-github-runner-207 kernel: [38544.614740] ? do_syscall_64+0x69/0xc0 Aug 22 16:06:10 juju-e4d256-prod-github-runner-207 kernel: [38544.615366] ? do_syscall_64+0x69/0xc0 Aug 22 16:06:10 juju-e4d256-prod-github-runner-207 kernel: [38544.615987] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 16:06:10 juju-e4d256-prod-github-runner-207 kernel: [38544.616702] RIP: 0033:0x7faa5d0edaff Aug 22 16:06:10 juju-e4d256-prod-github-runner-207 kernel: [38544.617360] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 16:06:10 juju-e4d256-prod-github-runner-207 kernel: [38544.619336] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 16:06:10 juju-e4d256-prod-github-runner-207 kernel: [38544.620245] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 16:06:10 juju-e4d256-prod-github-runner-207 kernel: [38544.621144] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 16:06:10 juju-e4d256-prod-github-runner-207 kernel: [38544.622037] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 16:06:10 juju-e4d256-prod-github-runner-207 kernel: [38544.622923] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 16:06:10 juju-e4d256-prod-github-runner-207 kernel: [38544.623809] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 16:06:10 juju-e4d256-prod-github-runner-207 kernel: [38544.624698] Aug 22 16:06:38 juju-e4d256-prod-github-runner-207 kernel: [38572.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 35815s! [qemu-system-x86:6715] Aug 22 16:06:38 juju-e4d256-prod-github-runner-207 kernel: [38572.543133] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 16:06:38 juju-e4d256-prod-github-runner-207 kernel: [38572.543201] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 16:06:38 juju-e4d256-prod-github-runner-207 kernel: [38572.555287] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 16:06:38 juju-e4d256-prod-github-runner-207 kernel: [38572.556556] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 16:06:38 juju-e4d256-prod-github-runner-207 kernel: [38572.557791] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:06:38 juju-e4d256-prod-github-runner-207 kernel: [38572.558851] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 16:06:38 juju-e4d256-prod-github-runner-207 kernel: [38572.561415] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 16:06:38 juju-e4d256-prod-github-runner-207 kernel: [38572.562463] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 16:06:38 juju-e4d256-prod-github-runner-207 kernel: [38572.563640] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 16:06:38 juju-e4d256-prod-github-runner-207 kernel: [38572.564832] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 16:06:38 juju-e4d256-prod-github-runner-207 kernel: [38572.566001] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 16:06:38 juju-e4d256-prod-github-runner-207 kernel: [38572.567185] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 16:06:38 juju-e4d256-prod-github-runner-207 kernel: [38572.568349] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 16:06:38 juju-e4d256-prod-github-runner-207 kernel: [38572.569602] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 16:06:38 juju-e4d256-prod-github-runner-207 kernel: [38572.570706] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 16:06:38 juju-e4d256-prod-github-runner-207 kernel: [38572.572060] Call Trace: Aug 22 16:06:38 juju-e4d256-prod-github-runner-207 kernel: [38572.573030] Aug 22 16:06:38 juju-e4d256-prod-github-runner-207 kernel: [38572.573920] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:06:38 juju-e4d256-prod-github-runner-207 kernel: [38572.574954] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:06:38 juju-e4d256-prod-github-runner-207 kernel: [38572.575980] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:06:38 juju-e4d256-prod-github-runner-207 kernel: [38572.577074] ? show_regs.part.0+0x23/0x29 Aug 22 16:06:38 juju-e4d256-prod-github-runner-207 kernel: [38572.578078] ? show_regs.cold+0x8/0xd Aug 22 16:06:38 juju-e4d256-prod-github-runner-207 kernel: [38572.579049] ? watchdog_timer_fn+0x1be/0x220 Aug 22 16:06:38 juju-e4d256-prod-github-runner-207 kernel: [38572.580058] ? lockup_detector_update_enable+0x60/0x60 Aug 22 16:06:38 juju-e4d256-prod-github-runner-207 kernel: [38572.581142] ? __hrtimer_run_queues+0x107/0x230 Aug 22 16:06:38 juju-e4d256-prod-github-runner-207 kernel: [38572.582175] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 16:06:38 juju-e4d256-prod-github-runner-207 kernel: [38572.583202] ? hrtimer_interrupt+0x101/0x220 Aug 22 16:06:38 juju-e4d256-prod-github-runner-207 kernel: [38572.584223] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 16:06:38 juju-e4d256-prod-github-runner-207 kernel: [38572.585347] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 16:06:38 juju-e4d256-prod-github-runner-207 kernel: [38572.586402] Aug 22 16:06:38 juju-e4d256-prod-github-runner-207 kernel: [38572.587253] Aug 22 16:06:38 juju-e4d256-prod-github-runner-207 kernel: [38572.588089] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 16:06:38 juju-e4d256-prod-github-runner-207 kernel: [38572.589133] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:06:38 juju-e4d256-prod-github-runner-207 kernel: [38572.590170] ? _raw_spin_lock+0x22/0x30 Aug 22 16:06:38 juju-e4d256-prod-github-runner-207 kernel: [38572.591117] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:06:38 juju-e4d256-prod-github-runner-207 kernel: [38572.592136] direct_page_fault+0x206/0x310 [kvm] Aug 22 16:06:38 juju-e4d256-prod-github-runner-207 kernel: [38572.593166] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 16:06:38 juju-e4d256-prod-github-runner-207 kernel: [38572.594178] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 16:06:38 juju-e4d256-prod-github-runner-207 kernel: [38572.595177] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 16:06:38 juju-e4d256-prod-github-runner-207 kernel: [38572.596149] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 16:06:38 juju-e4d256-prod-github-runner-207 kernel: [38572.597113] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 16:06:38 juju-e4d256-prod-github-runner-207 kernel: [38572.598089] handle_exit+0x98/0x230 [kvm_amd] Aug 22 16:06:38 juju-e4d256-prod-github-runner-207 kernel: [38572.598979] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 16:06:38 juju-e4d256-prod-github-runner-207 kernel: [38572.599894] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 16:06:38 juju-e4d256-prod-github-runner-207 kernel: [38572.600864] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 16:06:38 juju-e4d256-prod-github-runner-207 kernel: [38572.601792] vcpu_run+0x62/0x2c0 [kvm] Aug 22 16:06:38 juju-e4d256-prod-github-runner-207 kernel: [38572.602603] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 16:06:38 juju-e4d256-prod-github-runner-207 kernel: [38572.603436] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 16:06:38 juju-e4d256-prod-github-runner-207 kernel: [38572.604293] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 16:06:38 juju-e4d256-prod-github-runner-207 kernel: [38572.605110] ? __seccomp_filter+0x4a/0x4a0 Aug 22 16:06:38 juju-e4d256-prod-github-runner-207 kernel: [38572.605851] ? __fget_files+0x86/0xc0 Aug 22 16:06:38 juju-e4d256-prod-github-runner-207 kernel: [38572.606558] __x64_sys_ioctl+0x95/0xd0 Aug 22 16:06:38 juju-e4d256-prod-github-runner-207 kernel: [38572.607247] do_syscall_64+0x5c/0xc0 Aug 22 16:06:38 juju-e4d256-prod-github-runner-207 kernel: [38572.607909] ? do_futex+0x162/0x1f0 Aug 22 16:06:38 juju-e4d256-prod-github-runner-207 kernel: [38572.608554] ? __x64_sys_futex+0x78/0x1e0 Aug 22 16:06:38 juju-e4d256-prod-github-runner-207 kernel: [38572.609243] ? __secure_computing+0xa9/0x120 Aug 22 16:06:38 juju-e4d256-prod-github-runner-207 kernel: [38572.609932] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 16:06:38 juju-e4d256-prod-github-runner-207 kernel: [38572.610690] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:06:38 juju-e4d256-prod-github-runner-207 kernel: [38572.611410] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:06:38 juju-e4d256-prod-github-runner-207 kernel: [38572.612125] ? do_syscall_64+0x69/0xc0 Aug 22 16:06:38 juju-e4d256-prod-github-runner-207 kernel: [38572.612786] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:06:38 juju-e4d256-prod-github-runner-207 kernel: [38572.613489] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:06:38 juju-e4d256-prod-github-runner-207 kernel: [38572.614182] ? do_syscall_64+0x69/0xc0 Aug 22 16:06:38 juju-e4d256-prod-github-runner-207 kernel: [38572.614805] ? do_syscall_64+0x69/0xc0 Aug 22 16:06:38 juju-e4d256-prod-github-runner-207 kernel: [38572.615453] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 16:06:38 juju-e4d256-prod-github-runner-207 kernel: [38572.616169] RIP: 0033:0x7faa5d0edaff Aug 22 16:06:38 juju-e4d256-prod-github-runner-207 kernel: [38572.616805] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 16:06:38 juju-e4d256-prod-github-runner-207 kernel: [38572.618796] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 16:06:38 juju-e4d256-prod-github-runner-207 kernel: [38572.619711] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 16:06:38 juju-e4d256-prod-github-runner-207 kernel: [38572.620614] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 16:06:38 juju-e4d256-prod-github-runner-207 kernel: [38572.621503] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 16:06:38 juju-e4d256-prod-github-runner-207 kernel: [38572.622390] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 16:06:38 juju-e4d256-prod-github-runner-207 kernel: [38572.623277] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 16:06:38 juju-e4d256-prod-github-runner-207 kernel: [38572.624169] Aug 22 16:07:06 juju-e4d256-prod-github-runner-207 kernel: [38600.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 35841s! [qemu-system-x86:6715] Aug 22 16:07:06 juju-e4d256-prod-github-runner-207 kernel: [38600.543706] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 16:07:06 juju-e4d256-prod-github-runner-207 kernel: [38600.543952] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 16:07:06 juju-e4d256-prod-github-runner-207 kernel: [38600.555999] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 16:07:06 juju-e4d256-prod-github-runner-207 kernel: [38600.557278] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 16:07:06 juju-e4d256-prod-github-runner-207 kernel: [38600.558504] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:07:06 juju-e4d256-prod-github-runner-207 kernel: [38600.559560] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 16:07:06 juju-e4d256-prod-github-runner-207 kernel: [38600.562134] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 16:07:06 juju-e4d256-prod-github-runner-207 kernel: [38600.563174] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 16:07:06 juju-e4d256-prod-github-runner-207 kernel: [38600.564348] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 16:07:06 juju-e4d256-prod-github-runner-207 kernel: [38600.565505] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 16:07:06 juju-e4d256-prod-github-runner-207 kernel: [38600.566660] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 16:07:06 juju-e4d256-prod-github-runner-207 kernel: [38600.567824] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 16:07:06 juju-e4d256-prod-github-runner-207 kernel: [38600.569014] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 16:07:06 juju-e4d256-prod-github-runner-207 kernel: [38600.570243] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 16:07:06 juju-e4d256-prod-github-runner-207 kernel: [38600.571343] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 16:07:06 juju-e4d256-prod-github-runner-207 kernel: [38600.572548] Call Trace: Aug 22 16:07:06 juju-e4d256-prod-github-runner-207 kernel: [38600.573466] Aug 22 16:07:06 juju-e4d256-prod-github-runner-207 kernel: [38600.574357] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:07:06 juju-e4d256-prod-github-runner-207 kernel: [38600.575389] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:07:06 juju-e4d256-prod-github-runner-207 kernel: [38600.576431] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:07:06 juju-e4d256-prod-github-runner-207 kernel: [38600.577519] ? show_regs.part.0+0x23/0x29 Aug 22 16:07:06 juju-e4d256-prod-github-runner-207 kernel: [38600.578514] ? show_regs.cold+0x8/0xd Aug 22 16:07:06 juju-e4d256-prod-github-runner-207 kernel: [38600.579488] ? watchdog_timer_fn+0x1be/0x220 Aug 22 16:07:06 juju-e4d256-prod-github-runner-207 kernel: [38600.580509] ? lockup_detector_update_enable+0x60/0x60 Aug 22 16:07:06 juju-e4d256-prod-github-runner-207 kernel: [38600.581584] ? __hrtimer_run_queues+0x107/0x230 Aug 22 16:07:06 juju-e4d256-prod-github-runner-207 kernel: [38600.582615] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 16:07:06 juju-e4d256-prod-github-runner-207 kernel: [38600.583636] ? hrtimer_interrupt+0x101/0x220 Aug 22 16:07:06 juju-e4d256-prod-github-runner-207 kernel: [38600.584665] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 16:07:06 juju-e4d256-prod-github-runner-207 kernel: [38600.585738] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 16:07:06 juju-e4d256-prod-github-runner-207 kernel: [38600.586782] Aug 22 16:07:06 juju-e4d256-prod-github-runner-207 kernel: [38600.587638] Aug 22 16:07:06 juju-e4d256-prod-github-runner-207 kernel: [38600.588496] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 16:07:06 juju-e4d256-prod-github-runner-207 kernel: [38600.589534] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:07:06 juju-e4d256-prod-github-runner-207 kernel: [38600.590572] ? _raw_spin_lock+0x22/0x30 Aug 22 16:07:06 juju-e4d256-prod-github-runner-207 kernel: [38600.591514] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:07:06 juju-e4d256-prod-github-runner-207 kernel: [38600.592550] direct_page_fault+0x206/0x310 [kvm] Aug 22 16:07:06 juju-e4d256-prod-github-runner-207 kernel: [38600.593573] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 16:07:06 juju-e4d256-prod-github-runner-207 kernel: [38600.594578] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 16:07:06 juju-e4d256-prod-github-runner-207 kernel: [38600.595579] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 16:07:06 juju-e4d256-prod-github-runner-207 kernel: [38600.596719] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 16:07:06 juju-e4d256-prod-github-runner-207 kernel: [38600.597805] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 16:07:06 juju-e4d256-prod-github-runner-207 kernel: [38600.598785] handle_exit+0x98/0x230 [kvm_amd] Aug 22 16:07:06 juju-e4d256-prod-github-runner-207 kernel: [38600.599677] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 16:07:06 juju-e4d256-prod-github-runner-207 kernel: [38600.600629] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 16:07:06 juju-e4d256-prod-github-runner-207 kernel: [38600.601558] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 16:07:06 juju-e4d256-prod-github-runner-207 kernel: [38600.602458] vcpu_run+0x62/0x2c0 [kvm] Aug 22 16:07:06 juju-e4d256-prod-github-runner-207 kernel: [38600.603265] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 16:07:06 juju-e4d256-prod-github-runner-207 kernel: [38600.604070] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 16:07:06 juju-e4d256-prod-github-runner-207 kernel: [38600.604933] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 16:07:06 juju-e4d256-prod-github-runner-207 kernel: [38600.605731] ? __seccomp_filter+0x4a/0x4a0 Aug 22 16:07:06 juju-e4d256-prod-github-runner-207 kernel: [38600.606469] ? __fget_files+0x86/0xc0 Aug 22 16:07:06 juju-e4d256-prod-github-runner-207 kernel: [38600.607168] __x64_sys_ioctl+0x95/0xd0 Aug 22 16:07:06 juju-e4d256-prod-github-runner-207 kernel: [38600.607857] do_syscall_64+0x5c/0xc0 Aug 22 16:07:06 juju-e4d256-prod-github-runner-207 kernel: [38600.608536] ? do_futex+0x162/0x1f0 Aug 22 16:07:06 juju-e4d256-prod-github-runner-207 kernel: [38600.609184] ? __x64_sys_futex+0x78/0x1e0 Aug 22 16:07:06 juju-e4d256-prod-github-runner-207 kernel: [38600.609854] ? __secure_computing+0xa9/0x120 Aug 22 16:07:06 juju-e4d256-prod-github-runner-207 kernel: [38600.610543] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 16:07:06 juju-e4d256-prod-github-runner-207 kernel: [38600.611303] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:07:06 juju-e4d256-prod-github-runner-207 kernel: [38600.612022] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:07:06 juju-e4d256-prod-github-runner-207 kernel: [38600.612753] ? do_syscall_64+0x69/0xc0 Aug 22 16:07:06 juju-e4d256-prod-github-runner-207 kernel: [38600.613395] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:07:06 juju-e4d256-prod-github-runner-207 kernel: [38600.614095] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:07:06 juju-e4d256-prod-github-runner-207 kernel: [38600.614793] ? do_syscall_64+0x69/0xc0 Aug 22 16:07:06 juju-e4d256-prod-github-runner-207 kernel: [38600.615420] ? do_syscall_64+0x69/0xc0 Aug 22 16:07:06 juju-e4d256-prod-github-runner-207 kernel: [38600.616040] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 16:07:06 juju-e4d256-prod-github-runner-207 kernel: [38600.616759] RIP: 0033:0x7faa5d0edaff Aug 22 16:07:06 juju-e4d256-prod-github-runner-207 kernel: [38600.617411] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 16:07:06 juju-e4d256-prod-github-runner-207 kernel: [38600.619384] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 16:07:06 juju-e4d256-prod-github-runner-207 kernel: [38600.620299] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 16:07:06 juju-e4d256-prod-github-runner-207 kernel: [38600.621185] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 16:07:06 juju-e4d256-prod-github-runner-207 kernel: [38600.622070] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 16:07:06 juju-e4d256-prod-github-runner-207 kernel: [38600.622950] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 16:07:06 juju-e4d256-prod-github-runner-207 kernel: [38600.623830] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 16:07:06 juju-e4d256-prod-github-runner-207 kernel: [38600.624732] Aug 22 16:07:34 juju-e4d256-prod-github-runner-207 kernel: [38628.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 35867s! [qemu-system-x86:6715] Aug 22 16:07:34 juju-e4d256-prod-github-runner-207 kernel: [38628.543099] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 16:07:34 juju-e4d256-prod-github-runner-207 kernel: [38628.543167] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 16:07:34 juju-e4d256-prod-github-runner-207 kernel: [38628.555303] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 16:07:34 juju-e4d256-prod-github-runner-207 kernel: [38628.556584] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 16:07:34 juju-e4d256-prod-github-runner-207 kernel: [38628.557804] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:07:34 juju-e4d256-prod-github-runner-207 kernel: [38628.558859] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 16:07:34 juju-e4d256-prod-github-runner-207 kernel: [38628.561426] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 16:07:34 juju-e4d256-prod-github-runner-207 kernel: [38628.562468] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 16:07:34 juju-e4d256-prod-github-runner-207 kernel: [38628.563630] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 16:07:34 juju-e4d256-prod-github-runner-207 kernel: [38628.564874] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 16:07:34 juju-e4d256-prod-github-runner-207 kernel: [38628.566046] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 16:07:34 juju-e4d256-prod-github-runner-207 kernel: [38628.567204] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 16:07:34 juju-e4d256-prod-github-runner-207 kernel: [38628.568400] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 16:07:34 juju-e4d256-prod-github-runner-207 kernel: [38628.569630] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 16:07:34 juju-e4d256-prod-github-runner-207 kernel: [38628.570722] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 16:07:34 juju-e4d256-prod-github-runner-207 kernel: [38628.571928] Call Trace: Aug 22 16:07:34 juju-e4d256-prod-github-runner-207 kernel: [38628.572839] Aug 22 16:07:34 juju-e4d256-prod-github-runner-207 kernel: [38628.573719] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:07:34 juju-e4d256-prod-github-runner-207 kernel: [38628.574746] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:07:34 juju-e4d256-prod-github-runner-207 kernel: [38628.575763] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:07:34 juju-e4d256-prod-github-runner-207 kernel: [38628.576852] ? show_regs.part.0+0x23/0x29 Aug 22 16:07:34 juju-e4d256-prod-github-runner-207 kernel: [38628.577845] ? show_regs.cold+0x8/0xd Aug 22 16:07:34 juju-e4d256-prod-github-runner-207 kernel: [38628.578815] ? watchdog_timer_fn+0x1be/0x220 Aug 22 16:07:34 juju-e4d256-prod-github-runner-207 kernel: [38628.579824] ? lockup_detector_update_enable+0x60/0x60 Aug 22 16:07:34 juju-e4d256-prod-github-runner-207 kernel: [38628.580902] ? __hrtimer_run_queues+0x107/0x230 Aug 22 16:07:34 juju-e4d256-prod-github-runner-207 kernel: [38628.581931] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 16:07:34 juju-e4d256-prod-github-runner-207 kernel: [38628.582952] ? hrtimer_interrupt+0x101/0x220 Aug 22 16:07:34 juju-e4d256-prod-github-runner-207 kernel: [38628.583981] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 16:07:34 juju-e4d256-prod-github-runner-207 kernel: [38628.585046] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 16:07:34 juju-e4d256-prod-github-runner-207 kernel: [38628.586102] Aug 22 16:07:34 juju-e4d256-prod-github-runner-207 kernel: [38628.586958] Aug 22 16:07:34 juju-e4d256-prod-github-runner-207 kernel: [38628.587792] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 16:07:34 juju-e4d256-prod-github-runner-207 kernel: [38628.588872] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:07:34 juju-e4d256-prod-github-runner-207 kernel: [38628.589960] ? _raw_spin_lock+0x22/0x30 Aug 22 16:07:34 juju-e4d256-prod-github-runner-207 kernel: [38628.590915] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:07:34 juju-e4d256-prod-github-runner-207 kernel: [38628.591950] direct_page_fault+0x206/0x310 [kvm] Aug 22 16:07:34 juju-e4d256-prod-github-runner-207 kernel: [38628.592974] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 16:07:34 juju-e4d256-prod-github-runner-207 kernel: [38628.593981] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 16:07:34 juju-e4d256-prod-github-runner-207 kernel: [38628.595046] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 16:07:34 juju-e4d256-prod-github-runner-207 kernel: [38628.596042] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 16:07:34 juju-e4d256-prod-github-runner-207 kernel: [38628.596988] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 16:07:34 juju-e4d256-prod-github-runner-207 kernel: [38628.597964] handle_exit+0x98/0x230 [kvm_amd] Aug 22 16:07:34 juju-e4d256-prod-github-runner-207 kernel: [38628.598885] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 16:07:34 juju-e4d256-prod-github-runner-207 kernel: [38628.599803] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 16:07:34 juju-e4d256-prod-github-runner-207 kernel: [38628.600741] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 16:07:34 juju-e4d256-prod-github-runner-207 kernel: [38628.601650] vcpu_run+0x62/0x2c0 [kvm] Aug 22 16:07:34 juju-e4d256-prod-github-runner-207 kernel: [38628.602462] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 16:07:34 juju-e4d256-prod-github-runner-207 kernel: [38628.603269] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 16:07:34 juju-e4d256-prod-github-runner-207 kernel: [38628.604132] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 16:07:34 juju-e4d256-prod-github-runner-207 kernel: [38628.604934] ? __seccomp_filter+0x4a/0x4a0 Aug 22 16:07:34 juju-e4d256-prod-github-runner-207 kernel: [38628.605683] ? __fget_files+0x86/0xc0 Aug 22 16:07:34 juju-e4d256-prod-github-runner-207 kernel: [38628.606389] __x64_sys_ioctl+0x95/0xd0 Aug 22 16:07:34 juju-e4d256-prod-github-runner-207 kernel: [38628.607081] do_syscall_64+0x5c/0xc0 Aug 22 16:07:34 juju-e4d256-prod-github-runner-207 kernel: [38628.607747] ? do_futex+0x162/0x1f0 Aug 22 16:07:34 juju-e4d256-prod-github-runner-207 kernel: [38628.608407] ? __x64_sys_futex+0x78/0x1e0 Aug 22 16:07:34 juju-e4d256-prod-github-runner-207 kernel: [38628.609085] ? __secure_computing+0xa9/0x120 Aug 22 16:07:34 juju-e4d256-prod-github-runner-207 kernel: [38628.609773] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 16:07:34 juju-e4d256-prod-github-runner-207 kernel: [38628.610531] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:07:34 juju-e4d256-prod-github-runner-207 kernel: [38628.611251] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:07:34 juju-e4d256-prod-github-runner-207 kernel: [38628.611985] ? do_syscall_64+0x69/0xc0 Aug 22 16:07:34 juju-e4d256-prod-github-runner-207 kernel: [38628.612635] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:07:34 juju-e4d256-prod-github-runner-207 kernel: [38628.613338] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:07:34 juju-e4d256-prod-github-runner-207 kernel: [38628.614032] ? do_syscall_64+0x69/0xc0 Aug 22 16:07:34 juju-e4d256-prod-github-runner-207 kernel: [38628.614655] ? do_syscall_64+0x69/0xc0 Aug 22 16:07:34 juju-e4d256-prod-github-runner-207 kernel: [38628.615275] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 16:07:34 juju-e4d256-prod-github-runner-207 kernel: [38628.615992] RIP: 0033:0x7faa5d0edaff Aug 22 16:07:34 juju-e4d256-prod-github-runner-207 kernel: [38628.616615] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 16:07:34 juju-e4d256-prod-github-runner-207 kernel: [38628.618606] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 16:07:34 juju-e4d256-prod-github-runner-207 kernel: [38628.619516] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 16:07:34 juju-e4d256-prod-github-runner-207 kernel: [38628.620429] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 16:07:34 juju-e4d256-prod-github-runner-207 kernel: [38628.621320] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 16:07:34 juju-e4d256-prod-github-runner-207 kernel: [38628.622212] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 16:07:34 juju-e4d256-prod-github-runner-207 kernel: [38628.623104] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 16:07:34 juju-e4d256-prod-github-runner-207 kernel: [38628.624009] Aug 22 16:08:02 juju-e4d256-prod-github-runner-207 kernel: [38656.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 35893s! [qemu-system-x86:6715] Aug 22 16:08:02 juju-e4d256-prod-github-runner-207 kernel: [38656.543107] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 16:08:02 juju-e4d256-prod-github-runner-207 kernel: [38656.543174] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 16:08:02 juju-e4d256-prod-github-runner-207 kernel: [38656.555337] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 16:08:02 juju-e4d256-prod-github-runner-207 kernel: [38656.556624] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 16:08:02 juju-e4d256-prod-github-runner-207 kernel: [38656.557859] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:08:02 juju-e4d256-prod-github-runner-207 kernel: [38656.558919] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 16:08:02 juju-e4d256-prod-github-runner-207 kernel: [38656.561496] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 16:08:02 juju-e4d256-prod-github-runner-207 kernel: [38656.562539] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 16:08:02 juju-e4d256-prod-github-runner-207 kernel: [38656.563719] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 16:08:02 juju-e4d256-prod-github-runner-207 kernel: [38656.564883] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 16:08:02 juju-e4d256-prod-github-runner-207 kernel: [38656.566048] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 16:08:02 juju-e4d256-prod-github-runner-207 kernel: [38656.567212] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 16:08:02 juju-e4d256-prod-github-runner-207 kernel: [38656.568394] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 16:08:02 juju-e4d256-prod-github-runner-207 kernel: [38656.569622] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 16:08:02 juju-e4d256-prod-github-runner-207 kernel: [38656.570716] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 16:08:02 juju-e4d256-prod-github-runner-207 kernel: [38656.571929] Call Trace: Aug 22 16:08:02 juju-e4d256-prod-github-runner-207 kernel: [38656.574989] Aug 22 16:08:02 juju-e4d256-prod-github-runner-207 kernel: [38656.576052] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:08:02 juju-e4d256-prod-github-runner-207 kernel: [38656.577080] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:08:02 juju-e4d256-prod-github-runner-207 kernel: [38656.578165] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:08:02 juju-e4d256-prod-github-runner-207 kernel: [38656.579236] ? show_regs.part.0+0x23/0x29 Aug 22 16:08:02 juju-e4d256-prod-github-runner-207 kernel: [38656.580255] ? show_regs.cold+0x8/0xd Aug 22 16:08:02 juju-e4d256-prod-github-runner-207 kernel: [38656.581225] ? watchdog_timer_fn+0x1be/0x220 Aug 22 16:08:02 juju-e4d256-prod-github-runner-207 kernel: [38656.582230] ? lockup_detector_update_enable+0x60/0x60 Aug 22 16:08:02 juju-e4d256-prod-github-runner-207 kernel: [38656.583296] ? __hrtimer_run_queues+0x107/0x230 Aug 22 16:08:02 juju-e4d256-prod-github-runner-207 kernel: [38656.584338] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 16:08:02 juju-e4d256-prod-github-runner-207 kernel: [38656.585360] ? hrtimer_interrupt+0x101/0x220 Aug 22 16:08:02 juju-e4d256-prod-github-runner-207 kernel: [38656.586377] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 16:08:02 juju-e4d256-prod-github-runner-207 kernel: [38656.587443] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 16:08:02 juju-e4d256-prod-github-runner-207 kernel: [38656.588503] Aug 22 16:08:02 juju-e4d256-prod-github-runner-207 kernel: [38656.589354] Aug 22 16:08:02 juju-e4d256-prod-github-runner-207 kernel: [38656.590189] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 16:08:02 juju-e4d256-prod-github-runner-207 kernel: [38656.591219] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:08:02 juju-e4d256-prod-github-runner-207 kernel: [38656.592267] ? _raw_spin_lock+0x22/0x30 Aug 22 16:08:02 juju-e4d256-prod-github-runner-207 kernel: [38656.593214] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:08:02 juju-e4d256-prod-github-runner-207 kernel: [38656.594225] direct_page_fault+0x206/0x310 [kvm] Aug 22 16:08:02 juju-e4d256-prod-github-runner-207 kernel: [38656.595245] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 16:08:02 juju-e4d256-prod-github-runner-207 kernel: [38656.596266] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 16:08:02 juju-e4d256-prod-github-runner-207 kernel: [38656.597279] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 16:08:02 juju-e4d256-prod-github-runner-207 kernel: [38656.598245] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 16:08:02 juju-e4d256-prod-github-runner-207 kernel: [38656.599198] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 16:08:02 juju-e4d256-prod-github-runner-207 kernel: [38656.600197] handle_exit+0x98/0x230 [kvm_amd] Aug 22 16:08:02 juju-e4d256-prod-github-runner-207 kernel: [38656.601088] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 16:08:02 juju-e4d256-prod-github-runner-207 kernel: [38656.601999] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 16:08:02 juju-e4d256-prod-github-runner-207 kernel: [38656.602919] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 16:08:02 juju-e4d256-prod-github-runner-207 kernel: [38656.603833] vcpu_run+0x62/0x2c0 [kvm] Aug 22 16:08:02 juju-e4d256-prod-github-runner-207 kernel: [38656.604642] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 16:08:02 juju-e4d256-prod-github-runner-207 kernel: [38656.605445] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 16:08:02 juju-e4d256-prod-github-runner-207 kernel: [38656.606299] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 16:08:02 juju-e4d256-prod-github-runner-207 kernel: [38656.607092] ? __seccomp_filter+0x4a/0x4a0 Aug 22 16:08:02 juju-e4d256-prod-github-runner-207 kernel: [38656.607847] ? __fget_files+0x86/0xc0 Aug 22 16:08:02 juju-e4d256-prod-github-runner-207 kernel: [38656.608548] __x64_sys_ioctl+0x95/0xd0 Aug 22 16:08:02 juju-e4d256-prod-github-runner-207 kernel: [38656.609251] do_syscall_64+0x5c/0xc0 Aug 22 16:08:02 juju-e4d256-prod-github-runner-207 kernel: [38656.609911] ? do_futex+0x162/0x1f0 Aug 22 16:08:02 juju-e4d256-prod-github-runner-207 kernel: [38656.610555] ? __x64_sys_futex+0x78/0x1e0 Aug 22 16:08:02 juju-e4d256-prod-github-runner-207 kernel: [38656.611225] ? __secure_computing+0xa9/0x120 Aug 22 16:08:02 juju-e4d256-prod-github-runner-207 kernel: [38656.611961] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 16:08:02 juju-e4d256-prod-github-runner-207 kernel: [38656.612719] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:08:02 juju-e4d256-prod-github-runner-207 kernel: [38656.613441] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:08:02 juju-e4d256-prod-github-runner-207 kernel: [38656.614155] ? do_syscall_64+0x69/0xc0 Aug 22 16:08:02 juju-e4d256-prod-github-runner-207 kernel: [38656.614797] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:08:02 juju-e4d256-prod-github-runner-207 kernel: [38656.615504] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:08:02 juju-e4d256-prod-github-runner-207 kernel: [38656.616205] ? do_syscall_64+0x69/0xc0 Aug 22 16:08:02 juju-e4d256-prod-github-runner-207 kernel: [38656.616826] ? do_syscall_64+0x69/0xc0 Aug 22 16:08:02 juju-e4d256-prod-github-runner-207 kernel: [38656.617445] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 16:08:02 juju-e4d256-prod-github-runner-207 kernel: [38656.618151] RIP: 0033:0x7faa5d0edaff Aug 22 16:08:02 juju-e4d256-prod-github-runner-207 kernel: [38656.618771] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 16:08:02 juju-e4d256-prod-github-runner-207 kernel: [38656.620766] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 16:08:02 juju-e4d256-prod-github-runner-207 kernel: [38656.621675] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 16:08:02 juju-e4d256-prod-github-runner-207 kernel: [38656.622567] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 16:08:02 juju-e4d256-prod-github-runner-207 kernel: [38656.623454] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 16:08:02 juju-e4d256-prod-github-runner-207 kernel: [38656.624348] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 16:08:02 juju-e4d256-prod-github-runner-207 kernel: [38656.625240] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 16:08:02 juju-e4d256-prod-github-runner-207 kernel: [38656.626133] Aug 22 16:08:30 juju-e4d256-prod-github-runner-207 kernel: [38684.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 35919s! [qemu-system-x86:6715] Aug 22 16:08:30 juju-e4d256-prod-github-runner-207 kernel: [38684.543712] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 16:08:30 juju-e4d256-prod-github-runner-207 kernel: [38684.543955] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 16:08:30 juju-e4d256-prod-github-runner-207 kernel: [38684.556081] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 16:08:30 juju-e4d256-prod-github-runner-207 kernel: [38684.557348] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 16:08:30 juju-e4d256-prod-github-runner-207 kernel: [38684.558571] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:08:30 juju-e4d256-prod-github-runner-207 kernel: [38684.559645] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 16:08:30 juju-e4d256-prod-github-runner-207 kernel: [38684.562192] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 16:08:30 juju-e4d256-prod-github-runner-207 kernel: [38684.563237] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 16:08:30 juju-e4d256-prod-github-runner-207 kernel: [38684.564411] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 16:08:30 juju-e4d256-prod-github-runner-207 kernel: [38684.565574] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 16:08:30 juju-e4d256-prod-github-runner-207 kernel: [38684.566752] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 16:08:30 juju-e4d256-prod-github-runner-207 kernel: [38684.567935] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 16:08:30 juju-e4d256-prod-github-runner-207 kernel: [38684.569103] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 16:08:30 juju-e4d256-prod-github-runner-207 kernel: [38684.570334] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 16:08:30 juju-e4d256-prod-github-runner-207 kernel: [38684.571445] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 16:08:30 juju-e4d256-prod-github-runner-207 kernel: [38684.572638] Call Trace: Aug 22 16:08:30 juju-e4d256-prod-github-runner-207 kernel: [38684.573555] Aug 22 16:08:30 juju-e4d256-prod-github-runner-207 kernel: [38684.574454] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:08:30 juju-e4d256-prod-github-runner-207 kernel: [38684.575530] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:08:30 juju-e4d256-prod-github-runner-207 kernel: [38684.576561] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:08:30 juju-e4d256-prod-github-runner-207 kernel: [38684.577653] ? show_regs.part.0+0x23/0x29 Aug 22 16:08:30 juju-e4d256-prod-github-runner-207 kernel: [38684.578649] ? show_regs.cold+0x8/0xd Aug 22 16:08:30 juju-e4d256-prod-github-runner-207 kernel: [38684.579639] ? watchdog_timer_fn+0x1be/0x220 Aug 22 16:08:30 juju-e4d256-prod-github-runner-207 kernel: [38684.580647] ? lockup_detector_update_enable+0x60/0x60 Aug 22 16:08:30 juju-e4d256-prod-github-runner-207 kernel: [38684.581711] ? __hrtimer_run_queues+0x107/0x230 Aug 22 16:08:30 juju-e4d256-prod-github-runner-207 kernel: [38684.582745] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 16:08:30 juju-e4d256-prod-github-runner-207 kernel: [38684.583787] ? hrtimer_interrupt+0x101/0x220 Aug 22 16:08:30 juju-e4d256-prod-github-runner-207 kernel: [38684.584804] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 16:08:30 juju-e4d256-prod-github-runner-207 kernel: [38684.585879] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 16:08:30 juju-e4d256-prod-github-runner-207 kernel: [38684.586942] Aug 22 16:08:30 juju-e4d256-prod-github-runner-207 kernel: [38684.587813] Aug 22 16:08:30 juju-e4d256-prod-github-runner-207 kernel: [38684.588830] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 16:08:30 juju-e4d256-prod-github-runner-207 kernel: [38684.589881] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:08:30 juju-e4d256-prod-github-runner-207 kernel: [38684.590926] ? _raw_spin_lock+0x22/0x30 Aug 22 16:08:30 juju-e4d256-prod-github-runner-207 kernel: [38684.591884] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:08:30 juju-e4d256-prod-github-runner-207 kernel: [38684.592905] direct_page_fault+0x206/0x310 [kvm] Aug 22 16:08:30 juju-e4d256-prod-github-runner-207 kernel: [38684.593934] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 16:08:30 juju-e4d256-prod-github-runner-207 kernel: [38684.594942] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 16:08:30 juju-e4d256-prod-github-runner-207 kernel: [38684.595967] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 16:08:30 juju-e4d256-prod-github-runner-207 kernel: [38684.596965] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 16:08:30 juju-e4d256-prod-github-runner-207 kernel: [38684.597915] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 16:08:30 juju-e4d256-prod-github-runner-207 kernel: [38684.598892] handle_exit+0x98/0x230 [kvm_amd] Aug 22 16:08:30 juju-e4d256-prod-github-runner-207 kernel: [38684.599799] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 16:08:30 juju-e4d256-prod-github-runner-207 kernel: [38684.600724] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 16:08:30 juju-e4d256-prod-github-runner-207 kernel: [38684.601666] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 16:08:30 juju-e4d256-prod-github-runner-207 kernel: [38684.602570] vcpu_run+0x62/0x2c0 [kvm] Aug 22 16:08:30 juju-e4d256-prod-github-runner-207 kernel: [38684.603399] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 16:08:30 juju-e4d256-prod-github-runner-207 kernel: [38684.604215] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 16:08:30 juju-e4d256-prod-github-runner-207 kernel: [38684.605071] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 16:08:30 juju-e4d256-prod-github-runner-207 kernel: [38684.605869] ? __seccomp_filter+0x4a/0x4a0 Aug 22 16:08:30 juju-e4d256-prod-github-runner-207 kernel: [38684.606620] ? __fget_files+0x86/0xc0 Aug 22 16:08:30 juju-e4d256-prod-github-runner-207 kernel: [38684.607344] __x64_sys_ioctl+0x95/0xd0 Aug 22 16:08:30 juju-e4d256-prod-github-runner-207 kernel: [38684.608038] do_syscall_64+0x5c/0xc0 Aug 22 16:08:30 juju-e4d256-prod-github-runner-207 kernel: [38684.608705] ? do_futex+0x162/0x1f0 Aug 22 16:08:30 juju-e4d256-prod-github-runner-207 kernel: [38684.609357] ? __x64_sys_futex+0x78/0x1e0 Aug 22 16:08:30 juju-e4d256-prod-github-runner-207 kernel: [38684.610055] ? __secure_computing+0xa9/0x120 Aug 22 16:08:30 juju-e4d256-prod-github-runner-207 kernel: [38684.610751] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 16:08:30 juju-e4d256-prod-github-runner-207 kernel: [38684.611523] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:08:30 juju-e4d256-prod-github-runner-207 kernel: [38684.612247] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:08:30 juju-e4d256-prod-github-runner-207 kernel: [38684.612964] ? do_syscall_64+0x69/0xc0 Aug 22 16:08:30 juju-e4d256-prod-github-runner-207 kernel: [38684.613611] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:08:30 juju-e4d256-prod-github-runner-207 kernel: [38684.614320] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:08:30 juju-e4d256-prod-github-runner-207 kernel: [38684.615016] ? do_syscall_64+0x69/0xc0 Aug 22 16:08:30 juju-e4d256-prod-github-runner-207 kernel: [38684.615659] ? do_syscall_64+0x69/0xc0 Aug 22 16:08:30 juju-e4d256-prod-github-runner-207 kernel: [38684.616284] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 16:08:30 juju-e4d256-prod-github-runner-207 kernel: [38684.616996] RIP: 0033:0x7faa5d0edaff Aug 22 16:08:30 juju-e4d256-prod-github-runner-207 kernel: [38684.617668] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 16:08:30 juju-e4d256-prod-github-runner-207 kernel: [38684.619675] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 16:08:30 juju-e4d256-prod-github-runner-207 kernel: [38684.620592] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 16:08:30 juju-e4d256-prod-github-runner-207 kernel: [38684.621497] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 16:08:30 juju-e4d256-prod-github-runner-207 kernel: [38684.622401] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 16:08:30 juju-e4d256-prod-github-runner-207 kernel: [38684.623316] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 16:08:30 juju-e4d256-prod-github-runner-207 kernel: [38684.624216] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 16:08:30 juju-e4d256-prod-github-runner-207 kernel: [38684.625110] Aug 22 16:08:45 juju-e4d256-prod-github-runner-207 kernel: [38699.768705] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 16:08:45 juju-e4d256-prod-github-runner-207 kernel: [38699.769673] rcu: 1-....: (9615397 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=4648996 Aug 22 16:08:45 juju-e4d256-prod-github-runner-207 kernel: [38699.770790] (t=9645642 jiffies g=23269 q=39784) Aug 22 16:08:45 juju-e4d256-prod-github-runner-207 kernel: [38699.771597] NMI backtrace for cpu 1 Aug 22 16:08:45 juju-e4d256-prod-github-runner-207 kernel: [38699.772311] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 16:08:45 juju-e4d256-prod-github-runner-207 kernel: [38699.773408] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 16:08:45 juju-e4d256-prod-github-runner-207 kernel: [38699.774495] Call Trace: Aug 22 16:08:45 juju-e4d256-prod-github-runner-207 kernel: [38699.775184] Aug 22 16:08:45 juju-e4d256-prod-github-runner-207 kernel: [38699.775829] show_stack+0x52/0x5c Aug 22 16:08:45 juju-e4d256-prod-github-runner-207 kernel: [38699.776552] dump_stack_lvl+0x4a/0x63 Aug 22 16:08:45 juju-e4d256-prod-github-runner-207 kernel: [38699.777295] dump_stack+0x10/0x16 Aug 22 16:08:45 juju-e4d256-prod-github-runner-207 kernel: [38699.778010] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 16:08:45 juju-e4d256-prod-github-runner-207 kernel: [38699.778787] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 16:08:45 juju-e4d256-prod-github-runner-207 kernel: [38699.779576] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 16:08:45 juju-e4d256-prod-github-runner-207 kernel: [38699.780398] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 16:08:45 juju-e4d256-prod-github-runner-207 kernel: [38699.781215] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 16:08:45 juju-e4d256-prod-github-runner-207 kernel: [38699.782031] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 16:08:45 juju-e4d256-prod-github-runner-207 kernel: [38699.782803] print_cpu_stall.cold+0x2f/0xe2 Aug 22 16:08:45 juju-e4d256-prod-github-runner-207 kernel: [38699.783579] ? timekeeping_update+0xf7/0x150 Aug 22 16:08:45 juju-e4d256-prod-github-runner-207 kernel: [38699.784349] check_cpu_stall+0x109/0x270 Aug 22 16:08:45 juju-e4d256-prod-github-runner-207 kernel: [38699.785095] rcu_sched_clock_irq+0x9a/0x250 Aug 22 16:08:45 juju-e4d256-prod-github-runner-207 kernel: [38699.785859] update_process_times+0x94/0xd0 Aug 22 16:08:45 juju-e4d256-prod-github-runner-207 kernel: [38699.786616] tick_sched_handle+0x29/0x70 Aug 22 16:08:45 juju-e4d256-prod-github-runner-207 kernel: [38699.787370] tick_sched_timer+0x8c/0xc0 Aug 22 16:08:45 juju-e4d256-prod-github-runner-207 kernel: [38699.788113] ? tick_nohz_handler+0xb0/0xb0 Aug 22 16:08:45 juju-e4d256-prod-github-runner-207 kernel: [38699.788864] __hrtimer_run_queues+0x107/0x230 Aug 22 16:08:45 juju-e4d256-prod-github-runner-207 kernel: [38699.789634] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 16:08:45 juju-e4d256-prod-github-runner-207 kernel: [38699.790410] hrtimer_interrupt+0x101/0x220 Aug 22 16:08:45 juju-e4d256-prod-github-runner-207 kernel: [38699.791185] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 16:08:45 juju-e4d256-prod-github-runner-207 kernel: [38699.791996] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 16:08:45 juju-e4d256-prod-github-runner-207 kernel: [38699.792800] Aug 22 16:08:45 juju-e4d256-prod-github-runner-207 kernel: [38699.793433] Aug 22 16:08:45 juju-e4d256-prod-github-runner-207 kernel: [38699.794058] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 16:08:45 juju-e4d256-prod-github-runner-207 kernel: [38699.794878] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:08:45 juju-e4d256-prod-github-runner-207 kernel: [38699.795781] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 16:08:45 juju-e4d256-prod-github-runner-207 kernel: [38699.797989] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 16:08:45 juju-e4d256-prod-github-runner-207 kernel: [38699.798862] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 16:08:45 juju-e4d256-prod-github-runner-207 kernel: [38699.799866] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 16:08:45 juju-e4d256-prod-github-runner-207 kernel: [38699.800835] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 16:08:45 juju-e4d256-prod-github-runner-207 kernel: [38699.801791] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 16:08:45 juju-e4d256-prod-github-runner-207 kernel: [38699.802750] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 16:08:45 juju-e4d256-prod-github-runner-207 kernel: [38699.803752] ? _raw_spin_lock+0x22/0x30 Aug 22 16:08:45 juju-e4d256-prod-github-runner-207 kernel: [38699.804522] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:08:45 juju-e4d256-prod-github-runner-207 kernel: [38699.805364] direct_page_fault+0x206/0x310 [kvm] Aug 22 16:08:45 juju-e4d256-prod-github-runner-207 kernel: [38699.806199] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 16:08:45 juju-e4d256-prod-github-runner-207 kernel: [38699.807032] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 16:08:45 juju-e4d256-prod-github-runner-207 kernel: [38699.807883] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 16:08:45 juju-e4d256-prod-github-runner-207 kernel: [38699.808685] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 16:08:45 juju-e4d256-prod-github-runner-207 kernel: [38699.809471] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 16:08:45 juju-e4d256-prod-github-runner-207 kernel: [38699.810287] handle_exit+0x98/0x230 [kvm_amd] Aug 22 16:08:45 juju-e4d256-prod-github-runner-207 kernel: [38699.811036] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 16:08:45 juju-e4d256-prod-github-runner-207 kernel: [38699.811828] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 16:08:45 juju-e4d256-prod-github-runner-207 kernel: [38699.812621] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 16:08:45 juju-e4d256-prod-github-runner-207 kernel: [38699.813426] vcpu_run+0x62/0x2c0 [kvm] Aug 22 16:08:45 juju-e4d256-prod-github-runner-207 kernel: [38699.814140] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 16:08:45 juju-e4d256-prod-github-runner-207 kernel: [38699.814868] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 16:08:45 juju-e4d256-prod-github-runner-207 kernel: [38699.815678] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 16:08:45 juju-e4d256-prod-github-runner-207 kernel: [38699.816441] ? __seccomp_filter+0x4a/0x4a0 Aug 22 16:08:45 juju-e4d256-prod-github-runner-207 kernel: [38699.817157] ? __fget_files+0x86/0xc0 Aug 22 16:08:45 juju-e4d256-prod-github-runner-207 kernel: [38699.817857] __x64_sys_ioctl+0x95/0xd0 Aug 22 16:08:45 juju-e4d256-prod-github-runner-207 kernel: [38699.818559] do_syscall_64+0x5c/0xc0 Aug 22 16:08:45 juju-e4d256-prod-github-runner-207 kernel: [38699.819258] ? do_futex+0x162/0x1f0 Aug 22 16:08:45 juju-e4d256-prod-github-runner-207 kernel: [38699.819927] ? __x64_sys_futex+0x78/0x1e0 Aug 22 16:08:45 juju-e4d256-prod-github-runner-207 kernel: [38699.820625] ? __secure_computing+0xa9/0x120 Aug 22 16:08:45 juju-e4d256-prod-github-runner-207 kernel: [38699.821344] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 16:08:45 juju-e4d256-prod-github-runner-207 kernel: [38699.822135] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:08:45 juju-e4d256-prod-github-runner-207 kernel: [38699.822886] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:08:45 juju-e4d256-prod-github-runner-207 kernel: [38699.823652] ? do_syscall_64+0x69/0xc0 Aug 22 16:08:45 juju-e4d256-prod-github-runner-207 kernel: [38699.824338] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:08:45 juju-e4d256-prod-github-runner-207 kernel: [38699.825089] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:08:45 juju-e4d256-prod-github-runner-207 kernel: [38699.825842] ? do_syscall_64+0x69/0xc0 Aug 22 16:08:45 juju-e4d256-prod-github-runner-207 kernel: [38699.826538] ? do_syscall_64+0x69/0xc0 Aug 22 16:08:45 juju-e4d256-prod-github-runner-207 kernel: [38699.827233] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 16:08:45 juju-e4d256-prod-github-runner-207 kernel: [38699.827999] RIP: 0033:0x7faa5d0edaff Aug 22 16:08:45 juju-e4d256-prod-github-runner-207 kernel: [38699.828697] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 16:08:45 juju-e4d256-prod-github-runner-207 kernel: [38699.830795] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 16:08:45 juju-e4d256-prod-github-runner-207 kernel: [38699.831780] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 16:08:45 juju-e4d256-prod-github-runner-207 kernel: [38699.832722] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 16:08:45 juju-e4d256-prod-github-runner-207 kernel: [38699.833688] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 16:08:45 juju-e4d256-prod-github-runner-207 kernel: [38699.834652] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 16:08:45 juju-e4d256-prod-github-runner-207 kernel: [38699.835593] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 16:08:45 juju-e4d256-prod-github-runner-207 kernel: [38699.836509] Aug 22 16:09:10 juju-e4d256-prod-github-runner-207 kernel: [38724.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 35957s! [qemu-system-x86:6715] Aug 22 16:09:10 juju-e4d256-prod-github-runner-207 kernel: [38724.543175] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 16:09:10 juju-e4d256-prod-github-runner-207 kernel: [38724.543246] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 16:09:10 juju-e4d256-prod-github-runner-207 kernel: [38724.555576] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 16:09:10 juju-e4d256-prod-github-runner-207 kernel: [38724.556838] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 16:09:10 juju-e4d256-prod-github-runner-207 kernel: [38724.558073] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:09:10 juju-e4d256-prod-github-runner-207 kernel: [38724.559137] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 16:09:10 juju-e4d256-prod-github-runner-207 kernel: [38724.561718] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 16:09:10 juju-e4d256-prod-github-runner-207 kernel: [38724.562761] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 16:09:10 juju-e4d256-prod-github-runner-207 kernel: [38724.563931] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 16:09:10 juju-e4d256-prod-github-runner-207 kernel: [38724.565092] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 16:09:10 juju-e4d256-prod-github-runner-207 kernel: [38724.566251] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 16:09:10 juju-e4d256-prod-github-runner-207 kernel: [38724.567424] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 16:09:10 juju-e4d256-prod-github-runner-207 kernel: [38724.568587] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 16:09:10 juju-e4d256-prod-github-runner-207 kernel: [38724.569815] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 16:09:10 juju-e4d256-prod-github-runner-207 kernel: [38724.570925] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 16:09:10 juju-e4d256-prod-github-runner-207 kernel: [38724.572137] Call Trace: Aug 22 16:09:10 juju-e4d256-prod-github-runner-207 kernel: [38724.573057] Aug 22 16:09:10 juju-e4d256-prod-github-runner-207 kernel: [38724.573940] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:09:10 juju-e4d256-prod-github-runner-207 kernel: [38724.574979] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:09:10 juju-e4d256-prod-github-runner-207 kernel: [38724.576001] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:09:10 juju-e4d256-prod-github-runner-207 kernel: [38724.577082] ? show_regs.part.0+0x23/0x29 Aug 22 16:09:10 juju-e4d256-prod-github-runner-207 kernel: [38724.578078] ? show_regs.cold+0x8/0xd Aug 22 16:09:10 juju-e4d256-prod-github-runner-207 kernel: [38724.579068] ? watchdog_timer_fn+0x1be/0x220 Aug 22 16:09:10 juju-e4d256-prod-github-runner-207 kernel: [38724.580075] ? lockup_detector_update_enable+0x60/0x60 Aug 22 16:09:10 juju-e4d256-prod-github-runner-207 kernel: [38724.581137] ? __hrtimer_run_queues+0x107/0x230 Aug 22 16:09:10 juju-e4d256-prod-github-runner-207 kernel: [38724.582167] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 16:09:10 juju-e4d256-prod-github-runner-207 kernel: [38724.583226] ? hrtimer_interrupt+0x101/0x220 Aug 22 16:09:10 juju-e4d256-prod-github-runner-207 kernel: [38724.584245] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 16:09:10 juju-e4d256-prod-github-runner-207 kernel: [38724.585314] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 16:09:10 juju-e4d256-prod-github-runner-207 kernel: [38724.586362] Aug 22 16:09:10 juju-e4d256-prod-github-runner-207 kernel: [38724.587233] Aug 22 16:09:10 juju-e4d256-prod-github-runner-207 kernel: [38724.588070] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 16:09:10 juju-e4d256-prod-github-runner-207 kernel: [38724.589108] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:09:10 juju-e4d256-prod-github-runner-207 kernel: [38724.590152] ? _raw_spin_lock+0x22/0x30 Aug 22 16:09:10 juju-e4d256-prod-github-runner-207 kernel: [38724.591108] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:09:10 juju-e4d256-prod-github-runner-207 kernel: [38724.592135] direct_page_fault+0x206/0x310 [kvm] Aug 22 16:09:10 juju-e4d256-prod-github-runner-207 kernel: [38724.593176] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 16:09:10 juju-e4d256-prod-github-runner-207 kernel: [38724.594186] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 16:09:10 juju-e4d256-prod-github-runner-207 kernel: [38724.595199] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 16:09:10 juju-e4d256-prod-github-runner-207 kernel: [38724.596174] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 16:09:10 juju-e4d256-prod-github-runner-207 kernel: [38724.597121] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 16:09:10 juju-e4d256-prod-github-runner-207 kernel: [38724.598101] handle_exit+0x98/0x230 [kvm_amd] Aug 22 16:09:10 juju-e4d256-prod-github-runner-207 kernel: [38724.599004] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 16:09:10 juju-e4d256-prod-github-runner-207 kernel: [38724.599929] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 16:09:10 juju-e4d256-prod-github-runner-207 kernel: [38724.600855] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 16:09:10 juju-e4d256-prod-github-runner-207 kernel: [38724.601763] vcpu_run+0x62/0x2c0 [kvm] Aug 22 16:09:10 juju-e4d256-prod-github-runner-207 kernel: [38724.602573] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 16:09:10 juju-e4d256-prod-github-runner-207 kernel: [38724.603398] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 16:09:10 juju-e4d256-prod-github-runner-207 kernel: [38724.604252] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 16:09:10 juju-e4d256-prod-github-runner-207 kernel: [38724.605067] ? __seccomp_filter+0x4a/0x4a0 Aug 22 16:09:10 juju-e4d256-prod-github-runner-207 kernel: [38724.605843] ? __fget_files+0x86/0xc0 Aug 22 16:09:10 juju-e4d256-prod-github-runner-207 kernel: [38724.606548] __x64_sys_ioctl+0x95/0xd0 Aug 22 16:09:10 juju-e4d256-prod-github-runner-207 kernel: [38724.607259] do_syscall_64+0x5c/0xc0 Aug 22 16:09:10 juju-e4d256-prod-github-runner-207 kernel: [38724.607922] ? do_futex+0x162/0x1f0 Aug 22 16:09:10 juju-e4d256-prod-github-runner-207 kernel: [38724.608567] ? __x64_sys_futex+0x78/0x1e0 Aug 22 16:09:10 juju-e4d256-prod-github-runner-207 kernel: [38724.609247] ? __secure_computing+0xa9/0x120 Aug 22 16:09:10 juju-e4d256-prod-github-runner-207 kernel: [38724.609949] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 16:09:10 juju-e4d256-prod-github-runner-207 kernel: [38724.610710] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:09:10 juju-e4d256-prod-github-runner-207 kernel: [38724.611445] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:09:10 juju-e4d256-prod-github-runner-207 kernel: [38724.612159] ? do_syscall_64+0x69/0xc0 Aug 22 16:09:10 juju-e4d256-prod-github-runner-207 kernel: [38724.612802] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:09:10 juju-e4d256-prod-github-runner-207 kernel: [38724.613500] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:09:10 juju-e4d256-prod-github-runner-207 kernel: [38724.614203] ? do_syscall_64+0x69/0xc0 Aug 22 16:09:10 juju-e4d256-prod-github-runner-207 kernel: [38724.614838] ? do_syscall_64+0x69/0xc0 Aug 22 16:09:10 juju-e4d256-prod-github-runner-207 kernel: [38724.615457] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 16:09:10 juju-e4d256-prod-github-runner-207 kernel: [38724.616169] RIP: 0033:0x7faa5d0edaff Aug 22 16:09:10 juju-e4d256-prod-github-runner-207 kernel: [38724.616823] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 16:09:10 juju-e4d256-prod-github-runner-207 kernel: [38724.618834] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 16:09:10 juju-e4d256-prod-github-runner-207 kernel: [38724.619742] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 16:09:10 juju-e4d256-prod-github-runner-207 kernel: [38724.620636] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 16:09:10 juju-e4d256-prod-github-runner-207 kernel: [38724.621529] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 16:09:10 juju-e4d256-prod-github-runner-207 kernel: [38724.622416] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 16:09:10 juju-e4d256-prod-github-runner-207 kernel: [38724.623325] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 16:09:10 juju-e4d256-prod-github-runner-207 kernel: [38724.624241] Aug 22 16:09:38 juju-e4d256-prod-github-runner-207 kernel: [38752.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 35983s! [qemu-system-x86:6715] Aug 22 16:09:38 juju-e4d256-prod-github-runner-207 kernel: [38752.543174] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 16:09:38 juju-e4d256-prod-github-runner-207 kernel: [38752.543244] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 16:09:38 juju-e4d256-prod-github-runner-207 kernel: [38752.555401] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 16:09:38 juju-e4d256-prod-github-runner-207 kernel: [38752.556674] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 16:09:38 juju-e4d256-prod-github-runner-207 kernel: [38752.557900] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:09:38 juju-e4d256-prod-github-runner-207 kernel: [38752.558972] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 16:09:38 juju-e4d256-prod-github-runner-207 kernel: [38752.561738] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 16:09:38 juju-e4d256-prod-github-runner-207 kernel: [38752.562852] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 16:09:38 juju-e4d256-prod-github-runner-207 kernel: [38752.564028] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 16:09:38 juju-e4d256-prod-github-runner-207 kernel: [38752.565196] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 16:09:38 juju-e4d256-prod-github-runner-207 kernel: [38752.566361] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 16:09:38 juju-e4d256-prod-github-runner-207 kernel: [38752.567534] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 16:09:38 juju-e4d256-prod-github-runner-207 kernel: [38752.568703] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 16:09:38 juju-e4d256-prod-github-runner-207 kernel: [38752.569938] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 16:09:38 juju-e4d256-prod-github-runner-207 kernel: [38752.571063] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 16:09:38 juju-e4d256-prod-github-runner-207 kernel: [38752.572258] Call Trace: Aug 22 16:09:38 juju-e4d256-prod-github-runner-207 kernel: [38752.573175] Aug 22 16:09:38 juju-e4d256-prod-github-runner-207 kernel: [38752.574063] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:09:38 juju-e4d256-prod-github-runner-207 kernel: [38752.575109] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:09:38 juju-e4d256-prod-github-runner-207 kernel: [38752.576167] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:09:38 juju-e4d256-prod-github-runner-207 kernel: [38752.577256] ? show_regs.part.0+0x23/0x29 Aug 22 16:09:38 juju-e4d256-prod-github-runner-207 kernel: [38752.578261] ? show_regs.cold+0x8/0xd Aug 22 16:09:38 juju-e4d256-prod-github-runner-207 kernel: [38752.579246] ? watchdog_timer_fn+0x1be/0x220 Aug 22 16:09:38 juju-e4d256-prod-github-runner-207 kernel: [38752.580255] ? lockup_detector_update_enable+0x60/0x60 Aug 22 16:09:38 juju-e4d256-prod-github-runner-207 kernel: [38752.581326] ? __hrtimer_run_queues+0x107/0x230 Aug 22 16:09:38 juju-e4d256-prod-github-runner-207 kernel: [38752.582354] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 16:09:38 juju-e4d256-prod-github-runner-207 kernel: [38752.583389] ? hrtimer_interrupt+0x101/0x220 Aug 22 16:09:38 juju-e4d256-prod-github-runner-207 kernel: [38752.584404] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 16:09:38 juju-e4d256-prod-github-runner-207 kernel: [38752.585472] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 16:09:38 juju-e4d256-prod-github-runner-207 kernel: [38752.586535] Aug 22 16:09:38 juju-e4d256-prod-github-runner-207 kernel: [38752.587393] Aug 22 16:09:38 juju-e4d256-prod-github-runner-207 kernel: [38752.588230] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 16:09:38 juju-e4d256-prod-github-runner-207 kernel: [38752.589262] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:09:38 juju-e4d256-prod-github-runner-207 kernel: [38752.590305] ? _raw_spin_lock+0x22/0x30 Aug 22 16:09:38 juju-e4d256-prod-github-runner-207 kernel: [38752.591263] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:09:38 juju-e4d256-prod-github-runner-207 kernel: [38752.592278] direct_page_fault+0x206/0x310 [kvm] Aug 22 16:09:38 juju-e4d256-prod-github-runner-207 kernel: [38752.593305] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 16:09:38 juju-e4d256-prod-github-runner-207 kernel: [38752.594318] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 16:09:38 juju-e4d256-prod-github-runner-207 kernel: [38752.595341] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 16:09:38 juju-e4d256-prod-github-runner-207 kernel: [38752.596315] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 16:09:38 juju-e4d256-prod-github-runner-207 kernel: [38752.597421] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 16:09:38 juju-e4d256-prod-github-runner-207 kernel: [38752.598434] handle_exit+0x98/0x230 [kvm_amd] Aug 22 16:09:38 juju-e4d256-prod-github-runner-207 kernel: [38752.599354] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 16:09:38 juju-e4d256-prod-github-runner-207 kernel: [38752.600274] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 16:09:38 juju-e4d256-prod-github-runner-207 kernel: [38752.601205] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 16:09:38 juju-e4d256-prod-github-runner-207 kernel: [38752.602118] vcpu_run+0x62/0x2c0 [kvm] Aug 22 16:09:38 juju-e4d256-prod-github-runner-207 kernel: [38752.602950] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 16:09:38 juju-e4d256-prod-github-runner-207 kernel: [38752.603765] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 16:09:38 juju-e4d256-prod-github-runner-207 kernel: [38752.604936] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 16:09:38 juju-e4d256-prod-github-runner-207 kernel: [38752.605914] ? __seccomp_filter+0x4a/0x4a0 Aug 22 16:09:38 juju-e4d256-prod-github-runner-207 kernel: [38752.606777] ? __fget_files+0x86/0xc0 Aug 22 16:09:38 juju-e4d256-prod-github-runner-207 kernel: [38752.607485] __x64_sys_ioctl+0x95/0xd0 Aug 22 16:09:38 juju-e4d256-prod-github-runner-207 kernel: [38752.608178] do_syscall_64+0x5c/0xc0 Aug 22 16:09:38 juju-e4d256-prod-github-runner-207 kernel: [38752.608848] ? do_futex+0x162/0x1f0 Aug 22 16:09:38 juju-e4d256-prod-github-runner-207 kernel: [38752.609497] ? __x64_sys_futex+0x78/0x1e0 Aug 22 16:09:38 juju-e4d256-prod-github-runner-207 kernel: [38752.610171] ? __secure_computing+0xa9/0x120 Aug 22 16:09:38 juju-e4d256-prod-github-runner-207 kernel: [38752.610872] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 16:09:38 juju-e4d256-prod-github-runner-207 kernel: [38752.611633] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:09:38 juju-e4d256-prod-github-runner-207 kernel: [38752.612365] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:09:38 juju-e4d256-prod-github-runner-207 kernel: [38752.613082] ? do_syscall_64+0x69/0xc0 Aug 22 16:09:38 juju-e4d256-prod-github-runner-207 kernel: [38752.613727] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:09:38 juju-e4d256-prod-github-runner-207 kernel: [38752.614430] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:09:38 juju-e4d256-prod-github-runner-207 kernel: [38752.615138] ? do_syscall_64+0x69/0xc0 Aug 22 16:09:38 juju-e4d256-prod-github-runner-207 kernel: [38752.615762] ? do_syscall_64+0x69/0xc0 Aug 22 16:09:38 juju-e4d256-prod-github-runner-207 kernel: [38752.616391] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 16:09:38 juju-e4d256-prod-github-runner-207 kernel: [38752.617101] RIP: 0033:0x7faa5d0edaff Aug 22 16:09:38 juju-e4d256-prod-github-runner-207 kernel: [38752.617726] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 16:09:38 juju-e4d256-prod-github-runner-207 kernel: [38752.619724] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 16:09:38 juju-e4d256-prod-github-runner-207 kernel: [38752.620634] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 16:09:38 juju-e4d256-prod-github-runner-207 kernel: [38752.621721] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 16:09:38 juju-e4d256-prod-github-runner-207 kernel: [38752.622992] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 16:09:38 juju-e4d256-prod-github-runner-207 kernel: [38752.624264] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 16:09:38 juju-e4d256-prod-github-runner-207 kernel: [38752.625554] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 16:09:38 juju-e4d256-prod-github-runner-207 kernel: [38752.626823] Aug 22 16:10:06 juju-e4d256-prod-github-runner-207 kernel: [38780.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 36009s! [qemu-system-x86:6715] Aug 22 16:10:06 juju-e4d256-prod-github-runner-207 kernel: [38780.543739] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 16:10:06 juju-e4d256-prod-github-runner-207 kernel: [38780.543998] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 16:10:06 juju-e4d256-prod-github-runner-207 kernel: [38780.556215] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 16:10:06 juju-e4d256-prod-github-runner-207 kernel: [38780.557507] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 16:10:06 juju-e4d256-prod-github-runner-207 kernel: [38780.558746] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:10:06 juju-e4d256-prod-github-runner-207 kernel: [38780.559802] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 16:10:06 juju-e4d256-prod-github-runner-207 kernel: [38780.562381] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 16:10:06 juju-e4d256-prod-github-runner-207 kernel: [38780.563434] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 16:10:06 juju-e4d256-prod-github-runner-207 kernel: [38780.564602] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 16:10:06 juju-e4d256-prod-github-runner-207 kernel: [38780.565764] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 16:10:06 juju-e4d256-prod-github-runner-207 kernel: [38780.566974] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 16:10:06 juju-e4d256-prod-github-runner-207 kernel: [38780.568143] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 16:10:06 juju-e4d256-prod-github-runner-207 kernel: [38780.569313] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 16:10:06 juju-e4d256-prod-github-runner-207 kernel: [38780.570556] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 16:10:06 juju-e4d256-prod-github-runner-207 kernel: [38780.571652] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 16:10:06 juju-e4d256-prod-github-runner-207 kernel: [38780.572840] Call Trace: Aug 22 16:10:06 juju-e4d256-prod-github-runner-207 kernel: [38780.573756] Aug 22 16:10:06 juju-e4d256-prod-github-runner-207 kernel: [38780.574659] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:10:06 juju-e4d256-prod-github-runner-207 kernel: [38780.575689] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:10:06 juju-e4d256-prod-github-runner-207 kernel: [38780.576713] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:10:06 juju-e4d256-prod-github-runner-207 kernel: [38780.577814] ? show_regs.part.0+0x23/0x29 Aug 22 16:10:06 juju-e4d256-prod-github-runner-207 kernel: [38780.578822] ? show_regs.cold+0x8/0xd Aug 22 16:10:06 juju-e4d256-prod-github-runner-207 kernel: [38780.579800] ? watchdog_timer_fn+0x1be/0x220 Aug 22 16:10:06 juju-e4d256-prod-github-runner-207 kernel: [38780.580805] ? lockup_detector_update_enable+0x60/0x60 Aug 22 16:10:06 juju-e4d256-prod-github-runner-207 kernel: [38780.581877] ? __hrtimer_run_queues+0x107/0x230 Aug 22 16:10:06 juju-e4d256-prod-github-runner-207 kernel: [38780.582931] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 16:10:06 juju-e4d256-prod-github-runner-207 kernel: [38780.583953] ? hrtimer_interrupt+0x101/0x220 Aug 22 16:10:06 juju-e4d256-prod-github-runner-207 kernel: [38780.584969] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 16:10:06 juju-e4d256-prod-github-runner-207 kernel: [38780.586047] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 16:10:06 juju-e4d256-prod-github-runner-207 kernel: [38780.587109] Aug 22 16:10:06 juju-e4d256-prod-github-runner-207 kernel: [38780.587960] Aug 22 16:10:06 juju-e4d256-prod-github-runner-207 kernel: [38780.588802] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 16:10:06 juju-e4d256-prod-github-runner-207 kernel: [38780.589837] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:10:06 juju-e4d256-prod-github-runner-207 kernel: [38780.590884] ? _raw_spin_lock+0x22/0x30 Aug 22 16:10:06 juju-e4d256-prod-github-runner-207 kernel: [38780.591853] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:10:06 juju-e4d256-prod-github-runner-207 kernel: [38780.592985] direct_page_fault+0x206/0x310 [kvm] Aug 22 16:10:06 juju-e4d256-prod-github-runner-207 kernel: [38780.594015] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 16:10:06 juju-e4d256-prod-github-runner-207 kernel: [38780.595042] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 16:10:06 juju-e4d256-prod-github-runner-207 kernel: [38780.596042] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 16:10:06 juju-e4d256-prod-github-runner-207 kernel: [38780.597031] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 16:10:06 juju-e4d256-prod-github-runner-207 kernel: [38780.597975] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 16:10:06 juju-e4d256-prod-github-runner-207 kernel: [38780.598972] handle_exit+0x98/0x230 [kvm_amd] Aug 22 16:10:06 juju-e4d256-prod-github-runner-207 kernel: [38780.599865] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 16:10:06 juju-e4d256-prod-github-runner-207 kernel: [38780.600774] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 16:10:06 juju-e4d256-prod-github-runner-207 kernel: [38780.601694] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 16:10:06 juju-e4d256-prod-github-runner-207 kernel: [38780.602608] vcpu_run+0x62/0x2c0 [kvm] Aug 22 16:10:06 juju-e4d256-prod-github-runner-207 kernel: [38780.603416] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 16:10:06 juju-e4d256-prod-github-runner-207 kernel: [38780.604225] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 16:10:06 juju-e4d256-prod-github-runner-207 kernel: [38780.605083] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 16:10:06 juju-e4d256-prod-github-runner-207 kernel: [38780.605877] ? __seccomp_filter+0x4a/0x4a0 Aug 22 16:10:06 juju-e4d256-prod-github-runner-207 kernel: [38780.606627] ? __fget_files+0x86/0xc0 Aug 22 16:10:06 juju-e4d256-prod-github-runner-207 kernel: [38780.607327] __x64_sys_ioctl+0x95/0xd0 Aug 22 16:10:06 juju-e4d256-prod-github-runner-207 kernel: [38780.608017] do_syscall_64+0x5c/0xc0 Aug 22 16:10:06 juju-e4d256-prod-github-runner-207 kernel: [38780.608677] ? do_futex+0x162/0x1f0 Aug 22 16:10:06 juju-e4d256-prod-github-runner-207 kernel: [38780.609323] ? __x64_sys_futex+0x78/0x1e0 Aug 22 16:10:06 juju-e4d256-prod-github-runner-207 kernel: [38780.609991] ? __secure_computing+0xa9/0x120 Aug 22 16:10:06 juju-e4d256-prod-github-runner-207 kernel: [38780.610692] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 16:10:06 juju-e4d256-prod-github-runner-207 kernel: [38780.611446] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:10:06 juju-e4d256-prod-github-runner-207 kernel: [38780.612190] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:10:06 juju-e4d256-prod-github-runner-207 kernel: [38780.613072] ? do_syscall_64+0x69/0xc0 Aug 22 16:10:06 juju-e4d256-prod-github-runner-207 kernel: [38780.613715] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:10:06 juju-e4d256-prod-github-runner-207 kernel: [38780.614443] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:10:06 juju-e4d256-prod-github-runner-207 kernel: [38780.615137] ? do_syscall_64+0x69/0xc0 Aug 22 16:10:06 juju-e4d256-prod-github-runner-207 kernel: [38780.615758] ? do_syscall_64+0x69/0xc0 Aug 22 16:10:06 juju-e4d256-prod-github-runner-207 kernel: [38780.616375] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 16:10:06 juju-e4d256-prod-github-runner-207 kernel: [38780.617101] RIP: 0033:0x7faa5d0edaff Aug 22 16:10:06 juju-e4d256-prod-github-runner-207 kernel: [38780.617749] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 16:10:06 juju-e4d256-prod-github-runner-207 kernel: [38780.619741] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 16:10:06 juju-e4d256-prod-github-runner-207 kernel: [38780.620653] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 16:10:06 juju-e4d256-prod-github-runner-207 kernel: [38780.621537] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 16:10:06 juju-e4d256-prod-github-runner-207 kernel: [38780.622434] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 16:10:06 juju-e4d256-prod-github-runner-207 kernel: [38780.623326] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 16:10:06 juju-e4d256-prod-github-runner-207 kernel: [38780.624210] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 16:10:06 juju-e4d256-prod-github-runner-207 kernel: [38780.625097] Aug 22 16:10:34 juju-e4d256-prod-github-runner-207 kernel: [38808.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 36035s! [qemu-system-x86:6715] Aug 22 16:10:34 juju-e4d256-prod-github-runner-207 kernel: [38808.543079] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 16:10:34 juju-e4d256-prod-github-runner-207 kernel: [38808.543145] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 16:10:34 juju-e4d256-prod-github-runner-207 kernel: [38808.555210] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 16:10:34 juju-e4d256-prod-github-runner-207 kernel: [38808.556478] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 16:10:34 juju-e4d256-prod-github-runner-207 kernel: [38808.557698] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:10:34 juju-e4d256-prod-github-runner-207 kernel: [38808.558760] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 16:10:34 juju-e4d256-prod-github-runner-207 kernel: [38808.561294] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 16:10:34 juju-e4d256-prod-github-runner-207 kernel: [38808.562344] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 16:10:34 juju-e4d256-prod-github-runner-207 kernel: [38808.563503] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 16:10:34 juju-e4d256-prod-github-runner-207 kernel: [38808.564855] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 16:10:34 juju-e4d256-prod-github-runner-207 kernel: [38808.566024] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 16:10:34 juju-e4d256-prod-github-runner-207 kernel: [38808.567188] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 16:10:34 juju-e4d256-prod-github-runner-207 kernel: [38808.568351] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 16:10:34 juju-e4d256-prod-github-runner-207 kernel: [38808.569587] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 16:10:34 juju-e4d256-prod-github-runner-207 kernel: [38808.570690] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 16:10:34 juju-e4d256-prod-github-runner-207 kernel: [38808.571884] Call Trace: Aug 22 16:10:34 juju-e4d256-prod-github-runner-207 kernel: [38808.572796] Aug 22 16:10:34 juju-e4d256-prod-github-runner-207 kernel: [38808.573679] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:10:34 juju-e4d256-prod-github-runner-207 kernel: [38808.574714] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:10:34 juju-e4d256-prod-github-runner-207 kernel: [38808.575745] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:10:34 juju-e4d256-prod-github-runner-207 kernel: [38808.576829] ? show_regs.part.0+0x23/0x29 Aug 22 16:10:34 juju-e4d256-prod-github-runner-207 kernel: [38808.577823] ? show_regs.cold+0x8/0xd Aug 22 16:10:34 juju-e4d256-prod-github-runner-207 kernel: [38808.578862] ? watchdog_timer_fn+0x1be/0x220 Aug 22 16:10:34 juju-e4d256-prod-github-runner-207 kernel: [38808.579871] ? lockup_detector_update_enable+0x60/0x60 Aug 22 16:10:34 juju-e4d256-prod-github-runner-207 kernel: [38808.580962] ? __hrtimer_run_queues+0x107/0x230 Aug 22 16:10:34 juju-e4d256-prod-github-runner-207 kernel: [38808.582220] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 16:10:34 juju-e4d256-prod-github-runner-207 kernel: [38808.583248] ? hrtimer_interrupt+0x101/0x220 Aug 22 16:10:34 juju-e4d256-prod-github-runner-207 kernel: [38808.584319] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 16:10:34 juju-e4d256-prod-github-runner-207 kernel: [38808.585530] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 16:10:34 juju-e4d256-prod-github-runner-207 kernel: [38808.586746] Aug 22 16:10:34 juju-e4d256-prod-github-runner-207 kernel: [38808.587605] Aug 22 16:10:34 juju-e4d256-prod-github-runner-207 kernel: [38808.588442] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 16:10:34 juju-e4d256-prod-github-runner-207 kernel: [38808.589472] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:10:34 juju-e4d256-prod-github-runner-207 kernel: [38808.590527] ? _raw_spin_lock+0x22/0x30 Aug 22 16:10:34 juju-e4d256-prod-github-runner-207 kernel: [38808.591472] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:10:34 juju-e4d256-prod-github-runner-207 kernel: [38808.592494] direct_page_fault+0x206/0x310 [kvm] Aug 22 16:10:34 juju-e4d256-prod-github-runner-207 kernel: [38808.593529] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 16:10:34 juju-e4d256-prod-github-runner-207 kernel: [38808.594553] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 16:10:34 juju-e4d256-prod-github-runner-207 kernel: [38808.595555] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 16:10:34 juju-e4d256-prod-github-runner-207 kernel: [38808.596531] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 16:10:34 juju-e4d256-prod-github-runner-207 kernel: [38808.597477] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 16:10:34 juju-e4d256-prod-github-runner-207 kernel: [38808.598468] handle_exit+0x98/0x230 [kvm_amd] Aug 22 16:10:34 juju-e4d256-prod-github-runner-207 kernel: [38808.599362] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 16:10:34 juju-e4d256-prod-github-runner-207 kernel: [38808.600275] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 16:10:34 juju-e4d256-prod-github-runner-207 kernel: [38808.601244] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 16:10:34 juju-e4d256-prod-github-runner-207 kernel: [38808.602169] vcpu_run+0x62/0x2c0 [kvm] Aug 22 16:10:34 juju-e4d256-prod-github-runner-207 kernel: [38808.602985] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 16:10:34 juju-e4d256-prod-github-runner-207 kernel: [38808.603794] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 16:10:34 juju-e4d256-prod-github-runner-207 kernel: [38808.604664] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 16:10:34 juju-e4d256-prod-github-runner-207 kernel: [38808.605466] ? __seccomp_filter+0x4a/0x4a0 Aug 22 16:10:34 juju-e4d256-prod-github-runner-207 kernel: [38808.606222] ? __fget_files+0x86/0xc0 Aug 22 16:10:34 juju-e4d256-prod-github-runner-207 kernel: [38808.606948] __x64_sys_ioctl+0x95/0xd0 Aug 22 16:10:34 juju-e4d256-prod-github-runner-207 kernel: [38808.607677] do_syscall_64+0x5c/0xc0 Aug 22 16:10:34 juju-e4d256-prod-github-runner-207 kernel: [38808.608466] ? do_futex+0x162/0x1f0 Aug 22 16:10:34 juju-e4d256-prod-github-runner-207 kernel: [38808.609151] ? __x64_sys_futex+0x78/0x1e0 Aug 22 16:10:34 juju-e4d256-prod-github-runner-207 kernel: [38808.609848] ? __secure_computing+0xa9/0x120 Aug 22 16:10:34 juju-e4d256-prod-github-runner-207 kernel: [38808.610539] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 16:10:34 juju-e4d256-prod-github-runner-207 kernel: [38808.611298] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:10:34 juju-e4d256-prod-github-runner-207 kernel: [38808.612019] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:10:34 juju-e4d256-prod-github-runner-207 kernel: [38808.612743] ? do_syscall_64+0x69/0xc0 Aug 22 16:10:34 juju-e4d256-prod-github-runner-207 kernel: [38808.613389] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:10:34 juju-e4d256-prod-github-runner-207 kernel: [38808.614108] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:10:34 juju-e4d256-prod-github-runner-207 kernel: [38808.614807] ? do_syscall_64+0x69/0xc0 Aug 22 16:10:34 juju-e4d256-prod-github-runner-207 kernel: [38808.615458] ? do_syscall_64+0x69/0xc0 Aug 22 16:10:34 juju-e4d256-prod-github-runner-207 kernel: [38808.616094] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 16:10:34 juju-e4d256-prod-github-runner-207 kernel: [38808.616800] RIP: 0033:0x7faa5d0edaff Aug 22 16:10:34 juju-e4d256-prod-github-runner-207 kernel: [38808.617425] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 16:10:34 juju-e4d256-prod-github-runner-207 kernel: [38808.619426] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 16:10:34 juju-e4d256-prod-github-runner-207 kernel: [38808.620339] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 16:10:34 juju-e4d256-prod-github-runner-207 kernel: [38808.621229] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 16:10:34 juju-e4d256-prod-github-runner-207 kernel: [38808.622141] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 16:10:34 juju-e4d256-prod-github-runner-207 kernel: [38808.623035] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 16:10:34 juju-e4d256-prod-github-runner-207 kernel: [38808.623937] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 16:10:34 juju-e4d256-prod-github-runner-207 kernel: [38808.624830] Aug 22 16:11:02 juju-e4d256-prod-github-runner-207 kernel: [38836.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 36061s! [qemu-system-x86:6715] Aug 22 16:11:02 juju-e4d256-prod-github-runner-207 kernel: [38836.543093] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 16:11:02 juju-e4d256-prod-github-runner-207 kernel: [38836.543161] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 16:11:02 juju-e4d256-prod-github-runner-207 kernel: [38836.555557] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 16:11:02 juju-e4d256-prod-github-runner-207 kernel: [38836.556823] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 16:11:02 juju-e4d256-prod-github-runner-207 kernel: [38836.558055] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:11:02 juju-e4d256-prod-github-runner-207 kernel: [38836.559112] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 16:11:02 juju-e4d256-prod-github-runner-207 kernel: [38836.561667] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 16:11:02 juju-e4d256-prod-github-runner-207 kernel: [38836.562708] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 16:11:02 juju-e4d256-prod-github-runner-207 kernel: [38836.563869] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 16:11:02 juju-e4d256-prod-github-runner-207 kernel: [38836.565027] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 16:11:02 juju-e4d256-prod-github-runner-207 kernel: [38836.566205] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 16:11:02 juju-e4d256-prod-github-runner-207 kernel: [38836.567367] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 16:11:02 juju-e4d256-prod-github-runner-207 kernel: [38836.568532] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 16:11:02 juju-e4d256-prod-github-runner-207 kernel: [38836.569787] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 16:11:02 juju-e4d256-prod-github-runner-207 kernel: [38836.570891] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 16:11:02 juju-e4d256-prod-github-runner-207 kernel: [38836.572093] Call Trace: Aug 22 16:11:02 juju-e4d256-prod-github-runner-207 kernel: [38836.573006] Aug 22 16:11:02 juju-e4d256-prod-github-runner-207 kernel: [38836.573910] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:11:02 juju-e4d256-prod-github-runner-207 kernel: [38836.574945] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:11:02 juju-e4d256-prod-github-runner-207 kernel: [38836.575963] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:11:02 juju-e4d256-prod-github-runner-207 kernel: [38836.577034] ? show_regs.part.0+0x23/0x29 Aug 22 16:11:02 juju-e4d256-prod-github-runner-207 kernel: [38836.578047] ? show_regs.cold+0x8/0xd Aug 22 16:11:02 juju-e4d256-prod-github-runner-207 kernel: [38836.579018] ? watchdog_timer_fn+0x1be/0x220 Aug 22 16:11:02 juju-e4d256-prod-github-runner-207 kernel: [38836.580024] ? lockup_detector_update_enable+0x60/0x60 Aug 22 16:11:02 juju-e4d256-prod-github-runner-207 kernel: [38836.581090] ? __hrtimer_run_queues+0x107/0x230 Aug 22 16:11:02 juju-e4d256-prod-github-runner-207 kernel: [38836.582130] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 16:11:02 juju-e4d256-prod-github-runner-207 kernel: [38836.583152] ? hrtimer_interrupt+0x101/0x220 Aug 22 16:11:02 juju-e4d256-prod-github-runner-207 kernel: [38836.584166] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 16:11:02 juju-e4d256-prod-github-runner-207 kernel: [38836.585233] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 16:11:02 juju-e4d256-prod-github-runner-207 kernel: [38836.586285] Aug 22 16:11:02 juju-e4d256-prod-github-runner-207 kernel: [38836.587139] Aug 22 16:11:02 juju-e4d256-prod-github-runner-207 kernel: [38836.587976] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 16:11:02 juju-e4d256-prod-github-runner-207 kernel: [38836.589006] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:11:02 juju-e4d256-prod-github-runner-207 kernel: [38836.590052] ? _raw_spin_lock+0x22/0x30 Aug 22 16:11:02 juju-e4d256-prod-github-runner-207 kernel: [38836.591001] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:11:02 juju-e4d256-prod-github-runner-207 kernel: [38836.592016] direct_page_fault+0x206/0x310 [kvm] Aug 22 16:11:02 juju-e4d256-prod-github-runner-207 kernel: [38836.593043] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 16:11:02 juju-e4d256-prod-github-runner-207 kernel: [38836.594069] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 16:11:02 juju-e4d256-prod-github-runner-207 kernel: [38836.595067] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 16:11:02 juju-e4d256-prod-github-runner-207 kernel: [38836.596035] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 16:11:02 juju-e4d256-prod-github-runner-207 kernel: [38836.596979] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 16:11:02 juju-e4d256-prod-github-runner-207 kernel: [38836.597967] handle_exit+0x98/0x230 [kvm_amd] Aug 22 16:11:02 juju-e4d256-prod-github-runner-207 kernel: [38836.598859] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 16:11:02 juju-e4d256-prod-github-runner-207 kernel: [38836.599774] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 16:11:02 juju-e4d256-prod-github-runner-207 kernel: [38836.600694] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 16:11:02 juju-e4d256-prod-github-runner-207 kernel: [38836.601609] vcpu_run+0x62/0x2c0 [kvm] Aug 22 16:11:02 juju-e4d256-prod-github-runner-207 kernel: [38836.602419] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 16:11:02 juju-e4d256-prod-github-runner-207 kernel: [38836.603224] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 16:11:02 juju-e4d256-prod-github-runner-207 kernel: [38836.604081] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 16:11:02 juju-e4d256-prod-github-runner-207 kernel: [38836.604898] ? __seccomp_filter+0x4a/0x4a0 Aug 22 16:11:02 juju-e4d256-prod-github-runner-207 kernel: [38836.605660] ? __fget_files+0x86/0xc0 Aug 22 16:11:02 juju-e4d256-prod-github-runner-207 kernel: [38836.606364] __x64_sys_ioctl+0x95/0xd0 Aug 22 16:11:02 juju-e4d256-prod-github-runner-207 kernel: [38836.607060] do_syscall_64+0x5c/0xc0 Aug 22 16:11:02 juju-e4d256-prod-github-runner-207 kernel: [38836.607723] ? do_futex+0x162/0x1f0 Aug 22 16:11:02 juju-e4d256-prod-github-runner-207 kernel: [38836.608369] ? __x64_sys_futex+0x78/0x1e0 Aug 22 16:11:02 juju-e4d256-prod-github-runner-207 kernel: [38836.609046] ? __secure_computing+0xa9/0x120 Aug 22 16:11:02 juju-e4d256-prod-github-runner-207 kernel: [38836.609803] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 16:11:02 juju-e4d256-prod-github-runner-207 kernel: [38836.610561] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:11:02 juju-e4d256-prod-github-runner-207 kernel: [38836.611282] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:11:02 juju-e4d256-prod-github-runner-207 kernel: [38836.612001] ? do_syscall_64+0x69/0xc0 Aug 22 16:11:02 juju-e4d256-prod-github-runner-207 kernel: [38836.612645] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:11:02 juju-e4d256-prod-github-runner-207 kernel: [38836.613348] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:11:02 juju-e4d256-prod-github-runner-207 kernel: [38836.614054] ? do_syscall_64+0x69/0xc0 Aug 22 16:11:02 juju-e4d256-prod-github-runner-207 kernel: [38836.614677] ? do_syscall_64+0x69/0xc0 Aug 22 16:11:02 juju-e4d256-prod-github-runner-207 kernel: [38836.615298] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 16:11:02 juju-e4d256-prod-github-runner-207 kernel: [38836.616006] RIP: 0033:0x7faa5d0edaff Aug 22 16:11:02 juju-e4d256-prod-github-runner-207 kernel: [38836.616630] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 16:11:02 juju-e4d256-prod-github-runner-207 kernel: [38836.618631] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 16:11:02 juju-e4d256-prod-github-runner-207 kernel: [38836.619546] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 16:11:02 juju-e4d256-prod-github-runner-207 kernel: [38836.620436] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 16:11:02 juju-e4d256-prod-github-runner-207 kernel: [38836.621330] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 16:11:02 juju-e4d256-prod-github-runner-207 kernel: [38836.622230] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 16:11:02 juju-e4d256-prod-github-runner-207 kernel: [38836.623118] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 16:11:02 juju-e4d256-prod-github-runner-207 kernel: [38836.624009] Aug 22 16:11:30 juju-e4d256-prod-github-runner-207 kernel: [38864.541981] watchdog: BUG: soft lockup - CPU#1 stuck for 36087s! [qemu-system-x86:6715] Aug 22 16:11:30 juju-e4d256-prod-github-runner-207 kernel: [38864.543776] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 16:11:30 juju-e4d256-prod-github-runner-207 kernel: [38864.544038] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 16:11:30 juju-e4d256-prod-github-runner-207 kernel: [38864.556245] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 16:11:30 juju-e4d256-prod-github-runner-207 kernel: [38864.557551] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 16:11:30 juju-e4d256-prod-github-runner-207 kernel: [38864.558783] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:11:30 juju-e4d256-prod-github-runner-207 kernel: [38864.559838] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 16:11:30 juju-e4d256-prod-github-runner-207 kernel: [38864.562416] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 16:11:30 juju-e4d256-prod-github-runner-207 kernel: [38864.563457] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 16:11:30 juju-e4d256-prod-github-runner-207 kernel: [38864.564618] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 16:11:30 juju-e4d256-prod-github-runner-207 kernel: [38864.565817] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 16:11:30 juju-e4d256-prod-github-runner-207 kernel: [38864.566984] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 16:11:30 juju-e4d256-prod-github-runner-207 kernel: [38864.568151] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 16:11:30 juju-e4d256-prod-github-runner-207 kernel: [38864.569329] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 16:11:30 juju-e4d256-prod-github-runner-207 kernel: [38864.570562] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 16:11:30 juju-e4d256-prod-github-runner-207 kernel: [38864.571665] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 16:11:30 juju-e4d256-prod-github-runner-207 kernel: [38864.572856] Call Trace: Aug 22 16:11:30 juju-e4d256-prod-github-runner-207 kernel: [38864.573783] Aug 22 16:11:30 juju-e4d256-prod-github-runner-207 kernel: [38864.574690] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:11:30 juju-e4d256-prod-github-runner-207 kernel: [38864.575721] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:11:30 juju-e4d256-prod-github-runner-207 kernel: [38864.576742] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:11:30 juju-e4d256-prod-github-runner-207 kernel: [38864.577850] ? show_regs.part.0+0x23/0x29 Aug 22 16:11:30 juju-e4d256-prod-github-runner-207 kernel: [38864.578853] ? show_regs.cold+0x8/0xd Aug 22 16:11:30 juju-e4d256-prod-github-runner-207 kernel: [38864.579822] ? watchdog_timer_fn+0x1be/0x220 Aug 22 16:11:30 juju-e4d256-prod-github-runner-207 kernel: [38864.580828] ? lockup_detector_update_enable+0x60/0x60 Aug 22 16:11:30 juju-e4d256-prod-github-runner-207 kernel: [38864.581915] ? __hrtimer_run_queues+0x107/0x230 Aug 22 16:11:30 juju-e4d256-prod-github-runner-207 kernel: [38864.582949] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 16:11:30 juju-e4d256-prod-github-runner-207 kernel: [38864.583973] ? hrtimer_interrupt+0x101/0x220 Aug 22 16:11:30 juju-e4d256-prod-github-runner-207 kernel: [38864.584987] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 16:11:30 juju-e4d256-prod-github-runner-207 kernel: [38864.586070] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 16:11:30 juju-e4d256-prod-github-runner-207 kernel: [38864.587120] Aug 22 16:11:30 juju-e4d256-prod-github-runner-207 kernel: [38864.587971] Aug 22 16:11:30 juju-e4d256-prod-github-runner-207 kernel: [38864.588808] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 16:11:30 juju-e4d256-prod-github-runner-207 kernel: [38864.589847] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:11:30 juju-e4d256-prod-github-runner-207 kernel: [38864.590890] ? _raw_spin_lock+0x22/0x30 Aug 22 16:11:30 juju-e4d256-prod-github-runner-207 kernel: [38864.591835] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:11:30 juju-e4d256-prod-github-runner-207 kernel: [38864.592858] direct_page_fault+0x206/0x310 [kvm] Aug 22 16:11:30 juju-e4d256-prod-github-runner-207 kernel: [38864.593897] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 16:11:30 juju-e4d256-prod-github-runner-207 kernel: [38864.594974] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 16:11:30 juju-e4d256-prod-github-runner-207 kernel: [38864.595974] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 16:11:30 juju-e4d256-prod-github-runner-207 kernel: [38864.596975] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 16:11:30 juju-e4d256-prod-github-runner-207 kernel: [38864.597931] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 16:11:30 juju-e4d256-prod-github-runner-207 kernel: [38864.598907] handle_exit+0x98/0x230 [kvm_amd] Aug 22 16:11:30 juju-e4d256-prod-github-runner-207 kernel: [38864.599797] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 16:11:30 juju-e4d256-prod-github-runner-207 kernel: [38864.600710] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 16:11:30 juju-e4d256-prod-github-runner-207 kernel: [38864.601651] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 16:11:30 juju-e4d256-prod-github-runner-207 kernel: [38864.602559] vcpu_run+0x62/0x2c0 [kvm] Aug 22 16:11:30 juju-e4d256-prod-github-runner-207 kernel: [38864.603374] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 16:11:30 juju-e4d256-prod-github-runner-207 kernel: [38864.604181] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 16:11:30 juju-e4d256-prod-github-runner-207 kernel: [38864.605035] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 16:11:30 juju-e4d256-prod-github-runner-207 kernel: [38864.605845] ? __seccomp_filter+0x4a/0x4a0 Aug 22 16:11:30 juju-e4d256-prod-github-runner-207 kernel: [38864.606594] ? __fget_files+0x86/0xc0 Aug 22 16:11:30 juju-e4d256-prod-github-runner-207 kernel: [38864.607297] __x64_sys_ioctl+0x95/0xd0 Aug 22 16:11:30 juju-e4d256-prod-github-runner-207 kernel: [38864.607990] do_syscall_64+0x5c/0xc0 Aug 22 16:11:30 juju-e4d256-prod-github-runner-207 kernel: [38864.608654] ? do_futex+0x162/0x1f0 Aug 22 16:11:30 juju-e4d256-prod-github-runner-207 kernel: [38864.609327] ? __x64_sys_futex+0x78/0x1e0 Aug 22 16:11:30 juju-e4d256-prod-github-runner-207 kernel: [38864.610001] ? __secure_computing+0xa9/0x120 Aug 22 16:11:30 juju-e4d256-prod-github-runner-207 kernel: [38864.610690] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 16:11:30 juju-e4d256-prod-github-runner-207 kernel: [38864.611449] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:11:30 juju-e4d256-prod-github-runner-207 kernel: [38864.612171] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:11:30 juju-e4d256-prod-github-runner-207 kernel: [38864.612891] ? do_syscall_64+0x69/0xc0 Aug 22 16:11:30 juju-e4d256-prod-github-runner-207 kernel: [38864.613554] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:11:30 juju-e4d256-prod-github-runner-207 kernel: [38864.614258] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:11:30 juju-e4d256-prod-github-runner-207 kernel: [38864.614952] ? do_syscall_64+0x69/0xc0 Aug 22 16:11:30 juju-e4d256-prod-github-runner-207 kernel: [38864.615576] ? do_syscall_64+0x69/0xc0 Aug 22 16:11:30 juju-e4d256-prod-github-runner-207 kernel: [38864.616202] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 16:11:30 juju-e4d256-prod-github-runner-207 kernel: [38864.616909] RIP: 0033:0x7faa5d0edaff Aug 22 16:11:30 juju-e4d256-prod-github-runner-207 kernel: [38864.617586] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 16:11:30 juju-e4d256-prod-github-runner-207 kernel: [38864.619572] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 16:11:30 juju-e4d256-prod-github-runner-207 kernel: [38864.620482] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 16:11:30 juju-e4d256-prod-github-runner-207 kernel: [38864.621381] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 16:11:30 juju-e4d256-prod-github-runner-207 kernel: [38864.622276] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 16:11:30 juju-e4d256-prod-github-runner-207 kernel: [38864.623169] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 16:11:30 juju-e4d256-prod-github-runner-207 kernel: [38864.624057] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 16:11:30 juju-e4d256-prod-github-runner-207 kernel: [38864.624948] Aug 22 16:11:45 juju-e4d256-prod-github-runner-207 kernel: [38879.780706] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 16:11:45 juju-e4d256-prod-github-runner-207 kernel: [38879.782346] rcu: 1-....: (9660265 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=4670802 Aug 22 16:11:45 juju-e4d256-prod-github-runner-207 kernel: [38879.783472] (t=9690645 jiffies g=23269 q=39896) Aug 22 16:11:45 juju-e4d256-prod-github-runner-207 kernel: [38879.784257] NMI backtrace for cpu 1 Aug 22 16:11:45 juju-e4d256-prod-github-runner-207 kernel: [38879.784979] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 16:11:45 juju-e4d256-prod-github-runner-207 kernel: [38879.786105] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 16:11:45 juju-e4d256-prod-github-runner-207 kernel: [38879.787175] Call Trace: Aug 22 16:11:45 juju-e4d256-prod-github-runner-207 kernel: [38879.787847] Aug 22 16:11:45 juju-e4d256-prod-github-runner-207 kernel: [38879.788504] show_stack+0x52/0x5c Aug 22 16:11:45 juju-e4d256-prod-github-runner-207 kernel: [38879.789240] dump_stack_lvl+0x4a/0x63 Aug 22 16:11:45 juju-e4d256-prod-github-runner-207 kernel: [38879.789984] dump_stack+0x10/0x16 Aug 22 16:11:45 juju-e4d256-prod-github-runner-207 kernel: [38879.790703] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 16:11:45 juju-e4d256-prod-github-runner-207 kernel: [38879.791487] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 16:11:45 juju-e4d256-prod-github-runner-207 kernel: [38879.792376] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 16:11:45 juju-e4d256-prod-github-runner-207 kernel: [38879.793208] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 16:11:45 juju-e4d256-prod-github-runner-207 kernel: [38879.794027] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 16:11:45 juju-e4d256-prod-github-runner-207 kernel: [38879.794832] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 16:11:45 juju-e4d256-prod-github-runner-207 kernel: [38879.795602] print_cpu_stall.cold+0x2f/0xe2 Aug 22 16:11:45 juju-e4d256-prod-github-runner-207 kernel: [38879.796365] ? timekeeping_update+0xf7/0x150 Aug 22 16:11:45 juju-e4d256-prod-github-runner-207 kernel: [38879.797152] check_cpu_stall+0x109/0x270 Aug 22 16:11:45 juju-e4d256-prod-github-runner-207 kernel: [38879.797898] rcu_sched_clock_irq+0x9a/0x250 Aug 22 16:11:45 juju-e4d256-prod-github-runner-207 kernel: [38879.798659] update_process_times+0x94/0xd0 Aug 22 16:11:45 juju-e4d256-prod-github-runner-207 kernel: [38879.799422] tick_sched_handle+0x29/0x70 Aug 22 16:11:45 juju-e4d256-prod-github-runner-207 kernel: [38879.800170] tick_sched_timer+0x8c/0xc0 Aug 22 16:11:45 juju-e4d256-prod-github-runner-207 kernel: [38879.800906] ? tick_nohz_handler+0xb0/0xb0 Aug 22 16:11:45 juju-e4d256-prod-github-runner-207 kernel: [38879.801666] __hrtimer_run_queues+0x107/0x230 Aug 22 16:11:45 juju-e4d256-prod-github-runner-207 kernel: [38879.802558] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 16:11:45 juju-e4d256-prod-github-runner-207 kernel: [38879.803336] hrtimer_interrupt+0x101/0x220 Aug 22 16:11:45 juju-e4d256-prod-github-runner-207 kernel: [38879.804091] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 16:11:45 juju-e4d256-prod-github-runner-207 kernel: [38879.804899] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 16:11:45 juju-e4d256-prod-github-runner-207 kernel: [38879.805711] Aug 22 16:11:45 juju-e4d256-prod-github-runner-207 kernel: [38879.806348] Aug 22 16:11:45 juju-e4d256-prod-github-runner-207 kernel: [38879.806974] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 16:11:45 juju-e4d256-prod-github-runner-207 kernel: [38879.807796] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:11:45 juju-e4d256-prod-github-runner-207 kernel: [38879.808853] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 16:11:45 juju-e4d256-prod-github-runner-207 kernel: [38879.811070] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 16:11:45 juju-e4d256-prod-github-runner-207 kernel: [38879.811940] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 16:11:45 juju-e4d256-prod-github-runner-207 kernel: [38879.812934] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 16:11:45 juju-e4d256-prod-github-runner-207 kernel: [38879.813914] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 16:11:45 juju-e4d256-prod-github-runner-207 kernel: [38879.814872] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 16:11:45 juju-e4d256-prod-github-runner-207 kernel: [38879.815826] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 16:11:45 juju-e4d256-prod-github-runner-207 kernel: [38879.816774] ? _raw_spin_lock+0x22/0x30 Aug 22 16:11:45 juju-e4d256-prod-github-runner-207 kernel: [38879.817590] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:11:45 juju-e4d256-prod-github-runner-207 kernel: [38879.818703] direct_page_fault+0x206/0x310 [kvm] Aug 22 16:11:45 juju-e4d256-prod-github-runner-207 kernel: [38879.819646] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 16:11:45 juju-e4d256-prod-github-runner-207 kernel: [38879.820566] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 16:11:45 juju-e4d256-prod-github-runner-207 kernel: [38879.821605] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 16:11:45 juju-e4d256-prod-github-runner-207 kernel: [38879.822528] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 16:11:45 juju-e4d256-prod-github-runner-207 kernel: [38879.823407] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 16:11:45 juju-e4d256-prod-github-runner-207 kernel: [38879.824329] handle_exit+0x98/0x230 [kvm_amd] Aug 22 16:11:45 juju-e4d256-prod-github-runner-207 kernel: [38879.825228] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 16:11:45 juju-e4d256-prod-github-runner-207 kernel: [38879.826116] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 16:11:45 juju-e4d256-prod-github-runner-207 kernel: [38879.827007] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 16:11:45 juju-e4d256-prod-github-runner-207 kernel: [38879.827897] vcpu_run+0x62/0x2c0 [kvm] Aug 22 16:11:45 juju-e4d256-prod-github-runner-207 kernel: [38879.828692] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 16:11:45 juju-e4d256-prod-github-runner-207 kernel: [38879.829532] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 16:11:45 juju-e4d256-prod-github-runner-207 kernel: [38879.830434] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 16:11:45 juju-e4d256-prod-github-runner-207 kernel: [38879.831275] ? __seccomp_filter+0x4a/0x4a0 Aug 22 16:11:45 juju-e4d256-prod-github-runner-207 kernel: [38879.832071] ? __fget_files+0x86/0xc0 Aug 22 16:11:45 juju-e4d256-prod-github-runner-207 kernel: [38879.832843] __x64_sys_ioctl+0x95/0xd0 Aug 22 16:11:45 juju-e4d256-prod-github-runner-207 kernel: [38879.833633] do_syscall_64+0x5c/0xc0 Aug 22 16:11:45 juju-e4d256-prod-github-runner-207 kernel: [38879.834386] ? do_futex+0x162/0x1f0 Aug 22 16:11:45 juju-e4d256-prod-github-runner-207 kernel: [38879.835130] ? __x64_sys_futex+0x78/0x1e0 Aug 22 16:11:45 juju-e4d256-prod-github-runner-207 kernel: [38879.835907] ? __secure_computing+0xa9/0x120 Aug 22 16:11:45 juju-e4d256-prod-github-runner-207 kernel: [38879.836704] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 16:11:45 juju-e4d256-prod-github-runner-207 kernel: [38879.837610] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:11:45 juju-e4d256-prod-github-runner-207 kernel: [38879.838461] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:11:45 juju-e4d256-prod-github-runner-207 kernel: [38879.839312] ? do_syscall_64+0x69/0xc0 Aug 22 16:11:45 juju-e4d256-prod-github-runner-207 kernel: [38879.840076] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:11:45 juju-e4d256-prod-github-runner-207 kernel: [38879.840922] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:11:45 juju-e4d256-prod-github-runner-207 kernel: [38879.841790] ? do_syscall_64+0x69/0xc0 Aug 22 16:11:45 juju-e4d256-prod-github-runner-207 kernel: [38879.842556] ? do_syscall_64+0x69/0xc0 Aug 22 16:11:45 juju-e4d256-prod-github-runner-207 kernel: [38879.843328] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 16:11:45 juju-e4d256-prod-github-runner-207 kernel: [38879.844204] RIP: 0033:0x7faa5d0edaff Aug 22 16:11:45 juju-e4d256-prod-github-runner-207 kernel: [38879.844981] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 16:11:45 juju-e4d256-prod-github-runner-207 kernel: [38879.847427] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 16:11:45 juju-e4d256-prod-github-runner-207 kernel: [38879.848530] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 16:11:45 juju-e4d256-prod-github-runner-207 kernel: [38879.849658] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 16:11:45 juju-e4d256-prod-github-runner-207 kernel: [38879.850742] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 16:11:45 juju-e4d256-prod-github-runner-207 kernel: [38879.851827] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 16:11:45 juju-e4d256-prod-github-runner-207 kernel: [38879.852884] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 16:11:45 juju-e4d256-prod-github-runner-207 kernel: [38879.854850] Aug 22 16:12:10 juju-e4d256-prod-github-runner-207 kernel: [38904.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 36124s! [qemu-system-x86:6715] Aug 22 16:12:10 juju-e4d256-prod-github-runner-207 kernel: [38904.543737] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 16:12:10 juju-e4d256-prod-github-runner-207 kernel: [38904.543998] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 16:12:10 juju-e4d256-prod-github-runner-207 kernel: [38904.556275] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 16:12:10 juju-e4d256-prod-github-runner-207 kernel: [38904.557557] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 16:12:10 juju-e4d256-prod-github-runner-207 kernel: [38904.558873] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:12:10 juju-e4d256-prod-github-runner-207 kernel: [38904.559929] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 16:12:10 juju-e4d256-prod-github-runner-207 kernel: [38904.562493] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 16:12:10 juju-e4d256-prod-github-runner-207 kernel: [38904.563548] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 16:12:10 juju-e4d256-prod-github-runner-207 kernel: [38904.564730] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 16:12:10 juju-e4d256-prod-github-runner-207 kernel: [38904.565898] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 16:12:10 juju-e4d256-prod-github-runner-207 kernel: [38904.567063] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 16:12:10 juju-e4d256-prod-github-runner-207 kernel: [38904.568224] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 16:12:10 juju-e4d256-prod-github-runner-207 kernel: [38904.569412] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 16:12:10 juju-e4d256-prod-github-runner-207 kernel: [38904.570649] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 16:12:10 juju-e4d256-prod-github-runner-207 kernel: [38904.571757] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 16:12:10 juju-e4d256-prod-github-runner-207 kernel: [38904.572975] Call Trace: Aug 22 16:12:10 juju-e4d256-prod-github-runner-207 kernel: [38904.573893] Aug 22 16:12:10 juju-e4d256-prod-github-runner-207 kernel: [38904.574780] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:12:10 juju-e4d256-prod-github-runner-207 kernel: [38904.575812] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:12:10 juju-e4d256-prod-github-runner-207 kernel: [38904.576857] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:12:10 juju-e4d256-prod-github-runner-207 kernel: [38904.577950] ? show_regs.part.0+0x23/0x29 Aug 22 16:12:10 juju-e4d256-prod-github-runner-207 kernel: [38904.578956] ? show_regs.cold+0x8/0xd Aug 22 16:12:10 juju-e4d256-prod-github-runner-207 kernel: [38904.579929] ? watchdog_timer_fn+0x1be/0x220 Aug 22 16:12:10 juju-e4d256-prod-github-runner-207 kernel: [38904.580964] ? lockup_detector_update_enable+0x60/0x60 Aug 22 16:12:10 juju-e4d256-prod-github-runner-207 kernel: [38904.582034] ? __hrtimer_run_queues+0x107/0x230 Aug 22 16:12:10 juju-e4d256-prod-github-runner-207 kernel: [38904.583069] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 16:12:10 juju-e4d256-prod-github-runner-207 kernel: [38904.584109] ? hrtimer_interrupt+0x101/0x220 Aug 22 16:12:10 juju-e4d256-prod-github-runner-207 kernel: [38904.585142] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 16:12:10 juju-e4d256-prod-github-runner-207 kernel: [38904.586212] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 16:12:10 juju-e4d256-prod-github-runner-207 kernel: [38904.587278] Aug 22 16:12:10 juju-e4d256-prod-github-runner-207 kernel: [38904.588132] Aug 22 16:12:10 juju-e4d256-prod-github-runner-207 kernel: [38904.588988] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 16:12:10 juju-e4d256-prod-github-runner-207 kernel: [38904.590035] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:12:10 juju-e4d256-prod-github-runner-207 kernel: [38904.591079] ? _raw_spin_lock+0x22/0x30 Aug 22 16:12:10 juju-e4d256-prod-github-runner-207 kernel: [38904.592027] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:12:10 juju-e4d256-prod-github-runner-207 kernel: [38904.593062] direct_page_fault+0x206/0x310 [kvm] Aug 22 16:12:10 juju-e4d256-prod-github-runner-207 kernel: [38904.594087] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 16:12:10 juju-e4d256-prod-github-runner-207 kernel: [38904.595101] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 16:12:10 juju-e4d256-prod-github-runner-207 kernel: [38904.596101] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 16:12:10 juju-e4d256-prod-github-runner-207 kernel: [38904.597117] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 16:12:10 juju-e4d256-prod-github-runner-207 kernel: [38904.598070] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 16:12:10 juju-e4d256-prod-github-runner-207 kernel: [38904.599050] handle_exit+0x98/0x230 [kvm_amd] Aug 22 16:12:10 juju-e4d256-prod-github-runner-207 kernel: [38904.599942] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 16:12:10 juju-e4d256-prod-github-runner-207 kernel: [38904.600880] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 16:12:10 juju-e4d256-prod-github-runner-207 kernel: [38904.601813] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 16:12:10 juju-e4d256-prod-github-runner-207 kernel: [38904.602721] vcpu_run+0x62/0x2c0 [kvm] Aug 22 16:12:10 juju-e4d256-prod-github-runner-207 kernel: [38904.603531] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 16:12:10 juju-e4d256-prod-github-runner-207 kernel: [38904.604340] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 16:12:10 juju-e4d256-prod-github-runner-207 kernel: [38904.605217] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 16:12:10 juju-e4d256-prod-github-runner-207 kernel: [38904.606017] ? __seccomp_filter+0x4a/0x4a0 Aug 22 16:12:10 juju-e4d256-prod-github-runner-207 kernel: [38904.606763] ? __fget_files+0x86/0xc0 Aug 22 16:12:10 juju-e4d256-prod-github-runner-207 kernel: [38904.607468] __x64_sys_ioctl+0x95/0xd0 Aug 22 16:12:10 juju-e4d256-prod-github-runner-207 kernel: [38904.608168] do_syscall_64+0x5c/0xc0 Aug 22 16:12:10 juju-e4d256-prod-github-runner-207 kernel: [38904.608849] ? do_futex+0x162/0x1f0 Aug 22 16:12:10 juju-e4d256-prod-github-runner-207 kernel: [38904.609504] ? __x64_sys_futex+0x78/0x1e0 Aug 22 16:12:10 juju-e4d256-prod-github-runner-207 kernel: [38904.610177] ? __secure_computing+0xa9/0x120 Aug 22 16:12:10 juju-e4d256-prod-github-runner-207 kernel: [38904.610863] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 16:12:10 juju-e4d256-prod-github-runner-207 kernel: [38904.611619] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:12:10 juju-e4d256-prod-github-runner-207 kernel: [38904.612340] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:12:10 juju-e4d256-prod-github-runner-207 kernel: [38904.613072] ? do_syscall_64+0x69/0xc0 Aug 22 16:12:10 juju-e4d256-prod-github-runner-207 kernel: [38904.613721] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:12:10 juju-e4d256-prod-github-runner-207 kernel: [38904.614420] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:12:10 juju-e4d256-prod-github-runner-207 kernel: [38904.615112] ? do_syscall_64+0x69/0xc0 Aug 22 16:12:10 juju-e4d256-prod-github-runner-207 kernel: [38904.615741] ? do_syscall_64+0x69/0xc0 Aug 22 16:12:10 juju-e4d256-prod-github-runner-207 kernel: [38904.616361] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 16:12:10 juju-e4d256-prod-github-runner-207 kernel: [38904.617075] RIP: 0033:0x7faa5d0edaff Aug 22 16:12:10 juju-e4d256-prod-github-runner-207 kernel: [38904.617724] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 16:12:10 juju-e4d256-prod-github-runner-207 kernel: [38904.619707] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 16:12:10 juju-e4d256-prod-github-runner-207 kernel: [38904.620618] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 16:12:10 juju-e4d256-prod-github-runner-207 kernel: [38904.621524] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 16:12:10 juju-e4d256-prod-github-runner-207 kernel: [38904.622413] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 16:12:10 juju-e4d256-prod-github-runner-207 kernel: [38904.623299] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 16:12:10 juju-e4d256-prod-github-runner-207 kernel: [38904.624187] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 16:12:10 juju-e4d256-prod-github-runner-207 kernel: [38904.625091] Aug 22 16:12:38 juju-e4d256-prod-github-runner-207 kernel: [38932.541980] watchdog: BUG: soft lockup - CPU#1 stuck for 36150s! [qemu-system-x86:6715] Aug 22 16:12:38 juju-e4d256-prod-github-runner-207 kernel: [38932.543841] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 16:12:38 juju-e4d256-prod-github-runner-207 kernel: [38932.544103] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 16:12:38 juju-e4d256-prod-github-runner-207 kernel: [38932.556024] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 16:12:38 juju-e4d256-prod-github-runner-207 kernel: [38932.557275] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 16:12:38 juju-e4d256-prod-github-runner-207 kernel: [38932.558704] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:12:38 juju-e4d256-prod-github-runner-207 kernel: [38932.559745] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 16:12:38 juju-e4d256-prod-github-runner-207 kernel: [38932.562238] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 16:12:38 juju-e4d256-prod-github-runner-207 kernel: [38932.563323] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 16:12:38 juju-e4d256-prod-github-runner-207 kernel: [38932.565032] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 16:12:38 juju-e4d256-prod-github-runner-207 kernel: [38932.566725] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 16:12:38 juju-e4d256-prod-github-runner-207 kernel: [38932.568263] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 16:12:38 juju-e4d256-prod-github-runner-207 kernel: [38932.569480] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 16:12:38 juju-e4d256-prod-github-runner-207 kernel: [38932.570889] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 16:12:38 juju-e4d256-prod-github-runner-207 kernel: [38932.572196] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 16:12:38 juju-e4d256-prod-github-runner-207 kernel: [38932.573305] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 16:12:38 juju-e4d256-prod-github-runner-207 kernel: [38932.574511] Call Trace: Aug 22 16:12:38 juju-e4d256-prod-github-runner-207 kernel: [38932.575433] Aug 22 16:12:38 juju-e4d256-prod-github-runner-207 kernel: [38932.576363] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:12:38 juju-e4d256-prod-github-runner-207 kernel: [38932.577408] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:12:38 juju-e4d256-prod-github-runner-207 kernel: [38932.578604] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:12:38 juju-e4d256-prod-github-runner-207 kernel: [38932.579737] ? show_regs.part.0+0x23/0x29 Aug 22 16:12:38 juju-e4d256-prod-github-runner-207 kernel: [38932.580766] ? show_regs.cold+0x8/0xd Aug 22 16:12:38 juju-e4d256-prod-github-runner-207 kernel: [38932.581807] ? watchdog_timer_fn+0x1be/0x220 Aug 22 16:12:38 juju-e4d256-prod-github-runner-207 kernel: [38932.583380] ? lockup_detector_update_enable+0x60/0x60 Aug 22 16:12:38 juju-e4d256-prod-github-runner-207 kernel: [38932.585121] ? __hrtimer_run_queues+0x107/0x230 Aug 22 16:12:38 juju-e4d256-prod-github-runner-207 kernel: [38932.586462] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 16:12:38 juju-e4d256-prod-github-runner-207 kernel: [38932.587518] ? hrtimer_interrupt+0x101/0x220 Aug 22 16:12:38 juju-e4d256-prod-github-runner-207 kernel: [38932.588933] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 16:12:38 juju-e4d256-prod-github-runner-207 kernel: [38932.589992] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 16:12:38 juju-e4d256-prod-github-runner-207 kernel: [38932.591028] Aug 22 16:12:38 juju-e4d256-prod-github-runner-207 kernel: [38932.592140] Aug 22 16:12:38 juju-e4d256-prod-github-runner-207 kernel: [38932.593533] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 16:12:38 juju-e4d256-prod-github-runner-207 kernel: [38932.595157] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:12:38 juju-e4d256-prod-github-runner-207 kernel: [38932.596527] ? _raw_spin_lock+0x22/0x30 Aug 22 16:12:38 juju-e4d256-prod-github-runner-207 kernel: [38932.597497] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:12:38 juju-e4d256-prod-github-runner-207 kernel: [38932.598562] direct_page_fault+0x206/0x310 [kvm] Aug 22 16:12:38 juju-e4d256-prod-github-runner-207 kernel: [38932.599628] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 16:12:38 juju-e4d256-prod-github-runner-207 kernel: [38932.600678] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 16:12:38 juju-e4d256-prod-github-runner-207 kernel: [38932.601724] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 16:12:38 juju-e4d256-prod-github-runner-207 kernel: [38932.602937] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 16:12:38 juju-e4d256-prod-github-runner-207 kernel: [38932.604106] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 16:12:38 juju-e4d256-prod-github-runner-207 kernel: [38932.605466] handle_exit+0x98/0x230 [kvm_amd] Aug 22 16:12:38 juju-e4d256-prod-github-runner-207 kernel: [38932.606406] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 16:12:38 juju-e4d256-prod-github-runner-207 kernel: [38932.607353] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 16:12:38 juju-e4d256-prod-github-runner-207 kernel: [38932.608289] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 16:12:38 juju-e4d256-prod-github-runner-207 kernel: [38932.609221] vcpu_run+0x62/0x2c0 [kvm] Aug 22 16:12:38 juju-e4d256-prod-github-runner-207 kernel: [38932.610042] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 16:12:38 juju-e4d256-prod-github-runner-207 kernel: [38932.610856] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 16:12:38 juju-e4d256-prod-github-runner-207 kernel: [38932.611717] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 16:12:38 juju-e4d256-prod-github-runner-207 kernel: [38932.612525] ? __seccomp_filter+0x4a/0x4a0 Aug 22 16:12:38 juju-e4d256-prod-github-runner-207 kernel: [38932.613274] ? __fget_files+0x86/0xc0 Aug 22 16:12:38 juju-e4d256-prod-github-runner-207 kernel: [38932.613981] __x64_sys_ioctl+0x95/0xd0 Aug 22 16:12:38 juju-e4d256-prod-github-runner-207 kernel: [38932.614677] do_syscall_64+0x5c/0xc0 Aug 22 16:12:38 juju-e4d256-prod-github-runner-207 kernel: [38932.615344] ? do_futex+0x162/0x1f0 Aug 22 16:12:38 juju-e4d256-prod-github-runner-207 kernel: [38932.615996] ? __x64_sys_futex+0x78/0x1e0 Aug 22 16:12:38 juju-e4d256-prod-github-runner-207 kernel: [38932.616679] ? __secure_computing+0xa9/0x120 Aug 22 16:12:38 juju-e4d256-prod-github-runner-207 kernel: [38932.617371] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 16:12:38 juju-e4d256-prod-github-runner-207 kernel: [38932.618135] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:12:38 juju-e4d256-prod-github-runner-207 kernel: [38932.618857] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:12:38 juju-e4d256-prod-github-runner-207 kernel: [38932.619669] ? do_syscall_64+0x69/0xc0 Aug 22 16:12:38 juju-e4d256-prod-github-runner-207 kernel: [38932.620317] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:12:38 juju-e4d256-prod-github-runner-207 kernel: [38932.621035] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:12:38 juju-e4d256-prod-github-runner-207 kernel: [38932.621731] ? do_syscall_64+0x69/0xc0 Aug 22 16:12:38 juju-e4d256-prod-github-runner-207 kernel: [38932.622356] ? do_syscall_64+0x69/0xc0 Aug 22 16:12:38 juju-e4d256-prod-github-runner-207 kernel: [38932.622979] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 16:12:38 juju-e4d256-prod-github-runner-207 kernel: [38932.623690] RIP: 0033:0x7faa5d0edaff Aug 22 16:12:38 juju-e4d256-prod-github-runner-207 kernel: [38932.624352] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 16:12:38 juju-e4d256-prod-github-runner-207 kernel: [38932.626376] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 16:12:38 juju-e4d256-prod-github-runner-207 kernel: [38932.627299] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 16:12:38 juju-e4d256-prod-github-runner-207 kernel: [38932.628206] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 16:12:38 juju-e4d256-prod-github-runner-207 kernel: [38932.629120] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 16:12:38 juju-e4d256-prod-github-runner-207 kernel: [38932.630029] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 16:12:38 juju-e4d256-prod-github-runner-207 kernel: [38932.630936] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 16:12:38 juju-e4d256-prod-github-runner-207 kernel: [38932.631840] Aug 22 16:13:06 juju-e4d256-prod-github-runner-207 kernel: [38960.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 36176s! [qemu-system-x86:6715] Aug 22 16:13:06 juju-e4d256-prod-github-runner-207 kernel: [38960.543749] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 16:13:06 juju-e4d256-prod-github-runner-207 kernel: [38960.544010] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 16:13:06 juju-e4d256-prod-github-runner-207 kernel: [38960.556187] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 16:13:06 juju-e4d256-prod-github-runner-207 kernel: [38960.557521] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 16:13:06 juju-e4d256-prod-github-runner-207 kernel: [38960.558761] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:13:06 juju-e4d256-prod-github-runner-207 kernel: [38960.559820] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 16:13:06 juju-e4d256-prod-github-runner-207 kernel: [38960.562384] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 16:13:06 juju-e4d256-prod-github-runner-207 kernel: [38960.563429] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 16:13:06 juju-e4d256-prod-github-runner-207 kernel: [38960.564600] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 16:13:06 juju-e4d256-prod-github-runner-207 kernel: [38960.565760] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 16:13:06 juju-e4d256-prod-github-runner-207 kernel: [38960.566927] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 16:13:06 juju-e4d256-prod-github-runner-207 kernel: [38960.568097] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 16:13:06 juju-e4d256-prod-github-runner-207 kernel: [38960.569267] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 16:13:06 juju-e4d256-prod-github-runner-207 kernel: [38960.570498] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 16:13:06 juju-e4d256-prod-github-runner-207 kernel: [38960.571593] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 16:13:06 juju-e4d256-prod-github-runner-207 kernel: [38960.572810] Call Trace: Aug 22 16:13:06 juju-e4d256-prod-github-runner-207 kernel: [38960.573853] Aug 22 16:13:06 juju-e4d256-prod-github-runner-207 kernel: [38960.574744] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:13:06 juju-e4d256-prod-github-runner-207 kernel: [38960.575790] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:13:06 juju-e4d256-prod-github-runner-207 kernel: [38960.576833] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:13:06 juju-e4d256-prod-github-runner-207 kernel: [38960.577943] ? show_regs.part.0+0x23/0x29 Aug 22 16:13:06 juju-e4d256-prod-github-runner-207 kernel: [38960.578990] ? show_regs.cold+0x8/0xd Aug 22 16:13:06 juju-e4d256-prod-github-runner-207 kernel: [38960.580075] ? watchdog_timer_fn+0x1be/0x220 Aug 22 16:13:06 juju-e4d256-prod-github-runner-207 kernel: [38960.581111] ? lockup_detector_update_enable+0x60/0x60 Aug 22 16:13:06 juju-e4d256-prod-github-runner-207 kernel: [38960.582282] ? __hrtimer_run_queues+0x107/0x230 Aug 22 16:13:06 juju-e4d256-prod-github-runner-207 kernel: [38960.583312] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 16:13:06 juju-e4d256-prod-github-runner-207 kernel: [38960.584353] ? hrtimer_interrupt+0x101/0x220 Aug 22 16:13:06 juju-e4d256-prod-github-runner-207 kernel: [38960.585371] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 16:13:06 juju-e4d256-prod-github-runner-207 kernel: [38960.586441] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 16:13:06 juju-e4d256-prod-github-runner-207 kernel: [38960.587490] Aug 22 16:13:06 juju-e4d256-prod-github-runner-207 kernel: [38960.588351] Aug 22 16:13:06 juju-e4d256-prod-github-runner-207 kernel: [38960.589188] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 16:13:06 juju-e4d256-prod-github-runner-207 kernel: [38960.590222] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:13:06 juju-e4d256-prod-github-runner-207 kernel: [38960.591260] ? _raw_spin_lock+0x22/0x30 Aug 22 16:13:06 juju-e4d256-prod-github-runner-207 kernel: [38960.592223] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:13:06 juju-e4d256-prod-github-runner-207 kernel: [38960.593241] direct_page_fault+0x206/0x310 [kvm] Aug 22 16:13:06 juju-e4d256-prod-github-runner-207 kernel: [38960.594270] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 16:13:06 juju-e4d256-prod-github-runner-207 kernel: [38960.595352] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 16:13:06 juju-e4d256-prod-github-runner-207 kernel: [38960.596372] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 16:13:06 juju-e4d256-prod-github-runner-207 kernel: [38960.597361] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 16:13:06 juju-e4d256-prod-github-runner-207 kernel: [38960.598306] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 16:13:06 juju-e4d256-prod-github-runner-207 kernel: [38960.599283] handle_exit+0x98/0x230 [kvm_amd] Aug 22 16:13:06 juju-e4d256-prod-github-runner-207 kernel: [38960.600188] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 16:13:06 juju-e4d256-prod-github-runner-207 kernel: [38960.601106] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 16:13:06 juju-e4d256-prod-github-runner-207 kernel: [38960.602030] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 16:13:06 juju-e4d256-prod-github-runner-207 kernel: [38960.602940] vcpu_run+0x62/0x2c0 [kvm] Aug 22 16:13:06 juju-e4d256-prod-github-runner-207 kernel: [38960.603750] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 16:13:06 juju-e4d256-prod-github-runner-207 kernel: [38960.604574] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 16:13:06 juju-e4d256-prod-github-runner-207 kernel: [38960.605429] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 16:13:06 juju-e4d256-prod-github-runner-207 kernel: [38960.606225] ? __seccomp_filter+0x4a/0x4a0 Aug 22 16:13:06 juju-e4d256-prod-github-runner-207 kernel: [38960.606971] ? __fget_files+0x86/0xc0 Aug 22 16:13:06 juju-e4d256-prod-github-runner-207 kernel: [38960.607674] __x64_sys_ioctl+0x95/0xd0 Aug 22 16:13:06 juju-e4d256-prod-github-runner-207 kernel: [38960.608375] do_syscall_64+0x5c/0xc0 Aug 22 16:13:06 juju-e4d256-prod-github-runner-207 kernel: [38960.609107] ? do_futex+0x162/0x1f0 Aug 22 16:13:06 juju-e4d256-prod-github-runner-207 kernel: [38960.609777] ? __x64_sys_futex+0x78/0x1e0 Aug 22 16:13:06 juju-e4d256-prod-github-runner-207 kernel: [38960.610456] ? __secure_computing+0xa9/0x120 Aug 22 16:13:06 juju-e4d256-prod-github-runner-207 kernel: [38960.611147] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 16:13:06 juju-e4d256-prod-github-runner-207 kernel: [38960.611907] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:13:06 juju-e4d256-prod-github-runner-207 kernel: [38960.612648] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:13:06 juju-e4d256-prod-github-runner-207 kernel: [38960.613371] ? do_syscall_64+0x69/0xc0 Aug 22 16:13:06 juju-e4d256-prod-github-runner-207 kernel: [38960.614018] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:13:06 juju-e4d256-prod-github-runner-207 kernel: [38960.614722] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:13:06 juju-e4d256-prod-github-runner-207 kernel: [38960.615417] ? do_syscall_64+0x69/0xc0 Aug 22 16:13:06 juju-e4d256-prod-github-runner-207 kernel: [38960.616063] ? do_syscall_64+0x69/0xc0 Aug 22 16:13:06 juju-e4d256-prod-github-runner-207 kernel: [38960.616684] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 16:13:06 juju-e4d256-prod-github-runner-207 kernel: [38960.617389] RIP: 0033:0x7faa5d0edaff Aug 22 16:13:06 juju-e4d256-prod-github-runner-207 kernel: [38960.618034] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 16:13:06 juju-e4d256-prod-github-runner-207 kernel: [38960.620025] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 16:13:06 juju-e4d256-prod-github-runner-207 kernel: [38960.620954] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 16:13:06 juju-e4d256-prod-github-runner-207 kernel: [38960.621844] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 16:13:06 juju-e4d256-prod-github-runner-207 kernel: [38960.622731] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 16:13:06 juju-e4d256-prod-github-runner-207 kernel: [38960.623625] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 16:13:06 juju-e4d256-prod-github-runner-207 kernel: [38960.624526] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 16:13:06 juju-e4d256-prod-github-runner-207 kernel: [38960.625420] Aug 22 16:13:34 juju-e4d256-prod-github-runner-207 kernel: [38988.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 36202s! [qemu-system-x86:6715] Aug 22 16:13:34 juju-e4d256-prod-github-runner-207 kernel: [38988.543803] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 16:13:34 juju-e4d256-prod-github-runner-207 kernel: [38988.544111] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 16:13:34 juju-e4d256-prod-github-runner-207 kernel: [38988.556627] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 16:13:34 juju-e4d256-prod-github-runner-207 kernel: [38988.557905] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 16:13:34 juju-e4d256-prod-github-runner-207 kernel: [38988.559127] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:13:34 juju-e4d256-prod-github-runner-207 kernel: [38988.560284] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 16:13:34 juju-e4d256-prod-github-runner-207 kernel: [38988.562827] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 16:13:34 juju-e4d256-prod-github-runner-207 kernel: [38988.563930] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 16:13:34 juju-e4d256-prod-github-runner-207 kernel: [38988.565119] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 16:13:34 juju-e4d256-prod-github-runner-207 kernel: [38988.566278] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 16:13:34 juju-e4d256-prod-github-runner-207 kernel: [38988.567438] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 16:13:34 juju-e4d256-prod-github-runner-207 kernel: [38988.568667] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 16:13:34 juju-e4d256-prod-github-runner-207 kernel: [38988.569834] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 16:13:34 juju-e4d256-prod-github-runner-207 kernel: [38988.571060] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 16:13:34 juju-e4d256-prod-github-runner-207 kernel: [38988.572249] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 16:13:34 juju-e4d256-prod-github-runner-207 kernel: [38988.573446] Call Trace: Aug 22 16:13:34 juju-e4d256-prod-github-runner-207 kernel: [38988.574356] Aug 22 16:13:34 juju-e4d256-prod-github-runner-207 kernel: [38988.575256] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:13:34 juju-e4d256-prod-github-runner-207 kernel: [38988.576368] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:13:34 juju-e4d256-prod-github-runner-207 kernel: [38988.577393] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:13:34 juju-e4d256-prod-github-runner-207 kernel: [38988.578486] ? show_regs.part.0+0x23/0x29 Aug 22 16:13:34 juju-e4d256-prod-github-runner-207 kernel: [38988.579485] ? show_regs.cold+0x8/0xd Aug 22 16:13:34 juju-e4d256-prod-github-runner-207 kernel: [38988.580526] ? watchdog_timer_fn+0x1be/0x220 Aug 22 16:13:34 juju-e4d256-prod-github-runner-207 kernel: [38988.581548] ? lockup_detector_update_enable+0x60/0x60 Aug 22 16:13:34 juju-e4d256-prod-github-runner-207 kernel: [38988.582620] ? __hrtimer_run_queues+0x107/0x230 Aug 22 16:13:34 juju-e4d256-prod-github-runner-207 kernel: [38988.583644] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 16:13:34 juju-e4d256-prod-github-runner-207 kernel: [38988.584733] ? hrtimer_interrupt+0x101/0x220 Aug 22 16:13:34 juju-e4d256-prod-github-runner-207 kernel: [38988.585767] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 16:13:34 juju-e4d256-prod-github-runner-207 kernel: [38988.586845] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 16:13:34 juju-e4d256-prod-github-runner-207 kernel: [38988.587954] Aug 22 16:13:34 juju-e4d256-prod-github-runner-207 kernel: [38988.588829] Aug 22 16:13:34 juju-e4d256-prod-github-runner-207 kernel: [38988.589665] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 16:13:34 juju-e4d256-prod-github-runner-207 kernel: [38988.590696] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:13:34 juju-e4d256-prod-github-runner-207 kernel: [38988.591755] ? _raw_spin_lock+0x22/0x30 Aug 22 16:13:34 juju-e4d256-prod-github-runner-207 kernel: [38988.592770] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:13:34 juju-e4d256-prod-github-runner-207 kernel: [38988.593790] direct_page_fault+0x206/0x310 [kvm] Aug 22 16:13:34 juju-e4d256-prod-github-runner-207 kernel: [38988.594811] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 16:13:34 juju-e4d256-prod-github-runner-207 kernel: [38988.595863] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 16:13:34 juju-e4d256-prod-github-runner-207 kernel: [38988.596892] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 16:13:34 juju-e4d256-prod-github-runner-207 kernel: [38988.597887] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 16:13:34 juju-e4d256-prod-github-runner-207 kernel: [38988.598835] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 16:13:34 juju-e4d256-prod-github-runner-207 kernel: [38988.599841] handle_exit+0x98/0x230 [kvm_amd] Aug 22 16:13:34 juju-e4d256-prod-github-runner-207 kernel: [38988.600776] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 16:13:34 juju-e4d256-prod-github-runner-207 kernel: [38988.601695] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 16:13:34 juju-e4d256-prod-github-runner-207 kernel: [38988.602618] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 16:13:34 juju-e4d256-prod-github-runner-207 kernel: [38988.603522] vcpu_run+0x62/0x2c0 [kvm] Aug 22 16:13:34 juju-e4d256-prod-github-runner-207 kernel: [38988.604432] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 16:13:34 juju-e4d256-prod-github-runner-207 kernel: [38988.605242] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 16:13:34 juju-e4d256-prod-github-runner-207 kernel: [38988.606097] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 16:13:34 juju-e4d256-prod-github-runner-207 kernel: [38988.606892] ? __seccomp_filter+0x4a/0x4a0 Aug 22 16:13:34 juju-e4d256-prod-github-runner-207 kernel: [38988.607639] ? __fget_files+0x86/0xc0 Aug 22 16:13:34 juju-e4d256-prod-github-runner-207 kernel: [38988.608417] __x64_sys_ioctl+0x95/0xd0 Aug 22 16:13:34 juju-e4d256-prod-github-runner-207 kernel: [38988.609112] do_syscall_64+0x5c/0xc0 Aug 22 16:13:34 juju-e4d256-prod-github-runner-207 kernel: [38988.609776] ? do_futex+0x162/0x1f0 Aug 22 16:13:34 juju-e4d256-prod-github-runner-207 kernel: [38988.610428] ? __x64_sys_futex+0x78/0x1e0 Aug 22 16:13:34 juju-e4d256-prod-github-runner-207 kernel: [38988.611099] ? __secure_computing+0xa9/0x120 Aug 22 16:13:34 juju-e4d256-prod-github-runner-207 kernel: [38988.611812] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 16:13:34 juju-e4d256-prod-github-runner-207 kernel: [38988.612618] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:13:34 juju-e4d256-prod-github-runner-207 kernel: [38988.613339] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:13:34 juju-e4d256-prod-github-runner-207 kernel: [38988.614055] ? do_syscall_64+0x69/0xc0 Aug 22 16:13:34 juju-e4d256-prod-github-runner-207 kernel: [38988.614700] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:13:34 juju-e4d256-prod-github-runner-207 kernel: [38988.615407] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:13:34 juju-e4d256-prod-github-runner-207 kernel: [38988.616181] ? do_syscall_64+0x69/0xc0 Aug 22 16:13:34 juju-e4d256-prod-github-runner-207 kernel: [38988.616808] ? do_syscall_64+0x69/0xc0 Aug 22 16:13:34 juju-e4d256-prod-github-runner-207 kernel: [38988.617435] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 16:13:34 juju-e4d256-prod-github-runner-207 kernel: [38988.618140] RIP: 0033:0x7faa5d0edaff Aug 22 16:13:34 juju-e4d256-prod-github-runner-207 kernel: [38988.618799] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 16:13:34 juju-e4d256-prod-github-runner-207 kernel: [38988.620862] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 16:13:34 juju-e4d256-prod-github-runner-207 kernel: [38988.621780] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 16:13:34 juju-e4d256-prod-github-runner-207 kernel: [38988.622672] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 16:13:34 juju-e4d256-prod-github-runner-207 kernel: [38988.623559] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 16:13:34 juju-e4d256-prod-github-runner-207 kernel: [38988.624526] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 16:13:34 juju-e4d256-prod-github-runner-207 kernel: [38988.625414] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 16:13:34 juju-e4d256-prod-github-runner-207 kernel: [38988.626309] Aug 22 16:14:02 juju-e4d256-prod-github-runner-207 kernel: [39016.541981] watchdog: BUG: soft lockup - CPU#1 stuck for 36228s! [qemu-system-x86:6715] Aug 22 16:14:02 juju-e4d256-prod-github-runner-207 kernel: [39016.543798] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 16:14:02 juju-e4d256-prod-github-runner-207 kernel: [39016.544056] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 16:14:02 juju-e4d256-prod-github-runner-207 kernel: [39016.556236] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 16:14:02 juju-e4d256-prod-github-runner-207 kernel: [39016.557541] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 16:14:02 juju-e4d256-prod-github-runner-207 kernel: [39016.558777] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:14:02 juju-e4d256-prod-github-runner-207 kernel: [39016.559860] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 16:14:02 juju-e4d256-prod-github-runner-207 kernel: [39016.562428] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 16:14:02 juju-e4d256-prod-github-runner-207 kernel: [39016.563494] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 16:14:02 juju-e4d256-prod-github-runner-207 kernel: [39016.564657] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 16:14:02 juju-e4d256-prod-github-runner-207 kernel: [39016.565824] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 16:14:02 juju-e4d256-prod-github-runner-207 kernel: [39016.566999] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 16:14:02 juju-e4d256-prod-github-runner-207 kernel: [39016.568191] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 16:14:02 juju-e4d256-prod-github-runner-207 kernel: [39016.569354] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 16:14:02 juju-e4d256-prod-github-runner-207 kernel: [39016.570585] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 16:14:02 juju-e4d256-prod-github-runner-207 kernel: [39016.571693] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 16:14:02 juju-e4d256-prod-github-runner-207 kernel: [39016.572917] Call Trace: Aug 22 16:14:02 juju-e4d256-prod-github-runner-207 kernel: [39016.573840] Aug 22 16:14:02 juju-e4d256-prod-github-runner-207 kernel: [39016.574737] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:14:02 juju-e4d256-prod-github-runner-207 kernel: [39016.575786] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:14:02 juju-e4d256-prod-github-runner-207 kernel: [39016.576808] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:14:02 juju-e4d256-prod-github-runner-207 kernel: [39016.577922] ? show_regs.part.0+0x23/0x29 Aug 22 16:14:02 juju-e4d256-prod-github-runner-207 kernel: [39016.578928] ? show_regs.cold+0x8/0xd Aug 22 16:14:02 juju-e4d256-prod-github-runner-207 kernel: [39016.579913] ? watchdog_timer_fn+0x1be/0x220 Aug 22 16:14:02 juju-e4d256-prod-github-runner-207 kernel: [39016.580931] ? lockup_detector_update_enable+0x60/0x60 Aug 22 16:14:02 juju-e4d256-prod-github-runner-207 kernel: [39016.582000] ? __hrtimer_run_queues+0x107/0x230 Aug 22 16:14:02 juju-e4d256-prod-github-runner-207 kernel: [39016.583039] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 16:14:02 juju-e4d256-prod-github-runner-207 kernel: [39016.584093] ? hrtimer_interrupt+0x101/0x220 Aug 22 16:14:02 juju-e4d256-prod-github-runner-207 kernel: [39016.585109] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 16:14:02 juju-e4d256-prod-github-runner-207 kernel: [39016.586179] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 16:14:02 juju-e4d256-prod-github-runner-207 kernel: [39016.587226] Aug 22 16:14:02 juju-e4d256-prod-github-runner-207 kernel: [39016.588103] Aug 22 16:14:02 juju-e4d256-prod-github-runner-207 kernel: [39016.588943] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 16:14:02 juju-e4d256-prod-github-runner-207 kernel: [39016.589976] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:14:02 juju-e4d256-prod-github-runner-207 kernel: [39016.591014] ? _raw_spin_lock+0x22/0x30 Aug 22 16:14:02 juju-e4d256-prod-github-runner-207 kernel: [39016.591971] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:14:02 juju-e4d256-prod-github-runner-207 kernel: [39016.592999] direct_page_fault+0x206/0x310 [kvm] Aug 22 16:14:02 juju-e4d256-prod-github-runner-207 kernel: [39016.594027] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 16:14:02 juju-e4d256-prod-github-runner-207 kernel: [39016.595037] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 16:14:02 juju-e4d256-prod-github-runner-207 kernel: [39016.596048] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 16:14:02 juju-e4d256-prod-github-runner-207 kernel: [39016.597047] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 16:14:02 juju-e4d256-prod-github-runner-207 kernel: [39016.597994] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 16:14:02 juju-e4d256-prod-github-runner-207 kernel: [39016.598985] handle_exit+0x98/0x230 [kvm_amd] Aug 22 16:14:02 juju-e4d256-prod-github-runner-207 kernel: [39016.599902] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 16:14:02 juju-e4d256-prod-github-runner-207 kernel: [39016.600829] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 16:14:02 juju-e4d256-prod-github-runner-207 kernel: [39016.601750] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 16:14:02 juju-e4d256-prod-github-runner-207 kernel: [39016.602649] vcpu_run+0x62/0x2c0 [kvm] Aug 22 16:14:02 juju-e4d256-prod-github-runner-207 kernel: [39016.603487] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 16:14:02 juju-e4d256-prod-github-runner-207 kernel: [39016.604301] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 16:14:02 juju-e4d256-prod-github-runner-207 kernel: [39016.605154] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 16:14:02 juju-e4d256-prod-github-runner-207 kernel: [39016.605950] ? __seccomp_filter+0x4a/0x4a0 Aug 22 16:14:02 juju-e4d256-prod-github-runner-207 kernel: [39016.606690] ? __fget_files+0x86/0xc0 Aug 22 16:14:02 juju-e4d256-prod-github-runner-207 kernel: [39016.607412] __x64_sys_ioctl+0x95/0xd0 Aug 22 16:14:02 juju-e4d256-prod-github-runner-207 kernel: [39016.608110] do_syscall_64+0x5c/0xc0 Aug 22 16:14:02 juju-e4d256-prod-github-runner-207 kernel: [39016.608782] ? do_futex+0x162/0x1f0 Aug 22 16:14:02 juju-e4d256-prod-github-runner-207 kernel: [39016.609431] ? __x64_sys_futex+0x78/0x1e0 Aug 22 16:14:02 juju-e4d256-prod-github-runner-207 kernel: [39016.610102] ? __secure_computing+0xa9/0x120 Aug 22 16:14:02 juju-e4d256-prod-github-runner-207 kernel: [39016.610801] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 16:14:02 juju-e4d256-prod-github-runner-207 kernel: [39016.611593] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:14:02 juju-e4d256-prod-github-runner-207 kernel: [39016.612324] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:14:02 juju-e4d256-prod-github-runner-207 kernel: [39016.613043] ? do_syscall_64+0x69/0xc0 Aug 22 16:14:02 juju-e4d256-prod-github-runner-207 kernel: [39016.613850] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:14:02 juju-e4d256-prod-github-runner-207 kernel: [39016.614570] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:14:02 juju-e4d256-prod-github-runner-207 kernel: [39016.615266] ? do_syscall_64+0x69/0xc0 Aug 22 16:14:02 juju-e4d256-prod-github-runner-207 kernel: [39016.615904] ? do_syscall_64+0x69/0xc0 Aug 22 16:14:02 juju-e4d256-prod-github-runner-207 kernel: [39016.616526] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 16:14:02 juju-e4d256-prod-github-runner-207 kernel: [39016.617241] RIP: 0033:0x7faa5d0edaff Aug 22 16:14:02 juju-e4d256-prod-github-runner-207 kernel: [39016.617891] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 16:14:02 juju-e4d256-prod-github-runner-207 kernel: [39016.619908] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 16:14:02 juju-e4d256-prod-github-runner-207 kernel: [39016.620818] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 16:14:02 juju-e4d256-prod-github-runner-207 kernel: [39016.621719] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 16:14:02 juju-e4d256-prod-github-runner-207 kernel: [39016.622610] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 16:14:02 juju-e4d256-prod-github-runner-207 kernel: [39016.623526] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 16:14:02 juju-e4d256-prod-github-runner-207 kernel: [39016.624425] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 16:14:02 juju-e4d256-prod-github-runner-207 kernel: [39016.625323] Aug 22 16:14:30 juju-e4d256-prod-github-runner-207 kernel: [39044.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 36255s! [qemu-system-x86:6715] Aug 22 16:14:30 juju-e4d256-prod-github-runner-207 kernel: [39044.543845] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 16:14:30 juju-e4d256-prod-github-runner-207 kernel: [39044.544117] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 16:14:30 juju-e4d256-prod-github-runner-207 kernel: [39044.557078] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 16:14:30 juju-e4d256-prod-github-runner-207 kernel: [39044.558348] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 16:14:30 juju-e4d256-prod-github-runner-207 kernel: [39044.559582] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:14:30 juju-e4d256-prod-github-runner-207 kernel: [39044.560639] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 16:14:30 juju-e4d256-prod-github-runner-207 kernel: [39044.563199] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 16:14:30 juju-e4d256-prod-github-runner-207 kernel: [39044.564292] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 16:14:30 juju-e4d256-prod-github-runner-207 kernel: [39044.565459] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 16:14:30 juju-e4d256-prod-github-runner-207 kernel: [39044.566622] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 16:14:30 juju-e4d256-prod-github-runner-207 kernel: [39044.567792] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 16:14:30 juju-e4d256-prod-github-runner-207 kernel: [39044.568967] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 16:14:30 juju-e4d256-prod-github-runner-207 kernel: [39044.570133] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 16:14:30 juju-e4d256-prod-github-runner-207 kernel: [39044.571391] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 16:14:30 juju-e4d256-prod-github-runner-207 kernel: [39044.572491] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 16:14:30 juju-e4d256-prod-github-runner-207 kernel: [39044.573698] Call Trace: Aug 22 16:14:30 juju-e4d256-prod-github-runner-207 kernel: [39044.574612] Aug 22 16:14:30 juju-e4d256-prod-github-runner-207 kernel: [39044.575520] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:14:30 juju-e4d256-prod-github-runner-207 kernel: [39044.576553] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:14:30 juju-e4d256-prod-github-runner-207 kernel: [39044.577701] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:14:30 juju-e4d256-prod-github-runner-207 kernel: [39044.578979] ? show_regs.part.0+0x23/0x29 Aug 22 16:14:30 juju-e4d256-prod-github-runner-207 kernel: [39044.580027] ? show_regs.cold+0x8/0xd Aug 22 16:14:30 juju-e4d256-prod-github-runner-207 kernel: [39044.581020] ? watchdog_timer_fn+0x1be/0x220 Aug 22 16:14:30 juju-e4d256-prod-github-runner-207 kernel: [39044.582033] ? lockup_detector_update_enable+0x60/0x60 Aug 22 16:14:30 juju-e4d256-prod-github-runner-207 kernel: [39044.583294] ? __hrtimer_run_queues+0x107/0x230 Aug 22 16:14:30 juju-e4d256-prod-github-runner-207 kernel: [39044.584631] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 16:14:30 juju-e4d256-prod-github-runner-207 kernel: [39044.585906] ? hrtimer_interrupt+0x101/0x220 Aug 22 16:14:30 juju-e4d256-prod-github-runner-207 kernel: [39044.586932] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 16:14:30 juju-e4d256-prod-github-runner-207 kernel: [39044.588033] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 16:14:30 juju-e4d256-prod-github-runner-207 kernel: [39044.589225] Aug 22 16:14:30 juju-e4d256-prod-github-runner-207 kernel: [39044.590083] Aug 22 16:14:30 juju-e4d256-prod-github-runner-207 kernel: [39044.590984] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 16:14:30 juju-e4d256-prod-github-runner-207 kernel: [39044.592137] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:14:30 juju-e4d256-prod-github-runner-207 kernel: [39044.593274] ? _raw_spin_lock+0x22/0x30 Aug 22 16:14:30 juju-e4d256-prod-github-runner-207 kernel: [39044.594293] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:14:30 juju-e4d256-prod-github-runner-207 kernel: [39044.595412] direct_page_fault+0x206/0x310 [kvm] Aug 22 16:14:30 juju-e4d256-prod-github-runner-207 kernel: [39044.596522] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 16:14:30 juju-e4d256-prod-github-runner-207 kernel: [39044.597614] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 16:14:30 juju-e4d256-prod-github-runner-207 kernel: [39044.598700] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 16:14:30 juju-e4d256-prod-github-runner-207 kernel: [39044.599808] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 16:14:30 juju-e4d256-prod-github-runner-207 kernel: [39044.600851] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 16:14:30 juju-e4d256-prod-github-runner-207 kernel: [39044.602028] handle_exit+0x98/0x230 [kvm_amd] Aug 22 16:14:30 juju-e4d256-prod-github-runner-207 kernel: [39044.603010] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 16:14:30 juju-e4d256-prod-github-runner-207 kernel: [39044.604098] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 16:14:30 juju-e4d256-prod-github-runner-207 kernel: [39044.605126] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 16:14:30 juju-e4d256-prod-github-runner-207 kernel: [39044.606134] vcpu_run+0x62/0x2c0 [kvm] Aug 22 16:14:30 juju-e4d256-prod-github-runner-207 kernel: [39044.607028] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 16:14:30 juju-e4d256-prod-github-runner-207 kernel: [39044.607936] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 16:14:30 juju-e4d256-prod-github-runner-207 kernel: [39044.608892] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 16:14:30 juju-e4d256-prod-github-runner-207 kernel: [39044.609699] ? __seccomp_filter+0x4a/0x4a0 Aug 22 16:14:30 juju-e4d256-prod-github-runner-207 kernel: [39044.610529] ? __fget_files+0x86/0xc0 Aug 22 16:14:30 juju-e4d256-prod-github-runner-207 kernel: [39044.611323] __x64_sys_ioctl+0x95/0xd0 Aug 22 16:14:30 juju-e4d256-prod-github-runner-207 kernel: [39044.612087] do_syscall_64+0x5c/0xc0 Aug 22 16:14:30 juju-e4d256-prod-github-runner-207 kernel: [39044.612822] ? do_futex+0x162/0x1f0 Aug 22 16:14:30 juju-e4d256-prod-github-runner-207 kernel: [39044.613535] ? __x64_sys_futex+0x78/0x1e0 Aug 22 16:14:30 juju-e4d256-prod-github-runner-207 kernel: [39044.614289] ? __secure_computing+0xa9/0x120 Aug 22 16:14:30 juju-e4d256-prod-github-runner-207 kernel: [39044.615070] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 16:14:30 juju-e4d256-prod-github-runner-207 kernel: [39044.615933] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:14:30 juju-e4d256-prod-github-runner-207 kernel: [39044.616743] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:14:30 juju-e4d256-prod-github-runner-207 kernel: [39044.617556] ? do_syscall_64+0x69/0xc0 Aug 22 16:14:30 juju-e4d256-prod-github-runner-207 kernel: [39044.618311] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:14:30 juju-e4d256-prod-github-runner-207 kernel: [39044.619127] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:14:30 juju-e4d256-prod-github-runner-207 kernel: [39044.619952] ? do_syscall_64+0x69/0xc0 Aug 22 16:14:30 juju-e4d256-prod-github-runner-207 kernel: [39044.620661] ? do_syscall_64+0x69/0xc0 Aug 22 16:14:30 juju-e4d256-prod-github-runner-207 kernel: [39044.621388] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 16:14:30 juju-e4d256-prod-github-runner-207 kernel: [39044.622189] RIP: 0033:0x7faa5d0edaff Aug 22 16:14:30 juju-e4d256-prod-github-runner-207 kernel: [39044.622919] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 16:14:30 juju-e4d256-prod-github-runner-207 kernel: [39044.625269] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 16:14:30 juju-e4d256-prod-github-runner-207 kernel: [39044.626336] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 16:14:30 juju-e4d256-prod-github-runner-207 kernel: [39044.627262] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 16:14:30 juju-e4d256-prod-github-runner-207 kernel: [39044.628310] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 16:14:30 juju-e4d256-prod-github-runner-207 kernel: [39044.629336] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 16:14:30 juju-e4d256-prod-github-runner-207 kernel: [39044.630364] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 16:14:30 juju-e4d256-prod-github-runner-207 kernel: [39044.631404] Aug 22 16:14:45 juju-e4d256-prod-github-runner-207 kernel: [39059.792706] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 16:14:45 juju-e4d256-prod-github-runner-207 kernel: [39059.794334] rcu: 1-....: (9705115 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=4692819 Aug 22 16:14:45 juju-e4d256-prod-github-runner-207 kernel: [39059.795473] (t=9735648 jiffies g=23269 q=40054) Aug 22 16:14:45 juju-e4d256-prod-github-runner-207 kernel: [39059.796407] NMI backtrace for cpu 1 Aug 22 16:14:45 juju-e4d256-prod-github-runner-207 kernel: [39059.797120] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 16:14:45 juju-e4d256-prod-github-runner-207 kernel: [39059.798223] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 16:14:45 juju-e4d256-prod-github-runner-207 kernel: [39059.799292] Call Trace: Aug 22 16:14:45 juju-e4d256-prod-github-runner-207 kernel: [39059.799972] Aug 22 16:14:45 juju-e4d256-prod-github-runner-207 kernel: [39059.800623] show_stack+0x52/0x5c Aug 22 16:14:45 juju-e4d256-prod-github-runner-207 kernel: [39059.801486] dump_stack_lvl+0x4a/0x63 Aug 22 16:14:45 juju-e4d256-prod-github-runner-207 kernel: [39059.802303] dump_stack+0x10/0x16 Aug 22 16:14:45 juju-e4d256-prod-github-runner-207 kernel: [39059.803054] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 16:14:45 juju-e4d256-prod-github-runner-207 kernel: [39059.803832] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 16:14:45 juju-e4d256-prod-github-runner-207 kernel: [39059.804610] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 16:14:45 juju-e4d256-prod-github-runner-207 kernel: [39059.805427] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 16:14:45 juju-e4d256-prod-github-runner-207 kernel: [39059.806241] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 16:14:45 juju-e4d256-prod-github-runner-207 kernel: [39059.807906] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 16:14:45 juju-e4d256-prod-github-runner-207 kernel: [39059.808682] print_cpu_stall.cold+0x2f/0xe2 Aug 22 16:14:45 juju-e4d256-prod-github-runner-207 kernel: [39059.809443] ? timekeeping_update+0xf7/0x150 Aug 22 16:14:45 juju-e4d256-prod-github-runner-207 kernel: [39059.810208] check_cpu_stall+0x109/0x270 Aug 22 16:14:45 juju-e4d256-prod-github-runner-207 kernel: [39059.810959] rcu_sched_clock_irq+0x9a/0x250 Aug 22 16:14:45 juju-e4d256-prod-github-runner-207 kernel: [39059.811717] update_process_times+0x94/0xd0 Aug 22 16:14:45 juju-e4d256-prod-github-runner-207 kernel: [39059.812476] tick_sched_handle+0x29/0x70 Aug 22 16:14:45 juju-e4d256-prod-github-runner-207 kernel: [39059.813223] tick_sched_timer+0x8c/0xc0 Aug 22 16:14:45 juju-e4d256-prod-github-runner-207 kernel: [39059.813959] ? tick_nohz_handler+0xb0/0xb0 Aug 22 16:14:45 juju-e4d256-prod-github-runner-207 kernel: [39059.814709] __hrtimer_run_queues+0x107/0x230 Aug 22 16:14:45 juju-e4d256-prod-github-runner-207 kernel: [39059.815499] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 16:14:45 juju-e4d256-prod-github-runner-207 kernel: [39059.816270] hrtimer_interrupt+0x101/0x220 Aug 22 16:14:45 juju-e4d256-prod-github-runner-207 kernel: [39059.817024] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 16:14:45 juju-e4d256-prod-github-runner-207 kernel: [39059.817831] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 16:14:45 juju-e4d256-prod-github-runner-207 kernel: [39059.818629] Aug 22 16:14:45 juju-e4d256-prod-github-runner-207 kernel: [39059.819278] Aug 22 16:14:45 juju-e4d256-prod-github-runner-207 kernel: [39059.819905] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 16:14:45 juju-e4d256-prod-github-runner-207 kernel: [39059.820723] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:14:45 juju-e4d256-prod-github-runner-207 kernel: [39059.821597] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 16:14:45 juju-e4d256-prod-github-runner-207 kernel: [39059.823797] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 16:14:45 juju-e4d256-prod-github-runner-207 kernel: [39059.824667] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 16:14:45 juju-e4d256-prod-github-runner-207 kernel: [39059.825654] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 16:14:45 juju-e4d256-prod-github-runner-207 kernel: [39059.826626] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 16:14:45 juju-e4d256-prod-github-runner-207 kernel: [39059.827592] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 16:14:45 juju-e4d256-prod-github-runner-207 kernel: [39059.828549] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 16:14:45 juju-e4d256-prod-github-runner-207 kernel: [39059.829497] ? _raw_spin_lock+0x22/0x30 Aug 22 16:14:45 juju-e4d256-prod-github-runner-207 kernel: [39059.830264] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:14:45 juju-e4d256-prod-github-runner-207 kernel: [39059.831128] direct_page_fault+0x206/0x310 [kvm] Aug 22 16:14:45 juju-e4d256-prod-github-runner-207 kernel: [39059.832020] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 16:14:45 juju-e4d256-prod-github-runner-207 kernel: [39059.832888] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 16:14:45 juju-e4d256-prod-github-runner-207 kernel: [39059.833720] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 16:14:45 juju-e4d256-prod-github-runner-207 kernel: [39059.834542] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 16:14:45 juju-e4d256-prod-github-runner-207 kernel: [39059.835350] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 16:14:45 juju-e4d256-prod-github-runner-207 kernel: [39059.836177] handle_exit+0x98/0x230 [kvm_amd] Aug 22 16:14:45 juju-e4d256-prod-github-runner-207 kernel: [39059.836934] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 16:14:45 juju-e4d256-prod-github-runner-207 kernel: [39059.837721] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 16:14:45 juju-e4d256-prod-github-runner-207 kernel: [39059.838523] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 16:14:45 juju-e4d256-prod-github-runner-207 kernel: [39059.839325] vcpu_run+0x62/0x2c0 [kvm] Aug 22 16:14:45 juju-e4d256-prod-github-runner-207 kernel: [39059.840045] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 16:14:45 juju-e4d256-prod-github-runner-207 kernel: [39059.840774] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 16:14:45 juju-e4d256-prod-github-runner-207 kernel: [39059.841574] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 16:14:45 juju-e4d256-prod-github-runner-207 kernel: [39059.842332] ? __seccomp_filter+0x4a/0x4a0 Aug 22 16:14:45 juju-e4d256-prod-github-runner-207 kernel: [39059.843060] ? __fget_files+0x86/0xc0 Aug 22 16:14:45 juju-e4d256-prod-github-runner-207 kernel: [39059.843752] __x64_sys_ioctl+0x95/0xd0 Aug 22 16:14:45 juju-e4d256-prod-github-runner-207 kernel: [39059.844449] do_syscall_64+0x5c/0xc0 Aug 22 16:14:45 juju-e4d256-prod-github-runner-207 kernel: [39059.845128] ? do_futex+0x162/0x1f0 Aug 22 16:14:45 juju-e4d256-prod-github-runner-207 kernel: [39059.845798] ? __x64_sys_futex+0x78/0x1e0 Aug 22 16:14:45 juju-e4d256-prod-github-runner-207 kernel: [39059.846500] ? __secure_computing+0xa9/0x120 Aug 22 16:14:45 juju-e4d256-prod-github-runner-207 kernel: [39059.847225] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 16:14:45 juju-e4d256-prod-github-runner-207 kernel: [39059.848019] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:14:45 juju-e4d256-prod-github-runner-207 kernel: [39059.848772] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:14:45 juju-e4d256-prod-github-runner-207 kernel: [39059.849523] ? do_syscall_64+0x69/0xc0 Aug 22 16:14:45 juju-e4d256-prod-github-runner-207 kernel: [39059.850210] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:14:45 juju-e4d256-prod-github-runner-207 kernel: [39059.850971] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:14:45 juju-e4d256-prod-github-runner-207 kernel: [39059.851781] ? do_syscall_64+0x69/0xc0 Aug 22 16:14:45 juju-e4d256-prod-github-runner-207 kernel: [39059.852475] ? do_syscall_64+0x69/0xc0 Aug 22 16:14:45 juju-e4d256-prod-github-runner-207 kernel: [39059.853167] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 16:14:45 juju-e4d256-prod-github-runner-207 kernel: [39059.853936] RIP: 0033:0x7faa5d0edaff Aug 22 16:14:45 juju-e4d256-prod-github-runner-207 kernel: [39059.854654] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 16:14:45 juju-e4d256-prod-github-runner-207 kernel: [39059.856762] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 16:14:45 juju-e4d256-prod-github-runner-207 kernel: [39059.857724] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 16:14:45 juju-e4d256-prod-github-runner-207 kernel: [39059.858673] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 16:14:45 juju-e4d256-prod-github-runner-207 kernel: [39059.859626] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 16:14:45 juju-e4d256-prod-github-runner-207 kernel: [39059.860568] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 16:14:45 juju-e4d256-prod-github-runner-207 kernel: [39059.861493] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 16:14:45 juju-e4d256-prod-github-runner-207 kernel: [39059.862517] Aug 22 16:15:10 juju-e4d256-prod-github-runner-207 kernel: [39084.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 36292s! [qemu-system-x86:6715] Aug 22 16:15:10 juju-e4d256-prod-github-runner-207 kernel: [39084.543741] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 16:15:10 juju-e4d256-prod-github-runner-207 kernel: [39084.543994] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 16:15:10 juju-e4d256-prod-github-runner-207 kernel: [39084.556364] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 16:15:10 juju-e4d256-prod-github-runner-207 kernel: [39084.557630] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 16:15:10 juju-e4d256-prod-github-runner-207 kernel: [39084.558855] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:15:10 juju-e4d256-prod-github-runner-207 kernel: [39084.559909] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 16:15:10 juju-e4d256-prod-github-runner-207 kernel: [39084.562451] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 16:15:10 juju-e4d256-prod-github-runner-207 kernel: [39084.563513] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 16:15:10 juju-e4d256-prod-github-runner-207 kernel: [39084.564673] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 16:15:10 juju-e4d256-prod-github-runner-207 kernel: [39084.565830] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 16:15:10 juju-e4d256-prod-github-runner-207 kernel: [39084.567011] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 16:15:10 juju-e4d256-prod-github-runner-207 kernel: [39084.568176] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 16:15:10 juju-e4d256-prod-github-runner-207 kernel: [39084.569345] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 16:15:10 juju-e4d256-prod-github-runner-207 kernel: [39084.570579] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 16:15:10 juju-e4d256-prod-github-runner-207 kernel: [39084.571689] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 16:15:10 juju-e4d256-prod-github-runner-207 kernel: [39084.572881] Call Trace: Aug 22 16:15:10 juju-e4d256-prod-github-runner-207 kernel: [39084.573792] Aug 22 16:15:10 juju-e4d256-prod-github-runner-207 kernel: [39084.574689] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:15:10 juju-e4d256-prod-github-runner-207 kernel: [39084.575717] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:15:10 juju-e4d256-prod-github-runner-207 kernel: [39084.576736] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:15:10 juju-e4d256-prod-github-runner-207 kernel: [39084.577824] ? show_regs.part.0+0x23/0x29 Aug 22 16:15:10 juju-e4d256-prod-github-runner-207 kernel: [39084.578832] ? show_regs.cold+0x8/0xd Aug 22 16:15:10 juju-e4d256-prod-github-runner-207 kernel: [39084.579823] ? watchdog_timer_fn+0x1be/0x220 Aug 22 16:15:10 juju-e4d256-prod-github-runner-207 kernel: [39084.580834] ? lockup_detector_update_enable+0x60/0x60 Aug 22 16:15:10 juju-e4d256-prod-github-runner-207 kernel: [39084.581897] ? __hrtimer_run_queues+0x107/0x230 Aug 22 16:15:10 juju-e4d256-prod-github-runner-207 kernel: [39084.582948] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 16:15:10 juju-e4d256-prod-github-runner-207 kernel: [39084.583973] ? hrtimer_interrupt+0x101/0x220 Aug 22 16:15:10 juju-e4d256-prod-github-runner-207 kernel: [39084.584988] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 16:15:10 juju-e4d256-prod-github-runner-207 kernel: [39084.586060] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 16:15:10 juju-e4d256-prod-github-runner-207 kernel: [39084.587122] Aug 22 16:15:10 juju-e4d256-prod-github-runner-207 kernel: [39084.587976] Aug 22 16:15:10 juju-e4d256-prod-github-runner-207 kernel: [39084.588814] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 16:15:10 juju-e4d256-prod-github-runner-207 kernel: [39084.589853] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:15:10 juju-e4d256-prod-github-runner-207 kernel: [39084.590906] ? _raw_spin_lock+0x22/0x30 Aug 22 16:15:10 juju-e4d256-prod-github-runner-207 kernel: [39084.591858] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:15:10 juju-e4d256-prod-github-runner-207 kernel: [39084.592874] direct_page_fault+0x206/0x310 [kvm] Aug 22 16:15:10 juju-e4d256-prod-github-runner-207 kernel: [39084.594053] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 16:15:10 juju-e4d256-prod-github-runner-207 kernel: [39084.595375] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 16:15:10 juju-e4d256-prod-github-runner-207 kernel: [39084.596465] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 16:15:10 juju-e4d256-prod-github-runner-207 kernel: [39084.597548] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 16:15:10 juju-e4d256-prod-github-runner-207 kernel: [39084.598608] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 16:15:10 juju-e4d256-prod-github-runner-207 kernel: [39084.599701] handle_exit+0x98/0x230 [kvm_amd] Aug 22 16:15:10 juju-e4d256-prod-github-runner-207 kernel: [39084.600673] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 16:15:10 juju-e4d256-prod-github-runner-207 kernel: [39084.601675] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 16:15:10 juju-e4d256-prod-github-runner-207 kernel: [39084.602720] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 16:15:10 juju-e4d256-prod-github-runner-207 kernel: [39084.603719] vcpu_run+0x62/0x2c0 [kvm] Aug 22 16:15:10 juju-e4d256-prod-github-runner-207 kernel: [39084.604599] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 16:15:10 juju-e4d256-prod-github-runner-207 kernel: [39084.605494] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 16:15:10 juju-e4d256-prod-github-runner-207 kernel: [39084.606439] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 16:15:10 juju-e4d256-prod-github-runner-207 kernel: [39084.607339] ? __seccomp_filter+0x4a/0x4a0 Aug 22 16:15:10 juju-e4d256-prod-github-runner-207 kernel: [39084.608160] ? __fget_files+0x86/0xc0 Aug 22 16:15:10 juju-e4d256-prod-github-runner-207 kernel: [39084.608931] __x64_sys_ioctl+0x95/0xd0 Aug 22 16:15:10 juju-e4d256-prod-github-runner-207 kernel: [39084.609694] do_syscall_64+0x5c/0xc0 Aug 22 16:15:10 juju-e4d256-prod-github-runner-207 kernel: [39084.610429] ? do_futex+0x162/0x1f0 Aug 22 16:15:10 juju-e4d256-prod-github-runner-207 kernel: [39084.611168] ? __x64_sys_futex+0x78/0x1e0 Aug 22 16:15:10 juju-e4d256-prod-github-runner-207 kernel: [39084.611924] ? __secure_computing+0xa9/0x120 Aug 22 16:15:10 juju-e4d256-prod-github-runner-207 kernel: [39084.612693] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 16:15:10 juju-e4d256-prod-github-runner-207 kernel: [39084.613551] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:15:10 juju-e4d256-prod-github-runner-207 kernel: [39084.614367] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:15:10 juju-e4d256-prod-github-runner-207 kernel: [39084.615186] ? do_syscall_64+0x69/0xc0 Aug 22 16:15:10 juju-e4d256-prod-github-runner-207 kernel: [39084.615901] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:15:10 juju-e4d256-prod-github-runner-207 kernel: [39084.616700] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:15:10 juju-e4d256-prod-github-runner-207 kernel: [39084.617485] ? do_syscall_64+0x69/0xc0 Aug 22 16:15:10 juju-e4d256-prod-github-runner-207 kernel: [39084.618179] ? do_syscall_64+0x69/0xc0 Aug 22 16:15:10 juju-e4d256-prod-github-runner-207 kernel: [39084.618890] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 16:15:10 juju-e4d256-prod-github-runner-207 kernel: [39084.619693] RIP: 0033:0x7faa5d0edaff Aug 22 16:15:10 juju-e4d256-prod-github-runner-207 kernel: [39084.620407] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 16:15:10 juju-e4d256-prod-github-runner-207 kernel: [39084.622744] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 16:15:10 juju-e4d256-prod-github-runner-207 kernel: [39084.623795] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 16:15:10 juju-e4d256-prod-github-runner-207 kernel: [39084.624821] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 16:15:10 juju-e4d256-prod-github-runner-207 kernel: [39084.625844] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 16:15:10 juju-e4d256-prod-github-runner-207 kernel: [39084.626881] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 16:15:10 juju-e4d256-prod-github-runner-207 kernel: [39084.627906] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 16:15:10 juju-e4d256-prod-github-runner-207 kernel: [39084.628934] Aug 22 16:15:38 juju-e4d256-prod-github-runner-207 kernel: [39112.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 36318s! [qemu-system-x86:6715] Aug 22 16:15:38 juju-e4d256-prod-github-runner-207 kernel: [39112.543738] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 16:15:38 juju-e4d256-prod-github-runner-207 kernel: [39112.543993] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 16:15:38 juju-e4d256-prod-github-runner-207 kernel: [39112.556036] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 16:15:38 juju-e4d256-prod-github-runner-207 kernel: [39112.557301] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 16:15:38 juju-e4d256-prod-github-runner-207 kernel: [39112.558544] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:15:38 juju-e4d256-prod-github-runner-207 kernel: [39112.559607] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 16:15:38 juju-e4d256-prod-github-runner-207 kernel: [39112.562155] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 16:15:38 juju-e4d256-prod-github-runner-207 kernel: [39112.563213] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 16:15:38 juju-e4d256-prod-github-runner-207 kernel: [39112.564381] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 16:15:38 juju-e4d256-prod-github-runner-207 kernel: [39112.565542] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 16:15:38 juju-e4d256-prod-github-runner-207 kernel: [39112.566712] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 16:15:38 juju-e4d256-prod-github-runner-207 kernel: [39112.567869] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 16:15:38 juju-e4d256-prod-github-runner-207 kernel: [39112.569042] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 16:15:38 juju-e4d256-prod-github-runner-207 kernel: [39112.570292] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 16:15:38 juju-e4d256-prod-github-runner-207 kernel: [39112.571398] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 16:15:38 juju-e4d256-prod-github-runner-207 kernel: [39112.572588] Call Trace: Aug 22 16:15:38 juju-e4d256-prod-github-runner-207 kernel: [39112.573504] Aug 22 16:15:38 juju-e4d256-prod-github-runner-207 kernel: [39112.574411] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:15:38 juju-e4d256-prod-github-runner-207 kernel: [39112.575442] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:15:38 juju-e4d256-prod-github-runner-207 kernel: [39112.576463] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:15:38 juju-e4d256-prod-github-runner-207 kernel: [39112.577550] ? show_regs.part.0+0x23/0x29 Aug 22 16:15:38 juju-e4d256-prod-github-runner-207 kernel: [39112.578559] ? show_regs.cold+0x8/0xd Aug 22 16:15:38 juju-e4d256-prod-github-runner-207 kernel: [39112.579539] ? watchdog_timer_fn+0x1be/0x220 Aug 22 16:15:38 juju-e4d256-prod-github-runner-207 kernel: [39112.580544] ? lockup_detector_update_enable+0x60/0x60 Aug 22 16:15:38 juju-e4d256-prod-github-runner-207 kernel: [39112.581604] ? __hrtimer_run_queues+0x107/0x230 Aug 22 16:15:38 juju-e4d256-prod-github-runner-207 kernel: [39112.582644] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 16:15:38 juju-e4d256-prod-github-runner-207 kernel: [39112.583669] ? hrtimer_interrupt+0x101/0x220 Aug 22 16:15:38 juju-e4d256-prod-github-runner-207 kernel: [39112.584687] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 16:15:38 juju-e4d256-prod-github-runner-207 kernel: [39112.585752] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 16:15:38 juju-e4d256-prod-github-runner-207 kernel: [39112.586812] Aug 22 16:15:38 juju-e4d256-prod-github-runner-207 kernel: [39112.587663] Aug 22 16:15:38 juju-e4d256-prod-github-runner-207 kernel: [39112.588497] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 16:15:38 juju-e4d256-prod-github-runner-207 kernel: [39112.589527] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:15:38 juju-e4d256-prod-github-runner-207 kernel: [39112.590583] ? _raw_spin_lock+0x22/0x30 Aug 22 16:15:38 juju-e4d256-prod-github-runner-207 kernel: [39112.591525] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:15:38 juju-e4d256-prod-github-runner-207 kernel: [39112.592541] direct_page_fault+0x206/0x310 [kvm] Aug 22 16:15:38 juju-e4d256-prod-github-runner-207 kernel: [39112.593562] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 16:15:38 juju-e4d256-prod-github-runner-207 kernel: [39112.594581] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 16:15:38 juju-e4d256-prod-github-runner-207 kernel: [39112.595583] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 16:15:38 juju-e4d256-prod-github-runner-207 kernel: [39112.596566] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 16:15:38 juju-e4d256-prod-github-runner-207 kernel: [39112.597506] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 16:15:38 juju-e4d256-prod-github-runner-207 kernel: [39112.598495] handle_exit+0x98/0x230 [kvm_amd] Aug 22 16:15:38 juju-e4d256-prod-github-runner-207 kernel: [39112.599385] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 16:15:38 juju-e4d256-prod-github-runner-207 kernel: [39112.600294] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 16:15:38 juju-e4d256-prod-github-runner-207 kernel: [39112.601215] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 16:15:38 juju-e4d256-prod-github-runner-207 kernel: [39112.602114] vcpu_run+0x62/0x2c0 [kvm] Aug 22 16:15:38 juju-e4d256-prod-github-runner-207 kernel: [39112.602933] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 16:15:38 juju-e4d256-prod-github-runner-207 kernel: [39112.603740] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 16:15:38 juju-e4d256-prod-github-runner-207 kernel: [39112.604589] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 16:15:38 juju-e4d256-prod-github-runner-207 kernel: [39112.605382] ? __seccomp_filter+0x4a/0x4a0 Aug 22 16:15:38 juju-e4d256-prod-github-runner-207 kernel: [39112.606119] ? __fget_files+0x86/0xc0 Aug 22 16:15:38 juju-e4d256-prod-github-runner-207 kernel: [39112.606836] __x64_sys_ioctl+0x95/0xd0 Aug 22 16:15:38 juju-e4d256-prod-github-runner-207 kernel: [39112.607524] do_syscall_64+0x5c/0xc0 Aug 22 16:15:38 juju-e4d256-prod-github-runner-207 kernel: [39112.608183] ? do_futex+0x162/0x1f0 Aug 22 16:15:38 juju-e4d256-prod-github-runner-207 kernel: [39112.608827] ? __x64_sys_futex+0x78/0x1e0 Aug 22 16:15:38 juju-e4d256-prod-github-runner-207 kernel: [39112.609497] ? __secure_computing+0xa9/0x120 Aug 22 16:15:38 juju-e4d256-prod-github-runner-207 kernel: [39112.610185] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 16:15:38 juju-e4d256-prod-github-runner-207 kernel: [39112.610948] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:15:38 juju-e4d256-prod-github-runner-207 kernel: [39112.611665] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:15:38 juju-e4d256-prod-github-runner-207 kernel: [39112.612377] ? do_syscall_64+0x69/0xc0 Aug 22 16:15:38 juju-e4d256-prod-github-runner-207 kernel: [39112.613022] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:15:38 juju-e4d256-prod-github-runner-207 kernel: [39112.613725] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:15:38 juju-e4d256-prod-github-runner-207 kernel: [39112.614429] ? do_syscall_64+0x69/0xc0 Aug 22 16:15:38 juju-e4d256-prod-github-runner-207 kernel: [39112.615051] ? do_syscall_64+0x69/0xc0 Aug 22 16:15:38 juju-e4d256-prod-github-runner-207 kernel: [39112.615672] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 16:15:38 juju-e4d256-prod-github-runner-207 kernel: [39112.616372] RIP: 0033:0x7faa5d0edaff Aug 22 16:15:38 juju-e4d256-prod-github-runner-207 kernel: [39112.617018] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 16:15:38 juju-e4d256-prod-github-runner-207 kernel: [39112.619015] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 16:15:38 juju-e4d256-prod-github-runner-207 kernel: [39112.619923] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 16:15:38 juju-e4d256-prod-github-runner-207 kernel: [39112.620820] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 16:15:38 juju-e4d256-prod-github-runner-207 kernel: [39112.621709] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 16:15:38 juju-e4d256-prod-github-runner-207 kernel: [39112.622610] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 16:15:38 juju-e4d256-prod-github-runner-207 kernel: [39112.623500] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 16:15:38 juju-e4d256-prod-github-runner-207 kernel: [39112.624387] Aug 22 16:16:06 juju-e4d256-prod-github-runner-207 kernel: [39140.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 36344s! [qemu-system-x86:6715] Aug 22 16:16:06 juju-e4d256-prod-github-runner-207 kernel: [39140.543916] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 16:16:06 juju-e4d256-prod-github-runner-207 kernel: [39140.544173] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 16:16:06 juju-e4d256-prod-github-runner-207 kernel: [39140.556864] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 16:16:06 juju-e4d256-prod-github-runner-207 kernel: [39140.558165] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 16:16:06 juju-e4d256-prod-github-runner-207 kernel: [39140.559405] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:16:06 juju-e4d256-prod-github-runner-207 kernel: [39140.560461] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 16:16:06 juju-e4d256-prod-github-runner-207 kernel: [39140.563142] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 16:16:06 juju-e4d256-prod-github-runner-207 kernel: [39140.564257] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 16:16:06 juju-e4d256-prod-github-runner-207 kernel: [39140.565508] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 16:16:06 juju-e4d256-prod-github-runner-207 kernel: [39140.566790] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 16:16:06 juju-e4d256-prod-github-runner-207 kernel: [39140.568070] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 16:16:06 juju-e4d256-prod-github-runner-207 kernel: [39140.569371] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 16:16:06 juju-e4d256-prod-github-runner-207 kernel: [39140.570626] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 16:16:06 juju-e4d256-prod-github-runner-207 kernel: [39140.571953] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 16:16:06 juju-e4d256-prod-github-runner-207 kernel: [39140.573056] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 16:16:06 juju-e4d256-prod-github-runner-207 kernel: [39140.574289] Call Trace: Aug 22 16:16:06 juju-e4d256-prod-github-runner-207 kernel: [39140.575328] Aug 22 16:16:06 juju-e4d256-prod-github-runner-207 kernel: [39140.576282] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:16:06 juju-e4d256-prod-github-runner-207 kernel: [39140.577383] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:16:06 juju-e4d256-prod-github-runner-207 kernel: [39140.578476] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:16:06 juju-e4d256-prod-github-runner-207 kernel: [39140.579644] ? show_regs.part.0+0x23/0x29 Aug 22 16:16:06 juju-e4d256-prod-github-runner-207 kernel: [39140.580678] ? show_regs.cold+0x8/0xd Aug 22 16:16:06 juju-e4d256-prod-github-runner-207 kernel: [39140.581689] ? watchdog_timer_fn+0x1be/0x220 Aug 22 16:16:06 juju-e4d256-prod-github-runner-207 kernel: [39140.582793] ? lockup_detector_update_enable+0x60/0x60 Aug 22 16:16:06 juju-e4d256-prod-github-runner-207 kernel: [39140.583866] ? __hrtimer_run_queues+0x107/0x230 Aug 22 16:16:06 juju-e4d256-prod-github-runner-207 kernel: [39140.584899] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 16:16:06 juju-e4d256-prod-github-runner-207 kernel: [39140.585960] ? hrtimer_interrupt+0x101/0x220 Aug 22 16:16:06 juju-e4d256-prod-github-runner-207 kernel: [39140.586976] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 16:16:06 juju-e4d256-prod-github-runner-207 kernel: [39140.588051] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 16:16:06 juju-e4d256-prod-github-runner-207 kernel: [39140.589168] Aug 22 16:16:06 juju-e4d256-prod-github-runner-207 kernel: [39140.590104] Aug 22 16:16:06 juju-e4d256-prod-github-runner-207 kernel: [39140.590968] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 16:16:06 juju-e4d256-prod-github-runner-207 kernel: [39140.592131] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:16:06 juju-e4d256-prod-github-runner-207 kernel: [39140.593275] ? _raw_spin_lock+0x22/0x30 Aug 22 16:16:06 juju-e4d256-prod-github-runner-207 kernel: [39140.594285] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:16:06 juju-e4d256-prod-github-runner-207 kernel: [39140.595346] direct_page_fault+0x206/0x310 [kvm] Aug 22 16:16:06 juju-e4d256-prod-github-runner-207 kernel: [39140.596389] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 16:16:06 juju-e4d256-prod-github-runner-207 kernel: [39140.597421] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 16:16:06 juju-e4d256-prod-github-runner-207 kernel: [39140.598480] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 16:16:06 juju-e4d256-prod-github-runner-207 kernel: [39140.599508] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 16:16:06 juju-e4d256-prod-github-runner-207 kernel: [39140.600479] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 16:16:06 juju-e4d256-prod-github-runner-207 kernel: [39140.601539] handle_exit+0x98/0x230 [kvm_amd] Aug 22 16:16:06 juju-e4d256-prod-github-runner-207 kernel: [39140.602489] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 16:16:06 juju-e4d256-prod-github-runner-207 kernel: [39140.603430] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 16:16:06 juju-e4d256-prod-github-runner-207 kernel: [39140.604384] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 16:16:06 juju-e4d256-prod-github-runner-207 kernel: [39140.605312] vcpu_run+0x62/0x2c0 [kvm] Aug 22 16:16:06 juju-e4d256-prod-github-runner-207 kernel: [39140.606163] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 16:16:06 juju-e4d256-prod-github-runner-207 kernel: [39140.606987] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 16:16:06 juju-e4d256-prod-github-runner-207 kernel: [39140.607859] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 16:16:06 juju-e4d256-prod-github-runner-207 kernel: [39140.608671] ? __seccomp_filter+0x4a/0x4a0 Aug 22 16:16:06 juju-e4d256-prod-github-runner-207 kernel: [39140.609434] ? __fget_files+0x86/0xc0 Aug 22 16:16:06 juju-e4d256-prod-github-runner-207 kernel: [39140.610193] __x64_sys_ioctl+0x95/0xd0 Aug 22 16:16:06 juju-e4d256-prod-github-runner-207 kernel: [39140.610890] do_syscall_64+0x5c/0xc0 Aug 22 16:16:06 juju-e4d256-prod-github-runner-207 kernel: [39140.611557] ? do_futex+0x162/0x1f0 Aug 22 16:16:06 juju-e4d256-prod-github-runner-207 kernel: [39140.612212] ? __x64_sys_futex+0x78/0x1e0 Aug 22 16:16:06 juju-e4d256-prod-github-runner-207 kernel: [39140.612891] ? __secure_computing+0xa9/0x120 Aug 22 16:16:06 juju-e4d256-prod-github-runner-207 kernel: [39140.613594] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 16:16:06 juju-e4d256-prod-github-runner-207 kernel: [39140.614398] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:16:06 juju-e4d256-prod-github-runner-207 kernel: [39140.615142] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:16:06 juju-e4d256-prod-github-runner-207 kernel: [39140.615882] ? do_syscall_64+0x69/0xc0 Aug 22 16:16:06 juju-e4d256-prod-github-runner-207 kernel: [39140.616661] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:16:06 juju-e4d256-prod-github-runner-207 kernel: [39140.617407] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:16:06 juju-e4d256-prod-github-runner-207 kernel: [39140.618148] ? do_syscall_64+0x69/0xc0 Aug 22 16:16:06 juju-e4d256-prod-github-runner-207 kernel: [39140.618787] ? do_syscall_64+0x69/0xc0 Aug 22 16:16:06 juju-e4d256-prod-github-runner-207 kernel: [39140.619418] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 16:16:06 juju-e4d256-prod-github-runner-207 kernel: [39140.620141] RIP: 0033:0x7faa5d0edaff Aug 22 16:16:06 juju-e4d256-prod-github-runner-207 kernel: [39140.620813] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 16:16:06 juju-e4d256-prod-github-runner-207 kernel: [39140.622863] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 16:16:06 juju-e4d256-prod-github-runner-207 kernel: [39140.623779] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 16:16:06 juju-e4d256-prod-github-runner-207 kernel: [39140.624665] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 16:16:06 juju-e4d256-prod-github-runner-207 kernel: [39140.625550] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 16:16:06 juju-e4d256-prod-github-runner-207 kernel: [39140.626460] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 16:16:06 juju-e4d256-prod-github-runner-207 kernel: [39140.627362] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 16:16:06 juju-e4d256-prod-github-runner-207 kernel: [39140.628303] Aug 22 16:16:34 juju-e4d256-prod-github-runner-207 kernel: [39168.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 36370s! [qemu-system-x86:6715] Aug 22 16:16:34 juju-e4d256-prod-github-runner-207 kernel: [39168.543727] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 16:16:34 juju-e4d256-prod-github-runner-207 kernel: [39168.543976] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 16:16:34 juju-e4d256-prod-github-runner-207 kernel: [39168.556216] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 16:16:34 juju-e4d256-prod-github-runner-207 kernel: [39168.557510] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 16:16:34 juju-e4d256-prod-github-runner-207 kernel: [39168.558781] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:16:34 juju-e4d256-prod-github-runner-207 kernel: [39168.559838] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 16:16:34 juju-e4d256-prod-github-runner-207 kernel: [39168.562452] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 16:16:34 juju-e4d256-prod-github-runner-207 kernel: [39168.563503] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 16:16:34 juju-e4d256-prod-github-runner-207 kernel: [39168.564668] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 16:16:34 juju-e4d256-prod-github-runner-207 kernel: [39168.565853] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 16:16:34 juju-e4d256-prod-github-runner-207 kernel: [39168.567029] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 16:16:34 juju-e4d256-prod-github-runner-207 kernel: [39168.568204] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 16:16:34 juju-e4d256-prod-github-runner-207 kernel: [39168.569379] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 16:16:34 juju-e4d256-prod-github-runner-207 kernel: [39168.570635] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 16:16:34 juju-e4d256-prod-github-runner-207 kernel: [39168.571743] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 16:16:34 juju-e4d256-prod-github-runner-207 kernel: [39168.572963] Call Trace: Aug 22 16:16:34 juju-e4d256-prod-github-runner-207 kernel: [39168.573900] Aug 22 16:16:34 juju-e4d256-prod-github-runner-207 kernel: [39168.574795] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:16:34 juju-e4d256-prod-github-runner-207 kernel: [39168.575830] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:16:34 juju-e4d256-prod-github-runner-207 kernel: [39168.576858] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:16:34 juju-e4d256-prod-github-runner-207 kernel: [39168.577987] ? show_regs.part.0+0x23/0x29 Aug 22 16:16:34 juju-e4d256-prod-github-runner-207 kernel: [39168.578990] ? show_regs.cold+0x8/0xd Aug 22 16:16:34 juju-e4d256-prod-github-runner-207 kernel: [39168.579964] ? watchdog_timer_fn+0x1be/0x220 Aug 22 16:16:34 juju-e4d256-prod-github-runner-207 kernel: [39168.580982] ? lockup_detector_update_enable+0x60/0x60 Aug 22 16:16:34 juju-e4d256-prod-github-runner-207 kernel: [39168.582167] ? __hrtimer_run_queues+0x107/0x230 Aug 22 16:16:34 juju-e4d256-prod-github-runner-207 kernel: [39168.583317] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 16:16:34 juju-e4d256-prod-github-runner-207 kernel: [39168.584364] ? hrtimer_interrupt+0x101/0x220 Aug 22 16:16:34 juju-e4d256-prod-github-runner-207 kernel: [39168.585382] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 16:16:34 juju-e4d256-prod-github-runner-207 kernel: [39168.586477] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 16:16:34 juju-e4d256-prod-github-runner-207 kernel: [39168.587548] Aug 22 16:16:34 juju-e4d256-prod-github-runner-207 kernel: [39168.588415] Aug 22 16:16:34 juju-e4d256-prod-github-runner-207 kernel: [39168.589260] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 16:16:34 juju-e4d256-prod-github-runner-207 kernel: [39168.590312] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:16:34 juju-e4d256-prod-github-runner-207 kernel: [39168.591354] ? _raw_spin_lock+0x22/0x30 Aug 22 16:16:34 juju-e4d256-prod-github-runner-207 kernel: [39168.592324] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:16:34 juju-e4d256-prod-github-runner-207 kernel: [39168.593383] direct_page_fault+0x206/0x310 [kvm] Aug 22 16:16:34 juju-e4d256-prod-github-runner-207 kernel: [39168.594426] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 16:16:34 juju-e4d256-prod-github-runner-207 kernel: [39168.595443] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 16:16:34 juju-e4d256-prod-github-runner-207 kernel: [39168.596453] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 16:16:34 juju-e4d256-prod-github-runner-207 kernel: [39168.597473] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 16:16:34 juju-e4d256-prod-github-runner-207 kernel: [39168.598446] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 16:16:34 juju-e4d256-prod-github-runner-207 kernel: [39168.599431] handle_exit+0x98/0x230 [kvm_amd] Aug 22 16:16:34 juju-e4d256-prod-github-runner-207 kernel: [39168.600331] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 16:16:34 juju-e4d256-prod-github-runner-207 kernel: [39168.601248] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 16:16:34 juju-e4d256-prod-github-runner-207 kernel: [39168.602210] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 16:16:34 juju-e4d256-prod-github-runner-207 kernel: [39168.603130] vcpu_run+0x62/0x2c0 [kvm] Aug 22 16:16:34 juju-e4d256-prod-github-runner-207 kernel: [39168.603967] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 16:16:34 juju-e4d256-prod-github-runner-207 kernel: [39168.604775] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 16:16:34 juju-e4d256-prod-github-runner-207 kernel: [39168.605653] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 16:16:34 juju-e4d256-prod-github-runner-207 kernel: [39168.606455] ? __seccomp_filter+0x4a/0x4a0 Aug 22 16:16:34 juju-e4d256-prod-github-runner-207 kernel: [39168.607197] ? __fget_files+0x86/0xc0 Aug 22 16:16:34 juju-e4d256-prod-github-runner-207 kernel: [39168.607910] __x64_sys_ioctl+0x95/0xd0 Aug 22 16:16:34 juju-e4d256-prod-github-runner-207 kernel: [39168.608612] do_syscall_64+0x5c/0xc0 Aug 22 16:16:34 juju-e4d256-prod-github-runner-207 kernel: [39168.609281] ? do_futex+0x162/0x1f0 Aug 22 16:16:34 juju-e4d256-prod-github-runner-207 kernel: [39168.609947] ? __x64_sys_futex+0x78/0x1e0 Aug 22 16:16:34 juju-e4d256-prod-github-runner-207 kernel: [39168.610623] ? __secure_computing+0xa9/0x120 Aug 22 16:16:34 juju-e4d256-prod-github-runner-207 kernel: [39168.611313] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 16:16:34 juju-e4d256-prod-github-runner-207 kernel: [39168.612073] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:16:34 juju-e4d256-prod-github-runner-207 kernel: [39168.612809] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:16:34 juju-e4d256-prod-github-runner-207 kernel: [39168.613582] ? do_syscall_64+0x69/0xc0 Aug 22 16:16:34 juju-e4d256-prod-github-runner-207 kernel: [39168.614262] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:16:34 juju-e4d256-prod-github-runner-207 kernel: [39168.614964] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:16:34 juju-e4d256-prod-github-runner-207 kernel: [39168.615660] ? do_syscall_64+0x69/0xc0 Aug 22 16:16:34 juju-e4d256-prod-github-runner-207 kernel: [39168.616281] ? do_syscall_64+0x69/0xc0 Aug 22 16:16:34 juju-e4d256-prod-github-runner-207 kernel: [39168.616900] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 16:16:34 juju-e4d256-prod-github-runner-207 kernel: [39168.617615] RIP: 0033:0x7faa5d0edaff Aug 22 16:16:34 juju-e4d256-prod-github-runner-207 kernel: [39168.618281] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 16:16:34 juju-e4d256-prod-github-runner-207 kernel: [39168.620275] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 16:16:34 juju-e4d256-prod-github-runner-207 kernel: [39168.621203] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 16:16:34 juju-e4d256-prod-github-runner-207 kernel: [39168.622103] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 16:16:34 juju-e4d256-prod-github-runner-207 kernel: [39168.622999] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 16:16:34 juju-e4d256-prod-github-runner-207 kernel: [39168.623910] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 16:16:34 juju-e4d256-prod-github-runner-207 kernel: [39168.624806] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 16:16:34 juju-e4d256-prod-github-runner-207 kernel: [39168.625713] Aug 22 16:17:02 juju-e4d256-prod-github-runner-207 kernel: [39196.541980] watchdog: BUG: soft lockup - CPU#1 stuck for 36396s! [qemu-system-x86:6715] Aug 22 16:17:02 juju-e4d256-prod-github-runner-207 kernel: [39196.544149] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 16:17:02 juju-e4d256-prod-github-runner-207 kernel: [39196.544415] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 16:17:02 juju-e4d256-prod-github-runner-207 kernel: [39196.556823] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 16:17:02 juju-e4d256-prod-github-runner-207 kernel: [39196.558185] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 16:17:02 juju-e4d256-prod-github-runner-207 kernel: [39196.559464] RIP: 0010:native_queued_spin_lock_slowpath+0xc/0x40 Aug 22 16:17:02 juju-e4d256-prod-github-runner-207 kernel: [39196.560523] Code: fe ff ff eb af 4c 89 fe 48 c7 c7 20 99 e9 89 e8 ca 69 55 00 e9 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 <8b> 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 eb Aug 22 16:17:02 juju-e4d256-prod-github-runner-207 kernel: [39196.563090] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 16:17:02 juju-e4d256-prod-github-runner-207 kernel: [39196.564157] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 16:17:02 juju-e4d256-prod-github-runner-207 kernel: [39196.565398] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 16:17:02 juju-e4d256-prod-github-runner-207 kernel: [39196.566598] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 16:17:02 juju-e4d256-prod-github-runner-207 kernel: [39196.567799] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 16:17:02 juju-e4d256-prod-github-runner-207 kernel: [39196.568966] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 16:17:02 juju-e4d256-prod-github-runner-207 kernel: [39196.570149] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 16:17:02 juju-e4d256-prod-github-runner-207 kernel: [39196.571388] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 16:17:02 juju-e4d256-prod-github-runner-207 kernel: [39196.572489] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 16:17:02 juju-e4d256-prod-github-runner-207 kernel: [39196.573770] Call Trace: Aug 22 16:17:02 juju-e4d256-prod-github-runner-207 kernel: [39196.574728] Aug 22 16:17:02 juju-e4d256-prod-github-runner-207 kernel: [39196.575620] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:17:02 juju-e4d256-prod-github-runner-207 kernel: [39196.576727] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:17:02 juju-e4d256-prod-github-runner-207 kernel: [39196.577784] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:17:02 juju-e4d256-prod-github-runner-207 kernel: [39196.578879] ? show_regs.part.0+0x23/0x29 Aug 22 16:17:02 juju-e4d256-prod-github-runner-207 kernel: [39196.579877] ? show_regs.cold+0x8/0xd Aug 22 16:17:02 juju-e4d256-prod-github-runner-207 kernel: [39196.580863] ? watchdog_timer_fn+0x1be/0x220 Aug 22 16:17:02 juju-e4d256-prod-github-runner-207 kernel: [39196.581893] ? lockup_detector_update_enable+0x60/0x60 Aug 22 16:17:02 juju-e4d256-prod-github-runner-207 kernel: [39196.582961] ? __hrtimer_run_queues+0x107/0x230 Aug 22 16:17:02 juju-e4d256-prod-github-runner-207 kernel: [39196.584006] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 16:17:02 juju-e4d256-prod-github-runner-207 kernel: [39196.585073] ? hrtimer_interrupt+0x101/0x220 Aug 22 16:17:02 juju-e4d256-prod-github-runner-207 kernel: [39196.586171] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 16:17:02 juju-e4d256-prod-github-runner-207 kernel: [39196.587266] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 16:17:02 juju-e4d256-prod-github-runner-207 kernel: [39196.588324] Aug 22 16:17:02 juju-e4d256-prod-github-runner-207 kernel: [39196.589177] Aug 22 16:17:02 juju-e4d256-prod-github-runner-207 kernel: [39196.590028] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 16:17:02 juju-e4d256-prod-github-runner-207 kernel: [39196.591140] ? native_queued_spin_lock_slowpath+0xc/0x40 Aug 22 16:17:02 juju-e4d256-prod-github-runner-207 kernel: [39196.592269] ? _raw_spin_lock+0x22/0x30 Aug 22 16:17:02 juju-e4d256-prod-github-runner-207 kernel: [39196.593223] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:17:02 juju-e4d256-prod-github-runner-207 kernel: [39196.594260] direct_page_fault+0x206/0x310 [kvm] Aug 22 16:17:02 juju-e4d256-prod-github-runner-207 kernel: [39196.595285] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 16:17:02 juju-e4d256-prod-github-runner-207 kernel: [39196.596301] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 16:17:02 juju-e4d256-prod-github-runner-207 kernel: [39196.597326] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 16:17:02 juju-e4d256-prod-github-runner-207 kernel: [39196.598321] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 16:17:02 juju-e4d256-prod-github-runner-207 kernel: [39196.599272] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 16:17:02 juju-e4d256-prod-github-runner-207 kernel: [39196.600316] handle_exit+0x98/0x230 [kvm_amd] Aug 22 16:17:02 juju-e4d256-prod-github-runner-207 kernel: [39196.601336] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 16:17:02 juju-e4d256-prod-github-runner-207 kernel: [39196.602267] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 16:17:02 juju-e4d256-prod-github-runner-207 kernel: [39196.603234] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 16:17:02 juju-e4d256-prod-github-runner-207 kernel: [39196.604142] vcpu_run+0x62/0x2c0 [kvm] Aug 22 16:17:02 juju-e4d256-prod-github-runner-207 kernel: [39196.604958] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 16:17:02 juju-e4d256-prod-github-runner-207 kernel: [39196.605779] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 16:17:02 juju-e4d256-prod-github-runner-207 kernel: [39196.606635] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 16:17:02 juju-e4d256-prod-github-runner-207 kernel: [39196.607437] ? __seccomp_filter+0x4a/0x4a0 Aug 22 16:17:02 juju-e4d256-prod-github-runner-207 kernel: [39196.608185] ? __fget_files+0x86/0xc0 Aug 22 16:17:02 juju-e4d256-prod-github-runner-207 kernel: [39196.608918] __x64_sys_ioctl+0x95/0xd0 Aug 22 16:17:02 juju-e4d256-prod-github-runner-207 kernel: [39196.609724] do_syscall_64+0x5c/0xc0 Aug 22 16:17:02 juju-e4d256-prod-github-runner-207 kernel: [39196.610429] ? do_futex+0x162/0x1f0 Aug 22 16:17:02 juju-e4d256-prod-github-runner-207 kernel: [39196.611087] ? __x64_sys_futex+0x78/0x1e0 Aug 22 16:17:02 juju-e4d256-prod-github-runner-207 kernel: [39196.611820] ? __secure_computing+0xa9/0x120 Aug 22 16:17:02 juju-e4d256-prod-github-runner-207 kernel: [39196.612582] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 16:17:02 juju-e4d256-prod-github-runner-207 kernel: [39196.613377] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:17:02 juju-e4d256-prod-github-runner-207 kernel: [39196.614102] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:17:02 juju-e4d256-prod-github-runner-207 kernel: [39196.614825] ? do_syscall_64+0x69/0xc0 Aug 22 16:17:02 juju-e4d256-prod-github-runner-207 kernel: [39196.615473] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:17:02 juju-e4d256-prod-github-runner-207 kernel: [39196.616178] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:17:02 juju-e4d256-prod-github-runner-207 kernel: [39196.616925] ? do_syscall_64+0x69/0xc0 Aug 22 16:17:02 juju-e4d256-prod-github-runner-207 kernel: [39196.617577] ? do_syscall_64+0x69/0xc0 Aug 22 16:17:02 juju-e4d256-prod-github-runner-207 kernel: [39196.618204] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 16:17:02 juju-e4d256-prod-github-runner-207 kernel: [39196.618945] RIP: 0033:0x7faa5d0edaff Aug 22 16:17:02 juju-e4d256-prod-github-runner-207 kernel: [39196.619638] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 16:17:02 juju-e4d256-prod-github-runner-207 kernel: [39196.621665] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 16:17:02 juju-e4d256-prod-github-runner-207 kernel: [39196.622620] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 16:17:02 juju-e4d256-prod-github-runner-207 kernel: [39196.623612] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 16:17:02 juju-e4d256-prod-github-runner-207 kernel: [39196.624571] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 16:17:02 juju-e4d256-prod-github-runner-207 kernel: [39196.625701] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 16:17:02 juju-e4d256-prod-github-runner-207 kernel: [39196.626777] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 16:17:02 juju-e4d256-prod-github-runner-207 kernel: [39196.627688] Aug 22 16:17:30 juju-e4d256-prod-github-runner-207 kernel: [39224.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 36422s! [qemu-system-x86:6715] Aug 22 16:17:30 juju-e4d256-prod-github-runner-207 kernel: [39224.543763] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 16:17:30 juju-e4d256-prod-github-runner-207 kernel: [39224.544036] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 16:17:30 juju-e4d256-prod-github-runner-207 kernel: [39224.556434] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 16:17:30 juju-e4d256-prod-github-runner-207 kernel: [39224.557716] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 16:17:30 juju-e4d256-prod-github-runner-207 kernel: [39224.558937] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:17:30 juju-e4d256-prod-github-runner-207 kernel: [39224.559995] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 16:17:30 juju-e4d256-prod-github-runner-207 kernel: [39224.562540] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 16:17:30 juju-e4d256-prod-github-runner-207 kernel: [39224.563610] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 16:17:30 juju-e4d256-prod-github-runner-207 kernel: [39224.564780] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 16:17:30 juju-e4d256-prod-github-runner-207 kernel: [39224.565947] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 16:17:30 juju-e4d256-prod-github-runner-207 kernel: [39224.567102] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 16:17:30 juju-e4d256-prod-github-runner-207 kernel: [39224.568260] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 16:17:30 juju-e4d256-prod-github-runner-207 kernel: [39224.569456] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 16:17:30 juju-e4d256-prod-github-runner-207 kernel: [39224.570710] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 16:17:30 juju-e4d256-prod-github-runner-207 kernel: [39224.571808] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 16:17:30 juju-e4d256-prod-github-runner-207 kernel: [39224.573011] Call Trace: Aug 22 16:17:30 juju-e4d256-prod-github-runner-207 kernel: [39224.573928] Aug 22 16:17:30 juju-e4d256-prod-github-runner-207 kernel: [39224.574827] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:17:30 juju-e4d256-prod-github-runner-207 kernel: [39224.575865] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:17:30 juju-e4d256-prod-github-runner-207 kernel: [39224.576890] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:17:30 juju-e4d256-prod-github-runner-207 kernel: [39224.577990] ? show_regs.part.0+0x23/0x29 Aug 22 16:17:30 juju-e4d256-prod-github-runner-207 kernel: [39224.578985] ? show_regs.cold+0x8/0xd Aug 22 16:17:30 juju-e4d256-prod-github-runner-207 kernel: [39224.579958] ? watchdog_timer_fn+0x1be/0x220 Aug 22 16:17:30 juju-e4d256-prod-github-runner-207 kernel: [39224.580981] ? lockup_detector_update_enable+0x60/0x60 Aug 22 16:17:30 juju-e4d256-prod-github-runner-207 kernel: [39224.582043] ? __hrtimer_run_queues+0x107/0x230 Aug 22 16:17:30 juju-e4d256-prod-github-runner-207 kernel: [39224.583070] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 16:17:30 juju-e4d256-prod-github-runner-207 kernel: [39224.584099] ? hrtimer_interrupt+0x101/0x220 Aug 22 16:17:30 juju-e4d256-prod-github-runner-207 kernel: [39224.585151] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 16:17:30 juju-e4d256-prod-github-runner-207 kernel: [39224.586234] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 16:17:30 juju-e4d256-prod-github-runner-207 kernel: [39224.587284] Aug 22 16:17:30 juju-e4d256-prod-github-runner-207 kernel: [39224.588135] Aug 22 16:17:30 juju-e4d256-prod-github-runner-207 kernel: [39224.588988] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 16:17:30 juju-e4d256-prod-github-runner-207 kernel: [39224.590028] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:17:30 juju-e4d256-prod-github-runner-207 kernel: [39224.591068] ? _raw_spin_lock+0x22/0x30 Aug 22 16:17:30 juju-e4d256-prod-github-runner-207 kernel: [39224.592015] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:17:30 juju-e4d256-prod-github-runner-207 kernel: [39224.593040] direct_page_fault+0x206/0x310 [kvm] Aug 22 16:17:30 juju-e4d256-prod-github-runner-207 kernel: [39224.594063] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 16:17:30 juju-e4d256-prod-github-runner-207 kernel: [39224.595070] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 16:17:30 juju-e4d256-prod-github-runner-207 kernel: [39224.596069] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 16:17:30 juju-e4d256-prod-github-runner-207 kernel: [39224.597104] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 16:17:30 juju-e4d256-prod-github-runner-207 kernel: [39224.598061] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 16:17:30 juju-e4d256-prod-github-runner-207 kernel: [39224.599046] handle_exit+0x98/0x230 [kvm_amd] Aug 22 16:17:30 juju-e4d256-prod-github-runner-207 kernel: [39224.599941] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 16:17:30 juju-e4d256-prod-github-runner-207 kernel: [39224.600876] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 16:17:30 juju-e4d256-prod-github-runner-207 kernel: [39224.601831] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 16:17:30 juju-e4d256-prod-github-runner-207 kernel: [39224.602760] vcpu_run+0x62/0x2c0 [kvm] Aug 22 16:17:30 juju-e4d256-prod-github-runner-207 kernel: [39224.603575] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 16:17:30 juju-e4d256-prod-github-runner-207 kernel: [39224.604388] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 16:17:30 juju-e4d256-prod-github-runner-207 kernel: [39224.605255] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 16:17:30 juju-e4d256-prod-github-runner-207 kernel: [39224.606052] ? __seccomp_filter+0x4a/0x4a0 Aug 22 16:17:30 juju-e4d256-prod-github-runner-207 kernel: [39224.606802] ? __fget_files+0x86/0xc0 Aug 22 16:17:30 juju-e4d256-prod-github-runner-207 kernel: [39224.607504] __x64_sys_ioctl+0x95/0xd0 Aug 22 16:17:30 juju-e4d256-prod-github-runner-207 kernel: [39224.608200] do_syscall_64+0x5c/0xc0 Aug 22 16:17:30 juju-e4d256-prod-github-runner-207 kernel: [39224.608867] ? do_futex+0x162/0x1f0 Aug 22 16:17:30 juju-e4d256-prod-github-runner-207 kernel: [39224.609522] ? __x64_sys_futex+0x78/0x1e0 Aug 22 16:17:30 juju-e4d256-prod-github-runner-207 kernel: [39224.610193] ? __secure_computing+0xa9/0x120 Aug 22 16:17:30 juju-e4d256-prod-github-runner-207 kernel: [39224.610883] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 16:17:30 juju-e4d256-prod-github-runner-207 kernel: [39224.611644] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:17:30 juju-e4d256-prod-github-runner-207 kernel: [39224.612363] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:17:30 juju-e4d256-prod-github-runner-207 kernel: [39224.613092] ? do_syscall_64+0x69/0xc0 Aug 22 16:17:30 juju-e4d256-prod-github-runner-207 kernel: [39224.613737] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:17:30 juju-e4d256-prod-github-runner-207 kernel: [39224.614437] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:17:30 juju-e4d256-prod-github-runner-207 kernel: [39224.615150] ? do_syscall_64+0x69/0xc0 Aug 22 16:17:30 juju-e4d256-prod-github-runner-207 kernel: [39224.615777] ? do_syscall_64+0x69/0xc0 Aug 22 16:17:30 juju-e4d256-prod-github-runner-207 kernel: [39224.616395] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 16:17:30 juju-e4d256-prod-github-runner-207 kernel: [39224.617108] RIP: 0033:0x7faa5d0edaff Aug 22 16:17:30 juju-e4d256-prod-github-runner-207 kernel: [39224.617748] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 16:17:30 juju-e4d256-prod-github-runner-207 kernel: [39224.619733] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 16:17:30 juju-e4d256-prod-github-runner-207 kernel: [39224.620645] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 16:17:30 juju-e4d256-prod-github-runner-207 kernel: [39224.621554] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 16:17:30 juju-e4d256-prod-github-runner-207 kernel: [39224.622450] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 16:17:30 juju-e4d256-prod-github-runner-207 kernel: [39224.623336] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 16:17:30 juju-e4d256-prod-github-runner-207 kernel: [39224.624221] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 16:17:30 juju-e4d256-prod-github-runner-207 kernel: [39224.625122] Aug 22 16:17:45 juju-e4d256-prod-github-runner-207 kernel: [39239.804705] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 16:17:45 juju-e4d256-prod-github-runner-207 kernel: [39239.805690] rcu: 1-....: (9749979 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=4714655 Aug 22 16:17:45 juju-e4d256-prod-github-runner-207 kernel: [39239.806804] (t=9780651 jiffies g=23269 q=40286) Aug 22 16:17:45 juju-e4d256-prod-github-runner-207 kernel: [39239.807581] NMI backtrace for cpu 1 Aug 22 16:17:45 juju-e4d256-prod-github-runner-207 kernel: [39239.808289] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 16:17:45 juju-e4d256-prod-github-runner-207 kernel: [39239.809406] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 16:17:45 juju-e4d256-prod-github-runner-207 kernel: [39239.810460] Call Trace: Aug 22 16:17:45 juju-e4d256-prod-github-runner-207 kernel: [39239.811134] Aug 22 16:17:45 juju-e4d256-prod-github-runner-207 kernel: [39239.811781] show_stack+0x52/0x5c Aug 22 16:17:45 juju-e4d256-prod-github-runner-207 kernel: [39239.812503] dump_stack_lvl+0x4a/0x63 Aug 22 16:17:45 juju-e4d256-prod-github-runner-207 kernel: [39239.813258] dump_stack+0x10/0x16 Aug 22 16:17:45 juju-e4d256-prod-github-runner-207 kernel: [39239.813978] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 16:17:45 juju-e4d256-prod-github-runner-207 kernel: [39239.814755] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 16:17:45 juju-e4d256-prod-github-runner-207 kernel: [39239.815529] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 16:17:45 juju-e4d256-prod-github-runner-207 kernel: [39239.816350] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 16:17:45 juju-e4d256-prod-github-runner-207 kernel: [39239.817185] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 16:17:45 juju-e4d256-prod-github-runner-207 kernel: [39239.818001] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 16:17:45 juju-e4d256-prod-github-runner-207 kernel: [39239.818776] print_cpu_stall.cold+0x2f/0xe2 Aug 22 16:17:45 juju-e4d256-prod-github-runner-207 kernel: [39239.819538] ? timekeeping_update+0xf7/0x150 Aug 22 16:17:45 juju-e4d256-prod-github-runner-207 kernel: [39239.820305] check_cpu_stall+0x109/0x270 Aug 22 16:17:45 juju-e4d256-prod-github-runner-207 kernel: [39239.821074] rcu_sched_clock_irq+0x9a/0x250 Aug 22 16:17:45 juju-e4d256-prod-github-runner-207 kernel: [39239.821833] update_process_times+0x94/0xd0 Aug 22 16:17:45 juju-e4d256-prod-github-runner-207 kernel: [39239.822590] tick_sched_handle+0x29/0x70 Aug 22 16:17:45 juju-e4d256-prod-github-runner-207 kernel: [39239.823337] tick_sched_timer+0x8c/0xc0 Aug 22 16:17:45 juju-e4d256-prod-github-runner-207 kernel: [39239.824076] ? tick_nohz_handler+0xb0/0xb0 Aug 22 16:17:45 juju-e4d256-prod-github-runner-207 kernel: [39239.824909] __hrtimer_run_queues+0x107/0x230 Aug 22 16:17:45 juju-e4d256-prod-github-runner-207 kernel: [39239.825682] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 16:17:45 juju-e4d256-prod-github-runner-207 kernel: [39239.826456] hrtimer_interrupt+0x101/0x220 Aug 22 16:17:45 juju-e4d256-prod-github-runner-207 kernel: [39239.827211] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 16:17:45 juju-e4d256-prod-github-runner-207 kernel: [39239.828020] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 16:17:45 juju-e4d256-prod-github-runner-207 kernel: [39239.828831] Aug 22 16:17:45 juju-e4d256-prod-github-runner-207 kernel: [39239.829470] Aug 22 16:17:45 juju-e4d256-prod-github-runner-207 kernel: [39239.830101] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 16:17:45 juju-e4d256-prod-github-runner-207 kernel: [39239.830918] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:17:45 juju-e4d256-prod-github-runner-207 kernel: [39239.831800] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 16:17:45 juju-e4d256-prod-github-runner-207 kernel: [39239.834011] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 16:17:45 juju-e4d256-prod-github-runner-207 kernel: [39239.834893] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 16:17:45 juju-e4d256-prod-github-runner-207 kernel: [39239.835885] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 16:17:45 juju-e4d256-prod-github-runner-207 kernel: [39239.836877] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 16:17:45 juju-e4d256-prod-github-runner-207 kernel: [39239.837846] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 16:17:45 juju-e4d256-prod-github-runner-207 kernel: [39239.838813] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 16:17:45 juju-e4d256-prod-github-runner-207 kernel: [39239.839781] ? _raw_spin_lock+0x22/0x30 Aug 22 16:17:45 juju-e4d256-prod-github-runner-207 kernel: [39239.840539] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:17:45 juju-e4d256-prod-github-runner-207 kernel: [39239.841386] direct_page_fault+0x206/0x310 [kvm] Aug 22 16:17:45 juju-e4d256-prod-github-runner-207 kernel: [39239.842223] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 16:17:45 juju-e4d256-prod-github-runner-207 kernel: [39239.843055] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 16:17:45 juju-e4d256-prod-github-runner-207 kernel: [39239.843886] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 16:17:45 juju-e4d256-prod-github-runner-207 kernel: [39239.844691] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 16:17:45 juju-e4d256-prod-github-runner-207 kernel: [39239.845487] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 16:17:45 juju-e4d256-prod-github-runner-207 kernel: [39239.846312] handle_exit+0x98/0x230 [kvm_amd] Aug 22 16:17:45 juju-e4d256-prod-github-runner-207 kernel: [39239.847067] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 16:17:45 juju-e4d256-prod-github-runner-207 kernel: [39239.847860] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 16:17:45 juju-e4d256-prod-github-runner-207 kernel: [39239.848660] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 16:17:45 juju-e4d256-prod-github-runner-207 kernel: [39239.849454] vcpu_run+0x62/0x2c0 [kvm] Aug 22 16:17:45 juju-e4d256-prod-github-runner-207 kernel: [39239.850175] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 16:17:45 juju-e4d256-prod-github-runner-207 kernel: [39239.850910] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 16:17:45 juju-e4d256-prod-github-runner-207 kernel: [39239.851711] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 16:17:45 juju-e4d256-prod-github-runner-207 kernel: [39239.852471] ? __seccomp_filter+0x4a/0x4a0 Aug 22 16:17:45 juju-e4d256-prod-github-runner-207 kernel: [39239.853200] ? __fget_files+0x86/0xc0 Aug 22 16:17:45 juju-e4d256-prod-github-runner-207 kernel: [39239.853898] __x64_sys_ioctl+0x95/0xd0 Aug 22 16:17:45 juju-e4d256-prod-github-runner-207 kernel: [39239.854592] do_syscall_64+0x5c/0xc0 Aug 22 16:17:45 juju-e4d256-prod-github-runner-207 kernel: [39239.855277] ? do_futex+0x162/0x1f0 Aug 22 16:17:45 juju-e4d256-prod-github-runner-207 kernel: [39239.855949] ? __x64_sys_futex+0x78/0x1e0 Aug 22 16:17:45 juju-e4d256-prod-github-runner-207 kernel: [39239.856649] ? __secure_computing+0xa9/0x120 Aug 22 16:17:45 juju-e4d256-prod-github-runner-207 kernel: [39239.857375] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 16:17:45 juju-e4d256-prod-github-runner-207 kernel: [39239.858163] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:17:45 juju-e4d256-prod-github-runner-207 kernel: [39239.858921] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:17:45 juju-e4d256-prod-github-runner-207 kernel: [39239.859673] ? do_syscall_64+0x69/0xc0 Aug 22 16:17:45 juju-e4d256-prod-github-runner-207 kernel: [39239.860374] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:17:45 juju-e4d256-prod-github-runner-207 kernel: [39239.861142] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:17:45 juju-e4d256-prod-github-runner-207 kernel: [39239.861900] ? do_syscall_64+0x69/0xc0 Aug 22 16:17:45 juju-e4d256-prod-github-runner-207 kernel: [39239.862593] ? do_syscall_64+0x69/0xc0 Aug 22 16:17:45 juju-e4d256-prod-github-runner-207 kernel: [39239.863280] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 16:17:45 juju-e4d256-prod-github-runner-207 kernel: [39239.864049] RIP: 0033:0x7faa5d0edaff Aug 22 16:17:45 juju-e4d256-prod-github-runner-207 kernel: [39239.864732] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 16:17:45 juju-e4d256-prod-github-runner-207 kernel: [39239.866839] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 16:17:45 juju-e4d256-prod-github-runner-207 kernel: [39239.867802] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 16:17:45 juju-e4d256-prod-github-runner-207 kernel: [39239.868778] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 16:17:45 juju-e4d256-prod-github-runner-207 kernel: [39239.869731] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 16:17:45 juju-e4d256-prod-github-runner-207 kernel: [39239.870680] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 16:17:45 juju-e4d256-prod-github-runner-207 kernel: [39239.871606] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 16:17:45 juju-e4d256-prod-github-runner-207 kernel: [39239.872522] Aug 22 16:18:10 juju-e4d256-prod-github-runner-207 kernel: [39264.541980] watchdog: BUG: soft lockup - CPU#1 stuck for 36459s! [qemu-system-x86:6715] Aug 22 16:18:10 juju-e4d256-prod-github-runner-207 kernel: [39264.543758] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 16:18:10 juju-e4d256-prod-github-runner-207 kernel: [39264.544013] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 16:18:10 juju-e4d256-prod-github-runner-207 kernel: [39264.556498] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 16:18:10 juju-e4d256-prod-github-runner-207 kernel: [39264.557791] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 16:18:10 juju-e4d256-prod-github-runner-207 kernel: [39264.559032] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:18:10 juju-e4d256-prod-github-runner-207 kernel: [39264.560127] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 16:18:10 juju-e4d256-prod-github-runner-207 kernel: [39264.562886] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 16:18:10 juju-e4d256-prod-github-runner-207 kernel: [39264.563948] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 16:18:10 juju-e4d256-prod-github-runner-207 kernel: [39264.565172] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 16:18:10 juju-e4d256-prod-github-runner-207 kernel: [39264.566377] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 16:18:10 juju-e4d256-prod-github-runner-207 kernel: [39264.567552] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 16:18:10 juju-e4d256-prod-github-runner-207 kernel: [39264.568740] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 16:18:10 juju-e4d256-prod-github-runner-207 kernel: [39264.569912] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 16:18:10 juju-e4d256-prod-github-runner-207 kernel: [39264.571156] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 16:18:10 juju-e4d256-prod-github-runner-207 kernel: [39264.572269] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 16:18:10 juju-e4d256-prod-github-runner-207 kernel: [39264.573488] Call Trace: Aug 22 16:18:10 juju-e4d256-prod-github-runner-207 kernel: [39264.574405] Aug 22 16:18:10 juju-e4d256-prod-github-runner-207 kernel: [39264.575342] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:18:10 juju-e4d256-prod-github-runner-207 kernel: [39264.576403] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:18:10 juju-e4d256-prod-github-runner-207 kernel: [39264.577460] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:18:10 juju-e4d256-prod-github-runner-207 kernel: [39264.578603] ? show_regs.part.0+0x23/0x29 Aug 22 16:18:10 juju-e4d256-prod-github-runner-207 kernel: [39264.579653] ? show_regs.cold+0x8/0xd Aug 22 16:18:10 juju-e4d256-prod-github-runner-207 kernel: [39264.580669] ? watchdog_timer_fn+0x1be/0x220 Aug 22 16:18:10 juju-e4d256-prod-github-runner-207 kernel: [39264.581701] ? lockup_detector_update_enable+0x60/0x60 Aug 22 16:18:10 juju-e4d256-prod-github-runner-207 kernel: [39264.582774] ? __hrtimer_run_queues+0x107/0x230 Aug 22 16:18:10 juju-e4d256-prod-github-runner-207 kernel: [39264.583812] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 16:18:10 juju-e4d256-prod-github-runner-207 kernel: [39264.584861] ? hrtimer_interrupt+0x101/0x220 Aug 22 16:18:10 juju-e4d256-prod-github-runner-207 kernel: [39264.585922] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 16:18:10 juju-e4d256-prod-github-runner-207 kernel: [39264.587022] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 16:18:10 juju-e4d256-prod-github-runner-207 kernel: [39264.588075] Aug 22 16:18:10 juju-e4d256-prod-github-runner-207 kernel: [39264.588959] Aug 22 16:18:10 juju-e4d256-prod-github-runner-207 kernel: [39264.589802] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 16:18:10 juju-e4d256-prod-github-runner-207 kernel: [39264.590854] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:18:10 juju-e4d256-prod-github-runner-207 kernel: [39264.591911] ? _raw_spin_lock+0x22/0x30 Aug 22 16:18:10 juju-e4d256-prod-github-runner-207 kernel: [39264.592877] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:18:10 juju-e4d256-prod-github-runner-207 kernel: [39264.593907] direct_page_fault+0x206/0x310 [kvm] Aug 22 16:18:10 juju-e4d256-prod-github-runner-207 kernel: [39264.594938] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 16:18:10 juju-e4d256-prod-github-runner-207 kernel: [39264.596003] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 16:18:10 juju-e4d256-prod-github-runner-207 kernel: [39264.597061] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 16:18:10 juju-e4d256-prod-github-runner-207 kernel: [39264.598071] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 16:18:10 juju-e4d256-prod-github-runner-207 kernel: [39264.599025] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 16:18:10 juju-e4d256-prod-github-runner-207 kernel: [39264.600007] handle_exit+0x98/0x230 [kvm_amd] Aug 22 16:18:10 juju-e4d256-prod-github-runner-207 kernel: [39264.600919] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 16:18:10 juju-e4d256-prod-github-runner-207 kernel: [39264.601847] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 16:18:10 juju-e4d256-prod-github-runner-207 kernel: [39264.602793] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 16:18:10 juju-e4d256-prod-github-runner-207 kernel: [39264.603711] vcpu_run+0x62/0x2c0 [kvm] Aug 22 16:18:10 juju-e4d256-prod-github-runner-207 kernel: [39264.604639] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 16:18:10 juju-e4d256-prod-github-runner-207 kernel: [39264.605548] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 16:18:10 juju-e4d256-prod-github-runner-207 kernel: [39264.606533] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 16:18:10 juju-e4d256-prod-github-runner-207 kernel: [39264.607456] ? __seccomp_filter+0x4a/0x4a0 Aug 22 16:18:10 juju-e4d256-prod-github-runner-207 kernel: [39264.608299] ? __fget_files+0x86/0xc0 Aug 22 16:18:10 juju-e4d256-prod-github-runner-207 kernel: [39264.609110] __x64_sys_ioctl+0x95/0xd0 Aug 22 16:18:10 juju-e4d256-prod-github-runner-207 kernel: [39264.609880] do_syscall_64+0x5c/0xc0 Aug 22 16:18:10 juju-e4d256-prod-github-runner-207 kernel: [39264.610625] ? do_futex+0x162/0x1f0 Aug 22 16:18:10 juju-e4d256-prod-github-runner-207 kernel: [39264.611345] ? __x64_sys_futex+0x78/0x1e0 Aug 22 16:18:10 juju-e4d256-prod-github-runner-207 kernel: [39264.612105] ? __secure_computing+0xa9/0x120 Aug 22 16:18:10 juju-e4d256-prod-github-runner-207 kernel: [39264.612902] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 16:18:10 juju-e4d256-prod-github-runner-207 kernel: [39264.613777] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:18:10 juju-e4d256-prod-github-runner-207 kernel: [39264.614596] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:18:10 juju-e4d256-prod-github-runner-207 kernel: [39264.615418] ? do_syscall_64+0x69/0xc0 Aug 22 16:18:10 juju-e4d256-prod-github-runner-207 kernel: [39264.616145] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:18:10 juju-e4d256-prod-github-runner-207 kernel: [39264.616968] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:18:10 juju-e4d256-prod-github-runner-207 kernel: [39264.617760] ? do_syscall_64+0x69/0xc0 Aug 22 16:18:10 juju-e4d256-prod-github-runner-207 kernel: [39264.618477] ? do_syscall_64+0x69/0xc0 Aug 22 16:18:10 juju-e4d256-prod-github-runner-207 kernel: [39264.619177] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 16:18:10 juju-e4d256-prod-github-runner-207 kernel: [39264.619979] RIP: 0033:0x7faa5d0edaff Aug 22 16:18:10 juju-e4d256-prod-github-runner-207 kernel: [39264.620749] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 16:18:10 juju-e4d256-prod-github-runner-207 kernel: [39264.622944] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 16:18:10 juju-e4d256-prod-github-runner-207 kernel: [39264.624202] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 16:18:10 juju-e4d256-prod-github-runner-207 kernel: [39264.625261] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 16:18:10 juju-e4d256-prod-github-runner-207 kernel: [39264.626299] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 16:18:10 juju-e4d256-prod-github-runner-207 kernel: [39264.627345] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 16:18:10 juju-e4d256-prod-github-runner-207 kernel: [39264.628375] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 16:18:10 juju-e4d256-prod-github-runner-207 kernel: [39264.629419] Aug 22 16:18:38 juju-e4d256-prod-github-runner-207 kernel: [39292.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 36486s! [qemu-system-x86:6715] Aug 22 16:18:38 juju-e4d256-prod-github-runner-207 kernel: [39292.543709] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 16:18:38 juju-e4d256-prod-github-runner-207 kernel: [39292.543945] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 16:18:38 juju-e4d256-prod-github-runner-207 kernel: [39292.556005] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 16:18:38 juju-e4d256-prod-github-runner-207 kernel: [39292.557289] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 16:18:38 juju-e4d256-prod-github-runner-207 kernel: [39292.558513] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:18:38 juju-e4d256-prod-github-runner-207 kernel: [39292.559575] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 16:18:38 juju-e4d256-prod-github-runner-207 kernel: [39292.562223] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 16:18:38 juju-e4d256-prod-github-runner-207 kernel: [39292.563271] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 16:18:38 juju-e4d256-prod-github-runner-207 kernel: [39292.564440] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 16:18:38 juju-e4d256-prod-github-runner-207 kernel: [39292.565600] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 16:18:38 juju-e4d256-prod-github-runner-207 kernel: [39292.566761] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 16:18:38 juju-e4d256-prod-github-runner-207 kernel: [39292.567924] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 16:18:38 juju-e4d256-prod-github-runner-207 kernel: [39292.569098] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 16:18:38 juju-e4d256-prod-github-runner-207 kernel: [39292.570330] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 16:18:38 juju-e4d256-prod-github-runner-207 kernel: [39292.571425] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 16:18:38 juju-e4d256-prod-github-runner-207 kernel: [39292.572635] Call Trace: Aug 22 16:18:38 juju-e4d256-prod-github-runner-207 kernel: [39292.573551] Aug 22 16:18:38 juju-e4d256-prod-github-runner-207 kernel: [39292.574440] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:18:38 juju-e4d256-prod-github-runner-207 kernel: [39292.575466] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:18:38 juju-e4d256-prod-github-runner-207 kernel: [39292.576505] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:18:38 juju-e4d256-prod-github-runner-207 kernel: [39292.577591] ? show_regs.part.0+0x23/0x29 Aug 22 16:18:38 juju-e4d256-prod-github-runner-207 kernel: [39292.578584] ? show_regs.cold+0x8/0xd Aug 22 16:18:38 juju-e4d256-prod-github-runner-207 kernel: [39292.579557] ? watchdog_timer_fn+0x1be/0x220 Aug 22 16:18:38 juju-e4d256-prod-github-runner-207 kernel: [39292.580575] ? lockup_detector_update_enable+0x60/0x60 Aug 22 16:18:38 juju-e4d256-prod-github-runner-207 kernel: [39292.581638] ? __hrtimer_run_queues+0x107/0x230 Aug 22 16:18:38 juju-e4d256-prod-github-runner-207 kernel: [39292.582681] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 16:18:38 juju-e4d256-prod-github-runner-207 kernel: [39292.583721] ? hrtimer_interrupt+0x101/0x220 Aug 22 16:18:38 juju-e4d256-prod-github-runner-207 kernel: [39292.584743] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 16:18:38 juju-e4d256-prod-github-runner-207 kernel: [39292.585814] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 16:18:38 juju-e4d256-prod-github-runner-207 kernel: [39292.586858] Aug 22 16:18:38 juju-e4d256-prod-github-runner-207 kernel: [39292.587708] Aug 22 16:18:38 juju-e4d256-prod-github-runner-207 kernel: [39292.588554] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 16:18:38 juju-e4d256-prod-github-runner-207 kernel: [39292.589590] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:18:38 juju-e4d256-prod-github-runner-207 kernel: [39292.590628] ? _raw_spin_lock+0x22/0x30 Aug 22 16:18:38 juju-e4d256-prod-github-runner-207 kernel: [39292.591571] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:18:38 juju-e4d256-prod-github-runner-207 kernel: [39292.592599] direct_page_fault+0x206/0x310 [kvm] Aug 22 16:18:38 juju-e4d256-prod-github-runner-207 kernel: [39292.593657] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 16:18:38 juju-e4d256-prod-github-runner-207 kernel: [39292.594662] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 16:18:38 juju-e4d256-prod-github-runner-207 kernel: [39292.595661] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 16:18:38 juju-e4d256-prod-github-runner-207 kernel: [39292.596657] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 16:18:38 juju-e4d256-prod-github-runner-207 kernel: [39292.597603] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 16:18:38 juju-e4d256-prod-github-runner-207 kernel: [39292.598581] handle_exit+0x98/0x230 [kvm_amd] Aug 22 16:18:38 juju-e4d256-prod-github-runner-207 kernel: [39292.599474] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 16:18:38 juju-e4d256-prod-github-runner-207 kernel: [39292.600404] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 16:18:38 juju-e4d256-prod-github-runner-207 kernel: [39292.601333] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 16:18:38 juju-e4d256-prod-github-runner-207 kernel: [39292.602234] vcpu_run+0x62/0x2c0 [kvm] Aug 22 16:18:38 juju-e4d256-prod-github-runner-207 kernel: [39292.603042] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 16:18:38 juju-e4d256-prod-github-runner-207 kernel: [39292.603846] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 16:18:38 juju-e4d256-prod-github-runner-207 kernel: [39292.604714] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 16:18:38 juju-e4d256-prod-github-runner-207 kernel: [39292.605513] ? __seccomp_filter+0x4a/0x4a0 Aug 22 16:18:38 juju-e4d256-prod-github-runner-207 kernel: [39292.606252] ? __fget_files+0x86/0xc0 Aug 22 16:18:38 juju-e4d256-prod-github-runner-207 kernel: [39292.606953] __x64_sys_ioctl+0x95/0xd0 Aug 22 16:18:38 juju-e4d256-prod-github-runner-207 kernel: [39292.607642] do_syscall_64+0x5c/0xc0 Aug 22 16:18:38 juju-e4d256-prod-github-runner-207 kernel: [39292.608316] ? do_futex+0x162/0x1f0 Aug 22 16:18:38 juju-e4d256-prod-github-runner-207 kernel: [39292.608964] ? __x64_sys_futex+0x78/0x1e0 Aug 22 16:18:38 juju-e4d256-prod-github-runner-207 kernel: [39292.609637] ? __secure_computing+0xa9/0x120 Aug 22 16:18:38 juju-e4d256-prod-github-runner-207 kernel: [39292.610326] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 16:18:38 juju-e4d256-prod-github-runner-207 kernel: [39292.611084] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:18:38 juju-e4d256-prod-github-runner-207 kernel: [39292.611808] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:18:38 juju-e4d256-prod-github-runner-207 kernel: [39292.612534] ? do_syscall_64+0x69/0xc0 Aug 22 16:18:38 juju-e4d256-prod-github-runner-207 kernel: [39292.613179] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:18:38 juju-e4d256-prod-github-runner-207 kernel: [39292.613881] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:18:38 juju-e4d256-prod-github-runner-207 kernel: [39292.614580] ? do_syscall_64+0x69/0xc0 Aug 22 16:18:38 juju-e4d256-prod-github-runner-207 kernel: [39292.615203] ? do_syscall_64+0x69/0xc0 Aug 22 16:18:38 juju-e4d256-prod-github-runner-207 kernel: [39292.615828] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 16:18:38 juju-e4d256-prod-github-runner-207 kernel: [39292.616543] RIP: 0033:0x7faa5d0edaff Aug 22 16:18:38 juju-e4d256-prod-github-runner-207 kernel: [39292.617186] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 16:18:38 juju-e4d256-prod-github-runner-207 kernel: [39292.619216] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 16:18:38 juju-e4d256-prod-github-runner-207 kernel: [39292.620138] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 16:18:38 juju-e4d256-prod-github-runner-207 kernel: [39292.621035] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 16:18:38 juju-e4d256-prod-github-runner-207 kernel: [39292.621921] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 16:18:38 juju-e4d256-prod-github-runner-207 kernel: [39292.622806] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 16:18:38 juju-e4d256-prod-github-runner-207 kernel: [39292.623692] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 16:18:38 juju-e4d256-prod-github-runner-207 kernel: [39292.624595] Aug 22 16:19:06 juju-e4d256-prod-github-runner-207 kernel: [39320.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 36512s! [qemu-system-x86:6715] Aug 22 16:19:06 juju-e4d256-prod-github-runner-207 kernel: [39320.543723] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 16:19:06 juju-e4d256-prod-github-runner-207 kernel: [39320.543984] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 16:19:06 juju-e4d256-prod-github-runner-207 kernel: [39320.556083] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 16:19:06 juju-e4d256-prod-github-runner-207 kernel: [39320.557352] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 16:19:06 juju-e4d256-prod-github-runner-207 kernel: [39320.558576] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:19:06 juju-e4d256-prod-github-runner-207 kernel: [39320.559634] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 16:19:06 juju-e4d256-prod-github-runner-207 kernel: [39320.562200] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 16:19:06 juju-e4d256-prod-github-runner-207 kernel: [39320.563244] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 16:19:06 juju-e4d256-prod-github-runner-207 kernel: [39320.564417] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 16:19:06 juju-e4d256-prod-github-runner-207 kernel: [39320.565579] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 16:19:06 juju-e4d256-prod-github-runner-207 kernel: [39320.566746] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 16:19:06 juju-e4d256-prod-github-runner-207 kernel: [39320.567918] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 16:19:06 juju-e4d256-prod-github-runner-207 kernel: [39320.569094] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 16:19:06 juju-e4d256-prod-github-runner-207 kernel: [39320.570333] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 16:19:06 juju-e4d256-prod-github-runner-207 kernel: [39320.571430] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 16:19:06 juju-e4d256-prod-github-runner-207 kernel: [39320.572638] Call Trace: Aug 22 16:19:06 juju-e4d256-prod-github-runner-207 kernel: [39320.573556] Aug 22 16:19:06 juju-e4d256-prod-github-runner-207 kernel: [39320.574448] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:19:06 juju-e4d256-prod-github-runner-207 kernel: [39320.575568] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:19:06 juju-e4d256-prod-github-runner-207 kernel: [39320.576597] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:19:06 juju-e4d256-prod-github-runner-207 kernel: [39320.577706] ? show_regs.part.0+0x23/0x29 Aug 22 16:19:06 juju-e4d256-prod-github-runner-207 kernel: [39320.578703] ? show_regs.cold+0x8/0xd Aug 22 16:19:06 juju-e4d256-prod-github-runner-207 kernel: [39320.579674] ? watchdog_timer_fn+0x1be/0x220 Aug 22 16:19:06 juju-e4d256-prod-github-runner-207 kernel: [39320.580692] ? lockup_detector_update_enable+0x60/0x60 Aug 22 16:19:06 juju-e4d256-prod-github-runner-207 kernel: [39320.581757] ? __hrtimer_run_queues+0x107/0x230 Aug 22 16:19:06 juju-e4d256-prod-github-runner-207 kernel: [39320.582804] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 16:19:06 juju-e4d256-prod-github-runner-207 kernel: [39320.583837] ? hrtimer_interrupt+0x101/0x220 Aug 22 16:19:06 juju-e4d256-prod-github-runner-207 kernel: [39320.584852] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 16:19:06 juju-e4d256-prod-github-runner-207 kernel: [39320.585920] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 16:19:06 juju-e4d256-prod-github-runner-207 kernel: [39320.586965] Aug 22 16:19:06 juju-e4d256-prod-github-runner-207 kernel: [39320.587835] Aug 22 16:19:06 juju-e4d256-prod-github-runner-207 kernel: [39320.588678] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 16:19:06 juju-e4d256-prod-github-runner-207 kernel: [39320.589712] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:19:06 juju-e4d256-prod-github-runner-207 kernel: [39320.590748] ? _raw_spin_lock+0x22/0x30 Aug 22 16:19:06 juju-e4d256-prod-github-runner-207 kernel: [39320.591700] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:19:06 juju-e4d256-prod-github-runner-207 kernel: [39320.592721] direct_page_fault+0x206/0x310 [kvm] Aug 22 16:19:06 juju-e4d256-prod-github-runner-207 kernel: [39320.593743] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 16:19:06 juju-e4d256-prod-github-runner-207 kernel: [39320.594756] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 16:19:06 juju-e4d256-prod-github-runner-207 kernel: [39320.595755] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 16:19:06 juju-e4d256-prod-github-runner-207 kernel: [39320.596753] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 16:19:06 juju-e4d256-prod-github-runner-207 kernel: [39320.597705] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 16:19:06 juju-e4d256-prod-github-runner-207 kernel: [39320.598700] handle_exit+0x98/0x230 [kvm_amd] Aug 22 16:19:06 juju-e4d256-prod-github-runner-207 kernel: [39320.599601] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 16:19:06 juju-e4d256-prod-github-runner-207 kernel: [39320.600522] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 16:19:06 juju-e4d256-prod-github-runner-207 kernel: [39320.601451] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 16:19:06 juju-e4d256-prod-github-runner-207 kernel: [39320.602357] vcpu_run+0x62/0x2c0 [kvm] Aug 22 16:19:06 juju-e4d256-prod-github-runner-207 kernel: [39320.603166] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 16:19:06 juju-e4d256-prod-github-runner-207 kernel: [39320.603992] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 16:19:06 juju-e4d256-prod-github-runner-207 kernel: [39320.604845] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 16:19:06 juju-e4d256-prod-github-runner-207 kernel: [39320.605641] ? __seccomp_filter+0x4a/0x4a0 Aug 22 16:19:06 juju-e4d256-prod-github-runner-207 kernel: [39320.606381] ? __fget_files+0x86/0xc0 Aug 22 16:19:06 juju-e4d256-prod-github-runner-207 kernel: [39320.607082] __x64_sys_ioctl+0x95/0xd0 Aug 22 16:19:06 juju-e4d256-prod-github-runner-207 kernel: [39320.607773] do_syscall_64+0x5c/0xc0 Aug 22 16:19:06 juju-e4d256-prod-github-runner-207 kernel: [39320.608446] ? do_futex+0x162/0x1f0 Aug 22 16:19:06 juju-e4d256-prod-github-runner-207 kernel: [39320.609092] ? __x64_sys_futex+0x78/0x1e0 Aug 22 16:19:06 juju-e4d256-prod-github-runner-207 kernel: [39320.609765] ? __secure_computing+0xa9/0x120 Aug 22 16:19:06 juju-e4d256-prod-github-runner-207 kernel: [39320.610452] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 16:19:06 juju-e4d256-prod-github-runner-207 kernel: [39320.611215] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:19:06 juju-e4d256-prod-github-runner-207 kernel: [39320.611941] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:19:06 juju-e4d256-prod-github-runner-207 kernel: [39320.612657] ? do_syscall_64+0x69/0xc0 Aug 22 16:19:06 juju-e4d256-prod-github-runner-207 kernel: [39320.613303] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:19:06 juju-e4d256-prod-github-runner-207 kernel: [39320.614008] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:19:06 juju-e4d256-prod-github-runner-207 kernel: [39320.614701] ? do_syscall_64+0x69/0xc0 Aug 22 16:19:06 juju-e4d256-prod-github-runner-207 kernel: [39320.615324] ? do_syscall_64+0x69/0xc0 Aug 22 16:19:06 juju-e4d256-prod-github-runner-207 kernel: [39320.615951] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 16:19:06 juju-e4d256-prod-github-runner-207 kernel: [39320.616654] RIP: 0033:0x7faa5d0edaff Aug 22 16:19:06 juju-e4d256-prod-github-runner-207 kernel: [39320.617296] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 16:19:06 juju-e4d256-prod-github-runner-207 kernel: [39320.619287] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 16:19:06 juju-e4d256-prod-github-runner-207 kernel: [39320.620208] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 16:19:06 juju-e4d256-prod-github-runner-207 kernel: [39320.621095] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 16:19:06 juju-e4d256-prod-github-runner-207 kernel: [39320.621982] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 16:19:06 juju-e4d256-prod-github-runner-207 kernel: [39320.622866] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 16:19:06 juju-e4d256-prod-github-runner-207 kernel: [39320.623752] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 16:19:06 juju-e4d256-prod-github-runner-207 kernel: [39320.624654] Aug 22 16:19:34 juju-e4d256-prod-github-runner-207 kernel: [39348.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 36538s! [qemu-system-x86:6715] Aug 22 16:19:34 juju-e4d256-prod-github-runner-207 kernel: [39348.543757] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 16:19:34 juju-e4d256-prod-github-runner-207 kernel: [39348.544022] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 16:19:34 juju-e4d256-prod-github-runner-207 kernel: [39348.556161] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 16:19:34 juju-e4d256-prod-github-runner-207 kernel: [39348.557431] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 16:19:34 juju-e4d256-prod-github-runner-207 kernel: [39348.558656] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:19:34 juju-e4d256-prod-github-runner-207 kernel: [39348.559723] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 16:19:34 juju-e4d256-prod-github-runner-207 kernel: [39348.562272] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 16:19:34 juju-e4d256-prod-github-runner-207 kernel: [39348.563316] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 16:19:34 juju-e4d256-prod-github-runner-207 kernel: [39348.564494] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 16:19:34 juju-e4d256-prod-github-runner-207 kernel: [39348.565650] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 16:19:34 juju-e4d256-prod-github-runner-207 kernel: [39348.566811] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 16:19:34 juju-e4d256-prod-github-runner-207 kernel: [39348.567980] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 16:19:34 juju-e4d256-prod-github-runner-207 kernel: [39348.569144] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 16:19:34 juju-e4d256-prod-github-runner-207 kernel: [39348.570386] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 16:19:34 juju-e4d256-prod-github-runner-207 kernel: [39348.571497] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 16:19:34 juju-e4d256-prod-github-runner-207 kernel: [39348.572688] Call Trace: Aug 22 16:19:34 juju-e4d256-prod-github-runner-207 kernel: [39348.573600] Aug 22 16:19:34 juju-e4d256-prod-github-runner-207 kernel: [39348.574498] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:19:34 juju-e4d256-prod-github-runner-207 kernel: [39348.575544] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:19:34 juju-e4d256-prod-github-runner-207 kernel: [39348.576566] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:19:34 juju-e4d256-prod-github-runner-207 kernel: [39348.577660] ? show_regs.part.0+0x23/0x29 Aug 22 16:19:34 juju-e4d256-prod-github-runner-207 kernel: [39348.578656] ? show_regs.cold+0x8/0xd Aug 22 16:19:34 juju-e4d256-prod-github-runner-207 kernel: [39348.579640] ? watchdog_timer_fn+0x1be/0x220 Aug 22 16:19:34 juju-e4d256-prod-github-runner-207 kernel: [39348.580649] ? lockup_detector_update_enable+0x60/0x60 Aug 22 16:19:34 juju-e4d256-prod-github-runner-207 kernel: [39348.581712] ? __hrtimer_run_queues+0x107/0x230 Aug 22 16:19:34 juju-e4d256-prod-github-runner-207 kernel: [39348.582739] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 16:19:34 juju-e4d256-prod-github-runner-207 kernel: [39348.583777] ? hrtimer_interrupt+0x101/0x220 Aug 22 16:19:34 juju-e4d256-prod-github-runner-207 kernel: [39348.584794] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 16:19:34 juju-e4d256-prod-github-runner-207 kernel: [39348.585869] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 16:19:34 juju-e4d256-prod-github-runner-207 kernel: [39348.586914] Aug 22 16:19:34 juju-e4d256-prod-github-runner-207 kernel: [39348.587784] Aug 22 16:19:34 juju-e4d256-prod-github-runner-207 kernel: [39348.588622] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 16:19:34 juju-e4d256-prod-github-runner-207 kernel: [39348.589661] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:19:34 juju-e4d256-prod-github-runner-207 kernel: [39348.590705] ? _raw_spin_lock+0x22/0x30 Aug 22 16:19:34 juju-e4d256-prod-github-runner-207 kernel: [39348.591661] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:19:34 juju-e4d256-prod-github-runner-207 kernel: [39348.592681] direct_page_fault+0x206/0x310 [kvm] Aug 22 16:19:34 juju-e4d256-prod-github-runner-207 kernel: [39348.593706] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 16:19:34 juju-e4d256-prod-github-runner-207 kernel: [39348.594714] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 16:19:34 juju-e4d256-prod-github-runner-207 kernel: [39348.595736] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 16:19:34 juju-e4d256-prod-github-runner-207 kernel: [39348.596741] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 16:19:34 juju-e4d256-prod-github-runner-207 kernel: [39348.597686] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 16:19:34 juju-e4d256-prod-github-runner-207 kernel: [39348.598664] handle_exit+0x98/0x230 [kvm_amd] Aug 22 16:19:34 juju-e4d256-prod-github-runner-207 kernel: [39348.599576] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 16:19:34 juju-e4d256-prod-github-runner-207 kernel: [39348.600490] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 16:19:34 juju-e4d256-prod-github-runner-207 kernel: [39348.601416] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 16:19:34 juju-e4d256-prod-github-runner-207 kernel: [39348.602321] vcpu_run+0x62/0x2c0 [kvm] Aug 22 16:19:34 juju-e4d256-prod-github-runner-207 kernel: [39348.603131] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 16:19:34 juju-e4d256-prod-github-runner-207 kernel: [39348.603952] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 16:19:34 juju-e4d256-prod-github-runner-207 kernel: [39348.604813] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 16:19:34 juju-e4d256-prod-github-runner-207 kernel: [39348.605611] ? __seccomp_filter+0x4a/0x4a0 Aug 22 16:19:34 juju-e4d256-prod-github-runner-207 kernel: [39348.606354] ? __fget_files+0x86/0xc0 Aug 22 16:19:34 juju-e4d256-prod-github-runner-207 kernel: [39348.607059] __x64_sys_ioctl+0x95/0xd0 Aug 22 16:19:34 juju-e4d256-prod-github-runner-207 kernel: [39348.607770] do_syscall_64+0x5c/0xc0 Aug 22 16:19:34 juju-e4d256-prod-github-runner-207 kernel: [39348.608435] ? do_futex+0x162/0x1f0 Aug 22 16:19:34 juju-e4d256-prod-github-runner-207 kernel: [39348.609084] ? __x64_sys_futex+0x78/0x1e0 Aug 22 16:19:34 juju-e4d256-prod-github-runner-207 kernel: [39348.609760] ? __secure_computing+0xa9/0x120 Aug 22 16:19:34 juju-e4d256-prod-github-runner-207 kernel: [39348.610449] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 16:19:34 juju-e4d256-prod-github-runner-207 kernel: [39348.611211] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:19:34 juju-e4d256-prod-github-runner-207 kernel: [39348.611944] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:19:34 juju-e4d256-prod-github-runner-207 kernel: [39348.612663] ? do_syscall_64+0x69/0xc0 Aug 22 16:19:34 juju-e4d256-prod-github-runner-207 kernel: [39348.613309] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:19:34 juju-e4d256-prod-github-runner-207 kernel: [39348.614018] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:19:34 juju-e4d256-prod-github-runner-207 kernel: [39348.614717] ? do_syscall_64+0x69/0xc0 Aug 22 16:19:34 juju-e4d256-prod-github-runner-207 kernel: [39348.615344] ? do_syscall_64+0x69/0xc0 Aug 22 16:19:34 juju-e4d256-prod-github-runner-207 kernel: [39348.615990] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 16:19:34 juju-e4d256-prod-github-runner-207 kernel: [39348.616697] RIP: 0033:0x7faa5d0edaff Aug 22 16:19:34 juju-e4d256-prod-github-runner-207 kernel: [39348.617362] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 16:19:34 juju-e4d256-prod-github-runner-207 kernel: [39348.619346] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 16:19:34 juju-e4d256-prod-github-runner-207 kernel: [39348.620273] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 16:19:34 juju-e4d256-prod-github-runner-207 kernel: [39348.621167] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 16:19:34 juju-e4d256-prod-github-runner-207 kernel: [39348.622056] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 16:19:34 juju-e4d256-prod-github-runner-207 kernel: [39348.622941] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 16:19:34 juju-e4d256-prod-github-runner-207 kernel: [39348.623842] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 16:19:34 juju-e4d256-prod-github-runner-207 kernel: [39348.624735] Aug 22 16:20:02 juju-e4d256-prod-github-runner-207 kernel: [39376.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 36564s! [qemu-system-x86:6715] Aug 22 16:20:02 juju-e4d256-prod-github-runner-207 kernel: [39376.543743] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 16:20:02 juju-e4d256-prod-github-runner-207 kernel: [39376.543993] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 16:20:02 juju-e4d256-prod-github-runner-207 kernel: [39376.556293] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 16:20:02 juju-e4d256-prod-github-runner-207 kernel: [39376.557565] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 16:20:02 juju-e4d256-prod-github-runner-207 kernel: [39376.558786] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:20:02 juju-e4d256-prod-github-runner-207 kernel: [39376.559883] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 16:20:02 juju-e4d256-prod-github-runner-207 kernel: [39376.562474] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 16:20:02 juju-e4d256-prod-github-runner-207 kernel: [39376.563611] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 16:20:02 juju-e4d256-prod-github-runner-207 kernel: [39376.564776] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 16:20:02 juju-e4d256-prod-github-runner-207 kernel: [39376.565933] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 16:20:02 juju-e4d256-prod-github-runner-207 kernel: [39376.569316] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 16:20:02 juju-e4d256-prod-github-runner-207 kernel: [39376.570498] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 16:20:02 juju-e4d256-prod-github-runner-207 kernel: [39376.571729] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 16:20:02 juju-e4d256-prod-github-runner-207 kernel: [39376.573008] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 16:20:02 juju-e4d256-prod-github-runner-207 kernel: [39376.574127] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 16:20:02 juju-e4d256-prod-github-runner-207 kernel: [39376.575345] Call Trace: Aug 22 16:20:02 juju-e4d256-prod-github-runner-207 kernel: [39376.576259] Aug 22 16:20:02 juju-e4d256-prod-github-runner-207 kernel: [39376.577171] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:20:02 juju-e4d256-prod-github-runner-207 kernel: [39376.578216] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:20:02 juju-e4d256-prod-github-runner-207 kernel: [39376.579267] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:20:02 juju-e4d256-prod-github-runner-207 kernel: [39376.580363] ? show_regs.part.0+0x23/0x29 Aug 22 16:20:02 juju-e4d256-prod-github-runner-207 kernel: [39376.581370] ? show_regs.cold+0x8/0xd Aug 22 16:20:02 juju-e4d256-prod-github-runner-207 kernel: [39376.582360] ? watchdog_timer_fn+0x1be/0x220 Aug 22 16:20:02 juju-e4d256-prod-github-runner-207 kernel: [39376.583407] ? lockup_detector_update_enable+0x60/0x60 Aug 22 16:20:02 juju-e4d256-prod-github-runner-207 kernel: [39376.584481] ? __hrtimer_run_queues+0x107/0x230 Aug 22 16:20:02 juju-e4d256-prod-github-runner-207 kernel: [39376.585523] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 16:20:02 juju-e4d256-prod-github-runner-207 kernel: [39376.586623] ? hrtimer_interrupt+0x101/0x220 Aug 22 16:20:02 juju-e4d256-prod-github-runner-207 kernel: [39376.587795] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 16:20:02 juju-e4d256-prod-github-runner-207 kernel: [39376.588924] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 16:20:02 juju-e4d256-prod-github-runner-207 kernel: [39376.589982] Aug 22 16:20:02 juju-e4d256-prod-github-runner-207 kernel: [39376.590836] Aug 22 16:20:02 juju-e4d256-prod-github-runner-207 kernel: [39376.591706] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 16:20:02 juju-e4d256-prod-github-runner-207 kernel: [39376.592834] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:20:02 juju-e4d256-prod-github-runner-207 kernel: [39376.594116] ? _raw_spin_lock+0x22/0x30 Aug 22 16:20:02 juju-e4d256-prod-github-runner-207 kernel: [39376.595446] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:20:02 juju-e4d256-prod-github-runner-207 kernel: [39376.597106] direct_page_fault+0x206/0x310 [kvm] Aug 22 16:20:02 juju-e4d256-prod-github-runner-207 kernel: [39376.598824] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 16:20:02 juju-e4d256-prod-github-runner-207 kernel: [39376.600252] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 16:20:02 juju-e4d256-prod-github-runner-207 kernel: [39376.601699] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 16:20:02 juju-e4d256-prod-github-runner-207 kernel: [39376.602855] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 16:20:02 juju-e4d256-prod-github-runner-207 kernel: [39376.604200] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 16:20:02 juju-e4d256-prod-github-runner-207 kernel: [39376.605291] handle_exit+0x98/0x230 [kvm_amd] Aug 22 16:20:02 juju-e4d256-prod-github-runner-207 kernel: [39376.606195] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 16:20:02 juju-e4d256-prod-github-runner-207 kernel: [39376.607134] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 16:20:02 juju-e4d256-prod-github-runner-207 kernel: [39376.608096] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 16:20:02 juju-e4d256-prod-github-runner-207 kernel: [39376.609044] vcpu_run+0x62/0x2c0 [kvm] Aug 22 16:20:02 juju-e4d256-prod-github-runner-207 kernel: [39376.609889] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 16:20:02 juju-e4d256-prod-github-runner-207 kernel: [39376.611035] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 16:20:02 juju-e4d256-prod-github-runner-207 kernel: [39376.612283] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 16:20:02 juju-e4d256-prod-github-runner-207 kernel: [39376.613464] ? __seccomp_filter+0x4a/0x4a0 Aug 22 16:20:02 juju-e4d256-prod-github-runner-207 kernel: [39376.614451] ? __fget_files+0x86/0xc0 Aug 22 16:20:02 juju-e4d256-prod-github-runner-207 kernel: [39376.615193] __x64_sys_ioctl+0x95/0xd0 Aug 22 16:20:02 juju-e4d256-prod-github-runner-207 kernel: [39376.615976] do_syscall_64+0x5c/0xc0 Aug 22 16:20:02 juju-e4d256-prod-github-runner-207 kernel: [39376.617011] ? do_futex+0x162/0x1f0 Aug 22 16:20:02 juju-e4d256-prod-github-runner-207 kernel: [39376.617872] ? __x64_sys_futex+0x78/0x1e0 Aug 22 16:20:02 juju-e4d256-prod-github-runner-207 kernel: [39376.618739] ? __secure_computing+0xa9/0x120 Aug 22 16:20:02 juju-e4d256-prod-github-runner-207 kernel: [39376.619471] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 16:20:02 juju-e4d256-prod-github-runner-207 kernel: [39376.620241] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:20:02 juju-e4d256-prod-github-runner-207 kernel: [39376.621087] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:20:02 juju-e4d256-prod-github-runner-207 kernel: [39376.621908] ? do_syscall_64+0x69/0xc0 Aug 22 16:20:02 juju-e4d256-prod-github-runner-207 kernel: [39376.622651] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:20:02 juju-e4d256-prod-github-runner-207 kernel: [39376.623504] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:20:02 juju-e4d256-prod-github-runner-207 kernel: [39376.624302] ? do_syscall_64+0x69/0xc0 Aug 22 16:20:02 juju-e4d256-prod-github-runner-207 kernel: [39376.625003] ? do_syscall_64+0x69/0xc0 Aug 22 16:20:02 juju-e4d256-prod-github-runner-207 kernel: [39376.625701] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 16:20:02 juju-e4d256-prod-github-runner-207 kernel: [39376.626536] RIP: 0033:0x7faa5d0edaff Aug 22 16:20:02 juju-e4d256-prod-github-runner-207 kernel: [39376.627317] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 16:20:02 juju-e4d256-prod-github-runner-207 kernel: [39376.629667] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 16:20:02 juju-e4d256-prod-github-runner-207 kernel: [39376.630734] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 16:20:02 juju-e4d256-prod-github-runner-207 kernel: [39376.631786] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 16:20:02 juju-e4d256-prod-github-runner-207 kernel: [39376.632822] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 16:20:02 juju-e4d256-prod-github-runner-207 kernel: [39376.633859] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 16:20:02 juju-e4d256-prod-github-runner-207 kernel: [39376.634892] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 16:20:02 juju-e4d256-prod-github-runner-207 kernel: [39376.635940] Aug 22 16:20:30 juju-e4d256-prod-github-runner-207 kernel: [39404.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 36590s! [qemu-system-x86:6715] Aug 22 16:20:30 juju-e4d256-prod-github-runner-207 kernel: [39404.543724] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 16:20:30 juju-e4d256-prod-github-runner-207 kernel: [39404.543963] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 16:20:30 juju-e4d256-prod-github-runner-207 kernel: [39404.556206] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 16:20:30 juju-e4d256-prod-github-runner-207 kernel: [39404.557472] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 16:20:30 juju-e4d256-prod-github-runner-207 kernel: [39404.558689] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:20:30 juju-e4d256-prod-github-runner-207 kernel: [39404.559819] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 16:20:30 juju-e4d256-prod-github-runner-207 kernel: [39404.562374] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 16:20:30 juju-e4d256-prod-github-runner-207 kernel: [39404.563490] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 16:20:30 juju-e4d256-prod-github-runner-207 kernel: [39404.564654] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 16:20:30 juju-e4d256-prod-github-runner-207 kernel: [39404.565816] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 16:20:30 juju-e4d256-prod-github-runner-207 kernel: [39404.567051] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 16:20:30 juju-e4d256-prod-github-runner-207 kernel: [39404.568231] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 16:20:30 juju-e4d256-prod-github-runner-207 kernel: [39404.569403] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 16:20:30 juju-e4d256-prod-github-runner-207 kernel: [39404.570826] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 16:20:30 juju-e4d256-prod-github-runner-207 kernel: [39404.571985] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 16:20:30 juju-e4d256-prod-github-runner-207 kernel: [39404.573181] Call Trace: Aug 22 16:20:30 juju-e4d256-prod-github-runner-207 kernel: [39404.574094] Aug 22 16:20:30 juju-e4d256-prod-github-runner-207 kernel: [39404.575073] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:20:30 juju-e4d256-prod-github-runner-207 kernel: [39404.576108] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:20:30 juju-e4d256-prod-github-runner-207 kernel: [39404.577132] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:20:30 juju-e4d256-prod-github-runner-207 kernel: [39404.578225] ? show_regs.part.0+0x23/0x29 Aug 22 16:20:30 juju-e4d256-prod-github-runner-207 kernel: [39404.579294] ? show_regs.cold+0x8/0xd Aug 22 16:20:30 juju-e4d256-prod-github-runner-207 kernel: [39404.580276] ? watchdog_timer_fn+0x1be/0x220 Aug 22 16:20:30 juju-e4d256-prod-github-runner-207 kernel: [39404.581285] ? lockup_detector_update_enable+0x60/0x60 Aug 22 16:20:30 juju-e4d256-prod-github-runner-207 kernel: [39404.582349] ? __hrtimer_run_queues+0x107/0x230 Aug 22 16:20:30 juju-e4d256-prod-github-runner-207 kernel: [39404.583458] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 16:20:30 juju-e4d256-prod-github-runner-207 kernel: [39404.584484] ? hrtimer_interrupt+0x101/0x220 Aug 22 16:20:30 juju-e4d256-prod-github-runner-207 kernel: [39404.585500] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 16:20:30 juju-e4d256-prod-github-runner-207 kernel: [39404.586569] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 16:20:30 juju-e4d256-prod-github-runner-207 kernel: [39404.587678] Aug 22 16:20:30 juju-e4d256-prod-github-runner-207 kernel: [39404.588538] Aug 22 16:20:30 juju-e4d256-prod-github-runner-207 kernel: [39404.589375] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 16:20:30 juju-e4d256-prod-github-runner-207 kernel: [39404.590409] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:20:30 juju-e4d256-prod-github-runner-207 kernel: [39404.591546] ? _raw_spin_lock+0x22/0x30 Aug 22 16:20:30 juju-e4d256-prod-github-runner-207 kernel: [39404.592500] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:20:30 juju-e4d256-prod-github-runner-207 kernel: [39404.593520] direct_page_fault+0x206/0x310 [kvm] Aug 22 16:20:30 juju-e4d256-prod-github-runner-207 kernel: [39404.594544] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 16:20:30 juju-e4d256-prod-github-runner-207 kernel: [39404.595629] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 16:20:30 juju-e4d256-prod-github-runner-207 kernel: [39404.596632] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 16:20:30 juju-e4d256-prod-github-runner-207 kernel: [39404.597635] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 16:20:30 juju-e4d256-prod-github-runner-207 kernel: [39404.598584] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 16:20:30 juju-e4d256-prod-github-runner-207 kernel: [39404.599636] handle_exit+0x98/0x230 [kvm_amd] Aug 22 16:20:30 juju-e4d256-prod-github-runner-207 kernel: [39404.600533] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 16:20:30 juju-e4d256-prod-github-runner-207 kernel: [39404.601454] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 16:20:30 juju-e4d256-prod-github-runner-207 kernel: [39404.602383] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 16:20:30 juju-e4d256-prod-github-runner-207 kernel: [39404.603376] vcpu_run+0x62/0x2c0 [kvm] Aug 22 16:20:30 juju-e4d256-prod-github-runner-207 kernel: [39404.604197] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 16:20:30 juju-e4d256-prod-github-runner-207 kernel: [39404.605005] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 16:20:30 juju-e4d256-prod-github-runner-207 kernel: [39404.605859] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 16:20:30 juju-e4d256-prod-github-runner-207 kernel: [39404.606656] ? __seccomp_filter+0x4a/0x4a0 Aug 22 16:20:30 juju-e4d256-prod-github-runner-207 kernel: [39404.607468] ? __fget_files+0x86/0xc0 Aug 22 16:20:30 juju-e4d256-prod-github-runner-207 kernel: [39404.608178] __x64_sys_ioctl+0x95/0xd0 Aug 22 16:20:30 juju-e4d256-prod-github-runner-207 kernel: [39404.608869] do_syscall_64+0x5c/0xc0 Aug 22 16:20:30 juju-e4d256-prod-github-runner-207 kernel: [39404.609533] ? do_futex+0x162/0x1f0 Aug 22 16:20:30 juju-e4d256-prod-github-runner-207 kernel: [39404.610180] ? __x64_sys_futex+0x78/0x1e0 Aug 22 16:20:30 juju-e4d256-prod-github-runner-207 kernel: [39404.610869] ? __secure_computing+0xa9/0x120 Aug 22 16:20:30 juju-e4d256-prod-github-runner-207 kernel: [39404.611614] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 16:20:30 juju-e4d256-prod-github-runner-207 kernel: [39404.612373] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:20:30 juju-e4d256-prod-github-runner-207 kernel: [39404.613092] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:20:30 juju-e4d256-prod-github-runner-207 kernel: [39404.613809] ? do_syscall_64+0x69/0xc0 Aug 22 16:20:30 juju-e4d256-prod-github-runner-207 kernel: [39404.614462] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:20:30 juju-e4d256-prod-github-runner-207 kernel: [39404.615233] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:20:30 juju-e4d256-prod-github-runner-207 kernel: [39404.615931] ? do_syscall_64+0x69/0xc0 Aug 22 16:20:30 juju-e4d256-prod-github-runner-207 kernel: [39404.616556] ? do_syscall_64+0x69/0xc0 Aug 22 16:20:30 juju-e4d256-prod-github-runner-207 kernel: [39404.617180] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 16:20:30 juju-e4d256-prod-github-runner-207 kernel: [39404.617888] RIP: 0033:0x7faa5d0edaff Aug 22 16:20:30 juju-e4d256-prod-github-runner-207 kernel: [39404.618548] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 16:20:30 juju-e4d256-prod-github-runner-207 kernel: [39404.620595] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 16:20:30 juju-e4d256-prod-github-runner-207 kernel: [39404.621512] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 16:20:30 juju-e4d256-prod-github-runner-207 kernel: [39404.622399] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 16:20:30 juju-e4d256-prod-github-runner-207 kernel: [39404.623358] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 16:20:30 juju-e4d256-prod-github-runner-207 kernel: [39404.624252] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 16:20:30 juju-e4d256-prod-github-runner-207 kernel: [39404.625146] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 16:20:30 juju-e4d256-prod-github-runner-207 kernel: [39404.626040] Aug 22 16:20:45 juju-e4d256-prod-github-runner-207 kernel: [39419.816707] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 16:20:45 juju-e4d256-prod-github-runner-207 kernel: [39419.818298] rcu: 1-....: (9794836 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=4736634 Aug 22 16:20:45 juju-e4d256-prod-github-runner-207 kernel: [39419.819492] (t=9825654 jiffies g=23269 q=40398) Aug 22 16:20:45 juju-e4d256-prod-github-runner-207 kernel: [39419.820273] NMI backtrace for cpu 1 Aug 22 16:20:45 juju-e4d256-prod-github-runner-207 kernel: [39419.820988] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 16:20:45 juju-e4d256-prod-github-runner-207 kernel: [39419.822091] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 16:20:45 juju-e4d256-prod-github-runner-207 kernel: [39419.823207] Call Trace: Aug 22 16:20:45 juju-e4d256-prod-github-runner-207 kernel: [39419.823883] Aug 22 16:20:45 juju-e4d256-prod-github-runner-207 kernel: [39419.824536] show_stack+0x52/0x5c Aug 22 16:20:45 juju-e4d256-prod-github-runner-207 kernel: [39419.825261] dump_stack_lvl+0x4a/0x63 Aug 22 16:20:45 juju-e4d256-prod-github-runner-207 kernel: [39419.826007] dump_stack+0x10/0x16 Aug 22 16:20:45 juju-e4d256-prod-github-runner-207 kernel: [39419.826754] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 16:20:45 juju-e4d256-prod-github-runner-207 kernel: [39419.827589] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 16:20:45 juju-e4d256-prod-github-runner-207 kernel: [39419.828365] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 16:20:45 juju-e4d256-prod-github-runner-207 kernel: [39419.829181] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 16:20:45 juju-e4d256-prod-github-runner-207 kernel: [39419.829998] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 16:20:45 juju-e4d256-prod-github-runner-207 kernel: [39419.830867] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 16:20:45 juju-e4d256-prod-github-runner-207 kernel: [39419.831658] print_cpu_stall.cold+0x2f/0xe2 Aug 22 16:20:45 juju-e4d256-prod-github-runner-207 kernel: [39419.832421] ? timekeeping_update+0xf7/0x150 Aug 22 16:20:45 juju-e4d256-prod-github-runner-207 kernel: [39419.833189] check_cpu_stall+0x109/0x270 Aug 22 16:20:45 juju-e4d256-prod-github-runner-207 kernel: [39419.833942] rcu_sched_clock_irq+0x9a/0x250 Aug 22 16:20:45 juju-e4d256-prod-github-runner-207 kernel: [39419.834729] update_process_times+0x94/0xd0 Aug 22 16:20:45 juju-e4d256-prod-github-runner-207 kernel: [39419.835525] tick_sched_handle+0x29/0x70 Aug 22 16:20:45 juju-e4d256-prod-github-runner-207 kernel: [39419.836270] tick_sched_timer+0x8c/0xc0 Aug 22 16:20:45 juju-e4d256-prod-github-runner-207 kernel: [39419.837012] ? tick_nohz_handler+0xb0/0xb0 Aug 22 16:20:45 juju-e4d256-prod-github-runner-207 kernel: [39419.837770] __hrtimer_run_queues+0x107/0x230 Aug 22 16:20:45 juju-e4d256-prod-github-runner-207 kernel: [39419.838539] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 16:20:45 juju-e4d256-prod-github-runner-207 kernel: [39419.839420] hrtimer_interrupt+0x101/0x220 Aug 22 16:20:45 juju-e4d256-prod-github-runner-207 kernel: [39419.840181] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 16:20:45 juju-e4d256-prod-github-runner-207 kernel: [39419.840993] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 16:20:45 juju-e4d256-prod-github-runner-207 kernel: [39419.841798] Aug 22 16:20:45 juju-e4d256-prod-github-runner-207 kernel: [39419.842432] Aug 22 16:20:45 juju-e4d256-prod-github-runner-207 kernel: [39419.843134] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 16:20:45 juju-e4d256-prod-github-runner-207 kernel: [39419.843963] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:20:45 juju-e4d256-prod-github-runner-207 kernel: [39419.844840] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 16:20:45 juju-e4d256-prod-github-runner-207 kernel: [39419.847119] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 16:20:45 juju-e4d256-prod-github-runner-207 kernel: [39419.847998] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 16:20:45 juju-e4d256-prod-github-runner-207 kernel: [39419.848989] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 16:20:45 juju-e4d256-prod-github-runner-207 kernel: [39419.849971] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 16:20:45 juju-e4d256-prod-github-runner-207 kernel: [39419.851008] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 16:20:45 juju-e4d256-prod-github-runner-207 kernel: [39419.851969] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 16:20:45 juju-e4d256-prod-github-runner-207 kernel: [39419.852931] ? _raw_spin_lock+0x22/0x30 Aug 22 16:20:45 juju-e4d256-prod-github-runner-207 kernel: [39419.853699] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:20:45 juju-e4d256-prod-github-runner-207 kernel: [39419.854551] direct_page_fault+0x206/0x310 [kvm] Aug 22 16:20:45 juju-e4d256-prod-github-runner-207 kernel: [39419.855468] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 16:20:45 juju-e4d256-prod-github-runner-207 kernel: [39419.856308] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 16:20:45 juju-e4d256-prod-github-runner-207 kernel: [39419.857137] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 16:20:45 juju-e4d256-prod-github-runner-207 kernel: [39419.857967] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 16:20:45 juju-e4d256-prod-github-runner-207 kernel: [39419.858797] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 16:20:45 juju-e4d256-prod-github-runner-207 kernel: [39419.859625] handle_exit+0x98/0x230 [kvm_amd] Aug 22 16:20:45 juju-e4d256-prod-github-runner-207 kernel: [39419.860378] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 16:20:45 juju-e4d256-prod-github-runner-207 kernel: [39419.861160] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 16:20:45 juju-e4d256-prod-github-runner-207 kernel: [39419.861958] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 16:20:45 juju-e4d256-prod-github-runner-207 kernel: [39419.862946] vcpu_run+0x62/0x2c0 [kvm] Aug 22 16:20:45 juju-e4d256-prod-github-runner-207 kernel: [39419.863681] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 16:20:45 juju-e4d256-prod-github-runner-207 kernel: [39419.864416] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 16:20:45 juju-e4d256-prod-github-runner-207 kernel: [39419.865356] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 16:20:45 juju-e4d256-prod-github-runner-207 kernel: [39419.866122] ? __seccomp_filter+0x4a/0x4a0 Aug 22 16:20:45 juju-e4d256-prod-github-runner-207 kernel: [39419.866911] ? __fget_files+0x86/0xc0 Aug 22 16:20:45 juju-e4d256-prod-github-runner-207 kernel: [39419.867610] __x64_sys_ioctl+0x95/0xd0 Aug 22 16:20:45 juju-e4d256-prod-github-runner-207 kernel: [39419.868305] do_syscall_64+0x5c/0xc0 Aug 22 16:20:45 juju-e4d256-prod-github-runner-207 kernel: [39419.868993] ? do_futex+0x162/0x1f0 Aug 22 16:20:45 juju-e4d256-prod-github-runner-207 kernel: [39419.869671] ? __x64_sys_futex+0x78/0x1e0 Aug 22 16:20:45 juju-e4d256-prod-github-runner-207 kernel: [39419.870372] ? __secure_computing+0xa9/0x120 Aug 22 16:20:45 juju-e4d256-prod-github-runner-207 kernel: [39419.871154] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 16:20:45 juju-e4d256-prod-github-runner-207 kernel: [39419.871955] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:20:45 juju-e4d256-prod-github-runner-207 kernel: [39419.872710] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:20:45 juju-e4d256-prod-github-runner-207 kernel: [39419.873465] ? do_syscall_64+0x69/0xc0 Aug 22 16:20:45 juju-e4d256-prod-github-runner-207 kernel: [39419.874156] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:20:45 juju-e4d256-prod-github-runner-207 kernel: [39419.874977] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:20:45 juju-e4d256-prod-github-runner-207 kernel: [39419.875739] ? do_syscall_64+0x69/0xc0 Aug 22 16:20:45 juju-e4d256-prod-github-runner-207 kernel: [39419.876432] ? do_syscall_64+0x69/0xc0 Aug 22 16:20:45 juju-e4d256-prod-github-runner-207 kernel: [39419.877119] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 16:20:45 juju-e4d256-prod-github-runner-207 kernel: [39419.877889] RIP: 0033:0x7faa5d0edaff Aug 22 16:20:45 juju-e4d256-prod-github-runner-207 kernel: [39419.878600] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 16:20:45 juju-e4d256-prod-github-runner-207 kernel: [39419.880750] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 16:20:45 juju-e4d256-prod-github-runner-207 kernel: [39419.881711] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 16:20:45 juju-e4d256-prod-github-runner-207 kernel: [39419.882663] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 16:20:45 juju-e4d256-prod-github-runner-207 kernel: [39419.883655] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 16:20:45 juju-e4d256-prod-github-runner-207 kernel: [39419.884600] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 16:20:45 juju-e4d256-prod-github-runner-207 kernel: [39419.885530] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 16:20:45 juju-e4d256-prod-github-runner-207 kernel: [39419.886443] Aug 22 16:21:10 juju-e4d256-prod-github-runner-207 kernel: [39444.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 36627s! [qemu-system-x86:6715] Aug 22 16:21:10 juju-e4d256-prod-github-runner-207 kernel: [39444.543146] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 16:21:10 juju-e4d256-prod-github-runner-207 kernel: [39444.543429] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 16:21:10 juju-e4d256-prod-github-runner-207 kernel: [39444.555562] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 16:21:10 juju-e4d256-prod-github-runner-207 kernel: [39444.556823] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 16:21:10 juju-e4d256-prod-github-runner-207 kernel: [39444.558037] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:21:10 juju-e4d256-prod-github-runner-207 kernel: [39444.559111] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 16:21:10 juju-e4d256-prod-github-runner-207 kernel: [39444.561676] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 16:21:10 juju-e4d256-prod-github-runner-207 kernel: [39444.562743] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 16:21:10 juju-e4d256-prod-github-runner-207 kernel: [39444.563907] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 16:21:10 juju-e4d256-prod-github-runner-207 kernel: [39444.565061] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 16:21:10 juju-e4d256-prod-github-runner-207 kernel: [39444.566217] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 16:21:10 juju-e4d256-prod-github-runner-207 kernel: [39444.567398] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 16:21:10 juju-e4d256-prod-github-runner-207 kernel: [39444.568601] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 16:21:10 juju-e4d256-prod-github-runner-207 kernel: [39444.569874] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 16:21:10 juju-e4d256-prod-github-runner-207 kernel: [39444.570990] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 16:21:10 juju-e4d256-prod-github-runner-207 kernel: [39444.572182] Call Trace: Aug 22 16:21:10 juju-e4d256-prod-github-runner-207 kernel: [39444.573095] Aug 22 16:21:10 juju-e4d256-prod-github-runner-207 kernel: [39444.573978] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:21:10 juju-e4d256-prod-github-runner-207 kernel: [39444.575027] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:21:10 juju-e4d256-prod-github-runner-207 kernel: [39444.576053] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:21:10 juju-e4d256-prod-github-runner-207 kernel: [39444.577125] ? show_regs.part.0+0x23/0x29 Aug 22 16:21:10 juju-e4d256-prod-github-runner-207 kernel: [39444.578122] ? show_regs.cold+0x8/0xd Aug 22 16:21:10 juju-e4d256-prod-github-runner-207 kernel: [39444.579111] ? watchdog_timer_fn+0x1be/0x220 Aug 22 16:21:10 juju-e4d256-prod-github-runner-207 kernel: [39444.580123] ? lockup_detector_update_enable+0x60/0x60 Aug 22 16:21:10 juju-e4d256-prod-github-runner-207 kernel: [39444.581184] ? __hrtimer_run_queues+0x107/0x230 Aug 22 16:21:10 juju-e4d256-prod-github-runner-207 kernel: [39444.582211] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 16:21:10 juju-e4d256-prod-github-runner-207 kernel: [39444.583252] ? hrtimer_interrupt+0x101/0x220 Aug 22 16:21:10 juju-e4d256-prod-github-runner-207 kernel: [39444.584266] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 16:21:10 juju-e4d256-prod-github-runner-207 kernel: [39444.585334] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 16:21:10 juju-e4d256-prod-github-runner-207 kernel: [39444.586397] Aug 22 16:21:10 juju-e4d256-prod-github-runner-207 kernel: [39444.587250] Aug 22 16:21:10 juju-e4d256-prod-github-runner-207 kernel: [39444.588088] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 16:21:10 juju-e4d256-prod-github-runner-207 kernel: [39444.589126] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:21:10 juju-e4d256-prod-github-runner-207 kernel: [39444.590185] ? _raw_spin_lock+0x22/0x30 Aug 22 16:21:10 juju-e4d256-prod-github-runner-207 kernel: [39444.591170] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:21:10 juju-e4d256-prod-github-runner-207 kernel: [39444.592197] direct_page_fault+0x206/0x310 [kvm] Aug 22 16:21:10 juju-e4d256-prod-github-runner-207 kernel: [39444.593219] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 16:21:10 juju-e4d256-prod-github-runner-207 kernel: [39444.594227] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 16:21:10 juju-e4d256-prod-github-runner-207 kernel: [39444.595253] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 16:21:10 juju-e4d256-prod-github-runner-207 kernel: [39444.596225] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 16:21:10 juju-e4d256-prod-github-runner-207 kernel: [39444.597168] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 16:21:10 juju-e4d256-prod-github-runner-207 kernel: [39444.598150] handle_exit+0x98/0x230 [kvm_amd] Aug 22 16:21:10 juju-e4d256-prod-github-runner-207 kernel: [39444.599059] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 16:21:10 juju-e4d256-prod-github-runner-207 kernel: [39444.599971] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 16:21:10 juju-e4d256-prod-github-runner-207 kernel: [39444.600899] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 16:21:10 juju-e4d256-prod-github-runner-207 kernel: [39444.601802] vcpu_run+0x62/0x2c0 [kvm] Aug 22 16:21:10 juju-e4d256-prod-github-runner-207 kernel: [39444.602634] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 16:21:10 juju-e4d256-prod-github-runner-207 kernel: [39444.603447] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 16:21:10 juju-e4d256-prod-github-runner-207 kernel: [39444.604302] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 16:21:10 juju-e4d256-prod-github-runner-207 kernel: [39444.605131] ? __seccomp_filter+0x4a/0x4a0 Aug 22 16:21:10 juju-e4d256-prod-github-runner-207 kernel: [39444.605876] ? __fget_files+0x86/0xc0 Aug 22 16:21:10 juju-e4d256-prod-github-runner-207 kernel: [39444.606599] __x64_sys_ioctl+0x95/0xd0 Aug 22 16:21:10 juju-e4d256-prod-github-runner-207 kernel: [39444.607292] do_syscall_64+0x5c/0xc0 Aug 22 16:21:10 juju-e4d256-prod-github-runner-207 kernel: [39444.607962] ? do_futex+0x162/0x1f0 Aug 22 16:21:10 juju-e4d256-prod-github-runner-207 kernel: [39444.608615] ? __x64_sys_futex+0x78/0x1e0 Aug 22 16:21:10 juju-e4d256-prod-github-runner-207 kernel: [39444.609291] ? __secure_computing+0xa9/0x120 Aug 22 16:21:10 juju-e4d256-prod-github-runner-207 kernel: [39444.609980] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 16:21:10 juju-e4d256-prod-github-runner-207 kernel: [39444.610763] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:21:10 juju-e4d256-prod-github-runner-207 kernel: [39444.611487] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:21:10 juju-e4d256-prod-github-runner-207 kernel: [39444.612209] ? do_syscall_64+0x69/0xc0 Aug 22 16:21:10 juju-e4d256-prod-github-runner-207 kernel: [39444.612854] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:21:10 juju-e4d256-prod-github-runner-207 kernel: [39444.613556] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:21:10 juju-e4d256-prod-github-runner-207 kernel: [39444.614256] ? do_syscall_64+0x69/0xc0 Aug 22 16:21:10 juju-e4d256-prod-github-runner-207 kernel: [39444.615568] ? do_syscall_64+0x69/0xc0 Aug 22 16:21:10 juju-e4d256-prod-github-runner-207 kernel: [39444.616295] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 16:21:10 juju-e4d256-prod-github-runner-207 kernel: [39444.617010] RIP: 0033:0x7faa5d0edaff Aug 22 16:21:10 juju-e4d256-prod-github-runner-207 kernel: [39444.617653] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 16:21:10 juju-e4d256-prod-github-runner-207 kernel: [39444.620359] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 16:21:10 juju-e4d256-prod-github-runner-207 kernel: [39444.621286] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 16:21:10 juju-e4d256-prod-github-runner-207 kernel: [39444.622244] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 16:21:10 juju-e4d256-prod-github-runner-207 kernel: [39444.623155] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 16:21:10 juju-e4d256-prod-github-runner-207 kernel: [39444.624042] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 16:21:10 juju-e4d256-prod-github-runner-207 kernel: [39444.624965] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 16:21:10 juju-e4d256-prod-github-runner-207 kernel: [39444.625865] Aug 22 16:21:38 juju-e4d256-prod-github-runner-207 kernel: [39472.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 36653s! [qemu-system-x86:6715] Aug 22 16:21:38 juju-e4d256-prod-github-runner-207 kernel: [39472.543678] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 16:21:38 juju-e4d256-prod-github-runner-207 kernel: [39472.543917] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 16:21:38 juju-e4d256-prod-github-runner-207 kernel: [39472.556679] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 16:21:38 juju-e4d256-prod-github-runner-207 kernel: [39472.563274] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 16:21:38 juju-e4d256-prod-github-runner-207 kernel: [39472.564983] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:21:38 juju-e4d256-prod-github-runner-207 kernel: [39472.566179] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 16:21:38 juju-e4d256-prod-github-runner-207 kernel: [39472.568717] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 16:21:38 juju-e4d256-prod-github-runner-207 kernel: [39472.569756] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 16:21:38 juju-e4d256-prod-github-runner-207 kernel: [39472.571088] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 16:21:38 juju-e4d256-prod-github-runner-207 kernel: [39472.572427] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 16:21:38 juju-e4d256-prod-github-runner-207 kernel: [39472.573588] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 16:21:38 juju-e4d256-prod-github-runner-207 kernel: [39472.574751] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 16:21:38 juju-e4d256-prod-github-runner-207 kernel: [39472.575918] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 16:21:38 juju-e4d256-prod-github-runner-207 kernel: [39472.577150] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 16:21:38 juju-e4d256-prod-github-runner-207 kernel: [39472.578291] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 16:21:38 juju-e4d256-prod-github-runner-207 kernel: [39472.579480] Call Trace: Aug 22 16:21:38 juju-e4d256-prod-github-runner-207 kernel: [39472.580390] Aug 22 16:21:38 juju-e4d256-prod-github-runner-207 kernel: [39472.581286] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:21:38 juju-e4d256-prod-github-runner-207 kernel: [39472.582325] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:21:38 juju-e4d256-prod-github-runner-207 kernel: [39472.583344] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:21:38 juju-e4d256-prod-github-runner-207 kernel: [39472.584434] ? show_regs.part.0+0x23/0x29 Aug 22 16:21:38 juju-e4d256-prod-github-runner-207 kernel: [39472.585426] ? show_regs.cold+0x8/0xd Aug 22 16:21:38 juju-e4d256-prod-github-runner-207 kernel: [39472.586403] ? watchdog_timer_fn+0x1be/0x220 Aug 22 16:21:38 juju-e4d256-prod-github-runner-207 kernel: [39472.587409] ? lockup_detector_update_enable+0x60/0x60 Aug 22 16:21:38 juju-e4d256-prod-github-runner-207 kernel: [39472.588469] ? __hrtimer_run_queues+0x107/0x230 Aug 22 16:21:38 juju-e4d256-prod-github-runner-207 kernel: [39472.589494] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 16:21:38 juju-e4d256-prod-github-runner-207 kernel: [39472.590527] ? hrtimer_interrupt+0x101/0x220 Aug 22 16:21:38 juju-e4d256-prod-github-runner-207 kernel: [39472.591643] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 16:21:38 juju-e4d256-prod-github-runner-207 kernel: [39472.593015] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 16:21:38 juju-e4d256-prod-github-runner-207 kernel: [39472.594391] Aug 22 16:21:38 juju-e4d256-prod-github-runner-207 kernel: [39472.595336] Aug 22 16:21:38 juju-e4d256-prod-github-runner-207 kernel: [39472.596173] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 16:21:38 juju-e4d256-prod-github-runner-207 kernel: [39472.597207] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:21:38 juju-e4d256-prod-github-runner-207 kernel: [39472.598259] ? _raw_spin_lock+0x22/0x30 Aug 22 16:21:38 juju-e4d256-prod-github-runner-207 kernel: [39472.599208] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:21:38 juju-e4d256-prod-github-runner-207 kernel: [39472.600223] direct_page_fault+0x206/0x310 [kvm] Aug 22 16:21:38 juju-e4d256-prod-github-runner-207 kernel: [39472.601245] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 16:21:38 juju-e4d256-prod-github-runner-207 kernel: [39472.602264] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 16:21:38 juju-e4d256-prod-github-runner-207 kernel: [39472.603265] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 16:21:38 juju-e4d256-prod-github-runner-207 kernel: [39472.604266] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 16:21:38 juju-e4d256-prod-github-runner-207 kernel: [39472.605210] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 16:21:38 juju-e4d256-prod-github-runner-207 kernel: [39472.606201] handle_exit+0x98/0x230 [kvm_amd] Aug 22 16:21:38 juju-e4d256-prod-github-runner-207 kernel: [39472.607092] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 16:21:38 juju-e4d256-prod-github-runner-207 kernel: [39472.608006] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 16:21:38 juju-e4d256-prod-github-runner-207 kernel: [39472.608933] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 16:21:38 juju-e4d256-prod-github-runner-207 kernel: [39472.609834] vcpu_run+0x62/0x2c0 [kvm] Aug 22 16:21:38 juju-e4d256-prod-github-runner-207 kernel: [39472.610659] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 16:21:38 juju-e4d256-prod-github-runner-207 kernel: [39472.611465] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 16:21:38 juju-e4d256-prod-github-runner-207 kernel: [39472.612323] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 16:21:38 juju-e4d256-prod-github-runner-207 kernel: [39472.613118] ? __seccomp_filter+0x4a/0x4a0 Aug 22 16:21:38 juju-e4d256-prod-github-runner-207 kernel: [39472.613860] ? __fget_files+0x86/0xc0 Aug 22 16:21:38 juju-e4d256-prod-github-runner-207 kernel: [39472.614580] __x64_sys_ioctl+0x95/0xd0 Aug 22 16:21:38 juju-e4d256-prod-github-runner-207 kernel: [39472.615271] do_syscall_64+0x5c/0xc0 Aug 22 16:21:38 juju-e4d256-prod-github-runner-207 kernel: [39472.615934] ? do_futex+0x162/0x1f0 Aug 22 16:21:38 juju-e4d256-prod-github-runner-207 kernel: [39472.616627] ? __x64_sys_futex+0x78/0x1e0 Aug 22 16:21:38 juju-e4d256-prod-github-runner-207 kernel: [39472.617306] ? __secure_computing+0xa9/0x120 Aug 22 16:21:38 juju-e4d256-prod-github-runner-207 kernel: [39472.617993] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 16:21:38 juju-e4d256-prod-github-runner-207 kernel: [39472.618766] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:21:38 juju-e4d256-prod-github-runner-207 kernel: [39472.619484] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:21:38 juju-e4d256-prod-github-runner-207 kernel: [39472.620204] ? do_syscall_64+0x69/0xc0 Aug 22 16:21:38 juju-e4d256-prod-github-runner-207 kernel: [39472.620845] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:21:38 juju-e4d256-prod-github-runner-207 kernel: [39472.621546] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:21:38 juju-e4d256-prod-github-runner-207 kernel: [39472.622251] ? do_syscall_64+0x69/0xc0 Aug 22 16:21:38 juju-e4d256-prod-github-runner-207 kernel: [39472.622875] ? do_syscall_64+0x69/0xc0 Aug 22 16:21:38 juju-e4d256-prod-github-runner-207 kernel: [39472.623563] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 16:21:38 juju-e4d256-prod-github-runner-207 kernel: [39472.624502] RIP: 0033:0x7faa5d0edaff Aug 22 16:21:38 juju-e4d256-prod-github-runner-207 kernel: [39472.625401] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 16:21:38 juju-e4d256-prod-github-runner-207 kernel: [39472.634562] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 16:21:38 juju-e4d256-prod-github-runner-207 kernel: [39472.635627] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 16:21:38 juju-e4d256-prod-github-runner-207 kernel: [39472.636664] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 16:21:38 juju-e4d256-prod-github-runner-207 kernel: [39472.637693] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 16:21:38 juju-e4d256-prod-github-runner-207 kernel: [39472.638741] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 16:21:38 juju-e4d256-prod-github-runner-207 kernel: [39472.639767] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 16:21:38 juju-e4d256-prod-github-runner-207 kernel: [39472.640808] Aug 22 16:22:06 juju-e4d256-prod-github-runner-207 kernel: [39500.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 36679s! [qemu-system-x86:6715] Aug 22 16:22:06 juju-e4d256-prod-github-runner-207 kernel: [39500.544106] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 16:22:06 juju-e4d256-prod-github-runner-207 kernel: [39500.544445] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 16:22:06 juju-e4d256-prod-github-runner-207 kernel: [39500.557354] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 16:22:06 juju-e4d256-prod-github-runner-207 kernel: [39500.558732] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 16:22:06 juju-e4d256-prod-github-runner-207 kernel: [39500.559983] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:22:06 juju-e4d256-prod-github-runner-207 kernel: [39500.561202] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 16:22:06 juju-e4d256-prod-github-runner-207 kernel: [39500.563915] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 16:22:06 juju-e4d256-prod-github-runner-207 kernel: [39500.564996] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 16:22:06 juju-e4d256-prod-github-runner-207 kernel: [39500.566206] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 16:22:06 juju-e4d256-prod-github-runner-207 kernel: [39500.567390] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 16:22:06 juju-e4d256-prod-github-runner-207 kernel: [39500.568604] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 16:22:06 juju-e4d256-prod-github-runner-207 kernel: [39500.569828] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 16:22:06 juju-e4d256-prod-github-runner-207 kernel: [39500.571030] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 16:22:06 juju-e4d256-prod-github-runner-207 kernel: [39500.572296] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 16:22:06 juju-e4d256-prod-github-runner-207 kernel: [39500.573410] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 16:22:06 juju-e4d256-prod-github-runner-207 kernel: [39500.574665] Call Trace: Aug 22 16:22:06 juju-e4d256-prod-github-runner-207 kernel: [39500.575592] Aug 22 16:22:06 juju-e4d256-prod-github-runner-207 kernel: [39500.576506] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:22:06 juju-e4d256-prod-github-runner-207 kernel: [39500.577598] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:22:06 juju-e4d256-prod-github-runner-207 kernel: [39500.578659] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:22:06 juju-e4d256-prod-github-runner-207 kernel: [39500.579780] ? show_regs.part.0+0x23/0x29 Aug 22 16:22:06 juju-e4d256-prod-github-runner-207 kernel: [39500.580802] ? show_regs.cold+0x8/0xd Aug 22 16:22:06 juju-e4d256-prod-github-runner-207 kernel: [39500.581824] ? watchdog_timer_fn+0x1be/0x220 Aug 22 16:22:06 juju-e4d256-prod-github-runner-207 kernel: [39500.582853] ? lockup_detector_update_enable+0x60/0x60 Aug 22 16:22:06 juju-e4d256-prod-github-runner-207 kernel: [39500.583941] ? __hrtimer_run_queues+0x107/0x230 Aug 22 16:22:06 juju-e4d256-prod-github-runner-207 kernel: [39500.584987] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 16:22:06 juju-e4d256-prod-github-runner-207 kernel: [39500.586040] ? hrtimer_interrupt+0x101/0x220 Aug 22 16:22:06 juju-e4d256-prod-github-runner-207 kernel: [39500.587072] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 16:22:06 juju-e4d256-prod-github-runner-207 kernel: [39500.588167] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 16:22:06 juju-e4d256-prod-github-runner-207 kernel: [39500.589238] Aug 22 16:22:06 juju-e4d256-prod-github-runner-207 kernel: [39500.590136] Aug 22 16:22:06 juju-e4d256-prod-github-runner-207 kernel: [39500.591027] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 16:22:06 juju-e4d256-prod-github-runner-207 kernel: [39500.592098] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:22:06 juju-e4d256-prod-github-runner-207 kernel: [39500.593165] ? _raw_spin_lock+0x22/0x30 Aug 22 16:22:06 juju-e4d256-prod-github-runner-207 kernel: [39500.594146] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:22:06 juju-e4d256-prod-github-runner-207 kernel: [39500.595187] direct_page_fault+0x206/0x310 [kvm] Aug 22 16:22:06 juju-e4d256-prod-github-runner-207 kernel: [39500.596224] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 16:22:06 juju-e4d256-prod-github-runner-207 kernel: [39500.597252] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 16:22:06 juju-e4d256-prod-github-runner-207 kernel: [39500.598289] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 16:22:06 juju-e4d256-prod-github-runner-207 kernel: [39500.599318] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 16:22:06 juju-e4d256-prod-github-runner-207 kernel: [39500.600281] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 16:22:06 juju-e4d256-prod-github-runner-207 kernel: [39500.601277] handle_exit+0x98/0x230 [kvm_amd] Aug 22 16:22:06 juju-e4d256-prod-github-runner-207 kernel: [39500.602196] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 16:22:06 juju-e4d256-prod-github-runner-207 kernel: [39500.603125] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 16:22:06 juju-e4d256-prod-github-runner-207 kernel: [39500.604066] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 16:22:06 juju-e4d256-prod-github-runner-207 kernel: [39500.604989] vcpu_run+0x62/0x2c0 [kvm] Aug 22 16:22:06 juju-e4d256-prod-github-runner-207 kernel: [39500.605832] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 16:22:06 juju-e4d256-prod-github-runner-207 kernel: [39500.606657] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 16:22:06 juju-e4d256-prod-github-runner-207 kernel: [39500.607522] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 16:22:06 juju-e4d256-prod-github-runner-207 kernel: [39500.608340] ? __seccomp_filter+0x4a/0x4a0 Aug 22 16:22:06 juju-e4d256-prod-github-runner-207 kernel: [39500.609101] ? __fget_files+0x86/0xc0 Aug 22 16:22:06 juju-e4d256-prod-github-runner-207 kernel: [39500.609836] __x64_sys_ioctl+0x95/0xd0 Aug 22 16:22:06 juju-e4d256-prod-github-runner-207 kernel: [39500.610539] do_syscall_64+0x5c/0xc0 Aug 22 16:22:06 juju-e4d256-prod-github-runner-207 kernel: [39500.611207] ? do_futex+0x162/0x1f0 Aug 22 16:22:06 juju-e4d256-prod-github-runner-207 kernel: [39500.611862] ? __x64_sys_futex+0x78/0x1e0 Aug 22 16:22:06 juju-e4d256-prod-github-runner-207 kernel: [39500.612552] ? __secure_computing+0xa9/0x120 Aug 22 16:22:06 juju-e4d256-prod-github-runner-207 kernel: [39500.613256] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 16:22:06 juju-e4d256-prod-github-runner-207 kernel: [39500.614027] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:22:06 juju-e4d256-prod-github-runner-207 kernel: [39500.614752] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:22:06 juju-e4d256-prod-github-runner-207 kernel: [39500.615492] ? do_syscall_64+0x69/0xc0 Aug 22 16:22:06 juju-e4d256-prod-github-runner-207 kernel: [39500.616206] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:22:06 juju-e4d256-prod-github-runner-207 kernel: [39500.616912] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:22:06 juju-e4d256-prod-github-runner-207 kernel: [39500.617653] ? do_syscall_64+0x69/0xc0 Aug 22 16:22:06 juju-e4d256-prod-github-runner-207 kernel: [39500.618302] ? do_syscall_64+0x69/0xc0 Aug 22 16:22:06 juju-e4d256-prod-github-runner-207 kernel: [39500.618927] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 16:22:06 juju-e4d256-prod-github-runner-207 kernel: [39500.619633] RIP: 0033:0x7faa5d0edaff Aug 22 16:22:06 juju-e4d256-prod-github-runner-207 kernel: [39500.620299] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 16:22:06 juju-e4d256-prod-github-runner-207 kernel: [39500.622499] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 16:22:06 juju-e4d256-prod-github-runner-207 kernel: [39500.623418] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 16:22:06 juju-e4d256-prod-github-runner-207 kernel: [39500.624312] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 16:22:06 juju-e4d256-prod-github-runner-207 kernel: [39500.625203] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 16:22:06 juju-e4d256-prod-github-runner-207 kernel: [39500.626112] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 16:22:06 juju-e4d256-prod-github-runner-207 kernel: [39500.627012] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 16:22:06 juju-e4d256-prod-github-runner-207 kernel: [39500.627915] Aug 22 16:22:34 juju-e4d256-prod-github-runner-207 kernel: [39528.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 36705s! [qemu-system-x86:6715] Aug 22 16:22:34 juju-e4d256-prod-github-runner-207 kernel: [39528.543775] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 16:22:34 juju-e4d256-prod-github-runner-207 kernel: [39528.544045] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 16:22:34 juju-e4d256-prod-github-runner-207 kernel: [39528.556287] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 16:22:34 juju-e4d256-prod-github-runner-207 kernel: [39528.557606] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 16:22:34 juju-e4d256-prod-github-runner-207 kernel: [39528.558829] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:22:34 juju-e4d256-prod-github-runner-207 kernel: [39528.559882] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 16:22:34 juju-e4d256-prod-github-runner-207 kernel: [39528.562448] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 16:22:34 juju-e4d256-prod-github-runner-207 kernel: [39528.563490] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 16:22:34 juju-e4d256-prod-github-runner-207 kernel: [39528.564658] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 16:22:34 juju-e4d256-prod-github-runner-207 kernel: [39528.565838] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 16:22:34 juju-e4d256-prod-github-runner-207 kernel: [39528.567015] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 16:22:34 juju-e4d256-prod-github-runner-207 kernel: [39528.568171] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 16:22:34 juju-e4d256-prod-github-runner-207 kernel: [39528.569341] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 16:22:34 juju-e4d256-prod-github-runner-207 kernel: [39528.570604] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 16:22:34 juju-e4d256-prod-github-runner-207 kernel: [39528.571702] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 16:22:34 juju-e4d256-prod-github-runner-207 kernel: [39528.572892] Call Trace: Aug 22 16:22:34 juju-e4d256-prod-github-runner-207 kernel: [39528.573852] Aug 22 16:22:34 juju-e4d256-prod-github-runner-207 kernel: [39528.574780] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:22:34 juju-e4d256-prod-github-runner-207 kernel: [39528.575810] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:22:34 juju-e4d256-prod-github-runner-207 kernel: [39528.576830] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:22:34 juju-e4d256-prod-github-runner-207 kernel: [39528.577947] ? show_regs.part.0+0x23/0x29 Aug 22 16:22:34 juju-e4d256-prod-github-runner-207 kernel: [39528.578944] ? show_regs.cold+0x8/0xd Aug 22 16:22:34 juju-e4d256-prod-github-runner-207 kernel: [39528.579914] ? watchdog_timer_fn+0x1be/0x220 Aug 22 16:22:34 juju-e4d256-prod-github-runner-207 kernel: [39528.580924] ? lockup_detector_update_enable+0x60/0x60 Aug 22 16:22:34 juju-e4d256-prod-github-runner-207 kernel: [39528.582043] ? __hrtimer_run_queues+0x107/0x230 Aug 22 16:22:34 juju-e4d256-prod-github-runner-207 kernel: [39528.583072] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 16:22:34 juju-e4d256-prod-github-runner-207 kernel: [39528.584098] ? hrtimer_interrupt+0x101/0x220 Aug 22 16:22:34 juju-e4d256-prod-github-runner-207 kernel: [39528.585111] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 16:22:34 juju-e4d256-prod-github-runner-207 kernel: [39528.586190] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 16:22:34 juju-e4d256-prod-github-runner-207 kernel: [39528.587237] Aug 22 16:22:34 juju-e4d256-prod-github-runner-207 kernel: [39528.588093] Aug 22 16:22:34 juju-e4d256-prod-github-runner-207 kernel: [39528.588944] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 16:22:34 juju-e4d256-prod-github-runner-207 kernel: [39528.590011] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:22:34 juju-e4d256-prod-github-runner-207 kernel: [39528.591057] ? _raw_spin_lock+0x22/0x30 Aug 22 16:22:34 juju-e4d256-prod-github-runner-207 kernel: [39528.592000] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:22:34 juju-e4d256-prod-github-runner-207 kernel: [39528.593020] direct_page_fault+0x206/0x310 [kvm] Aug 22 16:22:34 juju-e4d256-prod-github-runner-207 kernel: [39528.594056] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 16:22:34 juju-e4d256-prod-github-runner-207 kernel: [39528.595085] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 16:22:34 juju-e4d256-prod-github-runner-207 kernel: [39528.596105] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 16:22:34 juju-e4d256-prod-github-runner-207 kernel: [39528.597128] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 16:22:34 juju-e4d256-prod-github-runner-207 kernel: [39528.598091] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 16:22:34 juju-e4d256-prod-github-runner-207 kernel: [39528.599068] handle_exit+0x98/0x230 [kvm_amd] Aug 22 16:22:34 juju-e4d256-prod-github-runner-207 kernel: [39528.599961] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 16:22:34 juju-e4d256-prod-github-runner-207 kernel: [39528.600874] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 16:22:34 juju-e4d256-prod-github-runner-207 kernel: [39528.601809] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 16:22:34 juju-e4d256-prod-github-runner-207 kernel: [39528.602723] vcpu_run+0x62/0x2c0 [kvm] Aug 22 16:22:34 juju-e4d256-prod-github-runner-207 kernel: [39528.603543] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 16:22:34 juju-e4d256-prod-github-runner-207 kernel: [39528.604349] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 16:22:34 juju-e4d256-prod-github-runner-207 kernel: [39528.605204] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 16:22:34 juju-e4d256-prod-github-runner-207 kernel: [39528.606015] ? __seccomp_filter+0x4a/0x4a0 Aug 22 16:22:34 juju-e4d256-prod-github-runner-207 kernel: [39528.606761] ? __fget_files+0x86/0xc0 Aug 22 16:22:34 juju-e4d256-prod-github-runner-207 kernel: [39528.607462] __x64_sys_ioctl+0x95/0xd0 Aug 22 16:22:34 juju-e4d256-prod-github-runner-207 kernel: [39528.608153] do_syscall_64+0x5c/0xc0 Aug 22 16:22:34 juju-e4d256-prod-github-runner-207 kernel: [39528.608816] ? do_futex+0x162/0x1f0 Aug 22 16:22:34 juju-e4d256-prod-github-runner-207 kernel: [39528.609484] ? __x64_sys_futex+0x78/0x1e0 Aug 22 16:22:34 juju-e4d256-prod-github-runner-207 kernel: [39528.610163] ? __secure_computing+0xa9/0x120 Aug 22 16:22:34 juju-e4d256-prod-github-runner-207 kernel: [39528.610851] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 16:22:34 juju-e4d256-prod-github-runner-207 kernel: [39528.611609] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:22:34 juju-e4d256-prod-github-runner-207 kernel: [39528.612328] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:22:34 juju-e4d256-prod-github-runner-207 kernel: [39528.613044] ? do_syscall_64+0x69/0xc0 Aug 22 16:22:34 juju-e4d256-prod-github-runner-207 kernel: [39528.613709] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:22:34 juju-e4d256-prod-github-runner-207 kernel: [39528.614412] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:22:34 juju-e4d256-prod-github-runner-207 kernel: [39528.615106] ? do_syscall_64+0x69/0xc0 Aug 22 16:22:34 juju-e4d256-prod-github-runner-207 kernel: [39528.615742] ? do_syscall_64+0x69/0xc0 Aug 22 16:22:34 juju-e4d256-prod-github-runner-207 kernel: [39528.616363] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 16:22:34 juju-e4d256-prod-github-runner-207 kernel: [39528.617071] RIP: 0033:0x7faa5d0edaff Aug 22 16:22:34 juju-e4d256-prod-github-runner-207 kernel: [39528.617756] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 16:22:34 juju-e4d256-prod-github-runner-207 kernel: [39528.619747] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 16:22:34 juju-e4d256-prod-github-runner-207 kernel: [39528.620661] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 16:22:34 juju-e4d256-prod-github-runner-207 kernel: [39528.621585] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 16:22:34 juju-e4d256-prod-github-runner-207 kernel: [39528.622478] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 16:22:34 juju-e4d256-prod-github-runner-207 kernel: [39528.623365] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 16:22:34 juju-e4d256-prod-github-runner-207 kernel: [39528.624253] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 16:22:34 juju-e4d256-prod-github-runner-207 kernel: [39528.625146] Aug 22 16:23:02 juju-e4d256-prod-github-runner-207 kernel: [39556.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 36731s! [qemu-system-x86:6715] Aug 22 16:23:02 juju-e4d256-prod-github-runner-207 kernel: [39556.543767] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 16:23:02 juju-e4d256-prod-github-runner-207 kernel: [39556.544040] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 16:23:02 juju-e4d256-prod-github-runner-207 kernel: [39556.556305] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 16:23:02 juju-e4d256-prod-github-runner-207 kernel: [39556.557582] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 16:23:02 juju-e4d256-prod-github-runner-207 kernel: [39556.558804] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:23:02 juju-e4d256-prod-github-runner-207 kernel: [39556.559868] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 16:23:02 juju-e4d256-prod-github-runner-207 kernel: [39556.562431] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 16:23:02 juju-e4d256-prod-github-runner-207 kernel: [39556.563478] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 16:23:02 juju-e4d256-prod-github-runner-207 kernel: [39556.564643] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 16:23:02 juju-e4d256-prod-github-runner-207 kernel: [39556.565820] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 16:23:02 juju-e4d256-prod-github-runner-207 kernel: [39556.566987] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 16:23:02 juju-e4d256-prod-github-runner-207 kernel: [39556.568149] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 16:23:02 juju-e4d256-prod-github-runner-207 kernel: [39556.569327] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 16:23:02 juju-e4d256-prod-github-runner-207 kernel: [39556.570562] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 16:23:02 juju-e4d256-prod-github-runner-207 kernel: [39556.571659] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 16:23:02 juju-e4d256-prod-github-runner-207 kernel: [39556.572860] Call Trace: Aug 22 16:23:02 juju-e4d256-prod-github-runner-207 kernel: [39556.573784] Aug 22 16:23:02 juju-e4d256-prod-github-runner-207 kernel: [39556.574679] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:23:02 juju-e4d256-prod-github-runner-207 kernel: [39556.575709] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:23:02 juju-e4d256-prod-github-runner-207 kernel: [39556.576728] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:23:02 juju-e4d256-prod-github-runner-207 kernel: [39556.577836] ? show_regs.part.0+0x23/0x29 Aug 22 16:23:02 juju-e4d256-prod-github-runner-207 kernel: [39556.578833] ? show_regs.cold+0x8/0xd Aug 22 16:23:02 juju-e4d256-prod-github-runner-207 kernel: [39556.579803] ? watchdog_timer_fn+0x1be/0x220 Aug 22 16:23:02 juju-e4d256-prod-github-runner-207 kernel: [39556.580810] ? lockup_detector_update_enable+0x60/0x60 Aug 22 16:23:02 juju-e4d256-prod-github-runner-207 kernel: [39556.581894] ? __hrtimer_run_queues+0x107/0x230 Aug 22 16:23:02 juju-e4d256-prod-github-runner-207 kernel: [39556.582923] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 16:23:02 juju-e4d256-prod-github-runner-207 kernel: [39556.583952] ? hrtimer_interrupt+0x101/0x220 Aug 22 16:23:02 juju-e4d256-prod-github-runner-207 kernel: [39556.584967] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 16:23:02 juju-e4d256-prod-github-runner-207 kernel: [39556.586047] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 16:23:02 juju-e4d256-prod-github-runner-207 kernel: [39556.587093] Aug 22 16:23:02 juju-e4d256-prod-github-runner-207 kernel: [39556.587951] Aug 22 16:23:02 juju-e4d256-prod-github-runner-207 kernel: [39556.588787] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 16:23:02 juju-e4d256-prod-github-runner-207 kernel: [39556.589836] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:23:02 juju-e4d256-prod-github-runner-207 kernel: [39556.590875] ? _raw_spin_lock+0x22/0x30 Aug 22 16:23:02 juju-e4d256-prod-github-runner-207 kernel: [39556.591853] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:23:02 juju-e4d256-prod-github-runner-207 kernel: [39556.592890] direct_page_fault+0x206/0x310 [kvm] Aug 22 16:23:02 juju-e4d256-prod-github-runner-207 kernel: [39556.593936] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 16:23:02 juju-e4d256-prod-github-runner-207 kernel: [39556.594943] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 16:23:02 juju-e4d256-prod-github-runner-207 kernel: [39556.595946] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 16:23:02 juju-e4d256-prod-github-runner-207 kernel: [39556.596949] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 16:23:02 juju-e4d256-prod-github-runner-207 kernel: [39556.597908] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 16:23:02 juju-e4d256-prod-github-runner-207 kernel: [39556.598884] handle_exit+0x98/0x230 [kvm_amd] Aug 22 16:23:02 juju-e4d256-prod-github-runner-207 kernel: [39556.599775] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 16:23:02 juju-e4d256-prod-github-runner-207 kernel: [39556.600698] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 16:23:02 juju-e4d256-prod-github-runner-207 kernel: [39556.601639] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 16:23:02 juju-e4d256-prod-github-runner-207 kernel: [39556.602553] vcpu_run+0x62/0x2c0 [kvm] Aug 22 16:23:02 juju-e4d256-prod-github-runner-207 kernel: [39556.603382] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 16:23:02 juju-e4d256-prod-github-runner-207 kernel: [39556.604188] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 16:23:02 juju-e4d256-prod-github-runner-207 kernel: [39556.605062] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 16:23:02 juju-e4d256-prod-github-runner-207 kernel: [39556.605865] ? __seccomp_filter+0x4a/0x4a0 Aug 22 16:23:02 juju-e4d256-prod-github-runner-207 kernel: [39556.606607] ? __fget_files+0x86/0xc0 Aug 22 16:23:02 juju-e4d256-prod-github-runner-207 kernel: [39556.607320] __x64_sys_ioctl+0x95/0xd0 Aug 22 16:23:02 juju-e4d256-prod-github-runner-207 kernel: [39556.608014] do_syscall_64+0x5c/0xc0 Aug 22 16:23:02 juju-e4d256-prod-github-runner-207 kernel: [39556.608680] ? do_futex+0x162/0x1f0 Aug 22 16:23:02 juju-e4d256-prod-github-runner-207 kernel: [39556.609344] ? __x64_sys_futex+0x78/0x1e0 Aug 22 16:23:02 juju-e4d256-prod-github-runner-207 kernel: [39556.610019] ? __secure_computing+0xa9/0x120 Aug 22 16:23:02 juju-e4d256-prod-github-runner-207 kernel: [39556.610712] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 16:23:02 juju-e4d256-prod-github-runner-207 kernel: [39556.611472] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:23:02 juju-e4d256-prod-github-runner-207 kernel: [39556.612194] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:23:02 juju-e4d256-prod-github-runner-207 kernel: [39556.612918] ? do_syscall_64+0x69/0xc0 Aug 22 16:23:02 juju-e4d256-prod-github-runner-207 kernel: [39556.613580] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:23:02 juju-e4d256-prod-github-runner-207 kernel: [39556.614283] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:23:02 juju-e4d256-prod-github-runner-207 kernel: [39556.614989] ? do_syscall_64+0x69/0xc0 Aug 22 16:23:02 juju-e4d256-prod-github-runner-207 kernel: [39556.615612] ? do_syscall_64+0x69/0xc0 Aug 22 16:23:02 juju-e4d256-prod-github-runner-207 kernel: [39556.616239] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 16:23:02 juju-e4d256-prod-github-runner-207 kernel: [39556.616943] RIP: 0033:0x7faa5d0edaff Aug 22 16:23:02 juju-e4d256-prod-github-runner-207 kernel: [39556.617615] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 16:23:02 juju-e4d256-prod-github-runner-207 kernel: [39556.619605] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 16:23:02 juju-e4d256-prod-github-runner-207 kernel: [39556.620515] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 16:23:02 juju-e4d256-prod-github-runner-207 kernel: [39556.621459] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 16:23:02 juju-e4d256-prod-github-runner-207 kernel: [39556.622354] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 16:23:02 juju-e4d256-prod-github-runner-207 kernel: [39556.623240] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 16:23:02 juju-e4d256-prod-github-runner-207 kernel: [39556.624134] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 16:23:02 juju-e4d256-prod-github-runner-207 kernel: [39556.625024] Aug 22 16:23:30 juju-e4d256-prod-github-runner-207 kernel: [39584.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 36757s! [qemu-system-x86:6715] Aug 22 16:23:30 juju-e4d256-prod-github-runner-207 kernel: [39584.543760] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 16:23:30 juju-e4d256-prod-github-runner-207 kernel: [39584.544017] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 16:23:30 juju-e4d256-prod-github-runner-207 kernel: [39584.556159] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 16:23:30 juju-e4d256-prod-github-runner-207 kernel: [39584.557462] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 16:23:30 juju-e4d256-prod-github-runner-207 kernel: [39584.558689] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:23:30 juju-e4d256-prod-github-runner-207 kernel: [39584.559746] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 16:23:30 juju-e4d256-prod-github-runner-207 kernel: [39584.562316] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 16:23:30 juju-e4d256-prod-github-runner-207 kernel: [39584.563358] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 16:23:30 juju-e4d256-prod-github-runner-207 kernel: [39584.564523] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 16:23:30 juju-e4d256-prod-github-runner-207 kernel: [39584.565691] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 16:23:30 juju-e4d256-prod-github-runner-207 kernel: [39584.566850] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 16:23:30 juju-e4d256-prod-github-runner-207 kernel: [39584.568016] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 16:23:30 juju-e4d256-prod-github-runner-207 kernel: [39584.569193] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 16:23:30 juju-e4d256-prod-github-runner-207 kernel: [39584.570430] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 16:23:30 juju-e4d256-prod-github-runner-207 kernel: [39584.571524] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 16:23:30 juju-e4d256-prod-github-runner-207 kernel: [39584.572722] Call Trace: Aug 22 16:23:30 juju-e4d256-prod-github-runner-207 kernel: [39584.573640] Aug 22 16:23:30 juju-e4d256-prod-github-runner-207 kernel: [39584.574536] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:23:30 juju-e4d256-prod-github-runner-207 kernel: [39584.575565] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:23:30 juju-e4d256-prod-github-runner-207 kernel: [39584.576584] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:23:30 juju-e4d256-prod-github-runner-207 kernel: [39584.577681] ? show_regs.part.0+0x23/0x29 Aug 22 16:23:30 juju-e4d256-prod-github-runner-207 kernel: [39584.578681] ? show_regs.cold+0x8/0xd Aug 22 16:23:30 juju-e4d256-prod-github-runner-207 kernel: [39584.579655] ? watchdog_timer_fn+0x1be/0x220 Aug 22 16:23:30 juju-e4d256-prod-github-runner-207 kernel: [39584.580661] ? lockup_detector_update_enable+0x60/0x60 Aug 22 16:23:30 juju-e4d256-prod-github-runner-207 kernel: [39584.581729] ? __hrtimer_run_queues+0x107/0x230 Aug 22 16:23:30 juju-e4d256-prod-github-runner-207 kernel: [39584.582755] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 16:23:30 juju-e4d256-prod-github-runner-207 kernel: [39584.583781] ? hrtimer_interrupt+0x101/0x220 Aug 22 16:23:30 juju-e4d256-prod-github-runner-207 kernel: [39584.584803] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 16:23:30 juju-e4d256-prod-github-runner-207 kernel: [39584.585874] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 16:23:30 juju-e4d256-prod-github-runner-207 kernel: [39584.586919] Aug 22 16:23:30 juju-e4d256-prod-github-runner-207 kernel: [39584.587771] Aug 22 16:23:30 juju-e4d256-prod-github-runner-207 kernel: [39584.588606] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 16:23:30 juju-e4d256-prod-github-runner-207 kernel: [39584.589659] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:23:30 juju-e4d256-prod-github-runner-207 kernel: [39584.590697] ? _raw_spin_lock+0x22/0x30 Aug 22 16:23:30 juju-e4d256-prod-github-runner-207 kernel: [39584.591639] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:23:30 juju-e4d256-prod-github-runner-207 kernel: [39584.592653] direct_page_fault+0x206/0x310 [kvm] Aug 22 16:23:30 juju-e4d256-prod-github-runner-207 kernel: [39584.593686] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 16:23:30 juju-e4d256-prod-github-runner-207 kernel: [39584.594692] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 16:23:30 juju-e4d256-prod-github-runner-207 kernel: [39584.595697] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 16:23:30 juju-e4d256-prod-github-runner-207 kernel: [39584.596694] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 16:23:30 juju-e4d256-prod-github-runner-207 kernel: [39584.597656] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 16:23:30 juju-e4d256-prod-github-runner-207 kernel: [39584.598639] handle_exit+0x98/0x230 [kvm_amd] Aug 22 16:23:30 juju-e4d256-prod-github-runner-207 kernel: [39584.599541] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 16:23:30 juju-e4d256-prod-github-runner-207 kernel: [39584.600466] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 16:23:30 juju-e4d256-prod-github-runner-207 kernel: [39584.601408] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 16:23:30 juju-e4d256-prod-github-runner-207 kernel: [39584.602316] vcpu_run+0x62/0x2c0 [kvm] Aug 22 16:23:30 juju-e4d256-prod-github-runner-207 kernel: [39584.603125] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 16:23:30 juju-e4d256-prod-github-runner-207 kernel: [39584.603932] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 16:23:30 juju-e4d256-prod-github-runner-207 kernel: [39584.604800] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 16:23:30 juju-e4d256-prod-github-runner-207 kernel: [39584.605602] ? __seccomp_filter+0x4a/0x4a0 Aug 22 16:23:30 juju-e4d256-prod-github-runner-207 kernel: [39584.606341] ? __fget_files+0x86/0xc0 Aug 22 16:23:30 juju-e4d256-prod-github-runner-207 kernel: [39584.607048] __x64_sys_ioctl+0x95/0xd0 Aug 22 16:23:30 juju-e4d256-prod-github-runner-207 kernel: [39584.607744] do_syscall_64+0x5c/0xc0 Aug 22 16:23:30 juju-e4d256-prod-github-runner-207 kernel: [39584.608409] ? do_futex+0x162/0x1f0 Aug 22 16:23:30 juju-e4d256-prod-github-runner-207 kernel: [39584.609071] ? __x64_sys_futex+0x78/0x1e0 Aug 22 16:23:30 juju-e4d256-prod-github-runner-207 kernel: [39584.609758] ? __secure_computing+0xa9/0x120 Aug 22 16:23:30 juju-e4d256-prod-github-runner-207 kernel: [39584.610448] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 16:23:30 juju-e4d256-prod-github-runner-207 kernel: [39584.611211] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:23:30 juju-e4d256-prod-github-runner-207 kernel: [39584.611936] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:23:30 juju-e4d256-prod-github-runner-207 kernel: [39584.612651] ? do_syscall_64+0x69/0xc0 Aug 22 16:23:30 juju-e4d256-prod-github-runner-207 kernel: [39584.613315] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:23:30 juju-e4d256-prod-github-runner-207 kernel: [39584.614017] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:23:30 juju-e4d256-prod-github-runner-207 kernel: [39584.614780] ? do_syscall_64+0x69/0xc0 Aug 22 16:23:30 juju-e4d256-prod-github-runner-207 kernel: [39584.615416] ? do_syscall_64+0x69/0xc0 Aug 22 16:23:30 juju-e4d256-prod-github-runner-207 kernel: [39584.616037] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 16:23:30 juju-e4d256-prod-github-runner-207 kernel: [39584.616758] RIP: 0033:0x7faa5d0edaff Aug 22 16:23:30 juju-e4d256-prod-github-runner-207 kernel: [39584.617423] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 16:23:30 juju-e4d256-prod-github-runner-207 kernel: [39584.619423] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 16:23:30 juju-e4d256-prod-github-runner-207 kernel: [39584.620350] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 16:23:30 juju-e4d256-prod-github-runner-207 kernel: [39584.621253] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 16:23:30 juju-e4d256-prod-github-runner-207 kernel: [39584.622139] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 16:23:30 juju-e4d256-prod-github-runner-207 kernel: [39584.623025] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 16:23:30 juju-e4d256-prod-github-runner-207 kernel: [39584.623910] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 16:23:30 juju-e4d256-prod-github-runner-207 kernel: [39584.624814] Aug 22 16:23:45 juju-e4d256-prod-github-runner-207 kernel: [39599.828706] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 16:23:45 juju-e4d256-prod-github-runner-207 kernel: [39599.830308] rcu: 1-....: (9839695 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=4758457 Aug 22 16:23:45 juju-e4d256-prod-github-runner-207 kernel: [39599.831422] (t=9870657 jiffies g=23269 q=40536) Aug 22 16:23:45 juju-e4d256-prod-github-runner-207 kernel: [39599.832203] NMI backtrace for cpu 1 Aug 22 16:23:45 juju-e4d256-prod-github-runner-207 kernel: [39599.832927] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 16:23:45 juju-e4d256-prod-github-runner-207 kernel: [39599.834035] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 16:23:45 juju-e4d256-prod-github-runner-207 kernel: [39599.835092] Call Trace: Aug 22 16:23:45 juju-e4d256-prod-github-runner-207 kernel: [39599.835766] Aug 22 16:23:45 juju-e4d256-prod-github-runner-207 kernel: [39599.836418] show_stack+0x52/0x5c Aug 22 16:23:45 juju-e4d256-prod-github-runner-207 kernel: [39599.837151] dump_stack_lvl+0x4a/0x63 Aug 22 16:23:45 juju-e4d256-prod-github-runner-207 kernel: [39599.837901] dump_stack+0x10/0x16 Aug 22 16:23:45 juju-e4d256-prod-github-runner-207 kernel: [39599.838716] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 16:23:45 juju-e4d256-prod-github-runner-207 kernel: [39599.839497] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 16:23:45 juju-e4d256-prod-github-runner-207 kernel: [39599.840274] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 16:23:45 juju-e4d256-prod-github-runner-207 kernel: [39599.841108] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 16:23:45 juju-e4d256-prod-github-runner-207 kernel: [39599.841926] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 16:23:45 juju-e4d256-prod-github-runner-207 kernel: [39599.842731] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 16:23:45 juju-e4d256-prod-github-runner-207 kernel: [39599.843508] print_cpu_stall.cold+0x2f/0xe2 Aug 22 16:23:45 juju-e4d256-prod-github-runner-207 kernel: [39599.844269] ? timekeeping_update+0xf7/0x150 Aug 22 16:23:45 juju-e4d256-prod-github-runner-207 kernel: [39599.845058] check_cpu_stall+0x109/0x270 Aug 22 16:23:45 juju-e4d256-prod-github-runner-207 kernel: [39599.845804] rcu_sched_clock_irq+0x9a/0x250 Aug 22 16:23:45 juju-e4d256-prod-github-runner-207 kernel: [39599.846568] update_process_times+0x94/0xd0 Aug 22 16:23:45 juju-e4d256-prod-github-runner-207 kernel: [39599.847327] tick_sched_handle+0x29/0x70 Aug 22 16:23:45 juju-e4d256-prod-github-runner-207 kernel: [39599.848071] tick_sched_timer+0x8c/0xc0 Aug 22 16:23:45 juju-e4d256-prod-github-runner-207 kernel: [39599.848818] ? tick_nohz_handler+0xb0/0xb0 Aug 22 16:23:45 juju-e4d256-prod-github-runner-207 kernel: [39599.849579] __hrtimer_run_queues+0x107/0x230 Aug 22 16:23:45 juju-e4d256-prod-github-runner-207 kernel: [39599.850350] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 16:23:45 juju-e4d256-prod-github-runner-207 kernel: [39599.851123] hrtimer_interrupt+0x101/0x220 Aug 22 16:23:45 juju-e4d256-prod-github-runner-207 kernel: [39599.851881] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 16:23:45 juju-e4d256-prod-github-runner-207 kernel: [39599.852707] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 16:23:45 juju-e4d256-prod-github-runner-207 kernel: [39599.853508] Aug 22 16:23:45 juju-e4d256-prod-github-runner-207 kernel: [39599.854143] Aug 22 16:23:45 juju-e4d256-prod-github-runner-207 kernel: [39599.854770] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 16:23:45 juju-e4d256-prod-github-runner-207 kernel: [39599.855587] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:23:45 juju-e4d256-prod-github-runner-207 kernel: [39599.856468] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 16:23:45 juju-e4d256-prod-github-runner-207 kernel: [39599.858723] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 16:23:45 juju-e4d256-prod-github-runner-207 kernel: [39599.859633] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 16:23:45 juju-e4d256-prod-github-runner-207 kernel: [39599.860640] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 16:23:45 juju-e4d256-prod-github-runner-207 kernel: [39599.861616] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 16:23:45 juju-e4d256-prod-github-runner-207 kernel: [39599.862584] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 16:23:45 juju-e4d256-prod-github-runner-207 kernel: [39599.863538] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 16:23:45 juju-e4d256-prod-github-runner-207 kernel: [39599.864540] ? _raw_spin_lock+0x22/0x30 Aug 22 16:23:45 juju-e4d256-prod-github-runner-207 kernel: [39599.865318] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:23:45 juju-e4d256-prod-github-runner-207 kernel: [39599.866188] direct_page_fault+0x206/0x310 [kvm] Aug 22 16:23:45 juju-e4d256-prod-github-runner-207 kernel: [39599.867024] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 16:23:45 juju-e4d256-prod-github-runner-207 kernel: [39599.867849] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 16:23:45 juju-e4d256-prod-github-runner-207 kernel: [39599.868729] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 16:23:45 juju-e4d256-prod-github-runner-207 kernel: [39599.869577] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 16:23:45 juju-e4d256-prod-github-runner-207 kernel: [39599.870363] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 16:23:45 juju-e4d256-prod-github-runner-207 kernel: [39599.871184] handle_exit+0x98/0x230 [kvm_amd] Aug 22 16:23:45 juju-e4d256-prod-github-runner-207 kernel: [39599.871943] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 16:23:45 juju-e4d256-prod-github-runner-207 kernel: [39599.872734] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 16:23:45 juju-e4d256-prod-github-runner-207 kernel: [39599.873533] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 16:23:45 juju-e4d256-prod-github-runner-207 kernel: [39599.874319] vcpu_run+0x62/0x2c0 [kvm] Aug 22 16:23:45 juju-e4d256-prod-github-runner-207 kernel: [39599.875035] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 16:23:45 juju-e4d256-prod-github-runner-207 kernel: [39599.875769] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 16:23:45 juju-e4d256-prod-github-runner-207 kernel: [39599.876581] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 16:23:45 juju-e4d256-prod-github-runner-207 kernel: [39599.877345] ? __seccomp_filter+0x4a/0x4a0 Aug 22 16:23:45 juju-e4d256-prod-github-runner-207 kernel: [39599.878065] ? __fget_files+0x86/0xc0 Aug 22 16:23:45 juju-e4d256-prod-github-runner-207 kernel: [39599.878758] __x64_sys_ioctl+0x95/0xd0 Aug 22 16:23:45 juju-e4d256-prod-github-runner-207 kernel: [39599.879453] do_syscall_64+0x5c/0xc0 Aug 22 16:23:45 juju-e4d256-prod-github-runner-207 kernel: [39599.880132] ? do_futex+0x162/0x1f0 Aug 22 16:23:45 juju-e4d256-prod-github-runner-207 kernel: [39599.880819] ? __x64_sys_futex+0x78/0x1e0 Aug 22 16:23:45 juju-e4d256-prod-github-runner-207 kernel: [39599.881527] ? __secure_computing+0xa9/0x120 Aug 22 16:23:45 juju-e4d256-prod-github-runner-207 kernel: [39599.882243] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 16:23:45 juju-e4d256-prod-github-runner-207 kernel: [39599.883032] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:23:45 juju-e4d256-prod-github-runner-207 kernel: [39599.883786] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:23:45 juju-e4d256-prod-github-runner-207 kernel: [39599.884555] ? do_syscall_64+0x69/0xc0 Aug 22 16:23:45 juju-e4d256-prod-github-runner-207 kernel: [39599.885246] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:23:45 juju-e4d256-prod-github-runner-207 kernel: [39599.886004] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:23:45 juju-e4d256-prod-github-runner-207 kernel: [39599.886767] ? do_syscall_64+0x69/0xc0 Aug 22 16:23:45 juju-e4d256-prod-github-runner-207 kernel: [39599.887465] ? do_syscall_64+0x69/0xc0 Aug 22 16:23:45 juju-e4d256-prod-github-runner-207 kernel: [39599.888151] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 16:23:45 juju-e4d256-prod-github-runner-207 kernel: [39599.888971] RIP: 0033:0x7faa5d0edaff Aug 22 16:23:45 juju-e4d256-prod-github-runner-207 kernel: [39599.889667] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 16:23:45 juju-e4d256-prod-github-runner-207 kernel: [39599.891766] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 16:23:45 juju-e4d256-prod-github-runner-207 kernel: [39599.892748] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 16:23:45 juju-e4d256-prod-github-runner-207 kernel: [39599.893693] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 16:23:45 juju-e4d256-prod-github-runner-207 kernel: [39599.894638] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 16:23:45 juju-e4d256-prod-github-runner-207 kernel: [39599.895583] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 16:23:45 juju-e4d256-prod-github-runner-207 kernel: [39599.896511] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 16:23:45 juju-e4d256-prod-github-runner-207 kernel: [39599.897475] Aug 22 16:24:10 juju-e4d256-prod-github-runner-207 kernel: [39624.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 36795s! [qemu-system-x86:6715] Aug 22 16:24:10 juju-e4d256-prod-github-runner-207 kernel: [39624.543726] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 16:24:10 juju-e4d256-prod-github-runner-207 kernel: [39624.543988] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 16:24:10 juju-e4d256-prod-github-runner-207 kernel: [39624.556833] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 16:24:10 juju-e4d256-prod-github-runner-207 kernel: [39624.558301] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 16:24:10 juju-e4d256-prod-github-runner-207 kernel: [39624.559687] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:24:10 juju-e4d256-prod-github-runner-207 kernel: [39624.560880] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 16:24:10 juju-e4d256-prod-github-runner-207 kernel: [39624.563776] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 16:24:10 juju-e4d256-prod-github-runner-207 kernel: [39624.564933] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 16:24:10 juju-e4d256-prod-github-runner-207 kernel: [39624.566434] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 16:24:10 juju-e4d256-prod-github-runner-207 kernel: [39624.567733] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 16:24:10 juju-e4d256-prod-github-runner-207 kernel: [39624.569049] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 16:24:10 juju-e4d256-prod-github-runner-207 kernel: [39624.570353] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 16:24:10 juju-e4d256-prod-github-runner-207 kernel: [39624.571656] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 16:24:10 juju-e4d256-prod-github-runner-207 kernel: [39624.573066] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 16:24:10 juju-e4d256-prod-github-runner-207 kernel: [39624.574276] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 16:24:10 juju-e4d256-prod-github-runner-207 kernel: [39624.575601] Call Trace: Aug 22 16:24:10 juju-e4d256-prod-github-runner-207 kernel: [39624.576585] Aug 22 16:24:10 juju-e4d256-prod-github-runner-207 kernel: [39624.577534] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:24:10 juju-e4d256-prod-github-runner-207 kernel: [39624.578659] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:24:10 juju-e4d256-prod-github-runner-207 kernel: [39624.579768] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:24:10 juju-e4d256-prod-github-runner-207 kernel: [39624.580968] ? show_regs.part.0+0x23/0x29 Aug 22 16:24:10 juju-e4d256-prod-github-runner-207 kernel: [39624.582062] ? show_regs.cold+0x8/0xd Aug 22 16:24:10 juju-e4d256-prod-github-runner-207 kernel: [39624.583106] ? watchdog_timer_fn+0x1be/0x220 Aug 22 16:24:10 juju-e4d256-prod-github-runner-207 kernel: [39624.584195] ? lockup_detector_update_enable+0x60/0x60 Aug 22 16:24:10 juju-e4d256-prod-github-runner-207 kernel: [39624.585373] ? __hrtimer_run_queues+0x107/0x230 Aug 22 16:24:10 juju-e4d256-prod-github-runner-207 kernel: [39624.586497] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 16:24:10 juju-e4d256-prod-github-runner-207 kernel: [39624.587607] ? hrtimer_interrupt+0x101/0x220 Aug 22 16:24:10 juju-e4d256-prod-github-runner-207 kernel: [39624.588724] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 16:24:10 juju-e4d256-prod-github-runner-207 kernel: [39624.589895] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 16:24:10 juju-e4d256-prod-github-runner-207 kernel: [39624.591042] Aug 22 16:24:10 juju-e4d256-prod-github-runner-207 kernel: [39624.592083] Aug 22 16:24:10 juju-e4d256-prod-github-runner-207 kernel: [39624.593163] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 16:24:10 juju-e4d256-prod-github-runner-207 kernel: [39624.594296] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:24:10 juju-e4d256-prod-github-runner-207 kernel: [39624.595435] ? _raw_spin_lock+0x22/0x30 Aug 22 16:24:10 juju-e4d256-prod-github-runner-207 kernel: [39624.596472] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:24:10 juju-e4d256-prod-github-runner-207 kernel: [39624.597582] direct_page_fault+0x206/0x310 [kvm] Aug 22 16:24:10 juju-e4d256-prod-github-runner-207 kernel: [39624.598696] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 16:24:10 juju-e4d256-prod-github-runner-207 kernel: [39624.599793] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 16:24:10 juju-e4d256-prod-github-runner-207 kernel: [39624.600901] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 16:24:10 juju-e4d256-prod-github-runner-207 kernel: [39624.602003] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 16:24:10 juju-e4d256-prod-github-runner-207 kernel: [39624.603046] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 16:24:10 juju-e4d256-prod-github-runner-207 kernel: [39624.604126] handle_exit+0x98/0x230 [kvm_amd] Aug 22 16:24:10 juju-e4d256-prod-github-runner-207 kernel: [39624.605121] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 16:24:10 juju-e4d256-prod-github-runner-207 kernel: [39624.606122] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 16:24:10 juju-e4d256-prod-github-runner-207 kernel: [39624.607142] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 16:24:10 juju-e4d256-prod-github-runner-207 kernel: [39624.608144] vcpu_run+0x62/0x2c0 [kvm] Aug 22 16:24:10 juju-e4d256-prod-github-runner-207 kernel: [39624.609042] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 16:24:10 juju-e4d256-prod-github-runner-207 kernel: [39624.609935] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 16:24:10 juju-e4d256-prod-github-runner-207 kernel: [39624.610891] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 16:24:10 juju-e4d256-prod-github-runner-207 kernel: [39624.611776] ? __seccomp_filter+0x4a/0x4a0 Aug 22 16:24:10 juju-e4d256-prod-github-runner-207 kernel: [39624.612618] ? __fget_files+0x86/0xc0 Aug 22 16:24:10 juju-e4d256-prod-github-runner-207 kernel: [39624.613401] __x64_sys_ioctl+0x95/0xd0 Aug 22 16:24:10 juju-e4d256-prod-github-runner-207 kernel: [39624.614164] do_syscall_64+0x5c/0xc0 Aug 22 16:24:10 juju-e4d256-prod-github-runner-207 kernel: [39624.614908] ? do_futex+0x162/0x1f0 Aug 22 16:24:10 juju-e4d256-prod-github-runner-207 kernel: [39624.615632] ? __x64_sys_futex+0x78/0x1e0 Aug 22 16:24:10 juju-e4d256-prod-github-runner-207 kernel: [39624.616397] ? __secure_computing+0xa9/0x120 Aug 22 16:24:10 juju-e4d256-prod-github-runner-207 kernel: [39624.617170] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 16:24:10 juju-e4d256-prod-github-runner-207 kernel: [39624.618029] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:24:10 juju-e4d256-prod-github-runner-207 kernel: [39624.618841] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:24:10 juju-e4d256-prod-github-runner-207 kernel: [39624.619649] ? do_syscall_64+0x69/0xc0 Aug 22 16:24:10 juju-e4d256-prod-github-runner-207 kernel: [39624.620378] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:24:10 juju-e4d256-prod-github-runner-207 kernel: [39624.621171] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:24:10 juju-e4d256-prod-github-runner-207 kernel: [39624.621956] ? do_syscall_64+0x69/0xc0 Aug 22 16:24:10 juju-e4d256-prod-github-runner-207 kernel: [39624.622656] ? do_syscall_64+0x69/0xc0 Aug 22 16:24:10 juju-e4d256-prod-github-runner-207 kernel: [39624.623351] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 16:24:10 juju-e4d256-prod-github-runner-207 kernel: [39624.624152] RIP: 0033:0x7faa5d0edaff Aug 22 16:24:10 juju-e4d256-prod-github-runner-207 kernel: [39624.624891] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 16:24:10 juju-e4d256-prod-github-runner-207 kernel: [39624.627216] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 16:24:10 juju-e4d256-prod-github-runner-207 kernel: [39624.628294] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 16:24:10 juju-e4d256-prod-github-runner-207 kernel: [39624.629321] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 16:24:10 juju-e4d256-prod-github-runner-207 kernel: [39624.630347] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 16:24:10 juju-e4d256-prod-github-runner-207 kernel: [39624.631364] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 16:24:10 juju-e4d256-prod-github-runner-207 kernel: [39624.632397] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 16:24:10 juju-e4d256-prod-github-runner-207 kernel: [39624.633428] Aug 22 16:24:38 juju-e4d256-prod-github-runner-207 kernel: [39652.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 36821s! [qemu-system-x86:6715] Aug 22 16:24:38 juju-e4d256-prod-github-runner-207 kernel: [39652.544191] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 16:24:38 juju-e4d256-prod-github-runner-207 kernel: [39652.544552] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 16:24:38 juju-e4d256-prod-github-runner-207 kernel: [39652.557156] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 16:24:38 juju-e4d256-prod-github-runner-207 kernel: [39652.558426] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 16:24:38 juju-e4d256-prod-github-runner-207 kernel: [39652.559674] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:24:38 juju-e4d256-prod-github-runner-207 kernel: [39652.560768] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 16:24:38 juju-e4d256-prod-github-runner-207 kernel: [39652.563341] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 16:24:38 juju-e4d256-prod-github-runner-207 kernel: [39652.564424] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 16:24:38 juju-e4d256-prod-github-runner-207 kernel: [39652.565606] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 16:24:38 juju-e4d256-prod-github-runner-207 kernel: [39652.566767] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 16:24:38 juju-e4d256-prod-github-runner-207 kernel: [39652.567967] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 16:24:38 juju-e4d256-prod-github-runner-207 kernel: [39652.569163] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 16:24:38 juju-e4d256-prod-github-runner-207 kernel: [39652.570427] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 16:24:38 juju-e4d256-prod-github-runner-207 kernel: [39652.571833] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 16:24:38 juju-e4d256-prod-github-runner-207 kernel: [39652.572960] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 16:24:38 juju-e4d256-prod-github-runner-207 kernel: [39652.574168] Call Trace: Aug 22 16:24:38 juju-e4d256-prod-github-runner-207 kernel: [39652.575091] Aug 22 16:24:38 juju-e4d256-prod-github-runner-207 kernel: [39652.576059] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:24:38 juju-e4d256-prod-github-runner-207 kernel: [39652.577102] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:24:38 juju-e4d256-prod-github-runner-207 kernel: [39652.578157] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:24:38 juju-e4d256-prod-github-runner-207 kernel: [39652.579289] ? show_regs.part.0+0x23/0x29 Aug 22 16:24:38 juju-e4d256-prod-github-runner-207 kernel: [39652.580326] ? show_regs.cold+0x8/0xd Aug 22 16:24:38 juju-e4d256-prod-github-runner-207 kernel: [39652.581305] ? watchdog_timer_fn+0x1be/0x220 Aug 22 16:24:38 juju-e4d256-prod-github-runner-207 kernel: [39652.582357] ? lockup_detector_update_enable+0x60/0x60 Aug 22 16:24:38 juju-e4d256-prod-github-runner-207 kernel: [39652.583440] ? __hrtimer_run_queues+0x107/0x230 Aug 22 16:24:38 juju-e4d256-prod-github-runner-207 kernel: [39652.584506] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 16:24:38 juju-e4d256-prod-github-runner-207 kernel: [39652.585551] ? hrtimer_interrupt+0x101/0x220 Aug 22 16:24:38 juju-e4d256-prod-github-runner-207 kernel: [39652.586604] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 16:24:38 juju-e4d256-prod-github-runner-207 kernel: [39652.587773] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 16:24:38 juju-e4d256-prod-github-runner-207 kernel: [39652.588844] Aug 22 16:24:38 juju-e4d256-prod-github-runner-207 kernel: [39652.589711] Aug 22 16:24:38 juju-e4d256-prod-github-runner-207 kernel: [39652.590591] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 16:24:38 juju-e4d256-prod-github-runner-207 kernel: [39652.591670] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:24:38 juju-e4d256-prod-github-runner-207 kernel: [39652.592824] ? _raw_spin_lock+0x22/0x30 Aug 22 16:24:38 juju-e4d256-prod-github-runner-207 kernel: [39652.593830] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:24:38 juju-e4d256-prod-github-runner-207 kernel: [39652.594888] direct_page_fault+0x206/0x310 [kvm] Aug 22 16:24:38 juju-e4d256-prod-github-runner-207 kernel: [39652.595941] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 16:24:38 juju-e4d256-prod-github-runner-207 kernel: [39652.596960] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 16:24:38 juju-e4d256-prod-github-runner-207 kernel: [39652.597967] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 16:24:38 juju-e4d256-prod-github-runner-207 kernel: [39652.598996] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 16:24:38 juju-e4d256-prod-github-runner-207 kernel: [39652.599970] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 16:24:38 juju-e4d256-prod-github-runner-207 kernel: [39652.600961] handle_exit+0x98/0x230 [kvm_amd] Aug 22 16:24:38 juju-e4d256-prod-github-runner-207 kernel: [39652.601868] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 16:24:38 juju-e4d256-prod-github-runner-207 kernel: [39652.602789] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 16:24:38 juju-e4d256-prod-github-runner-207 kernel: [39652.603719] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 16:24:38 juju-e4d256-prod-github-runner-207 kernel: [39652.604642] vcpu_run+0x62/0x2c0 [kvm] Aug 22 16:24:38 juju-e4d256-prod-github-runner-207 kernel: [39652.605465] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 16:24:38 juju-e4d256-prod-github-runner-207 kernel: [39652.606284] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 16:24:38 juju-e4d256-prod-github-runner-207 kernel: [39652.607146] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 16:24:38 juju-e4d256-prod-github-runner-207 kernel: [39652.608015] ? __seccomp_filter+0x4a/0x4a0 Aug 22 16:24:38 juju-e4d256-prod-github-runner-207 kernel: [39652.608895] ? __fget_files+0x86/0xc0 Aug 22 16:24:38 juju-e4d256-prod-github-runner-207 kernel: [39652.609608] __x64_sys_ioctl+0x95/0xd0 Aug 22 16:24:38 juju-e4d256-prod-github-runner-207 kernel: [39652.610317] do_syscall_64+0x5c/0xc0 Aug 22 16:24:38 juju-e4d256-prod-github-runner-207 kernel: [39652.610995] ? do_futex+0x162/0x1f0 Aug 22 16:24:38 juju-e4d256-prod-github-runner-207 kernel: [39652.611648] ? __x64_sys_futex+0x78/0x1e0 Aug 22 16:24:38 juju-e4d256-prod-github-runner-207 kernel: [39652.612346] ? __secure_computing+0xa9/0x120 Aug 22 16:24:38 juju-e4d256-prod-github-runner-207 kernel: [39652.613048] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 16:24:38 juju-e4d256-prod-github-runner-207 kernel: [39652.613823] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:24:38 juju-e4d256-prod-github-runner-207 kernel: [39652.614552] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:24:38 juju-e4d256-prod-github-runner-207 kernel: [39652.615275] ? do_syscall_64+0x69/0xc0 Aug 22 16:24:38 juju-e4d256-prod-github-runner-207 kernel: [39652.615947] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:24:38 juju-e4d256-prod-github-runner-207 kernel: [39652.616665] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:24:38 juju-e4d256-prod-github-runner-207 kernel: [39652.617373] ? do_syscall_64+0x69/0xc0 Aug 22 16:24:38 juju-e4d256-prod-github-runner-207 kernel: [39652.618004] ? do_syscall_64+0x69/0xc0 Aug 22 16:24:38 juju-e4d256-prod-github-runner-207 kernel: [39652.618647] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 16:24:38 juju-e4d256-prod-github-runner-207 kernel: [39652.619509] RIP: 0033:0x7faa5d0edaff Aug 22 16:24:38 juju-e4d256-prod-github-runner-207 kernel: [39652.620316] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 16:24:38 juju-e4d256-prod-github-runner-207 kernel: [39652.622644] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 16:24:38 juju-e4d256-prod-github-runner-207 kernel: [39652.623713] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 16:24:38 juju-e4d256-prod-github-runner-207 kernel: [39652.624777] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 16:24:38 juju-e4d256-prod-github-runner-207 kernel: [39652.625800] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 16:24:38 juju-e4d256-prod-github-runner-207 kernel: [39652.626822] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 16:24:38 juju-e4d256-prod-github-runner-207 kernel: [39652.627859] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 16:24:38 juju-e4d256-prod-github-runner-207 kernel: [39652.628903] Aug 22 16:25:06 juju-e4d256-prod-github-runner-207 kernel: [39680.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 36847s! [qemu-system-x86:6715] Aug 22 16:25:06 juju-e4d256-prod-github-runner-207 kernel: [39680.544207] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 16:25:06 juju-e4d256-prod-github-runner-207 kernel: [39680.544548] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 16:25:06 juju-e4d256-prod-github-runner-207 kernel: [39680.562945] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 16:25:06 juju-e4d256-prod-github-runner-207 kernel: [39680.564979] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 16:25:06 juju-e4d256-prod-github-runner-207 kernel: [39680.566866] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:25:06 juju-e4d256-prod-github-runner-207 kernel: [39680.568151] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 16:25:06 juju-e4d256-prod-github-runner-207 kernel: [39680.570711] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 16:25:06 juju-e4d256-prod-github-runner-207 kernel: [39680.571980] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 16:25:06 juju-e4d256-prod-github-runner-207 kernel: [39680.573383] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 16:25:06 juju-e4d256-prod-github-runner-207 kernel: [39680.574543] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 16:25:06 juju-e4d256-prod-github-runner-207 kernel: [39680.576600] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 16:25:06 juju-e4d256-prod-github-runner-207 kernel: [39680.578096] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 16:25:06 juju-e4d256-prod-github-runner-207 kernel: [39680.579850] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 16:25:06 juju-e4d256-prod-github-runner-207 kernel: [39680.581734] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 16:25:06 juju-e4d256-prod-github-runner-207 kernel: [39680.582884] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 16:25:06 juju-e4d256-prod-github-runner-207 kernel: [39680.584095] Call Trace: Aug 22 16:25:06 juju-e4d256-prod-github-runner-207 kernel: [39680.585012] Aug 22 16:25:06 juju-e4d256-prod-github-runner-207 kernel: [39680.585924] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:25:06 juju-e4d256-prod-github-runner-207 kernel: [39680.586957] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:25:06 juju-e4d256-prod-github-runner-207 kernel: [39680.588006] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:25:06 juju-e4d256-prod-github-runner-207 kernel: [39680.589106] ? show_regs.part.0+0x23/0x29 Aug 22 16:25:06 juju-e4d256-prod-github-runner-207 kernel: [39680.590104] ? show_regs.cold+0x8/0xd Aug 22 16:25:06 juju-e4d256-prod-github-runner-207 kernel: [39680.591077] ? watchdog_timer_fn+0x1be/0x220 Aug 22 16:25:06 juju-e4d256-prod-github-runner-207 kernel: [39680.592100] ? lockup_detector_update_enable+0x60/0x60 Aug 22 16:25:06 juju-e4d256-prod-github-runner-207 kernel: [39680.593167] ? __hrtimer_run_queues+0x107/0x230 Aug 22 16:25:06 juju-e4d256-prod-github-runner-207 kernel: [39680.594197] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 16:25:06 juju-e4d256-prod-github-runner-207 kernel: [39680.595240] ? hrtimer_interrupt+0x101/0x220 Aug 22 16:25:06 juju-e4d256-prod-github-runner-207 kernel: [39680.596271] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 16:25:06 juju-e4d256-prod-github-runner-207 kernel: [39680.597349] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 16:25:06 juju-e4d256-prod-github-runner-207 kernel: [39680.598412] Aug 22 16:25:06 juju-e4d256-prod-github-runner-207 kernel: [39680.599275] Aug 22 16:25:06 juju-e4d256-prod-github-runner-207 kernel: [39680.600399] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 16:25:06 juju-e4d256-prod-github-runner-207 kernel: [39680.601832] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:25:06 juju-e4d256-prod-github-runner-207 kernel: [39680.603272] ? _raw_spin_lock+0x22/0x30 Aug 22 16:25:06 juju-e4d256-prod-github-runner-207 kernel: [39680.604469] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:25:06 juju-e4d256-prod-github-runner-207 kernel: [39680.605494] direct_page_fault+0x206/0x310 [kvm] Aug 22 16:25:06 juju-e4d256-prod-github-runner-207 kernel: [39680.606526] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 16:25:06 juju-e4d256-prod-github-runner-207 kernel: [39680.607742] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 16:25:06 juju-e4d256-prod-github-runner-207 kernel: [39680.608747] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 16:25:06 juju-e4d256-prod-github-runner-207 kernel: [39680.609763] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 16:25:06 juju-e4d256-prod-github-runner-207 kernel: [39680.610710] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 16:25:06 juju-e4d256-prod-github-runner-207 kernel: [39680.611730] handle_exit+0x98/0x230 [kvm_amd] Aug 22 16:25:06 juju-e4d256-prod-github-runner-207 kernel: [39680.612645] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 16:25:06 juju-e4d256-prod-github-runner-207 kernel: [39680.613564] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 16:25:06 juju-e4d256-prod-github-runner-207 kernel: [39680.614486] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 16:25:06 juju-e4d256-prod-github-runner-207 kernel: [39680.615388] vcpu_run+0x62/0x2c0 [kvm] Aug 22 16:25:06 juju-e4d256-prod-github-runner-207 kernel: [39680.616205] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 16:25:06 juju-e4d256-prod-github-runner-207 kernel: [39680.617014] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 16:25:06 juju-e4d256-prod-github-runner-207 kernel: [39680.617868] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 16:25:06 juju-e4d256-prod-github-runner-207 kernel: [39680.618667] ? __seccomp_filter+0x4a/0x4a0 Aug 22 16:25:06 juju-e4d256-prod-github-runner-207 kernel: [39680.619411] ? __fget_files+0x86/0xc0 Aug 22 16:25:06 juju-e4d256-prod-github-runner-207 kernel: [39680.620120] __x64_sys_ioctl+0x95/0xd0 Aug 22 16:25:06 juju-e4d256-prod-github-runner-207 kernel: [39680.620812] do_syscall_64+0x5c/0xc0 Aug 22 16:25:06 juju-e4d256-prod-github-runner-207 kernel: [39680.621491] ? do_futex+0x162/0x1f0 Aug 22 16:25:06 juju-e4d256-prod-github-runner-207 kernel: [39680.622140] ? __x64_sys_futex+0x78/0x1e0 Aug 22 16:25:06 juju-e4d256-prod-github-runner-207 kernel: [39680.622813] ? __secure_computing+0xa9/0x120 Aug 22 16:25:06 juju-e4d256-prod-github-runner-207 kernel: [39680.623526] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 16:25:06 juju-e4d256-prod-github-runner-207 kernel: [39680.624330] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:25:06 juju-e4d256-prod-github-runner-207 kernel: [39680.625052] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:25:06 juju-e4d256-prod-github-runner-207 kernel: [39680.625774] ? do_syscall_64+0x69/0xc0 Aug 22 16:25:06 juju-e4d256-prod-github-runner-207 kernel: [39680.626422] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:25:06 juju-e4d256-prod-github-runner-207 kernel: [39680.627124] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:25:06 juju-e4d256-prod-github-runner-207 kernel: [39680.627831] ? do_syscall_64+0x69/0xc0 Aug 22 16:25:06 juju-e4d256-prod-github-runner-207 kernel: [39680.628461] ? do_syscall_64+0x69/0xc0 Aug 22 16:25:06 juju-e4d256-prod-github-runner-207 kernel: [39680.629084] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 16:25:06 juju-e4d256-prod-github-runner-207 kernel: [39680.629794] RIP: 0033:0x7faa5d0edaff Aug 22 16:25:06 juju-e4d256-prod-github-runner-207 kernel: [39680.630470] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 16:25:06 juju-e4d256-prod-github-runner-207 kernel: [39680.632472] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 16:25:06 juju-e4d256-prod-github-runner-207 kernel: [39680.633385] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 16:25:06 juju-e4d256-prod-github-runner-207 kernel: [39680.634277] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 16:25:06 juju-e4d256-prod-github-runner-207 kernel: [39680.635167] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 16:25:06 juju-e4d256-prod-github-runner-207 kernel: [39680.636084] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 16:25:06 juju-e4d256-prod-github-runner-207 kernel: [39680.636975] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 16:25:06 juju-e4d256-prod-github-runner-207 kernel: [39680.637875] Aug 22 16:25:34 juju-e4d256-prod-github-runner-207 kernel: [39708.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 36873s! [qemu-system-x86:6715] Aug 22 16:25:34 juju-e4d256-prod-github-runner-207 kernel: [39708.544123] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 16:25:34 juju-e4d256-prod-github-runner-207 kernel: [39708.544886] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 16:25:34 juju-e4d256-prod-github-runner-207 kernel: [39708.557717] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 16:25:34 juju-e4d256-prod-github-runner-207 kernel: [39708.559042] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 16:25:34 juju-e4d256-prod-github-runner-207 kernel: [39708.560323] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:25:34 juju-e4d256-prod-github-runner-207 kernel: [39708.561421] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 16:25:34 juju-e4d256-prod-github-runner-207 kernel: [39708.564093] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 16:25:34 juju-e4d256-prod-github-runner-207 kernel: [39708.565191] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 16:25:34 juju-e4d256-prod-github-runner-207 kernel: [39708.566401] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 16:25:34 juju-e4d256-prod-github-runner-207 kernel: [39708.567609] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 16:25:34 juju-e4d256-prod-github-runner-207 kernel: [39708.568809] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 16:25:34 juju-e4d256-prod-github-runner-207 kernel: [39708.570187] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 16:25:34 juju-e4d256-prod-github-runner-207 kernel: [39708.571455] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 16:25:34 juju-e4d256-prod-github-runner-207 kernel: [39708.572789] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 16:25:34 juju-e4d256-prod-github-runner-207 kernel: [39708.573983] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 16:25:34 juju-e4d256-prod-github-runner-207 kernel: [39708.575234] Call Trace: Aug 22 16:25:34 juju-e4d256-prod-github-runner-207 kernel: [39708.576231] Aug 22 16:25:34 juju-e4d256-prod-github-runner-207 kernel: [39708.577172] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:25:34 juju-e4d256-prod-github-runner-207 kernel: [39708.578233] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:25:34 juju-e4d256-prod-github-runner-207 kernel: [39708.579302] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:25:34 juju-e4d256-prod-github-runner-207 kernel: [39708.580451] ? show_regs.part.0+0x23/0x29 Aug 22 16:25:34 juju-e4d256-prod-github-runner-207 kernel: [39708.581471] ? show_regs.cold+0x8/0xd Aug 22 16:25:34 juju-e4d256-prod-github-runner-207 kernel: [39708.582458] ? watchdog_timer_fn+0x1be/0x220 Aug 22 16:25:34 juju-e4d256-prod-github-runner-207 kernel: [39708.583521] ? lockup_detector_update_enable+0x60/0x60 Aug 22 16:25:34 juju-e4d256-prod-github-runner-207 kernel: [39708.584703] ? __hrtimer_run_queues+0x107/0x230 Aug 22 16:25:34 juju-e4d256-prod-github-runner-207 kernel: [39708.585779] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 16:25:34 juju-e4d256-prod-github-runner-207 kernel: [39708.586850] ? hrtimer_interrupt+0x101/0x220 Aug 22 16:25:34 juju-e4d256-prod-github-runner-207 kernel: [39708.587927] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 16:25:34 juju-e4d256-prod-github-runner-207 kernel: [39708.589024] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 16:25:34 juju-e4d256-prod-github-runner-207 kernel: [39708.590129] Aug 22 16:25:34 juju-e4d256-prod-github-runner-207 kernel: [39708.591000] Aug 22 16:25:34 juju-e4d256-prod-github-runner-207 kernel: [39708.593905] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 16:25:34 juju-e4d256-prod-github-runner-207 kernel: [39708.595038] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:25:34 juju-e4d256-prod-github-runner-207 kernel: [39708.596160] ? _raw_spin_lock+0x22/0x30 Aug 22 16:25:34 juju-e4d256-prod-github-runner-207 kernel: [39708.597152] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:25:34 juju-e4d256-prod-github-runner-207 kernel: [39708.598204] direct_page_fault+0x206/0x310 [kvm] Aug 22 16:25:34 juju-e4d256-prod-github-runner-207 kernel: [39708.599271] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 16:25:34 juju-e4d256-prod-github-runner-207 kernel: [39708.600300] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 16:25:34 juju-e4d256-prod-github-runner-207 kernel: [39708.601330] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 16:25:34 juju-e4d256-prod-github-runner-207 kernel: [39708.602386] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 16:25:34 juju-e4d256-prod-github-runner-207 kernel: [39708.603388] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 16:25:34 juju-e4d256-prod-github-runner-207 kernel: [39708.604405] handle_exit+0x98/0x230 [kvm_amd] Aug 22 16:25:34 juju-e4d256-prod-github-runner-207 kernel: [39708.605325] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 16:25:34 juju-e4d256-prod-github-runner-207 kernel: [39708.606265] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 16:25:34 juju-e4d256-prod-github-runner-207 kernel: [39708.607223] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 16:25:34 juju-e4d256-prod-github-runner-207 kernel: [39708.608202] vcpu_run+0x62/0x2c0 [kvm] Aug 22 16:25:34 juju-e4d256-prod-github-runner-207 kernel: [39708.609058] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 16:25:34 juju-e4d256-prod-github-runner-207 kernel: [39708.609900] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 16:25:34 juju-e4d256-prod-github-runner-207 kernel: [39708.610777] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 16:25:34 juju-e4d256-prod-github-runner-207 kernel: [39708.611655] ? __seccomp_filter+0x4a/0x4a0 Aug 22 16:25:34 juju-e4d256-prod-github-runner-207 kernel: [39708.612418] ? __fget_files+0x86/0xc0 Aug 22 16:25:34 juju-e4d256-prod-github-runner-207 kernel: [39708.613144] __x64_sys_ioctl+0x95/0xd0 Aug 22 16:25:34 juju-e4d256-prod-github-runner-207 kernel: [39708.613859] do_syscall_64+0x5c/0xc0 Aug 22 16:25:34 juju-e4d256-prod-github-runner-207 kernel: [39708.614544] ? do_futex+0x162/0x1f0 Aug 22 16:25:34 juju-e4d256-prod-github-runner-207 kernel: [39708.615212] ? __x64_sys_futex+0x78/0x1e0 Aug 22 16:25:34 juju-e4d256-prod-github-runner-207 kernel: [39708.615938] ? __secure_computing+0xa9/0x120 Aug 22 16:25:34 juju-e4d256-prod-github-runner-207 kernel: [39708.616655] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 16:25:34 juju-e4d256-prod-github-runner-207 kernel: [39708.617446] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:25:34 juju-e4d256-prod-github-runner-207 kernel: [39708.618184] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:25:34 juju-e4d256-prod-github-runner-207 kernel: [39708.618926] ? do_syscall_64+0x69/0xc0 Aug 22 16:25:34 juju-e4d256-prod-github-runner-207 kernel: [39708.619625] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:25:34 juju-e4d256-prod-github-runner-207 kernel: [39708.620355] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:25:34 juju-e4d256-prod-github-runner-207 kernel: [39708.621090] ? do_syscall_64+0x69/0xc0 Aug 22 16:25:34 juju-e4d256-prod-github-runner-207 kernel: [39708.621738] ? do_syscall_64+0x69/0xc0 Aug 22 16:25:34 juju-e4d256-prod-github-runner-207 kernel: [39708.622378] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 16:25:34 juju-e4d256-prod-github-runner-207 kernel: [39708.623110] RIP: 0033:0x7faa5d0edaff Aug 22 16:25:34 juju-e4d256-prod-github-runner-207 kernel: [39708.623831] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 16:25:34 juju-e4d256-prod-github-runner-207 kernel: [39708.625908] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 16:25:34 juju-e4d256-prod-github-runner-207 kernel: [39708.626848] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 16:25:34 juju-e4d256-prod-github-runner-207 kernel: [39708.627779] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 16:25:34 juju-e4d256-prod-github-runner-207 kernel: [39708.628690] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 16:25:34 juju-e4d256-prod-github-runner-207 kernel: [39708.629600] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 16:25:34 juju-e4d256-prod-github-runner-207 kernel: [39708.630511] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 16:25:34 juju-e4d256-prod-github-runner-207 kernel: [39708.631476] Aug 22 16:26:02 juju-e4d256-prod-github-runner-207 kernel: [39736.541976] watchdog: BUG: soft lockup - CPU#1 stuck for 36899s! [qemu-system-x86:6715] Aug 22 16:26:02 juju-e4d256-prod-github-runner-207 kernel: [39736.543944] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 16:26:02 juju-e4d256-prod-github-runner-207 kernel: [39736.544272] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 16:26:02 juju-e4d256-prod-github-runner-207 kernel: [39736.556337] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 16:26:02 juju-e4d256-prod-github-runner-207 kernel: [39736.557641] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 16:26:02 juju-e4d256-prod-github-runner-207 kernel: [39736.558864] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:26:02 juju-e4d256-prod-github-runner-207 kernel: [39736.559927] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 16:26:02 juju-e4d256-prod-github-runner-207 kernel: [39736.562506] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 16:26:02 juju-e4d256-prod-github-runner-207 kernel: [39736.563569] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 16:26:02 juju-e4d256-prod-github-runner-207 kernel: [39736.564746] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 16:26:02 juju-e4d256-prod-github-runner-207 kernel: [39736.565906] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 16:26:02 juju-e4d256-prod-github-runner-207 kernel: [39736.567090] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 16:26:02 juju-e4d256-prod-github-runner-207 kernel: [39736.568252] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 16:26:02 juju-e4d256-prod-github-runner-207 kernel: [39736.569431] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 16:26:02 juju-e4d256-prod-github-runner-207 kernel: [39736.570678] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 16:26:02 juju-e4d256-prod-github-runner-207 kernel: [39736.571792] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 16:26:02 juju-e4d256-prod-github-runner-207 kernel: [39736.572982] Call Trace: Aug 22 16:26:02 juju-e4d256-prod-github-runner-207 kernel: [39736.573895] Aug 22 16:26:02 juju-e4d256-prod-github-runner-207 kernel: [39736.574792] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:26:02 juju-e4d256-prod-github-runner-207 kernel: [39736.575839] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:26:02 juju-e4d256-prod-github-runner-207 kernel: [39736.576868] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:26:02 juju-e4d256-prod-github-runner-207 kernel: [39736.577961] ? show_regs.part.0+0x23/0x29 Aug 22 16:26:02 juju-e4d256-prod-github-runner-207 kernel: [39736.578968] ? show_regs.cold+0x8/0xd Aug 22 16:26:02 juju-e4d256-prod-github-runner-207 kernel: [39736.579937] ? watchdog_timer_fn+0x1be/0x220 Aug 22 16:26:02 juju-e4d256-prod-github-runner-207 kernel: [39736.580940] ? lockup_detector_update_enable+0x60/0x60 Aug 22 16:26:02 juju-e4d256-prod-github-runner-207 kernel: [39736.582000] ? __hrtimer_run_queues+0x107/0x230 Aug 22 16:26:02 juju-e4d256-prod-github-runner-207 kernel: [39736.583884] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 16:26:02 juju-e4d256-prod-github-runner-207 kernel: [39736.584913] ? hrtimer_interrupt+0x101/0x220 Aug 22 16:26:02 juju-e4d256-prod-github-runner-207 kernel: [39736.585925] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 16:26:02 juju-e4d256-prod-github-runner-207 kernel: [39736.587002] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 16:26:02 juju-e4d256-prod-github-runner-207 kernel: [39736.588046] Aug 22 16:26:02 juju-e4d256-prod-github-runner-207 kernel: [39736.588896] Aug 22 16:26:02 juju-e4d256-prod-github-runner-207 kernel: [39736.589729] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 16:26:02 juju-e4d256-prod-github-runner-207 kernel: [39736.590759] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:26:02 juju-e4d256-prod-github-runner-207 kernel: [39736.591800] ? _raw_spin_lock+0x22/0x30 Aug 22 16:26:02 juju-e4d256-prod-github-runner-207 kernel: [39736.592747] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:26:02 juju-e4d256-prod-github-runner-207 kernel: [39736.593772] direct_page_fault+0x206/0x310 [kvm] Aug 22 16:26:02 juju-e4d256-prod-github-runner-207 kernel: [39736.594801] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 16:26:02 juju-e4d256-prod-github-runner-207 kernel: [39736.595821] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 16:26:02 juju-e4d256-prod-github-runner-207 kernel: [39736.596819] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 16:26:02 juju-e4d256-prod-github-runner-207 kernel: [39736.597821] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 16:26:02 juju-e4d256-prod-github-runner-207 kernel: [39736.598767] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 16:26:02 juju-e4d256-prod-github-runner-207 kernel: [39736.599754] handle_exit+0x98/0x230 [kvm_amd] Aug 22 16:26:02 juju-e4d256-prod-github-runner-207 kernel: [39736.600645] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 16:26:02 juju-e4d256-prod-github-runner-207 kernel: [39736.601557] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 16:26:02 juju-e4d256-prod-github-runner-207 kernel: [39736.602485] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 16:26:02 juju-e4d256-prod-github-runner-207 kernel: [39736.603398] vcpu_run+0x62/0x2c0 [kvm] Aug 22 16:26:02 juju-e4d256-prod-github-runner-207 kernel: [39736.604211] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 16:26:02 juju-e4d256-prod-github-runner-207 kernel: [39736.605025] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 16:26:02 juju-e4d256-prod-github-runner-207 kernel: [39736.605883] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 16:26:02 juju-e4d256-prod-github-runner-207 kernel: [39736.606685] ? __seccomp_filter+0x4a/0x4a0 Aug 22 16:26:02 juju-e4d256-prod-github-runner-207 kernel: [39736.607450] ? __fget_files+0x86/0xc0 Aug 22 16:26:02 juju-e4d256-prod-github-runner-207 kernel: [39736.608153] __x64_sys_ioctl+0x95/0xd0 Aug 22 16:26:02 juju-e4d256-prod-github-runner-207 kernel: [39736.608847] do_syscall_64+0x5c/0xc0 Aug 22 16:26:02 juju-e4d256-prod-github-runner-207 kernel: [39736.609512] ? do_futex+0x162/0x1f0 Aug 22 16:26:02 juju-e4d256-prod-github-runner-207 kernel: [39736.610161] ? __x64_sys_futex+0x78/0x1e0 Aug 22 16:26:02 juju-e4d256-prod-github-runner-207 kernel: [39736.610839] ? __secure_computing+0xa9/0x120 Aug 22 16:26:02 juju-e4d256-prod-github-runner-207 kernel: [39736.611534] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 16:26:02 juju-e4d256-prod-github-runner-207 kernel: [39736.612293] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:26:02 juju-e4d256-prod-github-runner-207 kernel: [39736.613013] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:26:02 juju-e4d256-prod-github-runner-207 kernel: [39736.613734] ? do_syscall_64+0x69/0xc0 Aug 22 16:26:02 juju-e4d256-prod-github-runner-207 kernel: [39736.614377] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:26:02 juju-e4d256-prod-github-runner-207 kernel: [39736.615084] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:26:02 juju-e4d256-prod-github-runner-207 kernel: [39736.615778] ? do_syscall_64+0x69/0xc0 Aug 22 16:26:02 juju-e4d256-prod-github-runner-207 kernel: [39736.616404] ? do_syscall_64+0x69/0xc0 Aug 22 16:26:02 juju-e4d256-prod-github-runner-207 kernel: [39736.617046] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 16:26:02 juju-e4d256-prod-github-runner-207 kernel: [39736.617754] RIP: 0033:0x7faa5d0edaff Aug 22 16:26:02 juju-e4d256-prod-github-runner-207 kernel: [39736.618417] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 16:26:02 juju-e4d256-prod-github-runner-207 kernel: [39736.620422] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 16:26:02 juju-e4d256-prod-github-runner-207 kernel: [39736.621340] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 16:26:02 juju-e4d256-prod-github-runner-207 kernel: [39736.622277] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 16:26:02 juju-e4d256-prod-github-runner-207 kernel: [39736.623183] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 16:26:02 juju-e4d256-prod-github-runner-207 kernel: [39736.624082] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 16:26:02 juju-e4d256-prod-github-runner-207 kernel: [39736.624981] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 16:26:02 juju-e4d256-prod-github-runner-207 kernel: [39736.625881] Aug 22 16:26:30 juju-e4d256-prod-github-runner-207 kernel: [39764.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 36925s! [qemu-system-x86:6715] Aug 22 16:26:30 juju-e4d256-prod-github-runner-207 kernel: [39764.543950] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 16:26:30 juju-e4d256-prod-github-runner-207 kernel: [39764.544282] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 16:26:30 juju-e4d256-prod-github-runner-207 kernel: [39764.556680] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 16:26:30 juju-e4d256-prod-github-runner-207 kernel: [39764.557993] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 16:26:30 juju-e4d256-prod-github-runner-207 kernel: [39764.559382] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:26:30 juju-e4d256-prod-github-runner-207 kernel: [39764.560462] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 16:26:30 juju-e4d256-prod-github-runner-207 kernel: [39764.563101] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 16:26:30 juju-e4d256-prod-github-runner-207 kernel: [39764.564160] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 16:26:30 juju-e4d256-prod-github-runner-207 kernel: [39764.565341] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 16:26:30 juju-e4d256-prod-github-runner-207 kernel: [39764.566519] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 16:26:30 juju-e4d256-prod-github-runner-207 kernel: [39764.567711] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 16:26:30 juju-e4d256-prod-github-runner-207 kernel: [39764.568902] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 16:26:30 juju-e4d256-prod-github-runner-207 kernel: [39764.570090] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 16:26:30 juju-e4d256-prod-github-runner-207 kernel: [39764.571349] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 16:26:30 juju-e4d256-prod-github-runner-207 kernel: [39764.572464] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 16:26:30 juju-e4d256-prod-github-runner-207 kernel: [39764.573682] Call Trace: Aug 22 16:26:30 juju-e4d256-prod-github-runner-207 kernel: [39764.575652] Aug 22 16:26:30 juju-e4d256-prod-github-runner-207 kernel: [39764.576571] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:26:30 juju-e4d256-prod-github-runner-207 kernel: [39764.577613] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:26:30 juju-e4d256-prod-github-runner-207 kernel: [39764.578668] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:26:30 juju-e4d256-prod-github-runner-207 kernel: [39764.579789] ? show_regs.part.0+0x23/0x29 Aug 22 16:26:30 juju-e4d256-prod-github-runner-207 kernel: [39764.580801] ? show_regs.cold+0x8/0xd Aug 22 16:26:30 juju-e4d256-prod-github-runner-207 kernel: [39764.581788] ? watchdog_timer_fn+0x1be/0x220 Aug 22 16:26:30 juju-e4d256-prod-github-runner-207 kernel: [39764.582831] ? lockup_detector_update_enable+0x60/0x60 Aug 22 16:26:30 juju-e4d256-prod-github-runner-207 kernel: [39764.583910] ? __hrtimer_run_queues+0x107/0x230 Aug 22 16:26:30 juju-e4d256-prod-github-runner-207 kernel: [39764.584949] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 16:26:30 juju-e4d256-prod-github-runner-207 kernel: [39764.585993] ? hrtimer_interrupt+0x101/0x220 Aug 22 16:26:30 juju-e4d256-prod-github-runner-207 kernel: [39764.587031] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 16:26:30 juju-e4d256-prod-github-runner-207 kernel: [39764.588117] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 16:26:30 juju-e4d256-prod-github-runner-207 kernel: [39764.589186] Aug 22 16:26:30 juju-e4d256-prod-github-runner-207 kernel: [39764.590045] Aug 22 16:26:30 juju-e4d256-prod-github-runner-207 kernel: [39764.590910] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 16:26:30 juju-e4d256-prod-github-runner-207 kernel: [39764.591959] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:26:30 juju-e4d256-prod-github-runner-207 kernel: [39764.593016] ? _raw_spin_lock+0x22/0x30 Aug 22 16:26:30 juju-e4d256-prod-github-runner-207 kernel: [39764.593973] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:26:30 juju-e4d256-prod-github-runner-207 kernel: [39764.595010] direct_page_fault+0x206/0x310 [kvm] Aug 22 16:26:30 juju-e4d256-prod-github-runner-207 kernel: [39764.596050] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 16:26:30 juju-e4d256-prod-github-runner-207 kernel: [39764.597071] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 16:26:30 juju-e4d256-prod-github-runner-207 kernel: [39764.598095] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 16:26:30 juju-e4d256-prod-github-runner-207 kernel: [39764.599118] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 16:26:30 juju-e4d256-prod-github-runner-207 kernel: [39764.600074] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 16:26:30 juju-e4d256-prod-github-runner-207 kernel: [39764.601241] handle_exit+0x98/0x230 [kvm_amd] Aug 22 16:26:30 juju-e4d256-prod-github-runner-207 kernel: [39764.602152] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 16:26:30 juju-e4d256-prod-github-runner-207 kernel: [39764.603087] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 16:26:30 juju-e4d256-prod-github-runner-207 kernel: [39764.604034] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 16:26:30 juju-e4d256-prod-github-runner-207 kernel: [39764.604950] vcpu_run+0x62/0x2c0 [kvm] Aug 22 16:26:30 juju-e4d256-prod-github-runner-207 kernel: [39764.605771] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 16:26:30 juju-e4d256-prod-github-runner-207 kernel: [39764.606600] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 16:26:30 juju-e4d256-prod-github-runner-207 kernel: [39764.607466] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 16:26:30 juju-e4d256-prod-github-runner-207 kernel: [39764.608285] ? __seccomp_filter+0x4a/0x4a0 Aug 22 16:26:30 juju-e4d256-prod-github-runner-207 kernel: [39764.609042] ? __fget_files+0x86/0xc0 Aug 22 16:26:30 juju-e4d256-prod-github-runner-207 kernel: [39764.609756] __x64_sys_ioctl+0x95/0xd0 Aug 22 16:26:30 juju-e4d256-prod-github-runner-207 kernel: [39764.610460] do_syscall_64+0x5c/0xc0 Aug 22 16:26:30 juju-e4d256-prod-github-runner-207 kernel: [39764.611148] ? do_futex+0x162/0x1f0 Aug 22 16:26:30 juju-e4d256-prod-github-runner-207 kernel: [39764.611809] ? __x64_sys_futex+0x78/0x1e0 Aug 22 16:26:30 juju-e4d256-prod-github-runner-207 kernel: [39764.612496] ? __secure_computing+0xa9/0x120 Aug 22 16:26:30 juju-e4d256-prod-github-runner-207 kernel: [39764.613205] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 16:26:30 juju-e4d256-prod-github-runner-207 kernel: [39764.613980] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:26:30 juju-e4d256-prod-github-runner-207 kernel: [39764.614726] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:26:30 juju-e4d256-prod-github-runner-207 kernel: [39764.615457] ? do_syscall_64+0x69/0xc0 Aug 22 16:26:30 juju-e4d256-prod-github-runner-207 kernel: [39764.616116] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:26:30 juju-e4d256-prod-github-runner-207 kernel: [39764.616837] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:26:30 juju-e4d256-prod-github-runner-207 kernel: [39764.617545] ? do_syscall_64+0x69/0xc0 Aug 22 16:26:30 juju-e4d256-prod-github-runner-207 kernel: [39764.618182] ? do_syscall_64+0x69/0xc0 Aug 22 16:26:30 juju-e4d256-prod-github-runner-207 kernel: [39764.618834] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 16:26:30 juju-e4d256-prod-github-runner-207 kernel: [39764.619558] RIP: 0033:0x7faa5d0edaff Aug 22 16:26:30 juju-e4d256-prod-github-runner-207 kernel: [39764.620225] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 16:26:30 juju-e4d256-prod-github-runner-207 kernel: [39764.622276] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 16:26:30 juju-e4d256-prod-github-runner-207 kernel: [39764.623216] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 16:26:30 juju-e4d256-prod-github-runner-207 kernel: [39764.624124] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 16:26:30 juju-e4d256-prod-github-runner-207 kernel: [39764.625030] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 16:26:30 juju-e4d256-prod-github-runner-207 kernel: [39764.625935] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 16:26:30 juju-e4d256-prod-github-runner-207 kernel: [39764.626851] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 16:26:30 juju-e4d256-prod-github-runner-207 kernel: [39764.627765] Aug 22 16:26:45 juju-e4d256-prod-github-runner-207 kernel: [39779.840706] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 16:26:45 juju-e4d256-prod-github-runner-207 kernel: [39779.842487] rcu: 1-....: (9884533 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=4780210 Aug 22 16:26:45 juju-e4d256-prod-github-runner-207 kernel: [39779.843641] (t=9915660 jiffies g=23269 q=40649) Aug 22 16:26:45 juju-e4d256-prod-github-runner-207 kernel: [39779.844442] NMI backtrace for cpu 1 Aug 22 16:26:45 juju-e4d256-prod-github-runner-207 kernel: [39779.845157] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 16:26:45 juju-e4d256-prod-github-runner-207 kernel: [39779.846438] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 16:26:45 juju-e4d256-prod-github-runner-207 kernel: [39779.847731] Call Trace: Aug 22 16:26:45 juju-e4d256-prod-github-runner-207 kernel: [39779.848532] Aug 22 16:26:45 juju-e4d256-prod-github-runner-207 kernel: [39779.849212] show_stack+0x52/0x5c Aug 22 16:26:45 juju-e4d256-prod-github-runner-207 kernel: [39779.850141] dump_stack_lvl+0x4a/0x63 Aug 22 16:26:45 juju-e4d256-prod-github-runner-207 kernel: [39779.851063] dump_stack+0x10/0x16 Aug 22 16:26:45 juju-e4d256-prod-github-runner-207 kernel: [39779.851897] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 16:26:45 juju-e4d256-prod-github-runner-207 kernel: [39779.852817] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 16:26:45 juju-e4d256-prod-github-runner-207 kernel: [39779.853709] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 16:26:45 juju-e4d256-prod-github-runner-207 kernel: [39779.854704] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 16:26:45 juju-e4d256-prod-github-runner-207 kernel: [39779.855783] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 16:26:45 juju-e4d256-prod-github-runner-207 kernel: [39779.856770] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 16:26:45 juju-e4d256-prod-github-runner-207 kernel: [39779.857604] print_cpu_stall.cold+0x2f/0xe2 Aug 22 16:26:45 juju-e4d256-prod-github-runner-207 kernel: [39779.858587] ? timekeeping_update+0xf7/0x150 Aug 22 16:26:45 juju-e4d256-prod-github-runner-207 kernel: [39779.859611] check_cpu_stall+0x109/0x270 Aug 22 16:26:45 juju-e4d256-prod-github-runner-207 kernel: [39779.860568] rcu_sched_clock_irq+0x9a/0x250 Aug 22 16:26:45 juju-e4d256-prod-github-runner-207 kernel: [39779.861361] update_process_times+0x94/0xd0 Aug 22 16:26:45 juju-e4d256-prod-github-runner-207 kernel: [39779.862306] tick_sched_handle+0x29/0x70 Aug 22 16:26:45 juju-e4d256-prod-github-runner-207 kernel: [39779.863359] tick_sched_timer+0x8c/0xc0 Aug 22 16:26:45 juju-e4d256-prod-github-runner-207 kernel: [39779.864339] ? tick_nohz_handler+0xb0/0xb0 Aug 22 16:26:45 juju-e4d256-prod-github-runner-207 kernel: [39779.865262] __hrtimer_run_queues+0x107/0x230 Aug 22 16:26:45 juju-e4d256-prod-github-runner-207 kernel: [39779.866500] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 16:26:45 juju-e4d256-prod-github-runner-207 kernel: [39779.867543] hrtimer_interrupt+0x101/0x220 Aug 22 16:26:45 juju-e4d256-prod-github-runner-207 kernel: [39779.868442] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 16:26:45 juju-e4d256-prod-github-runner-207 kernel: [39779.869372] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 16:26:45 juju-e4d256-prod-github-runner-207 kernel: [39779.870372] Aug 22 16:26:45 juju-e4d256-prod-github-runner-207 kernel: [39779.871166] Aug 22 16:26:45 juju-e4d256-prod-github-runner-207 kernel: [39779.871916] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 16:26:45 juju-e4d256-prod-github-runner-207 kernel: [39779.872914] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:26:45 juju-e4d256-prod-github-runner-207 kernel: [39779.874013] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 16:26:45 juju-e4d256-prod-github-runner-207 kernel: [39779.876762] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 16:26:45 juju-e4d256-prod-github-runner-207 kernel: [39779.877681] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 16:26:45 juju-e4d256-prod-github-runner-207 kernel: [39779.879014] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 16:26:45 juju-e4d256-prod-github-runner-207 kernel: [39779.880245] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 16:26:45 juju-e4d256-prod-github-runner-207 kernel: [39779.881505] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 16:26:45 juju-e4d256-prod-github-runner-207 kernel: [39779.882590] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 16:26:45 juju-e4d256-prod-github-runner-207 kernel: [39779.883729] ? _raw_spin_lock+0x22/0x30 Aug 22 16:26:45 juju-e4d256-prod-github-runner-207 kernel: [39779.884724] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:26:45 juju-e4d256-prod-github-runner-207 kernel: [39779.885850] direct_page_fault+0x206/0x310 [kvm] Aug 22 16:26:45 juju-e4d256-prod-github-runner-207 kernel: [39779.887011] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 16:26:45 juju-e4d256-prod-github-runner-207 kernel: [39779.888005] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 16:26:45 juju-e4d256-prod-github-runner-207 kernel: [39779.888932] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 16:26:45 juju-e4d256-prod-github-runner-207 kernel: [39779.889947] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 16:26:45 juju-e4d256-prod-github-runner-207 kernel: [39779.890906] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 16:26:45 juju-e4d256-prod-github-runner-207 kernel: [39779.891894] handle_exit+0x98/0x230 [kvm_amd] Aug 22 16:26:45 juju-e4d256-prod-github-runner-207 kernel: [39779.892830] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 16:26:45 juju-e4d256-prod-github-runner-207 kernel: [39779.893744] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 16:26:45 juju-e4d256-prod-github-runner-207 kernel: [39779.894600] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 16:26:45 juju-e4d256-prod-github-runner-207 kernel: [39779.895447] vcpu_run+0x62/0x2c0 [kvm] Aug 22 16:26:45 juju-e4d256-prod-github-runner-207 kernel: [39779.896169] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 16:26:45 juju-e4d256-prod-github-runner-207 kernel: [39779.896923] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 16:26:45 juju-e4d256-prod-github-runner-207 kernel: [39779.897747] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 16:26:45 juju-e4d256-prod-github-runner-207 kernel: [39779.898643] ? __seccomp_filter+0x4a/0x4a0 Aug 22 16:26:45 juju-e4d256-prod-github-runner-207 kernel: [39779.899374] ? __fget_files+0x86/0xc0 Aug 22 16:26:45 juju-e4d256-prod-github-runner-207 kernel: [39779.900068] __x64_sys_ioctl+0x95/0xd0 Aug 22 16:26:45 juju-e4d256-prod-github-runner-207 kernel: [39779.900766] do_syscall_64+0x5c/0xc0 Aug 22 16:26:45 juju-e4d256-prod-github-runner-207 kernel: [39779.901489] ? do_futex+0x162/0x1f0 Aug 22 16:26:45 juju-e4d256-prod-github-runner-207 kernel: [39779.902201] ? __x64_sys_futex+0x78/0x1e0 Aug 22 16:26:45 juju-e4d256-prod-github-runner-207 kernel: [39779.902924] ? __secure_computing+0xa9/0x120 Aug 22 16:26:45 juju-e4d256-prod-github-runner-207 kernel: [39779.903691] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 16:26:45 juju-e4d256-prod-github-runner-207 kernel: [39779.904528] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:26:45 juju-e4d256-prod-github-runner-207 kernel: [39779.905292] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:26:45 juju-e4d256-prod-github-runner-207 kernel: [39779.906047] ? do_syscall_64+0x69/0xc0 Aug 22 16:26:45 juju-e4d256-prod-github-runner-207 kernel: [39779.906757] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:26:45 juju-e4d256-prod-github-runner-207 kernel: [39779.907519] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:26:45 juju-e4d256-prod-github-runner-207 kernel: [39779.908348] ? do_syscall_64+0x69/0xc0 Aug 22 16:26:45 juju-e4d256-prod-github-runner-207 kernel: [39779.909063] ? do_syscall_64+0x69/0xc0 Aug 22 16:26:45 juju-e4d256-prod-github-runner-207 kernel: [39779.909770] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 16:26:45 juju-e4d256-prod-github-runner-207 kernel: [39779.910564] RIP: 0033:0x7faa5d0edaff Aug 22 16:26:45 juju-e4d256-prod-github-runner-207 kernel: [39779.911302] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 16:26:45 juju-e4d256-prod-github-runner-207 kernel: [39779.913466] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 16:26:45 juju-e4d256-prod-github-runner-207 kernel: [39779.914491] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 16:26:45 juju-e4d256-prod-github-runner-207 kernel: [39779.915456] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 16:26:45 juju-e4d256-prod-github-runner-207 kernel: [39779.916425] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 16:26:45 juju-e4d256-prod-github-runner-207 kernel: [39779.917370] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 16:26:45 juju-e4d256-prod-github-runner-207 kernel: [39779.918358] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 16:26:45 juju-e4d256-prod-github-runner-207 kernel: [39779.919284] Aug 22 16:27:10 juju-e4d256-prod-github-runner-207 kernel: [39804.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 36962s! [qemu-system-x86:6715] Aug 22 16:27:10 juju-e4d256-prod-github-runner-207 kernel: [39804.543842] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 16:27:10 juju-e4d256-prod-github-runner-207 kernel: [39804.544136] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 16:27:10 juju-e4d256-prod-github-runner-207 kernel: [39804.556572] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 16:27:10 juju-e4d256-prod-github-runner-207 kernel: [39804.557842] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 16:27:10 juju-e4d256-prod-github-runner-207 kernel: [39804.559073] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:27:10 juju-e4d256-prod-github-runner-207 kernel: [39804.560131] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 16:27:10 juju-e4d256-prod-github-runner-207 kernel: [39804.562731] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 16:27:10 juju-e4d256-prod-github-runner-207 kernel: [39804.563802] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 16:27:10 juju-e4d256-prod-github-runner-207 kernel: [39804.565117] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 16:27:10 juju-e4d256-prod-github-runner-207 kernel: [39804.566290] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 16:27:10 juju-e4d256-prod-github-runner-207 kernel: [39804.567455] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 16:27:10 juju-e4d256-prod-github-runner-207 kernel: [39804.568627] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 16:27:10 juju-e4d256-prod-github-runner-207 kernel: [39804.569800] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 16:27:10 juju-e4d256-prod-github-runner-207 kernel: [39804.571050] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 16:27:10 juju-e4d256-prod-github-runner-207 kernel: [39804.572156] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 16:27:10 juju-e4d256-prod-github-runner-207 kernel: [39804.573354] Call Trace: Aug 22 16:27:10 juju-e4d256-prod-github-runner-207 kernel: [39804.574280] Aug 22 16:27:10 juju-e4d256-prod-github-runner-207 kernel: [39804.575172] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:27:10 juju-e4d256-prod-github-runner-207 kernel: [39804.576204] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:27:10 juju-e4d256-prod-github-runner-207 kernel: [39804.577227] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:27:10 juju-e4d256-prod-github-runner-207 kernel: [39804.578332] ? show_regs.part.0+0x23/0x29 Aug 22 16:27:10 juju-e4d256-prod-github-runner-207 kernel: [39804.579334] ? show_regs.cold+0x8/0xd Aug 22 16:27:10 juju-e4d256-prod-github-runner-207 kernel: [39804.580307] ? watchdog_timer_fn+0x1be/0x220 Aug 22 16:27:10 juju-e4d256-prod-github-runner-207 kernel: [39804.581327] ? lockup_detector_update_enable+0x60/0x60 Aug 22 16:27:10 juju-e4d256-prod-github-runner-207 kernel: [39804.582401] ? __hrtimer_run_queues+0x107/0x230 Aug 22 16:27:10 juju-e4d256-prod-github-runner-207 kernel: [39804.583436] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 16:27:10 juju-e4d256-prod-github-runner-207 kernel: [39804.584462] ? hrtimer_interrupt+0x101/0x220 Aug 22 16:27:10 juju-e4d256-prod-github-runner-207 kernel: [39804.585480] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 16:27:10 juju-e4d256-prod-github-runner-207 kernel: [39804.586569] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 16:27:10 juju-e4d256-prod-github-runner-207 kernel: [39804.587623] Aug 22 16:27:10 juju-e4d256-prod-github-runner-207 kernel: [39804.588488] Aug 22 16:27:10 juju-e4d256-prod-github-runner-207 kernel: [39804.589326] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 16:27:10 juju-e4d256-prod-github-runner-207 kernel: [39804.590375] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:27:10 juju-e4d256-prod-github-runner-207 kernel: [39804.591418] ? _raw_spin_lock+0x22/0x30 Aug 22 16:27:10 juju-e4d256-prod-github-runner-207 kernel: [39804.592391] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:27:10 juju-e4d256-prod-github-runner-207 kernel: [39804.593410] direct_page_fault+0x206/0x310 [kvm] Aug 22 16:27:10 juju-e4d256-prod-github-runner-207 kernel: [39804.594500] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 16:27:10 juju-e4d256-prod-github-runner-207 kernel: [39804.595517] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 16:27:10 juju-e4d256-prod-github-runner-207 kernel: [39804.596522] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 16:27:10 juju-e4d256-prod-github-runner-207 kernel: [39804.597524] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 16:27:10 juju-e4d256-prod-github-runner-207 kernel: [39804.598489] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 16:27:10 juju-e4d256-prod-github-runner-207 kernel: [39804.599510] handle_exit+0x98/0x230 [kvm_amd] Aug 22 16:27:10 juju-e4d256-prod-github-runner-207 kernel: [39804.600407] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 16:27:10 juju-e4d256-prod-github-runner-207 kernel: [39804.601323] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 16:27:10 juju-e4d256-prod-github-runner-207 kernel: [39804.602263] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 16:27:10 juju-e4d256-prod-github-runner-207 kernel: [39804.603174] vcpu_run+0x62/0x2c0 [kvm] Aug 22 16:27:10 juju-e4d256-prod-github-runner-207 kernel: [39804.603986] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 16:27:10 juju-e4d256-prod-github-runner-207 kernel: [39804.604802] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 16:27:10 juju-e4d256-prod-github-runner-207 kernel: [39804.605669] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 16:27:10 juju-e4d256-prod-github-runner-207 kernel: [39804.606482] ? __seccomp_filter+0x4a/0x4a0 Aug 22 16:27:10 juju-e4d256-prod-github-runner-207 kernel: [39804.607226] ? __fget_files+0x86/0xc0 Aug 22 16:27:10 juju-e4d256-prod-github-runner-207 kernel: [39804.607938] __x64_sys_ioctl+0x95/0xd0 Aug 22 16:27:10 juju-e4d256-prod-github-runner-207 kernel: [39804.608633] do_syscall_64+0x5c/0xc0 Aug 22 16:27:10 juju-e4d256-prod-github-runner-207 kernel: [39804.609302] ? do_futex+0x162/0x1f0 Aug 22 16:27:10 juju-e4d256-prod-github-runner-207 kernel: [39804.609964] ? __x64_sys_futex+0x78/0x1e0 Aug 22 16:27:10 juju-e4d256-prod-github-runner-207 kernel: [39804.610654] ? __secure_computing+0xa9/0x120 Aug 22 16:27:10 juju-e4d256-prod-github-runner-207 kernel: [39804.611345] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 16:27:10 juju-e4d256-prod-github-runner-207 kernel: [39804.612103] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:27:10 juju-e4d256-prod-github-runner-207 kernel: [39804.612824] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:27:10 juju-e4d256-prod-github-runner-207 kernel: [39804.613540] ? do_syscall_64+0x69/0xc0 Aug 22 16:27:10 juju-e4d256-prod-github-runner-207 kernel: [39804.614197] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:27:10 juju-e4d256-prod-github-runner-207 kernel: [39804.614900] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:27:10 juju-e4d256-prod-github-runner-207 kernel: [39804.615597] ? do_syscall_64+0x69/0xc0 Aug 22 16:27:10 juju-e4d256-prod-github-runner-207 kernel: [39804.616222] ? do_syscall_64+0x69/0xc0 Aug 22 16:27:10 juju-e4d256-prod-github-runner-207 kernel: [39804.616844] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 16:27:10 juju-e4d256-prod-github-runner-207 kernel: [39804.617564] RIP: 0033:0x7faa5d0edaff Aug 22 16:27:10 juju-e4d256-prod-github-runner-207 kernel: [39804.618230] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 16:27:10 juju-e4d256-prod-github-runner-207 kernel: [39804.620215] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 16:27:10 juju-e4d256-prod-github-runner-207 kernel: [39804.621126] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 16:27:10 juju-e4d256-prod-github-runner-207 kernel: [39804.622017] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 16:27:10 juju-e4d256-prod-github-runner-207 kernel: [39804.622919] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 16:27:10 juju-e4d256-prod-github-runner-207 kernel: [39804.623808] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 16:27:10 juju-e4d256-prod-github-runner-207 kernel: [39804.624701] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 16:27:10 juju-e4d256-prod-github-runner-207 kernel: [39804.625596] Aug 22 16:27:38 juju-e4d256-prod-github-runner-207 kernel: [39832.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 36988s! [qemu-system-x86:6715] Aug 22 16:27:38 juju-e4d256-prod-github-runner-207 kernel: [39832.543899] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 16:27:38 juju-e4d256-prod-github-runner-207 kernel: [39832.544210] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 16:27:38 juju-e4d256-prod-github-runner-207 kernel: [39832.556739] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 16:27:38 juju-e4d256-prod-github-runner-207 kernel: [39832.558033] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 16:27:38 juju-e4d256-prod-github-runner-207 kernel: [39832.559286] RIP: 0010:native_queued_spin_lock_slowpath+0xc/0x40 Aug 22 16:27:38 juju-e4d256-prod-github-runner-207 kernel: [39832.560347] Code: fe ff ff eb af 4c 89 fe 48 c7 c7 20 99 e9 89 e8 ca 69 55 00 e9 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 <8b> 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 eb Aug 22 16:27:38 juju-e4d256-prod-github-runner-207 kernel: [39832.562912] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 16:27:38 juju-e4d256-prod-github-runner-207 kernel: [39832.563960] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 16:27:38 juju-e4d256-prod-github-runner-207 kernel: [39832.565120] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 16:27:38 juju-e4d256-prod-github-runner-207 kernel: [39832.566289] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 16:27:38 juju-e4d256-prod-github-runner-207 kernel: [39832.567454] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 16:27:38 juju-e4d256-prod-github-runner-207 kernel: [39832.568615] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 16:27:38 juju-e4d256-prod-github-runner-207 kernel: [39832.569857] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 16:27:38 juju-e4d256-prod-github-runner-207 kernel: [39832.571131] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 16:27:38 juju-e4d256-prod-github-runner-207 kernel: [39832.572229] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 16:27:38 juju-e4d256-prod-github-runner-207 kernel: [39832.573422] Call Trace: Aug 22 16:27:38 juju-e4d256-prod-github-runner-207 kernel: [39832.574356] Aug 22 16:27:38 juju-e4d256-prod-github-runner-207 kernel: [39832.575298] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:27:38 juju-e4d256-prod-github-runner-207 kernel: [39832.576500] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:27:38 juju-e4d256-prod-github-runner-207 kernel: [39832.577653] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:27:38 juju-e4d256-prod-github-runner-207 kernel: [39832.578805] ? show_regs.part.0+0x23/0x29 Aug 22 16:27:38 juju-e4d256-prod-github-runner-207 kernel: [39832.579829] ? show_regs.cold+0x8/0xd Aug 22 16:27:38 juju-e4d256-prod-github-runner-207 kernel: [39832.580810] ? watchdog_timer_fn+0x1be/0x220 Aug 22 16:27:38 juju-e4d256-prod-github-runner-207 kernel: [39832.581839] ? lockup_detector_update_enable+0x60/0x60 Aug 22 16:27:38 juju-e4d256-prod-github-runner-207 kernel: [39832.582911] ? __hrtimer_run_queues+0x107/0x230 Aug 22 16:27:38 juju-e4d256-prod-github-runner-207 kernel: [39832.584023] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 16:27:38 juju-e4d256-prod-github-runner-207 kernel: [39832.585164] ? hrtimer_interrupt+0x101/0x220 Aug 22 16:27:38 juju-e4d256-prod-github-runner-207 kernel: [39832.586231] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 16:27:38 juju-e4d256-prod-github-runner-207 kernel: [39832.587306] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 16:27:38 juju-e4d256-prod-github-runner-207 kernel: [39832.588359] Aug 22 16:27:38 juju-e4d256-prod-github-runner-207 kernel: [39832.589361] Aug 22 16:27:38 juju-e4d256-prod-github-runner-207 kernel: [39832.590357] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 16:27:38 juju-e4d256-prod-github-runner-207 kernel: [39832.591443] ? native_queued_spin_lock_slowpath+0xc/0x40 Aug 22 16:27:38 juju-e4d256-prod-github-runner-207 kernel: [39832.592507] ? _raw_spin_lock+0x22/0x30 Aug 22 16:27:38 juju-e4d256-prod-github-runner-207 kernel: [39832.593493] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:27:38 juju-e4d256-prod-github-runner-207 kernel: [39832.594570] direct_page_fault+0x206/0x310 [kvm] Aug 22 16:27:38 juju-e4d256-prod-github-runner-207 kernel: [39832.595659] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 16:27:38 juju-e4d256-prod-github-runner-207 kernel: [39832.596742] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 16:27:38 juju-e4d256-prod-github-runner-207 kernel: [39832.598014] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 16:27:38 juju-e4d256-prod-github-runner-207 kernel: [39832.599041] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 16:27:38 juju-e4d256-prod-github-runner-207 kernel: [39832.599998] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 16:27:38 juju-e4d256-prod-github-runner-207 kernel: [39832.600980] handle_exit+0x98/0x230 [kvm_amd] Aug 22 16:27:38 juju-e4d256-prod-github-runner-207 kernel: [39832.601890] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 16:27:38 juju-e4d256-prod-github-runner-207 kernel: [39832.602806] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 16:27:38 juju-e4d256-prod-github-runner-207 kernel: [39832.603732] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 16:27:38 juju-e4d256-prod-github-runner-207 kernel: [39832.604640] vcpu_run+0x62/0x2c0 [kvm] Aug 22 16:27:38 juju-e4d256-prod-github-runner-207 kernel: [39832.605452] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 16:27:38 juju-e4d256-prod-github-runner-207 kernel: [39832.606272] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 16:27:38 juju-e4d256-prod-github-runner-207 kernel: [39832.607129] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 16:27:38 juju-e4d256-prod-github-runner-207 kernel: [39832.607932] ? __seccomp_filter+0x4a/0x4a0 Aug 22 16:27:38 juju-e4d256-prod-github-runner-207 kernel: [39832.608683] ? __fget_files+0x86/0xc0 Aug 22 16:27:38 juju-e4d256-prod-github-runner-207 kernel: [39832.609389] __x64_sys_ioctl+0x95/0xd0 Aug 22 16:27:38 juju-e4d256-prod-github-runner-207 kernel: [39832.610092] do_syscall_64+0x5c/0xc0 Aug 22 16:27:38 juju-e4d256-prod-github-runner-207 kernel: [39832.610785] ? do_futex+0x162/0x1f0 Aug 22 16:27:38 juju-e4d256-prod-github-runner-207 kernel: [39832.611447] ? __x64_sys_futex+0x78/0x1e0 Aug 22 16:27:38 juju-e4d256-prod-github-runner-207 kernel: [39832.612130] ? __secure_computing+0xa9/0x120 Aug 22 16:27:38 juju-e4d256-prod-github-runner-207 kernel: [39832.612822] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 16:27:38 juju-e4d256-prod-github-runner-207 kernel: [39832.613589] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:27:38 juju-e4d256-prod-github-runner-207 kernel: [39832.614331] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:27:38 juju-e4d256-prod-github-runner-207 kernel: [39832.615336] ? do_syscall_64+0x69/0xc0 Aug 22 16:27:38 juju-e4d256-prod-github-runner-207 kernel: [39832.616034] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:27:38 juju-e4d256-prod-github-runner-207 kernel: [39832.616749] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:27:38 juju-e4d256-prod-github-runner-207 kernel: [39832.617446] ? do_syscall_64+0x69/0xc0 Aug 22 16:27:38 juju-e4d256-prod-github-runner-207 kernel: [39832.618098] ? do_syscall_64+0x69/0xc0 Aug 22 16:27:38 juju-e4d256-prod-github-runner-207 kernel: [39832.618723] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 16:27:38 juju-e4d256-prod-github-runner-207 kernel: [39832.619431] RIP: 0033:0x7faa5d0edaff Aug 22 16:27:38 juju-e4d256-prod-github-runner-207 kernel: [39832.620113] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 16:27:38 juju-e4d256-prod-github-runner-207 kernel: [39832.622141] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 16:27:38 juju-e4d256-prod-github-runner-207 kernel: [39832.623056] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 16:27:38 juju-e4d256-prod-github-runner-207 kernel: [39832.623995] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 16:27:38 juju-e4d256-prod-github-runner-207 kernel: [39832.624898] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 16:27:38 juju-e4d256-prod-github-runner-207 kernel: [39832.625841] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 16:27:38 juju-e4d256-prod-github-runner-207 kernel: [39832.626755] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 16:27:38 juju-e4d256-prod-github-runner-207 kernel: [39832.627652] Aug 22 16:28:06 juju-e4d256-prod-github-runner-207 kernel: [39860.541976] watchdog: BUG: soft lockup - CPU#1 stuck for 37015s! [qemu-system-x86:6715] Aug 22 16:28:06 juju-e4d256-prod-github-runner-207 kernel: [39860.543897] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 16:28:06 juju-e4d256-prod-github-runner-207 kernel: [39860.544203] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 16:28:06 juju-e4d256-prod-github-runner-207 kernel: [39860.556503] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 16:28:06 juju-e4d256-prod-github-runner-207 kernel: [39860.557815] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 16:28:06 juju-e4d256-prod-github-runner-207 kernel: [39860.559055] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:28:06 juju-e4d256-prod-github-runner-207 kernel: [39860.560143] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 16:28:06 juju-e4d256-prod-github-runner-207 kernel: [39860.562720] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 16:28:06 juju-e4d256-prod-github-runner-207 kernel: [39860.563774] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 16:28:06 juju-e4d256-prod-github-runner-207 kernel: [39860.564959] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 16:28:06 juju-e4d256-prod-github-runner-207 kernel: [39860.566133] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 16:28:06 juju-e4d256-prod-github-runner-207 kernel: [39860.567330] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 16:28:06 juju-e4d256-prod-github-runner-207 kernel: [39860.568518] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 16:28:06 juju-e4d256-prod-github-runner-207 kernel: [39860.569710] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 16:28:06 juju-e4d256-prod-github-runner-207 kernel: [39860.570946] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 16:28:06 juju-e4d256-prod-github-runner-207 kernel: [39860.572060] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 16:28:06 juju-e4d256-prod-github-runner-207 kernel: [39860.573254] Call Trace: Aug 22 16:28:06 juju-e4d256-prod-github-runner-207 kernel: [39860.574180] Aug 22 16:28:06 juju-e4d256-prod-github-runner-207 kernel: [39860.575090] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:28:06 juju-e4d256-prod-github-runner-207 kernel: [39860.576150] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:28:06 juju-e4d256-prod-github-runner-207 kernel: [39860.577196] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:28:06 juju-e4d256-prod-github-runner-207 kernel: [39860.578330] ? show_regs.part.0+0x23/0x29 Aug 22 16:28:06 juju-e4d256-prod-github-runner-207 kernel: [39860.579329] ? show_regs.cold+0x8/0xd Aug 22 16:28:06 juju-e4d256-prod-github-runner-207 kernel: [39860.580302] ? watchdog_timer_fn+0x1be/0x220 Aug 22 16:28:06 juju-e4d256-prod-github-runner-207 kernel: [39860.581337] ? lockup_detector_update_enable+0x60/0x60 Aug 22 16:28:06 juju-e4d256-prod-github-runner-207 kernel: [39860.582429] ? __hrtimer_run_queues+0x107/0x230 Aug 22 16:28:06 juju-e4d256-prod-github-runner-207 kernel: [39860.583467] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 16:28:06 juju-e4d256-prod-github-runner-207 kernel: [39860.584518] ? hrtimer_interrupt+0x101/0x220 Aug 22 16:28:06 juju-e4d256-prod-github-runner-207 kernel: [39860.585559] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 16:28:06 juju-e4d256-prod-github-runner-207 kernel: [39860.586642] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 16:28:06 juju-e4d256-prod-github-runner-207 kernel: [39860.587708] Aug 22 16:28:06 juju-e4d256-prod-github-runner-207 kernel: [39860.588568] Aug 22 16:28:06 juju-e4d256-prod-github-runner-207 kernel: [39860.589419] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 16:28:06 juju-e4d256-prod-github-runner-207 kernel: [39860.590470] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:28:06 juju-e4d256-prod-github-runner-207 kernel: [39860.591511] ? _raw_spin_lock+0x22/0x30 Aug 22 16:28:06 juju-e4d256-prod-github-runner-207 kernel: [39860.592466] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:28:06 juju-e4d256-prod-github-runner-207 kernel: [39860.593518] direct_page_fault+0x206/0x310 [kvm] Aug 22 16:28:06 juju-e4d256-prod-github-runner-207 kernel: [39860.594550] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 16:28:06 juju-e4d256-prod-github-runner-207 kernel: [39860.595577] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 16:28:06 juju-e4d256-prod-github-runner-207 kernel: [39860.596580] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 16:28:06 juju-e4d256-prod-github-runner-207 kernel: [39860.597617] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 16:28:06 juju-e4d256-prod-github-runner-207 kernel: [39860.598571] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 16:28:06 juju-e4d256-prod-github-runner-207 kernel: [39860.599556] handle_exit+0x98/0x230 [kvm_amd] Aug 22 16:28:06 juju-e4d256-prod-github-runner-207 kernel: [39860.600466] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 16:28:06 juju-e4d256-prod-github-runner-207 kernel: [39860.601384] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 16:28:06 juju-e4d256-prod-github-runner-207 kernel: [39860.602325] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 16:28:06 juju-e4d256-prod-github-runner-207 kernel: [39860.603231] vcpu_run+0x62/0x2c0 [kvm] Aug 22 16:28:06 juju-e4d256-prod-github-runner-207 kernel: [39860.604046] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 16:28:06 juju-e4d256-prod-github-runner-207 kernel: [39860.604869] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 16:28:06 juju-e4d256-prod-github-runner-207 kernel: [39860.605743] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 16:28:06 juju-e4d256-prod-github-runner-207 kernel: [39860.606541] ? __seccomp_filter+0x4a/0x4a0 Aug 22 16:28:06 juju-e4d256-prod-github-runner-207 kernel: [39860.607303] ? __fget_files+0x86/0xc0 Aug 22 16:28:06 juju-e4d256-prod-github-runner-207 kernel: [39860.608013] __x64_sys_ioctl+0x95/0xd0 Aug 22 16:28:06 juju-e4d256-prod-github-runner-207 kernel: [39860.608707] do_syscall_64+0x5c/0xc0 Aug 22 16:28:06 juju-e4d256-prod-github-runner-207 kernel: [39860.609412] ? do_futex+0x162/0x1f0 Aug 22 16:28:06 juju-e4d256-prod-github-runner-207 kernel: [39860.610088] ? __x64_sys_futex+0x78/0x1e0 Aug 22 16:28:06 juju-e4d256-prod-github-runner-207 kernel: [39860.610775] ? __secure_computing+0xa9/0x120 Aug 22 16:28:06 juju-e4d256-prod-github-runner-207 kernel: [39860.611475] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 16:28:06 juju-e4d256-prod-github-runner-207 kernel: [39860.612244] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:28:06 juju-e4d256-prod-github-runner-207 kernel: [39860.612967] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:28:06 juju-e4d256-prod-github-runner-207 kernel: [39860.613695] ? do_syscall_64+0x69/0xc0 Aug 22 16:28:06 juju-e4d256-prod-github-runner-207 kernel: [39860.614357] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:28:06 juju-e4d256-prod-github-runner-207 kernel: [39860.615067] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:28:06 juju-e4d256-prod-github-runner-207 kernel: [39860.615763] ? do_syscall_64+0x69/0xc0 Aug 22 16:28:06 juju-e4d256-prod-github-runner-207 kernel: [39860.616395] ? do_syscall_64+0x69/0xc0 Aug 22 16:28:06 juju-e4d256-prod-github-runner-207 kernel: [39860.617031] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 16:28:06 juju-e4d256-prod-github-runner-207 kernel: [39860.617752] RIP: 0033:0x7faa5d0edaff Aug 22 16:28:06 juju-e4d256-prod-github-runner-207 kernel: [39860.618417] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 16:28:06 juju-e4d256-prod-github-runner-207 kernel: [39860.620443] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 16:28:06 juju-e4d256-prod-github-runner-207 kernel: [39860.621368] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 16:28:06 juju-e4d256-prod-github-runner-207 kernel: [39860.622290] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 16:28:06 juju-e4d256-prod-github-runner-207 kernel: [39860.623188] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 16:28:06 juju-e4d256-prod-github-runner-207 kernel: [39860.624095] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 16:28:06 juju-e4d256-prod-github-runner-207 kernel: [39860.625021] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 16:28:06 juju-e4d256-prod-github-runner-207 kernel: [39860.625935] Aug 22 16:28:34 juju-e4d256-prod-github-runner-207 kernel: [39888.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 37041s! [qemu-system-x86:6715] Aug 22 16:28:34 juju-e4d256-prod-github-runner-207 kernel: [39888.543954] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 16:28:34 juju-e4d256-prod-github-runner-207 kernel: [39888.544262] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 16:28:34 juju-e4d256-prod-github-runner-207 kernel: [39888.556992] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 16:28:34 juju-e4d256-prod-github-runner-207 kernel: [39888.558314] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 16:28:34 juju-e4d256-prod-github-runner-207 kernel: [39888.559571] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:28:34 juju-e4d256-prod-github-runner-207 kernel: [39888.560650] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 16:28:34 juju-e4d256-prod-github-runner-207 kernel: [39888.563290] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 16:28:34 juju-e4d256-prod-github-runner-207 kernel: [39888.564367] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 16:28:34 juju-e4d256-prod-github-runner-207 kernel: [39888.565580] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 16:28:34 juju-e4d256-prod-github-runner-207 kernel: [39888.566760] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 16:28:34 juju-e4d256-prod-github-runner-207 kernel: [39888.567947] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 16:28:34 juju-e4d256-prod-github-runner-207 kernel: [39888.569151] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 16:28:34 juju-e4d256-prod-github-runner-207 kernel: [39888.570336] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 16:28:34 juju-e4d256-prod-github-runner-207 kernel: [39888.571604] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 16:28:34 juju-e4d256-prod-github-runner-207 kernel: [39888.572741] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 16:28:34 juju-e4d256-prod-github-runner-207 kernel: [39888.573984] Call Trace: Aug 22 16:28:34 juju-e4d256-prod-github-runner-207 kernel: [39888.574944] Aug 22 16:28:34 juju-e4d256-prod-github-runner-207 kernel: [39888.575865] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:28:34 juju-e4d256-prod-github-runner-207 kernel: [39888.576924] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:28:34 juju-e4d256-prod-github-runner-207 kernel: [39888.577984] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:28:34 juju-e4d256-prod-github-runner-207 kernel: [39888.579104] ? show_regs.part.0+0x23/0x29 Aug 22 16:28:34 juju-e4d256-prod-github-runner-207 kernel: [39888.580119] ? show_regs.cold+0x8/0xd Aug 22 16:28:34 juju-e4d256-prod-github-runner-207 kernel: [39888.581107] ? watchdog_timer_fn+0x1be/0x220 Aug 22 16:28:34 juju-e4d256-prod-github-runner-207 kernel: [39888.582154] ? lockup_detector_update_enable+0x60/0x60 Aug 22 16:28:34 juju-e4d256-prod-github-runner-207 kernel: [39888.583239] ? __hrtimer_run_queues+0x107/0x230 Aug 22 16:28:34 juju-e4d256-prod-github-runner-207 kernel: [39888.584384] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 16:28:34 juju-e4d256-prod-github-runner-207 kernel: [39888.585487] ? hrtimer_interrupt+0x101/0x220 Aug 22 16:28:34 juju-e4d256-prod-github-runner-207 kernel: [39888.586526] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 16:28:34 juju-e4d256-prod-github-runner-207 kernel: [39888.587625] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 16:28:34 juju-e4d256-prod-github-runner-207 kernel: [39888.588700] Aug 22 16:28:34 juju-e4d256-prod-github-runner-207 kernel: [39888.589578] Aug 22 16:28:34 juju-e4d256-prod-github-runner-207 kernel: [39888.590428] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 16:28:34 juju-e4d256-prod-github-runner-207 kernel: [39888.591478] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:28:34 juju-e4d256-prod-github-runner-207 kernel: [39888.592534] ? _raw_spin_lock+0x22/0x30 Aug 22 16:28:34 juju-e4d256-prod-github-runner-207 kernel: [39888.593522] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:28:34 juju-e4d256-prod-github-runner-207 kernel: [39888.594565] direct_page_fault+0x206/0x310 [kvm] Aug 22 16:28:34 juju-e4d256-prod-github-runner-207 kernel: [39888.595602] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 16:28:34 juju-e4d256-prod-github-runner-207 kernel: [39888.596624] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 16:28:34 juju-e4d256-prod-github-runner-207 kernel: [39888.597655] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 16:28:34 juju-e4d256-prod-github-runner-207 kernel: [39888.598680] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 16:28:34 juju-e4d256-prod-github-runner-207 kernel: [39888.599659] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 16:28:34 juju-e4d256-prod-github-runner-207 kernel: [39888.600665] handle_exit+0x98/0x230 [kvm_amd] Aug 22 16:28:34 juju-e4d256-prod-github-runner-207 kernel: [39888.601624] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 16:28:34 juju-e4d256-prod-github-runner-207 kernel: [39888.602559] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 16:28:34 juju-e4d256-prod-github-runner-207 kernel: [39888.603513] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 16:28:34 juju-e4d256-prod-github-runner-207 kernel: [39888.604445] vcpu_run+0x62/0x2c0 [kvm] Aug 22 16:28:34 juju-e4d256-prod-github-runner-207 kernel: [39888.605292] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 16:28:34 juju-e4d256-prod-github-runner-207 kernel: [39888.606122] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 16:28:34 juju-e4d256-prod-github-runner-207 kernel: [39888.607014] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 16:28:34 juju-e4d256-prod-github-runner-207 kernel: [39888.607839] ? __seccomp_filter+0x4a/0x4a0 Aug 22 16:28:34 juju-e4d256-prod-github-runner-207 kernel: [39888.608610] ? __fget_files+0x86/0xc0 Aug 22 16:28:34 juju-e4d256-prod-github-runner-207 kernel: [39888.609368] __x64_sys_ioctl+0x95/0xd0 Aug 22 16:28:34 juju-e4d256-prod-github-runner-207 kernel: [39888.610074] do_syscall_64+0x5c/0xc0 Aug 22 16:28:34 juju-e4d256-prod-github-runner-207 kernel: [39888.610758] ? do_futex+0x162/0x1f0 Aug 22 16:28:34 juju-e4d256-prod-github-runner-207 kernel: [39888.611431] ? __x64_sys_futex+0x78/0x1e0 Aug 22 16:28:34 juju-e4d256-prod-github-runner-207 kernel: [39888.612162] ? __secure_computing+0xa9/0x120 Aug 22 16:28:34 juju-e4d256-prod-github-runner-207 kernel: [39888.612913] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 16:28:34 juju-e4d256-prod-github-runner-207 kernel: [39888.613767] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:28:34 juju-e4d256-prod-github-runner-207 kernel: [39888.614530] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:28:34 juju-e4d256-prod-github-runner-207 kernel: [39888.615265] ? do_syscall_64+0x69/0xc0 Aug 22 16:28:34 juju-e4d256-prod-github-runner-207 kernel: [39888.615929] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:28:34 juju-e4d256-prod-github-runner-207 kernel: [39888.616652] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:28:34 juju-e4d256-prod-github-runner-207 kernel: [39888.617382] ? do_syscall_64+0x69/0xc0 Aug 22 16:28:34 juju-e4d256-prod-github-runner-207 kernel: [39888.618031] ? do_syscall_64+0x69/0xc0 Aug 22 16:28:34 juju-e4d256-prod-github-runner-207 kernel: [39888.618677] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 16:28:34 juju-e4d256-prod-github-runner-207 kernel: [39888.619399] RIP: 0033:0x7faa5d0edaff Aug 22 16:28:34 juju-e4d256-prod-github-runner-207 kernel: [39888.620085] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 16:28:34 juju-e4d256-prod-github-runner-207 kernel: [39888.622169] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 16:28:34 juju-e4d256-prod-github-runner-207 kernel: [39888.623105] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 16:28:34 juju-e4d256-prod-github-runner-207 kernel: [39888.624020] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 16:28:34 juju-e4d256-prod-github-runner-207 kernel: [39888.624928] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 16:28:34 juju-e4d256-prod-github-runner-207 kernel: [39888.625864] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 16:28:34 juju-e4d256-prod-github-runner-207 kernel: [39888.626790] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 16:28:34 juju-e4d256-prod-github-runner-207 kernel: [39888.627718] Aug 22 16:29:02 juju-e4d256-prod-github-runner-207 kernel: [39916.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 37067s! [qemu-system-x86:6715] Aug 22 16:29:02 juju-e4d256-prod-github-runner-207 kernel: [39916.543863] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 16:29:02 juju-e4d256-prod-github-runner-207 kernel: [39916.544171] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 16:29:02 juju-e4d256-prod-github-runner-207 kernel: [39916.556421] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 16:29:02 juju-e4d256-prod-github-runner-207 kernel: [39916.557721] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 16:29:02 juju-e4d256-prod-github-runner-207 kernel: [39916.558943] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:29:02 juju-e4d256-prod-github-runner-207 kernel: [39916.560071] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 16:29:02 juju-e4d256-prod-github-runner-207 kernel: [39916.562995] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 16:29:02 juju-e4d256-prod-github-runner-207 kernel: [39916.564066] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 16:29:02 juju-e4d256-prod-github-runner-207 kernel: [39916.565265] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 16:29:02 juju-e4d256-prod-github-runner-207 kernel: [39916.566439] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 16:29:02 juju-e4d256-prod-github-runner-207 kernel: [39916.567625] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 16:29:02 juju-e4d256-prod-github-runner-207 kernel: [39916.569052] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 16:29:02 juju-e4d256-prod-github-runner-207 kernel: [39916.570603] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 16:29:02 juju-e4d256-prod-github-runner-207 kernel: [39916.572081] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 16:29:02 juju-e4d256-prod-github-runner-207 kernel: [39916.573215] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 16:29:02 juju-e4d256-prod-github-runner-207 kernel: [39916.574425] Call Trace: Aug 22 16:29:02 juju-e4d256-prod-github-runner-207 kernel: [39916.575351] Aug 22 16:29:02 juju-e4d256-prod-github-runner-207 kernel: [39916.576265] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:29:02 juju-e4d256-prod-github-runner-207 kernel: [39916.577471] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:29:02 juju-e4d256-prod-github-runner-207 kernel: [39916.578515] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:29:02 juju-e4d256-prod-github-runner-207 kernel: [39916.579701] ? show_regs.part.0+0x23/0x29 Aug 22 16:29:02 juju-e4d256-prod-github-runner-207 kernel: [39916.580784] ? show_regs.cold+0x8/0xd Aug 22 16:29:02 juju-e4d256-prod-github-runner-207 kernel: [39916.581823] ? watchdog_timer_fn+0x1be/0x220 Aug 22 16:29:02 juju-e4d256-prod-github-runner-207 kernel: [39916.582855] ? lockup_detector_update_enable+0x60/0x60 Aug 22 16:29:02 juju-e4d256-prod-github-runner-207 kernel: [39916.583932] ? __hrtimer_run_queues+0x107/0x230 Aug 22 16:29:02 juju-e4d256-prod-github-runner-207 kernel: [39916.585016] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 16:29:02 juju-e4d256-prod-github-runner-207 kernel: [39916.586085] ? hrtimer_interrupt+0x101/0x220 Aug 22 16:29:02 juju-e4d256-prod-github-runner-207 kernel: [39916.587108] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 16:29:02 juju-e4d256-prod-github-runner-207 kernel: [39916.588201] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 16:29:02 juju-e4d256-prod-github-runner-207 kernel: [39916.589264] Aug 22 16:29:02 juju-e4d256-prod-github-runner-207 kernel: [39916.590140] Aug 22 16:29:02 juju-e4d256-prod-github-runner-207 kernel: [39916.590987] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 16:29:02 juju-e4d256-prod-github-runner-207 kernel: [39916.592035] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:29:02 juju-e4d256-prod-github-runner-207 kernel: [39916.593129] ? _raw_spin_lock+0x22/0x30 Aug 22 16:29:02 juju-e4d256-prod-github-runner-207 kernel: [39916.594117] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:29:02 juju-e4d256-prod-github-runner-207 kernel: [39916.595140] direct_page_fault+0x206/0x310 [kvm] Aug 22 16:29:02 juju-e4d256-prod-github-runner-207 kernel: [39916.596264] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 16:29:02 juju-e4d256-prod-github-runner-207 kernel: [39916.597303] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 16:29:02 juju-e4d256-prod-github-runner-207 kernel: [39916.598367] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 16:29:02 juju-e4d256-prod-github-runner-207 kernel: [39916.599402] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 16:29:02 juju-e4d256-prod-github-runner-207 kernel: [39916.600357] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 16:29:02 juju-e4d256-prod-github-runner-207 kernel: [39916.601425] handle_exit+0x98/0x230 [kvm_amd] Aug 22 16:29:02 juju-e4d256-prod-github-runner-207 kernel: [39916.602336] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 16:29:02 juju-e4d256-prod-github-runner-207 kernel: [39916.603260] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 16:29:02 juju-e4d256-prod-github-runner-207 kernel: [39916.604206] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 16:29:02 juju-e4d256-prod-github-runner-207 kernel: [39916.605137] vcpu_run+0x62/0x2c0 [kvm] Aug 22 16:29:02 juju-e4d256-prod-github-runner-207 kernel: [39916.605956] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 16:29:02 juju-e4d256-prod-github-runner-207 kernel: [39916.606771] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 16:29:02 juju-e4d256-prod-github-runner-207 kernel: [39916.607640] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 16:29:02 juju-e4d256-prod-github-runner-207 kernel: [39916.608458] ? __seccomp_filter+0x4a/0x4a0 Aug 22 16:29:02 juju-e4d256-prod-github-runner-207 kernel: [39916.609261] ? __fget_files+0x86/0xc0 Aug 22 16:29:02 juju-e4d256-prod-github-runner-207 kernel: [39916.609998] __x64_sys_ioctl+0x95/0xd0 Aug 22 16:29:02 juju-e4d256-prod-github-runner-207 kernel: [39916.610698] do_syscall_64+0x5c/0xc0 Aug 22 16:29:02 juju-e4d256-prod-github-runner-207 kernel: [39916.611376] ? do_futex+0x162/0x1f0 Aug 22 16:29:02 juju-e4d256-prod-github-runner-207 kernel: [39916.612034] ? __x64_sys_futex+0x78/0x1e0 Aug 22 16:29:02 juju-e4d256-prod-github-runner-207 kernel: [39916.612714] ? __secure_computing+0xa9/0x120 Aug 22 16:29:02 juju-e4d256-prod-github-runner-207 kernel: [39916.613478] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 16:29:02 juju-e4d256-prod-github-runner-207 kernel: [39916.614247] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:29:02 juju-e4d256-prod-github-runner-207 kernel: [39916.614975] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:29:02 juju-e4d256-prod-github-runner-207 kernel: [39916.615707] ? do_syscall_64+0x69/0xc0 Aug 22 16:29:02 juju-e4d256-prod-github-runner-207 kernel: [39916.616358] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:29:02 juju-e4d256-prod-github-runner-207 kernel: [39916.617119] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:29:02 juju-e4d256-prod-github-runner-207 kernel: [39916.617861] ? do_syscall_64+0x69/0xc0 Aug 22 16:29:02 juju-e4d256-prod-github-runner-207 kernel: [39916.618504] ? do_syscall_64+0x69/0xc0 Aug 22 16:29:02 juju-e4d256-prod-github-runner-207 kernel: [39916.619133] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 16:29:02 juju-e4d256-prod-github-runner-207 kernel: [39916.619853] RIP: 0033:0x7faa5d0edaff Aug 22 16:29:02 juju-e4d256-prod-github-runner-207 kernel: [39916.620528] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 16:29:02 juju-e4d256-prod-github-runner-207 kernel: [39916.622558] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 16:29:02 juju-e4d256-prod-github-runner-207 kernel: [39916.623485] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 16:29:02 juju-e4d256-prod-github-runner-207 kernel: [39916.624385] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 16:29:02 juju-e4d256-prod-github-runner-207 kernel: [39916.625393] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 16:29:02 juju-e4d256-prod-github-runner-207 kernel: [39916.626292] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 16:29:02 juju-e4d256-prod-github-runner-207 kernel: [39916.627184] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 16:29:02 juju-e4d256-prod-github-runner-207 kernel: [39916.628098] Aug 22 16:29:30 juju-e4d256-prod-github-runner-207 kernel: [39944.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 37093s! [qemu-system-x86:6715] Aug 22 16:29:30 juju-e4d256-prod-github-runner-207 kernel: [39944.543152] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 16:29:30 juju-e4d256-prod-github-runner-207 kernel: [39944.543228] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 16:29:30 juju-e4d256-prod-github-runner-207 kernel: [39944.555558] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 16:29:30 juju-e4d256-prod-github-runner-207 kernel: [39944.556949] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 16:29:30 juju-e4d256-prod-github-runner-207 kernel: [39944.558235] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:29:30 juju-e4d256-prod-github-runner-207 kernel: [39944.559333] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 16:29:30 juju-e4d256-prod-github-runner-207 kernel: [39944.562079] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 16:29:30 juju-e4d256-prod-github-runner-207 kernel: [39944.563155] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 16:29:30 juju-e4d256-prod-github-runner-207 kernel: [39944.564375] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 16:29:30 juju-e4d256-prod-github-runner-207 kernel: [39944.565798] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 16:29:30 juju-e4d256-prod-github-runner-207 kernel: [39944.567046] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 16:29:30 juju-e4d256-prod-github-runner-207 kernel: [39944.568253] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 16:29:30 juju-e4d256-prod-github-runner-207 kernel: [39944.569468] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 16:29:30 juju-e4d256-prod-github-runner-207 kernel: [39944.570704] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 16:29:30 juju-e4d256-prod-github-runner-207 kernel: [39944.571817] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 16:29:30 juju-e4d256-prod-github-runner-207 kernel: [39944.573069] Call Trace: Aug 22 16:29:30 juju-e4d256-prod-github-runner-207 kernel: [39944.573994] Aug 22 16:29:30 juju-e4d256-prod-github-runner-207 kernel: [39944.574884] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:29:30 juju-e4d256-prod-github-runner-207 kernel: [39944.575925] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:29:30 juju-e4d256-prod-github-runner-207 kernel: [39944.576981] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:29:30 juju-e4d256-prod-github-runner-207 kernel: [39944.578104] ? show_regs.part.0+0x23/0x29 Aug 22 16:29:30 juju-e4d256-prod-github-runner-207 kernel: [39944.579118] ? show_regs.cold+0x8/0xd Aug 22 16:29:30 juju-e4d256-prod-github-runner-207 kernel: [39944.580098] ? watchdog_timer_fn+0x1be/0x220 Aug 22 16:29:30 juju-e4d256-prod-github-runner-207 kernel: [39944.581133] ? lockup_detector_update_enable+0x60/0x60 Aug 22 16:29:30 juju-e4d256-prod-github-runner-207 kernel: [39944.582212] ? __hrtimer_run_queues+0x107/0x230 Aug 22 16:29:30 juju-e4d256-prod-github-runner-207 kernel: [39944.583265] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 16:29:30 juju-e4d256-prod-github-runner-207 kernel: [39944.584296] ? hrtimer_interrupt+0x101/0x220 Aug 22 16:29:30 juju-e4d256-prod-github-runner-207 kernel: [39944.585333] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 16:29:30 juju-e4d256-prod-github-runner-207 kernel: [39944.586410] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 16:29:30 juju-e4d256-prod-github-runner-207 kernel: [39944.587475] Aug 22 16:29:30 juju-e4d256-prod-github-runner-207 kernel: [39944.588373] Aug 22 16:29:30 juju-e4d256-prod-github-runner-207 kernel: [39944.589262] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 16:29:30 juju-e4d256-prod-github-runner-207 kernel: [39944.590350] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:29:30 juju-e4d256-prod-github-runner-207 kernel: [39944.591457] ? _raw_spin_lock+0x22/0x30 Aug 22 16:29:30 juju-e4d256-prod-github-runner-207 kernel: [39944.592499] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:29:30 juju-e4d256-prod-github-runner-207 kernel: [39944.593566] direct_page_fault+0x206/0x310 [kvm] Aug 22 16:29:30 juju-e4d256-prod-github-runner-207 kernel: [39944.594614] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 16:29:30 juju-e4d256-prod-github-runner-207 kernel: [39944.595714] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 16:29:30 juju-e4d256-prod-github-runner-207 kernel: [39944.596778] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 16:29:30 juju-e4d256-prod-github-runner-207 kernel: [39944.597783] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 16:29:30 juju-e4d256-prod-github-runner-207 kernel: [39944.598824] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 16:29:30 juju-e4d256-prod-github-runner-207 kernel: [39944.599821] handle_exit+0x98/0x230 [kvm_amd] Aug 22 16:29:30 juju-e4d256-prod-github-runner-207 kernel: [39944.600791] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 16:29:30 juju-e4d256-prod-github-runner-207 kernel: [39944.601725] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 16:29:30 juju-e4d256-prod-github-runner-207 kernel: [39944.602687] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 16:29:30 juju-e4d256-prod-github-runner-207 kernel: [39944.603625] vcpu_run+0x62/0x2c0 [kvm] Aug 22 16:29:30 juju-e4d256-prod-github-runner-207 kernel: [39944.604445] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 16:29:30 juju-e4d256-prod-github-runner-207 kernel: [39944.605276] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 16:29:30 juju-e4d256-prod-github-runner-207 kernel: [39944.606136] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 16:29:30 juju-e4d256-prod-github-runner-207 kernel: [39944.606939] ? __seccomp_filter+0x4a/0x4a0 Aug 22 16:29:30 juju-e4d256-prod-github-runner-207 kernel: [39944.607693] ? __fget_files+0x86/0xc0 Aug 22 16:29:30 juju-e4d256-prod-github-runner-207 kernel: [39944.608417] __x64_sys_ioctl+0x95/0xd0 Aug 22 16:29:30 juju-e4d256-prod-github-runner-207 kernel: [39944.609187] do_syscall_64+0x5c/0xc0 Aug 22 16:29:30 juju-e4d256-prod-github-runner-207 kernel: [39944.609861] ? do_futex+0x162/0x1f0 Aug 22 16:29:30 juju-e4d256-prod-github-runner-207 kernel: [39944.610514] ? __x64_sys_futex+0x78/0x1e0 Aug 22 16:29:30 juju-e4d256-prod-github-runner-207 kernel: [39944.611195] ? __secure_computing+0xa9/0x120 Aug 22 16:29:30 juju-e4d256-prod-github-runner-207 kernel: [39944.611889] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 16:29:30 juju-e4d256-prod-github-runner-207 kernel: [39944.612680] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:29:30 juju-e4d256-prod-github-runner-207 kernel: [39944.613416] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:29:30 juju-e4d256-prod-github-runner-207 kernel: [39944.614152] ? do_syscall_64+0x69/0xc0 Aug 22 16:29:30 juju-e4d256-prod-github-runner-207 kernel: [39944.614806] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:29:30 juju-e4d256-prod-github-runner-207 kernel: [39944.615511] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:29:30 juju-e4d256-prod-github-runner-207 kernel: [39944.616215] ? do_syscall_64+0x69/0xc0 Aug 22 16:29:30 juju-e4d256-prod-github-runner-207 kernel: [39944.616870] ? do_syscall_64+0x69/0xc0 Aug 22 16:29:30 juju-e4d256-prod-github-runner-207 kernel: [39944.617496] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 16:29:30 juju-e4d256-prod-github-runner-207 kernel: [39944.618223] RIP: 0033:0x7faa5d0edaff Aug 22 16:29:30 juju-e4d256-prod-github-runner-207 kernel: [39944.618868] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 16:29:30 juju-e4d256-prod-github-runner-207 kernel: [39944.620913] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 16:29:30 juju-e4d256-prod-github-runner-207 kernel: [39944.621829] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 16:29:30 juju-e4d256-prod-github-runner-207 kernel: [39944.622721] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 16:29:30 juju-e4d256-prod-github-runner-207 kernel: [39944.623622] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 16:29:30 juju-e4d256-prod-github-runner-207 kernel: [39944.624543] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 16:29:30 juju-e4d256-prod-github-runner-207 kernel: [39944.625440] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 16:29:30 juju-e4d256-prod-github-runner-207 kernel: [39944.626424] Aug 22 16:29:45 juju-e4d256-prod-github-runner-207 kernel: [39959.852715] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 16:29:45 juju-e4d256-prod-github-runner-207 kernel: [39959.854419] rcu: 1-....: (9929396 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=4801866 Aug 22 16:29:45 juju-e4d256-prod-github-runner-207 kernel: [39959.855569] (t=9960663 jiffies g=23269 q=40797) Aug 22 16:29:45 juju-e4d256-prod-github-runner-207 kernel: [39959.857274] NMI backtrace for cpu 1 Aug 22 16:29:45 juju-e4d256-prod-github-runner-207 kernel: [39959.858020] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 16:29:45 juju-e4d256-prod-github-runner-207 kernel: [39959.859155] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 16:29:45 juju-e4d256-prod-github-runner-207 kernel: [39959.860248] Call Trace: Aug 22 16:29:45 juju-e4d256-prod-github-runner-207 kernel: [39959.860944] Aug 22 16:29:45 juju-e4d256-prod-github-runner-207 kernel: [39959.861607] show_stack+0x52/0x5c Aug 22 16:29:45 juju-e4d256-prod-github-runner-207 kernel: [39959.862340] dump_stack_lvl+0x4a/0x63 Aug 22 16:29:45 juju-e4d256-prod-github-runner-207 kernel: [39959.863114] dump_stack+0x10/0x16 Aug 22 16:29:45 juju-e4d256-prod-github-runner-207 kernel: [39959.863845] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 16:29:45 juju-e4d256-prod-github-runner-207 kernel: [39959.864675] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 16:29:45 juju-e4d256-prod-github-runner-207 kernel: [39959.865479] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 16:29:45 juju-e4d256-prod-github-runner-207 kernel: [39959.866309] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 16:29:45 juju-e4d256-prod-github-runner-207 kernel: [39959.867141] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 16:29:45 juju-e4d256-prod-github-runner-207 kernel: [39959.867960] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 16:29:45 juju-e4d256-prod-github-runner-207 kernel: [39959.868779] print_cpu_stall.cold+0x2f/0xe2 Aug 22 16:29:45 juju-e4d256-prod-github-runner-207 kernel: [39959.869554] ? timekeeping_update+0xf7/0x150 Aug 22 16:29:45 juju-e4d256-prod-github-runner-207 kernel: [39959.870340] check_cpu_stall+0x109/0x270 Aug 22 16:29:45 juju-e4d256-prod-github-runner-207 kernel: [39959.871114] rcu_sched_clock_irq+0x9a/0x250 Aug 22 16:29:45 juju-e4d256-prod-github-runner-207 kernel: [39959.871888] update_process_times+0x94/0xd0 Aug 22 16:29:45 juju-e4d256-prod-github-runner-207 kernel: [39959.872754] tick_sched_handle+0x29/0x70 Aug 22 16:29:45 juju-e4d256-prod-github-runner-207 kernel: [39959.873535] tick_sched_timer+0x8c/0xc0 Aug 22 16:29:45 juju-e4d256-prod-github-runner-207 kernel: [39959.874288] ? tick_nohz_handler+0xb0/0xb0 Aug 22 16:29:45 juju-e4d256-prod-github-runner-207 kernel: [39959.875065] __hrtimer_run_queues+0x107/0x230 Aug 22 16:29:45 juju-e4d256-prod-github-runner-207 kernel: [39959.875850] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 16:29:45 juju-e4d256-prod-github-runner-207 kernel: [39959.876655] hrtimer_interrupt+0x101/0x220 Aug 22 16:29:45 juju-e4d256-prod-github-runner-207 kernel: [39959.877427] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 16:29:45 juju-e4d256-prod-github-runner-207 kernel: [39959.878251] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 16:29:45 juju-e4d256-prod-github-runner-207 kernel: [39959.879085] Aug 22 16:29:45 juju-e4d256-prod-github-runner-207 kernel: [39959.879735] Aug 22 16:29:45 juju-e4d256-prod-github-runner-207 kernel: [39959.880391] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 16:29:45 juju-e4d256-prod-github-runner-207 kernel: [39959.881225] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:29:45 juju-e4d256-prod-github-runner-207 kernel: [39959.882115] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 16:29:45 juju-e4d256-prod-github-runner-207 kernel: [39959.884376] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 16:29:45 juju-e4d256-prod-github-runner-207 kernel: [39959.885273] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 16:29:45 juju-e4d256-prod-github-runner-207 kernel: [39959.886306] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 16:29:45 juju-e4d256-prod-github-runner-207 kernel: [39959.887535] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 16:29:45 juju-e4d256-prod-github-runner-207 kernel: [39959.888689] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 16:29:45 juju-e4d256-prod-github-runner-207 kernel: [39959.889681] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 16:29:45 juju-e4d256-prod-github-runner-207 kernel: [39959.890646] ? _raw_spin_lock+0x22/0x30 Aug 22 16:29:45 juju-e4d256-prod-github-runner-207 kernel: [39959.891426] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:29:45 juju-e4d256-prod-github-runner-207 kernel: [39959.892316] direct_page_fault+0x206/0x310 [kvm] Aug 22 16:29:45 juju-e4d256-prod-github-runner-207 kernel: [39959.893251] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 16:29:45 juju-e4d256-prod-github-runner-207 kernel: [39959.894108] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 16:29:45 juju-e4d256-prod-github-runner-207 kernel: [39959.894982] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 16:29:45 juju-e4d256-prod-github-runner-207 kernel: [39959.895858] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 16:29:45 juju-e4d256-prod-github-runner-207 kernel: [39959.896688] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 16:29:45 juju-e4d256-prod-github-runner-207 kernel: [39959.897557] handle_exit+0x98/0x230 [kvm_amd] Aug 22 16:29:45 juju-e4d256-prod-github-runner-207 kernel: [39959.898380] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 16:29:45 juju-e4d256-prod-github-runner-207 kernel: [39959.899180] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 16:29:45 juju-e4d256-prod-github-runner-207 kernel: [39959.900001] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 16:29:45 juju-e4d256-prod-github-runner-207 kernel: [39959.900816] vcpu_run+0x62/0x2c0 [kvm] Aug 22 16:29:45 juju-e4d256-prod-github-runner-207 kernel: [39959.901643] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 16:29:45 juju-e4d256-prod-github-runner-207 kernel: [39959.902505] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 16:29:45 juju-e4d256-prod-github-runner-207 kernel: [39959.903411] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 16:29:45 juju-e4d256-prod-github-runner-207 kernel: [39959.904259] ? __seccomp_filter+0x4a/0x4a0 Aug 22 16:29:45 juju-e4d256-prod-github-runner-207 kernel: [39959.905086] ? __fget_files+0x86/0xc0 Aug 22 16:29:45 juju-e4d256-prod-github-runner-207 kernel: [39959.905864] __x64_sys_ioctl+0x95/0xd0 Aug 22 16:29:45 juju-e4d256-prod-github-runner-207 kernel: [39959.906662] do_syscall_64+0x5c/0xc0 Aug 22 16:29:45 juju-e4d256-prod-github-runner-207 kernel: [39959.907424] ? do_futex+0x162/0x1f0 Aug 22 16:29:45 juju-e4d256-prod-github-runner-207 kernel: [39959.908186] ? __x64_sys_futex+0x78/0x1e0 Aug 22 16:29:45 juju-e4d256-prod-github-runner-207 kernel: [39959.908987] ? __secure_computing+0xa9/0x120 Aug 22 16:29:45 juju-e4d256-prod-github-runner-207 kernel: [39959.909789] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 16:29:45 juju-e4d256-prod-github-runner-207 kernel: [39959.910699] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:29:45 juju-e4d256-prod-github-runner-207 kernel: [39959.911560] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:29:45 juju-e4d256-prod-github-runner-207 kernel: [39959.912447] ? do_syscall_64+0x69/0xc0 Aug 22 16:29:45 juju-e4d256-prod-github-runner-207 kernel: [39959.913225] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:29:45 juju-e4d256-prod-github-runner-207 kernel: [39959.914078] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:29:45 juju-e4d256-prod-github-runner-207 kernel: [39959.914940] ? do_syscall_64+0x69/0xc0 Aug 22 16:29:45 juju-e4d256-prod-github-runner-207 kernel: [39959.915760] ? do_syscall_64+0x69/0xc0 Aug 22 16:29:45 juju-e4d256-prod-github-runner-207 kernel: [39959.916556] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 16:29:45 juju-e4d256-prod-github-runner-207 kernel: [39959.917442] RIP: 0033:0x7faa5d0edaff Aug 22 16:29:45 juju-e4d256-prod-github-runner-207 kernel: [39959.918259] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 16:29:45 juju-e4d256-prod-github-runner-207 kernel: [39959.920733] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 16:29:45 juju-e4d256-prod-github-runner-207 kernel: [39959.921854] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 16:29:45 juju-e4d256-prod-github-runner-207 kernel: [39959.922943] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 16:29:45 juju-e4d256-prod-github-runner-207 kernel: [39959.924038] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 16:29:45 juju-e4d256-prod-github-runner-207 kernel: [39959.925135] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 16:29:45 juju-e4d256-prod-github-runner-207 kernel: [39959.926200] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 16:29:45 juju-e4d256-prod-github-runner-207 kernel: [39959.927259] Aug 22 16:30:10 juju-e4d256-prod-github-runner-207 kernel: [39984.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 37130s! [qemu-system-x86:6715] Aug 22 16:30:10 juju-e4d256-prod-github-runner-207 kernel: [39984.543150] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 16:30:10 juju-e4d256-prod-github-runner-207 kernel: [39984.543532] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 16:30:10 juju-e4d256-prod-github-runner-207 kernel: [39984.555806] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 16:30:10 juju-e4d256-prod-github-runner-207 kernel: [39984.557110] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 16:30:10 juju-e4d256-prod-github-runner-207 kernel: [39984.558343] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:30:10 juju-e4d256-prod-github-runner-207 kernel: [39984.559412] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 16:30:10 juju-e4d256-prod-github-runner-207 kernel: [39984.561998] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 16:30:10 juju-e4d256-prod-github-runner-207 kernel: [39984.563049] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 16:30:10 juju-e4d256-prod-github-runner-207 kernel: [39984.564231] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 16:30:10 juju-e4d256-prod-github-runner-207 kernel: [39984.565406] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 16:30:10 juju-e4d256-prod-github-runner-207 kernel: [39984.566570] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 16:30:10 juju-e4d256-prod-github-runner-207 kernel: [39984.567736] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 16:30:10 juju-e4d256-prod-github-runner-207 kernel: [39984.568937] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 16:30:10 juju-e4d256-prod-github-runner-207 kernel: [39984.570194] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 16:30:10 juju-e4d256-prod-github-runner-207 kernel: [39984.571305] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 16:30:10 juju-e4d256-prod-github-runner-207 kernel: [39984.572521] Call Trace: Aug 22 16:30:10 juju-e4d256-prod-github-runner-207 kernel: [39984.573440] Aug 22 16:30:10 juju-e4d256-prod-github-runner-207 kernel: [39984.574343] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:30:10 juju-e4d256-prod-github-runner-207 kernel: [39984.575383] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:30:10 juju-e4d256-prod-github-runner-207 kernel: [39984.576426] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:30:10 juju-e4d256-prod-github-runner-207 kernel: [39984.577538] ? show_regs.part.0+0x23/0x29 Aug 22 16:30:10 juju-e4d256-prod-github-runner-207 kernel: [39984.578550] ? show_regs.cold+0x8/0xd Aug 22 16:30:10 juju-e4d256-prod-github-runner-207 kernel: [39984.579530] ? watchdog_timer_fn+0x1be/0x220 Aug 22 16:30:10 juju-e4d256-prod-github-runner-207 kernel: [39984.580555] ? lockup_detector_update_enable+0x60/0x60 Aug 22 16:30:10 juju-e4d256-prod-github-runner-207 kernel: [39984.581631] ? __hrtimer_run_queues+0x107/0x230 Aug 22 16:30:10 juju-e4d256-prod-github-runner-207 kernel: [39984.582667] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 16:30:10 juju-e4d256-prod-github-runner-207 kernel: [39984.583695] ? hrtimer_interrupt+0x101/0x220 Aug 22 16:30:10 juju-e4d256-prod-github-runner-207 kernel: [39984.584739] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 16:30:10 juju-e4d256-prod-github-runner-207 kernel: [39984.585825] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 16:30:10 juju-e4d256-prod-github-runner-207 kernel: [39984.586875] Aug 22 16:30:10 juju-e4d256-prod-github-runner-207 kernel: [39984.587735] Aug 22 16:30:10 juju-e4d256-prod-github-runner-207 kernel: [39984.588583] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 16:30:10 juju-e4d256-prod-github-runner-207 kernel: [39984.589620] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:30:10 juju-e4d256-prod-github-runner-207 kernel: [39984.590682] ? _raw_spin_lock+0x22/0x30 Aug 22 16:30:10 juju-e4d256-prod-github-runner-207 kernel: [39984.591640] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:30:10 juju-e4d256-prod-github-runner-207 kernel: [39984.592685] direct_page_fault+0x206/0x310 [kvm] Aug 22 16:30:10 juju-e4d256-prod-github-runner-207 kernel: [39984.593711] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 16:30:10 juju-e4d256-prod-github-runner-207 kernel: [39984.594741] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 16:30:10 juju-e4d256-prod-github-runner-207 kernel: [39984.595759] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 16:30:10 juju-e4d256-prod-github-runner-207 kernel: [39984.596750] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 16:30:10 juju-e4d256-prod-github-runner-207 kernel: [39984.597698] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 16:30:10 juju-e4d256-prod-github-runner-207 kernel: [39984.598679] handle_exit+0x98/0x230 [kvm_amd] Aug 22 16:30:10 juju-e4d256-prod-github-runner-207 kernel: [39984.599573] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 16:30:10 juju-e4d256-prod-github-runner-207 kernel: [39984.600512] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 16:30:10 juju-e4d256-prod-github-runner-207 kernel: [39984.601451] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 16:30:10 juju-e4d256-prod-github-runner-207 kernel: [39984.602363] vcpu_run+0x62/0x2c0 [kvm] Aug 22 16:30:10 juju-e4d256-prod-github-runner-207 kernel: [39984.603177] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 16:30:10 juju-e4d256-prod-github-runner-207 kernel: [39984.603988] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 16:30:10 juju-e4d256-prod-github-runner-207 kernel: [39984.604857] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 16:30:10 juju-e4d256-prod-github-runner-207 kernel: [39984.605657] ? __seccomp_filter+0x4a/0x4a0 Aug 22 16:30:10 juju-e4d256-prod-github-runner-207 kernel: [39984.606410] ? __fget_files+0x86/0xc0 Aug 22 16:30:10 juju-e4d256-prod-github-runner-207 kernel: [39984.607183] __x64_sys_ioctl+0x95/0xd0 Aug 22 16:30:10 juju-e4d256-prod-github-runner-207 kernel: [39984.607883] do_syscall_64+0x5c/0xc0 Aug 22 16:30:10 juju-e4d256-prod-github-runner-207 kernel: [39984.608559] ? do_futex+0x162/0x1f0 Aug 22 16:30:10 juju-e4d256-prod-github-runner-207 kernel: [39984.609211] ? __x64_sys_futex+0x78/0x1e0 Aug 22 16:30:10 juju-e4d256-prod-github-runner-207 kernel: [39984.609885] ? __secure_computing+0xa9/0x120 Aug 22 16:30:10 juju-e4d256-prod-github-runner-207 kernel: [39984.610576] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 16:30:10 juju-e4d256-prod-github-runner-207 kernel: [39984.611338] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:30:10 juju-e4d256-prod-github-runner-207 kernel: [39984.612076] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:30:10 juju-e4d256-prod-github-runner-207 kernel: [39984.612801] ? do_syscall_64+0x69/0xc0 Aug 22 16:30:10 juju-e4d256-prod-github-runner-207 kernel: [39984.613447] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:30:10 juju-e4d256-prod-github-runner-207 kernel: [39984.614150] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:30:10 juju-e4d256-prod-github-runner-207 kernel: [39984.614847] ? do_syscall_64+0x69/0xc0 Aug 22 16:30:10 juju-e4d256-prod-github-runner-207 kernel: [39984.615474] ? do_syscall_64+0x69/0xc0 Aug 22 16:30:10 juju-e4d256-prod-github-runner-207 kernel: [39984.616107] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 16:30:10 juju-e4d256-prod-github-runner-207 kernel: [39984.616822] RIP: 0033:0x7faa5d0edaff Aug 22 16:30:10 juju-e4d256-prod-github-runner-207 kernel: [39984.617590] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 16:30:10 juju-e4d256-prod-github-runner-207 kernel: [39984.619616] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 16:30:10 juju-e4d256-prod-github-runner-207 kernel: [39984.620738] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 16:30:10 juju-e4d256-prod-github-runner-207 kernel: [39984.621637] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 16:30:10 juju-e4d256-prod-github-runner-207 kernel: [39984.622535] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 16:30:10 juju-e4d256-prod-github-runner-207 kernel: [39984.623426] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 16:30:10 juju-e4d256-prod-github-runner-207 kernel: [39984.624338] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 16:30:10 juju-e4d256-prod-github-runner-207 kernel: [39984.625255] Aug 22 16:30:38 juju-e4d256-prod-github-runner-207 kernel: [40012.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 37156s! [qemu-system-x86:6715] Aug 22 16:30:38 juju-e4d256-prod-github-runner-207 kernel: [40012.543875] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 16:30:38 juju-e4d256-prod-github-runner-207 kernel: [40012.544175] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 16:30:38 juju-e4d256-prod-github-runner-207 kernel: [40012.556317] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 16:30:38 juju-e4d256-prod-github-runner-207 kernel: [40012.557600] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 16:30:38 juju-e4d256-prod-github-runner-207 kernel: [40012.558820] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:30:38 juju-e4d256-prod-github-runner-207 kernel: [40012.559887] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 16:30:38 juju-e4d256-prod-github-runner-207 kernel: [40012.562446] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 16:30:38 juju-e4d256-prod-github-runner-207 kernel: [40012.563493] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 16:30:38 juju-e4d256-prod-github-runner-207 kernel: [40012.564687] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 16:30:38 juju-e4d256-prod-github-runner-207 kernel: [40012.565857] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 16:30:38 juju-e4d256-prod-github-runner-207 kernel: [40012.567019] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 16:30:38 juju-e4d256-prod-github-runner-207 kernel: [40012.568198] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 16:30:38 juju-e4d256-prod-github-runner-207 kernel: [40012.569367] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 16:30:38 juju-e4d256-prod-github-runner-207 kernel: [40012.570612] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 16:30:38 juju-e4d256-prod-github-runner-207 kernel: [40012.571733] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 16:30:38 juju-e4d256-prod-github-runner-207 kernel: [40012.572937] Call Trace: Aug 22 16:30:38 juju-e4d256-prod-github-runner-207 kernel: [40012.573859] Aug 22 16:30:38 juju-e4d256-prod-github-runner-207 kernel: [40012.574769] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:30:38 juju-e4d256-prod-github-runner-207 kernel: [40012.575815] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:30:38 juju-e4d256-prod-github-runner-207 kernel: [40012.576844] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:30:38 juju-e4d256-prod-github-runner-207 kernel: [40012.577947] ? show_regs.part.0+0x23/0x29 Aug 22 16:30:38 juju-e4d256-prod-github-runner-207 kernel: [40012.578951] ? show_regs.cold+0x8/0xd Aug 22 16:30:38 juju-e4d256-prod-github-runner-207 kernel: [40012.579935] ? watchdog_timer_fn+0x1be/0x220 Aug 22 16:30:38 juju-e4d256-prod-github-runner-207 kernel: [40012.580953] ? lockup_detector_update_enable+0x60/0x60 Aug 22 16:30:38 juju-e4d256-prod-github-runner-207 kernel: [40012.582018] ? __hrtimer_run_queues+0x107/0x230 Aug 22 16:30:38 juju-e4d256-prod-github-runner-207 kernel: [40012.583053] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 16:30:38 juju-e4d256-prod-github-runner-207 kernel: [40012.584089] ? hrtimer_interrupt+0x101/0x220 Aug 22 16:30:38 juju-e4d256-prod-github-runner-207 kernel: [40012.585106] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 16:30:38 juju-e4d256-prod-github-runner-207 kernel: [40012.586222] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 16:30:38 juju-e4d256-prod-github-runner-207 kernel: [40012.587485] Aug 22 16:30:38 juju-e4d256-prod-github-runner-207 kernel: [40012.588457] Aug 22 16:30:38 juju-e4d256-prod-github-runner-207 kernel: [40012.589311] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 16:30:38 juju-e4d256-prod-github-runner-207 kernel: [40012.590357] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:30:38 juju-e4d256-prod-github-runner-207 kernel: [40012.591414] ? _raw_spin_lock+0x22/0x30 Aug 22 16:30:38 juju-e4d256-prod-github-runner-207 kernel: [40012.592387] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:30:38 juju-e4d256-prod-github-runner-207 kernel: [40012.593431] direct_page_fault+0x206/0x310 [kvm] Aug 22 16:30:38 juju-e4d256-prod-github-runner-207 kernel: [40012.594500] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 16:30:38 juju-e4d256-prod-github-runner-207 kernel: [40012.595529] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 16:30:38 juju-e4d256-prod-github-runner-207 kernel: [40012.596594] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 16:30:38 juju-e4d256-prod-github-runner-207 kernel: [40012.597628] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 16:30:38 juju-e4d256-prod-github-runner-207 kernel: [40012.598577] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 16:30:38 juju-e4d256-prod-github-runner-207 kernel: [40012.599556] handle_exit+0x98/0x230 [kvm_amd] Aug 22 16:30:38 juju-e4d256-prod-github-runner-207 kernel: [40012.600482] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 16:30:38 juju-e4d256-prod-github-runner-207 kernel: [40012.601515] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 16:30:38 juju-e4d256-prod-github-runner-207 kernel: [40012.602463] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 16:30:38 juju-e4d256-prod-github-runner-207 kernel: [40012.603374] vcpu_run+0x62/0x2c0 [kvm] Aug 22 16:30:38 juju-e4d256-prod-github-runner-207 kernel: [40012.604221] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 16:30:38 juju-e4d256-prod-github-runner-207 kernel: [40012.605057] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 16:30:38 juju-e4d256-prod-github-runner-207 kernel: [40012.605932] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 16:30:38 juju-e4d256-prod-github-runner-207 kernel: [40012.606780] ? __seccomp_filter+0x4a/0x4a0 Aug 22 16:30:38 juju-e4d256-prod-github-runner-207 kernel: [40012.607547] ? __fget_files+0x86/0xc0 Aug 22 16:30:38 juju-e4d256-prod-github-runner-207 kernel: [40012.608313] __x64_sys_ioctl+0x95/0xd0 Aug 22 16:30:38 juju-e4d256-prod-github-runner-207 kernel: [40012.609026] do_syscall_64+0x5c/0xc0 Aug 22 16:30:38 juju-e4d256-prod-github-runner-207 kernel: [40012.609697] ? do_futex+0x162/0x1f0 Aug 22 16:30:38 juju-e4d256-prod-github-runner-207 kernel: [40012.610363] ? __x64_sys_futex+0x78/0x1e0 Aug 22 16:30:38 juju-e4d256-prod-github-runner-207 kernel: [40012.611048] ? __secure_computing+0xa9/0x120 Aug 22 16:30:38 juju-e4d256-prod-github-runner-207 kernel: [40012.611775] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 16:30:38 juju-e4d256-prod-github-runner-207 kernel: [40012.612543] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:30:38 juju-e4d256-prod-github-runner-207 kernel: [40012.613289] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:30:38 juju-e4d256-prod-github-runner-207 kernel: [40012.614013] ? do_syscall_64+0x69/0xc0 Aug 22 16:30:38 juju-e4d256-prod-github-runner-207 kernel: [40012.614662] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:30:38 juju-e4d256-prod-github-runner-207 kernel: [40012.615381] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:30:38 juju-e4d256-prod-github-runner-207 kernel: [40012.616116] ? do_syscall_64+0x69/0xc0 Aug 22 16:30:38 juju-e4d256-prod-github-runner-207 kernel: [40012.616763] ? do_syscall_64+0x69/0xc0 Aug 22 16:30:38 juju-e4d256-prod-github-runner-207 kernel: [40012.617395] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 16:30:38 juju-e4d256-prod-github-runner-207 kernel: [40012.618111] RIP: 0033:0x7faa5d0edaff Aug 22 16:30:38 juju-e4d256-prod-github-runner-207 kernel: [40012.618865] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 16:30:38 juju-e4d256-prod-github-runner-207 kernel: [40012.620905] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 16:30:38 juju-e4d256-prod-github-runner-207 kernel: [40012.621852] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 16:30:38 juju-e4d256-prod-github-runner-207 kernel: [40012.622756] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 16:30:38 juju-e4d256-prod-github-runner-207 kernel: [40012.623652] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 16:30:38 juju-e4d256-prod-github-runner-207 kernel: [40012.624565] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 16:30:38 juju-e4d256-prod-github-runner-207 kernel: [40012.625460] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 16:30:38 juju-e4d256-prod-github-runner-207 kernel: [40012.626368] Aug 22 16:31:06 juju-e4d256-prod-github-runner-207 kernel: [40040.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 37182s! [qemu-system-x86:6715] Aug 22 16:31:06 juju-e4d256-prod-github-runner-207 kernel: [40040.543105] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 16:31:06 juju-e4d256-prod-github-runner-207 kernel: [40040.543180] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 16:31:06 juju-e4d256-prod-github-runner-207 kernel: [40040.555393] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 16:31:06 juju-e4d256-prod-github-runner-207 kernel: [40040.556987] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 16:31:06 juju-e4d256-prod-github-runner-207 kernel: [40040.558240] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:31:06 juju-e4d256-prod-github-runner-207 kernel: [40040.559384] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 16:31:06 juju-e4d256-prod-github-runner-207 kernel: [40040.561986] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 16:31:06 juju-e4d256-prod-github-runner-207 kernel: [40040.563040] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 16:31:06 juju-e4d256-prod-github-runner-207 kernel: [40040.564246] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 16:31:06 juju-e4d256-prod-github-runner-207 kernel: [40040.565443] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 16:31:06 juju-e4d256-prod-github-runner-207 kernel: [40040.566645] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 16:31:06 juju-e4d256-prod-github-runner-207 kernel: [40040.567855] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 16:31:06 juju-e4d256-prod-github-runner-207 kernel: [40040.569036] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 16:31:06 juju-e4d256-prod-github-runner-207 kernel: [40040.570297] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 16:31:06 juju-e4d256-prod-github-runner-207 kernel: [40040.571457] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 16:31:06 juju-e4d256-prod-github-runner-207 kernel: [40040.572746] Call Trace: Aug 22 16:31:06 juju-e4d256-prod-github-runner-207 kernel: [40040.573665] Aug 22 16:31:06 juju-e4d256-prod-github-runner-207 kernel: [40040.574550] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:31:06 juju-e4d256-prod-github-runner-207 kernel: [40040.575605] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:31:06 juju-e4d256-prod-github-runner-207 kernel: [40040.576645] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:31:06 juju-e4d256-prod-github-runner-207 kernel: [40040.577778] ? show_regs.part.0+0x23/0x29 Aug 22 16:31:06 juju-e4d256-prod-github-runner-207 kernel: [40040.578901] ? show_regs.cold+0x8/0xd Aug 22 16:31:06 juju-e4d256-prod-github-runner-207 kernel: [40040.580091] ? watchdog_timer_fn+0x1be/0x220 Aug 22 16:31:06 juju-e4d256-prod-github-runner-207 kernel: [40040.581325] ? lockup_detector_update_enable+0x60/0x60 Aug 22 16:31:06 juju-e4d256-prod-github-runner-207 kernel: [40040.582607] ? __hrtimer_run_queues+0x107/0x230 Aug 22 16:31:06 juju-e4d256-prod-github-runner-207 kernel: [40040.583760] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 16:31:06 juju-e4d256-prod-github-runner-207 kernel: [40040.584884] ? hrtimer_interrupt+0x101/0x220 Aug 22 16:31:06 juju-e4d256-prod-github-runner-207 kernel: [40040.586013] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 16:31:06 juju-e4d256-prod-github-runner-207 kernel: [40040.587184] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 16:31:06 juju-e4d256-prod-github-runner-207 kernel: [40040.588355] Aug 22 16:31:06 juju-e4d256-prod-github-runner-207 kernel: [40040.589446] Aug 22 16:31:06 juju-e4d256-prod-github-runner-207 kernel: [40040.590461] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 16:31:06 juju-e4d256-prod-github-runner-207 kernel: [40040.591726] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:31:06 juju-e4d256-prod-github-runner-207 kernel: [40040.593068] ? _raw_spin_lock+0x22/0x30 Aug 22 16:31:06 juju-e4d256-prod-github-runner-207 kernel: [40040.594213] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:31:06 juju-e4d256-prod-github-runner-207 kernel: [40040.595539] direct_page_fault+0x206/0x310 [kvm] Aug 22 16:31:06 juju-e4d256-prod-github-runner-207 kernel: [40040.596849] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 16:31:06 juju-e4d256-prod-github-runner-207 kernel: [40040.598191] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 16:31:06 juju-e4d256-prod-github-runner-207 kernel: [40040.599532] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 16:31:06 juju-e4d256-prod-github-runner-207 kernel: [40040.600600] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 16:31:06 juju-e4d256-prod-github-runner-207 kernel: [40040.601645] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 16:31:06 juju-e4d256-prod-github-runner-207 kernel: [40040.602730] handle_exit+0x98/0x230 [kvm_amd] Aug 22 16:31:06 juju-e4d256-prod-github-runner-207 kernel: [40040.603730] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 16:31:06 juju-e4d256-prod-github-runner-207 kernel: [40040.604851] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 16:31:06 juju-e4d256-prod-github-runner-207 kernel: [40040.605950] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 16:31:06 juju-e4d256-prod-github-runner-207 kernel: [40040.606988] vcpu_run+0x62/0x2c0 [kvm] Aug 22 16:31:06 juju-e4d256-prod-github-runner-207 kernel: [40040.607910] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 16:31:06 juju-e4d256-prod-github-runner-207 kernel: [40040.608903] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 16:31:06 juju-e4d256-prod-github-runner-207 kernel: [40040.609855] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 16:31:06 juju-e4d256-prod-github-runner-207 kernel: [40040.610738] ? __seccomp_filter+0x4a/0x4a0 Aug 22 16:31:06 juju-e4d256-prod-github-runner-207 kernel: [40040.611581] ? __fget_files+0x86/0xc0 Aug 22 16:31:06 juju-e4d256-prod-github-runner-207 kernel: [40040.612359] __x64_sys_ioctl+0x95/0xd0 Aug 22 16:31:06 juju-e4d256-prod-github-runner-207 kernel: [40040.613131] do_syscall_64+0x5c/0xc0 Aug 22 16:31:06 juju-e4d256-prod-github-runner-207 kernel: [40040.613881] ? do_futex+0x162/0x1f0 Aug 22 16:31:06 juju-e4d256-prod-github-runner-207 kernel: [40040.614631] ? __x64_sys_futex+0x78/0x1e0 Aug 22 16:31:06 juju-e4d256-prod-github-runner-207 kernel: [40040.615411] ? __secure_computing+0xa9/0x120 Aug 22 16:31:06 juju-e4d256-prod-github-runner-207 kernel: [40040.616215] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 16:31:06 juju-e4d256-prod-github-runner-207 kernel: [40040.617106] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:31:06 juju-e4d256-prod-github-runner-207 kernel: [40040.618024] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:31:06 juju-e4d256-prod-github-runner-207 kernel: [40040.618847] ? do_syscall_64+0x69/0xc0 Aug 22 16:31:06 juju-e4d256-prod-github-runner-207 kernel: [40040.619636] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:31:06 juju-e4d256-prod-github-runner-207 kernel: [40040.620436] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:31:06 juju-e4d256-prod-github-runner-207 kernel: [40040.621307] ? do_syscall_64+0x69/0xc0 Aug 22 16:31:06 juju-e4d256-prod-github-runner-207 kernel: [40040.622008] ? do_syscall_64+0x69/0xc0 Aug 22 16:31:06 juju-e4d256-prod-github-runner-207 kernel: [40040.622709] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 16:31:06 juju-e4d256-prod-github-runner-207 kernel: [40040.623534] RIP: 0033:0x7faa5d0edaff Aug 22 16:31:06 juju-e4d256-prod-github-runner-207 kernel: [40040.624250] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 16:31:06 juju-e4d256-prod-github-runner-207 kernel: [40040.626622] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 16:31:06 juju-e4d256-prod-github-runner-207 kernel: [40040.627696] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 16:31:06 juju-e4d256-prod-github-runner-207 kernel: [40040.628724] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 16:31:06 juju-e4d256-prod-github-runner-207 kernel: [40040.629758] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 16:31:06 juju-e4d256-prod-github-runner-207 kernel: [40040.630848] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 16:31:06 juju-e4d256-prod-github-runner-207 kernel: [40040.631880] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 16:31:06 juju-e4d256-prod-github-runner-207 kernel: [40040.632922] Aug 22 16:31:34 juju-e4d256-prod-github-runner-207 kernel: [40068.541976] watchdog: BUG: soft lockup - CPU#1 stuck for 37208s! [qemu-system-x86:6715] Aug 22 16:31:34 juju-e4d256-prod-github-runner-207 kernel: [40068.543225] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 16:31:34 juju-e4d256-prod-github-runner-207 kernel: [40068.543426] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 16:31:34 juju-e4d256-prod-github-runner-207 kernel: [40068.555525] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 16:31:34 juju-e4d256-prod-github-runner-207 kernel: [40068.556790] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 16:31:34 juju-e4d256-prod-github-runner-207 kernel: [40068.558018] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:31:34 juju-e4d256-prod-github-runner-207 kernel: [40068.559085] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 16:31:34 juju-e4d256-prod-github-runner-207 kernel: [40068.561623] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 16:31:34 juju-e4d256-prod-github-runner-207 kernel: [40068.562667] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 16:31:34 juju-e4d256-prod-github-runner-207 kernel: [40068.563831] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 16:31:34 juju-e4d256-prod-github-runner-207 kernel: [40068.565094] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 16:31:34 juju-e4d256-prod-github-runner-207 kernel: [40068.566271] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 16:31:34 juju-e4d256-prod-github-runner-207 kernel: [40068.567461] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 16:31:34 juju-e4d256-prod-github-runner-207 kernel: [40068.568803] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 16:31:34 juju-e4d256-prod-github-runner-207 kernel: [40068.570050] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 16:31:34 juju-e4d256-prod-github-runner-207 kernel: [40068.571174] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 16:31:34 juju-e4d256-prod-github-runner-207 kernel: [40068.572371] Call Trace: Aug 22 16:31:34 juju-e4d256-prod-github-runner-207 kernel: [40068.573283] Aug 22 16:31:34 juju-e4d256-prod-github-runner-207 kernel: [40068.574167] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:31:34 juju-e4d256-prod-github-runner-207 kernel: [40068.575216] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:31:34 juju-e4d256-prod-github-runner-207 kernel: [40068.576237] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:31:34 juju-e4d256-prod-github-runner-207 kernel: [40068.577359] ? show_regs.part.0+0x23/0x29 Aug 22 16:31:34 juju-e4d256-prod-github-runner-207 kernel: [40068.578362] ? show_regs.cold+0x8/0xd Aug 22 16:31:34 juju-e4d256-prod-github-runner-207 kernel: [40068.579556] ? watchdog_timer_fn+0x1be/0x220 Aug 22 16:31:34 juju-e4d256-prod-github-runner-207 kernel: [40068.580666] ? lockup_detector_update_enable+0x60/0x60 Aug 22 16:31:34 juju-e4d256-prod-github-runner-207 kernel: [40068.581847] ? __hrtimer_run_queues+0x107/0x230 Aug 22 16:31:34 juju-e4d256-prod-github-runner-207 kernel: [40068.582992] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 16:31:34 juju-e4d256-prod-github-runner-207 kernel: [40068.584125] ? hrtimer_interrupt+0x101/0x220 Aug 22 16:31:34 juju-e4d256-prod-github-runner-207 kernel: [40068.585300] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 16:31:34 juju-e4d256-prod-github-runner-207 kernel: [40068.586483] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 16:31:34 juju-e4d256-prod-github-runner-207 kernel: [40068.587646] Aug 22 16:31:34 juju-e4d256-prod-github-runner-207 kernel: [40068.588547] Aug 22 16:31:34 juju-e4d256-prod-github-runner-207 kernel: [40068.589430] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 16:31:34 juju-e4d256-prod-github-runner-207 kernel: [40068.590589] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:31:34 juju-e4d256-prod-github-runner-207 kernel: [40068.591789] ? _raw_spin_lock+0x22/0x30 Aug 22 16:31:34 juju-e4d256-prod-github-runner-207 kernel: [40068.592829] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:31:34 juju-e4d256-prod-github-runner-207 kernel: [40068.593935] direct_page_fault+0x206/0x310 [kvm] Aug 22 16:31:34 juju-e4d256-prod-github-runner-207 kernel: [40068.595090] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 16:31:34 juju-e4d256-prod-github-runner-207 kernel: [40068.596186] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 16:31:34 juju-e4d256-prod-github-runner-207 kernel: [40068.597277] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 16:31:34 juju-e4d256-prod-github-runner-207 kernel: [40068.598364] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 16:31:34 juju-e4d256-prod-github-runner-207 kernel: [40068.599411] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 16:31:34 juju-e4d256-prod-github-runner-207 kernel: [40068.600505] handle_exit+0x98/0x230 [kvm_amd] Aug 22 16:31:34 juju-e4d256-prod-github-runner-207 kernel: [40068.601488] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 16:31:34 juju-e4d256-prod-github-runner-207 kernel: [40068.602496] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 16:31:34 juju-e4d256-prod-github-runner-207 kernel: [40068.603556] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 16:31:34 juju-e4d256-prod-github-runner-207 kernel: [40068.604563] vcpu_run+0x62/0x2c0 [kvm] Aug 22 16:31:34 juju-e4d256-prod-github-runner-207 kernel: [40068.605453] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 16:31:34 juju-e4d256-prod-github-runner-207 kernel: [40068.606353] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 16:31:34 juju-e4d256-prod-github-runner-207 kernel: [40068.607318] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 16:31:34 juju-e4d256-prod-github-runner-207 kernel: [40068.608210] ? __seccomp_filter+0x4a/0x4a0 Aug 22 16:31:34 juju-e4d256-prod-github-runner-207 kernel: [40068.609039] ? __fget_files+0x86/0xc0 Aug 22 16:31:34 juju-e4d256-prod-github-runner-207 kernel: [40068.609821] __x64_sys_ioctl+0x95/0xd0 Aug 22 16:31:34 juju-e4d256-prod-github-runner-207 kernel: [40068.610589] do_syscall_64+0x5c/0xc0 Aug 22 16:31:34 juju-e4d256-prod-github-runner-207 kernel: [40068.611344] ? do_futex+0x162/0x1f0 Aug 22 16:31:34 juju-e4d256-prod-github-runner-207 kernel: [40068.612088] ? __x64_sys_futex+0x78/0x1e0 Aug 22 16:31:34 juju-e4d256-prod-github-runner-207 kernel: [40068.612861] ? __secure_computing+0xa9/0x120 Aug 22 16:31:34 juju-e4d256-prod-github-runner-207 kernel: [40068.613644] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 16:31:34 juju-e4d256-prod-github-runner-207 kernel: [40068.614505] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:31:34 juju-e4d256-prod-github-runner-207 kernel: [40068.615338] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:31:34 juju-e4d256-prod-github-runner-207 kernel: [40068.616156] ? do_syscall_64+0x69/0xc0 Aug 22 16:31:34 juju-e4d256-prod-github-runner-207 kernel: [40068.616875] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:31:34 juju-e4d256-prod-github-runner-207 kernel: [40068.617668] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:31:34 juju-e4d256-prod-github-runner-207 kernel: [40068.618473] ? do_syscall_64+0x69/0xc0 Aug 22 16:31:34 juju-e4d256-prod-github-runner-207 kernel: [40068.619194] ? do_syscall_64+0x69/0xc0 Aug 22 16:31:34 juju-e4d256-prod-github-runner-207 kernel: [40068.619895] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 16:31:34 juju-e4d256-prod-github-runner-207 kernel: [40068.620697] RIP: 0033:0x7faa5d0edaff Aug 22 16:31:34 juju-e4d256-prod-github-runner-207 kernel: [40068.621391] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 16:31:34 juju-e4d256-prod-github-runner-207 kernel: [40068.623714] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 16:31:34 juju-e4d256-prod-github-runner-207 kernel: [40068.624765] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 16:31:34 juju-e4d256-prod-github-runner-207 kernel: [40068.625790] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 16:31:34 juju-e4d256-prod-github-runner-207 kernel: [40068.626810] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 16:31:34 juju-e4d256-prod-github-runner-207 kernel: [40068.627842] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 16:31:34 juju-e4d256-prod-github-runner-207 kernel: [40068.628864] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 16:31:34 juju-e4d256-prod-github-runner-207 kernel: [40068.629893] Aug 22 16:32:02 juju-e4d256-prod-github-runner-207 kernel: [40096.541981] watchdog: BUG: soft lockup - CPU#1 stuck for 37234s! [qemu-system-x86:6715] Aug 22 16:32:02 juju-e4d256-prod-github-runner-207 kernel: [40096.543879] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 16:32:02 juju-e4d256-prod-github-runner-207 kernel: [40096.544114] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 16:32:02 juju-e4d256-prod-github-runner-207 kernel: [40096.556803] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 16:32:02 juju-e4d256-prod-github-runner-207 kernel: [40096.558068] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 16:32:02 juju-e4d256-prod-github-runner-207 kernel: [40096.559297] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:32:02 juju-e4d256-prod-github-runner-207 kernel: [40096.560354] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 16:32:02 juju-e4d256-prod-github-runner-207 kernel: [40096.562910] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 16:32:02 juju-e4d256-prod-github-runner-207 kernel: [40096.563954] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 16:32:02 juju-e4d256-prod-github-runner-207 kernel: [40096.565117] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 16:32:02 juju-e4d256-prod-github-runner-207 kernel: [40096.566278] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 16:32:02 juju-e4d256-prod-github-runner-207 kernel: [40096.567468] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 16:32:02 juju-e4d256-prod-github-runner-207 kernel: [40096.568635] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 16:32:02 juju-e4d256-prod-github-runner-207 kernel: [40096.569801] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 16:32:02 juju-e4d256-prod-github-runner-207 kernel: [40096.571049] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 16:32:02 juju-e4d256-prod-github-runner-207 kernel: [40096.572150] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 16:32:02 juju-e4d256-prod-github-runner-207 kernel: [40096.573344] Call Trace: Aug 22 16:32:02 juju-e4d256-prod-github-runner-207 kernel: [40096.574262] Aug 22 16:32:02 juju-e4d256-prod-github-runner-207 kernel: [40096.575212] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:32:02 juju-e4d256-prod-github-runner-207 kernel: [40096.576254] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:32:02 juju-e4d256-prod-github-runner-207 kernel: [40096.577279] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:32:02 juju-e4d256-prod-github-runner-207 kernel: [40096.578358] ? show_regs.part.0+0x23/0x29 Aug 22 16:32:02 juju-e4d256-prod-github-runner-207 kernel: [40096.579367] ? show_regs.cold+0x8/0xd Aug 22 16:32:02 juju-e4d256-prod-github-runner-207 kernel: [40096.580341] ? watchdog_timer_fn+0x1be/0x220 Aug 22 16:32:02 juju-e4d256-prod-github-runner-207 kernel: [40096.581352] ? lockup_detector_update_enable+0x60/0x60 Aug 22 16:32:02 juju-e4d256-prod-github-runner-207 kernel: [40096.582415] ? __hrtimer_run_queues+0x107/0x230 Aug 22 16:32:02 juju-e4d256-prod-github-runner-207 kernel: [40096.583454] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 16:32:02 juju-e4d256-prod-github-runner-207 kernel: [40096.584482] ? hrtimer_interrupt+0x101/0x220 Aug 22 16:32:02 juju-e4d256-prod-github-runner-207 kernel: [40096.585498] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 16:32:02 juju-e4d256-prod-github-runner-207 kernel: [40096.586587] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 16:32:02 juju-e4d256-prod-github-runner-207 kernel: [40096.587657] Aug 22 16:32:02 juju-e4d256-prod-github-runner-207 kernel: [40096.588512] Aug 22 16:32:02 juju-e4d256-prod-github-runner-207 kernel: [40096.589350] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 16:32:02 juju-e4d256-prod-github-runner-207 kernel: [40096.590387] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:32:02 juju-e4d256-prod-github-runner-207 kernel: [40096.591443] ? _raw_spin_lock+0x22/0x30 Aug 22 16:32:02 juju-e4d256-prod-github-runner-207 kernel: [40096.592393] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:32:02 juju-e4d256-prod-github-runner-207 kernel: [40096.593426] direct_page_fault+0x206/0x310 [kvm] Aug 22 16:32:02 juju-e4d256-prod-github-runner-207 kernel: [40096.594452] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 16:32:02 juju-e4d256-prod-github-runner-207 kernel: [40096.595474] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 16:32:02 juju-e4d256-prod-github-runner-207 kernel: [40096.596477] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 16:32:02 juju-e4d256-prod-github-runner-207 kernel: [40096.597477] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 16:32:02 juju-e4d256-prod-github-runner-207 kernel: [40096.598424] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 16:32:02 juju-e4d256-prod-github-runner-207 kernel: [40096.599465] handle_exit+0x98/0x230 [kvm_amd] Aug 22 16:32:02 juju-e4d256-prod-github-runner-207 kernel: [40096.600407] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 16:32:02 juju-e4d256-prod-github-runner-207 kernel: [40096.601329] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 16:32:02 juju-e4d256-prod-github-runner-207 kernel: [40096.602274] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 16:32:02 juju-e4d256-prod-github-runner-207 kernel: [40096.603193] vcpu_run+0x62/0x2c0 [kvm] Aug 22 16:32:02 juju-e4d256-prod-github-runner-207 kernel: [40096.604039] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 16:32:02 juju-e4d256-prod-github-runner-207 kernel: [40096.604851] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 16:32:02 juju-e4d256-prod-github-runner-207 kernel: [40096.605708] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 16:32:02 juju-e4d256-prod-github-runner-207 kernel: [40096.606512] ? __seccomp_filter+0x4a/0x4a0 Aug 22 16:32:02 juju-e4d256-prod-github-runner-207 kernel: [40096.607279] ? __fget_files+0x86/0xc0 Aug 22 16:32:02 juju-e4d256-prod-github-runner-207 kernel: [40096.607983] __x64_sys_ioctl+0x95/0xd0 Aug 22 16:32:02 juju-e4d256-prod-github-runner-207 kernel: [40096.608684] do_syscall_64+0x5c/0xc0 Aug 22 16:32:02 juju-e4d256-prod-github-runner-207 kernel: [40096.609355] ? do_futex+0x162/0x1f0 Aug 22 16:32:02 juju-e4d256-prod-github-runner-207 kernel: [40096.610002] ? __x64_sys_futex+0x78/0x1e0 Aug 22 16:32:02 juju-e4d256-prod-github-runner-207 kernel: [40096.610698] ? __secure_computing+0xa9/0x120 Aug 22 16:32:02 juju-e4d256-prod-github-runner-207 kernel: [40096.611392] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 16:32:02 juju-e4d256-prod-github-runner-207 kernel: [40096.612182] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:32:02 juju-e4d256-prod-github-runner-207 kernel: [40096.612911] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:32:02 juju-e4d256-prod-github-runner-207 kernel: [40096.613642] ? do_syscall_64+0x69/0xc0 Aug 22 16:32:02 juju-e4d256-prod-github-runner-207 kernel: [40096.614288] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:32:02 juju-e4d256-prod-github-runner-207 kernel: [40096.615001] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:32:02 juju-e4d256-prod-github-runner-207 kernel: [40096.615703] ? do_syscall_64+0x69/0xc0 Aug 22 16:32:02 juju-e4d256-prod-github-runner-207 kernel: [40096.616333] ? do_syscall_64+0x69/0xc0 Aug 22 16:32:02 juju-e4d256-prod-github-runner-207 kernel: [40096.616956] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 16:32:02 juju-e4d256-prod-github-runner-207 kernel: [40096.617660] RIP: 0033:0x7faa5d0edaff Aug 22 16:32:02 juju-e4d256-prod-github-runner-207 kernel: [40096.618328] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 16:32:02 juju-e4d256-prod-github-runner-207 kernel: [40096.620389] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 16:32:02 juju-e4d256-prod-github-runner-207 kernel: [40096.621302] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 16:32:02 juju-e4d256-prod-github-runner-207 kernel: [40096.622191] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 16:32:02 juju-e4d256-prod-github-runner-207 kernel: [40096.623092] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 16:32:02 juju-e4d256-prod-github-runner-207 kernel: [40096.623980] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 16:32:02 juju-e4d256-prod-github-runner-207 kernel: [40096.624866] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 16:32:02 juju-e4d256-prod-github-runner-207 kernel: [40096.625763] Aug 22 16:32:30 juju-e4d256-prod-github-runner-207 kernel: [40124.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 37260s! [qemu-system-x86:6715] Aug 22 16:32:30 juju-e4d256-prod-github-runner-207 kernel: [40124.543117] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 16:32:30 juju-e4d256-prod-github-runner-207 kernel: [40124.543191] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 16:32:30 juju-e4d256-prod-github-runner-207 kernel: [40124.555266] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 16:32:30 juju-e4d256-prod-github-runner-207 kernel: [40124.556568] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 16:32:30 juju-e4d256-prod-github-runner-207 kernel: [40124.557808] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:32:30 juju-e4d256-prod-github-runner-207 kernel: [40124.558908] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 16:32:30 juju-e4d256-prod-github-runner-207 kernel: [40124.561523] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 16:32:30 juju-e4d256-prod-github-runner-207 kernel: [40124.562605] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 16:32:30 juju-e4d256-prod-github-runner-207 kernel: [40124.563782] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 16:32:30 juju-e4d256-prod-github-runner-207 kernel: [40124.564950] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 16:32:30 juju-e4d256-prod-github-runner-207 kernel: [40124.566113] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 16:32:30 juju-e4d256-prod-github-runner-207 kernel: [40124.567297] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 16:32:30 juju-e4d256-prod-github-runner-207 kernel: [40124.568465] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 16:32:30 juju-e4d256-prod-github-runner-207 kernel: [40124.569704] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 16:32:30 juju-e4d256-prod-github-runner-207 kernel: [40124.570819] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 16:32:30 juju-e4d256-prod-github-runner-207 kernel: [40124.572016] Call Trace: Aug 22 16:32:30 juju-e4d256-prod-github-runner-207 kernel: [40124.572930] Aug 22 16:32:30 juju-e4d256-prod-github-runner-207 kernel: [40124.573816] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:32:30 juju-e4d256-prod-github-runner-207 kernel: [40124.574858] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:32:30 juju-e4d256-prod-github-runner-207 kernel: [40124.575881] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:32:30 juju-e4d256-prod-github-runner-207 kernel: [40124.576958] ? show_regs.part.0+0x23/0x29 Aug 22 16:32:30 juju-e4d256-prod-github-runner-207 kernel: [40124.577958] ? show_regs.cold+0x8/0xd Aug 22 16:32:30 juju-e4d256-prod-github-runner-207 kernel: [40124.578942] ? watchdog_timer_fn+0x1be/0x220 Aug 22 16:32:30 juju-e4d256-prod-github-runner-207 kernel: [40124.579952] ? lockup_detector_update_enable+0x60/0x60 Aug 22 16:32:30 juju-e4d256-prod-github-runner-207 kernel: [40124.581014] ? __hrtimer_run_queues+0x107/0x230 Aug 22 16:32:30 juju-e4d256-prod-github-runner-207 kernel: [40124.582049] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 16:32:30 juju-e4d256-prod-github-runner-207 kernel: [40124.583083] ? hrtimer_interrupt+0x101/0x220 Aug 22 16:32:30 juju-e4d256-prod-github-runner-207 kernel: [40124.584109] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 16:32:30 juju-e4d256-prod-github-runner-207 kernel: [40124.585184] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 16:32:30 juju-e4d256-prod-github-runner-207 kernel: [40124.586233] Aug 22 16:32:30 juju-e4d256-prod-github-runner-207 kernel: [40124.587098] Aug 22 16:32:30 juju-e4d256-prod-github-runner-207 kernel: [40124.587947] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 16:32:30 juju-e4d256-prod-github-runner-207 kernel: [40124.588986] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:32:30 juju-e4d256-prod-github-runner-207 kernel: [40124.590026] ? _raw_spin_lock+0x22/0x30 Aug 22 16:32:30 juju-e4d256-prod-github-runner-207 kernel: [40124.590980] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:32:30 juju-e4d256-prod-github-runner-207 kernel: [40124.592003] direct_page_fault+0x206/0x310 [kvm] Aug 22 16:32:30 juju-e4d256-prod-github-runner-207 kernel: [40124.593028] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 16:32:30 juju-e4d256-prod-github-runner-207 kernel: [40124.594045] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 16:32:30 juju-e4d256-prod-github-runner-207 kernel: [40124.595072] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 16:32:30 juju-e4d256-prod-github-runner-207 kernel: [40124.596045] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 16:32:30 juju-e4d256-prod-github-runner-207 kernel: [40124.597008] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 16:32:30 juju-e4d256-prod-github-runner-207 kernel: [40124.597996] handle_exit+0x98/0x230 [kvm_amd] Aug 22 16:32:30 juju-e4d256-prod-github-runner-207 kernel: [40124.598906] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 16:32:30 juju-e4d256-prod-github-runner-207 kernel: [40124.599827] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 16:32:30 juju-e4d256-prod-github-runner-207 kernel: [40124.600748] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 16:32:30 juju-e4d256-prod-github-runner-207 kernel: [40124.601649] vcpu_run+0x62/0x2c0 [kvm] Aug 22 16:32:30 juju-e4d256-prod-github-runner-207 kernel: [40124.602479] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 16:32:30 juju-e4d256-prod-github-runner-207 kernel: [40124.603297] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 16:32:30 juju-e4d256-prod-github-runner-207 kernel: [40124.604151] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 16:32:30 juju-e4d256-prod-github-runner-207 kernel: [40124.604951] ? __seccomp_filter+0x4a/0x4a0 Aug 22 16:32:30 juju-e4d256-prod-github-runner-207 kernel: [40124.605696] ? __fget_files+0x86/0xc0 Aug 22 16:32:30 juju-e4d256-prod-github-runner-207 kernel: [40124.606404] __x64_sys_ioctl+0x95/0xd0 Aug 22 16:32:30 juju-e4d256-prod-github-runner-207 kernel: [40124.607099] do_syscall_64+0x5c/0xc0 Aug 22 16:32:30 juju-e4d256-prod-github-runner-207 kernel: [40124.607780] ? do_futex+0x162/0x1f0 Aug 22 16:32:30 juju-e4d256-prod-github-runner-207 kernel: [40124.608432] ? __x64_sys_futex+0x78/0x1e0 Aug 22 16:32:30 juju-e4d256-prod-github-runner-207 kernel: [40124.609110] ? __secure_computing+0xa9/0x120 Aug 22 16:32:30 juju-e4d256-prod-github-runner-207 kernel: [40124.609922] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 16:32:30 juju-e4d256-prod-github-runner-207 kernel: [40124.610691] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:32:30 juju-e4d256-prod-github-runner-207 kernel: [40124.611411] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:32:30 juju-e4d256-prod-github-runner-207 kernel: [40124.612132] ? do_syscall_64+0x69/0xc0 Aug 22 16:32:30 juju-e4d256-prod-github-runner-207 kernel: [40124.612778] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:32:30 juju-e4d256-prod-github-runner-207 kernel: [40124.613482] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:32:30 juju-e4d256-prod-github-runner-207 kernel: [40124.614174] ? do_syscall_64+0x69/0xc0 Aug 22 16:32:30 juju-e4d256-prod-github-runner-207 kernel: [40124.614814] ? do_syscall_64+0x69/0xc0 Aug 22 16:32:30 juju-e4d256-prod-github-runner-207 kernel: [40124.615466] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 16:32:30 juju-e4d256-prod-github-runner-207 kernel: [40124.616177] RIP: 0033:0x7faa5d0edaff Aug 22 16:32:30 juju-e4d256-prod-github-runner-207 kernel: [40124.616798] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 16:32:30 juju-e4d256-prod-github-runner-207 kernel: [40124.618814] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 16:32:30 juju-e4d256-prod-github-runner-207 kernel: [40124.619726] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 16:32:30 juju-e4d256-prod-github-runner-207 kernel: [40124.620619] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 16:32:30 juju-e4d256-prod-github-runner-207 kernel: [40124.621510] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 16:32:30 juju-e4d256-prod-github-runner-207 kernel: [40124.622417] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 16:32:30 juju-e4d256-prod-github-runner-207 kernel: [40124.623303] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 16:32:30 juju-e4d256-prod-github-runner-207 kernel: [40124.624198] Aug 22 16:32:45 juju-e4d256-prod-github-runner-207 kernel: [40139.864707] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 16:32:45 juju-e4d256-prod-github-runner-207 kernel: [40139.865673] rcu: 1-....: (9974259 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=4823525 Aug 22 16:32:45 juju-e4d256-prod-github-runner-207 kernel: [40139.866822] (t=10005666 jiffies g=23269 q=40901) Aug 22 16:32:45 juju-e4d256-prod-github-runner-207 kernel: [40139.867617] NMI backtrace for cpu 1 Aug 22 16:32:45 juju-e4d256-prod-github-runner-207 kernel: [40139.868326] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 16:32:45 juju-e4d256-prod-github-runner-207 kernel: [40139.869436] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 16:32:45 juju-e4d256-prod-github-runner-207 kernel: [40139.870531] Call Trace: Aug 22 16:32:45 juju-e4d256-prod-github-runner-207 kernel: [40139.871216] Aug 22 16:32:45 juju-e4d256-prod-github-runner-207 kernel: [40139.871869] show_stack+0x52/0x5c Aug 22 16:32:45 juju-e4d256-prod-github-runner-207 kernel: [40139.872596] dump_stack_lvl+0x4a/0x63 Aug 22 16:32:45 juju-e4d256-prod-github-runner-207 kernel: [40139.873539] dump_stack+0x10/0x16 Aug 22 16:32:45 juju-e4d256-prod-github-runner-207 kernel: [40139.874268] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 16:32:45 juju-e4d256-prod-github-runner-207 kernel: [40139.875054] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 16:32:45 juju-e4d256-prod-github-runner-207 kernel: [40139.875842] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 16:32:45 juju-e4d256-prod-github-runner-207 kernel: [40139.876663] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 16:32:45 juju-e4d256-prod-github-runner-207 kernel: [40139.877506] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 16:32:45 juju-e4d256-prod-github-runner-207 kernel: [40139.878373] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 16:32:45 juju-e4d256-prod-github-runner-207 kernel: [40139.879149] print_cpu_stall.cold+0x2f/0xe2 Aug 22 16:32:45 juju-e4d256-prod-github-runner-207 kernel: [40139.879913] ? timekeeping_update+0xf7/0x150 Aug 22 16:32:45 juju-e4d256-prod-github-runner-207 kernel: [40139.880684] check_cpu_stall+0x109/0x270 Aug 22 16:32:45 juju-e4d256-prod-github-runner-207 kernel: [40139.881432] rcu_sched_clock_irq+0x9a/0x250 Aug 22 16:32:45 juju-e4d256-prod-github-runner-207 kernel: [40139.882219] update_process_times+0x94/0xd0 Aug 22 16:32:45 juju-e4d256-prod-github-runner-207 kernel: [40139.882982] tick_sched_handle+0x29/0x70 Aug 22 16:32:45 juju-e4d256-prod-github-runner-207 kernel: [40139.883729] tick_sched_timer+0x8c/0xc0 Aug 22 16:32:45 juju-e4d256-prod-github-runner-207 kernel: [40139.884465] ? tick_nohz_handler+0xb0/0xb0 Aug 22 16:32:45 juju-e4d256-prod-github-runner-207 kernel: [40139.885227] __hrtimer_run_queues+0x107/0x230 Aug 22 16:32:45 juju-e4d256-prod-github-runner-207 kernel: [40139.886006] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 16:32:45 juju-e4d256-prod-github-runner-207 kernel: [40139.886827] hrtimer_interrupt+0x101/0x220 Aug 22 16:32:45 juju-e4d256-prod-github-runner-207 kernel: [40139.887590] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 16:32:45 juju-e4d256-prod-github-runner-207 kernel: [40139.888409] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 16:32:45 juju-e4d256-prod-github-runner-207 kernel: [40139.889212] Aug 22 16:32:45 juju-e4d256-prod-github-runner-207 kernel: [40139.889877] Aug 22 16:32:45 juju-e4d256-prod-github-runner-207 kernel: [40139.890522] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 16:32:45 juju-e4d256-prod-github-runner-207 kernel: [40139.891350] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:32:45 juju-e4d256-prod-github-runner-207 kernel: [40139.892241] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 16:32:45 juju-e4d256-prod-github-runner-207 kernel: [40139.894466] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 16:32:45 juju-e4d256-prod-github-runner-207 kernel: [40139.895343] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 16:32:45 juju-e4d256-prod-github-runner-207 kernel: [40139.896346] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 16:32:45 juju-e4d256-prod-github-runner-207 kernel: [40139.897338] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 16:32:45 juju-e4d256-prod-github-runner-207 kernel: [40139.898340] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 16:32:45 juju-e4d256-prod-github-runner-207 kernel: [40139.899348] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 16:32:45 juju-e4d256-prod-github-runner-207 kernel: [40139.900382] ? _raw_spin_lock+0x22/0x30 Aug 22 16:32:45 juju-e4d256-prod-github-runner-207 kernel: [40139.901151] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:32:45 juju-e4d256-prod-github-runner-207 kernel: [40139.902039] direct_page_fault+0x206/0x310 [kvm] Aug 22 16:32:45 juju-e4d256-prod-github-runner-207 kernel: [40139.902916] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 16:32:45 juju-e4d256-prod-github-runner-207 kernel: [40139.903760] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 16:32:45 juju-e4d256-prod-github-runner-207 kernel: [40139.904727] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 16:32:45 juju-e4d256-prod-github-runner-207 kernel: [40139.905638] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 16:32:45 juju-e4d256-prod-github-runner-207 kernel: [40139.906555] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 16:32:45 juju-e4d256-prod-github-runner-207 kernel: [40139.907761] handle_exit+0x98/0x230 [kvm_amd] Aug 22 16:32:45 juju-e4d256-prod-github-runner-207 kernel: [40139.908789] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 16:32:45 juju-e4d256-prod-github-runner-207 kernel: [40139.909578] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 16:32:45 juju-e4d256-prod-github-runner-207 kernel: [40139.910432] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 16:32:45 juju-e4d256-prod-github-runner-207 kernel: [40139.911396] vcpu_run+0x62/0x2c0 [kvm] Aug 22 16:32:45 juju-e4d256-prod-github-runner-207 kernel: [40139.912173] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 16:32:45 juju-e4d256-prod-github-runner-207 kernel: [40139.912917] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 16:32:45 juju-e4d256-prod-github-runner-207 kernel: [40139.913725] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 16:32:45 juju-e4d256-prod-github-runner-207 kernel: [40139.914509] ? __seccomp_filter+0x4a/0x4a0 Aug 22 16:32:45 juju-e4d256-prod-github-runner-207 kernel: [40139.915234] ? __fget_files+0x86/0xc0 Aug 22 16:32:45 juju-e4d256-prod-github-runner-207 kernel: [40139.915931] __x64_sys_ioctl+0x95/0xd0 Aug 22 16:32:45 juju-e4d256-prod-github-runner-207 kernel: [40139.916633] do_syscall_64+0x5c/0xc0 Aug 22 16:32:45 juju-e4d256-prod-github-runner-207 kernel: [40139.917324] ? do_futex+0x162/0x1f0 Aug 22 16:32:45 juju-e4d256-prod-github-runner-207 kernel: [40139.918001] ? __x64_sys_futex+0x78/0x1e0 Aug 22 16:32:45 juju-e4d256-prod-github-runner-207 kernel: [40139.918719] ? __secure_computing+0xa9/0x120 Aug 22 16:32:45 juju-e4d256-prod-github-runner-207 kernel: [40139.919655] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 16:32:45 juju-e4d256-prod-github-runner-207 kernel: [40139.920473] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:32:45 juju-e4d256-prod-github-runner-207 kernel: [40139.921232] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:32:45 juju-e4d256-prod-github-runner-207 kernel: [40139.921988] ? do_syscall_64+0x69/0xc0 Aug 22 16:32:45 juju-e4d256-prod-github-runner-207 kernel: [40139.922713] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:32:45 juju-e4d256-prod-github-runner-207 kernel: [40139.923474] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:32:45 juju-e4d256-prod-github-runner-207 kernel: [40139.924238] ? do_syscall_64+0x69/0xc0 Aug 22 16:32:45 juju-e4d256-prod-github-runner-207 kernel: [40139.924934] ? do_syscall_64+0x69/0xc0 Aug 22 16:32:45 juju-e4d256-prod-github-runner-207 kernel: [40139.925625] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 16:32:45 juju-e4d256-prod-github-runner-207 kernel: [40139.926416] RIP: 0033:0x7faa5d0edaff Aug 22 16:32:45 juju-e4d256-prod-github-runner-207 kernel: [40139.927114] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 16:32:45 juju-e4d256-prod-github-runner-207 kernel: [40139.929231] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 16:32:45 juju-e4d256-prod-github-runner-207 kernel: [40139.930217] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 16:32:45 juju-e4d256-prod-github-runner-207 kernel: [40139.931172] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 16:32:45 juju-e4d256-prod-github-runner-207 kernel: [40139.932123] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 16:32:45 juju-e4d256-prod-github-runner-207 kernel: [40139.933067] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 16:32:45 juju-e4d256-prod-github-runner-207 kernel: [40139.934000] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 16:32:45 juju-e4d256-prod-github-runner-207 kernel: [40139.934946] Aug 22 16:33:10 juju-e4d256-prod-github-runner-207 kernel: [40164.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 37298s! [qemu-system-x86:6715] Aug 22 16:33:10 juju-e4d256-prod-github-runner-207 kernel: [40164.543884] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 16:33:10 juju-e4d256-prod-github-runner-207 kernel: [40164.544182] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 16:33:10 juju-e4d256-prod-github-runner-207 kernel: [40164.556589] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 16:33:10 juju-e4d256-prod-github-runner-207 kernel: [40164.557877] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 16:33:10 juju-e4d256-prod-github-runner-207 kernel: [40164.559110] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:33:10 juju-e4d256-prod-github-runner-207 kernel: [40164.560187] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 16:33:10 juju-e4d256-prod-github-runner-207 kernel: [40164.562872] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 16:33:10 juju-e4d256-prod-github-runner-207 kernel: [40164.563921] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 16:33:10 juju-e4d256-prod-github-runner-207 kernel: [40164.565089] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 16:33:10 juju-e4d256-prod-github-runner-207 kernel: [40164.566277] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 16:33:10 juju-e4d256-prod-github-runner-207 kernel: [40164.567454] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 16:33:10 juju-e4d256-prod-github-runner-207 kernel: [40164.568633] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 16:33:10 juju-e4d256-prod-github-runner-207 kernel: [40164.570034] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 16:33:10 juju-e4d256-prod-github-runner-207 kernel: [40164.571301] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 16:33:10 juju-e4d256-prod-github-runner-207 kernel: [40164.572407] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 16:33:10 juju-e4d256-prod-github-runner-207 kernel: [40164.573616] Call Trace: Aug 22 16:33:10 juju-e4d256-prod-github-runner-207 kernel: [40164.574546] Aug 22 16:33:10 juju-e4d256-prod-github-runner-207 kernel: [40164.575455] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:33:10 juju-e4d256-prod-github-runner-207 kernel: [40164.576495] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:33:10 juju-e4d256-prod-github-runner-207 kernel: [40164.577582] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:33:10 juju-e4d256-prod-github-runner-207 kernel: [40164.578739] ? show_regs.part.0+0x23/0x29 Aug 22 16:33:10 juju-e4d256-prod-github-runner-207 kernel: [40164.579747] ? show_regs.cold+0x8/0xd Aug 22 16:33:10 juju-e4d256-prod-github-runner-207 kernel: [40164.580744] ? watchdog_timer_fn+0x1be/0x220 Aug 22 16:33:10 juju-e4d256-prod-github-runner-207 kernel: [40164.581771] ? lockup_detector_update_enable+0x60/0x60 Aug 22 16:33:10 juju-e4d256-prod-github-runner-207 kernel: [40164.582877] ? __hrtimer_run_queues+0x107/0x230 Aug 22 16:33:10 juju-e4d256-prod-github-runner-207 kernel: [40164.583940] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 16:33:10 juju-e4d256-prod-github-runner-207 kernel: [40164.585023] ? hrtimer_interrupt+0x101/0x220 Aug 22 16:33:10 juju-e4d256-prod-github-runner-207 kernel: [40164.586077] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 16:33:10 juju-e4d256-prod-github-runner-207 kernel: [40164.587158] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 16:33:10 juju-e4d256-prod-github-runner-207 kernel: [40164.588232] Aug 22 16:33:10 juju-e4d256-prod-github-runner-207 kernel: [40164.589141] Aug 22 16:33:10 juju-e4d256-prod-github-runner-207 kernel: [40164.590014] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 16:33:10 juju-e4d256-prod-github-runner-207 kernel: [40164.591104] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:33:10 juju-e4d256-prod-github-runner-207 kernel: [40164.592182] ? _raw_spin_lock+0x22/0x30 Aug 22 16:33:10 juju-e4d256-prod-github-runner-207 kernel: [40164.593158] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:33:10 juju-e4d256-prod-github-runner-207 kernel: [40164.595084] direct_page_fault+0x206/0x310 [kvm] Aug 22 16:33:10 juju-e4d256-prod-github-runner-207 kernel: [40164.596145] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 16:33:10 juju-e4d256-prod-github-runner-207 kernel: [40164.597169] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 16:33:10 juju-e4d256-prod-github-runner-207 kernel: [40164.598203] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 16:33:10 juju-e4d256-prod-github-runner-207 kernel: [40164.599238] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 16:33:10 juju-e4d256-prod-github-runner-207 kernel: [40164.600212] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 16:33:10 juju-e4d256-prod-github-runner-207 kernel: [40164.601214] handle_exit+0x98/0x230 [kvm_amd] Aug 22 16:33:10 juju-e4d256-prod-github-runner-207 kernel: [40164.602127] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 16:33:10 juju-e4d256-prod-github-runner-207 kernel: [40164.603052] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 16:33:10 juju-e4d256-prod-github-runner-207 kernel: [40164.603978] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 16:33:10 juju-e4d256-prod-github-runner-207 kernel: [40164.604899] vcpu_run+0x62/0x2c0 [kvm] Aug 22 16:33:10 juju-e4d256-prod-github-runner-207 kernel: [40164.605782] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 16:33:10 juju-e4d256-prod-github-runner-207 kernel: [40164.606622] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 16:33:10 juju-e4d256-prod-github-runner-207 kernel: [40164.607594] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 16:33:10 juju-e4d256-prod-github-runner-207 kernel: [40164.608419] ? __seccomp_filter+0x4a/0x4a0 Aug 22 16:33:10 juju-e4d256-prod-github-runner-207 kernel: [40164.609170] ? __fget_files+0x86/0xc0 Aug 22 16:33:10 juju-e4d256-prod-github-runner-207 kernel: [40164.609917] __x64_sys_ioctl+0x95/0xd0 Aug 22 16:33:10 juju-e4d256-prod-github-runner-207 kernel: [40164.610612] do_syscall_64+0x5c/0xc0 Aug 22 16:33:10 juju-e4d256-prod-github-runner-207 kernel: [40164.611286] ? do_futex+0x162/0x1f0 Aug 22 16:33:10 juju-e4d256-prod-github-runner-207 kernel: [40164.611938] ? __x64_sys_futex+0x78/0x1e0 Aug 22 16:33:10 juju-e4d256-prod-github-runner-207 kernel: [40164.612625] ? __secure_computing+0xa9/0x120 Aug 22 16:33:10 juju-e4d256-prod-github-runner-207 kernel: [40164.613317] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 16:33:10 juju-e4d256-prod-github-runner-207 kernel: [40164.614104] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:33:10 juju-e4d256-prod-github-runner-207 kernel: [40164.614847] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:33:10 juju-e4d256-prod-github-runner-207 kernel: [40164.615571] ? do_syscall_64+0x69/0xc0 Aug 22 16:33:10 juju-e4d256-prod-github-runner-207 kernel: [40164.616227] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:33:10 juju-e4d256-prod-github-runner-207 kernel: [40164.616930] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:33:10 juju-e4d256-prod-github-runner-207 kernel: [40164.617627] ? do_syscall_64+0x69/0xc0 Aug 22 16:33:10 juju-e4d256-prod-github-runner-207 kernel: [40164.618261] ? do_syscall_64+0x69/0xc0 Aug 22 16:33:10 juju-e4d256-prod-github-runner-207 kernel: [40164.618899] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 16:33:10 juju-e4d256-prod-github-runner-207 kernel: [40164.619684] RIP: 0033:0x7faa5d0edaff Aug 22 16:33:10 juju-e4d256-prod-github-runner-207 kernel: [40164.620387] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 16:33:10 juju-e4d256-prod-github-runner-207 kernel: [40164.622440] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 16:33:10 juju-e4d256-prod-github-runner-207 kernel: [40164.623360] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 16:33:10 juju-e4d256-prod-github-runner-207 kernel: [40164.624251] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 16:33:10 juju-e4d256-prod-github-runner-207 kernel: [40164.625151] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 16:33:10 juju-e4d256-prod-github-runner-207 kernel: [40164.626068] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 16:33:10 juju-e4d256-prod-github-runner-207 kernel: [40164.626966] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 16:33:10 juju-e4d256-prod-github-runner-207 kernel: [40164.627868] Aug 22 16:33:38 juju-e4d256-prod-github-runner-207 kernel: [40192.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 37324s! [qemu-system-x86:6715] Aug 22 16:33:38 juju-e4d256-prod-github-runner-207 kernel: [40192.543124] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 16:33:38 juju-e4d256-prod-github-runner-207 kernel: [40192.543199] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 16:33:38 juju-e4d256-prod-github-runner-207 kernel: [40192.556309] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 16:33:38 juju-e4d256-prod-github-runner-207 kernel: [40192.557598] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 16:33:38 juju-e4d256-prod-github-runner-207 kernel: [40192.558825] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:33:38 juju-e4d256-prod-github-runner-207 kernel: [40192.559914] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 16:33:38 juju-e4d256-prod-github-runner-207 kernel: [40192.562487] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 16:33:38 juju-e4d256-prod-github-runner-207 kernel: [40192.563532] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 16:33:38 juju-e4d256-prod-github-runner-207 kernel: [40192.564702] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 16:33:38 juju-e4d256-prod-github-runner-207 kernel: [40192.565885] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 16:33:38 juju-e4d256-prod-github-runner-207 kernel: [40192.567050] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 16:33:38 juju-e4d256-prod-github-runner-207 kernel: [40192.568217] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 16:33:38 juju-e4d256-prod-github-runner-207 kernel: [40192.569383] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 16:33:38 juju-e4d256-prod-github-runner-207 kernel: [40192.570638] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 16:33:38 juju-e4d256-prod-github-runner-207 kernel: [40192.571736] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 16:33:38 juju-e4d256-prod-github-runner-207 kernel: [40192.572930] Call Trace: Aug 22 16:33:38 juju-e4d256-prod-github-runner-207 kernel: [40192.573867] Aug 22 16:33:38 juju-e4d256-prod-github-runner-207 kernel: [40192.574761] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:33:38 juju-e4d256-prod-github-runner-207 kernel: [40192.575880] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:33:38 juju-e4d256-prod-github-runner-207 kernel: [40192.577040] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:33:38 juju-e4d256-prod-github-runner-207 kernel: [40192.578157] ? show_regs.part.0+0x23/0x29 Aug 22 16:33:38 juju-e4d256-prod-github-runner-207 kernel: [40192.579162] ? show_regs.cold+0x8/0xd Aug 22 16:33:38 juju-e4d256-prod-github-runner-207 kernel: [40192.580138] ? watchdog_timer_fn+0x1be/0x220 Aug 22 16:33:38 juju-e4d256-prod-github-runner-207 kernel: [40192.581156] ? lockup_detector_update_enable+0x60/0x60 Aug 22 16:33:38 juju-e4d256-prod-github-runner-207 kernel: [40192.582241] ? __hrtimer_run_queues+0x107/0x230 Aug 22 16:33:38 juju-e4d256-prod-github-runner-207 kernel: [40192.583271] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 16:33:38 juju-e4d256-prod-github-runner-207 kernel: [40192.584296] ? hrtimer_interrupt+0x101/0x220 Aug 22 16:33:38 juju-e4d256-prod-github-runner-207 kernel: [40192.585333] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 16:33:38 juju-e4d256-prod-github-runner-207 kernel: [40192.586488] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 16:33:38 juju-e4d256-prod-github-runner-207 kernel: [40192.587558] Aug 22 16:33:38 juju-e4d256-prod-github-runner-207 kernel: [40192.588411] Aug 22 16:33:38 juju-e4d256-prod-github-runner-207 kernel: [40192.589252] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 16:33:38 juju-e4d256-prod-github-runner-207 kernel: [40192.590316] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:33:38 juju-e4d256-prod-github-runner-207 kernel: [40192.591378] ? _raw_spin_lock+0x22/0x30 Aug 22 16:33:38 juju-e4d256-prod-github-runner-207 kernel: [40192.592336] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:33:38 juju-e4d256-prod-github-runner-207 kernel: [40192.593358] direct_page_fault+0x206/0x310 [kvm] Aug 22 16:33:38 juju-e4d256-prod-github-runner-207 kernel: [40192.594425] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 16:33:38 juju-e4d256-prod-github-runner-207 kernel: [40192.595446] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 16:33:38 juju-e4d256-prod-github-runner-207 kernel: [40192.596457] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 16:33:38 juju-e4d256-prod-github-runner-207 kernel: [40192.597430] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 16:33:38 juju-e4d256-prod-github-runner-207 kernel: [40192.598392] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 16:33:38 juju-e4d256-prod-github-runner-207 kernel: [40192.599371] handle_exit+0x98/0x230 [kvm_amd] Aug 22 16:33:38 juju-e4d256-prod-github-runner-207 kernel: [40192.600270] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 16:33:38 juju-e4d256-prod-github-runner-207 kernel: [40192.601187] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 16:33:38 juju-e4d256-prod-github-runner-207 kernel: [40192.602134] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 16:33:38 juju-e4d256-prod-github-runner-207 kernel: [40192.603039] vcpu_run+0x62/0x2c0 [kvm] Aug 22 16:33:38 juju-e4d256-prod-github-runner-207 kernel: [40192.603863] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 16:33:38 juju-e4d256-prod-github-runner-207 kernel: [40192.604678] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 16:33:38 juju-e4d256-prod-github-runner-207 kernel: [40192.605601] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 16:33:38 juju-e4d256-prod-github-runner-207 kernel: [40192.606588] ? __seccomp_filter+0x4a/0x4a0 Aug 22 16:33:38 juju-e4d256-prod-github-runner-207 kernel: [40192.607352] ? __fget_files+0x86/0xc0 Aug 22 16:33:38 juju-e4d256-prod-github-runner-207 kernel: [40192.608061] __x64_sys_ioctl+0x95/0xd0 Aug 22 16:33:38 juju-e4d256-prod-github-runner-207 kernel: [40192.608758] do_syscall_64+0x5c/0xc0 Aug 22 16:33:38 juju-e4d256-prod-github-runner-207 kernel: [40192.609428] ? do_futex+0x162/0x1f0 Aug 22 16:33:38 juju-e4d256-prod-github-runner-207 kernel: [40192.610105] ? __x64_sys_futex+0x78/0x1e0 Aug 22 16:33:38 juju-e4d256-prod-github-runner-207 kernel: [40192.610817] ? __secure_computing+0xa9/0x120 Aug 22 16:33:38 juju-e4d256-prod-github-runner-207 kernel: [40192.611528] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 16:33:38 juju-e4d256-prod-github-runner-207 kernel: [40192.612290] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:33:38 juju-e4d256-prod-github-runner-207 kernel: [40192.613015] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:33:38 juju-e4d256-prod-github-runner-207 kernel: [40192.613762] ? do_syscall_64+0x69/0xc0 Aug 22 16:33:38 juju-e4d256-prod-github-runner-207 kernel: [40192.614481] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:33:38 juju-e4d256-prod-github-runner-207 kernel: [40192.615186] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:33:38 juju-e4d256-prod-github-runner-207 kernel: [40192.615902] ? do_syscall_64+0x69/0xc0 Aug 22 16:33:38 juju-e4d256-prod-github-runner-207 kernel: [40192.616551] ? do_syscall_64+0x69/0xc0 Aug 22 16:33:38 juju-e4d256-prod-github-runner-207 kernel: [40192.617179] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 16:33:38 juju-e4d256-prod-github-runner-207 kernel: [40192.617919] RIP: 0033:0x7faa5d0edaff Aug 22 16:33:38 juju-e4d256-prod-github-runner-207 kernel: [40192.618558] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 16:33:38 juju-e4d256-prod-github-runner-207 kernel: [40192.620558] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 16:33:38 juju-e4d256-prod-github-runner-207 kernel: [40192.621567] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 16:33:38 juju-e4d256-prod-github-runner-207 kernel: [40192.622481] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 16:33:38 juju-e4d256-prod-github-runner-207 kernel: [40192.623376] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 16:33:38 juju-e4d256-prod-github-runner-207 kernel: [40192.624271] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 16:33:38 juju-e4d256-prod-github-runner-207 kernel: [40192.625164] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 16:33:38 juju-e4d256-prod-github-runner-207 kernel: [40192.626081] Aug 22 16:34:06 juju-e4d256-prod-github-runner-207 kernel: [40220.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 37350s! [qemu-system-x86:6715] Aug 22 16:34:06 juju-e4d256-prod-github-runner-207 kernel: [40220.543123] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 16:34:06 juju-e4d256-prod-github-runner-207 kernel: [40220.543198] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 16:34:06 juju-e4d256-prod-github-runner-207 kernel: [40220.555375] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 16:34:06 juju-e4d256-prod-github-runner-207 kernel: [40220.556647] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 16:34:06 juju-e4d256-prod-github-runner-207 kernel: [40220.557885] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:34:06 juju-e4d256-prod-github-runner-207 kernel: [40220.558947] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 16:34:06 juju-e4d256-prod-github-runner-207 kernel: [40220.561503] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 16:34:06 juju-e4d256-prod-github-runner-207 kernel: [40220.562548] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 16:34:06 juju-e4d256-prod-github-runner-207 kernel: [40220.563715] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 16:34:06 juju-e4d256-prod-github-runner-207 kernel: [40220.564876] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 16:34:06 juju-e4d256-prod-github-runner-207 kernel: [40220.566050] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 16:34:06 juju-e4d256-prod-github-runner-207 kernel: [40220.567214] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 16:34:06 juju-e4d256-prod-github-runner-207 kernel: [40220.568382] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 16:34:06 juju-e4d256-prod-github-runner-207 kernel: [40220.569643] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 16:34:06 juju-e4d256-prod-github-runner-207 kernel: [40220.570753] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 16:34:06 juju-e4d256-prod-github-runner-207 kernel: [40220.571969] Call Trace: Aug 22 16:34:06 juju-e4d256-prod-github-runner-207 kernel: [40220.572896] Aug 22 16:34:06 juju-e4d256-prod-github-runner-207 kernel: [40220.573803] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:34:06 juju-e4d256-prod-github-runner-207 kernel: [40220.574845] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:34:06 juju-e4d256-prod-github-runner-207 kernel: [40220.575875] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:34:06 juju-e4d256-prod-github-runner-207 kernel: [40220.576964] ? show_regs.part.0+0x23/0x29 Aug 22 16:34:06 juju-e4d256-prod-github-runner-207 kernel: [40220.577998] ? show_regs.cold+0x8/0xd Aug 22 16:34:06 juju-e4d256-prod-github-runner-207 kernel: [40220.578982] ? watchdog_timer_fn+0x1be/0x220 Aug 22 16:34:06 juju-e4d256-prod-github-runner-207 kernel: [40220.579992] ? lockup_detector_update_enable+0x60/0x60 Aug 22 16:34:06 juju-e4d256-prod-github-runner-207 kernel: [40220.581057] ? __hrtimer_run_queues+0x107/0x230 Aug 22 16:34:06 juju-e4d256-prod-github-runner-207 kernel: [40220.582105] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 16:34:06 juju-e4d256-prod-github-runner-207 kernel: [40220.583136] ? hrtimer_interrupt+0x101/0x220 Aug 22 16:34:06 juju-e4d256-prod-github-runner-207 kernel: [40220.584151] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 16:34:06 juju-e4d256-prod-github-runner-207 kernel: [40220.585253] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 16:34:06 juju-e4d256-prod-github-runner-207 kernel: [40220.586301] Aug 22 16:34:06 juju-e4d256-prod-github-runner-207 kernel: [40220.587155] Aug 22 16:34:06 juju-e4d256-prod-github-runner-207 kernel: [40220.587994] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 16:34:06 juju-e4d256-prod-github-runner-207 kernel: [40220.589040] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:34:06 juju-e4d256-prod-github-runner-207 kernel: [40220.590099] ? _raw_spin_lock+0x22/0x30 Aug 22 16:34:06 juju-e4d256-prod-github-runner-207 kernel: [40220.591048] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:34:06 juju-e4d256-prod-github-runner-207 kernel: [40220.592067] direct_page_fault+0x206/0x310 [kvm] Aug 22 16:34:06 juju-e4d256-prod-github-runner-207 kernel: [40220.593091] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 16:34:06 juju-e4d256-prod-github-runner-207 kernel: [40220.594127] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 16:34:06 juju-e4d256-prod-github-runner-207 kernel: [40220.595141] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 16:34:06 juju-e4d256-prod-github-runner-207 kernel: [40220.596116] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 16:34:06 juju-e4d256-prod-github-runner-207 kernel: [40220.597062] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 16:34:06 juju-e4d256-prod-github-runner-207 kernel: [40220.598060] handle_exit+0x98/0x230 [kvm_amd] Aug 22 16:34:06 juju-e4d256-prod-github-runner-207 kernel: [40220.598962] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 16:34:06 juju-e4d256-prod-github-runner-207 kernel: [40220.599877] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 16:34:06 juju-e4d256-prod-github-runner-207 kernel: [40220.600801] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 16:34:06 juju-e4d256-prod-github-runner-207 kernel: [40220.601715] vcpu_run+0x62/0x2c0 [kvm] Aug 22 16:34:06 juju-e4d256-prod-github-runner-207 kernel: [40220.602526] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 16:34:06 juju-e4d256-prod-github-runner-207 kernel: [40220.603333] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 16:34:06 juju-e4d256-prod-github-runner-207 kernel: [40220.604186] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 16:34:06 juju-e4d256-prod-github-runner-207 kernel: [40220.604999] ? __seccomp_filter+0x4a/0x4a0 Aug 22 16:34:06 juju-e4d256-prod-github-runner-207 kernel: [40220.605762] ? __fget_files+0x86/0xc0 Aug 22 16:34:06 juju-e4d256-prod-github-runner-207 kernel: [40220.606476] __x64_sys_ioctl+0x95/0xd0 Aug 22 16:34:06 juju-e4d256-prod-github-runner-207 kernel: [40220.607172] do_syscall_64+0x5c/0xc0 Aug 22 16:34:06 juju-e4d256-prod-github-runner-207 kernel: [40220.607837] ? do_futex+0x162/0x1f0 Aug 22 16:34:06 juju-e4d256-prod-github-runner-207 kernel: [40220.608486] ? __x64_sys_futex+0x78/0x1e0 Aug 22 16:34:06 juju-e4d256-prod-github-runner-207 kernel: [40220.609161] ? __secure_computing+0xa9/0x120 Aug 22 16:34:06 juju-e4d256-prod-github-runner-207 kernel: [40220.609862] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 16:34:06 juju-e4d256-prod-github-runner-207 kernel: [40220.610628] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:34:06 juju-e4d256-prod-github-runner-207 kernel: [40220.611361] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:34:06 juju-e4d256-prod-github-runner-207 kernel: [40220.612077] ? do_syscall_64+0x69/0xc0 Aug 22 16:34:06 juju-e4d256-prod-github-runner-207 kernel: [40220.612733] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:34:06 juju-e4d256-prod-github-runner-207 kernel: [40220.613450] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:34:06 juju-e4d256-prod-github-runner-207 kernel: [40220.614147] ? do_syscall_64+0x69/0xc0 Aug 22 16:34:06 juju-e4d256-prod-github-runner-207 kernel: [40220.614778] ? do_syscall_64+0x69/0xc0 Aug 22 16:34:06 juju-e4d256-prod-github-runner-207 kernel: [40220.615398] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 16:34:06 juju-e4d256-prod-github-runner-207 kernel: [40220.616100] RIP: 0033:0x7faa5d0edaff Aug 22 16:34:06 juju-e4d256-prod-github-runner-207 kernel: [40220.616824] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 16:34:06 juju-e4d256-prod-github-runner-207 kernel: [40220.618826] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 16:34:06 juju-e4d256-prod-github-runner-207 kernel: [40220.619744] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 16:34:06 juju-e4d256-prod-github-runner-207 kernel: [40220.620636] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 16:34:06 juju-e4d256-prod-github-runner-207 kernel: [40220.621547] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 16:34:06 juju-e4d256-prod-github-runner-207 kernel: [40220.622438] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 16:34:06 juju-e4d256-prod-github-runner-207 kernel: [40220.623328] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 16:34:06 juju-e4d256-prod-github-runner-207 kernel: [40220.624220] Aug 22 16:34:34 juju-e4d256-prod-github-runner-207 kernel: [40248.541980] watchdog: BUG: soft lockup - CPU#1 stuck for 37376s! [qemu-system-x86:6715] Aug 22 16:34:34 juju-e4d256-prod-github-runner-207 kernel: [40248.543977] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 16:34:34 juju-e4d256-prod-github-runner-207 kernel: [40248.544280] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 16:34:34 juju-e4d256-prod-github-runner-207 kernel: [40248.556475] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 16:34:34 juju-e4d256-prod-github-runner-207 kernel: [40248.557787] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 16:34:34 juju-e4d256-prod-github-runner-207 kernel: [40248.558993] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:34:34 juju-e4d256-prod-github-runner-207 kernel: [40248.560039] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 16:34:34 juju-e4d256-prod-github-runner-207 kernel: [40248.562759] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 16:34:34 juju-e4d256-prod-github-runner-207 kernel: [40248.563829] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 16:34:34 juju-e4d256-prod-github-runner-207 kernel: [40248.565028] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 16:34:34 juju-e4d256-prod-github-runner-207 kernel: [40248.566182] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 16:34:34 juju-e4d256-prod-github-runner-207 kernel: [40248.567320] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 16:34:34 juju-e4d256-prod-github-runner-207 kernel: [40248.568455] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 16:34:34 juju-e4d256-prod-github-runner-207 kernel: [40248.569613] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 16:34:34 juju-e4d256-prod-github-runner-207 kernel: [40248.570825] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 16:34:34 juju-e4d256-prod-github-runner-207 kernel: [40248.571903] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 16:34:34 juju-e4d256-prod-github-runner-207 kernel: [40248.573085] Call Trace: Aug 22 16:34:34 juju-e4d256-prod-github-runner-207 kernel: [40248.574162] Aug 22 16:34:34 juju-e4d256-prod-github-runner-207 kernel: [40248.575081] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:34:34 juju-e4d256-prod-github-runner-207 kernel: [40248.576133] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:34:34 juju-e4d256-prod-github-runner-207 kernel: [40248.578023] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:34:34 juju-e4d256-prod-github-runner-207 kernel: [40248.579126] ? show_regs.part.0+0x23/0x29 Aug 22 16:34:34 juju-e4d256-prod-github-runner-207 kernel: [40248.580347] ? show_regs.cold+0x8/0xd Aug 22 16:34:34 juju-e4d256-prod-github-runner-207 kernel: [40248.581330] ? watchdog_timer_fn+0x1be/0x220 Aug 22 16:34:34 juju-e4d256-prod-github-runner-207 kernel: [40248.582325] ? lockup_detector_update_enable+0x60/0x60 Aug 22 16:34:34 juju-e4d256-prod-github-runner-207 kernel: [40248.583372] ? __hrtimer_run_queues+0x107/0x230 Aug 22 16:34:34 juju-e4d256-prod-github-runner-207 kernel: [40248.584382] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 16:34:34 juju-e4d256-prod-github-runner-207 kernel: [40248.585421] ? hrtimer_interrupt+0x101/0x220 Aug 22 16:34:34 juju-e4d256-prod-github-runner-207 kernel: [40248.586449] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 16:34:34 juju-e4d256-prod-github-runner-207 kernel: [40248.587525] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 16:34:34 juju-e4d256-prod-github-runner-207 kernel: [40248.588569] Aug 22 16:34:34 juju-e4d256-prod-github-runner-207 kernel: [40248.589510] Aug 22 16:34:34 juju-e4d256-prod-github-runner-207 kernel: [40248.590622] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 16:34:34 juju-e4d256-prod-github-runner-207 kernel: [40248.591828] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:34:34 juju-e4d256-prod-github-runner-207 kernel: [40248.592878] ? _raw_spin_lock+0x22/0x30 Aug 22 16:34:34 juju-e4d256-prod-github-runner-207 kernel: [40248.593817] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:34:34 juju-e4d256-prod-github-runner-207 kernel: [40248.594832] direct_page_fault+0x206/0x310 [kvm] Aug 22 16:34:34 juju-e4d256-prod-github-runner-207 kernel: [40248.595858] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 16:34:34 juju-e4d256-prod-github-runner-207 kernel: [40248.596892] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 16:34:34 juju-e4d256-prod-github-runner-207 kernel: [40248.597877] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 16:34:34 juju-e4d256-prod-github-runner-207 kernel: [40248.598872] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 16:34:34 juju-e4d256-prod-github-runner-207 kernel: [40248.599803] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 16:34:34 juju-e4d256-prod-github-runner-207 kernel: [40248.600758] handle_exit+0x98/0x230 [kvm_amd] Aug 22 16:34:34 juju-e4d256-prod-github-runner-207 kernel: [40248.601666] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 16:34:34 juju-e4d256-prod-github-runner-207 kernel: [40248.602568] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 16:34:34 juju-e4d256-prod-github-runner-207 kernel: [40248.603511] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 16:34:34 juju-e4d256-prod-github-runner-207 kernel: [40248.604410] vcpu_run+0x62/0x2c0 [kvm] Aug 22 16:34:34 juju-e4d256-prod-github-runner-207 kernel: [40248.605228] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 16:34:34 juju-e4d256-prod-github-runner-207 kernel: [40248.606035] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 16:34:34 juju-e4d256-prod-github-runner-207 kernel: [40248.606890] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 16:34:34 juju-e4d256-prod-github-runner-207 kernel: [40248.607671] ? __seccomp_filter+0x4a/0x4a0 Aug 22 16:34:34 juju-e4d256-prod-github-runner-207 kernel: [40248.608404] ? __fget_files+0x86/0xc0 Aug 22 16:34:34 juju-e4d256-prod-github-runner-207 kernel: [40248.609103] __x64_sys_ioctl+0x95/0xd0 Aug 22 16:34:34 juju-e4d256-prod-github-runner-207 kernel: [40248.609784] do_syscall_64+0x5c/0xc0 Aug 22 16:34:34 juju-e4d256-prod-github-runner-207 kernel: [40248.610434] ? do_futex+0x162/0x1f0 Aug 22 16:34:34 juju-e4d256-prod-github-runner-207 kernel: [40248.611068] ? __x64_sys_futex+0x78/0x1e0 Aug 22 16:34:34 juju-e4d256-prod-github-runner-207 kernel: [40248.611728] ? __secure_computing+0xa9/0x120 Aug 22 16:34:34 juju-e4d256-prod-github-runner-207 kernel: [40248.612408] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 16:34:34 juju-e4d256-prod-github-runner-207 kernel: [40248.613154] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:34:34 juju-e4d256-prod-github-runner-207 kernel: [40248.613862] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:34:34 juju-e4d256-prod-github-runner-207 kernel: [40248.614557] ? do_syscall_64+0x69/0xc0 Aug 22 16:34:34 juju-e4d256-prod-github-runner-207 kernel: [40248.615189] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:34:34 juju-e4d256-prod-github-runner-207 kernel: [40248.615875] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:34:34 juju-e4d256-prod-github-runner-207 kernel: [40248.616558] ? do_syscall_64+0x69/0xc0 Aug 22 16:34:34 juju-e4d256-prod-github-runner-207 kernel: [40248.617195] ? do_syscall_64+0x69/0xc0 Aug 22 16:34:34 juju-e4d256-prod-github-runner-207 kernel: [40248.617804] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 16:34:34 juju-e4d256-prod-github-runner-207 kernel: [40248.618490] RIP: 0033:0x7faa5d0edaff Aug 22 16:34:34 juju-e4d256-prod-github-runner-207 kernel: [40248.619141] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 16:34:34 juju-e4d256-prod-github-runner-207 kernel: [40248.621055] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 16:34:34 juju-e4d256-prod-github-runner-207 kernel: [40248.621937] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 16:34:34 juju-e4d256-prod-github-runner-207 kernel: [40248.622807] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 16:34:34 juju-e4d256-prod-github-runner-207 kernel: [40248.623664] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 16:34:34 juju-e4d256-prod-github-runner-207 kernel: [40248.624628] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 16:34:34 juju-e4d256-prod-github-runner-207 kernel: [40248.626089] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 16:34:34 juju-e4d256-prod-github-runner-207 kernel: [40248.627122] Aug 22 16:35:02 juju-e4d256-prod-github-runner-207 kernel: [40276.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 37402s! [qemu-system-x86:6715] Aug 22 16:35:02 juju-e4d256-prod-github-runner-207 kernel: [40276.544204] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 16:35:02 juju-e4d256-prod-github-runner-207 kernel: [40276.544484] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 16:35:02 juju-e4d256-prod-github-runner-207 kernel: [40276.556552] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 16:35:02 juju-e4d256-prod-github-runner-207 kernel: [40276.557811] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 16:35:02 juju-e4d256-prod-github-runner-207 kernel: [40276.559033] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:35:02 juju-e4d256-prod-github-runner-207 kernel: [40276.560092] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 16:35:02 juju-e4d256-prod-github-runner-207 kernel: [40276.562645] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 16:35:02 juju-e4d256-prod-github-runner-207 kernel: [40276.563683] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 16:35:02 juju-e4d256-prod-github-runner-207 kernel: [40276.564854] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 16:35:02 juju-e4d256-prod-github-runner-207 kernel: [40276.566010] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 16:35:02 juju-e4d256-prod-github-runner-207 kernel: [40276.567169] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 16:35:02 juju-e4d256-prod-github-runner-207 kernel: [40276.568324] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 16:35:02 juju-e4d256-prod-github-runner-207 kernel: [40276.569499] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 16:35:02 juju-e4d256-prod-github-runner-207 kernel: [40276.570729] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 16:35:02 juju-e4d256-prod-github-runner-207 kernel: [40276.571822] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 16:35:02 juju-e4d256-prod-github-runner-207 kernel: [40276.573018] Call Trace: Aug 22 16:35:02 juju-e4d256-prod-github-runner-207 kernel: [40276.573928] Aug 22 16:35:02 juju-e4d256-prod-github-runner-207 kernel: [40276.574823] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:35:02 juju-e4d256-prod-github-runner-207 kernel: [40276.575849] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:35:02 juju-e4d256-prod-github-runner-207 kernel: [40276.576874] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:35:02 juju-e4d256-prod-github-runner-207 kernel: [40276.577964] ? show_regs.part.0+0x23/0x29 Aug 22 16:35:02 juju-e4d256-prod-github-runner-207 kernel: [40276.578956] ? show_regs.cold+0x8/0xd Aug 22 16:35:02 juju-e4d256-prod-github-runner-207 kernel: [40276.579928] ? watchdog_timer_fn+0x1be/0x220 Aug 22 16:35:02 juju-e4d256-prod-github-runner-207 kernel: [40276.580946] ? lockup_detector_update_enable+0x60/0x60 Aug 22 16:35:02 juju-e4d256-prod-github-runner-207 kernel: [40276.582005] ? __hrtimer_run_queues+0x107/0x230 Aug 22 16:35:02 juju-e4d256-prod-github-runner-207 kernel: [40276.583028] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 16:35:02 juju-e4d256-prod-github-runner-207 kernel: [40276.584052] ? hrtimer_interrupt+0x101/0x220 Aug 22 16:35:02 juju-e4d256-prod-github-runner-207 kernel: [40276.585075] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 16:35:02 juju-e4d256-prod-github-runner-207 kernel: [40276.586141] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 16:35:02 juju-e4d256-prod-github-runner-207 kernel: [40276.587181] Aug 22 16:35:02 juju-e4d256-prod-github-runner-207 kernel: [40276.588030] Aug 22 16:35:02 juju-e4d256-prod-github-runner-207 kernel: [40276.588870] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 16:35:02 juju-e4d256-prod-github-runner-207 kernel: [40276.589900] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:35:02 juju-e4d256-prod-github-runner-207 kernel: [40276.590942] ? _raw_spin_lock+0x22/0x30 Aug 22 16:35:02 juju-e4d256-prod-github-runner-207 kernel: [40276.591882] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:35:02 juju-e4d256-prod-github-runner-207 kernel: [40276.592902] direct_page_fault+0x206/0x310 [kvm] Aug 22 16:35:02 juju-e4d256-prod-github-runner-207 kernel: [40276.593927] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 16:35:02 juju-e4d256-prod-github-runner-207 kernel: [40276.594931] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 16:35:02 juju-e4d256-prod-github-runner-207 kernel: [40276.595935] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 16:35:02 juju-e4d256-prod-github-runner-207 kernel: [40276.596942] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 16:35:02 juju-e4d256-prod-github-runner-207 kernel: [40276.597885] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 16:35:02 juju-e4d256-prod-github-runner-207 kernel: [40276.598864] handle_exit+0x98/0x230 [kvm_amd] Aug 22 16:35:02 juju-e4d256-prod-github-runner-207 kernel: [40276.599754] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 16:35:02 juju-e4d256-prod-github-runner-207 kernel: [40276.600679] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 16:35:02 juju-e4d256-prod-github-runner-207 kernel: [40276.601600] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 16:35:02 juju-e4d256-prod-github-runner-207 kernel: [40276.602504] vcpu_run+0x62/0x2c0 [kvm] Aug 22 16:35:02 juju-e4d256-prod-github-runner-207 kernel: [40276.603309] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 16:35:02 juju-e4d256-prod-github-runner-207 kernel: [40276.604113] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 16:35:02 juju-e4d256-prod-github-runner-207 kernel: [40276.604969] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 16:35:02 juju-e4d256-prod-github-runner-207 kernel: [40276.605767] ? __seccomp_filter+0x4a/0x4a0 Aug 22 16:35:02 juju-e4d256-prod-github-runner-207 kernel: [40276.606503] ? __fget_files+0x86/0xc0 Aug 22 16:35:02 juju-e4d256-prod-github-runner-207 kernel: [40276.607202] __x64_sys_ioctl+0x95/0xd0 Aug 22 16:35:02 juju-e4d256-prod-github-runner-207 kernel: [40276.607890] do_syscall_64+0x5c/0xc0 Aug 22 16:35:02 juju-e4d256-prod-github-runner-207 kernel: [40276.608559] ? do_futex+0x162/0x1f0 Aug 22 16:35:02 juju-e4d256-prod-github-runner-207 kernel: [40276.609209] ? __x64_sys_futex+0x78/0x1e0 Aug 22 16:35:02 juju-e4d256-prod-github-runner-207 kernel: [40276.609878] ? __secure_computing+0xa9/0x120 Aug 22 16:35:02 juju-e4d256-prod-github-runner-207 kernel: [40276.610561] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 16:35:02 juju-e4d256-prod-github-runner-207 kernel: [40276.611320] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:35:02 juju-e4d256-prod-github-runner-207 kernel: [40276.612035] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:35:02 juju-e4d256-prod-github-runner-207 kernel: [40276.612754] ? do_syscall_64+0x69/0xc0 Aug 22 16:35:02 juju-e4d256-prod-github-runner-207 kernel: [40276.613401] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:35:02 juju-e4d256-prod-github-runner-207 kernel: [40276.614098] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:35:02 juju-e4d256-prod-github-runner-207 kernel: [40276.614788] ? do_syscall_64+0x69/0xc0 Aug 22 16:35:02 juju-e4d256-prod-github-runner-207 kernel: [40276.615414] ? do_syscall_64+0x69/0xc0 Aug 22 16:35:02 juju-e4d256-prod-github-runner-207 kernel: [40276.616034] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 16:35:02 juju-e4d256-prod-github-runner-207 kernel: [40276.616745] RIP: 0033:0x7faa5d0edaff Aug 22 16:35:02 juju-e4d256-prod-github-runner-207 kernel: [40276.617748] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 16:35:02 juju-e4d256-prod-github-runner-207 kernel: [40276.619722] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 16:35:02 juju-e4d256-prod-github-runner-207 kernel: [40276.622965] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 16:35:02 juju-e4d256-prod-github-runner-207 kernel: [40276.624157] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 16:35:02 juju-e4d256-prod-github-runner-207 kernel: [40276.625058] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 16:35:02 juju-e4d256-prod-github-runner-207 kernel: [40276.625942] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 16:35:02 juju-e4d256-prod-github-runner-207 kernel: [40276.626829] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 16:35:02 juju-e4d256-prod-github-runner-207 kernel: [40276.627720] Aug 22 16:35:30 juju-e4d256-prod-github-runner-207 kernel: [40304.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 37428s! [qemu-system-x86:6715] Aug 22 16:35:30 juju-e4d256-prod-github-runner-207 kernel: [40304.543782] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 16:35:30 juju-e4d256-prod-github-runner-207 kernel: [40304.544065] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 16:35:30 juju-e4d256-prod-github-runner-207 kernel: [40304.556649] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 16:35:30 juju-e4d256-prod-github-runner-207 kernel: [40304.557924] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 16:35:30 juju-e4d256-prod-github-runner-207 kernel: [40304.559149] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:35:30 juju-e4d256-prod-github-runner-207 kernel: [40304.560231] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 16:35:30 juju-e4d256-prod-github-runner-207 kernel: [40304.562813] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 16:35:30 juju-e4d256-prod-github-runner-207 kernel: [40304.563870] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 16:35:30 juju-e4d256-prod-github-runner-207 kernel: [40304.565055] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 16:35:30 juju-e4d256-prod-github-runner-207 kernel: [40304.566226] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 16:35:30 juju-e4d256-prod-github-runner-207 kernel: [40304.567422] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 16:35:30 juju-e4d256-prod-github-runner-207 kernel: [40304.568616] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 16:35:30 juju-e4d256-prod-github-runner-207 kernel: [40304.569798] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 16:35:30 juju-e4d256-prod-github-runner-207 kernel: [40304.571045] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 16:35:30 juju-e4d256-prod-github-runner-207 kernel: [40304.572156] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 16:35:30 juju-e4d256-prod-github-runner-207 kernel: [40304.573367] Call Trace: Aug 22 16:35:30 juju-e4d256-prod-github-runner-207 kernel: [40304.574299] Aug 22 16:35:30 juju-e4d256-prod-github-runner-207 kernel: [40304.575241] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:35:30 juju-e4d256-prod-github-runner-207 kernel: [40304.576312] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:35:30 juju-e4d256-prod-github-runner-207 kernel: [40304.577379] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:35:30 juju-e4d256-prod-github-runner-207 kernel: [40304.578490] ? show_regs.part.0+0x23/0x29 Aug 22 16:35:30 juju-e4d256-prod-github-runner-207 kernel: [40304.579495] ? show_regs.cold+0x8/0xd Aug 22 16:35:30 juju-e4d256-prod-github-runner-207 kernel: [40304.580483] ? watchdog_timer_fn+0x1be/0x220 Aug 22 16:35:30 juju-e4d256-prod-github-runner-207 kernel: [40304.581522] ? lockup_detector_update_enable+0x60/0x60 Aug 22 16:35:30 juju-e4d256-prod-github-runner-207 kernel: [40304.582609] ? __hrtimer_run_queues+0x107/0x230 Aug 22 16:35:30 juju-e4d256-prod-github-runner-207 kernel: [40304.583647] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 16:35:30 juju-e4d256-prod-github-runner-207 kernel: [40304.584707] ? hrtimer_interrupt+0x101/0x220 Aug 22 16:35:30 juju-e4d256-prod-github-runner-207 kernel: [40304.585736] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 16:35:30 juju-e4d256-prod-github-runner-207 kernel: [40304.586817] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 16:35:30 juju-e4d256-prod-github-runner-207 kernel: [40304.587893] Aug 22 16:35:30 juju-e4d256-prod-github-runner-207 kernel: [40304.588776] Aug 22 16:35:30 juju-e4d256-prod-github-runner-207 kernel: [40304.589718] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 16:35:30 juju-e4d256-prod-github-runner-207 kernel: [40304.590751] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:35:30 juju-e4d256-prod-github-runner-207 kernel: [40304.591806] ? _raw_spin_lock+0x22/0x30 Aug 22 16:35:30 juju-e4d256-prod-github-runner-207 kernel: [40304.592795] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:35:30 juju-e4d256-prod-github-runner-207 kernel: [40304.593824] direct_page_fault+0x206/0x310 [kvm] Aug 22 16:35:30 juju-e4d256-prod-github-runner-207 kernel: [40304.594858] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 16:35:30 juju-e4d256-prod-github-runner-207 kernel: [40304.595870] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 16:35:30 juju-e4d256-prod-github-runner-207 kernel: [40304.596900] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 16:35:30 juju-e4d256-prod-github-runner-207 kernel: [40304.597939] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 16:35:30 juju-e4d256-prod-github-runner-207 kernel: [40304.598893] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 16:35:30 juju-e4d256-prod-github-runner-207 kernel: [40304.599875] handle_exit+0x98/0x230 [kvm_amd] Aug 22 16:35:30 juju-e4d256-prod-github-runner-207 kernel: [40304.600793] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 16:35:30 juju-e4d256-prod-github-runner-207 kernel: [40304.601718] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 16:35:30 juju-e4d256-prod-github-runner-207 kernel: [40304.602646] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 16:35:30 juju-e4d256-prod-github-runner-207 kernel: [40304.603561] vcpu_run+0x62/0x2c0 [kvm] Aug 22 16:35:30 juju-e4d256-prod-github-runner-207 kernel: [40304.604402] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 16:35:30 juju-e4d256-prod-github-runner-207 kernel: [40304.605228] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 16:35:30 juju-e4d256-prod-github-runner-207 kernel: [40304.606086] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 16:35:30 juju-e4d256-prod-github-runner-207 kernel: [40304.606891] ? __seccomp_filter+0x4a/0x4a0 Aug 22 16:35:30 juju-e4d256-prod-github-runner-207 kernel: [40304.607650] ? __fget_files+0x86/0xc0 Aug 22 16:35:30 juju-e4d256-prod-github-runner-207 kernel: [40304.608389] __x64_sys_ioctl+0x95/0xd0 Aug 22 16:35:30 juju-e4d256-prod-github-runner-207 kernel: [40304.609084] do_syscall_64+0x5c/0xc0 Aug 22 16:35:30 juju-e4d256-prod-github-runner-207 kernel: [40304.609750] ? do_futex+0x162/0x1f0 Aug 22 16:35:30 juju-e4d256-prod-github-runner-207 kernel: [40304.610403] ? __x64_sys_futex+0x78/0x1e0 Aug 22 16:35:30 juju-e4d256-prod-github-runner-207 kernel: [40304.611088] ? __secure_computing+0xa9/0x120 Aug 22 16:35:30 juju-e4d256-prod-github-runner-207 kernel: [40304.611794] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 16:35:30 juju-e4d256-prod-github-runner-207 kernel: [40304.612568] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:35:30 juju-e4d256-prod-github-runner-207 kernel: [40304.613302] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:35:30 juju-e4d256-prod-github-runner-207 kernel: [40304.614029] ? do_syscall_64+0x69/0xc0 Aug 22 16:35:30 juju-e4d256-prod-github-runner-207 kernel: [40304.614676] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:35:30 juju-e4d256-prod-github-runner-207 kernel: [40304.615378] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:35:30 juju-e4d256-prod-github-runner-207 kernel: [40304.616070] ? do_syscall_64+0x69/0xc0 Aug 22 16:35:30 juju-e4d256-prod-github-runner-207 kernel: [40304.616721] ? do_syscall_64+0x69/0xc0 Aug 22 16:35:30 juju-e4d256-prod-github-runner-207 kernel: [40304.617346] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 16:35:30 juju-e4d256-prod-github-runner-207 kernel: [40304.618067] RIP: 0033:0x7faa5d0edaff Aug 22 16:35:30 juju-e4d256-prod-github-runner-207 kernel: [40304.618760] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 16:35:30 juju-e4d256-prod-github-runner-207 kernel: [40304.620782] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 16:35:30 juju-e4d256-prod-github-runner-207 kernel: [40304.621696] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 16:35:30 juju-e4d256-prod-github-runner-207 kernel: [40304.622590] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 16:35:30 juju-e4d256-prod-github-runner-207 kernel: [40304.623496] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 16:35:30 juju-e4d256-prod-github-runner-207 kernel: [40304.624405] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 16:35:30 juju-e4d256-prod-github-runner-207 kernel: [40304.625349] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 16:35:30 juju-e4d256-prod-github-runner-207 kernel: [40304.626249] Aug 22 16:35:45 juju-e4d256-prod-github-runner-207 kernel: [40319.876706] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 16:35:45 juju-e4d256-prod-github-runner-207 kernel: [40319.878383] rcu: 1-....: (10019116 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=4845093 Aug 22 16:35:45 juju-e4d256-prod-github-runner-207 kernel: [40319.879504] (t=10050669 jiffies g=23269 q=41049) Aug 22 16:35:45 juju-e4d256-prod-github-runner-207 kernel: [40319.880310] NMI backtrace for cpu 1 Aug 22 16:35:45 juju-e4d256-prod-github-runner-207 kernel: [40319.881035] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 16:35:45 juju-e4d256-prod-github-runner-207 kernel: [40319.882134] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 16:35:45 juju-e4d256-prod-github-runner-207 kernel: [40319.883191] Call Trace: Aug 22 16:35:45 juju-e4d256-prod-github-runner-207 kernel: [40319.883863] Aug 22 16:35:45 juju-e4d256-prod-github-runner-207 kernel: [40319.884530] show_stack+0x52/0x5c Aug 22 16:35:45 juju-e4d256-prod-github-runner-207 kernel: [40319.885254] dump_stack_lvl+0x4a/0x63 Aug 22 16:35:45 juju-e4d256-prod-github-runner-207 kernel: [40319.885998] dump_stack+0x10/0x16 Aug 22 16:35:45 juju-e4d256-prod-github-runner-207 kernel: [40319.886719] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 16:35:45 juju-e4d256-prod-github-runner-207 kernel: [40319.887496] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 16:35:45 juju-e4d256-prod-github-runner-207 kernel: [40319.888299] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 16:35:45 juju-e4d256-prod-github-runner-207 kernel: [40319.889121] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 16:35:45 juju-e4d256-prod-github-runner-207 kernel: [40319.889941] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 16:35:45 juju-e4d256-prod-github-runner-207 kernel: [40319.890757] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 16:35:45 juju-e4d256-prod-github-runner-207 kernel: [40319.891722] print_cpu_stall.cold+0x2f/0xe2 Aug 22 16:35:45 juju-e4d256-prod-github-runner-207 kernel: [40319.892525] ? timekeeping_update+0xf7/0x150 Aug 22 16:35:45 juju-e4d256-prod-github-runner-207 kernel: [40319.893303] check_cpu_stall+0x109/0x270 Aug 22 16:35:45 juju-e4d256-prod-github-runner-207 kernel: [40319.894051] rcu_sched_clock_irq+0x9a/0x250 Aug 22 16:35:45 juju-e4d256-prod-github-runner-207 kernel: [40319.894815] update_process_times+0x94/0xd0 Aug 22 16:35:45 juju-e4d256-prod-github-runner-207 kernel: [40319.895579] tick_sched_handle+0x29/0x70 Aug 22 16:35:45 juju-e4d256-prod-github-runner-207 kernel: [40319.896355] tick_sched_timer+0x8c/0xc0 Aug 22 16:35:45 juju-e4d256-prod-github-runner-207 kernel: [40319.897094] ? tick_nohz_handler+0xb0/0xb0 Aug 22 16:35:45 juju-e4d256-prod-github-runner-207 kernel: [40319.897853] __hrtimer_run_queues+0x107/0x230 Aug 22 16:35:45 juju-e4d256-prod-github-runner-207 kernel: [40319.898623] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 16:35:45 juju-e4d256-prod-github-runner-207 kernel: [40319.899395] hrtimer_interrupt+0x101/0x220 Aug 22 16:35:45 juju-e4d256-prod-github-runner-207 kernel: [40319.900167] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 16:35:45 juju-e4d256-prod-github-runner-207 kernel: [40319.900979] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 16:35:45 juju-e4d256-prod-github-runner-207 kernel: [40319.901785] Aug 22 16:35:45 juju-e4d256-prod-github-runner-207 kernel: [40319.902419] Aug 22 16:35:45 juju-e4d256-prod-github-runner-207 kernel: [40319.903048] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 16:35:45 juju-e4d256-prod-github-runner-207 kernel: [40319.903866] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:35:45 juju-e4d256-prod-github-runner-207 kernel: [40319.904763] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 16:35:45 juju-e4d256-prod-github-runner-207 kernel: [40319.906962] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 16:35:45 juju-e4d256-prod-github-runner-207 kernel: [40319.907834] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 16:35:45 juju-e4d256-prod-github-runner-207 kernel: [40319.908841] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 16:35:45 juju-e4d256-prod-github-runner-207 kernel: [40319.909814] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 16:35:45 juju-e4d256-prod-github-runner-207 kernel: [40319.910774] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 16:35:45 juju-e4d256-prod-github-runner-207 kernel: [40319.911733] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 16:35:45 juju-e4d256-prod-github-runner-207 kernel: [40319.912697] ? _raw_spin_lock+0x22/0x30 Aug 22 16:35:45 juju-e4d256-prod-github-runner-207 kernel: [40319.913464] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:35:45 juju-e4d256-prod-github-runner-207 kernel: [40319.914320] direct_page_fault+0x206/0x310 [kvm] Aug 22 16:35:45 juju-e4d256-prod-github-runner-207 kernel: [40319.915156] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 16:35:45 juju-e4d256-prod-github-runner-207 kernel: [40319.915988] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 16:35:45 juju-e4d256-prod-github-runner-207 kernel: [40319.916913] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 16:35:45 juju-e4d256-prod-github-runner-207 kernel: [40319.917744] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 16:35:45 juju-e4d256-prod-github-runner-207 kernel: [40319.918532] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 16:35:45 juju-e4d256-prod-github-runner-207 kernel: [40319.919353] handle_exit+0x98/0x230 [kvm_amd] Aug 22 16:35:45 juju-e4d256-prod-github-runner-207 kernel: [40319.920116] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 16:35:45 juju-e4d256-prod-github-runner-207 kernel: [40319.920962] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 16:35:45 juju-e4d256-prod-github-runner-207 kernel: [40319.921868] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 16:35:45 juju-e4d256-prod-github-runner-207 kernel: [40319.922654] vcpu_run+0x62/0x2c0 [kvm] Aug 22 16:35:45 juju-e4d256-prod-github-runner-207 kernel: [40319.923369] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 16:35:45 juju-e4d256-prod-github-runner-207 kernel: [40319.924989] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 16:35:45 juju-e4d256-prod-github-runner-207 kernel: [40319.925799] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 16:35:45 juju-e4d256-prod-github-runner-207 kernel: [40319.926557] ? __seccomp_filter+0x4a/0x4a0 Aug 22 16:35:45 juju-e4d256-prod-github-runner-207 kernel: [40319.927277] ? __fget_files+0x86/0xc0 Aug 22 16:35:45 juju-e4d256-prod-github-runner-207 kernel: [40319.927974] __x64_sys_ioctl+0x95/0xd0 Aug 22 16:35:45 juju-e4d256-prod-github-runner-207 kernel: [40319.928678] do_syscall_64+0x5c/0xc0 Aug 22 16:35:45 juju-e4d256-prod-github-runner-207 kernel: [40319.929357] ? do_futex+0x162/0x1f0 Aug 22 16:35:45 juju-e4d256-prod-github-runner-207 kernel: [40319.930031] ? __x64_sys_futex+0x78/0x1e0 Aug 22 16:35:45 juju-e4d256-prod-github-runner-207 kernel: [40319.930731] ? __secure_computing+0xa9/0x120 Aug 22 16:35:45 juju-e4d256-prod-github-runner-207 kernel: [40319.931443] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 16:35:45 juju-e4d256-prod-github-runner-207 kernel: [40319.932239] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:35:45 juju-e4d256-prod-github-runner-207 kernel: [40319.932992] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:35:45 juju-e4d256-prod-github-runner-207 kernel: [40319.933744] ? do_syscall_64+0x69/0xc0 Aug 22 16:35:45 juju-e4d256-prod-github-runner-207 kernel: [40319.934431] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:35:45 juju-e4d256-prod-github-runner-207 kernel: [40319.935185] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:35:45 juju-e4d256-prod-github-runner-207 kernel: [40319.935940] ? do_syscall_64+0x69/0xc0 Aug 22 16:35:45 juju-e4d256-prod-github-runner-207 kernel: [40319.936648] ? do_syscall_64+0x69/0xc0 Aug 22 16:35:45 juju-e4d256-prod-github-runner-207 kernel: [40319.937333] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 16:35:45 juju-e4d256-prod-github-runner-207 kernel: [40319.938101] RIP: 0033:0x7faa5d0edaff Aug 22 16:35:45 juju-e4d256-prod-github-runner-207 kernel: [40319.938806] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 16:35:45 juju-e4d256-prod-github-runner-207 kernel: [40319.940924] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 16:35:45 juju-e4d256-prod-github-runner-207 kernel: [40319.941888] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 16:35:45 juju-e4d256-prod-github-runner-207 kernel: [40319.942833] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 16:35:45 juju-e4d256-prod-github-runner-207 kernel: [40319.943774] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 16:35:45 juju-e4d256-prod-github-runner-207 kernel: [40319.944726] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 16:35:45 juju-e4d256-prod-github-runner-207 kernel: [40319.945650] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 16:35:45 juju-e4d256-prod-github-runner-207 kernel: [40319.946561] Aug 22 16:36:10 juju-e4d256-prod-github-runner-207 kernel: [40344.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 37465s! [qemu-system-x86:6715] Aug 22 16:36:10 juju-e4d256-prod-github-runner-207 kernel: [40344.543819] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 16:36:10 juju-e4d256-prod-github-runner-207 kernel: [40344.544085] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 16:36:10 juju-e4d256-prod-github-runner-207 kernel: [40344.556377] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 16:36:10 juju-e4d256-prod-github-runner-207 kernel: [40344.557688] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 16:36:10 juju-e4d256-prod-github-runner-207 kernel: [40344.558915] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:36:10 juju-e4d256-prod-github-runner-207 kernel: [40344.560023] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 16:36:10 juju-e4d256-prod-github-runner-207 kernel: [40344.562585] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 16:36:10 juju-e4d256-prod-github-runner-207 kernel: [40344.563628] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 16:36:10 juju-e4d256-prod-github-runner-207 kernel: [40344.564843] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 16:36:10 juju-e4d256-prod-github-runner-207 kernel: [40344.566039] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 16:36:10 juju-e4d256-prod-github-runner-207 kernel: [40344.567197] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 16:36:10 juju-e4d256-prod-github-runner-207 kernel: [40344.568384] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 16:36:10 juju-e4d256-prod-github-runner-207 kernel: [40344.569575] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 16:36:10 juju-e4d256-prod-github-runner-207 kernel: [40344.570819] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 16:36:10 juju-e4d256-prod-github-runner-207 kernel: [40344.571940] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 16:36:10 juju-e4d256-prod-github-runner-207 kernel: [40344.573151] Call Trace: Aug 22 16:36:10 juju-e4d256-prod-github-runner-207 kernel: [40344.574071] Aug 22 16:36:10 juju-e4d256-prod-github-runner-207 kernel: [40344.574971] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:36:10 juju-e4d256-prod-github-runner-207 kernel: [40344.576046] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:36:10 juju-e4d256-prod-github-runner-207 kernel: [40344.577078] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:36:10 juju-e4d256-prod-github-runner-207 kernel: [40344.578184] ? show_regs.part.0+0x23/0x29 Aug 22 16:36:10 juju-e4d256-prod-github-runner-207 kernel: [40344.579183] ? show_regs.cold+0x8/0xd Aug 22 16:36:10 juju-e4d256-prod-github-runner-207 kernel: [40344.580320] ? watchdog_timer_fn+0x1be/0x220 Aug 22 16:36:10 juju-e4d256-prod-github-runner-207 kernel: [40344.581346] ? lockup_detector_update_enable+0x60/0x60 Aug 22 16:36:10 juju-e4d256-prod-github-runner-207 kernel: [40344.582417] ? __hrtimer_run_queues+0x107/0x230 Aug 22 16:36:10 juju-e4d256-prod-github-runner-207 kernel: [40344.583743] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 16:36:10 juju-e4d256-prod-github-runner-207 kernel: [40344.584795] ? hrtimer_interrupt+0x101/0x220 Aug 22 16:36:10 juju-e4d256-prod-github-runner-207 kernel: [40344.585879] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 16:36:10 juju-e4d256-prod-github-runner-207 kernel: [40344.586957] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 16:36:10 juju-e4d256-prod-github-runner-207 kernel: [40344.588042] Aug 22 16:36:10 juju-e4d256-prod-github-runner-207 kernel: [40344.588905] Aug 22 16:36:10 juju-e4d256-prod-github-runner-207 kernel: [40344.589759] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 16:36:10 juju-e4d256-prod-github-runner-207 kernel: [40344.590821] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:36:10 juju-e4d256-prod-github-runner-207 kernel: [40344.591889] ? _raw_spin_lock+0x22/0x30 Aug 22 16:36:10 juju-e4d256-prod-github-runner-207 kernel: [40344.592849] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:36:10 juju-e4d256-prod-github-runner-207 kernel: [40344.593875] direct_page_fault+0x206/0x310 [kvm] Aug 22 16:36:10 juju-e4d256-prod-github-runner-207 kernel: [40344.594921] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 16:36:10 juju-e4d256-prod-github-runner-207 kernel: [40344.595984] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 16:36:10 juju-e4d256-prod-github-runner-207 kernel: [40344.597004] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 16:36:10 juju-e4d256-prod-github-runner-207 kernel: [40344.598015] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 16:36:10 juju-e4d256-prod-github-runner-207 kernel: [40344.598963] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 16:36:10 juju-e4d256-prod-github-runner-207 kernel: [40344.599973] handle_exit+0x98/0x230 [kvm_amd] Aug 22 16:36:10 juju-e4d256-prod-github-runner-207 kernel: [40344.600895] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 16:36:10 juju-e4d256-prod-github-runner-207 kernel: [40344.601830] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 16:36:10 juju-e4d256-prod-github-runner-207 kernel: [40344.602762] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 16:36:10 juju-e4d256-prod-github-runner-207 kernel: [40344.603670] vcpu_run+0x62/0x2c0 [kvm] Aug 22 16:36:10 juju-e4d256-prod-github-runner-207 kernel: [40344.604504] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 16:36:10 juju-e4d256-prod-github-runner-207 kernel: [40344.605332] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 16:36:10 juju-e4d256-prod-github-runner-207 kernel: [40344.606227] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 16:36:10 juju-e4d256-prod-github-runner-207 kernel: [40344.607033] ? __seccomp_filter+0x4a/0x4a0 Aug 22 16:36:10 juju-e4d256-prod-github-runner-207 kernel: [40344.607799] ? __fget_files+0x86/0xc0 Aug 22 16:36:10 juju-e4d256-prod-github-runner-207 kernel: [40344.608510] __x64_sys_ioctl+0x95/0xd0 Aug 22 16:36:10 juju-e4d256-prod-github-runner-207 kernel: [40344.609212] do_syscall_64+0x5c/0xc0 Aug 22 16:36:10 juju-e4d256-prod-github-runner-207 kernel: [40344.609886] ? do_futex+0x162/0x1f0 Aug 22 16:36:10 juju-e4d256-prod-github-runner-207 kernel: [40344.610546] ? __x64_sys_futex+0x78/0x1e0 Aug 22 16:36:10 juju-e4d256-prod-github-runner-207 kernel: [40344.611234] ? __secure_computing+0xa9/0x120 Aug 22 16:36:10 juju-e4d256-prod-github-runner-207 kernel: [40344.611954] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 16:36:10 juju-e4d256-prod-github-runner-207 kernel: [40344.612723] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:36:10 juju-e4d256-prod-github-runner-207 kernel: [40344.613448] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:36:10 juju-e4d256-prod-github-runner-207 kernel: [40344.614167] ? do_syscall_64+0x69/0xc0 Aug 22 16:36:10 juju-e4d256-prod-github-runner-207 kernel: [40344.614815] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:36:10 juju-e4d256-prod-github-runner-207 kernel: [40344.615528] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:36:10 juju-e4d256-prod-github-runner-207 kernel: [40344.616266] ? do_syscall_64+0x69/0xc0 Aug 22 16:36:10 juju-e4d256-prod-github-runner-207 kernel: [40344.616938] ? do_syscall_64+0x69/0xc0 Aug 22 16:36:10 juju-e4d256-prod-github-runner-207 kernel: [40344.617565] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 16:36:10 juju-e4d256-prod-github-runner-207 kernel: [40344.618273] RIP: 0033:0x7faa5d0edaff Aug 22 16:36:10 juju-e4d256-prod-github-runner-207 kernel: [40344.618929] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 16:36:10 juju-e4d256-prod-github-runner-207 kernel: [40344.620952] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 16:36:10 juju-e4d256-prod-github-runner-207 kernel: [40344.621883] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 16:36:10 juju-e4d256-prod-github-runner-207 kernel: [40344.622780] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 16:36:10 juju-e4d256-prod-github-runner-207 kernel: [40344.623675] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 16:36:10 juju-e4d256-prod-github-runner-207 kernel: [40344.624587] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 16:36:10 juju-e4d256-prod-github-runner-207 kernel: [40344.625487] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 16:36:10 juju-e4d256-prod-github-runner-207 kernel: [40344.626398] Aug 22 16:36:38 juju-e4d256-prod-github-runner-207 kernel: [40372.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 37491s! [qemu-system-x86:6715] Aug 22 16:36:38 juju-e4d256-prod-github-runner-207 kernel: [40372.543709] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 16:36:38 juju-e4d256-prod-github-runner-207 kernel: [40372.543945] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 16:36:38 juju-e4d256-prod-github-runner-207 kernel: [40372.556035] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 16:36:38 juju-e4d256-prod-github-runner-207 kernel: [40372.557316] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 16:36:38 juju-e4d256-prod-github-runner-207 kernel: [40372.558541] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:36:38 juju-e4d256-prod-github-runner-207 kernel: [40372.559609] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 16:36:38 juju-e4d256-prod-github-runner-207 kernel: [40372.562183] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 16:36:38 juju-e4d256-prod-github-runner-207 kernel: [40372.563230] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 16:36:38 juju-e4d256-prod-github-runner-207 kernel: [40372.564400] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 16:36:38 juju-e4d256-prod-github-runner-207 kernel: [40372.565561] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 16:36:38 juju-e4d256-prod-github-runner-207 kernel: [40372.566734] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 16:36:38 juju-e4d256-prod-github-runner-207 kernel: [40372.567909] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 16:36:38 juju-e4d256-prod-github-runner-207 kernel: [40372.569081] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 16:36:38 juju-e4d256-prod-github-runner-207 kernel: [40372.570314] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 16:36:38 juju-e4d256-prod-github-runner-207 kernel: [40372.571440] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 16:36:38 juju-e4d256-prod-github-runner-207 kernel: [40372.572642] Call Trace: Aug 22 16:36:38 juju-e4d256-prod-github-runner-207 kernel: [40372.573555] Aug 22 16:36:38 juju-e4d256-prod-github-runner-207 kernel: [40372.574451] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:36:38 juju-e4d256-prod-github-runner-207 kernel: [40372.575509] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:36:38 juju-e4d256-prod-github-runner-207 kernel: [40372.576547] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:36:38 juju-e4d256-prod-github-runner-207 kernel: [40372.577656] ? show_regs.part.0+0x23/0x29 Aug 22 16:36:38 juju-e4d256-prod-github-runner-207 kernel: [40372.578652] ? show_regs.cold+0x8/0xd Aug 22 16:36:38 juju-e4d256-prod-github-runner-207 kernel: [40372.579635] ? watchdog_timer_fn+0x1be/0x220 Aug 22 16:36:38 juju-e4d256-prod-github-runner-207 kernel: [40372.580641] ? lockup_detector_update_enable+0x60/0x60 Aug 22 16:36:38 juju-e4d256-prod-github-runner-207 kernel: [40372.581709] ? __hrtimer_run_queues+0x107/0x230 Aug 22 16:36:38 juju-e4d256-prod-github-runner-207 kernel: [40372.582739] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 16:36:38 juju-e4d256-prod-github-runner-207 kernel: [40372.583777] ? hrtimer_interrupt+0x101/0x220 Aug 22 16:36:38 juju-e4d256-prod-github-runner-207 kernel: [40372.584792] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 16:36:38 juju-e4d256-prod-github-runner-207 kernel: [40372.585860] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 16:36:38 juju-e4d256-prod-github-runner-207 kernel: [40372.586911] Aug 22 16:36:38 juju-e4d256-prod-github-runner-207 kernel: [40372.587935] Aug 22 16:36:38 juju-e4d256-prod-github-runner-207 kernel: [40372.588773] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 16:36:38 juju-e4d256-prod-github-runner-207 kernel: [40372.589805] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:36:38 juju-e4d256-prod-github-runner-207 kernel: [40372.590848] ? _raw_spin_lock+0x22/0x30 Aug 22 16:36:38 juju-e4d256-prod-github-runner-207 kernel: [40372.591816] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:36:38 juju-e4d256-prod-github-runner-207 kernel: [40372.592835] direct_page_fault+0x206/0x310 [kvm] Aug 22 16:36:38 juju-e4d256-prod-github-runner-207 kernel: [40372.593865] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 16:36:38 juju-e4d256-prod-github-runner-207 kernel: [40372.594873] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 16:36:38 juju-e4d256-prod-github-runner-207 kernel: [40372.595901] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 16:36:38 juju-e4d256-prod-github-runner-207 kernel: [40372.597060] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 16:36:38 juju-e4d256-prod-github-runner-207 kernel: [40372.598009] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 16:36:38 juju-e4d256-prod-github-runner-207 kernel: [40372.598986] handle_exit+0x98/0x230 [kvm_amd] Aug 22 16:36:38 juju-e4d256-prod-github-runner-207 kernel: [40372.599908] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 16:36:38 juju-e4d256-prod-github-runner-207 kernel: [40372.600825] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 16:36:38 juju-e4d256-prod-github-runner-207 kernel: [40372.601749] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 16:36:38 juju-e4d256-prod-github-runner-207 kernel: [40372.602671] vcpu_run+0x62/0x2c0 [kvm] Aug 22 16:36:38 juju-e4d256-prod-github-runner-207 kernel: [40372.603495] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 16:36:38 juju-e4d256-prod-github-runner-207 kernel: [40372.604304] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 16:36:38 juju-e4d256-prod-github-runner-207 kernel: [40372.605158] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 16:36:38 juju-e4d256-prod-github-runner-207 kernel: [40372.605954] ? __seccomp_filter+0x4a/0x4a0 Aug 22 16:36:38 juju-e4d256-prod-github-runner-207 kernel: [40372.606702] ? __fget_files+0x86/0xc0 Aug 22 16:36:38 juju-e4d256-prod-github-runner-207 kernel: [40372.607429] __x64_sys_ioctl+0x95/0xd0 Aug 22 16:36:38 juju-e4d256-prod-github-runner-207 kernel: [40372.608125] do_syscall_64+0x5c/0xc0 Aug 22 16:36:38 juju-e4d256-prod-github-runner-207 kernel: [40372.608795] ? do_futex+0x162/0x1f0 Aug 22 16:36:38 juju-e4d256-prod-github-runner-207 kernel: [40372.609449] ? __x64_sys_futex+0x78/0x1e0 Aug 22 16:36:38 juju-e4d256-prod-github-runner-207 kernel: [40372.610121] ? __secure_computing+0xa9/0x120 Aug 22 16:36:38 juju-e4d256-prod-github-runner-207 kernel: [40372.610810] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 16:36:38 juju-e4d256-prod-github-runner-207 kernel: [40372.611579] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:36:38 juju-e4d256-prod-github-runner-207 kernel: [40372.612311] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:36:38 juju-e4d256-prod-github-runner-207 kernel: [40372.613032] ? do_syscall_64+0x69/0xc0 Aug 22 16:36:38 juju-e4d256-prod-github-runner-207 kernel: [40372.613675] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:36:38 juju-e4d256-prod-github-runner-207 kernel: [40372.614377] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:36:38 juju-e4d256-prod-github-runner-207 kernel: [40372.615076] ? do_syscall_64+0x69/0xc0 Aug 22 16:36:38 juju-e4d256-prod-github-runner-207 kernel: [40372.615716] ? do_syscall_64+0x69/0xc0 Aug 22 16:36:38 juju-e4d256-prod-github-runner-207 kernel: [40372.616338] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 16:36:38 juju-e4d256-prod-github-runner-207 kernel: [40372.617042] RIP: 0033:0x7faa5d0edaff Aug 22 16:36:38 juju-e4d256-prod-github-runner-207 kernel: [40372.617704] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 16:36:38 juju-e4d256-prod-github-runner-207 kernel: [40372.619713] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 16:36:38 juju-e4d256-prod-github-runner-207 kernel: [40372.620625] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 16:36:38 juju-e4d256-prod-github-runner-207 kernel: [40372.621516] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 16:36:38 juju-e4d256-prod-github-runner-207 kernel: [40372.622406] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 16:36:38 juju-e4d256-prod-github-runner-207 kernel: [40372.623307] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 16:36:38 juju-e4d256-prod-github-runner-207 kernel: [40372.624233] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 16:36:38 juju-e4d256-prod-github-runner-207 kernel: [40372.625140] Aug 22 16:37:06 juju-e4d256-prod-github-runner-207 kernel: [40400.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 37517s! [qemu-system-x86:6715] Aug 22 16:37:06 juju-e4d256-prod-github-runner-207 kernel: [40400.544829] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 16:37:06 juju-e4d256-prod-github-runner-207 kernel: [40400.545186] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 16:37:06 juju-e4d256-prod-github-runner-207 kernel: [40400.559789] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 16:37:06 juju-e4d256-prod-github-runner-207 kernel: [40400.561056] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 16:37:06 juju-e4d256-prod-github-runner-207 kernel: [40400.562283] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:37:06 juju-e4d256-prod-github-runner-207 kernel: [40400.563352] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 16:37:06 juju-e4d256-prod-github-runner-207 kernel: [40400.565903] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 16:37:06 juju-e4d256-prod-github-runner-207 kernel: [40400.566945] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 16:37:06 juju-e4d256-prod-github-runner-207 kernel: [40400.568131] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 16:37:06 juju-e4d256-prod-github-runner-207 kernel: [40400.569794] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 16:37:06 juju-e4d256-prod-github-runner-207 kernel: [40400.571489] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 16:37:06 juju-e4d256-prod-github-runner-207 kernel: [40400.572902] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 16:37:06 juju-e4d256-prod-github-runner-207 kernel: [40400.574074] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 16:37:06 juju-e4d256-prod-github-runner-207 kernel: [40400.575324] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 16:37:06 juju-e4d256-prod-github-runner-207 kernel: [40400.576421] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 16:37:06 juju-e4d256-prod-github-runner-207 kernel: [40400.577615] Call Trace: Aug 22 16:37:06 juju-e4d256-prod-github-runner-207 kernel: [40400.578532] Aug 22 16:37:06 juju-e4d256-prod-github-runner-207 kernel: [40400.579441] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:37:06 juju-e4d256-prod-github-runner-207 kernel: [40400.580471] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:37:06 juju-e4d256-prod-github-runner-207 kernel: [40400.581498] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:37:06 juju-e4d256-prod-github-runner-207 kernel: [40400.582590] ? show_regs.part.0+0x23/0x29 Aug 22 16:37:06 juju-e4d256-prod-github-runner-207 kernel: [40400.583598] ? show_regs.cold+0x8/0xd Aug 22 16:37:06 juju-e4d256-prod-github-runner-207 kernel: [40400.584570] ? watchdog_timer_fn+0x1be/0x220 Aug 22 16:37:06 juju-e4d256-prod-github-runner-207 kernel: [40400.585579] ? lockup_detector_update_enable+0x60/0x60 Aug 22 16:37:06 juju-e4d256-prod-github-runner-207 kernel: [40400.586639] ? __hrtimer_run_queues+0x107/0x230 Aug 22 16:37:06 juju-e4d256-prod-github-runner-207 kernel: [40400.587776] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 16:37:06 juju-e4d256-prod-github-runner-207 kernel: [40400.588807] ? hrtimer_interrupt+0x101/0x220 Aug 22 16:37:06 juju-e4d256-prod-github-runner-207 kernel: [40400.589824] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 16:37:06 juju-e4d256-prod-github-runner-207 kernel: [40400.590892] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 16:37:06 juju-e4d256-prod-github-runner-207 kernel: [40400.591957] Aug 22 16:37:06 juju-e4d256-prod-github-runner-207 kernel: [40400.592816] Aug 22 16:37:06 juju-e4d256-prod-github-runner-207 kernel: [40400.593659] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 16:37:06 juju-e4d256-prod-github-runner-207 kernel: [40400.594695] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:37:06 juju-e4d256-prod-github-runner-207 kernel: [40400.595739] ? _raw_spin_lock+0x22/0x30 Aug 22 16:37:06 juju-e4d256-prod-github-runner-207 kernel: [40400.596684] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:37:06 juju-e4d256-prod-github-runner-207 kernel: [40400.597706] direct_page_fault+0x206/0x310 [kvm] Aug 22 16:37:06 juju-e4d256-prod-github-runner-207 kernel: [40400.598731] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 16:37:06 juju-e4d256-prod-github-runner-207 kernel: [40400.599747] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 16:37:06 juju-e4d256-prod-github-runner-207 kernel: [40400.600752] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 16:37:06 juju-e4d256-prod-github-runner-207 kernel: [40400.601753] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 16:37:06 juju-e4d256-prod-github-runner-207 kernel: [40400.602705] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 16:37:06 juju-e4d256-prod-github-runner-207 kernel: [40400.603702] handle_exit+0x98/0x230 [kvm_amd] Aug 22 16:37:06 juju-e4d256-prod-github-runner-207 kernel: [40400.604594] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 16:37:06 juju-e4d256-prod-github-runner-207 kernel: [40400.605509] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 16:37:06 juju-e4d256-prod-github-runner-207 kernel: [40400.606438] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 16:37:06 juju-e4d256-prod-github-runner-207 kernel: [40400.607347] vcpu_run+0x62/0x2c0 [kvm] Aug 22 16:37:06 juju-e4d256-prod-github-runner-207 kernel: [40400.608157] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 16:37:06 juju-e4d256-prod-github-runner-207 kernel: [40400.608964] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 16:37:06 juju-e4d256-prod-github-runner-207 kernel: [40400.609816] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 16:37:06 juju-e4d256-prod-github-runner-207 kernel: [40400.610611] ? __seccomp_filter+0x4a/0x4a0 Aug 22 16:37:06 juju-e4d256-prod-github-runner-207 kernel: [40400.611359] ? __fget_files+0x86/0xc0 Aug 22 16:37:06 juju-e4d256-prod-github-runner-207 kernel: [40400.612062] __x64_sys_ioctl+0x95/0xd0 Aug 22 16:37:06 juju-e4d256-prod-github-runner-207 kernel: [40400.612813] do_syscall_64+0x5c/0xc0 Aug 22 16:37:06 juju-e4d256-prod-github-runner-207 kernel: [40400.613551] ? do_futex+0x162/0x1f0 Aug 22 16:37:06 juju-e4d256-prod-github-runner-207 kernel: [40400.614199] ? __x64_sys_futex+0x78/0x1e0 Aug 22 16:37:06 juju-e4d256-prod-github-runner-207 kernel: [40400.614878] ? __secure_computing+0xa9/0x120 Aug 22 16:37:06 juju-e4d256-prod-github-runner-207 kernel: [40400.615578] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 16:37:06 juju-e4d256-prod-github-runner-207 kernel: [40400.616342] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:37:06 juju-e4d256-prod-github-runner-207 kernel: [40400.617063] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:37:06 juju-e4d256-prod-github-runner-207 kernel: [40400.617893] ? do_syscall_64+0x69/0xc0 Aug 22 16:37:06 juju-e4d256-prod-github-runner-207 kernel: [40400.618559] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:37:06 juju-e4d256-prod-github-runner-207 kernel: [40400.619271] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:37:06 juju-e4d256-prod-github-runner-207 kernel: [40400.620154] ? do_syscall_64+0x69/0xc0 Aug 22 16:37:06 juju-e4d256-prod-github-runner-207 kernel: [40400.620961] ? do_syscall_64+0x69/0xc0 Aug 22 16:37:06 juju-e4d256-prod-github-runner-207 kernel: [40400.621816] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 16:37:06 juju-e4d256-prod-github-runner-207 kernel: [40400.622821] RIP: 0033:0x7faa5d0edaff Aug 22 16:37:06 juju-e4d256-prod-github-runner-207 kernel: [40400.623742] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 16:37:06 juju-e4d256-prod-github-runner-207 kernel: [40400.626686] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 16:37:06 juju-e4d256-prod-github-runner-207 kernel: [40400.628051] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 16:37:06 juju-e4d256-prod-github-runner-207 kernel: [40400.629356] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 16:37:06 juju-e4d256-prod-github-runner-207 kernel: [40400.630650] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 16:37:06 juju-e4d256-prod-github-runner-207 kernel: [40400.631668] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 16:37:06 juju-e4d256-prod-github-runner-207 kernel: [40400.632556] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 16:37:06 juju-e4d256-prod-github-runner-207 kernel: [40400.633451] Aug 22 16:37:34 juju-e4d256-prod-github-runner-207 kernel: [40428.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 37544s! [qemu-system-x86:6715] Aug 22 16:37:34 juju-e4d256-prod-github-runner-207 kernel: [40428.543740] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 16:37:34 juju-e4d256-prod-github-runner-207 kernel: [40428.543996] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 16:37:34 juju-e4d256-prod-github-runner-207 kernel: [40428.556055] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 16:37:34 juju-e4d256-prod-github-runner-207 kernel: [40428.557321] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 16:37:34 juju-e4d256-prod-github-runner-207 kernel: [40428.558546] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:37:34 juju-e4d256-prod-github-runner-207 kernel: [40428.559623] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 16:37:34 juju-e4d256-prod-github-runner-207 kernel: [40428.562177] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 16:37:34 juju-e4d256-prod-github-runner-207 kernel: [40428.563231] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 16:37:34 juju-e4d256-prod-github-runner-207 kernel: [40428.564401] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 16:37:34 juju-e4d256-prod-github-runner-207 kernel: [40428.565564] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 16:37:34 juju-e4d256-prod-github-runner-207 kernel: [40428.566736] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 16:37:34 juju-e4d256-prod-github-runner-207 kernel: [40428.567903] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 16:37:34 juju-e4d256-prod-github-runner-207 kernel: [40428.569070] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 16:37:34 juju-e4d256-prod-github-runner-207 kernel: [40428.570304] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 16:37:34 juju-e4d256-prod-github-runner-207 kernel: [40428.571417] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 16:37:34 juju-e4d256-prod-github-runner-207 kernel: [40428.572612] Call Trace: Aug 22 16:37:34 juju-e4d256-prod-github-runner-207 kernel: [40428.573525] Aug 22 16:37:34 juju-e4d256-prod-github-runner-207 kernel: [40428.574421] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:37:34 juju-e4d256-prod-github-runner-207 kernel: [40428.575464] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:37:34 juju-e4d256-prod-github-runner-207 kernel: [40428.576484] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:37:34 juju-e4d256-prod-github-runner-207 kernel: [40428.577576] ? show_regs.part.0+0x23/0x29 Aug 22 16:37:34 juju-e4d256-prod-github-runner-207 kernel: [40428.578577] ? show_regs.cold+0x8/0xd Aug 22 16:37:34 juju-e4d256-prod-github-runner-207 kernel: [40428.579562] ? watchdog_timer_fn+0x1be/0x220 Aug 22 16:37:34 juju-e4d256-prod-github-runner-207 kernel: [40428.580576] ? lockup_detector_update_enable+0x60/0x60 Aug 22 16:37:34 juju-e4d256-prod-github-runner-207 kernel: [40428.581640] ? __hrtimer_run_queues+0x107/0x230 Aug 22 16:37:34 juju-e4d256-prod-github-runner-207 kernel: [40428.582670] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 16:37:34 juju-e4d256-prod-github-runner-207 kernel: [40428.583709] ? hrtimer_interrupt+0x101/0x220 Aug 22 16:37:34 juju-e4d256-prod-github-runner-207 kernel: [40428.584721] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 16:37:34 juju-e4d256-prod-github-runner-207 kernel: [40428.585790] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 16:37:34 juju-e4d256-prod-github-runner-207 kernel: [40428.586846] Aug 22 16:37:34 juju-e4d256-prod-github-runner-207 kernel: [40428.587699] Aug 22 16:37:34 juju-e4d256-prod-github-runner-207 kernel: [40428.588535] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 16:37:34 juju-e4d256-prod-github-runner-207 kernel: [40428.589569] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:37:34 juju-e4d256-prod-github-runner-207 kernel: [40428.590612] ? _raw_spin_lock+0x22/0x30 Aug 22 16:37:34 juju-e4d256-prod-github-runner-207 kernel: [40428.591568] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:37:34 juju-e4d256-prod-github-runner-207 kernel: [40428.592581] direct_page_fault+0x206/0x310 [kvm] Aug 22 16:37:34 juju-e4d256-prod-github-runner-207 kernel: [40428.593603] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 16:37:34 juju-e4d256-prod-github-runner-207 kernel: [40428.594609] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 16:37:34 juju-e4d256-prod-github-runner-207 kernel: [40428.595619] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 16:37:34 juju-e4d256-prod-github-runner-207 kernel: [40428.596603] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 16:37:34 juju-e4d256-prod-github-runner-207 kernel: [40428.597552] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 16:37:34 juju-e4d256-prod-github-runner-207 kernel: [40428.598530] handle_exit+0x98/0x230 [kvm_amd] Aug 22 16:37:34 juju-e4d256-prod-github-runner-207 kernel: [40428.599440] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 16:37:34 juju-e4d256-prod-github-runner-207 kernel: [40428.600353] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 16:37:34 juju-e4d256-prod-github-runner-207 kernel: [40428.601277] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 16:37:34 juju-e4d256-prod-github-runner-207 kernel: [40428.602181] vcpu_run+0x62/0x2c0 [kvm] Aug 22 16:37:34 juju-e4d256-prod-github-runner-207 kernel: [40428.603005] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 16:37:34 juju-e4d256-prod-github-runner-207 kernel: [40428.603811] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 16:37:34 juju-e4d256-prod-github-runner-207 kernel: [40428.604662] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 16:37:34 juju-e4d256-prod-github-runner-207 kernel: [40428.605458] ? __seccomp_filter+0x4a/0x4a0 Aug 22 16:37:34 juju-e4d256-prod-github-runner-207 kernel: [40428.606201] ? __fget_files+0x86/0xc0 Aug 22 16:37:34 juju-e4d256-prod-github-runner-207 kernel: [40428.606921] __x64_sys_ioctl+0x95/0xd0 Aug 22 16:37:34 juju-e4d256-prod-github-runner-207 kernel: [40428.607615] do_syscall_64+0x5c/0xc0 Aug 22 16:37:34 juju-e4d256-prod-github-runner-207 kernel: [40428.608280] ? do_futex+0x162/0x1f0 Aug 22 16:37:34 juju-e4d256-prod-github-runner-207 kernel: [40428.608927] ? __x64_sys_futex+0x78/0x1e0 Aug 22 16:37:34 juju-e4d256-prod-github-runner-207 kernel: [40428.609600] ? __secure_computing+0xa9/0x120 Aug 22 16:37:34 juju-e4d256-prod-github-runner-207 kernel: [40428.610288] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 16:37:34 juju-e4d256-prod-github-runner-207 kernel: [40428.611057] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:37:34 juju-e4d256-prod-github-runner-207 kernel: [40428.611784] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:37:34 juju-e4d256-prod-github-runner-207 kernel: [40428.612501] ? do_syscall_64+0x69/0xc0 Aug 22 16:37:34 juju-e4d256-prod-github-runner-207 kernel: [40428.613145] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:37:34 juju-e4d256-prod-github-runner-207 kernel: [40428.613846] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:37:34 juju-e4d256-prod-github-runner-207 kernel: [40428.614539] ? do_syscall_64+0x69/0xc0 Aug 22 16:37:34 juju-e4d256-prod-github-runner-207 kernel: [40428.615177] ? do_syscall_64+0x69/0xc0 Aug 22 16:37:34 juju-e4d256-prod-github-runner-207 kernel: [40428.615805] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 16:37:34 juju-e4d256-prod-github-runner-207 kernel: [40428.616508] RIP: 0033:0x7faa5d0edaff Aug 22 16:37:34 juju-e4d256-prod-github-runner-207 kernel: [40428.617154] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 16:37:34 juju-e4d256-prod-github-runner-207 kernel: [40428.619150] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 16:37:34 juju-e4d256-prod-github-runner-207 kernel: [40428.620061] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 16:37:34 juju-e4d256-prod-github-runner-207 kernel: [40428.620954] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 16:37:34 juju-e4d256-prod-github-runner-207 kernel: [40428.621842] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 16:37:34 juju-e4d256-prod-github-runner-207 kernel: [40428.622739] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 16:37:34 juju-e4d256-prod-github-runner-207 kernel: [40428.623626] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 16:37:34 juju-e4d256-prod-github-runner-207 kernel: [40428.624517] Aug 22 16:38:02 juju-e4d256-prod-github-runner-207 kernel: [40456.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 37570s! [qemu-system-x86:6715] Aug 22 16:38:02 juju-e4d256-prod-github-runner-207 kernel: [40456.543724] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 16:38:02 juju-e4d256-prod-github-runner-207 kernel: [40456.543985] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 16:38:02 juju-e4d256-prod-github-runner-207 kernel: [40456.556151] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 16:38:02 juju-e4d256-prod-github-runner-207 kernel: [40456.557421] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 16:38:02 juju-e4d256-prod-github-runner-207 kernel: [40456.558649] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:38:02 juju-e4d256-prod-github-runner-207 kernel: [40456.559718] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 16:38:02 juju-e4d256-prod-github-runner-207 kernel: [40456.562280] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 16:38:02 juju-e4d256-prod-github-runner-207 kernel: [40456.563334] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 16:38:02 juju-e4d256-prod-github-runner-207 kernel: [40456.564491] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 16:38:02 juju-e4d256-prod-github-runner-207 kernel: [40456.565654] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 16:38:02 juju-e4d256-prod-github-runner-207 kernel: [40456.566822] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 16:38:02 juju-e4d256-prod-github-runner-207 kernel: [40456.567993] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 16:38:02 juju-e4d256-prod-github-runner-207 kernel: [40456.569163] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 16:38:02 juju-e4d256-prod-github-runner-207 kernel: [40456.570409] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 16:38:02 juju-e4d256-prod-github-runner-207 kernel: [40456.571511] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 16:38:02 juju-e4d256-prod-github-runner-207 kernel: [40456.572700] Call Trace: Aug 22 16:38:02 juju-e4d256-prod-github-runner-207 kernel: [40456.573616] Aug 22 16:38:02 juju-e4d256-prod-github-runner-207 kernel: [40456.574520] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:38:02 juju-e4d256-prod-github-runner-207 kernel: [40456.575556] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:38:02 juju-e4d256-prod-github-runner-207 kernel: [40456.576581] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:38:02 juju-e4d256-prod-github-runner-207 kernel: [40456.577667] ? show_regs.part.0+0x23/0x29 Aug 22 16:38:02 juju-e4d256-prod-github-runner-207 kernel: [40456.578676] ? show_regs.cold+0x8/0xd Aug 22 16:38:02 juju-e4d256-prod-github-runner-207 kernel: [40456.579648] ? watchdog_timer_fn+0x1be/0x220 Aug 22 16:38:02 juju-e4d256-prod-github-runner-207 kernel: [40456.580662] ? lockup_detector_update_enable+0x60/0x60 Aug 22 16:38:02 juju-e4d256-prod-github-runner-207 kernel: [40456.581726] ? __hrtimer_run_queues+0x107/0x230 Aug 22 16:38:02 juju-e4d256-prod-github-runner-207 kernel: [40456.582766] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 16:38:02 juju-e4d256-prod-github-runner-207 kernel: [40456.583789] ? hrtimer_interrupt+0x101/0x220 Aug 22 16:38:02 juju-e4d256-prod-github-runner-207 kernel: [40456.584809] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 16:38:02 juju-e4d256-prod-github-runner-207 kernel: [40456.585883] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 16:38:02 juju-e4d256-prod-github-runner-207 kernel: [40456.586936] Aug 22 16:38:02 juju-e4d256-prod-github-runner-207 kernel: [40456.587789] Aug 22 16:38:02 juju-e4d256-prod-github-runner-207 kernel: [40456.588630] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 16:38:02 juju-e4d256-prod-github-runner-207 kernel: [40456.589664] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:38:02 juju-e4d256-prod-github-runner-207 kernel: [40456.590713] ? _raw_spin_lock+0x22/0x30 Aug 22 16:38:02 juju-e4d256-prod-github-runner-207 kernel: [40456.591664] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:38:02 juju-e4d256-prod-github-runner-207 kernel: [40456.592686] direct_page_fault+0x206/0x310 [kvm] Aug 22 16:38:02 juju-e4d256-prod-github-runner-207 kernel: [40456.593708] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 16:38:02 juju-e4d256-prod-github-runner-207 kernel: [40456.594723] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 16:38:02 juju-e4d256-prod-github-runner-207 kernel: [40456.595721] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 16:38:02 juju-e4d256-prod-github-runner-207 kernel: [40456.596722] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 16:38:02 juju-e4d256-prod-github-runner-207 kernel: [40456.597665] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 16:38:02 juju-e4d256-prod-github-runner-207 kernel: [40456.598655] handle_exit+0x98/0x230 [kvm_amd] Aug 22 16:38:02 juju-e4d256-prod-github-runner-207 kernel: [40456.599546] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 16:38:02 juju-e4d256-prod-github-runner-207 kernel: [40456.600460] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 16:38:02 juju-e4d256-prod-github-runner-207 kernel: [40456.601384] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 16:38:02 juju-e4d256-prod-github-runner-207 kernel: [40456.602291] vcpu_run+0x62/0x2c0 [kvm] Aug 22 16:38:02 juju-e4d256-prod-github-runner-207 kernel: [40456.603114] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 16:38:02 juju-e4d256-prod-github-runner-207 kernel: [40456.603919] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 16:38:02 juju-e4d256-prod-github-runner-207 kernel: [40456.604777] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 16:38:02 juju-e4d256-prod-github-runner-207 kernel: [40456.605574] ? __seccomp_filter+0x4a/0x4a0 Aug 22 16:38:02 juju-e4d256-prod-github-runner-207 kernel: [40456.606319] ? __fget_files+0x86/0xc0 Aug 22 16:38:02 juju-e4d256-prod-github-runner-207 kernel: [40456.607031] __x64_sys_ioctl+0x95/0xd0 Aug 22 16:38:02 juju-e4d256-prod-github-runner-207 kernel: [40456.607723] do_syscall_64+0x5c/0xc0 Aug 22 16:38:02 juju-e4d256-prod-github-runner-207 kernel: [40456.608389] ? do_futex+0x162/0x1f0 Aug 22 16:38:02 juju-e4d256-prod-github-runner-207 kernel: [40456.609040] ? __x64_sys_futex+0x78/0x1e0 Aug 22 16:38:02 juju-e4d256-prod-github-runner-207 kernel: [40456.609711] ? __secure_computing+0xa9/0x120 Aug 22 16:38:02 juju-e4d256-prod-github-runner-207 kernel: [40456.610406] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 16:38:02 juju-e4d256-prod-github-runner-207 kernel: [40456.611309] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:38:02 juju-e4d256-prod-github-runner-207 kernel: [40456.612129] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:38:02 juju-e4d256-prod-github-runner-207 kernel: [40456.612948] ? do_syscall_64+0x69/0xc0 Aug 22 16:38:02 juju-e4d256-prod-github-runner-207 kernel: [40456.613668] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:38:02 juju-e4d256-prod-github-runner-207 kernel: [40456.614478] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:38:02 juju-e4d256-prod-github-runner-207 kernel: [40456.615270] ? do_syscall_64+0x69/0xc0 Aug 22 16:38:02 juju-e4d256-prod-github-runner-207 kernel: [40456.615965] ? do_syscall_64+0x69/0xc0 Aug 22 16:38:02 juju-e4d256-prod-github-runner-207 kernel: [40456.616658] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 16:38:02 juju-e4d256-prod-github-runner-207 kernel: [40456.617462] RIP: 0033:0x7faa5d0edaff Aug 22 16:38:02 juju-e4d256-prod-github-runner-207 kernel: [40456.618187] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 16:38:02 juju-e4d256-prod-github-runner-207 kernel: [40456.620499] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 16:38:02 juju-e4d256-prod-github-runner-207 kernel: [40456.621549] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 16:38:02 juju-e4d256-prod-github-runner-207 kernel: [40456.622582] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 16:38:02 juju-e4d256-prod-github-runner-207 kernel: [40456.623601] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 16:38:02 juju-e4d256-prod-github-runner-207 kernel: [40456.624620] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 16:38:02 juju-e4d256-prod-github-runner-207 kernel: [40456.625650] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 16:38:02 juju-e4d256-prod-github-runner-207 kernel: [40456.626687] Aug 22 16:38:30 juju-e4d256-prod-github-runner-207 kernel: [40484.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 37596s! [qemu-system-x86:6715] Aug 22 16:38:30 juju-e4d256-prod-github-runner-207 kernel: [40484.543814] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 16:38:30 juju-e4d256-prod-github-runner-207 kernel: [40484.544085] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 16:38:30 juju-e4d256-prod-github-runner-207 kernel: [40484.556278] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 16:38:30 juju-e4d256-prod-github-runner-207 kernel: [40484.557559] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 16:38:30 juju-e4d256-prod-github-runner-207 kernel: [40484.558795] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:38:30 juju-e4d256-prod-github-runner-207 kernel: [40484.559857] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 16:38:30 juju-e4d256-prod-github-runner-207 kernel: [40484.562423] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 16:38:30 juju-e4d256-prod-github-runner-207 kernel: [40484.563469] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 16:38:30 juju-e4d256-prod-github-runner-207 kernel: [40484.564627] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 16:38:30 juju-e4d256-prod-github-runner-207 kernel: [40484.565784] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 16:38:30 juju-e4d256-prod-github-runner-207 kernel: [40484.566958] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 16:38:30 juju-e4d256-prod-github-runner-207 kernel: [40484.568120] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 16:38:30 juju-e4d256-prod-github-runner-207 kernel: [40484.569284] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 16:38:30 juju-e4d256-prod-github-runner-207 kernel: [40484.570537] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 16:38:30 juju-e4d256-prod-github-runner-207 kernel: [40484.571653] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 16:38:30 juju-e4d256-prod-github-runner-207 kernel: [40484.572844] Call Trace: Aug 22 16:38:30 juju-e4d256-prod-github-runner-207 kernel: [40484.573758] Aug 22 16:38:30 juju-e4d256-prod-github-runner-207 kernel: [40484.574682] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:38:30 juju-e4d256-prod-github-runner-207 kernel: [40484.575979] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:38:30 juju-e4d256-prod-github-runner-207 kernel: [40484.577020] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:38:30 juju-e4d256-prod-github-runner-207 kernel: [40484.578127] ? show_regs.part.0+0x23/0x29 Aug 22 16:38:30 juju-e4d256-prod-github-runner-207 kernel: [40484.579156] ? show_regs.cold+0x8/0xd Aug 22 16:38:30 juju-e4d256-prod-github-runner-207 kernel: [40484.580146] ? watchdog_timer_fn+0x1be/0x220 Aug 22 16:38:30 juju-e4d256-prod-github-runner-207 kernel: [40484.581159] ? lockup_detector_update_enable+0x60/0x60 Aug 22 16:38:30 juju-e4d256-prod-github-runner-207 kernel: [40484.582246] ? __hrtimer_run_queues+0x107/0x230 Aug 22 16:38:30 juju-e4d256-prod-github-runner-207 kernel: [40484.583282] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 16:38:30 juju-e4d256-prod-github-runner-207 kernel: [40484.584320] ? hrtimer_interrupt+0x101/0x220 Aug 22 16:38:30 juju-e4d256-prod-github-runner-207 kernel: [40484.585349] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 16:38:30 juju-e4d256-prod-github-runner-207 kernel: [40484.586440] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 16:38:30 juju-e4d256-prod-github-runner-207 kernel: [40484.587496] Aug 22 16:38:30 juju-e4d256-prod-github-runner-207 kernel: [40484.588353] Aug 22 16:38:30 juju-e4d256-prod-github-runner-207 kernel: [40484.589208] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 16:38:30 juju-e4d256-prod-github-runner-207 kernel: [40484.590275] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:38:30 juju-e4d256-prod-github-runner-207 kernel: [40484.591331] ? _raw_spin_lock+0x22/0x30 Aug 22 16:38:30 juju-e4d256-prod-github-runner-207 kernel: [40484.592282] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:38:30 juju-e4d256-prod-github-runner-207 kernel: [40484.593303] direct_page_fault+0x206/0x310 [kvm] Aug 22 16:38:30 juju-e4d256-prod-github-runner-207 kernel: [40484.594361] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 16:38:30 juju-e4d256-prod-github-runner-207 kernel: [40484.595394] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 16:38:30 juju-e4d256-prod-github-runner-207 kernel: [40484.596403] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 16:38:30 juju-e4d256-prod-github-runner-207 kernel: [40484.597399] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 16:38:30 juju-e4d256-prod-github-runner-207 kernel: [40484.598367] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 16:38:30 juju-e4d256-prod-github-runner-207 kernel: [40484.599367] handle_exit+0x98/0x230 [kvm_amd] Aug 22 16:38:30 juju-e4d256-prod-github-runner-207 kernel: [40484.600278] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 16:38:30 juju-e4d256-prod-github-runner-207 kernel: [40484.601207] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 16:38:30 juju-e4d256-prod-github-runner-207 kernel: [40484.602151] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 16:38:30 juju-e4d256-prod-github-runner-207 kernel: [40484.603119] vcpu_run+0x62/0x2c0 [kvm] Aug 22 16:38:30 juju-e4d256-prod-github-runner-207 kernel: [40484.603939] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 16:38:30 juju-e4d256-prod-github-runner-207 kernel: [40484.604757] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 16:38:30 juju-e4d256-prod-github-runner-207 kernel: [40484.605632] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 16:38:30 juju-e4d256-prod-github-runner-207 kernel: [40484.606453] ? __seccomp_filter+0x4a/0x4a0 Aug 22 16:38:30 juju-e4d256-prod-github-runner-207 kernel: [40484.607212] ? __fget_files+0x86/0xc0 Aug 22 16:38:30 juju-e4d256-prod-github-runner-207 kernel: [40484.608126] __x64_sys_ioctl+0x95/0xd0 Aug 22 16:38:30 juju-e4d256-prod-github-runner-207 kernel: [40484.609009] do_syscall_64+0x5c/0xc0 Aug 22 16:38:30 juju-e4d256-prod-github-runner-207 kernel: [40484.609862] ? do_futex+0x162/0x1f0 Aug 22 16:38:30 juju-e4d256-prod-github-runner-207 kernel: [40484.610769] ? __x64_sys_futex+0x78/0x1e0 Aug 22 16:38:30 juju-e4d256-prod-github-runner-207 kernel: [40484.611713] ? __secure_computing+0xa9/0x120 Aug 22 16:38:30 juju-e4d256-prod-github-runner-207 kernel: [40484.612444] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 16:38:30 juju-e4d256-prod-github-runner-207 kernel: [40484.613208] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:38:30 juju-e4d256-prod-github-runner-207 kernel: [40484.613932] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:38:30 juju-e4d256-prod-github-runner-207 kernel: [40484.614688] ? do_syscall_64+0x69/0xc0 Aug 22 16:38:30 juju-e4d256-prod-github-runner-207 kernel: [40484.615346] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:38:30 juju-e4d256-prod-github-runner-207 kernel: [40484.616072] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:38:30 juju-e4d256-prod-github-runner-207 kernel: [40484.616770] ? do_syscall_64+0x69/0xc0 Aug 22 16:38:30 juju-e4d256-prod-github-runner-207 kernel: [40484.617403] ? do_syscall_64+0x69/0xc0 Aug 22 16:38:30 juju-e4d256-prod-github-runner-207 kernel: [40484.618042] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 16:38:30 juju-e4d256-prod-github-runner-207 kernel: [40484.618764] RIP: 0033:0x7faa5d0edaff Aug 22 16:38:30 juju-e4d256-prod-github-runner-207 kernel: [40484.619416] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 16:38:30 juju-e4d256-prod-github-runner-207 kernel: [40484.621442] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 16:38:30 juju-e4d256-prod-github-runner-207 kernel: [40484.622381] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 16:38:30 juju-e4d256-prod-github-runner-207 kernel: [40484.623295] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 16:38:30 juju-e4d256-prod-github-runner-207 kernel: [40484.624186] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 16:38:30 juju-e4d256-prod-github-runner-207 kernel: [40484.625081] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 16:38:30 juju-e4d256-prod-github-runner-207 kernel: [40484.625988] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 16:38:30 juju-e4d256-prod-github-runner-207 kernel: [40484.626912] Aug 22 16:38:45 juju-e4d256-prod-github-runner-207 kernel: [40499.888704] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 16:38:45 juju-e4d256-prod-github-runner-207 kernel: [40499.889657] rcu: 1-....: (10063976 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=4867108 Aug 22 16:38:45 juju-e4d256-prod-github-runner-207 kernel: [40499.890824] (t=10095672 jiffies g=23269 q=41151) Aug 22 16:38:45 juju-e4d256-prod-github-runner-207 kernel: [40499.891614] NMI backtrace for cpu 1 Aug 22 16:38:45 juju-e4d256-prod-github-runner-207 kernel: [40499.892321] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 16:38:45 juju-e4d256-prod-github-runner-207 kernel: [40499.893432] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 16:38:45 juju-e4d256-prod-github-runner-207 kernel: [40499.894500] Call Trace: Aug 22 16:38:45 juju-e4d256-prod-github-runner-207 kernel: [40499.895172] Aug 22 16:38:45 juju-e4d256-prod-github-runner-207 kernel: [40499.895850] show_stack+0x52/0x5c Aug 22 16:38:45 juju-e4d256-prod-github-runner-207 kernel: [40499.896572] dump_stack_lvl+0x4a/0x63 Aug 22 16:38:45 juju-e4d256-prod-github-runner-207 kernel: [40499.897317] dump_stack+0x10/0x16 Aug 22 16:38:45 juju-e4d256-prod-github-runner-207 kernel: [40499.898066] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 16:38:45 juju-e4d256-prod-github-runner-207 kernel: [40499.898846] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 16:38:45 juju-e4d256-prod-github-runner-207 kernel: [40499.899628] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 16:38:45 juju-e4d256-prod-github-runner-207 kernel: [40499.900445] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 16:38:45 juju-e4d256-prod-github-runner-207 kernel: [40499.901264] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 16:38:45 juju-e4d256-prod-github-runner-207 kernel: [40499.902084] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 16:38:45 juju-e4d256-prod-github-runner-207 kernel: [40499.902860] print_cpu_stall.cold+0x2f/0xe2 Aug 22 16:38:45 juju-e4d256-prod-github-runner-207 kernel: [40499.903623] ? timekeeping_update+0xf7/0x150 Aug 22 16:38:45 juju-e4d256-prod-github-runner-207 kernel: [40499.904401] check_cpu_stall+0x109/0x270 Aug 22 16:38:45 juju-e4d256-prod-github-runner-207 kernel: [40499.905155] rcu_sched_clock_irq+0x9a/0x250 Aug 22 16:38:45 juju-e4d256-prod-github-runner-207 kernel: [40499.905928] update_process_times+0x94/0xd0 Aug 22 16:38:45 juju-e4d256-prod-github-runner-207 kernel: [40499.906687] tick_sched_handle+0x29/0x70 Aug 22 16:38:45 juju-e4d256-prod-github-runner-207 kernel: [40499.907429] tick_sched_timer+0x8c/0xc0 Aug 22 16:38:45 juju-e4d256-prod-github-runner-207 kernel: [40499.908162] ? tick_nohz_handler+0xb0/0xb0 Aug 22 16:38:45 juju-e4d256-prod-github-runner-207 kernel: [40499.908915] __hrtimer_run_queues+0x107/0x230 Aug 22 16:38:45 juju-e4d256-prod-github-runner-207 kernel: [40499.909683] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 16:38:45 juju-e4d256-prod-github-runner-207 kernel: [40499.910461] hrtimer_interrupt+0x101/0x220 Aug 22 16:38:45 juju-e4d256-prod-github-runner-207 kernel: [40499.911216] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 16:38:45 juju-e4d256-prod-github-runner-207 kernel: [40499.912061] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 16:38:45 juju-e4d256-prod-github-runner-207 kernel: [40499.912863] Aug 22 16:38:45 juju-e4d256-prod-github-runner-207 kernel: [40499.913495] Aug 22 16:38:45 juju-e4d256-prod-github-runner-207 kernel: [40499.914128] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 16:38:45 juju-e4d256-prod-github-runner-207 kernel: [40499.914945] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:38:45 juju-e4d256-prod-github-runner-207 kernel: [40499.915825] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 16:38:45 juju-e4d256-prod-github-runner-207 kernel: [40499.918035] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 16:38:45 juju-e4d256-prod-github-runner-207 kernel: [40499.918904] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 16:38:45 juju-e4d256-prod-github-runner-207 kernel: [40499.919893] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 16:38:45 juju-e4d256-prod-github-runner-207 kernel: [40499.920863] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 16:38:45 juju-e4d256-prod-github-runner-207 kernel: [40499.921820] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 16:38:45 juju-e4d256-prod-github-runner-207 kernel: [40499.922782] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 16:38:45 juju-e4d256-prod-github-runner-207 kernel: [40499.923730] ? _raw_spin_lock+0x22/0x30 Aug 22 16:38:45 juju-e4d256-prod-github-runner-207 kernel: [40499.924490] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:38:45 juju-e4d256-prod-github-runner-207 kernel: [40499.925323] direct_page_fault+0x206/0x310 [kvm] Aug 22 16:38:45 juju-e4d256-prod-github-runner-207 kernel: [40499.926170] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 16:38:45 juju-e4d256-prod-github-runner-207 kernel: [40499.926996] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 16:38:45 juju-e4d256-prod-github-runner-207 kernel: [40499.927839] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 16:38:45 juju-e4d256-prod-github-runner-207 kernel: [40499.928658] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 16:38:45 juju-e4d256-prod-github-runner-207 kernel: [40499.929447] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 16:38:45 juju-e4d256-prod-github-runner-207 kernel: [40499.930283] handle_exit+0x98/0x230 [kvm_amd] Aug 22 16:38:45 juju-e4d256-prod-github-runner-207 kernel: [40499.931035] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 16:38:45 juju-e4d256-prod-github-runner-207 kernel: [40499.931820] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 16:38:45 juju-e4d256-prod-github-runner-207 kernel: [40499.932615] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 16:38:45 juju-e4d256-prod-github-runner-207 kernel: [40499.933397] vcpu_run+0x62/0x2c0 [kvm] Aug 22 16:38:45 juju-e4d256-prod-github-runner-207 kernel: [40499.934122] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 16:38:45 juju-e4d256-prod-github-runner-207 kernel: [40499.934859] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 16:38:45 juju-e4d256-prod-github-runner-207 kernel: [40499.935657] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 16:38:45 juju-e4d256-prod-github-runner-207 kernel: [40499.936420] ? __seccomp_filter+0x4a/0x4a0 Aug 22 16:38:45 juju-e4d256-prod-github-runner-207 kernel: [40499.937137] ? __fget_files+0x86/0xc0 Aug 22 16:38:45 juju-e4d256-prod-github-runner-207 kernel: [40499.937894] __x64_sys_ioctl+0x95/0xd0 Aug 22 16:38:45 juju-e4d256-prod-github-runner-207 kernel: [40499.938586] do_syscall_64+0x5c/0xc0 Aug 22 16:38:45 juju-e4d256-prod-github-runner-207 kernel: [40499.939264] ? do_futex+0x162/0x1f0 Aug 22 16:38:45 juju-e4d256-prod-github-runner-207 kernel: [40499.939934] ? __x64_sys_futex+0x78/0x1e0 Aug 22 16:38:45 juju-e4d256-prod-github-runner-207 kernel: [40499.940639] ? __secure_computing+0xa9/0x120 Aug 22 16:38:45 juju-e4d256-prod-github-runner-207 kernel: [40499.941354] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 16:38:45 juju-e4d256-prod-github-runner-207 kernel: [40499.942154] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:38:45 juju-e4d256-prod-github-runner-207 kernel: [40499.942906] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:38:45 juju-e4d256-prod-github-runner-207 kernel: [40499.943656] ? do_syscall_64+0x69/0xc0 Aug 22 16:38:45 juju-e4d256-prod-github-runner-207 kernel: [40499.944344] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:38:45 juju-e4d256-prod-github-runner-207 kernel: [40499.945099] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:38:45 juju-e4d256-prod-github-runner-207 kernel: [40499.945869] ? do_syscall_64+0x69/0xc0 Aug 22 16:38:45 juju-e4d256-prod-github-runner-207 kernel: [40499.946565] ? do_syscall_64+0x69/0xc0 Aug 22 16:38:45 juju-e4d256-prod-github-runner-207 kernel: [40499.947248] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 16:38:45 juju-e4d256-prod-github-runner-207 kernel: [40499.948060] RIP: 0033:0x7faa5d0edaff Aug 22 16:38:45 juju-e4d256-prod-github-runner-207 kernel: [40499.948764] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 16:38:45 juju-e4d256-prod-github-runner-207 kernel: [40499.950866] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 16:38:45 juju-e4d256-prod-github-runner-207 kernel: [40499.951827] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 16:38:45 juju-e4d256-prod-github-runner-207 kernel: [40499.952769] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 16:38:45 juju-e4d256-prod-github-runner-207 kernel: [40499.953713] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 16:38:45 juju-e4d256-prod-github-runner-207 kernel: [40499.954656] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 16:38:45 juju-e4d256-prod-github-runner-207 kernel: [40499.955576] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 16:38:45 juju-e4d256-prod-github-runner-207 kernel: [40499.956489] Aug 22 16:39:10 juju-e4d256-prod-github-runner-207 kernel: [40524.541976] watchdog: BUG: soft lockup - CPU#1 stuck for 37633s! [qemu-system-x86:6715] Aug 22 16:39:10 juju-e4d256-prod-github-runner-207 kernel: [40524.543138] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 16:39:10 juju-e4d256-prod-github-runner-207 kernel: [40524.543202] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 16:39:10 juju-e4d256-prod-github-runner-207 kernel: [40524.555288] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 16:39:10 juju-e4d256-prod-github-runner-207 kernel: [40524.556554] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 16:39:10 juju-e4d256-prod-github-runner-207 kernel: [40524.557790] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:39:10 juju-e4d256-prod-github-runner-207 kernel: [40524.558848] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 16:39:10 juju-e4d256-prod-github-runner-207 kernel: [40524.561406] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 16:39:10 juju-e4d256-prod-github-runner-207 kernel: [40524.562463] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 16:39:10 juju-e4d256-prod-github-runner-207 kernel: [40524.563630] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 16:39:10 juju-e4d256-prod-github-runner-207 kernel: [40524.564794] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 16:39:10 juju-e4d256-prod-github-runner-207 kernel: [40524.565965] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 16:39:10 juju-e4d256-prod-github-runner-207 kernel: [40524.567132] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 16:39:10 juju-e4d256-prod-github-runner-207 kernel: [40524.568301] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 16:39:10 juju-e4d256-prod-github-runner-207 kernel: [40524.569540] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 16:39:10 juju-e4d256-prod-github-runner-207 kernel: [40524.570653] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 16:39:10 juju-e4d256-prod-github-runner-207 kernel: [40524.571890] Call Trace: Aug 22 16:39:10 juju-e4d256-prod-github-runner-207 kernel: [40524.573056] Aug 22 16:39:10 juju-e4d256-prod-github-runner-207 kernel: [40524.573957] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:39:10 juju-e4d256-prod-github-runner-207 kernel: [40524.575217] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:39:10 juju-e4d256-prod-github-runner-207 kernel: [40524.576236] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:39:10 juju-e4d256-prod-github-runner-207 kernel: [40524.577314] ? show_regs.part.0+0x23/0x29 Aug 22 16:39:10 juju-e4d256-prod-github-runner-207 kernel: [40524.578325] ? show_regs.cold+0x8/0xd Aug 22 16:39:10 juju-e4d256-prod-github-runner-207 kernel: [40524.579296] ? watchdog_timer_fn+0x1be/0x220 Aug 22 16:39:10 juju-e4d256-prod-github-runner-207 kernel: [40524.580302] ? lockup_detector_update_enable+0x60/0x60 Aug 22 16:39:10 juju-e4d256-prod-github-runner-207 kernel: [40524.581364] ? __hrtimer_run_queues+0x107/0x230 Aug 22 16:39:10 juju-e4d256-prod-github-runner-207 kernel: [40524.582621] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 16:39:10 juju-e4d256-prod-github-runner-207 kernel: [40524.583911] ? hrtimer_interrupt+0x101/0x220 Aug 22 16:39:10 juju-e4d256-prod-github-runner-207 kernel: [40524.584937] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 16:39:10 juju-e4d256-prod-github-runner-207 kernel: [40524.586019] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 16:39:10 juju-e4d256-prod-github-runner-207 kernel: [40524.587070] Aug 22 16:39:10 juju-e4d256-prod-github-runner-207 kernel: [40524.587921] Aug 22 16:39:10 juju-e4d256-prod-github-runner-207 kernel: [40524.588756] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 16:39:10 juju-e4d256-prod-github-runner-207 kernel: [40524.589793] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:39:10 juju-e4d256-prod-github-runner-207 kernel: [40524.590830] ? _raw_spin_lock+0x22/0x30 Aug 22 16:39:10 juju-e4d256-prod-github-runner-207 kernel: [40524.591775] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:39:10 juju-e4d256-prod-github-runner-207 kernel: [40524.592798] direct_page_fault+0x206/0x310 [kvm] Aug 22 16:39:10 juju-e4d256-prod-github-runner-207 kernel: [40524.593826] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 16:39:10 juju-e4d256-prod-github-runner-207 kernel: [40524.594835] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 16:39:10 juju-e4d256-prod-github-runner-207 kernel: [40524.595839] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 16:39:10 juju-e4d256-prod-github-runner-207 kernel: [40524.596810] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 16:39:10 juju-e4d256-prod-github-runner-207 kernel: [40524.597770] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 16:39:10 juju-e4d256-prod-github-runner-207 kernel: [40524.598753] handle_exit+0x98/0x230 [kvm_amd] Aug 22 16:39:10 juju-e4d256-prod-github-runner-207 kernel: [40524.599645] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 16:39:10 juju-e4d256-prod-github-runner-207 kernel: [40524.600557] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 16:39:10 juju-e4d256-prod-github-runner-207 kernel: [40524.601486] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 16:39:10 juju-e4d256-prod-github-runner-207 kernel: [40524.602406] vcpu_run+0x62/0x2c0 [kvm] Aug 22 16:39:10 juju-e4d256-prod-github-runner-207 kernel: [40524.603217] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 16:39:10 juju-e4d256-prod-github-runner-207 kernel: [40524.604022] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 16:39:10 juju-e4d256-prod-github-runner-207 kernel: [40524.604879] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 16:39:10 juju-e4d256-prod-github-runner-207 kernel: [40524.605683] ? __seccomp_filter+0x4a/0x4a0 Aug 22 16:39:10 juju-e4d256-prod-github-runner-207 kernel: [40524.606424] ? __fget_files+0x86/0xc0 Aug 22 16:39:10 juju-e4d256-prod-github-runner-207 kernel: [40524.607127] __x64_sys_ioctl+0x95/0xd0 Aug 22 16:39:10 juju-e4d256-prod-github-runner-207 kernel: [40524.607823] do_syscall_64+0x5c/0xc0 Aug 22 16:39:10 juju-e4d256-prod-github-runner-207 kernel: [40524.608487] ? do_futex+0x162/0x1f0 Aug 22 16:39:10 juju-e4d256-prod-github-runner-207 kernel: [40524.609135] ? __x64_sys_futex+0x78/0x1e0 Aug 22 16:39:10 juju-e4d256-prod-github-runner-207 kernel: [40524.609820] ? __secure_computing+0xa9/0x120 Aug 22 16:39:10 juju-e4d256-prod-github-runner-207 kernel: [40524.610508] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 16:39:10 juju-e4d256-prod-github-runner-207 kernel: [40524.611288] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:39:10 juju-e4d256-prod-github-runner-207 kernel: [40524.612008] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:39:10 juju-e4d256-prod-github-runner-207 kernel: [40524.612724] ? do_syscall_64+0x69/0xc0 Aug 22 16:39:10 juju-e4d256-prod-github-runner-207 kernel: [40524.613366] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:39:10 juju-e4d256-prod-github-runner-207 kernel: [40524.614139] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:39:10 juju-e4d256-prod-github-runner-207 kernel: [40524.614832] ? do_syscall_64+0x69/0xc0 Aug 22 16:39:10 juju-e4d256-prod-github-runner-207 kernel: [40524.615455] ? do_syscall_64+0x69/0xc0 Aug 22 16:39:10 juju-e4d256-prod-github-runner-207 kernel: [40524.616080] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 16:39:10 juju-e4d256-prod-github-runner-207 kernel: [40524.616787] RIP: 0033:0x7faa5d0edaff Aug 22 16:39:10 juju-e4d256-prod-github-runner-207 kernel: [40524.617409] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 16:39:10 juju-e4d256-prod-github-runner-207 kernel: [40524.619401] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 16:39:10 juju-e4d256-prod-github-runner-207 kernel: [40524.620308] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 16:39:10 juju-e4d256-prod-github-runner-207 kernel: [40524.621202] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 16:39:10 juju-e4d256-prod-github-runner-207 kernel: [40524.622101] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 16:39:10 juju-e4d256-prod-github-runner-207 kernel: [40524.622986] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 16:39:10 juju-e4d256-prod-github-runner-207 kernel: [40524.623876] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 16:39:10 juju-e4d256-prod-github-runner-207 kernel: [40524.624766] Aug 22 16:39:38 juju-e4d256-prod-github-runner-207 kernel: [40552.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 37659s! [qemu-system-x86:6715] Aug 22 16:39:38 juju-e4d256-prod-github-runner-207 kernel: [40552.543683] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 16:39:38 juju-e4d256-prod-github-runner-207 kernel: [40552.543913] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 16:39:38 juju-e4d256-prod-github-runner-207 kernel: [40552.556134] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 16:39:38 juju-e4d256-prod-github-runner-207 kernel: [40552.557405] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 16:39:38 juju-e4d256-prod-github-runner-207 kernel: [40552.558631] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:39:38 juju-e4d256-prod-github-runner-207 kernel: [40552.559686] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 16:39:38 juju-e4d256-prod-github-runner-207 kernel: [40552.562243] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 16:39:38 juju-e4d256-prod-github-runner-207 kernel: [40552.563282] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 16:39:38 juju-e4d256-prod-github-runner-207 kernel: [40552.564445] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 16:39:38 juju-e4d256-prod-github-runner-207 kernel: [40552.565610] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 16:39:38 juju-e4d256-prod-github-runner-207 kernel: [40552.566810] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 16:39:38 juju-e4d256-prod-github-runner-207 kernel: [40552.567974] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 16:39:38 juju-e4d256-prod-github-runner-207 kernel: [40552.569137] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 16:39:38 juju-e4d256-prod-github-runner-207 kernel: [40552.570376] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 16:39:38 juju-e4d256-prod-github-runner-207 kernel: [40552.571475] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 16:39:38 juju-e4d256-prod-github-runner-207 kernel: [40552.572672] Call Trace: Aug 22 16:39:38 juju-e4d256-prod-github-runner-207 kernel: [40552.573601] Aug 22 16:39:38 juju-e4d256-prod-github-runner-207 kernel: [40552.574527] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:39:38 juju-e4d256-prod-github-runner-207 kernel: [40552.575553] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:39:38 juju-e4d256-prod-github-runner-207 kernel: [40552.576608] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:39:38 juju-e4d256-prod-github-runner-207 kernel: [40552.577739] ? show_regs.part.0+0x23/0x29 Aug 22 16:39:38 juju-e4d256-prod-github-runner-207 kernel: [40552.578735] ? show_regs.cold+0x8/0xd Aug 22 16:39:38 juju-e4d256-prod-github-runner-207 kernel: [40552.579702] ? watchdog_timer_fn+0x1be/0x220 Aug 22 16:39:38 juju-e4d256-prod-github-runner-207 kernel: [40552.580712] ? lockup_detector_update_enable+0x60/0x60 Aug 22 16:39:38 juju-e4d256-prod-github-runner-207 kernel: [40552.581781] ? __hrtimer_run_queues+0x107/0x230 Aug 22 16:39:38 juju-e4d256-prod-github-runner-207 kernel: [40552.582859] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 16:39:38 juju-e4d256-prod-github-runner-207 kernel: [40552.583880] ? hrtimer_interrupt+0x101/0x220 Aug 22 16:39:38 juju-e4d256-prod-github-runner-207 kernel: [40552.584891] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 16:39:38 juju-e4d256-prod-github-runner-207 kernel: [40552.585968] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 16:39:38 juju-e4d256-prod-github-runner-207 kernel: [40552.587012] Aug 22 16:39:38 juju-e4d256-prod-github-runner-207 kernel: [40552.587862] Aug 22 16:39:38 juju-e4d256-prod-github-runner-207 kernel: [40552.588697] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 16:39:38 juju-e4d256-prod-github-runner-207 kernel: [40552.589740] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:39:38 juju-e4d256-prod-github-runner-207 kernel: [40552.590781] ? _raw_spin_lock+0x22/0x30 Aug 22 16:39:38 juju-e4d256-prod-github-runner-207 kernel: [40552.591722] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:39:38 juju-e4d256-prod-github-runner-207 kernel: [40552.592734] direct_page_fault+0x206/0x310 [kvm] Aug 22 16:39:38 juju-e4d256-prod-github-runner-207 kernel: [40552.593773] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 16:39:38 juju-e4d256-prod-github-runner-207 kernel: [40552.594780] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 16:39:38 juju-e4d256-prod-github-runner-207 kernel: [40552.595776] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 16:39:38 juju-e4d256-prod-github-runner-207 kernel: [40552.596764] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 16:39:38 juju-e4d256-prod-github-runner-207 kernel: [40552.597734] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 16:39:38 juju-e4d256-prod-github-runner-207 kernel: [40552.598717] handle_exit+0x98/0x230 [kvm_amd] Aug 22 16:39:38 juju-e4d256-prod-github-runner-207 kernel: [40552.599611] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 16:39:38 juju-e4d256-prod-github-runner-207 kernel: [40552.600522] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 16:39:38 juju-e4d256-prod-github-runner-207 kernel: [40552.601453] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 16:39:38 juju-e4d256-prod-github-runner-207 kernel: [40552.602362] vcpu_run+0x62/0x2c0 [kvm] Aug 22 16:39:38 juju-e4d256-prod-github-runner-207 kernel: [40552.603172] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 16:39:38 juju-e4d256-prod-github-runner-207 kernel: [40552.603977] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 16:39:38 juju-e4d256-prod-github-runner-207 kernel: [40552.604828] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 16:39:38 juju-e4d256-prod-github-runner-207 kernel: [40552.605638] ? __seccomp_filter+0x4a/0x4a0 Aug 22 16:39:38 juju-e4d256-prod-github-runner-207 kernel: [40552.606379] ? __fget_files+0x86/0xc0 Aug 22 16:39:38 juju-e4d256-prod-github-runner-207 kernel: [40552.607084] __x64_sys_ioctl+0x95/0xd0 Aug 22 16:39:38 juju-e4d256-prod-github-runner-207 kernel: [40552.607775] do_syscall_64+0x5c/0xc0 Aug 22 16:39:38 juju-e4d256-prod-github-runner-207 kernel: [40552.608438] ? do_futex+0x162/0x1f0 Aug 22 16:39:38 juju-e4d256-prod-github-runner-207 kernel: [40552.609088] ? __x64_sys_futex+0x78/0x1e0 Aug 22 16:39:38 juju-e4d256-prod-github-runner-207 kernel: [40552.609769] ? __secure_computing+0xa9/0x120 Aug 22 16:39:38 juju-e4d256-prod-github-runner-207 kernel: [40552.610454] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 16:39:38 juju-e4d256-prod-github-runner-207 kernel: [40552.611209] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:39:38 juju-e4d256-prod-github-runner-207 kernel: [40552.611927] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:39:38 juju-e4d256-prod-github-runner-207 kernel: [40552.612640] ? do_syscall_64+0x69/0xc0 Aug 22 16:39:38 juju-e4d256-prod-github-runner-207 kernel: [40552.613294] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:39:38 juju-e4d256-prod-github-runner-207 kernel: [40552.613995] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:39:38 juju-e4d256-prod-github-runner-207 kernel: [40552.614687] ? do_syscall_64+0x69/0xc0 Aug 22 16:39:38 juju-e4d256-prod-github-runner-207 kernel: [40552.615309] ? do_syscall_64+0x69/0xc0 Aug 22 16:39:38 juju-e4d256-prod-github-runner-207 kernel: [40552.615930] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 16:39:38 juju-e4d256-prod-github-runner-207 kernel: [40552.616632] RIP: 0033:0x7faa5d0edaff Aug 22 16:39:38 juju-e4d256-prod-github-runner-207 kernel: [40552.617281] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 16:39:38 juju-e4d256-prod-github-runner-207 kernel: [40552.619265] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 16:39:38 juju-e4d256-prod-github-runner-207 kernel: [40552.620171] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 16:39:38 juju-e4d256-prod-github-runner-207 kernel: [40552.621062] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 16:39:38 juju-e4d256-prod-github-runner-207 kernel: [40552.621956] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 16:39:38 juju-e4d256-prod-github-runner-207 kernel: [40552.622843] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 16:39:38 juju-e4d256-prod-github-runner-207 kernel: [40552.623732] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 16:39:38 juju-e4d256-prod-github-runner-207 kernel: [40552.624626] Aug 22 16:40:06 juju-e4d256-prod-github-runner-207 kernel: [40580.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 37685s! [qemu-system-x86:6715] Aug 22 16:40:06 juju-e4d256-prod-github-runner-207 kernel: [40580.543099] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 16:40:06 juju-e4d256-prod-github-runner-207 kernel: [40580.543167] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 16:40:06 juju-e4d256-prod-github-runner-207 kernel: [40580.555254] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 16:40:06 juju-e4d256-prod-github-runner-207 kernel: [40580.556710] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 16:40:06 juju-e4d256-prod-github-runner-207 kernel: [40580.557943] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:40:06 juju-e4d256-prod-github-runner-207 kernel: [40580.559004] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 16:40:06 juju-e4d256-prod-github-runner-207 kernel: [40580.561565] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 16:40:06 juju-e4d256-prod-github-runner-207 kernel: [40580.562607] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 16:40:06 juju-e4d256-prod-github-runner-207 kernel: [40580.563766] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 16:40:06 juju-e4d256-prod-github-runner-207 kernel: [40580.564942] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 16:40:06 juju-e4d256-prod-github-runner-207 kernel: [40580.566113] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 16:40:06 juju-e4d256-prod-github-runner-207 kernel: [40580.567294] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 16:40:06 juju-e4d256-prod-github-runner-207 kernel: [40580.568471] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 16:40:06 juju-e4d256-prod-github-runner-207 kernel: [40580.571087] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 16:40:06 juju-e4d256-prod-github-runner-207 kernel: [40580.572192] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 16:40:06 juju-e4d256-prod-github-runner-207 kernel: [40580.573405] Call Trace: Aug 22 16:40:06 juju-e4d256-prod-github-runner-207 kernel: [40580.574331] Aug 22 16:40:06 juju-e4d256-prod-github-runner-207 kernel: [40580.575216] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:40:06 juju-e4d256-prod-github-runner-207 kernel: [40580.576287] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:40:06 juju-e4d256-prod-github-runner-207 kernel: [40580.577345] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:40:06 juju-e4d256-prod-github-runner-207 kernel: [40580.578434] ? show_regs.part.0+0x23/0x29 Aug 22 16:40:06 juju-e4d256-prod-github-runner-207 kernel: [40580.579437] ? show_regs.cold+0x8/0xd Aug 22 16:40:06 juju-e4d256-prod-github-runner-207 kernel: [40580.580407] ? watchdog_timer_fn+0x1be/0x220 Aug 22 16:40:06 juju-e4d256-prod-github-runner-207 kernel: [40580.581431] ? lockup_detector_update_enable+0x60/0x60 Aug 22 16:40:06 juju-e4d256-prod-github-runner-207 kernel: [40580.582497] ? __hrtimer_run_queues+0x107/0x230 Aug 22 16:40:06 juju-e4d256-prod-github-runner-207 kernel: [40580.583524] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 16:40:06 juju-e4d256-prod-github-runner-207 kernel: [40580.584546] ? hrtimer_interrupt+0x101/0x220 Aug 22 16:40:06 juju-e4d256-prod-github-runner-207 kernel: [40580.585619] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 16:40:06 juju-e4d256-prod-github-runner-207 kernel: [40580.586695] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 16:40:06 juju-e4d256-prod-github-runner-207 kernel: [40580.587758] Aug 22 16:40:06 juju-e4d256-prod-github-runner-207 kernel: [40580.588614] Aug 22 16:40:06 juju-e4d256-prod-github-runner-207 kernel: [40580.589463] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 16:40:06 juju-e4d256-prod-github-runner-207 kernel: [40580.590507] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:40:06 juju-e4d256-prod-github-runner-207 kernel: [40580.591543] ? _raw_spin_lock+0x22/0x30 Aug 22 16:40:06 juju-e4d256-prod-github-runner-207 kernel: [40580.592487] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:40:06 juju-e4d256-prod-github-runner-207 kernel: [40580.593525] direct_page_fault+0x206/0x310 [kvm] Aug 22 16:40:06 juju-e4d256-prod-github-runner-207 kernel: [40580.594551] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 16:40:06 juju-e4d256-prod-github-runner-207 kernel: [40580.595558] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 16:40:06 juju-e4d256-prod-github-runner-207 kernel: [40580.596563] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 16:40:06 juju-e4d256-prod-github-runner-207 kernel: [40580.597583] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 16:40:06 juju-e4d256-prod-github-runner-207 kernel: [40580.598576] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 16:40:06 juju-e4d256-prod-github-runner-207 kernel: [40580.599561] handle_exit+0x98/0x230 [kvm_amd] Aug 22 16:40:06 juju-e4d256-prod-github-runner-207 kernel: [40580.600473] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 16:40:06 juju-e4d256-prod-github-runner-207 kernel: [40580.601412] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 16:40:06 juju-e4d256-prod-github-runner-207 kernel: [40580.602340] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 16:40:06 juju-e4d256-prod-github-runner-207 kernel: [40580.603249] vcpu_run+0x62/0x2c0 [kvm] Aug 22 16:40:06 juju-e4d256-prod-github-runner-207 kernel: [40580.604059] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 16:40:06 juju-e4d256-prod-github-runner-207 kernel: [40580.604876] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 16:40:06 juju-e4d256-prod-github-runner-207 kernel: [40580.605739] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 16:40:06 juju-e4d256-prod-github-runner-207 kernel: [40580.606534] ? __seccomp_filter+0x4a/0x4a0 Aug 22 16:40:06 juju-e4d256-prod-github-runner-207 kernel: [40580.607282] ? __fget_files+0x86/0xc0 Aug 22 16:40:06 juju-e4d256-prod-github-runner-207 kernel: [40580.607987] __x64_sys_ioctl+0x95/0xd0 Aug 22 16:40:06 juju-e4d256-prod-github-runner-207 kernel: [40580.608694] do_syscall_64+0x5c/0xc0 Aug 22 16:40:06 juju-e4d256-prod-github-runner-207 kernel: [40580.609376] ? do_futex+0x162/0x1f0 Aug 22 16:40:06 juju-e4d256-prod-github-runner-207 kernel: [40580.610024] ? __x64_sys_futex+0x78/0x1e0 Aug 22 16:40:06 juju-e4d256-prod-github-runner-207 kernel: [40580.610697] ? __secure_computing+0xa9/0x120 Aug 22 16:40:06 juju-e4d256-prod-github-runner-207 kernel: [40580.611390] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 16:40:06 juju-e4d256-prod-github-runner-207 kernel: [40580.612159] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:40:06 juju-e4d256-prod-github-runner-207 kernel: [40580.612900] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:40:06 juju-e4d256-prod-github-runner-207 kernel: [40580.613628] ? do_syscall_64+0x69/0xc0 Aug 22 16:40:06 juju-e4d256-prod-github-runner-207 kernel: [40580.614274] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:40:06 juju-e4d256-prod-github-runner-207 kernel: [40580.614976] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:40:06 juju-e4d256-prod-github-runner-207 kernel: [40580.615671] ? do_syscall_64+0x69/0xc0 Aug 22 16:40:06 juju-e4d256-prod-github-runner-207 kernel: [40580.616293] ? do_syscall_64+0x69/0xc0 Aug 22 16:40:06 juju-e4d256-prod-github-runner-207 kernel: [40580.616927] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 16:40:06 juju-e4d256-prod-github-runner-207 kernel: [40580.617630] RIP: 0033:0x7faa5d0edaff Aug 22 16:40:06 juju-e4d256-prod-github-runner-207 kernel: [40580.618253] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 16:40:06 juju-e4d256-prod-github-runner-207 kernel: [40580.620273] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 16:40:06 juju-e4d256-prod-github-runner-207 kernel: [40580.621195] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 16:40:06 juju-e4d256-prod-github-runner-207 kernel: [40580.622091] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 16:40:06 juju-e4d256-prod-github-runner-207 kernel: [40580.623005] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 16:40:06 juju-e4d256-prod-github-runner-207 kernel: [40580.623890] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 16:40:06 juju-e4d256-prod-github-runner-207 kernel: [40580.624781] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 16:40:06 juju-e4d256-prod-github-runner-207 kernel: [40580.625685] Aug 22 16:40:34 juju-e4d256-prod-github-runner-207 kernel: [40608.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 37711s! [qemu-system-x86:6715] Aug 22 16:40:34 juju-e4d256-prod-github-runner-207 kernel: [40608.543731] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 16:40:34 juju-e4d256-prod-github-runner-207 kernel: [40608.543985] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 16:40:34 juju-e4d256-prod-github-runner-207 kernel: [40608.556051] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 16:40:34 juju-e4d256-prod-github-runner-207 kernel: [40608.557327] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 16:40:34 juju-e4d256-prod-github-runner-207 kernel: [40608.558553] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:40:34 juju-e4d256-prod-github-runner-207 kernel: [40608.559608] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 16:40:34 juju-e4d256-prod-github-runner-207 kernel: [40608.562165] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 16:40:34 juju-e4d256-prod-github-runner-207 kernel: [40608.563211] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 16:40:34 juju-e4d256-prod-github-runner-207 kernel: [40608.564370] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 16:40:34 juju-e4d256-prod-github-runner-207 kernel: [40608.565545] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 16:40:34 juju-e4d256-prod-github-runner-207 kernel: [40608.566706] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 16:40:34 juju-e4d256-prod-github-runner-207 kernel: [40608.567871] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 16:40:34 juju-e4d256-prod-github-runner-207 kernel: [40608.569044] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 16:40:34 juju-e4d256-prod-github-runner-207 kernel: [40608.570276] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 16:40:34 juju-e4d256-prod-github-runner-207 kernel: [40608.571374] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 16:40:34 juju-e4d256-prod-github-runner-207 kernel: [40608.572575] Call Trace: Aug 22 16:40:34 juju-e4d256-prod-github-runner-207 kernel: [40608.573491] Aug 22 16:40:34 juju-e4d256-prod-github-runner-207 kernel: [40608.574381] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:40:34 juju-e4d256-prod-github-runner-207 kernel: [40608.575414] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:40:34 juju-e4d256-prod-github-runner-207 kernel: [40608.576435] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:40:34 juju-e4d256-prod-github-runner-207 kernel: [40608.577536] ? show_regs.part.0+0x23/0x29 Aug 22 16:40:34 juju-e4d256-prod-github-runner-207 kernel: [40608.578530] ? show_regs.cold+0x8/0xd Aug 22 16:40:34 juju-e4d256-prod-github-runner-207 kernel: [40608.579498] ? watchdog_timer_fn+0x1be/0x220 Aug 22 16:40:34 juju-e4d256-prod-github-runner-207 kernel: [40608.580510] ? lockup_detector_update_enable+0x60/0x60 Aug 22 16:40:34 juju-e4d256-prod-github-runner-207 kernel: [40608.581585] ? __hrtimer_run_queues+0x107/0x230 Aug 22 16:40:34 juju-e4d256-prod-github-runner-207 kernel: [40608.582612] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 16:40:34 juju-e4d256-prod-github-runner-207 kernel: [40608.583639] ? hrtimer_interrupt+0x101/0x220 Aug 22 16:40:34 juju-e4d256-prod-github-runner-207 kernel: [40608.584661] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 16:40:34 juju-e4d256-prod-github-runner-207 kernel: [40608.585730] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 16:40:34 juju-e4d256-prod-github-runner-207 kernel: [40608.586781] Aug 22 16:40:34 juju-e4d256-prod-github-runner-207 kernel: [40608.587633] Aug 22 16:40:34 juju-e4d256-prod-github-runner-207 kernel: [40608.588469] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 16:40:34 juju-e4d256-prod-github-runner-207 kernel: [40608.589518] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:40:34 juju-e4d256-prod-github-runner-207 kernel: [40608.590560] ? _raw_spin_lock+0x22/0x30 Aug 22 16:40:34 juju-e4d256-prod-github-runner-207 kernel: [40608.591504] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:40:34 juju-e4d256-prod-github-runner-207 kernel: [40608.592518] direct_page_fault+0x206/0x310 [kvm] Aug 22 16:40:34 juju-e4d256-prod-github-runner-207 kernel: [40608.593568] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 16:40:34 juju-e4d256-prod-github-runner-207 kernel: [40608.594925] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 16:40:34 juju-e4d256-prod-github-runner-207 kernel: [40608.596331] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 16:40:34 juju-e4d256-prod-github-runner-207 kernel: [40608.597714] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 16:40:34 juju-e4d256-prod-github-runner-207 kernel: [40608.598708] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 16:40:34 juju-e4d256-prod-github-runner-207 kernel: [40608.599745] handle_exit+0x98/0x230 [kvm_amd] Aug 22 16:40:34 juju-e4d256-prod-github-runner-207 kernel: [40608.600664] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 16:40:34 juju-e4d256-prod-github-runner-207 kernel: [40608.601582] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 16:40:34 juju-e4d256-prod-github-runner-207 kernel: [40608.602531] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 16:40:34 juju-e4d256-prod-github-runner-207 kernel: [40608.603450] vcpu_run+0x62/0x2c0 [kvm] Aug 22 16:40:34 juju-e4d256-prod-github-runner-207 kernel: [40608.604376] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 16:40:34 juju-e4d256-prod-github-runner-207 kernel: [40608.605261] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 16:40:34 juju-e4d256-prod-github-runner-207 kernel: [40608.606207] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 16:40:34 juju-e4d256-prod-github-runner-207 kernel: [40608.607051] ? __seccomp_filter+0x4a/0x4a0 Aug 22 16:40:34 juju-e4d256-prod-github-runner-207 kernel: [40608.607863] ? __fget_files+0x86/0xc0 Aug 22 16:40:34 juju-e4d256-prod-github-runner-207 kernel: [40608.608636] __x64_sys_ioctl+0x95/0xd0 Aug 22 16:40:34 juju-e4d256-prod-github-runner-207 kernel: [40608.609353] do_syscall_64+0x5c/0xc0 Aug 22 16:40:34 juju-e4d256-prod-github-runner-207 kernel: [40608.610029] ? do_futex+0x162/0x1f0 Aug 22 16:40:34 juju-e4d256-prod-github-runner-207 kernel: [40608.610714] ? __x64_sys_futex+0x78/0x1e0 Aug 22 16:40:34 juju-e4d256-prod-github-runner-207 kernel: [40608.611402] ? __secure_computing+0xa9/0x120 Aug 22 16:40:34 juju-e4d256-prod-github-runner-207 kernel: [40608.612133] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 16:40:34 juju-e4d256-prod-github-runner-207 kernel: [40608.612972] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:40:34 juju-e4d256-prod-github-runner-207 kernel: [40608.613706] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:40:34 juju-e4d256-prod-github-runner-207 kernel: [40608.614433] ? do_syscall_64+0x69/0xc0 Aug 22 16:40:34 juju-e4d256-prod-github-runner-207 kernel: [40608.615108] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:40:34 juju-e4d256-prod-github-runner-207 kernel: [40608.615824] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:40:34 juju-e4d256-prod-github-runner-207 kernel: [40608.616567] ? do_syscall_64+0x69/0xc0 Aug 22 16:40:34 juju-e4d256-prod-github-runner-207 kernel: [40608.617239] ? do_syscall_64+0x69/0xc0 Aug 22 16:40:34 juju-e4d256-prod-github-runner-207 kernel: [40608.617873] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 16:40:34 juju-e4d256-prod-github-runner-207 kernel: [40608.618619] RIP: 0033:0x7faa5d0edaff Aug 22 16:40:34 juju-e4d256-prod-github-runner-207 kernel: [40608.619330] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 16:40:34 juju-e4d256-prod-github-runner-207 kernel: [40608.621411] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 16:40:34 juju-e4d256-prod-github-runner-207 kernel: [40608.622371] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 16:40:34 juju-e4d256-prod-github-runner-207 kernel: [40608.623302] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 16:40:34 juju-e4d256-prod-github-runner-207 kernel: [40608.624228] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 16:40:34 juju-e4d256-prod-github-runner-207 kernel: [40608.625175] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 16:40:34 juju-e4d256-prod-github-runner-207 kernel: [40608.626099] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 16:40:34 juju-e4d256-prod-github-runner-207 kernel: [40608.627048] Aug 22 16:41:02 juju-e4d256-prod-github-runner-207 kernel: [40636.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 37737s! [qemu-system-x86:6715] Aug 22 16:41:02 juju-e4d256-prod-github-runner-207 kernel: [40636.543099] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 16:41:02 juju-e4d256-prod-github-runner-207 kernel: [40636.543166] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 16:41:02 juju-e4d256-prod-github-runner-207 kernel: [40636.555219] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 16:41:02 juju-e4d256-prod-github-runner-207 kernel: [40636.556489] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 16:41:02 juju-e4d256-prod-github-runner-207 kernel: [40636.557712] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:41:02 juju-e4d256-prod-github-runner-207 kernel: [40636.558769] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 16:41:02 juju-e4d256-prod-github-runner-207 kernel: [40636.561336] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 16:41:02 juju-e4d256-prod-github-runner-207 kernel: [40636.562377] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 16:41:02 juju-e4d256-prod-github-runner-207 kernel: [40636.563540] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 16:41:02 juju-e4d256-prod-github-runner-207 kernel: [40636.564787] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 16:41:02 juju-e4d256-prod-github-runner-207 kernel: [40636.565946] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 16:41:02 juju-e4d256-prod-github-runner-207 kernel: [40636.567101] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 16:41:02 juju-e4d256-prod-github-runner-207 kernel: [40636.568272] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 16:41:02 juju-e4d256-prod-github-runner-207 kernel: [40636.569499] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 16:41:02 juju-e4d256-prod-github-runner-207 kernel: [40636.570592] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 16:41:02 juju-e4d256-prod-github-runner-207 kernel: [40636.571787] Call Trace: Aug 22 16:41:02 juju-e4d256-prod-github-runner-207 kernel: [40636.572703] Aug 22 16:41:02 juju-e4d256-prod-github-runner-207 kernel: [40636.573584] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:41:02 juju-e4d256-prod-github-runner-207 kernel: [40636.574609] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:41:02 juju-e4d256-prod-github-runner-207 kernel: [40636.575626] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:41:02 juju-e4d256-prod-github-runner-207 kernel: [40636.576702] ? show_regs.part.0+0x23/0x29 Aug 22 16:41:02 juju-e4d256-prod-github-runner-207 kernel: [40636.577695] ? show_regs.cold+0x8/0xd Aug 22 16:41:02 juju-e4d256-prod-github-runner-207 kernel: [40636.578741] ? watchdog_timer_fn+0x1be/0x220 Aug 22 16:41:02 juju-e4d256-prod-github-runner-207 kernel: [40636.579760] ? lockup_detector_update_enable+0x60/0x60 Aug 22 16:41:02 juju-e4d256-prod-github-runner-207 kernel: [40636.580833] ? __hrtimer_run_queues+0x107/0x230 Aug 22 16:41:02 juju-e4d256-prod-github-runner-207 kernel: [40636.581860] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 16:41:02 juju-e4d256-prod-github-runner-207 kernel: [40636.582881] ? hrtimer_interrupt+0x101/0x220 Aug 22 16:41:02 juju-e4d256-prod-github-runner-207 kernel: [40636.583894] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 16:41:02 juju-e4d256-prod-github-runner-207 kernel: [40636.584970] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 16:41:02 juju-e4d256-prod-github-runner-207 kernel: [40636.586019] Aug 22 16:41:02 juju-e4d256-prod-github-runner-207 kernel: [40636.586869] Aug 22 16:41:02 juju-e4d256-prod-github-runner-207 kernel: [40636.587704] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 16:41:02 juju-e4d256-prod-github-runner-207 kernel: [40636.588764] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:41:02 juju-e4d256-prod-github-runner-207 kernel: [40636.589850] ? _raw_spin_lock+0x22/0x30 Aug 22 16:41:02 juju-e4d256-prod-github-runner-207 kernel: [40636.590794] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:41:02 juju-e4d256-prod-github-runner-207 kernel: [40636.591809] direct_page_fault+0x206/0x310 [kvm] Aug 22 16:41:02 juju-e4d256-prod-github-runner-207 kernel: [40636.592849] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 16:41:02 juju-e4d256-prod-github-runner-207 kernel: [40636.593890] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 16:41:02 juju-e4d256-prod-github-runner-207 kernel: [40636.594946] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 16:41:02 juju-e4d256-prod-github-runner-207 kernel: [40636.595926] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 16:41:02 juju-e4d256-prod-github-runner-207 kernel: [40636.596892] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 16:41:02 juju-e4d256-prod-github-runner-207 kernel: [40636.597866] handle_exit+0x98/0x230 [kvm_amd] Aug 22 16:41:02 juju-e4d256-prod-github-runner-207 kernel: [40636.598754] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 16:41:02 juju-e4d256-prod-github-runner-207 kernel: [40636.599667] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 16:41:02 juju-e4d256-prod-github-runner-207 kernel: [40636.600602] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 16:41:02 juju-e4d256-prod-github-runner-207 kernel: [40636.601504] vcpu_run+0x62/0x2c0 [kvm] Aug 22 16:41:02 juju-e4d256-prod-github-runner-207 kernel: [40636.602312] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 16:41:02 juju-e4d256-prod-github-runner-207 kernel: [40636.603115] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 16:41:02 juju-e4d256-prod-github-runner-207 kernel: [40636.603963] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 16:41:02 juju-e4d256-prod-github-runner-207 kernel: [40636.604775] ? __seccomp_filter+0x4a/0x4a0 Aug 22 16:41:02 juju-e4d256-prod-github-runner-207 kernel: [40636.605517] ? __fget_files+0x86/0xc0 Aug 22 16:41:02 juju-e4d256-prod-github-runner-207 kernel: [40636.606239] __x64_sys_ioctl+0x95/0xd0 Aug 22 16:41:02 juju-e4d256-prod-github-runner-207 kernel: [40636.606930] do_syscall_64+0x5c/0xc0 Aug 22 16:41:02 juju-e4d256-prod-github-runner-207 kernel: [40636.607592] ? do_futex+0x162/0x1f0 Aug 22 16:41:02 juju-e4d256-prod-github-runner-207 kernel: [40636.608250] ? __x64_sys_futex+0x78/0x1e0 Aug 22 16:41:02 juju-e4d256-prod-github-runner-207 kernel: [40636.608927] ? __secure_computing+0xa9/0x120 Aug 22 16:41:02 juju-e4d256-prod-github-runner-207 kernel: [40636.609615] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 16:41:02 juju-e4d256-prod-github-runner-207 kernel: [40636.610371] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:41:02 juju-e4d256-prod-github-runner-207 kernel: [40636.611095] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:41:02 juju-e4d256-prod-github-runner-207 kernel: [40636.611811] ? do_syscall_64+0x69/0xc0 Aug 22 16:41:02 juju-e4d256-prod-github-runner-207 kernel: [40636.612467] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:41:02 juju-e4d256-prod-github-runner-207 kernel: [40636.613175] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:41:02 juju-e4d256-prod-github-runner-207 kernel: [40636.613868] ? do_syscall_64+0x69/0xc0 Aug 22 16:41:02 juju-e4d256-prod-github-runner-207 kernel: [40636.614490] ? do_syscall_64+0x69/0xc0 Aug 22 16:41:02 juju-e4d256-prod-github-runner-207 kernel: [40636.615110] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 16:41:02 juju-e4d256-prod-github-runner-207 kernel: [40636.615818] RIP: 0033:0x7faa5d0edaff Aug 22 16:41:02 juju-e4d256-prod-github-runner-207 kernel: [40636.616454] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 16:41:02 juju-e4d256-prod-github-runner-207 kernel: [40636.618432] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 16:41:02 juju-e4d256-prod-github-runner-207 kernel: [40636.619342] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 16:41:02 juju-e4d256-prod-github-runner-207 kernel: [40636.620234] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 16:41:02 juju-e4d256-prod-github-runner-207 kernel: [40636.621131] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 16:41:02 juju-e4d256-prod-github-runner-207 kernel: [40636.622023] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 16:41:02 juju-e4d256-prod-github-runner-207 kernel: [40636.622910] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 16:41:02 juju-e4d256-prod-github-runner-207 kernel: [40636.623842] Aug 22 16:41:30 juju-e4d256-prod-github-runner-207 kernel: [40664.541976] watchdog: BUG: soft lockup - CPU#1 stuck for 37763s! [qemu-system-x86:6715] Aug 22 16:41:30 juju-e4d256-prod-github-runner-207 kernel: [40664.543724] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 16:41:30 juju-e4d256-prod-github-runner-207 kernel: [40664.543980] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 16:41:30 juju-e4d256-prod-github-runner-207 kernel: [40664.556040] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 16:41:30 juju-e4d256-prod-github-runner-207 kernel: [40664.557311] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 16:41:30 juju-e4d256-prod-github-runner-207 kernel: [40664.558544] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:41:30 juju-e4d256-prod-github-runner-207 kernel: [40664.559646] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 16:41:30 juju-e4d256-prod-github-runner-207 kernel: [40664.562240] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 16:41:30 juju-e4d256-prod-github-runner-207 kernel: [40664.563282] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 16:41:30 juju-e4d256-prod-github-runner-207 kernel: [40664.564451] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 16:41:30 juju-e4d256-prod-github-runner-207 kernel: [40664.565609] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 16:41:30 juju-e4d256-prod-github-runner-207 kernel: [40664.566767] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 16:41:30 juju-e4d256-prod-github-runner-207 kernel: [40664.567937] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 16:41:30 juju-e4d256-prod-github-runner-207 kernel: [40664.569108] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 16:41:30 juju-e4d256-prod-github-runner-207 kernel: [40664.570337] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 16:41:30 juju-e4d256-prod-github-runner-207 kernel: [40664.571433] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 16:41:30 juju-e4d256-prod-github-runner-207 kernel: [40664.572640] Call Trace: Aug 22 16:41:30 juju-e4d256-prod-github-runner-207 kernel: [40664.573551] Aug 22 16:41:30 juju-e4d256-prod-github-runner-207 kernel: [40664.574446] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:41:30 juju-e4d256-prod-github-runner-207 kernel: [40664.575481] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:41:30 juju-e4d256-prod-github-runner-207 kernel: [40664.576584] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:41:30 juju-e4d256-prod-github-runner-207 kernel: [40664.577672] ? show_regs.part.0+0x23/0x29 Aug 22 16:41:30 juju-e4d256-prod-github-runner-207 kernel: [40664.578667] ? show_regs.cold+0x8/0xd Aug 22 16:41:30 juju-e4d256-prod-github-runner-207 kernel: [40664.579637] ? watchdog_timer_fn+0x1be/0x220 Aug 22 16:41:30 juju-e4d256-prod-github-runner-207 kernel: [40664.580807] ? lockup_detector_update_enable+0x60/0x60 Aug 22 16:41:30 juju-e4d256-prod-github-runner-207 kernel: [40664.581877] ? __hrtimer_run_queues+0x107/0x230 Aug 22 16:41:30 juju-e4d256-prod-github-runner-207 kernel: [40664.582908] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 16:41:30 juju-e4d256-prod-github-runner-207 kernel: [40664.583940] ? hrtimer_interrupt+0x101/0x220 Aug 22 16:41:30 juju-e4d256-prod-github-runner-207 kernel: [40664.584955] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 16:41:30 juju-e4d256-prod-github-runner-207 kernel: [40664.586021] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 16:41:30 juju-e4d256-prod-github-runner-207 kernel: [40664.587064] Aug 22 16:41:30 juju-e4d256-prod-github-runner-207 kernel: [40664.587924] Aug 22 16:41:30 juju-e4d256-prod-github-runner-207 kernel: [40664.588760] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 16:41:30 juju-e4d256-prod-github-runner-207 kernel: [40664.589792] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:41:30 juju-e4d256-prod-github-runner-207 kernel: [40664.590828] ? _raw_spin_lock+0x22/0x30 Aug 22 16:41:30 juju-e4d256-prod-github-runner-207 kernel: [40664.591776] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:41:30 juju-e4d256-prod-github-runner-207 kernel: [40664.592800] direct_page_fault+0x206/0x310 [kvm] Aug 22 16:41:30 juju-e4d256-prod-github-runner-207 kernel: [40664.593821] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 16:41:30 juju-e4d256-prod-github-runner-207 kernel: [40664.594832] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 16:41:30 juju-e4d256-prod-github-runner-207 kernel: [40664.595831] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 16:41:30 juju-e4d256-prod-github-runner-207 kernel: [40664.596836] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 16:41:30 juju-e4d256-prod-github-runner-207 kernel: [40664.597778] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 16:41:30 juju-e4d256-prod-github-runner-207 kernel: [40664.598754] handle_exit+0x98/0x230 [kvm_amd] Aug 22 16:41:30 juju-e4d256-prod-github-runner-207 kernel: [40664.599644] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 16:41:30 juju-e4d256-prod-github-runner-207 kernel: [40664.600567] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 16:41:30 juju-e4d256-prod-github-runner-207 kernel: [40664.601488] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 16:41:30 juju-e4d256-prod-github-runner-207 kernel: [40664.602388] vcpu_run+0x62/0x2c0 [kvm] Aug 22 16:41:30 juju-e4d256-prod-github-runner-207 kernel: [40664.603201] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 16:41:30 juju-e4d256-prod-github-runner-207 kernel: [40664.604016] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 16:41:30 juju-e4d256-prod-github-runner-207 kernel: [40664.604867] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 16:41:30 juju-e4d256-prod-github-runner-207 kernel: [40664.605661] ? __seccomp_filter+0x4a/0x4a0 Aug 22 16:41:30 juju-e4d256-prod-github-runner-207 kernel: [40664.606400] ? __fget_files+0x86/0xc0 Aug 22 16:41:30 juju-e4d256-prod-github-runner-207 kernel: [40664.607106] __x64_sys_ioctl+0x95/0xd0 Aug 22 16:41:30 juju-e4d256-prod-github-runner-207 kernel: [40664.607795] do_syscall_64+0x5c/0xc0 Aug 22 16:41:30 juju-e4d256-prod-github-runner-207 kernel: [40664.608468] ? do_futex+0x162/0x1f0 Aug 22 16:41:30 juju-e4d256-prod-github-runner-207 kernel: [40664.609116] ? __x64_sys_futex+0x78/0x1e0 Aug 22 16:41:30 juju-e4d256-prod-github-runner-207 kernel: [40664.609786] ? __secure_computing+0xa9/0x120 Aug 22 16:41:30 juju-e4d256-prod-github-runner-207 kernel: [40664.610472] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 16:41:30 juju-e4d256-prod-github-runner-207 kernel: [40664.611237] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:41:30 juju-e4d256-prod-github-runner-207 kernel: [40664.611963] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:41:30 juju-e4d256-prod-github-runner-207 kernel: [40664.612680] ? do_syscall_64+0x69/0xc0 Aug 22 16:41:30 juju-e4d256-prod-github-runner-207 kernel: [40664.613328] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:41:30 juju-e4d256-prod-github-runner-207 kernel: [40664.614028] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:41:30 juju-e4d256-prod-github-runner-207 kernel: [40664.614721] ? do_syscall_64+0x69/0xc0 Aug 22 16:41:30 juju-e4d256-prod-github-runner-207 kernel: [40664.615343] ? do_syscall_64+0x69/0xc0 Aug 22 16:41:30 juju-e4d256-prod-github-runner-207 kernel: [40664.615970] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 16:41:30 juju-e4d256-prod-github-runner-207 kernel: [40664.616673] RIP: 0033:0x7faa5d0edaff Aug 22 16:41:30 juju-e4d256-prod-github-runner-207 kernel: [40664.617318] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 16:41:30 juju-e4d256-prod-github-runner-207 kernel: [40664.619302] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 16:41:30 juju-e4d256-prod-github-runner-207 kernel: [40664.620219] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 16:41:30 juju-e4d256-prod-github-runner-207 kernel: [40664.621107] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 16:41:30 juju-e4d256-prod-github-runner-207 kernel: [40664.621998] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 16:41:30 juju-e4d256-prod-github-runner-207 kernel: [40664.622883] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 16:41:30 juju-e4d256-prod-github-runner-207 kernel: [40664.623768] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 16:41:30 juju-e4d256-prod-github-runner-207 kernel: [40664.624670] Aug 22 16:41:46 juju-e4d256-prod-github-runner-207 kernel: [40679.900705] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 16:41:46 juju-e4d256-prod-github-runner-207 kernel: [40679.901659] rcu: 1-....: (10108844 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=4889220 Aug 22 16:41:46 juju-e4d256-prod-github-runner-207 kernel: [40679.902788] (t=10140675 jiffies g=23269 q=41299) Aug 22 16:41:46 juju-e4d256-prod-github-runner-207 kernel: [40679.903576] NMI backtrace for cpu 1 Aug 22 16:41:46 juju-e4d256-prod-github-runner-207 kernel: [40679.904297] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 16:41:46 juju-e4d256-prod-github-runner-207 kernel: [40679.905422] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 16:41:46 juju-e4d256-prod-github-runner-207 kernel: [40679.906522] Call Trace: Aug 22 16:41:46 juju-e4d256-prod-github-runner-207 kernel: [40679.907194] Aug 22 16:41:46 juju-e4d256-prod-github-runner-207 kernel: [40679.907843] show_stack+0x52/0x5c Aug 22 16:41:46 juju-e4d256-prod-github-runner-207 kernel: [40679.908571] dump_stack_lvl+0x4a/0x63 Aug 22 16:41:46 juju-e4d256-prod-github-runner-207 kernel: [40679.909315] dump_stack+0x10/0x16 Aug 22 16:41:46 juju-e4d256-prod-github-runner-207 kernel: [40679.910052] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 16:41:46 juju-e4d256-prod-github-runner-207 kernel: [40679.910839] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 16:41:46 juju-e4d256-prod-github-runner-207 kernel: [40679.911623] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 16:41:46 juju-e4d256-prod-github-runner-207 kernel: [40679.912453] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 16:41:46 juju-e4d256-prod-github-runner-207 kernel: [40679.913276] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 16:41:46 juju-e4d256-prod-github-runner-207 kernel: [40679.914088] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 16:41:46 juju-e4d256-prod-github-runner-207 kernel: [40679.914894] print_cpu_stall.cold+0x2f/0xe2 Aug 22 16:41:46 juju-e4d256-prod-github-runner-207 kernel: [40679.915657] ? timekeeping_update+0xf7/0x150 Aug 22 16:41:46 juju-e4d256-prod-github-runner-207 kernel: [40679.916432] check_cpu_stall+0x109/0x270 Aug 22 16:41:46 juju-e4d256-prod-github-runner-207 kernel: [40679.917177] rcu_sched_clock_irq+0x9a/0x250 Aug 22 16:41:46 juju-e4d256-prod-github-runner-207 kernel: [40679.917935] update_process_times+0x94/0xd0 Aug 22 16:41:46 juju-e4d256-prod-github-runner-207 kernel: [40679.918692] tick_sched_handle+0x29/0x70 Aug 22 16:41:46 juju-e4d256-prod-github-runner-207 kernel: [40679.919437] tick_sched_timer+0x8c/0xc0 Aug 22 16:41:46 juju-e4d256-prod-github-runner-207 kernel: [40679.920184] ? tick_nohz_handler+0xb0/0xb0 Aug 22 16:41:46 juju-e4d256-prod-github-runner-207 kernel: [40679.920953] __hrtimer_run_queues+0x107/0x230 Aug 22 16:41:46 juju-e4d256-prod-github-runner-207 kernel: [40679.921732] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 16:41:46 juju-e4d256-prod-github-runner-207 kernel: [40679.922506] hrtimer_interrupt+0x101/0x220 Aug 22 16:41:46 juju-e4d256-prod-github-runner-207 kernel: [40679.923263] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 16:41:46 juju-e4d256-prod-github-runner-207 kernel: [40679.924084] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 16:41:46 juju-e4d256-prod-github-runner-207 kernel: [40679.924885] Aug 22 16:41:46 juju-e4d256-prod-github-runner-207 kernel: [40679.925521] Aug 22 16:41:46 juju-e4d256-prod-github-runner-207 kernel: [40679.926156] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 16:41:46 juju-e4d256-prod-github-runner-207 kernel: [40679.926975] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:41:46 juju-e4d256-prod-github-runner-207 kernel: [40679.927871] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 16:41:46 juju-e4d256-prod-github-runner-207 kernel: [40679.930085] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 16:41:46 juju-e4d256-prod-github-runner-207 kernel: [40679.930965] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 16:41:46 juju-e4d256-prod-github-runner-207 kernel: [40679.931973] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 16:41:46 juju-e4d256-prod-github-runner-207 kernel: [40679.932952] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 16:41:46 juju-e4d256-prod-github-runner-207 kernel: [40679.933922] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 16:41:46 juju-e4d256-prod-github-runner-207 kernel: [40679.934881] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 16:41:46 juju-e4d256-prod-github-runner-207 kernel: [40679.935883] ? _raw_spin_lock+0x22/0x30 Aug 22 16:41:46 juju-e4d256-prod-github-runner-207 kernel: [40679.936639] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:41:46 juju-e4d256-prod-github-runner-207 kernel: [40679.937481] direct_page_fault+0x206/0x310 [kvm] Aug 22 16:41:46 juju-e4d256-prod-github-runner-207 kernel: [40679.938362] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 16:41:46 juju-e4d256-prod-github-runner-207 kernel: [40679.939188] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 16:41:46 juju-e4d256-prod-github-runner-207 kernel: [40679.940018] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 16:41:46 juju-e4d256-prod-github-runner-207 kernel: [40679.940819] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 16:41:46 juju-e4d256-prod-github-runner-207 kernel: [40679.941601] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 16:41:46 juju-e4d256-prod-github-runner-207 kernel: [40679.942419] handle_exit+0x98/0x230 [kvm_amd] Aug 22 16:41:46 juju-e4d256-prod-github-runner-207 kernel: [40679.943175] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 16:41:46 juju-e4d256-prod-github-runner-207 kernel: [40679.943964] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 16:41:46 juju-e4d256-prod-github-runner-207 kernel: [40679.944798] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 16:41:46 juju-e4d256-prod-github-runner-207 kernel: [40679.945582] vcpu_run+0x62/0x2c0 [kvm] Aug 22 16:41:46 juju-e4d256-prod-github-runner-207 kernel: [40679.946299] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 16:41:46 juju-e4d256-prod-github-runner-207 kernel: [40679.947031] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 16:41:46 juju-e4d256-prod-github-runner-207 kernel: [40679.947839] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 16:41:46 juju-e4d256-prod-github-runner-207 kernel: [40679.948602] ? __seccomp_filter+0x4a/0x4a0 Aug 22 16:41:46 juju-e4d256-prod-github-runner-207 kernel: [40679.949327] ? __fget_files+0x86/0xc0 Aug 22 16:41:46 juju-e4d256-prod-github-runner-207 kernel: [40679.950023] __x64_sys_ioctl+0x95/0xd0 Aug 22 16:41:46 juju-e4d256-prod-github-runner-207 kernel: [40679.950719] do_syscall_64+0x5c/0xc0 Aug 22 16:41:46 juju-e4d256-prod-github-runner-207 kernel: [40679.951397] ? do_futex+0x162/0x1f0 Aug 22 16:41:46 juju-e4d256-prod-github-runner-207 kernel: [40679.952075] ? __x64_sys_futex+0x78/0x1e0 Aug 22 16:41:46 juju-e4d256-prod-github-runner-207 kernel: [40679.952781] ? __secure_computing+0xa9/0x120 Aug 22 16:41:46 juju-e4d256-prod-github-runner-207 kernel: [40679.953498] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 16:41:46 juju-e4d256-prod-github-runner-207 kernel: [40679.954287] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:41:46 juju-e4d256-prod-github-runner-207 kernel: [40679.955040] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:41:46 juju-e4d256-prod-github-runner-207 kernel: [40679.955809] ? do_syscall_64+0x69/0xc0 Aug 22 16:41:46 juju-e4d256-prod-github-runner-207 kernel: [40679.956500] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:41:46 juju-e4d256-prod-github-runner-207 kernel: [40679.957255] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:41:46 juju-e4d256-prod-github-runner-207 kernel: [40679.958011] ? do_syscall_64+0x69/0xc0 Aug 22 16:41:46 juju-e4d256-prod-github-runner-207 kernel: [40679.958757] ? do_syscall_64+0x69/0xc0 Aug 22 16:41:46 juju-e4d256-prod-github-runner-207 kernel: [40679.959481] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 16:41:46 juju-e4d256-prod-github-runner-207 kernel: [40679.960259] RIP: 0033:0x7faa5d0edaff Aug 22 16:41:46 juju-e4d256-prod-github-runner-207 kernel: [40679.960939] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 16:41:46 juju-e4d256-prod-github-runner-207 kernel: [40679.963043] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 16:41:46 juju-e4d256-prod-github-runner-207 kernel: [40679.964012] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 16:41:46 juju-e4d256-prod-github-runner-207 kernel: [40679.964957] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 16:41:46 juju-e4d256-prod-github-runner-207 kernel: [40679.965907] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 16:41:46 juju-e4d256-prod-github-runner-207 kernel: [40679.966852] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 16:41:46 juju-e4d256-prod-github-runner-207 kernel: [40679.967791] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 16:41:46 juju-e4d256-prod-github-runner-207 kernel: [40679.968706] Aug 22 16:42:10 juju-e4d256-prod-github-runner-207 kernel: [40704.541982] watchdog: BUG: soft lockup - CPU#1 stuck for 37801s! [qemu-system-x86:6715] Aug 22 16:42:10 juju-e4d256-prod-github-runner-207 kernel: [40704.543885] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 16:42:10 juju-e4d256-prod-github-runner-207 kernel: [40704.543981] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 16:42:10 juju-e4d256-prod-github-runner-207 kernel: [40704.557529] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 16:42:10 juju-e4d256-prod-github-runner-207 kernel: [40704.558868] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 16:42:10 juju-e4d256-prod-github-runner-207 kernel: [40704.560146] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:42:10 juju-e4d256-prod-github-runner-207 kernel: [40704.561235] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 16:42:10 juju-e4d256-prod-github-runner-207 kernel: [40704.563992] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 16:42:10 juju-e4d256-prod-github-runner-207 kernel: [40704.565068] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 16:42:10 juju-e4d256-prod-github-runner-207 kernel: [40704.566361] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 16:42:10 juju-e4d256-prod-github-runner-207 kernel: [40704.567598] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 16:42:10 juju-e4d256-prod-github-runner-207 kernel: [40704.568831] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 16:42:10 juju-e4d256-prod-github-runner-207 kernel: [40704.570037] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 16:42:10 juju-e4d256-prod-github-runner-207 kernel: [40704.571247] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 16:42:10 juju-e4d256-prod-github-runner-207 kernel: [40704.572526] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 16:42:10 juju-e4d256-prod-github-runner-207 kernel: [40704.573796] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 16:42:10 juju-e4d256-prod-github-runner-207 kernel: [40704.575035] Call Trace: Aug 22 16:42:10 juju-e4d256-prod-github-runner-207 kernel: [40704.576012] Aug 22 16:42:10 juju-e4d256-prod-github-runner-207 kernel: [40704.576930] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:42:10 juju-e4d256-prod-github-runner-207 kernel: [40704.578165] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:42:10 juju-e4d256-prod-github-runner-207 kernel: [40704.579230] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:42:10 juju-e4d256-prod-github-runner-207 kernel: [40704.580321] ? show_regs.part.0+0x23/0x29 Aug 22 16:42:10 juju-e4d256-prod-github-runner-207 kernel: [40704.581335] ? show_regs.cold+0x8/0xd Aug 22 16:42:10 juju-e4d256-prod-github-runner-207 kernel: [40704.582319] ? watchdog_timer_fn+0x1be/0x220 Aug 22 16:42:10 juju-e4d256-prod-github-runner-207 kernel: [40704.583333] ? lockup_detector_update_enable+0x60/0x60 Aug 22 16:42:10 juju-e4d256-prod-github-runner-207 kernel: [40704.584417] ? __hrtimer_run_queues+0x107/0x230 Aug 22 16:42:10 juju-e4d256-prod-github-runner-207 kernel: [40704.585446] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 16:42:10 juju-e4d256-prod-github-runner-207 kernel: [40704.586479] ? hrtimer_interrupt+0x101/0x220 Aug 22 16:42:10 juju-e4d256-prod-github-runner-207 kernel: [40704.587518] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 16:42:10 juju-e4d256-prod-github-runner-207 kernel: [40704.588598] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 16:42:10 juju-e4d256-prod-github-runner-207 kernel: [40704.589664] Aug 22 16:42:10 juju-e4d256-prod-github-runner-207 kernel: [40704.590543] Aug 22 16:42:10 juju-e4d256-prod-github-runner-207 kernel: [40704.591395] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 16:42:10 juju-e4d256-prod-github-runner-207 kernel: [40704.592442] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:42:10 juju-e4d256-prod-github-runner-207 kernel: [40704.593491] ? _raw_spin_lock+0x22/0x30 Aug 22 16:42:10 juju-e4d256-prod-github-runner-207 kernel: [40704.594442] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:42:10 juju-e4d256-prod-github-runner-207 kernel: [40704.595478] direct_page_fault+0x206/0x310 [kvm] Aug 22 16:42:10 juju-e4d256-prod-github-runner-207 kernel: [40704.596717] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 16:42:10 juju-e4d256-prod-github-runner-207 kernel: [40704.597984] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 16:42:10 juju-e4d256-prod-github-runner-207 kernel: [40704.599222] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 16:42:10 juju-e4d256-prod-github-runner-207 kernel: [40704.600471] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 16:42:10 juju-e4d256-prod-github-runner-207 kernel: [40704.601659] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 16:42:10 juju-e4d256-prod-github-runner-207 kernel: [40704.602916] handle_exit+0x98/0x230 [kvm_amd] Aug 22 16:42:10 juju-e4d256-prod-github-runner-207 kernel: [40704.604151] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 16:42:10 juju-e4d256-prod-github-runner-207 kernel: [40704.605163] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 16:42:10 juju-e4d256-prod-github-runner-207 kernel: [40704.606093] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 16:42:10 juju-e4d256-prod-github-runner-207 kernel: [40704.607013] vcpu_run+0x62/0x2c0 [kvm] Aug 22 16:42:10 juju-e4d256-prod-github-runner-207 kernel: [40704.607838] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 16:42:10 juju-e4d256-prod-github-runner-207 kernel: [40704.608728] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 16:42:10 juju-e4d256-prod-github-runner-207 kernel: [40704.609600] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 16:42:10 juju-e4d256-prod-github-runner-207 kernel: [40704.610408] ? __seccomp_filter+0x4a/0x4a0 Aug 22 16:42:10 juju-e4d256-prod-github-runner-207 kernel: [40704.611163] ? __fget_files+0x86/0xc0 Aug 22 16:42:10 juju-e4d256-prod-github-runner-207 kernel: [40704.611879] __x64_sys_ioctl+0x95/0xd0 Aug 22 16:42:10 juju-e4d256-prod-github-runner-207 kernel: [40704.612575] do_syscall_64+0x5c/0xc0 Aug 22 16:42:10 juju-e4d256-prod-github-runner-207 kernel: [40704.613243] ? do_futex+0x162/0x1f0 Aug 22 16:42:10 juju-e4d256-prod-github-runner-207 kernel: [40704.613898] ? __x64_sys_futex+0x78/0x1e0 Aug 22 16:42:10 juju-e4d256-prod-github-runner-207 kernel: [40704.614586] ? __secure_computing+0xa9/0x120 Aug 22 16:42:10 juju-e4d256-prod-github-runner-207 kernel: [40704.615281] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 16:42:10 juju-e4d256-prod-github-runner-207 kernel: [40704.616070] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:42:10 juju-e4d256-prod-github-runner-207 kernel: [40704.616793] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:42:10 juju-e4d256-prod-github-runner-207 kernel: [40704.617508] ? do_syscall_64+0x69/0xc0 Aug 22 16:42:10 juju-e4d256-prod-github-runner-207 kernel: [40704.618154] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:42:10 juju-e4d256-prod-github-runner-207 kernel: [40704.618890] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:42:10 juju-e4d256-prod-github-runner-207 kernel: [40704.619614] ? do_syscall_64+0x69/0xc0 Aug 22 16:42:10 juju-e4d256-prod-github-runner-207 kernel: [40704.620238] ? do_syscall_64+0x69/0xc0 Aug 22 16:42:10 juju-e4d256-prod-github-runner-207 kernel: [40704.620859] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 16:42:10 juju-e4d256-prod-github-runner-207 kernel: [40704.621564] RIP: 0033:0x7faa5d0edaff Aug 22 16:42:10 juju-e4d256-prod-github-runner-207 kernel: [40704.622195] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 16:42:10 juju-e4d256-prod-github-runner-207 kernel: [40704.624517] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 16:42:10 juju-e4d256-prod-github-runner-207 kernel: [40704.625477] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 16:42:10 juju-e4d256-prod-github-runner-207 kernel: [40704.626390] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 16:42:10 juju-e4d256-prod-github-runner-207 kernel: [40704.627382] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 16:42:10 juju-e4d256-prod-github-runner-207 kernel: [40704.628287] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 16:42:10 juju-e4d256-prod-github-runner-207 kernel: [40704.629184] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 16:42:10 juju-e4d256-prod-github-runner-207 kernel: [40704.630075] Aug 22 16:42:38 juju-e4d256-prod-github-runner-207 kernel: [40732.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 37827s! [qemu-system-x86:6715] Aug 22 16:42:38 juju-e4d256-prod-github-runner-207 kernel: [40732.543153] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 16:42:38 juju-e4d256-prod-github-runner-207 kernel: [40732.543224] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 16:42:38 juju-e4d256-prod-github-runner-207 kernel: [40732.555326] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 16:42:38 juju-e4d256-prod-github-runner-207 kernel: [40732.556596] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 16:42:38 juju-e4d256-prod-github-runner-207 kernel: [40732.557812] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:42:38 juju-e4d256-prod-github-runner-207 kernel: [40732.558882] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 16:42:38 juju-e4d256-prod-github-runner-207 kernel: [40732.561469] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 16:42:38 juju-e4d256-prod-github-runner-207 kernel: [40732.562514] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 16:42:38 juju-e4d256-prod-github-runner-207 kernel: [40732.563702] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 16:42:38 juju-e4d256-prod-github-runner-207 kernel: [40732.564899] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 16:42:38 juju-e4d256-prod-github-runner-207 kernel: [40732.566065] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 16:42:38 juju-e4d256-prod-github-runner-207 kernel: [40732.567242] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 16:42:38 juju-e4d256-prod-github-runner-207 kernel: [40732.568414] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 16:42:38 juju-e4d256-prod-github-runner-207 kernel: [40732.569672] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 16:42:38 juju-e4d256-prod-github-runner-207 kernel: [40732.570779] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 16:42:38 juju-e4d256-prod-github-runner-207 kernel: [40732.571993] Call Trace: Aug 22 16:42:38 juju-e4d256-prod-github-runner-207 kernel: [40732.572916] Aug 22 16:42:38 juju-e4d256-prod-github-runner-207 kernel: [40732.573817] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:42:38 juju-e4d256-prod-github-runner-207 kernel: [40732.574863] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:42:38 juju-e4d256-prod-github-runner-207 kernel: [40732.575905] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:42:38 juju-e4d256-prod-github-runner-207 kernel: [40732.576999] ? show_regs.part.0+0x23/0x29 Aug 22 16:42:38 juju-e4d256-prod-github-runner-207 kernel: [40732.578009] ? show_regs.cold+0x8/0xd Aug 22 16:42:38 juju-e4d256-prod-github-runner-207 kernel: [40732.578995] ? watchdog_timer_fn+0x1be/0x220 Aug 22 16:42:38 juju-e4d256-prod-github-runner-207 kernel: [40732.580044] ? lockup_detector_update_enable+0x60/0x60 Aug 22 16:42:38 juju-e4d256-prod-github-runner-207 kernel: [40732.581131] ? __hrtimer_run_queues+0x107/0x230 Aug 22 16:42:38 juju-e4d256-prod-github-runner-207 kernel: [40732.582171] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 16:42:38 juju-e4d256-prod-github-runner-207 kernel: [40732.583214] ? hrtimer_interrupt+0x101/0x220 Aug 22 16:42:38 juju-e4d256-prod-github-runner-207 kernel: [40732.584256] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 16:42:38 juju-e4d256-prod-github-runner-207 kernel: [40732.585348] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 16:42:38 juju-e4d256-prod-github-runner-207 kernel: [40732.586403] Aug 22 16:42:38 juju-e4d256-prod-github-runner-207 kernel: [40732.587275] Aug 22 16:42:38 juju-e4d256-prod-github-runner-207 kernel: [40732.588119] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 16:42:38 juju-e4d256-prod-github-runner-207 kernel: [40732.589162] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:42:38 juju-e4d256-prod-github-runner-207 kernel: [40732.590217] ? _raw_spin_lock+0x22/0x30 Aug 22 16:42:38 juju-e4d256-prod-github-runner-207 kernel: [40732.591192] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:42:38 juju-e4d256-prod-github-runner-207 kernel: [40732.592222] direct_page_fault+0x206/0x310 [kvm] Aug 22 16:42:38 juju-e4d256-prod-github-runner-207 kernel: [40732.593256] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 16:42:38 juju-e4d256-prod-github-runner-207 kernel: [40732.594269] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 16:42:38 juju-e4d256-prod-github-runner-207 kernel: [40732.595294] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 16:42:38 juju-e4d256-prod-github-runner-207 kernel: [40732.596284] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 16:42:38 juju-e4d256-prod-github-runner-207 kernel: [40732.597239] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 16:42:38 juju-e4d256-prod-github-runner-207 kernel: [40732.598228] handle_exit+0x98/0x230 [kvm_amd] Aug 22 16:42:38 juju-e4d256-prod-github-runner-207 kernel: [40732.599142] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 16:42:38 juju-e4d256-prod-github-runner-207 kernel: [40732.600096] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 16:42:38 juju-e4d256-prod-github-runner-207 kernel: [40732.601044] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 16:42:38 juju-e4d256-prod-github-runner-207 kernel: [40732.601957] vcpu_run+0x62/0x2c0 [kvm] Aug 22 16:42:38 juju-e4d256-prod-github-runner-207 kernel: [40732.602773] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 16:42:38 juju-e4d256-prod-github-runner-207 kernel: [40732.603606] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 16:42:38 juju-e4d256-prod-github-runner-207 kernel: [40732.604471] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 16:42:38 juju-e4d256-prod-github-runner-207 kernel: [40732.605291] ? __seccomp_filter+0x4a/0x4a0 Aug 22 16:42:38 juju-e4d256-prod-github-runner-207 kernel: [40732.606049] ? __fget_files+0x86/0xc0 Aug 22 16:42:38 juju-e4d256-prod-github-runner-207 kernel: [40732.606765] __x64_sys_ioctl+0x95/0xd0 Aug 22 16:42:38 juju-e4d256-prod-github-runner-207 kernel: [40732.607655] do_syscall_64+0x5c/0xc0 Aug 22 16:42:38 juju-e4d256-prod-github-runner-207 kernel: [40732.608455] ? do_futex+0x162/0x1f0 Aug 22 16:42:38 juju-e4d256-prod-github-runner-207 kernel: [40732.609108] ? __x64_sys_futex+0x78/0x1e0 Aug 22 16:42:38 juju-e4d256-prod-github-runner-207 kernel: [40732.609786] ? __secure_computing+0xa9/0x120 Aug 22 16:42:38 juju-e4d256-prod-github-runner-207 kernel: [40732.610498] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 16:42:38 juju-e4d256-prod-github-runner-207 kernel: [40732.611349] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:42:38 juju-e4d256-prod-github-runner-207 kernel: [40732.612083] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:42:38 juju-e4d256-prod-github-runner-207 kernel: [40732.612806] ? do_syscall_64+0x69/0xc0 Aug 22 16:42:38 juju-e4d256-prod-github-runner-207 kernel: [40732.613457] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:42:38 juju-e4d256-prod-github-runner-207 kernel: [40732.614170] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:42:38 juju-e4d256-prod-github-runner-207 kernel: [40732.614869] ? do_syscall_64+0x69/0xc0 Aug 22 16:42:38 juju-e4d256-prod-github-runner-207 kernel: [40732.615519] ? do_syscall_64+0x69/0xc0 Aug 22 16:42:38 juju-e4d256-prod-github-runner-207 kernel: [40732.616161] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 16:42:38 juju-e4d256-prod-github-runner-207 kernel: [40732.616878] RIP: 0033:0x7faa5d0edaff Aug 22 16:42:38 juju-e4d256-prod-github-runner-207 kernel: [40732.617508] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 16:42:38 juju-e4d256-prod-github-runner-207 kernel: [40732.619529] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 16:42:38 juju-e4d256-prod-github-runner-207 kernel: [40732.620456] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 16:42:38 juju-e4d256-prod-github-runner-207 kernel: [40732.621368] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 16:42:38 juju-e4d256-prod-github-runner-207 kernel: [40732.622262] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 16:42:38 juju-e4d256-prod-github-runner-207 kernel: [40732.623171] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 16:42:38 juju-e4d256-prod-github-runner-207 kernel: [40732.624067] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 16:42:38 juju-e4d256-prod-github-runner-207 kernel: [40732.624967] Aug 22 16:43:06 juju-e4d256-prod-github-runner-207 kernel: [40760.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 37853s! [qemu-system-x86:6715] Aug 22 16:43:06 juju-e4d256-prod-github-runner-207 kernel: [40760.543706] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 16:43:06 juju-e4d256-prod-github-runner-207 kernel: [40760.543962] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 16:43:06 juju-e4d256-prod-github-runner-207 kernel: [40760.556055] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 16:43:06 juju-e4d256-prod-github-runner-207 kernel: [40760.557321] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 16:43:06 juju-e4d256-prod-github-runner-207 kernel: [40760.558543] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:43:06 juju-e4d256-prod-github-runner-207 kernel: [40760.559618] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 16:43:06 juju-e4d256-prod-github-runner-207 kernel: [40760.562168] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 16:43:06 juju-e4d256-prod-github-runner-207 kernel: [40760.563226] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 16:43:06 juju-e4d256-prod-github-runner-207 kernel: [40760.564390] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 16:43:06 juju-e4d256-prod-github-runner-207 kernel: [40760.565552] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 16:43:06 juju-e4d256-prod-github-runner-207 kernel: [40760.566711] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 16:43:06 juju-e4d256-prod-github-runner-207 kernel: [40760.567892] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 16:43:06 juju-e4d256-prod-github-runner-207 kernel: [40760.569063] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 16:43:06 juju-e4d256-prod-github-runner-207 kernel: [40760.570301] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 16:43:06 juju-e4d256-prod-github-runner-207 kernel: [40760.571416] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 16:43:06 juju-e4d256-prod-github-runner-207 kernel: [40760.572608] Call Trace: Aug 22 16:43:06 juju-e4d256-prod-github-runner-207 kernel: [40760.573520] Aug 22 16:43:06 juju-e4d256-prod-github-runner-207 kernel: [40760.574412] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:43:06 juju-e4d256-prod-github-runner-207 kernel: [40760.575455] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:43:06 juju-e4d256-prod-github-runner-207 kernel: [40760.576476] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:43:06 juju-e4d256-prod-github-runner-207 kernel: [40760.577602] ? show_regs.part.0+0x23/0x29 Aug 22 16:43:06 juju-e4d256-prod-github-runner-207 kernel: [40760.578598] ? show_regs.cold+0x8/0xd Aug 22 16:43:06 juju-e4d256-prod-github-runner-207 kernel: [40760.579584] ? watchdog_timer_fn+0x1be/0x220 Aug 22 16:43:06 juju-e4d256-prod-github-runner-207 kernel: [40760.580595] ? lockup_detector_update_enable+0x60/0x60 Aug 22 16:43:06 juju-e4d256-prod-github-runner-207 kernel: [40760.581658] ? __hrtimer_run_queues+0x107/0x230 Aug 22 16:43:06 juju-e4d256-prod-github-runner-207 kernel: [40760.582685] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 16:43:06 juju-e4d256-prod-github-runner-207 kernel: [40760.583723] ? hrtimer_interrupt+0x101/0x220 Aug 22 16:43:06 juju-e4d256-prod-github-runner-207 kernel: [40760.584738] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 16:43:06 juju-e4d256-prod-github-runner-207 kernel: [40760.585812] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 16:43:06 juju-e4d256-prod-github-runner-207 kernel: [40760.586870] Aug 22 16:43:06 juju-e4d256-prod-github-runner-207 kernel: [40760.587722] Aug 22 16:43:06 juju-e4d256-prod-github-runner-207 kernel: [40760.588564] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 16:43:06 juju-e4d256-prod-github-runner-207 kernel: [40760.589598] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:43:06 juju-e4d256-prod-github-runner-207 kernel: [40760.590641] ? _raw_spin_lock+0x22/0x30 Aug 22 16:43:06 juju-e4d256-prod-github-runner-207 kernel: [40760.591603] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:43:06 juju-e4d256-prod-github-runner-207 kernel: [40760.592617] direct_page_fault+0x206/0x310 [kvm] Aug 22 16:43:06 juju-e4d256-prod-github-runner-207 kernel: [40760.593639] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 16:43:06 juju-e4d256-prod-github-runner-207 kernel: [40760.594647] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 16:43:06 juju-e4d256-prod-github-runner-207 kernel: [40760.595666] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 16:43:06 juju-e4d256-prod-github-runner-207 kernel: [40760.596653] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 16:43:06 juju-e4d256-prod-github-runner-207 kernel: [40760.597599] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 16:43:06 juju-e4d256-prod-github-runner-207 kernel: [40760.598582] handle_exit+0x98/0x230 [kvm_amd] Aug 22 16:43:06 juju-e4d256-prod-github-runner-207 kernel: [40760.599490] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 16:43:06 juju-e4d256-prod-github-runner-207 kernel: [40760.600405] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 16:43:06 juju-e4d256-prod-github-runner-207 kernel: [40760.601335] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 16:43:06 juju-e4d256-prod-github-runner-207 kernel: [40760.602236] vcpu_run+0x62/0x2c0 [kvm] Aug 22 16:43:06 juju-e4d256-prod-github-runner-207 kernel: [40760.603058] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 16:43:06 juju-e4d256-prod-github-runner-207 kernel: [40760.603866] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 16:43:06 juju-e4d256-prod-github-runner-207 kernel: [40760.604718] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 16:43:06 juju-e4d256-prod-github-runner-207 kernel: [40760.605513] ? __seccomp_filter+0x4a/0x4a0 Aug 22 16:43:06 juju-e4d256-prod-github-runner-207 kernel: [40760.606255] ? __fget_files+0x86/0xc0 Aug 22 16:43:06 juju-e4d256-prod-github-runner-207 kernel: [40760.606971] __x64_sys_ioctl+0x95/0xd0 Aug 22 16:43:06 juju-e4d256-prod-github-runner-207 kernel: [40760.607662] do_syscall_64+0x5c/0xc0 Aug 22 16:43:06 juju-e4d256-prod-github-runner-207 kernel: [40760.608325] ? do_futex+0x162/0x1f0 Aug 22 16:43:06 juju-e4d256-prod-github-runner-207 kernel: [40760.608973] ? __x64_sys_futex+0x78/0x1e0 Aug 22 16:43:06 juju-e4d256-prod-github-runner-207 kernel: [40760.609645] ? __secure_computing+0xa9/0x120 Aug 22 16:43:06 juju-e4d256-prod-github-runner-207 kernel: [40760.610332] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 16:43:06 juju-e4d256-prod-github-runner-207 kernel: [40760.611110] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:43:06 juju-e4d256-prod-github-runner-207 kernel: [40760.611830] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:43:06 juju-e4d256-prod-github-runner-207 kernel: [40760.612551] ? do_syscall_64+0x69/0xc0 Aug 22 16:43:06 juju-e4d256-prod-github-runner-207 kernel: [40760.613194] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:43:06 juju-e4d256-prod-github-runner-207 kernel: [40760.613894] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:43:06 juju-e4d256-prod-github-runner-207 kernel: [40760.614587] ? do_syscall_64+0x69/0xc0 Aug 22 16:43:06 juju-e4d256-prod-github-runner-207 kernel: [40760.615221] ? do_syscall_64+0x69/0xc0 Aug 22 16:43:06 juju-e4d256-prod-github-runner-207 kernel: [40760.615841] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 16:43:06 juju-e4d256-prod-github-runner-207 kernel: [40760.616543] RIP: 0033:0x7faa5d0edaff Aug 22 16:43:06 juju-e4d256-prod-github-runner-207 kernel: [40760.617188] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 16:43:06 juju-e4d256-prod-github-runner-207 kernel: [40760.619172] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 16:43:06 juju-e4d256-prod-github-runner-207 kernel: [40760.620080] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 16:43:06 juju-e4d256-prod-github-runner-207 kernel: [40760.620966] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 16:43:06 juju-e4d256-prod-github-runner-207 kernel: [40760.621851] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 16:43:06 juju-e4d256-prod-github-runner-207 kernel: [40760.622751] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 16:43:06 juju-e4d256-prod-github-runner-207 kernel: [40760.623652] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 16:43:06 juju-e4d256-prod-github-runner-207 kernel: [40760.624542] Aug 22 16:43:34 juju-e4d256-prod-github-runner-207 kernel: [40788.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 37879s! [qemu-system-x86:6715] Aug 22 16:43:34 juju-e4d256-prod-github-runner-207 kernel: [40788.543108] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 16:43:34 juju-e4d256-prod-github-runner-207 kernel: [40788.543174] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 16:43:34 juju-e4d256-prod-github-runner-207 kernel: [40788.555238] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 16:43:34 juju-e4d256-prod-github-runner-207 kernel: [40788.556496] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 16:43:34 juju-e4d256-prod-github-runner-207 kernel: [40788.557717] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:43:34 juju-e4d256-prod-github-runner-207 kernel: [40788.558957] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 16:43:34 juju-e4d256-prod-github-runner-207 kernel: [40788.561510] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 16:43:34 juju-e4d256-prod-github-runner-207 kernel: [40788.562568] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 16:43:34 juju-e4d256-prod-github-runner-207 kernel: [40788.563774] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 16:43:34 juju-e4d256-prod-github-runner-207 kernel: [40788.564933] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 16:43:34 juju-e4d256-prod-github-runner-207 kernel: [40788.566116] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 16:43:34 juju-e4d256-prod-github-runner-207 kernel: [40788.567294] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 16:43:34 juju-e4d256-prod-github-runner-207 kernel: [40788.568456] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 16:43:34 juju-e4d256-prod-github-runner-207 kernel: [40788.569687] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 16:43:34 juju-e4d256-prod-github-runner-207 kernel: [40788.570816] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 16:43:34 juju-e4d256-prod-github-runner-207 kernel: [40788.572006] Call Trace: Aug 22 16:43:34 juju-e4d256-prod-github-runner-207 kernel: [40788.572920] Aug 22 16:43:34 juju-e4d256-prod-github-runner-207 kernel: [40788.573861] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:43:34 juju-e4d256-prod-github-runner-207 kernel: [40788.574903] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:43:34 juju-e4d256-prod-github-runner-207 kernel: [40788.575925] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:43:34 juju-e4d256-prod-github-runner-207 kernel: [40788.576999] ? show_regs.part.0+0x23/0x29 Aug 22 16:43:34 juju-e4d256-prod-github-runner-207 kernel: [40788.577992] ? show_regs.cold+0x8/0xd Aug 22 16:43:34 juju-e4d256-prod-github-runner-207 kernel: [40788.578971] ? watchdog_timer_fn+0x1be/0x220 Aug 22 16:43:34 juju-e4d256-prod-github-runner-207 kernel: [40788.579975] ? lockup_detector_update_enable+0x60/0x60 Aug 22 16:43:34 juju-e4d256-prod-github-runner-207 kernel: [40788.581034] ? __hrtimer_run_queues+0x107/0x230 Aug 22 16:43:34 juju-e4d256-prod-github-runner-207 kernel: [40788.582058] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 16:43:34 juju-e4d256-prod-github-runner-207 kernel: [40788.583095] ? hrtimer_interrupt+0x101/0x220 Aug 22 16:43:34 juju-e4d256-prod-github-runner-207 kernel: [40788.584109] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 16:43:34 juju-e4d256-prod-github-runner-207 kernel: [40788.585175] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 16:43:34 juju-e4d256-prod-github-runner-207 kernel: [40788.586219] Aug 22 16:43:34 juju-e4d256-prod-github-runner-207 kernel: [40788.587083] Aug 22 16:43:34 juju-e4d256-prod-github-runner-207 kernel: [40788.587964] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 16:43:34 juju-e4d256-prod-github-runner-207 kernel: [40788.589102] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:43:34 juju-e4d256-prod-github-runner-207 kernel: [40788.590141] ? _raw_spin_lock+0x22/0x30 Aug 22 16:43:34 juju-e4d256-prod-github-runner-207 kernel: [40788.591105] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:43:34 juju-e4d256-prod-github-runner-207 kernel: [40788.592131] direct_page_fault+0x206/0x310 [kvm] Aug 22 16:43:34 juju-e4d256-prod-github-runner-207 kernel: [40788.593176] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 16:43:34 juju-e4d256-prod-github-runner-207 kernel: [40788.594197] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 16:43:34 juju-e4d256-prod-github-runner-207 kernel: [40788.595242] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 16:43:34 juju-e4d256-prod-github-runner-207 kernel: [40788.596226] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 16:43:34 juju-e4d256-prod-github-runner-207 kernel: [40788.597173] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 16:43:34 juju-e4d256-prod-github-runner-207 kernel: [40788.598151] handle_exit+0x98/0x230 [kvm_amd] Aug 22 16:43:34 juju-e4d256-prod-github-runner-207 kernel: [40788.599060] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 16:43:34 juju-e4d256-prod-github-runner-207 kernel: [40788.599987] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 16:43:34 juju-e4d256-prod-github-runner-207 kernel: [40788.600921] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 16:43:34 juju-e4d256-prod-github-runner-207 kernel: [40788.601826] vcpu_run+0x62/0x2c0 [kvm] Aug 22 16:43:34 juju-e4d256-prod-github-runner-207 kernel: [40788.602653] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 16:43:34 juju-e4d256-prod-github-runner-207 kernel: [40788.603458] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 16:43:34 juju-e4d256-prod-github-runner-207 kernel: [40788.604307] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 16:43:34 juju-e4d256-prod-github-runner-207 kernel: [40788.605101] ? __seccomp_filter+0x4a/0x4a0 Aug 22 16:43:34 juju-e4d256-prod-github-runner-207 kernel: [40788.605844] ? __fget_files+0x86/0xc0 Aug 22 16:43:34 juju-e4d256-prod-github-runner-207 kernel: [40788.606554] __x64_sys_ioctl+0x95/0xd0 Aug 22 16:43:34 juju-e4d256-prod-github-runner-207 kernel: [40788.607251] do_syscall_64+0x5c/0xc0 Aug 22 16:43:34 juju-e4d256-prod-github-runner-207 kernel: [40788.607920] ? do_futex+0x162/0x1f0 Aug 22 16:43:34 juju-e4d256-prod-github-runner-207 kernel: [40788.608566] ? __x64_sys_futex+0x78/0x1e0 Aug 22 16:43:34 juju-e4d256-prod-github-runner-207 kernel: [40788.609238] ? __secure_computing+0xa9/0x120 Aug 22 16:43:34 juju-e4d256-prod-github-runner-207 kernel: [40788.609925] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 16:43:34 juju-e4d256-prod-github-runner-207 kernel: [40788.610693] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:43:34 juju-e4d256-prod-github-runner-207 kernel: [40788.611415] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:43:34 juju-e4d256-prod-github-runner-207 kernel: [40788.612130] ? do_syscall_64+0x69/0xc0 Aug 22 16:43:34 juju-e4d256-prod-github-runner-207 kernel: [40788.612772] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:43:34 juju-e4d256-prod-github-runner-207 kernel: [40788.613499] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:43:34 juju-e4d256-prod-github-runner-207 kernel: [40788.614210] ? do_syscall_64+0x69/0xc0 Aug 22 16:43:34 juju-e4d256-prod-github-runner-207 kernel: [40788.614881] ? do_syscall_64+0x69/0xc0 Aug 22 16:43:34 juju-e4d256-prod-github-runner-207 kernel: [40788.615539] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 16:43:34 juju-e4d256-prod-github-runner-207 kernel: [40788.616240] RIP: 0033:0x7faa5d0edaff Aug 22 16:43:34 juju-e4d256-prod-github-runner-207 kernel: [40788.616861] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 16:43:34 juju-e4d256-prod-github-runner-207 kernel: [40788.619021] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 16:43:34 juju-e4d256-prod-github-runner-207 kernel: [40788.619947] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 16:43:34 juju-e4d256-prod-github-runner-207 kernel: [40788.620840] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 16:43:34 juju-e4d256-prod-github-runner-207 kernel: [40788.621734] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 16:43:34 juju-e4d256-prod-github-runner-207 kernel: [40788.622637] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 16:43:34 juju-e4d256-prod-github-runner-207 kernel: [40788.623557] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 16:43:34 juju-e4d256-prod-github-runner-207 kernel: [40788.624448] Aug 22 16:44:02 juju-e4d256-prod-github-runner-207 kernel: [40816.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 37905s! [qemu-system-x86:6715] Aug 22 16:44:02 juju-e4d256-prod-github-runner-207 kernel: [40816.543097] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 16:44:02 juju-e4d256-prod-github-runner-207 kernel: [40816.543165] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 16:44:02 juju-e4d256-prod-github-runner-207 kernel: [40816.555210] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 16:44:02 juju-e4d256-prod-github-runner-207 kernel: [40816.556472] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 16:44:02 juju-e4d256-prod-github-runner-207 kernel: [40816.557692] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:44:02 juju-e4d256-prod-github-runner-207 kernel: [40816.558758] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 16:44:02 juju-e4d256-prod-github-runner-207 kernel: [40816.561320] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 16:44:02 juju-e4d256-prod-github-runner-207 kernel: [40816.562373] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 16:44:02 juju-e4d256-prod-github-runner-207 kernel: [40816.563537] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 16:44:02 juju-e4d256-prod-github-runner-207 kernel: [40816.564692] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 16:44:02 juju-e4d256-prod-github-runner-207 kernel: [40816.565852] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 16:44:02 juju-e4d256-prod-github-runner-207 kernel: [40816.567024] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 16:44:02 juju-e4d256-prod-github-runner-207 kernel: [40816.568189] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 16:44:02 juju-e4d256-prod-github-runner-207 kernel: [40816.569417] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 16:44:02 juju-e4d256-prod-github-runner-207 kernel: [40816.570526] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 16:44:02 juju-e4d256-prod-github-runner-207 kernel: [40816.571719] Call Trace: Aug 22 16:44:02 juju-e4d256-prod-github-runner-207 kernel: [40816.572639] Aug 22 16:44:02 juju-e4d256-prod-github-runner-207 kernel: [40816.573524] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:44:02 juju-e4d256-prod-github-runner-207 kernel: [40816.574557] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:44:02 juju-e4d256-prod-github-runner-207 kernel: [40816.575575] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:44:02 juju-e4d256-prod-github-runner-207 kernel: [40816.576651] ? show_regs.part.0+0x23/0x29 Aug 22 16:44:02 juju-e4d256-prod-github-runner-207 kernel: [40816.577652] ? show_regs.cold+0x8/0xd Aug 22 16:44:02 juju-e4d256-prod-github-runner-207 kernel: [40816.578637] ? watchdog_timer_fn+0x1be/0x220 Aug 22 16:44:02 juju-e4d256-prod-github-runner-207 kernel: [40816.579643] ? lockup_detector_update_enable+0x60/0x60 Aug 22 16:44:02 juju-e4d256-prod-github-runner-207 kernel: [40816.580702] ? __hrtimer_run_queues+0x107/0x230 Aug 22 16:44:02 juju-e4d256-prod-github-runner-207 kernel: [40816.581728] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 16:44:02 juju-e4d256-prod-github-runner-207 kernel: [40816.582769] ? hrtimer_interrupt+0x101/0x220 Aug 22 16:44:02 juju-e4d256-prod-github-runner-207 kernel: [40816.583785] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 16:44:02 juju-e4d256-prod-github-runner-207 kernel: [40816.584851] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 16:44:02 juju-e4d256-prod-github-runner-207 kernel: [40816.585901] Aug 22 16:44:02 juju-e4d256-prod-github-runner-207 kernel: [40816.586760] Aug 22 16:44:02 juju-e4d256-prod-github-runner-207 kernel: [40816.587598] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 16:44:02 juju-e4d256-prod-github-runner-207 kernel: [40816.588631] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:44:02 juju-e4d256-prod-github-runner-207 kernel: [40816.589669] ? _raw_spin_lock+0x22/0x30 Aug 22 16:44:02 juju-e4d256-prod-github-runner-207 kernel: [40816.590619] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:44:02 juju-e4d256-prod-github-runner-207 kernel: [40816.591641] direct_page_fault+0x206/0x310 [kvm] Aug 22 16:44:02 juju-e4d256-prod-github-runner-207 kernel: [40816.592679] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 16:44:02 juju-e4d256-prod-github-runner-207 kernel: [40816.593688] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 16:44:02 juju-e4d256-prod-github-runner-207 kernel: [40816.594702] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 16:44:02 juju-e4d256-prod-github-runner-207 kernel: [40816.595670] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 16:44:02 juju-e4d256-prod-github-runner-207 kernel: [40816.596618] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 16:44:02 juju-e4d256-prod-github-runner-207 kernel: [40816.597592] handle_exit+0x98/0x230 [kvm_amd] Aug 22 16:44:02 juju-e4d256-prod-github-runner-207 kernel: [40816.598501] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 16:44:02 juju-e4d256-prod-github-runner-207 kernel: [40816.599412] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 16:44:02 juju-e4d256-prod-github-runner-207 kernel: [40816.600333] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 16:44:02 juju-e4d256-prod-github-runner-207 kernel: [40816.601233] vcpu_run+0x62/0x2c0 [kvm] Aug 22 16:44:02 juju-e4d256-prod-github-runner-207 kernel: [40816.602040] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 16:44:02 juju-e4d256-prod-github-runner-207 kernel: [40816.602871] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 16:44:02 juju-e4d256-prod-github-runner-207 kernel: [40816.603724] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 16:44:02 juju-e4d256-prod-github-runner-207 kernel: [40816.604524] ? __seccomp_filter+0x4a/0x4a0 Aug 22 16:44:02 juju-e4d256-prod-github-runner-207 kernel: [40816.605264] ? __fget_files+0x86/0xc0 Aug 22 16:44:02 juju-e4d256-prod-github-runner-207 kernel: [40816.605966] __x64_sys_ioctl+0x95/0xd0 Aug 22 16:44:02 juju-e4d256-prod-github-runner-207 kernel: [40816.606672] do_syscall_64+0x5c/0xc0 Aug 22 16:44:02 juju-e4d256-prod-github-runner-207 kernel: [40816.607400] ? do_futex+0x162/0x1f0 Aug 22 16:44:02 juju-e4d256-prod-github-runner-207 kernel: [40816.608051] ? __x64_sys_futex+0x78/0x1e0 Aug 22 16:44:02 juju-e4d256-prod-github-runner-207 kernel: [40816.608722] ? __secure_computing+0xa9/0x120 Aug 22 16:44:02 juju-e4d256-prod-github-runner-207 kernel: [40816.609407] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 16:44:02 juju-e4d256-prod-github-runner-207 kernel: [40816.610176] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:44:02 juju-e4d256-prod-github-runner-207 kernel: [40816.610895] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:44:02 juju-e4d256-prod-github-runner-207 kernel: [40816.611608] ? do_syscall_64+0x69/0xc0 Aug 22 16:44:02 juju-e4d256-prod-github-runner-207 kernel: [40816.612250] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:44:02 juju-e4d256-prod-github-runner-207 kernel: [40816.612958] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:44:02 juju-e4d256-prod-github-runner-207 kernel: [40816.613651] ? do_syscall_64+0x69/0xc0 Aug 22 16:44:02 juju-e4d256-prod-github-runner-207 kernel: [40816.614282] ? do_syscall_64+0x69/0xc0 Aug 22 16:44:02 juju-e4d256-prod-github-runner-207 kernel: [40816.614904] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 16:44:02 juju-e4d256-prod-github-runner-207 kernel: [40816.615605] RIP: 0033:0x7faa5d0edaff Aug 22 16:44:02 juju-e4d256-prod-github-runner-207 kernel: [40816.616227] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 16:44:02 juju-e4d256-prod-github-runner-207 kernel: [40816.618210] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 16:44:02 juju-e4d256-prod-github-runner-207 kernel: [40816.619115] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 16:44:02 juju-e4d256-prod-github-runner-207 kernel: [40816.620000] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 16:44:02 juju-e4d256-prod-github-runner-207 kernel: [40816.621019] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 16:44:02 juju-e4d256-prod-github-runner-207 kernel: [40816.621901] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 16:44:02 juju-e4d256-prod-github-runner-207 kernel: [40816.622880] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 16:44:02 juju-e4d256-prod-github-runner-207 kernel: [40816.623780] Aug 22 16:44:30 juju-e4d256-prod-github-runner-207 kernel: [40844.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 37931s! [qemu-system-x86:6715] Aug 22 16:44:30 juju-e4d256-prod-github-runner-207 kernel: [40844.543768] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 16:44:30 juju-e4d256-prod-github-runner-207 kernel: [40844.544036] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 16:44:30 juju-e4d256-prod-github-runner-207 kernel: [40844.556167] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 16:44:30 juju-e4d256-prod-github-runner-207 kernel: [40844.557432] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 16:44:30 juju-e4d256-prod-github-runner-207 kernel: [40844.558667] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:44:30 juju-e4d256-prod-github-runner-207 kernel: [40844.559723] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 16:44:30 juju-e4d256-prod-github-runner-207 kernel: [40844.562297] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 16:44:30 juju-e4d256-prod-github-runner-207 kernel: [40844.563344] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 16:44:30 juju-e4d256-prod-github-runner-207 kernel: [40844.564504] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 16:44:30 juju-e4d256-prod-github-runner-207 kernel: [40844.565668] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 16:44:30 juju-e4d256-prod-github-runner-207 kernel: [40844.566842] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 16:44:30 juju-e4d256-prod-github-runner-207 kernel: [40844.568002] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 16:44:30 juju-e4d256-prod-github-runner-207 kernel: [40844.569171] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 16:44:30 juju-e4d256-prod-github-runner-207 kernel: [40844.570424] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 16:44:30 juju-e4d256-prod-github-runner-207 kernel: [40844.571528] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 16:44:30 juju-e4d256-prod-github-runner-207 kernel: [40844.572721] Call Trace: Aug 22 16:44:30 juju-e4d256-prod-github-runner-207 kernel: [40844.573638] Aug 22 16:44:30 juju-e4d256-prod-github-runner-207 kernel: [40844.574546] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:44:30 juju-e4d256-prod-github-runner-207 kernel: [40844.575581] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:44:30 juju-e4d256-prod-github-runner-207 kernel: [40844.576612] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:44:30 juju-e4d256-prod-github-runner-207 kernel: [40844.577705] ? show_regs.part.0+0x23/0x29 Aug 22 16:44:30 juju-e4d256-prod-github-runner-207 kernel: [40844.578716] ? show_regs.cold+0x8/0xd Aug 22 16:44:30 juju-e4d256-prod-github-runner-207 kernel: [40844.579687] ? watchdog_timer_fn+0x1be/0x220 Aug 22 16:44:30 juju-e4d256-prod-github-runner-207 kernel: [40844.580698] ? lockup_detector_update_enable+0x60/0x60 Aug 22 16:44:30 juju-e4d256-prod-github-runner-207 kernel: [40844.581771] ? __hrtimer_run_queues+0x107/0x230 Aug 22 16:44:30 juju-e4d256-prod-github-runner-207 kernel: [40844.582815] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 16:44:30 juju-e4d256-prod-github-runner-207 kernel: [40844.583843] ? hrtimer_interrupt+0x101/0x220 Aug 22 16:44:30 juju-e4d256-prod-github-runner-207 kernel: [40844.584856] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 16:44:30 juju-e4d256-prod-github-runner-207 kernel: [40844.585944] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 16:44:30 juju-e4d256-prod-github-runner-207 kernel: [40844.586997] Aug 22 16:44:30 juju-e4d256-prod-github-runner-207 kernel: [40844.587855] Aug 22 16:44:30 juju-e4d256-prod-github-runner-207 kernel: [40844.588692] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 16:44:30 juju-e4d256-prod-github-runner-207 kernel: [40844.589725] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:44:30 juju-e4d256-prod-github-runner-207 kernel: [40844.590781] ? _raw_spin_lock+0x22/0x30 Aug 22 16:44:30 juju-e4d256-prod-github-runner-207 kernel: [40844.591728] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:44:30 juju-e4d256-prod-github-runner-207 kernel: [40844.592751] direct_page_fault+0x206/0x310 [kvm] Aug 22 16:44:30 juju-e4d256-prod-github-runner-207 kernel: [40844.593774] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 16:44:30 juju-e4d256-prod-github-runner-207 kernel: [40844.594793] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 16:44:30 juju-e4d256-prod-github-runner-207 kernel: [40844.595799] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 16:44:30 juju-e4d256-prod-github-runner-207 kernel: [40844.596807] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 16:44:30 juju-e4d256-prod-github-runner-207 kernel: [40844.597758] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 16:44:30 juju-e4d256-prod-github-runner-207 kernel: [40844.598748] handle_exit+0x98/0x230 [kvm_amd] Aug 22 16:44:30 juju-e4d256-prod-github-runner-207 kernel: [40844.599640] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 16:44:30 juju-e4d256-prod-github-runner-207 kernel: [40844.600555] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 16:44:30 juju-e4d256-prod-github-runner-207 kernel: [40844.601482] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 16:44:30 juju-e4d256-prod-github-runner-207 kernel: [40844.602407] vcpu_run+0x62/0x2c0 [kvm] Aug 22 16:44:30 juju-e4d256-prod-github-runner-207 kernel: [40844.603221] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 16:44:30 juju-e4d256-prod-github-runner-207 kernel: [40844.604036] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 16:44:30 juju-e4d256-prod-github-runner-207 kernel: [40844.604891] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 16:44:30 juju-e4d256-prod-github-runner-207 kernel: [40844.605691] ? __seccomp_filter+0x4a/0x4a0 Aug 22 16:44:30 juju-e4d256-prod-github-runner-207 kernel: [40844.606449] ? __fget_files+0x86/0xc0 Aug 22 16:44:30 juju-e4d256-prod-github-runner-207 kernel: [40844.607168] __x64_sys_ioctl+0x95/0xd0 Aug 22 16:44:30 juju-e4d256-prod-github-runner-207 kernel: [40844.607862] do_syscall_64+0x5c/0xc0 Aug 22 16:44:30 juju-e4d256-prod-github-runner-207 kernel: [40844.608529] ? do_futex+0x162/0x1f0 Aug 22 16:44:30 juju-e4d256-prod-github-runner-207 kernel: [40844.609179] ? __x64_sys_futex+0x78/0x1e0 Aug 22 16:44:30 juju-e4d256-prod-github-runner-207 kernel: [40844.609867] ? __secure_computing+0xa9/0x120 Aug 22 16:44:30 juju-e4d256-prod-github-runner-207 kernel: [40844.610557] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 16:44:30 juju-e4d256-prod-github-runner-207 kernel: [40844.611326] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:44:30 juju-e4d256-prod-github-runner-207 kernel: [40844.612054] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:44:30 juju-e4d256-prod-github-runner-207 kernel: [40844.612776] ? do_syscall_64+0x69/0xc0 Aug 22 16:44:30 juju-e4d256-prod-github-runner-207 kernel: [40844.613423] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:44:30 juju-e4d256-prod-github-runner-207 kernel: [40844.614144] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:44:30 juju-e4d256-prod-github-runner-207 kernel: [40844.614843] ? do_syscall_64+0x69/0xc0 Aug 22 16:44:30 juju-e4d256-prod-github-runner-207 kernel: [40844.615470] ? do_syscall_64+0x69/0xc0 Aug 22 16:44:30 juju-e4d256-prod-github-runner-207 kernel: [40844.616098] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 16:44:30 juju-e4d256-prod-github-runner-207 kernel: [40844.616809] RIP: 0033:0x7faa5d0edaff Aug 22 16:44:30 juju-e4d256-prod-github-runner-207 kernel: [40844.617490] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 16:44:30 juju-e4d256-prod-github-runner-207 kernel: [40844.619500] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 16:44:30 juju-e4d256-prod-github-runner-207 kernel: [40844.620413] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 16:44:30 juju-e4d256-prod-github-runner-207 kernel: [40844.621312] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 16:44:30 juju-e4d256-prod-github-runner-207 kernel: [40844.623102] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 16:44:30 juju-e4d256-prod-github-runner-207 kernel: [40844.624011] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 16:44:30 juju-e4d256-prod-github-runner-207 kernel: [40844.624899] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 16:44:30 juju-e4d256-prod-github-runner-207 kernel: [40844.625812] Aug 22 16:44:46 juju-e4d256-prod-github-runner-207 kernel: [40859.912706] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 16:44:46 juju-e4d256-prod-github-runner-207 kernel: [40859.913686] rcu: 1-....: (10153711 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=4911205 Aug 22 16:44:46 juju-e4d256-prod-github-runner-207 kernel: [40859.914821] (t=10185678 jiffies g=23269 q=41412) Aug 22 16:44:46 juju-e4d256-prod-github-runner-207 kernel: [40859.915606] NMI backtrace for cpu 1 Aug 22 16:44:46 juju-e4d256-prod-github-runner-207 kernel: [40859.916315] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 16:44:46 juju-e4d256-prod-github-runner-207 kernel: [40859.917428] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 16:44:46 juju-e4d256-prod-github-runner-207 kernel: [40859.918498] Call Trace: Aug 22 16:44:46 juju-e4d256-prod-github-runner-207 kernel: [40859.919172] Aug 22 16:44:46 juju-e4d256-prod-github-runner-207 kernel: [40859.919817] show_stack+0x52/0x5c Aug 22 16:44:46 juju-e4d256-prod-github-runner-207 kernel: [40859.920547] dump_stack_lvl+0x4a/0x63 Aug 22 16:44:46 juju-e4d256-prod-github-runner-207 kernel: [40859.921298] dump_stack+0x10/0x16 Aug 22 16:44:46 juju-e4d256-prod-github-runner-207 kernel: [40859.922028] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 16:44:46 juju-e4d256-prod-github-runner-207 kernel: [40859.922812] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 16:44:46 juju-e4d256-prod-github-runner-207 kernel: [40859.923589] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 16:44:46 juju-e4d256-prod-github-runner-207 kernel: [40859.924414] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 16:44:46 juju-e4d256-prod-github-runner-207 kernel: [40859.925233] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 16:44:46 juju-e4d256-prod-github-runner-207 kernel: [40859.926048] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 16:44:46 juju-e4d256-prod-github-runner-207 kernel: [40859.926823] print_cpu_stall.cold+0x2f/0xe2 Aug 22 16:44:46 juju-e4d256-prod-github-runner-207 kernel: [40859.927592] ? timekeeping_update+0xf7/0x150 Aug 22 16:44:46 juju-e4d256-prod-github-runner-207 kernel: [40859.928362] check_cpu_stall+0x109/0x270 Aug 22 16:44:46 juju-e4d256-prod-github-runner-207 kernel: [40859.929107] rcu_sched_clock_irq+0x9a/0x250 Aug 22 16:44:46 juju-e4d256-prod-github-runner-207 kernel: [40859.929882] update_process_times+0x94/0xd0 Aug 22 16:44:46 juju-e4d256-prod-github-runner-207 kernel: [40859.930646] tick_sched_handle+0x29/0x70 Aug 22 16:44:46 juju-e4d256-prod-github-runner-207 kernel: [40859.931391] tick_sched_timer+0x8c/0xc0 Aug 22 16:44:46 juju-e4d256-prod-github-runner-207 kernel: [40859.932127] ? tick_nohz_handler+0xb0/0xb0 Aug 22 16:44:46 juju-e4d256-prod-github-runner-207 kernel: [40859.932882] __hrtimer_run_queues+0x107/0x230 Aug 22 16:44:46 juju-e4d256-prod-github-runner-207 kernel: [40859.933667] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 16:44:46 juju-e4d256-prod-github-runner-207 kernel: [40859.934442] hrtimer_interrupt+0x101/0x220 Aug 22 16:44:46 juju-e4d256-prod-github-runner-207 kernel: [40859.935201] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 16:44:46 juju-e4d256-prod-github-runner-207 kernel: [40859.936017] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 16:44:46 juju-e4d256-prod-github-runner-207 kernel: [40859.936824] Aug 22 16:44:46 juju-e4d256-prod-github-runner-207 kernel: [40859.937459] Aug 22 16:44:46 juju-e4d256-prod-github-runner-207 kernel: [40859.938106] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 16:44:46 juju-e4d256-prod-github-runner-207 kernel: [40859.938923] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:44:46 juju-e4d256-prod-github-runner-207 kernel: [40859.939800] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 16:44:46 juju-e4d256-prod-github-runner-207 kernel: [40859.942013] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 16:44:46 juju-e4d256-prod-github-runner-207 kernel: [40859.942885] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 16:44:46 juju-e4d256-prod-github-runner-207 kernel: [40859.943875] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 16:44:46 juju-e4d256-prod-github-runner-207 kernel: [40859.944847] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 16:44:46 juju-e4d256-prod-github-runner-207 kernel: [40859.945818] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 16:44:46 juju-e4d256-prod-github-runner-207 kernel: [40859.946777] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 16:44:46 juju-e4d256-prod-github-runner-207 kernel: [40859.947729] ? _raw_spin_lock+0x22/0x30 Aug 22 16:44:46 juju-e4d256-prod-github-runner-207 kernel: [40859.948494] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:44:46 juju-e4d256-prod-github-runner-207 kernel: [40859.949328] direct_page_fault+0x206/0x310 [kvm] Aug 22 16:44:46 juju-e4d256-prod-github-runner-207 kernel: [40859.950174] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 16:44:46 juju-e4d256-prod-github-runner-207 kernel: [40859.950999] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 16:44:46 juju-e4d256-prod-github-runner-207 kernel: [40859.951819] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 16:44:46 juju-e4d256-prod-github-runner-207 kernel: [40859.952627] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 16:44:46 juju-e4d256-prod-github-runner-207 kernel: [40859.953411] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 16:44:46 juju-e4d256-prod-github-runner-207 kernel: [40859.954243] handle_exit+0x98/0x230 [kvm_amd] Aug 22 16:44:46 juju-e4d256-prod-github-runner-207 kernel: [40859.954994] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 16:44:46 juju-e4d256-prod-github-runner-207 kernel: [40859.955775] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 16:44:46 juju-e4d256-prod-github-runner-207 kernel: [40859.956572] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 16:44:46 juju-e4d256-prod-github-runner-207 kernel: [40859.957354] vcpu_run+0x62/0x2c0 [kvm] Aug 22 16:44:46 juju-e4d256-prod-github-runner-207 kernel: [40859.958084] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 16:44:46 juju-e4d256-prod-github-runner-207 kernel: [40859.958823] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 16:44:46 juju-e4d256-prod-github-runner-207 kernel: [40859.959622] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 16:44:46 juju-e4d256-prod-github-runner-207 kernel: [40859.960380] ? __seccomp_filter+0x4a/0x4a0 Aug 22 16:44:46 juju-e4d256-prod-github-runner-207 kernel: [40859.961138] ? __fget_files+0x86/0xc0 Aug 22 16:44:46 juju-e4d256-prod-github-runner-207 kernel: [40859.961844] __x64_sys_ioctl+0x95/0xd0 Aug 22 16:44:46 juju-e4d256-prod-github-runner-207 kernel: [40859.962538] do_syscall_64+0x5c/0xc0 Aug 22 16:44:46 juju-e4d256-prod-github-runner-207 kernel: [40859.963219] ? do_futex+0x162/0x1f0 Aug 22 16:44:46 juju-e4d256-prod-github-runner-207 kernel: [40859.963894] ? __x64_sys_futex+0x78/0x1e0 Aug 22 16:44:46 juju-e4d256-prod-github-runner-207 kernel: [40859.964593] ? __secure_computing+0xa9/0x120 Aug 22 16:44:46 juju-e4d256-prod-github-runner-207 kernel: [40859.965309] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 16:44:46 juju-e4d256-prod-github-runner-207 kernel: [40859.966113] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:44:46 juju-e4d256-prod-github-runner-207 kernel: [40859.966874] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:44:46 juju-e4d256-prod-github-runner-207 kernel: [40859.967631] ? do_syscall_64+0x69/0xc0 Aug 22 16:44:46 juju-e4d256-prod-github-runner-207 kernel: [40859.968326] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:44:46 juju-e4d256-prod-github-runner-207 kernel: [40859.969089] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:44:46 juju-e4d256-prod-github-runner-207 kernel: [40859.969860] ? do_syscall_64+0x69/0xc0 Aug 22 16:44:46 juju-e4d256-prod-github-runner-207 kernel: [40859.970554] ? do_syscall_64+0x69/0xc0 Aug 22 16:44:46 juju-e4d256-prod-github-runner-207 kernel: [40859.971245] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 16:44:46 juju-e4d256-prod-github-runner-207 kernel: [40859.972012] RIP: 0033:0x7faa5d0edaff Aug 22 16:44:46 juju-e4d256-prod-github-runner-207 kernel: [40859.972695] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 16:44:46 juju-e4d256-prod-github-runner-207 kernel: [40859.974909] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 16:44:46 juju-e4d256-prod-github-runner-207 kernel: [40859.975883] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 16:44:46 juju-e4d256-prod-github-runner-207 kernel: [40859.976828] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 16:44:46 juju-e4d256-prod-github-runner-207 kernel: [40859.977800] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 16:44:46 juju-e4d256-prod-github-runner-207 kernel: [40859.978741] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 16:44:46 juju-e4d256-prod-github-runner-207 kernel: [40859.979677] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 16:44:46 juju-e4d256-prod-github-runner-207 kernel: [40859.980591] Aug 22 16:45:10 juju-e4d256-prod-github-runner-207 kernel: [40884.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 37968s! [qemu-system-x86:6715] Aug 22 16:45:10 juju-e4d256-prod-github-runner-207 kernel: [40884.543113] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 16:45:10 juju-e4d256-prod-github-runner-207 kernel: [40884.543183] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 16:45:10 juju-e4d256-prod-github-runner-207 kernel: [40884.555423] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 16:45:10 juju-e4d256-prod-github-runner-207 kernel: [40884.556704] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 16:45:10 juju-e4d256-prod-github-runner-207 kernel: [40884.557962] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:45:10 juju-e4d256-prod-github-runner-207 kernel: [40884.559026] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 16:45:10 juju-e4d256-prod-github-runner-207 kernel: [40884.561610] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 16:45:10 juju-e4d256-prod-github-runner-207 kernel: [40884.562684] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 16:45:10 juju-e4d256-prod-github-runner-207 kernel: [40884.563853] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 16:45:10 juju-e4d256-prod-github-runner-207 kernel: [40884.565019] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 16:45:10 juju-e4d256-prod-github-runner-207 kernel: [40884.566218] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 16:45:10 juju-e4d256-prod-github-runner-207 kernel: [40884.567401] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 16:45:10 juju-e4d256-prod-github-runner-207 kernel: [40884.568589] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 16:45:10 juju-e4d256-prod-github-runner-207 kernel: [40884.569846] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 16:45:10 juju-e4d256-prod-github-runner-207 kernel: [40884.570954] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 16:45:10 juju-e4d256-prod-github-runner-207 kernel: [40884.572223] Call Trace: Aug 22 16:45:10 juju-e4d256-prod-github-runner-207 kernel: [40884.573170] Aug 22 16:45:10 juju-e4d256-prod-github-runner-207 kernel: [40884.574087] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:45:10 juju-e4d256-prod-github-runner-207 kernel: [40884.575136] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:45:10 juju-e4d256-prod-github-runner-207 kernel: [40884.576164] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:45:10 juju-e4d256-prod-github-runner-207 kernel: [40884.577410] ? show_regs.part.0+0x23/0x29 Aug 22 16:45:10 juju-e4d256-prod-github-runner-207 kernel: [40884.578533] ? show_regs.cold+0x8/0xd Aug 22 16:45:10 juju-e4d256-prod-github-runner-207 kernel: [40884.579599] ? watchdog_timer_fn+0x1be/0x220 Aug 22 16:45:10 juju-e4d256-prod-github-runner-207 kernel: [40884.580701] ? lockup_detector_update_enable+0x60/0x60 Aug 22 16:45:10 juju-e4d256-prod-github-runner-207 kernel: [40884.581889] ? __hrtimer_run_queues+0x107/0x230 Aug 22 16:45:10 juju-e4d256-prod-github-runner-207 kernel: [40884.583076] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 16:45:10 juju-e4d256-prod-github-runner-207 kernel: [40884.584226] ? hrtimer_interrupt+0x101/0x220 Aug 22 16:45:10 juju-e4d256-prod-github-runner-207 kernel: [40884.585361] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 16:45:10 juju-e4d256-prod-github-runner-207 kernel: [40884.586532] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 16:45:10 juju-e4d256-prod-github-runner-207 kernel: [40884.587679] Aug 22 16:45:10 juju-e4d256-prod-github-runner-207 kernel: [40884.588585] Aug 22 16:45:10 juju-e4d256-prod-github-runner-207 kernel: [40884.589490] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 16:45:10 juju-e4d256-prod-github-runner-207 kernel: [40884.590626] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:45:10 juju-e4d256-prod-github-runner-207 kernel: [40884.591772] ? _raw_spin_lock+0x22/0x30 Aug 22 16:45:10 juju-e4d256-prod-github-runner-207 kernel: [40884.592799] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:45:10 juju-e4d256-prod-github-runner-207 kernel: [40884.593933] direct_page_fault+0x206/0x310 [kvm] Aug 22 16:45:10 juju-e4d256-prod-github-runner-207 kernel: [40884.595050] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 16:45:10 juju-e4d256-prod-github-runner-207 kernel: [40884.596151] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 16:45:10 juju-e4d256-prod-github-runner-207 kernel: [40884.597247] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 16:45:10 juju-e4d256-prod-github-runner-207 kernel: [40884.598337] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 16:45:10 juju-e4d256-prod-github-runner-207 kernel: [40884.599390] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 16:45:10 juju-e4d256-prod-github-runner-207 kernel: [40884.600478] handle_exit+0x98/0x230 [kvm_amd] Aug 22 16:45:10 juju-e4d256-prod-github-runner-207 kernel: [40884.601491] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 16:45:10 juju-e4d256-prod-github-runner-207 kernel: [40884.602507] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 16:45:10 juju-e4d256-prod-github-runner-207 kernel: [40884.603538] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 16:45:10 juju-e4d256-prod-github-runner-207 kernel: [40884.604548] vcpu_run+0x62/0x2c0 [kvm] Aug 22 16:45:10 juju-e4d256-prod-github-runner-207 kernel: [40884.605479] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 16:45:10 juju-e4d256-prod-github-runner-207 kernel: [40884.606381] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 16:45:10 juju-e4d256-prod-github-runner-207 kernel: [40884.607341] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 16:45:10 juju-e4d256-prod-github-runner-207 kernel: [40884.608227] ? __seccomp_filter+0x4a/0x4a0 Aug 22 16:45:10 juju-e4d256-prod-github-runner-207 kernel: [40884.609053] ? __fget_files+0x86/0xc0 Aug 22 16:45:10 juju-e4d256-prod-github-runner-207 kernel: [40884.609860] __x64_sys_ioctl+0x95/0xd0 Aug 22 16:45:10 juju-e4d256-prod-github-runner-207 kernel: [40884.610630] do_syscall_64+0x5c/0xc0 Aug 22 16:45:10 juju-e4d256-prod-github-runner-207 kernel: [40884.611378] ? do_futex+0x162/0x1f0 Aug 22 16:45:10 juju-e4d256-prod-github-runner-207 kernel: [40884.612100] ? __x64_sys_futex+0x78/0x1e0 Aug 22 16:45:10 juju-e4d256-prod-github-runner-207 kernel: [40884.612854] ? __secure_computing+0xa9/0x120 Aug 22 16:45:10 juju-e4d256-prod-github-runner-207 kernel: [40884.613772] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 16:45:10 juju-e4d256-prod-github-runner-207 kernel: [40884.614741] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:45:10 juju-e4d256-prod-github-runner-207 kernel: [40884.615577] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:45:10 juju-e4d256-prod-github-runner-207 kernel: [40884.616400] ? do_syscall_64+0x69/0xc0 Aug 22 16:45:10 juju-e4d256-prod-github-runner-207 kernel: [40884.617119] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:45:10 juju-e4d256-prod-github-runner-207 kernel: [40884.617935] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:45:10 juju-e4d256-prod-github-runner-207 kernel: [40884.618722] ? do_syscall_64+0x69/0xc0 Aug 22 16:45:10 juju-e4d256-prod-github-runner-207 kernel: [40884.619418] ? do_syscall_64+0x69/0xc0 Aug 22 16:45:10 juju-e4d256-prod-github-runner-207 kernel: [40884.620111] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 16:45:10 juju-e4d256-prod-github-runner-207 kernel: [40884.620915] RIP: 0033:0x7faa5d0edaff Aug 22 16:45:10 juju-e4d256-prod-github-runner-207 kernel: [40884.621742] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 16:45:10 juju-e4d256-prod-github-runner-207 kernel: [40884.624057] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 16:45:10 juju-e4d256-prod-github-runner-207 kernel: [40884.625104] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 16:45:10 juju-e4d256-prod-github-runner-207 kernel: [40884.626140] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 16:45:10 juju-e4d256-prod-github-runner-207 kernel: [40884.627169] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 16:45:10 juju-e4d256-prod-github-runner-207 kernel: [40884.628192] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 16:45:10 juju-e4d256-prod-github-runner-207 kernel: [40884.629212] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 16:45:10 juju-e4d256-prod-github-runner-207 kernel: [40884.630452] Aug 22 16:45:38 juju-e4d256-prod-github-runner-207 kernel: [40912.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 37994s! [qemu-system-x86:6715] Aug 22 16:45:38 juju-e4d256-prod-github-runner-207 kernel: [40912.543128] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 16:45:38 juju-e4d256-prod-github-runner-207 kernel: [40912.543197] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 16:45:38 juju-e4d256-prod-github-runner-207 kernel: [40912.555255] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 16:45:38 juju-e4d256-prod-github-runner-207 kernel: [40912.556525] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 16:45:38 juju-e4d256-prod-github-runner-207 kernel: [40912.557759] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:45:38 juju-e4d256-prod-github-runner-207 kernel: [40912.558819] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 16:45:38 juju-e4d256-prod-github-runner-207 kernel: [40912.561376] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 16:45:38 juju-e4d256-prod-github-runner-207 kernel: [40912.562425] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 16:45:38 juju-e4d256-prod-github-runner-207 kernel: [40912.563595] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 16:45:38 juju-e4d256-prod-github-runner-207 kernel: [40912.564759] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 16:45:38 juju-e4d256-prod-github-runner-207 kernel: [40912.565932] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 16:45:38 juju-e4d256-prod-github-runner-207 kernel: [40912.567097] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 16:45:38 juju-e4d256-prod-github-runner-207 kernel: [40912.568267] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 16:45:38 juju-e4d256-prod-github-runner-207 kernel: [40912.569518] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 16:45:38 juju-e4d256-prod-github-runner-207 kernel: [40912.570625] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 16:45:38 juju-e4d256-prod-github-runner-207 kernel: [40912.571821] Call Trace: Aug 22 16:45:38 juju-e4d256-prod-github-runner-207 kernel: [40912.572739] Aug 22 16:45:38 juju-e4d256-prod-github-runner-207 kernel: [40912.573638] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:45:38 juju-e4d256-prod-github-runner-207 kernel: [40912.574673] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:45:38 juju-e4d256-prod-github-runner-207 kernel: [40912.575691] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:45:38 juju-e4d256-prod-github-runner-207 kernel: [40912.576769] ? show_regs.part.0+0x23/0x29 Aug 22 16:45:38 juju-e4d256-prod-github-runner-207 kernel: [40912.577785] ? show_regs.cold+0x8/0xd Aug 22 16:45:38 juju-e4d256-prod-github-runner-207 kernel: [40912.578762] ? watchdog_timer_fn+0x1be/0x220 Aug 22 16:45:38 juju-e4d256-prod-github-runner-207 kernel: [40912.579774] ? lockup_detector_update_enable+0x60/0x60 Aug 22 16:45:38 juju-e4d256-prod-github-runner-207 kernel: [40912.580845] ? __hrtimer_run_queues+0x107/0x230 Aug 22 16:45:38 juju-e4d256-prod-github-runner-207 kernel: [40912.581892] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 16:45:38 juju-e4d256-prod-github-runner-207 kernel: [40912.582914] ? hrtimer_interrupt+0x101/0x220 Aug 22 16:45:38 juju-e4d256-prod-github-runner-207 kernel: [40912.583933] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 16:45:38 juju-e4d256-prod-github-runner-207 kernel: [40912.585005] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 16:45:38 juju-e4d256-prod-github-runner-207 kernel: [40912.586069] Aug 22 16:45:38 juju-e4d256-prod-github-runner-207 kernel: [40912.586921] Aug 22 16:45:38 juju-e4d256-prod-github-runner-207 kernel: [40912.587757] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 16:45:38 juju-e4d256-prod-github-runner-207 kernel: [40912.588788] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:45:38 juju-e4d256-prod-github-runner-207 kernel: [40912.589835] ? _raw_spin_lock+0x22/0x30 Aug 22 16:45:38 juju-e4d256-prod-github-runner-207 kernel: [40912.590783] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:45:38 juju-e4d256-prod-github-runner-207 kernel: [40912.591800] direct_page_fault+0x206/0x310 [kvm] Aug 22 16:45:38 juju-e4d256-prod-github-runner-207 kernel: [40912.592822] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 16:45:38 juju-e4d256-prod-github-runner-207 kernel: [40912.593846] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 16:45:38 juju-e4d256-prod-github-runner-207 kernel: [40912.594845] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 16:45:38 juju-e4d256-prod-github-runner-207 kernel: [40912.595817] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 16:45:38 juju-e4d256-prod-github-runner-207 kernel: [40912.596762] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 16:45:38 juju-e4d256-prod-github-runner-207 kernel: [40912.597764] handle_exit+0x98/0x230 [kvm_amd] Aug 22 16:45:38 juju-e4d256-prod-github-runner-207 kernel: [40912.598655] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 16:45:38 juju-e4d256-prod-github-runner-207 kernel: [40912.599573] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 16:45:38 juju-e4d256-prod-github-runner-207 kernel: [40912.600498] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 16:45:38 juju-e4d256-prod-github-runner-207 kernel: [40912.601415] vcpu_run+0x62/0x2c0 [kvm] Aug 22 16:45:38 juju-e4d256-prod-github-runner-207 kernel: [40912.602231] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 16:45:38 juju-e4d256-prod-github-runner-207 kernel: [40912.603042] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 16:45:38 juju-e4d256-prod-github-runner-207 kernel: [40912.603893] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 16:45:38 juju-e4d256-prod-github-runner-207 kernel: [40912.604694] ? __seccomp_filter+0x4a/0x4a0 Aug 22 16:45:38 juju-e4d256-prod-github-runner-207 kernel: [40912.605468] ? __fget_files+0x86/0xc0 Aug 22 16:45:38 juju-e4d256-prod-github-runner-207 kernel: [40912.606175] __x64_sys_ioctl+0x95/0xd0 Aug 22 16:45:38 juju-e4d256-prod-github-runner-207 kernel: [40912.606872] do_syscall_64+0x5c/0xc0 Aug 22 16:45:38 juju-e4d256-prod-github-runner-207 kernel: [40912.607541] ? do_futex+0x162/0x1f0 Aug 22 16:45:38 juju-e4d256-prod-github-runner-207 kernel: [40912.608188] ? __x64_sys_futex+0x78/0x1e0 Aug 22 16:45:38 juju-e4d256-prod-github-runner-207 kernel: [40912.608862] ? __secure_computing+0xa9/0x120 Aug 22 16:45:38 juju-e4d256-prod-github-runner-207 kernel: [40912.609567] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 16:45:38 juju-e4d256-prod-github-runner-207 kernel: [40912.610327] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:45:38 juju-e4d256-prod-github-runner-207 kernel: [40912.611052] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:45:38 juju-e4d256-prod-github-runner-207 kernel: [40912.611855] ? do_syscall_64+0x69/0xc0 Aug 22 16:45:38 juju-e4d256-prod-github-runner-207 kernel: [40912.612512] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:45:38 juju-e4d256-prod-github-runner-207 kernel: [40912.613228] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:45:38 juju-e4d256-prod-github-runner-207 kernel: [40912.613923] ? do_syscall_64+0x69/0xc0 Aug 22 16:45:38 juju-e4d256-prod-github-runner-207 kernel: [40912.614548] ? do_syscall_64+0x69/0xc0 Aug 22 16:45:38 juju-e4d256-prod-github-runner-207 kernel: [40912.615171] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 16:45:38 juju-e4d256-prod-github-runner-207 kernel: [40912.615877] RIP: 0033:0x7faa5d0edaff Aug 22 16:45:38 juju-e4d256-prod-github-runner-207 kernel: [40912.616511] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 16:45:38 juju-e4d256-prod-github-runner-207 kernel: [40912.618512] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 16:45:38 juju-e4d256-prod-github-runner-207 kernel: [40912.619422] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 16:45:38 juju-e4d256-prod-github-runner-207 kernel: [40912.620311] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 16:45:38 juju-e4d256-prod-github-runner-207 kernel: [40912.621207] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 16:45:38 juju-e4d256-prod-github-runner-207 kernel: [40912.622099] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 16:45:38 juju-e4d256-prod-github-runner-207 kernel: [40912.622994] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 16:45:38 juju-e4d256-prod-github-runner-207 kernel: [40912.623887] Aug 22 16:46:06 juju-e4d256-prod-github-runner-207 kernel: [40940.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 38020s! [qemu-system-x86:6715] Aug 22 16:46:06 juju-e4d256-prod-github-runner-207 kernel: [40940.543709] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 16:46:06 juju-e4d256-prod-github-runner-207 kernel: [40940.543957] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 16:46:06 juju-e4d256-prod-github-runner-207 kernel: [40940.556041] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 16:46:06 juju-e4d256-prod-github-runner-207 kernel: [40940.557321] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 16:46:06 juju-e4d256-prod-github-runner-207 kernel: [40940.558549] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:46:06 juju-e4d256-prod-github-runner-207 kernel: [40940.559607] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 16:46:06 juju-e4d256-prod-github-runner-207 kernel: [40940.562171] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 16:46:06 juju-e4d256-prod-github-runner-207 kernel: [40940.563224] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 16:46:06 juju-e4d256-prod-github-runner-207 kernel: [40940.564389] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 16:46:06 juju-e4d256-prod-github-runner-207 kernel: [40940.565560] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 16:46:06 juju-e4d256-prod-github-runner-207 kernel: [40940.566724] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 16:46:06 juju-e4d256-prod-github-runner-207 kernel: [40940.567890] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 16:46:06 juju-e4d256-prod-github-runner-207 kernel: [40940.569078] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 16:46:06 juju-e4d256-prod-github-runner-207 kernel: [40940.570312] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 16:46:06 juju-e4d256-prod-github-runner-207 kernel: [40940.571408] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 16:46:06 juju-e4d256-prod-github-runner-207 kernel: [40940.572602] Call Trace: Aug 22 16:46:06 juju-e4d256-prod-github-runner-207 kernel: [40940.573539] Aug 22 16:46:06 juju-e4d256-prod-github-runner-207 kernel: [40940.574431] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:46:06 juju-e4d256-prod-github-runner-207 kernel: [40940.575461] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:46:06 juju-e4d256-prod-github-runner-207 kernel: [40940.576481] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:46:06 juju-e4d256-prod-github-runner-207 kernel: [40940.577583] ? show_regs.part.0+0x23/0x29 Aug 22 16:46:06 juju-e4d256-prod-github-runner-207 kernel: [40940.578580] ? show_regs.cold+0x8/0xd Aug 22 16:46:06 juju-e4d256-prod-github-runner-207 kernel: [40940.579557] ? watchdog_timer_fn+0x1be/0x220 Aug 22 16:46:06 juju-e4d256-prod-github-runner-207 kernel: [40940.580564] ? lockup_detector_update_enable+0x60/0x60 Aug 22 16:46:06 juju-e4d256-prod-github-runner-207 kernel: [40940.581637] ? __hrtimer_run_queues+0x107/0x230 Aug 22 16:46:06 juju-e4d256-prod-github-runner-207 kernel: [40940.582670] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 16:46:06 juju-e4d256-prod-github-runner-207 kernel: [40940.583692] ? hrtimer_interrupt+0x101/0x220 Aug 22 16:46:06 juju-e4d256-prod-github-runner-207 kernel: [40940.584705] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 16:46:06 juju-e4d256-prod-github-runner-207 kernel: [40940.585788] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 16:46:06 juju-e4d256-prod-github-runner-207 kernel: [40940.586831] Aug 22 16:46:06 juju-e4d256-prod-github-runner-207 kernel: [40940.587684] Aug 22 16:46:06 juju-e4d256-prod-github-runner-207 kernel: [40940.588521] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 16:46:06 juju-e4d256-prod-github-runner-207 kernel: [40940.589564] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:46:06 juju-e4d256-prod-github-runner-207 kernel: [40940.590602] ? _raw_spin_lock+0x22/0x30 Aug 22 16:46:06 juju-e4d256-prod-github-runner-207 kernel: [40940.591547] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:46:06 juju-e4d256-prod-github-runner-207 kernel: [40940.592566] direct_page_fault+0x206/0x310 [kvm] Aug 22 16:46:06 juju-e4d256-prod-github-runner-207 kernel: [40940.593598] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 16:46:06 juju-e4d256-prod-github-runner-207 kernel: [40940.594606] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 16:46:06 juju-e4d256-prod-github-runner-207 kernel: [40940.595606] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 16:46:06 juju-e4d256-prod-github-runner-207 kernel: [40940.596605] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 16:46:06 juju-e4d256-prod-github-runner-207 kernel: [40940.597571] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 16:46:06 juju-e4d256-prod-github-runner-207 kernel: [40940.598552] handle_exit+0x98/0x230 [kvm_amd] Aug 22 16:46:06 juju-e4d256-prod-github-runner-207 kernel: [40940.599447] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 16:46:06 juju-e4d256-prod-github-runner-207 kernel: [40940.600522] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 16:46:06 juju-e4d256-prod-github-runner-207 kernel: [40940.601472] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 16:46:06 juju-e4d256-prod-github-runner-207 kernel: [40940.602378] vcpu_run+0x62/0x2c0 [kvm] Aug 22 16:46:06 juju-e4d256-prod-github-runner-207 kernel: [40940.603195] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 16:46:06 juju-e4d256-prod-github-runner-207 kernel: [40940.604163] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 16:46:06 juju-e4d256-prod-github-runner-207 kernel: [40940.605040] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 16:46:06 juju-e4d256-prod-github-runner-207 kernel: [40940.605839] ? __seccomp_filter+0x4a/0x4a0 Aug 22 16:46:06 juju-e4d256-prod-github-runner-207 kernel: [40940.606582] ? __fget_files+0x86/0xc0 Aug 22 16:46:06 juju-e4d256-prod-github-runner-207 kernel: [40940.607291] __x64_sys_ioctl+0x95/0xd0 Aug 22 16:46:06 juju-e4d256-prod-github-runner-207 kernel: [40940.607986] do_syscall_64+0x5c/0xc0 Aug 22 16:46:06 juju-e4d256-prod-github-runner-207 kernel: [40940.608651] ? do_futex+0x162/0x1f0 Aug 22 16:46:06 juju-e4d256-prod-github-runner-207 kernel: [40940.609312] ? __x64_sys_futex+0x78/0x1e0 Aug 22 16:46:06 juju-e4d256-prod-github-runner-207 kernel: [40940.609987] ? __secure_computing+0xa9/0x120 Aug 22 16:46:06 juju-e4d256-prod-github-runner-207 kernel: [40940.610689] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 16:46:06 juju-e4d256-prod-github-runner-207 kernel: [40940.611453] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:46:06 juju-e4d256-prod-github-runner-207 kernel: [40940.612175] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:46:06 juju-e4d256-prod-github-runner-207 kernel: [40940.612911] ? do_syscall_64+0x69/0xc0 Aug 22 16:46:06 juju-e4d256-prod-github-runner-207 kernel: [40940.613557] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:46:06 juju-e4d256-prod-github-runner-207 kernel: [40940.614261] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:46:06 juju-e4d256-prod-github-runner-207 kernel: [40940.614982] ? do_syscall_64+0x69/0xc0 Aug 22 16:46:06 juju-e4d256-prod-github-runner-207 kernel: [40940.615697] ? do_syscall_64+0x69/0xc0 Aug 22 16:46:06 juju-e4d256-prod-github-runner-207 kernel: [40940.616453] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 16:46:06 juju-e4d256-prod-github-runner-207 kernel: [40940.617223] RIP: 0033:0x7faa5d0edaff Aug 22 16:46:06 juju-e4d256-prod-github-runner-207 kernel: [40940.617892] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 16:46:06 juju-e4d256-prod-github-runner-207 kernel: [40940.619889] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 16:46:06 juju-e4d256-prod-github-runner-207 kernel: [40940.620835] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 16:46:06 juju-e4d256-prod-github-runner-207 kernel: [40940.621727] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 16:46:06 juju-e4d256-prod-github-runner-207 kernel: [40940.622615] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 16:46:06 juju-e4d256-prod-github-runner-207 kernel: [40940.623503] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 16:46:06 juju-e4d256-prod-github-runner-207 kernel: [40940.624391] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 16:46:06 juju-e4d256-prod-github-runner-207 kernel: [40940.625299] Aug 22 16:46:34 juju-e4d256-prod-github-runner-207 kernel: [40968.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 38046s! [qemu-system-x86:6715] Aug 22 16:46:34 juju-e4d256-prod-github-runner-207 kernel: [40968.543082] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 16:46:34 juju-e4d256-prod-github-runner-207 kernel: [40968.543150] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 16:46:34 juju-e4d256-prod-github-runner-207 kernel: [40968.555147] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 16:46:34 juju-e4d256-prod-github-runner-207 kernel: [40968.556417] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 16:46:34 juju-e4d256-prod-github-runner-207 kernel: [40968.557639] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:46:34 juju-e4d256-prod-github-runner-207 kernel: [40968.558694] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 16:46:34 juju-e4d256-prod-github-runner-207 kernel: [40968.561255] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 16:46:34 juju-e4d256-prod-github-runner-207 kernel: [40968.562296] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 16:46:34 juju-e4d256-prod-github-runner-207 kernel: [40968.563454] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 16:46:34 juju-e4d256-prod-github-runner-207 kernel: [40968.564620] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 16:46:34 juju-e4d256-prod-github-runner-207 kernel: [40968.565781] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 16:46:34 juju-e4d256-prod-github-runner-207 kernel: [40968.566951] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 16:46:34 juju-e4d256-prod-github-runner-207 kernel: [40968.568127] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 16:46:34 juju-e4d256-prod-github-runner-207 kernel: [40968.569375] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 16:46:34 juju-e4d256-prod-github-runner-207 kernel: [40968.570469] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 16:46:34 juju-e4d256-prod-github-runner-207 kernel: [40968.571662] Call Trace: Aug 22 16:46:34 juju-e4d256-prod-github-runner-207 kernel: [40968.572577] Aug 22 16:46:34 juju-e4d256-prod-github-runner-207 kernel: [40968.573460] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:46:34 juju-e4d256-prod-github-runner-207 kernel: [40968.574487] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:46:34 juju-e4d256-prod-github-runner-207 kernel: [40968.575512] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:46:34 juju-e4d256-prod-github-runner-207 kernel: [40968.576591] ? show_regs.part.0+0x23/0x29 Aug 22 16:46:34 juju-e4d256-prod-github-runner-207 kernel: [40968.577587] ? show_regs.cold+0x8/0xd Aug 22 16:46:34 juju-e4d256-prod-github-runner-207 kernel: [40968.578555] ? watchdog_timer_fn+0x1be/0x220 Aug 22 16:46:34 juju-e4d256-prod-github-runner-207 kernel: [40968.579567] ? lockup_detector_update_enable+0x60/0x60 Aug 22 16:46:34 juju-e4d256-prod-github-runner-207 kernel: [40968.580634] ? __hrtimer_run_queues+0x107/0x230 Aug 22 16:46:34 juju-e4d256-prod-github-runner-207 kernel: [40968.581665] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 16:46:34 juju-e4d256-prod-github-runner-207 kernel: [40968.582686] ? hrtimer_interrupt+0x101/0x220 Aug 22 16:46:34 juju-e4d256-prod-github-runner-207 kernel: [40968.583698] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 16:46:34 juju-e4d256-prod-github-runner-207 kernel: [40968.584776] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 16:46:34 juju-e4d256-prod-github-runner-207 kernel: [40968.585825] Aug 22 16:46:34 juju-e4d256-prod-github-runner-207 kernel: [40968.586681] Aug 22 16:46:34 juju-e4d256-prod-github-runner-207 kernel: [40968.587517] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 16:46:34 juju-e4d256-prod-github-runner-207 kernel: [40968.588559] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:46:34 juju-e4d256-prod-github-runner-207 kernel: [40968.589598] ? _raw_spin_lock+0x22/0x30 Aug 22 16:46:34 juju-e4d256-prod-github-runner-207 kernel: [40968.590540] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:46:34 juju-e4d256-prod-github-runner-207 kernel: [40968.591557] direct_page_fault+0x206/0x310 [kvm] Aug 22 16:46:34 juju-e4d256-prod-github-runner-207 kernel: [40968.592589] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 16:46:34 juju-e4d256-prod-github-runner-207 kernel: [40968.593596] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 16:46:34 juju-e4d256-prod-github-runner-207 kernel: [40968.594595] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 16:46:34 juju-e4d256-prod-github-runner-207 kernel: [40968.595564] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 16:46:34 juju-e4d256-prod-github-runner-207 kernel: [40968.596515] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 16:46:34 juju-e4d256-prod-github-runner-207 kernel: [40968.597500] handle_exit+0x98/0x230 [kvm_amd] Aug 22 16:46:34 juju-e4d256-prod-github-runner-207 kernel: [40968.598390] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 16:46:34 juju-e4d256-prod-github-runner-207 kernel: [40968.599300] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 16:46:34 juju-e4d256-prod-github-runner-207 kernel: [40968.600220] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 16:46:34 juju-e4d256-prod-github-runner-207 kernel: [40968.601128] vcpu_run+0x62/0x2c0 [kvm] Aug 22 16:46:34 juju-e4d256-prod-github-runner-207 kernel: [40968.601936] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 16:46:34 juju-e4d256-prod-github-runner-207 kernel: [40968.602748] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 16:46:34 juju-e4d256-prod-github-runner-207 kernel: [40968.603597] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 16:46:34 juju-e4d256-prod-github-runner-207 kernel: [40968.604390] ? __seccomp_filter+0x4a/0x4a0 Aug 22 16:46:34 juju-e4d256-prod-github-runner-207 kernel: [40968.605135] ? __fget_files+0x86/0xc0 Aug 22 16:46:34 juju-e4d256-prod-github-runner-207 kernel: [40968.605838] __x64_sys_ioctl+0x95/0xd0 Aug 22 16:46:34 juju-e4d256-prod-github-runner-207 kernel: [40968.606527] do_syscall_64+0x5c/0xc0 Aug 22 16:46:34 juju-e4d256-prod-github-runner-207 kernel: [40968.607202] ? do_futex+0x162/0x1f0 Aug 22 16:46:34 juju-e4d256-prod-github-runner-207 kernel: [40968.607861] ? __x64_sys_futex+0x78/0x1e0 Aug 22 16:46:34 juju-e4d256-prod-github-runner-207 kernel: [40968.608661] ? __secure_computing+0xa9/0x120 Aug 22 16:46:34 juju-e4d256-prod-github-runner-207 kernel: [40968.609348] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 16:46:34 juju-e4d256-prod-github-runner-207 kernel: [40968.610109] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:46:34 juju-e4d256-prod-github-runner-207 kernel: [40968.610824] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:46:34 juju-e4d256-prod-github-runner-207 kernel: [40968.611536] ? do_syscall_64+0x69/0xc0 Aug 22 16:46:34 juju-e4d256-prod-github-runner-207 kernel: [40968.612176] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:46:34 juju-e4d256-prod-github-runner-207 kernel: [40968.612890] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:46:34 juju-e4d256-prod-github-runner-207 kernel: [40968.613579] ? do_syscall_64+0x69/0xc0 Aug 22 16:46:34 juju-e4d256-prod-github-runner-207 kernel: [40968.614204] ? do_syscall_64+0x69/0xc0 Aug 22 16:46:34 juju-e4d256-prod-github-runner-207 kernel: [40968.614821] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 16:46:34 juju-e4d256-prod-github-runner-207 kernel: [40968.615520] RIP: 0033:0x7faa5d0edaff Aug 22 16:46:34 juju-e4d256-prod-github-runner-207 kernel: [40968.616146] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 16:46:34 juju-e4d256-prod-github-runner-207 kernel: [40968.618126] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 16:46:34 juju-e4d256-prod-github-runner-207 kernel: [40968.619186] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 16:46:34 juju-e4d256-prod-github-runner-207 kernel: [40968.620075] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 16:46:34 juju-e4d256-prod-github-runner-207 kernel: [40968.620965] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 16:46:34 juju-e4d256-prod-github-runner-207 kernel: [40968.621845] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 16:46:34 juju-e4d256-prod-github-runner-207 kernel: [40968.622732] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 16:46:34 juju-e4d256-prod-github-runner-207 kernel: [40968.623627] Aug 22 16:47:02 juju-e4d256-prod-github-runner-207 kernel: [40996.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 38073s! [qemu-system-x86:6715] Aug 22 16:47:02 juju-e4d256-prod-github-runner-207 kernel: [40996.543107] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 16:47:02 juju-e4d256-prod-github-runner-207 kernel: [40996.543178] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 16:47:02 juju-e4d256-prod-github-runner-207 kernel: [40996.555351] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 16:47:02 juju-e4d256-prod-github-runner-207 kernel: [40996.556638] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 16:47:02 juju-e4d256-prod-github-runner-207 kernel: [40996.557865] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:47:02 juju-e4d256-prod-github-runner-207 kernel: [40996.558919] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 16:47:02 juju-e4d256-prod-github-runner-207 kernel: [40996.561472] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 16:47:02 juju-e4d256-prod-github-runner-207 kernel: [40996.562556] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 16:47:02 juju-e4d256-prod-github-runner-207 kernel: [40996.563736] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 16:47:02 juju-e4d256-prod-github-runner-207 kernel: [40996.564908] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 16:47:02 juju-e4d256-prod-github-runner-207 kernel: [40996.566064] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 16:47:02 juju-e4d256-prod-github-runner-207 kernel: [40996.567223] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 16:47:02 juju-e4d256-prod-github-runner-207 kernel: [40996.568410] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 16:47:02 juju-e4d256-prod-github-runner-207 kernel: [40996.569644] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 16:47:02 juju-e4d256-prod-github-runner-207 kernel: [40996.570780] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 16:47:02 juju-e4d256-prod-github-runner-207 kernel: [40996.571986] Call Trace: Aug 22 16:47:02 juju-e4d256-prod-github-runner-207 kernel: [40996.572947] Aug 22 16:47:02 juju-e4d256-prod-github-runner-207 kernel: [40996.573839] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:47:02 juju-e4d256-prod-github-runner-207 kernel: [40996.574870] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:47:02 juju-e4d256-prod-github-runner-207 kernel: [40996.575890] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:47:02 juju-e4d256-prod-github-runner-207 kernel: [40996.576971] ? show_regs.part.0+0x23/0x29 Aug 22 16:47:02 juju-e4d256-prod-github-runner-207 kernel: [40996.577967] ? show_regs.cold+0x8/0xd Aug 22 16:47:02 juju-e4d256-prod-github-runner-207 kernel: [40996.578936] ? watchdog_timer_fn+0x1be/0x220 Aug 22 16:47:02 juju-e4d256-prod-github-runner-207 kernel: [40996.579944] ? lockup_detector_update_enable+0x60/0x60 Aug 22 16:47:02 juju-e4d256-prod-github-runner-207 kernel: [40996.581014] ? __hrtimer_run_queues+0x107/0x230 Aug 22 16:47:02 juju-e4d256-prod-github-runner-207 kernel: [40996.582040] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 16:47:02 juju-e4d256-prod-github-runner-207 kernel: [40996.583083] ? hrtimer_interrupt+0x101/0x220 Aug 22 16:47:02 juju-e4d256-prod-github-runner-207 kernel: [40996.584125] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 16:47:02 juju-e4d256-prod-github-runner-207 kernel: [40996.585250] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 16:47:02 juju-e4d256-prod-github-runner-207 kernel: [40996.586370] Aug 22 16:47:02 juju-e4d256-prod-github-runner-207 kernel: [40996.587232] Aug 22 16:47:02 juju-e4d256-prod-github-runner-207 kernel: [40996.588073] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 16:47:02 juju-e4d256-prod-github-runner-207 kernel: [40996.589131] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:47:02 juju-e4d256-prod-github-runner-207 kernel: [40996.590172] ? _raw_spin_lock+0x22/0x30 Aug 22 16:47:02 juju-e4d256-prod-github-runner-207 kernel: [40996.591119] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:47:02 juju-e4d256-prod-github-runner-207 kernel: [40996.592154] direct_page_fault+0x206/0x310 [kvm] Aug 22 16:47:02 juju-e4d256-prod-github-runner-207 kernel: [40996.593225] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 16:47:02 juju-e4d256-prod-github-runner-207 kernel: [40996.594248] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 16:47:02 juju-e4d256-prod-github-runner-207 kernel: [40996.595251] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 16:47:02 juju-e4d256-prod-github-runner-207 kernel: [40996.596262] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 16:47:02 juju-e4d256-prod-github-runner-207 kernel: [40996.597230] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 16:47:02 juju-e4d256-prod-github-runner-207 kernel: [40996.598210] handle_exit+0x98/0x230 [kvm_amd] Aug 22 16:47:02 juju-e4d256-prod-github-runner-207 kernel: [40996.599109] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 16:47:02 juju-e4d256-prod-github-runner-207 kernel: [40996.600021] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 16:47:02 juju-e4d256-prod-github-runner-207 kernel: [40996.600967] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 16:47:02 juju-e4d256-prod-github-runner-207 kernel: [40996.601869] vcpu_run+0x62/0x2c0 [kvm] Aug 22 16:47:02 juju-e4d256-prod-github-runner-207 kernel: [40996.602679] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 16:47:02 juju-e4d256-prod-github-runner-207 kernel: [40996.603519] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 16:47:02 juju-e4d256-prod-github-runner-207 kernel: [40996.604418] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 16:47:02 juju-e4d256-prod-github-runner-207 kernel: [40996.605221] ? __seccomp_filter+0x4a/0x4a0 Aug 22 16:47:02 juju-e4d256-prod-github-runner-207 kernel: [40996.605971] ? __fget_files+0x86/0xc0 Aug 22 16:47:02 juju-e4d256-prod-github-runner-207 kernel: [40996.606676] __x64_sys_ioctl+0x95/0xd0 Aug 22 16:47:02 juju-e4d256-prod-github-runner-207 kernel: [40996.607382] do_syscall_64+0x5c/0xc0 Aug 22 16:47:02 juju-e4d256-prod-github-runner-207 kernel: [40996.608048] ? do_futex+0x162/0x1f0 Aug 22 16:47:02 juju-e4d256-prod-github-runner-207 kernel: [40996.608714] ? __x64_sys_futex+0x78/0x1e0 Aug 22 16:47:02 juju-e4d256-prod-github-runner-207 kernel: [40996.609388] ? __secure_computing+0xa9/0x120 Aug 22 16:47:02 juju-e4d256-prod-github-runner-207 kernel: [40996.610078] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 16:47:02 juju-e4d256-prod-github-runner-207 kernel: [40996.610839] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:47:02 juju-e4d256-prod-github-runner-207 kernel: [40996.611565] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:47:02 juju-e4d256-prod-github-runner-207 kernel: [40996.612295] ? do_syscall_64+0x69/0xc0 Aug 22 16:47:02 juju-e4d256-prod-github-runner-207 kernel: [40996.612942] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:47:02 juju-e4d256-prod-github-runner-207 kernel: [40996.613655] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:47:02 juju-e4d256-prod-github-runner-207 kernel: [40996.614360] ? do_syscall_64+0x69/0xc0 Aug 22 16:47:02 juju-e4d256-prod-github-runner-207 kernel: [40996.614985] ? do_syscall_64+0x69/0xc0 Aug 22 16:47:02 juju-e4d256-prod-github-runner-207 kernel: [40996.615606] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 16:47:02 juju-e4d256-prod-github-runner-207 kernel: [40996.616346] RIP: 0033:0x7faa5d0edaff Aug 22 16:47:02 juju-e4d256-prod-github-runner-207 kernel: [40996.616971] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 16:47:02 juju-e4d256-prod-github-runner-207 kernel: [40996.619015] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 16:47:02 juju-e4d256-prod-github-runner-207 kernel: [40996.619933] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 16:47:02 juju-e4d256-prod-github-runner-207 kernel: [40996.620842] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 16:47:02 juju-e4d256-prod-github-runner-207 kernel: [40996.621732] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 16:47:02 juju-e4d256-prod-github-runner-207 kernel: [40996.622619] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 16:47:02 juju-e4d256-prod-github-runner-207 kernel: [40996.623506] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 16:47:02 juju-e4d256-prod-github-runner-207 kernel: [40996.624428] Aug 22 16:47:30 juju-e4d256-prod-github-runner-207 kernel: [41024.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 38099s! [qemu-system-x86:6715] Aug 22 16:47:30 juju-e4d256-prod-github-runner-207 kernel: [41024.543753] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 16:47:30 juju-e4d256-prod-github-runner-207 kernel: [41024.544027] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 16:47:30 juju-e4d256-prod-github-runner-207 kernel: [41024.556127] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 16:47:30 juju-e4d256-prod-github-runner-207 kernel: [41024.557401] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 16:47:30 juju-e4d256-prod-github-runner-207 kernel: [41024.558628] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:47:30 juju-e4d256-prod-github-runner-207 kernel: [41024.559681] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 16:47:30 juju-e4d256-prod-github-runner-207 kernel: [41024.562238] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 16:47:30 juju-e4d256-prod-github-runner-207 kernel: [41024.563281] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 16:47:30 juju-e4d256-prod-github-runner-207 kernel: [41024.564465] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 16:47:30 juju-e4d256-prod-github-runner-207 kernel: [41024.565633] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 16:47:30 juju-e4d256-prod-github-runner-207 kernel: [41024.566795] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 16:47:30 juju-e4d256-prod-github-runner-207 kernel: [41024.567975] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 16:47:30 juju-e4d256-prod-github-runner-207 kernel: [41024.569142] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 16:47:30 juju-e4d256-prod-github-runner-207 kernel: [41024.570378] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 16:47:30 juju-e4d256-prod-github-runner-207 kernel: [41024.571473] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 16:47:30 juju-e4d256-prod-github-runner-207 kernel: [41024.572683] Call Trace: Aug 22 16:47:30 juju-e4d256-prod-github-runner-207 kernel: [41024.573594] Aug 22 16:47:30 juju-e4d256-prod-github-runner-207 kernel: [41024.574487] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:47:30 juju-e4d256-prod-github-runner-207 kernel: [41024.575519] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:47:30 juju-e4d256-prod-github-runner-207 kernel: [41024.576554] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:47:30 juju-e4d256-prod-github-runner-207 kernel: [41024.577647] ? show_regs.part.0+0x23/0x29 Aug 22 16:47:30 juju-e4d256-prod-github-runner-207 kernel: [41024.578642] ? show_regs.cold+0x8/0xd Aug 22 16:47:30 juju-e4d256-prod-github-runner-207 kernel: [41024.579616] ? watchdog_timer_fn+0x1be/0x220 Aug 22 16:47:30 juju-e4d256-prod-github-runner-207 kernel: [41024.580645] ? lockup_detector_update_enable+0x60/0x60 Aug 22 16:47:30 juju-e4d256-prod-github-runner-207 kernel: [41024.581709] ? __hrtimer_run_queues+0x107/0x230 Aug 22 16:47:30 juju-e4d256-prod-github-runner-207 kernel: [41024.582737] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 16:47:30 juju-e4d256-prod-github-runner-207 kernel: [41024.583758] ? hrtimer_interrupt+0x101/0x220 Aug 22 16:47:30 juju-e4d256-prod-github-runner-207 kernel: [41024.584908] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 16:47:30 juju-e4d256-prod-github-runner-207 kernel: [41024.585974] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 16:47:30 juju-e4d256-prod-github-runner-207 kernel: [41024.587018] Aug 22 16:47:30 juju-e4d256-prod-github-runner-207 kernel: [41024.587889] Aug 22 16:47:30 juju-e4d256-prod-github-runner-207 kernel: [41024.588726] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 16:47:30 juju-e4d256-prod-github-runner-207 kernel: [41024.589758] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:47:30 juju-e4d256-prod-github-runner-207 kernel: [41024.590795] ? _raw_spin_lock+0x22/0x30 Aug 22 16:47:30 juju-e4d256-prod-github-runner-207 kernel: [41024.591738] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:47:30 juju-e4d256-prod-github-runner-207 kernel: [41024.592769] direct_page_fault+0x206/0x310 [kvm] Aug 22 16:47:30 juju-e4d256-prod-github-runner-207 kernel: [41024.593796] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 16:47:30 juju-e4d256-prod-github-runner-207 kernel: [41024.594813] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 16:47:30 juju-e4d256-prod-github-runner-207 kernel: [41024.595832] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 16:47:30 juju-e4d256-prod-github-runner-207 kernel: [41024.596837] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 16:47:30 juju-e4d256-prod-github-runner-207 kernel: [41024.597787] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 16:47:30 juju-e4d256-prod-github-runner-207 kernel: [41024.598761] handle_exit+0x98/0x230 [kvm_amd] Aug 22 16:47:30 juju-e4d256-prod-github-runner-207 kernel: [41024.599651] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 16:47:30 juju-e4d256-prod-github-runner-207 kernel: [41024.600579] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 16:47:30 juju-e4d256-prod-github-runner-207 kernel: [41024.601502] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 16:47:30 juju-e4d256-prod-github-runner-207 kernel: [41024.602417] vcpu_run+0x62/0x2c0 [kvm] Aug 22 16:47:30 juju-e4d256-prod-github-runner-207 kernel: [41024.603233] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 16:47:30 juju-e4d256-prod-github-runner-207 kernel: [41024.604059] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 16:47:30 juju-e4d256-prod-github-runner-207 kernel: [41024.604912] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 16:47:30 juju-e4d256-prod-github-runner-207 kernel: [41024.605708] ? __seccomp_filter+0x4a/0x4a0 Aug 22 16:47:30 juju-e4d256-prod-github-runner-207 kernel: [41024.606447] ? __fget_files+0x86/0xc0 Aug 22 16:47:30 juju-e4d256-prod-github-runner-207 kernel: [41024.607156] __x64_sys_ioctl+0x95/0xd0 Aug 22 16:47:30 juju-e4d256-prod-github-runner-207 kernel: [41024.607870] do_syscall_64+0x5c/0xc0 Aug 22 16:47:30 juju-e4d256-prod-github-runner-207 kernel: [41024.608544] ? do_futex+0x162/0x1f0 Aug 22 16:47:30 juju-e4d256-prod-github-runner-207 kernel: [41024.609192] ? __x64_sys_futex+0x78/0x1e0 Aug 22 16:47:30 juju-e4d256-prod-github-runner-207 kernel: [41024.609869] ? __secure_computing+0xa9/0x120 Aug 22 16:47:30 juju-e4d256-prod-github-runner-207 kernel: [41024.610556] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 16:47:30 juju-e4d256-prod-github-runner-207 kernel: [41024.611320] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:47:30 juju-e4d256-prod-github-runner-207 kernel: [41024.612053] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:47:30 juju-e4d256-prod-github-runner-207 kernel: [41024.612780] ? do_syscall_64+0x69/0xc0 Aug 22 16:47:30 juju-e4d256-prod-github-runner-207 kernel: [41024.613426] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:47:30 juju-e4d256-prod-github-runner-207 kernel: [41024.614127] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:47:30 juju-e4d256-prod-github-runner-207 kernel: [41024.614826] ? do_syscall_64+0x69/0xc0 Aug 22 16:47:30 juju-e4d256-prod-github-runner-207 kernel: [41024.615450] ? do_syscall_64+0x69/0xc0 Aug 22 16:47:30 juju-e4d256-prod-github-runner-207 kernel: [41024.616093] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 16:47:30 juju-e4d256-prod-github-runner-207 kernel: [41024.616798] RIP: 0033:0x7faa5d0edaff Aug 22 16:47:30 juju-e4d256-prod-github-runner-207 kernel: [41024.617448] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 16:47:30 juju-e4d256-prod-github-runner-207 kernel: [41024.619442] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 16:47:30 juju-e4d256-prod-github-runner-207 kernel: [41024.620362] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 16:47:30 juju-e4d256-prod-github-runner-207 kernel: [41024.621255] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 16:47:30 juju-e4d256-prod-github-runner-207 kernel: [41024.622139] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 16:47:30 juju-e4d256-prod-github-runner-207 kernel: [41024.623026] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 16:47:30 juju-e4d256-prod-github-runner-207 kernel: [41024.623936] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 16:47:30 juju-e4d256-prod-github-runner-207 kernel: [41024.624835] Aug 22 16:47:46 juju-e4d256-prod-github-runner-207 kernel: [41039.924707] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 16:47:46 juju-e4d256-prod-github-runner-207 kernel: [41039.925662] rcu: 1-....: (10198577 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=4933248 Aug 22 16:47:46 juju-e4d256-prod-github-runner-207 kernel: [41039.926785] (t=10230681 jiffies g=23269 q=41550) Aug 22 16:47:46 juju-e4d256-prod-github-runner-207 kernel: [41039.927570] NMI backtrace for cpu 1 Aug 22 16:47:46 juju-e4d256-prod-github-runner-207 kernel: [41039.928297] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 16:47:46 juju-e4d256-prod-github-runner-207 kernel: [41039.929400] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 16:47:46 juju-e4d256-prod-github-runner-207 kernel: [41039.930456] Call Trace: Aug 22 16:47:46 juju-e4d256-prod-github-runner-207 kernel: [41039.931133] Aug 22 16:47:46 juju-e4d256-prod-github-runner-207 kernel: [41039.931785] show_stack+0x52/0x5c Aug 22 16:47:46 juju-e4d256-prod-github-runner-207 kernel: [41039.932511] dump_stack_lvl+0x4a/0x63 Aug 22 16:47:46 juju-e4d256-prod-github-runner-207 kernel: [41039.933263] dump_stack+0x10/0x16 Aug 22 16:47:46 juju-e4d256-prod-github-runner-207 kernel: [41039.933984] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 16:47:46 juju-e4d256-prod-github-runner-207 kernel: [41039.934762] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 16:47:46 juju-e4d256-prod-github-runner-207 kernel: [41039.935538] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 16:47:46 juju-e4d256-prod-github-runner-207 kernel: [41039.936366] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 16:47:46 juju-e4d256-prod-github-runner-207 kernel: [41039.937188] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 16:47:46 juju-e4d256-prod-github-runner-207 kernel: [41039.937997] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 16:47:46 juju-e4d256-prod-github-runner-207 kernel: [41039.938766] print_cpu_stall.cold+0x2f/0xe2 Aug 22 16:47:46 juju-e4d256-prod-github-runner-207 kernel: [41039.939527] ? timekeeping_update+0xf7/0x150 Aug 22 16:47:46 juju-e4d256-prod-github-runner-207 kernel: [41039.940308] check_cpu_stall+0x109/0x270 Aug 22 16:47:46 juju-e4d256-prod-github-runner-207 kernel: [41039.941052] rcu_sched_clock_irq+0x9a/0x250 Aug 22 16:47:46 juju-e4d256-prod-github-runner-207 kernel: [41039.941811] update_process_times+0x94/0xd0 Aug 22 16:47:46 juju-e4d256-prod-github-runner-207 kernel: [41039.942570] tick_sched_handle+0x29/0x70 Aug 22 16:47:46 juju-e4d256-prod-github-runner-207 kernel: [41039.943315] tick_sched_timer+0x8c/0xc0 Aug 22 16:47:46 juju-e4d256-prod-github-runner-207 kernel: [41039.944063] ? tick_nohz_handler+0xb0/0xb0 Aug 22 16:47:46 juju-e4d256-prod-github-runner-207 kernel: [41039.944941] __hrtimer_run_queues+0x107/0x230 Aug 22 16:47:46 juju-e4d256-prod-github-runner-207 kernel: [41039.945743] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 16:47:46 juju-e4d256-prod-github-runner-207 kernel: [41039.946516] hrtimer_interrupt+0x101/0x220 Aug 22 16:47:46 juju-e4d256-prod-github-runner-207 kernel: [41039.947277] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 16:47:46 juju-e4d256-prod-github-runner-207 kernel: [41039.948102] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 16:47:46 juju-e4d256-prod-github-runner-207 kernel: [41039.948908] Aug 22 16:47:46 juju-e4d256-prod-github-runner-207 kernel: [41039.949541] Aug 22 16:47:46 juju-e4d256-prod-github-runner-207 kernel: [41039.950173] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 16:47:46 juju-e4d256-prod-github-runner-207 kernel: [41039.950990] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:47:46 juju-e4d256-prod-github-runner-207 kernel: [41039.951889] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 16:47:46 juju-e4d256-prod-github-runner-207 kernel: [41039.954090] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 16:47:46 juju-e4d256-prod-github-runner-207 kernel: [41039.954960] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 16:47:46 juju-e4d256-prod-github-runner-207 kernel: [41039.955965] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 16:47:46 juju-e4d256-prod-github-runner-207 kernel: [41039.956938] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 16:47:46 juju-e4d256-prod-github-runner-207 kernel: [41039.957897] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 16:47:46 juju-e4d256-prod-github-runner-207 kernel: [41039.958848] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 16:47:46 juju-e4d256-prod-github-runner-207 kernel: [41039.959807] ? _raw_spin_lock+0x22/0x30 Aug 22 16:47:46 juju-e4d256-prod-github-runner-207 kernel: [41039.960563] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:47:46 juju-e4d256-prod-github-runner-207 kernel: [41039.961395] direct_page_fault+0x206/0x310 [kvm] Aug 22 16:47:46 juju-e4d256-prod-github-runner-207 kernel: [41039.962234] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 16:47:46 juju-e4d256-prod-github-runner-207 kernel: [41039.963058] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 16:47:46 juju-e4d256-prod-github-runner-207 kernel: [41039.963894] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 16:47:46 juju-e4d256-prod-github-runner-207 kernel: [41039.964697] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 16:47:46 juju-e4d256-prod-github-runner-207 kernel: [41039.965480] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 16:47:46 juju-e4d256-prod-github-runner-207 kernel: [41039.966304] handle_exit+0x98/0x230 [kvm_amd] Aug 22 16:47:46 juju-e4d256-prod-github-runner-207 kernel: [41039.967060] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 16:47:46 juju-e4d256-prod-github-runner-207 kernel: [41039.967915] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 16:47:46 juju-e4d256-prod-github-runner-207 kernel: [41039.968716] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 16:47:46 juju-e4d256-prod-github-runner-207 kernel: [41039.969503] vcpu_run+0x62/0x2c0 [kvm] Aug 22 16:47:46 juju-e4d256-prod-github-runner-207 kernel: [41039.970221] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 16:47:46 juju-e4d256-prod-github-runner-207 kernel: [41039.970957] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 16:47:46 juju-e4d256-prod-github-runner-207 kernel: [41039.971766] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 16:47:46 juju-e4d256-prod-github-runner-207 kernel: [41039.972525] ? __seccomp_filter+0x4a/0x4a0 Aug 22 16:47:46 juju-e4d256-prod-github-runner-207 kernel: [41039.973244] ? __fget_files+0x86/0xc0 Aug 22 16:47:46 juju-e4d256-prod-github-runner-207 kernel: [41039.973941] __x64_sys_ioctl+0x95/0xd0 Aug 22 16:47:46 juju-e4d256-prod-github-runner-207 kernel: [41039.974633] do_syscall_64+0x5c/0xc0 Aug 22 16:47:46 juju-e4d256-prod-github-runner-207 kernel: [41039.975317] ? do_futex+0x162/0x1f0 Aug 22 16:47:46 juju-e4d256-prod-github-runner-207 kernel: [41039.975995] ? __x64_sys_futex+0x78/0x1e0 Aug 22 16:47:46 juju-e4d256-prod-github-runner-207 kernel: [41039.976693] ? __secure_computing+0xa9/0x120 Aug 22 16:47:46 juju-e4d256-prod-github-runner-207 kernel: [41039.977408] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 16:47:46 juju-e4d256-prod-github-runner-207 kernel: [41039.978194] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:47:46 juju-e4d256-prod-github-runner-207 kernel: [41039.978950] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:47:46 juju-e4d256-prod-github-runner-207 kernel: [41039.979707] ? do_syscall_64+0x69/0xc0 Aug 22 16:47:46 juju-e4d256-prod-github-runner-207 kernel: [41039.980399] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:47:46 juju-e4d256-prod-github-runner-207 kernel: [41039.981151] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:47:46 juju-e4d256-prod-github-runner-207 kernel: [41039.981911] ? do_syscall_64+0x69/0xc0 Aug 22 16:47:46 juju-e4d256-prod-github-runner-207 kernel: [41039.982602] ? do_syscall_64+0x69/0xc0 Aug 22 16:47:46 juju-e4d256-prod-github-runner-207 kernel: [41039.983287] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 16:47:46 juju-e4d256-prod-github-runner-207 kernel: [41039.984065] RIP: 0033:0x7faa5d0edaff Aug 22 16:47:46 juju-e4d256-prod-github-runner-207 kernel: [41039.984748] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 16:47:46 juju-e4d256-prod-github-runner-207 kernel: [41039.986837] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 16:47:46 juju-e4d256-prod-github-runner-207 kernel: [41039.987814] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 16:47:46 juju-e4d256-prod-github-runner-207 kernel: [41039.988757] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 16:47:46 juju-e4d256-prod-github-runner-207 kernel: [41039.989695] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 16:47:46 juju-e4d256-prod-github-runner-207 kernel: [41039.990632] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 16:47:46 juju-e4d256-prod-github-runner-207 kernel: [41039.991559] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 16:47:46 juju-e4d256-prod-github-runner-207 kernel: [41039.992483] Aug 22 16:48:10 juju-e4d256-prod-github-runner-207 kernel: [41064.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 38136s! [qemu-system-x86:6715] Aug 22 16:48:10 juju-e4d256-prod-github-runner-207 kernel: [41064.543119] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 16:48:10 juju-e4d256-prod-github-runner-207 kernel: [41064.543188] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 16:48:10 juju-e4d256-prod-github-runner-207 kernel: [41064.556016] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 16:48:10 juju-e4d256-prod-github-runner-207 kernel: [41064.557291] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 16:48:10 juju-e4d256-prod-github-runner-207 kernel: [41064.558514] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:48:10 juju-e4d256-prod-github-runner-207 kernel: [41064.559582] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 16:48:10 juju-e4d256-prod-github-runner-207 kernel: [41064.562134] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 16:48:10 juju-e4d256-prod-github-runner-207 kernel: [41064.563191] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 16:48:10 juju-e4d256-prod-github-runner-207 kernel: [41064.564374] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 16:48:10 juju-e4d256-prod-github-runner-207 kernel: [41064.565630] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 16:48:10 juju-e4d256-prod-github-runner-207 kernel: [41064.566798] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 16:48:10 juju-e4d256-prod-github-runner-207 kernel: [41064.567982] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 16:48:10 juju-e4d256-prod-github-runner-207 kernel: [41064.569180] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 16:48:10 juju-e4d256-prod-github-runner-207 kernel: [41064.570423] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 16:48:10 juju-e4d256-prod-github-runner-207 kernel: [41064.571747] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 16:48:10 juju-e4d256-prod-github-runner-207 kernel: [41064.572955] Call Trace: Aug 22 16:48:10 juju-e4d256-prod-github-runner-207 kernel: [41064.573867] Aug 22 16:48:10 juju-e4d256-prod-github-runner-207 kernel: [41064.574751] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:48:10 juju-e4d256-prod-github-runner-207 kernel: [41064.575800] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:48:10 juju-e4d256-prod-github-runner-207 kernel: [41064.576826] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:48:10 juju-e4d256-prod-github-runner-207 kernel: [41064.577902] ? show_regs.part.0+0x23/0x29 Aug 22 16:48:10 juju-e4d256-prod-github-runner-207 kernel: [41064.578905] ? show_regs.cold+0x8/0xd Aug 22 16:48:10 juju-e4d256-prod-github-runner-207 kernel: [41064.579883] ? watchdog_timer_fn+0x1be/0x220 Aug 22 16:48:10 juju-e4d256-prod-github-runner-207 kernel: [41064.580898] ? lockup_detector_update_enable+0x60/0x60 Aug 22 16:48:10 juju-e4d256-prod-github-runner-207 kernel: [41064.581973] ? __hrtimer_run_queues+0x107/0x230 Aug 22 16:48:10 juju-e4d256-prod-github-runner-207 kernel: [41064.583014] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 16:48:10 juju-e4d256-prod-github-runner-207 kernel: [41064.584054] ? hrtimer_interrupt+0x101/0x220 Aug 22 16:48:10 juju-e4d256-prod-github-runner-207 kernel: [41064.585070] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 16:48:10 juju-e4d256-prod-github-runner-207 kernel: [41064.586138] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 16:48:10 juju-e4d256-prod-github-runner-207 kernel: [41064.587189] Aug 22 16:48:10 juju-e4d256-prod-github-runner-207 kernel: [41064.588050] Aug 22 16:48:10 juju-e4d256-prod-github-runner-207 kernel: [41064.588888] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 16:48:10 juju-e4d256-prod-github-runner-207 kernel: [41064.589921] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:48:10 juju-e4d256-prod-github-runner-207 kernel: [41064.590962] ? _raw_spin_lock+0x22/0x30 Aug 22 16:48:10 juju-e4d256-prod-github-runner-207 kernel: [41064.591922] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:48:10 juju-e4d256-prod-github-runner-207 kernel: [41064.592947] direct_page_fault+0x206/0x310 [kvm] Aug 22 16:48:10 juju-e4d256-prod-github-runner-207 kernel: [41064.593981] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 16:48:10 juju-e4d256-prod-github-runner-207 kernel: [41064.594998] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 16:48:10 juju-e4d256-prod-github-runner-207 kernel: [41064.596011] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 16:48:10 juju-e4d256-prod-github-runner-207 kernel: [41064.596993] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 16:48:10 juju-e4d256-prod-github-runner-207 kernel: [41064.597940] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 16:48:10 juju-e4d256-prod-github-runner-207 kernel: [41064.598933] handle_exit+0x98/0x230 [kvm_amd] Aug 22 16:48:10 juju-e4d256-prod-github-runner-207 kernel: [41064.599848] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 16:48:10 juju-e4d256-prod-github-runner-207 kernel: [41064.600764] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 16:48:10 juju-e4d256-prod-github-runner-207 kernel: [41064.601695] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 16:48:10 juju-e4d256-prod-github-runner-207 kernel: [41064.602599] vcpu_run+0x62/0x2c0 [kvm] Aug 22 16:48:10 juju-e4d256-prod-github-runner-207 kernel: [41064.603437] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 16:48:10 juju-e4d256-prod-github-runner-207 kernel: [41064.604254] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 16:48:10 juju-e4d256-prod-github-runner-207 kernel: [41064.605110] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 16:48:10 juju-e4d256-prod-github-runner-207 kernel: [41064.605908] ? __seccomp_filter+0x4a/0x4a0 Aug 22 16:48:10 juju-e4d256-prod-github-runner-207 kernel: [41064.606652] ? __fget_files+0x86/0xc0 Aug 22 16:48:10 juju-e4d256-prod-github-runner-207 kernel: [41064.607367] __x64_sys_ioctl+0x95/0xd0 Aug 22 16:48:10 juju-e4d256-prod-github-runner-207 kernel: [41064.608063] do_syscall_64+0x5c/0xc0 Aug 22 16:48:10 juju-e4d256-prod-github-runner-207 kernel: [41064.608731] ? do_futex+0x162/0x1f0 Aug 22 16:48:10 juju-e4d256-prod-github-runner-207 kernel: [41064.609382] ? __x64_sys_futex+0x78/0x1e0 Aug 22 16:48:10 juju-e4d256-prod-github-runner-207 kernel: [41064.610062] ? __secure_computing+0xa9/0x120 Aug 22 16:48:10 juju-e4d256-prod-github-runner-207 kernel: [41064.610754] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 16:48:10 juju-e4d256-prod-github-runner-207 kernel: [41064.611526] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:48:10 juju-e4d256-prod-github-runner-207 kernel: [41064.612251] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:48:10 juju-e4d256-prod-github-runner-207 kernel: [41064.612973] ? do_syscall_64+0x69/0xc0 Aug 22 16:48:10 juju-e4d256-prod-github-runner-207 kernel: [41064.613633] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:48:10 juju-e4d256-prod-github-runner-207 kernel: [41064.614340] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:48:10 juju-e4d256-prod-github-runner-207 kernel: [41064.615038] ? do_syscall_64+0x69/0xc0 Aug 22 16:48:10 juju-e4d256-prod-github-runner-207 kernel: [41064.615677] ? do_syscall_64+0x69/0xc0 Aug 22 16:48:10 juju-e4d256-prod-github-runner-207 kernel: [41064.616307] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 16:48:10 juju-e4d256-prod-github-runner-207 kernel: [41064.617015] RIP: 0033:0x7faa5d0edaff Aug 22 16:48:10 juju-e4d256-prod-github-runner-207 kernel: [41064.617642] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 16:48:10 juju-e4d256-prod-github-runner-207 kernel: [41064.619671] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 16:48:10 juju-e4d256-prod-github-runner-207 kernel: [41064.620598] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 16:48:10 juju-e4d256-prod-github-runner-207 kernel: [41064.621491] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 16:48:10 juju-e4d256-prod-github-runner-207 kernel: [41064.622381] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 16:48:10 juju-e4d256-prod-github-runner-207 kernel: [41064.623275] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 16:48:10 juju-e4d256-prod-github-runner-207 kernel: [41064.624178] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 16:48:10 juju-e4d256-prod-github-runner-207 kernel: [41064.625076] Aug 22 16:48:38 juju-e4d256-prod-github-runner-207 kernel: [41092.541982] watchdog: BUG: soft lockup - CPU#1 stuck for 38162s! [qemu-system-x86:6715] Aug 22 16:48:38 juju-e4d256-prod-github-runner-207 kernel: [41092.543192] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 16:48:38 juju-e4d256-prod-github-runner-207 kernel: [41092.543259] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 16:48:38 juju-e4d256-prod-github-runner-207 kernel: [41092.556456] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 16:48:38 juju-e4d256-prod-github-runner-207 kernel: [41092.557724] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 16:48:38 juju-e4d256-prod-github-runner-207 kernel: [41092.558995] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:48:38 juju-e4d256-prod-github-runner-207 kernel: [41092.560271] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 16:48:38 juju-e4d256-prod-github-runner-207 kernel: [41092.562914] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 16:48:38 juju-e4d256-prod-github-runner-207 kernel: [41092.564023] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 16:48:38 juju-e4d256-prod-github-runner-207 kernel: [41092.565205] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 16:48:38 juju-e4d256-prod-github-runner-207 kernel: [41092.566373] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 16:48:38 juju-e4d256-prod-github-runner-207 kernel: [41092.567551] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 16:48:38 juju-e4d256-prod-github-runner-207 kernel: [41092.568717] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 16:48:38 juju-e4d256-prod-github-runner-207 kernel: [41092.569888] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 16:48:38 juju-e4d256-prod-github-runner-207 kernel: [41092.571131] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 16:48:38 juju-e4d256-prod-github-runner-207 kernel: [41092.572488] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 16:48:38 juju-e4d256-prod-github-runner-207 kernel: [41092.574262] Call Trace: Aug 22 16:48:38 juju-e4d256-prod-github-runner-207 kernel: [41092.575511] Aug 22 16:48:38 juju-e4d256-prod-github-runner-207 kernel: [41092.576704] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:48:38 juju-e4d256-prod-github-runner-207 kernel: [41092.578133] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:48:38 juju-e4d256-prod-github-runner-207 kernel: [41092.579538] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:48:38 juju-e4d256-prod-github-runner-207 kernel: [41092.580623] ? show_regs.part.0+0x23/0x29 Aug 22 16:48:38 juju-e4d256-prod-github-runner-207 kernel: [41092.581627] ? show_regs.cold+0x8/0xd Aug 22 16:48:38 juju-e4d256-prod-github-runner-207 kernel: [41092.582600] ? watchdog_timer_fn+0x1be/0x220 Aug 22 16:48:38 juju-e4d256-prod-github-runner-207 kernel: [41092.583633] ? lockup_detector_update_enable+0x60/0x60 Aug 22 16:48:38 juju-e4d256-prod-github-runner-207 kernel: [41092.584702] ? __hrtimer_run_queues+0x107/0x230 Aug 22 16:48:38 juju-e4d256-prod-github-runner-207 kernel: [41092.585806] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 16:48:38 juju-e4d256-prod-github-runner-207 kernel: [41092.587219] ? hrtimer_interrupt+0x101/0x220 Aug 22 16:48:38 juju-e4d256-prod-github-runner-207 kernel: [41092.588538] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 16:48:38 juju-e4d256-prod-github-runner-207 kernel: [41092.589618] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 16:48:38 juju-e4d256-prod-github-runner-207 kernel: [41092.590695] Aug 22 16:48:38 juju-e4d256-prod-github-runner-207 kernel: [41092.591602] Aug 22 16:48:38 juju-e4d256-prod-github-runner-207 kernel: [41092.592472] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 16:48:38 juju-e4d256-prod-github-runner-207 kernel: [41092.593521] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:48:38 juju-e4d256-prod-github-runner-207 kernel: [41092.594562] ? _raw_spin_lock+0x22/0x30 Aug 22 16:48:38 juju-e4d256-prod-github-runner-207 kernel: [41092.595523] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:48:38 juju-e4d256-prod-github-runner-207 kernel: [41092.596543] direct_page_fault+0x206/0x310 [kvm] Aug 22 16:48:38 juju-e4d256-prod-github-runner-207 kernel: [41092.597700] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 16:48:38 juju-e4d256-prod-github-runner-207 kernel: [41092.598800] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 16:48:38 juju-e4d256-prod-github-runner-207 kernel: [41092.599821] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 16:48:38 juju-e4d256-prod-github-runner-207 kernel: [41092.600790] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 16:48:38 juju-e4d256-prod-github-runner-207 kernel: [41092.601842] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 16:48:38 juju-e4d256-prod-github-runner-207 kernel: [41092.603140] handle_exit+0x98/0x230 [kvm_amd] Aug 22 16:48:38 juju-e4d256-prod-github-runner-207 kernel: [41092.604064] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 16:48:38 juju-e4d256-prod-github-runner-207 kernel: [41092.605129] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 16:48:38 juju-e4d256-prod-github-runner-207 kernel: [41092.606196] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 16:48:38 juju-e4d256-prod-github-runner-207 kernel: [41092.607245] vcpu_run+0x62/0x2c0 [kvm] Aug 22 16:48:38 juju-e4d256-prod-github-runner-207 kernel: [41092.608095] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 16:48:38 juju-e4d256-prod-github-runner-207 kernel: [41092.608917] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 16:48:38 juju-e4d256-prod-github-runner-207 kernel: [41092.609781] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 16:48:38 juju-e4d256-prod-github-runner-207 kernel: [41092.610670] ? __seccomp_filter+0x4a/0x4a0 Aug 22 16:48:38 juju-e4d256-prod-github-runner-207 kernel: [41092.611517] ? __fget_files+0x86/0xc0 Aug 22 16:48:38 juju-e4d256-prod-github-runner-207 kernel: [41092.612242] __x64_sys_ioctl+0x95/0xd0 Aug 22 16:48:38 juju-e4d256-prod-github-runner-207 kernel: [41092.613031] do_syscall_64+0x5c/0xc0 Aug 22 16:48:38 juju-e4d256-prod-github-runner-207 kernel: [41092.613718] ? do_futex+0x162/0x1f0 Aug 22 16:48:38 juju-e4d256-prod-github-runner-207 kernel: [41092.614452] ? __x64_sys_futex+0x78/0x1e0 Aug 22 16:48:38 juju-e4d256-prod-github-runner-207 kernel: [41092.615182] ? __secure_computing+0xa9/0x120 Aug 22 16:48:38 juju-e4d256-prod-github-runner-207 kernel: [41092.615928] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 16:48:38 juju-e4d256-prod-github-runner-207 kernel: [41092.616949] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:48:38 juju-e4d256-prod-github-runner-207 kernel: [41092.617680] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:48:38 juju-e4d256-prod-github-runner-207 kernel: [41092.618439] ? do_syscall_64+0x69/0xc0 Aug 22 16:48:38 juju-e4d256-prod-github-runner-207 kernel: [41092.619101] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:48:38 juju-e4d256-prod-github-runner-207 kernel: [41092.619888] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:48:38 juju-e4d256-prod-github-runner-207 kernel: [41092.620767] ? do_syscall_64+0x69/0xc0 Aug 22 16:48:38 juju-e4d256-prod-github-runner-207 kernel: [41092.621484] ? do_syscall_64+0x69/0xc0 Aug 22 16:48:38 juju-e4d256-prod-github-runner-207 kernel: [41092.622237] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 16:48:38 juju-e4d256-prod-github-runner-207 kernel: [41092.622983] RIP: 0033:0x7faa5d0edaff Aug 22 16:48:38 juju-e4d256-prod-github-runner-207 kernel: [41092.623672] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 16:48:38 juju-e4d256-prod-github-runner-207 kernel: [41092.625838] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 16:48:38 juju-e4d256-prod-github-runner-207 kernel: [41092.626844] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 16:48:38 juju-e4d256-prod-github-runner-207 kernel: [41092.627751] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 16:48:38 juju-e4d256-prod-github-runner-207 kernel: [41092.628642] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 16:48:38 juju-e4d256-prod-github-runner-207 kernel: [41092.629637] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 16:48:38 juju-e4d256-prod-github-runner-207 kernel: [41092.630538] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 16:48:38 juju-e4d256-prod-github-runner-207 kernel: [41092.631462] Aug 22 16:49:06 juju-e4d256-prod-github-runner-207 kernel: [41120.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 38188s! [qemu-system-x86:6715] Aug 22 16:49:06 juju-e4d256-prod-github-runner-207 kernel: [41120.543765] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 16:49:06 juju-e4d256-prod-github-runner-207 kernel: [41120.544027] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 16:49:06 juju-e4d256-prod-github-runner-207 kernel: [41120.556142] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 16:49:06 juju-e4d256-prod-github-runner-207 kernel: [41120.557415] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 16:49:06 juju-e4d256-prod-github-runner-207 kernel: [41120.558635] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:49:06 juju-e4d256-prod-github-runner-207 kernel: [41120.559700] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 16:49:06 juju-e4d256-prod-github-runner-207 kernel: [41120.562267] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 16:49:06 juju-e4d256-prod-github-runner-207 kernel: [41120.563325] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 16:49:06 juju-e4d256-prod-github-runner-207 kernel: [41120.564492] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 16:49:06 juju-e4d256-prod-github-runner-207 kernel: [41120.565655] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 16:49:06 juju-e4d256-prod-github-runner-207 kernel: [41120.566827] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 16:49:06 juju-e4d256-prod-github-runner-207 kernel: [41120.567996] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 16:49:06 juju-e4d256-prod-github-runner-207 kernel: [41120.569162] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 16:49:06 juju-e4d256-prod-github-runner-207 kernel: [41120.570410] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 16:49:06 juju-e4d256-prod-github-runner-207 kernel: [41120.571520] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 16:49:06 juju-e4d256-prod-github-runner-207 kernel: [41120.572712] Call Trace: Aug 22 16:49:06 juju-e4d256-prod-github-runner-207 kernel: [41120.573630] Aug 22 16:49:06 juju-e4d256-prod-github-runner-207 kernel: [41120.574523] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:49:06 juju-e4d256-prod-github-runner-207 kernel: [41120.575567] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:49:06 juju-e4d256-prod-github-runner-207 kernel: [41120.576592] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:49:06 juju-e4d256-prod-github-runner-207 kernel: [41120.577706] ? show_regs.part.0+0x23/0x29 Aug 22 16:49:06 juju-e4d256-prod-github-runner-207 kernel: [41120.578704] ? show_regs.cold+0x8/0xd Aug 22 16:49:06 juju-e4d256-prod-github-runner-207 kernel: [41120.579681] ? watchdog_timer_fn+0x1be/0x220 Aug 22 16:49:06 juju-e4d256-prod-github-runner-207 kernel: [41120.580689] ? lockup_detector_update_enable+0x60/0x60 Aug 22 16:49:06 juju-e4d256-prod-github-runner-207 kernel: [41120.581752] ? __hrtimer_run_queues+0x107/0x230 Aug 22 16:49:06 juju-e4d256-prod-github-runner-207 kernel: [41120.582786] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 16:49:06 juju-e4d256-prod-github-runner-207 kernel: [41120.583811] ? hrtimer_interrupt+0x101/0x220 Aug 22 16:49:06 juju-e4d256-prod-github-runner-207 kernel: [41120.584848] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 16:49:06 juju-e4d256-prod-github-runner-207 kernel: [41120.585924] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 16:49:06 juju-e4d256-prod-github-runner-207 kernel: [41120.586987] Aug 22 16:49:06 juju-e4d256-prod-github-runner-207 kernel: [41120.587840] Aug 22 16:49:06 juju-e4d256-prod-github-runner-207 kernel: [41120.588677] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 16:49:06 juju-e4d256-prod-github-runner-207 kernel: [41120.589712] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:49:06 juju-e4d256-prod-github-runner-207 kernel: [41120.590776] ? _raw_spin_lock+0x22/0x30 Aug 22 16:49:06 juju-e4d256-prod-github-runner-207 kernel: [41120.591723] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:49:06 juju-e4d256-prod-github-runner-207 kernel: [41120.592746] direct_page_fault+0x206/0x310 [kvm] Aug 22 16:49:06 juju-e4d256-prod-github-runner-207 kernel: [41120.593773] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 16:49:06 juju-e4d256-prod-github-runner-207 kernel: [41120.594790] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 16:49:06 juju-e4d256-prod-github-runner-207 kernel: [41120.595793] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 16:49:06 juju-e4d256-prod-github-runner-207 kernel: [41120.596785] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 16:49:06 juju-e4d256-prod-github-runner-207 kernel: [41120.597734] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 16:49:06 juju-e4d256-prod-github-runner-207 kernel: [41120.598735] handle_exit+0x98/0x230 [kvm_amd] Aug 22 16:49:06 juju-e4d256-prod-github-runner-207 kernel: [41120.599636] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 16:49:06 juju-e4d256-prod-github-runner-207 kernel: [41120.600553] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 16:49:06 juju-e4d256-prod-github-runner-207 kernel: [41120.601481] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 16:49:06 juju-e4d256-prod-github-runner-207 kernel: [41120.602385] vcpu_run+0x62/0x2c0 [kvm] Aug 22 16:49:06 juju-e4d256-prod-github-runner-207 kernel: [41120.603215] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 16:49:06 juju-e4d256-prod-github-runner-207 kernel: [41120.604022] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 16:49:06 juju-e4d256-prod-github-runner-207 kernel: [41120.604875] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 16:49:06 juju-e4d256-prod-github-runner-207 kernel: [41120.605676] ? __seccomp_filter+0x4a/0x4a0 Aug 22 16:49:06 juju-e4d256-prod-github-runner-207 kernel: [41120.606434] ? __fget_files+0x86/0xc0 Aug 22 16:49:06 juju-e4d256-prod-github-runner-207 kernel: [41120.607148] __x64_sys_ioctl+0x95/0xd0 Aug 22 16:49:06 juju-e4d256-prod-github-runner-207 kernel: [41120.607842] do_syscall_64+0x5c/0xc0 Aug 22 16:49:06 juju-e4d256-prod-github-runner-207 kernel: [41120.608507] ? do_futex+0x162/0x1f0 Aug 22 16:49:06 juju-e4d256-prod-github-runner-207 kernel: [41120.609155] ? __x64_sys_futex+0x78/0x1e0 Aug 22 16:49:06 juju-e4d256-prod-github-runner-207 kernel: [41120.609829] ? __secure_computing+0xa9/0x120 Aug 22 16:49:06 juju-e4d256-prod-github-runner-207 kernel: [41120.610518] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 16:49:06 juju-e4d256-prod-github-runner-207 kernel: [41120.611294] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:49:06 juju-e4d256-prod-github-runner-207 kernel: [41120.612023] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:49:06 juju-e4d256-prod-github-runner-207 kernel: [41120.612746] ? do_syscall_64+0x69/0xc0 Aug 22 16:49:06 juju-e4d256-prod-github-runner-207 kernel: [41120.613391] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:49:06 juju-e4d256-prod-github-runner-207 kernel: [41120.614095] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:49:06 juju-e4d256-prod-github-runner-207 kernel: [41120.614806] ? do_syscall_64+0x69/0xc0 Aug 22 16:49:06 juju-e4d256-prod-github-runner-207 kernel: [41120.615445] ? do_syscall_64+0x69/0xc0 Aug 22 16:49:06 juju-e4d256-prod-github-runner-207 kernel: [41120.616074] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 16:49:06 juju-e4d256-prod-github-runner-207 kernel: [41120.616785] RIP: 0033:0x7faa5d0edaff Aug 22 16:49:06 juju-e4d256-prod-github-runner-207 kernel: [41120.617425] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 16:49:06 juju-e4d256-prod-github-runner-207 kernel: [41120.619429] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 16:49:06 juju-e4d256-prod-github-runner-207 kernel: [41120.620339] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 16:49:06 juju-e4d256-prod-github-runner-207 kernel: [41120.621232] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 16:49:06 juju-e4d256-prod-github-runner-207 kernel: [41120.622120] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 16:49:06 juju-e4d256-prod-github-runner-207 kernel: [41120.623013] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 16:49:06 juju-e4d256-prod-github-runner-207 kernel: [41120.623912] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 16:49:06 juju-e4d256-prod-github-runner-207 kernel: [41120.624807] Aug 22 16:49:34 juju-e4d256-prod-github-runner-207 kernel: [41148.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 38214s! [qemu-system-x86:6715] Aug 22 16:49:34 juju-e4d256-prod-github-runner-207 kernel: [41148.543114] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 16:49:34 juju-e4d256-prod-github-runner-207 kernel: [41148.543181] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 16:49:34 juju-e4d256-prod-github-runner-207 kernel: [41148.555255] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 16:49:34 juju-e4d256-prod-github-runner-207 kernel: [41148.556527] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 16:49:34 juju-e4d256-prod-github-runner-207 kernel: [41148.557756] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:49:34 juju-e4d256-prod-github-runner-207 kernel: [41148.558854] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 16:49:34 juju-e4d256-prod-github-runner-207 kernel: [41148.561406] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 16:49:34 juju-e4d256-prod-github-runner-207 kernel: [41148.562488] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 16:49:34 juju-e4d256-prod-github-runner-207 kernel: [41148.563785] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 16:49:34 juju-e4d256-prod-github-runner-207 kernel: [41148.564955] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 16:49:34 juju-e4d256-prod-github-runner-207 kernel: [41148.566120] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 16:49:34 juju-e4d256-prod-github-runner-207 kernel: [41148.567302] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 16:49:34 juju-e4d256-prod-github-runner-207 kernel: [41148.568465] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 16:49:34 juju-e4d256-prod-github-runner-207 kernel: [41148.569697] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 16:49:34 juju-e4d256-prod-github-runner-207 kernel: [41148.570818] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 16:49:34 juju-e4d256-prod-github-runner-207 kernel: [41148.572010] Call Trace: Aug 22 16:49:34 juju-e4d256-prod-github-runner-207 kernel: [41148.572921] Aug 22 16:49:34 juju-e4d256-prod-github-runner-207 kernel: [41148.573804] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:49:34 juju-e4d256-prod-github-runner-207 kernel: [41148.574962] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:49:34 juju-e4d256-prod-github-runner-207 kernel: [41148.576072] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:49:34 juju-e4d256-prod-github-runner-207 kernel: [41148.577163] ? show_regs.part.0+0x23/0x29 Aug 22 16:49:34 juju-e4d256-prod-github-runner-207 kernel: [41148.578169] ? show_regs.cold+0x8/0xd Aug 22 16:49:34 juju-e4d256-prod-github-runner-207 kernel: [41148.579164] ? watchdog_timer_fn+0x1be/0x220 Aug 22 16:49:34 juju-e4d256-prod-github-runner-207 kernel: [41148.580177] ? lockup_detector_update_enable+0x60/0x60 Aug 22 16:49:34 juju-e4d256-prod-github-runner-207 kernel: [41148.581249] ? __hrtimer_run_queues+0x107/0x230 Aug 22 16:49:34 juju-e4d256-prod-github-runner-207 kernel: [41148.582280] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 16:49:34 juju-e4d256-prod-github-runner-207 kernel: [41148.583326] ? hrtimer_interrupt+0x101/0x220 Aug 22 16:49:34 juju-e4d256-prod-github-runner-207 kernel: [41148.584348] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 16:49:34 juju-e4d256-prod-github-runner-207 kernel: [41148.585433] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 16:49:34 juju-e4d256-prod-github-runner-207 kernel: [41148.586503] Aug 22 16:49:34 juju-e4d256-prod-github-runner-207 kernel: [41148.587538] Aug 22 16:49:34 juju-e4d256-prod-github-runner-207 kernel: [41148.588402] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 16:49:34 juju-e4d256-prod-github-runner-207 kernel: [41148.589449] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:49:34 juju-e4d256-prod-github-runner-207 kernel: [41148.590511] ? _raw_spin_lock+0x22/0x30 Aug 22 16:49:34 juju-e4d256-prod-github-runner-207 kernel: [41148.591460] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:49:34 juju-e4d256-prod-github-runner-207 kernel: [41148.592481] direct_page_fault+0x206/0x310 [kvm] Aug 22 16:49:34 juju-e4d256-prod-github-runner-207 kernel: [41148.593509] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 16:49:34 juju-e4d256-prod-github-runner-207 kernel: [41148.594571] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 16:49:34 juju-e4d256-prod-github-runner-207 kernel: [41148.595686] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 16:49:34 juju-e4d256-prod-github-runner-207 kernel: [41148.596700] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 16:49:34 juju-e4d256-prod-github-runner-207 kernel: [41148.597659] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 16:49:34 juju-e4d256-prod-github-runner-207 kernel: [41148.598660] handle_exit+0x98/0x230 [kvm_amd] Aug 22 16:49:34 juju-e4d256-prod-github-runner-207 kernel: [41148.599560] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 16:49:34 juju-e4d256-prod-github-runner-207 kernel: [41148.600470] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 16:49:34 juju-e4d256-prod-github-runner-207 kernel: [41148.601394] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 16:49:34 juju-e4d256-prod-github-runner-207 kernel: [41148.602299] vcpu_run+0x62/0x2c0 [kvm] Aug 22 16:49:34 juju-e4d256-prod-github-runner-207 kernel: [41148.603133] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 16:49:34 juju-e4d256-prod-github-runner-207 kernel: [41148.603938] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 16:49:34 juju-e4d256-prod-github-runner-207 kernel: [41148.604789] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 16:49:34 juju-e4d256-prod-github-runner-207 kernel: [41148.605582] ? __seccomp_filter+0x4a/0x4a0 Aug 22 16:49:34 juju-e4d256-prod-github-runner-207 kernel: [41148.606322] ? __fget_files+0x86/0xc0 Aug 22 16:49:34 juju-e4d256-prod-github-runner-207 kernel: [41148.607135] __x64_sys_ioctl+0x95/0xd0 Aug 22 16:49:34 juju-e4d256-prod-github-runner-207 kernel: [41148.607895] do_syscall_64+0x5c/0xc0 Aug 22 16:49:34 juju-e4d256-prod-github-runner-207 kernel: [41148.608576] ? do_futex+0x162/0x1f0 Aug 22 16:49:34 juju-e4d256-prod-github-runner-207 kernel: [41148.609230] ? __x64_sys_futex+0x78/0x1e0 Aug 22 16:49:34 juju-e4d256-prod-github-runner-207 kernel: [41148.609901] ? __secure_computing+0xa9/0x120 Aug 22 16:49:34 juju-e4d256-prod-github-runner-207 kernel: [41148.610606] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 16:49:34 juju-e4d256-prod-github-runner-207 kernel: [41148.611365] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:49:34 juju-e4d256-prod-github-runner-207 kernel: [41148.612092] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:49:34 juju-e4d256-prod-github-runner-207 kernel: [41148.612808] ? do_syscall_64+0x69/0xc0 Aug 22 16:49:34 juju-e4d256-prod-github-runner-207 kernel: [41148.613455] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:49:34 juju-e4d256-prod-github-runner-207 kernel: [41148.614157] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:49:34 juju-e4d256-prod-github-runner-207 kernel: [41148.614885] ? do_syscall_64+0x69/0xc0 Aug 22 16:49:34 juju-e4d256-prod-github-runner-207 kernel: [41148.615507] ? do_syscall_64+0x69/0xc0 Aug 22 16:49:34 juju-e4d256-prod-github-runner-207 kernel: [41148.616134] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 16:49:34 juju-e4d256-prod-github-runner-207 kernel: [41148.616836] RIP: 0033:0x7faa5d0edaff Aug 22 16:49:34 juju-e4d256-prod-github-runner-207 kernel: [41148.617481] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 16:49:34 juju-e4d256-prod-github-runner-207 kernel: [41148.619540] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 16:49:34 juju-e4d256-prod-github-runner-207 kernel: [41148.620451] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 16:49:34 juju-e4d256-prod-github-runner-207 kernel: [41148.621343] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 16:49:34 juju-e4d256-prod-github-runner-207 kernel: [41148.622239] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 16:49:34 juju-e4d256-prod-github-runner-207 kernel: [41148.623285] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 16:49:34 juju-e4d256-prod-github-runner-207 kernel: [41148.624251] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 16:49:34 juju-e4d256-prod-github-runner-207 kernel: [41148.625158] Aug 22 16:50:02 juju-e4d256-prod-github-runner-207 kernel: [41176.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 38240s! [qemu-system-x86:6715] Aug 22 16:50:02 juju-e4d256-prod-github-runner-207 kernel: [41176.543107] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 16:50:02 juju-e4d256-prod-github-runner-207 kernel: [41176.543175] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 16:50:02 juju-e4d256-prod-github-runner-207 kernel: [41176.555250] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 16:50:02 juju-e4d256-prod-github-runner-207 kernel: [41176.556513] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 16:50:02 juju-e4d256-prod-github-runner-207 kernel: [41176.557731] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:50:02 juju-e4d256-prod-github-runner-207 kernel: [41176.558800] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 16:50:02 juju-e4d256-prod-github-runner-207 kernel: [41176.561342] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 16:50:02 juju-e4d256-prod-github-runner-207 kernel: [41176.562392] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 16:50:02 juju-e4d256-prod-github-runner-207 kernel: [41176.563552] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 16:50:02 juju-e4d256-prod-github-runner-207 kernel: [41176.564708] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 16:50:02 juju-e4d256-prod-github-runner-207 kernel: [41176.565918] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 16:50:02 juju-e4d256-prod-github-runner-207 kernel: [41176.567090] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 16:50:02 juju-e4d256-prod-github-runner-207 kernel: [41176.568255] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 16:50:02 juju-e4d256-prod-github-runner-207 kernel: [41176.569484] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 16:50:02 juju-e4d256-prod-github-runner-207 kernel: [41176.570585] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 16:50:02 juju-e4d256-prod-github-runner-207 kernel: [41176.571776] Call Trace: Aug 22 16:50:02 juju-e4d256-prod-github-runner-207 kernel: [41176.572687] Aug 22 16:50:02 juju-e4d256-prod-github-runner-207 kernel: [41176.573582] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:50:02 juju-e4d256-prod-github-runner-207 kernel: [41176.574648] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:50:02 juju-e4d256-prod-github-runner-207 kernel: [41176.575670] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:50:02 juju-e4d256-prod-github-runner-207 kernel: [41176.576741] ? show_regs.part.0+0x23/0x29 Aug 22 16:50:02 juju-e4d256-prod-github-runner-207 kernel: [41176.577742] ? show_regs.cold+0x8/0xd Aug 22 16:50:02 juju-e4d256-prod-github-runner-207 kernel: [41176.578721] ? watchdog_timer_fn+0x1be/0x220 Aug 22 16:50:02 juju-e4d256-prod-github-runner-207 kernel: [41176.579727] ? lockup_detector_update_enable+0x60/0x60 Aug 22 16:50:02 juju-e4d256-prod-github-runner-207 kernel: [41176.580787] ? __hrtimer_run_queues+0x107/0x230 Aug 22 16:50:02 juju-e4d256-prod-github-runner-207 kernel: [41176.581816] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 16:50:02 juju-e4d256-prod-github-runner-207 kernel: [41176.582854] ? hrtimer_interrupt+0x101/0x220 Aug 22 16:50:02 juju-e4d256-prod-github-runner-207 kernel: [41176.584442] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 16:50:02 juju-e4d256-prod-github-runner-207 kernel: [41176.587200] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 16:50:02 juju-e4d256-prod-github-runner-207 kernel: [41176.588248] Aug 22 16:50:02 juju-e4d256-prod-github-runner-207 kernel: [41176.589099] Aug 22 16:50:02 juju-e4d256-prod-github-runner-207 kernel: [41176.589933] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 16:50:02 juju-e4d256-prod-github-runner-207 kernel: [41176.590977] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:50:02 juju-e4d256-prod-github-runner-207 kernel: [41176.592020] ? _raw_spin_lock+0x22/0x30 Aug 22 16:50:02 juju-e4d256-prod-github-runner-207 kernel: [41176.592967] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:50:02 juju-e4d256-prod-github-runner-207 kernel: [41176.593993] direct_page_fault+0x206/0x310 [kvm] Aug 22 16:50:02 juju-e4d256-prod-github-runner-207 kernel: [41176.595021] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 16:50:02 juju-e4d256-prod-github-runner-207 kernel: [41176.596027] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 16:50:02 juju-e4d256-prod-github-runner-207 kernel: [41176.597025] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 16:50:02 juju-e4d256-prod-github-runner-207 kernel: [41176.597995] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 16:50:02 juju-e4d256-prod-github-runner-207 kernel: [41176.598950] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 16:50:02 juju-e4d256-prod-github-runner-207 kernel: [41176.599926] handle_exit+0x98/0x230 [kvm_amd] Aug 22 16:50:02 juju-e4d256-prod-github-runner-207 kernel: [41176.600814] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 16:50:02 juju-e4d256-prod-github-runner-207 kernel: [41176.601723] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 16:50:02 juju-e4d256-prod-github-runner-207 kernel: [41176.602654] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 16:50:02 juju-e4d256-prod-github-runner-207 kernel: [41176.603554] vcpu_run+0x62/0x2c0 [kvm] Aug 22 16:50:02 juju-e4d256-prod-github-runner-207 kernel: [41176.604364] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 16:50:02 juju-e4d256-prod-github-runner-207 kernel: [41176.605170] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 16:50:02 juju-e4d256-prod-github-runner-207 kernel: [41176.606043] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 16:50:02 juju-e4d256-prod-github-runner-207 kernel: [41176.606903] ? __seccomp_filter+0x4a/0x4a0 Aug 22 16:50:02 juju-e4d256-prod-github-runner-207 kernel: [41176.607645] ? __fget_files+0x86/0xc0 Aug 22 16:50:02 juju-e4d256-prod-github-runner-207 kernel: [41176.608345] __x64_sys_ioctl+0x95/0xd0 Aug 22 16:50:02 juju-e4d256-prod-github-runner-207 kernel: [41176.609032] do_syscall_64+0x5c/0xc0 Aug 22 16:50:02 juju-e4d256-prod-github-runner-207 kernel: [41176.609692] ? do_futex+0x162/0x1f0 Aug 22 16:50:02 juju-e4d256-prod-github-runner-207 kernel: [41176.610354] ? __x64_sys_futex+0x78/0x1e0 Aug 22 16:50:02 juju-e4d256-prod-github-runner-207 kernel: [41176.611024] ? __secure_computing+0xa9/0x120 Aug 22 16:50:02 juju-e4d256-prod-github-runner-207 kernel: [41176.611708] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 16:50:02 juju-e4d256-prod-github-runner-207 kernel: [41176.612471] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:50:02 juju-e4d256-prod-github-runner-207 kernel: [41176.613188] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:50:02 juju-e4d256-prod-github-runner-207 kernel: [41176.613899] ? do_syscall_64+0x69/0xc0 Aug 22 16:50:02 juju-e4d256-prod-github-runner-207 kernel: [41176.614548] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:50:02 juju-e4d256-prod-github-runner-207 kernel: [41176.615246] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:50:02 juju-e4d256-prod-github-runner-207 kernel: [41176.615937] ? do_syscall_64+0x69/0xc0 Aug 22 16:50:02 juju-e4d256-prod-github-runner-207 kernel: [41176.616556] ? do_syscall_64+0x69/0xc0 Aug 22 16:50:02 juju-e4d256-prod-github-runner-207 kernel: [41176.617183] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 16:50:02 juju-e4d256-prod-github-runner-207 kernel: [41176.617929] RIP: 0033:0x7faa5d0edaff Aug 22 16:50:02 juju-e4d256-prod-github-runner-207 kernel: [41176.618564] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 16:50:02 juju-e4d256-prod-github-runner-207 kernel: [41176.620541] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 16:50:02 juju-e4d256-prod-github-runner-207 kernel: [41176.621447] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 16:50:02 juju-e4d256-prod-github-runner-207 kernel: [41176.622344] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 16:50:02 juju-e4d256-prod-github-runner-207 kernel: [41176.623242] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 16:50:02 juju-e4d256-prod-github-runner-207 kernel: [41176.624138] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 16:50:02 juju-e4d256-prod-github-runner-207 kernel: [41176.625021] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 16:50:02 juju-e4d256-prod-github-runner-207 kernel: [41176.625923] Aug 22 16:50:30 juju-e4d256-prod-github-runner-207 kernel: [41204.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 38266s! [qemu-system-x86:6715] Aug 22 16:50:30 juju-e4d256-prod-github-runner-207 kernel: [41204.543284] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 16:50:30 juju-e4d256-prod-github-runner-207 kernel: [41204.543494] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 16:50:30 juju-e4d256-prod-github-runner-207 kernel: [41204.555582] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 16:50:30 juju-e4d256-prod-github-runner-207 kernel: [41204.556853] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 16:50:30 juju-e4d256-prod-github-runner-207 kernel: [41204.558107] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:50:30 juju-e4d256-prod-github-runner-207 kernel: [41204.559175] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 16:50:30 juju-e4d256-prod-github-runner-207 kernel: [41204.561756] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 16:50:30 juju-e4d256-prod-github-runner-207 kernel: [41204.562854] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 16:50:30 juju-e4d256-prod-github-runner-207 kernel: [41204.564036] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 16:50:30 juju-e4d256-prod-github-runner-207 kernel: [41204.565214] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 16:50:30 juju-e4d256-prod-github-runner-207 kernel: [41204.566399] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 16:50:30 juju-e4d256-prod-github-runner-207 kernel: [41204.567574] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 16:50:30 juju-e4d256-prod-github-runner-207 kernel: [41204.568752] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 16:50:30 juju-e4d256-prod-github-runner-207 kernel: [41204.570025] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 16:50:30 juju-e4d256-prod-github-runner-207 kernel: [41204.571128] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 16:50:30 juju-e4d256-prod-github-runner-207 kernel: [41204.572324] Call Trace: Aug 22 16:50:30 juju-e4d256-prod-github-runner-207 kernel: [41204.573235] Aug 22 16:50:30 juju-e4d256-prod-github-runner-207 kernel: [41204.574301] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:50:30 juju-e4d256-prod-github-runner-207 kernel: [41204.575486] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:50:30 juju-e4d256-prod-github-runner-207 kernel: [41204.576561] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:50:30 juju-e4d256-prod-github-runner-207 kernel: [41204.577709] ? show_regs.part.0+0x23/0x29 Aug 22 16:50:30 juju-e4d256-prod-github-runner-207 kernel: [41204.578820] ? show_regs.cold+0x8/0xd Aug 22 16:50:30 juju-e4d256-prod-github-runner-207 kernel: [41204.579855] ? watchdog_timer_fn+0x1be/0x220 Aug 22 16:50:30 juju-e4d256-prod-github-runner-207 kernel: [41204.580934] ? lockup_detector_update_enable+0x60/0x60 Aug 22 16:50:30 juju-e4d256-prod-github-runner-207 kernel: [41204.582073] ? __hrtimer_run_queues+0x107/0x230 Aug 22 16:50:30 juju-e4d256-prod-github-runner-207 kernel: [41204.583151] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 16:50:30 juju-e4d256-prod-github-runner-207 kernel: [41204.584289] ? hrtimer_interrupt+0x101/0x220 Aug 22 16:50:30 juju-e4d256-prod-github-runner-207 kernel: [41204.585343] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 16:50:30 juju-e4d256-prod-github-runner-207 kernel: [41204.586481] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 16:50:30 juju-e4d256-prod-github-runner-207 kernel: [41204.587545] Aug 22 16:50:30 juju-e4d256-prod-github-runner-207 kernel: [41204.588419] Aug 22 16:50:30 juju-e4d256-prod-github-runner-207 kernel: [41204.589324] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 16:50:30 juju-e4d256-prod-github-runner-207 kernel: [41204.590417] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:50:30 juju-e4d256-prod-github-runner-207 kernel: [41204.591474] ? _raw_spin_lock+0x22/0x30 Aug 22 16:50:30 juju-e4d256-prod-github-runner-207 kernel: [41204.592434] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:50:30 juju-e4d256-prod-github-runner-207 kernel: [41204.593491] direct_page_fault+0x206/0x310 [kvm] Aug 22 16:50:30 juju-e4d256-prod-github-runner-207 kernel: [41204.594614] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 16:50:30 juju-e4d256-prod-github-runner-207 kernel: [41204.595674] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 16:50:30 juju-e4d256-prod-github-runner-207 kernel: [41204.596693] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 16:50:30 juju-e4d256-prod-github-runner-207 kernel: [41204.597695] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 16:50:30 juju-e4d256-prod-github-runner-207 kernel: [41204.598710] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 16:50:30 juju-e4d256-prod-github-runner-207 kernel: [41204.599745] handle_exit+0x98/0x230 [kvm_amd] Aug 22 16:50:30 juju-e4d256-prod-github-runner-207 kernel: [41204.600674] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 16:50:30 juju-e4d256-prod-github-runner-207 kernel: [41204.601606] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 16:50:30 juju-e4d256-prod-github-runner-207 kernel: [41204.602712] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 16:50:30 juju-e4d256-prod-github-runner-207 kernel: [41204.603700] vcpu_run+0x62/0x2c0 [kvm] Aug 22 16:50:30 juju-e4d256-prod-github-runner-207 kernel: [41204.604585] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 16:50:30 juju-e4d256-prod-github-runner-207 kernel: [41204.605430] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 16:50:30 juju-e4d256-prod-github-runner-207 kernel: [41204.606336] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 16:50:30 juju-e4d256-prod-github-runner-207 kernel: [41204.607147] ? __seccomp_filter+0x4a/0x4a0 Aug 22 16:50:30 juju-e4d256-prod-github-runner-207 kernel: [41204.607895] ? __fget_files+0x86/0xc0 Aug 22 16:50:30 juju-e4d256-prod-github-runner-207 kernel: [41204.608639] __x64_sys_ioctl+0x95/0xd0 Aug 22 16:50:30 juju-e4d256-prod-github-runner-207 kernel: [41204.609361] do_syscall_64+0x5c/0xc0 Aug 22 16:50:30 juju-e4d256-prod-github-runner-207 kernel: [41204.610098] ? do_futex+0x162/0x1f0 Aug 22 16:50:30 juju-e4d256-prod-github-runner-207 kernel: [41204.610772] ? __x64_sys_futex+0x78/0x1e0 Aug 22 16:50:30 juju-e4d256-prod-github-runner-207 kernel: [41204.611465] ? __secure_computing+0xa9/0x120 Aug 22 16:50:30 juju-e4d256-prod-github-runner-207 kernel: [41204.612160] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 16:50:30 juju-e4d256-prod-github-runner-207 kernel: [41204.612924] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:50:30 juju-e4d256-prod-github-runner-207 kernel: [41204.613665] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:50:30 juju-e4d256-prod-github-runner-207 kernel: [41204.614414] ? do_syscall_64+0x69/0xc0 Aug 22 16:50:30 juju-e4d256-prod-github-runner-207 kernel: [41204.615121] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:50:30 juju-e4d256-prod-github-runner-207 kernel: [41204.615860] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:50:30 juju-e4d256-prod-github-runner-207 kernel: [41204.616586] ? do_syscall_64+0x69/0xc0 Aug 22 16:50:30 juju-e4d256-prod-github-runner-207 kernel: [41204.617220] ? do_syscall_64+0x69/0xc0 Aug 22 16:50:30 juju-e4d256-prod-github-runner-207 kernel: [41204.617878] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 16:50:30 juju-e4d256-prod-github-runner-207 kernel: [41204.618673] RIP: 0033:0x7faa5d0edaff Aug 22 16:50:30 juju-e4d256-prod-github-runner-207 kernel: [41204.619386] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 16:50:30 juju-e4d256-prod-github-runner-207 kernel: [41204.621498] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 16:50:30 juju-e4d256-prod-github-runner-207 kernel: [41204.622456] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 16:50:30 juju-e4d256-prod-github-runner-207 kernel: [41204.623358] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 16:50:30 juju-e4d256-prod-github-runner-207 kernel: [41204.624295] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 16:50:30 juju-e4d256-prod-github-runner-207 kernel: [41204.625237] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 16:50:30 juju-e4d256-prod-github-runner-207 kernel: [41204.626201] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 16:50:30 juju-e4d256-prod-github-runner-207 kernel: [41204.627119] Aug 22 16:50:46 juju-e4d256-prod-github-runner-207 kernel: [41219.936705] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 16:50:46 juju-e4d256-prod-github-runner-207 kernel: [41219.938257] rcu: 1-....: (10243443 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=4955049 Aug 22 16:50:46 juju-e4d256-prod-github-runner-207 kernel: [41219.939382] (t=10275684 jiffies g=23269 q=41662) Aug 22 16:50:46 juju-e4d256-prod-github-runner-207 kernel: [41219.940174] NMI backtrace for cpu 1 Aug 22 16:50:46 juju-e4d256-prod-github-runner-207 kernel: [41219.940886] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 16:50:46 juju-e4d256-prod-github-runner-207 kernel: [41219.942004] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 16:50:46 juju-e4d256-prod-github-runner-207 kernel: [41219.943060] Call Trace: Aug 22 16:50:46 juju-e4d256-prod-github-runner-207 kernel: [41219.943740] Aug 22 16:50:46 juju-e4d256-prod-github-runner-207 kernel: [41219.944385] show_stack+0x52/0x5c Aug 22 16:50:46 juju-e4d256-prod-github-runner-207 kernel: [41219.945113] dump_stack_lvl+0x4a/0x63 Aug 22 16:50:46 juju-e4d256-prod-github-runner-207 kernel: [41219.945910] dump_stack+0x10/0x16 Aug 22 16:50:46 juju-e4d256-prod-github-runner-207 kernel: [41219.946647] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 16:50:46 juju-e4d256-prod-github-runner-207 kernel: [41219.947429] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 16:50:46 juju-e4d256-prod-github-runner-207 kernel: [41219.948244] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 16:50:46 juju-e4d256-prod-github-runner-207 kernel: [41219.949073] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 16:50:46 juju-e4d256-prod-github-runner-207 kernel: [41219.949974] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 16:50:46 juju-e4d256-prod-github-runner-207 kernel: [41219.950827] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 16:50:46 juju-e4d256-prod-github-runner-207 kernel: [41219.951602] print_cpu_stall.cold+0x2f/0xe2 Aug 22 16:50:46 juju-e4d256-prod-github-runner-207 kernel: [41219.952374] ? timekeeping_update+0xf7/0x150 Aug 22 16:50:46 juju-e4d256-prod-github-runner-207 kernel: [41219.953159] check_cpu_stall+0x109/0x270 Aug 22 16:50:46 juju-e4d256-prod-github-runner-207 kernel: [41219.953928] rcu_sched_clock_irq+0x9a/0x250 Aug 22 16:50:46 juju-e4d256-prod-github-runner-207 kernel: [41219.954689] update_process_times+0x94/0xd0 Aug 22 16:50:46 juju-e4d256-prod-github-runner-207 kernel: [41219.955446] tick_sched_handle+0x29/0x70 Aug 22 16:50:46 juju-e4d256-prod-github-runner-207 kernel: [41219.956196] tick_sched_timer+0x8c/0xc0 Aug 22 16:50:46 juju-e4d256-prod-github-runner-207 kernel: [41219.956946] ? tick_nohz_handler+0xb0/0xb0 Aug 22 16:50:46 juju-e4d256-prod-github-runner-207 kernel: [41219.957720] __hrtimer_run_queues+0x107/0x230 Aug 22 16:50:46 juju-e4d256-prod-github-runner-207 kernel: [41219.958528] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 16:50:46 juju-e4d256-prod-github-runner-207 kernel: [41219.959350] hrtimer_interrupt+0x101/0x220 Aug 22 16:50:46 juju-e4d256-prod-github-runner-207 kernel: [41219.960130] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 16:50:46 juju-e4d256-prod-github-runner-207 kernel: [41219.960964] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 16:50:46 juju-e4d256-prod-github-runner-207 kernel: [41219.961784] Aug 22 16:50:46 juju-e4d256-prod-github-runner-207 kernel: [41219.962422] Aug 22 16:50:46 juju-e4d256-prod-github-runner-207 kernel: [41219.963054] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 16:50:46 juju-e4d256-prod-github-runner-207 kernel: [41219.963996] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:50:46 juju-e4d256-prod-github-runner-207 kernel: [41219.964943] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 16:50:46 juju-e4d256-prod-github-runner-207 kernel: [41219.967581] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 16:50:46 juju-e4d256-prod-github-runner-207 kernel: [41219.968496] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 16:50:46 juju-e4d256-prod-github-runner-207 kernel: [41219.969497] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 16:50:46 juju-e4d256-prod-github-runner-207 kernel: [41219.970496] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 16:50:46 juju-e4d256-prod-github-runner-207 kernel: [41219.971458] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 16:50:46 juju-e4d256-prod-github-runner-207 kernel: [41219.972411] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 16:50:46 juju-e4d256-prod-github-runner-207 kernel: [41219.973398] ? _raw_spin_lock+0x22/0x30 Aug 22 16:50:46 juju-e4d256-prod-github-runner-207 kernel: [41219.974181] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:50:46 juju-e4d256-prod-github-runner-207 kernel: [41219.975021] direct_page_fault+0x206/0x310 [kvm] Aug 22 16:50:46 juju-e4d256-prod-github-runner-207 kernel: [41219.975864] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 16:50:46 juju-e4d256-prod-github-runner-207 kernel: [41219.976691] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 16:50:46 juju-e4d256-prod-github-runner-207 kernel: [41219.977519] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 16:50:46 juju-e4d256-prod-github-runner-207 kernel: [41219.978376] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 16:50:46 juju-e4d256-prod-github-runner-207 kernel: [41219.979171] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 16:50:46 juju-e4d256-prod-github-runner-207 kernel: [41219.979989] handle_exit+0x98/0x230 [kvm_amd] Aug 22 16:50:46 juju-e4d256-prod-github-runner-207 kernel: [41219.980739] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 16:50:46 juju-e4d256-prod-github-runner-207 kernel: [41219.981522] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 16:50:46 juju-e4d256-prod-github-runner-207 kernel: [41219.982523] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 16:50:46 juju-e4d256-prod-github-runner-207 kernel: [41219.983373] vcpu_run+0x62/0x2c0 [kvm] Aug 22 16:50:46 juju-e4d256-prod-github-runner-207 kernel: [41219.984178] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 16:50:46 juju-e4d256-prod-github-runner-207 kernel: [41219.984984] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 16:50:46 juju-e4d256-prod-github-runner-207 kernel: [41219.985862] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 16:50:46 juju-e4d256-prod-github-runner-207 kernel: [41219.986657] ? __seccomp_filter+0x4a/0x4a0 Aug 22 16:50:46 juju-e4d256-prod-github-runner-207 kernel: [41219.987385] ? __fget_files+0x86/0xc0 Aug 22 16:50:46 juju-e4d256-prod-github-runner-207 kernel: [41219.988182] __x64_sys_ioctl+0x95/0xd0 Aug 22 16:50:46 juju-e4d256-prod-github-runner-207 kernel: [41219.988899] do_syscall_64+0x5c/0xc0 Aug 22 16:50:46 juju-e4d256-prod-github-runner-207 kernel: [41219.989581] ? do_futex+0x162/0x1f0 Aug 22 16:50:46 juju-e4d256-prod-github-runner-207 kernel: [41219.990270] ? __x64_sys_futex+0x78/0x1e0 Aug 22 16:50:46 juju-e4d256-prod-github-runner-207 kernel: [41219.990982] ? __secure_computing+0xa9/0x120 Aug 22 16:50:46 juju-e4d256-prod-github-runner-207 kernel: [41219.991703] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 16:50:46 juju-e4d256-prod-github-runner-207 kernel: [41219.992493] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:50:46 juju-e4d256-prod-github-runner-207 kernel: [41219.993247] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:50:46 juju-e4d256-prod-github-runner-207 kernel: [41219.994018] ? do_syscall_64+0x69/0xc0 Aug 22 16:50:46 juju-e4d256-prod-github-runner-207 kernel: [41219.994707] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:50:46 juju-e4d256-prod-github-runner-207 kernel: [41219.995501] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:50:46 juju-e4d256-prod-github-runner-207 kernel: [41219.996373] ? do_syscall_64+0x69/0xc0 Aug 22 16:50:46 juju-e4d256-prod-github-runner-207 kernel: [41219.997082] ? do_syscall_64+0x69/0xc0 Aug 22 16:50:46 juju-e4d256-prod-github-runner-207 kernel: [41219.997797] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 16:50:46 juju-e4d256-prod-github-runner-207 kernel: [41219.998575] RIP: 0033:0x7faa5d0edaff Aug 22 16:50:46 juju-e4d256-prod-github-runner-207 kernel: [41219.999276] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 16:50:46 juju-e4d256-prod-github-runner-207 kernel: [41220.001372] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 16:50:46 juju-e4d256-prod-github-runner-207 kernel: [41220.002348] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 16:50:46 juju-e4d256-prod-github-runner-207 kernel: [41220.003293] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 16:50:46 juju-e4d256-prod-github-runner-207 kernel: [41220.004238] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 16:50:46 juju-e4d256-prod-github-runner-207 kernel: [41220.005179] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 16:50:46 juju-e4d256-prod-github-runner-207 kernel: [41220.006120] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 16:50:46 juju-e4d256-prod-github-runner-207 kernel: [41220.007035] Aug 22 16:51:10 juju-e4d256-prod-github-runner-207 kernel: [41244.541980] watchdog: BUG: soft lockup - CPU#1 stuck for 38303s! [qemu-system-x86:6715] Aug 22 16:51:10 juju-e4d256-prod-github-runner-207 kernel: [41244.543087] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 16:51:10 juju-e4d256-prod-github-runner-207 kernel: [41244.543275] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 16:51:10 juju-e4d256-prod-github-runner-207 kernel: [41244.555338] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 16:51:10 juju-e4d256-prod-github-runner-207 kernel: [41244.556606] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 16:51:10 juju-e4d256-prod-github-runner-207 kernel: [41244.557840] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:51:10 juju-e4d256-prod-github-runner-207 kernel: [41244.558931] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 16:51:10 juju-e4d256-prod-github-runner-207 kernel: [41244.561495] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 16:51:10 juju-e4d256-prod-github-runner-207 kernel: [41244.562541] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 16:51:10 juju-e4d256-prod-github-runner-207 kernel: [41244.563705] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 16:51:10 juju-e4d256-prod-github-runner-207 kernel: [41244.564905] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 16:51:10 juju-e4d256-prod-github-runner-207 kernel: [41244.566101] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 16:51:10 juju-e4d256-prod-github-runner-207 kernel: [41244.567275] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 16:51:10 juju-e4d256-prod-github-runner-207 kernel: [41244.568444] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 16:51:10 juju-e4d256-prod-github-runner-207 kernel: [41244.569686] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 16:51:10 juju-e4d256-prod-github-runner-207 kernel: [41244.570787] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 16:51:10 juju-e4d256-prod-github-runner-207 kernel: [41244.571995] Call Trace: Aug 22 16:51:10 juju-e4d256-prod-github-runner-207 kernel: [41244.572922] Aug 22 16:51:10 juju-e4d256-prod-github-runner-207 kernel: [41244.573817] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:51:10 juju-e4d256-prod-github-runner-207 kernel: [41244.574848] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:51:10 juju-e4d256-prod-github-runner-207 kernel: [41244.575871] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:51:10 juju-e4d256-prod-github-runner-207 kernel: [41244.576949] ? show_regs.part.0+0x23/0x29 Aug 22 16:51:10 juju-e4d256-prod-github-runner-207 kernel: [41244.577970] ? show_regs.cold+0x8/0xd Aug 22 16:51:10 juju-e4d256-prod-github-runner-207 kernel: [41244.578939] ? watchdog_timer_fn+0x1be/0x220 Aug 22 16:51:10 juju-e4d256-prod-github-runner-207 kernel: [41244.579949] ? lockup_detector_update_enable+0x60/0x60 Aug 22 16:51:10 juju-e4d256-prod-github-runner-207 kernel: [41244.581008] ? __hrtimer_run_queues+0x107/0x230 Aug 22 16:51:10 juju-e4d256-prod-github-runner-207 kernel: [41244.582054] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 16:51:10 juju-e4d256-prod-github-runner-207 kernel: [41244.583080] ? hrtimer_interrupt+0x101/0x220 Aug 22 16:51:10 juju-e4d256-prod-github-runner-207 kernel: [41244.584097] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 16:51:10 juju-e4d256-prod-github-runner-207 kernel: [41244.585162] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 16:51:10 juju-e4d256-prod-github-runner-207 kernel: [41244.586231] Aug 22 16:51:10 juju-e4d256-prod-github-runner-207 kernel: [41244.587145] Aug 22 16:51:10 juju-e4d256-prod-github-runner-207 kernel: [41244.587985] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 16:51:10 juju-e4d256-prod-github-runner-207 kernel: [41244.589086] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:51:10 juju-e4d256-prod-github-runner-207 kernel: [41244.590131] ? _raw_spin_lock+0x22/0x30 Aug 22 16:51:10 juju-e4d256-prod-github-runner-207 kernel: [41244.591071] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:51:10 juju-e4d256-prod-github-runner-207 kernel: [41244.592082] direct_page_fault+0x206/0x310 [kvm] Aug 22 16:51:10 juju-e4d256-prod-github-runner-207 kernel: [41244.593101] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 16:51:10 juju-e4d256-prod-github-runner-207 kernel: [41244.594133] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 16:51:10 juju-e4d256-prod-github-runner-207 kernel: [41244.595141] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 16:51:10 juju-e4d256-prod-github-runner-207 kernel: [41244.596118] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 16:51:10 juju-e4d256-prod-github-runner-207 kernel: [41244.597071] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 16:51:10 juju-e4d256-prod-github-runner-207 kernel: [41244.598058] handle_exit+0x98/0x230 [kvm_amd] Aug 22 16:51:10 juju-e4d256-prod-github-runner-207 kernel: [41244.598954] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 16:51:10 juju-e4d256-prod-github-runner-207 kernel: [41244.599867] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 16:51:10 juju-e4d256-prod-github-runner-207 kernel: [41244.600793] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 16:51:10 juju-e4d256-prod-github-runner-207 kernel: [41244.601705] vcpu_run+0x62/0x2c0 [kvm] Aug 22 16:51:10 juju-e4d256-prod-github-runner-207 kernel: [41244.602532] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 16:51:10 juju-e4d256-prod-github-runner-207 kernel: [41244.603337] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 16:51:10 juju-e4d256-prod-github-runner-207 kernel: [41244.604191] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 16:51:10 juju-e4d256-prod-github-runner-207 kernel: [41244.604989] ? __seccomp_filter+0x4a/0x4a0 Aug 22 16:51:10 juju-e4d256-prod-github-runner-207 kernel: [41244.605748] ? __fget_files+0x86/0xc0 Aug 22 16:51:10 juju-e4d256-prod-github-runner-207 kernel: [41244.606450] __x64_sys_ioctl+0x95/0xd0 Aug 22 16:51:10 juju-e4d256-prod-github-runner-207 kernel: [41244.607140] do_syscall_64+0x5c/0xc0 Aug 22 16:51:10 juju-e4d256-prod-github-runner-207 kernel: [41244.607803] ? do_futex+0x162/0x1f0 Aug 22 16:51:10 juju-e4d256-prod-github-runner-207 kernel: [41244.608448] ? __x64_sys_futex+0x78/0x1e0 Aug 22 16:51:10 juju-e4d256-prod-github-runner-207 kernel: [41244.609119] ? __secure_computing+0xa9/0x120 Aug 22 16:51:10 juju-e4d256-prod-github-runner-207 kernel: [41244.609831] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 16:51:10 juju-e4d256-prod-github-runner-207 kernel: [41244.610589] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:51:10 juju-e4d256-prod-github-runner-207 kernel: [41244.611316] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:51:10 juju-e4d256-prod-github-runner-207 kernel: [41244.612032] ? do_syscall_64+0x69/0xc0 Aug 22 16:51:10 juju-e4d256-prod-github-runner-207 kernel: [41244.612674] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:51:10 juju-e4d256-prod-github-runner-207 kernel: [41244.613393] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:51:10 juju-e4d256-prod-github-runner-207 kernel: [41244.614091] ? do_syscall_64+0x69/0xc0 Aug 22 16:51:10 juju-e4d256-prod-github-runner-207 kernel: [41244.614714] ? do_syscall_64+0x69/0xc0 Aug 22 16:51:10 juju-e4d256-prod-github-runner-207 kernel: [41244.615334] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 16:51:10 juju-e4d256-prod-github-runner-207 kernel: [41244.616051] RIP: 0033:0x7faa5d0edaff Aug 22 16:51:10 juju-e4d256-prod-github-runner-207 kernel: [41244.616673] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 16:51:10 juju-e4d256-prod-github-runner-207 kernel: [41244.618664] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 16:51:10 juju-e4d256-prod-github-runner-207 kernel: [41244.619569] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 16:51:10 juju-e4d256-prod-github-runner-207 kernel: [41244.620459] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 16:51:10 juju-e4d256-prod-github-runner-207 kernel: [41244.621355] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 16:51:10 juju-e4d256-prod-github-runner-207 kernel: [41244.622240] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 16:51:10 juju-e4d256-prod-github-runner-207 kernel: [41244.623129] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 16:51:10 juju-e4d256-prod-github-runner-207 kernel: [41244.624029] Aug 22 16:51:38 juju-e4d256-prod-github-runner-207 kernel: [41272.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 38330s! [qemu-system-x86:6715] Aug 22 16:51:38 juju-e4d256-prod-github-runner-207 kernel: [41272.543126] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 16:51:38 juju-e4d256-prod-github-runner-207 kernel: [41272.543196] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 16:51:38 juju-e4d256-prod-github-runner-207 kernel: [41272.555300] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 16:51:38 juju-e4d256-prod-github-runner-207 kernel: [41272.556566] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 16:51:38 juju-e4d256-prod-github-runner-207 kernel: [41272.557806] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:51:38 juju-e4d256-prod-github-runner-207 kernel: [41272.558868] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 16:51:38 juju-e4d256-prod-github-runner-207 kernel: [41272.561436] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 16:51:38 juju-e4d256-prod-github-runner-207 kernel: [41272.562483] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 16:51:38 juju-e4d256-prod-github-runner-207 kernel: [41272.563649] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 16:51:38 juju-e4d256-prod-github-runner-207 kernel: [41272.564814] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 16:51:38 juju-e4d256-prod-github-runner-207 kernel: [41272.565991] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 16:51:38 juju-e4d256-prod-github-runner-207 kernel: [41272.567161] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 16:51:38 juju-e4d256-prod-github-runner-207 kernel: [41272.568333] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 16:51:38 juju-e4d256-prod-github-runner-207 kernel: [41272.569581] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 16:51:38 juju-e4d256-prod-github-runner-207 kernel: [41272.570678] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 16:51:38 juju-e4d256-prod-github-runner-207 kernel: [41272.571870] Call Trace: Aug 22 16:51:38 juju-e4d256-prod-github-runner-207 kernel: [41272.572785] Aug 22 16:51:38 juju-e4d256-prod-github-runner-207 kernel: [41272.573679] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:51:38 juju-e4d256-prod-github-runner-207 kernel: [41272.574713] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:51:38 juju-e4d256-prod-github-runner-207 kernel: [41272.575737] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:51:38 juju-e4d256-prod-github-runner-207 kernel: [41272.576814] ? show_regs.part.0+0x23/0x29 Aug 22 16:51:38 juju-e4d256-prod-github-runner-207 kernel: [41272.577823] ? show_regs.cold+0x8/0xd Aug 22 16:51:38 juju-e4d256-prod-github-runner-207 kernel: [41272.578793] ? watchdog_timer_fn+0x1be/0x220 Aug 22 16:51:38 juju-e4d256-prod-github-runner-207 kernel: [41272.579806] ? lockup_detector_update_enable+0x60/0x60 Aug 22 16:51:38 juju-e4d256-prod-github-runner-207 kernel: [41272.580868] ? __hrtimer_run_queues+0x107/0x230 Aug 22 16:51:38 juju-e4d256-prod-github-runner-207 kernel: [41272.581906] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 16:51:38 juju-e4d256-prod-github-runner-207 kernel: [41272.583076] ? hrtimer_interrupt+0x101/0x220 Aug 22 16:51:38 juju-e4d256-prod-github-runner-207 kernel: [41272.584088] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 16:51:38 juju-e4d256-prod-github-runner-207 kernel: [41272.585168] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 16:51:38 juju-e4d256-prod-github-runner-207 kernel: [41272.586213] Aug 22 16:51:38 juju-e4d256-prod-github-runner-207 kernel: [41272.587065] Aug 22 16:51:38 juju-e4d256-prod-github-runner-207 kernel: [41272.587899] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 16:51:38 juju-e4d256-prod-github-runner-207 kernel: [41272.588930] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:51:38 juju-e4d256-prod-github-runner-207 kernel: [41272.589983] ? _raw_spin_lock+0x22/0x30 Aug 22 16:51:38 juju-e4d256-prod-github-runner-207 kernel: [41272.590927] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:51:38 juju-e4d256-prod-github-runner-207 kernel: [41272.591943] direct_page_fault+0x206/0x310 [kvm] Aug 22 16:51:38 juju-e4d256-prod-github-runner-207 kernel: [41272.592964] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 16:51:38 juju-e4d256-prod-github-runner-207 kernel: [41272.593984] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 16:51:38 juju-e4d256-prod-github-runner-207 kernel: [41272.594983] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 16:51:38 juju-e4d256-prod-github-runner-207 kernel: [41272.595952] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 16:51:38 juju-e4d256-prod-github-runner-207 kernel: [41272.596897] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 16:51:38 juju-e4d256-prod-github-runner-207 kernel: [41272.597885] handle_exit+0x98/0x230 [kvm_amd] Aug 22 16:51:38 juju-e4d256-prod-github-runner-207 kernel: [41272.598781] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 16:51:38 juju-e4d256-prod-github-runner-207 kernel: [41272.599693] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 16:51:38 juju-e4d256-prod-github-runner-207 kernel: [41272.600614] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 16:51:38 juju-e4d256-prod-github-runner-207 kernel: [41272.601531] vcpu_run+0x62/0x2c0 [kvm] Aug 22 16:51:38 juju-e4d256-prod-github-runner-207 kernel: [41272.602341] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 16:51:38 juju-e4d256-prod-github-runner-207 kernel: [41272.603146] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 16:51:38 juju-e4d256-prod-github-runner-207 kernel: [41272.603998] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 16:51:38 juju-e4d256-prod-github-runner-207 kernel: [41272.604798] ? __seccomp_filter+0x4a/0x4a0 Aug 22 16:51:38 juju-e4d256-prod-github-runner-207 kernel: [41272.605548] ? __fget_files+0x86/0xc0 Aug 22 16:51:38 juju-e4d256-prod-github-runner-207 kernel: [41272.606255] __x64_sys_ioctl+0x95/0xd0 Aug 22 16:51:38 juju-e4d256-prod-github-runner-207 kernel: [41272.606945] do_syscall_64+0x5c/0xc0 Aug 22 16:51:38 juju-e4d256-prod-github-runner-207 kernel: [41272.607607] ? do_futex+0x162/0x1f0 Aug 22 16:51:38 juju-e4d256-prod-github-runner-207 kernel: [41272.608253] ? __x64_sys_futex+0x78/0x1e0 Aug 22 16:51:38 juju-e4d256-prod-github-runner-207 kernel: [41272.608924] ? __secure_computing+0xa9/0x120 Aug 22 16:51:38 juju-e4d256-prod-github-runner-207 kernel: [41272.609625] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 16:51:38 juju-e4d256-prod-github-runner-207 kernel: [41272.610386] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:51:38 juju-e4d256-prod-github-runner-207 kernel: [41272.611106] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:51:38 juju-e4d256-prod-github-runner-207 kernel: [41272.611823] ? do_syscall_64+0x69/0xc0 Aug 22 16:51:38 juju-e4d256-prod-github-runner-207 kernel: [41272.612471] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:51:38 juju-e4d256-prod-github-runner-207 kernel: [41272.613192] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:51:38 juju-e4d256-prod-github-runner-207 kernel: [41272.613886] ? do_syscall_64+0x69/0xc0 Aug 22 16:51:38 juju-e4d256-prod-github-runner-207 kernel: [41272.614509] ? do_syscall_64+0x69/0xc0 Aug 22 16:51:38 juju-e4d256-prod-github-runner-207 kernel: [41272.615134] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 16:51:38 juju-e4d256-prod-github-runner-207 kernel: [41272.615837] RIP: 0033:0x7faa5d0edaff Aug 22 16:51:38 juju-e4d256-prod-github-runner-207 kernel: [41272.616458] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 16:51:38 juju-e4d256-prod-github-runner-207 kernel: [41272.618498] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 16:51:38 juju-e4d256-prod-github-runner-207 kernel: [41272.619410] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 16:51:38 juju-e4d256-prod-github-runner-207 kernel: [41272.620301] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 16:51:38 juju-e4d256-prod-github-runner-207 kernel: [41272.621202] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 16:51:38 juju-e4d256-prod-github-runner-207 kernel: [41272.622094] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 16:51:38 juju-e4d256-prod-github-runner-207 kernel: [41272.622981] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 16:51:38 juju-e4d256-prod-github-runner-207 kernel: [41272.623869] Aug 22 16:52:06 juju-e4d256-prod-github-runner-207 kernel: [41300.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 38356s! [qemu-system-x86:6715] Aug 22 16:52:06 juju-e4d256-prod-github-runner-207 kernel: [41300.543728] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 16:52:06 juju-e4d256-prod-github-runner-207 kernel: [41300.543977] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 16:52:06 juju-e4d256-prod-github-runner-207 kernel: [41300.556082] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 16:52:06 juju-e4d256-prod-github-runner-207 kernel: [41300.557366] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 16:52:06 juju-e4d256-prod-github-runner-207 kernel: [41300.558586] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:52:06 juju-e4d256-prod-github-runner-207 kernel: [41300.559656] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 16:52:06 juju-e4d256-prod-github-runner-207 kernel: [41300.562224] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 16:52:06 juju-e4d256-prod-github-runner-207 kernel: [41300.563264] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 16:52:06 juju-e4d256-prod-github-runner-207 kernel: [41300.564454] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 16:52:06 juju-e4d256-prod-github-runner-207 kernel: [41300.565630] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 16:52:06 juju-e4d256-prod-github-runner-207 kernel: [41300.566785] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 16:52:06 juju-e4d256-prod-github-runner-207 kernel: [41300.567948] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 16:52:06 juju-e4d256-prod-github-runner-207 kernel: [41300.569122] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 16:52:06 juju-e4d256-prod-github-runner-207 kernel: [41300.570363] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 16:52:06 juju-e4d256-prod-github-runner-207 kernel: [41300.571462] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 16:52:06 juju-e4d256-prod-github-runner-207 kernel: [41300.572658] Call Trace: Aug 22 16:52:06 juju-e4d256-prod-github-runner-207 kernel: [41300.573587] Aug 22 16:52:06 juju-e4d256-prod-github-runner-207 kernel: [41300.574495] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:52:06 juju-e4d256-prod-github-runner-207 kernel: [41300.575548] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:52:06 juju-e4d256-prod-github-runner-207 kernel: [41300.576572] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:52:06 juju-e4d256-prod-github-runner-207 kernel: [41300.577681] ? show_regs.part.0+0x23/0x29 Aug 22 16:52:06 juju-e4d256-prod-github-runner-207 kernel: [41300.578677] ? show_regs.cold+0x8/0xd Aug 22 16:52:06 juju-e4d256-prod-github-runner-207 kernel: [41300.579647] ? watchdog_timer_fn+0x1be/0x220 Aug 22 16:52:06 juju-e4d256-prod-github-runner-207 kernel: [41300.580667] ? lockup_detector_update_enable+0x60/0x60 Aug 22 16:52:06 juju-e4d256-prod-github-runner-207 kernel: [41300.581751] ? __hrtimer_run_queues+0x107/0x230 Aug 22 16:52:06 juju-e4d256-prod-github-runner-207 kernel: [41300.582782] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 16:52:06 juju-e4d256-prod-github-runner-207 kernel: [41300.583809] ? hrtimer_interrupt+0x101/0x220 Aug 22 16:52:06 juju-e4d256-prod-github-runner-207 kernel: [41300.584860] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 16:52:06 juju-e4d256-prod-github-runner-207 kernel: [41300.585936] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 16:52:06 juju-e4d256-prod-github-runner-207 kernel: [41300.586985] Aug 22 16:52:06 juju-e4d256-prod-github-runner-207 kernel: [41300.587841] Aug 22 16:52:06 juju-e4d256-prod-github-runner-207 kernel: [41300.588677] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 16:52:06 juju-e4d256-prod-github-runner-207 kernel: [41300.589729] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:52:06 juju-e4d256-prod-github-runner-207 kernel: [41300.590780] ? _raw_spin_lock+0x22/0x30 Aug 22 16:52:06 juju-e4d256-prod-github-runner-207 kernel: [41300.591722] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:52:06 juju-e4d256-prod-github-runner-207 kernel: [41300.592755] direct_page_fault+0x206/0x310 [kvm] Aug 22 16:52:06 juju-e4d256-prod-github-runner-207 kernel: [41300.593784] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 16:52:06 juju-e4d256-prod-github-runner-207 kernel: [41300.594797] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 16:52:06 juju-e4d256-prod-github-runner-207 kernel: [41300.595832] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 16:52:06 juju-e4d256-prod-github-runner-207 kernel: [41300.596838] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 16:52:06 juju-e4d256-prod-github-runner-207 kernel: [41300.597781] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 16:52:06 juju-e4d256-prod-github-runner-207 kernel: [41300.598758] handle_exit+0x98/0x230 [kvm_amd] Aug 22 16:52:06 juju-e4d256-prod-github-runner-207 kernel: [41300.599650] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 16:52:06 juju-e4d256-prod-github-runner-207 kernel: [41300.600572] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 16:52:06 juju-e4d256-prod-github-runner-207 kernel: [41300.601521] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 16:52:06 juju-e4d256-prod-github-runner-207 kernel: [41300.602427] vcpu_run+0x62/0x2c0 [kvm] Aug 22 16:52:06 juju-e4d256-prod-github-runner-207 kernel: [41300.603236] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 16:52:06 juju-e4d256-prod-github-runner-207 kernel: [41300.604045] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 16:52:06 juju-e4d256-prod-github-runner-207 kernel: [41300.604918] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 16:52:06 juju-e4d256-prod-github-runner-207 kernel: [41300.605765] ? __seccomp_filter+0x4a/0x4a0 Aug 22 16:52:06 juju-e4d256-prod-github-runner-207 kernel: [41300.606696] ? __fget_files+0x86/0xc0 Aug 22 16:52:06 juju-e4d256-prod-github-runner-207 kernel: [41300.607401] __x64_sys_ioctl+0x95/0xd0 Aug 22 16:52:06 juju-e4d256-prod-github-runner-207 kernel: [41300.608094] do_syscall_64+0x5c/0xc0 Aug 22 16:52:06 juju-e4d256-prod-github-runner-207 kernel: [41300.608774] ? do_futex+0x162/0x1f0 Aug 22 16:52:06 juju-e4d256-prod-github-runner-207 kernel: [41300.609428] ? __x64_sys_futex+0x78/0x1e0 Aug 22 16:52:06 juju-e4d256-prod-github-runner-207 kernel: [41300.610101] ? __secure_computing+0xa9/0x120 Aug 22 16:52:06 juju-e4d256-prod-github-runner-207 kernel: [41300.610799] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 16:52:06 juju-e4d256-prod-github-runner-207 kernel: [41300.611568] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:52:06 juju-e4d256-prod-github-runner-207 kernel: [41300.612289] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:52:06 juju-e4d256-prod-github-runner-207 kernel: [41300.613027] ? do_syscall_64+0x69/0xc0 Aug 22 16:52:06 juju-e4d256-prod-github-runner-207 kernel: [41300.613678] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:52:06 juju-e4d256-prod-github-runner-207 kernel: [41300.614387] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:52:06 juju-e4d256-prod-github-runner-207 kernel: [41300.615081] ? do_syscall_64+0x69/0xc0 Aug 22 16:52:06 juju-e4d256-prod-github-runner-207 kernel: [41300.615721] ? do_syscall_64+0x69/0xc0 Aug 22 16:52:06 juju-e4d256-prod-github-runner-207 kernel: [41300.616368] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 16:52:06 juju-e4d256-prod-github-runner-207 kernel: [41300.617086] RIP: 0033:0x7faa5d0edaff Aug 22 16:52:06 juju-e4d256-prod-github-runner-207 kernel: [41300.617724] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 16:52:06 juju-e4d256-prod-github-runner-207 kernel: [41300.619706] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 16:52:06 juju-e4d256-prod-github-runner-207 kernel: [41300.620613] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 16:52:06 juju-e4d256-prod-github-runner-207 kernel: [41300.621521] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 16:52:06 juju-e4d256-prod-github-runner-207 kernel: [41300.622406] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 16:52:06 juju-e4d256-prod-github-runner-207 kernel: [41300.623290] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 16:52:06 juju-e4d256-prod-github-runner-207 kernel: [41300.624175] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 16:52:06 juju-e4d256-prod-github-runner-207 kernel: [41300.625079] Aug 22 16:52:34 juju-e4d256-prod-github-runner-207 kernel: [41328.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 38382s! [qemu-system-x86:6715] Aug 22 16:52:34 juju-e4d256-prod-github-runner-207 kernel: [41328.543103] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 16:52:34 juju-e4d256-prod-github-runner-207 kernel: [41328.543171] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 16:52:34 juju-e4d256-prod-github-runner-207 kernel: [41328.555678] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 16:52:34 juju-e4d256-prod-github-runner-207 kernel: [41328.556959] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 16:52:34 juju-e4d256-prod-github-runner-207 kernel: [41328.558187] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:52:34 juju-e4d256-prod-github-runner-207 kernel: [41328.559248] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 16:52:34 juju-e4d256-prod-github-runner-207 kernel: [41328.561807] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 16:52:34 juju-e4d256-prod-github-runner-207 kernel: [41328.562851] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 16:52:34 juju-e4d256-prod-github-runner-207 kernel: [41328.564014] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 16:52:34 juju-e4d256-prod-github-runner-207 kernel: [41328.565187] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 16:52:34 juju-e4d256-prod-github-runner-207 kernel: [41328.566350] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 16:52:34 juju-e4d256-prod-github-runner-207 kernel: [41328.567517] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 16:52:34 juju-e4d256-prod-github-runner-207 kernel: [41328.568716] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 16:52:34 juju-e4d256-prod-github-runner-207 kernel: [41328.569953] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 16:52:34 juju-e4d256-prod-github-runner-207 kernel: [41328.571057] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 16:52:34 juju-e4d256-prod-github-runner-207 kernel: [41328.572254] Call Trace: Aug 22 16:52:34 juju-e4d256-prod-github-runner-207 kernel: [41328.573179] Aug 22 16:52:34 juju-e4d256-prod-github-runner-207 kernel: [41328.574062] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:52:34 juju-e4d256-prod-github-runner-207 kernel: [41328.575090] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:52:34 juju-e4d256-prod-github-runner-207 kernel: [41328.576120] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:52:34 juju-e4d256-prod-github-runner-207 kernel: [41328.577332] ? show_regs.part.0+0x23/0x29 Aug 22 16:52:34 juju-e4d256-prod-github-runner-207 kernel: [41328.578346] ? show_regs.cold+0x8/0xd Aug 22 16:52:34 juju-e4d256-prod-github-runner-207 kernel: [41328.579325] ? watchdog_timer_fn+0x1be/0x220 Aug 22 16:52:34 juju-e4d256-prod-github-runner-207 kernel: [41328.580339] ? lockup_detector_update_enable+0x60/0x60 Aug 22 16:52:34 juju-e4d256-prod-github-runner-207 kernel: [41328.581432] ? __hrtimer_run_queues+0x107/0x230 Aug 22 16:52:34 juju-e4d256-prod-github-runner-207 kernel: [41328.582459] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 16:52:34 juju-e4d256-prod-github-runner-207 kernel: [41328.583486] ? hrtimer_interrupt+0x101/0x220 Aug 22 16:52:34 juju-e4d256-prod-github-runner-207 kernel: [41328.584511] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 16:52:34 juju-e4d256-prod-github-runner-207 kernel: [41328.585579] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 16:52:34 juju-e4d256-prod-github-runner-207 kernel: [41328.586631] Aug 22 16:52:34 juju-e4d256-prod-github-runner-207 kernel: [41328.587483] Aug 22 16:52:34 juju-e4d256-prod-github-runner-207 kernel: [41328.588320] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 16:52:34 juju-e4d256-prod-github-runner-207 kernel: [41328.589361] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:52:34 juju-e4d256-prod-github-runner-207 kernel: [41328.590399] ? _raw_spin_lock+0x22/0x30 Aug 22 16:52:34 juju-e4d256-prod-github-runner-207 kernel: [41328.591356] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:52:34 juju-e4d256-prod-github-runner-207 kernel: [41328.592373] direct_page_fault+0x206/0x310 [kvm] Aug 22 16:52:34 juju-e4d256-prod-github-runner-207 kernel: [41328.593411] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 16:52:34 juju-e4d256-prod-github-runner-207 kernel: [41328.594423] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 16:52:34 juju-e4d256-prod-github-runner-207 kernel: [41328.595428] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 16:52:34 juju-e4d256-prod-github-runner-207 kernel: [41328.596416] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 16:52:34 juju-e4d256-prod-github-runner-207 kernel: [41328.597370] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 16:52:34 juju-e4d256-prod-github-runner-207 kernel: [41328.598347] handle_exit+0x98/0x230 [kvm_amd] Aug 22 16:52:34 juju-e4d256-prod-github-runner-207 kernel: [41328.599245] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 16:52:34 juju-e4d256-prod-github-runner-207 kernel: [41328.600158] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 16:52:34 juju-e4d256-prod-github-runner-207 kernel: [41328.601102] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 16:52:34 juju-e4d256-prod-github-runner-207 kernel: [41328.602011] vcpu_run+0x62/0x2c0 [kvm] Aug 22 16:52:34 juju-e4d256-prod-github-runner-207 kernel: [41328.602824] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 16:52:34 juju-e4d256-prod-github-runner-207 kernel: [41328.603635] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 16:52:34 juju-e4d256-prod-github-runner-207 kernel: [41328.604506] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 16:52:34 juju-e4d256-prod-github-runner-207 kernel: [41328.605304] ? __seccomp_filter+0x4a/0x4a0 Aug 22 16:52:34 juju-e4d256-prod-github-runner-207 kernel: [41328.606044] ? __fget_files+0x86/0xc0 Aug 22 16:52:34 juju-e4d256-prod-github-runner-207 kernel: [41328.606856] __x64_sys_ioctl+0x95/0xd0 Aug 22 16:52:34 juju-e4d256-prod-github-runner-207 kernel: [41328.607625] do_syscall_64+0x5c/0xc0 Aug 22 16:52:34 juju-e4d256-prod-github-runner-207 kernel: [41328.608291] ? do_futex+0x162/0x1f0 Aug 22 16:52:34 juju-e4d256-prod-github-runner-207 kernel: [41328.608957] ? __x64_sys_futex+0x78/0x1e0 Aug 22 16:52:34 juju-e4d256-prod-github-runner-207 kernel: [41328.609636] ? __secure_computing+0xa9/0x120 Aug 22 16:52:34 juju-e4d256-prod-github-runner-207 kernel: [41328.610323] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 16:52:34 juju-e4d256-prod-github-runner-207 kernel: [41328.611085] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:52:34 juju-e4d256-prod-github-runner-207 kernel: [41328.611829] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:52:34 juju-e4d256-prod-github-runner-207 kernel: [41328.612568] ? do_syscall_64+0x69/0xc0 Aug 22 16:52:34 juju-e4d256-prod-github-runner-207 kernel: [41328.613219] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:52:34 juju-e4d256-prod-github-runner-207 kernel: [41328.613928] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:52:34 juju-e4d256-prod-github-runner-207 kernel: [41328.614622] ? do_syscall_64+0x69/0xc0 Aug 22 16:52:34 juju-e4d256-prod-github-runner-207 kernel: [41328.615247] ? do_syscall_64+0x69/0xc0 Aug 22 16:52:34 juju-e4d256-prod-github-runner-207 kernel: [41328.615873] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 16:52:34 juju-e4d256-prod-github-runner-207 kernel: [41328.616591] RIP: 0033:0x7faa5d0edaff Aug 22 16:52:34 juju-e4d256-prod-github-runner-207 kernel: [41328.617249] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 16:52:34 juju-e4d256-prod-github-runner-207 kernel: [41328.619228] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 16:52:34 juju-e4d256-prod-github-runner-207 kernel: [41328.620152] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 16:52:34 juju-e4d256-prod-github-runner-207 kernel: [41328.621056] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 16:52:34 juju-e4d256-prod-github-runner-207 kernel: [41328.621947] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 16:52:34 juju-e4d256-prod-github-runner-207 kernel: [41328.622847] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 16:52:34 juju-e4d256-prod-github-runner-207 kernel: [41328.623767] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 16:52:34 juju-e4d256-prod-github-runner-207 kernel: [41328.624676] Aug 22 16:53:02 juju-e4d256-prod-github-runner-207 kernel: [41356.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 38408s! [qemu-system-x86:6715] Aug 22 16:53:02 juju-e4d256-prod-github-runner-207 kernel: [41356.543112] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 16:53:02 juju-e4d256-prod-github-runner-207 kernel: [41356.543182] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 16:53:02 juju-e4d256-prod-github-runner-207 kernel: [41356.555424] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 16:53:02 juju-e4d256-prod-github-runner-207 kernel: [41356.556722] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 16:53:02 juju-e4d256-prod-github-runner-207 kernel: [41356.557947] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:53:02 juju-e4d256-prod-github-runner-207 kernel: [41356.559010] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 16:53:02 juju-e4d256-prod-github-runner-207 kernel: [41356.561594] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 16:53:02 juju-e4d256-prod-github-runner-207 kernel: [41356.562679] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 16:53:02 juju-e4d256-prod-github-runner-207 kernel: [41356.563860] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 16:53:02 juju-e4d256-prod-github-runner-207 kernel: [41356.565051] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 16:53:02 juju-e4d256-prod-github-runner-207 kernel: [41356.566215] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 16:53:02 juju-e4d256-prod-github-runner-207 kernel: [41356.567380] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 16:53:02 juju-e4d256-prod-github-runner-207 kernel: [41356.568579] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 16:53:02 juju-e4d256-prod-github-runner-207 kernel: [41356.569821] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 16:53:02 juju-e4d256-prod-github-runner-207 kernel: [41356.570927] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 16:53:02 juju-e4d256-prod-github-runner-207 kernel: [41356.572141] Call Trace: Aug 22 16:53:02 juju-e4d256-prod-github-runner-207 kernel: [41356.573063] Aug 22 16:53:02 juju-e4d256-prod-github-runner-207 kernel: [41356.573952] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:53:02 juju-e4d256-prod-github-runner-207 kernel: [41356.574986] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:53:02 juju-e4d256-prod-github-runner-207 kernel: [41356.576011] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:53:02 juju-e4d256-prod-github-runner-207 kernel: [41356.577104] ? show_regs.part.0+0x23/0x29 Aug 22 16:53:02 juju-e4d256-prod-github-runner-207 kernel: [41356.578119] ? show_regs.cold+0x8/0xd Aug 22 16:53:02 juju-e4d256-prod-github-runner-207 kernel: [41356.579104] ? watchdog_timer_fn+0x1be/0x220 Aug 22 16:53:02 juju-e4d256-prod-github-runner-207 kernel: [41356.580132] ? lockup_detector_update_enable+0x60/0x60 Aug 22 16:53:02 juju-e4d256-prod-github-runner-207 kernel: [41356.581214] ? __hrtimer_run_queues+0x107/0x230 Aug 22 16:53:02 juju-e4d256-prod-github-runner-207 kernel: [41356.582250] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 16:53:02 juju-e4d256-prod-github-runner-207 kernel: [41356.583285] ? hrtimer_interrupt+0x101/0x220 Aug 22 16:53:02 juju-e4d256-prod-github-runner-207 kernel: [41356.584323] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 16:53:02 juju-e4d256-prod-github-runner-207 kernel: [41356.585405] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 16:53:02 juju-e4d256-prod-github-runner-207 kernel: [41356.586457] Aug 22 16:53:02 juju-e4d256-prod-github-runner-207 kernel: [41356.587316] Aug 22 16:53:02 juju-e4d256-prod-github-runner-207 kernel: [41356.588189] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 16:53:02 juju-e4d256-prod-github-runner-207 kernel: [41356.589227] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:53:02 juju-e4d256-prod-github-runner-207 kernel: [41356.590277] ? _raw_spin_lock+0x22/0x30 Aug 22 16:53:02 juju-e4d256-prod-github-runner-207 kernel: [41356.591230] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:53:02 juju-e4d256-prod-github-runner-207 kernel: [41356.592277] direct_page_fault+0x206/0x310 [kvm] Aug 22 16:53:02 juju-e4d256-prod-github-runner-207 kernel: [41356.593331] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 16:53:02 juju-e4d256-prod-github-runner-207 kernel: [41356.594342] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 16:53:02 juju-e4d256-prod-github-runner-207 kernel: [41356.595367] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 16:53:02 juju-e4d256-prod-github-runner-207 kernel: [41356.596393] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 16:53:02 juju-e4d256-prod-github-runner-207 kernel: [41356.597352] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 16:53:02 juju-e4d256-prod-github-runner-207 kernel: [41356.598329] handle_exit+0x98/0x230 [kvm_amd] Aug 22 16:53:02 juju-e4d256-prod-github-runner-207 kernel: [41356.599220] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 16:53:02 juju-e4d256-prod-github-runner-207 kernel: [41356.600157] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 16:53:02 juju-e4d256-prod-github-runner-207 kernel: [41356.601083] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 16:53:02 juju-e4d256-prod-github-runner-207 kernel: [41356.601987] vcpu_run+0x62/0x2c0 [kvm] Aug 22 16:53:02 juju-e4d256-prod-github-runner-207 kernel: [41356.602798] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 16:53:02 juju-e4d256-prod-github-runner-207 kernel: [41356.603611] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 16:53:02 juju-e4d256-prod-github-runner-207 kernel: [41356.604486] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 16:53:02 juju-e4d256-prod-github-runner-207 kernel: [41356.605286] ? __seccomp_filter+0x4a/0x4a0 Aug 22 16:53:02 juju-e4d256-prod-github-runner-207 kernel: [41356.606034] ? __fget_files+0x86/0xc0 Aug 22 16:53:02 juju-e4d256-prod-github-runner-207 kernel: [41356.606738] __x64_sys_ioctl+0x95/0xd0 Aug 22 16:53:02 juju-e4d256-prod-github-runner-207 kernel: [41356.607430] do_syscall_64+0x5c/0xc0 Aug 22 16:53:02 juju-e4d256-prod-github-runner-207 kernel: [41356.608107] ? do_futex+0x162/0x1f0 Aug 22 16:53:02 juju-e4d256-prod-github-runner-207 kernel: [41356.608754] ? __x64_sys_futex+0x78/0x1e0 Aug 22 16:53:02 juju-e4d256-prod-github-runner-207 kernel: [41356.609428] ? __secure_computing+0xa9/0x120 Aug 22 16:53:02 juju-e4d256-prod-github-runner-207 kernel: [41356.610118] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 16:53:02 juju-e4d256-prod-github-runner-207 kernel: [41356.610880] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:53:02 juju-e4d256-prod-github-runner-207 kernel: [41356.611605] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:53:02 juju-e4d256-prod-github-runner-207 kernel: [41356.612332] ? do_syscall_64+0x69/0xc0 Aug 22 16:53:02 juju-e4d256-prod-github-runner-207 kernel: [41356.612978] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:53:02 juju-e4d256-prod-github-runner-207 kernel: [41356.613683] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:53:02 juju-e4d256-prod-github-runner-207 kernel: [41356.614378] ? do_syscall_64+0x69/0xc0 Aug 22 16:53:02 juju-e4d256-prod-github-runner-207 kernel: [41356.615003] ? do_syscall_64+0x69/0xc0 Aug 22 16:53:02 juju-e4d256-prod-github-runner-207 kernel: [41356.615626] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 16:53:02 juju-e4d256-prod-github-runner-207 kernel: [41356.616344] RIP: 0033:0x7faa5d0edaff Aug 22 16:53:02 juju-e4d256-prod-github-runner-207 kernel: [41356.616975] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 16:53:02 juju-e4d256-prod-github-runner-207 kernel: [41356.618975] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 16:53:02 juju-e4d256-prod-github-runner-207 kernel: [41356.619886] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 16:53:02 juju-e4d256-prod-github-runner-207 kernel: [41356.620791] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 16:53:02 juju-e4d256-prod-github-runner-207 kernel: [41356.621680] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 16:53:02 juju-e4d256-prod-github-runner-207 kernel: [41356.622568] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 16:53:02 juju-e4d256-prod-github-runner-207 kernel: [41356.623482] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 16:53:02 juju-e4d256-prod-github-runner-207 kernel: [41356.624397] Aug 22 16:53:30 juju-e4d256-prod-github-runner-207 kernel: [41384.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 38434s! [qemu-system-x86:6715] Aug 22 16:53:30 juju-e4d256-prod-github-runner-207 kernel: [41384.543130] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 16:53:30 juju-e4d256-prod-github-runner-207 kernel: [41384.543206] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 16:53:30 juju-e4d256-prod-github-runner-207 kernel: [41384.555309] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 16:53:30 juju-e4d256-prod-github-runner-207 kernel: [41384.556590] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 16:53:30 juju-e4d256-prod-github-runner-207 kernel: [41384.557814] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:53:30 juju-e4d256-prod-github-runner-207 kernel: [41384.558871] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 16:53:30 juju-e4d256-prod-github-runner-207 kernel: [41384.561428] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 16:53:30 juju-e4d256-prod-github-runner-207 kernel: [41384.562474] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 16:53:30 juju-e4d256-prod-github-runner-207 kernel: [41384.563634] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 16:53:30 juju-e4d256-prod-github-runner-207 kernel: [41384.564804] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 16:53:30 juju-e4d256-prod-github-runner-207 kernel: [41384.565972] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 16:53:30 juju-e4d256-prod-github-runner-207 kernel: [41384.567132] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 16:53:30 juju-e4d256-prod-github-runner-207 kernel: [41384.568310] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 16:53:30 juju-e4d256-prod-github-runner-207 kernel: [41384.569540] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 16:53:30 juju-e4d256-prod-github-runner-207 kernel: [41384.570635] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 16:53:30 juju-e4d256-prod-github-runner-207 kernel: [41384.571838] Call Trace: Aug 22 16:53:30 juju-e4d256-prod-github-runner-207 kernel: [41384.572749] Aug 22 16:53:30 juju-e4d256-prod-github-runner-207 kernel: [41384.573631] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:53:30 juju-e4d256-prod-github-runner-207 kernel: [41384.574659] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:53:30 juju-e4d256-prod-github-runner-207 kernel: [41384.575681] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:53:30 juju-e4d256-prod-github-runner-207 kernel: [41384.576765] ? show_regs.part.0+0x23/0x29 Aug 22 16:53:30 juju-e4d256-prod-github-runner-207 kernel: [41384.577761] ? show_regs.cold+0x8/0xd Aug 22 16:53:30 juju-e4d256-prod-github-runner-207 kernel: [41384.578736] ? watchdog_timer_fn+0x1be/0x220 Aug 22 16:53:30 juju-e4d256-prod-github-runner-207 kernel: [41384.579742] ? lockup_detector_update_enable+0x60/0x60 Aug 22 16:53:30 juju-e4d256-prod-github-runner-207 kernel: [41384.580819] ? __hrtimer_run_queues+0x107/0x230 Aug 22 16:53:30 juju-e4d256-prod-github-runner-207 kernel: [41384.581850] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 16:53:30 juju-e4d256-prod-github-runner-207 kernel: [41384.582872] ? hrtimer_interrupt+0x101/0x220 Aug 22 16:53:30 juju-e4d256-prod-github-runner-207 kernel: [41384.583909] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 16:53:30 juju-e4d256-prod-github-runner-207 kernel: [41384.584979] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 16:53:30 juju-e4d256-prod-github-runner-207 kernel: [41384.586023] Aug 22 16:53:30 juju-e4d256-prod-github-runner-207 kernel: [41384.586875] Aug 22 16:53:30 juju-e4d256-prod-github-runner-207 kernel: [41384.587711] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 16:53:30 juju-e4d256-prod-github-runner-207 kernel: [41384.588758] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:53:30 juju-e4d256-prod-github-runner-207 kernel: [41384.589795] ? _raw_spin_lock+0x22/0x30 Aug 22 16:53:30 juju-e4d256-prod-github-runner-207 kernel: [41384.590741] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:53:30 juju-e4d256-prod-github-runner-207 kernel: [41384.591776] direct_page_fault+0x206/0x310 [kvm] Aug 22 16:53:30 juju-e4d256-prod-github-runner-207 kernel: [41384.592798] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 16:53:30 juju-e4d256-prod-github-runner-207 kernel: [41384.593805] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 16:53:30 juju-e4d256-prod-github-runner-207 kernel: [41384.594806] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 16:53:30 juju-e4d256-prod-github-runner-207 kernel: [41384.595785] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 16:53:30 juju-e4d256-prod-github-runner-207 kernel: [41384.596734] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 16:53:30 juju-e4d256-prod-github-runner-207 kernel: [41384.597716] handle_exit+0x98/0x230 [kvm_amd] Aug 22 16:53:30 juju-e4d256-prod-github-runner-207 kernel: [41384.598608] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 16:53:30 juju-e4d256-prod-github-runner-207 kernel: [41384.599521] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 16:53:30 juju-e4d256-prod-github-runner-207 kernel: [41384.600454] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 16:53:30 juju-e4d256-prod-github-runner-207 kernel: [41384.601356] vcpu_run+0x62/0x2c0 [kvm] Aug 22 16:53:30 juju-e4d256-prod-github-runner-207 kernel: [41384.602168] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 16:53:30 juju-e4d256-prod-github-runner-207 kernel: [41384.602974] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 16:53:30 juju-e4d256-prod-github-runner-207 kernel: [41384.603848] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 16:53:30 juju-e4d256-prod-github-runner-207 kernel: [41384.604643] ? __seccomp_filter+0x4a/0x4a0 Aug 22 16:53:30 juju-e4d256-prod-github-runner-207 kernel: [41384.605482] ? __fget_files+0x86/0xc0 Aug 22 16:53:30 juju-e4d256-prod-github-runner-207 kernel: [41384.606189] __x64_sys_ioctl+0x95/0xd0 Aug 22 16:53:30 juju-e4d256-prod-github-runner-207 kernel: [41384.606883] do_syscall_64+0x5c/0xc0 Aug 22 16:53:30 juju-e4d256-prod-github-runner-207 kernel: [41384.607544] ? do_futex+0x162/0x1f0 Aug 22 16:53:30 juju-e4d256-prod-github-runner-207 kernel: [41384.608204] ? __x64_sys_futex+0x78/0x1e0 Aug 22 16:53:30 juju-e4d256-prod-github-runner-207 kernel: [41384.608875] ? __secure_computing+0xa9/0x120 Aug 22 16:53:30 juju-e4d256-prod-github-runner-207 kernel: [41384.609567] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 16:53:30 juju-e4d256-prod-github-runner-207 kernel: [41384.610323] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:53:30 juju-e4d256-prod-github-runner-207 kernel: [41384.611041] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:53:30 juju-e4d256-prod-github-runner-207 kernel: [41384.611769] ? do_syscall_64+0x69/0xc0 Aug 22 16:53:30 juju-e4d256-prod-github-runner-207 kernel: [41384.612413] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:53:30 juju-e4d256-prod-github-runner-207 kernel: [41384.613115] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:53:30 juju-e4d256-prod-github-runner-207 kernel: [41384.613821] ? do_syscall_64+0x69/0xc0 Aug 22 16:53:30 juju-e4d256-prod-github-runner-207 kernel: [41384.614444] ? do_syscall_64+0x69/0xc0 Aug 22 16:53:30 juju-e4d256-prod-github-runner-207 kernel: [41384.615063] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 16:53:30 juju-e4d256-prod-github-runner-207 kernel: [41384.615781] RIP: 0033:0x7faa5d0edaff Aug 22 16:53:30 juju-e4d256-prod-github-runner-207 kernel: [41384.616408] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 16:53:30 juju-e4d256-prod-github-runner-207 kernel: [41384.618393] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 16:53:30 juju-e4d256-prod-github-runner-207 kernel: [41384.619301] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 16:53:30 juju-e4d256-prod-github-runner-207 kernel: [41384.620199] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 16:53:30 juju-e4d256-prod-github-runner-207 kernel: [41384.621085] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 16:53:30 juju-e4d256-prod-github-runner-207 kernel: [41384.621969] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 16:53:30 juju-e4d256-prod-github-runner-207 kernel: [41384.622859] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 16:53:30 juju-e4d256-prod-github-runner-207 kernel: [41384.623763] Aug 22 16:53:46 juju-e4d256-prod-github-runner-207 kernel: [41399.948706] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 16:53:46 juju-e4d256-prod-github-runner-207 kernel: [41399.950225] rcu: 1-....: (10288313 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=4977015 Aug 22 16:53:46 juju-e4d256-prod-github-runner-207 kernel: [41399.951351] (t=10320687 jiffies g=23269 q=41764) Aug 22 16:53:46 juju-e4d256-prod-github-runner-207 kernel: [41399.952154] NMI backtrace for cpu 1 Aug 22 16:53:46 juju-e4d256-prod-github-runner-207 kernel: [41399.952866] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 16:53:46 juju-e4d256-prod-github-runner-207 kernel: [41399.953978] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 16:53:46 juju-e4d256-prod-github-runner-207 kernel: [41399.955036] Call Trace: Aug 22 16:53:46 juju-e4d256-prod-github-runner-207 kernel: [41399.955723] Aug 22 16:53:46 juju-e4d256-prod-github-runner-207 kernel: [41399.956384] show_stack+0x52/0x5c Aug 22 16:53:46 juju-e4d256-prod-github-runner-207 kernel: [41399.957110] dump_stack_lvl+0x4a/0x63 Aug 22 16:53:46 juju-e4d256-prod-github-runner-207 kernel: [41399.957856] dump_stack+0x10/0x16 Aug 22 16:53:46 juju-e4d256-prod-github-runner-207 kernel: [41399.958574] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 16:53:46 juju-e4d256-prod-github-runner-207 kernel: [41399.959358] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 16:53:46 juju-e4d256-prod-github-runner-207 kernel: [41399.960150] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 16:53:46 juju-e4d256-prod-github-runner-207 kernel: [41399.960971] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 16:53:46 juju-e4d256-prod-github-runner-207 kernel: [41399.961792] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 16:53:46 juju-e4d256-prod-github-runner-207 kernel: [41399.962606] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 16:53:46 juju-e4d256-prod-github-runner-207 kernel: [41399.963379] print_cpu_stall.cold+0x2f/0xe2 Aug 22 16:53:46 juju-e4d256-prod-github-runner-207 kernel: [41399.964157] ? timekeeping_update+0xf7/0x150 Aug 22 16:53:46 juju-e4d256-prod-github-runner-207 kernel: [41399.964955] check_cpu_stall+0x109/0x270 Aug 22 16:53:46 juju-e4d256-prod-github-runner-207 kernel: [41399.965702] rcu_sched_clock_irq+0x9a/0x250 Aug 22 16:53:46 juju-e4d256-prod-github-runner-207 kernel: [41399.966463] update_process_times+0x94/0xd0 Aug 22 16:53:46 juju-e4d256-prod-github-runner-207 kernel: [41399.967225] tick_sched_handle+0x29/0x70 Aug 22 16:53:46 juju-e4d256-prod-github-runner-207 kernel: [41399.967992] tick_sched_timer+0x8c/0xc0 Aug 22 16:53:46 juju-e4d256-prod-github-runner-207 kernel: [41399.968730] ? tick_nohz_handler+0xb0/0xb0 Aug 22 16:53:46 juju-e4d256-prod-github-runner-207 kernel: [41399.969486] __hrtimer_run_queues+0x107/0x230 Aug 22 16:53:46 juju-e4d256-prod-github-runner-207 kernel: [41399.970258] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 16:53:46 juju-e4d256-prod-github-runner-207 kernel: [41399.971033] hrtimer_interrupt+0x101/0x220 Aug 22 16:53:46 juju-e4d256-prod-github-runner-207 kernel: [41399.971805] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 16:53:46 juju-e4d256-prod-github-runner-207 kernel: [41399.972624] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 16:53:46 juju-e4d256-prod-github-runner-207 kernel: [41399.973428] Aug 22 16:53:46 juju-e4d256-prod-github-runner-207 kernel: [41399.974062] Aug 22 16:53:46 juju-e4d256-prod-github-runner-207 kernel: [41399.974690] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 16:53:46 juju-e4d256-prod-github-runner-207 kernel: [41399.975508] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:53:46 juju-e4d256-prod-github-runner-207 kernel: [41399.976411] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 16:53:46 juju-e4d256-prod-github-runner-207 kernel: [41399.978619] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 16:53:46 juju-e4d256-prod-github-runner-207 kernel: [41399.979497] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 16:53:46 juju-e4d256-prod-github-runner-207 kernel: [41399.980501] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 16:53:46 juju-e4d256-prod-github-runner-207 kernel: [41399.981485] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 16:53:46 juju-e4d256-prod-github-runner-207 kernel: [41399.982449] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 16:53:46 juju-e4d256-prod-github-runner-207 kernel: [41399.983409] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 16:53:46 juju-e4d256-prod-github-runner-207 kernel: [41399.984369] ? _raw_spin_lock+0x22/0x30 Aug 22 16:53:46 juju-e4d256-prod-github-runner-207 kernel: [41399.985129] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:53:46 juju-e4d256-prod-github-runner-207 kernel: [41399.985981] direct_page_fault+0x206/0x310 [kvm] Aug 22 16:53:46 juju-e4d256-prod-github-runner-207 kernel: [41399.986817] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 16:53:46 juju-e4d256-prod-github-runner-207 kernel: [41399.987666] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 16:53:46 juju-e4d256-prod-github-runner-207 kernel: [41399.988499] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 16:53:46 juju-e4d256-prod-github-runner-207 kernel: [41399.989322] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 16:53:46 juju-e4d256-prod-github-runner-207 kernel: [41399.990106] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 16:53:46 juju-e4d256-prod-github-runner-207 kernel: [41399.990927] handle_exit+0x98/0x230 [kvm_amd] Aug 22 16:53:46 juju-e4d256-prod-github-runner-207 kernel: [41399.991745] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 16:53:46 juju-e4d256-prod-github-runner-207 kernel: [41399.992528] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 16:53:46 juju-e4d256-prod-github-runner-207 kernel: [41399.993345] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 16:53:46 juju-e4d256-prod-github-runner-207 kernel: [41399.994149] vcpu_run+0x62/0x2c0 [kvm] Aug 22 16:53:46 juju-e4d256-prod-github-runner-207 kernel: [41399.994866] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 16:53:46 juju-e4d256-prod-github-runner-207 kernel: [41399.995608] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 16:53:46 juju-e4d256-prod-github-runner-207 kernel: [41399.996407] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 16:53:46 juju-e4d256-prod-github-runner-207 kernel: [41399.997166] ? __seccomp_filter+0x4a/0x4a0 Aug 22 16:53:46 juju-e4d256-prod-github-runner-207 kernel: [41399.997887] ? __fget_files+0x86/0xc0 Aug 22 16:53:46 juju-e4d256-prod-github-runner-207 kernel: [41399.998579] __x64_sys_ioctl+0x95/0xd0 Aug 22 16:53:46 juju-e4d256-prod-github-runner-207 kernel: [41399.999273] do_syscall_64+0x5c/0xc0 Aug 22 16:53:46 juju-e4d256-prod-github-runner-207 kernel: [41399.999965] ? do_futex+0x162/0x1f0 Aug 22 16:53:46 juju-e4d256-prod-github-runner-207 kernel: [41400.000636] ? __x64_sys_futex+0x78/0x1e0 Aug 22 16:53:46 juju-e4d256-prod-github-runner-207 kernel: [41400.001339] ? __secure_computing+0xa9/0x120 Aug 22 16:53:46 juju-e4d256-prod-github-runner-207 kernel: [41400.002055] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 16:53:46 juju-e4d256-prod-github-runner-207 kernel: [41400.002844] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:53:46 juju-e4d256-prod-github-runner-207 kernel: [41400.003612] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:53:46 juju-e4d256-prod-github-runner-207 kernel: [41400.004372] ? do_syscall_64+0x69/0xc0 Aug 22 16:53:46 juju-e4d256-prod-github-runner-207 kernel: [41400.005064] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:53:46 juju-e4d256-prod-github-runner-207 kernel: [41400.005821] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:53:46 juju-e4d256-prod-github-runner-207 kernel: [41400.006576] ? do_syscall_64+0x69/0xc0 Aug 22 16:53:46 juju-e4d256-prod-github-runner-207 kernel: [41400.007270] ? do_syscall_64+0x69/0xc0 Aug 22 16:53:46 juju-e4d256-prod-github-runner-207 kernel: [41400.007964] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 16:53:46 juju-e4d256-prod-github-runner-207 kernel: [41400.008735] RIP: 0033:0x7faa5d0edaff Aug 22 16:53:46 juju-e4d256-prod-github-runner-207 kernel: [41400.009434] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 16:53:46 juju-e4d256-prod-github-runner-207 kernel: [41400.011536] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 16:53:46 juju-e4d256-prod-github-runner-207 kernel: [41400.012507] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 16:53:46 juju-e4d256-prod-github-runner-207 kernel: [41400.013454] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 16:53:46 juju-e4d256-prod-github-runner-207 kernel: [41400.014408] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 16:53:46 juju-e4d256-prod-github-runner-207 kernel: [41400.015348] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 16:53:46 juju-e4d256-prod-github-runner-207 kernel: [41400.016282] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 16:53:46 juju-e4d256-prod-github-runner-207 kernel: [41400.017201] Aug 22 16:54:10 juju-e4d256-prod-github-runner-207 kernel: [41424.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 38471s! [qemu-system-x86:6715] Aug 22 16:54:10 juju-e4d256-prod-github-runner-207 kernel: [41424.543125] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 16:54:10 juju-e4d256-prod-github-runner-207 kernel: [41424.543446] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 16:54:10 juju-e4d256-prod-github-runner-207 kernel: [41424.555754] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 16:54:10 juju-e4d256-prod-github-runner-207 kernel: [41424.557019] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 16:54:10 juju-e4d256-prod-github-runner-207 kernel: [41424.558234] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:54:10 juju-e4d256-prod-github-runner-207 kernel: [41424.559301] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 16:54:10 juju-e4d256-prod-github-runner-207 kernel: [41424.561849] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 16:54:10 juju-e4d256-prod-github-runner-207 kernel: [41424.562889] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 16:54:10 juju-e4d256-prod-github-runner-207 kernel: [41424.564064] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 16:54:10 juju-e4d256-prod-github-runner-207 kernel: [41424.565243] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 16:54:10 juju-e4d256-prod-github-runner-207 kernel: [41424.566426] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 16:54:10 juju-e4d256-prod-github-runner-207 kernel: [41424.567612] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 16:54:10 juju-e4d256-prod-github-runner-207 kernel: [41424.568789] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 16:54:10 juju-e4d256-prod-github-runner-207 kernel: [41424.570022] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 16:54:10 juju-e4d256-prod-github-runner-207 kernel: [41424.571150] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 16:54:10 juju-e4d256-prod-github-runner-207 kernel: [41424.572383] Call Trace: Aug 22 16:54:10 juju-e4d256-prod-github-runner-207 kernel: [41424.573298] Aug 22 16:54:10 juju-e4d256-prod-github-runner-207 kernel: [41424.574180] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:54:10 juju-e4d256-prod-github-runner-207 kernel: [41424.575213] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:54:10 juju-e4d256-prod-github-runner-207 kernel: [41424.576294] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:54:10 juju-e4d256-prod-github-runner-207 kernel: [41424.577374] ? show_regs.part.0+0x23/0x29 Aug 22 16:54:10 juju-e4d256-prod-github-runner-207 kernel: [41424.578371] ? show_regs.cold+0x8/0xd Aug 22 16:54:10 juju-e4d256-prod-github-runner-207 kernel: [41424.579361] ? watchdog_timer_fn+0x1be/0x220 Aug 22 16:54:10 juju-e4d256-prod-github-runner-207 kernel: [41424.580368] ? lockup_detector_update_enable+0x60/0x60 Aug 22 16:54:10 juju-e4d256-prod-github-runner-207 kernel: [41424.581448] ? __hrtimer_run_queues+0x107/0x230 Aug 22 16:54:10 juju-e4d256-prod-github-runner-207 kernel: [41424.582483] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 16:54:10 juju-e4d256-prod-github-runner-207 kernel: [41424.583519] ? hrtimer_interrupt+0x101/0x220 Aug 22 16:54:10 juju-e4d256-prod-github-runner-207 kernel: [41424.584535] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 16:54:10 juju-e4d256-prod-github-runner-207 kernel: [41424.585601] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 16:54:10 juju-e4d256-prod-github-runner-207 kernel: [41424.586704] Aug 22 16:54:10 juju-e4d256-prod-github-runner-207 kernel: [41424.587573] Aug 22 16:54:10 juju-e4d256-prod-github-runner-207 kernel: [41424.588410] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 16:54:10 juju-e4d256-prod-github-runner-207 kernel: [41424.589443] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:54:10 juju-e4d256-prod-github-runner-207 kernel: [41424.590479] ? _raw_spin_lock+0x22/0x30 Aug 22 16:54:10 juju-e4d256-prod-github-runner-207 kernel: [41424.591452] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:54:10 juju-e4d256-prod-github-runner-207 kernel: [41424.592473] direct_page_fault+0x206/0x310 [kvm] Aug 22 16:54:10 juju-e4d256-prod-github-runner-207 kernel: [41424.593504] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 16:54:10 juju-e4d256-prod-github-runner-207 kernel: [41424.594514] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 16:54:10 juju-e4d256-prod-github-runner-207 kernel: [41424.595537] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 16:54:10 juju-e4d256-prod-github-runner-207 kernel: [41424.596566] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 16:54:10 juju-e4d256-prod-github-runner-207 kernel: [41424.597518] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 16:54:10 juju-e4d256-prod-github-runner-207 kernel: [41424.598499] handle_exit+0x98/0x230 [kvm_amd] Aug 22 16:54:10 juju-e4d256-prod-github-runner-207 kernel: [41424.599488] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 16:54:10 juju-e4d256-prod-github-runner-207 kernel: [41424.600400] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 16:54:10 juju-e4d256-prod-github-runner-207 kernel: [41424.601324] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 16:54:10 juju-e4d256-prod-github-runner-207 kernel: [41424.602232] vcpu_run+0x62/0x2c0 [kvm] Aug 22 16:54:10 juju-e4d256-prod-github-runner-207 kernel: [41424.603043] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 16:54:10 juju-e4d256-prod-github-runner-207 kernel: [41424.603876] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 16:54:10 juju-e4d256-prod-github-runner-207 kernel: [41424.604732] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 16:54:10 juju-e4d256-prod-github-runner-207 kernel: [41424.605529] ? __seccomp_filter+0x4a/0x4a0 Aug 22 16:54:10 juju-e4d256-prod-github-runner-207 kernel: [41424.606383] ? __fget_files+0x86/0xc0 Aug 22 16:54:10 juju-e4d256-prod-github-runner-207 kernel: [41424.607179] __x64_sys_ioctl+0x95/0xd0 Aug 22 16:54:10 juju-e4d256-prod-github-runner-207 kernel: [41424.607974] do_syscall_64+0x5c/0xc0 Aug 22 16:54:10 juju-e4d256-prod-github-runner-207 kernel: [41424.608731] ? do_futex+0x162/0x1f0 Aug 22 16:54:10 juju-e4d256-prod-github-runner-207 kernel: [41424.609446] ? __x64_sys_futex+0x78/0x1e0 Aug 22 16:54:10 juju-e4d256-prod-github-runner-207 kernel: [41424.610197] ? __secure_computing+0xa9/0x120 Aug 22 16:54:10 juju-e4d256-prod-github-runner-207 kernel: [41424.610972] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 16:54:10 juju-e4d256-prod-github-runner-207 kernel: [41424.611849] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:54:10 juju-e4d256-prod-github-runner-207 kernel: [41424.612678] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:54:10 juju-e4d256-prod-github-runner-207 kernel: [41424.613494] ? do_syscall_64+0x69/0xc0 Aug 22 16:54:10 juju-e4d256-prod-github-runner-207 kernel: [41424.614216] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:54:10 juju-e4d256-prod-github-runner-207 kernel: [41424.615017] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:54:10 juju-e4d256-prod-github-runner-207 kernel: [41424.615820] ? do_syscall_64+0x69/0xc0 Aug 22 16:54:10 juju-e4d256-prod-github-runner-207 kernel: [41424.616521] ? do_syscall_64+0x69/0xc0 Aug 22 16:54:10 juju-e4d256-prod-github-runner-207 kernel: [41424.617222] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 16:54:10 juju-e4d256-prod-github-runner-207 kernel: [41424.618024] RIP: 0033:0x7faa5d0edaff Aug 22 16:54:10 juju-e4d256-prod-github-runner-207 kernel: [41424.618720] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 16:54:10 juju-e4d256-prod-github-runner-207 kernel: [41424.621054] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 16:54:10 juju-e4d256-prod-github-runner-207 kernel: [41424.622102] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 16:54:10 juju-e4d256-prod-github-runner-207 kernel: [41424.623123] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 16:54:10 juju-e4d256-prod-github-runner-207 kernel: [41424.624162] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 16:54:10 juju-e4d256-prod-github-runner-207 kernel: [41424.625184] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 16:54:10 juju-e4d256-prod-github-runner-207 kernel: [41424.626207] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 16:54:10 juju-e4d256-prod-github-runner-207 kernel: [41424.627230] Aug 22 16:54:38 juju-e4d256-prod-github-runner-207 kernel: [41452.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 38497s! [qemu-system-x86:6715] Aug 22 16:54:38 juju-e4d256-prod-github-runner-207 kernel: [41452.543117] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 16:54:38 juju-e4d256-prod-github-runner-207 kernel: [41452.543186] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 16:54:38 juju-e4d256-prod-github-runner-207 kernel: [41452.555206] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 16:54:38 juju-e4d256-prod-github-runner-207 kernel: [41452.556471] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 16:54:38 juju-e4d256-prod-github-runner-207 kernel: [41452.557698] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:54:38 juju-e4d256-prod-github-runner-207 kernel: [41452.558757] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 16:54:38 juju-e4d256-prod-github-runner-207 kernel: [41452.561317] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 16:54:38 juju-e4d256-prod-github-runner-207 kernel: [41452.562359] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 16:54:38 juju-e4d256-prod-github-runner-207 kernel: [41452.563529] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 16:54:38 juju-e4d256-prod-github-runner-207 kernel: [41452.564691] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 16:54:38 juju-e4d256-prod-github-runner-207 kernel: [41452.565856] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 16:54:38 juju-e4d256-prod-github-runner-207 kernel: [41452.567025] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 16:54:38 juju-e4d256-prod-github-runner-207 kernel: [41452.568193] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 16:54:38 juju-e4d256-prod-github-runner-207 kernel: [41452.569429] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 16:54:38 juju-e4d256-prod-github-runner-207 kernel: [41452.570553] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 16:54:38 juju-e4d256-prod-github-runner-207 kernel: [41452.571945] Call Trace: Aug 22 16:54:38 juju-e4d256-prod-github-runner-207 kernel: [41452.572864] Aug 22 16:54:38 juju-e4d256-prod-github-runner-207 kernel: [41452.573746] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:54:38 juju-e4d256-prod-github-runner-207 kernel: [41452.574775] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:54:38 juju-e4d256-prod-github-runner-207 kernel: [41452.575805] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:54:38 juju-e4d256-prod-github-runner-207 kernel: [41452.576882] ? show_regs.part.0+0x23/0x29 Aug 22 16:54:38 juju-e4d256-prod-github-runner-207 kernel: [41452.577876] ? show_regs.cold+0x8/0xd Aug 22 16:54:38 juju-e4d256-prod-github-runner-207 kernel: [41452.578844] ? watchdog_timer_fn+0x1be/0x220 Aug 22 16:54:38 juju-e4d256-prod-github-runner-207 kernel: [41452.579858] ? lockup_detector_update_enable+0x60/0x60 Aug 22 16:54:38 juju-e4d256-prod-github-runner-207 kernel: [41452.580924] ? __hrtimer_run_queues+0x107/0x230 Aug 22 16:54:38 juju-e4d256-prod-github-runner-207 kernel: [41452.581954] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 16:54:38 juju-e4d256-prod-github-runner-207 kernel: [41452.582985] ? hrtimer_interrupt+0x101/0x220 Aug 22 16:54:38 juju-e4d256-prod-github-runner-207 kernel: [41452.583999] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 16:54:38 juju-e4d256-prod-github-runner-207 kernel: [41452.585068] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 16:54:38 juju-e4d256-prod-github-runner-207 kernel: [41452.586117] Aug 22 16:54:38 juju-e4d256-prod-github-runner-207 kernel: [41452.586978] Aug 22 16:54:38 juju-e4d256-prod-github-runner-207 kernel: [41452.587815] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 16:54:38 juju-e4d256-prod-github-runner-207 kernel: [41452.588848] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:54:38 juju-e4d256-prod-github-runner-207 kernel: [41452.589885] ? _raw_spin_lock+0x22/0x30 Aug 22 16:54:38 juju-e4d256-prod-github-runner-207 kernel: [41452.590827] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:54:38 juju-e4d256-prod-github-runner-207 kernel: [41452.591848] direct_page_fault+0x206/0x310 [kvm] Aug 22 16:54:38 juju-e4d256-prod-github-runner-207 kernel: [41452.592869] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 16:54:38 juju-e4d256-prod-github-runner-207 kernel: [41452.593876] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 16:54:38 juju-e4d256-prod-github-runner-207 kernel: [41452.594875] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 16:54:38 juju-e4d256-prod-github-runner-207 kernel: [41452.595852] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 16:54:38 juju-e4d256-prod-github-runner-207 kernel: [41452.596794] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 16:54:38 juju-e4d256-prod-github-runner-207 kernel: [41452.597769] handle_exit+0x98/0x230 [kvm_amd] Aug 22 16:54:38 juju-e4d256-prod-github-runner-207 kernel: [41452.598660] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 16:54:38 juju-e4d256-prod-github-runner-207 kernel: [41452.599579] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 16:54:38 juju-e4d256-prod-github-runner-207 kernel: [41452.600501] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 16:54:38 juju-e4d256-prod-github-runner-207 kernel: [41452.601402] vcpu_run+0x62/0x2c0 [kvm] Aug 22 16:54:38 juju-e4d256-prod-github-runner-207 kernel: [41452.602210] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 16:54:38 juju-e4d256-prod-github-runner-207 kernel: [41452.603024] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 16:54:38 juju-e4d256-prod-github-runner-207 kernel: [41452.603876] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 16:54:38 juju-e4d256-prod-github-runner-207 kernel: [41452.604676] ? __seccomp_filter+0x4a/0x4a0 Aug 22 16:54:38 juju-e4d256-prod-github-runner-207 kernel: [41452.605418] ? __fget_files+0x86/0xc0 Aug 22 16:54:38 juju-e4d256-prod-github-runner-207 kernel: [41452.606120] __x64_sys_ioctl+0x95/0xd0 Aug 22 16:54:38 juju-e4d256-prod-github-runner-207 kernel: [41452.606810] do_syscall_64+0x5c/0xc0 Aug 22 16:54:38 juju-e4d256-prod-github-runner-207 kernel: [41452.607483] ? do_futex+0x162/0x1f0 Aug 22 16:54:38 juju-e4d256-prod-github-runner-207 kernel: [41452.608128] ? __x64_sys_futex+0x78/0x1e0 Aug 22 16:54:38 juju-e4d256-prod-github-runner-207 kernel: [41452.608798] ? __secure_computing+0xa9/0x120 Aug 22 16:54:38 juju-e4d256-prod-github-runner-207 kernel: [41452.609485] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 16:54:38 juju-e4d256-prod-github-runner-207 kernel: [41452.610242] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:54:38 juju-e4d256-prod-github-runner-207 kernel: [41452.610970] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:54:38 juju-e4d256-prod-github-runner-207 kernel: [41452.611685] ? do_syscall_64+0x69/0xc0 Aug 22 16:54:38 juju-e4d256-prod-github-runner-207 kernel: [41452.612333] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:54:38 juju-e4d256-prod-github-runner-207 kernel: [41452.613033] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:54:38 juju-e4d256-prod-github-runner-207 kernel: [41452.613727] ? do_syscall_64+0x69/0xc0 Aug 22 16:54:38 juju-e4d256-prod-github-runner-207 kernel: [41452.614354] ? do_syscall_64+0x69/0xc0 Aug 22 16:54:38 juju-e4d256-prod-github-runner-207 kernel: [41452.614984] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 16:54:38 juju-e4d256-prod-github-runner-207 kernel: [41452.615749] RIP: 0033:0x7faa5d0edaff Aug 22 16:54:38 juju-e4d256-prod-github-runner-207 kernel: [41452.616372] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 16:54:38 juju-e4d256-prod-github-runner-207 kernel: [41452.618348] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 16:54:38 juju-e4d256-prod-github-runner-207 kernel: [41452.619266] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 16:54:38 juju-e4d256-prod-github-runner-207 kernel: [41452.620156] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 16:54:38 juju-e4d256-prod-github-runner-207 kernel: [41452.621043] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 16:54:38 juju-e4d256-prod-github-runner-207 kernel: [41452.621929] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 16:54:38 juju-e4d256-prod-github-runner-207 kernel: [41452.622815] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 16:54:38 juju-e4d256-prod-github-runner-207 kernel: [41452.623711] Aug 22 16:55:06 juju-e4d256-prod-github-runner-207 kernel: [41480.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 38523s! [qemu-system-x86:6715] Aug 22 16:55:06 juju-e4d256-prod-github-runner-207 kernel: [41480.543132] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 16:55:06 juju-e4d256-prod-github-runner-207 kernel: [41480.543198] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 16:55:06 juju-e4d256-prod-github-runner-207 kernel: [41480.555228] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 16:55:06 juju-e4d256-prod-github-runner-207 kernel: [41480.556490] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 16:55:06 juju-e4d256-prod-github-runner-207 kernel: [41480.557716] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:55:06 juju-e4d256-prod-github-runner-207 kernel: [41480.558785] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 16:55:06 juju-e4d256-prod-github-runner-207 kernel: [41480.561338] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 16:55:06 juju-e4d256-prod-github-runner-207 kernel: [41480.562381] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 16:55:06 juju-e4d256-prod-github-runner-207 kernel: [41480.563559] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 16:55:06 juju-e4d256-prod-github-runner-207 kernel: [41480.564718] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 16:55:06 juju-e4d256-prod-github-runner-207 kernel: [41480.565881] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 16:55:06 juju-e4d256-prod-github-runner-207 kernel: [41480.567069] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 16:55:06 juju-e4d256-prod-github-runner-207 kernel: [41480.568235] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 16:55:06 juju-e4d256-prod-github-runner-207 kernel: [41480.569472] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 16:55:06 juju-e4d256-prod-github-runner-207 kernel: [41480.570568] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 16:55:06 juju-e4d256-prod-github-runner-207 kernel: [41480.571771] Call Trace: Aug 22 16:55:06 juju-e4d256-prod-github-runner-207 kernel: [41480.572683] Aug 22 16:55:06 juju-e4d256-prod-github-runner-207 kernel: [41480.573569] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:55:06 juju-e4d256-prod-github-runner-207 kernel: [41480.574597] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:55:06 juju-e4d256-prod-github-runner-207 kernel: [41480.575641] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:55:06 juju-e4d256-prod-github-runner-207 kernel: [41480.576719] ? show_regs.part.0+0x23/0x29 Aug 22 16:55:06 juju-e4d256-prod-github-runner-207 kernel: [41480.577714] ? show_regs.cold+0x8/0xd Aug 22 16:55:06 juju-e4d256-prod-github-runner-207 kernel: [41480.578697] ? watchdog_timer_fn+0x1be/0x220 Aug 22 16:55:06 juju-e4d256-prod-github-runner-207 kernel: [41480.579705] ? lockup_detector_update_enable+0x60/0x60 Aug 22 16:55:06 juju-e4d256-prod-github-runner-207 kernel: [41480.580771] ? __hrtimer_run_queues+0x107/0x230 Aug 22 16:55:06 juju-e4d256-prod-github-runner-207 kernel: [41480.581799] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 16:55:06 juju-e4d256-prod-github-runner-207 kernel: [41480.582833] ? hrtimer_interrupt+0x101/0x220 Aug 22 16:55:06 juju-e4d256-prod-github-runner-207 kernel: [41480.583849] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 16:55:06 juju-e4d256-prod-github-runner-207 kernel: [41480.584918] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 16:55:06 juju-e4d256-prod-github-runner-207 kernel: [41480.585963] Aug 22 16:55:06 juju-e4d256-prod-github-runner-207 kernel: [41480.586834] Aug 22 16:55:06 juju-e4d256-prod-github-runner-207 kernel: [41480.587671] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 16:55:06 juju-e4d256-prod-github-runner-207 kernel: [41480.588704] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:55:06 juju-e4d256-prod-github-runner-207 kernel: [41480.589747] ? _raw_spin_lock+0x22/0x30 Aug 22 16:55:06 juju-e4d256-prod-github-runner-207 kernel: [41480.590703] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:55:06 juju-e4d256-prod-github-runner-207 kernel: [41480.591717] direct_page_fault+0x206/0x310 [kvm] Aug 22 16:55:06 juju-e4d256-prod-github-runner-207 kernel: [41480.592740] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 16:55:06 juju-e4d256-prod-github-runner-207 kernel: [41480.593747] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 16:55:06 juju-e4d256-prod-github-runner-207 kernel: [41480.594757] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 16:55:06 juju-e4d256-prod-github-runner-207 kernel: [41480.595732] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 16:55:06 juju-e4d256-prod-github-runner-207 kernel: [41480.596676] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 16:55:06 juju-e4d256-prod-github-runner-207 kernel: [41480.597655] handle_exit+0x98/0x230 [kvm_amd] Aug 22 16:55:06 juju-e4d256-prod-github-runner-207 kernel: [41480.598552] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 16:55:06 juju-e4d256-prod-github-runner-207 kernel: [41480.599474] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 16:55:06 juju-e4d256-prod-github-runner-207 kernel: [41480.600395] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 16:55:06 juju-e4d256-prod-github-runner-207 kernel: [41480.601299] vcpu_run+0x62/0x2c0 [kvm] Aug 22 16:55:06 juju-e4d256-prod-github-runner-207 kernel: [41480.602111] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 16:55:06 juju-e4d256-prod-github-runner-207 kernel: [41480.602929] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 16:55:06 juju-e4d256-prod-github-runner-207 kernel: [41480.603783] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 16:55:06 juju-e4d256-prod-github-runner-207 kernel: [41480.604584] ? __seccomp_filter+0x4a/0x4a0 Aug 22 16:55:06 juju-e4d256-prod-github-runner-207 kernel: [41480.605325] ? __fget_files+0x86/0xc0 Aug 22 16:55:06 juju-e4d256-prod-github-runner-207 kernel: [41480.606027] __x64_sys_ioctl+0x95/0xd0 Aug 22 16:55:06 juju-e4d256-prod-github-runner-207 kernel: [41480.606728] do_syscall_64+0x5c/0xc0 Aug 22 16:55:06 juju-e4d256-prod-github-runner-207 kernel: [41480.607396] ? do_futex+0x162/0x1f0 Aug 22 16:55:06 juju-e4d256-prod-github-runner-207 kernel: [41480.608043] ? __x64_sys_futex+0x78/0x1e0 Aug 22 16:55:06 juju-e4d256-prod-github-runner-207 kernel: [41480.608717] ? __secure_computing+0xa9/0x120 Aug 22 16:55:06 juju-e4d256-prod-github-runner-207 kernel: [41480.609406] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 16:55:06 juju-e4d256-prod-github-runner-207 kernel: [41480.610165] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:55:06 juju-e4d256-prod-github-runner-207 kernel: [41480.610900] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:55:06 juju-e4d256-prod-github-runner-207 kernel: [41480.611617] ? do_syscall_64+0x69/0xc0 Aug 22 16:55:06 juju-e4d256-prod-github-runner-207 kernel: [41480.612262] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:55:06 juju-e4d256-prod-github-runner-207 kernel: [41480.612964] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:55:06 juju-e4d256-prod-github-runner-207 kernel: [41480.613659] ? do_syscall_64+0x69/0xc0 Aug 22 16:55:06 juju-e4d256-prod-github-runner-207 kernel: [41480.614288] ? do_syscall_64+0x69/0xc0 Aug 22 16:55:06 juju-e4d256-prod-github-runner-207 kernel: [41480.614917] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 16:55:06 juju-e4d256-prod-github-runner-207 kernel: [41480.615622] RIP: 0033:0x7faa5d0edaff Aug 22 16:55:06 juju-e4d256-prod-github-runner-207 kernel: [41480.616244] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 16:55:06 juju-e4d256-prod-github-runner-207 kernel: [41480.618231] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 16:55:06 juju-e4d256-prod-github-runner-207 kernel: [41480.619153] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 16:55:06 juju-e4d256-prod-github-runner-207 kernel: [41480.620042] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 16:55:06 juju-e4d256-prod-github-runner-207 kernel: [41480.620934] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 16:55:06 juju-e4d256-prod-github-runner-207 kernel: [41480.621821] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 16:55:06 juju-e4d256-prod-github-runner-207 kernel: [41480.622724] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 16:55:06 juju-e4d256-prod-github-runner-207 kernel: [41480.623620] Aug 22 16:55:34 juju-e4d256-prod-github-runner-207 kernel: [41508.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 38549s! [qemu-system-x86:6715] Aug 22 16:55:34 juju-e4d256-prod-github-runner-207 kernel: [41508.543729] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 16:55:34 juju-e4d256-prod-github-runner-207 kernel: [41508.543983] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 16:55:34 juju-e4d256-prod-github-runner-207 kernel: [41508.556129] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 16:55:34 juju-e4d256-prod-github-runner-207 kernel: [41508.557405] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 16:55:34 juju-e4d256-prod-github-runner-207 kernel: [41508.558654] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:55:34 juju-e4d256-prod-github-runner-207 kernel: [41508.559725] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 16:55:34 juju-e4d256-prod-github-runner-207 kernel: [41508.562349] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 16:55:34 juju-e4d256-prod-github-runner-207 kernel: [41508.563405] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 16:55:34 juju-e4d256-prod-github-runner-207 kernel: [41508.564594] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 16:55:34 juju-e4d256-prod-github-runner-207 kernel: [41508.565804] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 16:55:34 juju-e4d256-prod-github-runner-207 kernel: [41508.566992] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 16:55:34 juju-e4d256-prod-github-runner-207 kernel: [41508.568170] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 16:55:34 juju-e4d256-prod-github-runner-207 kernel: [41508.569355] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 16:55:34 juju-e4d256-prod-github-runner-207 kernel: [41508.570634] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 16:55:34 juju-e4d256-prod-github-runner-207 kernel: [41508.571748] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 16:55:34 juju-e4d256-prod-github-runner-207 kernel: [41508.572944] Call Trace: Aug 22 16:55:34 juju-e4d256-prod-github-runner-207 kernel: [41508.573862] Aug 22 16:55:34 juju-e4d256-prod-github-runner-207 kernel: [41508.574783] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:55:34 juju-e4d256-prod-github-runner-207 kernel: [41508.575829] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:55:34 juju-e4d256-prod-github-runner-207 kernel: [41508.576856] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:55:34 juju-e4d256-prod-github-runner-207 kernel: [41508.577982] ? show_regs.part.0+0x23/0x29 Aug 22 16:55:34 juju-e4d256-prod-github-runner-207 kernel: [41508.579088] ? show_regs.cold+0x8/0xd Aug 22 16:55:34 juju-e4d256-prod-github-runner-207 kernel: [41508.580094] ? watchdog_timer_fn+0x1be/0x220 Aug 22 16:55:34 juju-e4d256-prod-github-runner-207 kernel: [41508.581142] ? lockup_detector_update_enable+0x60/0x60 Aug 22 16:55:34 juju-e4d256-prod-github-runner-207 kernel: [41508.582223] ? __hrtimer_run_queues+0x107/0x230 Aug 22 16:55:34 juju-e4d256-prod-github-runner-207 kernel: [41508.583276] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 16:55:34 juju-e4d256-prod-github-runner-207 kernel: [41508.584305] ? hrtimer_interrupt+0x101/0x220 Aug 22 16:55:34 juju-e4d256-prod-github-runner-207 kernel: [41508.585339] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 16:55:34 juju-e4d256-prod-github-runner-207 kernel: [41508.586440] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 16:55:34 juju-e4d256-prod-github-runner-207 kernel: [41508.587517] Aug 22 16:55:34 juju-e4d256-prod-github-runner-207 kernel: [41508.588384] Aug 22 16:55:34 juju-e4d256-prod-github-runner-207 kernel: [41508.589232] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 16:55:34 juju-e4d256-prod-github-runner-207 kernel: [41508.590291] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:55:34 juju-e4d256-prod-github-runner-207 kernel: [41508.591411] ? _raw_spin_lock+0x22/0x30 Aug 22 16:55:34 juju-e4d256-prod-github-runner-207 kernel: [41508.592372] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:55:34 juju-e4d256-prod-github-runner-207 kernel: [41508.593396] direct_page_fault+0x206/0x310 [kvm] Aug 22 16:55:34 juju-e4d256-prod-github-runner-207 kernel: [41508.594451] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 16:55:34 juju-e4d256-prod-github-runner-207 kernel: [41508.595482] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 16:55:34 juju-e4d256-prod-github-runner-207 kernel: [41508.596499] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 16:55:34 juju-e4d256-prod-github-runner-207 kernel: [41508.597505] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 16:55:34 juju-e4d256-prod-github-runner-207 kernel: [41508.598475] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 16:55:34 juju-e4d256-prod-github-runner-207 kernel: [41508.599465] handle_exit+0x98/0x230 [kvm_amd] Aug 22 16:55:34 juju-e4d256-prod-github-runner-207 kernel: [41508.600374] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 16:55:34 juju-e4d256-prod-github-runner-207 kernel: [41508.601309] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 16:55:34 juju-e4d256-prod-github-runner-207 kernel: [41508.602244] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 16:55:34 juju-e4d256-prod-github-runner-207 kernel: [41508.603166] vcpu_run+0x62/0x2c0 [kvm] Aug 22 16:55:34 juju-e4d256-prod-github-runner-207 kernel: [41508.603986] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 16:55:34 juju-e4d256-prod-github-runner-207 kernel: [41508.604798] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 16:55:34 juju-e4d256-prod-github-runner-207 kernel: [41508.605765] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 16:55:34 juju-e4d256-prod-github-runner-207 kernel: [41508.606587] ? __seccomp_filter+0x4a/0x4a0 Aug 22 16:55:34 juju-e4d256-prod-github-runner-207 kernel: [41508.607336] ? __fget_files+0x86/0xc0 Aug 22 16:55:34 juju-e4d256-prod-github-runner-207 kernel: [41508.608047] __x64_sys_ioctl+0x95/0xd0 Aug 22 16:55:34 juju-e4d256-prod-github-runner-207 kernel: [41508.608761] do_syscall_64+0x5c/0xc0 Aug 22 16:55:34 juju-e4d256-prod-github-runner-207 kernel: [41508.609437] ? do_futex+0x162/0x1f0 Aug 22 16:55:34 juju-e4d256-prod-github-runner-207 kernel: [41508.610086] ? __x64_sys_futex+0x78/0x1e0 Aug 22 16:55:34 juju-e4d256-prod-github-runner-207 kernel: [41508.610794] ? __secure_computing+0xa9/0x120 Aug 22 16:55:34 juju-e4d256-prod-github-runner-207 kernel: [41508.611493] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 16:55:34 juju-e4d256-prod-github-runner-207 kernel: [41508.612265] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:55:34 juju-e4d256-prod-github-runner-207 kernel: [41508.612996] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:55:34 juju-e4d256-prod-github-runner-207 kernel: [41508.613714] ? do_syscall_64+0x69/0xc0 Aug 22 16:55:34 juju-e4d256-prod-github-runner-207 kernel: [41508.614372] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:55:34 juju-e4d256-prod-github-runner-207 kernel: [41508.615074] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:55:34 juju-e4d256-prod-github-runner-207 kernel: [41508.615787] ? do_syscall_64+0x69/0xc0 Aug 22 16:55:34 juju-e4d256-prod-github-runner-207 kernel: [41508.616417] ? do_syscall_64+0x69/0xc0 Aug 22 16:55:34 juju-e4d256-prod-github-runner-207 kernel: [41508.617054] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 16:55:34 juju-e4d256-prod-github-runner-207 kernel: [41508.617771] RIP: 0033:0x7faa5d0edaff Aug 22 16:55:34 juju-e4d256-prod-github-runner-207 kernel: [41508.618435] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 16:55:34 juju-e4d256-prod-github-runner-207 kernel: [41508.620436] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 16:55:34 juju-e4d256-prod-github-runner-207 kernel: [41508.621385] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 16:55:34 juju-e4d256-prod-github-runner-207 kernel: [41508.622310] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 16:55:34 juju-e4d256-prod-github-runner-207 kernel: [41508.623210] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 16:55:34 juju-e4d256-prod-github-runner-207 kernel: [41508.624098] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 16:55:34 juju-e4d256-prod-github-runner-207 kernel: [41508.624988] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 16:55:34 juju-e4d256-prod-github-runner-207 kernel: [41508.625887] Aug 22 16:56:02 juju-e4d256-prod-github-runner-207 kernel: [41536.541982] watchdog: BUG: soft lockup - CPU#1 stuck for 38575s! [qemu-system-x86:6715] Aug 22 16:56:02 juju-e4d256-prod-github-runner-207 kernel: [41536.543079] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 16:56:02 juju-e4d256-prod-github-runner-207 kernel: [41536.543148] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 16:56:02 juju-e4d256-prod-github-runner-207 kernel: [41536.555577] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 16:56:02 juju-e4d256-prod-github-runner-207 kernel: [41536.556864] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 16:56:02 juju-e4d256-prod-github-runner-207 kernel: [41536.558114] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:56:02 juju-e4d256-prod-github-runner-207 kernel: [41536.559178] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 16:56:02 juju-e4d256-prod-github-runner-207 kernel: [41536.561737] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 16:56:02 juju-e4d256-prod-github-runner-207 kernel: [41536.562798] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 16:56:02 juju-e4d256-prod-github-runner-207 kernel: [41536.563968] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 16:56:02 juju-e4d256-prod-github-runner-207 kernel: [41536.565137] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 16:56:02 juju-e4d256-prod-github-runner-207 kernel: [41536.566320] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 16:56:02 juju-e4d256-prod-github-runner-207 kernel: [41536.567486] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 16:56:02 juju-e4d256-prod-github-runner-207 kernel: [41536.568666] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 16:56:02 juju-e4d256-prod-github-runner-207 kernel: [41536.569903] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 16:56:02 juju-e4d256-prod-github-runner-207 kernel: [41536.571021] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 16:56:02 juju-e4d256-prod-github-runner-207 kernel: [41536.572218] Call Trace: Aug 22 16:56:02 juju-e4d256-prod-github-runner-207 kernel: [41536.573141] Aug 22 16:56:02 juju-e4d256-prod-github-runner-207 kernel: [41536.574041] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:56:02 juju-e4d256-prod-github-runner-207 kernel: [41536.575072] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:56:02 juju-e4d256-prod-github-runner-207 kernel: [41536.576094] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:56:02 juju-e4d256-prod-github-runner-207 kernel: [41536.577180] ? show_regs.part.0+0x23/0x29 Aug 22 16:56:02 juju-e4d256-prod-github-runner-207 kernel: [41536.578196] ? show_regs.cold+0x8/0xd Aug 22 16:56:02 juju-e4d256-prod-github-runner-207 kernel: [41536.579174] ? watchdog_timer_fn+0x1be/0x220 Aug 22 16:56:02 juju-e4d256-prod-github-runner-207 kernel: [41536.580183] ? lockup_detector_update_enable+0x60/0x60 Aug 22 16:56:02 juju-e4d256-prod-github-runner-207 kernel: [41536.581344] ? __hrtimer_run_queues+0x107/0x230 Aug 22 16:56:02 juju-e4d256-prod-github-runner-207 kernel: [41536.582391] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 16:56:02 juju-e4d256-prod-github-runner-207 kernel: [41536.583571] ? hrtimer_interrupt+0x101/0x220 Aug 22 16:56:02 juju-e4d256-prod-github-runner-207 kernel: [41536.584591] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 16:56:02 juju-e4d256-prod-github-runner-207 kernel: [41536.585665] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 16:56:02 juju-e4d256-prod-github-runner-207 kernel: [41536.586735] Aug 22 16:56:02 juju-e4d256-prod-github-runner-207 kernel: [41536.587588] Aug 22 16:56:02 juju-e4d256-prod-github-runner-207 kernel: [41536.588432] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 16:56:02 juju-e4d256-prod-github-runner-207 kernel: [41536.589468] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:56:02 juju-e4d256-prod-github-runner-207 kernel: [41536.590527] ? _raw_spin_lock+0x22/0x30 Aug 22 16:56:02 juju-e4d256-prod-github-runner-207 kernel: [41536.591473] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:56:02 juju-e4d256-prod-github-runner-207 kernel: [41536.592502] direct_page_fault+0x206/0x310 [kvm] Aug 22 16:56:02 juju-e4d256-prod-github-runner-207 kernel: [41536.593544] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 16:56:02 juju-e4d256-prod-github-runner-207 kernel: [41536.594676] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 16:56:02 juju-e4d256-prod-github-runner-207 kernel: [41536.595684] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 16:56:02 juju-e4d256-prod-github-runner-207 kernel: [41536.596667] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 16:56:02 juju-e4d256-prod-github-runner-207 kernel: [41536.597623] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 16:56:02 juju-e4d256-prod-github-runner-207 kernel: [41536.598622] handle_exit+0x98/0x230 [kvm_amd] Aug 22 16:56:02 juju-e4d256-prod-github-runner-207 kernel: [41536.599514] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 16:56:02 juju-e4d256-prod-github-runner-207 kernel: [41536.600442] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 16:56:02 juju-e4d256-prod-github-runner-207 kernel: [41536.601370] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 16:56:02 juju-e4d256-prod-github-runner-207 kernel: [41536.602304] vcpu_run+0x62/0x2c0 [kvm] Aug 22 16:56:02 juju-e4d256-prod-github-runner-207 kernel: [41536.603116] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 16:56:02 juju-e4d256-prod-github-runner-207 kernel: [41536.603925] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 16:56:02 juju-e4d256-prod-github-runner-207 kernel: [41536.604791] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 16:56:02 juju-e4d256-prod-github-runner-207 kernel: [41536.605589] ? __seccomp_filter+0x4a/0x4a0 Aug 22 16:56:02 juju-e4d256-prod-github-runner-207 kernel: [41536.606356] ? __fget_files+0x86/0xc0 Aug 22 16:56:02 juju-e4d256-prod-github-runner-207 kernel: [41536.607060] __x64_sys_ioctl+0x95/0xd0 Aug 22 16:56:02 juju-e4d256-prod-github-runner-207 kernel: [41536.607753] do_syscall_64+0x5c/0xc0 Aug 22 16:56:02 juju-e4d256-prod-github-runner-207 kernel: [41536.608423] ? do_futex+0x162/0x1f0 Aug 22 16:56:02 juju-e4d256-prod-github-runner-207 kernel: [41536.609075] ? __x64_sys_futex+0x78/0x1e0 Aug 22 16:56:02 juju-e4d256-prod-github-runner-207 kernel: [41536.609751] ? __secure_computing+0xa9/0x120 Aug 22 16:56:02 juju-e4d256-prod-github-runner-207 kernel: [41536.610459] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 16:56:02 juju-e4d256-prod-github-runner-207 kernel: [41536.611222] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:56:02 juju-e4d256-prod-github-runner-207 kernel: [41536.611959] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:56:02 juju-e4d256-prod-github-runner-207 kernel: [41536.612759] ? do_syscall_64+0x69/0xc0 Aug 22 16:56:02 juju-e4d256-prod-github-runner-207 kernel: [41536.613408] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:56:02 juju-e4d256-prod-github-runner-207 kernel: [41536.614135] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:56:02 juju-e4d256-prod-github-runner-207 kernel: [41536.614839] ? do_syscall_64+0x69/0xc0 Aug 22 16:56:02 juju-e4d256-prod-github-runner-207 kernel: [41536.615466] ? do_syscall_64+0x69/0xc0 Aug 22 16:56:02 juju-e4d256-prod-github-runner-207 kernel: [41536.616090] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 16:56:02 juju-e4d256-prod-github-runner-207 kernel: [41536.616805] RIP: 0033:0x7faa5d0edaff Aug 22 16:56:02 juju-e4d256-prod-github-runner-207 kernel: [41536.617433] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 16:56:02 juju-e4d256-prod-github-runner-207 kernel: [41536.619458] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 16:56:02 juju-e4d256-prod-github-runner-207 kernel: [41536.620382] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 16:56:02 juju-e4d256-prod-github-runner-207 kernel: [41536.621284] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 16:56:02 juju-e4d256-prod-github-runner-207 kernel: [41536.622199] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 16:56:02 juju-e4d256-prod-github-runner-207 kernel: [41536.623092] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 16:56:02 juju-e4d256-prod-github-runner-207 kernel: [41536.623986] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 16:56:02 juju-e4d256-prod-github-runner-207 kernel: [41536.624900] Aug 22 16:56:30 juju-e4d256-prod-github-runner-207 kernel: [41564.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 38601s! [qemu-system-x86:6715] Aug 22 16:56:30 juju-e4d256-prod-github-runner-207 kernel: [41564.543096] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 16:56:30 juju-e4d256-prod-github-runner-207 kernel: [41564.543162] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 16:56:30 juju-e4d256-prod-github-runner-207 kernel: [41564.555191] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 16:56:30 juju-e4d256-prod-github-runner-207 kernel: [41564.556453] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 16:56:30 juju-e4d256-prod-github-runner-207 kernel: [41564.557684] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:56:30 juju-e4d256-prod-github-runner-207 kernel: [41564.558749] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 16:56:30 juju-e4d256-prod-github-runner-207 kernel: [41564.561308] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 16:56:30 juju-e4d256-prod-github-runner-207 kernel: [41564.562364] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 16:56:30 juju-e4d256-prod-github-runner-207 kernel: [41564.563533] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 16:56:30 juju-e4d256-prod-github-runner-207 kernel: [41564.564694] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 16:56:30 juju-e4d256-prod-github-runner-207 kernel: [41564.565864] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 16:56:30 juju-e4d256-prod-github-runner-207 kernel: [41564.567031] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 16:56:30 juju-e4d256-prod-github-runner-207 kernel: [41564.568196] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 16:56:30 juju-e4d256-prod-github-runner-207 kernel: [41564.569426] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 16:56:30 juju-e4d256-prod-github-runner-207 kernel: [41564.570534] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 16:56:30 juju-e4d256-prod-github-runner-207 kernel: [41564.571724] Call Trace: Aug 22 16:56:30 juju-e4d256-prod-github-runner-207 kernel: [41564.572634] Aug 22 16:56:30 juju-e4d256-prod-github-runner-207 kernel: [41564.573522] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:56:30 juju-e4d256-prod-github-runner-207 kernel: [41564.574558] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:56:30 juju-e4d256-prod-github-runner-207 kernel: [41564.575577] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:56:30 juju-e4d256-prod-github-runner-207 kernel: [41564.576647] ? show_regs.part.0+0x23/0x29 Aug 22 16:56:30 juju-e4d256-prod-github-runner-207 kernel: [41564.577656] ? show_regs.cold+0x8/0xd Aug 22 16:56:30 juju-e4d256-prod-github-runner-207 kernel: [41564.578630] ? watchdog_timer_fn+0x1be/0x220 Aug 22 16:56:30 juju-e4d256-prod-github-runner-207 kernel: [41564.579641] ? lockup_detector_update_enable+0x60/0x60 Aug 22 16:56:30 juju-e4d256-prod-github-runner-207 kernel: [41564.580703] ? __hrtimer_run_queues+0x107/0x230 Aug 22 16:56:30 juju-e4d256-prod-github-runner-207 kernel: [41564.581740] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 16:56:30 juju-e4d256-prod-github-runner-207 kernel: [41564.582871] ? hrtimer_interrupt+0x101/0x220 Aug 22 16:56:30 juju-e4d256-prod-github-runner-207 kernel: [41564.583883] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 16:56:30 juju-e4d256-prod-github-runner-207 kernel: [41564.584950] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 16:56:30 juju-e4d256-prod-github-runner-207 kernel: [41564.586003] Aug 22 16:56:30 juju-e4d256-prod-github-runner-207 kernel: [41564.586856] Aug 22 16:56:30 juju-e4d256-prod-github-runner-207 kernel: [41564.587691] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 16:56:30 juju-e4d256-prod-github-runner-207 kernel: [41564.588727] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:56:30 juju-e4d256-prod-github-runner-207 kernel: [41564.589772] ? _raw_spin_lock+0x22/0x30 Aug 22 16:56:30 juju-e4d256-prod-github-runner-207 kernel: [41564.590715] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:56:30 juju-e4d256-prod-github-runner-207 kernel: [41564.591729] direct_page_fault+0x206/0x310 [kvm] Aug 22 16:56:30 juju-e4d256-prod-github-runner-207 kernel: [41564.592823] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 16:56:30 juju-e4d256-prod-github-runner-207 kernel: [41564.593844] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 16:56:30 juju-e4d256-prod-github-runner-207 kernel: [41564.594844] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 16:56:30 juju-e4d256-prod-github-runner-207 kernel: [41564.595811] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 16:56:30 juju-e4d256-prod-github-runner-207 kernel: [41564.596794] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 16:56:30 juju-e4d256-prod-github-runner-207 kernel: [41564.597805] handle_exit+0x98/0x230 [kvm_amd] Aug 22 16:56:30 juju-e4d256-prod-github-runner-207 kernel: [41564.598701] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 16:56:30 juju-e4d256-prod-github-runner-207 kernel: [41564.599618] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 16:56:30 juju-e4d256-prod-github-runner-207 kernel: [41564.600540] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 16:56:30 juju-e4d256-prod-github-runner-207 kernel: [41564.601448] vcpu_run+0x62/0x2c0 [kvm] Aug 22 16:56:30 juju-e4d256-prod-github-runner-207 kernel: [41564.602266] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 16:56:30 juju-e4d256-prod-github-runner-207 kernel: [41564.603072] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 16:56:30 juju-e4d256-prod-github-runner-207 kernel: [41564.603922] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 16:56:30 juju-e4d256-prod-github-runner-207 kernel: [41564.604716] ? __seccomp_filter+0x4a/0x4a0 Aug 22 16:56:30 juju-e4d256-prod-github-runner-207 kernel: [41564.605456] ? __fget_files+0x86/0xc0 Aug 22 16:56:30 juju-e4d256-prod-github-runner-207 kernel: [41564.606164] __x64_sys_ioctl+0x95/0xd0 Aug 22 16:56:30 juju-e4d256-prod-github-runner-207 kernel: [41564.606855] do_syscall_64+0x5c/0xc0 Aug 22 16:56:30 juju-e4d256-prod-github-runner-207 kernel: [41564.607521] ? do_futex+0x162/0x1f0 Aug 22 16:56:30 juju-e4d256-prod-github-runner-207 kernel: [41564.608167] ? __x64_sys_futex+0x78/0x1e0 Aug 22 16:56:30 juju-e4d256-prod-github-runner-207 kernel: [41564.608838] ? __secure_computing+0xa9/0x120 Aug 22 16:56:30 juju-e4d256-prod-github-runner-207 kernel: [41564.609525] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 16:56:30 juju-e4d256-prod-github-runner-207 kernel: [41564.610288] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:56:30 juju-e4d256-prod-github-runner-207 kernel: [41564.611008] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:56:30 juju-e4d256-prod-github-runner-207 kernel: [41564.611725] ? do_syscall_64+0x69/0xc0 Aug 22 16:56:30 juju-e4d256-prod-github-runner-207 kernel: [41564.612367] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:56:30 juju-e4d256-prod-github-runner-207 kernel: [41564.613067] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:56:30 juju-e4d256-prod-github-runner-207 kernel: [41564.613768] ? do_syscall_64+0x69/0xc0 Aug 22 16:56:30 juju-e4d256-prod-github-runner-207 kernel: [41564.614392] ? do_syscall_64+0x69/0xc0 Aug 22 16:56:30 juju-e4d256-prod-github-runner-207 kernel: [41564.615014] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 16:56:30 juju-e4d256-prod-github-runner-207 kernel: [41564.615718] RIP: 0033:0x7faa5d0edaff Aug 22 16:56:30 juju-e4d256-prod-github-runner-207 kernel: [41564.616340] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 16:56:30 juju-e4d256-prod-github-runner-207 kernel: [41564.618340] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 16:56:30 juju-e4d256-prod-github-runner-207 kernel: [41564.619250] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 16:56:30 juju-e4d256-prod-github-runner-207 kernel: [41564.620143] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 16:56:30 juju-e4d256-prod-github-runner-207 kernel: [41564.621032] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 16:56:30 juju-e4d256-prod-github-runner-207 kernel: [41564.621929] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 16:56:30 juju-e4d256-prod-github-runner-207 kernel: [41564.622816] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 16:56:30 juju-e4d256-prod-github-runner-207 kernel: [41564.623706] Aug 22 16:56:46 juju-e4d256-prod-github-runner-207 kernel: [41579.960706] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 16:56:46 juju-e4d256-prod-github-runner-207 kernel: [41579.962315] rcu: 1-....: (10333183 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=4999054 Aug 22 16:56:46 juju-e4d256-prod-github-runner-207 kernel: [41579.963444] (t=10365690 jiffies g=23269 q=41912) Aug 22 16:56:46 juju-e4d256-prod-github-runner-207 kernel: [41579.964231] NMI backtrace for cpu 1 Aug 22 16:56:46 juju-e4d256-prod-github-runner-207 kernel: [41579.964941] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 16:56:46 juju-e4d256-prod-github-runner-207 kernel: [41579.966055] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 16:56:46 juju-e4d256-prod-github-runner-207 kernel: [41579.967118] Call Trace: Aug 22 16:56:46 juju-e4d256-prod-github-runner-207 kernel: [41579.967790] Aug 22 16:56:46 juju-e4d256-prod-github-runner-207 kernel: [41579.968441] show_stack+0x52/0x5c Aug 22 16:56:46 juju-e4d256-prod-github-runner-207 kernel: [41579.969163] dump_stack_lvl+0x4a/0x63 Aug 22 16:56:46 juju-e4d256-prod-github-runner-207 kernel: [41579.969922] dump_stack+0x10/0x16 Aug 22 16:56:46 juju-e4d256-prod-github-runner-207 kernel: [41579.970637] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 16:56:46 juju-e4d256-prod-github-runner-207 kernel: [41579.971519] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 16:56:46 juju-e4d256-prod-github-runner-207 kernel: [41579.972303] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 16:56:46 juju-e4d256-prod-github-runner-207 kernel: [41579.973121] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 16:56:46 juju-e4d256-prod-github-runner-207 kernel: [41579.973951] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 16:56:46 juju-e4d256-prod-github-runner-207 kernel: [41579.974757] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 16:56:46 juju-e4d256-prod-github-runner-207 kernel: [41579.975528] print_cpu_stall.cold+0x2f/0xe2 Aug 22 16:56:46 juju-e4d256-prod-github-runner-207 kernel: [41579.976290] ? timekeeping_update+0xf7/0x150 Aug 22 16:56:46 juju-e4d256-prod-github-runner-207 kernel: [41579.977058] check_cpu_stall+0x109/0x270 Aug 22 16:56:46 juju-e4d256-prod-github-runner-207 kernel: [41579.977813] rcu_sched_clock_irq+0x9a/0x250 Aug 22 16:56:46 juju-e4d256-prod-github-runner-207 kernel: [41579.978576] update_process_times+0x94/0xd0 Aug 22 16:56:46 juju-e4d256-prod-github-runner-207 kernel: [41579.979335] tick_sched_handle+0x29/0x70 Aug 22 16:56:46 juju-e4d256-prod-github-runner-207 kernel: [41579.980079] tick_sched_timer+0x8c/0xc0 Aug 22 16:56:46 juju-e4d256-prod-github-runner-207 kernel: [41579.980814] ? tick_nohz_handler+0xb0/0xb0 Aug 22 16:56:46 juju-e4d256-prod-github-runner-207 kernel: [41579.981576] __hrtimer_run_queues+0x107/0x230 Aug 22 16:56:46 juju-e4d256-prod-github-runner-207 kernel: [41579.982355] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 16:56:46 juju-e4d256-prod-github-runner-207 kernel: [41579.983128] hrtimer_interrupt+0x101/0x220 Aug 22 16:56:46 juju-e4d256-prod-github-runner-207 kernel: [41579.983885] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 16:56:46 juju-e4d256-prod-github-runner-207 kernel: [41579.984694] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 16:56:46 juju-e4d256-prod-github-runner-207 kernel: [41579.985515] Aug 22 16:56:46 juju-e4d256-prod-github-runner-207 kernel: [41579.986148] Aug 22 16:56:46 juju-e4d256-prod-github-runner-207 kernel: [41579.986779] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 16:56:46 juju-e4d256-prod-github-runner-207 kernel: [41579.987597] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:56:46 juju-e4d256-prod-github-runner-207 kernel: [41579.988475] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 16:56:46 juju-e4d256-prod-github-runner-207 kernel: [41579.990711] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 16:56:46 juju-e4d256-prod-github-runner-207 kernel: [41579.991731] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 16:56:46 juju-e4d256-prod-github-runner-207 kernel: [41579.992879] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 16:56:46 juju-e4d256-prod-github-runner-207 kernel: [41579.994036] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 16:56:46 juju-e4d256-prod-github-runner-207 kernel: [41579.995128] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 16:56:46 juju-e4d256-prod-github-runner-207 kernel: [41579.996213] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 16:56:46 juju-e4d256-prod-github-runner-207 kernel: [41579.997300] ? _raw_spin_lock+0x22/0x30 Aug 22 16:56:46 juju-e4d256-prod-github-runner-207 kernel: [41579.998156] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:56:46 juju-e4d256-prod-github-runner-207 kernel: [41579.999101] direct_page_fault+0x206/0x310 [kvm] Aug 22 16:56:46 juju-e4d256-prod-github-runner-207 kernel: [41580.000028] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 16:56:46 juju-e4d256-prod-github-runner-207 kernel: [41580.000949] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 16:56:46 juju-e4d256-prod-github-runner-207 kernel: [41580.001895] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 16:56:46 juju-e4d256-prod-github-runner-207 kernel: [41580.002818] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 16:56:46 juju-e4d256-prod-github-runner-207 kernel: [41580.003698] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 16:56:46 juju-e4d256-prod-github-runner-207 kernel: [41580.004632] handle_exit+0x98/0x230 [kvm_amd] Aug 22 16:56:46 juju-e4d256-prod-github-runner-207 kernel: [41580.005485] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 16:56:46 juju-e4d256-prod-github-runner-207 kernel: [41580.006360] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 16:56:46 juju-e4d256-prod-github-runner-207 kernel: [41580.007259] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 16:56:46 juju-e4d256-prod-github-runner-207 kernel: [41580.008146] vcpu_run+0x62/0x2c0 [kvm] Aug 22 16:56:46 juju-e4d256-prod-github-runner-207 kernel: [41580.008936] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 16:56:46 juju-e4d256-prod-github-runner-207 kernel: [41580.009782] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 16:56:46 juju-e4d256-prod-github-runner-207 kernel: [41580.010684] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 16:56:46 juju-e4d256-prod-github-runner-207 kernel: [41580.011531] ? __seccomp_filter+0x4a/0x4a0 Aug 22 16:56:46 juju-e4d256-prod-github-runner-207 kernel: [41580.012331] ? __fget_files+0x86/0xc0 Aug 22 16:56:46 juju-e4d256-prod-github-runner-207 kernel: [41580.013097] __x64_sys_ioctl+0x95/0xd0 Aug 22 16:56:46 juju-e4d256-prod-github-runner-207 kernel: [41580.013886] do_syscall_64+0x5c/0xc0 Aug 22 16:56:46 juju-e4d256-prod-github-runner-207 kernel: [41580.014638] ? do_futex+0x162/0x1f0 Aug 22 16:56:46 juju-e4d256-prod-github-runner-207 kernel: [41580.015377] ? __x64_sys_futex+0x78/0x1e0 Aug 22 16:56:46 juju-e4d256-prod-github-runner-207 kernel: [41580.016161] ? __secure_computing+0xa9/0x120 Aug 22 16:56:46 juju-e4d256-prod-github-runner-207 kernel: [41580.016957] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 16:56:46 juju-e4d256-prod-github-runner-207 kernel: [41580.017864] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:56:46 juju-e4d256-prod-github-runner-207 kernel: [41580.018711] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:56:46 juju-e4d256-prod-github-runner-207 kernel: [41580.019556] ? do_syscall_64+0x69/0xc0 Aug 22 16:56:46 juju-e4d256-prod-github-runner-207 kernel: [41580.020316] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:56:46 juju-e4d256-prod-github-runner-207 kernel: [41580.021161] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:56:46 juju-e4d256-prod-github-runner-207 kernel: [41580.022019] ? do_syscall_64+0x69/0xc0 Aug 22 16:56:46 juju-e4d256-prod-github-runner-207 kernel: [41580.022783] ? do_syscall_64+0x69/0xc0 Aug 22 16:56:46 juju-e4d256-prod-github-runner-207 kernel: [41580.023541] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 16:56:46 juju-e4d256-prod-github-runner-207 kernel: [41580.024410] RIP: 0033:0x7faa5d0edaff Aug 22 16:56:46 juju-e4d256-prod-github-runner-207 kernel: [41580.025182] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 16:56:46 juju-e4d256-prod-github-runner-207 kernel: [41580.027631] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 16:56:46 juju-e4d256-prod-github-runner-207 kernel: [41580.028735] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 16:56:46 juju-e4d256-prod-github-runner-207 kernel: [41580.029834] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 16:56:46 juju-e4d256-prod-github-runner-207 kernel: [41580.030909] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 16:56:46 juju-e4d256-prod-github-runner-207 kernel: [41580.031983] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 16:56:46 juju-e4d256-prod-github-runner-207 kernel: [41580.033047] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 16:56:46 juju-e4d256-prod-github-runner-207 kernel: [41580.034110] Aug 22 16:57:10 juju-e4d256-prod-github-runner-207 kernel: [41604.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 38639s! [qemu-system-x86:6715] Aug 22 16:57:10 juju-e4d256-prod-github-runner-207 kernel: [41604.543097] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 16:57:10 juju-e4d256-prod-github-runner-207 kernel: [41604.543394] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 16:57:10 juju-e4d256-prod-github-runner-207 kernel: [41604.557803] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 16:57:10 juju-e4d256-prod-github-runner-207 kernel: [41604.559238] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 16:57:10 juju-e4d256-prod-github-runner-207 kernel: [41604.560617] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:57:10 juju-e4d256-prod-github-runner-207 kernel: [41604.561796] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 16:57:10 juju-e4d256-prod-github-runner-207 kernel: [41604.564701] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 16:57:10 juju-e4d256-prod-github-runner-207 kernel: [41604.565871] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 16:57:10 juju-e4d256-prod-github-runner-207 kernel: [41604.567181] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 16:57:10 juju-e4d256-prod-github-runner-207 kernel: [41604.568477] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 16:57:10 juju-e4d256-prod-github-runner-207 kernel: [41604.569787] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 16:57:10 juju-e4d256-prod-github-runner-207 kernel: [41604.571080] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 16:57:10 juju-e4d256-prod-github-runner-207 kernel: [41604.572388] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 16:57:10 juju-e4d256-prod-github-runner-207 kernel: [41604.573800] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 16:57:10 juju-e4d256-prod-github-runner-207 kernel: [41604.575016] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 16:57:10 juju-e4d256-prod-github-runner-207 kernel: [41604.576347] Call Trace: Aug 22 16:57:10 juju-e4d256-prod-github-runner-207 kernel: [41604.577335] Aug 22 16:57:10 juju-e4d256-prod-github-runner-207 kernel: [41604.578275] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:57:10 juju-e4d256-prod-github-runner-207 kernel: [41604.579400] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:57:10 juju-e4d256-prod-github-runner-207 kernel: [41604.580508] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:57:10 juju-e4d256-prod-github-runner-207 kernel: [41604.581695] ? show_regs.part.0+0x23/0x29 Aug 22 16:57:10 juju-e4d256-prod-github-runner-207 kernel: [41604.582775] ? show_regs.cold+0x8/0xd Aug 22 16:57:10 juju-e4d256-prod-github-runner-207 kernel: [41604.583822] ? watchdog_timer_fn+0x1be/0x220 Aug 22 16:57:10 juju-e4d256-prod-github-runner-207 kernel: [41604.584916] ? lockup_detector_update_enable+0x60/0x60 Aug 22 16:57:10 juju-e4d256-prod-github-runner-207 kernel: [41604.586103] ? __hrtimer_run_queues+0x107/0x230 Aug 22 16:57:10 juju-e4d256-prod-github-runner-207 kernel: [41604.587224] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 16:57:10 juju-e4d256-prod-github-runner-207 kernel: [41604.588337] ? hrtimer_interrupt+0x101/0x220 Aug 22 16:57:10 juju-e4d256-prod-github-runner-207 kernel: [41604.589451] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 16:57:10 juju-e4d256-prod-github-runner-207 kernel: [41604.590629] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 16:57:10 juju-e4d256-prod-github-runner-207 kernel: [41604.591776] Aug 22 16:57:10 juju-e4d256-prod-github-runner-207 kernel: [41604.592686] Aug 22 16:57:10 juju-e4d256-prod-github-runner-207 kernel: [41604.593591] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 16:57:10 juju-e4d256-prod-github-runner-207 kernel: [41604.594739] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:57:10 juju-e4d256-prod-github-runner-207 kernel: [41604.595893] ? _raw_spin_lock+0x22/0x30 Aug 22 16:57:10 juju-e4d256-prod-github-runner-207 kernel: [41604.596915] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:57:10 juju-e4d256-prod-github-runner-207 kernel: [41604.598049] direct_page_fault+0x206/0x310 [kvm] Aug 22 16:57:10 juju-e4d256-prod-github-runner-207 kernel: [41604.599168] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 16:57:10 juju-e4d256-prod-github-runner-207 kernel: [41604.600274] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 16:57:10 juju-e4d256-prod-github-runner-207 kernel: [41604.601402] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 16:57:10 juju-e4d256-prod-github-runner-207 kernel: [41604.602479] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 16:57:10 juju-e4d256-prod-github-runner-207 kernel: [41604.603522] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 16:57:10 juju-e4d256-prod-github-runner-207 kernel: [41604.604613] handle_exit+0x98/0x230 [kvm_amd] Aug 22 16:57:10 juju-e4d256-prod-github-runner-207 kernel: [41604.605609] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 16:57:10 juju-e4d256-prod-github-runner-207 kernel: [41604.606631] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 16:57:10 juju-e4d256-prod-github-runner-207 kernel: [41604.607651] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 16:57:10 juju-e4d256-prod-github-runner-207 kernel: [41604.608649] vcpu_run+0x62/0x2c0 [kvm] Aug 22 16:57:10 juju-e4d256-prod-github-runner-207 kernel: [41604.609548] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 16:57:10 juju-e4d256-prod-github-runner-207 kernel: [41604.610448] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 16:57:10 juju-e4d256-prod-github-runner-207 kernel: [41604.611412] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 16:57:10 juju-e4d256-prod-github-runner-207 kernel: [41604.612302] ? __seccomp_filter+0x4a/0x4a0 Aug 22 16:57:10 juju-e4d256-prod-github-runner-207 kernel: [41604.613131] ? __fget_files+0x86/0xc0 Aug 22 16:57:10 juju-e4d256-prod-github-runner-207 kernel: [41604.614013] __x64_sys_ioctl+0x95/0xd0 Aug 22 16:57:10 juju-e4d256-prod-github-runner-207 kernel: [41604.614823] do_syscall_64+0x5c/0xc0 Aug 22 16:57:10 juju-e4d256-prod-github-runner-207 kernel: [41604.615499] ? do_futex+0x162/0x1f0 Aug 22 16:57:10 juju-e4d256-prod-github-runner-207 kernel: [41604.616151] ? __x64_sys_futex+0x78/0x1e0 Aug 22 16:57:10 juju-e4d256-prod-github-runner-207 kernel: [41604.616832] ? __secure_computing+0xa9/0x120 Aug 22 16:57:10 juju-e4d256-prod-github-runner-207 kernel: [41604.617547] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 16:57:10 juju-e4d256-prod-github-runner-207 kernel: [41604.618309] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:57:10 juju-e4d256-prod-github-runner-207 kernel: [41604.619068] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:57:10 juju-e4d256-prod-github-runner-207 kernel: [41604.619792] ? do_syscall_64+0x69/0xc0 Aug 22 16:57:10 juju-e4d256-prod-github-runner-207 kernel: [41604.620438] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:57:10 juju-e4d256-prod-github-runner-207 kernel: [41604.621142] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:57:10 juju-e4d256-prod-github-runner-207 kernel: [41604.621848] ? do_syscall_64+0x69/0xc0 Aug 22 16:57:10 juju-e4d256-prod-github-runner-207 kernel: [41604.622478] ? do_syscall_64+0x69/0xc0 Aug 22 16:57:10 juju-e4d256-prod-github-runner-207 kernel: [41604.623101] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 16:57:10 juju-e4d256-prod-github-runner-207 kernel: [41604.623817] RIP: 0033:0x7faa5d0edaff Aug 22 16:57:10 juju-e4d256-prod-github-runner-207 kernel: [41604.624445] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 16:57:10 juju-e4d256-prod-github-runner-207 kernel: [41604.626456] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 16:57:10 juju-e4d256-prod-github-runner-207 kernel: [41604.627366] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 16:57:10 juju-e4d256-prod-github-runner-207 kernel: [41604.628255] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 16:57:10 juju-e4d256-prod-github-runner-207 kernel: [41604.629157] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 16:57:10 juju-e4d256-prod-github-runner-207 kernel: [41604.630056] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 16:57:10 juju-e4d256-prod-github-runner-207 kernel: [41604.630952] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 16:57:10 juju-e4d256-prod-github-runner-207 kernel: [41604.631844] Aug 22 16:57:38 juju-e4d256-prod-github-runner-207 kernel: [41632.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 38665s! [qemu-system-x86:6715] Aug 22 16:57:38 juju-e4d256-prod-github-runner-207 kernel: [41632.543098] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 16:57:38 juju-e4d256-prod-github-runner-207 kernel: [41632.543169] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 16:57:38 juju-e4d256-prod-github-runner-207 kernel: [41632.555192] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 16:57:38 juju-e4d256-prod-github-runner-207 kernel: [41632.556454] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 16:57:38 juju-e4d256-prod-github-runner-207 kernel: [41632.557680] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:57:38 juju-e4d256-prod-github-runner-207 kernel: [41632.558738] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 16:57:38 juju-e4d256-prod-github-runner-207 kernel: [41632.561285] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 16:57:38 juju-e4d256-prod-github-runner-207 kernel: [41632.562325] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 16:57:38 juju-e4d256-prod-github-runner-207 kernel: [41632.563490] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 16:57:38 juju-e4d256-prod-github-runner-207 kernel: [41632.564659] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 16:57:38 juju-e4d256-prod-github-runner-207 kernel: [41632.565843] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 16:57:38 juju-e4d256-prod-github-runner-207 kernel: [41632.567003] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 16:57:38 juju-e4d256-prod-github-runner-207 kernel: [41632.568163] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 16:57:38 juju-e4d256-prod-github-runner-207 kernel: [41632.569399] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 16:57:38 juju-e4d256-prod-github-runner-207 kernel: [41632.570495] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 16:57:38 juju-e4d256-prod-github-runner-207 kernel: [41632.571689] Call Trace: Aug 22 16:57:38 juju-e4d256-prod-github-runner-207 kernel: [41632.572600] Aug 22 16:57:38 juju-e4d256-prod-github-runner-207 kernel: [41632.573495] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:57:38 juju-e4d256-prod-github-runner-207 kernel: [41632.574532] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:57:38 juju-e4d256-prod-github-runner-207 kernel: [41632.575559] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:57:38 juju-e4d256-prod-github-runner-207 kernel: [41632.576668] ? show_regs.part.0+0x23/0x29 Aug 22 16:57:38 juju-e4d256-prod-github-runner-207 kernel: [41632.577674] ? show_regs.cold+0x8/0xd Aug 22 16:57:38 juju-e4d256-prod-github-runner-207 kernel: [41632.578648] ? watchdog_timer_fn+0x1be/0x220 Aug 22 16:57:38 juju-e4d256-prod-github-runner-207 kernel: [41632.579655] ? lockup_detector_update_enable+0x60/0x60 Aug 22 16:57:38 juju-e4d256-prod-github-runner-207 kernel: [41632.580715] ? __hrtimer_run_queues+0x107/0x230 Aug 22 16:57:38 juju-e4d256-prod-github-runner-207 kernel: [41632.581749] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 16:57:38 juju-e4d256-prod-github-runner-207 kernel: [41632.582770] ? hrtimer_interrupt+0x101/0x220 Aug 22 16:57:38 juju-e4d256-prod-github-runner-207 kernel: [41632.583786] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 16:57:38 juju-e4d256-prod-github-runner-207 kernel: [41632.584860] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 16:57:38 juju-e4d256-prod-github-runner-207 kernel: [41632.585902] Aug 22 16:57:38 juju-e4d256-prod-github-runner-207 kernel: [41632.586753] Aug 22 16:57:38 juju-e4d256-prod-github-runner-207 kernel: [41632.587588] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 16:57:38 juju-e4d256-prod-github-runner-207 kernel: [41632.588619] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:57:38 juju-e4d256-prod-github-runner-207 kernel: [41632.589674] ? _raw_spin_lock+0x22/0x30 Aug 22 16:57:38 juju-e4d256-prod-github-runner-207 kernel: [41632.590623] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:57:38 juju-e4d256-prod-github-runner-207 kernel: [41632.591642] direct_page_fault+0x206/0x310 [kvm] Aug 22 16:57:38 juju-e4d256-prod-github-runner-207 kernel: [41632.592669] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 16:57:38 juju-e4d256-prod-github-runner-207 kernel: [41632.593696] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 16:57:38 juju-e4d256-prod-github-runner-207 kernel: [41632.594701] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 16:57:38 juju-e4d256-prod-github-runner-207 kernel: [41632.595671] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 16:57:38 juju-e4d256-prod-github-runner-207 kernel: [41632.596624] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 16:57:38 juju-e4d256-prod-github-runner-207 kernel: [41632.597611] handle_exit+0x98/0x230 [kvm_amd] Aug 22 16:57:38 juju-e4d256-prod-github-runner-207 kernel: [41632.598521] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 16:57:38 juju-e4d256-prod-github-runner-207 kernel: [41632.599438] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 16:57:38 juju-e4d256-prod-github-runner-207 kernel: [41632.600365] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 16:57:38 juju-e4d256-prod-github-runner-207 kernel: [41632.601294] vcpu_run+0x62/0x2c0 [kvm] Aug 22 16:57:38 juju-e4d256-prod-github-runner-207 kernel: [41632.602106] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 16:57:38 juju-e4d256-prod-github-runner-207 kernel: [41632.602916] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 16:57:38 juju-e4d256-prod-github-runner-207 kernel: [41632.603768] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 16:57:38 juju-e4d256-prod-github-runner-207 kernel: [41632.604564] ? __seccomp_filter+0x4a/0x4a0 Aug 22 16:57:38 juju-e4d256-prod-github-runner-207 kernel: [41632.605311] ? __fget_files+0x86/0xc0 Aug 22 16:57:38 juju-e4d256-prod-github-runner-207 kernel: [41632.606015] __x64_sys_ioctl+0x95/0xd0 Aug 22 16:57:38 juju-e4d256-prod-github-runner-207 kernel: [41632.606708] do_syscall_64+0x5c/0xc0 Aug 22 16:57:38 juju-e4d256-prod-github-runner-207 kernel: [41632.607370] ? do_futex+0x162/0x1f0 Aug 22 16:57:38 juju-e4d256-prod-github-runner-207 kernel: [41632.608016] ? __x64_sys_futex+0x78/0x1e0 Aug 22 16:57:38 juju-e4d256-prod-github-runner-207 kernel: [41632.608689] ? __secure_computing+0xa9/0x120 Aug 22 16:57:38 juju-e4d256-prod-github-runner-207 kernel: [41632.609385] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 16:57:38 juju-e4d256-prod-github-runner-207 kernel: [41632.610143] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:57:38 juju-e4d256-prod-github-runner-207 kernel: [41632.610863] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:57:38 juju-e4d256-prod-github-runner-207 kernel: [41632.611579] ? do_syscall_64+0x69/0xc0 Aug 22 16:57:38 juju-e4d256-prod-github-runner-207 kernel: [41632.612223] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:57:38 juju-e4d256-prod-github-runner-207 kernel: [41632.612934] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:57:38 juju-e4d256-prod-github-runner-207 kernel: [41632.613630] ? do_syscall_64+0x69/0xc0 Aug 22 16:57:38 juju-e4d256-prod-github-runner-207 kernel: [41632.614253] ? do_syscall_64+0x69/0xc0 Aug 22 16:57:38 juju-e4d256-prod-github-runner-207 kernel: [41632.614876] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 16:57:38 juju-e4d256-prod-github-runner-207 kernel: [41632.615580] RIP: 0033:0x7faa5d0edaff Aug 22 16:57:38 juju-e4d256-prod-github-runner-207 kernel: [41632.616205] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 16:57:38 juju-e4d256-prod-github-runner-207 kernel: [41632.618193] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 16:57:38 juju-e4d256-prod-github-runner-207 kernel: [41632.619103] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 16:57:38 juju-e4d256-prod-github-runner-207 kernel: [41632.620005] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 16:57:38 juju-e4d256-prod-github-runner-207 kernel: [41632.620904] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 16:57:38 juju-e4d256-prod-github-runner-207 kernel: [41632.621797] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 16:57:38 juju-e4d256-prod-github-runner-207 kernel: [41632.622684] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 16:57:38 juju-e4d256-prod-github-runner-207 kernel: [41632.623574] Aug 22 16:58:06 juju-e4d256-prod-github-runner-207 kernel: [41660.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 38691s! [qemu-system-x86:6715] Aug 22 16:58:06 juju-e4d256-prod-github-runner-207 kernel: [41660.543094] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 16:58:06 juju-e4d256-prod-github-runner-207 kernel: [41660.543167] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 16:58:06 juju-e4d256-prod-github-runner-207 kernel: [41660.555172] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 16:58:06 juju-e4d256-prod-github-runner-207 kernel: [41660.556435] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 16:58:06 juju-e4d256-prod-github-runner-207 kernel: [41660.557671] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:58:06 juju-e4d256-prod-github-runner-207 kernel: [41660.558730] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 16:58:06 juju-e4d256-prod-github-runner-207 kernel: [41660.561429] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 16:58:06 juju-e4d256-prod-github-runner-207 kernel: [41660.562473] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 16:58:06 juju-e4d256-prod-github-runner-207 kernel: [41660.563636] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 16:58:06 juju-e4d256-prod-github-runner-207 kernel: [41660.564806] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 16:58:06 juju-e4d256-prod-github-runner-207 kernel: [41660.565967] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 16:58:06 juju-e4d256-prod-github-runner-207 kernel: [41660.567136] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 16:58:06 juju-e4d256-prod-github-runner-207 kernel: [41660.568299] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 16:58:06 juju-e4d256-prod-github-runner-207 kernel: [41660.569540] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 16:58:06 juju-e4d256-prod-github-runner-207 kernel: [41660.570640] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 16:58:06 juju-e4d256-prod-github-runner-207 kernel: [41660.571838] Call Trace: Aug 22 16:58:06 juju-e4d256-prod-github-runner-207 kernel: [41660.572760] Aug 22 16:58:06 juju-e4d256-prod-github-runner-207 kernel: [41660.573648] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:58:06 juju-e4d256-prod-github-runner-207 kernel: [41660.574675] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:58:06 juju-e4d256-prod-github-runner-207 kernel: [41660.575697] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:58:06 juju-e4d256-prod-github-runner-207 kernel: [41660.576778] ? show_regs.part.0+0x23/0x29 Aug 22 16:58:06 juju-e4d256-prod-github-runner-207 kernel: [41660.577779] ? show_regs.cold+0x8/0xd Aug 22 16:58:06 juju-e4d256-prod-github-runner-207 kernel: [41660.578752] ? watchdog_timer_fn+0x1be/0x220 Aug 22 16:58:06 juju-e4d256-prod-github-runner-207 kernel: [41660.579762] ? lockup_detector_update_enable+0x60/0x60 Aug 22 16:58:06 juju-e4d256-prod-github-runner-207 kernel: [41660.580829] ? __hrtimer_run_queues+0x107/0x230 Aug 22 16:58:06 juju-e4d256-prod-github-runner-207 kernel: [41660.581855] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 16:58:06 juju-e4d256-prod-github-runner-207 kernel: [41660.582882] ? hrtimer_interrupt+0x101/0x220 Aug 22 16:58:06 juju-e4d256-prod-github-runner-207 kernel: [41660.583899] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 16:58:06 juju-e4d256-prod-github-runner-207 kernel: [41660.584973] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 16:58:06 juju-e4d256-prod-github-runner-207 kernel: [41660.586035] Aug 22 16:58:06 juju-e4d256-prod-github-runner-207 kernel: [41660.586895] Aug 22 16:58:06 juju-e4d256-prod-github-runner-207 kernel: [41660.587749] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 16:58:06 juju-e4d256-prod-github-runner-207 kernel: [41660.588794] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:58:06 juju-e4d256-prod-github-runner-207 kernel: [41660.589882] ? _raw_spin_lock+0x22/0x30 Aug 22 16:58:06 juju-e4d256-prod-github-runner-207 kernel: [41660.590829] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:58:06 juju-e4d256-prod-github-runner-207 kernel: [41660.591844] direct_page_fault+0x206/0x310 [kvm] Aug 22 16:58:06 juju-e4d256-prod-github-runner-207 kernel: [41660.592884] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 16:58:06 juju-e4d256-prod-github-runner-207 kernel: [41660.593897] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 16:58:06 juju-e4d256-prod-github-runner-207 kernel: [41660.594899] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 16:58:06 juju-e4d256-prod-github-runner-207 kernel: [41660.595871] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 16:58:06 juju-e4d256-prod-github-runner-207 kernel: [41660.596853] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 16:58:06 juju-e4d256-prod-github-runner-207 kernel: [41660.597843] handle_exit+0x98/0x230 [kvm_amd] Aug 22 16:58:06 juju-e4d256-prod-github-runner-207 kernel: [41660.598739] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 16:58:06 juju-e4d256-prod-github-runner-207 kernel: [41660.599649] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 16:58:06 juju-e4d256-prod-github-runner-207 kernel: [41660.600590] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 16:58:06 juju-e4d256-prod-github-runner-207 kernel: [41660.601500] vcpu_run+0x62/0x2c0 [kvm] Aug 22 16:58:06 juju-e4d256-prod-github-runner-207 kernel: [41660.602320] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 16:58:06 juju-e4d256-prod-github-runner-207 kernel: [41660.603124] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 16:58:06 juju-e4d256-prod-github-runner-207 kernel: [41660.603973] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 16:58:06 juju-e4d256-prod-github-runner-207 kernel: [41660.604783] ? __seccomp_filter+0x4a/0x4a0 Aug 22 16:58:06 juju-e4d256-prod-github-runner-207 kernel: [41660.605528] ? __fget_files+0x86/0xc0 Aug 22 16:58:06 juju-e4d256-prod-github-runner-207 kernel: [41660.606228] __x64_sys_ioctl+0x95/0xd0 Aug 22 16:58:06 juju-e4d256-prod-github-runner-207 kernel: [41660.606918] do_syscall_64+0x5c/0xc0 Aug 22 16:58:06 juju-e4d256-prod-github-runner-207 kernel: [41660.607577] ? do_futex+0x162/0x1f0 Aug 22 16:58:06 juju-e4d256-prod-github-runner-207 kernel: [41660.608226] ? __x64_sys_futex+0x78/0x1e0 Aug 22 16:58:06 juju-e4d256-prod-github-runner-207 kernel: [41660.608906] ? __secure_computing+0xa9/0x120 Aug 22 16:58:06 juju-e4d256-prod-github-runner-207 kernel: [41660.609610] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 16:58:06 juju-e4d256-prod-github-runner-207 kernel: [41660.610366] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:58:06 juju-e4d256-prod-github-runner-207 kernel: [41660.611088] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:58:06 juju-e4d256-prod-github-runner-207 kernel: [41660.611801] ? do_syscall_64+0x69/0xc0 Aug 22 16:58:06 juju-e4d256-prod-github-runner-207 kernel: [41660.612446] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:58:06 juju-e4d256-prod-github-runner-207 kernel: [41660.613229] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:58:06 juju-e4d256-prod-github-runner-207 kernel: [41660.613935] ? do_syscall_64+0x69/0xc0 Aug 22 16:58:06 juju-e4d256-prod-github-runner-207 kernel: [41660.614558] ? do_syscall_64+0x69/0xc0 Aug 22 16:58:06 juju-e4d256-prod-github-runner-207 kernel: [41660.615182] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 16:58:06 juju-e4d256-prod-github-runner-207 kernel: [41660.615883] RIP: 0033:0x7faa5d0edaff Aug 22 16:58:06 juju-e4d256-prod-github-runner-207 kernel: [41660.616501] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 16:58:06 juju-e4d256-prod-github-runner-207 kernel: [41660.618499] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 16:58:06 juju-e4d256-prod-github-runner-207 kernel: [41660.619441] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 16:58:06 juju-e4d256-prod-github-runner-207 kernel: [41660.620351] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 16:58:06 juju-e4d256-prod-github-runner-207 kernel: [41660.621261] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 16:58:06 juju-e4d256-prod-github-runner-207 kernel: [41660.622144] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 16:58:06 juju-e4d256-prod-github-runner-207 kernel: [41660.623030] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 16:58:06 juju-e4d256-prod-github-runner-207 kernel: [41660.623920] Aug 22 16:58:34 juju-e4d256-prod-github-runner-207 kernel: [41688.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 38717s! [qemu-system-x86:6715] Aug 22 16:58:34 juju-e4d256-prod-github-runner-207 kernel: [41688.543707] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 16:58:34 juju-e4d256-prod-github-runner-207 kernel: [41688.543965] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 16:58:34 juju-e4d256-prod-github-runner-207 kernel: [41688.556051] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 16:58:34 juju-e4d256-prod-github-runner-207 kernel: [41688.557331] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 16:58:34 juju-e4d256-prod-github-runner-207 kernel: [41688.558545] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:58:34 juju-e4d256-prod-github-runner-207 kernel: [41688.559600] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 16:58:34 juju-e4d256-prod-github-runner-207 kernel: [41688.562157] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 16:58:34 juju-e4d256-prod-github-runner-207 kernel: [41688.563201] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 16:58:34 juju-e4d256-prod-github-runner-207 kernel: [41688.564369] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 16:58:34 juju-e4d256-prod-github-runner-207 kernel: [41688.565530] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 16:58:34 juju-e4d256-prod-github-runner-207 kernel: [41688.566692] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 16:58:34 juju-e4d256-prod-github-runner-207 kernel: [41688.567849] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 16:58:34 juju-e4d256-prod-github-runner-207 kernel: [41688.569024] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 16:58:34 juju-e4d256-prod-github-runner-207 kernel: [41688.570257] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 16:58:34 juju-e4d256-prod-github-runner-207 kernel: [41688.571350] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 16:58:34 juju-e4d256-prod-github-runner-207 kernel: [41688.572548] Call Trace: Aug 22 16:58:34 juju-e4d256-prod-github-runner-207 kernel: [41688.573460] Aug 22 16:58:34 juju-e4d256-prod-github-runner-207 kernel: [41688.574350] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:58:34 juju-e4d256-prod-github-runner-207 kernel: [41688.575376] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:58:34 juju-e4d256-prod-github-runner-207 kernel: [41688.576402] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:58:34 juju-e4d256-prod-github-runner-207 kernel: [41688.577486] ? show_regs.part.0+0x23/0x29 Aug 22 16:58:34 juju-e4d256-prod-github-runner-207 kernel: [41688.578480] ? show_regs.cold+0x8/0xd Aug 22 16:58:34 juju-e4d256-prod-github-runner-207 kernel: [41688.579447] ? watchdog_timer_fn+0x1be/0x220 Aug 22 16:58:34 juju-e4d256-prod-github-runner-207 kernel: [41688.580461] ? lockup_detector_update_enable+0x60/0x60 Aug 22 16:58:34 juju-e4d256-prod-github-runner-207 kernel: [41688.581521] ? __hrtimer_run_queues+0x107/0x230 Aug 22 16:58:34 juju-e4d256-prod-github-runner-207 kernel: [41688.582545] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 16:58:34 juju-e4d256-prod-github-runner-207 kernel: [41688.583571] ? hrtimer_interrupt+0x101/0x220 Aug 22 16:58:34 juju-e4d256-prod-github-runner-207 kernel: [41688.584624] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 16:58:34 juju-e4d256-prod-github-runner-207 kernel: [41688.585696] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 16:58:34 juju-e4d256-prod-github-runner-207 kernel: [41688.586736] Aug 22 16:58:34 juju-e4d256-prod-github-runner-207 kernel: [41688.587585] Aug 22 16:58:34 juju-e4d256-prod-github-runner-207 kernel: [41688.588435] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 16:58:34 juju-e4d256-prod-github-runner-207 kernel: [41688.589464] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:58:34 juju-e4d256-prod-github-runner-207 kernel: [41688.590498] ? _raw_spin_lock+0x22/0x30 Aug 22 16:58:34 juju-e4d256-prod-github-runner-207 kernel: [41688.591448] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:58:34 juju-e4d256-prod-github-runner-207 kernel: [41688.592472] direct_page_fault+0x206/0x310 [kvm] Aug 22 16:58:34 juju-e4d256-prod-github-runner-207 kernel: [41688.593492] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 16:58:34 juju-e4d256-prod-github-runner-207 kernel: [41688.594503] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 16:58:34 juju-e4d256-prod-github-runner-207 kernel: [41688.595504] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 16:58:34 juju-e4d256-prod-github-runner-207 kernel: [41688.596657] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 16:58:34 juju-e4d256-prod-github-runner-207 kernel: [41688.597605] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 16:58:34 juju-e4d256-prod-github-runner-207 kernel: [41688.598580] handle_exit+0x98/0x230 [kvm_amd] Aug 22 16:58:34 juju-e4d256-prod-github-runner-207 kernel: [41688.599469] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 16:58:34 juju-e4d256-prod-github-runner-207 kernel: [41688.600397] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 16:58:34 juju-e4d256-prod-github-runner-207 kernel: [41688.601324] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 16:58:34 juju-e4d256-prod-github-runner-207 kernel: [41688.602228] vcpu_run+0x62/0x2c0 [kvm] Aug 22 16:58:34 juju-e4d256-prod-github-runner-207 kernel: [41688.603034] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 16:58:34 juju-e4d256-prod-github-runner-207 kernel: [41688.603839] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 16:58:34 juju-e4d256-prod-github-runner-207 kernel: [41688.604703] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 16:58:34 juju-e4d256-prod-github-runner-207 kernel: [41688.605501] ? __seccomp_filter+0x4a/0x4a0 Aug 22 16:58:34 juju-e4d256-prod-github-runner-207 kernel: [41688.606242] ? __fget_files+0x86/0xc0 Aug 22 16:58:34 juju-e4d256-prod-github-runner-207 kernel: [41688.606941] __x64_sys_ioctl+0x95/0xd0 Aug 22 16:58:34 juju-e4d256-prod-github-runner-207 kernel: [41688.607642] do_syscall_64+0x5c/0xc0 Aug 22 16:58:34 juju-e4d256-prod-github-runner-207 kernel: [41688.608314] ? do_futex+0x162/0x1f0 Aug 22 16:58:34 juju-e4d256-prod-github-runner-207 kernel: [41688.608959] ? __x64_sys_futex+0x78/0x1e0 Aug 22 16:58:34 juju-e4d256-prod-github-runner-207 kernel: [41688.609627] ? __secure_computing+0xa9/0x120 Aug 22 16:58:34 juju-e4d256-prod-github-runner-207 kernel: [41688.610316] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 16:58:34 juju-e4d256-prod-github-runner-207 kernel: [41688.611070] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:58:34 juju-e4d256-prod-github-runner-207 kernel: [41688.611789] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:58:34 juju-e4d256-prod-github-runner-207 kernel: [41688.612510] ? do_syscall_64+0x69/0xc0 Aug 22 16:58:34 juju-e4d256-prod-github-runner-207 kernel: [41688.613152] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:58:34 juju-e4d256-prod-github-runner-207 kernel: [41688.613850] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:58:34 juju-e4d256-prod-github-runner-207 kernel: [41688.614542] ? do_syscall_64+0x69/0xc0 Aug 22 16:58:34 juju-e4d256-prod-github-runner-207 kernel: [41688.615162] ? do_syscall_64+0x69/0xc0 Aug 22 16:58:34 juju-e4d256-prod-github-runner-207 kernel: [41688.615778] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 16:58:34 juju-e4d256-prod-github-runner-207 kernel: [41688.616495] RIP: 0033:0x7faa5d0edaff Aug 22 16:58:34 juju-e4d256-prod-github-runner-207 kernel: [41688.617134] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 16:58:34 juju-e4d256-prod-github-runner-207 kernel: [41688.619112] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 16:58:34 juju-e4d256-prod-github-runner-207 kernel: [41688.620015] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 16:58:34 juju-e4d256-prod-github-runner-207 kernel: [41688.620913] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 16:58:34 juju-e4d256-prod-github-runner-207 kernel: [41688.621798] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 16:58:34 juju-e4d256-prod-github-runner-207 kernel: [41688.622683] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 16:58:34 juju-e4d256-prod-github-runner-207 kernel: [41688.623569] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 16:58:34 juju-e4d256-prod-github-runner-207 kernel: [41688.624466] Aug 22 16:59:02 juju-e4d256-prod-github-runner-207 kernel: [41716.542393] watchdog: BUG: soft lockup - CPU#1 stuck for 38743s! [qemu-system-x86:6715] Aug 22 16:59:02 juju-e4d256-prod-github-runner-207 kernel: [41716.544047] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 16:59:02 juju-e4d256-prod-github-runner-207 kernel: [41716.544117] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 16:59:02 juju-e4d256-prod-github-runner-207 kernel: [41716.568500] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 16:59:02 juju-e4d256-prod-github-runner-207 kernel: [41716.571756] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 16:59:02 juju-e4d256-prod-github-runner-207 kernel: [41716.573440] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:59:02 juju-e4d256-prod-github-runner-207 kernel: [41716.575956] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 16:59:02 juju-e4d256-prod-github-runner-207 kernel: [41716.580911] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 16:59:02 juju-e4d256-prod-github-runner-207 kernel: [41716.583423] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 16:59:02 juju-e4d256-prod-github-runner-207 kernel: [41716.584601] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 16:59:02 juju-e4d256-prod-github-runner-207 kernel: [41716.588004] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 16:59:02 juju-e4d256-prod-github-runner-207 kernel: [41716.589166] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 16:59:02 juju-e4d256-prod-github-runner-207 kernel: [41716.592476] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 16:59:02 juju-e4d256-prod-github-runner-207 kernel: [41716.593656] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 16:59:02 juju-e4d256-prod-github-runner-207 kernel: [41716.597147] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 16:59:02 juju-e4d256-prod-github-runner-207 kernel: [41716.598260] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 16:59:02 juju-e4d256-prod-github-runner-207 kernel: [41716.601486] Call Trace: Aug 22 16:59:02 juju-e4d256-prod-github-runner-207 kernel: [41716.602402] Aug 22 16:59:02 juju-e4d256-prod-github-runner-207 kernel: [41716.603293] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:59:02 juju-e4d256-prod-github-runner-207 kernel: [41716.606416] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:59:02 juju-e4d256-prod-github-runner-207 kernel: [41716.607445] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:59:02 juju-e4d256-prod-github-runner-207 kernel: [41716.610631] ? show_regs.part.0+0x23/0x29 Aug 22 16:59:02 juju-e4d256-prod-github-runner-207 kernel: [41716.611633] ? show_regs.cold+0x8/0xd Aug 22 16:59:02 juju-e4d256-prod-github-runner-207 kernel: [41716.614699] ? watchdog_timer_fn+0x1be/0x220 Aug 22 16:59:02 juju-e4d256-prod-github-runner-207 kernel: [41716.615718] ? lockup_detector_update_enable+0x60/0x60 Aug 22 16:59:02 juju-e4d256-prod-github-runner-207 kernel: [41716.616793] ? __hrtimer_run_queues+0x107/0x230 Aug 22 16:59:02 juju-e4d256-prod-github-runner-207 kernel: [41716.619958] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 16:59:02 juju-e4d256-prod-github-runner-207 kernel: [41716.620985] ? hrtimer_interrupt+0x101/0x220 Aug 22 16:59:02 juju-e4d256-prod-github-runner-207 kernel: [41716.622011] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 16:59:02 juju-e4d256-prod-github-runner-207 kernel: [41716.625245] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 16:59:02 juju-e4d256-prod-github-runner-207 kernel: [41716.626303] Aug 22 16:59:02 juju-e4d256-prod-github-runner-207 kernel: [41716.627156] Aug 22 16:59:02 juju-e4d256-prod-github-runner-207 kernel: [41716.630150] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 16:59:02 juju-e4d256-prod-github-runner-207 kernel: [41716.631187] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:59:02 juju-e4d256-prod-github-runner-207 kernel: [41716.634336] ? _raw_spin_lock+0x22/0x30 Aug 22 16:59:02 juju-e4d256-prod-github-runner-207 kernel: [41716.635292] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:59:02 juju-e4d256-prod-github-runner-207 kernel: [41716.636320] direct_page_fault+0x206/0x310 [kvm] Aug 22 16:59:02 juju-e4d256-prod-github-runner-207 kernel: [41716.639429] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 16:59:02 juju-e4d256-prod-github-runner-207 kernel: [41716.640452] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 16:59:02 juju-e4d256-prod-github-runner-207 kernel: [41716.643470] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 16:59:02 juju-e4d256-prod-github-runner-207 kernel: [41716.644461] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 16:59:02 juju-e4d256-prod-github-runner-207 kernel: [41716.646669] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 16:59:02 juju-e4d256-prod-github-runner-207 kernel: [41716.648652] handle_exit+0x98/0x230 [kvm_amd] Aug 22 16:59:02 juju-e4d256-prod-github-runner-207 kernel: [41716.649548] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 16:59:02 juju-e4d256-prod-github-runner-207 kernel: [41716.652628] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 16:59:02 juju-e4d256-prod-github-runner-207 kernel: [41716.653567] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 16:59:02 juju-e4d256-prod-github-runner-207 kernel: [41716.656230] vcpu_run+0x62/0x2c0 [kvm] Aug 22 16:59:02 juju-e4d256-prod-github-runner-207 kernel: [41716.657552] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 16:59:02 juju-e4d256-prod-github-runner-207 kernel: [41716.658366] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 16:59:02 juju-e4d256-prod-github-runner-207 kernel: [41716.659717] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 16:59:02 juju-e4d256-prod-github-runner-207 kernel: [41716.662053] ? __seccomp_filter+0x4a/0x4a0 Aug 22 16:59:02 juju-e4d256-prod-github-runner-207 kernel: [41716.662804] ? __fget_files+0x86/0xc0 Aug 22 16:59:02 juju-e4d256-prod-github-runner-207 kernel: [41716.665072] __x64_sys_ioctl+0x95/0xd0 Aug 22 16:59:02 juju-e4d256-prod-github-runner-207 kernel: [41716.666335] do_syscall_64+0x5c/0xc0 Aug 22 16:59:02 juju-e4d256-prod-github-runner-207 kernel: [41716.667004] ? do_futex+0x162/0x1f0 Aug 22 16:59:02 juju-e4d256-prod-github-runner-207 kernel: [41716.668670] ? __x64_sys_futex+0x78/0x1e0 Aug 22 16:59:02 juju-e4d256-prod-github-runner-207 kernel: [41716.670422] ? __secure_computing+0xa9/0x120 Aug 22 16:59:02 juju-e4d256-prod-github-runner-207 kernel: [41716.671112] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 16:59:02 juju-e4d256-prod-github-runner-207 kernel: [41716.673530] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:59:02 juju-e4d256-prod-github-runner-207 kernel: [41716.674746] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:59:02 juju-e4d256-prod-github-runner-207 kernel: [41716.675481] ? do_syscall_64+0x69/0xc0 Aug 22 16:59:02 juju-e4d256-prod-github-runner-207 kernel: [41716.676153] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:59:02 juju-e4d256-prod-github-runner-207 kernel: [41716.676862] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:59:02 juju-e4d256-prod-github-runner-207 kernel: [41716.677558] ? do_syscall_64+0x69/0xc0 Aug 22 16:59:02 juju-e4d256-prod-github-runner-207 kernel: [41716.678183] ? do_syscall_64+0x69/0xc0 Aug 22 16:59:02 juju-e4d256-prod-github-runner-207 kernel: [41716.678813] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 16:59:02 juju-e4d256-prod-github-runner-207 kernel: [41716.679517] RIP: 0033:0x7faa5d0edaff Aug 22 16:59:02 juju-e4d256-prod-github-runner-207 kernel: [41716.680148] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 16:59:02 juju-e4d256-prod-github-runner-207 kernel: [41716.682150] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 16:59:02 juju-e4d256-prod-github-runner-207 kernel: [41716.683065] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 16:59:02 juju-e4d256-prod-github-runner-207 kernel: [41716.683965] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 16:59:02 juju-e4d256-prod-github-runner-207 kernel: [41716.684860] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 16:59:02 juju-e4d256-prod-github-runner-207 kernel: [41716.685754] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 16:59:02 juju-e4d256-prod-github-runner-207 kernel: [41716.686648] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 16:59:02 juju-e4d256-prod-github-runner-207 kernel: [41716.687540] Aug 22 16:59:30 juju-e4d256-prod-github-runner-207 kernel: [41744.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 38769s! [qemu-system-x86:6715] Aug 22 16:59:30 juju-e4d256-prod-github-runner-207 kernel: [41744.543153] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 16:59:30 juju-e4d256-prod-github-runner-207 kernel: [41744.543222] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 16:59:30 juju-e4d256-prod-github-runner-207 kernel: [41744.555274] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 16:59:30 juju-e4d256-prod-github-runner-207 kernel: [41744.556564] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 16:59:30 juju-e4d256-prod-github-runner-207 kernel: [41744.557785] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:59:30 juju-e4d256-prod-github-runner-207 kernel: [41744.558844] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 16:59:30 juju-e4d256-prod-github-runner-207 kernel: [41744.561394] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 16:59:30 juju-e4d256-prod-github-runner-207 kernel: [41744.562439] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 16:59:30 juju-e4d256-prod-github-runner-207 kernel: [41744.563614] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 16:59:30 juju-e4d256-prod-github-runner-207 kernel: [41744.564778] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 16:59:30 juju-e4d256-prod-github-runner-207 kernel: [41744.565941] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 16:59:30 juju-e4d256-prod-github-runner-207 kernel: [41744.567100] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 16:59:30 juju-e4d256-prod-github-runner-207 kernel: [41744.568278] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 16:59:30 juju-e4d256-prod-github-runner-207 kernel: [41744.569508] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 16:59:30 juju-e4d256-prod-github-runner-207 kernel: [41744.570606] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 16:59:30 juju-e4d256-prod-github-runner-207 kernel: [41744.571800] Call Trace: Aug 22 16:59:30 juju-e4d256-prod-github-runner-207 kernel: [41744.572711] Aug 22 16:59:30 juju-e4d256-prod-github-runner-207 kernel: [41744.573593] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:59:30 juju-e4d256-prod-github-runner-207 kernel: [41744.574623] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 16:59:30 juju-e4d256-prod-github-runner-207 kernel: [41744.575647] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:59:30 juju-e4d256-prod-github-runner-207 kernel: [41744.576720] ? show_regs.part.0+0x23/0x29 Aug 22 16:59:30 juju-e4d256-prod-github-runner-207 kernel: [41744.577715] ? show_regs.cold+0x8/0xd Aug 22 16:59:30 juju-e4d256-prod-github-runner-207 kernel: [41744.578712] ? watchdog_timer_fn+0x1be/0x220 Aug 22 16:59:30 juju-e4d256-prod-github-runner-207 kernel: [41744.579738] ? lockup_detector_update_enable+0x60/0x60 Aug 22 16:59:30 juju-e4d256-prod-github-runner-207 kernel: [41744.580800] ? __hrtimer_run_queues+0x107/0x230 Aug 22 16:59:30 juju-e4d256-prod-github-runner-207 kernel: [41744.581828] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 16:59:30 juju-e4d256-prod-github-runner-207 kernel: [41744.583045] ? hrtimer_interrupt+0x101/0x220 Aug 22 16:59:30 juju-e4d256-prod-github-runner-207 kernel: [41744.584074] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 16:59:30 juju-e4d256-prod-github-runner-207 kernel: [41744.585142] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 16:59:30 juju-e4d256-prod-github-runner-207 kernel: [41744.586192] Aug 22 16:59:30 juju-e4d256-prod-github-runner-207 kernel: [41744.587042] Aug 22 16:59:30 juju-e4d256-prod-github-runner-207 kernel: [41744.587889] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 16:59:30 juju-e4d256-prod-github-runner-207 kernel: [41744.588925] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:59:30 juju-e4d256-prod-github-runner-207 kernel: [41744.589966] ? _raw_spin_lock+0x22/0x30 Aug 22 16:59:30 juju-e4d256-prod-github-runner-207 kernel: [41744.590913] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:59:30 juju-e4d256-prod-github-runner-207 kernel: [41744.591932] direct_page_fault+0x206/0x310 [kvm] Aug 22 16:59:30 juju-e4d256-prod-github-runner-207 kernel: [41744.592960] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 16:59:30 juju-e4d256-prod-github-runner-207 kernel: [41744.593966] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 16:59:30 juju-e4d256-prod-github-runner-207 kernel: [41744.594963] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 16:59:30 juju-e4d256-prod-github-runner-207 kernel: [41744.595945] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 16:59:30 juju-e4d256-prod-github-runner-207 kernel: [41744.596887] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 16:59:30 juju-e4d256-prod-github-runner-207 kernel: [41744.597866] handle_exit+0x98/0x230 [kvm_amd] Aug 22 16:59:30 juju-e4d256-prod-github-runner-207 kernel: [41744.598756] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 16:59:30 juju-e4d256-prod-github-runner-207 kernel: [41744.599679] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 16:59:30 juju-e4d256-prod-github-runner-207 kernel: [41744.600598] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 16:59:30 juju-e4d256-prod-github-runner-207 kernel: [41744.601499] vcpu_run+0x62/0x2c0 [kvm] Aug 22 16:59:30 juju-e4d256-prod-github-runner-207 kernel: [41744.602307] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 16:59:30 juju-e4d256-prod-github-runner-207 kernel: [41744.603113] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 16:59:30 juju-e4d256-prod-github-runner-207 kernel: [41744.603971] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 16:59:30 juju-e4d256-prod-github-runner-207 kernel: [41744.604764] ? __seccomp_filter+0x4a/0x4a0 Aug 22 16:59:30 juju-e4d256-prod-github-runner-207 kernel: [41744.605507] ? __fget_files+0x86/0xc0 Aug 22 16:59:30 juju-e4d256-prod-github-runner-207 kernel: [41744.606207] __x64_sys_ioctl+0x95/0xd0 Aug 22 16:59:30 juju-e4d256-prod-github-runner-207 kernel: [41744.606895] do_syscall_64+0x5c/0xc0 Aug 22 16:59:30 juju-e4d256-prod-github-runner-207 kernel: [41744.607562] ? do_futex+0x162/0x1f0 Aug 22 16:59:30 juju-e4d256-prod-github-runner-207 kernel: [41744.608229] ? __x64_sys_futex+0x78/0x1e0 Aug 22 16:59:30 juju-e4d256-prod-github-runner-207 kernel: [41744.608902] ? __secure_computing+0xa9/0x120 Aug 22 16:59:30 juju-e4d256-prod-github-runner-207 kernel: [41744.609588] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 16:59:30 juju-e4d256-prod-github-runner-207 kernel: [41744.610349] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:59:30 juju-e4d256-prod-github-runner-207 kernel: [41744.611072] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:59:30 juju-e4d256-prod-github-runner-207 kernel: [41744.611795] ? do_syscall_64+0x69/0xc0 Aug 22 16:59:30 juju-e4d256-prod-github-runner-207 kernel: [41744.612439] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:59:30 juju-e4d256-prod-github-runner-207 kernel: [41744.613145] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:59:30 juju-e4d256-prod-github-runner-207 kernel: [41744.613841] ? do_syscall_64+0x69/0xc0 Aug 22 16:59:30 juju-e4d256-prod-github-runner-207 kernel: [41744.614469] ? do_syscall_64+0x69/0xc0 Aug 22 16:59:30 juju-e4d256-prod-github-runner-207 kernel: [41744.615088] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 16:59:30 juju-e4d256-prod-github-runner-207 kernel: [41744.615796] RIP: 0033:0x7faa5d0edaff Aug 22 16:59:30 juju-e4d256-prod-github-runner-207 kernel: [41744.616441] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 16:59:30 juju-e4d256-prod-github-runner-207 kernel: [41744.618770] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 16:59:30 juju-e4d256-prod-github-runner-207 kernel: [41744.619720] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 16:59:30 juju-e4d256-prod-github-runner-207 kernel: [41744.620624] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 16:59:30 juju-e4d256-prod-github-runner-207 kernel: [41744.621508] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 16:59:30 juju-e4d256-prod-github-runner-207 kernel: [41744.622391] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 16:59:30 juju-e4d256-prod-github-runner-207 kernel: [41744.623325] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 16:59:30 juju-e4d256-prod-github-runner-207 kernel: [41744.624238] Aug 22 16:59:46 juju-e4d256-prod-github-runner-207 kernel: [41759.972706] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 16:59:46 juju-e4d256-prod-github-runner-207 kernel: [41759.973671] rcu: 1-....: (10378035 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=5021167 Aug 22 16:59:46 juju-e4d256-prod-github-runner-207 kernel: [41759.974804] (t=10410693 jiffies g=23269 q=42024) Aug 22 16:59:46 juju-e4d256-prod-github-runner-207 kernel: [41759.975609] NMI backtrace for cpu 1 Aug 22 16:59:46 juju-e4d256-prod-github-runner-207 kernel: [41759.976320] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 16:59:46 juju-e4d256-prod-github-runner-207 kernel: [41759.977432] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 16:59:46 juju-e4d256-prod-github-runner-207 kernel: [41759.978501] Call Trace: Aug 22 16:59:46 juju-e4d256-prod-github-runner-207 kernel: [41759.979180] Aug 22 16:59:46 juju-e4d256-prod-github-runner-207 kernel: [41759.979839] show_stack+0x52/0x5c Aug 22 16:59:46 juju-e4d256-prod-github-runner-207 kernel: [41759.980572] dump_stack_lvl+0x4a/0x63 Aug 22 16:59:46 juju-e4d256-prod-github-runner-207 kernel: [41759.981324] dump_stack+0x10/0x16 Aug 22 16:59:46 juju-e4d256-prod-github-runner-207 kernel: [41759.982047] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 16:59:46 juju-e4d256-prod-github-runner-207 kernel: [41759.982829] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 16:59:46 juju-e4d256-prod-github-runner-207 kernel: [41759.983629] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 16:59:46 juju-e4d256-prod-github-runner-207 kernel: [41759.984455] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 16:59:46 juju-e4d256-prod-github-runner-207 kernel: [41759.985280] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 16:59:46 juju-e4d256-prod-github-runner-207 kernel: [41759.986097] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 16:59:46 juju-e4d256-prod-github-runner-207 kernel: [41759.986871] print_cpu_stall.cold+0x2f/0xe2 Aug 22 16:59:46 juju-e4d256-prod-github-runner-207 kernel: [41759.987663] ? timekeeping_update+0xf7/0x150 Aug 22 16:59:46 juju-e4d256-prod-github-runner-207 kernel: [41759.988444] check_cpu_stall+0x109/0x270 Aug 22 16:59:46 juju-e4d256-prod-github-runner-207 kernel: [41759.989192] rcu_sched_clock_irq+0x9a/0x250 Aug 22 16:59:46 juju-e4d256-prod-github-runner-207 kernel: [41759.989959] update_process_times+0x94/0xd0 Aug 22 16:59:46 juju-e4d256-prod-github-runner-207 kernel: [41759.990721] tick_sched_handle+0x29/0x70 Aug 22 16:59:46 juju-e4d256-prod-github-runner-207 kernel: [41759.991483] tick_sched_timer+0x8c/0xc0 Aug 22 16:59:46 juju-e4d256-prod-github-runner-207 kernel: [41759.992226] ? tick_nohz_handler+0xb0/0xb0 Aug 22 16:59:46 juju-e4d256-prod-github-runner-207 kernel: [41759.992981] __hrtimer_run_queues+0x107/0x230 Aug 22 16:59:46 juju-e4d256-prod-github-runner-207 kernel: [41759.993763] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 16:59:46 juju-e4d256-prod-github-runner-207 kernel: [41759.994539] hrtimer_interrupt+0x101/0x220 Aug 22 16:59:46 juju-e4d256-prod-github-runner-207 kernel: [41759.995298] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 16:59:46 juju-e4d256-prod-github-runner-207 kernel: [41759.996121] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 16:59:46 juju-e4d256-prod-github-runner-207 kernel: [41759.996923] Aug 22 16:59:46 juju-e4d256-prod-github-runner-207 kernel: [41759.997558] Aug 22 16:59:46 juju-e4d256-prod-github-runner-207 kernel: [41759.998187] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 16:59:46 juju-e4d256-prod-github-runner-207 kernel: [41759.999016] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 16:59:46 juju-e4d256-prod-github-runner-207 kernel: [41759.999909] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 16:59:46 juju-e4d256-prod-github-runner-207 kernel: [41760.002139] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 16:59:46 juju-e4d256-prod-github-runner-207 kernel: [41760.003020] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 16:59:46 juju-e4d256-prod-github-runner-207 kernel: [41760.004043] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 16:59:46 juju-e4d256-prod-github-runner-207 kernel: [41760.005026] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 16:59:46 juju-e4d256-prod-github-runner-207 kernel: [41760.005991] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 16:59:46 juju-e4d256-prod-github-runner-207 kernel: [41760.006953] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 16:59:46 juju-e4d256-prod-github-runner-207 kernel: [41760.007931] ? _raw_spin_lock+0x22/0x30 Aug 22 16:59:46 juju-e4d256-prod-github-runner-207 kernel: [41760.008689] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 16:59:46 juju-e4d256-prod-github-runner-207 kernel: [41760.009525] direct_page_fault+0x206/0x310 [kvm] Aug 22 16:59:46 juju-e4d256-prod-github-runner-207 kernel: [41760.010363] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 16:59:46 juju-e4d256-prod-github-runner-207 kernel: [41760.011197] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 16:59:46 juju-e4d256-prod-github-runner-207 kernel: [41760.012032] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 16:59:46 juju-e4d256-prod-github-runner-207 kernel: [41760.012834] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 16:59:46 juju-e4d256-prod-github-runner-207 kernel: [41760.013624] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 16:59:46 juju-e4d256-prod-github-runner-207 kernel: [41760.014460] handle_exit+0x98/0x230 [kvm_amd] Aug 22 16:59:46 juju-e4d256-prod-github-runner-207 kernel: [41760.015218] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 16:59:46 juju-e4d256-prod-github-runner-207 kernel: [41760.016013] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 16:59:46 juju-e4d256-prod-github-runner-207 kernel: [41760.016810] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 16:59:46 juju-e4d256-prod-github-runner-207 kernel: [41760.017600] vcpu_run+0x62/0x2c0 [kvm] Aug 22 16:59:46 juju-e4d256-prod-github-runner-207 kernel: [41760.018323] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 16:59:46 juju-e4d256-prod-github-runner-207 kernel: [41760.019059] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 16:59:46 juju-e4d256-prod-github-runner-207 kernel: [41760.019867] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 16:59:46 juju-e4d256-prod-github-runner-207 kernel: [41760.020626] ? __seccomp_filter+0x4a/0x4a0 Aug 22 16:59:46 juju-e4d256-prod-github-runner-207 kernel: [41760.021352] ? __fget_files+0x86/0xc0 Aug 22 16:59:46 juju-e4d256-prod-github-runner-207 kernel: [41760.022048] __x64_sys_ioctl+0x95/0xd0 Aug 22 16:59:46 juju-e4d256-prod-github-runner-207 kernel: [41760.022742] do_syscall_64+0x5c/0xc0 Aug 22 16:59:46 juju-e4d256-prod-github-runner-207 kernel: [41760.023440] ? do_futex+0x162/0x1f0 Aug 22 16:59:46 juju-e4d256-prod-github-runner-207 kernel: [41760.024113] ? __x64_sys_futex+0x78/0x1e0 Aug 22 16:59:46 juju-e4d256-prod-github-runner-207 kernel: [41760.024816] ? __secure_computing+0xa9/0x120 Aug 22 16:59:46 juju-e4d256-prod-github-runner-207 kernel: [41760.025532] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 16:59:46 juju-e4d256-prod-github-runner-207 kernel: [41760.026321] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:59:46 juju-e4d256-prod-github-runner-207 kernel: [41760.027075] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:59:46 juju-e4d256-prod-github-runner-207 kernel: [41760.027839] ? do_syscall_64+0x69/0xc0 Aug 22 16:59:46 juju-e4d256-prod-github-runner-207 kernel: [41760.028528] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 16:59:46 juju-e4d256-prod-github-runner-207 kernel: [41760.029283] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 16:59:46 juju-e4d256-prod-github-runner-207 kernel: [41760.030044] ? do_syscall_64+0x69/0xc0 Aug 22 16:59:46 juju-e4d256-prod-github-runner-207 kernel: [41760.030738] ? do_syscall_64+0x69/0xc0 Aug 22 16:59:46 juju-e4d256-prod-github-runner-207 kernel: [41760.031440] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 16:59:46 juju-e4d256-prod-github-runner-207 kernel: [41760.032217] RIP: 0033:0x7faa5d0edaff Aug 22 16:59:46 juju-e4d256-prod-github-runner-207 kernel: [41760.032899] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 16:59:46 juju-e4d256-prod-github-runner-207 kernel: [41760.035015] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 16:59:46 juju-e4d256-prod-github-runner-207 kernel: [41760.035990] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 16:59:46 juju-e4d256-prod-github-runner-207 kernel: [41760.036936] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 16:59:46 juju-e4d256-prod-github-runner-207 kernel: [41760.037879] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 16:59:46 juju-e4d256-prod-github-runner-207 kernel: [41760.038818] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 16:59:46 juju-e4d256-prod-github-runner-207 kernel: [41760.039781] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 16:59:46 juju-e4d256-prod-github-runner-207 kernel: [41760.040700] Aug 22 17:00:10 juju-e4d256-prod-github-runner-207 kernel: [41784.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 38806s! [qemu-system-x86:6715] Aug 22 17:00:10 juju-e4d256-prod-github-runner-207 kernel: [41784.543749] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 17:00:10 juju-e4d256-prod-github-runner-207 kernel: [41784.543995] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 17:00:10 juju-e4d256-prod-github-runner-207 kernel: [41784.557103] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 17:00:10 juju-e4d256-prod-github-runner-207 kernel: [41784.558373] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 17:00:10 juju-e4d256-prod-github-runner-207 kernel: [41784.559602] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:00:10 juju-e4d256-prod-github-runner-207 kernel: [41784.560657] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 17:00:10 juju-e4d256-prod-github-runner-207 kernel: [41784.563217] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 17:00:10 juju-e4d256-prod-github-runner-207 kernel: [41784.564263] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 17:00:10 juju-e4d256-prod-github-runner-207 kernel: [41784.565422] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 17:00:10 juju-e4d256-prod-github-runner-207 kernel: [41784.566579] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 17:00:10 juju-e4d256-prod-github-runner-207 kernel: [41784.567753] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 17:00:10 juju-e4d256-prod-github-runner-207 kernel: [41784.568913] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 17:00:10 juju-e4d256-prod-github-runner-207 kernel: [41784.570079] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 17:00:10 juju-e4d256-prod-github-runner-207 kernel: [41784.571322] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 17:00:10 juju-e4d256-prod-github-runner-207 kernel: [41784.572422] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 17:00:10 juju-e4d256-prod-github-runner-207 kernel: [41784.573613] Call Trace: Aug 22 17:00:10 juju-e4d256-prod-github-runner-207 kernel: [41784.574528] Aug 22 17:00:10 juju-e4d256-prod-github-runner-207 kernel: [41784.575423] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:00:10 juju-e4d256-prod-github-runner-207 kernel: [41784.576451] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:00:10 juju-e4d256-prod-github-runner-207 kernel: [41784.577470] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:00:10 juju-e4d256-prod-github-runner-207 kernel: [41784.578556] ? show_regs.part.0+0x23/0x29 Aug 22 17:00:10 juju-e4d256-prod-github-runner-207 kernel: [41784.579580] ? show_regs.cold+0x8/0xd Aug 22 17:00:10 juju-e4d256-prod-github-runner-207 kernel: [41784.580552] ? watchdog_timer_fn+0x1be/0x220 Aug 22 17:00:10 juju-e4d256-prod-github-runner-207 kernel: [41784.581559] ? lockup_detector_update_enable+0x60/0x60 Aug 22 17:00:10 juju-e4d256-prod-github-runner-207 kernel: [41784.582621] ? __hrtimer_run_queues+0x107/0x230 Aug 22 17:00:10 juju-e4d256-prod-github-runner-207 kernel: [41784.583665] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 17:00:10 juju-e4d256-prod-github-runner-207 kernel: [41784.584686] ? hrtimer_interrupt+0x101/0x220 Aug 22 17:00:10 juju-e4d256-prod-github-runner-207 kernel: [41784.585698] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 17:00:10 juju-e4d256-prod-github-runner-207 kernel: [41784.586769] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 17:00:10 juju-e4d256-prod-github-runner-207 kernel: [41784.587848] Aug 22 17:00:10 juju-e4d256-prod-github-runner-207 kernel: [41784.588709] Aug 22 17:00:10 juju-e4d256-prod-github-runner-207 kernel: [41784.589549] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 17:00:10 juju-e4d256-prod-github-runner-207 kernel: [41784.590577] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:00:10 juju-e4d256-prod-github-runner-207 kernel: [41784.591635] ? _raw_spin_lock+0x22/0x30 Aug 22 17:00:10 juju-e4d256-prod-github-runner-207 kernel: [41784.592584] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:00:10 juju-e4d256-prod-github-runner-207 kernel: [41784.593597] direct_page_fault+0x206/0x310 [kvm] Aug 22 17:00:10 juju-e4d256-prod-github-runner-207 kernel: [41784.594616] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 17:00:10 juju-e4d256-prod-github-runner-207 kernel: [41784.595638] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 17:00:10 juju-e4d256-prod-github-runner-207 kernel: [41784.596670] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 17:00:10 juju-e4d256-prod-github-runner-207 kernel: [41784.597672] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 17:00:10 juju-e4d256-prod-github-runner-207 kernel: [41784.598617] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 17:00:10 juju-e4d256-prod-github-runner-207 kernel: [41784.599608] handle_exit+0x98/0x230 [kvm_amd] Aug 22 17:00:10 juju-e4d256-prod-github-runner-207 kernel: [41784.600505] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 17:00:10 juju-e4d256-prod-github-runner-207 kernel: [41784.601417] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 17:00:10 juju-e4d256-prod-github-runner-207 kernel: [41784.602344] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 17:00:10 juju-e4d256-prod-github-runner-207 kernel: [41784.603255] vcpu_run+0x62/0x2c0 [kvm] Aug 22 17:00:10 juju-e4d256-prod-github-runner-207 kernel: [41784.604065] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 17:00:10 juju-e4d256-prod-github-runner-207 kernel: [41784.604874] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 17:00:10 juju-e4d256-prod-github-runner-207 kernel: [41784.605730] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 17:00:10 juju-e4d256-prod-github-runner-207 kernel: [41784.606528] ? __seccomp_filter+0x4a/0x4a0 Aug 22 17:00:10 juju-e4d256-prod-github-runner-207 kernel: [41784.607287] ? __fget_files+0x86/0xc0 Aug 22 17:00:10 juju-e4d256-prod-github-runner-207 kernel: [41784.607989] __x64_sys_ioctl+0x95/0xd0 Aug 22 17:00:10 juju-e4d256-prod-github-runner-207 kernel: [41784.608690] do_syscall_64+0x5c/0xc0 Aug 22 17:00:10 juju-e4d256-prod-github-runner-207 kernel: [41784.609373] ? do_futex+0x162/0x1f0 Aug 22 17:00:10 juju-e4d256-prod-github-runner-207 kernel: [41784.610026] ? __x64_sys_futex+0x78/0x1e0 Aug 22 17:00:10 juju-e4d256-prod-github-runner-207 kernel: [41784.610696] ? __secure_computing+0xa9/0x120 Aug 22 17:00:10 juju-e4d256-prod-github-runner-207 kernel: [41784.611413] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 17:00:10 juju-e4d256-prod-github-runner-207 kernel: [41784.612179] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:00:10 juju-e4d256-prod-github-runner-207 kernel: [41784.612899] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:00:10 juju-e4d256-prod-github-runner-207 kernel: [41784.613615] ? do_syscall_64+0x69/0xc0 Aug 22 17:00:10 juju-e4d256-prod-github-runner-207 kernel: [41784.614257] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:00:10 juju-e4d256-prod-github-runner-207 kernel: [41784.614956] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:00:10 juju-e4d256-prod-github-runner-207 kernel: [41784.615660] ? do_syscall_64+0x69/0xc0 Aug 22 17:00:10 juju-e4d256-prod-github-runner-207 kernel: [41784.616282] ? do_syscall_64+0x69/0xc0 Aug 22 17:00:10 juju-e4d256-prod-github-runner-207 kernel: [41784.616901] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 17:00:10 juju-e4d256-prod-github-runner-207 kernel: [41784.617603] RIP: 0033:0x7faa5d0edaff Aug 22 17:00:10 juju-e4d256-prod-github-runner-207 kernel: [41784.618358] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 17:00:10 juju-e4d256-prod-github-runner-207 kernel: [41784.621111] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 17:00:10 juju-e4d256-prod-github-runner-207 kernel: [41784.622154] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 17:00:10 juju-e4d256-prod-github-runner-207 kernel: [41784.623041] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 17:00:10 juju-e4d256-prod-github-runner-207 kernel: [41784.623947] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 17:00:10 juju-e4d256-prod-github-runner-207 kernel: [41784.624832] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 17:00:10 juju-e4d256-prod-github-runner-207 kernel: [41784.625722] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 17:00:10 juju-e4d256-prod-github-runner-207 kernel: [41784.626649] Aug 22 17:00:38 juju-e4d256-prod-github-runner-207 kernel: [41812.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 38832s! [qemu-system-x86:6715] Aug 22 17:00:38 juju-e4d256-prod-github-runner-207 kernel: [41812.543107] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 17:00:38 juju-e4d256-prod-github-runner-207 kernel: [41812.543174] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 17:00:38 juju-e4d256-prod-github-runner-207 kernel: [41812.555242] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 17:00:38 juju-e4d256-prod-github-runner-207 kernel: [41812.556514] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 17:00:38 juju-e4d256-prod-github-runner-207 kernel: [41812.557739] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:00:38 juju-e4d256-prod-github-runner-207 kernel: [41812.558815] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 17:00:38 juju-e4d256-prod-github-runner-207 kernel: [41812.561353] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 17:00:38 juju-e4d256-prod-github-runner-207 kernel: [41812.562397] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 17:00:38 juju-e4d256-prod-github-runner-207 kernel: [41812.563573] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 17:00:38 juju-e4d256-prod-github-runner-207 kernel: [41812.564736] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 17:00:38 juju-e4d256-prod-github-runner-207 kernel: [41812.565896] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 17:00:38 juju-e4d256-prod-github-runner-207 kernel: [41812.567076] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 17:00:38 juju-e4d256-prod-github-runner-207 kernel: [41812.568239] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 17:00:38 juju-e4d256-prod-github-runner-207 kernel: [41812.569480] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 17:00:38 juju-e4d256-prod-github-runner-207 kernel: [41812.570581] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 17:00:38 juju-e4d256-prod-github-runner-207 kernel: [41812.571789] Call Trace: Aug 22 17:00:38 juju-e4d256-prod-github-runner-207 kernel: [41812.572706] Aug 22 17:00:38 juju-e4d256-prod-github-runner-207 kernel: [41812.573615] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:00:38 juju-e4d256-prod-github-runner-207 kernel: [41812.574674] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:00:38 juju-e4d256-prod-github-runner-207 kernel: [41812.575766] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:00:38 juju-e4d256-prod-github-runner-207 kernel: [41812.576861] ? show_regs.part.0+0x23/0x29 Aug 22 17:00:38 juju-e4d256-prod-github-runner-207 kernel: [41812.577881] ? show_regs.cold+0x8/0xd Aug 22 17:00:38 juju-e4d256-prod-github-runner-207 kernel: [41812.578974] ? watchdog_timer_fn+0x1be/0x220 Aug 22 17:00:38 juju-e4d256-prod-github-runner-207 kernel: [41812.580008] ? lockup_detector_update_enable+0x60/0x60 Aug 22 17:00:38 juju-e4d256-prod-github-runner-207 kernel: [41812.581094] ? __hrtimer_run_queues+0x107/0x230 Aug 22 17:00:38 juju-e4d256-prod-github-runner-207 kernel: [41812.582136] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 17:00:38 juju-e4d256-prod-github-runner-207 kernel: [41812.583204] ? hrtimer_interrupt+0x101/0x220 Aug 22 17:00:38 juju-e4d256-prod-github-runner-207 kernel: [41812.584237] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 17:00:38 juju-e4d256-prod-github-runner-207 kernel: [41812.585317] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 17:00:38 juju-e4d256-prod-github-runner-207 kernel: [41812.586386] Aug 22 17:00:38 juju-e4d256-prod-github-runner-207 kernel: [41812.587260] Aug 22 17:00:38 juju-e4d256-prod-github-runner-207 kernel: [41812.588113] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 17:00:38 juju-e4d256-prod-github-runner-207 kernel: [41812.589161] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:00:38 juju-e4d256-prod-github-runner-207 kernel: [41812.590217] ? _raw_spin_lock+0x22/0x30 Aug 22 17:00:38 juju-e4d256-prod-github-runner-207 kernel: [41812.591192] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:00:38 juju-e4d256-prod-github-runner-207 kernel: [41812.592227] direct_page_fault+0x206/0x310 [kvm] Aug 22 17:00:38 juju-e4d256-prod-github-runner-207 kernel: [41812.593268] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 17:00:38 juju-e4d256-prod-github-runner-207 kernel: [41812.594287] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 17:00:38 juju-e4d256-prod-github-runner-207 kernel: [41812.595313] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 17:00:38 juju-e4d256-prod-github-runner-207 kernel: [41812.596294] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 17:00:38 juju-e4d256-prod-github-runner-207 kernel: [41812.597250] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 17:00:38 juju-e4d256-prod-github-runner-207 kernel: [41812.598243] handle_exit+0x98/0x230 [kvm_amd] Aug 22 17:00:38 juju-e4d256-prod-github-runner-207 kernel: [41812.599170] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 17:00:38 juju-e4d256-prod-github-runner-207 kernel: [41812.600086] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 17:00:38 juju-e4d256-prod-github-runner-207 kernel: [41812.601016] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 17:00:38 juju-e4d256-prod-github-runner-207 kernel: [41812.601928] vcpu_run+0x62/0x2c0 [kvm] Aug 22 17:00:38 juju-e4d256-prod-github-runner-207 kernel: [41812.602765] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 17:00:38 juju-e4d256-prod-github-runner-207 kernel: [41812.603574] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 17:00:38 juju-e4d256-prod-github-runner-207 kernel: [41812.604428] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 17:00:38 juju-e4d256-prod-github-runner-207 kernel: [41812.605228] ? __seccomp_filter+0x4a/0x4a0 Aug 22 17:00:38 juju-e4d256-prod-github-runner-207 kernel: [41812.605975] ? __fget_files+0x86/0xc0 Aug 22 17:00:38 juju-e4d256-prod-github-runner-207 kernel: [41812.606683] __x64_sys_ioctl+0x95/0xd0 Aug 22 17:00:38 juju-e4d256-prod-github-runner-207 kernel: [41812.607387] do_syscall_64+0x5c/0xc0 Aug 22 17:00:38 juju-e4d256-prod-github-runner-207 kernel: [41812.608067] ? do_futex+0x162/0x1f0 Aug 22 17:00:38 juju-e4d256-prod-github-runner-207 kernel: [41812.608723] ? __x64_sys_futex+0x78/0x1e0 Aug 22 17:00:38 juju-e4d256-prod-github-runner-207 kernel: [41812.609397] ? __secure_computing+0xa9/0x120 Aug 22 17:00:38 juju-e4d256-prod-github-runner-207 kernel: [41812.610091] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 17:00:38 juju-e4d256-prod-github-runner-207 kernel: [41812.610904] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:00:38 juju-e4d256-prod-github-runner-207 kernel: [41812.611634] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:00:38 juju-e4d256-prod-github-runner-207 kernel: [41812.612353] ? do_syscall_64+0x69/0xc0 Aug 22 17:00:38 juju-e4d256-prod-github-runner-207 kernel: [41812.612998] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:00:38 juju-e4d256-prod-github-runner-207 kernel: [41812.613705] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:00:38 juju-e4d256-prod-github-runner-207 kernel: [41812.614404] ? do_syscall_64+0x69/0xc0 Aug 22 17:00:38 juju-e4d256-prod-github-runner-207 kernel: [41812.615044] ? do_syscall_64+0x69/0xc0 Aug 22 17:00:38 juju-e4d256-prod-github-runner-207 kernel: [41812.615672] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 17:00:38 juju-e4d256-prod-github-runner-207 kernel: [41812.616377] RIP: 0033:0x7faa5d0edaff Aug 22 17:00:38 juju-e4d256-prod-github-runner-207 kernel: [41812.617007] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 17:00:38 juju-e4d256-prod-github-runner-207 kernel: [41812.619023] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 17:00:38 juju-e4d256-prod-github-runner-207 kernel: [41812.619940] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 17:00:38 juju-e4d256-prod-github-runner-207 kernel: [41812.620830] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 17:00:38 juju-e4d256-prod-github-runner-207 kernel: [41812.621723] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 17:00:38 juju-e4d256-prod-github-runner-207 kernel: [41812.622616] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 17:00:38 juju-e4d256-prod-github-runner-207 kernel: [41812.623523] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 17:00:38 juju-e4d256-prod-github-runner-207 kernel: [41812.624416] Aug 22 17:01:06 juju-e4d256-prod-github-runner-207 kernel: [41840.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 38859s! [qemu-system-x86:6715] Aug 22 17:01:06 juju-e4d256-prod-github-runner-207 kernel: [41840.543094] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 17:01:06 juju-e4d256-prod-github-runner-207 kernel: [41840.543164] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 17:01:06 juju-e4d256-prod-github-runner-207 kernel: [41840.555218] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 17:01:06 juju-e4d256-prod-github-runner-207 kernel: [41840.556486] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 17:01:06 juju-e4d256-prod-github-runner-207 kernel: [41840.557756] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:01:06 juju-e4d256-prod-github-runner-207 kernel: [41840.558854] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 17:01:06 juju-e4d256-prod-github-runner-207 kernel: [41840.561424] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 17:01:06 juju-e4d256-prod-github-runner-207 kernel: [41840.562479] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 17:01:06 juju-e4d256-prod-github-runner-207 kernel: [41840.563643] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 17:01:06 juju-e4d256-prod-github-runner-207 kernel: [41840.564803] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 17:01:06 juju-e4d256-prod-github-runner-207 kernel: [41840.565965] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 17:01:06 juju-e4d256-prod-github-runner-207 kernel: [41840.567133] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 17:01:06 juju-e4d256-prod-github-runner-207 kernel: [41840.568297] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 17:01:06 juju-e4d256-prod-github-runner-207 kernel: [41840.569531] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 17:01:06 juju-e4d256-prod-github-runner-207 kernel: [41840.570639] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 17:01:06 juju-e4d256-prod-github-runner-207 kernel: [41840.571832] Call Trace: Aug 22 17:01:06 juju-e4d256-prod-github-runner-207 kernel: [41840.572741] Aug 22 17:01:06 juju-e4d256-prod-github-runner-207 kernel: [41840.573721] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:01:06 juju-e4d256-prod-github-runner-207 kernel: [41840.574777] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:01:06 juju-e4d256-prod-github-runner-207 kernel: [41840.575798] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:01:06 juju-e4d256-prod-github-runner-207 kernel: [41840.576993] ? show_regs.part.0+0x23/0x29 Aug 22 17:01:06 juju-e4d256-prod-github-runner-207 kernel: [41840.577993] ? show_regs.cold+0x8/0xd Aug 22 17:01:06 juju-e4d256-prod-github-runner-207 kernel: [41840.578976] ? watchdog_timer_fn+0x1be/0x220 Aug 22 17:01:06 juju-e4d256-prod-github-runner-207 kernel: [41840.579985] ? lockup_detector_update_enable+0x60/0x60 Aug 22 17:01:06 juju-e4d256-prod-github-runner-207 kernel: [41840.581046] ? __hrtimer_run_queues+0x107/0x230 Aug 22 17:01:06 juju-e4d256-prod-github-runner-207 kernel: [41840.582070] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 17:01:06 juju-e4d256-prod-github-runner-207 kernel: [41840.583102] ? hrtimer_interrupt+0x101/0x220 Aug 22 17:01:06 juju-e4d256-prod-github-runner-207 kernel: [41840.584125] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 17:01:06 juju-e4d256-prod-github-runner-207 kernel: [41840.585194] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 17:01:06 juju-e4d256-prod-github-runner-207 kernel: [41840.586237] Aug 22 17:01:06 juju-e4d256-prod-github-runner-207 kernel: [41840.587105] Aug 22 17:01:06 juju-e4d256-prod-github-runner-207 kernel: [41840.587940] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 17:01:06 juju-e4d256-prod-github-runner-207 kernel: [41840.588970] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:01:06 juju-e4d256-prod-github-runner-207 kernel: [41840.590008] ? _raw_spin_lock+0x22/0x30 Aug 22 17:01:06 juju-e4d256-prod-github-runner-207 kernel: [41840.590967] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:01:06 juju-e4d256-prod-github-runner-207 kernel: [41840.591983] direct_page_fault+0x206/0x310 [kvm] Aug 22 17:01:06 juju-e4d256-prod-github-runner-207 kernel: [41840.593004] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 17:01:06 juju-e4d256-prod-github-runner-207 kernel: [41840.594015] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 17:01:06 juju-e4d256-prod-github-runner-207 kernel: [41840.595020] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 17:01:06 juju-e4d256-prod-github-runner-207 kernel: [41840.595989] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 17:01:06 juju-e4d256-prod-github-runner-207 kernel: [41840.596937] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 17:01:06 juju-e4d256-prod-github-runner-207 kernel: [41840.597912] handle_exit+0x98/0x230 [kvm_amd] Aug 22 17:01:06 juju-e4d256-prod-github-runner-207 kernel: [41840.598833] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 17:01:06 juju-e4d256-prod-github-runner-207 kernel: [41840.599752] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 17:01:06 juju-e4d256-prod-github-runner-207 kernel: [41840.600677] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 17:01:06 juju-e4d256-prod-github-runner-207 kernel: [41840.601579] vcpu_run+0x62/0x2c0 [kvm] Aug 22 17:01:06 juju-e4d256-prod-github-runner-207 kernel: [41840.602388] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 17:01:06 juju-e4d256-prod-github-runner-207 kernel: [41840.603216] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 17:01:06 juju-e4d256-prod-github-runner-207 kernel: [41840.604071] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 17:01:06 juju-e4d256-prod-github-runner-207 kernel: [41840.604871] ? __seccomp_filter+0x4a/0x4a0 Aug 22 17:01:06 juju-e4d256-prod-github-runner-207 kernel: [41840.605616] ? __fget_files+0x86/0xc0 Aug 22 17:01:06 juju-e4d256-prod-github-runner-207 kernel: [41840.606320] __x64_sys_ioctl+0x95/0xd0 Aug 22 17:01:06 juju-e4d256-prod-github-runner-207 kernel: [41840.607021] do_syscall_64+0x5c/0xc0 Aug 22 17:01:06 juju-e4d256-prod-github-runner-207 kernel: [41840.607686] ? do_futex+0x162/0x1f0 Aug 22 17:01:06 juju-e4d256-prod-github-runner-207 kernel: [41840.608333] ? __x64_sys_futex+0x78/0x1e0 Aug 22 17:01:06 juju-e4d256-prod-github-runner-207 kernel: [41840.609007] ? __secure_computing+0xa9/0x120 Aug 22 17:01:06 juju-e4d256-prod-github-runner-207 kernel: [41840.609699] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 17:01:06 juju-e4d256-prod-github-runner-207 kernel: [41840.610468] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:01:06 juju-e4d256-prod-github-runner-207 kernel: [41840.611190] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:01:06 juju-e4d256-prod-github-runner-207 kernel: [41840.611908] ? do_syscall_64+0x69/0xc0 Aug 22 17:01:06 juju-e4d256-prod-github-runner-207 kernel: [41840.612552] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:01:06 juju-e4d256-prod-github-runner-207 kernel: [41840.613260] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:01:06 juju-e4d256-prod-github-runner-207 kernel: [41840.613954] ? do_syscall_64+0x69/0xc0 Aug 22 17:01:06 juju-e4d256-prod-github-runner-207 kernel: [41840.614587] ? do_syscall_64+0x69/0xc0 Aug 22 17:01:06 juju-e4d256-prod-github-runner-207 kernel: [41840.615210] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 17:01:06 juju-e4d256-prod-github-runner-207 kernel: [41840.615917] RIP: 0033:0x7faa5d0edaff Aug 22 17:01:06 juju-e4d256-prod-github-runner-207 kernel: [41840.616542] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 17:01:06 juju-e4d256-prod-github-runner-207 kernel: [41840.618534] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 17:01:06 juju-e4d256-prod-github-runner-207 kernel: [41840.619452] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 17:01:06 juju-e4d256-prod-github-runner-207 kernel: [41840.620349] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 17:01:06 juju-e4d256-prod-github-runner-207 kernel: [41840.621242] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 17:01:06 juju-e4d256-prod-github-runner-207 kernel: [41840.622134] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 17:01:06 juju-e4d256-prod-github-runner-207 kernel: [41840.623029] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 17:01:06 juju-e4d256-prod-github-runner-207 kernel: [41840.623920] Aug 22 17:01:34 juju-e4d256-prod-github-runner-207 kernel: [41868.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 38885s! [qemu-system-x86:6715] Aug 22 17:01:34 juju-e4d256-prod-github-runner-207 kernel: [41868.543780] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 17:01:34 juju-e4d256-prod-github-runner-207 kernel: [41868.544030] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 17:01:34 juju-e4d256-prod-github-runner-207 kernel: [41868.556688] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 17:01:34 juju-e4d256-prod-github-runner-207 kernel: [41868.558007] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 17:01:34 juju-e4d256-prod-github-runner-207 kernel: [41868.559375] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:01:34 juju-e4d256-prod-github-runner-207 kernel: [41868.560546] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 17:01:34 juju-e4d256-prod-github-runner-207 kernel: [41868.563207] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 17:01:34 juju-e4d256-prod-github-runner-207 kernel: [41868.564281] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 17:01:34 juju-e4d256-prod-github-runner-207 kernel: [41868.565470] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 17:01:34 juju-e4d256-prod-github-runner-207 kernel: [41868.566682] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 17:01:34 juju-e4d256-prod-github-runner-207 kernel: [41868.567968] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 17:01:34 juju-e4d256-prod-github-runner-207 kernel: [41868.569149] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 17:01:34 juju-e4d256-prod-github-runner-207 kernel: [41868.570362] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 17:01:34 juju-e4d256-prod-github-runner-207 kernel: [41868.571638] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 17:01:34 juju-e4d256-prod-github-runner-207 kernel: [41868.572760] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 17:01:34 juju-e4d256-prod-github-runner-207 kernel: [41868.573960] Call Trace: Aug 22 17:01:34 juju-e4d256-prod-github-runner-207 kernel: [41868.574913] Aug 22 17:01:34 juju-e4d256-prod-github-runner-207 kernel: [41868.575845] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:01:34 juju-e4d256-prod-github-runner-207 kernel: [41868.576899] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:01:34 juju-e4d256-prod-github-runner-207 kernel: [41868.577971] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:01:34 juju-e4d256-prod-github-runner-207 kernel: [41868.579096] ? show_regs.part.0+0x23/0x29 Aug 22 17:01:34 juju-e4d256-prod-github-runner-207 kernel: [41868.580113] ? show_regs.cold+0x8/0xd Aug 22 17:01:34 juju-e4d256-prod-github-runner-207 kernel: [41868.581171] ? watchdog_timer_fn+0x1be/0x220 Aug 22 17:01:34 juju-e4d256-prod-github-runner-207 kernel: [41868.582360] ? lockup_detector_update_enable+0x60/0x60 Aug 22 17:01:34 juju-e4d256-prod-github-runner-207 kernel: [41868.583750] ? __hrtimer_run_queues+0x107/0x230 Aug 22 17:01:34 juju-e4d256-prod-github-runner-207 kernel: [41868.584889] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 17:01:34 juju-e4d256-prod-github-runner-207 kernel: [41868.585926] ? hrtimer_interrupt+0x101/0x220 Aug 22 17:01:34 juju-e4d256-prod-github-runner-207 kernel: [41868.586987] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 17:01:34 juju-e4d256-prod-github-runner-207 kernel: [41868.588067] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 17:01:34 juju-e4d256-prod-github-runner-207 kernel: [41868.589116] Aug 22 17:01:34 juju-e4d256-prod-github-runner-207 kernel: [41868.589973] Aug 22 17:01:34 juju-e4d256-prod-github-runner-207 kernel: [41868.590841] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 17:01:34 juju-e4d256-prod-github-runner-207 kernel: [41868.591884] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:01:34 juju-e4d256-prod-github-runner-207 kernel: [41868.592927] ? _raw_spin_lock+0x22/0x30 Aug 22 17:01:34 juju-e4d256-prod-github-runner-207 kernel: [41868.593881] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:01:34 juju-e4d256-prod-github-runner-207 kernel: [41868.594943] direct_page_fault+0x206/0x310 [kvm] Aug 22 17:01:34 juju-e4d256-prod-github-runner-207 kernel: [41868.595993] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 17:01:34 juju-e4d256-prod-github-runner-207 kernel: [41868.597014] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 17:01:34 juju-e4d256-prod-github-runner-207 kernel: [41868.598019] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 17:01:34 juju-e4d256-prod-github-runner-207 kernel: [41868.599052] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 17:01:34 juju-e4d256-prod-github-runner-207 kernel: [41868.600029] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 17:01:34 juju-e4d256-prod-github-runner-207 kernel: [41868.601020] handle_exit+0x98/0x230 [kvm_amd] Aug 22 17:01:34 juju-e4d256-prod-github-runner-207 kernel: [41868.601913] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 17:01:34 juju-e4d256-prod-github-runner-207 kernel: [41868.602842] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 17:01:34 juju-e4d256-prod-github-runner-207 kernel: [41868.603765] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 17:01:34 juju-e4d256-prod-github-runner-207 kernel: [41868.604671] vcpu_run+0x62/0x2c0 [kvm] Aug 22 17:01:34 juju-e4d256-prod-github-runner-207 kernel: [41868.605481] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 17:01:34 juju-e4d256-prod-github-runner-207 kernel: [41868.606377] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 17:01:34 juju-e4d256-prod-github-runner-207 kernel: [41868.607295] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 17:01:34 juju-e4d256-prod-github-runner-207 kernel: [41868.608113] ? __seccomp_filter+0x4a/0x4a0 Aug 22 17:01:34 juju-e4d256-prod-github-runner-207 kernel: [41868.608904] ? __fget_files+0x86/0xc0 Aug 22 17:01:34 juju-e4d256-prod-github-runner-207 kernel: [41868.609659] __x64_sys_ioctl+0x95/0xd0 Aug 22 17:01:34 juju-e4d256-prod-github-runner-207 kernel: [41868.610409] do_syscall_64+0x5c/0xc0 Aug 22 17:01:34 juju-e4d256-prod-github-runner-207 kernel: [41868.611087] ? do_futex+0x162/0x1f0 Aug 22 17:01:34 juju-e4d256-prod-github-runner-207 kernel: [41868.611737] ? __x64_sys_futex+0x78/0x1e0 Aug 22 17:01:34 juju-e4d256-prod-github-runner-207 kernel: [41868.612466] ? __secure_computing+0xa9/0x120 Aug 22 17:01:34 juju-e4d256-prod-github-runner-207 kernel: [41868.613204] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 17:01:34 juju-e4d256-prod-github-runner-207 kernel: [41868.613980] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:01:34 juju-e4d256-prod-github-runner-207 kernel: [41868.614764] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:01:34 juju-e4d256-prod-github-runner-207 kernel: [41868.615528] ? do_syscall_64+0x69/0xc0 Aug 22 17:01:34 juju-e4d256-prod-github-runner-207 kernel: [41868.616212] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:01:34 juju-e4d256-prod-github-runner-207 kernel: [41868.616965] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:01:34 juju-e4d256-prod-github-runner-207 kernel: [41868.617703] ? do_syscall_64+0x69/0xc0 Aug 22 17:01:34 juju-e4d256-prod-github-runner-207 kernel: [41868.618347] ? do_syscall_64+0x69/0xc0 Aug 22 17:01:34 juju-e4d256-prod-github-runner-207 kernel: [41868.618975] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 17:01:34 juju-e4d256-prod-github-runner-207 kernel: [41868.619693] RIP: 0033:0x7faa5d0edaff Aug 22 17:01:34 juju-e4d256-prod-github-runner-207 kernel: [41868.620396] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 17:01:34 juju-e4d256-prod-github-runner-207 kernel: [41868.622515] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 17:01:34 juju-e4d256-prod-github-runner-207 kernel: [41868.623467] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 17:01:34 juju-e4d256-prod-github-runner-207 kernel: [41868.624360] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 17:01:34 juju-e4d256-prod-github-runner-207 kernel: [41868.625314] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 17:01:34 juju-e4d256-prod-github-runner-207 kernel: [41868.626245] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 17:01:34 juju-e4d256-prod-github-runner-207 kernel: [41868.627243] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 17:01:34 juju-e4d256-prod-github-runner-207 kernel: [41868.628176] Aug 22 17:02:02 juju-e4d256-prod-github-runner-207 kernel: [41896.541980] watchdog: BUG: soft lockup - CPU#1 stuck for 38911s! [qemu-system-x86:6715] Aug 22 17:02:02 juju-e4d256-prod-github-runner-207 kernel: [41896.543108] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 17:02:02 juju-e4d256-prod-github-runner-207 kernel: [41896.543176] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 17:02:02 juju-e4d256-prod-github-runner-207 kernel: [41896.555335] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 17:02:02 juju-e4d256-prod-github-runner-207 kernel: [41896.556604] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 17:02:02 juju-e4d256-prod-github-runner-207 kernel: [41896.557874] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:02:02 juju-e4d256-prod-github-runner-207 kernel: [41896.558986] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 17:02:02 juju-e4d256-prod-github-runner-207 kernel: [41896.562070] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 17:02:02 juju-e4d256-prod-github-runner-207 kernel: [41896.563149] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 17:02:02 juju-e4d256-prod-github-runner-207 kernel: [41896.564322] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 17:02:02 juju-e4d256-prod-github-runner-207 kernel: [41896.565483] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 17:02:02 juju-e4d256-prod-github-runner-207 kernel: [41896.566666] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 17:02:02 juju-e4d256-prod-github-runner-207 kernel: [41896.567855] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 17:02:02 juju-e4d256-prod-github-runner-207 kernel: [41896.569064] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 17:02:02 juju-e4d256-prod-github-runner-207 kernel: [41896.570365] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 17:02:02 juju-e4d256-prod-github-runner-207 kernel: [41896.571465] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 17:02:02 juju-e4d256-prod-github-runner-207 kernel: [41896.572667] Call Trace: Aug 22 17:02:02 juju-e4d256-prod-github-runner-207 kernel: [41896.573600] Aug 22 17:02:02 juju-e4d256-prod-github-runner-207 kernel: [41896.574501] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:02:02 juju-e4d256-prod-github-runner-207 kernel: [41896.575531] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:02:02 juju-e4d256-prod-github-runner-207 kernel: [41896.576550] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:02:02 juju-e4d256-prod-github-runner-207 kernel: [41896.577634] ? show_regs.part.0+0x23/0x29 Aug 22 17:02:02 juju-e4d256-prod-github-runner-207 kernel: [41896.578658] ? show_regs.cold+0x8/0xd Aug 22 17:02:02 juju-e4d256-prod-github-runner-207 kernel: [41896.579631] ? watchdog_timer_fn+0x1be/0x220 Aug 22 17:02:02 juju-e4d256-prod-github-runner-207 kernel: [41896.580638] ? lockup_detector_update_enable+0x60/0x60 Aug 22 17:02:02 juju-e4d256-prod-github-runner-207 kernel: [41896.581701] ? __hrtimer_run_queues+0x107/0x230 Aug 22 17:02:02 juju-e4d256-prod-github-runner-207 kernel: [41896.582810] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 17:02:02 juju-e4d256-prod-github-runner-207 kernel: [41896.583859] ? hrtimer_interrupt+0x101/0x220 Aug 22 17:02:02 juju-e4d256-prod-github-runner-207 kernel: [41896.584880] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 17:02:02 juju-e4d256-prod-github-runner-207 kernel: [41896.585971] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 17:02:02 juju-e4d256-prod-github-runner-207 kernel: [41896.587019] Aug 22 17:02:02 juju-e4d256-prod-github-runner-207 kernel: [41896.587892] Aug 22 17:02:02 juju-e4d256-prod-github-runner-207 kernel: [41896.588762] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 17:02:02 juju-e4d256-prod-github-runner-207 kernel: [41896.589849] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:02:02 juju-e4d256-prod-github-runner-207 kernel: [41896.590888] ? _raw_spin_lock+0x22/0x30 Aug 22 17:02:02 juju-e4d256-prod-github-runner-207 kernel: [41896.591829] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:02:02 juju-e4d256-prod-github-runner-207 kernel: [41896.592841] direct_page_fault+0x206/0x310 [kvm] Aug 22 17:02:02 juju-e4d256-prod-github-runner-207 kernel: [41896.593961] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 17:02:02 juju-e4d256-prod-github-runner-207 kernel: [41896.594995] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 17:02:02 juju-e4d256-prod-github-runner-207 kernel: [41896.595995] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 17:02:02 juju-e4d256-prod-github-runner-207 kernel: [41896.596977] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 17:02:02 juju-e4d256-prod-github-runner-207 kernel: [41896.597961] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 17:02:02 juju-e4d256-prod-github-runner-207 kernel: [41896.598965] handle_exit+0x98/0x230 [kvm_amd] Aug 22 17:02:02 juju-e4d256-prod-github-runner-207 kernel: [41896.600066] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 17:02:02 juju-e4d256-prod-github-runner-207 kernel: [41896.601024] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 17:02:02 juju-e4d256-prod-github-runner-207 kernel: [41896.601977] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 17:02:02 juju-e4d256-prod-github-runner-207 kernel: [41896.602911] vcpu_run+0x62/0x2c0 [kvm] Aug 22 17:02:02 juju-e4d256-prod-github-runner-207 kernel: [41896.603763] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 17:02:02 juju-e4d256-prod-github-runner-207 kernel: [41896.604611] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 17:02:02 juju-e4d256-prod-github-runner-207 kernel: [41896.605485] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 17:02:02 juju-e4d256-prod-github-runner-207 kernel: [41896.606476] ? __seccomp_filter+0x4a/0x4a0 Aug 22 17:02:02 juju-e4d256-prod-github-runner-207 kernel: [41896.607366] ? __fget_files+0x86/0xc0 Aug 22 17:02:02 juju-e4d256-prod-github-runner-207 kernel: [41896.608183] __x64_sys_ioctl+0x95/0xd0 Aug 22 17:02:02 juju-e4d256-prod-github-runner-207 kernel: [41896.609189] do_syscall_64+0x5c/0xc0 Aug 22 17:02:02 juju-e4d256-prod-github-runner-207 kernel: [41896.609979] ? do_futex+0x162/0x1f0 Aug 22 17:02:02 juju-e4d256-prod-github-runner-207 kernel: [41896.610629] ? __x64_sys_futex+0x78/0x1e0 Aug 22 17:02:02 juju-e4d256-prod-github-runner-207 kernel: [41896.611300] ? __secure_computing+0xa9/0x120 Aug 22 17:02:02 juju-e4d256-prod-github-runner-207 kernel: [41896.611986] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 17:02:02 juju-e4d256-prod-github-runner-207 kernel: [41896.612749] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:02:02 juju-e4d256-prod-github-runner-207 kernel: [41896.613468] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:02:02 juju-e4d256-prod-github-runner-207 kernel: [41896.614197] ? do_syscall_64+0x69/0xc0 Aug 22 17:02:02 juju-e4d256-prod-github-runner-207 kernel: [41896.614842] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:02:02 juju-e4d256-prod-github-runner-207 kernel: [41896.615547] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:02:02 juju-e4d256-prod-github-runner-207 kernel: [41896.616241] ? do_syscall_64+0x69/0xc0 Aug 22 17:02:02 juju-e4d256-prod-github-runner-207 kernel: [41896.616865] ? do_syscall_64+0x69/0xc0 Aug 22 17:02:02 juju-e4d256-prod-github-runner-207 kernel: [41896.617486] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 17:02:02 juju-e4d256-prod-github-runner-207 kernel: [41896.618205] RIP: 0033:0x7faa5d0edaff Aug 22 17:02:02 juju-e4d256-prod-github-runner-207 kernel: [41896.618874] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 17:02:02 juju-e4d256-prod-github-runner-207 kernel: [41896.620850] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 17:02:02 juju-e4d256-prod-github-runner-207 kernel: [41896.621776] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 17:02:02 juju-e4d256-prod-github-runner-207 kernel: [41896.622662] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 17:02:02 juju-e4d256-prod-github-runner-207 kernel: [41896.623545] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 17:02:02 juju-e4d256-prod-github-runner-207 kernel: [41896.624434] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 17:02:02 juju-e4d256-prod-github-runner-207 kernel: [41896.625318] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 17:02:02 juju-e4d256-prod-github-runner-207 kernel: [41896.626230] Aug 22 17:02:30 juju-e4d256-prod-github-runner-207 kernel: [41924.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 38937s! [qemu-system-x86:6715] Aug 22 17:02:30 juju-e4d256-prod-github-runner-207 kernel: [41924.543101] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 17:02:30 juju-e4d256-prod-github-runner-207 kernel: [41924.543169] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 17:02:30 juju-e4d256-prod-github-runner-207 kernel: [41924.555328] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 17:02:30 juju-e4d256-prod-github-runner-207 kernel: [41924.556607] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 17:02:30 juju-e4d256-prod-github-runner-207 kernel: [41924.557854] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:02:30 juju-e4d256-prod-github-runner-207 kernel: [41924.558917] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 17:02:30 juju-e4d256-prod-github-runner-207 kernel: [41924.561463] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 17:02:30 juju-e4d256-prod-github-runner-207 kernel: [41924.562504] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 17:02:30 juju-e4d256-prod-github-runner-207 kernel: [41924.563664] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 17:02:30 juju-e4d256-prod-github-runner-207 kernel: [41924.564827] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 17:02:30 juju-e4d256-prod-github-runner-207 kernel: [41924.565993] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 17:02:30 juju-e4d256-prod-github-runner-207 kernel: [41924.567154] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 17:02:30 juju-e4d256-prod-github-runner-207 kernel: [41924.568319] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 17:02:30 juju-e4d256-prod-github-runner-207 kernel: [41924.569569] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 17:02:30 juju-e4d256-prod-github-runner-207 kernel: [41924.570671] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 17:02:30 juju-e4d256-prod-github-runner-207 kernel: [41924.571862] Call Trace: Aug 22 17:02:30 juju-e4d256-prod-github-runner-207 kernel: [41924.572778] Aug 22 17:02:30 juju-e4d256-prod-github-runner-207 kernel: [41924.573667] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:02:30 juju-e4d256-prod-github-runner-207 kernel: [41924.574702] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:02:30 juju-e4d256-prod-github-runner-207 kernel: [41924.575721] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:02:30 juju-e4d256-prod-github-runner-207 kernel: [41924.576792] ? show_regs.part.0+0x23/0x29 Aug 22 17:02:30 juju-e4d256-prod-github-runner-207 kernel: [41924.577797] ? show_regs.cold+0x8/0xd Aug 22 17:02:30 juju-e4d256-prod-github-runner-207 kernel: [41924.578769] ? watchdog_timer_fn+0x1be/0x220 Aug 22 17:02:30 juju-e4d256-prod-github-runner-207 kernel: [41924.579776] ? lockup_detector_update_enable+0x60/0x60 Aug 22 17:02:30 juju-e4d256-prod-github-runner-207 kernel: [41924.580858] ? __hrtimer_run_queues+0x107/0x230 Aug 22 17:02:30 juju-e4d256-prod-github-runner-207 kernel: [41924.581906] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 17:02:30 juju-e4d256-prod-github-runner-207 kernel: [41924.582929] ? hrtimer_interrupt+0x101/0x220 Aug 22 17:02:30 juju-e4d256-prod-github-runner-207 kernel: [41924.583943] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 17:02:30 juju-e4d256-prod-github-runner-207 kernel: [41924.585018] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 17:02:30 juju-e4d256-prod-github-runner-207 kernel: [41924.586093] Aug 22 17:02:30 juju-e4d256-prod-github-runner-207 kernel: [41924.586947] Aug 22 17:02:30 juju-e4d256-prod-github-runner-207 kernel: [41924.587783] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 17:02:30 juju-e4d256-prod-github-runner-207 kernel: [41924.588814] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:02:30 juju-e4d256-prod-github-runner-207 kernel: [41924.589871] ? _raw_spin_lock+0x22/0x30 Aug 22 17:02:30 juju-e4d256-prod-github-runner-207 kernel: [41924.590814] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:02:30 juju-e4d256-prod-github-runner-207 kernel: [41924.591955] direct_page_fault+0x206/0x310 [kvm] Aug 22 17:02:30 juju-e4d256-prod-github-runner-207 kernel: [41924.592987] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 17:02:30 juju-e4d256-prod-github-runner-207 kernel: [41924.594005] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 17:02:30 juju-e4d256-prod-github-runner-207 kernel: [41924.595005] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 17:02:30 juju-e4d256-prod-github-runner-207 kernel: [41924.595973] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 17:02:30 juju-e4d256-prod-github-runner-207 kernel: [41924.596921] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 17:02:30 juju-e4d256-prod-github-runner-207 kernel: [41924.597904] handle_exit+0x98/0x230 [kvm_amd] Aug 22 17:02:30 juju-e4d256-prod-github-runner-207 kernel: [41924.598796] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 17:02:30 juju-e4d256-prod-github-runner-207 kernel: [41924.599714] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 17:02:30 juju-e4d256-prod-github-runner-207 kernel: [41924.600635] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 17:02:30 juju-e4d256-prod-github-runner-207 kernel: [41924.601551] vcpu_run+0x62/0x2c0 [kvm] Aug 22 17:02:30 juju-e4d256-prod-github-runner-207 kernel: [41924.602360] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 17:02:30 juju-e4d256-prod-github-runner-207 kernel: [41924.603166] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 17:02:30 juju-e4d256-prod-github-runner-207 kernel: [41924.604017] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 17:02:30 juju-e4d256-prod-github-runner-207 kernel: [41924.604813] ? __seccomp_filter+0x4a/0x4a0 Aug 22 17:02:30 juju-e4d256-prod-github-runner-207 kernel: [41924.605565] ? __fget_files+0x86/0xc0 Aug 22 17:02:30 juju-e4d256-prod-github-runner-207 kernel: [41924.606268] __x64_sys_ioctl+0x95/0xd0 Aug 22 17:02:30 juju-e4d256-prod-github-runner-207 kernel: [41924.606963] do_syscall_64+0x5c/0xc0 Aug 22 17:02:30 juju-e4d256-prod-github-runner-207 kernel: [41924.607627] ? do_futex+0x162/0x1f0 Aug 22 17:02:30 juju-e4d256-prod-github-runner-207 kernel: [41924.608273] ? __x64_sys_futex+0x78/0x1e0 Aug 22 17:02:30 juju-e4d256-prod-github-runner-207 kernel: [41924.608951] ? __secure_computing+0xa9/0x120 Aug 22 17:02:30 juju-e4d256-prod-github-runner-207 kernel: [41924.609656] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 17:02:30 juju-e4d256-prod-github-runner-207 kernel: [41924.610431] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:02:30 juju-e4d256-prod-github-runner-207 kernel: [41924.611162] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:02:30 juju-e4d256-prod-github-runner-207 kernel: [41924.611880] ? do_syscall_64+0x69/0xc0 Aug 22 17:02:30 juju-e4d256-prod-github-runner-207 kernel: [41924.612525] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:02:30 juju-e4d256-prod-github-runner-207 kernel: [41924.613288] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:02:30 juju-e4d256-prod-github-runner-207 kernel: [41924.614008] ? do_syscall_64+0x69/0xc0 Aug 22 17:02:30 juju-e4d256-prod-github-runner-207 kernel: [41924.614637] ? do_syscall_64+0x69/0xc0 Aug 22 17:02:30 juju-e4d256-prod-github-runner-207 kernel: [41924.615271] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 17:02:30 juju-e4d256-prod-github-runner-207 kernel: [41924.615991] RIP: 0033:0x7faa5d0edaff Aug 22 17:02:30 juju-e4d256-prod-github-runner-207 kernel: [41924.616614] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 17:02:30 juju-e4d256-prod-github-runner-207 kernel: [41924.618628] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 17:02:30 juju-e4d256-prod-github-runner-207 kernel: [41924.619538] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 17:02:30 juju-e4d256-prod-github-runner-207 kernel: [41924.620427] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 17:02:30 juju-e4d256-prod-github-runner-207 kernel: [41924.621314] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 17:02:30 juju-e4d256-prod-github-runner-207 kernel: [41924.622213] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 17:02:30 juju-e4d256-prod-github-runner-207 kernel: [41924.623132] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 17:02:30 juju-e4d256-prod-github-runner-207 kernel: [41924.624028] Aug 22 17:02:46 juju-e4d256-prod-github-runner-207 kernel: [41939.984705] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 17:02:46 juju-e4d256-prod-github-runner-207 kernel: [41939.985667] rcu: 1-....: (10422903 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=5043085 Aug 22 17:02:46 juju-e4d256-prod-github-runner-207 kernel: [41939.986798] (t=10455696 jiffies g=23269 q=42162) Aug 22 17:02:46 juju-e4d256-prod-github-runner-207 kernel: [41939.987587] NMI backtrace for cpu 1 Aug 22 17:02:46 juju-e4d256-prod-github-runner-207 kernel: [41939.988297] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 17:02:46 juju-e4d256-prod-github-runner-207 kernel: [41939.989419] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 17:02:46 juju-e4d256-prod-github-runner-207 kernel: [41939.990479] Call Trace: Aug 22 17:02:46 juju-e4d256-prod-github-runner-207 kernel: [41939.991154] Aug 22 17:02:46 juju-e4d256-prod-github-runner-207 kernel: [41939.991798] show_stack+0x52/0x5c Aug 22 17:02:46 juju-e4d256-prod-github-runner-207 kernel: [41939.992522] dump_stack_lvl+0x4a/0x63 Aug 22 17:02:46 juju-e4d256-prod-github-runner-207 kernel: [41939.993281] dump_stack+0x10/0x16 Aug 22 17:02:46 juju-e4d256-prod-github-runner-207 kernel: [41939.994144] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 17:02:46 juju-e4d256-prod-github-runner-207 kernel: [41939.995024] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 17:02:46 juju-e4d256-prod-github-runner-207 kernel: [41939.995802] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 17:02:46 juju-e4d256-prod-github-runner-207 kernel: [41939.996623] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 17:02:46 juju-e4d256-prod-github-runner-207 kernel: [41939.997462] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 17:02:46 juju-e4d256-prod-github-runner-207 kernel: [41939.998270] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 17:02:46 juju-e4d256-prod-github-runner-207 kernel: [41939.999048] print_cpu_stall.cold+0x2f/0xe2 Aug 22 17:02:46 juju-e4d256-prod-github-runner-207 kernel: [41939.999812] ? timekeeping_update+0xf7/0x150 Aug 22 17:02:46 juju-e4d256-prod-github-runner-207 kernel: [41940.000582] check_cpu_stall+0x109/0x270 Aug 22 17:02:46 juju-e4d256-prod-github-runner-207 kernel: [41940.001347] rcu_sched_clock_irq+0x9a/0x250 Aug 22 17:02:46 juju-e4d256-prod-github-runner-207 kernel: [41940.002114] update_process_times+0x94/0xd0 Aug 22 17:02:46 juju-e4d256-prod-github-runner-207 kernel: [41940.002875] tick_sched_handle+0x29/0x70 Aug 22 17:02:46 juju-e4d256-prod-github-runner-207 kernel: [41940.003621] tick_sched_timer+0x8c/0xc0 Aug 22 17:02:46 juju-e4d256-prod-github-runner-207 kernel: [41940.004365] ? tick_nohz_handler+0xb0/0xb0 Aug 22 17:02:46 juju-e4d256-prod-github-runner-207 kernel: [41940.005121] __hrtimer_run_queues+0x107/0x230 Aug 22 17:02:46 juju-e4d256-prod-github-runner-207 kernel: [41940.005907] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 17:02:46 juju-e4d256-prod-github-runner-207 kernel: [41940.006684] hrtimer_interrupt+0x101/0x220 Aug 22 17:02:46 juju-e4d256-prod-github-runner-207 kernel: [41940.007444] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 17:02:46 juju-e4d256-prod-github-runner-207 kernel: [41940.008259] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 17:02:46 juju-e4d256-prod-github-runner-207 kernel: [41940.009061] Aug 22 17:02:46 juju-e4d256-prod-github-runner-207 kernel: [41940.009714] Aug 22 17:02:46 juju-e4d256-prod-github-runner-207 kernel: [41940.010346] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 17:02:46 juju-e4d256-prod-github-runner-207 kernel: [41940.011173] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:02:46 juju-e4d256-prod-github-runner-207 kernel: [41940.012054] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 17:02:46 juju-e4d256-prod-github-runner-207 kernel: [41940.014292] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 17:02:46 juju-e4d256-prod-github-runner-207 kernel: [41940.015173] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 17:02:46 juju-e4d256-prod-github-runner-207 kernel: [41940.016178] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 17:02:46 juju-e4d256-prod-github-runner-207 kernel: [41940.017160] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 17:02:46 juju-e4d256-prod-github-runner-207 kernel: [41940.018141] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 17:02:46 juju-e4d256-prod-github-runner-207 kernel: [41940.019097] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 17:02:46 juju-e4d256-prod-github-runner-207 kernel: [41940.020058] ? _raw_spin_lock+0x22/0x30 Aug 22 17:02:46 juju-e4d256-prod-github-runner-207 kernel: [41940.020820] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:02:46 juju-e4d256-prod-github-runner-207 kernel: [41940.021669] direct_page_fault+0x206/0x310 [kvm] Aug 22 17:02:46 juju-e4d256-prod-github-runner-207 kernel: [41940.022508] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 17:02:46 juju-e4d256-prod-github-runner-207 kernel: [41940.023335] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 17:02:46 juju-e4d256-prod-github-runner-207 kernel: [41940.024163] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 17:02:46 juju-e4d256-prod-github-runner-207 kernel: [41940.024966] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 17:02:46 juju-e4d256-prod-github-runner-207 kernel: [41940.025768] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 17:02:46 juju-e4d256-prod-github-runner-207 kernel: [41940.026590] handle_exit+0x98/0x230 [kvm_amd] Aug 22 17:02:46 juju-e4d256-prod-github-runner-207 kernel: [41940.027349] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 17:02:46 juju-e4d256-prod-github-runner-207 kernel: [41940.028131] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 17:02:46 juju-e4d256-prod-github-runner-207 kernel: [41940.028931] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 17:02:46 juju-e4d256-prod-github-runner-207 kernel: [41940.029733] vcpu_run+0x62/0x2c0 [kvm] Aug 22 17:02:46 juju-e4d256-prod-github-runner-207 kernel: [41940.030466] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 17:02:46 juju-e4d256-prod-github-runner-207 kernel: [41940.031249] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 17:02:46 juju-e4d256-prod-github-runner-207 kernel: [41940.032052] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 17:02:46 juju-e4d256-prod-github-runner-207 kernel: [41940.032827] ? __seccomp_filter+0x4a/0x4a0 Aug 22 17:02:46 juju-e4d256-prod-github-runner-207 kernel: [41940.033558] ? __fget_files+0x86/0xc0 Aug 22 17:02:46 juju-e4d256-prod-github-runner-207 kernel: [41940.034259] __x64_sys_ioctl+0x95/0xd0 Aug 22 17:02:46 juju-e4d256-prod-github-runner-207 kernel: [41940.034959] do_syscall_64+0x5c/0xc0 Aug 22 17:02:46 juju-e4d256-prod-github-runner-207 kernel: [41940.035646] ? do_futex+0x162/0x1f0 Aug 22 17:02:46 juju-e4d256-prod-github-runner-207 kernel: [41940.036319] ? __x64_sys_futex+0x78/0x1e0 Aug 22 17:02:46 juju-e4d256-prod-github-runner-207 kernel: [41940.037020] ? __secure_computing+0xa9/0x120 Aug 22 17:02:46 juju-e4d256-prod-github-runner-207 kernel: [41940.037747] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 17:02:46 juju-e4d256-prod-github-runner-207 kernel: [41940.038537] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:02:46 juju-e4d256-prod-github-runner-207 kernel: [41940.039297] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:02:46 juju-e4d256-prod-github-runner-207 kernel: [41940.040049] ? do_syscall_64+0x69/0xc0 Aug 22 17:02:46 juju-e4d256-prod-github-runner-207 kernel: [41940.040742] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:02:46 juju-e4d256-prod-github-runner-207 kernel: [41940.041504] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:02:46 juju-e4d256-prod-github-runner-207 kernel: [41940.042261] ? do_syscall_64+0x69/0xc0 Aug 22 17:02:46 juju-e4d256-prod-github-runner-207 kernel: [41940.042959] ? do_syscall_64+0x69/0xc0 Aug 22 17:02:46 juju-e4d256-prod-github-runner-207 kernel: [41940.043644] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 17:02:46 juju-e4d256-prod-github-runner-207 kernel: [41940.044417] RIP: 0033:0x7faa5d0edaff Aug 22 17:02:46 juju-e4d256-prod-github-runner-207 kernel: [41940.045101] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 17:02:46 juju-e4d256-prod-github-runner-207 kernel: [41940.047223] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 17:02:46 juju-e4d256-prod-github-runner-207 kernel: [41940.048184] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 17:02:46 juju-e4d256-prod-github-runner-207 kernel: [41940.049130] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 17:02:46 juju-e4d256-prod-github-runner-207 kernel: [41940.050085] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 17:02:46 juju-e4d256-prod-github-runner-207 kernel: [41940.051025] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 17:02:46 juju-e4d256-prod-github-runner-207 kernel: [41940.051954] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 17:02:46 juju-e4d256-prod-github-runner-207 kernel: [41940.052864] Aug 22 17:03:10 juju-e4d256-prod-github-runner-207 kernel: [41964.541984] watchdog: BUG: soft lockup - CPU#1 stuck for 38974s! [qemu-system-x86:6715] Aug 22 17:03:10 juju-e4d256-prod-github-runner-207 kernel: [41964.543733] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 17:03:10 juju-e4d256-prod-github-runner-207 kernel: [41964.543995] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 17:03:10 juju-e4d256-prod-github-runner-207 kernel: [41964.556229] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 17:03:10 juju-e4d256-prod-github-runner-207 kernel: [41964.557515] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 17:03:10 juju-e4d256-prod-github-runner-207 kernel: [41964.558732] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:03:10 juju-e4d256-prod-github-runner-207 kernel: [41964.559786] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 17:03:10 juju-e4d256-prod-github-runner-207 kernel: [41964.562350] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 17:03:10 juju-e4d256-prod-github-runner-207 kernel: [41964.563394] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 17:03:10 juju-e4d256-prod-github-runner-207 kernel: [41964.564559] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 17:03:10 juju-e4d256-prod-github-runner-207 kernel: [41964.565740] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 17:03:10 juju-e4d256-prod-github-runner-207 kernel: [41964.566902] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 17:03:10 juju-e4d256-prod-github-runner-207 kernel: [41964.568068] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 17:03:10 juju-e4d256-prod-github-runner-207 kernel: [41964.569250] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 17:03:10 juju-e4d256-prod-github-runner-207 kernel: [41964.570493] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 17:03:10 juju-e4d256-prod-github-runner-207 kernel: [41964.571591] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 17:03:10 juju-e4d256-prod-github-runner-207 kernel: [41964.572784] Call Trace: Aug 22 17:03:10 juju-e4d256-prod-github-runner-207 kernel: [41964.573709] Aug 22 17:03:10 juju-e4d256-prod-github-runner-207 kernel: [41964.574591] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:03:10 juju-e4d256-prod-github-runner-207 kernel: [41964.575619] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:03:10 juju-e4d256-prod-github-runner-207 kernel: [41964.576638] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:03:10 juju-e4d256-prod-github-runner-207 kernel: [41964.577753] ? show_regs.part.0+0x23/0x29 Aug 22 17:03:10 juju-e4d256-prod-github-runner-207 kernel: [41964.578758] ? show_regs.cold+0x8/0xd Aug 22 17:03:10 juju-e4d256-prod-github-runner-207 kernel: [41964.579726] ? watchdog_timer_fn+0x1be/0x220 Aug 22 17:03:10 juju-e4d256-prod-github-runner-207 kernel: [41964.580731] ? lockup_detector_update_enable+0x60/0x60 Aug 22 17:03:10 juju-e4d256-prod-github-runner-207 kernel: [41964.581821] ? __hrtimer_run_queues+0x107/0x230 Aug 22 17:03:10 juju-e4d256-prod-github-runner-207 kernel: [41964.582845] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 17:03:10 juju-e4d256-prod-github-runner-207 kernel: [41964.583874] ? hrtimer_interrupt+0x101/0x220 Aug 22 17:03:10 juju-e4d256-prod-github-runner-207 kernel: [41964.584885] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 17:03:10 juju-e4d256-prod-github-runner-207 kernel: [41964.585965] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 17:03:10 juju-e4d256-prod-github-runner-207 kernel: [41964.587004] Aug 22 17:03:10 juju-e4d256-prod-github-runner-207 kernel: [41964.587852] Aug 22 17:03:10 juju-e4d256-prod-github-runner-207 kernel: [41964.588686] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 17:03:10 juju-e4d256-prod-github-runner-207 kernel: [41964.589731] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:03:10 juju-e4d256-prod-github-runner-207 kernel: [41964.590763] ? _raw_spin_lock+0x22/0x30 Aug 22 17:03:10 juju-e4d256-prod-github-runner-207 kernel: [41964.591702] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:03:10 juju-e4d256-prod-github-runner-207 kernel: [41964.592720] direct_page_fault+0x206/0x310 [kvm] Aug 22 17:03:10 juju-e4d256-prod-github-runner-207 kernel: [41964.593766] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 17:03:10 juju-e4d256-prod-github-runner-207 kernel: [41964.594770] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 17:03:10 juju-e4d256-prod-github-runner-207 kernel: [41964.595772] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 17:03:10 juju-e4d256-prod-github-runner-207 kernel: [41964.596767] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 17:03:10 juju-e4d256-prod-github-runner-207 kernel: [41964.597726] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 17:03:10 juju-e4d256-prod-github-runner-207 kernel: [41964.598721] handle_exit+0x98/0x230 [kvm_amd] Aug 22 17:03:10 juju-e4d256-prod-github-runner-207 kernel: [41964.599618] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 17:03:10 juju-e4d256-prod-github-runner-207 kernel: [41964.600528] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 17:03:10 juju-e4d256-prod-github-runner-207 kernel: [41964.601468] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 17:03:10 juju-e4d256-prod-github-runner-207 kernel: [41964.602373] vcpu_run+0x62/0x2c0 [kvm] Aug 22 17:03:10 juju-e4d256-prod-github-runner-207 kernel: [41964.603182] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 17:03:10 juju-e4d256-prod-github-runner-207 kernel: [41964.603988] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 17:03:10 juju-e4d256-prod-github-runner-207 kernel: [41964.604841] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 17:03:10 juju-e4d256-prod-github-runner-207 kernel: [41964.605667] ? __seccomp_filter+0x4a/0x4a0 Aug 22 17:03:10 juju-e4d256-prod-github-runner-207 kernel: [41964.606408] ? __fget_files+0x86/0xc0 Aug 22 17:03:10 juju-e4d256-prod-github-runner-207 kernel: [41964.607110] __x64_sys_ioctl+0x95/0xd0 Aug 22 17:03:10 juju-e4d256-prod-github-runner-207 kernel: [41964.607816] do_syscall_64+0x5c/0xc0 Aug 22 17:03:10 juju-e4d256-prod-github-runner-207 kernel: [41964.608494] ? do_futex+0x162/0x1f0 Aug 22 17:03:10 juju-e4d256-prod-github-runner-207 kernel: [41964.609158] ? __x64_sys_futex+0x78/0x1e0 Aug 22 17:03:10 juju-e4d256-prod-github-runner-207 kernel: [41964.609830] ? __secure_computing+0xa9/0x120 Aug 22 17:03:10 juju-e4d256-prod-github-runner-207 kernel: [41964.610520] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 17:03:10 juju-e4d256-prod-github-runner-207 kernel: [41964.611282] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:03:10 juju-e4d256-prod-github-runner-207 kernel: [41964.612001] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:03:10 juju-e4d256-prod-github-runner-207 kernel: [41964.612715] ? do_syscall_64+0x69/0xc0 Aug 22 17:03:10 juju-e4d256-prod-github-runner-207 kernel: [41964.613369] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:03:10 juju-e4d256-prod-github-runner-207 kernel: [41964.614072] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:03:10 juju-e4d256-prod-github-runner-207 kernel: [41964.614765] ? do_syscall_64+0x69/0xc0 Aug 22 17:03:10 juju-e4d256-prod-github-runner-207 kernel: [41964.615388] ? do_syscall_64+0x69/0xc0 Aug 22 17:03:10 juju-e4d256-prod-github-runner-207 kernel: [41964.616009] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 17:03:10 juju-e4d256-prod-github-runner-207 kernel: [41964.616713] RIP: 0033:0x7faa5d0edaff Aug 22 17:03:10 juju-e4d256-prod-github-runner-207 kernel: [41964.617379] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 17:03:10 juju-e4d256-prod-github-runner-207 kernel: [41964.619369] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 17:03:10 juju-e4d256-prod-github-runner-207 kernel: [41964.620280] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 17:03:10 juju-e4d256-prod-github-runner-207 kernel: [41964.621191] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 17:03:10 juju-e4d256-prod-github-runner-207 kernel: [41964.622081] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 17:03:10 juju-e4d256-prod-github-runner-207 kernel: [41964.622986] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 17:03:10 juju-e4d256-prod-github-runner-207 kernel: [41964.623882] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 17:03:10 juju-e4d256-prod-github-runner-207 kernel: [41964.624776] Aug 22 17:03:38 juju-e4d256-prod-github-runner-207 kernel: [41992.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 39000s! [qemu-system-x86:6715] Aug 22 17:03:38 juju-e4d256-prod-github-runner-207 kernel: [41992.543103] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 17:03:38 juju-e4d256-prod-github-runner-207 kernel: [41992.543171] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 17:03:38 juju-e4d256-prod-github-runner-207 kernel: [41992.555247] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 17:03:38 juju-e4d256-prod-github-runner-207 kernel: [41992.556511] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 17:03:38 juju-e4d256-prod-github-runner-207 kernel: [41992.557749] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:03:38 juju-e4d256-prod-github-runner-207 kernel: [41992.558808] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 17:03:38 juju-e4d256-prod-github-runner-207 kernel: [41992.561396] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 17:03:38 juju-e4d256-prod-github-runner-207 kernel: [41992.562449] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 17:03:38 juju-e4d256-prod-github-runner-207 kernel: [41992.563621] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 17:03:38 juju-e4d256-prod-github-runner-207 kernel: [41992.564793] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 17:03:38 juju-e4d256-prod-github-runner-207 kernel: [41992.565955] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 17:03:38 juju-e4d256-prod-github-runner-207 kernel: [41992.567274] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 17:03:38 juju-e4d256-prod-github-runner-207 kernel: [41992.568575] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 17:03:38 juju-e4d256-prod-github-runner-207 kernel: [41992.569974] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 17:03:38 juju-e4d256-prod-github-runner-207 kernel: [41992.571176] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 17:03:38 juju-e4d256-prod-github-runner-207 kernel: [41992.572500] Call Trace: Aug 22 17:03:38 juju-e4d256-prod-github-runner-207 kernel: [41992.573495] Aug 22 17:03:38 juju-e4d256-prod-github-runner-207 kernel: [41992.574422] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:03:38 juju-e4d256-prod-github-runner-207 kernel: [41992.575530] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:03:38 juju-e4d256-prod-github-runner-207 kernel: [41992.576655] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:03:38 juju-e4d256-prod-github-runner-207 kernel: [41992.577830] ? show_regs.part.0+0x23/0x29 Aug 22 17:03:38 juju-e4d256-prod-github-runner-207 kernel: [41992.578907] ? show_regs.cold+0x8/0xd Aug 22 17:03:38 juju-e4d256-prod-github-runner-207 kernel: [41992.579955] ? watchdog_timer_fn+0x1be/0x220 Aug 22 17:03:38 juju-e4d256-prod-github-runner-207 kernel: [41992.581065] ? lockup_detector_update_enable+0x60/0x60 Aug 22 17:03:38 juju-e4d256-prod-github-runner-207 kernel: [41992.582241] ? __hrtimer_run_queues+0x107/0x230 Aug 22 17:03:38 juju-e4d256-prod-github-runner-207 kernel: [41992.583364] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 17:03:38 juju-e4d256-prod-github-runner-207 kernel: [41992.584470] ? hrtimer_interrupt+0x101/0x220 Aug 22 17:03:38 juju-e4d256-prod-github-runner-207 kernel: [41992.585595] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 17:03:38 juju-e4d256-prod-github-runner-207 kernel: [41992.586762] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 17:03:38 juju-e4d256-prod-github-runner-207 kernel: [41992.587906] Aug 22 17:03:38 juju-e4d256-prod-github-runner-207 kernel: [41992.588824] Aug 22 17:03:38 juju-e4d256-prod-github-runner-207 kernel: [41992.589718] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 17:03:38 juju-e4d256-prod-github-runner-207 kernel: [41992.590852] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:03:38 juju-e4d256-prod-github-runner-207 kernel: [41992.591995] ? _raw_spin_lock+0x22/0x30 Aug 22 17:03:38 juju-e4d256-prod-github-runner-207 kernel: [41992.593050] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:03:38 juju-e4d256-prod-github-runner-207 kernel: [41992.594155] direct_page_fault+0x206/0x310 [kvm] Aug 22 17:03:38 juju-e4d256-prod-github-runner-207 kernel: [41992.595270] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 17:03:38 juju-e4d256-prod-github-runner-207 kernel: [41992.596368] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 17:03:38 juju-e4d256-prod-github-runner-207 kernel: [41992.597486] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 17:03:38 juju-e4d256-prod-github-runner-207 kernel: [41992.598551] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 17:03:38 juju-e4d256-prod-github-runner-207 kernel: [41992.599591] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 17:03:38 juju-e4d256-prod-github-runner-207 kernel: [41992.600694] handle_exit+0x98/0x230 [kvm_amd] Aug 22 17:03:38 juju-e4d256-prod-github-runner-207 kernel: [41992.601675] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 17:03:38 juju-e4d256-prod-github-runner-207 kernel: [41992.602696] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 17:03:38 juju-e4d256-prod-github-runner-207 kernel: [41992.603719] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 17:03:38 juju-e4d256-prod-github-runner-207 kernel: [41992.604743] vcpu_run+0x62/0x2c0 [kvm] Aug 22 17:03:38 juju-e4d256-prod-github-runner-207 kernel: [41992.605634] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 17:03:38 juju-e4d256-prod-github-runner-207 kernel: [41992.606546] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 17:03:38 juju-e4d256-prod-github-runner-207 kernel: [41992.607500] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 17:03:38 juju-e4d256-prod-github-runner-207 kernel: [41992.608385] ? __seccomp_filter+0x4a/0x4a0 Aug 22 17:03:38 juju-e4d256-prod-github-runner-207 kernel: [41992.609227] ? __fget_files+0x86/0xc0 Aug 22 17:03:38 juju-e4d256-prod-github-runner-207 kernel: [41992.610005] __x64_sys_ioctl+0x95/0xd0 Aug 22 17:03:38 juju-e4d256-prod-github-runner-207 kernel: [41992.610779] do_syscall_64+0x5c/0xc0 Aug 22 17:03:38 juju-e4d256-prod-github-runner-207 kernel: [41992.611533] ? do_futex+0x162/0x1f0 Aug 22 17:03:38 juju-e4d256-prod-github-runner-207 kernel: [41992.612256] ? __x64_sys_futex+0x78/0x1e0 Aug 22 17:03:38 juju-e4d256-prod-github-runner-207 kernel: [41992.613031] ? __secure_computing+0xa9/0x120 Aug 22 17:03:38 juju-e4d256-prod-github-runner-207 kernel: [41992.613910] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 17:03:38 juju-e4d256-prod-github-runner-207 kernel: [41992.614777] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:03:38 juju-e4d256-prod-github-runner-207 kernel: [41992.615590] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:03:38 juju-e4d256-prod-github-runner-207 kernel: [41992.616400] ? do_syscall_64+0x69/0xc0 Aug 22 17:03:38 juju-e4d256-prod-github-runner-207 kernel: [41992.617138] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:03:38 juju-e4d256-prod-github-runner-207 kernel: [41992.617947] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:03:38 juju-e4d256-prod-github-runner-207 kernel: [41992.618907] ? do_syscall_64+0x69/0xc0 Aug 22 17:03:38 juju-e4d256-prod-github-runner-207 kernel: [41992.619605] ? do_syscall_64+0x69/0xc0 Aug 22 17:03:38 juju-e4d256-prod-github-runner-207 kernel: [41992.620297] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 17:03:38 juju-e4d256-prod-github-runner-207 kernel: [41992.621113] RIP: 0033:0x7faa5d0edaff Aug 22 17:03:38 juju-e4d256-prod-github-runner-207 kernel: [41992.621841] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 17:03:38 juju-e4d256-prod-github-runner-207 kernel: [41992.624166] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 17:03:38 juju-e4d256-prod-github-runner-207 kernel: [41992.625241] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 17:03:38 juju-e4d256-prod-github-runner-207 kernel: [41992.626262] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 17:03:38 juju-e4d256-prod-github-runner-207 kernel: [41992.627283] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 17:03:38 juju-e4d256-prod-github-runner-207 kernel: [41992.628307] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 17:03:38 juju-e4d256-prod-github-runner-207 kernel: [41992.629339] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 17:03:38 juju-e4d256-prod-github-runner-207 kernel: [41992.630370] Aug 22 17:04:06 juju-e4d256-prod-github-runner-207 kernel: [42020.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 39026s! [qemu-system-x86:6715] Aug 22 17:04:06 juju-e4d256-prod-github-runner-207 kernel: [42020.543118] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 17:04:06 juju-e4d256-prod-github-runner-207 kernel: [42020.543185] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 17:04:06 juju-e4d256-prod-github-runner-207 kernel: [42020.556173] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 17:04:06 juju-e4d256-prod-github-runner-207 kernel: [42020.557858] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 17:04:06 juju-e4d256-prod-github-runner-207 kernel: [42020.559466] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:04:06 juju-e4d256-prod-github-runner-207 kernel: [42020.560847] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 17:04:06 juju-e4d256-prod-github-runner-207 kernel: [42020.563734] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 17:04:06 juju-e4d256-prod-github-runner-207 kernel: [42020.565024] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 17:04:06 juju-e4d256-prod-github-runner-207 kernel: [42020.566209] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 17:04:06 juju-e4d256-prod-github-runner-207 kernel: [42020.567380] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 17:04:06 juju-e4d256-prod-github-runner-207 kernel: [42020.568605] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 17:04:06 juju-e4d256-prod-github-runner-207 kernel: [42020.569811] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 17:04:06 juju-e4d256-prod-github-runner-207 kernel: [42020.571021] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 17:04:06 juju-e4d256-prod-github-runner-207 kernel: [42020.572298] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 17:04:06 juju-e4d256-prod-github-runner-207 kernel: [42020.573489] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 17:04:06 juju-e4d256-prod-github-runner-207 kernel: [42020.574736] Call Trace: Aug 22 17:04:06 juju-e4d256-prod-github-runner-207 kernel: [42020.575728] Aug 22 17:04:06 juju-e4d256-prod-github-runner-207 kernel: [42020.576665] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:04:06 juju-e4d256-prod-github-runner-207 kernel: [42020.577730] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:04:06 juju-e4d256-prod-github-runner-207 kernel: [42020.578796] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:04:06 juju-e4d256-prod-github-runner-207 kernel: [42020.579972] ? show_regs.part.0+0x23/0x29 Aug 22 17:04:06 juju-e4d256-prod-github-runner-207 kernel: [42020.581119] ? show_regs.cold+0x8/0xd Aug 22 17:04:06 juju-e4d256-prod-github-runner-207 kernel: [42020.582108] ? watchdog_timer_fn+0x1be/0x220 Aug 22 17:04:06 juju-e4d256-prod-github-runner-207 kernel: [42020.583169] ? lockup_detector_update_enable+0x60/0x60 Aug 22 17:04:06 juju-e4d256-prod-github-runner-207 kernel: [42020.584245] ? __hrtimer_run_queues+0x107/0x230 Aug 22 17:04:06 juju-e4d256-prod-github-runner-207 kernel: [42020.585318] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 17:04:06 juju-e4d256-prod-github-runner-207 kernel: [42020.586643] ? hrtimer_interrupt+0x101/0x220 Aug 22 17:04:06 juju-e4d256-prod-github-runner-207 kernel: [42020.587897] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 17:04:06 juju-e4d256-prod-github-runner-207 kernel: [42020.589213] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 17:04:06 juju-e4d256-prod-github-runner-207 kernel: [42020.590570] Aug 22 17:04:06 juju-e4d256-prod-github-runner-207 kernel: [42020.591692] Aug 22 17:04:06 juju-e4d256-prod-github-runner-207 kernel: [42020.592821] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 17:04:06 juju-e4d256-prod-github-runner-207 kernel: [42020.594190] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:04:06 juju-e4d256-prod-github-runner-207 kernel: [42020.595520] ? _raw_spin_lock+0x22/0x30 Aug 22 17:04:06 juju-e4d256-prod-github-runner-207 kernel: [42020.596544] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:04:06 juju-e4d256-prod-github-runner-207 kernel: [42020.597605] direct_page_fault+0x206/0x310 [kvm] Aug 22 17:04:06 juju-e4d256-prod-github-runner-207 kernel: [42020.598866] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 17:04:06 juju-e4d256-prod-github-runner-207 kernel: [42020.599921] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 17:04:06 juju-e4d256-prod-github-runner-207 kernel: [42020.600989] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 17:04:06 juju-e4d256-prod-github-runner-207 kernel: [42020.601996] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 17:04:06 juju-e4d256-prod-github-runner-207 kernel: [42020.602973] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 17:04:06 juju-e4d256-prod-github-runner-207 kernel: [42020.604012] handle_exit+0x98/0x230 [kvm_amd] Aug 22 17:04:06 juju-e4d256-prod-github-runner-207 kernel: [42020.605019] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 17:04:06 juju-e4d256-prod-github-runner-207 kernel: [42020.606015] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 17:04:06 juju-e4d256-prod-github-runner-207 kernel: [42020.607002] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 17:04:06 juju-e4d256-prod-github-runner-207 kernel: [42020.607961] vcpu_run+0x62/0x2c0 [kvm] Aug 22 17:04:06 juju-e4d256-prod-github-runner-207 kernel: [42020.608816] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 17:04:06 juju-e4d256-prod-github-runner-207 kernel: [42020.609654] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 17:04:06 juju-e4d256-prod-github-runner-207 kernel: [42020.610547] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 17:04:06 juju-e4d256-prod-github-runner-207 kernel: [42020.611379] ? __seccomp_filter+0x4a/0x4a0 Aug 22 17:04:06 juju-e4d256-prod-github-runner-207 kernel: [42020.612153] ? __fget_files+0x86/0xc0 Aug 22 17:04:06 juju-e4d256-prod-github-runner-207 kernel: [42020.612908] __x64_sys_ioctl+0x95/0xd0 Aug 22 17:04:06 juju-e4d256-prod-github-runner-207 kernel: [42020.613641] do_syscall_64+0x5c/0xc0 Aug 22 17:04:06 juju-e4d256-prod-github-runner-207 kernel: [42020.614381] ? do_futex+0x162/0x1f0 Aug 22 17:04:06 juju-e4d256-prod-github-runner-207 kernel: [42020.615043] ? __x64_sys_futex+0x78/0x1e0 Aug 22 17:04:06 juju-e4d256-prod-github-runner-207 kernel: [42020.615986] ? __secure_computing+0xa9/0x120 Aug 22 17:04:06 juju-e4d256-prod-github-runner-207 kernel: [42020.617164] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 17:04:06 juju-e4d256-prod-github-runner-207 kernel: [42020.618254] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:04:06 juju-e4d256-prod-github-runner-207 kernel: [42020.619023] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:04:06 juju-e4d256-prod-github-runner-207 kernel: [42020.619874] ? do_syscall_64+0x69/0xc0 Aug 22 17:04:06 juju-e4d256-prod-github-runner-207 kernel: [42020.620628] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:04:06 juju-e4d256-prod-github-runner-207 kernel: [42020.621425] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:04:06 juju-e4d256-prod-github-runner-207 kernel: [42020.622222] ? do_syscall_64+0x69/0xc0 Aug 22 17:04:06 juju-e4d256-prod-github-runner-207 kernel: [42020.622927] ? do_syscall_64+0x69/0xc0 Aug 22 17:04:06 juju-e4d256-prod-github-runner-207 kernel: [42020.623627] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 17:04:06 juju-e4d256-prod-github-runner-207 kernel: [42020.624461] RIP: 0033:0x7faa5d0edaff Aug 22 17:04:06 juju-e4d256-prod-github-runner-207 kernel: [42020.625169] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 17:04:06 juju-e4d256-prod-github-runner-207 kernel: [42020.627492] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 17:04:06 juju-e4d256-prod-github-runner-207 kernel: [42020.628570] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 17:04:06 juju-e4d256-prod-github-runner-207 kernel: [42020.629594] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 17:04:06 juju-e4d256-prod-github-runner-207 kernel: [42020.630617] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 17:04:06 juju-e4d256-prod-github-runner-207 kernel: [42020.631634] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 17:04:06 juju-e4d256-prod-github-runner-207 kernel: [42020.632673] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 17:04:06 juju-e4d256-prod-github-runner-207 kernel: [42020.633702] Aug 22 17:04:34 juju-e4d256-prod-github-runner-207 kernel: [42048.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 39052s! [qemu-system-x86:6715] Aug 22 17:04:34 juju-e4d256-prod-github-runner-207 kernel: [42048.543743] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 17:04:34 juju-e4d256-prod-github-runner-207 kernel: [42048.544024] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 17:04:34 juju-e4d256-prod-github-runner-207 kernel: [42048.556362] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 17:04:34 juju-e4d256-prod-github-runner-207 kernel: [42048.557628] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 17:04:34 juju-e4d256-prod-github-runner-207 kernel: [42048.558843] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:04:34 juju-e4d256-prod-github-runner-207 kernel: [42048.559896] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 17:04:34 juju-e4d256-prod-github-runner-207 kernel: [42048.562466] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 17:04:34 juju-e4d256-prod-github-runner-207 kernel: [42048.563509] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 17:04:34 juju-e4d256-prod-github-runner-207 kernel: [42048.564685] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 17:04:34 juju-e4d256-prod-github-runner-207 kernel: [42048.565855] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 17:04:34 juju-e4d256-prod-github-runner-207 kernel: [42048.567046] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 17:04:34 juju-e4d256-prod-github-runner-207 kernel: [42048.568221] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 17:04:34 juju-e4d256-prod-github-runner-207 kernel: [42048.569383] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 17:04:34 juju-e4d256-prod-github-runner-207 kernel: [42048.570622] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 17:04:34 juju-e4d256-prod-github-runner-207 kernel: [42048.571735] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 17:04:34 juju-e4d256-prod-github-runner-207 kernel: [42048.572940] Call Trace: Aug 22 17:04:34 juju-e4d256-prod-github-runner-207 kernel: [42048.573856] Aug 22 17:04:34 juju-e4d256-prod-github-runner-207 kernel: [42048.574754] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:04:34 juju-e4d256-prod-github-runner-207 kernel: [42048.575803] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:04:34 juju-e4d256-prod-github-runner-207 kernel: [42048.576887] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:04:34 juju-e4d256-prod-github-runner-207 kernel: [42048.578024] ? show_regs.part.0+0x23/0x29 Aug 22 17:04:34 juju-e4d256-prod-github-runner-207 kernel: [42048.579020] ? show_regs.cold+0x8/0xd Aug 22 17:04:34 juju-e4d256-prod-github-runner-207 kernel: [42048.580009] ? watchdog_timer_fn+0x1be/0x220 Aug 22 17:04:34 juju-e4d256-prod-github-runner-207 kernel: [42048.581033] ? lockup_detector_update_enable+0x60/0x60 Aug 22 17:04:34 juju-e4d256-prod-github-runner-207 kernel: [42048.582112] ? __hrtimer_run_queues+0x107/0x230 Aug 22 17:04:34 juju-e4d256-prod-github-runner-207 kernel: [42048.583145] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 17:04:34 juju-e4d256-prod-github-runner-207 kernel: [42048.584182] ? hrtimer_interrupt+0x101/0x220 Aug 22 17:04:34 juju-e4d256-prod-github-runner-207 kernel: [42048.585207] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 17:04:34 juju-e4d256-prod-github-runner-207 kernel: [42048.586291] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 17:04:34 juju-e4d256-prod-github-runner-207 kernel: [42048.587369] Aug 22 17:04:34 juju-e4d256-prod-github-runner-207 kernel: [42048.588240] Aug 22 17:04:34 juju-e4d256-prod-github-runner-207 kernel: [42048.589088] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 17:04:34 juju-e4d256-prod-github-runner-207 kernel: [42048.590125] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:04:34 juju-e4d256-prod-github-runner-207 kernel: [42048.591177] ? _raw_spin_lock+0x22/0x30 Aug 22 17:04:34 juju-e4d256-prod-github-runner-207 kernel: [42048.592152] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:04:34 juju-e4d256-prod-github-runner-207 kernel: [42048.593181] direct_page_fault+0x206/0x310 [kvm] Aug 22 17:04:34 juju-e4d256-prod-github-runner-207 kernel: [42048.594214] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 17:04:34 juju-e4d256-prod-github-runner-207 kernel: [42048.595228] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 17:04:34 juju-e4d256-prod-github-runner-207 kernel: [42048.596257] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 17:04:34 juju-e4d256-prod-github-runner-207 kernel: [42048.597284] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 17:04:34 juju-e4d256-prod-github-runner-207 kernel: [42048.598238] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 17:04:34 juju-e4d256-prod-github-runner-207 kernel: [42048.599222] handle_exit+0x98/0x230 [kvm_amd] Aug 22 17:04:34 juju-e4d256-prod-github-runner-207 kernel: [42048.600135] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 17:04:34 juju-e4d256-prod-github-runner-207 kernel: [42048.601054] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 17:04:34 juju-e4d256-prod-github-runner-207 kernel: [42048.601997] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 17:04:34 juju-e4d256-prod-github-runner-207 kernel: [42048.602917] vcpu_run+0x62/0x2c0 [kvm] Aug 22 17:04:34 juju-e4d256-prod-github-runner-207 kernel: [42048.603734] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 17:04:34 juju-e4d256-prod-github-runner-207 kernel: [42048.604560] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 17:04:34 juju-e4d256-prod-github-runner-207 kernel: [42048.605421] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 17:04:34 juju-e4d256-prod-github-runner-207 kernel: [42048.606228] ? __seccomp_filter+0x4a/0x4a0 Aug 22 17:04:34 juju-e4d256-prod-github-runner-207 kernel: [42048.606986] ? __fget_files+0x86/0xc0 Aug 22 17:04:34 juju-e4d256-prod-github-runner-207 kernel: [42048.607719] __x64_sys_ioctl+0x95/0xd0 Aug 22 17:04:34 juju-e4d256-prod-github-runner-207 kernel: [42048.608438] do_syscall_64+0x5c/0xc0 Aug 22 17:04:34 juju-e4d256-prod-github-runner-207 kernel: [42048.609108] ? do_futex+0x162/0x1f0 Aug 22 17:04:34 juju-e4d256-prod-github-runner-207 kernel: [42048.609760] ? __x64_sys_futex+0x78/0x1e0 Aug 22 17:04:34 juju-e4d256-prod-github-runner-207 kernel: [42048.610440] ? __secure_computing+0xa9/0x120 Aug 22 17:04:34 juju-e4d256-prod-github-runner-207 kernel: [42048.611133] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 17:04:34 juju-e4d256-prod-github-runner-207 kernel: [42048.611906] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:04:34 juju-e4d256-prod-github-runner-207 kernel: [42048.612656] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:04:34 juju-e4d256-prod-github-runner-207 kernel: [42048.613391] ? do_syscall_64+0x69/0xc0 Aug 22 17:04:34 juju-e4d256-prod-github-runner-207 kernel: [42048.614044] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:04:34 juju-e4d256-prod-github-runner-207 kernel: [42048.614748] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:04:34 juju-e4d256-prod-github-runner-207 kernel: [42048.615446] ? do_syscall_64+0x69/0xc0 Aug 22 17:04:34 juju-e4d256-prod-github-runner-207 kernel: [42048.616093] ? do_syscall_64+0x69/0xc0 Aug 22 17:04:34 juju-e4d256-prod-github-runner-207 kernel: [42048.616725] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 17:04:34 juju-e4d256-prod-github-runner-207 kernel: [42048.617438] RIP: 0033:0x7faa5d0edaff Aug 22 17:04:34 juju-e4d256-prod-github-runner-207 kernel: [42048.618116] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 17:04:34 juju-e4d256-prod-github-runner-207 kernel: [42048.620123] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 17:04:34 juju-e4d256-prod-github-runner-207 kernel: [42048.621045] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 17:04:34 juju-e4d256-prod-github-runner-207 kernel: [42048.621950] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 17:04:34 juju-e4d256-prod-github-runner-207 kernel: [42048.622852] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 17:04:34 juju-e4d256-prod-github-runner-207 kernel: [42048.623762] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 17:04:34 juju-e4d256-prod-github-runner-207 kernel: [42048.624676] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 17:04:34 juju-e4d256-prod-github-runner-207 kernel: [42048.625580] Aug 22 17:05:02 juju-e4d256-prod-github-runner-207 kernel: [42076.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 39078s! [qemu-system-x86:6715] Aug 22 17:05:02 juju-e4d256-prod-github-runner-207 kernel: [42076.543098] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 17:05:02 juju-e4d256-prod-github-runner-207 kernel: [42076.543167] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 17:05:02 juju-e4d256-prod-github-runner-207 kernel: [42076.555268] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 17:05:02 juju-e4d256-prod-github-runner-207 kernel: [42076.556554] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 17:05:02 juju-e4d256-prod-github-runner-207 kernel: [42076.557772] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:05:02 juju-e4d256-prod-github-runner-207 kernel: [42076.558835] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 17:05:02 juju-e4d256-prod-github-runner-207 kernel: [42076.561419] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 17:05:02 juju-e4d256-prod-github-runner-207 kernel: [42076.562466] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 17:05:02 juju-e4d256-prod-github-runner-207 kernel: [42076.563674] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 17:05:02 juju-e4d256-prod-github-runner-207 kernel: [42076.564835] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 17:05:02 juju-e4d256-prod-github-runner-207 kernel: [42076.566002] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 17:05:02 juju-e4d256-prod-github-runner-207 kernel: [42076.567168] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 17:05:02 juju-e4d256-prod-github-runner-207 kernel: [42076.568352] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 17:05:02 juju-e4d256-prod-github-runner-207 kernel: [42076.569602] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 17:05:02 juju-e4d256-prod-github-runner-207 kernel: [42076.570701] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 17:05:02 juju-e4d256-prod-github-runner-207 kernel: [42076.571911] Call Trace: Aug 22 17:05:02 juju-e4d256-prod-github-runner-207 kernel: [42076.572823] Aug 22 17:05:02 juju-e4d256-prod-github-runner-207 kernel: [42076.573707] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:05:02 juju-e4d256-prod-github-runner-207 kernel: [42076.574735] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:05:02 juju-e4d256-prod-github-runner-207 kernel: [42076.575760] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:05:02 juju-e4d256-prod-github-runner-207 kernel: [42076.576834] ? show_regs.part.0+0x23/0x29 Aug 22 17:05:02 juju-e4d256-prod-github-runner-207 kernel: [42076.577836] ? show_regs.cold+0x8/0xd Aug 22 17:05:02 juju-e4d256-prod-github-runner-207 kernel: [42076.578811] ? watchdog_timer_fn+0x1be/0x220 Aug 22 17:05:02 juju-e4d256-prod-github-runner-207 kernel: [42076.579850] ? lockup_detector_update_enable+0x60/0x60 Aug 22 17:05:02 juju-e4d256-prod-github-runner-207 kernel: [42076.580914] ? __hrtimer_run_queues+0x107/0x230 Aug 22 17:05:02 juju-e4d256-prod-github-runner-207 kernel: [42076.581949] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 17:05:02 juju-e4d256-prod-github-runner-207 kernel: [42076.582972] ? hrtimer_interrupt+0x101/0x220 Aug 22 17:05:02 juju-e4d256-prod-github-runner-207 kernel: [42076.584013] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 17:05:02 juju-e4d256-prod-github-runner-207 kernel: [42076.585083] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 17:05:02 juju-e4d256-prod-github-runner-207 kernel: [42076.586129] Aug 22 17:05:02 juju-e4d256-prod-github-runner-207 kernel: [42076.587004] Aug 22 17:05:02 juju-e4d256-prod-github-runner-207 kernel: [42076.587861] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 17:05:02 juju-e4d256-prod-github-runner-207 kernel: [42076.588896] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:05:02 juju-e4d256-prod-github-runner-207 kernel: [42076.589944] ? _raw_spin_lock+0x22/0x30 Aug 22 17:05:02 juju-e4d256-prod-github-runner-207 kernel: [42076.590902] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:05:02 juju-e4d256-prod-github-runner-207 kernel: [42076.591932] direct_page_fault+0x206/0x310 [kvm] Aug 22 17:05:02 juju-e4d256-prod-github-runner-207 kernel: [42076.592959] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 17:05:02 juju-e4d256-prod-github-runner-207 kernel: [42076.593972] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 17:05:02 juju-e4d256-prod-github-runner-207 kernel: [42076.594971] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 17:05:02 juju-e4d256-prod-github-runner-207 kernel: [42076.595948] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 17:05:02 juju-e4d256-prod-github-runner-207 kernel: [42076.596892] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 17:05:02 juju-e4d256-prod-github-runner-207 kernel: [42076.597874] handle_exit+0x98/0x230 [kvm_amd] Aug 22 17:05:02 juju-e4d256-prod-github-runner-207 kernel: [42076.598764] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 17:05:02 juju-e4d256-prod-github-runner-207 kernel: [42076.599682] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 17:05:02 juju-e4d256-prod-github-runner-207 kernel: [42076.600626] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 17:05:02 juju-e4d256-prod-github-runner-207 kernel: [42076.601531] vcpu_run+0x62/0x2c0 [kvm] Aug 22 17:05:02 juju-e4d256-prod-github-runner-207 kernel: [42076.602346] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 17:05:02 juju-e4d256-prod-github-runner-207 kernel: [42076.603156] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 17:05:02 juju-e4d256-prod-github-runner-207 kernel: [42076.604019] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 17:05:02 juju-e4d256-prod-github-runner-207 kernel: [42076.604816] ? __seccomp_filter+0x4a/0x4a0 Aug 22 17:05:02 juju-e4d256-prod-github-runner-207 kernel: [42076.605556] ? __fget_files+0x86/0xc0 Aug 22 17:05:02 juju-e4d256-prod-github-runner-207 kernel: [42076.606257] __x64_sys_ioctl+0x95/0xd0 Aug 22 17:05:02 juju-e4d256-prod-github-runner-207 kernel: [42076.606948] do_syscall_64+0x5c/0xc0 Aug 22 17:05:02 juju-e4d256-prod-github-runner-207 kernel: [42076.607616] ? do_futex+0x162/0x1f0 Aug 22 17:05:02 juju-e4d256-prod-github-runner-207 kernel: [42076.608273] ? __x64_sys_futex+0x78/0x1e0 Aug 22 17:05:02 juju-e4d256-prod-github-runner-207 kernel: [42076.608945] ? __secure_computing+0xa9/0x120 Aug 22 17:05:02 juju-e4d256-prod-github-runner-207 kernel: [42076.609634] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 17:05:02 juju-e4d256-prod-github-runner-207 kernel: [42076.610418] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:05:02 juju-e4d256-prod-github-runner-207 kernel: [42076.611151] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:05:02 juju-e4d256-prod-github-runner-207 kernel: [42076.611879] ? do_syscall_64+0x69/0xc0 Aug 22 17:05:02 juju-e4d256-prod-github-runner-207 kernel: [42076.612521] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:05:02 juju-e4d256-prod-github-runner-207 kernel: [42076.613221] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:05:02 juju-e4d256-prod-github-runner-207 kernel: [42076.613935] ? do_syscall_64+0x69/0xc0 Aug 22 17:05:02 juju-e4d256-prod-github-runner-207 kernel: [42076.614559] ? do_syscall_64+0x69/0xc0 Aug 22 17:05:02 juju-e4d256-prod-github-runner-207 kernel: [42076.615178] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 17:05:02 juju-e4d256-prod-github-runner-207 kernel: [42076.615889] RIP: 0033:0x7faa5d0edaff Aug 22 17:05:02 juju-e4d256-prod-github-runner-207 kernel: [42076.616537] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 17:05:02 juju-e4d256-prod-github-runner-207 kernel: [42076.618539] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 17:05:02 juju-e4d256-prod-github-runner-207 kernel: [42076.619452] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 17:05:02 juju-e4d256-prod-github-runner-207 kernel: [42076.620355] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 17:05:02 juju-e4d256-prod-github-runner-207 kernel: [42076.621259] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 17:05:02 juju-e4d256-prod-github-runner-207 kernel: [42076.622148] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 17:05:02 juju-e4d256-prod-github-runner-207 kernel: [42076.623036] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 17:05:02 juju-e4d256-prod-github-runner-207 kernel: [42076.623944] Aug 22 17:05:30 juju-e4d256-prod-github-runner-207 kernel: [42104.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 39104s! [qemu-system-x86:6715] Aug 22 17:05:30 juju-e4d256-prod-github-runner-207 kernel: [42104.543109] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 17:05:30 juju-e4d256-prod-github-runner-207 kernel: [42104.543180] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 17:05:30 juju-e4d256-prod-github-runner-207 kernel: [42104.555283] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 17:05:30 juju-e4d256-prod-github-runner-207 kernel: [42104.556571] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 17:05:30 juju-e4d256-prod-github-runner-207 kernel: [42104.557966] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:05:30 juju-e4d256-prod-github-runner-207 kernel: [42104.559157] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 17:05:30 juju-e4d256-prod-github-runner-207 kernel: [42104.562099] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 17:05:30 juju-e4d256-prod-github-runner-207 kernel: [42104.563244] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 17:05:30 juju-e4d256-prod-github-runner-207 kernel: [42104.564550] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 17:05:30 juju-e4d256-prod-github-runner-207 kernel: [42104.565841] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 17:05:30 juju-e4d256-prod-github-runner-207 kernel: [42104.567127] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 17:05:30 juju-e4d256-prod-github-runner-207 kernel: [42104.568436] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 17:05:30 juju-e4d256-prod-github-runner-207 kernel: [42104.569739] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 17:05:30 juju-e4d256-prod-github-runner-207 kernel: [42104.571122] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 17:05:30 juju-e4d256-prod-github-runner-207 kernel: [42104.572340] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 17:05:30 juju-e4d256-prod-github-runner-207 kernel: [42104.573662] Call Trace: Aug 22 17:05:30 juju-e4d256-prod-github-runner-207 kernel: [42104.574646] Aug 22 17:05:30 juju-e4d256-prod-github-runner-207 kernel: [42104.575618] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:05:30 juju-e4d256-prod-github-runner-207 kernel: [42104.576736] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:05:30 juju-e4d256-prod-github-runner-207 kernel: [42104.577842] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:05:30 juju-e4d256-prod-github-runner-207 kernel: [42104.579026] ? show_regs.part.0+0x23/0x29 Aug 22 17:05:30 juju-e4d256-prod-github-runner-207 kernel: [42104.580135] ? show_regs.cold+0x8/0xd Aug 22 17:05:30 juju-e4d256-prod-github-runner-207 kernel: [42104.581183] ? watchdog_timer_fn+0x1be/0x220 Aug 22 17:05:30 juju-e4d256-prod-github-runner-207 kernel: [42104.582280] ? lockup_detector_update_enable+0x60/0x60 Aug 22 17:05:30 juju-e4d256-prod-github-runner-207 kernel: [42104.583470] ? __hrtimer_run_queues+0x107/0x230 Aug 22 17:05:30 juju-e4d256-prod-github-runner-207 kernel: [42104.584584] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 17:05:30 juju-e4d256-prod-github-runner-207 kernel: [42104.585693] ? hrtimer_interrupt+0x101/0x220 Aug 22 17:05:30 juju-e4d256-prod-github-runner-207 kernel: [42104.586793] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 17:05:30 juju-e4d256-prod-github-runner-207 kernel: [42104.587982] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 17:05:30 juju-e4d256-prod-github-runner-207 kernel: [42104.589135] Aug 22 17:05:30 juju-e4d256-prod-github-runner-207 kernel: [42104.590041] Aug 22 17:05:30 juju-e4d256-prod-github-runner-207 kernel: [42104.590927] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 17:05:30 juju-e4d256-prod-github-runner-207 kernel: [42104.592088] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:05:30 juju-e4d256-prod-github-runner-207 kernel: [42104.593225] ? _raw_spin_lock+0x22/0x30 Aug 22 17:05:30 juju-e4d256-prod-github-runner-207 kernel: [42104.594247] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:05:30 juju-e4d256-prod-github-runner-207 kernel: [42104.595381] direct_page_fault+0x206/0x310 [kvm] Aug 22 17:05:30 juju-e4d256-prod-github-runner-207 kernel: [42104.596514] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 17:05:30 juju-e4d256-prod-github-runner-207 kernel: [42104.597615] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 17:05:30 juju-e4d256-prod-github-runner-207 kernel: [42104.598706] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 17:05:30 juju-e4d256-prod-github-runner-207 kernel: [42104.599794] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 17:05:30 juju-e4d256-prod-github-runner-207 kernel: [42104.600834] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 17:05:30 juju-e4d256-prod-github-runner-207 kernel: [42104.601918] handle_exit+0x98/0x230 [kvm_amd] Aug 22 17:05:30 juju-e4d256-prod-github-runner-207 kernel: [42104.602907] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 17:05:30 juju-e4d256-prod-github-runner-207 kernel: [42104.603932] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 17:05:30 juju-e4d256-prod-github-runner-207 kernel: [42104.604982] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 17:05:30 juju-e4d256-prod-github-runner-207 kernel: [42104.605982] vcpu_run+0x62/0x2c0 [kvm] Aug 22 17:05:30 juju-e4d256-prod-github-runner-207 kernel: [42104.606867] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 17:05:30 juju-e4d256-prod-github-runner-207 kernel: [42104.607778] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 17:05:30 juju-e4d256-prod-github-runner-207 kernel: [42104.608739] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 17:05:30 juju-e4d256-prod-github-runner-207 kernel: [42104.609619] ? __seccomp_filter+0x4a/0x4a0 Aug 22 17:05:30 juju-e4d256-prod-github-runner-207 kernel: [42104.610438] ? __fget_files+0x86/0xc0 Aug 22 17:05:30 juju-e4d256-prod-github-runner-207 kernel: [42104.611215] __x64_sys_ioctl+0x95/0xd0 Aug 22 17:05:30 juju-e4d256-prod-github-runner-207 kernel: [42104.612000] do_syscall_64+0x5c/0xc0 Aug 22 17:05:30 juju-e4d256-prod-github-runner-207 kernel: [42104.612738] ? do_futex+0x162/0x1f0 Aug 22 17:05:30 juju-e4d256-prod-github-runner-207 kernel: [42104.613459] ? __x64_sys_futex+0x78/0x1e0 Aug 22 17:05:30 juju-e4d256-prod-github-runner-207 kernel: [42104.614208] ? __secure_computing+0xa9/0x120 Aug 22 17:05:30 juju-e4d256-prod-github-runner-207 kernel: [42104.614987] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 17:05:30 juju-e4d256-prod-github-runner-207 kernel: [42104.615867] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:05:30 juju-e4d256-prod-github-runner-207 kernel: [42104.616676] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:05:30 juju-e4d256-prod-github-runner-207 kernel: [42104.617491] ? do_syscall_64+0x69/0xc0 Aug 22 17:05:30 juju-e4d256-prod-github-runner-207 kernel: [42104.618208] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:05:30 juju-e4d256-prod-github-runner-207 kernel: [42104.619011] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:05:30 juju-e4d256-prod-github-runner-207 kernel: [42104.619851] ? do_syscall_64+0x69/0xc0 Aug 22 17:05:30 juju-e4d256-prod-github-runner-207 kernel: [42104.620547] ? do_syscall_64+0x69/0xc0 Aug 22 17:05:30 juju-e4d256-prod-github-runner-207 kernel: [42104.621245] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 17:05:30 juju-e4d256-prod-github-runner-207 kernel: [42104.622053] RIP: 0033:0x7faa5d0edaff Aug 22 17:05:30 juju-e4d256-prod-github-runner-207 kernel: [42104.622750] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 17:05:30 juju-e4d256-prod-github-runner-207 kernel: [42104.625069] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 17:05:30 juju-e4d256-prod-github-runner-207 kernel: [42104.626115] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 17:05:30 juju-e4d256-prod-github-runner-207 kernel: [42104.627134] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 17:05:30 juju-e4d256-prod-github-runner-207 kernel: [42104.628179] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 17:05:30 juju-e4d256-prod-github-runner-207 kernel: [42104.629204] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 17:05:30 juju-e4d256-prod-github-runner-207 kernel: [42104.630226] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 17:05:30 juju-e4d256-prod-github-runner-207 kernel: [42104.631294] Aug 22 17:05:46 juju-e4d256-prod-github-runner-207 kernel: [42119.996707] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 17:05:46 juju-e4d256-prod-github-runner-207 kernel: [42119.997675] rcu: 1-....: (10467767 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=5064947 Aug 22 17:05:46 juju-e4d256-prod-github-runner-207 kernel: [42119.998797] (t=10500699 jiffies g=23269 q=42274) Aug 22 17:05:46 juju-e4d256-prod-github-runner-207 kernel: [42119.999602] NMI backtrace for cpu 1 Aug 22 17:05:46 juju-e4d256-prod-github-runner-207 kernel: [42120.000325] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 17:05:46 juju-e4d256-prod-github-runner-207 kernel: [42120.001433] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 17:05:46 juju-e4d256-prod-github-runner-207 kernel: [42120.002489] Call Trace: Aug 22 17:05:46 juju-e4d256-prod-github-runner-207 kernel: [42120.003179] Aug 22 17:05:46 juju-e4d256-prod-github-runner-207 kernel: [42120.003824] show_stack+0x52/0x5c Aug 22 17:05:46 juju-e4d256-prod-github-runner-207 kernel: [42120.004549] dump_stack_lvl+0x4a/0x63 Aug 22 17:05:46 juju-e4d256-prod-github-runner-207 kernel: [42120.005294] dump_stack+0x10/0x16 Aug 22 17:05:46 juju-e4d256-prod-github-runner-207 kernel: [42120.006012] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 17:05:46 juju-e4d256-prod-github-runner-207 kernel: [42120.006791] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 17:05:46 juju-e4d256-prod-github-runner-207 kernel: [42120.007578] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 17:05:46 juju-e4d256-prod-github-runner-207 kernel: [42120.008397] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 17:05:46 juju-e4d256-prod-github-runner-207 kernel: [42120.009215] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 17:05:46 juju-e4d256-prod-github-runner-207 kernel: [42120.010022] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 17:05:46 juju-e4d256-prod-github-runner-207 kernel: [42120.010793] print_cpu_stall.cold+0x2f/0xe2 Aug 22 17:05:46 juju-e4d256-prod-github-runner-207 kernel: [42120.011569] ? timekeeping_update+0xf7/0x150 Aug 22 17:05:46 juju-e4d256-prod-github-runner-207 kernel: [42120.012345] check_cpu_stall+0x109/0x270 Aug 22 17:05:46 juju-e4d256-prod-github-runner-207 kernel: [42120.013093] rcu_sched_clock_irq+0x9a/0x250 Aug 22 17:05:46 juju-e4d256-prod-github-runner-207 kernel: [42120.013855] update_process_times+0x94/0xd0 Aug 22 17:05:46 juju-e4d256-prod-github-runner-207 kernel: [42120.014623] tick_sched_handle+0x29/0x70 Aug 22 17:05:46 juju-e4d256-prod-github-runner-207 kernel: [42120.015397] tick_sched_timer+0x8c/0xc0 Aug 22 17:05:46 juju-e4d256-prod-github-runner-207 kernel: [42120.016170] ? tick_nohz_handler+0xb0/0xb0 Aug 22 17:05:46 juju-e4d256-prod-github-runner-207 kernel: [42120.016947] __hrtimer_run_queues+0x107/0x230 Aug 22 17:05:46 juju-e4d256-prod-github-runner-207 kernel: [42120.017723] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 17:05:46 juju-e4d256-prod-github-runner-207 kernel: [42120.018504] hrtimer_interrupt+0x101/0x220 Aug 22 17:05:46 juju-e4d256-prod-github-runner-207 kernel: [42120.019291] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 17:05:46 juju-e4d256-prod-github-runner-207 kernel: [42120.020106] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 17:05:46 juju-e4d256-prod-github-runner-207 kernel: [42120.020908] Aug 22 17:05:46 juju-e4d256-prod-github-runner-207 kernel: [42120.021545] Aug 22 17:05:46 juju-e4d256-prod-github-runner-207 kernel: [42120.022173] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 17:05:46 juju-e4d256-prod-github-runner-207 kernel: [42120.022992] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:05:46 juju-e4d256-prod-github-runner-207 kernel: [42120.023890] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 17:05:46 juju-e4d256-prod-github-runner-207 kernel: [42120.026090] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 17:05:46 juju-e4d256-prod-github-runner-207 kernel: [42120.026961] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 17:05:46 juju-e4d256-prod-github-runner-207 kernel: [42120.027968] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 17:05:46 juju-e4d256-prod-github-runner-207 kernel: [42120.028952] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 17:05:46 juju-e4d256-prod-github-runner-207 kernel: [42120.029916] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 17:05:46 juju-e4d256-prod-github-runner-207 kernel: [42120.030867] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 17:05:46 juju-e4d256-prod-github-runner-207 kernel: [42120.031841] ? _raw_spin_lock+0x22/0x30 Aug 22 17:05:46 juju-e4d256-prod-github-runner-207 kernel: [42120.032599] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:05:46 juju-e4d256-prod-github-runner-207 kernel: [42120.033436] direct_page_fault+0x206/0x310 [kvm] Aug 22 17:05:46 juju-e4d256-prod-github-runner-207 kernel: [42120.034274] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 17:05:46 juju-e4d256-prod-github-runner-207 kernel: [42120.035102] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 17:05:46 juju-e4d256-prod-github-runner-207 kernel: [42120.036057] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 17:05:46 juju-e4d256-prod-github-runner-207 kernel: [42120.036893] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 17:05:46 juju-e4d256-prod-github-runner-207 kernel: [42120.037679] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 17:05:46 juju-e4d256-prod-github-runner-207 kernel: [42120.038498] handle_exit+0x98/0x230 [kvm_amd] Aug 22 17:05:46 juju-e4d256-prod-github-runner-207 kernel: [42120.039268] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 17:05:46 juju-e4d256-prod-github-runner-207 kernel: [42120.040052] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 17:05:46 juju-e4d256-prod-github-runner-207 kernel: [42120.040849] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 17:05:46 juju-e4d256-prod-github-runner-207 kernel: [42120.041631] vcpu_run+0x62/0x2c0 [kvm] Aug 22 17:05:46 juju-e4d256-prod-github-runner-207 kernel: [42120.042343] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 17:05:46 juju-e4d256-prod-github-runner-207 kernel: [42120.043075] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 17:05:46 juju-e4d256-prod-github-runner-207 kernel: [42120.043886] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 17:05:46 juju-e4d256-prod-github-runner-207 kernel: [42120.044644] ? __seccomp_filter+0x4a/0x4a0 Aug 22 17:05:46 juju-e4d256-prod-github-runner-207 kernel: [42120.045365] ? __fget_files+0x86/0xc0 Aug 22 17:05:46 juju-e4d256-prod-github-runner-207 kernel: [42120.046056] __x64_sys_ioctl+0x95/0xd0 Aug 22 17:05:46 juju-e4d256-prod-github-runner-207 kernel: [42120.046749] do_syscall_64+0x5c/0xc0 Aug 22 17:05:46 juju-e4d256-prod-github-runner-207 kernel: [42120.047444] ? do_futex+0x162/0x1f0 Aug 22 17:05:46 juju-e4d256-prod-github-runner-207 kernel: [42120.048115] ? __x64_sys_futex+0x78/0x1e0 Aug 22 17:05:46 juju-e4d256-prod-github-runner-207 kernel: [42120.048816] ? __secure_computing+0xa9/0x120 Aug 22 17:05:46 juju-e4d256-prod-github-runner-207 kernel: [42120.049537] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 17:05:46 juju-e4d256-prod-github-runner-207 kernel: [42120.050325] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:05:46 juju-e4d256-prod-github-runner-207 kernel: [42120.051079] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:05:46 juju-e4d256-prod-github-runner-207 kernel: [42120.051845] ? do_syscall_64+0x69/0xc0 Aug 22 17:05:46 juju-e4d256-prod-github-runner-207 kernel: [42120.052543] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:05:46 juju-e4d256-prod-github-runner-207 kernel: [42120.053297] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:05:46 juju-e4d256-prod-github-runner-207 kernel: [42120.054051] ? do_syscall_64+0x69/0xc0 Aug 22 17:05:46 juju-e4d256-prod-github-runner-207 kernel: [42120.054743] ? do_syscall_64+0x69/0xc0 Aug 22 17:05:46 juju-e4d256-prod-github-runner-207 kernel: [42120.055443] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 17:05:46 juju-e4d256-prod-github-runner-207 kernel: [42120.056212] RIP: 0033:0x7faa5d0edaff Aug 22 17:05:46 juju-e4d256-prod-github-runner-207 kernel: [42120.056893] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 17:05:46 juju-e4d256-prod-github-runner-207 kernel: [42120.058987] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 17:05:46 juju-e4d256-prod-github-runner-207 kernel: [42120.059964] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 17:05:46 juju-e4d256-prod-github-runner-207 kernel: [42120.060910] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 17:05:46 juju-e4d256-prod-github-runner-207 kernel: [42120.061858] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 17:05:46 juju-e4d256-prod-github-runner-207 kernel: [42120.062971] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 17:05:46 juju-e4d256-prod-github-runner-207 kernel: [42120.064073] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 17:05:46 juju-e4d256-prod-github-runner-207 kernel: [42120.065167] Aug 22 17:06:10 juju-e4d256-prod-github-runner-207 kernel: [42144.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 39142s! [qemu-system-x86:6715] Aug 22 17:06:10 juju-e4d256-prod-github-runner-207 kernel: [42144.543182] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 17:06:10 juju-e4d256-prod-github-runner-207 kernel: [42144.543392] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 17:06:10 juju-e4d256-prod-github-runner-207 kernel: [42144.555765] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 17:06:10 juju-e4d256-prod-github-runner-207 kernel: [42144.557042] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 17:06:10 juju-e4d256-prod-github-runner-207 kernel: [42144.558281] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:06:10 juju-e4d256-prod-github-runner-207 kernel: [42144.559373] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 17:06:10 juju-e4d256-prod-github-runner-207 kernel: [42144.561963] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 17:06:10 juju-e4d256-prod-github-runner-207 kernel: [42144.563073] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 17:06:10 juju-e4d256-prod-github-runner-207 kernel: [42144.564435] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 17:06:10 juju-e4d256-prod-github-runner-207 kernel: [42144.565627] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 17:06:10 juju-e4d256-prod-github-runner-207 kernel: [42144.566804] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 17:06:10 juju-e4d256-prod-github-runner-207 kernel: [42144.568015] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 17:06:10 juju-e4d256-prod-github-runner-207 kernel: [42144.569194] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 17:06:10 juju-e4d256-prod-github-runner-207 kernel: [42144.570435] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 17:06:10 juju-e4d256-prod-github-runner-207 kernel: [42144.571562] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 17:06:10 juju-e4d256-prod-github-runner-207 kernel: [42144.572769] Call Trace: Aug 22 17:06:10 juju-e4d256-prod-github-runner-207 kernel: [42144.573716] Aug 22 17:06:10 juju-e4d256-prod-github-runner-207 kernel: [42144.574642] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:06:10 juju-e4d256-prod-github-runner-207 kernel: [42144.575850] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:06:10 juju-e4d256-prod-github-runner-207 kernel: [42144.576971] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:06:10 juju-e4d256-prod-github-runner-207 kernel: [42144.578111] ? show_regs.part.0+0x23/0x29 Aug 22 17:06:10 juju-e4d256-prod-github-runner-207 kernel: [42144.579146] ? show_regs.cold+0x8/0xd Aug 22 17:06:10 juju-e4d256-prod-github-runner-207 kernel: [42144.580132] ? watchdog_timer_fn+0x1be/0x220 Aug 22 17:06:10 juju-e4d256-prod-github-runner-207 kernel: [42144.581151] ? lockup_detector_update_enable+0x60/0x60 Aug 22 17:06:10 juju-e4d256-prod-github-runner-207 kernel: [42144.582214] ? __hrtimer_run_queues+0x107/0x230 Aug 22 17:06:10 juju-e4d256-prod-github-runner-207 kernel: [42144.583295] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 17:06:10 juju-e4d256-prod-github-runner-207 kernel: [42144.584344] ? hrtimer_interrupt+0x101/0x220 Aug 22 17:06:10 juju-e4d256-prod-github-runner-207 kernel: [42144.585360] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 17:06:10 juju-e4d256-prod-github-runner-207 kernel: [42144.586432] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 17:06:10 juju-e4d256-prod-github-runner-207 kernel: [42144.587800] Aug 22 17:06:10 juju-e4d256-prod-github-runner-207 kernel: [42144.588734] Aug 22 17:06:10 juju-e4d256-prod-github-runner-207 kernel: [42144.589583] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 17:06:10 juju-e4d256-prod-github-runner-207 kernel: [42144.590622] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:06:10 juju-e4d256-prod-github-runner-207 kernel: [42144.591685] ? _raw_spin_lock+0x22/0x30 Aug 22 17:06:10 juju-e4d256-prod-github-runner-207 kernel: [42144.592642] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:06:10 juju-e4d256-prod-github-runner-207 kernel: [42144.593691] direct_page_fault+0x206/0x310 [kvm] Aug 22 17:06:10 juju-e4d256-prod-github-runner-207 kernel: [42144.594732] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 17:06:10 juju-e4d256-prod-github-runner-207 kernel: [42144.595764] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 17:06:10 juju-e4d256-prod-github-runner-207 kernel: [42144.596779] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 17:06:10 juju-e4d256-prod-github-runner-207 kernel: [42144.597785] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 17:06:10 juju-e4d256-prod-github-runner-207 kernel: [42144.598735] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 17:06:10 juju-e4d256-prod-github-runner-207 kernel: [42144.599910] handle_exit+0x98/0x230 [kvm_amd] Aug 22 17:06:10 juju-e4d256-prod-github-runner-207 kernel: [42144.600859] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 17:06:10 juju-e4d256-prod-github-runner-207 kernel: [42144.601784] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 17:06:10 juju-e4d256-prod-github-runner-207 kernel: [42144.602714] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 17:06:10 juju-e4d256-prod-github-runner-207 kernel: [42144.603657] vcpu_run+0x62/0x2c0 [kvm] Aug 22 17:06:10 juju-e4d256-prod-github-runner-207 kernel: [42144.604495] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 17:06:10 juju-e4d256-prod-github-runner-207 kernel: [42144.605312] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 17:06:10 juju-e4d256-prod-github-runner-207 kernel: [42144.606177] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 17:06:10 juju-e4d256-prod-github-runner-207 kernel: [42144.607002] ? __seccomp_filter+0x4a/0x4a0 Aug 22 17:06:10 juju-e4d256-prod-github-runner-207 kernel: [42144.607750] ? __fget_files+0x86/0xc0 Aug 22 17:06:10 juju-e4d256-prod-github-runner-207 kernel: [42144.608459] __x64_sys_ioctl+0x95/0xd0 Aug 22 17:06:10 juju-e4d256-prod-github-runner-207 kernel: [42144.609163] do_syscall_64+0x5c/0xc0 Aug 22 17:06:10 juju-e4d256-prod-github-runner-207 kernel: [42144.609840] ? do_futex+0x162/0x1f0 Aug 22 17:06:10 juju-e4d256-prod-github-runner-207 kernel: [42144.610492] ? __x64_sys_futex+0x78/0x1e0 Aug 22 17:06:10 juju-e4d256-prod-github-runner-207 kernel: [42144.611188] ? __secure_computing+0xa9/0x120 Aug 22 17:06:10 juju-e4d256-prod-github-runner-207 kernel: [42144.611889] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 17:06:10 juju-e4d256-prod-github-runner-207 kernel: [42144.612653] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:06:10 juju-e4d256-prod-github-runner-207 kernel: [42144.613386] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:06:10 juju-e4d256-prod-github-runner-207 kernel: [42144.614119] ? do_syscall_64+0x69/0xc0 Aug 22 17:06:10 juju-e4d256-prod-github-runner-207 kernel: [42144.614783] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:06:10 juju-e4d256-prod-github-runner-207 kernel: [42144.615633] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:06:10 juju-e4d256-prod-github-runner-207 kernel: [42144.616379] ? do_syscall_64+0x69/0xc0 Aug 22 17:06:10 juju-e4d256-prod-github-runner-207 kernel: [42144.617012] ? do_syscall_64+0x69/0xc0 Aug 22 17:06:10 juju-e4d256-prod-github-runner-207 kernel: [42144.617641] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 17:06:10 juju-e4d256-prod-github-runner-207 kernel: [42144.618351] RIP: 0033:0x7faa5d0edaff Aug 22 17:06:10 juju-e4d256-prod-github-runner-207 kernel: [42144.619038] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 17:06:10 juju-e4d256-prod-github-runner-207 kernel: [42144.621116] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 17:06:10 juju-e4d256-prod-github-runner-207 kernel: [42144.622038] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 17:06:10 juju-e4d256-prod-github-runner-207 kernel: [42144.622952] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 17:06:10 juju-e4d256-prod-github-runner-207 kernel: [42144.623951] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 17:06:10 juju-e4d256-prod-github-runner-207 kernel: [42144.625008] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 17:06:10 juju-e4d256-prod-github-runner-207 kernel: [42144.625908] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 17:06:10 juju-e4d256-prod-github-runner-207 kernel: [42144.626812] Aug 22 17:06:38 juju-e4d256-prod-github-runner-207 kernel: [42172.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 39168s! [qemu-system-x86:6715] Aug 22 17:06:38 juju-e4d256-prod-github-runner-207 kernel: [42172.543688] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 17:06:38 juju-e4d256-prod-github-runner-207 kernel: [42172.543838] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 17:06:38 juju-e4d256-prod-github-runner-207 kernel: [42172.555898] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 17:06:38 juju-e4d256-prod-github-runner-207 kernel: [42172.557167] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 17:06:38 juju-e4d256-prod-github-runner-207 kernel: [42172.558383] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:06:38 juju-e4d256-prod-github-runner-207 kernel: [42172.559446] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 17:06:38 juju-e4d256-prod-github-runner-207 kernel: [42172.561997] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 17:06:38 juju-e4d256-prod-github-runner-207 kernel: [42172.563057] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 17:06:38 juju-e4d256-prod-github-runner-207 kernel: [42172.564220] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 17:06:38 juju-e4d256-prod-github-runner-207 kernel: [42172.565383] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 17:06:38 juju-e4d256-prod-github-runner-207 kernel: [42172.566540] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 17:06:38 juju-e4d256-prod-github-runner-207 kernel: [42172.567709] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 17:06:38 juju-e4d256-prod-github-runner-207 kernel: [42172.568873] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 17:06:38 juju-e4d256-prod-github-runner-207 kernel: [42172.570103] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 17:06:38 juju-e4d256-prod-github-runner-207 kernel: [42172.571209] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 17:06:38 juju-e4d256-prod-github-runner-207 kernel: [42172.572402] Call Trace: Aug 22 17:06:38 juju-e4d256-prod-github-runner-207 kernel: [42172.573314] Aug 22 17:06:38 juju-e4d256-prod-github-runner-207 kernel: [42172.574196] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:06:38 juju-e4d256-prod-github-runner-207 kernel: [42172.575238] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:06:38 juju-e4d256-prod-github-runner-207 kernel: [42172.576262] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:06:38 juju-e4d256-prod-github-runner-207 kernel: [42172.577335] ? show_regs.part.0+0x23/0x29 Aug 22 17:06:38 juju-e4d256-prod-github-runner-207 kernel: [42172.578330] ? show_regs.cold+0x8/0xd Aug 22 17:06:38 juju-e4d256-prod-github-runner-207 kernel: [42172.579308] ? watchdog_timer_fn+0x1be/0x220 Aug 22 17:06:38 juju-e4d256-prod-github-runner-207 kernel: [42172.580314] ? lockup_detector_update_enable+0x60/0x60 Aug 22 17:06:38 juju-e4d256-prod-github-runner-207 kernel: [42172.581380] ? __hrtimer_run_queues+0x107/0x230 Aug 22 17:06:38 juju-e4d256-prod-github-runner-207 kernel: [42172.582405] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 17:06:38 juju-e4d256-prod-github-runner-207 kernel: [42172.583436] ? hrtimer_interrupt+0x101/0x220 Aug 22 17:06:38 juju-e4d256-prod-github-runner-207 kernel: [42172.584457] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 17:06:38 juju-e4d256-prod-github-runner-207 kernel: [42172.585524] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 17:06:38 juju-e4d256-prod-github-runner-207 kernel: [42172.586575] Aug 22 17:06:38 juju-e4d256-prod-github-runner-207 kernel: [42172.587431] Aug 22 17:06:38 juju-e4d256-prod-github-runner-207 kernel: [42172.588266] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 17:06:38 juju-e4d256-prod-github-runner-207 kernel: [42172.589297] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:06:38 juju-e4d256-prod-github-runner-207 kernel: [42172.590340] ? _raw_spin_lock+0x22/0x30 Aug 22 17:06:38 juju-e4d256-prod-github-runner-207 kernel: [42172.591297] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:06:38 juju-e4d256-prod-github-runner-207 kernel: [42172.592321] direct_page_fault+0x206/0x310 [kvm] Aug 22 17:06:38 juju-e4d256-prod-github-runner-207 kernel: [42172.593348] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 17:06:38 juju-e4d256-prod-github-runner-207 kernel: [42172.594356] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 17:06:38 juju-e4d256-prod-github-runner-207 kernel: [42172.595367] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 17:06:38 juju-e4d256-prod-github-runner-207 kernel: [42172.596352] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 17:06:38 juju-e4d256-prod-github-runner-207 kernel: [42172.597298] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 17:06:38 juju-e4d256-prod-github-runner-207 kernel: [42172.598278] handle_exit+0x98/0x230 [kvm_amd] Aug 22 17:06:38 juju-e4d256-prod-github-runner-207 kernel: [42172.599185] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 17:06:38 juju-e4d256-prod-github-runner-207 kernel: [42172.600101] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 17:06:38 juju-e4d256-prod-github-runner-207 kernel: [42172.601026] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 17:06:38 juju-e4d256-prod-github-runner-207 kernel: [42172.601957] vcpu_run+0x62/0x2c0 [kvm] Aug 22 17:06:38 juju-e4d256-prod-github-runner-207 kernel: [42172.602836] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 17:06:38 juju-e4d256-prod-github-runner-207 kernel: [42172.603651] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 17:06:38 juju-e4d256-prod-github-runner-207 kernel: [42172.604505] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 17:06:38 juju-e4d256-prod-github-runner-207 kernel: [42172.605301] ? __seccomp_filter+0x4a/0x4a0 Aug 22 17:06:38 juju-e4d256-prod-github-runner-207 kernel: [42172.606048] ? __fget_files+0x86/0xc0 Aug 22 17:06:38 juju-e4d256-prod-github-runner-207 kernel: [42172.606762] __x64_sys_ioctl+0x95/0xd0 Aug 22 17:06:38 juju-e4d256-prod-github-runner-207 kernel: [42172.607459] do_syscall_64+0x5c/0xc0 Aug 22 17:06:38 juju-e4d256-prod-github-runner-207 kernel: [42172.608127] ? do_futex+0x162/0x1f0 Aug 22 17:06:38 juju-e4d256-prod-github-runner-207 kernel: [42172.608775] ? __x64_sys_futex+0x78/0x1e0 Aug 22 17:06:38 juju-e4d256-prod-github-runner-207 kernel: [42172.609452] ? __secure_computing+0xa9/0x120 Aug 22 17:06:38 juju-e4d256-prod-github-runner-207 kernel: [42172.610141] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 17:06:38 juju-e4d256-prod-github-runner-207 kernel: [42172.610915] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:06:38 juju-e4d256-prod-github-runner-207 kernel: [42172.611636] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:06:38 juju-e4d256-prod-github-runner-207 kernel: [42172.612360] ? do_syscall_64+0x69/0xc0 Aug 22 17:06:38 juju-e4d256-prod-github-runner-207 kernel: [42172.613004] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:06:38 juju-e4d256-prod-github-runner-207 kernel: [42172.613707] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:06:38 juju-e4d256-prod-github-runner-207 kernel: [42172.614403] ? do_syscall_64+0x69/0xc0 Aug 22 17:06:38 juju-e4d256-prod-github-runner-207 kernel: [42172.615042] ? do_syscall_64+0x69/0xc0 Aug 22 17:06:38 juju-e4d256-prod-github-runner-207 kernel: [42172.615664] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 17:06:38 juju-e4d256-prod-github-runner-207 kernel: [42172.616368] RIP: 0033:0x7faa5d0edaff Aug 22 17:06:38 juju-e4d256-prod-github-runner-207 kernel: [42172.617008] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 17:06:38 juju-e4d256-prod-github-runner-207 kernel: [42172.619001] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 17:06:38 juju-e4d256-prod-github-runner-207 kernel: [42172.619911] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 17:06:38 juju-e4d256-prod-github-runner-207 kernel: [42172.620805] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 17:06:38 juju-e4d256-prod-github-runner-207 kernel: [42172.621699] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 17:06:38 juju-e4d256-prod-github-runner-207 kernel: [42172.622603] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 17:06:38 juju-e4d256-prod-github-runner-207 kernel: [42172.623495] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 17:06:38 juju-e4d256-prod-github-runner-207 kernel: [42172.624429] Aug 22 17:07:06 juju-e4d256-prod-github-runner-207 kernel: [42200.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 39194s! [qemu-system-x86:6715] Aug 22 17:07:06 juju-e4d256-prod-github-runner-207 kernel: [42200.543160] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 17:07:06 juju-e4d256-prod-github-runner-207 kernel: [42200.543227] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 17:07:06 juju-e4d256-prod-github-runner-207 kernel: [42200.555693] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 17:07:06 juju-e4d256-prod-github-runner-207 kernel: [42200.556961] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 17:07:06 juju-e4d256-prod-github-runner-207 kernel: [42200.558182] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:07:06 juju-e4d256-prod-github-runner-207 kernel: [42200.559255] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 17:07:06 juju-e4d256-prod-github-runner-207 kernel: [42200.561879] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 17:07:06 juju-e4d256-prod-github-runner-207 kernel: [42200.562931] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 17:07:06 juju-e4d256-prod-github-runner-207 kernel: [42200.564092] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 17:07:06 juju-e4d256-prod-github-runner-207 kernel: [42200.565255] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 17:07:06 juju-e4d256-prod-github-runner-207 kernel: [42200.566425] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 17:07:06 juju-e4d256-prod-github-runner-207 kernel: [42200.567592] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 17:07:06 juju-e4d256-prod-github-runner-207 kernel: [42200.568760] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 17:07:06 juju-e4d256-prod-github-runner-207 kernel: [42200.570000] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 17:07:06 juju-e4d256-prod-github-runner-207 kernel: [42200.571114] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 17:07:06 juju-e4d256-prod-github-runner-207 kernel: [42200.572366] Call Trace: Aug 22 17:07:06 juju-e4d256-prod-github-runner-207 kernel: [42200.573296] Aug 22 17:07:06 juju-e4d256-prod-github-runner-207 kernel: [42200.574179] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:07:06 juju-e4d256-prod-github-runner-207 kernel: [42200.575223] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:07:06 juju-e4d256-prod-github-runner-207 kernel: [42200.576245] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:07:06 juju-e4d256-prod-github-runner-207 kernel: [42200.577320] ? show_regs.part.0+0x23/0x29 Aug 22 17:07:06 juju-e4d256-prod-github-runner-207 kernel: [42200.578325] ? show_regs.cold+0x8/0xd Aug 22 17:07:06 juju-e4d256-prod-github-runner-207 kernel: [42200.579296] ? watchdog_timer_fn+0x1be/0x220 Aug 22 17:07:06 juju-e4d256-prod-github-runner-207 kernel: [42200.580358] ? lockup_detector_update_enable+0x60/0x60 Aug 22 17:07:06 juju-e4d256-prod-github-runner-207 kernel: [42200.581424] ? __hrtimer_run_queues+0x107/0x230 Aug 22 17:07:06 juju-e4d256-prod-github-runner-207 kernel: [42200.582464] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 17:07:06 juju-e4d256-prod-github-runner-207 kernel: [42200.583522] ? hrtimer_interrupt+0x101/0x220 Aug 22 17:07:06 juju-e4d256-prod-github-runner-207 kernel: [42200.584556] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 17:07:06 juju-e4d256-prod-github-runner-207 kernel: [42200.585627] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 17:07:06 juju-e4d256-prod-github-runner-207 kernel: [42200.586695] Aug 22 17:07:06 juju-e4d256-prod-github-runner-207 kernel: [42200.587551] Aug 22 17:07:06 juju-e4d256-prod-github-runner-207 kernel: [42200.588389] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 17:07:06 juju-e4d256-prod-github-runner-207 kernel: [42200.589422] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:07:06 juju-e4d256-prod-github-runner-207 kernel: [42200.590534] ? _raw_spin_lock+0x22/0x30 Aug 22 17:07:06 juju-e4d256-prod-github-runner-207 kernel: [42200.591489] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:07:06 juju-e4d256-prod-github-runner-207 kernel: [42200.592510] direct_page_fault+0x206/0x310 [kvm] Aug 22 17:07:06 juju-e4d256-prod-github-runner-207 kernel: [42200.593536] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 17:07:06 juju-e4d256-prod-github-runner-207 kernel: [42200.594557] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 17:07:06 juju-e4d256-prod-github-runner-207 kernel: [42200.595559] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 17:07:06 juju-e4d256-prod-github-runner-207 kernel: [42200.596531] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 17:07:06 juju-e4d256-prod-github-runner-207 kernel: [42200.597479] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 17:07:06 juju-e4d256-prod-github-runner-207 kernel: [42200.598463] handle_exit+0x98/0x230 [kvm_amd] Aug 22 17:07:06 juju-e4d256-prod-github-runner-207 kernel: [42200.599360] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 17:07:06 juju-e4d256-prod-github-runner-207 kernel: [42200.600272] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 17:07:06 juju-e4d256-prod-github-runner-207 kernel: [42200.601198] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 17:07:06 juju-e4d256-prod-github-runner-207 kernel: [42200.602102] vcpu_run+0x62/0x2c0 [kvm] Aug 22 17:07:06 juju-e4d256-prod-github-runner-207 kernel: [42200.602927] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 17:07:06 juju-e4d256-prod-github-runner-207 kernel: [42200.603737] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 17:07:06 juju-e4d256-prod-github-runner-207 kernel: [42200.604589] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 17:07:06 juju-e4d256-prod-github-runner-207 kernel: [42200.605388] ? __seccomp_filter+0x4a/0x4a0 Aug 22 17:07:06 juju-e4d256-prod-github-runner-207 kernel: [42200.606130] ? __fget_files+0x86/0xc0 Aug 22 17:07:06 juju-e4d256-prod-github-runner-207 kernel: [42200.606890] __x64_sys_ioctl+0x95/0xd0 Aug 22 17:07:06 juju-e4d256-prod-github-runner-207 kernel: [42200.607584] do_syscall_64+0x5c/0xc0 Aug 22 17:07:06 juju-e4d256-prod-github-runner-207 kernel: [42200.608249] ? do_futex+0x162/0x1f0 Aug 22 17:07:06 juju-e4d256-prod-github-runner-207 kernel: [42200.608896] ? __x64_sys_futex+0x78/0x1e0 Aug 22 17:07:06 juju-e4d256-prod-github-runner-207 kernel: [42200.609568] ? __secure_computing+0xa9/0x120 Aug 22 17:07:06 juju-e4d256-prod-github-runner-207 kernel: [42200.610265] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 17:07:06 juju-e4d256-prod-github-runner-207 kernel: [42200.611138] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:07:06 juju-e4d256-prod-github-runner-207 kernel: [42200.611866] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:07:06 juju-e4d256-prod-github-runner-207 kernel: [42200.612620] ? do_syscall_64+0x69/0xc0 Aug 22 17:07:06 juju-e4d256-prod-github-runner-207 kernel: [42200.613267] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:07:06 juju-e4d256-prod-github-runner-207 kernel: [42200.613971] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:07:06 juju-e4d256-prod-github-runner-207 kernel: [42200.614716] ? do_syscall_64+0x69/0xc0 Aug 22 17:07:06 juju-e4d256-prod-github-runner-207 kernel: [42200.615352] ? do_syscall_64+0x69/0xc0 Aug 22 17:07:06 juju-e4d256-prod-github-runner-207 kernel: [42200.615990] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 17:07:06 juju-e4d256-prod-github-runner-207 kernel: [42200.616710] RIP: 0033:0x7faa5d0edaff Aug 22 17:07:06 juju-e4d256-prod-github-runner-207 kernel: [42200.617345] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 17:07:06 juju-e4d256-prod-github-runner-207 kernel: [42200.619380] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 17:07:06 juju-e4d256-prod-github-runner-207 kernel: [42200.620317] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 17:07:06 juju-e4d256-prod-github-runner-207 kernel: [42200.621234] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 17:07:06 juju-e4d256-prod-github-runner-207 kernel: [42200.622137] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 17:07:06 juju-e4d256-prod-github-runner-207 kernel: [42200.623044] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 17:07:06 juju-e4d256-prod-github-runner-207 kernel: [42200.623936] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 17:07:06 juju-e4d256-prod-github-runner-207 kernel: [42200.624826] Aug 22 17:07:34 juju-e4d256-prod-github-runner-207 kernel: [42228.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 39220s! [qemu-system-x86:6715] Aug 22 17:07:34 juju-e4d256-prod-github-runner-207 kernel: [42228.543088] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 17:07:34 juju-e4d256-prod-github-runner-207 kernel: [42228.543154] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 17:07:34 juju-e4d256-prod-github-runner-207 kernel: [42228.555180] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 17:07:34 juju-e4d256-prod-github-runner-207 kernel: [42228.556446] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 17:07:34 juju-e4d256-prod-github-runner-207 kernel: [42228.557671] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:07:34 juju-e4d256-prod-github-runner-207 kernel: [42228.558736] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 17:07:34 juju-e4d256-prod-github-runner-207 kernel: [42228.561286] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 17:07:34 juju-e4d256-prod-github-runner-207 kernel: [42228.562336] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 17:07:34 juju-e4d256-prod-github-runner-207 kernel: [42228.563500] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 17:07:34 juju-e4d256-prod-github-runner-207 kernel: [42228.564658] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 17:07:34 juju-e4d256-prod-github-runner-207 kernel: [42228.565819] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 17:07:34 juju-e4d256-prod-github-runner-207 kernel: [42228.566992] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 17:07:34 juju-e4d256-prod-github-runner-207 kernel: [42228.568170] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 17:07:34 juju-e4d256-prod-github-runner-207 kernel: [42228.569404] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 17:07:34 juju-e4d256-prod-github-runner-207 kernel: [42228.570514] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 17:07:34 juju-e4d256-prod-github-runner-207 kernel: [42228.571711] Call Trace: Aug 22 17:07:34 juju-e4d256-prod-github-runner-207 kernel: [42228.572620] Aug 22 17:07:34 juju-e4d256-prod-github-runner-207 kernel: [42228.573503] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:07:34 juju-e4d256-prod-github-runner-207 kernel: [42228.574542] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:07:34 juju-e4d256-prod-github-runner-207 kernel: [42228.575560] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:07:34 juju-e4d256-prod-github-runner-207 kernel: [42228.576631] ? show_regs.part.0+0x23/0x29 Aug 22 17:07:34 juju-e4d256-prod-github-runner-207 kernel: [42228.577628] ? show_regs.cold+0x8/0xd Aug 22 17:07:34 juju-e4d256-prod-github-runner-207 kernel: [42228.578606] ? watchdog_timer_fn+0x1be/0x220 Aug 22 17:07:34 juju-e4d256-prod-github-runner-207 kernel: [42228.579611] ? lockup_detector_update_enable+0x60/0x60 Aug 22 17:07:34 juju-e4d256-prod-github-runner-207 kernel: [42228.580671] ? __hrtimer_run_queues+0x107/0x230 Aug 22 17:07:34 juju-e4d256-prod-github-runner-207 kernel: [42228.581885] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 17:07:34 juju-e4d256-prod-github-runner-207 kernel: [42228.582917] ? hrtimer_interrupt+0x101/0x220 Aug 22 17:07:34 juju-e4d256-prod-github-runner-207 kernel: [42228.583931] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 17:07:34 juju-e4d256-prod-github-runner-207 kernel: [42228.584996] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 17:07:34 juju-e4d256-prod-github-runner-207 kernel: [42228.586050] Aug 22 17:07:34 juju-e4d256-prod-github-runner-207 kernel: [42228.587027] Aug 22 17:07:34 juju-e4d256-prod-github-runner-207 kernel: [42228.587869] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 17:07:34 juju-e4d256-prod-github-runner-207 kernel: [42228.588902] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:07:34 juju-e4d256-prod-github-runner-207 kernel: [42228.589944] ? _raw_spin_lock+0x22/0x30 Aug 22 17:07:34 juju-e4d256-prod-github-runner-207 kernel: [42228.590887] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:07:34 juju-e4d256-prod-github-runner-207 kernel: [42228.591899] direct_page_fault+0x206/0x310 [kvm] Aug 22 17:07:34 juju-e4d256-prod-github-runner-207 kernel: [42228.592922] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 17:07:34 juju-e4d256-prod-github-runner-207 kernel: [42228.593937] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 17:07:34 juju-e4d256-prod-github-runner-207 kernel: [42228.594936] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 17:07:34 juju-e4d256-prod-github-runner-207 kernel: [42228.595905] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 17:07:34 juju-e4d256-prod-github-runner-207 kernel: [42228.596854] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 17:07:34 juju-e4d256-prod-github-runner-207 kernel: [42228.597830] handle_exit+0x98/0x230 [kvm_amd] Aug 22 17:07:34 juju-e4d256-prod-github-runner-207 kernel: [42228.598728] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 17:07:34 juju-e4d256-prod-github-runner-207 kernel: [42228.599645] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 17:07:34 juju-e4d256-prod-github-runner-207 kernel: [42228.600567] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 17:07:34 juju-e4d256-prod-github-runner-207 kernel: [42228.601477] vcpu_run+0x62/0x2c0 [kvm] Aug 22 17:07:34 juju-e4d256-prod-github-runner-207 kernel: [42228.602298] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 17:07:34 juju-e4d256-prod-github-runner-207 kernel: [42228.603105] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 17:07:34 juju-e4d256-prod-github-runner-207 kernel: [42228.603963] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 17:07:34 juju-e4d256-prod-github-runner-207 kernel: [42228.604764] ? __seccomp_filter+0x4a/0x4a0 Aug 22 17:07:34 juju-e4d256-prod-github-runner-207 kernel: [42228.605504] ? __fget_files+0x86/0xc0 Aug 22 17:07:34 juju-e4d256-prod-github-runner-207 kernel: [42228.606220] __x64_sys_ioctl+0x95/0xd0 Aug 22 17:07:34 juju-e4d256-prod-github-runner-207 kernel: [42228.606917] do_syscall_64+0x5c/0xc0 Aug 22 17:07:34 juju-e4d256-prod-github-runner-207 kernel: [42228.607588] ? do_futex+0x162/0x1f0 Aug 22 17:07:34 juju-e4d256-prod-github-runner-207 kernel: [42228.608237] ? __x64_sys_futex+0x78/0x1e0 Aug 22 17:07:34 juju-e4d256-prod-github-runner-207 kernel: [42228.609025] ? __secure_computing+0xa9/0x120 Aug 22 17:07:34 juju-e4d256-prod-github-runner-207 kernel: [42228.609718] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 17:07:34 juju-e4d256-prod-github-runner-207 kernel: [42228.610485] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:07:34 juju-e4d256-prod-github-runner-207 kernel: [42228.611205] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:07:34 juju-e4d256-prod-github-runner-207 kernel: [42228.611923] ? do_syscall_64+0x69/0xc0 Aug 22 17:07:34 juju-e4d256-prod-github-runner-207 kernel: [42228.612568] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:07:34 juju-e4d256-prod-github-runner-207 kernel: [42228.613275] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:07:34 juju-e4d256-prod-github-runner-207 kernel: [42228.613976] ? do_syscall_64+0x69/0xc0 Aug 22 17:07:34 juju-e4d256-prod-github-runner-207 kernel: [42228.614605] ? do_syscall_64+0x69/0xc0 Aug 22 17:07:34 juju-e4d256-prod-github-runner-207 kernel: [42228.615226] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 17:07:34 juju-e4d256-prod-github-runner-207 kernel: [42228.615930] RIP: 0033:0x7faa5d0edaff Aug 22 17:07:34 juju-e4d256-prod-github-runner-207 kernel: [42228.616551] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 17:07:34 juju-e4d256-prod-github-runner-207 kernel: [42228.618552] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 17:07:34 juju-e4d256-prod-github-runner-207 kernel: [42228.619467] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 17:07:34 juju-e4d256-prod-github-runner-207 kernel: [42228.620354] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 17:07:34 juju-e4d256-prod-github-runner-207 kernel: [42228.621243] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 17:07:34 juju-e4d256-prod-github-runner-207 kernel: [42228.622141] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 17:07:34 juju-e4d256-prod-github-runner-207 kernel: [42228.623037] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 17:07:34 juju-e4d256-prod-github-runner-207 kernel: [42228.623928] Aug 22 17:08:02 juju-e4d256-prod-github-runner-207 kernel: [42256.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 39246s! [qemu-system-x86:6715] Aug 22 17:08:02 juju-e4d256-prod-github-runner-207 kernel: [42256.543649] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 17:08:02 juju-e4d256-prod-github-runner-207 kernel: [42256.543886] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 17:08:02 juju-e4d256-prod-github-runner-207 kernel: [42256.556297] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 17:08:02 juju-e4d256-prod-github-runner-207 kernel: [42256.557565] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 17:08:02 juju-e4d256-prod-github-runner-207 kernel: [42256.558811] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:08:02 juju-e4d256-prod-github-runner-207 kernel: [42256.559896] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 17:08:02 juju-e4d256-prod-github-runner-207 kernel: [42256.562463] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 17:08:02 juju-e4d256-prod-github-runner-207 kernel: [42256.563503] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 17:08:02 juju-e4d256-prod-github-runner-207 kernel: [42256.564672] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 17:08:02 juju-e4d256-prod-github-runner-207 kernel: [42256.565852] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 17:08:02 juju-e4d256-prod-github-runner-207 kernel: [42256.567016] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 17:08:02 juju-e4d256-prod-github-runner-207 kernel: [42256.568277] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 17:08:02 juju-e4d256-prod-github-runner-207 kernel: [42256.569458] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 17:08:02 juju-e4d256-prod-github-runner-207 kernel: [42256.570710] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 17:08:02 juju-e4d256-prod-github-runner-207 kernel: [42256.571812] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 17:08:02 juju-e4d256-prod-github-runner-207 kernel: [42256.573007] Call Trace: Aug 22 17:08:02 juju-e4d256-prod-github-runner-207 kernel: [42256.573938] Aug 22 17:08:02 juju-e4d256-prod-github-runner-207 kernel: [42256.574834] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:08:02 juju-e4d256-prod-github-runner-207 kernel: [42256.575869] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:08:02 juju-e4d256-prod-github-runner-207 kernel: [42256.576894] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:08:02 juju-e4d256-prod-github-runner-207 kernel: [42256.577997] ? show_regs.part.0+0x23/0x29 Aug 22 17:08:02 juju-e4d256-prod-github-runner-207 kernel: [42256.578994] ? show_regs.cold+0x8/0xd Aug 22 17:08:02 juju-e4d256-prod-github-runner-207 kernel: [42256.579969] ? watchdog_timer_fn+0x1be/0x220 Aug 22 17:08:02 juju-e4d256-prod-github-runner-207 kernel: [42256.581010] ? lockup_detector_update_enable+0x60/0x60 Aug 22 17:08:02 juju-e4d256-prod-github-runner-207 kernel: [42256.582134] ? __hrtimer_run_queues+0x107/0x230 Aug 22 17:08:02 juju-e4d256-prod-github-runner-207 kernel: [42256.583170] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 17:08:02 juju-e4d256-prod-github-runner-207 kernel: [42256.584194] ? hrtimer_interrupt+0x101/0x220 Aug 22 17:08:02 juju-e4d256-prod-github-runner-207 kernel: [42256.585209] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 17:08:02 juju-e4d256-prod-github-runner-207 kernel: [42256.586290] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 17:08:02 juju-e4d256-prod-github-runner-207 kernel: [42256.587340] Aug 22 17:08:02 juju-e4d256-prod-github-runner-207 kernel: [42256.588192] Aug 22 17:08:02 juju-e4d256-prod-github-runner-207 kernel: [42256.589032] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 17:08:02 juju-e4d256-prod-github-runner-207 kernel: [42256.590094] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:08:02 juju-e4d256-prod-github-runner-207 kernel: [42256.591165] ? _raw_spin_lock+0x22/0x30 Aug 22 17:08:02 juju-e4d256-prod-github-runner-207 kernel: [42256.592144] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:08:02 juju-e4d256-prod-github-runner-207 kernel: [42256.593190] direct_page_fault+0x206/0x310 [kvm] Aug 22 17:08:02 juju-e4d256-prod-github-runner-207 kernel: [42256.594271] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 17:08:02 juju-e4d256-prod-github-runner-207 kernel: [42256.595313] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 17:08:02 juju-e4d256-prod-github-runner-207 kernel: [42256.596327] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 17:08:02 juju-e4d256-prod-github-runner-207 kernel: [42256.597334] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 17:08:02 juju-e4d256-prod-github-runner-207 kernel: [42256.598298] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 17:08:02 juju-e4d256-prod-github-runner-207 kernel: [42256.599331] handle_exit+0x98/0x230 [kvm_amd] Aug 22 17:08:02 juju-e4d256-prod-github-runner-207 kernel: [42256.600236] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 17:08:02 juju-e4d256-prod-github-runner-207 kernel: [42256.601163] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 17:08:02 juju-e4d256-prod-github-runner-207 kernel: [42256.602109] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 17:08:02 juju-e4d256-prod-github-runner-207 kernel: [42256.603014] vcpu_run+0x62/0x2c0 [kvm] Aug 22 17:08:02 juju-e4d256-prod-github-runner-207 kernel: [42256.603827] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 17:08:02 juju-e4d256-prod-github-runner-207 kernel: [42256.604635] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 17:08:02 juju-e4d256-prod-github-runner-207 kernel: [42256.605489] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 17:08:02 juju-e4d256-prod-github-runner-207 kernel: [42256.606311] ? __seccomp_filter+0x4a/0x4a0 Aug 22 17:08:02 juju-e4d256-prod-github-runner-207 kernel: [42256.607054] ? __fget_files+0x86/0xc0 Aug 22 17:08:02 juju-e4d256-prod-github-runner-207 kernel: [42256.607757] __x64_sys_ioctl+0x95/0xd0 Aug 22 17:08:02 juju-e4d256-prod-github-runner-207 kernel: [42256.608449] do_syscall_64+0x5c/0xc0 Aug 22 17:08:02 juju-e4d256-prod-github-runner-207 kernel: [42256.609113] ? do_futex+0x162/0x1f0 Aug 22 17:08:02 juju-e4d256-prod-github-runner-207 kernel: [42256.609776] ? __x64_sys_futex+0x78/0x1e0 Aug 22 17:08:02 juju-e4d256-prod-github-runner-207 kernel: [42256.610457] ? __secure_computing+0xa9/0x120 Aug 22 17:08:02 juju-e4d256-prod-github-runner-207 kernel: [42256.611182] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 17:08:02 juju-e4d256-prod-github-runner-207 kernel: [42256.611972] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:08:02 juju-e4d256-prod-github-runner-207 kernel: [42256.612695] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:08:02 juju-e4d256-prod-github-runner-207 kernel: [42256.613419] ? do_syscall_64+0x69/0xc0 Aug 22 17:08:02 juju-e4d256-prod-github-runner-207 kernel: [42256.614084] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:08:02 juju-e4d256-prod-github-runner-207 kernel: [42256.614791] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:08:02 juju-e4d256-prod-github-runner-207 kernel: [42256.615497] ? do_syscall_64+0x69/0xc0 Aug 22 17:08:02 juju-e4d256-prod-github-runner-207 kernel: [42256.616133] ? do_syscall_64+0x69/0xc0 Aug 22 17:08:02 juju-e4d256-prod-github-runner-207 kernel: [42256.616757] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 17:08:02 juju-e4d256-prod-github-runner-207 kernel: [42256.617462] RIP: 0033:0x7faa5d0edaff Aug 22 17:08:02 juju-e4d256-prod-github-runner-207 kernel: [42256.618133] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 17:08:02 juju-e4d256-prod-github-runner-207 kernel: [42256.620124] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 17:08:02 juju-e4d256-prod-github-runner-207 kernel: [42256.621039] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 17:08:02 juju-e4d256-prod-github-runner-207 kernel: [42256.621951] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 17:08:02 juju-e4d256-prod-github-runner-207 kernel: [42256.622839] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 17:08:02 juju-e4d256-prod-github-runner-207 kernel: [42256.623772] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 17:08:02 juju-e4d256-prod-github-runner-207 kernel: [42256.624665] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 17:08:02 juju-e4d256-prod-github-runner-207 kernel: [42256.625606] Aug 22 17:08:30 juju-e4d256-prod-github-runner-207 kernel: [42284.541976] watchdog: BUG: soft lockup - CPU#1 stuck for 39272s! [qemu-system-x86:6715] Aug 22 17:08:30 juju-e4d256-prod-github-runner-207 kernel: [42284.543090] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 17:08:30 juju-e4d256-prod-github-runner-207 kernel: [42284.543153] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 17:08:30 juju-e4d256-prod-github-runner-207 kernel: [42284.555567] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 17:08:30 juju-e4d256-prod-github-runner-207 kernel: [42284.556843] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 17:08:30 juju-e4d256-prod-github-runner-207 kernel: [42284.558083] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:08:30 juju-e4d256-prod-github-runner-207 kernel: [42284.559140] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 17:08:30 juju-e4d256-prod-github-runner-207 kernel: [42284.561722] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 17:08:30 juju-e4d256-prod-github-runner-207 kernel: [42284.562768] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 17:08:30 juju-e4d256-prod-github-runner-207 kernel: [42284.563932] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 17:08:30 juju-e4d256-prod-github-runner-207 kernel: [42284.565101] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 17:08:30 juju-e4d256-prod-github-runner-207 kernel: [42284.566284] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 17:08:30 juju-e4d256-prod-github-runner-207 kernel: [42284.567444] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 17:08:30 juju-e4d256-prod-github-runner-207 kernel: [42284.568625] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 17:08:30 juju-e4d256-prod-github-runner-207 kernel: [42284.569879] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 17:08:30 juju-e4d256-prod-github-runner-207 kernel: [42284.570976] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 17:08:30 juju-e4d256-prod-github-runner-207 kernel: [42284.572167] Call Trace: Aug 22 17:08:30 juju-e4d256-prod-github-runner-207 kernel: [42284.573083] Aug 22 17:08:30 juju-e4d256-prod-github-runner-207 kernel: [42284.573989] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:08:30 juju-e4d256-prod-github-runner-207 kernel: [42284.575017] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:08:30 juju-e4d256-prod-github-runner-207 kernel: [42284.576037] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:08:30 juju-e4d256-prod-github-runner-207 kernel: [42284.577120] ? show_regs.part.0+0x23/0x29 Aug 22 17:08:30 juju-e4d256-prod-github-runner-207 kernel: [42284.578129] ? show_regs.cold+0x8/0xd Aug 22 17:08:30 juju-e4d256-prod-github-runner-207 kernel: [42284.579102] ? watchdog_timer_fn+0x1be/0x220 Aug 22 17:08:30 juju-e4d256-prod-github-runner-207 kernel: [42284.580106] ? lockup_detector_update_enable+0x60/0x60 Aug 22 17:08:30 juju-e4d256-prod-github-runner-207 kernel: [42284.581181] ? __hrtimer_run_queues+0x107/0x230 Aug 22 17:08:30 juju-e4d256-prod-github-runner-207 kernel: [42284.582231] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 17:08:30 juju-e4d256-prod-github-runner-207 kernel: [42284.583260] ? hrtimer_interrupt+0x101/0x220 Aug 22 17:08:30 juju-e4d256-prod-github-runner-207 kernel: [42284.584275] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 17:08:30 juju-e4d256-prod-github-runner-207 kernel: [42284.585375] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 17:08:30 juju-e4d256-prod-github-runner-207 kernel: [42284.586419] Aug 22 17:08:30 juju-e4d256-prod-github-runner-207 kernel: [42284.587274] Aug 22 17:08:30 juju-e4d256-prod-github-runner-207 kernel: [42284.588109] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 17:08:30 juju-e4d256-prod-github-runner-207 kernel: [42284.589144] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:08:30 juju-e4d256-prod-github-runner-207 kernel: [42284.590188] ? _raw_spin_lock+0x22/0x30 Aug 22 17:08:30 juju-e4d256-prod-github-runner-207 kernel: [42284.591132] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:08:30 juju-e4d256-prod-github-runner-207 kernel: [42284.592148] direct_page_fault+0x206/0x310 [kvm] Aug 22 17:08:30 juju-e4d256-prod-github-runner-207 kernel: [42284.593167] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 17:08:30 juju-e4d256-prod-github-runner-207 kernel: [42284.594187] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 17:08:30 juju-e4d256-prod-github-runner-207 kernel: [42284.595189] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 17:08:30 juju-e4d256-prod-github-runner-207 kernel: [42284.596156] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 17:08:30 juju-e4d256-prod-github-runner-207 kernel: [42284.597098] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 17:08:30 juju-e4d256-prod-github-runner-207 kernel: [42284.598096] handle_exit+0x98/0x230 [kvm_amd] Aug 22 17:08:30 juju-e4d256-prod-github-runner-207 kernel: [42284.598986] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 17:08:30 juju-e4d256-prod-github-runner-207 kernel: [42284.599895] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 17:08:30 juju-e4d256-prod-github-runner-207 kernel: [42284.600816] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 17:08:30 juju-e4d256-prod-github-runner-207 kernel: [42284.601735] vcpu_run+0x62/0x2c0 [kvm] Aug 22 17:08:30 juju-e4d256-prod-github-runner-207 kernel: [42284.602549] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 17:08:30 juju-e4d256-prod-github-runner-207 kernel: [42284.603353] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 17:08:30 juju-e4d256-prod-github-runner-207 kernel: [42284.604209] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 17:08:30 juju-e4d256-prod-github-runner-207 kernel: [42284.605004] ? __seccomp_filter+0x4a/0x4a0 Aug 22 17:08:30 juju-e4d256-prod-github-runner-207 kernel: [42284.605756] ? __fget_files+0x86/0xc0 Aug 22 17:08:30 juju-e4d256-prod-github-runner-207 kernel: [42284.606455] __x64_sys_ioctl+0x95/0xd0 Aug 22 17:08:30 juju-e4d256-prod-github-runner-207 kernel: [42284.607144] do_syscall_64+0x5c/0xc0 Aug 22 17:08:30 juju-e4d256-prod-github-runner-207 kernel: [42284.607804] ? do_futex+0x162/0x1f0 Aug 22 17:08:30 juju-e4d256-prod-github-runner-207 kernel: [42284.608448] ? __x64_sys_futex+0x78/0x1e0 Aug 22 17:08:30 juju-e4d256-prod-github-runner-207 kernel: [42284.609126] ? __secure_computing+0xa9/0x120 Aug 22 17:08:30 juju-e4d256-prod-github-runner-207 kernel: [42284.609832] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 17:08:30 juju-e4d256-prod-github-runner-207 kernel: [42284.610591] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:08:30 juju-e4d256-prod-github-runner-207 kernel: [42284.611308] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:08:30 juju-e4d256-prod-github-runner-207 kernel: [42284.612021] ? do_syscall_64+0x69/0xc0 Aug 22 17:08:30 juju-e4d256-prod-github-runner-207 kernel: [42284.612664] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:08:30 juju-e4d256-prod-github-runner-207 kernel: [42284.613381] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:08:30 juju-e4d256-prod-github-runner-207 kernel: [42284.614073] ? do_syscall_64+0x69/0xc0 Aug 22 17:08:30 juju-e4d256-prod-github-runner-207 kernel: [42284.614695] ? do_syscall_64+0x69/0xc0 Aug 22 17:08:30 juju-e4d256-prod-github-runner-207 kernel: [42284.615314] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 17:08:30 juju-e4d256-prod-github-runner-207 kernel: [42284.616015] RIP: 0033:0x7faa5d0edaff Aug 22 17:08:30 juju-e4d256-prod-github-runner-207 kernel: [42284.616641] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 17:08:30 juju-e4d256-prod-github-runner-207 kernel: [42284.618634] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 17:08:30 juju-e4d256-prod-github-runner-207 kernel: [42284.619540] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 17:08:30 juju-e4d256-prod-github-runner-207 kernel: [42284.620519] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 17:08:30 juju-e4d256-prod-github-runner-207 kernel: [42284.621419] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 17:08:30 juju-e4d256-prod-github-runner-207 kernel: [42284.622310] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 17:08:30 juju-e4d256-prod-github-runner-207 kernel: [42284.623205] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 17:08:30 juju-e4d256-prod-github-runner-207 kernel: [42284.624096] Aug 22 17:08:46 juju-e4d256-prod-github-runner-207 kernel: [42300.008708] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 17:08:46 juju-e4d256-prod-github-runner-207 kernel: [42300.009691] rcu: 1-....: (10512636 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=5086732 Aug 22 17:08:46 juju-e4d256-prod-github-runner-207 kernel: [42300.010811] (t=10545702 jiffies g=23269 q=42413) Aug 22 17:08:46 juju-e4d256-prod-github-runner-207 kernel: [42300.011601] NMI backtrace for cpu 1 Aug 22 17:08:46 juju-e4d256-prod-github-runner-207 kernel: [42300.012315] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 17:08:46 juju-e4d256-prod-github-runner-207 kernel: [42300.013585] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 17:08:46 juju-e4d256-prod-github-runner-207 kernel: [42300.014649] Call Trace: Aug 22 17:08:46 juju-e4d256-prod-github-runner-207 kernel: [42300.015330] Aug 22 17:08:46 juju-e4d256-prod-github-runner-207 kernel: [42300.015973] show_stack+0x52/0x5c Aug 22 17:08:46 juju-e4d256-prod-github-runner-207 kernel: [42300.016696] dump_stack_lvl+0x4a/0x63 Aug 22 17:08:46 juju-e4d256-prod-github-runner-207 kernel: [42300.017456] dump_stack+0x10/0x16 Aug 22 17:08:46 juju-e4d256-prod-github-runner-207 kernel: [42300.018172] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 17:08:46 juju-e4d256-prod-github-runner-207 kernel: [42300.018954] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 17:08:46 juju-e4d256-prod-github-runner-207 kernel: [42300.019734] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 17:08:46 juju-e4d256-prod-github-runner-207 kernel: [42300.020661] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 17:08:46 juju-e4d256-prod-github-runner-207 kernel: [42300.021499] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 17:08:46 juju-e4d256-prod-github-runner-207 kernel: [42300.022309] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 17:08:46 juju-e4d256-prod-github-runner-207 kernel: [42300.023080] print_cpu_stall.cold+0x2f/0xe2 Aug 22 17:08:46 juju-e4d256-prod-github-runner-207 kernel: [42300.023845] ? timekeeping_update+0xf7/0x150 Aug 22 17:08:46 juju-e4d256-prod-github-runner-207 kernel: [42300.024614] check_cpu_stall+0x109/0x270 Aug 22 17:08:46 juju-e4d256-prod-github-runner-207 kernel: [42300.025371] rcu_sched_clock_irq+0x9a/0x250 Aug 22 17:08:46 juju-e4d256-prod-github-runner-207 kernel: [42300.026133] update_process_times+0x94/0xd0 Aug 22 17:08:46 juju-e4d256-prod-github-runner-207 kernel: [42300.026896] tick_sched_handle+0x29/0x70 Aug 22 17:08:46 juju-e4d256-prod-github-runner-207 kernel: [42300.027646] tick_sched_timer+0x8c/0xc0 Aug 22 17:08:46 juju-e4d256-prod-github-runner-207 kernel: [42300.028381] ? tick_nohz_handler+0xb0/0xb0 Aug 22 17:08:46 juju-e4d256-prod-github-runner-207 kernel: [42300.029149] __hrtimer_run_queues+0x107/0x230 Aug 22 17:08:46 juju-e4d256-prod-github-runner-207 kernel: [42300.029922] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 17:08:46 juju-e4d256-prod-github-runner-207 kernel: [42300.030701] hrtimer_interrupt+0x101/0x220 Aug 22 17:08:46 juju-e4d256-prod-github-runner-207 kernel: [42300.031466] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 17:08:46 juju-e4d256-prod-github-runner-207 kernel: [42300.032278] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 17:08:46 juju-e4d256-prod-github-runner-207 kernel: [42300.033091] Aug 22 17:08:46 juju-e4d256-prod-github-runner-207 kernel: [42300.033726] Aug 22 17:08:46 juju-e4d256-prod-github-runner-207 kernel: [42300.034358] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 17:08:46 juju-e4d256-prod-github-runner-207 kernel: [42300.035177] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:08:46 juju-e4d256-prod-github-runner-207 kernel: [42300.036056] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 17:08:46 juju-e4d256-prod-github-runner-207 kernel: [42300.038282] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 17:08:46 juju-e4d256-prod-github-runner-207 kernel: [42300.039154] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 17:08:46 juju-e4d256-prod-github-runner-207 kernel: [42300.040146] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 17:08:46 juju-e4d256-prod-github-runner-207 kernel: [42300.041143] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 17:08:46 juju-e4d256-prod-github-runner-207 kernel: [42300.042108] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 17:08:46 juju-e4d256-prod-github-runner-207 kernel: [42300.043063] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 17:08:46 juju-e4d256-prod-github-runner-207 kernel: [42300.044022] ? _raw_spin_lock+0x22/0x30 Aug 22 17:08:46 juju-e4d256-prod-github-runner-207 kernel: [42300.044782] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:08:46 juju-e4d256-prod-github-runner-207 kernel: [42300.045636] direct_page_fault+0x206/0x310 [kvm] Aug 22 17:08:46 juju-e4d256-prod-github-runner-207 kernel: [42300.046474] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 17:08:46 juju-e4d256-prod-github-runner-207 kernel: [42300.047301] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 17:08:46 juju-e4d256-prod-github-runner-207 kernel: [42300.048124] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 17:08:46 juju-e4d256-prod-github-runner-207 kernel: [42300.048939] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 17:08:46 juju-e4d256-prod-github-runner-207 kernel: [42300.049731] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 17:08:46 juju-e4d256-prod-github-runner-207 kernel: [42300.050557] handle_exit+0x98/0x230 [kvm_amd] Aug 22 17:08:46 juju-e4d256-prod-github-runner-207 kernel: [42300.051313] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 17:08:46 juju-e4d256-prod-github-runner-207 kernel: [42300.052096] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 17:08:46 juju-e4d256-prod-github-runner-207 kernel: [42300.052893] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 17:08:46 juju-e4d256-prod-github-runner-207 kernel: [42300.053692] vcpu_run+0x62/0x2c0 [kvm] Aug 22 17:08:46 juju-e4d256-prod-github-runner-207 kernel: [42300.054405] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 17:08:46 juju-e4d256-prod-github-runner-207 kernel: [42300.055138] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 17:08:46 juju-e4d256-prod-github-runner-207 kernel: [42300.055951] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 17:08:46 juju-e4d256-prod-github-runner-207 kernel: [42300.056715] ? __seccomp_filter+0x4a/0x4a0 Aug 22 17:08:46 juju-e4d256-prod-github-runner-207 kernel: [42300.057450] ? __fget_files+0x86/0xc0 Aug 22 17:08:46 juju-e4d256-prod-github-runner-207 kernel: [42300.058140] __x64_sys_ioctl+0x95/0xd0 Aug 22 17:08:46 juju-e4d256-prod-github-runner-207 kernel: [42300.058830] do_syscall_64+0x5c/0xc0 Aug 22 17:08:46 juju-e4d256-prod-github-runner-207 kernel: [42300.059507] ? do_futex+0x162/0x1f0 Aug 22 17:08:46 juju-e4d256-prod-github-runner-207 kernel: [42300.060176] ? __x64_sys_futex+0x78/0x1e0 Aug 22 17:08:46 juju-e4d256-prod-github-runner-207 kernel: [42300.060873] ? __secure_computing+0xa9/0x120 Aug 22 17:08:46 juju-e4d256-prod-github-runner-207 kernel: [42300.061598] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 17:08:46 juju-e4d256-prod-github-runner-207 kernel: [42300.062382] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:08:46 juju-e4d256-prod-github-runner-207 kernel: [42300.063132] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:08:46 juju-e4d256-prod-github-runner-207 kernel: [42300.063885] ? do_syscall_64+0x69/0xc0 Aug 22 17:08:46 juju-e4d256-prod-github-runner-207 kernel: [42300.064576] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:08:46 juju-e4d256-prod-github-runner-207 kernel: [42300.065338] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:08:46 juju-e4d256-prod-github-runner-207 kernel: [42300.066092] ? do_syscall_64+0x69/0xc0 Aug 22 17:08:46 juju-e4d256-prod-github-runner-207 kernel: [42300.066787] ? do_syscall_64+0x69/0xc0 Aug 22 17:08:46 juju-e4d256-prod-github-runner-207 kernel: [42300.067471] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 17:08:46 juju-e4d256-prod-github-runner-207 kernel: [42300.068236] RIP: 0033:0x7faa5d0edaff Aug 22 17:08:46 juju-e4d256-prod-github-runner-207 kernel: [42300.068913] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 17:08:46 juju-e4d256-prod-github-runner-207 kernel: [42300.071008] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 17:08:46 juju-e4d256-prod-github-runner-207 kernel: [42300.071964] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 17:08:46 juju-e4d256-prod-github-runner-207 kernel: [42300.072908] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 17:08:46 juju-e4d256-prod-github-runner-207 kernel: [42300.073864] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 17:08:46 juju-e4d256-prod-github-runner-207 kernel: [42300.074797] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 17:08:46 juju-e4d256-prod-github-runner-207 kernel: [42300.075720] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 17:08:46 juju-e4d256-prod-github-runner-207 kernel: [42300.076631] Aug 22 17:09:10 juju-e4d256-prod-github-runner-207 kernel: [42324.541982] watchdog: BUG: soft lockup - CPU#1 stuck for 39309s! [qemu-system-x86:6715] Aug 22 17:09:10 juju-e4d256-prod-github-runner-207 kernel: [42324.543120] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 17:09:10 juju-e4d256-prod-github-runner-207 kernel: [42324.543186] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 17:09:10 juju-e4d256-prod-github-runner-207 kernel: [42324.556502] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 17:09:10 juju-e4d256-prod-github-runner-207 kernel: [42324.557787] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 17:09:10 juju-e4d256-prod-github-runner-207 kernel: [42324.559036] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:09:10 juju-e4d256-prod-github-runner-207 kernel: [42324.560110] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 17:09:10 juju-e4d256-prod-github-runner-207 kernel: [42324.562701] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 17:09:10 juju-e4d256-prod-github-runner-207 kernel: [42324.563754] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 17:09:10 juju-e4d256-prod-github-runner-207 kernel: [42324.564936] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 17:09:10 juju-e4d256-prod-github-runner-207 kernel: [42324.566101] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 17:09:10 juju-e4d256-prod-github-runner-207 kernel: [42324.567277] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 17:09:10 juju-e4d256-prod-github-runner-207 kernel: [42324.568443] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 17:09:10 juju-e4d256-prod-github-runner-207 kernel: [42324.569636] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 17:09:10 juju-e4d256-prod-github-runner-207 kernel: [42324.570882] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 17:09:10 juju-e4d256-prod-github-runner-207 kernel: [42324.571982] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 17:09:10 juju-e4d256-prod-github-runner-207 kernel: [42324.573202] Call Trace: Aug 22 17:09:10 juju-e4d256-prod-github-runner-207 kernel: [42324.574121] Aug 22 17:09:10 juju-e4d256-prod-github-runner-207 kernel: [42324.575013] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:09:10 juju-e4d256-prod-github-runner-207 kernel: [42324.576041] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:09:10 juju-e4d256-prod-github-runner-207 kernel: [42324.577082] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:09:10 juju-e4d256-prod-github-runner-207 kernel: [42324.578163] ? show_regs.part.0+0x23/0x29 Aug 22 17:09:10 juju-e4d256-prod-github-runner-207 kernel: [42324.579168] ? show_regs.cold+0x8/0xd Aug 22 17:09:10 juju-e4d256-prod-github-runner-207 kernel: [42324.580143] ? watchdog_timer_fn+0x1be/0x220 Aug 22 17:09:10 juju-e4d256-prod-github-runner-207 kernel: [42324.581174] ? lockup_detector_update_enable+0x60/0x60 Aug 22 17:09:10 juju-e4d256-prod-github-runner-207 kernel: [42324.582267] ? __hrtimer_run_queues+0x107/0x230 Aug 22 17:09:10 juju-e4d256-prod-github-runner-207 kernel: [42324.583314] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 17:09:10 juju-e4d256-prod-github-runner-207 kernel: [42324.584342] ? hrtimer_interrupt+0x101/0x220 Aug 22 17:09:10 juju-e4d256-prod-github-runner-207 kernel: [42324.585377] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 17:09:10 juju-e4d256-prod-github-runner-207 kernel: [42324.586446] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 17:09:10 juju-e4d256-prod-github-runner-207 kernel: [42324.587504] Aug 22 17:09:10 juju-e4d256-prod-github-runner-207 kernel: [42324.588356] Aug 22 17:09:10 juju-e4d256-prod-github-runner-207 kernel: [42324.589239] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 17:09:10 juju-e4d256-prod-github-runner-207 kernel: [42324.590278] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:09:10 juju-e4d256-prod-github-runner-207 kernel: [42324.591343] ? _raw_spin_lock+0x22/0x30 Aug 22 17:09:10 juju-e4d256-prod-github-runner-207 kernel: [42324.592292] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:09:10 juju-e4d256-prod-github-runner-207 kernel: [42324.593337] direct_page_fault+0x206/0x310 [kvm] Aug 22 17:09:10 juju-e4d256-prod-github-runner-207 kernel: [42324.594363] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 17:09:10 juju-e4d256-prod-github-runner-207 kernel: [42324.595552] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 17:09:10 juju-e4d256-prod-github-runner-207 kernel: [42324.596963] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 17:09:10 juju-e4d256-prod-github-runner-207 kernel: [42324.597958] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 17:09:10 juju-e4d256-prod-github-runner-207 kernel: [42324.598914] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 17:09:10 juju-e4d256-prod-github-runner-207 kernel: [42324.599900] handle_exit+0x98/0x230 [kvm_amd] Aug 22 17:09:10 juju-e4d256-prod-github-runner-207 kernel: [42324.600824] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 17:09:10 juju-e4d256-prod-github-runner-207 kernel: [42324.601751] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 17:09:10 juju-e4d256-prod-github-runner-207 kernel: [42324.602687] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 17:09:10 juju-e4d256-prod-github-runner-207 kernel: [42324.603606] vcpu_run+0x62/0x2c0 [kvm] Aug 22 17:09:10 juju-e4d256-prod-github-runner-207 kernel: [42324.604419] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 17:09:10 juju-e4d256-prod-github-runner-207 kernel: [42324.605250] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 17:09:10 juju-e4d256-prod-github-runner-207 kernel: [42324.606111] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 17:09:10 juju-e4d256-prod-github-runner-207 kernel: [42324.606918] ? __seccomp_filter+0x4a/0x4a0 Aug 22 17:09:10 juju-e4d256-prod-github-runner-207 kernel: [42324.607664] ? __fget_files+0x86/0xc0 Aug 22 17:09:10 juju-e4d256-prod-github-runner-207 kernel: [42324.608369] __x64_sys_ioctl+0x95/0xd0 Aug 22 17:09:10 juju-e4d256-prod-github-runner-207 kernel: [42324.609088] do_syscall_64+0x5c/0xc0 Aug 22 17:09:10 juju-e4d256-prod-github-runner-207 kernel: [42324.609757] ? do_futex+0x162/0x1f0 Aug 22 17:09:10 juju-e4d256-prod-github-runner-207 kernel: [42324.610410] ? __x64_sys_futex+0x78/0x1e0 Aug 22 17:09:10 juju-e4d256-prod-github-runner-207 kernel: [42324.611103] ? __secure_computing+0xa9/0x120 Aug 22 17:09:10 juju-e4d256-prod-github-runner-207 kernel: [42324.611817] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 17:09:10 juju-e4d256-prod-github-runner-207 kernel: [42324.612592] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:09:10 juju-e4d256-prod-github-runner-207 kernel: [42324.613400] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:09:10 juju-e4d256-prod-github-runner-207 kernel: [42324.614295] ? do_syscall_64+0x69/0xc0 Aug 22 17:09:10 juju-e4d256-prod-github-runner-207 kernel: [42324.614958] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:09:10 juju-e4d256-prod-github-runner-207 kernel: [42324.615661] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:09:10 juju-e4d256-prod-github-runner-207 kernel: [42324.616357] ? do_syscall_64+0x69/0xc0 Aug 22 17:09:10 juju-e4d256-prod-github-runner-207 kernel: [42324.617006] ? do_syscall_64+0x69/0xc0 Aug 22 17:09:10 juju-e4d256-prod-github-runner-207 kernel: [42324.617637] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 17:09:10 juju-e4d256-prod-github-runner-207 kernel: [42324.618345] RIP: 0033:0x7faa5d0edaff Aug 22 17:09:10 juju-e4d256-prod-github-runner-207 kernel: [42324.619005] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 17:09:10 juju-e4d256-prod-github-runner-207 kernel: [42324.621012] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 17:09:10 juju-e4d256-prod-github-runner-207 kernel: [42324.621924] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 17:09:10 juju-e4d256-prod-github-runner-207 kernel: [42324.622819] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 17:09:10 juju-e4d256-prod-github-runner-207 kernel: [42324.623717] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 17:09:10 juju-e4d256-prod-github-runner-207 kernel: [42324.624605] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 17:09:10 juju-e4d256-prod-github-runner-207 kernel: [42324.625516] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 17:09:10 juju-e4d256-prod-github-runner-207 kernel: [42324.626407] Aug 22 17:09:38 juju-e4d256-prod-github-runner-207 kernel: [42352.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 39335s! [qemu-system-x86:6715] Aug 22 17:09:38 juju-e4d256-prod-github-runner-207 kernel: [42352.543740] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 17:09:38 juju-e4d256-prod-github-runner-207 kernel: [42352.543983] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 17:09:38 juju-e4d256-prod-github-runner-207 kernel: [42352.556146] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 17:09:38 juju-e4d256-prod-github-runner-207 kernel: [42352.557444] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 17:09:38 juju-e4d256-prod-github-runner-207 kernel: [42352.558664] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:09:38 juju-e4d256-prod-github-runner-207 kernel: [42352.559718] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 17:09:38 juju-e4d256-prod-github-runner-207 kernel: [42352.562278] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 17:09:38 juju-e4d256-prod-github-runner-207 kernel: [42352.563316] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 17:09:38 juju-e4d256-prod-github-runner-207 kernel: [42352.564492] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 17:09:38 juju-e4d256-prod-github-runner-207 kernel: [42352.565652] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 17:09:38 juju-e4d256-prod-github-runner-207 kernel: [42352.566812] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 17:09:38 juju-e4d256-prod-github-runner-207 kernel: [42352.567969] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 17:09:38 juju-e4d256-prod-github-runner-207 kernel: [42352.569143] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 17:09:38 juju-e4d256-prod-github-runner-207 kernel: [42352.570378] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 17:09:38 juju-e4d256-prod-github-runner-207 kernel: [42352.571472] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 17:09:38 juju-e4d256-prod-github-runner-207 kernel: [42352.572676] Call Trace: Aug 22 17:09:38 juju-e4d256-prod-github-runner-207 kernel: [42352.573592] Aug 22 17:09:38 juju-e4d256-prod-github-runner-207 kernel: [42352.574492] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:09:38 juju-e4d256-prod-github-runner-207 kernel: [42352.575525] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:09:38 juju-e4d256-prod-github-runner-207 kernel: [42352.576561] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:09:38 juju-e4d256-prod-github-runner-207 kernel: [42352.577655] ? show_regs.part.0+0x23/0x29 Aug 22 17:09:38 juju-e4d256-prod-github-runner-207 kernel: [42352.578649] ? show_regs.cold+0x8/0xd Aug 22 17:09:38 juju-e4d256-prod-github-runner-207 kernel: [42352.579617] ? watchdog_timer_fn+0x1be/0x220 Aug 22 17:09:38 juju-e4d256-prod-github-runner-207 kernel: [42352.580639] ? lockup_detector_update_enable+0x60/0x60 Aug 22 17:09:38 juju-e4d256-prod-github-runner-207 kernel: [42352.581700] ? __hrtimer_run_queues+0x107/0x230 Aug 22 17:09:38 juju-e4d256-prod-github-runner-207 kernel: [42352.582726] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 17:09:38 juju-e4d256-prod-github-runner-207 kernel: [42352.583747] ? hrtimer_interrupt+0x101/0x220 Aug 22 17:09:38 juju-e4d256-prod-github-runner-207 kernel: [42352.584774] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 17:09:38 juju-e4d256-prod-github-runner-207 kernel: [42352.585852] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 17:09:38 juju-e4d256-prod-github-runner-207 kernel: [42352.586907] Aug 22 17:09:38 juju-e4d256-prod-github-runner-207 kernel: [42352.587762] Aug 22 17:09:38 juju-e4d256-prod-github-runner-207 kernel: [42352.588620] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 17:09:38 juju-e4d256-prod-github-runner-207 kernel: [42352.589659] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:09:38 juju-e4d256-prod-github-runner-207 kernel: [42352.590699] ? _raw_spin_lock+0x22/0x30 Aug 22 17:09:38 juju-e4d256-prod-github-runner-207 kernel: [42352.591649] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:09:38 juju-e4d256-prod-github-runner-207 kernel: [42352.592692] direct_page_fault+0x206/0x310 [kvm] Aug 22 17:09:38 juju-e4d256-prod-github-runner-207 kernel: [42352.593717] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 17:09:38 juju-e4d256-prod-github-runner-207 kernel: [42352.594726] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 17:09:38 juju-e4d256-prod-github-runner-207 kernel: [42352.595749] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 17:09:38 juju-e4d256-prod-github-runner-207 kernel: [42352.596791] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 17:09:38 juju-e4d256-prod-github-runner-207 kernel: [42352.597739] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 17:09:38 juju-e4d256-prod-github-runner-207 kernel: [42352.598720] handle_exit+0x98/0x230 [kvm_amd] Aug 22 17:09:38 juju-e4d256-prod-github-runner-207 kernel: [42352.599611] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 17:09:38 juju-e4d256-prod-github-runner-207 kernel: [42352.600555] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 17:09:38 juju-e4d256-prod-github-runner-207 kernel: [42352.601480] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 17:09:38 juju-e4d256-prod-github-runner-207 kernel: [42352.602382] vcpu_run+0x62/0x2c0 [kvm] Aug 22 17:09:38 juju-e4d256-prod-github-runner-207 kernel: [42352.603190] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 17:09:38 juju-e4d256-prod-github-runner-207 kernel: [42352.603997] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 17:09:38 juju-e4d256-prod-github-runner-207 kernel: [42352.604875] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 17:09:38 juju-e4d256-prod-github-runner-207 kernel: [42352.605673] ? __seccomp_filter+0x4a/0x4a0 Aug 22 17:09:38 juju-e4d256-prod-github-runner-207 kernel: [42352.606419] ? __fget_files+0x86/0xc0 Aug 22 17:09:38 juju-e4d256-prod-github-runner-207 kernel: [42352.607122] __x64_sys_ioctl+0x95/0xd0 Aug 22 17:09:38 juju-e4d256-prod-github-runner-207 kernel: [42352.607814] do_syscall_64+0x5c/0xc0 Aug 22 17:09:38 juju-e4d256-prod-github-runner-207 kernel: [42352.608495] ? do_futex+0x162/0x1f0 Aug 22 17:09:38 juju-e4d256-prod-github-runner-207 kernel: [42352.609145] ? __x64_sys_futex+0x78/0x1e0 Aug 22 17:09:38 juju-e4d256-prod-github-runner-207 kernel: [42352.609817] ? __secure_computing+0xa9/0x120 Aug 22 17:09:38 juju-e4d256-prod-github-runner-207 kernel: [42352.610506] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 17:09:38 juju-e4d256-prod-github-runner-207 kernel: [42352.611400] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:09:38 juju-e4d256-prod-github-runner-207 kernel: [42352.612121] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:09:38 juju-e4d256-prod-github-runner-207 kernel: [42352.612853] ? do_syscall_64+0x69/0xc0 Aug 22 17:09:38 juju-e4d256-prod-github-runner-207 kernel: [42352.613497] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:09:38 juju-e4d256-prod-github-runner-207 kernel: [42352.614204] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:09:38 juju-e4d256-prod-github-runner-207 kernel: [42352.614899] ? do_syscall_64+0x69/0xc0 Aug 22 17:09:38 juju-e4d256-prod-github-runner-207 kernel: [42352.615523] ? do_syscall_64+0x69/0xc0 Aug 22 17:09:38 juju-e4d256-prod-github-runner-207 kernel: [42352.616144] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 17:09:38 juju-e4d256-prod-github-runner-207 kernel: [42352.616869] RIP: 0033:0x7faa5d0edaff Aug 22 17:09:38 juju-e4d256-prod-github-runner-207 kernel: [42352.617544] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 17:09:38 juju-e4d256-prod-github-runner-207 kernel: [42352.619530] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 17:09:38 juju-e4d256-prod-github-runner-207 kernel: [42352.620578] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 17:09:38 juju-e4d256-prod-github-runner-207 kernel: [42352.621497] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 17:09:38 juju-e4d256-prod-github-runner-207 kernel: [42352.622462] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 17:09:38 juju-e4d256-prod-github-runner-207 kernel: [42352.623349] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 17:09:38 juju-e4d256-prod-github-runner-207 kernel: [42352.624242] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 17:09:38 juju-e4d256-prod-github-runner-207 kernel: [42352.625174] Aug 22 17:10:06 juju-e4d256-prod-github-runner-207 kernel: [42380.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 39361s! [qemu-system-x86:6715] Aug 22 17:10:06 juju-e4d256-prod-github-runner-207 kernel: [42380.543093] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 17:10:06 juju-e4d256-prod-github-runner-207 kernel: [42380.543160] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 17:10:06 juju-e4d256-prod-github-runner-207 kernel: [42380.555267] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 17:10:06 juju-e4d256-prod-github-runner-207 kernel: [42380.556545] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 17:10:06 juju-e4d256-prod-github-runner-207 kernel: [42380.557769] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:10:06 juju-e4d256-prod-github-runner-207 kernel: [42380.558828] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 17:10:06 juju-e4d256-prod-github-runner-207 kernel: [42380.561388] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 17:10:06 juju-e4d256-prod-github-runner-207 kernel: [42380.562433] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 17:10:06 juju-e4d256-prod-github-runner-207 kernel: [42380.563601] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 17:10:06 juju-e4d256-prod-github-runner-207 kernel: [42380.564962] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 17:10:06 juju-e4d256-prod-github-runner-207 kernel: [42380.566277] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 17:10:06 juju-e4d256-prod-github-runner-207 kernel: [42380.567579] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 17:10:06 juju-e4d256-prod-github-runner-207 kernel: [42380.568893] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 17:10:06 juju-e4d256-prod-github-runner-207 kernel: [42380.570283] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 17:10:06 juju-e4d256-prod-github-runner-207 kernel: [42380.571495] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 17:10:06 juju-e4d256-prod-github-runner-207 kernel: [42380.572838] Call Trace: Aug 22 17:10:06 juju-e4d256-prod-github-runner-207 kernel: [42380.573818] Aug 22 17:10:06 juju-e4d256-prod-github-runner-207 kernel: [42380.574749] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:10:06 juju-e4d256-prod-github-runner-207 kernel: [42380.575867] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:10:06 juju-e4d256-prod-github-runner-207 kernel: [42380.576982] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:10:06 juju-e4d256-prod-github-runner-207 kernel: [42380.578162] ? show_regs.part.0+0x23/0x29 Aug 22 17:10:06 juju-e4d256-prod-github-runner-207 kernel: [42380.579289] ? show_regs.cold+0x8/0xd Aug 22 17:10:06 juju-e4d256-prod-github-runner-207 kernel: [42380.580421] ? watchdog_timer_fn+0x1be/0x220 Aug 22 17:10:06 juju-e4d256-prod-github-runner-207 kernel: [42380.581543] ? lockup_detector_update_enable+0x60/0x60 Aug 22 17:10:06 juju-e4d256-prod-github-runner-207 kernel: [42380.582718] ? __hrtimer_run_queues+0x107/0x230 Aug 22 17:10:06 juju-e4d256-prod-github-runner-207 kernel: [42380.583847] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 17:10:06 juju-e4d256-prod-github-runner-207 kernel: [42380.584981] ? hrtimer_interrupt+0x101/0x220 Aug 22 17:10:06 juju-e4d256-prod-github-runner-207 kernel: [42380.586089] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 17:10:06 juju-e4d256-prod-github-runner-207 kernel: [42380.587264] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 17:10:06 juju-e4d256-prod-github-runner-207 kernel: [42380.588440] Aug 22 17:10:06 juju-e4d256-prod-github-runner-207 kernel: [42380.589343] Aug 22 17:10:06 juju-e4d256-prod-github-runner-207 kernel: [42380.590246] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 17:10:06 juju-e4d256-prod-github-runner-207 kernel: [42380.591389] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:10:06 juju-e4d256-prod-github-runner-207 kernel: [42380.592550] ? _raw_spin_lock+0x22/0x30 Aug 22 17:10:06 juju-e4d256-prod-github-runner-207 kernel: [42380.593593] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:10:06 juju-e4d256-prod-github-runner-207 kernel: [42380.594710] direct_page_fault+0x206/0x310 [kvm] Aug 22 17:10:06 juju-e4d256-prod-github-runner-207 kernel: [42380.595828] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 17:10:06 juju-e4d256-prod-github-runner-207 kernel: [42380.596961] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 17:10:06 juju-e4d256-prod-github-runner-207 kernel: [42380.598063] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 17:10:06 juju-e4d256-prod-github-runner-207 kernel: [42380.599136] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 17:10:06 juju-e4d256-prod-github-runner-207 kernel: [42380.600204] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 17:10:06 juju-e4d256-prod-github-runner-207 kernel: [42380.601302] handle_exit+0x98/0x230 [kvm_amd] Aug 22 17:10:06 juju-e4d256-prod-github-runner-207 kernel: [42380.602292] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 17:10:06 juju-e4d256-prod-github-runner-207 kernel: [42380.603302] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 17:10:06 juju-e4d256-prod-github-runner-207 kernel: [42380.604348] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 17:10:06 juju-e4d256-prod-github-runner-207 kernel: [42380.605354] vcpu_run+0x62/0x2c0 [kvm] Aug 22 17:10:06 juju-e4d256-prod-github-runner-207 kernel: [42380.606252] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 17:10:06 juju-e4d256-prod-github-runner-207 kernel: [42380.607162] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 17:10:06 juju-e4d256-prod-github-runner-207 kernel: [42380.608164] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 17:10:06 juju-e4d256-prod-github-runner-207 kernel: [42380.609072] ? __seccomp_filter+0x4a/0x4a0 Aug 22 17:10:06 juju-e4d256-prod-github-runner-207 kernel: [42380.609900] ? __fget_files+0x86/0xc0 Aug 22 17:10:06 juju-e4d256-prod-github-runner-207 kernel: [42380.610680] __x64_sys_ioctl+0x95/0xd0 Aug 22 17:10:06 juju-e4d256-prod-github-runner-207 kernel: [42380.611449] do_syscall_64+0x5c/0xc0 Aug 22 17:10:06 juju-e4d256-prod-github-runner-207 kernel: [42380.612215] ? do_futex+0x162/0x1f0 Aug 22 17:10:06 juju-e4d256-prod-github-runner-207 kernel: [42380.612943] ? __x64_sys_futex+0x78/0x1e0 Aug 22 17:10:06 juju-e4d256-prod-github-runner-207 kernel: [42380.613698] ? __secure_computing+0xa9/0x120 Aug 22 17:10:06 juju-e4d256-prod-github-runner-207 kernel: [42380.614474] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 17:10:06 juju-e4d256-prod-github-runner-207 kernel: [42380.615514] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:10:06 juju-e4d256-prod-github-runner-207 kernel: [42380.616353] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:10:06 juju-e4d256-prod-github-runner-207 kernel: [42380.617172] ? do_syscall_64+0x69/0xc0 Aug 22 17:10:06 juju-e4d256-prod-github-runner-207 kernel: [42380.617892] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:10:06 juju-e4d256-prod-github-runner-207 kernel: [42380.618693] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:10:06 juju-e4d256-prod-github-runner-207 kernel: [42380.619480] ? do_syscall_64+0x69/0xc0 Aug 22 17:10:06 juju-e4d256-prod-github-runner-207 kernel: [42380.620198] ? do_syscall_64+0x69/0xc0 Aug 22 17:10:06 juju-e4d256-prod-github-runner-207 kernel: [42380.620908] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 17:10:06 juju-e4d256-prod-github-runner-207 kernel: [42380.621903] RIP: 0033:0x7faa5d0edaff Aug 22 17:10:06 juju-e4d256-prod-github-runner-207 kernel: [42380.622536] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 17:10:06 juju-e4d256-prod-github-runner-207 kernel: [42380.624553] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 17:10:06 juju-e4d256-prod-github-runner-207 kernel: [42380.625467] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 17:10:06 juju-e4d256-prod-github-runner-207 kernel: [42380.626360] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 17:10:06 juju-e4d256-prod-github-runner-207 kernel: [42380.627256] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 17:10:06 juju-e4d256-prod-github-runner-207 kernel: [42380.628173] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 17:10:06 juju-e4d256-prod-github-runner-207 kernel: [42380.629064] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 17:10:06 juju-e4d256-prod-github-runner-207 kernel: [42380.629961] Aug 22 17:10:34 juju-e4d256-prod-github-runner-207 kernel: [42408.541976] watchdog: BUG: soft lockup - CPU#1 stuck for 39388s! [qemu-system-x86:6715] Aug 22 17:10:34 juju-e4d256-prod-github-runner-207 kernel: [42408.543097] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 17:10:34 juju-e4d256-prod-github-runner-207 kernel: [42408.543163] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 17:10:34 juju-e4d256-prod-github-runner-207 kernel: [42408.555266] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 17:10:34 juju-e4d256-prod-github-runner-207 kernel: [42408.556728] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 17:10:34 juju-e4d256-prod-github-runner-207 kernel: [42408.557955] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:10:34 juju-e4d256-prod-github-runner-207 kernel: [42408.559010] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 17:10:34 juju-e4d256-prod-github-runner-207 kernel: [42408.561586] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 17:10:34 juju-e4d256-prod-github-runner-207 kernel: [42408.562628] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 17:10:34 juju-e4d256-prod-github-runner-207 kernel: [42408.563802] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 17:10:34 juju-e4d256-prod-github-runner-207 kernel: [42408.564967] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 17:10:34 juju-e4d256-prod-github-runner-207 kernel: [42408.566288] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 17:10:34 juju-e4d256-prod-github-runner-207 kernel: [42408.567611] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 17:10:34 juju-e4d256-prod-github-runner-207 kernel: [42408.568802] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 17:10:34 juju-e4d256-prod-github-runner-207 kernel: [42408.570028] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 17:10:34 juju-e4d256-prod-github-runner-207 kernel: [42408.571125] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 17:10:34 juju-e4d256-prod-github-runner-207 kernel: [42408.572331] Call Trace: Aug 22 17:10:34 juju-e4d256-prod-github-runner-207 kernel: [42408.573242] Aug 22 17:10:34 juju-e4d256-prod-github-runner-207 kernel: [42408.574129] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:10:34 juju-e4d256-prod-github-runner-207 kernel: [42408.575177] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:10:34 juju-e4d256-prod-github-runner-207 kernel: [42408.576227] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:10:34 juju-e4d256-prod-github-runner-207 kernel: [42408.577298] ? show_regs.part.0+0x23/0x29 Aug 22 17:10:34 juju-e4d256-prod-github-runner-207 kernel: [42408.578292] ? show_regs.cold+0x8/0xd Aug 22 17:10:34 juju-e4d256-prod-github-runner-207 kernel: [42408.579265] ? watchdog_timer_fn+0x1be/0x220 Aug 22 17:10:34 juju-e4d256-prod-github-runner-207 kernel: [42408.580343] ? lockup_detector_update_enable+0x60/0x60 Aug 22 17:10:34 juju-e4d256-prod-github-runner-207 kernel: [42408.581432] ? __hrtimer_run_queues+0x107/0x230 Aug 22 17:10:34 juju-e4d256-prod-github-runner-207 kernel: [42408.582463] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 17:10:34 juju-e4d256-prod-github-runner-207 kernel: [42408.583483] ? hrtimer_interrupt+0x101/0x220 Aug 22 17:10:34 juju-e4d256-prod-github-runner-207 kernel: [42408.584509] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 17:10:34 juju-e4d256-prod-github-runner-207 kernel: [42408.585580] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 17:10:34 juju-e4d256-prod-github-runner-207 kernel: [42408.586628] Aug 22 17:10:34 juju-e4d256-prod-github-runner-207 kernel: [42408.587481] Aug 22 17:10:34 juju-e4d256-prod-github-runner-207 kernel: [42408.588357] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 17:10:34 juju-e4d256-prod-github-runner-207 kernel: [42408.589407] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:10:34 juju-e4d256-prod-github-runner-207 kernel: [42408.590457] ? _raw_spin_lock+0x22/0x30 Aug 22 17:10:34 juju-e4d256-prod-github-runner-207 kernel: [42408.591408] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:10:34 juju-e4d256-prod-github-runner-207 kernel: [42408.592444] direct_page_fault+0x206/0x310 [kvm] Aug 22 17:10:34 juju-e4d256-prod-github-runner-207 kernel: [42408.593473] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 17:10:34 juju-e4d256-prod-github-runner-207 kernel: [42408.594480] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 17:10:34 juju-e4d256-prod-github-runner-207 kernel: [42408.595478] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 17:10:34 juju-e4d256-prod-github-runner-207 kernel: [42408.596459] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 17:10:34 juju-e4d256-prod-github-runner-207 kernel: [42408.597404] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 17:10:34 juju-e4d256-prod-github-runner-207 kernel: [42408.598385] handle_exit+0x98/0x230 [kvm_amd] Aug 22 17:10:34 juju-e4d256-prod-github-runner-207 kernel: [42408.599283] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 17:10:34 juju-e4d256-prod-github-runner-207 kernel: [42408.600242] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 17:10:34 juju-e4d256-prod-github-runner-207 kernel: [42408.601176] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 17:10:34 juju-e4d256-prod-github-runner-207 kernel: [42408.602087] vcpu_run+0x62/0x2c0 [kvm] Aug 22 17:10:34 juju-e4d256-prod-github-runner-207 kernel: [42408.602898] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 17:10:34 juju-e4d256-prod-github-runner-207 kernel: [42408.603706] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 17:10:34 juju-e4d256-prod-github-runner-207 kernel: [42408.604583] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 17:10:34 juju-e4d256-prod-github-runner-207 kernel: [42408.605397] ? __seccomp_filter+0x4a/0x4a0 Aug 22 17:10:34 juju-e4d256-prod-github-runner-207 kernel: [42408.606154] ? __fget_files+0x86/0xc0 Aug 22 17:10:34 juju-e4d256-prod-github-runner-207 kernel: [42408.606863] __x64_sys_ioctl+0x95/0xd0 Aug 22 17:10:34 juju-e4d256-prod-github-runner-207 kernel: [42408.607563] do_syscall_64+0x5c/0xc0 Aug 22 17:10:34 juju-e4d256-prod-github-runner-207 kernel: [42408.608270] ? do_futex+0x162/0x1f0 Aug 22 17:10:34 juju-e4d256-prod-github-runner-207 kernel: [42408.608925] ? __x64_sys_futex+0x78/0x1e0 Aug 22 17:10:34 juju-e4d256-prod-github-runner-207 kernel: [42408.609604] ? __secure_computing+0xa9/0x120 Aug 22 17:10:34 juju-e4d256-prod-github-runner-207 kernel: [42408.610291] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 17:10:34 juju-e4d256-prod-github-runner-207 kernel: [42408.611048] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:10:34 juju-e4d256-prod-github-runner-207 kernel: [42408.611788] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:10:34 juju-e4d256-prod-github-runner-207 kernel: [42408.612504] ? do_syscall_64+0x69/0xc0 Aug 22 17:10:34 juju-e4d256-prod-github-runner-207 kernel: [42408.613147] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:10:34 juju-e4d256-prod-github-runner-207 kernel: [42408.613853] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:10:34 juju-e4d256-prod-github-runner-207 kernel: [42408.614550] ? do_syscall_64+0x69/0xc0 Aug 22 17:10:34 juju-e4d256-prod-github-runner-207 kernel: [42408.615173] ? do_syscall_64+0x69/0xc0 Aug 22 17:10:34 juju-e4d256-prod-github-runner-207 kernel: [42408.615809] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 17:10:34 juju-e4d256-prod-github-runner-207 kernel: [42408.616513] RIP: 0033:0x7faa5d0edaff Aug 22 17:10:34 juju-e4d256-prod-github-runner-207 kernel: [42408.617134] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 17:10:34 juju-e4d256-prod-github-runner-207 kernel: [42408.619113] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 17:10:34 juju-e4d256-prod-github-runner-207 kernel: [42408.620036] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 17:10:34 juju-e4d256-prod-github-runner-207 kernel: [42408.620929] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 17:10:34 juju-e4d256-prod-github-runner-207 kernel: [42408.621815] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 17:10:34 juju-e4d256-prod-github-runner-207 kernel: [42408.622711] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 17:10:34 juju-e4d256-prod-github-runner-207 kernel: [42408.623609] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 17:10:34 juju-e4d256-prod-github-runner-207 kernel: [42408.624511] Aug 22 17:11:02 juju-e4d256-prod-github-runner-207 kernel: [42436.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 39414s! [qemu-system-x86:6715] Aug 22 17:11:02 juju-e4d256-prod-github-runner-207 kernel: [42436.543701] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 17:11:02 juju-e4d256-prod-github-runner-207 kernel: [42436.543950] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 17:11:02 juju-e4d256-prod-github-runner-207 kernel: [42436.556576] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 17:11:02 juju-e4d256-prod-github-runner-207 kernel: [42436.558032] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 17:11:02 juju-e4d256-prod-github-runner-207 kernel: [42436.559468] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:11:02 juju-e4d256-prod-github-runner-207 kernel: [42436.560641] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 17:11:02 juju-e4d256-prod-github-runner-207 kernel: [42436.563552] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 17:11:02 juju-e4d256-prod-github-runner-207 kernel: [42436.564706] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 17:11:02 juju-e4d256-prod-github-runner-207 kernel: [42436.566015] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 17:11:02 juju-e4d256-prod-github-runner-207 kernel: [42436.567310] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 17:11:02 juju-e4d256-prod-github-runner-207 kernel: [42436.568635] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 17:11:02 juju-e4d256-prod-github-runner-207 kernel: [42436.569948] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 17:11:02 juju-e4d256-prod-github-runner-207 kernel: [42436.571252] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 17:11:02 juju-e4d256-prod-github-runner-207 kernel: [42436.572662] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 17:11:02 juju-e4d256-prod-github-runner-207 kernel: [42436.573875] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 17:11:02 juju-e4d256-prod-github-runner-207 kernel: [42436.575209] Call Trace: Aug 22 17:11:02 juju-e4d256-prod-github-runner-207 kernel: [42436.576231] Aug 22 17:11:02 juju-e4d256-prod-github-runner-207 kernel: [42436.577179] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:11:02 juju-e4d256-prod-github-runner-207 kernel: [42436.578300] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:11:02 juju-e4d256-prod-github-runner-207 kernel: [42436.579411] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:11:02 juju-e4d256-prod-github-runner-207 kernel: [42436.580625] ? show_regs.part.0+0x23/0x29 Aug 22 17:11:02 juju-e4d256-prod-github-runner-207 kernel: [42436.581706] ? show_regs.cold+0x8/0xd Aug 22 17:11:02 juju-e4d256-prod-github-runner-207 kernel: [42436.582763] ? watchdog_timer_fn+0x1be/0x220 Aug 22 17:11:02 juju-e4d256-prod-github-runner-207 kernel: [42436.583886] ? lockup_detector_update_enable+0x60/0x60 Aug 22 17:11:02 juju-e4d256-prod-github-runner-207 kernel: [42436.585053] ? __hrtimer_run_queues+0x107/0x230 Aug 22 17:11:02 juju-e4d256-prod-github-runner-207 kernel: [42436.586181] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 17:11:02 juju-e4d256-prod-github-runner-207 kernel: [42436.587293] ? hrtimer_interrupt+0x101/0x220 Aug 22 17:11:02 juju-e4d256-prod-github-runner-207 kernel: [42436.588423] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 17:11:02 juju-e4d256-prod-github-runner-207 kernel: [42436.589599] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 17:11:02 juju-e4d256-prod-github-runner-207 kernel: [42436.590743] Aug 22 17:11:02 juju-e4d256-prod-github-runner-207 kernel: [42436.591674] Aug 22 17:11:02 juju-e4d256-prod-github-runner-207 kernel: [42436.592517] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 17:11:02 juju-e4d256-prod-github-runner-207 kernel: [42436.593684] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:11:02 juju-e4d256-prod-github-runner-207 kernel: [42436.594841] ? _raw_spin_lock+0x22/0x30 Aug 22 17:11:02 juju-e4d256-prod-github-runner-207 kernel: [42436.595891] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:11:02 juju-e4d256-prod-github-runner-207 kernel: [42436.597003] direct_page_fault+0x206/0x310 [kvm] Aug 22 17:11:02 juju-e4d256-prod-github-runner-207 kernel: [42436.598123] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 17:11:02 juju-e4d256-prod-github-runner-207 kernel: [42436.599222] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 17:11:02 juju-e4d256-prod-github-runner-207 kernel: [42436.600336] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 17:11:02 juju-e4d256-prod-github-runner-207 kernel: [42436.601349] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 17:11:02 juju-e4d256-prod-github-runner-207 kernel: [42436.602310] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 17:11:02 juju-e4d256-prod-github-runner-207 kernel: [42436.603297] handle_exit+0x98/0x230 [kvm_amd] Aug 22 17:11:02 juju-e4d256-prod-github-runner-207 kernel: [42436.604216] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 17:11:02 juju-e4d256-prod-github-runner-207 kernel: [42436.605132] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 17:11:02 juju-e4d256-prod-github-runner-207 kernel: [42436.606059] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 17:11:02 juju-e4d256-prod-github-runner-207 kernel: [42436.606963] vcpu_run+0x62/0x2c0 [kvm] Aug 22 17:11:02 juju-e4d256-prod-github-runner-207 kernel: [42436.607798] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 17:11:02 juju-e4d256-prod-github-runner-207 kernel: [42436.608608] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 17:11:02 juju-e4d256-prod-github-runner-207 kernel: [42436.609470] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 17:11:02 juju-e4d256-prod-github-runner-207 kernel: [42436.610269] ? __seccomp_filter+0x4a/0x4a0 Aug 22 17:11:02 juju-e4d256-prod-github-runner-207 kernel: [42436.611015] ? __fget_files+0x86/0xc0 Aug 22 17:11:02 juju-e4d256-prod-github-runner-207 kernel: [42436.611766] __x64_sys_ioctl+0x95/0xd0 Aug 22 17:11:02 juju-e4d256-prod-github-runner-207 kernel: [42436.612461] do_syscall_64+0x5c/0xc0 Aug 22 17:11:02 juju-e4d256-prod-github-runner-207 kernel: [42436.613131] ? do_futex+0x162/0x1f0 Aug 22 17:11:02 juju-e4d256-prod-github-runner-207 kernel: [42436.613783] ? __x64_sys_futex+0x78/0x1e0 Aug 22 17:11:02 juju-e4d256-prod-github-runner-207 kernel: [42436.614458] ? __secure_computing+0xa9/0x120 Aug 22 17:11:02 juju-e4d256-prod-github-runner-207 kernel: [42436.615180] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 17:11:02 juju-e4d256-prod-github-runner-207 kernel: [42436.615972] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:11:02 juju-e4d256-prod-github-runner-207 kernel: [42436.616698] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:11:02 juju-e4d256-prod-github-runner-207 kernel: [42436.617438] ? do_syscall_64+0x69/0xc0 Aug 22 17:11:02 juju-e4d256-prod-github-runner-207 kernel: [42436.618095] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:11:02 juju-e4d256-prod-github-runner-207 kernel: [42436.618806] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:11:02 juju-e4d256-prod-github-runner-207 kernel: [42436.619514] ? do_syscall_64+0x69/0xc0 Aug 22 17:11:02 juju-e4d256-prod-github-runner-207 kernel: [42436.620141] ? do_syscall_64+0x69/0xc0 Aug 22 17:11:02 juju-e4d256-prod-github-runner-207 kernel: [42436.620772] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 17:11:02 juju-e4d256-prod-github-runner-207 kernel: [42436.621485] RIP: 0033:0x7faa5d0edaff Aug 22 17:11:02 juju-e4d256-prod-github-runner-207 kernel: [42436.622139] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 17:11:02 juju-e4d256-prod-github-runner-207 kernel: [42436.624150] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 17:11:02 juju-e4d256-prod-github-runner-207 kernel: [42436.625062] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 17:11:02 juju-e4d256-prod-github-runner-207 kernel: [42436.625953] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 17:11:02 juju-e4d256-prod-github-runner-207 kernel: [42436.626853] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 17:11:02 juju-e4d256-prod-github-runner-207 kernel: [42436.627764] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 17:11:02 juju-e4d256-prod-github-runner-207 kernel: [42436.628654] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 17:11:02 juju-e4d256-prod-github-runner-207 kernel: [42436.629547] Aug 22 17:11:30 juju-e4d256-prod-github-runner-207 kernel: [42464.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 39440s! [qemu-system-x86:6715] Aug 22 17:11:30 juju-e4d256-prod-github-runner-207 kernel: [42464.543120] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 17:11:30 juju-e4d256-prod-github-runner-207 kernel: [42464.543189] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 17:11:30 juju-e4d256-prod-github-runner-207 kernel: [42464.555271] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 17:11:30 juju-e4d256-prod-github-runner-207 kernel: [42464.556535] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 17:11:30 juju-e4d256-prod-github-runner-207 kernel: [42464.557763] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:11:30 juju-e4d256-prod-github-runner-207 kernel: [42464.558823] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 17:11:30 juju-e4d256-prod-github-runner-207 kernel: [42464.561387] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 17:11:30 juju-e4d256-prod-github-runner-207 kernel: [42464.562434] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 17:11:30 juju-e4d256-prod-github-runner-207 kernel: [42464.563603] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 17:11:30 juju-e4d256-prod-github-runner-207 kernel: [42464.564765] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 17:11:30 juju-e4d256-prod-github-runner-207 kernel: [42464.565930] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 17:11:30 juju-e4d256-prod-github-runner-207 kernel: [42464.567106] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 17:11:30 juju-e4d256-prod-github-runner-207 kernel: [42464.568273] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 17:11:30 juju-e4d256-prod-github-runner-207 kernel: [42464.569506] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 17:11:30 juju-e4d256-prod-github-runner-207 kernel: [42464.570604] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 17:11:30 juju-e4d256-prod-github-runner-207 kernel: [42464.571807] Call Trace: Aug 22 17:11:30 juju-e4d256-prod-github-runner-207 kernel: [42464.572726] Aug 22 17:11:30 juju-e4d256-prod-github-runner-207 kernel: [42464.573614] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:11:30 juju-e4d256-prod-github-runner-207 kernel: [42464.574645] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:11:30 juju-e4d256-prod-github-runner-207 kernel: [42464.575675] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:11:30 juju-e4d256-prod-github-runner-207 kernel: [42464.576757] ? show_regs.part.0+0x23/0x29 Aug 22 17:11:30 juju-e4d256-prod-github-runner-207 kernel: [42464.577754] ? show_regs.cold+0x8/0xd Aug 22 17:11:30 juju-e4d256-prod-github-runner-207 kernel: [42464.578724] ? watchdog_timer_fn+0x1be/0x220 Aug 22 17:11:30 juju-e4d256-prod-github-runner-207 kernel: [42464.579753] ? lockup_detector_update_enable+0x60/0x60 Aug 22 17:11:30 juju-e4d256-prod-github-runner-207 kernel: [42464.580817] ? __hrtimer_run_queues+0x107/0x230 Aug 22 17:11:30 juju-e4d256-prod-github-runner-207 kernel: [42464.581843] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 17:11:30 juju-e4d256-prod-github-runner-207 kernel: [42464.582870] ? hrtimer_interrupt+0x101/0x220 Aug 22 17:11:30 juju-e4d256-prod-github-runner-207 kernel: [42464.583895] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 17:11:30 juju-e4d256-prod-github-runner-207 kernel: [42464.584963] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 17:11:30 juju-e4d256-prod-github-runner-207 kernel: [42464.586007] Aug 22 17:11:30 juju-e4d256-prod-github-runner-207 kernel: [42464.586860] Aug 22 17:11:30 juju-e4d256-prod-github-runner-207 kernel: [42464.587850] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 17:11:30 juju-e4d256-prod-github-runner-207 kernel: [42464.588881] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:11:30 juju-e4d256-prod-github-runner-207 kernel: [42464.589931] ? _raw_spin_lock+0x22/0x30 Aug 22 17:11:30 juju-e4d256-prod-github-runner-207 kernel: [42464.590875] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:11:30 juju-e4d256-prod-github-runner-207 kernel: [42464.591904] direct_page_fault+0x206/0x310 [kvm] Aug 22 17:11:30 juju-e4d256-prod-github-runner-207 kernel: [42464.592928] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 17:11:30 juju-e4d256-prod-github-runner-207 kernel: [42464.593935] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 17:11:30 juju-e4d256-prod-github-runner-207 kernel: [42464.594939] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 17:11:30 juju-e4d256-prod-github-runner-207 kernel: [42464.595921] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 17:11:30 juju-e4d256-prod-github-runner-207 kernel: [42464.596868] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 17:11:30 juju-e4d256-prod-github-runner-207 kernel: [42464.597845] handle_exit+0x98/0x230 [kvm_amd] Aug 22 17:11:30 juju-e4d256-prod-github-runner-207 kernel: [42464.598737] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 17:11:30 juju-e4d256-prod-github-runner-207 kernel: [42464.599668] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 17:11:30 juju-e4d256-prod-github-runner-207 kernel: [42464.600592] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 17:11:30 juju-e4d256-prod-github-runner-207 kernel: [42464.601502] vcpu_run+0x62/0x2c0 [kvm] Aug 22 17:11:30 juju-e4d256-prod-github-runner-207 kernel: [42464.602314] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 17:11:30 juju-e4d256-prod-github-runner-207 kernel: [42464.603138] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 17:11:30 juju-e4d256-prod-github-runner-207 kernel: [42464.603992] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 17:11:30 juju-e4d256-prod-github-runner-207 kernel: [42464.604794] ? __seccomp_filter+0x4a/0x4a0 Aug 22 17:11:30 juju-e4d256-prod-github-runner-207 kernel: [42464.605690] ? __fget_files+0x86/0xc0 Aug 22 17:11:30 juju-e4d256-prod-github-runner-207 kernel: [42464.606395] __x64_sys_ioctl+0x95/0xd0 Aug 22 17:11:30 juju-e4d256-prod-github-runner-207 kernel: [42464.607104] do_syscall_64+0x5c/0xc0 Aug 22 17:11:30 juju-e4d256-prod-github-runner-207 kernel: [42464.607770] ? do_futex+0x162/0x1f0 Aug 22 17:11:30 juju-e4d256-prod-github-runner-207 kernel: [42464.608419] ? __x64_sys_futex+0x78/0x1e0 Aug 22 17:11:30 juju-e4d256-prod-github-runner-207 kernel: [42464.609093] ? __secure_computing+0xa9/0x120 Aug 22 17:11:30 juju-e4d256-prod-github-runner-207 kernel: [42464.609784] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 17:11:30 juju-e4d256-prod-github-runner-207 kernel: [42464.610550] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:11:30 juju-e4d256-prod-github-runner-207 kernel: [42464.611284] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:11:30 juju-e4d256-prod-github-runner-207 kernel: [42464.612010] ? do_syscall_64+0x69/0xc0 Aug 22 17:11:30 juju-e4d256-prod-github-runner-207 kernel: [42464.612657] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:11:30 juju-e4d256-prod-github-runner-207 kernel: [42464.613362] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:11:30 juju-e4d256-prod-github-runner-207 kernel: [42464.614059] ? do_syscall_64+0x69/0xc0 Aug 22 17:11:30 juju-e4d256-prod-github-runner-207 kernel: [42464.614685] ? do_syscall_64+0x69/0xc0 Aug 22 17:11:30 juju-e4d256-prod-github-runner-207 kernel: [42464.615329] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 17:11:30 juju-e4d256-prod-github-runner-207 kernel: [42464.616038] RIP: 0033:0x7faa5d0edaff Aug 22 17:11:30 juju-e4d256-prod-github-runner-207 kernel: [42464.616665] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 17:11:30 juju-e4d256-prod-github-runner-207 kernel: [42464.618660] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 17:11:30 juju-e4d256-prod-github-runner-207 kernel: [42464.619585] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 17:11:30 juju-e4d256-prod-github-runner-207 kernel: [42464.620486] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 17:11:30 juju-e4d256-prod-github-runner-207 kernel: [42464.621384] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 17:11:30 juju-e4d256-prod-github-runner-207 kernel: [42464.622276] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 17:11:30 juju-e4d256-prod-github-runner-207 kernel: [42464.623181] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 17:11:30 juju-e4d256-prod-github-runner-207 kernel: [42464.624078] Aug 22 17:11:46 juju-e4d256-prod-github-runner-207 kernel: [42480.020706] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 17:11:46 juju-e4d256-prod-github-runner-207 kernel: [42480.021855] rcu: 1-....: (10557502 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=5108659 Aug 22 17:11:46 juju-e4d256-prod-github-runner-207 kernel: [42480.023015] (t=10590705 jiffies g=23269 q=42525) Aug 22 17:11:46 juju-e4d256-prod-github-runner-207 kernel: [42480.023804] NMI backtrace for cpu 1 Aug 22 17:11:46 juju-e4d256-prod-github-runner-207 kernel: [42480.024514] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 17:11:46 juju-e4d256-prod-github-runner-207 kernel: [42480.025616] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 17:11:46 juju-e4d256-prod-github-runner-207 kernel: [42480.026677] Call Trace: Aug 22 17:11:46 juju-e4d256-prod-github-runner-207 kernel: [42480.027369] Aug 22 17:11:46 juju-e4d256-prod-github-runner-207 kernel: [42480.028017] show_stack+0x52/0x5c Aug 22 17:11:46 juju-e4d256-prod-github-runner-207 kernel: [42480.028743] dump_stack_lvl+0x4a/0x63 Aug 22 17:11:46 juju-e4d256-prod-github-runner-207 kernel: [42480.029514] dump_stack+0x10/0x16 Aug 22 17:11:46 juju-e4d256-prod-github-runner-207 kernel: [42480.030240] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 17:11:46 juju-e4d256-prod-github-runner-207 kernel: [42480.031038] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 17:11:46 juju-e4d256-prod-github-runner-207 kernel: [42480.031825] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 17:11:46 juju-e4d256-prod-github-runner-207 kernel: [42480.032688] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 17:11:46 juju-e4d256-prod-github-runner-207 kernel: [42480.033512] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 17:11:46 juju-e4d256-prod-github-runner-207 kernel: [42480.034664] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 17:11:46 juju-e4d256-prod-github-runner-207 kernel: [42480.035797] print_cpu_stall.cold+0x2f/0xe2 Aug 22 17:11:46 juju-e4d256-prod-github-runner-207 kernel: [42480.036662] ? timekeeping_update+0xf7/0x150 Aug 22 17:11:46 juju-e4d256-prod-github-runner-207 kernel: [42480.037444] check_cpu_stall+0x109/0x270 Aug 22 17:11:46 juju-e4d256-prod-github-runner-207 kernel: [42480.038199] rcu_sched_clock_irq+0x9a/0x250 Aug 22 17:11:46 juju-e4d256-prod-github-runner-207 kernel: [42480.038994] update_process_times+0x94/0xd0 Aug 22 17:11:46 juju-e4d256-prod-github-runner-207 kernel: [42480.039772] tick_sched_handle+0x29/0x70 Aug 22 17:11:46 juju-e4d256-prod-github-runner-207 kernel: [42480.040536] tick_sched_timer+0x8c/0xc0 Aug 22 17:11:46 juju-e4d256-prod-github-runner-207 kernel: [42480.041290] ? tick_nohz_handler+0xb0/0xb0 Aug 22 17:11:46 juju-e4d256-prod-github-runner-207 kernel: [42480.042056] __hrtimer_run_queues+0x107/0x230 Aug 22 17:11:46 juju-e4d256-prod-github-runner-207 kernel: [42480.042837] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 17:11:46 juju-e4d256-prod-github-runner-207 kernel: [42480.043647] hrtimer_interrupt+0x101/0x220 Aug 22 17:11:46 juju-e4d256-prod-github-runner-207 kernel: [42480.044421] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 17:11:46 juju-e4d256-prod-github-runner-207 kernel: [42480.045252] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 17:11:46 juju-e4d256-prod-github-runner-207 kernel: [42480.046074] Aug 22 17:11:46 juju-e4d256-prod-github-runner-207 kernel: [42480.046816] Aug 22 17:11:46 juju-e4d256-prod-github-runner-207 kernel: [42480.047475] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 17:11:46 juju-e4d256-prod-github-runner-207 kernel: [42480.048466] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:11:46 juju-e4d256-prod-github-runner-207 kernel: [42480.049496] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 17:11:46 juju-e4d256-prod-github-runner-207 kernel: [42480.052115] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 17:11:46 juju-e4d256-prod-github-runner-207 kernel: [42480.053147] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 17:11:46 juju-e4d256-prod-github-runner-207 kernel: [42480.054314] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 17:11:46 juju-e4d256-prod-github-runner-207 kernel: [42480.055497] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 17:11:46 juju-e4d256-prod-github-runner-207 kernel: [42480.056662] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 17:11:46 juju-e4d256-prod-github-runner-207 kernel: [42480.057802] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 17:11:46 juju-e4d256-prod-github-runner-207 kernel: [42480.058943] ? _raw_spin_lock+0x22/0x30 Aug 22 17:11:46 juju-e4d256-prod-github-runner-207 kernel: [42480.059789] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:11:46 juju-e4d256-prod-github-runner-207 kernel: [42480.060722] direct_page_fault+0x206/0x310 [kvm] Aug 22 17:11:46 juju-e4d256-prod-github-runner-207 kernel: [42480.061676] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 17:11:46 juju-e4d256-prod-github-runner-207 kernel: [42480.062626] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 17:11:46 juju-e4d256-prod-github-runner-207 kernel: [42480.063557] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 17:11:46 juju-e4d256-prod-github-runner-207 kernel: [42480.064464] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 17:11:46 juju-e4d256-prod-github-runner-207 kernel: [42480.065353] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 17:11:46 juju-e4d256-prod-github-runner-207 kernel: [42480.066290] handle_exit+0x98/0x230 [kvm_amd] Aug 22 17:11:46 juju-e4d256-prod-github-runner-207 kernel: [42480.067159] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 17:11:46 juju-e4d256-prod-github-runner-207 kernel: [42480.068039] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 17:11:46 juju-e4d256-prod-github-runner-207 kernel: [42480.068948] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 17:11:46 juju-e4d256-prod-github-runner-207 kernel: [42480.069838] vcpu_run+0x62/0x2c0 [kvm] Aug 22 17:11:46 juju-e4d256-prod-github-runner-207 kernel: [42480.070641] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 17:11:46 juju-e4d256-prod-github-runner-207 kernel: [42480.071492] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 17:11:46 juju-e4d256-prod-github-runner-207 kernel: [42480.072397] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 17:11:46 juju-e4d256-prod-github-runner-207 kernel: [42480.073249] ? __seccomp_filter+0x4a/0x4a0 Aug 22 17:11:46 juju-e4d256-prod-github-runner-207 kernel: [42480.074055] ? __fget_files+0x86/0xc0 Aug 22 17:11:46 juju-e4d256-prod-github-runner-207 kernel: [42480.074824] __x64_sys_ioctl+0x95/0xd0 Aug 22 17:11:46 juju-e4d256-prod-github-runner-207 kernel: [42480.075615] do_syscall_64+0x5c/0xc0 Aug 22 17:11:46 juju-e4d256-prod-github-runner-207 kernel: [42480.076552] ? do_futex+0x162/0x1f0 Aug 22 17:11:46 juju-e4d256-prod-github-runner-207 kernel: [42480.077302] ? __x64_sys_futex+0x78/0x1e0 Aug 22 17:11:46 juju-e4d256-prod-github-runner-207 kernel: [42480.078093] ? __secure_computing+0xa9/0x120 Aug 22 17:11:46 juju-e4d256-prod-github-runner-207 kernel: [42480.078895] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 17:11:46 juju-e4d256-prod-github-runner-207 kernel: [42480.079811] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:11:46 juju-e4d256-prod-github-runner-207 kernel: [42480.080662] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:11:46 juju-e4d256-prod-github-runner-207 kernel: [42480.081513] ? do_syscall_64+0x69/0xc0 Aug 22 17:11:46 juju-e4d256-prod-github-runner-207 kernel: [42480.082475] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:11:46 juju-e4d256-prod-github-runner-207 kernel: [42480.083376] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:11:46 juju-e4d256-prod-github-runner-207 kernel: [42480.084251] ? do_syscall_64+0x69/0xc0 Aug 22 17:11:46 juju-e4d256-prod-github-runner-207 kernel: [42480.085038] ? do_syscall_64+0x69/0xc0 Aug 22 17:11:46 juju-e4d256-prod-github-runner-207 kernel: [42480.085818] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 17:11:46 juju-e4d256-prod-github-runner-207 kernel: [42480.086696] RIP: 0033:0x7faa5d0edaff Aug 22 17:11:46 juju-e4d256-prod-github-runner-207 kernel: [42480.087468] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 17:11:46 juju-e4d256-prod-github-runner-207 kernel: [42480.089922] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 17:11:46 juju-e4d256-prod-github-runner-207 kernel: [42480.091051] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 17:11:46 juju-e4d256-prod-github-runner-207 kernel: [42480.092139] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 17:11:46 juju-e4d256-prod-github-runner-207 kernel: [42480.093233] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 17:11:46 juju-e4d256-prod-github-runner-207 kernel: [42480.094320] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 17:11:46 juju-e4d256-prod-github-runner-207 kernel: [42480.095410] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 17:11:46 juju-e4d256-prod-github-runner-207 kernel: [42480.096479] Aug 22 17:12:10 juju-e4d256-prod-github-runner-207 kernel: [42504.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 39477s! [qemu-system-x86:6715] Aug 22 17:12:10 juju-e4d256-prod-github-runner-207 kernel: [42504.543130] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 17:12:10 juju-e4d256-prod-github-runner-207 kernel: [42504.543198] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 17:12:10 juju-e4d256-prod-github-runner-207 kernel: [42504.555235] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 17:12:10 juju-e4d256-prod-github-runner-207 kernel: [42504.556494] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 17:12:10 juju-e4d256-prod-github-runner-207 kernel: [42504.557715] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:12:10 juju-e4d256-prod-github-runner-207 kernel: [42504.558782] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 17:12:10 juju-e4d256-prod-github-runner-207 kernel: [42504.561328] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 17:12:10 juju-e4d256-prod-github-runner-207 kernel: [42504.562373] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 17:12:10 juju-e4d256-prod-github-runner-207 kernel: [42504.563545] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 17:12:10 juju-e4d256-prod-github-runner-207 kernel: [42504.564702] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 17:12:10 juju-e4d256-prod-github-runner-207 kernel: [42504.565860] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 17:12:10 juju-e4d256-prod-github-runner-207 kernel: [42504.567034] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 17:12:10 juju-e4d256-prod-github-runner-207 kernel: [42504.568200] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 17:12:10 juju-e4d256-prod-github-runner-207 kernel: [42504.569436] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 17:12:10 juju-e4d256-prod-github-runner-207 kernel: [42504.570532] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 17:12:10 juju-e4d256-prod-github-runner-207 kernel: [42504.571738] Call Trace: Aug 22 17:12:10 juju-e4d256-prod-github-runner-207 kernel: [42504.572655] Aug 22 17:12:10 juju-e4d256-prod-github-runner-207 kernel: [42504.573540] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:12:10 juju-e4d256-prod-github-runner-207 kernel: [42504.574574] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:12:10 juju-e4d256-prod-github-runner-207 kernel: [42504.575611] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:12:10 juju-e4d256-prod-github-runner-207 kernel: [42504.576699] ? show_regs.part.0+0x23/0x29 Aug 22 17:12:10 juju-e4d256-prod-github-runner-207 kernel: [42504.577704] ? show_regs.cold+0x8/0xd Aug 22 17:12:10 juju-e4d256-prod-github-runner-207 kernel: [42504.578693] ? watchdog_timer_fn+0x1be/0x220 Aug 22 17:12:10 juju-e4d256-prod-github-runner-207 kernel: [42504.579902] ? lockup_detector_update_enable+0x60/0x60 Aug 22 17:12:10 juju-e4d256-prod-github-runner-207 kernel: [42504.580969] ? __hrtimer_run_queues+0x107/0x230 Aug 22 17:12:10 juju-e4d256-prod-github-runner-207 kernel: [42504.581999] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 17:12:10 juju-e4d256-prod-github-runner-207 kernel: [42504.583061] ? hrtimer_interrupt+0x101/0x220 Aug 22 17:12:10 juju-e4d256-prod-github-runner-207 kernel: [42504.584079] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 17:12:10 juju-e4d256-prod-github-runner-207 kernel: [42504.585145] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 17:12:10 juju-e4d256-prod-github-runner-207 kernel: [42504.586192] Aug 22 17:12:10 juju-e4d256-prod-github-runner-207 kernel: [42504.587062] Aug 22 17:12:10 juju-e4d256-prod-github-runner-207 kernel: [42504.587900] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 17:12:10 juju-e4d256-prod-github-runner-207 kernel: [42504.588934] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:12:10 juju-e4d256-prod-github-runner-207 kernel: [42504.589969] ? _raw_spin_lock+0x22/0x30 Aug 22 17:12:10 juju-e4d256-prod-github-runner-207 kernel: [42504.590923] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:12:10 juju-e4d256-prod-github-runner-207 kernel: [42504.591948] direct_page_fault+0x206/0x310 [kvm] Aug 22 17:12:10 juju-e4d256-prod-github-runner-207 kernel: [42504.593006] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 17:12:10 juju-e4d256-prod-github-runner-207 kernel: [42504.594026] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 17:12:10 juju-e4d256-prod-github-runner-207 kernel: [42504.595046] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 17:12:10 juju-e4d256-prod-github-runner-207 kernel: [42504.596033] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 17:12:10 juju-e4d256-prod-github-runner-207 kernel: [42504.597009] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 17:12:10 juju-e4d256-prod-github-runner-207 kernel: [42504.598007] handle_exit+0x98/0x230 [kvm_amd] Aug 22 17:12:10 juju-e4d256-prod-github-runner-207 kernel: [42504.598932] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 17:12:10 juju-e4d256-prod-github-runner-207 kernel: [42504.599847] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 17:12:10 juju-e4d256-prod-github-runner-207 kernel: [42504.600787] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 17:12:10 juju-e4d256-prod-github-runner-207 kernel: [42504.601724] vcpu_run+0x62/0x2c0 [kvm] Aug 22 17:12:10 juju-e4d256-prod-github-runner-207 kernel: [42504.602548] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 17:12:10 juju-e4d256-prod-github-runner-207 kernel: [42504.603385] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 17:12:10 juju-e4d256-prod-github-runner-207 kernel: [42504.604246] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 17:12:10 juju-e4d256-prod-github-runner-207 kernel: [42504.605051] ? __seccomp_filter+0x4a/0x4a0 Aug 22 17:12:10 juju-e4d256-prod-github-runner-207 kernel: [42504.605804] ? __fget_files+0x86/0xc0 Aug 22 17:12:10 juju-e4d256-prod-github-runner-207 kernel: [42504.606517] __x64_sys_ioctl+0x95/0xd0 Aug 22 17:12:10 juju-e4d256-prod-github-runner-207 kernel: [42504.607257] do_syscall_64+0x5c/0xc0 Aug 22 17:12:10 juju-e4d256-prod-github-runner-207 kernel: [42504.607937] ? do_futex+0x162/0x1f0 Aug 22 17:12:10 juju-e4d256-prod-github-runner-207 kernel: [42504.608597] ? __x64_sys_futex+0x78/0x1e0 Aug 22 17:12:10 juju-e4d256-prod-github-runner-207 kernel: [42504.609275] ? __secure_computing+0xa9/0x120 Aug 22 17:12:10 juju-e4d256-prod-github-runner-207 kernel: [42504.609968] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 17:12:10 juju-e4d256-prod-github-runner-207 kernel: [42504.610754] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:12:10 juju-e4d256-prod-github-runner-207 kernel: [42504.611479] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:12:10 juju-e4d256-prod-github-runner-207 kernel: [42504.612231] ? do_syscall_64+0x69/0xc0 Aug 22 17:12:10 juju-e4d256-prod-github-runner-207 kernel: [42504.612906] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:12:10 juju-e4d256-prod-github-runner-207 kernel: [42504.613636] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:12:10 juju-e4d256-prod-github-runner-207 kernel: [42504.614337] ? do_syscall_64+0x69/0xc0 Aug 22 17:12:10 juju-e4d256-prod-github-runner-207 kernel: [42504.614980] ? do_syscall_64+0x69/0xc0 Aug 22 17:12:10 juju-e4d256-prod-github-runner-207 kernel: [42504.615606] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 17:12:10 juju-e4d256-prod-github-runner-207 kernel: [42504.616312] RIP: 0033:0x7faa5d0edaff Aug 22 17:12:10 juju-e4d256-prod-github-runner-207 kernel: [42504.616939] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 17:12:10 juju-e4d256-prod-github-runner-207 kernel: [42504.618976] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 17:12:10 juju-e4d256-prod-github-runner-207 kernel: [42504.619896] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 17:12:10 juju-e4d256-prod-github-runner-207 kernel: [42504.620792] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 17:12:10 juju-e4d256-prod-github-runner-207 kernel: [42504.621685] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 17:12:10 juju-e4d256-prod-github-runner-207 kernel: [42504.622651] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 17:12:10 juju-e4d256-prod-github-runner-207 kernel: [42504.623589] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 17:12:10 juju-e4d256-prod-github-runner-207 kernel: [42504.624505] Aug 22 17:12:38 juju-e4d256-prod-github-runner-207 kernel: [42532.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 39503s! [qemu-system-x86:6715] Aug 22 17:12:38 juju-e4d256-prod-github-runner-207 kernel: [42532.543715] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 17:12:38 juju-e4d256-prod-github-runner-207 kernel: [42532.543952] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 17:12:38 juju-e4d256-prod-github-runner-207 kernel: [42532.556075] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 17:12:38 juju-e4d256-prod-github-runner-207 kernel: [42532.557350] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 17:12:38 juju-e4d256-prod-github-runner-207 kernel: [42532.558604] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:12:38 juju-e4d256-prod-github-runner-207 kernel: [42532.559674] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 17:12:38 juju-e4d256-prod-github-runner-207 kernel: [42532.562217] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 17:12:38 juju-e4d256-prod-github-runner-207 kernel: [42532.563279] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 17:12:38 juju-e4d256-prod-github-runner-207 kernel: [42532.564438] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 17:12:38 juju-e4d256-prod-github-runner-207 kernel: [42532.565606] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 17:12:38 juju-e4d256-prod-github-runner-207 kernel: [42532.566781] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 17:12:38 juju-e4d256-prod-github-runner-207 kernel: [42532.567934] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 17:12:38 juju-e4d256-prod-github-runner-207 kernel: [42532.569272] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 17:12:38 juju-e4d256-prod-github-runner-207 kernel: [42532.570508] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 17:12:38 juju-e4d256-prod-github-runner-207 kernel: [42532.571601] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 17:12:38 juju-e4d256-prod-github-runner-207 kernel: [42532.572789] Call Trace: Aug 22 17:12:38 juju-e4d256-prod-github-runner-207 kernel: [42532.573699] Aug 22 17:12:38 juju-e4d256-prod-github-runner-207 kernel: [42532.574613] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:12:38 juju-e4d256-prod-github-runner-207 kernel: [42532.575647] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:12:38 juju-e4d256-prod-github-runner-207 kernel: [42532.576666] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:12:38 juju-e4d256-prod-github-runner-207 kernel: [42532.577926] ? show_regs.part.0+0x23/0x29 Aug 22 17:12:38 juju-e4d256-prod-github-runner-207 kernel: [42532.578931] ? show_regs.cold+0x8/0xd Aug 22 17:12:38 juju-e4d256-prod-github-runner-207 kernel: [42532.579900] ? watchdog_timer_fn+0x1be/0x220 Aug 22 17:12:38 juju-e4d256-prod-github-runner-207 kernel: [42532.580907] ? lockup_detector_update_enable+0x60/0x60 Aug 22 17:12:38 juju-e4d256-prod-github-runner-207 kernel: [42532.581967] ? __hrtimer_run_queues+0x107/0x230 Aug 22 17:12:38 juju-e4d256-prod-github-runner-207 kernel: [42532.582999] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 17:12:38 juju-e4d256-prod-github-runner-207 kernel: [42532.584020] ? hrtimer_interrupt+0x101/0x220 Aug 22 17:12:38 juju-e4d256-prod-github-runner-207 kernel: [42532.585029] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 17:12:38 juju-e4d256-prod-github-runner-207 kernel: [42532.586093] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 17:12:38 juju-e4d256-prod-github-runner-207 kernel: [42532.587168] Aug 22 17:12:38 juju-e4d256-prod-github-runner-207 kernel: [42532.588041] Aug 22 17:12:38 juju-e4d256-prod-github-runner-207 kernel: [42532.588892] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 17:12:38 juju-e4d256-prod-github-runner-207 kernel: [42532.589925] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:12:38 juju-e4d256-prod-github-runner-207 kernel: [42532.590986] ? _raw_spin_lock+0x22/0x30 Aug 22 17:12:38 juju-e4d256-prod-github-runner-207 kernel: [42532.591929] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:12:38 juju-e4d256-prod-github-runner-207 kernel: [42532.593015] direct_page_fault+0x206/0x310 [kvm] Aug 22 17:12:38 juju-e4d256-prod-github-runner-207 kernel: [42532.594068] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 17:12:38 juju-e4d256-prod-github-runner-207 kernel: [42532.595105] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 17:12:38 juju-e4d256-prod-github-runner-207 kernel: [42532.596105] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 17:12:38 juju-e4d256-prod-github-runner-207 kernel: [42532.597115] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 17:12:38 juju-e4d256-prod-github-runner-207 kernel: [42532.598061] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 17:12:38 juju-e4d256-prod-github-runner-207 kernel: [42532.599048] handle_exit+0x98/0x230 [kvm_amd] Aug 22 17:12:38 juju-e4d256-prod-github-runner-207 kernel: [42532.599950] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 17:12:38 juju-e4d256-prod-github-runner-207 kernel: [42532.600866] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 17:12:38 juju-e4d256-prod-github-runner-207 kernel: [42532.601789] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 17:12:38 juju-e4d256-prod-github-runner-207 kernel: [42532.602699] vcpu_run+0x62/0x2c0 [kvm] Aug 22 17:12:38 juju-e4d256-prod-github-runner-207 kernel: [42532.603510] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 17:12:38 juju-e4d256-prod-github-runner-207 kernel: [42532.604333] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 17:12:38 juju-e4d256-prod-github-runner-207 kernel: [42532.605199] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 17:12:38 juju-e4d256-prod-github-runner-207 kernel: [42532.606047] ? __seccomp_filter+0x4a/0x4a0 Aug 22 17:12:38 juju-e4d256-prod-github-runner-207 kernel: [42532.606805] ? __fget_files+0x86/0xc0 Aug 22 17:12:38 juju-e4d256-prod-github-runner-207 kernel: [42532.607509] __x64_sys_ioctl+0x95/0xd0 Aug 22 17:12:38 juju-e4d256-prod-github-runner-207 kernel: [42532.608208] do_syscall_64+0x5c/0xc0 Aug 22 17:12:38 juju-e4d256-prod-github-runner-207 kernel: [42532.608878] ? do_futex+0x162/0x1f0 Aug 22 17:12:38 juju-e4d256-prod-github-runner-207 kernel: [42532.609527] ? __x64_sys_futex+0x78/0x1e0 Aug 22 17:12:38 juju-e4d256-prod-github-runner-207 kernel: [42532.610199] ? __secure_computing+0xa9/0x120 Aug 22 17:12:38 juju-e4d256-prod-github-runner-207 kernel: [42532.610902] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 17:12:38 juju-e4d256-prod-github-runner-207 kernel: [42532.611661] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:12:38 juju-e4d256-prod-github-runner-207 kernel: [42532.612397] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:12:38 juju-e4d256-prod-github-runner-207 kernel: [42532.613119] ? do_syscall_64+0x69/0xc0 Aug 22 17:12:38 juju-e4d256-prod-github-runner-207 kernel: [42532.613763] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:12:38 juju-e4d256-prod-github-runner-207 kernel: [42532.614477] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:12:38 juju-e4d256-prod-github-runner-207 kernel: [42532.615176] ? do_syscall_64+0x69/0xc0 Aug 22 17:12:38 juju-e4d256-prod-github-runner-207 kernel: [42532.615799] ? do_syscall_64+0x69/0xc0 Aug 22 17:12:38 juju-e4d256-prod-github-runner-207 kernel: [42532.616424] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 17:12:38 juju-e4d256-prod-github-runner-207 kernel: [42532.617131] RIP: 0033:0x7faa5d0edaff Aug 22 17:12:38 juju-e4d256-prod-github-runner-207 kernel: [42532.617801] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 17:12:38 juju-e4d256-prod-github-runner-207 kernel: [42532.619915] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 17:12:38 juju-e4d256-prod-github-runner-207 kernel: [42532.620831] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 17:12:38 juju-e4d256-prod-github-runner-207 kernel: [42532.621722] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 17:12:38 juju-e4d256-prod-github-runner-207 kernel: [42532.622627] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 17:12:38 juju-e4d256-prod-github-runner-207 kernel: [42532.623515] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 17:12:38 juju-e4d256-prod-github-runner-207 kernel: [42532.624401] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 17:12:38 juju-e4d256-prod-github-runner-207 kernel: [42532.625291] Aug 22 17:13:06 juju-e4d256-prod-github-runner-207 kernel: [42560.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 39529s! [qemu-system-x86:6715] Aug 22 17:13:06 juju-e4d256-prod-github-runner-207 kernel: [42560.543109] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 17:13:06 juju-e4d256-prod-github-runner-207 kernel: [42560.543177] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 17:13:06 juju-e4d256-prod-github-runner-207 kernel: [42560.555266] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 17:13:06 juju-e4d256-prod-github-runner-207 kernel: [42560.556534] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 17:13:06 juju-e4d256-prod-github-runner-207 kernel: [42560.557760] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:13:06 juju-e4d256-prod-github-runner-207 kernel: [42560.558834] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 17:13:06 juju-e4d256-prod-github-runner-207 kernel: [42560.561378] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 17:13:06 juju-e4d256-prod-github-runner-207 kernel: [42560.562440] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 17:13:06 juju-e4d256-prod-github-runner-207 kernel: [42560.563602] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 17:13:06 juju-e4d256-prod-github-runner-207 kernel: [42560.564769] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 17:13:06 juju-e4d256-prod-github-runner-207 kernel: [42560.565948] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 17:13:06 juju-e4d256-prod-github-runner-207 kernel: [42560.567110] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 17:13:06 juju-e4d256-prod-github-runner-207 kernel: [42560.568277] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 17:13:06 juju-e4d256-prod-github-runner-207 kernel: [42560.569517] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 17:13:06 juju-e4d256-prod-github-runner-207 kernel: [42560.570628] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 17:13:06 juju-e4d256-prod-github-runner-207 kernel: [42560.571822] Call Trace: Aug 22 17:13:06 juju-e4d256-prod-github-runner-207 kernel: [42560.572734] Aug 22 17:13:06 juju-e4d256-prod-github-runner-207 kernel: [42560.573632] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:13:06 juju-e4d256-prod-github-runner-207 kernel: [42560.574716] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:13:06 juju-e4d256-prod-github-runner-207 kernel: [42560.575755] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:13:06 juju-e4d256-prod-github-runner-207 kernel: [42560.576865] ? show_regs.part.0+0x23/0x29 Aug 22 17:13:06 juju-e4d256-prod-github-runner-207 kernel: [42560.577877] ? show_regs.cold+0x8/0xd Aug 22 17:13:06 juju-e4d256-prod-github-runner-207 kernel: [42560.578876] ? watchdog_timer_fn+0x1be/0x220 Aug 22 17:13:06 juju-e4d256-prod-github-runner-207 kernel: [42560.580011] ? lockup_detector_update_enable+0x60/0x60 Aug 22 17:13:06 juju-e4d256-prod-github-runner-207 kernel: [42560.581188] ? __hrtimer_run_queues+0x107/0x230 Aug 22 17:13:06 juju-e4d256-prod-github-runner-207 kernel: [42560.582335] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 17:13:06 juju-e4d256-prod-github-runner-207 kernel: [42560.583454] ? hrtimer_interrupt+0x101/0x220 Aug 22 17:13:06 juju-e4d256-prod-github-runner-207 kernel: [42560.584558] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 17:13:06 juju-e4d256-prod-github-runner-207 kernel: [42560.585739] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 17:13:06 juju-e4d256-prod-github-runner-207 kernel: [42560.587269] Aug 22 17:13:06 juju-e4d256-prod-github-runner-207 kernel: [42560.588179] Aug 22 17:13:06 juju-e4d256-prod-github-runner-207 kernel: [42560.589062] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 17:13:06 juju-e4d256-prod-github-runner-207 kernel: [42560.590225] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:13:06 juju-e4d256-prod-github-runner-207 kernel: [42560.591369] ? _raw_spin_lock+0x22/0x30 Aug 22 17:13:06 juju-e4d256-prod-github-runner-207 kernel: [42560.592390] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:13:06 juju-e4d256-prod-github-runner-207 kernel: [42560.593500] direct_page_fault+0x206/0x310 [kvm] Aug 22 17:13:06 juju-e4d256-prod-github-runner-207 kernel: [42560.594650] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 17:13:06 juju-e4d256-prod-github-runner-207 kernel: [42560.595755] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 17:13:06 juju-e4d256-prod-github-runner-207 kernel: [42560.596856] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 17:13:06 juju-e4d256-prod-github-runner-207 kernel: [42560.597923] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 17:13:06 juju-e4d256-prod-github-runner-207 kernel: [42560.599310] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 17:13:06 juju-e4d256-prod-github-runner-207 kernel: [42560.600398] handle_exit+0x98/0x230 [kvm_amd] Aug 22 17:13:06 juju-e4d256-prod-github-runner-207 kernel: [42560.601380] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 17:13:06 juju-e4d256-prod-github-runner-207 kernel: [42560.602412] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 17:13:06 juju-e4d256-prod-github-runner-207 kernel: [42560.603448] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 17:13:06 juju-e4d256-prod-github-runner-207 kernel: [42560.604452] vcpu_run+0x62/0x2c0 [kvm] Aug 22 17:13:06 juju-e4d256-prod-github-runner-207 kernel: [42560.605342] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 17:13:06 juju-e4d256-prod-github-runner-207 kernel: [42560.606255] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 17:13:06 juju-e4d256-prod-github-runner-207 kernel: [42560.607211] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 17:13:06 juju-e4d256-prod-github-runner-207 kernel: [42560.608098] ? __seccomp_filter+0x4a/0x4a0 Aug 22 17:13:06 juju-e4d256-prod-github-runner-207 kernel: [42560.608923] ? __fget_files+0x86/0xc0 Aug 22 17:13:06 juju-e4d256-prod-github-runner-207 kernel: [42560.609705] __x64_sys_ioctl+0x95/0xd0 Aug 22 17:13:06 juju-e4d256-prod-github-runner-207 kernel: [42560.610492] do_syscall_64+0x5c/0xc0 Aug 22 17:13:06 juju-e4d256-prod-github-runner-207 kernel: [42560.611231] ? do_futex+0x162/0x1f0 Aug 22 17:13:06 juju-e4d256-prod-github-runner-207 kernel: [42560.611952] ? __x64_sys_futex+0x78/0x1e0 Aug 22 17:13:06 juju-e4d256-prod-github-runner-207 kernel: [42560.612708] ? __secure_computing+0xa9/0x120 Aug 22 17:13:06 juju-e4d256-prod-github-runner-207 kernel: [42560.613486] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 17:13:06 juju-e4d256-prod-github-runner-207 kernel: [42560.614371] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:13:06 juju-e4d256-prod-github-runner-207 kernel: [42560.615189] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:13:06 juju-e4d256-prod-github-runner-207 kernel: [42560.616002] ? do_syscall_64+0x69/0xc0 Aug 22 17:13:06 juju-e4d256-prod-github-runner-207 kernel: [42560.616723] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:13:06 juju-e4d256-prod-github-runner-207 kernel: [42560.617520] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:13:06 juju-e4d256-prod-github-runner-207 kernel: [42560.618325] ? do_syscall_64+0x69/0xc0 Aug 22 17:13:06 juju-e4d256-prod-github-runner-207 kernel: [42560.619030] ? do_syscall_64+0x69/0xc0 Aug 22 17:13:06 juju-e4d256-prod-github-runner-207 kernel: [42560.619729] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 17:13:06 juju-e4d256-prod-github-runner-207 kernel: [42560.620534] RIP: 0033:0x7faa5d0edaff Aug 22 17:13:06 juju-e4d256-prod-github-runner-207 kernel: [42560.621232] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 17:13:06 juju-e4d256-prod-github-runner-207 kernel: [42560.623578] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 17:13:06 juju-e4d256-prod-github-runner-207 kernel: [42560.624636] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 17:13:06 juju-e4d256-prod-github-runner-207 kernel: [42560.625662] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 17:13:06 juju-e4d256-prod-github-runner-207 kernel: [42560.626706] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 17:13:06 juju-e4d256-prod-github-runner-207 kernel: [42560.627730] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 17:13:06 juju-e4d256-prod-github-runner-207 kernel: [42560.628757] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 17:13:06 juju-e4d256-prod-github-runner-207 kernel: [42560.629788] Aug 22 17:13:34 juju-e4d256-prod-github-runner-207 kernel: [42588.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 39555s! [qemu-system-x86:6715] Aug 22 17:13:34 juju-e4d256-prod-github-runner-207 kernel: [42588.543085] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 17:13:34 juju-e4d256-prod-github-runner-207 kernel: [42588.543150] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 17:13:34 juju-e4d256-prod-github-runner-207 kernel: [42588.555164] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 17:13:34 juju-e4d256-prod-github-runner-207 kernel: [42588.556426] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 17:13:34 juju-e4d256-prod-github-runner-207 kernel: [42588.557655] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:13:34 juju-e4d256-prod-github-runner-207 kernel: [42588.558711] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 17:13:34 juju-e4d256-prod-github-runner-207 kernel: [42588.561256] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 17:13:34 juju-e4d256-prod-github-runner-207 kernel: [42588.562307] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 17:13:34 juju-e4d256-prod-github-runner-207 kernel: [42588.563470] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 17:13:34 juju-e4d256-prod-github-runner-207 kernel: [42588.564634] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 17:13:34 juju-e4d256-prod-github-runner-207 kernel: [42588.565812] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 17:13:34 juju-e4d256-prod-github-runner-207 kernel: [42588.566976] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 17:13:34 juju-e4d256-prod-github-runner-207 kernel: [42588.568148] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 17:13:34 juju-e4d256-prod-github-runner-207 kernel: [42588.569392] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 17:13:34 juju-e4d256-prod-github-runner-207 kernel: [42588.570497] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 17:13:34 juju-e4d256-prod-github-runner-207 kernel: [42588.571717] Call Trace: Aug 22 17:13:34 juju-e4d256-prod-github-runner-207 kernel: [42588.572633] Aug 22 17:13:34 juju-e4d256-prod-github-runner-207 kernel: [42588.573524] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:13:34 juju-e4d256-prod-github-runner-207 kernel: [42588.574573] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:13:34 juju-e4d256-prod-github-runner-207 kernel: [42588.575592] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:13:34 juju-e4d256-prod-github-runner-207 kernel: [42588.576667] ? show_regs.part.0+0x23/0x29 Aug 22 17:13:34 juju-e4d256-prod-github-runner-207 kernel: [42588.577683] ? show_regs.cold+0x8/0xd Aug 22 17:13:34 juju-e4d256-prod-github-runner-207 kernel: [42588.578655] ? watchdog_timer_fn+0x1be/0x220 Aug 22 17:13:34 juju-e4d256-prod-github-runner-207 kernel: [42588.579666] ? lockup_detector_update_enable+0x60/0x60 Aug 22 17:13:34 juju-e4d256-prod-github-runner-207 kernel: [42588.580732] ? __hrtimer_run_queues+0x107/0x230 Aug 22 17:13:34 juju-e4d256-prod-github-runner-207 kernel: [42588.581765] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 17:13:34 juju-e4d256-prod-github-runner-207 kernel: [42588.582788] ? hrtimer_interrupt+0x101/0x220 Aug 22 17:13:34 juju-e4d256-prod-github-runner-207 kernel: [42588.583810] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 17:13:34 juju-e4d256-prod-github-runner-207 kernel: [42588.584880] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 17:13:34 juju-e4d256-prod-github-runner-207 kernel: [42588.585933] Aug 22 17:13:34 juju-e4d256-prod-github-runner-207 kernel: [42588.586791] Aug 22 17:13:34 juju-e4d256-prod-github-runner-207 kernel: [42588.587626] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 17:13:34 juju-e4d256-prod-github-runner-207 kernel: [42588.588659] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:13:34 juju-e4d256-prod-github-runner-207 kernel: [42588.589711] ? _raw_spin_lock+0x22/0x30 Aug 22 17:13:34 juju-e4d256-prod-github-runner-207 kernel: [42588.590657] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:13:34 juju-e4d256-prod-github-runner-207 kernel: [42588.591676] direct_page_fault+0x206/0x310 [kvm] Aug 22 17:13:34 juju-e4d256-prod-github-runner-207 kernel: [42588.592698] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 17:13:34 juju-e4d256-prod-github-runner-207 kernel: [42588.593721] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 17:13:34 juju-e4d256-prod-github-runner-207 kernel: [42588.594726] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 17:13:34 juju-e4d256-prod-github-runner-207 kernel: [42588.595700] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 17:13:34 juju-e4d256-prod-github-runner-207 kernel: [42588.596650] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 17:13:34 juju-e4d256-prod-github-runner-207 kernel: [42588.597644] handle_exit+0x98/0x230 [kvm_amd] Aug 22 17:13:34 juju-e4d256-prod-github-runner-207 kernel: [42588.598536] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 17:13:34 juju-e4d256-prod-github-runner-207 kernel: [42588.599454] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 17:13:34 juju-e4d256-prod-github-runner-207 kernel: [42588.600379] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 17:13:34 juju-e4d256-prod-github-runner-207 kernel: [42588.601283] vcpu_run+0x62/0x2c0 [kvm] Aug 22 17:13:34 juju-e4d256-prod-github-runner-207 kernel: [42588.602098] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 17:13:34 juju-e4d256-prod-github-runner-207 kernel: [42588.602905] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 17:13:34 juju-e4d256-prod-github-runner-207 kernel: [42588.603757] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 17:13:34 juju-e4d256-prod-github-runner-207 kernel: [42588.604554] ? __seccomp_filter+0x4a/0x4a0 Aug 22 17:13:34 juju-e4d256-prod-github-runner-207 kernel: [42588.605307] ? __fget_files+0x86/0xc0 Aug 22 17:13:34 juju-e4d256-prod-github-runner-207 kernel: [42588.606019] __x64_sys_ioctl+0x95/0xd0 Aug 22 17:13:34 juju-e4d256-prod-github-runner-207 kernel: [42588.606712] do_syscall_64+0x5c/0xc0 Aug 22 17:13:34 juju-e4d256-prod-github-runner-207 kernel: [42588.607376] ? do_futex+0x162/0x1f0 Aug 22 17:13:34 juju-e4d256-prod-github-runner-207 kernel: [42588.608024] ? __x64_sys_futex+0x78/0x1e0 Aug 22 17:13:34 juju-e4d256-prod-github-runner-207 kernel: [42588.608702] ? __secure_computing+0xa9/0x120 Aug 22 17:13:34 juju-e4d256-prod-github-runner-207 kernel: [42588.609398] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 17:13:34 juju-e4d256-prod-github-runner-207 kernel: [42588.610170] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:13:34 juju-e4d256-prod-github-runner-207 kernel: [42588.610894] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:13:34 juju-e4d256-prod-github-runner-207 kernel: [42588.611610] ? do_syscall_64+0x69/0xc0 Aug 22 17:13:34 juju-e4d256-prod-github-runner-207 kernel: [42588.612259] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:13:34 juju-e4d256-prod-github-runner-207 kernel: [42588.612961] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:13:34 juju-e4d256-prod-github-runner-207 kernel: [42588.613664] ? do_syscall_64+0x69/0xc0 Aug 22 17:13:34 juju-e4d256-prod-github-runner-207 kernel: [42588.614293] ? do_syscall_64+0x69/0xc0 Aug 22 17:13:34 juju-e4d256-prod-github-runner-207 kernel: [42588.614915] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 17:13:34 juju-e4d256-prod-github-runner-207 kernel: [42588.615625] RIP: 0033:0x7faa5d0edaff Aug 22 17:13:34 juju-e4d256-prod-github-runner-207 kernel: [42588.616254] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 17:13:34 juju-e4d256-prod-github-runner-207 kernel: [42588.618248] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 17:13:34 juju-e4d256-prod-github-runner-207 kernel: [42588.619157] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 17:13:34 juju-e4d256-prod-github-runner-207 kernel: [42588.620046] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 17:13:34 juju-e4d256-prod-github-runner-207 kernel: [42588.620935] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 17:13:34 juju-e4d256-prod-github-runner-207 kernel: [42588.621829] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 17:13:34 juju-e4d256-prod-github-runner-207 kernel: [42588.622717] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 17:13:34 juju-e4d256-prod-github-runner-207 kernel: [42588.623608] Aug 22 17:14:02 juju-e4d256-prod-github-runner-207 kernel: [42616.541976] watchdog: BUG: soft lockup - CPU#1 stuck for 39581s! [qemu-system-x86:6715] Aug 22 17:14:02 juju-e4d256-prod-github-runner-207 kernel: [42616.543707] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 17:14:02 juju-e4d256-prod-github-runner-207 kernel: [42616.543961] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 17:14:02 juju-e4d256-prod-github-runner-207 kernel: [42616.556056] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 17:14:02 juju-e4d256-prod-github-runner-207 kernel: [42616.557389] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 17:14:02 juju-e4d256-prod-github-runner-207 kernel: [42616.558653] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:14:02 juju-e4d256-prod-github-runner-207 kernel: [42616.559711] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 17:14:02 juju-e4d256-prod-github-runner-207 kernel: [42616.562274] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 17:14:02 juju-e4d256-prod-github-runner-207 kernel: [42616.563316] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 17:14:02 juju-e4d256-prod-github-runner-207 kernel: [42616.564482] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 17:14:02 juju-e4d256-prod-github-runner-207 kernel: [42616.565657] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 17:14:02 juju-e4d256-prod-github-runner-207 kernel: [42616.566823] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 17:14:02 juju-e4d256-prod-github-runner-207 kernel: [42616.568139] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 17:14:02 juju-e4d256-prod-github-runner-207 kernel: [42616.569318] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 17:14:02 juju-e4d256-prod-github-runner-207 kernel: [42616.570552] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 17:14:02 juju-e4d256-prod-github-runner-207 kernel: [42616.571650] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 17:14:02 juju-e4d256-prod-github-runner-207 kernel: [42616.572843] Call Trace: Aug 22 17:14:02 juju-e4d256-prod-github-runner-207 kernel: [42616.573769] Aug 22 17:14:02 juju-e4d256-prod-github-runner-207 kernel: [42616.574672] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:14:02 juju-e4d256-prod-github-runner-207 kernel: [42616.575702] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:14:02 juju-e4d256-prod-github-runner-207 kernel: [42616.576729] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:14:02 juju-e4d256-prod-github-runner-207 kernel: [42616.577831] ? show_regs.part.0+0x23/0x29 Aug 22 17:14:02 juju-e4d256-prod-github-runner-207 kernel: [42616.578827] ? show_regs.cold+0x8/0xd Aug 22 17:14:02 juju-e4d256-prod-github-runner-207 kernel: [42616.579798] ? watchdog_timer_fn+0x1be/0x220 Aug 22 17:14:02 juju-e4d256-prod-github-runner-207 kernel: [42616.580806] ? lockup_detector_update_enable+0x60/0x60 Aug 22 17:14:02 juju-e4d256-prod-github-runner-207 kernel: [42616.581879] ? __hrtimer_run_queues+0x107/0x230 Aug 22 17:14:02 juju-e4d256-prod-github-runner-207 kernel: [42616.582913] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 17:14:02 juju-e4d256-prod-github-runner-207 kernel: [42616.583938] ? hrtimer_interrupt+0x101/0x220 Aug 22 17:14:02 juju-e4d256-prod-github-runner-207 kernel: [42616.584954] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 17:14:02 juju-e4d256-prod-github-runner-207 kernel: [42616.586040] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 17:14:02 juju-e4d256-prod-github-runner-207 kernel: [42616.587088] Aug 22 17:14:02 juju-e4d256-prod-github-runner-207 kernel: [42616.587942] Aug 22 17:14:02 juju-e4d256-prod-github-runner-207 kernel: [42616.588781] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 17:14:02 juju-e4d256-prod-github-runner-207 kernel: [42616.589825] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:14:02 juju-e4d256-prod-github-runner-207 kernel: [42616.590865] ? _raw_spin_lock+0x22/0x30 Aug 22 17:14:02 juju-e4d256-prod-github-runner-207 kernel: [42616.591819] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:14:02 juju-e4d256-prod-github-runner-207 kernel: [42616.592842] direct_page_fault+0x206/0x310 [kvm] Aug 22 17:14:02 juju-e4d256-prod-github-runner-207 kernel: [42616.593875] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 17:14:02 juju-e4d256-prod-github-runner-207 kernel: [42616.594884] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 17:14:02 juju-e4d256-prod-github-runner-207 kernel: [42616.595885] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 17:14:02 juju-e4d256-prod-github-runner-207 kernel: [42616.596885] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 17:14:02 juju-e4d256-prod-github-runner-207 kernel: [42616.597846] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 17:14:02 juju-e4d256-prod-github-runner-207 kernel: [42616.598823] handle_exit+0x98/0x230 [kvm_amd] Aug 22 17:14:02 juju-e4d256-prod-github-runner-207 kernel: [42616.599715] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 17:14:02 juju-e4d256-prod-github-runner-207 kernel: [42616.600627] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 17:14:02 juju-e4d256-prod-github-runner-207 kernel: [42616.601563] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 17:14:02 juju-e4d256-prod-github-runner-207 kernel: [42616.602467] vcpu_run+0x62/0x2c0 [kvm] Aug 22 17:14:02 juju-e4d256-prod-github-runner-207 kernel: [42616.603278] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 17:14:02 juju-e4d256-prod-github-runner-207 kernel: [42616.604084] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 17:14:02 juju-e4d256-prod-github-runner-207 kernel: [42616.604938] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 17:14:02 juju-e4d256-prod-github-runner-207 kernel: [42616.605746] ? __seccomp_filter+0x4a/0x4a0 Aug 22 17:14:02 juju-e4d256-prod-github-runner-207 kernel: [42616.606489] ? __fget_files+0x86/0xc0 Aug 22 17:14:02 juju-e4d256-prod-github-runner-207 kernel: [42616.607194] __x64_sys_ioctl+0x95/0xd0 Aug 22 17:14:02 juju-e4d256-prod-github-runner-207 kernel: [42616.607892] do_syscall_64+0x5c/0xc0 Aug 22 17:14:02 juju-e4d256-prod-github-runner-207 kernel: [42616.608561] ? do_futex+0x162/0x1f0 Aug 22 17:14:02 juju-e4d256-prod-github-runner-207 kernel: [42616.609209] ? __x64_sys_futex+0x78/0x1e0 Aug 22 17:14:02 juju-e4d256-prod-github-runner-207 kernel: [42616.609894] ? __secure_computing+0xa9/0x120 Aug 22 17:14:02 juju-e4d256-prod-github-runner-207 kernel: [42616.610587] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 17:14:02 juju-e4d256-prod-github-runner-207 kernel: [42616.611345] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:14:02 juju-e4d256-prod-github-runner-207 kernel: [42616.612065] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:14:02 juju-e4d256-prod-github-runner-207 kernel: [42616.612787] ? do_syscall_64+0x69/0xc0 Aug 22 17:14:02 juju-e4d256-prod-github-runner-207 kernel: [42616.613448] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:14:02 juju-e4d256-prod-github-runner-207 kernel: [42616.614273] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:14:02 juju-e4d256-prod-github-runner-207 kernel: [42616.614972] ? do_syscall_64+0x69/0xc0 Aug 22 17:14:02 juju-e4d256-prod-github-runner-207 kernel: [42616.615596] ? do_syscall_64+0x69/0xc0 Aug 22 17:14:02 juju-e4d256-prod-github-runner-207 kernel: [42616.616218] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 17:14:02 juju-e4d256-prod-github-runner-207 kernel: [42616.616927] RIP: 0033:0x7faa5d0edaff Aug 22 17:14:02 juju-e4d256-prod-github-runner-207 kernel: [42616.617588] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 17:14:02 juju-e4d256-prod-github-runner-207 kernel: [42616.619639] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 17:14:02 juju-e4d256-prod-github-runner-207 kernel: [42616.620553] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 17:14:02 juju-e4d256-prod-github-runner-207 kernel: [42616.621453] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 17:14:02 juju-e4d256-prod-github-runner-207 kernel: [42616.622338] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 17:14:02 juju-e4d256-prod-github-runner-207 kernel: [42616.623220] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 17:14:02 juju-e4d256-prod-github-runner-207 kernel: [42616.624107] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 17:14:02 juju-e4d256-prod-github-runner-207 kernel: [42616.624994] Aug 22 17:14:30 juju-e4d256-prod-github-runner-207 kernel: [42644.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 39607s! [qemu-system-x86:6715] Aug 22 17:14:30 juju-e4d256-prod-github-runner-207 kernel: [42644.543109] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 17:14:30 juju-e4d256-prod-github-runner-207 kernel: [42644.543177] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 17:14:30 juju-e4d256-prod-github-runner-207 kernel: [42644.555269] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 17:14:30 juju-e4d256-prod-github-runner-207 kernel: [42644.556541] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 17:14:30 juju-e4d256-prod-github-runner-207 kernel: [42644.557829] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:14:30 juju-e4d256-prod-github-runner-207 kernel: [42644.558895] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 17:14:30 juju-e4d256-prod-github-runner-207 kernel: [42644.561476] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 17:14:30 juju-e4d256-prod-github-runner-207 kernel: [42644.562517] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 17:14:30 juju-e4d256-prod-github-runner-207 kernel: [42644.563680] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 17:14:30 juju-e4d256-prod-github-runner-207 kernel: [42644.564844] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 17:14:30 juju-e4d256-prod-github-runner-207 kernel: [42644.566016] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 17:14:30 juju-e4d256-prod-github-runner-207 kernel: [42644.567173] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 17:14:30 juju-e4d256-prod-github-runner-207 kernel: [42644.568343] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 17:14:30 juju-e4d256-prod-github-runner-207 kernel: [42644.569587] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 17:14:30 juju-e4d256-prod-github-runner-207 kernel: [42644.570684] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 17:14:30 juju-e4d256-prod-github-runner-207 kernel: [42644.571881] Call Trace: Aug 22 17:14:30 juju-e4d256-prod-github-runner-207 kernel: [42644.572793] Aug 22 17:14:30 juju-e4d256-prod-github-runner-207 kernel: [42644.573691] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:14:30 juju-e4d256-prod-github-runner-207 kernel: [42644.574721] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:14:30 juju-e4d256-prod-github-runner-207 kernel: [42644.575744] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:14:30 juju-e4d256-prod-github-runner-207 kernel: [42644.576818] ? show_regs.part.0+0x23/0x29 Aug 22 17:14:30 juju-e4d256-prod-github-runner-207 kernel: [42644.577830] ? show_regs.cold+0x8/0xd Aug 22 17:14:30 juju-e4d256-prod-github-runner-207 kernel: [42644.578799] ? watchdog_timer_fn+0x1be/0x220 Aug 22 17:14:30 juju-e4d256-prod-github-runner-207 kernel: [42644.579812] ? lockup_detector_update_enable+0x60/0x60 Aug 22 17:14:30 juju-e4d256-prod-github-runner-207 kernel: [42644.580881] ? __hrtimer_run_queues+0x107/0x230 Aug 22 17:14:30 juju-e4d256-prod-github-runner-207 kernel: [42644.581942] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 17:14:30 juju-e4d256-prod-github-runner-207 kernel: [42644.583135] ? hrtimer_interrupt+0x101/0x220 Aug 22 17:14:30 juju-e4d256-prod-github-runner-207 kernel: [42644.584243] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 17:14:30 juju-e4d256-prod-github-runner-207 kernel: [42644.585469] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 17:14:30 juju-e4d256-prod-github-runner-207 kernel: [42644.586526] Aug 22 17:14:30 juju-e4d256-prod-github-runner-207 kernel: [42644.587409] Aug 22 17:14:30 juju-e4d256-prod-github-runner-207 kernel: [42644.588248] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 17:14:30 juju-e4d256-prod-github-runner-207 kernel: [42644.589296] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:14:30 juju-e4d256-prod-github-runner-207 kernel: [42644.590341] ? _raw_spin_lock+0x22/0x30 Aug 22 17:14:30 juju-e4d256-prod-github-runner-207 kernel: [42644.591299] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:14:30 juju-e4d256-prod-github-runner-207 kernel: [42644.592323] direct_page_fault+0x206/0x310 [kvm] Aug 22 17:14:30 juju-e4d256-prod-github-runner-207 kernel: [42644.593370] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 17:14:30 juju-e4d256-prod-github-runner-207 kernel: [42644.594380] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 17:14:30 juju-e4d256-prod-github-runner-207 kernel: [42644.595524] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 17:14:30 juju-e4d256-prod-github-runner-207 kernel: [42644.596643] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 17:14:30 juju-e4d256-prod-github-runner-207 kernel: [42644.597619] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 17:14:30 juju-e4d256-prod-github-runner-207 kernel: [42644.598597] handle_exit+0x98/0x230 [kvm_amd] Aug 22 17:14:30 juju-e4d256-prod-github-runner-207 kernel: [42644.599489] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 17:14:30 juju-e4d256-prod-github-runner-207 kernel: [42644.600402] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 17:14:30 juju-e4d256-prod-github-runner-207 kernel: [42644.601342] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 17:14:30 juju-e4d256-prod-github-runner-207 kernel: [42644.602245] vcpu_run+0x62/0x2c0 [kvm] Aug 22 17:14:30 juju-e4d256-prod-github-runner-207 kernel: [42644.603055] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 17:14:30 juju-e4d256-prod-github-runner-207 kernel: [42644.603864] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 17:14:30 juju-e4d256-prod-github-runner-207 kernel: [42644.604719] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 17:14:30 juju-e4d256-prod-github-runner-207 kernel: [42644.605536] ? __seccomp_filter+0x4a/0x4a0 Aug 22 17:14:30 juju-e4d256-prod-github-runner-207 kernel: [42644.606287] ? __fget_files+0x86/0xc0 Aug 22 17:14:30 juju-e4d256-prod-github-runner-207 kernel: [42644.606992] __x64_sys_ioctl+0x95/0xd0 Aug 22 17:14:30 juju-e4d256-prod-github-runner-207 kernel: [42644.607685] do_syscall_64+0x5c/0xc0 Aug 22 17:14:30 juju-e4d256-prod-github-runner-207 kernel: [42644.608351] ? do_futex+0x162/0x1f0 Aug 22 17:14:30 juju-e4d256-prod-github-runner-207 kernel: [42644.609023] ? __x64_sys_futex+0x78/0x1e0 Aug 22 17:14:30 juju-e4d256-prod-github-runner-207 kernel: [42644.609698] ? __secure_computing+0xa9/0x120 Aug 22 17:14:30 juju-e4d256-prod-github-runner-207 kernel: [42644.610389] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 17:14:30 juju-e4d256-prod-github-runner-207 kernel: [42644.611151] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:14:30 juju-e4d256-prod-github-runner-207 kernel: [42644.611875] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:14:30 juju-e4d256-prod-github-runner-207 kernel: [42644.612593] ? do_syscall_64+0x69/0xc0 Aug 22 17:14:30 juju-e4d256-prod-github-runner-207 kernel: [42644.613264] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:14:30 juju-e4d256-prod-github-runner-207 kernel: [42644.614110] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:14:30 juju-e4d256-prod-github-runner-207 kernel: [42644.614824] ? do_syscall_64+0x69/0xc0 Aug 22 17:14:30 juju-e4d256-prod-github-runner-207 kernel: [42644.615450] ? do_syscall_64+0x69/0xc0 Aug 22 17:14:30 juju-e4d256-prod-github-runner-207 kernel: [42644.616079] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 17:14:30 juju-e4d256-prod-github-runner-207 kernel: [42644.616793] RIP: 0033:0x7faa5d0edaff Aug 22 17:14:30 juju-e4d256-prod-github-runner-207 kernel: [42644.617486] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 17:14:30 juju-e4d256-prod-github-runner-207 kernel: [42644.619480] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 17:14:30 juju-e4d256-prod-github-runner-207 kernel: [42644.620398] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 17:14:30 juju-e4d256-prod-github-runner-207 kernel: [42644.621314] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 17:14:30 juju-e4d256-prod-github-runner-207 kernel: [42644.622207] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 17:14:30 juju-e4d256-prod-github-runner-207 kernel: [42644.623096] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 17:14:30 juju-e4d256-prod-github-runner-207 kernel: [42644.623986] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 17:14:30 juju-e4d256-prod-github-runner-207 kernel: [42644.624880] Aug 22 17:14:46 juju-e4d256-prod-github-runner-207 kernel: [42660.032706] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 17:14:46 juju-e4d256-prod-github-runner-207 kernel: [42660.033677] rcu: 1-....: (10602367 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=5130401 Aug 22 17:14:46 juju-e4d256-prod-github-runner-207 kernel: [42660.034794] (t=10635708 jiffies g=23269 q=42637) Aug 22 17:14:46 juju-e4d256-prod-github-runner-207 kernel: [42660.035584] NMI backtrace for cpu 1 Aug 22 17:14:46 juju-e4d256-prod-github-runner-207 kernel: [42660.036292] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 17:14:46 juju-e4d256-prod-github-runner-207 kernel: [42660.037404] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 17:14:46 juju-e4d256-prod-github-runner-207 kernel: [42660.038464] Call Trace: Aug 22 17:14:46 juju-e4d256-prod-github-runner-207 kernel: [42660.039141] Aug 22 17:14:46 juju-e4d256-prod-github-runner-207 kernel: [42660.039785] show_stack+0x52/0x5c Aug 22 17:14:46 juju-e4d256-prod-github-runner-207 kernel: [42660.040510] dump_stack_lvl+0x4a/0x63 Aug 22 17:14:46 juju-e4d256-prod-github-runner-207 kernel: [42660.041269] dump_stack+0x10/0x16 Aug 22 17:14:46 juju-e4d256-prod-github-runner-207 kernel: [42660.041986] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 17:14:46 juju-e4d256-prod-github-runner-207 kernel: [42660.042764] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 17:14:46 juju-e4d256-prod-github-runner-207 kernel: [42660.043544] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 17:14:46 juju-e4d256-prod-github-runner-207 kernel: [42660.044366] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 17:14:46 juju-e4d256-prod-github-runner-207 kernel: [42660.045190] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 17:14:46 juju-e4d256-prod-github-runner-207 kernel: [42660.046001] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 17:14:46 juju-e4d256-prod-github-runner-207 kernel: [42660.046772] print_cpu_stall.cold+0x2f/0xe2 Aug 22 17:14:46 juju-e4d256-prod-github-runner-207 kernel: [42660.047539] ? timekeeping_update+0xf7/0x150 Aug 22 17:14:46 juju-e4d256-prod-github-runner-207 kernel: [42660.048308] check_cpu_stall+0x109/0x270 Aug 22 17:14:46 juju-e4d256-prod-github-runner-207 kernel: [42660.049072] rcu_sched_clock_irq+0x9a/0x250 Aug 22 17:14:46 juju-e4d256-prod-github-runner-207 kernel: [42660.049833] update_process_times+0x94/0xd0 Aug 22 17:14:46 juju-e4d256-prod-github-runner-207 kernel: [42660.050595] tick_sched_handle+0x29/0x70 Aug 22 17:14:46 juju-e4d256-prod-github-runner-207 kernel: [42660.051344] tick_sched_timer+0x8c/0xc0 Aug 22 17:14:46 juju-e4d256-prod-github-runner-207 kernel: [42660.052080] ? tick_nohz_handler+0xb0/0xb0 Aug 22 17:14:46 juju-e4d256-prod-github-runner-207 kernel: [42660.052844] __hrtimer_run_queues+0x107/0x230 Aug 22 17:14:46 juju-e4d256-prod-github-runner-207 kernel: [42660.053623] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 17:14:46 juju-e4d256-prod-github-runner-207 kernel: [42660.054400] hrtimer_interrupt+0x101/0x220 Aug 22 17:14:46 juju-e4d256-prod-github-runner-207 kernel: [42660.055162] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 17:14:46 juju-e4d256-prod-github-runner-207 kernel: [42660.055973] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 17:14:46 juju-e4d256-prod-github-runner-207 kernel: [42660.056781] Aug 22 17:14:46 juju-e4d256-prod-github-runner-207 kernel: [42660.057420] Aug 22 17:14:46 juju-e4d256-prod-github-runner-207 kernel: [42660.058053] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 17:14:46 juju-e4d256-prod-github-runner-207 kernel: [42660.058868] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:14:46 juju-e4d256-prod-github-runner-207 kernel: [42660.059754] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 17:14:46 juju-e4d256-prod-github-runner-207 kernel: [42660.061965] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 17:14:46 juju-e4d256-prod-github-runner-207 kernel: [42660.062838] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 17:14:46 juju-e4d256-prod-github-runner-207 kernel: [42660.063834] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 17:14:46 juju-e4d256-prod-github-runner-207 kernel: [42660.064819] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 17:14:46 juju-e4d256-prod-github-runner-207 kernel: [42660.065781] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 17:14:46 juju-e4d256-prod-github-runner-207 kernel: [42660.066739] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 17:14:46 juju-e4d256-prod-github-runner-207 kernel: [42660.067693] ? _raw_spin_lock+0x22/0x30 Aug 22 17:14:46 juju-e4d256-prod-github-runner-207 kernel: [42660.068449] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:14:46 juju-e4d256-prod-github-runner-207 kernel: [42660.069295] direct_page_fault+0x206/0x310 [kvm] Aug 22 17:14:46 juju-e4d256-prod-github-runner-207 kernel: [42660.070131] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 17:14:46 juju-e4d256-prod-github-runner-207 kernel: [42660.070957] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 17:14:46 juju-e4d256-prod-github-runner-207 kernel: [42660.071777] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 17:14:46 juju-e4d256-prod-github-runner-207 kernel: [42660.072582] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 17:14:46 juju-e4d256-prod-github-runner-207 kernel: [42660.073374] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 17:14:46 juju-e4d256-prod-github-runner-207 kernel: [42660.074324] handle_exit+0x98/0x230 [kvm_amd] Aug 22 17:14:46 juju-e4d256-prod-github-runner-207 kernel: [42660.075075] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 17:14:46 juju-e4d256-prod-github-runner-207 kernel: [42660.075855] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 17:14:46 juju-e4d256-prod-github-runner-207 kernel: [42660.076657] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 17:14:46 juju-e4d256-prod-github-runner-207 kernel: [42660.077460] vcpu_run+0x62/0x2c0 [kvm] Aug 22 17:14:46 juju-e4d256-prod-github-runner-207 kernel: [42660.078174] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 17:14:46 juju-e4d256-prod-github-runner-207 kernel: [42660.078908] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 17:14:46 juju-e4d256-prod-github-runner-207 kernel: [42660.079706] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 17:14:46 juju-e4d256-prod-github-runner-207 kernel: [42660.080465] ? __seccomp_filter+0x4a/0x4a0 Aug 22 17:14:46 juju-e4d256-prod-github-runner-207 kernel: [42660.081194] ? __fget_files+0x86/0xc0 Aug 22 17:14:46 juju-e4d256-prod-github-runner-207 kernel: [42660.081885] __x64_sys_ioctl+0x95/0xd0 Aug 22 17:14:46 juju-e4d256-prod-github-runner-207 kernel: [42660.082580] do_syscall_64+0x5c/0xc0 Aug 22 17:14:46 juju-e4d256-prod-github-runner-207 kernel: [42660.083264] ? do_futex+0x162/0x1f0 Aug 22 17:14:46 juju-e4d256-prod-github-runner-207 kernel: [42660.086092] ? __x64_sys_futex+0x78/0x1e0 Aug 22 17:14:46 juju-e4d256-prod-github-runner-207 kernel: [42660.086812] ? __secure_computing+0xa9/0x120 Aug 22 17:14:46 juju-e4d256-prod-github-runner-207 kernel: [42660.087527] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 17:14:46 juju-e4d256-prod-github-runner-207 kernel: [42660.088320] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:14:46 juju-e4d256-prod-github-runner-207 kernel: [42660.089086] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:14:46 juju-e4d256-prod-github-runner-207 kernel: [42660.089838] ? do_syscall_64+0x69/0xc0 Aug 22 17:14:46 juju-e4d256-prod-github-runner-207 kernel: [42660.090528] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:14:46 juju-e4d256-prod-github-runner-207 kernel: [42660.091280] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:14:46 juju-e4d256-prod-github-runner-207 kernel: [42660.092156] ? do_syscall_64+0x69/0xc0 Aug 22 17:14:46 juju-e4d256-prod-github-runner-207 kernel: [42660.092942] ? do_syscall_64+0x69/0xc0 Aug 22 17:14:46 juju-e4d256-prod-github-runner-207 kernel: [42660.093704] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 17:14:46 juju-e4d256-prod-github-runner-207 kernel: [42660.094706] RIP: 0033:0x7faa5d0edaff Aug 22 17:14:46 juju-e4d256-prod-github-runner-207 kernel: [42660.095460] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 17:14:46 juju-e4d256-prod-github-runner-207 kernel: [42660.097927] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 17:14:46 juju-e4d256-prod-github-runner-207 kernel: [42660.099047] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 17:14:46 juju-e4d256-prod-github-runner-207 kernel: [42660.100130] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 17:14:46 juju-e4d256-prod-github-runner-207 kernel: [42660.101238] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 17:14:46 juju-e4d256-prod-github-runner-207 kernel: [42660.102314] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 17:14:46 juju-e4d256-prod-github-runner-207 kernel: [42660.103372] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 17:14:46 juju-e4d256-prod-github-runner-207 kernel: [42660.104414] Aug 22 17:15:10 juju-e4d256-prod-github-runner-207 kernel: [42684.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 39645s! [qemu-system-x86:6715] Aug 22 17:15:10 juju-e4d256-prod-github-runner-207 kernel: [42684.543115] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 17:15:10 juju-e4d256-prod-github-runner-207 kernel: [42684.543187] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 17:15:10 juju-e4d256-prod-github-runner-207 kernel: [42684.555485] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 17:15:10 juju-e4d256-prod-github-runner-207 kernel: [42684.556753] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 17:15:10 juju-e4d256-prod-github-runner-207 kernel: [42684.557967] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:15:10 juju-e4d256-prod-github-runner-207 kernel: [42684.559021] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 17:15:10 juju-e4d256-prod-github-runner-207 kernel: [42684.561560] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 17:15:10 juju-e4d256-prod-github-runner-207 kernel: [42684.562600] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 17:15:10 juju-e4d256-prod-github-runner-207 kernel: [42684.563757] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 17:15:10 juju-e4d256-prod-github-runner-207 kernel: [42684.564920] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 17:15:10 juju-e4d256-prod-github-runner-207 kernel: [42684.566087] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 17:15:10 juju-e4d256-prod-github-runner-207 kernel: [42684.567245] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 17:15:10 juju-e4d256-prod-github-runner-207 kernel: [42684.568407] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 17:15:10 juju-e4d256-prod-github-runner-207 kernel: [42684.569657] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 17:15:10 juju-e4d256-prod-github-runner-207 kernel: [42684.570758] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 17:15:10 juju-e4d256-prod-github-runner-207 kernel: [42684.571948] Call Trace: Aug 22 17:15:10 juju-e4d256-prod-github-runner-207 kernel: [42684.572872] Aug 22 17:15:10 juju-e4d256-prod-github-runner-207 kernel: [42684.573757] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:15:10 juju-e4d256-prod-github-runner-207 kernel: [42684.574785] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:15:10 juju-e4d256-prod-github-runner-207 kernel: [42684.575809] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:15:10 juju-e4d256-prod-github-runner-207 kernel: [42684.576894] ? show_regs.part.0+0x23/0x29 Aug 22 17:15:10 juju-e4d256-prod-github-runner-207 kernel: [42684.577891] ? show_regs.cold+0x8/0xd Aug 22 17:15:10 juju-e4d256-prod-github-runner-207 kernel: [42684.578866] ? watchdog_timer_fn+0x1be/0x220 Aug 22 17:15:10 juju-e4d256-prod-github-runner-207 kernel: [42684.579874] ? lockup_detector_update_enable+0x60/0x60 Aug 22 17:15:10 juju-e4d256-prod-github-runner-207 kernel: [42684.580945] ? __hrtimer_run_queues+0x107/0x230 Aug 22 17:15:10 juju-e4d256-prod-github-runner-207 kernel: [42684.581977] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 17:15:10 juju-e4d256-prod-github-runner-207 kernel: [42684.582998] ? hrtimer_interrupt+0x101/0x220 Aug 22 17:15:10 juju-e4d256-prod-github-runner-207 kernel: [42684.584021] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 17:15:10 juju-e4d256-prod-github-runner-207 kernel: [42684.585106] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 17:15:10 juju-e4d256-prod-github-runner-207 kernel: [42684.586165] Aug 22 17:15:10 juju-e4d256-prod-github-runner-207 kernel: [42684.587017] Aug 22 17:15:10 juju-e4d256-prod-github-runner-207 kernel: [42684.587854] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 17:15:10 juju-e4d256-prod-github-runner-207 kernel: [42684.588895] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:15:10 juju-e4d256-prod-github-runner-207 kernel: [42684.589934] ? _raw_spin_lock+0x22/0x30 Aug 22 17:15:10 juju-e4d256-prod-github-runner-207 kernel: [42684.590879] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:15:10 juju-e4d256-prod-github-runner-207 kernel: [42684.591894] direct_page_fault+0x206/0x310 [kvm] Aug 22 17:15:10 juju-e4d256-prod-github-runner-207 kernel: [42684.592948] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 17:15:10 juju-e4d256-prod-github-runner-207 kernel: [42684.593961] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 17:15:10 juju-e4d256-prod-github-runner-207 kernel: [42684.594959] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 17:15:10 juju-e4d256-prod-github-runner-207 kernel: [42684.595928] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 17:15:10 juju-e4d256-prod-github-runner-207 kernel: [42684.596883] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 17:15:10 juju-e4d256-prod-github-runner-207 kernel: [42684.597865] handle_exit+0x98/0x230 [kvm_amd] Aug 22 17:15:10 juju-e4d256-prod-github-runner-207 kernel: [42684.598756] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 17:15:10 juju-e4d256-prod-github-runner-207 kernel: [42684.599674] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 17:15:10 juju-e4d256-prod-github-runner-207 kernel: [42684.600629] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 17:15:10 juju-e4d256-prod-github-runner-207 kernel: [42684.601531] vcpu_run+0x62/0x2c0 [kvm] Aug 22 17:15:10 juju-e4d256-prod-github-runner-207 kernel: [42684.602340] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 17:15:10 juju-e4d256-prod-github-runner-207 kernel: [42684.603148] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 17:15:10 juju-e4d256-prod-github-runner-207 kernel: [42684.604002] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 17:15:10 juju-e4d256-prod-github-runner-207 kernel: [42684.604812] ? __seccomp_filter+0x4a/0x4a0 Aug 22 17:15:10 juju-e4d256-prod-github-runner-207 kernel: [42684.605552] ? __fget_files+0x86/0xc0 Aug 22 17:15:10 juju-e4d256-prod-github-runner-207 kernel: [42684.606259] __x64_sys_ioctl+0x95/0xd0 Aug 22 17:15:10 juju-e4d256-prod-github-runner-207 kernel: [42684.606948] do_syscall_64+0x5c/0xc0 Aug 22 17:15:10 juju-e4d256-prod-github-runner-207 kernel: [42684.607609] ? do_futex+0x162/0x1f0 Aug 22 17:15:10 juju-e4d256-prod-github-runner-207 kernel: [42684.608255] ? __x64_sys_futex+0x78/0x1e0 Aug 22 17:15:10 juju-e4d256-prod-github-runner-207 kernel: [42684.608933] ? __secure_computing+0xa9/0x120 Aug 22 17:15:10 juju-e4d256-prod-github-runner-207 kernel: [42684.609625] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 17:15:10 juju-e4d256-prod-github-runner-207 kernel: [42684.610383] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:15:10 juju-e4d256-prod-github-runner-207 kernel: [42684.611102] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:15:10 juju-e4d256-prod-github-runner-207 kernel: [42684.611816] ? do_syscall_64+0x69/0xc0 Aug 22 17:15:10 juju-e4d256-prod-github-runner-207 kernel: [42684.612483] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:15:10 juju-e4d256-prod-github-runner-207 kernel: [42684.613202] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:15:10 juju-e4d256-prod-github-runner-207 kernel: [42684.613894] ? do_syscall_64+0x69/0xc0 Aug 22 17:15:10 juju-e4d256-prod-github-runner-207 kernel: [42684.614532] ? do_syscall_64+0x69/0xc0 Aug 22 17:15:10 juju-e4d256-prod-github-runner-207 kernel: [42684.615158] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 17:15:10 juju-e4d256-prod-github-runner-207 kernel: [42684.615859] RIP: 0033:0x7faa5d0edaff Aug 22 17:15:10 juju-e4d256-prod-github-runner-207 kernel: [42684.616504] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 17:15:10 juju-e4d256-prod-github-runner-207 kernel: [42684.618487] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 17:15:10 juju-e4d256-prod-github-runner-207 kernel: [42684.619394] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 17:15:10 juju-e4d256-prod-github-runner-207 kernel: [42684.620286] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 17:15:10 juju-e4d256-prod-github-runner-207 kernel: [42684.621181] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 17:15:10 juju-e4d256-prod-github-runner-207 kernel: [42684.622064] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 17:15:10 juju-e4d256-prod-github-runner-207 kernel: [42684.622955] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 17:15:10 juju-e4d256-prod-github-runner-207 kernel: [42684.623844] Aug 22 17:15:38 juju-e4d256-prod-github-runner-207 kernel: [42712.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 39671s! [qemu-system-x86:6715] Aug 22 17:15:38 juju-e4d256-prod-github-runner-207 kernel: [42712.543757] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 17:15:38 juju-e4d256-prod-github-runner-207 kernel: [42712.544016] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 17:15:38 juju-e4d256-prod-github-runner-207 kernel: [42712.556147] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 17:15:38 juju-e4d256-prod-github-runner-207 kernel: [42712.557465] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 17:15:38 juju-e4d256-prod-github-runner-207 kernel: [42712.558703] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:15:38 juju-e4d256-prod-github-runner-207 kernel: [42712.559763] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 17:15:38 juju-e4d256-prod-github-runner-207 kernel: [42712.562330] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 17:15:38 juju-e4d256-prod-github-runner-207 kernel: [42712.563372] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 17:15:38 juju-e4d256-prod-github-runner-207 kernel: [42712.564554] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 17:15:38 juju-e4d256-prod-github-runner-207 kernel: [42712.565723] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 17:15:38 juju-e4d256-prod-github-runner-207 kernel: [42712.566889] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 17:15:38 juju-e4d256-prod-github-runner-207 kernel: [42712.568105] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 17:15:38 juju-e4d256-prod-github-runner-207 kernel: [42712.569275] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 17:15:38 juju-e4d256-prod-github-runner-207 kernel: [42712.570515] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 17:15:38 juju-e4d256-prod-github-runner-207 kernel: [42712.571615] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 17:15:38 juju-e4d256-prod-github-runner-207 kernel: [42712.572826] Call Trace: Aug 22 17:15:38 juju-e4d256-prod-github-runner-207 kernel: [42712.573741] Aug 22 17:15:38 juju-e4d256-prod-github-runner-207 kernel: [42712.574636] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:15:38 juju-e4d256-prod-github-runner-207 kernel: [42712.575668] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:15:38 juju-e4d256-prod-github-runner-207 kernel: [42712.576694] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:15:38 juju-e4d256-prod-github-runner-207 kernel: [42712.577799] ? show_regs.part.0+0x23/0x29 Aug 22 17:15:38 juju-e4d256-prod-github-runner-207 kernel: [42712.578796] ? show_regs.cold+0x8/0xd Aug 22 17:15:38 juju-e4d256-prod-github-runner-207 kernel: [42712.579772] ? watchdog_timer_fn+0x1be/0x220 Aug 22 17:15:38 juju-e4d256-prod-github-runner-207 kernel: [42712.580789] ? lockup_detector_update_enable+0x60/0x60 Aug 22 17:15:38 juju-e4d256-prod-github-runner-207 kernel: [42712.581853] ? __hrtimer_run_queues+0x107/0x230 Aug 22 17:15:38 juju-e4d256-prod-github-runner-207 kernel: [42712.582886] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 17:15:38 juju-e4d256-prod-github-runner-207 kernel: [42712.583910] ? hrtimer_interrupt+0x101/0x220 Aug 22 17:15:38 juju-e4d256-prod-github-runner-207 kernel: [42712.584949] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 17:15:38 juju-e4d256-prod-github-runner-207 kernel: [42712.586017] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 17:15:38 juju-e4d256-prod-github-runner-207 kernel: [42712.587067] Aug 22 17:15:38 juju-e4d256-prod-github-runner-207 kernel: [42712.587919] Aug 22 17:15:38 juju-e4d256-prod-github-runner-207 kernel: [42712.588765] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 17:15:38 juju-e4d256-prod-github-runner-207 kernel: [42712.589803] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:15:38 juju-e4d256-prod-github-runner-207 kernel: [42712.590840] ? _raw_spin_lock+0x22/0x30 Aug 22 17:15:38 juju-e4d256-prod-github-runner-207 kernel: [42712.591783] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:15:38 juju-e4d256-prod-github-runner-207 kernel: [42712.592806] direct_page_fault+0x206/0x310 [kvm] Aug 22 17:15:38 juju-e4d256-prod-github-runner-207 kernel: [42712.593834] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 17:15:38 juju-e4d256-prod-github-runner-207 kernel: [42712.594844] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 17:15:38 juju-e4d256-prod-github-runner-207 kernel: [42712.595849] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 17:15:38 juju-e4d256-prod-github-runner-207 kernel: [42712.596860] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 17:15:38 juju-e4d256-prod-github-runner-207 kernel: [42712.597805] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 17:15:38 juju-e4d256-prod-github-runner-207 kernel: [42712.598781] handle_exit+0x98/0x230 [kvm_amd] Aug 22 17:15:38 juju-e4d256-prod-github-runner-207 kernel: [42712.599672] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 17:15:38 juju-e4d256-prod-github-runner-207 kernel: [42712.600598] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 17:15:38 juju-e4d256-prod-github-runner-207 kernel: [42712.601528] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 17:15:38 juju-e4d256-prod-github-runner-207 kernel: [42712.602431] vcpu_run+0x62/0x2c0 [kvm] Aug 22 17:15:38 juju-e4d256-prod-github-runner-207 kernel: [42712.603240] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 17:15:38 juju-e4d256-prod-github-runner-207 kernel: [42712.604048] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 17:15:38 juju-e4d256-prod-github-runner-207 kernel: [42712.604906] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 17:15:38 juju-e4d256-prod-github-runner-207 kernel: [42712.605703] ? __seccomp_filter+0x4a/0x4a0 Aug 22 17:15:38 juju-e4d256-prod-github-runner-207 kernel: [42712.606444] ? __fget_files+0x86/0xc0 Aug 22 17:15:38 juju-e4d256-prod-github-runner-207 kernel: [42712.607146] __x64_sys_ioctl+0x95/0xd0 Aug 22 17:15:38 juju-e4d256-prod-github-runner-207 kernel: [42712.607836] do_syscall_64+0x5c/0xc0 Aug 22 17:15:38 juju-e4d256-prod-github-runner-207 kernel: [42712.608503] ? do_futex+0x162/0x1f0 Aug 22 17:15:38 juju-e4d256-prod-github-runner-207 kernel: [42712.609152] ? __x64_sys_futex+0x78/0x1e0 Aug 22 17:15:38 juju-e4d256-prod-github-runner-207 kernel: [42712.609824] ? __secure_computing+0xa9/0x120 Aug 22 17:15:38 juju-e4d256-prod-github-runner-207 kernel: [42712.610511] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 17:15:38 juju-e4d256-prod-github-runner-207 kernel: [42712.611270] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:15:38 juju-e4d256-prod-github-runner-207 kernel: [42712.611996] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:15:38 juju-e4d256-prod-github-runner-207 kernel: [42712.612722] ? do_syscall_64+0x69/0xc0 Aug 22 17:15:38 juju-e4d256-prod-github-runner-207 kernel: [42712.613364] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:15:38 juju-e4d256-prod-github-runner-207 kernel: [42712.614066] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:15:38 juju-e4d256-prod-github-runner-207 kernel: [42712.614766] ? do_syscall_64+0x69/0xc0 Aug 22 17:15:38 juju-e4d256-prod-github-runner-207 kernel: [42712.615389] ? do_syscall_64+0x69/0xc0 Aug 22 17:15:38 juju-e4d256-prod-github-runner-207 kernel: [42712.616011] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 17:15:38 juju-e4d256-prod-github-runner-207 kernel: [42712.616729] RIP: 0033:0x7faa5d0edaff Aug 22 17:15:38 juju-e4d256-prod-github-runner-207 kernel: [42712.617438] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 17:15:38 juju-e4d256-prod-github-runner-207 kernel: [42712.619430] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 17:15:38 juju-e4d256-prod-github-runner-207 kernel: [42712.620355] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 17:15:38 juju-e4d256-prod-github-runner-207 kernel: [42712.621251] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 17:15:38 juju-e4d256-prod-github-runner-207 kernel: [42712.622176] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 17:15:38 juju-e4d256-prod-github-runner-207 kernel: [42712.623068] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 17:15:38 juju-e4d256-prod-github-runner-207 kernel: [42712.623952] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 17:15:38 juju-e4d256-prod-github-runner-207 kernel: [42712.624864] Aug 22 17:16:06 juju-e4d256-prod-github-runner-207 kernel: [42740.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 39697s! [qemu-system-x86:6715] Aug 22 17:16:06 juju-e4d256-prod-github-runner-207 kernel: [42740.543094] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 17:16:06 juju-e4d256-prod-github-runner-207 kernel: [42740.543163] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 17:16:06 juju-e4d256-prod-github-runner-207 kernel: [42740.555283] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 17:16:06 juju-e4d256-prod-github-runner-207 kernel: [42740.556556] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 17:16:06 juju-e4d256-prod-github-runner-207 kernel: [42740.557777] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:16:06 juju-e4d256-prod-github-runner-207 kernel: [42740.558840] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 17:16:06 juju-e4d256-prod-github-runner-207 kernel: [42740.561409] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 17:16:06 juju-e4d256-prod-github-runner-207 kernel: [42740.562457] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 17:16:06 juju-e4d256-prod-github-runner-207 kernel: [42740.563618] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 17:16:06 juju-e4d256-prod-github-runner-207 kernel: [42740.564791] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 17:16:06 juju-e4d256-prod-github-runner-207 kernel: [42740.565954] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 17:16:06 juju-e4d256-prod-github-runner-207 kernel: [42740.567141] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 17:16:06 juju-e4d256-prod-github-runner-207 kernel: [42740.568326] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 17:16:06 juju-e4d256-prod-github-runner-207 kernel: [42740.569568] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 17:16:06 juju-e4d256-prod-github-runner-207 kernel: [42740.570673] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 17:16:06 juju-e4d256-prod-github-runner-207 kernel: [42740.571880] Call Trace: Aug 22 17:16:06 juju-e4d256-prod-github-runner-207 kernel: [42740.572792] Aug 22 17:16:06 juju-e4d256-prod-github-runner-207 kernel: [42740.573676] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:16:06 juju-e4d256-prod-github-runner-207 kernel: [42740.574716] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:16:06 juju-e4d256-prod-github-runner-207 kernel: [42740.575766] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:16:06 juju-e4d256-prod-github-runner-207 kernel: [42740.576842] ? show_regs.part.0+0x23/0x29 Aug 22 17:16:06 juju-e4d256-prod-github-runner-207 kernel: [42740.577845] ? show_regs.cold+0x8/0xd Aug 22 17:16:06 juju-e4d256-prod-github-runner-207 kernel: [42740.578815] ? watchdog_timer_fn+0x1be/0x220 Aug 22 17:16:06 juju-e4d256-prod-github-runner-207 kernel: [42740.579839] ? lockup_detector_update_enable+0x60/0x60 Aug 22 17:16:06 juju-e4d256-prod-github-runner-207 kernel: [42740.580912] ? __hrtimer_run_queues+0x107/0x230 Aug 22 17:16:06 juju-e4d256-prod-github-runner-207 kernel: [42740.581940] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 17:16:06 juju-e4d256-prod-github-runner-207 kernel: [42740.582963] ? hrtimer_interrupt+0x101/0x220 Aug 22 17:16:06 juju-e4d256-prod-github-runner-207 kernel: [42740.583990] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 17:16:06 juju-e4d256-prod-github-runner-207 kernel: [42740.585067] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 17:16:06 juju-e4d256-prod-github-runner-207 kernel: [42740.586116] Aug 22 17:16:06 juju-e4d256-prod-github-runner-207 kernel: [42740.586974] Aug 22 17:16:06 juju-e4d256-prod-github-runner-207 kernel: [42740.587822] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 17:16:06 juju-e4d256-prod-github-runner-207 kernel: [42740.588856] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:16:06 juju-e4d256-prod-github-runner-207 kernel: [42740.589900] ? _raw_spin_lock+0x22/0x30 Aug 22 17:16:06 juju-e4d256-prod-github-runner-207 kernel: [42740.590846] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:16:06 juju-e4d256-prod-github-runner-207 kernel: [42740.591878] direct_page_fault+0x206/0x310 [kvm] Aug 22 17:16:06 juju-e4d256-prod-github-runner-207 kernel: [42740.592901] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 17:16:06 juju-e4d256-prod-github-runner-207 kernel: [42740.593910] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 17:16:06 juju-e4d256-prod-github-runner-207 kernel: [42740.594910] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 17:16:06 juju-e4d256-prod-github-runner-207 kernel: [42740.595888] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 17:16:06 juju-e4d256-prod-github-runner-207 kernel: [42740.596840] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 17:16:06 juju-e4d256-prod-github-runner-207 kernel: [42740.597816] handle_exit+0x98/0x230 [kvm_amd] Aug 22 17:16:06 juju-e4d256-prod-github-runner-207 kernel: [42740.598707] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 17:16:06 juju-e4d256-prod-github-runner-207 kernel: [42740.599625] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 17:16:06 juju-e4d256-prod-github-runner-207 kernel: [42740.600555] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 17:16:06 juju-e4d256-prod-github-runner-207 kernel: [42740.601465] vcpu_run+0x62/0x2c0 [kvm] Aug 22 17:16:06 juju-e4d256-prod-github-runner-207 kernel: [42740.602275] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 17:16:06 juju-e4d256-prod-github-runner-207 kernel: [42740.603082] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 17:16:06 juju-e4d256-prod-github-runner-207 kernel: [42740.603949] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 17:16:06 juju-e4d256-prod-github-runner-207 kernel: [42740.604746] ? __seccomp_filter+0x4a/0x4a0 Aug 22 17:16:06 juju-e4d256-prod-github-runner-207 kernel: [42740.605513] ? __fget_files+0x86/0xc0 Aug 22 17:16:06 juju-e4d256-prod-github-runner-207 kernel: [42740.606225] __x64_sys_ioctl+0x95/0xd0 Aug 22 17:16:06 juju-e4d256-prod-github-runner-207 kernel: [42740.606918] do_syscall_64+0x5c/0xc0 Aug 22 17:16:06 juju-e4d256-prod-github-runner-207 kernel: [42740.607582] ? do_futex+0x162/0x1f0 Aug 22 17:16:06 juju-e4d256-prod-github-runner-207 kernel: [42740.608242] ? __x64_sys_futex+0x78/0x1e0 Aug 22 17:16:06 juju-e4d256-prod-github-runner-207 kernel: [42740.608913] ? __secure_computing+0xa9/0x120 Aug 22 17:16:06 juju-e4d256-prod-github-runner-207 kernel: [42740.609601] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 17:16:06 juju-e4d256-prod-github-runner-207 kernel: [42740.610367] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:16:06 juju-e4d256-prod-github-runner-207 kernel: [42740.611088] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:16:06 juju-e4d256-prod-github-runner-207 kernel: [42740.611818] ? do_syscall_64+0x69/0xc0 Aug 22 17:16:06 juju-e4d256-prod-github-runner-207 kernel: [42740.612461] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:16:06 juju-e4d256-prod-github-runner-207 kernel: [42740.613169] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:16:06 juju-e4d256-prod-github-runner-207 kernel: [42740.613862] ? do_syscall_64+0x69/0xc0 Aug 22 17:16:06 juju-e4d256-prod-github-runner-207 kernel: [42740.614601] ? do_syscall_64+0x69/0xc0 Aug 22 17:16:06 juju-e4d256-prod-github-runner-207 kernel: [42740.615222] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 17:16:06 juju-e4d256-prod-github-runner-207 kernel: [42740.615939] RIP: 0033:0x7faa5d0edaff Aug 22 17:16:06 juju-e4d256-prod-github-runner-207 kernel: [42740.616565] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 17:16:06 juju-e4d256-prod-github-runner-207 kernel: [42740.618548] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 17:16:06 juju-e4d256-prod-github-runner-207 kernel: [42740.619462] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 17:16:06 juju-e4d256-prod-github-runner-207 kernel: [42740.620356] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 17:16:06 juju-e4d256-prod-github-runner-207 kernel: [42740.621255] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 17:16:06 juju-e4d256-prod-github-runner-207 kernel: [42740.622150] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 17:16:06 juju-e4d256-prod-github-runner-207 kernel: [42740.623035] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 17:16:06 juju-e4d256-prod-github-runner-207 kernel: [42740.623939] Aug 22 17:16:34 juju-e4d256-prod-github-runner-207 kernel: [42768.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 39723s! [qemu-system-x86:6715] Aug 22 17:16:34 juju-e4d256-prod-github-runner-207 kernel: [42768.543095] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 17:16:34 juju-e4d256-prod-github-runner-207 kernel: [42768.543160] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 17:16:34 juju-e4d256-prod-github-runner-207 kernel: [42768.555196] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 17:16:34 juju-e4d256-prod-github-runner-207 kernel: [42768.556477] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 17:16:34 juju-e4d256-prod-github-runner-207 kernel: [42768.557697] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:16:34 juju-e4d256-prod-github-runner-207 kernel: [42768.558758] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 17:16:34 juju-e4d256-prod-github-runner-207 kernel: [42768.561319] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 17:16:34 juju-e4d256-prod-github-runner-207 kernel: [42768.562365] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 17:16:34 juju-e4d256-prod-github-runner-207 kernel: [42768.563542] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 17:16:34 juju-e4d256-prod-github-runner-207 kernel: [42768.564702] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 17:16:34 juju-e4d256-prod-github-runner-207 kernel: [42768.565860] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 17:16:34 juju-e4d256-prod-github-runner-207 kernel: [42768.567023] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 17:16:34 juju-e4d256-prod-github-runner-207 kernel: [42768.568199] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 17:16:34 juju-e4d256-prod-github-runner-207 kernel: [42768.569440] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 17:16:34 juju-e4d256-prod-github-runner-207 kernel: [42768.570534] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 17:16:34 juju-e4d256-prod-github-runner-207 kernel: [42768.571734] Call Trace: Aug 22 17:16:34 juju-e4d256-prod-github-runner-207 kernel: [42768.572648] Aug 22 17:16:34 juju-e4d256-prod-github-runner-207 kernel: [42768.573530] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:16:34 juju-e4d256-prod-github-runner-207 kernel: [42768.574562] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:16:34 juju-e4d256-prod-github-runner-207 kernel: [42768.575592] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:16:34 juju-e4d256-prod-github-runner-207 kernel: [42768.576666] ? show_regs.part.0+0x23/0x29 Aug 22 17:16:34 juju-e4d256-prod-github-runner-207 kernel: [42768.577660] ? show_regs.cold+0x8/0xd Aug 22 17:16:34 juju-e4d256-prod-github-runner-207 kernel: [42768.578631] ? watchdog_timer_fn+0x1be/0x220 Aug 22 17:16:34 juju-e4d256-prod-github-runner-207 kernel: [42768.579655] ? lockup_detector_update_enable+0x60/0x60 Aug 22 17:16:34 juju-e4d256-prod-github-runner-207 kernel: [42768.580716] ? __hrtimer_run_queues+0x107/0x230 Aug 22 17:16:34 juju-e4d256-prod-github-runner-207 kernel: [42768.581741] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 17:16:34 juju-e4d256-prod-github-runner-207 kernel: [42768.582762] ? hrtimer_interrupt+0x101/0x220 Aug 22 17:16:34 juju-e4d256-prod-github-runner-207 kernel: [42768.583789] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 17:16:34 juju-e4d256-prod-github-runner-207 kernel: [42768.584867] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 17:16:34 juju-e4d256-prod-github-runner-207 kernel: [42768.585911] Aug 22 17:16:34 juju-e4d256-prod-github-runner-207 kernel: [42768.586761] Aug 22 17:16:34 juju-e4d256-prod-github-runner-207 kernel: [42768.587610] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 17:16:34 juju-e4d256-prod-github-runner-207 kernel: [42768.588649] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:16:34 juju-e4d256-prod-github-runner-207 kernel: [42768.589688] ? _raw_spin_lock+0x22/0x30 Aug 22 17:16:34 juju-e4d256-prod-github-runner-207 kernel: [42768.590630] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:16:34 juju-e4d256-prod-github-runner-207 kernel: [42768.591652] direct_page_fault+0x206/0x310 [kvm] Aug 22 17:16:34 juju-e4d256-prod-github-runner-207 kernel: [42768.592674] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 17:16:34 juju-e4d256-prod-github-runner-207 kernel: [42768.593681] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 17:16:34 juju-e4d256-prod-github-runner-207 kernel: [42768.594681] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 17:16:34 juju-e4d256-prod-github-runner-207 kernel: [42768.595662] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 17:16:34 juju-e4d256-prod-github-runner-207 kernel: [42768.596606] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 17:16:34 juju-e4d256-prod-github-runner-207 kernel: [42768.597587] handle_exit+0x98/0x230 [kvm_amd] Aug 22 17:16:34 juju-e4d256-prod-github-runner-207 kernel: [42768.598476] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 17:16:34 juju-e4d256-prod-github-runner-207 kernel: [42768.599403] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 17:16:34 juju-e4d256-prod-github-runner-207 kernel: [42768.600509] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 17:16:34 juju-e4d256-prod-github-runner-207 kernel: [42768.601412] vcpu_run+0x62/0x2c0 [kvm] Aug 22 17:16:34 juju-e4d256-prod-github-runner-207 kernel: [42768.602221] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 17:16:34 juju-e4d256-prod-github-runner-207 kernel: [42768.603031] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 17:16:34 juju-e4d256-prod-github-runner-207 kernel: [42768.604028] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 17:16:34 juju-e4d256-prod-github-runner-207 kernel: [42768.604824] ? __seccomp_filter+0x4a/0x4a0 Aug 22 17:16:34 juju-e4d256-prod-github-runner-207 kernel: [42768.605573] ? __fget_files+0x86/0xc0 Aug 22 17:16:34 juju-e4d256-prod-github-runner-207 kernel: [42768.606275] __x64_sys_ioctl+0x95/0xd0 Aug 22 17:16:34 juju-e4d256-prod-github-runner-207 kernel: [42768.606969] do_syscall_64+0x5c/0xc0 Aug 22 17:16:34 juju-e4d256-prod-github-runner-207 kernel: [42768.607644] ? do_futex+0x162/0x1f0 Aug 22 17:16:34 juju-e4d256-prod-github-runner-207 kernel: [42768.608292] ? __x64_sys_futex+0x78/0x1e0 Aug 22 17:16:34 juju-e4d256-prod-github-runner-207 kernel: [42768.608964] ? __secure_computing+0xa9/0x120 Aug 22 17:16:34 juju-e4d256-prod-github-runner-207 kernel: [42768.609656] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 17:16:34 juju-e4d256-prod-github-runner-207 kernel: [42768.610423] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:16:34 juju-e4d256-prod-github-runner-207 kernel: [42768.611143] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:16:34 juju-e4d256-prod-github-runner-207 kernel: [42768.611871] ? do_syscall_64+0x69/0xc0 Aug 22 17:16:34 juju-e4d256-prod-github-runner-207 kernel: [42768.612514] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:16:34 juju-e4d256-prod-github-runner-207 kernel: [42768.613214] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:16:34 juju-e4d256-prod-github-runner-207 kernel: [42768.613905] ? do_syscall_64+0x69/0xc0 Aug 22 17:16:34 juju-e4d256-prod-github-runner-207 kernel: [42768.614526] ? do_syscall_64+0x69/0xc0 Aug 22 17:16:34 juju-e4d256-prod-github-runner-207 kernel: [42768.615146] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 17:16:34 juju-e4d256-prod-github-runner-207 kernel: [42768.615860] RIP: 0033:0x7faa5d0edaff Aug 22 17:16:34 juju-e4d256-prod-github-runner-207 kernel: [42768.616486] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 17:16:34 juju-e4d256-prod-github-runner-207 kernel: [42768.618458] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 17:16:34 juju-e4d256-prod-github-runner-207 kernel: [42768.619381] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 17:16:34 juju-e4d256-prod-github-runner-207 kernel: [42768.620270] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 17:16:34 juju-e4d256-prod-github-runner-207 kernel: [42768.621166] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 17:16:34 juju-e4d256-prod-github-runner-207 kernel: [42768.622055] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 17:16:34 juju-e4d256-prod-github-runner-207 kernel: [42768.622940] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 17:16:34 juju-e4d256-prod-github-runner-207 kernel: [42768.623834] Aug 22 17:17:02 juju-e4d256-prod-github-runner-207 kernel: [42796.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 39749s! [qemu-system-x86:6715] Aug 22 17:17:02 juju-e4d256-prod-github-runner-207 kernel: [42796.543233] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 17:17:02 juju-e4d256-prod-github-runner-207 kernel: [42796.543381] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 17:17:02 juju-e4d256-prod-github-runner-207 kernel: [42796.555559] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 17:17:02 juju-e4d256-prod-github-runner-207 kernel: [42796.556842] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 17:17:02 juju-e4d256-prod-github-runner-207 kernel: [42796.558078] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:17:02 juju-e4d256-prod-github-runner-207 kernel: [42796.559165] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 17:17:02 juju-e4d256-prod-github-runner-207 kernel: [42796.561774] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 17:17:02 juju-e4d256-prod-github-runner-207 kernel: [42796.562817] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 17:17:02 juju-e4d256-prod-github-runner-207 kernel: [42796.563995] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 17:17:02 juju-e4d256-prod-github-runner-207 kernel: [42796.565156] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 17:17:02 juju-e4d256-prod-github-runner-207 kernel: [42796.566323] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 17:17:02 juju-e4d256-prod-github-runner-207 kernel: [42796.567491] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 17:17:02 juju-e4d256-prod-github-runner-207 kernel: [42796.568656] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 17:17:02 juju-e4d256-prod-github-runner-207 kernel: [42796.569887] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 17:17:02 juju-e4d256-prod-github-runner-207 kernel: [42796.570983] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 17:17:02 juju-e4d256-prod-github-runner-207 kernel: [42796.572182] Call Trace: Aug 22 17:17:02 juju-e4d256-prod-github-runner-207 kernel: [42796.573093] Aug 22 17:17:02 juju-e4d256-prod-github-runner-207 kernel: [42796.573980] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:17:02 juju-e4d256-prod-github-runner-207 kernel: [42796.575009] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:17:02 juju-e4d256-prod-github-runner-207 kernel: [42796.576052] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:17:02 juju-e4d256-prod-github-runner-207 kernel: [42796.577147] ? show_regs.part.0+0x23/0x29 Aug 22 17:17:02 juju-e4d256-prod-github-runner-207 kernel: [42796.578148] ? show_regs.cold+0x8/0xd Aug 22 17:17:02 juju-e4d256-prod-github-runner-207 kernel: [42796.579126] ? watchdog_timer_fn+0x1be/0x220 Aug 22 17:17:02 juju-e4d256-prod-github-runner-207 kernel: [42796.580141] ? lockup_detector_update_enable+0x60/0x60 Aug 22 17:17:02 juju-e4d256-prod-github-runner-207 kernel: [42796.581206] ? __hrtimer_run_queues+0x107/0x230 Aug 22 17:17:02 juju-e4d256-prod-github-runner-207 kernel: [42796.582234] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 17:17:02 juju-e4d256-prod-github-runner-207 kernel: [42796.583280] ? hrtimer_interrupt+0x101/0x220 Aug 22 17:17:02 juju-e4d256-prod-github-runner-207 kernel: [42796.584295] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 17:17:02 juju-e4d256-prod-github-runner-207 kernel: [42796.585371] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 17:17:02 juju-e4d256-prod-github-runner-207 kernel: [42796.586420] Aug 22 17:17:02 juju-e4d256-prod-github-runner-207 kernel: [42796.587279] Aug 22 17:17:02 juju-e4d256-prod-github-runner-207 kernel: [42796.588116] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 17:17:02 juju-e4d256-prod-github-runner-207 kernel: [42796.589224] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:17:02 juju-e4d256-prod-github-runner-207 kernel: [42796.590263] ? _raw_spin_lock+0x22/0x30 Aug 22 17:17:02 juju-e4d256-prod-github-runner-207 kernel: [42796.591231] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:17:02 juju-e4d256-prod-github-runner-207 kernel: [42796.592253] direct_page_fault+0x206/0x310 [kvm] Aug 22 17:17:02 juju-e4d256-prod-github-runner-207 kernel: [42796.593282] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 17:17:02 juju-e4d256-prod-github-runner-207 kernel: [42796.594297] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 17:17:02 juju-e4d256-prod-github-runner-207 kernel: [42796.595310] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 17:17:02 juju-e4d256-prod-github-runner-207 kernel: [42796.596307] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 17:17:02 juju-e4d256-prod-github-runner-207 kernel: [42796.597254] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 17:17:02 juju-e4d256-prod-github-runner-207 kernel: [42796.598235] handle_exit+0x98/0x230 [kvm_amd] Aug 22 17:17:02 juju-e4d256-prod-github-runner-207 kernel: [42796.599136] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 17:17:02 juju-e4d256-prod-github-runner-207 kernel: [42796.600051] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 17:17:02 juju-e4d256-prod-github-runner-207 kernel: [42796.600976] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 17:17:02 juju-e4d256-prod-github-runner-207 kernel: [42796.601884] vcpu_run+0x62/0x2c0 [kvm] Aug 22 17:17:02 juju-e4d256-prod-github-runner-207 kernel: [42796.602694] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 17:17:02 juju-e4d256-prod-github-runner-207 kernel: [42796.603510] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 17:17:02 juju-e4d256-prod-github-runner-207 kernel: [42796.604370] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 17:17:02 juju-e4d256-prod-github-runner-207 kernel: [42796.605166] ? __seccomp_filter+0x4a/0x4a0 Aug 22 17:17:02 juju-e4d256-prod-github-runner-207 kernel: [42796.605912] ? __fget_files+0x86/0xc0 Aug 22 17:17:02 juju-e4d256-prod-github-runner-207 kernel: [42796.606618] __x64_sys_ioctl+0x95/0xd0 Aug 22 17:17:02 juju-e4d256-prod-github-runner-207 kernel: [42796.607326] do_syscall_64+0x5c/0xc0 Aug 22 17:17:02 juju-e4d256-prod-github-runner-207 kernel: [42796.607991] ? do_futex+0x162/0x1f0 Aug 22 17:17:02 juju-e4d256-prod-github-runner-207 kernel: [42796.608639] ? __x64_sys_futex+0x78/0x1e0 Aug 22 17:17:02 juju-e4d256-prod-github-runner-207 kernel: [42796.609313] ? __secure_computing+0xa9/0x120 Aug 22 17:17:02 juju-e4d256-prod-github-runner-207 kernel: [42796.610002] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 17:17:02 juju-e4d256-prod-github-runner-207 kernel: [42796.610769] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:17:02 juju-e4d256-prod-github-runner-207 kernel: [42796.611506] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:17:02 juju-e4d256-prod-github-runner-207 kernel: [42796.612224] ? do_syscall_64+0x69/0xc0 Aug 22 17:17:02 juju-e4d256-prod-github-runner-207 kernel: [42796.612867] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:17:02 juju-e4d256-prod-github-runner-207 kernel: [42796.613570] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:17:02 juju-e4d256-prod-github-runner-207 kernel: [42796.614268] ? do_syscall_64+0x69/0xc0 Aug 22 17:17:02 juju-e4d256-prod-github-runner-207 kernel: [42796.614893] ? do_syscall_64+0x69/0xc0 Aug 22 17:17:02 juju-e4d256-prod-github-runner-207 kernel: [42796.615523] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 17:17:02 juju-e4d256-prod-github-runner-207 kernel: [42796.616312] RIP: 0033:0x7faa5d0edaff Aug 22 17:17:02 juju-e4d256-prod-github-runner-207 kernel: [42796.616938] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 17:17:02 juju-e4d256-prod-github-runner-207 kernel: [42796.618922] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 17:17:02 juju-e4d256-prod-github-runner-207 kernel: [42796.619856] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 17:17:02 juju-e4d256-prod-github-runner-207 kernel: [42796.620744] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 17:17:02 juju-e4d256-prod-github-runner-207 kernel: [42796.621631] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 17:17:02 juju-e4d256-prod-github-runner-207 kernel: [42796.622517] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 17:17:02 juju-e4d256-prod-github-runner-207 kernel: [42796.623413] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 17:17:02 juju-e4d256-prod-github-runner-207 kernel: [42796.624312] Aug 22 17:17:30 juju-e4d256-prod-github-runner-207 kernel: [42824.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 39775s! [qemu-system-x86:6715] Aug 22 17:17:30 juju-e4d256-prod-github-runner-207 kernel: [42824.543672] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 17:17:30 juju-e4d256-prod-github-runner-207 kernel: [42824.543874] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 17:17:30 juju-e4d256-prod-github-runner-207 kernel: [42824.556065] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 17:17:30 juju-e4d256-prod-github-runner-207 kernel: [42824.557333] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 17:17:30 juju-e4d256-prod-github-runner-207 kernel: [42824.558558] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:17:30 juju-e4d256-prod-github-runner-207 kernel: [42824.559625] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 17:17:30 juju-e4d256-prod-github-runner-207 kernel: [42824.562170] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 17:17:30 juju-e4d256-prod-github-runner-207 kernel: [42824.563225] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 17:17:30 juju-e4d256-prod-github-runner-207 kernel: [42824.564389] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 17:17:30 juju-e4d256-prod-github-runner-207 kernel: [42824.565555] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 17:17:30 juju-e4d256-prod-github-runner-207 kernel: [42824.566721] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 17:17:30 juju-e4d256-prod-github-runner-207 kernel: [42824.567884] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 17:17:30 juju-e4d256-prod-github-runner-207 kernel: [42824.569050] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 17:17:30 juju-e4d256-prod-github-runner-207 kernel: [42824.570284] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 17:17:30 juju-e4d256-prod-github-runner-207 kernel: [42824.571394] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 17:17:30 juju-e4d256-prod-github-runner-207 kernel: [42824.572589] Call Trace: Aug 22 17:17:30 juju-e4d256-prod-github-runner-207 kernel: [42824.573502] Aug 22 17:17:30 juju-e4d256-prod-github-runner-207 kernel: [42824.574386] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:17:30 juju-e4d256-prod-github-runner-207 kernel: [42824.575425] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:17:30 juju-e4d256-prod-github-runner-207 kernel: [42824.576446] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:17:30 juju-e4d256-prod-github-runner-207 kernel: [42824.577522] ? show_regs.part.0+0x23/0x29 Aug 22 17:17:30 juju-e4d256-prod-github-runner-207 kernel: [42824.578522] ? show_regs.cold+0x8/0xd Aug 22 17:17:30 juju-e4d256-prod-github-runner-207 kernel: [42824.579500] ? watchdog_timer_fn+0x1be/0x220 Aug 22 17:17:30 juju-e4d256-prod-github-runner-207 kernel: [42824.580508] ? lockup_detector_update_enable+0x60/0x60 Aug 22 17:17:30 juju-e4d256-prod-github-runner-207 kernel: [42824.581578] ? __hrtimer_run_queues+0x107/0x230 Aug 22 17:17:30 juju-e4d256-prod-github-runner-207 kernel: [42824.582603] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 17:17:30 juju-e4d256-prod-github-runner-207 kernel: [42824.583639] ? hrtimer_interrupt+0x101/0x220 Aug 22 17:17:30 juju-e4d256-prod-github-runner-207 kernel: [42824.584654] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 17:17:30 juju-e4d256-prod-github-runner-207 kernel: [42824.585721] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 17:17:30 juju-e4d256-prod-github-runner-207 kernel: [42824.586772] Aug 22 17:17:30 juju-e4d256-prod-github-runner-207 kernel: [42824.587630] Aug 22 17:17:30 juju-e4d256-prod-github-runner-207 kernel: [42824.588467] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 17:17:30 juju-e4d256-prod-github-runner-207 kernel: [42824.589500] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:17:30 juju-e4d256-prod-github-runner-207 kernel: [42824.590539] ? _raw_spin_lock+0x22/0x30 Aug 22 17:17:30 juju-e4d256-prod-github-runner-207 kernel: [42824.591493] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:17:30 juju-e4d256-prod-github-runner-207 kernel: [42824.592508] direct_page_fault+0x206/0x310 [kvm] Aug 22 17:17:30 juju-e4d256-prod-github-runner-207 kernel: [42824.593532] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 17:17:30 juju-e4d256-prod-github-runner-207 kernel: [42824.594539] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 17:17:30 juju-e4d256-prod-github-runner-207 kernel: [42824.595553] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 17:17:30 juju-e4d256-prod-github-runner-207 kernel: [42824.596531] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 17:17:30 juju-e4d256-prod-github-runner-207 kernel: [42824.597476] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 17:17:30 juju-e4d256-prod-github-runner-207 kernel: [42824.598453] handle_exit+0x98/0x230 [kvm_amd] Aug 22 17:17:30 juju-e4d256-prod-github-runner-207 kernel: [42824.599360] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 17:17:30 juju-e4d256-prod-github-runner-207 kernel: [42824.600279] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 17:17:30 juju-e4d256-prod-github-runner-207 kernel: [42824.601202] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 17:17:30 juju-e4d256-prod-github-runner-207 kernel: [42824.602104] vcpu_run+0x62/0x2c0 [kvm] Aug 22 17:17:30 juju-e4d256-prod-github-runner-207 kernel: [42824.602979] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 17:17:30 juju-e4d256-prod-github-runner-207 kernel: [42824.603951] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 17:17:30 juju-e4d256-prod-github-runner-207 kernel: [42824.604810] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 17:17:30 juju-e4d256-prod-github-runner-207 kernel: [42824.605620] ? __seccomp_filter+0x4a/0x4a0 Aug 22 17:17:30 juju-e4d256-prod-github-runner-207 kernel: [42824.606362] ? __fget_files+0x86/0xc0 Aug 22 17:17:30 juju-e4d256-prod-github-runner-207 kernel: [42824.607072] __x64_sys_ioctl+0x95/0xd0 Aug 22 17:17:30 juju-e4d256-prod-github-runner-207 kernel: [42824.607765] do_syscall_64+0x5c/0xc0 Aug 22 17:17:30 juju-e4d256-prod-github-runner-207 kernel: [42824.608428] ? do_futex+0x162/0x1f0 Aug 22 17:17:30 juju-e4d256-prod-github-runner-207 kernel: [42824.609084] ? __x64_sys_futex+0x78/0x1e0 Aug 22 17:17:30 juju-e4d256-prod-github-runner-207 kernel: [42824.609761] ? __secure_computing+0xa9/0x120 Aug 22 17:17:30 juju-e4d256-prod-github-runner-207 kernel: [42824.610449] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 17:17:30 juju-e4d256-prod-github-runner-207 kernel: [42824.611227] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:17:30 juju-e4d256-prod-github-runner-207 kernel: [42824.611950] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:17:30 juju-e4d256-prod-github-runner-207 kernel: [42824.612672] ? do_syscall_64+0x69/0xc0 Aug 22 17:17:30 juju-e4d256-prod-github-runner-207 kernel: [42824.613317] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:17:30 juju-e4d256-prod-github-runner-207 kernel: [42824.614020] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:17:30 juju-e4d256-prod-github-runner-207 kernel: [42824.614724] ? do_syscall_64+0x69/0xc0 Aug 22 17:17:30 juju-e4d256-prod-github-runner-207 kernel: [42824.615349] ? do_syscall_64+0x69/0xc0 Aug 22 17:17:30 juju-e4d256-prod-github-runner-207 kernel: [42824.615977] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 17:17:30 juju-e4d256-prod-github-runner-207 kernel: [42824.616681] RIP: 0033:0x7faa5d0edaff Aug 22 17:17:30 juju-e4d256-prod-github-runner-207 kernel: [42824.617325] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 17:17:30 juju-e4d256-prod-github-runner-207 kernel: [42824.619331] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 17:17:30 juju-e4d256-prod-github-runner-207 kernel: [42824.620280] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 17:17:30 juju-e4d256-prod-github-runner-207 kernel: [42824.621193] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 17:17:30 juju-e4d256-prod-github-runner-207 kernel: [42824.622112] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 17:17:30 juju-e4d256-prod-github-runner-207 kernel: [42824.623010] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 17:17:30 juju-e4d256-prod-github-runner-207 kernel: [42824.623901] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 17:17:30 juju-e4d256-prod-github-runner-207 kernel: [42824.624799] Aug 22 17:17:46 juju-e4d256-prod-github-runner-207 kernel: [42840.044704] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 17:17:46 juju-e4d256-prod-github-runner-207 kernel: [42840.045652] rcu: 1-....: (10647236 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=5152397 Aug 22 17:17:46 juju-e4d256-prod-github-runner-207 kernel: [42840.046786] (t=10680711 jiffies g=23269 q=42905) Aug 22 17:17:46 juju-e4d256-prod-github-runner-207 kernel: [42840.047573] NMI backtrace for cpu 1 Aug 22 17:17:46 juju-e4d256-prod-github-runner-207 kernel: [42840.048308] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 17:17:46 juju-e4d256-prod-github-runner-207 kernel: [42840.049409] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 17:17:46 juju-e4d256-prod-github-runner-207 kernel: [42840.050466] Call Trace: Aug 22 17:17:46 juju-e4d256-prod-github-runner-207 kernel: [42840.051154] Aug 22 17:17:46 juju-e4d256-prod-github-runner-207 kernel: [42840.051795] show_stack+0x52/0x5c Aug 22 17:17:46 juju-e4d256-prod-github-runner-207 kernel: [42840.052516] dump_stack_lvl+0x4a/0x63 Aug 22 17:17:46 juju-e4d256-prod-github-runner-207 kernel: [42840.053269] dump_stack+0x10/0x16 Aug 22 17:17:46 juju-e4d256-prod-github-runner-207 kernel: [42840.053984] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 17:17:46 juju-e4d256-prod-github-runner-207 kernel: [42840.054796] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 17:17:46 juju-e4d256-prod-github-runner-207 kernel: [42840.055575] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 17:17:46 juju-e4d256-prod-github-runner-207 kernel: [42840.056392] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 17:17:46 juju-e4d256-prod-github-runner-207 kernel: [42840.057209] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 17:17:46 juju-e4d256-prod-github-runner-207 kernel: [42840.058014] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 17:17:46 juju-e4d256-prod-github-runner-207 kernel: [42840.058793] print_cpu_stall.cold+0x2f/0xe2 Aug 22 17:17:46 juju-e4d256-prod-github-runner-207 kernel: [42840.059556] ? timekeeping_update+0xf7/0x150 Aug 22 17:17:46 juju-e4d256-prod-github-runner-207 kernel: [42840.060321] check_cpu_stall+0x109/0x270 Aug 22 17:17:46 juju-e4d256-prod-github-runner-207 kernel: [42840.061066] rcu_sched_clock_irq+0x9a/0x250 Aug 22 17:17:46 juju-e4d256-prod-github-runner-207 kernel: [42840.061824] update_process_times+0x94/0xd0 Aug 22 17:17:46 juju-e4d256-prod-github-runner-207 kernel: [42840.062593] tick_sched_handle+0x29/0x70 Aug 22 17:17:46 juju-e4d256-prod-github-runner-207 kernel: [42840.063343] tick_sched_timer+0x8c/0xc0 Aug 22 17:17:46 juju-e4d256-prod-github-runner-207 kernel: [42840.064089] ? tick_nohz_handler+0xb0/0xb0 Aug 22 17:17:46 juju-e4d256-prod-github-runner-207 kernel: [42840.064841] __hrtimer_run_queues+0x107/0x230 Aug 22 17:17:46 juju-e4d256-prod-github-runner-207 kernel: [42840.065611] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 17:17:46 juju-e4d256-prod-github-runner-207 kernel: [42840.066383] hrtimer_interrupt+0x101/0x220 Aug 22 17:17:46 juju-e4d256-prod-github-runner-207 kernel: [42840.067155] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 17:17:46 juju-e4d256-prod-github-runner-207 kernel: [42840.067964] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 17:17:46 juju-e4d256-prod-github-runner-207 kernel: [42840.068760] Aug 22 17:17:46 juju-e4d256-prod-github-runner-207 kernel: [42840.069393] Aug 22 17:17:46 juju-e4d256-prod-github-runner-207 kernel: [42840.070019] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 17:17:46 juju-e4d256-prod-github-runner-207 kernel: [42840.070843] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:17:46 juju-e4d256-prod-github-runner-207 kernel: [42840.071719] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 17:17:46 juju-e4d256-prod-github-runner-207 kernel: [42840.073911] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 17:17:46 juju-e4d256-prod-github-runner-207 kernel: [42840.074788] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 17:17:46 juju-e4d256-prod-github-runner-207 kernel: [42840.075778] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 17:17:46 juju-e4d256-prod-github-runner-207 kernel: [42840.076750] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 17:17:46 juju-e4d256-prod-github-runner-207 kernel: [42840.077711] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 17:17:46 juju-e4d256-prod-github-runner-207 kernel: [42840.078671] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 17:17:46 juju-e4d256-prod-github-runner-207 kernel: [42840.079619] ? _raw_spin_lock+0x22/0x30 Aug 22 17:17:46 juju-e4d256-prod-github-runner-207 kernel: [42840.080374] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:17:46 juju-e4d256-prod-github-runner-207 kernel: [42840.081207] direct_page_fault+0x206/0x310 [kvm] Aug 22 17:17:46 juju-e4d256-prod-github-runner-207 kernel: [42840.082044] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 17:17:46 juju-e4d256-prod-github-runner-207 kernel: [42840.082886] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 17:17:46 juju-e4d256-prod-github-runner-207 kernel: [42840.083714] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 17:17:46 juju-e4d256-prod-github-runner-207 kernel: [42840.084527] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 17:17:46 juju-e4d256-prod-github-runner-207 kernel: [42840.085320] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 17:17:46 juju-e4d256-prod-github-runner-207 kernel: [42840.086140] handle_exit+0x98/0x230 [kvm_amd] Aug 22 17:17:46 juju-e4d256-prod-github-runner-207 kernel: [42840.086902] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 17:17:46 juju-e4d256-prod-github-runner-207 kernel: [42840.087683] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 17:17:46 juju-e4d256-prod-github-runner-207 kernel: [42840.088479] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 17:17:46 juju-e4d256-prod-github-runner-207 kernel: [42840.089261] vcpu_run+0x62/0x2c0 [kvm] Aug 22 17:17:46 juju-e4d256-prod-github-runner-207 kernel: [42840.089974] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 17:17:46 juju-e4d256-prod-github-runner-207 kernel: [42840.090711] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 17:17:46 juju-e4d256-prod-github-runner-207 kernel: [42840.091511] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 17:17:46 juju-e4d256-prod-github-runner-207 kernel: [42840.092274] ? __seccomp_filter+0x4a/0x4a0 Aug 22 17:17:46 juju-e4d256-prod-github-runner-207 kernel: [42840.092991] ? __fget_files+0x86/0xc0 Aug 22 17:17:46 juju-e4d256-prod-github-runner-207 kernel: [42840.093683] __x64_sys_ioctl+0x95/0xd0 Aug 22 17:17:46 juju-e4d256-prod-github-runner-207 kernel: [42840.094379] do_syscall_64+0x5c/0xc0 Aug 22 17:17:46 juju-e4d256-prod-github-runner-207 kernel: [42840.095064] ? do_futex+0x162/0x1f0 Aug 22 17:17:46 juju-e4d256-prod-github-runner-207 kernel: [42840.095733] ? __x64_sys_futex+0x78/0x1e0 Aug 22 17:17:46 juju-e4d256-prod-github-runner-207 kernel: [42840.096430] ? __secure_computing+0xa9/0x120 Aug 22 17:17:46 juju-e4d256-prod-github-runner-207 kernel: [42840.097143] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 17:17:46 juju-e4d256-prod-github-runner-207 kernel: [42840.097929] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:17:46 juju-e4d256-prod-github-runner-207 kernel: [42840.098688] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:17:46 juju-e4d256-prod-github-runner-207 kernel: [42840.099439] ? do_syscall_64+0x69/0xc0 Aug 22 17:17:46 juju-e4d256-prod-github-runner-207 kernel: [42840.100126] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:17:46 juju-e4d256-prod-github-runner-207 kernel: [42840.100880] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:17:46 juju-e4d256-prod-github-runner-207 kernel: [42840.101778] ? do_syscall_64+0x69/0xc0 Aug 22 17:17:46 juju-e4d256-prod-github-runner-207 kernel: [42840.102470] ? do_syscall_64+0x69/0xc0 Aug 22 17:17:46 juju-e4d256-prod-github-runner-207 kernel: [42840.103167] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 17:17:46 juju-e4d256-prod-github-runner-207 kernel: [42840.103934] RIP: 0033:0x7faa5d0edaff Aug 22 17:17:46 juju-e4d256-prod-github-runner-207 kernel: [42840.104624] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 17:17:46 juju-e4d256-prod-github-runner-207 kernel: [42840.106724] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 17:17:46 juju-e4d256-prod-github-runner-207 kernel: [42840.107680] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 17:17:46 juju-e4d256-prod-github-runner-207 kernel: [42840.108619] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 17:17:46 juju-e4d256-prod-github-runner-207 kernel: [42840.109557] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 17:17:46 juju-e4d256-prod-github-runner-207 kernel: [42840.110504] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 17:17:46 juju-e4d256-prod-github-runner-207 kernel: [42840.111425] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 17:17:46 juju-e4d256-prod-github-runner-207 kernel: [42840.112334] Aug 22 17:18:10 juju-e4d256-prod-github-runner-207 kernel: [42864.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 39812s! [qemu-system-x86:6715] Aug 22 17:18:10 juju-e4d256-prod-github-runner-207 kernel: [42864.543136] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 17:18:10 juju-e4d256-prod-github-runner-207 kernel: [42864.543201] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 17:18:10 juju-e4d256-prod-github-runner-207 kernel: [42864.555437] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 17:18:10 juju-e4d256-prod-github-runner-207 kernel: [42864.556702] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 17:18:10 juju-e4d256-prod-github-runner-207 kernel: [42864.557931] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:18:10 juju-e4d256-prod-github-runner-207 kernel: [42864.559024] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 17:18:10 juju-e4d256-prod-github-runner-207 kernel: [42864.561566] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 17:18:10 juju-e4d256-prod-github-runner-207 kernel: [42864.562692] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 17:18:10 juju-e4d256-prod-github-runner-207 kernel: [42864.563890] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 17:18:10 juju-e4d256-prod-github-runner-207 kernel: [42864.565060] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 17:18:10 juju-e4d256-prod-github-runner-207 kernel: [42864.566250] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 17:18:10 juju-e4d256-prod-github-runner-207 kernel: [42864.567421] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 17:18:10 juju-e4d256-prod-github-runner-207 kernel: [42864.568606] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 17:18:10 juju-e4d256-prod-github-runner-207 kernel: [42864.569840] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 17:18:10 juju-e4d256-prod-github-runner-207 kernel: [42864.570954] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 17:18:10 juju-e4d256-prod-github-runner-207 kernel: [42864.572145] Call Trace: Aug 22 17:18:10 juju-e4d256-prod-github-runner-207 kernel: [42864.573073] Aug 22 17:18:10 juju-e4d256-prod-github-runner-207 kernel: [42864.573972] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:18:10 juju-e4d256-prod-github-runner-207 kernel: [42864.575018] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:18:10 juju-e4d256-prod-github-runner-207 kernel: [42864.576038] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:18:10 juju-e4d256-prod-github-runner-207 kernel: [42864.577110] ? show_regs.part.0+0x23/0x29 Aug 22 17:18:10 juju-e4d256-prod-github-runner-207 kernel: [42864.578124] ? show_regs.cold+0x8/0xd Aug 22 17:18:10 juju-e4d256-prod-github-runner-207 kernel: [42864.579129] ? watchdog_timer_fn+0x1be/0x220 Aug 22 17:18:10 juju-e4d256-prod-github-runner-207 kernel: [42864.580163] ? lockup_detector_update_enable+0x60/0x60 Aug 22 17:18:10 juju-e4d256-prod-github-runner-207 kernel: [42864.581239] ? __hrtimer_run_queues+0x107/0x230 Aug 22 17:18:10 juju-e4d256-prod-github-runner-207 kernel: [42864.582279] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 17:18:10 juju-e4d256-prod-github-runner-207 kernel: [42864.583318] ? hrtimer_interrupt+0x101/0x220 Aug 22 17:18:10 juju-e4d256-prod-github-runner-207 kernel: [42864.584359] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 17:18:10 juju-e4d256-prod-github-runner-207 kernel: [42864.585432] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 17:18:10 juju-e4d256-prod-github-runner-207 kernel: [42864.586499] Aug 22 17:18:10 juju-e4d256-prod-github-runner-207 kernel: [42864.587354] Aug 22 17:18:10 juju-e4d256-prod-github-runner-207 kernel: [42864.588206] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 17:18:10 juju-e4d256-prod-github-runner-207 kernel: [42864.589255] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:18:10 juju-e4d256-prod-github-runner-207 kernel: [42864.590309] ? _raw_spin_lock+0x22/0x30 Aug 22 17:18:10 juju-e4d256-prod-github-runner-207 kernel: [42864.591258] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:18:10 juju-e4d256-prod-github-runner-207 kernel: [42864.592290] direct_page_fault+0x206/0x310 [kvm] Aug 22 17:18:10 juju-e4d256-prod-github-runner-207 kernel: [42864.593339] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 17:18:10 juju-e4d256-prod-github-runner-207 kernel: [42864.594436] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 17:18:10 juju-e4d256-prod-github-runner-207 kernel: [42864.595446] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 17:18:10 juju-e4d256-prod-github-runner-207 kernel: [42864.596414] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 17:18:10 juju-e4d256-prod-github-runner-207 kernel: [42864.597360] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 17:18:10 juju-e4d256-prod-github-runner-207 kernel: [42864.598357] handle_exit+0x98/0x230 [kvm_amd] Aug 22 17:18:10 juju-e4d256-prod-github-runner-207 kernel: [42864.599264] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 17:18:10 juju-e4d256-prod-github-runner-207 kernel: [42864.600199] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 17:18:10 juju-e4d256-prod-github-runner-207 kernel: [42864.601149] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 17:18:10 juju-e4d256-prod-github-runner-207 kernel: [42864.602054] vcpu_run+0x62/0x2c0 [kvm] Aug 22 17:18:10 juju-e4d256-prod-github-runner-207 kernel: [42864.602890] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 17:18:10 juju-e4d256-prod-github-runner-207 kernel: [42864.603716] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 17:18:10 juju-e4d256-prod-github-runner-207 kernel: [42864.604575] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 17:18:10 juju-e4d256-prod-github-runner-207 kernel: [42864.605385] ? __seccomp_filter+0x4a/0x4a0 Aug 22 17:18:10 juju-e4d256-prod-github-runner-207 kernel: [42864.606128] ? __fget_files+0x86/0xc0 Aug 22 17:18:10 juju-e4d256-prod-github-runner-207 kernel: [42864.606848] __x64_sys_ioctl+0x95/0xd0 Aug 22 17:18:10 juju-e4d256-prod-github-runner-207 kernel: [42864.607547] do_syscall_64+0x5c/0xc0 Aug 22 17:18:10 juju-e4d256-prod-github-runner-207 kernel: [42864.608213] ? do_futex+0x162/0x1f0 Aug 22 17:18:10 juju-e4d256-prod-github-runner-207 kernel: [42864.608871] ? __x64_sys_futex+0x78/0x1e0 Aug 22 17:18:10 juju-e4d256-prod-github-runner-207 kernel: [42864.609687] ? __secure_computing+0xa9/0x120 Aug 22 17:18:10 juju-e4d256-prod-github-runner-207 kernel: [42864.610441] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 17:18:10 juju-e4d256-prod-github-runner-207 kernel: [42864.611202] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:18:10 juju-e4d256-prod-github-runner-207 kernel: [42864.611921] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:18:10 juju-e4d256-prod-github-runner-207 kernel: [42864.612637] ? do_syscall_64+0x69/0xc0 Aug 22 17:18:10 juju-e4d256-prod-github-runner-207 kernel: [42864.613279] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:18:10 juju-e4d256-prod-github-runner-207 kernel: [42864.613980] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:18:10 juju-e4d256-prod-github-runner-207 kernel: [42864.614681] ? do_syscall_64+0x69/0xc0 Aug 22 17:18:10 juju-e4d256-prod-github-runner-207 kernel: [42864.615304] ? do_syscall_64+0x69/0xc0 Aug 22 17:18:10 juju-e4d256-prod-github-runner-207 kernel: [42864.615924] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 17:18:10 juju-e4d256-prod-github-runner-207 kernel: [42864.616626] RIP: 0033:0x7faa5d0edaff Aug 22 17:18:10 juju-e4d256-prod-github-runner-207 kernel: [42864.617248] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 17:18:10 juju-e4d256-prod-github-runner-207 kernel: [42864.619240] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 17:18:10 juju-e4d256-prod-github-runner-207 kernel: [42864.620149] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 17:18:10 juju-e4d256-prod-github-runner-207 kernel: [42864.621036] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 17:18:10 juju-e4d256-prod-github-runner-207 kernel: [42864.621936] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 17:18:10 juju-e4d256-prod-github-runner-207 kernel: [42864.622851] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 17:18:10 juju-e4d256-prod-github-runner-207 kernel: [42864.623736] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 17:18:10 juju-e4d256-prod-github-runner-207 kernel: [42864.624625] Aug 22 17:18:38 juju-e4d256-prod-github-runner-207 kernel: [42892.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 39838s! [qemu-system-x86:6715] Aug 22 17:18:38 juju-e4d256-prod-github-runner-207 kernel: [42892.543772] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 17:18:38 juju-e4d256-prod-github-runner-207 kernel: [42892.544027] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 17:18:38 juju-e4d256-prod-github-runner-207 kernel: [42892.556136] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 17:18:38 juju-e4d256-prod-github-runner-207 kernel: [42892.557404] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 17:18:38 juju-e4d256-prod-github-runner-207 kernel: [42892.558638] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:18:38 juju-e4d256-prod-github-runner-207 kernel: [42892.559699] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 17:18:38 juju-e4d256-prod-github-runner-207 kernel: [42892.562257] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 17:18:38 juju-e4d256-prod-github-runner-207 kernel: [42892.563305] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 17:18:38 juju-e4d256-prod-github-runner-207 kernel: [42892.564470] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 17:18:38 juju-e4d256-prod-github-runner-207 kernel: [42892.565630] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 17:18:38 juju-e4d256-prod-github-runner-207 kernel: [42892.566803] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 17:18:38 juju-e4d256-prod-github-runner-207 kernel: [42892.567962] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 17:18:38 juju-e4d256-prod-github-runner-207 kernel: [42892.569124] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 17:18:38 juju-e4d256-prod-github-runner-207 kernel: [42892.570387] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 17:18:38 juju-e4d256-prod-github-runner-207 kernel: [42892.571487] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 17:18:38 juju-e4d256-prod-github-runner-207 kernel: [42892.572683] Call Trace: Aug 22 17:18:38 juju-e4d256-prod-github-runner-207 kernel: [42892.573595] Aug 22 17:18:38 juju-e4d256-prod-github-runner-207 kernel: [42892.574511] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:18:38 juju-e4d256-prod-github-runner-207 kernel: [42892.575539] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:18:38 juju-e4d256-prod-github-runner-207 kernel: [42892.576567] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:18:38 juju-e4d256-prod-github-runner-207 kernel: [42892.577659] ? show_regs.part.0+0x23/0x29 Aug 22 17:18:38 juju-e4d256-prod-github-runner-207 kernel: [42892.578674] ? show_regs.cold+0x8/0xd Aug 22 17:18:38 juju-e4d256-prod-github-runner-207 kernel: [42892.579648] ? watchdog_timer_fn+0x1be/0x220 Aug 22 17:18:38 juju-e4d256-prod-github-runner-207 kernel: [42892.580654] ? lockup_detector_update_enable+0x60/0x60 Aug 22 17:18:38 juju-e4d256-prod-github-runner-207 kernel: [42892.581715] ? __hrtimer_run_queues+0x107/0x230 Aug 22 17:18:38 juju-e4d256-prod-github-runner-207 kernel: [42892.582819] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 17:18:38 juju-e4d256-prod-github-runner-207 kernel: [42892.583841] ? hrtimer_interrupt+0x101/0x220 Aug 22 17:18:38 juju-e4d256-prod-github-runner-207 kernel: [42892.584855] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 17:18:38 juju-e4d256-prod-github-runner-207 kernel: [42892.585942] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 17:18:38 juju-e4d256-prod-github-runner-207 kernel: [42892.586992] Aug 22 17:18:38 juju-e4d256-prod-github-runner-207 kernel: [42892.587844] Aug 22 17:18:38 juju-e4d256-prod-github-runner-207 kernel: [42892.588685] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 17:18:38 juju-e4d256-prod-github-runner-207 kernel: [42892.589722] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:18:38 juju-e4d256-prod-github-runner-207 kernel: [42892.590769] ? _raw_spin_lock+0x22/0x30 Aug 22 17:18:38 juju-e4d256-prod-github-runner-207 kernel: [42892.591718] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:18:38 juju-e4d256-prod-github-runner-207 kernel: [42892.592734] direct_page_fault+0x206/0x310 [kvm] Aug 22 17:18:38 juju-e4d256-prod-github-runner-207 kernel: [42892.593759] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 17:18:38 juju-e4d256-prod-github-runner-207 kernel: [42892.594788] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 17:18:38 juju-e4d256-prod-github-runner-207 kernel: [42892.595792] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 17:18:38 juju-e4d256-prod-github-runner-207 kernel: [42892.596782] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 17:18:38 juju-e4d256-prod-github-runner-207 kernel: [42892.597727] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 17:18:38 juju-e4d256-prod-github-runner-207 kernel: [42892.598724] handle_exit+0x98/0x230 [kvm_amd] Aug 22 17:18:38 juju-e4d256-prod-github-runner-207 kernel: [42892.599613] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 17:18:38 juju-e4d256-prod-github-runner-207 kernel: [42892.600525] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 17:18:38 juju-e4d256-prod-github-runner-207 kernel: [42892.601448] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 17:18:38 juju-e4d256-prod-github-runner-207 kernel: [42892.602363] vcpu_run+0x62/0x2c0 [kvm] Aug 22 17:18:38 juju-e4d256-prod-github-runner-207 kernel: [42892.603173] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 17:18:38 juju-e4d256-prod-github-runner-207 kernel: [42892.603980] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 17:18:38 juju-e4d256-prod-github-runner-207 kernel: [42892.604832] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 17:18:38 juju-e4d256-prod-github-runner-207 kernel: [42892.605627] ? __seccomp_filter+0x4a/0x4a0 Aug 22 17:18:38 juju-e4d256-prod-github-runner-207 kernel: [42892.606404] ? __fget_files+0x86/0xc0 Aug 22 17:18:38 juju-e4d256-prod-github-runner-207 kernel: [42892.607109] __x64_sys_ioctl+0x95/0xd0 Aug 22 17:18:38 juju-e4d256-prod-github-runner-207 kernel: [42892.607802] do_syscall_64+0x5c/0xc0 Aug 22 17:18:38 juju-e4d256-prod-github-runner-207 kernel: [42892.608470] ? do_futex+0x162/0x1f0 Aug 22 17:18:38 juju-e4d256-prod-github-runner-207 kernel: [42892.609120] ? __x64_sys_futex+0x78/0x1e0 Aug 22 17:18:38 juju-e4d256-prod-github-runner-207 kernel: [42892.609797] ? __secure_computing+0xa9/0x120 Aug 22 17:18:38 juju-e4d256-prod-github-runner-207 kernel: [42892.610511] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 17:18:38 juju-e4d256-prod-github-runner-207 kernel: [42892.611275] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:18:38 juju-e4d256-prod-github-runner-207 kernel: [42892.611996] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:18:38 juju-e4d256-prod-github-runner-207 kernel: [42892.612717] ? do_syscall_64+0x69/0xc0 Aug 22 17:18:38 juju-e4d256-prod-github-runner-207 kernel: [42892.613369] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:18:38 juju-e4d256-prod-github-runner-207 kernel: [42892.614082] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:18:38 juju-e4d256-prod-github-runner-207 kernel: [42892.614777] ? do_syscall_64+0x69/0xc0 Aug 22 17:18:38 juju-e4d256-prod-github-runner-207 kernel: [42892.615400] ? do_syscall_64+0x69/0xc0 Aug 22 17:18:38 juju-e4d256-prod-github-runner-207 kernel: [42892.616024] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 17:18:38 juju-e4d256-prod-github-runner-207 kernel: [42892.616728] RIP: 0033:0x7faa5d0edaff Aug 22 17:18:38 juju-e4d256-prod-github-runner-207 kernel: [42892.617375] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 17:18:38 juju-e4d256-prod-github-runner-207 kernel: [42892.619372] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 17:18:38 juju-e4d256-prod-github-runner-207 kernel: [42892.620286] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 17:18:38 juju-e4d256-prod-github-runner-207 kernel: [42892.621175] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 17:18:38 juju-e4d256-prod-github-runner-207 kernel: [42892.622082] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 17:18:38 juju-e4d256-prod-github-runner-207 kernel: [42892.622968] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 17:18:38 juju-e4d256-prod-github-runner-207 kernel: [42892.623857] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 17:18:38 juju-e4d256-prod-github-runner-207 kernel: [42892.624746] Aug 22 17:19:06 juju-e4d256-prod-github-runner-207 kernel: [42920.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 39864s! [qemu-system-x86:6715] Aug 22 17:19:06 juju-e4d256-prod-github-runner-207 kernel: [42920.543119] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 17:19:06 juju-e4d256-prod-github-runner-207 kernel: [42920.543192] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 17:19:06 juju-e4d256-prod-github-runner-207 kernel: [42920.555363] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 17:19:06 juju-e4d256-prod-github-runner-207 kernel: [42920.556624] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 17:19:06 juju-e4d256-prod-github-runner-207 kernel: [42920.557928] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:19:06 juju-e4d256-prod-github-runner-207 kernel: [42920.558992] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 17:19:06 juju-e4d256-prod-github-runner-207 kernel: [42920.561558] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 17:19:06 juju-e4d256-prod-github-runner-207 kernel: [42920.562613] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 17:19:06 juju-e4d256-prod-github-runner-207 kernel: [42920.563774] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 17:19:06 juju-e4d256-prod-github-runner-207 kernel: [42920.564932] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 17:19:06 juju-e4d256-prod-github-runner-207 kernel: [42920.566099] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 17:19:06 juju-e4d256-prod-github-runner-207 kernel: [42920.567260] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 17:19:06 juju-e4d256-prod-github-runner-207 kernel: [42920.568428] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 17:19:06 juju-e4d256-prod-github-runner-207 kernel: [42920.569685] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 17:19:06 juju-e4d256-prod-github-runner-207 kernel: [42920.570786] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 17:19:06 juju-e4d256-prod-github-runner-207 kernel: [42920.571976] Call Trace: Aug 22 17:19:06 juju-e4d256-prod-github-runner-207 kernel: [42920.572886] Aug 22 17:19:06 juju-e4d256-prod-github-runner-207 kernel: [42920.573820] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:19:06 juju-e4d256-prod-github-runner-207 kernel: [42920.574858] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:19:06 juju-e4d256-prod-github-runner-207 kernel: [42920.575909] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:19:06 juju-e4d256-prod-github-runner-207 kernel: [42920.576987] ? show_regs.part.0+0x23/0x29 Aug 22 17:19:06 juju-e4d256-prod-github-runner-207 kernel: [42920.578025] ? show_regs.cold+0x8/0xd Aug 22 17:19:06 juju-e4d256-prod-github-runner-207 kernel: [42920.578998] ? watchdog_timer_fn+0x1be/0x220 Aug 22 17:19:06 juju-e4d256-prod-github-runner-207 kernel: [42920.580003] ? lockup_detector_update_enable+0x60/0x60 Aug 22 17:19:06 juju-e4d256-prod-github-runner-207 kernel: [42920.581062] ? __hrtimer_run_queues+0x107/0x230 Aug 22 17:19:06 juju-e4d256-prod-github-runner-207 kernel: [42920.582110] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 17:19:06 juju-e4d256-prod-github-runner-207 kernel: [42920.583132] ? hrtimer_interrupt+0x101/0x220 Aug 22 17:19:06 juju-e4d256-prod-github-runner-207 kernel: [42920.584149] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 17:19:06 juju-e4d256-prod-github-runner-207 kernel: [42920.585222] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 17:19:06 juju-e4d256-prod-github-runner-207 kernel: [42920.586278] Aug 22 17:19:06 juju-e4d256-prod-github-runner-207 kernel: [42920.587129] Aug 22 17:19:06 juju-e4d256-prod-github-runner-207 kernel: [42920.587965] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 17:19:06 juju-e4d256-prod-github-runner-207 kernel: [42920.588994] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:19:06 juju-e4d256-prod-github-runner-207 kernel: [42920.590038] ? _raw_spin_lock+0x22/0x30 Aug 22 17:19:06 juju-e4d256-prod-github-runner-207 kernel: [42920.590982] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:19:06 juju-e4d256-prod-github-runner-207 kernel: [42920.592011] direct_page_fault+0x206/0x310 [kvm] Aug 22 17:19:06 juju-e4d256-prod-github-runner-207 kernel: [42920.593034] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 17:19:06 juju-e4d256-prod-github-runner-207 kernel: [42920.594055] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 17:19:06 juju-e4d256-prod-github-runner-207 kernel: [42920.595054] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 17:19:06 juju-e4d256-prod-github-runner-207 kernel: [42920.596025] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 17:19:06 juju-e4d256-prod-github-runner-207 kernel: [42920.596972] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 17:19:06 juju-e4d256-prod-github-runner-207 kernel: [42920.597954] handle_exit+0x98/0x230 [kvm_amd] Aug 22 17:19:06 juju-e4d256-prod-github-runner-207 kernel: [42920.598849] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 17:19:06 juju-e4d256-prod-github-runner-207 kernel: [42920.599758] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 17:19:06 juju-e4d256-prod-github-runner-207 kernel: [42920.600679] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 17:19:06 juju-e4d256-prod-github-runner-207 kernel: [42920.601583] vcpu_run+0x62/0x2c0 [kvm] Aug 22 17:19:06 juju-e4d256-prod-github-runner-207 kernel: [42920.602391] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 17:19:06 juju-e4d256-prod-github-runner-207 kernel: [42920.603217] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 17:19:06 juju-e4d256-prod-github-runner-207 kernel: [42920.604083] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 17:19:06 juju-e4d256-prod-github-runner-207 kernel: [42920.604879] ? __seccomp_filter+0x4a/0x4a0 Aug 22 17:19:06 juju-e4d256-prod-github-runner-207 kernel: [42920.605675] ? __fget_files+0x86/0xc0 Aug 22 17:19:06 juju-e4d256-prod-github-runner-207 kernel: [42920.606381] __x64_sys_ioctl+0x95/0xd0 Aug 22 17:19:06 juju-e4d256-prod-github-runner-207 kernel: [42920.607096] do_syscall_64+0x5c/0xc0 Aug 22 17:19:06 juju-e4d256-prod-github-runner-207 kernel: [42920.607769] ? do_futex+0x162/0x1f0 Aug 22 17:19:06 juju-e4d256-prod-github-runner-207 kernel: [42920.608417] ? __x64_sys_futex+0x78/0x1e0 Aug 22 17:19:06 juju-e4d256-prod-github-runner-207 kernel: [42920.609094] ? __secure_computing+0xa9/0x120 Aug 22 17:19:06 juju-e4d256-prod-github-runner-207 kernel: [42920.609807] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 17:19:06 juju-e4d256-prod-github-runner-207 kernel: [42920.610567] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:19:06 juju-e4d256-prod-github-runner-207 kernel: [42920.611290] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:19:06 juju-e4d256-prod-github-runner-207 kernel: [42920.612005] ? do_syscall_64+0x69/0xc0 Aug 22 17:19:06 juju-e4d256-prod-github-runner-207 kernel: [42920.612648] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:19:06 juju-e4d256-prod-github-runner-207 kernel: [42920.613349] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:19:06 juju-e4d256-prod-github-runner-207 kernel: [42920.614050] ? do_syscall_64+0x69/0xc0 Aug 22 17:19:06 juju-e4d256-prod-github-runner-207 kernel: [42920.614676] ? do_syscall_64+0x69/0xc0 Aug 22 17:19:06 juju-e4d256-prod-github-runner-207 kernel: [42920.615298] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 17:19:06 juju-e4d256-prod-github-runner-207 kernel: [42920.615998] RIP: 0033:0x7faa5d0edaff Aug 22 17:19:06 juju-e4d256-prod-github-runner-207 kernel: [42920.616639] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 17:19:06 juju-e4d256-prod-github-runner-207 kernel: [42920.618630] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 17:19:06 juju-e4d256-prod-github-runner-207 kernel: [42920.619537] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 17:19:06 juju-e4d256-prod-github-runner-207 kernel: [42920.620422] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 17:19:06 juju-e4d256-prod-github-runner-207 kernel: [42920.621330] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 17:19:06 juju-e4d256-prod-github-runner-207 kernel: [42920.622238] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 17:19:06 juju-e4d256-prod-github-runner-207 kernel: [42920.623126] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 17:19:06 juju-e4d256-prod-github-runner-207 kernel: [42920.624017] Aug 22 17:19:34 juju-e4d256-prod-github-runner-207 kernel: [42948.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 39890s! [qemu-system-x86:6715] Aug 22 17:19:34 juju-e4d256-prod-github-runner-207 kernel: [42948.543100] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 17:19:34 juju-e4d256-prod-github-runner-207 kernel: [42948.543168] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 17:19:34 juju-e4d256-prod-github-runner-207 kernel: [42948.555423] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 17:19:34 juju-e4d256-prod-github-runner-207 kernel: [42948.556746] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 17:19:34 juju-e4d256-prod-github-runner-207 kernel: [42948.557988] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:19:34 juju-e4d256-prod-github-runner-207 kernel: [42948.559042] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 17:19:34 juju-e4d256-prod-github-runner-207 kernel: [42948.561646] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 17:19:34 juju-e4d256-prod-github-runner-207 kernel: [42948.562695] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 17:19:34 juju-e4d256-prod-github-runner-207 kernel: [42948.563853] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 17:19:34 juju-e4d256-prod-github-runner-207 kernel: [42948.565008] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 17:19:34 juju-e4d256-prod-github-runner-207 kernel: [42948.566368] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 17:19:34 juju-e4d256-prod-github-runner-207 kernel: [42948.567536] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 17:19:34 juju-e4d256-prod-github-runner-207 kernel: [42948.568699] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 17:19:34 juju-e4d256-prod-github-runner-207 kernel: [42948.569944] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 17:19:34 juju-e4d256-prod-github-runner-207 kernel: [42948.571040] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 17:19:34 juju-e4d256-prod-github-runner-207 kernel: [42948.572238] Call Trace: Aug 22 17:19:34 juju-e4d256-prod-github-runner-207 kernel: [42948.573167] Aug 22 17:19:34 juju-e4d256-prod-github-runner-207 kernel: [42948.574058] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:19:34 juju-e4d256-prod-github-runner-207 kernel: [42948.575106] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:19:34 juju-e4d256-prod-github-runner-207 kernel: [42948.576139] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:19:34 juju-e4d256-prod-github-runner-207 kernel: [42948.577278] ? show_regs.part.0+0x23/0x29 Aug 22 17:19:34 juju-e4d256-prod-github-runner-207 kernel: [42948.578283] ? show_regs.cold+0x8/0xd Aug 22 17:19:34 juju-e4d256-prod-github-runner-207 kernel: [42948.579257] ? watchdog_timer_fn+0x1be/0x220 Aug 22 17:19:34 juju-e4d256-prod-github-runner-207 kernel: [42948.580262] ? lockup_detector_update_enable+0x60/0x60 Aug 22 17:19:34 juju-e4d256-prod-github-runner-207 kernel: [42948.581401] ? __hrtimer_run_queues+0x107/0x230 Aug 22 17:19:34 juju-e4d256-prod-github-runner-207 kernel: [42948.582637] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 17:19:34 juju-e4d256-prod-github-runner-207 kernel: [42948.583665] ? hrtimer_interrupt+0x101/0x220 Aug 22 17:19:34 juju-e4d256-prod-github-runner-207 kernel: [42948.584745] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 17:19:34 juju-e4d256-prod-github-runner-207 kernel: [42948.585842] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 17:19:34 juju-e4d256-prod-github-runner-207 kernel: [42948.586894] Aug 22 17:19:34 juju-e4d256-prod-github-runner-207 kernel: [42948.587747] Aug 22 17:19:34 juju-e4d256-prod-github-runner-207 kernel: [42948.588589] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 17:19:34 juju-e4d256-prod-github-runner-207 kernel: [42948.589656] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:19:34 juju-e4d256-prod-github-runner-207 kernel: [42948.590708] ? _raw_spin_lock+0x22/0x30 Aug 22 17:19:34 juju-e4d256-prod-github-runner-207 kernel: [42948.591658] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:19:34 juju-e4d256-prod-github-runner-207 kernel: [42948.592681] direct_page_fault+0x206/0x310 [kvm] Aug 22 17:19:34 juju-e4d256-prod-github-runner-207 kernel: [42948.593722] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 17:19:34 juju-e4d256-prod-github-runner-207 kernel: [42948.594735] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 17:19:34 juju-e4d256-prod-github-runner-207 kernel: [42948.595738] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 17:19:34 juju-e4d256-prod-github-runner-207 kernel: [42948.596705] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 17:19:34 juju-e4d256-prod-github-runner-207 kernel: [42948.597664] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 17:19:34 juju-e4d256-prod-github-runner-207 kernel: [42948.598641] handle_exit+0x98/0x230 [kvm_amd] Aug 22 17:19:34 juju-e4d256-prod-github-runner-207 kernel: [42948.599531] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 17:19:34 juju-e4d256-prod-github-runner-207 kernel: [42948.600442] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 17:19:34 juju-e4d256-prod-github-runner-207 kernel: [42948.601439] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 17:19:34 juju-e4d256-prod-github-runner-207 kernel: [42948.602350] vcpu_run+0x62/0x2c0 [kvm] Aug 22 17:19:34 juju-e4d256-prod-github-runner-207 kernel: [42948.603167] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 17:19:34 juju-e4d256-prod-github-runner-207 kernel: [42948.603978] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 17:19:34 juju-e4d256-prod-github-runner-207 kernel: [42948.604831] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 17:19:34 juju-e4d256-prod-github-runner-207 kernel: [42948.605707] ? __seccomp_filter+0x4a/0x4a0 Aug 22 17:19:34 juju-e4d256-prod-github-runner-207 kernel: [42948.606458] ? __fget_files+0x86/0xc0 Aug 22 17:19:34 juju-e4d256-prod-github-runner-207 kernel: [42948.607163] __x64_sys_ioctl+0x95/0xd0 Aug 22 17:19:34 juju-e4d256-prod-github-runner-207 kernel: [42948.607857] do_syscall_64+0x5c/0xc0 Aug 22 17:19:34 juju-e4d256-prod-github-runner-207 kernel: [42948.608523] ? do_futex+0x162/0x1f0 Aug 22 17:19:34 juju-e4d256-prod-github-runner-207 kernel: [42948.609218] ? __x64_sys_futex+0x78/0x1e0 Aug 22 17:19:34 juju-e4d256-prod-github-runner-207 kernel: [42948.609963] ? __secure_computing+0xa9/0x120 Aug 22 17:19:34 juju-e4d256-prod-github-runner-207 kernel: [42948.610654] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 17:19:34 juju-e4d256-prod-github-runner-207 kernel: [42948.611418] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:19:34 juju-e4d256-prod-github-runner-207 kernel: [42948.612140] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:19:34 juju-e4d256-prod-github-runner-207 kernel: [42948.612865] ? do_syscall_64+0x69/0xc0 Aug 22 17:19:34 juju-e4d256-prod-github-runner-207 kernel: [42948.613586] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:19:34 juju-e4d256-prod-github-runner-207 kernel: [42948.614305] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:19:34 juju-e4d256-prod-github-runner-207 kernel: [42948.615005] ? do_syscall_64+0x69/0xc0 Aug 22 17:19:34 juju-e4d256-prod-github-runner-207 kernel: [42948.615630] ? do_syscall_64+0x69/0xc0 Aug 22 17:19:34 juju-e4d256-prod-github-runner-207 kernel: [42948.616257] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 17:19:34 juju-e4d256-prod-github-runner-207 kernel: [42948.616968] RIP: 0033:0x7faa5d0edaff Aug 22 17:19:34 juju-e4d256-prod-github-runner-207 kernel: [42948.617655] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 17:19:34 juju-e4d256-prod-github-runner-207 kernel: [42948.619656] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 17:19:34 juju-e4d256-prod-github-runner-207 kernel: [42948.620571] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 17:19:34 juju-e4d256-prod-github-runner-207 kernel: [42948.621549] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 17:19:34 juju-e4d256-prod-github-runner-207 kernel: [42948.622450] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 17:19:34 juju-e4d256-prod-github-runner-207 kernel: [42948.623346] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 17:19:34 juju-e4d256-prod-github-runner-207 kernel: [42948.624236] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 17:19:34 juju-e4d256-prod-github-runner-207 kernel: [42948.625128] Aug 22 17:20:02 juju-e4d256-prod-github-runner-207 kernel: [42976.541980] watchdog: BUG: soft lockup - CPU#1 stuck for 39917s! [qemu-system-x86:6715] Aug 22 17:20:02 juju-e4d256-prod-github-runner-207 kernel: [42976.543125] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 17:20:02 juju-e4d256-prod-github-runner-207 kernel: [42976.543190] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 17:20:02 juju-e4d256-prod-github-runner-207 kernel: [42976.555364] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 17:20:02 juju-e4d256-prod-github-runner-207 kernel: [42976.556684] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 17:20:02 juju-e4d256-prod-github-runner-207 kernel: [42976.557926] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:20:02 juju-e4d256-prod-github-runner-207 kernel: [42976.558994] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 17:20:02 juju-e4d256-prod-github-runner-207 kernel: [42976.561586] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 17:20:02 juju-e4d256-prod-github-runner-207 kernel: [42976.562769] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 17:20:02 juju-e4d256-prod-github-runner-207 kernel: [42976.564165] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 17:20:02 juju-e4d256-prod-github-runner-207 kernel: [42976.565364] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 17:20:02 juju-e4d256-prod-github-runner-207 kernel: [42976.566552] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 17:20:02 juju-e4d256-prod-github-runner-207 kernel: [42976.567966] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 17:20:02 juju-e4d256-prod-github-runner-207 kernel: [42976.569769] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 17:20:02 juju-e4d256-prod-github-runner-207 kernel: [42976.571042] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 17:20:02 juju-e4d256-prod-github-runner-207 kernel: [42976.572187] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 17:20:02 juju-e4d256-prod-github-runner-207 kernel: [42976.573432] Call Trace: Aug 22 17:20:02 juju-e4d256-prod-github-runner-207 kernel: [42976.574373] Aug 22 17:20:02 juju-e4d256-prod-github-runner-207 kernel: [42976.575271] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:20:02 juju-e4d256-prod-github-runner-207 kernel: [42976.576319] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:20:02 juju-e4d256-prod-github-runner-207 kernel: [42976.577436] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:20:02 juju-e4d256-prod-github-runner-207 kernel: [42976.578554] ? show_regs.part.0+0x23/0x29 Aug 22 17:20:02 juju-e4d256-prod-github-runner-207 kernel: [42976.579568] ? show_regs.cold+0x8/0xd Aug 22 17:20:02 juju-e4d256-prod-github-runner-207 kernel: [42976.580561] ? watchdog_timer_fn+0x1be/0x220 Aug 22 17:20:02 juju-e4d256-prod-github-runner-207 kernel: [42976.581609] ? lockup_detector_update_enable+0x60/0x60 Aug 22 17:20:02 juju-e4d256-prod-github-runner-207 kernel: [42976.582708] ? __hrtimer_run_queues+0x107/0x230 Aug 22 17:20:02 juju-e4d256-prod-github-runner-207 kernel: [42976.583827] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 17:20:02 juju-e4d256-prod-github-runner-207 kernel: [42976.584907] ? hrtimer_interrupt+0x101/0x220 Aug 22 17:20:02 juju-e4d256-prod-github-runner-207 kernel: [42976.586025] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 17:20:02 juju-e4d256-prod-github-runner-207 kernel: [42976.587162] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 17:20:02 juju-e4d256-prod-github-runner-207 kernel: [42976.588247] Aug 22 17:20:02 juju-e4d256-prod-github-runner-207 kernel: [42976.589170] Aug 22 17:20:02 juju-e4d256-prod-github-runner-207 kernel: [42976.590035] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 17:20:02 juju-e4d256-prod-github-runner-207 kernel: [42976.591084] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:20:02 juju-e4d256-prod-github-runner-207 kernel: [42976.592133] ? _raw_spin_lock+0x22/0x30 Aug 22 17:20:02 juju-e4d256-prod-github-runner-207 kernel: [42976.593245] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:20:02 juju-e4d256-prod-github-runner-207 kernel: [42976.594449] direct_page_fault+0x206/0x310 [kvm] Aug 22 17:20:02 juju-e4d256-prod-github-runner-207 kernel: [42976.595679] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 17:20:02 juju-e4d256-prod-github-runner-207 kernel: [42976.596722] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 17:20:02 juju-e4d256-prod-github-runner-207 kernel: [42976.597808] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 17:20:02 juju-e4d256-prod-github-runner-207 kernel: [42976.599074] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 17:20:02 juju-e4d256-prod-github-runner-207 kernel: [42976.600446] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 17:20:02 juju-e4d256-prod-github-runner-207 kernel: [42976.601471] handle_exit+0x98/0x230 [kvm_amd] Aug 22 17:20:02 juju-e4d256-prod-github-runner-207 kernel: [42976.602388] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 17:20:02 juju-e4d256-prod-github-runner-207 kernel: [42976.603436] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 17:20:02 juju-e4d256-prod-github-runner-207 kernel: [42976.604471] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 17:20:02 juju-e4d256-prod-github-runner-207 kernel: [42976.605414] vcpu_run+0x62/0x2c0 [kvm] Aug 22 17:20:02 juju-e4d256-prod-github-runner-207 kernel: [42976.606249] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 17:20:02 juju-e4d256-prod-github-runner-207 kernel: [42976.607124] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 17:20:02 juju-e4d256-prod-github-runner-207 kernel: [42976.608261] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 17:20:02 juju-e4d256-prod-github-runner-207 kernel: [42976.609110] ? __seccomp_filter+0x4a/0x4a0 Aug 22 17:20:02 juju-e4d256-prod-github-runner-207 kernel: [42976.609883] ? __fget_files+0x86/0xc0 Aug 22 17:20:02 juju-e4d256-prod-github-runner-207 kernel: [42976.610608] __x64_sys_ioctl+0x95/0xd0 Aug 22 17:20:02 juju-e4d256-prod-github-runner-207 kernel: [42976.611373] do_syscall_64+0x5c/0xc0 Aug 22 17:20:02 juju-e4d256-prod-github-runner-207 kernel: [42976.612129] ? do_futex+0x162/0x1f0 Aug 22 17:20:02 juju-e4d256-prod-github-runner-207 kernel: [42976.613116] ? __x64_sys_futex+0x78/0x1e0 Aug 22 17:20:02 juju-e4d256-prod-github-runner-207 kernel: [42976.614152] ? __secure_computing+0xa9/0x120 Aug 22 17:20:02 juju-e4d256-prod-github-runner-207 kernel: [42976.615148] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 17:20:02 juju-e4d256-prod-github-runner-207 kernel: [42976.616238] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:20:02 juju-e4d256-prod-github-runner-207 kernel: [42976.617284] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:20:02 juju-e4d256-prod-github-runner-207 kernel: [42976.618298] ? do_syscall_64+0x69/0xc0 Aug 22 17:20:02 juju-e4d256-prod-github-runner-207 kernel: [42976.619257] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:20:02 juju-e4d256-prod-github-runner-207 kernel: [42976.620210] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:20:02 juju-e4d256-prod-github-runner-207 kernel: [42976.621317] ? do_syscall_64+0x69/0xc0 Aug 22 17:20:02 juju-e4d256-prod-github-runner-207 kernel: [42976.622235] ? do_syscall_64+0x69/0xc0 Aug 22 17:20:02 juju-e4d256-prod-github-runner-207 kernel: [42976.623128] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 17:20:02 juju-e4d256-prod-github-runner-207 kernel: [42976.624141] RIP: 0033:0x7faa5d0edaff Aug 22 17:20:02 juju-e4d256-prod-github-runner-207 kernel: [42976.625062] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 17:20:02 juju-e4d256-prod-github-runner-207 kernel: [42976.627801] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 17:20:02 juju-e4d256-prod-github-runner-207 kernel: [42976.629124] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 17:20:02 juju-e4d256-prod-github-runner-207 kernel: [42976.630389] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 17:20:02 juju-e4d256-prod-github-runner-207 kernel: [42976.631588] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 17:20:02 juju-e4d256-prod-github-runner-207 kernel: [42976.632683] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 17:20:02 juju-e4d256-prod-github-runner-207 kernel: [42976.633969] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 17:20:02 juju-e4d256-prod-github-runner-207 kernel: [42976.635251] Aug 22 17:20:30 juju-e4d256-prod-github-runner-207 kernel: [43004.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 39943s! [qemu-system-x86:6715] Aug 22 17:20:30 juju-e4d256-prod-github-runner-207 kernel: [43004.543814] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 17:20:30 juju-e4d256-prod-github-runner-207 kernel: [43004.544074] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 17:20:30 juju-e4d256-prod-github-runner-207 kernel: [43004.556367] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 17:20:30 juju-e4d256-prod-github-runner-207 kernel: [43004.557643] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 17:20:30 juju-e4d256-prod-github-runner-207 kernel: [43004.558866] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:20:30 juju-e4d256-prod-github-runner-207 kernel: [43004.559929] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 17:20:30 juju-e4d256-prod-github-runner-207 kernel: [43004.562534] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 17:20:30 juju-e4d256-prod-github-runner-207 kernel: [43004.563582] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 17:20:30 juju-e4d256-prod-github-runner-207 kernel: [43004.564756] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 17:20:30 juju-e4d256-prod-github-runner-207 kernel: [43004.565935] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 17:20:30 juju-e4d256-prod-github-runner-207 kernel: [43004.567109] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 17:20:30 juju-e4d256-prod-github-runner-207 kernel: [43004.568270] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 17:20:30 juju-e4d256-prod-github-runner-207 kernel: [43004.569461] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 17:20:30 juju-e4d256-prod-github-runner-207 kernel: [43004.570692] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 17:20:30 juju-e4d256-prod-github-runner-207 kernel: [43004.571936] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 17:20:30 juju-e4d256-prod-github-runner-207 kernel: [43004.573322] Call Trace: Aug 22 17:20:30 juju-e4d256-prod-github-runner-207 kernel: [43004.574238] Aug 22 17:20:30 juju-e4d256-prod-github-runner-207 kernel: [43004.575137] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:20:30 juju-e4d256-prod-github-runner-207 kernel: [43004.576170] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:20:30 juju-e4d256-prod-github-runner-207 kernel: [43004.577210] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:20:30 juju-e4d256-prod-github-runner-207 kernel: [43004.578309] ? show_regs.part.0+0x23/0x29 Aug 22 17:20:30 juju-e4d256-prod-github-runner-207 kernel: [43004.579307] ? show_regs.cold+0x8/0xd Aug 22 17:20:30 juju-e4d256-prod-github-runner-207 kernel: [43004.580280] ? watchdog_timer_fn+0x1be/0x220 Aug 22 17:20:30 juju-e4d256-prod-github-runner-207 kernel: [43004.581303] ? lockup_detector_update_enable+0x60/0x60 Aug 22 17:20:30 juju-e4d256-prod-github-runner-207 kernel: [43004.582367] ? __hrtimer_run_queues+0x107/0x230 Aug 22 17:20:30 juju-e4d256-prod-github-runner-207 kernel: [43004.583394] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 17:20:30 juju-e4d256-prod-github-runner-207 kernel: [43004.584418] ? hrtimer_interrupt+0x101/0x220 Aug 22 17:20:30 juju-e4d256-prod-github-runner-207 kernel: [43004.585447] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 17:20:30 juju-e4d256-prod-github-runner-207 kernel: [43004.586515] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 17:20:30 juju-e4d256-prod-github-runner-207 kernel: [43004.587560] Aug 22 17:20:30 juju-e4d256-prod-github-runner-207 kernel: [43004.588419] Aug 22 17:20:30 juju-e4d256-prod-github-runner-207 kernel: [43004.589272] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 17:20:30 juju-e4d256-prod-github-runner-207 kernel: [43004.590306] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:20:30 juju-e4d256-prod-github-runner-207 kernel: [43004.591348] ? _raw_spin_lock+0x22/0x30 Aug 22 17:20:30 juju-e4d256-prod-github-runner-207 kernel: [43004.592293] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:20:30 juju-e4d256-prod-github-runner-207 kernel: [43004.593318] direct_page_fault+0x206/0x310 [kvm] Aug 22 17:20:30 juju-e4d256-prod-github-runner-207 kernel: [43004.594341] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 17:20:30 juju-e4d256-prod-github-runner-207 kernel: [43004.595350] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 17:20:30 juju-e4d256-prod-github-runner-207 kernel: [43004.596350] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 17:20:30 juju-e4d256-prod-github-runner-207 kernel: [43004.597369] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 17:20:30 juju-e4d256-prod-github-runner-207 kernel: [43004.598312] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 17:20:30 juju-e4d256-prod-github-runner-207 kernel: [43004.599288] handle_exit+0x98/0x230 [kvm_amd] Aug 22 17:20:30 juju-e4d256-prod-github-runner-207 kernel: [43004.600179] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 17:20:30 juju-e4d256-prod-github-runner-207 kernel: [43004.601120] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 17:20:30 juju-e4d256-prod-github-runner-207 kernel: [43004.602044] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 17:20:30 juju-e4d256-prod-github-runner-207 kernel: [43004.602946] vcpu_run+0x62/0x2c0 [kvm] Aug 22 17:20:30 juju-e4d256-prod-github-runner-207 kernel: [43004.603761] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 17:20:30 juju-e4d256-prod-github-runner-207 kernel: [43004.604583] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 17:20:30 juju-e4d256-prod-github-runner-207 kernel: [43004.605442] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 17:20:30 juju-e4d256-prod-github-runner-207 kernel: [43004.606239] ? __seccomp_filter+0x4a/0x4a0 Aug 22 17:20:30 juju-e4d256-prod-github-runner-207 kernel: [43004.606989] ? __fget_files+0x86/0xc0 Aug 22 17:20:30 juju-e4d256-prod-github-runner-207 kernel: [43004.607698] __x64_sys_ioctl+0x95/0xd0 Aug 22 17:20:30 juju-e4d256-prod-github-runner-207 kernel: [43004.608391] do_syscall_64+0x5c/0xc0 Aug 22 17:20:30 juju-e4d256-prod-github-runner-207 kernel: [43004.609068] ? do_futex+0x162/0x1f0 Aug 22 17:20:30 juju-e4d256-prod-github-runner-207 kernel: [43004.609720] ? __x64_sys_futex+0x78/0x1e0 Aug 22 17:20:30 juju-e4d256-prod-github-runner-207 kernel: [43004.610399] ? __secure_computing+0xa9/0x120 Aug 22 17:20:30 juju-e4d256-prod-github-runner-207 kernel: [43004.611090] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 17:20:30 juju-e4d256-prod-github-runner-207 kernel: [43004.611850] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:20:30 juju-e4d256-prod-github-runner-207 kernel: [43004.612584] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:20:30 juju-e4d256-prod-github-runner-207 kernel: [43004.613307] ? do_syscall_64+0x69/0xc0 Aug 22 17:20:30 juju-e4d256-prod-github-runner-207 kernel: [43004.613953] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:20:30 juju-e4d256-prod-github-runner-207 kernel: [43004.614657] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:20:30 juju-e4d256-prod-github-runner-207 kernel: [43004.615353] ? do_syscall_64+0x69/0xc0 Aug 22 17:20:30 juju-e4d256-prod-github-runner-207 kernel: [43004.615981] ? do_syscall_64+0x69/0xc0 Aug 22 17:20:30 juju-e4d256-prod-github-runner-207 kernel: [43004.616614] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 17:20:30 juju-e4d256-prod-github-runner-207 kernel: [43004.617324] RIP: 0033:0x7faa5d0edaff Aug 22 17:20:30 juju-e4d256-prod-github-runner-207 kernel: [43004.617987] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 17:20:30 juju-e4d256-prod-github-runner-207 kernel: [43004.619984] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 17:20:30 juju-e4d256-prod-github-runner-207 kernel: [43004.620914] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 17:20:30 juju-e4d256-prod-github-runner-207 kernel: [43004.621806] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 17:20:30 juju-e4d256-prod-github-runner-207 kernel: [43004.622695] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 17:20:30 juju-e4d256-prod-github-runner-207 kernel: [43004.623588] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 17:20:30 juju-e4d256-prod-github-runner-207 kernel: [43004.624497] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 17:20:30 juju-e4d256-prod-github-runner-207 kernel: [43004.625394] Aug 22 17:20:46 juju-e4d256-prod-github-runner-207 kernel: [43020.056706] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 17:20:46 juju-e4d256-prod-github-runner-207 kernel: [43020.057677] rcu: 1-....: (10692102 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=5174119 Aug 22 17:20:46 juju-e4d256-prod-github-runner-207 kernel: [43020.058798] (t=10725714 jiffies g=23269 q=43017) Aug 22 17:20:46 juju-e4d256-prod-github-runner-207 kernel: [43020.059583] NMI backtrace for cpu 1 Aug 22 17:20:46 juju-e4d256-prod-github-runner-207 kernel: [43020.060312] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 17:20:46 juju-e4d256-prod-github-runner-207 kernel: [43020.061416] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 17:20:46 juju-e4d256-prod-github-runner-207 kernel: [43020.062477] Call Trace: Aug 22 17:20:46 juju-e4d256-prod-github-runner-207 kernel: [43020.063159] Aug 22 17:20:46 juju-e4d256-prod-github-runner-207 kernel: [43020.063843] show_stack+0x52/0x5c Aug 22 17:20:46 juju-e4d256-prod-github-runner-207 kernel: [43020.064581] dump_stack_lvl+0x4a/0x63 Aug 22 17:20:46 juju-e4d256-prod-github-runner-207 kernel: [43020.065327] dump_stack+0x10/0x16 Aug 22 17:20:46 juju-e4d256-prod-github-runner-207 kernel: [43020.066043] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 17:20:46 juju-e4d256-prod-github-runner-207 kernel: [43020.066822] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 17:20:46 juju-e4d256-prod-github-runner-207 kernel: [43020.067602] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 17:20:46 juju-e4d256-prod-github-runner-207 kernel: [43020.068435] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 17:20:46 juju-e4d256-prod-github-runner-207 kernel: [43020.069254] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 17:20:46 juju-e4d256-prod-github-runner-207 kernel: [43020.070065] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 17:20:46 juju-e4d256-prod-github-runner-207 kernel: [43020.070843] print_cpu_stall.cold+0x2f/0xe2 Aug 22 17:20:46 juju-e4d256-prod-github-runner-207 kernel: [43020.071642] ? timekeeping_update+0xf7/0x150 Aug 22 17:20:46 juju-e4d256-prod-github-runner-207 kernel: [43020.072422] check_cpu_stall+0x109/0x270 Aug 22 17:20:46 juju-e4d256-prod-github-runner-207 kernel: [43020.073182] rcu_sched_clock_irq+0x9a/0x250 Aug 22 17:20:46 juju-e4d256-prod-github-runner-207 kernel: [43020.073944] update_process_times+0x94/0xd0 Aug 22 17:20:46 juju-e4d256-prod-github-runner-207 kernel: [43020.074708] tick_sched_handle+0x29/0x70 Aug 22 17:20:46 juju-e4d256-prod-github-runner-207 kernel: [43020.075454] tick_sched_timer+0x8c/0xc0 Aug 22 17:20:46 juju-e4d256-prod-github-runner-207 kernel: [43020.076225] ? tick_nohz_handler+0xb0/0xb0 Aug 22 17:20:46 juju-e4d256-prod-github-runner-207 kernel: [43020.076997] __hrtimer_run_queues+0x107/0x230 Aug 22 17:20:46 juju-e4d256-prod-github-runner-207 kernel: [43020.077774] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 17:20:46 juju-e4d256-prod-github-runner-207 kernel: [43020.078546] hrtimer_interrupt+0x101/0x220 Aug 22 17:20:46 juju-e4d256-prod-github-runner-207 kernel: [43020.079302] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 17:20:46 juju-e4d256-prod-github-runner-207 kernel: [43020.080153] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 17:20:46 juju-e4d256-prod-github-runner-207 kernel: [43020.080967] Aug 22 17:20:46 juju-e4d256-prod-github-runner-207 kernel: [43020.081617] Aug 22 17:20:46 juju-e4d256-prod-github-runner-207 kernel: [43020.082247] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 17:20:46 juju-e4d256-prod-github-runner-207 kernel: [43020.083103] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:20:46 juju-e4d256-prod-github-runner-207 kernel: [43020.083982] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 17:20:46 juju-e4d256-prod-github-runner-207 kernel: [43020.086207] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 17:20:46 juju-e4d256-prod-github-runner-207 kernel: [43020.087077] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 17:20:46 juju-e4d256-prod-github-runner-207 kernel: [43020.088068] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 17:20:46 juju-e4d256-prod-github-runner-207 kernel: [43020.089052] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 17:20:46 juju-e4d256-prod-github-runner-207 kernel: [43020.090011] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 17:20:46 juju-e4d256-prod-github-runner-207 kernel: [43020.090963] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 17:20:46 juju-e4d256-prod-github-runner-207 kernel: [43020.091917] ? _raw_spin_lock+0x22/0x30 Aug 22 17:20:46 juju-e4d256-prod-github-runner-207 kernel: [43020.092687] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:20:46 juju-e4d256-prod-github-runner-207 kernel: [43020.093522] direct_page_fault+0x206/0x310 [kvm] Aug 22 17:20:46 juju-e4d256-prod-github-runner-207 kernel: [43020.094360] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 17:20:46 juju-e4d256-prod-github-runner-207 kernel: [43020.095184] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 17:20:46 juju-e4d256-prod-github-runner-207 kernel: [43020.096010] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 17:20:46 juju-e4d256-prod-github-runner-207 kernel: [43020.096826] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 17:20:46 juju-e4d256-prod-github-runner-207 kernel: [43020.097613] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 17:20:46 juju-e4d256-prod-github-runner-207 kernel: [43020.098432] handle_exit+0x98/0x230 [kvm_amd] Aug 22 17:20:46 juju-e4d256-prod-github-runner-207 kernel: [43020.099183] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 17:20:46 juju-e4d256-prod-github-runner-207 kernel: [43020.099962] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 17:20:46 juju-e4d256-prod-github-runner-207 kernel: [43020.100773] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 17:20:46 juju-e4d256-prod-github-runner-207 kernel: [43020.101555] vcpu_run+0x62/0x2c0 [kvm] Aug 22 17:20:46 juju-e4d256-prod-github-runner-207 kernel: [43020.102267] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 17:20:46 juju-e4d256-prod-github-runner-207 kernel: [43020.102997] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 17:20:46 juju-e4d256-prod-github-runner-207 kernel: [43020.103794] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 17:20:46 juju-e4d256-prod-github-runner-207 kernel: [43020.104570] ? __seccomp_filter+0x4a/0x4a0 Aug 22 17:20:46 juju-e4d256-prod-github-runner-207 kernel: [43020.105289] ? __fget_files+0x86/0xc0 Aug 22 17:20:46 juju-e4d256-prod-github-runner-207 kernel: [43020.105979] __x64_sys_ioctl+0x95/0xd0 Aug 22 17:20:46 juju-e4d256-prod-github-runner-207 kernel: [43020.106676] do_syscall_64+0x5c/0xc0 Aug 22 17:20:46 juju-e4d256-prod-github-runner-207 kernel: [43020.107353] ? do_futex+0x162/0x1f0 Aug 22 17:20:46 juju-e4d256-prod-github-runner-207 kernel: [43020.108033] ? __x64_sys_futex+0x78/0x1e0 Aug 22 17:20:46 juju-e4d256-prod-github-runner-207 kernel: [43020.108744] ? __secure_computing+0xa9/0x120 Aug 22 17:20:46 juju-e4d256-prod-github-runner-207 kernel: [43020.109456] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 17:20:46 juju-e4d256-prod-github-runner-207 kernel: [43020.110241] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:20:46 juju-e4d256-prod-github-runner-207 kernel: [43020.110991] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:20:46 juju-e4d256-prod-github-runner-207 kernel: [43020.111751] ? do_syscall_64+0x69/0xc0 Aug 22 17:20:46 juju-e4d256-prod-github-runner-207 kernel: [43020.112459] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:20:46 juju-e4d256-prod-github-runner-207 kernel: [43020.113218] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:20:46 juju-e4d256-prod-github-runner-207 kernel: [43020.113972] ? do_syscall_64+0x69/0xc0 Aug 22 17:20:46 juju-e4d256-prod-github-runner-207 kernel: [43020.114665] ? do_syscall_64+0x69/0xc0 Aug 22 17:20:46 juju-e4d256-prod-github-runner-207 kernel: [43020.115349] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 17:20:46 juju-e4d256-prod-github-runner-207 kernel: [43020.116116] RIP: 0033:0x7faa5d0edaff Aug 22 17:20:46 juju-e4d256-prod-github-runner-207 kernel: [43020.116822] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 17:20:46 juju-e4d256-prod-github-runner-207 kernel: [43020.118912] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 17:20:46 juju-e4d256-prod-github-runner-207 kernel: [43020.119870] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 17:20:46 juju-e4d256-prod-github-runner-207 kernel: [43020.120828] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 17:20:46 juju-e4d256-prod-github-runner-207 kernel: [43020.121776] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 17:20:46 juju-e4d256-prod-github-runner-207 kernel: [43020.122718] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 17:20:46 juju-e4d256-prod-github-runner-207 kernel: [43020.123642] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 17:20:46 juju-e4d256-prod-github-runner-207 kernel: [43020.124566] Aug 22 17:21:10 juju-e4d256-prod-github-runner-207 kernel: [43044.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 39980s! [qemu-system-x86:6715] Aug 22 17:21:10 juju-e4d256-prod-github-runner-207 kernel: [43044.543121] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 17:21:10 juju-e4d256-prod-github-runner-207 kernel: [43044.543191] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 17:21:10 juju-e4d256-prod-github-runner-207 kernel: [43044.555402] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 17:21:10 juju-e4d256-prod-github-runner-207 kernel: [43044.556665] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 17:21:10 juju-e4d256-prod-github-runner-207 kernel: [43044.557884] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:21:10 juju-e4d256-prod-github-runner-207 kernel: [43044.558938] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 17:21:10 juju-e4d256-prod-github-runner-207 kernel: [43044.561484] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 17:21:10 juju-e4d256-prod-github-runner-207 kernel: [43044.562523] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 17:21:10 juju-e4d256-prod-github-runner-207 kernel: [43044.563687] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 17:21:10 juju-e4d256-prod-github-runner-207 kernel: [43044.564888] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 17:21:10 juju-e4d256-prod-github-runner-207 kernel: [43044.566044] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 17:21:10 juju-e4d256-prod-github-runner-207 kernel: [43044.567204] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 17:21:10 juju-e4d256-prod-github-runner-207 kernel: [43044.568394] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 17:21:10 juju-e4d256-prod-github-runner-207 kernel: [43044.569631] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 17:21:10 juju-e4d256-prod-github-runner-207 kernel: [43044.570724] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 17:21:10 juju-e4d256-prod-github-runner-207 kernel: [43044.572307] Call Trace: Aug 22 17:21:10 juju-e4d256-prod-github-runner-207 kernel: [43044.573283] Aug 22 17:21:10 juju-e4d256-prod-github-runner-207 kernel: [43044.574218] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:21:10 juju-e4d256-prod-github-runner-207 kernel: [43044.575344] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:21:10 juju-e4d256-prod-github-runner-207 kernel: [43044.576464] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:21:10 juju-e4d256-prod-github-runner-207 kernel: [43044.577634] ? show_regs.part.0+0x23/0x29 Aug 22 17:21:10 juju-e4d256-prod-github-runner-207 kernel: [43044.578725] ? show_regs.cold+0x8/0xd Aug 22 17:21:10 juju-e4d256-prod-github-runner-207 kernel: [43044.579770] ? watchdog_timer_fn+0x1be/0x220 Aug 22 17:21:10 juju-e4d256-prod-github-runner-207 kernel: [43044.580870] ? lockup_detector_update_enable+0x60/0x60 Aug 22 17:21:10 juju-e4d256-prod-github-runner-207 kernel: [43044.582037] ? __hrtimer_run_queues+0x107/0x230 Aug 22 17:21:10 juju-e4d256-prod-github-runner-207 kernel: [43044.583148] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 17:21:10 juju-e4d256-prod-github-runner-207 kernel: [43044.584272] ? hrtimer_interrupt+0x101/0x220 Aug 22 17:21:10 juju-e4d256-prod-github-runner-207 kernel: [43044.585367] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 17:21:10 juju-e4d256-prod-github-runner-207 kernel: [43044.586528] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 17:21:10 juju-e4d256-prod-github-runner-207 kernel: [43044.587666] Aug 22 17:21:10 juju-e4d256-prod-github-runner-207 kernel: [43044.588579] Aug 22 17:21:10 juju-e4d256-prod-github-runner-207 kernel: [43044.589462] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 17:21:10 juju-e4d256-prod-github-runner-207 kernel: [43044.590602] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:21:10 juju-e4d256-prod-github-runner-207 kernel: [43044.591753] ? _raw_spin_lock+0x22/0x30 Aug 22 17:21:10 juju-e4d256-prod-github-runner-207 kernel: [43044.592798] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:21:10 juju-e4d256-prod-github-runner-207 kernel: [43044.593906] direct_page_fault+0x206/0x310 [kvm] Aug 22 17:21:10 juju-e4d256-prod-github-runner-207 kernel: [43044.595026] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 17:21:10 juju-e4d256-prod-github-runner-207 kernel: [43044.596136] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 17:21:10 juju-e4d256-prod-github-runner-207 kernel: [43044.597231] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 17:21:10 juju-e4d256-prod-github-runner-207 kernel: [43044.598288] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 17:21:10 juju-e4d256-prod-github-runner-207 kernel: [43044.599325] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 17:21:10 juju-e4d256-prod-github-runner-207 kernel: [43044.600419] handle_exit+0x98/0x230 [kvm_amd] Aug 22 17:21:10 juju-e4d256-prod-github-runner-207 kernel: [43044.601402] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 17:21:10 juju-e4d256-prod-github-runner-207 kernel: [43044.602399] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 17:21:10 juju-e4d256-prod-github-runner-207 kernel: [43044.603421] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 17:21:10 juju-e4d256-prod-github-runner-207 kernel: [43044.604427] vcpu_run+0x62/0x2c0 [kvm] Aug 22 17:21:10 juju-e4d256-prod-github-runner-207 kernel: [43044.605314] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 17:21:10 juju-e4d256-prod-github-runner-207 kernel: [43044.606210] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 17:21:10 juju-e4d256-prod-github-runner-207 kernel: [43044.607163] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 17:21:10 juju-e4d256-prod-github-runner-207 kernel: [43044.608058] ? __seccomp_filter+0x4a/0x4a0 Aug 22 17:21:10 juju-e4d256-prod-github-runner-207 kernel: [43044.608886] ? __fget_files+0x86/0xc0 Aug 22 17:21:10 juju-e4d256-prod-github-runner-207 kernel: [43044.609661] __x64_sys_ioctl+0x95/0xd0 Aug 22 17:21:10 juju-e4d256-prod-github-runner-207 kernel: [43044.610431] do_syscall_64+0x5c/0xc0 Aug 22 17:21:10 juju-e4d256-prod-github-runner-207 kernel: [43044.611164] ? do_futex+0x162/0x1f0 Aug 22 17:21:10 juju-e4d256-prod-github-runner-207 kernel: [43044.611881] ? __x64_sys_futex+0x78/0x1e0 Aug 22 17:21:10 juju-e4d256-prod-github-runner-207 kernel: [43044.612639] ? __secure_computing+0xa9/0x120 Aug 22 17:21:10 juju-e4d256-prod-github-runner-207 kernel: [43044.613418] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 17:21:10 juju-e4d256-prod-github-runner-207 kernel: [43044.614275] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:21:10 juju-e4d256-prod-github-runner-207 kernel: [43044.615101] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:21:10 juju-e4d256-prod-github-runner-207 kernel: [43044.615909] ? do_syscall_64+0x69/0xc0 Aug 22 17:21:10 juju-e4d256-prod-github-runner-207 kernel: [43044.616640] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:21:10 juju-e4d256-prod-github-runner-207 kernel: [43044.617433] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:21:10 juju-e4d256-prod-github-runner-207 kernel: [43044.618216] ? do_syscall_64+0x69/0xc0 Aug 22 17:21:10 juju-e4d256-prod-github-runner-207 kernel: [43044.618913] ? do_syscall_64+0x69/0xc0 Aug 22 17:21:10 juju-e4d256-prod-github-runner-207 kernel: [43044.619607] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 17:21:10 juju-e4d256-prod-github-runner-207 kernel: [43044.620417] RIP: 0033:0x7faa5d0edaff Aug 22 17:21:10 juju-e4d256-prod-github-runner-207 kernel: [43044.621111] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 17:21:10 juju-e4d256-prod-github-runner-207 kernel: [43044.623420] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 17:21:10 juju-e4d256-prod-github-runner-207 kernel: [43044.624476] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 17:21:10 juju-e4d256-prod-github-runner-207 kernel: [43044.625500] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 17:21:10 juju-e4d256-prod-github-runner-207 kernel: [43044.626518] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 17:21:10 juju-e4d256-prod-github-runner-207 kernel: [43044.627534] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 17:21:10 juju-e4d256-prod-github-runner-207 kernel: [43044.628567] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 17:21:10 juju-e4d256-prod-github-runner-207 kernel: [43044.629591] Aug 22 17:21:38 juju-e4d256-prod-github-runner-207 kernel: [43072.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 40006s! [qemu-system-x86:6715] Aug 22 17:21:38 juju-e4d256-prod-github-runner-207 kernel: [43072.543188] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 17:21:38 juju-e4d256-prod-github-runner-207 kernel: [43072.543362] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 17:21:38 juju-e4d256-prod-github-runner-207 kernel: [43072.555407] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 17:21:38 juju-e4d256-prod-github-runner-207 kernel: [43072.556684] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 17:21:38 juju-e4d256-prod-github-runner-207 kernel: [43072.557908] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:21:38 juju-e4d256-prod-github-runner-207 kernel: [43072.558964] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 17:21:38 juju-e4d256-prod-github-runner-207 kernel: [43072.561532] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 17:21:38 juju-e4d256-prod-github-runner-207 kernel: [43072.562572] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 17:21:38 juju-e4d256-prod-github-runner-207 kernel: [43072.563741] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 17:21:38 juju-e4d256-prod-github-runner-207 kernel: [43072.564901] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 17:21:38 juju-e4d256-prod-github-runner-207 kernel: [43072.566065] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 17:21:38 juju-e4d256-prod-github-runner-207 kernel: [43072.567224] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 17:21:38 juju-e4d256-prod-github-runner-207 kernel: [43072.568394] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 17:21:38 juju-e4d256-prod-github-runner-207 kernel: [43072.569626] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 17:21:38 juju-e4d256-prod-github-runner-207 kernel: [43072.570731] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 17:21:38 juju-e4d256-prod-github-runner-207 kernel: [43072.571933] Call Trace: Aug 22 17:21:38 juju-e4d256-prod-github-runner-207 kernel: [43072.572932] Aug 22 17:21:38 juju-e4d256-prod-github-runner-207 kernel: [43072.573969] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:21:38 juju-e4d256-prod-github-runner-207 kernel: [43072.574996] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:21:38 juju-e4d256-prod-github-runner-207 kernel: [43072.576031] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:21:38 juju-e4d256-prod-github-runner-207 kernel: [43072.577125] ? show_regs.part.0+0x23/0x29 Aug 22 17:21:38 juju-e4d256-prod-github-runner-207 kernel: [43072.578119] ? show_regs.cold+0x8/0xd Aug 22 17:21:38 juju-e4d256-prod-github-runner-207 kernel: [43072.579087] ? watchdog_timer_fn+0x1be/0x220 Aug 22 17:21:38 juju-e4d256-prod-github-runner-207 kernel: [43072.580104] ? lockup_detector_update_enable+0x60/0x60 Aug 22 17:21:38 juju-e4d256-prod-github-runner-207 kernel: [43072.581168] ? __hrtimer_run_queues+0x107/0x230 Aug 22 17:21:38 juju-e4d256-prod-github-runner-207 kernel: [43072.582200] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 17:21:38 juju-e4d256-prod-github-runner-207 kernel: [43072.583222] ? hrtimer_interrupt+0x101/0x220 Aug 22 17:21:38 juju-e4d256-prod-github-runner-207 kernel: [43072.584245] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 17:21:38 juju-e4d256-prod-github-runner-207 kernel: [43072.585316] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 17:21:38 juju-e4d256-prod-github-runner-207 kernel: [43072.586364] Aug 22 17:21:38 juju-e4d256-prod-github-runner-207 kernel: [43072.587225] Aug 22 17:21:38 juju-e4d256-prod-github-runner-207 kernel: [43072.588078] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 17:21:38 juju-e4d256-prod-github-runner-207 kernel: [43072.589108] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:21:38 juju-e4d256-prod-github-runner-207 kernel: [43072.590145] ? _raw_spin_lock+0x22/0x30 Aug 22 17:21:38 juju-e4d256-prod-github-runner-207 kernel: [43072.591087] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:21:38 juju-e4d256-prod-github-runner-207 kernel: [43072.592112] direct_page_fault+0x206/0x310 [kvm] Aug 22 17:21:38 juju-e4d256-prod-github-runner-207 kernel: [43072.593134] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 17:21:38 juju-e4d256-prod-github-runner-207 kernel: [43072.594140] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 17:21:38 juju-e4d256-prod-github-runner-207 kernel: [43072.595138] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 17:21:38 juju-e4d256-prod-github-runner-207 kernel: [43072.596135] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 17:21:38 juju-e4d256-prod-github-runner-207 kernel: [43072.597080] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 17:21:38 juju-e4d256-prod-github-runner-207 kernel: [43072.598057] handle_exit+0x98/0x230 [kvm_amd] Aug 22 17:21:38 juju-e4d256-prod-github-runner-207 kernel: [43072.598947] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 17:21:38 juju-e4d256-prod-github-runner-207 kernel: [43072.599867] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 17:21:38 juju-e4d256-prod-github-runner-207 kernel: [43072.600790] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 17:21:38 juju-e4d256-prod-github-runner-207 kernel: [43072.601700] vcpu_run+0x62/0x2c0 [kvm] Aug 22 17:21:38 juju-e4d256-prod-github-runner-207 kernel: [43072.602510] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 17:21:38 juju-e4d256-prod-github-runner-207 kernel: [43072.603315] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 17:21:38 juju-e4d256-prod-github-runner-207 kernel: [43072.604183] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 17:21:38 juju-e4d256-prod-github-runner-207 kernel: [43072.604976] ? __seccomp_filter+0x4a/0x4a0 Aug 22 17:21:38 juju-e4d256-prod-github-runner-207 kernel: [43072.605717] ? __fget_files+0x86/0xc0 Aug 22 17:21:38 juju-e4d256-prod-github-runner-207 kernel: [43072.606417] __x64_sys_ioctl+0x95/0xd0 Aug 22 17:21:38 juju-e4d256-prod-github-runner-207 kernel: [43072.607112] do_syscall_64+0x5c/0xc0 Aug 22 17:21:38 juju-e4d256-prod-github-runner-207 kernel: [43072.607788] ? do_futex+0x162/0x1f0 Aug 22 17:21:38 juju-e4d256-prod-github-runner-207 kernel: [43072.608435] ? __x64_sys_futex+0x78/0x1e0 Aug 22 17:21:38 juju-e4d256-prod-github-runner-207 kernel: [43072.609106] ? __secure_computing+0xa9/0x120 Aug 22 17:21:38 juju-e4d256-prod-github-runner-207 kernel: [43072.609794] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 17:21:38 juju-e4d256-prod-github-runner-207 kernel: [43072.610552] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:21:38 juju-e4d256-prod-github-runner-207 kernel: [43072.611272] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:21:38 juju-e4d256-prod-github-runner-207 kernel: [43072.612000] ? do_syscall_64+0x69/0xc0 Aug 22 17:21:38 juju-e4d256-prod-github-runner-207 kernel: [43072.612650] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:21:38 juju-e4d256-prod-github-runner-207 kernel: [43072.613357] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:21:38 juju-e4d256-prod-github-runner-207 kernel: [43072.614050] ? do_syscall_64+0x69/0xc0 Aug 22 17:21:38 juju-e4d256-prod-github-runner-207 kernel: [43072.614672] ? do_syscall_64+0x69/0xc0 Aug 22 17:21:38 juju-e4d256-prod-github-runner-207 kernel: [43072.615292] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 17:21:38 juju-e4d256-prod-github-runner-207 kernel: [43072.616003] RIP: 0033:0x7faa5d0edaff Aug 22 17:21:38 juju-e4d256-prod-github-runner-207 kernel: [43072.616637] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 17:21:38 juju-e4d256-prod-github-runner-207 kernel: [43072.618619] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 17:21:38 juju-e4d256-prod-github-runner-207 kernel: [43072.619526] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 17:21:38 juju-e4d256-prod-github-runner-207 kernel: [43072.620420] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 17:21:38 juju-e4d256-prod-github-runner-207 kernel: [43072.621312] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 17:21:38 juju-e4d256-prod-github-runner-207 kernel: [43072.622206] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 17:21:38 juju-e4d256-prod-github-runner-207 kernel: [43072.623099] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 17:21:38 juju-e4d256-prod-github-runner-207 kernel: [43072.623998] Aug 22 17:22:06 juju-e4d256-prod-github-runner-207 kernel: [43100.541981] watchdog: BUG: soft lockup - CPU#1 stuck for 40032s! [qemu-system-x86:6715] Aug 22 17:22:06 juju-e4d256-prod-github-runner-207 kernel: [43100.544590] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 17:22:06 juju-e4d256-prod-github-runner-207 kernel: [43100.544840] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 17:22:06 juju-e4d256-prod-github-runner-207 kernel: [43100.560950] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 17:22:06 juju-e4d256-prod-github-runner-207 kernel: [43100.562216] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 17:22:06 juju-e4d256-prod-github-runner-207 kernel: [43100.563462] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:22:06 juju-e4d256-prod-github-runner-207 kernel: [43100.564519] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 17:22:06 juju-e4d256-prod-github-runner-207 kernel: [43100.567068] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 17:22:06 juju-e4d256-prod-github-runner-207 kernel: [43100.568135] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 17:22:06 juju-e4d256-prod-github-runner-207 kernel: [43100.569303] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 17:22:06 juju-e4d256-prod-github-runner-207 kernel: [43100.570465] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 17:22:06 juju-e4d256-prod-github-runner-207 kernel: [43100.571662] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 17:22:06 juju-e4d256-prod-github-runner-207 kernel: [43100.572972] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 17:22:06 juju-e4d256-prod-github-runner-207 kernel: [43100.574172] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 17:22:06 juju-e4d256-prod-github-runner-207 kernel: [43100.575435] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 17:22:06 juju-e4d256-prod-github-runner-207 kernel: [43100.576555] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 17:22:06 juju-e4d256-prod-github-runner-207 kernel: [43100.577992] Call Trace: Aug 22 17:22:06 juju-e4d256-prod-github-runner-207 kernel: [43100.579389] Aug 22 17:22:06 juju-e4d256-prod-github-runner-207 kernel: [43100.580823] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:22:06 juju-e4d256-prod-github-runner-207 kernel: [43100.582477] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:22:06 juju-e4d256-prod-github-runner-207 kernel: [43100.584083] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:22:06 juju-e4d256-prod-github-runner-207 kernel: [43100.585801] ? show_regs.part.0+0x23/0x29 Aug 22 17:22:06 juju-e4d256-prod-github-runner-207 kernel: [43100.587473] ? show_regs.cold+0x8/0xd Aug 22 17:22:06 juju-e4d256-prod-github-runner-207 kernel: [43100.589060] ? watchdog_timer_fn+0x1be/0x220 Aug 22 17:22:06 juju-e4d256-prod-github-runner-207 kernel: [43100.590732] ? lockup_detector_update_enable+0x60/0x60 Aug 22 17:22:06 juju-e4d256-prod-github-runner-207 kernel: [43100.592460] ? __hrtimer_run_queues+0x107/0x230 Aug 22 17:22:06 juju-e4d256-prod-github-runner-207 kernel: [43100.594290] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 17:22:06 juju-e4d256-prod-github-runner-207 kernel: [43100.595960] ? hrtimer_interrupt+0x101/0x220 Aug 22 17:22:06 juju-e4d256-prod-github-runner-207 kernel: [43100.597543] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 17:22:06 juju-e4d256-prod-github-runner-207 kernel: [43100.599119] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 17:22:06 juju-e4d256-prod-github-runner-207 kernel: [43100.600237] Aug 22 17:22:06 juju-e4d256-prod-github-runner-207 kernel: [43100.601098] Aug 22 17:22:06 juju-e4d256-prod-github-runner-207 kernel: [43100.601941] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 17:22:06 juju-e4d256-prod-github-runner-207 kernel: [43100.602987] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:22:06 juju-e4d256-prod-github-runner-207 kernel: [43100.604058] ? _raw_spin_lock+0x22/0x30 Aug 22 17:22:06 juju-e4d256-prod-github-runner-207 kernel: [43100.605011] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:22:06 juju-e4d256-prod-github-runner-207 kernel: [43100.606046] direct_page_fault+0x206/0x310 [kvm] Aug 22 17:22:06 juju-e4d256-prod-github-runner-207 kernel: [43100.607077] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 17:22:06 juju-e4d256-prod-github-runner-207 kernel: [43100.608112] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 17:22:06 juju-e4d256-prod-github-runner-207 kernel: [43100.609117] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 17:22:06 juju-e4d256-prod-github-runner-207 kernel: [43100.610122] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 17:22:06 juju-e4d256-prod-github-runner-207 kernel: [43100.611073] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 17:22:06 juju-e4d256-prod-github-runner-207 kernel: [43100.612085] handle_exit+0x98/0x230 [kvm_amd] Aug 22 17:22:06 juju-e4d256-prod-github-runner-207 kernel: [43100.612988] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 17:22:06 juju-e4d256-prod-github-runner-207 kernel: [43100.613907] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 17:22:06 juju-e4d256-prod-github-runner-207 kernel: [43100.614834] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 17:22:06 juju-e4d256-prod-github-runner-207 kernel: [43100.615768] vcpu_run+0x62/0x2c0 [kvm] Aug 22 17:22:06 juju-e4d256-prod-github-runner-207 kernel: [43100.616586] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 17:22:06 juju-e4d256-prod-github-runner-207 kernel: [43100.617424] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 17:22:06 juju-e4d256-prod-github-runner-207 kernel: [43100.618285] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 17:22:06 juju-e4d256-prod-github-runner-207 kernel: [43100.619088] ? __seccomp_filter+0x4a/0x4a0 Aug 22 17:22:06 juju-e4d256-prod-github-runner-207 kernel: [43100.619860] ? __fget_files+0x86/0xc0 Aug 22 17:22:06 juju-e4d256-prod-github-runner-207 kernel: [43100.620583] __x64_sys_ioctl+0x95/0xd0 Aug 22 17:22:06 juju-e4d256-prod-github-runner-207 kernel: [43100.621284] do_syscall_64+0x5c/0xc0 Aug 22 17:22:06 juju-e4d256-prod-github-runner-207 kernel: [43100.621971] ? do_futex+0x162/0x1f0 Aug 22 17:22:06 juju-e4d256-prod-github-runner-207 kernel: [43100.622630] ? __x64_sys_futex+0x78/0x1e0 Aug 22 17:22:06 juju-e4d256-prod-github-runner-207 kernel: [43100.623326] ? __secure_computing+0xa9/0x120 Aug 22 17:22:06 juju-e4d256-prod-github-runner-207 kernel: [43100.624022] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 17:22:06 juju-e4d256-prod-github-runner-207 kernel: [43100.624793] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:22:06 juju-e4d256-prod-github-runner-207 kernel: [43100.625523] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:22:06 juju-e4d256-prod-github-runner-207 kernel: [43100.626244] ? do_syscall_64+0x69/0xc0 Aug 22 17:22:06 juju-e4d256-prod-github-runner-207 kernel: [43100.626899] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:22:06 juju-e4d256-prod-github-runner-207 kernel: [43100.627626] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:22:06 juju-e4d256-prod-github-runner-207 kernel: [43100.628334] ? do_syscall_64+0x69/0xc0 Aug 22 17:22:06 juju-e4d256-prod-github-runner-207 kernel: [43100.628963] ? do_syscall_64+0x69/0xc0 Aug 22 17:22:06 juju-e4d256-prod-github-runner-207 kernel: [43100.629589] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 17:22:06 juju-e4d256-prod-github-runner-207 kernel: [43100.630300] RIP: 0033:0x7faa5d0edaff Aug 22 17:22:06 juju-e4d256-prod-github-runner-207 kernel: [43100.630963] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 17:22:06 juju-e4d256-prod-github-runner-207 kernel: [43100.632987] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 17:22:06 juju-e4d256-prod-github-runner-207 kernel: [43100.633904] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 17:22:06 juju-e4d256-prod-github-runner-207 kernel: [43100.634804] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 17:22:06 juju-e4d256-prod-github-runner-207 kernel: [43100.635731] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 17:22:06 juju-e4d256-prod-github-runner-207 kernel: [43100.636624] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 17:22:06 juju-e4d256-prod-github-runner-207 kernel: [43100.637528] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 17:22:06 juju-e4d256-prod-github-runner-207 kernel: [43100.638427] Aug 22 17:22:34 juju-e4d256-prod-github-runner-207 kernel: [43128.541976] watchdog: BUG: soft lockup - CPU#1 stuck for 40058s! [qemu-system-x86:6715] Aug 22 17:22:34 juju-e4d256-prod-github-runner-207 kernel: [43128.543087] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 17:22:34 juju-e4d256-prod-github-runner-207 kernel: [43128.543153] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 17:22:34 juju-e4d256-prod-github-runner-207 kernel: [43128.555123] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 17:22:34 juju-e4d256-prod-github-runner-207 kernel: [43128.556386] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 17:22:34 juju-e4d256-prod-github-runner-207 kernel: [43128.557597] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:22:34 juju-e4d256-prod-github-runner-207 kernel: [43128.558655] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 17:22:34 juju-e4d256-prod-github-runner-207 kernel: [43128.561613] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 17:22:34 juju-e4d256-prod-github-runner-207 kernel: [43128.562708] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 17:22:34 juju-e4d256-prod-github-runner-207 kernel: [43128.563926] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 17:22:34 juju-e4d256-prod-github-runner-207 kernel: [43128.565116] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 17:22:34 juju-e4d256-prod-github-runner-207 kernel: [43128.566301] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 17:22:34 juju-e4d256-prod-github-runner-207 kernel: [43128.567512] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 17:22:34 juju-e4d256-prod-github-runner-207 kernel: [43128.568700] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 17:22:34 juju-e4d256-prod-github-runner-207 kernel: [43128.569953] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 17:22:34 juju-e4d256-prod-github-runner-207 kernel: [43128.571075] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 17:22:34 juju-e4d256-prod-github-runner-207 kernel: [43128.572280] Call Trace: Aug 22 17:22:34 juju-e4d256-prod-github-runner-207 kernel: [43128.573237] Aug 22 17:22:34 juju-e4d256-prod-github-runner-207 kernel: [43128.574172] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:22:34 juju-e4d256-prod-github-runner-207 kernel: [43128.575223] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:22:34 juju-e4d256-prod-github-runner-207 kernel: [43128.576261] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:22:34 juju-e4d256-prod-github-runner-207 kernel: [43128.577368] ? show_regs.part.0+0x23/0x29 Aug 22 17:22:34 juju-e4d256-prod-github-runner-207 kernel: [43128.578374] ? show_regs.cold+0x8/0xd Aug 22 17:22:34 juju-e4d256-prod-github-runner-207 kernel: [43128.579368] ? watchdog_timer_fn+0x1be/0x220 Aug 22 17:22:34 juju-e4d256-prod-github-runner-207 kernel: [43128.580387] ? lockup_detector_update_enable+0x60/0x60 Aug 22 17:22:34 juju-e4d256-prod-github-runner-207 kernel: [43128.581461] ? __hrtimer_run_queues+0x107/0x230 Aug 22 17:22:34 juju-e4d256-prod-github-runner-207 kernel: [43128.582503] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 17:22:34 juju-e4d256-prod-github-runner-207 kernel: [43128.583547] ? hrtimer_interrupt+0x101/0x220 Aug 22 17:22:34 juju-e4d256-prod-github-runner-207 kernel: [43128.584572] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 17:22:34 juju-e4d256-prod-github-runner-207 kernel: [43128.585651] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 17:22:34 juju-e4d256-prod-github-runner-207 kernel: [43128.586694] Aug 22 17:22:34 juju-e4d256-prod-github-runner-207 kernel: [43128.587555] Aug 22 17:22:34 juju-e4d256-prod-github-runner-207 kernel: [43128.588411] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 17:22:34 juju-e4d256-prod-github-runner-207 kernel: [43128.589442] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:22:34 juju-e4d256-prod-github-runner-207 kernel: [43128.590485] ? _raw_spin_lock+0x22/0x30 Aug 22 17:22:34 juju-e4d256-prod-github-runner-207 kernel: [43128.591451] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:22:34 juju-e4d256-prod-github-runner-207 kernel: [43128.592470] direct_page_fault+0x206/0x310 [kvm] Aug 22 17:22:34 juju-e4d256-prod-github-runner-207 kernel: [43128.593496] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 17:22:34 juju-e4d256-prod-github-runner-207 kernel: [43128.594500] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 17:22:34 juju-e4d256-prod-github-runner-207 kernel: [43128.595511] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 17:22:34 juju-e4d256-prod-github-runner-207 kernel: [43128.596488] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 17:22:34 juju-e4d256-prod-github-runner-207 kernel: [43128.597431] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 17:22:34 juju-e4d256-prod-github-runner-207 kernel: [43128.598406] handle_exit+0x98/0x230 [kvm_amd] Aug 22 17:22:34 juju-e4d256-prod-github-runner-207 kernel: [43128.599311] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 17:22:34 juju-e4d256-prod-github-runner-207 kernel: [43128.600222] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 17:22:34 juju-e4d256-prod-github-runner-207 kernel: [43128.601150] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 17:22:34 juju-e4d256-prod-github-runner-207 kernel: [43128.602050] vcpu_run+0x62/0x2c0 [kvm] Aug 22 17:22:34 juju-e4d256-prod-github-runner-207 kernel: [43128.602857] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 17:22:34 juju-e4d256-prod-github-runner-207 kernel: [43128.603686] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 17:22:34 juju-e4d256-prod-github-runner-207 kernel: [43128.604536] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 17:22:34 juju-e4d256-prod-github-runner-207 kernel: [43128.605335] ? __seccomp_filter+0x4a/0x4a0 Aug 22 17:22:34 juju-e4d256-prod-github-runner-207 kernel: [43128.606074] ? __fget_files+0x86/0xc0 Aug 22 17:22:34 juju-e4d256-prod-github-runner-207 kernel: [43128.606779] __x64_sys_ioctl+0x95/0xd0 Aug 22 17:22:34 juju-e4d256-prod-github-runner-207 kernel: [43128.607479] do_syscall_64+0x5c/0xc0 Aug 22 17:22:34 juju-e4d256-prod-github-runner-207 kernel: [43128.608147] ? do_futex+0x162/0x1f0 Aug 22 17:22:34 juju-e4d256-prod-github-runner-207 kernel: [43128.608792] ? __x64_sys_futex+0x78/0x1e0 Aug 22 17:22:34 juju-e4d256-prod-github-runner-207 kernel: [43128.609461] ? __secure_computing+0xa9/0x120 Aug 22 17:22:34 juju-e4d256-prod-github-runner-207 kernel: [43128.610155] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 17:22:34 juju-e4d256-prod-github-runner-207 kernel: [43128.610918] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:22:34 juju-e4d256-prod-github-runner-207 kernel: [43128.611649] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:22:34 juju-e4d256-prod-github-runner-207 kernel: [43128.612363] ? do_syscall_64+0x69/0xc0 Aug 22 17:22:34 juju-e4d256-prod-github-runner-207 kernel: [43128.613005] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:22:34 juju-e4d256-prod-github-runner-207 kernel: [43128.613711] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:22:34 juju-e4d256-prod-github-runner-207 kernel: [43128.614402] ? do_syscall_64+0x69/0xc0 Aug 22 17:22:34 juju-e4d256-prod-github-runner-207 kernel: [43128.615047] ? do_syscall_64+0x69/0xc0 Aug 22 17:22:34 juju-e4d256-prod-github-runner-207 kernel: [43128.615667] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 17:22:34 juju-e4d256-prod-github-runner-207 kernel: [43128.616369] RIP: 0033:0x7faa5d0edaff Aug 22 17:22:34 juju-e4d256-prod-github-runner-207 kernel: [43128.616999] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 17:22:34 juju-e4d256-prod-github-runner-207 kernel: [43128.618983] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 17:22:34 juju-e4d256-prod-github-runner-207 kernel: [43128.619888] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 17:22:34 juju-e4d256-prod-github-runner-207 kernel: [43128.620775] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 17:22:34 juju-e4d256-prod-github-runner-207 kernel: [43128.621658] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 17:22:34 juju-e4d256-prod-github-runner-207 kernel: [43128.622542] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 17:22:34 juju-e4d256-prod-github-runner-207 kernel: [43128.623441] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 17:22:34 juju-e4d256-prod-github-runner-207 kernel: [43128.624325] Aug 22 17:23:02 juju-e4d256-prod-github-runner-207 kernel: [43156.541981] watchdog: BUG: soft lockup - CPU#1 stuck for 40084s! [qemu-system-x86:6715] Aug 22 17:23:02 juju-e4d256-prod-github-runner-207 kernel: [43156.543283] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 17:23:02 juju-e4d256-prod-github-runner-207 kernel: [43156.543352] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 17:23:02 juju-e4d256-prod-github-runner-207 kernel: [43156.557253] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 17:23:02 juju-e4d256-prod-github-runner-207 kernel: [43156.558728] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 17:23:02 juju-e4d256-prod-github-runner-207 kernel: [43156.560113] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:23:02 juju-e4d256-prod-github-runner-207 kernel: [43156.561286] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 17:23:02 juju-e4d256-prod-github-runner-207 kernel: [43156.564179] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 17:23:02 juju-e4d256-prod-github-runner-207 kernel: [43156.565321] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 17:23:02 juju-e4d256-prod-github-runner-207 kernel: [43156.566633] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 17:23:02 juju-e4d256-prod-github-runner-207 kernel: [43156.567933] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 17:23:02 juju-e4d256-prod-github-runner-207 kernel: [43156.569220] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 17:23:02 juju-e4d256-prod-github-runner-207 kernel: [43156.570525] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 17:23:02 juju-e4d256-prod-github-runner-207 kernel: [43156.571852] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 17:23:02 juju-e4d256-prod-github-runner-207 kernel: [43156.573239] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 17:23:02 juju-e4d256-prod-github-runner-207 kernel: [43156.574452] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 17:23:02 juju-e4d256-prod-github-runner-207 kernel: [43156.575810] Call Trace: Aug 22 17:23:02 juju-e4d256-prod-github-runner-207 kernel: [43156.576797] Aug 22 17:23:02 juju-e4d256-prod-github-runner-207 kernel: [43156.577723] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:23:02 juju-e4d256-prod-github-runner-207 kernel: [43156.578858] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:23:02 juju-e4d256-prod-github-runner-207 kernel: [43156.579971] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:23:02 juju-e4d256-prod-github-runner-207 kernel: [43156.581145] ? show_regs.part.0+0x23/0x29 Aug 22 17:23:02 juju-e4d256-prod-github-runner-207 kernel: [43156.582224] ? show_regs.cold+0x8/0xd Aug 22 17:23:02 juju-e4d256-prod-github-runner-207 kernel: [43156.583305] ? watchdog_timer_fn+0x1be/0x220 Aug 22 17:23:02 juju-e4d256-prod-github-runner-207 kernel: [43156.584408] ? lockup_detector_update_enable+0x60/0x60 Aug 22 17:23:02 juju-e4d256-prod-github-runner-207 kernel: [43156.585579] ? __hrtimer_run_queues+0x107/0x230 Aug 22 17:23:02 juju-e4d256-prod-github-runner-207 kernel: [43156.586729] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 17:23:02 juju-e4d256-prod-github-runner-207 kernel: [43156.587859] ? hrtimer_interrupt+0x101/0x220 Aug 22 17:23:02 juju-e4d256-prod-github-runner-207 kernel: [43156.588983] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 17:23:02 juju-e4d256-prod-github-runner-207 kernel: [43156.590171] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 17:23:02 juju-e4d256-prod-github-runner-207 kernel: [43156.591355] Aug 22 17:23:02 juju-e4d256-prod-github-runner-207 kernel: [43156.592280] Aug 22 17:23:02 juju-e4d256-prod-github-runner-207 kernel: [43156.593190] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 17:23:02 juju-e4d256-prod-github-runner-207 kernel: [43156.594355] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:23:02 juju-e4d256-prod-github-runner-207 kernel: [43156.595533] ? _raw_spin_lock+0x22/0x30 Aug 22 17:23:02 juju-e4d256-prod-github-runner-207 kernel: [43156.596575] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:23:02 juju-e4d256-prod-github-runner-207 kernel: [43156.597733] direct_page_fault+0x206/0x310 [kvm] Aug 22 17:23:02 juju-e4d256-prod-github-runner-207 kernel: [43156.598922] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 17:23:02 juju-e4d256-prod-github-runner-207 kernel: [43156.600040] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 17:23:02 juju-e4d256-prod-github-runner-207 kernel: [43156.601153] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 17:23:02 juju-e4d256-prod-github-runner-207 kernel: [43156.602292] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 17:23:02 juju-e4d256-prod-github-runner-207 kernel: [43156.603405] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 17:23:02 juju-e4d256-prod-github-runner-207 kernel: [43156.604498] handle_exit+0x98/0x230 [kvm_amd] Aug 22 17:23:02 juju-e4d256-prod-github-runner-207 kernel: [43156.605492] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 17:23:02 juju-e4d256-prod-github-runner-207 kernel: [43156.606524] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 17:23:02 juju-e4d256-prod-github-runner-207 kernel: [43156.607587] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 17:23:02 juju-e4d256-prod-github-runner-207 kernel: [43156.608697] vcpu_run+0x62/0x2c0 [kvm] Aug 22 17:23:02 juju-e4d256-prod-github-runner-207 kernel: [43156.609515] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 17:23:02 juju-e4d256-prod-github-runner-207 kernel: [43156.610326] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 17:23:02 juju-e4d256-prod-github-runner-207 kernel: [43156.611213] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 17:23:02 juju-e4d256-prod-github-runner-207 kernel: [43156.612025] ? __seccomp_filter+0x4a/0x4a0 Aug 22 17:23:02 juju-e4d256-prod-github-runner-207 kernel: [43156.612780] ? __fget_files+0x86/0xc0 Aug 22 17:23:02 juju-e4d256-prod-github-runner-207 kernel: [43156.613486] __x64_sys_ioctl+0x95/0xd0 Aug 22 17:23:02 juju-e4d256-prod-github-runner-207 kernel: [43156.614186] do_syscall_64+0x5c/0xc0 Aug 22 17:23:02 juju-e4d256-prod-github-runner-207 kernel: [43156.614874] ? do_futex+0x162/0x1f0 Aug 22 17:23:02 juju-e4d256-prod-github-runner-207 kernel: [43156.615526] ? __x64_sys_futex+0x78/0x1e0 Aug 22 17:23:02 juju-e4d256-prod-github-runner-207 kernel: [43156.616311] ? __secure_computing+0xa9/0x120 Aug 22 17:23:02 juju-e4d256-prod-github-runner-207 kernel: [43156.617001] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 17:23:02 juju-e4d256-prod-github-runner-207 kernel: [43156.617763] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:23:02 juju-e4d256-prod-github-runner-207 kernel: [43156.618525] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:23:02 juju-e4d256-prod-github-runner-207 kernel: [43156.619271] ? do_syscall_64+0x69/0xc0 Aug 22 17:23:02 juju-e4d256-prod-github-runner-207 kernel: [43156.619920] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:23:02 juju-e4d256-prod-github-runner-207 kernel: [43156.620626] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:23:02 juju-e4d256-prod-github-runner-207 kernel: [43156.621331] ? do_syscall_64+0x69/0xc0 Aug 22 17:23:02 juju-e4d256-prod-github-runner-207 kernel: [43156.621964] ? do_syscall_64+0x69/0xc0 Aug 22 17:23:02 juju-e4d256-prod-github-runner-207 kernel: [43156.622589] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 17:23:02 juju-e4d256-prod-github-runner-207 kernel: [43156.623372] RIP: 0033:0x7faa5d0edaff Aug 22 17:23:02 juju-e4d256-prod-github-runner-207 kernel: [43156.624017] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 17:23:02 juju-e4d256-prod-github-runner-207 kernel: [43156.626004] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 17:23:02 juju-e4d256-prod-github-runner-207 kernel: [43156.626940] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 17:23:02 juju-e4d256-prod-github-runner-207 kernel: [43156.627837] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 17:23:02 juju-e4d256-prod-github-runner-207 kernel: [43156.628757] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 17:23:02 juju-e4d256-prod-github-runner-207 kernel: [43156.629654] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 17:23:02 juju-e4d256-prod-github-runner-207 kernel: [43156.630557] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 17:23:02 juju-e4d256-prod-github-runner-207 kernel: [43156.631479] Aug 22 17:23:30 juju-e4d256-prod-github-runner-207 kernel: [43184.541980] watchdog: BUG: soft lockup - CPU#1 stuck for 40110s! [qemu-system-x86:6715] Aug 22 17:23:30 juju-e4d256-prod-github-runner-207 kernel: [43184.543954] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 17:23:30 juju-e4d256-prod-github-runner-207 kernel: [43184.544230] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 17:23:30 juju-e4d256-prod-github-runner-207 kernel: [43184.559823] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 17:23:30 juju-e4d256-prod-github-runner-207 kernel: [43184.561252] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 17:23:30 juju-e4d256-prod-github-runner-207 kernel: [43184.562694] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:23:30 juju-e4d256-prod-github-runner-207 kernel: [43184.563887] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 17:23:30 juju-e4d256-prod-github-runner-207 kernel: [43184.566748] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 17:23:30 juju-e4d256-prod-github-runner-207 kernel: [43184.567954] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 17:23:30 juju-e4d256-prod-github-runner-207 kernel: [43184.569257] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 17:23:30 juju-e4d256-prod-github-runner-207 kernel: [43184.570568] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 17:23:30 juju-e4d256-prod-github-runner-207 kernel: [43184.571820] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 17:23:30 juju-e4d256-prod-github-runner-207 kernel: [43184.573122] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 17:23:30 juju-e4d256-prod-github-runner-207 kernel: [43184.574504] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 17:23:30 juju-e4d256-prod-github-runner-207 kernel: [43184.575919] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 17:23:30 juju-e4d256-prod-github-runner-207 kernel: [43184.577175] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 17:23:30 juju-e4d256-prod-github-runner-207 kernel: [43184.578570] Call Trace: Aug 22 17:23:30 juju-e4d256-prod-github-runner-207 kernel: [43184.579617] Aug 22 17:23:30 juju-e4d256-prod-github-runner-207 kernel: [43184.580638] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:23:30 juju-e4d256-prod-github-runner-207 kernel: [43184.581815] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:23:30 juju-e4d256-prod-github-runner-207 kernel: [43184.583030] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:23:30 juju-e4d256-prod-github-runner-207 kernel: [43184.584287] ? show_regs.part.0+0x23/0x29 Aug 22 17:23:30 juju-e4d256-prod-github-runner-207 kernel: [43184.585433] ? show_regs.cold+0x8/0xd Aug 22 17:23:30 juju-e4d256-prod-github-runner-207 kernel: [43184.586556] ? watchdog_timer_fn+0x1be/0x220 Aug 22 17:23:30 juju-e4d256-prod-github-runner-207 kernel: [43184.587698] ? lockup_detector_update_enable+0x60/0x60 Aug 22 17:23:30 juju-e4d256-prod-github-runner-207 kernel: [43184.588918] ? __hrtimer_run_queues+0x107/0x230 Aug 22 17:23:30 juju-e4d256-prod-github-runner-207 kernel: [43184.590096] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 17:23:30 juju-e4d256-prod-github-runner-207 kernel: [43184.591199] ? hrtimer_interrupt+0x101/0x220 Aug 22 17:23:30 juju-e4d256-prod-github-runner-207 kernel: [43184.592335] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 17:23:30 juju-e4d256-prod-github-runner-207 kernel: [43184.593572] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 17:23:30 juju-e4d256-prod-github-runner-207 kernel: [43184.594807] Aug 22 17:23:30 juju-e4d256-prod-github-runner-207 kernel: [43184.595801] Aug 22 17:23:30 juju-e4d256-prod-github-runner-207 kernel: [43184.596788] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 17:23:30 juju-e4d256-prod-github-runner-207 kernel: [43184.597975] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:23:30 juju-e4d256-prod-github-runner-207 kernel: [43184.599181] ? _raw_spin_lock+0x22/0x30 Aug 22 17:23:30 juju-e4d256-prod-github-runner-207 kernel: [43184.600396] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:23:30 juju-e4d256-prod-github-runner-207 kernel: [43184.601585] direct_page_fault+0x206/0x310 [kvm] Aug 22 17:23:30 juju-e4d256-prod-github-runner-207 kernel: [43184.602856] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 17:23:30 juju-e4d256-prod-github-runner-207 kernel: [43184.604016] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 17:23:30 juju-e4d256-prod-github-runner-207 kernel: [43184.605183] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 17:23:30 juju-e4d256-prod-github-runner-207 kernel: [43184.606325] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 17:23:30 juju-e4d256-prod-github-runner-207 kernel: [43184.607429] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 17:23:30 juju-e4d256-prod-github-runner-207 kernel: [43184.608581] handle_exit+0x98/0x230 [kvm_amd] Aug 22 17:23:30 juju-e4d256-prod-github-runner-207 kernel: [43184.609629] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 17:23:30 juju-e4d256-prod-github-runner-207 kernel: [43184.610735] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 17:23:30 juju-e4d256-prod-github-runner-207 kernel: [43184.611783] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 17:23:30 juju-e4d256-prod-github-runner-207 kernel: [43184.612774] vcpu_run+0x62/0x2c0 [kvm] Aug 22 17:23:30 juju-e4d256-prod-github-runner-207 kernel: [43184.613710] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 17:23:30 juju-e4d256-prod-github-runner-207 kernel: [43184.614644] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 17:23:30 juju-e4d256-prod-github-runner-207 kernel: [43184.615576] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 17:23:30 juju-e4d256-prod-github-runner-207 kernel: [43184.616447] ? __seccomp_filter+0x4a/0x4a0 Aug 22 17:23:30 juju-e4d256-prod-github-runner-207 kernel: [43184.617209] ? __fget_files+0x86/0xc0 Aug 22 17:23:30 juju-e4d256-prod-github-runner-207 kernel: [43184.617915] __x64_sys_ioctl+0x95/0xd0 Aug 22 17:23:30 juju-e4d256-prod-github-runner-207 kernel: [43184.618638] do_syscall_64+0x5c/0xc0 Aug 22 17:23:30 juju-e4d256-prod-github-runner-207 kernel: [43184.619392] ? do_futex+0x162/0x1f0 Aug 22 17:23:30 juju-e4d256-prod-github-runner-207 kernel: [43184.620114] ? __x64_sys_futex+0x78/0x1e0 Aug 22 17:23:30 juju-e4d256-prod-github-runner-207 kernel: [43184.620866] ? __secure_computing+0xa9/0x120 Aug 22 17:23:30 juju-e4d256-prod-github-runner-207 kernel: [43184.621642] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 17:23:30 juju-e4d256-prod-github-runner-207 kernel: [43184.622524] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:23:30 juju-e4d256-prod-github-runner-207 kernel: [43184.623337] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:23:30 juju-e4d256-prod-github-runner-207 kernel: [43184.624144] ? do_syscall_64+0x69/0xc0 Aug 22 17:23:30 juju-e4d256-prod-github-runner-207 kernel: [43184.624864] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:23:30 juju-e4d256-prod-github-runner-207 kernel: [43184.625662] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:23:30 juju-e4d256-prod-github-runner-207 kernel: [43184.626476] ? do_syscall_64+0x69/0xc0 Aug 22 17:23:30 juju-e4d256-prod-github-runner-207 kernel: [43184.627189] ? do_syscall_64+0x69/0xc0 Aug 22 17:23:30 juju-e4d256-prod-github-runner-207 kernel: [43184.627899] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 17:23:30 juju-e4d256-prod-github-runner-207 kernel: [43184.628718] RIP: 0033:0x7faa5d0edaff Aug 22 17:23:30 juju-e4d256-prod-github-runner-207 kernel: [43184.629438] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 17:23:30 juju-e4d256-prod-github-runner-207 kernel: [43184.631761] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 17:23:30 juju-e4d256-prod-github-runner-207 kernel: [43184.632805] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 17:23:30 juju-e4d256-prod-github-runner-207 kernel: [43184.633823] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 17:23:30 juju-e4d256-prod-github-runner-207 kernel: [43184.634858] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 17:23:30 juju-e4d256-prod-github-runner-207 kernel: [43184.635877] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 17:23:30 juju-e4d256-prod-github-runner-207 kernel: [43184.636898] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 17:23:30 juju-e4d256-prod-github-runner-207 kernel: [43184.637916] Aug 22 17:23:46 juju-e4d256-prod-github-runner-207 kernel: [43200.068704] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 17:23:46 juju-e4d256-prod-github-runner-207 kernel: [43200.069662] rcu: 1-....: (10736962 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=5196018 Aug 22 17:23:46 juju-e4d256-prod-github-runner-207 kernel: [43200.070805] (t=10770717 jiffies g=23269 q=43155) Aug 22 17:23:46 juju-e4d256-prod-github-runner-207 kernel: [43200.071605] NMI backtrace for cpu 1 Aug 22 17:23:46 juju-e4d256-prod-github-runner-207 kernel: [43200.072315] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 17:23:46 juju-e4d256-prod-github-runner-207 kernel: [43200.073426] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 17:23:46 juju-e4d256-prod-github-runner-207 kernel: [43200.074496] Call Trace: Aug 22 17:23:46 juju-e4d256-prod-github-runner-207 kernel: [43200.075170] Aug 22 17:23:46 juju-e4d256-prod-github-runner-207 kernel: [43200.075812] show_stack+0x52/0x5c Aug 22 17:23:46 juju-e4d256-prod-github-runner-207 kernel: [43200.076541] dump_stack_lvl+0x4a/0x63 Aug 22 17:23:46 juju-e4d256-prod-github-runner-207 kernel: [43200.077284] dump_stack+0x10/0x16 Aug 22 17:23:46 juju-e4d256-prod-github-runner-207 kernel: [43200.077999] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 17:23:46 juju-e4d256-prod-github-runner-207 kernel: [43200.078787] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 17:23:46 juju-e4d256-prod-github-runner-207 kernel: [43200.079563] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 17:23:46 juju-e4d256-prod-github-runner-207 kernel: [43200.080384] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 17:23:46 juju-e4d256-prod-github-runner-207 kernel: [43200.081200] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 17:23:46 juju-e4d256-prod-github-runner-207 kernel: [43200.082011] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 17:23:46 juju-e4d256-prod-github-runner-207 kernel: [43200.082794] print_cpu_stall.cold+0x2f/0xe2 Aug 22 17:23:46 juju-e4d256-prod-github-runner-207 kernel: [43200.083557] ? timekeeping_update+0xf7/0x150 Aug 22 17:23:46 juju-e4d256-prod-github-runner-207 kernel: [43200.084325] check_cpu_stall+0x109/0x270 Aug 22 17:23:46 juju-e4d256-prod-github-runner-207 kernel: [43200.085069] rcu_sched_clock_irq+0x9a/0x250 Aug 22 17:23:46 juju-e4d256-prod-github-runner-207 kernel: [43200.085830] update_process_times+0x94/0xd0 Aug 22 17:23:46 juju-e4d256-prod-github-runner-207 kernel: [43200.086600] tick_sched_handle+0x29/0x70 Aug 22 17:23:46 juju-e4d256-prod-github-runner-207 kernel: [43200.087349] tick_sched_timer+0x8c/0xc0 Aug 22 17:23:46 juju-e4d256-prod-github-runner-207 kernel: [43200.088084] ? tick_nohz_handler+0xb0/0xb0 Aug 22 17:23:46 juju-e4d256-prod-github-runner-207 kernel: [43200.088836] __hrtimer_run_queues+0x107/0x230 Aug 22 17:23:46 juju-e4d256-prod-github-runner-207 kernel: [43200.089607] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 17:23:46 juju-e4d256-prod-github-runner-207 kernel: [43200.090389] hrtimer_interrupt+0x101/0x220 Aug 22 17:23:46 juju-e4d256-prod-github-runner-207 kernel: [43200.091148] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 17:23:46 juju-e4d256-prod-github-runner-207 kernel: [43200.091965] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 17:23:46 juju-e4d256-prod-github-runner-207 kernel: [43200.092772] Aug 22 17:23:46 juju-e4d256-prod-github-runner-207 kernel: [43200.093406] Aug 22 17:23:46 juju-e4d256-prod-github-runner-207 kernel: [43200.094033] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 17:23:46 juju-e4d256-prod-github-runner-207 kernel: [43200.094858] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:23:46 juju-e4d256-prod-github-runner-207 kernel: [43200.095740] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 17:23:46 juju-e4d256-prod-github-runner-207 kernel: [43200.097951] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 17:23:46 juju-e4d256-prod-github-runner-207 kernel: [43200.098836] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 17:23:46 juju-e4d256-prod-github-runner-207 kernel: [43200.099851] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 17:23:46 juju-e4d256-prod-github-runner-207 kernel: [43200.100832] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 17:23:46 juju-e4d256-prod-github-runner-207 kernel: [43200.101797] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 17:23:46 juju-e4d256-prod-github-runner-207 kernel: [43200.102762] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 17:23:46 juju-e4d256-prod-github-runner-207 kernel: [43200.103720] ? _raw_spin_lock+0x22/0x30 Aug 22 17:23:46 juju-e4d256-prod-github-runner-207 kernel: [43200.104477] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:23:46 juju-e4d256-prod-github-runner-207 kernel: [43200.105317] direct_page_fault+0x206/0x310 [kvm] Aug 22 17:23:46 juju-e4d256-prod-github-runner-207 kernel: [43200.106160] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 17:23:46 juju-e4d256-prod-github-runner-207 kernel: [43200.106988] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 17:23:46 juju-e4d256-prod-github-runner-207 kernel: [43200.107817] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 17:23:46 juju-e4d256-prod-github-runner-207 kernel: [43200.108688] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 17:23:46 juju-e4d256-prod-github-runner-207 kernel: [43200.109473] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 17:23:46 juju-e4d256-prod-github-runner-207 kernel: [43200.110307] handle_exit+0x98/0x230 [kvm_amd] Aug 22 17:23:46 juju-e4d256-prod-github-runner-207 kernel: [43200.111062] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 17:23:46 juju-e4d256-prod-github-runner-207 kernel: [43200.111849] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 17:23:46 juju-e4d256-prod-github-runner-207 kernel: [43200.112648] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 17:23:46 juju-e4d256-prod-github-runner-207 kernel: [43200.113437] vcpu_run+0x62/0x2c0 [kvm] Aug 22 17:23:46 juju-e4d256-prod-github-runner-207 kernel: [43200.114163] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 17:23:46 juju-e4d256-prod-github-runner-207 kernel: [43200.114902] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 17:23:46 juju-e4d256-prod-github-runner-207 kernel: [43200.115707] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 17:23:46 juju-e4d256-prod-github-runner-207 kernel: [43200.116474] ? __seccomp_filter+0x4a/0x4a0 Aug 22 17:23:46 juju-e4d256-prod-github-runner-207 kernel: [43200.117195] ? __fget_files+0x86/0xc0 Aug 22 17:23:46 juju-e4d256-prod-github-runner-207 kernel: [43200.117888] __x64_sys_ioctl+0x95/0xd0 Aug 22 17:23:46 juju-e4d256-prod-github-runner-207 kernel: [43200.118742] do_syscall_64+0x5c/0xc0 Aug 22 17:23:46 juju-e4d256-prod-github-runner-207 kernel: [43200.119431] ? do_futex+0x162/0x1f0 Aug 22 17:23:46 juju-e4d256-prod-github-runner-207 kernel: [43200.120101] ? __x64_sys_futex+0x78/0x1e0 Aug 22 17:23:46 juju-e4d256-prod-github-runner-207 kernel: [43200.120801] ? __secure_computing+0xa9/0x120 Aug 22 17:23:46 juju-e4d256-prod-github-runner-207 kernel: [43200.121522] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 17:23:46 juju-e4d256-prod-github-runner-207 kernel: [43200.122318] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:23:46 juju-e4d256-prod-github-runner-207 kernel: [43200.123071] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:23:46 juju-e4d256-prod-github-runner-207 kernel: [43200.123823] ? do_syscall_64+0x69/0xc0 Aug 22 17:23:46 juju-e4d256-prod-github-runner-207 kernel: [43200.124515] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:23:46 juju-e4d256-prod-github-runner-207 kernel: [43200.125270] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:23:46 juju-e4d256-prod-github-runner-207 kernel: [43200.126030] ? do_syscall_64+0x69/0xc0 Aug 22 17:23:46 juju-e4d256-prod-github-runner-207 kernel: [43200.126729] ? do_syscall_64+0x69/0xc0 Aug 22 17:23:46 juju-e4d256-prod-github-runner-207 kernel: [43200.127415] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 17:23:46 juju-e4d256-prod-github-runner-207 kernel: [43200.128184] RIP: 0033:0x7faa5d0edaff Aug 22 17:23:46 juju-e4d256-prod-github-runner-207 kernel: [43200.128866] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 17:23:46 juju-e4d256-prod-github-runner-207 kernel: [43200.130980] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 17:23:46 juju-e4d256-prod-github-runner-207 kernel: [43200.131942] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 17:23:46 juju-e4d256-prod-github-runner-207 kernel: [43200.132887] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 17:23:46 juju-e4d256-prod-github-runner-207 kernel: [43200.133840] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 17:23:46 juju-e4d256-prod-github-runner-207 kernel: [43200.134788] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 17:23:46 juju-e4d256-prod-github-runner-207 kernel: [43200.135711] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 17:23:46 juju-e4d256-prod-github-runner-207 kernel: [43200.136623] Aug 22 17:24:10 juju-e4d256-prod-github-runner-207 kernel: [43224.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 40147s! [qemu-system-x86:6715] Aug 22 17:24:10 juju-e4d256-prod-github-runner-207 kernel: [43224.543125] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 17:24:10 juju-e4d256-prod-github-runner-207 kernel: [43224.543194] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 17:24:10 juju-e4d256-prod-github-runner-207 kernel: [43224.555306] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 17:24:10 juju-e4d256-prod-github-runner-207 kernel: [43224.556566] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 17:24:10 juju-e4d256-prod-github-runner-207 kernel: [43224.557806] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:24:10 juju-e4d256-prod-github-runner-207 kernel: [43224.558932] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 17:24:10 juju-e4d256-prod-github-runner-207 kernel: [43224.561495] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 17:24:10 juju-e4d256-prod-github-runner-207 kernel: [43224.562561] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 17:24:10 juju-e4d256-prod-github-runner-207 kernel: [43224.563728] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 17:24:10 juju-e4d256-prod-github-runner-207 kernel: [43224.564990] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 17:24:10 juju-e4d256-prod-github-runner-207 kernel: [43224.566159] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 17:24:10 juju-e4d256-prod-github-runner-207 kernel: [43224.567319] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 17:24:10 juju-e4d256-prod-github-runner-207 kernel: [43224.568483] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 17:24:10 juju-e4d256-prod-github-runner-207 kernel: [43224.569714] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 17:24:10 juju-e4d256-prod-github-runner-207 kernel: [43224.570821] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 17:24:10 juju-e4d256-prod-github-runner-207 kernel: [43224.572012] Call Trace: Aug 22 17:24:10 juju-e4d256-prod-github-runner-207 kernel: [43224.572929] Aug 22 17:24:10 juju-e4d256-prod-github-runner-207 kernel: [43224.573826] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:24:10 juju-e4d256-prod-github-runner-207 kernel: [43224.574853] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:24:10 juju-e4d256-prod-github-runner-207 kernel: [43224.575872] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:24:10 juju-e4d256-prod-github-runner-207 kernel: [43224.576953] ? show_regs.part.0+0x23/0x29 Aug 22 17:24:10 juju-e4d256-prod-github-runner-207 kernel: [43224.577964] ? show_regs.cold+0x8/0xd Aug 22 17:24:10 juju-e4d256-prod-github-runner-207 kernel: [43224.578934] ? watchdog_timer_fn+0x1be/0x220 Aug 22 17:24:10 juju-e4d256-prod-github-runner-207 kernel: [43224.579945] ? lockup_detector_update_enable+0x60/0x60 Aug 22 17:24:10 juju-e4d256-prod-github-runner-207 kernel: [43224.581007] ? __hrtimer_run_queues+0x107/0x230 Aug 22 17:24:10 juju-e4d256-prod-github-runner-207 kernel: [43224.582046] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 17:24:10 juju-e4d256-prod-github-runner-207 kernel: [43224.583073] ? hrtimer_interrupt+0x101/0x220 Aug 22 17:24:10 juju-e4d256-prod-github-runner-207 kernel: [43224.584091] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 17:24:10 juju-e4d256-prod-github-runner-207 kernel: [43224.585156] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 17:24:10 juju-e4d256-prod-github-runner-207 kernel: [43224.586215] Aug 22 17:24:10 juju-e4d256-prod-github-runner-207 kernel: [43224.587066] Aug 22 17:24:10 juju-e4d256-prod-github-runner-207 kernel: [43224.587907] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 17:24:10 juju-e4d256-prod-github-runner-207 kernel: [43224.588936] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:24:10 juju-e4d256-prod-github-runner-207 kernel: [43224.589986] ? _raw_spin_lock+0x22/0x30 Aug 22 17:24:10 juju-e4d256-prod-github-runner-207 kernel: [43224.590933] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:24:10 juju-e4d256-prod-github-runner-207 kernel: [43224.591950] direct_page_fault+0x206/0x310 [kvm] Aug 22 17:24:10 juju-e4d256-prod-github-runner-207 kernel: [43224.592974] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 17:24:10 juju-e4d256-prod-github-runner-207 kernel: [43224.593996] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 17:24:10 juju-e4d256-prod-github-runner-207 kernel: [43224.594996] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 17:24:10 juju-e4d256-prod-github-runner-207 kernel: [43224.596047] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 17:24:10 juju-e4d256-prod-github-runner-207 kernel: [43224.597064] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 17:24:10 juju-e4d256-prod-github-runner-207 kernel: [43224.598058] handle_exit+0x98/0x230 [kvm_amd] Aug 22 17:24:10 juju-e4d256-prod-github-runner-207 kernel: [43224.598954] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 17:24:10 juju-e4d256-prod-github-runner-207 kernel: [43224.599868] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 17:24:10 juju-e4d256-prod-github-runner-207 kernel: [43224.600800] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 17:24:10 juju-e4d256-prod-github-runner-207 kernel: [43224.601755] vcpu_run+0x62/0x2c0 [kvm] Aug 22 17:24:10 juju-e4d256-prod-github-runner-207 kernel: [43224.602575] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 17:24:10 juju-e4d256-prod-github-runner-207 kernel: [43224.603379] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 17:24:10 juju-e4d256-prod-github-runner-207 kernel: [43224.604228] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 17:24:10 juju-e4d256-prod-github-runner-207 kernel: [43224.605090] ? __seccomp_filter+0x4a/0x4a0 Aug 22 17:24:10 juju-e4d256-prod-github-runner-207 kernel: [43224.605854] ? __fget_files+0x86/0xc0 Aug 22 17:24:10 juju-e4d256-prod-github-runner-207 kernel: [43224.606558] __x64_sys_ioctl+0x95/0xd0 Aug 22 17:24:10 juju-e4d256-prod-github-runner-207 kernel: [43224.607249] do_syscall_64+0x5c/0xc0 Aug 22 17:24:10 juju-e4d256-prod-github-runner-207 kernel: [43224.607911] ? do_futex+0x162/0x1f0 Aug 22 17:24:10 juju-e4d256-prod-github-runner-207 kernel: [43224.608562] ? __x64_sys_futex+0x78/0x1e0 Aug 22 17:24:10 juju-e4d256-prod-github-runner-207 kernel: [43224.609236] ? __secure_computing+0xa9/0x120 Aug 22 17:24:10 juju-e4d256-prod-github-runner-207 kernel: [43224.609936] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 17:24:10 juju-e4d256-prod-github-runner-207 kernel: [43224.610694] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:24:10 juju-e4d256-prod-github-runner-207 kernel: [43224.611416] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:24:10 juju-e4d256-prod-github-runner-207 kernel: [43224.612139] ? do_syscall_64+0x69/0xc0 Aug 22 17:24:10 juju-e4d256-prod-github-runner-207 kernel: [43224.612782] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:24:10 juju-e4d256-prod-github-runner-207 kernel: [43224.613483] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:24:10 juju-e4d256-prod-github-runner-207 kernel: [43224.614207] ? do_syscall_64+0x69/0xc0 Aug 22 17:24:10 juju-e4d256-prod-github-runner-207 kernel: [43224.614902] ? do_syscall_64+0x69/0xc0 Aug 22 17:24:10 juju-e4d256-prod-github-runner-207 kernel: [43224.615521] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 17:24:10 juju-e4d256-prod-github-runner-207 kernel: [43224.616222] RIP: 0033:0x7faa5d0edaff Aug 22 17:24:10 juju-e4d256-prod-github-runner-207 kernel: [43224.616843] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 17:24:10 juju-e4d256-prod-github-runner-207 kernel: [43224.618833] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 17:24:10 juju-e4d256-prod-github-runner-207 kernel: [43224.619739] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 17:24:10 juju-e4d256-prod-github-runner-207 kernel: [43224.620628] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 17:24:10 juju-e4d256-prod-github-runner-207 kernel: [43224.621515] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 17:24:10 juju-e4d256-prod-github-runner-207 kernel: [43224.622411] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 17:24:10 juju-e4d256-prod-github-runner-207 kernel: [43224.623302] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 17:24:10 juju-e4d256-prod-github-runner-207 kernel: [43224.624191] Aug 22 17:24:38 juju-e4d256-prod-github-runner-207 kernel: [43252.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 40174s! [qemu-system-x86:6715] Aug 22 17:24:38 juju-e4d256-prod-github-runner-207 kernel: [43252.543100] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 17:24:38 juju-e4d256-prod-github-runner-207 kernel: [43252.543169] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 17:24:38 juju-e4d256-prod-github-runner-207 kernel: [43252.555355] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 17:24:38 juju-e4d256-prod-github-runner-207 kernel: [43252.556624] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 17:24:38 juju-e4d256-prod-github-runner-207 kernel: [43252.557873] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:24:38 juju-e4d256-prod-github-runner-207 kernel: [43252.558933] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 17:24:38 juju-e4d256-prod-github-runner-207 kernel: [43252.561497] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 17:24:38 juju-e4d256-prod-github-runner-207 kernel: [43252.562540] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 17:24:38 juju-e4d256-prod-github-runner-207 kernel: [43252.563698] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 17:24:38 juju-e4d256-prod-github-runner-207 kernel: [43252.564854] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 17:24:38 juju-e4d256-prod-github-runner-207 kernel: [43252.566026] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 17:24:38 juju-e4d256-prod-github-runner-207 kernel: [43252.567193] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 17:24:38 juju-e4d256-prod-github-runner-207 kernel: [43252.568368] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 17:24:38 juju-e4d256-prod-github-runner-207 kernel: [43252.569606] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 17:24:38 juju-e4d256-prod-github-runner-207 kernel: [43252.570702] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 17:24:38 juju-e4d256-prod-github-runner-207 kernel: [43252.571894] Call Trace: Aug 22 17:24:38 juju-e4d256-prod-github-runner-207 kernel: [43252.572806] Aug 22 17:24:38 juju-e4d256-prod-github-runner-207 kernel: [43252.573699] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:24:38 juju-e4d256-prod-github-runner-207 kernel: [43252.574734] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:24:38 juju-e4d256-prod-github-runner-207 kernel: [43252.575754] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:24:38 juju-e4d256-prod-github-runner-207 kernel: [43252.576838] ? show_regs.part.0+0x23/0x29 Aug 22 17:24:38 juju-e4d256-prod-github-runner-207 kernel: [43252.577843] ? show_regs.cold+0x8/0xd Aug 22 17:24:38 juju-e4d256-prod-github-runner-207 kernel: [43252.578813] ? watchdog_timer_fn+0x1be/0x220 Aug 22 17:24:38 juju-e4d256-prod-github-runner-207 kernel: [43252.579823] ? lockup_detector_update_enable+0x60/0x60 Aug 22 17:24:38 juju-e4d256-prod-github-runner-207 kernel: [43252.580889] ? __hrtimer_run_queues+0x107/0x230 Aug 22 17:24:38 juju-e4d256-prod-github-runner-207 kernel: [43252.581930] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 17:24:38 juju-e4d256-prod-github-runner-207 kernel: [43252.582957] ? hrtimer_interrupt+0x101/0x220 Aug 22 17:24:38 juju-e4d256-prod-github-runner-207 kernel: [43252.583970] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 17:24:38 juju-e4d256-prod-github-runner-207 kernel: [43252.585039] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 17:24:38 juju-e4d256-prod-github-runner-207 kernel: [43252.586093] Aug 22 17:24:38 juju-e4d256-prod-github-runner-207 kernel: [43252.586945] Aug 22 17:24:38 juju-e4d256-prod-github-runner-207 kernel: [43252.587781] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 17:24:38 juju-e4d256-prod-github-runner-207 kernel: [43252.588815] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:24:38 juju-e4d256-prod-github-runner-207 kernel: [43252.589863] ? _raw_spin_lock+0x22/0x30 Aug 22 17:24:38 juju-e4d256-prod-github-runner-207 kernel: [43252.590810] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:24:38 juju-e4d256-prod-github-runner-207 kernel: [43252.591827] direct_page_fault+0x206/0x310 [kvm] Aug 22 17:24:38 juju-e4d256-prod-github-runner-207 kernel: [43252.592848] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 17:24:38 juju-e4d256-prod-github-runner-207 kernel: [43252.593864] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 17:24:38 juju-e4d256-prod-github-runner-207 kernel: [43252.594862] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 17:24:38 juju-e4d256-prod-github-runner-207 kernel: [43252.595827] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 17:24:38 juju-e4d256-prod-github-runner-207 kernel: [43252.596768] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 17:24:38 juju-e4d256-prod-github-runner-207 kernel: [43252.597763] handle_exit+0x98/0x230 [kvm_amd] Aug 22 17:24:38 juju-e4d256-prod-github-runner-207 kernel: [43252.598653] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 17:24:38 juju-e4d256-prod-github-runner-207 kernel: [43252.599569] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 17:24:38 juju-e4d256-prod-github-runner-207 kernel: [43252.600494] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 17:24:38 juju-e4d256-prod-github-runner-207 kernel: [43252.601395] vcpu_run+0x62/0x2c0 [kvm] Aug 22 17:24:38 juju-e4d256-prod-github-runner-207 kernel: [43252.602219] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 17:24:38 juju-e4d256-prod-github-runner-207 kernel: [43252.603028] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 17:24:38 juju-e4d256-prod-github-runner-207 kernel: [43252.603877] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 17:24:38 juju-e4d256-prod-github-runner-207 kernel: [43252.604671] ? __seccomp_filter+0x4a/0x4a0 Aug 22 17:24:38 juju-e4d256-prod-github-runner-207 kernel: [43252.605415] ? __fget_files+0x86/0xc0 Aug 22 17:24:38 juju-e4d256-prod-github-runner-207 kernel: [43252.606125] __x64_sys_ioctl+0x95/0xd0 Aug 22 17:24:38 juju-e4d256-prod-github-runner-207 kernel: [43252.606815] do_syscall_64+0x5c/0xc0 Aug 22 17:24:38 juju-e4d256-prod-github-runner-207 kernel: [43252.607477] ? do_futex+0x162/0x1f0 Aug 22 17:24:38 juju-e4d256-prod-github-runner-207 kernel: [43252.608125] ? __x64_sys_futex+0x78/0x1e0 Aug 22 17:24:38 juju-e4d256-prod-github-runner-207 kernel: [43252.608795] ? __secure_computing+0xa9/0x120 Aug 22 17:24:38 juju-e4d256-prod-github-runner-207 kernel: [43252.609493] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 17:24:38 juju-e4d256-prod-github-runner-207 kernel: [43252.610250] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:24:38 juju-e4d256-prod-github-runner-207 kernel: [43252.610969] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:24:38 juju-e4d256-prod-github-runner-207 kernel: [43252.611683] ? do_syscall_64+0x69/0xc0 Aug 22 17:24:38 juju-e4d256-prod-github-runner-207 kernel: [43252.612328] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:24:38 juju-e4d256-prod-github-runner-207 kernel: [43252.613028] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:24:38 juju-e4d256-prod-github-runner-207 kernel: [43252.613727] ? do_syscall_64+0x69/0xc0 Aug 22 17:24:38 juju-e4d256-prod-github-runner-207 kernel: [43252.614357] ? do_syscall_64+0x69/0xc0 Aug 22 17:24:38 juju-e4d256-prod-github-runner-207 kernel: [43252.614982] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 17:24:38 juju-e4d256-prod-github-runner-207 kernel: [43252.615686] RIP: 0033:0x7faa5d0edaff Aug 22 17:24:38 juju-e4d256-prod-github-runner-207 kernel: [43252.616306] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 17:24:38 juju-e4d256-prod-github-runner-207 kernel: [43252.618300] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 17:24:38 juju-e4d256-prod-github-runner-207 kernel: [43252.619212] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 17:24:38 juju-e4d256-prod-github-runner-207 kernel: [43252.620099] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 17:24:38 juju-e4d256-prod-github-runner-207 kernel: [43252.620982] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 17:24:38 juju-e4d256-prod-github-runner-207 kernel: [43252.621871] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 17:24:38 juju-e4d256-prod-github-runner-207 kernel: [43252.622756] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 17:24:38 juju-e4d256-prod-github-runner-207 kernel: [43252.623645] Aug 22 17:25:06 juju-e4d256-prod-github-runner-207 kernel: [43280.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 40200s! [qemu-system-x86:6715] Aug 22 17:25:06 juju-e4d256-prod-github-runner-207 kernel: [43280.544045] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 17:25:06 juju-e4d256-prod-github-runner-207 kernel: [43280.544295] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 17:25:06 juju-e4d256-prod-github-runner-207 kernel: [43280.561282] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 17:25:06 juju-e4d256-prod-github-runner-207 kernel: [43280.562736] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 17:25:06 juju-e4d256-prod-github-runner-207 kernel: [43280.563968] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:25:06 juju-e4d256-prod-github-runner-207 kernel: [43280.565035] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 17:25:06 juju-e4d256-prod-github-runner-207 kernel: [43280.567625] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 17:25:06 juju-e4d256-prod-github-runner-207 kernel: [43280.568676] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 17:25:06 juju-e4d256-prod-github-runner-207 kernel: [43280.570016] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 17:25:06 juju-e4d256-prod-github-runner-207 kernel: [43280.571199] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 17:25:06 juju-e4d256-prod-github-runner-207 kernel: [43280.572377] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 17:25:06 juju-e4d256-prod-github-runner-207 kernel: [43280.573557] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 17:25:06 juju-e4d256-prod-github-runner-207 kernel: [43280.574736] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 17:25:06 juju-e4d256-prod-github-runner-207 kernel: [43280.575981] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 17:25:06 juju-e4d256-prod-github-runner-207 kernel: [43280.577082] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 17:25:06 juju-e4d256-prod-github-runner-207 kernel: [43280.578296] Call Trace: Aug 22 17:25:06 juju-e4d256-prod-github-runner-207 kernel: [43280.579218] Aug 22 17:25:06 juju-e4d256-prod-github-runner-207 kernel: [43280.580110] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:25:06 juju-e4d256-prod-github-runner-207 kernel: [43280.581180] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:25:06 juju-e4d256-prod-github-runner-207 kernel: [43280.582208] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:25:06 juju-e4d256-prod-github-runner-207 kernel: [43280.583332] ? show_regs.part.0+0x23/0x29 Aug 22 17:25:06 juju-e4d256-prod-github-runner-207 kernel: [43280.584340] ? show_regs.cold+0x8/0xd Aug 22 17:25:06 juju-e4d256-prod-github-runner-207 kernel: [43280.585349] ? watchdog_timer_fn+0x1be/0x220 Aug 22 17:25:06 juju-e4d256-prod-github-runner-207 kernel: [43280.586373] ? lockup_detector_update_enable+0x60/0x60 Aug 22 17:25:06 juju-e4d256-prod-github-runner-207 kernel: [43280.587447] ? __hrtimer_run_queues+0x107/0x230 Aug 22 17:25:06 juju-e4d256-prod-github-runner-207 kernel: [43280.588481] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 17:25:06 juju-e4d256-prod-github-runner-207 kernel: [43280.589524] ? hrtimer_interrupt+0x101/0x220 Aug 22 17:25:06 juju-e4d256-prod-github-runner-207 kernel: [43280.590554] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 17:25:06 juju-e4d256-prod-github-runner-207 kernel: [43280.591700] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 17:25:06 juju-e4d256-prod-github-runner-207 kernel: [43280.592758] Aug 22 17:25:06 juju-e4d256-prod-github-runner-207 kernel: [43280.593634] Aug 22 17:25:06 juju-e4d256-prod-github-runner-207 kernel: [43280.594471] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 17:25:06 juju-e4d256-prod-github-runner-207 kernel: [43280.596048] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:25:06 juju-e4d256-prod-github-runner-207 kernel: [43280.597592] ? _raw_spin_lock+0x22/0x30 Aug 22 17:25:06 juju-e4d256-prod-github-runner-207 kernel: [43280.598945] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:25:06 juju-e4d256-prod-github-runner-207 kernel: [43280.600422] direct_page_fault+0x206/0x310 [kvm] Aug 22 17:25:06 juju-e4d256-prod-github-runner-207 kernel: [43280.601925] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 17:25:06 juju-e4d256-prod-github-runner-207 kernel: [43280.603357] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 17:25:06 juju-e4d256-prod-github-runner-207 kernel: [43280.604823] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 17:25:06 juju-e4d256-prod-github-runner-207 kernel: [43280.607639] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 17:25:06 juju-e4d256-prod-github-runner-207 kernel: [43280.609059] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 17:25:06 juju-e4d256-prod-github-runner-207 kernel: [43280.610479] handle_exit+0x98/0x230 [kvm_amd] Aug 22 17:25:06 juju-e4d256-prod-github-runner-207 kernel: [43280.611718] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 17:25:06 juju-e4d256-prod-github-runner-207 kernel: [43280.613090] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 17:25:06 juju-e4d256-prod-github-runner-207 kernel: [43280.614468] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 17:25:06 juju-e4d256-prod-github-runner-207 kernel: [43280.615800] vcpu_run+0x62/0x2c0 [kvm] Aug 22 17:25:06 juju-e4d256-prod-github-runner-207 kernel: [43280.617028] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 17:25:06 juju-e4d256-prod-github-runner-207 kernel: [43280.618221] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 17:25:06 juju-e4d256-prod-github-runner-207 kernel: [43280.619457] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 17:25:06 juju-e4d256-prod-github-runner-207 kernel: [43280.620566] ? __seccomp_filter+0x4a/0x4a0 Aug 22 17:25:06 juju-e4d256-prod-github-runner-207 kernel: [43280.621670] ? __fget_files+0x86/0xc0 Aug 22 17:25:06 juju-e4d256-prod-github-runner-207 kernel: [43280.622699] __x64_sys_ioctl+0x95/0xd0 Aug 22 17:25:06 juju-e4d256-prod-github-runner-207 kernel: [43280.623610] do_syscall_64+0x5c/0xc0 Aug 22 17:25:06 juju-e4d256-prod-github-runner-207 kernel: [43280.624296] ? do_futex+0x162/0x1f0 Aug 22 17:25:06 juju-e4d256-prod-github-runner-207 kernel: [43280.624953] ? __x64_sys_futex+0x78/0x1e0 Aug 22 17:25:06 juju-e4d256-prod-github-runner-207 kernel: [43280.625653] ? __secure_computing+0xa9/0x120 Aug 22 17:25:06 juju-e4d256-prod-github-runner-207 kernel: [43280.626348] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 17:25:06 juju-e4d256-prod-github-runner-207 kernel: [43280.627125] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:25:06 juju-e4d256-prod-github-runner-207 kernel: [43280.627861] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:25:06 juju-e4d256-prod-github-runner-207 kernel: [43280.628591] ? do_syscall_64+0x69/0xc0 Aug 22 17:25:06 juju-e4d256-prod-github-runner-207 kernel: [43280.629274] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:25:06 juju-e4d256-prod-github-runner-207 kernel: [43280.629996] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:25:06 juju-e4d256-prod-github-runner-207 kernel: [43280.630696] ? do_syscall_64+0x69/0xc0 Aug 22 17:25:06 juju-e4d256-prod-github-runner-207 kernel: [43280.631339] ? do_syscall_64+0x69/0xc0 Aug 22 17:25:06 juju-e4d256-prod-github-runner-207 kernel: [43280.631972] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 17:25:06 juju-e4d256-prod-github-runner-207 kernel: [43280.632691] RIP: 0033:0x7faa5d0edaff Aug 22 17:25:06 juju-e4d256-prod-github-runner-207 kernel: [43280.633373] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 17:25:06 juju-e4d256-prod-github-runner-207 kernel: [43280.636142] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 17:25:06 juju-e4d256-prod-github-runner-207 kernel: [43280.637474] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 17:25:06 juju-e4d256-prod-github-runner-207 kernel: [43280.638664] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 17:25:06 juju-e4d256-prod-github-runner-207 kernel: [43280.639822] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 17:25:06 juju-e4d256-prod-github-runner-207 kernel: [43280.641047] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 17:25:06 juju-e4d256-prod-github-runner-207 kernel: [43280.642364] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 17:25:06 juju-e4d256-prod-github-runner-207 kernel: [43280.643413] Aug 22 17:25:34 juju-e4d256-prod-github-runner-207 kernel: [43308.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 40226s! [qemu-system-x86:6715] Aug 22 17:25:34 juju-e4d256-prod-github-runner-207 kernel: [43308.543146] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 17:25:34 juju-e4d256-prod-github-runner-207 kernel: [43308.543214] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 17:25:34 juju-e4d256-prod-github-runner-207 kernel: [43308.555484] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 17:25:34 juju-e4d256-prod-github-runner-207 kernel: [43308.556755] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 17:25:34 juju-e4d256-prod-github-runner-207 kernel: [43308.557995] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:25:34 juju-e4d256-prod-github-runner-207 kernel: [43308.559203] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 17:25:34 juju-e4d256-prod-github-runner-207 kernel: [43308.561763] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 17:25:34 juju-e4d256-prod-github-runner-207 kernel: [43308.562808] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 17:25:34 juju-e4d256-prod-github-runner-207 kernel: [43308.564004] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 17:25:34 juju-e4d256-prod-github-runner-207 kernel: [43308.565184] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 17:25:34 juju-e4d256-prod-github-runner-207 kernel: [43308.566351] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 17:25:34 juju-e4d256-prod-github-runner-207 kernel: [43308.567518] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 17:25:34 juju-e4d256-prod-github-runner-207 kernel: [43308.568690] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 17:25:34 juju-e4d256-prod-github-runner-207 kernel: [43308.569952] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 17:25:34 juju-e4d256-prod-github-runner-207 kernel: [43308.571056] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 17:25:34 juju-e4d256-prod-github-runner-207 kernel: [43308.572259] Call Trace: Aug 22 17:25:34 juju-e4d256-prod-github-runner-207 kernel: [43308.573184] Aug 22 17:25:34 juju-e4d256-prod-github-runner-207 kernel: [43308.574091] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:25:34 juju-e4d256-prod-github-runner-207 kernel: [43308.575125] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:25:34 juju-e4d256-prod-github-runner-207 kernel: [43308.576151] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:25:34 juju-e4d256-prod-github-runner-207 kernel: [43308.577303] ? show_regs.part.0+0x23/0x29 Aug 22 17:25:34 juju-e4d256-prod-github-runner-207 kernel: [43308.578308] ? show_regs.cold+0x8/0xd Aug 22 17:25:34 juju-e4d256-prod-github-runner-207 kernel: [43308.579285] ? watchdog_timer_fn+0x1be/0x220 Aug 22 17:25:34 juju-e4d256-prod-github-runner-207 kernel: [43308.580295] ? lockup_detector_update_enable+0x60/0x60 Aug 22 17:25:34 juju-e4d256-prod-github-runner-207 kernel: [43308.581372] ? __hrtimer_run_queues+0x107/0x230 Aug 22 17:25:34 juju-e4d256-prod-github-runner-207 kernel: [43308.582407] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 17:25:34 juju-e4d256-prod-github-runner-207 kernel: [43308.583435] ? hrtimer_interrupt+0x101/0x220 Aug 22 17:25:34 juju-e4d256-prod-github-runner-207 kernel: [43308.584499] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 17:25:34 juju-e4d256-prod-github-runner-207 kernel: [43308.585583] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 17:25:34 juju-e4d256-prod-github-runner-207 kernel: [43308.586640] Aug 22 17:25:34 juju-e4d256-prod-github-runner-207 kernel: [43308.587494] Aug 22 17:25:34 juju-e4d256-prod-github-runner-207 kernel: [43308.588332] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 17:25:34 juju-e4d256-prod-github-runner-207 kernel: [43308.589382] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:25:34 juju-e4d256-prod-github-runner-207 kernel: [43308.590431] ? _raw_spin_lock+0x22/0x30 Aug 22 17:25:34 juju-e4d256-prod-github-runner-207 kernel: [43308.591384] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:25:34 juju-e4d256-prod-github-runner-207 kernel: [43308.592403] direct_page_fault+0x206/0x310 [kvm] Aug 22 17:25:34 juju-e4d256-prod-github-runner-207 kernel: [43308.593448] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 17:25:34 juju-e4d256-prod-github-runner-207 kernel: [43308.594470] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 17:25:34 juju-e4d256-prod-github-runner-207 kernel: [43308.595493] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 17:25:34 juju-e4d256-prod-github-runner-207 kernel: [43308.596481] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 17:25:34 juju-e4d256-prod-github-runner-207 kernel: [43308.597448] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 17:25:34 juju-e4d256-prod-github-runner-207 kernel: [43308.598424] handle_exit+0x98/0x230 [kvm_amd] Aug 22 17:25:34 juju-e4d256-prod-github-runner-207 kernel: [43308.599318] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 17:25:34 juju-e4d256-prod-github-runner-207 kernel: [43308.600240] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 17:25:34 juju-e4d256-prod-github-runner-207 kernel: [43308.601173] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 17:25:34 juju-e4d256-prod-github-runner-207 kernel: [43308.602074] vcpu_run+0x62/0x2c0 [kvm] Aug 22 17:25:34 juju-e4d256-prod-github-runner-207 kernel: [43308.602883] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 17:25:34 juju-e4d256-prod-github-runner-207 kernel: [43308.603690] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 17:25:34 juju-e4d256-prod-github-runner-207 kernel: [43308.604542] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 17:25:34 juju-e4d256-prod-github-runner-207 kernel: [43308.605389] ? __seccomp_filter+0x4a/0x4a0 Aug 22 17:25:34 juju-e4d256-prod-github-runner-207 kernel: [43308.606136] ? __fget_files+0x86/0xc0 Aug 22 17:25:34 juju-e4d256-prod-github-runner-207 kernel: [43308.606839] __x64_sys_ioctl+0x95/0xd0 Aug 22 17:25:34 juju-e4d256-prod-github-runner-207 kernel: [43308.607533] do_syscall_64+0x5c/0xc0 Aug 22 17:25:34 juju-e4d256-prod-github-runner-207 kernel: [43308.608198] ? do_futex+0x162/0x1f0 Aug 22 17:25:34 juju-e4d256-prod-github-runner-207 kernel: [43308.608866] ? __x64_sys_futex+0x78/0x1e0 Aug 22 17:25:34 juju-e4d256-prod-github-runner-207 kernel: [43308.609539] ? __secure_computing+0xa9/0x120 Aug 22 17:25:34 juju-e4d256-prod-github-runner-207 kernel: [43308.610235] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 17:25:34 juju-e4d256-prod-github-runner-207 kernel: [43308.610993] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:25:34 juju-e4d256-prod-github-runner-207 kernel: [43308.611715] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:25:34 juju-e4d256-prod-github-runner-207 kernel: [43308.612431] ? do_syscall_64+0x69/0xc0 Aug 22 17:25:34 juju-e4d256-prod-github-runner-207 kernel: [43308.613086] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:25:34 juju-e4d256-prod-github-runner-207 kernel: [43308.613791] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:25:34 juju-e4d256-prod-github-runner-207 kernel: [43308.614485] ? do_syscall_64+0x69/0xc0 Aug 22 17:25:34 juju-e4d256-prod-github-runner-207 kernel: [43308.615117] ? do_syscall_64+0x69/0xc0 Aug 22 17:25:34 juju-e4d256-prod-github-runner-207 kernel: [43308.615754] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 17:25:34 juju-e4d256-prod-github-runner-207 kernel: [43308.616455] RIP: 0033:0x7faa5d0edaff Aug 22 17:25:34 juju-e4d256-prod-github-runner-207 kernel: [43308.617087] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 17:25:34 juju-e4d256-prod-github-runner-207 kernel: [43308.619076] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 17:25:34 juju-e4d256-prod-github-runner-207 kernel: [43308.619982] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 17:25:34 juju-e4d256-prod-github-runner-207 kernel: [43308.620877] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 17:25:34 juju-e4d256-prod-github-runner-207 kernel: [43308.621770] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 17:25:34 juju-e4d256-prod-github-runner-207 kernel: [43308.622655] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 17:25:34 juju-e4d256-prod-github-runner-207 kernel: [43308.623542] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 17:25:34 juju-e4d256-prod-github-runner-207 kernel: [43308.624434] Aug 22 17:26:02 juju-e4d256-prod-github-runner-207 kernel: [43336.541980] watchdog: BUG: soft lockup - CPU#1 stuck for 40252s! [qemu-system-x86:6715] Aug 22 17:26:02 juju-e4d256-prod-github-runner-207 kernel: [43336.543094] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 17:26:02 juju-e4d256-prod-github-runner-207 kernel: [43336.543158] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 17:26:02 juju-e4d256-prod-github-runner-207 kernel: [43336.555366] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 17:26:02 juju-e4d256-prod-github-runner-207 kernel: [43336.556648] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 17:26:02 juju-e4d256-prod-github-runner-207 kernel: [43336.557873] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:26:02 juju-e4d256-prod-github-runner-207 kernel: [43336.558929] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 17:26:02 juju-e4d256-prod-github-runner-207 kernel: [43336.561511] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 17:26:02 juju-e4d256-prod-github-runner-207 kernel: [43336.562553] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 17:26:02 juju-e4d256-prod-github-runner-207 kernel: [43336.563720] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 17:26:02 juju-e4d256-prod-github-runner-207 kernel: [43336.564886] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 17:26:02 juju-e4d256-prod-github-runner-207 kernel: [43336.566050] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 17:26:02 juju-e4d256-prod-github-runner-207 kernel: [43336.567220] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 17:26:02 juju-e4d256-prod-github-runner-207 kernel: [43336.568383] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 17:26:02 juju-e4d256-prod-github-runner-207 kernel: [43336.569619] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 17:26:02 juju-e4d256-prod-github-runner-207 kernel: [43336.570711] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 17:26:02 juju-e4d256-prod-github-runner-207 kernel: [43336.571898] Call Trace: Aug 22 17:26:02 juju-e4d256-prod-github-runner-207 kernel: [43336.572863] Aug 22 17:26:02 juju-e4d256-prod-github-runner-207 kernel: [43336.573750] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:26:02 juju-e4d256-prod-github-runner-207 kernel: [43336.574784] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:26:02 juju-e4d256-prod-github-runner-207 kernel: [43336.575809] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:26:02 juju-e4d256-prod-github-runner-207 kernel: [43336.576899] ? show_regs.part.0+0x23/0x29 Aug 22 17:26:02 juju-e4d256-prod-github-runner-207 kernel: [43336.577895] ? show_regs.cold+0x8/0xd Aug 22 17:26:02 juju-e4d256-prod-github-runner-207 kernel: [43336.578871] ? watchdog_timer_fn+0x1be/0x220 Aug 22 17:26:02 juju-e4d256-prod-github-runner-207 kernel: [43336.579877] ? lockup_detector_update_enable+0x60/0x60 Aug 22 17:26:02 juju-e4d256-prod-github-runner-207 kernel: [43336.580956] ? __hrtimer_run_queues+0x107/0x230 Aug 22 17:26:02 juju-e4d256-prod-github-runner-207 kernel: [43336.581994] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 17:26:02 juju-e4d256-prod-github-runner-207 kernel: [43336.583022] ? hrtimer_interrupt+0x101/0x220 Aug 22 17:26:02 juju-e4d256-prod-github-runner-207 kernel: [43336.584037] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 17:26:02 juju-e4d256-prod-github-runner-207 kernel: [43336.585112] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 17:26:02 juju-e4d256-prod-github-runner-207 kernel: [43336.586155] Aug 22 17:26:02 juju-e4d256-prod-github-runner-207 kernel: [43336.587012] Aug 22 17:26:02 juju-e4d256-prod-github-runner-207 kernel: [43336.587848] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 17:26:02 juju-e4d256-prod-github-runner-207 kernel: [43336.588886] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:26:02 juju-e4d256-prod-github-runner-207 kernel: [43336.589946] ? _raw_spin_lock+0x22/0x30 Aug 22 17:26:02 juju-e4d256-prod-github-runner-207 kernel: [43336.590891] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:26:02 juju-e4d256-prod-github-runner-207 kernel: [43336.591912] direct_page_fault+0x206/0x310 [kvm] Aug 22 17:26:02 juju-e4d256-prod-github-runner-207 kernel: [43336.592952] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 17:26:02 juju-e4d256-prod-github-runner-207 kernel: [43336.593960] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 17:26:02 juju-e4d256-prod-github-runner-207 kernel: [43336.594963] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 17:26:02 juju-e4d256-prod-github-runner-207 kernel: [43336.595938] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 17:26:02 juju-e4d256-prod-github-runner-207 kernel: [43336.596928] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 17:26:02 juju-e4d256-prod-github-runner-207 kernel: [43336.597912] handle_exit+0x98/0x230 [kvm_amd] Aug 22 17:26:02 juju-e4d256-prod-github-runner-207 kernel: [43336.598806] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 17:26:02 juju-e4d256-prod-github-runner-207 kernel: [43336.599717] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 17:26:02 juju-e4d256-prod-github-runner-207 kernel: [43336.600659] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 17:26:02 juju-e4d256-prod-github-runner-207 kernel: [43336.601575] vcpu_run+0x62/0x2c0 [kvm] Aug 22 17:26:02 juju-e4d256-prod-github-runner-207 kernel: [43336.602416] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 17:26:02 juju-e4d256-prod-github-runner-207 kernel: [43336.603239] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 17:26:02 juju-e4d256-prod-github-runner-207 kernel: [43336.604106] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 17:26:02 juju-e4d256-prod-github-runner-207 kernel: [43336.604929] ? __seccomp_filter+0x4a/0x4a0 Aug 22 17:26:02 juju-e4d256-prod-github-runner-207 kernel: [43336.605688] ? __fget_files+0x86/0xc0 Aug 22 17:26:02 juju-e4d256-prod-github-runner-207 kernel: [43336.606390] __x64_sys_ioctl+0x95/0xd0 Aug 22 17:26:02 juju-e4d256-prod-github-runner-207 kernel: [43336.607080] do_syscall_64+0x5c/0xc0 Aug 22 17:26:02 juju-e4d256-prod-github-runner-207 kernel: [43336.607751] ? do_futex+0x162/0x1f0 Aug 22 17:26:02 juju-e4d256-prod-github-runner-207 kernel: [43336.608399] ? __x64_sys_futex+0x78/0x1e0 Aug 22 17:26:02 juju-e4d256-prod-github-runner-207 kernel: [43336.609089] ? __secure_computing+0xa9/0x120 Aug 22 17:26:02 juju-e4d256-prod-github-runner-207 kernel: [43336.609777] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 17:26:02 juju-e4d256-prod-github-runner-207 kernel: [43336.610535] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:26:02 juju-e4d256-prod-github-runner-207 kernel: [43336.611264] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:26:02 juju-e4d256-prod-github-runner-207 kernel: [43336.611981] ? do_syscall_64+0x69/0xc0 Aug 22 17:26:02 juju-e4d256-prod-github-runner-207 kernel: [43336.612647] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:26:02 juju-e4d256-prod-github-runner-207 kernel: [43336.613350] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:26:02 juju-e4d256-prod-github-runner-207 kernel: [43336.614046] ? do_syscall_64+0x69/0xc0 Aug 22 17:26:02 juju-e4d256-prod-github-runner-207 kernel: [43336.614669] ? do_syscall_64+0x69/0xc0 Aug 22 17:26:02 juju-e4d256-prod-github-runner-207 kernel: [43336.615293] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 17:26:02 juju-e4d256-prod-github-runner-207 kernel: [43336.616001] RIP: 0033:0x7faa5d0edaff Aug 22 17:26:02 juju-e4d256-prod-github-runner-207 kernel: [43336.616639] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 17:26:02 juju-e4d256-prod-github-runner-207 kernel: [43336.618633] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 17:26:02 juju-e4d256-prod-github-runner-207 kernel: [43336.619567] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 17:26:02 juju-e4d256-prod-github-runner-207 kernel: [43336.620502] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 17:26:02 juju-e4d256-prod-github-runner-207 kernel: [43336.621410] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 17:26:02 juju-e4d256-prod-github-runner-207 kernel: [43336.622352] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 17:26:02 juju-e4d256-prod-github-runner-207 kernel: [43336.623257] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 17:26:02 juju-e4d256-prod-github-runner-207 kernel: [43336.624153] Aug 22 17:26:30 juju-e4d256-prod-github-runner-207 kernel: [43364.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 40278s! [qemu-system-x86:6715] Aug 22 17:26:30 juju-e4d256-prod-github-runner-207 kernel: [43364.543717] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 17:26:30 juju-e4d256-prod-github-runner-207 kernel: [43364.543973] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 17:26:30 juju-e4d256-prod-github-runner-207 kernel: [43364.558188] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 17:26:30 juju-e4d256-prod-github-runner-207 kernel: [43364.559460] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 17:26:30 juju-e4d256-prod-github-runner-207 kernel: [43364.560690] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:26:30 juju-e4d256-prod-github-runner-207 kernel: [43364.561755] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 17:26:30 juju-e4d256-prod-github-runner-207 kernel: [43364.564331] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 17:26:30 juju-e4d256-prod-github-runner-207 kernel: [43364.565374] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 17:26:30 juju-e4d256-prod-github-runner-207 kernel: [43364.566536] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 17:26:30 juju-e4d256-prod-github-runner-207 kernel: [43364.567699] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 17:26:30 juju-e4d256-prod-github-runner-207 kernel: [43364.568871] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 17:26:30 juju-e4d256-prod-github-runner-207 kernel: [43364.570032] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 17:26:30 juju-e4d256-prod-github-runner-207 kernel: [43364.571198] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 17:26:30 juju-e4d256-prod-github-runner-207 kernel: [43364.572452] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 17:26:30 juju-e4d256-prod-github-runner-207 kernel: [43364.573557] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 17:26:30 juju-e4d256-prod-github-runner-207 kernel: [43364.574758] Call Trace: Aug 22 17:26:30 juju-e4d256-prod-github-runner-207 kernel: [43364.575668] Aug 22 17:26:30 juju-e4d256-prod-github-runner-207 kernel: [43364.576576] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:26:30 juju-e4d256-prod-github-runner-207 kernel: [43364.577609] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:26:30 juju-e4d256-prod-github-runner-207 kernel: [43364.578630] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:26:30 juju-e4d256-prod-github-runner-207 kernel: [43364.580132] ? show_regs.part.0+0x23/0x29 Aug 22 17:26:30 juju-e4d256-prod-github-runner-207 kernel: [43364.581218] ? show_regs.cold+0x8/0xd Aug 22 17:26:30 juju-e4d256-prod-github-runner-207 kernel: [43364.582197] ? watchdog_timer_fn+0x1be/0x220 Aug 22 17:26:30 juju-e4d256-prod-github-runner-207 kernel: [43364.583206] ? lockup_detector_update_enable+0x60/0x60 Aug 22 17:26:30 juju-e4d256-prod-github-runner-207 kernel: [43364.584618] ? __hrtimer_run_queues+0x107/0x230 Aug 22 17:26:30 juju-e4d256-prod-github-runner-207 kernel: [43364.585948] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 17:26:30 juju-e4d256-prod-github-runner-207 kernel: [43364.587284] ? hrtimer_interrupt+0x101/0x220 Aug 22 17:26:30 juju-e4d256-prod-github-runner-207 kernel: [43364.588647] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 17:26:30 juju-e4d256-prod-github-runner-207 kernel: [43364.590040] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 17:26:30 juju-e4d256-prod-github-runner-207 kernel: [43364.591369] Aug 22 17:26:30 juju-e4d256-prod-github-runner-207 kernel: [43364.592489] Aug 22 17:26:30 juju-e4d256-prod-github-runner-207 kernel: [43364.593340] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 17:26:30 juju-e4d256-prod-github-runner-207 kernel: [43364.594377] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:26:30 juju-e4d256-prod-github-runner-207 kernel: [43364.595417] ? _raw_spin_lock+0x22/0x30 Aug 22 17:26:30 juju-e4d256-prod-github-runner-207 kernel: [43364.596382] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:26:30 juju-e4d256-prod-github-runner-207 kernel: [43364.597404] direct_page_fault+0x206/0x310 [kvm] Aug 22 17:26:30 juju-e4d256-prod-github-runner-207 kernel: [43364.598432] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 17:26:30 juju-e4d256-prod-github-runner-207 kernel: [43364.599447] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 17:26:30 juju-e4d256-prod-github-runner-207 kernel: [43364.600464] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 17:26:30 juju-e4d256-prod-github-runner-207 kernel: [43364.601464] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 17:26:30 juju-e4d256-prod-github-runner-207 kernel: [43364.602416] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 17:26:30 juju-e4d256-prod-github-runner-207 kernel: [43364.603395] handle_exit+0x98/0x230 [kvm_amd] Aug 22 17:26:30 juju-e4d256-prod-github-runner-207 kernel: [43364.604311] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 17:26:30 juju-e4d256-prod-github-runner-207 kernel: [43364.605234] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 17:26:30 juju-e4d256-prod-github-runner-207 kernel: [43364.606276] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 17:26:30 juju-e4d256-prod-github-runner-207 kernel: [43364.607178] vcpu_run+0x62/0x2c0 [kvm] Aug 22 17:26:30 juju-e4d256-prod-github-runner-207 kernel: [43364.607993] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 17:26:30 juju-e4d256-prod-github-runner-207 kernel: [43364.608907] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 17:26:30 juju-e4d256-prod-github-runner-207 kernel: [43364.609764] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 17:26:30 juju-e4d256-prod-github-runner-207 kernel: [43364.610559] ? __seccomp_filter+0x4a/0x4a0 Aug 22 17:26:30 juju-e4d256-prod-github-runner-207 kernel: [43364.611300] ? __fget_files+0x86/0xc0 Aug 22 17:26:30 juju-e4d256-prod-github-runner-207 kernel: [43364.612007] __x64_sys_ioctl+0x95/0xd0 Aug 22 17:26:30 juju-e4d256-prod-github-runner-207 kernel: [43364.612715] do_syscall_64+0x5c/0xc0 Aug 22 17:26:30 juju-e4d256-prod-github-runner-207 kernel: [43364.613393] ? do_futex+0x162/0x1f0 Aug 22 17:26:30 juju-e4d256-prod-github-runner-207 kernel: [43364.614052] ? __x64_sys_futex+0x78/0x1e0 Aug 22 17:26:30 juju-e4d256-prod-github-runner-207 kernel: [43364.614724] ? __secure_computing+0xa9/0x120 Aug 22 17:26:30 juju-e4d256-prod-github-runner-207 kernel: [43364.615420] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 17:26:30 juju-e4d256-prod-github-runner-207 kernel: [43364.616194] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:26:30 juju-e4d256-prod-github-runner-207 kernel: [43364.616914] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:26:30 juju-e4d256-prod-github-runner-207 kernel: [43364.617629] ? do_syscall_64+0x69/0xc0 Aug 22 17:26:30 juju-e4d256-prod-github-runner-207 kernel: [43364.618277] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:26:30 juju-e4d256-prod-github-runner-207 kernel: [43364.618978] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:26:30 juju-e4d256-prod-github-runner-207 kernel: [43364.619672] ? do_syscall_64+0x69/0xc0 Aug 22 17:26:30 juju-e4d256-prod-github-runner-207 kernel: [43364.620303] ? do_syscall_64+0x69/0xc0 Aug 22 17:26:30 juju-e4d256-prod-github-runner-207 kernel: [43364.620926] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 17:26:30 juju-e4d256-prod-github-runner-207 kernel: [43364.621630] RIP: 0033:0x7faa5d0edaff Aug 22 17:26:30 juju-e4d256-prod-github-runner-207 kernel: [43364.622276] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 17:26:30 juju-e4d256-prod-github-runner-207 kernel: [43364.624272] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 17:26:30 juju-e4d256-prod-github-runner-207 kernel: [43364.625185] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 17:26:30 juju-e4d256-prod-github-runner-207 kernel: [43364.626073] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 17:26:30 juju-e4d256-prod-github-runner-207 kernel: [43364.626965] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 17:26:30 juju-e4d256-prod-github-runner-207 kernel: [43364.627851] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 17:26:30 juju-e4d256-prod-github-runner-207 kernel: [43364.628748] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 17:26:30 juju-e4d256-prod-github-runner-207 kernel: [43364.629639] Aug 22 17:26:46 juju-e4d256-prod-github-runner-207 kernel: [43380.080706] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 17:26:46 juju-e4d256-prod-github-runner-207 kernel: [43380.081688] rcu: 1-....: (10781825 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=5217853 Aug 22 17:26:46 juju-e4d256-prod-github-runner-207 kernel: [43380.082822] (t=10815720 jiffies g=23269 q=43372) Aug 22 17:26:46 juju-e4d256-prod-github-runner-207 kernel: [43380.083610] NMI backtrace for cpu 1 Aug 22 17:26:46 juju-e4d256-prod-github-runner-207 kernel: [43380.084334] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 17:26:46 juju-e4d256-prod-github-runner-207 kernel: [43380.085454] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 17:26:46 juju-e4d256-prod-github-runner-207 kernel: [43380.086522] Call Trace: Aug 22 17:26:46 juju-e4d256-prod-github-runner-207 kernel: [43380.087198] Aug 22 17:26:46 juju-e4d256-prod-github-runner-207 kernel: [43380.087845] show_stack+0x52/0x5c Aug 22 17:26:46 juju-e4d256-prod-github-runner-207 kernel: [43380.088579] dump_stack_lvl+0x4a/0x63 Aug 22 17:26:46 juju-e4d256-prod-github-runner-207 kernel: [43380.089330] dump_stack+0x10/0x16 Aug 22 17:26:46 juju-e4d256-prod-github-runner-207 kernel: [43380.090048] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 17:26:46 juju-e4d256-prod-github-runner-207 kernel: [43380.090834] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 17:26:46 juju-e4d256-prod-github-runner-207 kernel: [43380.091618] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 17:26:46 juju-e4d256-prod-github-runner-207 kernel: [43380.092456] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 17:26:46 juju-e4d256-prod-github-runner-207 kernel: [43380.093284] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 17:26:46 juju-e4d256-prod-github-runner-207 kernel: [43380.094099] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 17:26:46 juju-e4d256-prod-github-runner-207 kernel: [43380.094880] print_cpu_stall.cold+0x2f/0xe2 Aug 22 17:26:46 juju-e4d256-prod-github-runner-207 kernel: [43380.095653] ? timekeeping_update+0xf7/0x150 Aug 22 17:26:46 juju-e4d256-prod-github-runner-207 kernel: [43380.096437] check_cpu_stall+0x109/0x270 Aug 22 17:26:46 juju-e4d256-prod-github-runner-207 kernel: [43380.097192] rcu_sched_clock_irq+0x9a/0x250 Aug 22 17:26:46 juju-e4d256-prod-github-runner-207 kernel: [43380.097962] update_process_times+0x94/0xd0 Aug 22 17:26:46 juju-e4d256-prod-github-runner-207 kernel: [43380.098729] tick_sched_handle+0x29/0x70 Aug 22 17:26:46 juju-e4d256-prod-github-runner-207 kernel: [43380.099480] tick_sched_timer+0x8c/0xc0 Aug 22 17:26:46 juju-e4d256-prod-github-runner-207 kernel: [43380.100230] ? tick_nohz_handler+0xb0/0xb0 Aug 22 17:26:46 juju-e4d256-prod-github-runner-207 kernel: [43380.100996] __hrtimer_run_queues+0x107/0x230 Aug 22 17:26:46 juju-e4d256-prod-github-runner-207 kernel: [43380.101783] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 17:26:46 juju-e4d256-prod-github-runner-207 kernel: [43380.102571] hrtimer_interrupt+0x101/0x220 Aug 22 17:26:46 juju-e4d256-prod-github-runner-207 kernel: [43380.103340] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 17:26:46 juju-e4d256-prod-github-runner-207 kernel: [43380.104169] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 17:26:46 juju-e4d256-prod-github-runner-207 kernel: [43380.104989] Aug 22 17:26:46 juju-e4d256-prod-github-runner-207 kernel: [43380.105633] Aug 22 17:26:46 juju-e4d256-prod-github-runner-207 kernel: [43380.106277] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 17:26:46 juju-e4d256-prod-github-runner-207 kernel: [43380.107132] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:26:46 juju-e4d256-prod-github-runner-207 kernel: [43380.108062] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 17:26:46 juju-e4d256-prod-github-runner-207 kernel: [43380.110402] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 17:26:46 juju-e4d256-prod-github-runner-207 kernel: [43380.111313] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 17:26:46 juju-e4d256-prod-github-runner-207 kernel: [43380.112364] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 17:26:46 juju-e4d256-prod-github-runner-207 kernel: [43380.113383] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 17:26:46 juju-e4d256-prod-github-runner-207 kernel: [43380.114396] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 17:26:46 juju-e4d256-prod-github-runner-207 kernel: [43380.115399] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 17:26:46 juju-e4d256-prod-github-runner-207 kernel: [43380.116409] ? _raw_spin_lock+0x22/0x30 Aug 22 17:26:46 juju-e4d256-prod-github-runner-207 kernel: [43380.117200] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:26:46 juju-e4d256-prod-github-runner-207 kernel: [43380.118069] direct_page_fault+0x206/0x310 [kvm] Aug 22 17:26:46 juju-e4d256-prod-github-runner-207 kernel: [43380.118940] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 17:26:46 juju-e4d256-prod-github-runner-207 kernel: [43380.119799] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 17:26:46 juju-e4d256-prod-github-runner-207 kernel: [43380.120674] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 17:26:46 juju-e4d256-prod-github-runner-207 kernel: [43380.121586] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 17:26:46 juju-e4d256-prod-github-runner-207 kernel: [43380.122403] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 17:26:46 juju-e4d256-prod-github-runner-207 kernel: [43380.123269] handle_exit+0x98/0x230 [kvm_amd] Aug 22 17:26:46 juju-e4d256-prod-github-runner-207 kernel: [43380.124063] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 17:26:46 juju-e4d256-prod-github-runner-207 kernel: [43380.124873] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 17:26:46 juju-e4d256-prod-github-runner-207 kernel: [43380.125709] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 17:26:46 juju-e4d256-prod-github-runner-207 kernel: [43380.126523] vcpu_run+0x62/0x2c0 [kvm] Aug 22 17:26:46 juju-e4d256-prod-github-runner-207 kernel: [43380.127262] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 17:26:46 juju-e4d256-prod-github-runner-207 kernel: [43380.128031] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 17:26:46 juju-e4d256-prod-github-runner-207 kernel: [43380.128860] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 17:26:46 juju-e4d256-prod-github-runner-207 kernel: [43380.129647] ? __seccomp_filter+0x4a/0x4a0 Aug 22 17:26:46 juju-e4d256-prod-github-runner-207 kernel: [43380.130401] ? __fget_files+0x86/0xc0 Aug 22 17:26:46 juju-e4d256-prod-github-runner-207 kernel: [43380.131119] __x64_sys_ioctl+0x95/0xd0 Aug 22 17:26:46 juju-e4d256-prod-github-runner-207 kernel: [43380.131844] do_syscall_64+0x5c/0xc0 Aug 22 17:26:46 juju-e4d256-prod-github-runner-207 kernel: [43380.132548] ? do_futex+0x162/0x1f0 Aug 22 17:26:46 juju-e4d256-prod-github-runner-207 kernel: [43380.133239] ? __x64_sys_futex+0x78/0x1e0 Aug 22 17:26:46 juju-e4d256-prod-github-runner-207 kernel: [43380.133959] ? __secure_computing+0xa9/0x120 Aug 22 17:26:46 juju-e4d256-prod-github-runner-207 kernel: [43380.134707] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 17:26:46 juju-e4d256-prod-github-runner-207 kernel: [43380.135537] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:26:46 juju-e4d256-prod-github-runner-207 kernel: [43380.136339] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:26:46 juju-e4d256-prod-github-runner-207 kernel: [43380.137127] ? do_syscall_64+0x69/0xc0 Aug 22 17:26:46 juju-e4d256-prod-github-runner-207 kernel: [43380.137844] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:26:46 juju-e4d256-prod-github-runner-207 kernel: [43380.138635] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:26:46 juju-e4d256-prod-github-runner-207 kernel: [43380.139402] ? do_syscall_64+0x69/0xc0 Aug 22 17:26:46 juju-e4d256-prod-github-runner-207 kernel: [43380.140111] ? do_syscall_64+0x69/0xc0 Aug 22 17:26:46 juju-e4d256-prod-github-runner-207 kernel: [43380.140801] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 17:26:46 juju-e4d256-prod-github-runner-207 kernel: [43380.141571] RIP: 0033:0x7faa5d0edaff Aug 22 17:26:46 juju-e4d256-prod-github-runner-207 kernel: [43380.142274] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 17:26:46 juju-e4d256-prod-github-runner-207 kernel: [43380.144387] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 17:26:46 juju-e4d256-prod-github-runner-207 kernel: [43380.145354] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 17:26:46 juju-e4d256-prod-github-runner-207 kernel: [43380.146310] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 17:26:46 juju-e4d256-prod-github-runner-207 kernel: [43380.147275] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 17:26:46 juju-e4d256-prod-github-runner-207 kernel: [43380.148234] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 17:26:46 juju-e4d256-prod-github-runner-207 kernel: [43380.149165] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 17:26:46 juju-e4d256-prod-github-runner-207 kernel: [43380.150152] Aug 22 17:27:10 juju-e4d256-prod-github-runner-207 kernel: [43404.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 40315s! [qemu-system-x86:6715] Aug 22 17:27:10 juju-e4d256-prod-github-runner-207 kernel: [43404.543241] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 17:27:10 juju-e4d256-prod-github-runner-207 kernel: [43404.543314] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 17:27:10 juju-e4d256-prod-github-runner-207 kernel: [43404.555655] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 17:27:10 juju-e4d256-prod-github-runner-207 kernel: [43404.556920] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 17:27:10 juju-e4d256-prod-github-runner-207 kernel: [43404.558139] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:27:10 juju-e4d256-prod-github-runner-207 kernel: [43404.559197] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 17:27:10 juju-e4d256-prod-github-runner-207 kernel: [43404.563827] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 17:27:10 juju-e4d256-prod-github-runner-207 kernel: [43404.564883] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 17:27:10 juju-e4d256-prod-github-runner-207 kernel: [43404.566051] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 17:27:10 juju-e4d256-prod-github-runner-207 kernel: [43404.567213] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 17:27:10 juju-e4d256-prod-github-runner-207 kernel: [43404.568385] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 17:27:10 juju-e4d256-prod-github-runner-207 kernel: [43404.569550] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 17:27:10 juju-e4d256-prod-github-runner-207 kernel: [43404.570718] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 17:27:10 juju-e4d256-prod-github-runner-207 kernel: [43404.571982] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 17:27:10 juju-e4d256-prod-github-runner-207 kernel: [43404.573083] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 17:27:10 juju-e4d256-prod-github-runner-207 kernel: [43404.574382] Call Trace: Aug 22 17:27:10 juju-e4d256-prod-github-runner-207 kernel: [43404.575295] Aug 22 17:27:10 juju-e4d256-prod-github-runner-207 kernel: [43404.576207] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:27:10 juju-e4d256-prod-github-runner-207 kernel: [43404.577279] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:27:10 juju-e4d256-prod-github-runner-207 kernel: [43404.578305] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:27:10 juju-e4d256-prod-github-runner-207 kernel: [43404.579389] ? show_regs.part.0+0x23/0x29 Aug 22 17:27:10 juju-e4d256-prod-github-runner-207 kernel: [43404.580412] ? show_regs.cold+0x8/0xd Aug 22 17:27:10 juju-e4d256-prod-github-runner-207 kernel: [43404.581393] ? watchdog_timer_fn+0x1be/0x220 Aug 22 17:27:10 juju-e4d256-prod-github-runner-207 kernel: [43404.582428] ? lockup_detector_update_enable+0x60/0x60 Aug 22 17:27:10 juju-e4d256-prod-github-runner-207 kernel: [43404.583499] ? __hrtimer_run_queues+0x107/0x230 Aug 22 17:27:10 juju-e4d256-prod-github-runner-207 kernel: [43404.584543] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 17:27:10 juju-e4d256-prod-github-runner-207 kernel: [43404.585572] ? hrtimer_interrupt+0x101/0x220 Aug 22 17:27:10 juju-e4d256-prod-github-runner-207 kernel: [43404.586591] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 17:27:10 juju-e4d256-prod-github-runner-207 kernel: [43404.587690] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 17:27:10 juju-e4d256-prod-github-runner-207 kernel: [43404.588756] Aug 22 17:27:10 juju-e4d256-prod-github-runner-207 kernel: [43404.589616] Aug 22 17:27:10 juju-e4d256-prod-github-runner-207 kernel: [43404.590458] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 17:27:10 juju-e4d256-prod-github-runner-207 kernel: [43404.591502] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:27:10 juju-e4d256-prod-github-runner-207 kernel: [43404.592595] ? _raw_spin_lock+0x22/0x30 Aug 22 17:27:10 juju-e4d256-prod-github-runner-207 kernel: [43404.593570] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:27:10 juju-e4d256-prod-github-runner-207 kernel: [43404.594595] direct_page_fault+0x206/0x310 [kvm] Aug 22 17:27:10 juju-e4d256-prod-github-runner-207 kernel: [43404.595643] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 17:27:10 juju-e4d256-prod-github-runner-207 kernel: [43404.596653] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 17:27:10 juju-e4d256-prod-github-runner-207 kernel: [43404.597658] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 17:27:10 juju-e4d256-prod-github-runner-207 kernel: [43404.598629] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 17:27:10 juju-e4d256-prod-github-runner-207 kernel: [43404.599584] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 17:27:10 juju-e4d256-prod-github-runner-207 kernel: [43404.600575] handle_exit+0x98/0x230 [kvm_amd] Aug 22 17:27:10 juju-e4d256-prod-github-runner-207 kernel: [43404.601478] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 17:27:10 juju-e4d256-prod-github-runner-207 kernel: [43404.602409] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 17:27:10 juju-e4d256-prod-github-runner-207 kernel: [43404.603360] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 17:27:10 juju-e4d256-prod-github-runner-207 kernel: [43404.604277] vcpu_run+0x62/0x2c0 [kvm] Aug 22 17:27:10 juju-e4d256-prod-github-runner-207 kernel: [43404.605108] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 17:27:10 juju-e4d256-prod-github-runner-207 kernel: [43404.605923] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 17:27:10 juju-e4d256-prod-github-runner-207 kernel: [43404.606808] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 17:27:10 juju-e4d256-prod-github-runner-207 kernel: [43404.607618] ? __seccomp_filter+0x4a/0x4a0 Aug 22 17:27:10 juju-e4d256-prod-github-runner-207 kernel: [43404.608388] ? __fget_files+0x86/0xc0 Aug 22 17:27:10 juju-e4d256-prod-github-runner-207 kernel: [43404.609107] __x64_sys_ioctl+0x95/0xd0 Aug 22 17:27:10 juju-e4d256-prod-github-runner-207 kernel: [43404.609818] do_syscall_64+0x5c/0xc0 Aug 22 17:27:10 juju-e4d256-prod-github-runner-207 kernel: [43404.610505] ? do_futex+0x162/0x1f0 Aug 22 17:27:10 juju-e4d256-prod-github-runner-207 kernel: [43404.611170] ? __x64_sys_futex+0x78/0x1e0 Aug 22 17:27:10 juju-e4d256-prod-github-runner-207 kernel: [43404.611885] ? __secure_computing+0xa9/0x120 Aug 22 17:27:10 juju-e4d256-prod-github-runner-207 kernel: [43404.612601] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 17:27:10 juju-e4d256-prod-github-runner-207 kernel: [43404.613396] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:27:10 juju-e4d256-prod-github-runner-207 kernel: [43404.614119] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:27:10 juju-e4d256-prod-github-runner-207 kernel: [43404.614836] ? do_syscall_64+0x69/0xc0 Aug 22 17:27:10 juju-e4d256-prod-github-runner-207 kernel: [43404.615487] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:27:10 juju-e4d256-prod-github-runner-207 kernel: [43404.616217] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:27:10 juju-e4d256-prod-github-runner-207 kernel: [43404.616917] ? do_syscall_64+0x69/0xc0 Aug 22 17:27:10 juju-e4d256-prod-github-runner-207 kernel: [43404.617565] ? do_syscall_64+0x69/0xc0 Aug 22 17:27:10 juju-e4d256-prod-github-runner-207 kernel: [43404.618187] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 17:27:10 juju-e4d256-prod-github-runner-207 kernel: [43404.618892] RIP: 0033:0x7faa5d0edaff Aug 22 17:27:10 juju-e4d256-prod-github-runner-207 kernel: [43404.619521] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 17:27:10 juju-e4d256-prod-github-runner-207 kernel: [43404.621521] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 17:27:10 juju-e4d256-prod-github-runner-207 kernel: [43404.622438] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 17:27:10 juju-e4d256-prod-github-runner-207 kernel: [43404.623349] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 17:27:10 juju-e4d256-prod-github-runner-207 kernel: [43404.624258] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 17:27:10 juju-e4d256-prod-github-runner-207 kernel: [43404.625146] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 17:27:10 juju-e4d256-prod-github-runner-207 kernel: [43404.626046] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 17:27:10 juju-e4d256-prod-github-runner-207 kernel: [43404.626942] Aug 22 17:27:38 juju-e4d256-prod-github-runner-207 kernel: [43432.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 40341s! [qemu-system-x86:6715] Aug 22 17:27:38 juju-e4d256-prod-github-runner-207 kernel: [43432.543102] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 17:27:38 juju-e4d256-prod-github-runner-207 kernel: [43432.543172] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 17:27:38 juju-e4d256-prod-github-runner-207 kernel: [43432.555425] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 17:27:38 juju-e4d256-prod-github-runner-207 kernel: [43432.556696] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 17:27:38 juju-e4d256-prod-github-runner-207 kernel: [43432.557936] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:27:38 juju-e4d256-prod-github-runner-207 kernel: [43432.559131] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 17:27:38 juju-e4d256-prod-github-runner-207 kernel: [43432.561715] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 17:27:38 juju-e4d256-prod-github-runner-207 kernel: [43432.562777] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 17:27:38 juju-e4d256-prod-github-runner-207 kernel: [43432.563974] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 17:27:38 juju-e4d256-prod-github-runner-207 kernel: [43432.565181] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 17:27:38 juju-e4d256-prod-github-runner-207 kernel: [43432.566503] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 17:27:38 juju-e4d256-prod-github-runner-207 kernel: [43432.567695] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 17:27:38 juju-e4d256-prod-github-runner-207 kernel: [43432.568869] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 17:27:38 juju-e4d256-prod-github-runner-207 kernel: [43432.570123] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 17:27:38 juju-e4d256-prod-github-runner-207 kernel: [43432.571231] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 17:27:38 juju-e4d256-prod-github-runner-207 kernel: [43432.572465] Call Trace: Aug 22 17:27:38 juju-e4d256-prod-github-runner-207 kernel: [43432.573404] Aug 22 17:27:38 juju-e4d256-prod-github-runner-207 kernel: [43432.574292] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:27:38 juju-e4d256-prod-github-runner-207 kernel: [43432.575346] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:27:38 juju-e4d256-prod-github-runner-207 kernel: [43432.576370] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:27:38 juju-e4d256-prod-github-runner-207 kernel: [43432.577456] ? show_regs.part.0+0x23/0x29 Aug 22 17:27:38 juju-e4d256-prod-github-runner-207 kernel: [43432.578536] ? show_regs.cold+0x8/0xd Aug 22 17:27:38 juju-e4d256-prod-github-runner-207 kernel: [43432.579726] ? watchdog_timer_fn+0x1be/0x220 Aug 22 17:27:38 juju-e4d256-prod-github-runner-207 kernel: [43432.580792] ? lockup_detector_update_enable+0x60/0x60 Aug 22 17:27:38 juju-e4d256-prod-github-runner-207 kernel: [43432.581869] ? __hrtimer_run_queues+0x107/0x230 Aug 22 17:27:38 juju-e4d256-prod-github-runner-207 kernel: [43432.582903] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 17:27:38 juju-e4d256-prod-github-runner-207 kernel: [43432.583963] ? hrtimer_interrupt+0x101/0x220 Aug 22 17:27:38 juju-e4d256-prod-github-runner-207 kernel: [43432.584979] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 17:27:38 juju-e4d256-prod-github-runner-207 kernel: [43432.586044] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 17:27:38 juju-e4d256-prod-github-runner-207 kernel: [43432.587086] Aug 22 17:27:38 juju-e4d256-prod-github-runner-207 kernel: [43432.587964] Aug 22 17:27:38 juju-e4d256-prod-github-runner-207 kernel: [43432.588835] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 17:27:38 juju-e4d256-prod-github-runner-207 kernel: [43432.589873] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:27:38 juju-e4d256-prod-github-runner-207 kernel: [43432.590907] ? _raw_spin_lock+0x22/0x30 Aug 22 17:27:38 juju-e4d256-prod-github-runner-207 kernel: [43432.591894] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:27:38 juju-e4d256-prod-github-runner-207 kernel: [43432.592923] direct_page_fault+0x206/0x310 [kvm] Aug 22 17:27:38 juju-e4d256-prod-github-runner-207 kernel: [43432.593960] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 17:27:38 juju-e4d256-prod-github-runner-207 kernel: [43432.594976] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 17:27:38 juju-e4d256-prod-github-runner-207 kernel: [43432.596007] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 17:27:38 juju-e4d256-prod-github-runner-207 kernel: [43432.596991] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 17:27:38 juju-e4d256-prod-github-runner-207 kernel: [43432.597949] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 17:27:38 juju-e4d256-prod-github-runner-207 kernel: [43432.598950] handle_exit+0x98/0x230 [kvm_amd] Aug 22 17:27:38 juju-e4d256-prod-github-runner-207 kernel: [43432.599861] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 17:27:38 juju-e4d256-prod-github-runner-207 kernel: [43432.600779] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 17:27:38 juju-e4d256-prod-github-runner-207 kernel: [43432.601703] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 17:27:38 juju-e4d256-prod-github-runner-207 kernel: [43432.602625] vcpu_run+0x62/0x2c0 [kvm] Aug 22 17:27:38 juju-e4d256-prod-github-runner-207 kernel: [43432.603452] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 17:27:38 juju-e4d256-prod-github-runner-207 kernel: [43432.604280] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 17:27:38 juju-e4d256-prod-github-runner-207 kernel: [43432.605135] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 17:27:38 juju-e4d256-prod-github-runner-207 kernel: [43432.605936] ? __seccomp_filter+0x4a/0x4a0 Aug 22 17:27:38 juju-e4d256-prod-github-runner-207 kernel: [43432.606676] ? __fget_files+0x86/0xc0 Aug 22 17:27:38 juju-e4d256-prod-github-runner-207 kernel: [43432.607404] __x64_sys_ioctl+0x95/0xd0 Aug 22 17:27:38 juju-e4d256-prod-github-runner-207 kernel: [43432.608103] do_syscall_64+0x5c/0xc0 Aug 22 17:27:38 juju-e4d256-prod-github-runner-207 kernel: [43432.608773] ? do_futex+0x162/0x1f0 Aug 22 17:27:38 juju-e4d256-prod-github-runner-207 kernel: [43432.609511] ? __x64_sys_futex+0x78/0x1e0 Aug 22 17:27:38 juju-e4d256-prod-github-runner-207 kernel: [43432.610286] ? __secure_computing+0xa9/0x120 Aug 22 17:27:38 juju-e4d256-prod-github-runner-207 kernel: [43432.611000] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 17:27:38 juju-e4d256-prod-github-runner-207 kernel: [43432.611807] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:27:38 juju-e4d256-prod-github-runner-207 kernel: [43432.612561] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:27:38 juju-e4d256-prod-github-runner-207 kernel: [43432.613300] ? do_syscall_64+0x69/0xc0 Aug 22 17:27:38 juju-e4d256-prod-github-runner-207 kernel: [43432.613967] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:27:38 juju-e4d256-prod-github-runner-207 kernel: [43432.614679] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:27:38 juju-e4d256-prod-github-runner-207 kernel: [43432.615383] ? do_syscall_64+0x69/0xc0 Aug 22 17:27:38 juju-e4d256-prod-github-runner-207 kernel: [43432.616005] ? do_syscall_64+0x69/0xc0 Aug 22 17:27:38 juju-e4d256-prod-github-runner-207 kernel: [43432.616627] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 17:27:38 juju-e4d256-prod-github-runner-207 kernel: [43432.617333] RIP: 0033:0x7faa5d0edaff Aug 22 17:27:38 juju-e4d256-prod-github-runner-207 kernel: [43432.617957] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 17:27:38 juju-e4d256-prod-github-runner-207 kernel: [43432.619959] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 17:27:38 juju-e4d256-prod-github-runner-207 kernel: [43432.620874] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 17:27:38 juju-e4d256-prod-github-runner-207 kernel: [43432.621767] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 17:27:38 juju-e4d256-prod-github-runner-207 kernel: [43432.622656] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 17:27:38 juju-e4d256-prod-github-runner-207 kernel: [43432.623583] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 17:27:38 juju-e4d256-prod-github-runner-207 kernel: [43432.624486] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 17:27:38 juju-e4d256-prod-github-runner-207 kernel: [43432.625387] Aug 22 17:28:06 juju-e4d256-prod-github-runner-207 kernel: [43460.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 40367s! [qemu-system-x86:6715] Aug 22 17:28:06 juju-e4d256-prod-github-runner-207 kernel: [43460.543751] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 17:28:06 juju-e4d256-prod-github-runner-207 kernel: [43460.544013] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 17:28:06 juju-e4d256-prod-github-runner-207 kernel: [43460.556425] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 17:28:06 juju-e4d256-prod-github-runner-207 kernel: [43460.557696] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 17:28:06 juju-e4d256-prod-github-runner-207 kernel: [43460.558982] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:28:06 juju-e4d256-prod-github-runner-207 kernel: [43460.560072] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 17:28:06 juju-e4d256-prod-github-runner-207 kernel: [43460.562631] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 17:28:06 juju-e4d256-prod-github-runner-207 kernel: [43460.563687] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 17:28:06 juju-e4d256-prod-github-runner-207 kernel: [43460.564846] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 17:28:06 juju-e4d256-prod-github-runner-207 kernel: [43460.566011] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 17:28:06 juju-e4d256-prod-github-runner-207 kernel: [43460.567186] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 17:28:06 juju-e4d256-prod-github-runner-207 kernel: [43460.568348] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 17:28:06 juju-e4d256-prod-github-runner-207 kernel: [43460.569522] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 17:28:06 juju-e4d256-prod-github-runner-207 kernel: [43460.570768] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 17:28:06 juju-e4d256-prod-github-runner-207 kernel: [43460.571907] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 17:28:06 juju-e4d256-prod-github-runner-207 kernel: [43460.573107] Call Trace: Aug 22 17:28:06 juju-e4d256-prod-github-runner-207 kernel: [43460.574022] Aug 22 17:28:06 juju-e4d256-prod-github-runner-207 kernel: [43460.574934] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:28:06 juju-e4d256-prod-github-runner-207 kernel: [43460.575970] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:28:06 juju-e4d256-prod-github-runner-207 kernel: [43460.576989] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:28:06 juju-e4d256-prod-github-runner-207 kernel: [43460.578086] ? show_regs.part.0+0x23/0x29 Aug 22 17:28:06 juju-e4d256-prod-github-runner-207 kernel: [43460.579169] ? show_regs.cold+0x8/0xd Aug 22 17:28:06 juju-e4d256-prod-github-runner-207 kernel: [43460.580179] ? watchdog_timer_fn+0x1be/0x220 Aug 22 17:28:06 juju-e4d256-prod-github-runner-207 kernel: [43460.581206] ? lockup_detector_update_enable+0x60/0x60 Aug 22 17:28:06 juju-e4d256-prod-github-runner-207 kernel: [43460.582288] ? __hrtimer_run_queues+0x107/0x230 Aug 22 17:28:06 juju-e4d256-prod-github-runner-207 kernel: [43460.583346] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 17:28:06 juju-e4d256-prod-github-runner-207 kernel: [43460.584376] ? hrtimer_interrupt+0x101/0x220 Aug 22 17:28:06 juju-e4d256-prod-github-runner-207 kernel: [43460.585401] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 17:28:06 juju-e4d256-prod-github-runner-207 kernel: [43460.586469] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 17:28:06 juju-e4d256-prod-github-runner-207 kernel: [43460.587527] Aug 22 17:28:06 juju-e4d256-prod-github-runner-207 kernel: [43460.588384] Aug 22 17:28:06 juju-e4d256-prod-github-runner-207 kernel: [43460.589224] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 17:28:06 juju-e4d256-prod-github-runner-207 kernel: [43460.590260] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:28:06 juju-e4d256-prod-github-runner-207 kernel: [43460.591319] ? _raw_spin_lock+0x22/0x30 Aug 22 17:28:06 juju-e4d256-prod-github-runner-207 kernel: [43460.592282] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:28:06 juju-e4d256-prod-github-runner-207 kernel: [43460.593322] direct_page_fault+0x206/0x310 [kvm] Aug 22 17:28:06 juju-e4d256-prod-github-runner-207 kernel: [43460.594352] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 17:28:06 juju-e4d256-prod-github-runner-207 kernel: [43460.595381] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 17:28:06 juju-e4d256-prod-github-runner-207 kernel: [43460.596384] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 17:28:06 juju-e4d256-prod-github-runner-207 kernel: [43460.597392] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 17:28:06 juju-e4d256-prod-github-runner-207 kernel: [43460.598337] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 17:28:06 juju-e4d256-prod-github-runner-207 kernel: [43460.599330] handle_exit+0x98/0x230 [kvm_amd] Aug 22 17:28:06 juju-e4d256-prod-github-runner-207 kernel: [43460.600236] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 17:28:06 juju-e4d256-prod-github-runner-207 kernel: [43460.601160] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 17:28:06 juju-e4d256-prod-github-runner-207 kernel: [43460.602107] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 17:28:06 juju-e4d256-prod-github-runner-207 kernel: [43460.603036] vcpu_run+0x62/0x2c0 [kvm] Aug 22 17:28:06 juju-e4d256-prod-github-runner-207 kernel: [43460.603850] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 17:28:06 juju-e4d256-prod-github-runner-207 kernel: [43460.604664] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 17:28:06 juju-e4d256-prod-github-runner-207 kernel: [43460.605521] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 17:28:06 juju-e4d256-prod-github-runner-207 kernel: [43460.606319] ? __seccomp_filter+0x4a/0x4a0 Aug 22 17:28:06 juju-e4d256-prod-github-runner-207 kernel: [43460.607076] ? __fget_files+0x86/0xc0 Aug 22 17:28:06 juju-e4d256-prod-github-runner-207 kernel: [43460.607780] __x64_sys_ioctl+0x95/0xd0 Aug 22 17:28:06 juju-e4d256-prod-github-runner-207 kernel: [43460.608471] do_syscall_64+0x5c/0xc0 Aug 22 17:28:06 juju-e4d256-prod-github-runner-207 kernel: [43460.609279] ? do_futex+0x162/0x1f0 Aug 22 17:28:06 juju-e4d256-prod-github-runner-207 kernel: [43460.609952] ? __x64_sys_futex+0x78/0x1e0 Aug 22 17:28:06 juju-e4d256-prod-github-runner-207 kernel: [43460.610626] ? __secure_computing+0xa9/0x120 Aug 22 17:28:06 juju-e4d256-prod-github-runner-207 kernel: [43460.611331] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 17:28:06 juju-e4d256-prod-github-runner-207 kernel: [43460.612114] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:28:06 juju-e4d256-prod-github-runner-207 kernel: [43460.612847] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:28:06 juju-e4d256-prod-github-runner-207 kernel: [43460.613566] ? do_syscall_64+0x69/0xc0 Aug 22 17:28:06 juju-e4d256-prod-github-runner-207 kernel: [43460.614208] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:28:06 juju-e4d256-prod-github-runner-207 kernel: [43460.614911] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:28:06 juju-e4d256-prod-github-runner-207 kernel: [43460.615613] ? do_syscall_64+0x69/0xc0 Aug 22 17:28:06 juju-e4d256-prod-github-runner-207 kernel: [43460.616244] ? do_syscall_64+0x69/0xc0 Aug 22 17:28:06 juju-e4d256-prod-github-runner-207 kernel: [43460.616870] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 17:28:06 juju-e4d256-prod-github-runner-207 kernel: [43460.617577] RIP: 0033:0x7faa5d0edaff Aug 22 17:28:06 juju-e4d256-prod-github-runner-207 kernel: [43460.618224] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 17:28:06 juju-e4d256-prod-github-runner-207 kernel: [43460.620294] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 17:28:06 juju-e4d256-prod-github-runner-207 kernel: [43460.621209] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 17:28:06 juju-e4d256-prod-github-runner-207 kernel: [43460.622200] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 17:28:06 juju-e4d256-prod-github-runner-207 kernel: [43460.623118] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 17:28:06 juju-e4d256-prod-github-runner-207 kernel: [43460.624006] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 17:28:06 juju-e4d256-prod-github-runner-207 kernel: [43460.624895] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 17:28:06 juju-e4d256-prod-github-runner-207 kernel: [43460.625786] Aug 22 17:28:34 juju-e4d256-prod-github-runner-207 kernel: [43488.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 40393s! [qemu-system-x86:6715] Aug 22 17:28:34 juju-e4d256-prod-github-runner-207 kernel: [43488.543099] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 17:28:34 juju-e4d256-prod-github-runner-207 kernel: [43488.543167] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 17:28:34 juju-e4d256-prod-github-runner-207 kernel: [43488.555469] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 17:28:34 juju-e4d256-prod-github-runner-207 kernel: [43488.556758] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 17:28:34 juju-e4d256-prod-github-runner-207 kernel: [43488.557987] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:28:34 juju-e4d256-prod-github-runner-207 kernel: [43488.559058] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 17:28:34 juju-e4d256-prod-github-runner-207 kernel: [43488.561683] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 17:28:34 juju-e4d256-prod-github-runner-207 kernel: [43488.562764] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 17:28:34 juju-e4d256-prod-github-runner-207 kernel: [43488.563930] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 17:28:34 juju-e4d256-prod-github-runner-207 kernel: [43488.565094] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 17:28:34 juju-e4d256-prod-github-runner-207 kernel: [43488.566268] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 17:28:34 juju-e4d256-prod-github-runner-207 kernel: [43488.567464] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 17:28:34 juju-e4d256-prod-github-runner-207 kernel: [43488.568633] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 17:28:34 juju-e4d256-prod-github-runner-207 kernel: [43488.569866] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 17:28:34 juju-e4d256-prod-github-runner-207 kernel: [43488.570991] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 17:28:34 juju-e4d256-prod-github-runner-207 kernel: [43488.572227] Call Trace: Aug 22 17:28:34 juju-e4d256-prod-github-runner-207 kernel: [43488.573144] Aug 22 17:28:34 juju-e4d256-prod-github-runner-207 kernel: [43488.574028] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:28:34 juju-e4d256-prod-github-runner-207 kernel: [43488.575072] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:28:34 juju-e4d256-prod-github-runner-207 kernel: [43488.576099] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:28:34 juju-e4d256-prod-github-runner-207 kernel: [43488.577187] ? show_regs.part.0+0x23/0x29 Aug 22 17:28:34 juju-e4d256-prod-github-runner-207 kernel: [43488.578193] ? show_regs.cold+0x8/0xd Aug 22 17:28:34 juju-e4d256-prod-github-runner-207 kernel: [43488.579176] ? watchdog_timer_fn+0x1be/0x220 Aug 22 17:28:34 juju-e4d256-prod-github-runner-207 kernel: [43488.580191] ? lockup_detector_update_enable+0x60/0x60 Aug 22 17:28:34 juju-e4d256-prod-github-runner-207 kernel: [43488.581338] ? __hrtimer_run_queues+0x107/0x230 Aug 22 17:28:34 juju-e4d256-prod-github-runner-207 kernel: [43488.582394] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 17:28:34 juju-e4d256-prod-github-runner-207 kernel: [43488.583445] ? hrtimer_interrupt+0x101/0x220 Aug 22 17:28:34 juju-e4d256-prod-github-runner-207 kernel: [43488.584459] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 17:28:34 juju-e4d256-prod-github-runner-207 kernel: [43488.585528] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 17:28:34 juju-e4d256-prod-github-runner-207 kernel: [43488.586588] Aug 22 17:28:34 juju-e4d256-prod-github-runner-207 kernel: [43488.587460] Aug 22 17:28:34 juju-e4d256-prod-github-runner-207 kernel: [43488.588319] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 17:28:34 juju-e4d256-prod-github-runner-207 kernel: [43488.589365] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:28:34 juju-e4d256-prod-github-runner-207 kernel: [43488.590421] ? _raw_spin_lock+0x22/0x30 Aug 22 17:28:34 juju-e4d256-prod-github-runner-207 kernel: [43488.591397] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:28:34 juju-e4d256-prod-github-runner-207 kernel: [43488.592435] direct_page_fault+0x206/0x310 [kvm] Aug 22 17:28:34 juju-e4d256-prod-github-runner-207 kernel: [43488.593477] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 17:28:34 juju-e4d256-prod-github-runner-207 kernel: [43488.594494] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 17:28:34 juju-e4d256-prod-github-runner-207 kernel: [43488.595516] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 17:28:34 juju-e4d256-prod-github-runner-207 kernel: [43488.596490] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 17:28:34 juju-e4d256-prod-github-runner-207 kernel: [43488.597455] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 17:28:34 juju-e4d256-prod-github-runner-207 kernel: [43488.598450] handle_exit+0x98/0x230 [kvm_amd] Aug 22 17:28:34 juju-e4d256-prod-github-runner-207 kernel: [43488.599380] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 17:28:34 juju-e4d256-prod-github-runner-207 kernel: [43488.600299] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 17:28:34 juju-e4d256-prod-github-runner-207 kernel: [43488.601230] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 17:28:34 juju-e4d256-prod-github-runner-207 kernel: [43488.602151] vcpu_run+0x62/0x2c0 [kvm] Aug 22 17:28:34 juju-e4d256-prod-github-runner-207 kernel: [43488.602989] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 17:28:34 juju-e4d256-prod-github-runner-207 kernel: [43488.603812] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 17:28:34 juju-e4d256-prod-github-runner-207 kernel: [43488.604674] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 17:28:34 juju-e4d256-prod-github-runner-207 kernel: [43488.605481] ? __seccomp_filter+0x4a/0x4a0 Aug 22 17:28:34 juju-e4d256-prod-github-runner-207 kernel: [43488.606228] ? __fget_files+0x86/0xc0 Aug 22 17:28:34 juju-e4d256-prod-github-runner-207 kernel: [43488.606964] __x64_sys_ioctl+0x95/0xd0 Aug 22 17:28:34 juju-e4d256-prod-github-runner-207 kernel: [43488.607671] do_syscall_64+0x5c/0xc0 Aug 22 17:28:34 juju-e4d256-prod-github-runner-207 kernel: [43488.608348] ? do_futex+0x162/0x1f0 Aug 22 17:28:34 juju-e4d256-prod-github-runner-207 kernel: [43488.609003] ? __x64_sys_futex+0x78/0x1e0 Aug 22 17:28:34 juju-e4d256-prod-github-runner-207 kernel: [43488.609680] ? __secure_computing+0xa9/0x120 Aug 22 17:28:34 juju-e4d256-prod-github-runner-207 kernel: [43488.610373] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 17:28:34 juju-e4d256-prod-github-runner-207 kernel: [43488.611231] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:28:34 juju-e4d256-prod-github-runner-207 kernel: [43488.611964] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:28:34 juju-e4d256-prod-github-runner-207 kernel: [43488.612697] ? do_syscall_64+0x69/0xc0 Aug 22 17:28:34 juju-e4d256-prod-github-runner-207 kernel: [43488.613372] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:28:34 juju-e4d256-prod-github-runner-207 kernel: [43488.614084] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:28:34 juju-e4d256-prod-github-runner-207 kernel: [43488.614812] ? do_syscall_64+0x69/0xc0 Aug 22 17:28:34 juju-e4d256-prod-github-runner-207 kernel: [43488.615441] ? do_syscall_64+0x69/0xc0 Aug 22 17:28:34 juju-e4d256-prod-github-runner-207 kernel: [43488.616066] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 17:28:34 juju-e4d256-prod-github-runner-207 kernel: [43488.616780] RIP: 0033:0x7faa5d0edaff Aug 22 17:28:34 juju-e4d256-prod-github-runner-207 kernel: [43488.617426] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 17:28:34 juju-e4d256-prod-github-runner-207 kernel: [43488.619474] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 17:28:34 juju-e4d256-prod-github-runner-207 kernel: [43488.620407] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 17:28:34 juju-e4d256-prod-github-runner-207 kernel: [43488.621315] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 17:28:34 juju-e4d256-prod-github-runner-207 kernel: [43488.622219] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 17:28:34 juju-e4d256-prod-github-runner-207 kernel: [43488.623150] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 17:28:34 juju-e4d256-prod-github-runner-207 kernel: [43488.624061] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 17:28:34 juju-e4d256-prod-github-runner-207 kernel: [43488.624964] Aug 22 17:29:02 juju-e4d256-prod-github-runner-207 kernel: [43516.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 40419s! [qemu-system-x86:6715] Aug 22 17:29:02 juju-e4d256-prod-github-runner-207 kernel: [43516.543125] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 17:29:02 juju-e4d256-prod-github-runner-207 kernel: [43516.543193] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 17:29:02 juju-e4d256-prod-github-runner-207 kernel: [43516.555416] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 17:29:02 juju-e4d256-prod-github-runner-207 kernel: [43516.556682] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 17:29:02 juju-e4d256-prod-github-runner-207 kernel: [43516.558176] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:29:02 juju-e4d256-prod-github-runner-207 kernel: [43516.559262] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 17:29:02 juju-e4d256-prod-github-runner-207 kernel: [43516.561823] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 17:29:02 juju-e4d256-prod-github-runner-207 kernel: [43516.562903] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 17:29:02 juju-e4d256-prod-github-runner-207 kernel: [43516.564101] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 17:29:02 juju-e4d256-prod-github-runner-207 kernel: [43516.565281] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 17:29:02 juju-e4d256-prod-github-runner-207 kernel: [43516.566469] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 17:29:02 juju-e4d256-prod-github-runner-207 kernel: [43516.567639] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 17:29:02 juju-e4d256-prod-github-runner-207 kernel: [43516.568816] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 17:29:02 juju-e4d256-prod-github-runner-207 kernel: [43516.570078] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 17:29:02 juju-e4d256-prod-github-runner-207 kernel: [43516.571237] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 17:29:02 juju-e4d256-prod-github-runner-207 kernel: [43516.572443] Call Trace: Aug 22 17:29:02 juju-e4d256-prod-github-runner-207 kernel: [43516.573364] Aug 22 17:29:02 juju-e4d256-prod-github-runner-207 kernel: [43516.574250] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:29:02 juju-e4d256-prod-github-runner-207 kernel: [43516.575295] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:29:02 juju-e4d256-prod-github-runner-207 kernel: [43516.576341] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:29:02 juju-e4d256-prod-github-runner-207 kernel: [43516.577434] ? show_regs.part.0+0x23/0x29 Aug 22 17:29:02 juju-e4d256-prod-github-runner-207 kernel: [43516.578558] ? show_regs.cold+0x8/0xd Aug 22 17:29:02 juju-e4d256-prod-github-runner-207 kernel: [43516.579606] ? watchdog_timer_fn+0x1be/0x220 Aug 22 17:29:02 juju-e4d256-prod-github-runner-207 kernel: [43516.580638] ? lockup_detector_update_enable+0x60/0x60 Aug 22 17:29:02 juju-e4d256-prod-github-runner-207 kernel: [43516.581721] ? __hrtimer_run_queues+0x107/0x230 Aug 22 17:29:02 juju-e4d256-prod-github-runner-207 kernel: [43516.582798] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 17:29:02 juju-e4d256-prod-github-runner-207 kernel: [43516.583848] ? hrtimer_interrupt+0x101/0x220 Aug 22 17:29:02 juju-e4d256-prod-github-runner-207 kernel: [43516.585081] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 17:29:02 juju-e4d256-prod-github-runner-207 kernel: [43516.586153] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 17:29:02 juju-e4d256-prod-github-runner-207 kernel: [43516.587214] Aug 22 17:29:02 juju-e4d256-prod-github-runner-207 kernel: [43516.588071] Aug 22 17:29:02 juju-e4d256-prod-github-runner-207 kernel: [43516.588950] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 17:29:02 juju-e4d256-prod-github-runner-207 kernel: [43516.590021] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:29:02 juju-e4d256-prod-github-runner-207 kernel: [43516.591117] ? _raw_spin_lock+0x22/0x30 Aug 22 17:29:02 juju-e4d256-prod-github-runner-207 kernel: [43516.592130] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:29:02 juju-e4d256-prod-github-runner-207 kernel: [43516.593162] direct_page_fault+0x206/0x310 [kvm] Aug 22 17:29:02 juju-e4d256-prod-github-runner-207 kernel: [43516.594187] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 17:29:02 juju-e4d256-prod-github-runner-207 kernel: [43516.595230] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 17:29:02 juju-e4d256-prod-github-runner-207 kernel: [43516.596266] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 17:29:02 juju-e4d256-prod-github-runner-207 kernel: [43516.597235] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 17:29:02 juju-e4d256-prod-github-runner-207 kernel: [43516.598261] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 17:29:02 juju-e4d256-prod-github-runner-207 kernel: [43516.599286] handle_exit+0x98/0x230 [kvm_amd] Aug 22 17:29:02 juju-e4d256-prod-github-runner-207 kernel: [43516.600211] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 17:29:02 juju-e4d256-prod-github-runner-207 kernel: [43516.601138] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 17:29:02 juju-e4d256-prod-github-runner-207 kernel: [43516.602127] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 17:29:02 juju-e4d256-prod-github-runner-207 kernel: [43516.603403] vcpu_run+0x62/0x2c0 [kvm] Aug 22 17:29:02 juju-e4d256-prod-github-runner-207 kernel: [43516.604511] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 17:29:02 juju-e4d256-prod-github-runner-207 kernel: [43516.605330] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 17:29:02 juju-e4d256-prod-github-runner-207 kernel: [43516.606188] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 17:29:02 juju-e4d256-prod-github-runner-207 kernel: [43516.607008] ? __seccomp_filter+0x4a/0x4a0 Aug 22 17:29:02 juju-e4d256-prod-github-runner-207 kernel: [43516.607753] ? __fget_files+0x86/0xc0 Aug 22 17:29:02 juju-e4d256-prod-github-runner-207 kernel: [43516.608460] __x64_sys_ioctl+0x95/0xd0 Aug 22 17:29:02 juju-e4d256-prod-github-runner-207 kernel: [43516.609156] do_syscall_64+0x5c/0xc0 Aug 22 17:29:02 juju-e4d256-prod-github-runner-207 kernel: [43516.609828] ? do_futex+0x162/0x1f0 Aug 22 17:29:02 juju-e4d256-prod-github-runner-207 kernel: [43516.610502] ? __x64_sys_futex+0x78/0x1e0 Aug 22 17:29:02 juju-e4d256-prod-github-runner-207 kernel: [43516.611188] ? __secure_computing+0xa9/0x120 Aug 22 17:29:02 juju-e4d256-prod-github-runner-207 kernel: [43516.611883] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 17:29:02 juju-e4d256-prod-github-runner-207 kernel: [43516.612647] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:29:02 juju-e4d256-prod-github-runner-207 kernel: [43516.613379] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:29:02 juju-e4d256-prod-github-runner-207 kernel: [43516.614132] ? do_syscall_64+0x69/0xc0 Aug 22 17:29:02 juju-e4d256-prod-github-runner-207 kernel: [43516.614804] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:29:02 juju-e4d256-prod-github-runner-207 kernel: [43516.615545] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:29:02 juju-e4d256-prod-github-runner-207 kernel: [43516.616560] ? do_syscall_64+0x69/0xc0 Aug 22 17:29:02 juju-e4d256-prod-github-runner-207 kernel: [43516.617222] ? do_syscall_64+0x69/0xc0 Aug 22 17:29:02 juju-e4d256-prod-github-runner-207 kernel: [43516.617866] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 17:29:02 juju-e4d256-prod-github-runner-207 kernel: [43516.618675] RIP: 0033:0x7faa5d0edaff Aug 22 17:29:02 juju-e4d256-prod-github-runner-207 kernel: [43516.619313] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 17:29:02 juju-e4d256-prod-github-runner-207 kernel: [43516.621557] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 17:29:02 juju-e4d256-prod-github-runner-207 kernel: [43516.622520] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 17:29:02 juju-e4d256-prod-github-runner-207 kernel: [43516.623466] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 17:29:02 juju-e4d256-prod-github-runner-207 kernel: [43516.624528] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 17:29:02 juju-e4d256-prod-github-runner-207 kernel: [43516.625439] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 17:29:02 juju-e4d256-prod-github-runner-207 kernel: [43516.626344] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 17:29:02 juju-e4d256-prod-github-runner-207 kernel: [43516.627338] Aug 22 17:29:30 juju-e4d256-prod-github-runner-207 kernel: [43544.542105] watchdog: BUG: soft lockup - CPU#1 stuck for 40446s! [qemu-system-x86:6715] Aug 22 17:29:30 juju-e4d256-prod-github-runner-207 kernel: [43544.543303] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 17:29:30 juju-e4d256-prod-github-runner-207 kernel: [43544.543507] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 17:29:30 juju-e4d256-prod-github-runner-207 kernel: [43544.555560] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 17:29:30 juju-e4d256-prod-github-runner-207 kernel: [43544.556840] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 17:29:30 juju-e4d256-prod-github-runner-207 kernel: [43544.558079] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:29:30 juju-e4d256-prod-github-runner-207 kernel: [43544.559139] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 17:29:30 juju-e4d256-prod-github-runner-207 kernel: [43544.561690] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 17:29:30 juju-e4d256-prod-github-runner-207 kernel: [43544.562747] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 17:29:30 juju-e4d256-prod-github-runner-207 kernel: [43544.563914] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 17:29:30 juju-e4d256-prod-github-runner-207 kernel: [43544.565077] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 17:29:30 juju-e4d256-prod-github-runner-207 kernel: [43544.566258] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 17:29:30 juju-e4d256-prod-github-runner-207 kernel: [43544.567424] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 17:29:30 juju-e4d256-prod-github-runner-207 kernel: [43544.568588] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 17:29:30 juju-e4d256-prod-github-runner-207 kernel: [43544.569829] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 17:29:30 juju-e4d256-prod-github-runner-207 kernel: [43544.570946] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 17:29:30 juju-e4d256-prod-github-runner-207 kernel: [43544.572159] Call Trace: Aug 22 17:29:30 juju-e4d256-prod-github-runner-207 kernel: [43544.573075] Aug 22 17:29:30 juju-e4d256-prod-github-runner-207 kernel: [43544.573977] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:29:30 juju-e4d256-prod-github-runner-207 kernel: [43544.575006] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:29:30 juju-e4d256-prod-github-runner-207 kernel: [43544.576025] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:29:30 juju-e4d256-prod-github-runner-207 kernel: [43544.577119] ? show_regs.part.0+0x23/0x29 Aug 22 17:29:30 juju-e4d256-prod-github-runner-207 kernel: [43544.578125] ? show_regs.cold+0x8/0xd Aug 22 17:29:30 juju-e4d256-prod-github-runner-207 kernel: [43544.579095] ? watchdog_timer_fn+0x1be/0x220 Aug 22 17:29:30 juju-e4d256-prod-github-runner-207 kernel: [43544.580107] ? lockup_detector_update_enable+0x60/0x60 Aug 22 17:29:30 juju-e4d256-prod-github-runner-207 kernel: [43544.581168] ? __hrtimer_run_queues+0x107/0x230 Aug 22 17:29:30 juju-e4d256-prod-github-runner-207 kernel: [43544.582208] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 17:29:30 juju-e4d256-prod-github-runner-207 kernel: [43544.583247] ? hrtimer_interrupt+0x101/0x220 Aug 22 17:29:30 juju-e4d256-prod-github-runner-207 kernel: [43544.584279] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 17:29:30 juju-e4d256-prod-github-runner-207 kernel: [43544.585346] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 17:29:30 juju-e4d256-prod-github-runner-207 kernel: [43544.586419] Aug 22 17:29:30 juju-e4d256-prod-github-runner-207 kernel: [43544.587276] Aug 22 17:29:30 juju-e4d256-prod-github-runner-207 kernel: [43544.588113] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 17:29:30 juju-e4d256-prod-github-runner-207 kernel: [43544.589143] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:29:30 juju-e4d256-prod-github-runner-207 kernel: [43544.590203] ? _raw_spin_lock+0x22/0x30 Aug 22 17:29:30 juju-e4d256-prod-github-runner-207 kernel: [43544.591147] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:29:30 juju-e4d256-prod-github-runner-207 kernel: [43544.592166] direct_page_fault+0x206/0x310 [kvm] Aug 22 17:29:30 juju-e4d256-prod-github-runner-207 kernel: [43544.593192] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 17:29:30 juju-e4d256-prod-github-runner-207 kernel: [43544.594211] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 17:29:30 juju-e4d256-prod-github-runner-207 kernel: [43544.595209] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 17:29:30 juju-e4d256-prod-github-runner-207 kernel: [43544.596196] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 17:29:30 juju-e4d256-prod-github-runner-207 kernel: [43544.597144] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 17:29:30 juju-e4d256-prod-github-runner-207 kernel: [43544.598137] handle_exit+0x98/0x230 [kvm_amd] Aug 22 17:29:30 juju-e4d256-prod-github-runner-207 kernel: [43544.599028] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 17:29:30 juju-e4d256-prod-github-runner-207 kernel: [43544.599938] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 17:29:30 juju-e4d256-prod-github-runner-207 kernel: [43544.600862] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 17:29:30 juju-e4d256-prod-github-runner-207 kernel: [43544.601789] vcpu_run+0x62/0x2c0 [kvm] Aug 22 17:29:30 juju-e4d256-prod-github-runner-207 kernel: [43544.602623] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 17:29:30 juju-e4d256-prod-github-runner-207 kernel: [43544.603436] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 17:29:30 juju-e4d256-prod-github-runner-207 kernel: [43544.604304] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 17:29:30 juju-e4d256-prod-github-runner-207 kernel: [43544.605109] ? __seccomp_filter+0x4a/0x4a0 Aug 22 17:29:30 juju-e4d256-prod-github-runner-207 kernel: [43544.605848] ? __fget_files+0x86/0xc0 Aug 22 17:29:30 juju-e4d256-prod-github-runner-207 kernel: [43544.606569] __x64_sys_ioctl+0x95/0xd0 Aug 22 17:29:30 juju-e4d256-prod-github-runner-207 kernel: [43544.607264] do_syscall_64+0x5c/0xc0 Aug 22 17:29:30 juju-e4d256-prod-github-runner-207 kernel: [43544.607927] ? do_futex+0x162/0x1f0 Aug 22 17:29:30 juju-e4d256-prod-github-runner-207 kernel: [43544.608572] ? __x64_sys_futex+0x78/0x1e0 Aug 22 17:29:30 juju-e4d256-prod-github-runner-207 kernel: [43544.609250] ? __secure_computing+0xa9/0x120 Aug 22 17:29:30 juju-e4d256-prod-github-runner-207 kernel: [43544.609940] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 17:29:30 juju-e4d256-prod-github-runner-207 kernel: [43544.610712] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:29:30 juju-e4d256-prod-github-runner-207 kernel: [43544.611436] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:29:30 juju-e4d256-prod-github-runner-207 kernel: [43544.612157] ? do_syscall_64+0x69/0xc0 Aug 22 17:29:30 juju-e4d256-prod-github-runner-207 kernel: [43544.612800] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:29:30 juju-e4d256-prod-github-runner-207 kernel: [43544.613499] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:29:30 juju-e4d256-prod-github-runner-207 kernel: [43544.614318] ? do_syscall_64+0x69/0xc0 Aug 22 17:29:30 juju-e4d256-prod-github-runner-207 kernel: [43544.614957] ? do_syscall_64+0x69/0xc0 Aug 22 17:29:30 juju-e4d256-prod-github-runner-207 kernel: [43544.615579] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 17:29:30 juju-e4d256-prod-github-runner-207 kernel: [43544.616285] RIP: 0033:0x7faa5d0edaff Aug 22 17:29:30 juju-e4d256-prod-github-runner-207 kernel: [43544.616931] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 17:29:30 juju-e4d256-prod-github-runner-207 kernel: [43544.618941] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 17:29:30 juju-e4d256-prod-github-runner-207 kernel: [43544.619858] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 17:29:30 juju-e4d256-prod-github-runner-207 kernel: [43544.620748] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 17:29:30 juju-e4d256-prod-github-runner-207 kernel: [43544.621642] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 17:29:30 juju-e4d256-prod-github-runner-207 kernel: [43544.622546] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 17:29:30 juju-e4d256-prod-github-runner-207 kernel: [43544.623435] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 17:29:30 juju-e4d256-prod-github-runner-207 kernel: [43544.624326] Aug 22 17:29:46 juju-e4d256-prod-github-runner-207 kernel: [43560.092705] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 17:29:46 juju-e4d256-prod-github-runner-207 kernel: [43560.094273] rcu: 1-....: (10826692 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=5239674 Aug 22 17:29:46 juju-e4d256-prod-github-runner-207 kernel: [43560.095401] (t=10860723 jiffies g=23269 q=43496) Aug 22 17:29:46 juju-e4d256-prod-github-runner-207 kernel: [43560.096187] NMI backtrace for cpu 1 Aug 22 17:29:46 juju-e4d256-prod-github-runner-207 kernel: [43560.096897] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 17:29:46 juju-e4d256-prod-github-runner-207 kernel: [43560.098019] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 17:29:46 juju-e4d256-prod-github-runner-207 kernel: [43560.099086] Call Trace: Aug 22 17:29:46 juju-e4d256-prod-github-runner-207 kernel: [43560.099763] Aug 22 17:29:46 juju-e4d256-prod-github-runner-207 kernel: [43560.100417] show_stack+0x52/0x5c Aug 22 17:29:46 juju-e4d256-prod-github-runner-207 kernel: [43560.101141] dump_stack_lvl+0x4a/0x63 Aug 22 17:29:46 juju-e4d256-prod-github-runner-207 kernel: [43560.101898] dump_stack+0x10/0x16 Aug 22 17:29:46 juju-e4d256-prod-github-runner-207 kernel: [43560.102615] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 17:29:46 juju-e4d256-prod-github-runner-207 kernel: [43560.103394] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 17:29:46 juju-e4d256-prod-github-runner-207 kernel: [43560.104199] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 17:29:46 juju-e4d256-prod-github-runner-207 kernel: [43560.105033] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 17:29:46 juju-e4d256-prod-github-runner-207 kernel: [43560.105864] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 17:29:46 juju-e4d256-prod-github-runner-207 kernel: [43560.106674] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 17:29:46 juju-e4d256-prod-github-runner-207 kernel: [43560.107446] print_cpu_stall.cold+0x2f/0xe2 Aug 22 17:29:46 juju-e4d256-prod-github-runner-207 kernel: [43560.108209] ? timekeeping_update+0xf7/0x150 Aug 22 17:29:46 juju-e4d256-prod-github-runner-207 kernel: [43560.108985] check_cpu_stall+0x109/0x270 Aug 22 17:29:46 juju-e4d256-prod-github-runner-207 kernel: [43560.109731] rcu_sched_clock_irq+0x9a/0x250 Aug 22 17:29:46 juju-e4d256-prod-github-runner-207 kernel: [43560.110507] update_process_times+0x94/0xd0 Aug 22 17:29:46 juju-e4d256-prod-github-runner-207 kernel: [43560.111267] tick_sched_handle+0x29/0x70 Aug 22 17:29:46 juju-e4d256-prod-github-runner-207 kernel: [43560.112016] tick_sched_timer+0x8c/0xc0 Aug 22 17:29:46 juju-e4d256-prod-github-runner-207 kernel: [43560.112756] ? tick_nohz_handler+0xb0/0xb0 Aug 22 17:29:46 juju-e4d256-prod-github-runner-207 kernel: [43560.113509] __hrtimer_run_queues+0x107/0x230 Aug 22 17:29:46 juju-e4d256-prod-github-runner-207 kernel: [43560.114289] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 17:29:46 juju-e4d256-prod-github-runner-207 kernel: [43560.115071] hrtimer_interrupt+0x101/0x220 Aug 22 17:29:46 juju-e4d256-prod-github-runner-207 kernel: [43560.115828] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 17:29:46 juju-e4d256-prod-github-runner-207 kernel: [43560.116639] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 17:29:46 juju-e4d256-prod-github-runner-207 kernel: [43560.117440] Aug 22 17:29:46 juju-e4d256-prod-github-runner-207 kernel: [43560.118085] Aug 22 17:29:46 juju-e4d256-prod-github-runner-207 kernel: [43560.118713] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 17:29:46 juju-e4d256-prod-github-runner-207 kernel: [43560.119532] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:29:46 juju-e4d256-prod-github-runner-207 kernel: [43560.120429] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 17:29:46 juju-e4d256-prod-github-runner-207 kernel: [43560.122675] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 17:29:46 juju-e4d256-prod-github-runner-207 kernel: [43560.123598] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 17:29:46 juju-e4d256-prod-github-runner-207 kernel: [43560.124600] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 17:29:46 juju-e4d256-prod-github-runner-207 kernel: [43560.125586] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 17:29:46 juju-e4d256-prod-github-runner-207 kernel: [43560.126580] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 17:29:46 juju-e4d256-prod-github-runner-207 kernel: [43560.127698] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 17:29:46 juju-e4d256-prod-github-runner-207 kernel: [43560.128647] ? _raw_spin_lock+0x22/0x30 Aug 22 17:29:46 juju-e4d256-prod-github-runner-207 kernel: [43560.129406] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:29:46 juju-e4d256-prod-github-runner-207 kernel: [43560.130250] direct_page_fault+0x206/0x310 [kvm] Aug 22 17:29:46 juju-e4d256-prod-github-runner-207 kernel: [43560.131091] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 17:29:46 juju-e4d256-prod-github-runner-207 kernel: [43560.131922] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 17:29:46 juju-e4d256-prod-github-runner-207 kernel: [43560.132740] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 17:29:46 juju-e4d256-prod-github-runner-207 kernel: [43560.133554] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 17:29:46 juju-e4d256-prod-github-runner-207 kernel: [43560.134347] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 17:29:46 juju-e4d256-prod-github-runner-207 kernel: [43560.135170] handle_exit+0x98/0x230 [kvm_amd] Aug 22 17:29:46 juju-e4d256-prod-github-runner-207 kernel: [43560.135932] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 17:29:46 juju-e4d256-prod-github-runner-207 kernel: [43560.136715] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 17:29:46 juju-e4d256-prod-github-runner-207 kernel: [43560.137516] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 17:29:46 juju-e4d256-prod-github-runner-207 kernel: [43560.138311] vcpu_run+0x62/0x2c0 [kvm] Aug 22 17:29:46 juju-e4d256-prod-github-runner-207 kernel: [43560.139029] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 17:29:46 juju-e4d256-prod-github-runner-207 kernel: [43560.139779] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 17:29:46 juju-e4d256-prod-github-runner-207 kernel: [43560.140620] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 17:29:46 juju-e4d256-prod-github-runner-207 kernel: [43560.141390] ? __seccomp_filter+0x4a/0x4a0 Aug 22 17:29:46 juju-e4d256-prod-github-runner-207 kernel: [43560.142125] ? __fget_files+0x86/0xc0 Aug 22 17:29:46 juju-e4d256-prod-github-runner-207 kernel: [43560.142816] __x64_sys_ioctl+0x95/0xd0 Aug 22 17:29:46 juju-e4d256-prod-github-runner-207 kernel: [43560.143509] do_syscall_64+0x5c/0xc0 Aug 22 17:29:46 juju-e4d256-prod-github-runner-207 kernel: [43560.144194] ? do_futex+0x162/0x1f0 Aug 22 17:29:46 juju-e4d256-prod-github-runner-207 kernel: [43560.144864] ? __x64_sys_futex+0x78/0x1e0 Aug 22 17:29:46 juju-e4d256-prod-github-runner-207 kernel: [43560.145564] ? __secure_computing+0xa9/0x120 Aug 22 17:29:46 juju-e4d256-prod-github-runner-207 kernel: [43560.146297] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 17:29:46 juju-e4d256-prod-github-runner-207 kernel: [43560.147093] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:29:46 juju-e4d256-prod-github-runner-207 kernel: [43560.147853] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:29:46 juju-e4d256-prod-github-runner-207 kernel: [43560.148605] ? do_syscall_64+0x69/0xc0 Aug 22 17:29:46 juju-e4d256-prod-github-runner-207 kernel: [43560.149291] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:29:46 juju-e4d256-prod-github-runner-207 kernel: [43560.150061] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:29:46 juju-e4d256-prod-github-runner-207 kernel: [43560.150816] ? do_syscall_64+0x69/0xc0 Aug 22 17:29:46 juju-e4d256-prod-github-runner-207 kernel: [43560.151512] ? do_syscall_64+0x69/0xc0 Aug 22 17:29:46 juju-e4d256-prod-github-runner-207 kernel: [43560.152197] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 17:29:46 juju-e4d256-prod-github-runner-207 kernel: [43560.152969] RIP: 0033:0x7faa5d0edaff Aug 22 17:29:46 juju-e4d256-prod-github-runner-207 kernel: [43560.153650] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 17:29:46 juju-e4d256-prod-github-runner-207 kernel: [43560.155764] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 17:29:46 juju-e4d256-prod-github-runner-207 kernel: [43560.156729] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 17:29:46 juju-e4d256-prod-github-runner-207 kernel: [43560.157693] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 17:29:46 juju-e4d256-prod-github-runner-207 kernel: [43560.158657] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 17:29:46 juju-e4d256-prod-github-runner-207 kernel: [43560.159595] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 17:29:46 juju-e4d256-prod-github-runner-207 kernel: [43560.160516] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 17:29:46 juju-e4d256-prod-github-runner-207 kernel: [43560.161427] Aug 22 17:30:10 juju-e4d256-prod-github-runner-207 kernel: [43584.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 40483s! [qemu-system-x86:6715] Aug 22 17:30:10 juju-e4d256-prod-github-runner-207 kernel: [43584.543149] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 17:30:10 juju-e4d256-prod-github-runner-207 kernel: [43584.543365] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 17:30:10 juju-e4d256-prod-github-runner-207 kernel: [43584.556036] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 17:30:10 juju-e4d256-prod-github-runner-207 kernel: [43584.557295] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 17:30:10 juju-e4d256-prod-github-runner-207 kernel: [43584.558532] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:30:10 juju-e4d256-prod-github-runner-207 kernel: [43584.559587] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 17:30:10 juju-e4d256-prod-github-runner-207 kernel: [43584.562161] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 17:30:10 juju-e4d256-prod-github-runner-207 kernel: [43584.563218] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 17:30:10 juju-e4d256-prod-github-runner-207 kernel: [43584.564389] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 17:30:10 juju-e4d256-prod-github-runner-207 kernel: [43584.565569] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 17:30:10 juju-e4d256-prod-github-runner-207 kernel: [43584.566733] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 17:30:10 juju-e4d256-prod-github-runner-207 kernel: [43584.567899] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 17:30:10 juju-e4d256-prod-github-runner-207 kernel: [43584.569065] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 17:30:10 juju-e4d256-prod-github-runner-207 kernel: [43584.570327] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 17:30:10 juju-e4d256-prod-github-runner-207 kernel: [43584.571428] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 17:30:10 juju-e4d256-prod-github-runner-207 kernel: [43584.572645] Call Trace: Aug 22 17:30:10 juju-e4d256-prod-github-runner-207 kernel: [43584.573577] Aug 22 17:30:10 juju-e4d256-prod-github-runner-207 kernel: [43584.574467] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:30:10 juju-e4d256-prod-github-runner-207 kernel: [43584.575501] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:30:10 juju-e4d256-prod-github-runner-207 kernel: [43584.576525] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:30:10 juju-e4d256-prod-github-runner-207 kernel: [43584.577618] ? show_regs.part.0+0x23/0x29 Aug 22 17:30:10 juju-e4d256-prod-github-runner-207 kernel: [43584.578634] ? show_regs.cold+0x8/0xd Aug 22 17:30:10 juju-e4d256-prod-github-runner-207 kernel: [43584.579605] ? watchdog_timer_fn+0x1be/0x220 Aug 22 17:30:10 juju-e4d256-prod-github-runner-207 kernel: [43584.580615] ? lockup_detector_update_enable+0x60/0x60 Aug 22 17:30:10 juju-e4d256-prod-github-runner-207 kernel: [43584.581688] ? __hrtimer_run_queues+0x107/0x230 Aug 22 17:30:10 juju-e4d256-prod-github-runner-207 kernel: [43584.582750] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 17:30:10 juju-e4d256-prod-github-runner-207 kernel: [43584.583782] ? hrtimer_interrupt+0x101/0x220 Aug 22 17:30:10 juju-e4d256-prod-github-runner-207 kernel: [43584.584797] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 17:30:10 juju-e4d256-prod-github-runner-207 kernel: [43584.585884] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 17:30:10 juju-e4d256-prod-github-runner-207 kernel: [43584.586934] Aug 22 17:30:10 juju-e4d256-prod-github-runner-207 kernel: [43584.587787] Aug 22 17:30:10 juju-e4d256-prod-github-runner-207 kernel: [43584.588624] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 17:30:10 juju-e4d256-prod-github-runner-207 kernel: [43584.589666] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:30:10 juju-e4d256-prod-github-runner-207 kernel: [43584.590848] ? _raw_spin_lock+0x22/0x30 Aug 22 17:30:10 juju-e4d256-prod-github-runner-207 kernel: [43584.591877] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:30:10 juju-e4d256-prod-github-runner-207 kernel: [43584.593108] direct_page_fault+0x206/0x310 [kvm] Aug 22 17:30:10 juju-e4d256-prod-github-runner-207 kernel: [43584.594570] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 17:30:10 juju-e4d256-prod-github-runner-207 kernel: [43584.596048] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 17:30:10 juju-e4d256-prod-github-runner-207 kernel: [43584.597059] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 17:30:10 juju-e4d256-prod-github-runner-207 kernel: [43584.598050] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 17:30:10 juju-e4d256-prod-github-runner-207 kernel: [43584.599000] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 17:30:10 juju-e4d256-prod-github-runner-207 kernel: [43584.599974] handle_exit+0x98/0x230 [kvm_amd] Aug 22 17:30:10 juju-e4d256-prod-github-runner-207 kernel: [43584.600869] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 17:30:10 juju-e4d256-prod-github-runner-207 kernel: [43584.601799] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 17:30:10 juju-e4d256-prod-github-runner-207 kernel: [43584.602752] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 17:30:10 juju-e4d256-prod-github-runner-207 kernel: [43584.603689] vcpu_run+0x62/0x2c0 [kvm] Aug 22 17:30:10 juju-e4d256-prod-github-runner-207 kernel: [43584.604505] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 17:30:10 juju-e4d256-prod-github-runner-207 kernel: [43584.605318] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 17:30:10 juju-e4d256-prod-github-runner-207 kernel: [43584.606201] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 17:30:10 juju-e4d256-prod-github-runner-207 kernel: [43584.607000] ? __seccomp_filter+0x4a/0x4a0 Aug 22 17:30:10 juju-e4d256-prod-github-runner-207 kernel: [43584.607744] ? __fget_files+0x86/0xc0 Aug 22 17:30:10 juju-e4d256-prod-github-runner-207 kernel: [43584.608448] __x64_sys_ioctl+0x95/0xd0 Aug 22 17:30:10 juju-e4d256-prod-github-runner-207 kernel: [43584.609140] do_syscall_64+0x5c/0xc0 Aug 22 17:30:10 juju-e4d256-prod-github-runner-207 kernel: [43584.609817] ? do_futex+0x162/0x1f0 Aug 22 17:30:10 juju-e4d256-prod-github-runner-207 kernel: [43584.610466] ? __x64_sys_futex+0x78/0x1e0 Aug 22 17:30:10 juju-e4d256-prod-github-runner-207 kernel: [43584.611138] ? __secure_computing+0xa9/0x120 Aug 22 17:30:10 juju-e4d256-prod-github-runner-207 kernel: [43584.611827] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 17:30:10 juju-e4d256-prod-github-runner-207 kernel: [43584.612588] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:30:10 juju-e4d256-prod-github-runner-207 kernel: [43584.613311] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:30:10 juju-e4d256-prod-github-runner-207 kernel: [43584.614062] ? do_syscall_64+0x69/0xc0 Aug 22 17:30:10 juju-e4d256-prod-github-runner-207 kernel: [43584.614712] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:30:10 juju-e4d256-prod-github-runner-207 kernel: [43584.615417] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:30:10 juju-e4d256-prod-github-runner-207 kernel: [43584.616112] ? do_syscall_64+0x69/0xc0 Aug 22 17:30:10 juju-e4d256-prod-github-runner-207 kernel: [43584.616743] ? do_syscall_64+0x69/0xc0 Aug 22 17:30:10 juju-e4d256-prod-github-runner-207 kernel: [43584.617366] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 17:30:10 juju-e4d256-prod-github-runner-207 kernel: [43584.618082] RIP: 0033:0x7faa5d0edaff Aug 22 17:30:10 juju-e4d256-prod-github-runner-207 kernel: [43584.618707] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 17:30:10 juju-e4d256-prod-github-runner-207 kernel: [43584.620697] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 17:30:10 juju-e4d256-prod-github-runner-207 kernel: [43584.621636] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 17:30:10 juju-e4d256-prod-github-runner-207 kernel: [43584.622531] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 17:30:10 juju-e4d256-prod-github-runner-207 kernel: [43584.623425] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 17:30:10 juju-e4d256-prod-github-runner-207 kernel: [43584.624341] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 17:30:10 juju-e4d256-prod-github-runner-207 kernel: [43584.625259] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 17:30:10 juju-e4d256-prod-github-runner-207 kernel: [43584.626163] Aug 22 17:30:38 juju-e4d256-prod-github-runner-207 kernel: [43612.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 40509s! [qemu-system-x86:6715] Aug 22 17:30:38 juju-e4d256-prod-github-runner-207 kernel: [43612.543101] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 17:30:38 juju-e4d256-prod-github-runner-207 kernel: [43612.543170] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 17:30:38 juju-e4d256-prod-github-runner-207 kernel: [43612.555243] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 17:30:38 juju-e4d256-prod-github-runner-207 kernel: [43612.556518] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 17:30:38 juju-e4d256-prod-github-runner-207 kernel: [43612.557755] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:30:38 juju-e4d256-prod-github-runner-207 kernel: [43612.558823] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 17:30:38 juju-e4d256-prod-github-runner-207 kernel: [43612.561381] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 17:30:38 juju-e4d256-prod-github-runner-207 kernel: [43612.562425] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 17:30:38 juju-e4d256-prod-github-runner-207 kernel: [43612.563591] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 17:30:38 juju-e4d256-prod-github-runner-207 kernel: [43612.564751] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 17:30:38 juju-e4d256-prod-github-runner-207 kernel: [43612.565930] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 17:30:38 juju-e4d256-prod-github-runner-207 kernel: [43612.567098] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 17:30:38 juju-e4d256-prod-github-runner-207 kernel: [43612.568297] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 17:30:38 juju-e4d256-prod-github-runner-207 kernel: [43612.569548] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 17:30:38 juju-e4d256-prod-github-runner-207 kernel: [43612.570646] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 17:30:38 juju-e4d256-prod-github-runner-207 kernel: [43612.571844] Call Trace: Aug 22 17:30:38 juju-e4d256-prod-github-runner-207 kernel: [43612.572754] Aug 22 17:30:38 juju-e4d256-prod-github-runner-207 kernel: [43612.573652] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:30:38 juju-e4d256-prod-github-runner-207 kernel: [43612.574682] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:30:38 juju-e4d256-prod-github-runner-207 kernel: [43612.575699] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:30:38 juju-e4d256-prod-github-runner-207 kernel: [43612.576878] ? show_regs.part.0+0x23/0x29 Aug 22 17:30:38 juju-e4d256-prod-github-runner-207 kernel: [43612.577880] ? show_regs.cold+0x8/0xd Aug 22 17:30:38 juju-e4d256-prod-github-runner-207 kernel: [43612.578849] ? watchdog_timer_fn+0x1be/0x220 Aug 22 17:30:38 juju-e4d256-prod-github-runner-207 kernel: [43612.579864] ? lockup_detector_update_enable+0x60/0x60 Aug 22 17:30:38 juju-e4d256-prod-github-runner-207 kernel: [43612.580931] ? __hrtimer_run_queues+0x107/0x230 Aug 22 17:30:38 juju-e4d256-prod-github-runner-207 kernel: [43612.581967] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 17:30:38 juju-e4d256-prod-github-runner-207 kernel: [43612.582988] ? hrtimer_interrupt+0x101/0x220 Aug 22 17:30:38 juju-e4d256-prod-github-runner-207 kernel: [43612.584000] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 17:30:38 juju-e4d256-prod-github-runner-207 kernel: [43612.585071] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 17:30:38 juju-e4d256-prod-github-runner-207 kernel: [43612.586124] Aug 22 17:30:38 juju-e4d256-prod-github-runner-207 kernel: [43612.586980] Aug 22 17:30:38 juju-e4d256-prod-github-runner-207 kernel: [43612.587821] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 17:30:38 juju-e4d256-prod-github-runner-207 kernel: [43612.588852] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:30:38 juju-e4d256-prod-github-runner-207 kernel: [43612.589905] ? _raw_spin_lock+0x22/0x30 Aug 22 17:30:38 juju-e4d256-prod-github-runner-207 kernel: [43612.590855] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:30:38 juju-e4d256-prod-github-runner-207 kernel: [43612.591872] direct_page_fault+0x206/0x310 [kvm] Aug 22 17:30:38 juju-e4d256-prod-github-runner-207 kernel: [43612.592893] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 17:30:38 juju-e4d256-prod-github-runner-207 kernel: [43612.593915] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 17:30:38 juju-e4d256-prod-github-runner-207 kernel: [43612.594912] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 17:30:38 juju-e4d256-prod-github-runner-207 kernel: [43612.595880] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 17:30:38 juju-e4d256-prod-github-runner-207 kernel: [43612.596830] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 17:30:38 juju-e4d256-prod-github-runner-207 kernel: [43612.597830] handle_exit+0x98/0x230 [kvm_amd] Aug 22 17:30:38 juju-e4d256-prod-github-runner-207 kernel: [43612.598720] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 17:30:38 juju-e4d256-prod-github-runner-207 kernel: [43612.599630] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 17:30:38 juju-e4d256-prod-github-runner-207 kernel: [43612.600555] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 17:30:38 juju-e4d256-prod-github-runner-207 kernel: [43612.601464] vcpu_run+0x62/0x2c0 [kvm] Aug 22 17:30:38 juju-e4d256-prod-github-runner-207 kernel: [43612.602273] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 17:30:38 juju-e4d256-prod-github-runner-207 kernel: [43612.603082] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 17:30:38 juju-e4d256-prod-github-runner-207 kernel: [43612.603941] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 17:30:38 juju-e4d256-prod-github-runner-207 kernel: [43612.604736] ? __seccomp_filter+0x4a/0x4a0 Aug 22 17:30:38 juju-e4d256-prod-github-runner-207 kernel: [43612.605494] ? __fget_files+0x86/0xc0 Aug 22 17:30:38 juju-e4d256-prod-github-runner-207 kernel: [43612.606197] __x64_sys_ioctl+0x95/0xd0 Aug 22 17:30:38 juju-e4d256-prod-github-runner-207 kernel: [43612.606888] do_syscall_64+0x5c/0xc0 Aug 22 17:30:38 juju-e4d256-prod-github-runner-207 kernel: [43612.607555] ? do_futex+0x162/0x1f0 Aug 22 17:30:38 juju-e4d256-prod-github-runner-207 kernel: [43612.608200] ? __x64_sys_futex+0x78/0x1e0 Aug 22 17:30:38 juju-e4d256-prod-github-runner-207 kernel: [43612.608870] ? __secure_computing+0xa9/0x120 Aug 22 17:30:38 juju-e4d256-prod-github-runner-207 kernel: [43612.609566] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 17:30:38 juju-e4d256-prod-github-runner-207 kernel: [43612.610334] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:30:38 juju-e4d256-prod-github-runner-207 kernel: [43612.611059] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:30:38 juju-e4d256-prod-github-runner-207 kernel: [43612.611773] ? do_syscall_64+0x69/0xc0 Aug 22 17:30:38 juju-e4d256-prod-github-runner-207 kernel: [43612.612423] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:30:38 juju-e4d256-prod-github-runner-207 kernel: [43612.613129] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:30:38 juju-e4d256-prod-github-runner-207 kernel: [43612.613841] ? do_syscall_64+0x69/0xc0 Aug 22 17:30:38 juju-e4d256-prod-github-runner-207 kernel: [43612.614525] ? do_syscall_64+0x69/0xc0 Aug 22 17:30:38 juju-e4d256-prod-github-runner-207 kernel: [43612.615159] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 17:30:38 juju-e4d256-prod-github-runner-207 kernel: [43612.615868] RIP: 0033:0x7faa5d0edaff Aug 22 17:30:38 juju-e4d256-prod-github-runner-207 kernel: [43612.616495] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 17:30:38 juju-e4d256-prod-github-runner-207 kernel: [43612.618498] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 17:30:38 juju-e4d256-prod-github-runner-207 kernel: [43612.619407] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 17:30:38 juju-e4d256-prod-github-runner-207 kernel: [43612.620299] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 17:30:38 juju-e4d256-prod-github-runner-207 kernel: [43612.621205] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 17:30:38 juju-e4d256-prod-github-runner-207 kernel: [43612.622092] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 17:30:38 juju-e4d256-prod-github-runner-207 kernel: [43612.622979] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 17:30:38 juju-e4d256-prod-github-runner-207 kernel: [43612.623874] Aug 22 17:31:06 juju-e4d256-prod-github-runner-207 kernel: [43640.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 40535s! [qemu-system-x86:6715] Aug 22 17:31:06 juju-e4d256-prod-github-runner-207 kernel: [43640.543149] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 17:31:06 juju-e4d256-prod-github-runner-207 kernel: [43640.543219] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 17:31:06 juju-e4d256-prod-github-runner-207 kernel: [43640.555348] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 17:31:06 juju-e4d256-prod-github-runner-207 kernel: [43640.556617] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 17:31:06 juju-e4d256-prod-github-runner-207 kernel: [43640.557877] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:31:06 juju-e4d256-prod-github-runner-207 kernel: [43640.558945] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 17:31:06 juju-e4d256-prod-github-runner-207 kernel: [43640.561506] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 17:31:06 juju-e4d256-prod-github-runner-207 kernel: [43640.562550] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 17:31:06 juju-e4d256-prod-github-runner-207 kernel: [43640.563725] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 17:31:06 juju-e4d256-prod-github-runner-207 kernel: [43640.564906] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 17:31:06 juju-e4d256-prod-github-runner-207 kernel: [43640.566074] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 17:31:06 juju-e4d256-prod-github-runner-207 kernel: [43640.567237] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 17:31:06 juju-e4d256-prod-github-runner-207 kernel: [43640.568405] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 17:31:06 juju-e4d256-prod-github-runner-207 kernel: [43640.569665] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 17:31:06 juju-e4d256-prod-github-runner-207 kernel: [43640.570762] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 17:31:06 juju-e4d256-prod-github-runner-207 kernel: [43640.571956] Call Trace: Aug 22 17:31:06 juju-e4d256-prod-github-runner-207 kernel: [43640.572891] Aug 22 17:31:06 juju-e4d256-prod-github-runner-207 kernel: [43640.573778] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:31:06 juju-e4d256-prod-github-runner-207 kernel: [43640.574811] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:31:06 juju-e4d256-prod-github-runner-207 kernel: [43640.575831] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:31:06 juju-e4d256-prod-github-runner-207 kernel: [43640.576926] ? show_regs.part.0+0x23/0x29 Aug 22 17:31:06 juju-e4d256-prod-github-runner-207 kernel: [43640.577924] ? show_regs.cold+0x8/0xd Aug 22 17:31:06 juju-e4d256-prod-github-runner-207 kernel: [43640.578902] ? watchdog_timer_fn+0x1be/0x220 Aug 22 17:31:06 juju-e4d256-prod-github-runner-207 kernel: [43640.579909] ? lockup_detector_update_enable+0x60/0x60 Aug 22 17:31:06 juju-e4d256-prod-github-runner-207 kernel: [43640.580988] ? __hrtimer_run_queues+0x107/0x230 Aug 22 17:31:06 juju-e4d256-prod-github-runner-207 kernel: [43640.582015] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 17:31:06 juju-e4d256-prod-github-runner-207 kernel: [43640.583038] ? hrtimer_interrupt+0x101/0x220 Aug 22 17:31:06 juju-e4d256-prod-github-runner-207 kernel: [43640.584058] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 17:31:06 juju-e4d256-prod-github-runner-207 kernel: [43640.585144] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 17:31:06 juju-e4d256-prod-github-runner-207 kernel: [43640.586192] Aug 22 17:31:06 juju-e4d256-prod-github-runner-207 kernel: [43640.587045] Aug 22 17:31:06 juju-e4d256-prod-github-runner-207 kernel: [43640.587882] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 17:31:06 juju-e4d256-prod-github-runner-207 kernel: [43640.588942] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:31:06 juju-e4d256-prod-github-runner-207 kernel: [43640.589984] ? _raw_spin_lock+0x22/0x30 Aug 22 17:31:06 juju-e4d256-prod-github-runner-207 kernel: [43640.590929] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:31:06 juju-e4d256-prod-github-runner-207 kernel: [43640.591945] direct_page_fault+0x206/0x310 [kvm] Aug 22 17:31:06 juju-e4d256-prod-github-runner-207 kernel: [43640.592987] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 17:31:06 juju-e4d256-prod-github-runner-207 kernel: [43640.594001] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 17:31:06 juju-e4d256-prod-github-runner-207 kernel: [43640.595007] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 17:31:06 juju-e4d256-prod-github-runner-207 kernel: [43640.595978] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 17:31:06 juju-e4d256-prod-github-runner-207 kernel: [43640.596971] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 17:31:06 juju-e4d256-prod-github-runner-207 kernel: [43640.597985] handle_exit+0x98/0x230 [kvm_amd] Aug 22 17:31:06 juju-e4d256-prod-github-runner-207 kernel: [43640.598881] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 17:31:06 juju-e4d256-prod-github-runner-207 kernel: [43640.599819] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 17:31:06 juju-e4d256-prod-github-runner-207 kernel: [43640.600745] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 17:31:06 juju-e4d256-prod-github-runner-207 kernel: [43640.601660] vcpu_run+0x62/0x2c0 [kvm] Aug 22 17:31:06 juju-e4d256-prod-github-runner-207 kernel: [43640.602470] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 17:31:06 juju-e4d256-prod-github-runner-207 kernel: [43640.603277] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 17:31:06 juju-e4d256-prod-github-runner-207 kernel: [43640.604134] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 17:31:06 juju-e4d256-prod-github-runner-207 kernel: [43640.604953] ? __seccomp_filter+0x4a/0x4a0 Aug 22 17:31:06 juju-e4d256-prod-github-runner-207 kernel: [43640.605696] ? __fget_files+0x86/0xc0 Aug 22 17:31:06 juju-e4d256-prod-github-runner-207 kernel: [43640.606401] __x64_sys_ioctl+0x95/0xd0 Aug 22 17:31:06 juju-e4d256-prod-github-runner-207 kernel: [43640.607097] do_syscall_64+0x5c/0xc0 Aug 22 17:31:06 juju-e4d256-prod-github-runner-207 kernel: [43640.607758] ? do_futex+0x162/0x1f0 Aug 22 17:31:06 juju-e4d256-prod-github-runner-207 kernel: [43640.608404] ? __x64_sys_futex+0x78/0x1e0 Aug 22 17:31:06 juju-e4d256-prod-github-runner-207 kernel: [43640.609086] ? __secure_computing+0xa9/0x120 Aug 22 17:31:06 juju-e4d256-prod-github-runner-207 kernel: [43640.609789] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 17:31:06 juju-e4d256-prod-github-runner-207 kernel: [43640.610549] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:31:06 juju-e4d256-prod-github-runner-207 kernel: [43640.611270] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:31:06 juju-e4d256-prod-github-runner-207 kernel: [43640.611988] ? do_syscall_64+0x69/0xc0 Aug 22 17:31:06 juju-e4d256-prod-github-runner-207 kernel: [43640.612631] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:31:06 juju-e4d256-prod-github-runner-207 kernel: [43640.613347] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:31:06 juju-e4d256-prod-github-runner-207 kernel: [43640.614050] ? do_syscall_64+0x69/0xc0 Aug 22 17:31:06 juju-e4d256-prod-github-runner-207 kernel: [43640.614680] ? do_syscall_64+0x69/0xc0 Aug 22 17:31:06 juju-e4d256-prod-github-runner-207 kernel: [43640.615302] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 17:31:06 juju-e4d256-prod-github-runner-207 kernel: [43640.616011] RIP: 0033:0x7faa5d0edaff Aug 22 17:31:06 juju-e4d256-prod-github-runner-207 kernel: [43640.616634] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 17:31:06 juju-e4d256-prod-github-runner-207 kernel: [43640.618640] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 17:31:06 juju-e4d256-prod-github-runner-207 kernel: [43640.619556] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 17:31:06 juju-e4d256-prod-github-runner-207 kernel: [43640.620460] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 17:31:06 juju-e4d256-prod-github-runner-207 kernel: [43640.621362] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 17:31:06 juju-e4d256-prod-github-runner-207 kernel: [43640.622247] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 17:31:06 juju-e4d256-prod-github-runner-207 kernel: [43640.623133] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 17:31:06 juju-e4d256-prod-github-runner-207 kernel: [43640.624022] Aug 22 17:31:34 juju-e4d256-prod-github-runner-207 kernel: [43668.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 40561s! [qemu-system-x86:6715] Aug 22 17:31:34 juju-e4d256-prod-github-runner-207 kernel: [43668.543691] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 17:31:34 juju-e4d256-prod-github-runner-207 kernel: [43668.543934] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 17:31:34 juju-e4d256-prod-github-runner-207 kernel: [43668.556271] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 17:31:34 juju-e4d256-prod-github-runner-207 kernel: [43668.557564] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 17:31:34 juju-e4d256-prod-github-runner-207 kernel: [43668.558792] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:31:34 juju-e4d256-prod-github-runner-207 kernel: [43668.559858] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 17:31:34 juju-e4d256-prod-github-runner-207 kernel: [43668.562547] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 17:31:34 juju-e4d256-prod-github-runner-207 kernel: [43668.563610] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 17:31:34 juju-e4d256-prod-github-runner-207 kernel: [43668.564790] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 17:31:34 juju-e4d256-prod-github-runner-207 kernel: [43668.565981] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 17:31:34 juju-e4d256-prod-github-runner-207 kernel: [43668.567184] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 17:31:34 juju-e4d256-prod-github-runner-207 kernel: [43668.568352] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 17:31:34 juju-e4d256-prod-github-runner-207 kernel: [43668.569655] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 17:31:34 juju-e4d256-prod-github-runner-207 kernel: [43668.570927] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 17:31:34 juju-e4d256-prod-github-runner-207 kernel: [43668.572095] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 17:31:34 juju-e4d256-prod-github-runner-207 kernel: [43668.573366] Call Trace: Aug 22 17:31:34 juju-e4d256-prod-github-runner-207 kernel: [43668.574310] Aug 22 17:31:34 juju-e4d256-prod-github-runner-207 kernel: [43668.575242] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:31:34 juju-e4d256-prod-github-runner-207 kernel: [43668.576333] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:31:34 juju-e4d256-prod-github-runner-207 kernel: [43668.577434] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:31:34 juju-e4d256-prod-github-runner-207 kernel: [43668.578550] ? show_regs.part.0+0x23/0x29 Aug 22 17:31:34 juju-e4d256-prod-github-runner-207 kernel: [43668.579564] ? show_regs.cold+0x8/0xd Aug 22 17:31:34 juju-e4d256-prod-github-runner-207 kernel: [43668.580567] ? watchdog_timer_fn+0x1be/0x220 Aug 22 17:31:34 juju-e4d256-prod-github-runner-207 kernel: [43668.581594] ? lockup_detector_update_enable+0x60/0x60 Aug 22 17:31:34 juju-e4d256-prod-github-runner-207 kernel: [43668.582674] ? __hrtimer_run_queues+0x107/0x230 Aug 22 17:31:34 juju-e4d256-prod-github-runner-207 kernel: [43668.583707] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 17:31:34 juju-e4d256-prod-github-runner-207 kernel: [43668.584766] ? hrtimer_interrupt+0x101/0x220 Aug 22 17:31:34 juju-e4d256-prod-github-runner-207 kernel: [43668.585798] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 17:31:34 juju-e4d256-prod-github-runner-207 kernel: [43668.586911] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 17:31:34 juju-e4d256-prod-github-runner-207 kernel: [43668.587982] Aug 22 17:31:34 juju-e4d256-prod-github-runner-207 kernel: [43668.588852] Aug 22 17:31:34 juju-e4d256-prod-github-runner-207 kernel: [43668.589732] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 17:31:34 juju-e4d256-prod-github-runner-207 kernel: [43668.590800] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:31:34 juju-e4d256-prod-github-runner-207 kernel: [43668.591895] ? _raw_spin_lock+0x22/0x30 Aug 22 17:31:34 juju-e4d256-prod-github-runner-207 kernel: [43668.592887] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:31:34 juju-e4d256-prod-github-runner-207 kernel: [43668.593913] direct_page_fault+0x206/0x310 [kvm] Aug 22 17:31:34 juju-e4d256-prod-github-runner-207 kernel: [43668.594948] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 17:31:34 juju-e4d256-prod-github-runner-207 kernel: [43668.595967] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 17:31:34 juju-e4d256-prod-github-runner-207 kernel: [43668.597004] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 17:31:34 juju-e4d256-prod-github-runner-207 kernel: [43668.598037] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 17:31:34 juju-e4d256-prod-github-runner-207 kernel: [43668.599061] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 17:31:34 juju-e4d256-prod-github-runner-207 kernel: [43668.600102] handle_exit+0x98/0x230 [kvm_amd] Aug 22 17:31:34 juju-e4d256-prod-github-runner-207 kernel: [43668.601031] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 17:31:34 juju-e4d256-prod-github-runner-207 kernel: [43668.602022] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 17:31:34 juju-e4d256-prod-github-runner-207 kernel: [43668.602972] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 17:31:34 juju-e4d256-prod-github-runner-207 kernel: [43668.603892] vcpu_run+0x62/0x2c0 [kvm] Aug 22 17:31:34 juju-e4d256-prod-github-runner-207 kernel: [43668.604772] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 17:31:34 juju-e4d256-prod-github-runner-207 kernel: [43668.605596] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 17:31:34 juju-e4d256-prod-github-runner-207 kernel: [43668.606461] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 17:31:34 juju-e4d256-prod-github-runner-207 kernel: [43668.607286] ? __seccomp_filter+0x4a/0x4a0 Aug 22 17:31:34 juju-e4d256-prod-github-runner-207 kernel: [43668.608062] ? __fget_files+0x86/0xc0 Aug 22 17:31:34 juju-e4d256-prod-github-runner-207 kernel: [43668.608788] __x64_sys_ioctl+0x95/0xd0 Aug 22 17:31:34 juju-e4d256-prod-github-runner-207 kernel: [43668.609487] do_syscall_64+0x5c/0xc0 Aug 22 17:31:34 juju-e4d256-prod-github-runner-207 kernel: [43668.610161] ? do_futex+0x162/0x1f0 Aug 22 17:31:34 juju-e4d256-prod-github-runner-207 kernel: [43668.610814] ? __x64_sys_futex+0x78/0x1e0 Aug 22 17:31:34 juju-e4d256-prod-github-runner-207 kernel: [43668.611500] ? __secure_computing+0xa9/0x120 Aug 22 17:31:34 juju-e4d256-prod-github-runner-207 kernel: [43668.612211] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 17:31:34 juju-e4d256-prod-github-runner-207 kernel: [43668.613003] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:31:34 juju-e4d256-prod-github-runner-207 kernel: [43668.613733] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:31:34 juju-e4d256-prod-github-runner-207 kernel: [43668.614462] ? do_syscall_64+0x69/0xc0 Aug 22 17:31:34 juju-e4d256-prod-github-runner-207 kernel: [43668.615130] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:31:34 juju-e4d256-prod-github-runner-207 kernel: [43668.615874] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:31:34 juju-e4d256-prod-github-runner-207 kernel: [43668.616613] ? do_syscall_64+0x69/0xc0 Aug 22 17:31:34 juju-e4d256-prod-github-runner-207 kernel: [43668.617260] ? do_syscall_64+0x69/0xc0 Aug 22 17:31:34 juju-e4d256-prod-github-runner-207 kernel: [43668.617909] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 17:31:34 juju-e4d256-prod-github-runner-207 kernel: [43668.618630] RIP: 0033:0x7faa5d0edaff Aug 22 17:31:34 juju-e4d256-prod-github-runner-207 kernel: [43668.619308] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 17:31:34 juju-e4d256-prod-github-runner-207 kernel: [43668.621669] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 17:31:34 juju-e4d256-prod-github-runner-207 kernel: [43668.622734] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 17:31:34 juju-e4d256-prod-github-runner-207 kernel: [43668.623767] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 17:31:34 juju-e4d256-prod-github-runner-207 kernel: [43668.624804] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 17:31:34 juju-e4d256-prod-github-runner-207 kernel: [43668.625842] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 17:31:34 juju-e4d256-prod-github-runner-207 kernel: [43668.626999] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 17:31:34 juju-e4d256-prod-github-runner-207 kernel: [43668.628054] Aug 22 17:32:02 juju-e4d256-prod-github-runner-207 kernel: [43696.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 40587s! [qemu-system-x86:6715] Aug 22 17:32:02 juju-e4d256-prod-github-runner-207 kernel: [43696.543235] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 17:32:02 juju-e4d256-prod-github-runner-207 kernel: [43696.543306] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 17:32:02 juju-e4d256-prod-github-runner-207 kernel: [43696.556590] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 17:32:02 juju-e4d256-prod-github-runner-207 kernel: [43696.557864] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 17:32:02 juju-e4d256-prod-github-runner-207 kernel: [43696.559116] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:32:02 juju-e4d256-prod-github-runner-207 kernel: [43696.560226] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 17:32:02 juju-e4d256-prod-github-runner-207 kernel: [43696.562896] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 17:32:02 juju-e4d256-prod-github-runner-207 kernel: [43696.563950] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 17:32:02 juju-e4d256-prod-github-runner-207 kernel: [43696.565175] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 17:32:02 juju-e4d256-prod-github-runner-207 kernel: [43696.566408] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 17:32:02 juju-e4d256-prod-github-runner-207 kernel: [43696.567681] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 17:32:02 juju-e4d256-prod-github-runner-207 kernel: [43696.568909] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 17:32:02 juju-e4d256-prod-github-runner-207 kernel: [43696.570140] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 17:32:02 juju-e4d256-prod-github-runner-207 kernel: [43696.571374] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 17:32:02 juju-e4d256-prod-github-runner-207 kernel: [43696.572541] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 17:32:02 juju-e4d256-prod-github-runner-207 kernel: [43696.573756] Call Trace: Aug 22 17:32:02 juju-e4d256-prod-github-runner-207 kernel: [43696.574673] Aug 22 17:32:02 juju-e4d256-prod-github-runner-207 kernel: [43696.575562] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:32:02 juju-e4d256-prod-github-runner-207 kernel: [43696.576630] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:32:02 juju-e4d256-prod-github-runner-207 kernel: [43696.577658] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:32:02 juju-e4d256-prod-github-runner-207 kernel: [43696.578740] ? show_regs.part.0+0x23/0x29 Aug 22 17:32:02 juju-e4d256-prod-github-runner-207 kernel: [43696.579745] ? show_regs.cold+0x8/0xd Aug 22 17:32:02 juju-e4d256-prod-github-runner-207 kernel: [43696.580744] ? watchdog_timer_fn+0x1be/0x220 Aug 22 17:32:02 juju-e4d256-prod-github-runner-207 kernel: [43696.581756] ? lockup_detector_update_enable+0x60/0x60 Aug 22 17:32:02 juju-e4d256-prod-github-runner-207 kernel: [43696.582820] ? __hrtimer_run_queues+0x107/0x230 Aug 22 17:32:02 juju-e4d256-prod-github-runner-207 kernel: [43696.583853] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 17:32:02 juju-e4d256-prod-github-runner-207 kernel: [43696.584997] ? hrtimer_interrupt+0x101/0x220 Aug 22 17:32:02 juju-e4d256-prod-github-runner-207 kernel: [43696.586017] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 17:32:02 juju-e4d256-prod-github-runner-207 kernel: [43696.587214] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 17:32:02 juju-e4d256-prod-github-runner-207 kernel: [43696.588300] Aug 22 17:32:02 juju-e4d256-prod-github-runner-207 kernel: [43696.589157] Aug 22 17:32:02 juju-e4d256-prod-github-runner-207 kernel: [43696.590001] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 17:32:02 juju-e4d256-prod-github-runner-207 kernel: [43696.591111] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:32:02 juju-e4d256-prod-github-runner-207 kernel: [43696.592277] ? _raw_spin_lock+0x22/0x30 Aug 22 17:32:02 juju-e4d256-prod-github-runner-207 kernel: [43696.593323] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:32:02 juju-e4d256-prod-github-runner-207 kernel: [43696.594442] direct_page_fault+0x206/0x310 [kvm] Aug 22 17:32:02 juju-e4d256-prod-github-runner-207 kernel: [43696.595560] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 17:32:02 juju-e4d256-prod-github-runner-207 kernel: [43696.596729] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 17:32:02 juju-e4d256-prod-github-runner-207 kernel: [43696.597891] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 17:32:02 juju-e4d256-prod-github-runner-207 kernel: [43696.598871] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 17:32:02 juju-e4d256-prod-github-runner-207 kernel: [43696.599868] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 17:32:02 juju-e4d256-prod-github-runner-207 kernel: [43696.600985] handle_exit+0x98/0x230 [kvm_amd] Aug 22 17:32:02 juju-e4d256-prod-github-runner-207 kernel: [43696.601883] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 17:32:02 juju-e4d256-prod-github-runner-207 kernel: [43696.602840] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 17:32:02 juju-e4d256-prod-github-runner-207 kernel: [43696.603777] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 17:32:02 juju-e4d256-prod-github-runner-207 kernel: [43696.604729] vcpu_run+0x62/0x2c0 [kvm] Aug 22 17:32:02 juju-e4d256-prod-github-runner-207 kernel: [43696.605607] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 17:32:02 juju-e4d256-prod-github-runner-207 kernel: [43696.606449] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 17:32:02 juju-e4d256-prod-github-runner-207 kernel: [43696.607316] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 17:32:02 juju-e4d256-prod-github-runner-207 kernel: [43696.608129] ? __seccomp_filter+0x4a/0x4a0 Aug 22 17:32:02 juju-e4d256-prod-github-runner-207 kernel: [43696.608918] ? __fget_files+0x86/0xc0 Aug 22 17:32:02 juju-e4d256-prod-github-runner-207 kernel: [43696.609636] __x64_sys_ioctl+0x95/0xd0 Aug 22 17:32:02 juju-e4d256-prod-github-runner-207 kernel: [43696.610355] do_syscall_64+0x5c/0xc0 Aug 22 17:32:02 juju-e4d256-prod-github-runner-207 kernel: [43696.611029] ? do_futex+0x162/0x1f0 Aug 22 17:32:02 juju-e4d256-prod-github-runner-207 kernel: [43696.611695] ? __x64_sys_futex+0x78/0x1e0 Aug 22 17:32:02 juju-e4d256-prod-github-runner-207 kernel: [43696.612409] ? __secure_computing+0xa9/0x120 Aug 22 17:32:02 juju-e4d256-prod-github-runner-207 kernel: [43696.613103] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 17:32:02 juju-e4d256-prod-github-runner-207 kernel: [43696.613916] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:32:02 juju-e4d256-prod-github-runner-207 kernel: [43696.614692] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:32:02 juju-e4d256-prod-github-runner-207 kernel: [43696.615416] ? do_syscall_64+0x69/0xc0 Aug 22 17:32:02 juju-e4d256-prod-github-runner-207 kernel: [43696.616063] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:32:02 juju-e4d256-prod-github-runner-207 kernel: [43696.616810] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:32:02 juju-e4d256-prod-github-runner-207 kernel: [43696.617579] ? do_syscall_64+0x69/0xc0 Aug 22 17:32:02 juju-e4d256-prod-github-runner-207 kernel: [43696.618275] ? do_syscall_64+0x69/0xc0 Aug 22 17:32:02 juju-e4d256-prod-github-runner-207 kernel: [43696.618904] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 17:32:02 juju-e4d256-prod-github-runner-207 kernel: [43696.619673] RIP: 0033:0x7faa5d0edaff Aug 22 17:32:02 juju-e4d256-prod-github-runner-207 kernel: [43696.620387] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 17:32:02 juju-e4d256-prod-github-runner-207 kernel: [43696.622570] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 17:32:02 juju-e4d256-prod-github-runner-207 kernel: [43696.623567] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 17:32:02 juju-e4d256-prod-github-runner-207 kernel: [43696.624547] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 17:32:02 juju-e4d256-prod-github-runner-207 kernel: [43696.625461] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 17:32:02 juju-e4d256-prod-github-runner-207 kernel: [43696.626388] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 17:32:02 juju-e4d256-prod-github-runner-207 kernel: [43696.627295] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 17:32:02 juju-e4d256-prod-github-runner-207 kernel: [43696.628245] Aug 22 17:32:30 juju-e4d256-prod-github-runner-207 kernel: [43724.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 40613s! [qemu-system-x86:6715] Aug 22 17:32:30 juju-e4d256-prod-github-runner-207 kernel: [43724.543085] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 17:32:30 juju-e4d256-prod-github-runner-207 kernel: [43724.543148] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 17:32:30 juju-e4d256-prod-github-runner-207 kernel: [43724.557318] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 17:32:30 juju-e4d256-prod-github-runner-207 kernel: [43724.558964] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 17:32:30 juju-e4d256-prod-github-runner-207 kernel: [43724.560237] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:32:30 juju-e4d256-prod-github-runner-207 kernel: [43724.561305] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 17:32:30 juju-e4d256-prod-github-runner-207 kernel: [43724.563886] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 17:32:30 juju-e4d256-prod-github-runner-207 kernel: [43724.564953] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 17:32:30 juju-e4d256-prod-github-runner-207 kernel: [43724.566113] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 17:32:30 juju-e4d256-prod-github-runner-207 kernel: [43724.567286] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 17:32:30 juju-e4d256-prod-github-runner-207 kernel: [43724.568491] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 17:32:30 juju-e4d256-prod-github-runner-207 kernel: [43724.569661] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 17:32:30 juju-e4d256-prod-github-runner-207 kernel: [43724.570881] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 17:32:30 juju-e4d256-prod-github-runner-207 kernel: [43724.572276] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 17:32:30 juju-e4d256-prod-github-runner-207 kernel: [43724.573378] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 17:32:30 juju-e4d256-prod-github-runner-207 kernel: [43724.574578] Call Trace: Aug 22 17:32:30 juju-e4d256-prod-github-runner-207 kernel: [43724.575489] Aug 22 17:32:30 juju-e4d256-prod-github-runner-207 kernel: [43724.576384] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:32:30 juju-e4d256-prod-github-runner-207 kernel: [43724.577415] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:32:30 juju-e4d256-prod-github-runner-207 kernel: [43724.578447] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:32:30 juju-e4d256-prod-github-runner-207 kernel: [43724.579530] ? show_regs.part.0+0x23/0x29 Aug 22 17:32:30 juju-e4d256-prod-github-runner-207 kernel: [43724.580546] ? show_regs.cold+0x8/0xd Aug 22 17:32:30 juju-e4d256-prod-github-runner-207 kernel: [43724.581524] ? watchdog_timer_fn+0x1be/0x220 Aug 22 17:32:30 juju-e4d256-prod-github-runner-207 kernel: [43724.582531] ? lockup_detector_update_enable+0x60/0x60 Aug 22 17:32:30 juju-e4d256-prod-github-runner-207 kernel: [43724.583601] ? __hrtimer_run_queues+0x107/0x230 Aug 22 17:32:30 juju-e4d256-prod-github-runner-207 kernel: [43724.584644] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 17:32:30 juju-e4d256-prod-github-runner-207 kernel: [43724.585670] ? hrtimer_interrupt+0x101/0x220 Aug 22 17:32:30 juju-e4d256-prod-github-runner-207 kernel: [43724.586683] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 17:32:30 juju-e4d256-prod-github-runner-207 kernel: [43724.587764] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 17:32:30 juju-e4d256-prod-github-runner-207 kernel: [43724.588853] Aug 22 17:32:30 juju-e4d256-prod-github-runner-207 kernel: [43724.589706] Aug 22 17:32:30 juju-e4d256-prod-github-runner-207 kernel: [43724.590554] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 17:32:30 juju-e4d256-prod-github-runner-207 kernel: [43724.591592] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:32:30 juju-e4d256-prod-github-runner-207 kernel: [43724.592662] ? _raw_spin_lock+0x22/0x30 Aug 22 17:32:30 juju-e4d256-prod-github-runner-207 kernel: [43724.593613] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:32:30 juju-e4d256-prod-github-runner-207 kernel: [43724.594645] direct_page_fault+0x206/0x310 [kvm] Aug 22 17:32:30 juju-e4d256-prod-github-runner-207 kernel: [43724.595669] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 17:32:30 juju-e4d256-prod-github-runner-207 kernel: [43724.596695] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 17:32:30 juju-e4d256-prod-github-runner-207 kernel: [43724.597696] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 17:32:30 juju-e4d256-prod-github-runner-207 kernel: [43724.598671] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 17:32:30 juju-e4d256-prod-github-runner-207 kernel: [43724.599613] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 17:32:30 juju-e4d256-prod-github-runner-207 kernel: [43724.600610] handle_exit+0x98/0x230 [kvm_amd] Aug 22 17:32:30 juju-e4d256-prod-github-runner-207 kernel: [43724.601500] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 17:32:30 juju-e4d256-prod-github-runner-207 kernel: [43724.602441] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 17:32:30 juju-e4d256-prod-github-runner-207 kernel: [43724.603371] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 17:32:30 juju-e4d256-prod-github-runner-207 kernel: [43724.604287] vcpu_run+0x62/0x2c0 [kvm] Aug 22 17:32:30 juju-e4d256-prod-github-runner-207 kernel: [43724.605096] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 17:32:30 juju-e4d256-prod-github-runner-207 kernel: [43724.605901] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 17:32:30 juju-e4d256-prod-github-runner-207 kernel: [43724.606751] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 17:32:30 juju-e4d256-prod-github-runner-207 kernel: [43724.607543] ? __seccomp_filter+0x4a/0x4a0 Aug 22 17:32:30 juju-e4d256-prod-github-runner-207 kernel: [43724.608295] ? __fget_files+0x86/0xc0 Aug 22 17:32:30 juju-e4d256-prod-github-runner-207 kernel: [43724.609004] __x64_sys_ioctl+0x95/0xd0 Aug 22 17:32:30 juju-e4d256-prod-github-runner-207 kernel: [43724.609693] do_syscall_64+0x5c/0xc0 Aug 22 17:32:30 juju-e4d256-prod-github-runner-207 kernel: [43724.610353] ? do_futex+0x162/0x1f0 Aug 22 17:32:30 juju-e4d256-prod-github-runner-207 kernel: [43724.610999] ? __x64_sys_futex+0x78/0x1e0 Aug 22 17:32:30 juju-e4d256-prod-github-runner-207 kernel: [43724.611691] ? __secure_computing+0xa9/0x120 Aug 22 17:32:30 juju-e4d256-prod-github-runner-207 kernel: [43724.612424] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 17:32:30 juju-e4d256-prod-github-runner-207 kernel: [43724.613187] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:32:30 juju-e4d256-prod-github-runner-207 kernel: [43724.613909] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:32:30 juju-e4d256-prod-github-runner-207 kernel: [43724.614625] ? do_syscall_64+0x69/0xc0 Aug 22 17:32:30 juju-e4d256-prod-github-runner-207 kernel: [43724.615284] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:32:30 juju-e4d256-prod-github-runner-207 kernel: [43724.616006] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:32:30 juju-e4d256-prod-github-runner-207 kernel: [43724.616703] ? do_syscall_64+0x69/0xc0 Aug 22 17:32:30 juju-e4d256-prod-github-runner-207 kernel: [43724.617331] ? do_syscall_64+0x69/0xc0 Aug 22 17:32:30 juju-e4d256-prod-github-runner-207 kernel: [43724.617970] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 17:32:30 juju-e4d256-prod-github-runner-207 kernel: [43724.618675] RIP: 0033:0x7faa5d0edaff Aug 22 17:32:30 juju-e4d256-prod-github-runner-207 kernel: [43724.619300] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 17:32:30 juju-e4d256-prod-github-runner-207 kernel: [43724.621297] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 17:32:30 juju-e4d256-prod-github-runner-207 kernel: [43724.622213] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 17:32:30 juju-e4d256-prod-github-runner-207 kernel: [43724.623103] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 17:32:30 juju-e4d256-prod-github-runner-207 kernel: [43724.624006] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 17:32:30 juju-e4d256-prod-github-runner-207 kernel: [43724.624891] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 17:32:30 juju-e4d256-prod-github-runner-207 kernel: [43724.625791] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 17:32:30 juju-e4d256-prod-github-runner-207 kernel: [43724.626692] Aug 22 17:32:46 juju-e4d256-prod-github-runner-207 kernel: [43740.105056] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 17:32:46 juju-e4d256-prod-github-runner-207 kernel: [43740.108366] rcu: 1-....: (10871558 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=5261448 Aug 22 17:32:46 juju-e4d256-prod-github-runner-207 kernel: [43740.110218] (t=10905726 jiffies g=23269 q=43587) Aug 22 17:32:46 juju-e4d256-prod-github-runner-207 kernel: [43740.112940] NMI backtrace for cpu 1 Aug 22 17:32:46 juju-e4d256-prod-github-runner-207 kernel: [43740.113661] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 17:32:46 juju-e4d256-prod-github-runner-207 kernel: [43740.116811] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 17:32:46 juju-e4d256-prod-github-runner-207 kernel: [43740.119553] Call Trace: Aug 22 17:32:46 juju-e4d256-prod-github-runner-207 kernel: [43740.120827] Aug 22 17:32:46 juju-e4d256-prod-github-runner-207 kernel: [43740.122055] show_stack+0x52/0x5c Aug 22 17:32:46 juju-e4d256-prod-github-runner-207 kernel: [43740.124290] dump_stack_lvl+0x4a/0x63 Aug 22 17:32:46 juju-e4d256-prod-github-runner-207 kernel: [43740.125064] dump_stack+0x10/0x16 Aug 22 17:32:46 juju-e4d256-prod-github-runner-207 kernel: [43740.127825] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 17:32:46 juju-e4d256-prod-github-runner-207 kernel: [43740.128610] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 17:32:46 juju-e4d256-prod-github-runner-207 kernel: [43740.130438] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 17:32:46 juju-e4d256-prod-github-runner-207 kernel: [43740.132366] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 17:32:46 juju-e4d256-prod-github-runner-207 kernel: [43740.133251] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 17:32:46 juju-e4d256-prod-github-runner-207 kernel: [43740.136214] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 17:32:46 juju-e4d256-prod-github-runner-207 kernel: [43740.137047] print_cpu_stall.cold+0x2f/0xe2 Aug 22 17:32:46 juju-e4d256-prod-github-runner-207 kernel: [43740.138346] ? timekeeping_update+0xf7/0x150 Aug 22 17:32:46 juju-e4d256-prod-github-runner-207 kernel: [43740.140695] check_cpu_stall+0x109/0x270 Aug 22 17:32:46 juju-e4d256-prod-github-runner-207 kernel: [43740.141510] rcu_sched_clock_irq+0x9a/0x250 Aug 22 17:32:46 juju-e4d256-prod-github-runner-207 kernel: [43740.144446] update_process_times+0x94/0xd0 Aug 22 17:32:46 juju-e4d256-prod-github-runner-207 kernel: [43740.145246] tick_sched_handle+0x29/0x70 Aug 22 17:32:46 juju-e4d256-prod-github-runner-207 kernel: [43740.148035] tick_sched_timer+0x8c/0xc0 Aug 22 17:32:46 juju-e4d256-prod-github-runner-207 kernel: [43740.148795] ? tick_nohz_handler+0xb0/0xb0 Aug 22 17:32:46 juju-e4d256-prod-github-runner-207 kernel: [43740.151685] __hrtimer_run_queues+0x107/0x230 Aug 22 17:32:46 juju-e4d256-prod-github-runner-207 kernel: [43740.152484] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 17:32:46 juju-e4d256-prod-github-runner-207 kernel: [43740.154411] hrtimer_interrupt+0x101/0x220 Aug 22 17:32:46 juju-e4d256-prod-github-runner-207 kernel: [43740.156172] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 17:32:46 juju-e4d256-prod-github-runner-207 kernel: [43740.157014] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 17:32:46 juju-e4d256-prod-github-runner-207 kernel: [43740.159955] Aug 22 17:32:46 juju-e4d256-prod-github-runner-207 kernel: [43740.160605] Aug 22 17:32:46 juju-e4d256-prod-github-runner-207 kernel: [43740.161246] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 17:32:46 juju-e4d256-prod-github-runner-207 kernel: [43740.164100] RIP: 0010:native_queued_spin_lock_slowpath+0xc/0x40 Aug 22 17:32:46 juju-e4d256-prod-github-runner-207 kernel: [43740.164985] Code: fe ff ff eb af 4c 89 fe 48 c7 c7 20 99 e9 89 e8 ca 69 55 00 e9 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 <8b> 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 eb Aug 22 17:32:46 juju-e4d256-prod-github-runner-207 kernel: [43740.169220] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 17:32:46 juju-e4d256-prod-github-runner-207 kernel: [43740.172053] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 17:32:46 juju-e4d256-prod-github-runner-207 kernel: [43740.173047] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 17:32:46 juju-e4d256-prod-github-runner-207 kernel: [43740.176057] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 17:32:46 juju-e4d256-prod-github-runner-207 kernel: [43740.177028] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 17:32:46 juju-e4d256-prod-github-runner-207 kernel: [43740.178016] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 17:32:46 juju-e4d256-prod-github-runner-207 kernel: [43740.181042] ? _raw_spin_lock+0x22/0x30 Aug 22 17:32:46 juju-e4d256-prod-github-runner-207 kernel: [43740.181826] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:32:46 juju-e4d256-prod-github-runner-207 kernel: [43740.184351] direct_page_fault+0x206/0x310 [kvm] Aug 22 17:32:46 juju-e4d256-prod-github-runner-207 kernel: [43740.185696] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 17:32:46 juju-e4d256-prod-github-runner-207 kernel: [43740.186556] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 17:32:46 juju-e4d256-prod-github-runner-207 kernel: [43740.189529] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 17:32:46 juju-e4d256-prod-github-runner-207 kernel: [43740.190361] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 17:32:46 juju-e4d256-prod-github-runner-207 kernel: [43740.193196] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 17:32:46 juju-e4d256-prod-github-runner-207 kernel: [43740.194029] handle_exit+0x98/0x230 [kvm_amd] Aug 22 17:32:46 juju-e4d256-prod-github-runner-207 kernel: [43740.196414] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 17:32:46 juju-e4d256-prod-github-runner-207 kernel: [43740.197731] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 17:32:46 juju-e4d256-prod-github-runner-207 kernel: [43740.199572] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 17:32:46 juju-e4d256-prod-github-runner-207 kernel: [43740.201404] vcpu_run+0x62/0x2c0 [kvm] Aug 22 17:32:46 juju-e4d256-prod-github-runner-207 kernel: [43740.202126] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 17:32:46 juju-e4d256-prod-github-runner-207 kernel: [43740.204970] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 17:32:46 juju-e4d256-prod-github-runner-207 kernel: [43740.205777] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 17:32:46 juju-e4d256-prod-github-runner-207 kernel: [43740.206544] ? __seccomp_filter+0x4a/0x4a0 Aug 22 17:32:46 juju-e4d256-prod-github-runner-207 kernel: [43740.207846] ? __fget_files+0x86/0xc0 Aug 22 17:32:46 juju-e4d256-prod-github-runner-207 kernel: [43740.210058] __x64_sys_ioctl+0x95/0xd0 Aug 22 17:32:46 juju-e4d256-prod-github-runner-207 kernel: [43740.210755] do_syscall_64+0x5c/0xc0 Aug 22 17:32:46 juju-e4d256-prod-github-runner-207 kernel: [43740.211432] ? do_futex+0x162/0x1f0 Aug 22 17:32:46 juju-e4d256-prod-github-runner-207 kernel: [43740.213117] ? __x64_sys_futex+0x78/0x1e0 Aug 22 17:32:46 juju-e4d256-prod-github-runner-207 kernel: [43740.214738] ? __secure_computing+0xa9/0x120 Aug 22 17:32:46 juju-e4d256-prod-github-runner-207 kernel: [43740.215456] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 17:32:46 juju-e4d256-prod-github-runner-207 kernel: [43740.217283] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:32:46 juju-e4d256-prod-github-runner-207 kernel: [43740.219305] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:32:46 juju-e4d256-prod-github-runner-207 kernel: [43740.220077] ? do_syscall_64+0x69/0xc0 Aug 22 17:32:46 juju-e4d256-prod-github-runner-207 kernel: [43740.222301] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:32:46 juju-e4d256-prod-github-runner-207 kernel: [43740.223624] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:32:46 juju-e4d256-prod-github-runner-207 kernel: [43740.224416] ? do_syscall_64+0x69/0xc0 Aug 22 17:32:46 juju-e4d256-prod-github-runner-207 kernel: [43740.227046] ? do_syscall_64+0x69/0xc0 Aug 22 17:32:46 juju-e4d256-prod-github-runner-207 kernel: [43740.227755] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 17:32:46 juju-e4d256-prod-github-runner-207 kernel: [43740.228531] RIP: 0033:0x7faa5d0edaff Aug 22 17:32:46 juju-e4d256-prod-github-runner-207 kernel: [43740.231293] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 17:32:46 juju-e4d256-prod-github-runner-207 kernel: [43740.235378] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 17:32:46 juju-e4d256-prod-github-runner-207 kernel: [43740.236362] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 17:32:46 juju-e4d256-prod-github-runner-207 kernel: [43740.239424] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 17:32:46 juju-e4d256-prod-github-runner-207 kernel: [43740.240410] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 17:32:46 juju-e4d256-prod-github-runner-207 kernel: [43740.243394] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 17:32:46 juju-e4d256-prod-github-runner-207 kernel: [43740.244877] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 17:32:46 juju-e4d256-prod-github-runner-207 kernel: [43740.247303] Aug 22 17:33:10 juju-e4d256-prod-github-runner-207 kernel: [43764.541980] watchdog: BUG: soft lockup - CPU#1 stuck for 40650s! [qemu-system-x86:6715] Aug 22 17:33:10 juju-e4d256-prod-github-runner-207 kernel: [43764.543211] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 17:33:10 juju-e4d256-prod-github-runner-207 kernel: [43764.543568] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 17:33:10 juju-e4d256-prod-github-runner-207 kernel: [43764.558757] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 17:33:10 juju-e4d256-prod-github-runner-207 kernel: [43764.560558] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 17:33:10 juju-e4d256-prod-github-runner-207 kernel: [43764.562015] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:33:10 juju-e4d256-prod-github-runner-207 kernel: [43764.563106] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 17:33:10 juju-e4d256-prod-github-runner-207 kernel: [43764.565765] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 17:33:10 juju-e4d256-prod-github-runner-207 kernel: [43764.566857] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 17:33:10 juju-e4d256-prod-github-runner-207 kernel: [43764.568414] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 17:33:10 juju-e4d256-prod-github-runner-207 kernel: [43764.570001] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 17:33:10 juju-e4d256-prod-github-runner-207 kernel: [43764.571551] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 17:33:10 juju-e4d256-prod-github-runner-207 kernel: [43764.572769] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 17:33:10 juju-e4d256-prod-github-runner-207 kernel: [43764.573983] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 17:33:10 juju-e4d256-prod-github-runner-207 kernel: [43764.575264] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 17:33:10 juju-e4d256-prod-github-runner-207 kernel: [43764.576417] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 17:33:10 juju-e4d256-prod-github-runner-207 kernel: [43764.577690] Call Trace: Aug 22 17:33:10 juju-e4d256-prod-github-runner-207 kernel: [43764.578876] Aug 22 17:33:10 juju-e4d256-prod-github-runner-207 kernel: [43764.580031] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:33:10 juju-e4d256-prod-github-runner-207 kernel: [43764.581419] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:33:10 juju-e4d256-prod-github-runner-207 kernel: [43764.582746] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:33:10 juju-e4d256-prod-github-runner-207 kernel: [43764.583915] ? show_regs.part.0+0x23/0x29 Aug 22 17:33:10 juju-e4d256-prod-github-runner-207 kernel: [43764.584946] ? show_regs.cold+0x8/0xd Aug 22 17:33:10 juju-e4d256-prod-github-runner-207 kernel: [43764.585951] ? watchdog_timer_fn+0x1be/0x220 Aug 22 17:33:10 juju-e4d256-prod-github-runner-207 kernel: [43764.586984] ? lockup_detector_update_enable+0x60/0x60 Aug 22 17:33:10 juju-e4d256-prod-github-runner-207 kernel: [43764.588102] ? __hrtimer_run_queues+0x107/0x230 Aug 22 17:33:10 juju-e4d256-prod-github-runner-207 kernel: [43764.589160] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 17:33:10 juju-e4d256-prod-github-runner-207 kernel: [43764.590207] ? hrtimer_interrupt+0x101/0x220 Aug 22 17:33:10 juju-e4d256-prod-github-runner-207 kernel: [43764.591514] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 17:33:10 juju-e4d256-prod-github-runner-207 kernel: [43764.592974] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 17:33:10 juju-e4d256-prod-github-runner-207 kernel: [43764.594384] Aug 22 17:33:10 juju-e4d256-prod-github-runner-207 kernel: [43764.595478] Aug 22 17:33:10 juju-e4d256-prod-github-runner-207 kernel: [43764.596351] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 17:33:10 juju-e4d256-prod-github-runner-207 kernel: [43764.597520] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:33:10 juju-e4d256-prod-github-runner-207 kernel: [43764.598617] ? _raw_spin_lock+0x22/0x30 Aug 22 17:33:10 juju-e4d256-prod-github-runner-207 kernel: [43764.599619] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:33:10 juju-e4d256-prod-github-runner-207 kernel: [43764.600954] direct_page_fault+0x206/0x310 [kvm] Aug 22 17:33:10 juju-e4d256-prod-github-runner-207 kernel: [43764.602298] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 17:33:10 juju-e4d256-prod-github-runner-207 kernel: [43764.603653] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 17:33:10 juju-e4d256-prod-github-runner-207 kernel: [43764.604820] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 17:33:10 juju-e4d256-prod-github-runner-207 kernel: [43764.605799] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 17:33:10 juju-e4d256-prod-github-runner-207 kernel: [43764.606771] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 17:33:10 juju-e4d256-prod-github-runner-207 kernel: [43764.607794] handle_exit+0x98/0x230 [kvm_amd] Aug 22 17:33:10 juju-e4d256-prod-github-runner-207 kernel: [43764.608719] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 17:33:10 juju-e4d256-prod-github-runner-207 kernel: [43764.609671] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 17:33:10 juju-e4d256-prod-github-runner-207 kernel: [43764.610635] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 17:33:10 juju-e4d256-prod-github-runner-207 kernel: [43764.611593] vcpu_run+0x62/0x2c0 [kvm] Aug 22 17:33:10 juju-e4d256-prod-github-runner-207 kernel: [43764.612420] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 17:33:10 juju-e4d256-prod-github-runner-207 kernel: [43764.613243] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 17:33:10 juju-e4d256-prod-github-runner-207 kernel: [43764.614111] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 17:33:10 juju-e4d256-prod-github-runner-207 kernel: [43764.615036] ? __seccomp_filter+0x4a/0x4a0 Aug 22 17:33:10 juju-e4d256-prod-github-runner-207 kernel: [43764.615928] ? __fget_files+0x86/0xc0 Aug 22 17:33:10 juju-e4d256-prod-github-runner-207 kernel: [43764.616684] __x64_sys_ioctl+0x95/0xd0 Aug 22 17:33:10 juju-e4d256-prod-github-runner-207 kernel: [43764.617412] do_syscall_64+0x5c/0xc0 Aug 22 17:33:10 juju-e4d256-prod-github-runner-207 kernel: [43764.618109] ? do_futex+0x162/0x1f0 Aug 22 17:33:10 juju-e4d256-prod-github-runner-207 kernel: [43764.618831] ? __x64_sys_futex+0x78/0x1e0 Aug 22 17:33:10 juju-e4d256-prod-github-runner-207 kernel: [43764.619561] ? __secure_computing+0xa9/0x120 Aug 22 17:33:10 juju-e4d256-prod-github-runner-207 kernel: [43764.620346] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 17:33:10 juju-e4d256-prod-github-runner-207 kernel: [43764.621183] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:33:10 juju-e4d256-prod-github-runner-207 kernel: [43764.621960] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:33:10 juju-e4d256-prod-github-runner-207 kernel: [43764.622804] ? do_syscall_64+0x69/0xc0 Aug 22 17:33:10 juju-e4d256-prod-github-runner-207 kernel: [43764.623522] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:33:10 juju-e4d256-prod-github-runner-207 kernel: [43764.624266] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:33:10 juju-e4d256-prod-github-runner-207 kernel: [43764.625000] ? do_syscall_64+0x69/0xc0 Aug 22 17:33:10 juju-e4d256-prod-github-runner-207 kernel: [43764.625690] ? do_syscall_64+0x69/0xc0 Aug 22 17:33:10 juju-e4d256-prod-github-runner-207 kernel: [43764.626353] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 17:33:10 juju-e4d256-prod-github-runner-207 kernel: [43764.627098] RIP: 0033:0x7faa5d0edaff Aug 22 17:33:10 juju-e4d256-prod-github-runner-207 kernel: [43764.627798] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 17:33:10 juju-e4d256-prod-github-runner-207 kernel: [43764.629970] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 17:33:10 juju-e4d256-prod-github-runner-207 kernel: [43764.630934] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 17:33:10 juju-e4d256-prod-github-runner-207 kernel: [43764.631963] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 17:33:10 juju-e4d256-prod-github-runner-207 kernel: [43764.633031] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 17:33:10 juju-e4d256-prod-github-runner-207 kernel: [43764.633993] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 17:33:10 juju-e4d256-prod-github-runner-207 kernel: [43764.634987] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 17:33:10 juju-e4d256-prod-github-runner-207 kernel: [43764.635973] Aug 22 17:33:38 juju-e4d256-prod-github-runner-207 kernel: [43792.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 40676s! [qemu-system-x86:6715] Aug 22 17:33:38 juju-e4d256-prod-github-runner-207 kernel: [43792.543142] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 17:33:38 juju-e4d256-prod-github-runner-207 kernel: [43792.543210] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 17:33:38 juju-e4d256-prod-github-runner-207 kernel: [43792.555588] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 17:33:38 juju-e4d256-prod-github-runner-207 kernel: [43792.556873] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 17:33:38 juju-e4d256-prod-github-runner-207 kernel: [43792.558094] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:33:38 juju-e4d256-prod-github-runner-207 kernel: [43792.559169] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 17:33:38 juju-e4d256-prod-github-runner-207 kernel: [43792.561740] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 17:33:38 juju-e4d256-prod-github-runner-207 kernel: [43792.562854] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 17:33:38 juju-e4d256-prod-github-runner-207 kernel: [43792.564052] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 17:33:38 juju-e4d256-prod-github-runner-207 kernel: [43792.565211] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 17:33:38 juju-e4d256-prod-github-runner-207 kernel: [43792.566385] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 17:33:38 juju-e4d256-prod-github-runner-207 kernel: [43792.567568] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 17:33:38 juju-e4d256-prod-github-runner-207 kernel: [43792.568737] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 17:33:38 juju-e4d256-prod-github-runner-207 kernel: [43792.569969] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 17:33:38 juju-e4d256-prod-github-runner-207 kernel: [43792.571092] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 17:33:38 juju-e4d256-prod-github-runner-207 kernel: [43792.572301] Call Trace: Aug 22 17:33:38 juju-e4d256-prod-github-runner-207 kernel: [43792.573214] Aug 22 17:33:38 juju-e4d256-prod-github-runner-207 kernel: [43792.574123] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:33:38 juju-e4d256-prod-github-runner-207 kernel: [43792.575182] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:33:38 juju-e4d256-prod-github-runner-207 kernel: [43792.576209] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:33:38 juju-e4d256-prod-github-runner-207 kernel: [43792.577296] ? show_regs.part.0+0x23/0x29 Aug 22 17:33:38 juju-e4d256-prod-github-runner-207 kernel: [43792.578294] ? show_regs.cold+0x8/0xd Aug 22 17:33:38 juju-e4d256-prod-github-runner-207 kernel: [43792.579278] ? watchdog_timer_fn+0x1be/0x220 Aug 22 17:33:38 juju-e4d256-prod-github-runner-207 kernel: [43792.580305] ? lockup_detector_update_enable+0x60/0x60 Aug 22 17:33:38 juju-e4d256-prod-github-runner-207 kernel: [43792.581375] ? __hrtimer_run_queues+0x107/0x230 Aug 22 17:33:38 juju-e4d256-prod-github-runner-207 kernel: [43792.582403] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 17:33:38 juju-e4d256-prod-github-runner-207 kernel: [43792.583468] ? hrtimer_interrupt+0x101/0x220 Aug 22 17:33:38 juju-e4d256-prod-github-runner-207 kernel: [43792.584489] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 17:33:38 juju-e4d256-prod-github-runner-207 kernel: [43792.585557] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 17:33:38 juju-e4d256-prod-github-runner-207 kernel: [43792.586613] Aug 22 17:33:38 juju-e4d256-prod-github-runner-207 kernel: [43792.587502] Aug 22 17:33:38 juju-e4d256-prod-github-runner-207 kernel: [43792.588347] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 17:33:38 juju-e4d256-prod-github-runner-207 kernel: [43792.589386] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:33:38 juju-e4d256-prod-github-runner-207 kernel: [43792.590425] ? _raw_spin_lock+0x22/0x30 Aug 22 17:33:38 juju-e4d256-prod-github-runner-207 kernel: [43792.591387] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:33:38 juju-e4d256-prod-github-runner-207 kernel: [43792.592439] direct_page_fault+0x206/0x310 [kvm] Aug 22 17:33:38 juju-e4d256-prod-github-runner-207 kernel: [43792.593481] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 17:33:38 juju-e4d256-prod-github-runner-207 kernel: [43792.594499] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 17:33:38 juju-e4d256-prod-github-runner-207 kernel: [43792.595516] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 17:33:38 juju-e4d256-prod-github-runner-207 kernel: [43792.596494] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 17:33:38 juju-e4d256-prod-github-runner-207 kernel: [43792.597445] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 17:33:38 juju-e4d256-prod-github-runner-207 kernel: [43792.598439] handle_exit+0x98/0x230 [kvm_amd] Aug 22 17:33:38 juju-e4d256-prod-github-runner-207 kernel: [43792.599353] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 17:33:38 juju-e4d256-prod-github-runner-207 kernel: [43792.600270] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 17:33:38 juju-e4d256-prod-github-runner-207 kernel: [43792.601199] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 17:33:38 juju-e4d256-prod-github-runner-207 kernel: [43792.602103] vcpu_run+0x62/0x2c0 [kvm] Aug 22 17:33:38 juju-e4d256-prod-github-runner-207 kernel: [43792.602920] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 17:33:38 juju-e4d256-prod-github-runner-207 kernel: [43792.603751] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 17:33:38 juju-e4d256-prod-github-runner-207 kernel: [43792.604766] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 17:33:38 juju-e4d256-prod-github-runner-207 kernel: [43792.605572] ? __seccomp_filter+0x4a/0x4a0 Aug 22 17:33:38 juju-e4d256-prod-github-runner-207 kernel: [43792.606323] ? __fget_files+0x86/0xc0 Aug 22 17:33:38 juju-e4d256-prod-github-runner-207 kernel: [43792.607040] __x64_sys_ioctl+0x95/0xd0 Aug 22 17:33:38 juju-e4d256-prod-github-runner-207 kernel: [43792.607735] do_syscall_64+0x5c/0xc0 Aug 22 17:33:38 juju-e4d256-prod-github-runner-207 kernel: [43792.608402] ? do_futex+0x162/0x1f0 Aug 22 17:33:38 juju-e4d256-prod-github-runner-207 kernel: [43792.609052] ? __x64_sys_futex+0x78/0x1e0 Aug 22 17:33:38 juju-e4d256-prod-github-runner-207 kernel: [43792.609730] ? __secure_computing+0xa9/0x120 Aug 22 17:33:38 juju-e4d256-prod-github-runner-207 kernel: [43792.610425] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 17:33:38 juju-e4d256-prod-github-runner-207 kernel: [43792.611203] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:33:38 juju-e4d256-prod-github-runner-207 kernel: [43792.611932] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:33:38 juju-e4d256-prod-github-runner-207 kernel: [43792.612654] ? do_syscall_64+0x69/0xc0 Aug 22 17:33:38 juju-e4d256-prod-github-runner-207 kernel: [43792.613303] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:33:38 juju-e4d256-prod-github-runner-207 kernel: [43792.614008] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:33:38 juju-e4d256-prod-github-runner-207 kernel: [43792.614726] ? do_syscall_64+0x69/0xc0 Aug 22 17:33:38 juju-e4d256-prod-github-runner-207 kernel: [43792.615382] ? do_syscall_64+0x69/0xc0 Aug 22 17:33:38 juju-e4d256-prod-github-runner-207 kernel: [43792.616009] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 17:33:38 juju-e4d256-prod-github-runner-207 kernel: [43792.616737] RIP: 0033:0x7faa5d0edaff Aug 22 17:33:38 juju-e4d256-prod-github-runner-207 kernel: [43792.617368] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 17:33:38 juju-e4d256-prod-github-runner-207 kernel: [43792.619405] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 17:33:38 juju-e4d256-prod-github-runner-207 kernel: [43792.620332] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 17:33:38 juju-e4d256-prod-github-runner-207 kernel: [43792.621233] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 17:33:38 juju-e4d256-prod-github-runner-207 kernel: [43792.622125] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 17:33:38 juju-e4d256-prod-github-runner-207 kernel: [43792.623016] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 17:33:38 juju-e4d256-prod-github-runner-207 kernel: [43792.623915] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 17:33:38 juju-e4d256-prod-github-runner-207 kernel: [43792.624815] Aug 22 17:34:06 juju-e4d256-prod-github-runner-207 kernel: [43820.541986] watchdog: BUG: soft lockup - CPU#1 stuck for 40703s! [qemu-system-x86:6715] Aug 22 17:34:06 juju-e4d256-prod-github-runner-207 kernel: [43820.543111] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 17:34:06 juju-e4d256-prod-github-runner-207 kernel: [43820.543177] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 17:34:06 juju-e4d256-prod-github-runner-207 kernel: [43820.555387] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 17:34:06 juju-e4d256-prod-github-runner-207 kernel: [43820.556657] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 17:34:06 juju-e4d256-prod-github-runner-207 kernel: [43820.557912] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:34:06 juju-e4d256-prod-github-runner-207 kernel: [43820.558985] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 17:34:06 juju-e4d256-prod-github-runner-207 kernel: [43820.561560] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 17:34:06 juju-e4d256-prod-github-runner-207 kernel: [43820.562600] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 17:34:06 juju-e4d256-prod-github-runner-207 kernel: [43820.563772] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 17:34:06 juju-e4d256-prod-github-runner-207 kernel: [43820.564937] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 17:34:06 juju-e4d256-prod-github-runner-207 kernel: [43820.566116] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 17:34:06 juju-e4d256-prod-github-runner-207 kernel: [43820.567301] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 17:34:06 juju-e4d256-prod-github-runner-207 kernel: [43820.568492] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 17:34:06 juju-e4d256-prod-github-runner-207 kernel: [43820.569749] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 17:34:06 juju-e4d256-prod-github-runner-207 kernel: [43820.570897] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 17:34:06 juju-e4d256-prod-github-runner-207 kernel: [43820.572107] Call Trace: Aug 22 17:34:06 juju-e4d256-prod-github-runner-207 kernel: [43820.573019] Aug 22 17:34:06 juju-e4d256-prod-github-runner-207 kernel: [43820.573956] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:34:06 juju-e4d256-prod-github-runner-207 kernel: [43820.575032] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:34:06 juju-e4d256-prod-github-runner-207 kernel: [43820.576079] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:34:06 juju-e4d256-prod-github-runner-207 kernel: [43820.577207] ? show_regs.part.0+0x23/0x29 Aug 22 17:34:06 juju-e4d256-prod-github-runner-207 kernel: [43820.578418] ? show_regs.cold+0x8/0xd Aug 22 17:34:06 juju-e4d256-prod-github-runner-207 kernel: [43820.579420] ? watchdog_timer_fn+0x1be/0x220 Aug 22 17:34:06 juju-e4d256-prod-github-runner-207 kernel: [43820.580428] ? lockup_detector_update_enable+0x60/0x60 Aug 22 17:34:06 juju-e4d256-prod-github-runner-207 kernel: [43820.581513] ? __hrtimer_run_queues+0x107/0x230 Aug 22 17:34:06 juju-e4d256-prod-github-runner-207 kernel: [43820.582565] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 17:34:06 juju-e4d256-prod-github-runner-207 kernel: [43820.583615] ? hrtimer_interrupt+0x101/0x220 Aug 22 17:34:06 juju-e4d256-prod-github-runner-207 kernel: [43820.584639] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 17:34:06 juju-e4d256-prod-github-runner-207 kernel: [43820.585718] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 17:34:06 juju-e4d256-prod-github-runner-207 kernel: [43820.586783] Aug 22 17:34:06 juju-e4d256-prod-github-runner-207 kernel: [43820.587640] Aug 22 17:34:06 juju-e4d256-prod-github-runner-207 kernel: [43820.588514] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 17:34:06 juju-e4d256-prod-github-runner-207 kernel: [43820.589561] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:34:06 juju-e4d256-prod-github-runner-207 kernel: [43820.590622] ? _raw_spin_lock+0x22/0x30 Aug 22 17:34:06 juju-e4d256-prod-github-runner-207 kernel: [43820.591598] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:34:06 juju-e4d256-prod-github-runner-207 kernel: [43820.592615] direct_page_fault+0x206/0x310 [kvm] Aug 22 17:34:06 juju-e4d256-prod-github-runner-207 kernel: [43820.593641] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 17:34:06 juju-e4d256-prod-github-runner-207 kernel: [43820.594646] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 17:34:06 juju-e4d256-prod-github-runner-207 kernel: [43820.595659] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 17:34:06 juju-e4d256-prod-github-runner-207 kernel: [43820.596660] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 17:34:06 juju-e4d256-prod-github-runner-207 kernel: [43820.597610] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 17:34:06 juju-e4d256-prod-github-runner-207 kernel: [43820.598629] handle_exit+0x98/0x230 [kvm_amd] Aug 22 17:34:06 juju-e4d256-prod-github-runner-207 kernel: [43820.599562] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 17:34:06 juju-e4d256-prod-github-runner-207 kernel: [43820.600476] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 17:34:06 juju-e4d256-prod-github-runner-207 kernel: [43820.601416] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 17:34:06 juju-e4d256-prod-github-runner-207 kernel: [43820.602347] vcpu_run+0x62/0x2c0 [kvm] Aug 22 17:34:06 juju-e4d256-prod-github-runner-207 kernel: [43820.603187] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 17:34:06 juju-e4d256-prod-github-runner-207 kernel: [43820.604001] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 17:34:06 juju-e4d256-prod-github-runner-207 kernel: [43820.604854] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 17:34:06 juju-e4d256-prod-github-runner-207 kernel: [43820.605660] ? __seccomp_filter+0x4a/0x4a0 Aug 22 17:34:06 juju-e4d256-prod-github-runner-207 kernel: [43820.606424] ? __fget_files+0x86/0xc0 Aug 22 17:34:06 juju-e4d256-prod-github-runner-207 kernel: [43820.607164] __x64_sys_ioctl+0x95/0xd0 Aug 22 17:34:06 juju-e4d256-prod-github-runner-207 kernel: [43820.607948] do_syscall_64+0x5c/0xc0 Aug 22 17:34:06 juju-e4d256-prod-github-runner-207 kernel: [43820.608689] ? do_futex+0x162/0x1f0 Aug 22 17:34:06 juju-e4d256-prod-github-runner-207 kernel: [43820.609367] ? __x64_sys_futex+0x78/0x1e0 Aug 22 17:34:06 juju-e4d256-prod-github-runner-207 kernel: [43820.610045] ? __secure_computing+0xa9/0x120 Aug 22 17:34:06 juju-e4d256-prod-github-runner-207 kernel: [43820.610754] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 17:34:06 juju-e4d256-prod-github-runner-207 kernel: [43820.611530] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:34:06 juju-e4d256-prod-github-runner-207 kernel: [43820.612263] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:34:06 juju-e4d256-prod-github-runner-207 kernel: [43820.612985] ? do_syscall_64+0x69/0xc0 Aug 22 17:34:06 juju-e4d256-prod-github-runner-207 kernel: [43820.613664] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:34:06 juju-e4d256-prod-github-runner-207 kernel: [43820.614449] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:34:06 juju-e4d256-prod-github-runner-207 kernel: [43820.615228] ? do_syscall_64+0x69/0xc0 Aug 22 17:34:06 juju-e4d256-prod-github-runner-207 kernel: [43820.615879] ? do_syscall_64+0x69/0xc0 Aug 22 17:34:06 juju-e4d256-prod-github-runner-207 kernel: [43820.616506] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 17:34:06 juju-e4d256-prod-github-runner-207 kernel: [43820.617234] RIP: 0033:0x7faa5d0edaff Aug 22 17:34:06 juju-e4d256-prod-github-runner-207 kernel: [43820.617860] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 17:34:06 juju-e4d256-prod-github-runner-207 kernel: [43820.619915] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 17:34:06 juju-e4d256-prod-github-runner-207 kernel: [43820.620832] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 17:34:06 juju-e4d256-prod-github-runner-207 kernel: [43820.621724] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 17:34:06 juju-e4d256-prod-github-runner-207 kernel: [43820.622630] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 17:34:06 juju-e4d256-prod-github-runner-207 kernel: [43820.623532] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 17:34:06 juju-e4d256-prod-github-runner-207 kernel: [43820.624419] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 17:34:06 juju-e4d256-prod-github-runner-207 kernel: [43820.625309] Aug 22 17:34:34 juju-e4d256-prod-github-runner-207 kernel: [43848.541981] watchdog: BUG: soft lockup - CPU#1 stuck for 40729s! [qemu-system-x86:6715] Aug 22 17:34:34 juju-e4d256-prod-github-runner-207 kernel: [43848.543772] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 17:34:34 juju-e4d256-prod-github-runner-207 kernel: [43848.544027] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 17:34:34 juju-e4d256-prod-github-runner-207 kernel: [43848.556303] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 17:34:34 juju-e4d256-prod-github-runner-207 kernel: [43848.557617] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 17:34:34 juju-e4d256-prod-github-runner-207 kernel: [43848.558890] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:34:34 juju-e4d256-prod-github-runner-207 kernel: [43848.559968] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 17:34:34 juju-e4d256-prod-github-runner-207 kernel: [43848.562579] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 17:34:34 juju-e4d256-prod-github-runner-207 kernel: [43848.563662] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 17:34:34 juju-e4d256-prod-github-runner-207 kernel: [43848.564834] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 17:34:34 juju-e4d256-prod-github-runner-207 kernel: [43848.566003] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 17:34:34 juju-e4d256-prod-github-runner-207 kernel: [43848.567186] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 17:34:34 juju-e4d256-prod-github-runner-207 kernel: [43848.568364] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 17:34:34 juju-e4d256-prod-github-runner-207 kernel: [43848.569641] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 17:34:34 juju-e4d256-prod-github-runner-207 kernel: [43848.570911] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 17:34:34 juju-e4d256-prod-github-runner-207 kernel: [43848.572160] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 17:34:34 juju-e4d256-prod-github-runner-207 kernel: [43848.573373] Call Trace: Aug 22 17:34:34 juju-e4d256-prod-github-runner-207 kernel: [43848.574305] Aug 22 17:34:34 juju-e4d256-prod-github-runner-207 kernel: [43848.575221] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:34:34 juju-e4d256-prod-github-runner-207 kernel: [43848.576257] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:34:34 juju-e4d256-prod-github-runner-207 kernel: [43848.577282] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:34:34 juju-e4d256-prod-github-runner-207 kernel: [43848.578444] ? show_regs.part.0+0x23/0x29 Aug 22 17:34:34 juju-e4d256-prod-github-runner-207 kernel: [43848.579475] ? show_regs.cold+0x8/0xd Aug 22 17:34:34 juju-e4d256-prod-github-runner-207 kernel: [43848.580475] ? watchdog_timer_fn+0x1be/0x220 Aug 22 17:34:34 juju-e4d256-prod-github-runner-207 kernel: [43848.581500] ? lockup_detector_update_enable+0x60/0x60 Aug 22 17:34:34 juju-e4d256-prod-github-runner-207 kernel: [43848.582658] ? __hrtimer_run_queues+0x107/0x230 Aug 22 17:34:34 juju-e4d256-prod-github-runner-207 kernel: [43848.583724] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 17:34:34 juju-e4d256-prod-github-runner-207 kernel: [43848.584763] ? hrtimer_interrupt+0x101/0x220 Aug 22 17:34:34 juju-e4d256-prod-github-runner-207 kernel: [43848.585781] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 17:34:34 juju-e4d256-prod-github-runner-207 kernel: [43848.586868] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 17:34:34 juju-e4d256-prod-github-runner-207 kernel: [43848.587915] Aug 22 17:34:34 juju-e4d256-prod-github-runner-207 kernel: [43848.588769] Aug 22 17:34:34 juju-e4d256-prod-github-runner-207 kernel: [43848.589606] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 17:34:34 juju-e4d256-prod-github-runner-207 kernel: [43848.590651] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:34:34 juju-e4d256-prod-github-runner-207 kernel: [43848.591690] ? _raw_spin_lock+0x22/0x30 Aug 22 17:34:34 juju-e4d256-prod-github-runner-207 kernel: [43848.592636] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:34:34 juju-e4d256-prod-github-runner-207 kernel: [43848.593657] direct_page_fault+0x206/0x310 [kvm] Aug 22 17:34:34 juju-e4d256-prod-github-runner-207 kernel: [43848.594696] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 17:34:34 juju-e4d256-prod-github-runner-207 kernel: [43848.595713] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 17:34:34 juju-e4d256-prod-github-runner-207 kernel: [43848.596713] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 17:34:34 juju-e4d256-prod-github-runner-207 kernel: [43848.597713] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 17:34:34 juju-e4d256-prod-github-runner-207 kernel: [43848.598666] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 17:34:34 juju-e4d256-prod-github-runner-207 kernel: [43848.599646] handle_exit+0x98/0x230 [kvm_amd] Aug 22 17:34:34 juju-e4d256-prod-github-runner-207 kernel: [43848.600537] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 17:34:34 juju-e4d256-prod-github-runner-207 kernel: [43848.601475] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 17:34:34 juju-e4d256-prod-github-runner-207 kernel: [43848.602424] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 17:34:34 juju-e4d256-prod-github-runner-207 kernel: [43848.603349] vcpu_run+0x62/0x2c0 [kvm] Aug 22 17:34:34 juju-e4d256-prod-github-runner-207 kernel: [43848.604269] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 17:34:34 juju-e4d256-prod-github-runner-207 kernel: [43848.605093] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 17:34:34 juju-e4d256-prod-github-runner-207 kernel: [43848.605953] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 17:34:34 juju-e4d256-prod-github-runner-207 kernel: [43848.606804] ? __seccomp_filter+0x4a/0x4a0 Aug 22 17:34:34 juju-e4d256-prod-github-runner-207 kernel: [43848.607553] ? __fget_files+0x86/0xc0 Aug 22 17:34:34 juju-e4d256-prod-github-runner-207 kernel: [43848.608259] __x64_sys_ioctl+0x95/0xd0 Aug 22 17:34:34 juju-e4d256-prod-github-runner-207 kernel: [43848.608952] do_syscall_64+0x5c/0xc0 Aug 22 17:34:34 juju-e4d256-prod-github-runner-207 kernel: [43848.609619] ? do_futex+0x162/0x1f0 Aug 22 17:34:34 juju-e4d256-prod-github-runner-207 kernel: [43848.610270] ? __x64_sys_futex+0x78/0x1e0 Aug 22 17:34:34 juju-e4d256-prod-github-runner-207 kernel: [43848.610957] ? __secure_computing+0xa9/0x120 Aug 22 17:34:34 juju-e4d256-prod-github-runner-207 kernel: [43848.611643] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 17:34:34 juju-e4d256-prod-github-runner-207 kernel: [43848.612402] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:34:34 juju-e4d256-prod-github-runner-207 kernel: [43848.613166] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:34:34 juju-e4d256-prod-github-runner-207 kernel: [43848.613934] ? do_syscall_64+0x69/0xc0 Aug 22 17:34:34 juju-e4d256-prod-github-runner-207 kernel: [43848.614599] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:34:34 juju-e4d256-prod-github-runner-207 kernel: [43848.615304] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:34:34 juju-e4d256-prod-github-runner-207 kernel: [43848.616014] ? do_syscall_64+0x69/0xc0 Aug 22 17:34:34 juju-e4d256-prod-github-runner-207 kernel: [43848.616643] ? do_syscall_64+0x69/0xc0 Aug 22 17:34:34 juju-e4d256-prod-github-runner-207 kernel: [43848.617264] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 17:34:34 juju-e4d256-prod-github-runner-207 kernel: [43848.617965] RIP: 0033:0x7faa5d0edaff Aug 22 17:34:34 juju-e4d256-prod-github-runner-207 kernel: [43848.618650] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 17:34:34 juju-e4d256-prod-github-runner-207 kernel: [43848.620639] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 17:34:34 juju-e4d256-prod-github-runner-207 kernel: [43848.621549] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 17:34:34 juju-e4d256-prod-github-runner-207 kernel: [43848.622453] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 17:34:34 juju-e4d256-prod-github-runner-207 kernel: [43848.623342] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 17:34:34 juju-e4d256-prod-github-runner-207 kernel: [43848.624239] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 17:34:34 juju-e4d256-prod-github-runner-207 kernel: [43848.625159] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 17:34:34 juju-e4d256-prod-github-runner-207 kernel: [43848.626078] Aug 22 17:35:02 juju-e4d256-prod-github-runner-207 kernel: [43876.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 40755s! [qemu-system-x86:6715] Aug 22 17:35:02 juju-e4d256-prod-github-runner-207 kernel: [43876.543143] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 17:35:02 juju-e4d256-prod-github-runner-207 kernel: [43876.543214] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 17:35:02 juju-e4d256-prod-github-runner-207 kernel: [43876.555625] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 17:35:02 juju-e4d256-prod-github-runner-207 kernel: [43876.556913] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 17:35:02 juju-e4d256-prod-github-runner-207 kernel: [43876.558169] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:35:02 juju-e4d256-prod-github-runner-207 kernel: [43876.559247] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 17:35:02 juju-e4d256-prod-github-runner-207 kernel: [43876.561837] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 17:35:02 juju-e4d256-prod-github-runner-207 kernel: [43876.562920] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 17:35:02 juju-e4d256-prod-github-runner-207 kernel: [43876.564116] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 17:35:02 juju-e4d256-prod-github-runner-207 kernel: [43876.565285] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 17:35:02 juju-e4d256-prod-github-runner-207 kernel: [43876.566491] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 17:35:02 juju-e4d256-prod-github-runner-207 kernel: [43876.567675] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 17:35:02 juju-e4d256-prod-github-runner-207 kernel: [43876.568864] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 17:35:02 juju-e4d256-prod-github-runner-207 kernel: [43876.570127] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 17:35:02 juju-e4d256-prod-github-runner-207 kernel: [43876.571239] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 17:35:02 juju-e4d256-prod-github-runner-207 kernel: [43876.572435] Call Trace: Aug 22 17:35:02 juju-e4d256-prod-github-runner-207 kernel: [43876.573350] Aug 22 17:35:02 juju-e4d256-prod-github-runner-207 kernel: [43876.574342] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:35:02 juju-e4d256-prod-github-runner-207 kernel: [43876.575675] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:35:02 juju-e4d256-prod-github-runner-207 kernel: [43876.576710] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:35:02 juju-e4d256-prod-github-runner-207 kernel: [43876.577795] ? show_regs.part.0+0x23/0x29 Aug 22 17:35:02 juju-e4d256-prod-github-runner-207 kernel: [43876.578811] ? show_regs.cold+0x8/0xd Aug 22 17:35:02 juju-e4d256-prod-github-runner-207 kernel: [43876.579788] ? watchdog_timer_fn+0x1be/0x220 Aug 22 17:35:02 juju-e4d256-prod-github-runner-207 kernel: [43876.580814] ? lockup_detector_update_enable+0x60/0x60 Aug 22 17:35:02 juju-e4d256-prod-github-runner-207 kernel: [43876.581908] ? __hrtimer_run_queues+0x107/0x230 Aug 22 17:35:02 juju-e4d256-prod-github-runner-207 kernel: [43876.583069] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 17:35:02 juju-e4d256-prod-github-runner-207 kernel: [43876.584247] ? hrtimer_interrupt+0x101/0x220 Aug 22 17:35:02 juju-e4d256-prod-github-runner-207 kernel: [43876.585330] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 17:35:02 juju-e4d256-prod-github-runner-207 kernel: [43876.586574] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 17:35:02 juju-e4d256-prod-github-runner-207 kernel: [43876.587648] Aug 22 17:35:02 juju-e4d256-prod-github-runner-207 kernel: [43876.588511] Aug 22 17:35:02 juju-e4d256-prod-github-runner-207 kernel: [43876.589357] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 17:35:02 juju-e4d256-prod-github-runner-207 kernel: [43876.590413] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:35:02 juju-e4d256-prod-github-runner-207 kernel: [43876.591473] ? _raw_spin_lock+0x22/0x30 Aug 22 17:35:02 juju-e4d256-prod-github-runner-207 kernel: [43876.592425] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:35:02 juju-e4d256-prod-github-runner-207 kernel: [43876.593452] direct_page_fault+0x206/0x310 [kvm] Aug 22 17:35:02 juju-e4d256-prod-github-runner-207 kernel: [43876.594508] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 17:35:02 juju-e4d256-prod-github-runner-207 kernel: [43876.595528] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 17:35:02 juju-e4d256-prod-github-runner-207 kernel: [43876.596548] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 17:35:02 juju-e4d256-prod-github-runner-207 kernel: [43876.597548] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 17:35:02 juju-e4d256-prod-github-runner-207 kernel: [43876.598510] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 17:35:02 juju-e4d256-prod-github-runner-207 kernel: [43876.599489] handle_exit+0x98/0x230 [kvm_amd] Aug 22 17:35:02 juju-e4d256-prod-github-runner-207 kernel: [43876.600397] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 17:35:02 juju-e4d256-prod-github-runner-207 kernel: [43876.601337] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 17:35:02 juju-e4d256-prod-github-runner-207 kernel: [43876.602294] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 17:35:02 juju-e4d256-prod-github-runner-207 kernel: [43876.603204] vcpu_run+0x62/0x2c0 [kvm] Aug 22 17:35:02 juju-e4d256-prod-github-runner-207 kernel: [43876.604016] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 17:35:02 juju-e4d256-prod-github-runner-207 kernel: [43876.604830] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 17:35:02 juju-e4d256-prod-github-runner-207 kernel: [43876.605700] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 17:35:02 juju-e4d256-prod-github-runner-207 kernel: [43876.606516] ? __seccomp_filter+0x4a/0x4a0 Aug 22 17:35:02 juju-e4d256-prod-github-runner-207 kernel: [43876.607270] ? __fget_files+0x86/0xc0 Aug 22 17:35:02 juju-e4d256-prod-github-runner-207 kernel: [43876.607981] __x64_sys_ioctl+0x95/0xd0 Aug 22 17:35:02 juju-e4d256-prod-github-runner-207 kernel: [43876.608720] do_syscall_64+0x5c/0xc0 Aug 22 17:35:02 juju-e4d256-prod-github-runner-207 kernel: [43876.609399] ? do_futex+0x162/0x1f0 Aug 22 17:35:02 juju-e4d256-prod-github-runner-207 kernel: [43876.610063] ? __x64_sys_futex+0x78/0x1e0 Aug 22 17:35:02 juju-e4d256-prod-github-runner-207 kernel: [43876.610744] ? __secure_computing+0xa9/0x120 Aug 22 17:35:02 juju-e4d256-prod-github-runner-207 kernel: [43876.611486] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 17:35:02 juju-e4d256-prod-github-runner-207 kernel: [43876.612271] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:35:02 juju-e4d256-prod-github-runner-207 kernel: [43876.613002] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:35:02 juju-e4d256-prod-github-runner-207 kernel: [43876.613738] ? do_syscall_64+0x69/0xc0 Aug 22 17:35:02 juju-e4d256-prod-github-runner-207 kernel: [43876.614425] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:35:02 juju-e4d256-prod-github-runner-207 kernel: [43876.615143] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:35:02 juju-e4d256-prod-github-runner-207 kernel: [43876.615841] ? do_syscall_64+0x69/0xc0 Aug 22 17:35:02 juju-e4d256-prod-github-runner-207 kernel: [43876.616476] ? do_syscall_64+0x69/0xc0 Aug 22 17:35:02 juju-e4d256-prod-github-runner-207 kernel: [43876.617098] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 17:35:02 juju-e4d256-prod-github-runner-207 kernel: [43876.617811] RIP: 0033:0x7faa5d0edaff Aug 22 17:35:02 juju-e4d256-prod-github-runner-207 kernel: [43876.618451] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 17:35:02 juju-e4d256-prod-github-runner-207 kernel: [43876.620449] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 17:35:02 juju-e4d256-prod-github-runner-207 kernel: [43876.621371] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 17:35:02 juju-e4d256-prod-github-runner-207 kernel: [43876.622285] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 17:35:02 juju-e4d256-prod-github-runner-207 kernel: [43876.623201] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 17:35:02 juju-e4d256-prod-github-runner-207 kernel: [43876.624112] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 17:35:02 juju-e4d256-prod-github-runner-207 kernel: [43876.625031] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 17:35:02 juju-e4d256-prod-github-runner-207 kernel: [43876.625970] Aug 22 17:35:30 juju-e4d256-prod-github-runner-207 kernel: [43904.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 40781s! [qemu-system-x86:6715] Aug 22 17:35:30 juju-e4d256-prod-github-runner-207 kernel: [43904.543092] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 17:35:30 juju-e4d256-prod-github-runner-207 kernel: [43904.543162] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 17:35:30 juju-e4d256-prod-github-runner-207 kernel: [43904.555253] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 17:35:30 juju-e4d256-prod-github-runner-207 kernel: [43904.556523] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 17:35:30 juju-e4d256-prod-github-runner-207 kernel: [43904.557759] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:35:30 juju-e4d256-prod-github-runner-207 kernel: [43904.558820] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 17:35:30 juju-e4d256-prod-github-runner-207 kernel: [43904.561365] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 17:35:30 juju-e4d256-prod-github-runner-207 kernel: [43904.562417] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 17:35:30 juju-e4d256-prod-github-runner-207 kernel: [43904.563580] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 17:35:30 juju-e4d256-prod-github-runner-207 kernel: [43904.564740] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 17:35:30 juju-e4d256-prod-github-runner-207 kernel: [43904.565912] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 17:35:30 juju-e4d256-prod-github-runner-207 kernel: [43904.567084] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 17:35:30 juju-e4d256-prod-github-runner-207 kernel: [43904.568259] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 17:35:30 juju-e4d256-prod-github-runner-207 kernel: [43904.569492] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 17:35:30 juju-e4d256-prod-github-runner-207 kernel: [43904.570606] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 17:35:30 juju-e4d256-prod-github-runner-207 kernel: [43904.571800] Call Trace: Aug 22 17:35:30 juju-e4d256-prod-github-runner-207 kernel: [43904.572713] Aug 22 17:35:30 juju-e4d256-prod-github-runner-207 kernel: [43904.573597] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:35:30 juju-e4d256-prod-github-runner-207 kernel: [43904.574639] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:35:30 juju-e4d256-prod-github-runner-207 kernel: [43904.575659] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:35:30 juju-e4d256-prod-github-runner-207 kernel: [43904.576738] ? show_regs.part.0+0x23/0x29 Aug 22 17:35:30 juju-e4d256-prod-github-runner-207 kernel: [43904.577753] ? show_regs.cold+0x8/0xd Aug 22 17:35:30 juju-e4d256-prod-github-runner-207 kernel: [43904.578724] ? watchdog_timer_fn+0x1be/0x220 Aug 22 17:35:30 juju-e4d256-prod-github-runner-207 kernel: [43904.579737] ? lockup_detector_update_enable+0x60/0x60 Aug 22 17:35:30 juju-e4d256-prod-github-runner-207 kernel: [43904.580800] ? __hrtimer_run_queues+0x107/0x230 Aug 22 17:35:30 juju-e4d256-prod-github-runner-207 kernel: [43904.581841] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 17:35:30 juju-e4d256-prod-github-runner-207 kernel: [43904.582867] ? hrtimer_interrupt+0x101/0x220 Aug 22 17:35:30 juju-e4d256-prod-github-runner-207 kernel: [43904.583884] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 17:35:30 juju-e4d256-prod-github-runner-207 kernel: [43904.584951] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 17:35:30 juju-e4d256-prod-github-runner-207 kernel: [43904.586008] Aug 22 17:35:30 juju-e4d256-prod-github-runner-207 kernel: [43904.586864] Aug 22 17:35:30 juju-e4d256-prod-github-runner-207 kernel: [43904.587702] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 17:35:30 juju-e4d256-prod-github-runner-207 kernel: [43904.588735] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:35:30 juju-e4d256-prod-github-runner-207 kernel: [43904.589799] ? _raw_spin_lock+0x22/0x30 Aug 22 17:35:30 juju-e4d256-prod-github-runner-207 kernel: [43904.590744] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:35:30 juju-e4d256-prod-github-runner-207 kernel: [43904.591762] direct_page_fault+0x206/0x310 [kvm] Aug 22 17:35:30 juju-e4d256-prod-github-runner-207 kernel: [43904.592789] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 17:35:30 juju-e4d256-prod-github-runner-207 kernel: [43904.593810] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 17:35:30 juju-e4d256-prod-github-runner-207 kernel: [43904.595021] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 17:35:30 juju-e4d256-prod-github-runner-207 kernel: [43904.595996] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 17:35:30 juju-e4d256-prod-github-runner-207 kernel: [43904.596941] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 17:35:30 juju-e4d256-prod-github-runner-207 kernel: [43904.597939] handle_exit+0x98/0x230 [kvm_amd] Aug 22 17:35:30 juju-e4d256-prod-github-runner-207 kernel: [43904.598838] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 17:35:30 juju-e4d256-prod-github-runner-207 kernel: [43904.599760] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 17:35:30 juju-e4d256-prod-github-runner-207 kernel: [43904.600684] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 17:35:30 juju-e4d256-prod-github-runner-207 kernel: [43904.601594] vcpu_run+0x62/0x2c0 [kvm] Aug 22 17:35:30 juju-e4d256-prod-github-runner-207 kernel: [43904.602427] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 17:35:30 juju-e4d256-prod-github-runner-207 kernel: [43904.603239] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 17:35:30 juju-e4d256-prod-github-runner-207 kernel: [43904.604100] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 17:35:30 juju-e4d256-prod-github-runner-207 kernel: [43904.604902] ? __seccomp_filter+0x4a/0x4a0 Aug 22 17:35:30 juju-e4d256-prod-github-runner-207 kernel: [43904.605646] ? __fget_files+0x86/0xc0 Aug 22 17:35:30 juju-e4d256-prod-github-runner-207 kernel: [43904.606363] __x64_sys_ioctl+0x95/0xd0 Aug 22 17:35:30 juju-e4d256-prod-github-runner-207 kernel: [43904.607057] do_syscall_64+0x5c/0xc0 Aug 22 17:35:30 juju-e4d256-prod-github-runner-207 kernel: [43904.607729] ? do_futex+0x162/0x1f0 Aug 22 17:35:30 juju-e4d256-prod-github-runner-207 kernel: [43904.608379] ? __x64_sys_futex+0x78/0x1e0 Aug 22 17:35:30 juju-e4d256-prod-github-runner-207 kernel: [43904.609054] ? __secure_computing+0xa9/0x120 Aug 22 17:35:30 juju-e4d256-prod-github-runner-207 kernel: [43904.609768] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 17:35:30 juju-e4d256-prod-github-runner-207 kernel: [43904.610717] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:35:30 juju-e4d256-prod-github-runner-207 kernel: [43904.611445] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:35:30 juju-e4d256-prod-github-runner-207 kernel: [43904.612165] ? do_syscall_64+0x69/0xc0 Aug 22 17:35:30 juju-e4d256-prod-github-runner-207 kernel: [43904.612988] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:35:30 juju-e4d256-prod-github-runner-207 kernel: [43904.613691] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:35:30 juju-e4d256-prod-github-runner-207 kernel: [43904.614401] ? do_syscall_64+0x69/0xc0 Aug 22 17:35:30 juju-e4d256-prod-github-runner-207 kernel: [43904.615026] ? do_syscall_64+0x69/0xc0 Aug 22 17:35:30 juju-e4d256-prod-github-runner-207 kernel: [43904.615649] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 17:35:30 juju-e4d256-prod-github-runner-207 kernel: [43904.616356] RIP: 0033:0x7faa5d0edaff Aug 22 17:35:30 juju-e4d256-prod-github-runner-207 kernel: [43904.616982] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 17:35:30 juju-e4d256-prod-github-runner-207 kernel: [43904.618996] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 17:35:30 juju-e4d256-prod-github-runner-207 kernel: [43904.619909] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 17:35:30 juju-e4d256-prod-github-runner-207 kernel: [43904.620798] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 17:35:30 juju-e4d256-prod-github-runner-207 kernel: [43904.621687] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 17:35:30 juju-e4d256-prod-github-runner-207 kernel: [43904.622590] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 17:35:30 juju-e4d256-prod-github-runner-207 kernel: [43904.623486] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 17:35:30 juju-e4d256-prod-github-runner-207 kernel: [43904.624379] Aug 22 17:35:46 juju-e4d256-prod-github-runner-207 kernel: [43920.116706] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 17:35:46 juju-e4d256-prod-github-runner-207 kernel: [43920.117747] rcu: 1-....: (10916405 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=5283294 Aug 22 17:35:46 juju-e4d256-prod-github-runner-207 kernel: [43920.118869] (t=10950729 jiffies g=23269 q=43711) Aug 22 17:35:46 juju-e4d256-prod-github-runner-207 kernel: [43920.119654] NMI backtrace for cpu 1 Aug 22 17:35:46 juju-e4d256-prod-github-runner-207 kernel: [43920.120364] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 17:35:46 juju-e4d256-prod-github-runner-207 kernel: [43920.121471] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 17:35:46 juju-e4d256-prod-github-runner-207 kernel: [43920.122543] Call Trace: Aug 22 17:35:46 juju-e4d256-prod-github-runner-207 kernel: [43920.123218] Aug 22 17:35:46 juju-e4d256-prod-github-runner-207 kernel: [43920.123864] show_stack+0x52/0x5c Aug 22 17:35:46 juju-e4d256-prod-github-runner-207 kernel: [43920.124593] dump_stack_lvl+0x4a/0x63 Aug 22 17:35:46 juju-e4d256-prod-github-runner-207 kernel: [43920.125497] dump_stack+0x10/0x16 Aug 22 17:35:46 juju-e4d256-prod-github-runner-207 kernel: [43920.126273] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 17:35:46 juju-e4d256-prod-github-runner-207 kernel: [43920.127054] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 17:35:46 juju-e4d256-prod-github-runner-207 kernel: [43920.127833] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 17:35:46 juju-e4d256-prod-github-runner-207 kernel: [43920.128658] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 17:35:46 juju-e4d256-prod-github-runner-207 kernel: [43920.129477] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 17:35:46 juju-e4d256-prod-github-runner-207 kernel: [43920.130362] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 17:35:46 juju-e4d256-prod-github-runner-207 kernel: [43920.131178] print_cpu_stall.cold+0x2f/0xe2 Aug 22 17:35:46 juju-e4d256-prod-github-runner-207 kernel: [43920.131941] ? timekeeping_update+0xf7/0x150 Aug 22 17:35:46 juju-e4d256-prod-github-runner-207 kernel: [43920.132709] check_cpu_stall+0x109/0x270 Aug 22 17:35:46 juju-e4d256-prod-github-runner-207 kernel: [43920.133455] rcu_sched_clock_irq+0x9a/0x250 Aug 22 17:35:46 juju-e4d256-prod-github-runner-207 kernel: [43920.134228] update_process_times+0x94/0xd0 Aug 22 17:35:46 juju-e4d256-prod-github-runner-207 kernel: [43920.134989] tick_sched_handle+0x29/0x70 Aug 22 17:35:46 juju-e4d256-prod-github-runner-207 kernel: [43920.135734] tick_sched_timer+0x8c/0xc0 Aug 22 17:35:46 juju-e4d256-prod-github-runner-207 kernel: [43920.136470] ? tick_nohz_handler+0xb0/0xb0 Aug 22 17:35:46 juju-e4d256-prod-github-runner-207 kernel: [43920.137224] __hrtimer_run_queues+0x107/0x230 Aug 22 17:35:46 juju-e4d256-prod-github-runner-207 kernel: [43920.138003] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 17:35:46 juju-e4d256-prod-github-runner-207 kernel: [43920.138777] hrtimer_interrupt+0x101/0x220 Aug 22 17:35:46 juju-e4d256-prod-github-runner-207 kernel: [43920.139537] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 17:35:46 juju-e4d256-prod-github-runner-207 kernel: [43920.140347] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 17:35:46 juju-e4d256-prod-github-runner-207 kernel: [43920.141151] Aug 22 17:35:46 juju-e4d256-prod-github-runner-207 kernel: [43920.141804] Aug 22 17:35:46 juju-e4d256-prod-github-runner-207 kernel: [43920.142434] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 17:35:46 juju-e4d256-prod-github-runner-207 kernel: [43920.143251] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:35:46 juju-e4d256-prod-github-runner-207 kernel: [43920.144135] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 17:35:46 juju-e4d256-prod-github-runner-207 kernel: [43920.146352] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 17:35:46 juju-e4d256-prod-github-runner-207 kernel: [43920.147230] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 17:35:46 juju-e4d256-prod-github-runner-207 kernel: [43920.148221] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 17:35:46 juju-e4d256-prod-github-runner-207 kernel: [43920.149196] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 17:35:46 juju-e4d256-prod-github-runner-207 kernel: [43920.150174] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 17:35:46 juju-e4d256-prod-github-runner-207 kernel: [43920.151127] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 17:35:46 juju-e4d256-prod-github-runner-207 kernel: [43920.152078] ? _raw_spin_lock+0x22/0x30 Aug 22 17:35:46 juju-e4d256-prod-github-runner-207 kernel: [43920.152847] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:35:46 juju-e4d256-prod-github-runner-207 kernel: [43920.153750] direct_page_fault+0x206/0x310 [kvm] Aug 22 17:35:46 juju-e4d256-prod-github-runner-207 kernel: [43920.154618] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 17:35:46 juju-e4d256-prod-github-runner-207 kernel: [43920.155444] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 17:35:46 juju-e4d256-prod-github-runner-207 kernel: [43920.156275] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 17:35:46 juju-e4d256-prod-github-runner-207 kernel: [43920.157090] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 17:35:46 juju-e4d256-prod-github-runner-207 kernel: [43920.157880] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 17:35:46 juju-e4d256-prod-github-runner-207 kernel: [43920.158705] handle_exit+0x98/0x230 [kvm_amd] Aug 22 17:35:46 juju-e4d256-prod-github-runner-207 kernel: [43920.159457] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 17:35:46 juju-e4d256-prod-github-runner-207 kernel: [43920.160245] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 17:35:46 juju-e4d256-prod-github-runner-207 kernel: [43920.161044] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 17:35:46 juju-e4d256-prod-github-runner-207 kernel: [43920.161872] vcpu_run+0x62/0x2c0 [kvm] Aug 22 17:35:46 juju-e4d256-prod-github-runner-207 kernel: [43920.162609] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 17:35:46 juju-e4d256-prod-github-runner-207 kernel: [43920.163341] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 17:35:46 juju-e4d256-prod-github-runner-207 kernel: [43920.164140] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 17:35:46 juju-e4d256-prod-github-runner-207 kernel: [43920.164902] ? __seccomp_filter+0x4a/0x4a0 Aug 22 17:35:46 juju-e4d256-prod-github-runner-207 kernel: [43920.165633] ? __fget_files+0x86/0xc0 Aug 22 17:35:46 juju-e4d256-prod-github-runner-207 kernel: [43920.166326] __x64_sys_ioctl+0x95/0xd0 Aug 22 17:35:46 juju-e4d256-prod-github-runner-207 kernel: [43920.167018] do_syscall_64+0x5c/0xc0 Aug 22 17:35:46 juju-e4d256-prod-github-runner-207 kernel: [43920.167697] ? do_futex+0x162/0x1f0 Aug 22 17:35:46 juju-e4d256-prod-github-runner-207 kernel: [43920.168367] ? __x64_sys_futex+0x78/0x1e0 Aug 22 17:35:46 juju-e4d256-prod-github-runner-207 kernel: [43920.169069] ? __secure_computing+0xa9/0x120 Aug 22 17:35:46 juju-e4d256-prod-github-runner-207 kernel: [43920.169822] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 17:35:46 juju-e4d256-prod-github-runner-207 kernel: [43920.170630] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:35:46 juju-e4d256-prod-github-runner-207 kernel: [43920.171383] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:35:46 juju-e4d256-prod-github-runner-207 kernel: [43920.172134] ? do_syscall_64+0x69/0xc0 Aug 22 17:35:46 juju-e4d256-prod-github-runner-207 kernel: [43920.172822] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:35:46 juju-e4d256-prod-github-runner-207 kernel: [43920.173586] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:35:46 juju-e4d256-prod-github-runner-207 kernel: [43920.174345] ? do_syscall_64+0x69/0xc0 Aug 22 17:35:46 juju-e4d256-prod-github-runner-207 kernel: [43920.175045] ? do_syscall_64+0x69/0xc0 Aug 22 17:35:46 juju-e4d256-prod-github-runner-207 kernel: [43920.175732] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 17:35:46 juju-e4d256-prod-github-runner-207 kernel: [43920.176501] RIP: 0033:0x7faa5d0edaff Aug 22 17:35:46 juju-e4d256-prod-github-runner-207 kernel: [43920.177184] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 17:35:46 juju-e4d256-prod-github-runner-207 kernel: [43920.179387] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 17:35:46 juju-e4d256-prod-github-runner-207 kernel: [43920.180349] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 17:35:46 juju-e4d256-prod-github-runner-207 kernel: [43920.181296] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 17:35:46 juju-e4d256-prod-github-runner-207 kernel: [43920.182249] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 17:35:46 juju-e4d256-prod-github-runner-207 kernel: [43920.183187] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 17:35:46 juju-e4d256-prod-github-runner-207 kernel: [43920.184111] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 17:35:46 juju-e4d256-prod-github-runner-207 kernel: [43920.185029] Aug 22 17:36:10 juju-e4d256-prod-github-runner-207 kernel: [43944.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 40818s! [qemu-system-x86:6715] Aug 22 17:36:10 juju-e4d256-prod-github-runner-207 kernel: [43944.543788] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 17:36:10 juju-e4d256-prod-github-runner-207 kernel: [43944.544051] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 17:36:10 juju-e4d256-prod-github-runner-207 kernel: [43944.556452] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 17:36:10 juju-e4d256-prod-github-runner-207 kernel: [43944.557777] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 17:36:10 juju-e4d256-prod-github-runner-207 kernel: [43944.559030] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:36:10 juju-e4d256-prod-github-runner-207 kernel: [43944.560137] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 17:36:10 juju-e4d256-prod-github-runner-207 kernel: [43944.562787] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 17:36:10 juju-e4d256-prod-github-runner-207 kernel: [43944.563840] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 17:36:10 juju-e4d256-prod-github-runner-207 kernel: [43944.565025] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 17:36:10 juju-e4d256-prod-github-runner-207 kernel: [43944.566231] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 17:36:10 juju-e4d256-prod-github-runner-207 kernel: [43944.567407] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 17:36:10 juju-e4d256-prod-github-runner-207 kernel: [43944.568582] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 17:36:10 juju-e4d256-prod-github-runner-207 kernel: [43944.569853] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 17:36:10 juju-e4d256-prod-github-runner-207 kernel: [43944.571124] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 17:36:10 juju-e4d256-prod-github-runner-207 kernel: [43944.572233] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 17:36:10 juju-e4d256-prod-github-runner-207 kernel: [43944.573452] Call Trace: Aug 22 17:36:10 juju-e4d256-prod-github-runner-207 kernel: [43944.574370] Aug 22 17:36:10 juju-e4d256-prod-github-runner-207 kernel: [43944.575265] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:36:10 juju-e4d256-prod-github-runner-207 kernel: [43944.576308] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:36:10 juju-e4d256-prod-github-runner-207 kernel: [43944.577350] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:36:10 juju-e4d256-prod-github-runner-207 kernel: [43944.578441] ? show_regs.part.0+0x23/0x29 Aug 22 17:36:10 juju-e4d256-prod-github-runner-207 kernel: [43944.579450] ? show_regs.cold+0x8/0xd Aug 22 17:36:10 juju-e4d256-prod-github-runner-207 kernel: [43944.580438] ? watchdog_timer_fn+0x1be/0x220 Aug 22 17:36:10 juju-e4d256-prod-github-runner-207 kernel: [43944.581483] ? lockup_detector_update_enable+0x60/0x60 Aug 22 17:36:10 juju-e4d256-prod-github-runner-207 kernel: [43944.582560] ? __hrtimer_run_queues+0x107/0x230 Aug 22 17:36:10 juju-e4d256-prod-github-runner-207 kernel: [43944.583595] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 17:36:10 juju-e4d256-prod-github-runner-207 kernel: [43944.584636] ? hrtimer_interrupt+0x101/0x220 Aug 22 17:36:10 juju-e4d256-prod-github-runner-207 kernel: [43944.585797] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 17:36:10 juju-e4d256-prod-github-runner-207 kernel: [43944.586919] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 17:36:10 juju-e4d256-prod-github-runner-207 kernel: [43944.587992] Aug 22 17:36:10 juju-e4d256-prod-github-runner-207 kernel: [43944.588854] Aug 22 17:36:10 juju-e4d256-prod-github-runner-207 kernel: [43944.589718] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 17:36:10 juju-e4d256-prod-github-runner-207 kernel: [43944.590781] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:36:10 juju-e4d256-prod-github-runner-207 kernel: [43944.591835] ? _raw_spin_lock+0x22/0x30 Aug 22 17:36:10 juju-e4d256-prod-github-runner-207 kernel: [43944.592794] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:36:10 juju-e4d256-prod-github-runner-207 kernel: [43944.593845] direct_page_fault+0x206/0x310 [kvm] Aug 22 17:36:10 juju-e4d256-prod-github-runner-207 kernel: [43944.594878] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 17:36:10 juju-e4d256-prod-github-runner-207 kernel: [43944.595899] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 17:36:10 juju-e4d256-prod-github-runner-207 kernel: [43944.596907] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 17:36:10 juju-e4d256-prod-github-runner-207 kernel: [43944.597930] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 17:36:10 juju-e4d256-prod-github-runner-207 kernel: [43944.598897] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 17:36:10 juju-e4d256-prod-github-runner-207 kernel: [43944.600019] handle_exit+0x98/0x230 [kvm_amd] Aug 22 17:36:10 juju-e4d256-prod-github-runner-207 kernel: [43944.601038] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 17:36:10 juju-e4d256-prod-github-runner-207 kernel: [43944.602090] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 17:36:10 juju-e4d256-prod-github-runner-207 kernel: [43944.603120] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 17:36:10 juju-e4d256-prod-github-runner-207 kernel: [43944.604092] vcpu_run+0x62/0x2c0 [kvm] Aug 22 17:36:10 juju-e4d256-prod-github-runner-207 kernel: [43944.604914] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 17:36:10 juju-e4d256-prod-github-runner-207 kernel: [43944.605764] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 17:36:10 juju-e4d256-prod-github-runner-207 kernel: [43944.606622] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 17:36:10 juju-e4d256-prod-github-runner-207 kernel: [43944.607441] ? __seccomp_filter+0x4a/0x4a0 Aug 22 17:36:10 juju-e4d256-prod-github-runner-207 kernel: [43944.608194] ? __fget_files+0x86/0xc0 Aug 22 17:36:10 juju-e4d256-prod-github-runner-207 kernel: [43944.608926] __x64_sys_ioctl+0x95/0xd0 Aug 22 17:36:10 juju-e4d256-prod-github-runner-207 kernel: [43944.609646] do_syscall_64+0x5c/0xc0 Aug 22 17:36:10 juju-e4d256-prod-github-runner-207 kernel: [43944.610320] ? do_futex+0x162/0x1f0 Aug 22 17:36:10 juju-e4d256-prod-github-runner-207 kernel: [43944.610979] ? __x64_sys_futex+0x78/0x1e0 Aug 22 17:36:10 juju-e4d256-prod-github-runner-207 kernel: [43944.611662] ? __secure_computing+0xa9/0x120 Aug 22 17:36:10 juju-e4d256-prod-github-runner-207 kernel: [43944.612367] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 17:36:10 juju-e4d256-prod-github-runner-207 kernel: [43944.613131] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:36:10 juju-e4d256-prod-github-runner-207 kernel: [43944.613877] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:36:10 juju-e4d256-prod-github-runner-207 kernel: [43944.614600] ? do_syscall_64+0x69/0xc0 Aug 22 17:36:10 juju-e4d256-prod-github-runner-207 kernel: [43944.615281] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:36:10 juju-e4d256-prod-github-runner-207 kernel: [43944.615995] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:36:10 juju-e4d256-prod-github-runner-207 kernel: [43944.616701] ? do_syscall_64+0x69/0xc0 Aug 22 17:36:10 juju-e4d256-prod-github-runner-207 kernel: [43944.617345] ? do_syscall_64+0x69/0xc0 Aug 22 17:36:10 juju-e4d256-prod-github-runner-207 kernel: [43944.617987] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 17:36:10 juju-e4d256-prod-github-runner-207 kernel: [43944.618709] RIP: 0033:0x7faa5d0edaff Aug 22 17:36:10 juju-e4d256-prod-github-runner-207 kernel: [43944.619371] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 17:36:10 juju-e4d256-prod-github-runner-207 kernel: [43944.621418] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 17:36:10 juju-e4d256-prod-github-runner-207 kernel: [43944.622342] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 17:36:10 juju-e4d256-prod-github-runner-207 kernel: [43944.623242] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 17:36:10 juju-e4d256-prod-github-runner-207 kernel: [43944.624158] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 17:36:10 juju-e4d256-prod-github-runner-207 kernel: [43944.625055] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 17:36:10 juju-e4d256-prod-github-runner-207 kernel: [43944.625968] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 17:36:10 juju-e4d256-prod-github-runner-207 kernel: [43944.626883] Aug 22 17:36:38 juju-e4d256-prod-github-runner-207 kernel: [43972.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 40844s! [qemu-system-x86:6715] Aug 22 17:36:38 juju-e4d256-prod-github-runner-207 kernel: [43972.543145] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 17:36:38 juju-e4d256-prod-github-runner-207 kernel: [43972.543213] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 17:36:38 juju-e4d256-prod-github-runner-207 kernel: [43972.555971] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 17:36:38 juju-e4d256-prod-github-runner-207 kernel: [43972.557291] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 17:36:38 juju-e4d256-prod-github-runner-207 kernel: [43972.558550] RIP: 0010:native_queued_spin_lock_slowpath+0xc/0x40 Aug 22 17:36:38 juju-e4d256-prod-github-runner-207 kernel: [43972.559629] Code: fe ff ff eb af 4c 89 fe 48 c7 c7 20 99 e9 89 e8 ca 69 55 00 e9 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 <8b> 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 eb Aug 22 17:36:38 juju-e4d256-prod-github-runner-207 kernel: [43972.562257] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 17:36:38 juju-e4d256-prod-github-runner-207 kernel: [43972.563336] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 17:36:38 juju-e4d256-prod-github-runner-207 kernel: [43972.564536] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 17:36:38 juju-e4d256-prod-github-runner-207 kernel: [43972.565736] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 17:36:38 juju-e4d256-prod-github-runner-207 kernel: [43972.566930] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 17:36:38 juju-e4d256-prod-github-runner-207 kernel: [43972.568132] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 17:36:38 juju-e4d256-prod-github-runner-207 kernel: [43972.569338] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 17:36:38 juju-e4d256-prod-github-runner-207 kernel: [43972.570606] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 17:36:38 juju-e4d256-prod-github-runner-207 kernel: [43972.571734] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 17:36:38 juju-e4d256-prod-github-runner-207 kernel: [43972.572972] Call Trace: Aug 22 17:36:38 juju-e4d256-prod-github-runner-207 kernel: [43972.573913] Aug 22 17:36:38 juju-e4d256-prod-github-runner-207 kernel: [43972.574820] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:36:38 juju-e4d256-prod-github-runner-207 kernel: [43972.575881] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:36:38 juju-e4d256-prod-github-runner-207 kernel: [43972.576940] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:36:38 juju-e4d256-prod-github-runner-207 kernel: [43972.578075] ? show_regs.part.0+0x23/0x29 Aug 22 17:36:38 juju-e4d256-prod-github-runner-207 kernel: [43972.579100] ? show_regs.cold+0x8/0xd Aug 22 17:36:38 juju-e4d256-prod-github-runner-207 kernel: [43972.580098] ? watchdog_timer_fn+0x1be/0x220 Aug 22 17:36:38 juju-e4d256-prod-github-runner-207 kernel: [43972.581136] ? lockup_detector_update_enable+0x60/0x60 Aug 22 17:36:38 juju-e4d256-prod-github-runner-207 kernel: [43972.582212] ? __hrtimer_run_queues+0x107/0x230 Aug 22 17:36:38 juju-e4d256-prod-github-runner-207 kernel: [43972.583273] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 17:36:38 juju-e4d256-prod-github-runner-207 kernel: [43972.584318] ? hrtimer_interrupt+0x101/0x220 Aug 22 17:36:38 juju-e4d256-prod-github-runner-207 kernel: [43972.585365] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 17:36:38 juju-e4d256-prod-github-runner-207 kernel: [43972.586453] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 17:36:38 juju-e4d256-prod-github-runner-207 kernel: [43972.587522] Aug 22 17:36:38 juju-e4d256-prod-github-runner-207 kernel: [43972.588409] Aug 22 17:36:38 juju-e4d256-prod-github-runner-207 kernel: [43972.589278] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 17:36:38 juju-e4d256-prod-github-runner-207 kernel: [43972.590333] ? native_queued_spin_lock_slowpath+0xc/0x40 Aug 22 17:36:38 juju-e4d256-prod-github-runner-207 kernel: [43972.591392] ? _raw_spin_lock+0x22/0x30 Aug 22 17:36:38 juju-e4d256-prod-github-runner-207 kernel: [43972.592337] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:36:38 juju-e4d256-prod-github-runner-207 kernel: [43972.593386] direct_page_fault+0x206/0x310 [kvm] Aug 22 17:36:38 juju-e4d256-prod-github-runner-207 kernel: [43972.594441] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 17:36:38 juju-e4d256-prod-github-runner-207 kernel: [43972.595475] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 17:36:38 juju-e4d256-prod-github-runner-207 kernel: [43972.596511] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 17:36:38 juju-e4d256-prod-github-runner-207 kernel: [43972.597523] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 17:36:38 juju-e4d256-prod-github-runner-207 kernel: [43972.598485] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 17:36:38 juju-e4d256-prod-github-runner-207 kernel: [43972.599490] handle_exit+0x98/0x230 [kvm_amd] Aug 22 17:36:38 juju-e4d256-prod-github-runner-207 kernel: [43972.600407] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 17:36:38 juju-e4d256-prod-github-runner-207 kernel: [43972.601368] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 17:36:38 juju-e4d256-prod-github-runner-207 kernel: [43972.602308] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 17:36:38 juju-e4d256-prod-github-runner-207 kernel: [43972.603232] vcpu_run+0x62/0x2c0 [kvm] Aug 22 17:36:38 juju-e4d256-prod-github-runner-207 kernel: [43972.604044] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 17:36:38 juju-e4d256-prod-github-runner-207 kernel: [43972.604862] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 17:36:38 juju-e4d256-prod-github-runner-207 kernel: [43972.605744] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 17:36:38 juju-e4d256-prod-github-runner-207 kernel: [43972.606566] ? __seccomp_filter+0x4a/0x4a0 Aug 22 17:36:38 juju-e4d256-prod-github-runner-207 kernel: [43972.607330] ? __fget_files+0x86/0xc0 Aug 22 17:36:38 juju-e4d256-prod-github-runner-207 kernel: [43972.608053] __x64_sys_ioctl+0x95/0xd0 Aug 22 17:36:38 juju-e4d256-prod-github-runner-207 kernel: [43972.608757] do_syscall_64+0x5c/0xc0 Aug 22 17:36:38 juju-e4d256-prod-github-runner-207 kernel: [43972.609442] ? do_futex+0x162/0x1f0 Aug 22 17:36:38 juju-e4d256-prod-github-runner-207 kernel: [43972.610091] ? __x64_sys_futex+0x78/0x1e0 Aug 22 17:36:38 juju-e4d256-prod-github-runner-207 kernel: [43972.610784] ? __secure_computing+0xa9/0x120 Aug 22 17:36:38 juju-e4d256-prod-github-runner-207 kernel: [43972.611488] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 17:36:38 juju-e4d256-prod-github-runner-207 kernel: [43972.612269] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:36:38 juju-e4d256-prod-github-runner-207 kernel: [43972.613041] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:36:38 juju-e4d256-prod-github-runner-207 kernel: [43972.613777] ? do_syscall_64+0x69/0xc0 Aug 22 17:36:38 juju-e4d256-prod-github-runner-207 kernel: [43972.614437] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:36:38 juju-e4d256-prod-github-runner-207 kernel: [43972.615170] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:36:38 juju-e4d256-prod-github-runner-207 kernel: [43972.616040] ? do_syscall_64+0x69/0xc0 Aug 22 17:36:38 juju-e4d256-prod-github-runner-207 kernel: [43972.616678] ? do_syscall_64+0x69/0xc0 Aug 22 17:36:38 juju-e4d256-prod-github-runner-207 kernel: [43972.617335] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 17:36:38 juju-e4d256-prod-github-runner-207 kernel: [43972.618070] RIP: 0033:0x7faa5d0edaff Aug 22 17:36:38 juju-e4d256-prod-github-runner-207 kernel: [43972.618718] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 17:36:38 juju-e4d256-prod-github-runner-207 kernel: [43972.620746] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 17:36:38 juju-e4d256-prod-github-runner-207 kernel: [43972.621702] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 17:36:38 juju-e4d256-prod-github-runner-207 kernel: [43972.622607] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 17:36:38 juju-e4d256-prod-github-runner-207 kernel: [43972.623520] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 17:36:38 juju-e4d256-prod-github-runner-207 kernel: [43972.624428] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 17:36:38 juju-e4d256-prod-github-runner-207 kernel: [43972.625344] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 17:36:38 juju-e4d256-prod-github-runner-207 kernel: [43972.626256] Aug 22 17:37:06 juju-e4d256-prod-github-runner-207 kernel: [44000.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 40870s! [qemu-system-x86:6715] Aug 22 17:37:06 juju-e4d256-prod-github-runner-207 kernel: [44000.543097] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 17:37:06 juju-e4d256-prod-github-runner-207 kernel: [44000.543165] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 17:37:06 juju-e4d256-prod-github-runner-207 kernel: [44000.555242] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 17:37:06 juju-e4d256-prod-github-runner-207 kernel: [44000.556509] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 17:37:06 juju-e4d256-prod-github-runner-207 kernel: [44000.557741] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:37:06 juju-e4d256-prod-github-runner-207 kernel: [44000.558800] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 17:37:06 juju-e4d256-prod-github-runner-207 kernel: [44000.561352] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 17:37:06 juju-e4d256-prod-github-runner-207 kernel: [44000.562398] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 17:37:06 juju-e4d256-prod-github-runner-207 kernel: [44000.563562] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 17:37:06 juju-e4d256-prod-github-runner-207 kernel: [44000.564730] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 17:37:06 juju-e4d256-prod-github-runner-207 kernel: [44000.565889] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 17:37:06 juju-e4d256-prod-github-runner-207 kernel: [44000.567051] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 17:37:06 juju-e4d256-prod-github-runner-207 kernel: [44000.568220] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 17:37:06 juju-e4d256-prod-github-runner-207 kernel: [44000.569464] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 17:37:06 juju-e4d256-prod-github-runner-207 kernel: [44000.570567] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 17:37:06 juju-e4d256-prod-github-runner-207 kernel: [44000.571763] Call Trace: Aug 22 17:37:06 juju-e4d256-prod-github-runner-207 kernel: [44000.572687] Aug 22 17:37:06 juju-e4d256-prod-github-runner-207 kernel: [44000.573577] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:37:06 juju-e4d256-prod-github-runner-207 kernel: [44000.574611] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:37:06 juju-e4d256-prod-github-runner-207 kernel: [44000.575636] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:37:06 juju-e4d256-prod-github-runner-207 kernel: [44000.576722] ? show_regs.part.0+0x23/0x29 Aug 22 17:37:06 juju-e4d256-prod-github-runner-207 kernel: [44000.577723] ? show_regs.cold+0x8/0xd Aug 22 17:37:06 juju-e4d256-prod-github-runner-207 kernel: [44000.578702] ? watchdog_timer_fn+0x1be/0x220 Aug 22 17:37:06 juju-e4d256-prod-github-runner-207 kernel: [44000.579714] ? lockup_detector_update_enable+0x60/0x60 Aug 22 17:37:06 juju-e4d256-prod-github-runner-207 kernel: [44000.580796] ? __hrtimer_run_queues+0x107/0x230 Aug 22 17:37:06 juju-e4d256-prod-github-runner-207 kernel: [44000.581825] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 17:37:06 juju-e4d256-prod-github-runner-207 kernel: [44000.582848] ? hrtimer_interrupt+0x101/0x220 Aug 22 17:37:06 juju-e4d256-prod-github-runner-207 kernel: [44000.583867] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 17:37:06 juju-e4d256-prod-github-runner-207 kernel: [44000.584946] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 17:37:06 juju-e4d256-prod-github-runner-207 kernel: [44000.585992] Aug 22 17:37:06 juju-e4d256-prod-github-runner-207 kernel: [44000.586846] Aug 22 17:37:06 juju-e4d256-prod-github-runner-207 kernel: [44000.587683] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 17:37:06 juju-e4d256-prod-github-runner-207 kernel: [44000.588730] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:37:06 juju-e4d256-prod-github-runner-207 kernel: [44000.589769] ? _raw_spin_lock+0x22/0x30 Aug 22 17:37:06 juju-e4d256-prod-github-runner-207 kernel: [44000.590721] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:37:06 juju-e4d256-prod-github-runner-207 kernel: [44000.591739] direct_page_fault+0x206/0x310 [kvm] Aug 22 17:37:06 juju-e4d256-prod-github-runner-207 kernel: [44000.592776] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 17:37:06 juju-e4d256-prod-github-runner-207 kernel: [44000.593791] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 17:37:06 juju-e4d256-prod-github-runner-207 kernel: [44000.594791] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 17:37:06 juju-e4d256-prod-github-runner-207 kernel: [44000.595887] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 17:37:06 juju-e4d256-prod-github-runner-207 kernel: [44000.596951] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 17:37:06 juju-e4d256-prod-github-runner-207 kernel: [44000.598043] handle_exit+0x98/0x230 [kvm_amd] Aug 22 17:37:06 juju-e4d256-prod-github-runner-207 kernel: [44000.599024] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 17:37:06 juju-e4d256-prod-github-runner-207 kernel: [44000.600032] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 17:37:06 juju-e4d256-prod-github-runner-207 kernel: [44000.601077] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 17:37:06 juju-e4d256-prod-github-runner-207 kernel: [44000.602088] vcpu_run+0x62/0x2c0 [kvm] Aug 22 17:37:06 juju-e4d256-prod-github-runner-207 kernel: [44000.602979] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 17:37:06 juju-e4d256-prod-github-runner-207 kernel: [44000.603873] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 17:37:06 juju-e4d256-prod-github-runner-207 kernel: [44000.604835] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 17:37:06 juju-e4d256-prod-github-runner-207 kernel: [44000.605721] ? __seccomp_filter+0x4a/0x4a0 Aug 22 17:37:06 juju-e4d256-prod-github-runner-207 kernel: [44000.606552] ? __fget_files+0x86/0xc0 Aug 22 17:37:06 juju-e4d256-prod-github-runner-207 kernel: [44000.607335] __x64_sys_ioctl+0x95/0xd0 Aug 22 17:37:06 juju-e4d256-prod-github-runner-207 kernel: [44000.608106] do_syscall_64+0x5c/0xc0 Aug 22 17:37:06 juju-e4d256-prod-github-runner-207 kernel: [44000.608868] ? do_futex+0x162/0x1f0 Aug 22 17:37:06 juju-e4d256-prod-github-runner-207 kernel: [44000.609599] ? __x64_sys_futex+0x78/0x1e0 Aug 22 17:37:06 juju-e4d256-prod-github-runner-207 kernel: [44000.610358] ? __secure_computing+0xa9/0x120 Aug 22 17:37:06 juju-e4d256-prod-github-runner-207 kernel: [44000.611139] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 17:37:06 juju-e4d256-prod-github-runner-207 kernel: [44000.612002] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:37:06 juju-e4d256-prod-github-runner-207 kernel: [44000.612833] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:37:06 juju-e4d256-prod-github-runner-207 kernel: [44000.613649] ? do_syscall_64+0x69/0xc0 Aug 22 17:37:06 juju-e4d256-prod-github-runner-207 kernel: [44000.614371] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:37:06 juju-e4d256-prod-github-runner-207 kernel: [44000.615170] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:37:06 juju-e4d256-prod-github-runner-207 kernel: [44000.615984] ? do_syscall_64+0x69/0xc0 Aug 22 17:37:06 juju-e4d256-prod-github-runner-207 kernel: [44000.616709] ? do_syscall_64+0x69/0xc0 Aug 22 17:37:06 juju-e4d256-prod-github-runner-207 kernel: [44000.617407] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 17:37:06 juju-e4d256-prod-github-runner-207 kernel: [44000.618212] RIP: 0033:0x7faa5d0edaff Aug 22 17:37:06 juju-e4d256-prod-github-runner-207 kernel: [44000.618917] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 17:37:06 juju-e4d256-prod-github-runner-207 kernel: [44000.621262] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 17:37:06 juju-e4d256-prod-github-runner-207 kernel: [44000.622321] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 17:37:06 juju-e4d256-prod-github-runner-207 kernel: [44000.623343] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 17:37:06 juju-e4d256-prod-github-runner-207 kernel: [44000.624397] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 17:37:06 juju-e4d256-prod-github-runner-207 kernel: [44000.625449] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 17:37:06 juju-e4d256-prod-github-runner-207 kernel: [44000.626474] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 17:37:06 juju-e4d256-prod-github-runner-207 kernel: [44000.627505] Aug 22 17:37:34 juju-e4d256-prod-github-runner-207 kernel: [44028.541976] watchdog: BUG: soft lockup - CPU#1 stuck for 40896s! [qemu-system-x86:6715] Aug 22 17:37:34 juju-e4d256-prod-github-runner-207 kernel: [44028.543679] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 17:37:34 juju-e4d256-prod-github-runner-207 kernel: [44028.543907] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 17:37:34 juju-e4d256-prod-github-runner-207 kernel: [44028.556020] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 17:37:34 juju-e4d256-prod-github-runner-207 kernel: [44028.557298] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 17:37:34 juju-e4d256-prod-github-runner-207 kernel: [44028.558530] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:37:34 juju-e4d256-prod-github-runner-207 kernel: [44028.559599] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 17:37:34 juju-e4d256-prod-github-runner-207 kernel: [44028.562161] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 17:37:34 juju-e4d256-prod-github-runner-207 kernel: [44028.563200] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 17:37:34 juju-e4d256-prod-github-runner-207 kernel: [44028.564375] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 17:37:34 juju-e4d256-prod-github-runner-207 kernel: [44028.565532] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 17:37:34 juju-e4d256-prod-github-runner-207 kernel: [44028.566688] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 17:37:34 juju-e4d256-prod-github-runner-207 kernel: [44028.567854] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 17:37:34 juju-e4d256-prod-github-runner-207 kernel: [44028.569035] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 17:37:34 juju-e4d256-prod-github-runner-207 kernel: [44028.570264] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 17:37:34 juju-e4d256-prod-github-runner-207 kernel: [44028.571366] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 17:37:34 juju-e4d256-prod-github-runner-207 kernel: [44028.572572] Call Trace: Aug 22 17:37:34 juju-e4d256-prod-github-runner-207 kernel: [44028.573492] Aug 22 17:37:34 juju-e4d256-prod-github-runner-207 kernel: [44028.574392] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:37:34 juju-e4d256-prod-github-runner-207 kernel: [44028.575428] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:37:34 juju-e4d256-prod-github-runner-207 kernel: [44028.576459] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:37:34 juju-e4d256-prod-github-runner-207 kernel: [44028.577546] ? show_regs.part.0+0x23/0x29 Aug 22 17:37:34 juju-e4d256-prod-github-runner-207 kernel: [44028.578544] ? show_regs.cold+0x8/0xd Aug 22 17:37:34 juju-e4d256-prod-github-runner-207 kernel: [44028.579514] ? watchdog_timer_fn+0x1be/0x220 Aug 22 17:37:34 juju-e4d256-prod-github-runner-207 kernel: [44028.580539] ? lockup_detector_update_enable+0x60/0x60 Aug 22 17:37:34 juju-e4d256-prod-github-runner-207 kernel: [44028.581622] ? __hrtimer_run_queues+0x107/0x230 Aug 22 17:37:34 juju-e4d256-prod-github-runner-207 kernel: [44028.582653] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 17:37:34 juju-e4d256-prod-github-runner-207 kernel: [44028.583674] ? hrtimer_interrupt+0x101/0x220 Aug 22 17:37:34 juju-e4d256-prod-github-runner-207 kernel: [44028.584698] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 17:37:34 juju-e4d256-prod-github-runner-207 kernel: [44028.585768] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 17:37:34 juju-e4d256-prod-github-runner-207 kernel: [44028.586812] Aug 22 17:37:34 juju-e4d256-prod-github-runner-207 kernel: [44028.587663] Aug 22 17:37:34 juju-e4d256-prod-github-runner-207 kernel: [44028.588508] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 17:37:34 juju-e4d256-prod-github-runner-207 kernel: [44028.589541] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:37:34 juju-e4d256-prod-github-runner-207 kernel: [44028.590594] ? _raw_spin_lock+0x22/0x30 Aug 22 17:37:34 juju-e4d256-prod-github-runner-207 kernel: [44028.591543] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:37:34 juju-e4d256-prod-github-runner-207 kernel: [44028.592567] direct_page_fault+0x206/0x310 [kvm] Aug 22 17:37:34 juju-e4d256-prod-github-runner-207 kernel: [44028.593594] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 17:37:34 juju-e4d256-prod-github-runner-207 kernel: [44028.594615] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 17:37:34 juju-e4d256-prod-github-runner-207 kernel: [44028.595623] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 17:37:34 juju-e4d256-prod-github-runner-207 kernel: [44028.596628] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 17:37:34 juju-e4d256-prod-github-runner-207 kernel: [44028.597588] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 17:37:34 juju-e4d256-prod-github-runner-207 kernel: [44028.598571] handle_exit+0x98/0x230 [kvm_amd] Aug 22 17:37:34 juju-e4d256-prod-github-runner-207 kernel: [44028.599467] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 17:37:34 juju-e4d256-prod-github-runner-207 kernel: [44028.600396] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 17:37:34 juju-e4d256-prod-github-runner-207 kernel: [44028.601327] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 17:37:34 juju-e4d256-prod-github-runner-207 kernel: [44028.602234] vcpu_run+0x62/0x2c0 [kvm] Aug 22 17:37:34 juju-e4d256-prod-github-runner-207 kernel: [44028.603053] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 17:37:34 juju-e4d256-prod-github-runner-207 kernel: [44028.603866] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 17:37:34 juju-e4d256-prod-github-runner-207 kernel: [44028.604729] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 17:37:34 juju-e4d256-prod-github-runner-207 kernel: [44028.605525] ? __seccomp_filter+0x4a/0x4a0 Aug 22 17:37:34 juju-e4d256-prod-github-runner-207 kernel: [44028.606265] ? __fget_files+0x86/0xc0 Aug 22 17:37:34 juju-e4d256-prod-github-runner-207 kernel: [44028.606968] __x64_sys_ioctl+0x95/0xd0 Aug 22 17:37:34 juju-e4d256-prod-github-runner-207 kernel: [44028.607659] do_syscall_64+0x5c/0xc0 Aug 22 17:37:34 juju-e4d256-prod-github-runner-207 kernel: [44028.608333] ? do_futex+0x162/0x1f0 Aug 22 17:37:34 juju-e4d256-prod-github-runner-207 kernel: [44028.608986] ? __x64_sys_futex+0x78/0x1e0 Aug 22 17:37:34 juju-e4d256-prod-github-runner-207 kernel: [44028.609659] ? __secure_computing+0xa9/0x120 Aug 22 17:37:34 juju-e4d256-prod-github-runner-207 kernel: [44028.610346] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 17:37:34 juju-e4d256-prod-github-runner-207 kernel: [44028.611105] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:37:34 juju-e4d256-prod-github-runner-207 kernel: [44028.611831] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:37:34 juju-e4d256-prod-github-runner-207 kernel: [44028.612556] ? do_syscall_64+0x69/0xc0 Aug 22 17:37:34 juju-e4d256-prod-github-runner-207 kernel: [44028.613201] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:37:34 juju-e4d256-prod-github-runner-207 kernel: [44028.613924] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:37:34 juju-e4d256-prod-github-runner-207 kernel: [44028.614625] ? do_syscall_64+0x69/0xc0 Aug 22 17:37:34 juju-e4d256-prod-github-runner-207 kernel: [44028.615250] ? do_syscall_64+0x69/0xc0 Aug 22 17:37:34 juju-e4d256-prod-github-runner-207 kernel: [44028.615872] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 17:37:34 juju-e4d256-prod-github-runner-207 kernel: [44028.616587] RIP: 0033:0x7faa5d0edaff Aug 22 17:37:34 juju-e4d256-prod-github-runner-207 kernel: [44028.617233] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 17:37:34 juju-e4d256-prod-github-runner-207 kernel: [44028.619231] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 17:37:34 juju-e4d256-prod-github-runner-207 kernel: [44028.620142] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 17:37:34 juju-e4d256-prod-github-runner-207 kernel: [44028.621057] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 17:37:34 juju-e4d256-prod-github-runner-207 kernel: [44028.621962] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 17:37:34 juju-e4d256-prod-github-runner-207 kernel: [44028.622852] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 17:37:34 juju-e4d256-prod-github-runner-207 kernel: [44028.623781] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 17:37:34 juju-e4d256-prod-github-runner-207 kernel: [44028.624686] Aug 22 17:38:02 juju-e4d256-prod-github-runner-207 kernel: [44056.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 40922s! [qemu-system-x86:6715] Aug 22 17:38:02 juju-e4d256-prod-github-runner-207 kernel: [44056.543088] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 17:38:02 juju-e4d256-prod-github-runner-207 kernel: [44056.543156] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 17:38:02 juju-e4d256-prod-github-runner-207 kernel: [44056.555187] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 17:38:02 juju-e4d256-prod-github-runner-207 kernel: [44056.556466] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 17:38:02 juju-e4d256-prod-github-runner-207 kernel: [44056.557692] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:38:02 juju-e4d256-prod-github-runner-207 kernel: [44056.558749] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 17:38:02 juju-e4d256-prod-github-runner-207 kernel: [44056.561309] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 17:38:02 juju-e4d256-prod-github-runner-207 kernel: [44056.562350] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 17:38:02 juju-e4d256-prod-github-runner-207 kernel: [44056.563509] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 17:38:02 juju-e4d256-prod-github-runner-207 kernel: [44056.564674] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 17:38:02 juju-e4d256-prod-github-runner-207 kernel: [44056.565835] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 17:38:02 juju-e4d256-prod-github-runner-207 kernel: [44056.567003] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 17:38:02 juju-e4d256-prod-github-runner-207 kernel: [44056.568191] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 17:38:02 juju-e4d256-prod-github-runner-207 kernel: [44056.569421] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 17:38:02 juju-e4d256-prod-github-runner-207 kernel: [44056.570521] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 17:38:02 juju-e4d256-prod-github-runner-207 kernel: [44056.571710] Call Trace: Aug 22 17:38:02 juju-e4d256-prod-github-runner-207 kernel: [44056.572779] Aug 22 17:38:02 juju-e4d256-prod-github-runner-207 kernel: [44056.573661] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:38:02 juju-e4d256-prod-github-runner-207 kernel: [44056.574688] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:38:02 juju-e4d256-prod-github-runner-207 kernel: [44056.575710] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:38:02 juju-e4d256-prod-github-runner-207 kernel: [44056.576795] ? show_regs.part.0+0x23/0x29 Aug 22 17:38:02 juju-e4d256-prod-github-runner-207 kernel: [44056.577788] ? show_regs.cold+0x8/0xd Aug 22 17:38:02 juju-e4d256-prod-github-runner-207 kernel: [44056.578758] ? watchdog_timer_fn+0x1be/0x220 Aug 22 17:38:02 juju-e4d256-prod-github-runner-207 kernel: [44056.579762] ? lockup_detector_update_enable+0x60/0x60 Aug 22 17:38:02 juju-e4d256-prod-github-runner-207 kernel: [44056.580837] ? __hrtimer_run_queues+0x107/0x230 Aug 22 17:38:02 juju-e4d256-prod-github-runner-207 kernel: [44056.581862] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 17:38:02 juju-e4d256-prod-github-runner-207 kernel: [44056.582888] ? hrtimer_interrupt+0x101/0x220 Aug 22 17:38:02 juju-e4d256-prod-github-runner-207 kernel: [44056.583914] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 17:38:02 juju-e4d256-prod-github-runner-207 kernel: [44056.584980] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 17:38:02 juju-e4d256-prod-github-runner-207 kernel: [44056.586027] Aug 22 17:38:02 juju-e4d256-prod-github-runner-207 kernel: [44056.586892] Aug 22 17:38:02 juju-e4d256-prod-github-runner-207 kernel: [44056.587730] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 17:38:02 juju-e4d256-prod-github-runner-207 kernel: [44056.588767] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:38:02 juju-e4d256-prod-github-runner-207 kernel: [44056.589803] ? _raw_spin_lock+0x22/0x30 Aug 22 17:38:02 juju-e4d256-prod-github-runner-207 kernel: [44056.590746] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:38:02 juju-e4d256-prod-github-runner-207 kernel: [44056.591757] direct_page_fault+0x206/0x310 [kvm] Aug 22 17:38:02 juju-e4d256-prod-github-runner-207 kernel: [44056.592786] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 17:38:02 juju-e4d256-prod-github-runner-207 kernel: [44056.593798] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 17:38:02 juju-e4d256-prod-github-runner-207 kernel: [44056.594795] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 17:38:02 juju-e4d256-prod-github-runner-207 kernel: [44056.595759] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 17:38:02 juju-e4d256-prod-github-runner-207 kernel: [44056.596718] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 17:38:02 juju-e4d256-prod-github-runner-207 kernel: [44056.597697] handle_exit+0x98/0x230 [kvm_amd] Aug 22 17:38:02 juju-e4d256-prod-github-runner-207 kernel: [44056.598589] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 17:38:02 juju-e4d256-prod-github-runner-207 kernel: [44056.599503] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 17:38:02 juju-e4d256-prod-github-runner-207 kernel: [44056.600436] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 17:38:02 juju-e4d256-prod-github-runner-207 kernel: [44056.601342] vcpu_run+0x62/0x2c0 [kvm] Aug 22 17:38:02 juju-e4d256-prod-github-runner-207 kernel: [44056.602156] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 17:38:02 juju-e4d256-prod-github-runner-207 kernel: [44056.602961] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 17:38:02 juju-e4d256-prod-github-runner-207 kernel: [44056.603815] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 17:38:02 juju-e4d256-prod-github-runner-207 kernel: [44056.604619] ? __seccomp_filter+0x4a/0x4a0 Aug 22 17:38:02 juju-e4d256-prod-github-runner-207 kernel: [44056.605359] ? __fget_files+0x86/0xc0 Aug 22 17:38:02 juju-e4d256-prod-github-runner-207 kernel: [44056.606067] __x64_sys_ioctl+0x95/0xd0 Aug 22 17:38:02 juju-e4d256-prod-github-runner-207 kernel: [44056.606757] do_syscall_64+0x5c/0xc0 Aug 22 17:38:02 juju-e4d256-prod-github-runner-207 kernel: [44056.607418] ? do_futex+0x162/0x1f0 Aug 22 17:38:02 juju-e4d256-prod-github-runner-207 kernel: [44056.608070] ? __x64_sys_futex+0x78/0x1e0 Aug 22 17:38:02 juju-e4d256-prod-github-runner-207 kernel: [44056.608745] ? __secure_computing+0xa9/0x120 Aug 22 17:38:02 juju-e4d256-prod-github-runner-207 kernel: [44056.609431] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 17:38:02 juju-e4d256-prod-github-runner-207 kernel: [44056.610188] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:38:02 juju-e4d256-prod-github-runner-207 kernel: [44056.610907] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:38:02 juju-e4d256-prod-github-runner-207 kernel: [44056.611621] ? do_syscall_64+0x69/0xc0 Aug 22 17:38:02 juju-e4d256-prod-github-runner-207 kernel: [44056.612273] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:38:02 juju-e4d256-prod-github-runner-207 kernel: [44056.612974] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:38:02 juju-e4d256-prod-github-runner-207 kernel: [44056.613667] ? do_syscall_64+0x69/0xc0 Aug 22 17:38:02 juju-e4d256-prod-github-runner-207 kernel: [44056.614292] ? do_syscall_64+0x69/0xc0 Aug 22 17:38:02 juju-e4d256-prod-github-runner-207 kernel: [44056.614918] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 17:38:02 juju-e4d256-prod-github-runner-207 kernel: [44056.615621] RIP: 0033:0x7faa5d0edaff Aug 22 17:38:02 juju-e4d256-prod-github-runner-207 kernel: [44056.616251] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 17:38:02 juju-e4d256-prod-github-runner-207 kernel: [44056.618240] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 17:38:02 juju-e4d256-prod-github-runner-207 kernel: [44056.619152] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 17:38:02 juju-e4d256-prod-github-runner-207 kernel: [44056.620050] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 17:38:02 juju-e4d256-prod-github-runner-207 kernel: [44056.620943] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 17:38:02 juju-e4d256-prod-github-runner-207 kernel: [44056.621827] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 17:38:02 juju-e4d256-prod-github-runner-207 kernel: [44056.622712] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 17:38:02 juju-e4d256-prod-github-runner-207 kernel: [44056.623602] Aug 22 17:38:30 juju-e4d256-prod-github-runner-207 kernel: [44084.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 40948s! [qemu-system-x86:6715] Aug 22 17:38:30 juju-e4d256-prod-github-runner-207 kernel: [44084.543181] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 17:38:30 juju-e4d256-prod-github-runner-207 kernel: [44084.543251] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 17:38:30 juju-e4d256-prod-github-runner-207 kernel: [44084.555547] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 17:38:30 juju-e4d256-prod-github-runner-207 kernel: [44084.556845] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 17:38:30 juju-e4d256-prod-github-runner-207 kernel: [44084.558276] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:38:30 juju-e4d256-prod-github-runner-207 kernel: [44084.559387] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 17:38:30 juju-e4d256-prod-github-runner-207 kernel: [44084.562093] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 17:38:30 juju-e4d256-prod-github-runner-207 kernel: [44084.563182] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 17:38:30 juju-e4d256-prod-github-runner-207 kernel: [44084.564459] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 17:38:30 juju-e4d256-prod-github-runner-207 kernel: [44084.565661] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 17:38:30 juju-e4d256-prod-github-runner-207 kernel: [44084.566824] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 17:38:30 juju-e4d256-prod-github-runner-207 kernel: [44084.568007] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 17:38:30 juju-e4d256-prod-github-runner-207 kernel: [44084.569177] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 17:38:30 juju-e4d256-prod-github-runner-207 kernel: [44084.570407] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 17:38:30 juju-e4d256-prod-github-runner-207 kernel: [44084.571501] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 17:38:30 juju-e4d256-prod-github-runner-207 kernel: [44084.572710] Call Trace: Aug 22 17:38:30 juju-e4d256-prod-github-runner-207 kernel: [44084.573629] Aug 22 17:38:30 juju-e4d256-prod-github-runner-207 kernel: [44084.574515] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:38:30 juju-e4d256-prod-github-runner-207 kernel: [44084.575657] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:38:30 juju-e4d256-prod-github-runner-207 kernel: [44084.576733] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:38:30 juju-e4d256-prod-github-runner-207 kernel: [44084.577841] ? show_regs.part.0+0x23/0x29 Aug 22 17:38:30 juju-e4d256-prod-github-runner-207 kernel: [44084.578956] ? show_regs.cold+0x8/0xd Aug 22 17:38:30 juju-e4d256-prod-github-runner-207 kernel: [44084.580024] ? watchdog_timer_fn+0x1be/0x220 Aug 22 17:38:30 juju-e4d256-prod-github-runner-207 kernel: [44084.581086] ? lockup_detector_update_enable+0x60/0x60 Aug 22 17:38:30 juju-e4d256-prod-github-runner-207 kernel: [44084.582192] ? __hrtimer_run_queues+0x107/0x230 Aug 22 17:38:30 juju-e4d256-prod-github-runner-207 kernel: [44084.583387] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 17:38:30 juju-e4d256-prod-github-runner-207 kernel: [44084.584533] ? hrtimer_interrupt+0x101/0x220 Aug 22 17:38:30 juju-e4d256-prod-github-runner-207 kernel: [44084.585657] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 17:38:30 juju-e4d256-prod-github-runner-207 kernel: [44084.586785] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 17:38:30 juju-e4d256-prod-github-runner-207 kernel: [44084.587896] Aug 22 17:38:30 juju-e4d256-prod-github-runner-207 kernel: [44084.588793] Aug 22 17:38:30 juju-e4d256-prod-github-runner-207 kernel: [44084.589678] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 17:38:30 juju-e4d256-prod-github-runner-207 kernel: [44084.590761] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:38:30 juju-e4d256-prod-github-runner-207 kernel: [44084.591878] ? _raw_spin_lock+0x22/0x30 Aug 22 17:38:30 juju-e4d256-prod-github-runner-207 kernel: [44084.592944] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:38:30 juju-e4d256-prod-github-runner-207 kernel: [44084.593999] direct_page_fault+0x206/0x310 [kvm] Aug 22 17:38:30 juju-e4d256-prod-github-runner-207 kernel: [44084.595148] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 17:38:30 juju-e4d256-prod-github-runner-207 kernel: [44084.596326] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 17:38:30 juju-e4d256-prod-github-runner-207 kernel: [44084.597460] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 17:38:30 juju-e4d256-prod-github-runner-207 kernel: [44084.598443] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 17:38:30 juju-e4d256-prod-github-runner-207 kernel: [44084.599390] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 17:38:30 juju-e4d256-prod-github-runner-207 kernel: [44084.600460] handle_exit+0x98/0x230 [kvm_amd] Aug 22 17:38:30 juju-e4d256-prod-github-runner-207 kernel: [44084.601361] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 17:38:30 juju-e4d256-prod-github-runner-207 kernel: [44084.602277] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 17:38:30 juju-e4d256-prod-github-runner-207 kernel: [44084.603208] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 17:38:30 juju-e4d256-prod-github-runner-207 kernel: [44084.604125] vcpu_run+0x62/0x2c0 [kvm] Aug 22 17:38:30 juju-e4d256-prod-github-runner-207 kernel: [44084.604939] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 17:38:30 juju-e4d256-prod-github-runner-207 kernel: [44084.605747] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 17:38:30 juju-e4d256-prod-github-runner-207 kernel: [44084.606599] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 17:38:30 juju-e4d256-prod-github-runner-207 kernel: [44084.607401] ? __seccomp_filter+0x4a/0x4a0 Aug 22 17:38:30 juju-e4d256-prod-github-runner-207 kernel: [44084.608158] ? __fget_files+0x86/0xc0 Aug 22 17:38:30 juju-e4d256-prod-github-runner-207 kernel: [44084.608862] __x64_sys_ioctl+0x95/0xd0 Aug 22 17:38:30 juju-e4d256-prod-github-runner-207 kernel: [44084.609556] do_syscall_64+0x5c/0xc0 Aug 22 17:38:30 juju-e4d256-prod-github-runner-207 kernel: [44084.610225] ? do_futex+0x162/0x1f0 Aug 22 17:38:30 juju-e4d256-prod-github-runner-207 kernel: [44084.610872] ? __x64_sys_futex+0x78/0x1e0 Aug 22 17:38:30 juju-e4d256-prod-github-runner-207 kernel: [44084.611560] ? __secure_computing+0xa9/0x120 Aug 22 17:38:30 juju-e4d256-prod-github-runner-207 kernel: [44084.612250] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 17:38:30 juju-e4d256-prod-github-runner-207 kernel: [44084.613009] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:38:30 juju-e4d256-prod-github-runner-207 kernel: [44084.613729] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:38:30 juju-e4d256-prod-github-runner-207 kernel: [44084.614450] ? do_syscall_64+0x69/0xc0 Aug 22 17:38:30 juju-e4d256-prod-github-runner-207 kernel: [44084.615094] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:38:30 juju-e4d256-prod-github-runner-207 kernel: [44084.615809] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:38:30 juju-e4d256-prod-github-runner-207 kernel: [44084.616505] ? do_syscall_64+0x69/0xc0 Aug 22 17:38:30 juju-e4d256-prod-github-runner-207 kernel: [44084.617134] ? do_syscall_64+0x69/0xc0 Aug 22 17:38:30 juju-e4d256-prod-github-runner-207 kernel: [44084.617758] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 17:38:30 juju-e4d256-prod-github-runner-207 kernel: [44084.618464] RIP: 0033:0x7faa5d0edaff Aug 22 17:38:30 juju-e4d256-prod-github-runner-207 kernel: [44084.619089] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 17:38:30 juju-e4d256-prod-github-runner-207 kernel: [44084.621097] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 17:38:30 juju-e4d256-prod-github-runner-207 kernel: [44084.622008] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 17:38:30 juju-e4d256-prod-github-runner-207 kernel: [44084.622896] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 17:38:30 juju-e4d256-prod-github-runner-207 kernel: [44084.623813] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 17:38:30 juju-e4d256-prod-github-runner-207 kernel: [44084.624700] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 17:38:30 juju-e4d256-prod-github-runner-207 kernel: [44084.625591] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 17:38:30 juju-e4d256-prod-github-runner-207 kernel: [44084.626497] Aug 22 17:38:46 juju-e4d256-prod-github-runner-207 kernel: [44100.128705] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 17:38:46 juju-e4d256-prod-github-runner-207 kernel: [44100.129711] rcu: 1-....: (10961273 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=5305219 Aug 22 17:38:46 juju-e4d256-prod-github-runner-207 kernel: [44100.130844] (t=10995732 jiffies g=23269 q=43801) Aug 22 17:38:46 juju-e4d256-prod-github-runner-207 kernel: [44100.131649] NMI backtrace for cpu 1 Aug 22 17:38:46 juju-e4d256-prod-github-runner-207 kernel: [44100.132360] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 17:38:46 juju-e4d256-prod-github-runner-207 kernel: [44100.133481] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 17:38:46 juju-e4d256-prod-github-runner-207 kernel: [44100.134592] Call Trace: Aug 22 17:38:46 juju-e4d256-prod-github-runner-207 kernel: [44100.135275] Aug 22 17:38:46 juju-e4d256-prod-github-runner-207 kernel: [44100.135968] show_stack+0x52/0x5c Aug 22 17:38:46 juju-e4d256-prod-github-runner-207 kernel: [44100.136741] dump_stack_lvl+0x4a/0x63 Aug 22 17:38:46 juju-e4d256-prod-github-runner-207 kernel: [44100.137492] dump_stack+0x10/0x16 Aug 22 17:38:46 juju-e4d256-prod-github-runner-207 kernel: [44100.138208] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 17:38:46 juju-e4d256-prod-github-runner-207 kernel: [44100.138987] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 17:38:46 juju-e4d256-prod-github-runner-207 kernel: [44100.139780] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 17:38:46 juju-e4d256-prod-github-runner-207 kernel: [44100.140599] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 17:38:46 juju-e4d256-prod-github-runner-207 kernel: [44100.141417] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 17:38:46 juju-e4d256-prod-github-runner-207 kernel: [44100.142222] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 17:38:46 juju-e4d256-prod-github-runner-207 kernel: [44100.142992] print_cpu_stall.cold+0x2f/0xe2 Aug 22 17:38:46 juju-e4d256-prod-github-runner-207 kernel: [44100.143787] ? timekeeping_update+0xf7/0x150 Aug 22 17:38:46 juju-e4d256-prod-github-runner-207 kernel: [44100.144560] check_cpu_stall+0x109/0x270 Aug 22 17:38:46 juju-e4d256-prod-github-runner-207 kernel: [44100.145311] rcu_sched_clock_irq+0x9a/0x250 Aug 22 17:38:46 juju-e4d256-prod-github-runner-207 kernel: [44100.146073] update_process_times+0x94/0xd0 Aug 22 17:38:46 juju-e4d256-prod-github-runner-207 kernel: [44100.146833] tick_sched_handle+0x29/0x70 Aug 22 17:38:46 juju-e4d256-prod-github-runner-207 kernel: [44100.147622] tick_sched_timer+0x8c/0xc0 Aug 22 17:38:46 juju-e4d256-prod-github-runner-207 kernel: [44100.148387] ? tick_nohz_handler+0xb0/0xb0 Aug 22 17:38:46 juju-e4d256-prod-github-runner-207 kernel: [44100.149149] __hrtimer_run_queues+0x107/0x230 Aug 22 17:38:46 juju-e4d256-prod-github-runner-207 kernel: [44100.149925] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 17:38:46 juju-e4d256-prod-github-runner-207 kernel: [44100.150699] hrtimer_interrupt+0x101/0x220 Aug 22 17:38:46 juju-e4d256-prod-github-runner-207 kernel: [44100.151497] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 17:38:46 juju-e4d256-prod-github-runner-207 kernel: [44100.152321] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 17:38:46 juju-e4d256-prod-github-runner-207 kernel: [44100.153124] Aug 22 17:38:46 juju-e4d256-prod-github-runner-207 kernel: [44100.153767] Aug 22 17:38:46 juju-e4d256-prod-github-runner-207 kernel: [44100.154403] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 17:38:46 juju-e4d256-prod-github-runner-207 kernel: [44100.155219] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:38:46 juju-e4d256-prod-github-runner-207 kernel: [44100.156114] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 17:38:46 juju-e4d256-prod-github-runner-207 kernel: [44100.158323] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 17:38:46 juju-e4d256-prod-github-runner-207 kernel: [44100.159193] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 17:38:46 juju-e4d256-prod-github-runner-207 kernel: [44100.160196] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 17:38:46 juju-e4d256-prod-github-runner-207 kernel: [44100.161175] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 17:38:46 juju-e4d256-prod-github-runner-207 kernel: [44100.162139] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 17:38:46 juju-e4d256-prod-github-runner-207 kernel: [44100.163096] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 17:38:46 juju-e4d256-prod-github-runner-207 kernel: [44100.164069] ? _raw_spin_lock+0x22/0x30 Aug 22 17:38:46 juju-e4d256-prod-github-runner-207 kernel: [44100.164834] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:38:46 juju-e4d256-prod-github-runner-207 kernel: [44100.165679] direct_page_fault+0x206/0x310 [kvm] Aug 22 17:38:46 juju-e4d256-prod-github-runner-207 kernel: [44100.166554] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 17:38:46 juju-e4d256-prod-github-runner-207 kernel: [44100.167411] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 17:38:46 juju-e4d256-prod-github-runner-207 kernel: [44100.168236] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 17:38:46 juju-e4d256-prod-github-runner-207 kernel: [44100.169042] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 17:38:46 juju-e4d256-prod-github-runner-207 kernel: [44100.169828] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 17:38:46 juju-e4d256-prod-github-runner-207 kernel: [44100.170649] handle_exit+0x98/0x230 [kvm_amd] Aug 22 17:38:46 juju-e4d256-prod-github-runner-207 kernel: [44100.171421] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 17:38:46 juju-e4d256-prod-github-runner-207 kernel: [44100.172210] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 17:38:46 juju-e4d256-prod-github-runner-207 kernel: [44100.173010] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 17:38:46 juju-e4d256-prod-github-runner-207 kernel: [44100.173794] vcpu_run+0x62/0x2c0 [kvm] Aug 22 17:38:46 juju-e4d256-prod-github-runner-207 kernel: [44100.174562] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 17:38:46 juju-e4d256-prod-github-runner-207 kernel: [44100.175305] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 17:38:46 juju-e4d256-prod-github-runner-207 kernel: [44100.176162] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 17:38:46 juju-e4d256-prod-github-runner-207 kernel: [44100.176938] ? __seccomp_filter+0x4a/0x4a0 Aug 22 17:38:46 juju-e4d256-prod-github-runner-207 kernel: [44100.177669] ? __fget_files+0x86/0xc0 Aug 22 17:38:46 juju-e4d256-prod-github-runner-207 kernel: [44100.178367] __x64_sys_ioctl+0x95/0xd0 Aug 22 17:38:46 juju-e4d256-prod-github-runner-207 kernel: [44100.179059] do_syscall_64+0x5c/0xc0 Aug 22 17:38:46 juju-e4d256-prod-github-runner-207 kernel: [44100.179757] ? do_futex+0x162/0x1f0 Aug 22 17:38:46 juju-e4d256-prod-github-runner-207 kernel: [44100.180426] ? __x64_sys_futex+0x78/0x1e0 Aug 22 17:38:46 juju-e4d256-prod-github-runner-207 kernel: [44100.181126] ? __secure_computing+0xa9/0x120 Aug 22 17:38:46 juju-e4d256-prod-github-runner-207 kernel: [44100.181845] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 17:38:46 juju-e4d256-prod-github-runner-207 kernel: [44100.182637] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:38:46 juju-e4d256-prod-github-runner-207 kernel: [44100.183406] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:38:46 juju-e4d256-prod-github-runner-207 kernel: [44100.184158] ? do_syscall_64+0x69/0xc0 Aug 22 17:38:46 juju-e4d256-prod-github-runner-207 kernel: [44100.184953] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:38:46 juju-e4d256-prod-github-runner-207 kernel: [44100.185717] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:38:46 juju-e4d256-prod-github-runner-207 kernel: [44100.186475] ? do_syscall_64+0x69/0xc0 Aug 22 17:38:46 juju-e4d256-prod-github-runner-207 kernel: [44100.187170] ? do_syscall_64+0x69/0xc0 Aug 22 17:38:46 juju-e4d256-prod-github-runner-207 kernel: [44100.187910] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 17:38:46 juju-e4d256-prod-github-runner-207 kernel: [44100.188688] RIP: 0033:0x7faa5d0edaff Aug 22 17:38:46 juju-e4d256-prod-github-runner-207 kernel: [44100.189409] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 17:38:46 juju-e4d256-prod-github-runner-207 kernel: [44100.191542] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 17:38:46 juju-e4d256-prod-github-runner-207 kernel: [44100.192507] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 17:38:46 juju-e4d256-prod-github-runner-207 kernel: [44100.193458] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 17:38:46 juju-e4d256-prod-github-runner-207 kernel: [44100.194402] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 17:38:46 juju-e4d256-prod-github-runner-207 kernel: [44100.195380] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 17:38:46 juju-e4d256-prod-github-runner-207 kernel: [44100.196337] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 17:38:46 juju-e4d256-prod-github-runner-207 kernel: [44100.197389] Aug 22 17:39:10 juju-e4d256-prod-github-runner-207 kernel: [44124.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 40986s! [qemu-system-x86:6715] Aug 22 17:39:10 juju-e4d256-prod-github-runner-207 kernel: [44124.543808] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 17:39:10 juju-e4d256-prod-github-runner-207 kernel: [44124.544059] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 17:39:10 juju-e4d256-prod-github-runner-207 kernel: [44124.556910] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 17:39:10 juju-e4d256-prod-github-runner-207 kernel: [44124.558225] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 17:39:10 juju-e4d256-prod-github-runner-207 kernel: [44124.559534] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:39:10 juju-e4d256-prod-github-runner-207 kernel: [44124.560664] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 17:39:10 juju-e4d256-prod-github-runner-207 kernel: [44124.563349] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 17:39:10 juju-e4d256-prod-github-runner-207 kernel: [44124.564432] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 17:39:10 juju-e4d256-prod-github-runner-207 kernel: [44124.565646] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 17:39:10 juju-e4d256-prod-github-runner-207 kernel: [44124.566865] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 17:39:10 juju-e4d256-prod-github-runner-207 kernel: [44124.568097] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 17:39:10 juju-e4d256-prod-github-runner-207 kernel: [44124.569309] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 17:39:10 juju-e4d256-prod-github-runner-207 kernel: [44124.570505] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 17:39:10 juju-e4d256-prod-github-runner-207 kernel: [44124.571780] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 17:39:10 juju-e4d256-prod-github-runner-207 kernel: [44124.572952] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 17:39:10 juju-e4d256-prod-github-runner-207 kernel: [44124.574213] Call Trace: Aug 22 17:39:10 juju-e4d256-prod-github-runner-207 kernel: [44124.575143] Aug 22 17:39:10 juju-e4d256-prod-github-runner-207 kernel: [44124.576030] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:39:10 juju-e4d256-prod-github-runner-207 kernel: [44124.577086] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:39:10 juju-e4d256-prod-github-runner-207 kernel: [44124.578106] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:39:10 juju-e4d256-prod-github-runner-207 kernel: [44124.579214] ? show_regs.part.0+0x23/0x29 Aug 22 17:39:10 juju-e4d256-prod-github-runner-207 kernel: [44124.580261] ? show_regs.cold+0x8/0xd Aug 22 17:39:10 juju-e4d256-prod-github-runner-207 kernel: [44124.581231] ? watchdog_timer_fn+0x1be/0x220 Aug 22 17:39:10 juju-e4d256-prod-github-runner-207 kernel: [44124.582309] ? lockup_detector_update_enable+0x60/0x60 Aug 22 17:39:10 juju-e4d256-prod-github-runner-207 kernel: [44124.583414] ? __hrtimer_run_queues+0x107/0x230 Aug 22 17:39:10 juju-e4d256-prod-github-runner-207 kernel: [44124.584535] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 17:39:10 juju-e4d256-prod-github-runner-207 kernel: [44124.585597] ? hrtimer_interrupt+0x101/0x220 Aug 22 17:39:10 juju-e4d256-prod-github-runner-207 kernel: [44124.586625] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 17:39:10 juju-e4d256-prod-github-runner-207 kernel: [44124.587990] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 17:39:10 juju-e4d256-prod-github-runner-207 kernel: [44124.589072] Aug 22 17:39:10 juju-e4d256-prod-github-runner-207 kernel: [44124.590032] Aug 22 17:39:10 juju-e4d256-prod-github-runner-207 kernel: [44124.590877] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 17:39:10 juju-e4d256-prod-github-runner-207 kernel: [44124.591953] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:39:10 juju-e4d256-prod-github-runner-207 kernel: [44124.593029] ? _raw_spin_lock+0x22/0x30 Aug 22 17:39:10 juju-e4d256-prod-github-runner-207 kernel: [44124.593983] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:39:10 juju-e4d256-prod-github-runner-207 kernel: [44124.595078] direct_page_fault+0x206/0x310 [kvm] Aug 22 17:39:10 juju-e4d256-prod-github-runner-207 kernel: [44124.596131] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 17:39:10 juju-e4d256-prod-github-runner-207 kernel: [44124.597140] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 17:39:10 juju-e4d256-prod-github-runner-207 kernel: [44124.598143] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 17:39:10 juju-e4d256-prod-github-runner-207 kernel: [44124.599151] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 17:39:10 juju-e4d256-prod-github-runner-207 kernel: [44124.600095] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 17:39:10 juju-e4d256-prod-github-runner-207 kernel: [44124.601074] handle_exit+0x98/0x230 [kvm_amd] Aug 22 17:39:10 juju-e4d256-prod-github-runner-207 kernel: [44124.601971] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 17:39:10 juju-e4d256-prod-github-runner-207 kernel: [44124.602891] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 17:39:10 juju-e4d256-prod-github-runner-207 kernel: [44124.603842] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 17:39:10 juju-e4d256-prod-github-runner-207 kernel: [44124.604795] vcpu_run+0x62/0x2c0 [kvm] Aug 22 17:39:10 juju-e4d256-prod-github-runner-207 kernel: [44124.605614] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 17:39:10 juju-e4d256-prod-github-runner-207 kernel: [44124.606434] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 17:39:10 juju-e4d256-prod-github-runner-207 kernel: [44124.607321] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 17:39:10 juju-e4d256-prod-github-runner-207 kernel: [44124.608135] ? __seccomp_filter+0x4a/0x4a0 Aug 22 17:39:10 juju-e4d256-prod-github-runner-207 kernel: [44124.608890] ? __fget_files+0x86/0xc0 Aug 22 17:39:10 juju-e4d256-prod-github-runner-207 kernel: [44124.609598] __x64_sys_ioctl+0x95/0xd0 Aug 22 17:39:10 juju-e4d256-prod-github-runner-207 kernel: [44124.610289] do_syscall_64+0x5c/0xc0 Aug 22 17:39:10 juju-e4d256-prod-github-runner-207 kernel: [44124.610952] ? do_futex+0x162/0x1f0 Aug 22 17:39:10 juju-e4d256-prod-github-runner-207 kernel: [44124.611619] ? __x64_sys_futex+0x78/0x1e0 Aug 22 17:39:10 juju-e4d256-prod-github-runner-207 kernel: [44124.612291] ? __secure_computing+0xa9/0x120 Aug 22 17:39:10 juju-e4d256-prod-github-runner-207 kernel: [44124.612979] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 17:39:10 juju-e4d256-prod-github-runner-207 kernel: [44124.613738] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:39:10 juju-e4d256-prod-github-runner-207 kernel: [44124.614471] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:39:10 juju-e4d256-prod-github-runner-207 kernel: [44124.615201] ? do_syscall_64+0x69/0xc0 Aug 22 17:39:10 juju-e4d256-prod-github-runner-207 kernel: [44124.615844] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:39:10 juju-e4d256-prod-github-runner-207 kernel: [44124.616559] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:39:10 juju-e4d256-prod-github-runner-207 kernel: [44124.617261] ? do_syscall_64+0x69/0xc0 Aug 22 17:39:10 juju-e4d256-prod-github-runner-207 kernel: [44124.617890] ? do_syscall_64+0x69/0xc0 Aug 22 17:39:10 juju-e4d256-prod-github-runner-207 kernel: [44124.618510] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 17:39:10 juju-e4d256-prod-github-runner-207 kernel: [44124.619243] RIP: 0033:0x7faa5d0edaff Aug 22 17:39:10 juju-e4d256-prod-github-runner-207 kernel: [44124.619924] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 17:39:10 juju-e4d256-prod-github-runner-207 kernel: [44124.621919] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 17:39:10 juju-e4d256-prod-github-runner-207 kernel: [44124.622830] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 17:39:10 juju-e4d256-prod-github-runner-207 kernel: [44124.623738] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 17:39:10 juju-e4d256-prod-github-runner-207 kernel: [44124.624632] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 17:39:10 juju-e4d256-prod-github-runner-207 kernel: [44124.625547] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 17:39:10 juju-e4d256-prod-github-runner-207 kernel: [44124.626503] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 17:39:10 juju-e4d256-prod-github-runner-207 kernel: [44124.627420] Aug 22 17:39:38 juju-e4d256-prod-github-runner-207 kernel: [44152.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 41012s! [qemu-system-x86:6715] Aug 22 17:39:38 juju-e4d256-prod-github-runner-207 kernel: [44152.543113] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 17:39:38 juju-e4d256-prod-github-runner-207 kernel: [44152.543182] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 17:39:38 juju-e4d256-prod-github-runner-207 kernel: [44152.555259] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 17:39:38 juju-e4d256-prod-github-runner-207 kernel: [44152.556525] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 17:39:38 juju-e4d256-prod-github-runner-207 kernel: [44152.557742] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:39:38 juju-e4d256-prod-github-runner-207 kernel: [44152.558821] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 17:39:38 juju-e4d256-prod-github-runner-207 kernel: [44152.561370] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 17:39:38 juju-e4d256-prod-github-runner-207 kernel: [44152.562419] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 17:39:38 juju-e4d256-prod-github-runner-207 kernel: [44152.563605] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 17:39:38 juju-e4d256-prod-github-runner-207 kernel: [44152.564764] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 17:39:38 juju-e4d256-prod-github-runner-207 kernel: [44152.565929] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 17:39:38 juju-e4d256-prod-github-runner-207 kernel: [44152.567100] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 17:39:38 juju-e4d256-prod-github-runner-207 kernel: [44152.568268] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 17:39:38 juju-e4d256-prod-github-runner-207 kernel: [44152.569509] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 17:39:38 juju-e4d256-prod-github-runner-207 kernel: [44152.570606] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 17:39:38 juju-e4d256-prod-github-runner-207 kernel: [44152.571812] Call Trace: Aug 22 17:39:38 juju-e4d256-prod-github-runner-207 kernel: [44152.572723] Aug 22 17:39:38 juju-e4d256-prod-github-runner-207 kernel: [44152.573606] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:39:38 juju-e4d256-prod-github-runner-207 kernel: [44152.574700] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:39:38 juju-e4d256-prod-github-runner-207 kernel: [44152.575740] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:39:38 juju-e4d256-prod-github-runner-207 kernel: [44152.576814] ? show_regs.part.0+0x23/0x29 Aug 22 17:39:38 juju-e4d256-prod-github-runner-207 kernel: [44152.577812] ? show_regs.cold+0x8/0xd Aug 22 17:39:38 juju-e4d256-prod-github-runner-207 kernel: [44152.578790] ? watchdog_timer_fn+0x1be/0x220 Aug 22 17:39:38 juju-e4d256-prod-github-runner-207 kernel: [44152.579800] ? lockup_detector_update_enable+0x60/0x60 Aug 22 17:39:38 juju-e4d256-prod-github-runner-207 kernel: [44152.580868] ? __hrtimer_run_queues+0x107/0x230 Aug 22 17:39:38 juju-e4d256-prod-github-runner-207 kernel: [44152.581893] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 17:39:38 juju-e4d256-prod-github-runner-207 kernel: [44152.582929] ? hrtimer_interrupt+0x101/0x220 Aug 22 17:39:38 juju-e4d256-prod-github-runner-207 kernel: [44152.583944] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 17:39:38 juju-e4d256-prod-github-runner-207 kernel: [44152.585010] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 17:39:38 juju-e4d256-prod-github-runner-207 kernel: [44152.586052] Aug 22 17:39:38 juju-e4d256-prod-github-runner-207 kernel: [44152.586926] Aug 22 17:39:38 juju-e4d256-prod-github-runner-207 kernel: [44152.587763] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 17:39:38 juju-e4d256-prod-github-runner-207 kernel: [44152.588792] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:39:38 juju-e4d256-prod-github-runner-207 kernel: [44152.589840] ? _raw_spin_lock+0x22/0x30 Aug 22 17:39:38 juju-e4d256-prod-github-runner-207 kernel: [44152.590795] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:39:38 juju-e4d256-prod-github-runner-207 kernel: [44152.591812] direct_page_fault+0x206/0x310 [kvm] Aug 22 17:39:38 juju-e4d256-prod-github-runner-207 kernel: [44152.592857] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 17:39:38 juju-e4d256-prod-github-runner-207 kernel: [44152.593873] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 17:39:38 juju-e4d256-prod-github-runner-207 kernel: [44152.594888] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 17:39:38 juju-e4d256-prod-github-runner-207 kernel: [44152.595858] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 17:39:38 juju-e4d256-prod-github-runner-207 kernel: [44152.596804] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 17:39:38 juju-e4d256-prod-github-runner-207 kernel: [44152.597786] handle_exit+0x98/0x230 [kvm_amd] Aug 22 17:39:38 juju-e4d256-prod-github-runner-207 kernel: [44152.598675] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 17:39:38 juju-e4d256-prod-github-runner-207 kernel: [44152.599628] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 17:39:38 juju-e4d256-prod-github-runner-207 kernel: [44152.600551] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 17:39:38 juju-e4d256-prod-github-runner-207 kernel: [44152.601454] vcpu_run+0x62/0x2c0 [kvm] Aug 22 17:39:38 juju-e4d256-prod-github-runner-207 kernel: [44152.602262] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 17:39:38 juju-e4d256-prod-github-runner-207 kernel: [44152.603090] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 17:39:38 juju-e4d256-prod-github-runner-207 kernel: [44152.603944] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 17:39:38 juju-e4d256-prod-github-runner-207 kernel: [44152.604740] ? __seccomp_filter+0x4a/0x4a0 Aug 22 17:39:38 juju-e4d256-prod-github-runner-207 kernel: [44152.605481] ? __fget_files+0x86/0xc0 Aug 22 17:39:38 juju-e4d256-prod-github-runner-207 kernel: [44152.606183] __x64_sys_ioctl+0x95/0xd0 Aug 22 17:39:38 juju-e4d256-prod-github-runner-207 kernel: [44152.606888] do_syscall_64+0x5c/0xc0 Aug 22 17:39:38 juju-e4d256-prod-github-runner-207 kernel: [44152.607553] ? do_futex+0x162/0x1f0 Aug 22 17:39:38 juju-e4d256-prod-github-runner-207 kernel: [44152.608200] ? __x64_sys_futex+0x78/0x1e0 Aug 22 17:39:38 juju-e4d256-prod-github-runner-207 kernel: [44152.608872] ? __secure_computing+0xa9/0x120 Aug 22 17:39:38 juju-e4d256-prod-github-runner-207 kernel: [44152.609559] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 17:39:38 juju-e4d256-prod-github-runner-207 kernel: [44152.610465] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:39:38 juju-e4d256-prod-github-runner-207 kernel: [44152.611196] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:39:38 juju-e4d256-prod-github-runner-207 kernel: [44152.611913] ? do_syscall_64+0x69/0xc0 Aug 22 17:39:38 juju-e4d256-prod-github-runner-207 kernel: [44152.612557] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:39:38 juju-e4d256-prod-github-runner-207 kernel: [44152.613257] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:39:38 juju-e4d256-prod-github-runner-207 kernel: [44152.613950] ? do_syscall_64+0x69/0xc0 Aug 22 17:39:38 juju-e4d256-prod-github-runner-207 kernel: [44152.614572] ? do_syscall_64+0x69/0xc0 Aug 22 17:39:38 juju-e4d256-prod-github-runner-207 kernel: [44152.615211] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 17:39:38 juju-e4d256-prod-github-runner-207 kernel: [44152.615916] RIP: 0033:0x7faa5d0edaff Aug 22 17:39:38 juju-e4d256-prod-github-runner-207 kernel: [44152.616539] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 17:39:38 juju-e4d256-prod-github-runner-207 kernel: [44152.618516] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 17:39:38 juju-e4d256-prod-github-runner-207 kernel: [44152.619434] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 17:39:38 juju-e4d256-prod-github-runner-207 kernel: [44152.620324] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 17:39:38 juju-e4d256-prod-github-runner-207 kernel: [44152.621212] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 17:39:38 juju-e4d256-prod-github-runner-207 kernel: [44152.622098] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 17:39:38 juju-e4d256-prod-github-runner-207 kernel: [44152.623022] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 17:39:38 juju-e4d256-prod-github-runner-207 kernel: [44152.623917] Aug 22 17:40:06 juju-e4d256-prod-github-runner-207 kernel: [44180.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 41038s! [qemu-system-x86:6715] Aug 22 17:40:06 juju-e4d256-prod-github-runner-207 kernel: [44180.543104] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 17:40:06 juju-e4d256-prod-github-runner-207 kernel: [44180.543172] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 17:40:06 juju-e4d256-prod-github-runner-207 kernel: [44180.555241] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 17:40:06 juju-e4d256-prod-github-runner-207 kernel: [44180.556520] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 17:40:06 juju-e4d256-prod-github-runner-207 kernel: [44180.557742] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:40:06 juju-e4d256-prod-github-runner-207 kernel: [44180.558949] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 17:40:06 juju-e4d256-prod-github-runner-207 kernel: [44180.561509] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 17:40:06 juju-e4d256-prod-github-runner-207 kernel: [44180.562564] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 17:40:06 juju-e4d256-prod-github-runner-207 kernel: [44180.563732] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 17:40:06 juju-e4d256-prod-github-runner-207 kernel: [44180.565038] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 17:40:06 juju-e4d256-prod-github-runner-207 kernel: [44180.566204] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 17:40:06 juju-e4d256-prod-github-runner-207 kernel: [44180.567377] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 17:40:06 juju-e4d256-prod-github-runner-207 kernel: [44180.568542] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 17:40:06 juju-e4d256-prod-github-runner-207 kernel: [44180.569777] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 17:40:06 juju-e4d256-prod-github-runner-207 kernel: [44180.570885] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 17:40:06 juju-e4d256-prod-github-runner-207 kernel: [44180.572079] Call Trace: Aug 22 17:40:06 juju-e4d256-prod-github-runner-207 kernel: [44180.572997] Aug 22 17:40:06 juju-e4d256-prod-github-runner-207 kernel: [44180.573879] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:40:06 juju-e4d256-prod-github-runner-207 kernel: [44180.574920] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:40:06 juju-e4d256-prod-github-runner-207 kernel: [44180.575946] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:40:06 juju-e4d256-prod-github-runner-207 kernel: [44180.577019] ? show_regs.part.0+0x23/0x29 Aug 22 17:40:06 juju-e4d256-prod-github-runner-207 kernel: [44180.578014] ? show_regs.cold+0x8/0xd Aug 22 17:40:06 juju-e4d256-prod-github-runner-207 kernel: [44180.578993] ? watchdog_timer_fn+0x1be/0x220 Aug 22 17:40:06 juju-e4d256-prod-github-runner-207 kernel: [44180.580012] ? lockup_detector_update_enable+0x60/0x60 Aug 22 17:40:06 juju-e4d256-prod-github-runner-207 kernel: [44180.581103] ? __hrtimer_run_queues+0x107/0x230 Aug 22 17:40:06 juju-e4d256-prod-github-runner-207 kernel: [44180.582135] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 17:40:06 juju-e4d256-prod-github-runner-207 kernel: [44180.583168] ? hrtimer_interrupt+0x101/0x220 Aug 22 17:40:06 juju-e4d256-prod-github-runner-207 kernel: [44180.584182] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 17:40:06 juju-e4d256-prod-github-runner-207 kernel: [44180.585255] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 17:40:06 juju-e4d256-prod-github-runner-207 kernel: [44180.586305] Aug 22 17:40:06 juju-e4d256-prod-github-runner-207 kernel: [44180.587166] Aug 22 17:40:06 juju-e4d256-prod-github-runner-207 kernel: [44180.588002] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 17:40:06 juju-e4d256-prod-github-runner-207 kernel: [44180.589033] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:40:06 juju-e4d256-prod-github-runner-207 kernel: [44180.590070] ? _raw_spin_lock+0x22/0x30 Aug 22 17:40:06 juju-e4d256-prod-github-runner-207 kernel: [44180.591027] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:40:06 juju-e4d256-prod-github-runner-207 kernel: [44180.592044] direct_page_fault+0x206/0x310 [kvm] Aug 22 17:40:06 juju-e4d256-prod-github-runner-207 kernel: [44180.593066] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 17:40:06 juju-e4d256-prod-github-runner-207 kernel: [44180.594074] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 17:40:06 juju-e4d256-prod-github-runner-207 kernel: [44180.595086] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 17:40:06 juju-e4d256-prod-github-runner-207 kernel: [44180.596056] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 17:40:06 juju-e4d256-prod-github-runner-207 kernel: [44180.597000] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 17:40:06 juju-e4d256-prod-github-runner-207 kernel: [44180.597976] handle_exit+0x98/0x230 [kvm_amd] Aug 22 17:40:06 juju-e4d256-prod-github-runner-207 kernel: [44180.598876] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 17:40:06 juju-e4d256-prod-github-runner-207 kernel: [44180.599790] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 17:40:06 juju-e4d256-prod-github-runner-207 kernel: [44180.600720] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 17:40:06 juju-e4d256-prod-github-runner-207 kernel: [44180.601628] vcpu_run+0x62/0x2c0 [kvm] Aug 22 17:40:06 juju-e4d256-prod-github-runner-207 kernel: [44180.602453] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 17:40:06 juju-e4d256-prod-github-runner-207 kernel: [44180.603260] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 17:40:06 juju-e4d256-prod-github-runner-207 kernel: [44180.604120] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 17:40:06 juju-e4d256-prod-github-runner-207 kernel: [44180.604946] ? __seccomp_filter+0x4a/0x4a0 Aug 22 17:40:06 juju-e4d256-prod-github-runner-207 kernel: [44180.605705] ? __fget_files+0x86/0xc0 Aug 22 17:40:06 juju-e4d256-prod-github-runner-207 kernel: [44180.606424] __x64_sys_ioctl+0x95/0xd0 Aug 22 17:40:06 juju-e4d256-prod-github-runner-207 kernel: [44180.607116] do_syscall_64+0x5c/0xc0 Aug 22 17:40:06 juju-e4d256-prod-github-runner-207 kernel: [44180.607785] ? do_futex+0x162/0x1f0 Aug 22 17:40:06 juju-e4d256-prod-github-runner-207 kernel: [44180.608431] ? __x64_sys_futex+0x78/0x1e0 Aug 22 17:40:06 juju-e4d256-prod-github-runner-207 kernel: [44180.609103] ? __secure_computing+0xa9/0x120 Aug 22 17:40:06 juju-e4d256-prod-github-runner-207 kernel: [44180.609811] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 17:40:06 juju-e4d256-prod-github-runner-207 kernel: [44180.610590] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:40:06 juju-e4d256-prod-github-runner-207 kernel: [44180.611313] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:40:06 juju-e4d256-prod-github-runner-207 kernel: [44180.612030] ? do_syscall_64+0x69/0xc0 Aug 22 17:40:06 juju-e4d256-prod-github-runner-207 kernel: [44180.612673] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:40:06 juju-e4d256-prod-github-runner-207 kernel: [44180.613380] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:40:06 juju-e4d256-prod-github-runner-207 kernel: [44180.614074] ? do_syscall_64+0x69/0xc0 Aug 22 17:40:06 juju-e4d256-prod-github-runner-207 kernel: [44180.614703] ? do_syscall_64+0x69/0xc0 Aug 22 17:40:06 juju-e4d256-prod-github-runner-207 kernel: [44180.615338] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 17:40:06 juju-e4d256-prod-github-runner-207 kernel: [44180.616041] RIP: 0033:0x7faa5d0edaff Aug 22 17:40:06 juju-e4d256-prod-github-runner-207 kernel: [44180.616662] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 17:40:06 juju-e4d256-prod-github-runner-207 kernel: [44180.618657] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 17:40:06 juju-e4d256-prod-github-runner-207 kernel: [44180.619567] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 17:40:06 juju-e4d256-prod-github-runner-207 kernel: [44180.620474] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 17:40:06 juju-e4d256-prod-github-runner-207 kernel: [44180.621362] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 17:40:06 juju-e4d256-prod-github-runner-207 kernel: [44180.622250] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 17:40:06 juju-e4d256-prod-github-runner-207 kernel: [44180.623153] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 17:40:06 juju-e4d256-prod-github-runner-207 kernel: [44180.624043] Aug 22 17:40:34 juju-e4d256-prod-github-runner-207 kernel: [44208.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 41064s! [qemu-system-x86:6715] Aug 22 17:40:34 juju-e4d256-prod-github-runner-207 kernel: [44208.543709] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 17:40:34 juju-e4d256-prod-github-runner-207 kernel: [44208.543961] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 17:40:34 juju-e4d256-prod-github-runner-207 kernel: [44208.556069] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 17:40:34 juju-e4d256-prod-github-runner-207 kernel: [44208.557332] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 17:40:34 juju-e4d256-prod-github-runner-207 kernel: [44208.558565] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:40:34 juju-e4d256-prod-github-runner-207 kernel: [44208.559624] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 17:40:34 juju-e4d256-prod-github-runner-207 kernel: [44208.562181] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 17:40:34 juju-e4d256-prod-github-runner-207 kernel: [44208.563229] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 17:40:34 juju-e4d256-prod-github-runner-207 kernel: [44208.564392] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 17:40:34 juju-e4d256-prod-github-runner-207 kernel: [44208.565555] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 17:40:34 juju-e4d256-prod-github-runner-207 kernel: [44208.566736] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 17:40:34 juju-e4d256-prod-github-runner-207 kernel: [44208.567900] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 17:40:34 juju-e4d256-prod-github-runner-207 kernel: [44208.569077] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 17:40:34 juju-e4d256-prod-github-runner-207 kernel: [44208.570339] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 17:40:34 juju-e4d256-prod-github-runner-207 kernel: [44208.571445] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 17:40:34 juju-e4d256-prod-github-runner-207 kernel: [44208.572646] Call Trace: Aug 22 17:40:34 juju-e4d256-prod-github-runner-207 kernel: [44208.573563] Aug 22 17:40:34 juju-e4d256-prod-github-runner-207 kernel: [44208.574468] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:40:34 juju-e4d256-prod-github-runner-207 kernel: [44208.575526] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:40:34 juju-e4d256-prod-github-runner-207 kernel: [44208.576554] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:40:34 juju-e4d256-prod-github-runner-207 kernel: [44208.577649] ? show_regs.part.0+0x23/0x29 Aug 22 17:40:34 juju-e4d256-prod-github-runner-207 kernel: [44208.578672] ? show_regs.cold+0x8/0xd Aug 22 17:40:34 juju-e4d256-prod-github-runner-207 kernel: [44208.579647] ? watchdog_timer_fn+0x1be/0x220 Aug 22 17:40:34 juju-e4d256-prod-github-runner-207 kernel: [44208.580658] ? lockup_detector_update_enable+0x60/0x60 Aug 22 17:40:34 juju-e4d256-prod-github-runner-207 kernel: [44208.581728] ? __hrtimer_run_queues+0x107/0x230 Aug 22 17:40:34 juju-e4d256-prod-github-runner-207 kernel: [44208.582779] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 17:40:34 juju-e4d256-prod-github-runner-207 kernel: [44208.583808] ? hrtimer_interrupt+0x101/0x220 Aug 22 17:40:34 juju-e4d256-prod-github-runner-207 kernel: [44208.584829] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 17:40:34 juju-e4d256-prod-github-runner-207 kernel: [44208.585906] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 17:40:34 juju-e4d256-prod-github-runner-207 kernel: [44208.586972] Aug 22 17:40:34 juju-e4d256-prod-github-runner-207 kernel: [44208.587826] Aug 22 17:40:34 juju-e4d256-prod-github-runner-207 kernel: [44208.588665] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 17:40:34 juju-e4d256-prod-github-runner-207 kernel: [44208.589709] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:40:34 juju-e4d256-prod-github-runner-207 kernel: [44208.590763] ? _raw_spin_lock+0x22/0x30 Aug 22 17:40:34 juju-e4d256-prod-github-runner-207 kernel: [44208.591708] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:40:34 juju-e4d256-prod-github-runner-207 kernel: [44208.592722] direct_page_fault+0x206/0x310 [kvm] Aug 22 17:40:34 juju-e4d256-prod-github-runner-207 kernel: [44208.593749] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 17:40:34 juju-e4d256-prod-github-runner-207 kernel: [44208.594766] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 17:40:34 juju-e4d256-prod-github-runner-207 kernel: [44208.595790] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 17:40:34 juju-e4d256-prod-github-runner-207 kernel: [44208.596784] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 17:40:34 juju-e4d256-prod-github-runner-207 kernel: [44208.597733] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 17:40:34 juju-e4d256-prod-github-runner-207 kernel: [44208.598735] handle_exit+0x98/0x230 [kvm_amd] Aug 22 17:40:34 juju-e4d256-prod-github-runner-207 kernel: [44208.599628] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 17:40:34 juju-e4d256-prod-github-runner-207 kernel: [44208.600554] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 17:40:34 juju-e4d256-prod-github-runner-207 kernel: [44208.601486] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 17:40:34 juju-e4d256-prod-github-runner-207 kernel: [44208.602412] vcpu_run+0x62/0x2c0 [kvm] Aug 22 17:40:34 juju-e4d256-prod-github-runner-207 kernel: [44208.603224] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 17:40:34 juju-e4d256-prod-github-runner-207 kernel: [44208.604031] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 17:40:34 juju-e4d256-prod-github-runner-207 kernel: [44208.604887] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 17:40:34 juju-e4d256-prod-github-runner-207 kernel: [44208.605691] ? __seccomp_filter+0x4a/0x4a0 Aug 22 17:40:34 juju-e4d256-prod-github-runner-207 kernel: [44208.606443] ? __fget_files+0x86/0xc0 Aug 22 17:40:34 juju-e4d256-prod-github-runner-207 kernel: [44208.607145] __x64_sys_ioctl+0x95/0xd0 Aug 22 17:40:34 juju-e4d256-prod-github-runner-207 kernel: [44208.607842] do_syscall_64+0x5c/0xc0 Aug 22 17:40:34 juju-e4d256-prod-github-runner-207 kernel: [44208.608504] ? do_futex+0x162/0x1f0 Aug 22 17:40:34 juju-e4d256-prod-github-runner-207 kernel: [44208.609152] ? __x64_sys_futex+0x78/0x1e0 Aug 22 17:40:34 juju-e4d256-prod-github-runner-207 kernel: [44208.609823] ? __secure_computing+0xa9/0x120 Aug 22 17:40:34 juju-e4d256-prod-github-runner-207 kernel: [44208.610531] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 17:40:34 juju-e4d256-prod-github-runner-207 kernel: [44208.611293] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:40:34 juju-e4d256-prod-github-runner-207 kernel: [44208.612013] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:40:34 juju-e4d256-prod-github-runner-207 kernel: [44208.612729] ? do_syscall_64+0x69/0xc0 Aug 22 17:40:34 juju-e4d256-prod-github-runner-207 kernel: [44208.613448] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:40:34 juju-e4d256-prod-github-runner-207 kernel: [44208.614164] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:40:34 juju-e4d256-prod-github-runner-207 kernel: [44208.614862] ? do_syscall_64+0x69/0xc0 Aug 22 17:40:34 juju-e4d256-prod-github-runner-207 kernel: [44208.615486] ? do_syscall_64+0x69/0xc0 Aug 22 17:40:34 juju-e4d256-prod-github-runner-207 kernel: [44208.616107] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 17:40:34 juju-e4d256-prod-github-runner-207 kernel: [44208.616812] RIP: 0033:0x7faa5d0edaff Aug 22 17:40:34 juju-e4d256-prod-github-runner-207 kernel: [44208.617461] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 17:40:34 juju-e4d256-prod-github-runner-207 kernel: [44208.619475] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 17:40:34 juju-e4d256-prod-github-runner-207 kernel: [44208.620386] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 17:40:34 juju-e4d256-prod-github-runner-207 kernel: [44208.621275] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 17:40:34 juju-e4d256-prod-github-runner-207 kernel: [44208.622185] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 17:40:34 juju-e4d256-prod-github-runner-207 kernel: [44208.623079] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 17:40:34 juju-e4d256-prod-github-runner-207 kernel: [44208.623963] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 17:40:34 juju-e4d256-prod-github-runner-207 kernel: [44208.624851] Aug 22 17:41:02 juju-e4d256-prod-github-runner-207 kernel: [44236.541980] watchdog: BUG: soft lockup - CPU#1 stuck for 41090s! [qemu-system-x86:6715] Aug 22 17:41:02 juju-e4d256-prod-github-runner-207 kernel: [44236.543108] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 17:41:02 juju-e4d256-prod-github-runner-207 kernel: [44236.543177] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 17:41:02 juju-e4d256-prod-github-runner-207 kernel: [44236.555340] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 17:41:02 juju-e4d256-prod-github-runner-207 kernel: [44236.556604] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 17:41:02 juju-e4d256-prod-github-runner-207 kernel: [44236.557845] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:41:02 juju-e4d256-prod-github-runner-207 kernel: [44236.559012] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 17:41:02 juju-e4d256-prod-github-runner-207 kernel: [44236.561565] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 17:41:02 juju-e4d256-prod-github-runner-207 kernel: [44236.562619] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 17:41:02 juju-e4d256-prod-github-runner-207 kernel: [44236.563791] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 17:41:02 juju-e4d256-prod-github-runner-207 kernel: [44236.564954] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 17:41:02 juju-e4d256-prod-github-runner-207 kernel: [44236.566131] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 17:41:02 juju-e4d256-prod-github-runner-207 kernel: [44236.567299] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 17:41:02 juju-e4d256-prod-github-runner-207 kernel: [44236.568468] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 17:41:02 juju-e4d256-prod-github-runner-207 kernel: [44236.569725] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 17:41:02 juju-e4d256-prod-github-runner-207 kernel: [44236.570825] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 17:41:02 juju-e4d256-prod-github-runner-207 kernel: [44236.572020] Call Trace: Aug 22 17:41:02 juju-e4d256-prod-github-runner-207 kernel: [44236.572937] Aug 22 17:41:02 juju-e4d256-prod-github-runner-207 kernel: [44236.573863] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:41:02 juju-e4d256-prod-github-runner-207 kernel: [44236.574913] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:41:02 juju-e4d256-prod-github-runner-207 kernel: [44236.575933] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:41:02 juju-e4d256-prod-github-runner-207 kernel: [44236.577009] ? show_regs.part.0+0x23/0x29 Aug 22 17:41:02 juju-e4d256-prod-github-runner-207 kernel: [44236.578025] ? show_regs.cold+0x8/0xd Aug 22 17:41:02 juju-e4d256-prod-github-runner-207 kernel: [44236.578996] ? watchdog_timer_fn+0x1be/0x220 Aug 22 17:41:02 juju-e4d256-prod-github-runner-207 kernel: [44236.580011] ? lockup_detector_update_enable+0x60/0x60 Aug 22 17:41:02 juju-e4d256-prod-github-runner-207 kernel: [44236.581077] ? __hrtimer_run_queues+0x107/0x230 Aug 22 17:41:02 juju-e4d256-prod-github-runner-207 kernel: [44236.582124] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 17:41:02 juju-e4d256-prod-github-runner-207 kernel: [44236.583150] ? hrtimer_interrupt+0x101/0x220 Aug 22 17:41:02 juju-e4d256-prod-github-runner-207 kernel: [44236.584164] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 17:41:02 juju-e4d256-prod-github-runner-207 kernel: [44236.585231] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 17:41:02 juju-e4d256-prod-github-runner-207 kernel: [44236.586295] Aug 22 17:41:02 juju-e4d256-prod-github-runner-207 kernel: [44236.587147] Aug 22 17:41:02 juju-e4d256-prod-github-runner-207 kernel: [44236.587988] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 17:41:02 juju-e4d256-prod-github-runner-207 kernel: [44236.589026] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:41:02 juju-e4d256-prod-github-runner-207 kernel: [44236.590079] ? _raw_spin_lock+0x22/0x30 Aug 22 17:41:02 juju-e4d256-prod-github-runner-207 kernel: [44236.591023] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:41:02 juju-e4d256-prod-github-runner-207 kernel: [44236.592038] direct_page_fault+0x206/0x310 [kvm] Aug 22 17:41:02 juju-e4d256-prod-github-runner-207 kernel: [44236.593062] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 17:41:02 juju-e4d256-prod-github-runner-207 kernel: [44236.594095] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 17:41:02 juju-e4d256-prod-github-runner-207 kernel: [44236.595101] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 17:41:02 juju-e4d256-prod-github-runner-207 kernel: [44236.596069] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 17:41:02 juju-e4d256-prod-github-runner-207 kernel: [44236.597014] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 17:41:02 juju-e4d256-prod-github-runner-207 kernel: [44236.598010] handle_exit+0x98/0x230 [kvm_amd] Aug 22 17:41:02 juju-e4d256-prod-github-runner-207 kernel: [44236.598905] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 17:41:02 juju-e4d256-prod-github-runner-207 kernel: [44236.599818] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 17:41:02 juju-e4d256-prod-github-runner-207 kernel: [44236.600741] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 17:41:02 juju-e4d256-prod-github-runner-207 kernel: [44236.601643] vcpu_run+0x62/0x2c0 [kvm] Aug 22 17:41:02 juju-e4d256-prod-github-runner-207 kernel: [44236.602500] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 17:41:02 juju-e4d256-prod-github-runner-207 kernel: [44236.603307] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 17:41:02 juju-e4d256-prod-github-runner-207 kernel: [44236.604166] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 17:41:02 juju-e4d256-prod-github-runner-207 kernel: [44236.604960] ? __seccomp_filter+0x4a/0x4a0 Aug 22 17:41:02 juju-e4d256-prod-github-runner-207 kernel: [44236.605718] ? __fget_files+0x86/0xc0 Aug 22 17:41:02 juju-e4d256-prod-github-runner-207 kernel: [44236.606451] __x64_sys_ioctl+0x95/0xd0 Aug 22 17:41:02 juju-e4d256-prod-github-runner-207 kernel: [44236.607148] do_syscall_64+0x5c/0xc0 Aug 22 17:41:02 juju-e4d256-prod-github-runner-207 kernel: [44236.607811] ? do_futex+0x162/0x1f0 Aug 22 17:41:02 juju-e4d256-prod-github-runner-207 kernel: [44236.608460] ? __x64_sys_futex+0x78/0x1e0 Aug 22 17:41:02 juju-e4d256-prod-github-runner-207 kernel: [44236.609138] ? __secure_computing+0xa9/0x120 Aug 22 17:41:02 juju-e4d256-prod-github-runner-207 kernel: [44236.609840] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 17:41:02 juju-e4d256-prod-github-runner-207 kernel: [44236.610598] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:41:02 juju-e4d256-prod-github-runner-207 kernel: [44236.611318] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:41:02 juju-e4d256-prod-github-runner-207 kernel: [44236.612034] ? do_syscall_64+0x69/0xc0 Aug 22 17:41:02 juju-e4d256-prod-github-runner-207 kernel: [44236.612677] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:41:02 juju-e4d256-prod-github-runner-207 kernel: [44236.613379] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:41:02 juju-e4d256-prod-github-runner-207 kernel: [44236.614090] ? do_syscall_64+0x69/0xc0 Aug 22 17:41:02 juju-e4d256-prod-github-runner-207 kernel: [44236.614714] ? do_syscall_64+0x69/0xc0 Aug 22 17:41:02 juju-e4d256-prod-github-runner-207 kernel: [44236.615334] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 17:41:02 juju-e4d256-prod-github-runner-207 kernel: [44236.616037] RIP: 0033:0x7faa5d0edaff Aug 22 17:41:02 juju-e4d256-prod-github-runner-207 kernel: [44236.616659] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 17:41:02 juju-e4d256-prod-github-runner-207 kernel: [44236.618665] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 17:41:02 juju-e4d256-prod-github-runner-207 kernel: [44236.619576] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 17:41:02 juju-e4d256-prod-github-runner-207 kernel: [44236.620462] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 17:41:02 juju-e4d256-prod-github-runner-207 kernel: [44236.621348] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 17:41:02 juju-e4d256-prod-github-runner-207 kernel: [44236.622272] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 17:41:02 juju-e4d256-prod-github-runner-207 kernel: [44236.623183] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 17:41:02 juju-e4d256-prod-github-runner-207 kernel: [44236.624073] Aug 22 17:41:30 juju-e4d256-prod-github-runner-207 kernel: [44264.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 41116s! [qemu-system-x86:6715] Aug 22 17:41:30 juju-e4d256-prod-github-runner-207 kernel: [44264.543112] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 17:41:30 juju-e4d256-prod-github-runner-207 kernel: [44264.543178] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 17:41:30 juju-e4d256-prod-github-runner-207 kernel: [44264.555363] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 17:41:30 juju-e4d256-prod-github-runner-207 kernel: [44264.556633] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 17:41:30 juju-e4d256-prod-github-runner-207 kernel: [44264.557879] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:41:30 juju-e4d256-prod-github-runner-207 kernel: [44264.558955] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 17:41:30 juju-e4d256-prod-github-runner-207 kernel: [44264.561539] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 17:41:30 juju-e4d256-prod-github-runner-207 kernel: [44264.562584] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 17:41:30 juju-e4d256-prod-github-runner-207 kernel: [44264.563746] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 17:41:30 juju-e4d256-prod-github-runner-207 kernel: [44264.564914] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 17:41:30 juju-e4d256-prod-github-runner-207 kernel: [44264.566118] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 17:41:30 juju-e4d256-prod-github-runner-207 kernel: [44264.567298] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 17:41:30 juju-e4d256-prod-github-runner-207 kernel: [44264.568467] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 17:41:30 juju-e4d256-prod-github-runner-207 kernel: [44264.569733] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 17:41:30 juju-e4d256-prod-github-runner-207 kernel: [44264.570846] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 17:41:30 juju-e4d256-prod-github-runner-207 kernel: [44264.572043] Call Trace: Aug 22 17:41:30 juju-e4d256-prod-github-runner-207 kernel: [44264.572959] Aug 22 17:41:30 juju-e4d256-prod-github-runner-207 kernel: [44264.573861] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:41:30 juju-e4d256-prod-github-runner-207 kernel: [44264.574921] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:41:30 juju-e4d256-prod-github-runner-207 kernel: [44264.575958] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:41:30 juju-e4d256-prod-github-runner-207 kernel: [44264.577040] ? show_regs.part.0+0x23/0x29 Aug 22 17:41:30 juju-e4d256-prod-github-runner-207 kernel: [44264.578057] ? show_regs.cold+0x8/0xd Aug 22 17:41:30 juju-e4d256-prod-github-runner-207 kernel: [44264.579033] ? watchdog_timer_fn+0x1be/0x220 Aug 22 17:41:30 juju-e4d256-prod-github-runner-207 kernel: [44264.580052] ? lockup_detector_update_enable+0x60/0x60 Aug 22 17:41:30 juju-e4d256-prod-github-runner-207 kernel: [44264.581129] ? __hrtimer_run_queues+0x107/0x230 Aug 22 17:41:30 juju-e4d256-prod-github-runner-207 kernel: [44264.582180] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 17:41:30 juju-e4d256-prod-github-runner-207 kernel: [44264.583215] ? hrtimer_interrupt+0x101/0x220 Aug 22 17:41:30 juju-e4d256-prod-github-runner-207 kernel: [44264.584236] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 17:41:30 juju-e4d256-prod-github-runner-207 kernel: [44264.585342] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 17:41:30 juju-e4d256-prod-github-runner-207 kernel: [44264.586406] Aug 22 17:41:30 juju-e4d256-prod-github-runner-207 kernel: [44264.587264] Aug 22 17:41:30 juju-e4d256-prod-github-runner-207 kernel: [44264.588105] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 17:41:30 juju-e4d256-prod-github-runner-207 kernel: [44264.589143] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:41:30 juju-e4d256-prod-github-runner-207 kernel: [44264.590203] ? _raw_spin_lock+0x22/0x30 Aug 22 17:41:30 juju-e4d256-prod-github-runner-207 kernel: [44264.591168] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:41:30 juju-e4d256-prod-github-runner-207 kernel: [44264.592202] direct_page_fault+0x206/0x310 [kvm] Aug 22 17:41:30 juju-e4d256-prod-github-runner-207 kernel: [44264.593242] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 17:41:30 juju-e4d256-prod-github-runner-207 kernel: [44264.594269] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 17:41:30 juju-e4d256-prod-github-runner-207 kernel: [44264.595270] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 17:41:30 juju-e4d256-prod-github-runner-207 kernel: [44264.596258] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 17:41:30 juju-e4d256-prod-github-runner-207 kernel: [44264.597215] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 17:41:30 juju-e4d256-prod-github-runner-207 kernel: [44264.598213] handle_exit+0x98/0x230 [kvm_amd] Aug 22 17:41:30 juju-e4d256-prod-github-runner-207 kernel: [44264.599113] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 17:41:30 juju-e4d256-prod-github-runner-207 kernel: [44264.600028] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 17:41:30 juju-e4d256-prod-github-runner-207 kernel: [44264.600960] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 17:41:30 juju-e4d256-prod-github-runner-207 kernel: [44264.601906] vcpu_run+0x62/0x2c0 [kvm] Aug 22 17:41:30 juju-e4d256-prod-github-runner-207 kernel: [44264.602723] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 17:41:30 juju-e4d256-prod-github-runner-207 kernel: [44264.603536] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 17:41:30 juju-e4d256-prod-github-runner-207 kernel: [44264.604390] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 17:41:30 juju-e4d256-prod-github-runner-207 kernel: [44264.605189] ? __seccomp_filter+0x4a/0x4a0 Aug 22 17:41:30 juju-e4d256-prod-github-runner-207 kernel: [44264.605958] ? __fget_files+0x86/0xc0 Aug 22 17:41:30 juju-e4d256-prod-github-runner-207 kernel: [44264.606671] __x64_sys_ioctl+0x95/0xd0 Aug 22 17:41:30 juju-e4d256-prod-github-runner-207 kernel: [44264.607378] do_syscall_64+0x5c/0xc0 Aug 22 17:41:30 juju-e4d256-prod-github-runner-207 kernel: [44264.608044] ? do_futex+0x162/0x1f0 Aug 22 17:41:30 juju-e4d256-prod-github-runner-207 kernel: [44264.608692] ? __x64_sys_futex+0x78/0x1e0 Aug 22 17:41:30 juju-e4d256-prod-github-runner-207 kernel: [44264.609387] ? __secure_computing+0xa9/0x120 Aug 22 17:41:30 juju-e4d256-prod-github-runner-207 kernel: [44264.610081] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 17:41:30 juju-e4d256-prod-github-runner-207 kernel: [44264.610845] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:41:30 juju-e4d256-prod-github-runner-207 kernel: [44264.611575] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:41:30 juju-e4d256-prod-github-runner-207 kernel: [44264.612303] ? do_syscall_64+0x69/0xc0 Aug 22 17:41:30 juju-e4d256-prod-github-runner-207 kernel: [44264.612956] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:41:30 juju-e4d256-prod-github-runner-207 kernel: [44264.613679] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:41:30 juju-e4d256-prod-github-runner-207 kernel: [44264.614375] ? do_syscall_64+0x69/0xc0 Aug 22 17:41:30 juju-e4d256-prod-github-runner-207 kernel: [44264.614998] ? do_syscall_64+0x69/0xc0 Aug 22 17:41:30 juju-e4d256-prod-github-runner-207 kernel: [44264.615618] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 17:41:30 juju-e4d256-prod-github-runner-207 kernel: [44264.616338] RIP: 0033:0x7faa5d0edaff Aug 22 17:41:30 juju-e4d256-prod-github-runner-207 kernel: [44264.616966] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 17:41:30 juju-e4d256-prod-github-runner-207 kernel: [44264.618995] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 17:41:30 juju-e4d256-prod-github-runner-207 kernel: [44264.619910] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 17:41:30 juju-e4d256-prod-github-runner-207 kernel: [44264.620800] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 17:41:30 juju-e4d256-prod-github-runner-207 kernel: [44264.621714] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 17:41:30 juju-e4d256-prod-github-runner-207 kernel: [44264.622618] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 17:41:30 juju-e4d256-prod-github-runner-207 kernel: [44264.623516] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 17:41:30 juju-e4d256-prod-github-runner-207 kernel: [44264.624409] Aug 22 17:41:46 juju-e4d256-prod-github-runner-207 kernel: [44280.140705] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 17:41:46 juju-e4d256-prod-github-runner-207 kernel: [44280.141699] rcu: 1-....: (11006143 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=5327140 Aug 22 17:41:46 juju-e4d256-prod-github-runner-207 kernel: [44280.142819] (t=11040735 jiffies g=23269 q=43925) Aug 22 17:41:46 juju-e4d256-prod-github-runner-207 kernel: [44280.143604] NMI backtrace for cpu 1 Aug 22 17:41:46 juju-e4d256-prod-github-runner-207 kernel: [44280.144317] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 17:41:46 juju-e4d256-prod-github-runner-207 kernel: [44280.145429] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 17:41:46 juju-e4d256-prod-github-runner-207 kernel: [44280.146490] Call Trace: Aug 22 17:41:46 juju-e4d256-prod-github-runner-207 kernel: [44280.147163] Aug 22 17:41:46 juju-e4d256-prod-github-runner-207 kernel: [44280.147806] show_stack+0x52/0x5c Aug 22 17:41:46 juju-e4d256-prod-github-runner-207 kernel: [44280.148528] dump_stack_lvl+0x4a/0x63 Aug 22 17:41:46 juju-e4d256-prod-github-runner-207 kernel: [44280.149282] dump_stack+0x10/0x16 Aug 22 17:41:46 juju-e4d256-prod-github-runner-207 kernel: [44280.149999] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 17:41:46 juju-e4d256-prod-github-runner-207 kernel: [44280.150781] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 17:41:46 juju-e4d256-prod-github-runner-207 kernel: [44280.151558] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 17:41:46 juju-e4d256-prod-github-runner-207 kernel: [44280.152374] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 17:41:46 juju-e4d256-prod-github-runner-207 kernel: [44280.153212] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 17:41:46 juju-e4d256-prod-github-runner-207 kernel: [44280.154020] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 17:41:46 juju-e4d256-prod-github-runner-207 kernel: [44280.154796] print_cpu_stall.cold+0x2f/0xe2 Aug 22 17:41:46 juju-e4d256-prod-github-runner-207 kernel: [44280.155560] ? timekeeping_update+0xf7/0x150 Aug 22 17:41:46 juju-e4d256-prod-github-runner-207 kernel: [44280.156334] check_cpu_stall+0x109/0x270 Aug 22 17:41:46 juju-e4d256-prod-github-runner-207 kernel: [44280.157080] rcu_sched_clock_irq+0x9a/0x250 Aug 22 17:41:46 juju-e4d256-prod-github-runner-207 kernel: [44280.157856] update_process_times+0x94/0xd0 Aug 22 17:41:46 juju-e4d256-prod-github-runner-207 kernel: [44280.158623] tick_sched_handle+0x29/0x70 Aug 22 17:41:46 juju-e4d256-prod-github-runner-207 kernel: [44280.159368] tick_sched_timer+0x8c/0xc0 Aug 22 17:41:46 juju-e4d256-prod-github-runner-207 kernel: [44280.160105] ? tick_nohz_handler+0xb0/0xb0 Aug 22 17:41:46 juju-e4d256-prod-github-runner-207 kernel: [44280.160858] __hrtimer_run_queues+0x107/0x230 Aug 22 17:41:46 juju-e4d256-prod-github-runner-207 kernel: [44280.161638] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 17:41:46 juju-e4d256-prod-github-runner-207 kernel: [44280.162418] hrtimer_interrupt+0x101/0x220 Aug 22 17:41:46 juju-e4d256-prod-github-runner-207 kernel: [44280.163175] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 17:41:46 juju-e4d256-prod-github-runner-207 kernel: [44280.163985] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 17:41:46 juju-e4d256-prod-github-runner-207 kernel: [44280.164783] Aug 22 17:41:46 juju-e4d256-prod-github-runner-207 kernel: [44280.165425] Aug 22 17:41:46 juju-e4d256-prod-github-runner-207 kernel: [44280.166053] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 17:41:46 juju-e4d256-prod-github-runner-207 kernel: [44280.166870] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:41:46 juju-e4d256-prod-github-runner-207 kernel: [44280.167748] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 17:41:46 juju-e4d256-prod-github-runner-207 kernel: [44280.169966] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 17:41:46 juju-e4d256-prod-github-runner-207 kernel: [44280.170841] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 17:41:46 juju-e4d256-prod-github-runner-207 kernel: [44280.171837] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 17:41:46 juju-e4d256-prod-github-runner-207 kernel: [44280.172818] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 17:41:46 juju-e4d256-prod-github-runner-207 kernel: [44280.173799] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 17:41:46 juju-e4d256-prod-github-runner-207 kernel: [44280.174760] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 17:41:46 juju-e4d256-prod-github-runner-207 kernel: [44280.175720] ? _raw_spin_lock+0x22/0x30 Aug 22 17:41:46 juju-e4d256-prod-github-runner-207 kernel: [44280.176482] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:41:46 juju-e4d256-prod-github-runner-207 kernel: [44280.177348] direct_page_fault+0x206/0x310 [kvm] Aug 22 17:41:46 juju-e4d256-prod-github-runner-207 kernel: [44280.178420] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 17:41:46 juju-e4d256-prod-github-runner-207 kernel: [44280.179253] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 17:41:46 juju-e4d256-prod-github-runner-207 kernel: [44280.180074] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 17:41:46 juju-e4d256-prod-github-runner-207 kernel: [44280.180877] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 17:41:46 juju-e4d256-prod-github-runner-207 kernel: [44280.181682] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 17:41:46 juju-e4d256-prod-github-runner-207 kernel: [44280.182503] handle_exit+0x98/0x230 [kvm_amd] Aug 22 17:41:46 juju-e4d256-prod-github-runner-207 kernel: [44280.183254] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 17:41:46 juju-e4d256-prod-github-runner-207 kernel: [44280.184035] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 17:41:46 juju-e4d256-prod-github-runner-207 kernel: [44280.184834] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 17:41:46 juju-e4d256-prod-github-runner-207 kernel: [44280.185640] vcpu_run+0x62/0x2c0 [kvm] Aug 22 17:41:46 juju-e4d256-prod-github-runner-207 kernel: [44280.186353] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 17:41:46 juju-e4d256-prod-github-runner-207 kernel: [44280.187085] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 17:41:46 juju-e4d256-prod-github-runner-207 kernel: [44280.187884] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 17:41:46 juju-e4d256-prod-github-runner-207 kernel: [44280.188648] ? __seccomp_filter+0x4a/0x4a0 Aug 22 17:41:46 juju-e4d256-prod-github-runner-207 kernel: [44280.189383] ? __fget_files+0x86/0xc0 Aug 22 17:41:46 juju-e4d256-prod-github-runner-207 kernel: [44280.190075] __x64_sys_ioctl+0x95/0xd0 Aug 22 17:41:46 juju-e4d256-prod-github-runner-207 kernel: [44280.190768] do_syscall_64+0x5c/0xc0 Aug 22 17:41:46 juju-e4d256-prod-github-runner-207 kernel: [44280.191451] ? do_futex+0x162/0x1f0 Aug 22 17:41:46 juju-e4d256-prod-github-runner-207 kernel: [44280.192121] ? __x64_sys_futex+0x78/0x1e0 Aug 22 17:41:46 juju-e4d256-prod-github-runner-207 kernel: [44280.192825] ? __secure_computing+0xa9/0x120 Aug 22 17:41:46 juju-e4d256-prod-github-runner-207 kernel: [44280.193555] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 17:41:46 juju-e4d256-prod-github-runner-207 kernel: [44280.194343] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:41:46 juju-e4d256-prod-github-runner-207 kernel: [44280.195095] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:41:46 juju-e4d256-prod-github-runner-207 kernel: [44280.195851] ? do_syscall_64+0x69/0xc0 Aug 22 17:41:46 juju-e4d256-prod-github-runner-207 kernel: [44280.196562] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:41:46 juju-e4d256-prod-github-runner-207 kernel: [44280.197336] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:41:46 juju-e4d256-prod-github-runner-207 kernel: [44280.198092] ? do_syscall_64+0x69/0xc0 Aug 22 17:41:46 juju-e4d256-prod-github-runner-207 kernel: [44280.198783] ? do_syscall_64+0x69/0xc0 Aug 22 17:41:46 juju-e4d256-prod-github-runner-207 kernel: [44280.199476] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 17:41:46 juju-e4d256-prod-github-runner-207 kernel: [44280.200257] RIP: 0033:0x7faa5d0edaff Aug 22 17:41:46 juju-e4d256-prod-github-runner-207 kernel: [44280.200936] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 17:41:46 juju-e4d256-prod-github-runner-207 kernel: [44280.203050] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 17:41:46 juju-e4d256-prod-github-runner-207 kernel: [44280.204009] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 17:41:46 juju-e4d256-prod-github-runner-207 kernel: [44280.204950] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 17:41:46 juju-e4d256-prod-github-runner-207 kernel: [44280.205903] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 17:41:46 juju-e4d256-prod-github-runner-207 kernel: [44280.206841] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 17:41:46 juju-e4d256-prod-github-runner-207 kernel: [44280.207765] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 17:41:46 juju-e4d256-prod-github-runner-207 kernel: [44280.208674] Aug 22 17:42:10 juju-e4d256-prod-github-runner-207 kernel: [44304.541981] watchdog: BUG: soft lockup - CPU#1 stuck for 41153s! [qemu-system-x86:6715] Aug 22 17:42:10 juju-e4d256-prod-github-runner-207 kernel: [44304.543735] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 17:42:10 juju-e4d256-prod-github-runner-207 kernel: [44304.543986] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 17:42:10 juju-e4d256-prod-github-runner-207 kernel: [44304.556472] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 17:42:10 juju-e4d256-prod-github-runner-207 kernel: [44304.557772] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 17:42:10 juju-e4d256-prod-github-runner-207 kernel: [44304.558998] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:42:10 juju-e4d256-prod-github-runner-207 kernel: [44304.560059] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 17:42:10 juju-e4d256-prod-github-runner-207 kernel: [44304.562965] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 17:42:10 juju-e4d256-prod-github-runner-207 kernel: [44304.564109] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 17:42:10 juju-e4d256-prod-github-runner-207 kernel: [44304.565418] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 17:42:10 juju-e4d256-prod-github-runner-207 kernel: [44304.566708] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 17:42:10 juju-e4d256-prod-github-runner-207 kernel: [44304.568003] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 17:42:10 juju-e4d256-prod-github-runner-207 kernel: [44304.569311] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 17:42:10 juju-e4d256-prod-github-runner-207 kernel: [44304.570613] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 17:42:10 juju-e4d256-prod-github-runner-207 kernel: [44304.572017] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 17:42:10 juju-e4d256-prod-github-runner-207 kernel: [44304.573149] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 17:42:10 juju-e4d256-prod-github-runner-207 kernel: [44304.574342] Call Trace: Aug 22 17:42:10 juju-e4d256-prod-github-runner-207 kernel: [44304.575251] Aug 22 17:42:10 juju-e4d256-prod-github-runner-207 kernel: [44304.576135] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:42:10 juju-e4d256-prod-github-runner-207 kernel: [44304.577173] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:42:10 juju-e4d256-prod-github-runner-207 kernel: [44304.578194] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:42:10 juju-e4d256-prod-github-runner-207 kernel: [44304.579292] ? show_regs.part.0+0x23/0x29 Aug 22 17:42:10 juju-e4d256-prod-github-runner-207 kernel: [44304.580304] ? show_regs.cold+0x8/0xd Aug 22 17:42:10 juju-e4d256-prod-github-runner-207 kernel: [44304.581299] ? watchdog_timer_fn+0x1be/0x220 Aug 22 17:42:10 juju-e4d256-prod-github-runner-207 kernel: [44304.582314] ? lockup_detector_update_enable+0x60/0x60 Aug 22 17:42:10 juju-e4d256-prod-github-runner-207 kernel: [44304.583377] ? __hrtimer_run_queues+0x107/0x230 Aug 22 17:42:10 juju-e4d256-prod-github-runner-207 kernel: [44304.584404] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 17:42:10 juju-e4d256-prod-github-runner-207 kernel: [44304.585443] ? hrtimer_interrupt+0x101/0x220 Aug 22 17:42:10 juju-e4d256-prod-github-runner-207 kernel: [44304.586456] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 17:42:10 juju-e4d256-prod-github-runner-207 kernel: [44304.587526] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 17:42:10 juju-e4d256-prod-github-runner-207 kernel: [44304.588571] Aug 22 17:42:10 juju-e4d256-prod-github-runner-207 kernel: [44304.589445] Aug 22 17:42:10 juju-e4d256-prod-github-runner-207 kernel: [44304.590287] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 17:42:10 juju-e4d256-prod-github-runner-207 kernel: [44304.591438] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:42:10 juju-e4d256-prod-github-runner-207 kernel: [44304.592582] ? _raw_spin_lock+0x22/0x30 Aug 22 17:42:10 juju-e4d256-prod-github-runner-207 kernel: [44304.593629] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:42:10 juju-e4d256-prod-github-runner-207 kernel: [44304.594733] direct_page_fault+0x206/0x310 [kvm] Aug 22 17:42:10 juju-e4d256-prod-github-runner-207 kernel: [44304.595846] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 17:42:10 juju-e4d256-prod-github-runner-207 kernel: [44304.596958] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 17:42:10 juju-e4d256-prod-github-runner-207 kernel: [44304.598048] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 17:42:10 juju-e4d256-prod-github-runner-207 kernel: [44304.599149] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 17:42:10 juju-e4d256-prod-github-runner-207 kernel: [44304.600181] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 17:42:10 juju-e4d256-prod-github-runner-207 kernel: [44304.601277] handle_exit+0x98/0x230 [kvm_amd] Aug 22 17:42:10 juju-e4d256-prod-github-runner-207 kernel: [44304.602260] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 17:42:10 juju-e4d256-prod-github-runner-207 kernel: [44304.603261] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 17:42:10 juju-e4d256-prod-github-runner-207 kernel: [44304.604276] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 17:42:10 juju-e4d256-prod-github-runner-207 kernel: [44304.605288] vcpu_run+0x62/0x2c0 [kvm] Aug 22 17:42:10 juju-e4d256-prod-github-runner-207 kernel: [44304.606278] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 17:42:10 juju-e4d256-prod-github-runner-207 kernel: [44304.607365] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 17:42:10 juju-e4d256-prod-github-runner-207 kernel: [44304.608559] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 17:42:10 juju-e4d256-prod-github-runner-207 kernel: [44304.609678] ? __seccomp_filter+0x4a/0x4a0 Aug 22 17:42:10 juju-e4d256-prod-github-runner-207 kernel: [44304.610703] ? __fget_files+0x86/0xc0 Aug 22 17:42:10 juju-e4d256-prod-github-runner-207 kernel: [44304.611694] __x64_sys_ioctl+0x95/0xd0 Aug 22 17:42:10 juju-e4d256-prod-github-runner-207 kernel: [44304.612668] do_syscall_64+0x5c/0xc0 Aug 22 17:42:10 juju-e4d256-prod-github-runner-207 kernel: [44304.613641] ? do_futex+0x162/0x1f0 Aug 22 17:42:10 juju-e4d256-prod-github-runner-207 kernel: [44304.614592] ? __x64_sys_futex+0x78/0x1e0 Aug 22 17:42:10 juju-e4d256-prod-github-runner-207 kernel: [44304.615544] ? __secure_computing+0xa9/0x120 Aug 22 17:42:10 juju-e4d256-prod-github-runner-207 kernel: [44304.616514] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 17:42:10 juju-e4d256-prod-github-runner-207 kernel: [44304.617625] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:42:10 juju-e4d256-prod-github-runner-207 kernel: [44304.618685] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:42:10 juju-e4d256-prod-github-runner-207 kernel: [44304.619681] ? do_syscall_64+0x69/0xc0 Aug 22 17:42:10 juju-e4d256-prod-github-runner-207 kernel: [44304.620579] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:42:10 juju-e4d256-prod-github-runner-207 kernel: [44304.621612] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:42:10 juju-e4d256-prod-github-runner-207 kernel: [44304.622613] ? do_syscall_64+0x69/0xc0 Aug 22 17:42:10 juju-e4d256-prod-github-runner-207 kernel: [44304.623489] ? do_syscall_64+0x69/0xc0 Aug 22 17:42:10 juju-e4d256-prod-github-runner-207 kernel: [44304.624386] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 17:42:10 juju-e4d256-prod-github-runner-207 kernel: [44304.625434] RIP: 0033:0x7faa5d0edaff Aug 22 17:42:10 juju-e4d256-prod-github-runner-207 kernel: [44304.626386] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 17:42:10 juju-e4d256-prod-github-runner-207 kernel: [44304.629082] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 17:42:10 juju-e4d256-prod-github-runner-207 kernel: [44304.630352] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 17:42:10 juju-e4d256-prod-github-runner-207 kernel: [44304.631627] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 17:42:10 juju-e4d256-prod-github-runner-207 kernel: [44304.632922] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 17:42:10 juju-e4d256-prod-github-runner-207 kernel: [44304.634233] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 17:42:10 juju-e4d256-prod-github-runner-207 kernel: [44304.635595] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 17:42:10 juju-e4d256-prod-github-runner-207 kernel: [44304.636897] Aug 22 17:42:38 juju-e4d256-prod-github-runner-207 kernel: [44332.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 41179s! [qemu-system-x86:6715] Aug 22 17:42:38 juju-e4d256-prod-github-runner-207 kernel: [44332.543107] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 17:42:38 juju-e4d256-prod-github-runner-207 kernel: [44332.543179] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 17:42:38 juju-e4d256-prod-github-runner-207 kernel: [44332.555251] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 17:42:38 juju-e4d256-prod-github-runner-207 kernel: [44332.556527] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 17:42:38 juju-e4d256-prod-github-runner-207 kernel: [44332.557746] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:42:38 juju-e4d256-prod-github-runner-207 kernel: [44332.558801] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 17:42:38 juju-e4d256-prod-github-runner-207 kernel: [44332.561389] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 17:42:38 juju-e4d256-prod-github-runner-207 kernel: [44332.562440] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 17:42:38 juju-e4d256-prod-github-runner-207 kernel: [44332.563603] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 17:42:38 juju-e4d256-prod-github-runner-207 kernel: [44332.564782] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 17:42:38 juju-e4d256-prod-github-runner-207 kernel: [44332.565943] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 17:42:38 juju-e4d256-prod-github-runner-207 kernel: [44332.567105] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 17:42:38 juju-e4d256-prod-github-runner-207 kernel: [44332.568272] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 17:42:38 juju-e4d256-prod-github-runner-207 kernel: [44332.569516] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 17:42:38 juju-e4d256-prod-github-runner-207 kernel: [44332.570614] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 17:42:38 juju-e4d256-prod-github-runner-207 kernel: [44332.571807] Call Trace: Aug 22 17:42:38 juju-e4d256-prod-github-runner-207 kernel: [44332.572733] Aug 22 17:42:38 juju-e4d256-prod-github-runner-207 kernel: [44332.573617] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:42:38 juju-e4d256-prod-github-runner-207 kernel: [44332.574651] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:42:38 juju-e4d256-prod-github-runner-207 kernel: [44332.575674] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:42:38 juju-e4d256-prod-github-runner-207 kernel: [44332.576823] ? show_regs.part.0+0x23/0x29 Aug 22 17:42:38 juju-e4d256-prod-github-runner-207 kernel: [44332.577822] ? show_regs.cold+0x8/0xd Aug 22 17:42:38 juju-e4d256-prod-github-runner-207 kernel: [44332.578809] ? watchdog_timer_fn+0x1be/0x220 Aug 22 17:42:38 juju-e4d256-prod-github-runner-207 kernel: [44332.579841] ? lockup_detector_update_enable+0x60/0x60 Aug 22 17:42:38 juju-e4d256-prod-github-runner-207 kernel: [44332.580919] ? __hrtimer_run_queues+0x107/0x230 Aug 22 17:42:38 juju-e4d256-prod-github-runner-207 kernel: [44332.581948] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 17:42:38 juju-e4d256-prod-github-runner-207 kernel: [44332.582974] ? hrtimer_interrupt+0x101/0x220 Aug 22 17:42:38 juju-e4d256-prod-github-runner-207 kernel: [44332.583994] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 17:42:38 juju-e4d256-prod-github-runner-207 kernel: [44332.585076] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 17:42:38 juju-e4d256-prod-github-runner-207 kernel: [44332.586123] Aug 22 17:42:38 juju-e4d256-prod-github-runner-207 kernel: [44332.586976] Aug 22 17:42:38 juju-e4d256-prod-github-runner-207 kernel: [44332.587813] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 17:42:38 juju-e4d256-prod-github-runner-207 kernel: [44332.588855] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:42:38 juju-e4d256-prod-github-runner-207 kernel: [44332.589900] ? _raw_spin_lock+0x22/0x30 Aug 22 17:42:38 juju-e4d256-prod-github-runner-207 kernel: [44332.591059] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:42:38 juju-e4d256-prod-github-runner-207 kernel: [44332.592163] direct_page_fault+0x206/0x310 [kvm] Aug 22 17:42:38 juju-e4d256-prod-github-runner-207 kernel: [44332.593214] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 17:42:38 juju-e4d256-prod-github-runner-207 kernel: [44332.594224] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 17:42:38 juju-e4d256-prod-github-runner-207 kernel: [44332.595225] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 17:42:38 juju-e4d256-prod-github-runner-207 kernel: [44332.596200] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 17:42:38 juju-e4d256-prod-github-runner-207 kernel: [44332.597153] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 17:42:38 juju-e4d256-prod-github-runner-207 kernel: [44332.598133] handle_exit+0x98/0x230 [kvm_amd] Aug 22 17:42:38 juju-e4d256-prod-github-runner-207 kernel: [44332.599030] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 17:42:38 juju-e4d256-prod-github-runner-207 kernel: [44332.599942] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 17:42:38 juju-e4d256-prod-github-runner-207 kernel: [44332.600882] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 17:42:38 juju-e4d256-prod-github-runner-207 kernel: [44332.601793] vcpu_run+0x62/0x2c0 [kvm] Aug 22 17:42:38 juju-e4d256-prod-github-runner-207 kernel: [44332.602604] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 17:42:38 juju-e4d256-prod-github-runner-207 kernel: [44332.603419] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 17:42:38 juju-e4d256-prod-github-runner-207 kernel: [44332.604278] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 17:42:38 juju-e4d256-prod-github-runner-207 kernel: [44332.605091] ? __seccomp_filter+0x4a/0x4a0 Aug 22 17:42:38 juju-e4d256-prod-github-runner-207 kernel: [44332.605835] ? __fget_files+0x86/0xc0 Aug 22 17:42:38 juju-e4d256-prod-github-runner-207 kernel: [44332.606539] __x64_sys_ioctl+0x95/0xd0 Aug 22 17:42:38 juju-e4d256-prod-github-runner-207 kernel: [44332.607233] do_syscall_64+0x5c/0xc0 Aug 22 17:42:38 juju-e4d256-prod-github-runner-207 kernel: [44332.607902] ? do_futex+0x162/0x1f0 Aug 22 17:42:38 juju-e4d256-prod-github-runner-207 kernel: [44332.608567] ? __x64_sys_futex+0x78/0x1e0 Aug 22 17:42:38 juju-e4d256-prod-github-runner-207 kernel: [44332.609242] ? __secure_computing+0xa9/0x120 Aug 22 17:42:38 juju-e4d256-prod-github-runner-207 kernel: [44332.609930] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 17:42:38 juju-e4d256-prod-github-runner-207 kernel: [44332.610690] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:42:38 juju-e4d256-prod-github-runner-207 kernel: [44332.611410] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:42:38 juju-e4d256-prod-github-runner-207 kernel: [44332.612131] ? do_syscall_64+0x69/0xc0 Aug 22 17:42:38 juju-e4d256-prod-github-runner-207 kernel: [44332.612795] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:42:38 juju-e4d256-prod-github-runner-207 kernel: [44332.613506] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:42:38 juju-e4d256-prod-github-runner-207 kernel: [44332.614197] ? do_syscall_64+0x69/0xc0 Aug 22 17:42:38 juju-e4d256-prod-github-runner-207 kernel: [44332.614819] ? do_syscall_64+0x69/0xc0 Aug 22 17:42:38 juju-e4d256-prod-github-runner-207 kernel: [44332.615437] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 17:42:38 juju-e4d256-prod-github-runner-207 kernel: [44332.616137] RIP: 0033:0x7faa5d0edaff Aug 22 17:42:38 juju-e4d256-prod-github-runner-207 kernel: [44332.616767] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 17:42:38 juju-e4d256-prod-github-runner-207 kernel: [44332.618743] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 17:42:38 juju-e4d256-prod-github-runner-207 kernel: [44332.619651] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 17:42:38 juju-e4d256-prod-github-runner-207 kernel: [44332.620547] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 17:42:38 juju-e4d256-prod-github-runner-207 kernel: [44332.621435] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 17:42:38 juju-e4d256-prod-github-runner-207 kernel: [44332.622319] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 17:42:38 juju-e4d256-prod-github-runner-207 kernel: [44332.623203] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 17:42:38 juju-e4d256-prod-github-runner-207 kernel: [44332.624092] Aug 22 17:43:06 juju-e4d256-prod-github-runner-207 kernel: [44360.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 41205s! [qemu-system-x86:6715] Aug 22 17:43:06 juju-e4d256-prod-github-runner-207 kernel: [44360.543082] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 17:43:06 juju-e4d256-prod-github-runner-207 kernel: [44360.543152] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 17:43:06 juju-e4d256-prod-github-runner-207 kernel: [44360.555404] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 17:43:06 juju-e4d256-prod-github-runner-207 kernel: [44360.556683] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 17:43:06 juju-e4d256-prod-github-runner-207 kernel: [44360.557920] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:43:06 juju-e4d256-prod-github-runner-207 kernel: [44360.559010] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 17:43:06 juju-e4d256-prod-github-runner-207 kernel: [44360.561588] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 17:43:06 juju-e4d256-prod-github-runner-207 kernel: [44360.562633] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 17:43:06 juju-e4d256-prod-github-runner-207 kernel: [44360.563813] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 17:43:06 juju-e4d256-prod-github-runner-207 kernel: [44360.565022] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 17:43:06 juju-e4d256-prod-github-runner-207 kernel: [44360.566187] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 17:43:06 juju-e4d256-prod-github-runner-207 kernel: [44360.567361] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 17:43:06 juju-e4d256-prod-github-runner-207 kernel: [44360.568538] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 17:43:06 juju-e4d256-prod-github-runner-207 kernel: [44360.569777] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 17:43:06 juju-e4d256-prod-github-runner-207 kernel: [44360.570871] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 17:43:06 juju-e4d256-prod-github-runner-207 kernel: [44360.572095] Call Trace: Aug 22 17:43:06 juju-e4d256-prod-github-runner-207 kernel: [44360.573019] Aug 22 17:43:06 juju-e4d256-prod-github-runner-207 kernel: [44360.573902] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:43:06 juju-e4d256-prod-github-runner-207 kernel: [44360.574962] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:43:06 juju-e4d256-prod-github-runner-207 kernel: [44360.576003] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:43:06 juju-e4d256-prod-github-runner-207 kernel: [44360.577085] ? show_regs.part.0+0x23/0x29 Aug 22 17:43:06 juju-e4d256-prod-github-runner-207 kernel: [44360.578086] ? show_regs.cold+0x8/0xd Aug 22 17:43:06 juju-e4d256-prod-github-runner-207 kernel: [44360.579059] ? watchdog_timer_fn+0x1be/0x220 Aug 22 17:43:06 juju-e4d256-prod-github-runner-207 kernel: [44360.580066] ? lockup_detector_update_enable+0x60/0x60 Aug 22 17:43:06 juju-e4d256-prod-github-runner-207 kernel: [44360.581160] ? __hrtimer_run_queues+0x107/0x230 Aug 22 17:43:06 juju-e4d256-prod-github-runner-207 kernel: [44360.582201] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 17:43:06 juju-e4d256-prod-github-runner-207 kernel: [44360.583231] ? hrtimer_interrupt+0x101/0x220 Aug 22 17:43:06 juju-e4d256-prod-github-runner-207 kernel: [44360.584265] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 17:43:06 juju-e4d256-prod-github-runner-207 kernel: [44360.585373] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 17:43:06 juju-e4d256-prod-github-runner-207 kernel: [44360.586419] Aug 22 17:43:06 juju-e4d256-prod-github-runner-207 kernel: [44360.587272] Aug 22 17:43:06 juju-e4d256-prod-github-runner-207 kernel: [44360.588110] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 17:43:06 juju-e4d256-prod-github-runner-207 kernel: [44360.589190] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:43:06 juju-e4d256-prod-github-runner-207 kernel: [44360.590244] ? _raw_spin_lock+0x22/0x30 Aug 22 17:43:06 juju-e4d256-prod-github-runner-207 kernel: [44360.591189] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:43:06 juju-e4d256-prod-github-runner-207 kernel: [44360.592210] direct_page_fault+0x206/0x310 [kvm] Aug 22 17:43:06 juju-e4d256-prod-github-runner-207 kernel: [44360.593236] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 17:43:06 juju-e4d256-prod-github-runner-207 kernel: [44360.594246] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 17:43:06 juju-e4d256-prod-github-runner-207 kernel: [44360.595266] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 17:43:06 juju-e4d256-prod-github-runner-207 kernel: [44360.596252] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 17:43:06 juju-e4d256-prod-github-runner-207 kernel: [44360.597199] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 17:43:06 juju-e4d256-prod-github-runner-207 kernel: [44360.598185] handle_exit+0x98/0x230 [kvm_amd] Aug 22 17:43:06 juju-e4d256-prod-github-runner-207 kernel: [44360.599077] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 17:43:06 juju-e4d256-prod-github-runner-207 kernel: [44360.599992] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 17:43:06 juju-e4d256-prod-github-runner-207 kernel: [44360.600920] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 17:43:06 juju-e4d256-prod-github-runner-207 kernel: [44360.601823] vcpu_run+0x62/0x2c0 [kvm] Aug 22 17:43:06 juju-e4d256-prod-github-runner-207 kernel: [44360.602632] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 17:43:06 juju-e4d256-prod-github-runner-207 kernel: [44360.603450] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 17:43:06 juju-e4d256-prod-github-runner-207 kernel: [44360.604331] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 17:43:06 juju-e4d256-prod-github-runner-207 kernel: [44360.605144] ? __seccomp_filter+0x4a/0x4a0 Aug 22 17:43:06 juju-e4d256-prod-github-runner-207 kernel: [44360.605893] ? __fget_files+0x86/0xc0 Aug 22 17:43:06 juju-e4d256-prod-github-runner-207 kernel: [44360.606602] __x64_sys_ioctl+0x95/0xd0 Aug 22 17:43:06 juju-e4d256-prod-github-runner-207 kernel: [44360.607298] do_syscall_64+0x5c/0xc0 Aug 22 17:43:06 juju-e4d256-prod-github-runner-207 kernel: [44360.607963] ? do_futex+0x162/0x1f0 Aug 22 17:43:06 juju-e4d256-prod-github-runner-207 kernel: [44360.608621] ? __x64_sys_futex+0x78/0x1e0 Aug 22 17:43:06 juju-e4d256-prod-github-runner-207 kernel: [44360.609298] ? __secure_computing+0xa9/0x120 Aug 22 17:43:06 juju-e4d256-prod-github-runner-207 kernel: [44360.609986] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 17:43:06 juju-e4d256-prod-github-runner-207 kernel: [44360.610785] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:43:06 juju-e4d256-prod-github-runner-207 kernel: [44360.611527] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:43:06 juju-e4d256-prod-github-runner-207 kernel: [44360.612265] ? do_syscall_64+0x69/0xc0 Aug 22 17:43:06 juju-e4d256-prod-github-runner-207 kernel: [44360.612935] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:43:06 juju-e4d256-prod-github-runner-207 kernel: [44360.613653] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:43:06 juju-e4d256-prod-github-runner-207 kernel: [44360.614350] ? do_syscall_64+0x69/0xc0 Aug 22 17:43:06 juju-e4d256-prod-github-runner-207 kernel: [44360.614978] ? do_syscall_64+0x69/0xc0 Aug 22 17:43:06 juju-e4d256-prod-github-runner-207 kernel: [44360.615637] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 17:43:06 juju-e4d256-prod-github-runner-207 kernel: [44360.616373] RIP: 0033:0x7faa5d0edaff Aug 22 17:43:06 juju-e4d256-prod-github-runner-207 kernel: [44360.617000] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 17:43:06 juju-e4d256-prod-github-runner-207 kernel: [44360.618994] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 17:43:06 juju-e4d256-prod-github-runner-207 kernel: [44360.619911] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 17:43:06 juju-e4d256-prod-github-runner-207 kernel: [44360.620806] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 17:43:06 juju-e4d256-prod-github-runner-207 kernel: [44360.621699] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 17:43:06 juju-e4d256-prod-github-runner-207 kernel: [44360.622593] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 17:43:06 juju-e4d256-prod-github-runner-207 kernel: [44360.623517] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 17:43:06 juju-e4d256-prod-github-runner-207 kernel: [44360.624452] Aug 22 17:43:34 juju-e4d256-prod-github-runner-207 kernel: [44388.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 41232s! [qemu-system-x86:6715] Aug 22 17:43:34 juju-e4d256-prod-github-runner-207 kernel: [44388.543713] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 17:43:34 juju-e4d256-prod-github-runner-207 kernel: [44388.543997] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 17:43:34 juju-e4d256-prod-github-runner-207 kernel: [44388.556200] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 17:43:34 juju-e4d256-prod-github-runner-207 kernel: [44388.557473] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 17:43:34 juju-e4d256-prod-github-runner-207 kernel: [44388.558696] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:43:34 juju-e4d256-prod-github-runner-207 kernel: [44388.559757] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 17:43:34 juju-e4d256-prod-github-runner-207 kernel: [44388.562341] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 17:43:34 juju-e4d256-prod-github-runner-207 kernel: [44388.563391] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 17:43:34 juju-e4d256-prod-github-runner-207 kernel: [44388.564588] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 17:43:34 juju-e4d256-prod-github-runner-207 kernel: [44388.565782] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 17:43:34 juju-e4d256-prod-github-runner-207 kernel: [44388.566960] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 17:43:34 juju-e4d256-prod-github-runner-207 kernel: [44388.568135] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 17:43:34 juju-e4d256-prod-github-runner-207 kernel: [44388.569306] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 17:43:34 juju-e4d256-prod-github-runner-207 kernel: [44388.570555] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 17:43:34 juju-e4d256-prod-github-runner-207 kernel: [44388.571678] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 17:43:34 juju-e4d256-prod-github-runner-207 kernel: [44388.572893] Call Trace: Aug 22 17:43:34 juju-e4d256-prod-github-runner-207 kernel: [44388.573913] Aug 22 17:43:34 juju-e4d256-prod-github-runner-207 kernel: [44388.574821] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:43:34 juju-e4d256-prod-github-runner-207 kernel: [44388.575896] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:43:34 juju-e4d256-prod-github-runner-207 kernel: [44388.576966] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:43:34 juju-e4d256-prod-github-runner-207 kernel: [44388.578071] ? show_regs.part.0+0x23/0x29 Aug 22 17:43:34 juju-e4d256-prod-github-runner-207 kernel: [44388.579081] ? show_regs.cold+0x8/0xd Aug 22 17:43:34 juju-e4d256-prod-github-runner-207 kernel: [44388.580082] ? watchdog_timer_fn+0x1be/0x220 Aug 22 17:43:34 juju-e4d256-prod-github-runner-207 kernel: [44388.581122] ? lockup_detector_update_enable+0x60/0x60 Aug 22 17:43:34 juju-e4d256-prod-github-runner-207 kernel: [44388.582209] ? __hrtimer_run_queues+0x107/0x230 Aug 22 17:43:34 juju-e4d256-prod-github-runner-207 kernel: [44388.583243] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 17:43:34 juju-e4d256-prod-github-runner-207 kernel: [44388.584282] ? hrtimer_interrupt+0x101/0x220 Aug 22 17:43:34 juju-e4d256-prod-github-runner-207 kernel: [44388.585313] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 17:43:34 juju-e4d256-prod-github-runner-207 kernel: [44388.586536] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 17:43:34 juju-e4d256-prod-github-runner-207 kernel: [44388.587618] Aug 22 17:43:34 juju-e4d256-prod-github-runner-207 kernel: [44388.588497] Aug 22 17:43:34 juju-e4d256-prod-github-runner-207 kernel: [44388.589340] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 17:43:34 juju-e4d256-prod-github-runner-207 kernel: [44388.590376] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:43:34 juju-e4d256-prod-github-runner-207 kernel: [44388.591425] ? _raw_spin_lock+0x22/0x30 Aug 22 17:43:34 juju-e4d256-prod-github-runner-207 kernel: [44388.592405] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:43:34 juju-e4d256-prod-github-runner-207 kernel: [44388.593438] direct_page_fault+0x206/0x310 [kvm] Aug 22 17:43:34 juju-e4d256-prod-github-runner-207 kernel: [44388.594467] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 17:43:34 juju-e4d256-prod-github-runner-207 kernel: [44388.595491] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 17:43:34 juju-e4d256-prod-github-runner-207 kernel: [44388.596529] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 17:43:34 juju-e4d256-prod-github-runner-207 kernel: [44388.597563] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 17:43:34 juju-e4d256-prod-github-runner-207 kernel: [44388.598522] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 17:43:34 juju-e4d256-prod-github-runner-207 kernel: [44388.599501] handle_exit+0x98/0x230 [kvm_amd] Aug 22 17:43:34 juju-e4d256-prod-github-runner-207 kernel: [44388.600407] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 17:43:34 juju-e4d256-prod-github-runner-207 kernel: [44388.601336] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 17:43:34 juju-e4d256-prod-github-runner-207 kernel: [44388.602280] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 17:43:34 juju-e4d256-prod-github-runner-207 kernel: [44388.603192] vcpu_run+0x62/0x2c0 [kvm] Aug 22 17:43:34 juju-e4d256-prod-github-runner-207 kernel: [44388.604019] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 17:43:34 juju-e4d256-prod-github-runner-207 kernel: [44388.604834] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 17:43:34 juju-e4d256-prod-github-runner-207 kernel: [44388.605703] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 17:43:34 juju-e4d256-prod-github-runner-207 kernel: [44388.606528] ? __seccomp_filter+0x4a/0x4a0 Aug 22 17:43:34 juju-e4d256-prod-github-runner-207 kernel: [44388.607298] ? __fget_files+0x86/0xc0 Aug 22 17:43:34 juju-e4d256-prod-github-runner-207 kernel: [44388.608025] __x64_sys_ioctl+0x95/0xd0 Aug 22 17:43:34 juju-e4d256-prod-github-runner-207 kernel: [44388.608746] do_syscall_64+0x5c/0xc0 Aug 22 17:43:34 juju-e4d256-prod-github-runner-207 kernel: [44388.609422] ? do_futex+0x162/0x1f0 Aug 22 17:43:34 juju-e4d256-prod-github-runner-207 kernel: [44388.610073] ? __x64_sys_futex+0x78/0x1e0 Aug 22 17:43:34 juju-e4d256-prod-github-runner-207 kernel: [44388.610755] ? __secure_computing+0xa9/0x120 Aug 22 17:43:34 juju-e4d256-prod-github-runner-207 kernel: [44388.611473] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 17:43:34 juju-e4d256-prod-github-runner-207 kernel: [44388.612262] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:43:34 juju-e4d256-prod-github-runner-207 kernel: [44388.612997] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:43:34 juju-e4d256-prod-github-runner-207 kernel: [44388.613718] ? do_syscall_64+0x69/0xc0 Aug 22 17:43:34 juju-e4d256-prod-github-runner-207 kernel: [44388.614364] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:43:34 juju-e4d256-prod-github-runner-207 kernel: [44388.615071] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:43:34 juju-e4d256-prod-github-runner-207 kernel: [44388.615775] ? do_syscall_64+0x69/0xc0 Aug 22 17:43:34 juju-e4d256-prod-github-runner-207 kernel: [44388.616426] ? do_syscall_64+0x69/0xc0 Aug 22 17:43:34 juju-e4d256-prod-github-runner-207 kernel: [44388.617067] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 17:43:34 juju-e4d256-prod-github-runner-207 kernel: [44388.617802] RIP: 0033:0x7faa5d0edaff Aug 22 17:43:34 juju-e4d256-prod-github-runner-207 kernel: [44388.618448] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 17:43:34 juju-e4d256-prod-github-runner-207 kernel: [44388.620460] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 17:43:34 juju-e4d256-prod-github-runner-207 kernel: [44388.621385] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 17:43:34 juju-e4d256-prod-github-runner-207 kernel: [44388.622288] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 17:43:34 juju-e4d256-prod-github-runner-207 kernel: [44388.623193] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 17:43:34 juju-e4d256-prod-github-runner-207 kernel: [44388.624108] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 17:43:34 juju-e4d256-prod-github-runner-207 kernel: [44388.625004] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 17:43:34 juju-e4d256-prod-github-runner-207 kernel: [44388.625908] Aug 22 17:44:02 juju-e4d256-prod-github-runner-207 kernel: [44416.541976] watchdog: BUG: soft lockup - CPU#1 stuck for 41258s! [qemu-system-x86:6715] Aug 22 17:44:02 juju-e4d256-prod-github-runner-207 kernel: [44416.543080] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 17:44:02 juju-e4d256-prod-github-runner-207 kernel: [44416.543147] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 17:44:02 juju-e4d256-prod-github-runner-207 kernel: [44416.555337] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 17:44:02 juju-e4d256-prod-github-runner-207 kernel: [44416.556624] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 17:44:02 juju-e4d256-prod-github-runner-207 kernel: [44416.557846] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:44:02 juju-e4d256-prod-github-runner-207 kernel: [44416.558908] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 17:44:02 juju-e4d256-prod-github-runner-207 kernel: [44416.561470] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 17:44:02 juju-e4d256-prod-github-runner-207 kernel: [44416.562523] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 17:44:02 juju-e4d256-prod-github-runner-207 kernel: [44416.563696] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 17:44:02 juju-e4d256-prod-github-runner-207 kernel: [44416.564864] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 17:44:02 juju-e4d256-prod-github-runner-207 kernel: [44416.566032] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 17:44:02 juju-e4d256-prod-github-runner-207 kernel: [44416.567205] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 17:44:02 juju-e4d256-prod-github-runner-207 kernel: [44416.568384] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 17:44:02 juju-e4d256-prod-github-runner-207 kernel: [44416.569619] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 17:44:02 juju-e4d256-prod-github-runner-207 kernel: [44416.570716] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 17:44:02 juju-e4d256-prod-github-runner-207 kernel: [44416.571939] Call Trace: Aug 22 17:44:02 juju-e4d256-prod-github-runner-207 kernel: [44416.572859] Aug 22 17:44:02 juju-e4d256-prod-github-runner-207 kernel: [44416.573741] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:44:02 juju-e4d256-prod-github-runner-207 kernel: [44416.574853] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:44:02 juju-e4d256-prod-github-runner-207 kernel: [44416.575946] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:44:02 juju-e4d256-prod-github-runner-207 kernel: [44416.577051] ? show_regs.part.0+0x23/0x29 Aug 22 17:44:02 juju-e4d256-prod-github-runner-207 kernel: [44416.578055] ? show_regs.cold+0x8/0xd Aug 22 17:44:02 juju-e4d256-prod-github-runner-207 kernel: [44416.579024] ? watchdog_timer_fn+0x1be/0x220 Aug 22 17:44:02 juju-e4d256-prod-github-runner-207 kernel: [44416.580045] ? lockup_detector_update_enable+0x60/0x60 Aug 22 17:44:02 juju-e4d256-prod-github-runner-207 kernel: [44416.581146] ? __hrtimer_run_queues+0x107/0x230 Aug 22 17:44:02 juju-e4d256-prod-github-runner-207 kernel: [44416.582199] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 17:44:02 juju-e4d256-prod-github-runner-207 kernel: [44416.583230] ? hrtimer_interrupt+0x101/0x220 Aug 22 17:44:02 juju-e4d256-prod-github-runner-207 kernel: [44416.584260] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 17:44:02 juju-e4d256-prod-github-runner-207 kernel: [44416.585380] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 17:44:02 juju-e4d256-prod-github-runner-207 kernel: [44416.586427] Aug 22 17:44:02 juju-e4d256-prod-github-runner-207 kernel: [44416.587295] Aug 22 17:44:02 juju-e4d256-prod-github-runner-207 kernel: [44416.588148] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 17:44:02 juju-e4d256-prod-github-runner-207 kernel: [44416.589180] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:44:02 juju-e4d256-prod-github-runner-207 kernel: [44416.590216] ? _raw_spin_lock+0x22/0x30 Aug 22 17:44:02 juju-e4d256-prod-github-runner-207 kernel: [44416.591158] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:44:02 juju-e4d256-prod-github-runner-207 kernel: [44416.592216] direct_page_fault+0x206/0x310 [kvm] Aug 22 17:44:02 juju-e4d256-prod-github-runner-207 kernel: [44416.593244] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 17:44:02 juju-e4d256-prod-github-runner-207 kernel: [44416.594299] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 17:44:02 juju-e4d256-prod-github-runner-207 kernel: [44416.595306] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 17:44:02 juju-e4d256-prod-github-runner-207 kernel: [44416.596384] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 17:44:02 juju-e4d256-prod-github-runner-207 kernel: [44416.597443] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 17:44:02 juju-e4d256-prod-github-runner-207 kernel: [44416.598442] handle_exit+0x98/0x230 [kvm_amd] Aug 22 17:44:02 juju-e4d256-prod-github-runner-207 kernel: [44416.599849] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 17:44:02 juju-e4d256-prod-github-runner-207 kernel: [44416.600859] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 17:44:02 juju-e4d256-prod-github-runner-207 kernel: [44416.601785] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 17:44:02 juju-e4d256-prod-github-runner-207 kernel: [44416.602702] vcpu_run+0x62/0x2c0 [kvm] Aug 22 17:44:02 juju-e4d256-prod-github-runner-207 kernel: [44416.603551] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 17:44:02 juju-e4d256-prod-github-runner-207 kernel: [44416.604426] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 17:44:02 juju-e4d256-prod-github-runner-207 kernel: [44416.605283] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 17:44:02 juju-e4d256-prod-github-runner-207 kernel: [44416.606090] ? __seccomp_filter+0x4a/0x4a0 Aug 22 17:44:02 juju-e4d256-prod-github-runner-207 kernel: [44416.606838] ? __fget_files+0x86/0xc0 Aug 22 17:44:02 juju-e4d256-prod-github-runner-207 kernel: [44416.607561] __x64_sys_ioctl+0x95/0xd0 Aug 22 17:44:02 juju-e4d256-prod-github-runner-207 kernel: [44416.608265] do_syscall_64+0x5c/0xc0 Aug 22 17:44:02 juju-e4d256-prod-github-runner-207 kernel: [44416.608937] ? do_futex+0x162/0x1f0 Aug 22 17:44:02 juju-e4d256-prod-github-runner-207 kernel: [44416.609588] ? __x64_sys_futex+0x78/0x1e0 Aug 22 17:44:02 juju-e4d256-prod-github-runner-207 kernel: [44416.610261] ? __secure_computing+0xa9/0x120 Aug 22 17:44:02 juju-e4d256-prod-github-runner-207 kernel: [44416.610993] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 17:44:02 juju-e4d256-prod-github-runner-207 kernel: [44416.611779] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:44:02 juju-e4d256-prod-github-runner-207 kernel: [44416.612517] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:44:02 juju-e4d256-prod-github-runner-207 kernel: [44416.613271] ? do_syscall_64+0x69/0xc0 Aug 22 17:44:02 juju-e4d256-prod-github-runner-207 kernel: [44416.613927] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:44:02 juju-e4d256-prod-github-runner-207 kernel: [44416.614635] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:44:02 juju-e4d256-prod-github-runner-207 kernel: [44416.615329] ? do_syscall_64+0x69/0xc0 Aug 22 17:44:02 juju-e4d256-prod-github-runner-207 kernel: [44416.615965] ? do_syscall_64+0x69/0xc0 Aug 22 17:44:02 juju-e4d256-prod-github-runner-207 kernel: [44416.616586] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 17:44:02 juju-e4d256-prod-github-runner-207 kernel: [44416.617292] RIP: 0033:0x7faa5d0edaff Aug 22 17:44:02 juju-e4d256-prod-github-runner-207 kernel: [44416.617921] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 17:44:02 juju-e4d256-prod-github-runner-207 kernel: [44416.619932] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 17:44:02 juju-e4d256-prod-github-runner-207 kernel: [44416.620849] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 17:44:02 juju-e4d256-prod-github-runner-207 kernel: [44416.621743] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 17:44:02 juju-e4d256-prod-github-runner-207 kernel: [44416.622634] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 17:44:02 juju-e4d256-prod-github-runner-207 kernel: [44416.623547] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 17:44:02 juju-e4d256-prod-github-runner-207 kernel: [44416.624450] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 17:44:02 juju-e4d256-prod-github-runner-207 kernel: [44416.625400] Aug 22 17:44:30 juju-e4d256-prod-github-runner-207 kernel: [44444.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 41284s! [qemu-system-x86:6715] Aug 22 17:44:30 juju-e4d256-prod-github-runner-207 kernel: [44444.543121] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 17:44:30 juju-e4d256-prod-github-runner-207 kernel: [44444.543209] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 17:44:30 juju-e4d256-prod-github-runner-207 kernel: [44444.555444] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 17:44:30 juju-e4d256-prod-github-runner-207 kernel: [44444.556721] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 17:44:30 juju-e4d256-prod-github-runner-207 kernel: [44444.557940] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:44:30 juju-e4d256-prod-github-runner-207 kernel: [44444.559005] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 17:44:30 juju-e4d256-prod-github-runner-207 kernel: [44444.561574] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 17:44:30 juju-e4d256-prod-github-runner-207 kernel: [44444.562623] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 17:44:30 juju-e4d256-prod-github-runner-207 kernel: [44444.563814] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 17:44:30 juju-e4d256-prod-github-runner-207 kernel: [44444.564981] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 17:44:30 juju-e4d256-prod-github-runner-207 kernel: [44444.566159] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 17:44:30 juju-e4d256-prod-github-runner-207 kernel: [44444.567389] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 17:44:30 juju-e4d256-prod-github-runner-207 kernel: [44444.568574] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 17:44:30 juju-e4d256-prod-github-runner-207 kernel: [44444.569828] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 17:44:30 juju-e4d256-prod-github-runner-207 kernel: [44444.570935] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 17:44:30 juju-e4d256-prod-github-runner-207 kernel: [44444.572164] Call Trace: Aug 22 17:44:30 juju-e4d256-prod-github-runner-207 kernel: [44444.573091] Aug 22 17:44:30 juju-e4d256-prod-github-runner-207 kernel: [44444.573986] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:44:30 juju-e4d256-prod-github-runner-207 kernel: [44444.575085] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:44:30 juju-e4d256-prod-github-runner-207 kernel: [44444.576377] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:44:30 juju-e4d256-prod-github-runner-207 kernel: [44444.577467] ? show_regs.part.0+0x23/0x29 Aug 22 17:44:30 juju-e4d256-prod-github-runner-207 kernel: [44444.578463] ? show_regs.cold+0x8/0xd Aug 22 17:44:30 juju-e4d256-prod-github-runner-207 kernel: [44444.579468] ? watchdog_timer_fn+0x1be/0x220 Aug 22 17:44:30 juju-e4d256-prod-github-runner-207 kernel: [44444.580504] ? lockup_detector_update_enable+0x60/0x60 Aug 22 17:44:30 juju-e4d256-prod-github-runner-207 kernel: [44444.581574] ? __hrtimer_run_queues+0x107/0x230 Aug 22 17:44:30 juju-e4d256-prod-github-runner-207 kernel: [44444.582654] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 17:44:30 juju-e4d256-prod-github-runner-207 kernel: [44444.583726] ? hrtimer_interrupt+0x101/0x220 Aug 22 17:44:30 juju-e4d256-prod-github-runner-207 kernel: [44444.584772] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 17:44:30 juju-e4d256-prod-github-runner-207 kernel: [44444.585853] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 17:44:30 juju-e4d256-prod-github-runner-207 kernel: [44444.586904] Aug 22 17:44:30 juju-e4d256-prod-github-runner-207 kernel: [44444.587803] Aug 22 17:44:30 juju-e4d256-prod-github-runner-207 kernel: [44444.588669] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 17:44:30 juju-e4d256-prod-github-runner-207 kernel: [44444.589721] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:44:30 juju-e4d256-prod-github-runner-207 kernel: [44444.590777] ? _raw_spin_lock+0x22/0x30 Aug 22 17:44:30 juju-e4d256-prod-github-runner-207 kernel: [44444.591744] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:44:30 juju-e4d256-prod-github-runner-207 kernel: [44444.592775] direct_page_fault+0x206/0x310 [kvm] Aug 22 17:44:30 juju-e4d256-prod-github-runner-207 kernel: [44444.593807] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 17:44:30 juju-e4d256-prod-github-runner-207 kernel: [44444.594833] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 17:44:30 juju-e4d256-prod-github-runner-207 kernel: [44444.595869] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 17:44:30 juju-e4d256-prod-github-runner-207 kernel: [44444.596921] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 17:44:30 juju-e4d256-prod-github-runner-207 kernel: [44444.598019] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 17:44:30 juju-e4d256-prod-github-runner-207 kernel: [44444.599029] handle_exit+0x98/0x230 [kvm_amd] Aug 22 17:44:30 juju-e4d256-prod-github-runner-207 kernel: [44444.599938] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 17:44:30 juju-e4d256-prod-github-runner-207 kernel: [44444.601087] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 17:44:30 juju-e4d256-prod-github-runner-207 kernel: [44444.602074] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 17:44:30 juju-e4d256-prod-github-runner-207 kernel: [44444.602993] vcpu_run+0x62/0x2c0 [kvm] Aug 22 17:44:30 juju-e4d256-prod-github-runner-207 kernel: [44444.603831] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 17:44:30 juju-e4d256-prod-github-runner-207 kernel: [44444.604641] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 17:44:30 juju-e4d256-prod-github-runner-207 kernel: [44444.605504] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 17:44:30 juju-e4d256-prod-github-runner-207 kernel: [44444.606331] ? __seccomp_filter+0x4a/0x4a0 Aug 22 17:44:30 juju-e4d256-prod-github-runner-207 kernel: [44444.607091] ? __fget_files+0x86/0xc0 Aug 22 17:44:30 juju-e4d256-prod-github-runner-207 kernel: [44444.607816] __x64_sys_ioctl+0x95/0xd0 Aug 22 17:44:30 juju-e4d256-prod-github-runner-207 kernel: [44444.608510] do_syscall_64+0x5c/0xc0 Aug 22 17:44:30 juju-e4d256-prod-github-runner-207 kernel: [44444.609176] ? do_futex+0x162/0x1f0 Aug 22 17:44:30 juju-e4d256-prod-github-runner-207 kernel: [44444.609827] ? __x64_sys_futex+0x78/0x1e0 Aug 22 17:44:30 juju-e4d256-prod-github-runner-207 kernel: [44444.610501] ? __secure_computing+0xa9/0x120 Aug 22 17:44:30 juju-e4d256-prod-github-runner-207 kernel: [44444.611205] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 17:44:30 juju-e4d256-prod-github-runner-207 kernel: [44444.612045] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:44:30 juju-e4d256-prod-github-runner-207 kernel: [44444.612777] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:44:30 juju-e4d256-prod-github-runner-207 kernel: [44444.613495] ? do_syscall_64+0x69/0xc0 Aug 22 17:44:30 juju-e4d256-prod-github-runner-207 kernel: [44444.614140] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:44:30 juju-e4d256-prod-github-runner-207 kernel: [44444.614844] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:44:30 juju-e4d256-prod-github-runner-207 kernel: [44444.615553] ? do_syscall_64+0x69/0xc0 Aug 22 17:44:30 juju-e4d256-prod-github-runner-207 kernel: [44444.616179] ? do_syscall_64+0x69/0xc0 Aug 22 17:44:30 juju-e4d256-prod-github-runner-207 kernel: [44444.616848] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 17:44:30 juju-e4d256-prod-github-runner-207 kernel: [44444.617567] RIP: 0033:0x7faa5d0edaff Aug 22 17:44:30 juju-e4d256-prod-github-runner-207 kernel: [44444.618194] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 17:44:30 juju-e4d256-prod-github-runner-207 kernel: [44444.620198] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 17:44:30 juju-e4d256-prod-github-runner-207 kernel: [44444.621114] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 17:44:30 juju-e4d256-prod-github-runner-207 kernel: [44444.622037] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 17:44:30 juju-e4d256-prod-github-runner-207 kernel: [44444.622939] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 17:44:30 juju-e4d256-prod-github-runner-207 kernel: [44444.623847] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 17:44:30 juju-e4d256-prod-github-runner-207 kernel: [44444.624736] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 17:44:30 juju-e4d256-prod-github-runner-207 kernel: [44444.625630] Aug 22 17:44:46 juju-e4d256-prod-github-runner-207 kernel: [44460.152705] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 17:44:46 juju-e4d256-prod-github-runner-207 kernel: [44460.153692] rcu: 1-....: (11051007 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=5349192 Aug 22 17:44:46 juju-e4d256-prod-github-runner-207 kernel: [44460.154824] (t=11085738 jiffies g=23269 q=44025) Aug 22 17:44:46 juju-e4d256-prod-github-runner-207 kernel: [44460.155626] NMI backtrace for cpu 1 Aug 22 17:44:46 juju-e4d256-prod-github-runner-207 kernel: [44460.156334] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 17:44:46 juju-e4d256-prod-github-runner-207 kernel: [44460.157441] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 17:44:46 juju-e4d256-prod-github-runner-207 kernel: [44460.158514] Call Trace: Aug 22 17:44:46 juju-e4d256-prod-github-runner-207 kernel: [44460.159204] Aug 22 17:44:46 juju-e4d256-prod-github-runner-207 kernel: [44460.159851] show_stack+0x52/0x5c Aug 22 17:44:46 juju-e4d256-prod-github-runner-207 kernel: [44460.160580] dump_stack_lvl+0x4a/0x63 Aug 22 17:44:46 juju-e4d256-prod-github-runner-207 kernel: [44460.161412] dump_stack+0x10/0x16 Aug 22 17:44:46 juju-e4d256-prod-github-runner-207 kernel: [44460.162127] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 17:44:46 juju-e4d256-prod-github-runner-207 kernel: [44460.162909] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 17:44:46 juju-e4d256-prod-github-runner-207 kernel: [44460.163725] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 17:44:46 juju-e4d256-prod-github-runner-207 kernel: [44460.164588] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 17:44:46 juju-e4d256-prod-github-runner-207 kernel: [44460.165630] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 17:44:46 juju-e4d256-prod-github-runner-207 kernel: [44460.166537] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 17:44:46 juju-e4d256-prod-github-runner-207 kernel: [44460.167413] print_cpu_stall.cold+0x2f/0xe2 Aug 22 17:44:46 juju-e4d256-prod-github-runner-207 kernel: [44460.168256] ? timekeeping_update+0xf7/0x150 Aug 22 17:44:46 juju-e4d256-prod-github-runner-207 kernel: [44460.169152] check_cpu_stall+0x109/0x270 Aug 22 17:44:46 juju-e4d256-prod-github-runner-207 kernel: [44460.169982] rcu_sched_clock_irq+0x9a/0x250 Aug 22 17:44:46 juju-e4d256-prod-github-runner-207 kernel: [44460.170839] update_process_times+0x94/0xd0 Aug 22 17:44:46 juju-e4d256-prod-github-runner-207 kernel: [44460.171690] tick_sched_handle+0x29/0x70 Aug 22 17:44:46 juju-e4d256-prod-github-runner-207 kernel: [44460.172514] tick_sched_timer+0x8c/0xc0 Aug 22 17:44:46 juju-e4d256-prod-github-runner-207 kernel: [44460.173327] ? tick_nohz_handler+0xb0/0xb0 Aug 22 17:44:46 juju-e4d256-prod-github-runner-207 kernel: [44460.174158] __hrtimer_run_queues+0x107/0x230 Aug 22 17:44:46 juju-e4d256-prod-github-runner-207 kernel: [44460.175018] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 17:44:46 juju-e4d256-prod-github-runner-207 kernel: [44460.175874] hrtimer_interrupt+0x101/0x220 Aug 22 17:44:46 juju-e4d256-prod-github-runner-207 kernel: [44460.176708] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 17:44:46 juju-e4d256-prod-github-runner-207 kernel: [44460.177610] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 17:44:46 juju-e4d256-prod-github-runner-207 kernel: [44460.178503] Aug 22 17:44:46 juju-e4d256-prod-github-runner-207 kernel: [44460.179195] Aug 22 17:44:46 juju-e4d256-prod-github-runner-207 kernel: [44460.179868] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 17:44:46 juju-e4d256-prod-github-runner-207 kernel: [44460.180783] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:44:46 juju-e4d256-prod-github-runner-207 kernel: [44460.181777] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 17:44:46 juju-e4d256-prod-github-runner-207 kernel: [44460.184322] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 17:44:46 juju-e4d256-prod-github-runner-207 kernel: [44460.185292] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 17:44:46 juju-e4d256-prod-github-runner-207 kernel: [44460.186416] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 17:44:46 juju-e4d256-prod-github-runner-207 kernel: [44460.187531] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 17:44:46 juju-e4d256-prod-github-runner-207 kernel: [44460.188620] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 17:44:46 juju-e4d256-prod-github-runner-207 kernel: [44460.189709] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 17:44:46 juju-e4d256-prod-github-runner-207 kernel: [44460.190794] ? _raw_spin_lock+0x22/0x30 Aug 22 17:44:46 juju-e4d256-prod-github-runner-207 kernel: [44460.191647] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:44:46 juju-e4d256-prod-github-runner-207 kernel: [44460.192566] direct_page_fault+0x206/0x310 [kvm] Aug 22 17:44:46 juju-e4d256-prod-github-runner-207 kernel: [44460.193493] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 17:44:46 juju-e4d256-prod-github-runner-207 kernel: [44460.194409] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 17:44:46 juju-e4d256-prod-github-runner-207 kernel: [44460.195342] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 17:44:46 juju-e4d256-prod-github-runner-207 kernel: [44460.196237] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 17:44:46 juju-e4d256-prod-github-runner-207 kernel: [44460.197107] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 17:44:46 juju-e4d256-prod-github-runner-207 kernel: [44460.198039] handle_exit+0x98/0x230 [kvm_amd] Aug 22 17:44:46 juju-e4d256-prod-github-runner-207 kernel: [44460.198881] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 17:44:46 juju-e4d256-prod-github-runner-207 kernel: [44460.199780] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 17:44:46 juju-e4d256-prod-github-runner-207 kernel: [44460.200677] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 17:44:46 juju-e4d256-prod-github-runner-207 kernel: [44460.201560] vcpu_run+0x62/0x2c0 [kvm] Aug 22 17:44:46 juju-e4d256-prod-github-runner-207 kernel: [44460.202351] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 17:44:46 juju-e4d256-prod-github-runner-207 kernel: [44460.203188] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 17:44:46 juju-e4d256-prod-github-runner-207 kernel: [44460.204085] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 17:44:46 juju-e4d256-prod-github-runner-207 kernel: [44460.204932] ? __seccomp_filter+0x4a/0x4a0 Aug 22 17:44:46 juju-e4d256-prod-github-runner-207 kernel: [44460.205730] ? __fget_files+0x86/0xc0 Aug 22 17:44:46 juju-e4d256-prod-github-runner-207 kernel: [44460.206497] __x64_sys_ioctl+0x95/0xd0 Aug 22 17:44:46 juju-e4d256-prod-github-runner-207 kernel: [44460.207272] do_syscall_64+0x5c/0xc0 Aug 22 17:44:46 juju-e4d256-prod-github-runner-207 kernel: [44460.208027] ? do_futex+0x162/0x1f0 Aug 22 17:44:46 juju-e4d256-prod-github-runner-207 kernel: [44460.208766] ? __x64_sys_futex+0x78/0x1e0 Aug 22 17:44:46 juju-e4d256-prod-github-runner-207 kernel: [44460.209544] ? __secure_computing+0xa9/0x120 Aug 22 17:44:46 juju-e4d256-prod-github-runner-207 kernel: [44460.210342] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 17:44:46 juju-e4d256-prod-github-runner-207 kernel: [44460.211255] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:44:46 juju-e4d256-prod-github-runner-207 kernel: [44460.212105] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:44:46 juju-e4d256-prod-github-runner-207 kernel: [44460.212954] ? do_syscall_64+0x69/0xc0 Aug 22 17:44:46 juju-e4d256-prod-github-runner-207 kernel: [44460.213716] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:44:46 juju-e4d256-prod-github-runner-207 kernel: [44460.214571] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:44:46 juju-e4d256-prod-github-runner-207 kernel: [44460.215435] ? do_syscall_64+0x69/0xc0 Aug 22 17:44:46 juju-e4d256-prod-github-runner-207 kernel: [44460.216206] ? do_syscall_64+0x69/0xc0 Aug 22 17:44:46 juju-e4d256-prod-github-runner-207 kernel: [44460.216966] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 17:44:46 juju-e4d256-prod-github-runner-207 kernel: [44460.217832] RIP: 0033:0x7faa5d0edaff Aug 22 17:44:46 juju-e4d256-prod-github-runner-207 kernel: [44460.218594] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 17:44:46 juju-e4d256-prod-github-runner-207 kernel: [44460.221033] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 17:44:46 juju-e4d256-prod-github-runner-207 kernel: [44460.222134] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 17:44:46 juju-e4d256-prod-github-runner-207 kernel: [44460.223225] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 17:44:46 juju-e4d256-prod-github-runner-207 kernel: [44460.224305] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 17:44:46 juju-e4d256-prod-github-runner-207 kernel: [44460.225380] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 17:44:46 juju-e4d256-prod-github-runner-207 kernel: [44460.226439] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 17:44:46 juju-e4d256-prod-github-runner-207 kernel: [44460.227509] Aug 22 17:45:10 juju-e4d256-prod-github-runner-207 kernel: [44484.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 41321s! [qemu-system-x86:6715] Aug 22 17:45:10 juju-e4d256-prod-github-runner-207 kernel: [44484.543778] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 17:45:10 juju-e4d256-prod-github-runner-207 kernel: [44484.544028] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 17:45:10 juju-e4d256-prod-github-runner-207 kernel: [44484.556462] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 17:45:10 juju-e4d256-prod-github-runner-207 kernel: [44484.557744] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 17:45:10 juju-e4d256-prod-github-runner-207 kernel: [44484.558979] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:45:10 juju-e4d256-prod-github-runner-207 kernel: [44484.560047] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 17:45:10 juju-e4d256-prod-github-runner-207 kernel: [44484.562609] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 17:45:10 juju-e4d256-prod-github-runner-207 kernel: [44484.563825] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 17:45:10 juju-e4d256-prod-github-runner-207 kernel: [44484.565019] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 17:45:10 juju-e4d256-prod-github-runner-207 kernel: [44484.566206] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 17:45:10 juju-e4d256-prod-github-runner-207 kernel: [44484.567678] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 17:45:10 juju-e4d256-prod-github-runner-207 kernel: [44484.568951] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 17:45:10 juju-e4d256-prod-github-runner-207 kernel: [44484.570151] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 17:45:10 juju-e4d256-prod-github-runner-207 kernel: [44484.571455] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 17:45:10 juju-e4d256-prod-github-runner-207 kernel: [44484.572590] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 17:45:10 juju-e4d256-prod-github-runner-207 kernel: [44484.573804] Call Trace: Aug 22 17:45:10 juju-e4d256-prod-github-runner-207 kernel: [44484.574759] Aug 22 17:45:10 juju-e4d256-prod-github-runner-207 kernel: [44484.575677] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:45:10 juju-e4d256-prod-github-runner-207 kernel: [44484.576719] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:45:10 juju-e4d256-prod-github-runner-207 kernel: [44484.577753] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:45:10 juju-e4d256-prod-github-runner-207 kernel: [44484.578917] ? show_regs.part.0+0x23/0x29 Aug 22 17:45:10 juju-e4d256-prod-github-runner-207 kernel: [44484.579952] ? show_regs.cold+0x8/0xd Aug 22 17:45:10 juju-e4d256-prod-github-runner-207 kernel: [44484.580929] ? watchdog_timer_fn+0x1be/0x220 Aug 22 17:45:10 juju-e4d256-prod-github-runner-207 kernel: [44484.581957] ? lockup_detector_update_enable+0x60/0x60 Aug 22 17:45:10 juju-e4d256-prod-github-runner-207 kernel: [44484.583075] ? __hrtimer_run_queues+0x107/0x230 Aug 22 17:45:10 juju-e4d256-prod-github-runner-207 kernel: [44484.584145] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 17:45:10 juju-e4d256-prod-github-runner-207 kernel: [44484.585261] ? hrtimer_interrupt+0x101/0x220 Aug 22 17:45:10 juju-e4d256-prod-github-runner-207 kernel: [44484.586293] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 17:45:10 juju-e4d256-prod-github-runner-207 kernel: [44484.587404] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 17:45:10 juju-e4d256-prod-github-runner-207 kernel: [44484.588460] Aug 22 17:45:10 juju-e4d256-prod-github-runner-207 kernel: [44484.589311] Aug 22 17:45:10 juju-e4d256-prod-github-runner-207 kernel: [44484.590151] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 17:45:10 juju-e4d256-prod-github-runner-207 kernel: [44484.591235] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:45:10 juju-e4d256-prod-github-runner-207 kernel: [44484.592280] ? _raw_spin_lock+0x22/0x30 Aug 22 17:45:10 juju-e4d256-prod-github-runner-207 kernel: [44484.593229] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:45:10 juju-e4d256-prod-github-runner-207 kernel: [44484.594244] direct_page_fault+0x206/0x310 [kvm] Aug 22 17:45:10 juju-e4d256-prod-github-runner-207 kernel: [44484.595311] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 17:45:10 juju-e4d256-prod-github-runner-207 kernel: [44484.596328] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 17:45:10 juju-e4d256-prod-github-runner-207 kernel: [44484.597325] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 17:45:10 juju-e4d256-prod-github-runner-207 kernel: [44484.598324] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 17:45:10 juju-e4d256-prod-github-runner-207 kernel: [44484.599331] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 17:45:10 juju-e4d256-prod-github-runner-207 kernel: [44484.600308] handle_exit+0x98/0x230 [kvm_amd] Aug 22 17:45:10 juju-e4d256-prod-github-runner-207 kernel: [44484.601201] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 17:45:10 juju-e4d256-prod-github-runner-207 kernel: [44484.602114] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 17:45:10 juju-e4d256-prod-github-runner-207 kernel: [44484.603054] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 17:45:10 juju-e4d256-prod-github-runner-207 kernel: [44484.603973] vcpu_run+0x62/0x2c0 [kvm] Aug 22 17:45:10 juju-e4d256-prod-github-runner-207 kernel: [44484.604783] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 17:45:10 juju-e4d256-prod-github-runner-207 kernel: [44484.605589] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 17:45:10 juju-e4d256-prod-github-runner-207 kernel: [44484.606441] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 17:45:10 juju-e4d256-prod-github-runner-207 kernel: [44484.607250] ? __seccomp_filter+0x4a/0x4a0 Aug 22 17:45:10 juju-e4d256-prod-github-runner-207 kernel: [44484.607991] ? __fget_files+0x86/0xc0 Aug 22 17:45:10 juju-e4d256-prod-github-runner-207 kernel: [44484.608694] __x64_sys_ioctl+0x95/0xd0 Aug 22 17:45:10 juju-e4d256-prod-github-runner-207 kernel: [44484.609385] do_syscall_64+0x5c/0xc0 Aug 22 17:45:10 juju-e4d256-prod-github-runner-207 kernel: [44484.610047] ? do_futex+0x162/0x1f0 Aug 22 17:45:10 juju-e4d256-prod-github-runner-207 kernel: [44484.610705] ? __x64_sys_futex+0x78/0x1e0 Aug 22 17:45:10 juju-e4d256-prod-github-runner-207 kernel: [44484.611389] ? __secure_computing+0xa9/0x120 Aug 22 17:45:10 juju-e4d256-prod-github-runner-207 kernel: [44484.612079] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 17:45:10 juju-e4d256-prod-github-runner-207 kernel: [44484.612842] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:45:10 juju-e4d256-prod-github-runner-207 kernel: [44484.613561] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:45:10 juju-e4d256-prod-github-runner-207 kernel: [44484.614278] ? do_syscall_64+0x69/0xc0 Aug 22 17:45:10 juju-e4d256-prod-github-runner-207 kernel: [44484.614942] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:45:10 juju-e4d256-prod-github-runner-207 kernel: [44484.615644] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:45:10 juju-e4d256-prod-github-runner-207 kernel: [44484.616338] ? do_syscall_64+0x69/0xc0 Aug 22 17:45:10 juju-e4d256-prod-github-runner-207 kernel: [44484.616959] ? do_syscall_64+0x69/0xc0 Aug 22 17:45:10 juju-e4d256-prod-github-runner-207 kernel: [44484.617600] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 17:45:10 juju-e4d256-prod-github-runner-207 kernel: [44484.618309] RIP: 0033:0x7faa5d0edaff Aug 22 17:45:10 juju-e4d256-prod-github-runner-207 kernel: [44484.618987] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 17:45:10 juju-e4d256-prod-github-runner-207 kernel: [44484.621180] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 17:45:10 juju-e4d256-prod-github-runner-207 kernel: [44484.622108] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 17:45:10 juju-e4d256-prod-github-runner-207 kernel: [44484.623015] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 17:45:10 juju-e4d256-prod-github-runner-207 kernel: [44484.623932] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 17:45:10 juju-e4d256-prod-github-runner-207 kernel: [44484.624832] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 17:45:10 juju-e4d256-prod-github-runner-207 kernel: [44484.625798] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 17:45:10 juju-e4d256-prod-github-runner-207 kernel: [44484.626725] Aug 22 17:45:38 juju-e4d256-prod-github-runner-207 kernel: [44512.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 41347s! [qemu-system-x86:6715] Aug 22 17:45:38 juju-e4d256-prod-github-runner-207 kernel: [44512.543082] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 17:45:38 juju-e4d256-prod-github-runner-207 kernel: [44512.543150] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 17:45:38 juju-e4d256-prod-github-runner-207 kernel: [44512.555189] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 17:45:38 juju-e4d256-prod-github-runner-207 kernel: [44512.556456] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 17:45:38 juju-e4d256-prod-github-runner-207 kernel: [44512.557674] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:45:38 juju-e4d256-prod-github-runner-207 kernel: [44512.558734] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 17:45:38 juju-e4d256-prod-github-runner-207 kernel: [44512.561281] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 17:45:38 juju-e4d256-prod-github-runner-207 kernel: [44512.562323] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 17:45:38 juju-e4d256-prod-github-runner-207 kernel: [44512.563492] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 17:45:38 juju-e4d256-prod-github-runner-207 kernel: [44512.564648] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 17:45:38 juju-e4d256-prod-github-runner-207 kernel: [44512.565811] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 17:45:38 juju-e4d256-prod-github-runner-207 kernel: [44512.567116] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 17:45:38 juju-e4d256-prod-github-runner-207 kernel: [44512.568415] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 17:45:38 juju-e4d256-prod-github-runner-207 kernel: [44512.569742] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 17:45:38 juju-e4d256-prod-github-runner-207 kernel: [44512.570848] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 17:45:38 juju-e4d256-prod-github-runner-207 kernel: [44512.572041] Call Trace: Aug 22 17:45:38 juju-e4d256-prod-github-runner-207 kernel: [44512.572955] Aug 22 17:45:38 juju-e4d256-prod-github-runner-207 kernel: [44512.573836] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:45:38 juju-e4d256-prod-github-runner-207 kernel: [44512.574873] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:45:38 juju-e4d256-prod-github-runner-207 kernel: [44512.575889] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:45:38 juju-e4d256-prod-github-runner-207 kernel: [44512.576983] ? show_regs.part.0+0x23/0x29 Aug 22 17:45:38 juju-e4d256-prod-github-runner-207 kernel: [44512.577983] ? show_regs.cold+0x8/0xd Aug 22 17:45:38 juju-e4d256-prod-github-runner-207 kernel: [44512.578964] ? watchdog_timer_fn+0x1be/0x220 Aug 22 17:45:38 juju-e4d256-prod-github-runner-207 kernel: [44512.579969] ? lockup_detector_update_enable+0x60/0x60 Aug 22 17:45:38 juju-e4d256-prod-github-runner-207 kernel: [44512.581029] ? __hrtimer_run_queues+0x107/0x230 Aug 22 17:45:38 juju-e4d256-prod-github-runner-207 kernel: [44512.582059] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 17:45:38 juju-e4d256-prod-github-runner-207 kernel: [44512.583137] ? hrtimer_interrupt+0x101/0x220 Aug 22 17:45:38 juju-e4d256-prod-github-runner-207 kernel: [44512.584187] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 17:45:38 juju-e4d256-prod-github-runner-207 kernel: [44512.585261] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 17:45:38 juju-e4d256-prod-github-runner-207 kernel: [44512.586306] Aug 22 17:45:38 juju-e4d256-prod-github-runner-207 kernel: [44512.587176] Aug 22 17:45:38 juju-e4d256-prod-github-runner-207 kernel: [44512.588138] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 17:45:38 juju-e4d256-prod-github-runner-207 kernel: [44512.589235] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:45:38 juju-e4d256-prod-github-runner-207 kernel: [44512.590272] ? _raw_spin_lock+0x22/0x30 Aug 22 17:45:38 juju-e4d256-prod-github-runner-207 kernel: [44512.591230] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:45:38 juju-e4d256-prod-github-runner-207 kernel: [44512.592250] direct_page_fault+0x206/0x310 [kvm] Aug 22 17:45:38 juju-e4d256-prod-github-runner-207 kernel: [44512.593275] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 17:45:38 juju-e4d256-prod-github-runner-207 kernel: [44512.594283] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 17:45:38 juju-e4d256-prod-github-runner-207 kernel: [44512.595302] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 17:45:38 juju-e4d256-prod-github-runner-207 kernel: [44512.596269] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 17:45:38 juju-e4d256-prod-github-runner-207 kernel: [44512.597213] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 17:45:38 juju-e4d256-prod-github-runner-207 kernel: [44512.598194] handle_exit+0x98/0x230 [kvm_amd] Aug 22 17:45:38 juju-e4d256-prod-github-runner-207 kernel: [44512.599091] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 17:45:38 juju-e4d256-prod-github-runner-207 kernel: [44512.600002] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 17:45:38 juju-e4d256-prod-github-runner-207 kernel: [44512.600929] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 17:45:38 juju-e4d256-prod-github-runner-207 kernel: [44512.601833] vcpu_run+0x62/0x2c0 [kvm] Aug 22 17:45:38 juju-e4d256-prod-github-runner-207 kernel: [44512.602650] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 17:45:38 juju-e4d256-prod-github-runner-207 kernel: [44512.603462] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 17:45:38 juju-e4d256-prod-github-runner-207 kernel: [44512.604314] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 17:45:38 juju-e4d256-prod-github-runner-207 kernel: [44512.605114] ? __seccomp_filter+0x4a/0x4a0 Aug 22 17:45:38 juju-e4d256-prod-github-runner-207 kernel: [44512.605855] ? __fget_files+0x86/0xc0 Aug 22 17:45:38 juju-e4d256-prod-github-runner-207 kernel: [44512.606572] __x64_sys_ioctl+0x95/0xd0 Aug 22 17:45:38 juju-e4d256-prod-github-runner-207 kernel: [44512.607264] do_syscall_64+0x5c/0xc0 Aug 22 17:45:38 juju-e4d256-prod-github-runner-207 kernel: [44512.607927] ? do_futex+0x162/0x1f0 Aug 22 17:45:38 juju-e4d256-prod-github-runner-207 kernel: [44512.608575] ? __x64_sys_futex+0x78/0x1e0 Aug 22 17:45:38 juju-e4d256-prod-github-runner-207 kernel: [44512.609246] ? __secure_computing+0xa9/0x120 Aug 22 17:45:38 juju-e4d256-prod-github-runner-207 kernel: [44512.609933] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 17:45:38 juju-e4d256-prod-github-runner-207 kernel: [44512.610699] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:45:38 juju-e4d256-prod-github-runner-207 kernel: [44512.611420] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:45:38 juju-e4d256-prod-github-runner-207 kernel: [44512.612136] ? do_syscall_64+0x69/0xc0 Aug 22 17:45:38 juju-e4d256-prod-github-runner-207 kernel: [44512.612779] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:45:38 juju-e4d256-prod-github-runner-207 kernel: [44512.613486] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:45:38 juju-e4d256-prod-github-runner-207 kernel: [44512.614179] ? do_syscall_64+0x69/0xc0 Aug 22 17:45:38 juju-e4d256-prod-github-runner-207 kernel: [44512.614810] ? do_syscall_64+0x69/0xc0 Aug 22 17:45:38 juju-e4d256-prod-github-runner-207 kernel: [44512.615429] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 17:45:38 juju-e4d256-prod-github-runner-207 kernel: [44512.616130] RIP: 0033:0x7faa5d0edaff Aug 22 17:45:38 juju-e4d256-prod-github-runner-207 kernel: [44512.616757] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 17:45:38 juju-e4d256-prod-github-runner-207 kernel: [44512.618745] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 17:45:38 juju-e4d256-prod-github-runner-207 kernel: [44512.619653] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 17:45:38 juju-e4d256-prod-github-runner-207 kernel: [44512.620540] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 17:45:38 juju-e4d256-prod-github-runner-207 kernel: [44512.621428] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 17:45:38 juju-e4d256-prod-github-runner-207 kernel: [44512.622316] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 17:45:38 juju-e4d256-prod-github-runner-207 kernel: [44512.623215] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 17:45:38 juju-e4d256-prod-github-runner-207 kernel: [44512.624105] Aug 22 17:46:06 juju-e4d256-prod-github-runner-207 kernel: [44540.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 41373s! [qemu-system-x86:6715] Aug 22 17:46:06 juju-e4d256-prod-github-runner-207 kernel: [44540.543110] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 17:46:06 juju-e4d256-prod-github-runner-207 kernel: [44540.543178] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 17:46:06 juju-e4d256-prod-github-runner-207 kernel: [44540.555285] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 17:46:06 juju-e4d256-prod-github-runner-207 kernel: [44540.556556] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 17:46:06 juju-e4d256-prod-github-runner-207 kernel: [44540.557781] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:46:06 juju-e4d256-prod-github-runner-207 kernel: [44540.558855] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 17:46:06 juju-e4d256-prod-github-runner-207 kernel: [44540.561400] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 17:46:06 juju-e4d256-prod-github-runner-207 kernel: [44540.562456] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 17:46:06 juju-e4d256-prod-github-runner-207 kernel: [44540.563619] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 17:46:06 juju-e4d256-prod-github-runner-207 kernel: [44540.564779] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 17:46:06 juju-e4d256-prod-github-runner-207 kernel: [44540.565941] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 17:46:06 juju-e4d256-prod-github-runner-207 kernel: [44540.567111] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 17:46:06 juju-e4d256-prod-github-runner-207 kernel: [44540.568282] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 17:46:06 juju-e4d256-prod-github-runner-207 kernel: [44540.569579] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 17:46:06 juju-e4d256-prod-github-runner-207 kernel: [44540.570718] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 17:46:06 juju-e4d256-prod-github-runner-207 kernel: [44540.571921] Call Trace: Aug 22 17:46:06 juju-e4d256-prod-github-runner-207 kernel: [44540.572833] Aug 22 17:46:06 juju-e4d256-prod-github-runner-207 kernel: [44540.573726] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:46:06 juju-e4d256-prod-github-runner-207 kernel: [44540.574793] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:46:06 juju-e4d256-prod-github-runner-207 kernel: [44540.575816] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:46:06 juju-e4d256-prod-github-runner-207 kernel: [44540.576899] ? show_regs.part.0+0x23/0x29 Aug 22 17:46:06 juju-e4d256-prod-github-runner-207 kernel: [44540.577897] ? show_regs.cold+0x8/0xd Aug 22 17:46:06 juju-e4d256-prod-github-runner-207 kernel: [44540.578924] ? watchdog_timer_fn+0x1be/0x220 Aug 22 17:46:06 juju-e4d256-prod-github-runner-207 kernel: [44540.579966] ? lockup_detector_update_enable+0x60/0x60 Aug 22 17:46:06 juju-e4d256-prod-github-runner-207 kernel: [44540.581037] ? __hrtimer_run_queues+0x107/0x230 Aug 22 17:46:06 juju-e4d256-prod-github-runner-207 kernel: [44540.582088] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 17:46:06 juju-e4d256-prod-github-runner-207 kernel: [44540.583112] ? hrtimer_interrupt+0x101/0x220 Aug 22 17:46:06 juju-e4d256-prod-github-runner-207 kernel: [44540.584141] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 17:46:06 juju-e4d256-prod-github-runner-207 kernel: [44540.585220] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 17:46:06 juju-e4d256-prod-github-runner-207 kernel: [44540.586281] Aug 22 17:46:06 juju-e4d256-prod-github-runner-207 kernel: [44540.587134] Aug 22 17:46:06 juju-e4d256-prod-github-runner-207 kernel: [44540.588008] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 17:46:06 juju-e4d256-prod-github-runner-207 kernel: [44540.589051] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:46:06 juju-e4d256-prod-github-runner-207 kernel: [44540.590146] ? _raw_spin_lock+0x22/0x30 Aug 22 17:46:06 juju-e4d256-prod-github-runner-207 kernel: [44540.591097] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:46:06 juju-e4d256-prod-github-runner-207 kernel: [44540.592117] direct_page_fault+0x206/0x310 [kvm] Aug 22 17:46:06 juju-e4d256-prod-github-runner-207 kernel: [44540.593147] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 17:46:06 juju-e4d256-prod-github-runner-207 kernel: [44540.594189] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 17:46:06 juju-e4d256-prod-github-runner-207 kernel: [44540.595208] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 17:46:06 juju-e4d256-prod-github-runner-207 kernel: [44540.596186] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 17:46:06 juju-e4d256-prod-github-runner-207 kernel: [44540.597133] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 17:46:06 juju-e4d256-prod-github-runner-207 kernel: [44540.598125] handle_exit+0x98/0x230 [kvm_amd] Aug 22 17:46:06 juju-e4d256-prod-github-runner-207 kernel: [44540.599033] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 17:46:06 juju-e4d256-prod-github-runner-207 kernel: [44540.599985] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 17:46:06 juju-e4d256-prod-github-runner-207 kernel: [44540.600915] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 17:46:06 juju-e4d256-prod-github-runner-207 kernel: [44540.601822] vcpu_run+0x62/0x2c0 [kvm] Aug 22 17:46:06 juju-e4d256-prod-github-runner-207 kernel: [44540.602658] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 17:46:06 juju-e4d256-prod-github-runner-207 kernel: [44540.603484] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 17:46:06 juju-e4d256-prod-github-runner-207 kernel: [44540.604354] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 17:46:06 juju-e4d256-prod-github-runner-207 kernel: [44540.605167] ? __seccomp_filter+0x4a/0x4a0 Aug 22 17:46:06 juju-e4d256-prod-github-runner-207 kernel: [44540.605914] ? __fget_files+0x86/0xc0 Aug 22 17:46:06 juju-e4d256-prod-github-runner-207 kernel: [44540.606640] __x64_sys_ioctl+0x95/0xd0 Aug 22 17:46:06 juju-e4d256-prod-github-runner-207 kernel: [44540.607335] do_syscall_64+0x5c/0xc0 Aug 22 17:46:06 juju-e4d256-prod-github-runner-207 kernel: [44540.608000] ? do_futex+0x162/0x1f0 Aug 22 17:46:06 juju-e4d256-prod-github-runner-207 kernel: [44540.608649] ? __x64_sys_futex+0x78/0x1e0 Aug 22 17:46:06 juju-e4d256-prod-github-runner-207 kernel: [44540.609335] ? __secure_computing+0xa9/0x120 Aug 22 17:46:06 juju-e4d256-prod-github-runner-207 kernel: [44540.610056] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 17:46:06 juju-e4d256-prod-github-runner-207 kernel: [44540.610835] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:46:06 juju-e4d256-prod-github-runner-207 kernel: [44540.611559] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:46:06 juju-e4d256-prod-github-runner-207 kernel: [44540.612283] ? do_syscall_64+0x69/0xc0 Aug 22 17:46:06 juju-e4d256-prod-github-runner-207 kernel: [44540.612932] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:46:06 juju-e4d256-prod-github-runner-207 kernel: [44540.613636] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:46:06 juju-e4d256-prod-github-runner-207 kernel: [44540.614360] ? do_syscall_64+0x69/0xc0 Aug 22 17:46:06 juju-e4d256-prod-github-runner-207 kernel: [44540.614993] ? do_syscall_64+0x69/0xc0 Aug 22 17:46:06 juju-e4d256-prod-github-runner-207 kernel: [44540.615627] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 17:46:06 juju-e4d256-prod-github-runner-207 kernel: [44540.616334] RIP: 0033:0x7faa5d0edaff Aug 22 17:46:06 juju-e4d256-prod-github-runner-207 kernel: [44540.616961] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 17:46:06 juju-e4d256-prod-github-runner-207 kernel: [44540.618970] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 17:46:06 juju-e4d256-prod-github-runner-207 kernel: [44540.619891] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 17:46:06 juju-e4d256-prod-github-runner-207 kernel: [44540.620810] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 17:46:06 juju-e4d256-prod-github-runner-207 kernel: [44540.621711] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 17:46:06 juju-e4d256-prod-github-runner-207 kernel: [44540.622624] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 17:46:06 juju-e4d256-prod-github-runner-207 kernel: [44540.623524] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 17:46:06 juju-e4d256-prod-github-runner-207 kernel: [44540.624420] Aug 22 17:46:34 juju-e4d256-prod-github-runner-207 kernel: [44568.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 41399s! [qemu-system-x86:6715] Aug 22 17:46:34 juju-e4d256-prod-github-runner-207 kernel: [44568.543725] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 17:46:34 juju-e4d256-prod-github-runner-207 kernel: [44568.543983] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 17:46:34 juju-e4d256-prod-github-runner-207 kernel: [44568.556050] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 17:46:34 juju-e4d256-prod-github-runner-207 kernel: [44568.557362] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 17:46:34 juju-e4d256-prod-github-runner-207 kernel: [44568.558600] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:46:34 juju-e4d256-prod-github-runner-207 kernel: [44568.559669] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 17:46:34 juju-e4d256-prod-github-runner-207 kernel: [44568.562235] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 17:46:34 juju-e4d256-prod-github-runner-207 kernel: [44568.563277] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 17:46:34 juju-e4d256-prod-github-runner-207 kernel: [44568.564439] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 17:46:34 juju-e4d256-prod-github-runner-207 kernel: [44568.565611] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 17:46:34 juju-e4d256-prod-github-runner-207 kernel: [44568.566789] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 17:46:34 juju-e4d256-prod-github-runner-207 kernel: [44568.567968] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 17:46:34 juju-e4d256-prod-github-runner-207 kernel: [44568.569145] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 17:46:34 juju-e4d256-prod-github-runner-207 kernel: [44568.570398] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 17:46:34 juju-e4d256-prod-github-runner-207 kernel: [44568.571494] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 17:46:34 juju-e4d256-prod-github-runner-207 kernel: [44568.572685] Call Trace: Aug 22 17:46:34 juju-e4d256-prod-github-runner-207 kernel: [44568.573597] Aug 22 17:46:34 juju-e4d256-prod-github-runner-207 kernel: [44568.574541] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:46:34 juju-e4d256-prod-github-runner-207 kernel: [44568.575580] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:46:34 juju-e4d256-prod-github-runner-207 kernel: [44568.576601] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:46:34 juju-e4d256-prod-github-runner-207 kernel: [44568.577706] ? show_regs.part.0+0x23/0x29 Aug 22 17:46:34 juju-e4d256-prod-github-runner-207 kernel: [44568.578707] ? show_regs.cold+0x8/0xd Aug 22 17:46:34 juju-e4d256-prod-github-runner-207 kernel: [44568.579677] ? watchdog_timer_fn+0x1be/0x220 Aug 22 17:46:34 juju-e4d256-prod-github-runner-207 kernel: [44568.580688] ? lockup_detector_update_enable+0x60/0x60 Aug 22 17:46:34 juju-e4d256-prod-github-runner-207 kernel: [44568.581766] ? __hrtimer_run_queues+0x107/0x230 Aug 22 17:46:34 juju-e4d256-prod-github-runner-207 kernel: [44568.582798] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 17:46:34 juju-e4d256-prod-github-runner-207 kernel: [44568.583826] ? hrtimer_interrupt+0x101/0x220 Aug 22 17:46:34 juju-e4d256-prod-github-runner-207 kernel: [44568.584841] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 17:46:34 juju-e4d256-prod-github-runner-207 kernel: [44568.585920] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 17:46:34 juju-e4d256-prod-github-runner-207 kernel: [44568.586965] Aug 22 17:46:34 juju-e4d256-prod-github-runner-207 kernel: [44568.587817] Aug 22 17:46:34 juju-e4d256-prod-github-runner-207 kernel: [44568.588658] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 17:46:34 juju-e4d256-prod-github-runner-207 kernel: [44568.589706] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:46:34 juju-e4d256-prod-github-runner-207 kernel: [44568.590743] ? _raw_spin_lock+0x22/0x30 Aug 22 17:46:34 juju-e4d256-prod-github-runner-207 kernel: [44568.591693] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:46:34 juju-e4d256-prod-github-runner-207 kernel: [44568.592709] direct_page_fault+0x206/0x310 [kvm] Aug 22 17:46:34 juju-e4d256-prod-github-runner-207 kernel: [44568.593746] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 17:46:34 juju-e4d256-prod-github-runner-207 kernel: [44568.594774] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 17:46:34 juju-e4d256-prod-github-runner-207 kernel: [44568.595799] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 17:46:34 juju-e4d256-prod-github-runner-207 kernel: [44568.596804] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 17:46:34 juju-e4d256-prod-github-runner-207 kernel: [44568.597772] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 17:46:34 juju-e4d256-prod-github-runner-207 kernel: [44568.598749] handle_exit+0x98/0x230 [kvm_amd] Aug 22 17:46:34 juju-e4d256-prod-github-runner-207 kernel: [44568.599641] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 17:46:34 juju-e4d256-prod-github-runner-207 kernel: [44568.600554] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 17:46:34 juju-e4d256-prod-github-runner-207 kernel: [44568.601528] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 17:46:34 juju-e4d256-prod-github-runner-207 kernel: [44568.602456] vcpu_run+0x62/0x2c0 [kvm] Aug 22 17:46:34 juju-e4d256-prod-github-runner-207 kernel: [44568.603270] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 17:46:34 juju-e4d256-prod-github-runner-207 kernel: [44568.604090] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 17:46:34 juju-e4d256-prod-github-runner-207 kernel: [44568.604944] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 17:46:34 juju-e4d256-prod-github-runner-207 kernel: [44568.605765] ? __seccomp_filter+0x4a/0x4a0 Aug 22 17:46:34 juju-e4d256-prod-github-runner-207 kernel: [44568.606509] ? __fget_files+0x86/0xc0 Aug 22 17:46:34 juju-e4d256-prod-github-runner-207 kernel: [44568.607213] __x64_sys_ioctl+0x95/0xd0 Aug 22 17:46:34 juju-e4d256-prod-github-runner-207 kernel: [44568.607907] do_syscall_64+0x5c/0xc0 Aug 22 17:46:34 juju-e4d256-prod-github-runner-207 kernel: [44568.608571] ? do_futex+0x162/0x1f0 Aug 22 17:46:34 juju-e4d256-prod-github-runner-207 kernel: [44568.609222] ? __x64_sys_futex+0x78/0x1e0 Aug 22 17:46:34 juju-e4d256-prod-github-runner-207 kernel: [44568.609911] ? __secure_computing+0xa9/0x120 Aug 22 17:46:34 juju-e4d256-prod-github-runner-207 kernel: [44568.610614] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 17:46:34 juju-e4d256-prod-github-runner-207 kernel: [44568.611383] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:46:34 juju-e4d256-prod-github-runner-207 kernel: [44568.612107] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:46:34 juju-e4d256-prod-github-runner-207 kernel: [44568.612826] ? do_syscall_64+0x69/0xc0 Aug 22 17:46:34 juju-e4d256-prod-github-runner-207 kernel: [44568.613472] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:46:34 juju-e4d256-prod-github-runner-207 kernel: [44568.614202] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:46:34 juju-e4d256-prod-github-runner-207 kernel: [44568.614895] ? do_syscall_64+0x69/0xc0 Aug 22 17:46:34 juju-e4d256-prod-github-runner-207 kernel: [44568.615518] ? do_syscall_64+0x69/0xc0 Aug 22 17:46:34 juju-e4d256-prod-github-runner-207 kernel: [44568.616145] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 17:46:34 juju-e4d256-prod-github-runner-207 kernel: [44568.616850] RIP: 0033:0x7faa5d0edaff Aug 22 17:46:34 juju-e4d256-prod-github-runner-207 kernel: [44568.617508] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 17:46:34 juju-e4d256-prod-github-runner-207 kernel: [44568.619507] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 17:46:34 juju-e4d256-prod-github-runner-207 kernel: [44568.620422] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 17:46:34 juju-e4d256-prod-github-runner-207 kernel: [44568.621318] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 17:46:34 juju-e4d256-prod-github-runner-207 kernel: [44568.622237] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 17:46:34 juju-e4d256-prod-github-runner-207 kernel: [44568.623123] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 17:46:34 juju-e4d256-prod-github-runner-207 kernel: [44568.624023] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 17:46:34 juju-e4d256-prod-github-runner-207 kernel: [44568.624943] Aug 22 17:47:02 juju-e4d256-prod-github-runner-207 kernel: [44596.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 41425s! [qemu-system-x86:6715] Aug 22 17:47:02 juju-e4d256-prod-github-runner-207 kernel: [44596.543097] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 17:47:02 juju-e4d256-prod-github-runner-207 kernel: [44596.543164] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 17:47:02 juju-e4d256-prod-github-runner-207 kernel: [44596.556034] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 17:47:02 juju-e4d256-prod-github-runner-207 kernel: [44596.557348] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 17:47:02 juju-e4d256-prod-github-runner-207 kernel: [44596.558612] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:47:02 juju-e4d256-prod-github-runner-207 kernel: [44596.559668] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 17:47:02 juju-e4d256-prod-github-runner-207 kernel: [44596.562306] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 17:47:02 juju-e4d256-prod-github-runner-207 kernel: [44596.563403] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 17:47:02 juju-e4d256-prod-github-runner-207 kernel: [44596.564702] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 17:47:02 juju-e4d256-prod-github-runner-207 kernel: [44596.565994] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 17:47:02 juju-e4d256-prod-github-runner-207 kernel: [44596.567205] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 17:47:02 juju-e4d256-prod-github-runner-207 kernel: [44596.568458] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 17:47:02 juju-e4d256-prod-github-runner-207 kernel: [44596.569815] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 17:47:02 juju-e4d256-prod-github-runner-207 kernel: [44596.571134] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 17:47:02 juju-e4d256-prod-github-runner-207 kernel: [44596.572280] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 17:47:02 juju-e4d256-prod-github-runner-207 kernel: [44596.573602] Call Trace: Aug 22 17:47:02 juju-e4d256-prod-github-runner-207 kernel: [44596.574559] Aug 22 17:47:02 juju-e4d256-prod-github-runner-207 kernel: [44596.575547] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:47:02 juju-e4d256-prod-github-runner-207 kernel: [44596.576617] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:47:02 juju-e4d256-prod-github-runner-207 kernel: [44596.577689] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:47:02 juju-e4d256-prod-github-runner-207 kernel: [44596.578865] ? show_regs.part.0+0x23/0x29 Aug 22 17:47:02 juju-e4d256-prod-github-runner-207 kernel: [44596.579934] ? show_regs.cold+0x8/0xd Aug 22 17:47:02 juju-e4d256-prod-github-runner-207 kernel: [44596.580932] ? watchdog_timer_fn+0x1be/0x220 Aug 22 17:47:02 juju-e4d256-prod-github-runner-207 kernel: [44596.581989] ? lockup_detector_update_enable+0x60/0x60 Aug 22 17:47:02 juju-e4d256-prod-github-runner-207 kernel: [44596.583160] ? __hrtimer_run_queues+0x107/0x230 Aug 22 17:47:02 juju-e4d256-prod-github-runner-207 kernel: [44596.584287] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 17:47:02 juju-e4d256-prod-github-runner-207 kernel: [44596.585399] ? hrtimer_interrupt+0x101/0x220 Aug 22 17:47:02 juju-e4d256-prod-github-runner-207 kernel: [44596.586485] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 17:47:02 juju-e4d256-prod-github-runner-207 kernel: [44596.587639] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 17:47:02 juju-e4d256-prod-github-runner-207 kernel: [44596.588750] Aug 22 17:47:02 juju-e4d256-prod-github-runner-207 kernel: [44596.589784] Aug 22 17:47:02 juju-e4d256-prod-github-runner-207 kernel: [44596.590744] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 17:47:02 juju-e4d256-prod-github-runner-207 kernel: [44596.591831] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:47:02 juju-e4d256-prod-github-runner-207 kernel: [44596.592876] ? _raw_spin_lock+0x22/0x30 Aug 22 17:47:02 juju-e4d256-prod-github-runner-207 kernel: [44596.593899] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:47:02 juju-e4d256-prod-github-runner-207 kernel: [44596.594967] direct_page_fault+0x206/0x310 [kvm] Aug 22 17:47:02 juju-e4d256-prod-github-runner-207 kernel: [44596.596057] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 17:47:02 juju-e4d256-prod-github-runner-207 kernel: [44596.597131] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 17:47:02 juju-e4d256-prod-github-runner-207 kernel: [44596.598226] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 17:47:02 juju-e4d256-prod-github-runner-207 kernel: [44596.599240] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 17:47:02 juju-e4d256-prod-github-runner-207 kernel: [44596.600257] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 17:47:02 juju-e4d256-prod-github-runner-207 kernel: [44596.601287] handle_exit+0x98/0x230 [kvm_amd] Aug 22 17:47:02 juju-e4d256-prod-github-runner-207 kernel: [44596.602222] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 17:47:02 juju-e4d256-prod-github-runner-207 kernel: [44596.603171] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 17:47:02 juju-e4d256-prod-github-runner-207 kernel: [44596.604136] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 17:47:02 juju-e4d256-prod-github-runner-207 kernel: [44596.605095] vcpu_run+0x62/0x2c0 [kvm] Aug 22 17:47:02 juju-e4d256-prod-github-runner-207 kernel: [44596.605964] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 17:47:02 juju-e4d256-prod-github-runner-207 kernel: [44596.606813] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 17:47:02 juju-e4d256-prod-github-runner-207 kernel: [44596.607728] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 17:47:02 juju-e4d256-prod-github-runner-207 kernel: [44596.608557] ? __seccomp_filter+0x4a/0x4a0 Aug 22 17:47:02 juju-e4d256-prod-github-runner-207 kernel: [44596.609348] ? __fget_files+0x86/0xc0 Aug 22 17:47:02 juju-e4d256-prod-github-runner-207 kernel: [44596.610111] __x64_sys_ioctl+0x95/0xd0 Aug 22 17:47:02 juju-e4d256-prod-github-runner-207 kernel: [44596.610874] do_syscall_64+0x5c/0xc0 Aug 22 17:47:02 juju-e4d256-prod-github-runner-207 kernel: [44596.611579] ? do_futex+0x162/0x1f0 Aug 22 17:47:02 juju-e4d256-prod-github-runner-207 kernel: [44596.612230] ? __x64_sys_futex+0x78/0x1e0 Aug 22 17:47:02 juju-e4d256-prod-github-runner-207 kernel: [44596.612906] ? __secure_computing+0xa9/0x120 Aug 22 17:47:02 juju-e4d256-prod-github-runner-207 kernel: [44596.613613] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 17:47:02 juju-e4d256-prod-github-runner-207 kernel: [44596.614448] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:47:02 juju-e4d256-prod-github-runner-207 kernel: [44596.615219] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:47:02 juju-e4d256-prod-github-runner-207 kernel: [44596.615987] ? do_syscall_64+0x69/0xc0 Aug 22 17:47:02 juju-e4d256-prod-github-runner-207 kernel: [44596.616677] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:47:02 juju-e4d256-prod-github-runner-207 kernel: [44596.617458] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:47:02 juju-e4d256-prod-github-runner-207 kernel: [44596.618195] ? do_syscall_64+0x69/0xc0 Aug 22 17:47:02 juju-e4d256-prod-github-runner-207 kernel: [44596.618877] ? do_syscall_64+0x69/0xc0 Aug 22 17:47:02 juju-e4d256-prod-github-runner-207 kernel: [44596.619502] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 17:47:02 juju-e4d256-prod-github-runner-207 kernel: [44596.620211] RIP: 0033:0x7faa5d0edaff Aug 22 17:47:02 juju-e4d256-prod-github-runner-207 kernel: [44596.620903] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 17:47:02 juju-e4d256-prod-github-runner-207 kernel: [44596.623056] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 17:47:02 juju-e4d256-prod-github-runner-207 kernel: [44596.624010] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 17:47:02 juju-e4d256-prod-github-runner-207 kernel: [44596.625012] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 17:47:02 juju-e4d256-prod-github-runner-207 kernel: [44596.625925] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 17:47:02 juju-e4d256-prod-github-runner-207 kernel: [44596.626859] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 17:47:02 juju-e4d256-prod-github-runner-207 kernel: [44596.627839] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 17:47:02 juju-e4d256-prod-github-runner-207 kernel: [44596.628774] Aug 22 17:47:30 juju-e4d256-prod-github-runner-207 kernel: [44624.541976] watchdog: BUG: soft lockup - CPU#1 stuck for 41451s! [qemu-system-x86:6715] Aug 22 17:47:30 juju-e4d256-prod-github-runner-207 kernel: [44624.543104] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 17:47:30 juju-e4d256-prod-github-runner-207 kernel: [44624.543169] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 17:47:30 juju-e4d256-prod-github-runner-207 kernel: [44624.555200] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 17:47:30 juju-e4d256-prod-github-runner-207 kernel: [44624.556463] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 17:47:30 juju-e4d256-prod-github-runner-207 kernel: [44624.557693] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:47:30 juju-e4d256-prod-github-runner-207 kernel: [44624.558747] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 17:47:30 juju-e4d256-prod-github-runner-207 kernel: [44624.561292] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 17:47:30 juju-e4d256-prod-github-runner-207 kernel: [44624.562334] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 17:47:30 juju-e4d256-prod-github-runner-207 kernel: [44624.563494] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 17:47:30 juju-e4d256-prod-github-runner-207 kernel: [44624.564651] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 17:47:30 juju-e4d256-prod-github-runner-207 kernel: [44624.565821] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 17:47:30 juju-e4d256-prod-github-runner-207 kernel: [44624.566985] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 17:47:30 juju-e4d256-prod-github-runner-207 kernel: [44624.568154] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 17:47:30 juju-e4d256-prod-github-runner-207 kernel: [44624.569396] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 17:47:30 juju-e4d256-prod-github-runner-207 kernel: [44624.570496] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 17:47:30 juju-e4d256-prod-github-runner-207 kernel: [44624.571690] Call Trace: Aug 22 17:47:30 juju-e4d256-prod-github-runner-207 kernel: [44624.572700] Aug 22 17:47:30 juju-e4d256-prod-github-runner-207 kernel: [44624.573647] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:47:30 juju-e4d256-prod-github-runner-207 kernel: [44624.574678] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:47:30 juju-e4d256-prod-github-runner-207 kernel: [44624.575700] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:47:30 juju-e4d256-prod-github-runner-207 kernel: [44624.576773] ? show_regs.part.0+0x23/0x29 Aug 22 17:47:30 juju-e4d256-prod-github-runner-207 kernel: [44624.577781] ? show_regs.cold+0x8/0xd Aug 22 17:47:30 juju-e4d256-prod-github-runner-207 kernel: [44624.578749] ? watchdog_timer_fn+0x1be/0x220 Aug 22 17:47:30 juju-e4d256-prod-github-runner-207 kernel: [44624.579754] ? lockup_detector_update_enable+0x60/0x60 Aug 22 17:47:30 juju-e4d256-prod-github-runner-207 kernel: [44624.580817] ? __hrtimer_run_queues+0x107/0x230 Aug 22 17:47:30 juju-e4d256-prod-github-runner-207 kernel: [44624.581858] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 17:47:30 juju-e4d256-prod-github-runner-207 kernel: [44624.582885] ? hrtimer_interrupt+0x101/0x220 Aug 22 17:47:30 juju-e4d256-prod-github-runner-207 kernel: [44624.583899] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 17:47:30 juju-e4d256-prod-github-runner-207 kernel: [44624.584964] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 17:47:30 juju-e4d256-prod-github-runner-207 kernel: [44624.586015] Aug 22 17:47:30 juju-e4d256-prod-github-runner-207 kernel: [44624.586868] Aug 22 17:47:30 juju-e4d256-prod-github-runner-207 kernel: [44624.587701] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 17:47:30 juju-e4d256-prod-github-runner-207 kernel: [44624.588729] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:47:30 juju-e4d256-prod-github-runner-207 kernel: [44624.589770] ? _raw_spin_lock+0x22/0x30 Aug 22 17:47:30 juju-e4d256-prod-github-runner-207 kernel: [44624.590712] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:47:30 juju-e4d256-prod-github-runner-207 kernel: [44624.591729] direct_page_fault+0x206/0x310 [kvm] Aug 22 17:47:30 juju-e4d256-prod-github-runner-207 kernel: [44624.592750] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 17:47:30 juju-e4d256-prod-github-runner-207 kernel: [44624.593764] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 17:47:30 juju-e4d256-prod-github-runner-207 kernel: [44624.594764] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 17:47:30 juju-e4d256-prod-github-runner-207 kernel: [44624.595731] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 17:47:30 juju-e4d256-prod-github-runner-207 kernel: [44624.596677] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 17:47:30 juju-e4d256-prod-github-runner-207 kernel: [44624.597661] handle_exit+0x98/0x230 [kvm_amd] Aug 22 17:47:30 juju-e4d256-prod-github-runner-207 kernel: [44624.598554] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 17:47:30 juju-e4d256-prod-github-runner-207 kernel: [44624.599464] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 17:47:30 juju-e4d256-prod-github-runner-207 kernel: [44624.600383] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 17:47:30 juju-e4d256-prod-github-runner-207 kernel: [44624.601298] vcpu_run+0x62/0x2c0 [kvm] Aug 22 17:47:30 juju-e4d256-prod-github-runner-207 kernel: [44624.602108] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 17:47:30 juju-e4d256-prod-github-runner-207 kernel: [44624.602912] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 17:47:30 juju-e4d256-prod-github-runner-207 kernel: [44624.603762] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 17:47:30 juju-e4d256-prod-github-runner-207 kernel: [44624.604556] ? __seccomp_filter+0x4a/0x4a0 Aug 22 17:47:30 juju-e4d256-prod-github-runner-207 kernel: [44624.605312] ? __fget_files+0x86/0xc0 Aug 22 17:47:30 juju-e4d256-prod-github-runner-207 kernel: [44624.606013] __x64_sys_ioctl+0x95/0xd0 Aug 22 17:47:30 juju-e4d256-prod-github-runner-207 kernel: [44624.606703] do_syscall_64+0x5c/0xc0 Aug 22 17:47:30 juju-e4d256-prod-github-runner-207 kernel: [44624.607366] ? do_futex+0x162/0x1f0 Aug 22 17:47:30 juju-e4d256-prod-github-runner-207 kernel: [44624.608014] ? __x64_sys_futex+0x78/0x1e0 Aug 22 17:47:30 juju-e4d256-prod-github-runner-207 kernel: [44624.608689] ? __secure_computing+0xa9/0x120 Aug 22 17:47:30 juju-e4d256-prod-github-runner-207 kernel: [44624.609576] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 17:47:30 juju-e4d256-prod-github-runner-207 kernel: [44624.610333] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:47:30 juju-e4d256-prod-github-runner-207 kernel: [44624.611051] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:47:30 juju-e4d256-prod-github-runner-207 kernel: [44624.611771] ? do_syscall_64+0x69/0xc0 Aug 22 17:47:30 juju-e4d256-prod-github-runner-207 kernel: [44624.612414] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:47:30 juju-e4d256-prod-github-runner-207 kernel: [44624.613122] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:47:30 juju-e4d256-prod-github-runner-207 kernel: [44624.613940] ? do_syscall_64+0x69/0xc0 Aug 22 17:47:30 juju-e4d256-prod-github-runner-207 kernel: [44624.614563] ? do_syscall_64+0x69/0xc0 Aug 22 17:47:30 juju-e4d256-prod-github-runner-207 kernel: [44624.615184] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 17:47:30 juju-e4d256-prod-github-runner-207 kernel: [44624.615888] RIP: 0033:0x7faa5d0edaff Aug 22 17:47:30 juju-e4d256-prod-github-runner-207 kernel: [44624.616512] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 17:47:30 juju-e4d256-prod-github-runner-207 kernel: [44624.618502] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 17:47:30 juju-e4d256-prod-github-runner-207 kernel: [44624.619410] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 17:47:30 juju-e4d256-prod-github-runner-207 kernel: [44624.620297] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 17:47:30 juju-e4d256-prod-github-runner-207 kernel: [44624.621191] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 17:47:30 juju-e4d256-prod-github-runner-207 kernel: [44624.622076] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 17:47:30 juju-e4d256-prod-github-runner-207 kernel: [44624.622961] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 17:47:30 juju-e4d256-prod-github-runner-207 kernel: [44624.623854] Aug 22 17:47:46 juju-e4d256-prod-github-runner-207 kernel: [44640.164705] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 17:47:46 juju-e4d256-prod-github-runner-207 kernel: [44640.165676] rcu: 1-....: (11095874 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=5371101 Aug 22 17:47:46 juju-e4d256-prod-github-runner-207 kernel: [44640.166803] (t=11130741 jiffies g=23269 q=44140) Aug 22 17:47:46 juju-e4d256-prod-github-runner-207 kernel: [44640.167595] NMI backtrace for cpu 1 Aug 22 17:47:46 juju-e4d256-prod-github-runner-207 kernel: [44640.168305] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 17:47:46 juju-e4d256-prod-github-runner-207 kernel: [44640.169417] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 17:47:46 juju-e4d256-prod-github-runner-207 kernel: [44640.170474] Call Trace: Aug 22 17:47:46 juju-e4d256-prod-github-runner-207 kernel: [44640.171146] Aug 22 17:47:46 juju-e4d256-prod-github-runner-207 kernel: [44640.171791] show_stack+0x52/0x5c Aug 22 17:47:46 juju-e4d256-prod-github-runner-207 kernel: [44640.172516] dump_stack_lvl+0x4a/0x63 Aug 22 17:47:46 juju-e4d256-prod-github-runner-207 kernel: [44640.173277] dump_stack+0x10/0x16 Aug 22 17:47:46 juju-e4d256-prod-github-runner-207 kernel: [44640.173995] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 17:47:46 juju-e4d256-prod-github-runner-207 kernel: [44640.174775] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 17:47:46 juju-e4d256-prod-github-runner-207 kernel: [44640.175552] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 17:47:46 juju-e4d256-prod-github-runner-207 kernel: [44640.176371] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 17:47:46 juju-e4d256-prod-github-runner-207 kernel: [44640.177201] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 17:47:46 juju-e4d256-prod-github-runner-207 kernel: [44640.178017] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 17:47:46 juju-e4d256-prod-github-runner-207 kernel: [44640.178790] print_cpu_stall.cold+0x2f/0xe2 Aug 22 17:47:46 juju-e4d256-prod-github-runner-207 kernel: [44640.179556] ? timekeeping_update+0xf7/0x150 Aug 22 17:47:46 juju-e4d256-prod-github-runner-207 kernel: [44640.180327] check_cpu_stall+0x109/0x270 Aug 22 17:47:46 juju-e4d256-prod-github-runner-207 kernel: [44640.181088] rcu_sched_clock_irq+0x9a/0x250 Aug 22 17:47:46 juju-e4d256-prod-github-runner-207 kernel: [44640.181857] update_process_times+0x94/0xd0 Aug 22 17:47:46 juju-e4d256-prod-github-runner-207 kernel: [44640.182634] tick_sched_handle+0x29/0x70 Aug 22 17:47:46 juju-e4d256-prod-github-runner-207 kernel: [44640.183394] tick_sched_timer+0x8c/0xc0 Aug 22 17:47:46 juju-e4d256-prod-github-runner-207 kernel: [44640.184132] ? tick_nohz_handler+0xb0/0xb0 Aug 22 17:47:46 juju-e4d256-prod-github-runner-207 kernel: [44640.184895] __hrtimer_run_queues+0x107/0x230 Aug 22 17:47:46 juju-e4d256-prod-github-runner-207 kernel: [44640.185692] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 17:47:46 juju-e4d256-prod-github-runner-207 kernel: [44640.186468] hrtimer_interrupt+0x101/0x220 Aug 22 17:47:46 juju-e4d256-prod-github-runner-207 kernel: [44640.187226] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 17:47:46 juju-e4d256-prod-github-runner-207 kernel: [44640.188036] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 17:47:46 juju-e4d256-prod-github-runner-207 kernel: [44640.188845] Aug 22 17:47:46 juju-e4d256-prod-github-runner-207 kernel: [44640.189479] Aug 22 17:47:46 juju-e4d256-prod-github-runner-207 kernel: [44640.190235] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 17:47:46 juju-e4d256-prod-github-runner-207 kernel: [44640.191052] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:47:46 juju-e4d256-prod-github-runner-207 kernel: [44640.192033] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 17:47:46 juju-e4d256-prod-github-runner-207 kernel: [44640.194244] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 17:47:46 juju-e4d256-prod-github-runner-207 kernel: [44640.195118] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 17:47:46 juju-e4d256-prod-github-runner-207 kernel: [44640.196110] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 17:47:46 juju-e4d256-prod-github-runner-207 kernel: [44640.197091] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 17:47:46 juju-e4d256-prod-github-runner-207 kernel: [44640.198054] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 17:47:46 juju-e4d256-prod-github-runner-207 kernel: [44640.199012] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 17:47:46 juju-e4d256-prod-github-runner-207 kernel: [44640.199967] ? _raw_spin_lock+0x22/0x30 Aug 22 17:47:46 juju-e4d256-prod-github-runner-207 kernel: [44640.200725] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:47:46 juju-e4d256-prod-github-runner-207 kernel: [44640.201570] direct_page_fault+0x206/0x310 [kvm] Aug 22 17:47:46 juju-e4d256-prod-github-runner-207 kernel: [44640.202409] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 17:47:46 juju-e4d256-prod-github-runner-207 kernel: [44640.203238] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 17:47:46 juju-e4d256-prod-github-runner-207 kernel: [44640.204062] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 17:47:46 juju-e4d256-prod-github-runner-207 kernel: [44640.204877] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 17:47:46 juju-e4d256-prod-github-runner-207 kernel: [44640.205663] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 17:47:46 juju-e4d256-prod-github-runner-207 kernel: [44640.206484] handle_exit+0x98/0x230 [kvm_amd] Aug 22 17:47:46 juju-e4d256-prod-github-runner-207 kernel: [44640.207237] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 17:47:46 juju-e4d256-prod-github-runner-207 kernel: [44640.208020] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 17:47:46 juju-e4d256-prod-github-runner-207 kernel: [44640.208827] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 17:47:46 juju-e4d256-prod-github-runner-207 kernel: [44640.209615] vcpu_run+0x62/0x2c0 [kvm] Aug 22 17:47:46 juju-e4d256-prod-github-runner-207 kernel: [44640.210331] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 17:47:46 juju-e4d256-prod-github-runner-207 kernel: [44640.211065] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 17:47:46 juju-e4d256-prod-github-runner-207 kernel: [44640.211867] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 17:47:46 juju-e4d256-prod-github-runner-207 kernel: [44640.212627] ? __seccomp_filter+0x4a/0x4a0 Aug 22 17:47:46 juju-e4d256-prod-github-runner-207 kernel: [44640.213355] ? __fget_files+0x86/0xc0 Aug 22 17:47:46 juju-e4d256-prod-github-runner-207 kernel: [44640.214049] __x64_sys_ioctl+0x95/0xd0 Aug 22 17:47:46 juju-e4d256-prod-github-runner-207 kernel: [44640.214745] do_syscall_64+0x5c/0xc0 Aug 22 17:47:46 juju-e4d256-prod-github-runner-207 kernel: [44640.215428] ? do_futex+0x162/0x1f0 Aug 22 17:47:46 juju-e4d256-prod-github-runner-207 kernel: [44640.216100] ? __x64_sys_futex+0x78/0x1e0 Aug 22 17:47:46 juju-e4d256-prod-github-runner-207 kernel: [44640.216801] ? __secure_computing+0xa9/0x120 Aug 22 17:47:46 juju-e4d256-prod-github-runner-207 kernel: [44640.217524] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 17:47:46 juju-e4d256-prod-github-runner-207 kernel: [44640.218314] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:47:46 juju-e4d256-prod-github-runner-207 kernel: [44640.219068] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:47:46 juju-e4d256-prod-github-runner-207 kernel: [44640.219824] ? do_syscall_64+0x69/0xc0 Aug 22 17:47:46 juju-e4d256-prod-github-runner-207 kernel: [44640.220515] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:47:46 juju-e4d256-prod-github-runner-207 kernel: [44640.221278] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:47:46 juju-e4d256-prod-github-runner-207 kernel: [44640.222036] ? do_syscall_64+0x69/0xc0 Aug 22 17:47:46 juju-e4d256-prod-github-runner-207 kernel: [44640.222729] ? do_syscall_64+0x69/0xc0 Aug 22 17:47:46 juju-e4d256-prod-github-runner-207 kernel: [44640.223416] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 17:47:46 juju-e4d256-prod-github-runner-207 kernel: [44640.224188] RIP: 0033:0x7faa5d0edaff Aug 22 17:47:46 juju-e4d256-prod-github-runner-207 kernel: [44640.224885] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 17:47:46 juju-e4d256-prod-github-runner-207 kernel: [44640.226994] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 17:47:46 juju-e4d256-prod-github-runner-207 kernel: [44640.227957] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 17:47:46 juju-e4d256-prod-github-runner-207 kernel: [44640.228917] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 17:47:46 juju-e4d256-prod-github-runner-207 kernel: [44640.229873] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 17:47:46 juju-e4d256-prod-github-runner-207 kernel: [44640.230814] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 17:47:46 juju-e4d256-prod-github-runner-207 kernel: [44640.231740] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 17:47:46 juju-e4d256-prod-github-runner-207 kernel: [44640.232653] Aug 22 17:48:10 juju-e4d256-prod-github-runner-207 kernel: [44664.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 41489s! [qemu-system-x86:6715] Aug 22 17:48:10 juju-e4d256-prod-github-runner-207 kernel: [44664.543734] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 17:48:10 juju-e4d256-prod-github-runner-207 kernel: [44664.543992] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 17:48:10 juju-e4d256-prod-github-runner-207 kernel: [44664.556269] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 17:48:10 juju-e4d256-prod-github-runner-207 kernel: [44664.557663] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 17:48:10 juju-e4d256-prod-github-runner-207 kernel: [44664.558880] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:48:10 juju-e4d256-prod-github-runner-207 kernel: [44664.559939] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 17:48:10 juju-e4d256-prod-github-runner-207 kernel: [44664.562495] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 17:48:10 juju-e4d256-prod-github-runner-207 kernel: [44664.563537] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 17:48:10 juju-e4d256-prod-github-runner-207 kernel: [44664.564706] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 17:48:10 juju-e4d256-prod-github-runner-207 kernel: [44664.565871] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 17:48:10 juju-e4d256-prod-github-runner-207 kernel: [44664.567030] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 17:48:10 juju-e4d256-prod-github-runner-207 kernel: [44664.568194] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 17:48:10 juju-e4d256-prod-github-runner-207 kernel: [44664.569368] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 17:48:10 juju-e4d256-prod-github-runner-207 kernel: [44664.570601] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 17:48:10 juju-e4d256-prod-github-runner-207 kernel: [44664.571697] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 17:48:10 juju-e4d256-prod-github-runner-207 kernel: [44664.572900] Call Trace: Aug 22 17:48:10 juju-e4d256-prod-github-runner-207 kernel: [44664.573814] Aug 22 17:48:10 juju-e4d256-prod-github-runner-207 kernel: [44664.574697] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:48:10 juju-e4d256-prod-github-runner-207 kernel: [44664.575729] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:48:10 juju-e4d256-prod-github-runner-207 kernel: [44664.576765] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:48:10 juju-e4d256-prod-github-runner-207 kernel: [44664.577855] ? show_regs.part.0+0x23/0x29 Aug 22 17:48:10 juju-e4d256-prod-github-runner-207 kernel: [44664.578851] ? show_regs.cold+0x8/0xd Aug 22 17:48:10 juju-e4d256-prod-github-runner-207 kernel: [44664.579823] ? watchdog_timer_fn+0x1be/0x220 Aug 22 17:48:10 juju-e4d256-prod-github-runner-207 kernel: [44664.580839] ? lockup_detector_update_enable+0x60/0x60 Aug 22 17:48:10 juju-e4d256-prod-github-runner-207 kernel: [44664.581906] ? __hrtimer_run_queues+0x107/0x230 Aug 22 17:48:10 juju-e4d256-prod-github-runner-207 kernel: [44664.582933] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 17:48:10 juju-e4d256-prod-github-runner-207 kernel: [44664.583956] ? hrtimer_interrupt+0x101/0x220 Aug 22 17:48:10 juju-e4d256-prod-github-runner-207 kernel: [44664.584983] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 17:48:10 juju-e4d256-prod-github-runner-207 kernel: [44664.586057] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 17:48:10 juju-e4d256-prod-github-runner-207 kernel: [44664.587102] Aug 22 17:48:10 juju-e4d256-prod-github-runner-207 kernel: [44664.587953] Aug 22 17:48:10 juju-e4d256-prod-github-runner-207 kernel: [44664.588796] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 17:48:10 juju-e4d256-prod-github-runner-207 kernel: [44664.589829] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:48:10 juju-e4d256-prod-github-runner-207 kernel: [44664.590873] ? _raw_spin_lock+0x22/0x30 Aug 22 17:48:10 juju-e4d256-prod-github-runner-207 kernel: [44664.591822] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:48:10 juju-e4d256-prod-github-runner-207 kernel: [44664.592845] direct_page_fault+0x206/0x310 [kvm] Aug 22 17:48:10 juju-e4d256-prod-github-runner-207 kernel: [44664.593869] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 17:48:10 juju-e4d256-prod-github-runner-207 kernel: [44664.594884] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 17:48:10 juju-e4d256-prod-github-runner-207 kernel: [44664.595883] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 17:48:10 juju-e4d256-prod-github-runner-207 kernel: [44664.596879] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 17:48:10 juju-e4d256-prod-github-runner-207 kernel: [44664.597823] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 17:48:10 juju-e4d256-prod-github-runner-207 kernel: [44664.598800] handle_exit+0x98/0x230 [kvm_amd] Aug 22 17:48:10 juju-e4d256-prod-github-runner-207 kernel: [44664.599691] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 17:48:10 juju-e4d256-prod-github-runner-207 kernel: [44664.600621] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 17:48:10 juju-e4d256-prod-github-runner-207 kernel: [44664.601546] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 17:48:10 juju-e4d256-prod-github-runner-207 kernel: [44664.602448] vcpu_run+0x62/0x2c0 [kvm] Aug 22 17:48:10 juju-e4d256-prod-github-runner-207 kernel: [44664.603257] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 17:48:10 juju-e4d256-prod-github-runner-207 kernel: [44664.604064] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 17:48:10 juju-e4d256-prod-github-runner-207 kernel: [44664.604922] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 17:48:10 juju-e4d256-prod-github-runner-207 kernel: [44664.605719] ? __seccomp_filter+0x4a/0x4a0 Aug 22 17:48:10 juju-e4d256-prod-github-runner-207 kernel: [44664.606464] ? __fget_files+0x86/0xc0 Aug 22 17:48:10 juju-e4d256-prod-github-runner-207 kernel: [44664.607172] __x64_sys_ioctl+0x95/0xd0 Aug 22 17:48:10 juju-e4d256-prod-github-runner-207 kernel: [44664.607864] do_syscall_64+0x5c/0xc0 Aug 22 17:48:10 juju-e4d256-prod-github-runner-207 kernel: [44664.608535] ? do_futex+0x162/0x1f0 Aug 22 17:48:10 juju-e4d256-prod-github-runner-207 kernel: [44664.609190] ? __x64_sys_futex+0x78/0x1e0 Aug 22 17:48:10 juju-e4d256-prod-github-runner-207 kernel: [44664.609863] ? __secure_computing+0xa9/0x120 Aug 22 17:48:10 juju-e4d256-prod-github-runner-207 kernel: [44664.610552] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 17:48:10 juju-e4d256-prod-github-runner-207 kernel: [44664.611312] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:48:10 juju-e4d256-prod-github-runner-207 kernel: [44664.612050] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:48:10 juju-e4d256-prod-github-runner-207 kernel: [44664.612781] ? do_syscall_64+0x69/0xc0 Aug 22 17:48:10 juju-e4d256-prod-github-runner-207 kernel: [44664.613425] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:48:10 juju-e4d256-prod-github-runner-207 kernel: [44664.614127] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:48:10 juju-e4d256-prod-github-runner-207 kernel: [44664.614820] ? do_syscall_64+0x69/0xc0 Aug 22 17:48:10 juju-e4d256-prod-github-runner-207 kernel: [44664.615445] ? do_syscall_64+0x69/0xc0 Aug 22 17:48:10 juju-e4d256-prod-github-runner-207 kernel: [44664.616064] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 17:48:10 juju-e4d256-prod-github-runner-207 kernel: [44664.616773] RIP: 0033:0x7faa5d0edaff Aug 22 17:48:10 juju-e4d256-prod-github-runner-207 kernel: [44664.617415] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 17:48:10 juju-e4d256-prod-github-runner-207 kernel: [44664.619393] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 17:48:10 juju-e4d256-prod-github-runner-207 kernel: [44664.620304] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 17:48:10 juju-e4d256-prod-github-runner-207 kernel: [44664.621202] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 17:48:10 juju-e4d256-prod-github-runner-207 kernel: [44664.622091] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 17:48:10 juju-e4d256-prod-github-runner-207 kernel: [44664.622973] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 17:48:10 juju-e4d256-prod-github-runner-207 kernel: [44664.623856] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 17:48:10 juju-e4d256-prod-github-runner-207 kernel: [44664.624752] Aug 22 17:48:38 juju-e4d256-prod-github-runner-207 kernel: [44692.541976] watchdog: BUG: soft lockup - CPU#1 stuck for 41515s! [qemu-system-x86:6715] Aug 22 17:48:38 juju-e4d256-prod-github-runner-207 kernel: [44692.543257] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 17:48:38 juju-e4d256-prod-github-runner-207 kernel: [44692.543508] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 17:48:38 juju-e4d256-prod-github-runner-207 kernel: [44692.555569] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 17:48:38 juju-e4d256-prod-github-runner-207 kernel: [44692.556852] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 17:48:38 juju-e4d256-prod-github-runner-207 kernel: [44692.558079] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:48:38 juju-e4d256-prod-github-runner-207 kernel: [44692.559138] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 17:48:38 juju-e4d256-prod-github-runner-207 kernel: [44692.561703] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 17:48:38 juju-e4d256-prod-github-runner-207 kernel: [44692.562742] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 17:48:38 juju-e4d256-prod-github-runner-207 kernel: [44692.563900] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 17:48:38 juju-e4d256-prod-github-runner-207 kernel: [44692.565068] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 17:48:38 juju-e4d256-prod-github-runner-207 kernel: [44692.566229] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 17:48:38 juju-e4d256-prod-github-runner-207 kernel: [44692.567389] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 17:48:38 juju-e4d256-prod-github-runner-207 kernel: [44692.568575] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 17:48:38 juju-e4d256-prod-github-runner-207 kernel: [44692.569808] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 17:48:38 juju-e4d256-prod-github-runner-207 kernel: [44692.570908] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 17:48:38 juju-e4d256-prod-github-runner-207 kernel: [44692.572097] Call Trace: Aug 22 17:48:38 juju-e4d256-prod-github-runner-207 kernel: [44692.573017] Aug 22 17:48:38 juju-e4d256-prod-github-runner-207 kernel: [44692.573898] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:48:38 juju-e4d256-prod-github-runner-207 kernel: [44692.574926] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:48:38 juju-e4d256-prod-github-runner-207 kernel: [44692.575942] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:48:38 juju-e4d256-prod-github-runner-207 kernel: [44692.577077] ? show_regs.part.0+0x23/0x29 Aug 22 17:48:38 juju-e4d256-prod-github-runner-207 kernel: [44692.578073] ? show_regs.cold+0x8/0xd Aug 22 17:48:38 juju-e4d256-prod-github-runner-207 kernel: [44692.579041] ? watchdog_timer_fn+0x1be/0x220 Aug 22 17:48:38 juju-e4d256-prod-github-runner-207 kernel: [44692.580046] ? lockup_detector_update_enable+0x60/0x60 Aug 22 17:48:38 juju-e4d256-prod-github-runner-207 kernel: [44692.581114] ? __hrtimer_run_queues+0x107/0x230 Aug 22 17:48:38 juju-e4d256-prod-github-runner-207 kernel: [44692.582139] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 17:48:38 juju-e4d256-prod-github-runner-207 kernel: [44692.583159] ? hrtimer_interrupt+0x101/0x220 Aug 22 17:48:38 juju-e4d256-prod-github-runner-207 kernel: [44692.584177] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 17:48:38 juju-e4d256-prod-github-runner-207 kernel: [44692.585248] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 17:48:38 juju-e4d256-prod-github-runner-207 kernel: [44692.586297] Aug 22 17:48:38 juju-e4d256-prod-github-runner-207 kernel: [44692.587148] Aug 22 17:48:38 juju-e4d256-prod-github-runner-207 kernel: [44692.587982] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 17:48:38 juju-e4d256-prod-github-runner-207 kernel: [44692.589032] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:48:38 juju-e4d256-prod-github-runner-207 kernel: [44692.590194] ? _raw_spin_lock+0x22/0x30 Aug 22 17:48:38 juju-e4d256-prod-github-runner-207 kernel: [44692.591209] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:48:38 juju-e4d256-prod-github-runner-207 kernel: [44692.592359] direct_page_fault+0x206/0x310 [kvm] Aug 22 17:48:38 juju-e4d256-prod-github-runner-207 kernel: [44692.593485] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 17:48:38 juju-e4d256-prod-github-runner-207 kernel: [44692.594590] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 17:48:38 juju-e4d256-prod-github-runner-207 kernel: [44692.595676] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 17:48:38 juju-e4d256-prod-github-runner-207 kernel: [44692.596753] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 17:48:38 juju-e4d256-prod-github-runner-207 kernel: [44692.597786] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 17:48:38 juju-e4d256-prod-github-runner-207 kernel: [44692.598875] handle_exit+0x98/0x230 [kvm_amd] Aug 22 17:48:38 juju-e4d256-prod-github-runner-207 kernel: [44692.599853] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 17:48:38 juju-e4d256-prod-github-runner-207 kernel: [44692.600869] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 17:48:38 juju-e4d256-prod-github-runner-207 kernel: [44692.601882] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 17:48:38 juju-e4d256-prod-github-runner-207 kernel: [44692.602878] vcpu_run+0x62/0x2c0 [kvm] Aug 22 17:48:38 juju-e4d256-prod-github-runner-207 kernel: [44692.603762] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 17:48:38 juju-e4d256-prod-github-runner-207 kernel: [44692.604669] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 17:48:38 juju-e4d256-prod-github-runner-207 kernel: [44692.605617] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 17:48:38 juju-e4d256-prod-github-runner-207 kernel: [44692.606504] ? __seccomp_filter+0x4a/0x4a0 Aug 22 17:48:38 juju-e4d256-prod-github-runner-207 kernel: [44692.607323] ? __fget_files+0x86/0xc0 Aug 22 17:48:38 juju-e4d256-prod-github-runner-207 kernel: [44692.608098] __x64_sys_ioctl+0x95/0xd0 Aug 22 17:48:38 juju-e4d256-prod-github-runner-207 kernel: [44692.608887] do_syscall_64+0x5c/0xc0 Aug 22 17:48:38 juju-e4d256-prod-github-runner-207 kernel: [44692.609618] ? do_futex+0x162/0x1f0 Aug 22 17:48:38 juju-e4d256-prod-github-runner-207 kernel: [44692.610331] ? __x64_sys_futex+0x78/0x1e0 Aug 22 17:48:38 juju-e4d256-prod-github-runner-207 kernel: [44692.611080] ? __secure_computing+0xa9/0x120 Aug 22 17:48:38 juju-e4d256-prod-github-runner-207 kernel: [44692.611855] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 17:48:38 juju-e4d256-prod-github-runner-207 kernel: [44692.612719] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:48:38 juju-e4d256-prod-github-runner-207 kernel: [44692.613542] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:48:38 juju-e4d256-prod-github-runner-207 kernel: [44692.614363] ? do_syscall_64+0x69/0xc0 Aug 22 17:48:38 juju-e4d256-prod-github-runner-207 kernel: [44692.615089] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:48:38 juju-e4d256-prod-github-runner-207 kernel: [44692.615884] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:48:38 juju-e4d256-prod-github-runner-207 kernel: [44692.616677] ? do_syscall_64+0x69/0xc0 Aug 22 17:48:38 juju-e4d256-prod-github-runner-207 kernel: [44692.617374] ? do_syscall_64+0x69/0xc0 Aug 22 17:48:38 juju-e4d256-prod-github-runner-207 kernel: [44692.618068] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 17:48:38 juju-e4d256-prod-github-runner-207 kernel: [44692.618866] RIP: 0033:0x7faa5d0edaff Aug 22 17:48:38 juju-e4d256-prod-github-runner-207 kernel: [44692.619565] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 17:48:38 juju-e4d256-prod-github-runner-207 kernel: [44692.621891] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 17:48:38 juju-e4d256-prod-github-runner-207 kernel: [44692.622938] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 17:48:38 juju-e4d256-prod-github-runner-207 kernel: [44692.623993] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 17:48:38 juju-e4d256-prod-github-runner-207 kernel: [44692.625028] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 17:48:38 juju-e4d256-prod-github-runner-207 kernel: [44692.626049] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 17:48:38 juju-e4d256-prod-github-runner-207 kernel: [44692.627070] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 17:48:38 juju-e4d256-prod-github-runner-207 kernel: [44692.628096] Aug 22 17:49:06 juju-e4d256-prod-github-runner-207 kernel: [44720.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 41541s! [qemu-system-x86:6715] Aug 22 17:49:06 juju-e4d256-prod-github-runner-207 kernel: [44720.543090] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 17:49:06 juju-e4d256-prod-github-runner-207 kernel: [44720.543158] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 17:49:06 juju-e4d256-prod-github-runner-207 kernel: [44720.555292] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 17:49:06 juju-e4d256-prod-github-runner-207 kernel: [44720.556580] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 17:49:06 juju-e4d256-prod-github-runner-207 kernel: [44720.557950] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:49:06 juju-e4d256-prod-github-runner-207 kernel: [44720.559008] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 17:49:06 juju-e4d256-prod-github-runner-207 kernel: [44720.561579] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 17:49:06 juju-e4d256-prod-github-runner-207 kernel: [44720.562652] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 17:49:06 juju-e4d256-prod-github-runner-207 kernel: [44720.564052] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 17:49:06 juju-e4d256-prod-github-runner-207 kernel: [44720.565239] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 17:49:06 juju-e4d256-prod-github-runner-207 kernel: [44720.566416] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 17:49:06 juju-e4d256-prod-github-runner-207 kernel: [44720.567579] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 17:49:06 juju-e4d256-prod-github-runner-207 kernel: [44720.568958] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 17:49:06 juju-e4d256-prod-github-runner-207 kernel: [44720.570222] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 17:49:06 juju-e4d256-prod-github-runner-207 kernel: [44720.571324] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 17:49:06 juju-e4d256-prod-github-runner-207 kernel: [44720.572593] Call Trace: Aug 22 17:49:06 juju-e4d256-prod-github-runner-207 kernel: [44720.573517] Aug 22 17:49:06 juju-e4d256-prod-github-runner-207 kernel: [44720.574401] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:49:06 juju-e4d256-prod-github-runner-207 kernel: [44720.575434] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:49:06 juju-e4d256-prod-github-runner-207 kernel: [44720.576475] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:49:06 juju-e4d256-prod-github-runner-207 kernel: [44720.577551] ? show_regs.part.0+0x23/0x29 Aug 22 17:49:06 juju-e4d256-prod-github-runner-207 kernel: [44720.578561] ? show_regs.cold+0x8/0xd Aug 22 17:49:06 juju-e4d256-prod-github-runner-207 kernel: [44720.579533] ? watchdog_timer_fn+0x1be/0x220 Aug 22 17:49:06 juju-e4d256-prod-github-runner-207 kernel: [44720.580569] ? lockup_detector_update_enable+0x60/0x60 Aug 22 17:49:06 juju-e4d256-prod-github-runner-207 kernel: [44720.581653] ? __hrtimer_run_queues+0x107/0x230 Aug 22 17:49:06 juju-e4d256-prod-github-runner-207 kernel: [44720.582682] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 17:49:06 juju-e4d256-prod-github-runner-207 kernel: [44720.583717] ? hrtimer_interrupt+0x101/0x220 Aug 22 17:49:06 juju-e4d256-prod-github-runner-207 kernel: [44720.584750] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 17:49:06 juju-e4d256-prod-github-runner-207 kernel: [44720.585823] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 17:49:06 juju-e4d256-prod-github-runner-207 kernel: [44720.586892] Aug 22 17:49:06 juju-e4d256-prod-github-runner-207 kernel: [44720.587769] Aug 22 17:49:06 juju-e4d256-prod-github-runner-207 kernel: [44720.588642] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 17:49:06 juju-e4d256-prod-github-runner-207 kernel: [44720.589706] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:49:06 juju-e4d256-prod-github-runner-207 kernel: [44720.590759] ? _raw_spin_lock+0x22/0x30 Aug 22 17:49:06 juju-e4d256-prod-github-runner-207 kernel: [44720.591746] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:49:06 juju-e4d256-prod-github-runner-207 kernel: [44720.592833] direct_page_fault+0x206/0x310 [kvm] Aug 22 17:49:06 juju-e4d256-prod-github-runner-207 kernel: [44720.593888] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 17:49:06 juju-e4d256-prod-github-runner-207 kernel: [44720.594928] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 17:49:06 juju-e4d256-prod-github-runner-207 kernel: [44720.595952] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 17:49:06 juju-e4d256-prod-github-runner-207 kernel: [44720.596925] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 17:49:06 juju-e4d256-prod-github-runner-207 kernel: [44720.597872] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 17:49:06 juju-e4d256-prod-github-runner-207 kernel: [44720.598846] handle_exit+0x98/0x230 [kvm_amd] Aug 22 17:49:06 juju-e4d256-prod-github-runner-207 kernel: [44720.599736] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 17:49:06 juju-e4d256-prod-github-runner-207 kernel: [44720.600766] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 17:49:06 juju-e4d256-prod-github-runner-207 kernel: [44720.601705] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 17:49:06 juju-e4d256-prod-github-runner-207 kernel: [44720.602628] vcpu_run+0x62/0x2c0 [kvm] Aug 22 17:49:06 juju-e4d256-prod-github-runner-207 kernel: [44720.603441] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 17:49:06 juju-e4d256-prod-github-runner-207 kernel: [44720.604367] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 17:49:06 juju-e4d256-prod-github-runner-207 kernel: [44720.605358] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 17:49:06 juju-e4d256-prod-github-runner-207 kernel: [44720.606265] ? __seccomp_filter+0x4a/0x4a0 Aug 22 17:49:06 juju-e4d256-prod-github-runner-207 kernel: [44720.607095] ? __fget_files+0x86/0xc0 Aug 22 17:49:06 juju-e4d256-prod-github-runner-207 kernel: [44720.607904] __x64_sys_ioctl+0x95/0xd0 Aug 22 17:49:06 juju-e4d256-prod-github-runner-207 kernel: [44720.608684] do_syscall_64+0x5c/0xc0 Aug 22 17:49:06 juju-e4d256-prod-github-runner-207 kernel: [44720.609420] ? do_futex+0x162/0x1f0 Aug 22 17:49:06 juju-e4d256-prod-github-runner-207 kernel: [44720.610150] ? __x64_sys_futex+0x78/0x1e0 Aug 22 17:49:06 juju-e4d256-prod-github-runner-207 kernel: [44720.610935] ? __secure_computing+0xa9/0x120 Aug 22 17:49:06 juju-e4d256-prod-github-runner-207 kernel: [44720.611710] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 17:49:06 juju-e4d256-prod-github-runner-207 kernel: [44720.612593] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:49:06 juju-e4d256-prod-github-runner-207 kernel: [44720.613421] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:49:06 juju-e4d256-prod-github-runner-207 kernel: [44720.614247] ? do_syscall_64+0x69/0xc0 Aug 22 17:49:06 juju-e4d256-prod-github-runner-207 kernel: [44720.614965] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:49:06 juju-e4d256-prod-github-runner-207 kernel: [44720.615761] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:49:06 juju-e4d256-prod-github-runner-207 kernel: [44720.616576] ? do_syscall_64+0x69/0xc0 Aug 22 17:49:06 juju-e4d256-prod-github-runner-207 kernel: [44720.617275] ? do_syscall_64+0x69/0xc0 Aug 22 17:49:06 juju-e4d256-prod-github-runner-207 kernel: [44720.617969] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 17:49:06 juju-e4d256-prod-github-runner-207 kernel: [44720.618773] RIP: 0033:0x7faa5d0edaff Aug 22 17:49:06 juju-e4d256-prod-github-runner-207 kernel: [44720.619469] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 17:49:06 juju-e4d256-prod-github-runner-207 kernel: [44720.621808] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 17:49:06 juju-e4d256-prod-github-runner-207 kernel: [44720.622875] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 17:49:06 juju-e4d256-prod-github-runner-207 kernel: [44720.623931] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 17:49:06 juju-e4d256-prod-github-runner-207 kernel: [44720.624953] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 17:49:06 juju-e4d256-prod-github-runner-207 kernel: [44720.625979] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 17:49:06 juju-e4d256-prod-github-runner-207 kernel: [44720.627005] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 17:49:06 juju-e4d256-prod-github-runner-207 kernel: [44720.628051] Aug 22 17:49:34 juju-e4d256-prod-github-runner-207 kernel: [44748.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 41567s! [qemu-system-x86:6715] Aug 22 17:49:34 juju-e4d256-prod-github-runner-207 kernel: [44748.543755] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 17:49:34 juju-e4d256-prod-github-runner-207 kernel: [44748.544024] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 17:49:34 juju-e4d256-prod-github-runner-207 kernel: [44748.556053] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 17:49:34 juju-e4d256-prod-github-runner-207 kernel: [44748.557324] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 17:49:34 juju-e4d256-prod-github-runner-207 kernel: [44748.558546] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:49:34 juju-e4d256-prod-github-runner-207 kernel: [44748.559609] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 17:49:34 juju-e4d256-prod-github-runner-207 kernel: [44748.562155] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 17:49:34 juju-e4d256-prod-github-runner-207 kernel: [44748.563202] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 17:49:34 juju-e4d256-prod-github-runner-207 kernel: [44748.564370] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 17:49:34 juju-e4d256-prod-github-runner-207 kernel: [44748.565528] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 17:49:34 juju-e4d256-prod-github-runner-207 kernel: [44748.566686] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 17:49:34 juju-e4d256-prod-github-runner-207 kernel: [44748.567852] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 17:49:34 juju-e4d256-prod-github-runner-207 kernel: [44748.569021] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 17:49:34 juju-e4d256-prod-github-runner-207 kernel: [44748.570252] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 17:49:34 juju-e4d256-prod-github-runner-207 kernel: [44748.571348] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 17:49:34 juju-e4d256-prod-github-runner-207 kernel: [44748.572548] Call Trace: Aug 22 17:49:34 juju-e4d256-prod-github-runner-207 kernel: [44748.573466] Aug 22 17:49:34 juju-e4d256-prod-github-runner-207 kernel: [44748.574357] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:49:34 juju-e4d256-prod-github-runner-207 kernel: [44748.575385] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:49:34 juju-e4d256-prod-github-runner-207 kernel: [44748.576414] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:49:34 juju-e4d256-prod-github-runner-207 kernel: [44748.577500] ? show_regs.part.0+0x23/0x29 Aug 22 17:49:34 juju-e4d256-prod-github-runner-207 kernel: [44748.578495] ? show_regs.cold+0x8/0xd Aug 22 17:49:34 juju-e4d256-prod-github-runner-207 kernel: [44748.579465] ? watchdog_timer_fn+0x1be/0x220 Aug 22 17:49:34 juju-e4d256-prod-github-runner-207 kernel: [44748.580483] ? lockup_detector_update_enable+0x60/0x60 Aug 22 17:49:34 juju-e4d256-prod-github-runner-207 kernel: [44748.581544] ? __hrtimer_run_queues+0x107/0x230 Aug 22 17:49:34 juju-e4d256-prod-github-runner-207 kernel: [44748.582576] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 17:49:34 juju-e4d256-prod-github-runner-207 kernel: [44748.583607] ? hrtimer_interrupt+0x101/0x220 Aug 22 17:49:34 juju-e4d256-prod-github-runner-207 kernel: [44748.584622] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 17:49:34 juju-e4d256-prod-github-runner-207 kernel: [44748.585695] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 17:49:34 juju-e4d256-prod-github-runner-207 kernel: [44748.586740] Aug 22 17:49:34 juju-e4d256-prod-github-runner-207 kernel: [44748.587599] Aug 22 17:49:34 juju-e4d256-prod-github-runner-207 kernel: [44748.588439] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 17:49:34 juju-e4d256-prod-github-runner-207 kernel: [44748.589472] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:49:34 juju-e4d256-prod-github-runner-207 kernel: [44748.590509] ? _raw_spin_lock+0x22/0x30 Aug 22 17:49:34 juju-e4d256-prod-github-runner-207 kernel: [44748.591452] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:49:34 juju-e4d256-prod-github-runner-207 kernel: [44748.592472] direct_page_fault+0x206/0x310 [kvm] Aug 22 17:49:34 juju-e4d256-prod-github-runner-207 kernel: [44748.593494] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 17:49:34 juju-e4d256-prod-github-runner-207 kernel: [44748.594502] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 17:49:34 juju-e4d256-prod-github-runner-207 kernel: [44748.595503] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 17:49:34 juju-e4d256-prod-github-runner-207 kernel: [44748.596500] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 17:49:34 juju-e4d256-prod-github-runner-207 kernel: [44748.597446] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 17:49:34 juju-e4d256-prod-github-runner-207 kernel: [44748.598422] handle_exit+0x98/0x230 [kvm_amd] Aug 22 17:49:34 juju-e4d256-prod-github-runner-207 kernel: [44748.599314] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 17:49:34 juju-e4d256-prod-github-runner-207 kernel: [44748.600244] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 17:49:34 juju-e4d256-prod-github-runner-207 kernel: [44748.601167] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 17:49:34 juju-e4d256-prod-github-runner-207 kernel: [44748.602068] vcpu_run+0x62/0x2c0 [kvm] Aug 22 17:49:34 juju-e4d256-prod-github-runner-207 kernel: [44748.602878] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 17:49:34 juju-e4d256-prod-github-runner-207 kernel: [44748.603692] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 17:49:34 juju-e4d256-prod-github-runner-207 kernel: [44748.604546] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 17:49:34 juju-e4d256-prod-github-runner-207 kernel: [44748.605344] ? __seccomp_filter+0x4a/0x4a0 Aug 22 17:49:34 juju-e4d256-prod-github-runner-207 kernel: [44748.606085] ? __fget_files+0x86/0xc0 Aug 22 17:49:34 juju-e4d256-prod-github-runner-207 kernel: [44748.606787] __x64_sys_ioctl+0x95/0xd0 Aug 22 17:49:34 juju-e4d256-prod-github-runner-207 kernel: [44748.607477] do_syscall_64+0x5c/0xc0 Aug 22 17:49:34 juju-e4d256-prod-github-runner-207 kernel: [44748.608145] ? do_futex+0x162/0x1f0 Aug 22 17:49:34 juju-e4d256-prod-github-runner-207 kernel: [44748.608793] ? __x64_sys_futex+0x78/0x1e0 Aug 22 17:49:34 juju-e4d256-prod-github-runner-207 kernel: [44748.609465] ? __secure_computing+0xa9/0x120 Aug 22 17:49:34 juju-e4d256-prod-github-runner-207 kernel: [44748.610153] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 17:49:34 juju-e4d256-prod-github-runner-207 kernel: [44748.610911] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:49:34 juju-e4d256-prod-github-runner-207 kernel: [44748.611637] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:49:34 juju-e4d256-prod-github-runner-207 kernel: [44748.612353] ? do_syscall_64+0x69/0xc0 Aug 22 17:49:34 juju-e4d256-prod-github-runner-207 kernel: [44748.612997] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:49:34 juju-e4d256-prod-github-runner-207 kernel: [44748.613699] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:49:34 juju-e4d256-prod-github-runner-207 kernel: [44748.614393] ? do_syscall_64+0x69/0xc0 Aug 22 17:49:34 juju-e4d256-prod-github-runner-207 kernel: [44748.615016] ? do_syscall_64+0x69/0xc0 Aug 22 17:49:34 juju-e4d256-prod-github-runner-207 kernel: [44748.615645] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 17:49:34 juju-e4d256-prod-github-runner-207 kernel: [44748.616350] RIP: 0033:0x7faa5d0edaff Aug 22 17:49:34 juju-e4d256-prod-github-runner-207 kernel: [44748.616992] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 17:49:34 juju-e4d256-prod-github-runner-207 kernel: [44748.618970] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 17:49:34 juju-e4d256-prod-github-runner-207 kernel: [44748.619887] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 17:49:34 juju-e4d256-prod-github-runner-207 kernel: [44748.620776] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 17:49:34 juju-e4d256-prod-github-runner-207 kernel: [44748.621664] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 17:49:34 juju-e4d256-prod-github-runner-207 kernel: [44748.622550] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 17:49:34 juju-e4d256-prod-github-runner-207 kernel: [44748.623442] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 17:49:34 juju-e4d256-prod-github-runner-207 kernel: [44748.624339] Aug 22 17:50:02 juju-e4d256-prod-github-runner-207 kernel: [44776.541980] watchdog: BUG: soft lockup - CPU#1 stuck for 41593s! [qemu-system-x86:6715] Aug 22 17:50:02 juju-e4d256-prod-github-runner-207 kernel: [44776.543072] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 17:50:02 juju-e4d256-prod-github-runner-207 kernel: [44776.543136] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 17:50:02 juju-e4d256-prod-github-runner-207 kernel: [44776.555122] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 17:50:02 juju-e4d256-prod-github-runner-207 kernel: [44776.558098] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 17:50:02 juju-e4d256-prod-github-runner-207 kernel: [44776.559320] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:50:02 juju-e4d256-prod-github-runner-207 kernel: [44776.560376] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 17:50:02 juju-e4d256-prod-github-runner-207 kernel: [44776.563032] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 17:50:02 juju-e4d256-prod-github-runner-207 kernel: [44776.564086] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 17:50:02 juju-e4d256-prod-github-runner-207 kernel: [44776.565365] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 17:50:02 juju-e4d256-prod-github-runner-207 kernel: [44776.566520] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 17:50:02 juju-e4d256-prod-github-runner-207 kernel: [44776.567691] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 17:50:02 juju-e4d256-prod-github-runner-207 kernel: [44776.568850] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 17:50:02 juju-e4d256-prod-github-runner-207 kernel: [44776.570012] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 17:50:02 juju-e4d256-prod-github-runner-207 kernel: [44776.571256] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 17:50:02 juju-e4d256-prod-github-runner-207 kernel: [44776.572397] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 17:50:02 juju-e4d256-prod-github-runner-207 kernel: [44776.573598] Call Trace: Aug 22 17:50:02 juju-e4d256-prod-github-runner-207 kernel: [44776.574508] Aug 22 17:50:02 juju-e4d256-prod-github-runner-207 kernel: [44776.575415] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:50:02 juju-e4d256-prod-github-runner-207 kernel: [44776.576458] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:50:02 juju-e4d256-prod-github-runner-207 kernel: [44776.577478] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:50:02 juju-e4d256-prod-github-runner-207 kernel: [44776.578550] ? show_regs.part.0+0x23/0x29 Aug 22 17:50:02 juju-e4d256-prod-github-runner-207 kernel: [44776.579562] ? show_regs.cold+0x8/0xd Aug 22 17:50:02 juju-e4d256-prod-github-runner-207 kernel: [44776.580532] ? watchdog_timer_fn+0x1be/0x220 Aug 22 17:50:02 juju-e4d256-prod-github-runner-207 kernel: [44776.581539] ? lockup_detector_update_enable+0x60/0x60 Aug 22 17:50:02 juju-e4d256-prod-github-runner-207 kernel: [44776.582599] ? __hrtimer_run_queues+0x107/0x230 Aug 22 17:50:02 juju-e4d256-prod-github-runner-207 kernel: [44776.583639] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 17:50:02 juju-e4d256-prod-github-runner-207 kernel: [44776.584660] ? hrtimer_interrupt+0x101/0x220 Aug 22 17:50:02 juju-e4d256-prod-github-runner-207 kernel: [44776.585678] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 17:50:02 juju-e4d256-prod-github-runner-207 kernel: [44776.586743] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 17:50:02 juju-e4d256-prod-github-runner-207 kernel: [44776.587795] Aug 22 17:50:02 juju-e4d256-prod-github-runner-207 kernel: [44776.588647] Aug 22 17:50:02 juju-e4d256-prod-github-runner-207 kernel: [44776.589482] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 17:50:02 juju-e4d256-prod-github-runner-207 kernel: [44776.590513] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:50:02 juju-e4d256-prod-github-runner-207 kernel: [44776.591559] ? _raw_spin_lock+0x22/0x30 Aug 22 17:50:02 juju-e4d256-prod-github-runner-207 kernel: [44776.592506] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:50:02 juju-e4d256-prod-github-runner-207 kernel: [44776.593517] direct_page_fault+0x206/0x310 [kvm] Aug 22 17:50:02 juju-e4d256-prod-github-runner-207 kernel: [44776.594544] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 17:50:02 juju-e4d256-prod-github-runner-207 kernel: [44776.595564] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 17:50:02 juju-e4d256-prod-github-runner-207 kernel: [44776.596562] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 17:50:02 juju-e4d256-prod-github-runner-207 kernel: [44776.597527] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 17:50:02 juju-e4d256-prod-github-runner-207 kernel: [44776.598474] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 17:50:02 juju-e4d256-prod-github-runner-207 kernel: [44776.599456] handle_exit+0x98/0x230 [kvm_amd] Aug 22 17:50:02 juju-e4d256-prod-github-runner-207 kernel: [44776.600346] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 17:50:02 juju-e4d256-prod-github-runner-207 kernel: [44776.601257] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 17:50:02 juju-e4d256-prod-github-runner-207 kernel: [44776.602203] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 17:50:02 juju-e4d256-prod-github-runner-207 kernel: [44776.603123] vcpu_run+0x62/0x2c0 [kvm] Aug 22 17:50:02 juju-e4d256-prod-github-runner-207 kernel: [44776.603939] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 17:50:02 juju-e4d256-prod-github-runner-207 kernel: [44776.604744] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 17:50:02 juju-e4d256-prod-github-runner-207 kernel: [44776.605624] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 17:50:02 juju-e4d256-prod-github-runner-207 kernel: [44776.606418] ? __seccomp_filter+0x4a/0x4a0 Aug 22 17:50:02 juju-e4d256-prod-github-runner-207 kernel: [44776.607156] ? __fget_files+0x86/0xc0 Aug 22 17:50:02 juju-e4d256-prod-github-runner-207 kernel: [44776.607867] __x64_sys_ioctl+0x95/0xd0 Aug 22 17:50:02 juju-e4d256-prod-github-runner-207 kernel: [44776.608557] do_syscall_64+0x5c/0xc0 Aug 22 17:50:02 juju-e4d256-prod-github-runner-207 kernel: [44776.609217] ? do_futex+0x162/0x1f0 Aug 22 17:50:02 juju-e4d256-prod-github-runner-207 kernel: [44776.609860] ? __x64_sys_futex+0x78/0x1e0 Aug 22 17:50:02 juju-e4d256-prod-github-runner-207 kernel: [44776.610528] ? __secure_computing+0xa9/0x120 Aug 22 17:50:02 juju-e4d256-prod-github-runner-207 kernel: [44776.611223] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 17:50:02 juju-e4d256-prod-github-runner-207 kernel: [44776.611986] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:50:02 juju-e4d256-prod-github-runner-207 kernel: [44776.612702] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:50:02 juju-e4d256-prod-github-runner-207 kernel: [44776.613418] ? do_syscall_64+0x69/0xc0 Aug 22 17:50:02 juju-e4d256-prod-github-runner-207 kernel: [44776.614061] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:50:02 juju-e4d256-prod-github-runner-207 kernel: [44776.614762] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:50:02 juju-e4d256-prod-github-runner-207 kernel: [44776.615471] ? do_syscall_64+0x69/0xc0 Aug 22 17:50:02 juju-e4d256-prod-github-runner-207 kernel: [44776.616092] ? do_syscall_64+0x69/0xc0 Aug 22 17:50:02 juju-e4d256-prod-github-runner-207 kernel: [44776.616711] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 17:50:02 juju-e4d256-prod-github-runner-207 kernel: [44776.617412] RIP: 0033:0x7faa5d0edaff Aug 22 17:50:02 juju-e4d256-prod-github-runner-207 kernel: [44776.618032] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 17:50:02 juju-e4d256-prod-github-runner-207 kernel: [44776.620025] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 17:50:02 juju-e4d256-prod-github-runner-207 kernel: [44776.620931] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 17:50:02 juju-e4d256-prod-github-runner-207 kernel: [44776.621816] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 17:50:02 juju-e4d256-prod-github-runner-207 kernel: [44776.622757] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 17:50:02 juju-e4d256-prod-github-runner-207 kernel: [44776.623652] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 17:50:02 juju-e4d256-prod-github-runner-207 kernel: [44776.624542] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 17:50:02 juju-e4d256-prod-github-runner-207 kernel: [44776.625429] Aug 22 17:50:30 juju-e4d256-prod-github-runner-207 kernel: [44804.541982] watchdog: BUG: soft lockup - CPU#1 stuck for 41619s! [qemu-system-x86:6715] Aug 22 17:50:30 juju-e4d256-prod-github-runner-207 kernel: [44804.543300] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 17:50:30 juju-e4d256-prod-github-runner-207 kernel: [44804.543375] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 17:50:30 juju-e4d256-prod-github-runner-207 kernel: [44804.557992] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 17:50:30 juju-e4d256-prod-github-runner-207 kernel: [44804.559472] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 17:50:30 juju-e4d256-prod-github-runner-207 kernel: [44804.561008] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:50:30 juju-e4d256-prod-github-runner-207 kernel: [44804.562215] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 17:50:30 juju-e4d256-prod-github-runner-207 kernel: [44804.565197] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 17:50:30 juju-e4d256-prod-github-runner-207 kernel: [44804.566368] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 17:50:30 juju-e4d256-prod-github-runner-207 kernel: [44804.567711] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 17:50:30 juju-e4d256-prod-github-runner-207 kernel: [44804.569039] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 17:50:30 juju-e4d256-prod-github-runner-207 kernel: [44804.570427] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 17:50:30 juju-e4d256-prod-github-runner-207 kernel: [44804.571810] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 17:50:30 juju-e4d256-prod-github-runner-207 kernel: [44804.573106] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 17:50:30 juju-e4d256-prod-github-runner-207 kernel: [44804.574489] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 17:50:30 juju-e4d256-prod-github-runner-207 kernel: [44804.575715] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 17:50:30 juju-e4d256-prod-github-runner-207 kernel: [44804.577046] Call Trace: Aug 22 17:50:30 juju-e4d256-prod-github-runner-207 kernel: [44804.578148] Aug 22 17:50:30 juju-e4d256-prod-github-runner-207 kernel: [44804.579282] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:50:30 juju-e4d256-prod-github-runner-207 kernel: [44804.580575] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:50:30 juju-e4d256-prod-github-runner-207 kernel: [44804.581701] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:50:30 juju-e4d256-prod-github-runner-207 kernel: [44804.582870] ? show_regs.part.0+0x23/0x29 Aug 22 17:50:30 juju-e4d256-prod-github-runner-207 kernel: [44804.584055] ? show_regs.cold+0x8/0xd Aug 22 17:50:30 juju-e4d256-prod-github-runner-207 kernel: [44804.585178] ? watchdog_timer_fn+0x1be/0x220 Aug 22 17:50:30 juju-e4d256-prod-github-runner-207 kernel: [44804.586272] ? lockup_detector_update_enable+0x60/0x60 Aug 22 17:50:30 juju-e4d256-prod-github-runner-207 kernel: [44804.587545] ? __hrtimer_run_queues+0x107/0x230 Aug 22 17:50:30 juju-e4d256-prod-github-runner-207 kernel: [44804.588755] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 17:50:30 juju-e4d256-prod-github-runner-207 kernel: [44804.589866] ? hrtimer_interrupt+0x101/0x220 Aug 22 17:50:30 juju-e4d256-prod-github-runner-207 kernel: [44804.590988] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 17:50:30 juju-e4d256-prod-github-runner-207 kernel: [44804.592222] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 17:50:30 juju-e4d256-prod-github-runner-207 kernel: [44804.593436] Aug 22 17:50:30 juju-e4d256-prod-github-runner-207 kernel: [44804.594421] Aug 22 17:50:30 juju-e4d256-prod-github-runner-207 kernel: [44804.595332] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 17:50:30 juju-e4d256-prod-github-runner-207 kernel: [44804.596478] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:50:30 juju-e4d256-prod-github-runner-207 kernel: [44804.597660] ? _raw_spin_lock+0x22/0x30 Aug 22 17:50:30 juju-e4d256-prod-github-runner-207 kernel: [44804.598710] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:50:30 juju-e4d256-prod-github-runner-207 kernel: [44804.599860] direct_page_fault+0x206/0x310 [kvm] Aug 22 17:50:30 juju-e4d256-prod-github-runner-207 kernel: [44804.600988] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 17:50:30 juju-e4d256-prod-github-runner-207 kernel: [44804.602128] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 17:50:30 juju-e4d256-prod-github-runner-207 kernel: [44804.603246] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 17:50:30 juju-e4d256-prod-github-runner-207 kernel: [44804.604318] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 17:50:30 juju-e4d256-prod-github-runner-207 kernel: [44804.605418] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 17:50:30 juju-e4d256-prod-github-runner-207 kernel: [44804.606565] handle_exit+0x98/0x230 [kvm_amd] Aug 22 17:50:30 juju-e4d256-prod-github-runner-207 kernel: [44804.607564] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 17:50:30 juju-e4d256-prod-github-runner-207 kernel: [44804.608617] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 17:50:30 juju-e4d256-prod-github-runner-207 kernel: [44804.609645] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 17:50:30 juju-e4d256-prod-github-runner-207 kernel: [44804.610645] vcpu_run+0x62/0x2c0 [kvm] Aug 22 17:50:30 juju-e4d256-prod-github-runner-207 kernel: [44804.611625] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 17:50:30 juju-e4d256-prod-github-runner-207 kernel: [44804.612533] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 17:50:30 juju-e4d256-prod-github-runner-207 kernel: [44804.613502] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 17:50:30 juju-e4d256-prod-github-runner-207 kernel: [44804.614430] ? __seccomp_filter+0x4a/0x4a0 Aug 22 17:50:30 juju-e4d256-prod-github-runner-207 kernel: [44804.615279] ? __fget_files+0x86/0xc0 Aug 22 17:50:30 juju-e4d256-prod-github-runner-207 kernel: [44804.616063] __x64_sys_ioctl+0x95/0xd0 Aug 22 17:50:30 juju-e4d256-prod-github-runner-207 kernel: [44804.616829] do_syscall_64+0x5c/0xc0 Aug 22 17:50:30 juju-e4d256-prod-github-runner-207 kernel: [44804.617578] ? do_futex+0x162/0x1f0 Aug 22 17:50:30 juju-e4d256-prod-github-runner-207 kernel: [44804.618299] ? __x64_sys_futex+0x78/0x1e0 Aug 22 17:50:30 juju-e4d256-prod-github-runner-207 kernel: [44804.619237] ? __secure_computing+0xa9/0x120 Aug 22 17:50:30 juju-e4d256-prod-github-runner-207 kernel: [44804.620279] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 17:50:30 juju-e4d256-prod-github-runner-207 kernel: [44804.621147] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:50:30 juju-e4d256-prod-github-runner-207 kernel: [44804.621965] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:50:30 juju-e4d256-prod-github-runner-207 kernel: [44804.622778] ? do_syscall_64+0x69/0xc0 Aug 22 17:50:30 juju-e4d256-prod-github-runner-207 kernel: [44804.623515] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:50:30 juju-e4d256-prod-github-runner-207 kernel: [44804.624314] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:50:30 juju-e4d256-prod-github-runner-207 kernel: [44804.625104] ? do_syscall_64+0x69/0xc0 Aug 22 17:50:30 juju-e4d256-prod-github-runner-207 kernel: [44804.625803] ? do_syscall_64+0x69/0xc0 Aug 22 17:50:30 juju-e4d256-prod-github-runner-207 kernel: [44804.626506] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 17:50:30 juju-e4d256-prod-github-runner-207 kernel: [44804.627397] RIP: 0033:0x7faa5d0edaff Aug 22 17:50:30 juju-e4d256-prod-github-runner-207 kernel: [44804.628069] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 17:50:30 juju-e4d256-prod-github-runner-207 kernel: [44804.630074] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 17:50:30 juju-e4d256-prod-github-runner-207 kernel: [44804.631006] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 17:50:30 juju-e4d256-prod-github-runner-207 kernel: [44804.631933] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 17:50:30 juju-e4d256-prod-github-runner-207 kernel: [44804.632856] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 17:50:30 juju-e4d256-prod-github-runner-207 kernel: [44804.633751] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 17:50:30 juju-e4d256-prod-github-runner-207 kernel: [44804.634643] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 17:50:30 juju-e4d256-prod-github-runner-207 kernel: [44804.635583] Aug 22 17:50:46 juju-e4d256-prod-github-runner-207 kernel: [44820.176706] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 17:50:46 juju-e4d256-prod-github-runner-207 kernel: [44820.177686] rcu: 1-....: (11140737 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=5393060 Aug 22 17:50:46 juju-e4d256-prod-github-runner-207 kernel: [44820.178820] (t=11175744 jiffies g=23269 q=44240) Aug 22 17:50:46 juju-e4d256-prod-github-runner-207 kernel: [44820.179611] NMI backtrace for cpu 1 Aug 22 17:50:46 juju-e4d256-prod-github-runner-207 kernel: [44820.180318] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 17:50:46 juju-e4d256-prod-github-runner-207 kernel: [44820.181419] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 17:50:46 juju-e4d256-prod-github-runner-207 kernel: [44820.182474] Call Trace: Aug 22 17:50:46 juju-e4d256-prod-github-runner-207 kernel: [44820.183161] Aug 22 17:50:46 juju-e4d256-prod-github-runner-207 kernel: [44820.183807] show_stack+0x52/0x5c Aug 22 17:50:46 juju-e4d256-prod-github-runner-207 kernel: [44820.184528] dump_stack_lvl+0x4a/0x63 Aug 22 17:50:46 juju-e4d256-prod-github-runner-207 kernel: [44820.185272] dump_stack+0x10/0x16 Aug 22 17:50:46 juju-e4d256-prod-github-runner-207 kernel: [44820.185988] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 17:50:46 juju-e4d256-prod-github-runner-207 kernel: [44820.186775] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 17:50:46 juju-e4d256-prod-github-runner-207 kernel: [44820.187554] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 17:50:46 juju-e4d256-prod-github-runner-207 kernel: [44820.188369] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 17:50:46 juju-e4d256-prod-github-runner-207 kernel: [44820.189189] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 17:50:46 juju-e4d256-prod-github-runner-207 kernel: [44820.189998] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 17:50:46 juju-e4d256-prod-github-runner-207 kernel: [44820.190780] print_cpu_stall.cold+0x2f/0xe2 Aug 22 17:50:46 juju-e4d256-prod-github-runner-207 kernel: [44820.191545] ? timekeeping_update+0xf7/0x150 Aug 22 17:50:46 juju-e4d256-prod-github-runner-207 kernel: [44820.192314] check_cpu_stall+0x109/0x270 Aug 22 17:50:46 juju-e4d256-prod-github-runner-207 kernel: [44820.193060] rcu_sched_clock_irq+0x9a/0x250 Aug 22 17:50:46 juju-e4d256-prod-github-runner-207 kernel: [44820.193821] update_process_times+0x94/0xd0 Aug 22 17:50:46 juju-e4d256-prod-github-runner-207 kernel: [44820.194586] tick_sched_handle+0x29/0x70 Aug 22 17:50:46 juju-e4d256-prod-github-runner-207 kernel: [44820.195350] tick_sched_timer+0x8c/0xc0 Aug 22 17:50:46 juju-e4d256-prod-github-runner-207 kernel: [44820.196088] ? tick_nohz_handler+0xb0/0xb0 Aug 22 17:50:46 juju-e4d256-prod-github-runner-207 kernel: [44820.196843] __hrtimer_run_queues+0x107/0x230 Aug 22 17:50:46 juju-e4d256-prod-github-runner-207 kernel: [44820.197613] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 17:50:46 juju-e4d256-prod-github-runner-207 kernel: [44820.198387] hrtimer_interrupt+0x101/0x220 Aug 22 17:50:46 juju-e4d256-prod-github-runner-207 kernel: [44820.199155] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 17:50:46 juju-e4d256-prod-github-runner-207 kernel: [44820.199967] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 17:50:46 juju-e4d256-prod-github-runner-207 kernel: [44820.200771] Aug 22 17:50:46 juju-e4d256-prod-github-runner-207 kernel: [44820.201409] Aug 22 17:50:46 juju-e4d256-prod-github-runner-207 kernel: [44820.202039] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 17:50:46 juju-e4d256-prod-github-runner-207 kernel: [44820.202922] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:50:46 juju-e4d256-prod-github-runner-207 kernel: [44820.203805] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 17:50:46 juju-e4d256-prod-github-runner-207 kernel: [44820.206018] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 17:50:46 juju-e4d256-prod-github-runner-207 kernel: [44820.206929] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 17:50:46 juju-e4d256-prod-github-runner-207 kernel: [44820.207929] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 17:50:46 juju-e4d256-prod-github-runner-207 kernel: [44820.208901] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 17:50:46 juju-e4d256-prod-github-runner-207 kernel: [44820.209869] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 17:50:46 juju-e4d256-prod-github-runner-207 kernel: [44820.210866] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 17:50:46 juju-e4d256-prod-github-runner-207 kernel: [44820.211827] ? _raw_spin_lock+0x22/0x30 Aug 22 17:50:46 juju-e4d256-prod-github-runner-207 kernel: [44820.212586] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:50:46 juju-e4d256-prod-github-runner-207 kernel: [44820.213423] direct_page_fault+0x206/0x310 [kvm] Aug 22 17:50:46 juju-e4d256-prod-github-runner-207 kernel: [44820.214263] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 17:50:46 juju-e4d256-prod-github-runner-207 kernel: [44820.215104] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 17:50:46 juju-e4d256-prod-github-runner-207 kernel: [44820.215932] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 17:50:46 juju-e4d256-prod-github-runner-207 kernel: [44820.216738] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 17:50:46 juju-e4d256-prod-github-runner-207 kernel: [44820.217523] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 17:50:46 juju-e4d256-prod-github-runner-207 kernel: [44820.218390] handle_exit+0x98/0x230 [kvm_amd] Aug 22 17:50:46 juju-e4d256-prod-github-runner-207 kernel: [44820.219175] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 17:50:46 juju-e4d256-prod-github-runner-207 kernel: [44820.219962] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 17:50:46 juju-e4d256-prod-github-runner-207 kernel: [44820.220760] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 17:50:46 juju-e4d256-prod-github-runner-207 kernel: [44820.221550] vcpu_run+0x62/0x2c0 [kvm] Aug 22 17:50:46 juju-e4d256-prod-github-runner-207 kernel: [44820.222263] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 17:50:46 juju-e4d256-prod-github-runner-207 kernel: [44820.223013] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 17:50:46 juju-e4d256-prod-github-runner-207 kernel: [44820.223817] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 17:50:46 juju-e4d256-prod-github-runner-207 kernel: [44820.224577] ? __seccomp_filter+0x4a/0x4a0 Aug 22 17:50:46 juju-e4d256-prod-github-runner-207 kernel: [44820.225302] ? __fget_files+0x86/0xc0 Aug 22 17:50:46 juju-e4d256-prod-github-runner-207 kernel: [44820.225994] __x64_sys_ioctl+0x95/0xd0 Aug 22 17:50:46 juju-e4d256-prod-github-runner-207 kernel: [44820.226723] do_syscall_64+0x5c/0xc0 Aug 22 17:50:46 juju-e4d256-prod-github-runner-207 kernel: [44820.227404] ? do_futex+0x162/0x1f0 Aug 22 17:50:46 juju-e4d256-prod-github-runner-207 kernel: [44820.228075] ? __x64_sys_futex+0x78/0x1e0 Aug 22 17:50:46 juju-e4d256-prod-github-runner-207 kernel: [44820.228774] ? __secure_computing+0xa9/0x120 Aug 22 17:50:46 juju-e4d256-prod-github-runner-207 kernel: [44820.229491] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 17:50:46 juju-e4d256-prod-github-runner-207 kernel: [44820.230284] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:50:46 juju-e4d256-prod-github-runner-207 kernel: [44820.231055] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:50:46 juju-e4d256-prod-github-runner-207 kernel: [44820.231813] ? do_syscall_64+0x69/0xc0 Aug 22 17:50:46 juju-e4d256-prod-github-runner-207 kernel: [44820.232532] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:50:46 juju-e4d256-prod-github-runner-207 kernel: [44820.233289] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:50:46 juju-e4d256-prod-github-runner-207 kernel: [44820.234043] ? do_syscall_64+0x69/0xc0 Aug 22 17:50:46 juju-e4d256-prod-github-runner-207 kernel: [44820.234744] ? do_syscall_64+0x69/0xc0 Aug 22 17:50:46 juju-e4d256-prod-github-runner-207 kernel: [44820.235434] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 17:50:46 juju-e4d256-prod-github-runner-207 kernel: [44820.236201] RIP: 0033:0x7faa5d0edaff Aug 22 17:50:46 juju-e4d256-prod-github-runner-207 kernel: [44820.236884] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 17:50:46 juju-e4d256-prod-github-runner-207 kernel: [44820.238982] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 17:50:46 juju-e4d256-prod-github-runner-207 kernel: [44820.239938] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 17:50:46 juju-e4d256-prod-github-runner-207 kernel: [44820.240882] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 17:50:46 juju-e4d256-prod-github-runner-207 kernel: [44820.241829] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 17:50:46 juju-e4d256-prod-github-runner-207 kernel: [44820.242789] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 17:50:46 juju-e4d256-prod-github-runner-207 kernel: [44820.243713] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 17:50:46 juju-e4d256-prod-github-runner-207 kernel: [44820.244624] Aug 22 17:51:10 juju-e4d256-prod-github-runner-207 kernel: [44844.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 41656s! [qemu-system-x86:6715] Aug 22 17:51:10 juju-e4d256-prod-github-runner-207 kernel: [44844.543713] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 17:51:10 juju-e4d256-prod-github-runner-207 kernel: [44844.543956] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 17:51:10 juju-e4d256-prod-github-runner-207 kernel: [44844.556144] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 17:51:10 juju-e4d256-prod-github-runner-207 kernel: [44844.557415] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 17:51:10 juju-e4d256-prod-github-runner-207 kernel: [44844.558647] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:51:10 juju-e4d256-prod-github-runner-207 kernel: [44844.559705] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 17:51:10 juju-e4d256-prod-github-runner-207 kernel: [44844.562247] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 17:51:10 juju-e4d256-prod-github-runner-207 kernel: [44844.563491] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 17:51:10 juju-e4d256-prod-github-runner-207 kernel: [44844.564815] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 17:51:10 juju-e4d256-prod-github-runner-207 kernel: [44844.566129] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 17:51:10 juju-e4d256-prod-github-runner-207 kernel: [44844.567436] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 17:51:10 juju-e4d256-prod-github-runner-207 kernel: [44844.568740] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 17:51:10 juju-e4d256-prod-github-runner-207 kernel: [44844.570057] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 17:51:10 juju-e4d256-prod-github-runner-207 kernel: [44844.571462] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 17:51:10 juju-e4d256-prod-github-runner-207 kernel: [44844.572678] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 17:51:10 juju-e4d256-prod-github-runner-207 kernel: [44844.574021] Call Trace: Aug 22 17:51:10 juju-e4d256-prod-github-runner-207 kernel: [44844.575031] Aug 22 17:51:10 juju-e4d256-prod-github-runner-207 kernel: [44844.576042] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:51:10 juju-e4d256-prod-github-runner-207 kernel: [44844.577182] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:51:10 juju-e4d256-prod-github-runner-207 kernel: [44844.578292] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:51:10 juju-e4d256-prod-github-runner-207 kernel: [44844.579517] ? show_regs.part.0+0x23/0x29 Aug 22 17:51:10 juju-e4d256-prod-github-runner-207 kernel: [44844.580602] ? show_regs.cold+0x8/0xd Aug 22 17:51:10 juju-e4d256-prod-github-runner-207 kernel: [44844.581653] ? watchdog_timer_fn+0x1be/0x220 Aug 22 17:51:10 juju-e4d256-prod-github-runner-207 kernel: [44844.582782] ? lockup_detector_update_enable+0x60/0x60 Aug 22 17:51:10 juju-e4d256-prod-github-runner-207 kernel: [44844.583948] ? __hrtimer_run_queues+0x107/0x230 Aug 22 17:51:10 juju-e4d256-prod-github-runner-207 kernel: [44844.585072] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 17:51:10 juju-e4d256-prod-github-runner-207 kernel: [44844.586183] ? hrtimer_interrupt+0x101/0x220 Aug 22 17:51:10 juju-e4d256-prod-github-runner-207 kernel: [44844.587305] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 17:51:10 juju-e4d256-prod-github-runner-207 kernel: [44844.588478] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 17:51:10 juju-e4d256-prod-github-runner-207 kernel: [44844.589623] Aug 22 17:51:10 juju-e4d256-prod-github-runner-207 kernel: [44844.590553] Aug 22 17:51:10 juju-e4d256-prod-github-runner-207 kernel: [44844.591442] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 17:51:10 juju-e4d256-prod-github-runner-207 kernel: [44844.592583] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:51:10 juju-e4d256-prod-github-runner-207 kernel: [44844.593731] ? _raw_spin_lock+0x22/0x30 Aug 22 17:51:10 juju-e4d256-prod-github-runner-207 kernel: [44844.594767] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:51:10 juju-e4d256-prod-github-runner-207 kernel: [44844.595879] direct_page_fault+0x206/0x310 [kvm] Aug 22 17:51:10 juju-e4d256-prod-github-runner-207 kernel: [44844.596995] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 17:51:10 juju-e4d256-prod-github-runner-207 kernel: [44844.598101] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 17:51:10 juju-e4d256-prod-github-runner-207 kernel: [44844.599208] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 17:51:10 juju-e4d256-prod-github-runner-207 kernel: [44844.600325] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 17:51:10 juju-e4d256-prod-github-runner-207 kernel: [44844.601366] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 17:51:10 juju-e4d256-prod-github-runner-207 kernel: [44844.602468] handle_exit+0x98/0x230 [kvm_amd] Aug 22 17:51:10 juju-e4d256-prod-github-runner-207 kernel: [44844.603466] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 17:51:10 juju-e4d256-prod-github-runner-207 kernel: [44844.604477] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 17:51:10 juju-e4d256-prod-github-runner-207 kernel: [44844.605524] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 17:51:10 juju-e4d256-prod-github-runner-207 kernel: [44844.606545] vcpu_run+0x62/0x2c0 [kvm] Aug 22 17:51:10 juju-e4d256-prod-github-runner-207 kernel: [44844.607442] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 17:51:10 juju-e4d256-prod-github-runner-207 kernel: [44844.608339] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 17:51:10 juju-e4d256-prod-github-runner-207 kernel: [44844.609291] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 17:51:10 juju-e4d256-prod-github-runner-207 kernel: [44844.610183] ? __seccomp_filter+0x4a/0x4a0 Aug 22 17:51:10 juju-e4d256-prod-github-runner-207 kernel: [44844.611034] ? __fget_files+0x86/0xc0 Aug 22 17:51:10 juju-e4d256-prod-github-runner-207 kernel: [44844.611817] __x64_sys_ioctl+0x95/0xd0 Aug 22 17:51:10 juju-e4d256-prod-github-runner-207 kernel: [44844.612586] do_syscall_64+0x5c/0xc0 Aug 22 17:51:10 juju-e4d256-prod-github-runner-207 kernel: [44844.613340] ? do_futex+0x162/0x1f0 Aug 22 17:51:10 juju-e4d256-prod-github-runner-207 kernel: [44844.614064] ? __x64_sys_futex+0x78/0x1e0 Aug 22 17:51:10 juju-e4d256-prod-github-runner-207 kernel: [44844.614833] ? __secure_computing+0xa9/0x120 Aug 22 17:51:10 juju-e4d256-prod-github-runner-207 kernel: [44844.615615] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 17:51:10 juju-e4d256-prod-github-runner-207 kernel: [44844.616492] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:51:10 juju-e4d256-prod-github-runner-207 kernel: [44844.617314] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:51:10 juju-e4d256-prod-github-runner-207 kernel: [44844.618133] ? do_syscall_64+0x69/0xc0 Aug 22 17:51:10 juju-e4d256-prod-github-runner-207 kernel: [44844.618865] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:51:10 juju-e4d256-prod-github-runner-207 kernel: [44844.619667] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:51:10 juju-e4d256-prod-github-runner-207 kernel: [44844.620461] ? do_syscall_64+0x69/0xc0 Aug 22 17:51:10 juju-e4d256-prod-github-runner-207 kernel: [44844.621165] ? do_syscall_64+0x69/0xc0 Aug 22 17:51:10 juju-e4d256-prod-github-runner-207 kernel: [44844.621864] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 17:51:10 juju-e4d256-prod-github-runner-207 kernel: [44844.622690] RIP: 0033:0x7faa5d0edaff Aug 22 17:51:10 juju-e4d256-prod-github-runner-207 kernel: [44844.623422] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 17:51:10 juju-e4d256-prod-github-runner-207 kernel: [44844.625776] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 17:51:10 juju-e4d256-prod-github-runner-207 kernel: [44844.626848] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 17:51:10 juju-e4d256-prod-github-runner-207 kernel: [44844.627878] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 17:51:10 juju-e4d256-prod-github-runner-207 kernel: [44844.629108] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 17:51:10 juju-e4d256-prod-github-runner-207 kernel: [44844.630133] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 17:51:10 juju-e4d256-prod-github-runner-207 kernel: [44844.631326] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 17:51:10 juju-e4d256-prod-github-runner-207 kernel: [44844.632360] Aug 22 17:51:38 juju-e4d256-prod-github-runner-207 kernel: [44872.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 41682s! [qemu-system-x86:6715] Aug 22 17:51:38 juju-e4d256-prod-github-runner-207 kernel: [44872.543124] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 17:51:38 juju-e4d256-prod-github-runner-207 kernel: [44872.543192] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 17:51:38 juju-e4d256-prod-github-runner-207 kernel: [44872.555248] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 17:51:38 juju-e4d256-prod-github-runner-207 kernel: [44872.556513] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 17:51:38 juju-e4d256-prod-github-runner-207 kernel: [44872.557732] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:51:38 juju-e4d256-prod-github-runner-207 kernel: [44872.558802] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 17:51:38 juju-e4d256-prod-github-runner-207 kernel: [44872.561340] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 17:51:38 juju-e4d256-prod-github-runner-207 kernel: [44872.562387] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 17:51:38 juju-e4d256-prod-github-runner-207 kernel: [44872.563551] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 17:51:38 juju-e4d256-prod-github-runner-207 kernel: [44872.564707] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 17:51:38 juju-e4d256-prod-github-runner-207 kernel: [44872.565870] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 17:51:38 juju-e4d256-prod-github-runner-207 kernel: [44872.567040] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 17:51:38 juju-e4d256-prod-github-runner-207 kernel: [44872.568203] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 17:51:38 juju-e4d256-prod-github-runner-207 kernel: [44872.569435] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 17:51:38 juju-e4d256-prod-github-runner-207 kernel: [44872.570543] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 17:51:38 juju-e4d256-prod-github-runner-207 kernel: [44872.571732] Call Trace: Aug 22 17:51:38 juju-e4d256-prod-github-runner-207 kernel: [44872.572642] Aug 22 17:51:38 juju-e4d256-prod-github-runner-207 kernel: [44872.573529] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:51:38 juju-e4d256-prod-github-runner-207 kernel: [44872.574567] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:51:38 juju-e4d256-prod-github-runner-207 kernel: [44872.575590] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:51:38 juju-e4d256-prod-github-runner-207 kernel: [44872.576666] ? show_regs.part.0+0x23/0x29 Aug 22 17:51:38 juju-e4d256-prod-github-runner-207 kernel: [44872.577662] ? show_regs.cold+0x8/0xd Aug 22 17:51:38 juju-e4d256-prod-github-runner-207 kernel: [44872.578640] ? watchdog_timer_fn+0x1be/0x220 Aug 22 17:51:38 juju-e4d256-prod-github-runner-207 kernel: [44872.579654] ? lockup_detector_update_enable+0x60/0x60 Aug 22 17:51:38 juju-e4d256-prod-github-runner-207 kernel: [44872.580712] ? __hrtimer_run_queues+0x107/0x230 Aug 22 17:51:38 juju-e4d256-prod-github-runner-207 kernel: [44872.581736] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 17:51:38 juju-e4d256-prod-github-runner-207 kernel: [44872.582775] ? hrtimer_interrupt+0x101/0x220 Aug 22 17:51:38 juju-e4d256-prod-github-runner-207 kernel: [44872.583803] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 17:51:38 juju-e4d256-prod-github-runner-207 kernel: [44872.584886] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 17:51:38 juju-e4d256-prod-github-runner-207 kernel: [44872.585935] Aug 22 17:51:38 juju-e4d256-prod-github-runner-207 kernel: [44872.586806] Aug 22 17:51:38 juju-e4d256-prod-github-runner-207 kernel: [44872.587643] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 17:51:38 juju-e4d256-prod-github-runner-207 kernel: [44872.588674] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:51:38 juju-e4d256-prod-github-runner-207 kernel: [44872.589717] ? _raw_spin_lock+0x22/0x30 Aug 22 17:51:38 juju-e4d256-prod-github-runner-207 kernel: [44872.590684] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:51:38 juju-e4d256-prod-github-runner-207 kernel: [44872.591700] direct_page_fault+0x206/0x310 [kvm] Aug 22 17:51:38 juju-e4d256-prod-github-runner-207 kernel: [44872.592721] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 17:51:38 juju-e4d256-prod-github-runner-207 kernel: [44872.593727] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 17:51:38 juju-e4d256-prod-github-runner-207 kernel: [44872.594735] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 17:51:38 juju-e4d256-prod-github-runner-207 kernel: [44872.595705] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 17:51:38 juju-e4d256-prod-github-runner-207 kernel: [44872.596649] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 17:51:38 juju-e4d256-prod-github-runner-207 kernel: [44872.597626] handle_exit+0x98/0x230 [kvm_amd] Aug 22 17:51:38 juju-e4d256-prod-github-runner-207 kernel: [44872.598533] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 17:51:38 juju-e4d256-prod-github-runner-207 kernel: [44872.599459] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 17:51:38 juju-e4d256-prod-github-runner-207 kernel: [44872.600390] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 17:51:38 juju-e4d256-prod-github-runner-207 kernel: [44872.601306] vcpu_run+0x62/0x2c0 [kvm] Aug 22 17:51:38 juju-e4d256-prod-github-runner-207 kernel: [44872.602144] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 17:51:38 juju-e4d256-prod-github-runner-207 kernel: [44872.602952] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 17:51:38 juju-e4d256-prod-github-runner-207 kernel: [44872.603805] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 17:51:38 juju-e4d256-prod-github-runner-207 kernel: [44872.604606] ? __seccomp_filter+0x4a/0x4a0 Aug 22 17:51:38 juju-e4d256-prod-github-runner-207 kernel: [44872.605351] ? __fget_files+0x86/0xc0 Aug 22 17:51:38 juju-e4d256-prod-github-runner-207 kernel: [44872.606054] __x64_sys_ioctl+0x95/0xd0 Aug 22 17:51:38 juju-e4d256-prod-github-runner-207 kernel: [44872.606755] do_syscall_64+0x5c/0xc0 Aug 22 17:51:38 juju-e4d256-prod-github-runner-207 kernel: [44872.607423] ? do_futex+0x162/0x1f0 Aug 22 17:51:38 juju-e4d256-prod-github-runner-207 kernel: [44872.608071] ? __x64_sys_futex+0x78/0x1e0 Aug 22 17:51:38 juju-e4d256-prod-github-runner-207 kernel: [44872.608743] ? __secure_computing+0xa9/0x120 Aug 22 17:51:38 juju-e4d256-prod-github-runner-207 kernel: [44872.609432] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 17:51:38 juju-e4d256-prod-github-runner-207 kernel: [44872.610207] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:51:38 juju-e4d256-prod-github-runner-207 kernel: [44872.610929] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:51:38 juju-e4d256-prod-github-runner-207 kernel: [44872.611646] ? do_syscall_64+0x69/0xc0 Aug 22 17:51:38 juju-e4d256-prod-github-runner-207 kernel: [44872.612290] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:51:38 juju-e4d256-prod-github-runner-207 kernel: [44872.612992] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:51:38 juju-e4d256-prod-github-runner-207 kernel: [44872.613691] ? do_syscall_64+0x69/0xc0 Aug 22 17:51:38 juju-e4d256-prod-github-runner-207 kernel: [44872.614353] ? do_syscall_64+0x69/0xc0 Aug 22 17:51:38 juju-e4d256-prod-github-runner-207 kernel: [44872.614979] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 17:51:38 juju-e4d256-prod-github-runner-207 kernel: [44872.615690] RIP: 0033:0x7faa5d0edaff Aug 22 17:51:38 juju-e4d256-prod-github-runner-207 kernel: [44872.616343] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 17:51:38 juju-e4d256-prod-github-runner-207 kernel: [44872.618348] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 17:51:38 juju-e4d256-prod-github-runner-207 kernel: [44872.619258] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 17:51:38 juju-e4d256-prod-github-runner-207 kernel: [44872.620153] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 17:51:38 juju-e4d256-prod-github-runner-207 kernel: [44872.621046] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 17:51:38 juju-e4d256-prod-github-runner-207 kernel: [44872.621932] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 17:51:38 juju-e4d256-prod-github-runner-207 kernel: [44872.622827] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 17:51:38 juju-e4d256-prod-github-runner-207 kernel: [44872.623718] Aug 22 17:52:06 juju-e4d256-prod-github-runner-207 kernel: [44900.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 41708s! [qemu-system-x86:6715] Aug 22 17:52:06 juju-e4d256-prod-github-runner-207 kernel: [44900.543119] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 17:52:06 juju-e4d256-prod-github-runner-207 kernel: [44900.543190] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 17:52:06 juju-e4d256-prod-github-runner-207 kernel: [44900.555296] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 17:52:06 juju-e4d256-prod-github-runner-207 kernel: [44900.556566] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 17:52:06 juju-e4d256-prod-github-runner-207 kernel: [44900.557795] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:52:06 juju-e4d256-prod-github-runner-207 kernel: [44900.558858] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 17:52:06 juju-e4d256-prod-github-runner-207 kernel: [44900.561414] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 17:52:06 juju-e4d256-prod-github-runner-207 kernel: [44900.562469] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 17:52:06 juju-e4d256-prod-github-runner-207 kernel: [44900.563630] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 17:52:06 juju-e4d256-prod-github-runner-207 kernel: [44900.564789] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 17:52:06 juju-e4d256-prod-github-runner-207 kernel: [44900.565957] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 17:52:06 juju-e4d256-prod-github-runner-207 kernel: [44900.567120] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 17:52:06 juju-e4d256-prod-github-runner-207 kernel: [44900.568292] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 17:52:06 juju-e4d256-prod-github-runner-207 kernel: [44900.569532] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 17:52:06 juju-e4d256-prod-github-runner-207 kernel: [44900.570635] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 17:52:06 juju-e4d256-prod-github-runner-207 kernel: [44900.571832] Call Trace: Aug 22 17:52:06 juju-e4d256-prod-github-runner-207 kernel: [44900.572742] Aug 22 17:52:06 juju-e4d256-prod-github-runner-207 kernel: [44900.573629] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:52:06 juju-e4d256-prod-github-runner-207 kernel: [44900.574666] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:52:06 juju-e4d256-prod-github-runner-207 kernel: [44900.575686] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:52:06 juju-e4d256-prod-github-runner-207 kernel: [44900.576759] ? show_regs.part.0+0x23/0x29 Aug 22 17:52:06 juju-e4d256-prod-github-runner-207 kernel: [44900.577759] ? show_regs.cold+0x8/0xd Aug 22 17:52:06 juju-e4d256-prod-github-runner-207 kernel: [44900.578742] ? watchdog_timer_fn+0x1be/0x220 Aug 22 17:52:06 juju-e4d256-prod-github-runner-207 kernel: [44900.579765] ? lockup_detector_update_enable+0x60/0x60 Aug 22 17:52:06 juju-e4d256-prod-github-runner-207 kernel: [44900.580828] ? __hrtimer_run_queues+0x107/0x230 Aug 22 17:52:06 juju-e4d256-prod-github-runner-207 kernel: [44900.581868] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 17:52:06 juju-e4d256-prod-github-runner-207 kernel: [44900.582901] ? hrtimer_interrupt+0x101/0x220 Aug 22 17:52:06 juju-e4d256-prod-github-runner-207 kernel: [44900.583953] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 17:52:06 juju-e4d256-prod-github-runner-207 kernel: [44900.585023] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 17:52:06 juju-e4d256-prod-github-runner-207 kernel: [44900.586101] Aug 22 17:52:06 juju-e4d256-prod-github-runner-207 kernel: [44900.586960] Aug 22 17:52:06 juju-e4d256-prod-github-runner-207 kernel: [44900.587834] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 17:52:06 juju-e4d256-prod-github-runner-207 kernel: [44900.588863] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:52:06 juju-e4d256-prod-github-runner-207 kernel: [44900.589907] ? _raw_spin_lock+0x22/0x30 Aug 22 17:52:06 juju-e4d256-prod-github-runner-207 kernel: [44900.590848] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:52:06 juju-e4d256-prod-github-runner-207 kernel: [44900.591866] direct_page_fault+0x206/0x310 [kvm] Aug 22 17:52:06 juju-e4d256-prod-github-runner-207 kernel: [44900.592891] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 17:52:06 juju-e4d256-prod-github-runner-207 kernel: [44900.593905] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 17:52:06 juju-e4d256-prod-github-runner-207 kernel: [44900.594905] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 17:52:06 juju-e4d256-prod-github-runner-207 kernel: [44900.595869] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 17:52:06 juju-e4d256-prod-github-runner-207 kernel: [44900.596813] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 17:52:06 juju-e4d256-prod-github-runner-207 kernel: [44900.597799] handle_exit+0x98/0x230 [kvm_amd] Aug 22 17:52:06 juju-e4d256-prod-github-runner-207 kernel: [44900.598694] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 17:52:06 juju-e4d256-prod-github-runner-207 kernel: [44900.599601] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 17:52:06 juju-e4d256-prod-github-runner-207 kernel: [44900.600520] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 17:52:06 juju-e4d256-prod-github-runner-207 kernel: [44900.601420] vcpu_run+0x62/0x2c0 [kvm] Aug 22 17:52:06 juju-e4d256-prod-github-runner-207 kernel: [44900.602234] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 17:52:06 juju-e4d256-prod-github-runner-207 kernel: [44900.603078] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 17:52:06 juju-e4d256-prod-github-runner-207 kernel: [44900.603936] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 17:52:06 juju-e4d256-prod-github-runner-207 kernel: [44900.604733] ? __seccomp_filter+0x4a/0x4a0 Aug 22 17:52:06 juju-e4d256-prod-github-runner-207 kernel: [44900.605472] ? __fget_files+0x86/0xc0 Aug 22 17:52:06 juju-e4d256-prod-github-runner-207 kernel: [44900.606370] __x64_sys_ioctl+0x95/0xd0 Aug 22 17:52:06 juju-e4d256-prod-github-runner-207 kernel: [44900.607061] do_syscall_64+0x5c/0xc0 Aug 22 17:52:06 juju-e4d256-prod-github-runner-207 kernel: [44900.607725] ? do_futex+0x162/0x1f0 Aug 22 17:52:06 juju-e4d256-prod-github-runner-207 kernel: [44900.608369] ? __x64_sys_futex+0x78/0x1e0 Aug 22 17:52:06 juju-e4d256-prod-github-runner-207 kernel: [44900.609039] ? __secure_computing+0xa9/0x120 Aug 22 17:52:06 juju-e4d256-prod-github-runner-207 kernel: [44900.609763] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 17:52:06 juju-e4d256-prod-github-runner-207 kernel: [44900.610572] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:52:06 juju-e4d256-prod-github-runner-207 kernel: [44900.611291] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:52:06 juju-e4d256-prod-github-runner-207 kernel: [44900.612005] ? do_syscall_64+0x69/0xc0 Aug 22 17:52:06 juju-e4d256-prod-github-runner-207 kernel: [44900.612651] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:52:06 juju-e4d256-prod-github-runner-207 kernel: [44900.613350] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:52:06 juju-e4d256-prod-github-runner-207 kernel: [44900.614057] ? do_syscall_64+0x69/0xc0 Aug 22 17:52:06 juju-e4d256-prod-github-runner-207 kernel: [44900.614685] ? do_syscall_64+0x69/0xc0 Aug 22 17:52:06 juju-e4d256-prod-github-runner-207 kernel: [44900.615302] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 17:52:06 juju-e4d256-prod-github-runner-207 kernel: [44900.616001] RIP: 0033:0x7faa5d0edaff Aug 22 17:52:06 juju-e4d256-prod-github-runner-207 kernel: [44900.616627] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 17:52:06 juju-e4d256-prod-github-runner-207 kernel: [44900.618620] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 17:52:06 juju-e4d256-prod-github-runner-207 kernel: [44900.619535] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 17:52:06 juju-e4d256-prod-github-runner-207 kernel: [44900.620425] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 17:52:06 juju-e4d256-prod-github-runner-207 kernel: [44900.621310] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 17:52:06 juju-e4d256-prod-github-runner-207 kernel: [44900.622202] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 17:52:06 juju-e4d256-prod-github-runner-207 kernel: [44900.623088] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 17:52:06 juju-e4d256-prod-github-runner-207 kernel: [44900.623976] Aug 22 17:52:34 juju-e4d256-prod-github-runner-207 kernel: [44928.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 41734s! [qemu-system-x86:6715] Aug 22 17:52:34 juju-e4d256-prod-github-runner-207 kernel: [44928.543682] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 17:52:34 juju-e4d256-prod-github-runner-207 kernel: [44928.543938] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 17:52:34 juju-e4d256-prod-github-runner-207 kernel: [44928.556013] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 17:52:34 juju-e4d256-prod-github-runner-207 kernel: [44928.557281] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 17:52:34 juju-e4d256-prod-github-runner-207 kernel: [44928.558511] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:52:34 juju-e4d256-prod-github-runner-207 kernel: [44928.559570] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 17:52:34 juju-e4d256-prod-github-runner-207 kernel: [44928.562133] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 17:52:34 juju-e4d256-prod-github-runner-207 kernel: [44928.563175] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 17:52:34 juju-e4d256-prod-github-runner-207 kernel: [44928.564341] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 17:52:34 juju-e4d256-prod-github-runner-207 kernel: [44928.565514] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 17:52:34 juju-e4d256-prod-github-runner-207 kernel: [44928.566686] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 17:52:34 juju-e4d256-prod-github-runner-207 kernel: [44928.567854] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 17:52:34 juju-e4d256-prod-github-runner-207 kernel: [44928.569020] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 17:52:34 juju-e4d256-prod-github-runner-207 kernel: [44928.570283] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 17:52:34 juju-e4d256-prod-github-runner-207 kernel: [44928.571378] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 17:52:34 juju-e4d256-prod-github-runner-207 kernel: [44928.572569] Call Trace: Aug 22 17:52:34 juju-e4d256-prod-github-runner-207 kernel: [44928.573492] Aug 22 17:52:34 juju-e4d256-prod-github-runner-207 kernel: [44928.574385] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:52:34 juju-e4d256-prod-github-runner-207 kernel: [44928.575416] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:52:34 juju-e4d256-prod-github-runner-207 kernel: [44928.576439] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:52:34 juju-e4d256-prod-github-runner-207 kernel: [44928.577538] ? show_regs.part.0+0x23/0x29 Aug 22 17:52:34 juju-e4d256-prod-github-runner-207 kernel: [44928.578537] ? show_regs.cold+0x8/0xd Aug 22 17:52:34 juju-e4d256-prod-github-runner-207 kernel: [44928.579506] ? watchdog_timer_fn+0x1be/0x220 Aug 22 17:52:34 juju-e4d256-prod-github-runner-207 kernel: [44928.580516] ? lockup_detector_update_enable+0x60/0x60 Aug 22 17:52:34 juju-e4d256-prod-github-runner-207 kernel: [44928.581591] ? __hrtimer_run_queues+0x107/0x230 Aug 22 17:52:34 juju-e4d256-prod-github-runner-207 kernel: [44928.582802] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 17:52:34 juju-e4d256-prod-github-runner-207 kernel: [44928.583830] ? hrtimer_interrupt+0x101/0x220 Aug 22 17:52:34 juju-e4d256-prod-github-runner-207 kernel: [44928.584843] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 17:52:34 juju-e4d256-prod-github-runner-207 kernel: [44928.585919] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 17:52:34 juju-e4d256-prod-github-runner-207 kernel: [44928.586963] Aug 22 17:52:34 juju-e4d256-prod-github-runner-207 kernel: [44928.587813] Aug 22 17:52:34 juju-e4d256-prod-github-runner-207 kernel: [44928.588655] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 17:52:34 juju-e4d256-prod-github-runner-207 kernel: [44928.589696] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:52:34 juju-e4d256-prod-github-runner-207 kernel: [44928.590733] ? _raw_spin_lock+0x22/0x30 Aug 22 17:52:34 juju-e4d256-prod-github-runner-207 kernel: [44928.591684] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:52:34 juju-e4d256-prod-github-runner-207 kernel: [44928.592705] direct_page_fault+0x206/0x310 [kvm] Aug 22 17:52:34 juju-e4d256-prod-github-runner-207 kernel: [44928.593733] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 17:52:34 juju-e4d256-prod-github-runner-207 kernel: [44928.594747] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 17:52:34 juju-e4d256-prod-github-runner-207 kernel: [44928.595745] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 17:52:34 juju-e4d256-prod-github-runner-207 kernel: [44928.596738] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 17:52:34 juju-e4d256-prod-github-runner-207 kernel: [44928.597704] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 17:52:34 juju-e4d256-prod-github-runner-207 kernel: [44928.598682] handle_exit+0x98/0x230 [kvm_amd] Aug 22 17:52:34 juju-e4d256-prod-github-runner-207 kernel: [44928.599582] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 17:52:34 juju-e4d256-prod-github-runner-207 kernel: [44928.600499] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 17:52:34 juju-e4d256-prod-github-runner-207 kernel: [44928.601420] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 17:52:34 juju-e4d256-prod-github-runner-207 kernel: [44928.602332] vcpu_run+0x62/0x2c0 [kvm] Aug 22 17:52:34 juju-e4d256-prod-github-runner-207 kernel: [44928.603143] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 17:52:34 juju-e4d256-prod-github-runner-207 kernel: [44928.603950] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 17:52:34 juju-e4d256-prod-github-runner-207 kernel: [44928.604806] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 17:52:34 juju-e4d256-prod-github-runner-207 kernel: [44928.605607] ? __seccomp_filter+0x4a/0x4a0 Aug 22 17:52:34 juju-e4d256-prod-github-runner-207 kernel: [44928.606347] ? __fget_files+0x86/0xc0 Aug 22 17:52:34 juju-e4d256-prod-github-runner-207 kernel: [44928.607056] __x64_sys_ioctl+0x95/0xd0 Aug 22 17:52:34 juju-e4d256-prod-github-runner-207 kernel: [44928.607751] do_syscall_64+0x5c/0xc0 Aug 22 17:52:34 juju-e4d256-prod-github-runner-207 kernel: [44928.608414] ? do_futex+0x162/0x1f0 Aug 22 17:52:34 juju-e4d256-prod-github-runner-207 kernel: [44928.609065] ? __x64_sys_futex+0x78/0x1e0 Aug 22 17:52:34 juju-e4d256-prod-github-runner-207 kernel: [44928.609755] ? __secure_computing+0xa9/0x120 Aug 22 17:52:34 juju-e4d256-prod-github-runner-207 kernel: [44928.610444] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 17:52:34 juju-e4d256-prod-github-runner-207 kernel: [44928.611205] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:52:34 juju-e4d256-prod-github-runner-207 kernel: [44928.611929] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:52:34 juju-e4d256-prod-github-runner-207 kernel: [44928.612647] ? do_syscall_64+0x69/0xc0 Aug 22 17:52:34 juju-e4d256-prod-github-runner-207 kernel: [44928.613296] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:52:34 juju-e4d256-prod-github-runner-207 kernel: [44928.614006] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:52:34 juju-e4d256-prod-github-runner-207 kernel: [44928.614705] ? do_syscall_64+0x69/0xc0 Aug 22 17:52:34 juju-e4d256-prod-github-runner-207 kernel: [44928.615327] ? do_syscall_64+0x69/0xc0 Aug 22 17:52:34 juju-e4d256-prod-github-runner-207 kernel: [44928.615945] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 17:52:34 juju-e4d256-prod-github-runner-207 kernel: [44928.616652] RIP: 0033:0x7faa5d0edaff Aug 22 17:52:34 juju-e4d256-prod-github-runner-207 kernel: [44928.617290] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 17:52:34 juju-e4d256-prod-github-runner-207 kernel: [44928.619277] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 17:52:34 juju-e4d256-prod-github-runner-207 kernel: [44928.620187] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 17:52:34 juju-e4d256-prod-github-runner-207 kernel: [44928.621072] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 17:52:34 juju-e4d256-prod-github-runner-207 kernel: [44928.621969] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 17:52:34 juju-e4d256-prod-github-runner-207 kernel: [44928.622852] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 17:52:34 juju-e4d256-prod-github-runner-207 kernel: [44928.623746] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 17:52:34 juju-e4d256-prod-github-runner-207 kernel: [44928.624636] Aug 22 17:53:02 juju-e4d256-prod-github-runner-207 kernel: [44956.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 41761s! [qemu-system-x86:6715] Aug 22 17:53:02 juju-e4d256-prod-github-runner-207 kernel: [44956.543087] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 17:53:02 juju-e4d256-prod-github-runner-207 kernel: [44956.543152] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 17:53:02 juju-e4d256-prod-github-runner-207 kernel: [44956.555530] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 17:53:02 juju-e4d256-prod-github-runner-207 kernel: [44956.556819] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 17:53:02 juju-e4d256-prod-github-runner-207 kernel: [44956.558122] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:53:02 juju-e4d256-prod-github-runner-207 kernel: [44956.559376] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 17:53:02 juju-e4d256-prod-github-runner-207 kernel: [44956.561961] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 17:53:02 juju-e4d256-prod-github-runner-207 kernel: [44956.563048] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 17:53:02 juju-e4d256-prod-github-runner-207 kernel: [44956.564237] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 17:53:02 juju-e4d256-prod-github-runner-207 kernel: [44956.565422] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 17:53:02 juju-e4d256-prod-github-runner-207 kernel: [44956.566594] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 17:53:02 juju-e4d256-prod-github-runner-207 kernel: [44956.567766] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 17:53:02 juju-e4d256-prod-github-runner-207 kernel: [44956.568948] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 17:53:02 juju-e4d256-prod-github-runner-207 kernel: [44956.570203] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 17:53:02 juju-e4d256-prod-github-runner-207 kernel: [44956.571311] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 17:53:02 juju-e4d256-prod-github-runner-207 kernel: [44956.572518] Call Trace: Aug 22 17:53:02 juju-e4d256-prod-github-runner-207 kernel: [44956.573454] Aug 22 17:53:02 juju-e4d256-prod-github-runner-207 kernel: [44956.574350] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:53:02 juju-e4d256-prod-github-runner-207 kernel: [44956.575391] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:53:02 juju-e4d256-prod-github-runner-207 kernel: [44956.576423] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:53:02 juju-e4d256-prod-github-runner-207 kernel: [44956.577538] ? show_regs.part.0+0x23/0x29 Aug 22 17:53:02 juju-e4d256-prod-github-runner-207 kernel: [44956.578553] ? show_regs.cold+0x8/0xd Aug 22 17:53:02 juju-e4d256-prod-github-runner-207 kernel: [44956.579638] ? watchdog_timer_fn+0x1be/0x220 Aug 22 17:53:02 juju-e4d256-prod-github-runner-207 kernel: [44956.580747] ? lockup_detector_update_enable+0x60/0x60 Aug 22 17:53:02 juju-e4d256-prod-github-runner-207 kernel: [44956.581937] ? __hrtimer_run_queues+0x107/0x230 Aug 22 17:53:02 juju-e4d256-prod-github-runner-207 kernel: [44956.583058] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 17:53:02 juju-e4d256-prod-github-runner-207 kernel: [44956.584174] ? hrtimer_interrupt+0x101/0x220 Aug 22 17:53:02 juju-e4d256-prod-github-runner-207 kernel: [44956.585289] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 17:53:02 juju-e4d256-prod-github-runner-207 kernel: [44956.586461] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 17:53:02 juju-e4d256-prod-github-runner-207 kernel: [44956.587607] Aug 22 17:53:02 juju-e4d256-prod-github-runner-207 kernel: [44956.588507] Aug 22 17:53:02 juju-e4d256-prod-github-runner-207 kernel: [44956.589417] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 17:53:02 juju-e4d256-prod-github-runner-207 kernel: [44956.590552] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:53:02 juju-e4d256-prod-github-runner-207 kernel: [44956.591700] ? _raw_spin_lock+0x22/0x30 Aug 22 17:53:02 juju-e4d256-prod-github-runner-207 kernel: [44956.592740] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:53:02 juju-e4d256-prod-github-runner-207 kernel: [44956.593880] direct_page_fault+0x206/0x310 [kvm] Aug 22 17:53:02 juju-e4d256-prod-github-runner-207 kernel: [44956.594990] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 17:53:02 juju-e4d256-prod-github-runner-207 kernel: [44956.596088] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 17:53:02 juju-e4d256-prod-github-runner-207 kernel: [44956.597244] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 17:53:02 juju-e4d256-prod-github-runner-207 kernel: [44956.598329] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 17:53:02 juju-e4d256-prod-github-runner-207 kernel: [44956.599379] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 17:53:02 juju-e4d256-prod-github-runner-207 kernel: [44956.600478] handle_exit+0x98/0x230 [kvm_amd] Aug 22 17:53:02 juju-e4d256-prod-github-runner-207 kernel: [44956.601534] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 17:53:02 juju-e4d256-prod-github-runner-207 kernel: [44956.602549] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 17:53:02 juju-e4d256-prod-github-runner-207 kernel: [44956.603574] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 17:53:02 juju-e4d256-prod-github-runner-207 kernel: [44956.604582] vcpu_run+0x62/0x2c0 [kvm] Aug 22 17:53:02 juju-e4d256-prod-github-runner-207 kernel: [44956.605569] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 17:53:02 juju-e4d256-prod-github-runner-207 kernel: [44956.606488] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 17:53:02 juju-e4d256-prod-github-runner-207 kernel: [44956.607445] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 17:53:02 juju-e4d256-prod-github-runner-207 kernel: [44956.608341] ? __seccomp_filter+0x4a/0x4a0 Aug 22 17:53:02 juju-e4d256-prod-github-runner-207 kernel: [44956.609208] ? __fget_files+0x86/0xc0 Aug 22 17:53:02 juju-e4d256-prod-github-runner-207 kernel: [44956.610007] __x64_sys_ioctl+0x95/0xd0 Aug 22 17:53:02 juju-e4d256-prod-github-runner-207 kernel: [44956.610792] do_syscall_64+0x5c/0xc0 Aug 22 17:53:02 juju-e4d256-prod-github-runner-207 kernel: [44956.611537] ? do_futex+0x162/0x1f0 Aug 22 17:53:02 juju-e4d256-prod-github-runner-207 kernel: [44956.612257] ? __x64_sys_futex+0x78/0x1e0 Aug 22 17:53:02 juju-e4d256-prod-github-runner-207 kernel: [44956.613018] ? __secure_computing+0xa9/0x120 Aug 22 17:53:02 juju-e4d256-prod-github-runner-207 kernel: [44956.613802] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 17:53:02 juju-e4d256-prod-github-runner-207 kernel: [44956.614680] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:53:02 juju-e4d256-prod-github-runner-207 kernel: [44956.615494] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:53:02 juju-e4d256-prod-github-runner-207 kernel: [44956.616309] ? do_syscall_64+0x69/0xc0 Aug 22 17:53:02 juju-e4d256-prod-github-runner-207 kernel: [44956.617035] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:53:02 juju-e4d256-prod-github-runner-207 kernel: [44956.617842] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:53:02 juju-e4d256-prod-github-runner-207 kernel: [44956.618637] ? do_syscall_64+0x69/0xc0 Aug 22 17:53:02 juju-e4d256-prod-github-runner-207 kernel: [44956.619334] ? do_syscall_64+0x69/0xc0 Aug 22 17:53:02 juju-e4d256-prod-github-runner-207 kernel: [44956.620030] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 17:53:02 juju-e4d256-prod-github-runner-207 kernel: [44956.620833] RIP: 0033:0x7faa5d0edaff Aug 22 17:53:02 juju-e4d256-prod-github-runner-207 kernel: [44956.621570] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 17:53:02 juju-e4d256-prod-github-runner-207 kernel: [44956.623943] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 17:53:02 juju-e4d256-prod-github-runner-207 kernel: [44956.625067] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 17:53:02 juju-e4d256-prod-github-runner-207 kernel: [44956.626119] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 17:53:02 juju-e4d256-prod-github-runner-207 kernel: [44956.627152] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 17:53:02 juju-e4d256-prod-github-runner-207 kernel: [44956.628182] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 17:53:02 juju-e4d256-prod-github-runner-207 kernel: [44956.629229] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 17:53:02 juju-e4d256-prod-github-runner-207 kernel: [44956.630271] Aug 22 17:53:30 juju-e4d256-prod-github-runner-207 kernel: [44984.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 41787s! [qemu-system-x86:6715] Aug 22 17:53:30 juju-e4d256-prod-github-runner-207 kernel: [44984.543105] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 17:53:30 juju-e4d256-prod-github-runner-207 kernel: [44984.543173] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 17:53:30 juju-e4d256-prod-github-runner-207 kernel: [44984.555609] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 17:53:30 juju-e4d256-prod-github-runner-207 kernel: [44984.557221] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 17:53:30 juju-e4d256-prod-github-runner-207 kernel: [44984.558611] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:53:30 juju-e4d256-prod-github-runner-207 kernel: [44984.559670] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 17:53:30 juju-e4d256-prod-github-runner-207 kernel: [44984.562345] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 17:53:30 juju-e4d256-prod-github-runner-207 kernel: [44984.563454] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 17:53:30 juju-e4d256-prod-github-runner-207 kernel: [44984.564634] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 17:53:30 juju-e4d256-prod-github-runner-207 kernel: [44984.565828] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 17:53:30 juju-e4d256-prod-github-runner-207 kernel: [44984.567020] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 17:53:30 juju-e4d256-prod-github-runner-207 kernel: [44984.568355] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 17:53:30 juju-e4d256-prod-github-runner-207 kernel: [44984.569676] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 17:53:30 juju-e4d256-prod-github-runner-207 kernel: [44984.571061] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 17:53:30 juju-e4d256-prod-github-runner-207 kernel: [44984.572277] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 17:53:30 juju-e4d256-prod-github-runner-207 kernel: [44984.573630] Call Trace: Aug 22 17:53:30 juju-e4d256-prod-github-runner-207 kernel: [44984.574605] Aug 22 17:53:30 juju-e4d256-prod-github-runner-207 kernel: [44984.575532] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:53:30 juju-e4d256-prod-github-runner-207 kernel: [44984.576649] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:53:30 juju-e4d256-prod-github-runner-207 kernel: [44984.577850] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:53:30 juju-e4d256-prod-github-runner-207 kernel: [44984.579096] ? show_regs.part.0+0x23/0x29 Aug 22 17:53:30 juju-e4d256-prod-github-runner-207 kernel: [44984.580234] ? show_regs.cold+0x8/0xd Aug 22 17:53:30 juju-e4d256-prod-github-runner-207 kernel: [44984.581250] ? watchdog_timer_fn+0x1be/0x220 Aug 22 17:53:30 juju-e4d256-prod-github-runner-207 kernel: [44984.582271] ? lockup_detector_update_enable+0x60/0x60 Aug 22 17:53:30 juju-e4d256-prod-github-runner-207 kernel: [44984.583343] ? __hrtimer_run_queues+0x107/0x230 Aug 22 17:53:30 juju-e4d256-prod-github-runner-207 kernel: [44984.584384] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 17:53:30 juju-e4d256-prod-github-runner-207 kernel: [44984.585431] ? hrtimer_interrupt+0x101/0x220 Aug 22 17:53:30 juju-e4d256-prod-github-runner-207 kernel: [44984.586448] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 17:53:30 juju-e4d256-prod-github-runner-207 kernel: [44984.587617] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 17:53:30 juju-e4d256-prod-github-runner-207 kernel: [44984.588678] Aug 22 17:53:30 juju-e4d256-prod-github-runner-207 kernel: [44984.589593] Aug 22 17:53:30 juju-e4d256-prod-github-runner-207 kernel: [44984.590451] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 17:53:30 juju-e4d256-prod-github-runner-207 kernel: [44984.591486] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:53:30 juju-e4d256-prod-github-runner-207 kernel: [44984.592531] ? _raw_spin_lock+0x22/0x30 Aug 22 17:53:30 juju-e4d256-prod-github-runner-207 kernel: [44984.593527] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:53:30 juju-e4d256-prod-github-runner-207 kernel: [44984.594551] direct_page_fault+0x206/0x310 [kvm] Aug 22 17:53:30 juju-e4d256-prod-github-runner-207 kernel: [44984.595574] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 17:53:30 juju-e4d256-prod-github-runner-207 kernel: [44984.596613] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 17:53:30 juju-e4d256-prod-github-runner-207 kernel: [44984.597653] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 17:53:30 juju-e4d256-prod-github-runner-207 kernel: [44984.598628] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 17:53:30 juju-e4d256-prod-github-runner-207 kernel: [44984.599627] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 17:53:30 juju-e4d256-prod-github-runner-207 kernel: [44984.600624] handle_exit+0x98/0x230 [kvm_amd] Aug 22 17:53:30 juju-e4d256-prod-github-runner-207 kernel: [44984.601535] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 17:53:30 juju-e4d256-prod-github-runner-207 kernel: [44984.602450] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 17:53:30 juju-e4d256-prod-github-runner-207 kernel: [44984.603377] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 17:53:30 juju-e4d256-prod-github-runner-207 kernel: [44984.604281] vcpu_run+0x62/0x2c0 [kvm] Aug 22 17:53:30 juju-e4d256-prod-github-runner-207 kernel: [44984.605109] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 17:53:30 juju-e4d256-prod-github-runner-207 kernel: [44984.605919] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 17:53:30 juju-e4d256-prod-github-runner-207 kernel: [44984.606779] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 17:53:30 juju-e4d256-prod-github-runner-207 kernel: [44984.607585] ? __seccomp_filter+0x4a/0x4a0 Aug 22 17:53:30 juju-e4d256-prod-github-runner-207 kernel: [44984.608335] ? __fget_files+0x86/0xc0 Aug 22 17:53:30 juju-e4d256-prod-github-runner-207 kernel: [44984.609179] __x64_sys_ioctl+0x95/0xd0 Aug 22 17:53:30 juju-e4d256-prod-github-runner-207 kernel: [44984.609907] do_syscall_64+0x5c/0xc0 Aug 22 17:53:30 juju-e4d256-prod-github-runner-207 kernel: [44984.610584] ? do_futex+0x162/0x1f0 Aug 22 17:53:30 juju-e4d256-prod-github-runner-207 kernel: [44984.611234] ? __x64_sys_futex+0x78/0x1e0 Aug 22 17:53:30 juju-e4d256-prod-github-runner-207 kernel: [44984.611907] ? __secure_computing+0xa9/0x120 Aug 22 17:53:30 juju-e4d256-prod-github-runner-207 kernel: [44984.612597] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 17:53:30 juju-e4d256-prod-github-runner-207 kernel: [44984.613384] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:53:30 juju-e4d256-prod-github-runner-207 kernel: [44984.614107] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:53:30 juju-e4d256-prod-github-runner-207 kernel: [44984.614827] ? do_syscall_64+0x69/0xc0 Aug 22 17:53:30 juju-e4d256-prod-github-runner-207 kernel: [44984.615477] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:53:30 juju-e4d256-prod-github-runner-207 kernel: [44984.616179] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:53:30 juju-e4d256-prod-github-runner-207 kernel: [44984.616888] ? do_syscall_64+0x69/0xc0 Aug 22 17:53:30 juju-e4d256-prod-github-runner-207 kernel: [44984.617520] ? do_syscall_64+0x69/0xc0 Aug 22 17:53:30 juju-e4d256-prod-github-runner-207 kernel: [44984.618142] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 17:53:30 juju-e4d256-prod-github-runner-207 kernel: [44984.618849] RIP: 0033:0x7faa5d0edaff Aug 22 17:53:30 juju-e4d256-prod-github-runner-207 kernel: [44984.619479] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 17:53:30 juju-e4d256-prod-github-runner-207 kernel: [44984.621498] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 17:53:30 juju-e4d256-prod-github-runner-207 kernel: [44984.622414] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 17:53:30 juju-e4d256-prod-github-runner-207 kernel: [44984.623305] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 17:53:30 juju-e4d256-prod-github-runner-207 kernel: [44984.624196] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 17:53:30 juju-e4d256-prod-github-runner-207 kernel: [44984.625106] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 17:53:30 juju-e4d256-prod-github-runner-207 kernel: [44984.626003] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 17:53:30 juju-e4d256-prod-github-runner-207 kernel: [44984.626954] Aug 22 17:53:46 juju-e4d256-prod-github-runner-207 kernel: [45000.188709] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 17:53:46 juju-e4d256-prod-github-runner-207 kernel: [45000.189696] rcu: 1-....: (11185603 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=5414799 Aug 22 17:53:46 juju-e4d256-prod-github-runner-207 kernel: [45000.190821] (t=11220747 jiffies g=23269 q=44354) Aug 22 17:53:46 juju-e4d256-prod-github-runner-207 kernel: [45000.191611] NMI backtrace for cpu 1 Aug 22 17:53:46 juju-e4d256-prod-github-runner-207 kernel: [45000.192318] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 17:53:46 juju-e4d256-prod-github-runner-207 kernel: [45000.193463] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 17:53:46 juju-e4d256-prod-github-runner-207 kernel: [45000.194521] Call Trace: Aug 22 17:53:46 juju-e4d256-prod-github-runner-207 kernel: [45000.195195] Aug 22 17:53:46 juju-e4d256-prod-github-runner-207 kernel: [45000.195845] show_stack+0x52/0x5c Aug 22 17:53:46 juju-e4d256-prod-github-runner-207 kernel: [45000.196574] dump_stack_lvl+0x4a/0x63 Aug 22 17:53:46 juju-e4d256-prod-github-runner-207 kernel: [45000.197342] dump_stack+0x10/0x16 Aug 22 17:53:46 juju-e4d256-prod-github-runner-207 kernel: [45000.198056] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 17:53:46 juju-e4d256-prod-github-runner-207 kernel: [45000.198833] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 17:53:46 juju-e4d256-prod-github-runner-207 kernel: [45000.199631] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 17:53:46 juju-e4d256-prod-github-runner-207 kernel: [45000.200450] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 17:53:46 juju-e4d256-prod-github-runner-207 kernel: [45000.201288] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 17:53:46 juju-e4d256-prod-github-runner-207 kernel: [45000.202098] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 17:53:46 juju-e4d256-prod-github-runner-207 kernel: [45000.202868] print_cpu_stall.cold+0x2f/0xe2 Aug 22 17:53:46 juju-e4d256-prod-github-runner-207 kernel: [45000.203632] ? timekeeping_update+0xf7/0x150 Aug 22 17:53:46 juju-e4d256-prod-github-runner-207 kernel: [45000.204402] check_cpu_stall+0x109/0x270 Aug 22 17:53:46 juju-e4d256-prod-github-runner-207 kernel: [45000.205160] rcu_sched_clock_irq+0x9a/0x250 Aug 22 17:53:46 juju-e4d256-prod-github-runner-207 kernel: [45000.205936] update_process_times+0x94/0xd0 Aug 22 17:53:46 juju-e4d256-prod-github-runner-207 kernel: [45000.206704] tick_sched_handle+0x29/0x70 Aug 22 17:53:46 juju-e4d256-prod-github-runner-207 kernel: [45000.207453] tick_sched_timer+0x8c/0xc0 Aug 22 17:53:46 juju-e4d256-prod-github-runner-207 kernel: [45000.208191] ? tick_nohz_handler+0xb0/0xb0 Aug 22 17:53:46 juju-e4d256-prod-github-runner-207 kernel: [45000.208967] __hrtimer_run_queues+0x107/0x230 Aug 22 17:53:46 juju-e4d256-prod-github-runner-207 kernel: [45000.209740] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 17:53:46 juju-e4d256-prod-github-runner-207 kernel: [45000.210521] hrtimer_interrupt+0x101/0x220 Aug 22 17:53:46 juju-e4d256-prod-github-runner-207 kernel: [45000.211283] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 17:53:46 juju-e4d256-prod-github-runner-207 kernel: [45000.212094] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 17:53:46 juju-e4d256-prod-github-runner-207 kernel: [45000.213071] Aug 22 17:53:46 juju-e4d256-prod-github-runner-207 kernel: [45000.213836] Aug 22 17:53:46 juju-e4d256-prod-github-runner-207 kernel: [45000.214464] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 17:53:46 juju-e4d256-prod-github-runner-207 kernel: [45000.215287] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:53:46 juju-e4d256-prod-github-runner-207 kernel: [45000.216167] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 17:53:46 juju-e4d256-prod-github-runner-207 kernel: [45000.218384] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 17:53:46 juju-e4d256-prod-github-runner-207 kernel: [45000.219257] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 17:53:46 juju-e4d256-prod-github-runner-207 kernel: [45000.220249] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 17:53:46 juju-e4d256-prod-github-runner-207 kernel: [45000.221238] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 17:53:46 juju-e4d256-prod-github-runner-207 kernel: [45000.222205] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 17:53:46 juju-e4d256-prod-github-runner-207 kernel: [45000.223160] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 17:53:46 juju-e4d256-prod-github-runner-207 kernel: [45000.224121] ? _raw_spin_lock+0x22/0x30 Aug 22 17:53:46 juju-e4d256-prod-github-runner-207 kernel: [45000.224889] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:53:46 juju-e4d256-prod-github-runner-207 kernel: [45000.225734] direct_page_fault+0x206/0x310 [kvm] Aug 22 17:53:46 juju-e4d256-prod-github-runner-207 kernel: [45000.226577] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 17:53:46 juju-e4d256-prod-github-runner-207 kernel: [45000.227406] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 17:53:46 juju-e4d256-prod-github-runner-207 kernel: [45000.228231] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 17:53:46 juju-e4d256-prod-github-runner-207 kernel: [45000.229051] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 17:53:46 juju-e4d256-prod-github-runner-207 kernel: [45000.229842] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 17:53:46 juju-e4d256-prod-github-runner-207 kernel: [45000.230667] handle_exit+0x98/0x230 [kvm_amd] Aug 22 17:53:46 juju-e4d256-prod-github-runner-207 kernel: [45000.231422] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 17:53:46 juju-e4d256-prod-github-runner-207 kernel: [45000.232207] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 17:53:46 juju-e4d256-prod-github-runner-207 kernel: [45000.233021] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 17:53:46 juju-e4d256-prod-github-runner-207 kernel: [45000.233809] vcpu_run+0x62/0x2c0 [kvm] Aug 22 17:53:46 juju-e4d256-prod-github-runner-207 kernel: [45000.234525] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 17:53:46 juju-e4d256-prod-github-runner-207 kernel: [45000.235260] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 17:53:46 juju-e4d256-prod-github-runner-207 kernel: [45000.236062] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 17:53:46 juju-e4d256-prod-github-runner-207 kernel: [45000.236849] ? __seccomp_filter+0x4a/0x4a0 Aug 22 17:53:46 juju-e4d256-prod-github-runner-207 kernel: [45000.237573] ? __fget_files+0x86/0xc0 Aug 22 17:53:46 juju-e4d256-prod-github-runner-207 kernel: [45000.238278] __x64_sys_ioctl+0x95/0xd0 Aug 22 17:53:46 juju-e4d256-prod-github-runner-207 kernel: [45000.238989] do_syscall_64+0x5c/0xc0 Aug 22 17:53:46 juju-e4d256-prod-github-runner-207 kernel: [45000.239668] ? do_futex+0x162/0x1f0 Aug 22 17:53:46 juju-e4d256-prod-github-runner-207 kernel: [45000.240339] ? __x64_sys_futex+0x78/0x1e0 Aug 22 17:53:46 juju-e4d256-prod-github-runner-207 kernel: [45000.241052] ? __secure_computing+0xa9/0x120 Aug 22 17:53:46 juju-e4d256-prod-github-runner-207 kernel: [45000.241769] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 17:53:46 juju-e4d256-prod-github-runner-207 kernel: [45000.242563] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:53:46 juju-e4d256-prod-github-runner-207 kernel: [45000.243314] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:53:46 juju-e4d256-prod-github-runner-207 kernel: [45000.244064] ? do_syscall_64+0x69/0xc0 Aug 22 17:53:46 juju-e4d256-prod-github-runner-207 kernel: [45000.244769] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:53:46 juju-e4d256-prod-github-runner-207 kernel: [45000.245524] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:53:46 juju-e4d256-prod-github-runner-207 kernel: [45000.246281] ? do_syscall_64+0x69/0xc0 Aug 22 17:53:46 juju-e4d256-prod-github-runner-207 kernel: [45000.246974] ? do_syscall_64+0x69/0xc0 Aug 22 17:53:46 juju-e4d256-prod-github-runner-207 kernel: [45000.247679] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 17:53:46 juju-e4d256-prod-github-runner-207 kernel: [45000.248482] RIP: 0033:0x7faa5d0edaff Aug 22 17:53:46 juju-e4d256-prod-github-runner-207 kernel: [45000.249180] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 17:53:46 juju-e4d256-prod-github-runner-207 kernel: [45000.251267] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 17:53:46 juju-e4d256-prod-github-runner-207 kernel: [45000.252229] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 17:53:46 juju-e4d256-prod-github-runner-207 kernel: [45000.253183] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 17:53:46 juju-e4d256-prod-github-runner-207 kernel: [45000.254126] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 17:53:46 juju-e4d256-prod-github-runner-207 kernel: [45000.255063] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 17:53:46 juju-e4d256-prod-github-runner-207 kernel: [45000.255985] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 17:53:46 juju-e4d256-prod-github-runner-207 kernel: [45000.256909] Aug 22 17:54:10 juju-e4d256-prod-github-runner-207 kernel: [45024.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 41824s! [qemu-system-x86:6715] Aug 22 17:54:10 juju-e4d256-prod-github-runner-207 kernel: [45024.543698] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 17:54:10 juju-e4d256-prod-github-runner-207 kernel: [45024.543943] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 17:54:10 juju-e4d256-prod-github-runner-207 kernel: [45024.556118] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 17:54:10 juju-e4d256-prod-github-runner-207 kernel: [45024.557402] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 17:54:10 juju-e4d256-prod-github-runner-207 kernel: [45024.558630] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:54:10 juju-e4d256-prod-github-runner-207 kernel: [45024.559692] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 17:54:10 juju-e4d256-prod-github-runner-207 kernel: [45024.562267] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 17:54:10 juju-e4d256-prod-github-runner-207 kernel: [45024.563309] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 17:54:10 juju-e4d256-prod-github-runner-207 kernel: [45024.564489] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 17:54:10 juju-e4d256-prod-github-runner-207 kernel: [45024.565653] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 17:54:10 juju-e4d256-prod-github-runner-207 kernel: [45024.566816] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 17:54:10 juju-e4d256-prod-github-runner-207 kernel: [45024.567977] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 17:54:10 juju-e4d256-prod-github-runner-207 kernel: [45024.569164] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 17:54:10 juju-e4d256-prod-github-runner-207 kernel: [45024.570402] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 17:54:10 juju-e4d256-prod-github-runner-207 kernel: [45024.571525] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 17:54:10 juju-e4d256-prod-github-runner-207 kernel: [45024.572745] Call Trace: Aug 22 17:54:10 juju-e4d256-prod-github-runner-207 kernel: [45024.573675] Aug 22 17:54:10 juju-e4d256-prod-github-runner-207 kernel: [45024.574561] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:54:10 juju-e4d256-prod-github-runner-207 kernel: [45024.575593] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:54:10 juju-e4d256-prod-github-runner-207 kernel: [45024.576626] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:54:10 juju-e4d256-prod-github-runner-207 kernel: [45024.577731] ? show_regs.part.0+0x23/0x29 Aug 22 17:54:10 juju-e4d256-prod-github-runner-207 kernel: [45024.578728] ? show_regs.cold+0x8/0xd Aug 22 17:54:10 juju-e4d256-prod-github-runner-207 kernel: [45024.579703] ? watchdog_timer_fn+0x1be/0x220 Aug 22 17:54:10 juju-e4d256-prod-github-runner-207 kernel: [45024.580724] ? lockup_detector_update_enable+0x60/0x60 Aug 22 17:54:10 juju-e4d256-prod-github-runner-207 kernel: [45024.581789] ? __hrtimer_run_queues+0x107/0x230 Aug 22 17:54:10 juju-e4d256-prod-github-runner-207 kernel: [45024.582822] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 17:54:10 juju-e4d256-prod-github-runner-207 kernel: [45024.583846] ? hrtimer_interrupt+0x101/0x220 Aug 22 17:54:10 juju-e4d256-prod-github-runner-207 kernel: [45024.584874] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 17:54:10 juju-e4d256-prod-github-runner-207 kernel: [45024.585951] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 17:54:10 juju-e4d256-prod-github-runner-207 kernel: [45024.587003] Aug 22 17:54:10 juju-e4d256-prod-github-runner-207 kernel: [45024.587858] Aug 22 17:54:10 juju-e4d256-prod-github-runner-207 kernel: [45024.588709] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 17:54:10 juju-e4d256-prod-github-runner-207 kernel: [45024.589750] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:54:10 juju-e4d256-prod-github-runner-207 kernel: [45024.590791] ? _raw_spin_lock+0x22/0x30 Aug 22 17:54:10 juju-e4d256-prod-github-runner-207 kernel: [45024.591742] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:54:10 juju-e4d256-prod-github-runner-207 kernel: [45024.592778] direct_page_fault+0x206/0x310 [kvm] Aug 22 17:54:10 juju-e4d256-prod-github-runner-207 kernel: [45024.593804] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 17:54:10 juju-e4d256-prod-github-runner-207 kernel: [45024.594814] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 17:54:10 juju-e4d256-prod-github-runner-207 kernel: [45024.595822] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 17:54:10 juju-e4d256-prod-github-runner-207 kernel: [45024.596853] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 17:54:10 juju-e4d256-prod-github-runner-207 kernel: [45024.597806] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 17:54:10 juju-e4d256-prod-github-runner-207 kernel: [45024.598792] handle_exit+0x98/0x230 [kvm_amd] Aug 22 17:54:10 juju-e4d256-prod-github-runner-207 kernel: [45024.599691] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 17:54:10 juju-e4d256-prod-github-runner-207 kernel: [45024.600626] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 17:54:10 juju-e4d256-prod-github-runner-207 kernel: [45024.601556] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 17:54:10 juju-e4d256-prod-github-runner-207 kernel: [45024.602462] vcpu_run+0x62/0x2c0 [kvm] Aug 22 17:54:10 juju-e4d256-prod-github-runner-207 kernel: [45024.603278] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 17:54:10 juju-e4d256-prod-github-runner-207 kernel: [45024.604086] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 17:54:10 juju-e4d256-prod-github-runner-207 kernel: [45024.604970] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 17:54:10 juju-e4d256-prod-github-runner-207 kernel: [45024.605770] ? __seccomp_filter+0x4a/0x4a0 Aug 22 17:54:10 juju-e4d256-prod-github-runner-207 kernel: [45024.606515] ? __fget_files+0x86/0xc0 Aug 22 17:54:10 juju-e4d256-prod-github-runner-207 kernel: [45024.607218] __x64_sys_ioctl+0x95/0xd0 Aug 22 17:54:10 juju-e4d256-prod-github-runner-207 kernel: [45024.607910] do_syscall_64+0x5c/0xc0 Aug 22 17:54:10 juju-e4d256-prod-github-runner-207 kernel: [45024.608588] ? do_futex+0x162/0x1f0 Aug 22 17:54:10 juju-e4d256-prod-github-runner-207 kernel: [45024.609239] ? __x64_sys_futex+0x78/0x1e0 Aug 22 17:54:10 juju-e4d256-prod-github-runner-207 kernel: [45024.609913] ? __secure_computing+0xa9/0x120 Aug 22 17:54:10 juju-e4d256-prod-github-runner-207 kernel: [45024.610604] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 17:54:10 juju-e4d256-prod-github-runner-207 kernel: [45024.611708] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:54:10 juju-e4d256-prod-github-runner-207 kernel: [45024.612559] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:54:10 juju-e4d256-prod-github-runner-207 kernel: [45024.613377] ? do_syscall_64+0x69/0xc0 Aug 22 17:54:10 juju-e4d256-prod-github-runner-207 kernel: [45024.614099] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:54:10 juju-e4d256-prod-github-runner-207 kernel: [45024.614911] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:54:10 juju-e4d256-prod-github-runner-207 kernel: [45024.615704] ? do_syscall_64+0x69/0xc0 Aug 22 17:54:10 juju-e4d256-prod-github-runner-207 kernel: [45024.616424] ? do_syscall_64+0x69/0xc0 Aug 22 17:54:10 juju-e4d256-prod-github-runner-207 kernel: [45024.617130] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 17:54:10 juju-e4d256-prod-github-runner-207 kernel: [45024.617939] RIP: 0033:0x7faa5d0edaff Aug 22 17:54:10 juju-e4d256-prod-github-runner-207 kernel: [45024.618669] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 17:54:10 juju-e4d256-prod-github-runner-207 kernel: [45024.621027] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 17:54:10 juju-e4d256-prod-github-runner-207 kernel: [45024.622088] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 17:54:10 juju-e4d256-prod-github-runner-207 kernel: [45024.623127] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 17:54:10 juju-e4d256-prod-github-runner-207 kernel: [45024.624155] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 17:54:10 juju-e4d256-prod-github-runner-207 kernel: [45024.625203] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 17:54:10 juju-e4d256-prod-github-runner-207 kernel: [45024.626232] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 17:54:10 juju-e4d256-prod-github-runner-207 kernel: [45024.627263] Aug 22 17:54:38 juju-e4d256-prod-github-runner-207 kernel: [45052.541982] watchdog: BUG: soft lockup - CPU#1 stuck for 41850s! [qemu-system-x86:6715] Aug 22 17:54:38 juju-e4d256-prod-github-runner-207 kernel: [45052.543120] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 17:54:38 juju-e4d256-prod-github-runner-207 kernel: [45052.543194] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 17:54:38 juju-e4d256-prod-github-runner-207 kernel: [45052.555263] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 17:54:38 juju-e4d256-prod-github-runner-207 kernel: [45052.556536] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 17:54:38 juju-e4d256-prod-github-runner-207 kernel: [45052.557770] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:54:38 juju-e4d256-prod-github-runner-207 kernel: [45052.558835] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 17:54:38 juju-e4d256-prod-github-runner-207 kernel: [45052.561394] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 17:54:38 juju-e4d256-prod-github-runner-207 kernel: [45052.562442] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 17:54:38 juju-e4d256-prod-github-runner-207 kernel: [45052.563608] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 17:54:38 juju-e4d256-prod-github-runner-207 kernel: [45052.564775] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 17:54:38 juju-e4d256-prod-github-runner-207 kernel: [45052.565938] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 17:54:38 juju-e4d256-prod-github-runner-207 kernel: [45052.567116] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 17:54:38 juju-e4d256-prod-github-runner-207 kernel: [45052.568308] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 17:54:38 juju-e4d256-prod-github-runner-207 kernel: [45052.569538] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 17:54:38 juju-e4d256-prod-github-runner-207 kernel: [45052.570637] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 17:54:38 juju-e4d256-prod-github-runner-207 kernel: [45052.571827] Call Trace: Aug 22 17:54:38 juju-e4d256-prod-github-runner-207 kernel: [45052.572744] Aug 22 17:54:38 juju-e4d256-prod-github-runner-207 kernel: [45052.573632] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:54:38 juju-e4d256-prod-github-runner-207 kernel: [45052.574664] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:54:38 juju-e4d256-prod-github-runner-207 kernel: [45052.575682] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:54:38 juju-e4d256-prod-github-runner-207 kernel: [45052.576768] ? show_regs.part.0+0x23/0x29 Aug 22 17:54:38 juju-e4d256-prod-github-runner-207 kernel: [45052.577762] ? show_regs.cold+0x8/0xd Aug 22 17:54:38 juju-e4d256-prod-github-runner-207 kernel: [45052.578730] ? watchdog_timer_fn+0x1be/0x220 Aug 22 17:54:38 juju-e4d256-prod-github-runner-207 kernel: [45052.579733] ? lockup_detector_update_enable+0x60/0x60 Aug 22 17:54:38 juju-e4d256-prod-github-runner-207 kernel: [45052.580797] ? __hrtimer_run_queues+0x107/0x230 Aug 22 17:54:38 juju-e4d256-prod-github-runner-207 kernel: [45052.581826] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 17:54:38 juju-e4d256-prod-github-runner-207 kernel: [45052.582852] ? hrtimer_interrupt+0x101/0x220 Aug 22 17:54:38 juju-e4d256-prod-github-runner-207 kernel: [45052.583863] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 17:54:38 juju-e4d256-prod-github-runner-207 kernel: [45052.584939] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 17:54:38 juju-e4d256-prod-github-runner-207 kernel: [45052.585984] Aug 22 17:54:38 juju-e4d256-prod-github-runner-207 kernel: [45052.586834] Aug 22 17:54:38 juju-e4d256-prod-github-runner-207 kernel: [45052.587670] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 17:54:38 juju-e4d256-prod-github-runner-207 kernel: [45052.588713] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:54:38 juju-e4d256-prod-github-runner-207 kernel: [45052.589754] ? _raw_spin_lock+0x22/0x30 Aug 22 17:54:38 juju-e4d256-prod-github-runner-207 kernel: [45052.590696] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:54:38 juju-e4d256-prod-github-runner-207 kernel: [45052.591713] direct_page_fault+0x206/0x310 [kvm] Aug 22 17:54:38 juju-e4d256-prod-github-runner-207 kernel: [45052.592747] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 17:54:38 juju-e4d256-prod-github-runner-207 kernel: [45052.593758] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 17:54:38 juju-e4d256-prod-github-runner-207 kernel: [45052.594759] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 17:54:38 juju-e4d256-prod-github-runner-207 kernel: [45052.595729] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 17:54:38 juju-e4d256-prod-github-runner-207 kernel: [45052.596688] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 17:54:38 juju-e4d256-prod-github-runner-207 kernel: [45052.597680] handle_exit+0x98/0x230 [kvm_amd] Aug 22 17:54:38 juju-e4d256-prod-github-runner-207 kernel: [45052.598570] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 17:54:38 juju-e4d256-prod-github-runner-207 kernel: [45052.599481] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 17:54:38 juju-e4d256-prod-github-runner-207 kernel: [45052.600410] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 17:54:38 juju-e4d256-prod-github-runner-207 kernel: [45052.601318] vcpu_run+0x62/0x2c0 [kvm] Aug 22 17:54:38 juju-e4d256-prod-github-runner-207 kernel: [45052.602131] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 17:54:38 juju-e4d256-prod-github-runner-207 kernel: [45052.602938] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 17:54:38 juju-e4d256-prod-github-runner-207 kernel: [45052.603787] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 17:54:38 juju-e4d256-prod-github-runner-207 kernel: [45052.604593] ? __seccomp_filter+0x4a/0x4a0 Aug 22 17:54:38 juju-e4d256-prod-github-runner-207 kernel: [45052.605334] ? __fget_files+0x86/0xc0 Aug 22 17:54:38 juju-e4d256-prod-github-runner-207 kernel: [45052.606039] __x64_sys_ioctl+0x95/0xd0 Aug 22 17:54:38 juju-e4d256-prod-github-runner-207 kernel: [45052.606728] do_syscall_64+0x5c/0xc0 Aug 22 17:54:38 juju-e4d256-prod-github-runner-207 kernel: [45052.607388] ? do_futex+0x162/0x1f0 Aug 22 17:54:38 juju-e4d256-prod-github-runner-207 kernel: [45052.608041] ? __x64_sys_futex+0x78/0x1e0 Aug 22 17:54:38 juju-e4d256-prod-github-runner-207 kernel: [45052.608712] ? __secure_computing+0xa9/0x120 Aug 22 17:54:38 juju-e4d256-prod-github-runner-207 kernel: [45052.609401] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 17:54:38 juju-e4d256-prod-github-runner-207 kernel: [45052.610158] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:54:38 juju-e4d256-prod-github-runner-207 kernel: [45052.610875] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:54:38 juju-e4d256-prod-github-runner-207 kernel: [45052.611594] ? do_syscall_64+0x69/0xc0 Aug 22 17:54:38 juju-e4d256-prod-github-runner-207 kernel: [45052.612247] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:54:38 juju-e4d256-prod-github-runner-207 kernel: [45052.612951] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:54:38 juju-e4d256-prod-github-runner-207 kernel: [45052.613642] ? do_syscall_64+0x69/0xc0 Aug 22 17:54:38 juju-e4d256-prod-github-runner-207 kernel: [45052.614264] ? do_syscall_64+0x69/0xc0 Aug 22 17:54:38 juju-e4d256-prod-github-runner-207 kernel: [45052.614882] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 17:54:38 juju-e4d256-prod-github-runner-207 kernel: [45052.615582] RIP: 0033:0x7faa5d0edaff Aug 22 17:54:38 juju-e4d256-prod-github-runner-207 kernel: [45052.616228] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 17:54:38 juju-e4d256-prod-github-runner-207 kernel: [45052.618217] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 17:54:38 juju-e4d256-prod-github-runner-207 kernel: [45052.619205] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 17:54:38 juju-e4d256-prod-github-runner-207 kernel: [45052.620106] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 17:54:38 juju-e4d256-prod-github-runner-207 kernel: [45052.620992] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 17:54:38 juju-e4d256-prod-github-runner-207 kernel: [45052.621877] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 17:54:38 juju-e4d256-prod-github-runner-207 kernel: [45052.622761] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 17:54:38 juju-e4d256-prod-github-runner-207 kernel: [45052.623653] Aug 22 17:55:06 juju-e4d256-prod-github-runner-207 kernel: [45080.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 41876s! [qemu-system-x86:6715] Aug 22 17:55:06 juju-e4d256-prod-github-runner-207 kernel: [45080.543096] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 17:55:06 juju-e4d256-prod-github-runner-207 kernel: [45080.543175] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 17:55:06 juju-e4d256-prod-github-runner-207 kernel: [45080.555290] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 17:55:06 juju-e4d256-prod-github-runner-207 kernel: [45080.556601] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 17:55:06 juju-e4d256-prod-github-runner-207 kernel: [45080.557844] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:55:06 juju-e4d256-prod-github-runner-207 kernel: [45080.558900] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 17:55:06 juju-e4d256-prod-github-runner-207 kernel: [45080.561476] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 17:55:06 juju-e4d256-prod-github-runner-207 kernel: [45080.562524] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 17:55:06 juju-e4d256-prod-github-runner-207 kernel: [45080.563717] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 17:55:06 juju-e4d256-prod-github-runner-207 kernel: [45080.564888] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 17:55:06 juju-e4d256-prod-github-runner-207 kernel: [45080.566047] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 17:55:06 juju-e4d256-prod-github-runner-207 kernel: [45080.567206] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 17:55:06 juju-e4d256-prod-github-runner-207 kernel: [45080.568389] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 17:55:06 juju-e4d256-prod-github-runner-207 kernel: [45080.569637] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 17:55:06 juju-e4d256-prod-github-runner-207 kernel: [45080.570739] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 17:55:06 juju-e4d256-prod-github-runner-207 kernel: [45080.571953] Call Trace: Aug 22 17:55:06 juju-e4d256-prod-github-runner-207 kernel: [45080.572874] Aug 22 17:55:06 juju-e4d256-prod-github-runner-207 kernel: [45080.573757] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:55:06 juju-e4d256-prod-github-runner-207 kernel: [45080.574877] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:55:06 juju-e4d256-prod-github-runner-207 kernel: [45080.575941] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:55:06 juju-e4d256-prod-github-runner-207 kernel: [45080.577157] ? show_regs.part.0+0x23/0x29 Aug 22 17:55:06 juju-e4d256-prod-github-runner-207 kernel: [45080.578155] ? show_regs.cold+0x8/0xd Aug 22 17:55:06 juju-e4d256-prod-github-runner-207 kernel: [45080.579157] ? watchdog_timer_fn+0x1be/0x220 Aug 22 17:55:06 juju-e4d256-prod-github-runner-207 kernel: [45080.580299] ? lockup_detector_update_enable+0x60/0x60 Aug 22 17:55:06 juju-e4d256-prod-github-runner-207 kernel: [45080.581376] ? __hrtimer_run_queues+0x107/0x230 Aug 22 17:55:06 juju-e4d256-prod-github-runner-207 kernel: [45080.582405] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 17:55:06 juju-e4d256-prod-github-runner-207 kernel: [45080.583430] ? hrtimer_interrupt+0x101/0x220 Aug 22 17:55:06 juju-e4d256-prod-github-runner-207 kernel: [45080.584474] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 17:55:06 juju-e4d256-prod-github-runner-207 kernel: [45080.585555] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 17:55:06 juju-e4d256-prod-github-runner-207 kernel: [45080.586614] Aug 22 17:55:06 juju-e4d256-prod-github-runner-207 kernel: [45080.587470] Aug 22 17:55:06 juju-e4d256-prod-github-runner-207 kernel: [45080.588334] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 17:55:06 juju-e4d256-prod-github-runner-207 kernel: [45080.589384] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:55:06 juju-e4d256-prod-github-runner-207 kernel: [45080.590434] ? _raw_spin_lock+0x22/0x30 Aug 22 17:55:06 juju-e4d256-prod-github-runner-207 kernel: [45080.591387] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:55:06 juju-e4d256-prod-github-runner-207 kernel: [45080.592426] direct_page_fault+0x206/0x310 [kvm] Aug 22 17:55:06 juju-e4d256-prod-github-runner-207 kernel: [45080.593454] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 17:55:06 juju-e4d256-prod-github-runner-207 kernel: [45080.594645] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 17:55:06 juju-e4d256-prod-github-runner-207 kernel: [45080.595890] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 17:55:06 juju-e4d256-prod-github-runner-207 kernel: [45080.596899] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 17:55:06 juju-e4d256-prod-github-runner-207 kernel: [45080.597855] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 17:55:06 juju-e4d256-prod-github-runner-207 kernel: [45080.598833] handle_exit+0x98/0x230 [kvm_amd] Aug 22 17:55:06 juju-e4d256-prod-github-runner-207 kernel: [45080.599747] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 17:55:06 juju-e4d256-prod-github-runner-207 kernel: [45080.600670] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 17:55:06 juju-e4d256-prod-github-runner-207 kernel: [45080.601602] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 17:55:06 juju-e4d256-prod-github-runner-207 kernel: [45080.602514] vcpu_run+0x62/0x2c0 [kvm] Aug 22 17:55:06 juju-e4d256-prod-github-runner-207 kernel: [45080.603332] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 17:55:06 juju-e4d256-prod-github-runner-207 kernel: [45080.604161] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 17:55:06 juju-e4d256-prod-github-runner-207 kernel: [45080.605024] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 17:55:06 juju-e4d256-prod-github-runner-207 kernel: [45080.605825] ? __seccomp_filter+0x4a/0x4a0 Aug 22 17:55:06 juju-e4d256-prod-github-runner-207 kernel: [45080.606765] ? __fget_files+0x86/0xc0 Aug 22 17:55:06 juju-e4d256-prod-github-runner-207 kernel: [45080.607473] __x64_sys_ioctl+0x95/0xd0 Aug 22 17:55:06 juju-e4d256-prod-github-runner-207 kernel: [45080.608180] do_syscall_64+0x5c/0xc0 Aug 22 17:55:06 juju-e4d256-prod-github-runner-207 kernel: [45080.608862] ? do_futex+0x162/0x1f0 Aug 22 17:55:06 juju-e4d256-prod-github-runner-207 kernel: [45080.609520] ? __x64_sys_futex+0x78/0x1e0 Aug 22 17:55:06 juju-e4d256-prod-github-runner-207 kernel: [45080.610193] ? __secure_computing+0xa9/0x120 Aug 22 17:55:06 juju-e4d256-prod-github-runner-207 kernel: [45080.610897] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 17:55:06 juju-e4d256-prod-github-runner-207 kernel: [45080.611662] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:55:06 juju-e4d256-prod-github-runner-207 kernel: [45080.612412] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:55:06 juju-e4d256-prod-github-runner-207 kernel: [45080.613140] ? do_syscall_64+0x69/0xc0 Aug 22 17:55:06 juju-e4d256-prod-github-runner-207 kernel: [45080.613791] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:55:06 juju-e4d256-prod-github-runner-207 kernel: [45080.614494] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:55:06 juju-e4d256-prod-github-runner-207 kernel: [45080.615193] ? do_syscall_64+0x69/0xc0 Aug 22 17:55:06 juju-e4d256-prod-github-runner-207 kernel: [45080.615861] ? do_syscall_64+0x69/0xc0 Aug 22 17:55:06 juju-e4d256-prod-github-runner-207 kernel: [45080.616631] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 17:55:06 juju-e4d256-prod-github-runner-207 kernel: [45080.617433] RIP: 0033:0x7faa5d0edaff Aug 22 17:55:06 juju-e4d256-prod-github-runner-207 kernel: [45080.618059] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 17:55:06 juju-e4d256-prod-github-runner-207 kernel: [45080.620059] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 17:55:06 juju-e4d256-prod-github-runner-207 kernel: [45080.620983] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 17:55:06 juju-e4d256-prod-github-runner-207 kernel: [45080.621875] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 17:55:06 juju-e4d256-prod-github-runner-207 kernel: [45080.622763] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 17:55:06 juju-e4d256-prod-github-runner-207 kernel: [45080.623653] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 17:55:06 juju-e4d256-prod-github-runner-207 kernel: [45080.624551] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 17:55:06 juju-e4d256-prod-github-runner-207 kernel: [45080.625442] Aug 22 17:55:34 juju-e4d256-prod-github-runner-207 kernel: [45108.541981] watchdog: BUG: soft lockup - CPU#1 stuck for 41902s! [qemu-system-x86:6715] Aug 22 17:55:34 juju-e4d256-prod-github-runner-207 kernel: [45108.543178] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 17:55:34 juju-e4d256-prod-github-runner-207 kernel: [45108.543321] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 17:55:34 juju-e4d256-prod-github-runner-207 kernel: [45108.555598] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 17:55:34 juju-e4d256-prod-github-runner-207 kernel: [45108.556873] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 17:55:34 juju-e4d256-prod-github-runner-207 kernel: [45108.558091] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:55:34 juju-e4d256-prod-github-runner-207 kernel: [45108.559144] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 17:55:34 juju-e4d256-prod-github-runner-207 kernel: [45108.561711] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 17:55:34 juju-e4d256-prod-github-runner-207 kernel: [45108.562753] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 17:55:34 juju-e4d256-prod-github-runner-207 kernel: [45108.563929] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 17:55:34 juju-e4d256-prod-github-runner-207 kernel: [45108.565084] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 17:55:34 juju-e4d256-prod-github-runner-207 kernel: [45108.566252] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 17:55:34 juju-e4d256-prod-github-runner-207 kernel: [45108.567423] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 17:55:34 juju-e4d256-prod-github-runner-207 kernel: [45108.568587] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 17:55:34 juju-e4d256-prod-github-runner-207 kernel: [45108.569823] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 17:55:34 juju-e4d256-prod-github-runner-207 kernel: [45108.570917] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 17:55:34 juju-e4d256-prod-github-runner-207 kernel: [45108.572132] Call Trace: Aug 22 17:55:34 juju-e4d256-prod-github-runner-207 kernel: [45108.573058] Aug 22 17:55:34 juju-e4d256-prod-github-runner-207 kernel: [45108.573941] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:55:34 juju-e4d256-prod-github-runner-207 kernel: [45108.574968] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:55:34 juju-e4d256-prod-github-runner-207 kernel: [45108.576011] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:55:34 juju-e4d256-prod-github-runner-207 kernel: [45108.577106] ? show_regs.part.0+0x23/0x29 Aug 22 17:55:34 juju-e4d256-prod-github-runner-207 kernel: [45108.578101] ? show_regs.cold+0x8/0xd Aug 22 17:55:34 juju-e4d256-prod-github-runner-207 kernel: [45108.579075] ? watchdog_timer_fn+0x1be/0x220 Aug 22 17:55:34 juju-e4d256-prod-github-runner-207 kernel: [45108.580099] ? lockup_detector_update_enable+0x60/0x60 Aug 22 17:55:34 juju-e4d256-prod-github-runner-207 kernel: [45108.581161] ? __hrtimer_run_queues+0x107/0x230 Aug 22 17:55:34 juju-e4d256-prod-github-runner-207 kernel: [45108.582189] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 17:55:34 juju-e4d256-prod-github-runner-207 kernel: [45108.583216] ? hrtimer_interrupt+0x101/0x220 Aug 22 17:55:34 juju-e4d256-prod-github-runner-207 kernel: [45108.584354] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 17:55:34 juju-e4d256-prod-github-runner-207 kernel: [45108.585442] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 17:55:34 juju-e4d256-prod-github-runner-207 kernel: [45108.586488] Aug 22 17:55:34 juju-e4d256-prod-github-runner-207 kernel: [45108.587341] Aug 22 17:55:34 juju-e4d256-prod-github-runner-207 kernel: [45108.588189] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 17:55:34 juju-e4d256-prod-github-runner-207 kernel: [45108.589221] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:55:34 juju-e4d256-prod-github-runner-207 kernel: [45108.590259] ? _raw_spin_lock+0x22/0x30 Aug 22 17:55:34 juju-e4d256-prod-github-runner-207 kernel: [45108.591202] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:55:34 juju-e4d256-prod-github-runner-207 kernel: [45108.592236] direct_page_fault+0x206/0x310 [kvm] Aug 22 17:55:34 juju-e4d256-prod-github-runner-207 kernel: [45108.593261] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 17:55:34 juju-e4d256-prod-github-runner-207 kernel: [45108.594269] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 17:55:34 juju-e4d256-prod-github-runner-207 kernel: [45108.595274] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 17:55:34 juju-e4d256-prod-github-runner-207 kernel: [45108.596272] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 17:55:34 juju-e4d256-prod-github-runner-207 kernel: [45108.597219] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 17:55:34 juju-e4d256-prod-github-runner-207 kernel: [45108.598208] handle_exit+0x98/0x230 [kvm_amd] Aug 22 17:55:34 juju-e4d256-prod-github-runner-207 kernel: [45108.599099] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 17:55:34 juju-e4d256-prod-github-runner-207 kernel: [45108.600021] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 17:55:34 juju-e4d256-prod-github-runner-207 kernel: [45108.600944] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 17:55:34 juju-e4d256-prod-github-runner-207 kernel: [45108.601847] vcpu_run+0x62/0x2c0 [kvm] Aug 22 17:55:34 juju-e4d256-prod-github-runner-207 kernel: [45108.602753] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 17:55:34 juju-e4d256-prod-github-runner-207 kernel: [45108.603662] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 17:55:34 juju-e4d256-prod-github-runner-207 kernel: [45108.604617] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 17:55:34 juju-e4d256-prod-github-runner-207 kernel: [45108.605503] ? __seccomp_filter+0x4a/0x4a0 Aug 22 17:55:34 juju-e4d256-prod-github-runner-207 kernel: [45108.606327] ? __fget_files+0x86/0xc0 Aug 22 17:55:34 juju-e4d256-prod-github-runner-207 kernel: [45108.607104] __x64_sys_ioctl+0x95/0xd0 Aug 22 17:55:34 juju-e4d256-prod-github-runner-207 kernel: [45108.607887] do_syscall_64+0x5c/0xc0 Aug 22 17:55:34 juju-e4d256-prod-github-runner-207 kernel: [45108.608635] ? do_futex+0x162/0x1f0 Aug 22 17:55:34 juju-e4d256-prod-github-runner-207 kernel: [45108.609355] ? __x64_sys_futex+0x78/0x1e0 Aug 22 17:55:34 juju-e4d256-prod-github-runner-207 kernel: [45108.610106] ? __secure_computing+0xa9/0x120 Aug 22 17:55:34 juju-e4d256-prod-github-runner-207 kernel: [45108.610878] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 17:55:34 juju-e4d256-prod-github-runner-207 kernel: [45108.611757] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:55:34 juju-e4d256-prod-github-runner-207 kernel: [45108.612584] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:55:34 juju-e4d256-prod-github-runner-207 kernel: [45108.613403] ? do_syscall_64+0x69/0xc0 Aug 22 17:55:34 juju-e4d256-prod-github-runner-207 kernel: [45108.614160] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:55:34 juju-e4d256-prod-github-runner-207 kernel: [45108.614995] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:55:34 juju-e4d256-prod-github-runner-207 kernel: [45108.615803] ? do_syscall_64+0x69/0xc0 Aug 22 17:55:34 juju-e4d256-prod-github-runner-207 kernel: [45108.616499] ? do_syscall_64+0x69/0xc0 Aug 22 17:55:34 juju-e4d256-prod-github-runner-207 kernel: [45108.617199] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 17:55:34 juju-e4d256-prod-github-runner-207 kernel: [45108.618001] RIP: 0033:0x7faa5d0edaff Aug 22 17:55:34 juju-e4d256-prod-github-runner-207 kernel: [45108.618698] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 17:55:34 juju-e4d256-prod-github-runner-207 kernel: [45108.621020] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 17:55:34 juju-e4d256-prod-github-runner-207 kernel: [45108.622074] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 17:55:34 juju-e4d256-prod-github-runner-207 kernel: [45108.623103] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 17:55:34 juju-e4d256-prod-github-runner-207 kernel: [45108.624134] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 17:55:34 juju-e4d256-prod-github-runner-207 kernel: [45108.625149] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 17:55:34 juju-e4d256-prod-github-runner-207 kernel: [45108.626171] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 17:55:34 juju-e4d256-prod-github-runner-207 kernel: [45108.627190] Aug 22 17:56:02 juju-e4d256-prod-github-runner-207 kernel: [45136.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 41928s! [qemu-system-x86:6715] Aug 22 17:56:02 juju-e4d256-prod-github-runner-207 kernel: [45136.543766] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 17:56:02 juju-e4d256-prod-github-runner-207 kernel: [45136.544027] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 17:56:02 juju-e4d256-prod-github-runner-207 kernel: [45136.556113] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 17:56:02 juju-e4d256-prod-github-runner-207 kernel: [45136.557379] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 17:56:02 juju-e4d256-prod-github-runner-207 kernel: [45136.558599] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:56:02 juju-e4d256-prod-github-runner-207 kernel: [45136.559668] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 17:56:02 juju-e4d256-prod-github-runner-207 kernel: [45136.562215] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 17:56:02 juju-e4d256-prod-github-runner-207 kernel: [45136.563272] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 17:56:02 juju-e4d256-prod-github-runner-207 kernel: [45136.564434] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 17:56:02 juju-e4d256-prod-github-runner-207 kernel: [45136.565634] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 17:56:02 juju-e4d256-prod-github-runner-207 kernel: [45136.566797] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 17:56:02 juju-e4d256-prod-github-runner-207 kernel: [45136.567976] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 17:56:02 juju-e4d256-prod-github-runner-207 kernel: [45136.569147] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 17:56:02 juju-e4d256-prod-github-runner-207 kernel: [45136.570379] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 17:56:02 juju-e4d256-prod-github-runner-207 kernel: [45136.571485] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 17:56:02 juju-e4d256-prod-github-runner-207 kernel: [45136.572683] Call Trace: Aug 22 17:56:02 juju-e4d256-prod-github-runner-207 kernel: [45136.573595] Aug 22 17:56:02 juju-e4d256-prod-github-runner-207 kernel: [45136.574500] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:56:02 juju-e4d256-prod-github-runner-207 kernel: [45136.575539] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:56:02 juju-e4d256-prod-github-runner-207 kernel: [45136.576562] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:56:02 juju-e4d256-prod-github-runner-207 kernel: [45136.577666] ? show_regs.part.0+0x23/0x29 Aug 22 17:56:02 juju-e4d256-prod-github-runner-207 kernel: [45136.578665] ? show_regs.cold+0x8/0xd Aug 22 17:56:02 juju-e4d256-prod-github-runner-207 kernel: [45136.579656] ? watchdog_timer_fn+0x1be/0x220 Aug 22 17:56:02 juju-e4d256-prod-github-runner-207 kernel: [45136.580666] ? lockup_detector_update_enable+0x60/0x60 Aug 22 17:56:02 juju-e4d256-prod-github-runner-207 kernel: [45136.581731] ? __hrtimer_run_queues+0x107/0x230 Aug 22 17:56:02 juju-e4d256-prod-github-runner-207 kernel: [45136.582756] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 17:56:02 juju-e4d256-prod-github-runner-207 kernel: [45136.583788] ? hrtimer_interrupt+0x101/0x220 Aug 22 17:56:02 juju-e4d256-prod-github-runner-207 kernel: [45136.584807] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 17:56:02 juju-e4d256-prod-github-runner-207 kernel: [45136.585874] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 17:56:02 juju-e4d256-prod-github-runner-207 kernel: [45136.586918] Aug 22 17:56:02 juju-e4d256-prod-github-runner-207 kernel: [45136.587792] Aug 22 17:56:02 juju-e4d256-prod-github-runner-207 kernel: [45136.588628] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 17:56:02 juju-e4d256-prod-github-runner-207 kernel: [45136.589662] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:56:02 juju-e4d256-prod-github-runner-207 kernel: [45136.590701] ? _raw_spin_lock+0x22/0x30 Aug 22 17:56:02 juju-e4d256-prod-github-runner-207 kernel: [45136.591663] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:56:02 juju-e4d256-prod-github-runner-207 kernel: [45136.592684] direct_page_fault+0x206/0x310 [kvm] Aug 22 17:56:02 juju-e4d256-prod-github-runner-207 kernel: [45136.593708] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 17:56:02 juju-e4d256-prod-github-runner-207 kernel: [45136.594752] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 17:56:02 juju-e4d256-prod-github-runner-207 kernel: [45136.595779] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 17:56:02 juju-e4d256-prod-github-runner-207 kernel: [45136.596792] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 17:56:02 juju-e4d256-prod-github-runner-207 kernel: [45136.597741] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 17:56:02 juju-e4d256-prod-github-runner-207 kernel: [45136.598719] handle_exit+0x98/0x230 [kvm_amd] Aug 22 17:56:02 juju-e4d256-prod-github-runner-207 kernel: [45136.599621] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 17:56:02 juju-e4d256-prod-github-runner-207 kernel: [45136.600537] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 17:56:02 juju-e4d256-prod-github-runner-207 kernel: [45136.601465] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 17:56:02 juju-e4d256-prod-github-runner-207 kernel: [45136.602370] vcpu_run+0x62/0x2c0 [kvm] Aug 22 17:56:02 juju-e4d256-prod-github-runner-207 kernel: [45136.603196] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 17:56:02 juju-e4d256-prod-github-runner-207 kernel: [45136.604005] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 17:56:02 juju-e4d256-prod-github-runner-207 kernel: [45136.604860] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 17:56:02 juju-e4d256-prod-github-runner-207 kernel: [45136.605659] ? __seccomp_filter+0x4a/0x4a0 Aug 22 17:56:02 juju-e4d256-prod-github-runner-207 kernel: [45136.606402] ? __fget_files+0x86/0xc0 Aug 22 17:56:02 juju-e4d256-prod-github-runner-207 kernel: [45136.607124] __x64_sys_ioctl+0x95/0xd0 Aug 22 17:56:02 juju-e4d256-prod-github-runner-207 kernel: [45136.607821] do_syscall_64+0x5c/0xc0 Aug 22 17:56:02 juju-e4d256-prod-github-runner-207 kernel: [45136.608488] ? do_futex+0x162/0x1f0 Aug 22 17:56:02 juju-e4d256-prod-github-runner-207 kernel: [45136.609137] ? __x64_sys_futex+0x78/0x1e0 Aug 22 17:56:02 juju-e4d256-prod-github-runner-207 kernel: [45136.609812] ? __secure_computing+0xa9/0x120 Aug 22 17:56:02 juju-e4d256-prod-github-runner-207 kernel: [45136.610506] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 17:56:02 juju-e4d256-prod-github-runner-207 kernel: [45136.611275] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:56:02 juju-e4d256-prod-github-runner-207 kernel: [45136.611999] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:56:02 juju-e4d256-prod-github-runner-207 kernel: [45136.612725] ? do_syscall_64+0x69/0xc0 Aug 22 17:56:02 juju-e4d256-prod-github-runner-207 kernel: [45136.613372] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:56:02 juju-e4d256-prod-github-runner-207 kernel: [45136.614077] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:56:02 juju-e4d256-prod-github-runner-207 kernel: [45136.614775] ? do_syscall_64+0x69/0xc0 Aug 22 17:56:02 juju-e4d256-prod-github-runner-207 kernel: [45136.615409] ? do_syscall_64+0x69/0xc0 Aug 22 17:56:02 juju-e4d256-prod-github-runner-207 kernel: [45136.616039] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 17:56:02 juju-e4d256-prod-github-runner-207 kernel: [45136.616746] RIP: 0033:0x7faa5d0edaff Aug 22 17:56:02 juju-e4d256-prod-github-runner-207 kernel: [45136.617416] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 17:56:02 juju-e4d256-prod-github-runner-207 kernel: [45136.619420] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 17:56:02 juju-e4d256-prod-github-runner-207 kernel: [45136.620406] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 17:56:02 juju-e4d256-prod-github-runner-207 kernel: [45136.621302] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 17:56:02 juju-e4d256-prod-github-runner-207 kernel: [45136.622193] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 17:56:02 juju-e4d256-prod-github-runner-207 kernel: [45136.623099] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 17:56:02 juju-e4d256-prod-github-runner-207 kernel: [45136.623991] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 17:56:02 juju-e4d256-prod-github-runner-207 kernel: [45136.624910] Aug 22 17:56:30 juju-e4d256-prod-github-runner-207 kernel: [45164.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 41954s! [qemu-system-x86:6715] Aug 22 17:56:30 juju-e4d256-prod-github-runner-207 kernel: [45164.544023] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 17:56:30 juju-e4d256-prod-github-runner-207 kernel: [45164.544341] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 17:56:30 juju-e4d256-prod-github-runner-207 kernel: [45164.557384] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 17:56:30 juju-e4d256-prod-github-runner-207 kernel: [45164.558956] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 17:56:30 juju-e4d256-prod-github-runner-207 kernel: [45164.560411] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:56:30 juju-e4d256-prod-github-runner-207 kernel: [45164.561670] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 17:56:30 juju-e4d256-prod-github-runner-207 kernel: [45164.564458] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 17:56:30 juju-e4d256-prod-github-runner-207 kernel: [45164.565542] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 17:56:30 juju-e4d256-prod-github-runner-207 kernel: [45164.566747] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 17:56:30 juju-e4d256-prod-github-runner-207 kernel: [45164.567960] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 17:56:30 juju-e4d256-prod-github-runner-207 kernel: [45164.569175] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 17:56:30 juju-e4d256-prod-github-runner-207 kernel: [45164.570351] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 17:56:30 juju-e4d256-prod-github-runner-207 kernel: [45164.571567] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 17:56:30 juju-e4d256-prod-github-runner-207 kernel: [45164.572809] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 17:56:30 juju-e4d256-prod-github-runner-207 kernel: [45164.573932] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 17:56:30 juju-e4d256-prod-github-runner-207 kernel: [45164.575438] Call Trace: Aug 22 17:56:30 juju-e4d256-prod-github-runner-207 kernel: [45164.576524] Aug 22 17:56:30 juju-e4d256-prod-github-runner-207 kernel: [45164.577538] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:56:30 juju-e4d256-prod-github-runner-207 kernel: [45164.578758] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:56:30 juju-e4d256-prod-github-runner-207 kernel: [45164.579942] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:56:30 juju-e4d256-prod-github-runner-207 kernel: [45164.581266] ? show_regs.part.0+0x23/0x29 Aug 22 17:56:30 juju-e4d256-prod-github-runner-207 kernel: [45164.582471] ? show_regs.cold+0x8/0xd Aug 22 17:56:30 juju-e4d256-prod-github-runner-207 kernel: [45164.583620] ? watchdog_timer_fn+0x1be/0x220 Aug 22 17:56:30 juju-e4d256-prod-github-runner-207 kernel: [45164.584807] ? lockup_detector_update_enable+0x60/0x60 Aug 22 17:56:30 juju-e4d256-prod-github-runner-207 kernel: [45164.586123] ? __hrtimer_run_queues+0x107/0x230 Aug 22 17:56:30 juju-e4d256-prod-github-runner-207 kernel: [45164.587316] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 17:56:30 juju-e4d256-prod-github-runner-207 kernel: [45164.588503] ? hrtimer_interrupt+0x101/0x220 Aug 22 17:56:30 juju-e4d256-prod-github-runner-207 kernel: [45164.589687] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 17:56:30 juju-e4d256-prod-github-runner-207 kernel: [45164.590919] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 17:56:30 juju-e4d256-prod-github-runner-207 kernel: [45164.592096] Aug 22 17:56:30 juju-e4d256-prod-github-runner-207 kernel: [45164.593017] Aug 22 17:56:30 juju-e4d256-prod-github-runner-207 kernel: [45164.593917] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 17:56:30 juju-e4d256-prod-github-runner-207 kernel: [45164.595113] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:56:30 juju-e4d256-prod-github-runner-207 kernel: [45164.596337] ? _raw_spin_lock+0x22/0x30 Aug 22 17:56:30 juju-e4d256-prod-github-runner-207 kernel: [45164.597421] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:56:30 juju-e4d256-prod-github-runner-207 kernel: [45164.598547] direct_page_fault+0x206/0x310 [kvm] Aug 22 17:56:30 juju-e4d256-prod-github-runner-207 kernel: [45164.599701] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 17:56:30 juju-e4d256-prod-github-runner-207 kernel: [45164.600807] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 17:56:30 juju-e4d256-prod-github-runner-207 kernel: [45164.601907] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 17:56:30 juju-e4d256-prod-github-runner-207 kernel: [45164.603038] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 17:56:30 juju-e4d256-prod-github-runner-207 kernel: [45164.604103] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 17:56:30 juju-e4d256-prod-github-runner-207 kernel: [45164.605210] handle_exit+0x98/0x230 [kvm_amd] Aug 22 17:56:30 juju-e4d256-prod-github-runner-207 kernel: [45164.606228] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 17:56:30 juju-e4d256-prod-github-runner-207 kernel: [45164.607270] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 17:56:30 juju-e4d256-prod-github-runner-207 kernel: [45164.608305] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 17:56:30 juju-e4d256-prod-github-runner-207 kernel: [45164.609315] vcpu_run+0x62/0x2c0 [kvm] Aug 22 17:56:30 juju-e4d256-prod-github-runner-207 kernel: [45164.610215] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 17:56:30 juju-e4d256-prod-github-runner-207 kernel: [45164.611173] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 17:56:30 juju-e4d256-prod-github-runner-207 kernel: [45164.612357] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 17:56:30 juju-e4d256-prod-github-runner-207 kernel: [45164.613435] ? __seccomp_filter+0x4a/0x4a0 Aug 22 17:56:30 juju-e4d256-prod-github-runner-207 kernel: [45164.614411] ? __fget_files+0x86/0xc0 Aug 22 17:56:30 juju-e4d256-prod-github-runner-207 kernel: [45164.615466] __x64_sys_ioctl+0x95/0xd0 Aug 22 17:56:30 juju-e4d256-prod-github-runner-207 kernel: [45164.616540] do_syscall_64+0x5c/0xc0 Aug 22 17:56:30 juju-e4d256-prod-github-runner-207 kernel: [45164.617558] ? do_futex+0x162/0x1f0 Aug 22 17:56:30 juju-e4d256-prod-github-runner-207 kernel: [45164.618483] ? __x64_sys_futex+0x78/0x1e0 Aug 22 17:56:30 juju-e4d256-prod-github-runner-207 kernel: [45164.619242] ? __secure_computing+0xa9/0x120 Aug 22 17:56:30 juju-e4d256-prod-github-runner-207 kernel: [45164.619947] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 17:56:30 juju-e4d256-prod-github-runner-207 kernel: [45164.620720] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:56:30 juju-e4d256-prod-github-runner-207 kernel: [45164.621459] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:56:30 juju-e4d256-prod-github-runner-207 kernel: [45164.622193] ? do_syscall_64+0x69/0xc0 Aug 22 17:56:30 juju-e4d256-prod-github-runner-207 kernel: [45164.622868] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:56:30 juju-e4d256-prod-github-runner-207 kernel: [45164.623585] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:56:30 juju-e4d256-prod-github-runner-207 kernel: [45164.624285] ? do_syscall_64+0x69/0xc0 Aug 22 17:56:30 juju-e4d256-prod-github-runner-207 kernel: [45164.624938] ? do_syscall_64+0x69/0xc0 Aug 22 17:56:30 juju-e4d256-prod-github-runner-207 kernel: [45164.625576] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 17:56:30 juju-e4d256-prod-github-runner-207 kernel: [45164.626308] RIP: 0033:0x7faa5d0edaff Aug 22 17:56:30 juju-e4d256-prod-github-runner-207 kernel: [45164.627420] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 17:56:30 juju-e4d256-prod-github-runner-207 kernel: [45164.629519] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 17:56:30 juju-e4d256-prod-github-runner-207 kernel: [45164.630475] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 17:56:30 juju-e4d256-prod-github-runner-207 kernel: [45164.631414] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 17:56:30 juju-e4d256-prod-github-runner-207 kernel: [45164.632339] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 17:56:30 juju-e4d256-prod-github-runner-207 kernel: [45164.633234] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 17:56:30 juju-e4d256-prod-github-runner-207 kernel: [45164.634145] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 17:56:30 juju-e4d256-prod-github-runner-207 kernel: [45164.635111] Aug 22 17:56:46 juju-e4d256-prod-github-runner-207 kernel: [45180.200704] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 17:56:46 juju-e4d256-prod-github-runner-207 kernel: [45180.202808] rcu: 1-....: (11230456 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=5436526 Aug 22 17:56:46 juju-e4d256-prod-github-runner-207 kernel: [45180.203935] (t=11265750 jiffies g=23269 q=44454) Aug 22 17:56:46 juju-e4d256-prod-github-runner-207 kernel: [45180.204723] NMI backtrace for cpu 1 Aug 22 17:56:46 juju-e4d256-prod-github-runner-207 kernel: [45180.205436] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 17:56:46 juju-e4d256-prod-github-runner-207 kernel: [45180.206596] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 17:56:46 juju-e4d256-prod-github-runner-207 kernel: [45180.207663] Call Trace: Aug 22 17:56:46 juju-e4d256-prod-github-runner-207 kernel: [45180.208338] Aug 22 17:56:46 juju-e4d256-prod-github-runner-207 kernel: [45180.209066] show_stack+0x52/0x5c Aug 22 17:56:46 juju-e4d256-prod-github-runner-207 kernel: [45180.209806] dump_stack_lvl+0x4a/0x63 Aug 22 17:56:46 juju-e4d256-prod-github-runner-207 kernel: [45180.210568] dump_stack+0x10/0x16 Aug 22 17:56:46 juju-e4d256-prod-github-runner-207 kernel: [45180.211284] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 17:56:46 juju-e4d256-prod-github-runner-207 kernel: [45180.212062] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 17:56:46 juju-e4d256-prod-github-runner-207 kernel: [45180.212843] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 17:56:46 juju-e4d256-prod-github-runner-207 kernel: [45180.213661] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 17:56:46 juju-e4d256-prod-github-runner-207 kernel: [45180.214503] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 17:56:46 juju-e4d256-prod-github-runner-207 kernel: [45180.215336] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 17:56:46 juju-e4d256-prod-github-runner-207 kernel: [45180.216107] print_cpu_stall.cold+0x2f/0xe2 Aug 22 17:56:46 juju-e4d256-prod-github-runner-207 kernel: [45180.216872] ? timekeeping_update+0xf7/0x150 Aug 22 17:56:46 juju-e4d256-prod-github-runner-207 kernel: [45180.217642] check_cpu_stall+0x109/0x270 Aug 22 17:56:46 juju-e4d256-prod-github-runner-207 kernel: [45180.218388] rcu_sched_clock_irq+0x9a/0x250 Aug 22 17:56:46 juju-e4d256-prod-github-runner-207 kernel: [45180.219180] update_process_times+0x94/0xd0 Aug 22 17:56:46 juju-e4d256-prod-github-runner-207 kernel: [45180.219961] tick_sched_handle+0x29/0x70 Aug 22 17:56:46 juju-e4d256-prod-github-runner-207 kernel: [45180.220710] tick_sched_timer+0x8c/0xc0 Aug 22 17:56:46 juju-e4d256-prod-github-runner-207 kernel: [45180.221446] ? tick_nohz_handler+0xb0/0xb0 Aug 22 17:56:46 juju-e4d256-prod-github-runner-207 kernel: [45180.222198] __hrtimer_run_queues+0x107/0x230 Aug 22 17:56:46 juju-e4d256-prod-github-runner-207 kernel: [45180.222986] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 17:56:46 juju-e4d256-prod-github-runner-207 kernel: [45180.223766] hrtimer_interrupt+0x101/0x220 Aug 22 17:56:46 juju-e4d256-prod-github-runner-207 kernel: [45180.224522] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 17:56:46 juju-e4d256-prod-github-runner-207 kernel: [45180.225332] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 17:56:46 juju-e4d256-prod-github-runner-207 kernel: [45180.226171] Aug 22 17:56:46 juju-e4d256-prod-github-runner-207 kernel: [45180.226823] Aug 22 17:56:46 juju-e4d256-prod-github-runner-207 kernel: [45180.227457] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 17:56:46 juju-e4d256-prod-github-runner-207 kernel: [45180.228273] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:56:46 juju-e4d256-prod-github-runner-207 kernel: [45180.229153] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 17:56:46 juju-e4d256-prod-github-runner-207 kernel: [45180.231421] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 17:56:46 juju-e4d256-prod-github-runner-207 kernel: [45180.232296] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 17:56:46 juju-e4d256-prod-github-runner-207 kernel: [45180.233288] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 17:56:46 juju-e4d256-prod-github-runner-207 kernel: [45180.234259] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 17:56:46 juju-e4d256-prod-github-runner-207 kernel: [45180.235225] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 17:56:46 juju-e4d256-prod-github-runner-207 kernel: [45180.236177] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 17:56:46 juju-e4d256-prod-github-runner-207 kernel: [45180.237129] ? _raw_spin_lock+0x22/0x30 Aug 22 17:56:46 juju-e4d256-prod-github-runner-207 kernel: [45180.237897] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:56:46 juju-e4d256-prod-github-runner-207 kernel: [45180.238767] direct_page_fault+0x206/0x310 [kvm] Aug 22 17:56:46 juju-e4d256-prod-github-runner-207 kernel: [45180.239613] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 17:56:46 juju-e4d256-prod-github-runner-207 kernel: [45180.240478] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 17:56:46 juju-e4d256-prod-github-runner-207 kernel: [45180.241346] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 17:56:46 juju-e4d256-prod-github-runner-207 kernel: [45180.242186] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 17:56:46 juju-e4d256-prod-github-runner-207 kernel: [45180.243046] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 17:56:46 juju-e4d256-prod-github-runner-207 kernel: [45180.243872] handle_exit+0x98/0x230 [kvm_amd] Aug 22 17:56:46 juju-e4d256-prod-github-runner-207 kernel: [45180.244646] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 17:56:46 juju-e4d256-prod-github-runner-207 kernel: [45180.245490] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 17:56:46 juju-e4d256-prod-github-runner-207 kernel: [45180.246306] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 17:56:46 juju-e4d256-prod-github-runner-207 kernel: [45180.247325] vcpu_run+0x62/0x2c0 [kvm] Aug 22 17:56:46 juju-e4d256-prod-github-runner-207 kernel: [45180.248097] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 17:56:46 juju-e4d256-prod-github-runner-207 kernel: [45180.248834] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 17:56:46 juju-e4d256-prod-github-runner-207 kernel: [45180.249639] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 17:56:46 juju-e4d256-prod-github-runner-207 kernel: [45180.250442] ? __seccomp_filter+0x4a/0x4a0 Aug 22 17:56:46 juju-e4d256-prod-github-runner-207 kernel: [45180.251200] ? __fget_files+0x86/0xc0 Aug 22 17:56:46 juju-e4d256-prod-github-runner-207 kernel: [45180.251891] __x64_sys_ioctl+0x95/0xd0 Aug 22 17:56:46 juju-e4d256-prod-github-runner-207 kernel: [45180.252589] do_syscall_64+0x5c/0xc0 Aug 22 17:56:46 juju-e4d256-prod-github-runner-207 kernel: [45180.253269] ? do_futex+0x162/0x1f0 Aug 22 17:56:46 juju-e4d256-prod-github-runner-207 kernel: [45180.253940] ? __x64_sys_futex+0x78/0x1e0 Aug 22 17:56:46 juju-e4d256-prod-github-runner-207 kernel: [45180.254654] ? __secure_computing+0xa9/0x120 Aug 22 17:56:46 juju-e4d256-prod-github-runner-207 kernel: [45180.255374] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 17:56:46 juju-e4d256-prod-github-runner-207 kernel: [45180.256170] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:56:46 juju-e4d256-prod-github-runner-207 kernel: [45180.256937] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:56:46 juju-e4d256-prod-github-runner-207 kernel: [45180.257693] ? do_syscall_64+0x69/0xc0 Aug 22 17:56:46 juju-e4d256-prod-github-runner-207 kernel: [45180.258387] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:56:46 juju-e4d256-prod-github-runner-207 kernel: [45180.259160] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:56:46 juju-e4d256-prod-github-runner-207 kernel: [45180.259913] ? do_syscall_64+0x69/0xc0 Aug 22 17:56:46 juju-e4d256-prod-github-runner-207 kernel: [45180.260645] ? do_syscall_64+0x69/0xc0 Aug 22 17:56:46 juju-e4d256-prod-github-runner-207 kernel: [45180.261354] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 17:56:46 juju-e4d256-prod-github-runner-207 kernel: [45180.262170] RIP: 0033:0x7faa5d0edaff Aug 22 17:56:46 juju-e4d256-prod-github-runner-207 kernel: [45180.262939] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 17:56:46 juju-e4d256-prod-github-runner-207 kernel: [45180.265176] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 17:56:46 juju-e4d256-prod-github-runner-207 kernel: [45180.266170] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 17:56:46 juju-e4d256-prod-github-runner-207 kernel: [45180.267157] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 17:56:46 juju-e4d256-prod-github-runner-207 kernel: [45180.268126] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 17:56:46 juju-e4d256-prod-github-runner-207 kernel: [45180.269064] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 17:56:46 juju-e4d256-prod-github-runner-207 kernel: [45180.270004] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 17:56:46 juju-e4d256-prod-github-runner-207 kernel: [45180.271015] Aug 22 17:57:10 juju-e4d256-prod-github-runner-207 kernel: [45204.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 41992s! [qemu-system-x86:6715] Aug 22 17:57:10 juju-e4d256-prod-github-runner-207 kernel: [45204.544183] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 17:57:10 juju-e4d256-prod-github-runner-207 kernel: [45204.544515] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 17:57:10 juju-e4d256-prod-github-runner-207 kernel: [45204.557245] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 17:57:10 juju-e4d256-prod-github-runner-207 kernel: [45204.558741] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 17:57:10 juju-e4d256-prod-github-runner-207 kernel: [45204.560240] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:57:10 juju-e4d256-prod-github-runner-207 kernel: [45204.561339] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 17:57:10 juju-e4d256-prod-github-runner-207 kernel: [45204.563961] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 17:57:10 juju-e4d256-prod-github-runner-207 kernel: [45204.565039] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 17:57:10 juju-e4d256-prod-github-runner-207 kernel: [45204.566272] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 17:57:10 juju-e4d256-prod-github-runner-207 kernel: [45204.567459] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 17:57:10 juju-e4d256-prod-github-runner-207 kernel: [45204.568715] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 17:57:10 juju-e4d256-prod-github-runner-207 kernel: [45204.569910] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 17:57:10 juju-e4d256-prod-github-runner-207 kernel: [45204.571123] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 17:57:10 juju-e4d256-prod-github-runner-207 kernel: [45204.572381] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 17:57:10 juju-e4d256-prod-github-runner-207 kernel: [45204.573497] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 17:57:10 juju-e4d256-prod-github-runner-207 kernel: [45204.574728] Call Trace: Aug 22 17:57:10 juju-e4d256-prod-github-runner-207 kernel: [45204.575684] Aug 22 17:57:10 juju-e4d256-prod-github-runner-207 kernel: [45204.576624] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:57:10 juju-e4d256-prod-github-runner-207 kernel: [45204.577679] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:57:10 juju-e4d256-prod-github-runner-207 kernel: [45204.578779] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:57:10 juju-e4d256-prod-github-runner-207 kernel: [45204.579893] ? show_regs.part.0+0x23/0x29 Aug 22 17:57:10 juju-e4d256-prod-github-runner-207 kernel: [45204.580901] ? show_regs.cold+0x8/0xd Aug 22 17:57:10 juju-e4d256-prod-github-runner-207 kernel: [45204.581881] ? watchdog_timer_fn+0x1be/0x220 Aug 22 17:57:10 juju-e4d256-prod-github-runner-207 kernel: [45204.582918] ? lockup_detector_update_enable+0x60/0x60 Aug 22 17:57:10 juju-e4d256-prod-github-runner-207 kernel: [45204.583995] ? __hrtimer_run_queues+0x107/0x230 Aug 22 17:57:10 juju-e4d256-prod-github-runner-207 kernel: [45204.585034] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 17:57:10 juju-e4d256-prod-github-runner-207 kernel: [45204.586065] ? hrtimer_interrupt+0x101/0x220 Aug 22 17:57:10 juju-e4d256-prod-github-runner-207 kernel: [45204.587136] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 17:57:10 juju-e4d256-prod-github-runner-207 kernel: [45204.588220] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 17:57:10 juju-e4d256-prod-github-runner-207 kernel: [45204.589333] Aug 22 17:57:10 juju-e4d256-prod-github-runner-207 kernel: [45204.590216] Aug 22 17:57:10 juju-e4d256-prod-github-runner-207 kernel: [45204.591104] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 17:57:10 juju-e4d256-prod-github-runner-207 kernel: [45204.592183] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:57:10 juju-e4d256-prod-github-runner-207 kernel: [45204.593253] ? _raw_spin_lock+0x22/0x30 Aug 22 17:57:10 juju-e4d256-prod-github-runner-207 kernel: [45204.594253] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:57:10 juju-e4d256-prod-github-runner-207 kernel: [45204.595353] direct_page_fault+0x206/0x310 [kvm] Aug 22 17:57:10 juju-e4d256-prod-github-runner-207 kernel: [45204.596407] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 17:57:10 juju-e4d256-prod-github-runner-207 kernel: [45204.597447] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 17:57:10 juju-e4d256-prod-github-runner-207 kernel: [45204.598594] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 17:57:10 juju-e4d256-prod-github-runner-207 kernel: [45204.599690] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 17:57:10 juju-e4d256-prod-github-runner-207 kernel: [45204.600704] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 17:57:10 juju-e4d256-prod-github-runner-207 kernel: [45204.601796] handle_exit+0x98/0x230 [kvm_amd] Aug 22 17:57:10 juju-e4d256-prod-github-runner-207 kernel: [45204.602745] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 17:57:10 juju-e4d256-prod-github-runner-207 kernel: [45204.603689] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 17:57:10 juju-e4d256-prod-github-runner-207 kernel: [45204.605050] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 17:57:10 juju-e4d256-prod-github-runner-207 kernel: [45204.606528] vcpu_run+0x62/0x2c0 [kvm] Aug 22 17:57:10 juju-e4d256-prod-github-runner-207 kernel: [45204.607750] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 17:57:10 juju-e4d256-prod-github-runner-207 kernel: [45204.608598] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 17:57:10 juju-e4d256-prod-github-runner-207 kernel: [45204.609497] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 17:57:10 juju-e4d256-prod-github-runner-207 kernel: [45204.610350] ? __seccomp_filter+0x4a/0x4a0 Aug 22 17:57:10 juju-e4d256-prod-github-runner-207 kernel: [45204.611122] ? __fget_files+0x86/0xc0 Aug 22 17:57:10 juju-e4d256-prod-github-runner-207 kernel: [45204.611839] __x64_sys_ioctl+0x95/0xd0 Aug 22 17:57:10 juju-e4d256-prod-github-runner-207 kernel: [45204.612544] do_syscall_64+0x5c/0xc0 Aug 22 17:57:10 juju-e4d256-prod-github-runner-207 kernel: [45204.613245] ? do_futex+0x162/0x1f0 Aug 22 17:57:10 juju-e4d256-prod-github-runner-207 kernel: [45204.613908] ? __x64_sys_futex+0x78/0x1e0 Aug 22 17:57:10 juju-e4d256-prod-github-runner-207 kernel: [45204.614635] ? __secure_computing+0xa9/0x120 Aug 22 17:57:10 juju-e4d256-prod-github-runner-207 kernel: [45204.615376] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 17:57:10 juju-e4d256-prod-github-runner-207 kernel: [45204.616153] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:57:10 juju-e4d256-prod-github-runner-207 kernel: [45204.616890] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:57:10 juju-e4d256-prod-github-runner-207 kernel: [45204.617629] ? do_syscall_64+0x69/0xc0 Aug 22 17:57:10 juju-e4d256-prod-github-runner-207 kernel: [45204.618342] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:57:10 juju-e4d256-prod-github-runner-207 kernel: [45204.619084] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:57:10 juju-e4d256-prod-github-runner-207 kernel: [45204.619804] ? do_syscall_64+0x69/0xc0 Aug 22 17:57:10 juju-e4d256-prod-github-runner-207 kernel: [45204.620447] ? do_syscall_64+0x69/0xc0 Aug 22 17:57:10 juju-e4d256-prod-github-runner-207 kernel: [45204.621082] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 17:57:10 juju-e4d256-prod-github-runner-207 kernel: [45204.621800] RIP: 0033:0x7faa5d0edaff Aug 22 17:57:10 juju-e4d256-prod-github-runner-207 kernel: [45204.622495] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 17:57:10 juju-e4d256-prod-github-runner-207 kernel: [45204.624581] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 17:57:10 juju-e4d256-prod-github-runner-207 kernel: [45204.625523] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 17:57:10 juju-e4d256-prod-github-runner-207 kernel: [45204.626461] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 17:57:10 juju-e4d256-prod-github-runner-207 kernel: [45204.627381] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 17:57:10 juju-e4d256-prod-github-runner-207 kernel: [45204.628350] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 17:57:10 juju-e4d256-prod-github-runner-207 kernel: [45204.629265] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 17:57:10 juju-e4d256-prod-github-runner-207 kernel: [45204.630175] Aug 22 17:57:38 juju-e4d256-prod-github-runner-207 kernel: [45232.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 42018s! [qemu-system-x86:6715] Aug 22 17:57:38 juju-e4d256-prod-github-runner-207 kernel: [45232.543876] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 17:57:38 juju-e4d256-prod-github-runner-207 kernel: [45232.544175] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 17:57:38 juju-e4d256-prod-github-runner-207 kernel: [45232.556574] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 17:57:38 juju-e4d256-prod-github-runner-207 kernel: [45232.557899] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 17:57:38 juju-e4d256-prod-github-runner-207 kernel: [45232.559149] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:57:38 juju-e4d256-prod-github-runner-207 kernel: [45232.560218] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 17:57:38 juju-e4d256-prod-github-runner-207 kernel: [45232.562891] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 17:57:38 juju-e4d256-prod-github-runner-207 kernel: [45232.563944] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 17:57:38 juju-e4d256-prod-github-runner-207 kernel: [45232.565142] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 17:57:38 juju-e4d256-prod-github-runner-207 kernel: [45232.566350] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 17:57:38 juju-e4d256-prod-github-runner-207 kernel: [45232.567542] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 17:57:38 juju-e4d256-prod-github-runner-207 kernel: [45232.568731] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 17:57:38 juju-e4d256-prod-github-runner-207 kernel: [45232.570013] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 17:57:38 juju-e4d256-prod-github-runner-207 kernel: [45232.571281] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 17:57:38 juju-e4d256-prod-github-runner-207 kernel: [45232.572472] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 17:57:38 juju-e4d256-prod-github-runner-207 kernel: [45232.573694] Call Trace: Aug 22 17:57:38 juju-e4d256-prod-github-runner-207 kernel: [45232.574640] Aug 22 17:57:38 juju-e4d256-prod-github-runner-207 kernel: [45232.575565] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:57:38 juju-e4d256-prod-github-runner-207 kernel: [45232.576822] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:57:38 juju-e4d256-prod-github-runner-207 kernel: [45232.578235] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:57:38 juju-e4d256-prod-github-runner-207 kernel: [45232.579575] ? show_regs.part.0+0x23/0x29 Aug 22 17:57:38 juju-e4d256-prod-github-runner-207 kernel: [45232.580592] ? show_regs.cold+0x8/0xd Aug 22 17:57:38 juju-e4d256-prod-github-runner-207 kernel: [45232.581709] ? watchdog_timer_fn+0x1be/0x220 Aug 22 17:57:38 juju-e4d256-prod-github-runner-207 kernel: [45232.582804] ? lockup_detector_update_enable+0x60/0x60 Aug 22 17:57:38 juju-e4d256-prod-github-runner-207 kernel: [45232.584025] ? __hrtimer_run_queues+0x107/0x230 Aug 22 17:57:38 juju-e4d256-prod-github-runner-207 kernel: [45232.585088] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 17:57:38 juju-e4d256-prod-github-runner-207 kernel: [45232.586192] ? hrtimer_interrupt+0x101/0x220 Aug 22 17:57:38 juju-e4d256-prod-github-runner-207 kernel: [45232.587248] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 17:57:38 juju-e4d256-prod-github-runner-207 kernel: [45232.588327] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 17:57:38 juju-e4d256-prod-github-runner-207 kernel: [45232.589388] Aug 22 17:57:38 juju-e4d256-prod-github-runner-207 kernel: [45232.590265] Aug 22 17:57:38 juju-e4d256-prod-github-runner-207 kernel: [45232.591127] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 17:57:38 juju-e4d256-prod-github-runner-207 kernel: [45232.592177] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:57:38 juju-e4d256-prod-github-runner-207 kernel: [45232.593347] ? _raw_spin_lock+0x22/0x30 Aug 22 17:57:38 juju-e4d256-prod-github-runner-207 kernel: [45232.594326] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:57:38 juju-e4d256-prod-github-runner-207 kernel: [45232.595372] direct_page_fault+0x206/0x310 [kvm] Aug 22 17:57:38 juju-e4d256-prod-github-runner-207 kernel: [45232.596438] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 17:57:38 juju-e4d256-prod-github-runner-207 kernel: [45232.597685] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 17:57:38 juju-e4d256-prod-github-runner-207 kernel: [45232.598725] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 17:57:38 juju-e4d256-prod-github-runner-207 kernel: [45232.599768] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 17:57:38 juju-e4d256-prod-github-runner-207 kernel: [45232.600725] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 17:57:38 juju-e4d256-prod-github-runner-207 kernel: [45232.601716] handle_exit+0x98/0x230 [kvm_amd] Aug 22 17:57:38 juju-e4d256-prod-github-runner-207 kernel: [45232.602637] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 17:57:38 juju-e4d256-prod-github-runner-207 kernel: [45232.603560] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 17:57:38 juju-e4d256-prod-github-runner-207 kernel: [45232.604498] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 17:57:38 juju-e4d256-prod-github-runner-207 kernel: [45232.605416] vcpu_run+0x62/0x2c0 [kvm] Aug 22 17:57:38 juju-e4d256-prod-github-runner-207 kernel: [45232.606241] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 17:57:38 juju-e4d256-prod-github-runner-207 kernel: [45232.607065] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 17:57:38 juju-e4d256-prod-github-runner-207 kernel: [45232.607968] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 17:57:38 juju-e4d256-prod-github-runner-207 kernel: [45232.608776] ? __seccomp_filter+0x4a/0x4a0 Aug 22 17:57:38 juju-e4d256-prod-github-runner-207 kernel: [45232.609546] ? __fget_files+0x86/0xc0 Aug 22 17:57:38 juju-e4d256-prod-github-runner-207 kernel: [45232.610286] __x64_sys_ioctl+0x95/0xd0 Aug 22 17:57:38 juju-e4d256-prod-github-runner-207 kernel: [45232.610989] do_syscall_64+0x5c/0xc0 Aug 22 17:57:38 juju-e4d256-prod-github-runner-207 kernel: [45232.611661] ? do_futex+0x162/0x1f0 Aug 22 17:57:38 juju-e4d256-prod-github-runner-207 kernel: [45232.612316] ? __x64_sys_futex+0x78/0x1e0 Aug 22 17:57:38 juju-e4d256-prod-github-runner-207 kernel: [45232.613058] ? __secure_computing+0xa9/0x120 Aug 22 17:57:38 juju-e4d256-prod-github-runner-207 kernel: [45232.613776] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 17:57:38 juju-e4d256-prod-github-runner-207 kernel: [45232.614576] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:57:38 juju-e4d256-prod-github-runner-207 kernel: [45232.615326] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:57:38 juju-e4d256-prod-github-runner-207 kernel: [45232.616225] ? do_syscall_64+0x69/0xc0 Aug 22 17:57:38 juju-e4d256-prod-github-runner-207 kernel: [45232.616899] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:57:38 juju-e4d256-prod-github-runner-207 kernel: [45232.617639] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:57:38 juju-e4d256-prod-github-runner-207 kernel: [45232.618507] ? do_syscall_64+0x69/0xc0 Aug 22 17:57:38 juju-e4d256-prod-github-runner-207 kernel: [45232.619212] ? do_syscall_64+0x69/0xc0 Aug 22 17:57:38 juju-e4d256-prod-github-runner-207 kernel: [45232.619926] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 17:57:38 juju-e4d256-prod-github-runner-207 kernel: [45232.620641] RIP: 0033:0x7faa5d0edaff Aug 22 17:57:38 juju-e4d256-prod-github-runner-207 kernel: [45232.621326] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 17:57:38 juju-e4d256-prod-github-runner-207 kernel: [45232.623398] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 17:57:38 juju-e4d256-prod-github-runner-207 kernel: [45232.624337] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 17:57:38 juju-e4d256-prod-github-runner-207 kernel: [45232.625254] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 17:57:38 juju-e4d256-prod-github-runner-207 kernel: [45232.626191] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 17:57:38 juju-e4d256-prod-github-runner-207 kernel: [45232.627111] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 17:57:38 juju-e4d256-prod-github-runner-207 kernel: [45232.628031] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 17:57:38 juju-e4d256-prod-github-runner-207 kernel: [45232.628937] Aug 22 17:58:06 juju-e4d256-prod-github-runner-207 kernel: [45260.541981] watchdog: BUG: soft lockup - CPU#1 stuck for 42044s! [qemu-system-x86:6715] Aug 22 17:58:06 juju-e4d256-prod-github-runner-207 kernel: [45260.543939] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 17:58:06 juju-e4d256-prod-github-runner-207 kernel: [45260.544287] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 17:58:06 juju-e4d256-prod-github-runner-207 kernel: [45260.556959] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 17:58:06 juju-e4d256-prod-github-runner-207 kernel: [45260.558638] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 17:58:06 juju-e4d256-prod-github-runner-207 kernel: [45260.559933] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:58:06 juju-e4d256-prod-github-runner-207 kernel: [45260.561026] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 17:58:06 juju-e4d256-prod-github-runner-207 kernel: [45260.563654] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 17:58:06 juju-e4d256-prod-github-runner-207 kernel: [45260.564756] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 17:58:06 juju-e4d256-prod-github-runner-207 kernel: [45260.565975] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 17:58:06 juju-e4d256-prod-github-runner-207 kernel: [45260.567175] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 17:58:06 juju-e4d256-prod-github-runner-207 kernel: [45260.568358] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 17:58:06 juju-e4d256-prod-github-runner-207 kernel: [45260.569582] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 17:58:06 juju-e4d256-prod-github-runner-207 kernel: [45260.570828] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 17:58:06 juju-e4d256-prod-github-runner-207 kernel: [45260.572161] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 17:58:06 juju-e4d256-prod-github-runner-207 kernel: [45260.573287] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 17:58:06 juju-e4d256-prod-github-runner-207 kernel: [45260.574525] Call Trace: Aug 22 17:58:06 juju-e4d256-prod-github-runner-207 kernel: [45260.575455] Aug 22 17:58:06 juju-e4d256-prod-github-runner-207 kernel: [45260.576376] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:58:06 juju-e4d256-prod-github-runner-207 kernel: [45260.577646] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:58:06 juju-e4d256-prod-github-runner-207 kernel: [45260.578768] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:58:06 juju-e4d256-prod-github-runner-207 kernel: [45260.579902] ? show_regs.part.0+0x23/0x29 Aug 22 17:58:06 juju-e4d256-prod-github-runner-207 kernel: [45260.580932] ? show_regs.cold+0x8/0xd Aug 22 17:58:06 juju-e4d256-prod-github-runner-207 kernel: [45260.581947] ? watchdog_timer_fn+0x1be/0x220 Aug 22 17:58:06 juju-e4d256-prod-github-runner-207 kernel: [45260.582987] ? lockup_detector_update_enable+0x60/0x60 Aug 22 17:58:06 juju-e4d256-prod-github-runner-207 kernel: [45260.584076] ? __hrtimer_run_queues+0x107/0x230 Aug 22 17:58:06 juju-e4d256-prod-github-runner-207 kernel: [45260.585178] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 17:58:06 juju-e4d256-prod-github-runner-207 kernel: [45260.586266] ? hrtimer_interrupt+0x101/0x220 Aug 22 17:58:06 juju-e4d256-prod-github-runner-207 kernel: [45260.587360] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 17:58:06 juju-e4d256-prod-github-runner-207 kernel: [45260.588503] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 17:58:06 juju-e4d256-prod-github-runner-207 kernel: [45260.589618] Aug 22 17:58:06 juju-e4d256-prod-github-runner-207 kernel: [45260.590525] Aug 22 17:58:06 juju-e4d256-prod-github-runner-207 kernel: [45260.591397] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 17:58:06 juju-e4d256-prod-github-runner-207 kernel: [45260.592493] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:58:06 juju-e4d256-prod-github-runner-207 kernel: [45260.593604] ? _raw_spin_lock+0x22/0x30 Aug 22 17:58:06 juju-e4d256-prod-github-runner-207 kernel: [45260.594565] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:58:06 juju-e4d256-prod-github-runner-207 kernel: [45260.595603] direct_page_fault+0x206/0x310 [kvm] Aug 22 17:58:06 juju-e4d256-prod-github-runner-207 kernel: [45260.596660] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 17:58:06 juju-e4d256-prod-github-runner-207 kernel: [45260.597745] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 17:58:06 juju-e4d256-prod-github-runner-207 kernel: [45260.598830] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 17:58:06 juju-e4d256-prod-github-runner-207 kernel: [45260.599869] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 17:58:06 juju-e4d256-prod-github-runner-207 kernel: [45260.600828] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 17:58:06 juju-e4d256-prod-github-runner-207 kernel: [45260.602017] handle_exit+0x98/0x230 [kvm_amd] Aug 22 17:58:06 juju-e4d256-prod-github-runner-207 kernel: [45260.602962] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 17:58:06 juju-e4d256-prod-github-runner-207 kernel: [45260.603926] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 17:58:06 juju-e4d256-prod-github-runner-207 kernel: [45260.604869] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 17:58:06 juju-e4d256-prod-github-runner-207 kernel: [45260.605816] vcpu_run+0x62/0x2c0 [kvm] Aug 22 17:58:06 juju-e4d256-prod-github-runner-207 kernel: [45260.606640] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 17:58:06 juju-e4d256-prod-github-runner-207 kernel: [45260.607496] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 17:58:06 juju-e4d256-prod-github-runner-207 kernel: [45260.608424] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 17:58:06 juju-e4d256-prod-github-runner-207 kernel: [45260.609254] ? __seccomp_filter+0x4a/0x4a0 Aug 22 17:58:06 juju-e4d256-prod-github-runner-207 kernel: [45260.610027] ? __fget_files+0x86/0xc0 Aug 22 17:58:06 juju-e4d256-prod-github-runner-207 kernel: [45260.610767] __x64_sys_ioctl+0x95/0xd0 Aug 22 17:58:06 juju-e4d256-prod-github-runner-207 kernel: [45260.611480] do_syscall_64+0x5c/0xc0 Aug 22 17:58:06 juju-e4d256-prod-github-runner-207 kernel: [45260.612173] ? do_futex+0x162/0x1f0 Aug 22 17:58:06 juju-e4d256-prod-github-runner-207 kernel: [45260.612864] ? __x64_sys_futex+0x78/0x1e0 Aug 22 17:58:06 juju-e4d256-prod-github-runner-207 kernel: [45260.613632] ? __secure_computing+0xa9/0x120 Aug 22 17:58:06 juju-e4d256-prod-github-runner-207 kernel: [45260.614450] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 17:58:06 juju-e4d256-prod-github-runner-207 kernel: [45260.615318] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:58:06 juju-e4d256-prod-github-runner-207 kernel: [45260.616068] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:58:06 juju-e4d256-prod-github-runner-207 kernel: [45260.616804] ? do_syscall_64+0x69/0xc0 Aug 22 17:58:06 juju-e4d256-prod-github-runner-207 kernel: [45260.617485] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:58:06 juju-e4d256-prod-github-runner-207 kernel: [45260.618373] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:58:06 juju-e4d256-prod-github-runner-207 kernel: [45260.619108] ? do_syscall_64+0x69/0xc0 Aug 22 17:58:06 juju-e4d256-prod-github-runner-207 kernel: [45260.619744] ? do_syscall_64+0x69/0xc0 Aug 22 17:58:06 juju-e4d256-prod-github-runner-207 kernel: [45260.620380] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 17:58:06 juju-e4d256-prod-github-runner-207 kernel: [45260.621107] RIP: 0033:0x7faa5d0edaff Aug 22 17:58:06 juju-e4d256-prod-github-runner-207 kernel: [45260.621811] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 17:58:06 juju-e4d256-prod-github-runner-207 kernel: [45260.623950] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 17:58:06 juju-e4d256-prod-github-runner-207 kernel: [45260.624916] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 17:58:06 juju-e4d256-prod-github-runner-207 kernel: [45260.625855] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 17:58:06 juju-e4d256-prod-github-runner-207 kernel: [45260.626771] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 17:58:06 juju-e4d256-prod-github-runner-207 kernel: [45260.627677] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 17:58:06 juju-e4d256-prod-github-runner-207 kernel: [45260.628647] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 17:58:06 juju-e4d256-prod-github-runner-207 kernel: [45260.629630] Aug 22 17:58:34 juju-e4d256-prod-github-runner-207 kernel: [45288.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 42070s! [qemu-system-x86:6715] Aug 22 17:58:34 juju-e4d256-prod-github-runner-207 kernel: [45288.543887] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 17:58:34 juju-e4d256-prod-github-runner-207 kernel: [45288.544194] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 17:58:34 juju-e4d256-prod-github-runner-207 kernel: [45288.557220] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 17:58:34 juju-e4d256-prod-github-runner-207 kernel: [45288.558484] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 17:58:34 juju-e4d256-prod-github-runner-207 kernel: [45288.559704] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:58:34 juju-e4d256-prod-github-runner-207 kernel: [45288.560758] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 17:58:34 juju-e4d256-prod-github-runner-207 kernel: [45288.563315] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 17:58:34 juju-e4d256-prod-github-runner-207 kernel: [45288.564356] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 17:58:34 juju-e4d256-prod-github-runner-207 kernel: [45288.565559] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 17:58:34 juju-e4d256-prod-github-runner-207 kernel: [45288.566734] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 17:58:34 juju-e4d256-prod-github-runner-207 kernel: [45288.567933] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 17:58:34 juju-e4d256-prod-github-runner-207 kernel: [45288.569098] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 17:58:34 juju-e4d256-prod-github-runner-207 kernel: [45288.570296] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 17:58:34 juju-e4d256-prod-github-runner-207 kernel: [45288.571531] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 17:58:34 juju-e4d256-prod-github-runner-207 kernel: [45288.572628] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 17:58:34 juju-e4d256-prod-github-runner-207 kernel: [45288.573870] Call Trace: Aug 22 17:58:34 juju-e4d256-prod-github-runner-207 kernel: [45288.574796] Aug 22 17:58:34 juju-e4d256-prod-github-runner-207 kernel: [45288.575704] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:58:34 juju-e4d256-prod-github-runner-207 kernel: [45288.576752] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:58:34 juju-e4d256-prod-github-runner-207 kernel: [45288.577799] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:58:34 juju-e4d256-prod-github-runner-207 kernel: [45288.578907] ? show_regs.part.0+0x23/0x29 Aug 22 17:58:34 juju-e4d256-prod-github-runner-207 kernel: [45288.579953] ? show_regs.cold+0x8/0xd Aug 22 17:58:34 juju-e4d256-prod-github-runner-207 kernel: [45288.580938] ? watchdog_timer_fn+0x1be/0x220 Aug 22 17:58:34 juju-e4d256-prod-github-runner-207 kernel: [45288.582094] ? lockup_detector_update_enable+0x60/0x60 Aug 22 17:58:34 juju-e4d256-prod-github-runner-207 kernel: [45288.583213] ? __hrtimer_run_queues+0x107/0x230 Aug 22 17:58:34 juju-e4d256-prod-github-runner-207 kernel: [45288.584258] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 17:58:34 juju-e4d256-prod-github-runner-207 kernel: [45288.585344] ? hrtimer_interrupt+0x101/0x220 Aug 22 17:58:34 juju-e4d256-prod-github-runner-207 kernel: [45288.586377] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 17:58:34 juju-e4d256-prod-github-runner-207 kernel: [45288.587455] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 17:58:34 juju-e4d256-prod-github-runner-207 kernel: [45288.588510] Aug 22 17:58:34 juju-e4d256-prod-github-runner-207 kernel: [45288.589383] Aug 22 17:58:34 juju-e4d256-prod-github-runner-207 kernel: [45288.590226] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 17:58:34 juju-e4d256-prod-github-runner-207 kernel: [45288.591264] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:58:34 juju-e4d256-prod-github-runner-207 kernel: [45288.592326] ? _raw_spin_lock+0x22/0x30 Aug 22 17:58:34 juju-e4d256-prod-github-runner-207 kernel: [45288.593293] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:58:34 juju-e4d256-prod-github-runner-207 kernel: [45288.594346] direct_page_fault+0x206/0x310 [kvm] Aug 22 17:58:34 juju-e4d256-prod-github-runner-207 kernel: [45288.595407] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 17:58:34 juju-e4d256-prod-github-runner-207 kernel: [45288.596426] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 17:58:34 juju-e4d256-prod-github-runner-207 kernel: [45288.597446] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 17:58:34 juju-e4d256-prod-github-runner-207 kernel: [45288.598465] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 17:58:34 juju-e4d256-prod-github-runner-207 kernel: [45288.599415] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 17:58:34 juju-e4d256-prod-github-runner-207 kernel: [45288.600395] handle_exit+0x98/0x230 [kvm_amd] Aug 22 17:58:34 juju-e4d256-prod-github-runner-207 kernel: [45288.601307] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 17:58:34 juju-e4d256-prod-github-runner-207 kernel: [45288.602239] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 17:58:34 juju-e4d256-prod-github-runner-207 kernel: [45288.603167] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 17:58:34 juju-e4d256-prod-github-runner-207 kernel: [45288.604079] vcpu_run+0x62/0x2c0 [kvm] Aug 22 17:58:34 juju-e4d256-prod-github-runner-207 kernel: [45288.604893] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 17:58:34 juju-e4d256-prod-github-runner-207 kernel: [45288.605741] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 17:58:34 juju-e4d256-prod-github-runner-207 kernel: [45288.606611] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 17:58:34 juju-e4d256-prod-github-runner-207 kernel: [45288.607411] ? __seccomp_filter+0x4a/0x4a0 Aug 22 17:58:34 juju-e4d256-prod-github-runner-207 kernel: [45288.608156] ? __fget_files+0x86/0xc0 Aug 22 17:58:34 juju-e4d256-prod-github-runner-207 kernel: [45288.608861] __x64_sys_ioctl+0x95/0xd0 Aug 22 17:58:34 juju-e4d256-prod-github-runner-207 kernel: [45288.609573] do_syscall_64+0x5c/0xc0 Aug 22 17:58:34 juju-e4d256-prod-github-runner-207 kernel: [45288.610245] ? do_futex+0x162/0x1f0 Aug 22 17:58:34 juju-e4d256-prod-github-runner-207 kernel: [45288.610909] ? __x64_sys_futex+0x78/0x1e0 Aug 22 17:58:34 juju-e4d256-prod-github-runner-207 kernel: [45288.611589] ? __secure_computing+0xa9/0x120 Aug 22 17:58:34 juju-e4d256-prod-github-runner-207 kernel: [45288.612280] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 17:58:34 juju-e4d256-prod-github-runner-207 kernel: [45288.613045] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:58:34 juju-e4d256-prod-github-runner-207 kernel: [45288.613787] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:58:34 juju-e4d256-prod-github-runner-207 kernel: [45288.614505] ? do_syscall_64+0x69/0xc0 Aug 22 17:58:34 juju-e4d256-prod-github-runner-207 kernel: [45288.615153] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:58:34 juju-e4d256-prod-github-runner-207 kernel: [45288.615858] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:58:34 juju-e4d256-prod-github-runner-207 kernel: [45288.616559] ? do_syscall_64+0x69/0xc0 Aug 22 17:58:34 juju-e4d256-prod-github-runner-207 kernel: [45288.617185] ? do_syscall_64+0x69/0xc0 Aug 22 17:58:34 juju-e4d256-prod-github-runner-207 kernel: [45288.617829] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 17:58:34 juju-e4d256-prod-github-runner-207 kernel: [45288.618538] RIP: 0033:0x7faa5d0edaff Aug 22 17:58:34 juju-e4d256-prod-github-runner-207 kernel: [45288.619209] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 17:58:34 juju-e4d256-prod-github-runner-207 kernel: [45288.621215] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 17:58:34 juju-e4d256-prod-github-runner-207 kernel: [45288.622129] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 17:58:34 juju-e4d256-prod-github-runner-207 kernel: [45288.623023] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 17:58:34 juju-e4d256-prod-github-runner-207 kernel: [45288.623914] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 17:58:34 juju-e4d256-prod-github-runner-207 kernel: [45288.624805] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 17:58:34 juju-e4d256-prod-github-runner-207 kernel: [45288.625718] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 17:58:34 juju-e4d256-prod-github-runner-207 kernel: [45288.626613] Aug 22 17:59:02 juju-e4d256-prod-github-runner-207 kernel: [45316.541981] watchdog: BUG: soft lockup - CPU#1 stuck for 42096s! [qemu-system-x86:6715] Aug 22 17:59:02 juju-e4d256-prod-github-runner-207 kernel: [45316.543820] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 17:59:02 juju-e4d256-prod-github-runner-207 kernel: [45316.544105] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 17:59:02 juju-e4d256-prod-github-runner-207 kernel: [45316.556520] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 17:59:02 juju-e4d256-prod-github-runner-207 kernel: [45316.557834] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 17:59:02 juju-e4d256-prod-github-runner-207 kernel: [45316.559074] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:59:02 juju-e4d256-prod-github-runner-207 kernel: [45316.560148] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 17:59:02 juju-e4d256-prod-github-runner-207 kernel: [45316.562849] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 17:59:02 juju-e4d256-prod-github-runner-207 kernel: [45316.563905] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 17:59:02 juju-e4d256-prod-github-runner-207 kernel: [45316.565089] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 17:59:02 juju-e4d256-prod-github-runner-207 kernel: [45316.566298] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 17:59:02 juju-e4d256-prod-github-runner-207 kernel: [45316.567513] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 17:59:02 juju-e4d256-prod-github-runner-207 kernel: [45316.568689] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 17:59:02 juju-e4d256-prod-github-runner-207 kernel: [45316.569868] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 17:59:02 juju-e4d256-prod-github-runner-207 kernel: [45316.571131] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 17:59:02 juju-e4d256-prod-github-runner-207 kernel: [45316.572278] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 17:59:02 juju-e4d256-prod-github-runner-207 kernel: [45316.573545] Call Trace: Aug 22 17:59:02 juju-e4d256-prod-github-runner-207 kernel: [45316.574464] Aug 22 17:59:02 juju-e4d256-prod-github-runner-207 kernel: [45316.575374] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:59:02 juju-e4d256-prod-github-runner-207 kernel: [45316.576425] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:59:02 juju-e4d256-prod-github-runner-207 kernel: [45316.577527] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:59:02 juju-e4d256-prod-github-runner-207 kernel: [45316.578910] ? show_regs.part.0+0x23/0x29 Aug 22 17:59:02 juju-e4d256-prod-github-runner-207 kernel: [45316.579971] ? show_regs.cold+0x8/0xd Aug 22 17:59:02 juju-e4d256-prod-github-runner-207 kernel: [45316.581071] ? watchdog_timer_fn+0x1be/0x220 Aug 22 17:59:02 juju-e4d256-prod-github-runner-207 kernel: [45316.582117] ? lockup_detector_update_enable+0x60/0x60 Aug 22 17:59:02 juju-e4d256-prod-github-runner-207 kernel: [45316.583327] ? __hrtimer_run_queues+0x107/0x230 Aug 22 17:59:02 juju-e4d256-prod-github-runner-207 kernel: [45316.584367] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 17:59:02 juju-e4d256-prod-github-runner-207 kernel: [45316.585450] ? hrtimer_interrupt+0x101/0x220 Aug 22 17:59:02 juju-e4d256-prod-github-runner-207 kernel: [45316.586515] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 17:59:02 juju-e4d256-prod-github-runner-207 kernel: [45316.587675] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 17:59:02 juju-e4d256-prod-github-runner-207 kernel: [45316.588793] Aug 22 17:59:02 juju-e4d256-prod-github-runner-207 kernel: [45316.589698] Aug 22 17:59:02 juju-e4d256-prod-github-runner-207 kernel: [45316.590558] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 17:59:02 juju-e4d256-prod-github-runner-207 kernel: [45316.591704] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:59:02 juju-e4d256-prod-github-runner-207 kernel: [45316.592783] ? _raw_spin_lock+0x22/0x30 Aug 22 17:59:02 juju-e4d256-prod-github-runner-207 kernel: [45316.593793] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:59:02 juju-e4d256-prod-github-runner-207 kernel: [45316.594832] direct_page_fault+0x206/0x310 [kvm] Aug 22 17:59:02 juju-e4d256-prod-github-runner-207 kernel: [45316.595882] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 17:59:02 juju-e4d256-prod-github-runner-207 kernel: [45316.596974] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 17:59:02 juju-e4d256-prod-github-runner-207 kernel: [45316.598137] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 17:59:02 juju-e4d256-prod-github-runner-207 kernel: [45316.599282] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 17:59:02 juju-e4d256-prod-github-runner-207 kernel: [45316.600262] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 17:59:02 juju-e4d256-prod-github-runner-207 kernel: [45316.601288] handle_exit+0x98/0x230 [kvm_amd] Aug 22 17:59:02 juju-e4d256-prod-github-runner-207 kernel: [45316.602248] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 17:59:02 juju-e4d256-prod-github-runner-207 kernel: [45316.603223] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 17:59:02 juju-e4d256-prod-github-runner-207 kernel: [45316.604187] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 17:59:02 juju-e4d256-prod-github-runner-207 kernel: [45316.605118] vcpu_run+0x62/0x2c0 [kvm] Aug 22 17:59:02 juju-e4d256-prod-github-runner-207 kernel: [45316.605960] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 17:59:02 juju-e4d256-prod-github-runner-207 kernel: [45316.606812] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 17:59:02 juju-e4d256-prod-github-runner-207 kernel: [45316.607700] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 17:59:02 juju-e4d256-prod-github-runner-207 kernel: [45316.608537] ? __seccomp_filter+0x4a/0x4a0 Aug 22 17:59:02 juju-e4d256-prod-github-runner-207 kernel: [45316.609326] ? __fget_files+0x86/0xc0 Aug 22 17:59:02 juju-e4d256-prod-github-runner-207 kernel: [45316.610037] __x64_sys_ioctl+0x95/0xd0 Aug 22 17:59:02 juju-e4d256-prod-github-runner-207 kernel: [45316.610761] do_syscall_64+0x5c/0xc0 Aug 22 17:59:02 juju-e4d256-prod-github-runner-207 kernel: [45316.611440] ? do_futex+0x162/0x1f0 Aug 22 17:59:02 juju-e4d256-prod-github-runner-207 kernel: [45316.612161] ? __x64_sys_futex+0x78/0x1e0 Aug 22 17:59:02 juju-e4d256-prod-github-runner-207 kernel: [45316.612875] ? __secure_computing+0xa9/0x120 Aug 22 17:59:02 juju-e4d256-prod-github-runner-207 kernel: [45316.613596] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 17:59:02 juju-e4d256-prod-github-runner-207 kernel: [45316.614384] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:59:02 juju-e4d256-prod-github-runner-207 kernel: [45316.615120] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:59:02 juju-e4d256-prod-github-runner-207 kernel: [45316.615854] ? do_syscall_64+0x69/0xc0 Aug 22 17:59:02 juju-e4d256-prod-github-runner-207 kernel: [45316.616511] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:59:02 juju-e4d256-prod-github-runner-207 kernel: [45316.617268] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:59:02 juju-e4d256-prod-github-runner-207 kernel: [45316.617991] ? do_syscall_64+0x69/0xc0 Aug 22 17:59:02 juju-e4d256-prod-github-runner-207 kernel: [45316.618687] ? do_syscall_64+0x69/0xc0 Aug 22 17:59:02 juju-e4d256-prod-github-runner-207 kernel: [45316.619320] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 17:59:02 juju-e4d256-prod-github-runner-207 kernel: [45316.620031] RIP: 0033:0x7faa5d0edaff Aug 22 17:59:02 juju-e4d256-prod-github-runner-207 kernel: [45316.620768] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 17:59:02 juju-e4d256-prod-github-runner-207 kernel: [45316.622947] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 17:59:02 juju-e4d256-prod-github-runner-207 kernel: [45316.623925] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 17:59:02 juju-e4d256-prod-github-runner-207 kernel: [45316.624881] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 17:59:02 juju-e4d256-prod-github-runner-207 kernel: [45316.625778] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 17:59:02 juju-e4d256-prod-github-runner-207 kernel: [45316.626697] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 17:59:02 juju-e4d256-prod-github-runner-207 kernel: [45316.627637] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 17:59:02 juju-e4d256-prod-github-runner-207 kernel: [45316.628624] Aug 22 17:59:30 juju-e4d256-prod-github-runner-207 kernel: [45344.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 42122s! [qemu-system-x86:6715] Aug 22 17:59:30 juju-e4d256-prod-github-runner-207 kernel: [45344.543246] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 17:59:30 juju-e4d256-prod-github-runner-207 kernel: [45344.543330] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 17:59:30 juju-e4d256-prod-github-runner-207 kernel: [45344.557840] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 17:59:30 juju-e4d256-prod-github-runner-207 kernel: [45344.559306] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 17:59:30 juju-e4d256-prod-github-runner-207 kernel: [45344.560716] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:59:30 juju-e4d256-prod-github-runner-207 kernel: [45344.562090] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 17:59:30 juju-e4d256-prod-github-runner-207 kernel: [45344.564994] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 17:59:30 juju-e4d256-prod-github-runner-207 kernel: [45344.566143] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 17:59:30 juju-e4d256-prod-github-runner-207 kernel: [45344.567483] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 17:59:30 juju-e4d256-prod-github-runner-207 kernel: [45344.568808] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 17:59:30 juju-e4d256-prod-github-runner-207 kernel: [45344.570113] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 17:59:30 juju-e4d256-prod-github-runner-207 kernel: [45344.571419] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 17:59:30 juju-e4d256-prod-github-runner-207 kernel: [45344.572737] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 17:59:30 juju-e4d256-prod-github-runner-207 kernel: [45344.574137] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 17:59:30 juju-e4d256-prod-github-runner-207 kernel: [45344.575355] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 17:59:30 juju-e4d256-prod-github-runner-207 kernel: [45344.576706] Call Trace: Aug 22 17:59:30 juju-e4d256-prod-github-runner-207 kernel: [45344.577700] Aug 22 17:59:30 juju-e4d256-prod-github-runner-207 kernel: [45344.578650] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:59:30 juju-e4d256-prod-github-runner-207 kernel: [45344.579798] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 17:59:30 juju-e4d256-prod-github-runner-207 kernel: [45344.580958] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:59:30 juju-e4d256-prod-github-runner-207 kernel: [45344.582142] ? show_regs.part.0+0x23/0x29 Aug 22 17:59:30 juju-e4d256-prod-github-runner-207 kernel: [45344.583240] ? show_regs.cold+0x8/0xd Aug 22 17:59:30 juju-e4d256-prod-github-runner-207 kernel: [45344.584360] ? watchdog_timer_fn+0x1be/0x220 Aug 22 17:59:30 juju-e4d256-prod-github-runner-207 kernel: [45344.585511] ? lockup_detector_update_enable+0x60/0x60 Aug 22 17:59:30 juju-e4d256-prod-github-runner-207 kernel: [45344.586700] ? __hrtimer_run_queues+0x107/0x230 Aug 22 17:59:30 juju-e4d256-prod-github-runner-207 kernel: [45344.587908] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 17:59:30 juju-e4d256-prod-github-runner-207 kernel: [45344.589105] ? hrtimer_interrupt+0x101/0x220 Aug 22 17:59:30 juju-e4d256-prod-github-runner-207 kernel: [45344.590221] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 17:59:30 juju-e4d256-prod-github-runner-207 kernel: [45344.591415] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 17:59:30 juju-e4d256-prod-github-runner-207 kernel: [45344.592596] Aug 22 17:59:30 juju-e4d256-prod-github-runner-207 kernel: [45344.593514] Aug 22 17:59:30 juju-e4d256-prod-github-runner-207 kernel: [45344.594405] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 17:59:30 juju-e4d256-prod-github-runner-207 kernel: [45344.595567] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:59:30 juju-e4d256-prod-github-runner-207 kernel: [45344.596767] ? _raw_spin_lock+0x22/0x30 Aug 22 17:59:30 juju-e4d256-prod-github-runner-207 kernel: [45344.597812] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:59:30 juju-e4d256-prod-github-runner-207 kernel: [45344.598936] direct_page_fault+0x206/0x310 [kvm] Aug 22 17:59:30 juju-e4d256-prod-github-runner-207 kernel: [45344.600071] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 17:59:30 juju-e4d256-prod-github-runner-207 kernel: [45344.601263] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 17:59:30 juju-e4d256-prod-github-runner-207 kernel: [45344.602394] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 17:59:30 juju-e4d256-prod-github-runner-207 kernel: [45344.603477] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 17:59:30 juju-e4d256-prod-github-runner-207 kernel: [45344.604556] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 17:59:30 juju-e4d256-prod-github-runner-207 kernel: [45344.605669] handle_exit+0x98/0x230 [kvm_amd] Aug 22 17:59:30 juju-e4d256-prod-github-runner-207 kernel: [45344.606669] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 17:59:30 juju-e4d256-prod-github-runner-207 kernel: [45344.607702] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 17:59:30 juju-e4d256-prod-github-runner-207 kernel: [45344.608761] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 17:59:30 juju-e4d256-prod-github-runner-207 kernel: [45344.609777] vcpu_run+0x62/0x2c0 [kvm] Aug 22 17:59:30 juju-e4d256-prod-github-runner-207 kernel: [45344.610673] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 17:59:30 juju-e4d256-prod-github-runner-207 kernel: [45344.611581] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 17:59:30 juju-e4d256-prod-github-runner-207 kernel: [45344.612567] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 17:59:30 juju-e4d256-prod-github-runner-207 kernel: [45344.613470] ? __seccomp_filter+0x4a/0x4a0 Aug 22 17:59:30 juju-e4d256-prod-github-runner-207 kernel: [45344.614304] ? __fget_files+0x86/0xc0 Aug 22 17:59:30 juju-e4d256-prod-github-runner-207 kernel: [45344.615092] __x64_sys_ioctl+0x95/0xd0 Aug 22 17:59:30 juju-e4d256-prod-github-runner-207 kernel: [45344.615875] do_syscall_64+0x5c/0xc0 Aug 22 17:59:30 juju-e4d256-prod-github-runner-207 kernel: [45344.616731] ? do_futex+0x162/0x1f0 Aug 22 17:59:30 juju-e4d256-prod-github-runner-207 kernel: [45344.617466] ? __x64_sys_futex+0x78/0x1e0 Aug 22 17:59:30 juju-e4d256-prod-github-runner-207 kernel: [45344.618224] ? __secure_computing+0xa9/0x120 Aug 22 17:59:30 juju-e4d256-prod-github-runner-207 kernel: [45344.619005] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 17:59:30 juju-e4d256-prod-github-runner-207 kernel: [45344.619878] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:59:30 juju-e4d256-prod-github-runner-207 kernel: [45344.620725] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:59:30 juju-e4d256-prod-github-runner-207 kernel: [45344.621547] ? do_syscall_64+0x69/0xc0 Aug 22 17:59:30 juju-e4d256-prod-github-runner-207 kernel: [45344.622271] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:59:30 juju-e4d256-prod-github-runner-207 kernel: [45344.623082] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:59:30 juju-e4d256-prod-github-runner-207 kernel: [45344.623883] ? do_syscall_64+0x69/0xc0 Aug 22 17:59:30 juju-e4d256-prod-github-runner-207 kernel: [45344.624682] ? do_syscall_64+0x69/0xc0 Aug 22 17:59:30 juju-e4d256-prod-github-runner-207 kernel: [45344.625416] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 17:59:30 juju-e4d256-prod-github-runner-207 kernel: [45344.626229] RIP: 0033:0x7faa5d0edaff Aug 22 17:59:30 juju-e4d256-prod-github-runner-207 kernel: [45344.626959] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 17:59:30 juju-e4d256-prod-github-runner-207 kernel: [45344.629715] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 17:59:30 juju-e4d256-prod-github-runner-207 kernel: [45344.630993] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 17:59:30 juju-e4d256-prod-github-runner-207 kernel: [45344.632024] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 17:59:30 juju-e4d256-prod-github-runner-207 kernel: [45344.633081] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 17:59:30 juju-e4d256-prod-github-runner-207 kernel: [45344.634185] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 17:59:30 juju-e4d256-prod-github-runner-207 kernel: [45344.635230] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 17:59:30 juju-e4d256-prod-github-runner-207 kernel: [45344.636270] Aug 22 17:59:46 juju-e4d256-prod-github-runner-207 kernel: [45360.212707] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 17:59:46 juju-e4d256-prod-github-runner-207 kernel: [45360.213679] rcu: 1-....: (11275310 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=5457943 Aug 22 17:59:46 juju-e4d256-prod-github-runner-207 kernel: [45360.214800] (t=11310753 jiffies g=23269 q=44578) Aug 22 17:59:46 juju-e4d256-prod-github-runner-207 kernel: [45360.215601] NMI backtrace for cpu 1 Aug 22 17:59:46 juju-e4d256-prod-github-runner-207 kernel: [45360.216329] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 17:59:46 juju-e4d256-prod-github-runner-207 kernel: [45360.217434] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 17:59:46 juju-e4d256-prod-github-runner-207 kernel: [45360.218499] Call Trace: Aug 22 17:59:46 juju-e4d256-prod-github-runner-207 kernel: [45360.219176] Aug 22 17:59:46 juju-e4d256-prod-github-runner-207 kernel: [45360.219822] show_stack+0x52/0x5c Aug 22 17:59:46 juju-e4d256-prod-github-runner-207 kernel: [45360.220566] dump_stack_lvl+0x4a/0x63 Aug 22 17:59:46 juju-e4d256-prod-github-runner-207 kernel: [45360.221316] dump_stack+0x10/0x16 Aug 22 17:59:46 juju-e4d256-prod-github-runner-207 kernel: [45360.222032] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 17:59:46 juju-e4d256-prod-github-runner-207 kernel: [45360.222892] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 17:59:46 juju-e4d256-prod-github-runner-207 kernel: [45360.223721] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 17:59:46 juju-e4d256-prod-github-runner-207 kernel: [45360.224576] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 17:59:46 juju-e4d256-prod-github-runner-207 kernel: [45360.225456] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 17:59:46 juju-e4d256-prod-github-runner-207 kernel: [45360.226363] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 17:59:46 juju-e4d256-prod-github-runner-207 kernel: [45360.227148] print_cpu_stall.cold+0x2f/0xe2 Aug 22 17:59:46 juju-e4d256-prod-github-runner-207 kernel: [45360.227916] ? timekeeping_update+0xf7/0x150 Aug 22 17:59:46 juju-e4d256-prod-github-runner-207 kernel: [45360.228700] check_cpu_stall+0x109/0x270 Aug 22 17:59:46 juju-e4d256-prod-github-runner-207 kernel: [45360.229456] rcu_sched_clock_irq+0x9a/0x250 Aug 22 17:59:46 juju-e4d256-prod-github-runner-207 kernel: [45360.230221] update_process_times+0x94/0xd0 Aug 22 17:59:46 juju-e4d256-prod-github-runner-207 kernel: [45360.230984] tick_sched_handle+0x29/0x70 Aug 22 17:59:46 juju-e4d256-prod-github-runner-207 kernel: [45360.231770] tick_sched_timer+0x8c/0xc0 Aug 22 17:59:46 juju-e4d256-prod-github-runner-207 kernel: [45360.232527] ? tick_nohz_handler+0xb0/0xb0 Aug 22 17:59:46 juju-e4d256-prod-github-runner-207 kernel: [45360.233304] __hrtimer_run_queues+0x107/0x230 Aug 22 17:59:46 juju-e4d256-prod-github-runner-207 kernel: [45360.234103] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 17:59:46 juju-e4d256-prod-github-runner-207 kernel: [45360.234884] hrtimer_interrupt+0x101/0x220 Aug 22 17:59:46 juju-e4d256-prod-github-runner-207 kernel: [45360.235659] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 17:59:46 juju-e4d256-prod-github-runner-207 kernel: [45360.236505] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 17:59:46 juju-e4d256-prod-github-runner-207 kernel: [45360.237309] Aug 22 17:59:46 juju-e4d256-prod-github-runner-207 kernel: [45360.237944] Aug 22 17:59:46 juju-e4d256-prod-github-runner-207 kernel: [45360.238579] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 17:59:46 juju-e4d256-prod-github-runner-207 kernel: [45360.239403] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 17:59:46 juju-e4d256-prod-github-runner-207 kernel: [45360.240283] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 17:59:46 juju-e4d256-prod-github-runner-207 kernel: [45360.242500] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 17:59:46 juju-e4d256-prod-github-runner-207 kernel: [45360.243374] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 17:59:46 juju-e4d256-prod-github-runner-207 kernel: [45360.244377] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 17:59:46 juju-e4d256-prod-github-runner-207 kernel: [45360.245357] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 17:59:46 juju-e4d256-prod-github-runner-207 kernel: [45360.246328] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 17:59:46 juju-e4d256-prod-github-runner-207 kernel: [45360.247284] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 17:59:46 juju-e4d256-prod-github-runner-207 kernel: [45360.248268] ? _raw_spin_lock+0x22/0x30 Aug 22 17:59:46 juju-e4d256-prod-github-runner-207 kernel: [45360.249044] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 17:59:46 juju-e4d256-prod-github-runner-207 kernel: [45360.249885] direct_page_fault+0x206/0x310 [kvm] Aug 22 17:59:46 juju-e4d256-prod-github-runner-207 kernel: [45360.250724] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 17:59:46 juju-e4d256-prod-github-runner-207 kernel: [45360.251558] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 17:59:46 juju-e4d256-prod-github-runner-207 kernel: [45360.252425] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 17:59:46 juju-e4d256-prod-github-runner-207 kernel: [45360.253271] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 17:59:46 juju-e4d256-prod-github-runner-207 kernel: [45360.254065] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 17:59:46 juju-e4d256-prod-github-runner-207 kernel: [45360.254907] handle_exit+0x98/0x230 [kvm_amd] Aug 22 17:59:46 juju-e4d256-prod-github-runner-207 kernel: [45360.255684] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 17:59:46 juju-e4d256-prod-github-runner-207 kernel: [45360.256490] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 17:59:46 juju-e4d256-prod-github-runner-207 kernel: [45360.257293] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 17:59:46 juju-e4d256-prod-github-runner-207 kernel: [45360.258078] vcpu_run+0x62/0x2c0 [kvm] Aug 22 17:59:46 juju-e4d256-prod-github-runner-207 kernel: [45360.258795] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 17:59:46 juju-e4d256-prod-github-runner-207 kernel: [45360.259528] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 17:59:46 juju-e4d256-prod-github-runner-207 kernel: [45360.260348] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 17:59:46 juju-e4d256-prod-github-runner-207 kernel: [45360.261117] ? __seccomp_filter+0x4a/0x4a0 Aug 22 17:59:46 juju-e4d256-prod-github-runner-207 kernel: [45360.261839] ? __fget_files+0x86/0xc0 Aug 22 17:59:46 juju-e4d256-prod-github-runner-207 kernel: [45360.262537] __x64_sys_ioctl+0x95/0xd0 Aug 22 17:59:46 juju-e4d256-prod-github-runner-207 kernel: [45360.263232] do_syscall_64+0x5c/0xc0 Aug 22 17:59:46 juju-e4d256-prod-github-runner-207 kernel: [45360.263919] ? do_futex+0x162/0x1f0 Aug 22 17:59:46 juju-e4d256-prod-github-runner-207 kernel: [45360.264602] ? __x64_sys_futex+0x78/0x1e0 Aug 22 17:59:46 juju-e4d256-prod-github-runner-207 kernel: [45360.265451] ? __secure_computing+0xa9/0x120 Aug 22 17:59:46 juju-e4d256-prod-github-runner-207 kernel: [45360.266169] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 17:59:46 juju-e4d256-prod-github-runner-207 kernel: [45360.266961] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:59:46 juju-e4d256-prod-github-runner-207 kernel: [45360.267716] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:59:46 juju-e4d256-prod-github-runner-207 kernel: [45360.268485] ? do_syscall_64+0x69/0xc0 Aug 22 17:59:46 juju-e4d256-prod-github-runner-207 kernel: [45360.269177] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 17:59:46 juju-e4d256-prod-github-runner-207 kernel: [45360.269938] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 17:59:46 juju-e4d256-prod-github-runner-207 kernel: [45360.270694] ? do_syscall_64+0x69/0xc0 Aug 22 17:59:46 juju-e4d256-prod-github-runner-207 kernel: [45360.271393] ? do_syscall_64+0x69/0xc0 Aug 22 17:59:46 juju-e4d256-prod-github-runner-207 kernel: [45360.272080] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 17:59:46 juju-e4d256-prod-github-runner-207 kernel: [45360.272878] RIP: 0033:0x7faa5d0edaff Aug 22 17:59:46 juju-e4d256-prod-github-runner-207 kernel: [45360.273570] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 17:59:46 juju-e4d256-prod-github-runner-207 kernel: [45360.275672] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 17:59:46 juju-e4d256-prod-github-runner-207 kernel: [45360.276666] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 17:59:46 juju-e4d256-prod-github-runner-207 kernel: [45360.277622] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 17:59:46 juju-e4d256-prod-github-runner-207 kernel: [45360.278571] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 17:59:46 juju-e4d256-prod-github-runner-207 kernel: [45360.279514] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 17:59:46 juju-e4d256-prod-github-runner-207 kernel: [45360.280461] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 17:59:46 juju-e4d256-prod-github-runner-207 kernel: [45360.281381] Aug 22 18:00:10 juju-e4d256-prod-github-runner-207 kernel: [45384.541980] watchdog: BUG: soft lockup - CPU#1 stuck for 42159s! [qemu-system-x86:6715] Aug 22 18:00:10 juju-e4d256-prod-github-runner-207 kernel: [45384.543911] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 18:00:10 juju-e4d256-prod-github-runner-207 kernel: [45384.544240] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 18:00:10 juju-e4d256-prod-github-runner-207 kernel: [45384.556752] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 18:00:10 juju-e4d256-prod-github-runner-207 kernel: [45384.558042] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 18:00:10 juju-e4d256-prod-github-runner-207 kernel: [45384.559401] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:00:10 juju-e4d256-prod-github-runner-207 kernel: [45384.560690] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 18:00:10 juju-e4d256-prod-github-runner-207 kernel: [45384.563550] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 18:00:10 juju-e4d256-prod-github-runner-207 kernel: [45384.564633] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 18:00:10 juju-e4d256-prod-github-runner-207 kernel: [45384.565806] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 18:00:10 juju-e4d256-prod-github-runner-207 kernel: [45384.566986] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 18:00:10 juju-e4d256-prod-github-runner-207 kernel: [45384.568190] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 18:00:10 juju-e4d256-prod-github-runner-207 kernel: [45384.569432] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 18:00:10 juju-e4d256-prod-github-runner-207 kernel: [45384.570841] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 18:00:10 juju-e4d256-prod-github-runner-207 kernel: [45384.572105] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 18:00:10 juju-e4d256-prod-github-runner-207 kernel: [45384.573225] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 18:00:10 juju-e4d256-prod-github-runner-207 kernel: [45384.574450] Call Trace: Aug 22 18:00:10 juju-e4d256-prod-github-runner-207 kernel: [45384.575369] Aug 22 18:00:10 juju-e4d256-prod-github-runner-207 kernel: [45384.576271] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:00:10 juju-e4d256-prod-github-runner-207 kernel: [45384.577305] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:00:10 juju-e4d256-prod-github-runner-207 kernel: [45384.578358] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:00:10 juju-e4d256-prod-github-runner-207 kernel: [45384.579474] ? show_regs.part.0+0x23/0x29 Aug 22 18:00:10 juju-e4d256-prod-github-runner-207 kernel: [45384.580491] ? show_regs.cold+0x8/0xd Aug 22 18:00:10 juju-e4d256-prod-github-runner-207 kernel: [45384.581465] ? watchdog_timer_fn+0x1be/0x220 Aug 22 18:00:10 juju-e4d256-prod-github-runner-207 kernel: [45384.582504] ? lockup_detector_update_enable+0x60/0x60 Aug 22 18:00:10 juju-e4d256-prod-github-runner-207 kernel: [45384.583581] ? __hrtimer_run_queues+0x107/0x230 Aug 22 18:00:10 juju-e4d256-prod-github-runner-207 kernel: [45384.584669] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 18:00:10 juju-e4d256-prod-github-runner-207 kernel: [45384.585788] ? hrtimer_interrupt+0x101/0x220 Aug 22 18:00:10 juju-e4d256-prod-github-runner-207 kernel: [45384.586818] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 18:00:10 juju-e4d256-prod-github-runner-207 kernel: [45384.587961] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 18:00:10 juju-e4d256-prod-github-runner-207 kernel: [45384.589087] Aug 22 18:00:10 juju-e4d256-prod-github-runner-207 kernel: [45384.589977] Aug 22 18:00:10 juju-e4d256-prod-github-runner-207 kernel: [45384.590830] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 18:00:10 juju-e4d256-prod-github-runner-207 kernel: [45384.591862] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:00:10 juju-e4d256-prod-github-runner-207 kernel: [45384.592957] ? _raw_spin_lock+0x22/0x30 Aug 22 18:00:10 juju-e4d256-prod-github-runner-207 kernel: [45384.593930] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:00:10 juju-e4d256-prod-github-runner-207 kernel: [45384.594974] direct_page_fault+0x206/0x310 [kvm] Aug 22 18:00:10 juju-e4d256-prod-github-runner-207 kernel: [45384.596027] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 18:00:10 juju-e4d256-prod-github-runner-207 kernel: [45384.597036] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 18:00:10 juju-e4d256-prod-github-runner-207 kernel: [45384.598054] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 18:00:10 juju-e4d256-prod-github-runner-207 kernel: [45384.599111] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 18:00:10 juju-e4d256-prod-github-runner-207 kernel: [45384.600987] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 18:00:10 juju-e4d256-prod-github-runner-207 kernel: [45384.601984] handle_exit+0x98/0x230 [kvm_amd] Aug 22 18:00:10 juju-e4d256-prod-github-runner-207 kernel: [45384.602882] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 18:00:10 juju-e4d256-prod-github-runner-207 kernel: [45384.603799] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 18:00:10 juju-e4d256-prod-github-runner-207 kernel: [45384.604792] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 18:00:10 juju-e4d256-prod-github-runner-207 kernel: [45384.605718] vcpu_run+0x62/0x2c0 [kvm] Aug 22 18:00:10 juju-e4d256-prod-github-runner-207 kernel: [45384.606540] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 18:00:10 juju-e4d256-prod-github-runner-207 kernel: [45384.607348] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 18:00:10 juju-e4d256-prod-github-runner-207 kernel: [45384.608233] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 18:00:10 juju-e4d256-prod-github-runner-207 kernel: [45384.609032] ? __seccomp_filter+0x4a/0x4a0 Aug 22 18:00:10 juju-e4d256-prod-github-runner-207 kernel: [45384.609800] ? __fget_files+0x86/0xc0 Aug 22 18:00:10 juju-e4d256-prod-github-runner-207 kernel: [45384.610509] __x64_sys_ioctl+0x95/0xd0 Aug 22 18:00:10 juju-e4d256-prod-github-runner-207 kernel: [45384.611214] do_syscall_64+0x5c/0xc0 Aug 22 18:00:10 juju-e4d256-prod-github-runner-207 kernel: [45384.611892] ? do_futex+0x162/0x1f0 Aug 22 18:00:10 juju-e4d256-prod-github-runner-207 kernel: [45384.612565] ? __x64_sys_futex+0x78/0x1e0 Aug 22 18:00:10 juju-e4d256-prod-github-runner-207 kernel: [45384.613239] ? __secure_computing+0xa9/0x120 Aug 22 18:00:10 juju-e4d256-prod-github-runner-207 kernel: [45384.613936] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 18:00:10 juju-e4d256-prod-github-runner-207 kernel: [45384.614718] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:00:10 juju-e4d256-prod-github-runner-207 kernel: [45384.615441] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:00:10 juju-e4d256-prod-github-runner-207 kernel: [45384.616211] ? do_syscall_64+0x69/0xc0 Aug 22 18:00:10 juju-e4d256-prod-github-runner-207 kernel: [45384.616865] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:00:10 juju-e4d256-prod-github-runner-207 kernel: [45384.617590] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:00:10 juju-e4d256-prod-github-runner-207 kernel: [45384.618289] ? do_syscall_64+0x69/0xc0 Aug 22 18:00:10 juju-e4d256-prod-github-runner-207 kernel: [45384.618915] ? do_syscall_64+0x69/0xc0 Aug 22 18:00:10 juju-e4d256-prod-github-runner-207 kernel: [45384.619544] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 18:00:10 juju-e4d256-prod-github-runner-207 kernel: [45384.620271] RIP: 0033:0x7faa5d0edaff Aug 22 18:00:10 juju-e4d256-prod-github-runner-207 kernel: [45384.620948] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 18:00:10 juju-e4d256-prod-github-runner-207 kernel: [45384.622944] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 18:00:10 juju-e4d256-prod-github-runner-207 kernel: [45384.623860] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 18:00:10 juju-e4d256-prod-github-runner-207 kernel: [45384.624779] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 18:00:10 juju-e4d256-prod-github-runner-207 kernel: [45384.625673] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 18:00:10 juju-e4d256-prod-github-runner-207 kernel: [45384.626563] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 18:00:10 juju-e4d256-prod-github-runner-207 kernel: [45384.627450] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 18:00:10 juju-e4d256-prod-github-runner-207 kernel: [45384.628361] Aug 22 18:00:38 juju-e4d256-prod-github-runner-207 kernel: [45412.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 42185s! [qemu-system-x86:6715] Aug 22 18:00:38 juju-e4d256-prod-github-runner-207 kernel: [45412.543113] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 18:00:38 juju-e4d256-prod-github-runner-207 kernel: [45412.543192] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 18:00:38 juju-e4d256-prod-github-runner-207 kernel: [45412.555323] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 18:00:38 juju-e4d256-prod-github-runner-207 kernel: [45412.556600] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 18:00:38 juju-e4d256-prod-github-runner-207 kernel: [45412.557820] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:00:38 juju-e4d256-prod-github-runner-207 kernel: [45412.558876] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 18:00:38 juju-e4d256-prod-github-runner-207 kernel: [45412.561439] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 18:00:38 juju-e4d256-prod-github-runner-207 kernel: [45412.562486] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 18:00:38 juju-e4d256-prod-github-runner-207 kernel: [45412.563864] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 18:00:38 juju-e4d256-prod-github-runner-207 kernel: [45412.565030] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 18:00:38 juju-e4d256-prod-github-runner-207 kernel: [45412.566204] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 18:00:38 juju-e4d256-prod-github-runner-207 kernel: [45412.567369] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 18:00:38 juju-e4d256-prod-github-runner-207 kernel: [45412.568572] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 18:00:38 juju-e4d256-prod-github-runner-207 kernel: [45412.569807] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 18:00:38 juju-e4d256-prod-github-runner-207 kernel: [45412.570903] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 18:00:38 juju-e4d256-prod-github-runner-207 kernel: [45412.572118] Call Trace: Aug 22 18:00:38 juju-e4d256-prod-github-runner-207 kernel: [45412.573036] Aug 22 18:00:38 juju-e4d256-prod-github-runner-207 kernel: [45412.573921] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:00:38 juju-e4d256-prod-github-runner-207 kernel: [45412.574949] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:00:38 juju-e4d256-prod-github-runner-207 kernel: [45412.575983] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:00:38 juju-e4d256-prod-github-runner-207 kernel: [45412.577059] ? show_regs.part.0+0x23/0x29 Aug 22 18:00:38 juju-e4d256-prod-github-runner-207 kernel: [45412.578060] ? show_regs.cold+0x8/0xd Aug 22 18:00:38 juju-e4d256-prod-github-runner-207 kernel: [45412.579151] ? watchdog_timer_fn+0x1be/0x220 Aug 22 18:00:38 juju-e4d256-prod-github-runner-207 kernel: [45412.580262] ? lockup_detector_update_enable+0x60/0x60 Aug 22 18:00:38 juju-e4d256-prod-github-runner-207 kernel: [45412.581435] ? __hrtimer_run_queues+0x107/0x230 Aug 22 18:00:38 juju-e4d256-prod-github-runner-207 kernel: [45412.582557] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 18:00:38 juju-e4d256-prod-github-runner-207 kernel: [45412.583680] ? hrtimer_interrupt+0x101/0x220 Aug 22 18:00:38 juju-e4d256-prod-github-runner-207 kernel: [45412.584797] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 18:00:38 juju-e4d256-prod-github-runner-207 kernel: [45412.585967] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 18:00:38 juju-e4d256-prod-github-runner-207 kernel: [45412.587119] Aug 22 18:00:38 juju-e4d256-prod-github-runner-207 kernel: [45412.588038] Aug 22 18:00:38 juju-e4d256-prod-github-runner-207 kernel: [45412.588923] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 18:00:38 juju-e4d256-prod-github-runner-207 kernel: [45412.590118] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:00:38 juju-e4d256-prod-github-runner-207 kernel: [45412.591298] ? _raw_spin_lock+0x22/0x30 Aug 22 18:00:38 juju-e4d256-prod-github-runner-207 kernel: [45412.592355] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:00:38 juju-e4d256-prod-github-runner-207 kernel: [45412.593478] direct_page_fault+0x206/0x310 [kvm] Aug 22 18:00:38 juju-e4d256-prod-github-runner-207 kernel: [45412.594593] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 18:00:38 juju-e4d256-prod-github-runner-207 kernel: [45412.595737] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 18:00:38 juju-e4d256-prod-github-runner-207 kernel: [45412.596869] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 18:00:38 juju-e4d256-prod-github-runner-207 kernel: [45412.597960] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 18:00:38 juju-e4d256-prod-github-runner-207 kernel: [45412.598999] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 18:00:38 juju-e4d256-prod-github-runner-207 kernel: [45412.600096] handle_exit+0x98/0x230 [kvm_amd] Aug 22 18:00:38 juju-e4d256-prod-github-runner-207 kernel: [45412.601101] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 18:00:38 juju-e4d256-prod-github-runner-207 kernel: [45412.602109] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 18:00:38 juju-e4d256-prod-github-runner-207 kernel: [45412.603130] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 18:00:38 juju-e4d256-prod-github-runner-207 kernel: [45412.604179] vcpu_run+0x62/0x2c0 [kvm] Aug 22 18:00:38 juju-e4d256-prod-github-runner-207 kernel: [45412.605093] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 18:00:38 juju-e4d256-prod-github-runner-207 kernel: [45412.605989] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 18:00:38 juju-e4d256-prod-github-runner-207 kernel: [45412.606974] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 18:00:38 juju-e4d256-prod-github-runner-207 kernel: [45412.607903] ? __seccomp_filter+0x4a/0x4a0 Aug 22 18:00:38 juju-e4d256-prod-github-runner-207 kernel: [45412.608904] ? __fget_files+0x86/0xc0 Aug 22 18:00:38 juju-e4d256-prod-github-runner-207 kernel: [45412.609683] __x64_sys_ioctl+0x95/0xd0 Aug 22 18:00:38 juju-e4d256-prod-github-runner-207 kernel: [45412.610493] do_syscall_64+0x5c/0xc0 Aug 22 18:00:38 juju-e4d256-prod-github-runner-207 kernel: [45412.611236] ? do_futex+0x162/0x1f0 Aug 22 18:00:38 juju-e4d256-prod-github-runner-207 kernel: [45412.611986] ? __x64_sys_futex+0x78/0x1e0 Aug 22 18:00:38 juju-e4d256-prod-github-runner-207 kernel: [45412.612743] ? __secure_computing+0xa9/0x120 Aug 22 18:00:38 juju-e4d256-prod-github-runner-207 kernel: [45412.613522] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 18:00:38 juju-e4d256-prod-github-runner-207 kernel: [45412.614388] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:00:38 juju-e4d256-prod-github-runner-207 kernel: [45412.615207] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:00:38 juju-e4d256-prod-github-runner-207 kernel: [45412.616040] ? do_syscall_64+0x69/0xc0 Aug 22 18:00:38 juju-e4d256-prod-github-runner-207 kernel: [45412.616762] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:00:38 juju-e4d256-prod-github-runner-207 kernel: [45412.617560] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:00:38 juju-e4d256-prod-github-runner-207 kernel: [45412.618355] ? do_syscall_64+0x69/0xc0 Aug 22 18:00:38 juju-e4d256-prod-github-runner-207 kernel: [45412.619054] ? do_syscall_64+0x69/0xc0 Aug 22 18:00:38 juju-e4d256-prod-github-runner-207 kernel: [45412.619767] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 18:00:38 juju-e4d256-prod-github-runner-207 kernel: [45412.620570] RIP: 0033:0x7faa5d0edaff Aug 22 18:00:38 juju-e4d256-prod-github-runner-207 kernel: [45412.621266] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 18:00:38 juju-e4d256-prod-github-runner-207 kernel: [45412.623592] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 18:00:38 juju-e4d256-prod-github-runner-207 kernel: [45412.624663] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 18:00:38 juju-e4d256-prod-github-runner-207 kernel: [45412.625687] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 18:00:38 juju-e4d256-prod-github-runner-207 kernel: [45412.626707] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 18:00:38 juju-e4d256-prod-github-runner-207 kernel: [45412.627738] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 18:00:38 juju-e4d256-prod-github-runner-207 kernel: [45412.628759] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 18:00:38 juju-e4d256-prod-github-runner-207 kernel: [45412.629782] Aug 22 18:01:06 juju-e4d256-prod-github-runner-207 kernel: [45440.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 42211s! [qemu-system-x86:6715] Aug 22 18:01:06 juju-e4d256-prod-github-runner-207 kernel: [45440.543134] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 18:01:06 juju-e4d256-prod-github-runner-207 kernel: [45440.543207] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 18:01:06 juju-e4d256-prod-github-runner-207 kernel: [45440.555411] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 18:01:06 juju-e4d256-prod-github-runner-207 kernel: [45440.556687] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 18:01:06 juju-e4d256-prod-github-runner-207 kernel: [45440.557912] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:01:06 juju-e4d256-prod-github-runner-207 kernel: [45440.558971] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 18:01:06 juju-e4d256-prod-github-runner-207 kernel: [45440.561541] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 18:01:06 juju-e4d256-prod-github-runner-207 kernel: [45440.562585] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 18:01:06 juju-e4d256-prod-github-runner-207 kernel: [45440.563757] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 18:01:06 juju-e4d256-prod-github-runner-207 kernel: [45440.564937] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 18:01:06 juju-e4d256-prod-github-runner-207 kernel: [45440.566153] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 18:01:06 juju-e4d256-prod-github-runner-207 kernel: [45440.567471] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 18:01:06 juju-e4d256-prod-github-runner-207 kernel: [45440.568793] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 18:01:06 juju-e4d256-prod-github-runner-207 kernel: [45440.570072] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 18:01:06 juju-e4d256-prod-github-runner-207 kernel: [45440.571233] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 18:01:06 juju-e4d256-prod-github-runner-207 kernel: [45440.572446] Call Trace: Aug 22 18:01:06 juju-e4d256-prod-github-runner-207 kernel: [45440.573357] Aug 22 18:01:06 juju-e4d256-prod-github-runner-207 kernel: [45440.574241] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:01:06 juju-e4d256-prod-github-runner-207 kernel: [45440.575308] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:01:06 juju-e4d256-prod-github-runner-207 kernel: [45440.576367] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:01:06 juju-e4d256-prod-github-runner-207 kernel: [45440.577492] ? show_regs.part.0+0x23/0x29 Aug 22 18:01:06 juju-e4d256-prod-github-runner-207 kernel: [45440.578549] ? show_regs.cold+0x8/0xd Aug 22 18:01:06 juju-e4d256-prod-github-runner-207 kernel: [45440.579565] ? watchdog_timer_fn+0x1be/0x220 Aug 22 18:01:06 juju-e4d256-prod-github-runner-207 kernel: [45440.580613] ? lockup_detector_update_enable+0x60/0x60 Aug 22 18:01:06 juju-e4d256-prod-github-runner-207 kernel: [45440.581716] ? __hrtimer_run_queues+0x107/0x230 Aug 22 18:01:06 juju-e4d256-prod-github-runner-207 kernel: [45440.582747] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 18:01:06 juju-e4d256-prod-github-runner-207 kernel: [45440.583890] ? hrtimer_interrupt+0x101/0x220 Aug 22 18:01:06 juju-e4d256-prod-github-runner-207 kernel: [45440.584940] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 18:01:06 juju-e4d256-prod-github-runner-207 kernel: [45440.586046] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 18:01:06 juju-e4d256-prod-github-runner-207 kernel: [45440.587106] Aug 22 18:01:06 juju-e4d256-prod-github-runner-207 kernel: [45440.588003] Aug 22 18:01:06 juju-e4d256-prod-github-runner-207 kernel: [45440.588854] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 18:01:06 juju-e4d256-prod-github-runner-207 kernel: [45440.589923] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:01:06 juju-e4d256-prod-github-runner-207 kernel: [45440.590982] ? _raw_spin_lock+0x22/0x30 Aug 22 18:01:06 juju-e4d256-prod-github-runner-207 kernel: [45440.591984] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:01:06 juju-e4d256-prod-github-runner-207 kernel: [45440.593015] direct_page_fault+0x206/0x310 [kvm] Aug 22 18:01:06 juju-e4d256-prod-github-runner-207 kernel: [45440.594046] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 18:01:06 juju-e4d256-prod-github-runner-207 kernel: [45440.595133] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 18:01:06 juju-e4d256-prod-github-runner-207 kernel: [45440.596240] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 18:01:06 juju-e4d256-prod-github-runner-207 kernel: [45440.597239] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 18:01:06 juju-e4d256-prod-github-runner-207 kernel: [45440.598188] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 18:01:06 juju-e4d256-prod-github-runner-207 kernel: [45440.599165] handle_exit+0x98/0x230 [kvm_amd] Aug 22 18:01:06 juju-e4d256-prod-github-runner-207 kernel: [45440.600096] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 18:01:06 juju-e4d256-prod-github-runner-207 kernel: [45440.601031] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 18:01:06 juju-e4d256-prod-github-runner-207 kernel: [45440.601968] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 18:01:06 juju-e4d256-prod-github-runner-207 kernel: [45440.602882] vcpu_run+0x62/0x2c0 [kvm] Aug 22 18:01:06 juju-e4d256-prod-github-runner-207 kernel: [45440.603728] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 18:01:06 juju-e4d256-prod-github-runner-207 kernel: [45440.604546] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 18:01:06 juju-e4d256-prod-github-runner-207 kernel: [45440.605402] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 18:01:06 juju-e4d256-prod-github-runner-207 kernel: [45440.606222] ? __seccomp_filter+0x4a/0x4a0 Aug 22 18:01:06 juju-e4d256-prod-github-runner-207 kernel: [45440.606991] ? __fget_files+0x86/0xc0 Aug 22 18:01:06 juju-e4d256-prod-github-runner-207 kernel: [45440.607718] __x64_sys_ioctl+0x95/0xd0 Aug 22 18:01:06 juju-e4d256-prod-github-runner-207 kernel: [45440.608421] do_syscall_64+0x5c/0xc0 Aug 22 18:01:06 juju-e4d256-prod-github-runner-207 kernel: [45440.609094] ? do_futex+0x162/0x1f0 Aug 22 18:01:06 juju-e4d256-prod-github-runner-207 kernel: [45440.609742] ? __x64_sys_futex+0x78/0x1e0 Aug 22 18:01:06 juju-e4d256-prod-github-runner-207 kernel: [45440.610414] ? __secure_computing+0xa9/0x120 Aug 22 18:01:06 juju-e4d256-prod-github-runner-207 kernel: [45440.611128] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 18:01:06 juju-e4d256-prod-github-runner-207 kernel: [45440.611942] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:01:06 juju-e4d256-prod-github-runner-207 kernel: [45440.612667] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:01:06 juju-e4d256-prod-github-runner-207 kernel: [45440.613386] ? do_syscall_64+0x69/0xc0 Aug 22 18:01:06 juju-e4d256-prod-github-runner-207 kernel: [45440.614030] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:01:06 juju-e4d256-prod-github-runner-207 kernel: [45440.614734] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:01:06 juju-e4d256-prod-github-runner-207 kernel: [45440.615448] ? do_syscall_64+0x69/0xc0 Aug 22 18:01:06 juju-e4d256-prod-github-runner-207 kernel: [45440.616098] ? do_syscall_64+0x69/0xc0 Aug 22 18:01:06 juju-e4d256-prod-github-runner-207 kernel: [45440.616731] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 18:01:06 juju-e4d256-prod-github-runner-207 kernel: [45440.617470] RIP: 0033:0x7faa5d0edaff Aug 22 18:01:06 juju-e4d256-prod-github-runner-207 kernel: [45440.618226] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 18:01:06 juju-e4d256-prod-github-runner-207 kernel: [45440.620606] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 18:01:06 juju-e4d256-prod-github-runner-207 kernel: [45440.621694] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 18:01:06 juju-e4d256-prod-github-runner-207 kernel: [45440.622756] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 18:01:06 juju-e4d256-prod-github-runner-207 kernel: [45440.623803] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 18:01:06 juju-e4d256-prod-github-runner-207 kernel: [45440.624824] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 18:01:06 juju-e4d256-prod-github-runner-207 kernel: [45440.625900] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 18:01:06 juju-e4d256-prod-github-runner-207 kernel: [45440.626973] Aug 22 18:01:34 juju-e4d256-prod-github-runner-207 kernel: [45468.542477] watchdog: BUG: soft lockup - CPU#1 stuck for 42237s! [qemu-system-x86:6715] Aug 22 18:01:34 juju-e4d256-prod-github-runner-207 kernel: [45468.552662] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 18:01:34 juju-e4d256-prod-github-runner-207 kernel: [45468.552996] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 18:01:34 juju-e4d256-prod-github-runner-207 kernel: [45468.588096] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 18:01:34 juju-e4d256-prod-github-runner-207 kernel: [45468.589377] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 18:01:34 juju-e4d256-prod-github-runner-207 kernel: [45468.590594] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:01:34 juju-e4d256-prod-github-runner-207 kernel: [45468.591693] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 18:01:34 juju-e4d256-prod-github-runner-207 kernel: [45468.594315] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 18:01:34 juju-e4d256-prod-github-runner-207 kernel: [45468.595422] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 18:01:34 juju-e4d256-prod-github-runner-207 kernel: [45468.596595] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 18:01:34 juju-e4d256-prod-github-runner-207 kernel: [45468.597841] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 18:01:34 juju-e4d256-prod-github-runner-207 kernel: [45468.599081] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 18:01:34 juju-e4d256-prod-github-runner-207 kernel: [45468.600278] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 18:01:34 juju-e4d256-prod-github-runner-207 kernel: [45468.601447] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 18:01:34 juju-e4d256-prod-github-runner-207 kernel: [45468.602685] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 18:01:34 juju-e4d256-prod-github-runner-207 kernel: [45468.603849] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 18:01:34 juju-e4d256-prod-github-runner-207 kernel: [45468.605140] Call Trace: Aug 22 18:01:34 juju-e4d256-prod-github-runner-207 kernel: [45468.606068] Aug 22 18:01:34 juju-e4d256-prod-github-runner-207 kernel: [45468.607007] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:01:34 juju-e4d256-prod-github-runner-207 kernel: [45468.608047] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:01:34 juju-e4d256-prod-github-runner-207 kernel: [45468.609173] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:01:34 juju-e4d256-prod-github-runner-207 kernel: [45468.610337] ? show_regs.part.0+0x23/0x29 Aug 22 18:01:34 juju-e4d256-prod-github-runner-207 kernel: [45468.611387] ? show_regs.cold+0x8/0xd Aug 22 18:01:34 juju-e4d256-prod-github-runner-207 kernel: [45468.612364] ? watchdog_timer_fn+0x1be/0x220 Aug 22 18:01:34 juju-e4d256-prod-github-runner-207 kernel: [45468.613370] ? lockup_detector_update_enable+0x60/0x60 Aug 22 18:01:34 juju-e4d256-prod-github-runner-207 kernel: [45468.614468] ? __hrtimer_run_queues+0x107/0x230 Aug 22 18:01:34 juju-e4d256-prod-github-runner-207 kernel: [45468.615571] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 18:01:34 juju-e4d256-prod-github-runner-207 kernel: [45468.616607] ? hrtimer_interrupt+0x101/0x220 Aug 22 18:01:34 juju-e4d256-prod-github-runner-207 kernel: [45468.617640] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 18:01:34 juju-e4d256-prod-github-runner-207 kernel: [45468.618724] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 18:01:34 juju-e4d256-prod-github-runner-207 kernel: [45468.619819] Aug 22 18:01:34 juju-e4d256-prod-github-runner-207 kernel: [45468.620695] Aug 22 18:01:34 juju-e4d256-prod-github-runner-207 kernel: [45468.621550] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 18:01:34 juju-e4d256-prod-github-runner-207 kernel: [45468.622592] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:01:34 juju-e4d256-prod-github-runner-207 kernel: [45468.623656] ? _raw_spin_lock+0x22/0x30 Aug 22 18:01:34 juju-e4d256-prod-github-runner-207 kernel: [45468.624618] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:01:34 juju-e4d256-prod-github-runner-207 kernel: [45468.625704] direct_page_fault+0x206/0x310 [kvm] Aug 22 18:01:34 juju-e4d256-prod-github-runner-207 kernel: [45468.626739] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 18:01:34 juju-e4d256-prod-github-runner-207 kernel: [45468.627789] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 18:01:34 juju-e4d256-prod-github-runner-207 kernel: [45468.628798] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 18:01:34 juju-e4d256-prod-github-runner-207 kernel: [45468.629827] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 18:01:34 juju-e4d256-prod-github-runner-207 kernel: [45468.630818] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 18:01:34 juju-e4d256-prod-github-runner-207 kernel: [45468.631824] handle_exit+0x98/0x230 [kvm_amd] Aug 22 18:01:34 juju-e4d256-prod-github-runner-207 kernel: [45468.632727] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 18:01:34 juju-e4d256-prod-github-runner-207 kernel: [45468.633646] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 18:01:34 juju-e4d256-prod-github-runner-207 kernel: [45468.634581] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 18:01:34 juju-e4d256-prod-github-runner-207 kernel: [45468.635520] vcpu_run+0x62/0x2c0 [kvm] Aug 22 18:01:34 juju-e4d256-prod-github-runner-207 kernel: [45468.636361] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 18:01:34 juju-e4d256-prod-github-runner-207 kernel: [45468.637169] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 18:01:34 juju-e4d256-prod-github-runner-207 kernel: [45468.638026] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 18:01:34 juju-e4d256-prod-github-runner-207 kernel: [45468.638824] ? __seccomp_filter+0x4a/0x4a0 Aug 22 18:01:34 juju-e4d256-prod-github-runner-207 kernel: [45468.639690] ? __fget_files+0x86/0xc0 Aug 22 18:01:34 juju-e4d256-prod-github-runner-207 kernel: [45468.640434] __x64_sys_ioctl+0x95/0xd0 Aug 22 18:01:34 juju-e4d256-prod-github-runner-207 kernel: [45468.641153] do_syscall_64+0x5c/0xc0 Aug 22 18:01:34 juju-e4d256-prod-github-runner-207 kernel: [45468.641828] ? do_futex+0x162/0x1f0 Aug 22 18:01:34 juju-e4d256-prod-github-runner-207 kernel: [45468.642482] ? __x64_sys_futex+0x78/0x1e0 Aug 22 18:01:34 juju-e4d256-prod-github-runner-207 kernel: [45468.643246] ? __secure_computing+0xa9/0x120 Aug 22 18:01:34 juju-e4d256-prod-github-runner-207 kernel: [45468.643982] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 18:01:34 juju-e4d256-prod-github-runner-207 kernel: [45468.644761] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:01:34 juju-e4d256-prod-github-runner-207 kernel: [45468.645498] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:01:34 juju-e4d256-prod-github-runner-207 kernel: [45468.646267] ? do_syscall_64+0x69/0xc0 Aug 22 18:01:34 juju-e4d256-prod-github-runner-207 kernel: [45468.646986] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:01:34 juju-e4d256-prod-github-runner-207 kernel: [45468.647702] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:01:34 juju-e4d256-prod-github-runner-207 kernel: [45468.648395] ? do_syscall_64+0x69/0xc0 Aug 22 18:01:34 juju-e4d256-prod-github-runner-207 kernel: [45468.649019] ? do_syscall_64+0x69/0xc0 Aug 22 18:01:34 juju-e4d256-prod-github-runner-207 kernel: [45468.649656] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 18:01:34 juju-e4d256-prod-github-runner-207 kernel: [45468.650409] RIP: 0033:0x7faa5d0edaff Aug 22 18:01:34 juju-e4d256-prod-github-runner-207 kernel: [45468.651111] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 18:01:34 juju-e4d256-prod-github-runner-207 kernel: [45468.653127] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 18:01:34 juju-e4d256-prod-github-runner-207 kernel: [45468.654047] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 18:01:34 juju-e4d256-prod-github-runner-207 kernel: [45468.654964] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 18:01:34 juju-e4d256-prod-github-runner-207 kernel: [45468.655873] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 18:01:34 juju-e4d256-prod-github-runner-207 kernel: [45468.656791] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 18:01:34 juju-e4d256-prod-github-runner-207 kernel: [45468.657694] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 18:01:34 juju-e4d256-prod-github-runner-207 kernel: [45468.658740] Aug 22 18:02:02 juju-e4d256-prod-github-runner-207 kernel: [45496.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 42263s! [qemu-system-x86:6715] Aug 22 18:02:02 juju-e4d256-prod-github-runner-207 kernel: [45496.543128] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 18:02:02 juju-e4d256-prod-github-runner-207 kernel: [45496.543204] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 18:02:02 juju-e4d256-prod-github-runner-207 kernel: [45496.555393] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 18:02:02 juju-e4d256-prod-github-runner-207 kernel: [45496.556679] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 18:02:02 juju-e4d256-prod-github-runner-207 kernel: [45496.558134] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:02:02 juju-e4d256-prod-github-runner-207 kernel: [45496.559476] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 18:02:02 juju-e4d256-prod-github-runner-207 kernel: [45496.563506] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 18:02:02 juju-e4d256-prod-github-runner-207 kernel: [45496.564554] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 18:02:02 juju-e4d256-prod-github-runner-207 kernel: [45496.565753] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 18:02:02 juju-e4d256-prod-github-runner-207 kernel: [45496.567013] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 18:02:02 juju-e4d256-prod-github-runner-207 kernel: [45496.568195] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 18:02:02 juju-e4d256-prod-github-runner-207 kernel: [45496.569355] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 18:02:02 juju-e4d256-prod-github-runner-207 kernel: [45496.570523] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 18:02:02 juju-e4d256-prod-github-runner-207 kernel: [45496.571778] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 18:02:02 juju-e4d256-prod-github-runner-207 kernel: [45496.572891] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 18:02:02 juju-e4d256-prod-github-runner-207 kernel: [45496.574080] Call Trace: Aug 22 18:02:02 juju-e4d256-prod-github-runner-207 kernel: [45496.575017] Aug 22 18:02:02 juju-e4d256-prod-github-runner-207 kernel: [45496.575900] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:02:02 juju-e4d256-prod-github-runner-207 kernel: [45496.577226] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:02:02 juju-e4d256-prod-github-runner-207 kernel: [45496.578337] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:02:02 juju-e4d256-prod-github-runner-207 kernel: [45496.579527] ? show_regs.part.0+0x23/0x29 Aug 22 18:02:02 juju-e4d256-prod-github-runner-207 kernel: [45496.580604] ? show_regs.cold+0x8/0xd Aug 22 18:02:02 juju-e4d256-prod-github-runner-207 kernel: [45496.581646] ? watchdog_timer_fn+0x1be/0x220 Aug 22 18:02:02 juju-e4d256-prod-github-runner-207 kernel: [45496.582761] ? lockup_detector_update_enable+0x60/0x60 Aug 22 18:02:02 juju-e4d256-prod-github-runner-207 kernel: [45496.583926] ? __hrtimer_run_queues+0x107/0x230 Aug 22 18:02:02 juju-e4d256-prod-github-runner-207 kernel: [45496.585042] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 18:02:02 juju-e4d256-prod-github-runner-207 kernel: [45496.586154] ? hrtimer_interrupt+0x101/0x220 Aug 22 18:02:02 juju-e4d256-prod-github-runner-207 kernel: [45496.587270] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 18:02:02 juju-e4d256-prod-github-runner-207 kernel: [45496.588489] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 18:02:02 juju-e4d256-prod-github-runner-207 kernel: [45496.589642] Aug 22 18:02:02 juju-e4d256-prod-github-runner-207 kernel: [45496.590547] Aug 22 18:02:02 juju-e4d256-prod-github-runner-207 kernel: [45496.591453] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 18:02:02 juju-e4d256-prod-github-runner-207 kernel: [45496.592597] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:02:02 juju-e4d256-prod-github-runner-207 kernel: [45496.593755] ? _raw_spin_lock+0x22/0x30 Aug 22 18:02:02 juju-e4d256-prod-github-runner-207 kernel: [45496.594822] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:02:02 juju-e4d256-prod-github-runner-207 kernel: [45496.595944] direct_page_fault+0x206/0x310 [kvm] Aug 22 18:02:02 juju-e4d256-prod-github-runner-207 kernel: [45496.597059] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 18:02:02 juju-e4d256-prod-github-runner-207 kernel: [45496.598170] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 18:02:02 juju-e4d256-prod-github-runner-207 kernel: [45496.599340] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 18:02:02 juju-e4d256-prod-github-runner-207 kernel: [45496.600365] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 18:02:02 juju-e4d256-prod-github-runner-207 kernel: [45496.601327] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 18:02:02 juju-e4d256-prod-github-runner-207 kernel: [45496.602312] handle_exit+0x98/0x230 [kvm_amd] Aug 22 18:02:02 juju-e4d256-prod-github-runner-207 kernel: [45496.603235] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 18:02:02 juju-e4d256-prod-github-runner-207 kernel: [45496.604156] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 18:02:02 juju-e4d256-prod-github-runner-207 kernel: [45496.605084] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 18:02:02 juju-e4d256-prod-github-runner-207 kernel: [45496.605992] vcpu_run+0x62/0x2c0 [kvm] Aug 22 18:02:02 juju-e4d256-prod-github-runner-207 kernel: [45496.606835] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 18:02:02 juju-e4d256-prod-github-runner-207 kernel: [45496.607652] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 18:02:02 juju-e4d256-prod-github-runner-207 kernel: [45496.608513] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 18:02:02 juju-e4d256-prod-github-runner-207 kernel: [45496.609318] ? __seccomp_filter+0x4a/0x4a0 Aug 22 18:02:02 juju-e4d256-prod-github-runner-207 kernel: [45496.610064] ? __fget_files+0x86/0xc0 Aug 22 18:02:02 juju-e4d256-prod-github-runner-207 kernel: [45496.610816] __x64_sys_ioctl+0x95/0xd0 Aug 22 18:02:02 juju-e4d256-prod-github-runner-207 kernel: [45496.611517] do_syscall_64+0x5c/0xc0 Aug 22 18:02:02 juju-e4d256-prod-github-runner-207 kernel: [45496.612196] ? do_futex+0x162/0x1f0 Aug 22 18:02:02 juju-e4d256-prod-github-runner-207 kernel: [45496.612848] ? __x64_sys_futex+0x78/0x1e0 Aug 22 18:02:02 juju-e4d256-prod-github-runner-207 kernel: [45496.613529] ? __secure_computing+0xa9/0x120 Aug 22 18:02:02 juju-e4d256-prod-github-runner-207 kernel: [45496.614246] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 18:02:02 juju-e4d256-prod-github-runner-207 kernel: [45496.615028] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:02:02 juju-e4d256-prod-github-runner-207 kernel: [45496.615758] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:02:02 juju-e4d256-prod-github-runner-207 kernel: [45496.616483] ? do_syscall_64+0x69/0xc0 Aug 22 18:02:02 juju-e4d256-prod-github-runner-207 kernel: [45496.617132] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:02:02 juju-e4d256-prod-github-runner-207 kernel: [45496.617836] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:02:02 juju-e4d256-prod-github-runner-207 kernel: [45496.618531] ? do_syscall_64+0x69/0xc0 Aug 22 18:02:02 juju-e4d256-prod-github-runner-207 kernel: [45496.619185] ? do_syscall_64+0x69/0xc0 Aug 22 18:02:02 juju-e4d256-prod-github-runner-207 kernel: [45496.619808] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 18:02:02 juju-e4d256-prod-github-runner-207 kernel: [45496.620519] RIP: 0033:0x7faa5d0edaff Aug 22 18:02:02 juju-e4d256-prod-github-runner-207 kernel: [45496.621165] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 18:02:02 juju-e4d256-prod-github-runner-207 kernel: [45496.623173] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 18:02:02 juju-e4d256-prod-github-runner-207 kernel: [45496.624087] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 18:02:02 juju-e4d256-prod-github-runner-207 kernel: [45496.624978] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 18:02:02 juju-e4d256-prod-github-runner-207 kernel: [45496.625869] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 18:02:02 juju-e4d256-prod-github-runner-207 kernel: [45496.626781] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 18:02:02 juju-e4d256-prod-github-runner-207 kernel: [45496.627673] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 18:02:02 juju-e4d256-prod-github-runner-207 kernel: [45496.628567] Aug 22 18:02:30 juju-e4d256-prod-github-runner-207 kernel: [45524.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 42290s! [qemu-system-x86:6715] Aug 22 18:02:30 juju-e4d256-prod-github-runner-207 kernel: [45524.543138] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 18:02:30 juju-e4d256-prod-github-runner-207 kernel: [45524.543216] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 18:02:30 juju-e4d256-prod-github-runner-207 kernel: [45524.556104] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 18:02:30 juju-e4d256-prod-github-runner-207 kernel: [45524.557377] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 18:02:30 juju-e4d256-prod-github-runner-207 kernel: [45524.558619] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:02:30 juju-e4d256-prod-github-runner-207 kernel: [45524.559681] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 18:02:30 juju-e4d256-prod-github-runner-207 kernel: [45524.562281] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 18:02:30 juju-e4d256-prod-github-runner-207 kernel: [45524.563332] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 18:02:30 juju-e4d256-prod-github-runner-207 kernel: [45524.564500] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 18:02:30 juju-e4d256-prod-github-runner-207 kernel: [45524.567232] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 18:02:30 juju-e4d256-prod-github-runner-207 kernel: [45524.569155] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 18:02:30 juju-e4d256-prod-github-runner-207 kernel: [45524.570359] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 18:02:30 juju-e4d256-prod-github-runner-207 kernel: [45524.571570] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 18:02:30 juju-e4d256-prod-github-runner-207 kernel: [45524.572839] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 18:02:30 juju-e4d256-prod-github-runner-207 kernel: [45524.574043] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 18:02:30 juju-e4d256-prod-github-runner-207 kernel: [45524.575301] Call Trace: Aug 22 18:02:30 juju-e4d256-prod-github-runner-207 kernel: [45524.576223] Aug 22 18:02:30 juju-e4d256-prod-github-runner-207 kernel: [45524.577154] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:02:30 juju-e4d256-prod-github-runner-207 kernel: [45524.578263] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:02:30 juju-e4d256-prod-github-runner-207 kernel: [45524.579390] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:02:30 juju-e4d256-prod-github-runner-207 kernel: [45524.580495] ? show_regs.part.0+0x23/0x29 Aug 22 18:02:30 juju-e4d256-prod-github-runner-207 kernel: [45524.581502] ? show_regs.cold+0x8/0xd Aug 22 18:02:30 juju-e4d256-prod-github-runner-207 kernel: [45524.582518] ? watchdog_timer_fn+0x1be/0x220 Aug 22 18:02:30 juju-e4d256-prod-github-runner-207 kernel: [45524.583599] ? lockup_detector_update_enable+0x60/0x60 Aug 22 18:02:30 juju-e4d256-prod-github-runner-207 kernel: [45524.584693] ? __hrtimer_run_queues+0x107/0x230 Aug 22 18:02:30 juju-e4d256-prod-github-runner-207 kernel: [45524.585837] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 18:02:30 juju-e4d256-prod-github-runner-207 kernel: [45524.586920] ? hrtimer_interrupt+0x101/0x220 Aug 22 18:02:30 juju-e4d256-prod-github-runner-207 kernel: [45524.587976] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 18:02:30 juju-e4d256-prod-github-runner-207 kernel: [45524.589065] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 18:02:30 juju-e4d256-prod-github-runner-207 kernel: [45524.590120] Aug 22 18:02:30 juju-e4d256-prod-github-runner-207 kernel: [45524.590999] Aug 22 18:02:30 juju-e4d256-prod-github-runner-207 kernel: [45524.591876] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 18:02:30 juju-e4d256-prod-github-runner-207 kernel: [45524.592932] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:02:30 juju-e4d256-prod-github-runner-207 kernel: [45524.593994] ? _raw_spin_lock+0x22/0x30 Aug 22 18:02:30 juju-e4d256-prod-github-runner-207 kernel: [45524.595099] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:02:30 juju-e4d256-prod-github-runner-207 kernel: [45524.596132] direct_page_fault+0x206/0x310 [kvm] Aug 22 18:02:30 juju-e4d256-prod-github-runner-207 kernel: [45524.597169] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 18:02:30 juju-e4d256-prod-github-runner-207 kernel: [45524.598208] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 18:02:30 juju-e4d256-prod-github-runner-207 kernel: [45524.599250] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 18:02:30 juju-e4d256-prod-github-runner-207 kernel: [45524.600234] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 18:02:30 juju-e4d256-prod-github-runner-207 kernel: [45524.601191] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 18:02:30 juju-e4d256-prod-github-runner-207 kernel: [45524.602179] handle_exit+0x98/0x230 [kvm_amd] Aug 22 18:02:30 juju-e4d256-prod-github-runner-207 kernel: [45524.603113] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 18:02:30 juju-e4d256-prod-github-runner-207 kernel: [45524.604146] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 18:02:30 juju-e4d256-prod-github-runner-207 kernel: [45524.605118] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 18:02:30 juju-e4d256-prod-github-runner-207 kernel: [45524.606034] vcpu_run+0x62/0x2c0 [kvm] Aug 22 18:02:30 juju-e4d256-prod-github-runner-207 kernel: [45524.606870] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 18:02:30 juju-e4d256-prod-github-runner-207 kernel: [45524.607705] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 18:02:30 juju-e4d256-prod-github-runner-207 kernel: [45524.608622] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 18:02:30 juju-e4d256-prod-github-runner-207 kernel: [45524.609454] ? __seccomp_filter+0x4a/0x4a0 Aug 22 18:02:30 juju-e4d256-prod-github-runner-207 kernel: [45524.610213] ? __fget_files+0x86/0xc0 Aug 22 18:02:30 juju-e4d256-prod-github-runner-207 kernel: [45524.610958] __x64_sys_ioctl+0x95/0xd0 Aug 22 18:02:30 juju-e4d256-prod-github-runner-207 kernel: [45524.611659] do_syscall_64+0x5c/0xc0 Aug 22 18:02:30 juju-e4d256-prod-github-runner-207 kernel: [45524.612332] ? do_futex+0x162/0x1f0 Aug 22 18:02:30 juju-e4d256-prod-github-runner-207 kernel: [45524.612992] ? __x64_sys_futex+0x78/0x1e0 Aug 22 18:02:30 juju-e4d256-prod-github-runner-207 kernel: [45524.613694] ? __secure_computing+0xa9/0x120 Aug 22 18:02:30 juju-e4d256-prod-github-runner-207 kernel: [45524.614472] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 18:02:30 juju-e4d256-prod-github-runner-207 kernel: [45524.615261] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:02:30 juju-e4d256-prod-github-runner-207 kernel: [45524.615995] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:02:30 juju-e4d256-prod-github-runner-207 kernel: [45524.616719] ? do_syscall_64+0x69/0xc0 Aug 22 18:02:30 juju-e4d256-prod-github-runner-207 kernel: [45524.617369] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:02:30 juju-e4d256-prod-github-runner-207 kernel: [45524.618132] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:02:30 juju-e4d256-prod-github-runner-207 kernel: [45524.618897] ? do_syscall_64+0x69/0xc0 Aug 22 18:02:30 juju-e4d256-prod-github-runner-207 kernel: [45524.619533] ? do_syscall_64+0x69/0xc0 Aug 22 18:02:30 juju-e4d256-prod-github-runner-207 kernel: [45524.620188] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 18:02:30 juju-e4d256-prod-github-runner-207 kernel: [45524.620898] RIP: 0033:0x7faa5d0edaff Aug 22 18:02:30 juju-e4d256-prod-github-runner-207 kernel: [45524.621528] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 18:02:30 juju-e4d256-prod-github-runner-207 kernel: [45524.623562] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 18:02:30 juju-e4d256-prod-github-runner-207 kernel: [45524.624524] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 18:02:30 juju-e4d256-prod-github-runner-207 kernel: [45524.625591] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 18:02:30 juju-e4d256-prod-github-runner-207 kernel: [45524.626644] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 18:02:30 juju-e4d256-prod-github-runner-207 kernel: [45524.627683] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 18:02:30 juju-e4d256-prod-github-runner-207 kernel: [45524.628739] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 18:02:30 juju-e4d256-prod-github-runner-207 kernel: [45524.629809] Aug 22 18:02:46 juju-e4d256-prod-github-runner-207 kernel: [45540.224718] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 18:02:46 juju-e4d256-prod-github-runner-207 kernel: [45540.225732] rcu: 1-....: (11320165 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=5479469 Aug 22 18:02:46 juju-e4d256-prod-github-runner-207 kernel: [45540.226949] (t=11355756 jiffies g=23269 q=44668) Aug 22 18:02:46 juju-e4d256-prod-github-runner-207 kernel: [45540.227824] NMI backtrace for cpu 1 Aug 22 18:02:46 juju-e4d256-prod-github-runner-207 kernel: [45540.228607] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 18:02:46 juju-e4d256-prod-github-runner-207 kernel: [45540.229761] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 18:02:46 juju-e4d256-prod-github-runner-207 kernel: [45540.230868] Call Trace: Aug 22 18:02:46 juju-e4d256-prod-github-runner-207 kernel: [45540.231592] Aug 22 18:02:46 juju-e4d256-prod-github-runner-207 kernel: [45540.232249] show_stack+0x52/0x5c Aug 22 18:02:46 juju-e4d256-prod-github-runner-207 kernel: [45540.233008] dump_stack_lvl+0x4a/0x63 Aug 22 18:02:46 juju-e4d256-prod-github-runner-207 kernel: [45540.233775] dump_stack+0x10/0x16 Aug 22 18:02:46 juju-e4d256-prod-github-runner-207 kernel: [45540.234512] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 18:02:46 juju-e4d256-prod-github-runner-207 kernel: [45540.235313] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 18:02:46 juju-e4d256-prod-github-runner-207 kernel: [45540.236101] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 18:02:46 juju-e4d256-prod-github-runner-207 kernel: [45540.236973] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 18:02:46 juju-e4d256-prod-github-runner-207 kernel: [45540.237989] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 18:02:46 juju-e4d256-prod-github-runner-207 kernel: [45540.238834] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 18:02:46 juju-e4d256-prod-github-runner-207 kernel: [45540.239608] print_cpu_stall.cold+0x2f/0xe2 Aug 22 18:02:46 juju-e4d256-prod-github-runner-207 kernel: [45540.240374] ? timekeeping_update+0xf7/0x150 Aug 22 18:02:46 juju-e4d256-prod-github-runner-207 kernel: [45540.241150] check_cpu_stall+0x109/0x270 Aug 22 18:02:46 juju-e4d256-prod-github-runner-207 kernel: [45540.241899] rcu_sched_clock_irq+0x9a/0x250 Aug 22 18:02:46 juju-e4d256-prod-github-runner-207 kernel: [45540.242734] update_process_times+0x94/0xd0 Aug 22 18:02:46 juju-e4d256-prod-github-runner-207 kernel: [45540.243518] tick_sched_handle+0x29/0x70 Aug 22 18:02:46 juju-e4d256-prod-github-runner-207 kernel: [45540.244272] tick_sched_timer+0x8c/0xc0 Aug 22 18:02:46 juju-e4d256-prod-github-runner-207 kernel: [45540.245014] ? tick_nohz_handler+0xb0/0xb0 Aug 22 18:02:46 juju-e4d256-prod-github-runner-207 kernel: [45540.245788] __hrtimer_run_queues+0x107/0x230 Aug 22 18:02:46 juju-e4d256-prod-github-runner-207 kernel: [45540.246604] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 18:02:46 juju-e4d256-prod-github-runner-207 kernel: [45540.247583] hrtimer_interrupt+0x101/0x220 Aug 22 18:02:46 juju-e4d256-prod-github-runner-207 kernel: [45540.248365] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 18:02:46 juju-e4d256-prod-github-runner-207 kernel: [45540.249192] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 18:02:46 juju-e4d256-prod-github-runner-207 kernel: [45540.249996] Aug 22 18:02:46 juju-e4d256-prod-github-runner-207 kernel: [45540.250669] Aug 22 18:02:46 juju-e4d256-prod-github-runner-207 kernel: [45540.251304] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 18:02:46 juju-e4d256-prod-github-runner-207 kernel: [45540.252123] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:02:46 juju-e4d256-prod-github-runner-207 kernel: [45540.253004] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 18:02:46 juju-e4d256-prod-github-runner-207 kernel: [45540.255251] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 18:02:46 juju-e4d256-prod-github-runner-207 kernel: [45540.256149] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 18:02:46 juju-e4d256-prod-github-runner-207 kernel: [45540.257159] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 18:02:46 juju-e4d256-prod-github-runner-207 kernel: [45540.258162] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 18:02:46 juju-e4d256-prod-github-runner-207 kernel: [45540.259172] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 18:02:46 juju-e4d256-prod-github-runner-207 kernel: [45540.260131] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 18:02:46 juju-e4d256-prod-github-runner-207 kernel: [45540.261089] ? _raw_spin_lock+0x22/0x30 Aug 22 18:02:46 juju-e4d256-prod-github-runner-207 kernel: [45540.261870] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:02:46 juju-e4d256-prod-github-runner-207 kernel: [45540.262785] direct_page_fault+0x206/0x310 [kvm] Aug 22 18:02:46 juju-e4d256-prod-github-runner-207 kernel: [45540.263639] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 18:02:46 juju-e4d256-prod-github-runner-207 kernel: [45540.264475] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 18:02:46 juju-e4d256-prod-github-runner-207 kernel: [45540.265332] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 18:02:46 juju-e4d256-prod-github-runner-207 kernel: [45540.266168] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 18:02:46 juju-e4d256-prod-github-runner-207 kernel: [45540.266955] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 18:02:46 juju-e4d256-prod-github-runner-207 kernel: [45540.267777] handle_exit+0x98/0x230 [kvm_amd] Aug 22 18:02:46 juju-e4d256-prod-github-runner-207 kernel: [45540.268555] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 18:02:46 juju-e4d256-prod-github-runner-207 kernel: [45540.269454] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 18:02:46 juju-e4d256-prod-github-runner-207 kernel: [45540.270334] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 18:02:46 juju-e4d256-prod-github-runner-207 kernel: [45540.271216] vcpu_run+0x62/0x2c0 [kvm] Aug 22 18:02:46 juju-e4d256-prod-github-runner-207 kernel: [45540.272044] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 18:02:46 juju-e4d256-prod-github-runner-207 kernel: [45540.272832] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 18:02:46 juju-e4d256-prod-github-runner-207 kernel: [45540.273750] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 18:02:46 juju-e4d256-prod-github-runner-207 kernel: [45540.274749] ? __seccomp_filter+0x4a/0x4a0 Aug 22 18:02:46 juju-e4d256-prod-github-runner-207 kernel: [45540.275548] ? __fget_files+0x86/0xc0 Aug 22 18:02:46 juju-e4d256-prod-github-runner-207 kernel: [45540.276300] __x64_sys_ioctl+0x95/0xd0 Aug 22 18:02:46 juju-e4d256-prod-github-runner-207 kernel: [45540.277056] do_syscall_64+0x5c/0xc0 Aug 22 18:02:46 juju-e4d256-prod-github-runner-207 kernel: [45540.277750] ? do_futex+0x162/0x1f0 Aug 22 18:02:46 juju-e4d256-prod-github-runner-207 kernel: [45540.278451] ? __x64_sys_futex+0x78/0x1e0 Aug 22 18:02:46 juju-e4d256-prod-github-runner-207 kernel: [45540.279163] ? __secure_computing+0xa9/0x120 Aug 22 18:02:46 juju-e4d256-prod-github-runner-207 kernel: [45540.279887] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 18:02:46 juju-e4d256-prod-github-runner-207 kernel: [45540.280680] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:02:46 juju-e4d256-prod-github-runner-207 kernel: [45540.281499] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:02:46 juju-e4d256-prod-github-runner-207 kernel: [45540.282276] ? do_syscall_64+0x69/0xc0 Aug 22 18:02:46 juju-e4d256-prod-github-runner-207 kernel: [45540.283116] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:02:46 juju-e4d256-prod-github-runner-207 kernel: [45540.283871] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:02:46 juju-e4d256-prod-github-runner-207 kernel: [45540.284658] ? do_syscall_64+0x69/0xc0 Aug 22 18:02:46 juju-e4d256-prod-github-runner-207 kernel: [45540.285372] ? do_syscall_64+0x69/0xc0 Aug 22 18:02:46 juju-e4d256-prod-github-runner-207 kernel: [45540.286106] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 18:02:46 juju-e4d256-prod-github-runner-207 kernel: [45540.286888] RIP: 0033:0x7faa5d0edaff Aug 22 18:02:46 juju-e4d256-prod-github-runner-207 kernel: [45540.287574] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 18:02:46 juju-e4d256-prod-github-runner-207 kernel: [45540.289684] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 18:02:46 juju-e4d256-prod-github-runner-207 kernel: [45540.290771] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 18:02:46 juju-e4d256-prod-github-runner-207 kernel: [45540.291740] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 18:02:46 juju-e4d256-prod-github-runner-207 kernel: [45540.292685] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 18:02:46 juju-e4d256-prod-github-runner-207 kernel: [45540.293626] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 18:02:46 juju-e4d256-prod-github-runner-207 kernel: [45540.294584] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 18:02:46 juju-e4d256-prod-github-runner-207 kernel: [45540.295544] Aug 22 18:03:10 juju-e4d256-prod-github-runner-207 kernel: [45564.541982] watchdog: BUG: soft lockup - CPU#1 stuck for 42327s! [qemu-system-x86:6715] Aug 22 18:03:10 juju-e4d256-prod-github-runner-207 kernel: [45564.544392] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 18:03:10 juju-e4d256-prod-github-runner-207 kernel: [45564.544748] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 18:03:10 juju-e4d256-prod-github-runner-207 kernel: [45564.560939] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 18:03:10 juju-e4d256-prod-github-runner-207 kernel: [45564.562276] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 18:03:10 juju-e4d256-prod-github-runner-207 kernel: [45564.563532] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:03:10 juju-e4d256-prod-github-runner-207 kernel: [45564.564623] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 18:03:10 juju-e4d256-prod-github-runner-207 kernel: [45564.567263] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 18:03:10 juju-e4d256-prod-github-runner-207 kernel: [45564.568385] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 18:03:10 juju-e4d256-prod-github-runner-207 kernel: [45564.569561] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 18:03:10 juju-e4d256-prod-github-runner-207 kernel: [45564.570747] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 18:03:10 juju-e4d256-prod-github-runner-207 kernel: [45564.571959] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 18:03:10 juju-e4d256-prod-github-runner-207 kernel: [45564.573137] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 18:03:10 juju-e4d256-prod-github-runner-207 kernel: [45564.574355] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 18:03:10 juju-e4d256-prod-github-runner-207 kernel: [45564.575594] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 18:03:10 juju-e4d256-prod-github-runner-207 kernel: [45564.576700] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 18:03:10 juju-e4d256-prod-github-runner-207 kernel: [45564.577925] Call Trace: Aug 22 18:03:10 juju-e4d256-prod-github-runner-207 kernel: [45564.578839] Aug 22 18:03:10 juju-e4d256-prod-github-runner-207 kernel: [45564.579742] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:03:10 juju-e4d256-prod-github-runner-207 kernel: [45564.580774] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:03:10 juju-e4d256-prod-github-runner-207 kernel: [45564.581813] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:03:10 juju-e4d256-prod-github-runner-207 kernel: [45564.582931] ? show_regs.part.0+0x23/0x29 Aug 22 18:03:10 juju-e4d256-prod-github-runner-207 kernel: [45564.583931] ? show_regs.cold+0x8/0xd Aug 22 18:03:10 juju-e4d256-prod-github-runner-207 kernel: [45564.584904] ? watchdog_timer_fn+0x1be/0x220 Aug 22 18:03:10 juju-e4d256-prod-github-runner-207 kernel: [45564.585922] ? lockup_detector_update_enable+0x60/0x60 Aug 22 18:03:10 juju-e4d256-prod-github-runner-207 kernel: [45564.587191] ? __hrtimer_run_queues+0x107/0x230 Aug 22 18:03:10 juju-e4d256-prod-github-runner-207 kernel: [45564.588226] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 18:03:10 juju-e4d256-prod-github-runner-207 kernel: [45564.589249] ? hrtimer_interrupt+0x101/0x220 Aug 22 18:03:10 juju-e4d256-prod-github-runner-207 kernel: [45564.590290] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 18:03:10 juju-e4d256-prod-github-runner-207 kernel: [45564.591366] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 18:03:10 juju-e4d256-prod-github-runner-207 kernel: [45564.592413] Aug 22 18:03:10 juju-e4d256-prod-github-runner-207 kernel: [45564.593268] Aug 22 18:03:10 juju-e4d256-prod-github-runner-207 kernel: [45564.594161] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 18:03:10 juju-e4d256-prod-github-runner-207 kernel: [45564.595202] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:03:10 juju-e4d256-prod-github-runner-207 kernel: [45564.596242] ? _raw_spin_lock+0x22/0x30 Aug 22 18:03:10 juju-e4d256-prod-github-runner-207 kernel: [45564.597191] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:03:10 juju-e4d256-prod-github-runner-207 kernel: [45564.598233] direct_page_fault+0x206/0x310 [kvm] Aug 22 18:03:10 juju-e4d256-prod-github-runner-207 kernel: [45564.599256] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 18:03:10 juju-e4d256-prod-github-runner-207 kernel: [45564.600264] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 18:03:10 juju-e4d256-prod-github-runner-207 kernel: [45564.601267] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 18:03:10 juju-e4d256-prod-github-runner-207 kernel: [45564.602313] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 18:03:10 juju-e4d256-prod-github-runner-207 kernel: [45564.603325] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 18:03:10 juju-e4d256-prod-github-runner-207 kernel: [45564.604475] handle_exit+0x98/0x230 [kvm_amd] Aug 22 18:03:10 juju-e4d256-prod-github-runner-207 kernel: [45564.605489] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 18:03:10 juju-e4d256-prod-github-runner-207 kernel: [45564.606527] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 18:03:10 juju-e4d256-prod-github-runner-207 kernel: [45564.607589] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 18:03:10 juju-e4d256-prod-github-runner-207 kernel: [45564.608608] vcpu_run+0x62/0x2c0 [kvm] Aug 22 18:03:10 juju-e4d256-prod-github-runner-207 kernel: [45564.609495] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 18:03:10 juju-e4d256-prod-github-runner-207 kernel: [45564.610420] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 18:03:10 juju-e4d256-prod-github-runner-207 kernel: [45564.611389] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 18:03:10 juju-e4d256-prod-github-runner-207 kernel: [45564.612292] ? __seccomp_filter+0x4a/0x4a0 Aug 22 18:03:10 juju-e4d256-prod-github-runner-207 kernel: [45564.613141] ? __fget_files+0x86/0xc0 Aug 22 18:03:10 juju-e4d256-prod-github-runner-207 kernel: [45564.613946] __x64_sys_ioctl+0x95/0xd0 Aug 22 18:03:10 juju-e4d256-prod-github-runner-207 kernel: [45564.614716] do_syscall_64+0x5c/0xc0 Aug 22 18:03:10 juju-e4d256-prod-github-runner-207 kernel: [45564.615452] ? do_futex+0x162/0x1f0 Aug 22 18:03:10 juju-e4d256-prod-github-runner-207 kernel: [45564.616176] ? __x64_sys_futex+0x78/0x1e0 Aug 22 18:03:10 juju-e4d256-prod-github-runner-207 kernel: [45564.616927] ? __secure_computing+0xa9/0x120 Aug 22 18:03:10 juju-e4d256-prod-github-runner-207 kernel: [45564.617701] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 18:03:10 juju-e4d256-prod-github-runner-207 kernel: [45564.618606] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:03:10 juju-e4d256-prod-github-runner-207 kernel: [45564.619421] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:03:10 juju-e4d256-prod-github-runner-207 kernel: [45564.620254] ? do_syscall_64+0x69/0xc0 Aug 22 18:03:10 juju-e4d256-prod-github-runner-207 kernel: [45564.620979] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:03:10 juju-e4d256-prod-github-runner-207 kernel: [45564.621818] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:03:10 juju-e4d256-prod-github-runner-207 kernel: [45564.622613] ? do_syscall_64+0x69/0xc0 Aug 22 18:03:10 juju-e4d256-prod-github-runner-207 kernel: [45564.623328] ? do_syscall_64+0x69/0xc0 Aug 22 18:03:10 juju-e4d256-prod-github-runner-207 kernel: [45564.624023] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 18:03:10 juju-e4d256-prod-github-runner-207 kernel: [45564.624829] RIP: 0033:0x7faa5d0edaff Aug 22 18:03:10 juju-e4d256-prod-github-runner-207 kernel: [45564.625563] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 18:03:10 juju-e4d256-prod-github-runner-207 kernel: [45564.627900] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 18:03:10 juju-e4d256-prod-github-runner-207 kernel: [45564.629069] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 18:03:10 juju-e4d256-prod-github-runner-207 kernel: [45564.630019] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 18:03:10 juju-e4d256-prod-github-runner-207 kernel: [45564.630915] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 18:03:10 juju-e4d256-prod-github-runner-207 kernel: [45564.631803] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 18:03:10 juju-e4d256-prod-github-runner-207 kernel: [45564.632696] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 18:03:10 juju-e4d256-prod-github-runner-207 kernel: [45564.633590] Aug 22 18:03:38 juju-e4d256-prod-github-runner-207 kernel: [45592.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 42353s! [qemu-system-x86:6715] Aug 22 18:03:38 juju-e4d256-prod-github-runner-207 kernel: [45592.543123] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 18:03:38 juju-e4d256-prod-github-runner-207 kernel: [45592.543200] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 18:03:38 juju-e4d256-prod-github-runner-207 kernel: [45592.555511] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 18:03:38 juju-e4d256-prod-github-runner-207 kernel: [45592.556842] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 18:03:38 juju-e4d256-prod-github-runner-207 kernel: [45592.558260] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:03:38 juju-e4d256-prod-github-runner-207 kernel: [45592.559315] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 18:03:38 juju-e4d256-prod-github-runner-207 kernel: [45592.561873] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 18:03:38 juju-e4d256-prod-github-runner-207 kernel: [45592.563065] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 18:03:38 juju-e4d256-prod-github-runner-207 kernel: [45592.564228] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 18:03:38 juju-e4d256-prod-github-runner-207 kernel: [45592.565400] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 18:03:38 juju-e4d256-prod-github-runner-207 kernel: [45592.566562] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 18:03:38 juju-e4d256-prod-github-runner-207 kernel: [45592.567720] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 18:03:38 juju-e4d256-prod-github-runner-207 kernel: [45592.568882] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 18:03:38 juju-e4d256-prod-github-runner-207 kernel: [45592.570128] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 18:03:38 juju-e4d256-prod-github-runner-207 kernel: [45592.571298] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 18:03:38 juju-e4d256-prod-github-runner-207 kernel: [45592.572581] Call Trace: Aug 22 18:03:38 juju-e4d256-prod-github-runner-207 kernel: [45592.573545] Aug 22 18:03:38 juju-e4d256-prod-github-runner-207 kernel: [45592.574439] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:03:38 juju-e4d256-prod-github-runner-207 kernel: [45592.575522] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:03:38 juju-e4d256-prod-github-runner-207 kernel: [45592.576570] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:03:38 juju-e4d256-prod-github-runner-207 kernel: [45592.577679] ? show_regs.part.0+0x23/0x29 Aug 22 18:03:38 juju-e4d256-prod-github-runner-207 kernel: [45592.578681] ? show_regs.cold+0x8/0xd Aug 22 18:03:38 juju-e4d256-prod-github-runner-207 kernel: [45592.579660] ? watchdog_timer_fn+0x1be/0x220 Aug 22 18:03:38 juju-e4d256-prod-github-runner-207 kernel: [45592.580670] ? lockup_detector_update_enable+0x60/0x60 Aug 22 18:03:38 juju-e4d256-prod-github-runner-207 kernel: [45592.581752] ? __hrtimer_run_queues+0x107/0x230 Aug 22 18:03:38 juju-e4d256-prod-github-runner-207 kernel: [45592.582782] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 18:03:38 juju-e4d256-prod-github-runner-207 kernel: [45592.583827] ? hrtimer_interrupt+0x101/0x220 Aug 22 18:03:38 juju-e4d256-prod-github-runner-207 kernel: [45592.584845] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 18:03:38 juju-e4d256-prod-github-runner-207 kernel: [45592.585955] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 18:03:38 juju-e4d256-prod-github-runner-207 kernel: [45592.587050] Aug 22 18:03:38 juju-e4d256-prod-github-runner-207 kernel: [45592.587907] Aug 22 18:03:38 juju-e4d256-prod-github-runner-207 kernel: [45592.588751] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 18:03:38 juju-e4d256-prod-github-runner-207 kernel: [45592.589818] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:03:38 juju-e4d256-prod-github-runner-207 kernel: [45592.590856] ? _raw_spin_lock+0x22/0x30 Aug 22 18:03:38 juju-e4d256-prod-github-runner-207 kernel: [45592.591800] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:03:38 juju-e4d256-prod-github-runner-207 kernel: [45592.592829] direct_page_fault+0x206/0x310 [kvm] Aug 22 18:03:38 juju-e4d256-prod-github-runner-207 kernel: [45592.594073] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 18:03:38 juju-e4d256-prod-github-runner-207 kernel: [45592.595098] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 18:03:38 juju-e4d256-prod-github-runner-207 kernel: [45592.596099] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 18:03:38 juju-e4d256-prod-github-runner-207 kernel: [45592.597067] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 18:03:38 juju-e4d256-prod-github-runner-207 kernel: [45592.598020] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 18:03:38 juju-e4d256-prod-github-runner-207 kernel: [45592.598997] handle_exit+0x98/0x230 [kvm_amd] Aug 22 18:03:38 juju-e4d256-prod-github-runner-207 kernel: [45592.599932] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 18:03:38 juju-e4d256-prod-github-runner-207 kernel: [45592.600864] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 18:03:38 juju-e4d256-prod-github-runner-207 kernel: [45592.601814] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 18:03:38 juju-e4d256-prod-github-runner-207 kernel: [45592.602721] vcpu_run+0x62/0x2c0 [kvm] Aug 22 18:03:38 juju-e4d256-prod-github-runner-207 kernel: [45592.603656] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 18:03:38 juju-e4d256-prod-github-runner-207 kernel: [45592.604464] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 18:03:38 juju-e4d256-prod-github-runner-207 kernel: [45592.605354] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 18:03:38 juju-e4d256-prod-github-runner-207 kernel: [45592.606193] ? __seccomp_filter+0x4a/0x4a0 Aug 22 18:03:38 juju-e4d256-prod-github-runner-207 kernel: [45592.606948] ? __fget_files+0x86/0xc0 Aug 22 18:03:38 juju-e4d256-prod-github-runner-207 kernel: [45592.607667] __x64_sys_ioctl+0x95/0xd0 Aug 22 18:03:38 juju-e4d256-prod-github-runner-207 kernel: [45592.608359] do_syscall_64+0x5c/0xc0 Aug 22 18:03:38 juju-e4d256-prod-github-runner-207 kernel: [45592.609037] ? do_futex+0x162/0x1f0 Aug 22 18:03:38 juju-e4d256-prod-github-runner-207 kernel: [45592.609706] ? __x64_sys_futex+0x78/0x1e0 Aug 22 18:03:38 juju-e4d256-prod-github-runner-207 kernel: [45592.610459] ? __secure_computing+0xa9/0x120 Aug 22 18:03:38 juju-e4d256-prod-github-runner-207 kernel: [45592.611148] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 18:03:38 juju-e4d256-prod-github-runner-207 kernel: [45592.611913] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:03:38 juju-e4d256-prod-github-runner-207 kernel: [45592.612635] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:03:38 juju-e4d256-prod-github-runner-207 kernel: [45592.613355] ? do_syscall_64+0x69/0xc0 Aug 22 18:03:38 juju-e4d256-prod-github-runner-207 kernel: [45592.614027] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:03:38 juju-e4d256-prod-github-runner-207 kernel: [45592.614746] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:03:38 juju-e4d256-prod-github-runner-207 kernel: [45592.615506] ? do_syscall_64+0x69/0xc0 Aug 22 18:03:38 juju-e4d256-prod-github-runner-207 kernel: [45592.616302] ? do_syscall_64+0x69/0xc0 Aug 22 18:03:38 juju-e4d256-prod-github-runner-207 kernel: [45592.616952] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 18:03:38 juju-e4d256-prod-github-runner-207 kernel: [45592.617686] RIP: 0033:0x7faa5d0edaff Aug 22 18:03:38 juju-e4d256-prod-github-runner-207 kernel: [45592.618343] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 18:03:38 juju-e4d256-prod-github-runner-207 kernel: [45592.620337] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 18:03:38 juju-e4d256-prod-github-runner-207 kernel: [45592.621263] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 18:03:38 juju-e4d256-prod-github-runner-207 kernel: [45592.622173] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 18:03:38 juju-e4d256-prod-github-runner-207 kernel: [45592.623150] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 18:03:38 juju-e4d256-prod-github-runner-207 kernel: [45592.624055] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 18:03:38 juju-e4d256-prod-github-runner-207 kernel: [45592.624962] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 18:03:38 juju-e4d256-prod-github-runner-207 kernel: [45592.625874] Aug 22 18:04:06 juju-e4d256-prod-github-runner-207 kernel: [45620.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 42379s! [qemu-system-x86:6715] Aug 22 18:04:06 juju-e4d256-prod-github-runner-207 kernel: [45620.543093] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 18:04:06 juju-e4d256-prod-github-runner-207 kernel: [45620.543165] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 18:04:06 juju-e4d256-prod-github-runner-207 kernel: [45620.556154] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 18:04:06 juju-e4d256-prod-github-runner-207 kernel: [45620.557618] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 18:04:06 juju-e4d256-prod-github-runner-207 kernel: [45620.558873] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:04:06 juju-e4d256-prod-github-runner-207 kernel: [45620.559929] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 18:04:06 juju-e4d256-prod-github-runner-207 kernel: [45620.562527] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 18:04:06 juju-e4d256-prod-github-runner-207 kernel: [45620.563575] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 18:04:06 juju-e4d256-prod-github-runner-207 kernel: [45620.564736] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 18:04:06 juju-e4d256-prod-github-runner-207 kernel: [45620.565918] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 18:04:06 juju-e4d256-prod-github-runner-207 kernel: [45620.567098] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 18:04:06 juju-e4d256-prod-github-runner-207 kernel: [45620.568256] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 18:04:06 juju-e4d256-prod-github-runner-207 kernel: [45620.569440] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 18:04:06 juju-e4d256-prod-github-runner-207 kernel: [45620.570678] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 18:04:06 juju-e4d256-prod-github-runner-207 kernel: [45620.571782] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 18:04:06 juju-e4d256-prod-github-runner-207 kernel: [45620.572973] Call Trace: Aug 22 18:04:06 juju-e4d256-prod-github-runner-207 kernel: [45620.573947] Aug 22 18:04:06 juju-e4d256-prod-github-runner-207 kernel: [45620.574860] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:04:06 juju-e4d256-prod-github-runner-207 kernel: [45620.575941] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:04:06 juju-e4d256-prod-github-runner-207 kernel: [45620.576974] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:04:06 juju-e4d256-prod-github-runner-207 kernel: [45620.578081] ? show_regs.part.0+0x23/0x29 Aug 22 18:04:06 juju-e4d256-prod-github-runner-207 kernel: [45620.579086] ? show_regs.cold+0x8/0xd Aug 22 18:04:06 juju-e4d256-prod-github-runner-207 kernel: [45620.580063] ? watchdog_timer_fn+0x1be/0x220 Aug 22 18:04:06 juju-e4d256-prod-github-runner-207 kernel: [45620.581089] ? lockup_detector_update_enable+0x60/0x60 Aug 22 18:04:06 juju-e4d256-prod-github-runner-207 kernel: [45620.582156] ? __hrtimer_run_queues+0x107/0x230 Aug 22 18:04:06 juju-e4d256-prod-github-runner-207 kernel: [45620.583182] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 18:04:06 juju-e4d256-prod-github-runner-207 kernel: [45620.584202] ? hrtimer_interrupt+0x101/0x220 Aug 22 18:04:06 juju-e4d256-prod-github-runner-207 kernel: [45620.585235] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 18:04:06 juju-e4d256-prod-github-runner-207 kernel: [45620.586302] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 18:04:06 juju-e4d256-prod-github-runner-207 kernel: [45620.587346] Aug 22 18:04:06 juju-e4d256-prod-github-runner-207 kernel: [45620.588203] Aug 22 18:04:06 juju-e4d256-prod-github-runner-207 kernel: [45620.589061] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 18:04:06 juju-e4d256-prod-github-runner-207 kernel: [45620.590097] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:04:06 juju-e4d256-prod-github-runner-207 kernel: [45620.591135] ? _raw_spin_lock+0x22/0x30 Aug 22 18:04:06 juju-e4d256-prod-github-runner-207 kernel: [45620.592085] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:04:06 juju-e4d256-prod-github-runner-207 kernel: [45620.593116] direct_page_fault+0x206/0x310 [kvm] Aug 22 18:04:06 juju-e4d256-prod-github-runner-207 kernel: [45620.594144] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 18:04:06 juju-e4d256-prod-github-runner-207 kernel: [45620.595150] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 18:04:06 juju-e4d256-prod-github-runner-207 kernel: [45620.596151] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 18:04:06 juju-e4d256-prod-github-runner-207 kernel: [45620.597136] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 18:04:06 juju-e4d256-prod-github-runner-207 kernel: [45620.598080] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 18:04:06 juju-e4d256-prod-github-runner-207 kernel: [45620.599056] handle_exit+0x98/0x230 [kvm_amd] Aug 22 18:04:06 juju-e4d256-prod-github-runner-207 kernel: [45620.599946] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 18:04:06 juju-e4d256-prod-github-runner-207 kernel: [45620.600864] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 18:04:06 juju-e4d256-prod-github-runner-207 kernel: [45620.601806] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 18:04:06 juju-e4d256-prod-github-runner-207 kernel: [45620.602707] vcpu_run+0x62/0x2c0 [kvm] Aug 22 18:04:06 juju-e4d256-prod-github-runner-207 kernel: [45620.603519] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 18:04:06 juju-e4d256-prod-github-runner-207 kernel: [45620.604323] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 18:04:06 juju-e4d256-prod-github-runner-207 kernel: [45620.605208] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 18:04:06 juju-e4d256-prod-github-runner-207 kernel: [45620.606039] ? __seccomp_filter+0x4a/0x4a0 Aug 22 18:04:06 juju-e4d256-prod-github-runner-207 kernel: [45620.606787] ? __fget_files+0x86/0xc0 Aug 22 18:04:06 juju-e4d256-prod-github-runner-207 kernel: [45620.607490] __x64_sys_ioctl+0x95/0xd0 Aug 22 18:04:06 juju-e4d256-prod-github-runner-207 kernel: [45620.608187] do_syscall_64+0x5c/0xc0 Aug 22 18:04:06 juju-e4d256-prod-github-runner-207 kernel: [45620.608852] ? do_futex+0x162/0x1f0 Aug 22 18:04:06 juju-e4d256-prod-github-runner-207 kernel: [45620.609540] ? __x64_sys_futex+0x78/0x1e0 Aug 22 18:04:06 juju-e4d256-prod-github-runner-207 kernel: [45620.610340] ? __secure_computing+0xa9/0x120 Aug 22 18:04:06 juju-e4d256-prod-github-runner-207 kernel: [45620.611028] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 18:04:06 juju-e4d256-prod-github-runner-207 kernel: [45620.611785] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:04:06 juju-e4d256-prod-github-runner-207 kernel: [45620.612506] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:04:06 juju-e4d256-prod-github-runner-207 kernel: [45620.613242] ? do_syscall_64+0x69/0xc0 Aug 22 18:04:06 juju-e4d256-prod-github-runner-207 kernel: [45620.613888] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:04:06 juju-e4d256-prod-github-runner-207 kernel: [45620.614589] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:04:06 juju-e4d256-prod-github-runner-207 kernel: [45620.615289] ? do_syscall_64+0x69/0xc0 Aug 22 18:04:06 juju-e4d256-prod-github-runner-207 kernel: [45620.615921] ? do_syscall_64+0x69/0xc0 Aug 22 18:04:06 juju-e4d256-prod-github-runner-207 kernel: [45620.616543] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 18:04:06 juju-e4d256-prod-github-runner-207 kernel: [45620.617262] RIP: 0033:0x7faa5d0edaff Aug 22 18:04:06 juju-e4d256-prod-github-runner-207 kernel: [45620.617886] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 18:04:06 juju-e4d256-prod-github-runner-207 kernel: [45620.619898] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 18:04:06 juju-e4d256-prod-github-runner-207 kernel: [45620.620810] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 18:04:06 juju-e4d256-prod-github-runner-207 kernel: [45620.621720] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 18:04:06 juju-e4d256-prod-github-runner-207 kernel: [45620.622606] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 18:04:06 juju-e4d256-prod-github-runner-207 kernel: [45620.623489] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 18:04:06 juju-e4d256-prod-github-runner-207 kernel: [45620.624373] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 18:04:06 juju-e4d256-prod-github-runner-207 kernel: [45620.625281] Aug 22 18:04:34 juju-e4d256-prod-github-runner-207 kernel: [45648.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 42405s! [qemu-system-x86:6715] Aug 22 18:04:34 juju-e4d256-prod-github-runner-207 kernel: [45648.543218] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 18:04:34 juju-e4d256-prod-github-runner-207 kernel: [45648.543391] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 18:04:34 juju-e4d256-prod-github-runner-207 kernel: [45648.555587] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 18:04:34 juju-e4d256-prod-github-runner-207 kernel: [45648.556886] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 18:04:34 juju-e4d256-prod-github-runner-207 kernel: [45648.558196] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:04:34 juju-e4d256-prod-github-runner-207 kernel: [45648.559269] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 18:04:34 juju-e4d256-prod-github-runner-207 kernel: [45648.561877] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 18:04:34 juju-e4d256-prod-github-runner-207 kernel: [45648.562936] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 18:04:34 juju-e4d256-prod-github-runner-207 kernel: [45648.564123] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 18:04:34 juju-e4d256-prod-github-runner-207 kernel: [45648.565343] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 18:04:34 juju-e4d256-prod-github-runner-207 kernel: [45648.566504] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 18:04:34 juju-e4d256-prod-github-runner-207 kernel: [45648.567679] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 18:04:34 juju-e4d256-prod-github-runner-207 kernel: [45648.568891] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 18:04:34 juju-e4d256-prod-github-runner-207 kernel: [45648.570128] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 18:04:34 juju-e4d256-prod-github-runner-207 kernel: [45648.571232] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 18:04:34 juju-e4d256-prod-github-runner-207 kernel: [45648.572451] Call Trace: Aug 22 18:04:34 juju-e4d256-prod-github-runner-207 kernel: [45648.573397] Aug 22 18:04:34 juju-e4d256-prod-github-runner-207 kernel: [45648.574309] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:04:34 juju-e4d256-prod-github-runner-207 kernel: [45648.575387] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:04:34 juju-e4d256-prod-github-runner-207 kernel: [45648.576420] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:04:34 juju-e4d256-prod-github-runner-207 kernel: [45648.577559] ? show_regs.part.0+0x23/0x29 Aug 22 18:04:34 juju-e4d256-prod-github-runner-207 kernel: [45648.578572] ? show_regs.cold+0x8/0xd Aug 22 18:04:34 juju-e4d256-prod-github-runner-207 kernel: [45648.579561] ? watchdog_timer_fn+0x1be/0x220 Aug 22 18:04:34 juju-e4d256-prod-github-runner-207 kernel: [45648.580580] ? lockup_detector_update_enable+0x60/0x60 Aug 22 18:04:34 juju-e4d256-prod-github-runner-207 kernel: [45648.581682] ? __hrtimer_run_queues+0x107/0x230 Aug 22 18:04:34 juju-e4d256-prod-github-runner-207 kernel: [45648.582712] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 18:04:34 juju-e4d256-prod-github-runner-207 kernel: [45648.583747] ? hrtimer_interrupt+0x101/0x220 Aug 22 18:04:34 juju-e4d256-prod-github-runner-207 kernel: [45648.584797] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 18:04:34 juju-e4d256-prod-github-runner-207 kernel: [45648.586020] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 18:04:34 juju-e4d256-prod-github-runner-207 kernel: [45648.587083] Aug 22 18:04:34 juju-e4d256-prod-github-runner-207 kernel: [45648.587955] Aug 22 18:04:34 juju-e4d256-prod-github-runner-207 kernel: [45648.588829] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 18:04:34 juju-e4d256-prod-github-runner-207 kernel: [45648.589886] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:04:34 juju-e4d256-prod-github-runner-207 kernel: [45648.590929] ? _raw_spin_lock+0x22/0x30 Aug 22 18:04:34 juju-e4d256-prod-github-runner-207 kernel: [45648.591877] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:04:34 juju-e4d256-prod-github-runner-207 kernel: [45648.592920] direct_page_fault+0x206/0x310 [kvm] Aug 22 18:04:34 juju-e4d256-prod-github-runner-207 kernel: [45648.593959] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 18:04:34 juju-e4d256-prod-github-runner-207 kernel: [45648.594993] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 18:04:34 juju-e4d256-prod-github-runner-207 kernel: [45648.596004] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 18:04:34 juju-e4d256-prod-github-runner-207 kernel: [45648.597061] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 18:04:34 juju-e4d256-prod-github-runner-207 kernel: [45648.598011] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 18:04:34 juju-e4d256-prod-github-runner-207 kernel: [45648.599012] handle_exit+0x98/0x230 [kvm_amd] Aug 22 18:04:34 juju-e4d256-prod-github-runner-207 kernel: [45648.599932] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 18:04:34 juju-e4d256-prod-github-runner-207 kernel: [45648.600876] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 18:04:34 juju-e4d256-prod-github-runner-207 kernel: [45648.601811] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 18:04:34 juju-e4d256-prod-github-runner-207 kernel: [45648.602720] vcpu_run+0x62/0x2c0 [kvm] Aug 22 18:04:34 juju-e4d256-prod-github-runner-207 kernel: [45648.603552] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 18:04:34 juju-e4d256-prod-github-runner-207 kernel: [45648.604370] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 18:04:34 juju-e4d256-prod-github-runner-207 kernel: [45648.605253] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 18:04:34 juju-e4d256-prod-github-runner-207 kernel: [45648.606056] ? __seccomp_filter+0x4a/0x4a0 Aug 22 18:04:34 juju-e4d256-prod-github-runner-207 kernel: [45648.606809] ? __fget_files+0x86/0xc0 Aug 22 18:04:34 juju-e4d256-prod-github-runner-207 kernel: [45648.607518] __x64_sys_ioctl+0x95/0xd0 Aug 22 18:04:34 juju-e4d256-prod-github-runner-207 kernel: [45648.608318] do_syscall_64+0x5c/0xc0 Aug 22 18:04:34 juju-e4d256-prod-github-runner-207 kernel: [45648.609016] ? do_futex+0x162/0x1f0 Aug 22 18:04:34 juju-e4d256-prod-github-runner-207 kernel: [45648.609674] ? __x64_sys_futex+0x78/0x1e0 Aug 22 18:04:34 juju-e4d256-prod-github-runner-207 kernel: [45648.610371] ? __secure_computing+0xa9/0x120 Aug 22 18:04:34 juju-e4d256-prod-github-runner-207 kernel: [45648.611065] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 18:04:34 juju-e4d256-prod-github-runner-207 kernel: [45648.611828] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:04:34 juju-e4d256-prod-github-runner-207 kernel: [45648.612558] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:04:34 juju-e4d256-prod-github-runner-207 kernel: [45648.613304] ? do_syscall_64+0x69/0xc0 Aug 22 18:04:34 juju-e4d256-prod-github-runner-207 kernel: [45648.613965] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:04:34 juju-e4d256-prod-github-runner-207 kernel: [45648.614675] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:04:34 juju-e4d256-prod-github-runner-207 kernel: [45648.615383] ? do_syscall_64+0x69/0xc0 Aug 22 18:04:34 juju-e4d256-prod-github-runner-207 kernel: [45648.616014] ? do_syscall_64+0x69/0xc0 Aug 22 18:04:34 juju-e4d256-prod-github-runner-207 kernel: [45648.616720] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 18:04:34 juju-e4d256-prod-github-runner-207 kernel: [45648.617438] RIP: 0033:0x7faa5d0edaff Aug 22 18:04:34 juju-e4d256-prod-github-runner-207 kernel: [45648.618068] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 18:04:34 juju-e4d256-prod-github-runner-207 kernel: [45648.620075] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 18:04:34 juju-e4d256-prod-github-runner-207 kernel: [45648.621041] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 18:04:34 juju-e4d256-prod-github-runner-207 kernel: [45648.621933] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 18:04:34 juju-e4d256-prod-github-runner-207 kernel: [45648.622833] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 18:04:34 juju-e4d256-prod-github-runner-207 kernel: [45648.623716] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 18:04:34 juju-e4d256-prod-github-runner-207 kernel: [45648.624643] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 18:04:34 juju-e4d256-prod-github-runner-207 kernel: [45648.625581] Aug 22 18:05:02 juju-e4d256-prod-github-runner-207 kernel: [45676.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 42431s! [qemu-system-x86:6715] Aug 22 18:05:02 juju-e4d256-prod-github-runner-207 kernel: [45676.543770] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 18:05:02 juju-e4d256-prod-github-runner-207 kernel: [45676.544001] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 18:05:02 juju-e4d256-prod-github-runner-207 kernel: [45676.556090] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 18:05:02 juju-e4d256-prod-github-runner-207 kernel: [45676.557370] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 18:05:02 juju-e4d256-prod-github-runner-207 kernel: [45676.558625] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:05:02 juju-e4d256-prod-github-runner-207 kernel: [45676.559733] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 18:05:02 juju-e4d256-prod-github-runner-207 kernel: [45676.562336] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 18:05:02 juju-e4d256-prod-github-runner-207 kernel: [45676.563378] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 18:05:02 juju-e4d256-prod-github-runner-207 kernel: [45676.564670] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 18:05:02 juju-e4d256-prod-github-runner-207 kernel: [45676.565873] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 18:05:02 juju-e4d256-prod-github-runner-207 kernel: [45676.567061] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 18:05:02 juju-e4d256-prod-github-runner-207 kernel: [45676.568238] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 18:05:02 juju-e4d256-prod-github-runner-207 kernel: [45676.569455] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 18:05:02 juju-e4d256-prod-github-runner-207 kernel: [45676.570708] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 18:05:02 juju-e4d256-prod-github-runner-207 kernel: [45676.571868] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 18:05:02 juju-e4d256-prod-github-runner-207 kernel: [45676.573095] Call Trace: Aug 22 18:05:02 juju-e4d256-prod-github-runner-207 kernel: [45676.574016] Aug 22 18:05:02 juju-e4d256-prod-github-runner-207 kernel: [45676.574930] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:05:02 juju-e4d256-prod-github-runner-207 kernel: [45676.575969] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:05:02 juju-e4d256-prod-github-runner-207 kernel: [45676.577075] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:05:02 juju-e4d256-prod-github-runner-207 kernel: [45676.578356] ? show_regs.part.0+0x23/0x29 Aug 22 18:05:02 juju-e4d256-prod-github-runner-207 kernel: [45676.579451] ? show_regs.cold+0x8/0xd Aug 22 18:05:02 juju-e4d256-prod-github-runner-207 kernel: [45676.580950] ? watchdog_timer_fn+0x1be/0x220 Aug 22 18:05:02 juju-e4d256-prod-github-runner-207 kernel: [45676.582004] ? lockup_detector_update_enable+0x60/0x60 Aug 22 18:05:02 juju-e4d256-prod-github-runner-207 kernel: [45676.583111] ? __hrtimer_run_queues+0x107/0x230 Aug 22 18:05:02 juju-e4d256-prod-github-runner-207 kernel: [45676.584165] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 18:05:02 juju-e4d256-prod-github-runner-207 kernel: [45676.585256] ? hrtimer_interrupt+0x101/0x220 Aug 22 18:05:02 juju-e4d256-prod-github-runner-207 kernel: [45676.586302] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 18:05:02 juju-e4d256-prod-github-runner-207 kernel: [45676.587442] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 18:05:02 juju-e4d256-prod-github-runner-207 kernel: [45676.588509] Aug 22 18:05:02 juju-e4d256-prod-github-runner-207 kernel: [45676.589369] Aug 22 18:05:02 juju-e4d256-prod-github-runner-207 kernel: [45676.590205] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 18:05:02 juju-e4d256-prod-github-runner-207 kernel: [45676.591277] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:05:02 juju-e4d256-prod-github-runner-207 kernel: [45676.592318] ? _raw_spin_lock+0x22/0x30 Aug 22 18:05:02 juju-e4d256-prod-github-runner-207 kernel: [45676.593359] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:05:02 juju-e4d256-prod-github-runner-207 kernel: [45676.594424] direct_page_fault+0x206/0x310 [kvm] Aug 22 18:05:02 juju-e4d256-prod-github-runner-207 kernel: [45676.595480] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 18:05:02 juju-e4d256-prod-github-runner-207 kernel: [45676.596522] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 18:05:02 juju-e4d256-prod-github-runner-207 kernel: [45676.597527] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 18:05:02 juju-e4d256-prod-github-runner-207 kernel: [45676.598522] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 18:05:02 juju-e4d256-prod-github-runner-207 kernel: [45676.599496] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 18:05:02 juju-e4d256-prod-github-runner-207 kernel: [45676.600516] handle_exit+0x98/0x230 [kvm_amd] Aug 22 18:05:02 juju-e4d256-prod-github-runner-207 kernel: [45676.601411] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 18:05:02 juju-e4d256-prod-github-runner-207 kernel: [45676.602414] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 18:05:02 juju-e4d256-prod-github-runner-207 kernel: [45676.603360] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 18:05:02 juju-e4d256-prod-github-runner-207 kernel: [45676.604269] vcpu_run+0x62/0x2c0 [kvm] Aug 22 18:05:02 juju-e4d256-prod-github-runner-207 kernel: [45676.605113] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 18:05:02 juju-e4d256-prod-github-runner-207 kernel: [45676.605943] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 18:05:02 juju-e4d256-prod-github-runner-207 kernel: [45676.606798] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 18:05:02 juju-e4d256-prod-github-runner-207 kernel: [45676.607594] ? __seccomp_filter+0x4a/0x4a0 Aug 22 18:05:02 juju-e4d256-prod-github-runner-207 kernel: [45676.608446] ? __fget_files+0x86/0xc0 Aug 22 18:05:02 juju-e4d256-prod-github-runner-207 kernel: [45676.609173] __x64_sys_ioctl+0x95/0xd0 Aug 22 18:05:02 juju-e4d256-prod-github-runner-207 kernel: [45676.609869] do_syscall_64+0x5c/0xc0 Aug 22 18:05:02 juju-e4d256-prod-github-runner-207 kernel: [45676.610534] ? do_futex+0x162/0x1f0 Aug 22 18:05:02 juju-e4d256-prod-github-runner-207 kernel: [45676.611188] ? __x64_sys_futex+0x78/0x1e0 Aug 22 18:05:02 juju-e4d256-prod-github-runner-207 kernel: [45676.611879] ? __secure_computing+0xa9/0x120 Aug 22 18:05:02 juju-e4d256-prod-github-runner-207 kernel: [45676.612634] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 18:05:02 juju-e4d256-prod-github-runner-207 kernel: [45676.613466] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:05:02 juju-e4d256-prod-github-runner-207 kernel: [45676.614215] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:05:02 juju-e4d256-prod-github-runner-207 kernel: [45676.614936] ? do_syscall_64+0x69/0xc0 Aug 22 18:05:02 juju-e4d256-prod-github-runner-207 kernel: [45676.615582] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:05:02 juju-e4d256-prod-github-runner-207 kernel: [45676.616317] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:05:02 juju-e4d256-prod-github-runner-207 kernel: [45676.617039] ? do_syscall_64+0x69/0xc0 Aug 22 18:05:02 juju-e4d256-prod-github-runner-207 kernel: [45676.617669] ? do_syscall_64+0x69/0xc0 Aug 22 18:05:02 juju-e4d256-prod-github-runner-207 kernel: [45676.618300] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 18:05:02 juju-e4d256-prod-github-runner-207 kernel: [45676.619007] RIP: 0033:0x7faa5d0edaff Aug 22 18:05:02 juju-e4d256-prod-github-runner-207 kernel: [45676.619683] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 18:05:02 juju-e4d256-prod-github-runner-207 kernel: [45676.621828] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 18:05:02 juju-e4d256-prod-github-runner-207 kernel: [45676.622801] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 18:05:02 juju-e4d256-prod-github-runner-207 kernel: [45676.623775] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 18:05:02 juju-e4d256-prod-github-runner-207 kernel: [45676.624706] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 18:05:02 juju-e4d256-prod-github-runner-207 kernel: [45676.625597] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 18:05:02 juju-e4d256-prod-github-runner-207 kernel: [45676.626487] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 18:05:02 juju-e4d256-prod-github-runner-207 kernel: [45676.627406] Aug 22 18:05:30 juju-e4d256-prod-github-runner-207 kernel: [45704.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 42457s! [qemu-system-x86:6715] Aug 22 18:05:30 juju-e4d256-prod-github-runner-207 kernel: [45704.543101] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 18:05:30 juju-e4d256-prod-github-runner-207 kernel: [45704.543173] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 18:05:30 juju-e4d256-prod-github-runner-207 kernel: [45704.556162] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 18:05:30 juju-e4d256-prod-github-runner-207 kernel: [45704.557447] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 18:05:30 juju-e4d256-prod-github-runner-207 kernel: [45704.558926] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:05:30 juju-e4d256-prod-github-runner-207 kernel: [45704.560126] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 18:05:30 juju-e4d256-prod-github-runner-207 kernel: [45704.563029] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 18:05:30 juju-e4d256-prod-github-runner-207 kernel: [45704.564196] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 18:05:30 juju-e4d256-prod-github-runner-207 kernel: [45704.565523] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 18:05:30 juju-e4d256-prod-github-runner-207 kernel: [45704.566843] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 18:05:30 juju-e4d256-prod-github-runner-207 kernel: [45704.568192] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 18:05:30 juju-e4d256-prod-github-runner-207 kernel: [45704.569531] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 18:05:30 juju-e4d256-prod-github-runner-207 kernel: [45704.570859] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 18:05:30 juju-e4d256-prod-github-runner-207 kernel: [45704.572283] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 18:05:30 juju-e4d256-prod-github-runner-207 kernel: [45704.573511] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 18:05:30 juju-e4d256-prod-github-runner-207 kernel: [45704.574856] Call Trace: Aug 22 18:05:30 juju-e4d256-prod-github-runner-207 kernel: [45704.575824] Aug 22 18:05:30 juju-e4d256-prod-github-runner-207 kernel: [45704.576774] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:05:30 juju-e4d256-prod-github-runner-207 kernel: [45704.577911] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:05:30 juju-e4d256-prod-github-runner-207 kernel: [45704.579026] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:05:30 juju-e4d256-prod-github-runner-207 kernel: [45704.580217] ? show_regs.part.0+0x23/0x29 Aug 22 18:05:30 juju-e4d256-prod-github-runner-207 kernel: [45704.581327] ? show_regs.cold+0x8/0xd Aug 22 18:05:30 juju-e4d256-prod-github-runner-207 kernel: [45704.582376] ? watchdog_timer_fn+0x1be/0x220 Aug 22 18:05:30 juju-e4d256-prod-github-runner-207 kernel: [45704.583576] ? lockup_detector_update_enable+0x60/0x60 Aug 22 18:05:30 juju-e4d256-prod-github-runner-207 kernel: [45704.584804] ? __hrtimer_run_queues+0x107/0x230 Aug 22 18:05:30 juju-e4d256-prod-github-runner-207 kernel: [45704.585946] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 18:05:30 juju-e4d256-prod-github-runner-207 kernel: [45704.587113] ? hrtimer_interrupt+0x101/0x220 Aug 22 18:05:30 juju-e4d256-prod-github-runner-207 kernel: [45704.588272] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 18:05:30 juju-e4d256-prod-github-runner-207 kernel: [45704.589468] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 18:05:30 juju-e4d256-prod-github-runner-207 kernel: [45704.590624] Aug 22 18:05:30 juju-e4d256-prod-github-runner-207 kernel: [45704.591527] Aug 22 18:05:30 juju-e4d256-prod-github-runner-207 kernel: [45704.592455] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 18:05:30 juju-e4d256-prod-github-runner-207 kernel: [45704.593612] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:05:30 juju-e4d256-prod-github-runner-207 kernel: [45704.594760] ? _raw_spin_lock+0x22/0x30 Aug 22 18:05:30 juju-e4d256-prod-github-runner-207 kernel: [45704.595789] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:05:30 juju-e4d256-prod-github-runner-207 kernel: [45704.596953] direct_page_fault+0x206/0x310 [kvm] Aug 22 18:05:30 juju-e4d256-prod-github-runner-207 kernel: [45704.598106] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 18:05:30 juju-e4d256-prod-github-runner-207 kernel: [45704.599216] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 18:05:30 juju-e4d256-prod-github-runner-207 kernel: [45704.600339] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 18:05:30 juju-e4d256-prod-github-runner-207 kernel: [45704.601467] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 18:05:30 juju-e4d256-prod-github-runner-207 kernel: [45704.602544] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 18:05:30 juju-e4d256-prod-github-runner-207 kernel: [45704.603659] handle_exit+0x98/0x230 [kvm_amd] Aug 22 18:05:30 juju-e4d256-prod-github-runner-207 kernel: [45704.604692] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 18:05:30 juju-e4d256-prod-github-runner-207 kernel: [45704.605709] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 18:05:30 juju-e4d256-prod-github-runner-207 kernel: [45704.606742] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 18:05:30 juju-e4d256-prod-github-runner-207 kernel: [45704.607746] vcpu_run+0x62/0x2c0 [kvm] Aug 22 18:05:30 juju-e4d256-prod-github-runner-207 kernel: [45704.608648] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 18:05:30 juju-e4d256-prod-github-runner-207 kernel: [45704.609554] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 18:05:30 juju-e4d256-prod-github-runner-207 kernel: [45704.610525] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 18:05:30 juju-e4d256-prod-github-runner-207 kernel: [45704.611441] ? __seccomp_filter+0x4a/0x4a0 Aug 22 18:05:30 juju-e4d256-prod-github-runner-207 kernel: [45704.612334] ? __fget_files+0x86/0xc0 Aug 22 18:05:30 juju-e4d256-prod-github-runner-207 kernel: [45704.613136] __x64_sys_ioctl+0x95/0xd0 Aug 22 18:05:30 juju-e4d256-prod-github-runner-207 kernel: [45704.613927] do_syscall_64+0x5c/0xc0 Aug 22 18:05:30 juju-e4d256-prod-github-runner-207 kernel: [45704.614683] ? do_futex+0x162/0x1f0 Aug 22 18:05:30 juju-e4d256-prod-github-runner-207 kernel: [45704.615430] ? __x64_sys_futex+0x78/0x1e0 Aug 22 18:05:30 juju-e4d256-prod-github-runner-207 kernel: [45704.616255] ? __secure_computing+0xa9/0x120 Aug 22 18:05:30 juju-e4d256-prod-github-runner-207 kernel: [45704.617067] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 18:05:30 juju-e4d256-prod-github-runner-207 kernel: [45704.617946] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:05:30 juju-e4d256-prod-github-runner-207 kernel: [45704.618770] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:05:30 juju-e4d256-prod-github-runner-207 kernel: [45704.619596] ? do_syscall_64+0x69/0xc0 Aug 22 18:05:30 juju-e4d256-prod-github-runner-207 kernel: [45704.620350] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:05:30 juju-e4d256-prod-github-runner-207 kernel: [45704.621167] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:05:30 juju-e4d256-prod-github-runner-207 kernel: [45704.621971] ? do_syscall_64+0x69/0xc0 Aug 22 18:05:30 juju-e4d256-prod-github-runner-207 kernel: [45704.622697] ? do_syscall_64+0x69/0xc0 Aug 22 18:05:30 juju-e4d256-prod-github-runner-207 kernel: [45704.623421] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 18:05:30 juju-e4d256-prod-github-runner-207 kernel: [45704.624271] RIP: 0033:0x7faa5d0edaff Aug 22 18:05:30 juju-e4d256-prod-github-runner-207 kernel: [45704.624983] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 18:05:30 juju-e4d256-prod-github-runner-207 kernel: [45704.627323] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 18:05:30 juju-e4d256-prod-github-runner-207 kernel: [45704.628423] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 18:05:30 juju-e4d256-prod-github-runner-207 kernel: [45704.629500] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 18:05:30 juju-e4d256-prod-github-runner-207 kernel: [45704.630537] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 18:05:30 juju-e4d256-prod-github-runner-207 kernel: [45704.631563] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 18:05:30 juju-e4d256-prod-github-runner-207 kernel: [45704.632611] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 18:05:30 juju-e4d256-prod-github-runner-207 kernel: [45704.633654] Aug 22 18:05:46 juju-e4d256-prod-github-runner-207 kernel: [45720.236706] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 18:05:46 juju-e4d256-prod-github-runner-207 kernel: [45720.237674] rcu: 1-....: (11365028 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=5500866 Aug 22 18:05:46 juju-e4d256-prod-github-runner-207 kernel: [45720.238816] (t=11400759 jiffies g=23269 q=44792) Aug 22 18:05:46 juju-e4d256-prod-github-runner-207 kernel: [45720.239604] NMI backtrace for cpu 1 Aug 22 18:05:46 juju-e4d256-prod-github-runner-207 kernel: [45720.240326] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 18:05:46 juju-e4d256-prod-github-runner-207 kernel: [45720.241429] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 18:05:46 juju-e4d256-prod-github-runner-207 kernel: [45720.242484] Call Trace: Aug 22 18:05:46 juju-e4d256-prod-github-runner-207 kernel: [45720.243163] Aug 22 18:05:46 juju-e4d256-prod-github-runner-207 kernel: [45720.243818] show_stack+0x52/0x5c Aug 22 18:05:46 juju-e4d256-prod-github-runner-207 kernel: [45720.244595] dump_stack_lvl+0x4a/0x63 Aug 22 18:05:46 juju-e4d256-prod-github-runner-207 kernel: [45720.245347] dump_stack+0x10/0x16 Aug 22 18:05:46 juju-e4d256-prod-github-runner-207 kernel: [45720.246061] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 18:05:46 juju-e4d256-prod-github-runner-207 kernel: [45720.246841] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 18:05:46 juju-e4d256-prod-github-runner-207 kernel: [45720.247621] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 18:05:46 juju-e4d256-prod-github-runner-207 kernel: [45720.248467] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 18:05:46 juju-e4d256-prod-github-runner-207 kernel: [45720.249289] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 18:05:46 juju-e4d256-prod-github-runner-207 kernel: [45720.250102] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 18:05:46 juju-e4d256-prod-github-runner-207 kernel: [45720.250877] print_cpu_stall.cold+0x2f/0xe2 Aug 22 18:05:46 juju-e4d256-prod-github-runner-207 kernel: [45720.251645] ? timekeeping_update+0xf7/0x150 Aug 22 18:05:46 juju-e4d256-prod-github-runner-207 kernel: [45720.252714] check_cpu_stall+0x109/0x270 Aug 22 18:05:46 juju-e4d256-prod-github-runner-207 kernel: [45720.253704] rcu_sched_clock_irq+0x9a/0x250 Aug 22 18:05:46 juju-e4d256-prod-github-runner-207 kernel: [45720.254475] update_process_times+0x94/0xd0 Aug 22 18:05:46 juju-e4d256-prod-github-runner-207 kernel: [45720.255276] tick_sched_handle+0x29/0x70 Aug 22 18:05:46 juju-e4d256-prod-github-runner-207 kernel: [45720.256112] tick_sched_timer+0x8c/0xc0 Aug 22 18:05:46 juju-e4d256-prod-github-runner-207 kernel: [45720.256918] ? tick_nohz_handler+0xb0/0xb0 Aug 22 18:05:46 juju-e4d256-prod-github-runner-207 kernel: [45720.257706] __hrtimer_run_queues+0x107/0x230 Aug 22 18:05:46 juju-e4d256-prod-github-runner-207 kernel: [45720.258515] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 18:05:46 juju-e4d256-prod-github-runner-207 kernel: [45720.259312] hrtimer_interrupt+0x101/0x220 Aug 22 18:05:46 juju-e4d256-prod-github-runner-207 kernel: [45720.260115] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 18:05:46 juju-e4d256-prod-github-runner-207 kernel: [45720.260960] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 18:05:46 juju-e4d256-prod-github-runner-207 kernel: [45720.261784] Aug 22 18:05:46 juju-e4d256-prod-github-runner-207 kernel: [45720.262450] Aug 22 18:05:46 juju-e4d256-prod-github-runner-207 kernel: [45720.263189] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 18:05:46 juju-e4d256-prod-github-runner-207 kernel: [45720.264130] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:05:46 juju-e4d256-prod-github-runner-207 kernel: [45720.265017] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 18:05:46 juju-e4d256-prod-github-runner-207 kernel: [45720.267270] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 18:05:46 juju-e4d256-prod-github-runner-207 kernel: [45720.268179] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 18:05:46 juju-e4d256-prod-github-runner-207 kernel: [45720.269203] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 18:05:46 juju-e4d256-prod-github-runner-207 kernel: [45720.270190] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 18:05:46 juju-e4d256-prod-github-runner-207 kernel: [45720.271168] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 18:05:46 juju-e4d256-prod-github-runner-207 kernel: [45720.272180] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 18:05:46 juju-e4d256-prod-github-runner-207 kernel: [45720.273143] ? _raw_spin_lock+0x22/0x30 Aug 22 18:05:46 juju-e4d256-prod-github-runner-207 kernel: [45720.273911] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:05:46 juju-e4d256-prod-github-runner-207 kernel: [45720.274767] direct_page_fault+0x206/0x310 [kvm] Aug 22 18:05:46 juju-e4d256-prod-github-runner-207 kernel: [45720.275625] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 18:05:46 juju-e4d256-prod-github-runner-207 kernel: [45720.276499] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 18:05:46 juju-e4d256-prod-github-runner-207 kernel: [45720.277345] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 18:05:46 juju-e4d256-prod-github-runner-207 kernel: [45720.278185] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 18:05:46 juju-e4d256-prod-github-runner-207 kernel: [45720.279003] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 18:05:46 juju-e4d256-prod-github-runner-207 kernel: [45720.279861] handle_exit+0x98/0x230 [kvm_amd] Aug 22 18:05:46 juju-e4d256-prod-github-runner-207 kernel: [45720.280674] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 18:05:46 juju-e4d256-prod-github-runner-207 kernel: [45720.281510] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 18:05:46 juju-e4d256-prod-github-runner-207 kernel: [45720.282344] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 18:05:46 juju-e4d256-prod-github-runner-207 kernel: [45720.283142] vcpu_run+0x62/0x2c0 [kvm] Aug 22 18:05:46 juju-e4d256-prod-github-runner-207 kernel: [45720.283898] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 18:05:46 juju-e4d256-prod-github-runner-207 kernel: [45720.284657] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 18:05:46 juju-e4d256-prod-github-runner-207 kernel: [45720.285518] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 18:05:46 juju-e4d256-prod-github-runner-207 kernel: [45720.286330] ? __seccomp_filter+0x4a/0x4a0 Aug 22 18:05:46 juju-e4d256-prod-github-runner-207 kernel: [45720.287071] ? __fget_files+0x86/0xc0 Aug 22 18:05:46 juju-e4d256-prod-github-runner-207 kernel: [45720.287781] __x64_sys_ioctl+0x95/0xd0 Aug 22 18:05:46 juju-e4d256-prod-github-runner-207 kernel: [45720.288508] do_syscall_64+0x5c/0xc0 Aug 22 18:05:46 juju-e4d256-prod-github-runner-207 kernel: [45720.289194] ? do_futex+0x162/0x1f0 Aug 22 18:05:46 juju-e4d256-prod-github-runner-207 kernel: [45720.289873] ? __x64_sys_futex+0x78/0x1e0 Aug 22 18:05:46 juju-e4d256-prod-github-runner-207 kernel: [45720.290792] ? __secure_computing+0xa9/0x120 Aug 22 18:05:46 juju-e4d256-prod-github-runner-207 kernel: [45720.291609] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 18:05:46 juju-e4d256-prod-github-runner-207 kernel: [45720.292684] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:05:46 juju-e4d256-prod-github-runner-207 kernel: [45720.293533] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:05:46 juju-e4d256-prod-github-runner-207 kernel: [45720.294346] ? do_syscall_64+0x69/0xc0 Aug 22 18:05:46 juju-e4d256-prod-github-runner-207 kernel: [45720.295068] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:05:46 juju-e4d256-prod-github-runner-207 kernel: [45720.295910] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:05:46 juju-e4d256-prod-github-runner-207 kernel: [45720.296701] ? do_syscall_64+0x69/0xc0 Aug 22 18:05:46 juju-e4d256-prod-github-runner-207 kernel: [45720.297407] ? do_syscall_64+0x69/0xc0 Aug 22 18:05:46 juju-e4d256-prod-github-runner-207 kernel: [45720.298100] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 18:05:46 juju-e4d256-prod-github-runner-207 kernel: [45720.298875] RIP: 0033:0x7faa5d0edaff Aug 22 18:05:46 juju-e4d256-prod-github-runner-207 kernel: [45720.299566] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 18:05:46 juju-e4d256-prod-github-runner-207 kernel: [45720.301734] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 18:05:46 juju-e4d256-prod-github-runner-207 kernel: [45720.302706] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 18:05:46 juju-e4d256-prod-github-runner-207 kernel: [45720.303762] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 18:05:46 juju-e4d256-prod-github-runner-207 kernel: [45720.304859] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 18:05:46 juju-e4d256-prod-github-runner-207 kernel: [45720.305803] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 18:05:46 juju-e4d256-prod-github-runner-207 kernel: [45720.306731] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 18:05:46 juju-e4d256-prod-github-runner-207 kernel: [45720.307649] Aug 22 18:06:10 juju-e4d256-prod-github-runner-207 kernel: [45744.541981] watchdog: BUG: soft lockup - CPU#1 stuck for 42494s! [qemu-system-x86:6715] Aug 22 18:06:10 juju-e4d256-prod-github-runner-207 kernel: [45744.543905] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 18:06:10 juju-e4d256-prod-github-runner-207 kernel: [45744.544217] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 18:06:10 juju-e4d256-prod-github-runner-207 kernel: [45744.557052] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 18:06:10 juju-e4d256-prod-github-runner-207 kernel: [45744.558360] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 18:06:10 juju-e4d256-prod-github-runner-207 kernel: [45744.559622] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:06:10 juju-e4d256-prod-github-runner-207 kernel: [45744.560721] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 18:06:10 juju-e4d256-prod-github-runner-207 kernel: [45744.563548] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 18:06:10 juju-e4d256-prod-github-runner-207 kernel: [45744.564637] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 18:06:10 juju-e4d256-prod-github-runner-207 kernel: [45744.565963] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 18:06:10 juju-e4d256-prod-github-runner-207 kernel: [45744.567152] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 18:06:10 juju-e4d256-prod-github-runner-207 kernel: [45744.568365] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 18:06:10 juju-e4d256-prod-github-runner-207 kernel: [45744.569606] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 18:06:10 juju-e4d256-prod-github-runner-207 kernel: [45744.570884] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 18:06:10 juju-e4d256-prod-github-runner-207 kernel: [45744.572236] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 18:06:10 juju-e4d256-prod-github-runner-207 kernel: [45744.573736] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 18:06:10 juju-e4d256-prod-github-runner-207 kernel: [45744.575363] Call Trace: Aug 22 18:06:10 juju-e4d256-prod-github-runner-207 kernel: [45744.576344] Aug 22 18:06:10 juju-e4d256-prod-github-runner-207 kernel: [45744.577461] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:06:10 juju-e4d256-prod-github-runner-207 kernel: [45744.578922] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:06:10 juju-e4d256-prod-github-runner-207 kernel: [45744.580106] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:06:10 juju-e4d256-prod-github-runner-207 kernel: [45744.581296] ? show_regs.part.0+0x23/0x29 Aug 22 18:06:10 juju-e4d256-prod-github-runner-207 kernel: [45744.582632] ? show_regs.cold+0x8/0xd Aug 22 18:06:10 juju-e4d256-prod-github-runner-207 kernel: [45744.584231] ? watchdog_timer_fn+0x1be/0x220 Aug 22 18:06:10 juju-e4d256-prod-github-runner-207 kernel: [45744.585609] ? lockup_detector_update_enable+0x60/0x60 Aug 22 18:06:10 juju-e4d256-prod-github-runner-207 kernel: [45744.586721] ? __hrtimer_run_queues+0x107/0x230 Aug 22 18:06:10 juju-e4d256-prod-github-runner-207 kernel: [45744.587818] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 18:06:10 juju-e4d256-prod-github-runner-207 kernel: [45744.588881] ? hrtimer_interrupt+0x101/0x220 Aug 22 18:06:10 juju-e4d256-prod-github-runner-207 kernel: [45744.589927] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 18:06:10 juju-e4d256-prod-github-runner-207 kernel: [45744.591035] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 18:06:10 juju-e4d256-prod-github-runner-207 kernel: [45744.592178] Aug 22 18:06:10 juju-e4d256-prod-github-runner-207 kernel: [45744.593066] Aug 22 18:06:10 juju-e4d256-prod-github-runner-207 kernel: [45744.593927] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 18:06:10 juju-e4d256-prod-github-runner-207 kernel: [45744.594992] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:06:10 juju-e4d256-prod-github-runner-207 kernel: [45744.596090] ? _raw_spin_lock+0x22/0x30 Aug 22 18:06:10 juju-e4d256-prod-github-runner-207 kernel: [45744.597057] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:06:10 juju-e4d256-prod-github-runner-207 kernel: [45744.598111] direct_page_fault+0x206/0x310 [kvm] Aug 22 18:06:10 juju-e4d256-prod-github-runner-207 kernel: [45744.599169] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 18:06:10 juju-e4d256-prod-github-runner-207 kernel: [45744.600277] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 18:06:10 juju-e4d256-prod-github-runner-207 kernel: [45744.601356] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 18:06:10 juju-e4d256-prod-github-runner-207 kernel: [45744.602441] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 18:06:10 juju-e4d256-prod-github-runner-207 kernel: [45744.603448] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 18:06:10 juju-e4d256-prod-github-runner-207 kernel: [45744.604552] handle_exit+0x98/0x230 [kvm_amd] Aug 22 18:06:10 juju-e4d256-prod-github-runner-207 kernel: [45744.605474] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 18:06:10 juju-e4d256-prod-github-runner-207 kernel: [45744.606433] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 18:06:10 juju-e4d256-prod-github-runner-207 kernel: [45744.607431] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 18:06:10 juju-e4d256-prod-github-runner-207 kernel: [45744.608395] vcpu_run+0x62/0x2c0 [kvm] Aug 22 18:06:10 juju-e4d256-prod-github-runner-207 kernel: [45744.609231] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 18:06:10 juju-e4d256-prod-github-runner-207 kernel: [45744.610068] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 18:06:10 juju-e4d256-prod-github-runner-207 kernel: [45744.610949] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 18:06:10 juju-e4d256-prod-github-runner-207 kernel: [45744.611809] ? __seccomp_filter+0x4a/0x4a0 Aug 22 18:06:10 juju-e4d256-prod-github-runner-207 kernel: [45744.612603] ? __fget_files+0x86/0xc0 Aug 22 18:06:10 juju-e4d256-prod-github-runner-207 kernel: [45744.613355] __x64_sys_ioctl+0x95/0xd0 Aug 22 18:06:10 juju-e4d256-prod-github-runner-207 kernel: [45744.614084] do_syscall_64+0x5c/0xc0 Aug 22 18:06:10 juju-e4d256-prod-github-runner-207 kernel: [45744.614782] ? do_futex+0x162/0x1f0 Aug 22 18:06:10 juju-e4d256-prod-github-runner-207 kernel: [45744.615451] ? __x64_sys_futex+0x78/0x1e0 Aug 22 18:06:10 juju-e4d256-prod-github-runner-207 kernel: [45744.616218] ? __secure_computing+0xa9/0x120 Aug 22 18:06:10 juju-e4d256-prod-github-runner-207 kernel: [45744.616937] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 18:06:10 juju-e4d256-prod-github-runner-207 kernel: [45744.617734] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:06:10 juju-e4d256-prod-github-runner-207 kernel: [45744.618486] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:06:10 juju-e4d256-prod-github-runner-207 kernel: [45744.619420] ? do_syscall_64+0x69/0xc0 Aug 22 18:06:10 juju-e4d256-prod-github-runner-207 kernel: [45744.620102] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:06:10 juju-e4d256-prod-github-runner-207 kernel: [45744.620842] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:06:10 juju-e4d256-prod-github-runner-207 kernel: [45744.621568] ? do_syscall_64+0x69/0xc0 Aug 22 18:06:10 juju-e4d256-prod-github-runner-207 kernel: [45744.622253] ? do_syscall_64+0x69/0xc0 Aug 22 18:06:10 juju-e4d256-prod-github-runner-207 kernel: [45744.622907] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 18:06:10 juju-e4d256-prod-github-runner-207 kernel: [45744.623681] RIP: 0033:0x7faa5d0edaff Aug 22 18:06:10 juju-e4d256-prod-github-runner-207 kernel: [45744.624368] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 18:06:10 juju-e4d256-prod-github-runner-207 kernel: [45744.626634] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 18:06:10 juju-e4d256-prod-github-runner-207 kernel: [45744.627664] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 18:06:10 juju-e4d256-prod-github-runner-207 kernel: [45744.628591] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 18:06:10 juju-e4d256-prod-github-runner-207 kernel: [45744.629526] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 18:06:10 juju-e4d256-prod-github-runner-207 kernel: [45744.630469] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 18:06:10 juju-e4d256-prod-github-runner-207 kernel: [45744.631437] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 18:06:10 juju-e4d256-prod-github-runner-207 kernel: [45744.632448] Aug 22 18:06:38 juju-e4d256-prod-github-runner-207 kernel: [45772.541981] watchdog: BUG: soft lockup - CPU#1 stuck for 42521s! [qemu-system-x86:6715] Aug 22 18:06:38 juju-e4d256-prod-github-runner-207 kernel: [45772.543308] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 18:06:38 juju-e4d256-prod-github-runner-207 kernel: [45772.543380] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 18:06:38 juju-e4d256-prod-github-runner-207 kernel: [45772.557433] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 18:06:38 juju-e4d256-prod-github-runner-207 kernel: [45772.558890] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 18:06:38 juju-e4d256-prod-github-runner-207 kernel: [45772.560323] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:06:38 juju-e4d256-prod-github-runner-207 kernel: [45772.561515] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 18:06:38 juju-e4d256-prod-github-runner-207 kernel: [45772.564445] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 18:06:38 juju-e4d256-prod-github-runner-207 kernel: [45772.565605] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 18:06:38 juju-e4d256-prod-github-runner-207 kernel: [45772.566911] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 18:06:38 juju-e4d256-prod-github-runner-207 kernel: [45772.568235] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 18:06:38 juju-e4d256-prod-github-runner-207 kernel: [45772.569533] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 18:06:38 juju-e4d256-prod-github-runner-207 kernel: [45772.570839] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 18:06:38 juju-e4d256-prod-github-runner-207 kernel: [45772.572191] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 18:06:38 juju-e4d256-prod-github-runner-207 kernel: [45772.573525] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 18:06:38 juju-e4d256-prod-github-runner-207 kernel: [45772.574680] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 18:06:38 juju-e4d256-prod-github-runner-207 kernel: [45772.575972] Call Trace: Aug 22 18:06:38 juju-e4d256-prod-github-runner-207 kernel: [45772.576915] Aug 22 18:06:38 juju-e4d256-prod-github-runner-207 kernel: [45772.577831] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:06:38 juju-e4d256-prod-github-runner-207 kernel: [45772.578896] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:06:38 juju-e4d256-prod-github-runner-207 kernel: [45772.579979] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:06:38 juju-e4d256-prod-github-runner-207 kernel: [45772.581099] ? show_regs.part.0+0x23/0x29 Aug 22 18:06:38 juju-e4d256-prod-github-runner-207 kernel: [45772.582137] ? show_regs.cold+0x8/0xd Aug 22 18:06:38 juju-e4d256-prod-github-runner-207 kernel: [45772.583126] ? watchdog_timer_fn+0x1be/0x220 Aug 22 18:06:38 juju-e4d256-prod-github-runner-207 kernel: [45772.584166] ? lockup_detector_update_enable+0x60/0x60 Aug 22 18:06:38 juju-e4d256-prod-github-runner-207 kernel: [45772.585240] ? __hrtimer_run_queues+0x107/0x230 Aug 22 18:06:38 juju-e4d256-prod-github-runner-207 kernel: [45772.586283] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 18:06:38 juju-e4d256-prod-github-runner-207 kernel: [45772.587356] ? hrtimer_interrupt+0x101/0x220 Aug 22 18:06:38 juju-e4d256-prod-github-runner-207 kernel: [45772.588392] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 18:06:38 juju-e4d256-prod-github-runner-207 kernel: [45772.589505] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 18:06:38 juju-e4d256-prod-github-runner-207 kernel: [45772.590613] Aug 22 18:06:38 juju-e4d256-prod-github-runner-207 kernel: [45772.591529] Aug 22 18:06:38 juju-e4d256-prod-github-runner-207 kernel: [45772.592405] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 18:06:38 juju-e4d256-prod-github-runner-207 kernel: [45772.593644] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:06:38 juju-e4d256-prod-github-runner-207 kernel: [45772.594720] ? _raw_spin_lock+0x22/0x30 Aug 22 18:06:38 juju-e4d256-prod-github-runner-207 kernel: [45772.595705] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:06:38 juju-e4d256-prod-github-runner-207 kernel: [45772.596753] direct_page_fault+0x206/0x310 [kvm] Aug 22 18:06:38 juju-e4d256-prod-github-runner-207 kernel: [45772.597941] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 18:06:38 juju-e4d256-prod-github-runner-207 kernel: [45772.598961] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 18:06:38 juju-e4d256-prod-github-runner-207 kernel: [45772.599987] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 18:06:38 juju-e4d256-prod-github-runner-207 kernel: [45772.600963] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 18:06:38 juju-e4d256-prod-github-runner-207 kernel: [45772.601926] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 18:06:38 juju-e4d256-prod-github-runner-207 kernel: [45772.602913] handle_exit+0x98/0x230 [kvm_amd] Aug 22 18:06:38 juju-e4d256-prod-github-runner-207 kernel: [45772.603842] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 18:06:38 juju-e4d256-prod-github-runner-207 kernel: [45772.604764] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 18:06:38 juju-e4d256-prod-github-runner-207 kernel: [45772.605696] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 18:06:38 juju-e4d256-prod-github-runner-207 kernel: [45772.606604] vcpu_run+0x62/0x2c0 [kvm] Aug 22 18:06:38 juju-e4d256-prod-github-runner-207 kernel: [45772.607438] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 18:06:38 juju-e4d256-prod-github-runner-207 kernel: [45772.608267] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 18:06:38 juju-e4d256-prod-github-runner-207 kernel: [45772.609144] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 18:06:38 juju-e4d256-prod-github-runner-207 kernel: [45772.609948] ? __seccomp_filter+0x4a/0x4a0 Aug 22 18:06:38 juju-e4d256-prod-github-runner-207 kernel: [45772.610717] ? __fget_files+0x86/0xc0 Aug 22 18:06:38 juju-e4d256-prod-github-runner-207 kernel: [45772.611493] __x64_sys_ioctl+0x95/0xd0 Aug 22 18:06:38 juju-e4d256-prod-github-runner-207 kernel: [45772.612202] do_syscall_64+0x5c/0xc0 Aug 22 18:06:38 juju-e4d256-prod-github-runner-207 kernel: [45772.612871] ? do_futex+0x162/0x1f0 Aug 22 18:06:38 juju-e4d256-prod-github-runner-207 kernel: [45772.613531] ? __x64_sys_futex+0x78/0x1e0 Aug 22 18:06:38 juju-e4d256-prod-github-runner-207 kernel: [45772.614225] ? __secure_computing+0xa9/0x120 Aug 22 18:06:38 juju-e4d256-prod-github-runner-207 kernel: [45772.614922] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 18:06:38 juju-e4d256-prod-github-runner-207 kernel: [45772.615716] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:06:38 juju-e4d256-prod-github-runner-207 kernel: [45772.616467] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:06:38 juju-e4d256-prod-github-runner-207 kernel: [45772.617202] ? do_syscall_64+0x69/0xc0 Aug 22 18:06:38 juju-e4d256-prod-github-runner-207 kernel: [45772.617862] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:06:38 juju-e4d256-prod-github-runner-207 kernel: [45772.618572] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:06:38 juju-e4d256-prod-github-runner-207 kernel: [45772.619294] ? do_syscall_64+0x69/0xc0 Aug 22 18:06:38 juju-e4d256-prod-github-runner-207 kernel: [45772.619926] ? do_syscall_64+0x69/0xc0 Aug 22 18:06:38 juju-e4d256-prod-github-runner-207 kernel: [45772.620552] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 18:06:38 juju-e4d256-prod-github-runner-207 kernel: [45772.621271] RIP: 0033:0x7faa5d0edaff Aug 22 18:06:38 juju-e4d256-prod-github-runner-207 kernel: [45772.621935] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 18:06:38 juju-e4d256-prod-github-runner-207 kernel: [45772.623989] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 18:06:38 juju-e4d256-prod-github-runner-207 kernel: [45772.624907] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 18:06:38 juju-e4d256-prod-github-runner-207 kernel: [45772.625830] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 18:06:38 juju-e4d256-prod-github-runner-207 kernel: [45772.626763] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 18:06:38 juju-e4d256-prod-github-runner-207 kernel: [45772.627702] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 18:06:38 juju-e4d256-prod-github-runner-207 kernel: [45772.628618] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 18:06:38 juju-e4d256-prod-github-runner-207 kernel: [45772.629526] Aug 22 18:07:06 juju-e4d256-prod-github-runner-207 kernel: [45800.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 42547s! [qemu-system-x86:6715] Aug 22 18:07:06 juju-e4d256-prod-github-runner-207 kernel: [45800.543099] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 18:07:06 juju-e4d256-prod-github-runner-207 kernel: [45800.543170] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 18:07:06 juju-e4d256-prod-github-runner-207 kernel: [45800.555244] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 18:07:06 juju-e4d256-prod-github-runner-207 kernel: [45800.556511] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 18:07:06 juju-e4d256-prod-github-runner-207 kernel: [45800.557752] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:07:06 juju-e4d256-prod-github-runner-207 kernel: [45800.558843] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 18:07:06 juju-e4d256-prod-github-runner-207 kernel: [45800.561411] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 18:07:06 juju-e4d256-prod-github-runner-207 kernel: [45800.562464] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 18:07:06 juju-e4d256-prod-github-runner-207 kernel: [45800.563658] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 18:07:06 juju-e4d256-prod-github-runner-207 kernel: [45800.564827] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 18:07:06 juju-e4d256-prod-github-runner-207 kernel: [45800.565991] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 18:07:06 juju-e4d256-prod-github-runner-207 kernel: [45800.567173] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 18:07:06 juju-e4d256-prod-github-runner-207 kernel: [45800.568342] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 18:07:06 juju-e4d256-prod-github-runner-207 kernel: [45800.569577] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 18:07:06 juju-e4d256-prod-github-runner-207 kernel: [45800.570682] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 18:07:06 juju-e4d256-prod-github-runner-207 kernel: [45800.571892] Call Trace: Aug 22 18:07:06 juju-e4d256-prod-github-runner-207 kernel: [45800.572809] Aug 22 18:07:06 juju-e4d256-prod-github-runner-207 kernel: [45800.573696] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:07:06 juju-e4d256-prod-github-runner-207 kernel: [45800.574730] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:07:06 juju-e4d256-prod-github-runner-207 kernel: [45800.575761] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:07:06 juju-e4d256-prod-github-runner-207 kernel: [45800.576847] ? show_regs.part.0+0x23/0x29 Aug 22 18:07:06 juju-e4d256-prod-github-runner-207 kernel: [45800.577862] ? show_regs.cold+0x8/0xd Aug 22 18:07:06 juju-e4d256-prod-github-runner-207 kernel: [45800.578861] ? watchdog_timer_fn+0x1be/0x220 Aug 22 18:07:06 juju-e4d256-prod-github-runner-207 kernel: [45800.579917] ? lockup_detector_update_enable+0x60/0x60 Aug 22 18:07:06 juju-e4d256-prod-github-runner-207 kernel: [45800.581027] ? __hrtimer_run_queues+0x107/0x230 Aug 22 18:07:06 juju-e4d256-prod-github-runner-207 kernel: [45800.582059] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 18:07:06 juju-e4d256-prod-github-runner-207 kernel: [45800.583110] ? hrtimer_interrupt+0x101/0x220 Aug 22 18:07:06 juju-e4d256-prod-github-runner-207 kernel: [45800.584136] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 18:07:06 juju-e4d256-prod-github-runner-207 kernel: [45800.585209] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 18:07:06 juju-e4d256-prod-github-runner-207 kernel: [45800.586257] Aug 22 18:07:06 juju-e4d256-prod-github-runner-207 kernel: [45800.587134] Aug 22 18:07:06 juju-e4d256-prod-github-runner-207 kernel: [45800.587985] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 18:07:06 juju-e4d256-prod-github-runner-207 kernel: [45800.589015] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:07:06 juju-e4d256-prod-github-runner-207 kernel: [45800.590112] ? _raw_spin_lock+0x22/0x30 Aug 22 18:07:06 juju-e4d256-prod-github-runner-207 kernel: [45800.591106] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:07:06 juju-e4d256-prod-github-runner-207 kernel: [45800.592132] direct_page_fault+0x206/0x310 [kvm] Aug 22 18:07:06 juju-e4d256-prod-github-runner-207 kernel: [45800.593329] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 18:07:06 juju-e4d256-prod-github-runner-207 kernel: [45800.594361] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 18:07:06 juju-e4d256-prod-github-runner-207 kernel: [45800.595402] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 18:07:06 juju-e4d256-prod-github-runner-207 kernel: [45800.596376] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 18:07:06 juju-e4d256-prod-github-runner-207 kernel: [45800.597321] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 18:07:06 juju-e4d256-prod-github-runner-207 kernel: [45800.598305] handle_exit+0x98/0x230 [kvm_amd] Aug 22 18:07:06 juju-e4d256-prod-github-runner-207 kernel: [45800.599225] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 18:07:06 juju-e4d256-prod-github-runner-207 kernel: [45800.600143] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 18:07:06 juju-e4d256-prod-github-runner-207 kernel: [45800.601072] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 18:07:06 juju-e4d256-prod-github-runner-207 kernel: [45800.601977] vcpu_run+0x62/0x2c0 [kvm] Aug 22 18:07:06 juju-e4d256-prod-github-runner-207 kernel: [45800.602811] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 18:07:06 juju-e4d256-prod-github-runner-207 kernel: [45800.603633] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 18:07:06 juju-e4d256-prod-github-runner-207 kernel: [45800.604491] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 18:07:06 juju-e4d256-prod-github-runner-207 kernel: [45800.605292] ? __seccomp_filter+0x4a/0x4a0 Aug 22 18:07:06 juju-e4d256-prod-github-runner-207 kernel: [45800.606037] ? __fget_files+0x86/0xc0 Aug 22 18:07:06 juju-e4d256-prod-github-runner-207 kernel: [45800.606745] __x64_sys_ioctl+0x95/0xd0 Aug 22 18:07:06 juju-e4d256-prod-github-runner-207 kernel: [45800.607459] do_syscall_64+0x5c/0xc0 Aug 22 18:07:06 juju-e4d256-prod-github-runner-207 kernel: [45800.608140] ? do_futex+0x162/0x1f0 Aug 22 18:07:06 juju-e4d256-prod-github-runner-207 kernel: [45800.608800] ? __x64_sys_futex+0x78/0x1e0 Aug 22 18:07:06 juju-e4d256-prod-github-runner-207 kernel: [45800.609489] ? __secure_computing+0xa9/0x120 Aug 22 18:07:06 juju-e4d256-prod-github-runner-207 kernel: [45800.610179] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 18:07:06 juju-e4d256-prod-github-runner-207 kernel: [45800.610958] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:07:06 juju-e4d256-prod-github-runner-207 kernel: [45800.611682] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:07:06 juju-e4d256-prod-github-runner-207 kernel: [45800.612408] ? do_syscall_64+0x69/0xc0 Aug 22 18:07:06 juju-e4d256-prod-github-runner-207 kernel: [45800.613052] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:07:06 juju-e4d256-prod-github-runner-207 kernel: [45800.613759] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:07:06 juju-e4d256-prod-github-runner-207 kernel: [45800.614528] ? do_syscall_64+0x69/0xc0 Aug 22 18:07:06 juju-e4d256-prod-github-runner-207 kernel: [45800.615185] ? do_syscall_64+0x69/0xc0 Aug 22 18:07:06 juju-e4d256-prod-github-runner-207 kernel: [45800.615820] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 18:07:06 juju-e4d256-prod-github-runner-207 kernel: [45800.616537] RIP: 0033:0x7faa5d0edaff Aug 22 18:07:06 juju-e4d256-prod-github-runner-207 kernel: [45800.617205] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 18:07:06 juju-e4d256-prod-github-runner-207 kernel: [45800.619383] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 18:07:06 juju-e4d256-prod-github-runner-207 kernel: [45800.620300] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 18:07:06 juju-e4d256-prod-github-runner-207 kernel: [45800.621196] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 18:07:06 juju-e4d256-prod-github-runner-207 kernel: [45800.622116] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 18:07:06 juju-e4d256-prod-github-runner-207 kernel: [45800.623043] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 18:07:06 juju-e4d256-prod-github-runner-207 kernel: [45800.623932] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 18:07:06 juju-e4d256-prod-github-runner-207 kernel: [45800.624822] Aug 22 18:07:34 juju-e4d256-prod-github-runner-207 kernel: [45828.541981] watchdog: BUG: soft lockup - CPU#1 stuck for 42573s! [qemu-system-x86:6715] Aug 22 18:07:34 juju-e4d256-prod-github-runner-207 kernel: [45828.543293] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 18:07:34 juju-e4d256-prod-github-runner-207 kernel: [45828.543369] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 18:07:34 juju-e4d256-prod-github-runner-207 kernel: [45828.557795] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 18:07:34 juju-e4d256-prod-github-runner-207 kernel: [45828.559270] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 18:07:34 juju-e4d256-prod-github-runner-207 kernel: [45828.560652] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:07:34 juju-e4d256-prod-github-runner-207 kernel: [45828.561844] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 18:07:34 juju-e4d256-prod-github-runner-207 kernel: [45828.564746] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 18:07:34 juju-e4d256-prod-github-runner-207 kernel: [45828.565887] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 18:07:34 juju-e4d256-prod-github-runner-207 kernel: [45828.567201] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 18:07:34 juju-e4d256-prod-github-runner-207 kernel: [45828.568500] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 18:07:34 juju-e4d256-prod-github-runner-207 kernel: [45828.569802] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 18:07:34 juju-e4d256-prod-github-runner-207 kernel: [45828.571160] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 18:07:34 juju-e4d256-prod-github-runner-207 kernel: [45828.572465] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 18:07:34 juju-e4d256-prod-github-runner-207 kernel: [45828.573851] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 18:07:34 juju-e4d256-prod-github-runner-207 kernel: [45828.575104] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 18:07:34 juju-e4d256-prod-github-runner-207 kernel: [45828.576666] Call Trace: Aug 22 18:07:34 juju-e4d256-prod-github-runner-207 kernel: [45828.577788] Aug 22 18:07:34 juju-e4d256-prod-github-runner-207 kernel: [45828.578740] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:07:34 juju-e4d256-prod-github-runner-207 kernel: [45828.579855] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:07:34 juju-e4d256-prod-github-runner-207 kernel: [45828.581009] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:07:34 juju-e4d256-prod-github-runner-207 kernel: [45828.582251] ? show_regs.part.0+0x23/0x29 Aug 22 18:07:34 juju-e4d256-prod-github-runner-207 kernel: [45828.583351] ? show_regs.cold+0x8/0xd Aug 22 18:07:34 juju-e4d256-prod-github-runner-207 kernel: [45828.584395] ? watchdog_timer_fn+0x1be/0x220 Aug 22 18:07:34 juju-e4d256-prod-github-runner-207 kernel: [45828.585484] ? lockup_detector_update_enable+0x60/0x60 Aug 22 18:07:34 juju-e4d256-prod-github-runner-207 kernel: [45828.586676] ? __hrtimer_run_queues+0x107/0x230 Aug 22 18:07:34 juju-e4d256-prod-github-runner-207 kernel: [45828.587794] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 18:07:34 juju-e4d256-prod-github-runner-207 kernel: [45828.588904] ? hrtimer_interrupt+0x101/0x220 Aug 22 18:07:34 juju-e4d256-prod-github-runner-207 kernel: [45828.589999] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 18:07:34 juju-e4d256-prod-github-runner-207 kernel: [45828.591179] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 18:07:34 juju-e4d256-prod-github-runner-207 kernel: [45828.592327] Aug 22 18:07:34 juju-e4d256-prod-github-runner-207 kernel: [45828.593225] Aug 22 18:07:34 juju-e4d256-prod-github-runner-207 kernel: [45828.594119] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 18:07:34 juju-e4d256-prod-github-runner-207 kernel: [45828.595277] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:07:34 juju-e4d256-prod-github-runner-207 kernel: [45828.596421] ? _raw_spin_lock+0x22/0x30 Aug 22 18:07:34 juju-e4d256-prod-github-runner-207 kernel: [45828.597449] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:07:34 juju-e4d256-prod-github-runner-207 kernel: [45828.598573] direct_page_fault+0x206/0x310 [kvm] Aug 22 18:07:34 juju-e4d256-prod-github-runner-207 kernel: [45828.599691] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 18:07:34 juju-e4d256-prod-github-runner-207 kernel: [45828.600785] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 18:07:34 juju-e4d256-prod-github-runner-207 kernel: [45828.601886] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 18:07:34 juju-e4d256-prod-github-runner-207 kernel: [45828.602968] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 18:07:34 juju-e4d256-prod-github-runner-207 kernel: [45828.604013] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 18:07:34 juju-e4d256-prod-github-runner-207 kernel: [45828.605095] handle_exit+0x98/0x230 [kvm_amd] Aug 22 18:07:34 juju-e4d256-prod-github-runner-207 kernel: [45828.606072] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 18:07:34 juju-e4d256-prod-github-runner-207 kernel: [45828.607086] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 18:07:34 juju-e4d256-prod-github-runner-207 kernel: [45828.608109] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 18:07:34 juju-e4d256-prod-github-runner-207 kernel: [45828.609135] vcpu_run+0x62/0x2c0 [kvm] Aug 22 18:07:34 juju-e4d256-prod-github-runner-207 kernel: [45828.610043] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 18:07:34 juju-e4d256-prod-github-runner-207 kernel: [45828.610956] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 18:07:34 juju-e4d256-prod-github-runner-207 kernel: [45828.611908] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 18:07:34 juju-e4d256-prod-github-runner-207 kernel: [45828.612797] ? __seccomp_filter+0x4a/0x4a0 Aug 22 18:07:34 juju-e4d256-prod-github-runner-207 kernel: [45828.613635] ? __fget_files+0x86/0xc0 Aug 22 18:07:34 juju-e4d256-prod-github-runner-207 kernel: [45828.614410] __x64_sys_ioctl+0x95/0xd0 Aug 22 18:07:34 juju-e4d256-prod-github-runner-207 kernel: [45828.615196] do_syscall_64+0x5c/0xc0 Aug 22 18:07:34 juju-e4d256-prod-github-runner-207 kernel: [45828.615937] ? do_futex+0x162/0x1f0 Aug 22 18:07:34 juju-e4d256-prod-github-runner-207 kernel: [45828.616655] ? __x64_sys_futex+0x78/0x1e0 Aug 22 18:07:34 juju-e4d256-prod-github-runner-207 kernel: [45828.617403] ? __secure_computing+0xa9/0x120 Aug 22 18:07:34 juju-e4d256-prod-github-runner-207 kernel: [45828.618189] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 18:07:34 juju-e4d256-prod-github-runner-207 kernel: [45828.619061] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:07:34 juju-e4d256-prod-github-runner-207 kernel: [45828.619875] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:07:34 juju-e4d256-prod-github-runner-207 kernel: [45828.620687] ? do_syscall_64+0x69/0xc0 Aug 22 18:07:34 juju-e4d256-prod-github-runner-207 kernel: [45828.621410] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:07:34 juju-e4d256-prod-github-runner-207 kernel: [45828.622211] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:07:34 juju-e4d256-prod-github-runner-207 kernel: [45828.623009] ? do_syscall_64+0x69/0xc0 Aug 22 18:07:34 juju-e4d256-prod-github-runner-207 kernel: [45828.623711] ? do_syscall_64+0x69/0xc0 Aug 22 18:07:34 juju-e4d256-prod-github-runner-207 kernel: [45828.624411] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 18:07:34 juju-e4d256-prod-github-runner-207 kernel: [45828.625212] RIP: 0033:0x7faa5d0edaff Aug 22 18:07:34 juju-e4d256-prod-github-runner-207 kernel: [45828.625908] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 18:07:34 juju-e4d256-prod-github-runner-207 kernel: [45828.628232] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 18:07:34 juju-e4d256-prod-github-runner-207 kernel: [45828.629282] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 18:07:34 juju-e4d256-prod-github-runner-207 kernel: [45828.630305] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 18:07:34 juju-e4d256-prod-github-runner-207 kernel: [45828.631341] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 18:07:34 juju-e4d256-prod-github-runner-207 kernel: [45828.632362] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 18:07:34 juju-e4d256-prod-github-runner-207 kernel: [45828.633384] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 18:07:34 juju-e4d256-prod-github-runner-207 kernel: [45828.634410] Aug 22 18:08:02 juju-e4d256-prod-github-runner-207 kernel: [45856.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 42599s! [qemu-system-x86:6715] Aug 22 18:08:02 juju-e4d256-prod-github-runner-207 kernel: [45856.543886] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 18:08:02 juju-e4d256-prod-github-runner-207 kernel: [45856.544187] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 18:08:02 juju-e4d256-prod-github-runner-207 kernel: [45856.556627] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 18:08:02 juju-e4d256-prod-github-runner-207 kernel: [45856.557931] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 18:08:02 juju-e4d256-prod-github-runner-207 kernel: [45856.559169] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:08:02 juju-e4d256-prod-github-runner-207 kernel: [45856.560225] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 18:08:02 juju-e4d256-prod-github-runner-207 kernel: [45856.562773] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 18:08:02 juju-e4d256-prod-github-runner-207 kernel: [45856.563811] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 18:08:02 juju-e4d256-prod-github-runner-207 kernel: [45856.564979] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 18:08:02 juju-e4d256-prod-github-runner-207 kernel: [45856.566175] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 18:08:02 juju-e4d256-prod-github-runner-207 kernel: [45856.567341] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 18:08:02 juju-e4d256-prod-github-runner-207 kernel: [45856.568518] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 18:08:02 juju-e4d256-prod-github-runner-207 kernel: [45856.569695] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 18:08:02 juju-e4d256-prod-github-runner-207 kernel: [45856.570935] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 18:08:02 juju-e4d256-prod-github-runner-207 kernel: [45856.572028] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 18:08:02 juju-e4d256-prod-github-runner-207 kernel: [45856.573220] Call Trace: Aug 22 18:08:02 juju-e4d256-prod-github-runner-207 kernel: [45856.574136] Aug 22 18:08:02 juju-e4d256-prod-github-runner-207 kernel: [45856.575033] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:08:02 juju-e4d256-prod-github-runner-207 kernel: [45856.576066] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:08:02 juju-e4d256-prod-github-runner-207 kernel: [45856.577085] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:08:02 juju-e4d256-prod-github-runner-207 kernel: [45856.578204] ? show_regs.part.0+0x23/0x29 Aug 22 18:08:02 juju-e4d256-prod-github-runner-207 kernel: [45856.579202] ? show_regs.cold+0x8/0xd Aug 22 18:08:02 juju-e4d256-prod-github-runner-207 kernel: [45856.580186] ? watchdog_timer_fn+0x1be/0x220 Aug 22 18:08:02 juju-e4d256-prod-github-runner-207 kernel: [45856.581200] ? lockup_detector_update_enable+0x60/0x60 Aug 22 18:08:02 juju-e4d256-prod-github-runner-207 kernel: [45856.582288] ? __hrtimer_run_queues+0x107/0x230 Aug 22 18:08:02 juju-e4d256-prod-github-runner-207 kernel: [45856.583319] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 18:08:02 juju-e4d256-prod-github-runner-207 kernel: [45856.584340] ? hrtimer_interrupt+0x101/0x220 Aug 22 18:08:02 juju-e4d256-prod-github-runner-207 kernel: [45856.585355] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 18:08:02 juju-e4d256-prod-github-runner-207 kernel: [45856.586456] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 18:08:02 juju-e4d256-prod-github-runner-207 kernel: [45856.587514] Aug 22 18:08:02 juju-e4d256-prod-github-runner-207 kernel: [45856.588367] Aug 22 18:08:02 juju-e4d256-prod-github-runner-207 kernel: [45856.589210] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 18:08:02 juju-e4d256-prod-github-runner-207 kernel: [45856.590265] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:08:02 juju-e4d256-prod-github-runner-207 kernel: [45856.591307] ? _raw_spin_lock+0x22/0x30 Aug 22 18:08:02 juju-e4d256-prod-github-runner-207 kernel: [45856.592256] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:08:02 juju-e4d256-prod-github-runner-207 kernel: [45856.593274] direct_page_fault+0x206/0x310 [kvm] Aug 22 18:08:02 juju-e4d256-prod-github-runner-207 kernel: [45856.594312] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 18:08:02 juju-e4d256-prod-github-runner-207 kernel: [45856.595321] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 18:08:02 juju-e4d256-prod-github-runner-207 kernel: [45856.596339] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 18:08:02 juju-e4d256-prod-github-runner-207 kernel: [45856.597368] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 18:08:02 juju-e4d256-prod-github-runner-207 kernel: [45856.598338] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 18:08:02 juju-e4d256-prod-github-runner-207 kernel: [45856.599327] handle_exit+0x98/0x230 [kvm_amd] Aug 22 18:08:02 juju-e4d256-prod-github-runner-207 kernel: [45856.600230] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 18:08:02 juju-e4d256-prod-github-runner-207 kernel: [45856.601144] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 18:08:02 juju-e4d256-prod-github-runner-207 kernel: [45856.602081] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 18:08:02 juju-e4d256-prod-github-runner-207 kernel: [45856.603000] vcpu_run+0x62/0x2c0 [kvm] Aug 22 18:08:02 juju-e4d256-prod-github-runner-207 kernel: [45856.603816] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 18:08:02 juju-e4d256-prod-github-runner-207 kernel: [45856.604626] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 18:08:02 juju-e4d256-prod-github-runner-207 kernel: [45856.605489] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 18:08:02 juju-e4d256-prod-github-runner-207 kernel: [45856.606306] ? __seccomp_filter+0x4a/0x4a0 Aug 22 18:08:02 juju-e4d256-prod-github-runner-207 kernel: [45856.607077] ? __fget_files+0x86/0xc0 Aug 22 18:08:02 juju-e4d256-prod-github-runner-207 kernel: [45856.607806] __x64_sys_ioctl+0x95/0xd0 Aug 22 18:08:02 juju-e4d256-prod-github-runner-207 kernel: [45856.608587] do_syscall_64+0x5c/0xc0 Aug 22 18:08:02 juju-e4d256-prod-github-runner-207 kernel: [45856.609263] ? do_futex+0x162/0x1f0 Aug 22 18:08:02 juju-e4d256-prod-github-runner-207 kernel: [45856.609915] ? __x64_sys_futex+0x78/0x1e0 Aug 22 18:08:02 juju-e4d256-prod-github-runner-207 kernel: [45856.610612] ? __secure_computing+0xa9/0x120 Aug 22 18:08:02 juju-e4d256-prod-github-runner-207 kernel: [45856.611302] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 18:08:02 juju-e4d256-prod-github-runner-207 kernel: [45856.612063] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:08:02 juju-e4d256-prod-github-runner-207 kernel: [45856.612794] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:08:02 juju-e4d256-prod-github-runner-207 kernel: [45856.613512] ? do_syscall_64+0x69/0xc0 Aug 22 18:08:02 juju-e4d256-prod-github-runner-207 kernel: [45856.614180] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:08:02 juju-e4d256-prod-github-runner-207 kernel: [45856.614895] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:08:02 juju-e4d256-prod-github-runner-207 kernel: [45856.615626] ? do_syscall_64+0x69/0xc0 Aug 22 18:08:02 juju-e4d256-prod-github-runner-207 kernel: [45856.616511] ? do_syscall_64+0x69/0xc0 Aug 22 18:08:02 juju-e4d256-prod-github-runner-207 kernel: [45856.617149] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 18:08:02 juju-e4d256-prod-github-runner-207 kernel: [45856.617862] RIP: 0033:0x7faa5d0edaff Aug 22 18:08:02 juju-e4d256-prod-github-runner-207 kernel: [45856.618548] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 18:08:02 juju-e4d256-prod-github-runner-207 kernel: [45856.620574] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 18:08:02 juju-e4d256-prod-github-runner-207 kernel: [45856.621496] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 18:08:02 juju-e4d256-prod-github-runner-207 kernel: [45856.622404] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 18:08:02 juju-e4d256-prod-github-runner-207 kernel: [45856.623297] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 18:08:02 juju-e4d256-prod-github-runner-207 kernel: [45856.624192] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 18:08:02 juju-e4d256-prod-github-runner-207 kernel: [45856.625089] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 18:08:02 juju-e4d256-prod-github-runner-207 kernel: [45856.625990] Aug 22 18:08:30 juju-e4d256-prod-github-runner-207 kernel: [45884.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 42625s! [qemu-system-x86:6715] Aug 22 18:08:30 juju-e4d256-prod-github-runner-207 kernel: [45884.543096] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 18:08:30 juju-e4d256-prod-github-runner-207 kernel: [45884.543166] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 18:08:30 juju-e4d256-prod-github-runner-207 kernel: [45884.555459] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 18:08:30 juju-e4d256-prod-github-runner-207 kernel: [45884.556796] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 18:08:30 juju-e4d256-prod-github-runner-207 kernel: [45884.558095] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:08:30 juju-e4d256-prod-github-runner-207 kernel: [45884.559732] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 18:08:30 juju-e4d256-prod-github-runner-207 kernel: [45884.565058] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 18:08:30 juju-e4d256-prod-github-runner-207 kernel: [45884.567302] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 18:08:30 juju-e4d256-prod-github-runner-207 kernel: [45884.568533] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 18:08:30 juju-e4d256-prod-github-runner-207 kernel: [45884.571835] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 18:08:30 juju-e4d256-prod-github-runner-207 kernel: [45884.573040] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 18:08:30 juju-e4d256-prod-github-runner-207 kernel: [45884.576359] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 18:08:30 juju-e4d256-prod-github-runner-207 kernel: [45884.577565] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 18:08:30 juju-e4d256-prod-github-runner-207 kernel: [45884.581025] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 18:08:30 juju-e4d256-prod-github-runner-207 kernel: [45884.582155] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 18:08:30 juju-e4d256-prod-github-runner-207 kernel: [45884.585528] Call Trace: Aug 22 18:08:30 juju-e4d256-prod-github-runner-207 kernel: [45884.586487] Aug 22 18:08:30 juju-e4d256-prod-github-runner-207 kernel: [45884.587380] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:08:30 juju-e4d256-prod-github-runner-207 kernel: [45884.590553] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:08:30 juju-e4d256-prod-github-runner-207 kernel: [45884.591595] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:08:30 juju-e4d256-prod-github-runner-207 kernel: [45884.594815] ? show_regs.part.0+0x23/0x29 Aug 22 18:08:30 juju-e4d256-prod-github-runner-207 kernel: [45884.595899] ? show_regs.cold+0x8/0xd Aug 22 18:08:30 juju-e4d256-prod-github-runner-207 kernel: [45884.598030] ? watchdog_timer_fn+0x1be/0x220 Aug 22 18:08:30 juju-e4d256-prod-github-runner-207 kernel: [45884.600321] ? lockup_detector_update_enable+0x60/0x60 Aug 22 18:08:30 juju-e4d256-prod-github-runner-207 kernel: [45884.603760] ? __hrtimer_run_queues+0x107/0x230 Aug 22 18:08:30 juju-e4d256-prod-github-runner-207 kernel: [45884.604965] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 18:08:30 juju-e4d256-prod-github-runner-207 kernel: [45884.608233] ? hrtimer_interrupt+0x101/0x220 Aug 22 18:08:30 juju-e4d256-prod-github-runner-207 kernel: [45884.609264] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 18:08:30 juju-e4d256-prod-github-runner-207 kernel: [45884.612599] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 18:08:30 juju-e4d256-prod-github-runner-207 kernel: [45884.613691] Aug 22 18:08:30 juju-e4d256-prod-github-runner-207 kernel: [45884.614566] Aug 22 18:08:30 juju-e4d256-prod-github-runner-207 kernel: [45884.618049] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 18:08:30 juju-e4d256-prod-github-runner-207 kernel: [45884.621350] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:08:30 juju-e4d256-prod-github-runner-207 kernel: [45884.622475] ? _raw_spin_lock+0x22/0x30 Aug 22 18:08:30 juju-e4d256-prod-github-runner-207 kernel: [45884.625146] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:08:30 juju-e4d256-prod-github-runner-207 kernel: [45884.626840] direct_page_fault+0x206/0x310 [kvm] Aug 22 18:08:30 juju-e4d256-prod-github-runner-207 kernel: [45884.627882] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 18:08:30 juju-e4d256-prod-github-runner-207 kernel: [45884.631333] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 18:08:30 juju-e4d256-prod-github-runner-207 kernel: [45884.634641] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 18:08:30 juju-e4d256-prod-github-runner-207 kernel: [45884.635655] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 18:08:30 juju-e4d256-prod-github-runner-207 kernel: [45884.638943] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 18:08:30 juju-e4d256-prod-github-runner-207 kernel: [45884.639992] handle_exit+0x98/0x230 [kvm_amd] Aug 22 18:08:30 juju-e4d256-prod-github-runner-207 kernel: [45884.643118] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 18:08:30 juju-e4d256-prod-github-runner-207 kernel: [45884.644163] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 18:08:30 juju-e4d256-prod-github-runner-207 kernel: [45884.647435] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 18:08:30 juju-e4d256-prod-github-runner-207 kernel: [45884.648382] vcpu_run+0x62/0x2c0 [kvm] Aug 22 18:08:30 juju-e4d256-prod-github-runner-207 kernel: [45884.651551] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 18:08:30 juju-e4d256-prod-github-runner-207 kernel: [45884.652390] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 18:08:30 juju-e4d256-prod-github-runner-207 kernel: [45884.653288] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 18:08:30 juju-e4d256-prod-github-runner-207 kernel: [45884.656331] ? __seccomp_filter+0x4a/0x4a0 Aug 22 18:08:30 juju-e4d256-prod-github-runner-207 kernel: [45884.657102] ? __fget_files+0x86/0xc0 Aug 22 18:08:30 juju-e4d256-prod-github-runner-207 kernel: [45884.657860] __x64_sys_ioctl+0x95/0xd0 Aug 22 18:08:30 juju-e4d256-prod-github-runner-207 kernel: [45884.660993] do_syscall_64+0x5c/0xc0 Aug 22 18:08:30 juju-e4d256-prod-github-runner-207 kernel: [45884.661697] ? do_futex+0x162/0x1f0 Aug 22 18:08:30 juju-e4d256-prod-github-runner-207 kernel: [45884.662387] ? __x64_sys_futex+0x78/0x1e0 Aug 22 18:08:30 juju-e4d256-prod-github-runner-207 kernel: [45884.663096] ? __secure_computing+0xa9/0x120 Aug 22 18:08:30 juju-e4d256-prod-github-runner-207 kernel: [45884.665866] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 18:08:30 juju-e4d256-prod-github-runner-207 kernel: [45884.666686] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:08:30 juju-e4d256-prod-github-runner-207 kernel: [45884.667479] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:08:30 juju-e4d256-prod-github-runner-207 kernel: [45884.670438] ? do_syscall_64+0x69/0xc0 Aug 22 18:08:30 juju-e4d256-prod-github-runner-207 kernel: [45884.671106] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:08:30 juju-e4d256-prod-github-runner-207 kernel: [45884.672474] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:08:30 juju-e4d256-prod-github-runner-207 kernel: [45884.675007] ? do_syscall_64+0x69/0xc0 Aug 22 18:08:30 juju-e4d256-prod-github-runner-207 kernel: [45884.675655] ? do_syscall_64+0x69/0xc0 Aug 22 18:08:30 juju-e4d256-prod-github-runner-207 kernel: [45884.678587] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 18:08:30 juju-e4d256-prod-github-runner-207 kernel: [45884.679341] RIP: 0033:0x7faa5d0edaff Aug 22 18:08:30 juju-e4d256-prod-github-runner-207 kernel: [45884.682303] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 18:08:30 juju-e4d256-prod-github-runner-207 kernel: [45884.686399] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 18:08:30 juju-e4d256-prod-github-runner-207 kernel: [45884.687401] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 18:08:30 juju-e4d256-prod-github-runner-207 kernel: [45884.690796] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 18:08:30 juju-e4d256-prod-github-runner-207 kernel: [45884.691724] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 18:08:30 juju-e4d256-prod-github-runner-207 kernel: [45884.695050] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 18:08:30 juju-e4d256-prod-github-runner-207 kernel: [45884.696019] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 18:08:30 juju-e4d256-prod-github-runner-207 kernel: [45884.699161] Aug 22 18:08:46 juju-e4d256-prod-github-runner-207 kernel: [45900.248706] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 18:08:46 juju-e4d256-prod-github-runner-207 kernel: [45900.249702] rcu: 1-....: (11409872 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=5522234 Aug 22 18:08:46 juju-e4d256-prod-github-runner-207 kernel: [45900.250838] (t=11445762 jiffies g=23269 q=44882) Aug 22 18:08:46 juju-e4d256-prod-github-runner-207 kernel: [45900.251635] NMI backtrace for cpu 1 Aug 22 18:08:46 juju-e4d256-prod-github-runner-207 kernel: [45900.252357] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 18:08:46 juju-e4d256-prod-github-runner-207 kernel: [45900.253516] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 18:08:46 juju-e4d256-prod-github-runner-207 kernel: [45900.254598] Call Trace: Aug 22 18:08:46 juju-e4d256-prod-github-runner-207 kernel: [45900.255280] Aug 22 18:08:46 juju-e4d256-prod-github-runner-207 kernel: [45900.255936] show_stack+0x52/0x5c Aug 22 18:08:46 juju-e4d256-prod-github-runner-207 kernel: [45900.256674] dump_stack_lvl+0x4a/0x63 Aug 22 18:08:46 juju-e4d256-prod-github-runner-207 kernel: [45900.257430] dump_stack+0x10/0x16 Aug 22 18:08:46 juju-e4d256-prod-github-runner-207 kernel: [45900.258180] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 18:08:46 juju-e4d256-prod-github-runner-207 kernel: [45900.258970] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 18:08:46 juju-e4d256-prod-github-runner-207 kernel: [45900.259760] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 18:08:46 juju-e4d256-prod-github-runner-207 kernel: [45900.260592] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 18:08:46 juju-e4d256-prod-github-runner-207 kernel: [45900.261423] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 18:08:46 juju-e4d256-prod-github-runner-207 kernel: [45900.262261] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 18:08:46 juju-e4d256-prod-github-runner-207 kernel: [45900.263048] print_cpu_stall.cold+0x2f/0xe2 Aug 22 18:08:46 juju-e4d256-prod-github-runner-207 kernel: [45900.263828] ? timekeeping_update+0xf7/0x150 Aug 22 18:08:46 juju-e4d256-prod-github-runner-207 kernel: [45900.264613] check_cpu_stall+0x109/0x270 Aug 22 18:08:46 juju-e4d256-prod-github-runner-207 kernel: [45900.265371] rcu_sched_clock_irq+0x9a/0x250 Aug 22 18:08:46 juju-e4d256-prod-github-runner-207 kernel: [45900.266157] update_process_times+0x94/0xd0 Aug 22 18:08:46 juju-e4d256-prod-github-runner-207 kernel: [45900.266929] tick_sched_handle+0x29/0x70 Aug 22 18:08:46 juju-e4d256-prod-github-runner-207 kernel: [45900.267773] tick_sched_timer+0x8c/0xc0 Aug 22 18:08:46 juju-e4d256-prod-github-runner-207 kernel: [45900.268748] ? tick_nohz_handler+0xb0/0xb0 Aug 22 18:08:46 juju-e4d256-prod-github-runner-207 kernel: [45900.269557] __hrtimer_run_queues+0x107/0x230 Aug 22 18:08:46 juju-e4d256-prod-github-runner-207 kernel: [45900.270381] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 18:08:46 juju-e4d256-prod-github-runner-207 kernel: [45900.271171] hrtimer_interrupt+0x101/0x220 Aug 22 18:08:46 juju-e4d256-prod-github-runner-207 kernel: [45900.271944] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 18:08:46 juju-e4d256-prod-github-runner-207 kernel: [45900.272781] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 18:08:46 juju-e4d256-prod-github-runner-207 kernel: [45900.273670] Aug 22 18:08:46 juju-e4d256-prod-github-runner-207 kernel: [45900.274329] Aug 22 18:08:46 juju-e4d256-prod-github-runner-207 kernel: [45900.274961] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 18:08:46 juju-e4d256-prod-github-runner-207 kernel: [45900.275797] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:08:46 juju-e4d256-prod-github-runner-207 kernel: [45900.276690] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 18:08:46 juju-e4d256-prod-github-runner-207 kernel: [45900.278999] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 18:08:46 juju-e4d256-prod-github-runner-207 kernel: [45900.279887] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 18:08:46 juju-e4d256-prod-github-runner-207 kernel: [45900.280925] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 18:08:46 juju-e4d256-prod-github-runner-207 kernel: [45900.281978] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 18:08:46 juju-e4d256-prod-github-runner-207 kernel: [45900.283019] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 18:08:46 juju-e4d256-prod-github-runner-207 kernel: [45900.284022] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 18:08:46 juju-e4d256-prod-github-runner-207 kernel: [45900.285001] ? _raw_spin_lock+0x22/0x30 Aug 22 18:08:46 juju-e4d256-prod-github-runner-207 kernel: [45900.285786] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:08:46 juju-e4d256-prod-github-runner-207 kernel: [45900.286673] direct_page_fault+0x206/0x310 [kvm] Aug 22 18:08:46 juju-e4d256-prod-github-runner-207 kernel: [45900.287686] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 18:08:46 juju-e4d256-prod-github-runner-207 kernel: [45900.288564] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 18:08:46 juju-e4d256-prod-github-runner-207 kernel: [45900.289456] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 18:08:46 juju-e4d256-prod-github-runner-207 kernel: [45900.290294] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 18:08:46 juju-e4d256-prod-github-runner-207 kernel: [45900.291091] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 18:08:46 juju-e4d256-prod-github-runner-207 kernel: [45900.291920] handle_exit+0x98/0x230 [kvm_amd] Aug 22 18:08:46 juju-e4d256-prod-github-runner-207 kernel: [45900.292686] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 18:08:46 juju-e4d256-prod-github-runner-207 kernel: [45900.293478] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 18:08:46 juju-e4d256-prod-github-runner-207 kernel: [45900.294305] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 18:08:46 juju-e4d256-prod-github-runner-207 kernel: [45900.295331] vcpu_run+0x62/0x2c0 [kvm] Aug 22 18:08:46 juju-e4d256-prod-github-runner-207 kernel: [45900.296277] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 18:08:46 juju-e4d256-prod-github-runner-207 kernel: [45900.297021] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 18:08:46 juju-e4d256-prod-github-runner-207 kernel: [45900.297848] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 18:08:46 juju-e4d256-prod-github-runner-207 kernel: [45900.298616] ? __seccomp_filter+0x4a/0x4a0 Aug 22 18:08:46 juju-e4d256-prod-github-runner-207 kernel: [45900.299344] ? __fget_files+0x86/0xc0 Aug 22 18:08:46 juju-e4d256-prod-github-runner-207 kernel: [45900.300050] __x64_sys_ioctl+0x95/0xd0 Aug 22 18:08:46 juju-e4d256-prod-github-runner-207 kernel: [45900.300762] do_syscall_64+0x5c/0xc0 Aug 22 18:08:46 juju-e4d256-prod-github-runner-207 kernel: [45900.301474] ? do_futex+0x162/0x1f0 Aug 22 18:08:46 juju-e4d256-prod-github-runner-207 kernel: [45900.302173] ? __x64_sys_futex+0x78/0x1e0 Aug 22 18:08:46 juju-e4d256-prod-github-runner-207 kernel: [45900.302890] ? __secure_computing+0xa9/0x120 Aug 22 18:08:46 juju-e4d256-prod-github-runner-207 kernel: [45900.303618] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 18:08:46 juju-e4d256-prod-github-runner-207 kernel: [45900.304421] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:08:46 juju-e4d256-prod-github-runner-207 kernel: [45900.305257] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:08:46 juju-e4d256-prod-github-runner-207 kernel: [45900.306108] ? do_syscall_64+0x69/0xc0 Aug 22 18:08:46 juju-e4d256-prod-github-runner-207 kernel: [45900.306810] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:08:46 juju-e4d256-prod-github-runner-207 kernel: [45900.307594] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:08:46 juju-e4d256-prod-github-runner-207 kernel: [45900.308381] ? do_syscall_64+0x69/0xc0 Aug 22 18:08:46 juju-e4d256-prod-github-runner-207 kernel: [45900.309186] ? do_syscall_64+0x69/0xc0 Aug 22 18:08:46 juju-e4d256-prod-github-runner-207 kernel: [45900.310030] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 18:08:46 juju-e4d256-prod-github-runner-207 kernel: [45900.310812] RIP: 0033:0x7faa5d0edaff Aug 22 18:08:46 juju-e4d256-prod-github-runner-207 kernel: [45900.311505] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 18:08:46 juju-e4d256-prod-github-runner-207 kernel: [45900.313671] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 18:08:46 juju-e4d256-prod-github-runner-207 kernel: [45900.314657] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 18:08:46 juju-e4d256-prod-github-runner-207 kernel: [45900.315618] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 18:08:46 juju-e4d256-prod-github-runner-207 kernel: [45900.316579] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 18:08:46 juju-e4d256-prod-github-runner-207 kernel: [45900.317558] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 18:08:46 juju-e4d256-prod-github-runner-207 kernel: [45900.318503] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 18:08:46 juju-e4d256-prod-github-runner-207 kernel: [45900.319435] Aug 22 18:09:10 juju-e4d256-prod-github-runner-207 kernel: [45924.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 42662s! [qemu-system-x86:6715] Aug 22 18:09:10 juju-e4d256-prod-github-runner-207 kernel: [45924.543133] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 18:09:10 juju-e4d256-prod-github-runner-207 kernel: [45924.543204] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 18:09:10 juju-e4d256-prod-github-runner-207 kernel: [45924.555781] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 18:09:10 juju-e4d256-prod-github-runner-207 kernel: [45924.557056] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 18:09:10 juju-e4d256-prod-github-runner-207 kernel: [45924.558334] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:09:10 juju-e4d256-prod-github-runner-207 kernel: [45924.559412] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 18:09:10 juju-e4d256-prod-github-runner-207 kernel: [45924.562013] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 18:09:10 juju-e4d256-prod-github-runner-207 kernel: [45924.563080] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 18:09:10 juju-e4d256-prod-github-runner-207 kernel: [45924.564339] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 18:09:10 juju-e4d256-prod-github-runner-207 kernel: [45924.565558] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 18:09:10 juju-e4d256-prod-github-runner-207 kernel: [45924.566742] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 18:09:10 juju-e4d256-prod-github-runner-207 kernel: [45924.567927] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 18:09:10 juju-e4d256-prod-github-runner-207 kernel: [45924.569097] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 18:09:10 juju-e4d256-prod-github-runner-207 kernel: [45924.570393] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 18:09:10 juju-e4d256-prod-github-runner-207 kernel: [45924.571512] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 18:09:10 juju-e4d256-prod-github-runner-207 kernel: [45924.572708] Call Trace: Aug 22 18:09:10 juju-e4d256-prod-github-runner-207 kernel: [45924.573670] Aug 22 18:09:10 juju-e4d256-prod-github-runner-207 kernel: [45924.574556] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:09:10 juju-e4d256-prod-github-runner-207 kernel: [45924.575633] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:09:10 juju-e4d256-prod-github-runner-207 kernel: [45924.576655] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:09:10 juju-e4d256-prod-github-runner-207 kernel: [45924.577882] ? show_regs.part.0+0x23/0x29 Aug 22 18:09:10 juju-e4d256-prod-github-runner-207 kernel: [45924.578895] ? show_regs.cold+0x8/0xd Aug 22 18:09:10 juju-e4d256-prod-github-runner-207 kernel: [45924.579866] ? watchdog_timer_fn+0x1be/0x220 Aug 22 18:09:10 juju-e4d256-prod-github-runner-207 kernel: [45924.580873] ? lockup_detector_update_enable+0x60/0x60 Aug 22 18:09:10 juju-e4d256-prod-github-runner-207 kernel: [45924.581945] ? __hrtimer_run_queues+0x107/0x230 Aug 22 18:09:10 juju-e4d256-prod-github-runner-207 kernel: [45924.582970] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 18:09:10 juju-e4d256-prod-github-runner-207 kernel: [45924.583997] ? hrtimer_interrupt+0x101/0x220 Aug 22 18:09:10 juju-e4d256-prod-github-runner-207 kernel: [45924.585010] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 18:09:10 juju-e4d256-prod-github-runner-207 kernel: [45924.586207] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 18:09:10 juju-e4d256-prod-github-runner-207 kernel: [45924.587290] Aug 22 18:09:10 juju-e4d256-prod-github-runner-207 kernel: [45924.588159] Aug 22 18:09:10 juju-e4d256-prod-github-runner-207 kernel: [45924.589003] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 18:09:10 juju-e4d256-prod-github-runner-207 kernel: [45924.590069] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:09:10 juju-e4d256-prod-github-runner-207 kernel: [45924.591108] ? _raw_spin_lock+0x22/0x30 Aug 22 18:09:10 juju-e4d256-prod-github-runner-207 kernel: [45924.592058] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:09:10 juju-e4d256-prod-github-runner-207 kernel: [45924.593078] direct_page_fault+0x206/0x310 [kvm] Aug 22 18:09:10 juju-e4d256-prod-github-runner-207 kernel: [45924.594123] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 18:09:10 juju-e4d256-prod-github-runner-207 kernel: [45924.595135] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 18:09:10 juju-e4d256-prod-github-runner-207 kernel: [45924.596133] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 18:09:10 juju-e4d256-prod-github-runner-207 kernel: [45924.597106] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 18:09:10 juju-e4d256-prod-github-runner-207 kernel: [45924.598068] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 18:09:10 juju-e4d256-prod-github-runner-207 kernel: [45924.599044] handle_exit+0x98/0x230 [kvm_amd] Aug 22 18:09:10 juju-e4d256-prod-github-runner-207 kernel: [45924.599946] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 18:09:10 juju-e4d256-prod-github-runner-207 kernel: [45924.600866] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 18:09:10 juju-e4d256-prod-github-runner-207 kernel: [45924.601816] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 18:09:10 juju-e4d256-prod-github-runner-207 kernel: [45924.602723] vcpu_run+0x62/0x2c0 [kvm] Aug 22 18:09:10 juju-e4d256-prod-github-runner-207 kernel: [45924.603532] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 18:09:10 juju-e4d256-prod-github-runner-207 kernel: [45924.604369] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 18:09:10 juju-e4d256-prod-github-runner-207 kernel: [45924.605341] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 18:09:10 juju-e4d256-prod-github-runner-207 kernel: [45924.606313] ? __seccomp_filter+0x4a/0x4a0 Aug 22 18:09:10 juju-e4d256-prod-github-runner-207 kernel: [45924.607119] ? __fget_files+0x86/0xc0 Aug 22 18:09:10 juju-e4d256-prod-github-runner-207 kernel: [45924.608075] __x64_sys_ioctl+0x95/0xd0 Aug 22 18:09:10 juju-e4d256-prod-github-runner-207 kernel: [45924.608995] do_syscall_64+0x5c/0xc0 Aug 22 18:09:10 juju-e4d256-prod-github-runner-207 kernel: [45924.609954] ? do_futex+0x162/0x1f0 Aug 22 18:09:10 juju-e4d256-prod-github-runner-207 kernel: [45924.610644] ? __x64_sys_futex+0x78/0x1e0 Aug 22 18:09:10 juju-e4d256-prod-github-runner-207 kernel: [45924.611327] ? __secure_computing+0xa9/0x120 Aug 22 18:09:10 juju-e4d256-prod-github-runner-207 kernel: [45924.612030] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 18:09:10 juju-e4d256-prod-github-runner-207 kernel: [45924.612801] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:09:10 juju-e4d256-prod-github-runner-207 kernel: [45924.613570] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:09:10 juju-e4d256-prod-github-runner-207 kernel: [45924.614572] ? do_syscall_64+0x69/0xc0 Aug 22 18:09:10 juju-e4d256-prod-github-runner-207 kernel: [45924.615497] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:09:10 juju-e4d256-prod-github-runner-207 kernel: [45924.616324] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:09:10 juju-e4d256-prod-github-runner-207 kernel: [45924.617052] ? do_syscall_64+0x69/0xc0 Aug 22 18:09:10 juju-e4d256-prod-github-runner-207 kernel: [45924.617895] ? do_syscall_64+0x69/0xc0 Aug 22 18:09:10 juju-e4d256-prod-github-runner-207 kernel: [45924.618827] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 18:09:10 juju-e4d256-prod-github-runner-207 kernel: [45924.619581] RIP: 0033:0x7faa5d0edaff Aug 22 18:09:10 juju-e4d256-prod-github-runner-207 kernel: [45924.620642] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 18:09:10 juju-e4d256-prod-github-runner-207 kernel: [45924.623694] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 18:09:10 juju-e4d256-prod-github-runner-207 kernel: [45924.624962] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 18:09:10 juju-e4d256-prod-github-runner-207 kernel: [45924.626014] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 18:09:10 juju-e4d256-prod-github-runner-207 kernel: [45924.627252] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 18:09:10 juju-e4d256-prod-github-runner-207 kernel: [45924.628199] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 18:09:10 juju-e4d256-prod-github-runner-207 kernel: [45924.629118] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 18:09:10 juju-e4d256-prod-github-runner-207 kernel: [45924.630097] Aug 22 18:09:38 juju-e4d256-prod-github-runner-207 kernel: [45952.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 42688s! [qemu-system-x86:6715] Aug 22 18:09:38 juju-e4d256-prod-github-runner-207 kernel: [45952.543985] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 18:09:38 juju-e4d256-prod-github-runner-207 kernel: [45952.544277] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 18:09:38 juju-e4d256-prod-github-runner-207 kernel: [45952.556809] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 18:09:38 juju-e4d256-prod-github-runner-207 kernel: [45952.558108] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 18:09:38 juju-e4d256-prod-github-runner-207 kernel: [45952.559337] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:09:38 juju-e4d256-prod-github-runner-207 kernel: [45952.560399] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 18:09:38 juju-e4d256-prod-github-runner-207 kernel: [45952.562970] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 18:09:38 juju-e4d256-prod-github-runner-207 kernel: [45952.564015] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 18:09:38 juju-e4d256-prod-github-runner-207 kernel: [45952.565190] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 18:09:38 juju-e4d256-prod-github-runner-207 kernel: [45952.566357] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 18:09:38 juju-e4d256-prod-github-runner-207 kernel: [45952.567520] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 18:09:38 juju-e4d256-prod-github-runner-207 kernel: [45952.568685] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 18:09:38 juju-e4d256-prod-github-runner-207 kernel: [45952.569872] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 18:09:38 juju-e4d256-prod-github-runner-207 kernel: [45952.571108] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 18:09:38 juju-e4d256-prod-github-runner-207 kernel: [45952.572209] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 18:09:38 juju-e4d256-prod-github-runner-207 kernel: [45952.573457] Call Trace: Aug 22 18:09:38 juju-e4d256-prod-github-runner-207 kernel: [45952.574377] Aug 22 18:09:38 juju-e4d256-prod-github-runner-207 kernel: [45952.575314] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:09:38 juju-e4d256-prod-github-runner-207 kernel: [45952.576358] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:09:38 juju-e4d256-prod-github-runner-207 kernel: [45952.577401] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:09:38 juju-e4d256-prod-github-runner-207 kernel: [45952.578512] ? show_regs.part.0+0x23/0x29 Aug 22 18:09:38 juju-e4d256-prod-github-runner-207 kernel: [45952.579515] ? show_regs.cold+0x8/0xd Aug 22 18:09:38 juju-e4d256-prod-github-runner-207 kernel: [45952.580497] ? watchdog_timer_fn+0x1be/0x220 Aug 22 18:09:38 juju-e4d256-prod-github-runner-207 kernel: [45952.581528] ? lockup_detector_update_enable+0x60/0x60 Aug 22 18:09:38 juju-e4d256-prod-github-runner-207 kernel: [45952.582598] ? __hrtimer_run_queues+0x107/0x230 Aug 22 18:09:38 juju-e4d256-prod-github-runner-207 kernel: [45952.583631] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 18:09:38 juju-e4d256-prod-github-runner-207 kernel: [45952.584660] ? hrtimer_interrupt+0x101/0x220 Aug 22 18:09:38 juju-e4d256-prod-github-runner-207 kernel: [45952.585705] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 18:09:38 juju-e4d256-prod-github-runner-207 kernel: [45952.586801] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 18:09:38 juju-e4d256-prod-github-runner-207 kernel: [45952.587875] Aug 22 18:09:38 juju-e4d256-prod-github-runner-207 kernel: [45952.588733] Aug 22 18:09:38 juju-e4d256-prod-github-runner-207 kernel: [45952.589594] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 18:09:38 juju-e4d256-prod-github-runner-207 kernel: [45952.590633] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:09:38 juju-e4d256-prod-github-runner-207 kernel: [45952.591688] ? _raw_spin_lock+0x22/0x30 Aug 22 18:09:38 juju-e4d256-prod-github-runner-207 kernel: [45952.592637] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:09:38 juju-e4d256-prod-github-runner-207 kernel: [45952.593681] direct_page_fault+0x206/0x310 [kvm] Aug 22 18:09:38 juju-e4d256-prod-github-runner-207 kernel: [45952.594705] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 18:09:38 juju-e4d256-prod-github-runner-207 kernel: [45952.595711] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 18:09:38 juju-e4d256-prod-github-runner-207 kernel: [45952.596718] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 18:09:38 juju-e4d256-prod-github-runner-207 kernel: [45952.597786] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 18:09:38 juju-e4d256-prod-github-runner-207 kernel: [45952.598732] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 18:09:38 juju-e4d256-prod-github-runner-207 kernel: [45952.599710] handle_exit+0x98/0x230 [kvm_amd] Aug 22 18:09:38 juju-e4d256-prod-github-runner-207 kernel: [45952.600602] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 18:09:38 juju-e4d256-prod-github-runner-207 kernel: [45952.601544] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 18:09:38 juju-e4d256-prod-github-runner-207 kernel: [45952.602478] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 18:09:38 juju-e4d256-prod-github-runner-207 kernel: [45952.603400] vcpu_run+0x62/0x2c0 [kvm] Aug 22 18:09:38 juju-e4d256-prod-github-runner-207 kernel: [45952.604254] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 18:09:38 juju-e4d256-prod-github-runner-207 kernel: [45952.605112] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 18:09:38 juju-e4d256-prod-github-runner-207 kernel: [45952.606004] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 18:09:38 juju-e4d256-prod-github-runner-207 kernel: [45952.606805] ? __seccomp_filter+0x4a/0x4a0 Aug 22 18:09:38 juju-e4d256-prod-github-runner-207 kernel: [45952.607554] ? __fget_files+0x86/0xc0 Aug 22 18:09:38 juju-e4d256-prod-github-runner-207 kernel: [45952.608278] __x64_sys_ioctl+0x95/0xd0 Aug 22 18:09:38 juju-e4d256-prod-github-runner-207 kernel: [45952.608995] do_syscall_64+0x5c/0xc0 Aug 22 18:09:38 juju-e4d256-prod-github-runner-207 kernel: [45952.609664] ? do_futex+0x162/0x1f0 Aug 22 18:09:38 juju-e4d256-prod-github-runner-207 kernel: [45952.610335] ? __x64_sys_futex+0x78/0x1e0 Aug 22 18:09:38 juju-e4d256-prod-github-runner-207 kernel: [45952.611014] ? __secure_computing+0xa9/0x120 Aug 22 18:09:38 juju-e4d256-prod-github-runner-207 kernel: [45952.611709] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 18:09:38 juju-e4d256-prod-github-runner-207 kernel: [45952.612481] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:09:38 juju-e4d256-prod-github-runner-207 kernel: [45952.613227] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:09:38 juju-e4d256-prod-github-runner-207 kernel: [45952.613950] ? do_syscall_64+0x69/0xc0 Aug 22 18:09:38 juju-e4d256-prod-github-runner-207 kernel: [45952.614598] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:09:38 juju-e4d256-prod-github-runner-207 kernel: [45952.615302] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:09:38 juju-e4d256-prod-github-runner-207 kernel: [45952.615999] ? do_syscall_64+0x69/0xc0 Aug 22 18:09:38 juju-e4d256-prod-github-runner-207 kernel: [45952.616627] ? do_syscall_64+0x69/0xc0 Aug 22 18:09:38 juju-e4d256-prod-github-runner-207 kernel: [45952.617266] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 18:09:38 juju-e4d256-prod-github-runner-207 kernel: [45952.617976] RIP: 0033:0x7faa5d0edaff Aug 22 18:09:38 juju-e4d256-prod-github-runner-207 kernel: [45952.618648] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 18:09:38 juju-e4d256-prod-github-runner-207 kernel: [45952.620649] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 18:09:38 juju-e4d256-prod-github-runner-207 kernel: [45952.621584] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 18:09:38 juju-e4d256-prod-github-runner-207 kernel: [45952.622483] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 18:09:38 juju-e4d256-prod-github-runner-207 kernel: [45952.623375] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 18:09:38 juju-e4d256-prod-github-runner-207 kernel: [45952.624265] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 18:09:38 juju-e4d256-prod-github-runner-207 kernel: [45952.625165] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 18:09:38 juju-e4d256-prod-github-runner-207 kernel: [45952.626063] Aug 22 18:10:06 juju-e4d256-prod-github-runner-207 kernel: [45980.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 42714s! [qemu-system-x86:6715] Aug 22 18:10:06 juju-e4d256-prod-github-runner-207 kernel: [45980.543111] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 18:10:06 juju-e4d256-prod-github-runner-207 kernel: [45980.543187] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 18:10:06 juju-e4d256-prod-github-runner-207 kernel: [45980.555534] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 18:10:06 juju-e4d256-prod-github-runner-207 kernel: [45980.556875] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 18:10:06 juju-e4d256-prod-github-runner-207 kernel: [45980.558131] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:10:06 juju-e4d256-prod-github-runner-207 kernel: [45980.559204] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 18:10:06 juju-e4d256-prod-github-runner-207 kernel: [45980.561794] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 18:10:06 juju-e4d256-prod-github-runner-207 kernel: [45980.562886] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 18:10:06 juju-e4d256-prod-github-runner-207 kernel: [45980.564167] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 18:10:06 juju-e4d256-prod-github-runner-207 kernel: [45980.565374] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 18:10:06 juju-e4d256-prod-github-runner-207 kernel: [45980.566709] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 18:10:06 juju-e4d256-prod-github-runner-207 kernel: [45980.568034] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 18:10:06 juju-e4d256-prod-github-runner-207 kernel: [45980.569474] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 18:10:06 juju-e4d256-prod-github-runner-207 kernel: [45980.570898] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 18:10:06 juju-e4d256-prod-github-runner-207 kernel: [45980.572233] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 18:10:06 juju-e4d256-prod-github-runner-207 kernel: [45980.573604] Call Trace: Aug 22 18:10:06 juju-e4d256-prod-github-runner-207 kernel: [45980.574569] Aug 22 18:10:06 juju-e4d256-prod-github-runner-207 kernel: [45980.575546] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:10:06 juju-e4d256-prod-github-runner-207 kernel: [45980.576756] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:10:06 juju-e4d256-prod-github-runner-207 kernel: [45980.577824] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:10:06 juju-e4d256-prod-github-runner-207 kernel: [45980.578927] ? show_regs.part.0+0x23/0x29 Aug 22 18:10:06 juju-e4d256-prod-github-runner-207 kernel: [45980.579969] ? show_regs.cold+0x8/0xd Aug 22 18:10:06 juju-e4d256-prod-github-runner-207 kernel: [45980.581052] ? watchdog_timer_fn+0x1be/0x220 Aug 22 18:10:06 juju-e4d256-prod-github-runner-207 kernel: [45980.582089] ? lockup_detector_update_enable+0x60/0x60 Aug 22 18:10:06 juju-e4d256-prod-github-runner-207 kernel: [45980.583177] ? __hrtimer_run_queues+0x107/0x230 Aug 22 18:10:06 juju-e4d256-prod-github-runner-207 kernel: [45980.584218] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 18:10:06 juju-e4d256-prod-github-runner-207 kernel: [45980.585265] ? hrtimer_interrupt+0x101/0x220 Aug 22 18:10:06 juju-e4d256-prod-github-runner-207 kernel: [45980.586291] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 18:10:06 juju-e4d256-prod-github-runner-207 kernel: [45980.587373] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 18:10:06 juju-e4d256-prod-github-runner-207 kernel: [45980.588434] Aug 22 18:10:06 juju-e4d256-prod-github-runner-207 kernel: [45980.589354] Aug 22 18:10:06 juju-e4d256-prod-github-runner-207 kernel: [45980.590347] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 18:10:06 juju-e4d256-prod-github-runner-207 kernel: [45980.591408] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:10:06 juju-e4d256-prod-github-runner-207 kernel: [45980.592506] ? _raw_spin_lock+0x22/0x30 Aug 22 18:10:06 juju-e4d256-prod-github-runner-207 kernel: [45980.593524] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:10:06 juju-e4d256-prod-github-runner-207 kernel: [45980.594558] direct_page_fault+0x206/0x310 [kvm] Aug 22 18:10:06 juju-e4d256-prod-github-runner-207 kernel: [45980.595604] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 18:10:06 juju-e4d256-prod-github-runner-207 kernel: [45980.596661] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 18:10:06 juju-e4d256-prod-github-runner-207 kernel: [45980.597687] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 18:10:06 juju-e4d256-prod-github-runner-207 kernel: [45980.598828] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 18:10:06 juju-e4d256-prod-github-runner-207 kernel: [45980.599786] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 18:10:06 juju-e4d256-prod-github-runner-207 kernel: [45980.600823] handle_exit+0x98/0x230 [kvm_amd] Aug 22 18:10:06 juju-e4d256-prod-github-runner-207 kernel: [45980.601739] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 18:10:06 juju-e4d256-prod-github-runner-207 kernel: [45980.602675] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 18:10:06 juju-e4d256-prod-github-runner-207 kernel: [45980.603628] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 18:10:06 juju-e4d256-prod-github-runner-207 kernel: [45980.604564] vcpu_run+0x62/0x2c0 [kvm] Aug 22 18:10:06 juju-e4d256-prod-github-runner-207 kernel: [45980.605533] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 18:10:06 juju-e4d256-prod-github-runner-207 kernel: [45980.606422] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 18:10:06 juju-e4d256-prod-github-runner-207 kernel: [45980.607301] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 18:10:06 juju-e4d256-prod-github-runner-207 kernel: [45980.608106] ? __seccomp_filter+0x4a/0x4a0 Aug 22 18:10:06 juju-e4d256-prod-github-runner-207 kernel: [45980.608878] ? __fget_files+0x86/0xc0 Aug 22 18:10:06 juju-e4d256-prod-github-runner-207 kernel: [45980.609596] __x64_sys_ioctl+0x95/0xd0 Aug 22 18:10:06 juju-e4d256-prod-github-runner-207 kernel: [45980.610299] do_syscall_64+0x5c/0xc0 Aug 22 18:10:06 juju-e4d256-prod-github-runner-207 kernel: [45980.610971] ? do_futex+0x162/0x1f0 Aug 22 18:10:06 juju-e4d256-prod-github-runner-207 kernel: [45980.611626] ? __x64_sys_futex+0x78/0x1e0 Aug 22 18:10:06 juju-e4d256-prod-github-runner-207 kernel: [45980.612303] ? __secure_computing+0xa9/0x120 Aug 22 18:10:06 juju-e4d256-prod-github-runner-207 kernel: [45980.613018] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 18:10:06 juju-e4d256-prod-github-runner-207 kernel: [45980.613804] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:10:06 juju-e4d256-prod-github-runner-207 kernel: [45980.614542] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:10:06 juju-e4d256-prod-github-runner-207 kernel: [45980.615264] ? do_syscall_64+0x69/0xc0 Aug 22 18:10:06 juju-e4d256-prod-github-runner-207 kernel: [45980.615960] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:10:06 juju-e4d256-prod-github-runner-207 kernel: [45980.616689] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:10:06 juju-e4d256-prod-github-runner-207 kernel: [45980.617397] ? do_syscall_64+0x69/0xc0 Aug 22 18:10:06 juju-e4d256-prod-github-runner-207 kernel: [45980.618028] ? do_syscall_64+0x69/0xc0 Aug 22 18:10:06 juju-e4d256-prod-github-runner-207 kernel: [45980.618655] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 18:10:06 juju-e4d256-prod-github-runner-207 kernel: [45980.619404] RIP: 0033:0x7faa5d0edaff Aug 22 18:10:06 juju-e4d256-prod-github-runner-207 kernel: [45980.620033] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 18:10:06 juju-e4d256-prod-github-runner-207 kernel: [45980.622034] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 18:10:06 juju-e4d256-prod-github-runner-207 kernel: [45980.622946] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 18:10:06 juju-e4d256-prod-github-runner-207 kernel: [45980.623839] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 18:10:06 juju-e4d256-prod-github-runner-207 kernel: [45980.624778] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 18:10:06 juju-e4d256-prod-github-runner-207 kernel: [45980.625702] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 18:10:06 juju-e4d256-prod-github-runner-207 kernel: [45980.626765] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 18:10:06 juju-e4d256-prod-github-runner-207 kernel: [45980.627794] Aug 22 18:10:34 juju-e4d256-prod-github-runner-207 kernel: [46008.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 42740s! [qemu-system-x86:6715] Aug 22 18:10:34 juju-e4d256-prod-github-runner-207 kernel: [46008.543115] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 18:10:34 juju-e4d256-prod-github-runner-207 kernel: [46008.543189] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 18:10:34 juju-e4d256-prod-github-runner-207 kernel: [46008.555766] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 18:10:34 juju-e4d256-prod-github-runner-207 kernel: [46008.557084] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 18:10:34 juju-e4d256-prod-github-runner-207 kernel: [46008.558355] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:10:34 juju-e4d256-prod-github-runner-207 kernel: [46008.559441] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 18:10:34 juju-e4d256-prod-github-runner-207 kernel: [46008.562098] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 18:10:34 juju-e4d256-prod-github-runner-207 kernel: [46008.563157] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 18:10:34 juju-e4d256-prod-github-runner-207 kernel: [46008.564339] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 18:10:34 juju-e4d256-prod-github-runner-207 kernel: [46008.565706] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 18:10:34 juju-e4d256-prod-github-runner-207 kernel: [46008.566874] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 18:10:34 juju-e4d256-prod-github-runner-207 kernel: [46008.568066] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 18:10:34 juju-e4d256-prod-github-runner-207 kernel: [46008.569284] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 18:10:34 juju-e4d256-prod-github-runner-207 kernel: [46008.570670] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 18:10:34 juju-e4d256-prod-github-runner-207 kernel: [46008.571859] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 18:10:34 juju-e4d256-prod-github-runner-207 kernel: [46008.573586] Call Trace: Aug 22 18:10:34 juju-e4d256-prod-github-runner-207 kernel: [46008.574531] Aug 22 18:10:34 juju-e4d256-prod-github-runner-207 kernel: [46008.575502] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:10:34 juju-e4d256-prod-github-runner-207 kernel: [46008.576662] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:10:34 juju-e4d256-prod-github-runner-207 kernel: [46008.577764] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:10:34 juju-e4d256-prod-github-runner-207 kernel: [46008.578850] ? show_regs.part.0+0x23/0x29 Aug 22 18:10:34 juju-e4d256-prod-github-runner-207 kernel: [46008.579948] ? show_regs.cold+0x8/0xd Aug 22 18:10:34 juju-e4d256-prod-github-runner-207 kernel: [46008.580969] ? watchdog_timer_fn+0x1be/0x220 Aug 22 18:10:34 juju-e4d256-prod-github-runner-207 kernel: [46008.582104] ? lockup_detector_update_enable+0x60/0x60 Aug 22 18:10:34 juju-e4d256-prod-github-runner-207 kernel: [46008.583281] ? __hrtimer_run_queues+0x107/0x230 Aug 22 18:10:34 juju-e4d256-prod-github-runner-207 kernel: [46008.584573] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 18:10:34 juju-e4d256-prod-github-runner-207 kernel: [46008.586031] ? hrtimer_interrupt+0x101/0x220 Aug 22 18:10:34 juju-e4d256-prod-github-runner-207 kernel: [46008.587591] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 18:10:34 juju-e4d256-prod-github-runner-207 kernel: [46008.588997] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 18:10:34 juju-e4d256-prod-github-runner-207 kernel: [46008.590081] Aug 22 18:10:34 juju-e4d256-prod-github-runner-207 kernel: [46008.590946] Aug 22 18:10:34 juju-e4d256-prod-github-runner-207 kernel: [46008.591793] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 18:10:34 juju-e4d256-prod-github-runner-207 kernel: [46008.592923] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:10:34 juju-e4d256-prod-github-runner-207 kernel: [46008.593975] ? _raw_spin_lock+0x22/0x30 Aug 22 18:10:34 juju-e4d256-prod-github-runner-207 kernel: [46008.594927] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:10:34 juju-e4d256-prod-github-runner-207 kernel: [46008.596016] direct_page_fault+0x206/0x310 [kvm] Aug 22 18:10:34 juju-e4d256-prod-github-runner-207 kernel: [46008.597108] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 18:10:34 juju-e4d256-prod-github-runner-207 kernel: [46008.598152] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 18:10:34 juju-e4d256-prod-github-runner-207 kernel: [46008.599164] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 18:10:34 juju-e4d256-prod-github-runner-207 kernel: [46008.600172] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 18:10:34 juju-e4d256-prod-github-runner-207 kernel: [46008.601142] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 18:10:34 juju-e4d256-prod-github-runner-207 kernel: [46008.602156] handle_exit+0x98/0x230 [kvm_amd] Aug 22 18:10:34 juju-e4d256-prod-github-runner-207 kernel: [46008.603089] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 18:10:34 juju-e4d256-prod-github-runner-207 kernel: [46008.604036] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 18:10:34 juju-e4d256-prod-github-runner-207 kernel: [46008.605022] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 18:10:34 juju-e4d256-prod-github-runner-207 kernel: [46008.605950] vcpu_run+0x62/0x2c0 [kvm] Aug 22 18:10:34 juju-e4d256-prod-github-runner-207 kernel: [46008.606773] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 18:10:34 juju-e4d256-prod-github-runner-207 kernel: [46008.607624] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 18:10:34 juju-e4d256-prod-github-runner-207 kernel: [46008.608538] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 18:10:34 juju-e4d256-prod-github-runner-207 kernel: [46008.609368] ? __seccomp_filter+0x4a/0x4a0 Aug 22 18:10:34 juju-e4d256-prod-github-runner-207 kernel: [46008.610138] ? __fget_files+0x86/0xc0 Aug 22 18:10:34 juju-e4d256-prod-github-runner-207 kernel: [46008.610846] __x64_sys_ioctl+0x95/0xd0 Aug 22 18:10:34 juju-e4d256-prod-github-runner-207 kernel: [46008.611548] do_syscall_64+0x5c/0xc0 Aug 22 18:10:34 juju-e4d256-prod-github-runner-207 kernel: [46008.612238] ? do_futex+0x162/0x1f0 Aug 22 18:10:34 juju-e4d256-prod-github-runner-207 kernel: [46008.612893] ? __x64_sys_futex+0x78/0x1e0 Aug 22 18:10:34 juju-e4d256-prod-github-runner-207 kernel: [46008.613594] ? __secure_computing+0xa9/0x120 Aug 22 18:10:34 juju-e4d256-prod-github-runner-207 kernel: [46008.614289] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 18:10:34 juju-e4d256-prod-github-runner-207 kernel: [46008.615057] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:10:34 juju-e4d256-prod-github-runner-207 kernel: [46008.615788] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:10:34 juju-e4d256-prod-github-runner-207 kernel: [46008.616525] ? do_syscall_64+0x69/0xc0 Aug 22 18:10:34 juju-e4d256-prod-github-runner-207 kernel: [46008.617175] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:10:34 juju-e4d256-prod-github-runner-207 kernel: [46008.617882] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:10:34 juju-e4d256-prod-github-runner-207 kernel: [46008.618589] ? do_syscall_64+0x69/0xc0 Aug 22 18:10:34 juju-e4d256-prod-github-runner-207 kernel: [46008.619218] ? do_syscall_64+0x69/0xc0 Aug 22 18:10:34 juju-e4d256-prod-github-runner-207 kernel: [46008.619843] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 18:10:34 juju-e4d256-prod-github-runner-207 kernel: [46008.620579] RIP: 0033:0x7faa5d0edaff Aug 22 18:10:34 juju-e4d256-prod-github-runner-207 kernel: [46008.621208] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 18:10:34 juju-e4d256-prod-github-runner-207 kernel: [46008.623215] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 18:10:34 juju-e4d256-prod-github-runner-207 kernel: [46008.624162] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 18:10:34 juju-e4d256-prod-github-runner-207 kernel: [46008.625098] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 18:10:34 juju-e4d256-prod-github-runner-207 kernel: [46008.626013] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 18:10:34 juju-e4d256-prod-github-runner-207 kernel: [46008.626909] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 18:10:34 juju-e4d256-prod-github-runner-207 kernel: [46008.627801] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 18:10:34 juju-e4d256-prod-github-runner-207 kernel: [46008.628724] Aug 22 18:11:02 juju-e4d256-prod-github-runner-207 kernel: [46036.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 42766s! [qemu-system-x86:6715] Aug 22 18:11:02 juju-e4d256-prod-github-runner-207 kernel: [46036.543904] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 18:11:02 juju-e4d256-prod-github-runner-207 kernel: [46036.544188] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 18:11:02 juju-e4d256-prod-github-runner-207 kernel: [46036.556296] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 18:11:02 juju-e4d256-prod-github-runner-207 kernel: [46036.557559] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 18:11:02 juju-e4d256-prod-github-runner-207 kernel: [46036.558783] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:11:02 juju-e4d256-prod-github-runner-207 kernel: [46036.559852] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 18:11:02 juju-e4d256-prod-github-runner-207 kernel: [46036.562419] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 18:11:02 juju-e4d256-prod-github-runner-207 kernel: [46036.563471] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 18:11:02 juju-e4d256-prod-github-runner-207 kernel: [46036.564653] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 18:11:02 juju-e4d256-prod-github-runner-207 kernel: [46036.565819] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 18:11:02 juju-e4d256-prod-github-runner-207 kernel: [46036.566992] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 18:11:02 juju-e4d256-prod-github-runner-207 kernel: [46036.568220] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 18:11:02 juju-e4d256-prod-github-runner-207 kernel: [46036.569394] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 18:11:02 juju-e4d256-prod-github-runner-207 kernel: [46036.570630] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 18:11:02 juju-e4d256-prod-github-runner-207 kernel: [46036.571737] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 18:11:02 juju-e4d256-prod-github-runner-207 kernel: [46036.572955] Call Trace: Aug 22 18:11:02 juju-e4d256-prod-github-runner-207 kernel: [46036.573869] Aug 22 18:11:02 juju-e4d256-prod-github-runner-207 kernel: [46036.574763] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:11:02 juju-e4d256-prod-github-runner-207 kernel: [46036.575805] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:11:02 juju-e4d256-prod-github-runner-207 kernel: [46036.576833] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:11:02 juju-e4d256-prod-github-runner-207 kernel: [46036.577939] ? show_regs.part.0+0x23/0x29 Aug 22 18:11:02 juju-e4d256-prod-github-runner-207 kernel: [46036.579061] ? show_regs.cold+0x8/0xd Aug 22 18:11:02 juju-e4d256-prod-github-runner-207 kernel: [46036.580071] ? watchdog_timer_fn+0x1be/0x220 Aug 22 18:11:02 juju-e4d256-prod-github-runner-207 kernel: [46036.581084] ? lockup_detector_update_enable+0x60/0x60 Aug 22 18:11:02 juju-e4d256-prod-github-runner-207 kernel: [46036.582158] ? __hrtimer_run_queues+0x107/0x230 Aug 22 18:11:02 juju-e4d256-prod-github-runner-207 kernel: [46036.583195] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 18:11:02 juju-e4d256-prod-github-runner-207 kernel: [46036.584333] ? hrtimer_interrupt+0x101/0x220 Aug 22 18:11:02 juju-e4d256-prod-github-runner-207 kernel: [46036.585444] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 18:11:02 juju-e4d256-prod-github-runner-207 kernel: [46036.586616] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 18:11:02 juju-e4d256-prod-github-runner-207 kernel: [46036.587781] Aug 22 18:11:02 juju-e4d256-prod-github-runner-207 kernel: [46036.588679] Aug 22 18:11:02 juju-e4d256-prod-github-runner-207 kernel: [46036.589560] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 18:11:02 juju-e4d256-prod-github-runner-207 kernel: [46036.590693] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:11:02 juju-e4d256-prod-github-runner-207 kernel: [46036.591852] ? _raw_spin_lock+0x22/0x30 Aug 22 18:11:02 juju-e4d256-prod-github-runner-207 kernel: [46036.592873] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:11:02 juju-e4d256-prod-github-runner-207 kernel: [46036.593975] direct_page_fault+0x206/0x310 [kvm] Aug 22 18:11:02 juju-e4d256-prod-github-runner-207 kernel: [46036.595114] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 18:11:02 juju-e4d256-prod-github-runner-207 kernel: [46036.596226] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 18:11:02 juju-e4d256-prod-github-runner-207 kernel: [46036.597328] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 18:11:02 juju-e4d256-prod-github-runner-207 kernel: [46036.598423] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 18:11:02 juju-e4d256-prod-github-runner-207 kernel: [46036.599459] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 18:11:02 juju-e4d256-prod-github-runner-207 kernel: [46036.600560] handle_exit+0x98/0x230 [kvm_amd] Aug 22 18:11:02 juju-e4d256-prod-github-runner-207 kernel: [46036.601541] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 18:11:02 juju-e4d256-prod-github-runner-207 kernel: [46036.602542] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 18:11:02 juju-e4d256-prod-github-runner-207 kernel: [46036.603573] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 18:11:02 juju-e4d256-prod-github-runner-207 kernel: [46036.604592] vcpu_run+0x62/0x2c0 [kvm] Aug 22 18:11:02 juju-e4d256-prod-github-runner-207 kernel: [46036.605494] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 18:11:02 juju-e4d256-prod-github-runner-207 kernel: [46036.606386] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 18:11:02 juju-e4d256-prod-github-runner-207 kernel: [46036.607337] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 18:11:02 juju-e4d256-prod-github-runner-207 kernel: [46036.608255] ? __seccomp_filter+0x4a/0x4a0 Aug 22 18:11:02 juju-e4d256-prod-github-runner-207 kernel: [46036.609081] ? __fget_files+0x86/0xc0 Aug 22 18:11:02 juju-e4d256-prod-github-runner-207 kernel: [46036.609853] __x64_sys_ioctl+0x95/0xd0 Aug 22 18:11:02 juju-e4d256-prod-github-runner-207 kernel: [46036.610621] do_syscall_64+0x5c/0xc0 Aug 22 18:11:02 juju-e4d256-prod-github-runner-207 kernel: [46036.611355] ? do_futex+0x162/0x1f0 Aug 22 18:11:02 juju-e4d256-prod-github-runner-207 kernel: [46036.612087] ? __x64_sys_futex+0x78/0x1e0 Aug 22 18:11:02 juju-e4d256-prod-github-runner-207 kernel: [46036.612838] ? __secure_computing+0xa9/0x120 Aug 22 18:11:02 juju-e4d256-prod-github-runner-207 kernel: [46036.613615] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 18:11:02 juju-e4d256-prod-github-runner-207 kernel: [46036.614475] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:11:02 juju-e4d256-prod-github-runner-207 kernel: [46036.615286] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:11:02 juju-e4d256-prod-github-runner-207 kernel: [46036.616124] ? do_syscall_64+0x69/0xc0 Aug 22 18:11:02 juju-e4d256-prod-github-runner-207 kernel: [46036.616842] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:11:02 juju-e4d256-prod-github-runner-207 kernel: [46036.617639] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:11:02 juju-e4d256-prod-github-runner-207 kernel: [46036.618425] ? do_syscall_64+0x69/0xc0 Aug 22 18:11:02 juju-e4d256-prod-github-runner-207 kernel: [46036.619126] ? do_syscall_64+0x69/0xc0 Aug 22 18:11:02 juju-e4d256-prod-github-runner-207 kernel: [46036.620019] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 18:11:02 juju-e4d256-prod-github-runner-207 kernel: [46036.620836] RIP: 0033:0x7faa5d0edaff Aug 22 18:11:02 juju-e4d256-prod-github-runner-207 kernel: [46036.621760] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 18:11:02 juju-e4d256-prod-github-runner-207 kernel: [46036.624096] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 18:11:02 juju-e4d256-prod-github-runner-207 kernel: [46036.625152] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 18:11:02 juju-e4d256-prod-github-runner-207 kernel: [46036.626173] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 18:11:02 juju-e4d256-prod-github-runner-207 kernel: [46036.627195] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 18:11:02 juju-e4d256-prod-github-runner-207 kernel: [46036.628271] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 18:11:02 juju-e4d256-prod-github-runner-207 kernel: [46036.629295] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 18:11:02 juju-e4d256-prod-github-runner-207 kernel: [46036.630329] Aug 22 18:11:30 juju-e4d256-prod-github-runner-207 kernel: [46064.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 42792s! [qemu-system-x86:6715] Aug 22 18:11:30 juju-e4d256-prod-github-runner-207 kernel: [46064.543104] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 18:11:30 juju-e4d256-prod-github-runner-207 kernel: [46064.543176] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 18:11:30 juju-e4d256-prod-github-runner-207 kernel: [46064.555416] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 18:11:30 juju-e4d256-prod-github-runner-207 kernel: [46064.556707] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 18:11:30 juju-e4d256-prod-github-runner-207 kernel: [46064.558008] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:11:30 juju-e4d256-prod-github-runner-207 kernel: [46064.559083] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 18:11:30 juju-e4d256-prod-github-runner-207 kernel: [46064.561729] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 18:11:30 juju-e4d256-prod-github-runner-207 kernel: [46064.562802] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 18:11:30 juju-e4d256-prod-github-runner-207 kernel: [46064.563999] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 18:11:30 juju-e4d256-prod-github-runner-207 kernel: [46064.565171] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 18:11:30 juju-e4d256-prod-github-runner-207 kernel: [46064.566358] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 18:11:30 juju-e4d256-prod-github-runner-207 kernel: [46064.567607] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 18:11:30 juju-e4d256-prod-github-runner-207 kernel: [46064.568796] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 18:11:30 juju-e4d256-prod-github-runner-207 kernel: [46064.570057] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 18:11:30 juju-e4d256-prod-github-runner-207 kernel: [46064.571160] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 18:11:30 juju-e4d256-prod-github-runner-207 kernel: [46064.572369] Call Trace: Aug 22 18:11:30 juju-e4d256-prod-github-runner-207 kernel: [46064.573281] Aug 22 18:11:30 juju-e4d256-prod-github-runner-207 kernel: [46064.574169] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:11:30 juju-e4d256-prod-github-runner-207 kernel: [46064.575204] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:11:30 juju-e4d256-prod-github-runner-207 kernel: [46064.576247] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:11:30 juju-e4d256-prod-github-runner-207 kernel: [46064.577323] ? show_regs.part.0+0x23/0x29 Aug 22 18:11:30 juju-e4d256-prod-github-runner-207 kernel: [46064.578368] ? show_regs.cold+0x8/0xd Aug 22 18:11:30 juju-e4d256-prod-github-runner-207 kernel: [46064.579370] ? watchdog_timer_fn+0x1be/0x220 Aug 22 18:11:30 juju-e4d256-prod-github-runner-207 kernel: [46064.580405] ? lockup_detector_update_enable+0x60/0x60 Aug 22 18:11:30 juju-e4d256-prod-github-runner-207 kernel: [46064.581501] ? __hrtimer_run_queues+0x107/0x230 Aug 22 18:11:30 juju-e4d256-prod-github-runner-207 kernel: [46064.582554] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 18:11:30 juju-e4d256-prod-github-runner-207 kernel: [46064.583629] ? hrtimer_interrupt+0x101/0x220 Aug 22 18:11:30 juju-e4d256-prod-github-runner-207 kernel: [46064.584662] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 18:11:30 juju-e4d256-prod-github-runner-207 kernel: [46064.585773] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 18:11:30 juju-e4d256-prod-github-runner-207 kernel: [46064.586852] Aug 22 18:11:30 juju-e4d256-prod-github-runner-207 kernel: [46064.587771] Aug 22 18:11:30 juju-e4d256-prod-github-runner-207 kernel: [46064.588633] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 18:11:30 juju-e4d256-prod-github-runner-207 kernel: [46064.589711] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:11:30 juju-e4d256-prod-github-runner-207 kernel: [46064.590806] ? _raw_spin_lock+0x22/0x30 Aug 22 18:11:30 juju-e4d256-prod-github-runner-207 kernel: [46064.591779] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:11:30 juju-e4d256-prod-github-runner-207 kernel: [46064.592802] direct_page_fault+0x206/0x310 [kvm] Aug 22 18:11:30 juju-e4d256-prod-github-runner-207 kernel: [46064.593827] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 18:11:30 juju-e4d256-prod-github-runner-207 kernel: [46064.594840] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 18:11:30 juju-e4d256-prod-github-runner-207 kernel: [46064.595853] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 18:11:30 juju-e4d256-prod-github-runner-207 kernel: [46064.596824] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 18:11:30 juju-e4d256-prod-github-runner-207 kernel: [46064.597834] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 18:11:30 juju-e4d256-prod-github-runner-207 kernel: [46064.598838] handle_exit+0x98/0x230 [kvm_amd] Aug 22 18:11:30 juju-e4d256-prod-github-runner-207 kernel: [46064.599768] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 18:11:30 juju-e4d256-prod-github-runner-207 kernel: [46064.600702] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 18:11:30 juju-e4d256-prod-github-runner-207 kernel: [46064.601675] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 18:11:30 juju-e4d256-prod-github-runner-207 kernel: [46064.602596] vcpu_run+0x62/0x2c0 [kvm] Aug 22 18:11:30 juju-e4d256-prod-github-runner-207 kernel: [46064.603436] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 18:11:30 juju-e4d256-prod-github-runner-207 kernel: [46064.604252] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 18:11:30 juju-e4d256-prod-github-runner-207 kernel: [46064.605111] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 18:11:30 juju-e4d256-prod-github-runner-207 kernel: [46064.605916] ? __seccomp_filter+0x4a/0x4a0 Aug 22 18:11:30 juju-e4d256-prod-github-runner-207 kernel: [46064.606685] ? __fget_files+0x86/0xc0 Aug 22 18:11:30 juju-e4d256-prod-github-runner-207 kernel: [46064.607409] __x64_sys_ioctl+0x95/0xd0 Aug 22 18:11:30 juju-e4d256-prod-github-runner-207 kernel: [46064.608127] do_syscall_64+0x5c/0xc0 Aug 22 18:11:30 juju-e4d256-prod-github-runner-207 kernel: [46064.608794] ? do_futex+0x162/0x1f0 Aug 22 18:11:30 juju-e4d256-prod-github-runner-207 kernel: [46064.609444] ? __x64_sys_futex+0x78/0x1e0 Aug 22 18:11:30 juju-e4d256-prod-github-runner-207 kernel: [46064.610119] ? __secure_computing+0xa9/0x120 Aug 22 18:11:30 juju-e4d256-prod-github-runner-207 kernel: [46064.610810] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 18:11:30 juju-e4d256-prod-github-runner-207 kernel: [46064.611586] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:11:30 juju-e4d256-prod-github-runner-207 kernel: [46064.612315] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:11:30 juju-e4d256-prod-github-runner-207 kernel: [46064.613036] ? do_syscall_64+0x69/0xc0 Aug 22 18:11:30 juju-e4d256-prod-github-runner-207 kernel: [46064.613683] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:11:30 juju-e4d256-prod-github-runner-207 kernel: [46064.614387] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:11:30 juju-e4d256-prod-github-runner-207 kernel: [46064.615084] ? do_syscall_64+0x69/0xc0 Aug 22 18:11:30 juju-e4d256-prod-github-runner-207 kernel: [46064.615807] ? do_syscall_64+0x69/0xc0 Aug 22 18:11:30 juju-e4d256-prod-github-runner-207 kernel: [46064.616457] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 18:11:30 juju-e4d256-prod-github-runner-207 kernel: [46064.617169] RIP: 0033:0x7faa5d0edaff Aug 22 18:11:30 juju-e4d256-prod-github-runner-207 kernel: [46064.617798] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 18:11:30 juju-e4d256-prod-github-runner-207 kernel: [46064.619824] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 18:11:30 juju-e4d256-prod-github-runner-207 kernel: [46064.620743] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 18:11:30 juju-e4d256-prod-github-runner-207 kernel: [46064.621644] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 18:11:30 juju-e4d256-prod-github-runner-207 kernel: [46064.622540] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 18:11:30 juju-e4d256-prod-github-runner-207 kernel: [46064.623455] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 18:11:30 juju-e4d256-prod-github-runner-207 kernel: [46064.624350] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 18:11:30 juju-e4d256-prod-github-runner-207 kernel: [46064.625252] Aug 22 18:11:46 juju-e4d256-prod-github-runner-207 kernel: [46080.260706] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 18:11:46 juju-e4d256-prod-github-runner-207 kernel: [46080.261680] rcu: 1-....: (11454736 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=5543856 Aug 22 18:11:46 juju-e4d256-prod-github-runner-207 kernel: [46080.262799] (t=11490765 jiffies g=23269 q=45006) Aug 22 18:11:46 juju-e4d256-prod-github-runner-207 kernel: [46080.263593] NMI backtrace for cpu 1 Aug 22 18:11:46 juju-e4d256-prod-github-runner-207 kernel: [46080.264307] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 18:11:46 juju-e4d256-prod-github-runner-207 kernel: [46080.265434] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 18:11:46 juju-e4d256-prod-github-runner-207 kernel: [46080.266504] Call Trace: Aug 22 18:11:46 juju-e4d256-prod-github-runner-207 kernel: [46080.267198] Aug 22 18:11:46 juju-e4d256-prod-github-runner-207 kernel: [46080.267842] show_stack+0x52/0x5c Aug 22 18:11:46 juju-e4d256-prod-github-runner-207 kernel: [46080.268564] dump_stack_lvl+0x4a/0x63 Aug 22 18:11:46 juju-e4d256-prod-github-runner-207 kernel: [46080.269317] dump_stack+0x10/0x16 Aug 22 18:11:46 juju-e4d256-prod-github-runner-207 kernel: [46080.270037] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 18:11:46 juju-e4d256-prod-github-runner-207 kernel: [46080.270824] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 18:11:46 juju-e4d256-prod-github-runner-207 kernel: [46080.271611] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 18:11:46 juju-e4d256-prod-github-runner-207 kernel: [46080.272585] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 18:11:46 juju-e4d256-prod-github-runner-207 kernel: [46080.273411] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 18:11:46 juju-e4d256-prod-github-runner-207 kernel: [46080.274221] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 18:11:46 juju-e4d256-prod-github-runner-207 kernel: [46080.275050] print_cpu_stall.cold+0x2f/0xe2 Aug 22 18:11:46 juju-e4d256-prod-github-runner-207 kernel: [46080.276014] ? timekeeping_update+0xf7/0x150 Aug 22 18:11:46 juju-e4d256-prod-github-runner-207 kernel: [46080.277144] check_cpu_stall+0x109/0x270 Aug 22 18:11:46 juju-e4d256-prod-github-runner-207 kernel: [46080.278102] rcu_sched_clock_irq+0x9a/0x250 Aug 22 18:11:46 juju-e4d256-prod-github-runner-207 kernel: [46080.279063] update_process_times+0x94/0xd0 Aug 22 18:11:46 juju-e4d256-prod-github-runner-207 kernel: [46080.280070] tick_sched_handle+0x29/0x70 Aug 22 18:11:46 juju-e4d256-prod-github-runner-207 kernel: [46080.281073] tick_sched_timer+0x8c/0xc0 Aug 22 18:11:46 juju-e4d256-prod-github-runner-207 kernel: [46080.281873] ? tick_nohz_handler+0xb0/0xb0 Aug 22 18:11:46 juju-e4d256-prod-github-runner-207 kernel: [46080.282627] __hrtimer_run_queues+0x107/0x230 Aug 22 18:11:46 juju-e4d256-prod-github-runner-207 kernel: [46080.283448] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 18:11:46 juju-e4d256-prod-github-runner-207 kernel: [46080.284231] hrtimer_interrupt+0x101/0x220 Aug 22 18:11:46 juju-e4d256-prod-github-runner-207 kernel: [46080.284998] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 18:11:46 juju-e4d256-prod-github-runner-207 kernel: [46080.285815] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 18:11:46 juju-e4d256-prod-github-runner-207 kernel: [46080.286620] Aug 22 18:11:46 juju-e4d256-prod-github-runner-207 kernel: [46080.287273] Aug 22 18:11:46 juju-e4d256-prod-github-runner-207 kernel: [46080.287904] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 18:11:46 juju-e4d256-prod-github-runner-207 kernel: [46080.288724] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:11:46 juju-e4d256-prod-github-runner-207 kernel: [46080.289605] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 18:11:46 juju-e4d256-prod-github-runner-207 kernel: [46080.291840] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 18:11:46 juju-e4d256-prod-github-runner-207 kernel: [46080.292724] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 18:11:46 juju-e4d256-prod-github-runner-207 kernel: [46080.293734] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 18:11:46 juju-e4d256-prod-github-runner-207 kernel: [46080.294715] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 18:11:46 juju-e4d256-prod-github-runner-207 kernel: [46080.295693] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 18:11:46 juju-e4d256-prod-github-runner-207 kernel: [46080.296660] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 18:11:46 juju-e4d256-prod-github-runner-207 kernel: [46080.297618] ? _raw_spin_lock+0x22/0x30 Aug 22 18:11:46 juju-e4d256-prod-github-runner-207 kernel: [46080.298375] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:11:46 juju-e4d256-prod-github-runner-207 kernel: [46080.299228] direct_page_fault+0x206/0x310 [kvm] Aug 22 18:11:46 juju-e4d256-prod-github-runner-207 kernel: [46080.300069] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 18:11:46 juju-e4d256-prod-github-runner-207 kernel: [46080.300902] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 18:11:46 juju-e4d256-prod-github-runner-207 kernel: [46080.301730] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 18:11:46 juju-e4d256-prod-github-runner-207 kernel: [46080.302543] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 18:11:46 juju-e4d256-prod-github-runner-207 kernel: [46080.303347] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 18:11:46 juju-e4d256-prod-github-runner-207 kernel: [46080.304179] handle_exit+0x98/0x230 [kvm_amd] Aug 22 18:11:46 juju-e4d256-prod-github-runner-207 kernel: [46080.304949] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 18:11:46 juju-e4d256-prod-github-runner-207 kernel: [46080.305920] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 18:11:46 juju-e4d256-prod-github-runner-207 kernel: [46080.306719] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 18:11:46 juju-e4d256-prod-github-runner-207 kernel: [46080.307525] vcpu_run+0x62/0x2c0 [kvm] Aug 22 18:11:46 juju-e4d256-prod-github-runner-207 kernel: [46080.308245] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 18:11:46 juju-e4d256-prod-github-runner-207 kernel: [46080.309153] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 18:11:46 juju-e4d256-prod-github-runner-207 kernel: [46080.309951] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 18:11:46 juju-e4d256-prod-github-runner-207 kernel: [46080.310710] ? __seccomp_filter+0x4a/0x4a0 Aug 22 18:11:46 juju-e4d256-prod-github-runner-207 kernel: [46080.311446] ? __fget_files+0x86/0xc0 Aug 22 18:11:46 juju-e4d256-prod-github-runner-207 kernel: [46080.312140] __x64_sys_ioctl+0x95/0xd0 Aug 22 18:11:46 juju-e4d256-prod-github-runner-207 kernel: [46080.312835] do_syscall_64+0x5c/0xc0 Aug 22 18:11:46 juju-e4d256-prod-github-runner-207 kernel: [46080.313515] ? do_futex+0x162/0x1f0 Aug 22 18:11:46 juju-e4d256-prod-github-runner-207 kernel: [46080.314188] ? __x64_sys_futex+0x78/0x1e0 Aug 22 18:11:46 juju-e4d256-prod-github-runner-207 kernel: [46080.314887] ? __secure_computing+0xa9/0x120 Aug 22 18:11:46 juju-e4d256-prod-github-runner-207 kernel: [46080.315628] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 18:11:46 juju-e4d256-prod-github-runner-207 kernel: [46080.316417] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:11:46 juju-e4d256-prod-github-runner-207 kernel: [46080.317300] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:11:46 juju-e4d256-prod-github-runner-207 kernel: [46080.318158] ? do_syscall_64+0x69/0xc0 Aug 22 18:11:46 juju-e4d256-prod-github-runner-207 kernel: [46080.318926] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:11:46 juju-e4d256-prod-github-runner-207 kernel: [46080.319806] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:11:46 juju-e4d256-prod-github-runner-207 kernel: [46080.320664] ? do_syscall_64+0x69/0xc0 Aug 22 18:11:46 juju-e4d256-prod-github-runner-207 kernel: [46080.321446] ? do_syscall_64+0x69/0xc0 Aug 22 18:11:46 juju-e4d256-prod-github-runner-207 kernel: [46080.322213] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 18:11:46 juju-e4d256-prod-github-runner-207 kernel: [46080.323081] RIP: 0033:0x7faa5d0edaff Aug 22 18:11:46 juju-e4d256-prod-github-runner-207 kernel: [46080.323856] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 18:11:46 juju-e4d256-prod-github-runner-207 kernel: [46080.326330] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 18:11:46 juju-e4d256-prod-github-runner-207 kernel: [46080.327456] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 18:11:46 juju-e4d256-prod-github-runner-207 kernel: [46080.328543] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 18:11:46 juju-e4d256-prod-github-runner-207 kernel: [46080.329623] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 18:11:46 juju-e4d256-prod-github-runner-207 kernel: [46080.330709] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 18:11:46 juju-e4d256-prod-github-runner-207 kernel: [46080.331782] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 18:11:46 juju-e4d256-prod-github-runner-207 kernel: [46080.332837] Aug 22 18:12:10 juju-e4d256-prod-github-runner-207 kernel: [46104.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 42830s! [qemu-system-x86:6715] Aug 22 18:12:10 juju-e4d256-prod-github-runner-207 kernel: [46104.543193] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 18:12:10 juju-e4d256-prod-github-runner-207 kernel: [46104.543270] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 18:12:10 juju-e4d256-prod-github-runner-207 kernel: [46104.555862] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 18:12:10 juju-e4d256-prod-github-runner-207 kernel: [46104.557161] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 18:12:10 juju-e4d256-prod-github-runner-207 kernel: [46104.558406] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:12:10 juju-e4d256-prod-github-runner-207 kernel: [46104.559493] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 18:12:10 juju-e4d256-prod-github-runner-207 kernel: [46104.562220] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 18:12:10 juju-e4d256-prod-github-runner-207 kernel: [46104.563321] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 18:12:10 juju-e4d256-prod-github-runner-207 kernel: [46104.564531] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 18:12:10 juju-e4d256-prod-github-runner-207 kernel: [46104.565715] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 18:12:10 juju-e4d256-prod-github-runner-207 kernel: [46104.566923] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 18:12:10 juju-e4d256-prod-github-runner-207 kernel: [46104.568108] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 18:12:10 juju-e4d256-prod-github-runner-207 kernel: [46104.569290] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 18:12:10 juju-e4d256-prod-github-runner-207 kernel: [46104.570704] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 18:12:10 juju-e4d256-prod-github-runner-207 kernel: [46104.571850] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 18:12:10 juju-e4d256-prod-github-runner-207 kernel: [46104.573071] Call Trace: Aug 22 18:12:10 juju-e4d256-prod-github-runner-207 kernel: [46104.573993] Aug 22 18:12:10 juju-e4d256-prod-github-runner-207 kernel: [46104.574914] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:12:10 juju-e4d256-prod-github-runner-207 kernel: [46104.575956] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:12:10 juju-e4d256-prod-github-runner-207 kernel: [46104.577001] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:12:10 juju-e4d256-prod-github-runner-207 kernel: [46104.578113] ? show_regs.part.0+0x23/0x29 Aug 22 18:12:10 juju-e4d256-prod-github-runner-207 kernel: [46104.579143] ? show_regs.cold+0x8/0xd Aug 22 18:12:10 juju-e4d256-prod-github-runner-207 kernel: [46104.580136] ? watchdog_timer_fn+0x1be/0x220 Aug 22 18:12:10 juju-e4d256-prod-github-runner-207 kernel: [46104.581156] ? lockup_detector_update_enable+0x60/0x60 Aug 22 18:12:10 juju-e4d256-prod-github-runner-207 kernel: [46104.582232] ? __hrtimer_run_queues+0x107/0x230 Aug 22 18:12:10 juju-e4d256-prod-github-runner-207 kernel: [46104.583297] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 18:12:10 juju-e4d256-prod-github-runner-207 kernel: [46104.584340] ? hrtimer_interrupt+0x101/0x220 Aug 22 18:12:10 juju-e4d256-prod-github-runner-207 kernel: [46104.585367] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 18:12:10 juju-e4d256-prod-github-runner-207 kernel: [46104.586450] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 18:12:10 juju-e4d256-prod-github-runner-207 kernel: [46104.587528] Aug 22 18:12:10 juju-e4d256-prod-github-runner-207 kernel: [46104.588383] Aug 22 18:12:10 juju-e4d256-prod-github-runner-207 kernel: [46104.589225] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 18:12:10 juju-e4d256-prod-github-runner-207 kernel: [46104.590270] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:12:10 juju-e4d256-prod-github-runner-207 kernel: [46104.591341] ? _raw_spin_lock+0x22/0x30 Aug 22 18:12:10 juju-e4d256-prod-github-runner-207 kernel: [46104.592296] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:12:10 juju-e4d256-prod-github-runner-207 kernel: [46104.593317] direct_page_fault+0x206/0x310 [kvm] Aug 22 18:12:10 juju-e4d256-prod-github-runner-207 kernel: [46104.594366] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 18:12:10 juju-e4d256-prod-github-runner-207 kernel: [46104.595855] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 18:12:10 juju-e4d256-prod-github-runner-207 kernel: [46104.597171] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 18:12:10 juju-e4d256-prod-github-runner-207 kernel: [46104.598441] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 18:12:10 juju-e4d256-prod-github-runner-207 kernel: [46104.599709] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 18:12:10 juju-e4d256-prod-github-runner-207 kernel: [46104.600978] handle_exit+0x98/0x230 [kvm_amd] Aug 22 18:12:10 juju-e4d256-prod-github-runner-207 kernel: [46104.602142] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 18:12:10 juju-e4d256-prod-github-runner-207 kernel: [46104.603391] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 18:12:10 juju-e4d256-prod-github-runner-207 kernel: [46104.604606] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 18:12:10 juju-e4d256-prod-github-runner-207 kernel: [46104.605778] vcpu_run+0x62/0x2c0 [kvm] Aug 22 18:12:10 juju-e4d256-prod-github-runner-207 kernel: [46104.606870] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 18:12:10 juju-e4d256-prod-github-runner-207 kernel: [46104.607904] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 18:12:10 juju-e4d256-prod-github-runner-207 kernel: [46104.608938] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 18:12:10 juju-e4d256-prod-github-runner-207 kernel: [46104.609884] ? __seccomp_filter+0x4a/0x4a0 Aug 22 18:12:10 juju-e4d256-prod-github-runner-207 kernel: [46104.610744] ? __fget_files+0x86/0xc0 Aug 22 18:12:10 juju-e4d256-prod-github-runner-207 kernel: [46104.611600] __x64_sys_ioctl+0x95/0xd0 Aug 22 18:12:10 juju-e4d256-prod-github-runner-207 kernel: [46104.612423] do_syscall_64+0x5c/0xc0 Aug 22 18:12:10 juju-e4d256-prod-github-runner-207 kernel: [46104.613249] ? do_futex+0x162/0x1f0 Aug 22 18:12:10 juju-e4d256-prod-github-runner-207 kernel: [46104.614054] ? __x64_sys_futex+0x78/0x1e0 Aug 22 18:12:10 juju-e4d256-prod-github-runner-207 kernel: [46104.614758] ? __secure_computing+0xa9/0x120 Aug 22 18:12:10 juju-e4d256-prod-github-runner-207 kernel: [46104.615473] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 18:12:10 juju-e4d256-prod-github-runner-207 kernel: [46104.616253] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:12:10 juju-e4d256-prod-github-runner-207 kernel: [46104.616992] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:12:10 juju-e4d256-prod-github-runner-207 kernel: [46104.617725] ? do_syscall_64+0x69/0xc0 Aug 22 18:12:10 juju-e4d256-prod-github-runner-207 kernel: [46104.618384] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:12:10 juju-e4d256-prod-github-runner-207 kernel: [46104.619125] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:12:10 juju-e4d256-prod-github-runner-207 kernel: [46104.619840] ? do_syscall_64+0x69/0xc0 Aug 22 18:12:10 juju-e4d256-prod-github-runner-207 kernel: [46104.620476] ? do_syscall_64+0x69/0xc0 Aug 22 18:12:10 juju-e4d256-prod-github-runner-207 kernel: [46104.621109] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 18:12:10 juju-e4d256-prod-github-runner-207 kernel: [46104.621827] RIP: 0033:0x7faa5d0edaff Aug 22 18:12:10 juju-e4d256-prod-github-runner-207 kernel: [46104.622464] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 18:12:10 juju-e4d256-prod-github-runner-207 kernel: [46104.624532] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 18:12:10 juju-e4d256-prod-github-runner-207 kernel: [46104.625466] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 18:12:10 juju-e4d256-prod-github-runner-207 kernel: [46104.626377] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 18:12:10 juju-e4d256-prod-github-runner-207 kernel: [46104.627316] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 18:12:10 juju-e4d256-prod-github-runner-207 kernel: [46104.628227] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 18:12:10 juju-e4d256-prod-github-runner-207 kernel: [46104.629134] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 18:12:10 juju-e4d256-prod-github-runner-207 kernel: [46104.630039] Aug 22 18:12:38 juju-e4d256-prod-github-runner-207 kernel: [46132.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 42856s! [qemu-system-x86:6715] Aug 22 18:12:38 juju-e4d256-prod-github-runner-207 kernel: [46132.543849] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 18:12:38 juju-e4d256-prod-github-runner-207 kernel: [46132.544139] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 18:12:38 juju-e4d256-prod-github-runner-207 kernel: [46132.556716] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 18:12:38 juju-e4d256-prod-github-runner-207 kernel: [46132.558023] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 18:12:38 juju-e4d256-prod-github-runner-207 kernel: [46132.559291] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:12:38 juju-e4d256-prod-github-runner-207 kernel: [46132.560359] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 18:12:38 juju-e4d256-prod-github-runner-207 kernel: [46132.562971] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 18:12:38 juju-e4d256-prod-github-runner-207 kernel: [46132.564029] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 18:12:38 juju-e4d256-prod-github-runner-207 kernel: [46132.565216] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 18:12:38 juju-e4d256-prod-github-runner-207 kernel: [46132.566390] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 18:12:38 juju-e4d256-prod-github-runner-207 kernel: [46132.567582] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 18:12:38 juju-e4d256-prod-github-runner-207 kernel: [46132.568762] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 18:12:38 juju-e4d256-prod-github-runner-207 kernel: [46132.569948] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 18:12:38 juju-e4d256-prod-github-runner-207 kernel: [46132.571288] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 18:12:38 juju-e4d256-prod-github-runner-207 kernel: [46132.572405] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 18:12:38 juju-e4d256-prod-github-runner-207 kernel: [46132.573623] Call Trace: Aug 22 18:12:38 juju-e4d256-prod-github-runner-207 kernel: [46132.574569] Aug 22 18:12:38 juju-e4d256-prod-github-runner-207 kernel: [46132.575480] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:12:38 juju-e4d256-prod-github-runner-207 kernel: [46132.576521] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:12:38 juju-e4d256-prod-github-runner-207 kernel: [46132.577553] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:12:38 juju-e4d256-prod-github-runner-207 kernel: [46132.578688] ? show_regs.part.0+0x23/0x29 Aug 22 18:12:38 juju-e4d256-prod-github-runner-207 kernel: [46132.579695] ? show_regs.cold+0x8/0xd Aug 22 18:12:38 juju-e4d256-prod-github-runner-207 kernel: [46132.580683] ? watchdog_timer_fn+0x1be/0x220 Aug 22 18:12:38 juju-e4d256-prod-github-runner-207 kernel: [46132.581704] ? lockup_detector_update_enable+0x60/0x60 Aug 22 18:12:38 juju-e4d256-prod-github-runner-207 kernel: [46132.582794] ? __hrtimer_run_queues+0x107/0x230 Aug 22 18:12:38 juju-e4d256-prod-github-runner-207 kernel: [46132.583835] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 18:12:38 juju-e4d256-prod-github-runner-207 kernel: [46132.584866] ? hrtimer_interrupt+0x101/0x220 Aug 22 18:12:38 juju-e4d256-prod-github-runner-207 kernel: [46132.585889] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 18:12:38 juju-e4d256-prod-github-runner-207 kernel: [46132.586988] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 18:12:38 juju-e4d256-prod-github-runner-207 kernel: [46132.588093] Aug 22 18:12:38 juju-e4d256-prod-github-runner-207 kernel: [46132.588991] Aug 22 18:12:38 juju-e4d256-prod-github-runner-207 kernel: [46132.589950] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 18:12:38 juju-e4d256-prod-github-runner-207 kernel: [46132.591032] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:12:38 juju-e4d256-prod-github-runner-207 kernel: [46132.592093] ? _raw_spin_lock+0x22/0x30 Aug 22 18:12:38 juju-e4d256-prod-github-runner-207 kernel: [46132.593049] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:12:38 juju-e4d256-prod-github-runner-207 kernel: [46132.594085] direct_page_fault+0x206/0x310 [kvm] Aug 22 18:12:38 juju-e4d256-prod-github-runner-207 kernel: [46132.595143] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 18:12:38 juju-e4d256-prod-github-runner-207 kernel: [46132.596164] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 18:12:38 juju-e4d256-prod-github-runner-207 kernel: [46132.597175] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 18:12:38 juju-e4d256-prod-github-runner-207 kernel: [46132.598205] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 18:12:38 juju-e4d256-prod-github-runner-207 kernel: [46132.599211] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 18:12:38 juju-e4d256-prod-github-runner-207 kernel: [46132.600220] handle_exit+0x98/0x230 [kvm_amd] Aug 22 18:12:38 juju-e4d256-prod-github-runner-207 kernel: [46132.601131] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 18:12:38 juju-e4d256-prod-github-runner-207 kernel: [46132.602057] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 18:12:38 juju-e4d256-prod-github-runner-207 kernel: [46132.603014] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 18:12:38 juju-e4d256-prod-github-runner-207 kernel: [46132.603931] vcpu_run+0x62/0x2c0 [kvm] Aug 22 18:12:38 juju-e4d256-prod-github-runner-207 kernel: [46132.604750] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 18:12:38 juju-e4d256-prod-github-runner-207 kernel: [46132.605566] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 18:12:38 juju-e4d256-prod-github-runner-207 kernel: [46132.606452] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 18:12:38 juju-e4d256-prod-github-runner-207 kernel: [46132.607258] ? __seccomp_filter+0x4a/0x4a0 Aug 22 18:12:38 juju-e4d256-prod-github-runner-207 kernel: [46132.608009] ? __fget_files+0x86/0xc0 Aug 22 18:12:38 juju-e4d256-prod-github-runner-207 kernel: [46132.608762] __x64_sys_ioctl+0x95/0xd0 Aug 22 18:12:38 juju-e4d256-prod-github-runner-207 kernel: [46132.609464] do_syscall_64+0x5c/0xc0 Aug 22 18:12:38 juju-e4d256-prod-github-runner-207 kernel: [46132.610139] ? do_futex+0x162/0x1f0 Aug 22 18:12:38 juju-e4d256-prod-github-runner-207 kernel: [46132.610815] ? __x64_sys_futex+0x78/0x1e0 Aug 22 18:12:38 juju-e4d256-prod-github-runner-207 kernel: [46132.611531] ? __secure_computing+0xa9/0x120 Aug 22 18:12:38 juju-e4d256-prod-github-runner-207 kernel: [46132.612234] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 18:12:38 juju-e4d256-prod-github-runner-207 kernel: [46132.613035] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:12:38 juju-e4d256-prod-github-runner-207 kernel: [46132.613769] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:12:38 juju-e4d256-prod-github-runner-207 kernel: [46132.614518] ? do_syscall_64+0x69/0xc0 Aug 22 18:12:38 juju-e4d256-prod-github-runner-207 kernel: [46132.615185] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:12:38 juju-e4d256-prod-github-runner-207 kernel: [46132.615898] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:12:38 juju-e4d256-prod-github-runner-207 kernel: [46132.616656] ? do_syscall_64+0x69/0xc0 Aug 22 18:12:38 juju-e4d256-prod-github-runner-207 kernel: [46132.617306] ? do_syscall_64+0x69/0xc0 Aug 22 18:12:38 juju-e4d256-prod-github-runner-207 kernel: [46132.617954] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 18:12:38 juju-e4d256-prod-github-runner-207 kernel: [46132.618694] RIP: 0033:0x7faa5d0edaff Aug 22 18:12:38 juju-e4d256-prod-github-runner-207 kernel: [46132.619375] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 18:12:38 juju-e4d256-prod-github-runner-207 kernel: [46132.621520] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 18:12:38 juju-e4d256-prod-github-runner-207 kernel: [46132.622488] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 18:12:38 juju-e4d256-prod-github-runner-207 kernel: [46132.623433] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 18:12:38 juju-e4d256-prod-github-runner-207 kernel: [46132.624346] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 18:12:38 juju-e4d256-prod-github-runner-207 kernel: [46132.625253] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 18:12:38 juju-e4d256-prod-github-runner-207 kernel: [46132.626170] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 18:12:38 juju-e4d256-prod-github-runner-207 kernel: [46132.627105] Aug 22 18:13:06 juju-e4d256-prod-github-runner-207 kernel: [46160.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 42882s! [qemu-system-x86:6715] Aug 22 18:13:06 juju-e4d256-prod-github-runner-207 kernel: [46160.543112] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 18:13:06 juju-e4d256-prod-github-runner-207 kernel: [46160.543186] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 18:13:06 juju-e4d256-prod-github-runner-207 kernel: [46160.555286] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 18:13:06 juju-e4d256-prod-github-runner-207 kernel: [46160.556555] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 18:13:06 juju-e4d256-prod-github-runner-207 kernel: [46160.557782] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:13:06 juju-e4d256-prod-github-runner-207 kernel: [46160.558884] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 18:13:06 juju-e4d256-prod-github-runner-207 kernel: [46160.561473] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 18:13:06 juju-e4d256-prod-github-runner-207 kernel: [46160.562552] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 18:13:06 juju-e4d256-prod-github-runner-207 kernel: [46160.563709] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 18:13:06 juju-e4d256-prod-github-runner-207 kernel: [46160.564900] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 18:13:06 juju-e4d256-prod-github-runner-207 kernel: [46160.566101] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 18:13:06 juju-e4d256-prod-github-runner-207 kernel: [46160.567307] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 18:13:06 juju-e4d256-prod-github-runner-207 kernel: [46160.568479] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 18:13:06 juju-e4d256-prod-github-runner-207 kernel: [46160.569707] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 18:13:06 juju-e4d256-prod-github-runner-207 kernel: [46160.570821] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 18:13:06 juju-e4d256-prod-github-runner-207 kernel: [46160.572014] Call Trace: Aug 22 18:13:06 juju-e4d256-prod-github-runner-207 kernel: [46160.572923] Aug 22 18:13:06 juju-e4d256-prod-github-runner-207 kernel: [46160.573824] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:13:06 juju-e4d256-prod-github-runner-207 kernel: [46160.574882] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:13:06 juju-e4d256-prod-github-runner-207 kernel: [46160.575904] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:13:06 juju-e4d256-prod-github-runner-207 kernel: [46160.576976] ? show_regs.part.0+0x23/0x29 Aug 22 18:13:06 juju-e4d256-prod-github-runner-207 kernel: [46160.577975] ? show_regs.cold+0x8/0xd Aug 22 18:13:06 juju-e4d256-prod-github-runner-207 kernel: [46160.578955] ? watchdog_timer_fn+0x1be/0x220 Aug 22 18:13:06 juju-e4d256-prod-github-runner-207 kernel: [46160.579959] ? lockup_detector_update_enable+0x60/0x60 Aug 22 18:13:06 juju-e4d256-prod-github-runner-207 kernel: [46160.581021] ? __hrtimer_run_queues+0x107/0x230 Aug 22 18:13:06 juju-e4d256-prod-github-runner-207 kernel: [46160.582063] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 18:13:06 juju-e4d256-prod-github-runner-207 kernel: [46160.583111] ? hrtimer_interrupt+0x101/0x220 Aug 22 18:13:06 juju-e4d256-prod-github-runner-207 kernel: [46160.584168] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 18:13:06 juju-e4d256-prod-github-runner-207 kernel: [46160.585241] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 18:13:06 juju-e4d256-prod-github-runner-207 kernel: [46160.586304] Aug 22 18:13:06 juju-e4d256-prod-github-runner-207 kernel: [46160.587161] Aug 22 18:13:06 juju-e4d256-prod-github-runner-207 kernel: [46160.587996] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 18:13:06 juju-e4d256-prod-github-runner-207 kernel: [46160.589026] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:13:06 juju-e4d256-prod-github-runner-207 kernel: [46160.590078] ? _raw_spin_lock+0x22/0x30 Aug 22 18:13:06 juju-e4d256-prod-github-runner-207 kernel: [46160.591039] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:13:06 juju-e4d256-prod-github-runner-207 kernel: [46160.592055] direct_page_fault+0x206/0x310 [kvm] Aug 22 18:13:06 juju-e4d256-prod-github-runner-207 kernel: [46160.593140] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 18:13:06 juju-e4d256-prod-github-runner-207 kernel: [46160.594260] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 18:13:06 juju-e4d256-prod-github-runner-207 kernel: [46160.595273] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 18:13:06 juju-e4d256-prod-github-runner-207 kernel: [46160.596272] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 18:13:06 juju-e4d256-prod-github-runner-207 kernel: [46160.597224] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 18:13:06 juju-e4d256-prod-github-runner-207 kernel: [46160.598213] handle_exit+0x98/0x230 [kvm_amd] Aug 22 18:13:06 juju-e4d256-prod-github-runner-207 kernel: [46160.599110] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 18:13:06 juju-e4d256-prod-github-runner-207 kernel: [46160.600025] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 18:13:06 juju-e4d256-prod-github-runner-207 kernel: [46160.600951] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 18:13:06 juju-e4d256-prod-github-runner-207 kernel: [46160.601856] vcpu_run+0x62/0x2c0 [kvm] Aug 22 18:13:06 juju-e4d256-prod-github-runner-207 kernel: [46160.602748] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 18:13:06 juju-e4d256-prod-github-runner-207 kernel: [46160.603581] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 18:13:06 juju-e4d256-prod-github-runner-207 kernel: [46160.604466] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 18:13:06 juju-e4d256-prod-github-runner-207 kernel: [46160.605264] ? __seccomp_filter+0x4a/0x4a0 Aug 22 18:13:06 juju-e4d256-prod-github-runner-207 kernel: [46160.606010] ? __fget_files+0x86/0xc0 Aug 22 18:13:06 juju-e4d256-prod-github-runner-207 kernel: [46160.606747] __x64_sys_ioctl+0x95/0xd0 Aug 22 18:13:06 juju-e4d256-prod-github-runner-207 kernel: [46160.607444] do_syscall_64+0x5c/0xc0 Aug 22 18:13:06 juju-e4d256-prod-github-runner-207 kernel: [46160.608115] ? do_futex+0x162/0x1f0 Aug 22 18:13:06 juju-e4d256-prod-github-runner-207 kernel: [46160.608778] ? __x64_sys_futex+0x78/0x1e0 Aug 22 18:13:06 juju-e4d256-prod-github-runner-207 kernel: [46160.609459] ? __secure_computing+0xa9/0x120 Aug 22 18:13:06 juju-e4d256-prod-github-runner-207 kernel: [46160.610186] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 18:13:06 juju-e4d256-prod-github-runner-207 kernel: [46160.610950] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:13:06 juju-e4d256-prod-github-runner-207 kernel: [46160.611672] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:13:06 juju-e4d256-prod-github-runner-207 kernel: [46160.612389] ? do_syscall_64+0x69/0xc0 Aug 22 18:13:06 juju-e4d256-prod-github-runner-207 kernel: [46160.613060] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:13:06 juju-e4d256-prod-github-runner-207 kernel: [46160.613810] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:13:06 juju-e4d256-prod-github-runner-207 kernel: [46160.614520] ? do_syscall_64+0x69/0xc0 Aug 22 18:13:06 juju-e4d256-prod-github-runner-207 kernel: [46160.615151] ? do_syscall_64+0x69/0xc0 Aug 22 18:13:06 juju-e4d256-prod-github-runner-207 kernel: [46160.615795] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 18:13:06 juju-e4d256-prod-github-runner-207 kernel: [46160.616503] RIP: 0033:0x7faa5d0edaff Aug 22 18:13:06 juju-e4d256-prod-github-runner-207 kernel: [46160.617127] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 18:13:06 juju-e4d256-prod-github-runner-207 kernel: [46160.619128] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 18:13:06 juju-e4d256-prod-github-runner-207 kernel: [46160.620055] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 18:13:06 juju-e4d256-prod-github-runner-207 kernel: [46160.620987] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 18:13:06 juju-e4d256-prod-github-runner-207 kernel: [46160.621908] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 18:13:06 juju-e4d256-prod-github-runner-207 kernel: [46160.622813] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 18:13:06 juju-e4d256-prod-github-runner-207 kernel: [46160.623712] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 18:13:06 juju-e4d256-prod-github-runner-207 kernel: [46160.624617] Aug 22 18:13:34 juju-e4d256-prod-github-runner-207 kernel: [46188.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 42908s! [qemu-system-x86:6715] Aug 22 18:13:34 juju-e4d256-prod-github-runner-207 kernel: [46188.543238] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 18:13:34 juju-e4d256-prod-github-runner-207 kernel: [46188.543331] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 18:13:34 juju-e4d256-prod-github-runner-207 kernel: [46188.556417] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 18:13:34 juju-e4d256-prod-github-runner-207 kernel: [46188.557802] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 18:13:34 juju-e4d256-prod-github-runner-207 kernel: [46188.559061] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:13:34 juju-e4d256-prod-github-runner-207 kernel: [46188.560128] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 18:13:34 juju-e4d256-prod-github-runner-207 kernel: [46188.562775] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 18:13:34 juju-e4d256-prod-github-runner-207 kernel: [46188.563853] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 18:13:34 juju-e4d256-prod-github-runner-207 kernel: [46188.565030] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 18:13:34 juju-e4d256-prod-github-runner-207 kernel: [46188.566315] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 18:13:34 juju-e4d256-prod-github-runner-207 kernel: [46188.567550] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 18:13:34 juju-e4d256-prod-github-runner-207 kernel: [46188.568870] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 18:13:34 juju-e4d256-prod-github-runner-207 kernel: [46188.570132] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 18:13:34 juju-e4d256-prod-github-runner-207 kernel: [46188.571501] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 18:13:34 juju-e4d256-prod-github-runner-207 kernel: [46188.572678] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 18:13:34 juju-e4d256-prod-github-runner-207 kernel: [46188.574289] Call Trace: Aug 22 18:13:34 juju-e4d256-prod-github-runner-207 kernel: [46188.575743] Aug 22 18:13:34 juju-e4d256-prod-github-runner-207 kernel: [46188.576809] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:13:34 juju-e4d256-prod-github-runner-207 kernel: [46188.578096] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:13:34 juju-e4d256-prod-github-runner-207 kernel: [46188.579230] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:13:34 juju-e4d256-prod-github-runner-207 kernel: [46188.580901] ? show_regs.part.0+0x23/0x29 Aug 22 18:13:34 juju-e4d256-prod-github-runner-207 kernel: [46188.582277] ? show_regs.cold+0x8/0xd Aug 22 18:13:34 juju-e4d256-prod-github-runner-207 kernel: [46188.583750] ? watchdog_timer_fn+0x1be/0x220 Aug 22 18:13:34 juju-e4d256-prod-github-runner-207 kernel: [46188.584981] ? lockup_detector_update_enable+0x60/0x60 Aug 22 18:13:34 juju-e4d256-prod-github-runner-207 kernel: [46188.586585] ? __hrtimer_run_queues+0x107/0x230 Aug 22 18:13:34 juju-e4d256-prod-github-runner-207 kernel: [46188.587967] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 18:13:34 juju-e4d256-prod-github-runner-207 kernel: [46188.589175] ? hrtimer_interrupt+0x101/0x220 Aug 22 18:13:34 juju-e4d256-prod-github-runner-207 kernel: [46188.590304] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 18:13:34 juju-e4d256-prod-github-runner-207 kernel: [46188.591503] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 18:13:34 juju-e4d256-prod-github-runner-207 kernel: [46188.592616] Aug 22 18:13:34 juju-e4d256-prod-github-runner-207 kernel: [46188.593554] Aug 22 18:13:34 juju-e4d256-prod-github-runner-207 kernel: [46188.594447] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 18:13:34 juju-e4d256-prod-github-runner-207 kernel: [46188.595497] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:13:34 juju-e4d256-prod-github-runner-207 kernel: [46188.596554] ? _raw_spin_lock+0x22/0x30 Aug 22 18:13:34 juju-e4d256-prod-github-runner-207 kernel: [46188.597520] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:13:34 juju-e4d256-prod-github-runner-207 kernel: [46188.598586] direct_page_fault+0x206/0x310 [kvm] Aug 22 18:13:34 juju-e4d256-prod-github-runner-207 kernel: [46188.599632] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 18:13:34 juju-e4d256-prod-github-runner-207 kernel: [46188.600697] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 18:13:34 juju-e4d256-prod-github-runner-207 kernel: [46188.601756] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 18:13:34 juju-e4d256-prod-github-runner-207 kernel: [46188.602744] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 18:13:34 juju-e4d256-prod-github-runner-207 kernel: [46188.603722] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 18:13:34 juju-e4d256-prod-github-runner-207 kernel: [46188.604732] handle_exit+0x98/0x230 [kvm_amd] Aug 22 18:13:34 juju-e4d256-prod-github-runner-207 kernel: [46188.605639] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 18:13:34 juju-e4d256-prod-github-runner-207 kernel: [46188.606621] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 18:13:34 juju-e4d256-prod-github-runner-207 kernel: [46188.607569] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 18:13:34 juju-e4d256-prod-github-runner-207 kernel: [46188.608498] vcpu_run+0x62/0x2c0 [kvm] Aug 22 18:13:34 juju-e4d256-prod-github-runner-207 kernel: [46188.609353] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 18:13:34 juju-e4d256-prod-github-runner-207 kernel: [46188.610205] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 18:13:34 juju-e4d256-prod-github-runner-207 kernel: [46188.611073] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 18:13:34 juju-e4d256-prod-github-runner-207 kernel: [46188.611894] ? __seccomp_filter+0x4a/0x4a0 Aug 22 18:13:34 juju-e4d256-prod-github-runner-207 kernel: [46188.612649] ? __fget_files+0x86/0xc0 Aug 22 18:13:34 juju-e4d256-prod-github-runner-207 kernel: [46188.613369] __x64_sys_ioctl+0x95/0xd0 Aug 22 18:13:34 juju-e4d256-prod-github-runner-207 kernel: [46188.614094] do_syscall_64+0x5c/0xc0 Aug 22 18:13:34 juju-e4d256-prod-github-runner-207 kernel: [46188.614776] ? do_futex+0x162/0x1f0 Aug 22 18:13:34 juju-e4d256-prod-github-runner-207 kernel: [46188.615442] ? __x64_sys_futex+0x78/0x1e0 Aug 22 18:13:34 juju-e4d256-prod-github-runner-207 kernel: [46188.616133] ? __secure_computing+0xa9/0x120 Aug 22 18:13:34 juju-e4d256-prod-github-runner-207 kernel: [46188.616839] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 18:13:34 juju-e4d256-prod-github-runner-207 kernel: [46188.617618] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:13:34 juju-e4d256-prod-github-runner-207 kernel: [46188.618367] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:13:34 juju-e4d256-prod-github-runner-207 kernel: [46188.619113] ? do_syscall_64+0x69/0xc0 Aug 22 18:13:34 juju-e4d256-prod-github-runner-207 kernel: [46188.619780] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:13:34 juju-e4d256-prod-github-runner-207 kernel: [46188.620500] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:13:34 juju-e4d256-prod-github-runner-207 kernel: [46188.621224] ? do_syscall_64+0x69/0xc0 Aug 22 18:13:34 juju-e4d256-prod-github-runner-207 kernel: [46188.621898] ? do_syscall_64+0x69/0xc0 Aug 22 18:13:34 juju-e4d256-prod-github-runner-207 kernel: [46188.622537] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 18:13:34 juju-e4d256-prod-github-runner-207 kernel: [46188.623259] RIP: 0033:0x7faa5d0edaff Aug 22 18:13:34 juju-e4d256-prod-github-runner-207 kernel: [46188.623900] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 18:13:34 juju-e4d256-prod-github-runner-207 kernel: [46188.626026] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 18:13:34 juju-e4d256-prod-github-runner-207 kernel: [46188.626989] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 18:13:34 juju-e4d256-prod-github-runner-207 kernel: [46188.628132] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 18:13:34 juju-e4d256-prod-github-runner-207 kernel: [46188.629042] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 18:13:34 juju-e4d256-prod-github-runner-207 kernel: [46188.630021] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 18:13:34 juju-e4d256-prod-github-runner-207 kernel: [46188.630987] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 18:13:34 juju-e4d256-prod-github-runner-207 kernel: [46188.631907] Aug 22 18:14:02 juju-e4d256-prod-github-runner-207 kernel: [46216.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 42934s! [qemu-system-x86:6715] Aug 22 18:14:02 juju-e4d256-prod-github-runner-207 kernel: [46216.543808] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 18:14:02 juju-e4d256-prod-github-runner-207 kernel: [46216.544091] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 18:14:02 juju-e4d256-prod-github-runner-207 kernel: [46216.556283] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 18:14:02 juju-e4d256-prod-github-runner-207 kernel: [46216.557769] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 18:14:02 juju-e4d256-prod-github-runner-207 kernel: [46216.559012] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:14:02 juju-e4d256-prod-github-runner-207 kernel: [46216.560069] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 18:14:02 juju-e4d256-prod-github-runner-207 kernel: [46216.562634] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 18:14:02 juju-e4d256-prod-github-runner-207 kernel: [46216.563678] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 18:14:02 juju-e4d256-prod-github-runner-207 kernel: [46216.564867] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 18:14:02 juju-e4d256-prod-github-runner-207 kernel: [46216.566055] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 18:14:02 juju-e4d256-prod-github-runner-207 kernel: [46216.567224] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 18:14:02 juju-e4d256-prod-github-runner-207 kernel: [46216.568394] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 18:14:02 juju-e4d256-prod-github-runner-207 kernel: [46216.569599] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 18:14:02 juju-e4d256-prod-github-runner-207 kernel: [46216.570834] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 18:14:02 juju-e4d256-prod-github-runner-207 kernel: [46216.571934] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 18:14:02 juju-e4d256-prod-github-runner-207 kernel: [46216.573121] Call Trace: Aug 22 18:14:02 juju-e4d256-prod-github-runner-207 kernel: [46216.574042] Aug 22 18:14:02 juju-e4d256-prod-github-runner-207 kernel: [46216.574940] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:14:02 juju-e4d256-prod-github-runner-207 kernel: [46216.575968] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:14:02 juju-e4d256-prod-github-runner-207 kernel: [46216.576986] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:14:02 juju-e4d256-prod-github-runner-207 kernel: [46216.578089] ? show_regs.part.0+0x23/0x29 Aug 22 18:14:02 juju-e4d256-prod-github-runner-207 kernel: [46216.579084] ? show_regs.cold+0x8/0xd Aug 22 18:14:02 juju-e4d256-prod-github-runner-207 kernel: [46216.580052] ? watchdog_timer_fn+0x1be/0x220 Aug 22 18:14:02 juju-e4d256-prod-github-runner-207 kernel: [46216.581056] ? lockup_detector_update_enable+0x60/0x60 Aug 22 18:14:02 juju-e4d256-prod-github-runner-207 kernel: [46216.582129] ? __hrtimer_run_queues+0x107/0x230 Aug 22 18:14:02 juju-e4d256-prod-github-runner-207 kernel: [46216.583157] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 18:14:02 juju-e4d256-prod-github-runner-207 kernel: [46216.584177] ? hrtimer_interrupt+0x101/0x220 Aug 22 18:14:02 juju-e4d256-prod-github-runner-207 kernel: [46216.585187] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 18:14:02 juju-e4d256-prod-github-runner-207 kernel: [46216.586270] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 18:14:02 juju-e4d256-prod-github-runner-207 kernel: [46216.587310] Aug 22 18:14:02 juju-e4d256-prod-github-runner-207 kernel: [46216.588175] Aug 22 18:14:02 juju-e4d256-prod-github-runner-207 kernel: [46216.589019] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 18:14:02 juju-e4d256-prod-github-runner-207 kernel: [46216.590066] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:14:02 juju-e4d256-prod-github-runner-207 kernel: [46216.591106] ? _raw_spin_lock+0x22/0x30 Aug 22 18:14:02 juju-e4d256-prod-github-runner-207 kernel: [46216.592046] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:14:02 juju-e4d256-prod-github-runner-207 kernel: [46216.593069] direct_page_fault+0x206/0x310 [kvm] Aug 22 18:14:02 juju-e4d256-prod-github-runner-207 kernel: [46216.594096] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 18:14:02 juju-e4d256-prod-github-runner-207 kernel: [46216.595099] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 18:14:02 juju-e4d256-prod-github-runner-207 kernel: [46216.596095] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 18:14:02 juju-e4d256-prod-github-runner-207 kernel: [46216.597106] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 18:14:02 juju-e4d256-prod-github-runner-207 kernel: [46216.598070] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 18:14:02 juju-e4d256-prod-github-runner-207 kernel: [46216.599043] handle_exit+0x98/0x230 [kvm_amd] Aug 22 18:14:02 juju-e4d256-prod-github-runner-207 kernel: [46216.599936] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 18:14:02 juju-e4d256-prod-github-runner-207 kernel: [46216.600849] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 18:14:02 juju-e4d256-prod-github-runner-207 kernel: [46216.601779] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 18:14:02 juju-e4d256-prod-github-runner-207 kernel: [46216.602679] vcpu_run+0x62/0x2c0 [kvm] Aug 22 18:14:02 juju-e4d256-prod-github-runner-207 kernel: [46216.603498] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 18:14:02 juju-e4d256-prod-github-runner-207 kernel: [46216.604306] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 18:14:02 juju-e4d256-prod-github-runner-207 kernel: [46216.605156] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 18:14:02 juju-e4d256-prod-github-runner-207 kernel: [46216.605973] ? __seccomp_filter+0x4a/0x4a0 Aug 22 18:14:02 juju-e4d256-prod-github-runner-207 kernel: [46216.606711] ? __fget_files+0x86/0xc0 Aug 22 18:14:02 juju-e4d256-prod-github-runner-207 kernel: [46216.607409] __x64_sys_ioctl+0x95/0xd0 Aug 22 18:14:02 juju-e4d256-prod-github-runner-207 kernel: [46216.608103] do_syscall_64+0x5c/0xc0 Aug 22 18:14:02 juju-e4d256-prod-github-runner-207 kernel: [46216.608769] ? do_futex+0x162/0x1f0 Aug 22 18:14:02 juju-e4d256-prod-github-runner-207 kernel: [46216.609424] ? __x64_sys_futex+0x78/0x1e0 Aug 22 18:14:02 juju-e4d256-prod-github-runner-207 kernel: [46216.610097] ? __secure_computing+0xa9/0x120 Aug 22 18:14:02 juju-e4d256-prod-github-runner-207 kernel: [46216.610783] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 18:14:02 juju-e4d256-prod-github-runner-207 kernel: [46216.611537] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:14:02 juju-e4d256-prod-github-runner-207 kernel: [46216.612252] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:14:02 juju-e4d256-prod-github-runner-207 kernel: [46216.612965] ? do_syscall_64+0x69/0xc0 Aug 22 18:14:02 juju-e4d256-prod-github-runner-207 kernel: [46216.613621] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:14:02 juju-e4d256-prod-github-runner-207 kernel: [46216.614319] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:14:02 juju-e4d256-prod-github-runner-207 kernel: [46216.615010] ? do_syscall_64+0x69/0xc0 Aug 22 18:14:02 juju-e4d256-prod-github-runner-207 kernel: [46216.615629] ? do_syscall_64+0x69/0xc0 Aug 22 18:14:02 juju-e4d256-prod-github-runner-207 kernel: [46216.616246] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 18:14:02 juju-e4d256-prod-github-runner-207 kernel: [46216.616946] RIP: 0033:0x7faa5d0edaff Aug 22 18:14:02 juju-e4d256-prod-github-runner-207 kernel: [46216.617600] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 18:14:02 juju-e4d256-prod-github-runner-207 kernel: [46216.619612] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 18:14:02 juju-e4d256-prod-github-runner-207 kernel: [46216.620532] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 18:14:02 juju-e4d256-prod-github-runner-207 kernel: [46216.621436] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 18:14:02 juju-e4d256-prod-github-runner-207 kernel: [46216.622323] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 18:14:02 juju-e4d256-prod-github-runner-207 kernel: [46216.623204] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 18:14:02 juju-e4d256-prod-github-runner-207 kernel: [46216.624087] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 18:14:02 juju-e4d256-prod-github-runner-207 kernel: [46216.624974] Aug 22 18:14:30 juju-e4d256-prod-github-runner-207 kernel: [46244.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 42960s! [qemu-system-x86:6715] Aug 22 18:14:30 juju-e4d256-prod-github-runner-207 kernel: [46244.543109] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 18:14:30 juju-e4d256-prod-github-runner-207 kernel: [46244.543181] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 18:14:30 juju-e4d256-prod-github-runner-207 kernel: [46244.555788] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 18:14:30 juju-e4d256-prod-github-runner-207 kernel: [46244.557101] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 18:14:30 juju-e4d256-prod-github-runner-207 kernel: [46244.558366] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:14:30 juju-e4d256-prod-github-runner-207 kernel: [46244.559432] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 18:14:30 juju-e4d256-prod-github-runner-207 kernel: [46244.562051] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 18:14:30 juju-e4d256-prod-github-runner-207 kernel: [46244.563160] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 18:14:30 juju-e4d256-prod-github-runner-207 kernel: [46244.564348] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 18:14:30 juju-e4d256-prod-github-runner-207 kernel: [46244.565545] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 18:14:30 juju-e4d256-prod-github-runner-207 kernel: [46244.566727] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 18:14:30 juju-e4d256-prod-github-runner-207 kernel: [46244.568019] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 18:14:30 juju-e4d256-prod-github-runner-207 kernel: [46244.569249] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 18:14:30 juju-e4d256-prod-github-runner-207 kernel: [46244.570501] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 18:14:30 juju-e4d256-prod-github-runner-207 kernel: [46244.571624] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 18:14:30 juju-e4d256-prod-github-runner-207 kernel: [46244.572966] Call Trace: Aug 22 18:14:30 juju-e4d256-prod-github-runner-207 kernel: [46244.573927] Aug 22 18:14:30 juju-e4d256-prod-github-runner-207 kernel: [46244.574821] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:14:30 juju-e4d256-prod-github-runner-207 kernel: [46244.575874] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:14:30 juju-e4d256-prod-github-runner-207 kernel: [46244.576908] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:14:30 juju-e4d256-prod-github-runner-207 kernel: [46244.578034] ? show_regs.part.0+0x23/0x29 Aug 22 18:14:30 juju-e4d256-prod-github-runner-207 kernel: [46244.579095] ? show_regs.cold+0x8/0xd Aug 22 18:14:30 juju-e4d256-prod-github-runner-207 kernel: [46244.580091] ? watchdog_timer_fn+0x1be/0x220 Aug 22 18:14:30 juju-e4d256-prod-github-runner-207 kernel: [46244.581133] ? lockup_detector_update_enable+0x60/0x60 Aug 22 18:14:30 juju-e4d256-prod-github-runner-207 kernel: [46244.582209] ? __hrtimer_run_queues+0x107/0x230 Aug 22 18:14:30 juju-e4d256-prod-github-runner-207 kernel: [46244.583263] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 18:14:30 juju-e4d256-prod-github-runner-207 kernel: [46244.584316] ? hrtimer_interrupt+0x101/0x220 Aug 22 18:14:30 juju-e4d256-prod-github-runner-207 kernel: [46244.585367] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 18:14:30 juju-e4d256-prod-github-runner-207 kernel: [46244.586502] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 18:14:30 juju-e4d256-prod-github-runner-207 kernel: [46244.587585] Aug 22 18:14:30 juju-e4d256-prod-github-runner-207 kernel: [46244.588471] Aug 22 18:14:30 juju-e4d256-prod-github-runner-207 kernel: [46244.589353] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 18:14:30 juju-e4d256-prod-github-runner-207 kernel: [46244.590409] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:14:30 juju-e4d256-prod-github-runner-207 kernel: [46244.591524] ? _raw_spin_lock+0x22/0x30 Aug 22 18:14:30 juju-e4d256-prod-github-runner-207 kernel: [46244.592491] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:14:30 juju-e4d256-prod-github-runner-207 kernel: [46244.593580] direct_page_fault+0x206/0x310 [kvm] Aug 22 18:14:30 juju-e4d256-prod-github-runner-207 kernel: [46244.594661] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 18:14:30 juju-e4d256-prod-github-runner-207 kernel: [46244.595694] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 18:14:30 juju-e4d256-prod-github-runner-207 kernel: [46244.596713] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 18:14:30 juju-e4d256-prod-github-runner-207 kernel: [46244.597732] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 18:14:30 juju-e4d256-prod-github-runner-207 kernel: [46244.598708] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 18:14:30 juju-e4d256-prod-github-runner-207 kernel: [46244.599724] handle_exit+0x98/0x230 [kvm_amd] Aug 22 18:14:30 juju-e4d256-prod-github-runner-207 kernel: [46244.600638] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 18:14:30 juju-e4d256-prod-github-runner-207 kernel: [46244.601594] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 18:14:30 juju-e4d256-prod-github-runner-207 kernel: [46244.602724] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 18:14:30 juju-e4d256-prod-github-runner-207 kernel: [46244.603666] vcpu_run+0x62/0x2c0 [kvm] Aug 22 18:14:30 juju-e4d256-prod-github-runner-207 kernel: [46244.604511] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 18:14:30 juju-e4d256-prod-github-runner-207 kernel: [46244.605367] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 18:14:30 juju-e4d256-prod-github-runner-207 kernel: [46244.606247] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 18:14:30 juju-e4d256-prod-github-runner-207 kernel: [46244.607064] ? __seccomp_filter+0x4a/0x4a0 Aug 22 18:14:30 juju-e4d256-prod-github-runner-207 kernel: [46244.607821] ? __fget_files+0x86/0xc0 Aug 22 18:14:30 juju-e4d256-prod-github-runner-207 kernel: [46244.608734] __x64_sys_ioctl+0x95/0xd0 Aug 22 18:14:30 juju-e4d256-prod-github-runner-207 kernel: [46244.609675] do_syscall_64+0x5c/0xc0 Aug 22 18:14:30 juju-e4d256-prod-github-runner-207 kernel: [46244.610364] ? do_futex+0x162/0x1f0 Aug 22 18:14:30 juju-e4d256-prod-github-runner-207 kernel: [46244.611019] ? __x64_sys_futex+0x78/0x1e0 Aug 22 18:14:30 juju-e4d256-prod-github-runner-207 kernel: [46244.611700] ? __secure_computing+0xa9/0x120 Aug 22 18:14:30 juju-e4d256-prod-github-runner-207 kernel: [46244.612397] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 18:14:30 juju-e4d256-prod-github-runner-207 kernel: [46244.613197] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:14:30 juju-e4d256-prod-github-runner-207 kernel: [46244.613952] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:14:30 juju-e4d256-prod-github-runner-207 kernel: [46244.614696] ? do_syscall_64+0x69/0xc0 Aug 22 18:14:30 juju-e4d256-prod-github-runner-207 kernel: [46244.615368] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:14:30 juju-e4d256-prod-github-runner-207 kernel: [46244.616080] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:14:30 juju-e4d256-prod-github-runner-207 kernel: [46244.616788] ? do_syscall_64+0x69/0xc0 Aug 22 18:14:30 juju-e4d256-prod-github-runner-207 kernel: [46244.617441] ? do_syscall_64+0x69/0xc0 Aug 22 18:14:30 juju-e4d256-prod-github-runner-207 kernel: [46244.618096] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 18:14:30 juju-e4d256-prod-github-runner-207 kernel: [46244.618819] RIP: 0033:0x7faa5d0edaff Aug 22 18:14:30 juju-e4d256-prod-github-runner-207 kernel: [46244.619488] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 18:14:30 juju-e4d256-prod-github-runner-207 kernel: [46244.621617] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 18:14:30 juju-e4d256-prod-github-runner-207 kernel: [46244.622565] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 18:14:30 juju-e4d256-prod-github-runner-207 kernel: [46244.623479] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 18:14:30 juju-e4d256-prod-github-runner-207 kernel: [46244.624415] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 18:14:30 juju-e4d256-prod-github-runner-207 kernel: [46244.625359] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 18:14:30 juju-e4d256-prod-github-runner-207 kernel: [46244.626287] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 18:14:30 juju-e4d256-prod-github-runner-207 kernel: [46244.627295] Aug 22 18:14:46 juju-e4d256-prod-github-runner-207 kernel: [46260.272709] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 18:14:46 juju-e4d256-prod-github-runner-207 kernel: [46260.273707] rcu: 1-....: (11499600 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=5565342 Aug 22 18:14:46 juju-e4d256-prod-github-runner-207 kernel: [46260.274848] (t=11535768 jiffies g=23269 q=45106) Aug 22 18:14:46 juju-e4d256-prod-github-runner-207 kernel: [46260.275645] NMI backtrace for cpu 1 Aug 22 18:14:46 juju-e4d256-prod-github-runner-207 kernel: [46260.276379] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 18:14:46 juju-e4d256-prod-github-runner-207 kernel: [46260.277540] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 18:14:46 juju-e4d256-prod-github-runner-207 kernel: [46260.278615] Call Trace: Aug 22 18:14:46 juju-e4d256-prod-github-runner-207 kernel: [46260.279300] Aug 22 18:14:46 juju-e4d256-prod-github-runner-207 kernel: [46260.279948] show_stack+0x52/0x5c Aug 22 18:14:46 juju-e4d256-prod-github-runner-207 kernel: [46260.280697] dump_stack_lvl+0x4a/0x63 Aug 22 18:14:46 juju-e4d256-prod-github-runner-207 kernel: [46260.281551] dump_stack+0x10/0x16 Aug 22 18:14:46 juju-e4d256-prod-github-runner-207 kernel: [46260.282336] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 18:14:46 juju-e4d256-prod-github-runner-207 kernel: [46260.283127] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 18:14:46 juju-e4d256-prod-github-runner-207 kernel: [46260.283905] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 18:14:46 juju-e4d256-prod-github-runner-207 kernel: [46260.284753] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 18:14:46 juju-e4d256-prod-github-runner-207 kernel: [46260.285579] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 18:14:46 juju-e4d256-prod-github-runner-207 kernel: [46260.286397] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 18:14:46 juju-e4d256-prod-github-runner-207 kernel: [46260.287266] print_cpu_stall.cold+0x2f/0xe2 Aug 22 18:14:46 juju-e4d256-prod-github-runner-207 kernel: [46260.288191] ? timekeeping_update+0xf7/0x150 Aug 22 18:14:46 juju-e4d256-prod-github-runner-207 kernel: [46260.289000] check_cpu_stall+0x109/0x270 Aug 22 18:14:46 juju-e4d256-prod-github-runner-207 kernel: [46260.289747] rcu_sched_clock_irq+0x9a/0x250 Aug 22 18:14:46 juju-e4d256-prod-github-runner-207 kernel: [46260.290507] update_process_times+0x94/0xd0 Aug 22 18:14:46 juju-e4d256-prod-github-runner-207 kernel: [46260.291308] tick_sched_handle+0x29/0x70 Aug 22 18:14:46 juju-e4d256-prod-github-runner-207 kernel: [46260.292063] tick_sched_timer+0x8c/0xc0 Aug 22 18:14:46 juju-e4d256-prod-github-runner-207 kernel: [46260.292829] ? tick_nohz_handler+0xb0/0xb0 Aug 22 18:14:46 juju-e4d256-prod-github-runner-207 kernel: [46260.293583] __hrtimer_run_queues+0x107/0x230 Aug 22 18:14:46 juju-e4d256-prod-github-runner-207 kernel: [46260.294353] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 18:14:46 juju-e4d256-prod-github-runner-207 kernel: [46260.295160] hrtimer_interrupt+0x101/0x220 Aug 22 18:14:46 juju-e4d256-prod-github-runner-207 kernel: [46260.295940] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 18:14:46 juju-e4d256-prod-github-runner-207 kernel: [46260.296787] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 18:14:46 juju-e4d256-prod-github-runner-207 kernel: [46260.297644] Aug 22 18:14:46 juju-e4d256-prod-github-runner-207 kernel: [46260.298351] Aug 22 18:14:46 juju-e4d256-prod-github-runner-207 kernel: [46260.298992] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 18:14:46 juju-e4d256-prod-github-runner-207 kernel: [46260.299813] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:14:46 juju-e4d256-prod-github-runner-207 kernel: [46260.300692] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 18:14:46 juju-e4d256-prod-github-runner-207 kernel: [46260.302947] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 18:14:46 juju-e4d256-prod-github-runner-207 kernel: [46260.303881] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 18:14:46 juju-e4d256-prod-github-runner-207 kernel: [46260.305057] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 18:14:46 juju-e4d256-prod-github-runner-207 kernel: [46260.306286] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 18:14:46 juju-e4d256-prod-github-runner-207 kernel: [46260.307585] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 18:14:46 juju-e4d256-prod-github-runner-207 kernel: [46260.309074] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 18:14:46 juju-e4d256-prod-github-runner-207 kernel: [46260.310048] ? _raw_spin_lock+0x22/0x30 Aug 22 18:14:46 juju-e4d256-prod-github-runner-207 kernel: [46260.310815] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:14:46 juju-e4d256-prod-github-runner-207 kernel: [46260.311658] direct_page_fault+0x206/0x310 [kvm] Aug 22 18:14:46 juju-e4d256-prod-github-runner-207 kernel: [46260.312822] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 18:14:46 juju-e4d256-prod-github-runner-207 kernel: [46260.313711] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 18:14:46 juju-e4d256-prod-github-runner-207 kernel: [46260.314606] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 18:14:46 juju-e4d256-prod-github-runner-207 kernel: [46260.315434] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 18:14:46 juju-e4d256-prod-github-runner-207 kernel: [46260.316227] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 18:14:46 juju-e4d256-prod-github-runner-207 kernel: [46260.317096] handle_exit+0x98/0x230 [kvm_amd] Aug 22 18:14:46 juju-e4d256-prod-github-runner-207 kernel: [46260.317856] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 18:14:46 juju-e4d256-prod-github-runner-207 kernel: [46260.318642] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 18:14:46 juju-e4d256-prod-github-runner-207 kernel: [46260.319441] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 18:14:46 juju-e4d256-prod-github-runner-207 kernel: [46260.320231] vcpu_run+0x62/0x2c0 [kvm] Aug 22 18:14:46 juju-e4d256-prod-github-runner-207 kernel: [46260.320963] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 18:14:46 juju-e4d256-prod-github-runner-207 kernel: [46260.321703] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 18:14:46 juju-e4d256-prod-github-runner-207 kernel: [46260.322505] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 18:14:46 juju-e4d256-prod-github-runner-207 kernel: [46260.323266] ? __seccomp_filter+0x4a/0x4a0 Aug 22 18:14:46 juju-e4d256-prod-github-runner-207 kernel: [46260.323987] ? __fget_files+0x86/0xc0 Aug 22 18:14:46 juju-e4d256-prod-github-runner-207 kernel: [46260.324681] __x64_sys_ioctl+0x95/0xd0 Aug 22 18:14:46 juju-e4d256-prod-github-runner-207 kernel: [46260.325393] do_syscall_64+0x5c/0xc0 Aug 22 18:14:46 juju-e4d256-prod-github-runner-207 kernel: [46260.326082] ? do_futex+0x162/0x1f0 Aug 22 18:14:46 juju-e4d256-prod-github-runner-207 kernel: [46260.326758] ? __x64_sys_futex+0x78/0x1e0 Aug 22 18:14:46 juju-e4d256-prod-github-runner-207 kernel: [46260.327488] ? __secure_computing+0xa9/0x120 Aug 22 18:14:46 juju-e4d256-prod-github-runner-207 kernel: [46260.328212] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 18:14:46 juju-e4d256-prod-github-runner-207 kernel: [46260.329022] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:14:46 juju-e4d256-prod-github-runner-207 kernel: [46260.329778] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:14:46 juju-e4d256-prod-github-runner-207 kernel: [46260.330533] ? do_syscall_64+0x69/0xc0 Aug 22 18:14:46 juju-e4d256-prod-github-runner-207 kernel: [46260.331225] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:14:46 juju-e4d256-prod-github-runner-207 kernel: [46260.331984] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:14:46 juju-e4d256-prod-github-runner-207 kernel: [46260.332755] ? do_syscall_64+0x69/0xc0 Aug 22 18:14:46 juju-e4d256-prod-github-runner-207 kernel: [46260.333451] ? do_syscall_64+0x69/0xc0 Aug 22 18:14:46 juju-e4d256-prod-github-runner-207 kernel: [46260.334144] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 18:14:46 juju-e4d256-prod-github-runner-207 kernel: [46260.334917] RIP: 0033:0x7faa5d0edaff Aug 22 18:14:46 juju-e4d256-prod-github-runner-207 kernel: [46260.335602] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 18:14:46 juju-e4d256-prod-github-runner-207 kernel: [46260.337721] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 18:14:46 juju-e4d256-prod-github-runner-207 kernel: [46260.338692] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 18:14:46 juju-e4d256-prod-github-runner-207 kernel: [46260.339639] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 18:14:46 juju-e4d256-prod-github-runner-207 kernel: [46260.340603] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 18:14:46 juju-e4d256-prod-github-runner-207 kernel: [46260.341569] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 18:14:46 juju-e4d256-prod-github-runner-207 kernel: [46260.342502] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 18:14:46 juju-e4d256-prod-github-runner-207 kernel: [46260.343422] Aug 22 18:15:10 juju-e4d256-prod-github-runner-207 kernel: [46284.541980] watchdog: BUG: soft lockup - CPU#1 stuck for 42997s! [qemu-system-x86:6715] Aug 22 18:15:10 juju-e4d256-prod-github-runner-207 kernel: [46284.543152] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 18:15:10 juju-e4d256-prod-github-runner-207 kernel: [46284.543229] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 18:15:10 juju-e4d256-prod-github-runner-207 kernel: [46284.557125] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 18:15:10 juju-e4d256-prod-github-runner-207 kernel: [46284.558460] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 18:15:10 juju-e4d256-prod-github-runner-207 kernel: [46284.559716] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:15:10 juju-e4d256-prod-github-runner-207 kernel: [46284.560806] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 18:15:10 juju-e4d256-prod-github-runner-207 kernel: [46284.563431] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 18:15:10 juju-e4d256-prod-github-runner-207 kernel: [46284.564512] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 18:15:10 juju-e4d256-prod-github-runner-207 kernel: [46284.565695] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 18:15:10 juju-e4d256-prod-github-runner-207 kernel: [46284.566876] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 18:15:10 juju-e4d256-prod-github-runner-207 kernel: [46284.568065] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 18:15:10 juju-e4d256-prod-github-runner-207 kernel: [46284.569270] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 18:15:10 juju-e4d256-prod-github-runner-207 kernel: [46284.570454] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 18:15:10 juju-e4d256-prod-github-runner-207 kernel: [46284.571710] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 18:15:10 juju-e4d256-prod-github-runner-207 kernel: [46284.572845] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 18:15:10 juju-e4d256-prod-github-runner-207 kernel: [46284.574054] Call Trace: Aug 22 18:15:10 juju-e4d256-prod-github-runner-207 kernel: [46284.574977] Aug 22 18:15:10 juju-e4d256-prod-github-runner-207 kernel: [46284.575866] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:15:10 juju-e4d256-prod-github-runner-207 kernel: [46284.576959] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:15:10 juju-e4d256-prod-github-runner-207 kernel: [46284.577998] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:15:10 juju-e4d256-prod-github-runner-207 kernel: [46284.579085] ? show_regs.part.0+0x23/0x29 Aug 22 18:15:10 juju-e4d256-prod-github-runner-207 kernel: [46284.580102] ? show_regs.cold+0x8/0xd Aug 22 18:15:10 juju-e4d256-prod-github-runner-207 kernel: [46284.581127] ? watchdog_timer_fn+0x1be/0x220 Aug 22 18:15:10 juju-e4d256-prod-github-runner-207 kernel: [46284.582160] ? lockup_detector_update_enable+0x60/0x60 Aug 22 18:15:10 juju-e4d256-prod-github-runner-207 kernel: [46284.583235] ? __hrtimer_run_queues+0x107/0x230 Aug 22 18:15:10 juju-e4d256-prod-github-runner-207 kernel: [46284.584279] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 18:15:10 juju-e4d256-prod-github-runner-207 kernel: [46284.585331] ? hrtimer_interrupt+0x101/0x220 Aug 22 18:15:10 juju-e4d256-prod-github-runner-207 kernel: [46284.586354] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 18:15:10 juju-e4d256-prod-github-runner-207 kernel: [46284.587444] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 18:15:10 juju-e4d256-prod-github-runner-207 kernel: [46284.588514] Aug 22 18:15:10 juju-e4d256-prod-github-runner-207 kernel: [46284.589384] Aug 22 18:15:10 juju-e4d256-prod-github-runner-207 kernel: [46284.590228] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 18:15:10 juju-e4d256-prod-github-runner-207 kernel: [46284.591271] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:15:10 juju-e4d256-prod-github-runner-207 kernel: [46284.592327] ? _raw_spin_lock+0x22/0x30 Aug 22 18:15:10 juju-e4d256-prod-github-runner-207 kernel: [46284.593292] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:15:10 juju-e4d256-prod-github-runner-207 kernel: [46284.594321] direct_page_fault+0x206/0x310 [kvm] Aug 22 18:15:10 juju-e4d256-prod-github-runner-207 kernel: [46284.595358] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 18:15:10 juju-e4d256-prod-github-runner-207 kernel: [46284.596375] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 18:15:10 juju-e4d256-prod-github-runner-207 kernel: [46284.597403] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 18:15:10 juju-e4d256-prod-github-runner-207 kernel: [46284.598387] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 18:15:10 juju-e4d256-prod-github-runner-207 kernel: [46284.599347] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 18:15:10 juju-e4d256-prod-github-runner-207 kernel: [46284.600375] handle_exit+0x98/0x230 [kvm_amd] Aug 22 18:15:10 juju-e4d256-prod-github-runner-207 kernel: [46284.601315] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 18:15:10 juju-e4d256-prod-github-runner-207 kernel: [46284.602244] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 18:15:10 juju-e4d256-prod-github-runner-207 kernel: [46284.603205] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 18:15:10 juju-e4d256-prod-github-runner-207 kernel: [46284.604127] vcpu_run+0x62/0x2c0 [kvm] Aug 22 18:15:10 juju-e4d256-prod-github-runner-207 kernel: [46284.604955] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 18:15:10 juju-e4d256-prod-github-runner-207 kernel: [46284.605773] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 18:15:10 juju-e4d256-prod-github-runner-207 kernel: [46284.606671] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 18:15:10 juju-e4d256-prod-github-runner-207 kernel: [46284.607480] ? __seccomp_filter+0x4a/0x4a0 Aug 22 18:15:10 juju-e4d256-prod-github-runner-207 kernel: [46284.608239] ? __fget_files+0x86/0xc0 Aug 22 18:15:10 juju-e4d256-prod-github-runner-207 kernel: [46284.608977] __x64_sys_ioctl+0x95/0xd0 Aug 22 18:15:10 juju-e4d256-prod-github-runner-207 kernel: [46284.609682] do_syscall_64+0x5c/0xc0 Aug 22 18:15:10 juju-e4d256-prod-github-runner-207 kernel: [46284.610387] ? do_futex+0x162/0x1f0 Aug 22 18:15:10 juju-e4d256-prod-github-runner-207 kernel: [46284.611075] ? __x64_sys_futex+0x78/0x1e0 Aug 22 18:15:10 juju-e4d256-prod-github-runner-207 kernel: [46284.611759] ? __secure_computing+0xa9/0x120 Aug 22 18:15:10 juju-e4d256-prod-github-runner-207 kernel: [46284.612483] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 18:15:10 juju-e4d256-prod-github-runner-207 kernel: [46284.613263] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:15:10 juju-e4d256-prod-github-runner-207 kernel: [46284.613993] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:15:10 juju-e4d256-prod-github-runner-207 kernel: [46284.614752] ? do_syscall_64+0x69/0xc0 Aug 22 18:15:10 juju-e4d256-prod-github-runner-207 kernel: [46284.615425] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:15:10 juju-e4d256-prod-github-runner-207 kernel: [46284.616141] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:15:10 juju-e4d256-prod-github-runner-207 kernel: [46284.616859] ? do_syscall_64+0x69/0xc0 Aug 22 18:15:10 juju-e4d256-prod-github-runner-207 kernel: [46284.617499] ? do_syscall_64+0x69/0xc0 Aug 22 18:15:10 juju-e4d256-prod-github-runner-207 kernel: [46284.618132] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 18:15:10 juju-e4d256-prod-github-runner-207 kernel: [46284.618854] RIP: 0033:0x7faa5d0edaff Aug 22 18:15:10 juju-e4d256-prod-github-runner-207 kernel: [46284.619506] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 18:15:10 juju-e4d256-prod-github-runner-207 kernel: [46284.621557] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 18:15:10 juju-e4d256-prod-github-runner-207 kernel: [46284.622482] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 18:15:10 juju-e4d256-prod-github-runner-207 kernel: [46284.623414] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 18:15:10 juju-e4d256-prod-github-runner-207 kernel: [46284.624324] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 18:15:10 juju-e4d256-prod-github-runner-207 kernel: [46284.625254] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 18:15:10 juju-e4d256-prod-github-runner-207 kernel: [46284.626156] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 18:15:10 juju-e4d256-prod-github-runner-207 kernel: [46284.627095] Aug 22 18:15:38 juju-e4d256-prod-github-runner-207 kernel: [46312.541982] watchdog: BUG: soft lockup - CPU#1 stuck for 43023s! [qemu-system-x86:6715] Aug 22 18:15:38 juju-e4d256-prod-github-runner-207 kernel: [46312.544274] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 18:15:38 juju-e4d256-prod-github-runner-207 kernel: [46312.544636] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 18:15:38 juju-e4d256-prod-github-runner-207 kernel: [46312.558557] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 18:15:38 juju-e4d256-prod-github-runner-207 kernel: [46312.559869] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 18:15:38 juju-e4d256-prod-github-runner-207 kernel: [46312.561362] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:15:38 juju-e4d256-prod-github-runner-207 kernel: [46312.563053] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 18:15:38 juju-e4d256-prod-github-runner-207 kernel: [46312.565968] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 18:15:38 juju-e4d256-prod-github-runner-207 kernel: [46312.567021] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 18:15:38 juju-e4d256-prod-github-runner-207 kernel: [46312.568318] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 18:15:38 juju-e4d256-prod-github-runner-207 kernel: [46312.569520] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 18:15:38 juju-e4d256-prod-github-runner-207 kernel: [46312.571030] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 18:15:38 juju-e4d256-prod-github-runner-207 kernel: [46312.572812] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 18:15:38 juju-e4d256-prod-github-runner-207 kernel: [46312.574172] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 18:15:38 juju-e4d256-prod-github-runner-207 kernel: [46312.575423] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 18:15:38 juju-e4d256-prod-github-runner-207 kernel: [46312.576708] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 18:15:38 juju-e4d256-prod-github-runner-207 kernel: [46312.578206] Call Trace: Aug 22 18:15:38 juju-e4d256-prod-github-runner-207 kernel: [46312.579382] Aug 22 18:15:38 juju-e4d256-prod-github-runner-207 kernel: [46312.580717] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:15:38 juju-e4d256-prod-github-runner-207 kernel: [46312.581997] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:15:38 juju-e4d256-prod-github-runner-207 kernel: [46312.583291] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:15:38 juju-e4d256-prod-github-runner-207 kernel: [46312.584719] ? show_regs.part.0+0x23/0x29 Aug 22 18:15:38 juju-e4d256-prod-github-runner-207 kernel: [46312.586000] ? show_regs.cold+0x8/0xd Aug 22 18:15:38 juju-e4d256-prod-github-runner-207 kernel: [46312.587235] ? watchdog_timer_fn+0x1be/0x220 Aug 22 18:15:38 juju-e4d256-prod-github-runner-207 kernel: [46312.588556] ? lockup_detector_update_enable+0x60/0x60 Aug 22 18:15:38 juju-e4d256-prod-github-runner-207 kernel: [46312.589915] ? __hrtimer_run_queues+0x107/0x230 Aug 22 18:15:38 juju-e4d256-prod-github-runner-207 kernel: [46312.591222] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 18:15:38 juju-e4d256-prod-github-runner-207 kernel: [46312.592548] ? hrtimer_interrupt+0x101/0x220 Aug 22 18:15:38 juju-e4d256-prod-github-runner-207 kernel: [46312.593878] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 18:15:38 juju-e4d256-prod-github-runner-207 kernel: [46312.595313] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 18:15:38 juju-e4d256-prod-github-runner-207 kernel: [46312.596716] Aug 22 18:15:38 juju-e4d256-prod-github-runner-207 kernel: [46312.597858] Aug 22 18:15:38 juju-e4d256-prod-github-runner-207 kernel: [46312.598948] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 18:15:38 juju-e4d256-prod-github-runner-207 kernel: [46312.600289] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:15:38 juju-e4d256-prod-github-runner-207 kernel: [46312.601358] ? _raw_spin_lock+0x22/0x30 Aug 22 18:15:38 juju-e4d256-prod-github-runner-207 kernel: [46312.602315] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:15:38 juju-e4d256-prod-github-runner-207 kernel: [46312.603348] direct_page_fault+0x206/0x310 [kvm] Aug 22 18:15:38 juju-e4d256-prod-github-runner-207 kernel: [46312.604403] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 18:15:38 juju-e4d256-prod-github-runner-207 kernel: [46312.605423] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 18:15:38 juju-e4d256-prod-github-runner-207 kernel: [46312.606437] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 18:15:38 juju-e4d256-prod-github-runner-207 kernel: [46312.607459] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 18:15:38 juju-e4d256-prod-github-runner-207 kernel: [46312.608424] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 18:15:38 juju-e4d256-prod-github-runner-207 kernel: [46312.609409] handle_exit+0x98/0x230 [kvm_amd] Aug 22 18:15:38 juju-e4d256-prod-github-runner-207 kernel: [46312.610308] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 18:15:38 juju-e4d256-prod-github-runner-207 kernel: [46312.611232] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 18:15:38 juju-e4d256-prod-github-runner-207 kernel: [46312.612178] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 18:15:38 juju-e4d256-prod-github-runner-207 kernel: [46312.613087] vcpu_run+0x62/0x2c0 [kvm] Aug 22 18:15:38 juju-e4d256-prod-github-runner-207 kernel: [46312.613906] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 18:15:38 juju-e4d256-prod-github-runner-207 kernel: [46312.614759] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 18:15:38 juju-e4d256-prod-github-runner-207 kernel: [46312.615623] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 18:15:38 juju-e4d256-prod-github-runner-207 kernel: [46312.616441] ? __seccomp_filter+0x4a/0x4a0 Aug 22 18:15:38 juju-e4d256-prod-github-runner-207 kernel: [46312.617191] ? __fget_files+0x86/0xc0 Aug 22 18:15:38 juju-e4d256-prod-github-runner-207 kernel: [46312.617900] __x64_sys_ioctl+0x95/0xd0 Aug 22 18:15:38 juju-e4d256-prod-github-runner-207 kernel: [46312.618597] do_syscall_64+0x5c/0xc0 Aug 22 18:15:38 juju-e4d256-prod-github-runner-207 kernel: [46312.619279] ? do_futex+0x162/0x1f0 Aug 22 18:15:38 juju-e4d256-prod-github-runner-207 kernel: [46312.619933] ? __x64_sys_futex+0x78/0x1e0 Aug 22 18:15:38 juju-e4d256-prod-github-runner-207 kernel: [46312.620623] ? __secure_computing+0xa9/0x120 Aug 22 18:15:38 juju-e4d256-prod-github-runner-207 kernel: [46312.621321] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 18:15:38 juju-e4d256-prod-github-runner-207 kernel: [46312.622084] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:15:38 juju-e4d256-prod-github-runner-207 kernel: [46312.622809] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:15:38 juju-e4d256-prod-github-runner-207 kernel: [46312.623531] ? do_syscall_64+0x69/0xc0 Aug 22 18:15:38 juju-e4d256-prod-github-runner-207 kernel: [46312.624197] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:15:38 juju-e4d256-prod-github-runner-207 kernel: [46312.624906] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:15:38 juju-e4d256-prod-github-runner-207 kernel: [46312.625608] ? do_syscall_64+0x69/0xc0 Aug 22 18:15:38 juju-e4d256-prod-github-runner-207 kernel: [46312.626239] ? do_syscall_64+0x69/0xc0 Aug 22 18:15:38 juju-e4d256-prod-github-runner-207 kernel: [46312.626867] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 18:15:38 juju-e4d256-prod-github-runner-207 kernel: [46312.627579] RIP: 0033:0x7faa5d0edaff Aug 22 18:15:38 juju-e4d256-prod-github-runner-207 kernel: [46312.628279] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 18:15:38 juju-e4d256-prod-github-runner-207 kernel: [46312.630297] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 18:15:38 juju-e4d256-prod-github-runner-207 kernel: [46312.631347] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 18:15:38 juju-e4d256-prod-github-runner-207 kernel: [46312.632257] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 18:15:38 juju-e4d256-prod-github-runner-207 kernel: [46312.633150] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 18:15:38 juju-e4d256-prod-github-runner-207 kernel: [46312.634043] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 18:15:38 juju-e4d256-prod-github-runner-207 kernel: [46312.634940] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 18:15:38 juju-e4d256-prod-github-runner-207 kernel: [46312.635841] Aug 22 18:16:06 juju-e4d256-prod-github-runner-207 kernel: [46340.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 43049s! [qemu-system-x86:6715] Aug 22 18:16:06 juju-e4d256-prod-github-runner-207 kernel: [46340.543097] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 18:16:06 juju-e4d256-prod-github-runner-207 kernel: [46340.543169] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 18:16:06 juju-e4d256-prod-github-runner-207 kernel: [46340.555619] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 18:16:06 juju-e4d256-prod-github-runner-207 kernel: [46340.557105] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 18:16:06 juju-e4d256-prod-github-runner-207 kernel: [46340.558351] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:16:06 juju-e4d256-prod-github-runner-207 kernel: [46340.559479] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 18:16:06 juju-e4d256-prod-github-runner-207 kernel: [46340.562121] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 18:16:06 juju-e4d256-prod-github-runner-207 kernel: [46340.563183] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 18:16:06 juju-e4d256-prod-github-runner-207 kernel: [46340.564385] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 18:16:06 juju-e4d256-prod-github-runner-207 kernel: [46340.565560] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 18:16:06 juju-e4d256-prod-github-runner-207 kernel: [46340.566747] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 18:16:06 juju-e4d256-prod-github-runner-207 kernel: [46340.567948] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 18:16:06 juju-e4d256-prod-github-runner-207 kernel: [46340.569137] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 18:16:06 juju-e4d256-prod-github-runner-207 kernel: [46340.570389] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 18:16:06 juju-e4d256-prod-github-runner-207 kernel: [46340.571503] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 18:16:06 juju-e4d256-prod-github-runner-207 kernel: [46340.572732] Call Trace: Aug 22 18:16:06 juju-e4d256-prod-github-runner-207 kernel: [46340.573689] Aug 22 18:16:06 juju-e4d256-prod-github-runner-207 kernel: [46340.574577] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:16:06 juju-e4d256-prod-github-runner-207 kernel: [46340.575618] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:16:06 juju-e4d256-prod-github-runner-207 kernel: [46340.576671] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:16:06 juju-e4d256-prod-github-runner-207 kernel: [46340.577773] ? show_regs.part.0+0x23/0x29 Aug 22 18:16:06 juju-e4d256-prod-github-runner-207 kernel: [46340.578776] ? show_regs.cold+0x8/0xd Aug 22 18:16:06 juju-e4d256-prod-github-runner-207 kernel: [46340.579777] ? watchdog_timer_fn+0x1be/0x220 Aug 22 18:16:06 juju-e4d256-prod-github-runner-207 kernel: [46340.580791] ? lockup_detector_update_enable+0x60/0x60 Aug 22 18:16:06 juju-e4d256-prod-github-runner-207 kernel: [46340.581861] ? __hrtimer_run_queues+0x107/0x230 Aug 22 18:16:06 juju-e4d256-prod-github-runner-207 kernel: [46340.582904] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 18:16:06 juju-e4d256-prod-github-runner-207 kernel: [46340.583955] ? hrtimer_interrupt+0x101/0x220 Aug 22 18:16:06 juju-e4d256-prod-github-runner-207 kernel: [46340.584981] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 18:16:06 juju-e4d256-prod-github-runner-207 kernel: [46340.586062] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 18:16:06 juju-e4d256-prod-github-runner-207 kernel: [46340.587126] Aug 22 18:16:06 juju-e4d256-prod-github-runner-207 kernel: [46340.588020] Aug 22 18:16:06 juju-e4d256-prod-github-runner-207 kernel: [46340.588890] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 18:16:06 juju-e4d256-prod-github-runner-207 kernel: [46340.589945] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:16:06 juju-e4d256-prod-github-runner-207 kernel: [46340.590993] ? _raw_spin_lock+0x22/0x30 Aug 22 18:16:06 juju-e4d256-prod-github-runner-207 kernel: [46340.591968] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:16:06 juju-e4d256-prod-github-runner-207 kernel: [46340.593001] direct_page_fault+0x206/0x310 [kvm] Aug 22 18:16:06 juju-e4d256-prod-github-runner-207 kernel: [46340.594041] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 18:16:06 juju-e4d256-prod-github-runner-207 kernel: [46340.595068] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 18:16:06 juju-e4d256-prod-github-runner-207 kernel: [46340.596121] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 18:16:06 juju-e4d256-prod-github-runner-207 kernel: [46340.597107] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 18:16:06 juju-e4d256-prod-github-runner-207 kernel: [46340.598074] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 18:16:06 juju-e4d256-prod-github-runner-207 kernel: [46340.599091] handle_exit+0x98/0x230 [kvm_amd] Aug 22 18:16:06 juju-e4d256-prod-github-runner-207 kernel: [46340.600008] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 18:16:06 juju-e4d256-prod-github-runner-207 kernel: [46340.600931] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 18:16:06 juju-e4d256-prod-github-runner-207 kernel: [46340.601873] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 18:16:06 juju-e4d256-prod-github-runner-207 kernel: [46340.602789] vcpu_run+0x62/0x2c0 [kvm] Aug 22 18:16:06 juju-e4d256-prod-github-runner-207 kernel: [46340.603613] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 18:16:06 juju-e4d256-prod-github-runner-207 kernel: [46340.604445] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 18:16:06 juju-e4d256-prod-github-runner-207 kernel: [46340.605309] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 18:16:06 juju-e4d256-prod-github-runner-207 kernel: [46340.606160] ? __seccomp_filter+0x4a/0x4a0 Aug 22 18:16:06 juju-e4d256-prod-github-runner-207 kernel: [46340.606927] ? __fget_files+0x86/0xc0 Aug 22 18:16:06 juju-e4d256-prod-github-runner-207 kernel: [46340.607645] __x64_sys_ioctl+0x95/0xd0 Aug 22 18:16:06 juju-e4d256-prod-github-runner-207 kernel: [46340.608377] do_syscall_64+0x5c/0xc0 Aug 22 18:16:06 juju-e4d256-prod-github-runner-207 kernel: [46340.609054] ? do_futex+0x162/0x1f0 Aug 22 18:16:06 juju-e4d256-prod-github-runner-207 kernel: [46340.609714] ? __x64_sys_futex+0x78/0x1e0 Aug 22 18:16:06 juju-e4d256-prod-github-runner-207 kernel: [46340.610396] ? __secure_computing+0xa9/0x120 Aug 22 18:16:06 juju-e4d256-prod-github-runner-207 kernel: [46340.611099] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 18:16:06 juju-e4d256-prod-github-runner-207 kernel: [46340.611888] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:16:06 juju-e4d256-prod-github-runner-207 kernel: [46340.612625] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:16:06 juju-e4d256-prod-github-runner-207 kernel: [46340.613355] ? do_syscall_64+0x69/0xc0 Aug 22 18:16:06 juju-e4d256-prod-github-runner-207 kernel: [46340.614013] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:16:06 juju-e4d256-prod-github-runner-207 kernel: [46340.614729] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:16:06 juju-e4d256-prod-github-runner-207 kernel: [46340.615435] ? do_syscall_64+0x69/0xc0 Aug 22 18:16:06 juju-e4d256-prod-github-runner-207 kernel: [46340.616100] ? do_syscall_64+0x69/0xc0 Aug 22 18:16:06 juju-e4d256-prod-github-runner-207 kernel: [46340.616736] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 18:16:06 juju-e4d256-prod-github-runner-207 kernel: [46340.617443] RIP: 0033:0x7faa5d0edaff Aug 22 18:16:06 juju-e4d256-prod-github-runner-207 kernel: [46340.618070] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 18:16:06 juju-e4d256-prod-github-runner-207 kernel: [46340.620086] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 18:16:06 juju-e4d256-prod-github-runner-207 kernel: [46340.621000] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 18:16:06 juju-e4d256-prod-github-runner-207 kernel: [46340.621889] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 18:16:06 juju-e4d256-prod-github-runner-207 kernel: [46340.622776] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 18:16:06 juju-e4d256-prod-github-runner-207 kernel: [46340.623669] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 18:16:06 juju-e4d256-prod-github-runner-207 kernel: [46340.624579] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 18:16:06 juju-e4d256-prod-github-runner-207 kernel: [46340.625506] Aug 22 18:16:34 juju-e4d256-prod-github-runner-207 kernel: [46368.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 43076s! [qemu-system-x86:6715] Aug 22 18:16:34 juju-e4d256-prod-github-runner-207 kernel: [46368.543123] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 18:16:34 juju-e4d256-prod-github-runner-207 kernel: [46368.543196] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 18:16:34 juju-e4d256-prod-github-runner-207 kernel: [46368.555447] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 18:16:34 juju-e4d256-prod-github-runner-207 kernel: [46368.556760] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 18:16:34 juju-e4d256-prod-github-runner-207 kernel: [46368.558054] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:16:34 juju-e4d256-prod-github-runner-207 kernel: [46368.559123] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 18:16:34 juju-e4d256-prod-github-runner-207 kernel: [46368.561684] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 18:16:34 juju-e4d256-prod-github-runner-207 kernel: [46368.562733] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 18:16:34 juju-e4d256-prod-github-runner-207 kernel: [46368.563919] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 18:16:34 juju-e4d256-prod-github-runner-207 kernel: [46368.565233] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 18:16:34 juju-e4d256-prod-github-runner-207 kernel: [46368.566528] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 18:16:34 juju-e4d256-prod-github-runner-207 kernel: [46368.567837] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 18:16:34 juju-e4d256-prod-github-runner-207 kernel: [46368.569436] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 18:16:34 juju-e4d256-prod-github-runner-207 kernel: [46368.570809] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 18:16:34 juju-e4d256-prod-github-runner-207 kernel: [46368.572018] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 18:16:34 juju-e4d256-prod-github-runner-207 kernel: [46368.573341] Call Trace: Aug 22 18:16:34 juju-e4d256-prod-github-runner-207 kernel: [46368.574301] Aug 22 18:16:34 juju-e4d256-prod-github-runner-207 kernel: [46368.575237] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:16:34 juju-e4d256-prod-github-runner-207 kernel: [46368.576359] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:16:34 juju-e4d256-prod-github-runner-207 kernel: [46368.577462] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:16:34 juju-e4d256-prod-github-runner-207 kernel: [46368.578630] ? show_regs.part.0+0x23/0x29 Aug 22 18:16:34 juju-e4d256-prod-github-runner-207 kernel: [46368.579752] ? show_regs.cold+0x8/0xd Aug 22 18:16:34 juju-e4d256-prod-github-runner-207 kernel: [46368.580793] ? watchdog_timer_fn+0x1be/0x220 Aug 22 18:16:34 juju-e4d256-prod-github-runner-207 kernel: [46368.581885] ? lockup_detector_update_enable+0x60/0x60 Aug 22 18:16:34 juju-e4d256-prod-github-runner-207 kernel: [46368.583066] ? __hrtimer_run_queues+0x107/0x230 Aug 22 18:16:34 juju-e4d256-prod-github-runner-207 kernel: [46368.584185] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 18:16:34 juju-e4d256-prod-github-runner-207 kernel: [46368.585341] ? hrtimer_interrupt+0x101/0x220 Aug 22 18:16:34 juju-e4d256-prod-github-runner-207 kernel: [46368.586438] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 18:16:34 juju-e4d256-prod-github-runner-207 kernel: [46368.587621] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 18:16:34 juju-e4d256-prod-github-runner-207 kernel: [46368.588772] Aug 22 18:16:34 juju-e4d256-prod-github-runner-207 kernel: [46368.589669] Aug 22 18:16:34 juju-e4d256-prod-github-runner-207 kernel: [46368.590558] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 18:16:34 juju-e4d256-prod-github-runner-207 kernel: [46368.591706] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:16:34 juju-e4d256-prod-github-runner-207 kernel: [46368.592845] ? _raw_spin_lock+0x22/0x30 Aug 22 18:16:34 juju-e4d256-prod-github-runner-207 kernel: [46368.593867] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:16:34 juju-e4d256-prod-github-runner-207 kernel: [46368.594973] direct_page_fault+0x206/0x310 [kvm] Aug 22 18:16:34 juju-e4d256-prod-github-runner-207 kernel: [46368.596132] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 18:16:34 juju-e4d256-prod-github-runner-207 kernel: [46368.597264] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 18:16:34 juju-e4d256-prod-github-runner-207 kernel: [46368.598368] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 18:16:34 juju-e4d256-prod-github-runner-207 kernel: [46368.599441] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 18:16:34 juju-e4d256-prod-github-runner-207 kernel: [46368.600496] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 18:16:34 juju-e4d256-prod-github-runner-207 kernel: [46368.601581] handle_exit+0x98/0x230 [kvm_amd] Aug 22 18:16:34 juju-e4d256-prod-github-runner-207 kernel: [46368.602559] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 18:16:34 juju-e4d256-prod-github-runner-207 kernel: [46368.603569] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 18:16:34 juju-e4d256-prod-github-runner-207 kernel: [46368.604592] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 18:16:34 juju-e4d256-prod-github-runner-207 kernel: [46368.605602] vcpu_run+0x62/0x2c0 [kvm] Aug 22 18:16:34 juju-e4d256-prod-github-runner-207 kernel: [46368.606531] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 18:16:34 juju-e4d256-prod-github-runner-207 kernel: [46368.607441] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 18:16:34 juju-e4d256-prod-github-runner-207 kernel: [46368.608397] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 18:16:34 juju-e4d256-prod-github-runner-207 kernel: [46368.609283] ? __seccomp_filter+0x4a/0x4a0 Aug 22 18:16:34 juju-e4d256-prod-github-runner-207 kernel: [46368.610111] ? __fget_files+0x86/0xc0 Aug 22 18:16:34 juju-e4d256-prod-github-runner-207 kernel: [46368.610892] __x64_sys_ioctl+0x95/0xd0 Aug 22 18:16:34 juju-e4d256-prod-github-runner-207 kernel: [46368.611672] do_syscall_64+0x5c/0xc0 Aug 22 18:16:34 juju-e4d256-prod-github-runner-207 kernel: [46368.612409] ? do_futex+0x162/0x1f0 Aug 22 18:16:34 juju-e4d256-prod-github-runner-207 kernel: [46368.613127] ? __x64_sys_futex+0x78/0x1e0 Aug 22 18:16:34 juju-e4d256-prod-github-runner-207 kernel: [46368.613885] ? __secure_computing+0xa9/0x120 Aug 22 18:16:34 juju-e4d256-prod-github-runner-207 kernel: [46368.614669] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 18:16:34 juju-e4d256-prod-github-runner-207 kernel: [46368.615556] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:16:34 juju-e4d256-prod-github-runner-207 kernel: [46368.616397] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:16:34 juju-e4d256-prod-github-runner-207 kernel: [46368.617230] ? do_syscall_64+0x69/0xc0 Aug 22 18:16:34 juju-e4d256-prod-github-runner-207 kernel: [46368.617962] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:16:34 juju-e4d256-prod-github-runner-207 kernel: [46368.618755] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:16:34 juju-e4d256-prod-github-runner-207 kernel: [46368.619567] ? do_syscall_64+0x69/0xc0 Aug 22 18:16:34 juju-e4d256-prod-github-runner-207 kernel: [46368.620271] ? do_syscall_64+0x69/0xc0 Aug 22 18:16:34 juju-e4d256-prod-github-runner-207 kernel: [46368.620969] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 18:16:34 juju-e4d256-prod-github-runner-207 kernel: [46368.621771] RIP: 0033:0x7faa5d0edaff Aug 22 18:16:34 juju-e4d256-prod-github-runner-207 kernel: [46368.622466] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 18:16:34 juju-e4d256-prod-github-runner-207 kernel: [46368.624807] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 18:16:34 juju-e4d256-prod-github-runner-207 kernel: [46368.625862] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 18:16:34 juju-e4d256-prod-github-runner-207 kernel: [46368.626884] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 18:16:34 juju-e4d256-prod-github-runner-207 kernel: [46368.627913] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 18:16:34 juju-e4d256-prod-github-runner-207 kernel: [46368.628934] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 18:16:34 juju-e4d256-prod-github-runner-207 kernel: [46368.629961] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 18:16:34 juju-e4d256-prod-github-runner-207 kernel: [46368.630986] Aug 22 18:17:02 juju-e4d256-prod-github-runner-207 kernel: [46396.541982] watchdog: BUG: soft lockup - CPU#1 stuck for 43102s! [qemu-system-x86:6715] Aug 22 18:17:02 juju-e4d256-prod-github-runner-207 kernel: [46396.543217] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 18:17:02 juju-e4d256-prod-github-runner-207 kernel: [46396.543465] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 18:17:02 juju-e4d256-prod-github-runner-207 kernel: [46396.555666] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 18:17:02 juju-e4d256-prod-github-runner-207 kernel: [46396.556941] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 18:17:02 juju-e4d256-prod-github-runner-207 kernel: [46396.558162] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:17:02 juju-e4d256-prod-github-runner-207 kernel: [46396.559230] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 18:17:02 juju-e4d256-prod-github-runner-207 kernel: [46396.561775] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 18:17:02 juju-e4d256-prod-github-runner-207 kernel: [46396.562894] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 18:17:02 juju-e4d256-prod-github-runner-207 kernel: [46396.564079] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 18:17:02 juju-e4d256-prod-github-runner-207 kernel: [46396.565245] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 18:17:02 juju-e4d256-prod-github-runner-207 kernel: [46396.566406] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 18:17:02 juju-e4d256-prod-github-runner-207 kernel: [46396.567581] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 18:17:02 juju-e4d256-prod-github-runner-207 kernel: [46396.568745] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 18:17:02 juju-e4d256-prod-github-runner-207 kernel: [46396.569973] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 18:17:02 juju-e4d256-prod-github-runner-207 kernel: [46396.571076] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 18:17:02 juju-e4d256-prod-github-runner-207 kernel: [46396.572277] Call Trace: Aug 22 18:17:02 juju-e4d256-prod-github-runner-207 kernel: [46396.573191] Aug 22 18:17:02 juju-e4d256-prod-github-runner-207 kernel: [46396.574073] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:17:02 juju-e4d256-prod-github-runner-207 kernel: [46396.575114] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:17:02 juju-e4d256-prod-github-runner-207 kernel: [46396.576140] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:17:02 juju-e4d256-prod-github-runner-207 kernel: [46396.577245] ? show_regs.part.0+0x23/0x29 Aug 22 18:17:02 juju-e4d256-prod-github-runner-207 kernel: [46396.578249] ? show_regs.cold+0x8/0xd Aug 22 18:17:02 juju-e4d256-prod-github-runner-207 kernel: [46396.579235] ? watchdog_timer_fn+0x1be/0x220 Aug 22 18:17:02 juju-e4d256-prod-github-runner-207 kernel: [46396.580241] ? lockup_detector_update_enable+0x60/0x60 Aug 22 18:17:02 juju-e4d256-prod-github-runner-207 kernel: [46396.581301] ? __hrtimer_run_queues+0x107/0x230 Aug 22 18:17:02 juju-e4d256-prod-github-runner-207 kernel: [46396.582326] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 18:17:02 juju-e4d256-prod-github-runner-207 kernel: [46396.583373] ? hrtimer_interrupt+0x101/0x220 Aug 22 18:17:02 juju-e4d256-prod-github-runner-207 kernel: [46396.584416] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 18:17:02 juju-e4d256-prod-github-runner-207 kernel: [46396.585515] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 18:17:02 juju-e4d256-prod-github-runner-207 kernel: [46396.586564] Aug 22 18:17:02 juju-e4d256-prod-github-runner-207 kernel: [46396.587432] Aug 22 18:17:02 juju-e4d256-prod-github-runner-207 kernel: [46396.588271] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 18:17:02 juju-e4d256-prod-github-runner-207 kernel: [46396.589303] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:17:02 juju-e4d256-prod-github-runner-207 kernel: [46396.590367] ? _raw_spin_lock+0x22/0x30 Aug 22 18:17:02 juju-e4d256-prod-github-runner-207 kernel: [46396.591382] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:17:02 juju-e4d256-prod-github-runner-207 kernel: [46396.592408] direct_page_fault+0x206/0x310 [kvm] Aug 22 18:17:02 juju-e4d256-prod-github-runner-207 kernel: [46396.593431] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 18:17:02 juju-e4d256-prod-github-runner-207 kernel: [46396.594446] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 18:17:02 juju-e4d256-prod-github-runner-207 kernel: [46396.595475] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 18:17:02 juju-e4d256-prod-github-runner-207 kernel: [46396.596476] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 18:17:02 juju-e4d256-prod-github-runner-207 kernel: [46396.597443] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 18:17:02 juju-e4d256-prod-github-runner-207 kernel: [46396.598463] handle_exit+0x98/0x230 [kvm_amd] Aug 22 18:17:02 juju-e4d256-prod-github-runner-207 kernel: [46396.599413] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 18:17:02 juju-e4d256-prod-github-runner-207 kernel: [46396.600352] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 18:17:02 juju-e4d256-prod-github-runner-207 kernel: [46396.601280] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 18:17:02 juju-e4d256-prod-github-runner-207 kernel: [46396.602186] vcpu_run+0x62/0x2c0 [kvm] Aug 22 18:17:02 juju-e4d256-prod-github-runner-207 kernel: [46396.603017] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 18:17:02 juju-e4d256-prod-github-runner-207 kernel: [46396.603840] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 18:17:02 juju-e4d256-prod-github-runner-207 kernel: [46396.604704] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 18:17:02 juju-e4d256-prod-github-runner-207 kernel: [46396.605505] ? __seccomp_filter+0x4a/0x4a0 Aug 22 18:17:02 juju-e4d256-prod-github-runner-207 kernel: [46396.606250] ? __fget_files+0x86/0xc0 Aug 22 18:17:02 juju-e4d256-prod-github-runner-207 kernel: [46396.606960] __x64_sys_ioctl+0x95/0xd0 Aug 22 18:17:02 juju-e4d256-prod-github-runner-207 kernel: [46396.607669] do_syscall_64+0x5c/0xc0 Aug 22 18:17:02 juju-e4d256-prod-github-runner-207 kernel: [46396.608341] ? do_futex+0x162/0x1f0 Aug 22 18:17:02 juju-e4d256-prod-github-runner-207 kernel: [46396.608996] ? __x64_sys_futex+0x78/0x1e0 Aug 22 18:17:02 juju-e4d256-prod-github-runner-207 kernel: [46396.609675] ? __secure_computing+0xa9/0x120 Aug 22 18:17:02 juju-e4d256-prod-github-runner-207 kernel: [46396.610370] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 18:17:02 juju-e4d256-prod-github-runner-207 kernel: [46396.611147] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:17:02 juju-e4d256-prod-github-runner-207 kernel: [46396.611879] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:17:02 juju-e4d256-prod-github-runner-207 kernel: [46396.612604] ? do_syscall_64+0x69/0xc0 Aug 22 18:17:02 juju-e4d256-prod-github-runner-207 kernel: [46396.613341] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:17:02 juju-e4d256-prod-github-runner-207 kernel: [46396.614138] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:17:02 juju-e4d256-prod-github-runner-207 kernel: [46396.614919] ? do_syscall_64+0x69/0xc0 Aug 22 18:17:02 juju-e4d256-prod-github-runner-207 kernel: [46396.615691] ? do_syscall_64+0x69/0xc0 Aug 22 18:17:02 juju-e4d256-prod-github-runner-207 kernel: [46396.616391] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 18:17:02 juju-e4d256-prod-github-runner-207 kernel: [46396.617188] RIP: 0033:0x7faa5d0edaff Aug 22 18:17:02 juju-e4d256-prod-github-runner-207 kernel: [46396.617919] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 18:17:02 juju-e4d256-prod-github-runner-207 kernel: [46396.620279] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 18:17:02 juju-e4d256-prod-github-runner-207 kernel: [46396.621335] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 18:17:02 juju-e4d256-prod-github-runner-207 kernel: [46396.622359] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 18:17:02 juju-e4d256-prod-github-runner-207 kernel: [46396.623408] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 18:17:02 juju-e4d256-prod-github-runner-207 kernel: [46396.624433] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 18:17:02 juju-e4d256-prod-github-runner-207 kernel: [46396.625449] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 18:17:02 juju-e4d256-prod-github-runner-207 kernel: [46396.626488] Aug 22 18:17:30 juju-e4d256-prod-github-runner-207 kernel: [46424.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 43128s! [qemu-system-x86:6715] Aug 22 18:17:30 juju-e4d256-prod-github-runner-207 kernel: [46424.543864] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 18:17:30 juju-e4d256-prod-github-runner-207 kernel: [46424.544046] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 18:17:30 juju-e4d256-prod-github-runner-207 kernel: [46424.556093] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 18:17:30 juju-e4d256-prod-github-runner-207 kernel: [46424.557360] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 18:17:30 juju-e4d256-prod-github-runner-207 kernel: [46424.558639] RIP: 0010:native_queued_spin_lock_slowpath+0xc/0x40 Aug 22 18:17:30 juju-e4d256-prod-github-runner-207 kernel: [46424.559808] Code: fe ff ff eb af 4c 89 fe 48 c7 c7 20 99 e9 89 e8 ca 69 55 00 e9 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 <8b> 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 eb Aug 22 18:17:30 juju-e4d256-prod-github-runner-207 kernel: [46424.562426] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 18:17:30 juju-e4d256-prod-github-runner-207 kernel: [46424.563491] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 18:17:30 juju-e4d256-prod-github-runner-207 kernel: [46424.564655] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 18:17:30 juju-e4d256-prod-github-runner-207 kernel: [46424.565850] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 18:17:30 juju-e4d256-prod-github-runner-207 kernel: [46424.567038] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 18:17:30 juju-e4d256-prod-github-runner-207 kernel: [46424.568200] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 18:17:30 juju-e4d256-prod-github-runner-207 kernel: [46424.569364] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 18:17:30 juju-e4d256-prod-github-runner-207 kernel: [46424.570602] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 18:17:30 juju-e4d256-prod-github-runner-207 kernel: [46424.571714] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 18:17:30 juju-e4d256-prod-github-runner-207 kernel: [46424.572915] Call Trace: Aug 22 18:17:30 juju-e4d256-prod-github-runner-207 kernel: [46424.573834] Aug 22 18:17:30 juju-e4d256-prod-github-runner-207 kernel: [46424.574731] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:17:30 juju-e4d256-prod-github-runner-207 kernel: [46424.575767] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:17:30 juju-e4d256-prod-github-runner-207 kernel: [46424.576795] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:17:30 juju-e4d256-prod-github-runner-207 kernel: [46424.577892] ? show_regs.part.0+0x23/0x29 Aug 22 18:17:30 juju-e4d256-prod-github-runner-207 kernel: [46424.578912] ? show_regs.cold+0x8/0xd Aug 22 18:17:30 juju-e4d256-prod-github-runner-207 kernel: [46424.579941] ? watchdog_timer_fn+0x1be/0x220 Aug 22 18:17:30 juju-e4d256-prod-github-runner-207 kernel: [46424.580951] ? lockup_detector_update_enable+0x60/0x60 Aug 22 18:17:30 juju-e4d256-prod-github-runner-207 kernel: [46424.582012] ? __hrtimer_run_queues+0x107/0x230 Aug 22 18:17:30 juju-e4d256-prod-github-runner-207 kernel: [46424.583048] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 18:17:30 juju-e4d256-prod-github-runner-207 kernel: [46424.584086] ? hrtimer_interrupt+0x101/0x220 Aug 22 18:17:30 juju-e4d256-prod-github-runner-207 kernel: [46424.585108] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 18:17:30 juju-e4d256-prod-github-runner-207 kernel: [46424.586176] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 18:17:30 juju-e4d256-prod-github-runner-207 kernel: [46424.587231] Aug 22 18:17:30 juju-e4d256-prod-github-runner-207 kernel: [46424.588085] Aug 22 18:17:30 juju-e4d256-prod-github-runner-207 kernel: [46424.588919] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 18:17:30 juju-e4d256-prod-github-runner-207 kernel: [46424.589958] ? native_queued_spin_lock_slowpath+0xc/0x40 Aug 22 18:17:30 juju-e4d256-prod-github-runner-207 kernel: [46424.591017] ? _raw_spin_lock+0x22/0x30 Aug 22 18:17:30 juju-e4d256-prod-github-runner-207 kernel: [46424.591965] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:17:30 juju-e4d256-prod-github-runner-207 kernel: [46424.592979] direct_page_fault+0x206/0x310 [kvm] Aug 22 18:17:30 juju-e4d256-prod-github-runner-207 kernel: [46424.594013] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 18:17:30 juju-e4d256-prod-github-runner-207 kernel: [46424.595050] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 18:17:30 juju-e4d256-prod-github-runner-207 kernel: [46424.596052] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 18:17:30 juju-e4d256-prod-github-runner-207 kernel: [46424.597038] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 18:17:30 juju-e4d256-prod-github-runner-207 kernel: [46424.597980] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 18:17:30 juju-e4d256-prod-github-runner-207 kernel: [46424.598966] handle_exit+0x98/0x230 [kvm_amd] Aug 22 18:17:30 juju-e4d256-prod-github-runner-207 kernel: [46424.599860] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 18:17:30 juju-e4d256-prod-github-runner-207 kernel: [46424.600775] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 18:17:30 juju-e4d256-prod-github-runner-207 kernel: [46424.601710] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 18:17:30 juju-e4d256-prod-github-runner-207 kernel: [46424.602652] vcpu_run+0x62/0x2c0 [kvm] Aug 22 18:17:30 juju-e4d256-prod-github-runner-207 kernel: [46424.603472] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 18:17:30 juju-e4d256-prod-github-runner-207 kernel: [46424.604283] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 18:17:30 juju-e4d256-prod-github-runner-207 kernel: [46424.605138] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 18:17:30 juju-e4d256-prod-github-runner-207 kernel: [46424.605951] ? __seccomp_filter+0x4a/0x4a0 Aug 22 18:17:30 juju-e4d256-prod-github-runner-207 kernel: [46424.606711] ? __fget_files+0x86/0xc0 Aug 22 18:17:30 juju-e4d256-prod-github-runner-207 kernel: [46424.607412] __x64_sys_ioctl+0x95/0xd0 Aug 22 18:17:30 juju-e4d256-prod-github-runner-207 kernel: [46424.608203] do_syscall_64+0x5c/0xc0 Aug 22 18:17:30 juju-e4d256-prod-github-runner-207 kernel: [46424.608865] ? do_futex+0x162/0x1f0 Aug 22 18:17:30 juju-e4d256-prod-github-runner-207 kernel: [46424.609508] ? __x64_sys_futex+0x78/0x1e0 Aug 22 18:17:30 juju-e4d256-prod-github-runner-207 kernel: [46424.610200] ? __secure_computing+0xa9/0x120 Aug 22 18:17:30 juju-e4d256-prod-github-runner-207 kernel: [46424.610905] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 18:17:30 juju-e4d256-prod-github-runner-207 kernel: [46424.611661] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:17:30 juju-e4d256-prod-github-runner-207 kernel: [46424.612380] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:17:30 juju-e4d256-prod-github-runner-207 kernel: [46424.613191] ? do_syscall_64+0x69/0xc0 Aug 22 18:17:30 juju-e4d256-prod-github-runner-207 kernel: [46424.613844] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:17:30 juju-e4d256-prod-github-runner-207 kernel: [46424.614545] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:17:30 juju-e4d256-prod-github-runner-207 kernel: [46424.615259] ? do_syscall_64+0x69/0xc0 Aug 22 18:17:30 juju-e4d256-prod-github-runner-207 kernel: [46424.615883] ? do_syscall_64+0x69/0xc0 Aug 22 18:17:30 juju-e4d256-prod-github-runner-207 kernel: [46424.616512] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 18:17:30 juju-e4d256-prod-github-runner-207 kernel: [46424.617233] RIP: 0033:0x7faa5d0edaff Aug 22 18:17:30 juju-e4d256-prod-github-runner-207 kernel: [46424.617870] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 18:17:30 juju-e4d256-prod-github-runner-207 kernel: [46424.619868] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 18:17:30 juju-e4d256-prod-github-runner-207 kernel: [46424.620777] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 18:17:30 juju-e4d256-prod-github-runner-207 kernel: [46424.621670] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 18:17:30 juju-e4d256-prod-github-runner-207 kernel: [46424.622586] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 18:17:30 juju-e4d256-prod-github-runner-207 kernel: [46424.623501] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 18:17:30 juju-e4d256-prod-github-runner-207 kernel: [46424.624388] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 18:17:30 juju-e4d256-prod-github-runner-207 kernel: [46424.625278] Aug 22 18:17:46 juju-e4d256-prod-github-runner-207 kernel: [46440.284708] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 18:17:46 juju-e4d256-prod-github-runner-207 kernel: [46440.285679] rcu: 1-....: (11544464 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=5586940 Aug 22 18:17:46 juju-e4d256-prod-github-runner-207 kernel: [46440.286845] (t=11580771 jiffies g=23269 q=45349) Aug 22 18:17:46 juju-e4d256-prod-github-runner-207 kernel: [46440.287630] NMI backtrace for cpu 1 Aug 22 18:17:46 juju-e4d256-prod-github-runner-207 kernel: [46440.288338] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 18:17:46 juju-e4d256-prod-github-runner-207 kernel: [46440.289441] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 18:17:46 juju-e4d256-prod-github-runner-207 kernel: [46440.290507] Call Trace: Aug 22 18:17:46 juju-e4d256-prod-github-runner-207 kernel: [46440.291180] Aug 22 18:17:46 juju-e4d256-prod-github-runner-207 kernel: [46440.291828] show_stack+0x52/0x5c Aug 22 18:17:46 juju-e4d256-prod-github-runner-207 kernel: [46440.292549] dump_stack_lvl+0x4a/0x63 Aug 22 18:17:46 juju-e4d256-prod-github-runner-207 kernel: [46440.293292] dump_stack+0x10/0x16 Aug 22 18:17:46 juju-e4d256-prod-github-runner-207 kernel: [46440.294007] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 18:17:46 juju-e4d256-prod-github-runner-207 kernel: [46440.294802] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 18:17:46 juju-e4d256-prod-github-runner-207 kernel: [46440.295580] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 18:17:46 juju-e4d256-prod-github-runner-207 kernel: [46440.296403] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 18:17:46 juju-e4d256-prod-github-runner-207 kernel: [46440.297221] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 18:17:46 juju-e4d256-prod-github-runner-207 kernel: [46440.298027] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 18:17:46 juju-e4d256-prod-github-runner-207 kernel: [46440.298808] print_cpu_stall.cold+0x2f/0xe2 Aug 22 18:17:46 juju-e4d256-prod-github-runner-207 kernel: [46440.299572] ? timekeeping_update+0xf7/0x150 Aug 22 18:17:46 juju-e4d256-prod-github-runner-207 kernel: [46440.300340] check_cpu_stall+0x109/0x270 Aug 22 18:17:46 juju-e4d256-prod-github-runner-207 kernel: [46440.301085] rcu_sched_clock_irq+0x9a/0x250 Aug 22 18:17:46 juju-e4d256-prod-github-runner-207 kernel: [46440.301844] update_process_times+0x94/0xd0 Aug 22 18:17:46 juju-e4d256-prod-github-runner-207 kernel: [46440.302620] tick_sched_handle+0x29/0x70 Aug 22 18:17:46 juju-e4d256-prod-github-runner-207 kernel: [46440.303365] tick_sched_timer+0x8c/0xc0 Aug 22 18:17:46 juju-e4d256-prod-github-runner-207 kernel: [46440.304101] ? tick_nohz_handler+0xb0/0xb0 Aug 22 18:17:46 juju-e4d256-prod-github-runner-207 kernel: [46440.304864] __hrtimer_run_queues+0x107/0x230 Aug 22 18:17:46 juju-e4d256-prod-github-runner-207 kernel: [46440.305638] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 18:17:46 juju-e4d256-prod-github-runner-207 kernel: [46440.306457] hrtimer_interrupt+0x101/0x220 Aug 22 18:17:46 juju-e4d256-prod-github-runner-207 kernel: [46440.307229] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 18:17:46 juju-e4d256-prod-github-runner-207 kernel: [46440.308095] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 18:17:46 juju-e4d256-prod-github-runner-207 kernel: [46440.308915] Aug 22 18:17:46 juju-e4d256-prod-github-runner-207 kernel: [46440.309552] Aug 22 18:17:46 juju-e4d256-prod-github-runner-207 kernel: [46440.310180] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 18:17:46 juju-e4d256-prod-github-runner-207 kernel: [46440.311169] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:17:46 juju-e4d256-prod-github-runner-207 kernel: [46440.312160] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 18:17:46 juju-e4d256-prod-github-runner-207 kernel: [46440.314726] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 18:17:46 juju-e4d256-prod-github-runner-207 kernel: [46440.315708] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 18:17:46 juju-e4d256-prod-github-runner-207 kernel: [46440.316840] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 18:17:46 juju-e4d256-prod-github-runner-207 kernel: [46440.317943] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 18:17:46 juju-e4d256-prod-github-runner-207 kernel: [46440.319050] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 18:17:46 juju-e4d256-prod-github-runner-207 kernel: [46440.320142] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 18:17:46 juju-e4d256-prod-github-runner-207 kernel: [46440.321243] ? _raw_spin_lock+0x22/0x30 Aug 22 18:17:46 juju-e4d256-prod-github-runner-207 kernel: [46440.322091] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:17:46 juju-e4d256-prod-github-runner-207 kernel: [46440.323042] direct_page_fault+0x206/0x310 [kvm] Aug 22 18:17:46 juju-e4d256-prod-github-runner-207 kernel: [46440.323976] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 18:17:46 juju-e4d256-prod-github-runner-207 kernel: [46440.324887] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 18:17:46 juju-e4d256-prod-github-runner-207 kernel: [46440.325832] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 18:17:46 juju-e4d256-prod-github-runner-207 kernel: [46440.326753] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 18:17:46 juju-e4d256-prod-github-runner-207 kernel: [46440.327634] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 18:17:46 juju-e4d256-prod-github-runner-207 kernel: [46440.328564] handle_exit+0x98/0x230 [kvm_amd] Aug 22 18:17:46 juju-e4d256-prod-github-runner-207 kernel: [46440.329405] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 18:17:46 juju-e4d256-prod-github-runner-207 kernel: [46440.330275] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 18:17:46 juju-e4d256-prod-github-runner-207 kernel: [46440.331190] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 18:17:46 juju-e4d256-prod-github-runner-207 kernel: [46440.332072] vcpu_run+0x62/0x2c0 [kvm] Aug 22 18:17:46 juju-e4d256-prod-github-runner-207 kernel: [46440.332893] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 18:17:46 juju-e4d256-prod-github-runner-207 kernel: [46440.333714] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 18:17:46 juju-e4d256-prod-github-runner-207 kernel: [46440.334643] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 18:17:46 juju-e4d256-prod-github-runner-207 kernel: [46440.335505] ? __seccomp_filter+0x4a/0x4a0 Aug 22 18:17:46 juju-e4d256-prod-github-runner-207 kernel: [46440.336312] ? __fget_files+0x86/0xc0 Aug 22 18:17:46 juju-e4d256-prod-github-runner-207 kernel: [46440.337124] __x64_sys_ioctl+0x95/0xd0 Aug 22 18:17:46 juju-e4d256-prod-github-runner-207 kernel: [46440.337894] do_syscall_64+0x5c/0xc0 Aug 22 18:17:46 juju-e4d256-prod-github-runner-207 kernel: [46440.338702] ? do_futex+0x162/0x1f0 Aug 22 18:17:46 juju-e4d256-prod-github-runner-207 kernel: [46440.339449] ? __x64_sys_futex+0x78/0x1e0 Aug 22 18:17:46 juju-e4d256-prod-github-runner-207 kernel: [46440.340235] ? __secure_computing+0xa9/0x120 Aug 22 18:17:46 juju-e4d256-prod-github-runner-207 kernel: [46440.341039] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 18:17:46 juju-e4d256-prod-github-runner-207 kernel: [46440.341927] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:17:46 juju-e4d256-prod-github-runner-207 kernel: [46440.342785] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:17:46 juju-e4d256-prod-github-runner-207 kernel: [46440.343629] ? do_syscall_64+0x69/0xc0 Aug 22 18:17:46 juju-e4d256-prod-github-runner-207 kernel: [46440.344393] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:17:46 juju-e4d256-prod-github-runner-207 kernel: [46440.345238] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:17:46 juju-e4d256-prod-github-runner-207 kernel: [46440.346086] ? do_syscall_64+0x69/0xc0 Aug 22 18:17:46 juju-e4d256-prod-github-runner-207 kernel: [46440.346870] ? do_syscall_64+0x69/0xc0 Aug 22 18:17:46 juju-e4d256-prod-github-runner-207 kernel: [46440.347634] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 18:17:46 juju-e4d256-prod-github-runner-207 kernel: [46440.348499] RIP: 0033:0x7faa5d0edaff Aug 22 18:17:46 juju-e4d256-prod-github-runner-207 kernel: [46440.349259] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 18:17:46 juju-e4d256-prod-github-runner-207 kernel: [46440.351715] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 18:17:46 juju-e4d256-prod-github-runner-207 kernel: [46440.352819] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 18:17:46 juju-e4d256-prod-github-runner-207 kernel: [46440.353896] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 18:17:46 juju-e4d256-prod-github-runner-207 kernel: [46440.354982] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 18:17:46 juju-e4d256-prod-github-runner-207 kernel: [46440.356064] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 18:17:46 juju-e4d256-prod-github-runner-207 kernel: [46440.357121] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 18:17:46 juju-e4d256-prod-github-runner-207 kernel: [46440.358167] Aug 22 18:18:10 juju-e4d256-prod-github-runner-207 kernel: [46464.541981] watchdog: BUG: soft lockup - CPU#1 stuck for 43165s! [qemu-system-x86:6715] Aug 22 18:18:10 juju-e4d256-prod-github-runner-207 kernel: [46464.543140] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 18:18:10 juju-e4d256-prod-github-runner-207 kernel: [46464.543214] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 18:18:10 juju-e4d256-prod-github-runner-207 kernel: [46464.555554] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 18:18:10 juju-e4d256-prod-github-runner-207 kernel: [46464.556839] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 18:18:10 juju-e4d256-prod-github-runner-207 kernel: [46464.558067] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:18:10 juju-e4d256-prod-github-runner-207 kernel: [46464.559300] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 18:18:10 juju-e4d256-prod-github-runner-207 kernel: [46464.562254] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 18:18:10 juju-e4d256-prod-github-runner-207 kernel: [46464.563421] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 18:18:10 juju-e4d256-prod-github-runner-207 kernel: [46464.564725] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 18:18:10 juju-e4d256-prod-github-runner-207 kernel: [46464.566022] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 18:18:10 juju-e4d256-prod-github-runner-207 kernel: [46464.567287] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 18:18:10 juju-e4d256-prod-github-runner-207 kernel: [46464.568630] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 18:18:10 juju-e4d256-prod-github-runner-207 kernel: [46464.569942] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 18:18:10 juju-e4d256-prod-github-runner-207 kernel: [46464.571358] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 18:18:10 juju-e4d256-prod-github-runner-207 kernel: [46464.572608] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 18:18:10 juju-e4d256-prod-github-runner-207 kernel: [46464.573967] Call Trace: Aug 22 18:18:10 juju-e4d256-prod-github-runner-207 kernel: [46464.574966] Aug 22 18:18:10 juju-e4d256-prod-github-runner-207 kernel: [46464.575898] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:18:10 juju-e4d256-prod-github-runner-207 kernel: [46464.577016] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:18:10 juju-e4d256-prod-github-runner-207 kernel: [46464.578219] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:18:10 juju-e4d256-prod-github-runner-207 kernel: [46464.579418] ? show_regs.part.0+0x23/0x29 Aug 22 18:18:10 juju-e4d256-prod-github-runner-207 kernel: [46464.580504] ? show_regs.cold+0x8/0xd Aug 22 18:18:10 juju-e4d256-prod-github-runner-207 kernel: [46464.581564] ? watchdog_timer_fn+0x1be/0x220 Aug 22 18:18:10 juju-e4d256-prod-github-runner-207 kernel: [46464.582699] ? lockup_detector_update_enable+0x60/0x60 Aug 22 18:18:10 juju-e4d256-prod-github-runner-207 kernel: [46464.583893] ? __hrtimer_run_queues+0x107/0x230 Aug 22 18:18:10 juju-e4d256-prod-github-runner-207 kernel: [46464.585019] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 18:18:10 juju-e4d256-prod-github-runner-207 kernel: [46464.586157] ? hrtimer_interrupt+0x101/0x220 Aug 22 18:18:10 juju-e4d256-prod-github-runner-207 kernel: [46464.587261] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 18:18:10 juju-e4d256-prod-github-runner-207 kernel: [46464.588434] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 18:18:10 juju-e4d256-prod-github-runner-207 kernel: [46464.589773] Aug 22 18:18:10 juju-e4d256-prod-github-runner-207 kernel: [46464.590710] Aug 22 18:18:10 juju-e4d256-prod-github-runner-207 kernel: [46464.591600] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 18:18:10 juju-e4d256-prod-github-runner-207 kernel: [46464.592738] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:18:10 juju-e4d256-prod-github-runner-207 kernel: [46464.593888] ? _raw_spin_lock+0x22/0x30 Aug 22 18:18:10 juju-e4d256-prod-github-runner-207 kernel: [46464.594931] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:18:10 juju-e4d256-prod-github-runner-207 kernel: [46464.596043] direct_page_fault+0x206/0x310 [kvm] Aug 22 18:18:10 juju-e4d256-prod-github-runner-207 kernel: [46464.597361] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 18:18:10 juju-e4d256-prod-github-runner-207 kernel: [46464.598480] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 18:18:10 juju-e4d256-prod-github-runner-207 kernel: [46464.599582] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 18:18:10 juju-e4d256-prod-github-runner-207 kernel: [46464.600658] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 18:18:10 juju-e4d256-prod-github-runner-207 kernel: [46464.601706] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 18:18:10 juju-e4d256-prod-github-runner-207 kernel: [46464.602821] handle_exit+0x98/0x230 [kvm_amd] Aug 22 18:18:10 juju-e4d256-prod-github-runner-207 kernel: [46464.603808] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 18:18:10 juju-e4d256-prod-github-runner-207 kernel: [46464.604827] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 18:18:10 juju-e4d256-prod-github-runner-207 kernel: [46464.605858] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 18:18:10 juju-e4d256-prod-github-runner-207 kernel: [46464.606894] vcpu_run+0x62/0x2c0 [kvm] Aug 22 18:18:10 juju-e4d256-prod-github-runner-207 kernel: [46464.607785] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 18:18:10 juju-e4d256-prod-github-runner-207 kernel: [46464.608687] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 18:18:10 juju-e4d256-prod-github-runner-207 kernel: [46464.609652] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 18:18:10 juju-e4d256-prod-github-runner-207 kernel: [46464.610563] ? __seccomp_filter+0x4a/0x4a0 Aug 22 18:18:10 juju-e4d256-prod-github-runner-207 kernel: [46464.611396] ? __fget_files+0x86/0xc0 Aug 22 18:18:10 juju-e4d256-prod-github-runner-207 kernel: [46464.612187] __x64_sys_ioctl+0x95/0xd0 Aug 22 18:18:10 juju-e4d256-prod-github-runner-207 kernel: [46464.612968] do_syscall_64+0x5c/0xc0 Aug 22 18:18:10 juju-e4d256-prod-github-runner-207 kernel: [46464.613727] ? do_futex+0x162/0x1f0 Aug 22 18:18:10 juju-e4d256-prod-github-runner-207 kernel: [46464.614462] ? __x64_sys_futex+0x78/0x1e0 Aug 22 18:18:10 juju-e4d256-prod-github-runner-207 kernel: [46464.615222] ? __secure_computing+0xa9/0x120 Aug 22 18:18:10 juju-e4d256-prod-github-runner-207 kernel: [46464.616000] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 18:18:10 juju-e4d256-prod-github-runner-207 kernel: [46464.616862] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:18:10 juju-e4d256-prod-github-runner-207 kernel: [46464.617675] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:18:10 juju-e4d256-prod-github-runner-207 kernel: [46464.618511] ? do_syscall_64+0x69/0xc0 Aug 22 18:18:10 juju-e4d256-prod-github-runner-207 kernel: [46464.619246] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:18:10 juju-e4d256-prod-github-runner-207 kernel: [46464.620073] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:18:10 juju-e4d256-prod-github-runner-207 kernel: [46464.620864] ? do_syscall_64+0x69/0xc0 Aug 22 18:18:10 juju-e4d256-prod-github-runner-207 kernel: [46464.621570] ? do_syscall_64+0x69/0xc0 Aug 22 18:18:10 juju-e4d256-prod-github-runner-207 kernel: [46464.622307] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 18:18:10 juju-e4d256-prod-github-runner-207 kernel: [46464.623119] RIP: 0033:0x7faa5d0edaff Aug 22 18:18:10 juju-e4d256-prod-github-runner-207 kernel: [46464.623820] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 18:18:10 juju-e4d256-prod-github-runner-207 kernel: [46464.626177] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 18:18:10 juju-e4d256-prod-github-runner-207 kernel: [46464.627241] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 18:18:10 juju-e4d256-prod-github-runner-207 kernel: [46464.628273] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 18:18:10 juju-e4d256-prod-github-runner-207 kernel: [46464.629299] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 18:18:10 juju-e4d256-prod-github-runner-207 kernel: [46464.630348] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 18:18:10 juju-e4d256-prod-github-runner-207 kernel: [46464.631371] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 18:18:10 juju-e4d256-prod-github-runner-207 kernel: [46464.632407] Aug 22 18:18:38 juju-e4d256-prod-github-runner-207 kernel: [46492.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 43191s! [qemu-system-x86:6715] Aug 22 18:18:38 juju-e4d256-prod-github-runner-207 kernel: [46492.543865] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 18:18:38 juju-e4d256-prod-github-runner-207 kernel: [46492.544178] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 18:18:38 juju-e4d256-prod-github-runner-207 kernel: [46492.556286] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 18:18:38 juju-e4d256-prod-github-runner-207 kernel: [46492.557549] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 18:18:38 juju-e4d256-prod-github-runner-207 kernel: [46492.558779] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:18:38 juju-e4d256-prod-github-runner-207 kernel: [46492.559840] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 18:18:38 juju-e4d256-prod-github-runner-207 kernel: [46492.562410] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 18:18:38 juju-e4d256-prod-github-runner-207 kernel: [46492.563452] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 18:18:38 juju-e4d256-prod-github-runner-207 kernel: [46492.564626] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 18:18:38 juju-e4d256-prod-github-runner-207 kernel: [46492.565806] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 18:18:38 juju-e4d256-prod-github-runner-207 kernel: [46492.566973] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 18:18:38 juju-e4d256-prod-github-runner-207 kernel: [46492.568149] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 18:18:38 juju-e4d256-prod-github-runner-207 kernel: [46492.569317] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 18:18:38 juju-e4d256-prod-github-runner-207 kernel: [46492.570563] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 18:18:38 juju-e4d256-prod-github-runner-207 kernel: [46492.571666] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 18:18:38 juju-e4d256-prod-github-runner-207 kernel: [46492.572859] Call Trace: Aug 22 18:18:38 juju-e4d256-prod-github-runner-207 kernel: [46492.573781] Aug 22 18:18:38 juju-e4d256-prod-github-runner-207 kernel: [46492.574709] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:18:38 juju-e4d256-prod-github-runner-207 kernel: [46492.575754] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:18:38 juju-e4d256-prod-github-runner-207 kernel: [46492.576791] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:18:38 juju-e4d256-prod-github-runner-207 kernel: [46492.578007] ? show_regs.part.0+0x23/0x29 Aug 22 18:18:38 juju-e4d256-prod-github-runner-207 kernel: [46492.579113] ? show_regs.cold+0x8/0xd Aug 22 18:18:38 juju-e4d256-prod-github-runner-207 kernel: [46492.580166] ? watchdog_timer_fn+0x1be/0x220 Aug 22 18:18:38 juju-e4d256-prod-github-runner-207 kernel: [46492.581201] ? lockup_detector_update_enable+0x60/0x60 Aug 22 18:18:38 juju-e4d256-prod-github-runner-207 kernel: [46492.582291] ? __hrtimer_run_queues+0x107/0x230 Aug 22 18:18:38 juju-e4d256-prod-github-runner-207 kernel: [46492.583320] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 18:18:38 juju-e4d256-prod-github-runner-207 kernel: [46492.584349] ? hrtimer_interrupt+0x101/0x220 Aug 22 18:18:38 juju-e4d256-prod-github-runner-207 kernel: [46492.585368] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 18:18:38 juju-e4d256-prod-github-runner-207 kernel: [46492.586446] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 18:18:38 juju-e4d256-prod-github-runner-207 kernel: [46492.587562] Aug 22 18:18:38 juju-e4d256-prod-github-runner-207 kernel: [46492.588439] Aug 22 18:18:38 juju-e4d256-prod-github-runner-207 kernel: [46492.589276] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 18:18:38 juju-e4d256-prod-github-runner-207 kernel: [46492.590317] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:18:38 juju-e4d256-prod-github-runner-207 kernel: [46492.591355] ? _raw_spin_lock+0x22/0x30 Aug 22 18:18:38 juju-e4d256-prod-github-runner-207 kernel: [46492.592299] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:18:38 juju-e4d256-prod-github-runner-207 kernel: [46492.593322] direct_page_fault+0x206/0x310 [kvm] Aug 22 18:18:38 juju-e4d256-prod-github-runner-207 kernel: [46492.594356] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 18:18:38 juju-e4d256-prod-github-runner-207 kernel: [46492.595365] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 18:18:38 juju-e4d256-prod-github-runner-207 kernel: [46492.596369] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 18:18:38 juju-e4d256-prod-github-runner-207 kernel: [46492.597370] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 18:18:38 juju-e4d256-prod-github-runner-207 kernel: [46492.598338] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 18:18:38 juju-e4d256-prod-github-runner-207 kernel: [46492.599315] handle_exit+0x98/0x230 [kvm_amd] Aug 22 18:18:38 juju-e4d256-prod-github-runner-207 kernel: [46492.600246] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 18:18:38 juju-e4d256-prod-github-runner-207 kernel: [46492.601185] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 18:18:38 juju-e4d256-prod-github-runner-207 kernel: [46492.602139] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 18:18:38 juju-e4d256-prod-github-runner-207 kernel: [46492.603058] vcpu_run+0x62/0x2c0 [kvm] Aug 22 18:18:38 juju-e4d256-prod-github-runner-207 kernel: [46492.603875] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 18:18:38 juju-e4d256-prod-github-runner-207 kernel: [46492.604707] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 18:18:38 juju-e4d256-prod-github-runner-207 kernel: [46492.605583] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 18:18:38 juju-e4d256-prod-github-runner-207 kernel: [46492.606450] ? __seccomp_filter+0x4a/0x4a0 Aug 22 18:18:38 juju-e4d256-prod-github-runner-207 kernel: [46492.607196] ? __fget_files+0x86/0xc0 Aug 22 18:18:38 juju-e4d256-prod-github-runner-207 kernel: [46492.607902] __x64_sys_ioctl+0x95/0xd0 Aug 22 18:18:38 juju-e4d256-prod-github-runner-207 kernel: [46492.608643] do_syscall_64+0x5c/0xc0 Aug 22 18:18:38 juju-e4d256-prod-github-runner-207 kernel: [46492.609332] ? do_futex+0x162/0x1f0 Aug 22 18:18:38 juju-e4d256-prod-github-runner-207 kernel: [46492.610031] ? __x64_sys_futex+0x78/0x1e0 Aug 22 18:18:38 juju-e4d256-prod-github-runner-207 kernel: [46492.610730] ? __secure_computing+0xa9/0x120 Aug 22 18:18:38 juju-e4d256-prod-github-runner-207 kernel: [46492.611452] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 18:18:38 juju-e4d256-prod-github-runner-207 kernel: [46492.612236] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:18:38 juju-e4d256-prod-github-runner-207 kernel: [46492.612965] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:18:38 juju-e4d256-prod-github-runner-207 kernel: [46492.613692] ? do_syscall_64+0x69/0xc0 Aug 22 18:18:38 juju-e4d256-prod-github-runner-207 kernel: [46492.614425] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:18:38 juju-e4d256-prod-github-runner-207 kernel: [46492.615149] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:18:38 juju-e4d256-prod-github-runner-207 kernel: [46492.615947] ? do_syscall_64+0x69/0xc0 Aug 22 18:18:38 juju-e4d256-prod-github-runner-207 kernel: [46492.616600] ? do_syscall_64+0x69/0xc0 Aug 22 18:18:38 juju-e4d256-prod-github-runner-207 kernel: [46492.617228] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 18:18:38 juju-e4d256-prod-github-runner-207 kernel: [46492.618024] RIP: 0033:0x7faa5d0edaff Aug 22 18:18:38 juju-e4d256-prod-github-runner-207 kernel: [46492.618784] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 18:18:38 juju-e4d256-prod-github-runner-207 kernel: [46492.620843] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 18:18:38 juju-e4d256-prod-github-runner-207 kernel: [46492.621810] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 18:18:38 juju-e4d256-prod-github-runner-207 kernel: [46492.622707] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 18:18:38 juju-e4d256-prod-github-runner-207 kernel: [46492.623593] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 18:18:38 juju-e4d256-prod-github-runner-207 kernel: [46492.624489] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 18:18:38 juju-e4d256-prod-github-runner-207 kernel: [46492.625431] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 18:18:38 juju-e4d256-prod-github-runner-207 kernel: [46492.626356] Aug 22 18:19:06 juju-e4d256-prod-github-runner-207 kernel: [46520.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 43217s! [qemu-system-x86:6715] Aug 22 18:19:06 juju-e4d256-prod-github-runner-207 kernel: [46520.543883] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 18:19:06 juju-e4d256-prod-github-runner-207 kernel: [46520.544228] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 18:19:06 juju-e4d256-prod-github-runner-207 kernel: [46520.557169] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 18:19:06 juju-e4d256-prod-github-runner-207 kernel: [46520.558507] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 18:19:06 juju-e4d256-prod-github-runner-207 kernel: [46520.559756] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:19:06 juju-e4d256-prod-github-runner-207 kernel: [46520.560823] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 18:19:06 juju-e4d256-prod-github-runner-207 kernel: [46520.563392] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 18:19:06 juju-e4d256-prod-github-runner-207 kernel: [46520.564438] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 18:19:06 juju-e4d256-prod-github-runner-207 kernel: [46520.565616] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 18:19:06 juju-e4d256-prod-github-runner-207 kernel: [46520.566773] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 18:19:06 juju-e4d256-prod-github-runner-207 kernel: [46520.567929] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 18:19:06 juju-e4d256-prod-github-runner-207 kernel: [46520.569139] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 18:19:06 juju-e4d256-prod-github-runner-207 kernel: [46520.570421] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 18:19:06 juju-e4d256-prod-github-runner-207 kernel: [46520.571739] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 18:19:06 juju-e4d256-prod-github-runner-207 kernel: [46520.572849] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 18:19:06 juju-e4d256-prod-github-runner-207 kernel: [46520.574104] Call Trace: Aug 22 18:19:06 juju-e4d256-prod-github-runner-207 kernel: [46520.575198] Aug 22 18:19:06 juju-e4d256-prod-github-runner-207 kernel: [46520.576116] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:19:06 juju-e4d256-prod-github-runner-207 kernel: [46520.577180] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:19:06 juju-e4d256-prod-github-runner-207 kernel: [46520.578228] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:19:06 juju-e4d256-prod-github-runner-207 kernel: [46520.579333] ? show_regs.part.0+0x23/0x29 Aug 22 18:19:06 juju-e4d256-prod-github-runner-207 kernel: [46520.580330] ? show_regs.cold+0x8/0xd Aug 22 18:19:06 juju-e4d256-prod-github-runner-207 kernel: [46520.581324] ? watchdog_timer_fn+0x1be/0x220 Aug 22 18:19:06 juju-e4d256-prod-github-runner-207 kernel: [46520.582423] ? lockup_detector_update_enable+0x60/0x60 Aug 22 18:19:06 juju-e4d256-prod-github-runner-207 kernel: [46520.583696] ? __hrtimer_run_queues+0x107/0x230 Aug 22 18:19:06 juju-e4d256-prod-github-runner-207 kernel: [46520.584748] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 18:19:06 juju-e4d256-prod-github-runner-207 kernel: [46520.585805] ? hrtimer_interrupt+0x101/0x220 Aug 22 18:19:06 juju-e4d256-prod-github-runner-207 kernel: [46520.586822] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 18:19:06 juju-e4d256-prod-github-runner-207 kernel: [46520.588051] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 18:19:06 juju-e4d256-prod-github-runner-207 kernel: [46520.589132] Aug 22 18:19:06 juju-e4d256-prod-github-runner-207 kernel: [46520.590018] Aug 22 18:19:06 juju-e4d256-prod-github-runner-207 kernel: [46520.590857] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 18:19:06 juju-e4d256-prod-github-runner-207 kernel: [46520.591892] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:19:06 juju-e4d256-prod-github-runner-207 kernel: [46520.592932] ? _raw_spin_lock+0x22/0x30 Aug 22 18:19:06 juju-e4d256-prod-github-runner-207 kernel: [46520.593891] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:19:06 juju-e4d256-prod-github-runner-207 kernel: [46520.594927] direct_page_fault+0x206/0x310 [kvm] Aug 22 18:19:06 juju-e4d256-prod-github-runner-207 kernel: [46520.595968] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 18:19:06 juju-e4d256-prod-github-runner-207 kernel: [46520.597014] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 18:19:06 juju-e4d256-prod-github-runner-207 kernel: [46520.598052] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 18:19:06 juju-e4d256-prod-github-runner-207 kernel: [46520.599074] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 18:19:06 juju-e4d256-prod-github-runner-207 kernel: [46520.600024] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 18:19:06 juju-e4d256-prod-github-runner-207 kernel: [46520.601025] handle_exit+0x98/0x230 [kvm_amd] Aug 22 18:19:06 juju-e4d256-prod-github-runner-207 kernel: [46520.601958] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 18:19:06 juju-e4d256-prod-github-runner-207 kernel: [46520.602898] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 18:19:06 juju-e4d256-prod-github-runner-207 kernel: [46520.603838] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 18:19:06 juju-e4d256-prod-github-runner-207 kernel: [46520.604739] vcpu_run+0x62/0x2c0 [kvm] Aug 22 18:19:06 juju-e4d256-prod-github-runner-207 kernel: [46520.605573] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 18:19:06 juju-e4d256-prod-github-runner-207 kernel: [46520.606403] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 18:19:06 juju-e4d256-prod-github-runner-207 kernel: [46520.607266] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 18:19:06 juju-e4d256-prod-github-runner-207 kernel: [46520.608063] ? __seccomp_filter+0x4a/0x4a0 Aug 22 18:19:06 juju-e4d256-prod-github-runner-207 kernel: [46520.608803] ? __fget_files+0x86/0xc0 Aug 22 18:19:06 juju-e4d256-prod-github-runner-207 kernel: [46520.609526] __x64_sys_ioctl+0x95/0xd0 Aug 22 18:19:06 juju-e4d256-prod-github-runner-207 kernel: [46520.610216] do_syscall_64+0x5c/0xc0 Aug 22 18:19:06 juju-e4d256-prod-github-runner-207 kernel: [46520.610890] ? do_futex+0x162/0x1f0 Aug 22 18:19:06 juju-e4d256-prod-github-runner-207 kernel: [46520.611536] ? __x64_sys_futex+0x78/0x1e0 Aug 22 18:19:06 juju-e4d256-prod-github-runner-207 kernel: [46520.612249] ? __secure_computing+0xa9/0x120 Aug 22 18:19:06 juju-e4d256-prod-github-runner-207 kernel: [46520.612946] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 18:19:06 juju-e4d256-prod-github-runner-207 kernel: [46520.613732] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:19:06 juju-e4d256-prod-github-runner-207 kernel: [46520.614462] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:19:06 juju-e4d256-prod-github-runner-207 kernel: [46520.615177] ? do_syscall_64+0x69/0xc0 Aug 22 18:19:06 juju-e4d256-prod-github-runner-207 kernel: [46520.615818] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:19:06 juju-e4d256-prod-github-runner-207 kernel: [46520.616517] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:19:06 juju-e4d256-prod-github-runner-207 kernel: [46520.617213] ? do_syscall_64+0x69/0xc0 Aug 22 18:19:06 juju-e4d256-prod-github-runner-207 kernel: [46520.617898] ? do_syscall_64+0x69/0xc0 Aug 22 18:19:06 juju-e4d256-prod-github-runner-207 kernel: [46520.618529] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 18:19:06 juju-e4d256-prod-github-runner-207 kernel: [46520.619244] RIP: 0033:0x7faa5d0edaff Aug 22 18:19:06 juju-e4d256-prod-github-runner-207 kernel: [46520.619919] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 18:19:06 juju-e4d256-prod-github-runner-207 kernel: [46520.621935] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 18:19:06 juju-e4d256-prod-github-runner-207 kernel: [46520.622845] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 18:19:06 juju-e4d256-prod-github-runner-207 kernel: [46520.623744] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 18:19:06 juju-e4d256-prod-github-runner-207 kernel: [46520.624647] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 18:19:06 juju-e4d256-prod-github-runner-207 kernel: [46520.625591] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 18:19:06 juju-e4d256-prod-github-runner-207 kernel: [46520.626491] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 18:19:06 juju-e4d256-prod-github-runner-207 kernel: [46520.627380] Aug 22 18:19:34 juju-e4d256-prod-github-runner-207 kernel: [46548.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 43243s! [qemu-system-x86:6715] Aug 22 18:19:34 juju-e4d256-prod-github-runner-207 kernel: [46548.543841] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 18:19:34 juju-e4d256-prod-github-runner-207 kernel: [46548.544170] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 18:19:34 juju-e4d256-prod-github-runner-207 kernel: [46548.556657] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 18:19:34 juju-e4d256-prod-github-runner-207 kernel: [46548.557950] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 18:19:34 juju-e4d256-prod-github-runner-207 kernel: [46548.559166] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:19:34 juju-e4d256-prod-github-runner-207 kernel: [46548.560220] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 18:19:34 juju-e4d256-prod-github-runner-207 kernel: [46548.562800] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 18:19:34 juju-e4d256-prod-github-runner-207 kernel: [46548.563855] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 18:19:34 juju-e4d256-prod-github-runner-207 kernel: [46548.565055] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 18:19:34 juju-e4d256-prod-github-runner-207 kernel: [46548.566275] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 18:19:34 juju-e4d256-prod-github-runner-207 kernel: [46548.567450] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 18:19:34 juju-e4d256-prod-github-runner-207 kernel: [46548.568608] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 18:19:34 juju-e4d256-prod-github-runner-207 kernel: [46548.569791] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 18:19:34 juju-e4d256-prod-github-runner-207 kernel: [46548.571021] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 18:19:34 juju-e4d256-prod-github-runner-207 kernel: [46548.572124] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 18:19:34 juju-e4d256-prod-github-runner-207 kernel: [46548.573336] Call Trace: Aug 22 18:19:34 juju-e4d256-prod-github-runner-207 kernel: [46548.574252] Aug 22 18:19:34 juju-e4d256-prod-github-runner-207 kernel: [46548.575150] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:19:34 juju-e4d256-prod-github-runner-207 kernel: [46548.576178] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:19:34 juju-e4d256-prod-github-runner-207 kernel: [46548.577221] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:19:34 juju-e4d256-prod-github-runner-207 kernel: [46548.578318] ? show_regs.part.0+0x23/0x29 Aug 22 18:19:34 juju-e4d256-prod-github-runner-207 kernel: [46548.579314] ? show_regs.cold+0x8/0xd Aug 22 18:19:34 juju-e4d256-prod-github-runner-207 kernel: [46548.580289] ? watchdog_timer_fn+0x1be/0x220 Aug 22 18:19:34 juju-e4d256-prod-github-runner-207 kernel: [46548.581347] ? lockup_detector_update_enable+0x60/0x60 Aug 22 18:19:34 juju-e4d256-prod-github-runner-207 kernel: [46548.582447] ? __hrtimer_run_queues+0x107/0x230 Aug 22 18:19:34 juju-e4d256-prod-github-runner-207 kernel: [46548.583493] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 18:19:34 juju-e4d256-prod-github-runner-207 kernel: [46548.584516] ? hrtimer_interrupt+0x101/0x220 Aug 22 18:19:34 juju-e4d256-prod-github-runner-207 kernel: [46548.585550] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 18:19:34 juju-e4d256-prod-github-runner-207 kernel: [46548.586616] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 18:19:34 juju-e4d256-prod-github-runner-207 kernel: [46548.587699] Aug 22 18:19:34 juju-e4d256-prod-github-runner-207 kernel: [46548.588562] Aug 22 18:19:34 juju-e4d256-prod-github-runner-207 kernel: [46548.589436] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 18:19:34 juju-e4d256-prod-github-runner-207 kernel: [46548.590475] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:19:34 juju-e4d256-prod-github-runner-207 kernel: [46548.591511] ? _raw_spin_lock+0x22/0x30 Aug 22 18:19:34 juju-e4d256-prod-github-runner-207 kernel: [46548.592496] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:19:34 juju-e4d256-prod-github-runner-207 kernel: [46548.593547] direct_page_fault+0x206/0x310 [kvm] Aug 22 18:19:34 juju-e4d256-prod-github-runner-207 kernel: [46548.594576] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 18:19:34 juju-e4d256-prod-github-runner-207 kernel: [46548.595653] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 18:19:34 juju-e4d256-prod-github-runner-207 kernel: [46548.596673] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 18:19:34 juju-e4d256-prod-github-runner-207 kernel: [46548.597709] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 18:19:34 juju-e4d256-prod-github-runner-207 kernel: [46548.598657] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 18:19:34 juju-e4d256-prod-github-runner-207 kernel: [46548.599648] handle_exit+0x98/0x230 [kvm_amd] Aug 22 18:19:34 juju-e4d256-prod-github-runner-207 kernel: [46548.600544] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 18:19:34 juju-e4d256-prod-github-runner-207 kernel: [46548.601492] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 18:19:34 juju-e4d256-prod-github-runner-207 kernel: [46548.602461] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 18:19:34 juju-e4d256-prod-github-runner-207 kernel: [46548.603401] vcpu_run+0x62/0x2c0 [kvm] Aug 22 18:19:34 juju-e4d256-prod-github-runner-207 kernel: [46548.604218] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 18:19:34 juju-e4d256-prod-github-runner-207 kernel: [46548.605066] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 18:19:34 juju-e4d256-prod-github-runner-207 kernel: [46548.605925] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 18:19:34 juju-e4d256-prod-github-runner-207 kernel: [46548.606725] ? __seccomp_filter+0x4a/0x4a0 Aug 22 18:19:34 juju-e4d256-prod-github-runner-207 kernel: [46548.607471] ? __fget_files+0x86/0xc0 Aug 22 18:19:34 juju-e4d256-prod-github-runner-207 kernel: [46548.608192] __x64_sys_ioctl+0x95/0xd0 Aug 22 18:19:34 juju-e4d256-prod-github-runner-207 kernel: [46548.608891] do_syscall_64+0x5c/0xc0 Aug 22 18:19:34 juju-e4d256-prod-github-runner-207 kernel: [46548.609599] ? do_futex+0x162/0x1f0 Aug 22 18:19:34 juju-e4d256-prod-github-runner-207 kernel: [46548.610250] ? __x64_sys_futex+0x78/0x1e0 Aug 22 18:19:34 juju-e4d256-prod-github-runner-207 kernel: [46548.610929] ? __secure_computing+0xa9/0x120 Aug 22 18:19:34 juju-e4d256-prod-github-runner-207 kernel: [46548.611616] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 18:19:34 juju-e4d256-prod-github-runner-207 kernel: [46548.612374] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:19:34 juju-e4d256-prod-github-runner-207 kernel: [46548.613125] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:19:34 juju-e4d256-prod-github-runner-207 kernel: [46548.613860] ? do_syscall_64+0x69/0xc0 Aug 22 18:19:34 juju-e4d256-prod-github-runner-207 kernel: [46548.614508] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:19:34 juju-e4d256-prod-github-runner-207 kernel: [46548.615220] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:19:34 juju-e4d256-prod-github-runner-207 kernel: [46548.615918] ? do_syscall_64+0x69/0xc0 Aug 22 18:19:34 juju-e4d256-prod-github-runner-207 kernel: [46548.616547] ? do_syscall_64+0x69/0xc0 Aug 22 18:19:34 juju-e4d256-prod-github-runner-207 kernel: [46548.617191] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 18:19:34 juju-e4d256-prod-github-runner-207 kernel: [46548.617901] RIP: 0033:0x7faa5d0edaff Aug 22 18:19:34 juju-e4d256-prod-github-runner-207 kernel: [46548.618581] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 18:19:34 juju-e4d256-prod-github-runner-207 kernel: [46548.620582] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 18:19:34 juju-e4d256-prod-github-runner-207 kernel: [46548.621519] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 18:19:34 juju-e4d256-prod-github-runner-207 kernel: [46548.622546] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 18:19:34 juju-e4d256-prod-github-runner-207 kernel: [46548.623462] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 18:19:34 juju-e4d256-prod-github-runner-207 kernel: [46548.624358] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 18:19:34 juju-e4d256-prod-github-runner-207 kernel: [46548.625356] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 18:19:34 juju-e4d256-prod-github-runner-207 kernel: [46548.626274] Aug 22 18:20:02 juju-e4d256-prod-github-runner-207 kernel: [46576.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 43269s! [qemu-system-x86:6715] Aug 22 18:20:02 juju-e4d256-prod-github-runner-207 kernel: [46576.543092] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 18:20:02 juju-e4d256-prod-github-runner-207 kernel: [46576.543165] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 18:20:02 juju-e4d256-prod-github-runner-207 kernel: [46576.555447] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 18:20:02 juju-e4d256-prod-github-runner-207 kernel: [46576.557014] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 18:20:02 juju-e4d256-prod-github-runner-207 kernel: [46576.558281] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:20:02 juju-e4d256-prod-github-runner-207 kernel: [46576.559376] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 18:20:02 juju-e4d256-prod-github-runner-207 kernel: [46576.562034] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 18:20:02 juju-e4d256-prod-github-runner-207 kernel: [46576.563139] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 18:20:02 juju-e4d256-prod-github-runner-207 kernel: [46576.564698] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 18:20:02 juju-e4d256-prod-github-runner-207 kernel: [46576.565876] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 18:20:02 juju-e4d256-prod-github-runner-207 kernel: [46576.567074] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 18:20:02 juju-e4d256-prod-github-runner-207 kernel: [46576.568287] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 18:20:02 juju-e4d256-prod-github-runner-207 kernel: [46576.569485] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 18:20:02 juju-e4d256-prod-github-runner-207 kernel: [46576.570726] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 18:20:02 juju-e4d256-prod-github-runner-207 kernel: [46576.571846] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 18:20:02 juju-e4d256-prod-github-runner-207 kernel: [46576.573097] Call Trace: Aug 22 18:20:02 juju-e4d256-prod-github-runner-207 kernel: [46576.574028] Aug 22 18:20:02 juju-e4d256-prod-github-runner-207 kernel: [46576.574931] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:20:02 juju-e4d256-prod-github-runner-207 kernel: [46576.575966] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:20:02 juju-e4d256-prod-github-runner-207 kernel: [46576.577023] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:20:02 juju-e4d256-prod-github-runner-207 kernel: [46576.578125] ? show_regs.part.0+0x23/0x29 Aug 22 18:20:02 juju-e4d256-prod-github-runner-207 kernel: [46576.579131] ? show_regs.cold+0x8/0xd Aug 22 18:20:02 juju-e4d256-prod-github-runner-207 kernel: [46576.580173] ? watchdog_timer_fn+0x1be/0x220 Aug 22 18:20:02 juju-e4d256-prod-github-runner-207 kernel: [46576.581210] ? lockup_detector_update_enable+0x60/0x60 Aug 22 18:20:02 juju-e4d256-prod-github-runner-207 kernel: [46576.582297] ? __hrtimer_run_queues+0x107/0x230 Aug 22 18:20:02 juju-e4d256-prod-github-runner-207 kernel: [46576.583341] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 18:20:02 juju-e4d256-prod-github-runner-207 kernel: [46576.584372] ? hrtimer_interrupt+0x101/0x220 Aug 22 18:20:02 juju-e4d256-prod-github-runner-207 kernel: [46576.585402] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 18:20:02 juju-e4d256-prod-github-runner-207 kernel: [46576.586484] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 18:20:02 juju-e4d256-prod-github-runner-207 kernel: [46576.587544] Aug 22 18:20:02 juju-e4d256-prod-github-runner-207 kernel: [46576.588418] Aug 22 18:20:02 juju-e4d256-prod-github-runner-207 kernel: [46576.589300] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 18:20:02 juju-e4d256-prod-github-runner-207 kernel: [46576.590549] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:20:02 juju-e4d256-prod-github-runner-207 kernel: [46576.591633] ? _raw_spin_lock+0x22/0x30 Aug 22 18:20:02 juju-e4d256-prod-github-runner-207 kernel: [46576.592614] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:20:02 juju-e4d256-prod-github-runner-207 kernel: [46576.593735] direct_page_fault+0x206/0x310 [kvm] Aug 22 18:20:02 juju-e4d256-prod-github-runner-207 kernel: [46576.594797] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 18:20:02 juju-e4d256-prod-github-runner-207 kernel: [46576.595827] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 18:20:02 juju-e4d256-prod-github-runner-207 kernel: [46576.596883] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 18:20:02 juju-e4d256-prod-github-runner-207 kernel: [46576.597903] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 18:20:02 juju-e4d256-prod-github-runner-207 kernel: [46576.598908] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 18:20:02 juju-e4d256-prod-github-runner-207 kernel: [46576.599918] handle_exit+0x98/0x230 [kvm_amd] Aug 22 18:20:02 juju-e4d256-prod-github-runner-207 kernel: [46576.600857] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 18:20:02 juju-e4d256-prod-github-runner-207 kernel: [46576.601790] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 18:20:02 juju-e4d256-prod-github-runner-207 kernel: [46576.602742] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 18:20:02 juju-e4d256-prod-github-runner-207 kernel: [46576.603669] vcpu_run+0x62/0x2c0 [kvm] Aug 22 18:20:02 juju-e4d256-prod-github-runner-207 kernel: [46576.604508] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 18:20:02 juju-e4d256-prod-github-runner-207 kernel: [46576.605360] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 18:20:02 juju-e4d256-prod-github-runner-207 kernel: [46576.606224] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 18:20:02 juju-e4d256-prod-github-runner-207 kernel: [46576.607027] ? __seccomp_filter+0x4a/0x4a0 Aug 22 18:20:02 juju-e4d256-prod-github-runner-207 kernel: [46576.607779] ? __fget_files+0x86/0xc0 Aug 22 18:20:02 juju-e4d256-prod-github-runner-207 kernel: [46576.608558] __x64_sys_ioctl+0x95/0xd0 Aug 22 18:20:02 juju-e4d256-prod-github-runner-207 kernel: [46576.609297] do_syscall_64+0x5c/0xc0 Aug 22 18:20:02 juju-e4d256-prod-github-runner-207 kernel: [46576.609975] ? do_futex+0x162/0x1f0 Aug 22 18:20:02 juju-e4d256-prod-github-runner-207 kernel: [46576.610629] ? __x64_sys_futex+0x78/0x1e0 Aug 22 18:20:02 juju-e4d256-prod-github-runner-207 kernel: [46576.611312] ? __secure_computing+0xa9/0x120 Aug 22 18:20:02 juju-e4d256-prod-github-runner-207 kernel: [46576.612070] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 18:20:02 juju-e4d256-prod-github-runner-207 kernel: [46576.612881] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:20:02 juju-e4d256-prod-github-runner-207 kernel: [46576.613621] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:20:02 juju-e4d256-prod-github-runner-207 kernel: [46576.614360] ? do_syscall_64+0x69/0xc0 Aug 22 18:20:02 juju-e4d256-prod-github-runner-207 kernel: [46576.615013] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:20:02 juju-e4d256-prod-github-runner-207 kernel: [46576.615720] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:20:02 juju-e4d256-prod-github-runner-207 kernel: [46576.616424] ? do_syscall_64+0x69/0xc0 Aug 22 18:20:02 juju-e4d256-prod-github-runner-207 kernel: [46576.617082] ? do_syscall_64+0x69/0xc0 Aug 22 18:20:02 juju-e4d256-prod-github-runner-207 kernel: [46576.617709] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 18:20:02 juju-e4d256-prod-github-runner-207 kernel: [46576.618435] RIP: 0033:0x7faa5d0edaff Aug 22 18:20:02 juju-e4d256-prod-github-runner-207 kernel: [46576.619070] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 18:20:02 juju-e4d256-prod-github-runner-207 kernel: [46576.621142] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 18:20:02 juju-e4d256-prod-github-runner-207 kernel: [46576.622086] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 18:20:02 juju-e4d256-prod-github-runner-207 kernel: [46576.622995] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 18:20:02 juju-e4d256-prod-github-runner-207 kernel: [46576.623906] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 18:20:02 juju-e4d256-prod-github-runner-207 kernel: [46576.624844] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 18:20:02 juju-e4d256-prod-github-runner-207 kernel: [46576.625758] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 18:20:02 juju-e4d256-prod-github-runner-207 kernel: [46576.626744] Aug 22 18:20:30 juju-e4d256-prod-github-runner-207 kernel: [46604.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 43295s! [qemu-system-x86:6715] Aug 22 18:20:30 juju-e4d256-prod-github-runner-207 kernel: [46604.543812] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 18:20:30 juju-e4d256-prod-github-runner-207 kernel: [46604.544115] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 18:20:30 juju-e4d256-prod-github-runner-207 kernel: [46604.556865] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 18:20:30 juju-e4d256-prod-github-runner-207 kernel: [46604.558294] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 18:20:30 juju-e4d256-prod-github-runner-207 kernel: [46604.559563] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:20:30 juju-e4d256-prod-github-runner-207 kernel: [46604.560721] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 18:20:30 juju-e4d256-prod-github-runner-207 kernel: [46604.563368] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 18:20:30 juju-e4d256-prod-github-runner-207 kernel: [46604.564461] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 18:20:30 juju-e4d256-prod-github-runner-207 kernel: [46604.565650] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 18:20:30 juju-e4d256-prod-github-runner-207 kernel: [46604.566838] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 18:20:30 juju-e4d256-prod-github-runner-207 kernel: [46604.568026] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 18:20:30 juju-e4d256-prod-github-runner-207 kernel: [46604.569237] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 18:20:30 juju-e4d256-prod-github-runner-207 kernel: [46604.570436] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 18:20:30 juju-e4d256-prod-github-runner-207 kernel: [46604.571702] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 18:20:30 juju-e4d256-prod-github-runner-207 kernel: [46604.572838] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 18:20:30 juju-e4d256-prod-github-runner-207 kernel: [46604.574076] Call Trace: Aug 22 18:20:30 juju-e4d256-prod-github-runner-207 kernel: [46604.575002] Aug 22 18:20:30 juju-e4d256-prod-github-runner-207 kernel: [46604.575924] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:20:30 juju-e4d256-prod-github-runner-207 kernel: [46604.576988] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:20:30 juju-e4d256-prod-github-runner-207 kernel: [46604.578020] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:20:30 juju-e4d256-prod-github-runner-207 kernel: [46604.579312] ? show_regs.part.0+0x23/0x29 Aug 22 18:20:30 juju-e4d256-prod-github-runner-207 kernel: [46604.580354] ? show_regs.cold+0x8/0xd Aug 22 18:20:30 juju-e4d256-prod-github-runner-207 kernel: [46604.581346] ? watchdog_timer_fn+0x1be/0x220 Aug 22 18:20:30 juju-e4d256-prod-github-runner-207 kernel: [46604.582395] ? lockup_detector_update_enable+0x60/0x60 Aug 22 18:20:30 juju-e4d256-prod-github-runner-207 kernel: [46604.583474] ? __hrtimer_run_queues+0x107/0x230 Aug 22 18:20:30 juju-e4d256-prod-github-runner-207 kernel: [46604.584543] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 18:20:30 juju-e4d256-prod-github-runner-207 kernel: [46604.585584] ? hrtimer_interrupt+0x101/0x220 Aug 22 18:20:30 juju-e4d256-prod-github-runner-207 kernel: [46604.586614] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 18:20:30 juju-e4d256-prod-github-runner-207 kernel: [46604.587708] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 18:20:30 juju-e4d256-prod-github-runner-207 kernel: [46604.588780] Aug 22 18:20:30 juju-e4d256-prod-github-runner-207 kernel: [46604.589733] Aug 22 18:20:30 juju-e4d256-prod-github-runner-207 kernel: [46604.590577] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 18:20:30 juju-e4d256-prod-github-runner-207 kernel: [46604.591630] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:20:30 juju-e4d256-prod-github-runner-207 kernel: [46604.592713] ? _raw_spin_lock+0x22/0x30 Aug 22 18:20:30 juju-e4d256-prod-github-runner-207 kernel: [46604.593677] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:20:30 juju-e4d256-prod-github-runner-207 kernel: [46604.594755] direct_page_fault+0x206/0x310 [kvm] Aug 22 18:20:30 juju-e4d256-prod-github-runner-207 kernel: [46604.595814] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 18:20:30 juju-e4d256-prod-github-runner-207 kernel: [46604.596862] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 18:20:30 juju-e4d256-prod-github-runner-207 kernel: [46604.597899] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 18:20:30 juju-e4d256-prod-github-runner-207 kernel: [46604.598938] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 18:20:30 juju-e4d256-prod-github-runner-207 kernel: [46604.599948] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 18:20:30 juju-e4d256-prod-github-runner-207 kernel: [46604.601183] handle_exit+0x98/0x230 [kvm_amd] Aug 22 18:20:30 juju-e4d256-prod-github-runner-207 kernel: [46604.602237] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 18:20:30 juju-e4d256-prod-github-runner-207 kernel: [46604.603217] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 18:20:30 juju-e4d256-prod-github-runner-207 kernel: [46604.604217] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 18:20:30 juju-e4d256-prod-github-runner-207 kernel: [46604.605273] vcpu_run+0x62/0x2c0 [kvm] Aug 22 18:20:30 juju-e4d256-prod-github-runner-207 kernel: [46604.606131] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 18:20:30 juju-e4d256-prod-github-runner-207 kernel: [46604.607071] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 18:20:30 juju-e4d256-prod-github-runner-207 kernel: [46604.607958] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 18:20:30 juju-e4d256-prod-github-runner-207 kernel: [46604.608869] ? __seccomp_filter+0x4a/0x4a0 Aug 22 18:20:30 juju-e4d256-prod-github-runner-207 kernel: [46604.609855] ? __fget_files+0x86/0xc0 Aug 22 18:20:30 juju-e4d256-prod-github-runner-207 kernel: [46604.610809] __x64_sys_ioctl+0x95/0xd0 Aug 22 18:20:30 juju-e4d256-prod-github-runner-207 kernel: [46604.611528] do_syscall_64+0x5c/0xc0 Aug 22 18:20:30 juju-e4d256-prod-github-runner-207 kernel: [46604.612247] ? do_futex+0x162/0x1f0 Aug 22 18:20:30 juju-e4d256-prod-github-runner-207 kernel: [46604.613061] ? __x64_sys_futex+0x78/0x1e0 Aug 22 18:20:30 juju-e4d256-prod-github-runner-207 kernel: [46604.613760] ? __secure_computing+0xa9/0x120 Aug 22 18:20:30 juju-e4d256-prod-github-runner-207 kernel: [46604.614464] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 18:20:30 juju-e4d256-prod-github-runner-207 kernel: [46604.615259] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:20:30 juju-e4d256-prod-github-runner-207 kernel: [46604.616036] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:20:30 juju-e4d256-prod-github-runner-207 kernel: [46604.616802] ? do_syscall_64+0x69/0xc0 Aug 22 18:20:30 juju-e4d256-prod-github-runner-207 kernel: [46604.617466] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:20:30 juju-e4d256-prod-github-runner-207 kernel: [46604.618203] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:20:30 juju-e4d256-prod-github-runner-207 kernel: [46604.618920] ? do_syscall_64+0x69/0xc0 Aug 22 18:20:30 juju-e4d256-prod-github-runner-207 kernel: [46604.619561] ? do_syscall_64+0x69/0xc0 Aug 22 18:20:30 juju-e4d256-prod-github-runner-207 kernel: [46604.620210] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 18:20:30 juju-e4d256-prod-github-runner-207 kernel: [46604.620958] RIP: 0033:0x7faa5d0edaff Aug 22 18:20:30 juju-e4d256-prod-github-runner-207 kernel: [46604.621628] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 18:20:30 juju-e4d256-prod-github-runner-207 kernel: [46604.623681] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 18:20:30 juju-e4d256-prod-github-runner-207 kernel: [46604.624655] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 18:20:30 juju-e4d256-prod-github-runner-207 kernel: [46604.625581] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 18:20:30 juju-e4d256-prod-github-runner-207 kernel: [46604.626514] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 18:20:30 juju-e4d256-prod-github-runner-207 kernel: [46604.627424] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 18:20:30 juju-e4d256-prod-github-runner-207 kernel: [46604.628400] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 18:20:30 juju-e4d256-prod-github-runner-207 kernel: [46604.629342] Aug 22 18:20:46 juju-e4d256-prod-github-runner-207 kernel: [46620.296706] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 18:20:46 juju-e4d256-prod-github-runner-207 kernel: [46620.297755] rcu: 1-....: (11589326 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=5608422 Aug 22 18:20:46 juju-e4d256-prod-github-runner-207 kernel: [46620.298933] (t=11625774 jiffies g=23269 q=45449) Aug 22 18:20:46 juju-e4d256-prod-github-runner-207 kernel: [46620.299768] NMI backtrace for cpu 1 Aug 22 18:20:46 juju-e4d256-prod-github-runner-207 kernel: [46620.300528] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 18:20:46 juju-e4d256-prod-github-runner-207 kernel: [46620.301882] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 18:20:46 juju-e4d256-prod-github-runner-207 kernel: [46620.302989] Call Trace: Aug 22 18:20:46 juju-e4d256-prod-github-runner-207 kernel: [46620.303671] Aug 22 18:20:46 juju-e4d256-prod-github-runner-207 kernel: [46620.304336] show_stack+0x52/0x5c Aug 22 18:20:46 juju-e4d256-prod-github-runner-207 kernel: [46620.305060] dump_stack_lvl+0x4a/0x63 Aug 22 18:20:46 juju-e4d256-prod-github-runner-207 kernel: [46620.305803] dump_stack+0x10/0x16 Aug 22 18:20:46 juju-e4d256-prod-github-runner-207 kernel: [46620.306517] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 18:20:46 juju-e4d256-prod-github-runner-207 kernel: [46620.307294] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 18:20:46 juju-e4d256-prod-github-runner-207 kernel: [46620.308075] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 18:20:46 juju-e4d256-prod-github-runner-207 kernel: [46620.308908] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 18:20:46 juju-e4d256-prod-github-runner-207 kernel: [46620.309722] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 18:20:46 juju-e4d256-prod-github-runner-207 kernel: [46620.310527] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 18:20:46 juju-e4d256-prod-github-runner-207 kernel: [46620.311295] print_cpu_stall.cold+0x2f/0xe2 Aug 22 18:20:46 juju-e4d256-prod-github-runner-207 kernel: [46620.312177] ? timekeeping_update+0xf7/0x150 Aug 22 18:20:46 juju-e4d256-prod-github-runner-207 kernel: [46620.312969] check_cpu_stall+0x109/0x270 Aug 22 18:20:46 juju-e4d256-prod-github-runner-207 kernel: [46620.313813] rcu_sched_clock_irq+0x9a/0x250 Aug 22 18:20:46 juju-e4d256-prod-github-runner-207 kernel: [46620.314607] update_process_times+0x94/0xd0 Aug 22 18:20:46 juju-e4d256-prod-github-runner-207 kernel: [46620.315366] tick_sched_handle+0x29/0x70 Aug 22 18:20:46 juju-e4d256-prod-github-runner-207 kernel: [46620.316133] tick_sched_timer+0x8c/0xc0 Aug 22 18:20:46 juju-e4d256-prod-github-runner-207 kernel: [46620.316870] ? tick_nohz_handler+0xb0/0xb0 Aug 22 18:20:46 juju-e4d256-prod-github-runner-207 kernel: [46620.317624] __hrtimer_run_queues+0x107/0x230 Aug 22 18:20:46 juju-e4d256-prod-github-runner-207 kernel: [46620.318401] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 18:20:46 juju-e4d256-prod-github-runner-207 kernel: [46620.319176] hrtimer_interrupt+0x101/0x220 Aug 22 18:20:46 juju-e4d256-prod-github-runner-207 kernel: [46620.319939] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 18:20:46 juju-e4d256-prod-github-runner-207 kernel: [46620.320797] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 18:20:46 juju-e4d256-prod-github-runner-207 kernel: [46620.321609] Aug 22 18:20:46 juju-e4d256-prod-github-runner-207 kernel: [46620.322244] Aug 22 18:20:46 juju-e4d256-prod-github-runner-207 kernel: [46620.322872] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 18:20:46 juju-e4d256-prod-github-runner-207 kernel: [46620.323694] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:20:46 juju-e4d256-prod-github-runner-207 kernel: [46620.324600] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 18:20:46 juju-e4d256-prod-github-runner-207 kernel: [46620.326882] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 18:20:46 juju-e4d256-prod-github-runner-207 kernel: [46620.327803] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 18:20:46 juju-e4d256-prod-github-runner-207 kernel: [46620.328845] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 18:20:46 juju-e4d256-prod-github-runner-207 kernel: [46620.329880] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 18:20:46 juju-e4d256-prod-github-runner-207 kernel: [46620.330900] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 18:20:46 juju-e4d256-prod-github-runner-207 kernel: [46620.331882] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 18:20:46 juju-e4d256-prod-github-runner-207 kernel: [46620.332982] ? _raw_spin_lock+0x22/0x30 Aug 22 18:20:46 juju-e4d256-prod-github-runner-207 kernel: [46620.333790] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:20:46 juju-e4d256-prod-github-runner-207 kernel: [46620.334659] direct_page_fault+0x206/0x310 [kvm] Aug 22 18:20:46 juju-e4d256-prod-github-runner-207 kernel: [46620.335618] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 18:20:46 juju-e4d256-prod-github-runner-207 kernel: [46620.336558] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 18:20:46 juju-e4d256-prod-github-runner-207 kernel: [46620.337467] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 18:20:46 juju-e4d256-prod-github-runner-207 kernel: [46620.338363] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 18:20:46 juju-e4d256-prod-github-runner-207 kernel: [46620.339236] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 18:20:46 juju-e4d256-prod-github-runner-207 kernel: [46620.340187] handle_exit+0x98/0x230 [kvm_amd] Aug 22 18:20:46 juju-e4d256-prod-github-runner-207 kernel: [46620.341042] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 18:20:46 juju-e4d256-prod-github-runner-207 kernel: [46620.341910] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 18:20:46 juju-e4d256-prod-github-runner-207 kernel: [46620.342809] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 18:20:46 juju-e4d256-prod-github-runner-207 kernel: [46620.343685] vcpu_run+0x62/0x2c0 [kvm] Aug 22 18:20:46 juju-e4d256-prod-github-runner-207 kernel: [46620.344494] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 18:20:46 juju-e4d256-prod-github-runner-207 kernel: [46620.345311] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 18:20:46 juju-e4d256-prod-github-runner-207 kernel: [46620.346207] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 18:20:46 juju-e4d256-prod-github-runner-207 kernel: [46620.347063] ? __seccomp_filter+0x4a/0x4a0 Aug 22 18:20:46 juju-e4d256-prod-github-runner-207 kernel: [46620.347867] ? __fget_files+0x86/0xc0 Aug 22 18:20:46 juju-e4d256-prod-github-runner-207 kernel: [46620.348862] __x64_sys_ioctl+0x95/0xd0 Aug 22 18:20:46 juju-e4d256-prod-github-runner-207 kernel: [46620.349575] do_syscall_64+0x5c/0xc0 Aug 22 18:20:46 juju-e4d256-prod-github-runner-207 kernel: [46620.350275] ? do_futex+0x162/0x1f0 Aug 22 18:20:46 juju-e4d256-prod-github-runner-207 kernel: [46620.351047] ? __x64_sys_futex+0x78/0x1e0 Aug 22 18:20:46 juju-e4d256-prod-github-runner-207 kernel: [46620.351782] ? __secure_computing+0xa9/0x120 Aug 22 18:20:46 juju-e4d256-prod-github-runner-207 kernel: [46620.352529] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 18:20:46 juju-e4d256-prod-github-runner-207 kernel: [46620.353323] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:20:46 juju-e4d256-prod-github-runner-207 kernel: [46620.354083] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:20:46 juju-e4d256-prod-github-runner-207 kernel: [46620.354836] ? do_syscall_64+0x69/0xc0 Aug 22 18:20:46 juju-e4d256-prod-github-runner-207 kernel: [46620.355525] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:20:46 juju-e4d256-prod-github-runner-207 kernel: [46620.356300] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:20:46 juju-e4d256-prod-github-runner-207 kernel: [46620.357139] ? do_syscall_64+0x69/0xc0 Aug 22 18:20:46 juju-e4d256-prod-github-runner-207 kernel: [46620.357928] ? do_syscall_64+0x69/0xc0 Aug 22 18:20:46 juju-e4d256-prod-github-runner-207 kernel: [46620.358679] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 18:20:46 juju-e4d256-prod-github-runner-207 kernel: [46620.359555] RIP: 0033:0x7faa5d0edaff Aug 22 18:20:46 juju-e4d256-prod-github-runner-207 kernel: [46620.360279] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 18:20:46 juju-e4d256-prod-github-runner-207 kernel: [46620.362483] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 18:20:46 juju-e4d256-prod-github-runner-207 kernel: [46620.363447] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 18:20:46 juju-e4d256-prod-github-runner-207 kernel: [46620.364422] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 18:20:46 juju-e4d256-prod-github-runner-207 kernel: [46620.365454] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 18:20:46 juju-e4d256-prod-github-runner-207 kernel: [46620.366403] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 18:20:46 juju-e4d256-prod-github-runner-207 kernel: [46620.367330] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 18:20:46 juju-e4d256-prod-github-runner-207 kernel: [46620.368264] Aug 22 18:21:10 juju-e4d256-prod-github-runner-207 kernel: [46644.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 43333s! [qemu-system-x86:6715] Aug 22 18:21:10 juju-e4d256-prod-github-runner-207 kernel: [46644.543140] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 18:21:10 juju-e4d256-prod-github-runner-207 kernel: [46644.543216] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 18:21:10 juju-e4d256-prod-github-runner-207 kernel: [46644.555680] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 18:21:10 juju-e4d256-prod-github-runner-207 kernel: [46644.556965] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 18:21:10 juju-e4d256-prod-github-runner-207 kernel: [46644.558196] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:21:10 juju-e4d256-prod-github-runner-207 kernel: [46644.559256] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 18:21:10 juju-e4d256-prod-github-runner-207 kernel: [46644.561865] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 18:21:10 juju-e4d256-prod-github-runner-207 kernel: [46644.562938] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 18:21:10 juju-e4d256-prod-github-runner-207 kernel: [46644.564141] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 18:21:10 juju-e4d256-prod-github-runner-207 kernel: [46644.565312] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 18:21:10 juju-e4d256-prod-github-runner-207 kernel: [46644.566483] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 18:21:10 juju-e4d256-prod-github-runner-207 kernel: [46644.567660] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 18:21:10 juju-e4d256-prod-github-runner-207 kernel: [46644.568854] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 18:21:10 juju-e4d256-prod-github-runner-207 kernel: [46644.570136] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 18:21:10 juju-e4d256-prod-github-runner-207 kernel: [46644.571241] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 18:21:10 juju-e4d256-prod-github-runner-207 kernel: [46644.572474] Call Trace: Aug 22 18:21:10 juju-e4d256-prod-github-runner-207 kernel: [46644.573444] Aug 22 18:21:10 juju-e4d256-prod-github-runner-207 kernel: [46644.574337] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:21:10 juju-e4d256-prod-github-runner-207 kernel: [46644.575372] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:21:10 juju-e4d256-prod-github-runner-207 kernel: [46644.576402] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:21:10 juju-e4d256-prod-github-runner-207 kernel: [46644.577492] ? show_regs.part.0+0x23/0x29 Aug 22 18:21:10 juju-e4d256-prod-github-runner-207 kernel: [46644.578502] ? show_regs.cold+0x8/0xd Aug 22 18:21:10 juju-e4d256-prod-github-runner-207 kernel: [46644.579474] ? watchdog_timer_fn+0x1be/0x220 Aug 22 18:21:10 juju-e4d256-prod-github-runner-207 kernel: [46644.580503] ? lockup_detector_update_enable+0x60/0x60 Aug 22 18:21:10 juju-e4d256-prod-github-runner-207 kernel: [46644.581579] ? __hrtimer_run_queues+0x107/0x230 Aug 22 18:21:10 juju-e4d256-prod-github-runner-207 kernel: [46644.582608] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 18:21:10 juju-e4d256-prod-github-runner-207 kernel: [46644.583646] ? hrtimer_interrupt+0x101/0x220 Aug 22 18:21:10 juju-e4d256-prod-github-runner-207 kernel: [46644.584707] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 18:21:10 juju-e4d256-prod-github-runner-207 kernel: [46644.585781] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 18:21:10 juju-e4d256-prod-github-runner-207 kernel: [46644.586827] Aug 22 18:21:10 juju-e4d256-prod-github-runner-207 kernel: [46644.587678] Aug 22 18:21:10 juju-e4d256-prod-github-runner-207 kernel: [46644.588661] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 18:21:10 juju-e4d256-prod-github-runner-207 kernel: [46644.589723] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:21:10 juju-e4d256-prod-github-runner-207 kernel: [46644.590763] ? _raw_spin_lock+0x22/0x30 Aug 22 18:21:10 juju-e4d256-prod-github-runner-207 kernel: [46644.591712] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:21:10 juju-e4d256-prod-github-runner-207 kernel: [46644.592754] direct_page_fault+0x206/0x310 [kvm] Aug 22 18:21:10 juju-e4d256-prod-github-runner-207 kernel: [46644.593798] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 18:21:10 juju-e4d256-prod-github-runner-207 kernel: [46644.595015] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 18:21:10 juju-e4d256-prod-github-runner-207 kernel: [46644.596068] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 18:21:10 juju-e4d256-prod-github-runner-207 kernel: [46644.597048] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 18:21:10 juju-e4d256-prod-github-runner-207 kernel: [46644.597997] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 18:21:10 juju-e4d256-prod-github-runner-207 kernel: [46644.598988] handle_exit+0x98/0x230 [kvm_amd] Aug 22 18:21:10 juju-e4d256-prod-github-runner-207 kernel: [46644.599905] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 18:21:10 juju-e4d256-prod-github-runner-207 kernel: [46644.600837] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 18:21:10 juju-e4d256-prod-github-runner-207 kernel: [46644.601985] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 18:21:10 juju-e4d256-prod-github-runner-207 kernel: [46644.603227] vcpu_run+0x62/0x2c0 [kvm] Aug 22 18:21:10 juju-e4d256-prod-github-runner-207 kernel: [46644.604458] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 18:21:10 juju-e4d256-prod-github-runner-207 kernel: [46644.605610] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 18:21:10 juju-e4d256-prod-github-runner-207 kernel: [46644.606810] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 18:21:10 juju-e4d256-prod-github-runner-207 kernel: [46644.607957] ? __seccomp_filter+0x4a/0x4a0 Aug 22 18:21:10 juju-e4d256-prod-github-runner-207 kernel: [46644.609011] ? __fget_files+0x86/0xc0 Aug 22 18:21:10 juju-e4d256-prod-github-runner-207 kernel: [46644.610233] __x64_sys_ioctl+0x95/0xd0 Aug 22 18:21:10 juju-e4d256-prod-github-runner-207 kernel: [46644.611268] do_syscall_64+0x5c/0xc0 Aug 22 18:21:10 juju-e4d256-prod-github-runner-207 kernel: [46644.612248] ? do_futex+0x162/0x1f0 Aug 22 18:21:10 juju-e4d256-prod-github-runner-207 kernel: [46644.613219] ? __x64_sys_futex+0x78/0x1e0 Aug 22 18:21:10 juju-e4d256-prod-github-runner-207 kernel: [46644.614216] ? __secure_computing+0xa9/0x120 Aug 22 18:21:10 juju-e4d256-prod-github-runner-207 kernel: [46644.615231] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 18:21:10 juju-e4d256-prod-github-runner-207 kernel: [46644.616406] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:21:10 juju-e4d256-prod-github-runner-207 kernel: [46644.617462] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:21:10 juju-e4d256-prod-github-runner-207 kernel: [46644.618544] ? do_syscall_64+0x69/0xc0 Aug 22 18:21:10 juju-e4d256-prod-github-runner-207 kernel: [46644.619477] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:21:10 juju-e4d256-prod-github-runner-207 kernel: [46644.620526] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:21:10 juju-e4d256-prod-github-runner-207 kernel: [46644.621577] ? do_syscall_64+0x69/0xc0 Aug 22 18:21:10 juju-e4d256-prod-github-runner-207 kernel: [46644.622495] ? do_syscall_64+0x69/0xc0 Aug 22 18:21:10 juju-e4d256-prod-github-runner-207 kernel: [46644.623491] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 18:21:10 juju-e4d256-prod-github-runner-207 kernel: [46644.624557] RIP: 0033:0x7faa5d0edaff Aug 22 18:21:10 juju-e4d256-prod-github-runner-207 kernel: [46644.625472] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 18:21:10 juju-e4d256-prod-github-runner-207 kernel: [46644.628517] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 18:21:10 juju-e4d256-prod-github-runner-207 kernel: [46644.629960] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 18:21:10 juju-e4d256-prod-github-runner-207 kernel: [46644.631347] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 18:21:10 juju-e4d256-prod-github-runner-207 kernel: [46644.632616] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 18:21:10 juju-e4d256-prod-github-runner-207 kernel: [46644.633928] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 18:21:10 juju-e4d256-prod-github-runner-207 kernel: [46644.635187] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 18:21:10 juju-e4d256-prod-github-runner-207 kernel: [46644.636543] Aug 22 18:21:38 juju-e4d256-prod-github-runner-207 kernel: [46672.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 43359s! [qemu-system-x86:6715] Aug 22 18:21:38 juju-e4d256-prod-github-runner-207 kernel: [46672.543336] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 18:21:38 juju-e4d256-prod-github-runner-207 kernel: [46672.543410] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 18:21:38 juju-e4d256-prod-github-runner-207 kernel: [46672.557490] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 18:21:38 juju-e4d256-prod-github-runner-207 kernel: [46672.559012] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 18:21:38 juju-e4d256-prod-github-runner-207 kernel: [46672.560440] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:21:38 juju-e4d256-prod-github-runner-207 kernel: [46672.561620] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 18:21:38 juju-e4d256-prod-github-runner-207 kernel: [46672.564526] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 18:21:38 juju-e4d256-prod-github-runner-207 kernel: [46672.565675] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 18:21:38 juju-e4d256-prod-github-runner-207 kernel: [46672.566965] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 18:21:38 juju-e4d256-prod-github-runner-207 kernel: [46672.568266] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 18:21:38 juju-e4d256-prod-github-runner-207 kernel: [46672.569564] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 18:21:38 juju-e4d256-prod-github-runner-207 kernel: [46672.570853] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 18:21:38 juju-e4d256-prod-github-runner-207 kernel: [46672.572160] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 18:21:38 juju-e4d256-prod-github-runner-207 kernel: [46672.573540] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 18:21:38 juju-e4d256-prod-github-runner-207 kernel: [46672.574792] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 18:21:38 juju-e4d256-prod-github-runner-207 kernel: [46672.576145] Call Trace: Aug 22 18:21:38 juju-e4d256-prod-github-runner-207 kernel: [46672.577121] Aug 22 18:21:38 juju-e4d256-prod-github-runner-207 kernel: [46672.578056] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:21:38 juju-e4d256-prod-github-runner-207 kernel: [46672.579174] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:21:38 juju-e4d256-prod-github-runner-207 kernel: [46672.580309] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:21:38 juju-e4d256-prod-github-runner-207 kernel: [46672.581490] ? show_regs.part.0+0x23/0x29 Aug 22 18:21:38 juju-e4d256-prod-github-runner-207 kernel: [46672.582591] ? show_regs.cold+0x8/0xd Aug 22 18:21:38 juju-e4d256-prod-github-runner-207 kernel: [46672.583666] ? watchdog_timer_fn+0x1be/0x220 Aug 22 18:21:38 juju-e4d256-prod-github-runner-207 kernel: [46672.584762] ? lockup_detector_update_enable+0x60/0x60 Aug 22 18:21:38 juju-e4d256-prod-github-runner-207 kernel: [46672.585919] ? __hrtimer_run_queues+0x107/0x230 Aug 22 18:21:38 juju-e4d256-prod-github-runner-207 kernel: [46672.587036] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 18:21:38 juju-e4d256-prod-github-runner-207 kernel: [46672.588168] ? hrtimer_interrupt+0x101/0x220 Aug 22 18:21:38 juju-e4d256-prod-github-runner-207 kernel: [46672.589265] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 18:21:38 juju-e4d256-prod-github-runner-207 kernel: [46672.590429] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 18:21:38 juju-e4d256-prod-github-runner-207 kernel: [46672.591588] Aug 22 18:21:38 juju-e4d256-prod-github-runner-207 kernel: [46672.592487] Aug 22 18:21:38 juju-e4d256-prod-github-runner-207 kernel: [46672.593369] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 18:21:38 juju-e4d256-prod-github-runner-207 kernel: [46672.594499] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:21:38 juju-e4d256-prod-github-runner-207 kernel: [46672.595674] ? _raw_spin_lock+0x22/0x30 Aug 22 18:21:38 juju-e4d256-prod-github-runner-207 kernel: [46672.596696] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:21:38 juju-e4d256-prod-github-runner-207 kernel: [46672.597812] direct_page_fault+0x206/0x310 [kvm] Aug 22 18:21:38 juju-e4d256-prod-github-runner-207 kernel: [46672.598938] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 18:21:38 juju-e4d256-prod-github-runner-207 kernel: [46672.600068] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 18:21:38 juju-e4d256-prod-github-runner-207 kernel: [46672.601164] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 18:21:38 juju-e4d256-prod-github-runner-207 kernel: [46672.602230] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 18:21:38 juju-e4d256-prod-github-runner-207 kernel: [46672.603273] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 18:21:38 juju-e4d256-prod-github-runner-207 kernel: [46672.604371] handle_exit+0x98/0x230 [kvm_amd] Aug 22 18:21:38 juju-e4d256-prod-github-runner-207 kernel: [46672.605367] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 18:21:38 juju-e4d256-prod-github-runner-207 kernel: [46672.606377] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 18:21:38 juju-e4d256-prod-github-runner-207 kernel: [46672.607397] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 18:21:38 juju-e4d256-prod-github-runner-207 kernel: [46672.608438] vcpu_run+0x62/0x2c0 [kvm] Aug 22 18:21:38 juju-e4d256-prod-github-runner-207 kernel: [46672.609325] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 18:21:38 juju-e4d256-prod-github-runner-207 kernel: [46672.610222] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 18:21:38 juju-e4d256-prod-github-runner-207 kernel: [46672.611170] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 18:21:38 juju-e4d256-prod-github-runner-207 kernel: [46672.612143] ? __seccomp_filter+0x4a/0x4a0 Aug 22 18:21:38 juju-e4d256-prod-github-runner-207 kernel: [46672.612983] ? __fget_files+0x86/0xc0 Aug 22 18:21:38 juju-e4d256-prod-github-runner-207 kernel: [46672.613767] __x64_sys_ioctl+0x95/0xd0 Aug 22 18:21:38 juju-e4d256-prod-github-runner-207 kernel: [46672.614545] do_syscall_64+0x5c/0xc0 Aug 22 18:21:38 juju-e4d256-prod-github-runner-207 kernel: [46672.615283] ? do_futex+0x162/0x1f0 Aug 22 18:21:38 juju-e4d256-prod-github-runner-207 kernel: [46672.616030] ? __x64_sys_futex+0x78/0x1e0 Aug 22 18:21:38 juju-e4d256-prod-github-runner-207 kernel: [46672.616785] ? __secure_computing+0xa9/0x120 Aug 22 18:21:38 juju-e4d256-prod-github-runner-207 kernel: [46672.617703] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 18:21:38 juju-e4d256-prod-github-runner-207 kernel: [46672.618625] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:21:38 juju-e4d256-prod-github-runner-207 kernel: [46672.619495] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:21:38 juju-e4d256-prod-github-runner-207 kernel: [46672.620305] ? do_syscall_64+0x69/0xc0 Aug 22 18:21:38 juju-e4d256-prod-github-runner-207 kernel: [46672.621031] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:21:38 juju-e4d256-prod-github-runner-207 kernel: [46672.621827] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:21:38 juju-e4d256-prod-github-runner-207 kernel: [46672.622616] ? do_syscall_64+0x69/0xc0 Aug 22 18:21:38 juju-e4d256-prod-github-runner-207 kernel: [46672.623316] ? do_syscall_64+0x69/0xc0 Aug 22 18:21:38 juju-e4d256-prod-github-runner-207 kernel: [46672.624027] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 18:21:38 juju-e4d256-prod-github-runner-207 kernel: [46672.624827] RIP: 0033:0x7faa5d0edaff Aug 22 18:21:38 juju-e4d256-prod-github-runner-207 kernel: [46672.625525] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 18:21:38 juju-e4d256-prod-github-runner-207 kernel: [46672.627859] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 18:21:38 juju-e4d256-prod-github-runner-207 kernel: [46672.628907] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 18:21:38 juju-e4d256-prod-github-runner-207 kernel: [46672.629940] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 18:21:38 juju-e4d256-prod-github-runner-207 kernel: [46672.630961] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 18:21:38 juju-e4d256-prod-github-runner-207 kernel: [46672.631988] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 18:21:38 juju-e4d256-prod-github-runner-207 kernel: [46672.633009] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 18:21:38 juju-e4d256-prod-github-runner-207 kernel: [46672.634032] Aug 22 18:22:06 juju-e4d256-prod-github-runner-207 kernel: [46700.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 43385s! [qemu-system-x86:6715] Aug 22 18:22:06 juju-e4d256-prod-github-runner-207 kernel: [46700.543876] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 18:22:06 juju-e4d256-prod-github-runner-207 kernel: [46700.544192] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 18:22:06 juju-e4d256-prod-github-runner-207 kernel: [46700.557317] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 18:22:06 juju-e4d256-prod-github-runner-207 kernel: [46700.558579] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 18:22:06 juju-e4d256-prod-github-runner-207 kernel: [46700.559801] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:22:06 juju-e4d256-prod-github-runner-207 kernel: [46700.560853] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 18:22:06 juju-e4d256-prod-github-runner-207 kernel: [46700.563442] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 18:22:06 juju-e4d256-prod-github-runner-207 kernel: [46700.564498] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 18:22:06 juju-e4d256-prod-github-runner-207 kernel: [46700.565678] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 18:22:06 juju-e4d256-prod-github-runner-207 kernel: [46700.566841] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 18:22:06 juju-e4d256-prod-github-runner-207 kernel: [46700.568016] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 18:22:06 juju-e4d256-prod-github-runner-207 kernel: [46700.569173] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 18:22:06 juju-e4d256-prod-github-runner-207 kernel: [46700.570336] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 18:22:06 juju-e4d256-prod-github-runner-207 kernel: [46700.571601] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 18:22:06 juju-e4d256-prod-github-runner-207 kernel: [46700.572803] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 18:22:06 juju-e4d256-prod-github-runner-207 kernel: [46700.574073] Call Trace: Aug 22 18:22:06 juju-e4d256-prod-github-runner-207 kernel: [46700.574994] Aug 22 18:22:06 juju-e4d256-prod-github-runner-207 kernel: [46700.575916] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:22:06 juju-e4d256-prod-github-runner-207 kernel: [46700.576947] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:22:06 juju-e4d256-prod-github-runner-207 kernel: [46700.577970] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:22:06 juju-e4d256-prod-github-runner-207 kernel: [46700.579086] ? show_regs.part.0+0x23/0x29 Aug 22 18:22:06 juju-e4d256-prod-github-runner-207 kernel: [46700.580120] ? show_regs.cold+0x8/0xd Aug 22 18:22:06 juju-e4d256-prod-github-runner-207 kernel: [46700.581132] ? watchdog_timer_fn+0x1be/0x220 Aug 22 18:22:06 juju-e4d256-prod-github-runner-207 kernel: [46700.582160] ? lockup_detector_update_enable+0x60/0x60 Aug 22 18:22:06 juju-e4d256-prod-github-runner-207 kernel: [46700.583259] ? __hrtimer_run_queues+0x107/0x230 Aug 22 18:22:06 juju-e4d256-prod-github-runner-207 kernel: [46700.584294] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 18:22:06 juju-e4d256-prod-github-runner-207 kernel: [46700.585360] ? hrtimer_interrupt+0x101/0x220 Aug 22 18:22:06 juju-e4d256-prod-github-runner-207 kernel: [46700.586453] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 18:22:06 juju-e4d256-prod-github-runner-207 kernel: [46700.587572] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 18:22:06 juju-e4d256-prod-github-runner-207 kernel: [46700.588687] Aug 22 18:22:06 juju-e4d256-prod-github-runner-207 kernel: [46700.589579] Aug 22 18:22:06 juju-e4d256-prod-github-runner-207 kernel: [46700.590418] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 18:22:06 juju-e4d256-prod-github-runner-207 kernel: [46700.591549] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:22:06 juju-e4d256-prod-github-runner-207 kernel: [46700.592617] ? _raw_spin_lock+0x22/0x30 Aug 22 18:22:06 juju-e4d256-prod-github-runner-207 kernel: [46700.593568] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:22:06 juju-e4d256-prod-github-runner-207 kernel: [46700.594601] direct_page_fault+0x206/0x310 [kvm] Aug 22 18:22:06 juju-e4d256-prod-github-runner-207 kernel: [46700.595665] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 18:22:06 juju-e4d256-prod-github-runner-207 kernel: [46700.596689] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 18:22:06 juju-e4d256-prod-github-runner-207 kernel: [46700.597705] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 18:22:06 juju-e4d256-prod-github-runner-207 kernel: [46700.598719] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 18:22:06 juju-e4d256-prod-github-runner-207 kernel: [46700.599682] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 18:22:06 juju-e4d256-prod-github-runner-207 kernel: [46700.600662] handle_exit+0x98/0x230 [kvm_amd] Aug 22 18:22:06 juju-e4d256-prod-github-runner-207 kernel: [46700.601558] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 18:22:06 juju-e4d256-prod-github-runner-207 kernel: [46700.602480] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 18:22:06 juju-e4d256-prod-github-runner-207 kernel: [46700.603416] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 18:22:06 juju-e4d256-prod-github-runner-207 kernel: [46700.604322] vcpu_run+0x62/0x2c0 [kvm] Aug 22 18:22:06 juju-e4d256-prod-github-runner-207 kernel: [46700.605135] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 18:22:06 juju-e4d256-prod-github-runner-207 kernel: [46700.606019] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 18:22:06 juju-e4d256-prod-github-runner-207 kernel: [46700.606921] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 18:22:06 juju-e4d256-prod-github-runner-207 kernel: [46700.607742] ? __seccomp_filter+0x4a/0x4a0 Aug 22 18:22:06 juju-e4d256-prod-github-runner-207 kernel: [46700.608493] ? __fget_files+0x86/0xc0 Aug 22 18:22:06 juju-e4d256-prod-github-runner-207 kernel: [46700.609199] __x64_sys_ioctl+0x95/0xd0 Aug 22 18:22:06 juju-e4d256-prod-github-runner-207 kernel: [46700.609904] do_syscall_64+0x5c/0xc0 Aug 22 18:22:06 juju-e4d256-prod-github-runner-207 kernel: [46700.610624] ? do_futex+0x162/0x1f0 Aug 22 18:22:06 juju-e4d256-prod-github-runner-207 kernel: [46700.611297] ? __x64_sys_futex+0x78/0x1e0 Aug 22 18:22:06 juju-e4d256-prod-github-runner-207 kernel: [46700.612062] ? __secure_computing+0xa9/0x120 Aug 22 18:22:06 juju-e4d256-prod-github-runner-207 kernel: [46700.612756] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 18:22:06 juju-e4d256-prod-github-runner-207 kernel: [46700.613520] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:22:06 juju-e4d256-prod-github-runner-207 kernel: [46700.614252] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:22:06 juju-e4d256-prod-github-runner-207 kernel: [46700.614975] ? do_syscall_64+0x69/0xc0 Aug 22 18:22:06 juju-e4d256-prod-github-runner-207 kernel: [46700.615633] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:22:06 juju-e4d256-prod-github-runner-207 kernel: [46700.616336] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:22:06 juju-e4d256-prod-github-runner-207 kernel: [46700.617053] ? do_syscall_64+0x69/0xc0 Aug 22 18:22:06 juju-e4d256-prod-github-runner-207 kernel: [46700.617882] ? do_syscall_64+0x69/0xc0 Aug 22 18:22:06 juju-e4d256-prod-github-runner-207 kernel: [46700.618526] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 18:22:06 juju-e4d256-prod-github-runner-207 kernel: [46700.619266] RIP: 0033:0x7faa5d0edaff Aug 22 18:22:06 juju-e4d256-prod-github-runner-207 kernel: [46700.619928] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 18:22:06 juju-e4d256-prod-github-runner-207 kernel: [46700.621949] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 18:22:06 juju-e4d256-prod-github-runner-207 kernel: [46700.622869] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 18:22:06 juju-e4d256-prod-github-runner-207 kernel: [46700.623778] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 18:22:06 juju-e4d256-prod-github-runner-207 kernel: [46700.624673] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 18:22:06 juju-e4d256-prod-github-runner-207 kernel: [46700.625562] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 18:22:06 juju-e4d256-prod-github-runner-207 kernel: [46700.626451] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 18:22:06 juju-e4d256-prod-github-runner-207 kernel: [46700.627359] Aug 22 18:22:34 juju-e4d256-prod-github-runner-207 kernel: [46728.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 43411s! [qemu-system-x86:6715] Aug 22 18:22:34 juju-e4d256-prod-github-runner-207 kernel: [46728.543180] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 18:22:34 juju-e4d256-prod-github-runner-207 kernel: [46728.543255] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 18:22:34 juju-e4d256-prod-github-runner-207 kernel: [46728.556085] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 18:22:34 juju-e4d256-prod-github-runner-207 kernel: [46728.557362] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 18:22:34 juju-e4d256-prod-github-runner-207 kernel: [46728.558665] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:22:34 juju-e4d256-prod-github-runner-207 kernel: [46728.559759] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 18:22:34 juju-e4d256-prod-github-runner-207 kernel: [46728.562415] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 18:22:34 juju-e4d256-prod-github-runner-207 kernel: [46728.563501] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 18:22:34 juju-e4d256-prod-github-runner-207 kernel: [46728.564668] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 18:22:34 juju-e4d256-prod-github-runner-207 kernel: [46728.565837] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 18:22:34 juju-e4d256-prod-github-runner-207 kernel: [46728.567028] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 18:22:34 juju-e4d256-prod-github-runner-207 kernel: [46728.568198] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 18:22:34 juju-e4d256-prod-github-runner-207 kernel: [46728.569417] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 18:22:34 juju-e4d256-prod-github-runner-207 kernel: [46728.570671] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 18:22:34 juju-e4d256-prod-github-runner-207 kernel: [46728.571787] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 18:22:34 juju-e4d256-prod-github-runner-207 kernel: [46728.572989] Call Trace: Aug 22 18:22:34 juju-e4d256-prod-github-runner-207 kernel: [46728.573900] Aug 22 18:22:34 juju-e4d256-prod-github-runner-207 kernel: [46728.574814] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:22:34 juju-e4d256-prod-github-runner-207 kernel: [46728.575845] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:22:34 juju-e4d256-prod-github-runner-207 kernel: [46728.576867] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:22:34 juju-e4d256-prod-github-runner-207 kernel: [46728.577942] ? show_regs.part.0+0x23/0x29 Aug 22 18:22:34 juju-e4d256-prod-github-runner-207 kernel: [46728.578954] ? show_regs.cold+0x8/0xd Aug 22 18:22:34 juju-e4d256-prod-github-runner-207 kernel: [46728.579932] ? watchdog_timer_fn+0x1be/0x220 Aug 22 18:22:34 juju-e4d256-prod-github-runner-207 kernel: [46728.580973] ? lockup_detector_update_enable+0x60/0x60 Aug 22 18:22:34 juju-e4d256-prod-github-runner-207 kernel: [46728.582043] ? __hrtimer_run_queues+0x107/0x230 Aug 22 18:22:34 juju-e4d256-prod-github-runner-207 kernel: [46728.583095] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 18:22:34 juju-e4d256-prod-github-runner-207 kernel: [46728.584121] ? hrtimer_interrupt+0x101/0x220 Aug 22 18:22:34 juju-e4d256-prod-github-runner-207 kernel: [46728.585146] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 18:22:34 juju-e4d256-prod-github-runner-207 kernel: [46728.586259] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 18:22:34 juju-e4d256-prod-github-runner-207 kernel: [46728.587330] Aug 22 18:22:34 juju-e4d256-prod-github-runner-207 kernel: [46728.588185] Aug 22 18:22:34 juju-e4d256-prod-github-runner-207 kernel: [46728.589148] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 18:22:34 juju-e4d256-prod-github-runner-207 kernel: [46728.590785] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:22:34 juju-e4d256-prod-github-runner-207 kernel: [46728.591831] ? _raw_spin_lock+0x22/0x30 Aug 22 18:22:34 juju-e4d256-prod-github-runner-207 kernel: [46728.592970] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:22:34 juju-e4d256-prod-github-runner-207 kernel: [46728.593995] direct_page_fault+0x206/0x310 [kvm] Aug 22 18:22:34 juju-e4d256-prod-github-runner-207 kernel: [46728.595047] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 18:22:34 juju-e4d256-prod-github-runner-207 kernel: [46728.596075] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 18:22:34 juju-e4d256-prod-github-runner-207 kernel: [46728.597076] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 18:22:34 juju-e4d256-prod-github-runner-207 kernel: [46728.598166] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 18:22:34 juju-e4d256-prod-github-runner-207 kernel: [46728.599385] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 18:22:34 juju-e4d256-prod-github-runner-207 kernel: [46728.600378] handle_exit+0x98/0x230 [kvm_amd] Aug 22 18:22:34 juju-e4d256-prod-github-runner-207 kernel: [46728.601283] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 18:22:34 juju-e4d256-prod-github-runner-207 kernel: [46728.602225] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 18:22:34 juju-e4d256-prod-github-runner-207 kernel: [46728.603202] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 18:22:34 juju-e4d256-prod-github-runner-207 kernel: [46728.604116] vcpu_run+0x62/0x2c0 [kvm] Aug 22 18:22:34 juju-e4d256-prod-github-runner-207 kernel: [46728.604927] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 18:22:34 juju-e4d256-prod-github-runner-207 kernel: [46728.605744] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 18:22:34 juju-e4d256-prod-github-runner-207 kernel: [46728.606598] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 18:22:34 juju-e4d256-prod-github-runner-207 kernel: [46728.607460] ? __seccomp_filter+0x4a/0x4a0 Aug 22 18:22:34 juju-e4d256-prod-github-runner-207 kernel: [46728.608213] ? __fget_files+0x86/0xc0 Aug 22 18:22:34 juju-e4d256-prod-github-runner-207 kernel: [46728.608928] __x64_sys_ioctl+0x95/0xd0 Aug 22 18:22:34 juju-e4d256-prod-github-runner-207 kernel: [46728.609659] do_syscall_64+0x5c/0xc0 Aug 22 18:22:34 juju-e4d256-prod-github-runner-207 kernel: [46728.610329] ? do_futex+0x162/0x1f0 Aug 22 18:22:34 juju-e4d256-prod-github-runner-207 kernel: [46728.611002] ? __x64_sys_futex+0x78/0x1e0 Aug 22 18:22:34 juju-e4d256-prod-github-runner-207 kernel: [46728.611684] ? __secure_computing+0xa9/0x120 Aug 22 18:22:34 juju-e4d256-prod-github-runner-207 kernel: [46728.612375] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 18:22:34 juju-e4d256-prod-github-runner-207 kernel: [46728.613154] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:22:34 juju-e4d256-prod-github-runner-207 kernel: [46728.613925] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:22:34 juju-e4d256-prod-github-runner-207 kernel: [46728.614651] ? do_syscall_64+0x69/0xc0 Aug 22 18:22:34 juju-e4d256-prod-github-runner-207 kernel: [46728.615307] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:22:34 juju-e4d256-prod-github-runner-207 kernel: [46728.616010] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:22:34 juju-e4d256-prod-github-runner-207 kernel: [46728.616705] ? do_syscall_64+0x69/0xc0 Aug 22 18:22:34 juju-e4d256-prod-github-runner-207 kernel: [46728.617333] ? do_syscall_64+0x69/0xc0 Aug 22 18:22:34 juju-e4d256-prod-github-runner-207 kernel: [46728.617961] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 18:22:34 juju-e4d256-prod-github-runner-207 kernel: [46728.618674] RIP: 0033:0x7faa5d0edaff Aug 22 18:22:34 juju-e4d256-prod-github-runner-207 kernel: [46728.619361] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 18:22:34 juju-e4d256-prod-github-runner-207 kernel: [46728.621392] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 18:22:34 juju-e4d256-prod-github-runner-207 kernel: [46728.622310] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 18:22:34 juju-e4d256-prod-github-runner-207 kernel: [46728.623259] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 18:22:34 juju-e4d256-prod-github-runner-207 kernel: [46728.624167] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 18:22:34 juju-e4d256-prod-github-runner-207 kernel: [46728.625065] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 18:22:34 juju-e4d256-prod-github-runner-207 kernel: [46728.625956] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 18:22:34 juju-e4d256-prod-github-runner-207 kernel: [46728.626869] Aug 22 18:23:02 juju-e4d256-prod-github-runner-207 kernel: [46756.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 43437s! [qemu-system-x86:6715] Aug 22 18:23:02 juju-e4d256-prod-github-runner-207 kernel: [46756.543125] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 18:23:02 juju-e4d256-prod-github-runner-207 kernel: [46756.543198] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 18:23:02 juju-e4d256-prod-github-runner-207 kernel: [46756.558071] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 18:23:02 juju-e4d256-prod-github-runner-207 kernel: [46756.559812] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 18:23:02 juju-e4d256-prod-github-runner-207 kernel: [46756.561231] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:23:02 juju-e4d256-prod-github-runner-207 kernel: [46756.562491] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 18:23:02 juju-e4d256-prod-github-runner-207 kernel: [46756.566014] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 18:23:02 juju-e4d256-prod-github-runner-207 kernel: [46756.567776] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 18:23:02 juju-e4d256-prod-github-runner-207 kernel: [46756.569592] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 18:23:02 juju-e4d256-prod-github-runner-207 kernel: [46756.571005] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 18:23:02 juju-e4d256-prod-github-runner-207 kernel: [46756.572320] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 18:23:02 juju-e4d256-prod-github-runner-207 kernel: [46756.573781] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 18:23:02 juju-e4d256-prod-github-runner-207 kernel: [46756.575106] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 18:23:02 juju-e4d256-prod-github-runner-207 kernel: [46756.576982] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 18:23:02 juju-e4d256-prod-github-runner-207 kernel: [46756.578770] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 18:23:02 juju-e4d256-prod-github-runner-207 kernel: [46756.580660] Call Trace: Aug 22 18:23:02 juju-e4d256-prod-github-runner-207 kernel: [46756.581752] Aug 22 18:23:02 juju-e4d256-prod-github-runner-207 kernel: [46756.582778] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:23:02 juju-e4d256-prod-github-runner-207 kernel: [46756.583965] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:23:02 juju-e4d256-prod-github-runner-207 kernel: [46756.585319] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:23:02 juju-e4d256-prod-github-runner-207 kernel: [46756.587027] ? show_regs.part.0+0x23/0x29 Aug 22 18:23:02 juju-e4d256-prod-github-runner-207 kernel: [46756.588612] ? show_regs.cold+0x8/0xd Aug 22 18:23:02 juju-e4d256-prod-github-runner-207 kernel: [46756.590219] ? watchdog_timer_fn+0x1be/0x220 Aug 22 18:23:02 juju-e4d256-prod-github-runner-207 kernel: [46756.591718] ? lockup_detector_update_enable+0x60/0x60 Aug 22 18:23:02 juju-e4d256-prod-github-runner-207 kernel: [46756.592803] ? __hrtimer_run_queues+0x107/0x230 Aug 22 18:23:02 juju-e4d256-prod-github-runner-207 kernel: [46756.593876] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 18:23:02 juju-e4d256-prod-github-runner-207 kernel: [46756.594933] ? hrtimer_interrupt+0x101/0x220 Aug 22 18:23:02 juju-e4d256-prod-github-runner-207 kernel: [46756.595951] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 18:23:02 juju-e4d256-prod-github-runner-207 kernel: [46756.597027] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 18:23:02 juju-e4d256-prod-github-runner-207 kernel: [46756.598074] Aug 22 18:23:02 juju-e4d256-prod-github-runner-207 kernel: [46756.598956] Aug 22 18:23:02 juju-e4d256-prod-github-runner-207 kernel: [46756.599799] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 18:23:02 juju-e4d256-prod-github-runner-207 kernel: [46756.600856] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:23:02 juju-e4d256-prod-github-runner-207 kernel: [46756.602041] ? _raw_spin_lock+0x22/0x30 Aug 22 18:23:02 juju-e4d256-prod-github-runner-207 kernel: [46756.603199] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:23:02 juju-e4d256-prod-github-runner-207 kernel: [46756.604254] direct_page_fault+0x206/0x310 [kvm] Aug 22 18:23:02 juju-e4d256-prod-github-runner-207 kernel: [46756.605308] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 18:23:02 juju-e4d256-prod-github-runner-207 kernel: [46756.606326] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 18:23:02 juju-e4d256-prod-github-runner-207 kernel: [46756.607408] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 18:23:02 juju-e4d256-prod-github-runner-207 kernel: [46756.608388] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 18:23:02 juju-e4d256-prod-github-runner-207 kernel: [46756.609350] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 18:23:02 juju-e4d256-prod-github-runner-207 kernel: [46756.610366] handle_exit+0x98/0x230 [kvm_amd] Aug 22 18:23:02 juju-e4d256-prod-github-runner-207 kernel: [46756.611338] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 18:23:02 juju-e4d256-prod-github-runner-207 kernel: [46756.612302] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 18:23:02 juju-e4d256-prod-github-runner-207 kernel: [46756.613237] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 18:23:02 juju-e4d256-prod-github-runner-207 kernel: [46756.614143] vcpu_run+0x62/0x2c0 [kvm] Aug 22 18:23:02 juju-e4d256-prod-github-runner-207 kernel: [46756.614980] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 18:23:02 juju-e4d256-prod-github-runner-207 kernel: [46756.615791] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 18:23:02 juju-e4d256-prod-github-runner-207 kernel: [46756.616707] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 18:23:02 juju-e4d256-prod-github-runner-207 kernel: [46756.617542] ? __seccomp_filter+0x4a/0x4a0 Aug 22 18:23:02 juju-e4d256-prod-github-runner-207 kernel: [46756.618310] ? __fget_files+0x86/0xc0 Aug 22 18:23:02 juju-e4d256-prod-github-runner-207 kernel: [46756.619317] __x64_sys_ioctl+0x95/0xd0 Aug 22 18:23:02 juju-e4d256-prod-github-runner-207 kernel: [46756.620322] do_syscall_64+0x5c/0xc0 Aug 22 18:23:02 juju-e4d256-prod-github-runner-207 kernel: [46756.621330] ? do_futex+0x162/0x1f0 Aug 22 18:23:02 juju-e4d256-prod-github-runner-207 kernel: [46756.622047] ? __x64_sys_futex+0x78/0x1e0 Aug 22 18:23:02 juju-e4d256-prod-github-runner-207 kernel: [46756.622875] ? __secure_computing+0xa9/0x120 Aug 22 18:23:02 juju-e4d256-prod-github-runner-207 kernel: [46756.623798] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 18:23:02 juju-e4d256-prod-github-runner-207 kernel: [46756.624682] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:23:02 juju-e4d256-prod-github-runner-207 kernel: [46756.625446] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:23:02 juju-e4d256-prod-github-runner-207 kernel: [46756.626302] ? do_syscall_64+0x69/0xc0 Aug 22 18:23:02 juju-e4d256-prod-github-runner-207 kernel: [46756.627045] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:23:02 juju-e4d256-prod-github-runner-207 kernel: [46756.627753] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:23:02 juju-e4d256-prod-github-runner-207 kernel: [46756.628457] ? do_syscall_64+0x69/0xc0 Aug 22 18:23:02 juju-e4d256-prod-github-runner-207 kernel: [46756.629095] ? do_syscall_64+0x69/0xc0 Aug 22 18:23:02 juju-e4d256-prod-github-runner-207 kernel: [46756.629730] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 18:23:02 juju-e4d256-prod-github-runner-207 kernel: [46756.630473] RIP: 0033:0x7faa5d0edaff Aug 22 18:23:02 juju-e4d256-prod-github-runner-207 kernel: [46756.631121] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 18:23:02 juju-e4d256-prod-github-runner-207 kernel: [46756.633152] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 18:23:02 juju-e4d256-prod-github-runner-207 kernel: [46756.634082] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 18:23:02 juju-e4d256-prod-github-runner-207 kernel: [46756.635016] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 18:23:02 juju-e4d256-prod-github-runner-207 kernel: [46756.635926] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 18:23:02 juju-e4d256-prod-github-runner-207 kernel: [46756.636829] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 18:23:02 juju-e4d256-prod-github-runner-207 kernel: [46756.637736] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 18:23:02 juju-e4d256-prod-github-runner-207 kernel: [46756.638691] Aug 22 18:23:30 juju-e4d256-prod-github-runner-207 kernel: [46784.541983] watchdog: BUG: soft lockup - CPU#1 stuck for 43463s! [qemu-system-x86:6715] Aug 22 18:23:30 juju-e4d256-prod-github-runner-207 kernel: [46784.544055] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 18:23:30 juju-e4d256-prod-github-runner-207 kernel: [46784.544338] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 18:23:30 juju-e4d256-prod-github-runner-207 kernel: [46784.558707] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 18:23:30 juju-e4d256-prod-github-runner-207 kernel: [46784.560168] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 18:23:30 juju-e4d256-prod-github-runner-207 kernel: [46784.561634] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:23:30 juju-e4d256-prod-github-runner-207 kernel: [46784.562938] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 18:23:30 juju-e4d256-prod-github-runner-207 kernel: [46784.565543] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 18:23:30 juju-e4d256-prod-github-runner-207 kernel: [46784.566608] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 18:23:30 juju-e4d256-prod-github-runner-207 kernel: [46784.567784] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 18:23:30 juju-e4d256-prod-github-runner-207 kernel: [46784.568948] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 18:23:30 juju-e4d256-prod-github-runner-207 kernel: [46784.570128] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 18:23:30 juju-e4d256-prod-github-runner-207 kernel: [46784.571301] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 18:23:30 juju-e4d256-prod-github-runner-207 kernel: [46784.572472] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 18:23:30 juju-e4d256-prod-github-runner-207 kernel: [46784.573717] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 18:23:30 juju-e4d256-prod-github-runner-207 kernel: [46784.575315] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 18:23:30 juju-e4d256-prod-github-runner-207 kernel: [46784.576540] Call Trace: Aug 22 18:23:30 juju-e4d256-prod-github-runner-207 kernel: [46784.577464] Aug 22 18:23:30 juju-e4d256-prod-github-runner-207 kernel: [46784.578386] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:23:30 juju-e4d256-prod-github-runner-207 kernel: [46784.579426] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:23:30 juju-e4d256-prod-github-runner-207 kernel: [46784.580454] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:23:30 juju-e4d256-prod-github-runner-207 kernel: [46784.581561] ? show_regs.part.0+0x23/0x29 Aug 22 18:23:30 juju-e4d256-prod-github-runner-207 kernel: [46784.582603] ? show_regs.cold+0x8/0xd Aug 22 18:23:30 juju-e4d256-prod-github-runner-207 kernel: [46784.583591] ? watchdog_timer_fn+0x1be/0x220 Aug 22 18:23:30 juju-e4d256-prod-github-runner-207 kernel: [46784.584611] ? lockup_detector_update_enable+0x60/0x60 Aug 22 18:23:30 juju-e4d256-prod-github-runner-207 kernel: [46784.585698] ? __hrtimer_run_queues+0x107/0x230 Aug 22 18:23:30 juju-e4d256-prod-github-runner-207 kernel: [46784.586751] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 18:23:30 juju-e4d256-prod-github-runner-207 kernel: [46784.587797] ? hrtimer_interrupt+0x101/0x220 Aug 22 18:23:30 juju-e4d256-prod-github-runner-207 kernel: [46784.588829] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 18:23:30 juju-e4d256-prod-github-runner-207 kernel: [46784.589909] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 18:23:30 juju-e4d256-prod-github-runner-207 kernel: [46784.590987] Aug 22 18:23:30 juju-e4d256-prod-github-runner-207 kernel: [46784.591852] Aug 22 18:23:30 juju-e4d256-prod-github-runner-207 kernel: [46784.592753] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 18:23:30 juju-e4d256-prod-github-runner-207 kernel: [46784.594016] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:23:30 juju-e4d256-prod-github-runner-207 kernel: [46784.595080] ? _raw_spin_lock+0x22/0x30 Aug 22 18:23:30 juju-e4d256-prod-github-runner-207 kernel: [46784.596036] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:23:30 juju-e4d256-prod-github-runner-207 kernel: [46784.597077] direct_page_fault+0x206/0x310 [kvm] Aug 22 18:23:30 juju-e4d256-prod-github-runner-207 kernel: [46784.598207] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 18:23:30 juju-e4d256-prod-github-runner-207 kernel: [46784.599282] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 18:23:30 juju-e4d256-prod-github-runner-207 kernel: [46784.600292] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 18:23:30 juju-e4d256-prod-github-runner-207 kernel: [46784.601311] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 18:23:30 juju-e4d256-prod-github-runner-207 kernel: [46784.602293] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 18:23:30 juju-e4d256-prod-github-runner-207 kernel: [46784.603281] handle_exit+0x98/0x230 [kvm_amd] Aug 22 18:23:30 juju-e4d256-prod-github-runner-207 kernel: [46784.604182] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 18:23:30 juju-e4d256-prod-github-runner-207 kernel: [46784.605106] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 18:23:30 juju-e4d256-prod-github-runner-207 kernel: [46784.606061] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 18:23:30 juju-e4d256-prod-github-runner-207 kernel: [46784.606973] vcpu_run+0x62/0x2c0 [kvm] Aug 22 18:23:30 juju-e4d256-prod-github-runner-207 kernel: [46784.607844] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 18:23:30 juju-e4d256-prod-github-runner-207 kernel: [46784.608680] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 18:23:30 juju-e4d256-prod-github-runner-207 kernel: [46784.609598] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 18:23:30 juju-e4d256-prod-github-runner-207 kernel: [46784.610446] ? __seccomp_filter+0x4a/0x4a0 Aug 22 18:23:30 juju-e4d256-prod-github-runner-207 kernel: [46784.611202] ? __fget_files+0x86/0xc0 Aug 22 18:23:30 juju-e4d256-prod-github-runner-207 kernel: [46784.611915] __x64_sys_ioctl+0x95/0xd0 Aug 22 18:23:30 juju-e4d256-prod-github-runner-207 kernel: [46784.612640] do_syscall_64+0x5c/0xc0 Aug 22 18:23:30 juju-e4d256-prod-github-runner-207 kernel: [46784.613320] ? do_futex+0x162/0x1f0 Aug 22 18:23:30 juju-e4d256-prod-github-runner-207 kernel: [46784.613975] ? __x64_sys_futex+0x78/0x1e0 Aug 22 18:23:30 juju-e4d256-prod-github-runner-207 kernel: [46784.614666] ? __secure_computing+0xa9/0x120 Aug 22 18:23:30 juju-e4d256-prod-github-runner-207 kernel: [46784.615539] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 18:23:30 juju-e4d256-prod-github-runner-207 kernel: [46784.616306] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:23:30 juju-e4d256-prod-github-runner-207 kernel: [46784.617032] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:23:30 juju-e4d256-prod-github-runner-207 kernel: [46784.617761] ? do_syscall_64+0x69/0xc0 Aug 22 18:23:30 juju-e4d256-prod-github-runner-207 kernel: [46784.618425] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:23:30 juju-e4d256-prod-github-runner-207 kernel: [46784.619132] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:23:30 juju-e4d256-prod-github-runner-207 kernel: [46784.619836] ? do_syscall_64+0x69/0xc0 Aug 22 18:23:30 juju-e4d256-prod-github-runner-207 kernel: [46784.620469] ? do_syscall_64+0x69/0xc0 Aug 22 18:23:30 juju-e4d256-prod-github-runner-207 kernel: [46784.621098] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 18:23:30 juju-e4d256-prod-github-runner-207 kernel: [46784.621809] RIP: 0033:0x7faa5d0edaff Aug 22 18:23:30 juju-e4d256-prod-github-runner-207 kernel: [46784.622564] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 18:23:30 juju-e4d256-prod-github-runner-207 kernel: [46784.624768] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 18:23:30 juju-e4d256-prod-github-runner-207 kernel: [46784.625692] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 18:23:30 juju-e4d256-prod-github-runner-207 kernel: [46784.626662] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 18:23:30 juju-e4d256-prod-github-runner-207 kernel: [46784.627577] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 18:23:30 juju-e4d256-prod-github-runner-207 kernel: [46784.628485] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 18:23:30 juju-e4d256-prod-github-runner-207 kernel: [46784.629391] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 18:23:30 juju-e4d256-prod-github-runner-207 kernel: [46784.630318] Aug 22 18:23:46 juju-e4d256-prod-github-runner-207 kernel: [46800.308706] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 18:23:46 juju-e4d256-prod-github-runner-207 kernel: [46800.310513] rcu: 1-....: (11634182 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=5629798 Aug 22 18:23:46 juju-e4d256-prod-github-runner-207 kernel: [46800.311642] (t=11670777 jiffies g=23269 q=45563) Aug 22 18:23:46 juju-e4d256-prod-github-runner-207 kernel: [46800.312428] NMI backtrace for cpu 1 Aug 22 18:23:46 juju-e4d256-prod-github-runner-207 kernel: [46800.313140] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 18:23:46 juju-e4d256-prod-github-runner-207 kernel: [46800.314268] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 18:23:46 juju-e4d256-prod-github-runner-207 kernel: [46800.315362] Call Trace: Aug 22 18:23:46 juju-e4d256-prod-github-runner-207 kernel: [46800.316037] Aug 22 18:23:46 juju-e4d256-prod-github-runner-207 kernel: [46800.316697] show_stack+0x52/0x5c Aug 22 18:23:46 juju-e4d256-prod-github-runner-207 kernel: [46800.317422] dump_stack_lvl+0x4a/0x63 Aug 22 18:23:46 juju-e4d256-prod-github-runner-207 kernel: [46800.318187] dump_stack+0x10/0x16 Aug 22 18:23:46 juju-e4d256-prod-github-runner-207 kernel: [46800.318919] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 18:23:46 juju-e4d256-prod-github-runner-207 kernel: [46800.319729] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 18:23:46 juju-e4d256-prod-github-runner-207 kernel: [46800.320515] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 18:23:46 juju-e4d256-prod-github-runner-207 kernel: [46800.321332] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 18:23:46 juju-e4d256-prod-github-runner-207 kernel: [46800.322172] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 18:23:46 juju-e4d256-prod-github-runner-207 kernel: [46800.322984] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 18:23:46 juju-e4d256-prod-github-runner-207 kernel: [46800.323761] print_cpu_stall.cold+0x2f/0xe2 Aug 22 18:23:46 juju-e4d256-prod-github-runner-207 kernel: [46800.324536] ? timekeeping_update+0xf7/0x150 Aug 22 18:23:46 juju-e4d256-prod-github-runner-207 kernel: [46800.325324] check_cpu_stall+0x109/0x270 Aug 22 18:23:46 juju-e4d256-prod-github-runner-207 kernel: [46800.326096] rcu_sched_clock_irq+0x9a/0x250 Aug 22 18:23:46 juju-e4d256-prod-github-runner-207 kernel: [46800.326950] update_process_times+0x94/0xd0 Aug 22 18:23:46 juju-e4d256-prod-github-runner-207 kernel: [46800.327724] tick_sched_handle+0x29/0x70 Aug 22 18:23:46 juju-e4d256-prod-github-runner-207 kernel: [46800.328491] tick_sched_timer+0x8c/0xc0 Aug 22 18:23:46 juju-e4d256-prod-github-runner-207 kernel: [46800.329258] ? tick_nohz_handler+0xb0/0xb0 Aug 22 18:23:46 juju-e4d256-prod-github-runner-207 kernel: [46800.330060] __hrtimer_run_queues+0x107/0x230 Aug 22 18:23:46 juju-e4d256-prod-github-runner-207 kernel: [46800.330890] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 18:23:46 juju-e4d256-prod-github-runner-207 kernel: [46800.331754] hrtimer_interrupt+0x101/0x220 Aug 22 18:23:46 juju-e4d256-prod-github-runner-207 kernel: [46800.332548] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 18:23:46 juju-e4d256-prod-github-runner-207 kernel: [46800.333376] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 18:23:46 juju-e4d256-prod-github-runner-207 kernel: [46800.334226] Aug 22 18:23:46 juju-e4d256-prod-github-runner-207 kernel: [46800.334881] Aug 22 18:23:46 juju-e4d256-prod-github-runner-207 kernel: [46800.335528] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 18:23:46 juju-e4d256-prod-github-runner-207 kernel: [46800.336352] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:23:46 juju-e4d256-prod-github-runner-207 kernel: [46800.337231] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 18:23:46 juju-e4d256-prod-github-runner-207 kernel: [46800.339486] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 18:23:46 juju-e4d256-prod-github-runner-207 kernel: [46800.340404] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 18:23:46 juju-e4d256-prod-github-runner-207 kernel: [46800.341466] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 18:23:46 juju-e4d256-prod-github-runner-207 kernel: [46800.342467] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 18:23:46 juju-e4d256-prod-github-runner-207 kernel: [46800.343427] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 18:23:46 juju-e4d256-prod-github-runner-207 kernel: [46800.344384] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 18:23:46 juju-e4d256-prod-github-runner-207 kernel: [46800.345357] ? _raw_spin_lock+0x22/0x30 Aug 22 18:23:46 juju-e4d256-prod-github-runner-207 kernel: [46800.346154] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:23:46 juju-e4d256-prod-github-runner-207 kernel: [46800.347014] direct_page_fault+0x206/0x310 [kvm] Aug 22 18:23:46 juju-e4d256-prod-github-runner-207 kernel: [46800.347859] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 18:23:46 juju-e4d256-prod-github-runner-207 kernel: [46800.348683] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 18:23:46 juju-e4d256-prod-github-runner-207 kernel: [46800.349538] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 18:23:46 juju-e4d256-prod-github-runner-207 kernel: [46800.350422] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 18:23:46 juju-e4d256-prod-github-runner-207 kernel: [46800.351230] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 18:23:46 juju-e4d256-prod-github-runner-207 kernel: [46800.352084] handle_exit+0x98/0x230 [kvm_amd] Aug 22 18:23:46 juju-e4d256-prod-github-runner-207 kernel: [46800.352861] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 18:23:46 juju-e4d256-prod-github-runner-207 kernel: [46800.353657] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 18:23:46 juju-e4d256-prod-github-runner-207 kernel: [46800.354474] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 18:23:46 juju-e4d256-prod-github-runner-207 kernel: [46800.355260] vcpu_run+0x62/0x2c0 [kvm] Aug 22 18:23:46 juju-e4d256-prod-github-runner-207 kernel: [46800.355994] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 18:23:46 juju-e4d256-prod-github-runner-207 kernel: [46800.356742] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 18:23:46 juju-e4d256-prod-github-runner-207 kernel: [46800.357547] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 18:23:46 juju-e4d256-prod-github-runner-207 kernel: [46800.358339] ? __seccomp_filter+0x4a/0x4a0 Aug 22 18:23:46 juju-e4d256-prod-github-runner-207 kernel: [46800.359074] ? __fget_files+0x86/0xc0 Aug 22 18:23:46 juju-e4d256-prod-github-runner-207 kernel: [46800.359779] __x64_sys_ioctl+0x95/0xd0 Aug 22 18:23:46 juju-e4d256-prod-github-runner-207 kernel: [46800.360477] do_syscall_64+0x5c/0xc0 Aug 22 18:23:46 juju-e4d256-prod-github-runner-207 kernel: [46800.361193] ? do_futex+0x162/0x1f0 Aug 22 18:23:46 juju-e4d256-prod-github-runner-207 kernel: [46800.361914] ? __x64_sys_futex+0x78/0x1e0 Aug 22 18:23:46 juju-e4d256-prod-github-runner-207 kernel: [46800.362621] ? __secure_computing+0xa9/0x120 Aug 22 18:23:46 juju-e4d256-prod-github-runner-207 kernel: [46800.363379] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 18:23:46 juju-e4d256-prod-github-runner-207 kernel: [46800.364479] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:23:46 juju-e4d256-prod-github-runner-207 kernel: [46800.365251] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:23:46 juju-e4d256-prod-github-runner-207 kernel: [46800.366070] ? do_syscall_64+0x69/0xc0 Aug 22 18:23:46 juju-e4d256-prod-github-runner-207 kernel: [46800.366799] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:23:46 juju-e4d256-prod-github-runner-207 kernel: [46800.367614] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:23:46 juju-e4d256-prod-github-runner-207 kernel: [46800.368375] ? do_syscall_64+0x69/0xc0 Aug 22 18:23:46 juju-e4d256-prod-github-runner-207 kernel: [46800.369073] ? do_syscall_64+0x69/0xc0 Aug 22 18:23:46 juju-e4d256-prod-github-runner-207 kernel: [46800.369820] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 18:23:46 juju-e4d256-prod-github-runner-207 kernel: [46800.370620] RIP: 0033:0x7faa5d0edaff Aug 22 18:23:46 juju-e4d256-prod-github-runner-207 kernel: [46800.371394] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 18:23:46 juju-e4d256-prod-github-runner-207 kernel: [46800.373515] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 18:23:46 juju-e4d256-prod-github-runner-207 kernel: [46800.374505] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 18:23:46 juju-e4d256-prod-github-runner-207 kernel: [46800.375461] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 18:23:46 juju-e4d256-prod-github-runner-207 kernel: [46800.376414] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 18:23:46 juju-e4d256-prod-github-runner-207 kernel: [46800.377371] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 18:23:46 juju-e4d256-prod-github-runner-207 kernel: [46800.378314] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 18:23:46 juju-e4d256-prod-github-runner-207 kernel: [46800.379244] Aug 22 18:24:10 juju-e4d256-prod-github-runner-207 kernel: [46824.541982] watchdog: BUG: soft lockup - CPU#1 stuck for 43500s! [qemu-system-x86:6715] Aug 22 18:24:10 juju-e4d256-prod-github-runner-207 kernel: [46824.545715] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 18:24:10 juju-e4d256-prod-github-runner-207 kernel: [46824.546497] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 18:24:10 juju-e4d256-prod-github-runner-207 kernel: [46824.561170] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 18:24:10 juju-e4d256-prod-github-runner-207 kernel: [46824.562459] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 18:24:10 juju-e4d256-prod-github-runner-207 kernel: [46824.563690] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:24:10 juju-e4d256-prod-github-runner-207 kernel: [46824.564745] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 18:24:10 juju-e4d256-prod-github-runner-207 kernel: [46824.567301] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 18:24:10 juju-e4d256-prod-github-runner-207 kernel: [46824.568342] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 18:24:10 juju-e4d256-prod-github-runner-207 kernel: [46824.569523] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 18:24:10 juju-e4d256-prod-github-runner-207 kernel: [46824.570684] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 18:24:10 juju-e4d256-prod-github-runner-207 kernel: [46824.571842] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 18:24:10 juju-e4d256-prod-github-runner-207 kernel: [46824.573030] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 18:24:10 juju-e4d256-prod-github-runner-207 kernel: [46824.574214] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 18:24:10 juju-e4d256-prod-github-runner-207 kernel: [46824.575463] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 18:24:10 juju-e4d256-prod-github-runner-207 kernel: [46824.576558] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 18:24:10 juju-e4d256-prod-github-runner-207 kernel: [46824.577775] Call Trace: Aug 22 18:24:10 juju-e4d256-prod-github-runner-207 kernel: [46824.578686] Aug 22 18:24:10 juju-e4d256-prod-github-runner-207 kernel: [46824.579581] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:24:10 juju-e4d256-prod-github-runner-207 kernel: [46824.580607] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:24:10 juju-e4d256-prod-github-runner-207 kernel: [46824.581638] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:24:10 juju-e4d256-prod-github-runner-207 kernel: [46824.582738] ? show_regs.part.0+0x23/0x29 Aug 22 18:24:10 juju-e4d256-prod-github-runner-207 kernel: [46824.583733] ? show_regs.cold+0x8/0xd Aug 22 18:24:10 juju-e4d256-prod-github-runner-207 kernel: [46824.584704] ? watchdog_timer_fn+0x1be/0x220 Aug 22 18:24:10 juju-e4d256-prod-github-runner-207 kernel: [46824.585718] ? lockup_detector_update_enable+0x60/0x60 Aug 22 18:24:10 juju-e4d256-prod-github-runner-207 kernel: [46824.586781] ? __hrtimer_run_queues+0x107/0x230 Aug 22 18:24:10 juju-e4d256-prod-github-runner-207 kernel: [46824.587805] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 18:24:10 juju-e4d256-prod-github-runner-207 kernel: [46824.588834] ? hrtimer_interrupt+0x101/0x220 Aug 22 18:24:10 juju-e4d256-prod-github-runner-207 kernel: [46824.590017] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 18:24:10 juju-e4d256-prod-github-runner-207 kernel: [46824.591560] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 18:24:10 juju-e4d256-prod-github-runner-207 kernel: [46824.592709] Aug 22 18:24:10 juju-e4d256-prod-github-runner-207 kernel: [46824.593660] Aug 22 18:24:10 juju-e4d256-prod-github-runner-207 kernel: [46824.594562] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 18:24:10 juju-e4d256-prod-github-runner-207 kernel: [46824.595902] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:24:10 juju-e4d256-prod-github-runner-207 kernel: [46824.597106] ? _raw_spin_lock+0x22/0x30 Aug 22 18:24:10 juju-e4d256-prod-github-runner-207 kernel: [46824.598192] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:24:10 juju-e4d256-prod-github-runner-207 kernel: [46824.599323] direct_page_fault+0x206/0x310 [kvm] Aug 22 18:24:10 juju-e4d256-prod-github-runner-207 kernel: [46824.600397] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 18:24:10 juju-e4d256-prod-github-runner-207 kernel: [46824.601440] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 18:24:10 juju-e4d256-prod-github-runner-207 kernel: [46824.602545] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 18:24:10 juju-e4d256-prod-github-runner-207 kernel: [46824.603613] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 18:24:10 juju-e4d256-prod-github-runner-207 kernel: [46824.604596] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 18:24:10 juju-e4d256-prod-github-runner-207 kernel: [46824.605620] handle_exit+0x98/0x230 [kvm_amd] Aug 22 18:24:10 juju-e4d256-prod-github-runner-207 kernel: [46824.606521] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 18:24:10 juju-e4d256-prod-github-runner-207 kernel: [46824.607457] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 18:24:10 juju-e4d256-prod-github-runner-207 kernel: [46824.608531] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 18:24:10 juju-e4d256-prod-github-runner-207 kernel: [46824.609687] vcpu_run+0x62/0x2c0 [kvm] Aug 22 18:24:10 juju-e4d256-prod-github-runner-207 kernel: [46824.610902] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 18:24:10 juju-e4d256-prod-github-runner-207 kernel: [46824.611908] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 18:24:10 juju-e4d256-prod-github-runner-207 kernel: [46824.612847] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 18:24:10 juju-e4d256-prod-github-runner-207 kernel: [46824.613820] ? __seccomp_filter+0x4a/0x4a0 Aug 22 18:24:10 juju-e4d256-prod-github-runner-207 kernel: [46824.615097] ? __fget_files+0x86/0xc0 Aug 22 18:24:10 juju-e4d256-prod-github-runner-207 kernel: [46824.615897] __x64_sys_ioctl+0x95/0xd0 Aug 22 18:24:10 juju-e4d256-prod-github-runner-207 kernel: [46824.616639] do_syscall_64+0x5c/0xc0 Aug 22 18:24:10 juju-e4d256-prod-github-runner-207 kernel: [46824.617339] ? do_futex+0x162/0x1f0 Aug 22 18:24:10 juju-e4d256-prod-github-runner-207 kernel: [46824.618060] ? __x64_sys_futex+0x78/0x1e0 Aug 22 18:24:10 juju-e4d256-prod-github-runner-207 kernel: [46824.618753] ? __secure_computing+0xa9/0x120 Aug 22 18:24:10 juju-e4d256-prod-github-runner-207 kernel: [46824.619456] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 18:24:10 juju-e4d256-prod-github-runner-207 kernel: [46824.620232] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:24:10 juju-e4d256-prod-github-runner-207 kernel: [46824.620979] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:24:10 juju-e4d256-prod-github-runner-207 kernel: [46824.621726] ? do_syscall_64+0x69/0xc0 Aug 22 18:24:10 juju-e4d256-prod-github-runner-207 kernel: [46824.622386] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:24:10 juju-e4d256-prod-github-runner-207 kernel: [46824.623114] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:24:10 juju-e4d256-prod-github-runner-207 kernel: [46824.623823] ? do_syscall_64+0x69/0xc0 Aug 22 18:24:10 juju-e4d256-prod-github-runner-207 kernel: [46824.624453] ? do_syscall_64+0x69/0xc0 Aug 22 18:24:10 juju-e4d256-prod-github-runner-207 kernel: [46824.625078] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 18:24:10 juju-e4d256-prod-github-runner-207 kernel: [46824.625825] RIP: 0033:0x7faa5d0edaff Aug 22 18:24:10 juju-e4d256-prod-github-runner-207 kernel: [46824.626518] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 18:24:10 juju-e4d256-prod-github-runner-207 kernel: [46824.629133] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 18:24:10 juju-e4d256-prod-github-runner-207 kernel: [46824.630173] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 18:24:10 juju-e4d256-prod-github-runner-207 kernel: [46824.631158] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 18:24:10 juju-e4d256-prod-github-runner-207 kernel: [46824.632386] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 18:24:10 juju-e4d256-prod-github-runner-207 kernel: [46824.633430] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 18:24:10 juju-e4d256-prod-github-runner-207 kernel: [46824.634384] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 18:24:10 juju-e4d256-prod-github-runner-207 kernel: [46824.635370] Aug 22 18:24:38 juju-e4d256-prod-github-runner-207 kernel: [46852.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 43526s! [qemu-system-x86:6715] Aug 22 18:24:38 juju-e4d256-prod-github-runner-207 kernel: [46852.544066] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 18:24:38 juju-e4d256-prod-github-runner-207 kernel: [46852.544408] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 18:24:38 juju-e4d256-prod-github-runner-207 kernel: [46852.558919] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 18:24:38 juju-e4d256-prod-github-runner-207 kernel: [46852.560386] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 18:24:38 juju-e4d256-prod-github-runner-207 kernel: [46852.561828] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:24:38 juju-e4d256-prod-github-runner-207 kernel: [46852.563002] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 18:24:38 juju-e4d256-prod-github-runner-207 kernel: [46852.565921] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 18:24:38 juju-e4d256-prod-github-runner-207 kernel: [46852.567106] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 18:24:38 juju-e4d256-prod-github-runner-207 kernel: [46852.568412] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 18:24:38 juju-e4d256-prod-github-runner-207 kernel: [46852.569724] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 18:24:38 juju-e4d256-prod-github-runner-207 kernel: [46852.571039] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 18:24:38 juju-e4d256-prod-github-runner-207 kernel: [46852.572328] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 18:24:38 juju-e4d256-prod-github-runner-207 kernel: [46852.573642] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 18:24:38 juju-e4d256-prod-github-runner-207 kernel: [46852.575019] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 18:24:38 juju-e4d256-prod-github-runner-207 kernel: [46852.576236] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 18:24:38 juju-e4d256-prod-github-runner-207 kernel: [46852.577579] Call Trace: Aug 22 18:24:38 juju-e4d256-prod-github-runner-207 kernel: [46852.578547] Aug 22 18:24:38 juju-e4d256-prod-github-runner-207 kernel: [46852.579503] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:24:38 juju-e4d256-prod-github-runner-207 kernel: [46852.580631] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:24:38 juju-e4d256-prod-github-runner-207 kernel: [46852.581783] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:24:38 juju-e4d256-prod-github-runner-207 kernel: [46852.582979] ? show_regs.part.0+0x23/0x29 Aug 22 18:24:38 juju-e4d256-prod-github-runner-207 kernel: [46852.584076] ? show_regs.cold+0x8/0xd Aug 22 18:24:38 juju-e4d256-prod-github-runner-207 kernel: [46852.585150] ? watchdog_timer_fn+0x1be/0x220 Aug 22 18:24:38 juju-e4d256-prod-github-runner-207 kernel: [46852.586251] ? lockup_detector_update_enable+0x60/0x60 Aug 22 18:24:38 juju-e4d256-prod-github-runner-207 kernel: [46852.587417] ? __hrtimer_run_queues+0x107/0x230 Aug 22 18:24:38 juju-e4d256-prod-github-runner-207 kernel: [46852.588571] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 18:24:38 juju-e4d256-prod-github-runner-207 kernel: [46852.589736] ? hrtimer_interrupt+0x101/0x220 Aug 22 18:24:38 juju-e4d256-prod-github-runner-207 kernel: [46852.590850] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 18:24:38 juju-e4d256-prod-github-runner-207 kernel: [46852.592032] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 18:24:38 juju-e4d256-prod-github-runner-207 kernel: [46852.593198] Aug 22 18:24:38 juju-e4d256-prod-github-runner-207 kernel: [46852.594118] Aug 22 18:24:38 juju-e4d256-prod-github-runner-207 kernel: [46852.595012] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 18:24:38 juju-e4d256-prod-github-runner-207 kernel: [46852.596171] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:24:38 juju-e4d256-prod-github-runner-207 kernel: [46852.597377] ? _raw_spin_lock+0x22/0x30 Aug 22 18:24:38 juju-e4d256-prod-github-runner-207 kernel: [46852.598423] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:24:38 juju-e4d256-prod-github-runner-207 kernel: [46852.599547] direct_page_fault+0x206/0x310 [kvm] Aug 22 18:24:38 juju-e4d256-prod-github-runner-207 kernel: [46852.600676] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 18:24:38 juju-e4d256-prod-github-runner-207 kernel: [46852.601794] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 18:24:38 juju-e4d256-prod-github-runner-207 kernel: [46852.602895] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 18:24:38 juju-e4d256-prod-github-runner-207 kernel: [46852.604067] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 18:24:38 juju-e4d256-prod-github-runner-207 kernel: [46852.605129] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 18:24:38 juju-e4d256-prod-github-runner-207 kernel: [46852.606215] handle_exit+0x98/0x230 [kvm_amd] Aug 22 18:24:38 juju-e4d256-prod-github-runner-207 kernel: [46852.607194] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 18:24:38 juju-e4d256-prod-github-runner-207 kernel: [46852.608199] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 18:24:38 juju-e4d256-prod-github-runner-207 kernel: [46852.609244] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 18:24:38 juju-e4d256-prod-github-runner-207 kernel: [46852.610245] vcpu_run+0x62/0x2c0 [kvm] Aug 22 18:24:38 juju-e4d256-prod-github-runner-207 kernel: [46852.611132] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 18:24:38 juju-e4d256-prod-github-runner-207 kernel: [46852.612027] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 18:24:38 juju-e4d256-prod-github-runner-207 kernel: [46852.612986] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 18:24:38 juju-e4d256-prod-github-runner-207 kernel: [46852.614015] ? __seccomp_filter+0x4a/0x4a0 Aug 22 18:24:38 juju-e4d256-prod-github-runner-207 kernel: [46852.614851] ? __fget_files+0x86/0xc0 Aug 22 18:24:38 juju-e4d256-prod-github-runner-207 kernel: [46852.615666] __x64_sys_ioctl+0x95/0xd0 Aug 22 18:24:38 juju-e4d256-prod-github-runner-207 kernel: [46852.616465] do_syscall_64+0x5c/0xc0 Aug 22 18:24:38 juju-e4d256-prod-github-runner-207 kernel: [46852.617248] ? do_futex+0x162/0x1f0 Aug 22 18:24:38 juju-e4d256-prod-github-runner-207 kernel: [46852.617980] ? __x64_sys_futex+0x78/0x1e0 Aug 22 18:24:38 juju-e4d256-prod-github-runner-207 kernel: [46852.618735] ? __secure_computing+0xa9/0x120 Aug 22 18:24:38 juju-e4d256-prod-github-runner-207 kernel: [46852.619517] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 18:24:38 juju-e4d256-prod-github-runner-207 kernel: [46852.620384] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:24:38 juju-e4d256-prod-github-runner-207 kernel: [46852.621230] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:24:38 juju-e4d256-prod-github-runner-207 kernel: [46852.622048] ? do_syscall_64+0x69/0xc0 Aug 22 18:24:38 juju-e4d256-prod-github-runner-207 kernel: [46852.622775] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:24:38 juju-e4d256-prod-github-runner-207 kernel: [46852.623586] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:24:38 juju-e4d256-prod-github-runner-207 kernel: [46852.624374] ? do_syscall_64+0x69/0xc0 Aug 22 18:24:38 juju-e4d256-prod-github-runner-207 kernel: [46852.625080] ? do_syscall_64+0x69/0xc0 Aug 22 18:24:38 juju-e4d256-prod-github-runner-207 kernel: [46852.625793] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 18:24:38 juju-e4d256-prod-github-runner-207 kernel: [46852.626601] RIP: 0033:0x7faa5d0edaff Aug 22 18:24:38 juju-e4d256-prod-github-runner-207 kernel: [46852.627344] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 18:24:38 juju-e4d256-prod-github-runner-207 kernel: [46852.629717] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 18:24:38 juju-e4d256-prod-github-runner-207 kernel: [46852.630833] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 18:24:38 juju-e4d256-prod-github-runner-207 kernel: [46852.631878] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 18:24:38 juju-e4d256-prod-github-runner-207 kernel: [46852.632902] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 18:24:38 juju-e4d256-prod-github-runner-207 kernel: [46852.633937] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 18:24:38 juju-e4d256-prod-github-runner-207 kernel: [46852.634962] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 18:24:38 juju-e4d256-prod-github-runner-207 kernel: [46852.635999] Aug 22 18:25:06 juju-e4d256-prod-github-runner-207 kernel: [46880.541984] watchdog: BUG: soft lockup - CPU#1 stuck for 43552s! [qemu-system-x86:6715] Aug 22 18:25:06 juju-e4d256-prod-github-runner-207 kernel: [46880.544063] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 18:25:06 juju-e4d256-prod-github-runner-207 kernel: [46880.544358] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 18:25:06 juju-e4d256-prod-github-runner-207 kernel: [46880.556935] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 18:25:06 juju-e4d256-prod-github-runner-207 kernel: [46880.558214] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 18:25:06 juju-e4d256-prod-github-runner-207 kernel: [46880.559448] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:25:06 juju-e4d256-prod-github-runner-207 kernel: [46880.560510] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 18:25:06 juju-e4d256-prod-github-runner-207 kernel: [46880.563081] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 18:25:06 juju-e4d256-prod-github-runner-207 kernel: [46880.564130] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 18:25:06 juju-e4d256-prod-github-runner-207 kernel: [46880.565357] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 18:25:06 juju-e4d256-prod-github-runner-207 kernel: [46880.566522] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 18:25:06 juju-e4d256-prod-github-runner-207 kernel: [46880.567693] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 18:25:06 juju-e4d256-prod-github-runner-207 kernel: [46880.568901] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 18:25:06 juju-e4d256-prod-github-runner-207 kernel: [46880.570104] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 18:25:06 juju-e4d256-prod-github-runner-207 kernel: [46880.571428] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 18:25:06 juju-e4d256-prod-github-runner-207 kernel: [46880.572862] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 18:25:06 juju-e4d256-prod-github-runner-207 kernel: [46880.574112] Call Trace: Aug 22 18:25:06 juju-e4d256-prod-github-runner-207 kernel: [46880.575039] Aug 22 18:25:06 juju-e4d256-prod-github-runner-207 kernel: [46880.575935] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:25:06 juju-e4d256-prod-github-runner-207 kernel: [46880.576996] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:25:06 juju-e4d256-prod-github-runner-207 kernel: [46880.578026] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:25:06 juju-e4d256-prod-github-runner-207 kernel: [46880.579143] ? show_regs.part.0+0x23/0x29 Aug 22 18:25:06 juju-e4d256-prod-github-runner-207 kernel: [46880.580148] ? show_regs.cold+0x8/0xd Aug 22 18:25:06 juju-e4d256-prod-github-runner-207 kernel: [46880.581174] ? watchdog_timer_fn+0x1be/0x220 Aug 22 18:25:06 juju-e4d256-prod-github-runner-207 kernel: [46880.582232] ? lockup_detector_update_enable+0x60/0x60 Aug 22 18:25:06 juju-e4d256-prod-github-runner-207 kernel: [46880.583331] ? __hrtimer_run_queues+0x107/0x230 Aug 22 18:25:06 juju-e4d256-prod-github-runner-207 kernel: [46880.584397] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 18:25:06 juju-e4d256-prod-github-runner-207 kernel: [46880.585466] ? hrtimer_interrupt+0x101/0x220 Aug 22 18:25:06 juju-e4d256-prod-github-runner-207 kernel: [46880.586490] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 18:25:06 juju-e4d256-prod-github-runner-207 kernel: [46880.587560] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 18:25:06 juju-e4d256-prod-github-runner-207 kernel: [46880.588612] Aug 22 18:25:06 juju-e4d256-prod-github-runner-207 kernel: [46880.589495] Aug 22 18:25:06 juju-e4d256-prod-github-runner-207 kernel: [46880.590335] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 18:25:06 juju-e4d256-prod-github-runner-207 kernel: [46880.591556] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:25:06 juju-e4d256-prod-github-runner-207 kernel: [46880.592790] ? _raw_spin_lock+0x22/0x30 Aug 22 18:25:06 juju-e4d256-prod-github-runner-207 kernel: [46880.593835] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:25:06 juju-e4d256-prod-github-runner-207 kernel: [46880.594983] direct_page_fault+0x206/0x310 [kvm] Aug 22 18:25:06 juju-e4d256-prod-github-runner-207 kernel: [46880.596118] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 18:25:06 juju-e4d256-prod-github-runner-207 kernel: [46880.598043] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 18:25:06 juju-e4d256-prod-github-runner-207 kernel: [46880.599181] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 18:25:06 juju-e4d256-prod-github-runner-207 kernel: [46880.600292] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 18:25:06 juju-e4d256-prod-github-runner-207 kernel: [46880.601354] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 18:25:06 juju-e4d256-prod-github-runner-207 kernel: [46880.602442] handle_exit+0x98/0x230 [kvm_amd] Aug 22 18:25:06 juju-e4d256-prod-github-runner-207 kernel: [46880.603421] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 18:25:06 juju-e4d256-prod-github-runner-207 kernel: [46880.604459] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 18:25:06 juju-e4d256-prod-github-runner-207 kernel: [46880.605513] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 18:25:06 juju-e4d256-prod-github-runner-207 kernel: [46880.606539] vcpu_run+0x62/0x2c0 [kvm] Aug 22 18:25:06 juju-e4d256-prod-github-runner-207 kernel: [46880.607437] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 18:25:06 juju-e4d256-prod-github-runner-207 kernel: [46880.608336] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 18:25:06 juju-e4d256-prod-github-runner-207 kernel: [46880.609523] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 18:25:06 juju-e4d256-prod-github-runner-207 kernel: [46880.610415] ? __seccomp_filter+0x4a/0x4a0 Aug 22 18:25:06 juju-e4d256-prod-github-runner-207 kernel: [46880.611250] ? __fget_files+0x86/0xc0 Aug 22 18:25:06 juju-e4d256-prod-github-runner-207 kernel: [46880.612062] __x64_sys_ioctl+0x95/0xd0 Aug 22 18:25:06 juju-e4d256-prod-github-runner-207 kernel: [46880.612872] do_syscall_64+0x5c/0xc0 Aug 22 18:25:06 juju-e4d256-prod-github-runner-207 kernel: [46880.613670] ? do_futex+0x162/0x1f0 Aug 22 18:25:06 juju-e4d256-prod-github-runner-207 kernel: [46880.614427] ? __x64_sys_futex+0x78/0x1e0 Aug 22 18:25:06 juju-e4d256-prod-github-runner-207 kernel: [46880.615191] ? __secure_computing+0xa9/0x120 Aug 22 18:25:06 juju-e4d256-prod-github-runner-207 kernel: [46880.615982] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 18:25:06 juju-e4d256-prod-github-runner-207 kernel: [46880.616891] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:25:06 juju-e4d256-prod-github-runner-207 kernel: [46880.617725] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:25:06 juju-e4d256-prod-github-runner-207 kernel: [46880.618546] ? do_syscall_64+0x69/0xc0 Aug 22 18:25:06 juju-e4d256-prod-github-runner-207 kernel: [46880.619279] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:25:06 juju-e4d256-prod-github-runner-207 kernel: [46880.620083] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:25:06 juju-e4d256-prod-github-runner-207 kernel: [46880.620897] ? do_syscall_64+0x69/0xc0 Aug 22 18:25:06 juju-e4d256-prod-github-runner-207 kernel: [46880.621617] ? do_syscall_64+0x69/0xc0 Aug 22 18:25:06 juju-e4d256-prod-github-runner-207 kernel: [46880.622329] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 18:25:06 juju-e4d256-prod-github-runner-207 kernel: [46880.623138] RIP: 0033:0x7faa5d0edaff Aug 22 18:25:06 juju-e4d256-prod-github-runner-207 kernel: [46880.623895] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 18:25:06 juju-e4d256-prod-github-runner-207 kernel: [46880.626265] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 18:25:06 juju-e4d256-prod-github-runner-207 kernel: [46880.627331] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 18:25:06 juju-e4d256-prod-github-runner-207 kernel: [46880.628366] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 18:25:06 juju-e4d256-prod-github-runner-207 kernel: [46880.629439] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 18:25:06 juju-e4d256-prod-github-runner-207 kernel: [46880.630466] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 18:25:06 juju-e4d256-prod-github-runner-207 kernel: [46880.631495] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 18:25:06 juju-e4d256-prod-github-runner-207 kernel: [46880.632539] Aug 22 18:25:34 juju-e4d256-prod-github-runner-207 kernel: [46908.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 43578s! [qemu-system-x86:6715] Aug 22 18:25:34 juju-e4d256-prod-github-runner-207 kernel: [46908.544598] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 18:25:34 juju-e4d256-prod-github-runner-207 kernel: [46908.544995] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 18:25:34 juju-e4d256-prod-github-runner-207 kernel: [46908.561408] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 18:25:34 juju-e4d256-prod-github-runner-207 kernel: [46908.562782] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 18:25:34 juju-e4d256-prod-github-runner-207 kernel: [46908.564009] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:25:34 juju-e4d256-prod-github-runner-207 kernel: [46908.565084] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 18:25:34 juju-e4d256-prod-github-runner-207 kernel: [46908.567637] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 18:25:34 juju-e4d256-prod-github-runner-207 kernel: [46908.568703] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 18:25:34 juju-e4d256-prod-github-runner-207 kernel: [46908.569869] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 18:25:34 juju-e4d256-prod-github-runner-207 kernel: [46908.571031] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 18:25:34 juju-e4d256-prod-github-runner-207 kernel: [46908.572201] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 18:25:34 juju-e4d256-prod-github-runner-207 kernel: [46908.573395] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 18:25:34 juju-e4d256-prod-github-runner-207 kernel: [46908.574583] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 18:25:34 juju-e4d256-prod-github-runner-207 kernel: [46908.575844] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 18:25:34 juju-e4d256-prod-github-runner-207 kernel: [46908.576972] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 18:25:34 juju-e4d256-prod-github-runner-207 kernel: [46908.578180] Call Trace: Aug 22 18:25:34 juju-e4d256-prod-github-runner-207 kernel: [46908.579106] Aug 22 18:25:34 juju-e4d256-prod-github-runner-207 kernel: [46908.580031] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:25:34 juju-e4d256-prod-github-runner-207 kernel: [46908.581107] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:25:34 juju-e4d256-prod-github-runner-207 kernel: [46908.582151] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:25:34 juju-e4d256-prod-github-runner-207 kernel: [46908.583274] ? show_regs.part.0+0x23/0x29 Aug 22 18:25:34 juju-e4d256-prod-github-runner-207 kernel: [46908.584292] ? show_regs.cold+0x8/0xd Aug 22 18:25:34 juju-e4d256-prod-github-runner-207 kernel: [46908.585295] ? watchdog_timer_fn+0x1be/0x220 Aug 22 18:25:34 juju-e4d256-prod-github-runner-207 kernel: [46908.586321] ? lockup_detector_update_enable+0x60/0x60 Aug 22 18:25:34 juju-e4d256-prod-github-runner-207 kernel: [46908.587397] ? __hrtimer_run_queues+0x107/0x230 Aug 22 18:25:34 juju-e4d256-prod-github-runner-207 kernel: [46908.588452] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 18:25:34 juju-e4d256-prod-github-runner-207 kernel: [46908.589488] ? hrtimer_interrupt+0x101/0x220 Aug 22 18:25:34 juju-e4d256-prod-github-runner-207 kernel: [46908.590532] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 18:25:34 juju-e4d256-prod-github-runner-207 kernel: [46908.591612] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 18:25:34 juju-e4d256-prod-github-runner-207 kernel: [46908.592689] Aug 22 18:25:34 juju-e4d256-prod-github-runner-207 kernel: [46908.593559] Aug 22 18:25:34 juju-e4d256-prod-github-runner-207 kernel: [46908.594407] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 18:25:34 juju-e4d256-prod-github-runner-207 kernel: [46908.595450] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:25:34 juju-e4d256-prod-github-runner-207 kernel: [46908.596522] ? _raw_spin_lock+0x22/0x30 Aug 22 18:25:34 juju-e4d256-prod-github-runner-207 kernel: [46908.597490] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:25:34 juju-e4d256-prod-github-runner-207 kernel: [46908.598544] direct_page_fault+0x206/0x310 [kvm] Aug 22 18:25:34 juju-e4d256-prod-github-runner-207 kernel: [46908.599589] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 18:25:34 juju-e4d256-prod-github-runner-207 kernel: [46908.600631] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 18:25:34 juju-e4d256-prod-github-runner-207 kernel: [46908.601685] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 18:25:34 juju-e4d256-prod-github-runner-207 kernel: [46908.602715] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 18:25:34 juju-e4d256-prod-github-runner-207 kernel: [46908.603669] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 18:25:34 juju-e4d256-prod-github-runner-207 kernel: [46908.604702] handle_exit+0x98/0x230 [kvm_amd] Aug 22 18:25:34 juju-e4d256-prod-github-runner-207 kernel: [46908.605602] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 18:25:34 juju-e4d256-prod-github-runner-207 kernel: [46908.606522] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 18:25:34 juju-e4d256-prod-github-runner-207 kernel: [46908.607456] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 18:25:34 juju-e4d256-prod-github-runner-207 kernel: [46908.608365] vcpu_run+0x62/0x2c0 [kvm] Aug 22 18:25:34 juju-e4d256-prod-github-runner-207 kernel: [46908.609210] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 18:25:34 juju-e4d256-prod-github-runner-207 kernel: [46908.610027] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 18:25:34 juju-e4d256-prod-github-runner-207 kernel: [46908.610892] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 18:25:34 juju-e4d256-prod-github-runner-207 kernel: [46908.611696] ? __seccomp_filter+0x4a/0x4a0 Aug 22 18:25:34 juju-e4d256-prod-github-runner-207 kernel: [46908.612474] ? __fget_files+0x86/0xc0 Aug 22 18:25:34 juju-e4d256-prod-github-runner-207 kernel: [46908.613198] __x64_sys_ioctl+0x95/0xd0 Aug 22 18:25:34 juju-e4d256-prod-github-runner-207 kernel: [46908.613920] do_syscall_64+0x5c/0xc0 Aug 22 18:25:34 juju-e4d256-prod-github-runner-207 kernel: [46908.614606] ? do_futex+0x162/0x1f0 Aug 22 18:25:34 juju-e4d256-prod-github-runner-207 kernel: [46908.615265] ? __x64_sys_futex+0x78/0x1e0 Aug 22 18:25:34 juju-e4d256-prod-github-runner-207 kernel: [46908.615954] ? __secure_computing+0xa9/0x120 Aug 22 18:25:34 juju-e4d256-prod-github-runner-207 kernel: [46908.616675] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 18:25:34 juju-e4d256-prod-github-runner-207 kernel: [46908.617452] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:25:34 juju-e4d256-prod-github-runner-207 kernel: [46908.618188] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:25:34 juju-e4d256-prod-github-runner-207 kernel: [46908.618923] ? do_syscall_64+0x69/0xc0 Aug 22 18:25:34 juju-e4d256-prod-github-runner-207 kernel: [46908.619581] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:25:34 juju-e4d256-prod-github-runner-207 kernel: [46908.620298] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:25:34 juju-e4d256-prod-github-runner-207 kernel: [46908.621028] ? do_syscall_64+0x69/0xc0 Aug 22 18:25:34 juju-e4d256-prod-github-runner-207 kernel: [46908.621660] ? do_syscall_64+0x69/0xc0 Aug 22 18:25:34 juju-e4d256-prod-github-runner-207 kernel: [46908.622300] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 18:25:34 juju-e4d256-prod-github-runner-207 kernel: [46908.623013] RIP: 0033:0x7faa5d0edaff Aug 22 18:25:34 juju-e4d256-prod-github-runner-207 kernel: [46908.623693] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 18:25:34 juju-e4d256-prod-github-runner-207 kernel: [46908.625722] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 18:25:34 juju-e4d256-prod-github-runner-207 kernel: [46908.626647] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 18:25:34 juju-e4d256-prod-github-runner-207 kernel: [46908.627554] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 18:25:34 juju-e4d256-prod-github-runner-207 kernel: [46908.628495] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 18:25:34 juju-e4d256-prod-github-runner-207 kernel: [46908.629399] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 18:25:34 juju-e4d256-prod-github-runner-207 kernel: [46908.630299] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 18:25:34 juju-e4d256-prod-github-runner-207 kernel: [46908.631208] Aug 22 18:26:02 juju-e4d256-prod-github-runner-207 kernel: [46936.541980] watchdog: BUG: soft lockup - CPU#1 stuck for 43605s! [qemu-system-x86:6715] Aug 22 18:26:02 juju-e4d256-prod-github-runner-207 kernel: [46936.544188] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 18:26:02 juju-e4d256-prod-github-runner-207 kernel: [46936.544505] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 18:26:02 juju-e4d256-prod-github-runner-207 kernel: [46936.557440] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 18:26:02 juju-e4d256-prod-github-runner-207 kernel: [46936.558738] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 18:26:02 juju-e4d256-prod-github-runner-207 kernel: [46936.559989] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:26:02 juju-e4d256-prod-github-runner-207 kernel: [46936.561076] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 18:26:02 juju-e4d256-prod-github-runner-207 kernel: [46936.563692] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 18:26:02 juju-e4d256-prod-github-runner-207 kernel: [46936.564770] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 18:26:02 juju-e4d256-prod-github-runner-207 kernel: [46936.565995] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 18:26:02 juju-e4d256-prod-github-runner-207 kernel: [46936.567183] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 18:26:02 juju-e4d256-prod-github-runner-207 kernel: [46936.568391] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 18:26:02 juju-e4d256-prod-github-runner-207 kernel: [46936.569629] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 18:26:02 juju-e4d256-prod-github-runner-207 kernel: [46936.570821] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 18:26:02 juju-e4d256-prod-github-runner-207 kernel: [46936.572086] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 18:26:02 juju-e4d256-prod-github-runner-207 kernel: [46936.573198] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 18:26:02 juju-e4d256-prod-github-runner-207 kernel: [46936.574452] Call Trace: Aug 22 18:26:02 juju-e4d256-prod-github-runner-207 kernel: [46936.575381] Aug 22 18:26:02 juju-e4d256-prod-github-runner-207 kernel: [46936.576351] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:26:02 juju-e4d256-prod-github-runner-207 kernel: [46936.577464] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:26:02 juju-e4d256-prod-github-runner-207 kernel: [46936.578557] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:26:02 juju-e4d256-prod-github-runner-207 kernel: [46936.579764] ? show_regs.part.0+0x23/0x29 Aug 22 18:26:02 juju-e4d256-prod-github-runner-207 kernel: [46936.580789] ? show_regs.cold+0x8/0xd Aug 22 18:26:02 juju-e4d256-prod-github-runner-207 kernel: [46936.581779] ? watchdog_timer_fn+0x1be/0x220 Aug 22 18:26:02 juju-e4d256-prod-github-runner-207 kernel: [46936.582803] ? lockup_detector_update_enable+0x60/0x60 Aug 22 18:26:02 juju-e4d256-prod-github-runner-207 kernel: [46936.583887] ? __hrtimer_run_queues+0x107/0x230 Aug 22 18:26:02 juju-e4d256-prod-github-runner-207 kernel: [46936.584965] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 18:26:02 juju-e4d256-prod-github-runner-207 kernel: [46936.586010] ? hrtimer_interrupt+0x101/0x220 Aug 22 18:26:02 juju-e4d256-prod-github-runner-207 kernel: [46936.587046] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 18:26:02 juju-e4d256-prod-github-runner-207 kernel: [46936.588206] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 18:26:02 juju-e4d256-prod-github-runner-207 kernel: [46936.589280] Aug 22 18:26:02 juju-e4d256-prod-github-runner-207 kernel: [46936.590161] Aug 22 18:26:02 juju-e4d256-prod-github-runner-207 kernel: [46936.591024] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 18:26:02 juju-e4d256-prod-github-runner-207 kernel: [46936.592115] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:26:02 juju-e4d256-prod-github-runner-207 kernel: [46936.593182] ? _raw_spin_lock+0x22/0x30 Aug 22 18:26:02 juju-e4d256-prod-github-runner-207 kernel: [46936.594137] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:26:02 juju-e4d256-prod-github-runner-207 kernel: [46936.595169] direct_page_fault+0x206/0x310 [kvm] Aug 22 18:26:02 juju-e4d256-prod-github-runner-207 kernel: [46936.596219] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 18:26:02 juju-e4d256-prod-github-runner-207 kernel: [46936.597249] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 18:26:02 juju-e4d256-prod-github-runner-207 kernel: [46936.598290] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 18:26:02 juju-e4d256-prod-github-runner-207 kernel: [46936.599315] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 18:26:02 juju-e4d256-prod-github-runner-207 kernel: [46936.600288] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 18:26:02 juju-e4d256-prod-github-runner-207 kernel: [46936.601278] handle_exit+0x98/0x230 [kvm_amd] Aug 22 18:26:02 juju-e4d256-prod-github-runner-207 kernel: [46936.602182] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 18:26:02 juju-e4d256-prod-github-runner-207 kernel: [46936.603105] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 18:26:02 juju-e4d256-prod-github-runner-207 kernel: [46936.604066] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 18:26:02 juju-e4d256-prod-github-runner-207 kernel: [46936.604980] vcpu_run+0x62/0x2c0 [kvm] Aug 22 18:26:02 juju-e4d256-prod-github-runner-207 kernel: [46936.605833] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 18:26:02 juju-e4d256-prod-github-runner-207 kernel: [46936.606694] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 18:26:02 juju-e4d256-prod-github-runner-207 kernel: [46936.607555] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 18:26:02 juju-e4d256-prod-github-runner-207 kernel: [46936.608407] ? __seccomp_filter+0x4a/0x4a0 Aug 22 18:26:02 juju-e4d256-prod-github-runner-207 kernel: [46936.609174] ? __fget_files+0x86/0xc0 Aug 22 18:26:02 juju-e4d256-prod-github-runner-207 kernel: [46936.609884] __x64_sys_ioctl+0x95/0xd0 Aug 22 18:26:02 juju-e4d256-prod-github-runner-207 kernel: [46936.610582] do_syscall_64+0x5c/0xc0 Aug 22 18:26:02 juju-e4d256-prod-github-runner-207 kernel: [46936.611256] ? do_futex+0x162/0x1f0 Aug 22 18:26:02 juju-e4d256-prod-github-runner-207 kernel: [46936.611916] ? __x64_sys_futex+0x78/0x1e0 Aug 22 18:26:02 juju-e4d256-prod-github-runner-207 kernel: [46936.612602] ? __secure_computing+0xa9/0x120 Aug 22 18:26:02 juju-e4d256-prod-github-runner-207 kernel: [46936.613302] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 18:26:02 juju-e4d256-prod-github-runner-207 kernel: [46936.614082] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:26:02 juju-e4d256-prod-github-runner-207 kernel: [46936.614811] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:26:02 juju-e4d256-prod-github-runner-207 kernel: [46936.615535] ? do_syscall_64+0x69/0xc0 Aug 22 18:26:02 juju-e4d256-prod-github-runner-207 kernel: [46936.616204] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:26:02 juju-e4d256-prod-github-runner-207 kernel: [46936.616921] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:26:02 juju-e4d256-prod-github-runner-207 kernel: [46936.617629] ? do_syscall_64+0x69/0xc0 Aug 22 18:26:02 juju-e4d256-prod-github-runner-207 kernel: [46936.618264] ? do_syscall_64+0x69/0xc0 Aug 22 18:26:02 juju-e4d256-prod-github-runner-207 kernel: [46936.618890] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 18:26:02 juju-e4d256-prod-github-runner-207 kernel: [46936.619599] RIP: 0033:0x7faa5d0edaff Aug 22 18:26:02 juju-e4d256-prod-github-runner-207 kernel: [46936.620287] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 18:26:02 juju-e4d256-prod-github-runner-207 kernel: [46936.622395] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 18:26:02 juju-e4d256-prod-github-runner-207 kernel: [46936.623370] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 18:26:02 juju-e4d256-prod-github-runner-207 kernel: [46936.624353] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 18:26:02 juju-e4d256-prod-github-runner-207 kernel: [46936.625366] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 18:26:02 juju-e4d256-prod-github-runner-207 kernel: [46936.626324] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 18:26:02 juju-e4d256-prod-github-runner-207 kernel: [46936.627249] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 18:26:02 juju-e4d256-prod-github-runner-207 kernel: [46936.629064] Aug 22 18:26:30 juju-e4d256-prod-github-runner-207 kernel: [46964.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 43631s! [qemu-system-x86:6715] Aug 22 18:26:30 juju-e4d256-prod-github-runner-207 kernel: [46964.543923] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 18:26:30 juju-e4d256-prod-github-runner-207 kernel: [46964.544225] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 18:26:30 juju-e4d256-prod-github-runner-207 kernel: [46964.557075] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 18:26:30 juju-e4d256-prod-github-runner-207 kernel: [46964.558376] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 18:26:30 juju-e4d256-prod-github-runner-207 kernel: [46964.559617] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:26:30 juju-e4d256-prod-github-runner-207 kernel: [46964.560709] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 18:26:30 juju-e4d256-prod-github-runner-207 kernel: [46964.563267] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 18:26:30 juju-e4d256-prod-github-runner-207 kernel: [46964.564346] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 18:26:30 juju-e4d256-prod-github-runner-207 kernel: [46964.565523] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 18:26:30 juju-e4d256-prod-github-runner-207 kernel: [46964.566693] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 18:26:30 juju-e4d256-prod-github-runner-207 kernel: [46964.567886] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 18:26:30 juju-e4d256-prod-github-runner-207 kernel: [46964.569057] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 18:26:30 juju-e4d256-prod-github-runner-207 kernel: [46964.570235] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 18:26:30 juju-e4d256-prod-github-runner-207 kernel: [46964.571478] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 18:26:30 juju-e4d256-prod-github-runner-207 kernel: [46964.572615] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 18:26:30 juju-e4d256-prod-github-runner-207 kernel: [46964.573819] Call Trace: Aug 22 18:26:30 juju-e4d256-prod-github-runner-207 kernel: [46964.574740] Aug 22 18:26:30 juju-e4d256-prod-github-runner-207 kernel: [46964.575659] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:26:30 juju-e4d256-prod-github-runner-207 kernel: [46964.576732] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:26:30 juju-e4d256-prod-github-runner-207 kernel: [46964.577773] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:26:30 juju-e4d256-prod-github-runner-207 kernel: [46964.578898] ? show_regs.part.0+0x23/0x29 Aug 22 18:26:30 juju-e4d256-prod-github-runner-207 kernel: [46964.579947] ? show_regs.cold+0x8/0xd Aug 22 18:26:30 juju-e4d256-prod-github-runner-207 kernel: [46964.580935] ? watchdog_timer_fn+0x1be/0x220 Aug 22 18:26:30 juju-e4d256-prod-github-runner-207 kernel: [46964.581958] ? lockup_detector_update_enable+0x60/0x60 Aug 22 18:26:30 juju-e4d256-prod-github-runner-207 kernel: [46964.583032] ? __hrtimer_run_queues+0x107/0x230 Aug 22 18:26:30 juju-e4d256-prod-github-runner-207 kernel: [46964.584098] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 18:26:30 juju-e4d256-prod-github-runner-207 kernel: [46964.585136] ? hrtimer_interrupt+0x101/0x220 Aug 22 18:26:30 juju-e4d256-prod-github-runner-207 kernel: [46964.586169] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 18:26:30 juju-e4d256-prod-github-runner-207 kernel: [46964.587251] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 18:26:30 juju-e4d256-prod-github-runner-207 kernel: [46964.588392] Aug 22 18:26:30 juju-e4d256-prod-github-runner-207 kernel: [46964.589266] Aug 22 18:26:30 juju-e4d256-prod-github-runner-207 kernel: [46964.590118] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 18:26:30 juju-e4d256-prod-github-runner-207 kernel: [46964.591167] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:26:30 juju-e4d256-prod-github-runner-207 kernel: [46964.592241] ? _raw_spin_lock+0x22/0x30 Aug 22 18:26:30 juju-e4d256-prod-github-runner-207 kernel: [46964.593198] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:26:30 juju-e4d256-prod-github-runner-207 kernel: [46964.594242] direct_page_fault+0x206/0x310 [kvm] Aug 22 18:26:30 juju-e4d256-prod-github-runner-207 kernel: [46964.595280] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 18:26:30 juju-e4d256-prod-github-runner-207 kernel: [46964.596327] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 18:26:30 juju-e4d256-prod-github-runner-207 kernel: [46964.597345] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 18:26:30 juju-e4d256-prod-github-runner-207 kernel: [46964.598366] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 18:26:30 juju-e4d256-prod-github-runner-207 kernel: [46964.599318] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 18:26:30 juju-e4d256-prod-github-runner-207 kernel: [46964.600330] handle_exit+0x98/0x230 [kvm_amd] Aug 22 18:26:30 juju-e4d256-prod-github-runner-207 kernel: [46964.601235] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 18:26:30 juju-e4d256-prod-github-runner-207 kernel: [46964.602205] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 18:26:30 juju-e4d256-prod-github-runner-207 kernel: [46964.603324] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 18:26:30 juju-e4d256-prod-github-runner-207 kernel: [46964.604391] vcpu_run+0x62/0x2c0 [kvm] Aug 22 18:26:30 juju-e4d256-prod-github-runner-207 kernel: [46964.605313] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 18:26:30 juju-e4d256-prod-github-runner-207 kernel: [46964.606230] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 18:26:30 juju-e4d256-prod-github-runner-207 kernel: [46964.607207] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 18:26:30 juju-e4d256-prod-github-runner-207 kernel: [46964.614975] ? __seccomp_filter+0x4a/0x4a0 Aug 22 18:26:30 juju-e4d256-prod-github-runner-207 kernel: [46964.615971] ? __fget_files+0x86/0xc0 Aug 22 18:26:30 juju-e4d256-prod-github-runner-207 kernel: [46964.616766] __x64_sys_ioctl+0x95/0xd0 Aug 22 18:26:30 juju-e4d256-prod-github-runner-207 kernel: [46964.617552] do_syscall_64+0x5c/0xc0 Aug 22 18:26:30 juju-e4d256-prod-github-runner-207 kernel: [46964.618303] ? do_futex+0x162/0x1f0 Aug 22 18:26:30 juju-e4d256-prod-github-runner-207 kernel: [46964.619053] ? __x64_sys_futex+0x78/0x1e0 Aug 22 18:26:30 juju-e4d256-prod-github-runner-207 kernel: [46964.619861] ? __secure_computing+0xa9/0x120 Aug 22 18:26:30 juju-e4d256-prod-github-runner-207 kernel: [46964.620650] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 18:26:30 juju-e4d256-prod-github-runner-207 kernel: [46964.621532] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:26:30 juju-e4d256-prod-github-runner-207 kernel: [46964.622373] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:26:30 juju-e4d256-prod-github-runner-207 kernel: [46964.623199] ? do_syscall_64+0x69/0xc0 Aug 22 18:26:30 juju-e4d256-prod-github-runner-207 kernel: [46964.623956] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:26:30 juju-e4d256-prod-github-runner-207 kernel: [46964.624770] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:26:30 juju-e4d256-prod-github-runner-207 kernel: [46964.625570] ? do_syscall_64+0x69/0xc0 Aug 22 18:26:30 juju-e4d256-prod-github-runner-207 kernel: [46964.626278] ? do_syscall_64+0x69/0xc0 Aug 22 18:26:30 juju-e4d256-prod-github-runner-207 kernel: [46964.626987] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 18:26:30 juju-e4d256-prod-github-runner-207 kernel: [46964.627842] RIP: 0033:0x7faa5d0edaff Aug 22 18:26:30 juju-e4d256-prod-github-runner-207 kernel: [46964.628639] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 18:26:30 juju-e4d256-prod-github-runner-207 kernel: [46964.631040] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 18:26:30 juju-e4d256-prod-github-runner-207 kernel: [46964.632155] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 18:26:30 juju-e4d256-prod-github-runner-207 kernel: [46964.633190] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 18:26:30 juju-e4d256-prod-github-runner-207 kernel: [46964.634224] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 18:26:30 juju-e4d256-prod-github-runner-207 kernel: [46964.635260] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 18:26:30 juju-e4d256-prod-github-runner-207 kernel: [46964.636402] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 18:26:30 juju-e4d256-prod-github-runner-207 kernel: [46964.637446] Aug 22 18:26:46 juju-e4d256-prod-github-runner-207 kernel: [46980.320707] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 18:26:46 juju-e4d256-prod-github-runner-207 kernel: [46980.322916] rcu: 1-....: (11679021 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=5650869 Aug 22 18:26:46 juju-e4d256-prod-github-runner-207 kernel: [46980.324086] (t=11715780 jiffies g=23269 q=45673) Aug 22 18:26:46 juju-e4d256-prod-github-runner-207 kernel: [46980.324891] NMI backtrace for cpu 1 Aug 22 18:26:46 juju-e4d256-prod-github-runner-207 kernel: [46980.325636] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 18:26:46 juju-e4d256-prod-github-runner-207 kernel: [46980.326751] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 18:26:46 juju-e4d256-prod-github-runner-207 kernel: [46980.327836] Call Trace: Aug 22 18:26:46 juju-e4d256-prod-github-runner-207 kernel: [46980.328521] Aug 22 18:26:46 juju-e4d256-prod-github-runner-207 kernel: [46980.329283] show_stack+0x52/0x5c Aug 22 18:26:46 juju-e4d256-prod-github-runner-207 kernel: [46980.330101] dump_stack_lvl+0x4a/0x63 Aug 22 18:26:46 juju-e4d256-prod-github-runner-207 kernel: [46980.330936] dump_stack+0x10/0x16 Aug 22 18:26:46 juju-e4d256-prod-github-runner-207 kernel: [46980.331741] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 18:26:46 juju-e4d256-prod-github-runner-207 kernel: [46980.332623] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 18:26:46 juju-e4d256-prod-github-runner-207 kernel: [46980.333499] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 18:26:46 juju-e4d256-prod-github-runner-207 kernel: [46980.334422] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 18:26:46 juju-e4d256-prod-github-runner-207 kernel: [46980.335388] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 18:26:46 juju-e4d256-prod-github-runner-207 kernel: [46980.336422] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 18:26:46 juju-e4d256-prod-github-runner-207 kernel: [46980.337312] print_cpu_stall.cold+0x2f/0xe2 Aug 22 18:26:46 juju-e4d256-prod-github-runner-207 kernel: [46980.338167] ? timekeeping_update+0xf7/0x150 Aug 22 18:26:46 juju-e4d256-prod-github-runner-207 kernel: [46980.339030] check_cpu_stall+0x109/0x270 Aug 22 18:26:46 juju-e4d256-prod-github-runner-207 kernel: [46980.339885] rcu_sched_clock_irq+0x9a/0x250 Aug 22 18:26:46 juju-e4d256-prod-github-runner-207 kernel: [46980.340735] update_process_times+0x94/0xd0 Aug 22 18:26:46 juju-e4d256-prod-github-runner-207 kernel: [46980.341584] tick_sched_handle+0x29/0x70 Aug 22 18:26:46 juju-e4d256-prod-github-runner-207 kernel: [46980.342415] tick_sched_timer+0x8c/0xc0 Aug 22 18:26:46 juju-e4d256-prod-github-runner-207 kernel: [46980.343236] ? tick_nohz_handler+0xb0/0xb0 Aug 22 18:26:46 juju-e4d256-prod-github-runner-207 kernel: [46980.344095] __hrtimer_run_queues+0x107/0x230 Aug 22 18:26:46 juju-e4d256-prod-github-runner-207 kernel: [46980.344959] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 18:26:46 juju-e4d256-prod-github-runner-207 kernel: [46980.345837] hrtimer_interrupt+0x101/0x220 Aug 22 18:26:46 juju-e4d256-prod-github-runner-207 kernel: [46980.346686] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 18:26:46 juju-e4d256-prod-github-runner-207 kernel: [46980.347618] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 18:26:46 juju-e4d256-prod-github-runner-207 kernel: [46980.348518] Aug 22 18:26:46 juju-e4d256-prod-github-runner-207 kernel: [46980.349202] Aug 22 18:26:46 juju-e4d256-prod-github-runner-207 kernel: [46980.349885] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 18:26:46 juju-e4d256-prod-github-runner-207 kernel: [46980.350813] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:26:46 juju-e4d256-prod-github-runner-207 kernel: [46980.351843] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 18:26:46 juju-e4d256-prod-github-runner-207 kernel: [46980.354405] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 18:26:46 juju-e4d256-prod-github-runner-207 kernel: [46980.355394] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 18:26:46 juju-e4d256-prod-github-runner-207 kernel: [46980.356556] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 18:26:46 juju-e4d256-prod-github-runner-207 kernel: [46980.357673] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 18:26:46 juju-e4d256-prod-github-runner-207 kernel: [46980.358778] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 18:26:46 juju-e4d256-prod-github-runner-207 kernel: [46980.359889] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 18:26:46 juju-e4d256-prod-github-runner-207 kernel: [46980.360982] ? _raw_spin_lock+0x22/0x30 Aug 22 18:26:46 juju-e4d256-prod-github-runner-207 kernel: [46980.361843] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:26:46 juju-e4d256-prod-github-runner-207 kernel: [46980.362802] direct_page_fault+0x206/0x310 [kvm] Aug 22 18:26:46 juju-e4d256-prod-github-runner-207 kernel: [46980.363758] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 18:26:46 juju-e4d256-prod-github-runner-207 kernel: [46980.364682] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 18:26:46 juju-e4d256-prod-github-runner-207 kernel: [46980.365622] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 18:26:46 juju-e4d256-prod-github-runner-207 kernel: [46980.366558] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 18:26:46 juju-e4d256-prod-github-runner-207 kernel: [46980.367440] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 18:26:46 juju-e4d256-prod-github-runner-207 kernel: [46980.368389] handle_exit+0x98/0x230 [kvm_amd] Aug 22 18:26:46 juju-e4d256-prod-github-runner-207 kernel: [46980.369400] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 18:26:46 juju-e4d256-prod-github-runner-207 kernel: [46980.370281] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 18:26:46 juju-e4d256-prod-github-runner-207 kernel: [46980.371187] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 18:26:46 juju-e4d256-prod-github-runner-207 kernel: [46980.372094] vcpu_run+0x62/0x2c0 [kvm] Aug 22 18:26:46 juju-e4d256-prod-github-runner-207 kernel: [46980.372892] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 18:26:46 juju-e4d256-prod-github-runner-207 kernel: [46980.373720] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 18:26:46 juju-e4d256-prod-github-runner-207 kernel: [46980.374625] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 18:26:46 juju-e4d256-prod-github-runner-207 kernel: [46980.375662] ? __seccomp_filter+0x4a/0x4a0 Aug 22 18:26:46 juju-e4d256-prod-github-runner-207 kernel: [46980.376474] ? __fget_files+0x86/0xc0 Aug 22 18:26:46 juju-e4d256-prod-github-runner-207 kernel: [46980.377254] __x64_sys_ioctl+0x95/0xd0 Aug 22 18:26:46 juju-e4d256-prod-github-runner-207 kernel: [46980.378032] do_syscall_64+0x5c/0xc0 Aug 22 18:26:46 juju-e4d256-prod-github-runner-207 kernel: [46980.378792] ? do_futex+0x162/0x1f0 Aug 22 18:26:46 juju-e4d256-prod-github-runner-207 kernel: [46980.379562] ? __x64_sys_futex+0x78/0x1e0 Aug 22 18:26:46 juju-e4d256-prod-github-runner-207 kernel: [46980.380349] ? __secure_computing+0xa9/0x120 Aug 22 18:26:46 juju-e4d256-prod-github-runner-207 kernel: [46980.381158] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 18:26:46 juju-e4d256-prod-github-runner-207 kernel: [46980.382064] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:26:46 juju-e4d256-prod-github-runner-207 kernel: [46980.382917] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:26:46 juju-e4d256-prod-github-runner-207 kernel: [46980.383797] ? do_syscall_64+0x69/0xc0 Aug 22 18:26:46 juju-e4d256-prod-github-runner-207 kernel: [46980.384577] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:26:46 juju-e4d256-prod-github-runner-207 kernel: [46980.385430] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:26:46 juju-e4d256-prod-github-runner-207 kernel: [46980.386287] ? do_syscall_64+0x69/0xc0 Aug 22 18:26:46 juju-e4d256-prod-github-runner-207 kernel: [46980.387064] ? do_syscall_64+0x69/0xc0 Aug 22 18:26:46 juju-e4d256-prod-github-runner-207 kernel: [46980.387853] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 18:26:46 juju-e4d256-prod-github-runner-207 kernel: [46980.388733] RIP: 0033:0x7faa5d0edaff Aug 22 18:26:46 juju-e4d256-prod-github-runner-207 kernel: [46980.389931] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 18:26:46 juju-e4d256-prod-github-runner-207 kernel: [46980.392449] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 18:26:46 juju-e4d256-prod-github-runner-207 kernel: [46980.393573] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 18:26:46 juju-e4d256-prod-github-runner-207 kernel: [46980.394663] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 18:26:46 juju-e4d256-prod-github-runner-207 kernel: [46980.395771] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 18:26:46 juju-e4d256-prod-github-runner-207 kernel: [46980.396858] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 18:26:46 juju-e4d256-prod-github-runner-207 kernel: [46980.397931] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 18:26:46 juju-e4d256-prod-github-runner-207 kernel: [46980.398987] Aug 22 18:27:10 juju-e4d256-prod-github-runner-207 kernel: [47004.541981] watchdog: BUG: soft lockup - CPU#1 stuck for 43668s! [qemu-system-x86:6715] Aug 22 18:27:10 juju-e4d256-prod-github-runner-207 kernel: [47004.544227] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 18:27:10 juju-e4d256-prod-github-runner-207 kernel: [47004.544505] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 18:27:10 juju-e4d256-prod-github-runner-207 kernel: [47004.559100] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 18:27:10 juju-e4d256-prod-github-runner-207 kernel: [47004.563716] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 18:27:10 juju-e4d256-prod-github-runner-207 kernel: [47004.565547] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:27:10 juju-e4d256-prod-github-runner-207 kernel: [47004.567229] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 18:27:10 juju-e4d256-prod-github-runner-207 kernel: [47004.571217] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 18:27:10 juju-e4d256-prod-github-runner-207 kernel: [47004.572783] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 18:27:10 juju-e4d256-prod-github-runner-207 kernel: [47004.574569] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 18:27:10 juju-e4d256-prod-github-runner-207 kernel: [47004.576331] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 18:27:10 juju-e4d256-prod-github-runner-207 kernel: [47004.578004] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 18:27:10 juju-e4d256-prod-github-runner-207 kernel: [47004.579785] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 18:27:10 juju-e4d256-prod-github-runner-207 kernel: [47004.581472] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 18:27:10 juju-e4d256-prod-github-runner-207 kernel: [47004.583327] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 18:27:10 juju-e4d256-prod-github-runner-207 kernel: [47004.585303] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 18:27:10 juju-e4d256-prod-github-runner-207 kernel: [47004.587068] Call Trace: Aug 22 18:27:10 juju-e4d256-prod-github-runner-207 kernel: [47004.588482] Aug 22 18:27:10 juju-e4d256-prod-github-runner-207 kernel: [47004.589895] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:27:10 juju-e4d256-prod-github-runner-207 kernel: [47004.591448] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:27:10 juju-e4d256-prod-github-runner-207 kernel: [47004.593021] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:27:10 juju-e4d256-prod-github-runner-207 kernel: [47004.594742] ? show_regs.part.0+0x23/0x29 Aug 22 18:27:10 juju-e4d256-prod-github-runner-207 kernel: [47004.595936] ? show_regs.cold+0x8/0xd Aug 22 18:27:10 juju-e4d256-prod-github-runner-207 kernel: [47004.596940] ? watchdog_timer_fn+0x1be/0x220 Aug 22 18:27:10 juju-e4d256-prod-github-runner-207 kernel: [47004.598146] ? lockup_detector_update_enable+0x60/0x60 Aug 22 18:27:10 juju-e4d256-prod-github-runner-207 kernel: [47004.599256] ? __hrtimer_run_queues+0x107/0x230 Aug 22 18:27:10 juju-e4d256-prod-github-runner-207 kernel: [47004.600343] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 18:27:10 juju-e4d256-prod-github-runner-207 kernel: [47004.601376] ? hrtimer_interrupt+0x101/0x220 Aug 22 18:27:10 juju-e4d256-prod-github-runner-207 kernel: [47004.602394] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 18:27:10 juju-e4d256-prod-github-runner-207 kernel: [47004.603547] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 18:27:10 juju-e4d256-prod-github-runner-207 kernel: [47004.604607] Aug 22 18:27:10 juju-e4d256-prod-github-runner-207 kernel: [47004.605466] Aug 22 18:27:10 juju-e4d256-prod-github-runner-207 kernel: [47004.606308] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 18:27:10 juju-e4d256-prod-github-runner-207 kernel: [47004.607411] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:27:10 juju-e4d256-prod-github-runner-207 kernel: [47004.608471] ? _raw_spin_lock+0x22/0x30 Aug 22 18:27:10 juju-e4d256-prod-github-runner-207 kernel: [47004.609425] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:27:10 juju-e4d256-prod-github-runner-207 kernel: [47004.610455] direct_page_fault+0x206/0x310 [kvm] Aug 22 18:27:10 juju-e4d256-prod-github-runner-207 kernel: [47004.611558] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 18:27:10 juju-e4d256-prod-github-runner-207 kernel: [47004.612584] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 18:27:10 juju-e4d256-prod-github-runner-207 kernel: [47004.613589] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 18:27:10 juju-e4d256-prod-github-runner-207 kernel: [47004.614612] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 18:27:10 juju-e4d256-prod-github-runner-207 kernel: [47004.615652] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 18:27:10 juju-e4d256-prod-github-runner-207 kernel: [47004.616649] handle_exit+0x98/0x230 [kvm_amd] Aug 22 18:27:10 juju-e4d256-prod-github-runner-207 kernel: [47004.617547] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 18:27:10 juju-e4d256-prod-github-runner-207 kernel: [47004.618468] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 18:27:10 juju-e4d256-prod-github-runner-207 kernel: [47004.619467] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 18:27:10 juju-e4d256-prod-github-runner-207 kernel: [47004.620387] vcpu_run+0x62/0x2c0 [kvm] Aug 22 18:27:10 juju-e4d256-prod-github-runner-207 kernel: [47004.621205] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 18:27:10 juju-e4d256-prod-github-runner-207 kernel: [47004.622019] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 18:27:10 juju-e4d256-prod-github-runner-207 kernel: [47004.622955] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 18:27:10 juju-e4d256-prod-github-runner-207 kernel: [47004.623821] ? __seccomp_filter+0x4a/0x4a0 Aug 22 18:27:10 juju-e4d256-prod-github-runner-207 kernel: [47004.624568] ? __fget_files+0x86/0xc0 Aug 22 18:27:10 juju-e4d256-prod-github-runner-207 kernel: [47004.625275] __x64_sys_ioctl+0x95/0xd0 Aug 22 18:27:10 juju-e4d256-prod-github-runner-207 kernel: [47004.625968] do_syscall_64+0x5c/0xc0 Aug 22 18:27:10 juju-e4d256-prod-github-runner-207 kernel: [47004.626636] ? do_futex+0x162/0x1f0 Aug 22 18:27:10 juju-e4d256-prod-github-runner-207 kernel: [47004.627380] ? __x64_sys_futex+0x78/0x1e0 Aug 22 18:27:10 juju-e4d256-prod-github-runner-207 kernel: [47004.628103] ? __secure_computing+0xa9/0x120 Aug 22 18:27:10 juju-e4d256-prod-github-runner-207 kernel: [47004.628805] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 18:27:10 juju-e4d256-prod-github-runner-207 kernel: [47004.629566] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:27:10 juju-e4d256-prod-github-runner-207 kernel: [47004.630291] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:27:10 juju-e4d256-prod-github-runner-207 kernel: [47004.631013] ? do_syscall_64+0x69/0xc0 Aug 22 18:27:10 juju-e4d256-prod-github-runner-207 kernel: [47004.631943] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:27:10 juju-e4d256-prod-github-runner-207 kernel: [47004.632661] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:27:10 juju-e4d256-prod-github-runner-207 kernel: [47004.633360] ? do_syscall_64+0x69/0xc0 Aug 22 18:27:10 juju-e4d256-prod-github-runner-207 kernel: [47004.633987] ? do_syscall_64+0x69/0xc0 Aug 22 18:27:10 juju-e4d256-prod-github-runner-207 kernel: [47004.634617] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 18:27:10 juju-e4d256-prod-github-runner-207 kernel: [47004.635406] RIP: 0033:0x7faa5d0edaff Aug 22 18:27:10 juju-e4d256-prod-github-runner-207 kernel: [47004.636096] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 18:27:10 juju-e4d256-prod-github-runner-207 kernel: [47004.638084] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 18:27:10 juju-e4d256-prod-github-runner-207 kernel: [47004.639002] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 18:27:10 juju-e4d256-prod-github-runner-207 kernel: [47004.639966] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 18:27:10 juju-e4d256-prod-github-runner-207 kernel: [47004.640858] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 18:27:10 juju-e4d256-prod-github-runner-207 kernel: [47004.641753] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 18:27:10 juju-e4d256-prod-github-runner-207 kernel: [47004.642642] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 18:27:10 juju-e4d256-prod-github-runner-207 kernel: [47004.643607] Aug 22 18:27:38 juju-e4d256-prod-github-runner-207 kernel: [47032.542096] watchdog: BUG: soft lockup - CPU#1 stuck for 43694s! [qemu-system-x86:6715] Aug 22 18:27:38 juju-e4d256-prod-github-runner-207 kernel: [47032.546406] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 18:27:38 juju-e4d256-prod-github-runner-207 kernel: [47032.547760] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 18:27:38 juju-e4d256-prod-github-runner-207 kernel: [47032.570412] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 18:27:38 juju-e4d256-prod-github-runner-207 kernel: [47032.571708] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 18:27:38 juju-e4d256-prod-github-runner-207 kernel: [47032.575189] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:27:38 juju-e4d256-prod-github-runner-207 kernel: [47032.577742] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 18:27:38 juju-e4d256-prod-github-runner-207 kernel: [47032.582856] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 18:27:38 juju-e4d256-prod-github-runner-207 kernel: [47032.584375] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 18:27:38 juju-e4d256-prod-github-runner-207 kernel: [47032.587060] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 18:27:38 juju-e4d256-prod-github-runner-207 kernel: [47032.590361] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 18:27:38 juju-e4d256-prod-github-runner-207 kernel: [47032.591596] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 18:27:38 juju-e4d256-prod-github-runner-207 kernel: [47032.594814] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 18:27:38 juju-e4d256-prod-github-runner-207 kernel: [47032.596012] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 18:27:38 juju-e4d256-prod-github-runner-207 kernel: [47032.599328] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 18:27:38 juju-e4d256-prod-github-runner-207 kernel: [47032.600458] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 18:27:38 juju-e4d256-prod-github-runner-207 kernel: [47032.601768] Call Trace: Aug 22 18:27:38 juju-e4d256-prod-github-runner-207 kernel: [47032.602692] Aug 22 18:27:38 juju-e4d256-prod-github-runner-207 kernel: [47032.603606] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:27:38 juju-e4d256-prod-github-runner-207 kernel: [47032.604640] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:27:38 juju-e4d256-prod-github-runner-207 kernel: [47032.605660] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:27:38 juju-e4d256-prod-github-runner-207 kernel: [47032.606775] ? show_regs.part.0+0x23/0x29 Aug 22 18:27:38 juju-e4d256-prod-github-runner-207 kernel: [47032.607778] ? show_regs.cold+0x8/0xd Aug 22 18:27:38 juju-e4d256-prod-github-runner-207 kernel: [47032.608749] ? watchdog_timer_fn+0x1be/0x220 Aug 22 18:27:38 juju-e4d256-prod-github-runner-207 kernel: [47032.609755] ? lockup_detector_update_enable+0x60/0x60 Aug 22 18:27:38 juju-e4d256-prod-github-runner-207 kernel: [47032.610835] ? __hrtimer_run_queues+0x107/0x230 Aug 22 18:27:38 juju-e4d256-prod-github-runner-207 kernel: [47032.611861] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 18:27:38 juju-e4d256-prod-github-runner-207 kernel: [47032.612887] ? hrtimer_interrupt+0x101/0x220 Aug 22 18:27:38 juju-e4d256-prod-github-runner-207 kernel: [47032.613905] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 18:27:38 juju-e4d256-prod-github-runner-207 kernel: [47032.614981] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 18:27:38 juju-e4d256-prod-github-runner-207 kernel: [47032.616025] Aug 22 18:27:38 juju-e4d256-prod-github-runner-207 kernel: [47032.616878] Aug 22 18:27:38 juju-e4d256-prod-github-runner-207 kernel: [47032.617718] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 18:27:38 juju-e4d256-prod-github-runner-207 kernel: [47032.618749] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:27:38 juju-e4d256-prod-github-runner-207 kernel: [47032.619796] ? _raw_spin_lock+0x22/0x30 Aug 22 18:27:38 juju-e4d256-prod-github-runner-207 kernel: [47032.620749] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:27:38 juju-e4d256-prod-github-runner-207 kernel: [47032.621774] direct_page_fault+0x206/0x310 [kvm] Aug 22 18:27:38 juju-e4d256-prod-github-runner-207 kernel: [47032.622802] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 18:27:38 juju-e4d256-prod-github-runner-207 kernel: [47032.623831] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 18:27:38 juju-e4d256-prod-github-runner-207 kernel: [47032.624830] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 18:27:38 juju-e4d256-prod-github-runner-207 kernel: [47032.625839] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 18:27:38 juju-e4d256-prod-github-runner-207 kernel: [47032.626780] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 18:27:38 juju-e4d256-prod-github-runner-207 kernel: [47032.627777] handle_exit+0x98/0x230 [kvm_amd] Aug 22 18:27:38 juju-e4d256-prod-github-runner-207 kernel: [47032.628666] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 18:27:38 juju-e4d256-prod-github-runner-207 kernel: [47032.629577] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 18:27:38 juju-e4d256-prod-github-runner-207 kernel: [47032.630496] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 18:27:38 juju-e4d256-prod-github-runner-207 kernel: [47032.631411] vcpu_run+0x62/0x2c0 [kvm] Aug 22 18:27:38 juju-e4d256-prod-github-runner-207 kernel: [47032.632219] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 18:27:38 juju-e4d256-prod-github-runner-207 kernel: [47032.633030] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 18:27:38 juju-e4d256-prod-github-runner-207 kernel: [47032.633886] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 18:27:38 juju-e4d256-prod-github-runner-207 kernel: [47032.634678] ? __seccomp_filter+0x4a/0x4a0 Aug 22 18:27:38 juju-e4d256-prod-github-runner-207 kernel: [47032.635427] ? __fget_files+0x86/0xc0 Aug 22 18:27:38 juju-e4d256-prod-github-runner-207 kernel: [47032.636133] __x64_sys_ioctl+0x95/0xd0 Aug 22 18:27:38 juju-e4d256-prod-github-runner-207 kernel: [47032.636823] do_syscall_64+0x5c/0xc0 Aug 22 18:27:38 juju-e4d256-prod-github-runner-207 kernel: [47032.637484] ? do_futex+0x162/0x1f0 Aug 22 18:27:38 juju-e4d256-prod-github-runner-207 kernel: [47032.638130] ? __x64_sys_futex+0x78/0x1e0 Aug 22 18:27:38 juju-e4d256-prod-github-runner-207 kernel: [47032.638804] ? __secure_computing+0xa9/0x120 Aug 22 18:27:38 juju-e4d256-prod-github-runner-207 kernel: [47032.639499] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 18:27:38 juju-e4d256-prod-github-runner-207 kernel: [47032.640255] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:27:38 juju-e4d256-prod-github-runner-207 kernel: [47032.640972] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:27:38 juju-e4d256-prod-github-runner-207 kernel: [47032.641687] ? do_syscall_64+0x69/0xc0 Aug 22 18:27:38 juju-e4d256-prod-github-runner-207 kernel: [47032.642328] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:27:38 juju-e4d256-prod-github-runner-207 kernel: [47032.643043] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:27:38 juju-e4d256-prod-github-runner-207 kernel: [47032.643734] ? do_syscall_64+0x69/0xc0 Aug 22 18:27:38 juju-e4d256-prod-github-runner-207 kernel: [47032.644354] ? do_syscall_64+0x69/0xc0 Aug 22 18:27:38 juju-e4d256-prod-github-runner-207 kernel: [47032.644977] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 18:27:38 juju-e4d256-prod-github-runner-207 kernel: [47032.645679] RIP: 0033:0x7faa5d0edaff Aug 22 18:27:38 juju-e4d256-prod-github-runner-207 kernel: [47032.646338] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 18:27:38 juju-e4d256-prod-github-runner-207 kernel: [47032.648327] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 18:27:38 juju-e4d256-prod-github-runner-207 kernel: [47032.649239] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 18:27:38 juju-e4d256-prod-github-runner-207 kernel: [47032.650124] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 18:27:38 juju-e4d256-prod-github-runner-207 kernel: [47032.651025] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 18:27:38 juju-e4d256-prod-github-runner-207 kernel: [47032.651909] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 18:27:38 juju-e4d256-prod-github-runner-207 kernel: [47032.652793] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 18:27:38 juju-e4d256-prod-github-runner-207 kernel: [47032.653684] Aug 22 18:28:06 juju-e4d256-prod-github-runner-207 kernel: [47060.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 43720s! [qemu-system-x86:6715] Aug 22 18:28:06 juju-e4d256-prod-github-runner-207 kernel: [47060.543965] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 18:28:06 juju-e4d256-prod-github-runner-207 kernel: [47060.544290] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 18:28:06 juju-e4d256-prod-github-runner-207 kernel: [47060.556872] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 18:28:06 juju-e4d256-prod-github-runner-207 kernel: [47060.558201] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 18:28:06 juju-e4d256-prod-github-runner-207 kernel: [47060.559465] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:28:06 juju-e4d256-prod-github-runner-207 kernel: [47060.560531] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 18:28:06 juju-e4d256-prod-github-runner-207 kernel: [47060.563131] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 18:28:06 juju-e4d256-prod-github-runner-207 kernel: [47060.564183] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 18:28:06 juju-e4d256-prod-github-runner-207 kernel: [47060.565358] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 18:28:06 juju-e4d256-prod-github-runner-207 kernel: [47060.566541] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 18:28:06 juju-e4d256-prod-github-runner-207 kernel: [47060.567717] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 18:28:06 juju-e4d256-prod-github-runner-207 kernel: [47060.568899] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 18:28:06 juju-e4d256-prod-github-runner-207 kernel: [47060.570085] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 18:28:06 juju-e4d256-prod-github-runner-207 kernel: [47060.571354] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 18:28:06 juju-e4d256-prod-github-runner-207 kernel: [47060.572477] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 18:28:06 juju-e4d256-prod-github-runner-207 kernel: [47060.573693] Call Trace: Aug 22 18:28:06 juju-e4d256-prod-github-runner-207 kernel: [47060.574641] Aug 22 18:28:06 juju-e4d256-prod-github-runner-207 kernel: [47060.575569] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:28:06 juju-e4d256-prod-github-runner-207 kernel: [47060.576610] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:28:06 juju-e4d256-prod-github-runner-207 kernel: [47060.577655] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:28:06 juju-e4d256-prod-github-runner-207 kernel: [47060.578797] ? show_regs.part.0+0x23/0x29 Aug 22 18:28:06 juju-e4d256-prod-github-runner-207 kernel: [47060.579815] ? show_regs.cold+0x8/0xd Aug 22 18:28:06 juju-e4d256-prod-github-runner-207 kernel: [47060.580798] ? watchdog_timer_fn+0x1be/0x220 Aug 22 18:28:06 juju-e4d256-prod-github-runner-207 kernel: [47060.581819] ? lockup_detector_update_enable+0x60/0x60 Aug 22 18:28:06 juju-e4d256-prod-github-runner-207 kernel: [47060.582917] ? __hrtimer_run_queues+0x107/0x230 Aug 22 18:28:06 juju-e4d256-prod-github-runner-207 kernel: [47060.583965] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 18:28:06 juju-e4d256-prod-github-runner-207 kernel: [47060.585000] ? hrtimer_interrupt+0x101/0x220 Aug 22 18:28:06 juju-e4d256-prod-github-runner-207 kernel: [47060.586027] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 18:28:06 juju-e4d256-prod-github-runner-207 kernel: [47060.587118] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 18:28:06 juju-e4d256-prod-github-runner-207 kernel: [47060.588183] Aug 22 18:28:06 juju-e4d256-prod-github-runner-207 kernel: [47060.589045] Aug 22 18:28:06 juju-e4d256-prod-github-runner-207 kernel: [47060.589892] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 18:28:06 juju-e4d256-prod-github-runner-207 kernel: [47060.590954] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:28:06 juju-e4d256-prod-github-runner-207 kernel: [47060.592008] ? _raw_spin_lock+0x22/0x30 Aug 22 18:28:06 juju-e4d256-prod-github-runner-207 kernel: [47060.592971] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:28:06 juju-e4d256-prod-github-runner-207 kernel: [47060.594015] direct_page_fault+0x206/0x310 [kvm] Aug 22 18:28:06 juju-e4d256-prod-github-runner-207 kernel: [47060.595072] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 18:28:06 juju-e4d256-prod-github-runner-207 kernel: [47060.596095] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 18:28:06 juju-e4d256-prod-github-runner-207 kernel: [47060.597115] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 18:28:06 juju-e4d256-prod-github-runner-207 kernel: [47060.598143] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 18:28:06 juju-e4d256-prod-github-runner-207 kernel: [47060.599119] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 18:28:06 juju-e4d256-prod-github-runner-207 kernel: [47060.600118] handle_exit+0x98/0x230 [kvm_amd] Aug 22 18:28:06 juju-e4d256-prod-github-runner-207 kernel: [47060.601027] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 18:28:06 juju-e4d256-prod-github-runner-207 kernel: [47060.601968] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 18:28:06 juju-e4d256-prod-github-runner-207 kernel: [47060.602924] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 18:28:06 juju-e4d256-prod-github-runner-207 kernel: [47060.603848] vcpu_run+0x62/0x2c0 [kvm] Aug 22 18:28:06 juju-e4d256-prod-github-runner-207 kernel: [47060.604672] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 18:28:06 juju-e4d256-prod-github-runner-207 kernel: [47060.605498] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 18:28:06 juju-e4d256-prod-github-runner-207 kernel: [47060.606373] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 18:28:06 juju-e4d256-prod-github-runner-207 kernel: [47060.607199] ? __seccomp_filter+0x4a/0x4a0 Aug 22 18:28:06 juju-e4d256-prod-github-runner-207 kernel: [47060.607954] ? __fget_files+0x86/0xc0 Aug 22 18:28:06 juju-e4d256-prod-github-runner-207 kernel: [47060.608670] __x64_sys_ioctl+0x95/0xd0 Aug 22 18:28:06 juju-e4d256-prod-github-runner-207 kernel: [47060.609381] do_syscall_64+0x5c/0xc0 Aug 22 18:28:06 juju-e4d256-prod-github-runner-207 kernel: [47060.610057] ? do_futex+0x162/0x1f0 Aug 22 18:28:06 juju-e4d256-prod-github-runner-207 kernel: [47060.610734] ? __x64_sys_futex+0x78/0x1e0 Aug 22 18:28:06 juju-e4d256-prod-github-runner-207 kernel: [47060.611419] ? __secure_computing+0xa9/0x120 Aug 22 18:28:06 juju-e4d256-prod-github-runner-207 kernel: [47060.612125] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 18:28:06 juju-e4d256-prod-github-runner-207 kernel: [47060.612906] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:28:06 juju-e4d256-prod-github-runner-207 kernel: [47060.613641] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:28:06 juju-e4d256-prod-github-runner-207 kernel: [47060.614371] ? do_syscall_64+0x69/0xc0 Aug 22 18:28:06 juju-e4d256-prod-github-runner-207 kernel: [47060.615038] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:28:06 juju-e4d256-prod-github-runner-207 kernel: [47060.615829] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:28:06 juju-e4d256-prod-github-runner-207 kernel: [47060.616525] ? do_syscall_64+0x69/0xc0 Aug 22 18:28:06 juju-e4d256-prod-github-runner-207 kernel: [47060.617261] ? do_syscall_64+0x69/0xc0 Aug 22 18:28:06 juju-e4d256-prod-github-runner-207 kernel: [47060.617884] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 18:28:06 juju-e4d256-prod-github-runner-207 kernel: [47060.618694] RIP: 0033:0x7faa5d0edaff Aug 22 18:28:06 juju-e4d256-prod-github-runner-207 kernel: [47060.619370] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 18:28:06 juju-e4d256-prod-github-runner-207 kernel: [47060.621350] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 18:28:06 juju-e4d256-prod-github-runner-207 kernel: [47060.622259] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 18:28:06 juju-e4d256-prod-github-runner-207 kernel: [47060.623161] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 18:28:06 juju-e4d256-prod-github-runner-207 kernel: [47060.624047] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 18:28:06 juju-e4d256-prod-github-runner-207 kernel: [47060.624933] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 18:28:06 juju-e4d256-prod-github-runner-207 kernel: [47060.625821] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 18:28:06 juju-e4d256-prod-github-runner-207 kernel: [47060.626732] Aug 22 18:28:34 juju-e4d256-prod-github-runner-207 kernel: [47088.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 43746s! [qemu-system-x86:6715] Aug 22 18:28:34 juju-e4d256-prod-github-runner-207 kernel: [47088.543954] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 18:28:34 juju-e4d256-prod-github-runner-207 kernel: [47088.544288] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 18:28:34 juju-e4d256-prod-github-runner-207 kernel: [47088.556472] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 18:28:34 juju-e4d256-prod-github-runner-207 kernel: [47088.557758] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 18:28:34 juju-e4d256-prod-github-runner-207 kernel: [47088.558986] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:28:34 juju-e4d256-prod-github-runner-207 kernel: [47088.560044] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 18:28:34 juju-e4d256-prod-github-runner-207 kernel: [47088.562631] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 18:28:34 juju-e4d256-prod-github-runner-207 kernel: [47088.563683] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 18:28:34 juju-e4d256-prod-github-runner-207 kernel: [47088.564847] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 18:28:34 juju-e4d256-prod-github-runner-207 kernel: [47088.566035] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 18:28:34 juju-e4d256-prod-github-runner-207 kernel: [47088.567227] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 18:28:34 juju-e4d256-prod-github-runner-207 kernel: [47088.568390] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 18:28:34 juju-e4d256-prod-github-runner-207 kernel: [47088.569707] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 18:28:34 juju-e4d256-prod-github-runner-207 kernel: [47088.570950] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 18:28:34 juju-e4d256-prod-github-runner-207 kernel: [47088.572063] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 18:28:34 juju-e4d256-prod-github-runner-207 kernel: [47088.573256] Call Trace: Aug 22 18:28:34 juju-e4d256-prod-github-runner-207 kernel: [47088.574184] Aug 22 18:28:34 juju-e4d256-prod-github-runner-207 kernel: [47088.575089] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:28:34 juju-e4d256-prod-github-runner-207 kernel: [47088.576129] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:28:34 juju-e4d256-prod-github-runner-207 kernel: [47088.577170] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:28:34 juju-e4d256-prod-github-runner-207 kernel: [47088.578295] ? show_regs.part.0+0x23/0x29 Aug 22 18:28:34 juju-e4d256-prod-github-runner-207 kernel: [47088.579295] ? show_regs.cold+0x8/0xd Aug 22 18:28:34 juju-e4d256-prod-github-runner-207 kernel: [47088.580266] ? watchdog_timer_fn+0x1be/0x220 Aug 22 18:28:34 juju-e4d256-prod-github-runner-207 kernel: [47088.581275] ? lockup_detector_update_enable+0x60/0x60 Aug 22 18:28:34 juju-e4d256-prod-github-runner-207 kernel: [47088.582373] ? __hrtimer_run_queues+0x107/0x230 Aug 22 18:28:34 juju-e4d256-prod-github-runner-207 kernel: [47088.583413] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 18:28:34 juju-e4d256-prod-github-runner-207 kernel: [47088.584443] ? hrtimer_interrupt+0x101/0x220 Aug 22 18:28:34 juju-e4d256-prod-github-runner-207 kernel: [47088.585510] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 18:28:34 juju-e4d256-prod-github-runner-207 kernel: [47088.586621] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 18:28:34 juju-e4d256-prod-github-runner-207 kernel: [47088.587696] Aug 22 18:28:34 juju-e4d256-prod-github-runner-207 kernel: [47088.588549] Aug 22 18:28:34 juju-e4d256-prod-github-runner-207 kernel: [47088.589390] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 18:28:34 juju-e4d256-prod-github-runner-207 kernel: [47088.590438] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:28:34 juju-e4d256-prod-github-runner-207 kernel: [47088.591520] ? _raw_spin_lock+0x22/0x30 Aug 22 18:28:34 juju-e4d256-prod-github-runner-207 kernel: [47088.592491] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:28:34 juju-e4d256-prod-github-runner-207 kernel: [47088.593524] direct_page_fault+0x206/0x310 [kvm] Aug 22 18:28:34 juju-e4d256-prod-github-runner-207 kernel: [47088.594569] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 18:28:34 juju-e4d256-prod-github-runner-207 kernel: [47088.595805] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 18:28:34 juju-e4d256-prod-github-runner-207 kernel: [47088.596835] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 18:28:34 juju-e4d256-prod-github-runner-207 kernel: [47088.597870] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 18:28:34 juju-e4d256-prod-github-runner-207 kernel: [47088.599002] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 18:28:34 juju-e4d256-prod-github-runner-207 kernel: [47088.599978] handle_exit+0x98/0x230 [kvm_amd] Aug 22 18:28:34 juju-e4d256-prod-github-runner-207 kernel: [47088.600870] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 18:28:34 juju-e4d256-prod-github-runner-207 kernel: [47088.601789] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 18:28:34 juju-e4d256-prod-github-runner-207 kernel: [47088.602746] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 18:28:34 juju-e4d256-prod-github-runner-207 kernel: [47088.603660] vcpu_run+0x62/0x2c0 [kvm] Aug 22 18:28:34 juju-e4d256-prod-github-runner-207 kernel: [47088.604473] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 18:28:34 juju-e4d256-prod-github-runner-207 kernel: [47088.605291] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 18:28:34 juju-e4d256-prod-github-runner-207 kernel: [47088.606168] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 18:28:34 juju-e4d256-prod-github-runner-207 kernel: [47088.606970] ? __seccomp_filter+0x4a/0x4a0 Aug 22 18:28:34 juju-e4d256-prod-github-runner-207 kernel: [47088.607746] ? __fget_files+0x86/0xc0 Aug 22 18:28:34 juju-e4d256-prod-github-runner-207 kernel: [47088.608457] __x64_sys_ioctl+0x95/0xd0 Aug 22 18:28:34 juju-e4d256-prod-github-runner-207 kernel: [47088.609151] do_syscall_64+0x5c/0xc0 Aug 22 18:28:34 juju-e4d256-prod-github-runner-207 kernel: [47088.609818] ? do_futex+0x162/0x1f0 Aug 22 18:28:34 juju-e4d256-prod-github-runner-207 kernel: [47088.610478] ? __x64_sys_futex+0x78/0x1e0 Aug 22 18:28:34 juju-e4d256-prod-github-runner-207 kernel: [47088.611154] ? __secure_computing+0xa9/0x120 Aug 22 18:28:34 juju-e4d256-prod-github-runner-207 kernel: [47088.611844] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 18:28:34 juju-e4d256-prod-github-runner-207 kernel: [47088.612612] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:28:34 juju-e4d256-prod-github-runner-207 kernel: [47088.613394] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:28:34 juju-e4d256-prod-github-runner-207 kernel: [47088.614149] ? do_syscall_64+0x69/0xc0 Aug 22 18:28:34 juju-e4d256-prod-github-runner-207 kernel: [47088.614796] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:28:34 juju-e4d256-prod-github-runner-207 kernel: [47088.615498] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:28:34 juju-e4d256-prod-github-runner-207 kernel: [47088.616194] ? do_syscall_64+0x69/0xc0 Aug 22 18:28:34 juju-e4d256-prod-github-runner-207 kernel: [47088.616820] ? do_syscall_64+0x69/0xc0 Aug 22 18:28:34 juju-e4d256-prod-github-runner-207 kernel: [47088.617458] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 18:28:34 juju-e4d256-prod-github-runner-207 kernel: [47088.618226] RIP: 0033:0x7faa5d0edaff Aug 22 18:28:34 juju-e4d256-prod-github-runner-207 kernel: [47088.618906] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 18:28:34 juju-e4d256-prod-github-runner-207 kernel: [47088.620892] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 18:28:34 juju-e4d256-prod-github-runner-207 kernel: [47088.621812] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 18:28:34 juju-e4d256-prod-github-runner-207 kernel: [47088.622720] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 18:28:34 juju-e4d256-prod-github-runner-207 kernel: [47088.623659] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 18:28:34 juju-e4d256-prod-github-runner-207 kernel: [47088.624553] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 18:28:34 juju-e4d256-prod-github-runner-207 kernel: [47088.625485] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 18:28:34 juju-e4d256-prod-github-runner-207 kernel: [47088.626402] Aug 22 18:29:02 juju-e4d256-prod-github-runner-207 kernel: [47116.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 43772s! [qemu-system-x86:6715] Aug 22 18:29:02 juju-e4d256-prod-github-runner-207 kernel: [47116.544273] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 18:29:02 juju-e4d256-prod-github-runner-207 kernel: [47116.544574] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 18:29:02 juju-e4d256-prod-github-runner-207 kernel: [47116.556754] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 18:29:02 juju-e4d256-prod-github-runner-207 kernel: [47116.558082] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 18:29:02 juju-e4d256-prod-github-runner-207 kernel: [47116.559319] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:29:02 juju-e4d256-prod-github-runner-207 kernel: [47116.560379] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 18:29:02 juju-e4d256-prod-github-runner-207 kernel: [47116.562965] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 18:29:02 juju-e4d256-prod-github-runner-207 kernel: [47116.564007] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 18:29:02 juju-e4d256-prod-github-runner-207 kernel: [47116.565236] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 18:29:02 juju-e4d256-prod-github-runner-207 kernel: [47116.566442] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 18:29:02 juju-e4d256-prod-github-runner-207 kernel: [47116.567610] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 18:29:02 juju-e4d256-prod-github-runner-207 kernel: [47116.568775] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 18:29:02 juju-e4d256-prod-github-runner-207 kernel: [47116.569971] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 18:29:02 juju-e4d256-prod-github-runner-207 kernel: [47116.571207] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 18:29:02 juju-e4d256-prod-github-runner-207 kernel: [47116.572304] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 18:29:02 juju-e4d256-prod-github-runner-207 kernel: [47116.573504] Call Trace: Aug 22 18:29:02 juju-e4d256-prod-github-runner-207 kernel: [47116.574438] Aug 22 18:29:02 juju-e4d256-prod-github-runner-207 kernel: [47116.575340] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:29:02 juju-e4d256-prod-github-runner-207 kernel: [47116.576372] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:29:02 juju-e4d256-prod-github-runner-207 kernel: [47116.577394] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:29:02 juju-e4d256-prod-github-runner-207 kernel: [47116.578522] ? show_regs.part.0+0x23/0x29 Aug 22 18:29:02 juju-e4d256-prod-github-runner-207 kernel: [47116.579519] ? show_regs.cold+0x8/0xd Aug 22 18:29:02 juju-e4d256-prod-github-runner-207 kernel: [47116.580490] ? watchdog_timer_fn+0x1be/0x220 Aug 22 18:29:02 juju-e4d256-prod-github-runner-207 kernel: [47116.581506] ? lockup_detector_update_enable+0x60/0x60 Aug 22 18:29:02 juju-e4d256-prod-github-runner-207 kernel: [47116.582591] ? __hrtimer_run_queues+0x107/0x230 Aug 22 18:29:02 juju-e4d256-prod-github-runner-207 kernel: [47116.583618] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 18:29:02 juju-e4d256-prod-github-runner-207 kernel: [47116.584654] ? hrtimer_interrupt+0x101/0x220 Aug 22 18:29:02 juju-e4d256-prod-github-runner-207 kernel: [47116.585678] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 18:29:02 juju-e4d256-prod-github-runner-207 kernel: [47116.586793] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 18:29:02 juju-e4d256-prod-github-runner-207 kernel: [47116.587845] Aug 22 18:29:02 juju-e4d256-prod-github-runner-207 kernel: [47116.588699] Aug 22 18:29:02 juju-e4d256-prod-github-runner-207 kernel: [47116.589537] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 18:29:02 juju-e4d256-prod-github-runner-207 kernel: [47116.590594] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:29:02 juju-e4d256-prod-github-runner-207 kernel: [47116.591645] ? _raw_spin_lock+0x22/0x30 Aug 22 18:29:02 juju-e4d256-prod-github-runner-207 kernel: [47116.592598] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:29:02 juju-e4d256-prod-github-runner-207 kernel: [47116.593625] direct_page_fault+0x206/0x310 [kvm] Aug 22 18:29:02 juju-e4d256-prod-github-runner-207 kernel: [47116.594675] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 18:29:02 juju-e4d256-prod-github-runner-207 kernel: [47116.595684] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 18:29:02 juju-e4d256-prod-github-runner-207 kernel: [47116.596689] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 18:29:02 juju-e4d256-prod-github-runner-207 kernel: [47116.597701] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 18:29:02 juju-e4d256-prod-github-runner-207 kernel: [47116.598662] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 18:29:02 juju-e4d256-prod-github-runner-207 kernel: [47116.599642] handle_exit+0x98/0x230 [kvm_amd] Aug 22 18:29:02 juju-e4d256-prod-github-runner-207 kernel: [47116.600539] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 18:29:02 juju-e4d256-prod-github-runner-207 kernel: [47116.601455] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 18:29:02 juju-e4d256-prod-github-runner-207 kernel: [47116.602397] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 18:29:02 juju-e4d256-prod-github-runner-207 kernel: [47116.603304] vcpu_run+0x62/0x2c0 [kvm] Aug 22 18:29:02 juju-e4d256-prod-github-runner-207 kernel: [47116.604118] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 18:29:02 juju-e4d256-prod-github-runner-207 kernel: [47116.604927] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 18:29:02 juju-e4d256-prod-github-runner-207 kernel: [47116.605802] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 18:29:02 juju-e4d256-prod-github-runner-207 kernel: [47116.606608] ? __seccomp_filter+0x4a/0x4a0 Aug 22 18:29:02 juju-e4d256-prod-github-runner-207 kernel: [47116.607351] ? __fget_files+0x86/0xc0 Aug 22 18:29:02 juju-e4d256-prod-github-runner-207 kernel: [47116.608055] __x64_sys_ioctl+0x95/0xd0 Aug 22 18:29:02 juju-e4d256-prod-github-runner-207 kernel: [47116.608748] do_syscall_64+0x5c/0xc0 Aug 22 18:29:02 juju-e4d256-prod-github-runner-207 kernel: [47116.609414] ? do_futex+0x162/0x1f0 Aug 22 18:29:02 juju-e4d256-prod-github-runner-207 kernel: [47116.610083] ? __x64_sys_futex+0x78/0x1e0 Aug 22 18:29:02 juju-e4d256-prod-github-runner-207 kernel: [47116.610759] ? __secure_computing+0xa9/0x120 Aug 22 18:29:02 juju-e4d256-prod-github-runner-207 kernel: [47116.611454] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 18:29:02 juju-e4d256-prod-github-runner-207 kernel: [47116.612230] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:29:02 juju-e4d256-prod-github-runner-207 kernel: [47116.613125] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:29:02 juju-e4d256-prod-github-runner-207 kernel: [47116.613860] ? do_syscall_64+0x69/0xc0 Aug 22 18:29:02 juju-e4d256-prod-github-runner-207 kernel: [47116.614509] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:29:02 juju-e4d256-prod-github-runner-207 kernel: [47116.615231] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:29:02 juju-e4d256-prod-github-runner-207 kernel: [47116.615928] ? do_syscall_64+0x69/0xc0 Aug 22 18:29:02 juju-e4d256-prod-github-runner-207 kernel: [47116.616559] ? do_syscall_64+0x69/0xc0 Aug 22 18:29:02 juju-e4d256-prod-github-runner-207 kernel: [47116.617182] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 18:29:02 juju-e4d256-prod-github-runner-207 kernel: [47116.617902] RIP: 0033:0x7faa5d0edaff Aug 22 18:29:02 juju-e4d256-prod-github-runner-207 kernel: [47116.618956] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 18:29:02 juju-e4d256-prod-github-runner-207 kernel: [47116.620965] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 18:29:02 juju-e4d256-prod-github-runner-207 kernel: [47116.621933] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 18:29:02 juju-e4d256-prod-github-runner-207 kernel: [47116.623000] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 18:29:02 juju-e4d256-prod-github-runner-207 kernel: [47116.624038] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 18:29:02 juju-e4d256-prod-github-runner-207 kernel: [47116.625078] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 18:29:02 juju-e4d256-prod-github-runner-207 kernel: [47116.626196] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 18:29:02 juju-e4d256-prod-github-runner-207 kernel: [47116.627234] Aug 22 18:29:30 juju-e4d256-prod-github-runner-207 kernel: [47144.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 43798s! [qemu-system-x86:6715] Aug 22 18:29:30 juju-e4d256-prod-github-runner-207 kernel: [47144.543878] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 18:29:30 juju-e4d256-prod-github-runner-207 kernel: [47144.544163] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 18:29:30 juju-e4d256-prod-github-runner-207 kernel: [47144.556892] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 18:29:30 juju-e4d256-prod-github-runner-207 kernel: [47144.558222] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 18:29:30 juju-e4d256-prod-github-runner-207 kernel: [47144.559660] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:29:30 juju-e4d256-prod-github-runner-207 kernel: [47144.560737] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 18:29:30 juju-e4d256-prod-github-runner-207 kernel: [47144.563365] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 18:29:30 juju-e4d256-prod-github-runner-207 kernel: [47144.564413] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 18:29:30 juju-e4d256-prod-github-runner-207 kernel: [47144.565605] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 18:29:30 juju-e4d256-prod-github-runner-207 kernel: [47144.566988] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 18:29:30 juju-e4d256-prod-github-runner-207 kernel: [47144.568157] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 18:29:30 juju-e4d256-prod-github-runner-207 kernel: [47144.569330] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 18:29:30 juju-e4d256-prod-github-runner-207 kernel: [47144.570582] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 18:29:30 juju-e4d256-prod-github-runner-207 kernel: [47144.571839] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 18:29:30 juju-e4d256-prod-github-runner-207 kernel: [47144.573024] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 18:29:30 juju-e4d256-prod-github-runner-207 kernel: [47144.574513] Call Trace: Aug 22 18:29:30 juju-e4d256-prod-github-runner-207 kernel: [47144.575747] Aug 22 18:29:30 juju-e4d256-prod-github-runner-207 kernel: [47144.576889] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:29:30 juju-e4d256-prod-github-runner-207 kernel: [47144.578074] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:29:30 juju-e4d256-prod-github-runner-207 kernel: [47144.579121] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:29:30 juju-e4d256-prod-github-runner-207 kernel: [47144.580261] ? show_regs.part.0+0x23/0x29 Aug 22 18:29:30 juju-e4d256-prod-github-runner-207 kernel: [47144.581258] ? show_regs.cold+0x8/0xd Aug 22 18:29:30 juju-e4d256-prod-github-runner-207 kernel: [47144.582245] ? watchdog_timer_fn+0x1be/0x220 Aug 22 18:29:30 juju-e4d256-prod-github-runner-207 kernel: [47144.583303] ? lockup_detector_update_enable+0x60/0x60 Aug 22 18:29:30 juju-e4d256-prod-github-runner-207 kernel: [47144.584398] ? __hrtimer_run_queues+0x107/0x230 Aug 22 18:29:30 juju-e4d256-prod-github-runner-207 kernel: [47144.585479] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 18:29:30 juju-e4d256-prod-github-runner-207 kernel: [47144.586505] ? hrtimer_interrupt+0x101/0x220 Aug 22 18:29:30 juju-e4d256-prod-github-runner-207 kernel: [47144.587542] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 18:29:30 juju-e4d256-prod-github-runner-207 kernel: [47144.588672] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 18:29:30 juju-e4d256-prod-github-runner-207 kernel: [47144.589765] Aug 22 18:29:30 juju-e4d256-prod-github-runner-207 kernel: [47144.590643] Aug 22 18:29:30 juju-e4d256-prod-github-runner-207 kernel: [47144.591482] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 18:29:30 juju-e4d256-prod-github-runner-207 kernel: [47144.592519] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:29:30 juju-e4d256-prod-github-runner-207 kernel: [47144.593586] ? _raw_spin_lock+0x22/0x30 Aug 22 18:29:30 juju-e4d256-prod-github-runner-207 kernel: [47144.594561] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:29:30 juju-e4d256-prod-github-runner-207 kernel: [47144.595584] direct_page_fault+0x206/0x310 [kvm] Aug 22 18:29:30 juju-e4d256-prod-github-runner-207 kernel: [47144.596679] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 18:29:30 juju-e4d256-prod-github-runner-207 kernel: [47144.597813] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 18:29:30 juju-e4d256-prod-github-runner-207 kernel: [47144.598857] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 18:29:30 juju-e4d256-prod-github-runner-207 kernel: [47144.599918] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 18:29:30 juju-e4d256-prod-github-runner-207 kernel: [47144.600870] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 18:29:30 juju-e4d256-prod-github-runner-207 kernel: [47144.601871] handle_exit+0x98/0x230 [kvm_amd] Aug 22 18:29:30 juju-e4d256-prod-github-runner-207 kernel: [47144.602776] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 18:29:30 juju-e4d256-prod-github-runner-207 kernel: [47144.603710] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 18:29:30 juju-e4d256-prod-github-runner-207 kernel: [47144.604640] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 18:29:30 juju-e4d256-prod-github-runner-207 kernel: [47144.605664] vcpu_run+0x62/0x2c0 [kvm] Aug 22 18:29:30 juju-e4d256-prod-github-runner-207 kernel: [47144.606481] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 18:29:30 juju-e4d256-prod-github-runner-207 kernel: [47144.607297] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 18:29:30 juju-e4d256-prod-github-runner-207 kernel: [47144.608503] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 18:29:30 juju-e4d256-prod-github-runner-207 kernel: [47144.609339] ? __seccomp_filter+0x4a/0x4a0 Aug 22 18:29:30 juju-e4d256-prod-github-runner-207 kernel: [47144.610104] ? __fget_files+0x86/0xc0 Aug 22 18:29:30 juju-e4d256-prod-github-runner-207 kernel: [47144.610819] __x64_sys_ioctl+0x95/0xd0 Aug 22 18:29:30 juju-e4d256-prod-github-runner-207 kernel: [47144.611532] do_syscall_64+0x5c/0xc0 Aug 22 18:29:30 juju-e4d256-prod-github-runner-207 kernel: [47144.612254] ? do_futex+0x162/0x1f0 Aug 22 18:29:30 juju-e4d256-prod-github-runner-207 kernel: [47144.612938] ? __x64_sys_futex+0x78/0x1e0 Aug 22 18:29:30 juju-e4d256-prod-github-runner-207 kernel: [47144.613659] ? __secure_computing+0xa9/0x120 Aug 22 18:29:30 juju-e4d256-prod-github-runner-207 kernel: [47144.614439] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 18:29:30 juju-e4d256-prod-github-runner-207 kernel: [47144.615224] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:29:30 juju-e4d256-prod-github-runner-207 kernel: [47144.615952] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:29:30 juju-e4d256-prod-github-runner-207 kernel: [47144.616675] ? do_syscall_64+0x69/0xc0 Aug 22 18:29:30 juju-e4d256-prod-github-runner-207 kernel: [47144.617324] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:29:30 juju-e4d256-prod-github-runner-207 kernel: [47144.618156] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:29:30 juju-e4d256-prod-github-runner-207 kernel: [47144.618857] ? do_syscall_64+0x69/0xc0 Aug 22 18:29:30 juju-e4d256-prod-github-runner-207 kernel: [47144.619481] ? do_syscall_64+0x69/0xc0 Aug 22 18:29:30 juju-e4d256-prod-github-runner-207 kernel: [47144.620104] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 18:29:30 juju-e4d256-prod-github-runner-207 kernel: [47144.620836] RIP: 0033:0x7faa5d0edaff Aug 22 18:29:30 juju-e4d256-prod-github-runner-207 kernel: [47144.621532] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 18:29:30 juju-e4d256-prod-github-runner-207 kernel: [47144.623551] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 18:29:30 juju-e4d256-prod-github-runner-207 kernel: [47144.624487] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 18:29:30 juju-e4d256-prod-github-runner-207 kernel: [47144.625383] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 18:29:30 juju-e4d256-prod-github-runner-207 kernel: [47144.626291] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 18:29:30 juju-e4d256-prod-github-runner-207 kernel: [47144.627186] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 18:29:30 juju-e4d256-prod-github-runner-207 kernel: [47144.628098] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 18:29:30 juju-e4d256-prod-github-runner-207 kernel: [47144.628994] Aug 22 18:29:46 juju-e4d256-prod-github-runner-207 kernel: [47160.332712] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 18:29:46 juju-e4d256-prod-github-runner-207 kernel: [47160.334451] rcu: 1-....: (11723851 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=5671902 Aug 22 18:29:46 juju-e4d256-prod-github-runner-207 kernel: [47160.335609] (t=11760783 jiffies g=23269 q=45797) Aug 22 18:29:46 juju-e4d256-prod-github-runner-207 kernel: [47160.336398] NMI backtrace for cpu 1 Aug 22 18:29:46 juju-e4d256-prod-github-runner-207 kernel: [47160.337109] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 18:29:46 juju-e4d256-prod-github-runner-207 kernel: [47160.338430] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 18:29:46 juju-e4d256-prod-github-runner-207 kernel: [47160.339647] Call Trace: Aug 22 18:29:46 juju-e4d256-prod-github-runner-207 kernel: [47160.340388] Aug 22 18:29:46 juju-e4d256-prod-github-runner-207 kernel: [47160.341098] show_stack+0x52/0x5c Aug 22 18:29:46 juju-e4d256-prod-github-runner-207 kernel: [47160.341913] dump_stack_lvl+0x4a/0x63 Aug 22 18:29:46 juju-e4d256-prod-github-runner-207 kernel: [47160.342734] dump_stack+0x10/0x16 Aug 22 18:29:46 juju-e4d256-prod-github-runner-207 kernel: [47160.343532] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 18:29:46 juju-e4d256-prod-github-runner-207 kernel: [47160.344404] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 18:29:46 juju-e4d256-prod-github-runner-207 kernel: [47160.345326] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 18:29:46 juju-e4d256-prod-github-runner-207 kernel: [47160.346266] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 18:29:46 juju-e4d256-prod-github-runner-207 kernel: [47160.347269] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 18:29:46 juju-e4d256-prod-github-runner-207 kernel: [47160.348196] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 18:29:46 juju-e4d256-prod-github-runner-207 kernel: [47160.349074] print_cpu_stall.cold+0x2f/0xe2 Aug 22 18:29:46 juju-e4d256-prod-github-runner-207 kernel: [47160.349941] ? timekeeping_update+0xf7/0x150 Aug 22 18:29:46 juju-e4d256-prod-github-runner-207 kernel: [47160.350792] check_cpu_stall+0x109/0x270 Aug 22 18:29:46 juju-e4d256-prod-github-runner-207 kernel: [47160.351617] rcu_sched_clock_irq+0x9a/0x250 Aug 22 18:29:46 juju-e4d256-prod-github-runner-207 kernel: [47160.352473] update_process_times+0x94/0xd0 Aug 22 18:29:46 juju-e4d256-prod-github-runner-207 kernel: [47160.353344] tick_sched_handle+0x29/0x70 Aug 22 18:29:46 juju-e4d256-prod-github-runner-207 kernel: [47160.354168] tick_sched_timer+0x8c/0xc0 Aug 22 18:29:46 juju-e4d256-prod-github-runner-207 kernel: [47160.354984] ? tick_nohz_handler+0xb0/0xb0 Aug 22 18:29:46 juju-e4d256-prod-github-runner-207 kernel: [47160.355825] __hrtimer_run_queues+0x107/0x230 Aug 22 18:29:46 juju-e4d256-prod-github-runner-207 kernel: [47160.356720] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 18:29:46 juju-e4d256-prod-github-runner-207 kernel: [47160.357643] hrtimer_interrupt+0x101/0x220 Aug 22 18:29:46 juju-e4d256-prod-github-runner-207 kernel: [47160.358499] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 18:29:46 juju-e4d256-prod-github-runner-207 kernel: [47160.359409] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 18:29:46 juju-e4d256-prod-github-runner-207 kernel: [47160.360299] Aug 22 18:29:46 juju-e4d256-prod-github-runner-207 kernel: [47160.360988] Aug 22 18:29:46 juju-e4d256-prod-github-runner-207 kernel: [47160.361683] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 18:29:46 juju-e4d256-prod-github-runner-207 kernel: [47160.362604] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:29:46 juju-e4d256-prod-github-runner-207 kernel: [47160.363597] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 18:29:46 juju-e4d256-prod-github-runner-207 kernel: [47160.366168] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 18:29:46 juju-e4d256-prod-github-runner-207 kernel: [47160.367144] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 18:29:46 juju-e4d256-prod-github-runner-207 kernel: [47160.368278] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 18:29:46 juju-e4d256-prod-github-runner-207 kernel: [47160.369415] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 18:29:46 juju-e4d256-prod-github-runner-207 kernel: [47160.370521] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 18:29:46 juju-e4d256-prod-github-runner-207 kernel: [47160.371635] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 18:29:46 juju-e4d256-prod-github-runner-207 kernel: [47160.372724] ? _raw_spin_lock+0x22/0x30 Aug 22 18:29:46 juju-e4d256-prod-github-runner-207 kernel: [47160.373599] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:29:46 juju-e4d256-prod-github-runner-207 kernel: [47160.374563] direct_page_fault+0x206/0x310 [kvm] Aug 22 18:29:46 juju-e4d256-prod-github-runner-207 kernel: [47160.375492] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 18:29:46 juju-e4d256-prod-github-runner-207 kernel: [47160.376412] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 18:29:46 juju-e4d256-prod-github-runner-207 kernel: [47160.377395] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 18:29:46 juju-e4d256-prod-github-runner-207 kernel: [47160.378335] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 18:29:46 juju-e4d256-prod-github-runner-207 kernel: [47160.379216] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 18:29:46 juju-e4d256-prod-github-runner-207 kernel: [47160.380144] handle_exit+0x98/0x230 [kvm_amd] Aug 22 18:29:46 juju-e4d256-prod-github-runner-207 kernel: [47160.380990] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 18:29:46 juju-e4d256-prod-github-runner-207 kernel: [47160.381885] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 18:29:46 juju-e4d256-prod-github-runner-207 kernel: [47160.382788] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 18:29:46 juju-e4d256-prod-github-runner-207 kernel: [47160.383674] vcpu_run+0x62/0x2c0 [kvm] Aug 22 18:29:46 juju-e4d256-prod-github-runner-207 kernel: [47160.384467] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 18:29:46 juju-e4d256-prod-github-runner-207 kernel: [47160.385315] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 18:29:46 juju-e4d256-prod-github-runner-207 kernel: [47160.386213] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 18:29:46 juju-e4d256-prod-github-runner-207 kernel: [47160.387064] ? __seccomp_filter+0x4a/0x4a0 Aug 22 18:29:46 juju-e4d256-prod-github-runner-207 kernel: [47160.387866] ? __fget_files+0x86/0xc0 Aug 22 18:29:46 juju-e4d256-prod-github-runner-207 kernel: [47160.388639] __x64_sys_ioctl+0x95/0xd0 Aug 22 18:29:46 juju-e4d256-prod-github-runner-207 kernel: [47160.389425] do_syscall_64+0x5c/0xc0 Aug 22 18:29:46 juju-e4d256-prod-github-runner-207 kernel: [47160.390186] ? do_futex+0x162/0x1f0 Aug 22 18:29:46 juju-e4d256-prod-github-runner-207 kernel: [47160.390929] ? __x64_sys_futex+0x78/0x1e0 Aug 22 18:29:46 juju-e4d256-prod-github-runner-207 kernel: [47160.391722] ? __secure_computing+0xa9/0x120 Aug 22 18:29:46 juju-e4d256-prod-github-runner-207 kernel: [47160.392530] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 18:29:46 juju-e4d256-prod-github-runner-207 kernel: [47160.393442] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:29:46 juju-e4d256-prod-github-runner-207 kernel: [47160.394288] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:29:46 juju-e4d256-prod-github-runner-207 kernel: [47160.395143] ? do_syscall_64+0x69/0xc0 Aug 22 18:29:46 juju-e4d256-prod-github-runner-207 kernel: [47160.395915] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:29:46 juju-e4d256-prod-github-runner-207 kernel: [47160.396762] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:29:46 juju-e4d256-prod-github-runner-207 kernel: [47160.397639] ? do_syscall_64+0x69/0xc0 Aug 22 18:29:46 juju-e4d256-prod-github-runner-207 kernel: [47160.398411] ? do_syscall_64+0x69/0xc0 Aug 22 18:29:46 juju-e4d256-prod-github-runner-207 kernel: [47160.399186] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 18:29:46 juju-e4d256-prod-github-runner-207 kernel: [47160.400057] RIP: 0033:0x7faa5d0edaff Aug 22 18:29:46 juju-e4d256-prod-github-runner-207 kernel: [47160.400859] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 18:29:46 juju-e4d256-prod-github-runner-207 kernel: [47160.403401] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 18:29:46 juju-e4d256-prod-github-runner-207 kernel: [47160.404562] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 18:29:46 juju-e4d256-prod-github-runner-207 kernel: [47160.405676] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 18:29:46 juju-e4d256-prod-github-runner-207 kernel: [47160.406800] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 18:29:46 juju-e4d256-prod-github-runner-207 kernel: [47160.407887] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 18:29:46 juju-e4d256-prod-github-runner-207 kernel: [47160.408956] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 18:29:46 juju-e4d256-prod-github-runner-207 kernel: [47160.410062] Aug 22 18:30:10 juju-e4d256-prod-github-runner-207 kernel: [47184.541981] watchdog: BUG: soft lockup - CPU#1 stuck for 43836s! [qemu-system-x86:6715] Aug 22 18:30:10 juju-e4d256-prod-github-runner-207 kernel: [47184.543883] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 18:30:10 juju-e4d256-prod-github-runner-207 kernel: [47184.544181] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 18:30:10 juju-e4d256-prod-github-runner-207 kernel: [47184.557034] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 18:30:10 juju-e4d256-prod-github-runner-207 kernel: [47184.558343] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 18:30:10 juju-e4d256-prod-github-runner-207 kernel: [47184.559585] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:30:10 juju-e4d256-prod-github-runner-207 kernel: [47184.560666] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 18:30:10 juju-e4d256-prod-github-runner-207 kernel: [47184.563342] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 18:30:10 juju-e4d256-prod-github-runner-207 kernel: [47184.564543] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 18:30:10 juju-e4d256-prod-github-runner-207 kernel: [47184.565752] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 18:30:10 juju-e4d256-prod-github-runner-207 kernel: [47184.567129] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 18:30:10 juju-e4d256-prod-github-runner-207 kernel: [47184.568520] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 18:30:10 juju-e4d256-prod-github-runner-207 kernel: [47184.569733] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 18:30:10 juju-e4d256-prod-github-runner-207 kernel: [47184.570918] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 18:30:10 juju-e4d256-prod-github-runner-207 kernel: [47184.572212] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 18:30:10 juju-e4d256-prod-github-runner-207 kernel: [47184.573372] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 18:30:10 juju-e4d256-prod-github-runner-207 kernel: [47184.574617] Call Trace: Aug 22 18:30:10 juju-e4d256-prod-github-runner-207 kernel: [47184.575608] Aug 22 18:30:10 juju-e4d256-prod-github-runner-207 kernel: [47184.576544] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:30:10 juju-e4d256-prod-github-runner-207 kernel: [47184.577638] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:30:10 juju-e4d256-prod-github-runner-207 kernel: [47184.578685] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:30:10 juju-e4d256-prod-github-runner-207 kernel: [47184.579840] ? show_regs.part.0+0x23/0x29 Aug 22 18:30:10 juju-e4d256-prod-github-runner-207 kernel: [47184.580864] ? show_regs.cold+0x8/0xd Aug 22 18:30:10 juju-e4d256-prod-github-runner-207 kernel: [47184.581889] ? watchdog_timer_fn+0x1be/0x220 Aug 22 18:30:10 juju-e4d256-prod-github-runner-207 kernel: [47184.582969] ? lockup_detector_update_enable+0x60/0x60 Aug 22 18:30:10 juju-e4d256-prod-github-runner-207 kernel: [47184.584082] ? __hrtimer_run_queues+0x107/0x230 Aug 22 18:30:10 juju-e4d256-prod-github-runner-207 kernel: [47184.585168] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 18:30:10 juju-e4d256-prod-github-runner-207 kernel: [47184.586214] ? hrtimer_interrupt+0x101/0x220 Aug 22 18:30:10 juju-e4d256-prod-github-runner-207 kernel: [47184.587269] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 18:30:10 juju-e4d256-prod-github-runner-207 kernel: [47184.588367] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 18:30:10 juju-e4d256-prod-github-runner-207 kernel: [47184.589470] Aug 22 18:30:10 juju-e4d256-prod-github-runner-207 kernel: [47184.590385] Aug 22 18:30:10 juju-e4d256-prod-github-runner-207 kernel: [47184.591247] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 18:30:10 juju-e4d256-prod-github-runner-207 kernel: [47184.592349] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:30:10 juju-e4d256-prod-github-runner-207 kernel: [47184.593455] ? _raw_spin_lock+0x22/0x30 Aug 22 18:30:10 juju-e4d256-prod-github-runner-207 kernel: [47184.594420] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:30:10 juju-e4d256-prod-github-runner-207 kernel: [47184.595458] direct_page_fault+0x206/0x310 [kvm] Aug 22 18:30:10 juju-e4d256-prod-github-runner-207 kernel: [47184.596508] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 18:30:10 juju-e4d256-prod-github-runner-207 kernel: [47184.597561] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 18:30:10 juju-e4d256-prod-github-runner-207 kernel: [47184.598580] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 18:30:10 juju-e4d256-prod-github-runner-207 kernel: [47184.599615] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 18:30:10 juju-e4d256-prod-github-runner-207 kernel: [47184.600644] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 18:30:10 juju-e4d256-prod-github-runner-207 kernel: [47184.601707] handle_exit+0x98/0x230 [kvm_amd] Aug 22 18:30:10 juju-e4d256-prod-github-runner-207 kernel: [47184.602636] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 18:30:10 juju-e4d256-prod-github-runner-207 kernel: [47184.603603] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 18:30:10 juju-e4d256-prod-github-runner-207 kernel: [47184.604554] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 18:30:10 juju-e4d256-prod-github-runner-207 kernel: [47184.605543] vcpu_run+0x62/0x2c0 [kvm] Aug 22 18:30:10 juju-e4d256-prod-github-runner-207 kernel: [47184.606392] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 18:30:10 juju-e4d256-prod-github-runner-207 kernel: [47184.607274] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 18:30:10 juju-e4d256-prod-github-runner-207 kernel: [47184.608185] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 18:30:10 juju-e4d256-prod-github-runner-207 kernel: [47184.609036] ? __seccomp_filter+0x4a/0x4a0 Aug 22 18:30:10 juju-e4d256-prod-github-runner-207 kernel: [47184.609809] ? __fget_files+0x86/0xc0 Aug 22 18:30:10 juju-e4d256-prod-github-runner-207 kernel: [47184.610557] __x64_sys_ioctl+0x95/0xd0 Aug 22 18:30:10 juju-e4d256-prod-github-runner-207 kernel: [47184.611263] do_syscall_64+0x5c/0xc0 Aug 22 18:30:10 juju-e4d256-prod-github-runner-207 kernel: [47184.611940] ? do_futex+0x162/0x1f0 Aug 22 18:30:10 juju-e4d256-prod-github-runner-207 kernel: [47184.612601] ? __x64_sys_futex+0x78/0x1e0 Aug 22 18:30:10 juju-e4d256-prod-github-runner-207 kernel: [47184.613345] ? __secure_computing+0xa9/0x120 Aug 22 18:30:10 juju-e4d256-prod-github-runner-207 kernel: [47184.614059] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 18:30:10 juju-e4d256-prod-github-runner-207 kernel: [47184.614837] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:30:10 juju-e4d256-prod-github-runner-207 kernel: [47184.615572] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:30:10 juju-e4d256-prod-github-runner-207 kernel: [47184.616305] ? do_syscall_64+0x69/0xc0 Aug 22 18:30:10 juju-e4d256-prod-github-runner-207 kernel: [47184.616995] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:30:10 juju-e4d256-prod-github-runner-207 kernel: [47184.617722] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:30:10 juju-e4d256-prod-github-runner-207 kernel: [47184.618433] ? do_syscall_64+0x69/0xc0 Aug 22 18:30:10 juju-e4d256-prod-github-runner-207 kernel: [47184.619069] ? do_syscall_64+0x69/0xc0 Aug 22 18:30:10 juju-e4d256-prod-github-runner-207 kernel: [47184.619704] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 18:30:10 juju-e4d256-prod-github-runner-207 kernel: [47184.620439] RIP: 0033:0x7faa5d0edaff Aug 22 18:30:10 juju-e4d256-prod-github-runner-207 kernel: [47184.621158] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 18:30:10 juju-e4d256-prod-github-runner-207 kernel: [47184.623213] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 18:30:10 juju-e4d256-prod-github-runner-207 kernel: [47184.624184] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 18:30:10 juju-e4d256-prod-github-runner-207 kernel: [47184.625111] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 18:30:10 juju-e4d256-prod-github-runner-207 kernel: [47184.626071] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 18:30:10 juju-e4d256-prod-github-runner-207 kernel: [47184.626979] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 18:30:10 juju-e4d256-prod-github-runner-207 kernel: [47184.627873] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 18:30:10 juju-e4d256-prod-github-runner-207 kernel: [47184.628774] Aug 22 18:30:38 juju-e4d256-prod-github-runner-207 kernel: [47212.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 43862s! [qemu-system-x86:6715] Aug 22 18:30:38 juju-e4d256-prod-github-runner-207 kernel: [47212.543113] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 18:30:38 juju-e4d256-prod-github-runner-207 kernel: [47212.543187] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 18:30:38 juju-e4d256-prod-github-runner-207 kernel: [47212.555655] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 18:30:38 juju-e4d256-prod-github-runner-207 kernel: [47212.556963] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 18:30:38 juju-e4d256-prod-github-runner-207 kernel: [47212.558241] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:30:38 juju-e4d256-prod-github-runner-207 kernel: [47212.559310] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 18:30:38 juju-e4d256-prod-github-runner-207 kernel: [47212.561921] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 18:30:38 juju-e4d256-prod-github-runner-207 kernel: [47212.563185] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 18:30:38 juju-e4d256-prod-github-runner-207 kernel: [47212.564403] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 18:30:38 juju-e4d256-prod-github-runner-207 kernel: [47212.565617] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 18:30:38 juju-e4d256-prod-github-runner-207 kernel: [47212.566804] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 18:30:38 juju-e4d256-prod-github-runner-207 kernel: [47212.567998] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 18:30:38 juju-e4d256-prod-github-runner-207 kernel: [47212.569195] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 18:30:38 juju-e4d256-prod-github-runner-207 kernel: [47212.570451] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 18:30:38 juju-e4d256-prod-github-runner-207 kernel: [47212.571558] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 18:30:38 juju-e4d256-prod-github-runner-207 kernel: [47212.572785] Call Trace: Aug 22 18:30:38 juju-e4d256-prod-github-runner-207 kernel: [47212.573705] Aug 22 18:30:38 juju-e4d256-prod-github-runner-207 kernel: [47212.574622] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:30:38 juju-e4d256-prod-github-runner-207 kernel: [47212.575662] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:30:38 juju-e4d256-prod-github-runner-207 kernel: [47212.576731] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:30:38 juju-e4d256-prod-github-runner-207 kernel: [47212.577818] ? show_regs.part.0+0x23/0x29 Aug 22 18:30:38 juju-e4d256-prod-github-runner-207 kernel: [47212.578828] ? show_regs.cold+0x8/0xd Aug 22 18:30:38 juju-e4d256-prod-github-runner-207 kernel: [47212.579976] ? watchdog_timer_fn+0x1be/0x220 Aug 22 18:30:38 juju-e4d256-prod-github-runner-207 kernel: [47212.581016] ? lockup_detector_update_enable+0x60/0x60 Aug 22 18:30:38 juju-e4d256-prod-github-runner-207 kernel: [47212.582097] ? __hrtimer_run_queues+0x107/0x230 Aug 22 18:30:38 juju-e4d256-prod-github-runner-207 kernel: [47212.583143] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 18:30:38 juju-e4d256-prod-github-runner-207 kernel: [47212.584176] ? hrtimer_interrupt+0x101/0x220 Aug 22 18:30:38 juju-e4d256-prod-github-runner-207 kernel: [47212.585241] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 18:30:38 juju-e4d256-prod-github-runner-207 kernel: [47212.586325] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 18:30:38 juju-e4d256-prod-github-runner-207 kernel: [47212.587382] Aug 22 18:30:38 juju-e4d256-prod-github-runner-207 kernel: [47212.588239] Aug 22 18:30:38 juju-e4d256-prod-github-runner-207 kernel: [47212.589111] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 18:30:38 juju-e4d256-prod-github-runner-207 kernel: [47212.590164] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:30:38 juju-e4d256-prod-github-runner-207 kernel: [47212.591400] ? _raw_spin_lock+0x22/0x30 Aug 22 18:30:38 juju-e4d256-prod-github-runner-207 kernel: [47212.592367] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:30:38 juju-e4d256-prod-github-runner-207 kernel: [47212.593430] direct_page_fault+0x206/0x310 [kvm] Aug 22 18:30:38 juju-e4d256-prod-github-runner-207 kernel: [47212.594471] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 18:30:38 juju-e4d256-prod-github-runner-207 kernel: [47212.595491] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 18:30:38 juju-e4d256-prod-github-runner-207 kernel: [47212.596518] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 18:30:38 juju-e4d256-prod-github-runner-207 kernel: [47212.597741] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 18:30:38 juju-e4d256-prod-github-runner-207 kernel: [47212.598726] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 18:30:38 juju-e4d256-prod-github-runner-207 kernel: [47212.599726] handle_exit+0x98/0x230 [kvm_amd] Aug 22 18:30:38 juju-e4d256-prod-github-runner-207 kernel: [47212.600653] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 18:30:38 juju-e4d256-prod-github-runner-207 kernel: [47212.601584] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 18:30:38 juju-e4d256-prod-github-runner-207 kernel: [47212.602521] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 18:30:38 juju-e4d256-prod-github-runner-207 kernel: [47212.603439] vcpu_run+0x62/0x2c0 [kvm] Aug 22 18:30:38 juju-e4d256-prod-github-runner-207 kernel: [47212.604266] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 18:30:38 juju-e4d256-prod-github-runner-207 kernel: [47212.605270] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 18:30:38 juju-e4d256-prod-github-runner-207 kernel: [47212.606139] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 18:30:38 juju-e4d256-prod-github-runner-207 kernel: [47212.606947] ? __seccomp_filter+0x4a/0x4a0 Aug 22 18:30:38 juju-e4d256-prod-github-runner-207 kernel: [47212.607711] ? __fget_files+0x86/0xc0 Aug 22 18:30:38 juju-e4d256-prod-github-runner-207 kernel: [47212.608431] __x64_sys_ioctl+0x95/0xd0 Aug 22 18:30:38 juju-e4d256-prod-github-runner-207 kernel: [47212.609247] do_syscall_64+0x5c/0xc0 Aug 22 18:30:38 juju-e4d256-prod-github-runner-207 kernel: [47212.609927] ? do_futex+0x162/0x1f0 Aug 22 18:30:38 juju-e4d256-prod-github-runner-207 kernel: [47212.610586] ? __x64_sys_futex+0x78/0x1e0 Aug 22 18:30:38 juju-e4d256-prod-github-runner-207 kernel: [47212.611271] ? __secure_computing+0xa9/0x120 Aug 22 18:30:38 juju-e4d256-prod-github-runner-207 kernel: [47212.611971] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 18:30:38 juju-e4d256-prod-github-runner-207 kernel: [47212.612763] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:30:38 juju-e4d256-prod-github-runner-207 kernel: [47212.613499] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:30:38 juju-e4d256-prod-github-runner-207 kernel: [47212.614230] ? do_syscall_64+0x69/0xc0 Aug 22 18:30:38 juju-e4d256-prod-github-runner-207 kernel: [47212.614883] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:30:38 juju-e4d256-prod-github-runner-207 kernel: [47212.615597] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:30:38 juju-e4d256-prod-github-runner-207 kernel: [47212.616306] ? do_syscall_64+0x69/0xc0 Aug 22 18:30:38 juju-e4d256-prod-github-runner-207 kernel: [47212.616954] ? do_syscall_64+0x69/0xc0 Aug 22 18:30:38 juju-e4d256-prod-github-runner-207 kernel: [47212.617586] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 18:30:38 juju-e4d256-prod-github-runner-207 kernel: [47212.618306] RIP: 0033:0x7faa5d0edaff Aug 22 18:30:38 juju-e4d256-prod-github-runner-207 kernel: [47212.618964] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 18:30:38 juju-e4d256-prod-github-runner-207 kernel: [47212.621011] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 18:30:38 juju-e4d256-prod-github-runner-207 kernel: [47212.621953] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 18:30:38 juju-e4d256-prod-github-runner-207 kernel: [47212.622868] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 18:30:38 juju-e4d256-prod-github-runner-207 kernel: [47212.623783] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 18:30:38 juju-e4d256-prod-github-runner-207 kernel: [47212.624893] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 18:30:38 juju-e4d256-prod-github-runner-207 kernel: [47212.625801] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 18:30:38 juju-e4d256-prod-github-runner-207 kernel: [47212.626724] Aug 22 18:31:06 juju-e4d256-prod-github-runner-207 kernel: [47240.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 43888s! [qemu-system-x86:6715] Aug 22 18:31:06 juju-e4d256-prod-github-runner-207 kernel: [47240.543876] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 18:31:06 juju-e4d256-prod-github-runner-207 kernel: [47240.544208] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 18:31:06 juju-e4d256-prod-github-runner-207 kernel: [47240.556530] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 18:31:06 juju-e4d256-prod-github-runner-207 kernel: [47240.557802] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 18:31:06 juju-e4d256-prod-github-runner-207 kernel: [47240.559023] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:31:06 juju-e4d256-prod-github-runner-207 kernel: [47240.560138] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 18:31:06 juju-e4d256-prod-github-runner-207 kernel: [47240.562870] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 18:31:06 juju-e4d256-prod-github-runner-207 kernel: [47240.564019] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 18:31:06 juju-e4d256-prod-github-runner-207 kernel: [47240.565300] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 18:31:06 juju-e4d256-prod-github-runner-207 kernel: [47240.566468] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 18:31:06 juju-e4d256-prod-github-runner-207 kernel: [47240.567626] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 18:31:06 juju-e4d256-prod-github-runner-207 kernel: [47240.568838] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 18:31:06 juju-e4d256-prod-github-runner-207 kernel: [47240.570008] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 18:31:06 juju-e4d256-prod-github-runner-207 kernel: [47240.571247] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 18:31:06 juju-e4d256-prod-github-runner-207 kernel: [47240.572374] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 18:31:06 juju-e4d256-prod-github-runner-207 kernel: [47240.573573] Call Trace: Aug 22 18:31:06 juju-e4d256-prod-github-runner-207 kernel: [47240.574496] Aug 22 18:31:06 juju-e4d256-prod-github-runner-207 kernel: [47240.575411] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:31:06 juju-e4d256-prod-github-runner-207 kernel: [47240.576470] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:31:06 juju-e4d256-prod-github-runner-207 kernel: [47240.577499] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:31:06 juju-e4d256-prod-github-runner-207 kernel: [47240.578601] ? show_regs.part.0+0x23/0x29 Aug 22 18:31:06 juju-e4d256-prod-github-runner-207 kernel: [47240.579617] ? show_regs.cold+0x8/0xd Aug 22 18:31:06 juju-e4d256-prod-github-runner-207 kernel: [47240.580611] ? watchdog_timer_fn+0x1be/0x220 Aug 22 18:31:06 juju-e4d256-prod-github-runner-207 kernel: [47240.581857] ? lockup_detector_update_enable+0x60/0x60 Aug 22 18:31:06 juju-e4d256-prod-github-runner-207 kernel: [47240.582992] ? __hrtimer_run_queues+0x107/0x230 Aug 22 18:31:06 juju-e4d256-prod-github-runner-207 kernel: [47240.584045] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 18:31:06 juju-e4d256-prod-github-runner-207 kernel: [47240.585098] ? hrtimer_interrupt+0x101/0x220 Aug 22 18:31:06 juju-e4d256-prod-github-runner-207 kernel: [47240.586118] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 18:31:06 juju-e4d256-prod-github-runner-207 kernel: [47240.587209] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 18:31:06 juju-e4d256-prod-github-runner-207 kernel: [47240.588273] Aug 22 18:31:06 juju-e4d256-prod-github-runner-207 kernel: [47240.589127] Aug 22 18:31:06 juju-e4d256-prod-github-runner-207 kernel: [47240.589988] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 18:31:06 juju-e4d256-prod-github-runner-207 kernel: [47240.591029] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:31:06 juju-e4d256-prod-github-runner-207 kernel: [47240.592274] ? _raw_spin_lock+0x22/0x30 Aug 22 18:31:06 juju-e4d256-prod-github-runner-207 kernel: [47240.593240] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:31:06 juju-e4d256-prod-github-runner-207 kernel: [47240.594294] direct_page_fault+0x206/0x310 [kvm] Aug 22 18:31:06 juju-e4d256-prod-github-runner-207 kernel: [47240.595337] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 18:31:06 juju-e4d256-prod-github-runner-207 kernel: [47240.596369] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 18:31:06 juju-e4d256-prod-github-runner-207 kernel: [47240.597379] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 18:31:06 juju-e4d256-prod-github-runner-207 kernel: [47240.598432] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 18:31:06 juju-e4d256-prod-github-runner-207 kernel: [47240.599387] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 18:31:06 juju-e4d256-prod-github-runner-207 kernel: [47240.600403] handle_exit+0x98/0x230 [kvm_amd] Aug 22 18:31:06 juju-e4d256-prod-github-runner-207 kernel: [47240.601299] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 18:31:06 juju-e4d256-prod-github-runner-207 kernel: [47240.602226] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 18:31:06 juju-e4d256-prod-github-runner-207 kernel: [47240.603158] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 18:31:06 juju-e4d256-prod-github-runner-207 kernel: [47240.604066] vcpu_run+0x62/0x2c0 [kvm] Aug 22 18:31:06 juju-e4d256-prod-github-runner-207 kernel: [47240.604965] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 18:31:06 juju-e4d256-prod-github-runner-207 kernel: [47240.605783] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 18:31:06 juju-e4d256-prod-github-runner-207 kernel: [47240.606637] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 18:31:06 juju-e4d256-prod-github-runner-207 kernel: [47240.607433] ? __seccomp_filter+0x4a/0x4a0 Aug 22 18:31:06 juju-e4d256-prod-github-runner-207 kernel: [47240.608204] ? __fget_files+0x86/0xc0 Aug 22 18:31:06 juju-e4d256-prod-github-runner-207 kernel: [47240.608911] __x64_sys_ioctl+0x95/0xd0 Aug 22 18:31:06 juju-e4d256-prod-github-runner-207 kernel: [47240.609642] do_syscall_64+0x5c/0xc0 Aug 22 18:31:06 juju-e4d256-prod-github-runner-207 kernel: [47240.610338] ? do_futex+0x162/0x1f0 Aug 22 18:31:06 juju-e4d256-prod-github-runner-207 kernel: [47240.611004] ? __x64_sys_futex+0x78/0x1e0 Aug 22 18:31:06 juju-e4d256-prod-github-runner-207 kernel: [47240.611701] ? __secure_computing+0xa9/0x120 Aug 22 18:31:06 juju-e4d256-prod-github-runner-207 kernel: [47240.612424] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 18:31:06 juju-e4d256-prod-github-runner-207 kernel: [47240.613239] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:31:06 juju-e4d256-prod-github-runner-207 kernel: [47240.614002] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:31:06 juju-e4d256-prod-github-runner-207 kernel: [47240.614764] ? do_syscall_64+0x69/0xc0 Aug 22 18:31:06 juju-e4d256-prod-github-runner-207 kernel: [47240.615463] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:31:06 juju-e4d256-prod-github-runner-207 kernel: [47240.616215] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:31:06 juju-e4d256-prod-github-runner-207 kernel: [47240.616929] ? do_syscall_64+0x69/0xc0 Aug 22 18:31:06 juju-e4d256-prod-github-runner-207 kernel: [47240.617567] ? do_syscall_64+0x69/0xc0 Aug 22 18:31:06 juju-e4d256-prod-github-runner-207 kernel: [47240.618213] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 18:31:06 juju-e4d256-prod-github-runner-207 kernel: [47240.618947] RIP: 0033:0x7faa5d0edaff Aug 22 18:31:06 juju-e4d256-prod-github-runner-207 kernel: [47240.619640] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 18:31:06 juju-e4d256-prod-github-runner-207 kernel: [47240.621837] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 18:31:06 juju-e4d256-prod-github-runner-207 kernel: [47240.622828] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 18:31:06 juju-e4d256-prod-github-runner-207 kernel: [47240.623744] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 18:31:06 juju-e4d256-prod-github-runner-207 kernel: [47240.624680] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 18:31:06 juju-e4d256-prod-github-runner-207 kernel: [47240.625610] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 18:31:06 juju-e4d256-prod-github-runner-207 kernel: [47240.626527] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 18:31:06 juju-e4d256-prod-github-runner-207 kernel: [47240.627439] Aug 22 18:31:34 juju-e4d256-prod-github-runner-207 kernel: [47268.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 43914s! [qemu-system-x86:6715] Aug 22 18:31:34 juju-e4d256-prod-github-runner-207 kernel: [47268.543948] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 18:31:34 juju-e4d256-prod-github-runner-207 kernel: [47268.544279] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 18:31:34 juju-e4d256-prod-github-runner-207 kernel: [47268.556877] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 18:31:34 juju-e4d256-prod-github-runner-207 kernel: [47268.558158] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 18:31:34 juju-e4d256-prod-github-runner-207 kernel: [47268.559394] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:31:34 juju-e4d256-prod-github-runner-207 kernel: [47268.560516] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 18:31:34 juju-e4d256-prod-github-runner-207 kernel: [47268.563100] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 18:31:34 juju-e4d256-prod-github-runner-207 kernel: [47268.564175] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 18:31:34 juju-e4d256-prod-github-runner-207 kernel: [47268.565356] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 18:31:34 juju-e4d256-prod-github-runner-207 kernel: [47268.566523] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 18:31:34 juju-e4d256-prod-github-runner-207 kernel: [47268.567688] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 18:31:34 juju-e4d256-prod-github-runner-207 kernel: [47268.568877] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 18:31:34 juju-e4d256-prod-github-runner-207 kernel: [47268.570045] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 18:31:34 juju-e4d256-prod-github-runner-207 kernel: [47268.571287] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 18:31:34 juju-e4d256-prod-github-runner-207 kernel: [47268.572403] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 18:31:34 juju-e4d256-prod-github-runner-207 kernel: [47268.573600] Call Trace: Aug 22 18:31:34 juju-e4d256-prod-github-runner-207 kernel: [47268.574513] Aug 22 18:31:34 juju-e4d256-prod-github-runner-207 kernel: [47268.575425] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:31:34 juju-e4d256-prod-github-runner-207 kernel: [47268.576517] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:31:34 juju-e4d256-prod-github-runner-207 kernel: [47268.577562] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:31:34 juju-e4d256-prod-github-runner-207 kernel: [47268.578680] ? show_regs.part.0+0x23/0x29 Aug 22 18:31:34 juju-e4d256-prod-github-runner-207 kernel: [47268.579680] ? show_regs.cold+0x8/0xd Aug 22 18:31:34 juju-e4d256-prod-github-runner-207 kernel: [47268.580687] ? watchdog_timer_fn+0x1be/0x220 Aug 22 18:31:34 juju-e4d256-prod-github-runner-207 kernel: [47268.581757] ? lockup_detector_update_enable+0x60/0x60 Aug 22 18:31:34 juju-e4d256-prod-github-runner-207 kernel: [47268.582860] ? __hrtimer_run_queues+0x107/0x230 Aug 22 18:31:34 juju-e4d256-prod-github-runner-207 kernel: [47268.583980] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 18:31:34 juju-e4d256-prod-github-runner-207 kernel: [47268.585016] ? hrtimer_interrupt+0x101/0x220 Aug 22 18:31:34 juju-e4d256-prod-github-runner-207 kernel: [47268.586034] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 18:31:34 juju-e4d256-prod-github-runner-207 kernel: [47268.587106] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 18:31:34 juju-e4d256-prod-github-runner-207 kernel: [47268.588196] Aug 22 18:31:34 juju-e4d256-prod-github-runner-207 kernel: [47268.589055] Aug 22 18:31:34 juju-e4d256-prod-github-runner-207 kernel: [47268.589916] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 18:31:34 juju-e4d256-prod-github-runner-207 kernel: [47268.591006] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:31:34 juju-e4d256-prod-github-runner-207 kernel: [47268.592092] ? _raw_spin_lock+0x22/0x30 Aug 22 18:31:34 juju-e4d256-prod-github-runner-207 kernel: [47268.593046] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:31:34 juju-e4d256-prod-github-runner-207 kernel: [47268.594071] direct_page_fault+0x206/0x310 [kvm] Aug 22 18:31:34 juju-e4d256-prod-github-runner-207 kernel: [47268.595097] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 18:31:34 juju-e4d256-prod-github-runner-207 kernel: [47268.596126] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 18:31:34 juju-e4d256-prod-github-runner-207 kernel: [47268.597138] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 18:31:34 juju-e4d256-prod-github-runner-207 kernel: [47268.598170] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 18:31:34 juju-e4d256-prod-github-runner-207 kernel: [47268.599136] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 18:31:34 juju-e4d256-prod-github-runner-207 kernel: [47268.600146] handle_exit+0x98/0x230 [kvm_amd] Aug 22 18:31:34 juju-e4d256-prod-github-runner-207 kernel: [47268.601052] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 18:31:34 juju-e4d256-prod-github-runner-207 kernel: [47268.601977] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 18:31:34 juju-e4d256-prod-github-runner-207 kernel: [47268.602905] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 18:31:34 juju-e4d256-prod-github-runner-207 kernel: [47268.603923] vcpu_run+0x62/0x2c0 [kvm] Aug 22 18:31:34 juju-e4d256-prod-github-runner-207 kernel: [47268.604766] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 18:31:34 juju-e4d256-prod-github-runner-207 kernel: [47268.605581] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 18:31:34 juju-e4d256-prod-github-runner-207 kernel: [47268.606442] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 18:31:34 juju-e4d256-prod-github-runner-207 kernel: [47268.607248] ? __seccomp_filter+0x4a/0x4a0 Aug 22 18:31:34 juju-e4d256-prod-github-runner-207 kernel: [47268.608015] ? __fget_files+0x86/0xc0 Aug 22 18:31:34 juju-e4d256-prod-github-runner-207 kernel: [47268.608721] __x64_sys_ioctl+0x95/0xd0 Aug 22 18:31:34 juju-e4d256-prod-github-runner-207 kernel: [47268.609420] do_syscall_64+0x5c/0xc0 Aug 22 18:31:34 juju-e4d256-prod-github-runner-207 kernel: [47268.610088] ? do_futex+0x162/0x1f0 Aug 22 18:31:34 juju-e4d256-prod-github-runner-207 kernel: [47268.610778] ? __x64_sys_futex+0x78/0x1e0 Aug 22 18:31:34 juju-e4d256-prod-github-runner-207 kernel: [47268.611464] ? __secure_computing+0xa9/0x120 Aug 22 18:31:34 juju-e4d256-prod-github-runner-207 kernel: [47268.612209] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 18:31:34 juju-e4d256-prod-github-runner-207 kernel: [47268.612978] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:31:34 juju-e4d256-prod-github-runner-207 kernel: [47268.613703] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:31:34 juju-e4d256-prod-github-runner-207 kernel: [47268.614423] ? do_syscall_64+0x69/0xc0 Aug 22 18:31:34 juju-e4d256-prod-github-runner-207 kernel: [47268.615076] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:31:34 juju-e4d256-prod-github-runner-207 kernel: [47268.615782] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:31:34 juju-e4d256-prod-github-runner-207 kernel: [47268.616509] ? do_syscall_64+0x69/0xc0 Aug 22 18:31:34 juju-e4d256-prod-github-runner-207 kernel: [47268.617139] ? do_syscall_64+0x69/0xc0 Aug 22 18:31:34 juju-e4d256-prod-github-runner-207 kernel: [47268.617762] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 18:31:34 juju-e4d256-prod-github-runner-207 kernel: [47268.618484] RIP: 0033:0x7faa5d0edaff Aug 22 18:31:34 juju-e4d256-prod-github-runner-207 kernel: [47268.619159] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 18:31:34 juju-e4d256-prod-github-runner-207 kernel: [47268.621205] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 18:31:34 juju-e4d256-prod-github-runner-207 kernel: [47268.622186] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 18:31:34 juju-e4d256-prod-github-runner-207 kernel: [47268.623076] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 18:31:34 juju-e4d256-prod-github-runner-207 kernel: [47268.624180] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 18:31:34 juju-e4d256-prod-github-runner-207 kernel: [47268.625076] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 18:31:34 juju-e4d256-prod-github-runner-207 kernel: [47268.625963] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 18:31:34 juju-e4d256-prod-github-runner-207 kernel: [47268.626858] Aug 22 18:32:02 juju-e4d256-prod-github-runner-207 kernel: [47296.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 43940s! [qemu-system-x86:6715] Aug 22 18:32:02 juju-e4d256-prod-github-runner-207 kernel: [47296.543859] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 18:32:02 juju-e4d256-prod-github-runner-207 kernel: [47296.544161] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 18:32:02 juju-e4d256-prod-github-runner-207 kernel: [47296.556451] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 18:32:02 juju-e4d256-prod-github-runner-207 kernel: [47296.557720] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 18:32:02 juju-e4d256-prod-github-runner-207 kernel: [47296.558935] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:32:02 juju-e4d256-prod-github-runner-207 kernel: [47296.559998] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 18:32:02 juju-e4d256-prod-github-runner-207 kernel: [47296.562559] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 18:32:02 juju-e4d256-prod-github-runner-207 kernel: [47296.563623] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 18:32:02 juju-e4d256-prod-github-runner-207 kernel: [47296.564794] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 18:32:02 juju-e4d256-prod-github-runner-207 kernel: [47296.565958] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 18:32:02 juju-e4d256-prod-github-runner-207 kernel: [47296.567114] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 18:32:02 juju-e4d256-prod-github-runner-207 kernel: [47296.568289] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 18:32:02 juju-e4d256-prod-github-runner-207 kernel: [47296.569452] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 18:32:02 juju-e4d256-prod-github-runner-207 kernel: [47296.570682] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 18:32:02 juju-e4d256-prod-github-runner-207 kernel: [47296.571789] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 18:32:02 juju-e4d256-prod-github-runner-207 kernel: [47296.572983] Call Trace: Aug 22 18:32:02 juju-e4d256-prod-github-runner-207 kernel: [47296.573892] Aug 22 18:32:02 juju-e4d256-prod-github-runner-207 kernel: [47296.574786] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:32:02 juju-e4d256-prod-github-runner-207 kernel: [47296.575824] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:32:02 juju-e4d256-prod-github-runner-207 kernel: [47296.576843] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:32:02 juju-e4d256-prod-github-runner-207 kernel: [47296.577930] ? show_regs.part.0+0x23/0x29 Aug 22 18:32:02 juju-e4d256-prod-github-runner-207 kernel: [47296.578924] ? show_regs.cold+0x8/0xd Aug 22 18:32:02 juju-e4d256-prod-github-runner-207 kernel: [47296.579902] ? watchdog_timer_fn+0x1be/0x220 Aug 22 18:32:02 juju-e4d256-prod-github-runner-207 kernel: [47296.580909] ? lockup_detector_update_enable+0x60/0x60 Aug 22 18:32:02 juju-e4d256-prod-github-runner-207 kernel: [47296.581974] ? __hrtimer_run_queues+0x107/0x230 Aug 22 18:32:02 juju-e4d256-prod-github-runner-207 kernel: [47296.583007] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 18:32:02 juju-e4d256-prod-github-runner-207 kernel: [47296.584041] ? hrtimer_interrupt+0x101/0x220 Aug 22 18:32:02 juju-e4d256-prod-github-runner-207 kernel: [47296.585055] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 18:32:02 juju-e4d256-prod-github-runner-207 kernel: [47296.586126] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 18:32:02 juju-e4d256-prod-github-runner-207 kernel: [47296.587169] Aug 22 18:32:02 juju-e4d256-prod-github-runner-207 kernel: [47296.588027] Aug 22 18:32:02 juju-e4d256-prod-github-runner-207 kernel: [47296.588868] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 18:32:02 juju-e4d256-prod-github-runner-207 kernel: [47296.589898] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:32:02 juju-e4d256-prod-github-runner-207 kernel: [47296.590932] ? _raw_spin_lock+0x22/0x30 Aug 22 18:32:02 juju-e4d256-prod-github-runner-207 kernel: [47296.591885] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:32:02 juju-e4d256-prod-github-runner-207 kernel: [47296.592900] direct_page_fault+0x206/0x310 [kvm] Aug 22 18:32:02 juju-e4d256-prod-github-runner-207 kernel: [47296.593921] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 18:32:02 juju-e4d256-prod-github-runner-207 kernel: [47296.594926] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 18:32:02 juju-e4d256-prod-github-runner-207 kernel: [47296.595941] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 18:32:02 juju-e4d256-prod-github-runner-207 kernel: [47296.596954] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 18:32:02 juju-e4d256-prod-github-runner-207 kernel: [47296.597897] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 18:32:02 juju-e4d256-prod-github-runner-207 kernel: [47296.598880] handle_exit+0x98/0x230 [kvm_amd] Aug 22 18:32:02 juju-e4d256-prod-github-runner-207 kernel: [47296.599784] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 18:32:02 juju-e4d256-prod-github-runner-207 kernel: [47296.600698] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 18:32:02 juju-e4d256-prod-github-runner-207 kernel: [47296.601625] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 18:32:02 juju-e4d256-prod-github-runner-207 kernel: [47296.602537] vcpu_run+0x62/0x2c0 [kvm] Aug 22 18:32:02 juju-e4d256-prod-github-runner-207 kernel: [47296.603346] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 18:32:02 juju-e4d256-prod-github-runner-207 kernel: [47296.604177] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 18:32:02 juju-e4d256-prod-github-runner-207 kernel: [47296.605045] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 18:32:02 juju-e4d256-prod-github-runner-207 kernel: [47296.605843] ? __seccomp_filter+0x4a/0x4a0 Aug 22 18:32:02 juju-e4d256-prod-github-runner-207 kernel: [47296.606607] ? __fget_files+0x86/0xc0 Aug 22 18:32:02 juju-e4d256-prod-github-runner-207 kernel: [47296.607317] __x64_sys_ioctl+0x95/0xd0 Aug 22 18:32:02 juju-e4d256-prod-github-runner-207 kernel: [47296.608023] do_syscall_64+0x5c/0xc0 Aug 22 18:32:02 juju-e4d256-prod-github-runner-207 kernel: [47296.608746] ? do_futex+0x162/0x1f0 Aug 22 18:32:02 juju-e4d256-prod-github-runner-207 kernel: [47296.609393] ? __x64_sys_futex+0x78/0x1e0 Aug 22 18:32:02 juju-e4d256-prod-github-runner-207 kernel: [47296.610063] ? __secure_computing+0xa9/0x120 Aug 22 18:32:02 juju-e4d256-prod-github-runner-207 kernel: [47296.610756] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 18:32:02 juju-e4d256-prod-github-runner-207 kernel: [47296.611527] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:32:02 juju-e4d256-prod-github-runner-207 kernel: [47296.612295] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:32:02 juju-e4d256-prod-github-runner-207 kernel: [47296.613014] ? do_syscall_64+0x69/0xc0 Aug 22 18:32:02 juju-e4d256-prod-github-runner-207 kernel: [47296.613664] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:32:02 juju-e4d256-prod-github-runner-207 kernel: [47296.614369] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:32:02 juju-e4d256-prod-github-runner-207 kernel: [47296.615063] ? do_syscall_64+0x69/0xc0 Aug 22 18:32:02 juju-e4d256-prod-github-runner-207 kernel: [47296.615696] ? do_syscall_64+0x69/0xc0 Aug 22 18:32:02 juju-e4d256-prod-github-runner-207 kernel: [47296.616318] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 18:32:02 juju-e4d256-prod-github-runner-207 kernel: [47296.617024] RIP: 0033:0x7faa5d0edaff Aug 22 18:32:02 juju-e4d256-prod-github-runner-207 kernel: [47296.617683] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 18:32:02 juju-e4d256-prod-github-runner-207 kernel: [47296.619678] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 18:32:02 juju-e4d256-prod-github-runner-207 kernel: [47296.620588] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 18:32:02 juju-e4d256-prod-github-runner-207 kernel: [47296.621477] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 18:32:02 juju-e4d256-prod-github-runner-207 kernel: [47296.622369] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 18:32:02 juju-e4d256-prod-github-runner-207 kernel: [47296.623256] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 18:32:02 juju-e4d256-prod-github-runner-207 kernel: [47296.624160] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 18:32:02 juju-e4d256-prod-github-runner-207 kernel: [47296.625054] Aug 22 18:32:30 juju-e4d256-prod-github-runner-207 kernel: [47324.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 43966s! [qemu-system-x86:6715] Aug 22 18:32:30 juju-e4d256-prod-github-runner-207 kernel: [47324.543866] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 18:32:30 juju-e4d256-prod-github-runner-207 kernel: [47324.544166] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 18:32:30 juju-e4d256-prod-github-runner-207 kernel: [47324.556905] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 18:32:30 juju-e4d256-prod-github-runner-207 kernel: [47324.558222] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 18:32:30 juju-e4d256-prod-github-runner-207 kernel: [47324.559486] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:32:30 juju-e4d256-prod-github-runner-207 kernel: [47324.560574] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 18:32:30 juju-e4d256-prod-github-runner-207 kernel: [47324.563245] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 18:32:30 juju-e4d256-prod-github-runner-207 kernel: [47324.564317] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 18:32:30 juju-e4d256-prod-github-runner-207 kernel: [47324.565495] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 18:32:30 juju-e4d256-prod-github-runner-207 kernel: [47324.566726] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 18:32:30 juju-e4d256-prod-github-runner-207 kernel: [47324.567934] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 18:32:30 juju-e4d256-prod-github-runner-207 kernel: [47324.569115] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 18:32:30 juju-e4d256-prod-github-runner-207 kernel: [47324.570321] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 18:32:30 juju-e4d256-prod-github-runner-207 kernel: [47324.571612] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 18:32:30 juju-e4d256-prod-github-runner-207 kernel: [47324.572743] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 18:32:30 juju-e4d256-prod-github-runner-207 kernel: [47324.573988] Call Trace: Aug 22 18:32:30 juju-e4d256-prod-github-runner-207 kernel: [47324.574918] Aug 22 18:32:30 juju-e4d256-prod-github-runner-207 kernel: [47324.575884] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:32:30 juju-e4d256-prod-github-runner-207 kernel: [47324.576973] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:32:30 juju-e4d256-prod-github-runner-207 kernel: [47324.578032] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:32:30 juju-e4d256-prod-github-runner-207 kernel: [47324.579160] ? show_regs.part.0+0x23/0x29 Aug 22 18:32:30 juju-e4d256-prod-github-runner-207 kernel: [47324.580221] ? show_regs.cold+0x8/0xd Aug 22 18:32:30 juju-e4d256-prod-github-runner-207 kernel: [47324.581212] ? watchdog_timer_fn+0x1be/0x220 Aug 22 18:32:30 juju-e4d256-prod-github-runner-207 kernel: [47324.582233] ? lockup_detector_update_enable+0x60/0x60 Aug 22 18:32:30 juju-e4d256-prod-github-runner-207 kernel: [47324.584224] ? __hrtimer_run_queues+0x107/0x230 Aug 22 18:32:30 juju-e4d256-prod-github-runner-207 kernel: [47324.585290] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 18:32:30 juju-e4d256-prod-github-runner-207 kernel: [47324.586355] ? hrtimer_interrupt+0x101/0x220 Aug 22 18:32:30 juju-e4d256-prod-github-runner-207 kernel: [47324.587394] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 18:32:30 juju-e4d256-prod-github-runner-207 kernel: [47324.588469] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 18:32:30 juju-e4d256-prod-github-runner-207 kernel: [47324.589530] Aug 22 18:32:30 juju-e4d256-prod-github-runner-207 kernel: [47324.590394] Aug 22 18:32:30 juju-e4d256-prod-github-runner-207 kernel: [47324.591288] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 18:32:30 juju-e4d256-prod-github-runner-207 kernel: [47324.592408] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:32:30 juju-e4d256-prod-github-runner-207 kernel: [47324.593463] ? _raw_spin_lock+0x22/0x30 Aug 22 18:32:30 juju-e4d256-prod-github-runner-207 kernel: [47324.594478] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:32:30 juju-e4d256-prod-github-runner-207 kernel: [47324.595538] direct_page_fault+0x206/0x310 [kvm] Aug 22 18:32:30 juju-e4d256-prod-github-runner-207 kernel: [47324.596669] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 18:32:30 juju-e4d256-prod-github-runner-207 kernel: [47324.597697] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 18:32:30 juju-e4d256-prod-github-runner-207 kernel: [47324.598750] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 18:32:30 juju-e4d256-prod-github-runner-207 kernel: [47324.599818] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 18:32:30 juju-e4d256-prod-github-runner-207 kernel: [47324.600767] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 18:32:30 juju-e4d256-prod-github-runner-207 kernel: [47324.601807] handle_exit+0x98/0x230 [kvm_amd] Aug 22 18:32:30 juju-e4d256-prod-github-runner-207 kernel: [47324.602713] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 18:32:30 juju-e4d256-prod-github-runner-207 kernel: [47324.603651] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 18:32:30 juju-e4d256-prod-github-runner-207 kernel: [47324.604595] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 18:32:30 juju-e4d256-prod-github-runner-207 kernel: [47324.605547] vcpu_run+0x62/0x2c0 [kvm] Aug 22 18:32:30 juju-e4d256-prod-github-runner-207 kernel: [47324.606386] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 18:32:30 juju-e4d256-prod-github-runner-207 kernel: [47324.607252] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 18:32:30 juju-e4d256-prod-github-runner-207 kernel: [47324.608130] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 18:32:30 juju-e4d256-prod-github-runner-207 kernel: [47324.608947] ? __seccomp_filter+0x4a/0x4a0 Aug 22 18:32:30 juju-e4d256-prod-github-runner-207 kernel: [47324.609708] ? __fget_files+0x86/0xc0 Aug 22 18:32:30 juju-e4d256-prod-github-runner-207 kernel: [47324.610429] __x64_sys_ioctl+0x95/0xd0 Aug 22 18:32:30 juju-e4d256-prod-github-runner-207 kernel: [47324.611156] do_syscall_64+0x5c/0xc0 Aug 22 18:32:30 juju-e4d256-prod-github-runner-207 kernel: [47324.612069] ? do_futex+0x162/0x1f0 Aug 22 18:32:30 juju-e4d256-prod-github-runner-207 kernel: [47324.612741] ? __x64_sys_futex+0x78/0x1e0 Aug 22 18:32:30 juju-e4d256-prod-github-runner-207 kernel: [47324.613429] ? __secure_computing+0xa9/0x120 Aug 22 18:32:30 juju-e4d256-prod-github-runner-207 kernel: [47324.614132] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 18:32:30 juju-e4d256-prod-github-runner-207 kernel: [47324.614911] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:32:30 juju-e4d256-prod-github-runner-207 kernel: [47324.615679] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:32:30 juju-e4d256-prod-github-runner-207 kernel: [47324.616419] ? do_syscall_64+0x69/0xc0 Aug 22 18:32:30 juju-e4d256-prod-github-runner-207 kernel: [47324.617081] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:32:30 juju-e4d256-prod-github-runner-207 kernel: [47324.617811] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:32:30 juju-e4d256-prod-github-runner-207 kernel: [47324.618525] ? do_syscall_64+0x69/0xc0 Aug 22 18:32:30 juju-e4d256-prod-github-runner-207 kernel: [47324.619184] ? do_syscall_64+0x69/0xc0 Aug 22 18:32:30 juju-e4d256-prod-github-runner-207 kernel: [47324.619837] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 18:32:30 juju-e4d256-prod-github-runner-207 kernel: [47324.620569] RIP: 0033:0x7faa5d0edaff Aug 22 18:32:30 juju-e4d256-prod-github-runner-207 kernel: [47324.621253] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 18:32:30 juju-e4d256-prod-github-runner-207 kernel: [47324.623328] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 18:32:30 juju-e4d256-prod-github-runner-207 kernel: [47324.624271] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 18:32:30 juju-e4d256-prod-github-runner-207 kernel: [47324.625193] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 18:32:30 juju-e4d256-prod-github-runner-207 kernel: [47324.626120] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 18:32:30 juju-e4d256-prod-github-runner-207 kernel: [47324.627039] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 18:32:30 juju-e4d256-prod-github-runner-207 kernel: [47324.627991] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 18:32:30 juju-e4d256-prod-github-runner-207 kernel: [47324.628927] Aug 22 18:32:46 juju-e4d256-prod-github-runner-207 kernel: [47340.344714] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 18:32:46 juju-e4d256-prod-github-runner-207 kernel: [47340.345702] rcu: 1-....: (11768702 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=5693181 Aug 22 18:32:46 juju-e4d256-prod-github-runner-207 kernel: [47340.346822] (t=11805786 jiffies g=23269 q=45889) Aug 22 18:32:46 juju-e4d256-prod-github-runner-207 kernel: [47340.347625] NMI backtrace for cpu 1 Aug 22 18:32:46 juju-e4d256-prod-github-runner-207 kernel: [47340.348335] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 18:32:46 juju-e4d256-prod-github-runner-207 kernel: [47340.349443] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 18:32:46 juju-e4d256-prod-github-runner-207 kernel: [47340.350508] Call Trace: Aug 22 18:32:46 juju-e4d256-prod-github-runner-207 kernel: [47340.351195] Aug 22 18:32:46 juju-e4d256-prod-github-runner-207 kernel: [47340.351847] show_stack+0x52/0x5c Aug 22 18:32:46 juju-e4d256-prod-github-runner-207 kernel: [47340.352576] dump_stack_lvl+0x4a/0x63 Aug 22 18:32:46 juju-e4d256-prod-github-runner-207 kernel: [47340.353327] dump_stack+0x10/0x16 Aug 22 18:32:46 juju-e4d256-prod-github-runner-207 kernel: [47340.354113] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 18:32:46 juju-e4d256-prod-github-runner-207 kernel: [47340.354962] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 18:32:46 juju-e4d256-prod-github-runner-207 kernel: [47340.355743] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 18:32:46 juju-e4d256-prod-github-runner-207 kernel: [47340.356567] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 18:32:46 juju-e4d256-prod-github-runner-207 kernel: [47340.357388] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 18:32:46 juju-e4d256-prod-github-runner-207 kernel: [47340.358257] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 18:32:46 juju-e4d256-prod-github-runner-207 kernel: [47340.359068] print_cpu_stall.cold+0x2f/0xe2 Aug 22 18:32:46 juju-e4d256-prod-github-runner-207 kernel: [47340.359837] ? timekeeping_update+0xf7/0x150 Aug 22 18:32:46 juju-e4d256-prod-github-runner-207 kernel: [47340.360624] check_cpu_stall+0x109/0x270 Aug 22 18:32:46 juju-e4d256-prod-github-runner-207 kernel: [47340.361373] rcu_sched_clock_irq+0x9a/0x250 Aug 22 18:32:46 juju-e4d256-prod-github-runner-207 kernel: [47340.362133] update_process_times+0x94/0xd0 Aug 22 18:32:46 juju-e4d256-prod-github-runner-207 kernel: [47340.362891] tick_sched_handle+0x29/0x70 Aug 22 18:32:46 juju-e4d256-prod-github-runner-207 kernel: [47340.363659] tick_sched_timer+0x8c/0xc0 Aug 22 18:32:46 juju-e4d256-prod-github-runner-207 kernel: [47340.364442] ? tick_nohz_handler+0xb0/0xb0 Aug 22 18:32:46 juju-e4d256-prod-github-runner-207 kernel: [47340.365194] __hrtimer_run_queues+0x107/0x230 Aug 22 18:32:46 juju-e4d256-prod-github-runner-207 kernel: [47340.365964] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 18:32:46 juju-e4d256-prod-github-runner-207 kernel: [47340.366784] hrtimer_interrupt+0x101/0x220 Aug 22 18:32:46 juju-e4d256-prod-github-runner-207 kernel: [47340.367642] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 18:32:46 juju-e4d256-prod-github-runner-207 kernel: [47340.368558] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 18:32:46 juju-e4d256-prod-github-runner-207 kernel: [47340.369374] Aug 22 18:32:46 juju-e4d256-prod-github-runner-207 kernel: [47340.370010] Aug 22 18:32:46 juju-e4d256-prod-github-runner-207 kernel: [47340.370641] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 18:32:46 juju-e4d256-prod-github-runner-207 kernel: [47340.371508] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:32:46 juju-e4d256-prod-github-runner-207 kernel: [47340.372450] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 18:32:46 juju-e4d256-prod-github-runner-207 kernel: [47340.374693] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 18:32:46 juju-e4d256-prod-github-runner-207 kernel: [47340.375587] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 18:32:46 juju-e4d256-prod-github-runner-207 kernel: [47340.376580] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 18:32:46 juju-e4d256-prod-github-runner-207 kernel: [47340.377555] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 18:32:46 juju-e4d256-prod-github-runner-207 kernel: [47340.378518] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 18:32:46 juju-e4d256-prod-github-runner-207 kernel: [47340.379478] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 18:32:46 juju-e4d256-prod-github-runner-207 kernel: [47340.380438] ? _raw_spin_lock+0x22/0x30 Aug 22 18:32:46 juju-e4d256-prod-github-runner-207 kernel: [47340.381325] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:32:46 juju-e4d256-prod-github-runner-207 kernel: [47340.382200] direct_page_fault+0x206/0x310 [kvm] Aug 22 18:32:46 juju-e4d256-prod-github-runner-207 kernel: [47340.383283] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 18:32:46 juju-e4d256-prod-github-runner-207 kernel: [47340.384253] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 18:32:46 juju-e4d256-prod-github-runner-207 kernel: [47340.385081] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 18:32:46 juju-e4d256-prod-github-runner-207 kernel: [47340.385886] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 18:32:46 juju-e4d256-prod-github-runner-207 kernel: [47340.386670] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 18:32:46 juju-e4d256-prod-github-runner-207 kernel: [47340.387510] handle_exit+0x98/0x230 [kvm_amd] Aug 22 18:32:46 juju-e4d256-prod-github-runner-207 kernel: [47340.388263] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 18:32:46 juju-e4d256-prod-github-runner-207 kernel: [47340.389047] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 18:32:46 juju-e4d256-prod-github-runner-207 kernel: [47340.389852] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 18:32:46 juju-e4d256-prod-github-runner-207 kernel: [47340.390636] vcpu_run+0x62/0x2c0 [kvm] Aug 22 18:32:46 juju-e4d256-prod-github-runner-207 kernel: [47340.391365] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 18:32:46 juju-e4d256-prod-github-runner-207 kernel: [47340.392098] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 18:32:46 juju-e4d256-prod-github-runner-207 kernel: [47340.392898] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 18:32:46 juju-e4d256-prod-github-runner-207 kernel: [47340.393658] ? __seccomp_filter+0x4a/0x4a0 Aug 22 18:32:46 juju-e4d256-prod-github-runner-207 kernel: [47340.394385] ? __fget_files+0x86/0xc0 Aug 22 18:32:46 juju-e4d256-prod-github-runner-207 kernel: [47340.395091] __x64_sys_ioctl+0x95/0xd0 Aug 22 18:32:46 juju-e4d256-prod-github-runner-207 kernel: [47340.395784] do_syscall_64+0x5c/0xc0 Aug 22 18:32:46 juju-e4d256-prod-github-runner-207 kernel: [47340.396463] ? do_futex+0x162/0x1f0 Aug 22 18:32:46 juju-e4d256-prod-github-runner-207 kernel: [47340.397139] ? __x64_sys_futex+0x78/0x1e0 Aug 22 18:32:46 juju-e4d256-prod-github-runner-207 kernel: [47340.397842] ? __secure_computing+0xa9/0x120 Aug 22 18:32:46 juju-e4d256-prod-github-runner-207 kernel: [47340.398557] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 18:32:46 juju-e4d256-prod-github-runner-207 kernel: [47340.399387] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:32:46 juju-e4d256-prod-github-runner-207 kernel: [47340.400250] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:32:46 juju-e4d256-prod-github-runner-207 kernel: [47340.401082] ? do_syscall_64+0x69/0xc0 Aug 22 18:32:46 juju-e4d256-prod-github-runner-207 kernel: [47340.401777] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:32:46 juju-e4d256-prod-github-runner-207 kernel: [47340.402535] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:32:46 juju-e4d256-prod-github-runner-207 kernel: [47340.403314] ? do_syscall_64+0x69/0xc0 Aug 22 18:32:46 juju-e4d256-prod-github-runner-207 kernel: [47340.404015] ? do_syscall_64+0x69/0xc0 Aug 22 18:32:46 juju-e4d256-prod-github-runner-207 kernel: [47340.404705] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 18:32:46 juju-e4d256-prod-github-runner-207 kernel: [47340.405478] RIP: 0033:0x7faa5d0edaff Aug 22 18:32:46 juju-e4d256-prod-github-runner-207 kernel: [47340.406167] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 18:32:46 juju-e4d256-prod-github-runner-207 kernel: [47340.408362] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 18:32:46 juju-e4d256-prod-github-runner-207 kernel: [47340.409400] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 18:32:46 juju-e4d256-prod-github-runner-207 kernel: [47340.410348] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 18:32:46 juju-e4d256-prod-github-runner-207 kernel: [47340.411311] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 18:32:46 juju-e4d256-prod-github-runner-207 kernel: [47340.412302] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 18:32:46 juju-e4d256-prod-github-runner-207 kernel: [47340.413238] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 18:32:46 juju-e4d256-prod-github-runner-207 kernel: [47340.414154] Aug 22 18:33:10 juju-e4d256-prod-github-runner-207 kernel: [47364.541982] watchdog: BUG: soft lockup - CPU#1 stuck for 44003s! [qemu-system-x86:6715] Aug 22 18:33:10 juju-e4d256-prod-github-runner-207 kernel: [47364.543863] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 18:33:10 juju-e4d256-prod-github-runner-207 kernel: [47364.544213] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 18:33:10 juju-e4d256-prod-github-runner-207 kernel: [47364.556690] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 18:33:10 juju-e4d256-prod-github-runner-207 kernel: [47364.557982] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 18:33:10 juju-e4d256-prod-github-runner-207 kernel: [47364.559291] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:33:10 juju-e4d256-prod-github-runner-207 kernel: [47364.560377] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 18:33:10 juju-e4d256-prod-github-runner-207 kernel: [47364.563021] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 18:33:10 juju-e4d256-prod-github-runner-207 kernel: [47364.564103] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 18:33:10 juju-e4d256-prod-github-runner-207 kernel: [47364.565293] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 18:33:10 juju-e4d256-prod-github-runner-207 kernel: [47364.566472] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 18:33:10 juju-e4d256-prod-github-runner-207 kernel: [47364.567685] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 18:33:10 juju-e4d256-prod-github-runner-207 kernel: [47364.568860] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 18:33:10 juju-e4d256-prod-github-runner-207 kernel: [47364.570042] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 18:33:10 juju-e4d256-prod-github-runner-207 kernel: [47364.571316] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 18:33:10 juju-e4d256-prod-github-runner-207 kernel: [47364.572472] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 18:33:10 juju-e4d256-prod-github-runner-207 kernel: [47364.573682] Call Trace: Aug 22 18:33:10 juju-e4d256-prod-github-runner-207 kernel: [47364.574620] Aug 22 18:33:10 juju-e4d256-prod-github-runner-207 kernel: [47364.575508] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:33:10 juju-e4d256-prod-github-runner-207 kernel: [47364.576565] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:33:10 juju-e4d256-prod-github-runner-207 kernel: [47364.577606] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:33:10 juju-e4d256-prod-github-runner-207 kernel: [47364.578827] ? show_regs.part.0+0x23/0x29 Aug 22 18:33:10 juju-e4d256-prod-github-runner-207 kernel: [47364.579852] ? show_regs.cold+0x8/0xd Aug 22 18:33:10 juju-e4d256-prod-github-runner-207 kernel: [47364.580855] ? watchdog_timer_fn+0x1be/0x220 Aug 22 18:33:10 juju-e4d256-prod-github-runner-207 kernel: [47364.581881] ? lockup_detector_update_enable+0x60/0x60 Aug 22 18:33:10 juju-e4d256-prod-github-runner-207 kernel: [47364.582980] ? __hrtimer_run_queues+0x107/0x230 Aug 22 18:33:10 juju-e4d256-prod-github-runner-207 kernel: [47364.584022] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 18:33:10 juju-e4d256-prod-github-runner-207 kernel: [47364.585058] ? hrtimer_interrupt+0x101/0x220 Aug 22 18:33:10 juju-e4d256-prod-github-runner-207 kernel: [47364.586074] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 18:33:10 juju-e4d256-prod-github-runner-207 kernel: [47364.587178] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 18:33:10 juju-e4d256-prod-github-runner-207 kernel: [47364.588246] Aug 22 18:33:10 juju-e4d256-prod-github-runner-207 kernel: [47364.589099] Aug 22 18:33:10 juju-e4d256-prod-github-runner-207 kernel: [47364.589937] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 18:33:10 juju-e4d256-prod-github-runner-207 kernel: [47364.590989] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:33:10 juju-e4d256-prod-github-runner-207 kernel: [47364.592033] ? _raw_spin_lock+0x22/0x30 Aug 22 18:33:10 juju-e4d256-prod-github-runner-207 kernel: [47364.592994] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:33:10 juju-e4d256-prod-github-runner-207 kernel: [47364.594018] direct_page_fault+0x206/0x310 [kvm] Aug 22 18:33:10 juju-e4d256-prod-github-runner-207 kernel: [47364.595053] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 18:33:10 juju-e4d256-prod-github-runner-207 kernel: [47364.596067] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 18:33:10 juju-e4d256-prod-github-runner-207 kernel: [47364.597068] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 18:33:10 juju-e4d256-prod-github-runner-207 kernel: [47364.598094] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 18:33:10 juju-e4d256-prod-github-runner-207 kernel: [47364.599063] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 18:33:10 juju-e4d256-prod-github-runner-207 kernel: [47364.600045] handle_exit+0x98/0x230 [kvm_amd] Aug 22 18:33:10 juju-e4d256-prod-github-runner-207 kernel: [47364.600939] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 18:33:10 juju-e4d256-prod-github-runner-207 kernel: [47364.601854] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 18:33:10 juju-e4d256-prod-github-runner-207 kernel: [47364.602799] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 18:33:10 juju-e4d256-prod-github-runner-207 kernel: [47364.603706] vcpu_run+0x62/0x2c0 [kvm] Aug 22 18:33:10 juju-e4d256-prod-github-runner-207 kernel: [47364.604516] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 18:33:10 juju-e4d256-prod-github-runner-207 kernel: [47364.605325] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 18:33:10 juju-e4d256-prod-github-runner-207 kernel: [47364.606176] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 18:33:10 juju-e4d256-prod-github-runner-207 kernel: [47364.606983] ? __seccomp_filter+0x4a/0x4a0 Aug 22 18:33:10 juju-e4d256-prod-github-runner-207 kernel: [47364.607736] ? __fget_files+0x86/0xc0 Aug 22 18:33:10 juju-e4d256-prod-github-runner-207 kernel: [47364.608444] __x64_sys_ioctl+0x95/0xd0 Aug 22 18:33:10 juju-e4d256-prod-github-runner-207 kernel: [47364.609143] do_syscall_64+0x5c/0xc0 Aug 22 18:33:10 juju-e4d256-prod-github-runner-207 kernel: [47364.609810] ? do_futex+0x162/0x1f0 Aug 22 18:33:10 juju-e4d256-prod-github-runner-207 kernel: [47364.610459] ? __x64_sys_futex+0x78/0x1e0 Aug 22 18:33:10 juju-e4d256-prod-github-runner-207 kernel: [47364.611145] ? __secure_computing+0xa9/0x120 Aug 22 18:33:10 juju-e4d256-prod-github-runner-207 kernel: [47364.611835] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 18:33:10 juju-e4d256-prod-github-runner-207 kernel: [47364.612596] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:33:10 juju-e4d256-prod-github-runner-207 kernel: [47364.613330] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:33:10 juju-e4d256-prod-github-runner-207 kernel: [47364.614048] ? do_syscall_64+0x69/0xc0 Aug 22 18:33:10 juju-e4d256-prod-github-runner-207 kernel: [47364.614702] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:33:10 juju-e4d256-prod-github-runner-207 kernel: [47364.615407] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:33:10 juju-e4d256-prod-github-runner-207 kernel: [47364.616100] ? do_syscall_64+0x69/0xc0 Aug 22 18:33:10 juju-e4d256-prod-github-runner-207 kernel: [47364.616735] ? do_syscall_64+0x69/0xc0 Aug 22 18:33:10 juju-e4d256-prod-github-runner-207 kernel: [47364.617372] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 18:33:10 juju-e4d256-prod-github-runner-207 kernel: [47364.618094] RIP: 0033:0x7faa5d0edaff Aug 22 18:33:10 juju-e4d256-prod-github-runner-207 kernel: [47364.618836] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 18:33:10 juju-e4d256-prod-github-runner-207 kernel: [47364.620823] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 18:33:10 juju-e4d256-prod-github-runner-207 kernel: [47364.621734] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 18:33:10 juju-e4d256-prod-github-runner-207 kernel: [47364.622642] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 18:33:10 juju-e4d256-prod-github-runner-207 kernel: [47364.623557] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 18:33:10 juju-e4d256-prod-github-runner-207 kernel: [47364.624443] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 18:33:10 juju-e4d256-prod-github-runner-207 kernel: [47364.625330] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 18:33:10 juju-e4d256-prod-github-runner-207 kernel: [47364.626221] Aug 22 18:33:38 juju-e4d256-prod-github-runner-207 kernel: [47392.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 44029s! [qemu-system-x86:6715] Aug 22 18:33:38 juju-e4d256-prod-github-runner-207 kernel: [47392.544015] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 18:33:38 juju-e4d256-prod-github-runner-207 kernel: [47392.544313] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 18:33:38 juju-e4d256-prod-github-runner-207 kernel: [47392.557074] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 18:33:38 juju-e4d256-prod-github-runner-207 kernel: [47392.558374] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 18:33:38 juju-e4d256-prod-github-runner-207 kernel: [47392.559634] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:33:38 juju-e4d256-prod-github-runner-207 kernel: [47392.560694] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 18:33:38 juju-e4d256-prod-github-runner-207 kernel: [47392.563317] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 18:33:38 juju-e4d256-prod-github-runner-207 kernel: [47392.564363] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 18:33:38 juju-e4d256-prod-github-runner-207 kernel: [47392.565527] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 18:33:38 juju-e4d256-prod-github-runner-207 kernel: [47392.566736] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 18:33:38 juju-e4d256-prod-github-runner-207 kernel: [47392.568058] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 18:33:38 juju-e4d256-prod-github-runner-207 kernel: [47392.569220] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 18:33:38 juju-e4d256-prod-github-runner-207 kernel: [47392.570435] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 18:33:38 juju-e4d256-prod-github-runner-207 kernel: [47392.571670] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 18:33:38 juju-e4d256-prod-github-runner-207 kernel: [47392.572769] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 18:33:38 juju-e4d256-prod-github-runner-207 kernel: [47392.573964] Call Trace: Aug 22 18:33:38 juju-e4d256-prod-github-runner-207 kernel: [47392.574933] Aug 22 18:33:38 juju-e4d256-prod-github-runner-207 kernel: [47392.575832] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:33:38 juju-e4d256-prod-github-runner-207 kernel: [47392.576896] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:33:38 juju-e4d256-prod-github-runner-207 kernel: [47392.578103] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:33:38 juju-e4d256-prod-github-runner-207 kernel: [47392.579380] ? show_regs.part.0+0x23/0x29 Aug 22 18:33:38 juju-e4d256-prod-github-runner-207 kernel: [47392.580399] ? show_regs.cold+0x8/0xd Aug 22 18:33:38 juju-e4d256-prod-github-runner-207 kernel: [47392.581373] ? watchdog_timer_fn+0x1be/0x220 Aug 22 18:33:38 juju-e4d256-prod-github-runner-207 kernel: [47392.582451] ? lockup_detector_update_enable+0x60/0x60 Aug 22 18:33:38 juju-e4d256-prod-github-runner-207 kernel: [47392.583526] ? __hrtimer_run_queues+0x107/0x230 Aug 22 18:33:38 juju-e4d256-prod-github-runner-207 kernel: [47392.584568] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 18:33:38 juju-e4d256-prod-github-runner-207 kernel: [47392.585610] ? hrtimer_interrupt+0x101/0x220 Aug 22 18:33:38 juju-e4d256-prod-github-runner-207 kernel: [47392.586683] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 18:33:38 juju-e4d256-prod-github-runner-207 kernel: [47392.587756] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 18:33:38 juju-e4d256-prod-github-runner-207 kernel: [47392.588846] Aug 22 18:33:38 juju-e4d256-prod-github-runner-207 kernel: [47392.589700] Aug 22 18:33:38 juju-e4d256-prod-github-runner-207 kernel: [47392.590579] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 18:33:38 juju-e4d256-prod-github-runner-207 kernel: [47392.591615] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:33:38 juju-e4d256-prod-github-runner-207 kernel: [47392.592659] ? _raw_spin_lock+0x22/0x30 Aug 22 18:33:38 juju-e4d256-prod-github-runner-207 kernel: [47392.593604] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:33:38 juju-e4d256-prod-github-runner-207 kernel: [47392.594688] direct_page_fault+0x206/0x310 [kvm] Aug 22 18:33:38 juju-e4d256-prod-github-runner-207 kernel: [47392.595715] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 18:33:38 juju-e4d256-prod-github-runner-207 kernel: [47392.596721] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 18:33:38 juju-e4d256-prod-github-runner-207 kernel: [47392.597719] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 18:33:38 juju-e4d256-prod-github-runner-207 kernel: [47392.598795] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 18:33:38 juju-e4d256-prod-github-runner-207 kernel: [47392.599742] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 18:33:38 juju-e4d256-prod-github-runner-207 kernel: [47392.600719] handle_exit+0x98/0x230 [kvm_amd] Aug 22 18:33:38 juju-e4d256-prod-github-runner-207 kernel: [47392.601617] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 18:33:38 juju-e4d256-prod-github-runner-207 kernel: [47392.602601] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 18:33:38 juju-e4d256-prod-github-runner-207 kernel: [47392.603530] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 18:33:38 juju-e4d256-prod-github-runner-207 kernel: [47392.604439] vcpu_run+0x62/0x2c0 [kvm] Aug 22 18:33:38 juju-e4d256-prod-github-runner-207 kernel: [47392.605251] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 18:33:38 juju-e4d256-prod-github-runner-207 kernel: [47392.606059] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 18:33:38 juju-e4d256-prod-github-runner-207 kernel: [47392.607051] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 18:33:38 juju-e4d256-prod-github-runner-207 kernel: [47392.608033] ? __seccomp_filter+0x4a/0x4a0 Aug 22 18:33:38 juju-e4d256-prod-github-runner-207 kernel: [47392.609022] ? __fget_files+0x86/0xc0 Aug 22 18:33:38 juju-e4d256-prod-github-runner-207 kernel: [47392.609748] __x64_sys_ioctl+0x95/0xd0 Aug 22 18:33:38 juju-e4d256-prod-github-runner-207 kernel: [47392.610475] do_syscall_64+0x5c/0xc0 Aug 22 18:33:38 juju-e4d256-prod-github-runner-207 kernel: [47392.611155] ? do_futex+0x162/0x1f0 Aug 22 18:33:38 juju-e4d256-prod-github-runner-207 kernel: [47392.611807] ? __x64_sys_futex+0x78/0x1e0 Aug 22 18:33:38 juju-e4d256-prod-github-runner-207 kernel: [47392.612481] ? __secure_computing+0xa9/0x120 Aug 22 18:33:38 juju-e4d256-prod-github-runner-207 kernel: [47392.613173] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 18:33:38 juju-e4d256-prod-github-runner-207 kernel: [47392.613950] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:33:38 juju-e4d256-prod-github-runner-207 kernel: [47392.614770] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:33:38 juju-e4d256-prod-github-runner-207 kernel: [47392.615492] ? do_syscall_64+0x69/0xc0 Aug 22 18:33:38 juju-e4d256-prod-github-runner-207 kernel: [47392.616135] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:33:38 juju-e4d256-prod-github-runner-207 kernel: [47392.616835] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:33:38 juju-e4d256-prod-github-runner-207 kernel: [47392.617532] ? do_syscall_64+0x69/0xc0 Aug 22 18:33:38 juju-e4d256-prod-github-runner-207 kernel: [47392.618155] ? do_syscall_64+0x69/0xc0 Aug 22 18:33:38 juju-e4d256-prod-github-runner-207 kernel: [47392.618856] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 18:33:38 juju-e4d256-prod-github-runner-207 kernel: [47392.619564] RIP: 0033:0x7faa5d0edaff Aug 22 18:33:38 juju-e4d256-prod-github-runner-207 kernel: [47392.620230] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 18:33:38 juju-e4d256-prod-github-runner-207 kernel: [47392.622216] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 18:33:38 juju-e4d256-prod-github-runner-207 kernel: [47392.623191] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 18:33:38 juju-e4d256-prod-github-runner-207 kernel: [47392.624082] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 18:33:38 juju-e4d256-prod-github-runner-207 kernel: [47392.624975] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 18:33:38 juju-e4d256-prod-github-runner-207 kernel: [47392.625866] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 18:33:38 juju-e4d256-prod-github-runner-207 kernel: [47392.626815] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 18:33:38 juju-e4d256-prod-github-runner-207 kernel: [47392.627710] Aug 22 18:34:06 juju-e4d256-prod-github-runner-207 kernel: [47420.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 44055s! [qemu-system-x86:6715] Aug 22 18:34:06 juju-e4d256-prod-github-runner-207 kernel: [47420.543910] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 18:34:06 juju-e4d256-prod-github-runner-207 kernel: [47420.544235] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 18:34:06 juju-e4d256-prod-github-runner-207 kernel: [47420.556896] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 18:34:06 juju-e4d256-prod-github-runner-207 kernel: [47420.558267] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 18:34:06 juju-e4d256-prod-github-runner-207 kernel: [47420.559528] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:34:06 juju-e4d256-prod-github-runner-207 kernel: [47420.560598] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 18:34:06 juju-e4d256-prod-github-runner-207 kernel: [47420.563344] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 18:34:06 juju-e4d256-prod-github-runner-207 kernel: [47420.564401] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 18:34:06 juju-e4d256-prod-github-runner-207 kernel: [47420.565569] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 18:34:06 juju-e4d256-prod-github-runner-207 kernel: [47420.566745] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 18:34:06 juju-e4d256-prod-github-runner-207 kernel: [47420.567936] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 18:34:06 juju-e4d256-prod-github-runner-207 kernel: [47420.569125] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 18:34:06 juju-e4d256-prod-github-runner-207 kernel: [47420.570310] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 18:34:06 juju-e4d256-prod-github-runner-207 kernel: [47420.571562] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 18:34:06 juju-e4d256-prod-github-runner-207 kernel: [47420.572669] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 18:34:06 juju-e4d256-prod-github-runner-207 kernel: [47420.573865] Call Trace: Aug 22 18:34:06 juju-e4d256-prod-github-runner-207 kernel: [47420.574799] Aug 22 18:34:06 juju-e4d256-prod-github-runner-207 kernel: [47420.575718] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:34:06 juju-e4d256-prod-github-runner-207 kernel: [47420.576753] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:34:06 juju-e4d256-prod-github-runner-207 kernel: [47420.577776] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:34:06 juju-e4d256-prod-github-runner-207 kernel: [47420.578881] ? show_regs.part.0+0x23/0x29 Aug 22 18:34:06 juju-e4d256-prod-github-runner-207 kernel: [47420.579883] ? show_regs.cold+0x8/0xd Aug 22 18:34:06 juju-e4d256-prod-github-runner-207 kernel: [47420.580865] ? watchdog_timer_fn+0x1be/0x220 Aug 22 18:34:06 juju-e4d256-prod-github-runner-207 kernel: [47420.581913] ? lockup_detector_update_enable+0x60/0x60 Aug 22 18:34:06 juju-e4d256-prod-github-runner-207 kernel: [47420.582995] ? __hrtimer_run_queues+0x107/0x230 Aug 22 18:34:06 juju-e4d256-prod-github-runner-207 kernel: [47420.584037] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 18:34:06 juju-e4d256-prod-github-runner-207 kernel: [47420.585070] ? hrtimer_interrupt+0x101/0x220 Aug 22 18:34:06 juju-e4d256-prod-github-runner-207 kernel: [47420.586118] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 18:34:06 juju-e4d256-prod-github-runner-207 kernel: [47420.587235] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 18:34:06 juju-e4d256-prod-github-runner-207 kernel: [47420.588292] Aug 22 18:34:06 juju-e4d256-prod-github-runner-207 kernel: [47420.589157] Aug 22 18:34:06 juju-e4d256-prod-github-runner-207 kernel: [47420.590010] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 18:34:06 juju-e4d256-prod-github-runner-207 kernel: [47420.591045] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:34:06 juju-e4d256-prod-github-runner-207 kernel: [47420.592093] ? _raw_spin_lock+0x22/0x30 Aug 22 18:34:06 juju-e4d256-prod-github-runner-207 kernel: [47420.593041] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:34:06 juju-e4d256-prod-github-runner-207 kernel: [47420.594089] direct_page_fault+0x206/0x310 [kvm] Aug 22 18:34:06 juju-e4d256-prod-github-runner-207 kernel: [47420.595114] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 18:34:06 juju-e4d256-prod-github-runner-207 kernel: [47420.596134] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 18:34:06 juju-e4d256-prod-github-runner-207 kernel: [47420.597155] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 18:34:06 juju-e4d256-prod-github-runner-207 kernel: [47420.598196] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 18:34:06 juju-e4d256-prod-github-runner-207 kernel: [47420.599160] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 18:34:06 juju-e4d256-prod-github-runner-207 kernel: [47420.600150] handle_exit+0x98/0x230 [kvm_amd] Aug 22 18:34:06 juju-e4d256-prod-github-runner-207 kernel: [47420.601083] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 18:34:06 juju-e4d256-prod-github-runner-207 kernel: [47420.602031] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 18:34:06 juju-e4d256-prod-github-runner-207 kernel: [47420.603008] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 18:34:06 juju-e4d256-prod-github-runner-207 kernel: [47420.603931] vcpu_run+0x62/0x2c0 [kvm] Aug 22 18:34:06 juju-e4d256-prod-github-runner-207 kernel: [47420.604742] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 18:34:06 juju-e4d256-prod-github-runner-207 kernel: [47420.605621] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 18:34:06 juju-e4d256-prod-github-runner-207 kernel: [47420.606497] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 18:34:06 juju-e4d256-prod-github-runner-207 kernel: [47420.607309] ? __seccomp_filter+0x4a/0x4a0 Aug 22 18:34:06 juju-e4d256-prod-github-runner-207 kernel: [47420.608124] ? __fget_files+0x86/0xc0 Aug 22 18:34:06 juju-e4d256-prod-github-runner-207 kernel: [47420.608855] __x64_sys_ioctl+0x95/0xd0 Aug 22 18:34:06 juju-e4d256-prod-github-runner-207 kernel: [47420.609615] do_syscall_64+0x5c/0xc0 Aug 22 18:34:06 juju-e4d256-prod-github-runner-207 kernel: [47420.610299] ? do_futex+0x162/0x1f0 Aug 22 18:34:06 juju-e4d256-prod-github-runner-207 kernel: [47420.610948] ? __x64_sys_futex+0x78/0x1e0 Aug 22 18:34:06 juju-e4d256-prod-github-runner-207 kernel: [47420.611623] ? __secure_computing+0xa9/0x120 Aug 22 18:34:06 juju-e4d256-prod-github-runner-207 kernel: [47420.612316] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 18:34:06 juju-e4d256-prod-github-runner-207 kernel: [47420.613087] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:34:06 juju-e4d256-prod-github-runner-207 kernel: [47420.613828] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:34:06 juju-e4d256-prod-github-runner-207 kernel: [47420.614567] ? do_syscall_64+0x69/0xc0 Aug 22 18:34:06 juju-e4d256-prod-github-runner-207 kernel: [47420.615212] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:34:06 juju-e4d256-prod-github-runner-207 kernel: [47420.615932] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:34:06 juju-e4d256-prod-github-runner-207 kernel: [47420.616633] ? do_syscall_64+0x69/0xc0 Aug 22 18:34:06 juju-e4d256-prod-github-runner-207 kernel: [47420.617277] ? do_syscall_64+0x69/0xc0 Aug 22 18:34:06 juju-e4d256-prod-github-runner-207 kernel: [47420.617916] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 18:34:06 juju-e4d256-prod-github-runner-207 kernel: [47420.618631] RIP: 0033:0x7faa5d0edaff Aug 22 18:34:06 juju-e4d256-prod-github-runner-207 kernel: [47420.619319] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 18:34:06 juju-e4d256-prod-github-runner-207 kernel: [47420.621332] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 18:34:06 juju-e4d256-prod-github-runner-207 kernel: [47420.622275] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 18:34:06 juju-e4d256-prod-github-runner-207 kernel: [47420.623170] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 18:34:06 juju-e4d256-prod-github-runner-207 kernel: [47420.624068] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 18:34:06 juju-e4d256-prod-github-runner-207 kernel: [47420.625029] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 18:34:06 juju-e4d256-prod-github-runner-207 kernel: [47420.625979] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 18:34:06 juju-e4d256-prod-github-runner-207 kernel: [47420.626914] Aug 22 18:34:34 juju-e4d256-prod-github-runner-207 kernel: [47448.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 44081s! [qemu-system-x86:6715] Aug 22 18:34:34 juju-e4d256-prod-github-runner-207 kernel: [47448.543939] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 18:34:34 juju-e4d256-prod-github-runner-207 kernel: [47448.544261] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 18:34:34 juju-e4d256-prod-github-runner-207 kernel: [47448.556450] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 18:34:34 juju-e4d256-prod-github-runner-207 kernel: [47448.557721] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 18:34:34 juju-e4d256-prod-github-runner-207 kernel: [47448.558940] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:34:34 juju-e4d256-prod-github-runner-207 kernel: [47448.559993] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 18:34:34 juju-e4d256-prod-github-runner-207 kernel: [47448.562582] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 18:34:34 juju-e4d256-prod-github-runner-207 kernel: [47448.563637] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 18:34:34 juju-e4d256-prod-github-runner-207 kernel: [47448.564807] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 18:34:34 juju-e4d256-prod-github-runner-207 kernel: [47448.565992] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 18:34:34 juju-e4d256-prod-github-runner-207 kernel: [47448.567153] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 18:34:34 juju-e4d256-prod-github-runner-207 kernel: [47448.568314] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 18:34:34 juju-e4d256-prod-github-runner-207 kernel: [47448.569480] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 18:34:34 juju-e4d256-prod-github-runner-207 kernel: [47448.570729] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 18:34:34 juju-e4d256-prod-github-runner-207 kernel: [47448.571827] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 18:34:34 juju-e4d256-prod-github-runner-207 kernel: [47448.573025] Call Trace: Aug 22 18:34:34 juju-e4d256-prod-github-runner-207 kernel: [47448.573956] Aug 22 18:34:34 juju-e4d256-prod-github-runner-207 kernel: [47448.574860] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:34:34 juju-e4d256-prod-github-runner-207 kernel: [47448.575890] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:34:34 juju-e4d256-prod-github-runner-207 kernel: [47448.576911] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:34:34 juju-e4d256-prod-github-runner-207 kernel: [47448.578077] ? show_regs.part.0+0x23/0x29 Aug 22 18:34:34 juju-e4d256-prod-github-runner-207 kernel: [47448.579079] ? show_regs.cold+0x8/0xd Aug 22 18:34:34 juju-e4d256-prod-github-runner-207 kernel: [47448.580050] ? watchdog_timer_fn+0x1be/0x220 Aug 22 18:34:34 juju-e4d256-prod-github-runner-207 kernel: [47448.581058] ? lockup_detector_update_enable+0x60/0x60 Aug 22 18:34:34 juju-e4d256-prod-github-runner-207 kernel: [47448.582141] ? __hrtimer_run_queues+0x107/0x230 Aug 22 18:34:34 juju-e4d256-prod-github-runner-207 kernel: [47448.583170] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 18:34:34 juju-e4d256-prod-github-runner-207 kernel: [47448.584193] ? hrtimer_interrupt+0x101/0x220 Aug 22 18:34:34 juju-e4d256-prod-github-runner-207 kernel: [47448.585219] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 18:34:34 juju-e4d256-prod-github-runner-207 kernel: [47448.586307] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 18:34:34 juju-e4d256-prod-github-runner-207 kernel: [47448.587351] Aug 22 18:34:34 juju-e4d256-prod-github-runner-207 kernel: [47448.588203] Aug 22 18:34:34 juju-e4d256-prod-github-runner-207 kernel: [47448.589038] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 18:34:34 juju-e4d256-prod-github-runner-207 kernel: [47448.590083] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:34:34 juju-e4d256-prod-github-runner-207 kernel: [47448.591124] ? _raw_spin_lock+0x22/0x30 Aug 22 18:34:34 juju-e4d256-prod-github-runner-207 kernel: [47448.592093] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:34:34 juju-e4d256-prod-github-runner-207 kernel: [47448.593111] direct_page_fault+0x206/0x310 [kvm] Aug 22 18:34:34 juju-e4d256-prod-github-runner-207 kernel: [47448.594151] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 18:34:34 juju-e4d256-prod-github-runner-207 kernel: [47448.595159] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 18:34:34 juju-e4d256-prod-github-runner-207 kernel: [47448.596159] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 18:34:34 juju-e4d256-prod-github-runner-207 kernel: [47448.597167] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 18:34:34 juju-e4d256-prod-github-runner-207 kernel: [47448.598119] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 18:34:34 juju-e4d256-prod-github-runner-207 kernel: [47448.599097] handle_exit+0x98/0x230 [kvm_amd] Aug 22 18:34:34 juju-e4d256-prod-github-runner-207 kernel: [47448.599993] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 18:34:34 juju-e4d256-prod-github-runner-207 kernel: [47448.600910] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 18:34:34 juju-e4d256-prod-github-runner-207 kernel: [47448.601849] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 18:34:34 juju-e4d256-prod-github-runner-207 kernel: [47448.602756] vcpu_run+0x62/0x2c0 [kvm] Aug 22 18:34:34 juju-e4d256-prod-github-runner-207 kernel: [47448.603566] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 18:34:34 juju-e4d256-prod-github-runner-207 kernel: [47448.604380] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 18:34:34 juju-e4d256-prod-github-runner-207 kernel: [47448.605234] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 18:34:34 juju-e4d256-prod-github-runner-207 kernel: [47448.606041] ? __seccomp_filter+0x4a/0x4a0 Aug 22 18:34:34 juju-e4d256-prod-github-runner-207 kernel: [47448.606785] ? __fget_files+0x86/0xc0 Aug 22 18:34:34 juju-e4d256-prod-github-runner-207 kernel: [47448.607546] __x64_sys_ioctl+0x95/0xd0 Aug 22 18:34:34 juju-e4d256-prod-github-runner-207 kernel: [47448.608248] do_syscall_64+0x5c/0xc0 Aug 22 18:34:34 juju-e4d256-prod-github-runner-207 kernel: [47448.608919] ? do_futex+0x162/0x1f0 Aug 22 18:34:34 juju-e4d256-prod-github-runner-207 kernel: [47448.609582] ? __x64_sys_futex+0x78/0x1e0 Aug 22 18:34:34 juju-e4d256-prod-github-runner-207 kernel: [47448.610258] ? __secure_computing+0xa9/0x120 Aug 22 18:34:34 juju-e4d256-prod-github-runner-207 kernel: [47448.610950] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 18:34:34 juju-e4d256-prod-github-runner-207 kernel: [47448.611712] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:34:34 juju-e4d256-prod-github-runner-207 kernel: [47448.612434] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:34:34 juju-e4d256-prod-github-runner-207 kernel: [47448.613158] ? do_syscall_64+0x69/0xc0 Aug 22 18:34:34 juju-e4d256-prod-github-runner-207 kernel: [47448.613815] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:34:34 juju-e4d256-prod-github-runner-207 kernel: [47448.614522] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:34:34 juju-e4d256-prod-github-runner-207 kernel: [47448.615218] ? do_syscall_64+0x69/0xc0 Aug 22 18:34:34 juju-e4d256-prod-github-runner-207 kernel: [47448.615849] ? do_syscall_64+0x69/0xc0 Aug 22 18:34:34 juju-e4d256-prod-github-runner-207 kernel: [47448.616599] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 18:34:34 juju-e4d256-prod-github-runner-207 kernel: [47448.617323] RIP: 0033:0x7faa5d0edaff Aug 22 18:34:34 juju-e4d256-prod-github-runner-207 kernel: [47448.620114] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 18:34:34 juju-e4d256-prod-github-runner-207 kernel: [47448.622169] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 18:34:34 juju-e4d256-prod-github-runner-207 kernel: [47448.623088] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 18:34:34 juju-e4d256-prod-github-runner-207 kernel: [47448.624006] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 18:34:34 juju-e4d256-prod-github-runner-207 kernel: [47448.624899] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 18:34:34 juju-e4d256-prod-github-runner-207 kernel: [47448.625845] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 18:34:34 juju-e4d256-prod-github-runner-207 kernel: [47448.626755] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 18:34:34 juju-e4d256-prod-github-runner-207 kernel: [47448.627709] Aug 22 18:35:02 juju-e4d256-prod-github-runner-207 kernel: [47476.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 44107s! [qemu-system-x86:6715] Aug 22 18:35:02 juju-e4d256-prod-github-runner-207 kernel: [47476.543837] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 18:35:02 juju-e4d256-prod-github-runner-207 kernel: [47476.544140] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 18:35:02 juju-e4d256-prod-github-runner-207 kernel: [47476.556726] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 18:35:02 juju-e4d256-prod-github-runner-207 kernel: [47476.558031] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 18:35:02 juju-e4d256-prod-github-runner-207 kernel: [47476.559267] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:35:02 juju-e4d256-prod-github-runner-207 kernel: [47476.560342] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 18:35:02 juju-e4d256-prod-github-runner-207 kernel: [47476.562946] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 18:35:02 juju-e4d256-prod-github-runner-207 kernel: [47476.563999] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 18:35:02 juju-e4d256-prod-github-runner-207 kernel: [47476.565198] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 18:35:02 juju-e4d256-prod-github-runner-207 kernel: [47476.566374] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 18:35:02 juju-e4d256-prod-github-runner-207 kernel: [47476.567549] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 18:35:02 juju-e4d256-prod-github-runner-207 kernel: [47476.568727] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 18:35:02 juju-e4d256-prod-github-runner-207 kernel: [47476.570862] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 18:35:02 juju-e4d256-prod-github-runner-207 kernel: [47476.572103] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 18:35:02 juju-e4d256-prod-github-runner-207 kernel: [47476.573219] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 18:35:02 juju-e4d256-prod-github-runner-207 kernel: [47476.574419] Call Trace: Aug 22 18:35:02 juju-e4d256-prod-github-runner-207 kernel: [47476.575333] Aug 22 18:35:02 juju-e4d256-prod-github-runner-207 kernel: [47476.576239] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:35:02 juju-e4d256-prod-github-runner-207 kernel: [47476.577286] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:35:02 juju-e4d256-prod-github-runner-207 kernel: [47476.578314] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:35:02 juju-e4d256-prod-github-runner-207 kernel: [47476.579413] ? show_regs.part.0+0x23/0x29 Aug 22 18:35:02 juju-e4d256-prod-github-runner-207 kernel: [47476.580417] ? show_regs.cold+0x8/0xd Aug 22 18:35:02 juju-e4d256-prod-github-runner-207 kernel: [47476.581467] ? watchdog_timer_fn+0x1be/0x220 Aug 22 18:35:02 juju-e4d256-prod-github-runner-207 kernel: [47476.582507] ? lockup_detector_update_enable+0x60/0x60 Aug 22 18:35:02 juju-e4d256-prod-github-runner-207 kernel: [47476.583577] ? __hrtimer_run_queues+0x107/0x230 Aug 22 18:35:02 juju-e4d256-prod-github-runner-207 kernel: [47476.584609] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 18:35:02 juju-e4d256-prod-github-runner-207 kernel: [47476.585672] ? hrtimer_interrupt+0x101/0x220 Aug 22 18:35:02 juju-e4d256-prod-github-runner-207 kernel: [47476.586690] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 18:35:02 juju-e4d256-prod-github-runner-207 kernel: [47476.587757] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 18:35:02 juju-e4d256-prod-github-runner-207 kernel: [47476.588800] Aug 22 18:35:02 juju-e4d256-prod-github-runner-207 kernel: [47476.589674] Aug 22 18:35:02 juju-e4d256-prod-github-runner-207 kernel: [47476.590515] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 18:35:02 juju-e4d256-prod-github-runner-207 kernel: [47476.591546] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:35:02 juju-e4d256-prod-github-runner-207 kernel: [47476.592580] ? _raw_spin_lock+0x22/0x30 Aug 22 18:35:02 juju-e4d256-prod-github-runner-207 kernel: [47476.593541] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:35:02 juju-e4d256-prod-github-runner-207 kernel: [47476.594562] direct_page_fault+0x206/0x310 [kvm] Aug 22 18:35:02 juju-e4d256-prod-github-runner-207 kernel: [47476.595587] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 18:35:02 juju-e4d256-prod-github-runner-207 kernel: [47476.596594] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 18:35:02 juju-e4d256-prod-github-runner-207 kernel: [47476.597603] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 18:35:02 juju-e4d256-prod-github-runner-207 kernel: [47476.598622] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 18:35:02 juju-e4d256-prod-github-runner-207 kernel: [47476.599572] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 18:35:02 juju-e4d256-prod-github-runner-207 kernel: [47476.600549] handle_exit+0x98/0x230 [kvm_amd] Aug 22 18:35:02 juju-e4d256-prod-github-runner-207 kernel: [47476.601455] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 18:35:02 juju-e4d256-prod-github-runner-207 kernel: [47476.602622] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 18:35:02 juju-e4d256-prod-github-runner-207 kernel: [47476.603619] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 18:35:02 juju-e4d256-prod-github-runner-207 kernel: [47476.604528] vcpu_run+0x62/0x2c0 [kvm] Aug 22 18:35:02 juju-e4d256-prod-github-runner-207 kernel: [47476.605363] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 18:35:02 juju-e4d256-prod-github-runner-207 kernel: [47476.606177] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 18:35:02 juju-e4d256-prod-github-runner-207 kernel: [47476.607031] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 18:35:02 juju-e4d256-prod-github-runner-207 kernel: [47476.607831] ? __seccomp_filter+0x4a/0x4a0 Aug 22 18:35:02 juju-e4d256-prod-github-runner-207 kernel: [47476.608786] ? __fget_files+0x86/0xc0 Aug 22 18:35:02 juju-e4d256-prod-github-runner-207 kernel: [47476.609693] __x64_sys_ioctl+0x95/0xd0 Aug 22 18:35:02 juju-e4d256-prod-github-runner-207 kernel: [47476.610393] do_syscall_64+0x5c/0xc0 Aug 22 18:35:02 juju-e4d256-prod-github-runner-207 kernel: [47476.611075] ? do_futex+0x162/0x1f0 Aug 22 18:35:02 juju-e4d256-prod-github-runner-207 kernel: [47476.611724] ? __x64_sys_futex+0x78/0x1e0 Aug 22 18:35:02 juju-e4d256-prod-github-runner-207 kernel: [47476.612546] ? __secure_computing+0xa9/0x120 Aug 22 18:35:02 juju-e4d256-prod-github-runner-207 kernel: [47476.613264] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 18:35:02 juju-e4d256-prod-github-runner-207 kernel: [47476.614026] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:35:02 juju-e4d256-prod-github-runner-207 kernel: [47476.614750] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:35:02 juju-e4d256-prod-github-runner-207 kernel: [47476.615475] ? do_syscall_64+0x69/0xc0 Aug 22 18:35:02 juju-e4d256-prod-github-runner-207 kernel: [47476.616121] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:35:02 juju-e4d256-prod-github-runner-207 kernel: [47476.616824] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:35:02 juju-e4d256-prod-github-runner-207 kernel: [47476.617544] ? do_syscall_64+0x69/0xc0 Aug 22 18:35:02 juju-e4d256-prod-github-runner-207 kernel: [47476.618173] ? do_syscall_64+0x69/0xc0 Aug 22 18:35:02 juju-e4d256-prod-github-runner-207 kernel: [47476.618797] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 18:35:02 juju-e4d256-prod-github-runner-207 kernel: [47476.619509] RIP: 0033:0x7faa5d0edaff Aug 22 18:35:02 juju-e4d256-prod-github-runner-207 kernel: [47476.620195] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 18:35:02 juju-e4d256-prod-github-runner-207 kernel: [47476.622302] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 18:35:02 juju-e4d256-prod-github-runner-207 kernel: [47476.623218] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 18:35:02 juju-e4d256-prod-github-runner-207 kernel: [47476.624115] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 18:35:02 juju-e4d256-prod-github-runner-207 kernel: [47476.625006] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 18:35:02 juju-e4d256-prod-github-runner-207 kernel: [47476.625907] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 18:35:02 juju-e4d256-prod-github-runner-207 kernel: [47476.626810] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 18:35:02 juju-e4d256-prod-github-runner-207 kernel: [47476.627708] Aug 22 18:35:30 juju-e4d256-prod-github-runner-207 kernel: [47504.541983] watchdog: BUG: soft lockup - CPU#1 stuck for 44134s! [qemu-system-x86:6715] Aug 22 18:35:30 juju-e4d256-prod-github-runner-207 kernel: [47504.543929] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 18:35:30 juju-e4d256-prod-github-runner-207 kernel: [47504.544237] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 18:35:30 juju-e4d256-prod-github-runner-207 kernel: [47504.556998] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 18:35:30 juju-e4d256-prod-github-runner-207 kernel: [47504.558332] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 18:35:30 juju-e4d256-prod-github-runner-207 kernel: [47504.559604] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:35:30 juju-e4d256-prod-github-runner-207 kernel: [47504.560670] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 18:35:30 juju-e4d256-prod-github-runner-207 kernel: [47504.563328] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 18:35:30 juju-e4d256-prod-github-runner-207 kernel: [47504.564418] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 18:35:30 juju-e4d256-prod-github-runner-207 kernel: [47504.565659] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 18:35:30 juju-e4d256-prod-github-runner-207 kernel: [47504.566861] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 18:35:30 juju-e4d256-prod-github-runner-207 kernel: [47504.568040] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 18:35:30 juju-e4d256-prod-github-runner-207 kernel: [47504.569279] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 18:35:30 juju-e4d256-prod-github-runner-207 kernel: [47504.570474] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 18:35:30 juju-e4d256-prod-github-runner-207 kernel: [47504.571724] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 18:35:30 juju-e4d256-prod-github-runner-207 kernel: [47504.572905] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 18:35:30 juju-e4d256-prod-github-runner-207 kernel: [47504.574176] Call Trace: Aug 22 18:35:30 juju-e4d256-prod-github-runner-207 kernel: [47504.575180] Aug 22 18:35:30 juju-e4d256-prod-github-runner-207 kernel: [47504.576138] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:35:30 juju-e4d256-prod-github-runner-207 kernel: [47504.577225] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:35:30 juju-e4d256-prod-github-runner-207 kernel: [47504.578264] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:35:30 juju-e4d256-prod-github-runner-207 kernel: [47504.579400] ? show_regs.part.0+0x23/0x29 Aug 22 18:35:30 juju-e4d256-prod-github-runner-207 kernel: [47504.580482] ? show_regs.cold+0x8/0xd Aug 22 18:35:30 juju-e4d256-prod-github-runner-207 kernel: [47504.581545] ? watchdog_timer_fn+0x1be/0x220 Aug 22 18:35:30 juju-e4d256-prod-github-runner-207 kernel: [47504.582593] ? lockup_detector_update_enable+0x60/0x60 Aug 22 18:35:30 juju-e4d256-prod-github-runner-207 kernel: [47504.583664] ? __hrtimer_run_queues+0x107/0x230 Aug 22 18:35:30 juju-e4d256-prod-github-runner-207 kernel: [47504.584735] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 18:35:30 juju-e4d256-prod-github-runner-207 kernel: [47504.586902] ? hrtimer_interrupt+0x101/0x220 Aug 22 18:35:30 juju-e4d256-prod-github-runner-207 kernel: [47504.588031] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 18:35:30 juju-e4d256-prod-github-runner-207 kernel: [47504.589154] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 18:35:30 juju-e4d256-prod-github-runner-207 kernel: [47504.590259] Aug 22 18:35:30 juju-e4d256-prod-github-runner-207 kernel: [47504.591146] Aug 22 18:35:30 juju-e4d256-prod-github-runner-207 kernel: [47504.592000] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 18:35:30 juju-e4d256-prod-github-runner-207 kernel: [47504.593075] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:35:30 juju-e4d256-prod-github-runner-207 kernel: [47504.594146] ? _raw_spin_lock+0x22/0x30 Aug 22 18:35:30 juju-e4d256-prod-github-runner-207 kernel: [47504.595112] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:35:30 juju-e4d256-prod-github-runner-207 kernel: [47504.596188] direct_page_fault+0x206/0x310 [kvm] Aug 22 18:35:30 juju-e4d256-prod-github-runner-207 kernel: [47504.597296] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 18:35:30 juju-e4d256-prod-github-runner-207 kernel: [47504.598331] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 18:35:30 juju-e4d256-prod-github-runner-207 kernel: [47504.599393] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 18:35:30 juju-e4d256-prod-github-runner-207 kernel: [47504.600472] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 18:35:30 juju-e4d256-prod-github-runner-207 kernel: [47504.601465] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 18:35:30 juju-e4d256-prod-github-runner-207 kernel: [47504.602529] handle_exit+0x98/0x230 [kvm_amd] Aug 22 18:35:30 juju-e4d256-prod-github-runner-207 kernel: [47504.603455] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 18:35:30 juju-e4d256-prod-github-runner-207 kernel: [47504.604384] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 18:35:30 juju-e4d256-prod-github-runner-207 kernel: [47504.605347] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 18:35:30 juju-e4d256-prod-github-runner-207 kernel: [47504.606299] vcpu_run+0x62/0x2c0 [kvm] Aug 22 18:35:30 juju-e4d256-prod-github-runner-207 kernel: [47504.607136] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 18:35:30 juju-e4d256-prod-github-runner-207 kernel: [47504.607948] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 18:35:30 juju-e4d256-prod-github-runner-207 kernel: [47504.608837] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 18:35:30 juju-e4d256-prod-github-runner-207 kernel: [47504.609740] ? __seccomp_filter+0x4a/0x4a0 Aug 22 18:35:30 juju-e4d256-prod-github-runner-207 kernel: [47504.610595] ? __fget_files+0x86/0xc0 Aug 22 18:35:30 juju-e4d256-prod-github-runner-207 kernel: [47504.611342] __x64_sys_ioctl+0x95/0xd0 Aug 22 18:35:30 juju-e4d256-prod-github-runner-207 kernel: [47504.612050] do_syscall_64+0x5c/0xc0 Aug 22 18:35:30 juju-e4d256-prod-github-runner-207 kernel: [47504.612744] ? do_futex+0x162/0x1f0 Aug 22 18:35:30 juju-e4d256-prod-github-runner-207 kernel: [47504.613462] ? __x64_sys_futex+0x78/0x1e0 Aug 22 18:35:30 juju-e4d256-prod-github-runner-207 kernel: [47504.614141] ? __secure_computing+0xa9/0x120 Aug 22 18:35:30 juju-e4d256-prod-github-runner-207 kernel: [47504.614835] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 18:35:30 juju-e4d256-prod-github-runner-207 kernel: [47504.615602] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:35:30 juju-e4d256-prod-github-runner-207 kernel: [47504.616331] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:35:30 juju-e4d256-prod-github-runner-207 kernel: [47504.617105] ? do_syscall_64+0x69/0xc0 Aug 22 18:35:30 juju-e4d256-prod-github-runner-207 kernel: [47504.617768] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:35:30 juju-e4d256-prod-github-runner-207 kernel: [47504.618514] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:35:30 juju-e4d256-prod-github-runner-207 kernel: [47504.619242] ? do_syscall_64+0x69/0xc0 Aug 22 18:35:30 juju-e4d256-prod-github-runner-207 kernel: [47504.619884] ? do_syscall_64+0x69/0xc0 Aug 22 18:35:30 juju-e4d256-prod-github-runner-207 kernel: [47504.620519] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 18:35:30 juju-e4d256-prod-github-runner-207 kernel: [47504.621266] RIP: 0033:0x7faa5d0edaff Aug 22 18:35:30 juju-e4d256-prod-github-runner-207 kernel: [47504.621957] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 18:35:30 juju-e4d256-prod-github-runner-207 kernel: [47504.624007] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 18:35:30 juju-e4d256-prod-github-runner-207 kernel: [47504.624946] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 18:35:30 juju-e4d256-prod-github-runner-207 kernel: [47504.625843] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 18:35:30 juju-e4d256-prod-github-runner-207 kernel: [47504.626743] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 18:35:30 juju-e4d256-prod-github-runner-207 kernel: [47504.627707] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 18:35:30 juju-e4d256-prod-github-runner-207 kernel: [47504.628646] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 18:35:30 juju-e4d256-prod-github-runner-207 kernel: [47504.629587] Aug 22 18:35:46 juju-e4d256-prod-github-runner-207 kernel: [47520.356709] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 18:35:46 juju-e4d256-prod-github-runner-207 kernel: [47520.357718] rcu: 1-....: (11813554 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=5714283 Aug 22 18:35:46 juju-e4d256-prod-github-runner-207 kernel: [47520.358846] (t=11850789 jiffies g=23269 q=45989) Aug 22 18:35:46 juju-e4d256-prod-github-runner-207 kernel: [47520.359633] NMI backtrace for cpu 1 Aug 22 18:35:46 juju-e4d256-prod-github-runner-207 kernel: [47520.360343] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 18:35:46 juju-e4d256-prod-github-runner-207 kernel: [47520.361471] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 18:35:46 juju-e4d256-prod-github-runner-207 kernel: [47520.362525] Call Trace: Aug 22 18:35:46 juju-e4d256-prod-github-runner-207 kernel: [47520.363269] Aug 22 18:35:46 juju-e4d256-prod-github-runner-207 kernel: [47520.363927] show_stack+0x52/0x5c Aug 22 18:35:46 juju-e4d256-prod-github-runner-207 kernel: [47520.364693] dump_stack_lvl+0x4a/0x63 Aug 22 18:35:46 juju-e4d256-prod-github-runner-207 kernel: [47520.365466] dump_stack+0x10/0x16 Aug 22 18:35:46 juju-e4d256-prod-github-runner-207 kernel: [47520.366184] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 18:35:46 juju-e4d256-prod-github-runner-207 kernel: [47520.366965] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 18:35:46 juju-e4d256-prod-github-runner-207 kernel: [47520.367744] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 18:35:46 juju-e4d256-prod-github-runner-207 kernel: [47520.368570] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 18:35:46 juju-e4d256-prod-github-runner-207 kernel: [47520.369416] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 18:35:46 juju-e4d256-prod-github-runner-207 kernel: [47520.370227] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 18:35:46 juju-e4d256-prod-github-runner-207 kernel: [47520.370996] print_cpu_stall.cold+0x2f/0xe2 Aug 22 18:35:46 juju-e4d256-prod-github-runner-207 kernel: [47520.371763] ? timekeeping_update+0xf7/0x150 Aug 22 18:35:46 juju-e4d256-prod-github-runner-207 kernel: [47520.372530] check_cpu_stall+0x109/0x270 Aug 22 18:35:46 juju-e4d256-prod-github-runner-207 kernel: [47520.373288] rcu_sched_clock_irq+0x9a/0x250 Aug 22 18:35:46 juju-e4d256-prod-github-runner-207 kernel: [47520.374062] update_process_times+0x94/0xd0 Aug 22 18:35:46 juju-e4d256-prod-github-runner-207 kernel: [47520.374841] tick_sched_handle+0x29/0x70 Aug 22 18:35:46 juju-e4d256-prod-github-runner-207 kernel: [47520.375591] tick_sched_timer+0x8c/0xc0 Aug 22 18:35:46 juju-e4d256-prod-github-runner-207 kernel: [47520.376325] ? tick_nohz_handler+0xb0/0xb0 Aug 22 18:35:46 juju-e4d256-prod-github-runner-207 kernel: [47520.377172] __hrtimer_run_queues+0x107/0x230 Aug 22 18:35:46 juju-e4d256-prod-github-runner-207 kernel: [47520.378103] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 18:35:46 juju-e4d256-prod-github-runner-207 kernel: [47520.378910] hrtimer_interrupt+0x101/0x220 Aug 22 18:35:46 juju-e4d256-prod-github-runner-207 kernel: [47520.379708] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 18:35:46 juju-e4d256-prod-github-runner-207 kernel: [47520.380525] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 18:35:46 juju-e4d256-prod-github-runner-207 kernel: [47520.381344] Aug 22 18:35:46 juju-e4d256-prod-github-runner-207 kernel: [47520.381979] Aug 22 18:35:46 juju-e4d256-prod-github-runner-207 kernel: [47520.382607] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 18:35:46 juju-e4d256-prod-github-runner-207 kernel: [47520.383434] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:35:46 juju-e4d256-prod-github-runner-207 kernel: [47520.384320] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 18:35:46 juju-e4d256-prod-github-runner-207 kernel: [47520.386909] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 18:35:46 juju-e4d256-prod-github-runner-207 kernel: [47520.387779] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 18:35:46 juju-e4d256-prod-github-runner-207 kernel: [47520.388781] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 18:35:46 juju-e4d256-prod-github-runner-207 kernel: [47520.389775] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 18:35:46 juju-e4d256-prod-github-runner-207 kernel: [47520.390789] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 18:35:46 juju-e4d256-prod-github-runner-207 kernel: [47520.391747] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 18:35:46 juju-e4d256-prod-github-runner-207 kernel: [47520.392727] ? _raw_spin_lock+0x22/0x30 Aug 22 18:35:46 juju-e4d256-prod-github-runner-207 kernel: [47520.393493] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:35:46 juju-e4d256-prod-github-runner-207 kernel: [47520.394335] direct_page_fault+0x206/0x310 [kvm] Aug 22 18:35:46 juju-e4d256-prod-github-runner-207 kernel: [47520.395179] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 18:35:46 juju-e4d256-prod-github-runner-207 kernel: [47520.396178] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 18:35:46 juju-e4d256-prod-github-runner-207 kernel: [47520.397015] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 18:35:46 juju-e4d256-prod-github-runner-207 kernel: [47520.397820] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 18:35:46 juju-e4d256-prod-github-runner-207 kernel: [47520.398609] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 18:35:46 juju-e4d256-prod-github-runner-207 kernel: [47520.399433] handle_exit+0x98/0x230 [kvm_amd] Aug 22 18:35:46 juju-e4d256-prod-github-runner-207 kernel: [47520.400187] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 18:35:46 juju-e4d256-prod-github-runner-207 kernel: [47520.400989] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 18:35:46 juju-e4d256-prod-github-runner-207 kernel: [47520.401983] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 18:35:46 juju-e4d256-prod-github-runner-207 kernel: [47520.402857] vcpu_run+0x62/0x2c0 [kvm] Aug 22 18:35:46 juju-e4d256-prod-github-runner-207 kernel: [47520.403603] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 18:35:46 juju-e4d256-prod-github-runner-207 kernel: [47520.404347] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 18:35:46 juju-e4d256-prod-github-runner-207 kernel: [47520.405184] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 18:35:46 juju-e4d256-prod-github-runner-207 kernel: [47520.405949] ? __seccomp_filter+0x4a/0x4a0 Aug 22 18:35:46 juju-e4d256-prod-github-runner-207 kernel: [47520.406670] ? __fget_files+0x86/0xc0 Aug 22 18:35:46 juju-e4d256-prod-github-runner-207 kernel: [47520.407535] __x64_sys_ioctl+0x95/0xd0 Aug 22 18:35:46 juju-e4d256-prod-github-runner-207 kernel: [47520.408506] do_syscall_64+0x5c/0xc0 Aug 22 18:35:46 juju-e4d256-prod-github-runner-207 kernel: [47520.409219] ? do_futex+0x162/0x1f0 Aug 22 18:35:46 juju-e4d256-prod-github-runner-207 kernel: [47520.409909] ? __x64_sys_futex+0x78/0x1e0 Aug 22 18:35:46 juju-e4d256-prod-github-runner-207 kernel: [47520.410614] ? __secure_computing+0xa9/0x120 Aug 22 18:35:46 juju-e4d256-prod-github-runner-207 kernel: [47520.411331] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 18:35:46 juju-e4d256-prod-github-runner-207 kernel: [47520.412126] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:35:46 juju-e4d256-prod-github-runner-207 kernel: [47520.412905] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:35:46 juju-e4d256-prod-github-runner-207 kernel: [47520.413662] ? do_syscall_64+0x69/0xc0 Aug 22 18:35:46 juju-e4d256-prod-github-runner-207 kernel: [47520.414351] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:35:46 juju-e4d256-prod-github-runner-207 kernel: [47520.415108] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:35:46 juju-e4d256-prod-github-runner-207 kernel: [47520.415871] ? do_syscall_64+0x69/0xc0 Aug 22 18:35:46 juju-e4d256-prod-github-runner-207 kernel: [47520.416564] ? do_syscall_64+0x69/0xc0 Aug 22 18:35:46 juju-e4d256-prod-github-runner-207 kernel: [47520.417324] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 18:35:46 juju-e4d256-prod-github-runner-207 kernel: [47520.418095] RIP: 0033:0x7faa5d0edaff Aug 22 18:35:46 juju-e4d256-prod-github-runner-207 kernel: [47520.418802] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 18:35:46 juju-e4d256-prod-github-runner-207 kernel: [47520.420938] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 18:35:46 juju-e4d256-prod-github-runner-207 kernel: [47520.421929] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 18:35:46 juju-e4d256-prod-github-runner-207 kernel: [47520.422937] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 18:35:46 juju-e4d256-prod-github-runner-207 kernel: [47520.423881] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 18:35:46 juju-e4d256-prod-github-runner-207 kernel: [47520.424853] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 18:35:46 juju-e4d256-prod-github-runner-207 kernel: [47520.425783] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 18:35:46 juju-e4d256-prod-github-runner-207 kernel: [47520.426701] Aug 22 18:36:10 juju-e4d256-prod-github-runner-207 kernel: [47544.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 44171s! [qemu-system-x86:6715] Aug 22 18:36:10 juju-e4d256-prod-github-runner-207 kernel: [47544.544242] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 18:36:10 juju-e4d256-prod-github-runner-207 kernel: [47544.544586] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 18:36:10 juju-e4d256-prod-github-runner-207 kernel: [47544.559534] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 18:36:10 juju-e4d256-prod-github-runner-207 kernel: [47544.560874] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 18:36:10 juju-e4d256-prod-github-runner-207 kernel: [47544.562126] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:36:10 juju-e4d256-prod-github-runner-207 kernel: [47544.563212] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 18:36:10 juju-e4d256-prod-github-runner-207 kernel: [47544.565863] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 18:36:10 juju-e4d256-prod-github-runner-207 kernel: [47544.566917] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 18:36:10 juju-e4d256-prod-github-runner-207 kernel: [47544.568115] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 18:36:10 juju-e4d256-prod-github-runner-207 kernel: [47544.569552] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 18:36:10 juju-e4d256-prod-github-runner-207 kernel: [47544.571487] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 18:36:10 juju-e4d256-prod-github-runner-207 kernel: [47544.573469] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 18:36:10 juju-e4d256-prod-github-runner-207 kernel: [47544.575287] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 18:36:10 juju-e4d256-prod-github-runner-207 kernel: [47544.576659] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 18:36:10 juju-e4d256-prod-github-runner-207 kernel: [47544.577785] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 18:36:10 juju-e4d256-prod-github-runner-207 kernel: [47544.579004] Call Trace: Aug 22 18:36:10 juju-e4d256-prod-github-runner-207 kernel: [47544.579974] Aug 22 18:36:10 juju-e4d256-prod-github-runner-207 kernel: [47544.580972] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:36:10 juju-e4d256-prod-github-runner-207 kernel: [47544.582112] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:36:10 juju-e4d256-prod-github-runner-207 kernel: [47544.583180] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:36:10 juju-e4d256-prod-github-runner-207 kernel: [47544.584341] ? show_regs.part.0+0x23/0x29 Aug 22 18:36:10 juju-e4d256-prod-github-runner-207 kernel: [47544.585359] ? show_regs.cold+0x8/0xd Aug 22 18:36:10 juju-e4d256-prod-github-runner-207 kernel: [47544.586351] ? watchdog_timer_fn+0x1be/0x220 Aug 22 18:36:10 juju-e4d256-prod-github-runner-207 kernel: [47544.587390] ? lockup_detector_update_enable+0x60/0x60 Aug 22 18:36:10 juju-e4d256-prod-github-runner-207 kernel: [47544.588480] ? __hrtimer_run_queues+0x107/0x230 Aug 22 18:36:10 juju-e4d256-prod-github-runner-207 kernel: [47544.589518] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 18:36:10 juju-e4d256-prod-github-runner-207 kernel: [47544.590557] ? hrtimer_interrupt+0x101/0x220 Aug 22 18:36:10 juju-e4d256-prod-github-runner-207 kernel: [47544.591593] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 18:36:10 juju-e4d256-prod-github-runner-207 kernel: [47544.592691] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 18:36:10 juju-e4d256-prod-github-runner-207 kernel: [47544.593749] Aug 22 18:36:10 juju-e4d256-prod-github-runner-207 kernel: [47544.594616] Aug 22 18:36:10 juju-e4d256-prod-github-runner-207 kernel: [47544.595475] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 18:36:10 juju-e4d256-prod-github-runner-207 kernel: [47544.596567] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:36:10 juju-e4d256-prod-github-runner-207 kernel: [47544.597655] ? _raw_spin_lock+0x22/0x30 Aug 22 18:36:10 juju-e4d256-prod-github-runner-207 kernel: [47544.598626] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:36:10 juju-e4d256-prod-github-runner-207 kernel: [47544.599701] direct_page_fault+0x206/0x310 [kvm] Aug 22 18:36:10 juju-e4d256-prod-github-runner-207 kernel: [47544.600804] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 18:36:10 juju-e4d256-prod-github-runner-207 kernel: [47544.601889] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 18:36:10 juju-e4d256-prod-github-runner-207 kernel: [47544.602932] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 18:36:10 juju-e4d256-prod-github-runner-207 kernel: [47544.604023] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 18:36:10 juju-e4d256-prod-github-runner-207 kernel: [47544.605016] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 18:36:10 juju-e4d256-prod-github-runner-207 kernel: [47544.606050] handle_exit+0x98/0x230 [kvm_amd] Aug 22 18:36:10 juju-e4d256-prod-github-runner-207 kernel: [47544.607054] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 18:36:10 juju-e4d256-prod-github-runner-207 kernel: [47544.608010] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 18:36:10 juju-e4d256-prod-github-runner-207 kernel: [47544.608961] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 18:36:10 juju-e4d256-prod-github-runner-207 kernel: [47544.609878] vcpu_run+0x62/0x2c0 [kvm] Aug 22 18:36:10 juju-e4d256-prod-github-runner-207 kernel: [47544.610700] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 18:36:10 juju-e4d256-prod-github-runner-207 kernel: [47544.611540] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 18:36:10 juju-e4d256-prod-github-runner-207 kernel: [47544.612435] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 18:36:10 juju-e4d256-prod-github-runner-207 kernel: [47544.613247] ? __seccomp_filter+0x4a/0x4a0 Aug 22 18:36:10 juju-e4d256-prod-github-runner-207 kernel: [47544.614000] ? __fget_files+0x86/0xc0 Aug 22 18:36:10 juju-e4d256-prod-github-runner-207 kernel: [47544.614713] __x64_sys_ioctl+0x95/0xd0 Aug 22 18:36:10 juju-e4d256-prod-github-runner-207 kernel: [47544.615437] do_syscall_64+0x5c/0xc0 Aug 22 18:36:10 juju-e4d256-prod-github-runner-207 kernel: [47544.616114] ? do_futex+0x162/0x1f0 Aug 22 18:36:10 juju-e4d256-prod-github-runner-207 kernel: [47544.616793] ? __x64_sys_futex+0x78/0x1e0 Aug 22 18:36:10 juju-e4d256-prod-github-runner-207 kernel: [47544.617486] ? __secure_computing+0xa9/0x120 Aug 22 18:36:10 juju-e4d256-prod-github-runner-207 kernel: [47544.618194] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 18:36:10 juju-e4d256-prod-github-runner-207 kernel: [47544.618972] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:36:10 juju-e4d256-prod-github-runner-207 kernel: [47544.619737] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:36:10 juju-e4d256-prod-github-runner-207 kernel: [47544.620481] ? do_syscall_64+0x69/0xc0 Aug 22 18:36:10 juju-e4d256-prod-github-runner-207 kernel: [47544.621137] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:36:10 juju-e4d256-prod-github-runner-207 kernel: [47544.621854] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:36:10 juju-e4d256-prod-github-runner-207 kernel: [47544.622562] ? do_syscall_64+0x69/0xc0 Aug 22 18:36:10 juju-e4d256-prod-github-runner-207 kernel: [47544.623199] ? do_syscall_64+0x69/0xc0 Aug 22 18:36:10 juju-e4d256-prod-github-runner-207 kernel: [47544.623831] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 18:36:10 juju-e4d256-prod-github-runner-207 kernel: [47544.624559] RIP: 0033:0x7faa5d0edaff Aug 22 18:36:10 juju-e4d256-prod-github-runner-207 kernel: [47544.625249] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 18:36:10 juju-e4d256-prod-github-runner-207 kernel: [47544.627287] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 18:36:10 juju-e4d256-prod-github-runner-207 kernel: [47544.628221] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 18:36:10 juju-e4d256-prod-github-runner-207 kernel: [47544.629164] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 18:36:10 juju-e4d256-prod-github-runner-207 kernel: [47544.630088] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 18:36:10 juju-e4d256-prod-github-runner-207 kernel: [47544.631011] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 18:36:10 juju-e4d256-prod-github-runner-207 kernel: [47544.631935] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 18:36:10 juju-e4d256-prod-github-runner-207 kernel: [47544.632886] Aug 22 18:36:38 juju-e4d256-prod-github-runner-207 kernel: [47572.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 44197s! [qemu-system-x86:6715] Aug 22 18:36:38 juju-e4d256-prod-github-runner-207 kernel: [47572.543856] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 18:36:38 juju-e4d256-prod-github-runner-207 kernel: [47572.544174] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 18:36:38 juju-e4d256-prod-github-runner-207 kernel: [47572.556626] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 18:36:38 juju-e4d256-prod-github-runner-207 kernel: [47572.557997] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 18:36:38 juju-e4d256-prod-github-runner-207 kernel: [47572.559263] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:36:38 juju-e4d256-prod-github-runner-207 kernel: [47572.560481] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 18:36:38 juju-e4d256-prod-github-runner-207 kernel: [47572.563172] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 18:36:38 juju-e4d256-prod-github-runner-207 kernel: [47572.564295] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 18:36:38 juju-e4d256-prod-github-runner-207 kernel: [47572.565505] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 18:36:38 juju-e4d256-prod-github-runner-207 kernel: [47572.566772] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 18:36:38 juju-e4d256-prod-github-runner-207 kernel: [47572.567984] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 18:36:38 juju-e4d256-prod-github-runner-207 kernel: [47572.569164] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 18:36:38 juju-e4d256-prod-github-runner-207 kernel: [47572.570386] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 18:36:38 juju-e4d256-prod-github-runner-207 kernel: [47572.571646] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 18:36:38 juju-e4d256-prod-github-runner-207 kernel: [47572.572781] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 18:36:38 juju-e4d256-prod-github-runner-207 kernel: [47572.573996] Call Trace: Aug 22 18:36:38 juju-e4d256-prod-github-runner-207 kernel: [47572.574953] Aug 22 18:36:38 juju-e4d256-prod-github-runner-207 kernel: [47572.575925] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:36:38 juju-e4d256-prod-github-runner-207 kernel: [47572.577021] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:36:38 juju-e4d256-prod-github-runner-207 kernel: [47572.578054] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:36:38 juju-e4d256-prod-github-runner-207 kernel: [47572.579195] ? show_regs.part.0+0x23/0x29 Aug 22 18:36:38 juju-e4d256-prod-github-runner-207 kernel: [47572.580241] ? show_regs.cold+0x8/0xd Aug 22 18:36:38 juju-e4d256-prod-github-runner-207 kernel: [47572.581255] ? watchdog_timer_fn+0x1be/0x220 Aug 22 18:36:38 juju-e4d256-prod-github-runner-207 kernel: [47572.582290] ? lockup_detector_update_enable+0x60/0x60 Aug 22 18:36:38 juju-e4d256-prod-github-runner-207 kernel: [47572.583396] ? __hrtimer_run_queues+0x107/0x230 Aug 22 18:36:38 juju-e4d256-prod-github-runner-207 kernel: [47572.584475] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 18:36:38 juju-e4d256-prod-github-runner-207 kernel: [47572.585581] ? hrtimer_interrupt+0x101/0x220 Aug 22 18:36:38 juju-e4d256-prod-github-runner-207 kernel: [47572.586783] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 18:36:38 juju-e4d256-prod-github-runner-207 kernel: [47572.587874] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 18:36:38 juju-e4d256-prod-github-runner-207 kernel: [47572.588972] Aug 22 18:36:38 juju-e4d256-prod-github-runner-207 kernel: [47572.589835] Aug 22 18:36:38 juju-e4d256-prod-github-runner-207 kernel: [47572.590743] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 18:36:38 juju-e4d256-prod-github-runner-207 kernel: [47572.592033] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:36:38 juju-e4d256-prod-github-runner-207 kernel: [47572.593094] ? _raw_spin_lock+0x22/0x30 Aug 22 18:36:38 juju-e4d256-prod-github-runner-207 kernel: [47572.594043] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:36:38 juju-e4d256-prod-github-runner-207 kernel: [47572.595097] direct_page_fault+0x206/0x310 [kvm] Aug 22 18:36:38 juju-e4d256-prod-github-runner-207 kernel: [47572.596187] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 18:36:38 juju-e4d256-prod-github-runner-207 kernel: [47572.597210] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 18:36:38 juju-e4d256-prod-github-runner-207 kernel: [47572.598254] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 18:36:38 juju-e4d256-prod-github-runner-207 kernel: [47572.599290] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 18:36:38 juju-e4d256-prod-github-runner-207 kernel: [47572.600296] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 18:36:38 juju-e4d256-prod-github-runner-207 kernel: [47572.601304] handle_exit+0x98/0x230 [kvm_amd] Aug 22 18:36:38 juju-e4d256-prod-github-runner-207 kernel: [47572.602231] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 18:36:38 juju-e4d256-prod-github-runner-207 kernel: [47572.603171] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 18:36:38 juju-e4d256-prod-github-runner-207 kernel: [47572.604132] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 18:36:38 juju-e4d256-prod-github-runner-207 kernel: [47572.605353] vcpu_run+0x62/0x2c0 [kvm] Aug 22 18:36:38 juju-e4d256-prod-github-runner-207 kernel: [47572.606210] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 18:36:38 juju-e4d256-prod-github-runner-207 kernel: [47572.607039] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 18:36:38 juju-e4d256-prod-github-runner-207 kernel: [47572.608120] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 18:36:38 juju-e4d256-prod-github-runner-207 kernel: [47572.608931] ? __seccomp_filter+0x4a/0x4a0 Aug 22 18:36:38 juju-e4d256-prod-github-runner-207 kernel: [47572.609771] ? __fget_files+0x86/0xc0 Aug 22 18:36:38 juju-e4d256-prod-github-runner-207 kernel: [47572.610488] __x64_sys_ioctl+0x95/0xd0 Aug 22 18:36:38 juju-e4d256-prod-github-runner-207 kernel: [47572.611236] do_syscall_64+0x5c/0xc0 Aug 22 18:36:38 juju-e4d256-prod-github-runner-207 kernel: [47572.611916] ? do_futex+0x162/0x1f0 Aug 22 18:36:38 juju-e4d256-prod-github-runner-207 kernel: [47572.612613] ? __x64_sys_futex+0x78/0x1e0 Aug 22 18:36:38 juju-e4d256-prod-github-runner-207 kernel: [47572.613321] ? __secure_computing+0xa9/0x120 Aug 22 18:36:38 juju-e4d256-prod-github-runner-207 kernel: [47572.614047] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 18:36:38 juju-e4d256-prod-github-runner-207 kernel: [47572.614829] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:36:38 juju-e4d256-prod-github-runner-207 kernel: [47572.615570] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:36:38 juju-e4d256-prod-github-runner-207 kernel: [47572.616342] ? do_syscall_64+0x69/0xc0 Aug 22 18:36:38 juju-e4d256-prod-github-runner-207 kernel: [47572.616999] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:36:38 juju-e4d256-prod-github-runner-207 kernel: [47572.617716] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:36:38 juju-e4d256-prod-github-runner-207 kernel: [47572.618424] ? do_syscall_64+0x69/0xc0 Aug 22 18:36:38 juju-e4d256-prod-github-runner-207 kernel: [47572.619059] ? do_syscall_64+0x69/0xc0 Aug 22 18:36:38 juju-e4d256-prod-github-runner-207 kernel: [47572.619691] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 18:36:38 juju-e4d256-prod-github-runner-207 kernel: [47572.620427] RIP: 0033:0x7faa5d0edaff Aug 22 18:36:38 juju-e4d256-prod-github-runner-207 kernel: [47572.621115] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 18:36:38 juju-e4d256-prod-github-runner-207 kernel: [47572.623166] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 18:36:38 juju-e4d256-prod-github-runner-207 kernel: [47572.624122] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 18:36:38 juju-e4d256-prod-github-runner-207 kernel: [47572.625033] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 18:36:38 juju-e4d256-prod-github-runner-207 kernel: [47572.626004] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 18:36:38 juju-e4d256-prod-github-runner-207 kernel: [47572.626993] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 18:36:38 juju-e4d256-prod-github-runner-207 kernel: [47572.627921] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 18:36:38 juju-e4d256-prod-github-runner-207 kernel: [47572.628869] Aug 22 18:37:06 juju-e4d256-prod-github-runner-207 kernel: [47600.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 44223s! [qemu-system-x86:6715] Aug 22 18:37:06 juju-e4d256-prod-github-runner-207 kernel: [47600.543947] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 18:37:06 juju-e4d256-prod-github-runner-207 kernel: [47600.544279] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 18:37:06 juju-e4d256-prod-github-runner-207 kernel: [47600.557530] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 18:37:06 juju-e4d256-prod-github-runner-207 kernel: [47600.558800] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 18:37:06 juju-e4d256-prod-github-runner-207 kernel: [47600.560029] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:37:06 juju-e4d256-prod-github-runner-207 kernel: [47600.561084] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 18:37:06 juju-e4d256-prod-github-runner-207 kernel: [47600.563639] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 18:37:06 juju-e4d256-prod-github-runner-207 kernel: [47600.564680] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 18:37:06 juju-e4d256-prod-github-runner-207 kernel: [47600.565852] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 18:37:06 juju-e4d256-prod-github-runner-207 kernel: [47600.567075] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 18:37:06 juju-e4d256-prod-github-runner-207 kernel: [47600.568259] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 18:37:06 juju-e4d256-prod-github-runner-207 kernel: [47600.569424] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 18:37:06 juju-e4d256-prod-github-runner-207 kernel: [47600.570611] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 18:37:06 juju-e4d256-prod-github-runner-207 kernel: [47600.572085] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 18:37:06 juju-e4d256-prod-github-runner-207 kernel: [47600.573196] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 18:37:06 juju-e4d256-prod-github-runner-207 kernel: [47600.574402] Call Trace: Aug 22 18:37:06 juju-e4d256-prod-github-runner-207 kernel: [47600.575328] Aug 22 18:37:06 juju-e4d256-prod-github-runner-207 kernel: [47600.576263] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:37:06 juju-e4d256-prod-github-runner-207 kernel: [47600.577297] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:37:06 juju-e4d256-prod-github-runner-207 kernel: [47600.578321] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:37:06 juju-e4d256-prod-github-runner-207 kernel: [47600.579429] ? show_regs.part.0+0x23/0x29 Aug 22 18:37:06 juju-e4d256-prod-github-runner-207 kernel: [47600.580472] ? show_regs.cold+0x8/0xd Aug 22 18:37:06 juju-e4d256-prod-github-runner-207 kernel: [47600.581455] ? watchdog_timer_fn+0x1be/0x220 Aug 22 18:37:06 juju-e4d256-prod-github-runner-207 kernel: [47600.582467] ? lockup_detector_update_enable+0x60/0x60 Aug 22 18:37:06 juju-e4d256-prod-github-runner-207 kernel: [47600.583541] ? __hrtimer_run_queues+0x107/0x230 Aug 22 18:37:06 juju-e4d256-prod-github-runner-207 kernel: [47600.584587] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 18:37:06 juju-e4d256-prod-github-runner-207 kernel: [47600.585619] ? hrtimer_interrupt+0x101/0x220 Aug 22 18:37:06 juju-e4d256-prod-github-runner-207 kernel: [47600.586634] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 18:37:06 juju-e4d256-prod-github-runner-207 kernel: [47600.587725] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 18:37:06 juju-e4d256-prod-github-runner-207 kernel: [47600.588784] Aug 22 18:37:06 juju-e4d256-prod-github-runner-207 kernel: [47600.589644] Aug 22 18:37:06 juju-e4d256-prod-github-runner-207 kernel: [47600.590483] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 18:37:06 juju-e4d256-prod-github-runner-207 kernel: [47600.591516] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:37:06 juju-e4d256-prod-github-runner-207 kernel: [47600.592573] ? _raw_spin_lock+0x22/0x30 Aug 22 18:37:06 juju-e4d256-prod-github-runner-207 kernel: [47600.593523] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:37:06 juju-e4d256-prod-github-runner-207 kernel: [47600.594559] direct_page_fault+0x206/0x310 [kvm] Aug 22 18:37:06 juju-e4d256-prod-github-runner-207 kernel: [47600.595598] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 18:37:06 juju-e4d256-prod-github-runner-207 kernel: [47600.596608] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 18:37:06 juju-e4d256-prod-github-runner-207 kernel: [47600.597654] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 18:37:06 juju-e4d256-prod-github-runner-207 kernel: [47600.598657] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 18:37:06 juju-e4d256-prod-github-runner-207 kernel: [47600.599622] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 18:37:06 juju-e4d256-prod-github-runner-207 kernel: [47600.600603] handle_exit+0x98/0x230 [kvm_amd] Aug 22 18:37:06 juju-e4d256-prod-github-runner-207 kernel: [47600.601506] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 18:37:06 juju-e4d256-prod-github-runner-207 kernel: [47600.602450] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 18:37:06 juju-e4d256-prod-github-runner-207 kernel: [47600.603390] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 18:37:06 juju-e4d256-prod-github-runner-207 kernel: [47600.604319] vcpu_run+0x62/0x2c0 [kvm] Aug 22 18:37:06 juju-e4d256-prod-github-runner-207 kernel: [47600.605129] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 18:37:06 juju-e4d256-prod-github-runner-207 kernel: [47600.605934] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 18:37:06 juju-e4d256-prod-github-runner-207 kernel: [47600.606790] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 18:37:06 juju-e4d256-prod-github-runner-207 kernel: [47600.607601] ? __seccomp_filter+0x4a/0x4a0 Aug 22 18:37:06 juju-e4d256-prod-github-runner-207 kernel: [47600.608349] ? __fget_files+0x86/0xc0 Aug 22 18:37:06 juju-e4d256-prod-github-runner-207 kernel: [47600.609074] __x64_sys_ioctl+0x95/0xd0 Aug 22 18:37:06 juju-e4d256-prod-github-runner-207 kernel: [47600.609778] do_syscall_64+0x5c/0xc0 Aug 22 18:37:06 juju-e4d256-prod-github-runner-207 kernel: [47600.610441] ? do_futex+0x162/0x1f0 Aug 22 18:37:06 juju-e4d256-prod-github-runner-207 kernel: [47600.611087] ? __x64_sys_futex+0x78/0x1e0 Aug 22 18:37:06 juju-e4d256-prod-github-runner-207 kernel: [47600.611778] ? __secure_computing+0xa9/0x120 Aug 22 18:37:06 juju-e4d256-prod-github-runner-207 kernel: [47600.612487] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 18:37:06 juju-e4d256-prod-github-runner-207 kernel: [47600.613254] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:37:06 juju-e4d256-prod-github-runner-207 kernel: [47600.613973] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:37:06 juju-e4d256-prod-github-runner-207 kernel: [47600.614688] ? do_syscall_64+0x69/0xc0 Aug 22 18:37:06 juju-e4d256-prod-github-runner-207 kernel: [47600.615329] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:37:06 juju-e4d256-prod-github-runner-207 kernel: [47600.616041] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:37:06 juju-e4d256-prod-github-runner-207 kernel: [47600.616733] ? do_syscall_64+0x69/0xc0 Aug 22 18:37:06 juju-e4d256-prod-github-runner-207 kernel: [47600.617356] ? do_syscall_64+0x69/0xc0 Aug 22 18:37:06 juju-e4d256-prod-github-runner-207 kernel: [47600.617974] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 18:37:06 juju-e4d256-prod-github-runner-207 kernel: [47600.618683] RIP: 0033:0x7faa5d0edaff Aug 22 18:37:06 juju-e4d256-prod-github-runner-207 kernel: [47600.619342] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 18:37:06 juju-e4d256-prod-github-runner-207 kernel: [47600.621331] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 18:37:06 juju-e4d256-prod-github-runner-207 kernel: [47600.622247] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 18:37:06 juju-e4d256-prod-github-runner-207 kernel: [47600.623143] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 18:37:06 juju-e4d256-prod-github-runner-207 kernel: [47600.624047] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 18:37:06 juju-e4d256-prod-github-runner-207 kernel: [47600.624938] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 18:37:06 juju-e4d256-prod-github-runner-207 kernel: [47600.625824] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 18:37:06 juju-e4d256-prod-github-runner-207 kernel: [47600.626730] Aug 22 18:37:34 juju-e4d256-prod-github-runner-207 kernel: [47628.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 44249s! [qemu-system-x86:6715] Aug 22 18:37:34 juju-e4d256-prod-github-runner-207 kernel: [47628.543927] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 18:37:34 juju-e4d256-prod-github-runner-207 kernel: [47628.544231] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 18:37:34 juju-e4d256-prod-github-runner-207 kernel: [47628.556537] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 18:37:34 juju-e4d256-prod-github-runner-207 kernel: [47628.557810] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 18:37:34 juju-e4d256-prod-github-runner-207 kernel: [47628.559035] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:37:34 juju-e4d256-prod-github-runner-207 kernel: [47628.560105] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 18:37:34 juju-e4d256-prod-github-runner-207 kernel: [47628.562775] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 18:37:34 juju-e4d256-prod-github-runner-207 kernel: [47628.564037] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 18:37:34 juju-e4d256-prod-github-runner-207 kernel: [47628.565357] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 18:37:34 juju-e4d256-prod-github-runner-207 kernel: [47628.566706] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 18:37:34 juju-e4d256-prod-github-runner-207 kernel: [47628.568064] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 18:37:34 juju-e4d256-prod-github-runner-207 kernel: [47628.569376] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 18:37:34 juju-e4d256-prod-github-runner-207 kernel: [47628.570765] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 18:37:34 juju-e4d256-prod-github-runner-207 kernel: [47628.572208] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 18:37:34 juju-e4d256-prod-github-runner-207 kernel: [47628.573494] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 18:37:34 juju-e4d256-prod-github-runner-207 kernel: [47628.574873] Call Trace: Aug 22 18:37:34 juju-e4d256-prod-github-runner-207 kernel: [47628.575905] Aug 22 18:37:34 juju-e4d256-prod-github-runner-207 kernel: [47628.576891] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:37:34 juju-e4d256-prod-github-runner-207 kernel: [47628.578059] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:37:34 juju-e4d256-prod-github-runner-207 kernel: [47628.579209] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:37:34 juju-e4d256-prod-github-runner-207 kernel: [47628.580468] ? show_regs.part.0+0x23/0x29 Aug 22 18:37:34 juju-e4d256-prod-github-runner-207 kernel: [47628.581579] ? show_regs.cold+0x8/0xd Aug 22 18:37:34 juju-e4d256-prod-github-runner-207 kernel: [47628.582628] ? watchdog_timer_fn+0x1be/0x220 Aug 22 18:37:34 juju-e4d256-prod-github-runner-207 kernel: [47628.583984] ? lockup_detector_update_enable+0x60/0x60 Aug 22 18:37:34 juju-e4d256-prod-github-runner-207 kernel: [47628.585204] ? __hrtimer_run_queues+0x107/0x230 Aug 22 18:37:34 juju-e4d256-prod-github-runner-207 kernel: [47628.586487] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 18:37:34 juju-e4d256-prod-github-runner-207 kernel: [47628.587694] ? hrtimer_interrupt+0x101/0x220 Aug 22 18:37:34 juju-e4d256-prod-github-runner-207 kernel: [47628.588810] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 18:37:34 juju-e4d256-prod-github-runner-207 kernel: [47628.590021] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 18:37:34 juju-e4d256-prod-github-runner-207 kernel: [47628.591195] Aug 22 18:37:34 juju-e4d256-prod-github-runner-207 kernel: [47628.592116] Aug 22 18:37:34 juju-e4d256-prod-github-runner-207 kernel: [47628.593020] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 18:37:34 juju-e4d256-prod-github-runner-207 kernel: [47628.594177] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:37:34 juju-e4d256-prod-github-runner-207 kernel: [47628.595384] ? _raw_spin_lock+0x22/0x30 Aug 22 18:37:34 juju-e4d256-prod-github-runner-207 kernel: [47628.596484] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:37:34 juju-e4d256-prod-github-runner-207 kernel: [47628.597637] direct_page_fault+0x206/0x310 [kvm] Aug 22 18:37:34 juju-e4d256-prod-github-runner-207 kernel: [47628.598843] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 18:37:34 juju-e4d256-prod-github-runner-207 kernel: [47628.599886] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 18:37:34 juju-e4d256-prod-github-runner-207 kernel: [47628.600932] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 18:37:34 juju-e4d256-prod-github-runner-207 kernel: [47628.602019] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 18:37:34 juju-e4d256-prod-github-runner-207 kernel: [47628.603020] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 18:37:34 juju-e4d256-prod-github-runner-207 kernel: [47628.604058] handle_exit+0x98/0x230 [kvm_amd] Aug 22 18:37:34 juju-e4d256-prod-github-runner-207 kernel: [47628.605018] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 18:37:34 juju-e4d256-prod-github-runner-207 kernel: [47628.605968] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 18:37:34 juju-e4d256-prod-github-runner-207 kernel: [47628.606891] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 18:37:34 juju-e4d256-prod-github-runner-207 kernel: [47628.607853] vcpu_run+0x62/0x2c0 [kvm] Aug 22 18:37:34 juju-e4d256-prod-github-runner-207 kernel: [47628.608701] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 18:37:34 juju-e4d256-prod-github-runner-207 kernel: [47628.609510] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 18:37:34 juju-e4d256-prod-github-runner-207 kernel: [47628.610377] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 18:37:34 juju-e4d256-prod-github-runner-207 kernel: [47628.611208] ? __seccomp_filter+0x4a/0x4a0 Aug 22 18:37:34 juju-e4d256-prod-github-runner-207 kernel: [47628.612062] ? __fget_files+0x86/0xc0 Aug 22 18:37:34 juju-e4d256-prod-github-runner-207 kernel: [47628.612901] __x64_sys_ioctl+0x95/0xd0 Aug 22 18:37:34 juju-e4d256-prod-github-runner-207 kernel: [47628.613682] do_syscall_64+0x5c/0xc0 Aug 22 18:37:34 juju-e4d256-prod-github-runner-207 kernel: [47628.614459] ? do_futex+0x162/0x1f0 Aug 22 18:37:34 juju-e4d256-prod-github-runner-207 kernel: [47628.615199] ? __x64_sys_futex+0x78/0x1e0 Aug 22 18:37:34 juju-e4d256-prod-github-runner-207 kernel: [47628.616032] ? __secure_computing+0xa9/0x120 Aug 22 18:37:34 juju-e4d256-prod-github-runner-207 kernel: [47628.616866] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 18:37:34 juju-e4d256-prod-github-runner-207 kernel: [47628.617766] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:37:34 juju-e4d256-prod-github-runner-207 kernel: [47628.618601] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:37:34 juju-e4d256-prod-github-runner-207 kernel: [47628.619453] ? do_syscall_64+0x69/0xc0 Aug 22 18:37:34 juju-e4d256-prod-github-runner-207 kernel: [47628.620177] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:37:34 juju-e4d256-prod-github-runner-207 kernel: [47628.621000] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:37:34 juju-e4d256-prod-github-runner-207 kernel: [47628.621732] ? do_syscall_64+0x69/0xc0 Aug 22 18:37:34 juju-e4d256-prod-github-runner-207 kernel: [47628.622451] ? do_syscall_64+0x69/0xc0 Aug 22 18:37:34 juju-e4d256-prod-github-runner-207 kernel: [47628.623239] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 18:37:34 juju-e4d256-prod-github-runner-207 kernel: [47628.624079] RIP: 0033:0x7faa5d0edaff Aug 22 18:37:34 juju-e4d256-prod-github-runner-207 kernel: [47628.624821] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 18:37:34 juju-e4d256-prod-github-runner-207 kernel: [47628.627263] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 18:37:34 juju-e4d256-prod-github-runner-207 kernel: [47628.628375] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 18:37:34 juju-e4d256-prod-github-runner-207 kernel: [47628.629438] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 18:37:34 juju-e4d256-prod-github-runner-207 kernel: [47628.630465] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 18:37:34 juju-e4d256-prod-github-runner-207 kernel: [47628.631569] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 18:37:34 juju-e4d256-prod-github-runner-207 kernel: [47628.632625] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 18:37:34 juju-e4d256-prod-github-runner-207 kernel: [47628.633669] Aug 22 18:38:02 juju-e4d256-prod-github-runner-207 kernel: [47656.541985] watchdog: BUG: soft lockup - CPU#1 stuck for 44275s! [qemu-system-x86:6715] Aug 22 18:38:02 juju-e4d256-prod-github-runner-207 kernel: [47656.544018] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 18:38:02 juju-e4d256-prod-github-runner-207 kernel: [47656.544122] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 18:38:02 juju-e4d256-prod-github-runner-207 kernel: [47656.559870] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 18:38:02 juju-e4d256-prod-github-runner-207 kernel: [47656.561672] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 18:38:02 juju-e4d256-prod-github-runner-207 kernel: [47656.563451] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:38:02 juju-e4d256-prod-github-runner-207 kernel: [47656.564920] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 18:38:02 juju-e4d256-prod-github-runner-207 kernel: [47656.568887] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 18:38:02 juju-e4d256-prod-github-runner-207 kernel: [47656.570485] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 18:38:02 juju-e4d256-prod-github-runner-207 kernel: [47656.572205] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 18:38:02 juju-e4d256-prod-github-runner-207 kernel: [47656.573869] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 18:38:02 juju-e4d256-prod-github-runner-207 kernel: [47656.575580] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 18:38:02 juju-e4d256-prod-github-runner-207 kernel: [47656.577305] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 18:38:02 juju-e4d256-prod-github-runner-207 kernel: [47656.579004] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 18:38:02 juju-e4d256-prod-github-runner-207 kernel: [47656.580828] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 18:38:02 juju-e4d256-prod-github-runner-207 kernel: [47656.582442] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 18:38:02 juju-e4d256-prod-github-runner-207 kernel: [47656.584173] Call Trace: Aug 22 18:38:02 juju-e4d256-prod-github-runner-207 kernel: [47656.585516] Aug 22 18:38:02 juju-e4d256-prod-github-runner-207 kernel: [47656.586827] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:38:02 juju-e4d256-prod-github-runner-207 kernel: [47656.588336] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:38:02 juju-e4d256-prod-github-runner-207 kernel: [47656.589828] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:38:02 juju-e4d256-prod-github-runner-207 kernel: [47656.591418] ? show_regs.part.0+0x23/0x29 Aug 22 18:38:02 juju-e4d256-prod-github-runner-207 kernel: [47656.592879] ? show_regs.cold+0x8/0xd Aug 22 18:38:02 juju-e4d256-prod-github-runner-207 kernel: [47656.594330] ? watchdog_timer_fn+0x1be/0x220 Aug 22 18:38:02 juju-e4d256-prod-github-runner-207 kernel: [47656.595866] ? lockup_detector_update_enable+0x60/0x60 Aug 22 18:38:02 juju-e4d256-prod-github-runner-207 kernel: [47656.597442] ? __hrtimer_run_queues+0x107/0x230 Aug 22 18:38:02 juju-e4d256-prod-github-runner-207 kernel: [47656.599013] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 18:38:02 juju-e4d256-prod-github-runner-207 kernel: [47656.600498] ? hrtimer_interrupt+0x101/0x220 Aug 22 18:38:02 juju-e4d256-prod-github-runner-207 kernel: [47656.601991] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 18:38:02 juju-e4d256-prod-github-runner-207 kernel: [47656.603605] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 18:38:02 juju-e4d256-prod-github-runner-207 kernel: [47656.605154] Aug 22 18:38:02 juju-e4d256-prod-github-runner-207 kernel: [47656.606409] Aug 22 18:38:02 juju-e4d256-prod-github-runner-207 kernel: [47656.607652] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 18:38:02 juju-e4d256-prod-github-runner-207 kernel: [47656.609220] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:38:02 juju-e4d256-prod-github-runner-207 kernel: [47656.610694] ? _raw_spin_lock+0x22/0x30 Aug 22 18:38:02 juju-e4d256-prod-github-runner-207 kernel: [47656.612052] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:38:02 juju-e4d256-prod-github-runner-207 kernel: [47656.613411] direct_page_fault+0x206/0x310 [kvm] Aug 22 18:38:02 juju-e4d256-prod-github-runner-207 kernel: [47656.615018] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 18:38:02 juju-e4d256-prod-github-runner-207 kernel: [47656.616599] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 18:38:02 juju-e4d256-prod-github-runner-207 kernel: [47656.618158] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 18:38:02 juju-e4d256-prod-github-runner-207 kernel: [47656.619673] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 18:38:02 juju-e4d256-prod-github-runner-207 kernel: [47656.621173] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 18:38:02 juju-e4d256-prod-github-runner-207 kernel: [47656.622686] handle_exit+0x98/0x230 [kvm_amd] Aug 22 18:38:02 juju-e4d256-prod-github-runner-207 kernel: [47656.624096] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 18:38:02 juju-e4d256-prod-github-runner-207 kernel: [47656.625522] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 18:38:02 juju-e4d256-prod-github-runner-207 kernel: [47656.626986] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 18:38:02 juju-e4d256-prod-github-runner-207 kernel: [47656.628269] vcpu_run+0x62/0x2c0 [kvm] Aug 22 18:38:02 juju-e4d256-prod-github-runner-207 kernel: [47656.629461] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 18:38:02 juju-e4d256-prod-github-runner-207 kernel: [47656.630683] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 18:38:02 juju-e4d256-prod-github-runner-207 kernel: [47656.632028] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 18:38:02 juju-e4d256-prod-github-runner-207 kernel: [47656.633263] ? __seccomp_filter+0x4a/0x4a0 Aug 22 18:38:02 juju-e4d256-prod-github-runner-207 kernel: [47656.634375] ? __fget_files+0x86/0xc0 Aug 22 18:38:02 juju-e4d256-prod-github-runner-207 kernel: [47656.635403] __x64_sys_ioctl+0x95/0xd0 Aug 22 18:38:02 juju-e4d256-prod-github-runner-207 kernel: [47656.636465] do_syscall_64+0x5c/0xc0 Aug 22 18:38:02 juju-e4d256-prod-github-runner-207 kernel: [47656.637505] ? do_futex+0x162/0x1f0 Aug 22 18:38:02 juju-e4d256-prod-github-runner-207 kernel: [47656.638500] ? __x64_sys_futex+0x78/0x1e0 Aug 22 18:38:02 juju-e4d256-prod-github-runner-207 kernel: [47656.639548] ? __secure_computing+0xa9/0x120 Aug 22 18:38:02 juju-e4d256-prod-github-runner-207 kernel: [47656.640536] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 18:38:02 juju-e4d256-prod-github-runner-207 kernel: [47656.641635] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:38:02 juju-e4d256-prod-github-runner-207 kernel: [47656.642717] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:38:02 juju-e4d256-prod-github-runner-207 kernel: [47656.643798] ? do_syscall_64+0x69/0xc0 Aug 22 18:38:02 juju-e4d256-prod-github-runner-207 kernel: [47656.644783] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:38:02 juju-e4d256-prod-github-runner-207 kernel: [47656.645756] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:38:02 juju-e4d256-prod-github-runner-207 kernel: [47656.646772] ? do_syscall_64+0x69/0xc0 Aug 22 18:38:02 juju-e4d256-prod-github-runner-207 kernel: [47656.647686] ? do_syscall_64+0x69/0xc0 Aug 22 18:38:02 juju-e4d256-prod-github-runner-207 kernel: [47656.648594] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 18:38:02 juju-e4d256-prod-github-runner-207 kernel: [47656.649558] RIP: 0033:0x7faa5d0edaff Aug 22 18:38:02 juju-e4d256-prod-github-runner-207 kernel: [47656.650365] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 18:38:02 juju-e4d256-prod-github-runner-207 kernel: [47656.652935] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 18:38:02 juju-e4d256-prod-github-runner-207 kernel: [47656.654107] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 18:38:02 juju-e4d256-prod-github-runner-207 kernel: [47656.655371] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 18:38:02 juju-e4d256-prod-github-runner-207 kernel: [47656.656659] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 18:38:02 juju-e4d256-prod-github-runner-207 kernel: [47656.657892] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 18:38:02 juju-e4d256-prod-github-runner-207 kernel: [47656.659129] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 18:38:02 juju-e4d256-prod-github-runner-207 kernel: [47656.660377] Aug 22 18:38:30 juju-e4d256-prod-github-runner-207 kernel: [47684.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 44301s! [qemu-system-x86:6715] Aug 22 18:38:30 juju-e4d256-prod-github-runner-207 kernel: [47684.543933] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 18:38:30 juju-e4d256-prod-github-runner-207 kernel: [47684.544272] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 18:38:30 juju-e4d256-prod-github-runner-207 kernel: [47684.556723] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 18:38:30 juju-e4d256-prod-github-runner-207 kernel: [47684.558007] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 18:38:30 juju-e4d256-prod-github-runner-207 kernel: [47684.559262] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:38:30 juju-e4d256-prod-github-runner-207 kernel: [47684.560337] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 18:38:30 juju-e4d256-prod-github-runner-207 kernel: [47684.562957] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 18:38:30 juju-e4d256-prod-github-runner-207 kernel: [47684.564015] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 18:38:30 juju-e4d256-prod-github-runner-207 kernel: [47684.565187] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 18:38:30 juju-e4d256-prod-github-runner-207 kernel: [47684.566361] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 18:38:30 juju-e4d256-prod-github-runner-207 kernel: [47684.567542] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 18:38:30 juju-e4d256-prod-github-runner-207 kernel: [47684.568711] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 18:38:30 juju-e4d256-prod-github-runner-207 kernel: [47684.569892] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 18:38:30 juju-e4d256-prod-github-runner-207 kernel: [47684.571203] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 18:38:30 juju-e4d256-prod-github-runner-207 kernel: [47684.572321] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 18:38:30 juju-e4d256-prod-github-runner-207 kernel: [47684.573530] Call Trace: Aug 22 18:38:30 juju-e4d256-prod-github-runner-207 kernel: [47684.574446] Aug 22 18:38:30 juju-e4d256-prod-github-runner-207 kernel: [47684.575360] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:38:30 juju-e4d256-prod-github-runner-207 kernel: [47684.576391] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:38:30 juju-e4d256-prod-github-runner-207 kernel: [47684.577414] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:38:30 juju-e4d256-prod-github-runner-207 kernel: [47684.578528] ? show_regs.part.0+0x23/0x29 Aug 22 18:38:30 juju-e4d256-prod-github-runner-207 kernel: [47684.579524] ? show_regs.cold+0x8/0xd Aug 22 18:38:30 juju-e4d256-prod-github-runner-207 kernel: [47684.580496] ? watchdog_timer_fn+0x1be/0x220 Aug 22 18:38:30 juju-e4d256-prod-github-runner-207 kernel: [47684.581503] ? lockup_detector_update_enable+0x60/0x60 Aug 22 18:38:30 juju-e4d256-prod-github-runner-207 kernel: [47684.582585] ? __hrtimer_run_queues+0x107/0x230 Aug 22 18:38:30 juju-e4d256-prod-github-runner-207 kernel: [47684.583613] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 18:38:30 juju-e4d256-prod-github-runner-207 kernel: [47684.584637] ? hrtimer_interrupt+0x101/0x220 Aug 22 18:38:30 juju-e4d256-prod-github-runner-207 kernel: [47684.585653] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 18:38:30 juju-e4d256-prod-github-runner-207 kernel: [47684.586731] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 18:38:30 juju-e4d256-prod-github-runner-207 kernel: [47684.587777] Aug 22 18:38:30 juju-e4d256-prod-github-runner-207 kernel: [47684.588634] Aug 22 18:38:30 juju-e4d256-prod-github-runner-207 kernel: [47684.589494] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 18:38:30 juju-e4d256-prod-github-runner-207 kernel: [47684.590576] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:38:30 juju-e4d256-prod-github-runner-207 kernel: [47684.591628] ? _raw_spin_lock+0x22/0x30 Aug 22 18:38:30 juju-e4d256-prod-github-runner-207 kernel: [47684.592591] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:38:30 juju-e4d256-prod-github-runner-207 kernel: [47684.593608] direct_page_fault+0x206/0x310 [kvm] Aug 22 18:38:30 juju-e4d256-prod-github-runner-207 kernel: [47684.594711] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 18:38:30 juju-e4d256-prod-github-runner-207 kernel: [47684.595761] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 18:38:30 juju-e4d256-prod-github-runner-207 kernel: [47684.596761] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 18:38:30 juju-e4d256-prod-github-runner-207 kernel: [47684.597755] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 18:38:30 juju-e4d256-prod-github-runner-207 kernel: [47684.598768] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 18:38:30 juju-e4d256-prod-github-runner-207 kernel: [47684.599783] handle_exit+0x98/0x230 [kvm_amd] Aug 22 18:38:30 juju-e4d256-prod-github-runner-207 kernel: [47684.600680] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 18:38:30 juju-e4d256-prod-github-runner-207 kernel: [47684.601620] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 18:38:30 juju-e4d256-prod-github-runner-207 kernel: [47684.602622] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 18:38:30 juju-e4d256-prod-github-runner-207 kernel: [47684.603531] vcpu_run+0x62/0x2c0 [kvm] Aug 22 18:38:30 juju-e4d256-prod-github-runner-207 kernel: [47684.604345] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 18:38:30 juju-e4d256-prod-github-runner-207 kernel: [47684.605168] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 18:38:30 juju-e4d256-prod-github-runner-207 kernel: [47684.606057] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 18:38:30 juju-e4d256-prod-github-runner-207 kernel: [47684.606899] ? __seccomp_filter+0x4a/0x4a0 Aug 22 18:38:30 juju-e4d256-prod-github-runner-207 kernel: [47684.607678] ? __fget_files+0x86/0xc0 Aug 22 18:38:30 juju-e4d256-prod-github-runner-207 kernel: [47684.608387] __x64_sys_ioctl+0x95/0xd0 Aug 22 18:38:30 juju-e4d256-prod-github-runner-207 kernel: [47684.609077] do_syscall_64+0x5c/0xc0 Aug 22 18:38:30 juju-e4d256-prod-github-runner-207 kernel: [47684.609741] ? do_futex+0x162/0x1f0 Aug 22 18:38:30 juju-e4d256-prod-github-runner-207 kernel: [47684.610399] ? __x64_sys_futex+0x78/0x1e0 Aug 22 18:38:30 juju-e4d256-prod-github-runner-207 kernel: [47684.611098] ? __secure_computing+0xa9/0x120 Aug 22 18:38:30 juju-e4d256-prod-github-runner-207 kernel: [47684.612038] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 18:38:30 juju-e4d256-prod-github-runner-207 kernel: [47684.612796] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:38:30 juju-e4d256-prod-github-runner-207 kernel: [47684.613527] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:38:30 juju-e4d256-prod-github-runner-207 kernel: [47684.614247] ? do_syscall_64+0x69/0xc0 Aug 22 18:38:30 juju-e4d256-prod-github-runner-207 kernel: [47684.614900] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:38:30 juju-e4d256-prod-github-runner-207 kernel: [47684.615600] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:38:30 juju-e4d256-prod-github-runner-207 kernel: [47684.616292] ? do_syscall_64+0x69/0xc0 Aug 22 18:38:30 juju-e4d256-prod-github-runner-207 kernel: [47684.616912] ? do_syscall_64+0x69/0xc0 Aug 22 18:38:30 juju-e4d256-prod-github-runner-207 kernel: [47684.617535] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 18:38:30 juju-e4d256-prod-github-runner-207 kernel: [47684.618272] RIP: 0033:0x7faa5d0edaff Aug 22 18:38:30 juju-e4d256-prod-github-runner-207 kernel: [47684.618964] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 18:38:30 juju-e4d256-prod-github-runner-207 kernel: [47684.620982] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 18:38:30 juju-e4d256-prod-github-runner-207 kernel: [47684.621899] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 18:38:30 juju-e4d256-prod-github-runner-207 kernel: [47684.622921] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 18:38:30 juju-e4d256-prod-github-runner-207 kernel: [47684.623855] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 18:38:30 juju-e4d256-prod-github-runner-207 kernel: [47684.624762] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 18:38:30 juju-e4d256-prod-github-runner-207 kernel: [47684.625645] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 18:38:30 juju-e4d256-prod-github-runner-207 kernel: [47684.626552] Aug 22 18:38:46 juju-e4d256-prod-github-runner-207 kernel: [47700.368708] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 18:38:46 juju-e4d256-prod-github-runner-207 kernel: [47700.370603] rcu: 1-....: (11858388 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=5735490 Aug 22 18:38:46 juju-e4d256-prod-github-runner-207 kernel: [47700.371743] (t=11895792 jiffies g=23269 q=46104) Aug 22 18:38:46 juju-e4d256-prod-github-runner-207 kernel: [47700.372531] NMI backtrace for cpu 1 Aug 22 18:38:46 juju-e4d256-prod-github-runner-207 kernel: [47700.373241] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 18:38:46 juju-e4d256-prod-github-runner-207 kernel: [47700.374419] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 18:38:46 juju-e4d256-prod-github-runner-207 kernel: [47700.375499] Call Trace: Aug 22 18:38:46 juju-e4d256-prod-github-runner-207 kernel: [47700.376171] Aug 22 18:38:46 juju-e4d256-prod-github-runner-207 kernel: [47700.376849] show_stack+0x52/0x5c Aug 22 18:38:46 juju-e4d256-prod-github-runner-207 kernel: [47700.377573] dump_stack_lvl+0x4a/0x63 Aug 22 18:38:46 juju-e4d256-prod-github-runner-207 kernel: [47700.378329] dump_stack+0x10/0x16 Aug 22 18:38:46 juju-e4d256-prod-github-runner-207 kernel: [47700.379077] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 18:38:46 juju-e4d256-prod-github-runner-207 kernel: [47700.379865] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 18:38:46 juju-e4d256-prod-github-runner-207 kernel: [47700.380666] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 18:38:46 juju-e4d256-prod-github-runner-207 kernel: [47700.381488] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 18:38:46 juju-e4d256-prod-github-runner-207 kernel: [47700.382326] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 18:38:46 juju-e4d256-prod-github-runner-207 kernel: [47700.383134] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 18:38:46 juju-e4d256-prod-github-runner-207 kernel: [47700.384062] print_cpu_stall.cold+0x2f/0xe2 Aug 22 18:38:46 juju-e4d256-prod-github-runner-207 kernel: [47700.384868] ? timekeeping_update+0xf7/0x150 Aug 22 18:38:46 juju-e4d256-prod-github-runner-207 kernel: [47700.385771] check_cpu_stall+0x109/0x270 Aug 22 18:38:46 juju-e4d256-prod-github-runner-207 kernel: [47700.386558] rcu_sched_clock_irq+0x9a/0x250 Aug 22 18:38:46 juju-e4d256-prod-github-runner-207 kernel: [47700.387347] update_process_times+0x94/0xd0 Aug 22 18:38:46 juju-e4d256-prod-github-runner-207 kernel: [47700.388109] tick_sched_handle+0x29/0x70 Aug 22 18:38:46 juju-e4d256-prod-github-runner-207 kernel: [47700.388866] tick_sched_timer+0x8c/0xc0 Aug 22 18:38:46 juju-e4d256-prod-github-runner-207 kernel: [47700.389610] ? tick_nohz_handler+0xb0/0xb0 Aug 22 18:38:46 juju-e4d256-prod-github-runner-207 kernel: [47700.390385] __hrtimer_run_queues+0x107/0x230 Aug 22 18:38:46 juju-e4d256-prod-github-runner-207 kernel: [47700.391288] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 18:38:46 juju-e4d256-prod-github-runner-207 kernel: [47700.392076] hrtimer_interrupt+0x101/0x220 Aug 22 18:38:46 juju-e4d256-prod-github-runner-207 kernel: [47700.392834] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 18:38:46 juju-e4d256-prod-github-runner-207 kernel: [47700.393650] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 18:38:46 juju-e4d256-prod-github-runner-207 kernel: [47700.394476] Aug 22 18:38:46 juju-e4d256-prod-github-runner-207 kernel: [47700.395112] Aug 22 18:38:46 juju-e4d256-prod-github-runner-207 kernel: [47700.395744] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 18:38:46 juju-e4d256-prod-github-runner-207 kernel: [47700.396562] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:38:46 juju-e4d256-prod-github-runner-207 kernel: [47700.397450] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 18:38:46 juju-e4d256-prod-github-runner-207 kernel: [47700.399675] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 18:38:46 juju-e4d256-prod-github-runner-207 kernel: [47700.400548] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 18:38:46 juju-e4d256-prod-github-runner-207 kernel: [47700.401545] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 18:38:46 juju-e4d256-prod-github-runner-207 kernel: [47700.402535] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 18:38:46 juju-e4d256-prod-github-runner-207 kernel: [47700.403501] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 18:38:46 juju-e4d256-prod-github-runner-207 kernel: [47700.404457] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 18:38:46 juju-e4d256-prod-github-runner-207 kernel: [47700.405419] ? _raw_spin_lock+0x22/0x30 Aug 22 18:38:46 juju-e4d256-prod-github-runner-207 kernel: [47700.406218] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:38:46 juju-e4d256-prod-github-runner-207 kernel: [47700.407138] direct_page_fault+0x206/0x310 [kvm] Aug 22 18:38:46 juju-e4d256-prod-github-runner-207 kernel: [47700.407984] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 18:38:46 juju-e4d256-prod-github-runner-207 kernel: [47700.408815] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 18:38:46 juju-e4d256-prod-github-runner-207 kernel: [47700.409676] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 18:38:46 juju-e4d256-prod-github-runner-207 kernel: [47700.410606] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 18:38:46 juju-e4d256-prod-github-runner-207 kernel: [47700.411403] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 18:38:46 juju-e4d256-prod-github-runner-207 kernel: [47700.412246] handle_exit+0x98/0x230 [kvm_amd] Aug 22 18:38:46 juju-e4d256-prod-github-runner-207 kernel: [47700.413005] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 18:38:46 juju-e4d256-prod-github-runner-207 kernel: [47700.413891] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 18:38:46 juju-e4d256-prod-github-runner-207 kernel: [47700.414800] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 18:38:46 juju-e4d256-prod-github-runner-207 kernel: [47700.415595] vcpu_run+0x62/0x2c0 [kvm] Aug 22 18:38:46 juju-e4d256-prod-github-runner-207 kernel: [47700.416312] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 18:38:46 juju-e4d256-prod-github-runner-207 kernel: [47700.417062] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 18:38:46 juju-e4d256-prod-github-runner-207 kernel: [47700.417864] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 18:38:46 juju-e4d256-prod-github-runner-207 kernel: [47700.418651] ? __seccomp_filter+0x4a/0x4a0 Aug 22 18:38:46 juju-e4d256-prod-github-runner-207 kernel: [47700.419390] ? __fget_files+0x86/0xc0 Aug 22 18:38:46 juju-e4d256-prod-github-runner-207 kernel: [47700.420096] __x64_sys_ioctl+0x95/0xd0 Aug 22 18:38:46 juju-e4d256-prod-github-runner-207 kernel: [47700.420946] do_syscall_64+0x5c/0xc0 Aug 22 18:38:46 juju-e4d256-prod-github-runner-207 kernel: [47700.421961] ? do_futex+0x162/0x1f0 Aug 22 18:38:46 juju-e4d256-prod-github-runner-207 kernel: [47700.422822] ? __x64_sys_futex+0x78/0x1e0 Aug 22 18:38:46 juju-e4d256-prod-github-runner-207 kernel: [47700.423551] ? __secure_computing+0xa9/0x120 Aug 22 18:38:46 juju-e4d256-prod-github-runner-207 kernel: [47700.424283] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 18:38:46 juju-e4d256-prod-github-runner-207 kernel: [47700.425071] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:38:46 juju-e4d256-prod-github-runner-207 kernel: [47700.425826] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:38:46 juju-e4d256-prod-github-runner-207 kernel: [47700.426606] ? do_syscall_64+0x69/0xc0 Aug 22 18:38:46 juju-e4d256-prod-github-runner-207 kernel: [47700.427299] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:38:46 juju-e4d256-prod-github-runner-207 kernel: [47700.428053] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:38:46 juju-e4d256-prod-github-runner-207 kernel: [47700.428812] ? do_syscall_64+0x69/0xc0 Aug 22 18:38:46 juju-e4d256-prod-github-runner-207 kernel: [47700.429504] ? do_syscall_64+0x69/0xc0 Aug 22 18:38:46 juju-e4d256-prod-github-runner-207 kernel: [47700.430196] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 18:38:46 juju-e4d256-prod-github-runner-207 kernel: [47700.431009] RIP: 0033:0x7faa5d0edaff Aug 22 18:38:46 juju-e4d256-prod-github-runner-207 kernel: [47700.431752] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 18:38:46 juju-e4d256-prod-github-runner-207 kernel: [47700.433859] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 18:38:46 juju-e4d256-prod-github-runner-207 kernel: [47700.434846] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 18:38:46 juju-e4d256-prod-github-runner-207 kernel: [47700.435791] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 18:38:46 juju-e4d256-prod-github-runner-207 kernel: [47700.436785] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 18:38:46 juju-e4d256-prod-github-runner-207 kernel: [47700.437742] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 18:38:46 juju-e4d256-prod-github-runner-207 kernel: [47700.438868] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 18:38:46 juju-e4d256-prod-github-runner-207 kernel: [47700.439921] Aug 22 18:39:10 juju-e4d256-prod-github-runner-207 kernel: [47724.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 44338s! [qemu-system-x86:6715] Aug 22 18:39:10 juju-e4d256-prod-github-runner-207 kernel: [47724.543788] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 18:39:10 juju-e4d256-prod-github-runner-207 kernel: [47724.544050] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 18:39:10 juju-e4d256-prod-github-runner-207 kernel: [47724.556289] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 18:39:10 juju-e4d256-prod-github-runner-207 kernel: [47724.557561] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 18:39:10 juju-e4d256-prod-github-runner-207 kernel: [47724.558804] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:39:10 juju-e4d256-prod-github-runner-207 kernel: [47724.559863] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 18:39:10 juju-e4d256-prod-github-runner-207 kernel: [47724.562452] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 18:39:10 juju-e4d256-prod-github-runner-207 kernel: [47724.563515] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 18:39:10 juju-e4d256-prod-github-runner-207 kernel: [47724.564679] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 18:39:10 juju-e4d256-prod-github-runner-207 kernel: [47724.565842] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 18:39:10 juju-e4d256-prod-github-runner-207 kernel: [47724.567026] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 18:39:10 juju-e4d256-prod-github-runner-207 kernel: [47724.568193] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 18:39:10 juju-e4d256-prod-github-runner-207 kernel: [47724.569358] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 18:39:10 juju-e4d256-prod-github-runner-207 kernel: [47724.570607] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 18:39:10 juju-e4d256-prod-github-runner-207 kernel: [47724.571710] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 18:39:10 juju-e4d256-prod-github-runner-207 kernel: [47724.572919] Call Trace: Aug 22 18:39:10 juju-e4d256-prod-github-runner-207 kernel: [47724.574057] Aug 22 18:39:10 juju-e4d256-prod-github-runner-207 kernel: [47724.574952] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:39:10 juju-e4d256-prod-github-runner-207 kernel: [47724.575988] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:39:10 juju-e4d256-prod-github-runner-207 kernel: [47724.577208] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:39:10 juju-e4d256-prod-github-runner-207 kernel: [47724.578385] ? show_regs.part.0+0x23/0x29 Aug 22 18:39:10 juju-e4d256-prod-github-runner-207 kernel: [47724.579577] ? show_regs.cold+0x8/0xd Aug 22 18:39:10 juju-e4d256-prod-github-runner-207 kernel: [47724.580555] ? watchdog_timer_fn+0x1be/0x220 Aug 22 18:39:10 juju-e4d256-prod-github-runner-207 kernel: [47724.581565] ? lockup_detector_update_enable+0x60/0x60 Aug 22 18:39:10 juju-e4d256-prod-github-runner-207 kernel: [47724.582654] ? __hrtimer_run_queues+0x107/0x230 Aug 22 18:39:10 juju-e4d256-prod-github-runner-207 kernel: [47724.583878] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 18:39:10 juju-e4d256-prod-github-runner-207 kernel: [47724.585039] ? hrtimer_interrupt+0x101/0x220 Aug 22 18:39:10 juju-e4d256-prod-github-runner-207 kernel: [47724.586064] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 18:39:10 juju-e4d256-prod-github-runner-207 kernel: [47724.587134] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 18:39:10 juju-e4d256-prod-github-runner-207 kernel: [47724.588179] Aug 22 18:39:10 juju-e4d256-prod-github-runner-207 kernel: [47724.589032] Aug 22 18:39:10 juju-e4d256-prod-github-runner-207 kernel: [47724.589883] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 18:39:10 juju-e4d256-prod-github-runner-207 kernel: [47724.591117] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:39:10 juju-e4d256-prod-github-runner-207 kernel: [47724.592283] ? _raw_spin_lock+0x22/0x30 Aug 22 18:39:10 juju-e4d256-prod-github-runner-207 kernel: [47724.593333] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:39:10 juju-e4d256-prod-github-runner-207 kernel: [47724.594475] direct_page_fault+0x206/0x310 [kvm] Aug 22 18:39:10 juju-e4d256-prod-github-runner-207 kernel: [47724.595596] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 18:39:10 juju-e4d256-prod-github-runner-207 kernel: [47724.596698] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 18:39:10 juju-e4d256-prod-github-runner-207 kernel: [47724.597815] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 18:39:10 juju-e4d256-prod-github-runner-207 kernel: [47724.598960] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 18:39:10 juju-e4d256-prod-github-runner-207 kernel: [47724.600023] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 18:39:10 juju-e4d256-prod-github-runner-207 kernel: [47724.601118] handle_exit+0x98/0x230 [kvm_amd] Aug 22 18:39:10 juju-e4d256-prod-github-runner-207 kernel: [47724.602129] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 18:39:10 juju-e4d256-prod-github-runner-207 kernel: [47724.603150] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 18:39:10 juju-e4d256-prod-github-runner-207 kernel: [47724.604185] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 18:39:10 juju-e4d256-prod-github-runner-207 kernel: [47724.605203] vcpu_run+0x62/0x2c0 [kvm] Aug 22 18:39:10 juju-e4d256-prod-github-runner-207 kernel: [47724.606115] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 18:39:10 juju-e4d256-prod-github-runner-207 kernel: [47724.607018] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 18:39:10 juju-e4d256-prod-github-runner-207 kernel: [47724.607974] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 18:39:10 juju-e4d256-prod-github-runner-207 kernel: [47724.608867] ? __seccomp_filter+0x4a/0x4a0 Aug 22 18:39:10 juju-e4d256-prod-github-runner-207 kernel: [47724.609699] ? __fget_files+0x86/0xc0 Aug 22 18:39:10 juju-e4d256-prod-github-runner-207 kernel: [47724.610518] __x64_sys_ioctl+0x95/0xd0 Aug 22 18:39:10 juju-e4d256-prod-github-runner-207 kernel: [47724.611296] do_syscall_64+0x5c/0xc0 Aug 22 18:39:10 juju-e4d256-prod-github-runner-207 kernel: [47724.612040] ? do_futex+0x162/0x1f0 Aug 22 18:39:10 juju-e4d256-prod-github-runner-207 kernel: [47724.612769] ? __x64_sys_futex+0x78/0x1e0 Aug 22 18:39:10 juju-e4d256-prod-github-runner-207 kernel: [47724.613525] ? __secure_computing+0xa9/0x120 Aug 22 18:39:10 juju-e4d256-prod-github-runner-207 kernel: [47724.614331] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 18:39:10 juju-e4d256-prod-github-runner-207 kernel: [47724.615219] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:39:10 juju-e4d256-prod-github-runner-207 kernel: [47724.616040] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:39:10 juju-e4d256-prod-github-runner-207 kernel: [47724.616855] ? do_syscall_64+0x69/0xc0 Aug 22 18:39:10 juju-e4d256-prod-github-runner-207 kernel: [47724.617586] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:39:10 juju-e4d256-prod-github-runner-207 kernel: [47724.618406] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:39:10 juju-e4d256-prod-github-runner-207 kernel: [47724.619203] ? do_syscall_64+0x69/0xc0 Aug 22 18:39:10 juju-e4d256-prod-github-runner-207 kernel: [47724.619911] ? do_syscall_64+0x69/0xc0 Aug 22 18:39:10 juju-e4d256-prod-github-runner-207 kernel: [47724.620618] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 18:39:10 juju-e4d256-prod-github-runner-207 kernel: [47724.621430] RIP: 0033:0x7faa5d0edaff Aug 22 18:39:10 juju-e4d256-prod-github-runner-207 kernel: [47724.622191] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 18:39:10 juju-e4d256-prod-github-runner-207 kernel: [47724.624544] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 18:39:10 juju-e4d256-prod-github-runner-207 kernel: [47724.625615] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 18:39:10 juju-e4d256-prod-github-runner-207 kernel: [47724.626671] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 18:39:10 juju-e4d256-prod-github-runner-207 kernel: [47724.627699] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 18:39:10 juju-e4d256-prod-github-runner-207 kernel: [47724.628728] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 18:39:10 juju-e4d256-prod-github-runner-207 kernel: [47724.629762] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 18:39:10 juju-e4d256-prod-github-runner-207 kernel: [47724.630819] Aug 22 18:39:38 juju-e4d256-prod-github-runner-207 kernel: [47752.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 44365s! [qemu-system-x86:6715] Aug 22 18:39:38 juju-e4d256-prod-github-runner-207 kernel: [47752.544205] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 18:39:38 juju-e4d256-prod-github-runner-207 kernel: [47752.544475] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 18:39:38 juju-e4d256-prod-github-runner-207 kernel: [47752.556817] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 18:39:38 juju-e4d256-prod-github-runner-207 kernel: [47752.558117] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 18:39:38 juju-e4d256-prod-github-runner-207 kernel: [47752.559384] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:39:38 juju-e4d256-prod-github-runner-207 kernel: [47752.560460] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 18:39:38 juju-e4d256-prod-github-runner-207 kernel: [47752.563052] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 18:39:38 juju-e4d256-prod-github-runner-207 kernel: [47752.564105] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 18:39:38 juju-e4d256-prod-github-runner-207 kernel: [47752.565282] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 18:39:38 juju-e4d256-prod-github-runner-207 kernel: [47752.566484] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 18:39:38 juju-e4d256-prod-github-runner-207 kernel: [47752.567841] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 18:39:38 juju-e4d256-prod-github-runner-207 kernel: [47752.569003] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 18:39:38 juju-e4d256-prod-github-runner-207 kernel: [47752.570205] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 18:39:38 juju-e4d256-prod-github-runner-207 kernel: [47752.571445] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 18:39:38 juju-e4d256-prod-github-runner-207 kernel: [47752.572546] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 18:39:38 juju-e4d256-prod-github-runner-207 kernel: [47752.573771] Call Trace: Aug 22 18:39:38 juju-e4d256-prod-github-runner-207 kernel: [47752.574690] Aug 22 18:39:38 juju-e4d256-prod-github-runner-207 kernel: [47752.575605] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:39:38 juju-e4d256-prod-github-runner-207 kernel: [47752.576655] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:39:38 juju-e4d256-prod-github-runner-207 kernel: [47752.577704] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:39:38 juju-e4d256-prod-github-runner-207 kernel: [47752.578809] ? show_regs.part.0+0x23/0x29 Aug 22 18:39:38 juju-e4d256-prod-github-runner-207 kernel: [47752.579810] ? show_regs.cold+0x8/0xd Aug 22 18:39:38 juju-e4d256-prod-github-runner-207 kernel: [47752.580784] ? watchdog_timer_fn+0x1be/0x220 Aug 22 18:39:38 juju-e4d256-prod-github-runner-207 kernel: [47752.581819] ? lockup_detector_update_enable+0x60/0x60 Aug 22 18:39:38 juju-e4d256-prod-github-runner-207 kernel: [47752.583085] ? __hrtimer_run_queues+0x107/0x230 Aug 22 18:39:38 juju-e4d256-prod-github-runner-207 kernel: [47752.584115] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 18:39:38 juju-e4d256-prod-github-runner-207 kernel: [47752.585141] ? hrtimer_interrupt+0x101/0x220 Aug 22 18:39:38 juju-e4d256-prod-github-runner-207 kernel: [47752.586190] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 18:39:38 juju-e4d256-prod-github-runner-207 kernel: [47752.587261] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 18:39:38 juju-e4d256-prod-github-runner-207 kernel: [47752.588319] Aug 22 18:39:38 juju-e4d256-prod-github-runner-207 kernel: [47752.589190] Aug 22 18:39:38 juju-e4d256-prod-github-runner-207 kernel: [47752.590053] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 18:39:38 juju-e4d256-prod-github-runner-207 kernel: [47752.591089] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:39:38 juju-e4d256-prod-github-runner-207 kernel: [47752.592133] ? _raw_spin_lock+0x22/0x30 Aug 22 18:39:38 juju-e4d256-prod-github-runner-207 kernel: [47752.593079] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:39:38 juju-e4d256-prod-github-runner-207 kernel: [47752.594175] direct_page_fault+0x206/0x310 [kvm] Aug 22 18:39:38 juju-e4d256-prod-github-runner-207 kernel: [47752.595215] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 18:39:38 juju-e4d256-prod-github-runner-207 kernel: [47752.596228] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 18:39:38 juju-e4d256-prod-github-runner-207 kernel: [47752.597233] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 18:39:38 juju-e4d256-prod-github-runner-207 kernel: [47752.598303] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 18:39:38 juju-e4d256-prod-github-runner-207 kernel: [47752.599254] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 18:39:38 juju-e4d256-prod-github-runner-207 kernel: [47752.600239] handle_exit+0x98/0x230 [kvm_amd] Aug 22 18:39:38 juju-e4d256-prod-github-runner-207 kernel: [47752.601135] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 18:39:38 juju-e4d256-prod-github-runner-207 kernel: [47752.602088] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 18:39:38 juju-e4d256-prod-github-runner-207 kernel: [47752.603019] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 18:39:38 juju-e4d256-prod-github-runner-207 kernel: [47752.603928] vcpu_run+0x62/0x2c0 [kvm] Aug 22 18:39:38 juju-e4d256-prod-github-runner-207 kernel: [47752.604742] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 18:39:38 juju-e4d256-prod-github-runner-207 kernel: [47752.605550] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 18:39:38 juju-e4d256-prod-github-runner-207 kernel: [47752.606433] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 18:39:38 juju-e4d256-prod-github-runner-207 kernel: [47752.607309] ? __seccomp_filter+0x4a/0x4a0 Aug 22 18:39:38 juju-e4d256-prod-github-runner-207 kernel: [47752.608060] ? __fget_files+0x86/0xc0 Aug 22 18:39:38 juju-e4d256-prod-github-runner-207 kernel: [47752.608769] __x64_sys_ioctl+0x95/0xd0 Aug 22 18:39:38 juju-e4d256-prod-github-runner-207 kernel: [47752.609464] do_syscall_64+0x5c/0xc0 Aug 22 18:39:38 juju-e4d256-prod-github-runner-207 kernel: [47752.610174] ? do_futex+0x162/0x1f0 Aug 22 18:39:38 juju-e4d256-prod-github-runner-207 kernel: [47752.610826] ? __x64_sys_futex+0x78/0x1e0 Aug 22 18:39:38 juju-e4d256-prod-github-runner-207 kernel: [47752.611506] ? __secure_computing+0xa9/0x120 Aug 22 18:39:38 juju-e4d256-prod-github-runner-207 kernel: [47752.612199] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 18:39:38 juju-e4d256-prod-github-runner-207 kernel: [47752.612977] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:39:38 juju-e4d256-prod-github-runner-207 kernel: [47752.613729] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:39:38 juju-e4d256-prod-github-runner-207 kernel: [47752.614453] ? do_syscall_64+0x69/0xc0 Aug 22 18:39:38 juju-e4d256-prod-github-runner-207 kernel: [47752.615101] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:39:38 juju-e4d256-prod-github-runner-207 kernel: [47752.615810] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:39:38 juju-e4d256-prod-github-runner-207 kernel: [47752.616509] ? do_syscall_64+0x69/0xc0 Aug 22 18:39:38 juju-e4d256-prod-github-runner-207 kernel: [47752.617140] ? do_syscall_64+0x69/0xc0 Aug 22 18:39:38 juju-e4d256-prod-github-runner-207 kernel: [47752.617785] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 18:39:38 juju-e4d256-prod-github-runner-207 kernel: [47752.618512] RIP: 0033:0x7faa5d0edaff Aug 22 18:39:38 juju-e4d256-prod-github-runner-207 kernel: [47752.619619] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 18:39:38 juju-e4d256-prod-github-runner-207 kernel: [47752.621666] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 18:39:38 juju-e4d256-prod-github-runner-207 kernel: [47752.622585] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 18:39:38 juju-e4d256-prod-github-runner-207 kernel: [47752.623484] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 18:39:38 juju-e4d256-prod-github-runner-207 kernel: [47752.624383] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 18:39:38 juju-e4d256-prod-github-runner-207 kernel: [47752.625293] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 18:39:38 juju-e4d256-prod-github-runner-207 kernel: [47752.626225] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 18:39:38 juju-e4d256-prod-github-runner-207 kernel: [47752.627129] Aug 22 18:40:06 juju-e4d256-prod-github-runner-207 kernel: [47780.541980] watchdog: BUG: soft lockup - CPU#1 stuck for 44391s! [qemu-system-x86:6715] Aug 22 18:40:06 juju-e4d256-prod-github-runner-207 kernel: [47780.543945] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 18:40:06 juju-e4d256-prod-github-runner-207 kernel: [47780.544217] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 18:40:06 juju-e4d256-prod-github-runner-207 kernel: [47780.556881] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 18:40:06 juju-e4d256-prod-github-runner-207 kernel: [47780.558161] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 18:40:06 juju-e4d256-prod-github-runner-207 kernel: [47780.559375] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:40:06 juju-e4d256-prod-github-runner-207 kernel: [47780.560450] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 18:40:06 juju-e4d256-prod-github-runner-207 kernel: [47780.563112] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 18:40:06 juju-e4d256-prod-github-runner-207 kernel: [47780.564218] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 18:40:06 juju-e4d256-prod-github-runner-207 kernel: [47780.565539] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 18:40:06 juju-e4d256-prod-github-runner-207 kernel: [47780.566788] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 18:40:06 juju-e4d256-prod-github-runner-207 kernel: [47780.568007] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 18:40:06 juju-e4d256-prod-github-runner-207 kernel: [47780.569267] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 18:40:06 juju-e4d256-prod-github-runner-207 kernel: [47780.570867] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 18:40:06 juju-e4d256-prod-github-runner-207 kernel: [47780.572276] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 18:40:06 juju-e4d256-prod-github-runner-207 kernel: [47780.573498] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 18:40:06 juju-e4d256-prod-github-runner-207 kernel: [47780.574819] Call Trace: Aug 22 18:40:06 juju-e4d256-prod-github-runner-207 kernel: [47780.575779] Aug 22 18:40:06 juju-e4d256-prod-github-runner-207 kernel: [47780.576722] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:40:06 juju-e4d256-prod-github-runner-207 kernel: [47780.577850] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:40:06 juju-e4d256-prod-github-runner-207 kernel: [47780.578950] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:40:06 juju-e4d256-prod-github-runner-207 kernel: [47780.580124] ? show_regs.part.0+0x23/0x29 Aug 22 18:40:06 juju-e4d256-prod-github-runner-207 kernel: [47780.581201] ? show_regs.cold+0x8/0xd Aug 22 18:40:06 juju-e4d256-prod-github-runner-207 kernel: [47780.582263] ? watchdog_timer_fn+0x1be/0x220 Aug 22 18:40:06 juju-e4d256-prod-github-runner-207 kernel: [47780.583348] ? lockup_detector_update_enable+0x60/0x60 Aug 22 18:40:06 juju-e4d256-prod-github-runner-207 kernel: [47780.584514] ? __hrtimer_run_queues+0x107/0x230 Aug 22 18:40:06 juju-e4d256-prod-github-runner-207 kernel: [47780.585667] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 18:40:06 juju-e4d256-prod-github-runner-207 kernel: [47780.586776] ? hrtimer_interrupt+0x101/0x220 Aug 22 18:40:06 juju-e4d256-prod-github-runner-207 kernel: [47780.587869] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 18:40:06 juju-e4d256-prod-github-runner-207 kernel: [47780.589030] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 18:40:06 juju-e4d256-prod-github-runner-207 kernel: [47780.590192] Aug 22 18:40:06 juju-e4d256-prod-github-runner-207 kernel: [47780.591086] Aug 22 18:40:06 juju-e4d256-prod-github-runner-207 kernel: [47780.591965] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 18:40:06 juju-e4d256-prod-github-runner-207 kernel: [47780.593093] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:40:06 juju-e4d256-prod-github-runner-207 kernel: [47780.594244] ? _raw_spin_lock+0x22/0x30 Aug 22 18:40:06 juju-e4d256-prod-github-runner-207 kernel: [47780.595265] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:40:06 juju-e4d256-prod-github-runner-207 kernel: [47780.596365] direct_page_fault+0x206/0x310 [kvm] Aug 22 18:40:06 juju-e4d256-prod-github-runner-207 kernel: [47780.597517] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 18:40:06 juju-e4d256-prod-github-runner-207 kernel: [47780.598614] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 18:40:06 juju-e4d256-prod-github-runner-207 kernel: [47780.599699] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 18:40:06 juju-e4d256-prod-github-runner-207 kernel: [47780.600787] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 18:40:06 juju-e4d256-prod-github-runner-207 kernel: [47780.601840] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 18:40:06 juju-e4d256-prod-github-runner-207 kernel: [47780.602921] handle_exit+0x98/0x230 [kvm_amd] Aug 22 18:40:06 juju-e4d256-prod-github-runner-207 kernel: [47780.603899] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 18:40:06 juju-e4d256-prod-github-runner-207 kernel: [47780.604901] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 18:40:06 juju-e4d256-prod-github-runner-207 kernel: [47780.605950] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 18:40:06 juju-e4d256-prod-github-runner-207 kernel: [47780.606951] vcpu_run+0x62/0x2c0 [kvm] Aug 22 18:40:06 juju-e4d256-prod-github-runner-207 kernel: [47780.607848] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 18:40:06 juju-e4d256-prod-github-runner-207 kernel: [47780.608740] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 18:40:06 juju-e4d256-prod-github-runner-207 kernel: [47780.609705] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 18:40:06 juju-e4d256-prod-github-runner-207 kernel: [47780.610590] ? __seccomp_filter+0x4a/0x4a0 Aug 22 18:40:06 juju-e4d256-prod-github-runner-207 kernel: [47780.611413] ? __fget_files+0x86/0xc0 Aug 22 18:40:06 juju-e4d256-prod-github-runner-207 kernel: [47780.612185] __x64_sys_ioctl+0x95/0xd0 Aug 22 18:40:06 juju-e4d256-prod-github-runner-207 kernel: [47780.612950] do_syscall_64+0x5c/0xc0 Aug 22 18:40:06 juju-e4d256-prod-github-runner-207 kernel: [47780.613695] ? do_futex+0x162/0x1f0 Aug 22 18:40:06 juju-e4d256-prod-github-runner-207 kernel: [47780.614413] ? __x64_sys_futex+0x78/0x1e0 Aug 22 18:40:06 juju-e4d256-prod-github-runner-207 kernel: [47780.615166] ? __secure_computing+0xa9/0x120 Aug 22 18:40:06 juju-e4d256-prod-github-runner-207 kernel: [47780.615934] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 18:40:06 juju-e4d256-prod-github-runner-207 kernel: [47780.616800] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:40:06 juju-e4d256-prod-github-runner-207 kernel: [47780.617631] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:40:06 juju-e4d256-prod-github-runner-207 kernel: [47780.618441] ? do_syscall_64+0x69/0xc0 Aug 22 18:40:06 juju-e4d256-prod-github-runner-207 kernel: [47780.619166] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:40:06 juju-e4d256-prod-github-runner-207 kernel: [47780.619960] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:40:06 juju-e4d256-prod-github-runner-207 kernel: [47780.620747] ? do_syscall_64+0x69/0xc0 Aug 22 18:40:06 juju-e4d256-prod-github-runner-207 kernel: [47780.621478] ? do_syscall_64+0x69/0xc0 Aug 22 18:40:06 juju-e4d256-prod-github-runner-207 kernel: [47780.622184] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 18:40:06 juju-e4d256-prod-github-runner-207 kernel: [47780.622990] RIP: 0033:0x7faa5d0edaff Aug 22 18:40:06 juju-e4d256-prod-github-runner-207 kernel: [47780.623726] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 18:40:06 juju-e4d256-prod-github-runner-207 kernel: [47780.626065] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 18:40:06 juju-e4d256-prod-github-runner-207 kernel: [47780.627307] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 18:40:06 juju-e4d256-prod-github-runner-207 kernel: [47780.628332] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 18:40:06 juju-e4d256-prod-github-runner-207 kernel: [47780.629466] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 18:40:06 juju-e4d256-prod-github-runner-207 kernel: [47780.630496] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 18:40:06 juju-e4d256-prod-github-runner-207 kernel: [47780.631516] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 18:40:06 juju-e4d256-prod-github-runner-207 kernel: [47780.632541] Aug 22 18:40:34 juju-e4d256-prod-github-runner-207 kernel: [47808.541981] watchdog: BUG: soft lockup - CPU#1 stuck for 44417s! [qemu-system-x86:6715] Aug 22 18:40:34 juju-e4d256-prod-github-runner-207 kernel: [47808.543751] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 18:40:34 juju-e4d256-prod-github-runner-207 kernel: [47808.544016] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 18:40:34 juju-e4d256-prod-github-runner-207 kernel: [47808.556314] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 18:40:34 juju-e4d256-prod-github-runner-207 kernel: [47808.557628] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 18:40:34 juju-e4d256-prod-github-runner-207 kernel: [47808.558859] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:40:34 juju-e4d256-prod-github-runner-207 kernel: [47808.559975] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 18:40:34 juju-e4d256-prod-github-runner-207 kernel: [47808.562582] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 18:40:34 juju-e4d256-prod-github-runner-207 kernel: [47808.563633] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 18:40:34 juju-e4d256-prod-github-runner-207 kernel: [47808.564803] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 18:40:34 juju-e4d256-prod-github-runner-207 kernel: [47808.565982] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 18:40:34 juju-e4d256-prod-github-runner-207 kernel: [47808.567164] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 18:40:34 juju-e4d256-prod-github-runner-207 kernel: [47808.568372] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 18:40:34 juju-e4d256-prod-github-runner-207 kernel: [47808.569563] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 18:40:34 juju-e4d256-prod-github-runner-207 kernel: [47808.570814] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 18:40:34 juju-e4d256-prod-github-runner-207 kernel: [47808.572015] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 18:40:34 juju-e4d256-prod-github-runner-207 kernel: [47808.573306] Call Trace: Aug 22 18:40:34 juju-e4d256-prod-github-runner-207 kernel: [47808.574271] Aug 22 18:40:34 juju-e4d256-prod-github-runner-207 kernel: [47808.575215] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:40:34 juju-e4d256-prod-github-runner-207 kernel: [47808.576313] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:40:34 juju-e4d256-prod-github-runner-207 kernel: [47808.577397] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:40:34 juju-e4d256-prod-github-runner-207 kernel: [47808.578519] ? show_regs.part.0+0x23/0x29 Aug 22 18:40:34 juju-e4d256-prod-github-runner-207 kernel: [47808.579537] ? show_regs.cold+0x8/0xd Aug 22 18:40:34 juju-e4d256-prod-github-runner-207 kernel: [47808.580516] ? watchdog_timer_fn+0x1be/0x220 Aug 22 18:40:34 juju-e4d256-prod-github-runner-207 kernel: [47808.581555] ? lockup_detector_update_enable+0x60/0x60 Aug 22 18:40:34 juju-e4d256-prod-github-runner-207 kernel: [47808.582637] ? __hrtimer_run_queues+0x107/0x230 Aug 22 18:40:34 juju-e4d256-prod-github-runner-207 kernel: [47808.583693] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 18:40:34 juju-e4d256-prod-github-runner-207 kernel: [47808.584724] ? hrtimer_interrupt+0x101/0x220 Aug 22 18:40:34 juju-e4d256-prod-github-runner-207 kernel: [47808.585763] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 18:40:34 juju-e4d256-prod-github-runner-207 kernel: [47808.586839] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 18:40:34 juju-e4d256-prod-github-runner-207 kernel: [47808.587913] Aug 22 18:40:34 juju-e4d256-prod-github-runner-207 kernel: [47808.588784] Aug 22 18:40:34 juju-e4d256-prod-github-runner-207 kernel: [47808.589642] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 18:40:34 juju-e4d256-prod-github-runner-207 kernel: [47808.590678] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:40:34 juju-e4d256-prod-github-runner-207 kernel: [47808.591726] ? _raw_spin_lock+0x22/0x30 Aug 22 18:40:34 juju-e4d256-prod-github-runner-207 kernel: [47808.592687] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:40:34 juju-e4d256-prod-github-runner-207 kernel: [47808.593763] direct_page_fault+0x206/0x310 [kvm] Aug 22 18:40:34 juju-e4d256-prod-github-runner-207 kernel: [47808.594805] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 18:40:34 juju-e4d256-prod-github-runner-207 kernel: [47808.595817] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 18:40:34 juju-e4d256-prod-github-runner-207 kernel: [47808.596820] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 18:40:34 juju-e4d256-prod-github-runner-207 kernel: [47808.597864] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 18:40:34 juju-e4d256-prod-github-runner-207 kernel: [47808.598838] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 18:40:34 juju-e4d256-prod-github-runner-207 kernel: [47808.599824] handle_exit+0x98/0x230 [kvm_amd] Aug 22 18:40:34 juju-e4d256-prod-github-runner-207 kernel: [47808.600718] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 18:40:34 juju-e4d256-prod-github-runner-207 kernel: [47808.601755] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 18:40:34 juju-e4d256-prod-github-runner-207 kernel: [47808.602711] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 18:40:34 juju-e4d256-prod-github-runner-207 kernel: [47808.603628] vcpu_run+0x62/0x2c0 [kvm] Aug 22 18:40:34 juju-e4d256-prod-github-runner-207 kernel: [47808.604460] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 18:40:34 juju-e4d256-prod-github-runner-207 kernel: [47808.605300] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 18:40:34 juju-e4d256-prod-github-runner-207 kernel: [47808.606163] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 18:40:34 juju-e4d256-prod-github-runner-207 kernel: [47808.606962] ? __seccomp_filter+0x4a/0x4a0 Aug 22 18:40:34 juju-e4d256-prod-github-runner-207 kernel: [47808.607720] ? __fget_files+0x86/0xc0 Aug 22 18:40:34 juju-e4d256-prod-github-runner-207 kernel: [47808.608439] __x64_sys_ioctl+0x95/0xd0 Aug 22 18:40:34 juju-e4d256-prod-github-runner-207 kernel: [47808.609164] do_syscall_64+0x5c/0xc0 Aug 22 18:40:34 juju-e4d256-prod-github-runner-207 kernel: [47808.609833] ? do_futex+0x162/0x1f0 Aug 22 18:40:34 juju-e4d256-prod-github-runner-207 kernel: [47808.610480] ? __x64_sys_futex+0x78/0x1e0 Aug 22 18:40:34 juju-e4d256-prod-github-runner-207 kernel: [47808.611153] ? __secure_computing+0xa9/0x120 Aug 22 18:40:34 juju-e4d256-prod-github-runner-207 kernel: [47808.611841] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 18:40:34 juju-e4d256-prod-github-runner-207 kernel: [47808.612606] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:40:34 juju-e4d256-prod-github-runner-207 kernel: [47808.613356] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:40:34 juju-e4d256-prod-github-runner-207 kernel: [47808.614090] ? do_syscall_64+0x69/0xc0 Aug 22 18:40:34 juju-e4d256-prod-github-runner-207 kernel: [47808.614739] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:40:34 juju-e4d256-prod-github-runner-207 kernel: [47808.615444] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:40:34 juju-e4d256-prod-github-runner-207 kernel: [47808.616140] ? do_syscall_64+0x69/0xc0 Aug 22 18:40:34 juju-e4d256-prod-github-runner-207 kernel: [47808.616766] ? do_syscall_64+0x69/0xc0 Aug 22 18:40:34 juju-e4d256-prod-github-runner-207 kernel: [47808.617403] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 18:40:34 juju-e4d256-prod-github-runner-207 kernel: [47808.618117] RIP: 0033:0x7faa5d0edaff Aug 22 18:40:34 juju-e4d256-prod-github-runner-207 kernel: [47808.618780] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 18:40:34 juju-e4d256-prod-github-runner-207 kernel: [47808.620785] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 18:40:34 juju-e4d256-prod-github-runner-207 kernel: [47808.621721] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 18:40:34 juju-e4d256-prod-github-runner-207 kernel: [47808.622613] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 18:40:34 juju-e4d256-prod-github-runner-207 kernel: [47808.623556] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 18:40:34 juju-e4d256-prod-github-runner-207 kernel: [47808.624514] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 18:40:34 juju-e4d256-prod-github-runner-207 kernel: [47808.625425] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 18:40:34 juju-e4d256-prod-github-runner-207 kernel: [47808.626316] Aug 22 18:41:02 juju-e4d256-prod-github-runner-207 kernel: [47836.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 44443s! [qemu-system-x86:6715] Aug 22 18:41:02 juju-e4d256-prod-github-runner-207 kernel: [47836.543745] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 18:41:02 juju-e4d256-prod-github-runner-207 kernel: [47836.543999] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 18:41:02 juju-e4d256-prod-github-runner-207 kernel: [47836.556323] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 18:41:02 juju-e4d256-prod-github-runner-207 kernel: [47836.557614] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 18:41:02 juju-e4d256-prod-github-runner-207 kernel: [47836.558840] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:41:02 juju-e4d256-prod-github-runner-207 kernel: [47836.559898] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 18:41:02 juju-e4d256-prod-github-runner-207 kernel: [47836.562530] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 18:41:02 juju-e4d256-prod-github-runner-207 kernel: [47836.563582] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 18:41:02 juju-e4d256-prod-github-runner-207 kernel: [47836.564788] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 18:41:02 juju-e4d256-prod-github-runner-207 kernel: [47836.565985] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 18:41:02 juju-e4d256-prod-github-runner-207 kernel: [47836.567166] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 18:41:02 juju-e4d256-prod-github-runner-207 kernel: [47836.568339] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 18:41:02 juju-e4d256-prod-github-runner-207 kernel: [47836.569571] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 18:41:02 juju-e4d256-prod-github-runner-207 kernel: [47836.571011] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 18:41:02 juju-e4d256-prod-github-runner-207 kernel: [47836.572272] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 18:41:02 juju-e4d256-prod-github-runner-207 kernel: [47836.573634] Call Trace: Aug 22 18:41:02 juju-e4d256-prod-github-runner-207 kernel: [47836.574613] Aug 22 18:41:02 juju-e4d256-prod-github-runner-207 kernel: [47836.575574] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:41:02 juju-e4d256-prod-github-runner-207 kernel: [47836.576804] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:41:02 juju-e4d256-prod-github-runner-207 kernel: [47836.577975] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:41:02 juju-e4d256-prod-github-runner-207 kernel: [47836.579178] ? show_regs.part.0+0x23/0x29 Aug 22 18:41:02 juju-e4d256-prod-github-runner-207 kernel: [47836.580285] ? show_regs.cold+0x8/0xd Aug 22 18:41:02 juju-e4d256-prod-github-runner-207 kernel: [47836.581430] ? watchdog_timer_fn+0x1be/0x220 Aug 22 18:41:02 juju-e4d256-prod-github-runner-207 kernel: [47836.582583] ? lockup_detector_update_enable+0x60/0x60 Aug 22 18:41:02 juju-e4d256-prod-github-runner-207 kernel: [47836.583768] ? __hrtimer_run_queues+0x107/0x230 Aug 22 18:41:02 juju-e4d256-prod-github-runner-207 kernel: [47836.584932] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 18:41:02 juju-e4d256-prod-github-runner-207 kernel: [47836.586069] ? hrtimer_interrupt+0x101/0x220 Aug 22 18:41:02 juju-e4d256-prod-github-runner-207 kernel: [47836.587173] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 18:41:02 juju-e4d256-prod-github-runner-207 kernel: [47836.588338] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 18:41:02 juju-e4d256-prod-github-runner-207 kernel: [47836.589496] Aug 22 18:41:02 juju-e4d256-prod-github-runner-207 kernel: [47836.590394] Aug 22 18:41:02 juju-e4d256-prod-github-runner-207 kernel: [47836.591287] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 18:41:02 juju-e4d256-prod-github-runner-207 kernel: [47836.592433] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:41:02 juju-e4d256-prod-github-runner-207 kernel: [47836.593601] ? _raw_spin_lock+0x22/0x30 Aug 22 18:41:02 juju-e4d256-prod-github-runner-207 kernel: [47836.594824] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:41:02 juju-e4d256-prod-github-runner-207 kernel: [47836.595931] direct_page_fault+0x206/0x310 [kvm] Aug 22 18:41:02 juju-e4d256-prod-github-runner-207 kernel: [47836.597064] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 18:41:02 juju-e4d256-prod-github-runner-207 kernel: [47836.598160] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 18:41:02 juju-e4d256-prod-github-runner-207 kernel: [47836.599264] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 18:41:02 juju-e4d256-prod-github-runner-207 kernel: [47836.600361] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 18:41:02 juju-e4d256-prod-github-runner-207 kernel: [47836.601408] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 18:41:02 juju-e4d256-prod-github-runner-207 kernel: [47836.602494] handle_exit+0x98/0x230 [kvm_amd] Aug 22 18:41:02 juju-e4d256-prod-github-runner-207 kernel: [47836.603478] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 18:41:02 juju-e4d256-prod-github-runner-207 kernel: [47836.604478] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 18:41:02 juju-e4d256-prod-github-runner-207 kernel: [47836.605509] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 18:41:02 juju-e4d256-prod-github-runner-207 kernel: [47836.606513] vcpu_run+0x62/0x2c0 [kvm] Aug 22 18:41:02 juju-e4d256-prod-github-runner-207 kernel: [47836.607411] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 18:41:02 juju-e4d256-prod-github-runner-207 kernel: [47836.608305] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 18:41:02 juju-e4d256-prod-github-runner-207 kernel: [47836.609272] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 18:41:02 juju-e4d256-prod-github-runner-207 kernel: [47836.610155] ? __seccomp_filter+0x4a/0x4a0 Aug 22 18:41:02 juju-e4d256-prod-github-runner-207 kernel: [47836.610978] ? __fget_files+0x86/0xc0 Aug 22 18:41:02 juju-e4d256-prod-github-runner-207 kernel: [47836.611761] __x64_sys_ioctl+0x95/0xd0 Aug 22 18:41:02 juju-e4d256-prod-github-runner-207 kernel: [47836.612528] do_syscall_64+0x5c/0xc0 Aug 22 18:41:02 juju-e4d256-prod-github-runner-207 kernel: [47836.613297] ? do_futex+0x162/0x1f0 Aug 22 18:41:02 juju-e4d256-prod-github-runner-207 kernel: [47836.614020] ? __x64_sys_futex+0x78/0x1e0 Aug 22 18:41:02 juju-e4d256-prod-github-runner-207 kernel: [47836.614791] ? __secure_computing+0xa9/0x120 Aug 22 18:41:02 juju-e4d256-prod-github-runner-207 kernel: [47836.615568] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 18:41:02 juju-e4d256-prod-github-runner-207 kernel: [47836.616431] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:41:02 juju-e4d256-prod-github-runner-207 kernel: [47836.617263] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:41:02 juju-e4d256-prod-github-runner-207 kernel: [47836.618078] ? do_syscall_64+0x69/0xc0 Aug 22 18:41:02 juju-e4d256-prod-github-runner-207 kernel: [47836.618799] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:41:02 juju-e4d256-prod-github-runner-207 kernel: [47836.619592] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:41:02 juju-e4d256-prod-github-runner-207 kernel: [47836.620377] ? do_syscall_64+0x69/0xc0 Aug 22 18:41:02 juju-e4d256-prod-github-runner-207 kernel: [47836.621089] ? do_syscall_64+0x69/0xc0 Aug 22 18:41:02 juju-e4d256-prod-github-runner-207 kernel: [47836.621788] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 18:41:02 juju-e4d256-prod-github-runner-207 kernel: [47836.622591] RIP: 0033:0x7faa5d0edaff Aug 22 18:41:02 juju-e4d256-prod-github-runner-207 kernel: [47836.623329] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 18:41:02 juju-e4d256-prod-github-runner-207 kernel: [47836.625668] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 18:41:02 juju-e4d256-prod-github-runner-207 kernel: [47836.626718] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 18:41:02 juju-e4d256-prod-github-runner-207 kernel: [47836.627747] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 18:41:02 juju-e4d256-prod-github-runner-207 kernel: [47836.628790] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 18:41:02 juju-e4d256-prod-github-runner-207 kernel: [47836.629814] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 18:41:02 juju-e4d256-prod-github-runner-207 kernel: [47836.630841] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 18:41:02 juju-e4d256-prod-github-runner-207 kernel: [47836.631865] Aug 22 18:41:30 juju-e4d256-prod-github-runner-207 kernel: [47864.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 44469s! [qemu-system-x86:6715] Aug 22 18:41:30 juju-e4d256-prod-github-runner-207 kernel: [47864.543086] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 18:41:30 juju-e4d256-prod-github-runner-207 kernel: [47864.543152] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 18:41:30 juju-e4d256-prod-github-runner-207 kernel: [47864.555251] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 18:41:30 juju-e4d256-prod-github-runner-207 kernel: [47864.556591] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 18:41:30 juju-e4d256-prod-github-runner-207 kernel: [47864.557822] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:41:30 juju-e4d256-prod-github-runner-207 kernel: [47864.558897] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 18:41:30 juju-e4d256-prod-github-runner-207 kernel: [47864.561573] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 18:41:30 juju-e4d256-prod-github-runner-207 kernel: [47864.562623] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 18:41:30 juju-e4d256-prod-github-runner-207 kernel: [47864.563800] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 18:41:30 juju-e4d256-prod-github-runner-207 kernel: [47864.565141] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 18:41:30 juju-e4d256-prod-github-runner-207 kernel: [47864.566309] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 18:41:30 juju-e4d256-prod-github-runner-207 kernel: [47864.567498] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 18:41:30 juju-e4d256-prod-github-runner-207 kernel: [47864.568749] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 18:41:30 juju-e4d256-prod-github-runner-207 kernel: [47864.570004] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 18:41:30 juju-e4d256-prod-github-runner-207 kernel: [47864.571101] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 18:41:30 juju-e4d256-prod-github-runner-207 kernel: [47864.572332] Call Trace: Aug 22 18:41:30 juju-e4d256-prod-github-runner-207 kernel: [47864.573261] Aug 22 18:41:30 juju-e4d256-prod-github-runner-207 kernel: [47864.574152] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:41:30 juju-e4d256-prod-github-runner-207 kernel: [47864.575190] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:41:30 juju-e4d256-prod-github-runner-207 kernel: [47864.576432] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:41:30 juju-e4d256-prod-github-runner-207 kernel: [47864.577555] ? show_regs.part.0+0x23/0x29 Aug 22 18:41:30 juju-e4d256-prod-github-runner-207 kernel: [47864.578565] ? show_regs.cold+0x8/0xd Aug 22 18:41:30 juju-e4d256-prod-github-runner-207 kernel: [47864.579549] ? watchdog_timer_fn+0x1be/0x220 Aug 22 18:41:30 juju-e4d256-prod-github-runner-207 kernel: [47864.580618] ? lockup_detector_update_enable+0x60/0x60 Aug 22 18:41:30 juju-e4d256-prod-github-runner-207 kernel: [47864.581685] ? __hrtimer_run_queues+0x107/0x230 Aug 22 18:41:30 juju-e4d256-prod-github-runner-207 kernel: [47864.582717] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 18:41:30 juju-e4d256-prod-github-runner-207 kernel: [47864.583740] ? hrtimer_interrupt+0x101/0x220 Aug 22 18:41:30 juju-e4d256-prod-github-runner-207 kernel: [47864.584802] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 18:41:30 juju-e4d256-prod-github-runner-207 kernel: [47864.585893] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 18:41:30 juju-e4d256-prod-github-runner-207 kernel: [47864.586978] Aug 22 18:41:30 juju-e4d256-prod-github-runner-207 kernel: [47864.587841] Aug 22 18:41:30 juju-e4d256-prod-github-runner-207 kernel: [47864.588775] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 18:41:30 juju-e4d256-prod-github-runner-207 kernel: [47864.589830] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:41:30 juju-e4d256-prod-github-runner-207 kernel: [47864.590880] ? _raw_spin_lock+0x22/0x30 Aug 22 18:41:30 juju-e4d256-prod-github-runner-207 kernel: [47864.591831] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:41:30 juju-e4d256-prod-github-runner-207 kernel: [47864.592932] direct_page_fault+0x206/0x310 [kvm] Aug 22 18:41:30 juju-e4d256-prod-github-runner-207 kernel: [47864.593961] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 18:41:30 juju-e4d256-prod-github-runner-207 kernel: [47864.594981] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 18:41:30 juju-e4d256-prod-github-runner-207 kernel: [47864.595994] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 18:41:30 juju-e4d256-prod-github-runner-207 kernel: [47864.597152] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 18:41:30 juju-e4d256-prod-github-runner-207 kernel: [47864.598122] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 18:41:30 juju-e4d256-prod-github-runner-207 kernel: [47864.599126] handle_exit+0x98/0x230 [kvm_amd] Aug 22 18:41:30 juju-e4d256-prod-github-runner-207 kernel: [47864.600023] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 18:41:30 juju-e4d256-prod-github-runner-207 kernel: [47864.601018] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 18:41:30 juju-e4d256-prod-github-runner-207 kernel: [47864.601944] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 18:41:30 juju-e4d256-prod-github-runner-207 kernel: [47864.602844] vcpu_run+0x62/0x2c0 [kvm] Aug 22 18:41:30 juju-e4d256-prod-github-runner-207 kernel: [47864.603656] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 18:41:30 juju-e4d256-prod-github-runner-207 kernel: [47864.604538] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 18:41:30 juju-e4d256-prod-github-runner-207 kernel: [47864.605454] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 18:41:30 juju-e4d256-prod-github-runner-207 kernel: [47864.606272] ? __seccomp_filter+0x4a/0x4a0 Aug 22 18:41:30 juju-e4d256-prod-github-runner-207 kernel: [47864.607022] ? __fget_files+0x86/0xc0 Aug 22 18:41:30 juju-e4d256-prod-github-runner-207 kernel: [47864.607744] __x64_sys_ioctl+0x95/0xd0 Aug 22 18:41:30 juju-e4d256-prod-github-runner-207 kernel: [47864.608553] do_syscall_64+0x5c/0xc0 Aug 22 18:41:30 juju-e4d256-prod-github-runner-207 kernel: [47864.609260] ? do_futex+0x162/0x1f0 Aug 22 18:41:30 juju-e4d256-prod-github-runner-207 kernel: [47864.609918] ? __x64_sys_futex+0x78/0x1e0 Aug 22 18:41:30 juju-e4d256-prod-github-runner-207 kernel: [47864.610629] ? __secure_computing+0xa9/0x120 Aug 22 18:41:30 juju-e4d256-prod-github-runner-207 kernel: [47864.611337] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 18:41:30 juju-e4d256-prod-github-runner-207 kernel: [47864.612105] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:41:30 juju-e4d256-prod-github-runner-207 kernel: [47864.612913] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:41:30 juju-e4d256-prod-github-runner-207 kernel: [47864.613641] ? do_syscall_64+0x69/0xc0 Aug 22 18:41:30 juju-e4d256-prod-github-runner-207 kernel: [47864.614307] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:41:30 juju-e4d256-prod-github-runner-207 kernel: [47864.615022] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:41:30 juju-e4d256-prod-github-runner-207 kernel: [47864.615729] ? do_syscall_64+0x69/0xc0 Aug 22 18:41:30 juju-e4d256-prod-github-runner-207 kernel: [47864.616425] ? do_syscall_64+0x69/0xc0 Aug 22 18:41:30 juju-e4d256-prod-github-runner-207 kernel: [47864.617061] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 18:41:30 juju-e4d256-prod-github-runner-207 kernel: [47864.617769] RIP: 0033:0x7faa5d0edaff Aug 22 18:41:30 juju-e4d256-prod-github-runner-207 kernel: [47864.618424] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 18:41:30 juju-e4d256-prod-github-runner-207 kernel: [47864.620465] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 18:41:30 juju-e4d256-prod-github-runner-207 kernel: [47864.621409] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 18:41:30 juju-e4d256-prod-github-runner-207 kernel: [47864.622301] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 18:41:30 juju-e4d256-prod-github-runner-207 kernel: [47864.623191] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 18:41:30 juju-e4d256-prod-github-runner-207 kernel: [47864.624081] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 18:41:30 juju-e4d256-prod-github-runner-207 kernel: [47864.625037] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 18:41:30 juju-e4d256-prod-github-runner-207 kernel: [47864.625932] Aug 22 18:41:46 juju-e4d256-prod-github-runner-207 kernel: [47880.380706] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 18:41:46 juju-e4d256-prod-github-runner-207 kernel: [47880.382325] rcu: 1-....: (11903245 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=5757068 Aug 22 18:41:46 juju-e4d256-prod-github-runner-207 kernel: [47880.383450] (t=11940795 jiffies g=23269 q=46205) Aug 22 18:41:46 juju-e4d256-prod-github-runner-207 kernel: [47880.384250] NMI backtrace for cpu 1 Aug 22 18:41:46 juju-e4d256-prod-github-runner-207 kernel: [47880.384958] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 18:41:46 juju-e4d256-prod-github-runner-207 kernel: [47880.386109] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 18:41:46 juju-e4d256-prod-github-runner-207 kernel: [47880.387175] Call Trace: Aug 22 18:41:46 juju-e4d256-prod-github-runner-207 kernel: [47880.387857] Aug 22 18:41:46 juju-e4d256-prod-github-runner-207 kernel: [47880.388530] show_stack+0x52/0x5c Aug 22 18:41:46 juju-e4d256-prod-github-runner-207 kernel: [47880.389254] dump_stack_lvl+0x4a/0x63 Aug 22 18:41:46 juju-e4d256-prod-github-runner-207 kernel: [47880.389994] dump_stack+0x10/0x16 Aug 22 18:41:46 juju-e4d256-prod-github-runner-207 kernel: [47880.390721] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 18:41:46 juju-e4d256-prod-github-runner-207 kernel: [47880.391499] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 18:41:46 juju-e4d256-prod-github-runner-207 kernel: [47880.392284] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 18:41:46 juju-e4d256-prod-github-runner-207 kernel: [47880.393098] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 18:41:46 juju-e4d256-prod-github-runner-207 kernel: [47880.393913] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 18:41:46 juju-e4d256-prod-github-runner-207 kernel: [47880.394716] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 18:41:46 juju-e4d256-prod-github-runner-207 kernel: [47880.395636] print_cpu_stall.cold+0x2f/0xe2 Aug 22 18:41:46 juju-e4d256-prod-github-runner-207 kernel: [47880.396408] ? timekeeping_update+0xf7/0x150 Aug 22 18:41:46 juju-e4d256-prod-github-runner-207 kernel: [47880.397178] check_cpu_stall+0x109/0x270 Aug 22 18:41:46 juju-e4d256-prod-github-runner-207 kernel: [47880.397922] rcu_sched_clock_irq+0x9a/0x250 Aug 22 18:41:46 juju-e4d256-prod-github-runner-207 kernel: [47880.398679] update_process_times+0x94/0xd0 Aug 22 18:41:46 juju-e4d256-prod-github-runner-207 kernel: [47880.399436] tick_sched_handle+0x29/0x70 Aug 22 18:41:46 juju-e4d256-prod-github-runner-207 kernel: [47880.400195] tick_sched_timer+0x8c/0xc0 Aug 22 18:41:46 juju-e4d256-prod-github-runner-207 kernel: [47880.400931] ? tick_nohz_handler+0xb0/0xb0 Aug 22 18:41:46 juju-e4d256-prod-github-runner-207 kernel: [47880.401686] __hrtimer_run_queues+0x107/0x230 Aug 22 18:41:46 juju-e4d256-prod-github-runner-207 kernel: [47880.402457] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 18:41:46 juju-e4d256-prod-github-runner-207 kernel: [47880.403231] hrtimer_interrupt+0x101/0x220 Aug 22 18:41:46 juju-e4d256-prod-github-runner-207 kernel: [47880.403988] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 18:41:46 juju-e4d256-prod-github-runner-207 kernel: [47880.404811] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 18:41:46 juju-e4d256-prod-github-runner-207 kernel: [47880.405610] Aug 22 18:41:46 juju-e4d256-prod-github-runner-207 kernel: [47880.406242] Aug 22 18:41:46 juju-e4d256-prod-github-runner-207 kernel: [47880.406869] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 18:41:46 juju-e4d256-prod-github-runner-207 kernel: [47880.407693] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:41:46 juju-e4d256-prod-github-runner-207 kernel: [47880.408580] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 18:41:46 juju-e4d256-prod-github-runner-207 kernel: [47880.410777] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 18:41:46 juju-e4d256-prod-github-runner-207 kernel: [47880.411653] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 18:41:46 juju-e4d256-prod-github-runner-207 kernel: [47880.412654] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 18:41:46 juju-e4d256-prod-github-runner-207 kernel: [47880.413629] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 18:41:46 juju-e4d256-prod-github-runner-207 kernel: [47880.414766] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 18:41:46 juju-e4d256-prod-github-runner-207 kernel: [47880.415716] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 18:41:46 juju-e4d256-prod-github-runner-207 kernel: [47880.416677] ? _raw_spin_lock+0x22/0x30 Aug 22 18:41:46 juju-e4d256-prod-github-runner-207 kernel: [47880.417609] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:41:46 juju-e4d256-prod-github-runner-207 kernel: [47880.418460] direct_page_fault+0x206/0x310 [kvm] Aug 22 18:41:46 juju-e4d256-prod-github-runner-207 kernel: [47880.419294] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 18:41:46 juju-e4d256-prod-github-runner-207 kernel: [47880.420127] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 18:41:46 juju-e4d256-prod-github-runner-207 kernel: [47880.420959] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 18:41:46 juju-e4d256-prod-github-runner-207 kernel: [47880.421786] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 18:41:46 juju-e4d256-prod-github-runner-207 kernel: [47880.422570] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 18:41:46 juju-e4d256-prod-github-runner-207 kernel: [47880.423391] handle_exit+0x98/0x230 [kvm_amd] Aug 22 18:41:46 juju-e4d256-prod-github-runner-207 kernel: [47880.424160] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 18:41:46 juju-e4d256-prod-github-runner-207 kernel: [47880.424986] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 18:41:46 juju-e4d256-prod-github-runner-207 kernel: [47880.425786] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 18:41:46 juju-e4d256-prod-github-runner-207 kernel: [47880.426568] vcpu_run+0x62/0x2c0 [kvm] Aug 22 18:41:46 juju-e4d256-prod-github-runner-207 kernel: [47880.427283] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 18:41:46 juju-e4d256-prod-github-runner-207 kernel: [47880.428014] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 18:41:46 juju-e4d256-prod-github-runner-207 kernel: [47880.428846] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 18:41:46 juju-e4d256-prod-github-runner-207 kernel: [47880.429610] ? __seccomp_filter+0x4a/0x4a0 Aug 22 18:41:46 juju-e4d256-prod-github-runner-207 kernel: [47880.430328] ? __fget_files+0x86/0xc0 Aug 22 18:41:46 juju-e4d256-prod-github-runner-207 kernel: [47880.431017] __x64_sys_ioctl+0x95/0xd0 Aug 22 18:41:46 juju-e4d256-prod-github-runner-207 kernel: [47880.431709] do_syscall_64+0x5c/0xc0 Aug 22 18:41:46 juju-e4d256-prod-github-runner-207 kernel: [47880.432400] ? do_futex+0x162/0x1f0 Aug 22 18:41:46 juju-e4d256-prod-github-runner-207 kernel: [47880.433073] ? __x64_sys_futex+0x78/0x1e0 Aug 22 18:41:46 juju-e4d256-prod-github-runner-207 kernel: [47880.433773] ? __secure_computing+0xa9/0x120 Aug 22 18:41:46 juju-e4d256-prod-github-runner-207 kernel: [47880.434487] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 18:41:46 juju-e4d256-prod-github-runner-207 kernel: [47880.435272] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:41:46 juju-e4d256-prod-github-runner-207 kernel: [47880.436074] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:41:46 juju-e4d256-prod-github-runner-207 kernel: [47880.436840] ? do_syscall_64+0x69/0xc0 Aug 22 18:41:46 juju-e4d256-prod-github-runner-207 kernel: [47880.437528] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:41:46 juju-e4d256-prod-github-runner-207 kernel: [47880.438283] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:41:46 juju-e4d256-prod-github-runner-207 kernel: [47880.439036] ? do_syscall_64+0x69/0xc0 Aug 22 18:41:46 juju-e4d256-prod-github-runner-207 kernel: [47880.439734] ? do_syscall_64+0x69/0xc0 Aug 22 18:41:46 juju-e4d256-prod-github-runner-207 kernel: [47880.440426] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 18:41:46 juju-e4d256-prod-github-runner-207 kernel: [47880.441195] RIP: 0033:0x7faa5d0edaff Aug 22 18:41:46 juju-e4d256-prod-github-runner-207 kernel: [47880.441903] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 18:41:46 juju-e4d256-prod-github-runner-207 kernel: [47880.444000] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 18:41:46 juju-e4d256-prod-github-runner-207 kernel: [47880.444967] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 18:41:46 juju-e4d256-prod-github-runner-207 kernel: [47880.445913] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 18:41:46 juju-e4d256-prod-github-runner-207 kernel: [47880.446853] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 18:41:46 juju-e4d256-prod-github-runner-207 kernel: [47880.447788] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 18:41:46 juju-e4d256-prod-github-runner-207 kernel: [47880.448722] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 18:41:46 juju-e4d256-prod-github-runner-207 kernel: [47880.449633] Aug 22 18:42:10 juju-e4d256-prod-github-runner-207 kernel: [47904.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 44506s! [qemu-system-x86:6715] Aug 22 18:42:10 juju-e4d256-prod-github-runner-207 kernel: [47904.543095] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 18:42:10 juju-e4d256-prod-github-runner-207 kernel: [47904.543386] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 18:42:10 juju-e4d256-prod-github-runner-207 kernel: [47904.555425] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 18:42:10 juju-e4d256-prod-github-runner-207 kernel: [47904.556693] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 18:42:10 juju-e4d256-prod-github-runner-207 kernel: [47904.557909] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:42:10 juju-e4d256-prod-github-runner-207 kernel: [47904.559015] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 18:42:10 juju-e4d256-prod-github-runner-207 kernel: [47904.561558] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 18:42:10 juju-e4d256-prod-github-runner-207 kernel: [47904.562598] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 18:42:10 juju-e4d256-prod-github-runner-207 kernel: [47904.563765] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 18:42:10 juju-e4d256-prod-github-runner-207 kernel: [47904.564923] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 18:42:10 juju-e4d256-prod-github-runner-207 kernel: [47904.566078] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 18:42:10 juju-e4d256-prod-github-runner-207 kernel: [47904.567235] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 18:42:10 juju-e4d256-prod-github-runner-207 kernel: [47904.568402] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 18:42:10 juju-e4d256-prod-github-runner-207 kernel: [47904.569630] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 18:42:10 juju-e4d256-prod-github-runner-207 kernel: [47904.570744] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 18:42:10 juju-e4d256-prod-github-runner-207 kernel: [47904.571959] Call Trace: Aug 22 18:42:10 juju-e4d256-prod-github-runner-207 kernel: [47904.572870] Aug 22 18:42:10 juju-e4d256-prod-github-runner-207 kernel: [47904.573757] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:42:10 juju-e4d256-prod-github-runner-207 kernel: [47904.574795] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:42:10 juju-e4d256-prod-github-runner-207 kernel: [47904.575839] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:42:10 juju-e4d256-prod-github-runner-207 kernel: [47904.576913] ? show_regs.part.0+0x23/0x29 Aug 22 18:42:10 juju-e4d256-prod-github-runner-207 kernel: [47904.577906] ? show_regs.cold+0x8/0xd Aug 22 18:42:10 juju-e4d256-prod-github-runner-207 kernel: [47904.578880] ? watchdog_timer_fn+0x1be/0x220 Aug 22 18:42:10 juju-e4d256-prod-github-runner-207 kernel: [47904.579899] ? lockup_detector_update_enable+0x60/0x60 Aug 22 18:42:10 juju-e4d256-prod-github-runner-207 kernel: [47904.580964] ? __hrtimer_run_queues+0x107/0x230 Aug 22 18:42:10 juju-e4d256-prod-github-runner-207 kernel: [47904.581992] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 18:42:10 juju-e4d256-prod-github-runner-207 kernel: [47904.583018] ? hrtimer_interrupt+0x101/0x220 Aug 22 18:42:10 juju-e4d256-prod-github-runner-207 kernel: [47904.584040] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 18:42:10 juju-e4d256-prod-github-runner-207 kernel: [47904.585107] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 18:42:10 juju-e4d256-prod-github-runner-207 kernel: [47904.586151] Aug 22 18:42:10 juju-e4d256-prod-github-runner-207 kernel: [47904.587002] Aug 22 18:42:10 juju-e4d256-prod-github-runner-207 kernel: [47904.587847] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 18:42:10 juju-e4d256-prod-github-runner-207 kernel: [47904.588904] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:42:10 juju-e4d256-prod-github-runner-207 kernel: [47904.589953] ? _raw_spin_lock+0x22/0x30 Aug 22 18:42:10 juju-e4d256-prod-github-runner-207 kernel: [47904.590900] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:42:10 juju-e4d256-prod-github-runner-207 kernel: [47904.591934] direct_page_fault+0x206/0x310 [kvm] Aug 22 18:42:10 juju-e4d256-prod-github-runner-207 kernel: [47904.592966] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 18:42:10 juju-e4d256-prod-github-runner-207 kernel: [47904.593972] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 18:42:10 juju-e4d256-prod-github-runner-207 kernel: [47904.594970] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 18:42:10 juju-e4d256-prod-github-runner-207 kernel: [47904.595949] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 18:42:10 juju-e4d256-prod-github-runner-207 kernel: [47904.596895] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 18:42:10 juju-e4d256-prod-github-runner-207 kernel: [47904.597870] handle_exit+0x98/0x230 [kvm_amd] Aug 22 18:42:10 juju-e4d256-prod-github-runner-207 kernel: [47904.598761] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 18:42:10 juju-e4d256-prod-github-runner-207 kernel: [47904.599678] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 18:42:10 juju-e4d256-prod-github-runner-207 kernel: [47904.600616] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 18:42:10 juju-e4d256-prod-github-runner-207 kernel: [47904.601537] vcpu_run+0x62/0x2c0 [kvm] Aug 22 18:42:10 juju-e4d256-prod-github-runner-207 kernel: [47904.602349] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 18:42:10 juju-e4d256-prod-github-runner-207 kernel: [47904.603155] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 18:42:10 juju-e4d256-prod-github-runner-207 kernel: [47904.604024] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 18:42:10 juju-e4d256-prod-github-runner-207 kernel: [47904.604849] ? __seccomp_filter+0x4a/0x4a0 Aug 22 18:42:10 juju-e4d256-prod-github-runner-207 kernel: [47904.605598] ? __fget_files+0x86/0xc0 Aug 22 18:42:10 juju-e4d256-prod-github-runner-207 kernel: [47904.606300] __x64_sys_ioctl+0x95/0xd0 Aug 22 18:42:10 juju-e4d256-prod-github-runner-207 kernel: [47904.606990] do_syscall_64+0x5c/0xc0 Aug 22 18:42:10 juju-e4d256-prod-github-runner-207 kernel: [47904.607658] ? do_futex+0x162/0x1f0 Aug 22 18:42:10 juju-e4d256-prod-github-runner-207 kernel: [47904.608316] ? __x64_sys_futex+0x78/0x1e0 Aug 22 18:42:10 juju-e4d256-prod-github-runner-207 kernel: [47904.608988] ? __secure_computing+0xa9/0x120 Aug 22 18:42:10 juju-e4d256-prod-github-runner-207 kernel: [47904.609676] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 18:42:10 juju-e4d256-prod-github-runner-207 kernel: [47904.610434] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:42:10 juju-e4d256-prod-github-runner-207 kernel: [47904.611152] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:42:10 juju-e4d256-prod-github-runner-207 kernel: [47904.611882] ? do_syscall_64+0x69/0xc0 Aug 22 18:42:10 juju-e4d256-prod-github-runner-207 kernel: [47904.612533] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:42:10 juju-e4d256-prod-github-runner-207 kernel: [47904.613235] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:42:10 juju-e4d256-prod-github-runner-207 kernel: [47904.613929] ? do_syscall_64+0x69/0xc0 Aug 22 18:42:10 juju-e4d256-prod-github-runner-207 kernel: [47904.614556] ? do_syscall_64+0x69/0xc0 Aug 22 18:42:10 juju-e4d256-prod-github-runner-207 kernel: [47904.615214] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 18:42:10 juju-e4d256-prod-github-runner-207 kernel: [47904.615948] RIP: 0033:0x7faa5d0edaff Aug 22 18:42:10 juju-e4d256-prod-github-runner-207 kernel: [47904.616574] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 18:42:10 juju-e4d256-prod-github-runner-207 kernel: [47904.618574] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 18:42:10 juju-e4d256-prod-github-runner-207 kernel: [47904.619495] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 18:42:10 juju-e4d256-prod-github-runner-207 kernel: [47904.620395] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 18:42:10 juju-e4d256-prod-github-runner-207 kernel: [47904.621280] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 18:42:10 juju-e4d256-prod-github-runner-207 kernel: [47904.622164] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 18:42:10 juju-e4d256-prod-github-runner-207 kernel: [47904.623049] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 18:42:10 juju-e4d256-prod-github-runner-207 kernel: [47904.623949] Aug 22 18:42:38 juju-e4d256-prod-github-runner-207 kernel: [47932.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 44532s! [qemu-system-x86:6715] Aug 22 18:42:38 juju-e4d256-prod-github-runner-207 kernel: [47932.543091] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 18:42:38 juju-e4d256-prod-github-runner-207 kernel: [47932.543159] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 18:42:38 juju-e4d256-prod-github-runner-207 kernel: [47932.555593] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 18:42:38 juju-e4d256-prod-github-runner-207 kernel: [47932.556897] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 18:42:38 juju-e4d256-prod-github-runner-207 kernel: [47932.558149] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:42:38 juju-e4d256-prod-github-runner-207 kernel: [47932.559215] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 18:42:38 juju-e4d256-prod-github-runner-207 kernel: [47932.561831] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 18:42:38 juju-e4d256-prod-github-runner-207 kernel: [47932.562912] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 18:42:38 juju-e4d256-prod-github-runner-207 kernel: [47932.564112] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 18:42:38 juju-e4d256-prod-github-runner-207 kernel: [47932.565274] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 18:42:38 juju-e4d256-prod-github-runner-207 kernel: [47932.566465] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 18:42:38 juju-e4d256-prod-github-runner-207 kernel: [47932.567697] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 18:42:38 juju-e4d256-prod-github-runner-207 kernel: [47932.568890] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 18:42:38 juju-e4d256-prod-github-runner-207 kernel: [47932.570127] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 18:42:38 juju-e4d256-prod-github-runner-207 kernel: [47932.571253] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 18:42:38 juju-e4d256-prod-github-runner-207 kernel: [47932.572518] Call Trace: Aug 22 18:42:38 juju-e4d256-prod-github-runner-207 kernel: [47932.573493] Aug 22 18:42:38 juju-e4d256-prod-github-runner-207 kernel: [47932.574386] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:42:38 juju-e4d256-prod-github-runner-207 kernel: [47932.575484] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:42:38 juju-e4d256-prod-github-runner-207 kernel: [47932.576590] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:42:38 juju-e4d256-prod-github-runner-207 kernel: [47932.577712] ? show_regs.part.0+0x23/0x29 Aug 22 18:42:38 juju-e4d256-prod-github-runner-207 kernel: [47932.578733] ? show_regs.cold+0x8/0xd Aug 22 18:42:38 juju-e4d256-prod-github-runner-207 kernel: [47932.579780] ? watchdog_timer_fn+0x1be/0x220 Aug 22 18:42:38 juju-e4d256-prod-github-runner-207 kernel: [47932.580809] ? lockup_detector_update_enable+0x60/0x60 Aug 22 18:42:38 juju-e4d256-prod-github-runner-207 kernel: [47932.581900] ? __hrtimer_run_queues+0x107/0x230 Aug 22 18:42:38 juju-e4d256-prod-github-runner-207 kernel: [47932.583064] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 18:42:38 juju-e4d256-prod-github-runner-207 kernel: [47932.584176] ? hrtimer_interrupt+0x101/0x220 Aug 22 18:42:38 juju-e4d256-prod-github-runner-207 kernel: [47932.585212] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 18:42:38 juju-e4d256-prod-github-runner-207 kernel: [47932.586284] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 18:42:38 juju-e4d256-prod-github-runner-207 kernel: [47932.587350] Aug 22 18:42:38 juju-e4d256-prod-github-runner-207 kernel: [47932.588274] Aug 22 18:42:38 juju-e4d256-prod-github-runner-207 kernel: [47932.589146] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 18:42:38 juju-e4d256-prod-github-runner-207 kernel: [47932.590193] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:42:38 juju-e4d256-prod-github-runner-207 kernel: [47932.591234] ? _raw_spin_lock+0x22/0x30 Aug 22 18:42:38 juju-e4d256-prod-github-runner-207 kernel: [47932.592197] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:42:38 juju-e4d256-prod-github-runner-207 kernel: [47932.593305] direct_page_fault+0x206/0x310 [kvm] Aug 22 18:42:38 juju-e4d256-prod-github-runner-207 kernel: [47932.594379] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 18:42:38 juju-e4d256-prod-github-runner-207 kernel: [47932.595420] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 18:42:38 juju-e4d256-prod-github-runner-207 kernel: [47932.596428] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 18:42:38 juju-e4d256-prod-github-runner-207 kernel: [47932.597402] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 18:42:38 juju-e4d256-prod-github-runner-207 kernel: [47932.598368] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 18:42:38 juju-e4d256-prod-github-runner-207 kernel: [47932.599363] handle_exit+0x98/0x230 [kvm_amd] Aug 22 18:42:38 juju-e4d256-prod-github-runner-207 kernel: [47932.600282] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 18:42:38 juju-e4d256-prod-github-runner-207 kernel: [47932.601203] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 18:42:38 juju-e4d256-prod-github-runner-207 kernel: [47932.602135] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 18:42:38 juju-e4d256-prod-github-runner-207 kernel: [47932.603044] vcpu_run+0x62/0x2c0 [kvm] Aug 22 18:42:38 juju-e4d256-prod-github-runner-207 kernel: [47932.603895] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 18:42:38 juju-e4d256-prod-github-runner-207 kernel: [47932.604739] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 18:42:38 juju-e4d256-prod-github-runner-207 kernel: [47932.605654] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 18:42:38 juju-e4d256-prod-github-runner-207 kernel: [47932.606510] ? __seccomp_filter+0x4a/0x4a0 Aug 22 18:42:38 juju-e4d256-prod-github-runner-207 kernel: [47932.607265] ? __fget_files+0x86/0xc0 Aug 22 18:42:38 juju-e4d256-prod-github-runner-207 kernel: [47932.608005] __x64_sys_ioctl+0x95/0xd0 Aug 22 18:42:38 juju-e4d256-prod-github-runner-207 kernel: [47932.608713] do_syscall_64+0x5c/0xc0 Aug 22 18:42:38 juju-e4d256-prod-github-runner-207 kernel: [47932.609388] ? do_futex+0x162/0x1f0 Aug 22 18:42:38 juju-e4d256-prod-github-runner-207 kernel: [47932.610056] ? __x64_sys_futex+0x78/0x1e0 Aug 22 18:42:38 juju-e4d256-prod-github-runner-207 kernel: [47932.610737] ? __secure_computing+0xa9/0x120 Aug 22 18:42:38 juju-e4d256-prod-github-runner-207 kernel: [47932.611460] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 18:42:38 juju-e4d256-prod-github-runner-207 kernel: [47932.612252] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:42:38 juju-e4d256-prod-github-runner-207 kernel: [47932.612994] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:42:38 juju-e4d256-prod-github-runner-207 kernel: [47932.613737] ? do_syscall_64+0x69/0xc0 Aug 22 18:42:38 juju-e4d256-prod-github-runner-207 kernel: [47932.614405] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:42:38 juju-e4d256-prod-github-runner-207 kernel: [47932.615139] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:42:38 juju-e4d256-prod-github-runner-207 kernel: [47932.615863] ? do_syscall_64+0x69/0xc0 Aug 22 18:42:38 juju-e4d256-prod-github-runner-207 kernel: [47932.616494] ? do_syscall_64+0x69/0xc0 Aug 22 18:42:38 juju-e4d256-prod-github-runner-207 kernel: [47932.617126] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 18:42:38 juju-e4d256-prod-github-runner-207 kernel: [47932.617840] RIP: 0033:0x7faa5d0edaff Aug 22 18:42:38 juju-e4d256-prod-github-runner-207 kernel: [47932.618469] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 18:42:38 juju-e4d256-prod-github-runner-207 kernel: [47932.620500] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 18:42:38 juju-e4d256-prod-github-runner-207 kernel: [47932.621423] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 18:42:38 juju-e4d256-prod-github-runner-207 kernel: [47932.622320] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 18:42:38 juju-e4d256-prod-github-runner-207 kernel: [47932.623218] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 18:42:38 juju-e4d256-prod-github-runner-207 kernel: [47932.624147] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 18:42:38 juju-e4d256-prod-github-runner-207 kernel: [47932.625067] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 18:42:38 juju-e4d256-prod-github-runner-207 kernel: [47932.625970] Aug 22 18:43:06 juju-e4d256-prod-github-runner-207 kernel: [47960.541976] watchdog: BUG: soft lockup - CPU#1 stuck for 44558s! [qemu-system-x86:6715] Aug 22 18:43:06 juju-e4d256-prod-github-runner-207 kernel: [47960.543125] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 18:43:06 juju-e4d256-prod-github-runner-207 kernel: [47960.543193] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 18:43:06 juju-e4d256-prod-github-runner-207 kernel: [47960.555344] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 18:43:06 juju-e4d256-prod-github-runner-207 kernel: [47960.556630] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 18:43:06 juju-e4d256-prod-github-runner-207 kernel: [47960.557855] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:43:06 juju-e4d256-prod-github-runner-207 kernel: [47960.558955] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 18:43:06 juju-e4d256-prod-github-runner-207 kernel: [47960.561595] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 18:43:06 juju-e4d256-prod-github-runner-207 kernel: [47960.562649] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 18:43:06 juju-e4d256-prod-github-runner-207 kernel: [47960.563838] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 18:43:06 juju-e4d256-prod-github-runner-207 kernel: [47960.565022] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 18:43:06 juju-e4d256-prod-github-runner-207 kernel: [47960.566213] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 18:43:06 juju-e4d256-prod-github-runner-207 kernel: [47960.567400] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 18:43:06 juju-e4d256-prod-github-runner-207 kernel: [47960.568572] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 18:43:06 juju-e4d256-prod-github-runner-207 kernel: [47960.569864] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 18:43:06 juju-e4d256-prod-github-runner-207 kernel: [47960.571002] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 18:43:06 juju-e4d256-prod-github-runner-207 kernel: [47960.572234] Call Trace: Aug 22 18:43:06 juju-e4d256-prod-github-runner-207 kernel: [47960.573152] Aug 22 18:43:06 juju-e4d256-prod-github-runner-207 kernel: [47960.574040] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:43:06 juju-e4d256-prod-github-runner-207 kernel: [47960.575127] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:43:06 juju-e4d256-prod-github-runner-207 kernel: [47960.576180] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:43:06 juju-e4d256-prod-github-runner-207 kernel: [47960.577267] ? show_regs.part.0+0x23/0x29 Aug 22 18:43:06 juju-e4d256-prod-github-runner-207 kernel: [47960.578272] ? show_regs.cold+0x8/0xd Aug 22 18:43:06 juju-e4d256-prod-github-runner-207 kernel: [47960.579274] ? watchdog_timer_fn+0x1be/0x220 Aug 22 18:43:06 juju-e4d256-prod-github-runner-207 kernel: [47960.580299] ? lockup_detector_update_enable+0x60/0x60 Aug 22 18:43:06 juju-e4d256-prod-github-runner-207 kernel: [47960.581384] ? __hrtimer_run_queues+0x107/0x230 Aug 22 18:43:06 juju-e4d256-prod-github-runner-207 kernel: [47960.582432] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 18:43:06 juju-e4d256-prod-github-runner-207 kernel: [47960.583559] ? hrtimer_interrupt+0x101/0x220 Aug 22 18:43:06 juju-e4d256-prod-github-runner-207 kernel: [47960.584578] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 18:43:06 juju-e4d256-prod-github-runner-207 kernel: [47960.585675] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 18:43:06 juju-e4d256-prod-github-runner-207 kernel: [47960.586742] Aug 22 18:43:06 juju-e4d256-prod-github-runner-207 kernel: [47960.587620] Aug 22 18:43:06 juju-e4d256-prod-github-runner-207 kernel: [47960.588463] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 18:43:06 juju-e4d256-prod-github-runner-207 kernel: [47960.589499] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:43:06 juju-e4d256-prod-github-runner-207 kernel: [47960.590550] ? _raw_spin_lock+0x22/0x30 Aug 22 18:43:06 juju-e4d256-prod-github-runner-207 kernel: [47960.591530] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:43:06 juju-e4d256-prod-github-runner-207 kernel: [47960.592565] direct_page_fault+0x206/0x310 [kvm] Aug 22 18:43:06 juju-e4d256-prod-github-runner-207 kernel: [47960.593595] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 18:43:06 juju-e4d256-prod-github-runner-207 kernel: [47960.594607] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 18:43:06 juju-e4d256-prod-github-runner-207 kernel: [47960.595642] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 18:43:06 juju-e4d256-prod-github-runner-207 kernel: [47960.596634] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 18:43:06 juju-e4d256-prod-github-runner-207 kernel: [47960.597593] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 18:43:06 juju-e4d256-prod-github-runner-207 kernel: [47960.598578] handle_exit+0x98/0x230 [kvm_amd] Aug 22 18:43:06 juju-e4d256-prod-github-runner-207 kernel: [47960.599502] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 18:43:06 juju-e4d256-prod-github-runner-207 kernel: [47960.600607] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 18:43:06 juju-e4d256-prod-github-runner-207 kernel: [47960.601553] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 18:43:06 juju-e4d256-prod-github-runner-207 kernel: [47960.602467] vcpu_run+0x62/0x2c0 [kvm] Aug 22 18:43:06 juju-e4d256-prod-github-runner-207 kernel: [47960.603305] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 18:43:06 juju-e4d256-prod-github-runner-207 kernel: [47960.604122] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 18:43:06 juju-e4d256-prod-github-runner-207 kernel: [47960.604983] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 18:43:06 juju-e4d256-prod-github-runner-207 kernel: [47960.605796] ? __seccomp_filter+0x4a/0x4a0 Aug 22 18:43:06 juju-e4d256-prod-github-runner-207 kernel: [47960.606547] ? __fget_files+0x86/0xc0 Aug 22 18:43:06 juju-e4d256-prod-github-runner-207 kernel: [47960.607293] __x64_sys_ioctl+0x95/0xd0 Aug 22 18:43:06 juju-e4d256-prod-github-runner-207 kernel: [47960.607994] do_syscall_64+0x5c/0xc0 Aug 22 18:43:06 juju-e4d256-prod-github-runner-207 kernel: [47960.608792] ? do_futex+0x162/0x1f0 Aug 22 18:43:06 juju-e4d256-prod-github-runner-207 kernel: [47960.609445] ? __x64_sys_futex+0x78/0x1e0 Aug 22 18:43:06 juju-e4d256-prod-github-runner-207 kernel: [47960.610124] ? __secure_computing+0xa9/0x120 Aug 22 18:43:06 juju-e4d256-prod-github-runner-207 kernel: [47960.610839] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 18:43:06 juju-e4d256-prod-github-runner-207 kernel: [47960.611630] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:43:06 juju-e4d256-prod-github-runner-207 kernel: [47960.612377] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:43:06 juju-e4d256-prod-github-runner-207 kernel: [47960.613105] ? do_syscall_64+0x69/0xc0 Aug 22 18:43:06 juju-e4d256-prod-github-runner-207 kernel: [47960.613757] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:43:06 juju-e4d256-prod-github-runner-207 kernel: [47960.614468] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:43:06 juju-e4d256-prod-github-runner-207 kernel: [47960.615189] ? do_syscall_64+0x69/0xc0 Aug 22 18:43:06 juju-e4d256-prod-github-runner-207 kernel: [47960.615822] ? do_syscall_64+0x69/0xc0 Aug 22 18:43:06 juju-e4d256-prod-github-runner-207 kernel: [47960.616464] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 18:43:06 juju-e4d256-prod-github-runner-207 kernel: [47960.617201] RIP: 0033:0x7faa5d0edaff Aug 22 18:43:06 juju-e4d256-prod-github-runner-207 kernel: [47960.617837] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 18:43:06 juju-e4d256-prod-github-runner-207 kernel: [47960.619861] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 18:43:06 juju-e4d256-prod-github-runner-207 kernel: [47960.620782] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 18:43:06 juju-e4d256-prod-github-runner-207 kernel: [47960.621695] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 18:43:06 juju-e4d256-prod-github-runner-207 kernel: [47960.622612] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 18:43:06 juju-e4d256-prod-github-runner-207 kernel: [47960.623538] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 18:43:06 juju-e4d256-prod-github-runner-207 kernel: [47960.624435] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 18:43:06 juju-e4d256-prod-github-runner-207 kernel: [47960.625339] Aug 22 18:43:34 juju-e4d256-prod-github-runner-207 kernel: [47988.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 44584s! [qemu-system-x86:6715] Aug 22 18:43:34 juju-e4d256-prod-github-runner-207 kernel: [47988.543744] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 18:43:34 juju-e4d256-prod-github-runner-207 kernel: [47988.543996] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 18:43:34 juju-e4d256-prod-github-runner-207 kernel: [47988.556093] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 18:43:34 juju-e4d256-prod-github-runner-207 kernel: [47988.557370] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 18:43:34 juju-e4d256-prod-github-runner-207 kernel: [47988.558590] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:43:34 juju-e4d256-prod-github-runner-207 kernel: [47988.559704] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 18:43:34 juju-e4d256-prod-github-runner-207 kernel: [47988.562308] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 18:43:34 juju-e4d256-prod-github-runner-207 kernel: [47988.563387] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 18:43:34 juju-e4d256-prod-github-runner-207 kernel: [47988.564549] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 18:43:34 juju-e4d256-prod-github-runner-207 kernel: [47988.565938] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 18:43:34 juju-e4d256-prod-github-runner-207 kernel: [47988.567118] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 18:43:34 juju-e4d256-prod-github-runner-207 kernel: [47988.568289] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 18:43:34 juju-e4d256-prod-github-runner-207 kernel: [47988.569487] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 18:43:34 juju-e4d256-prod-github-runner-207 kernel: [47988.570761] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 18:43:34 juju-e4d256-prod-github-runner-207 kernel: [47988.571857] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 18:43:34 juju-e4d256-prod-github-runner-207 kernel: [47988.573048] Call Trace: Aug 22 18:43:34 juju-e4d256-prod-github-runner-207 kernel: [47988.573960] Aug 22 18:43:34 juju-e4d256-prod-github-runner-207 kernel: [47988.574886] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:43:34 juju-e4d256-prod-github-runner-207 kernel: [47988.575948] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:43:34 juju-e4d256-prod-github-runner-207 kernel: [47988.576979] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:43:34 juju-e4d256-prod-github-runner-207 kernel: [47988.578072] ? show_regs.part.0+0x23/0x29 Aug 22 18:43:34 juju-e4d256-prod-github-runner-207 kernel: [47988.579114] ? show_regs.cold+0x8/0xd Aug 22 18:43:34 juju-e4d256-prod-github-runner-207 kernel: [47988.580117] ? watchdog_timer_fn+0x1be/0x220 Aug 22 18:43:34 juju-e4d256-prod-github-runner-207 kernel: [47988.581125] ? lockup_detector_update_enable+0x60/0x60 Aug 22 18:43:34 juju-e4d256-prod-github-runner-207 kernel: [47988.582186] ? __hrtimer_run_queues+0x107/0x230 Aug 22 18:43:34 juju-e4d256-prod-github-runner-207 kernel: [47988.583245] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 18:43:34 juju-e4d256-prod-github-runner-207 kernel: [47988.584281] ? hrtimer_interrupt+0x101/0x220 Aug 22 18:43:34 juju-e4d256-prod-github-runner-207 kernel: [47988.585298] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 18:43:34 juju-e4d256-prod-github-runner-207 kernel: [47988.586382] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 18:43:34 juju-e4d256-prod-github-runner-207 kernel: [47988.587461] Aug 22 18:43:34 juju-e4d256-prod-github-runner-207 kernel: [47988.588319] Aug 22 18:43:34 juju-e4d256-prod-github-runner-207 kernel: [47988.589159] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 18:43:34 juju-e4d256-prod-github-runner-207 kernel: [47988.590218] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:43:34 juju-e4d256-prod-github-runner-207 kernel: [47988.591343] ? _raw_spin_lock+0x22/0x30 Aug 22 18:43:34 juju-e4d256-prod-github-runner-207 kernel: [47988.592319] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:43:34 juju-e4d256-prod-github-runner-207 kernel: [47988.593348] direct_page_fault+0x206/0x310 [kvm] Aug 22 18:43:34 juju-e4d256-prod-github-runner-207 kernel: [47988.594378] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 18:43:34 juju-e4d256-prod-github-runner-207 kernel: [47988.595408] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 18:43:34 juju-e4d256-prod-github-runner-207 kernel: [47988.596412] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 18:43:34 juju-e4d256-prod-github-runner-207 kernel: [47988.597444] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 18:43:34 juju-e4d256-prod-github-runner-207 kernel: [47988.598400] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 18:43:34 juju-e4d256-prod-github-runner-207 kernel: [47988.599395] handle_exit+0x98/0x230 [kvm_amd] Aug 22 18:43:34 juju-e4d256-prod-github-runner-207 kernel: [47988.600290] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 18:43:34 juju-e4d256-prod-github-runner-207 kernel: [47988.601201] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 18:43:34 juju-e4d256-prod-github-runner-207 kernel: [47988.602123] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 18:43:34 juju-e4d256-prod-github-runner-207 kernel: [47988.603038] vcpu_run+0x62/0x2c0 [kvm] Aug 22 18:43:34 juju-e4d256-prod-github-runner-207 kernel: [47988.603861] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 18:43:34 juju-e4d256-prod-github-runner-207 kernel: [47988.604681] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 18:43:34 juju-e4d256-prod-github-runner-207 kernel: [47988.605548] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 18:43:34 juju-e4d256-prod-github-runner-207 kernel: [47988.606347] ? __seccomp_filter+0x4a/0x4a0 Aug 22 18:43:34 juju-e4d256-prod-github-runner-207 kernel: [47988.607121] ? __fget_files+0x86/0xc0 Aug 22 18:43:34 juju-e4d256-prod-github-runner-207 kernel: [47988.607851] __x64_sys_ioctl+0x95/0xd0 Aug 22 18:43:34 juju-e4d256-prod-github-runner-207 kernel: [47988.608557] do_syscall_64+0x5c/0xc0 Aug 22 18:43:34 juju-e4d256-prod-github-runner-207 kernel: [47988.609249] ? do_futex+0x162/0x1f0 Aug 22 18:43:34 juju-e4d256-prod-github-runner-207 kernel: [47988.609912] ? __x64_sys_futex+0x78/0x1e0 Aug 22 18:43:34 juju-e4d256-prod-github-runner-207 kernel: [47988.610640] ? __secure_computing+0xa9/0x120 Aug 22 18:43:34 juju-e4d256-prod-github-runner-207 kernel: [47988.611371] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 18:43:34 juju-e4d256-prod-github-runner-207 kernel: [47988.612187] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:43:34 juju-e4d256-prod-github-runner-207 kernel: [47988.612934] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:43:34 juju-e4d256-prod-github-runner-207 kernel: [47988.613680] ? do_syscall_64+0x69/0xc0 Aug 22 18:43:34 juju-e4d256-prod-github-runner-207 kernel: [47988.614363] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:43:34 juju-e4d256-prod-github-runner-207 kernel: [47988.615182] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:43:34 juju-e4d256-prod-github-runner-207 kernel: [47988.615957] ? do_syscall_64+0x69/0xc0 Aug 22 18:43:34 juju-e4d256-prod-github-runner-207 kernel: [47988.616653] ? do_syscall_64+0x69/0xc0 Aug 22 18:43:34 juju-e4d256-prod-github-runner-207 kernel: [47988.617365] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 18:43:34 juju-e4d256-prod-github-runner-207 kernel: [47988.618111] RIP: 0033:0x7faa5d0edaff Aug 22 18:43:34 juju-e4d256-prod-github-runner-207 kernel: [47988.618971] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 18:43:34 juju-e4d256-prod-github-runner-207 kernel: [47988.621010] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 18:43:34 juju-e4d256-prod-github-runner-207 kernel: [47988.621942] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 18:43:34 juju-e4d256-prod-github-runner-207 kernel: [47988.622862] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 18:43:34 juju-e4d256-prod-github-runner-207 kernel: [47988.623762] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 18:43:34 juju-e4d256-prod-github-runner-207 kernel: [47988.624653] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 18:43:34 juju-e4d256-prod-github-runner-207 kernel: [47988.625543] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 18:43:34 juju-e4d256-prod-github-runner-207 kernel: [47988.626438] Aug 22 18:44:02 juju-e4d256-prod-github-runner-207 kernel: [48016.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 44610s! [qemu-system-x86:6715] Aug 22 18:44:02 juju-e4d256-prod-github-runner-207 kernel: [48016.543119] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 18:44:02 juju-e4d256-prod-github-runner-207 kernel: [48016.543188] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 18:44:02 juju-e4d256-prod-github-runner-207 kernel: [48016.555562] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 18:44:02 juju-e4d256-prod-github-runner-207 kernel: [48016.556886] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 18:44:02 juju-e4d256-prod-github-runner-207 kernel: [48016.558122] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:44:02 juju-e4d256-prod-github-runner-207 kernel: [48016.559243] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 18:44:02 juju-e4d256-prod-github-runner-207 kernel: [48016.561817] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 18:44:02 juju-e4d256-prod-github-runner-207 kernel: [48016.562923] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 18:44:02 juju-e4d256-prod-github-runner-207 kernel: [48016.564162] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 18:44:02 juju-e4d256-prod-github-runner-207 kernel: [48016.565383] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 18:44:02 juju-e4d256-prod-github-runner-207 kernel: [48016.566718] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 18:44:02 juju-e4d256-prod-github-runner-207 kernel: [48016.568016] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 18:44:02 juju-e4d256-prod-github-runner-207 kernel: [48016.569316] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 18:44:02 juju-e4d256-prod-github-runner-207 kernel: [48016.570711] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 18:44:02 juju-e4d256-prod-github-runner-207 kernel: [48016.571921] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 18:44:02 juju-e4d256-prod-github-runner-207 kernel: [48016.573245] Call Trace: Aug 22 18:44:02 juju-e4d256-prod-github-runner-207 kernel: [48016.574212] Aug 22 18:44:02 juju-e4d256-prod-github-runner-207 kernel: [48016.575151] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:44:02 juju-e4d256-prod-github-runner-207 kernel: [48016.576266] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:44:02 juju-e4d256-prod-github-runner-207 kernel: [48016.577374] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:44:02 juju-e4d256-prod-github-runner-207 kernel: [48016.578597] ? show_regs.part.0+0x23/0x29 Aug 22 18:44:02 juju-e4d256-prod-github-runner-207 kernel: [48016.579694] ? show_regs.cold+0x8/0xd Aug 22 18:44:02 juju-e4d256-prod-github-runner-207 kernel: [48016.580737] ? watchdog_timer_fn+0x1be/0x220 Aug 22 18:44:02 juju-e4d256-prod-github-runner-207 kernel: [48016.581821] ? lockup_detector_update_enable+0x60/0x60 Aug 22 18:44:02 juju-e4d256-prod-github-runner-207 kernel: [48016.582990] ? __hrtimer_run_queues+0x107/0x230 Aug 22 18:44:02 juju-e4d256-prod-github-runner-207 kernel: [48016.584103] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 18:44:02 juju-e4d256-prod-github-runner-207 kernel: [48016.585209] ? hrtimer_interrupt+0x101/0x220 Aug 22 18:44:02 juju-e4d256-prod-github-runner-207 kernel: [48016.586305] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 18:44:02 juju-e4d256-prod-github-runner-207 kernel: [48016.587490] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 18:44:02 juju-e4d256-prod-github-runner-207 kernel: [48016.588631] Aug 22 18:44:02 juju-e4d256-prod-github-runner-207 kernel: [48016.589527] Aug 22 18:44:02 juju-e4d256-prod-github-runner-207 kernel: [48016.590424] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 18:44:02 juju-e4d256-prod-github-runner-207 kernel: [48016.591562] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:44:02 juju-e4d256-prod-github-runner-207 kernel: [48016.592701] ? _raw_spin_lock+0x22/0x30 Aug 22 18:44:02 juju-e4d256-prod-github-runner-207 kernel: [48016.593724] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:44:02 juju-e4d256-prod-github-runner-207 kernel: [48016.594852] direct_page_fault+0x206/0x310 [kvm] Aug 22 18:44:02 juju-e4d256-prod-github-runner-207 kernel: [48016.595962] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 18:44:02 juju-e4d256-prod-github-runner-207 kernel: [48016.597055] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 18:44:02 juju-e4d256-prod-github-runner-207 kernel: [48016.598140] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 18:44:02 juju-e4d256-prod-github-runner-207 kernel: [48016.599227] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 18:44:02 juju-e4d256-prod-github-runner-207 kernel: [48016.600269] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 18:44:02 juju-e4d256-prod-github-runner-207 kernel: [48016.601359] handle_exit+0x98/0x230 [kvm_amd] Aug 22 18:44:02 juju-e4d256-prod-github-runner-207 kernel: [48016.602355] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 18:44:02 juju-e4d256-prod-github-runner-207 kernel: [48016.603360] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 18:44:02 juju-e4d256-prod-github-runner-207 kernel: [48016.604390] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 18:44:02 juju-e4d256-prod-github-runner-207 kernel: [48016.605393] vcpu_run+0x62/0x2c0 [kvm] Aug 22 18:44:02 juju-e4d256-prod-github-runner-207 kernel: [48016.606280] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 18:44:02 juju-e4d256-prod-github-runner-207 kernel: [48016.607184] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 18:44:02 juju-e4d256-prod-github-runner-207 kernel: [48016.608166] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 18:44:02 juju-e4d256-prod-github-runner-207 kernel: [48016.609066] ? __seccomp_filter+0x4a/0x4a0 Aug 22 18:44:02 juju-e4d256-prod-github-runner-207 kernel: [48016.609891] ? __fget_files+0x86/0xc0 Aug 22 18:44:02 juju-e4d256-prod-github-runner-207 kernel: [48016.610677] __x64_sys_ioctl+0x95/0xd0 Aug 22 18:44:02 juju-e4d256-prod-github-runner-207 kernel: [48016.611442] do_syscall_64+0x5c/0xc0 Aug 22 18:44:02 juju-e4d256-prod-github-runner-207 kernel: [48016.612174] ? do_futex+0x162/0x1f0 Aug 22 18:44:02 juju-e4d256-prod-github-runner-207 kernel: [48016.612895] ? __x64_sys_futex+0x78/0x1e0 Aug 22 18:44:02 juju-e4d256-prod-github-runner-207 kernel: [48016.613648] ? __secure_computing+0xa9/0x120 Aug 22 18:44:02 juju-e4d256-prod-github-runner-207 kernel: [48016.614430] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 18:44:02 juju-e4d256-prod-github-runner-207 kernel: [48016.615290] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:44:02 juju-e4d256-prod-github-runner-207 kernel: [48016.616104] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:44:02 juju-e4d256-prod-github-runner-207 kernel: [48016.616909] ? do_syscall_64+0x69/0xc0 Aug 22 18:44:02 juju-e4d256-prod-github-runner-207 kernel: [48016.617628] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:44:02 juju-e4d256-prod-github-runner-207 kernel: [48016.618437] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:44:02 juju-e4d256-prod-github-runner-207 kernel: [48016.619230] ? do_syscall_64+0x69/0xc0 Aug 22 18:44:02 juju-e4d256-prod-github-runner-207 kernel: [48016.619929] ? do_syscall_64+0x69/0xc0 Aug 22 18:44:02 juju-e4d256-prod-github-runner-207 kernel: [48016.620820] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 18:44:02 juju-e4d256-prod-github-runner-207 kernel: [48016.621625] RIP: 0033:0x7faa5d0edaff Aug 22 18:44:02 juju-e4d256-prod-github-runner-207 kernel: [48016.622339] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 18:44:02 juju-e4d256-prod-github-runner-207 kernel: [48016.624656] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 18:44:02 juju-e4d256-prod-github-runner-207 kernel: [48016.625711] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 18:44:02 juju-e4d256-prod-github-runner-207 kernel: [48016.626745] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 18:44:02 juju-e4d256-prod-github-runner-207 kernel: [48016.627771] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 18:44:02 juju-e4d256-prod-github-runner-207 kernel: [48016.628800] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 18:44:02 juju-e4d256-prod-github-runner-207 kernel: [48016.629827] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 18:44:02 juju-e4d256-prod-github-runner-207 kernel: [48016.630875] Aug 22 18:44:30 juju-e4d256-prod-github-runner-207 kernel: [48044.541986] watchdog: BUG: soft lockup - CPU#1 stuck for 44636s! [qemu-system-x86:6715] Aug 22 18:44:30 juju-e4d256-prod-github-runner-207 kernel: [48044.543093] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 18:44:30 juju-e4d256-prod-github-runner-207 kernel: [48044.543160] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 18:44:30 juju-e4d256-prod-github-runner-207 kernel: [48044.555292] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 18:44:30 juju-e4d256-prod-github-runner-207 kernel: [48044.556565] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 18:44:30 juju-e4d256-prod-github-runner-207 kernel: [48044.557794] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:44:30 juju-e4d256-prod-github-runner-207 kernel: [48044.558869] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 18:44:30 juju-e4d256-prod-github-runner-207 kernel: [48044.561419] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 18:44:30 juju-e4d256-prod-github-runner-207 kernel: [48044.562480] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 18:44:30 juju-e4d256-prod-github-runner-207 kernel: [48044.563643] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 18:44:30 juju-e4d256-prod-github-runner-207 kernel: [48044.564805] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 18:44:30 juju-e4d256-prod-github-runner-207 kernel: [48044.565965] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 18:44:30 juju-e4d256-prod-github-runner-207 kernel: [48044.567139] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 18:44:30 juju-e4d256-prod-github-runner-207 kernel: [48044.568307] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 18:44:30 juju-e4d256-prod-github-runner-207 kernel: [48044.569545] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 18:44:30 juju-e4d256-prod-github-runner-207 kernel: [48044.570668] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 18:44:30 juju-e4d256-prod-github-runner-207 kernel: [48044.571871] Call Trace: Aug 22 18:44:30 juju-e4d256-prod-github-runner-207 kernel: [48044.572785] Aug 22 18:44:30 juju-e4d256-prod-github-runner-207 kernel: [48044.573669] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:44:30 juju-e4d256-prod-github-runner-207 kernel: [48044.574724] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:44:30 juju-e4d256-prod-github-runner-207 kernel: [48044.575755] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:44:30 juju-e4d256-prod-github-runner-207 kernel: [48044.576832] ? show_regs.part.0+0x23/0x29 Aug 22 18:44:30 juju-e4d256-prod-github-runner-207 kernel: [48044.577831] ? show_regs.cold+0x8/0xd Aug 22 18:44:30 juju-e4d256-prod-github-runner-207 kernel: [48044.578812] ? watchdog_timer_fn+0x1be/0x220 Aug 22 18:44:30 juju-e4d256-prod-github-runner-207 kernel: [48044.579827] ? lockup_detector_update_enable+0x60/0x60 Aug 22 18:44:30 juju-e4d256-prod-github-runner-207 kernel: [48044.580896] ? __hrtimer_run_queues+0x107/0x230 Aug 22 18:44:30 juju-e4d256-prod-github-runner-207 kernel: [48044.581924] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 18:44:30 juju-e4d256-prod-github-runner-207 kernel: [48044.582962] ? hrtimer_interrupt+0x101/0x220 Aug 22 18:44:30 juju-e4d256-prod-github-runner-207 kernel: [48044.583977] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 18:44:30 juju-e4d256-prod-github-runner-207 kernel: [48044.585052] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 18:44:30 juju-e4d256-prod-github-runner-207 kernel: [48044.586115] Aug 22 18:44:30 juju-e4d256-prod-github-runner-207 kernel: [48044.586970] Aug 22 18:44:30 juju-e4d256-prod-github-runner-207 kernel: [48044.587831] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 18:44:30 juju-e4d256-prod-github-runner-207 kernel: [48044.588879] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:44:30 juju-e4d256-prod-github-runner-207 kernel: [48044.589919] ? _raw_spin_lock+0x22/0x30 Aug 22 18:44:30 juju-e4d256-prod-github-runner-207 kernel: [48044.590895] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:44:30 juju-e4d256-prod-github-runner-207 kernel: [48044.591915] direct_page_fault+0x206/0x310 [kvm] Aug 22 18:44:30 juju-e4d256-prod-github-runner-207 kernel: [48044.593040] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 18:44:30 juju-e4d256-prod-github-runner-207 kernel: [48044.594063] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 18:44:30 juju-e4d256-prod-github-runner-207 kernel: [48044.595188] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 18:44:30 juju-e4d256-prod-github-runner-207 kernel: [48044.596256] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 18:44:30 juju-e4d256-prod-github-runner-207 kernel: [48044.597303] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 18:44:30 juju-e4d256-prod-github-runner-207 kernel: [48044.598430] handle_exit+0x98/0x230 [kvm_amd] Aug 22 18:44:30 juju-e4d256-prod-github-runner-207 kernel: [48044.599408] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 18:44:30 juju-e4d256-prod-github-runner-207 kernel: [48044.600421] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 18:44:30 juju-e4d256-prod-github-runner-207 kernel: [48044.601442] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 18:44:30 juju-e4d256-prod-github-runner-207 kernel: [48044.602463] vcpu_run+0x62/0x2c0 [kvm] Aug 22 18:44:30 juju-e4d256-prod-github-runner-207 kernel: [48044.603368] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 18:44:30 juju-e4d256-prod-github-runner-207 kernel: [48044.604269] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 18:44:30 juju-e4d256-prod-github-runner-207 kernel: [48044.605226] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 18:44:30 juju-e4d256-prod-github-runner-207 kernel: [48044.606147] ? __seccomp_filter+0x4a/0x4a0 Aug 22 18:44:30 juju-e4d256-prod-github-runner-207 kernel: [48044.606982] ? __fget_files+0x86/0xc0 Aug 22 18:44:30 juju-e4d256-prod-github-runner-207 kernel: [48044.607762] __x64_sys_ioctl+0x95/0xd0 Aug 22 18:44:30 juju-e4d256-prod-github-runner-207 kernel: [48044.608537] do_syscall_64+0x5c/0xc0 Aug 22 18:44:30 juju-e4d256-prod-github-runner-207 kernel: [48044.609278] ? do_futex+0x162/0x1f0 Aug 22 18:44:30 juju-e4d256-prod-github-runner-207 kernel: [48044.610020] ? __x64_sys_futex+0x78/0x1e0 Aug 22 18:44:30 juju-e4d256-prod-github-runner-207 kernel: [48044.610775] ? __secure_computing+0xa9/0x120 Aug 22 18:44:30 juju-e4d256-prod-github-runner-207 kernel: [48044.611558] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 18:44:30 juju-e4d256-prod-github-runner-207 kernel: [48044.612423] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:44:30 juju-e4d256-prod-github-runner-207 kernel: [48044.613246] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:44:30 juju-e4d256-prod-github-runner-207 kernel: [48044.614137] ? do_syscall_64+0x69/0xc0 Aug 22 18:44:30 juju-e4d256-prod-github-runner-207 kernel: [48044.614864] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:44:30 juju-e4d256-prod-github-runner-207 kernel: [48044.615661] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:44:30 juju-e4d256-prod-github-runner-207 kernel: [48044.616465] ? do_syscall_64+0x69/0xc0 Aug 22 18:44:30 juju-e4d256-prod-github-runner-207 kernel: [48044.617173] ? do_syscall_64+0x69/0xc0 Aug 22 18:44:30 juju-e4d256-prod-github-runner-207 kernel: [48044.617886] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 18:44:30 juju-e4d256-prod-github-runner-207 kernel: [48044.618723] RIP: 0033:0x7faa5d0edaff Aug 22 18:44:30 juju-e4d256-prod-github-runner-207 kernel: [48044.619420] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 18:44:30 juju-e4d256-prod-github-runner-207 kernel: [48044.621729] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 18:44:30 juju-e4d256-prod-github-runner-207 kernel: [48044.622808] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 18:44:30 juju-e4d256-prod-github-runner-207 kernel: [48044.623836] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 18:44:30 juju-e4d256-prod-github-runner-207 kernel: [48044.624864] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 18:44:30 juju-e4d256-prod-github-runner-207 kernel: [48044.625887] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 18:44:30 juju-e4d256-prod-github-runner-207 kernel: [48044.626932] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 18:44:30 juju-e4d256-prod-github-runner-207 kernel: [48044.627968] Aug 22 18:44:46 juju-e4d256-prod-github-runner-207 kernel: [48060.392706] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 18:44:46 juju-e4d256-prod-github-runner-207 kernel: [48060.393741] rcu: 1-....: (11948112 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=5778751 Aug 22 18:44:46 juju-e4d256-prod-github-runner-207 kernel: [48060.394882] (t=11985798 jiffies g=23269 q=46329) Aug 22 18:44:46 juju-e4d256-prod-github-runner-207 kernel: [48060.395669] NMI backtrace for cpu 1 Aug 22 18:44:46 juju-e4d256-prod-github-runner-207 kernel: [48060.396382] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 18:44:46 juju-e4d256-prod-github-runner-207 kernel: [48060.397488] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 18:44:46 juju-e4d256-prod-github-runner-207 kernel: [48060.398566] Call Trace: Aug 22 18:44:46 juju-e4d256-prod-github-runner-207 kernel: [48060.399242] Aug 22 18:44:46 juju-e4d256-prod-github-runner-207 kernel: [48060.399886] show_stack+0x52/0x5c Aug 22 18:44:46 juju-e4d256-prod-github-runner-207 kernel: [48060.400612] dump_stack_lvl+0x4a/0x63 Aug 22 18:44:46 juju-e4d256-prod-github-runner-207 kernel: [48060.401360] dump_stack+0x10/0x16 Aug 22 18:44:46 juju-e4d256-prod-github-runner-207 kernel: [48060.402092] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 18:44:46 juju-e4d256-prod-github-runner-207 kernel: [48060.402883] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 18:44:46 juju-e4d256-prod-github-runner-207 kernel: [48060.403736] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 18:44:46 juju-e4d256-prod-github-runner-207 kernel: [48060.404572] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 18:44:46 juju-e4d256-prod-github-runner-207 kernel: [48060.405391] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 18:44:46 juju-e4d256-prod-github-runner-207 kernel: [48060.406216] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 18:44:46 juju-e4d256-prod-github-runner-207 kernel: [48060.406996] print_cpu_stall.cold+0x2f/0xe2 Aug 22 18:44:46 juju-e4d256-prod-github-runner-207 kernel: [48060.407763] ? timekeeping_update+0xf7/0x150 Aug 22 18:44:46 juju-e4d256-prod-github-runner-207 kernel: [48060.408534] check_cpu_stall+0x109/0x270 Aug 22 18:44:46 juju-e4d256-prod-github-runner-207 kernel: [48060.409283] rcu_sched_clock_irq+0x9a/0x250 Aug 22 18:44:46 juju-e4d256-prod-github-runner-207 kernel: [48060.410069] update_process_times+0x94/0xd0 Aug 22 18:44:46 juju-e4d256-prod-github-runner-207 kernel: [48060.410831] tick_sched_handle+0x29/0x70 Aug 22 18:44:46 juju-e4d256-prod-github-runner-207 kernel: [48060.411580] tick_sched_timer+0x8c/0xc0 Aug 22 18:44:46 juju-e4d256-prod-github-runner-207 kernel: [48060.412323] ? tick_nohz_handler+0xb0/0xb0 Aug 22 18:44:46 juju-e4d256-prod-github-runner-207 kernel: [48060.413084] __hrtimer_run_queues+0x107/0x230 Aug 22 18:44:46 juju-e4d256-prod-github-runner-207 kernel: [48060.413874] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 18:44:46 juju-e4d256-prod-github-runner-207 kernel: [48060.414650] hrtimer_interrupt+0x101/0x220 Aug 22 18:44:46 juju-e4d256-prod-github-runner-207 kernel: [48060.415408] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 18:44:46 juju-e4d256-prod-github-runner-207 kernel: [48060.416225] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 18:44:46 juju-e4d256-prod-github-runner-207 kernel: [48060.417031] Aug 22 18:44:46 juju-e4d256-prod-github-runner-207 kernel: [48060.417667] Aug 22 18:44:46 juju-e4d256-prod-github-runner-207 kernel: [48060.418316] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 18:44:46 juju-e4d256-prod-github-runner-207 kernel: [48060.419139] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:44:46 juju-e4d256-prod-github-runner-207 kernel: [48060.420016] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 18:44:46 juju-e4d256-prod-github-runner-207 kernel: [48060.422233] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 18:44:46 juju-e4d256-prod-github-runner-207 kernel: [48060.423112] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 18:44:46 juju-e4d256-prod-github-runner-207 kernel: [48060.424105] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 18:44:46 juju-e4d256-prod-github-runner-207 kernel: [48060.425086] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 18:44:46 juju-e4d256-prod-github-runner-207 kernel: [48060.426068] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 18:44:46 juju-e4d256-prod-github-runner-207 kernel: [48060.427039] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 18:44:46 juju-e4d256-prod-github-runner-207 kernel: [48060.428009] ? _raw_spin_lock+0x22/0x30 Aug 22 18:44:46 juju-e4d256-prod-github-runner-207 kernel: [48060.428791] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:44:46 juju-e4d256-prod-github-runner-207 kernel: [48060.429651] direct_page_fault+0x206/0x310 [kvm] Aug 22 18:44:46 juju-e4d256-prod-github-runner-207 kernel: [48060.430512] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 18:44:46 juju-e4d256-prod-github-runner-207 kernel: [48060.431533] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 18:44:46 juju-e4d256-prod-github-runner-207 kernel: [48060.432466] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 18:44:46 juju-e4d256-prod-github-runner-207 kernel: [48060.433335] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 18:44:46 juju-e4d256-prod-github-runner-207 kernel: [48060.434167] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 18:44:46 juju-e4d256-prod-github-runner-207 kernel: [48060.435000] handle_exit+0x98/0x230 [kvm_amd] Aug 22 18:44:46 juju-e4d256-prod-github-runner-207 kernel: [48060.435756] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 18:44:46 juju-e4d256-prod-github-runner-207 kernel: [48060.436540] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 18:44:46 juju-e4d256-prod-github-runner-207 kernel: [48060.437422] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 18:44:46 juju-e4d256-prod-github-runner-207 kernel: [48060.439919] vcpu_run+0x62/0x2c0 [kvm] Aug 22 18:44:46 juju-e4d256-prod-github-runner-207 kernel: [48060.440724] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 18:44:46 juju-e4d256-prod-github-runner-207 kernel: [48060.441468] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 18:44:46 juju-e4d256-prod-github-runner-207 kernel: [48060.442313] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 18:44:46 juju-e4d256-prod-github-runner-207 kernel: [48060.443263] ? __seccomp_filter+0x4a/0x4a0 Aug 22 18:44:46 juju-e4d256-prod-github-runner-207 kernel: [48060.444002] ? __fget_files+0x86/0xc0 Aug 22 18:44:46 juju-e4d256-prod-github-runner-207 kernel: [48060.444696] __x64_sys_ioctl+0x95/0xd0 Aug 22 18:44:46 juju-e4d256-prod-github-runner-207 kernel: [48060.445396] do_syscall_64+0x5c/0xc0 Aug 22 18:44:46 juju-e4d256-prod-github-runner-207 kernel: [48060.446095] ? do_futex+0x162/0x1f0 Aug 22 18:44:46 juju-e4d256-prod-github-runner-207 kernel: [48060.446770] ? __x64_sys_futex+0x78/0x1e0 Aug 22 18:44:46 juju-e4d256-prod-github-runner-207 kernel: [48060.447475] ? __secure_computing+0xa9/0x120 Aug 22 18:44:46 juju-e4d256-prod-github-runner-207 kernel: [48060.448220] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 18:44:46 juju-e4d256-prod-github-runner-207 kernel: [48060.449015] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:44:46 juju-e4d256-prod-github-runner-207 kernel: [48060.449769] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:44:46 juju-e4d256-prod-github-runner-207 kernel: [48060.450585] ? do_syscall_64+0x69/0xc0 Aug 22 18:44:46 juju-e4d256-prod-github-runner-207 kernel: [48060.451294] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:44:46 juju-e4d256-prod-github-runner-207 kernel: [48060.452051] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:44:46 juju-e4d256-prod-github-runner-207 kernel: [48060.452817] ? do_syscall_64+0x69/0xc0 Aug 22 18:44:46 juju-e4d256-prod-github-runner-207 kernel: [48060.453511] ? do_syscall_64+0x69/0xc0 Aug 22 18:44:46 juju-e4d256-prod-github-runner-207 kernel: [48060.454214] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 18:44:46 juju-e4d256-prod-github-runner-207 kernel: [48060.454993] RIP: 0033:0x7faa5d0edaff Aug 22 18:44:46 juju-e4d256-prod-github-runner-207 kernel: [48060.455710] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 18:44:46 juju-e4d256-prod-github-runner-207 kernel: [48060.457840] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 18:44:46 juju-e4d256-prod-github-runner-207 kernel: [48060.459002] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 18:44:46 juju-e4d256-prod-github-runner-207 kernel: [48060.459953] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 18:44:46 juju-e4d256-prod-github-runner-207 kernel: [48060.460904] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 18:44:46 juju-e4d256-prod-github-runner-207 kernel: [48060.461976] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 18:44:46 juju-e4d256-prod-github-runner-207 kernel: [48060.462995] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 18:44:46 juju-e4d256-prod-github-runner-207 kernel: [48060.463927] Aug 22 18:45:10 juju-e4d256-prod-github-runner-207 kernel: [48084.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 44674s! [qemu-system-x86:6715] Aug 22 18:45:10 juju-e4d256-prod-github-runner-207 kernel: [48084.543095] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 18:45:10 juju-e4d256-prod-github-runner-207 kernel: [48084.543405] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 18:45:10 juju-e4d256-prod-github-runner-207 kernel: [48084.556645] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 18:45:10 juju-e4d256-prod-github-runner-207 kernel: [48084.557966] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 18:45:10 juju-e4d256-prod-github-runner-207 kernel: [48084.559190] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:45:10 juju-e4d256-prod-github-runner-207 kernel: [48084.560245] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 18:45:10 juju-e4d256-prod-github-runner-207 kernel: [48084.562847] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 18:45:10 juju-e4d256-prod-github-runner-207 kernel: [48084.563893] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 18:45:10 juju-e4d256-prod-github-runner-207 kernel: [48084.565049] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 18:45:10 juju-e4d256-prod-github-runner-207 kernel: [48084.566248] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 18:45:10 juju-e4d256-prod-github-runner-207 kernel: [48084.567412] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 18:45:10 juju-e4d256-prod-github-runner-207 kernel: [48084.568569] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 18:45:10 juju-e4d256-prod-github-runner-207 kernel: [48084.569758] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 18:45:10 juju-e4d256-prod-github-runner-207 kernel: [48084.571013] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 18:45:10 juju-e4d256-prod-github-runner-207 kernel: [48084.572124] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 18:45:10 juju-e4d256-prod-github-runner-207 kernel: [48084.573323] Call Trace: Aug 22 18:45:10 juju-e4d256-prod-github-runner-207 kernel: [48084.574264] Aug 22 18:45:10 juju-e4d256-prod-github-runner-207 kernel: [48084.575160] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:45:10 juju-e4d256-prod-github-runner-207 kernel: [48084.576209] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:45:10 juju-e4d256-prod-github-runner-207 kernel: [48084.577250] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:45:10 juju-e4d256-prod-github-runner-207 kernel: [48084.578362] ? show_regs.part.0+0x23/0x29 Aug 22 18:45:10 juju-e4d256-prod-github-runner-207 kernel: [48084.579363] ? show_regs.cold+0x8/0xd Aug 22 18:45:10 juju-e4d256-prod-github-runner-207 kernel: [48084.580336] ? watchdog_timer_fn+0x1be/0x220 Aug 22 18:45:10 juju-e4d256-prod-github-runner-207 kernel: [48084.581360] ? lockup_detector_update_enable+0x60/0x60 Aug 22 18:45:10 juju-e4d256-prod-github-runner-207 kernel: [48084.582487] ? __hrtimer_run_queues+0x107/0x230 Aug 22 18:45:10 juju-e4d256-prod-github-runner-207 kernel: [48084.583585] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 18:45:10 juju-e4d256-prod-github-runner-207 kernel: [48084.584633] ? hrtimer_interrupt+0x101/0x220 Aug 22 18:45:10 juju-e4d256-prod-github-runner-207 kernel: [48084.585679] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 18:45:10 juju-e4d256-prod-github-runner-207 kernel: [48084.586749] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 18:45:10 juju-e4d256-prod-github-runner-207 kernel: [48084.587838] Aug 22 18:45:10 juju-e4d256-prod-github-runner-207 kernel: [48084.588697] Aug 22 18:45:10 juju-e4d256-prod-github-runner-207 kernel: [48084.589560] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 18:45:10 juju-e4d256-prod-github-runner-207 kernel: [48084.590601] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:45:10 juju-e4d256-prod-github-runner-207 kernel: [48084.591640] ? _raw_spin_lock+0x22/0x30 Aug 22 18:45:10 juju-e4d256-prod-github-runner-207 kernel: [48084.592602] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:45:10 juju-e4d256-prod-github-runner-207 kernel: [48084.593661] direct_page_fault+0x206/0x310 [kvm] Aug 22 18:45:10 juju-e4d256-prod-github-runner-207 kernel: [48084.594717] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 18:45:10 juju-e4d256-prod-github-runner-207 kernel: [48084.595729] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 18:45:10 juju-e4d256-prod-github-runner-207 kernel: [48084.596787] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 18:45:10 juju-e4d256-prod-github-runner-207 kernel: [48084.597856] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 18:45:10 juju-e4d256-prod-github-runner-207 kernel: [48084.598864] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 18:45:10 juju-e4d256-prod-github-runner-207 kernel: [48084.599885] handle_exit+0x98/0x230 [kvm_amd] Aug 22 18:45:10 juju-e4d256-prod-github-runner-207 kernel: [48084.600871] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 18:45:10 juju-e4d256-prod-github-runner-207 kernel: [48084.601857] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 18:45:10 juju-e4d256-prod-github-runner-207 kernel: [48084.602844] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 18:45:10 juju-e4d256-prod-github-runner-207 kernel: [48084.603774] vcpu_run+0x62/0x2c0 [kvm] Aug 22 18:45:10 juju-e4d256-prod-github-runner-207 kernel: [48084.604592] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 18:45:10 juju-e4d256-prod-github-runner-207 kernel: [48084.605402] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 18:45:10 juju-e4d256-prod-github-runner-207 kernel: [48084.606288] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 18:45:10 juju-e4d256-prod-github-runner-207 kernel: [48084.607211] ? __seccomp_filter+0x4a/0x4a0 Aug 22 18:45:10 juju-e4d256-prod-github-runner-207 kernel: [48084.608045] ? __fget_files+0x86/0xc0 Aug 22 18:45:10 juju-e4d256-prod-github-runner-207 kernel: [48084.608822] __x64_sys_ioctl+0x95/0xd0 Aug 22 18:45:10 juju-e4d256-prod-github-runner-207 kernel: [48084.609636] do_syscall_64+0x5c/0xc0 Aug 22 18:45:10 juju-e4d256-prod-github-runner-207 kernel: [48084.610384] ? do_futex+0x162/0x1f0 Aug 22 18:45:10 juju-e4d256-prod-github-runner-207 kernel: [48084.611107] ? __x64_sys_futex+0x78/0x1e0 Aug 22 18:45:10 juju-e4d256-prod-github-runner-207 kernel: [48084.611865] ? __secure_computing+0xa9/0x120 Aug 22 18:45:10 juju-e4d256-prod-github-runner-207 kernel: [48084.612646] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 18:45:10 juju-e4d256-prod-github-runner-207 kernel: [48084.613540] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:45:10 juju-e4d256-prod-github-runner-207 kernel: [48084.614370] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:45:10 juju-e4d256-prod-github-runner-207 kernel: [48084.615198] ? do_syscall_64+0x69/0xc0 Aug 22 18:45:10 juju-e4d256-prod-github-runner-207 kernel: [48084.615923] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:45:10 juju-e4d256-prod-github-runner-207 kernel: [48084.616721] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:45:10 juju-e4d256-prod-github-runner-207 kernel: [48084.617538] ? do_syscall_64+0x69/0xc0 Aug 22 18:45:10 juju-e4d256-prod-github-runner-207 kernel: [48084.618249] ? do_syscall_64+0x69/0xc0 Aug 22 18:45:10 juju-e4d256-prod-github-runner-207 kernel: [48084.618956] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 18:45:10 juju-e4d256-prod-github-runner-207 kernel: [48084.619699] RIP: 0033:0x7faa5d0edaff Aug 22 18:45:10 juju-e4d256-prod-github-runner-207 kernel: [48084.620325] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 18:45:10 juju-e4d256-prod-github-runner-207 kernel: [48084.622331] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 18:45:10 juju-e4d256-prod-github-runner-207 kernel: [48084.623246] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 18:45:10 juju-e4d256-prod-github-runner-207 kernel: [48084.624144] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 18:45:10 juju-e4d256-prod-github-runner-207 kernel: [48084.625033] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 18:45:10 juju-e4d256-prod-github-runner-207 kernel: [48084.625972] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 18:45:10 juju-e4d256-prod-github-runner-207 kernel: [48084.626873] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 18:45:10 juju-e4d256-prod-github-runner-207 kernel: [48084.627774] Aug 22 18:45:38 juju-e4d256-prod-github-runner-207 kernel: [48112.541981] watchdog: BUG: soft lockup - CPU#1 stuck for 44700s! [qemu-system-x86:6715] Aug 22 18:45:38 juju-e4d256-prod-github-runner-207 kernel: [48112.543112] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 18:45:38 juju-e4d256-prod-github-runner-207 kernel: [48112.543178] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 18:45:38 juju-e4d256-prod-github-runner-207 kernel: [48112.555435] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 18:45:38 juju-e4d256-prod-github-runner-207 kernel: [48112.556705] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 18:45:38 juju-e4d256-prod-github-runner-207 kernel: [48112.558021] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:45:38 juju-e4d256-prod-github-runner-207 kernel: [48112.559186] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 18:45:38 juju-e4d256-prod-github-runner-207 kernel: [48112.561865] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 18:45:38 juju-e4d256-prod-github-runner-207 kernel: [48112.562951] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 18:45:38 juju-e4d256-prod-github-runner-207 kernel: [48112.564128] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 18:45:38 juju-e4d256-prod-github-runner-207 kernel: [48112.565322] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 18:45:38 juju-e4d256-prod-github-runner-207 kernel: [48112.566493] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 18:45:38 juju-e4d256-prod-github-runner-207 kernel: [48112.567676] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 18:45:38 juju-e4d256-prod-github-runner-207 kernel: [48112.568881] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 18:45:38 juju-e4d256-prod-github-runner-207 kernel: [48112.570142] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 18:45:38 juju-e4d256-prod-github-runner-207 kernel: [48112.571439] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 18:45:38 juju-e4d256-prod-github-runner-207 kernel: [48112.572887] Call Trace: Aug 22 18:45:38 juju-e4d256-prod-github-runner-207 kernel: [48112.573848] Aug 22 18:45:38 juju-e4d256-prod-github-runner-207 kernel: [48112.574736] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:45:38 juju-e4d256-prod-github-runner-207 kernel: [48112.575769] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:45:38 juju-e4d256-prod-github-runner-207 kernel: [48112.576795] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:45:38 juju-e4d256-prod-github-runner-207 kernel: [48112.577918] ? show_regs.part.0+0x23/0x29 Aug 22 18:45:38 juju-e4d256-prod-github-runner-207 kernel: [48112.578954] ? show_regs.cold+0x8/0xd Aug 22 18:45:38 juju-e4d256-prod-github-runner-207 kernel: [48112.579930] ? watchdog_timer_fn+0x1be/0x220 Aug 22 18:45:38 juju-e4d256-prod-github-runner-207 kernel: [48112.580939] ? lockup_detector_update_enable+0x60/0x60 Aug 22 18:45:38 juju-e4d256-prod-github-runner-207 kernel: [48112.582031] ? __hrtimer_run_queues+0x107/0x230 Aug 22 18:45:38 juju-e4d256-prod-github-runner-207 kernel: [48112.583124] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 18:45:38 juju-e4d256-prod-github-runner-207 kernel: [48112.584181] ? hrtimer_interrupt+0x101/0x220 Aug 22 18:45:38 juju-e4d256-prod-github-runner-207 kernel: [48112.585226] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 18:45:38 juju-e4d256-prod-github-runner-207 kernel: [48112.586326] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 18:45:38 juju-e4d256-prod-github-runner-207 kernel: [48112.587391] Aug 22 18:45:38 juju-e4d256-prod-github-runner-207 kernel: [48112.588279] Aug 22 18:45:38 juju-e4d256-prod-github-runner-207 kernel: [48112.589169] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 18:45:38 juju-e4d256-prod-github-runner-207 kernel: [48112.590227] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:45:38 juju-e4d256-prod-github-runner-207 kernel: [48112.591287] ? _raw_spin_lock+0x22/0x30 Aug 22 18:45:38 juju-e4d256-prod-github-runner-207 kernel: [48112.592245] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:45:38 juju-e4d256-prod-github-runner-207 kernel: [48112.593334] direct_page_fault+0x206/0x310 [kvm] Aug 22 18:45:38 juju-e4d256-prod-github-runner-207 kernel: [48112.594434] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 18:45:38 juju-e4d256-prod-github-runner-207 kernel: [48112.595486] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 18:45:38 juju-e4d256-prod-github-runner-207 kernel: [48112.596515] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 18:45:38 juju-e4d256-prod-github-runner-207 kernel: [48112.597539] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 18:45:38 juju-e4d256-prod-github-runner-207 kernel: [48112.598560] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 18:45:38 juju-e4d256-prod-github-runner-207 kernel: [48112.599636] handle_exit+0x98/0x230 [kvm_amd] Aug 22 18:45:38 juju-e4d256-prod-github-runner-207 kernel: [48112.600558] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 18:45:38 juju-e4d256-prod-github-runner-207 kernel: [48112.601511] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 18:45:38 juju-e4d256-prod-github-runner-207 kernel: [48112.602528] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 18:45:38 juju-e4d256-prod-github-runner-207 kernel: [48112.603505] vcpu_run+0x62/0x2c0 [kvm] Aug 22 18:45:38 juju-e4d256-prod-github-runner-207 kernel: [48112.604359] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 18:45:38 juju-e4d256-prod-github-runner-207 kernel: [48112.605223] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 18:45:38 juju-e4d256-prod-github-runner-207 kernel: [48112.606097] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 18:45:38 juju-e4d256-prod-github-runner-207 kernel: [48112.606902] ? __seccomp_filter+0x4a/0x4a0 Aug 22 18:45:38 juju-e4d256-prod-github-runner-207 kernel: [48112.607657] ? __fget_files+0x86/0xc0 Aug 22 18:45:38 juju-e4d256-prod-github-runner-207 kernel: [48112.608369] __x64_sys_ioctl+0x95/0xd0 Aug 22 18:45:38 juju-e4d256-prod-github-runner-207 kernel: [48112.609090] do_syscall_64+0x5c/0xc0 Aug 22 18:45:38 juju-e4d256-prod-github-runner-207 kernel: [48112.609834] ? do_futex+0x162/0x1f0 Aug 22 18:45:38 juju-e4d256-prod-github-runner-207 kernel: [48112.610793] ? __x64_sys_futex+0x78/0x1e0 Aug 22 18:45:38 juju-e4d256-prod-github-runner-207 kernel: [48112.611567] ? __secure_computing+0xa9/0x120 Aug 22 18:45:38 juju-e4d256-prod-github-runner-207 kernel: [48112.612263] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 18:45:38 juju-e4d256-prod-github-runner-207 kernel: [48112.613026] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:45:38 juju-e4d256-prod-github-runner-207 kernel: [48112.613814] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:45:38 juju-e4d256-prod-github-runner-207 kernel: [48112.614688] ? do_syscall_64+0x69/0xc0 Aug 22 18:45:38 juju-e4d256-prod-github-runner-207 kernel: [48112.615345] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:45:38 juju-e4d256-prod-github-runner-207 kernel: [48112.616052] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:45:38 juju-e4d256-prod-github-runner-207 kernel: [48112.616751] ? do_syscall_64+0x69/0xc0 Aug 22 18:45:38 juju-e4d256-prod-github-runner-207 kernel: [48112.617395] ? do_syscall_64+0x69/0xc0 Aug 22 18:45:38 juju-e4d256-prod-github-runner-207 kernel: [48112.618024] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 18:45:38 juju-e4d256-prod-github-runner-207 kernel: [48112.618732] RIP: 0033:0x7faa5d0edaff Aug 22 18:45:38 juju-e4d256-prod-github-runner-207 kernel: [48112.619359] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 18:45:38 juju-e4d256-prod-github-runner-207 kernel: [48112.621379] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 18:45:38 juju-e4d256-prod-github-runner-207 kernel: [48112.622308] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 18:45:38 juju-e4d256-prod-github-runner-207 kernel: [48112.623209] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 18:45:38 juju-e4d256-prod-github-runner-207 kernel: [48112.624099] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 18:45:38 juju-e4d256-prod-github-runner-207 kernel: [48112.624991] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 18:45:38 juju-e4d256-prod-github-runner-207 kernel: [48112.625919] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 18:45:38 juju-e4d256-prod-github-runner-207 kernel: [48112.626815] Aug 22 18:46:06 juju-e4d256-prod-github-runner-207 kernel: [48140.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 44726s! [qemu-system-x86:6715] Aug 22 18:46:06 juju-e4d256-prod-github-runner-207 kernel: [48140.543099] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 18:46:06 juju-e4d256-prod-github-runner-207 kernel: [48140.543169] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 18:46:06 juju-e4d256-prod-github-runner-207 kernel: [48140.555352] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 18:46:06 juju-e4d256-prod-github-runner-207 kernel: [48140.556641] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 18:46:06 juju-e4d256-prod-github-runner-207 kernel: [48140.557879] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:46:06 juju-e4d256-prod-github-runner-207 kernel: [48140.558942] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 18:46:06 juju-e4d256-prod-github-runner-207 kernel: [48140.561562] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 18:46:06 juju-e4d256-prod-github-runner-207 kernel: [48140.562615] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 18:46:06 juju-e4d256-prod-github-runner-207 kernel: [48140.563784] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 18:46:06 juju-e4d256-prod-github-runner-207 kernel: [48140.564960] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 18:46:06 juju-e4d256-prod-github-runner-207 kernel: [48140.566151] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 18:46:06 juju-e4d256-prod-github-runner-207 kernel: [48140.567327] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 18:46:06 juju-e4d256-prod-github-runner-207 kernel: [48140.568491] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 18:46:06 juju-e4d256-prod-github-runner-207 kernel: [48140.569747] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 18:46:06 juju-e4d256-prod-github-runner-207 kernel: [48140.570878] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 18:46:06 juju-e4d256-prod-github-runner-207 kernel: [48140.572097] Call Trace: Aug 22 18:46:06 juju-e4d256-prod-github-runner-207 kernel: [48140.573027] Aug 22 18:46:06 juju-e4d256-prod-github-runner-207 kernel: [48140.573912] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:46:06 juju-e4d256-prod-github-runner-207 kernel: [48140.574941] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:46:06 juju-e4d256-prod-github-runner-207 kernel: [48140.575979] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:46:06 juju-e4d256-prod-github-runner-207 kernel: [48140.577112] ? show_regs.part.0+0x23/0x29 Aug 22 18:46:06 juju-e4d256-prod-github-runner-207 kernel: [48140.578111] ? show_regs.cold+0x8/0xd Aug 22 18:46:06 juju-e4d256-prod-github-runner-207 kernel: [48140.579087] ? watchdog_timer_fn+0x1be/0x220 Aug 22 18:46:06 juju-e4d256-prod-github-runner-207 kernel: [48140.580095] ? lockup_detector_update_enable+0x60/0x60 Aug 22 18:46:06 juju-e4d256-prod-github-runner-207 kernel: [48140.581211] ? __hrtimer_run_queues+0x107/0x230 Aug 22 18:46:06 juju-e4d256-prod-github-runner-207 kernel: [48140.582271] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 18:46:06 juju-e4d256-prod-github-runner-207 kernel: [48140.583301] ? hrtimer_interrupt+0x101/0x220 Aug 22 18:46:06 juju-e4d256-prod-github-runner-207 kernel: [48140.584317] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 18:46:06 juju-e4d256-prod-github-runner-207 kernel: [48140.585416] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 18:46:06 juju-e4d256-prod-github-runner-207 kernel: [48140.586485] Aug 22 18:46:06 juju-e4d256-prod-github-runner-207 kernel: [48140.587370] Aug 22 18:46:06 juju-e4d256-prod-github-runner-207 kernel: [48140.588208] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 18:46:06 juju-e4d256-prod-github-runner-207 kernel: [48140.589255] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:46:06 juju-e4d256-prod-github-runner-207 kernel: [48140.590296] ? _raw_spin_lock+0x22/0x30 Aug 22 18:46:06 juju-e4d256-prod-github-runner-207 kernel: [48140.591258] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:46:06 juju-e4d256-prod-github-runner-207 kernel: [48140.592323] direct_page_fault+0x206/0x310 [kvm] Aug 22 18:46:06 juju-e4d256-prod-github-runner-207 kernel: [48140.593371] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 18:46:06 juju-e4d256-prod-github-runner-207 kernel: [48140.594382] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 18:46:06 juju-e4d256-prod-github-runner-207 kernel: [48140.595382] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 18:46:06 juju-e4d256-prod-github-runner-207 kernel: [48140.596366] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 18:46:06 juju-e4d256-prod-github-runner-207 kernel: [48140.597352] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 18:46:06 juju-e4d256-prod-github-runner-207 kernel: [48140.598340] handle_exit+0x98/0x230 [kvm_amd] Aug 22 18:46:06 juju-e4d256-prod-github-runner-207 kernel: [48140.599237] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 18:46:06 juju-e4d256-prod-github-runner-207 kernel: [48140.600306] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 18:46:06 juju-e4d256-prod-github-runner-207 kernel: [48140.601258] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 18:46:06 juju-e4d256-prod-github-runner-207 kernel: [48140.602226] vcpu_run+0x62/0x2c0 [kvm] Aug 22 18:46:06 juju-e4d256-prod-github-runner-207 kernel: [48140.603051] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 18:46:06 juju-e4d256-prod-github-runner-207 kernel: [48140.603862] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 18:46:06 juju-e4d256-prod-github-runner-207 kernel: [48140.604725] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 18:46:06 juju-e4d256-prod-github-runner-207 kernel: [48140.605547] ? __seccomp_filter+0x4a/0x4a0 Aug 22 18:46:06 juju-e4d256-prod-github-runner-207 kernel: [48140.606292] ? __fget_files+0x86/0xc0 Aug 22 18:46:06 juju-e4d256-prod-github-runner-207 kernel: [48140.607015] __x64_sys_ioctl+0x95/0xd0 Aug 22 18:46:06 juju-e4d256-prod-github-runner-207 kernel: [48140.607744] do_syscall_64+0x5c/0xc0 Aug 22 18:46:06 juju-e4d256-prod-github-runner-207 kernel: [48140.608636] ? do_futex+0x162/0x1f0 Aug 22 18:46:06 juju-e4d256-prod-github-runner-207 kernel: [48140.609306] ? __x64_sys_futex+0x78/0x1e0 Aug 22 18:46:06 juju-e4d256-prod-github-runner-207 kernel: [48140.609987] ? __secure_computing+0xa9/0x120 Aug 22 18:46:06 juju-e4d256-prod-github-runner-207 kernel: [48140.610684] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 18:46:06 juju-e4d256-prod-github-runner-207 kernel: [48140.611450] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:46:06 juju-e4d256-prod-github-runner-207 kernel: [48140.612207] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:46:06 juju-e4d256-prod-github-runner-207 kernel: [48140.612977] ? do_syscall_64+0x69/0xc0 Aug 22 18:46:06 juju-e4d256-prod-github-runner-207 kernel: [48140.613631] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:46:06 juju-e4d256-prod-github-runner-207 kernel: [48140.614336] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:46:06 juju-e4d256-prod-github-runner-207 kernel: [48140.615032] ? do_syscall_64+0x69/0xc0 Aug 22 18:46:06 juju-e4d256-prod-github-runner-207 kernel: [48140.615658] ? do_syscall_64+0x69/0xc0 Aug 22 18:46:06 juju-e4d256-prod-github-runner-207 kernel: [48140.616283] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 18:46:06 juju-e4d256-prod-github-runner-207 kernel: [48140.617013] RIP: 0033:0x7faa5d0edaff Aug 22 18:46:06 juju-e4d256-prod-github-runner-207 kernel: [48140.617681] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 18:46:06 juju-e4d256-prod-github-runner-207 kernel: [48140.619672] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 18:46:06 juju-e4d256-prod-github-runner-207 kernel: [48140.620582] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 18:46:06 juju-e4d256-prod-github-runner-207 kernel: [48140.621496] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 18:46:06 juju-e4d256-prod-github-runner-207 kernel: [48140.622434] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 18:46:06 juju-e4d256-prod-github-runner-207 kernel: [48140.623358] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 18:46:06 juju-e4d256-prod-github-runner-207 kernel: [48140.624250] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 18:46:06 juju-e4d256-prod-github-runner-207 kernel: [48140.625155] Aug 22 18:46:34 juju-e4d256-prod-github-runner-207 kernel: [48168.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 44752s! [qemu-system-x86:6715] Aug 22 18:46:34 juju-e4d256-prod-github-runner-207 kernel: [48168.543664] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 18:46:34 juju-e4d256-prod-github-runner-207 kernel: [48168.543901] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 18:46:34 juju-e4d256-prod-github-runner-207 kernel: [48168.556086] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 18:46:34 juju-e4d256-prod-github-runner-207 kernel: [48168.557392] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 18:46:34 juju-e4d256-prod-github-runner-207 kernel: [48168.558613] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:46:34 juju-e4d256-prod-github-runner-207 kernel: [48168.559668] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 18:46:34 juju-e4d256-prod-github-runner-207 kernel: [48168.562240] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 18:46:34 juju-e4d256-prod-github-runner-207 kernel: [48168.563286] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 18:46:34 juju-e4d256-prod-github-runner-207 kernel: [48168.564469] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 18:46:34 juju-e4d256-prod-github-runner-207 kernel: [48168.565636] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 18:46:34 juju-e4d256-prod-github-runner-207 kernel: [48168.566798] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 18:46:34 juju-e4d256-prod-github-runner-207 kernel: [48168.567965] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 18:46:34 juju-e4d256-prod-github-runner-207 kernel: [48168.569154] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 18:46:34 juju-e4d256-prod-github-runner-207 kernel: [48168.570385] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 18:46:34 juju-e4d256-prod-github-runner-207 kernel: [48168.571487] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 18:46:34 juju-e4d256-prod-github-runner-207 kernel: [48168.572692] Call Trace: Aug 22 18:46:34 juju-e4d256-prod-github-runner-207 kernel: [48168.573605] Aug 22 18:46:34 juju-e4d256-prod-github-runner-207 kernel: [48168.574502] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:46:34 juju-e4d256-prod-github-runner-207 kernel: [48168.575533] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:46:34 juju-e4d256-prod-github-runner-207 kernel: [48168.576565] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:46:34 juju-e4d256-prod-github-runner-207 kernel: [48168.577656] ? show_regs.part.0+0x23/0x29 Aug 22 18:46:34 juju-e4d256-prod-github-runner-207 kernel: [48168.578650] ? show_regs.cold+0x8/0xd Aug 22 18:46:34 juju-e4d256-prod-github-runner-207 kernel: [48168.579625] ? watchdog_timer_fn+0x1be/0x220 Aug 22 18:46:34 juju-e4d256-prod-github-runner-207 kernel: [48168.580643] ? lockup_detector_update_enable+0x60/0x60 Aug 22 18:46:34 juju-e4d256-prod-github-runner-207 kernel: [48168.581705] ? __hrtimer_run_queues+0x107/0x230 Aug 22 18:46:34 juju-e4d256-prod-github-runner-207 kernel: [48168.582731] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 18:46:34 juju-e4d256-prod-github-runner-207 kernel: [48168.583759] ? hrtimer_interrupt+0x101/0x220 Aug 22 18:46:34 juju-e4d256-prod-github-runner-207 kernel: [48168.584987] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 18:46:34 juju-e4d256-prod-github-runner-207 kernel: [48168.586061] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 18:46:34 juju-e4d256-prod-github-runner-207 kernel: [48168.587138] Aug 22 18:46:34 juju-e4d256-prod-github-runner-207 kernel: [48168.587991] Aug 22 18:46:34 juju-e4d256-prod-github-runner-207 kernel: [48168.588838] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 18:46:34 juju-e4d256-prod-github-runner-207 kernel: [48168.589875] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:46:34 juju-e4d256-prod-github-runner-207 kernel: [48168.590916] ? _raw_spin_lock+0x22/0x30 Aug 22 18:46:34 juju-e4d256-prod-github-runner-207 kernel: [48168.591858] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:46:34 juju-e4d256-prod-github-runner-207 kernel: [48168.592884] direct_page_fault+0x206/0x310 [kvm] Aug 22 18:46:34 juju-e4d256-prod-github-runner-207 kernel: [48168.593932] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 18:46:34 juju-e4d256-prod-github-runner-207 kernel: [48168.594948] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 18:46:34 juju-e4d256-prod-github-runner-207 kernel: [48168.595952] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 18:46:34 juju-e4d256-prod-github-runner-207 kernel: [48168.596959] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 18:46:34 juju-e4d256-prod-github-runner-207 kernel: [48168.597904] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 18:46:34 juju-e4d256-prod-github-runner-207 kernel: [48168.598880] handle_exit+0x98/0x230 [kvm_amd] Aug 22 18:46:34 juju-e4d256-prod-github-runner-207 kernel: [48168.599859] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 18:46:34 juju-e4d256-prod-github-runner-207 kernel: [48168.600784] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 18:46:34 juju-e4d256-prod-github-runner-207 kernel: [48168.601709] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 18:46:34 juju-e4d256-prod-github-runner-207 kernel: [48168.602611] vcpu_run+0x62/0x2c0 [kvm] Aug 22 18:46:34 juju-e4d256-prod-github-runner-207 kernel: [48168.603420] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 18:46:34 juju-e4d256-prod-github-runner-207 kernel: [48168.604230] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 18:46:34 juju-e4d256-prod-github-runner-207 kernel: [48168.605104] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 18:46:34 juju-e4d256-prod-github-runner-207 kernel: [48168.605902] ? __seccomp_filter+0x4a/0x4a0 Aug 22 18:46:34 juju-e4d256-prod-github-runner-207 kernel: [48168.606644] ? __fget_files+0x86/0xc0 Aug 22 18:46:34 juju-e4d256-prod-github-runner-207 kernel: [48168.607346] __x64_sys_ioctl+0x95/0xd0 Aug 22 18:46:34 juju-e4d256-prod-github-runner-207 kernel: [48168.608037] do_syscall_64+0x5c/0xc0 Aug 22 18:46:34 juju-e4d256-prod-github-runner-207 kernel: [48168.608710] ? do_futex+0x162/0x1f0 Aug 22 18:46:34 juju-e4d256-prod-github-runner-207 kernel: [48168.609359] ? __x64_sys_futex+0x78/0x1e0 Aug 22 18:46:34 juju-e4d256-prod-github-runner-207 kernel: [48168.610031] ? __secure_computing+0xa9/0x120 Aug 22 18:46:34 juju-e4d256-prod-github-runner-207 kernel: [48168.610719] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 18:46:34 juju-e4d256-prod-github-runner-207 kernel: [48168.611477] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:46:34 juju-e4d256-prod-github-runner-207 kernel: [48168.612204] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:46:34 juju-e4d256-prod-github-runner-207 kernel: [48168.612931] ? do_syscall_64+0x69/0xc0 Aug 22 18:46:34 juju-e4d256-prod-github-runner-207 kernel: [48168.613575] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:46:34 juju-e4d256-prod-github-runner-207 kernel: [48168.614277] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:46:34 juju-e4d256-prod-github-runner-207 kernel: [48168.614970] ? do_syscall_64+0x69/0xc0 Aug 22 18:46:34 juju-e4d256-prod-github-runner-207 kernel: [48168.615593] ? do_syscall_64+0x69/0xc0 Aug 22 18:46:34 juju-e4d256-prod-github-runner-207 kernel: [48168.616214] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 18:46:34 juju-e4d256-prod-github-runner-207 kernel: [48168.616925] RIP: 0033:0x7faa5d0edaff Aug 22 18:46:34 juju-e4d256-prod-github-runner-207 kernel: [48168.617575] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 18:46:34 juju-e4d256-prod-github-runner-207 kernel: [48168.619560] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 18:46:34 juju-e4d256-prod-github-runner-207 kernel: [48168.620484] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 18:46:34 juju-e4d256-prod-github-runner-207 kernel: [48168.621380] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 18:46:34 juju-e4d256-prod-github-runner-207 kernel: [48168.622277] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 18:46:34 juju-e4d256-prod-github-runner-207 kernel: [48168.623176] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 18:46:34 juju-e4d256-prod-github-runner-207 kernel: [48168.624072] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 18:46:34 juju-e4d256-prod-github-runner-207 kernel: [48168.624973] Aug 22 18:47:02 juju-e4d256-prod-github-runner-207 kernel: [48196.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 44778s! [qemu-system-x86:6715] Aug 22 18:47:02 juju-e4d256-prod-github-runner-207 kernel: [48196.543092] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 18:47:02 juju-e4d256-prod-github-runner-207 kernel: [48196.543162] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 18:47:02 juju-e4d256-prod-github-runner-207 kernel: [48196.557307] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 18:47:02 juju-e4d256-prod-github-runner-207 kernel: [48196.558780] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 18:47:02 juju-e4d256-prod-github-runner-207 kernel: [48196.560207] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:47:02 juju-e4d256-prod-github-runner-207 kernel: [48196.561380] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 18:47:02 juju-e4d256-prod-github-runner-207 kernel: [48196.564299] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 18:47:02 juju-e4d256-prod-github-runner-207 kernel: [48196.565441] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 18:47:02 juju-e4d256-prod-github-runner-207 kernel: [48196.566748] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 18:47:02 juju-e4d256-prod-github-runner-207 kernel: [48196.568051] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 18:47:02 juju-e4d256-prod-github-runner-207 kernel: [48196.569423] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 18:47:02 juju-e4d256-prod-github-runner-207 kernel: [48196.570722] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 18:47:02 juju-e4d256-prod-github-runner-207 kernel: [48196.572043] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 18:47:02 juju-e4d256-prod-github-runner-207 kernel: [48196.573457] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 18:47:02 juju-e4d256-prod-github-runner-207 kernel: [48196.574668] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 18:47:02 juju-e4d256-prod-github-runner-207 kernel: [48196.576008] Call Trace: Aug 22 18:47:02 juju-e4d256-prod-github-runner-207 kernel: [48196.576983] Aug 22 18:47:02 juju-e4d256-prod-github-runner-207 kernel: [48196.577915] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:47:02 juju-e4d256-prod-github-runner-207 kernel: [48196.579030] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:47:02 juju-e4d256-prod-github-runner-207 kernel: [48196.580160] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:47:02 juju-e4d256-prod-github-runner-207 kernel: [48196.581328] ? show_regs.part.0+0x23/0x29 Aug 22 18:47:02 juju-e4d256-prod-github-runner-207 kernel: [48196.582411] ? show_regs.cold+0x8/0xd Aug 22 18:47:02 juju-e4d256-prod-github-runner-207 kernel: [48196.583459] ? watchdog_timer_fn+0x1be/0x220 Aug 22 18:47:02 juju-e4d256-prod-github-runner-207 kernel: [48196.584565] ? lockup_detector_update_enable+0x60/0x60 Aug 22 18:47:02 juju-e4d256-prod-github-runner-207 kernel: [48196.585728] ? __hrtimer_run_queues+0x107/0x230 Aug 22 18:47:02 juju-e4d256-prod-github-runner-207 kernel: [48196.586848] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 18:47:02 juju-e4d256-prod-github-runner-207 kernel: [48196.587960] ? hrtimer_interrupt+0x101/0x220 Aug 22 18:47:02 juju-e4d256-prod-github-runner-207 kernel: [48196.589068] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 18:47:02 juju-e4d256-prod-github-runner-207 kernel: [48196.590237] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 18:47:02 juju-e4d256-prod-github-runner-207 kernel: [48196.591386] Aug 22 18:47:02 juju-e4d256-prod-github-runner-207 kernel: [48196.592311] Aug 22 18:47:02 juju-e4d256-prod-github-runner-207 kernel: [48196.593199] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 18:47:02 juju-e4d256-prod-github-runner-207 kernel: [48196.594352] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:47:02 juju-e4d256-prod-github-runner-207 kernel: [48196.595500] ? _raw_spin_lock+0x22/0x30 Aug 22 18:47:02 juju-e4d256-prod-github-runner-207 kernel: [48196.596539] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:47:02 juju-e4d256-prod-github-runner-207 kernel: [48196.597659] direct_page_fault+0x206/0x310 [kvm] Aug 22 18:47:02 juju-e4d256-prod-github-runner-207 kernel: [48196.598780] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 18:47:02 juju-e4d256-prod-github-runner-207 kernel: [48196.599884] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 18:47:02 juju-e4d256-prod-github-runner-207 kernel: [48196.600996] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 18:47:02 juju-e4d256-prod-github-runner-207 kernel: [48196.602074] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 18:47:02 juju-e4d256-prod-github-runner-207 kernel: [48196.603119] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 18:47:02 juju-e4d256-prod-github-runner-207 kernel: [48196.604218] handle_exit+0x98/0x230 [kvm_amd] Aug 22 18:47:02 juju-e4d256-prod-github-runner-207 kernel: [48196.605205] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 18:47:02 juju-e4d256-prod-github-runner-207 kernel: [48196.606219] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 18:47:02 juju-e4d256-prod-github-runner-207 kernel: [48196.607242] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 18:47:02 juju-e4d256-prod-github-runner-207 kernel: [48196.608267] vcpu_run+0x62/0x2c0 [kvm] Aug 22 18:47:02 juju-e4d256-prod-github-runner-207 kernel: [48196.609160] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 18:47:02 juju-e4d256-prod-github-runner-207 kernel: [48196.610061] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 18:47:02 juju-e4d256-prod-github-runner-207 kernel: [48196.611020] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 18:47:02 juju-e4d256-prod-github-runner-207 kernel: [48196.611909] ? __seccomp_filter+0x4a/0x4a0 Aug 22 18:47:02 juju-e4d256-prod-github-runner-207 kernel: [48196.612764] ? __fget_files+0x86/0xc0 Aug 22 18:47:02 juju-e4d256-prod-github-runner-207 kernel: [48196.613542] __x64_sys_ioctl+0x95/0xd0 Aug 22 18:47:02 juju-e4d256-prod-github-runner-207 kernel: [48196.614311] do_syscall_64+0x5c/0xc0 Aug 22 18:47:02 juju-e4d256-prod-github-runner-207 kernel: [48196.615229] ? do_futex+0x162/0x1f0 Aug 22 18:47:02 juju-e4d256-prod-github-runner-207 kernel: [48196.615957] ? __x64_sys_futex+0x78/0x1e0 Aug 22 18:47:02 juju-e4d256-prod-github-runner-207 kernel: [48196.616731] ? __secure_computing+0xa9/0x120 Aug 22 18:47:02 juju-e4d256-prod-github-runner-207 kernel: [48196.617507] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 18:47:02 juju-e4d256-prod-github-runner-207 kernel: [48196.618378] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:47:02 juju-e4d256-prod-github-runner-207 kernel: [48196.619196] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:47:02 juju-e4d256-prod-github-runner-207 kernel: [48196.620010] ? do_syscall_64+0x69/0xc0 Aug 22 18:47:02 juju-e4d256-prod-github-runner-207 kernel: [48196.620744] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:47:02 juju-e4d256-prod-github-runner-207 kernel: [48196.621549] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:47:02 juju-e4d256-prod-github-runner-207 kernel: [48196.622339] ? do_syscall_64+0x69/0xc0 Aug 22 18:47:02 juju-e4d256-prod-github-runner-207 kernel: [48196.623045] ? do_syscall_64+0x69/0xc0 Aug 22 18:47:02 juju-e4d256-prod-github-runner-207 kernel: [48196.623746] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 18:47:02 juju-e4d256-prod-github-runner-207 kernel: [48196.624571] RIP: 0033:0x7faa5d0edaff Aug 22 18:47:02 juju-e4d256-prod-github-runner-207 kernel: [48196.625288] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 18:47:02 juju-e4d256-prod-github-runner-207 kernel: [48196.627607] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 18:47:02 juju-e4d256-prod-github-runner-207 kernel: [48196.628687] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 18:47:02 juju-e4d256-prod-github-runner-207 kernel: [48196.629713] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 18:47:02 juju-e4d256-prod-github-runner-207 kernel: [48196.630737] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 18:47:02 juju-e4d256-prod-github-runner-207 kernel: [48196.631759] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 18:47:02 juju-e4d256-prod-github-runner-207 kernel: [48196.632798] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 18:47:02 juju-e4d256-prod-github-runner-207 kernel: [48196.633826] Aug 22 18:47:30 juju-e4d256-prod-github-runner-207 kernel: [48224.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 44804s! [qemu-system-x86:6715] Aug 22 18:47:30 juju-e4d256-prod-github-runner-207 kernel: [48224.543138] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 18:47:30 juju-e4d256-prod-github-runner-207 kernel: [48224.543210] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 18:47:30 juju-e4d256-prod-github-runner-207 kernel: [48224.555463] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 18:47:30 juju-e4d256-prod-github-runner-207 kernel: [48224.556737] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 18:47:30 juju-e4d256-prod-github-runner-207 kernel: [48224.557952] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:47:30 juju-e4d256-prod-github-runner-207 kernel: [48224.559006] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 18:47:30 juju-e4d256-prod-github-runner-207 kernel: [48224.561558] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 18:47:30 juju-e4d256-prod-github-runner-207 kernel: [48224.562609] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 18:47:30 juju-e4d256-prod-github-runner-207 kernel: [48224.563795] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 18:47:30 juju-e4d256-prod-github-runner-207 kernel: [48224.564960] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 18:47:30 juju-e4d256-prod-github-runner-207 kernel: [48224.566118] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 18:47:30 juju-e4d256-prod-github-runner-207 kernel: [48224.567294] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 18:47:30 juju-e4d256-prod-github-runner-207 kernel: [48224.568479] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 18:47:30 juju-e4d256-prod-github-runner-207 kernel: [48224.569715] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 18:47:30 juju-e4d256-prod-github-runner-207 kernel: [48224.570809] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 18:47:30 juju-e4d256-prod-github-runner-207 kernel: [48224.572022] Call Trace: Aug 22 18:47:30 juju-e4d256-prod-github-runner-207 kernel: [48224.572935] Aug 22 18:47:30 juju-e4d256-prod-github-runner-207 kernel: [48224.573818] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:47:30 juju-e4d256-prod-github-runner-207 kernel: [48224.574856] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:47:30 juju-e4d256-prod-github-runner-207 kernel: [48224.575894] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:47:30 juju-e4d256-prod-github-runner-207 kernel: [48224.576970] ? show_regs.part.0+0x23/0x29 Aug 22 18:47:30 juju-e4d256-prod-github-runner-207 kernel: [48224.577966] ? show_regs.cold+0x8/0xd Aug 22 18:47:30 juju-e4d256-prod-github-runner-207 kernel: [48224.578938] ? watchdog_timer_fn+0x1be/0x220 Aug 22 18:47:30 juju-e4d256-prod-github-runner-207 kernel: [48224.579971] ? lockup_detector_update_enable+0x60/0x60 Aug 22 18:47:30 juju-e4d256-prod-github-runner-207 kernel: [48224.581034] ? __hrtimer_run_queues+0x107/0x230 Aug 22 18:47:30 juju-e4d256-prod-github-runner-207 kernel: [48224.582060] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 18:47:30 juju-e4d256-prod-github-runner-207 kernel: [48224.583086] ? hrtimer_interrupt+0x101/0x220 Aug 22 18:47:30 juju-e4d256-prod-github-runner-207 kernel: [48224.584117] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 18:47:30 juju-e4d256-prod-github-runner-207 kernel: [48224.585193] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 18:47:30 juju-e4d256-prod-github-runner-207 kernel: [48224.586237] Aug 22 18:47:30 juju-e4d256-prod-github-runner-207 kernel: [48224.587088] Aug 22 18:47:30 juju-e4d256-prod-github-runner-207 kernel: [48224.587943] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 18:47:30 juju-e4d256-prod-github-runner-207 kernel: [48224.588982] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:47:30 juju-e4d256-prod-github-runner-207 kernel: [48224.590022] ? _raw_spin_lock+0x22/0x30 Aug 22 18:47:30 juju-e4d256-prod-github-runner-207 kernel: [48224.590971] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:47:30 juju-e4d256-prod-github-runner-207 kernel: [48224.592002] direct_page_fault+0x206/0x310 [kvm] Aug 22 18:47:30 juju-e4d256-prod-github-runner-207 kernel: [48224.593024] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 18:47:30 juju-e4d256-prod-github-runner-207 kernel: [48224.594057] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 18:47:30 juju-e4d256-prod-github-runner-207 kernel: [48224.595061] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 18:47:30 juju-e4d256-prod-github-runner-207 kernel: [48224.596056] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 18:47:30 juju-e4d256-prod-github-runner-207 kernel: [48224.597023] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 18:47:30 juju-e4d256-prod-github-runner-207 kernel: [48224.598005] handle_exit+0x98/0x230 [kvm_amd] Aug 22 18:47:30 juju-e4d256-prod-github-runner-207 kernel: [48224.598949] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 18:47:30 juju-e4d256-prod-github-runner-207 kernel: [48224.599882] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 18:47:30 juju-e4d256-prod-github-runner-207 kernel: [48224.600811] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 18:47:30 juju-e4d256-prod-github-runner-207 kernel: [48224.601714] vcpu_run+0x62/0x2c0 [kvm] Aug 22 18:47:30 juju-e4d256-prod-github-runner-207 kernel: [48224.602525] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 18:47:30 juju-e4d256-prod-github-runner-207 kernel: [48224.603332] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 18:47:30 juju-e4d256-prod-github-runner-207 kernel: [48224.604203] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 18:47:30 juju-e4d256-prod-github-runner-207 kernel: [48224.605006] ? __seccomp_filter+0x4a/0x4a0 Aug 22 18:47:30 juju-e4d256-prod-github-runner-207 kernel: [48224.605751] ? __fget_files+0x86/0xc0 Aug 22 18:47:30 juju-e4d256-prod-github-runner-207 kernel: [48224.606455] __x64_sys_ioctl+0x95/0xd0 Aug 22 18:47:30 juju-e4d256-prod-github-runner-207 kernel: [48224.607152] do_syscall_64+0x5c/0xc0 Aug 22 18:47:30 juju-e4d256-prod-github-runner-207 kernel: [48224.607825] ? do_futex+0x162/0x1f0 Aug 22 18:47:30 juju-e4d256-prod-github-runner-207 kernel: [48224.608474] ? __x64_sys_futex+0x78/0x1e0 Aug 22 18:47:30 juju-e4d256-prod-github-runner-207 kernel: [48224.609148] ? __secure_computing+0xa9/0x120 Aug 22 18:47:30 juju-e4d256-prod-github-runner-207 kernel: [48224.609842] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 18:47:30 juju-e4d256-prod-github-runner-207 kernel: [48224.610608] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:47:30 juju-e4d256-prod-github-runner-207 kernel: [48224.611332] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:47:30 juju-e4d256-prod-github-runner-207 kernel: [48224.612064] ? do_syscall_64+0x69/0xc0 Aug 22 18:47:30 juju-e4d256-prod-github-runner-207 kernel: [48224.612711] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:47:30 juju-e4d256-prod-github-runner-207 kernel: [48224.613414] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:47:30 juju-e4d256-prod-github-runner-207 kernel: [48224.614114] ? do_syscall_64+0x69/0xc0 Aug 22 18:47:30 juju-e4d256-prod-github-runner-207 kernel: [48224.614738] ? do_syscall_64+0x69/0xc0 Aug 22 18:47:30 juju-e4d256-prod-github-runner-207 kernel: [48224.615366] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 18:47:30 juju-e4d256-prod-github-runner-207 kernel: [48224.616091] RIP: 0033:0x7faa5d0edaff Aug 22 18:47:30 juju-e4d256-prod-github-runner-207 kernel: [48224.616717] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 18:47:30 juju-e4d256-prod-github-runner-207 kernel: [48224.618701] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 18:47:30 juju-e4d256-prod-github-runner-207 kernel: [48224.619613] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 18:47:30 juju-e4d256-prod-github-runner-207 kernel: [48224.620524] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 18:47:30 juju-e4d256-prod-github-runner-207 kernel: [48224.621421] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 18:47:30 juju-e4d256-prod-github-runner-207 kernel: [48224.622312] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 18:47:30 juju-e4d256-prod-github-runner-207 kernel: [48224.623201] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 18:47:30 juju-e4d256-prod-github-runner-207 kernel: [48224.624111] Aug 22 18:47:46 juju-e4d256-prod-github-runner-207 kernel: [48240.404709] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 18:47:46 juju-e4d256-prod-github-runner-207 kernel: [48240.405684] rcu: 1-....: (11992977 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=5800413 Aug 22 18:47:46 juju-e4d256-prod-github-runner-207 kernel: [48240.406821] (t=12030801 jiffies g=23269 q=46419) Aug 22 18:47:46 juju-e4d256-prod-github-runner-207 kernel: [48240.407635] NMI backtrace for cpu 1 Aug 22 18:47:46 juju-e4d256-prod-github-runner-207 kernel: [48240.408354] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 18:47:46 juju-e4d256-prod-github-runner-207 kernel: [48240.409467] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 18:47:46 juju-e4d256-prod-github-runner-207 kernel: [48240.410527] Call Trace: Aug 22 18:47:46 juju-e4d256-prod-github-runner-207 kernel: [48240.411209] Aug 22 18:47:46 juju-e4d256-prod-github-runner-207 kernel: [48240.411875] show_stack+0x52/0x5c Aug 22 18:47:46 juju-e4d256-prod-github-runner-207 kernel: [48240.412604] dump_stack_lvl+0x4a/0x63 Aug 22 18:47:46 juju-e4d256-prod-github-runner-207 kernel: [48240.413356] dump_stack+0x10/0x16 Aug 22 18:47:46 juju-e4d256-prod-github-runner-207 kernel: [48240.414083] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 18:47:46 juju-e4d256-prod-github-runner-207 kernel: [48240.414864] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 18:47:46 juju-e4d256-prod-github-runner-207 kernel: [48240.415665] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 18:47:46 juju-e4d256-prod-github-runner-207 kernel: [48240.416493] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 18:47:46 juju-e4d256-prod-github-runner-207 kernel: [48240.417315] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 18:47:46 juju-e4d256-prod-github-runner-207 kernel: [48240.418123] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 18:47:46 juju-e4d256-prod-github-runner-207 kernel: [48240.418900] print_cpu_stall.cold+0x2f/0xe2 Aug 22 18:47:46 juju-e4d256-prod-github-runner-207 kernel: [48240.419684] ? timekeeping_update+0xf7/0x150 Aug 22 18:47:46 juju-e4d256-prod-github-runner-207 kernel: [48240.420457] check_cpu_stall+0x109/0x270 Aug 22 18:47:46 juju-e4d256-prod-github-runner-207 kernel: [48240.421213] rcu_sched_clock_irq+0x9a/0x250 Aug 22 18:47:46 juju-e4d256-prod-github-runner-207 kernel: [48240.421975] update_process_times+0x94/0xd0 Aug 22 18:47:46 juju-e4d256-prod-github-runner-207 kernel: [48240.422744] tick_sched_handle+0x29/0x70 Aug 22 18:47:46 juju-e4d256-prod-github-runner-207 kernel: [48240.423497] tick_sched_timer+0x8c/0xc0 Aug 22 18:47:46 juju-e4d256-prod-github-runner-207 kernel: [48240.424256] ? tick_nohz_handler+0xb0/0xb0 Aug 22 18:47:46 juju-e4d256-prod-github-runner-207 kernel: [48240.425013] __hrtimer_run_queues+0x107/0x230 Aug 22 18:47:46 juju-e4d256-prod-github-runner-207 kernel: [48240.425788] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 18:47:46 juju-e4d256-prod-github-runner-207 kernel: [48240.426563] hrtimer_interrupt+0x101/0x220 Aug 22 18:47:46 juju-e4d256-prod-github-runner-207 kernel: [48240.427321] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 18:47:46 juju-e4d256-prod-github-runner-207 kernel: [48240.428153] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 18:47:46 juju-e4d256-prod-github-runner-207 kernel: [48240.428963] Aug 22 18:47:46 juju-e4d256-prod-github-runner-207 kernel: [48240.429601] Aug 22 18:47:46 juju-e4d256-prod-github-runner-207 kernel: [48240.430237] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 18:47:46 juju-e4d256-prod-github-runner-207 kernel: [48240.431057] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:47:46 juju-e4d256-prod-github-runner-207 kernel: [48240.431960] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 18:47:46 juju-e4d256-prod-github-runner-207 kernel: [48240.434186] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 18:47:46 juju-e4d256-prod-github-runner-207 kernel: [48240.435073] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 18:47:46 juju-e4d256-prod-github-runner-207 kernel: [48240.436095] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 18:47:46 juju-e4d256-prod-github-runner-207 kernel: [48240.437073] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 18:47:46 juju-e4d256-prod-github-runner-207 kernel: [48240.438037] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 18:47:46 juju-e4d256-prod-github-runner-207 kernel: [48240.438999] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 18:47:46 juju-e4d256-prod-github-runner-207 kernel: [48240.439973] ? _raw_spin_lock+0x22/0x30 Aug 22 18:47:46 juju-e4d256-prod-github-runner-207 kernel: [48240.440737] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:47:46 juju-e4d256-prod-github-runner-207 kernel: [48240.441574] direct_page_fault+0x206/0x310 [kvm] Aug 22 18:47:46 juju-e4d256-prod-github-runner-207 kernel: [48240.442412] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 18:47:46 juju-e4d256-prod-github-runner-207 kernel: [48240.443241] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 18:47:46 juju-e4d256-prod-github-runner-207 kernel: [48240.444079] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 18:47:46 juju-e4d256-prod-github-runner-207 kernel: [48240.444890] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 18:47:46 juju-e4d256-prod-github-runner-207 kernel: [48240.445682] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 18:47:46 juju-e4d256-prod-github-runner-207 kernel: [48240.446504] handle_exit+0x98/0x230 [kvm_amd] Aug 22 18:47:46 juju-e4d256-prod-github-runner-207 kernel: [48240.447262] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 18:47:46 juju-e4d256-prod-github-runner-207 kernel: [48240.448062] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 18:47:46 juju-e4d256-prod-github-runner-207 kernel: [48240.448861] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 18:47:46 juju-e4d256-prod-github-runner-207 kernel: [48240.449651] vcpu_run+0x62/0x2c0 [kvm] Aug 22 18:47:46 juju-e4d256-prod-github-runner-207 kernel: [48240.450368] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 18:47:46 juju-e4d256-prod-github-runner-207 kernel: [48240.451102] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 18:47:46 juju-e4d256-prod-github-runner-207 kernel: [48240.451919] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 18:47:46 juju-e4d256-prod-github-runner-207 kernel: [48240.452682] ? __seccomp_filter+0x4a/0x4a0 Aug 22 18:47:46 juju-e4d256-prod-github-runner-207 kernel: [48240.453404] ? __fget_files+0x86/0xc0 Aug 22 18:47:46 juju-e4d256-prod-github-runner-207 kernel: [48240.454096] __x64_sys_ioctl+0x95/0xd0 Aug 22 18:47:46 juju-e4d256-prod-github-runner-207 kernel: [48240.454793] do_syscall_64+0x5c/0xc0 Aug 22 18:47:46 juju-e4d256-prod-github-runner-207 kernel: [48240.455477] ? do_futex+0x162/0x1f0 Aug 22 18:47:46 juju-e4d256-prod-github-runner-207 kernel: [48240.456166] ? __x64_sys_futex+0x78/0x1e0 Aug 22 18:47:46 juju-e4d256-prod-github-runner-207 kernel: [48240.456868] ? __secure_computing+0xa9/0x120 Aug 22 18:47:46 juju-e4d256-prod-github-runner-207 kernel: [48240.457583] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 18:47:46 juju-e4d256-prod-github-runner-207 kernel: [48240.458377] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:47:46 juju-e4d256-prod-github-runner-207 kernel: [48240.459129] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:47:46 juju-e4d256-prod-github-runner-207 kernel: [48240.459895] ? do_syscall_64+0x69/0xc0 Aug 22 18:47:46 juju-e4d256-prod-github-runner-207 kernel: [48240.460587] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:47:46 juju-e4d256-prod-github-runner-207 kernel: [48240.461349] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:47:46 juju-e4d256-prod-github-runner-207 kernel: [48240.462106] ? do_syscall_64+0x69/0xc0 Aug 22 18:47:46 juju-e4d256-prod-github-runner-207 kernel: [48240.462800] ? do_syscall_64+0x69/0xc0 Aug 22 18:47:46 juju-e4d256-prod-github-runner-207 kernel: [48240.463487] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 18:47:46 juju-e4d256-prod-github-runner-207 kernel: [48240.464266] RIP: 0033:0x7faa5d0edaff Aug 22 18:47:46 juju-e4d256-prod-github-runner-207 kernel: [48240.464950] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 18:47:46 juju-e4d256-prod-github-runner-207 kernel: [48240.467067] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 18:47:46 juju-e4d256-prod-github-runner-207 kernel: [48240.468044] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 18:47:46 juju-e4d256-prod-github-runner-207 kernel: [48240.468988] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 18:47:46 juju-e4d256-prod-github-runner-207 kernel: [48240.470117] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 18:47:46 juju-e4d256-prod-github-runner-207 kernel: [48240.471066] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 18:47:46 juju-e4d256-prod-github-runner-207 kernel: [48240.472025] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 18:47:46 juju-e4d256-prod-github-runner-207 kernel: [48240.472944] Aug 22 18:48:10 juju-e4d256-prod-github-runner-207 kernel: [48264.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 44841s! [qemu-system-x86:6715] Aug 22 18:48:10 juju-e4d256-prod-github-runner-207 kernel: [48264.543724] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 18:48:10 juju-e4d256-prod-github-runner-207 kernel: [48264.543957] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 18:48:10 juju-e4d256-prod-github-runner-207 kernel: [48264.556087] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 18:48:10 juju-e4d256-prod-github-runner-207 kernel: [48264.557354] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 18:48:10 juju-e4d256-prod-github-runner-207 kernel: [48264.558577] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:48:10 juju-e4d256-prod-github-runner-207 kernel: [48264.559641] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 18:48:10 juju-e4d256-prod-github-runner-207 kernel: [48264.562193] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 18:48:10 juju-e4d256-prod-github-runner-207 kernel: [48264.563248] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 18:48:10 juju-e4d256-prod-github-runner-207 kernel: [48264.564414] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 18:48:10 juju-e4d256-prod-github-runner-207 kernel: [48264.565574] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 18:48:10 juju-e4d256-prod-github-runner-207 kernel: [48264.566737] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 18:48:10 juju-e4d256-prod-github-runner-207 kernel: [48264.567910] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 18:48:10 juju-e4d256-prod-github-runner-207 kernel: [48264.569093] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 18:48:10 juju-e4d256-prod-github-runner-207 kernel: [48264.570331] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 18:48:10 juju-e4d256-prod-github-runner-207 kernel: [48264.571450] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 18:48:10 juju-e4d256-prod-github-runner-207 kernel: [48264.572649] Call Trace: Aug 22 18:48:10 juju-e4d256-prod-github-runner-207 kernel: [48264.573569] Aug 22 18:48:10 juju-e4d256-prod-github-runner-207 kernel: [48264.574453] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:48:10 juju-e4d256-prod-github-runner-207 kernel: [48264.575503] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:48:10 juju-e4d256-prod-github-runner-207 kernel: [48264.576532] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:48:10 juju-e4d256-prod-github-runner-207 kernel: [48264.577641] ? show_regs.part.0+0x23/0x29 Aug 22 18:48:10 juju-e4d256-prod-github-runner-207 kernel: [48264.578639] ? show_regs.cold+0x8/0xd Aug 22 18:48:10 juju-e4d256-prod-github-runner-207 kernel: [48264.579621] ? watchdog_timer_fn+0x1be/0x220 Aug 22 18:48:10 juju-e4d256-prod-github-runner-207 kernel: [48264.580630] ? lockup_detector_update_enable+0x60/0x60 Aug 22 18:48:10 juju-e4d256-prod-github-runner-207 kernel: [48264.581694] ? __hrtimer_run_queues+0x107/0x230 Aug 22 18:48:10 juju-e4d256-prod-github-runner-207 kernel: [48264.582721] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 18:48:10 juju-e4d256-prod-github-runner-207 kernel: [48264.583761] ? hrtimer_interrupt+0x101/0x220 Aug 22 18:48:10 juju-e4d256-prod-github-runner-207 kernel: [48264.584778] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 18:48:10 juju-e4d256-prod-github-runner-207 kernel: [48264.585850] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 18:48:10 juju-e4d256-prod-github-runner-207 kernel: [48264.586894] Aug 22 18:48:10 juju-e4d256-prod-github-runner-207 kernel: [48264.587763] Aug 22 18:48:10 juju-e4d256-prod-github-runner-207 kernel: [48264.588600] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 18:48:10 juju-e4d256-prod-github-runner-207 kernel: [48264.589638] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:48:10 juju-e4d256-prod-github-runner-207 kernel: [48264.590675] ? _raw_spin_lock+0x22/0x30 Aug 22 18:48:10 juju-e4d256-prod-github-runner-207 kernel: [48264.591633] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:48:10 juju-e4d256-prod-github-runner-207 kernel: [48264.592661] direct_page_fault+0x206/0x310 [kvm] Aug 22 18:48:10 juju-e4d256-prod-github-runner-207 kernel: [48264.593689] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 18:48:10 juju-e4d256-prod-github-runner-207 kernel: [48264.594696] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 18:48:10 juju-e4d256-prod-github-runner-207 kernel: [48264.595724] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 18:48:10 juju-e4d256-prod-github-runner-207 kernel: [48264.596730] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 18:48:10 juju-e4d256-prod-github-runner-207 kernel: [48264.597676] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 18:48:10 juju-e4d256-prod-github-runner-207 kernel: [48264.598658] handle_exit+0x98/0x230 [kvm_amd] Aug 22 18:48:10 juju-e4d256-prod-github-runner-207 kernel: [48264.599563] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 18:48:10 juju-e4d256-prod-github-runner-207 kernel: [48264.600477] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 18:48:10 juju-e4d256-prod-github-runner-207 kernel: [48264.601408] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 18:48:10 juju-e4d256-prod-github-runner-207 kernel: [48264.602311] vcpu_run+0x62/0x2c0 [kvm] Aug 22 18:48:10 juju-e4d256-prod-github-runner-207 kernel: [48264.603130] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 18:48:10 juju-e4d256-prod-github-runner-207 kernel: [48264.603968] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 18:48:10 juju-e4d256-prod-github-runner-207 kernel: [48264.604821] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 18:48:10 juju-e4d256-prod-github-runner-207 kernel: [48264.605622] ? __seccomp_filter+0x4a/0x4a0 Aug 22 18:48:10 juju-e4d256-prod-github-runner-207 kernel: [48264.606367] ? __fget_files+0x86/0xc0 Aug 22 18:48:10 juju-e4d256-prod-github-runner-207 kernel: [48264.607076] __x64_sys_ioctl+0x95/0xd0 Aug 22 18:48:10 juju-e4d256-prod-github-runner-207 kernel: [48264.607780] do_syscall_64+0x5c/0xc0 Aug 22 18:48:10 juju-e4d256-prod-github-runner-207 kernel: [48264.608445] ? do_futex+0x162/0x1f0 Aug 22 18:48:10 juju-e4d256-prod-github-runner-207 kernel: [48264.609095] ? __x64_sys_futex+0x78/0x1e0 Aug 22 18:48:10 juju-e4d256-prod-github-runner-207 kernel: [48264.609768] ? __secure_computing+0xa9/0x120 Aug 22 18:48:10 juju-e4d256-prod-github-runner-207 kernel: [48264.610461] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 18:48:10 juju-e4d256-prod-github-runner-207 kernel: [48264.611238] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:48:10 juju-e4d256-prod-github-runner-207 kernel: [48264.611960] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:48:10 juju-e4d256-prod-github-runner-207 kernel: [48264.612678] ? do_syscall_64+0x69/0xc0 Aug 22 18:48:10 juju-e4d256-prod-github-runner-207 kernel: [48264.613324] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:48:10 juju-e4d256-prod-github-runner-207 kernel: [48264.614032] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:48:10 juju-e4d256-prod-github-runner-207 kernel: [48264.614726] ? do_syscall_64+0x69/0xc0 Aug 22 18:48:10 juju-e4d256-prod-github-runner-207 kernel: [48264.615368] ? do_syscall_64+0x69/0xc0 Aug 22 18:48:10 juju-e4d256-prod-github-runner-207 kernel: [48264.615997] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 18:48:10 juju-e4d256-prod-github-runner-207 kernel: [48264.616703] RIP: 0033:0x7faa5d0edaff Aug 22 18:48:10 juju-e4d256-prod-github-runner-207 kernel: [48264.617355] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 18:48:10 juju-e4d256-prod-github-runner-207 kernel: [48264.619345] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 18:48:10 juju-e4d256-prod-github-runner-207 kernel: [48264.620262] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 18:48:10 juju-e4d256-prod-github-runner-207 kernel: [48264.621157] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 18:48:10 juju-e4d256-prod-github-runner-207 kernel: [48264.622045] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 18:48:10 juju-e4d256-prod-github-runner-207 kernel: [48264.622934] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 18:48:10 juju-e4d256-prod-github-runner-207 kernel: [48264.623835] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 18:48:10 juju-e4d256-prod-github-runner-207 kernel: [48264.624729] Aug 22 18:48:38 juju-e4d256-prod-github-runner-207 kernel: [48292.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 44867s! [qemu-system-x86:6715] Aug 22 18:48:38 juju-e4d256-prod-github-runner-207 kernel: [48292.543129] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 18:48:38 juju-e4d256-prod-github-runner-207 kernel: [48292.543196] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 18:48:38 juju-e4d256-prod-github-runner-207 kernel: [48292.555352] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 18:48:38 juju-e4d256-prod-github-runner-207 kernel: [48292.556675] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 18:48:38 juju-e4d256-prod-github-runner-207 kernel: [48292.557903] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:48:38 juju-e4d256-prod-github-runner-207 kernel: [48292.558983] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 18:48:38 juju-e4d256-prod-github-runner-207 kernel: [48292.561553] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 18:48:38 juju-e4d256-prod-github-runner-207 kernel: [48292.562786] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 18:48:38 juju-e4d256-prod-github-runner-207 kernel: [48292.563972] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 18:48:38 juju-e4d256-prod-github-runner-207 kernel: [48292.565130] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 18:48:38 juju-e4d256-prod-github-runner-207 kernel: [48292.566295] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 18:48:38 juju-e4d256-prod-github-runner-207 kernel: [48292.567477] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 18:48:38 juju-e4d256-prod-github-runner-207 kernel: [48292.568651] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 18:48:38 juju-e4d256-prod-github-runner-207 kernel: [48292.570060] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 18:48:38 juju-e4d256-prod-github-runner-207 kernel: [48292.571279] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 18:48:38 juju-e4d256-prod-github-runner-207 kernel: [48292.572509] Call Trace: Aug 22 18:48:38 juju-e4d256-prod-github-runner-207 kernel: [48292.573435] Aug 22 18:48:38 juju-e4d256-prod-github-runner-207 kernel: [48292.574324] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:48:38 juju-e4d256-prod-github-runner-207 kernel: [48292.575384] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:48:38 juju-e4d256-prod-github-runner-207 kernel: [48292.576409] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:48:38 juju-e4d256-prod-github-runner-207 kernel: [48292.577546] ? show_regs.part.0+0x23/0x29 Aug 22 18:48:38 juju-e4d256-prod-github-runner-207 kernel: [48292.578593] ? show_regs.cold+0x8/0xd Aug 22 18:48:38 juju-e4d256-prod-github-runner-207 kernel: [48292.579659] ? watchdog_timer_fn+0x1be/0x220 Aug 22 18:48:38 juju-e4d256-prod-github-runner-207 kernel: [48292.580679] ? lockup_detector_update_enable+0x60/0x60 Aug 22 18:48:38 juju-e4d256-prod-github-runner-207 kernel: [48292.581746] ? __hrtimer_run_queues+0x107/0x230 Aug 22 18:48:38 juju-e4d256-prod-github-runner-207 kernel: [48292.582804] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 18:48:38 juju-e4d256-prod-github-runner-207 kernel: [48292.583874] ? hrtimer_interrupt+0x101/0x220 Aug 22 18:48:38 juju-e4d256-prod-github-runner-207 kernel: [48292.584915] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 18:48:38 juju-e4d256-prod-github-runner-207 kernel: [48292.585990] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 18:48:38 juju-e4d256-prod-github-runner-207 kernel: [48292.587066] Aug 22 18:48:38 juju-e4d256-prod-github-runner-207 kernel: [48292.587920] Aug 22 18:48:38 juju-e4d256-prod-github-runner-207 kernel: [48292.588757] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 18:48:38 juju-e4d256-prod-github-runner-207 kernel: [48292.589787] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:48:38 juju-e4d256-prod-github-runner-207 kernel: [48292.590825] ? _raw_spin_lock+0x22/0x30 Aug 22 18:48:38 juju-e4d256-prod-github-runner-207 kernel: [48292.591792] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:48:38 juju-e4d256-prod-github-runner-207 kernel: [48292.592817] direct_page_fault+0x206/0x310 [kvm] Aug 22 18:48:38 juju-e4d256-prod-github-runner-207 kernel: [48292.593841] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 18:48:38 juju-e4d256-prod-github-runner-207 kernel: [48292.594893] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 18:48:38 juju-e4d256-prod-github-runner-207 kernel: [48292.595931] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 18:48:38 juju-e4d256-prod-github-runner-207 kernel: [48292.596904] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 18:48:38 juju-e4d256-prod-github-runner-207 kernel: [48292.597855] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 18:48:38 juju-e4d256-prod-github-runner-207 kernel: [48292.598835] handle_exit+0x98/0x230 [kvm_amd] Aug 22 18:48:38 juju-e4d256-prod-github-runner-207 kernel: [48292.599755] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 18:48:38 juju-e4d256-prod-github-runner-207 kernel: [48292.600676] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 18:48:38 juju-e4d256-prod-github-runner-207 kernel: [48292.601603] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 18:48:38 juju-e4d256-prod-github-runner-207 kernel: [48292.602508] vcpu_run+0x62/0x2c0 [kvm] Aug 22 18:48:38 juju-e4d256-prod-github-runner-207 kernel: [48292.603345] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 18:48:38 juju-e4d256-prod-github-runner-207 kernel: [48292.604171] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 18:48:38 juju-e4d256-prod-github-runner-207 kernel: [48292.605028] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 18:48:38 juju-e4d256-prod-github-runner-207 kernel: [48292.605828] ? __seccomp_filter+0x4a/0x4a0 Aug 22 18:48:38 juju-e4d256-prod-github-runner-207 kernel: [48292.606587] ? __fget_files+0x86/0xc0 Aug 22 18:48:38 juju-e4d256-prod-github-runner-207 kernel: [48292.607330] __x64_sys_ioctl+0x95/0xd0 Aug 22 18:48:38 juju-e4d256-prod-github-runner-207 kernel: [48292.608037] do_syscall_64+0x5c/0xc0 Aug 22 18:48:38 juju-e4d256-prod-github-runner-207 kernel: [48292.608709] ? do_futex+0x162/0x1f0 Aug 22 18:48:38 juju-e4d256-prod-github-runner-207 kernel: [48292.609371] ? __x64_sys_futex+0x78/0x1e0 Aug 22 18:48:38 juju-e4d256-prod-github-runner-207 kernel: [48292.610047] ? __secure_computing+0xa9/0x120 Aug 22 18:48:38 juju-e4d256-prod-github-runner-207 kernel: [48292.610742] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 18:48:38 juju-e4d256-prod-github-runner-207 kernel: [48292.611531] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:48:38 juju-e4d256-prod-github-runner-207 kernel: [48292.612255] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:48:38 juju-e4d256-prod-github-runner-207 kernel: [48292.612977] ? do_syscall_64+0x69/0xc0 Aug 22 18:48:38 juju-e4d256-prod-github-runner-207 kernel: [48292.613624] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:48:38 juju-e4d256-prod-github-runner-207 kernel: [48292.614329] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:48:38 juju-e4d256-prod-github-runner-207 kernel: [48292.615047] ? do_syscall_64+0x69/0xc0 Aug 22 18:48:38 juju-e4d256-prod-github-runner-207 kernel: [48292.615676] ? do_syscall_64+0x69/0xc0 Aug 22 18:48:38 juju-e4d256-prod-github-runner-207 kernel: [48292.616304] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 18:48:38 juju-e4d256-prod-github-runner-207 kernel: [48292.617011] RIP: 0033:0x7faa5d0edaff Aug 22 18:48:38 juju-e4d256-prod-github-runner-207 kernel: [48292.617669] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 18:48:38 juju-e4d256-prod-github-runner-207 kernel: [48292.619703] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 18:48:38 juju-e4d256-prod-github-runner-207 kernel: [48292.620619] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 18:48:38 juju-e4d256-prod-github-runner-207 kernel: [48292.621518] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 18:48:38 juju-e4d256-prod-github-runner-207 kernel: [48292.622414] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 18:48:38 juju-e4d256-prod-github-runner-207 kernel: [48292.623323] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 18:48:38 juju-e4d256-prod-github-runner-207 kernel: [48292.624216] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 18:48:38 juju-e4d256-prod-github-runner-207 kernel: [48292.625110] Aug 22 18:49:06 juju-e4d256-prod-github-runner-207 kernel: [48320.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 44894s! [qemu-system-x86:6715] Aug 22 18:49:06 juju-e4d256-prod-github-runner-207 kernel: [48320.543768] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 18:49:06 juju-e4d256-prod-github-runner-207 kernel: [48320.544025] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 18:49:06 juju-e4d256-prod-github-runner-207 kernel: [48320.556120] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 18:49:06 juju-e4d256-prod-github-runner-207 kernel: [48320.557391] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 18:49:06 juju-e4d256-prod-github-runner-207 kernel: [48320.558626] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:49:06 juju-e4d256-prod-github-runner-207 kernel: [48320.559688] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 18:49:06 juju-e4d256-prod-github-runner-207 kernel: [48320.562238] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 18:49:06 juju-e4d256-prod-github-runner-207 kernel: [48320.563289] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 18:49:06 juju-e4d256-prod-github-runner-207 kernel: [48320.564450] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 18:49:06 juju-e4d256-prod-github-runner-207 kernel: [48320.565614] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 18:49:06 juju-e4d256-prod-github-runner-207 kernel: [48320.566782] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 18:49:06 juju-e4d256-prod-github-runner-207 kernel: [48320.567944] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 18:49:06 juju-e4d256-prod-github-runner-207 kernel: [48320.569111] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 18:49:06 juju-e4d256-prod-github-runner-207 kernel: [48320.570350] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 18:49:06 juju-e4d256-prod-github-runner-207 kernel: [48320.571459] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 18:49:06 juju-e4d256-prod-github-runner-207 kernel: [48320.572653] Call Trace: Aug 22 18:49:06 juju-e4d256-prod-github-runner-207 kernel: [48320.573571] Aug 22 18:49:06 juju-e4d256-prod-github-runner-207 kernel: [48320.574467] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:49:06 juju-e4d256-prod-github-runner-207 kernel: [48320.575521] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:49:06 juju-e4d256-prod-github-runner-207 kernel: [48320.576547] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:49:06 juju-e4d256-prod-github-runner-207 kernel: [48320.577640] ? show_regs.part.0+0x23/0x29 Aug 22 18:49:06 juju-e4d256-prod-github-runner-207 kernel: [48320.578649] ? show_regs.cold+0x8/0xd Aug 22 18:49:06 juju-e4d256-prod-github-runner-207 kernel: [48320.579622] ? watchdog_timer_fn+0x1be/0x220 Aug 22 18:49:06 juju-e4d256-prod-github-runner-207 kernel: [48320.580631] ? lockup_detector_update_enable+0x60/0x60 Aug 22 18:49:06 juju-e4d256-prod-github-runner-207 kernel: [48320.581697] ? __hrtimer_run_queues+0x107/0x230 Aug 22 18:49:06 juju-e4d256-prod-github-runner-207 kernel: [48320.582738] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 18:49:06 juju-e4d256-prod-github-runner-207 kernel: [48320.583762] ? hrtimer_interrupt+0x101/0x220 Aug 22 18:49:06 juju-e4d256-prod-github-runner-207 kernel: [48320.584782] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 18:49:06 juju-e4d256-prod-github-runner-207 kernel: [48320.585849] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 18:49:06 juju-e4d256-prod-github-runner-207 kernel: [48320.586907] Aug 22 18:49:06 juju-e4d256-prod-github-runner-207 kernel: [48320.587759] Aug 22 18:49:06 juju-e4d256-prod-github-runner-207 kernel: [48320.588601] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 18:49:06 juju-e4d256-prod-github-runner-207 kernel: [48320.589637] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:49:06 juju-e4d256-prod-github-runner-207 kernel: [48320.590685] ? _raw_spin_lock+0x22/0x30 Aug 22 18:49:06 juju-e4d256-prod-github-runner-207 kernel: [48320.591636] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:49:06 juju-e4d256-prod-github-runner-207 kernel: [48320.592654] direct_page_fault+0x206/0x310 [kvm] Aug 22 18:49:06 juju-e4d256-prod-github-runner-207 kernel: [48320.593684] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 18:49:06 juju-e4d256-prod-github-runner-207 kernel: [48320.594702] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 18:49:06 juju-e4d256-prod-github-runner-207 kernel: [48320.595704] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 18:49:06 juju-e4d256-prod-github-runner-207 kernel: [48320.596697] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 18:49:06 juju-e4d256-prod-github-runner-207 kernel: [48320.597642] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 18:49:06 juju-e4d256-prod-github-runner-207 kernel: [48320.598633] handle_exit+0x98/0x230 [kvm_amd] Aug 22 18:49:06 juju-e4d256-prod-github-runner-207 kernel: [48320.599525] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 18:49:06 juju-e4d256-prod-github-runner-207 kernel: [48320.600438] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 18:49:06 juju-e4d256-prod-github-runner-207 kernel: [48320.601366] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 18:49:06 juju-e4d256-prod-github-runner-207 kernel: [48320.602268] vcpu_run+0x62/0x2c0 [kvm] Aug 22 18:49:06 juju-e4d256-prod-github-runner-207 kernel: [48320.603090] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 18:49:06 juju-e4d256-prod-github-runner-207 kernel: [48320.603903] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 18:49:06 juju-e4d256-prod-github-runner-207 kernel: [48320.604763] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 18:49:06 juju-e4d256-prod-github-runner-207 kernel: [48320.605559] ? __seccomp_filter+0x4a/0x4a0 Aug 22 18:49:06 juju-e4d256-prod-github-runner-207 kernel: [48320.606301] ? __fget_files+0x86/0xc0 Aug 22 18:49:06 juju-e4d256-prod-github-runner-207 kernel: [48320.607011] __x64_sys_ioctl+0x95/0xd0 Aug 22 18:49:06 juju-e4d256-prod-github-runner-207 kernel: [48320.607702] do_syscall_64+0x5c/0xc0 Aug 22 18:49:06 juju-e4d256-prod-github-runner-207 kernel: [48320.608366] ? do_futex+0x162/0x1f0 Aug 22 18:49:06 juju-e4d256-prod-github-runner-207 kernel: [48320.609013] ? __x64_sys_futex+0x78/0x1e0 Aug 22 18:49:06 juju-e4d256-prod-github-runner-207 kernel: [48320.609685] ? __secure_computing+0xa9/0x120 Aug 22 18:49:06 juju-e4d256-prod-github-runner-207 kernel: [48320.610372] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 18:49:06 juju-e4d256-prod-github-runner-207 kernel: [48320.611147] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:49:06 juju-e4d256-prod-github-runner-207 kernel: [48320.611869] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:49:06 juju-e4d256-prod-github-runner-207 kernel: [48320.612586] ? do_syscall_64+0x69/0xc0 Aug 22 18:49:06 juju-e4d256-prod-github-runner-207 kernel: [48320.613230] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:49:06 juju-e4d256-prod-github-runner-207 kernel: [48320.613931] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:49:06 juju-e4d256-prod-github-runner-207 kernel: [48320.614632] ? do_syscall_64+0x69/0xc0 Aug 22 18:49:06 juju-e4d256-prod-github-runner-207 kernel: [48320.615256] ? do_syscall_64+0x69/0xc0 Aug 22 18:49:06 juju-e4d256-prod-github-runner-207 kernel: [48320.615879] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 18:49:06 juju-e4d256-prod-github-runner-207 kernel: [48320.616583] RIP: 0033:0x7faa5d0edaff Aug 22 18:49:06 juju-e4d256-prod-github-runner-207 kernel: [48320.617234] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 18:49:06 juju-e4d256-prod-github-runner-207 kernel: [48320.619230] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 18:49:06 juju-e4d256-prod-github-runner-207 kernel: [48320.620142] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 18:49:06 juju-e4d256-prod-github-runner-207 kernel: [48320.621103] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 18:49:06 juju-e4d256-prod-github-runner-207 kernel: [48320.621991] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 18:49:06 juju-e4d256-prod-github-runner-207 kernel: [48320.622915] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 18:49:06 juju-e4d256-prod-github-runner-207 kernel: [48320.623809] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 18:49:06 juju-e4d256-prod-github-runner-207 kernel: [48320.624701] Aug 22 18:49:34 juju-e4d256-prod-github-runner-207 kernel: [48348.541981] watchdog: BUG: soft lockup - CPU#1 stuck for 44920s! [qemu-system-x86:6715] Aug 22 18:49:34 juju-e4d256-prod-github-runner-207 kernel: [48348.543979] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 18:49:34 juju-e4d256-prod-github-runner-207 kernel: [48348.544304] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 18:49:34 juju-e4d256-prod-github-runner-207 kernel: [48348.557223] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 18:49:34 juju-e4d256-prod-github-runner-207 kernel: [48348.558830] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 18:49:34 juju-e4d256-prod-github-runner-207 kernel: [48348.560103] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:49:34 juju-e4d256-prod-github-runner-207 kernel: [48348.561187] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 18:49:34 juju-e4d256-prod-github-runner-207 kernel: [48348.563890] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 18:49:34 juju-e4d256-prod-github-runner-207 kernel: [48348.565082] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 18:49:34 juju-e4d256-prod-github-runner-207 kernel: [48348.566342] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 18:49:34 juju-e4d256-prod-github-runner-207 kernel: [48348.567530] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 18:49:34 juju-e4d256-prod-github-runner-207 kernel: [48348.568736] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 18:49:34 juju-e4d256-prod-github-runner-207 kernel: [48348.569929] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 18:49:34 juju-e4d256-prod-github-runner-207 kernel: [48348.571154] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 18:49:34 juju-e4d256-prod-github-runner-207 kernel: [48348.572392] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 18:49:34 juju-e4d256-prod-github-runner-207 kernel: [48348.573557] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 18:49:34 juju-e4d256-prod-github-runner-207 kernel: [48348.574781] Call Trace: Aug 22 18:49:34 juju-e4d256-prod-github-runner-207 kernel: [48348.575753] Aug 22 18:49:34 juju-e4d256-prod-github-runner-207 kernel: [48348.576676] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:49:34 juju-e4d256-prod-github-runner-207 kernel: [48348.577731] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:49:34 juju-e4d256-prod-github-runner-207 kernel: [48348.578800] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:49:34 juju-e4d256-prod-github-runner-207 kernel: [48348.579912] ? show_regs.part.0+0x23/0x29 Aug 22 18:49:34 juju-e4d256-prod-github-runner-207 kernel: [48348.580935] ? show_regs.cold+0x8/0xd Aug 22 18:49:34 juju-e4d256-prod-github-runner-207 kernel: [48348.581921] ? watchdog_timer_fn+0x1be/0x220 Aug 22 18:49:34 juju-e4d256-prod-github-runner-207 kernel: [48348.583010] ? lockup_detector_update_enable+0x60/0x60 Aug 22 18:49:34 juju-e4d256-prod-github-runner-207 kernel: [48348.584091] ? __hrtimer_run_queues+0x107/0x230 Aug 22 18:49:34 juju-e4d256-prod-github-runner-207 kernel: [48348.585327] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 18:49:34 juju-e4d256-prod-github-runner-207 kernel: [48348.586475] ? hrtimer_interrupt+0x101/0x220 Aug 22 18:49:34 juju-e4d256-prod-github-runner-207 kernel: [48348.587518] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 18:49:34 juju-e4d256-prod-github-runner-207 kernel: [48348.588686] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 18:49:34 juju-e4d256-prod-github-runner-207 kernel: [48348.589744] Aug 22 18:49:34 juju-e4d256-prod-github-runner-207 kernel: [48348.590631] Aug 22 18:49:34 juju-e4d256-prod-github-runner-207 kernel: [48348.591488] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 18:49:34 juju-e4d256-prod-github-runner-207 kernel: [48348.592553] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:49:34 juju-e4d256-prod-github-runner-207 kernel: [48348.593641] ? _raw_spin_lock+0x22/0x30 Aug 22 18:49:34 juju-e4d256-prod-github-runner-207 kernel: [48348.594623] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:49:34 juju-e4d256-prod-github-runner-207 kernel: [48348.595662] direct_page_fault+0x206/0x310 [kvm] Aug 22 18:49:34 juju-e4d256-prod-github-runner-207 kernel: [48348.596708] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 18:49:34 juju-e4d256-prod-github-runner-207 kernel: [48348.597739] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 18:49:34 juju-e4d256-prod-github-runner-207 kernel: [48348.598799] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 18:49:34 juju-e4d256-prod-github-runner-207 kernel: [48348.599825] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 18:49:34 juju-e4d256-prod-github-runner-207 kernel: [48348.600800] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 18:49:34 juju-e4d256-prod-github-runner-207 kernel: [48348.601806] handle_exit+0x98/0x230 [kvm_amd] Aug 22 18:49:34 juju-e4d256-prod-github-runner-207 kernel: [48348.602747] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 18:49:34 juju-e4d256-prod-github-runner-207 kernel: [48348.603682] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 18:49:34 juju-e4d256-prod-github-runner-207 kernel: [48348.604632] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 18:49:34 juju-e4d256-prod-github-runner-207 kernel: [48348.605542] vcpu_run+0x62/0x2c0 [kvm] Aug 22 18:49:34 juju-e4d256-prod-github-runner-207 kernel: [48348.606462] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 18:49:34 juju-e4d256-prod-github-runner-207 kernel: [48348.607334] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 18:49:34 juju-e4d256-prod-github-runner-207 kernel: [48348.608222] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 18:49:34 juju-e4d256-prod-github-runner-207 kernel: [48348.609068] ? __seccomp_filter+0x4a/0x4a0 Aug 22 18:49:34 juju-e4d256-prod-github-runner-207 kernel: [48348.609831] ? __fget_files+0x86/0xc0 Aug 22 18:49:34 juju-e4d256-prod-github-runner-207 kernel: [48348.610566] __x64_sys_ioctl+0x95/0xd0 Aug 22 18:49:34 juju-e4d256-prod-github-runner-207 kernel: [48348.611266] do_syscall_64+0x5c/0xc0 Aug 22 18:49:34 juju-e4d256-prod-github-runner-207 kernel: [48348.611964] ? do_futex+0x162/0x1f0 Aug 22 18:49:34 juju-e4d256-prod-github-runner-207 kernel: [48348.612618] ? __x64_sys_futex+0x78/0x1e0 Aug 22 18:49:34 juju-e4d256-prod-github-runner-207 kernel: [48348.613322] ? __secure_computing+0xa9/0x120 Aug 22 18:49:34 juju-e4d256-prod-github-runner-207 kernel: [48348.614048] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 18:49:34 juju-e4d256-prod-github-runner-207 kernel: [48348.614999] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:49:34 juju-e4d256-prod-github-runner-207 kernel: [48348.615875] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:49:34 juju-e4d256-prod-github-runner-207 kernel: [48348.616655] ? do_syscall_64+0x69/0xc0 Aug 22 18:49:34 juju-e4d256-prod-github-runner-207 kernel: [48348.617326] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:49:34 juju-e4d256-prod-github-runner-207 kernel: [48348.618043] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:49:34 juju-e4d256-prod-github-runner-207 kernel: [48348.618815] ? do_syscall_64+0x69/0xc0 Aug 22 18:49:34 juju-e4d256-prod-github-runner-207 kernel: [48348.619467] ? do_syscall_64+0x69/0xc0 Aug 22 18:49:34 juju-e4d256-prod-github-runner-207 kernel: [48348.620119] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 18:49:34 juju-e4d256-prod-github-runner-207 kernel: [48348.620850] RIP: 0033:0x7faa5d0edaff Aug 22 18:49:34 juju-e4d256-prod-github-runner-207 kernel: [48348.621544] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 18:49:34 juju-e4d256-prod-github-runner-207 kernel: [48348.623641] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 18:49:34 juju-e4d256-prod-github-runner-207 kernel: [48348.624603] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 18:49:34 juju-e4d256-prod-github-runner-207 kernel: [48348.625516] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 18:49:34 juju-e4d256-prod-github-runner-207 kernel: [48348.626501] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 18:49:34 juju-e4d256-prod-github-runner-207 kernel: [48348.627419] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 18:49:34 juju-e4d256-prod-github-runner-207 kernel: [48348.628323] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 18:49:34 juju-e4d256-prod-github-runner-207 kernel: [48348.629263] Aug 22 18:50:02 juju-e4d256-prod-github-runner-207 kernel: [48376.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 44946s! [qemu-system-x86:6715] Aug 22 18:50:02 juju-e4d256-prod-github-runner-207 kernel: [48376.543885] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 18:50:02 juju-e4d256-prod-github-runner-207 kernel: [48376.544171] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 18:50:02 juju-e4d256-prod-github-runner-207 kernel: [48376.556509] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 18:50:02 juju-e4d256-prod-github-runner-207 kernel: [48376.557790] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 18:50:02 juju-e4d256-prod-github-runner-207 kernel: [48376.559919] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:50:02 juju-e4d256-prod-github-runner-207 kernel: [48376.560982] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 18:50:02 juju-e4d256-prod-github-runner-207 kernel: [48376.563528] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 18:50:02 juju-e4d256-prod-github-runner-207 kernel: [48376.564567] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 18:50:02 juju-e4d256-prod-github-runner-207 kernel: [48376.565725] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 18:50:02 juju-e4d256-prod-github-runner-207 kernel: [48376.566892] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 18:50:02 juju-e4d256-prod-github-runner-207 kernel: [48376.568047] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 18:50:02 juju-e4d256-prod-github-runner-207 kernel: [48376.569202] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 18:50:02 juju-e4d256-prod-github-runner-207 kernel: [48376.570388] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 18:50:02 juju-e4d256-prod-github-runner-207 kernel: [48376.571627] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 18:50:02 juju-e4d256-prod-github-runner-207 kernel: [48376.572742] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 18:50:02 juju-e4d256-prod-github-runner-207 kernel: [48376.574044] Call Trace: Aug 22 18:50:02 juju-e4d256-prod-github-runner-207 kernel: [48376.574967] Aug 22 18:50:02 juju-e4d256-prod-github-runner-207 kernel: [48376.575885] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:50:02 juju-e4d256-prod-github-runner-207 kernel: [48376.576925] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:50:02 juju-e4d256-prod-github-runner-207 kernel: [48376.577962] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:50:02 juju-e4d256-prod-github-runner-207 kernel: [48376.579073] ? show_regs.part.0+0x23/0x29 Aug 22 18:50:02 juju-e4d256-prod-github-runner-207 kernel: [48376.580075] ? show_regs.cold+0x8/0xd Aug 22 18:50:02 juju-e4d256-prod-github-runner-207 kernel: [48376.581048] ? watchdog_timer_fn+0x1be/0x220 Aug 22 18:50:02 juju-e4d256-prod-github-runner-207 kernel: [48376.582078] ? lockup_detector_update_enable+0x60/0x60 Aug 22 18:50:02 juju-e4d256-prod-github-runner-207 kernel: [48376.583162] ? __hrtimer_run_queues+0x107/0x230 Aug 22 18:50:02 juju-e4d256-prod-github-runner-207 kernel: [48376.584221] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 18:50:02 juju-e4d256-prod-github-runner-207 kernel: [48376.585283] ? hrtimer_interrupt+0x101/0x220 Aug 22 18:50:02 juju-e4d256-prod-github-runner-207 kernel: [48376.586339] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 18:50:02 juju-e4d256-prod-github-runner-207 kernel: [48376.587416] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 18:50:02 juju-e4d256-prod-github-runner-207 kernel: [48376.588465] Aug 22 18:50:02 juju-e4d256-prod-github-runner-207 kernel: [48376.589497] Aug 22 18:50:02 juju-e4d256-prod-github-runner-207 kernel: [48376.590361] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 18:50:02 juju-e4d256-prod-github-runner-207 kernel: [48376.591397] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:50:02 juju-e4d256-prod-github-runner-207 kernel: [48376.592469] ? _raw_spin_lock+0x22/0x30 Aug 22 18:50:02 juju-e4d256-prod-github-runner-207 kernel: [48376.593431] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:50:02 juju-e4d256-prod-github-runner-207 kernel: [48376.594482] direct_page_fault+0x206/0x310 [kvm] Aug 22 18:50:02 juju-e4d256-prod-github-runner-207 kernel: [48376.595511] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 18:50:02 juju-e4d256-prod-github-runner-207 kernel: [48376.596542] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 18:50:02 juju-e4d256-prod-github-runner-207 kernel: [48376.597587] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 18:50:02 juju-e4d256-prod-github-runner-207 kernel: [48376.598652] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 18:50:02 juju-e4d256-prod-github-runner-207 kernel: [48376.599601] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 18:50:02 juju-e4d256-prod-github-runner-207 kernel: [48376.600578] handle_exit+0x98/0x230 [kvm_amd] Aug 22 18:50:02 juju-e4d256-prod-github-runner-207 kernel: [48376.601480] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 18:50:02 juju-e4d256-prod-github-runner-207 kernel: [48376.602430] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 18:50:02 juju-e4d256-prod-github-runner-207 kernel: [48376.603396] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 18:50:02 juju-e4d256-prod-github-runner-207 kernel: [48376.604335] vcpu_run+0x62/0x2c0 [kvm] Aug 22 18:50:02 juju-e4d256-prod-github-runner-207 kernel: [48376.605172] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 18:50:02 juju-e4d256-prod-github-runner-207 kernel: [48376.606072] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 18:50:02 juju-e4d256-prod-github-runner-207 kernel: [48376.606984] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 18:50:02 juju-e4d256-prod-github-runner-207 kernel: [48376.607799] ? __seccomp_filter+0x4a/0x4a0 Aug 22 18:50:02 juju-e4d256-prod-github-runner-207 kernel: [48376.608551] ? __fget_files+0x86/0xc0 Aug 22 18:50:02 juju-e4d256-prod-github-runner-207 kernel: [48376.609264] __x64_sys_ioctl+0x95/0xd0 Aug 22 18:50:02 juju-e4d256-prod-github-runner-207 kernel: [48376.609984] do_syscall_64+0x5c/0xc0 Aug 22 18:50:02 juju-e4d256-prod-github-runner-207 kernel: [48376.610661] ? do_futex+0x162/0x1f0 Aug 22 18:50:02 juju-e4d256-prod-github-runner-207 kernel: [48376.611318] ? __x64_sys_futex+0x78/0x1e0 Aug 22 18:50:02 juju-e4d256-prod-github-runner-207 kernel: [48376.611999] ? __secure_computing+0xa9/0x120 Aug 22 18:50:02 juju-e4d256-prod-github-runner-207 kernel: [48376.612706] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 18:50:02 juju-e4d256-prod-github-runner-207 kernel: [48376.613630] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:50:02 juju-e4d256-prod-github-runner-207 kernel: [48376.614392] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:50:02 juju-e4d256-prod-github-runner-207 kernel: [48376.615126] ? do_syscall_64+0x69/0xc0 Aug 22 18:50:02 juju-e4d256-prod-github-runner-207 kernel: [48376.615774] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:50:02 juju-e4d256-prod-github-runner-207 kernel: [48376.616476] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:50:02 juju-e4d256-prod-github-runner-207 kernel: [48376.617171] ? do_syscall_64+0x69/0xc0 Aug 22 18:50:02 juju-e4d256-prod-github-runner-207 kernel: [48376.617817] ? do_syscall_64+0x69/0xc0 Aug 22 18:50:02 juju-e4d256-prod-github-runner-207 kernel: [48376.618440] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 18:50:02 juju-e4d256-prod-github-runner-207 kernel: [48376.619147] RIP: 0033:0x7faa5d0edaff Aug 22 18:50:02 juju-e4d256-prod-github-runner-207 kernel: [48376.619875] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 18:50:02 juju-e4d256-prod-github-runner-207 kernel: [48376.621948] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 18:50:02 juju-e4d256-prod-github-runner-207 kernel: [48376.622884] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 18:50:02 juju-e4d256-prod-github-runner-207 kernel: [48376.623803] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 18:50:02 juju-e4d256-prod-github-runner-207 kernel: [48376.624712] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 18:50:02 juju-e4d256-prod-github-runner-207 kernel: [48376.625608] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 18:50:02 juju-e4d256-prod-github-runner-207 kernel: [48376.626522] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 18:50:02 juju-e4d256-prod-github-runner-207 kernel: [48376.627422] Aug 22 18:50:30 juju-e4d256-prod-github-runner-207 kernel: [48404.541981] watchdog: BUG: soft lockup - CPU#1 stuck for 44972s! [qemu-system-x86:6715] Aug 22 18:50:30 juju-e4d256-prod-github-runner-207 kernel: [48404.543872] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 18:50:30 juju-e4d256-prod-github-runner-207 kernel: [48404.544170] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 18:50:30 juju-e4d256-prod-github-runner-207 kernel: [48404.556722] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 18:50:30 juju-e4d256-prod-github-runner-207 kernel: [48404.558046] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 18:50:30 juju-e4d256-prod-github-runner-207 kernel: [48404.559299] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:50:30 juju-e4d256-prod-github-runner-207 kernel: [48404.560403] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 18:50:30 juju-e4d256-prod-github-runner-207 kernel: [48404.563059] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 18:50:30 juju-e4d256-prod-github-runner-207 kernel: [48404.564118] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 18:50:30 juju-e4d256-prod-github-runner-207 kernel: [48404.565312] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 18:50:30 juju-e4d256-prod-github-runner-207 kernel: [48404.566533] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 18:50:30 juju-e4d256-prod-github-runner-207 kernel: [48404.567744] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 18:50:30 juju-e4d256-prod-github-runner-207 kernel: [48404.568973] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 18:50:30 juju-e4d256-prod-github-runner-207 kernel: [48404.570219] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 18:50:30 juju-e4d256-prod-github-runner-207 kernel: [48404.571557] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 18:50:30 juju-e4d256-prod-github-runner-207 kernel: [48404.572692] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 18:50:30 juju-e4d256-prod-github-runner-207 kernel: [48404.574026] Call Trace: Aug 22 18:50:30 juju-e4d256-prod-github-runner-207 kernel: [48404.574963] Aug 22 18:50:30 juju-e4d256-prod-github-runner-207 kernel: [48404.575886] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:50:30 juju-e4d256-prod-github-runner-207 kernel: [48404.576955] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:50:30 juju-e4d256-prod-github-runner-207 kernel: [48404.578025] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:50:30 juju-e4d256-prod-github-runner-207 kernel: [48404.579144] ? show_regs.part.0+0x23/0x29 Aug 22 18:50:30 juju-e4d256-prod-github-runner-207 kernel: [48404.580193] ? show_regs.cold+0x8/0xd Aug 22 18:50:30 juju-e4d256-prod-github-runner-207 kernel: [48404.581178] ? watchdog_timer_fn+0x1be/0x220 Aug 22 18:50:30 juju-e4d256-prod-github-runner-207 kernel: [48404.582216] ? lockup_detector_update_enable+0x60/0x60 Aug 22 18:50:30 juju-e4d256-prod-github-runner-207 kernel: [48404.583309] ? __hrtimer_run_queues+0x107/0x230 Aug 22 18:50:30 juju-e4d256-prod-github-runner-207 kernel: [48404.584364] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 18:50:30 juju-e4d256-prod-github-runner-207 kernel: [48404.585411] ? hrtimer_interrupt+0x101/0x220 Aug 22 18:50:30 juju-e4d256-prod-github-runner-207 kernel: [48404.586462] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 18:50:30 juju-e4d256-prod-github-runner-207 kernel: [48404.587616] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 18:50:30 juju-e4d256-prod-github-runner-207 kernel: [48404.588694] Aug 22 18:50:30 juju-e4d256-prod-github-runner-207 kernel: [48404.589586] Aug 22 18:50:30 juju-e4d256-prod-github-runner-207 kernel: [48404.590438] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 18:50:30 juju-e4d256-prod-github-runner-207 kernel: [48404.591499] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:50:30 juju-e4d256-prod-github-runner-207 kernel: [48404.592608] ? _raw_spin_lock+0x22/0x30 Aug 22 18:50:30 juju-e4d256-prod-github-runner-207 kernel: [48404.593612] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:50:30 juju-e4d256-prod-github-runner-207 kernel: [48404.594666] direct_page_fault+0x206/0x310 [kvm] Aug 22 18:50:30 juju-e4d256-prod-github-runner-207 kernel: [48404.595745] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 18:50:30 juju-e4d256-prod-github-runner-207 kernel: [48404.596798] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 18:50:30 juju-e4d256-prod-github-runner-207 kernel: [48404.597871] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 18:50:30 juju-e4d256-prod-github-runner-207 kernel: [48404.598913] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 18:50:30 juju-e4d256-prod-github-runner-207 kernel: [48404.599911] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 18:50:30 juju-e4d256-prod-github-runner-207 kernel: [48404.600988] handle_exit+0x98/0x230 [kvm_amd] Aug 22 18:50:30 juju-e4d256-prod-github-runner-207 kernel: [48404.601928] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 18:50:30 juju-e4d256-prod-github-runner-207 kernel: [48404.602871] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 18:50:30 juju-e4d256-prod-github-runner-207 kernel: [48404.603823] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 18:50:30 juju-e4d256-prod-github-runner-207 kernel: [48404.604744] vcpu_run+0x62/0x2c0 [kvm] Aug 22 18:50:30 juju-e4d256-prod-github-runner-207 kernel: [48404.605587] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 18:50:30 juju-e4d256-prod-github-runner-207 kernel: [48404.606422] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 18:50:30 juju-e4d256-prod-github-runner-207 kernel: [48404.607299] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 18:50:30 juju-e4d256-prod-github-runner-207 kernel: [48404.608120] ? __seccomp_filter+0x4a/0x4a0 Aug 22 18:50:30 juju-e4d256-prod-github-runner-207 kernel: [48404.608881] ? __fget_files+0x86/0xc0 Aug 22 18:50:30 juju-e4d256-prod-github-runner-207 kernel: [48404.609619] __x64_sys_ioctl+0x95/0xd0 Aug 22 18:50:30 juju-e4d256-prod-github-runner-207 kernel: [48404.610349] do_syscall_64+0x5c/0xc0 Aug 22 18:50:30 juju-e4d256-prod-github-runner-207 kernel: [48404.611044] ? do_futex+0x162/0x1f0 Aug 22 18:50:30 juju-e4d256-prod-github-runner-207 kernel: [48404.611763] ? __x64_sys_futex+0x78/0x1e0 Aug 22 18:50:30 juju-e4d256-prod-github-runner-207 kernel: [48404.612453] ? __secure_computing+0xa9/0x120 Aug 22 18:50:30 juju-e4d256-prod-github-runner-207 kernel: [48404.613219] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 18:50:30 juju-e4d256-prod-github-runner-207 kernel: [48404.614058] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:50:30 juju-e4d256-prod-github-runner-207 kernel: [48404.614810] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:50:30 juju-e4d256-prod-github-runner-207 kernel: [48404.615578] ? do_syscall_64+0x69/0xc0 Aug 22 18:50:30 juju-e4d256-prod-github-runner-207 kernel: [48404.616248] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:50:30 juju-e4d256-prod-github-runner-207 kernel: [48404.616991] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:50:30 juju-e4d256-prod-github-runner-207 kernel: [48404.617739] ? do_syscall_64+0x69/0xc0 Aug 22 18:50:30 juju-e4d256-prod-github-runner-207 kernel: [48404.618398] ? do_syscall_64+0x69/0xc0 Aug 22 18:50:30 juju-e4d256-prod-github-runner-207 kernel: [48404.619042] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 18:50:30 juju-e4d256-prod-github-runner-207 kernel: [48404.619779] RIP: 0033:0x7faa5d0edaff Aug 22 18:50:30 juju-e4d256-prod-github-runner-207 kernel: [48404.620877] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 18:50:30 juju-e4d256-prod-github-runner-207 kernel: [48404.623139] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 18:50:30 juju-e4d256-prod-github-runner-207 kernel: [48404.624084] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 18:50:30 juju-e4d256-prod-github-runner-207 kernel: [48404.625002] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 18:50:30 juju-e4d256-prod-github-runner-207 kernel: [48404.625967] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 18:50:30 juju-e4d256-prod-github-runner-207 kernel: [48404.626920] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 18:50:30 juju-e4d256-prod-github-runner-207 kernel: [48404.627866] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 18:50:30 juju-e4d256-prod-github-runner-207 kernel: [48404.628803] Aug 22 18:50:46 juju-e4d256-prod-github-runner-207 kernel: [48420.416711] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 18:50:46 juju-e4d256-prod-github-runner-207 kernel: [48420.419157] rcu: 1-....: (12037834 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=5821757 Aug 22 18:50:46 juju-e4d256-prod-github-runner-207 kernel: [48420.420315] (t=12075804 jiffies g=23269 q=46543) Aug 22 18:50:46 juju-e4d256-prod-github-runner-207 kernel: [48420.421113] NMI backtrace for cpu 1 Aug 22 18:50:46 juju-e4d256-prod-github-runner-207 kernel: [48420.421881] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 18:50:46 juju-e4d256-prod-github-runner-207 kernel: [48420.423020] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 18:50:46 juju-e4d256-prod-github-runner-207 kernel: [48420.424095] Call Trace: Aug 22 18:50:46 juju-e4d256-prod-github-runner-207 kernel: [48420.424771] Aug 22 18:50:46 juju-e4d256-prod-github-runner-207 kernel: [48420.425506] show_stack+0x52/0x5c Aug 22 18:50:46 juju-e4d256-prod-github-runner-207 kernel: [48420.426296] dump_stack_lvl+0x4a/0x63 Aug 22 18:50:46 juju-e4d256-prod-github-runner-207 kernel: [48420.427057] dump_stack+0x10/0x16 Aug 22 18:50:46 juju-e4d256-prod-github-runner-207 kernel: [48420.427837] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 18:50:46 juju-e4d256-prod-github-runner-207 kernel: [48420.428683] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 18:50:46 juju-e4d256-prod-github-runner-207 kernel: [48420.429489] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 18:50:46 juju-e4d256-prod-github-runner-207 kernel: [48420.430359] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 18:50:46 juju-e4d256-prod-github-runner-207 kernel: [48420.431185] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 18:50:46 juju-e4d256-prod-github-runner-207 kernel: [48420.431991] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 18:50:46 juju-e4d256-prod-github-runner-207 kernel: [48420.432765] print_cpu_stall.cold+0x2f/0xe2 Aug 22 18:50:46 juju-e4d256-prod-github-runner-207 kernel: [48420.433548] ? timekeeping_update+0xf7/0x150 Aug 22 18:50:46 juju-e4d256-prod-github-runner-207 kernel: [48420.434317] check_cpu_stall+0x109/0x270 Aug 22 18:50:46 juju-e4d256-prod-github-runner-207 kernel: [48420.435123] rcu_sched_clock_irq+0x9a/0x250 Aug 22 18:50:46 juju-e4d256-prod-github-runner-207 kernel: [48420.435895] update_process_times+0x94/0xd0 Aug 22 18:50:46 juju-e4d256-prod-github-runner-207 kernel: [48420.436740] tick_sched_handle+0x29/0x70 Aug 22 18:50:46 juju-e4d256-prod-github-runner-207 kernel: [48420.437534] tick_sched_timer+0x8c/0xc0 Aug 22 18:50:46 juju-e4d256-prod-github-runner-207 kernel: [48420.438349] ? tick_nohz_handler+0xb0/0xb0 Aug 22 18:50:46 juju-e4d256-prod-github-runner-207 kernel: [48420.439108] __hrtimer_run_queues+0x107/0x230 Aug 22 18:50:46 juju-e4d256-prod-github-runner-207 kernel: [48420.440005] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 18:50:46 juju-e4d256-prod-github-runner-207 kernel: [48420.440799] hrtimer_interrupt+0x101/0x220 Aug 22 18:50:46 juju-e4d256-prod-github-runner-207 kernel: [48420.441659] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 18:50:46 juju-e4d256-prod-github-runner-207 kernel: [48420.442492] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 18:50:46 juju-e4d256-prod-github-runner-207 kernel: [48420.443306] Aug 22 18:50:46 juju-e4d256-prod-github-runner-207 kernel: [48420.443958] Aug 22 18:50:46 juju-e4d256-prod-github-runner-207 kernel: [48420.444593] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 18:50:46 juju-e4d256-prod-github-runner-207 kernel: [48420.445437] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:50:46 juju-e4d256-prod-github-runner-207 kernel: [48420.446321] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 18:50:46 juju-e4d256-prod-github-runner-207 kernel: [48420.448626] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 18:50:46 juju-e4d256-prod-github-runner-207 kernel: [48420.449596] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 18:50:46 juju-e4d256-prod-github-runner-207 kernel: [48420.450602] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 18:50:46 juju-e4d256-prod-github-runner-207 kernel: [48420.451643] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 18:50:46 juju-e4d256-prod-github-runner-207 kernel: [48420.452681] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 18:50:46 juju-e4d256-prod-github-runner-207 kernel: [48420.453680] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 18:50:46 juju-e4d256-prod-github-runner-207 kernel: [48420.454700] ? _raw_spin_lock+0x22/0x30 Aug 22 18:50:46 juju-e4d256-prod-github-runner-207 kernel: [48420.455508] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:50:46 juju-e4d256-prod-github-runner-207 kernel: [48420.456369] direct_page_fault+0x206/0x310 [kvm] Aug 22 18:50:46 juju-e4d256-prod-github-runner-207 kernel: [48420.457232] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 18:50:46 juju-e4d256-prod-github-runner-207 kernel: [48420.458107] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 18:50:46 juju-e4d256-prod-github-runner-207 kernel: [48420.458962] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 18:50:46 juju-e4d256-prod-github-runner-207 kernel: [48420.459820] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 18:50:46 juju-e4d256-prod-github-runner-207 kernel: [48420.460616] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 18:50:46 juju-e4d256-prod-github-runner-207 kernel: [48420.461513] handle_exit+0x98/0x230 [kvm_amd] Aug 22 18:50:46 juju-e4d256-prod-github-runner-207 kernel: [48420.462270] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 18:50:46 juju-e4d256-prod-github-runner-207 kernel: [48420.463081] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 18:50:46 juju-e4d256-prod-github-runner-207 kernel: [48420.463900] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 18:50:46 juju-e4d256-prod-github-runner-207 kernel: [48420.464701] vcpu_run+0x62/0x2c0 [kvm] Aug 22 18:50:46 juju-e4d256-prod-github-runner-207 kernel: [48420.465500] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 18:50:46 juju-e4d256-prod-github-runner-207 kernel: [48420.466298] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 18:50:46 juju-e4d256-prod-github-runner-207 kernel: [48420.467145] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 18:50:46 juju-e4d256-prod-github-runner-207 kernel: [48420.467917] ? __seccomp_filter+0x4a/0x4a0 Aug 22 18:50:46 juju-e4d256-prod-github-runner-207 kernel: [48420.468674] ? __fget_files+0x86/0xc0 Aug 22 18:50:46 juju-e4d256-prod-github-runner-207 kernel: [48420.469403] __x64_sys_ioctl+0x95/0xd0 Aug 22 18:50:46 juju-e4d256-prod-github-runner-207 kernel: [48420.470133] do_syscall_64+0x5c/0xc0 Aug 22 18:50:46 juju-e4d256-prod-github-runner-207 kernel: [48420.470820] ? do_futex+0x162/0x1f0 Aug 22 18:50:46 juju-e4d256-prod-github-runner-207 kernel: [48420.471514] ? __x64_sys_futex+0x78/0x1e0 Aug 22 18:50:46 juju-e4d256-prod-github-runner-207 kernel: [48420.472221] ? __secure_computing+0xa9/0x120 Aug 22 18:50:46 juju-e4d256-prod-github-runner-207 kernel: [48420.472979] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 18:50:46 juju-e4d256-prod-github-runner-207 kernel: [48420.473829] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:50:46 juju-e4d256-prod-github-runner-207 kernel: [48420.474617] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:50:46 juju-e4d256-prod-github-runner-207 kernel: [48420.475395] ? do_syscall_64+0x69/0xc0 Aug 22 18:50:46 juju-e4d256-prod-github-runner-207 kernel: [48420.476108] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:50:46 juju-e4d256-prod-github-runner-207 kernel: [48420.476889] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:50:46 juju-e4d256-prod-github-runner-207 kernel: [48420.477691] ? do_syscall_64+0x69/0xc0 Aug 22 18:50:46 juju-e4d256-prod-github-runner-207 kernel: [48420.478412] ? do_syscall_64+0x69/0xc0 Aug 22 18:50:46 juju-e4d256-prod-github-runner-207 kernel: [48420.479131] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 18:50:46 juju-e4d256-prod-github-runner-207 kernel: [48420.479925] RIP: 0033:0x7faa5d0edaff Aug 22 18:50:46 juju-e4d256-prod-github-runner-207 kernel: [48420.480662] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 18:50:46 juju-e4d256-prod-github-runner-207 kernel: [48420.482850] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 18:50:46 juju-e4d256-prod-github-runner-207 kernel: [48420.483836] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 18:50:46 juju-e4d256-prod-github-runner-207 kernel: [48420.484803] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 18:50:46 juju-e4d256-prod-github-runner-207 kernel: [48420.485784] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 18:50:46 juju-e4d256-prod-github-runner-207 kernel: [48420.486734] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 18:50:46 juju-e4d256-prod-github-runner-207 kernel: [48420.487698] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 18:50:46 juju-e4d256-prod-github-runner-207 kernel: [48420.488644] Aug 22 18:51:10 juju-e4d256-prod-github-runner-207 kernel: [48444.541983] watchdog: BUG: soft lockup - CPU#1 stuck for 45009s! [qemu-system-x86:6715] Aug 22 18:51:10 juju-e4d256-prod-github-runner-207 kernel: [48444.544024] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 18:51:10 juju-e4d256-prod-github-runner-207 kernel: [48444.544365] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 18:51:10 juju-e4d256-prod-github-runner-207 kernel: [48444.558783] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 18:51:10 juju-e4d256-prod-github-runner-207 kernel: [48444.560214] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 18:51:10 juju-e4d256-prod-github-runner-207 kernel: [48444.561592] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:51:10 juju-e4d256-prod-github-runner-207 kernel: [48444.562745] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 18:51:10 juju-e4d256-prod-github-runner-207 kernel: [48444.565533] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 18:51:10 juju-e4d256-prod-github-runner-207 kernel: [48444.566671] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 18:51:10 juju-e4d256-prod-github-runner-207 kernel: [48444.567928] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 18:51:10 juju-e4d256-prod-github-runner-207 kernel: [48444.569207] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 18:51:10 juju-e4d256-prod-github-runner-207 kernel: [48444.570457] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 18:51:10 juju-e4d256-prod-github-runner-207 kernel: [48444.571676] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 18:51:10 juju-e4d256-prod-github-runner-207 kernel: [48444.572922] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 18:51:10 juju-e4d256-prod-github-runner-207 kernel: [48444.574240] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 18:51:10 juju-e4d256-prod-github-runner-207 kernel: [48444.575408] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 18:51:10 juju-e4d256-prod-github-runner-207 kernel: [48444.576656] Call Trace: Aug 22 18:51:10 juju-e4d256-prod-github-runner-207 kernel: [48444.577613] Aug 22 18:51:10 juju-e4d256-prod-github-runner-207 kernel: [48444.578538] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:51:10 juju-e4d256-prod-github-runner-207 kernel: [48444.579633] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:51:10 juju-e4d256-prod-github-runner-207 kernel: [48444.580766] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:51:10 juju-e4d256-prod-github-runner-207 kernel: [48444.582003] ? show_regs.part.0+0x23/0x29 Aug 22 18:51:10 juju-e4d256-prod-github-runner-207 kernel: [48444.583102] ? show_regs.cold+0x8/0xd Aug 22 18:51:10 juju-e4d256-prod-github-runner-207 kernel: [48444.584144] ? watchdog_timer_fn+0x1be/0x220 Aug 22 18:51:10 juju-e4d256-prod-github-runner-207 kernel: [48444.585258] ? lockup_detector_update_enable+0x60/0x60 Aug 22 18:51:10 juju-e4d256-prod-github-runner-207 kernel: [48444.586389] ? __hrtimer_run_queues+0x107/0x230 Aug 22 18:51:10 juju-e4d256-prod-github-runner-207 kernel: [48444.587479] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 18:51:10 juju-e4d256-prod-github-runner-207 kernel: [48444.588567] ? hrtimer_interrupt+0x101/0x220 Aug 22 18:51:10 juju-e4d256-prod-github-runner-207 kernel: [48444.589741] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 18:51:10 juju-e4d256-prod-github-runner-207 kernel: [48444.590879] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 18:51:10 juju-e4d256-prod-github-runner-207 kernel: [48444.591985] Aug 22 18:51:10 juju-e4d256-prod-github-runner-207 kernel: [48444.592880] Aug 22 18:51:10 juju-e4d256-prod-github-runner-207 kernel: [48444.593801] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 18:51:10 juju-e4d256-prod-github-runner-207 kernel: [48444.594952] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:51:10 juju-e4d256-prod-github-runner-207 kernel: [48444.596128] ? _raw_spin_lock+0x22/0x30 Aug 22 18:51:10 juju-e4d256-prod-github-runner-207 kernel: [48444.597165] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:51:10 juju-e4d256-prod-github-runner-207 kernel: [48444.598242] direct_page_fault+0x206/0x310 [kvm] Aug 22 18:51:10 juju-e4d256-prod-github-runner-207 kernel: [48444.599348] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 18:51:10 juju-e4d256-prod-github-runner-207 kernel: [48444.600456] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 18:51:10 juju-e4d256-prod-github-runner-207 kernel: [48444.601562] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 18:51:10 juju-e4d256-prod-github-runner-207 kernel: [48444.602709] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 18:51:10 juju-e4d256-prod-github-runner-207 kernel: [48444.603712] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 18:51:10 juju-e4d256-prod-github-runner-207 kernel: [48444.604738] handle_exit+0x98/0x230 [kvm_amd] Aug 22 18:51:10 juju-e4d256-prod-github-runner-207 kernel: [48444.605692] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 18:51:10 juju-e4d256-prod-github-runner-207 kernel: [48444.606689] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 18:51:10 juju-e4d256-prod-github-runner-207 kernel: [48444.607676] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 18:51:10 juju-e4d256-prod-github-runner-207 kernel: [48444.608669] vcpu_run+0x62/0x2c0 [kvm] Aug 22 18:51:10 juju-e4d256-prod-github-runner-207 kernel: [48444.609530] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 18:51:10 juju-e4d256-prod-github-runner-207 kernel: [48444.610361] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 18:51:10 juju-e4d256-prod-github-runner-207 kernel: [48444.611259] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 18:51:10 juju-e4d256-prod-github-runner-207 kernel: [48444.612075] ? __seccomp_filter+0x4a/0x4a0 Aug 22 18:51:10 juju-e4d256-prod-github-runner-207 kernel: [48444.612837] ? __fget_files+0x86/0xc0 Aug 22 18:51:10 juju-e4d256-prod-github-runner-207 kernel: [48444.613572] __x64_sys_ioctl+0x95/0xd0 Aug 22 18:51:10 juju-e4d256-prod-github-runner-207 kernel: [48444.614287] do_syscall_64+0x5c/0xc0 Aug 22 18:51:10 juju-e4d256-prod-github-runner-207 kernel: [48444.614978] ? do_futex+0x162/0x1f0 Aug 22 18:51:10 juju-e4d256-prod-github-runner-207 kernel: [48444.615643] ? __x64_sys_futex+0x78/0x1e0 Aug 22 18:51:10 juju-e4d256-prod-github-runner-207 kernel: [48444.616334] ? __secure_computing+0xa9/0x120 Aug 22 18:51:10 juju-e4d256-prod-github-runner-207 kernel: [48444.617089] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 18:51:10 juju-e4d256-prod-github-runner-207 kernel: [48444.617903] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:51:10 juju-e4d256-prod-github-runner-207 kernel: [48444.618799] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:51:10 juju-e4d256-prod-github-runner-207 kernel: [48444.619626] ? do_syscall_64+0x69/0xc0 Aug 22 18:51:10 juju-e4d256-prod-github-runner-207 kernel: [48444.620305] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:51:10 juju-e4d256-prod-github-runner-207 kernel: [48444.621072] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:51:10 juju-e4d256-prod-github-runner-207 kernel: [48444.621791] ? do_syscall_64+0x69/0xc0 Aug 22 18:51:10 juju-e4d256-prod-github-runner-207 kernel: [48444.622434] ? do_syscall_64+0x69/0xc0 Aug 22 18:51:10 juju-e4d256-prod-github-runner-207 kernel: [48444.623090] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 18:51:10 juju-e4d256-prod-github-runner-207 kernel: [48444.623819] RIP: 0033:0x7faa5d0edaff Aug 22 18:51:10 juju-e4d256-prod-github-runner-207 kernel: [48444.624502] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 18:51:10 juju-e4d256-prod-github-runner-207 kernel: [48444.626611] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 18:51:10 juju-e4d256-prod-github-runner-207 kernel: [48444.627581] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 18:51:10 juju-e4d256-prod-github-runner-207 kernel: [48444.628516] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 18:51:10 juju-e4d256-prod-github-runner-207 kernel: [48444.629536] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 18:51:10 juju-e4d256-prod-github-runner-207 kernel: [48444.630505] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 18:51:10 juju-e4d256-prod-github-runner-207 kernel: [48444.631420] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 18:51:10 juju-e4d256-prod-github-runner-207 kernel: [48444.632502] Aug 22 18:51:38 juju-e4d256-prod-github-runner-207 kernel: [48472.541981] watchdog: BUG: soft lockup - CPU#1 stuck for 45035s! [qemu-system-x86:6715] Aug 22 18:51:38 juju-e4d256-prod-github-runner-207 kernel: [48472.543834] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 18:51:38 juju-e4d256-prod-github-runner-207 kernel: [48472.544128] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 18:51:38 juju-e4d256-prod-github-runner-207 kernel: [48472.556859] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 18:51:38 juju-e4d256-prod-github-runner-207 kernel: [48472.558191] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 18:51:38 juju-e4d256-prod-github-runner-207 kernel: [48472.559446] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:51:38 juju-e4d256-prod-github-runner-207 kernel: [48472.560559] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 18:51:38 juju-e4d256-prod-github-runner-207 kernel: [48472.563299] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 18:51:38 juju-e4d256-prod-github-runner-207 kernel: [48472.564373] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 18:51:38 juju-e4d256-prod-github-runner-207 kernel: [48472.565576] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 18:51:38 juju-e4d256-prod-github-runner-207 kernel: [48472.566810] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 18:51:38 juju-e4d256-prod-github-runner-207 kernel: [48472.568026] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 18:51:38 juju-e4d256-prod-github-runner-207 kernel: [48472.569251] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 18:51:38 juju-e4d256-prod-github-runner-207 kernel: [48472.570466] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 18:51:38 juju-e4d256-prod-github-runner-207 kernel: [48472.571769] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 18:51:38 juju-e4d256-prod-github-runner-207 kernel: [48472.572988] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 18:51:38 juju-e4d256-prod-github-runner-207 kernel: [48472.574215] Call Trace: Aug 22 18:51:38 juju-e4d256-prod-github-runner-207 kernel: [48472.575146] Aug 22 18:51:38 juju-e4d256-prod-github-runner-207 kernel: [48472.576076] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:51:38 juju-e4d256-prod-github-runner-207 kernel: [48472.577164] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:51:38 juju-e4d256-prod-github-runner-207 kernel: [48472.578209] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:51:38 juju-e4d256-prod-github-runner-207 kernel: [48472.579335] ? show_regs.part.0+0x23/0x29 Aug 22 18:51:38 juju-e4d256-prod-github-runner-207 kernel: [48472.580351] ? show_regs.cold+0x8/0xd Aug 22 18:51:38 juju-e4d256-prod-github-runner-207 kernel: [48472.581361] ? watchdog_timer_fn+0x1be/0x220 Aug 22 18:51:38 juju-e4d256-prod-github-runner-207 kernel: [48472.582424] ? lockup_detector_update_enable+0x60/0x60 Aug 22 18:51:38 juju-e4d256-prod-github-runner-207 kernel: [48472.583534] ? __hrtimer_run_queues+0x107/0x230 Aug 22 18:51:38 juju-e4d256-prod-github-runner-207 kernel: [48472.584623] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 18:51:38 juju-e4d256-prod-github-runner-207 kernel: [48472.585674] ? hrtimer_interrupt+0x101/0x220 Aug 22 18:51:38 juju-e4d256-prod-github-runner-207 kernel: [48472.586731] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 18:51:38 juju-e4d256-prod-github-runner-207 kernel: [48472.587841] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 18:51:38 juju-e4d256-prod-github-runner-207 kernel: [48472.588934] Aug 22 18:51:38 juju-e4d256-prod-github-runner-207 kernel: [48472.589803] Aug 22 18:51:38 juju-e4d256-prod-github-runner-207 kernel: [48472.590661] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 18:51:38 juju-e4d256-prod-github-runner-207 kernel: [48472.591739] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:51:38 juju-e4d256-prod-github-runner-207 kernel: [48472.592864] ? _raw_spin_lock+0x22/0x30 Aug 22 18:51:38 juju-e4d256-prod-github-runner-207 kernel: [48472.593834] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:51:38 juju-e4d256-prod-github-runner-207 kernel: [48472.594872] direct_page_fault+0x206/0x310 [kvm] Aug 22 18:51:38 juju-e4d256-prod-github-runner-207 kernel: [48472.595914] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 18:51:38 juju-e4d256-prod-github-runner-207 kernel: [48472.596960] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 18:51:38 juju-e4d256-prod-github-runner-207 kernel: [48472.597990] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 18:51:38 juju-e4d256-prod-github-runner-207 kernel: [48472.599021] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 18:51:38 juju-e4d256-prod-github-runner-207 kernel: [48472.599983] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 18:51:38 juju-e4d256-prod-github-runner-207 kernel: [48472.600991] handle_exit+0x98/0x230 [kvm_amd] Aug 22 18:51:38 juju-e4d256-prod-github-runner-207 kernel: [48472.601916] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 18:51:38 juju-e4d256-prod-github-runner-207 kernel: [48472.602995] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 18:51:38 juju-e4d256-prod-github-runner-207 kernel: [48472.603973] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 18:51:38 juju-e4d256-prod-github-runner-207 kernel: [48472.604945] vcpu_run+0x62/0x2c0 [kvm] Aug 22 18:51:38 juju-e4d256-prod-github-runner-207 kernel: [48472.605838] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 18:51:38 juju-e4d256-prod-github-runner-207 kernel: [48472.606675] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 18:51:38 juju-e4d256-prod-github-runner-207 kernel: [48472.607583] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 18:51:38 juju-e4d256-prod-github-runner-207 kernel: [48472.608422] ? __seccomp_filter+0x4a/0x4a0 Aug 22 18:51:38 juju-e4d256-prod-github-runner-207 kernel: [48472.609278] ? __fget_files+0x86/0xc0 Aug 22 18:51:38 juju-e4d256-prod-github-runner-207 kernel: [48472.610002] __x64_sys_ioctl+0x95/0xd0 Aug 22 18:51:38 juju-e4d256-prod-github-runner-207 kernel: [48472.610714] do_syscall_64+0x5c/0xc0 Aug 22 18:51:38 juju-e4d256-prod-github-runner-207 kernel: [48472.611402] ? do_futex+0x162/0x1f0 Aug 22 18:51:38 juju-e4d256-prod-github-runner-207 kernel: [48472.612069] ? __x64_sys_futex+0x78/0x1e0 Aug 22 18:51:38 juju-e4d256-prod-github-runner-207 kernel: [48472.612784] ? __secure_computing+0xa9/0x120 Aug 22 18:51:38 juju-e4d256-prod-github-runner-207 kernel: [48472.613543] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 18:51:38 juju-e4d256-prod-github-runner-207 kernel: [48472.614334] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:51:38 juju-e4d256-prod-github-runner-207 kernel: [48472.615077] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:51:38 juju-e4d256-prod-github-runner-207 kernel: [48472.616056] ? do_syscall_64+0x69/0xc0 Aug 22 18:51:38 juju-e4d256-prod-github-runner-207 kernel: [48472.616728] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:51:38 juju-e4d256-prod-github-runner-207 kernel: [48472.617466] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:51:38 juju-e4d256-prod-github-runner-207 kernel: [48472.618185] ? do_syscall_64+0x69/0xc0 Aug 22 18:51:38 juju-e4d256-prod-github-runner-207 kernel: [48472.618835] ? do_syscall_64+0x69/0xc0 Aug 22 18:51:38 juju-e4d256-prod-github-runner-207 kernel: [48472.619471] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 18:51:38 juju-e4d256-prod-github-runner-207 kernel: [48472.620195] RIP: 0033:0x7faa5d0edaff Aug 22 18:51:38 juju-e4d256-prod-github-runner-207 kernel: [48472.620894] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 18:51:38 juju-e4d256-prod-github-runner-207 kernel: [48472.622941] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 18:51:38 juju-e4d256-prod-github-runner-207 kernel: [48472.623916] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 18:51:38 juju-e4d256-prod-github-runner-207 kernel: [48472.624874] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 18:51:38 juju-e4d256-prod-github-runner-207 kernel: [48472.625789] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 18:51:38 juju-e4d256-prod-github-runner-207 kernel: [48472.626702] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 18:51:38 juju-e4d256-prod-github-runner-207 kernel: [48472.627614] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 18:51:38 juju-e4d256-prod-github-runner-207 kernel: [48472.628531] Aug 22 18:52:06 juju-e4d256-prod-github-runner-207 kernel: [48500.541981] watchdog: BUG: soft lockup - CPU#1 stuck for 45061s! [qemu-system-x86:6715] Aug 22 18:52:06 juju-e4d256-prod-github-runner-207 kernel: [48500.543090] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 18:52:06 juju-e4d256-prod-github-runner-207 kernel: [48500.543162] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 18:52:06 juju-e4d256-prod-github-runner-207 kernel: [48500.555849] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 18:52:06 juju-e4d256-prod-github-runner-207 kernel: [48500.557242] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 18:52:06 juju-e4d256-prod-github-runner-207 kernel: [48500.558504] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:52:06 juju-e4d256-prod-github-runner-207 kernel: [48500.559660] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 18:52:06 juju-e4d256-prod-github-runner-207 kernel: [48500.562305] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 18:52:06 juju-e4d256-prod-github-runner-207 kernel: [48500.563367] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 18:52:06 juju-e4d256-prod-github-runner-207 kernel: [48500.564652] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 18:52:06 juju-e4d256-prod-github-runner-207 kernel: [48500.565840] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 18:52:06 juju-e4d256-prod-github-runner-207 kernel: [48500.567017] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 18:52:06 juju-e4d256-prod-github-runner-207 kernel: [48500.568209] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 18:52:06 juju-e4d256-prod-github-runner-207 kernel: [48500.569445] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 18:52:06 juju-e4d256-prod-github-runner-207 kernel: [48500.570857] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 18:52:06 juju-e4d256-prod-github-runner-207 kernel: [48500.571990] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 18:52:06 juju-e4d256-prod-github-runner-207 kernel: [48500.573240] Call Trace: Aug 22 18:52:06 juju-e4d256-prod-github-runner-207 kernel: [48500.574260] Aug 22 18:52:06 juju-e4d256-prod-github-runner-207 kernel: [48500.575191] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:52:06 juju-e4d256-prod-github-runner-207 kernel: [48500.576304] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:52:06 juju-e4d256-prod-github-runner-207 kernel: [48500.577395] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:52:06 juju-e4d256-prod-github-runner-207 kernel: [48500.578552] ? show_regs.part.0+0x23/0x29 Aug 22 18:52:06 juju-e4d256-prod-github-runner-207 kernel: [48500.579614] ? show_regs.cold+0x8/0xd Aug 22 18:52:06 juju-e4d256-prod-github-runner-207 kernel: [48500.580659] ? watchdog_timer_fn+0x1be/0x220 Aug 22 18:52:06 juju-e4d256-prod-github-runner-207 kernel: [48500.581695] ? lockup_detector_update_enable+0x60/0x60 Aug 22 18:52:06 juju-e4d256-prod-github-runner-207 kernel: [48500.582782] ? __hrtimer_run_queues+0x107/0x230 Aug 22 18:52:06 juju-e4d256-prod-github-runner-207 kernel: [48500.583830] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 18:52:06 juju-e4d256-prod-github-runner-207 kernel: [48500.584899] ? hrtimer_interrupt+0x101/0x220 Aug 22 18:52:06 juju-e4d256-prod-github-runner-207 kernel: [48500.585946] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 18:52:06 juju-e4d256-prod-github-runner-207 kernel: [48500.587039] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 18:52:06 juju-e4d256-prod-github-runner-207 kernel: [48500.588105] Aug 22 18:52:06 juju-e4d256-prod-github-runner-207 kernel: [48500.588983] Aug 22 18:52:06 juju-e4d256-prod-github-runner-207 kernel: [48500.590046] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 18:52:06 juju-e4d256-prod-github-runner-207 kernel: [48500.591151] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:52:06 juju-e4d256-prod-github-runner-207 kernel: [48500.592236] ? _raw_spin_lock+0x22/0x30 Aug 22 18:52:06 juju-e4d256-prod-github-runner-207 kernel: [48500.593244] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:52:06 juju-e4d256-prod-github-runner-207 kernel: [48500.594308] direct_page_fault+0x206/0x310 [kvm] Aug 22 18:52:06 juju-e4d256-prod-github-runner-207 kernel: [48500.595397] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 18:52:06 juju-e4d256-prod-github-runner-207 kernel: [48500.596571] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 18:52:06 juju-e4d256-prod-github-runner-207 kernel: [48500.597628] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 18:52:06 juju-e4d256-prod-github-runner-207 kernel: [48500.598639] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 18:52:06 juju-e4d256-prod-github-runner-207 kernel: [48500.599614] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 18:52:06 juju-e4d256-prod-github-runner-207 kernel: [48500.600669] handle_exit+0x98/0x230 [kvm_amd] Aug 22 18:52:06 juju-e4d256-prod-github-runner-207 kernel: [48500.601639] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 18:52:06 juju-e4d256-prod-github-runner-207 kernel: [48500.602570] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 18:52:06 juju-e4d256-prod-github-runner-207 kernel: [48500.603512] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 18:52:06 juju-e4d256-prod-github-runner-207 kernel: [48500.604478] vcpu_run+0x62/0x2c0 [kvm] Aug 22 18:52:06 juju-e4d256-prod-github-runner-207 kernel: [48500.605336] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 18:52:06 juju-e4d256-prod-github-runner-207 kernel: [48500.606195] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 18:52:06 juju-e4d256-prod-github-runner-207 kernel: [48500.607077] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 18:52:06 juju-e4d256-prod-github-runner-207 kernel: [48500.607894] ? __seccomp_filter+0x4a/0x4a0 Aug 22 18:52:06 juju-e4d256-prod-github-runner-207 kernel: [48500.608709] ? __fget_files+0x86/0xc0 Aug 22 18:52:06 juju-e4d256-prod-github-runner-207 kernel: [48500.609439] __x64_sys_ioctl+0x95/0xd0 Aug 22 18:52:06 juju-e4d256-prod-github-runner-207 kernel: [48500.610160] do_syscall_64+0x5c/0xc0 Aug 22 18:52:06 juju-e4d256-prod-github-runner-207 kernel: [48500.610849] ? do_futex+0x162/0x1f0 Aug 22 18:52:06 juju-e4d256-prod-github-runner-207 kernel: [48500.611527] ? __x64_sys_futex+0x78/0x1e0 Aug 22 18:52:06 juju-e4d256-prod-github-runner-207 kernel: [48500.612215] ? __secure_computing+0xa9/0x120 Aug 22 18:52:06 juju-e4d256-prod-github-runner-207 kernel: [48500.612940] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 18:52:06 juju-e4d256-prod-github-runner-207 kernel: [48500.613714] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:52:06 juju-e4d256-prod-github-runner-207 kernel: [48500.614454] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:52:06 juju-e4d256-prod-github-runner-207 kernel: [48500.615220] ? do_syscall_64+0x69/0xc0 Aug 22 18:52:06 juju-e4d256-prod-github-runner-207 kernel: [48500.615935] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:52:06 juju-e4d256-prod-github-runner-207 kernel: [48500.616706] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:52:06 juju-e4d256-prod-github-runner-207 kernel: [48500.617451] ? do_syscall_64+0x69/0xc0 Aug 22 18:52:06 juju-e4d256-prod-github-runner-207 kernel: [48500.618093] ? do_syscall_64+0x69/0xc0 Aug 22 18:52:06 juju-e4d256-prod-github-runner-207 kernel: [48500.618731] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 18:52:06 juju-e4d256-prod-github-runner-207 kernel: [48500.619463] RIP: 0033:0x7faa5d0edaff Aug 22 18:52:06 juju-e4d256-prod-github-runner-207 kernel: [48500.620146] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 18:52:06 juju-e4d256-prod-github-runner-207 kernel: [48500.622354] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 18:52:06 juju-e4d256-prod-github-runner-207 kernel: [48500.623339] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 18:52:06 juju-e4d256-prod-github-runner-207 kernel: [48500.624323] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 18:52:06 juju-e4d256-prod-github-runner-207 kernel: [48500.625248] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 18:52:06 juju-e4d256-prod-github-runner-207 kernel: [48500.626210] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 18:52:06 juju-e4d256-prod-github-runner-207 kernel: [48500.627196] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 18:52:06 juju-e4d256-prod-github-runner-207 kernel: [48500.628179] Aug 22 18:52:34 juju-e4d256-prod-github-runner-207 kernel: [48528.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 45087s! [qemu-system-x86:6715] Aug 22 18:52:34 juju-e4d256-prod-github-runner-207 kernel: [48528.543815] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 18:52:34 juju-e4d256-prod-github-runner-207 kernel: [48528.544118] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 18:52:34 juju-e4d256-prod-github-runner-207 kernel: [48528.556528] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 18:52:34 juju-e4d256-prod-github-runner-207 kernel: [48528.558007] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 18:52:34 juju-e4d256-prod-github-runner-207 kernel: [48528.559259] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:52:34 juju-e4d256-prod-github-runner-207 kernel: [48528.560369] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 18:52:34 juju-e4d256-prod-github-runner-207 kernel: [48528.562986] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 18:52:34 juju-e4d256-prod-github-runner-207 kernel: [48528.564089] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 18:52:34 juju-e4d256-prod-github-runner-207 kernel: [48528.565311] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 18:52:34 juju-e4d256-prod-github-runner-207 kernel: [48528.566505] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 18:52:34 juju-e4d256-prod-github-runner-207 kernel: [48528.567705] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 18:52:34 juju-e4d256-prod-github-runner-207 kernel: [48528.568936] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 18:52:34 juju-e4d256-prod-github-runner-207 kernel: [48528.570130] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 18:52:34 juju-e4d256-prod-github-runner-207 kernel: [48528.571383] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 18:52:34 juju-e4d256-prod-github-runner-207 kernel: [48528.572513] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 18:52:34 juju-e4d256-prod-github-runner-207 kernel: [48528.573725] Call Trace: Aug 22 18:52:34 juju-e4d256-prod-github-runner-207 kernel: [48528.574644] Aug 22 18:52:34 juju-e4d256-prod-github-runner-207 kernel: [48528.575559] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:52:34 juju-e4d256-prod-github-runner-207 kernel: [48528.576634] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:52:34 juju-e4d256-prod-github-runner-207 kernel: [48528.577668] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:52:34 juju-e4d256-prod-github-runner-207 kernel: [48528.578775] ? show_regs.part.0+0x23/0x29 Aug 22 18:52:34 juju-e4d256-prod-github-runner-207 kernel: [48528.579819] ? show_regs.cold+0x8/0xd Aug 22 18:52:34 juju-e4d256-prod-github-runner-207 kernel: [48528.580846] ? watchdog_timer_fn+0x1be/0x220 Aug 22 18:52:34 juju-e4d256-prod-github-runner-207 kernel: [48528.581869] ? lockup_detector_update_enable+0x60/0x60 Aug 22 18:52:34 juju-e4d256-prod-github-runner-207 kernel: [48528.583053] ? __hrtimer_run_queues+0x107/0x230 Aug 22 18:52:34 juju-e4d256-prod-github-runner-207 kernel: [48528.584202] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 18:52:34 juju-e4d256-prod-github-runner-207 kernel: [48528.585314] ? hrtimer_interrupt+0x101/0x220 Aug 22 18:52:34 juju-e4d256-prod-github-runner-207 kernel: [48528.586344] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 18:52:34 juju-e4d256-prod-github-runner-207 kernel: [48528.587437] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 18:52:34 juju-e4d256-prod-github-runner-207 kernel: [48528.588530] Aug 22 18:52:34 juju-e4d256-prod-github-runner-207 kernel: [48528.589416] Aug 22 18:52:34 juju-e4d256-prod-github-runner-207 kernel: [48528.590267] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 18:52:34 juju-e4d256-prod-github-runner-207 kernel: [48528.591314] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:52:34 juju-e4d256-prod-github-runner-207 kernel: [48528.592373] ? _raw_spin_lock+0x22/0x30 Aug 22 18:52:34 juju-e4d256-prod-github-runner-207 kernel: [48528.593325] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:52:34 juju-e4d256-prod-github-runner-207 kernel: [48528.594371] direct_page_fault+0x206/0x310 [kvm] Aug 22 18:52:34 juju-e4d256-prod-github-runner-207 kernel: [48528.595407] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 18:52:34 juju-e4d256-prod-github-runner-207 kernel: [48528.596451] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 18:52:34 juju-e4d256-prod-github-runner-207 kernel: [48528.597477] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 18:52:34 juju-e4d256-prod-github-runner-207 kernel: [48528.598494] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 18:52:34 juju-e4d256-prod-github-runner-207 kernel: [48528.599452] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 18:52:34 juju-e4d256-prod-github-runner-207 kernel: [48528.600461] handle_exit+0x98/0x230 [kvm_amd] Aug 22 18:52:34 juju-e4d256-prod-github-runner-207 kernel: [48528.601367] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 18:52:34 juju-e4d256-prod-github-runner-207 kernel: [48528.602289] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 18:52:34 juju-e4d256-prod-github-runner-207 kernel: [48528.603230] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 18:52:34 juju-e4d256-prod-github-runner-207 kernel: [48528.604155] vcpu_run+0x62/0x2c0 [kvm] Aug 22 18:52:34 juju-e4d256-prod-github-runner-207 kernel: [48528.604976] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 18:52:34 juju-e4d256-prod-github-runner-207 kernel: [48528.605798] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 18:52:34 juju-e4d256-prod-github-runner-207 kernel: [48528.606683] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 18:52:34 juju-e4d256-prod-github-runner-207 kernel: [48528.607503] ? __seccomp_filter+0x4a/0x4a0 Aug 22 18:52:34 juju-e4d256-prod-github-runner-207 kernel: [48528.608271] ? __fget_files+0x86/0xc0 Aug 22 18:52:34 juju-e4d256-prod-github-runner-207 kernel: [48528.609160] __x64_sys_ioctl+0x95/0xd0 Aug 22 18:52:34 juju-e4d256-prod-github-runner-207 kernel: [48528.609872] do_syscall_64+0x5c/0xc0 Aug 22 18:52:34 juju-e4d256-prod-github-runner-207 kernel: [48528.610544] ? do_futex+0x162/0x1f0 Aug 22 18:52:34 juju-e4d256-prod-github-runner-207 kernel: [48528.611301] ? __x64_sys_futex+0x78/0x1e0 Aug 22 18:52:34 juju-e4d256-prod-github-runner-207 kernel: [48528.612008] ? __secure_computing+0xa9/0x120 Aug 22 18:52:34 juju-e4d256-prod-github-runner-207 kernel: [48528.612706] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 18:52:34 juju-e4d256-prod-github-runner-207 kernel: [48528.613479] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:52:34 juju-e4d256-prod-github-runner-207 kernel: [48528.614214] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:52:34 juju-e4d256-prod-github-runner-207 kernel: [48528.614944] ? do_syscall_64+0x69/0xc0 Aug 22 18:52:34 juju-e4d256-prod-github-runner-207 kernel: [48528.615610] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:52:34 juju-e4d256-prod-github-runner-207 kernel: [48528.616356] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:52:34 juju-e4d256-prod-github-runner-207 kernel: [48528.617069] ? do_syscall_64+0x69/0xc0 Aug 22 18:52:34 juju-e4d256-prod-github-runner-207 kernel: [48528.617705] ? do_syscall_64+0x69/0xc0 Aug 22 18:52:34 juju-e4d256-prod-github-runner-207 kernel: [48528.618338] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 18:52:34 juju-e4d256-prod-github-runner-207 kernel: [48528.619066] RIP: 0033:0x7faa5d0edaff Aug 22 18:52:34 juju-e4d256-prod-github-runner-207 kernel: [48528.619743] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 18:52:34 juju-e4d256-prod-github-runner-207 kernel: [48528.622009] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 18:52:34 juju-e4d256-prod-github-runner-207 kernel: [48528.622940] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 18:52:34 juju-e4d256-prod-github-runner-207 kernel: [48528.623855] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 18:52:34 juju-e4d256-prod-github-runner-207 kernel: [48528.624780] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 18:52:34 juju-e4d256-prod-github-runner-207 kernel: [48528.625689] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 18:52:34 juju-e4d256-prod-github-runner-207 kernel: [48528.626596] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 18:52:34 juju-e4d256-prod-github-runner-207 kernel: [48528.627504] Aug 22 18:53:02 juju-e4d256-prod-github-runner-207 kernel: [48556.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 45113s! [qemu-system-x86:6715] Aug 22 18:53:02 juju-e4d256-prod-github-runner-207 kernel: [48556.543298] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 18:53:02 juju-e4d256-prod-github-runner-207 kernel: [48556.543371] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 18:53:02 juju-e4d256-prod-github-runner-207 kernel: [48556.555839] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 18:53:02 juju-e4d256-prod-github-runner-207 kernel: [48556.557205] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 18:53:02 juju-e4d256-prod-github-runner-207 kernel: [48556.558491] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:53:02 juju-e4d256-prod-github-runner-207 kernel: [48556.559697] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 18:53:02 juju-e4d256-prod-github-runner-207 kernel: [48556.562343] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 18:53:02 juju-e4d256-prod-github-runner-207 kernel: [48556.563442] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 18:53:02 juju-e4d256-prod-github-runner-207 kernel: [48556.564670] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 18:53:02 juju-e4d256-prod-github-runner-207 kernel: [48556.565903] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 18:53:02 juju-e4d256-prod-github-runner-207 kernel: [48556.567096] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 18:53:02 juju-e4d256-prod-github-runner-207 kernel: [48556.568373] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 18:53:02 juju-e4d256-prod-github-runner-207 kernel: [48556.569594] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 18:53:02 juju-e4d256-prod-github-runner-207 kernel: [48556.570873] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 18:53:02 juju-e4d256-prod-github-runner-207 kernel: [48556.572058] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 18:53:02 juju-e4d256-prod-github-runner-207 kernel: [48556.573281] Call Trace: Aug 22 18:53:02 juju-e4d256-prod-github-runner-207 kernel: [48556.574199] Aug 22 18:53:02 juju-e4d256-prod-github-runner-207 kernel: [48556.575094] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:53:02 juju-e4d256-prod-github-runner-207 kernel: [48556.576157] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:53:02 juju-e4d256-prod-github-runner-207 kernel: [48556.577193] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:53:02 juju-e4d256-prod-github-runner-207 kernel: [48556.578289] ? show_regs.part.0+0x23/0x29 Aug 22 18:53:02 juju-e4d256-prod-github-runner-207 kernel: [48556.579294] ? show_regs.cold+0x8/0xd Aug 22 18:53:02 juju-e4d256-prod-github-runner-207 kernel: [48556.580287] ? watchdog_timer_fn+0x1be/0x220 Aug 22 18:53:02 juju-e4d256-prod-github-runner-207 kernel: [48556.581313] ? lockup_detector_update_enable+0x60/0x60 Aug 22 18:53:02 juju-e4d256-prod-github-runner-207 kernel: [48556.582392] ? __hrtimer_run_queues+0x107/0x230 Aug 22 18:53:02 juju-e4d256-prod-github-runner-207 kernel: [48556.583433] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 18:53:02 juju-e4d256-prod-github-runner-207 kernel: [48556.584491] ? hrtimer_interrupt+0x101/0x220 Aug 22 18:53:02 juju-e4d256-prod-github-runner-207 kernel: [48556.585519] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 18:53:02 juju-e4d256-prod-github-runner-207 kernel: [48556.586619] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 18:53:02 juju-e4d256-prod-github-runner-207 kernel: [48556.587743] Aug 22 18:53:02 juju-e4d256-prod-github-runner-207 kernel: [48556.588625] Aug 22 18:53:02 juju-e4d256-prod-github-runner-207 kernel: [48556.589470] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 18:53:02 juju-e4d256-prod-github-runner-207 kernel: [48556.590525] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:53:02 juju-e4d256-prod-github-runner-207 kernel: [48556.591604] ? _raw_spin_lock+0x22/0x30 Aug 22 18:53:02 juju-e4d256-prod-github-runner-207 kernel: [48556.592568] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:53:02 juju-e4d256-prod-github-runner-207 kernel: [48556.593609] direct_page_fault+0x206/0x310 [kvm] Aug 22 18:53:02 juju-e4d256-prod-github-runner-207 kernel: [48556.594648] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 18:53:02 juju-e4d256-prod-github-runner-207 kernel: [48556.595690] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 18:53:02 juju-e4d256-prod-github-runner-207 kernel: [48556.596707] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 18:53:02 juju-e4d256-prod-github-runner-207 kernel: [48556.597699] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 18:53:02 juju-e4d256-prod-github-runner-207 kernel: [48556.598666] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 18:53:02 juju-e4d256-prod-github-runner-207 kernel: [48556.599677] handle_exit+0x98/0x230 [kvm_amd] Aug 22 18:53:02 juju-e4d256-prod-github-runner-207 kernel: [48556.600590] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 18:53:02 juju-e4d256-prod-github-runner-207 kernel: [48556.601570] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 18:53:02 juju-e4d256-prod-github-runner-207 kernel: [48556.602529] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 18:53:02 juju-e4d256-prod-github-runner-207 kernel: [48556.603481] vcpu_run+0x62/0x2c0 [kvm] Aug 22 18:53:02 juju-e4d256-prod-github-runner-207 kernel: [48556.604334] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 18:53:02 juju-e4d256-prod-github-runner-207 kernel: [48556.605160] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 18:53:02 juju-e4d256-prod-github-runner-207 kernel: [48556.606034] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 18:53:02 juju-e4d256-prod-github-runner-207 kernel: [48556.606848] ? __seccomp_filter+0x4a/0x4a0 Aug 22 18:53:02 juju-e4d256-prod-github-runner-207 kernel: [48556.607677] ? __fget_files+0x86/0xc0 Aug 22 18:53:02 juju-e4d256-prod-github-runner-207 kernel: [48556.608403] __x64_sys_ioctl+0x95/0xd0 Aug 22 18:53:02 juju-e4d256-prod-github-runner-207 kernel: [48556.609266] do_syscall_64+0x5c/0xc0 Aug 22 18:53:02 juju-e4d256-prod-github-runner-207 kernel: [48556.610018] ? do_futex+0x162/0x1f0 Aug 22 18:53:02 juju-e4d256-prod-github-runner-207 kernel: [48556.610717] ? __x64_sys_futex+0x78/0x1e0 Aug 22 18:53:02 juju-e4d256-prod-github-runner-207 kernel: [48556.611433] ? __secure_computing+0xa9/0x120 Aug 22 18:53:02 juju-e4d256-prod-github-runner-207 kernel: [48556.612163] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 18:53:02 juju-e4d256-prod-github-runner-207 kernel: [48556.612951] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:53:02 juju-e4d256-prod-github-runner-207 kernel: [48556.613697] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:53:02 juju-e4d256-prod-github-runner-207 kernel: [48556.614451] ? do_syscall_64+0x69/0xc0 Aug 22 18:53:02 juju-e4d256-prod-github-runner-207 kernel: [48556.615118] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:53:02 juju-e4d256-prod-github-runner-207 kernel: [48556.615857] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:53:02 juju-e4d256-prod-github-runner-207 kernel: [48556.616577] ? do_syscall_64+0x69/0xc0 Aug 22 18:53:02 juju-e4d256-prod-github-runner-207 kernel: [48556.617271] ? do_syscall_64+0x69/0xc0 Aug 22 18:53:02 juju-e4d256-prod-github-runner-207 kernel: [48556.617930] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 18:53:02 juju-e4d256-prod-github-runner-207 kernel: [48556.618659] RIP: 0033:0x7faa5d0edaff Aug 22 18:53:02 juju-e4d256-prod-github-runner-207 kernel: [48556.619304] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 18:53:02 juju-e4d256-prod-github-runner-207 kernel: [48556.621379] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 18:53:02 juju-e4d256-prod-github-runner-207 kernel: [48556.622326] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 18:53:02 juju-e4d256-prod-github-runner-207 kernel: [48556.623248] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 18:53:02 juju-e4d256-prod-github-runner-207 kernel: [48556.624181] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 18:53:02 juju-e4d256-prod-github-runner-207 kernel: [48556.625095] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 18:53:02 juju-e4d256-prod-github-runner-207 kernel: [48556.626012] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 18:53:02 juju-e4d256-prod-github-runner-207 kernel: [48556.626964] Aug 22 18:53:30 juju-e4d256-prod-github-runner-207 kernel: [48584.541981] watchdog: BUG: soft lockup - CPU#1 stuck for 45139s! [qemu-system-x86:6715] Aug 22 18:53:30 juju-e4d256-prod-github-runner-207 kernel: [48584.543146] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 18:53:30 juju-e4d256-prod-github-runner-207 kernel: [48584.543243] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 18:53:30 juju-e4d256-prod-github-runner-207 kernel: [48584.555646] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 18:53:30 juju-e4d256-prod-github-runner-207 kernel: [48584.556910] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 18:53:30 juju-e4d256-prod-github-runner-207 kernel: [48584.558134] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:53:30 juju-e4d256-prod-github-runner-207 kernel: [48584.559204] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 18:53:30 juju-e4d256-prod-github-runner-207 kernel: [48584.561992] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 18:53:30 juju-e4d256-prod-github-runner-207 kernel: [48584.563053] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 18:53:30 juju-e4d256-prod-github-runner-207 kernel: [48584.564244] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 18:53:30 juju-e4d256-prod-github-runner-207 kernel: [48584.565443] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 18:53:30 juju-e4d256-prod-github-runner-207 kernel: [48584.566618] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 18:53:30 juju-e4d256-prod-github-runner-207 kernel: [48584.567807] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 18:53:30 juju-e4d256-prod-github-runner-207 kernel: [48584.569156] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 18:53:30 juju-e4d256-prod-github-runner-207 kernel: [48584.570773] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 18:53:30 juju-e4d256-prod-github-runner-207 kernel: [48584.571982] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 18:53:30 juju-e4d256-prod-github-runner-207 kernel: [48584.573250] Call Trace: Aug 22 18:53:30 juju-e4d256-prod-github-runner-207 kernel: [48584.574271] Aug 22 18:53:30 juju-e4d256-prod-github-runner-207 kernel: [48584.575477] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:53:30 juju-e4d256-prod-github-runner-207 kernel: [48584.577185] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:53:30 juju-e4d256-prod-github-runner-207 kernel: [48584.578585] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:53:30 juju-e4d256-prod-github-runner-207 kernel: [48584.579754] ? show_regs.part.0+0x23/0x29 Aug 22 18:53:30 juju-e4d256-prod-github-runner-207 kernel: [48584.580761] ? show_regs.cold+0x8/0xd Aug 22 18:53:30 juju-e4d256-prod-github-runner-207 kernel: [48584.581744] ? watchdog_timer_fn+0x1be/0x220 Aug 22 18:53:30 juju-e4d256-prod-github-runner-207 kernel: [48584.582769] ? lockup_detector_update_enable+0x60/0x60 Aug 22 18:53:30 juju-e4d256-prod-github-runner-207 kernel: [48584.583878] ? __hrtimer_run_queues+0x107/0x230 Aug 22 18:53:30 juju-e4d256-prod-github-runner-207 kernel: [48584.584966] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 18:53:30 juju-e4d256-prod-github-runner-207 kernel: [48584.586027] ? hrtimer_interrupt+0x101/0x220 Aug 22 18:53:30 juju-e4d256-prod-github-runner-207 kernel: [48584.587076] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 18:53:30 juju-e4d256-prod-github-runner-207 kernel: [48584.588185] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 18:53:30 juju-e4d256-prod-github-runner-207 kernel: [48584.589233] Aug 22 18:53:30 juju-e4d256-prod-github-runner-207 kernel: [48584.590089] Aug 22 18:53:30 juju-e4d256-prod-github-runner-207 kernel: [48584.590939] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 18:53:30 juju-e4d256-prod-github-runner-207 kernel: [48584.592020] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:53:30 juju-e4d256-prod-github-runner-207 kernel: [48584.593061] ? _raw_spin_lock+0x22/0x30 Aug 22 18:53:30 juju-e4d256-prod-github-runner-207 kernel: [48584.594008] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:53:30 juju-e4d256-prod-github-runner-207 kernel: [48584.595028] direct_page_fault+0x206/0x310 [kvm] Aug 22 18:53:30 juju-e4d256-prod-github-runner-207 kernel: [48584.596067] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 18:53:30 juju-e4d256-prod-github-runner-207 kernel: [48584.597074] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 18:53:30 juju-e4d256-prod-github-runner-207 kernel: [48584.598075] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 18:53:30 juju-e4d256-prod-github-runner-207 kernel: [48584.599043] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 18:53:30 juju-e4d256-prod-github-runner-207 kernel: [48584.600003] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 18:53:30 juju-e4d256-prod-github-runner-207 kernel: [48584.601026] handle_exit+0x98/0x230 [kvm_amd] Aug 22 18:53:30 juju-e4d256-prod-github-runner-207 kernel: [48584.601922] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 18:53:30 juju-e4d256-prod-github-runner-207 kernel: [48584.602841] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 18:53:30 juju-e4d256-prod-github-runner-207 kernel: [48584.603829] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 18:53:30 juju-e4d256-prod-github-runner-207 kernel: [48584.604739] vcpu_run+0x62/0x2c0 [kvm] Aug 22 18:53:30 juju-e4d256-prod-github-runner-207 kernel: [48584.605548] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 18:53:30 juju-e4d256-prod-github-runner-207 kernel: [48584.606375] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 18:53:30 juju-e4d256-prod-github-runner-207 kernel: [48584.607292] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 18:53:30 juju-e4d256-prod-github-runner-207 kernel: [48584.608096] ? __seccomp_filter+0x4a/0x4a0 Aug 22 18:53:30 juju-e4d256-prod-github-runner-207 kernel: [48584.608878] ? __fget_files+0x86/0xc0 Aug 22 18:53:30 juju-e4d256-prod-github-runner-207 kernel: [48584.609581] __x64_sys_ioctl+0x95/0xd0 Aug 22 18:53:30 juju-e4d256-prod-github-runner-207 kernel: [48584.610312] do_syscall_64+0x5c/0xc0 Aug 22 18:53:30 juju-e4d256-prod-github-runner-207 kernel: [48584.610982] ? do_futex+0x162/0x1f0 Aug 22 18:53:30 juju-e4d256-prod-github-runner-207 kernel: [48584.611685] ? __x64_sys_futex+0x78/0x1e0 Aug 22 18:53:30 juju-e4d256-prod-github-runner-207 kernel: [48584.612369] ? __secure_computing+0xa9/0x120 Aug 22 18:53:30 juju-e4d256-prod-github-runner-207 kernel: [48584.613091] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 18:53:30 juju-e4d256-prod-github-runner-207 kernel: [48584.613856] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:53:30 juju-e4d256-prod-github-runner-207 kernel: [48584.614590] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:53:30 juju-e4d256-prod-github-runner-207 kernel: [48584.615358] ? do_syscall_64+0x69/0xc0 Aug 22 18:53:30 juju-e4d256-prod-github-runner-207 kernel: [48584.616057] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:53:30 juju-e4d256-prod-github-runner-207 kernel: [48584.616761] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:53:30 juju-e4d256-prod-github-runner-207 kernel: [48584.617455] ? do_syscall_64+0x69/0xc0 Aug 22 18:53:30 juju-e4d256-prod-github-runner-207 kernel: [48584.618078] ? do_syscall_64+0x69/0xc0 Aug 22 18:53:30 juju-e4d256-prod-github-runner-207 kernel: [48584.618699] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 18:53:30 juju-e4d256-prod-github-runner-207 kernel: [48584.619434] RIP: 0033:0x7faa5d0edaff Aug 22 18:53:30 juju-e4d256-prod-github-runner-207 kernel: [48584.620091] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 18:53:30 juju-e4d256-prod-github-runner-207 kernel: [48584.622093] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 18:53:30 juju-e4d256-prod-github-runner-207 kernel: [48584.623013] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 18:53:30 juju-e4d256-prod-github-runner-207 kernel: [48584.623952] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 18:53:30 juju-e4d256-prod-github-runner-207 kernel: [48584.624867] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 18:53:30 juju-e4d256-prod-github-runner-207 kernel: [48584.625827] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 18:53:30 juju-e4d256-prod-github-runner-207 kernel: [48584.626809] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 18:53:30 juju-e4d256-prod-github-runner-207 kernel: [48584.627810] Aug 22 18:53:46 juju-e4d256-prod-github-runner-207 kernel: [48600.428707] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 18:53:46 juju-e4d256-prod-github-runner-207 kernel: [48600.429701] rcu: 1-....: (12082695 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=5843318 Aug 22 18:53:46 juju-e4d256-prod-github-runner-207 kernel: [48600.430844] (t=12120807 jiffies g=23269 q=46633) Aug 22 18:53:46 juju-e4d256-prod-github-runner-207 kernel: [48600.431665] NMI backtrace for cpu 1 Aug 22 18:53:46 juju-e4d256-prod-github-runner-207 kernel: [48600.432386] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 18:53:46 juju-e4d256-prod-github-runner-207 kernel: [48600.433516] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 18:53:46 juju-e4d256-prod-github-runner-207 kernel: [48600.434581] Call Trace: Aug 22 18:53:46 juju-e4d256-prod-github-runner-207 kernel: [48600.435285] Aug 22 18:53:46 juju-e4d256-prod-github-runner-207 kernel: [48600.435950] show_stack+0x52/0x5c Aug 22 18:53:46 juju-e4d256-prod-github-runner-207 kernel: [48600.436672] dump_stack_lvl+0x4a/0x63 Aug 22 18:53:46 juju-e4d256-prod-github-runner-207 kernel: [48600.437415] dump_stack+0x10/0x16 Aug 22 18:53:46 juju-e4d256-prod-github-runner-207 kernel: [48600.438131] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 18:53:46 juju-e4d256-prod-github-runner-207 kernel: [48600.438913] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 18:53:46 juju-e4d256-prod-github-runner-207 kernel: [48600.439698] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 18:53:46 juju-e4d256-prod-github-runner-207 kernel: [48600.440538] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 18:53:46 juju-e4d256-prod-github-runner-207 kernel: [48600.441392] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 18:53:46 juju-e4d256-prod-github-runner-207 kernel: [48600.442208] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 18:53:46 juju-e4d256-prod-github-runner-207 kernel: [48600.442980] print_cpu_stall.cold+0x2f/0xe2 Aug 22 18:53:46 juju-e4d256-prod-github-runner-207 kernel: [48600.443766] ? timekeeping_update+0xf7/0x150 Aug 22 18:53:46 juju-e4d256-prod-github-runner-207 kernel: [48600.444536] check_cpu_stall+0x109/0x270 Aug 22 18:53:46 juju-e4d256-prod-github-runner-207 kernel: [48600.445285] rcu_sched_clock_irq+0x9a/0x250 Aug 22 18:53:46 juju-e4d256-prod-github-runner-207 kernel: [48600.446066] update_process_times+0x94/0xd0 Aug 22 18:53:46 juju-e4d256-prod-github-runner-207 kernel: [48600.446829] tick_sched_handle+0x29/0x70 Aug 22 18:53:46 juju-e4d256-prod-github-runner-207 kernel: [48600.447582] tick_sched_timer+0x8c/0xc0 Aug 22 18:53:46 juju-e4d256-prod-github-runner-207 kernel: [48600.448316] ? tick_nohz_handler+0xb0/0xb0 Aug 22 18:53:46 juju-e4d256-prod-github-runner-207 kernel: [48600.449068] __hrtimer_run_queues+0x107/0x230 Aug 22 18:53:46 juju-e4d256-prod-github-runner-207 kernel: [48600.449843] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 18:53:46 juju-e4d256-prod-github-runner-207 kernel: [48600.450639] hrtimer_interrupt+0x101/0x220 Aug 22 18:53:46 juju-e4d256-prod-github-runner-207 kernel: [48600.451429] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 18:53:46 juju-e4d256-prod-github-runner-207 kernel: [48600.452241] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 18:53:46 juju-e4d256-prod-github-runner-207 kernel: [48600.453041] Aug 22 18:53:46 juju-e4d256-prod-github-runner-207 kernel: [48600.453678] Aug 22 18:53:46 juju-e4d256-prod-github-runner-207 kernel: [48600.454311] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 18:53:46 juju-e4d256-prod-github-runner-207 kernel: [48600.455140] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:53:46 juju-e4d256-prod-github-runner-207 kernel: [48600.456033] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 18:53:46 juju-e4d256-prod-github-runner-207 kernel: [48600.458242] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 18:53:46 juju-e4d256-prod-github-runner-207 kernel: [48600.459133] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 18:53:46 juju-e4d256-prod-github-runner-207 kernel: [48600.460127] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 18:53:46 juju-e4d256-prod-github-runner-207 kernel: [48600.461119] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 18:53:46 juju-e4d256-prod-github-runner-207 kernel: [48600.462111] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 18:53:46 juju-e4d256-prod-github-runner-207 kernel: [48600.463149] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 18:53:46 juju-e4d256-prod-github-runner-207 kernel: [48600.464114] ? _raw_spin_lock+0x22/0x30 Aug 22 18:53:46 juju-e4d256-prod-github-runner-207 kernel: [48600.464874] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:53:46 juju-e4d256-prod-github-runner-207 kernel: [48600.465709] direct_page_fault+0x206/0x310 [kvm] Aug 22 18:53:46 juju-e4d256-prod-github-runner-207 kernel: [48600.466576] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 18:53:46 juju-e4d256-prod-github-runner-207 kernel: [48600.467435] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 18:53:46 juju-e4d256-prod-github-runner-207 kernel: [48600.468256] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 18:53:46 juju-e4d256-prod-github-runner-207 kernel: [48600.469063] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 18:53:46 juju-e4d256-prod-github-runner-207 kernel: [48600.469849] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 18:53:46 juju-e4d256-prod-github-runner-207 kernel: [48600.470683] handle_exit+0x98/0x230 [kvm_amd] Aug 22 18:53:46 juju-e4d256-prod-github-runner-207 kernel: [48600.471481] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 18:53:46 juju-e4d256-prod-github-runner-207 kernel: [48600.472273] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 18:53:46 juju-e4d256-prod-github-runner-207 kernel: [48600.473071] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 18:53:46 juju-e4d256-prod-github-runner-207 kernel: [48600.473861] vcpu_run+0x62/0x2c0 [kvm] Aug 22 18:53:46 juju-e4d256-prod-github-runner-207 kernel: [48600.474573] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 18:53:46 juju-e4d256-prod-github-runner-207 kernel: [48600.475314] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 18:53:46 juju-e4d256-prod-github-runner-207 kernel: [48600.476133] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 18:53:46 juju-e4d256-prod-github-runner-207 kernel: [48600.476938] ? __seccomp_filter+0x4a/0x4a0 Aug 22 18:53:46 juju-e4d256-prod-github-runner-207 kernel: [48600.477679] ? __fget_files+0x86/0xc0 Aug 22 18:53:46 juju-e4d256-prod-github-runner-207 kernel: [48600.478370] __x64_sys_ioctl+0x95/0xd0 Aug 22 18:53:46 juju-e4d256-prod-github-runner-207 kernel: [48600.479178] do_syscall_64+0x5c/0xc0 Aug 22 18:53:46 juju-e4d256-prod-github-runner-207 kernel: [48600.479919] ? do_futex+0x162/0x1f0 Aug 22 18:53:46 juju-e4d256-prod-github-runner-207 kernel: [48600.480620] ? __x64_sys_futex+0x78/0x1e0 Aug 22 18:53:46 juju-e4d256-prod-github-runner-207 kernel: [48600.481335] ? __secure_computing+0xa9/0x120 Aug 22 18:53:46 juju-e4d256-prod-github-runner-207 kernel: [48600.482084] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 18:53:46 juju-e4d256-prod-github-runner-207 kernel: [48600.482888] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:53:46 juju-e4d256-prod-github-runner-207 kernel: [48600.483668] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:53:46 juju-e4d256-prod-github-runner-207 kernel: [48600.484425] ? do_syscall_64+0x69/0xc0 Aug 22 18:53:46 juju-e4d256-prod-github-runner-207 kernel: [48600.485127] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:53:46 juju-e4d256-prod-github-runner-207 kernel: [48600.485935] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:53:46 juju-e4d256-prod-github-runner-207 kernel: [48600.486713] ? do_syscall_64+0x69/0xc0 Aug 22 18:53:46 juju-e4d256-prod-github-runner-207 kernel: [48600.487460] ? do_syscall_64+0x69/0xc0 Aug 22 18:53:46 juju-e4d256-prod-github-runner-207 kernel: [48600.488154] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 18:53:46 juju-e4d256-prod-github-runner-207 kernel: [48600.488931] RIP: 0033:0x7faa5d0edaff Aug 22 18:53:46 juju-e4d256-prod-github-runner-207 kernel: [48600.489613] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 18:53:46 juju-e4d256-prod-github-runner-207 kernel: [48600.491728] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 18:53:46 juju-e4d256-prod-github-runner-207 kernel: [48600.492731] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 18:53:46 juju-e4d256-prod-github-runner-207 kernel: [48600.493680] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 18:53:46 juju-e4d256-prod-github-runner-207 kernel: [48600.494649] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 18:53:46 juju-e4d256-prod-github-runner-207 kernel: [48600.495652] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 18:53:46 juju-e4d256-prod-github-runner-207 kernel: [48600.496595] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 18:53:46 juju-e4d256-prod-github-runner-207 kernel: [48600.497507] Aug 22 18:54:10 juju-e4d256-prod-github-runner-207 kernel: [48624.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 45177s! [qemu-system-x86:6715] Aug 22 18:54:10 juju-e4d256-prod-github-runner-207 kernel: [48624.543832] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 18:54:10 juju-e4d256-prod-github-runner-207 kernel: [48624.544109] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 18:54:10 juju-e4d256-prod-github-runner-207 kernel: [48624.556735] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 18:54:10 juju-e4d256-prod-github-runner-207 kernel: [48624.558010] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 18:54:10 juju-e4d256-prod-github-runner-207 kernel: [48624.559272] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:54:10 juju-e4d256-prod-github-runner-207 kernel: [48624.560341] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 18:54:10 juju-e4d256-prod-github-runner-207 kernel: [48624.563012] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 18:54:10 juju-e4d256-prod-github-runner-207 kernel: [48624.564075] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 18:54:10 juju-e4d256-prod-github-runner-207 kernel: [48624.565276] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 18:54:10 juju-e4d256-prod-github-runner-207 kernel: [48624.566463] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 18:54:10 juju-e4d256-prod-github-runner-207 kernel: [48624.567642] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 18:54:10 juju-e4d256-prod-github-runner-207 kernel: [48624.568815] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 18:54:10 juju-e4d256-prod-github-runner-207 kernel: [48624.570032] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 18:54:10 juju-e4d256-prod-github-runner-207 kernel: [48624.571287] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 18:54:10 juju-e4d256-prod-github-runner-207 kernel: [48624.572435] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 18:54:10 juju-e4d256-prod-github-runner-207 kernel: [48624.573644] Call Trace: Aug 22 18:54:10 juju-e4d256-prod-github-runner-207 kernel: [48624.574560] Aug 22 18:54:10 juju-e4d256-prod-github-runner-207 kernel: [48624.575453] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:54:10 juju-e4d256-prod-github-runner-207 kernel: [48624.576493] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:54:10 juju-e4d256-prod-github-runner-207 kernel: [48624.577534] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:54:10 juju-e4d256-prod-github-runner-207 kernel: [48624.578658] ? show_regs.part.0+0x23/0x29 Aug 22 18:54:10 juju-e4d256-prod-github-runner-207 kernel: [48624.579679] ? show_regs.cold+0x8/0xd Aug 22 18:54:10 juju-e4d256-prod-github-runner-207 kernel: [48624.580683] ? watchdog_timer_fn+0x1be/0x220 Aug 22 18:54:10 juju-e4d256-prod-github-runner-207 kernel: [48624.581730] ? lockup_detector_update_enable+0x60/0x60 Aug 22 18:54:10 juju-e4d256-prod-github-runner-207 kernel: [48624.582861] ? __hrtimer_run_queues+0x107/0x230 Aug 22 18:54:10 juju-e4d256-prod-github-runner-207 kernel: [48624.583925] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 18:54:10 juju-e4d256-prod-github-runner-207 kernel: [48624.584961] ? hrtimer_interrupt+0x101/0x220 Aug 22 18:54:10 juju-e4d256-prod-github-runner-207 kernel: [48624.586006] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 18:54:10 juju-e4d256-prod-github-runner-207 kernel: [48624.587132] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 18:54:10 juju-e4d256-prod-github-runner-207 kernel: [48624.588219] Aug 22 18:54:10 juju-e4d256-prod-github-runner-207 kernel: [48624.589103] Aug 22 18:54:10 juju-e4d256-prod-github-runner-207 kernel: [48624.590041] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 18:54:10 juju-e4d256-prod-github-runner-207 kernel: [48624.591165] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:54:10 juju-e4d256-prod-github-runner-207 kernel: [48624.592287] ? _raw_spin_lock+0x22/0x30 Aug 22 18:54:10 juju-e4d256-prod-github-runner-207 kernel: [48624.593254] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:54:10 juju-e4d256-prod-github-runner-207 kernel: [48624.594313] direct_page_fault+0x206/0x310 [kvm] Aug 22 18:54:10 juju-e4d256-prod-github-runner-207 kernel: [48624.595413] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 18:54:10 juju-e4d256-prod-github-runner-207 kernel: [48624.596457] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 18:54:10 juju-e4d256-prod-github-runner-207 kernel: [48624.597485] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 18:54:10 juju-e4d256-prod-github-runner-207 kernel: [48624.598544] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 18:54:10 juju-e4d256-prod-github-runner-207 kernel: [48624.599540] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 18:54:10 juju-e4d256-prod-github-runner-207 kernel: [48624.600549] handle_exit+0x98/0x230 [kvm_amd] Aug 22 18:54:10 juju-e4d256-prod-github-runner-207 kernel: [48624.601462] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 18:54:10 juju-e4d256-prod-github-runner-207 kernel: [48624.602409] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 18:54:10 juju-e4d256-prod-github-runner-207 kernel: [48624.603391] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 18:54:10 juju-e4d256-prod-github-runner-207 kernel: [48624.604318] vcpu_run+0x62/0x2c0 [kvm] Aug 22 18:54:10 juju-e4d256-prod-github-runner-207 kernel: [48624.605163] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 18:54:10 juju-e4d256-prod-github-runner-207 kernel: [48624.606011] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 18:54:10 juju-e4d256-prod-github-runner-207 kernel: [48624.606910] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 18:54:10 juju-e4d256-prod-github-runner-207 kernel: [48624.607749] ? __seccomp_filter+0x4a/0x4a0 Aug 22 18:54:10 juju-e4d256-prod-github-runner-207 kernel: [48624.608515] ? __fget_files+0x86/0xc0 Aug 22 18:54:10 juju-e4d256-prod-github-runner-207 kernel: [48624.609260] __x64_sys_ioctl+0x95/0xd0 Aug 22 18:54:10 juju-e4d256-prod-github-runner-207 kernel: [48624.609975] do_syscall_64+0x5c/0xc0 Aug 22 18:54:10 juju-e4d256-prod-github-runner-207 kernel: [48624.610736] ? do_futex+0x162/0x1f0 Aug 22 18:54:10 juju-e4d256-prod-github-runner-207 kernel: [48624.611399] ? __x64_sys_futex+0x78/0x1e0 Aug 22 18:54:10 juju-e4d256-prod-github-runner-207 kernel: [48624.612152] ? __secure_computing+0xa9/0x120 Aug 22 18:54:10 juju-e4d256-prod-github-runner-207 kernel: [48624.612869] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 18:54:10 juju-e4d256-prod-github-runner-207 kernel: [48624.613683] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:54:10 juju-e4d256-prod-github-runner-207 kernel: [48624.614431] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:54:10 juju-e4d256-prod-github-runner-207 kernel: [48624.615184] ? do_syscall_64+0x69/0xc0 Aug 22 18:54:10 juju-e4d256-prod-github-runner-207 kernel: [48624.615848] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:54:10 juju-e4d256-prod-github-runner-207 kernel: [48624.616572] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:54:10 juju-e4d256-prod-github-runner-207 kernel: [48624.617287] ? do_syscall_64+0x69/0xc0 Aug 22 18:54:10 juju-e4d256-prod-github-runner-207 kernel: [48624.617928] ? do_syscall_64+0x69/0xc0 Aug 22 18:54:10 juju-e4d256-prod-github-runner-207 kernel: [48624.618573] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 18:54:10 juju-e4d256-prod-github-runner-207 kernel: [48624.619324] RIP: 0033:0x7faa5d0edaff Aug 22 18:54:10 juju-e4d256-prod-github-runner-207 kernel: [48624.620017] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 18:54:10 juju-e4d256-prod-github-runner-207 kernel: [48624.622091] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 18:54:10 juju-e4d256-prod-github-runner-207 kernel: [48624.623065] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 18:54:10 juju-e4d256-prod-github-runner-207 kernel: [48624.623986] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 18:54:10 juju-e4d256-prod-github-runner-207 kernel: [48624.624903] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 18:54:10 juju-e4d256-prod-github-runner-207 kernel: [48624.625850] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 18:54:10 juju-e4d256-prod-github-runner-207 kernel: [48624.626779] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 18:54:10 juju-e4d256-prod-github-runner-207 kernel: [48624.627701] Aug 22 18:54:38 juju-e4d256-prod-github-runner-207 kernel: [48652.542525] watchdog: BUG: soft lockup - CPU#1 stuck for 45203s! [qemu-system-x86:6715] Aug 22 18:54:38 juju-e4d256-prod-github-runner-207 kernel: [48652.544931] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 18:54:38 juju-e4d256-prod-github-runner-207 kernel: [48652.545005] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 18:54:38 juju-e4d256-prod-github-runner-207 kernel: [48652.558964] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 18:54:38 juju-e4d256-prod-github-runner-207 kernel: [48652.560405] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 18:54:38 juju-e4d256-prod-github-runner-207 kernel: [48652.561788] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:54:38 juju-e4d256-prod-github-runner-207 kernel: [48652.562979] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 18:54:38 juju-e4d256-prod-github-runner-207 kernel: [48652.565895] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 18:54:38 juju-e4d256-prod-github-runner-207 kernel: [48652.567062] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 18:54:38 juju-e4d256-prod-github-runner-207 kernel: [48652.568360] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 18:54:38 juju-e4d256-prod-github-runner-207 kernel: [48652.569695] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 18:54:38 juju-e4d256-prod-github-runner-207 kernel: [48652.571024] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 18:54:38 juju-e4d256-prod-github-runner-207 kernel: [48652.572326] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 18:54:38 juju-e4d256-prod-github-runner-207 kernel: [48652.573633] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 18:54:38 juju-e4d256-prod-github-runner-207 kernel: [48652.575038] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 18:54:38 juju-e4d256-prod-github-runner-207 kernel: [48652.576262] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 18:54:38 juju-e4d256-prod-github-runner-207 kernel: [48652.577606] Call Trace: Aug 22 18:54:38 juju-e4d256-prod-github-runner-207 kernel: [48652.578600] Aug 22 18:54:38 juju-e4d256-prod-github-runner-207 kernel: [48652.579543] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:54:38 juju-e4d256-prod-github-runner-207 kernel: [48652.580661] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:54:38 juju-e4d256-prod-github-runner-207 kernel: [48652.581794] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:54:38 juju-e4d256-prod-github-runner-207 kernel: [48652.582998] ? show_regs.part.0+0x23/0x29 Aug 22 18:54:38 juju-e4d256-prod-github-runner-207 kernel: [48652.584083] ? show_regs.cold+0x8/0xd Aug 22 18:54:38 juju-e4d256-prod-github-runner-207 kernel: [48652.585125] ? watchdog_timer_fn+0x1be/0x220 Aug 22 18:54:38 juju-e4d256-prod-github-runner-207 kernel: [48652.586241] ? lockup_detector_update_enable+0x60/0x60 Aug 22 18:54:38 juju-e4d256-prod-github-runner-207 kernel: [48652.587416] ? __hrtimer_run_queues+0x107/0x230 Aug 22 18:54:38 juju-e4d256-prod-github-runner-207 kernel: [48652.588534] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 18:54:38 juju-e4d256-prod-github-runner-207 kernel: [48652.589645] ? hrtimer_interrupt+0x101/0x220 Aug 22 18:54:38 juju-e4d256-prod-github-runner-207 kernel: [48652.590821] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 18:54:38 juju-e4d256-prod-github-runner-207 kernel: [48652.592032] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 18:54:38 juju-e4d256-prod-github-runner-207 kernel: [48652.593169] Aug 22 18:54:38 juju-e4d256-prod-github-runner-207 kernel: [48652.594079] Aug 22 18:54:38 juju-e4d256-prod-github-runner-207 kernel: [48652.595083] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 18:54:38 juju-e4d256-prod-github-runner-207 kernel: [48652.596273] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:54:38 juju-e4d256-prod-github-runner-207 kernel: [48652.597581] ? _raw_spin_lock+0x22/0x30 Aug 22 18:54:38 juju-e4d256-prod-github-runner-207 kernel: [48652.598724] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:54:38 juju-e4d256-prod-github-runner-207 kernel: [48652.599753] direct_page_fault+0x206/0x310 [kvm] Aug 22 18:54:38 juju-e4d256-prod-github-runner-207 kernel: [48652.600778] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 18:54:38 juju-e4d256-prod-github-runner-207 kernel: [48652.601793] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 18:54:38 juju-e4d256-prod-github-runner-207 kernel: [48652.602842] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 18:54:38 juju-e4d256-prod-github-runner-207 kernel: [48652.603839] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 18:54:38 juju-e4d256-prod-github-runner-207 kernel: [48652.604884] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 18:54:38 juju-e4d256-prod-github-runner-207 kernel: [48652.605872] handle_exit+0x98/0x230 [kvm_amd] Aug 22 18:54:38 juju-e4d256-prod-github-runner-207 kernel: [48652.606793] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 18:54:38 juju-e4d256-prod-github-runner-207 kernel: [48652.607715] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 18:54:38 juju-e4d256-prod-github-runner-207 kernel: [48652.608657] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 18:54:38 juju-e4d256-prod-github-runner-207 kernel: [48652.609740] vcpu_run+0x62/0x2c0 [kvm] Aug 22 18:54:38 juju-e4d256-prod-github-runner-207 kernel: [48652.610579] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 18:54:38 juju-e4d256-prod-github-runner-207 kernel: [48652.611391] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 18:54:38 juju-e4d256-prod-github-runner-207 kernel: [48652.612253] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 18:54:38 juju-e4d256-prod-github-runner-207 kernel: [48652.613059] ? __seccomp_filter+0x4a/0x4a0 Aug 22 18:54:38 juju-e4d256-prod-github-runner-207 kernel: [48652.613805] ? __fget_files+0x86/0xc0 Aug 22 18:54:38 juju-e4d256-prod-github-runner-207 kernel: [48652.614527] __x64_sys_ioctl+0x95/0xd0 Aug 22 18:54:38 juju-e4d256-prod-github-runner-207 kernel: [48652.615225] do_syscall_64+0x5c/0xc0 Aug 22 18:54:38 juju-e4d256-prod-github-runner-207 kernel: [48652.615898] ? do_futex+0x162/0x1f0 Aug 22 18:54:38 juju-e4d256-prod-github-runner-207 kernel: [48652.616560] ? __x64_sys_futex+0x78/0x1e0 Aug 22 18:54:38 juju-e4d256-prod-github-runner-207 kernel: [48652.617237] ? __secure_computing+0xa9/0x120 Aug 22 18:54:38 juju-e4d256-prod-github-runner-207 kernel: [48652.617931] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 18:54:38 juju-e4d256-prod-github-runner-207 kernel: [48652.618709] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:54:38 juju-e4d256-prod-github-runner-207 kernel: [48652.619435] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:54:38 juju-e4d256-prod-github-runner-207 kernel: [48652.620162] ? do_syscall_64+0x69/0xc0 Aug 22 18:54:38 juju-e4d256-prod-github-runner-207 kernel: [48652.620810] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:54:38 juju-e4d256-prod-github-runner-207 kernel: [48652.621516] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:54:38 juju-e4d256-prod-github-runner-207 kernel: [48652.622216] ? do_syscall_64+0x69/0xc0 Aug 22 18:54:38 juju-e4d256-prod-github-runner-207 kernel: [48652.622861] ? do_syscall_64+0x69/0xc0 Aug 22 18:54:38 juju-e4d256-prod-github-runner-207 kernel: [48652.623487] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 18:54:38 juju-e4d256-prod-github-runner-207 kernel: [48652.624196] RIP: 0033:0x7faa5d0edaff Aug 22 18:54:38 juju-e4d256-prod-github-runner-207 kernel: [48652.624830] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 18:54:38 juju-e4d256-prod-github-runner-207 kernel: [48652.626896] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 18:54:38 juju-e4d256-prod-github-runner-207 kernel: [48652.627813] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 18:54:38 juju-e4d256-prod-github-runner-207 kernel: [48652.628714] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 18:54:38 juju-e4d256-prod-github-runner-207 kernel: [48652.629609] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 18:54:38 juju-e4d256-prod-github-runner-207 kernel: [48652.630572] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 18:54:38 juju-e4d256-prod-github-runner-207 kernel: [48652.631472] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 18:54:38 juju-e4d256-prod-github-runner-207 kernel: [48652.632381] Aug 22 18:55:06 juju-e4d256-prod-github-runner-207 kernel: [48680.541985] watchdog: BUG: soft lockup - CPU#1 stuck for 45229s! [qemu-system-x86:6715] Aug 22 18:55:06 juju-e4d256-prod-github-runner-207 kernel: [48680.543135] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 18:55:06 juju-e4d256-prod-github-runner-207 kernel: [48680.543210] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 18:55:06 juju-e4d256-prod-github-runner-207 kernel: [48680.555615] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 18:55:06 juju-e4d256-prod-github-runner-207 kernel: [48680.556952] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 18:55:06 juju-e4d256-prod-github-runner-207 kernel: [48680.558194] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:55:06 juju-e4d256-prod-github-runner-207 kernel: [48680.559257] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 18:55:06 juju-e4d256-prod-github-runner-207 kernel: [48680.561799] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 18:55:06 juju-e4d256-prod-github-runner-207 kernel: [48680.562856] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 18:55:06 juju-e4d256-prod-github-runner-207 kernel: [48680.564058] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 18:55:06 juju-e4d256-prod-github-runner-207 kernel: [48680.565280] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 18:55:06 juju-e4d256-prod-github-runner-207 kernel: [48680.566504] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 18:55:06 juju-e4d256-prod-github-runner-207 kernel: [48680.567669] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 18:55:06 juju-e4d256-prod-github-runner-207 kernel: [48680.568835] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 18:55:06 juju-e4d256-prod-github-runner-207 kernel: [48680.570105] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 18:55:06 juju-e4d256-prod-github-runner-207 kernel: [48680.571205] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 18:55:06 juju-e4d256-prod-github-runner-207 kernel: [48680.572411] Call Trace: Aug 22 18:55:06 juju-e4d256-prod-github-runner-207 kernel: [48680.573325] Aug 22 18:55:06 juju-e4d256-prod-github-runner-207 kernel: [48680.574250] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:55:06 juju-e4d256-prod-github-runner-207 kernel: [48680.575285] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:55:06 juju-e4d256-prod-github-runner-207 kernel: [48680.576310] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:55:06 juju-e4d256-prod-github-runner-207 kernel: [48680.577394] ? show_regs.part.0+0x23/0x29 Aug 22 18:55:06 juju-e4d256-prod-github-runner-207 kernel: [48680.578405] ? show_regs.cold+0x8/0xd Aug 22 18:55:06 juju-e4d256-prod-github-runner-207 kernel: [48680.579388] ? watchdog_timer_fn+0x1be/0x220 Aug 22 18:55:06 juju-e4d256-prod-github-runner-207 kernel: [48680.580399] ? lockup_detector_update_enable+0x60/0x60 Aug 22 18:55:06 juju-e4d256-prod-github-runner-207 kernel: [48680.581464] ? __hrtimer_run_queues+0x107/0x230 Aug 22 18:55:06 juju-e4d256-prod-github-runner-207 kernel: [48680.582525] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 18:55:06 juju-e4d256-prod-github-runner-207 kernel: [48680.583588] ? hrtimer_interrupt+0x101/0x220 Aug 22 18:55:06 juju-e4d256-prod-github-runner-207 kernel: [48680.584680] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 18:55:06 juju-e4d256-prod-github-runner-207 kernel: [48680.585844] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 18:55:06 juju-e4d256-prod-github-runner-207 kernel: [48680.586987] Aug 22 18:55:06 juju-e4d256-prod-github-runner-207 kernel: [48680.587854] Aug 22 18:55:06 juju-e4d256-prod-github-runner-207 kernel: [48680.588797] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 18:55:06 juju-e4d256-prod-github-runner-207 kernel: [48680.589878] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:55:06 juju-e4d256-prod-github-runner-207 kernel: [48680.590947] ? _raw_spin_lock+0x22/0x30 Aug 22 18:55:06 juju-e4d256-prod-github-runner-207 kernel: [48680.591904] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:55:06 juju-e4d256-prod-github-runner-207 kernel: [48680.592935] direct_page_fault+0x206/0x310 [kvm] Aug 22 18:55:06 juju-e4d256-prod-github-runner-207 kernel: [48680.593960] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 18:55:06 juju-e4d256-prod-github-runner-207 kernel: [48680.594986] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 18:55:06 juju-e4d256-prod-github-runner-207 kernel: [48680.595991] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 18:55:06 juju-e4d256-prod-github-runner-207 kernel: [48680.596963] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 18:55:06 juju-e4d256-prod-github-runner-207 kernel: [48680.597907] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 18:55:06 juju-e4d256-prod-github-runner-207 kernel: [48680.598893] handle_exit+0x98/0x230 [kvm_amd] Aug 22 18:55:06 juju-e4d256-prod-github-runner-207 kernel: [48680.599820] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 18:55:06 juju-e4d256-prod-github-runner-207 kernel: [48680.600755] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 18:55:06 juju-e4d256-prod-github-runner-207 kernel: [48680.601724] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 18:55:06 juju-e4d256-prod-github-runner-207 kernel: [48680.602641] vcpu_run+0x62/0x2c0 [kvm] Aug 22 18:55:06 juju-e4d256-prod-github-runner-207 kernel: [48680.603460] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 18:55:06 juju-e4d256-prod-github-runner-207 kernel: [48680.604328] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 18:55:06 juju-e4d256-prod-github-runner-207 kernel: [48680.605184] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 18:55:06 juju-e4d256-prod-github-runner-207 kernel: [48680.606006] ? __seccomp_filter+0x4a/0x4a0 Aug 22 18:55:06 juju-e4d256-prod-github-runner-207 kernel: [48680.606751] ? __fget_files+0x86/0xc0 Aug 22 18:55:06 juju-e4d256-prod-github-runner-207 kernel: [48680.607457] __x64_sys_ioctl+0x95/0xd0 Aug 22 18:55:06 juju-e4d256-prod-github-runner-207 kernel: [48680.608233] do_syscall_64+0x5c/0xc0 Aug 22 18:55:06 juju-e4d256-prod-github-runner-207 kernel: [48680.608938] ? do_futex+0x162/0x1f0 Aug 22 18:55:06 juju-e4d256-prod-github-runner-207 kernel: [48680.609591] ? __x64_sys_futex+0x78/0x1e0 Aug 22 18:55:06 juju-e4d256-prod-github-runner-207 kernel: [48680.610338] ? __secure_computing+0xa9/0x120 Aug 22 18:55:06 juju-e4d256-prod-github-runner-207 kernel: [48680.611051] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 18:55:06 juju-e4d256-prod-github-runner-207 kernel: [48680.611825] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:55:06 juju-e4d256-prod-github-runner-207 kernel: [48680.612550] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:55:06 juju-e4d256-prod-github-runner-207 kernel: [48680.613271] ? do_syscall_64+0x69/0xc0 Aug 22 18:55:06 juju-e4d256-prod-github-runner-207 kernel: [48680.613919] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:55:06 juju-e4d256-prod-github-runner-207 kernel: [48680.614646] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:55:06 juju-e4d256-prod-github-runner-207 kernel: [48680.615343] ? do_syscall_64+0x69/0xc0 Aug 22 18:55:06 juju-e4d256-prod-github-runner-207 kernel: [48680.615969] ? do_syscall_64+0x69/0xc0 Aug 22 18:55:06 juju-e4d256-prod-github-runner-207 kernel: [48680.616598] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 18:55:06 juju-e4d256-prod-github-runner-207 kernel: [48680.617309] RIP: 0033:0x7faa5d0edaff Aug 22 18:55:06 juju-e4d256-prod-github-runner-207 kernel: [48680.617937] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 18:55:06 juju-e4d256-prod-github-runner-207 kernel: [48680.619926] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 18:55:06 juju-e4d256-prod-github-runner-207 kernel: [48680.620846] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 18:55:06 juju-e4d256-prod-github-runner-207 kernel: [48680.621736] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 18:55:06 juju-e4d256-prod-github-runner-207 kernel: [48680.622690] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 18:55:06 juju-e4d256-prod-github-runner-207 kernel: [48680.623647] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 18:55:06 juju-e4d256-prod-github-runner-207 kernel: [48680.624594] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 18:55:06 juju-e4d256-prod-github-runner-207 kernel: [48680.625507] Aug 22 18:55:34 juju-e4d256-prod-github-runner-207 kernel: [48708.541980] watchdog: BUG: soft lockup - CPU#1 stuck for 45255s! [qemu-system-x86:6715] Aug 22 18:55:34 juju-e4d256-prod-github-runner-207 kernel: [48708.543916] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 18:55:34 juju-e4d256-prod-github-runner-207 kernel: [48708.544243] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 18:55:34 juju-e4d256-prod-github-runner-207 kernel: [48708.557187] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 18:55:34 juju-e4d256-prod-github-runner-207 kernel: [48708.558693] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 18:55:34 juju-e4d256-prod-github-runner-207 kernel: [48708.560095] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:55:34 juju-e4d256-prod-github-runner-207 kernel: [48708.561273] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 18:55:34 juju-e4d256-prod-github-runner-207 kernel: [48708.564216] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 18:55:34 juju-e4d256-prod-github-runner-207 kernel: [48708.565378] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 18:55:34 juju-e4d256-prod-github-runner-207 kernel: [48708.566718] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 18:55:34 juju-e4d256-prod-github-runner-207 kernel: [48708.568024] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 18:55:34 juju-e4d256-prod-github-runner-207 kernel: [48708.569335] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 18:55:34 juju-e4d256-prod-github-runner-207 kernel: [48708.570655] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 18:55:34 juju-e4d256-prod-github-runner-207 kernel: [48708.571965] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 18:55:34 juju-e4d256-prod-github-runner-207 kernel: [48708.573370] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 18:55:34 juju-e4d256-prod-github-runner-207 kernel: [48708.574605] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 18:55:34 juju-e4d256-prod-github-runner-207 kernel: [48708.575943] Call Trace: Aug 22 18:55:34 juju-e4d256-prod-github-runner-207 kernel: [48708.576910] Aug 22 18:55:34 juju-e4d256-prod-github-runner-207 kernel: [48708.577898] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:55:34 juju-e4d256-prod-github-runner-207 kernel: [48708.579193] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:55:34 juju-e4d256-prod-github-runner-207 kernel: [48708.580312] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:55:34 juju-e4d256-prod-github-runner-207 kernel: [48708.581736] ? show_regs.part.0+0x23/0x29 Aug 22 18:55:34 juju-e4d256-prod-github-runner-207 kernel: [48708.582816] ? show_regs.cold+0x8/0xd Aug 22 18:55:34 juju-e4d256-prod-github-runner-207 kernel: [48708.583868] ? watchdog_timer_fn+0x1be/0x220 Aug 22 18:55:34 juju-e4d256-prod-github-runner-207 kernel: [48708.584959] ? lockup_detector_update_enable+0x60/0x60 Aug 22 18:55:34 juju-e4d256-prod-github-runner-207 kernel: [48708.586149] ? __hrtimer_run_queues+0x107/0x230 Aug 22 18:55:34 juju-e4d256-prod-github-runner-207 kernel: [48708.587276] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 18:55:34 juju-e4d256-prod-github-runner-207 kernel: [48708.588404] ? hrtimer_interrupt+0x101/0x220 Aug 22 18:55:34 juju-e4d256-prod-github-runner-207 kernel: [48708.589535] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 18:55:34 juju-e4d256-prod-github-runner-207 kernel: [48708.590737] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 18:55:34 juju-e4d256-prod-github-runner-207 kernel: [48708.592077] Aug 22 18:55:34 juju-e4d256-prod-github-runner-207 kernel: [48708.593000] Aug 22 18:55:34 juju-e4d256-prod-github-runner-207 kernel: [48708.593930] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 18:55:34 juju-e4d256-prod-github-runner-207 kernel: [48708.595111] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:55:34 juju-e4d256-prod-github-runner-207 kernel: [48708.596267] ? _raw_spin_lock+0x22/0x30 Aug 22 18:55:34 juju-e4d256-prod-github-runner-207 kernel: [48708.597337] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:55:34 juju-e4d256-prod-github-runner-207 kernel: [48708.598492] direct_page_fault+0x206/0x310 [kvm] Aug 22 18:55:34 juju-e4d256-prod-github-runner-207 kernel: [48708.599658] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 18:55:34 juju-e4d256-prod-github-runner-207 kernel: [48708.600800] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 18:55:34 juju-e4d256-prod-github-runner-207 kernel: [48708.601971] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 18:55:34 juju-e4d256-prod-github-runner-207 kernel: [48708.603098] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 18:55:34 juju-e4d256-prod-github-runner-207 kernel: [48708.604155] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 18:55:34 juju-e4d256-prod-github-runner-207 kernel: [48708.605309] handle_exit+0x98/0x230 [kvm_amd] Aug 22 18:55:34 juju-e4d256-prod-github-runner-207 kernel: [48708.606320] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 18:55:34 juju-e4d256-prod-github-runner-207 kernel: [48708.607338] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 18:55:34 juju-e4d256-prod-github-runner-207 kernel: [48708.608370] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 18:55:34 juju-e4d256-prod-github-runner-207 kernel: [48708.609406] vcpu_run+0x62/0x2c0 [kvm] Aug 22 18:55:34 juju-e4d256-prod-github-runner-207 kernel: [48708.610381] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 18:55:34 juju-e4d256-prod-github-runner-207 kernel: [48708.611290] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 18:55:34 juju-e4d256-prod-github-runner-207 kernel: [48708.612252] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 18:55:34 juju-e4d256-prod-github-runner-207 kernel: [48708.613142] ? __seccomp_filter+0x4a/0x4a0 Aug 22 18:55:34 juju-e4d256-prod-github-runner-207 kernel: [48708.613990] ? __fget_files+0x86/0xc0 Aug 22 18:55:34 juju-e4d256-prod-github-runner-207 kernel: [48708.614780] __x64_sys_ioctl+0x95/0xd0 Aug 22 18:55:34 juju-e4d256-prod-github-runner-207 kernel: [48708.615595] do_syscall_64+0x5c/0xc0 Aug 22 18:55:34 juju-e4d256-prod-github-runner-207 kernel: [48708.616379] ? do_futex+0x162/0x1f0 Aug 22 18:55:34 juju-e4d256-prod-github-runner-207 kernel: [48708.617138] ? __x64_sys_futex+0x78/0x1e0 Aug 22 18:55:34 juju-e4d256-prod-github-runner-207 kernel: [48708.617950] ? __secure_computing+0xa9/0x120 Aug 22 18:55:34 juju-e4d256-prod-github-runner-207 kernel: [48708.618747] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 18:55:34 juju-e4d256-prod-github-runner-207 kernel: [48708.619618] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:55:34 juju-e4d256-prod-github-runner-207 kernel: [48708.620496] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:55:34 juju-e4d256-prod-github-runner-207 kernel: [48708.621324] ? do_syscall_64+0x69/0xc0 Aug 22 18:55:34 juju-e4d256-prod-github-runner-207 kernel: [48708.622067] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:55:34 juju-e4d256-prod-github-runner-207 kernel: [48708.622872] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:55:34 juju-e4d256-prod-github-runner-207 kernel: [48708.623684] ? do_syscall_64+0x69/0xc0 Aug 22 18:55:34 juju-e4d256-prod-github-runner-207 kernel: [48708.624393] ? do_syscall_64+0x69/0xc0 Aug 22 18:55:34 juju-e4d256-prod-github-runner-207 kernel: [48708.625104] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 18:55:34 juju-e4d256-prod-github-runner-207 kernel: [48708.625960] RIP: 0033:0x7faa5d0edaff Aug 22 18:55:34 juju-e4d256-prod-github-runner-207 kernel: [48708.626726] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 18:55:34 juju-e4d256-prod-github-runner-207 kernel: [48708.629127] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 18:55:34 juju-e4d256-prod-github-runner-207 kernel: [48708.630214] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 18:55:34 juju-e4d256-prod-github-runner-207 kernel: [48708.631254] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 18:55:34 juju-e4d256-prod-github-runner-207 kernel: [48708.632312] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 18:55:34 juju-e4d256-prod-github-runner-207 kernel: [48708.633371] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 18:55:34 juju-e4d256-prod-github-runner-207 kernel: [48708.634461] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 18:55:34 juju-e4d256-prod-github-runner-207 kernel: [48708.635544] Aug 22 18:56:02 juju-e4d256-prod-github-runner-207 kernel: [48736.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 45281s! [qemu-system-x86:6715] Aug 22 18:56:02 juju-e4d256-prod-github-runner-207 kernel: [48736.543106] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 18:56:02 juju-e4d256-prod-github-runner-207 kernel: [48736.543180] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 18:56:02 juju-e4d256-prod-github-runner-207 kernel: [48736.555566] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 18:56:02 juju-e4d256-prod-github-runner-207 kernel: [48736.556836] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 18:56:02 juju-e4d256-prod-github-runner-207 kernel: [48736.558078] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:56:02 juju-e4d256-prod-github-runner-207 kernel: [48736.559131] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 18:56:02 juju-e4d256-prod-github-runner-207 kernel: [48736.561685] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 18:56:02 juju-e4d256-prod-github-runner-207 kernel: [48736.562726] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 18:56:02 juju-e4d256-prod-github-runner-207 kernel: [48736.563892] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 18:56:02 juju-e4d256-prod-github-runner-207 kernel: [48736.565056] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 18:56:02 juju-e4d256-prod-github-runner-207 kernel: [48736.566224] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 18:56:02 juju-e4d256-prod-github-runner-207 kernel: [48736.567380] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 18:56:02 juju-e4d256-prod-github-runner-207 kernel: [48736.568549] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 18:56:02 juju-e4d256-prod-github-runner-207 kernel: [48736.569835] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 18:56:02 juju-e4d256-prod-github-runner-207 kernel: [48736.570973] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 18:56:02 juju-e4d256-prod-github-runner-207 kernel: [48736.572187] Call Trace: Aug 22 18:56:02 juju-e4d256-prod-github-runner-207 kernel: [48736.573107] Aug 22 18:56:02 juju-e4d256-prod-github-runner-207 kernel: [48736.574079] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:56:02 juju-e4d256-prod-github-runner-207 kernel: [48736.575116] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:56:02 juju-e4d256-prod-github-runner-207 kernel: [48736.576137] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:56:02 juju-e4d256-prod-github-runner-207 kernel: [48736.577210] ? show_regs.part.0+0x23/0x29 Aug 22 18:56:02 juju-e4d256-prod-github-runner-207 kernel: [48736.578216] ? show_regs.cold+0x8/0xd Aug 22 18:56:02 juju-e4d256-prod-github-runner-207 kernel: [48736.579185] ? watchdog_timer_fn+0x1be/0x220 Aug 22 18:56:02 juju-e4d256-prod-github-runner-207 kernel: [48736.580192] ? lockup_detector_update_enable+0x60/0x60 Aug 22 18:56:02 juju-e4d256-prod-github-runner-207 kernel: [48736.581312] ? __hrtimer_run_queues+0x107/0x230 Aug 22 18:56:02 juju-e4d256-prod-github-runner-207 kernel: [48736.582346] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 18:56:02 juju-e4d256-prod-github-runner-207 kernel: [48736.583387] ? hrtimer_interrupt+0x101/0x220 Aug 22 18:56:02 juju-e4d256-prod-github-runner-207 kernel: [48736.584413] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 18:56:02 juju-e4d256-prod-github-runner-207 kernel: [48736.585512] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 18:56:02 juju-e4d256-prod-github-runner-207 kernel: [48736.586564] Aug 22 18:56:02 juju-e4d256-prod-github-runner-207 kernel: [48736.587417] Aug 22 18:56:02 juju-e4d256-prod-github-runner-207 kernel: [48736.588254] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 18:56:02 juju-e4d256-prod-github-runner-207 kernel: [48736.589305] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:56:02 juju-e4d256-prod-github-runner-207 kernel: [48736.590349] ? _raw_spin_lock+0x22/0x30 Aug 22 18:56:02 juju-e4d256-prod-github-runner-207 kernel: [48736.591292] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:56:02 juju-e4d256-prod-github-runner-207 kernel: [48736.592342] direct_page_fault+0x206/0x310 [kvm] Aug 22 18:56:02 juju-e4d256-prod-github-runner-207 kernel: [48736.593410] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 18:56:02 juju-e4d256-prod-github-runner-207 kernel: [48736.594484] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 18:56:02 juju-e4d256-prod-github-runner-207 kernel: [48736.595492] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 18:56:02 juju-e4d256-prod-github-runner-207 kernel: [48736.596500] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 18:56:02 juju-e4d256-prod-github-runner-207 kernel: [48736.597508] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 18:56:02 juju-e4d256-prod-github-runner-207 kernel: [48736.598575] handle_exit+0x98/0x230 [kvm_amd] Aug 22 18:56:02 juju-e4d256-prod-github-runner-207 kernel: [48736.599509] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 18:56:02 juju-e4d256-prod-github-runner-207 kernel: [48736.600466] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 18:56:02 juju-e4d256-prod-github-runner-207 kernel: [48736.601446] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 18:56:02 juju-e4d256-prod-github-runner-207 kernel: [48736.602358] vcpu_run+0x62/0x2c0 [kvm] Aug 22 18:56:02 juju-e4d256-prod-github-runner-207 kernel: [48736.603173] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 18:56:02 juju-e4d256-prod-github-runner-207 kernel: [48736.603986] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 18:56:02 juju-e4d256-prod-github-runner-207 kernel: [48736.604870] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 18:56:02 juju-e4d256-prod-github-runner-207 kernel: [48736.605811] ? __seccomp_filter+0x4a/0x4a0 Aug 22 18:56:02 juju-e4d256-prod-github-runner-207 kernel: [48736.606559] ? __fget_files+0x86/0xc0 Aug 22 18:56:02 juju-e4d256-prod-github-runner-207 kernel: [48736.607263] __x64_sys_ioctl+0x95/0xd0 Aug 22 18:56:02 juju-e4d256-prod-github-runner-207 kernel: [48736.607990] do_syscall_64+0x5c/0xc0 Aug 22 18:56:02 juju-e4d256-prod-github-runner-207 kernel: [48736.608682] ? do_futex+0x162/0x1f0 Aug 22 18:56:02 juju-e4d256-prod-github-runner-207 kernel: [48736.609397] ? __x64_sys_futex+0x78/0x1e0 Aug 22 18:56:02 juju-e4d256-prod-github-runner-207 kernel: [48736.610093] ? __secure_computing+0xa9/0x120 Aug 22 18:56:02 juju-e4d256-prod-github-runner-207 kernel: [48736.610785] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 18:56:02 juju-e4d256-prod-github-runner-207 kernel: [48736.611546] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:56:02 juju-e4d256-prod-github-runner-207 kernel: [48736.612274] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:56:02 juju-e4d256-prod-github-runner-207 kernel: [48736.612995] ? do_syscall_64+0x69/0xc0 Aug 22 18:56:02 juju-e4d256-prod-github-runner-207 kernel: [48736.613695] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:56:02 juju-e4d256-prod-github-runner-207 kernel: [48736.614455] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:56:02 juju-e4d256-prod-github-runner-207 kernel: [48736.615194] ? do_syscall_64+0x69/0xc0 Aug 22 18:56:02 juju-e4d256-prod-github-runner-207 kernel: [48736.615880] ? do_syscall_64+0x69/0xc0 Aug 22 18:56:02 juju-e4d256-prod-github-runner-207 kernel: [48736.616528] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 18:56:02 juju-e4d256-prod-github-runner-207 kernel: [48736.617256] RIP: 0033:0x7faa5d0edaff Aug 22 18:56:02 juju-e4d256-prod-github-runner-207 kernel: [48736.617915] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 18:56:02 juju-e4d256-prod-github-runner-207 kernel: [48736.620129] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 18:56:02 juju-e4d256-prod-github-runner-207 kernel: [48736.621094] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 18:56:02 juju-e4d256-prod-github-runner-207 kernel: [48736.622023] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 18:56:02 juju-e4d256-prod-github-runner-207 kernel: [48736.622967] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 18:56:02 juju-e4d256-prod-github-runner-207 kernel: [48736.623975] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 18:56:02 juju-e4d256-prod-github-runner-207 kernel: [48736.624886] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 18:56:02 juju-e4d256-prod-github-runner-207 kernel: [48736.625824] Aug 22 18:56:30 juju-e4d256-prod-github-runner-207 kernel: [48764.541981] watchdog: BUG: soft lockup - CPU#1 stuck for 45307s! [qemu-system-x86:6715] Aug 22 18:56:30 juju-e4d256-prod-github-runner-207 kernel: [48764.543178] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 18:56:30 juju-e4d256-prod-github-runner-207 kernel: [48764.543254] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 18:56:30 juju-e4d256-prod-github-runner-207 kernel: [48764.556516] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 18:56:30 juju-e4d256-prod-github-runner-207 kernel: [48764.557887] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 18:56:30 juju-e4d256-prod-github-runner-207 kernel: [48764.559287] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:56:30 juju-e4d256-prod-github-runner-207 kernel: [48764.560404] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 18:56:30 juju-e4d256-prod-github-runner-207 kernel: [48764.563085] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 18:56:30 juju-e4d256-prod-github-runner-207 kernel: [48764.564184] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 18:56:30 juju-e4d256-prod-github-runner-207 kernel: [48764.565426] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 18:56:30 juju-e4d256-prod-github-runner-207 kernel: [48764.566608] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 18:56:30 juju-e4d256-prod-github-runner-207 kernel: [48764.567806] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 18:56:30 juju-e4d256-prod-github-runner-207 kernel: [48764.569145] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 18:56:30 juju-e4d256-prod-github-runner-207 kernel: [48764.570332] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 18:56:30 juju-e4d256-prod-github-runner-207 kernel: [48764.571560] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 18:56:30 juju-e4d256-prod-github-runner-207 kernel: [48764.572828] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 18:56:30 juju-e4d256-prod-github-runner-207 kernel: [48764.574077] Call Trace: Aug 22 18:56:30 juju-e4d256-prod-github-runner-207 kernel: [48764.575022] Aug 22 18:56:30 juju-e4d256-prod-github-runner-207 kernel: [48764.575920] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:56:30 juju-e4d256-prod-github-runner-207 kernel: [48764.577025] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:56:30 juju-e4d256-prod-github-runner-207 kernel: [48764.578087] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:56:30 juju-e4d256-prod-github-runner-207 kernel: [48764.579177] ? show_regs.part.0+0x23/0x29 Aug 22 18:56:30 juju-e4d256-prod-github-runner-207 kernel: [48764.580206] ? show_regs.cold+0x8/0xd Aug 22 18:56:30 juju-e4d256-prod-github-runner-207 kernel: [48764.581224] ? watchdog_timer_fn+0x1be/0x220 Aug 22 18:56:30 juju-e4d256-prod-github-runner-207 kernel: [48764.582242] ? lockup_detector_update_enable+0x60/0x60 Aug 22 18:56:30 juju-e4d256-prod-github-runner-207 kernel: [48764.583317] ? __hrtimer_run_queues+0x107/0x230 Aug 22 18:56:30 juju-e4d256-prod-github-runner-207 kernel: [48764.584365] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 18:56:30 juju-e4d256-prod-github-runner-207 kernel: [48764.585440] ? hrtimer_interrupt+0x101/0x220 Aug 22 18:56:30 juju-e4d256-prod-github-runner-207 kernel: [48764.586468] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 18:56:30 juju-e4d256-prod-github-runner-207 kernel: [48764.587562] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 18:56:30 juju-e4d256-prod-github-runner-207 kernel: [48764.588626] Aug 22 18:56:30 juju-e4d256-prod-github-runner-207 kernel: [48764.589512] Aug 22 18:56:30 juju-e4d256-prod-github-runner-207 kernel: [48764.590379] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 18:56:30 juju-e4d256-prod-github-runner-207 kernel: [48764.591509] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:56:30 juju-e4d256-prod-github-runner-207 kernel: [48764.592574] ? _raw_spin_lock+0x22/0x30 Aug 22 18:56:30 juju-e4d256-prod-github-runner-207 kernel: [48764.593571] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:56:30 juju-e4d256-prod-github-runner-207 kernel: [48764.594613] direct_page_fault+0x206/0x310 [kvm] Aug 22 18:56:30 juju-e4d256-prod-github-runner-207 kernel: [48764.595676] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 18:56:30 juju-e4d256-prod-github-runner-207 kernel: [48764.596710] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 18:56:30 juju-e4d256-prod-github-runner-207 kernel: [48764.597758] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 18:56:30 juju-e4d256-prod-github-runner-207 kernel: [48764.598773] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 18:56:30 juju-e4d256-prod-github-runner-207 kernel: [48764.599743] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 18:56:30 juju-e4d256-prod-github-runner-207 kernel: [48764.600791] handle_exit+0x98/0x230 [kvm_amd] Aug 22 18:56:30 juju-e4d256-prod-github-runner-207 kernel: [48764.601758] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 18:56:30 juju-e4d256-prod-github-runner-207 kernel: [48764.602696] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 18:56:30 juju-e4d256-prod-github-runner-207 kernel: [48764.603650] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 18:56:30 juju-e4d256-prod-github-runner-207 kernel: [48764.604604] vcpu_run+0x62/0x2c0 [kvm] Aug 22 18:56:30 juju-e4d256-prod-github-runner-207 kernel: [48764.605527] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 18:56:30 juju-e4d256-prod-github-runner-207 kernel: [48764.606387] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 18:56:30 juju-e4d256-prod-github-runner-207 kernel: [48764.607250] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 18:56:30 juju-e4d256-prod-github-runner-207 kernel: [48764.608059] ? __seccomp_filter+0x4a/0x4a0 Aug 22 18:56:30 juju-e4d256-prod-github-runner-207 kernel: [48764.608812] ? __fget_files+0x86/0xc0 Aug 22 18:56:30 juju-e4d256-prod-github-runner-207 kernel: [48764.609561] __x64_sys_ioctl+0x95/0xd0 Aug 22 18:56:30 juju-e4d256-prod-github-runner-207 kernel: [48764.610291] do_syscall_64+0x5c/0xc0 Aug 22 18:56:30 juju-e4d256-prod-github-runner-207 kernel: [48764.611012] ? do_futex+0x162/0x1f0 Aug 22 18:56:30 juju-e4d256-prod-github-runner-207 kernel: [48764.611682] ? __x64_sys_futex+0x78/0x1e0 Aug 22 18:56:30 juju-e4d256-prod-github-runner-207 kernel: [48764.612371] ? __secure_computing+0xa9/0x120 Aug 22 18:56:30 juju-e4d256-prod-github-runner-207 kernel: [48764.613107] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 18:56:30 juju-e4d256-prod-github-runner-207 kernel: [48764.613883] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:56:30 juju-e4d256-prod-github-runner-207 kernel: [48764.614615] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:56:30 juju-e4d256-prod-github-runner-207 kernel: [48764.615368] ? do_syscall_64+0x69/0xc0 Aug 22 18:56:30 juju-e4d256-prod-github-runner-207 kernel: [48764.616078] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:56:30 juju-e4d256-prod-github-runner-207 kernel: [48764.616804] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:56:30 juju-e4d256-prod-github-runner-207 kernel: [48764.617538] ? do_syscall_64+0x69/0xc0 Aug 22 18:56:30 juju-e4d256-prod-github-runner-207 kernel: [48764.618178] ? do_syscall_64+0x69/0xc0 Aug 22 18:56:30 juju-e4d256-prod-github-runner-207 kernel: [48764.618809] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 18:56:30 juju-e4d256-prod-github-runner-207 kernel: [48764.619535] RIP: 0033:0x7faa5d0edaff Aug 22 18:56:30 juju-e4d256-prod-github-runner-207 kernel: [48764.620190] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 18:56:30 juju-e4d256-prod-github-runner-207 kernel: [48764.622276] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 18:56:30 juju-e4d256-prod-github-runner-207 kernel: [48764.623200] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 18:56:30 juju-e4d256-prod-github-runner-207 kernel: [48764.624092] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 18:56:30 juju-e4d256-prod-github-runner-207 kernel: [48764.625012] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 18:56:30 juju-e4d256-prod-github-runner-207 kernel: [48764.625941] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 18:56:30 juju-e4d256-prod-github-runner-207 kernel: [48764.626872] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 18:56:30 juju-e4d256-prod-github-runner-207 kernel: [48764.627821] Aug 22 18:56:46 juju-e4d256-prod-github-runner-207 kernel: [48780.440742] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 18:56:46 juju-e4d256-prod-github-runner-207 kernel: [48780.441712] rcu: 1-....: (12127558 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=5864558 Aug 22 18:56:46 juju-e4d256-prod-github-runner-207 kernel: [48780.443051] (t=12165810 jiffies g=23269 q=46757) Aug 22 18:56:46 juju-e4d256-prod-github-runner-207 kernel: [48780.443938] NMI backtrace for cpu 1 Aug 22 18:56:46 juju-e4d256-prod-github-runner-207 kernel: [48780.444745] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 18:56:46 juju-e4d256-prod-github-runner-207 kernel: [48780.446036] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 18:56:46 juju-e4d256-prod-github-runner-207 kernel: [48780.447301] Call Trace: Aug 22 18:56:46 juju-e4d256-prod-github-runner-207 kernel: [48780.448002] Aug 22 18:56:46 juju-e4d256-prod-github-runner-207 kernel: [48780.448649] show_stack+0x52/0x5c Aug 22 18:56:46 juju-e4d256-prod-github-runner-207 kernel: [48780.449412] dump_stack_lvl+0x4a/0x63 Aug 22 18:56:46 juju-e4d256-prod-github-runner-207 kernel: [48780.450156] dump_stack+0x10/0x16 Aug 22 18:56:46 juju-e4d256-prod-github-runner-207 kernel: [48780.450872] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 18:56:46 juju-e4d256-prod-github-runner-207 kernel: [48780.451654] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 18:56:46 juju-e4d256-prod-github-runner-207 kernel: [48780.452435] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 18:56:46 juju-e4d256-prod-github-runner-207 kernel: [48780.453266] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 18:56:46 juju-e4d256-prod-github-runner-207 kernel: [48780.454080] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 18:56:46 juju-e4d256-prod-github-runner-207 kernel: [48780.454884] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 18:56:46 juju-e4d256-prod-github-runner-207 kernel: [48780.455651] print_cpu_stall.cold+0x2f/0xe2 Aug 22 18:56:46 juju-e4d256-prod-github-runner-207 kernel: [48780.456411] ? timekeeping_update+0xf7/0x150 Aug 22 18:56:46 juju-e4d256-prod-github-runner-207 kernel: [48780.457196] check_cpu_stall+0x109/0x270 Aug 22 18:56:46 juju-e4d256-prod-github-runner-207 kernel: [48780.457941] rcu_sched_clock_irq+0x9a/0x250 Aug 22 18:56:46 juju-e4d256-prod-github-runner-207 kernel: [48780.458703] update_process_times+0x94/0xd0 Aug 22 18:56:46 juju-e4d256-prod-github-runner-207 kernel: [48780.459465] tick_sched_handle+0x29/0x70 Aug 22 18:56:46 juju-e4d256-prod-github-runner-207 kernel: [48780.460213] tick_sched_timer+0x8c/0xc0 Aug 22 18:56:46 juju-e4d256-prod-github-runner-207 kernel: [48780.460968] ? tick_nohz_handler+0xb0/0xb0 Aug 22 18:56:46 juju-e4d256-prod-github-runner-207 kernel: [48780.461722] __hrtimer_run_queues+0x107/0x230 Aug 22 18:56:46 juju-e4d256-prod-github-runner-207 kernel: [48780.462491] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 18:56:46 juju-e4d256-prod-github-runner-207 kernel: [48780.463268] hrtimer_interrupt+0x101/0x220 Aug 22 18:56:46 juju-e4d256-prod-github-runner-207 kernel: [48780.464024] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 18:56:46 juju-e4d256-prod-github-runner-207 kernel: [48780.464851] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 18:56:46 juju-e4d256-prod-github-runner-207 kernel: [48780.465651] Aug 22 18:56:46 juju-e4d256-prod-github-runner-207 kernel: [48780.466284] Aug 22 18:56:46 juju-e4d256-prod-github-runner-207 kernel: [48780.466916] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 18:56:46 juju-e4d256-prod-github-runner-207 kernel: [48780.467743] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:56:46 juju-e4d256-prod-github-runner-207 kernel: [48780.468631] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 18:56:46 juju-e4d256-prod-github-runner-207 kernel: [48780.470922] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 18:56:46 juju-e4d256-prod-github-runner-207 kernel: [48780.471982] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 18:56:46 juju-e4d256-prod-github-runner-207 kernel: [48780.473332] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 18:56:46 juju-e4d256-prod-github-runner-207 kernel: [48780.474459] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 18:56:46 juju-e4d256-prod-github-runner-207 kernel: [48780.475559] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 18:56:46 juju-e4d256-prod-github-runner-207 kernel: [48780.476654] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 18:56:46 juju-e4d256-prod-github-runner-207 kernel: [48780.477771] ? _raw_spin_lock+0x22/0x30 Aug 22 18:56:46 juju-e4d256-prod-github-runner-207 kernel: [48780.478619] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:56:46 juju-e4d256-prod-github-runner-207 kernel: [48780.479544] direct_page_fault+0x206/0x310 [kvm] Aug 22 18:56:46 juju-e4d256-prod-github-runner-207 kernel: [48780.480479] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 18:56:46 juju-e4d256-prod-github-runner-207 kernel: [48780.481410] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 18:56:46 juju-e4d256-prod-github-runner-207 kernel: [48780.482329] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 18:56:46 juju-e4d256-prod-github-runner-207 kernel: [48780.483227] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 18:56:46 juju-e4d256-prod-github-runner-207 kernel: [48780.484118] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 18:56:46 juju-e4d256-prod-github-runner-207 kernel: [48780.485076] handle_exit+0x98/0x230 [kvm_amd] Aug 22 18:56:46 juju-e4d256-prod-github-runner-207 kernel: [48780.486097] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 18:56:46 juju-e4d256-prod-github-runner-207 kernel: [48780.486974] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 18:56:46 juju-e4d256-prod-github-runner-207 kernel: [48780.487876] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 18:56:46 juju-e4d256-prod-github-runner-207 kernel: [48780.488774] vcpu_run+0x62/0x2c0 [kvm] Aug 22 18:56:46 juju-e4d256-prod-github-runner-207 kernel: [48780.489575] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 18:56:46 juju-e4d256-prod-github-runner-207 kernel: [48780.490401] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 18:56:46 juju-e4d256-prod-github-runner-207 kernel: [48780.491302] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 18:56:46 juju-e4d256-prod-github-runner-207 kernel: [48780.492151] ? __seccomp_filter+0x4a/0x4a0 Aug 22 18:56:46 juju-e4d256-prod-github-runner-207 kernel: [48780.492977] ? __fget_files+0x86/0xc0 Aug 22 18:56:46 juju-e4d256-prod-github-runner-207 kernel: [48780.493750] __x64_sys_ioctl+0x95/0xd0 Aug 22 18:56:46 juju-e4d256-prod-github-runner-207 kernel: [48780.494522] do_syscall_64+0x5c/0xc0 Aug 22 18:56:46 juju-e4d256-prod-github-runner-207 kernel: [48780.495274] ? do_futex+0x162/0x1f0 Aug 22 18:56:46 juju-e4d256-prod-github-runner-207 kernel: [48780.496018] ? __x64_sys_futex+0x78/0x1e0 Aug 22 18:56:46 juju-e4d256-prod-github-runner-207 kernel: [48780.496825] ? __secure_computing+0xa9/0x120 Aug 22 18:56:46 juju-e4d256-prod-github-runner-207 kernel: [48780.497638] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 18:56:46 juju-e4d256-prod-github-runner-207 kernel: [48780.498539] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:56:46 juju-e4d256-prod-github-runner-207 kernel: [48780.499387] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:56:46 juju-e4d256-prod-github-runner-207 kernel: [48780.500240] ? do_syscall_64+0x69/0xc0 Aug 22 18:56:46 juju-e4d256-prod-github-runner-207 kernel: [48780.501022] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:56:46 juju-e4d256-prod-github-runner-207 kernel: [48780.501880] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:56:46 juju-e4d256-prod-github-runner-207 kernel: [48780.502734] ? do_syscall_64+0x69/0xc0 Aug 22 18:56:46 juju-e4d256-prod-github-runner-207 kernel: [48780.503507] ? do_syscall_64+0x69/0xc0 Aug 22 18:56:46 juju-e4d256-prod-github-runner-207 kernel: [48780.504275] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 18:56:46 juju-e4d256-prod-github-runner-207 kernel: [48780.505162] RIP: 0033:0x7faa5d0edaff Aug 22 18:56:46 juju-e4d256-prod-github-runner-207 kernel: [48780.505924] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 18:56:46 juju-e4d256-prod-github-runner-207 kernel: [48780.508372] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 18:56:46 juju-e4d256-prod-github-runner-207 kernel: [48780.509506] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 18:56:46 juju-e4d256-prod-github-runner-207 kernel: [48780.510589] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 18:56:46 juju-e4d256-prod-github-runner-207 kernel: [48780.511674] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 18:56:46 juju-e4d256-prod-github-runner-207 kernel: [48780.512777] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 18:56:46 juju-e4d256-prod-github-runner-207 kernel: [48780.513855] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 18:56:46 juju-e4d256-prod-github-runner-207 kernel: [48780.514907] Aug 22 18:57:10 juju-e4d256-prod-github-runner-207 kernel: [48804.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 45344s! [qemu-system-x86:6715] Aug 22 18:57:10 juju-e4d256-prod-github-runner-207 kernel: [48804.543860] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 18:57:10 juju-e4d256-prod-github-runner-207 kernel: [48804.544167] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 18:57:10 juju-e4d256-prod-github-runner-207 kernel: [48804.556899] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 18:57:10 juju-e4d256-prod-github-runner-207 kernel: [48804.558220] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 18:57:10 juju-e4d256-prod-github-runner-207 kernel: [48804.559448] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:57:10 juju-e4d256-prod-github-runner-207 kernel: [48804.560568] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 18:57:10 juju-e4d256-prod-github-runner-207 kernel: [48804.563183] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 18:57:10 juju-e4d256-prod-github-runner-207 kernel: [48804.564247] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 18:57:10 juju-e4d256-prod-github-runner-207 kernel: [48804.565457] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 18:57:10 juju-e4d256-prod-github-runner-207 kernel: [48804.566654] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 18:57:10 juju-e4d256-prod-github-runner-207 kernel: [48804.567863] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 18:57:10 juju-e4d256-prod-github-runner-207 kernel: [48804.569059] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 18:57:10 juju-e4d256-prod-github-runner-207 kernel: [48804.570252] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 18:57:10 juju-e4d256-prod-github-runner-207 kernel: [48804.571517] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 18:57:10 juju-e4d256-prod-github-runner-207 kernel: [48804.572660] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 18:57:10 juju-e4d256-prod-github-runner-207 kernel: [48804.573904] Call Trace: Aug 22 18:57:10 juju-e4d256-prod-github-runner-207 kernel: [48804.574861] Aug 22 18:57:10 juju-e4d256-prod-github-runner-207 kernel: [48804.575763] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:57:10 juju-e4d256-prod-github-runner-207 kernel: [48804.576828] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:57:10 juju-e4d256-prod-github-runner-207 kernel: [48804.577920] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:57:10 juju-e4d256-prod-github-runner-207 kernel: [48804.579116] ? show_regs.part.0+0x23/0x29 Aug 22 18:57:10 juju-e4d256-prod-github-runner-207 kernel: [48804.580178] ? show_regs.cold+0x8/0xd Aug 22 18:57:10 juju-e4d256-prod-github-runner-207 kernel: [48804.581230] ? watchdog_timer_fn+0x1be/0x220 Aug 22 18:57:10 juju-e4d256-prod-github-runner-207 kernel: [48804.582359] ? lockup_detector_update_enable+0x60/0x60 Aug 22 18:57:10 juju-e4d256-prod-github-runner-207 kernel: [48804.583490] ? __hrtimer_run_queues+0x107/0x230 Aug 22 18:57:10 juju-e4d256-prod-github-runner-207 kernel: [48804.584557] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 18:57:10 juju-e4d256-prod-github-runner-207 kernel: [48804.585646] ? hrtimer_interrupt+0x101/0x220 Aug 22 18:57:10 juju-e4d256-prod-github-runner-207 kernel: [48804.586707] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 18:57:10 juju-e4d256-prod-github-runner-207 kernel: [48804.587824] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 18:57:10 juju-e4d256-prod-github-runner-207 kernel: [48804.588920] Aug 22 18:57:10 juju-e4d256-prod-github-runner-207 kernel: [48804.589828] Aug 22 18:57:10 juju-e4d256-prod-github-runner-207 kernel: [48804.590717] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 18:57:10 juju-e4d256-prod-github-runner-207 kernel: [48804.591809] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:57:10 juju-e4d256-prod-github-runner-207 kernel: [48804.592930] ? _raw_spin_lock+0x22/0x30 Aug 22 18:57:10 juju-e4d256-prod-github-runner-207 kernel: [48804.593916] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:57:10 juju-e4d256-prod-github-runner-207 kernel: [48804.594964] direct_page_fault+0x206/0x310 [kvm] Aug 22 18:57:10 juju-e4d256-prod-github-runner-207 kernel: [48804.596004] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 18:57:10 juju-e4d256-prod-github-runner-207 kernel: [48804.597067] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 18:57:10 juju-e4d256-prod-github-runner-207 kernel: [48804.598083] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 18:57:10 juju-e4d256-prod-github-runner-207 kernel: [48804.599103] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 18:57:10 juju-e4d256-prod-github-runner-207 kernel: [48804.600068] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 18:57:10 juju-e4d256-prod-github-runner-207 kernel: [48804.601138] handle_exit+0x98/0x230 [kvm_amd] Aug 22 18:57:10 juju-e4d256-prod-github-runner-207 kernel: [48804.602096] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 18:57:10 juju-e4d256-prod-github-runner-207 kernel: [48804.603026] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 18:57:10 juju-e4d256-prod-github-runner-207 kernel: [48804.603952] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 18:57:10 juju-e4d256-prod-github-runner-207 kernel: [48804.604884] vcpu_run+0x62/0x2c0 [kvm] Aug 22 18:57:10 juju-e4d256-prod-github-runner-207 kernel: [48804.605697] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 18:57:10 juju-e4d256-prod-github-runner-207 kernel: [48804.606510] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 18:57:10 juju-e4d256-prod-github-runner-207 kernel: [48804.607366] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 18:57:10 juju-e4d256-prod-github-runner-207 kernel: [48804.608165] ? __seccomp_filter+0x4a/0x4a0 Aug 22 18:57:10 juju-e4d256-prod-github-runner-207 kernel: [48804.608933] ? __fget_files+0x86/0xc0 Aug 22 18:57:10 juju-e4d256-prod-github-runner-207 kernel: [48804.609850] __x64_sys_ioctl+0x95/0xd0 Aug 22 18:57:10 juju-e4d256-prod-github-runner-207 kernel: [48804.610553] do_syscall_64+0x5c/0xc0 Aug 22 18:57:10 juju-e4d256-prod-github-runner-207 kernel: [48804.611245] ? do_futex+0x162/0x1f0 Aug 22 18:57:10 juju-e4d256-prod-github-runner-207 kernel: [48804.612089] ? __x64_sys_futex+0x78/0x1e0 Aug 22 18:57:10 juju-e4d256-prod-github-runner-207 kernel: [48804.612793] ? __secure_computing+0xa9/0x120 Aug 22 18:57:10 juju-e4d256-prod-github-runner-207 kernel: [48804.613488] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 18:57:10 juju-e4d256-prod-github-runner-207 kernel: [48804.614272] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:57:10 juju-e4d256-prod-github-runner-207 kernel: [48804.615002] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:57:10 juju-e4d256-prod-github-runner-207 kernel: [48804.615726] ? do_syscall_64+0x69/0xc0 Aug 22 18:57:10 juju-e4d256-prod-github-runner-207 kernel: [48804.616376] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:57:10 juju-e4d256-prod-github-runner-207 kernel: [48804.617099] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:57:10 juju-e4d256-prod-github-runner-207 kernel: [48804.617799] ? do_syscall_64+0x69/0xc0 Aug 22 18:57:10 juju-e4d256-prod-github-runner-207 kernel: [48804.618423] ? do_syscall_64+0x69/0xc0 Aug 22 18:57:10 juju-e4d256-prod-github-runner-207 kernel: [48804.619046] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 18:57:10 juju-e4d256-prod-github-runner-207 kernel: [48804.619751] RIP: 0033:0x7faa5d0edaff Aug 22 18:57:10 juju-e4d256-prod-github-runner-207 kernel: [48804.620423] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 18:57:10 juju-e4d256-prod-github-runner-207 kernel: [48804.622468] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 18:57:10 juju-e4d256-prod-github-runner-207 kernel: [48804.623394] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 18:57:10 juju-e4d256-prod-github-runner-207 kernel: [48804.624297] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 18:57:10 juju-e4d256-prod-github-runner-207 kernel: [48804.625206] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 18:57:10 juju-e4d256-prod-github-runner-207 kernel: [48804.626146] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 18:57:10 juju-e4d256-prod-github-runner-207 kernel: [48804.627067] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 18:57:10 juju-e4d256-prod-github-runner-207 kernel: [48804.627963] Aug 22 18:57:38 juju-e4d256-prod-github-runner-207 kernel: [48832.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 45370s! [qemu-system-x86:6715] Aug 22 18:57:38 juju-e4d256-prod-github-runner-207 kernel: [48832.543311] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 18:57:38 juju-e4d256-prod-github-runner-207 kernel: [48832.543387] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 18:57:38 juju-e4d256-prod-github-runner-207 kernel: [48832.556100] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 18:57:38 juju-e4d256-prod-github-runner-207 kernel: [48832.557403] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 18:57:38 juju-e4d256-prod-github-runner-207 kernel: [48832.558657] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:57:38 juju-e4d256-prod-github-runner-207 kernel: [48832.559738] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 18:57:38 juju-e4d256-prod-github-runner-207 kernel: [48832.562349] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 18:57:38 juju-e4d256-prod-github-runner-207 kernel: [48832.563413] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 18:57:38 juju-e4d256-prod-github-runner-207 kernel: [48832.564616] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 18:57:38 juju-e4d256-prod-github-runner-207 kernel: [48832.565802] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 18:57:38 juju-e4d256-prod-github-runner-207 kernel: [48832.566980] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 18:57:38 juju-e4d256-prod-github-runner-207 kernel: [48832.568181] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 18:57:38 juju-e4d256-prod-github-runner-207 kernel: [48832.569423] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 18:57:38 juju-e4d256-prod-github-runner-207 kernel: [48832.570703] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 18:57:38 juju-e4d256-prod-github-runner-207 kernel: [48832.571818] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 18:57:38 juju-e4d256-prod-github-runner-207 kernel: [48832.573057] Call Trace: Aug 22 18:57:38 juju-e4d256-prod-github-runner-207 kernel: [48832.573980] Aug 22 18:57:38 juju-e4d256-prod-github-runner-207 kernel: [48832.574869] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:57:38 juju-e4d256-prod-github-runner-207 kernel: [48832.575910] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:57:38 juju-e4d256-prod-github-runner-207 kernel: [48832.576951] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:57:38 juju-e4d256-prod-github-runner-207 kernel: [48832.578038] ? show_regs.part.0+0x23/0x29 Aug 22 18:57:38 juju-e4d256-prod-github-runner-207 kernel: [48832.579052] ? show_regs.cold+0x8/0xd Aug 22 18:57:38 juju-e4d256-prod-github-runner-207 kernel: [48832.580222] ? watchdog_timer_fn+0x1be/0x220 Aug 22 18:57:38 juju-e4d256-prod-github-runner-207 kernel: [48832.581251] ? lockup_detector_update_enable+0x60/0x60 Aug 22 18:57:38 juju-e4d256-prod-github-runner-207 kernel: [48832.582330] ? __hrtimer_run_queues+0x107/0x230 Aug 22 18:57:38 juju-e4d256-prod-github-runner-207 kernel: [48832.583527] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 18:57:38 juju-e4d256-prod-github-runner-207 kernel: [48832.584573] ? hrtimer_interrupt+0x101/0x220 Aug 22 18:57:38 juju-e4d256-prod-github-runner-207 kernel: [48832.585609] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 18:57:38 juju-e4d256-prod-github-runner-207 kernel: [48832.586716] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 18:57:38 juju-e4d256-prod-github-runner-207 kernel: [48832.587789] Aug 22 18:57:38 juju-e4d256-prod-github-runner-207 kernel: [48832.588664] Aug 22 18:57:38 juju-e4d256-prod-github-runner-207 kernel: [48832.589507] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 18:57:38 juju-e4d256-prod-github-runner-207 kernel: [48832.590562] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:57:38 juju-e4d256-prod-github-runner-207 kernel: [48832.591626] ? _raw_spin_lock+0x22/0x30 Aug 22 18:57:38 juju-e4d256-prod-github-runner-207 kernel: [48832.592595] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:57:38 juju-e4d256-prod-github-runner-207 kernel: [48832.593631] direct_page_fault+0x206/0x310 [kvm] Aug 22 18:57:38 juju-e4d256-prod-github-runner-207 kernel: [48832.594667] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 18:57:38 juju-e4d256-prod-github-runner-207 kernel: [48832.595692] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 18:57:38 juju-e4d256-prod-github-runner-207 kernel: [48832.596713] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 18:57:38 juju-e4d256-prod-github-runner-207 kernel: [48832.597706] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 18:57:38 juju-e4d256-prod-github-runner-207 kernel: [48832.598676] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 18:57:38 juju-e4d256-prod-github-runner-207 kernel: [48832.599682] handle_exit+0x98/0x230 [kvm_amd] Aug 22 18:57:38 juju-e4d256-prod-github-runner-207 kernel: [48832.600639] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 18:57:38 juju-e4d256-prod-github-runner-207 kernel: [48832.601597] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 18:57:38 juju-e4d256-prod-github-runner-207 kernel: [48832.602545] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 18:57:38 juju-e4d256-prod-github-runner-207 kernel: [48832.603466] vcpu_run+0x62/0x2c0 [kvm] Aug 22 18:57:38 juju-e4d256-prod-github-runner-207 kernel: [48832.604317] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 18:57:38 juju-e4d256-prod-github-runner-207 kernel: [48832.605144] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 18:57:38 juju-e4d256-prod-github-runner-207 kernel: [48832.606022] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 18:57:38 juju-e4d256-prod-github-runner-207 kernel: [48832.606836] ? __seccomp_filter+0x4a/0x4a0 Aug 22 18:57:38 juju-e4d256-prod-github-runner-207 kernel: [48832.607595] ? __fget_files+0x86/0xc0 Aug 22 18:57:38 juju-e4d256-prod-github-runner-207 kernel: [48832.608332] __x64_sys_ioctl+0x95/0xd0 Aug 22 18:57:38 juju-e4d256-prod-github-runner-207 kernel: [48832.609043] do_syscall_64+0x5c/0xc0 Aug 22 18:57:38 juju-e4d256-prod-github-runner-207 kernel: [48832.609729] ? do_futex+0x162/0x1f0 Aug 22 18:57:38 juju-e4d256-prod-github-runner-207 kernel: [48832.610390] ? __x64_sys_futex+0x78/0x1e0 Aug 22 18:57:38 juju-e4d256-prod-github-runner-207 kernel: [48832.611079] ? __secure_computing+0xa9/0x120 Aug 22 18:57:38 juju-e4d256-prod-github-runner-207 kernel: [48832.611806] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 18:57:38 juju-e4d256-prod-github-runner-207 kernel: [48832.612615] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:57:38 juju-e4d256-prod-github-runner-207 kernel: [48832.613358] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:57:38 juju-e4d256-prod-github-runner-207 kernel: [48832.614090] ? do_syscall_64+0x69/0xc0 Aug 22 18:57:38 juju-e4d256-prod-github-runner-207 kernel: [48832.614750] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:57:38 juju-e4d256-prod-github-runner-207 kernel: [48832.615466] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:57:38 juju-e4d256-prod-github-runner-207 kernel: [48832.616186] ? do_syscall_64+0x69/0xc0 Aug 22 18:57:38 juju-e4d256-prod-github-runner-207 kernel: [48832.616828] ? do_syscall_64+0x69/0xc0 Aug 22 18:57:38 juju-e4d256-prod-github-runner-207 kernel: [48832.617465] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 18:57:38 juju-e4d256-prod-github-runner-207 kernel: [48832.618207] RIP: 0033:0x7faa5d0edaff Aug 22 18:57:38 juju-e4d256-prod-github-runner-207 kernel: [48832.618885] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 18:57:38 juju-e4d256-prod-github-runner-207 kernel: [48832.620948] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 18:57:38 juju-e4d256-prod-github-runner-207 kernel: [48832.621887] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 18:57:38 juju-e4d256-prod-github-runner-207 kernel: [48832.622817] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 18:57:38 juju-e4d256-prod-github-runner-207 kernel: [48832.623732] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 18:57:38 juju-e4d256-prod-github-runner-207 kernel: [48832.624657] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 18:57:38 juju-e4d256-prod-github-runner-207 kernel: [48832.625570] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 18:57:38 juju-e4d256-prod-github-runner-207 kernel: [48832.626482] Aug 22 18:58:06 juju-e4d256-prod-github-runner-207 kernel: [48860.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 45396s! [qemu-system-x86:6715] Aug 22 18:58:06 juju-e4d256-prod-github-runner-207 kernel: [48860.543101] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 18:58:06 juju-e4d256-prod-github-runner-207 kernel: [48860.543176] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 18:58:06 juju-e4d256-prod-github-runner-207 kernel: [48860.555239] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 18:58:06 juju-e4d256-prod-github-runner-207 kernel: [48860.556509] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 18:58:06 juju-e4d256-prod-github-runner-207 kernel: [48860.557739] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:58:06 juju-e4d256-prod-github-runner-207 kernel: [48860.558797] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 18:58:06 juju-e4d256-prod-github-runner-207 kernel: [48860.561365] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 18:58:06 juju-e4d256-prod-github-runner-207 kernel: [48860.562408] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 18:58:06 juju-e4d256-prod-github-runner-207 kernel: [48860.563570] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 18:58:06 juju-e4d256-prod-github-runner-207 kernel: [48860.564761] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 18:58:06 juju-e4d256-prod-github-runner-207 kernel: [48860.565917] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 18:58:06 juju-e4d256-prod-github-runner-207 kernel: [48860.567158] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 18:58:06 juju-e4d256-prod-github-runner-207 kernel: [48860.568926] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 18:58:06 juju-e4d256-prod-github-runner-207 kernel: [48860.571002] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 18:58:06 juju-e4d256-prod-github-runner-207 kernel: [48860.572886] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 18:58:06 juju-e4d256-prod-github-runner-207 kernel: [48860.574796] Call Trace: Aug 22 18:58:06 juju-e4d256-prod-github-runner-207 kernel: [48860.576130] Aug 22 18:58:06 juju-e4d256-prod-github-runner-207 kernel: [48860.577598] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:58:06 juju-e4d256-prod-github-runner-207 kernel: [48860.579247] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:58:06 juju-e4d256-prod-github-runner-207 kernel: [48860.580726] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:58:06 juju-e4d256-prod-github-runner-207 kernel: [48860.582258] ? show_regs.part.0+0x23/0x29 Aug 22 18:58:06 juju-e4d256-prod-github-runner-207 kernel: [48860.583621] ? show_regs.cold+0x8/0xd Aug 22 18:58:06 juju-e4d256-prod-github-runner-207 kernel: [48860.584681] ? watchdog_timer_fn+0x1be/0x220 Aug 22 18:58:06 juju-e4d256-prod-github-runner-207 kernel: [48860.585688] ? lockup_detector_update_enable+0x60/0x60 Aug 22 18:58:06 juju-e4d256-prod-github-runner-207 kernel: [48860.586749] ? __hrtimer_run_queues+0x107/0x230 Aug 22 18:58:06 juju-e4d256-prod-github-runner-207 kernel: [48860.587793] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 18:58:06 juju-e4d256-prod-github-runner-207 kernel: [48860.588817] ? hrtimer_interrupt+0x101/0x220 Aug 22 18:58:06 juju-e4d256-prod-github-runner-207 kernel: [48860.589842] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 18:58:06 juju-e4d256-prod-github-runner-207 kernel: [48860.590909] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 18:58:06 juju-e4d256-prod-github-runner-207 kernel: [48860.591959] Aug 22 18:58:06 juju-e4d256-prod-github-runner-207 kernel: [48860.592830] Aug 22 18:58:06 juju-e4d256-prod-github-runner-207 kernel: [48860.593672] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 18:58:06 juju-e4d256-prod-github-runner-207 kernel: [48860.594703] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:58:06 juju-e4d256-prod-github-runner-207 kernel: [48860.595772] ? _raw_spin_lock+0x22/0x30 Aug 22 18:58:06 juju-e4d256-prod-github-runner-207 kernel: [48860.596735] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:58:06 juju-e4d256-prod-github-runner-207 kernel: [48860.597749] direct_page_fault+0x206/0x310 [kvm] Aug 22 18:58:06 juju-e4d256-prod-github-runner-207 kernel: [48860.598771] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 18:58:06 juju-e4d256-prod-github-runner-207 kernel: [48860.599798] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 18:58:06 juju-e4d256-prod-github-runner-207 kernel: [48860.600798] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 18:58:06 juju-e4d256-prod-github-runner-207 kernel: [48860.601772] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 18:58:06 juju-e4d256-prod-github-runner-207 kernel: [48860.602723] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 18:58:06 juju-e4d256-prod-github-runner-207 kernel: [48860.603709] handle_exit+0x98/0x230 [kvm_amd] Aug 22 18:58:06 juju-e4d256-prod-github-runner-207 kernel: [48860.604601] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 18:58:06 juju-e4d256-prod-github-runner-207 kernel: [48860.605521] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 18:58:06 juju-e4d256-prod-github-runner-207 kernel: [48860.606443] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 18:58:06 juju-e4d256-prod-github-runner-207 kernel: [48860.607344] vcpu_run+0x62/0x2c0 [kvm] Aug 22 18:58:06 juju-e4d256-prod-github-runner-207 kernel: [48860.608155] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 18:58:06 juju-e4d256-prod-github-runner-207 kernel: [48860.608968] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 18:58:06 juju-e4d256-prod-github-runner-207 kernel: [48860.609820] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 18:58:06 juju-e4d256-prod-github-runner-207 kernel: [48860.610617] ? __seccomp_filter+0x4a/0x4a0 Aug 22 18:58:06 juju-e4d256-prod-github-runner-207 kernel: [48860.611362] ? __fget_files+0x86/0xc0 Aug 22 18:58:06 juju-e4d256-prod-github-runner-207 kernel: [48860.612074] __x64_sys_ioctl+0x95/0xd0 Aug 22 18:58:06 juju-e4d256-prod-github-runner-207 kernel: [48860.612765] do_syscall_64+0x5c/0xc0 Aug 22 18:58:06 juju-e4d256-prod-github-runner-207 kernel: [48860.613428] ? do_futex+0x162/0x1f0 Aug 22 18:58:06 juju-e4d256-prod-github-runner-207 kernel: [48860.614075] ? __x64_sys_futex+0x78/0x1e0 Aug 22 18:58:06 juju-e4d256-prod-github-runner-207 kernel: [48860.614748] ? __secure_computing+0xa9/0x120 Aug 22 18:58:06 juju-e4d256-prod-github-runner-207 kernel: [48860.615439] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 18:58:06 juju-e4d256-prod-github-runner-207 kernel: [48860.616210] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:58:06 juju-e4d256-prod-github-runner-207 kernel: [48860.616929] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:58:06 juju-e4d256-prod-github-runner-207 kernel: [48860.617644] ? do_syscall_64+0x69/0xc0 Aug 22 18:58:06 juju-e4d256-prod-github-runner-207 kernel: [48860.618292] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:58:06 juju-e4d256-prod-github-runner-207 kernel: [48860.618992] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:58:06 juju-e4d256-prod-github-runner-207 kernel: [48860.619684] ? do_syscall_64+0x69/0xc0 Aug 22 18:58:06 juju-e4d256-prod-github-runner-207 kernel: [48860.620313] ? do_syscall_64+0x69/0xc0 Aug 22 18:58:06 juju-e4d256-prod-github-runner-207 kernel: [48860.620949] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 18:58:06 juju-e4d256-prod-github-runner-207 kernel: [48860.621651] RIP: 0033:0x7faa5d0edaff Aug 22 18:58:06 juju-e4d256-prod-github-runner-207 kernel: [48860.622273] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 18:58:06 juju-e4d256-prod-github-runner-207 kernel: [48860.624251] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 18:58:06 juju-e4d256-prod-github-runner-207 kernel: [48860.625165] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 18:58:06 juju-e4d256-prod-github-runner-207 kernel: [48860.626056] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 18:58:06 juju-e4d256-prod-github-runner-207 kernel: [48860.626940] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 18:58:06 juju-e4d256-prod-github-runner-207 kernel: [48860.627829] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 18:58:06 juju-e4d256-prod-github-runner-207 kernel: [48860.628719] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 18:58:06 juju-e4d256-prod-github-runner-207 kernel: [48860.629907] Aug 22 18:58:34 juju-e4d256-prod-github-runner-207 kernel: [48888.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 45423s! [qemu-system-x86:6715] Aug 22 18:58:34 juju-e4d256-prod-github-runner-207 kernel: [48888.544517] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 18:58:34 juju-e4d256-prod-github-runner-207 kernel: [48888.544890] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 18:58:34 juju-e4d256-prod-github-runner-207 kernel: [48888.557807] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 18:58:34 juju-e4d256-prod-github-runner-207 kernel: [48888.559083] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 18:58:34 juju-e4d256-prod-github-runner-207 kernel: [48888.560364] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:58:34 juju-e4d256-prod-github-runner-207 kernel: [48888.561449] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 18:58:34 juju-e4d256-prod-github-runner-207 kernel: [48888.564038] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 18:58:34 juju-e4d256-prod-github-runner-207 kernel: [48888.565114] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 18:58:34 juju-e4d256-prod-github-runner-207 kernel: [48888.566284] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 18:58:34 juju-e4d256-prod-github-runner-207 kernel: [48888.567479] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 18:58:34 juju-e4d256-prod-github-runner-207 kernel: [48888.568642] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 18:58:34 juju-e4d256-prod-github-runner-207 kernel: [48888.569816] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 18:58:34 juju-e4d256-prod-github-runner-207 kernel: [48888.571016] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 18:58:34 juju-e4d256-prod-github-runner-207 kernel: [48888.572288] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 18:58:34 juju-e4d256-prod-github-runner-207 kernel: [48888.573424] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 18:58:34 juju-e4d256-prod-github-runner-207 kernel: [48888.574730] Call Trace: Aug 22 18:58:34 juju-e4d256-prod-github-runner-207 kernel: [48888.575690] Aug 22 18:58:34 juju-e4d256-prod-github-runner-207 kernel: [48888.576605] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:58:34 juju-e4d256-prod-github-runner-207 kernel: [48888.577695] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:58:34 juju-e4d256-prod-github-runner-207 kernel: [48888.578723] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:58:34 juju-e4d256-prod-github-runner-207 kernel: [48888.579861] ? show_regs.part.0+0x23/0x29 Aug 22 18:58:34 juju-e4d256-prod-github-runner-207 kernel: [48888.580863] ? show_regs.cold+0x8/0xd Aug 22 18:58:34 juju-e4d256-prod-github-runner-207 kernel: [48888.581838] ? watchdog_timer_fn+0x1be/0x220 Aug 22 18:58:34 juju-e4d256-prod-github-runner-207 kernel: [48888.582863] ? lockup_detector_update_enable+0x60/0x60 Aug 22 18:58:34 juju-e4d256-prod-github-runner-207 kernel: [48888.583967] ? __hrtimer_run_queues+0x107/0x230 Aug 22 18:58:34 juju-e4d256-prod-github-runner-207 kernel: [48888.585024] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 18:58:34 juju-e4d256-prod-github-runner-207 kernel: [48888.586058] ? hrtimer_interrupt+0x101/0x220 Aug 22 18:58:34 juju-e4d256-prod-github-runner-207 kernel: [48888.587073] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 18:58:34 juju-e4d256-prod-github-runner-207 kernel: [48888.588208] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 18:58:34 juju-e4d256-prod-github-runner-207 kernel: [48888.589334] Aug 22 18:58:34 juju-e4d256-prod-github-runner-207 kernel: [48888.590520] Aug 22 18:58:34 juju-e4d256-prod-github-runner-207 kernel: [48888.591493] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 18:58:34 juju-e4d256-prod-github-runner-207 kernel: [48888.592626] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:58:34 juju-e4d256-prod-github-runner-207 kernel: [48888.593682] ? _raw_spin_lock+0x22/0x30 Aug 22 18:58:34 juju-e4d256-prod-github-runner-207 kernel: [48888.594649] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:58:34 juju-e4d256-prod-github-runner-207 kernel: [48888.595736] direct_page_fault+0x206/0x310 [kvm] Aug 22 18:58:34 juju-e4d256-prod-github-runner-207 kernel: [48888.596797] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 18:58:34 juju-e4d256-prod-github-runner-207 kernel: [48888.597838] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 18:58:34 juju-e4d256-prod-github-runner-207 kernel: [48888.598848] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 18:58:34 juju-e4d256-prod-github-runner-207 kernel: [48888.599886] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 18:58:34 juju-e4d256-prod-github-runner-207 kernel: [48888.600848] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 18:58:34 juju-e4d256-prod-github-runner-207 kernel: [48888.601844] handle_exit+0x98/0x230 [kvm_amd] Aug 22 18:58:34 juju-e4d256-prod-github-runner-207 kernel: [48888.602746] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 18:58:34 juju-e4d256-prod-github-runner-207 kernel: [48888.603766] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 18:58:34 juju-e4d256-prod-github-runner-207 kernel: [48888.604757] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 18:58:34 juju-e4d256-prod-github-runner-207 kernel: [48888.605825] vcpu_run+0x62/0x2c0 [kvm] Aug 22 18:58:34 juju-e4d256-prod-github-runner-207 kernel: [48888.606668] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 18:58:34 juju-e4d256-prod-github-runner-207 kernel: [48888.607546] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 18:58:34 juju-e4d256-prod-github-runner-207 kernel: [48888.608402] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 18:58:34 juju-e4d256-prod-github-runner-207 kernel: [48888.609215] ? __seccomp_filter+0x4a/0x4a0 Aug 22 18:58:34 juju-e4d256-prod-github-runner-207 kernel: [48888.609965] ? __fget_files+0x86/0xc0 Aug 22 18:58:34 juju-e4d256-prod-github-runner-207 kernel: [48888.610704] __x64_sys_ioctl+0x95/0xd0 Aug 22 18:58:34 juju-e4d256-prod-github-runner-207 kernel: [48888.611427] do_syscall_64+0x5c/0xc0 Aug 22 18:58:34 juju-e4d256-prod-github-runner-207 kernel: [48888.612109] ? do_futex+0x162/0x1f0 Aug 22 18:58:34 juju-e4d256-prod-github-runner-207 kernel: [48888.612820] ? __x64_sys_futex+0x78/0x1e0 Aug 22 18:58:34 juju-e4d256-prod-github-runner-207 kernel: [48888.613712] ? __secure_computing+0xa9/0x120 Aug 22 18:58:34 juju-e4d256-prod-github-runner-207 kernel: [48888.614637] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 18:58:34 juju-e4d256-prod-github-runner-207 kernel: [48888.615479] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:58:34 juju-e4d256-prod-github-runner-207 kernel: [48888.616264] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:58:34 juju-e4d256-prod-github-runner-207 kernel: [48888.617062] ? do_syscall_64+0x69/0xc0 Aug 22 18:58:34 juju-e4d256-prod-github-runner-207 kernel: [48888.617748] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:58:34 juju-e4d256-prod-github-runner-207 kernel: [48888.618485] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:58:34 juju-e4d256-prod-github-runner-207 kernel: [48888.619225] ? do_syscall_64+0x69/0xc0 Aug 22 18:58:34 juju-e4d256-prod-github-runner-207 kernel: [48888.619928] ? do_syscall_64+0x69/0xc0 Aug 22 18:58:34 juju-e4d256-prod-github-runner-207 kernel: [48888.620585] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 18:58:34 juju-e4d256-prod-github-runner-207 kernel: [48888.621323] RIP: 0033:0x7faa5d0edaff Aug 22 18:58:34 juju-e4d256-prod-github-runner-207 kernel: [48888.622032] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 18:58:34 juju-e4d256-prod-github-runner-207 kernel: [48888.624110] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 18:58:34 juju-e4d256-prod-github-runner-207 kernel: [48888.625064] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 18:58:34 juju-e4d256-prod-github-runner-207 kernel: [48888.625998] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 18:58:34 juju-e4d256-prod-github-runner-207 kernel: [48888.626915] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 18:58:34 juju-e4d256-prod-github-runner-207 kernel: [48888.627852] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 18:58:34 juju-e4d256-prod-github-runner-207 kernel: [48888.628770] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 18:58:34 juju-e4d256-prod-github-runner-207 kernel: [48888.629696] Aug 22 18:59:02 juju-e4d256-prod-github-runner-207 kernel: [48916.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 45449s! [qemu-system-x86:6715] Aug 22 18:59:02 juju-e4d256-prod-github-runner-207 kernel: [48916.543865] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 18:59:02 juju-e4d256-prod-github-runner-207 kernel: [48916.544152] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 18:59:02 juju-e4d256-prod-github-runner-207 kernel: [48916.556528] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 18:59:02 juju-e4d256-prod-github-runner-207 kernel: [48916.558069] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 18:59:02 juju-e4d256-prod-github-runner-207 kernel: [48916.559527] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:59:02 juju-e4d256-prod-github-runner-207 kernel: [48916.560597] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 18:59:02 juju-e4d256-prod-github-runner-207 kernel: [48916.563225] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 18:59:02 juju-e4d256-prod-github-runner-207 kernel: [48916.564295] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 18:59:02 juju-e4d256-prod-github-runner-207 kernel: [48916.565480] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 18:59:02 juju-e4d256-prod-github-runner-207 kernel: [48916.566845] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 18:59:02 juju-e4d256-prod-github-runner-207 kernel: [48916.568050] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 18:59:02 juju-e4d256-prod-github-runner-207 kernel: [48916.569225] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 18:59:02 juju-e4d256-prod-github-runner-207 kernel: [48916.570411] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 18:59:02 juju-e4d256-prod-github-runner-207 kernel: [48916.571758] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 18:59:02 juju-e4d256-prod-github-runner-207 kernel: [48916.572928] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 18:59:02 juju-e4d256-prod-github-runner-207 kernel: [48916.574166] Call Trace: Aug 22 18:59:02 juju-e4d256-prod-github-runner-207 kernel: [48916.575305] Aug 22 18:59:02 juju-e4d256-prod-github-runner-207 kernel: [48916.576218] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:59:02 juju-e4d256-prod-github-runner-207 kernel: [48916.577266] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:59:02 juju-e4d256-prod-github-runner-207 kernel: [48916.578343] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:59:02 juju-e4d256-prod-github-runner-207 kernel: [48916.579507] ? show_regs.part.0+0x23/0x29 Aug 22 18:59:02 juju-e4d256-prod-github-runner-207 kernel: [48916.580540] ? show_regs.cold+0x8/0xd Aug 22 18:59:02 juju-e4d256-prod-github-runner-207 kernel: [48916.581554] ? watchdog_timer_fn+0x1be/0x220 Aug 22 18:59:02 juju-e4d256-prod-github-runner-207 kernel: [48916.582599] ? lockup_detector_update_enable+0x60/0x60 Aug 22 18:59:02 juju-e4d256-prod-github-runner-207 kernel: [48916.583819] ? __hrtimer_run_queues+0x107/0x230 Aug 22 18:59:02 juju-e4d256-prod-github-runner-207 kernel: [48916.584979] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 18:59:02 juju-e4d256-prod-github-runner-207 kernel: [48916.586214] ? hrtimer_interrupt+0x101/0x220 Aug 22 18:59:02 juju-e4d256-prod-github-runner-207 kernel: [48916.587319] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 18:59:02 juju-e4d256-prod-github-runner-207 kernel: [48916.588429] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 18:59:02 juju-e4d256-prod-github-runner-207 kernel: [48916.589542] Aug 22 18:59:02 juju-e4d256-prod-github-runner-207 kernel: [48916.590410] Aug 22 18:59:02 juju-e4d256-prod-github-runner-207 kernel: [48916.591269] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 18:59:02 juju-e4d256-prod-github-runner-207 kernel: [48916.592313] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:59:02 juju-e4d256-prod-github-runner-207 kernel: [48916.593392] ? _raw_spin_lock+0x22/0x30 Aug 22 18:59:02 juju-e4d256-prod-github-runner-207 kernel: [48916.594358] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:59:02 juju-e4d256-prod-github-runner-207 kernel: [48916.595450] direct_page_fault+0x206/0x310 [kvm] Aug 22 18:59:02 juju-e4d256-prod-github-runner-207 kernel: [48916.596496] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 18:59:02 juju-e4d256-prod-github-runner-207 kernel: [48916.597517] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 18:59:02 juju-e4d256-prod-github-runner-207 kernel: [48916.598528] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 18:59:02 juju-e4d256-prod-github-runner-207 kernel: [48916.599571] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 18:59:02 juju-e4d256-prod-github-runner-207 kernel: [48916.600529] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 18:59:02 juju-e4d256-prod-github-runner-207 kernel: [48916.601538] handle_exit+0x98/0x230 [kvm_amd] Aug 22 18:59:02 juju-e4d256-prod-github-runner-207 kernel: [48916.602444] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 18:59:02 juju-e4d256-prod-github-runner-207 kernel: [48916.603416] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 18:59:02 juju-e4d256-prod-github-runner-207 kernel: [48916.604379] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 18:59:02 juju-e4d256-prod-github-runner-207 kernel: [48916.605320] vcpu_run+0x62/0x2c0 [kvm] Aug 22 18:59:02 juju-e4d256-prod-github-runner-207 kernel: [48916.606141] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 18:59:02 juju-e4d256-prod-github-runner-207 kernel: [48916.606961] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 18:59:02 juju-e4d256-prod-github-runner-207 kernel: [48916.607863] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 18:59:02 juju-e4d256-prod-github-runner-207 kernel: [48916.608674] ? __seccomp_filter+0x4a/0x4a0 Aug 22 18:59:02 juju-e4d256-prod-github-runner-207 kernel: [48916.609425] ? __fget_files+0x86/0xc0 Aug 22 18:59:02 juju-e4d256-prod-github-runner-207 kernel: [48916.610137] __x64_sys_ioctl+0x95/0xd0 Aug 22 18:59:02 juju-e4d256-prod-github-runner-207 kernel: [48916.610843] do_syscall_64+0x5c/0xc0 Aug 22 18:59:02 juju-e4d256-prod-github-runner-207 kernel: [48916.611539] ? do_futex+0x162/0x1f0 Aug 22 18:59:02 juju-e4d256-prod-github-runner-207 kernel: [48916.612199] ? __x64_sys_futex+0x78/0x1e0 Aug 22 18:59:02 juju-e4d256-prod-github-runner-207 kernel: [48916.612878] ? __secure_computing+0xa9/0x120 Aug 22 18:59:02 juju-e4d256-prod-github-runner-207 kernel: [48916.613575] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 18:59:02 juju-e4d256-prod-github-runner-207 kernel: [48916.614371] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:59:02 juju-e4d256-prod-github-runner-207 kernel: [48916.615137] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:59:02 juju-e4d256-prod-github-runner-207 kernel: [48916.615863] ? do_syscall_64+0x69/0xc0 Aug 22 18:59:02 juju-e4d256-prod-github-runner-207 kernel: [48916.616513] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:59:02 juju-e4d256-prod-github-runner-207 kernel: [48916.617223] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:59:02 juju-e4d256-prod-github-runner-207 kernel: [48916.617930] ? do_syscall_64+0x69/0xc0 Aug 22 18:59:02 juju-e4d256-prod-github-runner-207 kernel: [48916.618561] ? do_syscall_64+0x69/0xc0 Aug 22 18:59:02 juju-e4d256-prod-github-runner-207 kernel: [48916.619208] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 18:59:02 juju-e4d256-prod-github-runner-207 kernel: [48916.619921] RIP: 0033:0x7faa5d0edaff Aug 22 18:59:02 juju-e4d256-prod-github-runner-207 kernel: [48916.620595] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 18:59:02 juju-e4d256-prod-github-runner-207 kernel: [48916.622627] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 18:59:02 juju-e4d256-prod-github-runner-207 kernel: [48916.623560] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 18:59:02 juju-e4d256-prod-github-runner-207 kernel: [48916.624461] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 18:59:02 juju-e4d256-prod-github-runner-207 kernel: [48916.625347] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 18:59:02 juju-e4d256-prod-github-runner-207 kernel: [48916.626233] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 18:59:02 juju-e4d256-prod-github-runner-207 kernel: [48916.627139] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 18:59:02 juju-e4d256-prod-github-runner-207 kernel: [48916.628037] Aug 22 18:59:30 juju-e4d256-prod-github-runner-207 kernel: [48944.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 45475s! [qemu-system-x86:6715] Aug 22 18:59:30 juju-e4d256-prod-github-runner-207 kernel: [48944.543944] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 18:59:30 juju-e4d256-prod-github-runner-207 kernel: [48944.544254] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 18:59:30 juju-e4d256-prod-github-runner-207 kernel: [48944.556935] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 18:59:30 juju-e4d256-prod-github-runner-207 kernel: [48944.558278] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 18:59:30 juju-e4d256-prod-github-runner-207 kernel: [48944.559604] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:59:30 juju-e4d256-prod-github-runner-207 kernel: [48944.560729] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 18:59:30 juju-e4d256-prod-github-runner-207 kernel: [48944.563387] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 18:59:30 juju-e4d256-prod-github-runner-207 kernel: [48944.564474] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 18:59:30 juju-e4d256-prod-github-runner-207 kernel: [48944.565680] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 18:59:30 juju-e4d256-prod-github-runner-207 kernel: [48944.567188] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 18:59:30 juju-e4d256-prod-github-runner-207 kernel: [48944.568557] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 18:59:30 juju-e4d256-prod-github-runner-207 kernel: [48944.569967] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 18:59:30 juju-e4d256-prod-github-runner-207 kernel: [48944.571395] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 18:59:30 juju-e4d256-prod-github-runner-207 kernel: [48944.572876] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 18:59:30 juju-e4d256-prod-github-runner-207 kernel: [48944.574166] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 18:59:30 juju-e4d256-prod-github-runner-207 kernel: [48944.575610] Call Trace: Aug 22 18:59:30 juju-e4d256-prod-github-runner-207 kernel: [48944.576710] Aug 22 18:59:30 juju-e4d256-prod-github-runner-207 kernel: [48944.577715] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:59:30 juju-e4d256-prod-github-runner-207 kernel: [48944.578977] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 18:59:30 juju-e4d256-prod-github-runner-207 kernel: [48944.580147] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:59:30 juju-e4d256-prod-github-runner-207 kernel: [48944.581418] ? show_regs.part.0+0x23/0x29 Aug 22 18:59:30 juju-e4d256-prod-github-runner-207 kernel: [48944.582568] ? show_regs.cold+0x8/0xd Aug 22 18:59:30 juju-e4d256-prod-github-runner-207 kernel: [48944.583693] ? watchdog_timer_fn+0x1be/0x220 Aug 22 18:59:30 juju-e4d256-prod-github-runner-207 kernel: [48944.585033] ? lockup_detector_update_enable+0x60/0x60 Aug 22 18:59:30 juju-e4d256-prod-github-runner-207 kernel: [48944.586261] ? __hrtimer_run_queues+0x107/0x230 Aug 22 18:59:30 juju-e4d256-prod-github-runner-207 kernel: [48944.587474] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 18:59:30 juju-e4d256-prod-github-runner-207 kernel: [48944.588668] ? hrtimer_interrupt+0x101/0x220 Aug 22 18:59:30 juju-e4d256-prod-github-runner-207 kernel: [48944.589871] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 18:59:30 juju-e4d256-prod-github-runner-207 kernel: [48944.591159] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 18:59:30 juju-e4d256-prod-github-runner-207 kernel: [48944.592367] Aug 22 18:59:30 juju-e4d256-prod-github-runner-207 kernel: [48944.593318] Aug 22 18:59:30 juju-e4d256-prod-github-runner-207 kernel: [48944.594247] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 18:59:30 juju-e4d256-prod-github-runner-207 kernel: [48944.595458] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:59:30 juju-e4d256-prod-github-runner-207 kernel: [48944.596696] ? _raw_spin_lock+0x22/0x30 Aug 22 18:59:30 juju-e4d256-prod-github-runner-207 kernel: [48944.597781] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:59:30 juju-e4d256-prod-github-runner-207 kernel: [48944.598982] direct_page_fault+0x206/0x310 [kvm] Aug 22 18:59:30 juju-e4d256-prod-github-runner-207 kernel: [48944.600178] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 18:59:30 juju-e4d256-prod-github-runner-207 kernel: [48944.601353] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 18:59:30 juju-e4d256-prod-github-runner-207 kernel: [48944.602514] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 18:59:30 juju-e4d256-prod-github-runner-207 kernel: [48944.603699] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 18:59:30 juju-e4d256-prod-github-runner-207 kernel: [48944.604797] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 18:59:30 juju-e4d256-prod-github-runner-207 kernel: [48944.605941] handle_exit+0x98/0x230 [kvm_amd] Aug 22 18:59:30 juju-e4d256-prod-github-runner-207 kernel: [48944.607005] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 18:59:30 juju-e4d256-prod-github-runner-207 kernel: [48944.608065] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 18:59:30 juju-e4d256-prod-github-runner-207 kernel: [48944.609164] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 18:59:30 juju-e4d256-prod-github-runner-207 kernel: [48944.610260] vcpu_run+0x62/0x2c0 [kvm] Aug 22 18:59:30 juju-e4d256-prod-github-runner-207 kernel: [48944.611210] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 18:59:30 juju-e4d256-prod-github-runner-207 kernel: [48944.612154] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 18:59:30 juju-e4d256-prod-github-runner-207 kernel: [48944.613153] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 18:59:30 juju-e4d256-prod-github-runner-207 kernel: [48944.614079] ? __seccomp_filter+0x4a/0x4a0 Aug 22 18:59:30 juju-e4d256-prod-github-runner-207 kernel: [48944.614966] ? __fget_files+0x86/0xc0 Aug 22 18:59:30 juju-e4d256-prod-github-runner-207 kernel: [48944.615802] __x64_sys_ioctl+0x95/0xd0 Aug 22 18:59:30 juju-e4d256-prod-github-runner-207 kernel: [48944.616628] do_syscall_64+0x5c/0xc0 Aug 22 18:59:30 juju-e4d256-prod-github-runner-207 kernel: [48944.617404] ? do_futex+0x162/0x1f0 Aug 22 18:59:30 juju-e4d256-prod-github-runner-207 kernel: [48944.618157] ? __x64_sys_futex+0x78/0x1e0 Aug 22 18:59:30 juju-e4d256-prod-github-runner-207 kernel: [48944.618972] ? __secure_computing+0xa9/0x120 Aug 22 18:59:30 juju-e4d256-prod-github-runner-207 kernel: [48944.619797] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 18:59:30 juju-e4d256-prod-github-runner-207 kernel: [48944.620705] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:59:30 juju-e4d256-prod-github-runner-207 kernel: [48944.621565] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:59:30 juju-e4d256-prod-github-runner-207 kernel: [48944.622429] ? do_syscall_64+0x69/0xc0 Aug 22 18:59:30 juju-e4d256-prod-github-runner-207 kernel: [48944.623211] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:59:30 juju-e4d256-prod-github-runner-207 kernel: [48944.624047] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:59:30 juju-e4d256-prod-github-runner-207 kernel: [48944.624882] ? do_syscall_64+0x69/0xc0 Aug 22 18:59:30 juju-e4d256-prod-github-runner-207 kernel: [48944.625623] ? do_syscall_64+0x69/0xc0 Aug 22 18:59:30 juju-e4d256-prod-github-runner-207 kernel: [48944.626406] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 18:59:30 juju-e4d256-prod-github-runner-207 kernel: [48944.627282] RIP: 0033:0x7faa5d0edaff Aug 22 18:59:30 juju-e4d256-prod-github-runner-207 kernel: [48944.628068] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 18:59:30 juju-e4d256-prod-github-runner-207 kernel: [48944.630489] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 18:59:30 juju-e4d256-prod-github-runner-207 kernel: [48944.631593] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 18:59:30 juju-e4d256-prod-github-runner-207 kernel: [48944.632657] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 18:59:30 juju-e4d256-prod-github-runner-207 kernel: [48944.633741] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 18:59:30 juju-e4d256-prod-github-runner-207 kernel: [48944.634812] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 18:59:30 juju-e4d256-prod-github-runner-207 kernel: [48944.635866] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 18:59:30 juju-e4d256-prod-github-runner-207 kernel: [48944.636926] Aug 22 18:59:46 juju-e4d256-prod-github-runner-207 kernel: [48960.452709] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 18:59:46 juju-e4d256-prod-github-runner-207 kernel: [48960.454445] rcu: 1-....: (12172415 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=5885985 Aug 22 18:59:46 juju-e4d256-prod-github-runner-207 kernel: [48960.455590] (t=12210813 jiffies g=23269 q=46857) Aug 22 18:59:46 juju-e4d256-prod-github-runner-207 kernel: [48960.456413] NMI backtrace for cpu 1 Aug 22 18:59:46 juju-e4d256-prod-github-runner-207 kernel: [48960.457131] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 18:59:46 juju-e4d256-prod-github-runner-207 kernel: [48960.458258] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 18:59:46 juju-e4d256-prod-github-runner-207 kernel: [48960.459349] Call Trace: Aug 22 18:59:46 juju-e4d256-prod-github-runner-207 kernel: [48960.460031] Aug 22 18:59:46 juju-e4d256-prod-github-runner-207 kernel: [48960.460690] show_stack+0x52/0x5c Aug 22 18:59:46 juju-e4d256-prod-github-runner-207 kernel: [48960.461420] dump_stack_lvl+0x4a/0x63 Aug 22 18:59:46 juju-e4d256-prod-github-runner-207 kernel: [48960.462179] dump_stack+0x10/0x16 Aug 22 18:59:46 juju-e4d256-prod-github-runner-207 kernel: [48960.462976] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 18:59:46 juju-e4d256-prod-github-runner-207 kernel: [48960.463777] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 18:59:46 juju-e4d256-prod-github-runner-207 kernel: [48960.464594] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 18:59:46 juju-e4d256-prod-github-runner-207 kernel: [48960.465434] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 18:59:46 juju-e4d256-prod-github-runner-207 kernel: [48960.466282] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 18:59:46 juju-e4d256-prod-github-runner-207 kernel: [48960.467115] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 18:59:46 juju-e4d256-prod-github-runner-207 kernel: [48960.467900] print_cpu_stall.cold+0x2f/0xe2 Aug 22 18:59:46 juju-e4d256-prod-github-runner-207 kernel: [48960.468665] ? timekeeping_update+0xf7/0x150 Aug 22 18:59:46 juju-e4d256-prod-github-runner-207 kernel: [48960.469437] check_cpu_stall+0x109/0x270 Aug 22 18:59:46 juju-e4d256-prod-github-runner-207 kernel: [48960.470190] rcu_sched_clock_irq+0x9a/0x250 Aug 22 18:59:46 juju-e4d256-prod-github-runner-207 kernel: [48960.470966] update_process_times+0x94/0xd0 Aug 22 18:59:46 juju-e4d256-prod-github-runner-207 kernel: [48960.471748] tick_sched_handle+0x29/0x70 Aug 22 18:59:46 juju-e4d256-prod-github-runner-207 kernel: [48960.472512] tick_sched_timer+0x8c/0xc0 Aug 22 18:59:46 juju-e4d256-prod-github-runner-207 kernel: [48960.473252] ? tick_nohz_handler+0xb0/0xb0 Aug 22 18:59:46 juju-e4d256-prod-github-runner-207 kernel: [48960.474012] __hrtimer_run_queues+0x107/0x230 Aug 22 18:59:46 juju-e4d256-prod-github-runner-207 kernel: [48960.474805] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 18:59:46 juju-e4d256-prod-github-runner-207 kernel: [48960.475581] hrtimer_interrupt+0x101/0x220 Aug 22 18:59:46 juju-e4d256-prod-github-runner-207 kernel: [48960.476340] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 18:59:46 juju-e4d256-prod-github-runner-207 kernel: [48960.477154] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 18:59:46 juju-e4d256-prod-github-runner-207 kernel: [48960.477955] Aug 22 18:59:46 juju-e4d256-prod-github-runner-207 kernel: [48960.478596] Aug 22 18:59:46 juju-e4d256-prod-github-runner-207 kernel: [48960.479224] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 18:59:46 juju-e4d256-prod-github-runner-207 kernel: [48960.480258] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 18:59:46 juju-e4d256-prod-github-runner-207 kernel: [48960.481175] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 18:59:46 juju-e4d256-prod-github-runner-207 kernel: [48960.483452] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 18:59:46 juju-e4d256-prod-github-runner-207 kernel: [48960.484330] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 18:59:46 juju-e4d256-prod-github-runner-207 kernel: [48960.485449] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 18:59:46 juju-e4d256-prod-github-runner-207 kernel: [48960.486447] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 18:59:46 juju-e4d256-prod-github-runner-207 kernel: [48960.487532] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 18:59:46 juju-e4d256-prod-github-runner-207 kernel: [48960.488499] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 18:59:46 juju-e4d256-prod-github-runner-207 kernel: [48960.489470] ? _raw_spin_lock+0x22/0x30 Aug 22 18:59:46 juju-e4d256-prod-github-runner-207 kernel: [48960.490254] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 18:59:46 juju-e4d256-prod-github-runner-207 kernel: [48960.491141] direct_page_fault+0x206/0x310 [kvm] Aug 22 18:59:46 juju-e4d256-prod-github-runner-207 kernel: [48960.491991] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 18:59:46 juju-e4d256-prod-github-runner-207 kernel: [48960.492832] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 18:59:46 juju-e4d256-prod-github-runner-207 kernel: [48960.493700] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 18:59:46 juju-e4d256-prod-github-runner-207 kernel: [48960.494567] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 18:59:46 juju-e4d256-prod-github-runner-207 kernel: [48960.495366] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 18:59:46 juju-e4d256-prod-github-runner-207 kernel: [48960.496210] handle_exit+0x98/0x230 [kvm_amd] Aug 22 18:59:46 juju-e4d256-prod-github-runner-207 kernel: [48960.496975] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 18:59:46 juju-e4d256-prod-github-runner-207 kernel: [48960.497768] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 18:59:46 juju-e4d256-prod-github-runner-207 kernel: [48960.498607] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 18:59:46 juju-e4d256-prod-github-runner-207 kernel: [48960.499403] vcpu_run+0x62/0x2c0 [kvm] Aug 22 18:59:46 juju-e4d256-prod-github-runner-207 kernel: [48960.500133] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 18:59:46 juju-e4d256-prod-github-runner-207 kernel: [48960.500876] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 18:59:46 juju-e4d256-prod-github-runner-207 kernel: [48960.501694] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 18:59:46 juju-e4d256-prod-github-runner-207 kernel: [48960.502489] ? __seccomp_filter+0x4a/0x4a0 Aug 22 18:59:46 juju-e4d256-prod-github-runner-207 kernel: [48960.503276] ? __fget_files+0x86/0xc0 Aug 22 18:59:46 juju-e4d256-prod-github-runner-207 kernel: [48960.503985] __x64_sys_ioctl+0x95/0xd0 Aug 22 18:59:46 juju-e4d256-prod-github-runner-207 kernel: [48960.504707] do_syscall_64+0x5c/0xc0 Aug 22 18:59:46 juju-e4d256-prod-github-runner-207 kernel: [48960.505410] ? do_futex+0x162/0x1f0 Aug 22 18:59:46 juju-e4d256-prod-github-runner-207 kernel: [48960.506090] ? __x64_sys_futex+0x78/0x1e0 Aug 22 18:59:46 juju-e4d256-prod-github-runner-207 kernel: [48960.506831] ? __secure_computing+0xa9/0x120 Aug 22 18:59:46 juju-e4d256-prod-github-runner-207 kernel: [48960.507573] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 18:59:46 juju-e4d256-prod-github-runner-207 kernel: [48960.508375] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:59:46 juju-e4d256-prod-github-runner-207 kernel: [48960.509157] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:59:46 juju-e4d256-prod-github-runner-207 kernel: [48960.509922] ? do_syscall_64+0x69/0xc0 Aug 22 18:59:46 juju-e4d256-prod-github-runner-207 kernel: [48960.510644] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 18:59:46 juju-e4d256-prod-github-runner-207 kernel: [48960.511448] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 18:59:46 juju-e4d256-prod-github-runner-207 kernel: [48960.512223] ? do_syscall_64+0x69/0xc0 Aug 22 18:59:46 juju-e4d256-prod-github-runner-207 kernel: [48960.512929] ? do_syscall_64+0x69/0xc0 Aug 22 18:59:46 juju-e4d256-prod-github-runner-207 kernel: [48960.513625] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 18:59:46 juju-e4d256-prod-github-runner-207 kernel: [48960.514410] RIP: 0033:0x7faa5d0edaff Aug 22 18:59:46 juju-e4d256-prod-github-runner-207 kernel: [48960.515146] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 18:59:46 juju-e4d256-prod-github-runner-207 kernel: [48960.517296] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 18:59:46 juju-e4d256-prod-github-runner-207 kernel: [48960.518277] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 18:59:46 juju-e4d256-prod-github-runner-207 kernel: [48960.519253] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 18:59:46 juju-e4d256-prod-github-runner-207 kernel: [48960.520322] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 18:59:46 juju-e4d256-prod-github-runner-207 kernel: [48960.521590] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 18:59:46 juju-e4d256-prod-github-runner-207 kernel: [48960.522592] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 18:59:46 juju-e4d256-prod-github-runner-207 kernel: [48960.523528] Aug 22 19:00:10 juju-e4d256-prod-github-runner-207 kernel: [48984.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 45512s! [qemu-system-x86:6715] Aug 22 19:00:10 juju-e4d256-prod-github-runner-207 kernel: [48984.543138] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 19:00:10 juju-e4d256-prod-github-runner-207 kernel: [48984.543488] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 19:00:10 juju-e4d256-prod-github-runner-207 kernel: [48984.556441] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 19:00:10 juju-e4d256-prod-github-runner-207 kernel: [48984.557742] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 19:00:10 juju-e4d256-prod-github-runner-207 kernel: [48984.559003] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:00:10 juju-e4d256-prod-github-runner-207 kernel: [48984.560073] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 19:00:10 juju-e4d256-prod-github-runner-207 kernel: [48984.562742] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 19:00:10 juju-e4d256-prod-github-runner-207 kernel: [48984.563805] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 19:00:10 juju-e4d256-prod-github-runner-207 kernel: [48984.564985] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 19:00:10 juju-e4d256-prod-github-runner-207 kernel: [48984.566225] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 19:00:10 juju-e4d256-prod-github-runner-207 kernel: [48984.567468] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 19:00:10 juju-e4d256-prod-github-runner-207 kernel: [48984.568696] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 19:00:10 juju-e4d256-prod-github-runner-207 kernel: [48984.569881] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 19:00:10 juju-e4d256-prod-github-runner-207 kernel: [48984.571186] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 19:00:10 juju-e4d256-prod-github-runner-207 kernel: [48984.572344] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 19:00:10 juju-e4d256-prod-github-runner-207 kernel: [48984.573567] Call Trace: Aug 22 19:00:10 juju-e4d256-prod-github-runner-207 kernel: [48984.574507] Aug 22 19:00:10 juju-e4d256-prod-github-runner-207 kernel: [48984.575601] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:00:10 juju-e4d256-prod-github-runner-207 kernel: [48984.576670] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:00:10 juju-e4d256-prod-github-runner-207 kernel: [48984.577912] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:00:10 juju-e4d256-prod-github-runner-207 kernel: [48984.579038] ? show_regs.part.0+0x23/0x29 Aug 22 19:00:10 juju-e4d256-prod-github-runner-207 kernel: [48984.580042] ? show_regs.cold+0x8/0xd Aug 22 19:00:10 juju-e4d256-prod-github-runner-207 kernel: [48984.581066] ? watchdog_timer_fn+0x1be/0x220 Aug 22 19:00:10 juju-e4d256-prod-github-runner-207 kernel: [48984.582133] ? lockup_detector_update_enable+0x60/0x60 Aug 22 19:00:10 juju-e4d256-prod-github-runner-207 kernel: [48984.583263] ? __hrtimer_run_queues+0x107/0x230 Aug 22 19:00:10 juju-e4d256-prod-github-runner-207 kernel: [48984.584296] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 19:00:10 juju-e4d256-prod-github-runner-207 kernel: [48984.585334] ? hrtimer_interrupt+0x101/0x220 Aug 22 19:00:10 juju-e4d256-prod-github-runner-207 kernel: [48984.586587] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 19:00:10 juju-e4d256-prod-github-runner-207 kernel: [48984.587708] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 19:00:10 juju-e4d256-prod-github-runner-207 kernel: [48984.588779] Aug 22 19:00:10 juju-e4d256-prod-github-runner-207 kernel: [48984.589647] Aug 22 19:00:10 juju-e4d256-prod-github-runner-207 kernel: [48984.590520] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 19:00:10 juju-e4d256-prod-github-runner-207 kernel: [48984.591585] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:00:10 juju-e4d256-prod-github-runner-207 kernel: [48984.592663] ? _raw_spin_lock+0x22/0x30 Aug 22 19:00:10 juju-e4d256-prod-github-runner-207 kernel: [48984.593663] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:00:10 juju-e4d256-prod-github-runner-207 kernel: [48984.594721] direct_page_fault+0x206/0x310 [kvm] Aug 22 19:00:10 juju-e4d256-prod-github-runner-207 kernel: [48984.595762] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 19:00:10 juju-e4d256-prod-github-runner-207 kernel: [48984.596806] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 19:00:10 juju-e4d256-prod-github-runner-207 kernel: [48984.597854] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 19:00:10 juju-e4d256-prod-github-runner-207 kernel: [48984.598917] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 19:00:10 juju-e4d256-prod-github-runner-207 kernel: [48984.599876] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 19:00:10 juju-e4d256-prod-github-runner-207 kernel: [48984.600868] handle_exit+0x98/0x230 [kvm_amd] Aug 22 19:00:10 juju-e4d256-prod-github-runner-207 kernel: [48984.601791] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 19:00:10 juju-e4d256-prod-github-runner-207 kernel: [48984.602760] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 19:00:10 juju-e4d256-prod-github-runner-207 kernel: [48984.603726] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 19:00:10 juju-e4d256-prod-github-runner-207 kernel: [48984.604655] vcpu_run+0x62/0x2c0 [kvm] Aug 22 19:00:10 juju-e4d256-prod-github-runner-207 kernel: [48984.605480] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 19:00:10 juju-e4d256-prod-github-runner-207 kernel: [48984.606323] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 19:00:10 juju-e4d256-prod-github-runner-207 kernel: [48984.607225] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 19:00:10 juju-e4d256-prod-github-runner-207 kernel: [48984.608058] ? __seccomp_filter+0x4a/0x4a0 Aug 22 19:00:10 juju-e4d256-prod-github-runner-207 kernel: [48984.608848] ? __fget_files+0x86/0xc0 Aug 22 19:00:10 juju-e4d256-prod-github-runner-207 kernel: [48984.609572] __x64_sys_ioctl+0x95/0xd0 Aug 22 19:00:10 juju-e4d256-prod-github-runner-207 kernel: [48984.610302] do_syscall_64+0x5c/0xc0 Aug 22 19:00:10 juju-e4d256-prod-github-runner-207 kernel: [48984.610979] ? do_futex+0x162/0x1f0 Aug 22 19:00:10 juju-e4d256-prod-github-runner-207 kernel: [48984.611672] ? __x64_sys_futex+0x78/0x1e0 Aug 22 19:00:10 juju-e4d256-prod-github-runner-207 kernel: [48984.612404] ? __secure_computing+0xa9/0x120 Aug 22 19:00:10 juju-e4d256-prod-github-runner-207 kernel: [48984.613166] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 19:00:10 juju-e4d256-prod-github-runner-207 kernel: [48984.614407] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:00:10 juju-e4d256-prod-github-runner-207 kernel: [48984.615626] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:00:10 juju-e4d256-prod-github-runner-207 kernel: [48984.616716] ? do_syscall_64+0x69/0xc0 Aug 22 19:00:10 juju-e4d256-prod-github-runner-207 kernel: [48984.617397] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:00:10 juju-e4d256-prod-github-runner-207 kernel: [48984.618135] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:00:10 juju-e4d256-prod-github-runner-207 kernel: [48984.618843] ? do_syscall_64+0x69/0xc0 Aug 22 19:00:10 juju-e4d256-prod-github-runner-207 kernel: [48984.619483] ? do_syscall_64+0x69/0xc0 Aug 22 19:00:10 juju-e4d256-prod-github-runner-207 kernel: [48984.620124] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 19:00:10 juju-e4d256-prod-github-runner-207 kernel: [48984.620882] RIP: 0033:0x7faa5d0edaff Aug 22 19:00:10 juju-e4d256-prod-github-runner-207 kernel: [48984.621596] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 19:00:10 juju-e4d256-prod-github-runner-207 kernel: [48984.623670] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 19:00:10 juju-e4d256-prod-github-runner-207 kernel: [48984.624598] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 19:00:10 juju-e4d256-prod-github-runner-207 kernel: [48984.625507] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 19:00:10 juju-e4d256-prod-github-runner-207 kernel: [48984.626446] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 19:00:10 juju-e4d256-prod-github-runner-207 kernel: [48984.627356] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 19:00:10 juju-e4d256-prod-github-runner-207 kernel: [48984.628269] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 19:00:10 juju-e4d256-prod-github-runner-207 kernel: [48984.629190] Aug 22 19:00:38 juju-e4d256-prod-github-runner-207 kernel: [49012.541980] watchdog: BUG: soft lockup - CPU#1 stuck for 45538s! [qemu-system-x86:6715] Aug 22 19:00:38 juju-e4d256-prod-github-runner-207 kernel: [49012.543455] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 19:00:38 juju-e4d256-prod-github-runner-207 kernel: [49012.543527] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 19:00:38 juju-e4d256-prod-github-runner-207 kernel: [49012.555999] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 19:00:38 juju-e4d256-prod-github-runner-207 kernel: [49012.557289] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 19:00:38 juju-e4d256-prod-github-runner-207 kernel: [49012.558549] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:00:38 juju-e4d256-prod-github-runner-207 kernel: [49012.559626] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 19:00:38 juju-e4d256-prod-github-runner-207 kernel: [49012.562257] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 19:00:38 juju-e4d256-prod-github-runner-207 kernel: [49012.563415] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 19:00:38 juju-e4d256-prod-github-runner-207 kernel: [49012.564624] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 19:00:38 juju-e4d256-prod-github-runner-207 kernel: [49012.565842] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 19:00:38 juju-e4d256-prod-github-runner-207 kernel: [49012.567028] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 19:00:38 juju-e4d256-prod-github-runner-207 kernel: [49012.568217] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 19:00:38 juju-e4d256-prod-github-runner-207 kernel: [49012.569412] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 19:00:38 juju-e4d256-prod-github-runner-207 kernel: [49012.570707] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 19:00:38 juju-e4d256-prod-github-runner-207 kernel: [49012.571832] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 19:00:38 juju-e4d256-prod-github-runner-207 kernel: [49012.573070] Call Trace: Aug 22 19:00:38 juju-e4d256-prod-github-runner-207 kernel: [49012.574065] Aug 22 19:00:38 juju-e4d256-prod-github-runner-207 kernel: [49012.574973] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:00:38 juju-e4d256-prod-github-runner-207 kernel: [49012.576039] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:00:38 juju-e4d256-prod-github-runner-207 kernel: [49012.577107] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:00:38 juju-e4d256-prod-github-runner-207 kernel: [49012.578236] ? show_regs.part.0+0x23/0x29 Aug 22 19:00:38 juju-e4d256-prod-github-runner-207 kernel: [49012.579257] ? show_regs.cold+0x8/0xd Aug 22 19:00:38 juju-e4d256-prod-github-runner-207 kernel: [49012.580249] ? watchdog_timer_fn+0x1be/0x220 Aug 22 19:00:38 juju-e4d256-prod-github-runner-207 kernel: [49012.581276] ? lockup_detector_update_enable+0x60/0x60 Aug 22 19:00:38 juju-e4d256-prod-github-runner-207 kernel: [49012.582372] ? __hrtimer_run_queues+0x107/0x230 Aug 22 19:00:38 juju-e4d256-prod-github-runner-207 kernel: [49012.583416] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 19:00:38 juju-e4d256-prod-github-runner-207 kernel: [49012.584453] ? hrtimer_interrupt+0x101/0x220 Aug 22 19:00:38 juju-e4d256-prod-github-runner-207 kernel: [49012.585500] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 19:00:38 juju-e4d256-prod-github-runner-207 kernel: [49012.586602] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 19:00:38 juju-e4d256-prod-github-runner-207 kernel: [49012.587660] Aug 22 19:00:38 juju-e4d256-prod-github-runner-207 kernel: [49012.588521] Aug 22 19:00:38 juju-e4d256-prod-github-runner-207 kernel: [49012.589368] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 19:00:38 juju-e4d256-prod-github-runner-207 kernel: [49012.590431] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:00:38 juju-e4d256-prod-github-runner-207 kernel: [49012.591494] ? _raw_spin_lock+0x22/0x30 Aug 22 19:00:38 juju-e4d256-prod-github-runner-207 kernel: [49012.592450] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:00:38 juju-e4d256-prod-github-runner-207 kernel: [49012.593496] direct_page_fault+0x206/0x310 [kvm] Aug 22 19:00:38 juju-e4d256-prod-github-runner-207 kernel: [49012.594544] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 19:00:38 juju-e4d256-prod-github-runner-207 kernel: [49012.595560] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 19:00:38 juju-e4d256-prod-github-runner-207 kernel: [49012.596574] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 19:00:38 juju-e4d256-prod-github-runner-207 kernel: [49012.597562] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 19:00:38 juju-e4d256-prod-github-runner-207 kernel: [49012.598527] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 19:00:38 juju-e4d256-prod-github-runner-207 kernel: [49012.599516] handle_exit+0x98/0x230 [kvm_amd] Aug 22 19:00:38 juju-e4d256-prod-github-runner-207 kernel: [49012.600432] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 19:00:38 juju-e4d256-prod-github-runner-207 kernel: [49012.601363] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 19:00:38 juju-e4d256-prod-github-runner-207 kernel: [49012.602333] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 19:00:38 juju-e4d256-prod-github-runner-207 kernel: [49012.603317] vcpu_run+0x62/0x2c0 [kvm] Aug 22 19:00:38 juju-e4d256-prod-github-runner-207 kernel: [49012.604140] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 19:00:38 juju-e4d256-prod-github-runner-207 kernel: [49012.604965] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 19:00:38 juju-e4d256-prod-github-runner-207 kernel: [49012.605905] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 19:00:38 juju-e4d256-prod-github-runner-207 kernel: [49012.606725] ? __seccomp_filter+0x4a/0x4a0 Aug 22 19:00:38 juju-e4d256-prod-github-runner-207 kernel: [49012.607503] ? __fget_files+0x86/0xc0 Aug 22 19:00:38 juju-e4d256-prod-github-runner-207 kernel: [49012.608218] __x64_sys_ioctl+0x95/0xd0 Aug 22 19:00:38 juju-e4d256-prod-github-runner-207 kernel: [49012.608925] do_syscall_64+0x5c/0xc0 Aug 22 19:00:38 juju-e4d256-prod-github-runner-207 kernel: [49012.609604] ? do_futex+0x162/0x1f0 Aug 22 19:00:38 juju-e4d256-prod-github-runner-207 kernel: [49012.610277] ? __x64_sys_futex+0x78/0x1e0 Aug 22 19:00:38 juju-e4d256-prod-github-runner-207 kernel: [49012.610968] ? __secure_computing+0xa9/0x120 Aug 22 19:00:38 juju-e4d256-prod-github-runner-207 kernel: [49012.611671] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 19:00:38 juju-e4d256-prod-github-runner-207 kernel: [49012.612449] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:00:38 juju-e4d256-prod-github-runner-207 kernel: [49012.613187] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:00:38 juju-e4d256-prod-github-runner-207 kernel: [49012.613929] ? do_syscall_64+0x69/0xc0 Aug 22 19:00:38 juju-e4d256-prod-github-runner-207 kernel: [49012.614587] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:00:38 juju-e4d256-prod-github-runner-207 kernel: [49012.615306] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:00:38 juju-e4d256-prod-github-runner-207 kernel: [49012.616017] ? do_syscall_64+0x69/0xc0 Aug 22 19:00:38 juju-e4d256-prod-github-runner-207 kernel: [49012.616660] ? do_syscall_64+0x69/0xc0 Aug 22 19:00:38 juju-e4d256-prod-github-runner-207 kernel: [49012.617306] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 19:00:38 juju-e4d256-prod-github-runner-207 kernel: [49012.618054] RIP: 0033:0x7faa5d0edaff Aug 22 19:00:38 juju-e4d256-prod-github-runner-207 kernel: [49012.618697] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 19:00:38 juju-e4d256-prod-github-runner-207 kernel: [49012.620755] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 19:00:38 juju-e4d256-prod-github-runner-207 kernel: [49012.621698] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 19:00:38 juju-e4d256-prod-github-runner-207 kernel: [49012.622630] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 19:00:38 juju-e4d256-prod-github-runner-207 kernel: [49012.623543] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 19:00:38 juju-e4d256-prod-github-runner-207 kernel: [49012.624448] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 19:00:38 juju-e4d256-prod-github-runner-207 kernel: [49012.625361] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 19:00:38 juju-e4d256-prod-github-runner-207 kernel: [49012.626300] Aug 22 19:01:06 juju-e4d256-prod-github-runner-207 kernel: [49040.541983] watchdog: BUG: soft lockup - CPU#1 stuck for 45564s! [qemu-system-x86:6715] Aug 22 19:01:06 juju-e4d256-prod-github-runner-207 kernel: [49040.544282] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 19:01:06 juju-e4d256-prod-github-runner-207 kernel: [49040.544572] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 19:01:06 juju-e4d256-prod-github-runner-207 kernel: [49040.557685] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 19:01:06 juju-e4d256-prod-github-runner-207 kernel: [49040.558962] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 19:01:06 juju-e4d256-prod-github-runner-207 kernel: [49040.560187] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:01:06 juju-e4d256-prod-github-runner-207 kernel: [49040.561298] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 19:01:06 juju-e4d256-prod-github-runner-207 kernel: [49040.563908] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 19:01:06 juju-e4d256-prod-github-runner-207 kernel: [49040.564961] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 19:01:06 juju-e4d256-prod-github-runner-207 kernel: [49040.566139] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 19:01:06 juju-e4d256-prod-github-runner-207 kernel: [49040.567304] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 19:01:06 juju-e4d256-prod-github-runner-207 kernel: [49040.568464] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 19:01:06 juju-e4d256-prod-github-runner-207 kernel: [49040.569682] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 19:01:06 juju-e4d256-prod-github-runner-207 kernel: [49040.570868] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 19:01:06 juju-e4d256-prod-github-runner-207 kernel: [49040.572109] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 19:01:06 juju-e4d256-prod-github-runner-207 kernel: [49040.573243] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 19:01:06 juju-e4d256-prod-github-runner-207 kernel: [49040.574459] Call Trace: Aug 22 19:01:06 juju-e4d256-prod-github-runner-207 kernel: [49040.575378] Aug 22 19:01:06 juju-e4d256-prod-github-runner-207 kernel: [49040.576359] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:01:06 juju-e4d256-prod-github-runner-207 kernel: [49040.577497] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:01:06 juju-e4d256-prod-github-runner-207 kernel: [49040.578543] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:01:06 juju-e4d256-prod-github-runner-207 kernel: [49040.579691] ? show_regs.part.0+0x23/0x29 Aug 22 19:01:06 juju-e4d256-prod-github-runner-207 kernel: [49040.580743] ? show_regs.cold+0x8/0xd Aug 22 19:01:06 juju-e4d256-prod-github-runner-207 kernel: [49040.581748] ? watchdog_timer_fn+0x1be/0x220 Aug 22 19:01:06 juju-e4d256-prod-github-runner-207 kernel: [49040.582761] ? lockup_detector_update_enable+0x60/0x60 Aug 22 19:01:06 juju-e4d256-prod-github-runner-207 kernel: [49040.583837] ? __hrtimer_run_queues+0x107/0x230 Aug 22 19:01:06 juju-e4d256-prod-github-runner-207 kernel: [49040.584896] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 19:01:06 juju-e4d256-prod-github-runner-207 kernel: [49040.585932] ? hrtimer_interrupt+0x101/0x220 Aug 22 19:01:06 juju-e4d256-prod-github-runner-207 kernel: [49040.586950] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 19:01:06 juju-e4d256-prod-github-runner-207 kernel: [49040.588019] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 19:01:06 juju-e4d256-prod-github-runner-207 kernel: [49040.589064] Aug 22 19:01:06 juju-e4d256-prod-github-runner-207 kernel: [49040.589923] Aug 22 19:01:06 juju-e4d256-prod-github-runner-207 kernel: [49040.590774] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 19:01:06 juju-e4d256-prod-github-runner-207 kernel: [49040.591808] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:01:06 juju-e4d256-prod-github-runner-207 kernel: [49040.592850] ? _raw_spin_lock+0x22/0x30 Aug 22 19:01:06 juju-e4d256-prod-github-runner-207 kernel: [49040.593827] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:01:06 juju-e4d256-prod-github-runner-207 kernel: [49040.594855] direct_page_fault+0x206/0x310 [kvm] Aug 22 19:01:06 juju-e4d256-prod-github-runner-207 kernel: [49040.595877] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 19:01:06 juju-e4d256-prod-github-runner-207 kernel: [49040.596885] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 19:01:06 juju-e4d256-prod-github-runner-207 kernel: [49040.597899] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 19:01:06 juju-e4d256-prod-github-runner-207 kernel: [49040.598899] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 19:01:06 juju-e4d256-prod-github-runner-207 kernel: [49040.599844] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 19:01:06 juju-e4d256-prod-github-runner-207 kernel: [49040.600820] handle_exit+0x98/0x230 [kvm_amd] Aug 22 19:01:06 juju-e4d256-prod-github-runner-207 kernel: [49040.601727] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 19:01:06 juju-e4d256-prod-github-runner-207 kernel: [49040.602642] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 19:01:06 juju-e4d256-prod-github-runner-207 kernel: [49040.603572] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 19:01:06 juju-e4d256-prod-github-runner-207 kernel: [49040.604473] vcpu_run+0x62/0x2c0 [kvm] Aug 22 19:01:06 juju-e4d256-prod-github-runner-207 kernel: [49040.605290] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 19:01:06 juju-e4d256-prod-github-runner-207 kernel: [49040.606114] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 19:01:06 juju-e4d256-prod-github-runner-207 kernel: [49040.606977] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 19:01:06 juju-e4d256-prod-github-runner-207 kernel: [49040.607774] ? __seccomp_filter+0x4a/0x4a0 Aug 22 19:01:06 juju-e4d256-prod-github-runner-207 kernel: [49040.608516] ? __fget_files+0x86/0xc0 Aug 22 19:01:06 juju-e4d256-prod-github-runner-207 kernel: [49040.609220] __x64_sys_ioctl+0x95/0xd0 Aug 22 19:01:06 juju-e4d256-prod-github-runner-207 kernel: [49040.609925] do_syscall_64+0x5c/0xc0 Aug 22 19:01:06 juju-e4d256-prod-github-runner-207 kernel: [49040.610604] ? do_futex+0x162/0x1f0 Aug 22 19:01:06 juju-e4d256-prod-github-runner-207 kernel: [49040.611253] ? __x64_sys_futex+0x78/0x1e0 Aug 22 19:01:06 juju-e4d256-prod-github-runner-207 kernel: [49040.611928] ? __secure_computing+0xa9/0x120 Aug 22 19:01:06 juju-e4d256-prod-github-runner-207 kernel: [49040.612637] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 19:01:06 juju-e4d256-prod-github-runner-207 kernel: [49040.613434] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:01:06 juju-e4d256-prod-github-runner-207 kernel: [49040.614200] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:01:06 juju-e4d256-prod-github-runner-207 kernel: [49040.614937] ? do_syscall_64+0x69/0xc0 Aug 22 19:01:06 juju-e4d256-prod-github-runner-207 kernel: [49040.615589] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:01:06 juju-e4d256-prod-github-runner-207 kernel: [49040.616296] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:01:06 juju-e4d256-prod-github-runner-207 kernel: [49040.616989] ? do_syscall_64+0x69/0xc0 Aug 22 19:01:06 juju-e4d256-prod-github-runner-207 kernel: [49040.617623] ? do_syscall_64+0x69/0xc0 Aug 22 19:01:06 juju-e4d256-prod-github-runner-207 kernel: [49040.618247] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 19:01:06 juju-e4d256-prod-github-runner-207 kernel: [49040.618956] RIP: 0033:0x7faa5d0edaff Aug 22 19:01:06 juju-e4d256-prod-github-runner-207 kernel: [49040.619999] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 19:01:06 juju-e4d256-prod-github-runner-207 kernel: [49040.621996] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 19:01:06 juju-e4d256-prod-github-runner-207 kernel: [49040.622915] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 19:01:06 juju-e4d256-prod-github-runner-207 kernel: [49040.623813] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 19:01:06 juju-e4d256-prod-github-runner-207 kernel: [49040.624710] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 19:01:06 juju-e4d256-prod-github-runner-207 kernel: [49040.625615] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 19:01:06 juju-e4d256-prod-github-runner-207 kernel: [49040.626509] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 19:01:06 juju-e4d256-prod-github-runner-207 kernel: [49040.627406] Aug 22 19:01:34 juju-e4d256-prod-github-runner-207 kernel: [49068.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 45590s! [qemu-system-x86:6715] Aug 22 19:01:34 juju-e4d256-prod-github-runner-207 kernel: [49068.544217] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 19:01:34 juju-e4d256-prod-github-runner-207 kernel: [49068.544491] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 19:01:34 juju-e4d256-prod-github-runner-207 kernel: [49068.556540] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 19:01:34 juju-e4d256-prod-github-runner-207 kernel: [49068.557823] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 19:01:34 juju-e4d256-prod-github-runner-207 kernel: [49068.559043] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:01:34 juju-e4d256-prod-github-runner-207 kernel: [49068.560098] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 19:01:34 juju-e4d256-prod-github-runner-207 kernel: [49068.562674] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 19:01:34 juju-e4d256-prod-github-runner-207 kernel: [49068.563723] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 19:01:34 juju-e4d256-prod-github-runner-207 kernel: [49068.564887] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 19:01:34 juju-e4d256-prod-github-runner-207 kernel: [49068.566062] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 19:01:34 juju-e4d256-prod-github-runner-207 kernel: [49068.567220] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 19:01:34 juju-e4d256-prod-github-runner-207 kernel: [49068.568379] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 19:01:34 juju-e4d256-prod-github-runner-207 kernel: [49068.569554] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 19:01:34 juju-e4d256-prod-github-runner-207 kernel: [49068.570794] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 19:01:34 juju-e4d256-prod-github-runner-207 kernel: [49068.571975] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 19:01:34 juju-e4d256-prod-github-runner-207 kernel: [49068.573181] Call Trace: Aug 22 19:01:34 juju-e4d256-prod-github-runner-207 kernel: [49068.574105] Aug 22 19:01:34 juju-e4d256-prod-github-runner-207 kernel: [49068.575014] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:01:34 juju-e4d256-prod-github-runner-207 kernel: [49068.576042] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:01:34 juju-e4d256-prod-github-runner-207 kernel: [49068.577080] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:01:34 juju-e4d256-prod-github-runner-207 kernel: [49068.578209] ? show_regs.part.0+0x23/0x29 Aug 22 19:01:34 juju-e4d256-prod-github-runner-207 kernel: [49068.579226] ? show_regs.cold+0x8/0xd Aug 22 19:01:34 juju-e4d256-prod-github-runner-207 kernel: [49068.580209] ? watchdog_timer_fn+0x1be/0x220 Aug 22 19:01:34 juju-e4d256-prod-github-runner-207 kernel: [49068.581236] ? lockup_detector_update_enable+0x60/0x60 Aug 22 19:01:34 juju-e4d256-prod-github-runner-207 kernel: [49068.582303] ? __hrtimer_run_queues+0x107/0x230 Aug 22 19:01:34 juju-e4d256-prod-github-runner-207 kernel: [49068.583329] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 19:01:34 juju-e4d256-prod-github-runner-207 kernel: [49068.584351] ? hrtimer_interrupt+0x101/0x220 Aug 22 19:01:34 juju-e4d256-prod-github-runner-207 kernel: [49068.585379] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 19:01:34 juju-e4d256-prod-github-runner-207 kernel: [49068.586449] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 19:01:34 juju-e4d256-prod-github-runner-207 kernel: [49068.587496] Aug 22 19:01:34 juju-e4d256-prod-github-runner-207 kernel: [49068.588354] Aug 22 19:01:34 juju-e4d256-prod-github-runner-207 kernel: [49068.589200] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 19:01:34 juju-e4d256-prod-github-runner-207 kernel: [49068.590238] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:01:34 juju-e4d256-prod-github-runner-207 kernel: [49068.591281] ? _raw_spin_lock+0x22/0x30 Aug 22 19:01:34 juju-e4d256-prod-github-runner-207 kernel: [49068.592229] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:01:34 juju-e4d256-prod-github-runner-207 kernel: [49068.593258] direct_page_fault+0x206/0x310 [kvm] Aug 22 19:01:34 juju-e4d256-prod-github-runner-207 kernel: [49068.594282] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 19:01:34 juju-e4d256-prod-github-runner-207 kernel: [49068.595289] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 19:01:34 juju-e4d256-prod-github-runner-207 kernel: [49068.596294] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 19:01:34 juju-e4d256-prod-github-runner-207 kernel: [49068.597460] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 19:01:34 juju-e4d256-prod-github-runner-207 kernel: [49068.598514] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 19:01:34 juju-e4d256-prod-github-runner-207 kernel: [49068.599596] handle_exit+0x98/0x230 [kvm_amd] Aug 22 19:01:34 juju-e4d256-prod-github-runner-207 kernel: [49068.600593] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 19:01:34 juju-e4d256-prod-github-runner-207 kernel: [49068.601634] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 19:01:34 juju-e4d256-prod-github-runner-207 kernel: [49068.602657] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 19:01:34 juju-e4d256-prod-github-runner-207 kernel: [49068.603663] vcpu_run+0x62/0x2c0 [kvm] Aug 22 19:01:34 juju-e4d256-prod-github-runner-207 kernel: [49068.604580] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 19:01:34 juju-e4d256-prod-github-runner-207 kernel: [49068.605511] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 19:01:34 juju-e4d256-prod-github-runner-207 kernel: [49068.606472] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 19:01:34 juju-e4d256-prod-github-runner-207 kernel: [49068.607359] ? __seccomp_filter+0x4a/0x4a0 Aug 22 19:01:34 juju-e4d256-prod-github-runner-207 kernel: [49068.608193] ? __fget_files+0x86/0xc0 Aug 22 19:01:34 juju-e4d256-prod-github-runner-207 kernel: [49068.608974] __x64_sys_ioctl+0x95/0xd0 Aug 22 19:01:34 juju-e4d256-prod-github-runner-207 kernel: [49068.609767] do_syscall_64+0x5c/0xc0 Aug 22 19:01:34 juju-e4d256-prod-github-runner-207 kernel: [49068.610505] ? do_futex+0x162/0x1f0 Aug 22 19:01:34 juju-e4d256-prod-github-runner-207 kernel: [49068.611231] ? __x64_sys_futex+0x78/0x1e0 Aug 22 19:01:34 juju-e4d256-prod-github-runner-207 kernel: [49068.612001] ? __secure_computing+0xa9/0x120 Aug 22 19:01:34 juju-e4d256-prod-github-runner-207 kernel: [49068.612774] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 19:01:34 juju-e4d256-prod-github-runner-207 kernel: [49068.613650] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:01:34 juju-e4d256-prod-github-runner-207 kernel: [49068.614470] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:01:34 juju-e4d256-prod-github-runner-207 kernel: [49068.615279] ? do_syscall_64+0x69/0xc0 Aug 22 19:01:34 juju-e4d256-prod-github-runner-207 kernel: [49068.616004] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:01:34 juju-e4d256-prod-github-runner-207 kernel: [49068.616803] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:01:34 juju-e4d256-prod-github-runner-207 kernel: [49068.617632] ? do_syscall_64+0x69/0xc0 Aug 22 19:01:34 juju-e4d256-prod-github-runner-207 kernel: [49068.618337] ? do_syscall_64+0x69/0xc0 Aug 22 19:01:34 juju-e4d256-prod-github-runner-207 kernel: [49068.619031] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 19:01:34 juju-e4d256-prod-github-runner-207 kernel: [49068.619834] RIP: 0033:0x7faa5d0edaff Aug 22 19:01:34 juju-e4d256-prod-github-runner-207 kernel: [49068.620584] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 19:01:34 juju-e4d256-prod-github-runner-207 kernel: [49068.622935] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 19:01:34 juju-e4d256-prod-github-runner-207 kernel: [49068.623993] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 19:01:34 juju-e4d256-prod-github-runner-207 kernel: [49068.625016] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 19:01:34 juju-e4d256-prod-github-runner-207 kernel: [49068.626054] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 19:01:34 juju-e4d256-prod-github-runner-207 kernel: [49068.627085] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 19:01:34 juju-e4d256-prod-github-runner-207 kernel: [49068.628111] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 19:01:34 juju-e4d256-prod-github-runner-207 kernel: [49068.629158] Aug 22 19:02:02 juju-e4d256-prod-github-runner-207 kernel: [49096.541982] watchdog: BUG: soft lockup - CPU#1 stuck for 45616s! [qemu-system-x86:6715] Aug 22 19:02:02 juju-e4d256-prod-github-runner-207 kernel: [49096.543788] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 19:02:02 juju-e4d256-prod-github-runner-207 kernel: [49096.544056] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 19:02:02 juju-e4d256-prod-github-runner-207 kernel: [49096.556567] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 19:02:02 juju-e4d256-prod-github-runner-207 kernel: [49096.557921] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 19:02:02 juju-e4d256-prod-github-runner-207 kernel: [49096.559202] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:02:02 juju-e4d256-prod-github-runner-207 kernel: [49096.560311] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 19:02:02 juju-e4d256-prod-github-runner-207 kernel: [49096.563172] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 19:02:02 juju-e4d256-prod-github-runner-207 kernel: [49096.564302] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 19:02:02 juju-e4d256-prod-github-runner-207 kernel: [49096.565556] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 19:02:02 juju-e4d256-prod-github-runner-207 kernel: [49096.566753] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 19:02:02 juju-e4d256-prod-github-runner-207 kernel: [49096.568005] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 19:02:02 juju-e4d256-prod-github-runner-207 kernel: [49096.569213] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 19:02:02 juju-e4d256-prod-github-runner-207 kernel: [49096.570452] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 19:02:02 juju-e4d256-prod-github-runner-207 kernel: [49096.571747] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 19:02:02 juju-e4d256-prod-github-runner-207 kernel: [49096.572933] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 19:02:02 juju-e4d256-prod-github-runner-207 kernel: [49096.574162] Call Trace: Aug 22 19:02:02 juju-e4d256-prod-github-runner-207 kernel: [49096.575083] Aug 22 19:02:02 juju-e4d256-prod-github-runner-207 kernel: [49096.576025] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:02:02 juju-e4d256-prod-github-runner-207 kernel: [49096.577152] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:02:02 juju-e4d256-prod-github-runner-207 kernel: [49096.578208] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:02:02 juju-e4d256-prod-github-runner-207 kernel: [49096.579370] ? show_regs.part.0+0x23/0x29 Aug 22 19:02:02 juju-e4d256-prod-github-runner-207 kernel: [49096.580430] ? show_regs.cold+0x8/0xd Aug 22 19:02:02 juju-e4d256-prod-github-runner-207 kernel: [49096.581455] ? watchdog_timer_fn+0x1be/0x220 Aug 22 19:02:02 juju-e4d256-prod-github-runner-207 kernel: [49096.582513] ? lockup_detector_update_enable+0x60/0x60 Aug 22 19:02:02 juju-e4d256-prod-github-runner-207 kernel: [49096.583603] ? __hrtimer_run_queues+0x107/0x230 Aug 22 19:02:02 juju-e4d256-prod-github-runner-207 kernel: [49096.584669] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 19:02:02 juju-e4d256-prod-github-runner-207 kernel: [49096.585741] ? hrtimer_interrupt+0x101/0x220 Aug 22 19:02:02 juju-e4d256-prod-github-runner-207 kernel: [49096.586769] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 19:02:02 juju-e4d256-prod-github-runner-207 kernel: [49096.588075] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 19:02:02 juju-e4d256-prod-github-runner-207 kernel: [49096.589316] Aug 22 19:02:02 juju-e4d256-prod-github-runner-207 kernel: [49096.590178] Aug 22 19:02:02 juju-e4d256-prod-github-runner-207 kernel: [49096.591033] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 19:02:02 juju-e4d256-prod-github-runner-207 kernel: [49096.592128] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:02:02 juju-e4d256-prod-github-runner-207 kernel: [49096.593232] ? _raw_spin_lock+0x22/0x30 Aug 22 19:02:02 juju-e4d256-prod-github-runner-207 kernel: [49096.594222] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:02:02 juju-e4d256-prod-github-runner-207 kernel: [49096.595300] direct_page_fault+0x206/0x310 [kvm] Aug 22 19:02:02 juju-e4d256-prod-github-runner-207 kernel: [49096.596404] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 19:02:02 juju-e4d256-prod-github-runner-207 kernel: [49096.597490] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 19:02:02 juju-e4d256-prod-github-runner-207 kernel: [49096.598518] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 19:02:02 juju-e4d256-prod-github-runner-207 kernel: [49096.599560] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 19:02:02 juju-e4d256-prod-github-runner-207 kernel: [49096.600550] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 19:02:02 juju-e4d256-prod-github-runner-207 kernel: [49096.601587] handle_exit+0x98/0x230 [kvm_amd] Aug 22 19:02:02 juju-e4d256-prod-github-runner-207 kernel: [49096.602523] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 19:02:02 juju-e4d256-prod-github-runner-207 kernel: [49096.603470] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 19:02:02 juju-e4d256-prod-github-runner-207 kernel: [49096.604411] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 19:02:02 juju-e4d256-prod-github-runner-207 kernel: [49096.605380] vcpu_run+0x62/0x2c0 [kvm] Aug 22 19:02:02 juju-e4d256-prod-github-runner-207 kernel: [49096.606206] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 19:02:02 juju-e4d256-prod-github-runner-207 kernel: [49096.607030] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 19:02:02 juju-e4d256-prod-github-runner-207 kernel: [49096.607914] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 19:02:02 juju-e4d256-prod-github-runner-207 kernel: [49096.608760] ? __seccomp_filter+0x4a/0x4a0 Aug 22 19:02:02 juju-e4d256-prod-github-runner-207 kernel: [49096.609518] ? __fget_files+0x86/0xc0 Aug 22 19:02:02 juju-e4d256-prod-github-runner-207 kernel: [49096.610233] __x64_sys_ioctl+0x95/0xd0 Aug 22 19:02:02 juju-e4d256-prod-github-runner-207 kernel: [49096.610959] do_syscall_64+0x5c/0xc0 Aug 22 19:02:02 juju-e4d256-prod-github-runner-207 kernel: [49096.611639] ? do_futex+0x162/0x1f0 Aug 22 19:02:02 juju-e4d256-prod-github-runner-207 kernel: [49096.612297] ? __x64_sys_futex+0x78/0x1e0 Aug 22 19:02:02 juju-e4d256-prod-github-runner-207 kernel: [49096.613015] ? __secure_computing+0xa9/0x120 Aug 22 19:02:02 juju-e4d256-prod-github-runner-207 kernel: [49096.613823] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 19:02:02 juju-e4d256-prod-github-runner-207 kernel: [49096.614607] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:02:02 juju-e4d256-prod-github-runner-207 kernel: [49096.615343] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:02:02 juju-e4d256-prod-github-runner-207 kernel: [49096.616105] ? do_syscall_64+0x69/0xc0 Aug 22 19:02:02 juju-e4d256-prod-github-runner-207 kernel: [49096.616798] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:02:02 juju-e4d256-prod-github-runner-207 kernel: [49096.617566] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:02:02 juju-e4d256-prod-github-runner-207 kernel: [49096.618289] ? do_syscall_64+0x69/0xc0 Aug 22 19:02:02 juju-e4d256-prod-github-runner-207 kernel: [49096.618974] ? do_syscall_64+0x69/0xc0 Aug 22 19:02:02 juju-e4d256-prod-github-runner-207 kernel: [49096.619635] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 19:02:02 juju-e4d256-prod-github-runner-207 kernel: [49096.620427] RIP: 0033:0x7faa5d0edaff Aug 22 19:02:02 juju-e4d256-prod-github-runner-207 kernel: [49096.621151] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 19:02:02 juju-e4d256-prod-github-runner-207 kernel: [49096.623301] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 19:02:02 juju-e4d256-prod-github-runner-207 kernel: [49096.624246] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 19:02:02 juju-e4d256-prod-github-runner-207 kernel: [49096.625251] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 19:02:02 juju-e4d256-prod-github-runner-207 kernel: [49096.626193] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 19:02:02 juju-e4d256-prod-github-runner-207 kernel: [49096.627131] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 19:02:02 juju-e4d256-prod-github-runner-207 kernel: [49096.628061] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 19:02:02 juju-e4d256-prod-github-runner-207 kernel: [49096.628995] Aug 22 19:02:30 juju-e4d256-prod-github-runner-207 kernel: [49124.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 45642s! [qemu-system-x86:6715] Aug 22 19:02:30 juju-e4d256-prod-github-runner-207 kernel: [49124.543738] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 19:02:30 juju-e4d256-prod-github-runner-207 kernel: [49124.543994] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 19:02:30 juju-e4d256-prod-github-runner-207 kernel: [49124.556254] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 19:02:30 juju-e4d256-prod-github-runner-207 kernel: [49124.557543] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 19:02:30 juju-e4d256-prod-github-runner-207 kernel: [49124.558761] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:02:30 juju-e4d256-prod-github-runner-207 kernel: [49124.559832] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 19:02:30 juju-e4d256-prod-github-runner-207 kernel: [49124.562412] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 19:02:30 juju-e4d256-prod-github-runner-207 kernel: [49124.563453] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 19:02:30 juju-e4d256-prod-github-runner-207 kernel: [49124.564646] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 19:02:30 juju-e4d256-prod-github-runner-207 kernel: [49124.565808] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 19:02:30 juju-e4d256-prod-github-runner-207 kernel: [49124.566985] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 19:02:30 juju-e4d256-prod-github-runner-207 kernel: [49124.568152] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 19:02:30 juju-e4d256-prod-github-runner-207 kernel: [49124.569344] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 19:02:30 juju-e4d256-prod-github-runner-207 kernel: [49124.570577] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 19:02:30 juju-e4d256-prod-github-runner-207 kernel: [49124.571678] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 19:02:30 juju-e4d256-prod-github-runner-207 kernel: [49124.572893] Call Trace: Aug 22 19:02:30 juju-e4d256-prod-github-runner-207 kernel: [49124.573815] Aug 22 19:02:30 juju-e4d256-prod-github-runner-207 kernel: [49124.574717] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:02:30 juju-e4d256-prod-github-runner-207 kernel: [49124.575744] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:02:30 juju-e4d256-prod-github-runner-207 kernel: [49124.576788] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:02:30 juju-e4d256-prod-github-runner-207 kernel: [49124.577879] ? show_regs.part.0+0x23/0x29 Aug 22 19:02:30 juju-e4d256-prod-github-runner-207 kernel: [49124.578885] ? show_regs.cold+0x8/0xd Aug 22 19:02:30 juju-e4d256-prod-github-runner-207 kernel: [49124.579853] ? watchdog_timer_fn+0x1be/0x220 Aug 22 19:02:30 juju-e4d256-prod-github-runner-207 kernel: [49124.580888] ? lockup_detector_update_enable+0x60/0x60 Aug 22 19:02:30 juju-e4d256-prod-github-runner-207 kernel: [49124.581953] ? __hrtimer_run_queues+0x107/0x230 Aug 22 19:02:30 juju-e4d256-prod-github-runner-207 kernel: [49124.582979] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 19:02:30 juju-e4d256-prod-github-runner-207 kernel: [49124.584019] ? hrtimer_interrupt+0x101/0x220 Aug 22 19:02:30 juju-e4d256-prod-github-runner-207 kernel: [49124.585073] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 19:02:30 juju-e4d256-prod-github-runner-207 kernel: [49124.586144] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 19:02:30 juju-e4d256-prod-github-runner-207 kernel: [49124.587204] Aug 22 19:02:30 juju-e4d256-prod-github-runner-207 kernel: [49124.588064] Aug 22 19:02:30 juju-e4d256-prod-github-runner-207 kernel: [49124.588909] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 19:02:30 juju-e4d256-prod-github-runner-207 kernel: [49124.589941] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:02:30 juju-e4d256-prod-github-runner-207 kernel: [49124.590979] ? _raw_spin_lock+0x22/0x30 Aug 22 19:02:30 juju-e4d256-prod-github-runner-207 kernel: [49124.591954] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:02:30 juju-e4d256-prod-github-runner-207 kernel: [49124.592996] direct_page_fault+0x206/0x310 [kvm] Aug 22 19:02:30 juju-e4d256-prod-github-runner-207 kernel: [49124.594026] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 19:02:30 juju-e4d256-prod-github-runner-207 kernel: [49124.595035] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 19:02:30 juju-e4d256-prod-github-runner-207 kernel: [49124.596034] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 19:02:30 juju-e4d256-prod-github-runner-207 kernel: [49124.597045] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 19:02:30 juju-e4d256-prod-github-runner-207 kernel: [49124.597988] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 19:02:30 juju-e4d256-prod-github-runner-207 kernel: [49124.598963] handle_exit+0x98/0x230 [kvm_amd] Aug 22 19:02:30 juju-e4d256-prod-github-runner-207 kernel: [49124.599853] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 19:02:30 juju-e4d256-prod-github-runner-207 kernel: [49124.600815] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 19:02:30 juju-e4d256-prod-github-runner-207 kernel: [49124.601740] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 19:02:30 juju-e4d256-prod-github-runner-207 kernel: [49124.602642] vcpu_run+0x62/0x2c0 [kvm] Aug 22 19:02:30 juju-e4d256-prod-github-runner-207 kernel: [49124.603449] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 19:02:30 juju-e4d256-prod-github-runner-207 kernel: [49124.604254] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 19:02:30 juju-e4d256-prod-github-runner-207 kernel: [49124.605113] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 19:02:30 juju-e4d256-prod-github-runner-207 kernel: [49124.605908] ? __seccomp_filter+0x4a/0x4a0 Aug 22 19:02:30 juju-e4d256-prod-github-runner-207 kernel: [49124.606647] ? __fget_files+0x86/0xc0 Aug 22 19:02:30 juju-e4d256-prod-github-runner-207 kernel: [49124.607349] __x64_sys_ioctl+0x95/0xd0 Aug 22 19:02:30 juju-e4d256-prod-github-runner-207 kernel: [49124.608037] do_syscall_64+0x5c/0xc0 Aug 22 19:02:30 juju-e4d256-prod-github-runner-207 kernel: [49124.608706] ? do_futex+0x162/0x1f0 Aug 22 19:02:30 juju-e4d256-prod-github-runner-207 kernel: [49124.609353] ? __x64_sys_futex+0x78/0x1e0 Aug 22 19:02:30 juju-e4d256-prod-github-runner-207 kernel: [49124.610032] ? __secure_computing+0xa9/0x120 Aug 22 19:02:30 juju-e4d256-prod-github-runner-207 kernel: [49124.610718] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 19:02:30 juju-e4d256-prod-github-runner-207 kernel: [49124.611474] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:02:30 juju-e4d256-prod-github-runner-207 kernel: [49124.612209] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:02:30 juju-e4d256-prod-github-runner-207 kernel: [49124.612957] ? do_syscall_64+0x69/0xc0 Aug 22 19:02:30 juju-e4d256-prod-github-runner-207 kernel: [49124.613600] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:02:30 juju-e4d256-prod-github-runner-207 kernel: [49124.614310] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:02:30 juju-e4d256-prod-github-runner-207 kernel: [49124.615012] ? do_syscall_64+0x69/0xc0 Aug 22 19:02:30 juju-e4d256-prod-github-runner-207 kernel: [49124.615640] ? do_syscall_64+0x69/0xc0 Aug 22 19:02:30 juju-e4d256-prod-github-runner-207 kernel: [49124.616262] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 19:02:30 juju-e4d256-prod-github-runner-207 kernel: [49124.617016] RIP: 0033:0x7faa5d0edaff Aug 22 19:02:30 juju-e4d256-prod-github-runner-207 kernel: [49124.617673] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 19:02:30 juju-e4d256-prod-github-runner-207 kernel: [49124.619652] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 19:02:30 juju-e4d256-prod-github-runner-207 kernel: [49124.620585] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 19:02:30 juju-e4d256-prod-github-runner-207 kernel: [49124.621472] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 19:02:30 juju-e4d256-prod-github-runner-207 kernel: [49124.622364] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 19:02:30 juju-e4d256-prod-github-runner-207 kernel: [49124.623249] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 19:02:30 juju-e4d256-prod-github-runner-207 kernel: [49124.624134] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 19:02:30 juju-e4d256-prod-github-runner-207 kernel: [49124.625030] Aug 22 19:02:46 juju-e4d256-prod-github-runner-207 kernel: [49140.464706] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 19:02:46 juju-e4d256-prod-github-runner-207 kernel: [49140.466317] rcu: 1-....: (12217271 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=5907253 Aug 22 19:02:46 juju-e4d256-prod-github-runner-207 kernel: [49140.467483] (t=12255816 jiffies g=23269 q=46971) Aug 22 19:02:46 juju-e4d256-prod-github-runner-207 kernel: [49140.468340] NMI backtrace for cpu 1 Aug 22 19:02:46 juju-e4d256-prod-github-runner-207 kernel: [49140.469061] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 19:02:46 juju-e4d256-prod-github-runner-207 kernel: [49140.470197] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 19:02:46 juju-e4d256-prod-github-runner-207 kernel: [49140.471278] Call Trace: Aug 22 19:02:46 juju-e4d256-prod-github-runner-207 kernel: [49140.471959] Aug 22 19:02:46 juju-e4d256-prod-github-runner-207 kernel: [49140.472626] show_stack+0x52/0x5c Aug 22 19:02:46 juju-e4d256-prod-github-runner-207 kernel: [49140.473368] dump_stack_lvl+0x4a/0x63 Aug 22 19:02:46 juju-e4d256-prod-github-runner-207 kernel: [49140.474130] dump_stack+0x10/0x16 Aug 22 19:02:46 juju-e4d256-prod-github-runner-207 kernel: [49140.474856] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 19:02:46 juju-e4d256-prod-github-runner-207 kernel: [49140.475650] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 19:02:46 juju-e4d256-prod-github-runner-207 kernel: [49140.476455] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 19:02:46 juju-e4d256-prod-github-runner-207 kernel: [49140.477287] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 19:02:46 juju-e4d256-prod-github-runner-207 kernel: [49140.478140] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 19:02:46 juju-e4d256-prod-github-runner-207 kernel: [49140.478967] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 19:02:46 juju-e4d256-prod-github-runner-207 kernel: [49140.479754] print_cpu_stall.cold+0x2f/0xe2 Aug 22 19:02:46 juju-e4d256-prod-github-runner-207 kernel: [49140.480541] ? timekeeping_update+0xf7/0x150 Aug 22 19:02:46 juju-e4d256-prod-github-runner-207 kernel: [49140.481327] check_cpu_stall+0x109/0x270 Aug 22 19:02:46 juju-e4d256-prod-github-runner-207 kernel: [49140.482097] rcu_sched_clock_irq+0x9a/0x250 Aug 22 19:02:46 juju-e4d256-prod-github-runner-207 kernel: [49140.482878] update_process_times+0x94/0xd0 Aug 22 19:02:46 juju-e4d256-prod-github-runner-207 kernel: [49140.483652] tick_sched_handle+0x29/0x70 Aug 22 19:02:46 juju-e4d256-prod-github-runner-207 kernel: [49140.484420] tick_sched_timer+0x8c/0xc0 Aug 22 19:02:46 juju-e4d256-prod-github-runner-207 kernel: [49140.485179] ? tick_nohz_handler+0xb0/0xb0 Aug 22 19:02:46 juju-e4d256-prod-github-runner-207 kernel: [49140.485955] __hrtimer_run_queues+0x107/0x230 Aug 22 19:02:46 juju-e4d256-prod-github-runner-207 kernel: [49140.486741] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 19:02:46 juju-e4d256-prod-github-runner-207 kernel: [49140.487530] hrtimer_interrupt+0x101/0x220 Aug 22 19:02:46 juju-e4d256-prod-github-runner-207 kernel: [49140.488346] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 19:02:46 juju-e4d256-prod-github-runner-207 kernel: [49140.489190] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 19:02:46 juju-e4d256-prod-github-runner-207 kernel: [49140.490012] Aug 22 19:02:46 juju-e4d256-prod-github-runner-207 kernel: [49140.490655] Aug 22 19:02:46 juju-e4d256-prod-github-runner-207 kernel: [49140.491290] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 19:02:46 juju-e4d256-prod-github-runner-207 kernel: [49140.492142] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:02:46 juju-e4d256-prod-github-runner-207 kernel: [49140.493041] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 19:02:46 juju-e4d256-prod-github-runner-207 kernel: [49140.495317] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 19:02:46 juju-e4d256-prod-github-runner-207 kernel: [49140.496218] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 19:02:46 juju-e4d256-prod-github-runner-207 kernel: [49140.497266] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 19:02:46 juju-e4d256-prod-github-runner-207 kernel: [49140.498269] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 19:02:46 juju-e4d256-prod-github-runner-207 kernel: [49140.499274] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 19:02:46 juju-e4d256-prod-github-runner-207 kernel: [49140.500269] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 19:02:46 juju-e4d256-prod-github-runner-207 kernel: [49140.501252] ? _raw_spin_lock+0x22/0x30 Aug 22 19:02:46 juju-e4d256-prod-github-runner-207 kernel: [49140.502033] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:02:46 juju-e4d256-prod-github-runner-207 kernel: [49140.502904] direct_page_fault+0x206/0x310 [kvm] Aug 22 19:02:46 juju-e4d256-prod-github-runner-207 kernel: [49140.503754] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 19:02:46 juju-e4d256-prod-github-runner-207 kernel: [49140.504604] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 19:02:46 juju-e4d256-prod-github-runner-207 kernel: [49140.505460] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 19:02:46 juju-e4d256-prod-github-runner-207 kernel: [49140.506299] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 19:02:46 juju-e4d256-prod-github-runner-207 kernel: [49140.507117] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 19:02:46 juju-e4d256-prod-github-runner-207 kernel: [49140.507963] handle_exit+0x98/0x230 [kvm_amd] Aug 22 19:02:46 juju-e4d256-prod-github-runner-207 kernel: [49140.508847] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 19:02:46 juju-e4d256-prod-github-runner-207 kernel: [49140.509661] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 19:02:46 juju-e4d256-prod-github-runner-207 kernel: [49140.510472] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 19:02:46 juju-e4d256-prod-github-runner-207 kernel: [49140.511272] vcpu_run+0x62/0x2c0 [kvm] Aug 22 19:02:46 juju-e4d256-prod-github-runner-207 kernel: [49140.512003] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 19:02:46 juju-e4d256-prod-github-runner-207 kernel: [49140.512776] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 19:02:46 juju-e4d256-prod-github-runner-207 kernel: [49140.513771] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 19:02:46 juju-e4d256-prod-github-runner-207 kernel: [49140.514542] ? __seccomp_filter+0x4a/0x4a0 Aug 22 19:02:46 juju-e4d256-prod-github-runner-207 kernel: [49140.515270] ? __fget_files+0x86/0xc0 Aug 22 19:02:46 juju-e4d256-prod-github-runner-207 kernel: [49140.515973] __x64_sys_ioctl+0x95/0xd0 Aug 22 19:02:46 juju-e4d256-prod-github-runner-207 kernel: [49140.516707] do_syscall_64+0x5c/0xc0 Aug 22 19:02:46 juju-e4d256-prod-github-runner-207 kernel: [49140.517407] ? do_futex+0x162/0x1f0 Aug 22 19:02:46 juju-e4d256-prod-github-runner-207 kernel: [49140.518099] ? __x64_sys_futex+0x78/0x1e0 Aug 22 19:02:46 juju-e4d256-prod-github-runner-207 kernel: [49140.518820] ? __secure_computing+0xa9/0x120 Aug 22 19:02:46 juju-e4d256-prod-github-runner-207 kernel: [49140.519594] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 19:02:46 juju-e4d256-prod-github-runner-207 kernel: [49140.520411] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:02:46 juju-e4d256-prod-github-runner-207 kernel: [49140.521179] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:02:46 juju-e4d256-prod-github-runner-207 kernel: [49140.521949] ? do_syscall_64+0x69/0xc0 Aug 22 19:02:46 juju-e4d256-prod-github-runner-207 kernel: [49140.522650] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:02:46 juju-e4d256-prod-github-runner-207 kernel: [49140.523423] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:02:46 juju-e4d256-prod-github-runner-207 kernel: [49140.524205] ? do_syscall_64+0x69/0xc0 Aug 22 19:02:46 juju-e4d256-prod-github-runner-207 kernel: [49140.524907] ? do_syscall_64+0x69/0xc0 Aug 22 19:02:46 juju-e4d256-prod-github-runner-207 kernel: [49140.525603] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 19:02:46 juju-e4d256-prod-github-runner-207 kernel: [49140.526386] RIP: 0033:0x7faa5d0edaff Aug 22 19:02:46 juju-e4d256-prod-github-runner-207 kernel: [49140.527146] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 19:02:46 juju-e4d256-prod-github-runner-207 kernel: [49140.529301] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 19:02:46 juju-e4d256-prod-github-runner-207 kernel: [49140.530309] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 19:02:46 juju-e4d256-prod-github-runner-207 kernel: [49140.531275] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 19:02:46 juju-e4d256-prod-github-runner-207 kernel: [49140.532259] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 19:02:46 juju-e4d256-prod-github-runner-207 kernel: [49140.533246] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 19:02:46 juju-e4d256-prod-github-runner-207 kernel: [49140.534185] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 19:02:46 juju-e4d256-prod-github-runner-207 kernel: [49140.535117] Aug 22 19:03:10 juju-e4d256-prod-github-runner-207 kernel: [49164.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 45680s! [qemu-system-x86:6715] Aug 22 19:03:10 juju-e4d256-prod-github-runner-207 kernel: [49164.543836] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 19:03:10 juju-e4d256-prod-github-runner-207 kernel: [49164.544121] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 19:03:10 juju-e4d256-prod-github-runner-207 kernel: [49164.556550] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 19:03:10 juju-e4d256-prod-github-runner-207 kernel: [49164.557819] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 19:03:10 juju-e4d256-prod-github-runner-207 kernel: [49164.559031] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:03:10 juju-e4d256-prod-github-runner-207 kernel: [49164.560144] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 19:03:10 juju-e4d256-prod-github-runner-207 kernel: [49164.562888] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 19:03:10 juju-e4d256-prod-github-runner-207 kernel: [49164.563973] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 19:03:10 juju-e4d256-prod-github-runner-207 kernel: [49164.565133] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 19:03:10 juju-e4d256-prod-github-runner-207 kernel: [49164.566338] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 19:03:10 juju-e4d256-prod-github-runner-207 kernel: [49164.567531] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 19:03:10 juju-e4d256-prod-github-runner-207 kernel: [49164.568712] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 19:03:10 juju-e4d256-prod-github-runner-207 kernel: [49164.569885] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 19:03:10 juju-e4d256-prod-github-runner-207 kernel: [49164.571287] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 19:03:10 juju-e4d256-prod-github-runner-207 kernel: [49164.572469] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 19:03:10 juju-e4d256-prod-github-runner-207 kernel: [49164.573769] Call Trace: Aug 22 19:03:10 juju-e4d256-prod-github-runner-207 kernel: [49164.574723] Aug 22 19:03:10 juju-e4d256-prod-github-runner-207 kernel: [49164.576000] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:03:10 juju-e4d256-prod-github-runner-207 kernel: [49164.577271] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:03:10 juju-e4d256-prod-github-runner-207 kernel: [49164.578562] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:03:10 juju-e4d256-prod-github-runner-207 kernel: [49164.579729] ? show_regs.part.0+0x23/0x29 Aug 22 19:03:10 juju-e4d256-prod-github-runner-207 kernel: [49164.580794] ? show_regs.cold+0x8/0xd Aug 22 19:03:10 juju-e4d256-prod-github-runner-207 kernel: [49164.581866] ? watchdog_timer_fn+0x1be/0x220 Aug 22 19:03:10 juju-e4d256-prod-github-runner-207 kernel: [49164.582982] ? lockup_detector_update_enable+0x60/0x60 Aug 22 19:03:10 juju-e4d256-prod-github-runner-207 kernel: [49164.584132] ? __hrtimer_run_queues+0x107/0x230 Aug 22 19:03:10 juju-e4d256-prod-github-runner-207 kernel: [49164.585232] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 19:03:10 juju-e4d256-prod-github-runner-207 kernel: [49164.586352] ? hrtimer_interrupt+0x101/0x220 Aug 22 19:03:10 juju-e4d256-prod-github-runner-207 kernel: [49164.587440] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 19:03:10 juju-e4d256-prod-github-runner-207 kernel: [49164.588599] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 19:03:10 juju-e4d256-prod-github-runner-207 kernel: [49164.589785] Aug 22 19:03:10 juju-e4d256-prod-github-runner-207 kernel: [49164.590703] Aug 22 19:03:10 juju-e4d256-prod-github-runner-207 kernel: [49164.591601] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 19:03:10 juju-e4d256-prod-github-runner-207 kernel: [49164.592723] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:03:10 juju-e4d256-prod-github-runner-207 kernel: [49164.593821] ? _raw_spin_lock+0x22/0x30 Aug 22 19:03:10 juju-e4d256-prod-github-runner-207 kernel: [49164.594825] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:03:10 juju-e4d256-prod-github-runner-207 kernel: [49164.595935] direct_page_fault+0x206/0x310 [kvm] Aug 22 19:03:10 juju-e4d256-prod-github-runner-207 kernel: [49164.597035] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 19:03:10 juju-e4d256-prod-github-runner-207 kernel: [49164.598155] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 19:03:10 juju-e4d256-prod-github-runner-207 kernel: [49164.599170] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 19:03:10 juju-e4d256-prod-github-runner-207 kernel: [49164.600320] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 19:03:10 juju-e4d256-prod-github-runner-207 kernel: [49164.601342] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 19:03:10 juju-e4d256-prod-github-runner-207 kernel: [49164.602401] handle_exit+0x98/0x230 [kvm_amd] Aug 22 19:03:10 juju-e4d256-prod-github-runner-207 kernel: [49164.603331] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 19:03:10 juju-e4d256-prod-github-runner-207 kernel: [49164.604336] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 19:03:10 juju-e4d256-prod-github-runner-207 kernel: [49164.605287] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 19:03:10 juju-e4d256-prod-github-runner-207 kernel: [49164.606269] vcpu_run+0x62/0x2c0 [kvm] Aug 22 19:03:10 juju-e4d256-prod-github-runner-207 kernel: [49164.607151] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 19:03:10 juju-e4d256-prod-github-runner-207 kernel: [49164.608033] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 19:03:10 juju-e4d256-prod-github-runner-207 kernel: [49164.608960] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 19:03:10 juju-e4d256-prod-github-runner-207 kernel: [49164.609819] ? __seccomp_filter+0x4a/0x4a0 Aug 22 19:03:10 juju-e4d256-prod-github-runner-207 kernel: [49164.610617] ? __fget_files+0x86/0xc0 Aug 22 19:03:10 juju-e4d256-prod-github-runner-207 kernel: [49164.611386] __x64_sys_ioctl+0x95/0xd0 Aug 22 19:03:10 juju-e4d256-prod-github-runner-207 kernel: [49164.612190] do_syscall_64+0x5c/0xc0 Aug 22 19:03:10 juju-e4d256-prod-github-runner-207 kernel: [49164.612984] ? do_futex+0x162/0x1f0 Aug 22 19:03:10 juju-e4d256-prod-github-runner-207 kernel: [49164.613666] ? __x64_sys_futex+0x78/0x1e0 Aug 22 19:03:10 juju-e4d256-prod-github-runner-207 kernel: [49164.614426] ? __secure_computing+0xa9/0x120 Aug 22 19:03:10 juju-e4d256-prod-github-runner-207 kernel: [49164.615176] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 19:03:10 juju-e4d256-prod-github-runner-207 kernel: [49164.616033] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:03:10 juju-e4d256-prod-github-runner-207 kernel: [49164.616835] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:03:10 juju-e4d256-prod-github-runner-207 kernel: [49164.617596] ? do_syscall_64+0x69/0xc0 Aug 22 19:03:10 juju-e4d256-prod-github-runner-207 kernel: [49164.618288] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:03:10 juju-e4d256-prod-github-runner-207 kernel: [49164.619065] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:03:10 juju-e4d256-prod-github-runner-207 kernel: [49164.619826] ? do_syscall_64+0x69/0xc0 Aug 22 19:03:10 juju-e4d256-prod-github-runner-207 kernel: [49164.620491] ? do_syscall_64+0x69/0xc0 Aug 22 19:03:10 juju-e4d256-prod-github-runner-207 kernel: [49164.621127] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 19:03:10 juju-e4d256-prod-github-runner-207 kernel: [49164.621871] RIP: 0033:0x7faa5d0edaff Aug 22 19:03:10 juju-e4d256-prod-github-runner-207 kernel: [49164.622621] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 19:03:10 juju-e4d256-prod-github-runner-207 kernel: [49164.624670] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 19:03:10 juju-e4d256-prod-github-runner-207 kernel: [49164.625638] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 19:03:10 juju-e4d256-prod-github-runner-207 kernel: [49164.626582] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 19:03:10 juju-e4d256-prod-github-runner-207 kernel: [49164.627528] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 19:03:10 juju-e4d256-prod-github-runner-207 kernel: [49164.628518] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 19:03:10 juju-e4d256-prod-github-runner-207 kernel: [49164.629451] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 19:03:10 juju-e4d256-prod-github-runner-207 kernel: [49164.630429] Aug 22 19:03:38 juju-e4d256-prod-github-runner-207 kernel: [49192.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 45706s! [qemu-system-x86:6715] Aug 22 19:03:38 juju-e4d256-prod-github-runner-207 kernel: [49192.544626] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 19:03:38 juju-e4d256-prod-github-runner-207 kernel: [49192.544896] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 19:03:38 juju-e4d256-prod-github-runner-207 kernel: [49192.557161] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 19:03:38 juju-e4d256-prod-github-runner-207 kernel: [49192.558569] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 19:03:38 juju-e4d256-prod-github-runner-207 kernel: [49192.560043] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:03:38 juju-e4d256-prod-github-runner-207 kernel: [49192.561412] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 19:03:38 juju-e4d256-prod-github-runner-207 kernel: [49192.563990] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 19:03:38 juju-e4d256-prod-github-runner-207 kernel: [49192.565034] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 19:03:38 juju-e4d256-prod-github-runner-207 kernel: [49192.566276] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 19:03:38 juju-e4d256-prod-github-runner-207 kernel: [49192.567550] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 19:03:38 juju-e4d256-prod-github-runner-207 kernel: [49192.569030] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 19:03:38 juju-e4d256-prod-github-runner-207 kernel: [49192.570551] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 19:03:38 juju-e4d256-prod-github-runner-207 kernel: [49192.571830] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 19:03:38 juju-e4d256-prod-github-runner-207 kernel: [49192.573065] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 19:03:38 juju-e4d256-prod-github-runner-207 kernel: [49192.574164] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 19:03:38 juju-e4d256-prod-github-runner-207 kernel: [49192.575362] Call Trace: Aug 22 19:03:38 juju-e4d256-prod-github-runner-207 kernel: [49192.576373] Aug 22 19:03:38 juju-e4d256-prod-github-runner-207 kernel: [49192.577582] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:03:38 juju-e4d256-prod-github-runner-207 kernel: [49192.578694] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:03:38 juju-e4d256-prod-github-runner-207 kernel: [49192.579735] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:03:38 juju-e4d256-prod-github-runner-207 kernel: [49192.580830] ? show_regs.part.0+0x23/0x29 Aug 22 19:03:38 juju-e4d256-prod-github-runner-207 kernel: [49192.581833] ? show_regs.cold+0x8/0xd Aug 22 19:03:38 juju-e4d256-prod-github-runner-207 kernel: [49192.582806] ? watchdog_timer_fn+0x1be/0x220 Aug 22 19:03:38 juju-e4d256-prod-github-runner-207 kernel: [49192.583833] ? lockup_detector_update_enable+0x60/0x60 Aug 22 19:03:38 juju-e4d256-prod-github-runner-207 kernel: [49192.584895] ? __hrtimer_run_queues+0x107/0x230 Aug 22 19:03:38 juju-e4d256-prod-github-runner-207 kernel: [49192.585924] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 19:03:38 juju-e4d256-prod-github-runner-207 kernel: [49192.586949] ? hrtimer_interrupt+0x101/0x220 Aug 22 19:03:38 juju-e4d256-prod-github-runner-207 kernel: [49192.587970] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 19:03:38 juju-e4d256-prod-github-runner-207 kernel: [49192.589038] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 19:03:38 juju-e4d256-prod-github-runner-207 kernel: [49192.590085] Aug 22 19:03:38 juju-e4d256-prod-github-runner-207 kernel: [49192.590937] Aug 22 19:03:38 juju-e4d256-prod-github-runner-207 kernel: [49192.591788] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 19:03:38 juju-e4d256-prod-github-runner-207 kernel: [49192.592825] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:03:38 juju-e4d256-prod-github-runner-207 kernel: [49192.593864] ? _raw_spin_lock+0x22/0x30 Aug 22 19:03:38 juju-e4d256-prod-github-runner-207 kernel: [49192.595004] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:03:38 juju-e4d256-prod-github-runner-207 kernel: [49192.596356] direct_page_fault+0x206/0x310 [kvm] Aug 22 19:03:38 juju-e4d256-prod-github-runner-207 kernel: [49192.597518] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 19:03:38 juju-e4d256-prod-github-runner-207 kernel: [49192.598527] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 19:03:38 juju-e4d256-prod-github-runner-207 kernel: [49192.599554] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 19:03:38 juju-e4d256-prod-github-runner-207 kernel: [49192.600562] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 19:03:38 juju-e4d256-prod-github-runner-207 kernel: [49192.601510] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 19:03:38 juju-e4d256-prod-github-runner-207 kernel: [49192.602595] handle_exit+0x98/0x230 [kvm_amd] Aug 22 19:03:38 juju-e4d256-prod-github-runner-207 kernel: [49192.603802] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 19:03:38 juju-e4d256-prod-github-runner-207 kernel: [49192.605017] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 19:03:38 juju-e4d256-prod-github-runner-207 kernel: [49192.605948] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 19:03:38 juju-e4d256-prod-github-runner-207 kernel: [49192.606853] vcpu_run+0x62/0x2c0 [kvm] Aug 22 19:03:38 juju-e4d256-prod-github-runner-207 kernel: [49192.607684] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 19:03:38 juju-e4d256-prod-github-runner-207 kernel: [49192.608494] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 19:03:38 juju-e4d256-prod-github-runner-207 kernel: [49192.609423] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 19:03:38 juju-e4d256-prod-github-runner-207 kernel: [49192.610499] ? __seccomp_filter+0x4a/0x4a0 Aug 22 19:03:38 juju-e4d256-prod-github-runner-207 kernel: [49192.611540] ? __fget_files+0x86/0xc0 Aug 22 19:03:38 juju-e4d256-prod-github-runner-207 kernel: [49192.612516] __x64_sys_ioctl+0x95/0xd0 Aug 22 19:03:38 juju-e4d256-prod-github-runner-207 kernel: [49192.613491] do_syscall_64+0x5c/0xc0 Aug 22 19:03:38 juju-e4d256-prod-github-runner-207 kernel: [49192.614468] ? do_futex+0x162/0x1f0 Aug 22 19:03:38 juju-e4d256-prod-github-runner-207 kernel: [49192.615307] ? __x64_sys_futex+0x78/0x1e0 Aug 22 19:03:38 juju-e4d256-prod-github-runner-207 kernel: [49192.616001] ? __secure_computing+0xa9/0x120 Aug 22 19:03:38 juju-e4d256-prod-github-runner-207 kernel: [49192.616693] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 19:03:38 juju-e4d256-prod-github-runner-207 kernel: [49192.617456] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:03:38 juju-e4d256-prod-github-runner-207 kernel: [49192.618181] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:03:38 juju-e4d256-prod-github-runner-207 kernel: [49192.618993] ? do_syscall_64+0x69/0xc0 Aug 22 19:03:38 juju-e4d256-prod-github-runner-207 kernel: [49192.619863] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:03:38 juju-e4d256-prod-github-runner-207 kernel: [49192.620871] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:03:38 juju-e4d256-prod-github-runner-207 kernel: [49192.621804] ? do_syscall_64+0x69/0xc0 Aug 22 19:03:38 juju-e4d256-prod-github-runner-207 kernel: [49192.622614] ? do_syscall_64+0x69/0xc0 Aug 22 19:03:38 juju-e4d256-prod-github-runner-207 kernel: [49192.623444] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 19:03:38 juju-e4d256-prod-github-runner-207 kernel: [49192.624292] RIP: 0033:0x7faa5d0edaff Aug 22 19:03:38 juju-e4d256-prod-github-runner-207 kernel: [49192.624965] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 19:03:38 juju-e4d256-prod-github-runner-207 kernel: [49192.627022] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 19:03:38 juju-e4d256-prod-github-runner-207 kernel: [49192.628249] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 19:03:38 juju-e4d256-prod-github-runner-207 kernel: [49192.629479] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 19:03:38 juju-e4d256-prod-github-runner-207 kernel: [49192.630595] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 19:03:38 juju-e4d256-prod-github-runner-207 kernel: [49192.631583] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 19:03:38 juju-e4d256-prod-github-runner-207 kernel: [49192.632477] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 19:03:38 juju-e4d256-prod-github-runner-207 kernel: [49192.633390] Aug 22 19:04:06 juju-e4d256-prod-github-runner-207 kernel: [49220.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 45732s! [qemu-system-x86:6715] Aug 22 19:04:06 juju-e4d256-prod-github-runner-207 kernel: [49220.543799] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 19:04:06 juju-e4d256-prod-github-runner-207 kernel: [49220.544051] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 19:04:06 juju-e4d256-prod-github-runner-207 kernel: [49220.556957] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 19:04:06 juju-e4d256-prod-github-runner-207 kernel: [49220.558222] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 19:04:06 juju-e4d256-prod-github-runner-207 kernel: [49220.559486] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:04:06 juju-e4d256-prod-github-runner-207 kernel: [49220.560542] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 19:04:06 juju-e4d256-prod-github-runner-207 kernel: [49220.563081] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 19:04:06 juju-e4d256-prod-github-runner-207 kernel: [49220.564150] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 19:04:06 juju-e4d256-prod-github-runner-207 kernel: [49220.565339] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 19:04:06 juju-e4d256-prod-github-runner-207 kernel: [49220.566509] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 19:04:06 juju-e4d256-prod-github-runner-207 kernel: [49220.567690] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 19:04:06 juju-e4d256-prod-github-runner-207 kernel: [49220.568856] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 19:04:06 juju-e4d256-prod-github-runner-207 kernel: [49220.570021] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 19:04:06 juju-e4d256-prod-github-runner-207 kernel: [49220.571274] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 19:04:06 juju-e4d256-prod-github-runner-207 kernel: [49220.572383] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 19:04:06 juju-e4d256-prod-github-runner-207 kernel: [49220.573585] Call Trace: Aug 22 19:04:06 juju-e4d256-prod-github-runner-207 kernel: [49220.574500] Aug 22 19:04:06 juju-e4d256-prod-github-runner-207 kernel: [49220.575413] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:04:06 juju-e4d256-prod-github-runner-207 kernel: [49220.576445] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:04:06 juju-e4d256-prod-github-runner-207 kernel: [49220.577497] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:04:06 juju-e4d256-prod-github-runner-207 kernel: [49220.578592] ? show_regs.part.0+0x23/0x29 Aug 22 19:04:06 juju-e4d256-prod-github-runner-207 kernel: [49220.579610] ? show_regs.cold+0x8/0xd Aug 22 19:04:06 juju-e4d256-prod-github-runner-207 kernel: [49220.580583] ? watchdog_timer_fn+0x1be/0x220 Aug 22 19:04:06 juju-e4d256-prod-github-runner-207 kernel: [49220.581598] ? lockup_detector_update_enable+0x60/0x60 Aug 22 19:04:06 juju-e4d256-prod-github-runner-207 kernel: [49220.582679] ? __hrtimer_run_queues+0x107/0x230 Aug 22 19:04:06 juju-e4d256-prod-github-runner-207 kernel: [49220.583731] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 19:04:06 juju-e4d256-prod-github-runner-207 kernel: [49220.584755] ? hrtimer_interrupt+0x101/0x220 Aug 22 19:04:06 juju-e4d256-prod-github-runner-207 kernel: [49220.585771] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 19:04:06 juju-e4d256-prod-github-runner-207 kernel: [49220.586839] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 19:04:06 juju-e4d256-prod-github-runner-207 kernel: [49220.587905] Aug 22 19:04:06 juju-e4d256-prod-github-runner-207 kernel: [49220.588802] Aug 22 19:04:06 juju-e4d256-prod-github-runner-207 kernel: [49220.589644] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 19:04:06 juju-e4d256-prod-github-runner-207 kernel: [49220.590685] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:04:06 juju-e4d256-prod-github-runner-207 kernel: [49220.591745] ? _raw_spin_lock+0x22/0x30 Aug 22 19:04:06 juju-e4d256-prod-github-runner-207 kernel: [49220.592694] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:04:06 juju-e4d256-prod-github-runner-207 kernel: [49220.593714] direct_page_fault+0x206/0x310 [kvm] Aug 22 19:04:06 juju-e4d256-prod-github-runner-207 kernel: [49220.594754] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 19:04:06 juju-e4d256-prod-github-runner-207 kernel: [49220.595779] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 19:04:06 juju-e4d256-prod-github-runner-207 kernel: [49220.596787] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 19:04:06 juju-e4d256-prod-github-runner-207 kernel: [49220.597790] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 19:04:06 juju-e4d256-prod-github-runner-207 kernel: [49220.598740] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 19:04:06 juju-e4d256-prod-github-runner-207 kernel: [49220.599739] handle_exit+0x98/0x230 [kvm_amd] Aug 22 19:04:06 juju-e4d256-prod-github-runner-207 kernel: [49220.600647] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 19:04:06 juju-e4d256-prod-github-runner-207 kernel: [49220.601567] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 19:04:06 juju-e4d256-prod-github-runner-207 kernel: [49220.602494] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 19:04:06 juju-e4d256-prod-github-runner-207 kernel: [49220.603421] vcpu_run+0x62/0x2c0 [kvm] Aug 22 19:04:06 juju-e4d256-prod-github-runner-207 kernel: [49220.604268] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 19:04:06 juju-e4d256-prod-github-runner-207 kernel: [49220.605077] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 19:04:06 juju-e4d256-prod-github-runner-207 kernel: [49220.605962] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 19:04:06 juju-e4d256-prod-github-runner-207 kernel: [49220.606766] ? __seccomp_filter+0x4a/0x4a0 Aug 22 19:04:06 juju-e4d256-prod-github-runner-207 kernel: [49220.607525] ? __fget_files+0x86/0xc0 Aug 22 19:04:06 juju-e4d256-prod-github-runner-207 kernel: [49220.608232] __x64_sys_ioctl+0x95/0xd0 Aug 22 19:04:06 juju-e4d256-prod-github-runner-207 kernel: [49220.608934] do_syscall_64+0x5c/0xc0 Aug 22 19:04:06 juju-e4d256-prod-github-runner-207 kernel: [49220.609638] ? do_futex+0x162/0x1f0 Aug 22 19:04:06 juju-e4d256-prod-github-runner-207 kernel: [49220.610289] ? __x64_sys_futex+0x78/0x1e0 Aug 22 19:04:06 juju-e4d256-prod-github-runner-207 kernel: [49220.610964] ? __secure_computing+0xa9/0x120 Aug 22 19:04:06 juju-e4d256-prod-github-runner-207 kernel: [49220.611669] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 19:04:06 juju-e4d256-prod-github-runner-207 kernel: [49220.612431] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:04:06 juju-e4d256-prod-github-runner-207 kernel: [49220.613177] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:04:06 juju-e4d256-prod-github-runner-207 kernel: [49220.613902] ? do_syscall_64+0x69/0xc0 Aug 22 19:04:06 juju-e4d256-prod-github-runner-207 kernel: [49220.614548] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:04:06 juju-e4d256-prod-github-runner-207 kernel: [49220.615272] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:04:06 juju-e4d256-prod-github-runner-207 kernel: [49220.615970] ? do_syscall_64+0x69/0xc0 Aug 22 19:04:06 juju-e4d256-prod-github-runner-207 kernel: [49220.616594] ? do_syscall_64+0x69/0xc0 Aug 22 19:04:06 juju-e4d256-prod-github-runner-207 kernel: [49220.617218] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 19:04:06 juju-e4d256-prod-github-runner-207 kernel: [49220.617922] RIP: 0033:0x7faa5d0edaff Aug 22 19:04:06 juju-e4d256-prod-github-runner-207 kernel: [49220.618571] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 19:04:06 juju-e4d256-prod-github-runner-207 kernel: [49220.620597] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 19:04:06 juju-e4d256-prod-github-runner-207 kernel: [49220.621514] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 19:04:06 juju-e4d256-prod-github-runner-207 kernel: [49220.622405] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 19:04:06 juju-e4d256-prod-github-runner-207 kernel: [49220.623312] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 19:04:06 juju-e4d256-prod-github-runner-207 kernel: [49220.624217] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 19:04:06 juju-e4d256-prod-github-runner-207 kernel: [49220.625440] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 19:04:06 juju-e4d256-prod-github-runner-207 kernel: [49220.626343] Aug 22 19:04:34 juju-e4d256-prod-github-runner-207 kernel: [49248.541980] watchdog: BUG: soft lockup - CPU#1 stuck for 45758s! [qemu-system-x86:6715] Aug 22 19:04:34 juju-e4d256-prod-github-runner-207 kernel: [49248.543107] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 19:04:34 juju-e4d256-prod-github-runner-207 kernel: [49248.543174] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 19:04:34 juju-e4d256-prod-github-runner-207 kernel: [49248.555407] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 19:04:34 juju-e4d256-prod-github-runner-207 kernel: [49248.556715] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 19:04:34 juju-e4d256-prod-github-runner-207 kernel: [49248.557978] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:04:34 juju-e4d256-prod-github-runner-207 kernel: [49248.559100] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 19:04:34 juju-e4d256-prod-github-runner-207 kernel: [49248.561681] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 19:04:34 juju-e4d256-prod-github-runner-207 kernel: [49248.562728] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 19:04:34 juju-e4d256-prod-github-runner-207 kernel: [49248.563908] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 19:04:34 juju-e4d256-prod-github-runner-207 kernel: [49248.565070] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 19:04:34 juju-e4d256-prod-github-runner-207 kernel: [49248.566229] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 19:04:34 juju-e4d256-prod-github-runner-207 kernel: [49248.567415] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 19:04:34 juju-e4d256-prod-github-runner-207 kernel: [49248.568584] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 19:04:34 juju-e4d256-prod-github-runner-207 kernel: [49248.569819] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 19:04:34 juju-e4d256-prod-github-runner-207 kernel: [49248.570924] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 19:04:34 juju-e4d256-prod-github-runner-207 kernel: [49248.572121] Call Trace: Aug 22 19:04:34 juju-e4d256-prod-github-runner-207 kernel: [49248.573032] Aug 22 19:04:34 juju-e4d256-prod-github-runner-207 kernel: [49248.573914] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:04:34 juju-e4d256-prod-github-runner-207 kernel: [49248.574964] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:04:34 juju-e4d256-prod-github-runner-207 kernel: [49248.575986] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:04:34 juju-e4d256-prod-github-runner-207 kernel: [49248.577057] ? show_regs.part.0+0x23/0x29 Aug 22 19:04:34 juju-e4d256-prod-github-runner-207 kernel: [49248.578049] ? show_regs.cold+0x8/0xd Aug 22 19:04:34 juju-e4d256-prod-github-runner-207 kernel: [49248.579031] ? watchdog_timer_fn+0x1be/0x220 Aug 22 19:04:34 juju-e4d256-prod-github-runner-207 kernel: [49248.580039] ? lockup_detector_update_enable+0x60/0x60 Aug 22 19:04:34 juju-e4d256-prod-github-runner-207 kernel: [49248.581099] ? __hrtimer_run_queues+0x107/0x230 Aug 22 19:04:34 juju-e4d256-prod-github-runner-207 kernel: [49248.582127] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 19:04:34 juju-e4d256-prod-github-runner-207 kernel: [49248.583165] ? hrtimer_interrupt+0x101/0x220 Aug 22 19:04:34 juju-e4d256-prod-github-runner-207 kernel: [49248.584178] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 19:04:34 juju-e4d256-prod-github-runner-207 kernel: [49248.585250] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 19:04:34 juju-e4d256-prod-github-runner-207 kernel: [49248.586300] Aug 22 19:04:34 juju-e4d256-prod-github-runner-207 kernel: [49248.587170] Aug 22 19:04:34 juju-e4d256-prod-github-runner-207 kernel: [49248.588007] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 19:04:34 juju-e4d256-prod-github-runner-207 kernel: [49248.589037] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:04:34 juju-e4d256-prod-github-runner-207 kernel: [49248.590071] ? _raw_spin_lock+0x22/0x30 Aug 22 19:04:34 juju-e4d256-prod-github-runner-207 kernel: [49248.591024] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:04:34 juju-e4d256-prod-github-runner-207 kernel: [49248.592053] direct_page_fault+0x206/0x310 [kvm] Aug 22 19:04:34 juju-e4d256-prod-github-runner-207 kernel: [49248.593078] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 19:04:34 juju-e4d256-prod-github-runner-207 kernel: [49248.594085] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 19:04:34 juju-e4d256-prod-github-runner-207 kernel: [49248.595101] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 19:04:34 juju-e4d256-prod-github-runner-207 kernel: [49248.596070] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 19:04:34 juju-e4d256-prod-github-runner-207 kernel: [49248.597013] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 19:04:34 juju-e4d256-prod-github-runner-207 kernel: [49248.597994] handle_exit+0x98/0x230 [kvm_amd] Aug 22 19:04:34 juju-e4d256-prod-github-runner-207 kernel: [49248.598975] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 19:04:34 juju-e4d256-prod-github-runner-207 kernel: [49248.599910] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 19:04:34 juju-e4d256-prod-github-runner-207 kernel: [49248.600836] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 19:04:34 juju-e4d256-prod-github-runner-207 kernel: [49248.601735] vcpu_run+0x62/0x2c0 [kvm] Aug 22 19:04:34 juju-e4d256-prod-github-runner-207 kernel: [49248.602551] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 19:04:34 juju-e4d256-prod-github-runner-207 kernel: [49248.603366] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 19:04:34 juju-e4d256-prod-github-runner-207 kernel: [49248.604240] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 19:04:34 juju-e4d256-prod-github-runner-207 kernel: [49248.605037] ? __seccomp_filter+0x4a/0x4a0 Aug 22 19:04:34 juju-e4d256-prod-github-runner-207 kernel: [49248.605777] ? __fget_files+0x86/0xc0 Aug 22 19:04:34 juju-e4d256-prod-github-runner-207 kernel: [49248.606477] __x64_sys_ioctl+0x95/0xd0 Aug 22 19:04:34 juju-e4d256-prod-github-runner-207 kernel: [49248.607181] do_syscall_64+0x5c/0xc0 Aug 22 19:04:34 juju-e4d256-prod-github-runner-207 kernel: [49248.607858] ? do_futex+0x162/0x1f0 Aug 22 19:04:34 juju-e4d256-prod-github-runner-207 kernel: [49248.608592] ? __x64_sys_futex+0x78/0x1e0 Aug 22 19:04:34 juju-e4d256-prod-github-runner-207 kernel: [49248.609263] ? __secure_computing+0xa9/0x120 Aug 22 19:04:34 juju-e4d256-prod-github-runner-207 kernel: [49248.609956] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 19:04:34 juju-e4d256-prod-github-runner-207 kernel: [49248.610712] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:04:34 juju-e4d256-prod-github-runner-207 kernel: [49248.611441] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:04:34 juju-e4d256-prod-github-runner-207 kernel: [49248.612159] ? do_syscall_64+0x69/0xc0 Aug 22 19:04:34 juju-e4d256-prod-github-runner-207 kernel: [49248.612803] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:04:34 juju-e4d256-prod-github-runner-207 kernel: [49248.613510] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:04:34 juju-e4d256-prod-github-runner-207 kernel: [49248.614202] ? do_syscall_64+0x69/0xc0 Aug 22 19:04:34 juju-e4d256-prod-github-runner-207 kernel: [49248.614834] ? do_syscall_64+0x69/0xc0 Aug 22 19:04:34 juju-e4d256-prod-github-runner-207 kernel: [49248.615455] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 19:04:34 juju-e4d256-prod-github-runner-207 kernel: [49248.616160] RIP: 0033:0x7faa5d0edaff Aug 22 19:04:34 juju-e4d256-prod-github-runner-207 kernel: [49248.616798] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 19:04:34 juju-e4d256-prod-github-runner-207 kernel: [49248.618798] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 19:04:34 juju-e4d256-prod-github-runner-207 kernel: [49248.619710] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 19:04:34 juju-e4d256-prod-github-runner-207 kernel: [49248.620600] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 19:04:34 juju-e4d256-prod-github-runner-207 kernel: [49248.621491] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 19:04:34 juju-e4d256-prod-github-runner-207 kernel: [49248.622376] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 19:04:34 juju-e4d256-prod-github-runner-207 kernel: [49248.623282] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 19:04:34 juju-e4d256-prod-github-runner-207 kernel: [49248.624180] Aug 22 19:05:02 juju-e4d256-prod-github-runner-207 kernel: [49276.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 45784s! [qemu-system-x86:6715] Aug 22 19:05:02 juju-e4d256-prod-github-runner-207 kernel: [49276.543137] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 19:05:02 juju-e4d256-prod-github-runner-207 kernel: [49276.543206] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 19:05:02 juju-e4d256-prod-github-runner-207 kernel: [49276.555647] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 19:05:02 juju-e4d256-prod-github-runner-207 kernel: [49276.556919] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 19:05:02 juju-e4d256-prod-github-runner-207 kernel: [49276.558139] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:05:02 juju-e4d256-prod-github-runner-207 kernel: [49276.559262] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 19:05:02 juju-e4d256-prod-github-runner-207 kernel: [49276.561941] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 19:05:02 juju-e4d256-prod-github-runner-207 kernel: [49276.563133] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 19:05:02 juju-e4d256-prod-github-runner-207 kernel: [49276.564325] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 19:05:02 juju-e4d256-prod-github-runner-207 kernel: [49276.565497] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 19:05:02 juju-e4d256-prod-github-runner-207 kernel: [49276.566686] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 19:05:02 juju-e4d256-prod-github-runner-207 kernel: [49276.567866] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 19:05:02 juju-e4d256-prod-github-runner-207 kernel: [49276.569044] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 19:05:02 juju-e4d256-prod-github-runner-207 kernel: [49276.570288] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 19:05:02 juju-e4d256-prod-github-runner-207 kernel: [49276.571407] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 19:05:02 juju-e4d256-prod-github-runner-207 kernel: [49276.572612] Call Trace: Aug 22 19:05:02 juju-e4d256-prod-github-runner-207 kernel: [49276.573531] Aug 22 19:05:02 juju-e4d256-prod-github-runner-207 kernel: [49276.574438] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:05:02 juju-e4d256-prod-github-runner-207 kernel: [49276.575477] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:05:02 juju-e4d256-prod-github-runner-207 kernel: [49276.576510] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:05:02 juju-e4d256-prod-github-runner-207 kernel: [49276.577591] ? show_regs.part.0+0x23/0x29 Aug 22 19:05:02 juju-e4d256-prod-github-runner-207 kernel: [49276.578613] ? show_regs.cold+0x8/0xd Aug 22 19:05:02 juju-e4d256-prod-github-runner-207 kernel: [49276.579596] ? watchdog_timer_fn+0x1be/0x220 Aug 22 19:05:02 juju-e4d256-prod-github-runner-207 kernel: [49276.580628] ? lockup_detector_update_enable+0x60/0x60 Aug 22 19:05:02 juju-e4d256-prod-github-runner-207 kernel: [49276.581697] ? __hrtimer_run_queues+0x107/0x230 Aug 22 19:05:02 juju-e4d256-prod-github-runner-207 kernel: [49276.582876] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 19:05:02 juju-e4d256-prod-github-runner-207 kernel: [49276.583907] ? hrtimer_interrupt+0x101/0x220 Aug 22 19:05:02 juju-e4d256-prod-github-runner-207 kernel: [49276.584922] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 19:05:02 juju-e4d256-prod-github-runner-207 kernel: [49276.585989] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 19:05:02 juju-e4d256-prod-github-runner-207 kernel: [49276.587090] Aug 22 19:05:02 juju-e4d256-prod-github-runner-207 kernel: [49276.587945] Aug 22 19:05:02 juju-e4d256-prod-github-runner-207 kernel: [49276.588787] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 19:05:02 juju-e4d256-prod-github-runner-207 kernel: [49276.589820] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:05:02 juju-e4d256-prod-github-runner-207 kernel: [49276.590923] ? _raw_spin_lock+0x22/0x30 Aug 22 19:05:02 juju-e4d256-prod-github-runner-207 kernel: [49276.591871] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:05:02 juju-e4d256-prod-github-runner-207 kernel: [49276.592889] direct_page_fault+0x206/0x310 [kvm] Aug 22 19:05:02 juju-e4d256-prod-github-runner-207 kernel: [49276.593913] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 19:05:02 juju-e4d256-prod-github-runner-207 kernel: [49276.594987] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 19:05:02 juju-e4d256-prod-github-runner-207 kernel: [49276.595992] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 19:05:02 juju-e4d256-prod-github-runner-207 kernel: [49276.596960] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 19:05:02 juju-e4d256-prod-github-runner-207 kernel: [49276.597905] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 19:05:02 juju-e4d256-prod-github-runner-207 kernel: [49276.598966] handle_exit+0x98/0x230 [kvm_amd] Aug 22 19:05:02 juju-e4d256-prod-github-runner-207 kernel: [49276.599864] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 19:05:02 juju-e4d256-prod-github-runner-207 kernel: [49276.600778] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 19:05:02 juju-e4d256-prod-github-runner-207 kernel: [49276.601703] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 19:05:02 juju-e4d256-prod-github-runner-207 kernel: [49276.602678] vcpu_run+0x62/0x2c0 [kvm] Aug 22 19:05:02 juju-e4d256-prod-github-runner-207 kernel: [49276.603493] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 19:05:02 juju-e4d256-prod-github-runner-207 kernel: [49276.604308] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 19:05:02 juju-e4d256-prod-github-runner-207 kernel: [49276.605166] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 19:05:02 juju-e4d256-prod-github-runner-207 kernel: [49276.605968] ? __seccomp_filter+0x4a/0x4a0 Aug 22 19:05:02 juju-e4d256-prod-github-runner-207 kernel: [49276.606732] ? __fget_files+0x86/0xc0 Aug 22 19:05:02 juju-e4d256-prod-github-runner-207 kernel: [49276.607439] __x64_sys_ioctl+0x95/0xd0 Aug 22 19:05:02 juju-e4d256-prod-github-runner-207 kernel: [49276.608133] do_syscall_64+0x5c/0xc0 Aug 22 19:05:02 juju-e4d256-prod-github-runner-207 kernel: [49276.608799] ? do_futex+0x162/0x1f0 Aug 22 19:05:02 juju-e4d256-prod-github-runner-207 kernel: [49276.609450] ? __x64_sys_futex+0x78/0x1e0 Aug 22 19:05:02 juju-e4d256-prod-github-runner-207 kernel: [49276.610125] ? __secure_computing+0xa9/0x120 Aug 22 19:05:02 juju-e4d256-prod-github-runner-207 kernel: [49276.610845] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 19:05:02 juju-e4d256-prod-github-runner-207 kernel: [49276.611614] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:05:02 juju-e4d256-prod-github-runner-207 kernel: [49276.612336] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:05:02 juju-e4d256-prod-github-runner-207 kernel: [49276.613053] ? do_syscall_64+0x69/0xc0 Aug 22 19:05:02 juju-e4d256-prod-github-runner-207 kernel: [49276.613699] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:05:02 juju-e4d256-prod-github-runner-207 kernel: [49276.614420] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:05:02 juju-e4d256-prod-github-runner-207 kernel: [49276.615119] ? do_syscall_64+0x69/0xc0 Aug 22 19:05:02 juju-e4d256-prod-github-runner-207 kernel: [49276.615747] ? do_syscall_64+0x69/0xc0 Aug 22 19:05:02 juju-e4d256-prod-github-runner-207 kernel: [49276.616371] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 19:05:02 juju-e4d256-prod-github-runner-207 kernel: [49276.617078] RIP: 0033:0x7faa5d0edaff Aug 22 19:05:02 juju-e4d256-prod-github-runner-207 kernel: [49276.617704] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 19:05:02 juju-e4d256-prod-github-runner-207 kernel: [49276.619719] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 19:05:02 juju-e4d256-prod-github-runner-207 kernel: [49276.620637] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 19:05:02 juju-e4d256-prod-github-runner-207 kernel: [49276.621530] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 19:05:02 juju-e4d256-prod-github-runner-207 kernel: [49276.622442] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 19:05:02 juju-e4d256-prod-github-runner-207 kernel: [49276.623358] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 19:05:02 juju-e4d256-prod-github-runner-207 kernel: [49276.624250] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 19:05:02 juju-e4d256-prod-github-runner-207 kernel: [49276.625143] Aug 22 19:05:30 juju-e4d256-prod-github-runner-207 kernel: [49304.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 45810s! [qemu-system-x86:6715] Aug 22 19:05:30 juju-e4d256-prod-github-runner-207 kernel: [49304.543710] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 19:05:30 juju-e4d256-prod-github-runner-207 kernel: [49304.543944] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 19:05:30 juju-e4d256-prod-github-runner-207 kernel: [49304.556416] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 19:05:30 juju-e4d256-prod-github-runner-207 kernel: [49304.557694] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 19:05:30 juju-e4d256-prod-github-runner-207 kernel: [49304.558937] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:05:30 juju-e4d256-prod-github-runner-207 kernel: [49304.560001] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 19:05:30 juju-e4d256-prod-github-runner-207 kernel: [49304.562586] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 19:05:30 juju-e4d256-prod-github-runner-207 kernel: [49304.563631] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 19:05:30 juju-e4d256-prod-github-runner-207 kernel: [49304.564795] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 19:05:30 juju-e4d256-prod-github-runner-207 kernel: [49304.565965] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 19:05:30 juju-e4d256-prod-github-runner-207 kernel: [49304.567157] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 19:05:30 juju-e4d256-prod-github-runner-207 kernel: [49304.568333] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 19:05:30 juju-e4d256-prod-github-runner-207 kernel: [49304.569711] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 19:05:30 juju-e4d256-prod-github-runner-207 kernel: [49304.570981] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 19:05:30 juju-e4d256-prod-github-runner-207 kernel: [49304.572097] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 19:05:30 juju-e4d256-prod-github-runner-207 kernel: [49304.573317] Call Trace: Aug 22 19:05:30 juju-e4d256-prod-github-runner-207 kernel: [49304.574265] Aug 22 19:05:30 juju-e4d256-prod-github-runner-207 kernel: [49304.575174] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:05:30 juju-e4d256-prod-github-runner-207 kernel: [49304.576223] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:05:30 juju-e4d256-prod-github-runner-207 kernel: [49304.577258] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:05:30 juju-e4d256-prod-github-runner-207 kernel: [49304.578569] ? show_regs.part.0+0x23/0x29 Aug 22 19:05:30 juju-e4d256-prod-github-runner-207 kernel: [49304.579585] ? show_regs.cold+0x8/0xd Aug 22 19:05:30 juju-e4d256-prod-github-runner-207 kernel: [49304.580567] ? watchdog_timer_fn+0x1be/0x220 Aug 22 19:05:30 juju-e4d256-prod-github-runner-207 kernel: [49304.581596] ? lockup_detector_update_enable+0x60/0x60 Aug 22 19:05:30 juju-e4d256-prod-github-runner-207 kernel: [49304.582685] ? __hrtimer_run_queues+0x107/0x230 Aug 22 19:05:30 juju-e4d256-prod-github-runner-207 kernel: [49304.583726] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 19:05:30 juju-e4d256-prod-github-runner-207 kernel: [49304.584761] ? hrtimer_interrupt+0x101/0x220 Aug 22 19:05:30 juju-e4d256-prod-github-runner-207 kernel: [49304.585788] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 19:05:30 juju-e4d256-prod-github-runner-207 kernel: [49304.586883] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 19:05:30 juju-e4d256-prod-github-runner-207 kernel: [49304.587948] Aug 22 19:05:30 juju-e4d256-prod-github-runner-207 kernel: [49304.588826] Aug 22 19:05:30 juju-e4d256-prod-github-runner-207 kernel: [49304.589724] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 19:05:30 juju-e4d256-prod-github-runner-207 kernel: [49304.590806] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:05:30 juju-e4d256-prod-github-runner-207 kernel: [49304.591869] ? _raw_spin_lock+0x22/0x30 Aug 22 19:05:30 juju-e4d256-prod-github-runner-207 kernel: [49304.592864] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:05:30 juju-e4d256-prod-github-runner-207 kernel: [49304.593902] direct_page_fault+0x206/0x310 [kvm] Aug 22 19:05:30 juju-e4d256-prod-github-runner-207 kernel: [49304.594993] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 19:05:30 juju-e4d256-prod-github-runner-207 kernel: [49304.596099] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 19:05:30 juju-e4d256-prod-github-runner-207 kernel: [49304.597133] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 19:05:30 juju-e4d256-prod-github-runner-207 kernel: [49304.598164] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 19:05:30 juju-e4d256-prod-github-runner-207 kernel: [49304.599120] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 19:05:30 juju-e4d256-prod-github-runner-207 kernel: [49304.600102] handle_exit+0x98/0x230 [kvm_amd] Aug 22 19:05:30 juju-e4d256-prod-github-runner-207 kernel: [49304.601023] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 19:05:30 juju-e4d256-prod-github-runner-207 kernel: [49304.601955] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 19:05:30 juju-e4d256-prod-github-runner-207 kernel: [49304.603098] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 19:05:30 juju-e4d256-prod-github-runner-207 kernel: [49304.604120] vcpu_run+0x62/0x2c0 [kvm] Aug 22 19:05:30 juju-e4d256-prod-github-runner-207 kernel: [49304.604965] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 19:05:30 juju-e4d256-prod-github-runner-207 kernel: [49304.605802] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 19:05:30 juju-e4d256-prod-github-runner-207 kernel: [49304.606715] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 19:05:30 juju-e4d256-prod-github-runner-207 kernel: [49304.607516] ? __seccomp_filter+0x4a/0x4a0 Aug 22 19:05:30 juju-e4d256-prod-github-runner-207 kernel: [49304.608260] ? __fget_files+0x86/0xc0 Aug 22 19:05:30 juju-e4d256-prod-github-runner-207 kernel: [49304.608971] __x64_sys_ioctl+0x95/0xd0 Aug 22 19:05:30 juju-e4d256-prod-github-runner-207 kernel: [49304.609664] do_syscall_64+0x5c/0xc0 Aug 22 19:05:30 juju-e4d256-prod-github-runner-207 kernel: [49304.610450] ? do_futex+0x162/0x1f0 Aug 22 19:05:30 juju-e4d256-prod-github-runner-207 kernel: [49304.611174] ? __x64_sys_futex+0x78/0x1e0 Aug 22 19:05:30 juju-e4d256-prod-github-runner-207 kernel: [49304.611865] ? __secure_computing+0xa9/0x120 Aug 22 19:05:30 juju-e4d256-prod-github-runner-207 kernel: [49304.612558] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 19:05:30 juju-e4d256-prod-github-runner-207 kernel: [49304.613324] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:05:30 juju-e4d256-prod-github-runner-207 kernel: [49304.614076] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:05:30 juju-e4d256-prod-github-runner-207 kernel: [49304.614951] ? do_syscall_64+0x69/0xc0 Aug 22 19:05:30 juju-e4d256-prod-github-runner-207 kernel: [49304.615679] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:05:30 juju-e4d256-prod-github-runner-207 kernel: [49304.616484] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:05:30 juju-e4d256-prod-github-runner-207 kernel: [49304.617284] ? do_syscall_64+0x69/0xc0 Aug 22 19:05:30 juju-e4d256-prod-github-runner-207 kernel: [49304.617994] ? do_syscall_64+0x69/0xc0 Aug 22 19:05:30 juju-e4d256-prod-github-runner-207 kernel: [49304.618724] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 19:05:30 juju-e4d256-prod-github-runner-207 kernel: [49304.619537] RIP: 0033:0x7faa5d0edaff Aug 22 19:05:30 juju-e4d256-prod-github-runner-207 kernel: [49304.620289] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 19:05:30 juju-e4d256-prod-github-runner-207 kernel: [49304.622696] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 19:05:30 juju-e4d256-prod-github-runner-207 kernel: [49304.623769] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 19:05:30 juju-e4d256-prod-github-runner-207 kernel: [49304.624805] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 19:05:30 juju-e4d256-prod-github-runner-207 kernel: [49304.625847] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 19:05:30 juju-e4d256-prod-github-runner-207 kernel: [49304.626930] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 19:05:30 juju-e4d256-prod-github-runner-207 kernel: [49304.627963] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 19:05:30 juju-e4d256-prod-github-runner-207 kernel: [49304.628996] Aug 22 19:05:46 juju-e4d256-prod-github-runner-207 kernel: [49320.476708] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 19:05:46 juju-e4d256-prod-github-runner-207 kernel: [49320.477975] rcu: 1-....: (12262130 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=5928903 Aug 22 19:05:46 juju-e4d256-prod-github-runner-207 kernel: [49320.479294] (t=12300819 jiffies g=23269 q=47139) Aug 22 19:05:46 juju-e4d256-prod-github-runner-207 kernel: [49320.480098] NMI backtrace for cpu 1 Aug 22 19:05:46 juju-e4d256-prod-github-runner-207 kernel: [49320.480814] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 19:05:46 juju-e4d256-prod-github-runner-207 kernel: [49320.481937] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 19:05:46 juju-e4d256-prod-github-runner-207 kernel: [49320.483066] Call Trace: Aug 22 19:05:46 juju-e4d256-prod-github-runner-207 kernel: [49320.483745] Aug 22 19:05:46 juju-e4d256-prod-github-runner-207 kernel: [49320.484391] show_stack+0x52/0x5c Aug 22 19:05:46 juju-e4d256-prod-github-runner-207 kernel: [49320.485117] dump_stack_lvl+0x4a/0x63 Aug 22 19:05:46 juju-e4d256-prod-github-runner-207 kernel: [49320.485886] dump_stack+0x10/0x16 Aug 22 19:05:46 juju-e4d256-prod-github-runner-207 kernel: [49320.486605] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 19:05:46 juju-e4d256-prod-github-runner-207 kernel: [49320.487385] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 19:05:46 juju-e4d256-prod-github-runner-207 kernel: [49320.488169] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 19:05:46 juju-e4d256-prod-github-runner-207 kernel: [49320.488988] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 19:05:46 juju-e4d256-prod-github-runner-207 kernel: [49320.489807] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 19:05:46 juju-e4d256-prod-github-runner-207 kernel: [49320.490626] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 19:05:46 juju-e4d256-prod-github-runner-207 kernel: [49320.491398] print_cpu_stall.cold+0x2f/0xe2 Aug 22 19:05:46 juju-e4d256-prod-github-runner-207 kernel: [49320.492163] ? timekeeping_update+0xf7/0x150 Aug 22 19:05:46 juju-e4d256-prod-github-runner-207 kernel: [49320.492940] check_cpu_stall+0x109/0x270 Aug 22 19:05:46 juju-e4d256-prod-github-runner-207 kernel: [49320.493688] rcu_sched_clock_irq+0x9a/0x250 Aug 22 19:05:46 juju-e4d256-prod-github-runner-207 kernel: [49320.494460] update_process_times+0x94/0xd0 Aug 22 19:05:46 juju-e4d256-prod-github-runner-207 kernel: [49320.495221] tick_sched_handle+0x29/0x70 Aug 22 19:05:46 juju-e4d256-prod-github-runner-207 kernel: [49320.495971] tick_sched_timer+0x8c/0xc0 Aug 22 19:05:46 juju-e4d256-prod-github-runner-207 kernel: [49320.496707] ? tick_nohz_handler+0xb0/0xb0 Aug 22 19:05:46 juju-e4d256-prod-github-runner-207 kernel: [49320.497461] __hrtimer_run_queues+0x107/0x230 Aug 22 19:05:46 juju-e4d256-prod-github-runner-207 kernel: [49320.498242] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 19:05:46 juju-e4d256-prod-github-runner-207 kernel: [49320.499024] hrtimer_interrupt+0x101/0x220 Aug 22 19:05:46 juju-e4d256-prod-github-runner-207 kernel: [49320.499783] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 19:05:46 juju-e4d256-prod-github-runner-207 kernel: [49320.500593] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 19:05:46 juju-e4d256-prod-github-runner-207 kernel: [49320.501396] Aug 22 19:05:46 juju-e4d256-prod-github-runner-207 kernel: [49320.502044] Aug 22 19:05:46 juju-e4d256-prod-github-runner-207 kernel: [49320.502673] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 19:05:46 juju-e4d256-prod-github-runner-207 kernel: [49320.503492] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:05:46 juju-e4d256-prod-github-runner-207 kernel: [49320.504369] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 19:05:46 juju-e4d256-prod-github-runner-207 kernel: [49320.506623] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 19:05:46 juju-e4d256-prod-github-runner-207 kernel: [49320.507503] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 19:05:46 juju-e4d256-prod-github-runner-207 kernel: [49320.508499] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 19:05:46 juju-e4d256-prod-github-runner-207 kernel: [49320.509479] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 19:05:46 juju-e4d256-prod-github-runner-207 kernel: [49320.510453] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 19:05:46 juju-e4d256-prod-github-runner-207 kernel: [49320.511413] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 19:05:46 juju-e4d256-prod-github-runner-207 kernel: [49320.512379] ? _raw_spin_lock+0x22/0x30 Aug 22 19:05:46 juju-e4d256-prod-github-runner-207 kernel: [49320.513140] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:05:46 juju-e4d256-prod-github-runner-207 kernel: [49320.513984] direct_page_fault+0x206/0x310 [kvm] Aug 22 19:05:46 juju-e4d256-prod-github-runner-207 kernel: [49320.514821] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 19:05:46 juju-e4d256-prod-github-runner-207 kernel: [49320.515648] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 19:05:46 juju-e4d256-prod-github-runner-207 kernel: [49320.516469] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 19:05:46 juju-e4d256-prod-github-runner-207 kernel: [49320.517273] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 19:05:46 juju-e4d256-prod-github-runner-207 kernel: [49320.518074] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 19:05:46 juju-e4d256-prod-github-runner-207 kernel: [49320.518896] handle_exit+0x98/0x230 [kvm_amd] Aug 22 19:05:46 juju-e4d256-prod-github-runner-207 kernel: [49320.519663] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 19:05:46 juju-e4d256-prod-github-runner-207 kernel: [49320.520443] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 19:05:46 juju-e4d256-prod-github-runner-207 kernel: [49320.521238] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 19:05:46 juju-e4d256-prod-github-runner-207 kernel: [49320.522046] vcpu_run+0x62/0x2c0 [kvm] Aug 22 19:05:46 juju-e4d256-prod-github-runner-207 kernel: [49320.522760] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 19:05:46 juju-e4d256-prod-github-runner-207 kernel: [49320.523511] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 19:05:46 juju-e4d256-prod-github-runner-207 kernel: [49320.524315] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 19:05:46 juju-e4d256-prod-github-runner-207 kernel: [49320.525075] ? __seccomp_filter+0x4a/0x4a0 Aug 22 19:05:46 juju-e4d256-prod-github-runner-207 kernel: [49320.525794] ? __fget_files+0x86/0xc0 Aug 22 19:05:46 juju-e4d256-prod-github-runner-207 kernel: [49320.526499] __x64_sys_ioctl+0x95/0xd0 Aug 22 19:05:46 juju-e4d256-prod-github-runner-207 kernel: [49320.527195] do_syscall_64+0x5c/0xc0 Aug 22 19:05:46 juju-e4d256-prod-github-runner-207 kernel: [49320.527877] ? do_futex+0x162/0x1f0 Aug 22 19:05:46 juju-e4d256-prod-github-runner-207 kernel: [49320.528568] ? __x64_sys_futex+0x78/0x1e0 Aug 22 19:05:46 juju-e4d256-prod-github-runner-207 kernel: [49320.529271] ? __secure_computing+0xa9/0x120 Aug 22 19:05:46 juju-e4d256-prod-github-runner-207 kernel: [49320.530005] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 19:05:46 juju-e4d256-prod-github-runner-207 kernel: [49320.530796] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:05:46 juju-e4d256-prod-github-runner-207 kernel: [49320.531580] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:05:46 juju-e4d256-prod-github-runner-207 kernel: [49320.532333] ? do_syscall_64+0x69/0xc0 Aug 22 19:05:46 juju-e4d256-prod-github-runner-207 kernel: [49320.533031] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:05:46 juju-e4d256-prod-github-runner-207 kernel: [49320.534018] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:05:46 juju-e4d256-prod-github-runner-207 kernel: [49320.535026] ? do_syscall_64+0x69/0xc0 Aug 22 19:05:46 juju-e4d256-prod-github-runner-207 kernel: [49320.535984] ? do_syscall_64+0x69/0xc0 Aug 22 19:05:46 juju-e4d256-prod-github-runner-207 kernel: [49320.536806] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 19:05:46 juju-e4d256-prod-github-runner-207 kernel: [49320.537640] RIP: 0033:0x7faa5d0edaff Aug 22 19:05:46 juju-e4d256-prod-github-runner-207 kernel: [49320.538439] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 19:05:46 juju-e4d256-prod-github-runner-207 kernel: [49320.541075] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 19:05:46 juju-e4d256-prod-github-runner-207 kernel: [49320.542173] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 19:05:46 juju-e4d256-prod-github-runner-207 kernel: [49320.543122] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 19:05:46 juju-e4d256-prod-github-runner-207 kernel: [49320.544073] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 19:05:46 juju-e4d256-prod-github-runner-207 kernel: [49320.545016] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 19:05:46 juju-e4d256-prod-github-runner-207 kernel: [49320.545967] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 19:05:46 juju-e4d256-prod-github-runner-207 kernel: [49320.546883] Aug 22 19:06:10 juju-e4d256-prod-github-runner-207 kernel: [49344.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 45847s! [qemu-system-x86:6715] Aug 22 19:06:10 juju-e4d256-prod-github-runner-207 kernel: [49344.543114] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 19:06:10 juju-e4d256-prod-github-runner-207 kernel: [49344.543182] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 19:06:10 juju-e4d256-prod-github-runner-207 kernel: [49344.555431] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 19:06:10 juju-e4d256-prod-github-runner-207 kernel: [49344.556702] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 19:06:10 juju-e4d256-prod-github-runner-207 kernel: [49344.557947] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:06:10 juju-e4d256-prod-github-runner-207 kernel: [49344.559005] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 19:06:10 juju-e4d256-prod-github-runner-207 kernel: [49344.561563] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 19:06:10 juju-e4d256-prod-github-runner-207 kernel: [49344.562611] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 19:06:10 juju-e4d256-prod-github-runner-207 kernel: [49344.563770] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 19:06:10 juju-e4d256-prod-github-runner-207 kernel: [49344.564932] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 19:06:10 juju-e4d256-prod-github-runner-207 kernel: [49344.566106] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 19:06:10 juju-e4d256-prod-github-runner-207 kernel: [49344.567264] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 19:06:10 juju-e4d256-prod-github-runner-207 kernel: [49344.568433] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 19:06:10 juju-e4d256-prod-github-runner-207 kernel: [49344.569684] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 19:06:10 juju-e4d256-prod-github-runner-207 kernel: [49344.570788] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 19:06:10 juju-e4d256-prod-github-runner-207 kernel: [49344.572022] Call Trace: Aug 22 19:06:10 juju-e4d256-prod-github-runner-207 kernel: [49344.572940] Aug 22 19:06:10 juju-e4d256-prod-github-runner-207 kernel: [49344.573856] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:06:10 juju-e4d256-prod-github-runner-207 kernel: [49344.574899] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:06:10 juju-e4d256-prod-github-runner-207 kernel: [49344.575956] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:06:10 juju-e4d256-prod-github-runner-207 kernel: [49344.577051] ? show_regs.part.0+0x23/0x29 Aug 22 19:06:10 juju-e4d256-prod-github-runner-207 kernel: [49344.578093] ? show_regs.cold+0x8/0xd Aug 22 19:06:10 juju-e4d256-prod-github-runner-207 kernel: [49344.579102] ? watchdog_timer_fn+0x1be/0x220 Aug 22 19:06:10 juju-e4d256-prod-github-runner-207 kernel: [49344.580236] ? lockup_detector_update_enable+0x60/0x60 Aug 22 19:06:10 juju-e4d256-prod-github-runner-207 kernel: [49344.581413] ? __hrtimer_run_queues+0x107/0x230 Aug 22 19:06:10 juju-e4d256-prod-github-runner-207 kernel: [49344.582575] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 19:06:10 juju-e4d256-prod-github-runner-207 kernel: [49344.583725] ? hrtimer_interrupt+0x101/0x220 Aug 22 19:06:10 juju-e4d256-prod-github-runner-207 kernel: [49344.584859] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 19:06:10 juju-e4d256-prod-github-runner-207 kernel: [49344.586060] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 19:06:10 juju-e4d256-prod-github-runner-207 kernel: [49344.587213] Aug 22 19:06:10 juju-e4d256-prod-github-runner-207 kernel: [49344.588145] Aug 22 19:06:10 juju-e4d256-prod-github-runner-207 kernel: [49344.589052] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 19:06:10 juju-e4d256-prod-github-runner-207 kernel: [49344.590232] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:06:10 juju-e4d256-prod-github-runner-207 kernel: [49344.591390] ? _raw_spin_lock+0x22/0x30 Aug 22 19:06:10 juju-e4d256-prod-github-runner-207 kernel: [49344.592417] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:06:10 juju-e4d256-prod-github-runner-207 kernel: [49344.593578] direct_page_fault+0x206/0x310 [kvm] Aug 22 19:06:10 juju-e4d256-prod-github-runner-207 kernel: [49344.594714] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 19:06:10 juju-e4d256-prod-github-runner-207 kernel: [49344.595824] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 19:06:10 juju-e4d256-prod-github-runner-207 kernel: [49344.596911] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 19:06:10 juju-e4d256-prod-github-runner-207 kernel: [49344.598000] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 19:06:10 juju-e4d256-prod-github-runner-207 kernel: [49344.599056] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 19:06:10 juju-e4d256-prod-github-runner-207 kernel: [49344.600156] handle_exit+0x98/0x230 [kvm_amd] Aug 22 19:06:10 juju-e4d256-prod-github-runner-207 kernel: [49344.601146] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 19:06:10 juju-e4d256-prod-github-runner-207 kernel: [49344.602183] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 19:06:10 juju-e4d256-prod-github-runner-207 kernel: [49344.603208] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 19:06:10 juju-e4d256-prod-github-runner-207 kernel: [49344.604208] vcpu_run+0x62/0x2c0 [kvm] Aug 22 19:06:10 juju-e4d256-prod-github-runner-207 kernel: [49344.605097] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 19:06:10 juju-e4d256-prod-github-runner-207 kernel: [49344.606018] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 19:06:10 juju-e4d256-prod-github-runner-207 kernel: [49344.606981] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 19:06:10 juju-e4d256-prod-github-runner-207 kernel: [49344.607864] ? __seccomp_filter+0x4a/0x4a0 Aug 22 19:06:10 juju-e4d256-prod-github-runner-207 kernel: [49344.608695] ? __fget_files+0x86/0xc0 Aug 22 19:06:10 juju-e4d256-prod-github-runner-207 kernel: [49344.609481] __x64_sys_ioctl+0x95/0xd0 Aug 22 19:06:10 juju-e4d256-prod-github-runner-207 kernel: [49344.610293] do_syscall_64+0x5c/0xc0 Aug 22 19:06:10 juju-e4d256-prod-github-runner-207 kernel: [49344.611032] ? do_futex+0x162/0x1f0 Aug 22 19:06:10 juju-e4d256-prod-github-runner-207 kernel: [49344.611767] ? __x64_sys_futex+0x78/0x1e0 Aug 22 19:06:10 juju-e4d256-prod-github-runner-207 kernel: [49344.612524] ? __secure_computing+0xa9/0x120 Aug 22 19:06:10 juju-e4d256-prod-github-runner-207 kernel: [49344.613318] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 19:06:10 juju-e4d256-prod-github-runner-207 kernel: [49344.614240] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:06:10 juju-e4d256-prod-github-runner-207 kernel: [49344.615064] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:06:10 juju-e4d256-prod-github-runner-207 kernel: [49344.615885] ? do_syscall_64+0x69/0xc0 Aug 22 19:06:10 juju-e4d256-prod-github-runner-207 kernel: [49344.616613] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:06:10 juju-e4d256-prod-github-runner-207 kernel: [49344.617413] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:06:10 juju-e4d256-prod-github-runner-207 kernel: [49344.618232] ? do_syscall_64+0x69/0xc0 Aug 22 19:06:10 juju-e4d256-prod-github-runner-207 kernel: [49344.618942] ? do_syscall_64+0x69/0xc0 Aug 22 19:06:10 juju-e4d256-prod-github-runner-207 kernel: [49344.619652] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 19:06:10 juju-e4d256-prod-github-runner-207 kernel: [49344.620466] RIP: 0033:0x7faa5d0edaff Aug 22 19:06:10 juju-e4d256-prod-github-runner-207 kernel: [49344.621175] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 19:06:10 juju-e4d256-prod-github-runner-207 kernel: [49344.623526] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 19:06:10 juju-e4d256-prod-github-runner-207 kernel: [49344.624580] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 19:06:10 juju-e4d256-prod-github-runner-207 kernel: [49344.625493] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 19:06:10 juju-e4d256-prod-github-runner-207 kernel: [49344.626415] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 19:06:10 juju-e4d256-prod-github-runner-207 kernel: [49344.627464] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 19:06:10 juju-e4d256-prod-github-runner-207 kernel: [49344.628501] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 19:06:10 juju-e4d256-prod-github-runner-207 kernel: [49344.629570] Aug 22 19:06:38 juju-e4d256-prod-github-runner-207 kernel: [49372.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 45873s! [qemu-system-x86:6715] Aug 22 19:06:38 juju-e4d256-prod-github-runner-207 kernel: [49372.543205] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 19:06:38 juju-e4d256-prod-github-runner-207 kernel: [49372.543432] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 19:06:38 juju-e4d256-prod-github-runner-207 kernel: [49372.555719] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 19:06:38 juju-e4d256-prod-github-runner-207 kernel: [49372.556979] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 19:06:38 juju-e4d256-prod-github-runner-207 kernel: [49372.558214] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:06:38 juju-e4d256-prod-github-runner-207 kernel: [49372.559307] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 19:06:38 juju-e4d256-prod-github-runner-207 kernel: [49372.562391] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 19:06:38 juju-e4d256-prod-github-runner-207 kernel: [49372.563552] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 19:06:38 juju-e4d256-prod-github-runner-207 kernel: [49372.564842] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 19:06:38 juju-e4d256-prod-github-runner-207 kernel: [49372.566149] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 19:06:38 juju-e4d256-prod-github-runner-207 kernel: [49372.567435] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 19:06:38 juju-e4d256-prod-github-runner-207 kernel: [49372.568730] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 19:06:38 juju-e4d256-prod-github-runner-207 kernel: [49372.570037] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 19:06:38 juju-e4d256-prod-github-runner-207 kernel: [49372.571423] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 19:06:38 juju-e4d256-prod-github-runner-207 kernel: [49372.572632] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 19:06:38 juju-e4d256-prod-github-runner-207 kernel: [49372.573967] Call Trace: Aug 22 19:06:38 juju-e4d256-prod-github-runner-207 kernel: [49372.574934] Aug 22 19:06:38 juju-e4d256-prod-github-runner-207 kernel: [49372.575885] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:06:38 juju-e4d256-prod-github-runner-207 kernel: [49372.576995] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:06:38 juju-e4d256-prod-github-runner-207 kernel: [49372.578113] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:06:38 juju-e4d256-prod-github-runner-207 kernel: [49372.579292] ? show_regs.part.0+0x23/0x29 Aug 22 19:06:38 juju-e4d256-prod-github-runner-207 kernel: [49372.580365] ? show_regs.cold+0x8/0xd Aug 22 19:06:38 juju-e4d256-prod-github-runner-207 kernel: [49372.581636] ? watchdog_timer_fn+0x1be/0x220 Aug 22 19:06:38 juju-e4d256-prod-github-runner-207 kernel: [49372.582743] ? lockup_detector_update_enable+0x60/0x60 Aug 22 19:06:38 juju-e4d256-prod-github-runner-207 kernel: [49372.583912] ? __hrtimer_run_queues+0x107/0x230 Aug 22 19:06:38 juju-e4d256-prod-github-runner-207 kernel: [49372.585032] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 19:06:38 juju-e4d256-prod-github-runner-207 kernel: [49372.586157] ? hrtimer_interrupt+0x101/0x220 Aug 22 19:06:38 juju-e4d256-prod-github-runner-207 kernel: [49372.587255] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 19:06:38 juju-e4d256-prod-github-runner-207 kernel: [49372.588422] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 19:06:38 juju-e4d256-prod-github-runner-207 kernel: [49372.589569] Aug 22 19:06:38 juju-e4d256-prod-github-runner-207 kernel: [49372.590474] Aug 22 19:06:38 juju-e4d256-prod-github-runner-207 kernel: [49372.591370] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 19:06:38 juju-e4d256-prod-github-runner-207 kernel: [49372.592507] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:06:38 juju-e4d256-prod-github-runner-207 kernel: [49372.593671] ? _raw_spin_lock+0x22/0x30 Aug 22 19:06:38 juju-e4d256-prod-github-runner-207 kernel: [49372.594694] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:06:38 juju-e4d256-prod-github-runner-207 kernel: [49372.595801] direct_page_fault+0x206/0x310 [kvm] Aug 22 19:06:38 juju-e4d256-prod-github-runner-207 kernel: [49372.596913] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 19:06:38 juju-e4d256-prod-github-runner-207 kernel: [49372.598019] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 19:06:38 juju-e4d256-prod-github-runner-207 kernel: [49372.599107] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 19:06:38 juju-e4d256-prod-github-runner-207 kernel: [49372.600188] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 19:06:38 juju-e4d256-prod-github-runner-207 kernel: [49372.601250] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 19:06:38 juju-e4d256-prod-github-runner-207 kernel: [49372.602368] handle_exit+0x98/0x230 [kvm_amd] Aug 22 19:06:38 juju-e4d256-prod-github-runner-207 kernel: [49372.603352] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 19:06:38 juju-e4d256-prod-github-runner-207 kernel: [49372.604355] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 19:06:38 juju-e4d256-prod-github-runner-207 kernel: [49372.605402] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 19:06:38 juju-e4d256-prod-github-runner-207 kernel: [49372.606408] vcpu_run+0x62/0x2c0 [kvm] Aug 22 19:06:38 juju-e4d256-prod-github-runner-207 kernel: [49372.607300] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 19:06:38 juju-e4d256-prod-github-runner-207 kernel: [49372.608200] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 19:06:38 juju-e4d256-prod-github-runner-207 kernel: [49372.609151] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 19:06:38 juju-e4d256-prod-github-runner-207 kernel: [49372.610052] ? __seccomp_filter+0x4a/0x4a0 Aug 22 19:06:38 juju-e4d256-prod-github-runner-207 kernel: [49372.610878] ? __fget_files+0x86/0xc0 Aug 22 19:06:38 juju-e4d256-prod-github-runner-207 kernel: [49372.611685] __x64_sys_ioctl+0x95/0xd0 Aug 22 19:06:38 juju-e4d256-prod-github-runner-207 kernel: [49372.612470] do_syscall_64+0x5c/0xc0 Aug 22 19:06:38 juju-e4d256-prod-github-runner-207 kernel: [49372.613238] ? do_futex+0x162/0x1f0 Aug 22 19:06:38 juju-e4d256-prod-github-runner-207 kernel: [49372.613956] ? __x64_sys_futex+0x78/0x1e0 Aug 22 19:06:38 juju-e4d256-prod-github-runner-207 kernel: [49372.614702] ? __secure_computing+0xa9/0x120 Aug 22 19:06:38 juju-e4d256-prod-github-runner-207 kernel: [49372.615469] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 19:06:38 juju-e4d256-prod-github-runner-207 kernel: [49372.616341] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:06:38 juju-e4d256-prod-github-runner-207 kernel: [49372.617157] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:06:38 juju-e4d256-prod-github-runner-207 kernel: [49372.617976] ? do_syscall_64+0x69/0xc0 Aug 22 19:06:38 juju-e4d256-prod-github-runner-207 kernel: [49372.618693] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:06:38 juju-e4d256-prod-github-runner-207 kernel: [49372.619494] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:06:38 juju-e4d256-prod-github-runner-207 kernel: [49372.620281] ? do_syscall_64+0x69/0xc0 Aug 22 19:06:38 juju-e4d256-prod-github-runner-207 kernel: [49372.620976] ? do_syscall_64+0x69/0xc0 Aug 22 19:06:38 juju-e4d256-prod-github-runner-207 kernel: [49372.621678] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 19:06:38 juju-e4d256-prod-github-runner-207 kernel: [49372.622488] RIP: 0033:0x7faa5d0edaff Aug 22 19:06:38 juju-e4d256-prod-github-runner-207 kernel: [49372.623211] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 19:06:38 juju-e4d256-prod-github-runner-207 kernel: [49372.625546] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 19:06:38 juju-e4d256-prod-github-runner-207 kernel: [49372.626604] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 19:06:38 juju-e4d256-prod-github-runner-207 kernel: [49372.627625] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 19:06:38 juju-e4d256-prod-github-runner-207 kernel: [49372.628647] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 19:06:38 juju-e4d256-prod-github-runner-207 kernel: [49372.629698] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 19:06:38 juju-e4d256-prod-github-runner-207 kernel: [49372.630721] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 19:06:38 juju-e4d256-prod-github-runner-207 kernel: [49372.631742] Aug 22 19:07:06 juju-e4d256-prod-github-runner-207 kernel: [49400.541982] watchdog: BUG: soft lockup - CPU#1 stuck for 45899s! [qemu-system-x86:6715] Aug 22 19:07:06 juju-e4d256-prod-github-runner-207 kernel: [49400.543662] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 19:07:06 juju-e4d256-prod-github-runner-207 kernel: [49400.543809] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 19:07:06 juju-e4d256-prod-github-runner-207 kernel: [49400.555899] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 19:07:06 juju-e4d256-prod-github-runner-207 kernel: [49400.557186] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 19:07:06 juju-e4d256-prod-github-runner-207 kernel: [49400.558413] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:07:06 juju-e4d256-prod-github-runner-207 kernel: [49400.559469] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 19:07:06 juju-e4d256-prod-github-runner-207 kernel: [49400.562026] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 19:07:06 juju-e4d256-prod-github-runner-207 kernel: [49400.563070] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 19:07:06 juju-e4d256-prod-github-runner-207 kernel: [49400.564264] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 19:07:06 juju-e4d256-prod-github-runner-207 kernel: [49400.565440] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 19:07:06 juju-e4d256-prod-github-runner-207 kernel: [49400.566599] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 19:07:06 juju-e4d256-prod-github-runner-207 kernel: [49400.567764] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 19:07:06 juju-e4d256-prod-github-runner-207 kernel: [49400.568961] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 19:07:06 juju-e4d256-prod-github-runner-207 kernel: [49400.570193] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 19:07:06 juju-e4d256-prod-github-runner-207 kernel: [49400.571288] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 19:07:06 juju-e4d256-prod-github-runner-207 kernel: [49400.572479] Call Trace: Aug 22 19:07:06 juju-e4d256-prod-github-runner-207 kernel: [49400.573430] Aug 22 19:07:06 juju-e4d256-prod-github-runner-207 kernel: [49400.574317] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:07:06 juju-e4d256-prod-github-runner-207 kernel: [49400.575347] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:07:06 juju-e4d256-prod-github-runner-207 kernel: [49400.576366] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:07:06 juju-e4d256-prod-github-runner-207 kernel: [49400.577452] ? show_regs.part.0+0x23/0x29 Aug 22 19:07:06 juju-e4d256-prod-github-runner-207 kernel: [49400.578469] ? show_regs.cold+0x8/0xd Aug 22 19:07:06 juju-e4d256-prod-github-runner-207 kernel: [49400.579442] ? watchdog_timer_fn+0x1be/0x220 Aug 22 19:07:06 juju-e4d256-prod-github-runner-207 kernel: [49400.580457] ? lockup_detector_update_enable+0x60/0x60 Aug 22 19:07:06 juju-e4d256-prod-github-runner-207 kernel: [49400.581554] ? __hrtimer_run_queues+0x107/0x230 Aug 22 19:07:06 juju-e4d256-prod-github-runner-207 kernel: [49400.582587] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 19:07:06 juju-e4d256-prod-github-runner-207 kernel: [49400.583616] ? hrtimer_interrupt+0x101/0x220 Aug 22 19:07:06 juju-e4d256-prod-github-runner-207 kernel: [49400.584635] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 19:07:06 juju-e4d256-prod-github-runner-207 kernel: [49400.585725] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 19:07:06 juju-e4d256-prod-github-runner-207 kernel: [49400.586772] Aug 22 19:07:06 juju-e4d256-prod-github-runner-207 kernel: [49400.587627] Aug 22 19:07:06 juju-e4d256-prod-github-runner-207 kernel: [49400.588464] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 19:07:06 juju-e4d256-prod-github-runner-207 kernel: [49400.589540] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:07:06 juju-e4d256-prod-github-runner-207 kernel: [49400.590585] ? _raw_spin_lock+0x22/0x30 Aug 22 19:07:06 juju-e4d256-prod-github-runner-207 kernel: [49400.591531] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:07:06 juju-e4d256-prod-github-runner-207 kernel: [49400.592556] direct_page_fault+0x206/0x310 [kvm] Aug 22 19:07:06 juju-e4d256-prod-github-runner-207 kernel: [49400.593616] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 19:07:06 juju-e4d256-prod-github-runner-207 kernel: [49400.594626] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 19:07:06 juju-e4d256-prod-github-runner-207 kernel: [49400.595626] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 19:07:06 juju-e4d256-prod-github-runner-207 kernel: [49400.596611] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 19:07:06 juju-e4d256-prod-github-runner-207 kernel: [49400.597563] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 19:07:06 juju-e4d256-prod-github-runner-207 kernel: [49400.598561] handle_exit+0x98/0x230 [kvm_amd] Aug 22 19:07:06 juju-e4d256-prod-github-runner-207 kernel: [49400.599459] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 19:07:06 juju-e4d256-prod-github-runner-207 kernel: [49400.600374] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 19:07:06 juju-e4d256-prod-github-runner-207 kernel: [49400.601316] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 19:07:06 juju-e4d256-prod-github-runner-207 kernel: [49400.602221] vcpu_run+0x62/0x2c0 [kvm] Aug 22 19:07:06 juju-e4d256-prod-github-runner-207 kernel: [49400.603038] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 19:07:06 juju-e4d256-prod-github-runner-207 kernel: [49400.603873] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 19:07:06 juju-e4d256-prod-github-runner-207 kernel: [49400.604728] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 19:07:06 juju-e4d256-prod-github-runner-207 kernel: [49400.605544] ? __seccomp_filter+0x4a/0x4a0 Aug 22 19:07:06 juju-e4d256-prod-github-runner-207 kernel: [49400.606288] ? __fget_files+0x86/0xc0 Aug 22 19:07:06 juju-e4d256-prod-github-runner-207 kernel: [49400.606993] __x64_sys_ioctl+0x95/0xd0 Aug 22 19:07:06 juju-e4d256-prod-github-runner-207 kernel: [49400.607685] do_syscall_64+0x5c/0xc0 Aug 22 19:07:06 juju-e4d256-prod-github-runner-207 kernel: [49400.608353] ? do_futex+0x162/0x1f0 Aug 22 19:07:06 juju-e4d256-prod-github-runner-207 kernel: [49400.609043] ? __x64_sys_futex+0x78/0x1e0 Aug 22 19:07:06 juju-e4d256-prod-github-runner-207 kernel: [49400.609723] ? __secure_computing+0xa9/0x120 Aug 22 19:07:06 juju-e4d256-prod-github-runner-207 kernel: [49400.610417] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 19:07:06 juju-e4d256-prod-github-runner-207 kernel: [49400.611178] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:07:06 juju-e4d256-prod-github-runner-207 kernel: [49400.611899] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:07:06 juju-e4d256-prod-github-runner-207 kernel: [49400.612621] ? do_syscall_64+0x69/0xc0 Aug 22 19:07:06 juju-e4d256-prod-github-runner-207 kernel: [49400.613277] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:07:06 juju-e4d256-prod-github-runner-207 kernel: [49400.613980] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:07:06 juju-e4d256-prod-github-runner-207 kernel: [49400.614688] ? do_syscall_64+0x69/0xc0 Aug 22 19:07:06 juju-e4d256-prod-github-runner-207 kernel: [49400.615319] ? do_syscall_64+0x69/0xc0 Aug 22 19:07:06 juju-e4d256-prod-github-runner-207 kernel: [49400.615960] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 19:07:06 juju-e4d256-prod-github-runner-207 kernel: [49400.616701] RIP: 0033:0x7faa5d0edaff Aug 22 19:07:06 juju-e4d256-prod-github-runner-207 kernel: [49400.617364] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 19:07:06 juju-e4d256-prod-github-runner-207 kernel: [49400.619363] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 19:07:06 juju-e4d256-prod-github-runner-207 kernel: [49400.620291] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 19:07:06 juju-e4d256-prod-github-runner-207 kernel: [49400.621207] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 19:07:06 juju-e4d256-prod-github-runner-207 kernel: [49400.622097] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 19:07:06 juju-e4d256-prod-github-runner-207 kernel: [49400.622979] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 19:07:06 juju-e4d256-prod-github-runner-207 kernel: [49400.623864] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 19:07:06 juju-e4d256-prod-github-runner-207 kernel: [49400.624754] Aug 22 19:07:34 juju-e4d256-prod-github-runner-207 kernel: [49428.541980] watchdog: BUG: soft lockup - CPU#1 stuck for 45925s! [qemu-system-x86:6715] Aug 22 19:07:34 juju-e4d256-prod-github-runner-207 kernel: [49428.543097] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 19:07:34 juju-e4d256-prod-github-runner-207 kernel: [49428.543170] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 19:07:34 juju-e4d256-prod-github-runner-207 kernel: [49428.555227] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 19:07:34 juju-e4d256-prod-github-runner-207 kernel: [49428.556499] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 19:07:34 juju-e4d256-prod-github-runner-207 kernel: [49428.557725] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:07:34 juju-e4d256-prod-github-runner-207 kernel: [49428.558780] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 19:07:34 juju-e4d256-prod-github-runner-207 kernel: [49428.561335] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 19:07:34 juju-e4d256-prod-github-runner-207 kernel: [49428.562382] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 19:07:34 juju-e4d256-prod-github-runner-207 kernel: [49428.563541] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 19:07:34 juju-e4d256-prod-github-runner-207 kernel: [49428.564714] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 19:07:34 juju-e4d256-prod-github-runner-207 kernel: [49428.565871] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 19:07:34 juju-e4d256-prod-github-runner-207 kernel: [49428.567030] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 19:07:34 juju-e4d256-prod-github-runner-207 kernel: [49428.568201] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 19:07:34 juju-e4d256-prod-github-runner-207 kernel: [49428.569446] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 19:07:34 juju-e4d256-prod-github-runner-207 kernel: [49428.570541] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 19:07:34 juju-e4d256-prod-github-runner-207 kernel: [49428.571757] Call Trace: Aug 22 19:07:34 juju-e4d256-prod-github-runner-207 kernel: [49428.572701] Aug 22 19:07:34 juju-e4d256-prod-github-runner-207 kernel: [49428.573588] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:07:34 juju-e4d256-prod-github-runner-207 kernel: [49428.574618] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:07:34 juju-e4d256-prod-github-runner-207 kernel: [49428.575641] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:07:34 juju-e4d256-prod-github-runner-207 kernel: [49428.576731] ? show_regs.part.0+0x23/0x29 Aug 22 19:07:34 juju-e4d256-prod-github-runner-207 kernel: [49428.577755] ? show_regs.cold+0x8/0xd Aug 22 19:07:34 juju-e4d256-prod-github-runner-207 kernel: [49428.578736] ? watchdog_timer_fn+0x1be/0x220 Aug 22 19:07:34 juju-e4d256-prod-github-runner-207 kernel: [49428.579746] ? lockup_detector_update_enable+0x60/0x60 Aug 22 19:07:34 juju-e4d256-prod-github-runner-207 kernel: [49428.580829] ? __hrtimer_run_queues+0x107/0x230 Aug 22 19:07:34 juju-e4d256-prod-github-runner-207 kernel: [49428.581861] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 19:07:34 juju-e4d256-prod-github-runner-207 kernel: [49428.582887] ? hrtimer_interrupt+0x101/0x220 Aug 22 19:07:34 juju-e4d256-prod-github-runner-207 kernel: [49428.583901] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 19:07:34 juju-e4d256-prod-github-runner-207 kernel: [49428.584980] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 19:07:34 juju-e4d256-prod-github-runner-207 kernel: [49428.586024] Aug 22 19:07:34 juju-e4d256-prod-github-runner-207 kernel: [49428.586875] Aug 22 19:07:34 juju-e4d256-prod-github-runner-207 kernel: [49428.587710] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 19:07:34 juju-e4d256-prod-github-runner-207 kernel: [49428.588753] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:07:34 juju-e4d256-prod-github-runner-207 kernel: [49428.589796] ? _raw_spin_lock+0x22/0x30 Aug 22 19:07:34 juju-e4d256-prod-github-runner-207 kernel: [49428.590738] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:07:34 juju-e4d256-prod-github-runner-207 kernel: [49428.591751] direct_page_fault+0x206/0x310 [kvm] Aug 22 19:07:34 juju-e4d256-prod-github-runner-207 kernel: [49428.592783] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 19:07:34 juju-e4d256-prod-github-runner-207 kernel: [49428.593794] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 19:07:34 juju-e4d256-prod-github-runner-207 kernel: [49428.594792] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 19:07:34 juju-e4d256-prod-github-runner-207 kernel: [49428.595758] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 19:07:34 juju-e4d256-prod-github-runner-207 kernel: [49428.596712] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 19:07:34 juju-e4d256-prod-github-runner-207 kernel: [49428.597695] handle_exit+0x98/0x230 [kvm_amd] Aug 22 19:07:34 juju-e4d256-prod-github-runner-207 kernel: [49428.598586] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 19:07:34 juju-e4d256-prod-github-runner-207 kernel: [49428.599499] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 19:07:34 juju-e4d256-prod-github-runner-207 kernel: [49428.600470] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 19:07:34 juju-e4d256-prod-github-runner-207 kernel: [49428.601415] vcpu_run+0x62/0x2c0 [kvm] Aug 22 19:07:34 juju-e4d256-prod-github-runner-207 kernel: [49428.602240] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 19:07:34 juju-e4d256-prod-github-runner-207 kernel: [49428.603047] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 19:07:34 juju-e4d256-prod-github-runner-207 kernel: [49428.603907] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 19:07:34 juju-e4d256-prod-github-runner-207 kernel: [49428.604718] ? __seccomp_filter+0x4a/0x4a0 Aug 22 19:07:34 juju-e4d256-prod-github-runner-207 kernel: [49428.605459] ? __fget_files+0x86/0xc0 Aug 22 19:07:34 juju-e4d256-prod-github-runner-207 kernel: [49428.606166] __x64_sys_ioctl+0x95/0xd0 Aug 22 19:07:34 juju-e4d256-prod-github-runner-207 kernel: [49428.606856] do_syscall_64+0x5c/0xc0 Aug 22 19:07:34 juju-e4d256-prod-github-runner-207 kernel: [49428.607556] ? do_futex+0x162/0x1f0 Aug 22 19:07:34 juju-e4d256-prod-github-runner-207 kernel: [49428.608211] ? __x64_sys_futex+0x78/0x1e0 Aug 22 19:07:34 juju-e4d256-prod-github-runner-207 kernel: [49428.608910] ? __secure_computing+0xa9/0x120 Aug 22 19:07:34 juju-e4d256-prod-github-runner-207 kernel: [49428.609599] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 19:07:34 juju-e4d256-prod-github-runner-207 kernel: [49428.610357] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:07:34 juju-e4d256-prod-github-runner-207 kernel: [49428.611075] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:07:34 juju-e4d256-prod-github-runner-207 kernel: [49428.611792] ? do_syscall_64+0x69/0xc0 Aug 22 19:07:34 juju-e4d256-prod-github-runner-207 kernel: [49428.612433] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:07:34 juju-e4d256-prod-github-runner-207 kernel: [49428.613144] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:07:34 juju-e4d256-prod-github-runner-207 kernel: [49428.613845] ? do_syscall_64+0x69/0xc0 Aug 22 19:07:34 juju-e4d256-prod-github-runner-207 kernel: [49428.614466] ? do_syscall_64+0x69/0xc0 Aug 22 19:07:34 juju-e4d256-prod-github-runner-207 kernel: [49428.615090] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 19:07:34 juju-e4d256-prod-github-runner-207 kernel: [49428.615789] RIP: 0033:0x7faa5d0edaff Aug 22 19:07:34 juju-e4d256-prod-github-runner-207 kernel: [49428.616411] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 19:07:34 juju-e4d256-prod-github-runner-207 kernel: [49428.618405] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 19:07:34 juju-e4d256-prod-github-runner-207 kernel: [49428.619319] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 19:07:34 juju-e4d256-prod-github-runner-207 kernel: [49428.620207] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 19:07:34 juju-e4d256-prod-github-runner-207 kernel: [49428.621186] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 19:07:34 juju-e4d256-prod-github-runner-207 kernel: [49428.622069] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 19:07:34 juju-e4d256-prod-github-runner-207 kernel: [49428.622951] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 19:07:34 juju-e4d256-prod-github-runner-207 kernel: [49428.623838] Aug 22 19:08:02 juju-e4d256-prod-github-runner-207 kernel: [49456.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 45951s! [qemu-system-x86:6715] Aug 22 19:08:02 juju-e4d256-prod-github-runner-207 kernel: [49456.543131] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 19:08:02 juju-e4d256-prod-github-runner-207 kernel: [49456.543201] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 19:08:02 juju-e4d256-prod-github-runner-207 kernel: [49456.555333] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 19:08:02 juju-e4d256-prod-github-runner-207 kernel: [49456.556630] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 19:08:02 juju-e4d256-prod-github-runner-207 kernel: [49456.557861] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:08:02 juju-e4d256-prod-github-runner-207 kernel: [49456.558946] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 19:08:02 juju-e4d256-prod-github-runner-207 kernel: [49456.561880] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 19:08:02 juju-e4d256-prod-github-runner-207 kernel: [49456.563056] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 19:08:02 juju-e4d256-prod-github-runner-207 kernel: [49456.564391] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 19:08:02 juju-e4d256-prod-github-runner-207 kernel: [49456.565690] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 19:08:02 juju-e4d256-prod-github-runner-207 kernel: [49456.567020] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 19:08:02 juju-e4d256-prod-github-runner-207 kernel: [49456.568239] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 19:08:02 juju-e4d256-prod-github-runner-207 kernel: [49456.569436] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 19:08:02 juju-e4d256-prod-github-runner-207 kernel: [49456.570810] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 19:08:02 juju-e4d256-prod-github-runner-207 kernel: [49456.572004] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 19:08:02 juju-e4d256-prod-github-runner-207 kernel: [49456.573273] Call Trace: Aug 22 19:08:02 juju-e4d256-prod-github-runner-207 kernel: [49456.574213] Aug 22 19:08:02 juju-e4d256-prod-github-runner-207 kernel: [49456.575262] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:08:02 juju-e4d256-prod-github-runner-207 kernel: [49456.576320] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:08:02 juju-e4d256-prod-github-runner-207 kernel: [49456.577351] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:08:02 juju-e4d256-prod-github-runner-207 kernel: [49456.578428] ? show_regs.part.0+0x23/0x29 Aug 22 19:08:02 juju-e4d256-prod-github-runner-207 kernel: [49456.579427] ? show_regs.cold+0x8/0xd Aug 22 19:08:02 juju-e4d256-prod-github-runner-207 kernel: [49456.580425] ? watchdog_timer_fn+0x1be/0x220 Aug 22 19:08:02 juju-e4d256-prod-github-runner-207 kernel: [49456.581438] ? lockup_detector_update_enable+0x60/0x60 Aug 22 19:08:02 juju-e4d256-prod-github-runner-207 kernel: [49456.582504] ? __hrtimer_run_queues+0x107/0x230 Aug 22 19:08:02 juju-e4d256-prod-github-runner-207 kernel: [49456.583666] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 19:08:02 juju-e4d256-prod-github-runner-207 kernel: [49456.584837] ? hrtimer_interrupt+0x101/0x220 Aug 22 19:08:02 juju-e4d256-prod-github-runner-207 kernel: [49456.585911] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 19:08:02 juju-e4d256-prod-github-runner-207 kernel: [49456.587097] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 19:08:02 juju-e4d256-prod-github-runner-207 kernel: [49456.588180] Aug 22 19:08:02 juju-e4d256-prod-github-runner-207 kernel: [49456.589037] Aug 22 19:08:02 juju-e4d256-prod-github-runner-207 kernel: [49456.589903] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 19:08:02 juju-e4d256-prod-github-runner-207 kernel: [49456.591103] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:08:02 juju-e4d256-prod-github-runner-207 kernel: [49456.592280] ? _raw_spin_lock+0x22/0x30 Aug 22 19:08:02 juju-e4d256-prod-github-runner-207 kernel: [49456.593359] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:08:02 juju-e4d256-prod-github-runner-207 kernel: [49456.594448] direct_page_fault+0x206/0x310 [kvm] Aug 22 19:08:02 juju-e4d256-prod-github-runner-207 kernel: [49456.595619] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 19:08:02 juju-e4d256-prod-github-runner-207 kernel: [49456.596739] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 19:08:02 juju-e4d256-prod-github-runner-207 kernel: [49456.597794] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 19:08:02 juju-e4d256-prod-github-runner-207 kernel: [49456.598765] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 19:08:02 juju-e4d256-prod-github-runner-207 kernel: [49456.599715] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 19:08:02 juju-e4d256-prod-github-runner-207 kernel: [49456.600709] handle_exit+0x98/0x230 [kvm_amd] Aug 22 19:08:02 juju-e4d256-prod-github-runner-207 kernel: [49456.601609] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 19:08:02 juju-e4d256-prod-github-runner-207 kernel: [49456.602525] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 19:08:02 juju-e4d256-prod-github-runner-207 kernel: [49456.603463] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 19:08:02 juju-e4d256-prod-github-runner-207 kernel: [49456.604391] vcpu_run+0x62/0x2c0 [kvm] Aug 22 19:08:02 juju-e4d256-prod-github-runner-207 kernel: [49456.605203] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 19:08:02 juju-e4d256-prod-github-runner-207 kernel: [49456.606026] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 19:08:02 juju-e4d256-prod-github-runner-207 kernel: [49456.606884] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 19:08:02 juju-e4d256-prod-github-runner-207 kernel: [49456.607682] ? __seccomp_filter+0x4a/0x4a0 Aug 22 19:08:02 juju-e4d256-prod-github-runner-207 kernel: [49456.608436] ? __fget_files+0x86/0xc0 Aug 22 19:08:02 juju-e4d256-prod-github-runner-207 kernel: [49456.609144] __x64_sys_ioctl+0x95/0xd0 Aug 22 19:08:02 juju-e4d256-prod-github-runner-207 kernel: [49456.609842] do_syscall_64+0x5c/0xc0 Aug 22 19:08:02 juju-e4d256-prod-github-runner-207 kernel: [49456.610508] ? do_futex+0x162/0x1f0 Aug 22 19:08:02 juju-e4d256-prod-github-runner-207 kernel: [49456.611160] ? __x64_sys_futex+0x78/0x1e0 Aug 22 19:08:02 juju-e4d256-prod-github-runner-207 kernel: [49456.611862] ? __secure_computing+0xa9/0x120 Aug 22 19:08:02 juju-e4d256-prod-github-runner-207 kernel: [49456.612567] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 19:08:02 juju-e4d256-prod-github-runner-207 kernel: [49456.613341] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:08:02 juju-e4d256-prod-github-runner-207 kernel: [49456.614067] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:08:02 juju-e4d256-prod-github-runner-207 kernel: [49456.614787] ? do_syscall_64+0x69/0xc0 Aug 22 19:08:02 juju-e4d256-prod-github-runner-207 kernel: [49456.615438] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:08:02 juju-e4d256-prod-github-runner-207 kernel: [49456.616161] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:08:02 juju-e4d256-prod-github-runner-207 kernel: [49456.616862] ? do_syscall_64+0x69/0xc0 Aug 22 19:08:02 juju-e4d256-prod-github-runner-207 kernel: [49456.617489] ? do_syscall_64+0x69/0xc0 Aug 22 19:08:02 juju-e4d256-prod-github-runner-207 kernel: [49456.618111] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 19:08:02 juju-e4d256-prod-github-runner-207 kernel: [49456.618816] RIP: 0033:0x7faa5d0edaff Aug 22 19:08:02 juju-e4d256-prod-github-runner-207 kernel: [49456.619442] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 19:08:02 juju-e4d256-prod-github-runner-207 kernel: [49456.621443] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 19:08:02 juju-e4d256-prod-github-runner-207 kernel: [49456.622364] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 19:08:02 juju-e4d256-prod-github-runner-207 kernel: [49456.623262] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 19:08:02 juju-e4d256-prod-github-runner-207 kernel: [49456.624165] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 19:08:02 juju-e4d256-prod-github-runner-207 kernel: [49456.625059] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 19:08:02 juju-e4d256-prod-github-runner-207 kernel: [49456.625977] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 19:08:02 juju-e4d256-prod-github-runner-207 kernel: [49456.627049] Aug 22 19:08:30 juju-e4d256-prod-github-runner-207 kernel: [49484.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 45978s! [qemu-system-x86:6715] Aug 22 19:08:30 juju-e4d256-prod-github-runner-207 kernel: [49484.543988] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 19:08:30 juju-e4d256-prod-github-runner-207 kernel: [49484.544228] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 19:08:30 juju-e4d256-prod-github-runner-207 kernel: [49484.556446] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 19:08:30 juju-e4d256-prod-github-runner-207 kernel: [49484.557752] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 19:08:30 juju-e4d256-prod-github-runner-207 kernel: [49484.559007] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:08:30 juju-e4d256-prod-github-runner-207 kernel: [49484.560089] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 19:08:30 juju-e4d256-prod-github-runner-207 kernel: [49484.562676] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 19:08:30 juju-e4d256-prod-github-runner-207 kernel: [49484.563756] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 19:08:30 juju-e4d256-prod-github-runner-207 kernel: [49484.564989] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 19:08:30 juju-e4d256-prod-github-runner-207 kernel: [49484.566156] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 19:08:30 juju-e4d256-prod-github-runner-207 kernel: [49484.567318] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 19:08:30 juju-e4d256-prod-github-runner-207 kernel: [49484.568516] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 19:08:30 juju-e4d256-prod-github-runner-207 kernel: [49484.569715] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 19:08:30 juju-e4d256-prod-github-runner-207 kernel: [49484.570951] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 19:08:30 juju-e4d256-prod-github-runner-207 kernel: [49484.572081] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 19:08:30 juju-e4d256-prod-github-runner-207 kernel: [49484.573302] Call Trace: Aug 22 19:08:30 juju-e4d256-prod-github-runner-207 kernel: [49484.574232] Aug 22 19:08:30 juju-e4d256-prod-github-runner-207 kernel: [49484.575131] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:08:30 juju-e4d256-prod-github-runner-207 kernel: [49484.576191] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:08:30 juju-e4d256-prod-github-runner-207 kernel: [49484.577219] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:08:30 juju-e4d256-prod-github-runner-207 kernel: [49484.578332] ? show_regs.part.0+0x23/0x29 Aug 22 19:08:30 juju-e4d256-prod-github-runner-207 kernel: [49484.579383] ? show_regs.cold+0x8/0xd Aug 22 19:08:30 juju-e4d256-prod-github-runner-207 kernel: [49484.580389] ? watchdog_timer_fn+0x1be/0x220 Aug 22 19:08:30 juju-e4d256-prod-github-runner-207 kernel: [49484.581401] ? lockup_detector_update_enable+0x60/0x60 Aug 22 19:08:30 juju-e4d256-prod-github-runner-207 kernel: [49484.582463] ? __hrtimer_run_queues+0x107/0x230 Aug 22 19:08:30 juju-e4d256-prod-github-runner-207 kernel: [49484.583508] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 19:08:30 juju-e4d256-prod-github-runner-207 kernel: [49484.584588] ? hrtimer_interrupt+0x101/0x220 Aug 22 19:08:30 juju-e4d256-prod-github-runner-207 kernel: [49484.585609] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 19:08:30 juju-e4d256-prod-github-runner-207 kernel: [49484.586683] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 19:08:30 juju-e4d256-prod-github-runner-207 kernel: [49484.587730] Aug 22 19:08:30 juju-e4d256-prod-github-runner-207 kernel: [49484.588653] Aug 22 19:08:30 juju-e4d256-prod-github-runner-207 kernel: [49484.589527] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 19:08:30 juju-e4d256-prod-github-runner-207 kernel: [49484.590576] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:08:30 juju-e4d256-prod-github-runner-207 kernel: [49484.591618] ? _raw_spin_lock+0x22/0x30 Aug 22 19:08:30 juju-e4d256-prod-github-runner-207 kernel: [49484.592593] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:08:30 juju-e4d256-prod-github-runner-207 kernel: [49484.593647] direct_page_fault+0x206/0x310 [kvm] Aug 22 19:08:30 juju-e4d256-prod-github-runner-207 kernel: [49484.594685] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 19:08:30 juju-e4d256-prod-github-runner-207 kernel: [49484.595703] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 19:08:30 juju-e4d256-prod-github-runner-207 kernel: [49484.596735] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 19:08:30 juju-e4d256-prod-github-runner-207 kernel: [49484.597743] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 19:08:30 juju-e4d256-prod-github-runner-207 kernel: [49484.598708] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 19:08:30 juju-e4d256-prod-github-runner-207 kernel: [49484.599699] handle_exit+0x98/0x230 [kvm_amd] Aug 22 19:08:30 juju-e4d256-prod-github-runner-207 kernel: [49484.600817] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 19:08:30 juju-e4d256-prod-github-runner-207 kernel: [49484.601740] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 19:08:30 juju-e4d256-prod-github-runner-207 kernel: [49484.602842] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 19:08:30 juju-e4d256-prod-github-runner-207 kernel: [49484.603891] vcpu_run+0x62/0x2c0 [kvm] Aug 22 19:08:30 juju-e4d256-prod-github-runner-207 kernel: [49484.604790] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 19:08:30 juju-e4d256-prod-github-runner-207 kernel: [49484.605691] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 19:08:30 juju-e4d256-prod-github-runner-207 kernel: [49484.606653] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 19:08:30 juju-e4d256-prod-github-runner-207 kernel: [49484.607539] ? __seccomp_filter+0x4a/0x4a0 Aug 22 19:08:30 juju-e4d256-prod-github-runner-207 kernel: [49484.608397] ? __fget_files+0x86/0xc0 Aug 22 19:08:30 juju-e4d256-prod-github-runner-207 kernel: [49484.609177] __x64_sys_ioctl+0x95/0xd0 Aug 22 19:08:30 juju-e4d256-prod-github-runner-207 kernel: [49484.609953] do_syscall_64+0x5c/0xc0 Aug 22 19:08:30 juju-e4d256-prod-github-runner-207 kernel: [49484.610702] ? do_futex+0x162/0x1f0 Aug 22 19:08:30 juju-e4d256-prod-github-runner-207 kernel: [49484.611428] ? __x64_sys_futex+0x78/0x1e0 Aug 22 19:08:30 juju-e4d256-prod-github-runner-207 kernel: [49484.612217] ? __secure_computing+0xa9/0x120 Aug 22 19:08:30 juju-e4d256-prod-github-runner-207 kernel: [49484.612997] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 19:08:30 juju-e4d256-prod-github-runner-207 kernel: [49484.613864] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:08:30 juju-e4d256-prod-github-runner-207 kernel: [49484.614686] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:08:30 juju-e4d256-prod-github-runner-207 kernel: [49484.615500] ? do_syscall_64+0x69/0xc0 Aug 22 19:08:30 juju-e4d256-prod-github-runner-207 kernel: [49484.616247] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:08:30 juju-e4d256-prod-github-runner-207 kernel: [49484.617047] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:08:30 juju-e4d256-prod-github-runner-207 kernel: [49484.617839] ? do_syscall_64+0x69/0xc0 Aug 22 19:08:30 juju-e4d256-prod-github-runner-207 kernel: [49484.618543] ? do_syscall_64+0x69/0xc0 Aug 22 19:08:30 juju-e4d256-prod-github-runner-207 kernel: [49484.619245] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 19:08:30 juju-e4d256-prod-github-runner-207 kernel: [49484.620074] RIP: 0033:0x7faa5d0edaff Aug 22 19:08:30 juju-e4d256-prod-github-runner-207 kernel: [49484.620825] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 19:08:30 juju-e4d256-prod-github-runner-207 kernel: [49484.623174] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 19:08:30 juju-e4d256-prod-github-runner-207 kernel: [49484.624261] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 19:08:30 juju-e4d256-prod-github-runner-207 kernel: [49484.625297] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 19:08:30 juju-e4d256-prod-github-runner-207 kernel: [49484.626334] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 19:08:30 juju-e4d256-prod-github-runner-207 kernel: [49484.627382] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 19:08:30 juju-e4d256-prod-github-runner-207 kernel: [49484.628426] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 19:08:30 juju-e4d256-prod-github-runner-207 kernel: [49484.629457] Aug 22 19:08:46 juju-e4d256-prod-github-runner-207 kernel: [49500.488706] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 19:08:46 juju-e4d256-prod-github-runner-207 kernel: [49500.489678] rcu: 1-....: (12306995 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=5950594 Aug 22 19:08:46 juju-e4d256-prod-github-runner-207 kernel: [49500.490798] (t=12345822 jiffies g=23269 q=47253) Aug 22 19:08:46 juju-e4d256-prod-github-runner-207 kernel: [49500.491596] NMI backtrace for cpu 1 Aug 22 19:08:46 juju-e4d256-prod-github-runner-207 kernel: [49500.492316] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 19:08:46 juju-e4d256-prod-github-runner-207 kernel: [49500.493420] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 19:08:46 juju-e4d256-prod-github-runner-207 kernel: [49500.494477] Call Trace: Aug 22 19:08:46 juju-e4d256-prod-github-runner-207 kernel: [49500.495152] Aug 22 19:08:46 juju-e4d256-prod-github-runner-207 kernel: [49500.495976] show_stack+0x52/0x5c Aug 22 19:08:46 juju-e4d256-prod-github-runner-207 kernel: [49500.496702] dump_stack_lvl+0x4a/0x63 Aug 22 19:08:46 juju-e4d256-prod-github-runner-207 kernel: [49500.497454] dump_stack+0x10/0x16 Aug 22 19:08:46 juju-e4d256-prod-github-runner-207 kernel: [49500.498171] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 19:08:46 juju-e4d256-prod-github-runner-207 kernel: [49500.499142] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 19:08:46 juju-e4d256-prod-github-runner-207 kernel: [49500.500104] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 19:08:46 juju-e4d256-prod-github-runner-207 kernel: [49500.501044] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 19:08:46 juju-e4d256-prod-github-runner-207 kernel: [49500.501982] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 19:08:46 juju-e4d256-prod-github-runner-207 kernel: [49500.502917] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 19:08:46 juju-e4d256-prod-github-runner-207 kernel: [49500.503811] print_cpu_stall.cold+0x2f/0xe2 Aug 22 19:08:46 juju-e4d256-prod-github-runner-207 kernel: [49500.504669] ? timekeeping_update+0xf7/0x150 Aug 22 19:08:46 juju-e4d256-prod-github-runner-207 kernel: [49500.505527] check_cpu_stall+0x109/0x270 Aug 22 19:08:46 juju-e4d256-prod-github-runner-207 kernel: [49500.506355] rcu_sched_clock_irq+0x9a/0x250 Aug 22 19:08:46 juju-e4d256-prod-github-runner-207 kernel: [49500.507200] update_process_times+0x94/0xd0 Aug 22 19:08:46 juju-e4d256-prod-github-runner-207 kernel: [49500.508072] tick_sched_handle+0x29/0x70 Aug 22 19:08:46 juju-e4d256-prod-github-runner-207 kernel: [49500.508895] tick_sched_timer+0x8c/0xc0 Aug 22 19:08:46 juju-e4d256-prod-github-runner-207 kernel: [49500.509709] ? tick_nohz_handler+0xb0/0xb0 Aug 22 19:08:46 juju-e4d256-prod-github-runner-207 kernel: [49500.510546] __hrtimer_run_queues+0x107/0x230 Aug 22 19:08:46 juju-e4d256-prod-github-runner-207 kernel: [49500.511419] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 19:08:46 juju-e4d256-prod-github-runner-207 kernel: [49500.512294] hrtimer_interrupt+0x101/0x220 Aug 22 19:08:46 juju-e4d256-prod-github-runner-207 kernel: [49500.513147] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 19:08:46 juju-e4d256-prod-github-runner-207 kernel: [49500.514052] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 19:08:46 juju-e4d256-prod-github-runner-207 kernel: [49500.514948] Aug 22 19:08:46 juju-e4d256-prod-github-runner-207 kernel: [49500.515644] Aug 22 19:08:46 juju-e4d256-prod-github-runner-207 kernel: [49500.516318] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 19:08:46 juju-e4d256-prod-github-runner-207 kernel: [49500.517235] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:08:46 juju-e4d256-prod-github-runner-207 kernel: [49500.518231] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 19:08:46 juju-e4d256-prod-github-runner-207 kernel: [49500.520771] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 19:08:46 juju-e4d256-prod-github-runner-207 kernel: [49500.521744] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 19:08:46 juju-e4d256-prod-github-runner-207 kernel: [49500.522876] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 19:08:46 juju-e4d256-prod-github-runner-207 kernel: [49500.524003] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 19:08:46 juju-e4d256-prod-github-runner-207 kernel: [49500.525118] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 19:08:46 juju-e4d256-prod-github-runner-207 kernel: [49500.526219] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 19:08:46 juju-e4d256-prod-github-runner-207 kernel: [49500.527332] ? _raw_spin_lock+0x22/0x30 Aug 22 19:08:46 juju-e4d256-prod-github-runner-207 kernel: [49500.528196] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:08:46 juju-e4d256-prod-github-runner-207 kernel: [49500.529150] direct_page_fault+0x206/0x310 [kvm] Aug 22 19:08:46 juju-e4d256-prod-github-runner-207 kernel: [49500.530088] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 19:08:46 juju-e4d256-prod-github-runner-207 kernel: [49500.531013] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 19:08:46 juju-e4d256-prod-github-runner-207 kernel: [49500.531953] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 19:08:46 juju-e4d256-prod-github-runner-207 kernel: [49500.532871] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 19:08:46 juju-e4d256-prod-github-runner-207 kernel: [49500.533780] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 19:08:46 juju-e4d256-prod-github-runner-207 kernel: [49500.534720] handle_exit+0x98/0x230 [kvm_amd] Aug 22 19:08:46 juju-e4d256-prod-github-runner-207 kernel: [49500.535565] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 19:08:46 juju-e4d256-prod-github-runner-207 kernel: [49500.536457] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 19:08:46 juju-e4d256-prod-github-runner-207 kernel: [49500.537359] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 19:08:46 juju-e4d256-prod-github-runner-207 kernel: [49500.538237] vcpu_run+0x62/0x2c0 [kvm] Aug 22 19:08:46 juju-e4d256-prod-github-runner-207 kernel: [49500.539029] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 19:08:46 juju-e4d256-prod-github-runner-207 kernel: [49500.539863] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 19:08:46 juju-e4d256-prod-github-runner-207 kernel: [49500.540769] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 19:08:46 juju-e4d256-prod-github-runner-207 kernel: [49500.541623] ? __seccomp_filter+0x4a/0x4a0 Aug 22 19:08:46 juju-e4d256-prod-github-runner-207 kernel: [49500.542430] ? __fget_files+0x86/0xc0 Aug 22 19:08:46 juju-e4d256-prod-github-runner-207 kernel: [49500.543194] __x64_sys_ioctl+0x95/0xd0 Aug 22 19:08:46 juju-e4d256-prod-github-runner-207 kernel: [49500.543982] do_syscall_64+0x5c/0xc0 Aug 22 19:08:46 juju-e4d256-prod-github-runner-207 kernel: [49500.544736] ? do_futex+0x162/0x1f0 Aug 22 19:08:46 juju-e4d256-prod-github-runner-207 kernel: [49500.545481] ? __x64_sys_futex+0x78/0x1e0 Aug 22 19:08:46 juju-e4d256-prod-github-runner-207 kernel: [49500.546261] ? __secure_computing+0xa9/0x120 Aug 22 19:08:46 juju-e4d256-prod-github-runner-207 kernel: [49500.547063] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 19:08:46 juju-e4d256-prod-github-runner-207 kernel: [49500.547975] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:08:46 juju-e4d256-prod-github-runner-207 kernel: [49500.548849] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:08:46 juju-e4d256-prod-github-runner-207 kernel: [49500.549716] ? do_syscall_64+0x69/0xc0 Aug 22 19:08:46 juju-e4d256-prod-github-runner-207 kernel: [49500.550481] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:08:46 juju-e4d256-prod-github-runner-207 kernel: [49500.551324] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:08:46 juju-e4d256-prod-github-runner-207 kernel: [49500.552194] ? do_syscall_64+0x69/0xc0 Aug 22 19:08:46 juju-e4d256-prod-github-runner-207 kernel: [49500.552971] ? do_syscall_64+0x69/0xc0 Aug 22 19:08:46 juju-e4d256-prod-github-runner-207 kernel: [49500.553733] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 19:08:46 juju-e4d256-prod-github-runner-207 kernel: [49500.554598] RIP: 0033:0x7faa5d0edaff Aug 22 19:08:46 juju-e4d256-prod-github-runner-207 kernel: [49500.555347] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 19:08:46 juju-e4d256-prod-github-runner-207 kernel: [49500.557782] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 19:08:46 juju-e4d256-prod-github-runner-207 kernel: [49500.558886] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 19:08:46 juju-e4d256-prod-github-runner-207 kernel: [49500.559993] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 19:08:46 juju-e4d256-prod-github-runner-207 kernel: [49500.561070] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 19:08:46 juju-e4d256-prod-github-runner-207 kernel: [49500.562142] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 19:08:46 juju-e4d256-prod-github-runner-207 kernel: [49500.563205] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 19:08:46 juju-e4d256-prod-github-runner-207 kernel: [49500.564294] Aug 22 19:09:10 juju-e4d256-prod-github-runner-207 kernel: [49524.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 46015s! [qemu-system-x86:6715] Aug 22 19:09:10 juju-e4d256-prod-github-runner-207 kernel: [49524.543327] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 19:09:10 juju-e4d256-prod-github-runner-207 kernel: [49524.543405] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 19:09:10 juju-e4d256-prod-github-runner-207 kernel: [49524.556561] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 19:09:10 juju-e4d256-prod-github-runner-207 kernel: [49524.557825] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 19:09:10 juju-e4d256-prod-github-runner-207 kernel: [49524.559154] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:09:10 juju-e4d256-prod-github-runner-207 kernel: [49524.560237] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 19:09:10 juju-e4d256-prod-github-runner-207 kernel: [49524.562793] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 19:09:10 juju-e4d256-prod-github-runner-207 kernel: [49524.563868] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 19:09:10 juju-e4d256-prod-github-runner-207 kernel: [49524.565031] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 19:09:10 juju-e4d256-prod-github-runner-207 kernel: [49524.566193] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 19:09:10 juju-e4d256-prod-github-runner-207 kernel: [49524.567376] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 19:09:10 juju-e4d256-prod-github-runner-207 kernel: [49524.568544] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 19:09:10 juju-e4d256-prod-github-runner-207 kernel: [49524.569711] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 19:09:10 juju-e4d256-prod-github-runner-207 kernel: [49524.570949] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 19:09:10 juju-e4d256-prod-github-runner-207 kernel: [49524.572057] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 19:09:10 juju-e4d256-prod-github-runner-207 kernel: [49524.573252] Call Trace: Aug 22 19:09:10 juju-e4d256-prod-github-runner-207 kernel: [49524.574169] Aug 22 19:09:10 juju-e4d256-prod-github-runner-207 kernel: [49524.575052] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:09:10 juju-e4d256-prod-github-runner-207 kernel: [49524.576102] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:09:10 juju-e4d256-prod-github-runner-207 kernel: [49524.577127] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:09:10 juju-e4d256-prod-github-runner-207 kernel: [49524.578202] ? show_regs.part.0+0x23/0x29 Aug 22 19:09:10 juju-e4d256-prod-github-runner-207 kernel: [49524.579198] ? show_regs.cold+0x8/0xd Aug 22 19:09:10 juju-e4d256-prod-github-runner-207 kernel: [49524.580183] ? watchdog_timer_fn+0x1be/0x220 Aug 22 19:09:10 juju-e4d256-prod-github-runner-207 kernel: [49524.581191] ? lockup_detector_update_enable+0x60/0x60 Aug 22 19:09:10 juju-e4d256-prod-github-runner-207 kernel: [49524.582254] ? __hrtimer_run_queues+0x107/0x230 Aug 22 19:09:10 juju-e4d256-prod-github-runner-207 kernel: [49524.583283] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 19:09:10 juju-e4d256-prod-github-runner-207 kernel: [49524.584323] ? hrtimer_interrupt+0x101/0x220 Aug 22 19:09:10 juju-e4d256-prod-github-runner-207 kernel: [49524.585339] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 19:09:10 juju-e4d256-prod-github-runner-207 kernel: [49524.586456] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 19:09:10 juju-e4d256-prod-github-runner-207 kernel: [49524.587529] Aug 22 19:09:10 juju-e4d256-prod-github-runner-207 kernel: [49524.588386] Aug 22 19:09:10 juju-e4d256-prod-github-runner-207 kernel: [49524.589233] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 19:09:10 juju-e4d256-prod-github-runner-207 kernel: [49524.590320] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:09:10 juju-e4d256-prod-github-runner-207 kernel: [49524.591499] ? _raw_spin_lock+0x22/0x30 Aug 22 19:09:10 juju-e4d256-prod-github-runner-207 kernel: [49524.593026] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:09:10 juju-e4d256-prod-github-runner-207 kernel: [49524.594053] direct_page_fault+0x206/0x310 [kvm] Aug 22 19:09:10 juju-e4d256-prod-github-runner-207 kernel: [49524.595080] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 19:09:10 juju-e4d256-prod-github-runner-207 kernel: [49524.596115] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 19:09:10 juju-e4d256-prod-github-runner-207 kernel: [49524.597117] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 19:09:10 juju-e4d256-prod-github-runner-207 kernel: [49524.598088] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 19:09:10 juju-e4d256-prod-github-runner-207 kernel: [49524.599040] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 19:09:10 juju-e4d256-prod-github-runner-207 kernel: [49524.600037] handle_exit+0x98/0x230 [kvm_amd] Aug 22 19:09:10 juju-e4d256-prod-github-runner-207 kernel: [49524.600934] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 19:09:10 juju-e4d256-prod-github-runner-207 kernel: [49524.601856] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 19:09:10 juju-e4d256-prod-github-runner-207 kernel: [49524.602781] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 19:09:10 juju-e4d256-prod-github-runner-207 kernel: [49524.603705] vcpu_run+0x62/0x2c0 [kvm] Aug 22 19:09:10 juju-e4d256-prod-github-runner-207 kernel: [49524.604520] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 19:09:10 juju-e4d256-prod-github-runner-207 kernel: [49524.605575] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 19:09:10 juju-e4d256-prod-github-runner-207 kernel: [49524.606436] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 19:09:10 juju-e4d256-prod-github-runner-207 kernel: [49524.607237] ? __seccomp_filter+0x4a/0x4a0 Aug 22 19:09:10 juju-e4d256-prod-github-runner-207 kernel: [49524.608002] ? __fget_files+0x86/0xc0 Aug 22 19:09:10 juju-e4d256-prod-github-runner-207 kernel: [49524.608713] __x64_sys_ioctl+0x95/0xd0 Aug 22 19:09:10 juju-e4d256-prod-github-runner-207 kernel: [49524.609407] do_syscall_64+0x5c/0xc0 Aug 22 19:09:10 juju-e4d256-prod-github-runner-207 kernel: [49524.610074] ? do_futex+0x162/0x1f0 Aug 22 19:09:10 juju-e4d256-prod-github-runner-207 kernel: [49524.610725] ? __x64_sys_futex+0x78/0x1e0 Aug 22 19:09:10 juju-e4d256-prod-github-runner-207 kernel: [49524.611413] ? __secure_computing+0xa9/0x120 Aug 22 19:09:10 juju-e4d256-prod-github-runner-207 kernel: [49524.612105] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 19:09:10 juju-e4d256-prod-github-runner-207 kernel: [49524.612868] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:09:10 juju-e4d256-prod-github-runner-207 kernel: [49524.613595] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:09:10 juju-e4d256-prod-github-runner-207 kernel: [49524.614316] ? do_syscall_64+0x69/0xc0 Aug 22 19:09:10 juju-e4d256-prod-github-runner-207 kernel: [49524.614965] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:09:10 juju-e4d256-prod-github-runner-207 kernel: [49524.615686] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:09:10 juju-e4d256-prod-github-runner-207 kernel: [49524.616384] ? do_syscall_64+0x69/0xc0 Aug 22 19:09:10 juju-e4d256-prod-github-runner-207 kernel: [49524.617011] ? do_syscall_64+0x69/0xc0 Aug 22 19:09:10 juju-e4d256-prod-github-runner-207 kernel: [49524.617641] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 19:09:10 juju-e4d256-prod-github-runner-207 kernel: [49524.618350] RIP: 0033:0x7faa5d0edaff Aug 22 19:09:10 juju-e4d256-prod-github-runner-207 kernel: [49524.618977] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 19:09:10 juju-e4d256-prod-github-runner-207 kernel: [49524.621310] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 19:09:10 juju-e4d256-prod-github-runner-207 kernel: [49524.622639] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 19:09:10 juju-e4d256-prod-github-runner-207 kernel: [49524.623991] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 19:09:10 juju-e4d256-prod-github-runner-207 kernel: [49524.625305] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 19:09:10 juju-e4d256-prod-github-runner-207 kernel: [49524.626615] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 19:09:10 juju-e4d256-prod-github-runner-207 kernel: [49524.627932] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 19:09:10 juju-e4d256-prod-github-runner-207 kernel: [49524.629205] Aug 22 19:09:38 juju-e4d256-prod-github-runner-207 kernel: [49552.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 46041s! [qemu-system-x86:6715] Aug 22 19:09:38 juju-e4d256-prod-github-runner-207 kernel: [49552.543105] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 19:09:38 juju-e4d256-prod-github-runner-207 kernel: [49552.543174] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 19:09:38 juju-e4d256-prod-github-runner-207 kernel: [49552.555275] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 19:09:38 juju-e4d256-prod-github-runner-207 kernel: [49552.556547] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 19:09:38 juju-e4d256-prod-github-runner-207 kernel: [49552.557780] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:09:38 juju-e4d256-prod-github-runner-207 kernel: [49552.558840] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 19:09:38 juju-e4d256-prod-github-runner-207 kernel: [49552.561398] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 19:09:38 juju-e4d256-prod-github-runner-207 kernel: [49552.562456] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 19:09:38 juju-e4d256-prod-github-runner-207 kernel: [49552.563628] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 19:09:38 juju-e4d256-prod-github-runner-207 kernel: [49552.564795] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 19:09:38 juju-e4d256-prod-github-runner-207 kernel: [49552.565981] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 19:09:38 juju-e4d256-prod-github-runner-207 kernel: [49552.567170] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 19:09:38 juju-e4d256-prod-github-runner-207 kernel: [49552.568338] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 19:09:38 juju-e4d256-prod-github-runner-207 kernel: [49552.569570] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 19:09:38 juju-e4d256-prod-github-runner-207 kernel: [49552.570667] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 19:09:38 juju-e4d256-prod-github-runner-207 kernel: [49552.571870] Call Trace: Aug 22 19:09:38 juju-e4d256-prod-github-runner-207 kernel: [49552.572781] Aug 22 19:09:38 juju-e4d256-prod-github-runner-207 kernel: [49552.573664] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:09:38 juju-e4d256-prod-github-runner-207 kernel: [49552.574698] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:09:38 juju-e4d256-prod-github-runner-207 kernel: [49552.575732] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:09:38 juju-e4d256-prod-github-runner-207 kernel: [49552.576810] ? show_regs.part.0+0x23/0x29 Aug 22 19:09:38 juju-e4d256-prod-github-runner-207 kernel: [49552.577806] ? show_regs.cold+0x8/0xd Aug 22 19:09:38 juju-e4d256-prod-github-runner-207 kernel: [49552.578776] ? watchdog_timer_fn+0x1be/0x220 Aug 22 19:09:38 juju-e4d256-prod-github-runner-207 kernel: [49552.579789] ? lockup_detector_update_enable+0x60/0x60 Aug 22 19:09:38 juju-e4d256-prod-github-runner-207 kernel: [49552.580857] ? __hrtimer_run_queues+0x107/0x230 Aug 22 19:09:38 juju-e4d256-prod-github-runner-207 kernel: [49552.581883] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 19:09:38 juju-e4d256-prod-github-runner-207 kernel: [49552.582904] ? hrtimer_interrupt+0x101/0x220 Aug 22 19:09:38 juju-e4d256-prod-github-runner-207 kernel: [49552.583928] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 19:09:38 juju-e4d256-prod-github-runner-207 kernel: [49552.584996] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 19:09:38 juju-e4d256-prod-github-runner-207 kernel: [49552.586046] Aug 22 19:09:38 juju-e4d256-prod-github-runner-207 kernel: [49552.586903] Aug 22 19:09:38 juju-e4d256-prod-github-runner-207 kernel: [49552.587750] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 19:09:38 juju-e4d256-prod-github-runner-207 kernel: [49552.588784] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:09:38 juju-e4d256-prod-github-runner-207 kernel: [49552.589828] ? _raw_spin_lock+0x22/0x30 Aug 22 19:09:38 juju-e4d256-prod-github-runner-207 kernel: [49552.590771] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:09:38 juju-e4d256-prod-github-runner-207 kernel: [49552.591805] direct_page_fault+0x206/0x310 [kvm] Aug 22 19:09:38 juju-e4d256-prod-github-runner-207 kernel: [49552.592836] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 19:09:38 juju-e4d256-prod-github-runner-207 kernel: [49552.593846] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 19:09:38 juju-e4d256-prod-github-runner-207 kernel: [49552.594850] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 19:09:38 juju-e4d256-prod-github-runner-207 kernel: [49552.595860] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 19:09:38 juju-e4d256-prod-github-runner-207 kernel: [49552.596817] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 19:09:38 juju-e4d256-prod-github-runner-207 kernel: [49552.597797] handle_exit+0x98/0x230 [kvm_amd] Aug 22 19:09:38 juju-e4d256-prod-github-runner-207 kernel: [49552.598689] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 19:09:38 juju-e4d256-prod-github-runner-207 kernel: [49552.599663] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 19:09:38 juju-e4d256-prod-github-runner-207 kernel: [49552.600588] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 19:09:38 juju-e4d256-prod-github-runner-207 kernel: [49552.601492] vcpu_run+0x62/0x2c0 [kvm] Aug 22 19:09:38 juju-e4d256-prod-github-runner-207 kernel: [49552.602301] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 19:09:38 juju-e4d256-prod-github-runner-207 kernel: [49552.603122] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 19:09:38 juju-e4d256-prod-github-runner-207 kernel: [49552.603979] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 19:09:38 juju-e4d256-prod-github-runner-207 kernel: [49552.604777] ? __seccomp_filter+0x4a/0x4a0 Aug 22 19:09:38 juju-e4d256-prod-github-runner-207 kernel: [49552.605526] ? __fget_files+0x86/0xc0 Aug 22 19:09:38 juju-e4d256-prod-github-runner-207 kernel: [49552.606229] __x64_sys_ioctl+0x95/0xd0 Aug 22 19:09:38 juju-e4d256-prod-github-runner-207 kernel: [49552.606921] do_syscall_64+0x5c/0xc0 Aug 22 19:09:38 juju-e4d256-prod-github-runner-207 kernel: [49552.607600] ? do_futex+0x162/0x1f0 Aug 22 19:09:38 juju-e4d256-prod-github-runner-207 kernel: [49552.608253] ? __x64_sys_futex+0x78/0x1e0 Aug 22 19:09:38 juju-e4d256-prod-github-runner-207 kernel: [49552.608929] ? __secure_computing+0xa9/0x120 Aug 22 19:09:38 juju-e4d256-prod-github-runner-207 kernel: [49552.609620] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 19:09:38 juju-e4d256-prod-github-runner-207 kernel: [49552.610380] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:09:38 juju-e4d256-prod-github-runner-207 kernel: [49552.611115] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:09:38 juju-e4d256-prod-github-runner-207 kernel: [49552.611835] ? do_syscall_64+0x69/0xc0 Aug 22 19:09:38 juju-e4d256-prod-github-runner-207 kernel: [49552.612480] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:09:38 juju-e4d256-prod-github-runner-207 kernel: [49552.613184] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:09:38 juju-e4d256-prod-github-runner-207 kernel: [49552.613879] ? do_syscall_64+0x69/0xc0 Aug 22 19:09:38 juju-e4d256-prod-github-runner-207 kernel: [49552.614504] ? do_syscall_64+0x69/0xc0 Aug 22 19:09:38 juju-e4d256-prod-github-runner-207 kernel: [49552.615134] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 19:09:38 juju-e4d256-prod-github-runner-207 kernel: [49552.615840] RIP: 0033:0x7faa5d0edaff Aug 22 19:09:38 juju-e4d256-prod-github-runner-207 kernel: [49552.616463] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 19:09:38 juju-e4d256-prod-github-runner-207 kernel: [49552.618451] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 19:09:38 juju-e4d256-prod-github-runner-207 kernel: [49552.619372] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 19:09:38 juju-e4d256-prod-github-runner-207 kernel: [49552.620266] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 19:09:38 juju-e4d256-prod-github-runner-207 kernel: [49552.621161] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 19:09:38 juju-e4d256-prod-github-runner-207 kernel: [49552.622074] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 19:09:38 juju-e4d256-prod-github-runner-207 kernel: [49552.622979] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 19:09:38 juju-e4d256-prod-github-runner-207 kernel: [49552.623875] Aug 22 19:10:06 juju-e4d256-prod-github-runner-207 kernel: [49580.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 46067s! [qemu-system-x86:6715] Aug 22 19:10:06 juju-e4d256-prod-github-runner-207 kernel: [49580.543745] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 19:10:06 juju-e4d256-prod-github-runner-207 kernel: [49580.544001] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 19:10:06 juju-e4d256-prod-github-runner-207 kernel: [49580.556045] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 19:10:06 juju-e4d256-prod-github-runner-207 kernel: [49580.557315] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 19:10:06 juju-e4d256-prod-github-runner-207 kernel: [49580.558535] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:10:06 juju-e4d256-prod-github-runner-207 kernel: [49580.559602] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 19:10:06 juju-e4d256-prod-github-runner-207 kernel: [49580.562152] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 19:10:06 juju-e4d256-prod-github-runner-207 kernel: [49580.563208] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 19:10:06 juju-e4d256-prod-github-runner-207 kernel: [49580.564371] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 19:10:06 juju-e4d256-prod-github-runner-207 kernel: [49580.565528] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 19:10:06 juju-e4d256-prod-github-runner-207 kernel: [49580.566829] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 19:10:06 juju-e4d256-prod-github-runner-207 kernel: [49580.567993] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 19:10:06 juju-e4d256-prod-github-runner-207 kernel: [49580.569276] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 19:10:06 juju-e4d256-prod-github-runner-207 kernel: [49580.570513] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 19:10:06 juju-e4d256-prod-github-runner-207 kernel: [49580.571622] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 19:10:06 juju-e4d256-prod-github-runner-207 kernel: [49580.572816] Call Trace: Aug 22 19:10:06 juju-e4d256-prod-github-runner-207 kernel: [49580.573733] Aug 22 19:10:06 juju-e4d256-prod-github-runner-207 kernel: [49580.574641] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:10:06 juju-e4d256-prod-github-runner-207 kernel: [49580.575677] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:10:06 juju-e4d256-prod-github-runner-207 kernel: [49580.576698] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:10:06 juju-e4d256-prod-github-runner-207 kernel: [49580.577794] ? show_regs.part.0+0x23/0x29 Aug 22 19:10:06 juju-e4d256-prod-github-runner-207 kernel: [49580.578798] ? show_regs.cold+0x8/0xd Aug 22 19:10:06 juju-e4d256-prod-github-runner-207 kernel: [49580.579776] ? watchdog_timer_fn+0x1be/0x220 Aug 22 19:10:06 juju-e4d256-prod-github-runner-207 kernel: [49580.580789] ? lockup_detector_update_enable+0x60/0x60 Aug 22 19:10:06 juju-e4d256-prod-github-runner-207 kernel: [49580.581851] ? __hrtimer_run_queues+0x107/0x230 Aug 22 19:10:06 juju-e4d256-prod-github-runner-207 kernel: [49580.582967] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 19:10:06 juju-e4d256-prod-github-runner-207 kernel: [49580.584001] ? hrtimer_interrupt+0x101/0x220 Aug 22 19:10:06 juju-e4d256-prod-github-runner-207 kernel: [49580.585020] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 19:10:06 juju-e4d256-prod-github-runner-207 kernel: [49580.586094] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 19:10:06 juju-e4d256-prod-github-runner-207 kernel: [49580.587169] Aug 22 19:10:06 juju-e4d256-prod-github-runner-207 kernel: [49580.588036] Aug 22 19:10:06 juju-e4d256-prod-github-runner-207 kernel: [49580.588893] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 19:10:06 juju-e4d256-prod-github-runner-207 kernel: [49580.589927] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:10:06 juju-e4d256-prod-github-runner-207 kernel: [49580.590980] ? _raw_spin_lock+0x22/0x30 Aug 22 19:10:06 juju-e4d256-prod-github-runner-207 kernel: [49580.591928] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:10:06 juju-e4d256-prod-github-runner-207 kernel: [49580.592943] direct_page_fault+0x206/0x310 [kvm] Aug 22 19:10:06 juju-e4d256-prod-github-runner-207 kernel: [49580.593970] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 19:10:06 juju-e4d256-prod-github-runner-207 kernel: [49580.595038] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 19:10:06 juju-e4d256-prod-github-runner-207 kernel: [49580.596043] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 19:10:06 juju-e4d256-prod-github-runner-207 kernel: [49580.597070] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 19:10:06 juju-e4d256-prod-github-runner-207 kernel: [49580.598017] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 19:10:06 juju-e4d256-prod-github-runner-207 kernel: [49580.599002] handle_exit+0x98/0x230 [kvm_amd] Aug 22 19:10:06 juju-e4d256-prod-github-runner-207 kernel: [49580.599893] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 19:10:06 juju-e4d256-prod-github-runner-207 kernel: [49580.600809] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 19:10:06 juju-e4d256-prod-github-runner-207 kernel: [49580.601738] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 19:10:06 juju-e4d256-prod-github-runner-207 kernel: [49580.602654] vcpu_run+0x62/0x2c0 [kvm] Aug 22 19:10:06 juju-e4d256-prod-github-runner-207 kernel: [49580.603477] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 19:10:06 juju-e4d256-prod-github-runner-207 kernel: [49580.604299] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 19:10:06 juju-e4d256-prod-github-runner-207 kernel: [49580.605160] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 19:10:06 juju-e4d256-prod-github-runner-207 kernel: [49580.605956] ? __seccomp_filter+0x4a/0x4a0 Aug 22 19:10:06 juju-e4d256-prod-github-runner-207 kernel: [49580.606715] ? __fget_files+0x86/0xc0 Aug 22 19:10:06 juju-e4d256-prod-github-runner-207 kernel: [49580.607422] __x64_sys_ioctl+0x95/0xd0 Aug 22 19:10:06 juju-e4d256-prod-github-runner-207 kernel: [49580.608112] do_syscall_64+0x5c/0xc0 Aug 22 19:10:06 juju-e4d256-prod-github-runner-207 kernel: [49580.608780] ? do_futex+0x162/0x1f0 Aug 22 19:10:06 juju-e4d256-prod-github-runner-207 kernel: [49580.609433] ? __x64_sys_futex+0x78/0x1e0 Aug 22 19:10:06 juju-e4d256-prod-github-runner-207 kernel: [49580.610108] ? __secure_computing+0xa9/0x120 Aug 22 19:10:06 juju-e4d256-prod-github-runner-207 kernel: [49580.610843] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 19:10:06 juju-e4d256-prod-github-runner-207 kernel: [49580.611792] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:10:06 juju-e4d256-prod-github-runner-207 kernel: [49580.612511] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:10:06 juju-e4d256-prod-github-runner-207 kernel: [49580.613228] ? do_syscall_64+0x69/0xc0 Aug 22 19:10:06 juju-e4d256-prod-github-runner-207 kernel: [49580.613878] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:10:06 juju-e4d256-prod-github-runner-207 kernel: [49580.614622] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:10:06 juju-e4d256-prod-github-runner-207 kernel: [49580.615519] ? do_syscall_64+0x69/0xc0 Aug 22 19:10:06 juju-e4d256-prod-github-runner-207 kernel: [49580.616459] ? do_syscall_64+0x69/0xc0 Aug 22 19:10:06 juju-e4d256-prod-github-runner-207 kernel: [49580.617092] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 19:10:06 juju-e4d256-prod-github-runner-207 kernel: [49580.617800] RIP: 0033:0x7faa5d0edaff Aug 22 19:10:06 juju-e4d256-prod-github-runner-207 kernel: [49580.618468] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 19:10:06 juju-e4d256-prod-github-runner-207 kernel: [49580.620633] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 19:10:06 juju-e4d256-prod-github-runner-207 kernel: [49580.621549] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 19:10:06 juju-e4d256-prod-github-runner-207 kernel: [49580.622470] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 19:10:06 juju-e4d256-prod-github-runner-207 kernel: [49580.623380] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 19:10:06 juju-e4d256-prod-github-runner-207 kernel: [49580.624280] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 19:10:06 juju-e4d256-prod-github-runner-207 kernel: [49580.625171] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 19:10:06 juju-e4d256-prod-github-runner-207 kernel: [49580.626066] Aug 22 19:10:34 juju-e4d256-prod-github-runner-207 kernel: [49608.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 46093s! [qemu-system-x86:6715] Aug 22 19:10:34 juju-e4d256-prod-github-runner-207 kernel: [49608.543098] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 19:10:34 juju-e4d256-prod-github-runner-207 kernel: [49608.543166] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 19:10:34 juju-e4d256-prod-github-runner-207 kernel: [49608.555285] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 19:10:34 juju-e4d256-prod-github-runner-207 kernel: [49608.556568] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 19:10:34 juju-e4d256-prod-github-runner-207 kernel: [49608.557815] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:10:34 juju-e4d256-prod-github-runner-207 kernel: [49608.558896] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 19:10:34 juju-e4d256-prod-github-runner-207 kernel: [49608.561435] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 19:10:34 juju-e4d256-prod-github-runner-207 kernel: [49608.562493] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 19:10:34 juju-e4d256-prod-github-runner-207 kernel: [49608.563666] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 19:10:34 juju-e4d256-prod-github-runner-207 kernel: [49608.564830] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 19:10:34 juju-e4d256-prod-github-runner-207 kernel: [49608.565993] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 19:10:34 juju-e4d256-prod-github-runner-207 kernel: [49608.567172] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 19:10:34 juju-e4d256-prod-github-runner-207 kernel: [49608.568341] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 19:10:34 juju-e4d256-prod-github-runner-207 kernel: [49608.569589] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 19:10:34 juju-e4d256-prod-github-runner-207 kernel: [49608.570700] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 19:10:34 juju-e4d256-prod-github-runner-207 kernel: [49608.571895] Call Trace: Aug 22 19:10:34 juju-e4d256-prod-github-runner-207 kernel: [49608.572805] Aug 22 19:10:34 juju-e4d256-prod-github-runner-207 kernel: [49608.573688] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:10:34 juju-e4d256-prod-github-runner-207 kernel: [49608.574744] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:10:34 juju-e4d256-prod-github-runner-207 kernel: [49608.575778] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:10:34 juju-e4d256-prod-github-runner-207 kernel: [49608.576856] ? show_regs.part.0+0x23/0x29 Aug 22 19:10:34 juju-e4d256-prod-github-runner-207 kernel: [49608.577853] ? show_regs.cold+0x8/0xd Aug 22 19:10:34 juju-e4d256-prod-github-runner-207 kernel: [49608.578836] ? watchdog_timer_fn+0x1be/0x220 Aug 22 19:10:34 juju-e4d256-prod-github-runner-207 kernel: [49608.579844] ? lockup_detector_update_enable+0x60/0x60 Aug 22 19:10:34 juju-e4d256-prod-github-runner-207 kernel: [49608.580926] ? __hrtimer_run_queues+0x107/0x230 Aug 22 19:10:34 juju-e4d256-prod-github-runner-207 kernel: [49608.581953] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 19:10:34 juju-e4d256-prod-github-runner-207 kernel: [49608.582984] ? hrtimer_interrupt+0x101/0x220 Aug 22 19:10:34 juju-e4d256-prod-github-runner-207 kernel: [49608.583999] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 19:10:34 juju-e4d256-prod-github-runner-207 kernel: [49608.585066] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 19:10:34 juju-e4d256-prod-github-runner-207 kernel: [49608.586110] Aug 22 19:10:34 juju-e4d256-prod-github-runner-207 kernel: [49608.586988] Aug 22 19:10:34 juju-e4d256-prod-github-runner-207 kernel: [49608.587834] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 19:10:34 juju-e4d256-prod-github-runner-207 kernel: [49608.588867] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:10:34 juju-e4d256-prod-github-runner-207 kernel: [49608.589908] ? _raw_spin_lock+0x22/0x30 Aug 22 19:10:34 juju-e4d256-prod-github-runner-207 kernel: [49608.590866] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:10:34 juju-e4d256-prod-github-runner-207 kernel: [49608.591898] direct_page_fault+0x206/0x310 [kvm] Aug 22 19:10:34 juju-e4d256-prod-github-runner-207 kernel: [49608.592934] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 19:10:34 juju-e4d256-prod-github-runner-207 kernel: [49608.593944] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 19:10:34 juju-e4d256-prod-github-runner-207 kernel: [49608.594973] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 19:10:34 juju-e4d256-prod-github-runner-207 kernel: [49608.595942] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 19:10:34 juju-e4d256-prod-github-runner-207 kernel: [49608.596887] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 19:10:34 juju-e4d256-prod-github-runner-207 kernel: [49608.597882] handle_exit+0x98/0x230 [kvm_amd] Aug 22 19:10:34 juju-e4d256-prod-github-runner-207 kernel: [49608.598796] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 19:10:34 juju-e4d256-prod-github-runner-207 kernel: [49608.599711] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 19:10:34 juju-e4d256-prod-github-runner-207 kernel: [49608.600633] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 19:10:34 juju-e4d256-prod-github-runner-207 kernel: [49608.601536] vcpu_run+0x62/0x2c0 [kvm] Aug 22 19:10:34 juju-e4d256-prod-github-runner-207 kernel: [49608.602359] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 19:10:34 juju-e4d256-prod-github-runner-207 kernel: [49608.603186] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 19:10:34 juju-e4d256-prod-github-runner-207 kernel: [49608.604149] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 19:10:34 juju-e4d256-prod-github-runner-207 kernel: [49608.604955] ? __seccomp_filter+0x4a/0x4a0 Aug 22 19:10:34 juju-e4d256-prod-github-runner-207 kernel: [49608.605698] ? __fget_files+0x86/0xc0 Aug 22 19:10:34 juju-e4d256-prod-github-runner-207 kernel: [49608.606420] __x64_sys_ioctl+0x95/0xd0 Aug 22 19:10:34 juju-e4d256-prod-github-runner-207 kernel: [49608.607114] do_syscall_64+0x5c/0xc0 Aug 22 19:10:34 juju-e4d256-prod-github-runner-207 kernel: [49608.607781] ? do_futex+0x162/0x1f0 Aug 22 19:10:34 juju-e4d256-prod-github-runner-207 kernel: [49608.608429] ? __x64_sys_futex+0x78/0x1e0 Aug 22 19:10:34 juju-e4d256-prod-github-runner-207 kernel: [49608.609103] ? __secure_computing+0xa9/0x120 Aug 22 19:10:34 juju-e4d256-prod-github-runner-207 kernel: [49608.609794] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 19:10:34 juju-e4d256-prod-github-runner-207 kernel: [49608.610592] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:10:34 juju-e4d256-prod-github-runner-207 kernel: [49608.611315] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:10:34 juju-e4d256-prod-github-runner-207 kernel: [49608.612032] ? do_syscall_64+0x69/0xc0 Aug 22 19:10:34 juju-e4d256-prod-github-runner-207 kernel: [49608.612680] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:10:34 juju-e4d256-prod-github-runner-207 kernel: [49608.613385] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:10:34 juju-e4d256-prod-github-runner-207 kernel: [49608.614081] ? do_syscall_64+0x69/0xc0 Aug 22 19:10:34 juju-e4d256-prod-github-runner-207 kernel: [49608.614718] ? do_syscall_64+0x69/0xc0 Aug 22 19:10:34 juju-e4d256-prod-github-runner-207 kernel: [49608.615342] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 19:10:34 juju-e4d256-prod-github-runner-207 kernel: [49608.616062] RIP: 0033:0x7faa5d0edaff Aug 22 19:10:34 juju-e4d256-prod-github-runner-207 kernel: [49608.616686] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 19:10:34 juju-e4d256-prod-github-runner-207 kernel: [49608.618687] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 19:10:34 juju-e4d256-prod-github-runner-207 kernel: [49608.619597] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 19:10:34 juju-e4d256-prod-github-runner-207 kernel: [49608.620511] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 19:10:34 juju-e4d256-prod-github-runner-207 kernel: [49608.621402] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 19:10:34 juju-e4d256-prod-github-runner-207 kernel: [49608.622307] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 19:10:34 juju-e4d256-prod-github-runner-207 kernel: [49608.623201] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 19:10:34 juju-e4d256-prod-github-runner-207 kernel: [49608.624095] Aug 22 19:11:02 juju-e4d256-prod-github-runner-207 kernel: [49636.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 46119s! [qemu-system-x86:6715] Aug 22 19:11:02 juju-e4d256-prod-github-runner-207 kernel: [49636.543093] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 19:11:02 juju-e4d256-prod-github-runner-207 kernel: [49636.543161] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 19:11:02 juju-e4d256-prod-github-runner-207 kernel: [49636.555311] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 19:11:02 juju-e4d256-prod-github-runner-207 kernel: [49636.556594] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 19:11:02 juju-e4d256-prod-github-runner-207 kernel: [49636.557841] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:11:02 juju-e4d256-prod-github-runner-207 kernel: [49636.558924] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 19:11:02 juju-e4d256-prod-github-runner-207 kernel: [49636.561481] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 19:11:02 juju-e4d256-prod-github-runner-207 kernel: [49636.562536] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 19:11:02 juju-e4d256-prod-github-runner-207 kernel: [49636.563832] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 19:11:02 juju-e4d256-prod-github-runner-207 kernel: [49636.564998] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 19:11:02 juju-e4d256-prod-github-runner-207 kernel: [49636.566173] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 19:11:02 juju-e4d256-prod-github-runner-207 kernel: [49636.567344] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 19:11:02 juju-e4d256-prod-github-runner-207 kernel: [49636.568511] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 19:11:02 juju-e4d256-prod-github-runner-207 kernel: [49636.569767] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 19:11:02 juju-e4d256-prod-github-runner-207 kernel: [49636.571047] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 19:11:02 juju-e4d256-prod-github-runner-207 kernel: [49636.572346] Call Trace: Aug 22 19:11:02 juju-e4d256-prod-github-runner-207 kernel: [49636.573419] Aug 22 19:11:02 juju-e4d256-prod-github-runner-207 kernel: [49636.574320] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:11:02 juju-e4d256-prod-github-runner-207 kernel: [49636.575381] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:11:02 juju-e4d256-prod-github-runner-207 kernel: [49636.576412] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:11:02 juju-e4d256-prod-github-runner-207 kernel: [49636.577495] ? show_regs.part.0+0x23/0x29 Aug 22 19:11:02 juju-e4d256-prod-github-runner-207 kernel: [49636.578533] ? show_regs.cold+0x8/0xd Aug 22 19:11:02 juju-e4d256-prod-github-runner-207 kernel: [49636.579511] ? watchdog_timer_fn+0x1be/0x220 Aug 22 19:11:02 juju-e4d256-prod-github-runner-207 kernel: [49636.580663] ? lockup_detector_update_enable+0x60/0x60 Aug 22 19:11:02 juju-e4d256-prod-github-runner-207 kernel: [49636.581813] ? __hrtimer_run_queues+0x107/0x230 Aug 22 19:11:02 juju-e4d256-prod-github-runner-207 kernel: [49636.582969] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 19:11:02 juju-e4d256-prod-github-runner-207 kernel: [49636.584104] ? hrtimer_interrupt+0x101/0x220 Aug 22 19:11:02 juju-e4d256-prod-github-runner-207 kernel: [49636.585291] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 19:11:02 juju-e4d256-prod-github-runner-207 kernel: [49636.586545] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 19:11:02 juju-e4d256-prod-github-runner-207 kernel: [49636.587720] Aug 22 19:11:02 juju-e4d256-prod-github-runner-207 kernel: [49636.588635] Aug 22 19:11:02 juju-e4d256-prod-github-runner-207 kernel: [49636.589639] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 19:11:02 juju-e4d256-prod-github-runner-207 kernel: [49636.590803] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:11:02 juju-e4d256-prod-github-runner-207 kernel: [49636.591851] ? _raw_spin_lock+0x22/0x30 Aug 22 19:11:02 juju-e4d256-prod-github-runner-207 kernel: [49636.592889] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:11:02 juju-e4d256-prod-github-runner-207 kernel: [49636.594080] direct_page_fault+0x206/0x310 [kvm] Aug 22 19:11:02 juju-e4d256-prod-github-runner-207 kernel: [49636.595249] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 19:11:02 juju-e4d256-prod-github-runner-207 kernel: [49636.596587] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 19:11:02 juju-e4d256-prod-github-runner-207 kernel: [49636.597697] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 19:11:02 juju-e4d256-prod-github-runner-207 kernel: [49636.598807] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 19:11:02 juju-e4d256-prod-github-runner-207 kernel: [49636.599882] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 19:11:02 juju-e4d256-prod-github-runner-207 kernel: [49636.601042] handle_exit+0x98/0x230 [kvm_amd] Aug 22 19:11:02 juju-e4d256-prod-github-runner-207 kernel: [49636.602175] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 19:11:02 juju-e4d256-prod-github-runner-207 kernel: [49636.603116] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 19:11:02 juju-e4d256-prod-github-runner-207 kernel: [49636.604334] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 19:11:02 juju-e4d256-prod-github-runner-207 kernel: [49636.605279] vcpu_run+0x62/0x2c0 [kvm] Aug 22 19:11:02 juju-e4d256-prod-github-runner-207 kernel: [49636.606113] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 19:11:02 juju-e4d256-prod-github-runner-207 kernel: [49636.607118] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 19:11:02 juju-e4d256-prod-github-runner-207 kernel: [49636.607993] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 19:11:02 juju-e4d256-prod-github-runner-207 kernel: [49636.608818] ? __seccomp_filter+0x4a/0x4a0 Aug 22 19:11:02 juju-e4d256-prod-github-runner-207 kernel: [49636.609564] ? __fget_files+0x86/0xc0 Aug 22 19:11:02 juju-e4d256-prod-github-runner-207 kernel: [49636.610295] __x64_sys_ioctl+0x95/0xd0 Aug 22 19:11:02 juju-e4d256-prod-github-runner-207 kernel: [49636.610996] do_syscall_64+0x5c/0xc0 Aug 22 19:11:02 juju-e4d256-prod-github-runner-207 kernel: [49636.611667] ? do_futex+0x162/0x1f0 Aug 22 19:11:02 juju-e4d256-prod-github-runner-207 kernel: [49636.612319] ? __x64_sys_futex+0x78/0x1e0 Aug 22 19:11:02 juju-e4d256-prod-github-runner-207 kernel: [49636.613027] ? __secure_computing+0xa9/0x120 Aug 22 19:11:02 juju-e4d256-prod-github-runner-207 kernel: [49636.613805] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 19:11:02 juju-e4d256-prod-github-runner-207 kernel: [49636.615096] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:11:02 juju-e4d256-prod-github-runner-207 kernel: [49636.616097] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:11:02 juju-e4d256-prod-github-runner-207 kernel: [49636.617050] ? do_syscall_64+0x69/0xc0 Aug 22 19:11:02 juju-e4d256-prod-github-runner-207 kernel: [49636.617974] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:11:02 juju-e4d256-prod-github-runner-207 kernel: [49636.618683] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:11:02 juju-e4d256-prod-github-runner-207 kernel: [49636.619501] ? do_syscall_64+0x69/0xc0 Aug 22 19:11:02 juju-e4d256-prod-github-runner-207 kernel: [49636.620129] ? do_syscall_64+0x69/0xc0 Aug 22 19:11:02 juju-e4d256-prod-github-runner-207 kernel: [49636.620754] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 19:11:02 juju-e4d256-prod-github-runner-207 kernel: [49636.621463] RIP: 0033:0x7faa5d0edaff Aug 22 19:11:02 juju-e4d256-prod-github-runner-207 kernel: [49636.622105] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 19:11:02 juju-e4d256-prod-github-runner-207 kernel: [49636.624154] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 19:11:02 juju-e4d256-prod-github-runner-207 kernel: [49636.625081] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 19:11:02 juju-e4d256-prod-github-runner-207 kernel: [49636.625994] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 19:11:02 juju-e4d256-prod-github-runner-207 kernel: [49636.626904] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 19:11:02 juju-e4d256-prod-github-runner-207 kernel: [49636.627864] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 19:11:02 juju-e4d256-prod-github-runner-207 kernel: [49636.628788] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 19:11:02 juju-e4d256-prod-github-runner-207 kernel: [49636.629699] Aug 22 19:11:30 juju-e4d256-prod-github-runner-207 kernel: [49664.541980] watchdog: BUG: soft lockup - CPU#1 stuck for 46145s! [qemu-system-x86:6715] Aug 22 19:11:30 juju-e4d256-prod-github-runner-207 kernel: [49664.543659] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 19:11:30 juju-e4d256-prod-github-runner-207 kernel: [49664.543890] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 19:11:30 juju-e4d256-prod-github-runner-207 kernel: [49664.556184] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 19:11:30 juju-e4d256-prod-github-runner-207 kernel: [49664.557529] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 19:11:30 juju-e4d256-prod-github-runner-207 kernel: [49664.558769] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:11:30 juju-e4d256-prod-github-runner-207 kernel: [49664.559868] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 19:11:30 juju-e4d256-prod-github-runner-207 kernel: [49664.562766] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 19:11:30 juju-e4d256-prod-github-runner-207 kernel: [49664.563827] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 19:11:30 juju-e4d256-prod-github-runner-207 kernel: [49664.564996] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 19:11:30 juju-e4d256-prod-github-runner-207 kernel: [49664.566201] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 19:11:30 juju-e4d256-prod-github-runner-207 kernel: [49664.567394] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 19:11:30 juju-e4d256-prod-github-runner-207 kernel: [49664.568580] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 19:11:30 juju-e4d256-prod-github-runner-207 kernel: [49664.569779] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 19:11:30 juju-e4d256-prod-github-runner-207 kernel: [49664.571021] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 19:11:30 juju-e4d256-prod-github-runner-207 kernel: [49664.572271] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 19:11:30 juju-e4d256-prod-github-runner-207 kernel: [49664.573496] Call Trace: Aug 22 19:11:30 juju-e4d256-prod-github-runner-207 kernel: [49664.574445] Aug 22 19:11:30 juju-e4d256-prod-github-runner-207 kernel: [49664.575359] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:11:30 juju-e4d256-prod-github-runner-207 kernel: [49664.576422] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:11:30 juju-e4d256-prod-github-runner-207 kernel: [49664.577472] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:11:30 juju-e4d256-prod-github-runner-207 kernel: [49664.578622] ? show_regs.part.0+0x23/0x29 Aug 22 19:11:30 juju-e4d256-prod-github-runner-207 kernel: [49664.579622] ? show_regs.cold+0x8/0xd Aug 22 19:11:30 juju-e4d256-prod-github-runner-207 kernel: [49664.580617] ? watchdog_timer_fn+0x1be/0x220 Aug 22 19:11:30 juju-e4d256-prod-github-runner-207 kernel: [49664.581719] ? lockup_detector_update_enable+0x60/0x60 Aug 22 19:11:30 juju-e4d256-prod-github-runner-207 kernel: [49664.582814] ? __hrtimer_run_queues+0x107/0x230 Aug 22 19:11:30 juju-e4d256-prod-github-runner-207 kernel: [49664.583860] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 19:11:30 juju-e4d256-prod-github-runner-207 kernel: [49664.584888] ? hrtimer_interrupt+0x101/0x220 Aug 22 19:11:30 juju-e4d256-prod-github-runner-207 kernel: [49664.585974] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 19:11:30 juju-e4d256-prod-github-runner-207 kernel: [49664.587069] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 19:11:30 juju-e4d256-prod-github-runner-207 kernel: [49664.588154] Aug 22 19:11:30 juju-e4d256-prod-github-runner-207 kernel: [49664.589016] Aug 22 19:11:30 juju-e4d256-prod-github-runner-207 kernel: [49664.589868] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 19:11:30 juju-e4d256-prod-github-runner-207 kernel: [49664.590908] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:11:30 juju-e4d256-prod-github-runner-207 kernel: [49664.591974] ? _raw_spin_lock+0x22/0x30 Aug 22 19:11:30 juju-e4d256-prod-github-runner-207 kernel: [49664.592927] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:11:30 juju-e4d256-prod-github-runner-207 kernel: [49664.594019] direct_page_fault+0x206/0x310 [kvm] Aug 22 19:11:30 juju-e4d256-prod-github-runner-207 kernel: [49664.595059] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 19:11:30 juju-e4d256-prod-github-runner-207 kernel: [49664.596091] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 19:11:30 juju-e4d256-prod-github-runner-207 kernel: [49664.597116] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 19:11:30 juju-e4d256-prod-github-runner-207 kernel: [49664.598171] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 19:11:30 juju-e4d256-prod-github-runner-207 kernel: [49664.599126] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 19:11:30 juju-e4d256-prod-github-runner-207 kernel: [49664.600213] handle_exit+0x98/0x230 [kvm_amd] Aug 22 19:11:30 juju-e4d256-prod-github-runner-207 kernel: [49664.601209] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 19:11:30 juju-e4d256-prod-github-runner-207 kernel: [49664.602176] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 19:11:30 juju-e4d256-prod-github-runner-207 kernel: [49664.603302] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 19:11:30 juju-e4d256-prod-github-runner-207 kernel: [49664.604266] vcpu_run+0x62/0x2c0 [kvm] Aug 22 19:11:30 juju-e4d256-prod-github-runner-207 kernel: [49664.605284] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 19:11:30 juju-e4d256-prod-github-runner-207 kernel: [49664.606198] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 19:11:30 juju-e4d256-prod-github-runner-207 kernel: [49664.607063] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 19:11:30 juju-e4d256-prod-github-runner-207 kernel: [49664.607989] ? __seccomp_filter+0x4a/0x4a0 Aug 22 19:11:30 juju-e4d256-prod-github-runner-207 kernel: [49664.608748] ? __fget_files+0x86/0xc0 Aug 22 19:11:30 juju-e4d256-prod-github-runner-207 kernel: [49664.609459] __x64_sys_ioctl+0x95/0xd0 Aug 22 19:11:30 juju-e4d256-prod-github-runner-207 kernel: [49664.610196] do_syscall_64+0x5c/0xc0 Aug 22 19:11:30 juju-e4d256-prod-github-runner-207 kernel: [49664.610867] ? do_futex+0x162/0x1f0 Aug 22 19:11:30 juju-e4d256-prod-github-runner-207 kernel: [49664.611694] ? __x64_sys_futex+0x78/0x1e0 Aug 22 19:11:30 juju-e4d256-prod-github-runner-207 kernel: [49664.612510] ? __secure_computing+0xa9/0x120 Aug 22 19:11:30 juju-e4d256-prod-github-runner-207 kernel: [49664.613310] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 19:11:30 juju-e4d256-prod-github-runner-207 kernel: [49664.614127] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:11:30 juju-e4d256-prod-github-runner-207 kernel: [49664.614860] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:11:30 juju-e4d256-prod-github-runner-207 kernel: [49664.615693] ? do_syscall_64+0x69/0xc0 Aug 22 19:11:30 juju-e4d256-prod-github-runner-207 kernel: [49664.616450] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:11:30 juju-e4d256-prod-github-runner-207 kernel: [49664.617255] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:11:30 juju-e4d256-prod-github-runner-207 kernel: [49664.618025] ? do_syscall_64+0x69/0xc0 Aug 22 19:11:30 juju-e4d256-prod-github-runner-207 kernel: [49664.618665] ? do_syscall_64+0x69/0xc0 Aug 22 19:11:30 juju-e4d256-prod-github-runner-207 kernel: [49664.619372] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 19:11:30 juju-e4d256-prod-github-runner-207 kernel: [49664.620089] RIP: 0033:0x7faa5d0edaff Aug 22 19:11:30 juju-e4d256-prod-github-runner-207 kernel: [49664.620764] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 19:11:30 juju-e4d256-prod-github-runner-207 kernel: [49664.622979] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 19:11:30 juju-e4d256-prod-github-runner-207 kernel: [49664.623929] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 19:11:30 juju-e4d256-prod-github-runner-207 kernel: [49664.624907] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 19:11:30 juju-e4d256-prod-github-runner-207 kernel: [49664.625860] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 19:11:30 juju-e4d256-prod-github-runner-207 kernel: [49664.626760] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 19:11:30 juju-e4d256-prod-github-runner-207 kernel: [49664.627751] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 19:11:30 juju-e4d256-prod-github-runner-207 kernel: [49664.628986] Aug 22 19:11:46 juju-e4d256-prod-github-runner-207 kernel: [49680.500707] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 19:11:46 juju-e4d256-prod-github-runner-207 kernel: [49680.501696] rcu: 1-....: (12351858 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=5972162 Aug 22 19:11:46 juju-e4d256-prod-github-runner-207 kernel: [49680.502867] (t=12390825 jiffies g=23269 q=47353) Aug 22 19:11:46 juju-e4d256-prod-github-runner-207 kernel: [49680.503663] NMI backtrace for cpu 1 Aug 22 19:11:46 juju-e4d256-prod-github-runner-207 kernel: [49680.504392] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 19:11:46 juju-e4d256-prod-github-runner-207 kernel: [49680.505527] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 19:11:46 juju-e4d256-prod-github-runner-207 kernel: [49680.506589] Call Trace: Aug 22 19:11:46 juju-e4d256-prod-github-runner-207 kernel: [49680.507264] Aug 22 19:11:46 juju-e4d256-prod-github-runner-207 kernel: [49680.507907] show_stack+0x52/0x5c Aug 22 19:11:46 juju-e4d256-prod-github-runner-207 kernel: [49680.508647] dump_stack_lvl+0x4a/0x63 Aug 22 19:11:46 juju-e4d256-prod-github-runner-207 kernel: [49680.509441] dump_stack+0x10/0x16 Aug 22 19:11:46 juju-e4d256-prod-github-runner-207 kernel: [49680.510162] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 19:11:46 juju-e4d256-prod-github-runner-207 kernel: [49680.510943] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 19:11:46 juju-e4d256-prod-github-runner-207 kernel: [49680.511725] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 19:11:46 juju-e4d256-prod-github-runner-207 kernel: [49680.512542] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 19:11:46 juju-e4d256-prod-github-runner-207 kernel: [49680.513387] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 19:11:46 juju-e4d256-prod-github-runner-207 kernel: [49680.514209] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 19:11:46 juju-e4d256-prod-github-runner-207 kernel: [49680.514998] print_cpu_stall.cold+0x2f/0xe2 Aug 22 19:11:46 juju-e4d256-prod-github-runner-207 kernel: [49680.515808] ? timekeeping_update+0xf7/0x150 Aug 22 19:11:46 juju-e4d256-prod-github-runner-207 kernel: [49680.516597] check_cpu_stall+0x109/0x270 Aug 22 19:11:46 juju-e4d256-prod-github-runner-207 kernel: [49680.517458] rcu_sched_clock_irq+0x9a/0x250 Aug 22 19:11:46 juju-e4d256-prod-github-runner-207 kernel: [49680.518230] update_process_times+0x94/0xd0 Aug 22 19:11:46 juju-e4d256-prod-github-runner-207 kernel: [49680.518990] tick_sched_handle+0x29/0x70 Aug 22 19:11:46 juju-e4d256-prod-github-runner-207 kernel: [49680.519758] tick_sched_timer+0x8c/0xc0 Aug 22 19:11:46 juju-e4d256-prod-github-runner-207 kernel: [49680.520498] ? tick_nohz_handler+0xb0/0xb0 Aug 22 19:11:46 juju-e4d256-prod-github-runner-207 kernel: [49680.521253] __hrtimer_run_queues+0x107/0x230 Aug 22 19:11:46 juju-e4d256-prod-github-runner-207 kernel: [49680.522041] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 19:11:46 juju-e4d256-prod-github-runner-207 kernel: [49680.522814] hrtimer_interrupt+0x101/0x220 Aug 22 19:11:46 juju-e4d256-prod-github-runner-207 kernel: [49680.523570] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 19:11:46 juju-e4d256-prod-github-runner-207 kernel: [49680.524386] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 19:11:46 juju-e4d256-prod-github-runner-207 kernel: [49680.525184] Aug 22 19:11:46 juju-e4d256-prod-github-runner-207 kernel: [49680.525827] Aug 22 19:11:46 juju-e4d256-prod-github-runner-207 kernel: [49680.526455] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 19:11:46 juju-e4d256-prod-github-runner-207 kernel: [49680.527271] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:11:46 juju-e4d256-prod-github-runner-207 kernel: [49680.528147] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 19:11:46 juju-e4d256-prod-github-runner-207 kernel: [49680.530368] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 19:11:46 juju-e4d256-prod-github-runner-207 kernel: [49680.531248] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 19:11:46 juju-e4d256-prod-github-runner-207 kernel: [49680.532242] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 19:11:46 juju-e4d256-prod-github-runner-207 kernel: [49680.533215] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 19:11:46 juju-e4d256-prod-github-runner-207 kernel: [49680.534199] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 19:11:46 juju-e4d256-prod-github-runner-207 kernel: [49680.535154] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 19:11:46 juju-e4d256-prod-github-runner-207 kernel: [49680.536106] ? _raw_spin_lock+0x22/0x30 Aug 22 19:11:46 juju-e4d256-prod-github-runner-207 kernel: [49680.536864] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:11:46 juju-e4d256-prod-github-runner-207 kernel: [49680.537719] direct_page_fault+0x206/0x310 [kvm] Aug 22 19:11:46 juju-e4d256-prod-github-runner-207 kernel: [49680.538558] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 19:11:46 juju-e4d256-prod-github-runner-207 kernel: [49680.539382] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 19:11:46 juju-e4d256-prod-github-runner-207 kernel: [49680.540228] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 19:11:46 juju-e4d256-prod-github-runner-207 kernel: [49680.541042] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 19:11:46 juju-e4d256-prod-github-runner-207 kernel: [49680.541849] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 19:11:46 juju-e4d256-prod-github-runner-207 kernel: [49680.542670] handle_exit+0x98/0x230 [kvm_amd] Aug 22 19:11:46 juju-e4d256-prod-github-runner-207 kernel: [49680.543422] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 19:11:46 juju-e4d256-prod-github-runner-207 kernel: [49680.544202] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 19:11:46 juju-e4d256-prod-github-runner-207 kernel: [49680.544998] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 19:11:46 juju-e4d256-prod-github-runner-207 kernel: [49680.545796] vcpu_run+0x62/0x2c0 [kvm] Aug 22 19:11:46 juju-e4d256-prod-github-runner-207 kernel: [49680.546509] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 19:11:46 juju-e4d256-prod-github-runner-207 kernel: [49680.547240] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 19:11:46 juju-e4d256-prod-github-runner-207 kernel: [49680.548090] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 19:11:46 juju-e4d256-prod-github-runner-207 kernel: [49680.548870] ? __seccomp_filter+0x4a/0x4a0 Aug 22 19:11:46 juju-e4d256-prod-github-runner-207 kernel: [49680.549608] ? __fget_files+0x86/0xc0 Aug 22 19:11:46 juju-e4d256-prod-github-runner-207 kernel: [49680.550300] __x64_sys_ioctl+0x95/0xd0 Aug 22 19:11:46 juju-e4d256-prod-github-runner-207 kernel: [49680.551013] do_syscall_64+0x5c/0xc0 Aug 22 19:11:46 juju-e4d256-prod-github-runner-207 kernel: [49680.551694] ? do_futex+0x162/0x1f0 Aug 22 19:11:46 juju-e4d256-prod-github-runner-207 kernel: [49680.552365] ? __x64_sys_futex+0x78/0x1e0 Aug 22 19:11:46 juju-e4d256-prod-github-runner-207 kernel: [49680.553065] ? __secure_computing+0xa9/0x120 Aug 22 19:11:46 juju-e4d256-prod-github-runner-207 kernel: [49680.553804] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 19:11:46 juju-e4d256-prod-github-runner-207 kernel: [49680.554594] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:11:46 juju-e4d256-prod-github-runner-207 kernel: [49680.555348] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:11:46 juju-e4d256-prod-github-runner-207 kernel: [49680.556101] ? do_syscall_64+0x69/0xc0 Aug 22 19:11:46 juju-e4d256-prod-github-runner-207 kernel: [49680.556789] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:11:46 juju-e4d256-prod-github-runner-207 kernel: [49680.557562] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:11:46 juju-e4d256-prod-github-runner-207 kernel: [49680.558319] ? do_syscall_64+0x69/0xc0 Aug 22 19:11:46 juju-e4d256-prod-github-runner-207 kernel: [49680.559011] ? do_syscall_64+0x69/0xc0 Aug 22 19:11:46 juju-e4d256-prod-github-runner-207 kernel: [49680.559697] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 19:11:46 juju-e4d256-prod-github-runner-207 kernel: [49680.560464] RIP: 0033:0x7faa5d0edaff Aug 22 19:11:46 juju-e4d256-prod-github-runner-207 kernel: [49680.561205] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 19:11:46 juju-e4d256-prod-github-runner-207 kernel: [49680.563400] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 19:11:46 juju-e4d256-prod-github-runner-207 kernel: [49680.564366] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 19:11:46 juju-e4d256-prod-github-runner-207 kernel: [49680.565319] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 19:11:46 juju-e4d256-prod-github-runner-207 kernel: [49680.566408] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 19:11:46 juju-e4d256-prod-github-runner-207 kernel: [49680.567348] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 19:11:46 juju-e4d256-prod-github-runner-207 kernel: [49680.568271] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 19:11:46 juju-e4d256-prod-github-runner-207 kernel: [49680.569190] Aug 22 19:12:10 juju-e4d256-prod-github-runner-207 kernel: [49704.541981] watchdog: BUG: soft lockup - CPU#1 stuck for 46182s! [qemu-system-x86:6715] Aug 22 19:12:10 juju-e4d256-prod-github-runner-207 kernel: [49704.543105] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 19:12:10 juju-e4d256-prod-github-runner-207 kernel: [49704.543175] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 19:12:10 juju-e4d256-prod-github-runner-207 kernel: [49704.556128] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 19:12:10 juju-e4d256-prod-github-runner-207 kernel: [49704.557487] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 19:12:10 juju-e4d256-prod-github-runner-207 kernel: [49704.558744] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:12:10 juju-e4d256-prod-github-runner-207 kernel: [49704.559809] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 19:12:10 juju-e4d256-prod-github-runner-207 kernel: [49704.562376] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 19:12:10 juju-e4d256-prod-github-runner-207 kernel: [49704.563425] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 19:12:10 juju-e4d256-prod-github-runner-207 kernel: [49704.564597] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 19:12:10 juju-e4d256-prod-github-runner-207 kernel: [49704.565788] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 19:12:10 juju-e4d256-prod-github-runner-207 kernel: [49704.567019] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 19:12:10 juju-e4d256-prod-github-runner-207 kernel: [49704.568192] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 19:12:10 juju-e4d256-prod-github-runner-207 kernel: [49704.569576] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 19:12:10 juju-e4d256-prod-github-runner-207 kernel: [49704.571141] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 19:12:10 juju-e4d256-prod-github-runner-207 kernel: [49704.572402] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 19:12:10 juju-e4d256-prod-github-runner-207 kernel: [49704.573956] Call Trace: Aug 22 19:12:10 juju-e4d256-prod-github-runner-207 kernel: [49704.574926] Aug 22 19:12:10 juju-e4d256-prod-github-runner-207 kernel: [49704.575888] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:12:10 juju-e4d256-prod-github-runner-207 kernel: [49704.577110] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:12:10 juju-e4d256-prod-github-runner-207 kernel: [49704.578313] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:12:10 juju-e4d256-prod-github-runner-207 kernel: [49704.579506] ? show_regs.part.0+0x23/0x29 Aug 22 19:12:10 juju-e4d256-prod-github-runner-207 kernel: [49704.580585] ? show_regs.cold+0x8/0xd Aug 22 19:12:10 juju-e4d256-prod-github-runner-207 kernel: [49704.581657] ? watchdog_timer_fn+0x1be/0x220 Aug 22 19:12:10 juju-e4d256-prod-github-runner-207 kernel: [49704.582769] ? lockup_detector_update_enable+0x60/0x60 Aug 22 19:12:10 juju-e4d256-prod-github-runner-207 kernel: [49704.583935] ? __hrtimer_run_queues+0x107/0x230 Aug 22 19:12:10 juju-e4d256-prod-github-runner-207 kernel: [49704.585166] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 19:12:10 juju-e4d256-prod-github-runner-207 kernel: [49704.586306] ? hrtimer_interrupt+0x101/0x220 Aug 22 19:12:10 juju-e4d256-prod-github-runner-207 kernel: [49704.587435] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 19:12:10 juju-e4d256-prod-github-runner-207 kernel: [49704.588607] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 19:12:10 juju-e4d256-prod-github-runner-207 kernel: [49704.589781] Aug 22 19:12:10 juju-e4d256-prod-github-runner-207 kernel: [49704.590758] Aug 22 19:12:10 juju-e4d256-prod-github-runner-207 kernel: [49704.591648] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 19:12:10 juju-e4d256-prod-github-runner-207 kernel: [49704.592786] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:12:10 juju-e4d256-prod-github-runner-207 kernel: [49704.593952] ? _raw_spin_lock+0x22/0x30 Aug 22 19:12:10 juju-e4d256-prod-github-runner-207 kernel: [49704.594974] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:12:10 juju-e4d256-prod-github-runner-207 kernel: [49704.596081] direct_page_fault+0x206/0x310 [kvm] Aug 22 19:12:10 juju-e4d256-prod-github-runner-207 kernel: [49704.597222] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 19:12:10 juju-e4d256-prod-github-runner-207 kernel: [49704.598335] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 19:12:10 juju-e4d256-prod-github-runner-207 kernel: [49704.599466] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 19:12:10 juju-e4d256-prod-github-runner-207 kernel: [49704.600584] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 19:12:10 juju-e4d256-prod-github-runner-207 kernel: [49704.601678] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 19:12:10 juju-e4d256-prod-github-runner-207 kernel: [49704.602786] handle_exit+0x98/0x230 [kvm_amd] Aug 22 19:12:10 juju-e4d256-prod-github-runner-207 kernel: [49704.603776] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 19:12:10 juju-e4d256-prod-github-runner-207 kernel: [49704.604792] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 19:12:10 juju-e4d256-prod-github-runner-207 kernel: [49704.605877] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 19:12:10 juju-e4d256-prod-github-runner-207 kernel: [49704.607000] vcpu_run+0x62/0x2c0 [kvm] Aug 22 19:12:10 juju-e4d256-prod-github-runner-207 kernel: [49704.607902] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 19:12:10 juju-e4d256-prod-github-runner-207 kernel: [49704.608807] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 19:12:10 juju-e4d256-prod-github-runner-207 kernel: [49704.609782] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 19:12:10 juju-e4d256-prod-github-runner-207 kernel: [49704.610679] ? __seccomp_filter+0x4a/0x4a0 Aug 22 19:12:10 juju-e4d256-prod-github-runner-207 kernel: [49704.611516] ? __fget_files+0x86/0xc0 Aug 22 19:12:10 juju-e4d256-prod-github-runner-207 kernel: [49704.612301] __x64_sys_ioctl+0x95/0xd0 Aug 22 19:12:10 juju-e4d256-prod-github-runner-207 kernel: [49704.613104] do_syscall_64+0x5c/0xc0 Aug 22 19:12:10 juju-e4d256-prod-github-runner-207 kernel: [49704.613853] ? do_futex+0x162/0x1f0 Aug 22 19:12:10 juju-e4d256-prod-github-runner-207 kernel: [49704.614651] ? __x64_sys_futex+0x78/0x1e0 Aug 22 19:12:10 juju-e4d256-prod-github-runner-207 kernel: [49704.615416] ? __secure_computing+0xa9/0x120 Aug 22 19:12:10 juju-e4d256-prod-github-runner-207 kernel: [49704.616209] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 19:12:10 juju-e4d256-prod-github-runner-207 kernel: [49704.617124] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:12:10 juju-e4d256-prod-github-runner-207 kernel: [49704.617971] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:12:10 juju-e4d256-prod-github-runner-207 kernel: [49704.618787] ? do_syscall_64+0x69/0xc0 Aug 22 19:12:10 juju-e4d256-prod-github-runner-207 kernel: [49704.619536] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:12:10 juju-e4d256-prod-github-runner-207 kernel: [49704.620347] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:12:10 juju-e4d256-prod-github-runner-207 kernel: [49704.621181] ? do_syscall_64+0x69/0xc0 Aug 22 19:12:10 juju-e4d256-prod-github-runner-207 kernel: [49704.621885] ? do_syscall_64+0x69/0xc0 Aug 22 19:12:10 juju-e4d256-prod-github-runner-207 kernel: [49704.622594] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 19:12:10 juju-e4d256-prod-github-runner-207 kernel: [49704.623400] RIP: 0033:0x7faa5d0edaff Aug 22 19:12:10 juju-e4d256-prod-github-runner-207 kernel: [49704.624105] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 19:12:10 juju-e4d256-prod-github-runner-207 kernel: [49704.626520] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 19:12:10 juju-e4d256-prod-github-runner-207 kernel: [49704.627581] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 19:12:10 juju-e4d256-prod-github-runner-207 kernel: [49704.628647] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 19:12:10 juju-e4d256-prod-github-runner-207 kernel: [49704.629718] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 19:12:10 juju-e4d256-prod-github-runner-207 kernel: [49704.630778] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 19:12:10 juju-e4d256-prod-github-runner-207 kernel: [49704.631841] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 19:12:10 juju-e4d256-prod-github-runner-207 kernel: [49704.632883] Aug 22 19:12:38 juju-e4d256-prod-github-runner-207 kernel: [49732.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 46209s! [qemu-system-x86:6715] Aug 22 19:12:38 juju-e4d256-prod-github-runner-207 kernel: [49732.543096] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 19:12:38 juju-e4d256-prod-github-runner-207 kernel: [49732.543164] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 19:12:38 juju-e4d256-prod-github-runner-207 kernel: [49732.555291] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 19:12:38 juju-e4d256-prod-github-runner-207 kernel: [49732.556574] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 19:12:38 juju-e4d256-prod-github-runner-207 kernel: [49732.557821] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:12:38 juju-e4d256-prod-github-runner-207 kernel: [49732.558878] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 19:12:38 juju-e4d256-prod-github-runner-207 kernel: [49732.561428] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 19:12:38 juju-e4d256-prod-github-runner-207 kernel: [49732.562472] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 19:12:38 juju-e4d256-prod-github-runner-207 kernel: [49732.563639] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 19:12:38 juju-e4d256-prod-github-runner-207 kernel: [49732.564819] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 19:12:38 juju-e4d256-prod-github-runner-207 kernel: [49732.565989] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 19:12:38 juju-e4d256-prod-github-runner-207 kernel: [49732.567152] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 19:12:38 juju-e4d256-prod-github-runner-207 kernel: [49732.568325] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 19:12:38 juju-e4d256-prod-github-runner-207 kernel: [49732.569579] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 19:12:38 juju-e4d256-prod-github-runner-207 kernel: [49732.570679] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 19:12:38 juju-e4d256-prod-github-runner-207 kernel: [49732.571877] Call Trace: Aug 22 19:12:38 juju-e4d256-prod-github-runner-207 kernel: [49732.572810] Aug 22 19:12:38 juju-e4d256-prod-github-runner-207 kernel: [49732.573696] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:12:38 juju-e4d256-prod-github-runner-207 kernel: [49732.574733] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:12:38 juju-e4d256-prod-github-runner-207 kernel: [49732.575755] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:12:38 juju-e4d256-prod-github-runner-207 kernel: [49732.576843] ? show_regs.part.0+0x23/0x29 Aug 22 19:12:38 juju-e4d256-prod-github-runner-207 kernel: [49732.577842] ? show_regs.cold+0x8/0xd Aug 22 19:12:38 juju-e4d256-prod-github-runner-207 kernel: [49732.578812] ? watchdog_timer_fn+0x1be/0x220 Aug 22 19:12:38 juju-e4d256-prod-github-runner-207 kernel: [49732.579820] ? lockup_detector_update_enable+0x60/0x60 Aug 22 19:12:38 juju-e4d256-prod-github-runner-207 kernel: [49732.580906] ? __hrtimer_run_queues+0x107/0x230 Aug 22 19:12:38 juju-e4d256-prod-github-runner-207 kernel: [49732.581936] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 19:12:38 juju-e4d256-prod-github-runner-207 kernel: [49732.582964] ? hrtimer_interrupt+0x101/0x220 Aug 22 19:12:38 juju-e4d256-prod-github-runner-207 kernel: [49732.584117] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 19:12:38 juju-e4d256-prod-github-runner-207 kernel: [49732.585367] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 19:12:38 juju-e4d256-prod-github-runner-207 kernel: [49732.586425] Aug 22 19:12:38 juju-e4d256-prod-github-runner-207 kernel: [49732.587278] Aug 22 19:12:38 juju-e4d256-prod-github-runner-207 kernel: [49732.588119] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 19:12:38 juju-e4d256-prod-github-runner-207 kernel: [49732.589183] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:12:38 juju-e4d256-prod-github-runner-207 kernel: [49732.590225] ? _raw_spin_lock+0x22/0x30 Aug 22 19:12:38 juju-e4d256-prod-github-runner-207 kernel: [49732.591177] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:12:38 juju-e4d256-prod-github-runner-207 kernel: [49732.592196] direct_page_fault+0x206/0x310 [kvm] Aug 22 19:12:38 juju-e4d256-prod-github-runner-207 kernel: [49732.593238] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 19:12:38 juju-e4d256-prod-github-runner-207 kernel: [49732.594255] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 19:12:38 juju-e4d256-prod-github-runner-207 kernel: [49732.595256] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 19:12:38 juju-e4d256-prod-github-runner-207 kernel: [49732.596231] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 19:12:38 juju-e4d256-prod-github-runner-207 kernel: [49732.597205] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 19:12:38 juju-e4d256-prod-github-runner-207 kernel: [49732.598186] handle_exit+0x98/0x230 [kvm_amd] Aug 22 19:12:38 juju-e4d256-prod-github-runner-207 kernel: [49732.599078] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 19:12:38 juju-e4d256-prod-github-runner-207 kernel: [49732.599998] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 19:12:38 juju-e4d256-prod-github-runner-207 kernel: [49732.600940] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 19:12:38 juju-e4d256-prod-github-runner-207 kernel: [49732.601850] vcpu_run+0x62/0x2c0 [kvm] Aug 22 19:12:38 juju-e4d256-prod-github-runner-207 kernel: [49732.602663] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 19:12:38 juju-e4d256-prod-github-runner-207 kernel: [49732.603472] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 19:12:38 juju-e4d256-prod-github-runner-207 kernel: [49732.604333] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 19:12:38 juju-e4d256-prod-github-runner-207 kernel: [49732.605167] ? __seccomp_filter+0x4a/0x4a0 Aug 22 19:12:38 juju-e4d256-prod-github-runner-207 kernel: [49732.605923] ? __fget_files+0x86/0xc0 Aug 22 19:12:38 juju-e4d256-prod-github-runner-207 kernel: [49732.606632] __x64_sys_ioctl+0x95/0xd0 Aug 22 19:12:38 juju-e4d256-prod-github-runner-207 kernel: [49732.607326] do_syscall_64+0x5c/0xc0 Aug 22 19:12:38 juju-e4d256-prod-github-runner-207 kernel: [49732.607994] ? do_futex+0x162/0x1f0 Aug 22 19:12:38 juju-e4d256-prod-github-runner-207 kernel: [49732.608644] ? __x64_sys_futex+0x78/0x1e0 Aug 22 19:12:38 juju-e4d256-prod-github-runner-207 kernel: [49732.609342] ? __secure_computing+0xa9/0x120 Aug 22 19:12:38 juju-e4d256-prod-github-runner-207 kernel: [49732.610041] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 19:12:38 juju-e4d256-prod-github-runner-207 kernel: [49732.610801] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:12:38 juju-e4d256-prod-github-runner-207 kernel: [49732.611524] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:12:38 juju-e4d256-prod-github-runner-207 kernel: [49732.612317] ? do_syscall_64+0x69/0xc0 Aug 22 19:12:38 juju-e4d256-prod-github-runner-207 kernel: [49732.612990] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:12:38 juju-e4d256-prod-github-runner-207 kernel: [49732.613703] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:12:38 juju-e4d256-prod-github-runner-207 kernel: [49732.614403] ? do_syscall_64+0x69/0xc0 Aug 22 19:12:38 juju-e4d256-prod-github-runner-207 kernel: [49732.615034] ? do_syscall_64+0x69/0xc0 Aug 22 19:12:38 juju-e4d256-prod-github-runner-207 kernel: [49732.615667] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 19:12:38 juju-e4d256-prod-github-runner-207 kernel: [49732.616380] RIP: 0033:0x7faa5d0edaff Aug 22 19:12:38 juju-e4d256-prod-github-runner-207 kernel: [49732.617016] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 19:12:38 juju-e4d256-prod-github-runner-207 kernel: [49732.619010] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 19:12:38 juju-e4d256-prod-github-runner-207 kernel: [49732.619928] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 19:12:38 juju-e4d256-prod-github-runner-207 kernel: [49732.620835] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 19:12:38 juju-e4d256-prod-github-runner-207 kernel: [49732.621735] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 19:12:38 juju-e4d256-prod-github-runner-207 kernel: [49732.622626] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 19:12:38 juju-e4d256-prod-github-runner-207 kernel: [49732.623516] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 19:12:38 juju-e4d256-prod-github-runner-207 kernel: [49732.624409] Aug 22 19:13:06 juju-e4d256-prod-github-runner-207 kernel: [49760.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 46235s! [qemu-system-x86:6715] Aug 22 19:13:06 juju-e4d256-prod-github-runner-207 kernel: [49760.543734] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 19:13:06 juju-e4d256-prod-github-runner-207 kernel: [49760.544000] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 19:13:06 juju-e4d256-prod-github-runner-207 kernel: [49760.556297] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 19:13:06 juju-e4d256-prod-github-runner-207 kernel: [49760.557583] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 19:13:06 juju-e4d256-prod-github-runner-207 kernel: [49760.558818] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:13:06 juju-e4d256-prod-github-runner-207 kernel: [49760.559917] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 19:13:06 juju-e4d256-prod-github-runner-207 kernel: [49760.562923] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 19:13:06 juju-e4d256-prod-github-runner-207 kernel: [49760.564093] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 19:13:06 juju-e4d256-prod-github-runner-207 kernel: [49760.565408] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 19:13:06 juju-e4d256-prod-github-runner-207 kernel: [49760.566692] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 19:13:06 juju-e4d256-prod-github-runner-207 kernel: [49760.567977] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 19:13:06 juju-e4d256-prod-github-runner-207 kernel: [49760.569286] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 19:13:06 juju-e4d256-prod-github-runner-207 kernel: [49760.570578] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 19:13:06 juju-e4d256-prod-github-runner-207 kernel: [49760.571951] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 19:13:06 juju-e4d256-prod-github-runner-207 kernel: [49760.573172] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 19:13:06 juju-e4d256-prod-github-runner-207 kernel: [49760.574491] Call Trace: Aug 22 19:13:06 juju-e4d256-prod-github-runner-207 kernel: [49760.575452] Aug 22 19:13:06 juju-e4d256-prod-github-runner-207 kernel: [49760.576419] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:13:06 juju-e4d256-prod-github-runner-207 kernel: [49760.577538] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:13:06 juju-e4d256-prod-github-runner-207 kernel: [49760.578656] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:13:06 juju-e4d256-prod-github-runner-207 kernel: [49760.579849] ? show_regs.part.0+0x23/0x29 Aug 22 19:13:06 juju-e4d256-prod-github-runner-207 kernel: [49760.580943] ? show_regs.cold+0x8/0xd Aug 22 19:13:06 juju-e4d256-prod-github-runner-207 kernel: [49760.582016] ? watchdog_timer_fn+0x1be/0x220 Aug 22 19:13:06 juju-e4d256-prod-github-runner-207 kernel: [49760.583128] ? lockup_detector_update_enable+0x60/0x60 Aug 22 19:13:06 juju-e4d256-prod-github-runner-207 kernel: [49760.584301] ? __hrtimer_run_queues+0x107/0x230 Aug 22 19:13:06 juju-e4d256-prod-github-runner-207 kernel: [49760.585439] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 19:13:06 juju-e4d256-prod-github-runner-207 kernel: [49760.586549] ? hrtimer_interrupt+0x101/0x220 Aug 22 19:13:06 juju-e4d256-prod-github-runner-207 kernel: [49760.587663] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 19:13:06 juju-e4d256-prod-github-runner-207 kernel: [49760.588853] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 19:13:06 juju-e4d256-prod-github-runner-207 kernel: [49760.589992] Aug 22 19:13:06 juju-e4d256-prod-github-runner-207 kernel: [49760.590909] Aug 22 19:13:06 juju-e4d256-prod-github-runner-207 kernel: [49760.591805] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 19:13:06 juju-e4d256-prod-github-runner-207 kernel: [49760.592960] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:13:06 juju-e4d256-prod-github-runner-207 kernel: [49760.594100] ? _raw_spin_lock+0x22/0x30 Aug 22 19:13:06 juju-e4d256-prod-github-runner-207 kernel: [49760.595141] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:13:06 juju-e4d256-prod-github-runner-207 kernel: [49760.596257] direct_page_fault+0x206/0x310 [kvm] Aug 22 19:13:06 juju-e4d256-prod-github-runner-207 kernel: [49760.597389] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 19:13:06 juju-e4d256-prod-github-runner-207 kernel: [49760.598488] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 19:13:06 juju-e4d256-prod-github-runner-207 kernel: [49760.599591] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 19:13:06 juju-e4d256-prod-github-runner-207 kernel: [49760.600735] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 19:13:06 juju-e4d256-prod-github-runner-207 kernel: [49760.601792] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 19:13:06 juju-e4d256-prod-github-runner-207 kernel: [49760.602884] handle_exit+0x98/0x230 [kvm_amd] Aug 22 19:13:06 juju-e4d256-prod-github-runner-207 kernel: [49760.603868] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 19:13:06 juju-e4d256-prod-github-runner-207 kernel: [49760.604920] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 19:13:06 juju-e4d256-prod-github-runner-207 kernel: [49760.605965] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 19:13:06 juju-e4d256-prod-github-runner-207 kernel: [49760.606979] vcpu_run+0x62/0x2c0 [kvm] Aug 22 19:13:06 juju-e4d256-prod-github-runner-207 kernel: [49760.607870] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 19:13:06 juju-e4d256-prod-github-runner-207 kernel: [49760.608800] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 19:13:06 juju-e4d256-prod-github-runner-207 kernel: [49760.609773] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 19:13:06 juju-e4d256-prod-github-runner-207 kernel: [49760.610687] ? __seccomp_filter+0x4a/0x4a0 Aug 22 19:13:06 juju-e4d256-prod-github-runner-207 kernel: [49760.611521] ? __fget_files+0x86/0xc0 Aug 22 19:13:06 juju-e4d256-prod-github-runner-207 kernel: [49760.612305] __x64_sys_ioctl+0x95/0xd0 Aug 22 19:13:06 juju-e4d256-prod-github-runner-207 kernel: [49760.613111] do_syscall_64+0x5c/0xc0 Aug 22 19:13:06 juju-e4d256-prod-github-runner-207 kernel: [49760.613864] ? do_futex+0x162/0x1f0 Aug 22 19:13:06 juju-e4d256-prod-github-runner-207 kernel: [49760.614605] ? __x64_sys_futex+0x78/0x1e0 Aug 22 19:13:06 juju-e4d256-prod-github-runner-207 kernel: [49760.615369] ? __secure_computing+0xa9/0x120 Aug 22 19:13:06 juju-e4d256-prod-github-runner-207 kernel: [49760.616160] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 19:13:06 juju-e4d256-prod-github-runner-207 kernel: [49760.617047] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:13:06 juju-e4d256-prod-github-runner-207 kernel: [49760.617865] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:13:06 juju-e4d256-prod-github-runner-207 kernel: [49760.618686] ? do_syscall_64+0x69/0xc0 Aug 22 19:13:06 juju-e4d256-prod-github-runner-207 kernel: [49760.619422] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:13:06 juju-e4d256-prod-github-runner-207 kernel: [49760.620225] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:13:06 juju-e4d256-prod-github-runner-207 kernel: [49760.621044] ? do_syscall_64+0x69/0xc0 Aug 22 19:13:06 juju-e4d256-prod-github-runner-207 kernel: [49760.621744] ? do_syscall_64+0x69/0xc0 Aug 22 19:13:06 juju-e4d256-prod-github-runner-207 kernel: [49760.622456] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 19:13:06 juju-e4d256-prod-github-runner-207 kernel: [49760.623268] RIP: 0033:0x7faa5d0edaff Aug 22 19:13:06 juju-e4d256-prod-github-runner-207 kernel: [49760.624007] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 19:13:06 juju-e4d256-prod-github-runner-207 kernel: [49760.626422] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 19:13:06 juju-e4d256-prod-github-runner-207 kernel: [49760.627633] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 19:13:06 juju-e4d256-prod-github-runner-207 kernel: [49760.628675] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 19:13:06 juju-e4d256-prod-github-runner-207 kernel: [49760.629714] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 19:13:06 juju-e4d256-prod-github-runner-207 kernel: [49760.630736] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 19:13:06 juju-e4d256-prod-github-runner-207 kernel: [49760.631763] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 19:13:06 juju-e4d256-prod-github-runner-207 kernel: [49760.632836] Aug 22 19:13:34 juju-e4d256-prod-github-runner-207 kernel: [49788.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 46261s! [qemu-system-x86:6715] Aug 22 19:13:34 juju-e4d256-prod-github-runner-207 kernel: [49788.543095] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 19:13:34 juju-e4d256-prod-github-runner-207 kernel: [49788.543160] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 19:13:34 juju-e4d256-prod-github-runner-207 kernel: [49788.555882] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 19:13:34 juju-e4d256-prod-github-runner-207 kernel: [49788.557262] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 19:13:34 juju-e4d256-prod-github-runner-207 kernel: [49788.558571] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:13:34 juju-e4d256-prod-github-runner-207 kernel: [49788.559695] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 19:13:34 juju-e4d256-prod-github-runner-207 kernel: [49788.562406] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 19:13:34 juju-e4d256-prod-github-runner-207 kernel: [49788.563500] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 19:13:34 juju-e4d256-prod-github-runner-207 kernel: [49788.564796] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 19:13:34 juju-e4d256-prod-github-runner-207 kernel: [49788.565980] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 19:13:34 juju-e4d256-prod-github-runner-207 kernel: [49788.567152] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 19:13:34 juju-e4d256-prod-github-runner-207 kernel: [49788.568385] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 19:13:34 juju-e4d256-prod-github-runner-207 kernel: [49788.569690] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 19:13:34 juju-e4d256-prod-github-runner-207 kernel: [49788.570959] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 19:13:34 juju-e4d256-prod-github-runner-207 kernel: [49788.572154] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 19:13:34 juju-e4d256-prod-github-runner-207 kernel: [49788.573476] Call Trace: Aug 22 19:13:34 juju-e4d256-prod-github-runner-207 kernel: [49788.574469] Aug 22 19:13:34 juju-e4d256-prod-github-runner-207 kernel: [49788.575382] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:13:34 juju-e4d256-prod-github-runner-207 kernel: [49788.576494] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:13:34 juju-e4d256-prod-github-runner-207 kernel: [49788.577549] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:13:34 juju-e4d256-prod-github-runner-207 kernel: [49788.578780] ? show_regs.part.0+0x23/0x29 Aug 22 19:13:34 juju-e4d256-prod-github-runner-207 kernel: [49788.579794] ? show_regs.cold+0x8/0xd Aug 22 19:13:34 juju-e4d256-prod-github-runner-207 kernel: [49788.580788] ? watchdog_timer_fn+0x1be/0x220 Aug 22 19:13:34 juju-e4d256-prod-github-runner-207 kernel: [49788.581802] ? lockup_detector_update_enable+0x60/0x60 Aug 22 19:13:34 juju-e4d256-prod-github-runner-207 kernel: [49788.582866] ? __hrtimer_run_queues+0x107/0x230 Aug 22 19:13:34 juju-e4d256-prod-github-runner-207 kernel: [49788.583900] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 19:13:34 juju-e4d256-prod-github-runner-207 kernel: [49788.584933] ? hrtimer_interrupt+0x101/0x220 Aug 22 19:13:34 juju-e4d256-prod-github-runner-207 kernel: [49788.585947] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 19:13:34 juju-e4d256-prod-github-runner-207 kernel: [49788.587015] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 19:13:34 juju-e4d256-prod-github-runner-207 kernel: [49788.588072] Aug 22 19:13:34 juju-e4d256-prod-github-runner-207 kernel: [49788.588927] Aug 22 19:13:34 juju-e4d256-prod-github-runner-207 kernel: [49788.589770] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 19:13:34 juju-e4d256-prod-github-runner-207 kernel: [49788.590803] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:13:34 juju-e4d256-prod-github-runner-207 kernel: [49788.591842] ? _raw_spin_lock+0x22/0x30 Aug 22 19:13:34 juju-e4d256-prod-github-runner-207 kernel: [49788.592808] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:13:34 juju-e4d256-prod-github-runner-207 kernel: [49788.593826] direct_page_fault+0x206/0x310 [kvm] Aug 22 19:13:34 juju-e4d256-prod-github-runner-207 kernel: [49788.594853] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 19:13:34 juju-e4d256-prod-github-runner-207 kernel: [49788.595861] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 19:13:34 juju-e4d256-prod-github-runner-207 kernel: [49788.596878] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 19:13:34 juju-e4d256-prod-github-runner-207 kernel: [49788.597849] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 19:13:34 juju-e4d256-prod-github-runner-207 kernel: [49788.598793] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 19:13:34 juju-e4d256-prod-github-runner-207 kernel: [49788.599773] handle_exit+0x98/0x230 [kvm_amd] Aug 22 19:13:34 juju-e4d256-prod-github-runner-207 kernel: [49788.600670] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 19:13:34 juju-e4d256-prod-github-runner-207 kernel: [49788.601584] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 19:13:34 juju-e4d256-prod-github-runner-207 kernel: [49788.602509] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 19:13:34 juju-e4d256-prod-github-runner-207 kernel: [49788.603411] vcpu_run+0x62/0x2c0 [kvm] Aug 22 19:13:34 juju-e4d256-prod-github-runner-207 kernel: [49788.604229] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 19:13:34 juju-e4d256-prod-github-runner-207 kernel: [49788.605037] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 19:13:34 juju-e4d256-prod-github-runner-207 kernel: [49788.606067] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 19:13:34 juju-e4d256-prod-github-runner-207 kernel: [49788.606869] ? __seccomp_filter+0x4a/0x4a0 Aug 22 19:13:34 juju-e4d256-prod-github-runner-207 kernel: [49788.607783] ? __fget_files+0x86/0xc0 Aug 22 19:13:34 juju-e4d256-prod-github-runner-207 kernel: [49788.608510] __x64_sys_ioctl+0x95/0xd0 Aug 22 19:13:34 juju-e4d256-prod-github-runner-207 kernel: [49788.609215] do_syscall_64+0x5c/0xc0 Aug 22 19:13:34 juju-e4d256-prod-github-runner-207 kernel: [49788.609882] ? do_futex+0x162/0x1f0 Aug 22 19:13:34 juju-e4d256-prod-github-runner-207 kernel: [49788.610531] ? __x64_sys_futex+0x78/0x1e0 Aug 22 19:13:34 juju-e4d256-prod-github-runner-207 kernel: [49788.611221] ? __secure_computing+0xa9/0x120 Aug 22 19:13:34 juju-e4d256-prod-github-runner-207 kernel: [49788.611922] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 19:13:34 juju-e4d256-prod-github-runner-207 kernel: [49788.612702] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:13:34 juju-e4d256-prod-github-runner-207 kernel: [49788.613427] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:13:34 juju-e4d256-prod-github-runner-207 kernel: [49788.614143] ? do_syscall_64+0x69/0xc0 Aug 22 19:13:34 juju-e4d256-prod-github-runner-207 kernel: [49788.614786] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:13:34 juju-e4d256-prod-github-runner-207 kernel: [49788.615487] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:13:34 juju-e4d256-prod-github-runner-207 kernel: [49788.616199] ? do_syscall_64+0x69/0xc0 Aug 22 19:13:34 juju-e4d256-prod-github-runner-207 kernel: [49788.616825] ? do_syscall_64+0x69/0xc0 Aug 22 19:13:34 juju-e4d256-prod-github-runner-207 kernel: [49788.617470] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 19:13:34 juju-e4d256-prod-github-runner-207 kernel: [49788.618187] RIP: 0033:0x7faa5d0edaff Aug 22 19:13:34 juju-e4d256-prod-github-runner-207 kernel: [49788.618814] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 19:13:34 juju-e4d256-prod-github-runner-207 kernel: [49788.620848] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 19:13:34 juju-e4d256-prod-github-runner-207 kernel: [49788.621759] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 19:13:34 juju-e4d256-prod-github-runner-207 kernel: [49788.622646] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 19:13:34 juju-e4d256-prod-github-runner-207 kernel: [49788.623574] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 19:13:34 juju-e4d256-prod-github-runner-207 kernel: [49788.624523] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 19:13:34 juju-e4d256-prod-github-runner-207 kernel: [49788.625467] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 19:13:34 juju-e4d256-prod-github-runner-207 kernel: [49788.626396] Aug 22 19:14:02 juju-e4d256-prod-github-runner-207 kernel: [49816.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 46287s! [qemu-system-x86:6715] Aug 22 19:14:02 juju-e4d256-prod-github-runner-207 kernel: [49816.543163] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 19:14:02 juju-e4d256-prod-github-runner-207 kernel: [49816.543229] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 19:14:02 juju-e4d256-prod-github-runner-207 kernel: [49816.555851] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 19:14:02 juju-e4d256-prod-github-runner-207 kernel: [49816.557123] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 19:14:02 juju-e4d256-prod-github-runner-207 kernel: [49816.558347] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:14:02 juju-e4d256-prod-github-runner-207 kernel: [49816.559412] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 19:14:02 juju-e4d256-prod-github-runner-207 kernel: [49816.562170] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 19:14:02 juju-e4d256-prod-github-runner-207 kernel: [49816.563273] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 19:14:02 juju-e4d256-prod-github-runner-207 kernel: [49816.564572] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 19:14:02 juju-e4d256-prod-github-runner-207 kernel: [49816.565784] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 19:14:02 juju-e4d256-prod-github-runner-207 kernel: [49816.566981] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 19:14:02 juju-e4d256-prod-github-runner-207 kernel: [49816.568161] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 19:14:02 juju-e4d256-prod-github-runner-207 kernel: [49816.569375] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 19:14:02 juju-e4d256-prod-github-runner-207 kernel: [49816.570658] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 19:14:02 juju-e4d256-prod-github-runner-207 kernel: [49816.571801] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 19:14:02 juju-e4d256-prod-github-runner-207 kernel: [49816.572990] Call Trace: Aug 22 19:14:02 juju-e4d256-prod-github-runner-207 kernel: [49816.573906] Aug 22 19:14:02 juju-e4d256-prod-github-runner-207 kernel: [49816.574788] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:14:02 juju-e4d256-prod-github-runner-207 kernel: [49816.575836] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:14:02 juju-e4d256-prod-github-runner-207 kernel: [49816.576988] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:14:02 juju-e4d256-prod-github-runner-207 kernel: [49816.578072] ? show_regs.part.0+0x23/0x29 Aug 22 19:14:02 juju-e4d256-prod-github-runner-207 kernel: [49816.579068] ? show_regs.cold+0x8/0xd Aug 22 19:14:02 juju-e4d256-prod-github-runner-207 kernel: [49816.580070] ? watchdog_timer_fn+0x1be/0x220 Aug 22 19:14:02 juju-e4d256-prod-github-runner-207 kernel: [49816.581079] ? lockup_detector_update_enable+0x60/0x60 Aug 22 19:14:02 juju-e4d256-prod-github-runner-207 kernel: [49816.582188] ? __hrtimer_run_queues+0x107/0x230 Aug 22 19:14:02 juju-e4d256-prod-github-runner-207 kernel: [49816.583221] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 19:14:02 juju-e4d256-prod-github-runner-207 kernel: [49816.584261] ? hrtimer_interrupt+0x101/0x220 Aug 22 19:14:02 juju-e4d256-prod-github-runner-207 kernel: [49816.585275] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 19:14:02 juju-e4d256-prod-github-runner-207 kernel: [49816.586346] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 19:14:02 juju-e4d256-prod-github-runner-207 kernel: [49816.587391] Aug 22 19:14:02 juju-e4d256-prod-github-runner-207 kernel: [49816.588260] Aug 22 19:14:02 juju-e4d256-prod-github-runner-207 kernel: [49816.589098] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 19:14:02 juju-e4d256-prod-github-runner-207 kernel: [49816.590140] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:14:02 juju-e4d256-prod-github-runner-207 kernel: [49816.591203] ? _raw_spin_lock+0x22/0x30 Aug 22 19:14:02 juju-e4d256-prod-github-runner-207 kernel: [49816.592183] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:14:02 juju-e4d256-prod-github-runner-207 kernel: [49816.593208] direct_page_fault+0x206/0x310 [kvm] Aug 22 19:14:02 juju-e4d256-prod-github-runner-207 kernel: [49816.594233] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 19:14:02 juju-e4d256-prod-github-runner-207 kernel: [49816.595242] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 19:14:02 juju-e4d256-prod-github-runner-207 kernel: [49816.596258] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 19:14:02 juju-e4d256-prod-github-runner-207 kernel: [49816.597232] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 19:14:02 juju-e4d256-prod-github-runner-207 kernel: [49816.598176] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 19:14:02 juju-e4d256-prod-github-runner-207 kernel: [49816.599154] handle_exit+0x98/0x230 [kvm_amd] Aug 22 19:14:02 juju-e4d256-prod-github-runner-207 kernel: [49816.600056] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 19:14:02 juju-e4d256-prod-github-runner-207 kernel: [49816.601104] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 19:14:02 juju-e4d256-prod-github-runner-207 kernel: [49816.602203] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 19:14:02 juju-e4d256-prod-github-runner-207 kernel: [49816.603186] vcpu_run+0x62/0x2c0 [kvm] Aug 22 19:14:02 juju-e4d256-prod-github-runner-207 kernel: [49816.604261] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 19:14:02 juju-e4d256-prod-github-runner-207 kernel: [49816.605084] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 19:14:02 juju-e4d256-prod-github-runner-207 kernel: [49816.606111] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 19:14:02 juju-e4d256-prod-github-runner-207 kernel: [49816.606910] ? __seccomp_filter+0x4a/0x4a0 Aug 22 19:14:02 juju-e4d256-prod-github-runner-207 kernel: [49816.607656] ? __fget_files+0x86/0xc0 Aug 22 19:14:02 juju-e4d256-prod-github-runner-207 kernel: [49816.608372] __x64_sys_ioctl+0x95/0xd0 Aug 22 19:14:02 juju-e4d256-prod-github-runner-207 kernel: [49816.609101] do_syscall_64+0x5c/0xc0 Aug 22 19:14:02 juju-e4d256-prod-github-runner-207 kernel: [49816.609771] ? do_futex+0x162/0x1f0 Aug 22 19:14:02 juju-e4d256-prod-github-runner-207 kernel: [49816.610423] ? __x64_sys_futex+0x78/0x1e0 Aug 22 19:14:02 juju-e4d256-prod-github-runner-207 kernel: [49816.611100] ? __secure_computing+0xa9/0x120 Aug 22 19:14:02 juju-e4d256-prod-github-runner-207 kernel: [49816.611859] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 19:14:02 juju-e4d256-prod-github-runner-207 kernel: [49816.612712] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:14:02 juju-e4d256-prod-github-runner-207 kernel: [49816.613537] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:14:02 juju-e4d256-prod-github-runner-207 kernel: [49816.614480] ? do_syscall_64+0x69/0xc0 Aug 22 19:14:02 juju-e4d256-prod-github-runner-207 kernel: [49816.615284] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:14:02 juju-e4d256-prod-github-runner-207 kernel: [49816.616054] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:14:02 juju-e4d256-prod-github-runner-207 kernel: [49816.616961] ? do_syscall_64+0x69/0xc0 Aug 22 19:14:02 juju-e4d256-prod-github-runner-207 kernel: [49816.617631] ? do_syscall_64+0x69/0xc0 Aug 22 19:14:02 juju-e4d256-prod-github-runner-207 kernel: [49816.618358] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 19:14:02 juju-e4d256-prod-github-runner-207 kernel: [49816.619346] RIP: 0033:0x7faa5d0edaff Aug 22 19:14:02 juju-e4d256-prod-github-runner-207 kernel: [49816.620120] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 19:14:02 juju-e4d256-prod-github-runner-207 kernel: [49816.622127] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 19:14:02 juju-e4d256-prod-github-runner-207 kernel: [49816.623143] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 19:14:02 juju-e4d256-prod-github-runner-207 kernel: [49816.624162] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 19:14:02 juju-e4d256-prod-github-runner-207 kernel: [49816.625182] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 19:14:02 juju-e4d256-prod-github-runner-207 kernel: [49816.626126] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 19:14:02 juju-e4d256-prod-github-runner-207 kernel: [49816.627019] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 19:14:02 juju-e4d256-prod-github-runner-207 kernel: [49816.627944] Aug 22 19:14:30 juju-e4d256-prod-github-runner-207 kernel: [49844.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 46313s! [qemu-system-x86:6715] Aug 22 19:14:30 juju-e4d256-prod-github-runner-207 kernel: [49844.543971] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 19:14:30 juju-e4d256-prod-github-runner-207 kernel: [49844.544221] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 19:14:30 juju-e4d256-prod-github-runner-207 kernel: [49844.558358] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 19:14:30 juju-e4d256-prod-github-runner-207 kernel: [49844.559817] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 19:14:30 juju-e4d256-prod-github-runner-207 kernel: [49844.561212] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:14:30 juju-e4d256-prod-github-runner-207 kernel: [49844.562385] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 19:14:30 juju-e4d256-prod-github-runner-207 kernel: [49844.565296] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 19:14:30 juju-e4d256-prod-github-runner-207 kernel: [49844.566442] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 19:14:30 juju-e4d256-prod-github-runner-207 kernel: [49844.567771] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 19:14:30 juju-e4d256-prod-github-runner-207 kernel: [49844.569081] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 19:14:30 juju-e4d256-prod-github-runner-207 kernel: [49844.570380] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 19:14:30 juju-e4d256-prod-github-runner-207 kernel: [49844.571708] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 19:14:30 juju-e4d256-prod-github-runner-207 kernel: [49844.573011] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 19:14:30 juju-e4d256-prod-github-runner-207 kernel: [49844.574397] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 19:14:30 juju-e4d256-prod-github-runner-207 kernel: [49844.575643] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 19:14:30 juju-e4d256-prod-github-runner-207 kernel: [49844.576977] Call Trace: Aug 22 19:14:30 juju-e4d256-prod-github-runner-207 kernel: [49844.577960] Aug 22 19:14:30 juju-e4d256-prod-github-runner-207 kernel: [49844.578906] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:14:30 juju-e4d256-prod-github-runner-207 kernel: [49844.580049] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:14:30 juju-e4d256-prod-github-runner-207 kernel: [49844.581164] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:14:30 juju-e4d256-prod-github-runner-207 kernel: [49844.582397] ? show_regs.part.0+0x23/0x29 Aug 22 19:14:30 juju-e4d256-prod-github-runner-207 kernel: [49844.583506] ? show_regs.cold+0x8/0xd Aug 22 19:14:30 juju-e4d256-prod-github-runner-207 kernel: [49844.584760] ? watchdog_timer_fn+0x1be/0x220 Aug 22 19:14:30 juju-e4d256-prod-github-runner-207 kernel: [49844.585857] ? lockup_detector_update_enable+0x60/0x60 Aug 22 19:14:30 juju-e4d256-prod-github-runner-207 kernel: [49844.587023] ? __hrtimer_run_queues+0x107/0x230 Aug 22 19:14:30 juju-e4d256-prod-github-runner-207 kernel: [49844.588161] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 19:14:30 juju-e4d256-prod-github-runner-207 kernel: [49844.589270] ? hrtimer_interrupt+0x101/0x220 Aug 22 19:14:30 juju-e4d256-prod-github-runner-207 kernel: [49844.590373] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 19:14:30 juju-e4d256-prod-github-runner-207 kernel: [49844.591582] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 19:14:30 juju-e4d256-prod-github-runner-207 kernel: [49844.592727] Aug 22 19:14:30 juju-e4d256-prod-github-runner-207 kernel: [49844.593630] Aug 22 19:14:30 juju-e4d256-prod-github-runner-207 kernel: [49844.594515] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 19:14:30 juju-e4d256-prod-github-runner-207 kernel: [49844.595678] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:14:30 juju-e4d256-prod-github-runner-207 kernel: [49844.596819] ? _raw_spin_lock+0x22/0x30 Aug 22 19:14:30 juju-e4d256-prod-github-runner-207 kernel: [49844.597849] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:14:30 juju-e4d256-prod-github-runner-207 kernel: [49844.598969] direct_page_fault+0x206/0x310 [kvm] Aug 22 19:14:30 juju-e4d256-prod-github-runner-207 kernel: [49844.600115] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 19:14:30 juju-e4d256-prod-github-runner-207 kernel: [49844.601223] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 19:14:30 juju-e4d256-prod-github-runner-207 kernel: [49844.602316] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 19:14:30 juju-e4d256-prod-github-runner-207 kernel: [49844.603442] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 19:14:30 juju-e4d256-prod-github-runner-207 kernel: [49844.604687] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 19:14:30 juju-e4d256-prod-github-runner-207 kernel: [49844.605793] handle_exit+0x98/0x230 [kvm_amd] Aug 22 19:14:30 juju-e4d256-prod-github-runner-207 kernel: [49844.606785] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 19:14:30 juju-e4d256-prod-github-runner-207 kernel: [49844.607816] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 19:14:30 juju-e4d256-prod-github-runner-207 kernel: [49844.608847] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 19:14:30 juju-e4d256-prod-github-runner-207 kernel: [49844.609863] vcpu_run+0x62/0x2c0 [kvm] Aug 22 19:14:30 juju-e4d256-prod-github-runner-207 kernel: [49844.610769] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 19:14:30 juju-e4d256-prod-github-runner-207 kernel: [49844.611693] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 19:14:30 juju-e4d256-prod-github-runner-207 kernel: [49844.612652] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 19:14:30 juju-e4d256-prod-github-runner-207 kernel: [49844.613552] ? __seccomp_filter+0x4a/0x4a0 Aug 22 19:14:30 juju-e4d256-prod-github-runner-207 kernel: [49844.614385] ? __fget_files+0x86/0xc0 Aug 22 19:14:30 juju-e4d256-prod-github-runner-207 kernel: [49844.615172] __x64_sys_ioctl+0x95/0xd0 Aug 22 19:14:30 juju-e4d256-prod-github-runner-207 kernel: [49844.615974] do_syscall_64+0x5c/0xc0 Aug 22 19:14:30 juju-e4d256-prod-github-runner-207 kernel: [49844.616719] ? do_futex+0x162/0x1f0 Aug 22 19:14:30 juju-e4d256-prod-github-runner-207 kernel: [49844.617462] ? __x64_sys_futex+0x78/0x1e0 Aug 22 19:14:30 juju-e4d256-prod-github-runner-207 kernel: [49844.618235] ? __secure_computing+0xa9/0x120 Aug 22 19:14:30 juju-e4d256-prod-github-runner-207 kernel: [49844.619048] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 19:14:30 juju-e4d256-prod-github-runner-207 kernel: [49844.619941] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:14:30 juju-e4d256-prod-github-runner-207 kernel: [49844.620771] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:14:30 juju-e4d256-prod-github-runner-207 kernel: [49844.621599] ? do_syscall_64+0x69/0xc0 Aug 22 19:14:30 juju-e4d256-prod-github-runner-207 kernel: [49844.622544] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:14:30 juju-e4d256-prod-github-runner-207 kernel: [49844.623410] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:14:30 juju-e4d256-prod-github-runner-207 kernel: [49844.624222] ? do_syscall_64+0x69/0xc0 Aug 22 19:14:30 juju-e4d256-prod-github-runner-207 kernel: [49844.624924] ? do_syscall_64+0x69/0xc0 Aug 22 19:14:30 juju-e4d256-prod-github-runner-207 kernel: [49844.625621] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 19:14:30 juju-e4d256-prod-github-runner-207 kernel: [49844.626441] RIP: 0033:0x7faa5d0edaff Aug 22 19:14:30 juju-e4d256-prod-github-runner-207 kernel: [49844.627169] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 19:14:30 juju-e4d256-prod-github-runner-207 kernel: [49844.629519] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 19:14:30 juju-e4d256-prod-github-runner-207 kernel: [49844.630573] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 19:14:30 juju-e4d256-prod-github-runner-207 kernel: [49844.631620] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 19:14:30 juju-e4d256-prod-github-runner-207 kernel: [49844.632645] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 19:14:30 juju-e4d256-prod-github-runner-207 kernel: [49844.633664] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 19:14:30 juju-e4d256-prod-github-runner-207 kernel: [49844.634687] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 19:14:30 juju-e4d256-prod-github-runner-207 kernel: [49844.635733] Aug 22 19:14:46 juju-e4d256-prod-github-runner-207 kernel: [49860.512712] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 19:14:46 juju-e4d256-prod-github-runner-207 kernel: [49860.513725] rcu: 1-....: (12396719 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=5993742 Aug 22 19:14:46 juju-e4d256-prod-github-runner-207 kernel: [49860.514916] (t=12435828 jiffies g=23269 q=47477) Aug 22 19:14:46 juju-e4d256-prod-github-runner-207 kernel: [49860.515738] NMI backtrace for cpu 1 Aug 22 19:14:46 juju-e4d256-prod-github-runner-207 kernel: [49860.516485] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 19:14:46 juju-e4d256-prod-github-runner-207 kernel: [49860.517599] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 19:14:46 juju-e4d256-prod-github-runner-207 kernel: [49860.518742] Call Trace: Aug 22 19:14:46 juju-e4d256-prod-github-runner-207 kernel: [49860.519454] Aug 22 19:14:46 juju-e4d256-prod-github-runner-207 kernel: [49860.520123] show_stack+0x52/0x5c Aug 22 19:14:46 juju-e4d256-prod-github-runner-207 kernel: [49860.520856] dump_stack_lvl+0x4a/0x63 Aug 22 19:14:46 juju-e4d256-prod-github-runner-207 kernel: [49860.521617] dump_stack+0x10/0x16 Aug 22 19:14:46 juju-e4d256-prod-github-runner-207 kernel: [49860.522346] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 19:14:46 juju-e4d256-prod-github-runner-207 kernel: [49860.523146] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 19:14:46 juju-e4d256-prod-github-runner-207 kernel: [49860.524074] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 19:14:46 juju-e4d256-prod-github-runner-207 kernel: [49860.525003] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 19:14:46 juju-e4d256-prod-github-runner-207 kernel: [49860.525952] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 19:14:46 juju-e4d256-prod-github-runner-207 kernel: [49860.526890] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 19:14:46 juju-e4d256-prod-github-runner-207 kernel: [49860.527788] print_cpu_stall.cold+0x2f/0xe2 Aug 22 19:14:46 juju-e4d256-prod-github-runner-207 kernel: [49860.528634] ? timekeeping_update+0xf7/0x150 Aug 22 19:14:46 juju-e4d256-prod-github-runner-207 kernel: [49860.529531] check_cpu_stall+0x109/0x270 Aug 22 19:14:46 juju-e4d256-prod-github-runner-207 kernel: [49860.530371] rcu_sched_clock_irq+0x9a/0x250 Aug 22 19:14:46 juju-e4d256-prod-github-runner-207 kernel: [49860.531246] update_process_times+0x94/0xd0 Aug 22 19:14:46 juju-e4d256-prod-github-runner-207 kernel: [49860.532085] tick_sched_handle+0x29/0x70 Aug 22 19:14:46 juju-e4d256-prod-github-runner-207 kernel: [49860.532904] tick_sched_timer+0x8c/0xc0 Aug 22 19:14:46 juju-e4d256-prod-github-runner-207 kernel: [49860.533721] ? tick_nohz_handler+0xb0/0xb0 Aug 22 19:14:46 juju-e4d256-prod-github-runner-207 kernel: [49860.534564] __hrtimer_run_queues+0x107/0x230 Aug 22 19:14:46 juju-e4d256-prod-github-runner-207 kernel: [49860.535456] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 19:14:46 juju-e4d256-prod-github-runner-207 kernel: [49860.536340] hrtimer_interrupt+0x101/0x220 Aug 22 19:14:46 juju-e4d256-prod-github-runner-207 kernel: [49860.537182] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 19:14:46 juju-e4d256-prod-github-runner-207 kernel: [49860.538093] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 19:14:46 juju-e4d256-prod-github-runner-207 kernel: [49860.538994] Aug 22 19:14:46 juju-e4d256-prod-github-runner-207 kernel: [49860.539707] Aug 22 19:14:46 juju-e4d256-prod-github-runner-207 kernel: [49860.540384] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 19:14:46 juju-e4d256-prod-github-runner-207 kernel: [49860.541307] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:14:46 juju-e4d256-prod-github-runner-207 kernel: [49860.542307] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 19:14:46 juju-e4d256-prod-github-runner-207 kernel: [49860.544854] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 19:14:46 juju-e4d256-prod-github-runner-207 kernel: [49860.545834] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 19:14:46 juju-e4d256-prod-github-runner-207 kernel: [49860.546980] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 19:14:46 juju-e4d256-prod-github-runner-207 kernel: [49860.548114] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 19:14:46 juju-e4d256-prod-github-runner-207 kernel: [49860.549211] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 19:14:46 juju-e4d256-prod-github-runner-207 kernel: [49860.550298] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 19:14:46 juju-e4d256-prod-github-runner-207 kernel: [49860.551418] ? _raw_spin_lock+0x22/0x30 Aug 22 19:14:46 juju-e4d256-prod-github-runner-207 kernel: [49860.552262] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:14:46 juju-e4d256-prod-github-runner-207 kernel: [49860.553182] direct_page_fault+0x206/0x310 [kvm] Aug 22 19:14:46 juju-e4d256-prod-github-runner-207 kernel: [49860.554113] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 19:14:46 juju-e4d256-prod-github-runner-207 kernel: [49860.555033] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 19:14:46 juju-e4d256-prod-github-runner-207 kernel: [49860.555984] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 19:14:46 juju-e4d256-prod-github-runner-207 kernel: [49860.556885] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 19:14:46 juju-e4d256-prod-github-runner-207 kernel: [49860.557764] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 19:14:46 juju-e4d256-prod-github-runner-207 kernel: [49860.558694] handle_exit+0x98/0x230 [kvm_amd] Aug 22 19:14:46 juju-e4d256-prod-github-runner-207 kernel: [49860.559548] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 19:14:46 juju-e4d256-prod-github-runner-207 kernel: [49860.560431] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 19:14:46 juju-e4d256-prod-github-runner-207 kernel: [49860.561326] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 19:14:46 juju-e4d256-prod-github-runner-207 kernel: [49860.562211] vcpu_run+0x62/0x2c0 [kvm] Aug 22 19:14:46 juju-e4d256-prod-github-runner-207 kernel: [49860.563006] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 19:14:46 juju-e4d256-prod-github-runner-207 kernel: [49860.563849] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 19:14:46 juju-e4d256-prod-github-runner-207 kernel: [49860.564755] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 19:14:46 juju-e4d256-prod-github-runner-207 kernel: [49860.565605] ? __seccomp_filter+0x4a/0x4a0 Aug 22 19:14:46 juju-e4d256-prod-github-runner-207 kernel: [49860.566414] ? __fget_files+0x86/0xc0 Aug 22 19:14:46 juju-e4d256-prod-github-runner-207 kernel: [49860.567215] __x64_sys_ioctl+0x95/0xd0 Aug 22 19:14:46 juju-e4d256-prod-github-runner-207 kernel: [49860.567989] do_syscall_64+0x5c/0xc0 Aug 22 19:14:46 juju-e4d256-prod-github-runner-207 kernel: [49860.568749] ? do_futex+0x162/0x1f0 Aug 22 19:14:46 juju-e4d256-prod-github-runner-207 kernel: [49860.569498] ? __x64_sys_futex+0x78/0x1e0 Aug 22 19:14:46 juju-e4d256-prod-github-runner-207 kernel: [49860.570281] ? __secure_computing+0xa9/0x120 Aug 22 19:14:46 juju-e4d256-prod-github-runner-207 kernel: [49860.571084] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 19:14:46 juju-e4d256-prod-github-runner-207 kernel: [49860.572004] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:14:46 juju-e4d256-prod-github-runner-207 kernel: [49860.572858] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:14:46 juju-e4d256-prod-github-runner-207 kernel: [49860.573705] ? do_syscall_64+0x69/0xc0 Aug 22 19:14:46 juju-e4d256-prod-github-runner-207 kernel: [49860.574470] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:14:46 juju-e4d256-prod-github-runner-207 kernel: [49860.575348] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:14:46 juju-e4d256-prod-github-runner-207 kernel: [49860.576199] ? do_syscall_64+0x69/0xc0 Aug 22 19:14:46 juju-e4d256-prod-github-runner-207 kernel: [49860.576968] ? do_syscall_64+0x69/0xc0 Aug 22 19:14:46 juju-e4d256-prod-github-runner-207 kernel: [49860.577728] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 19:14:46 juju-e4d256-prod-github-runner-207 kernel: [49860.578589] RIP: 0033:0x7faa5d0edaff Aug 22 19:14:46 juju-e4d256-prod-github-runner-207 kernel: [49860.579382] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 19:14:46 juju-e4d256-prod-github-runner-207 kernel: [49860.581809] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 19:14:46 juju-e4d256-prod-github-runner-207 kernel: [49860.582926] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 19:14:46 juju-e4d256-prod-github-runner-207 kernel: [49860.584023] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 19:14:46 juju-e4d256-prod-github-runner-207 kernel: [49860.585120] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 19:14:46 juju-e4d256-prod-github-runner-207 kernel: [49860.586243] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 19:14:46 juju-e4d256-prod-github-runner-207 kernel: [49860.587362] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 19:14:46 juju-e4d256-prod-github-runner-207 kernel: [49860.588431] Aug 22 19:15:10 juju-e4d256-prod-github-runner-207 kernel: [49884.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 46350s! [qemu-system-x86:6715] Aug 22 19:15:10 juju-e4d256-prod-github-runner-207 kernel: [49884.543104] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 19:15:10 juju-e4d256-prod-github-runner-207 kernel: [49884.543170] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 19:15:10 juju-e4d256-prod-github-runner-207 kernel: [49884.556121] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 19:15:10 juju-e4d256-prod-github-runner-207 kernel: [49884.557678] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 19:15:10 juju-e4d256-prod-github-runner-207 kernel: [49884.559014] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:15:10 juju-e4d256-prod-github-runner-207 kernel: [49884.560203] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 19:15:10 juju-e4d256-prod-github-runner-207 kernel: [49884.563137] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 19:15:10 juju-e4d256-prod-github-runner-207 kernel: [49884.564292] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 19:15:10 juju-e4d256-prod-github-runner-207 kernel: [49884.565589] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 19:15:10 juju-e4d256-prod-github-runner-207 kernel: [49884.566913] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 19:15:10 juju-e4d256-prod-github-runner-207 kernel: [49884.568228] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 19:15:10 juju-e4d256-prod-github-runner-207 kernel: [49884.569535] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 19:15:10 juju-e4d256-prod-github-runner-207 kernel: [49884.570840] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 19:15:10 juju-e4d256-prod-github-runner-207 kernel: [49884.572249] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 19:15:10 juju-e4d256-prod-github-runner-207 kernel: [49884.573468] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 19:15:10 juju-e4d256-prod-github-runner-207 kernel: [49884.574801] Call Trace: Aug 22 19:15:10 juju-e4d256-prod-github-runner-207 kernel: [49884.575789] Aug 22 19:15:10 juju-e4d256-prod-github-runner-207 kernel: [49884.576732] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:15:10 juju-e4d256-prod-github-runner-207 kernel: [49884.577856] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:15:10 juju-e4d256-prod-github-runner-207 kernel: [49884.578994] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:15:10 juju-e4d256-prod-github-runner-207 kernel: [49884.580175] ? show_regs.part.0+0x23/0x29 Aug 22 19:15:10 juju-e4d256-prod-github-runner-207 kernel: [49884.581261] ? show_regs.cold+0x8/0xd Aug 22 19:15:10 juju-e4d256-prod-github-runner-207 kernel: [49884.582310] ? watchdog_timer_fn+0x1be/0x220 Aug 22 19:15:10 juju-e4d256-prod-github-runner-207 kernel: [49884.583422] ? lockup_detector_update_enable+0x60/0x60 Aug 22 19:15:10 juju-e4d256-prod-github-runner-207 kernel: [49884.584594] ? __hrtimer_run_queues+0x107/0x230 Aug 22 19:15:10 juju-e4d256-prod-github-runner-207 kernel: [49884.585724] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 19:15:10 juju-e4d256-prod-github-runner-207 kernel: [49884.586897] ? hrtimer_interrupt+0x101/0x220 Aug 22 19:15:10 juju-e4d256-prod-github-runner-207 kernel: [49884.588018] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 19:15:10 juju-e4d256-prod-github-runner-207 kernel: [49884.589196] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 19:15:10 juju-e4d256-prod-github-runner-207 kernel: [49884.590338] Aug 22 19:15:10 juju-e4d256-prod-github-runner-207 kernel: [49884.591277] Aug 22 19:15:10 juju-e4d256-prod-github-runner-207 kernel: [49884.592237] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 19:15:10 juju-e4d256-prod-github-runner-207 kernel: [49884.593346] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:15:10 juju-e4d256-prod-github-runner-207 kernel: [49884.594490] ? _raw_spin_lock+0x22/0x30 Aug 22 19:15:10 juju-e4d256-prod-github-runner-207 kernel: [49884.595589] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:15:10 juju-e4d256-prod-github-runner-207 kernel: [49884.596719] direct_page_fault+0x206/0x310 [kvm] Aug 22 19:15:10 juju-e4d256-prod-github-runner-207 kernel: [49884.597916] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 19:15:10 juju-e4d256-prod-github-runner-207 kernel: [49884.599027] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 19:15:10 juju-e4d256-prod-github-runner-207 kernel: [49884.600126] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 19:15:10 juju-e4d256-prod-github-runner-207 kernel: [49884.601183] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 19:15:10 juju-e4d256-prod-github-runner-207 kernel: [49884.602227] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 19:15:10 juju-e4d256-prod-github-runner-207 kernel: [49884.603310] handle_exit+0x98/0x230 [kvm_amd] Aug 22 19:15:10 juju-e4d256-prod-github-runner-207 kernel: [49884.604270] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 19:15:10 juju-e4d256-prod-github-runner-207 kernel: [49884.605340] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 19:15:10 juju-e4d256-prod-github-runner-207 kernel: [49884.606373] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 19:15:10 juju-e4d256-prod-github-runner-207 kernel: [49884.607405] vcpu_run+0x62/0x2c0 [kvm] Aug 22 19:15:10 juju-e4d256-prod-github-runner-207 kernel: [49884.608302] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 19:15:10 juju-e4d256-prod-github-runner-207 kernel: [49884.609177] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 19:15:10 juju-e4d256-prod-github-runner-207 kernel: [49884.610121] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 19:15:10 juju-e4d256-prod-github-runner-207 kernel: [49884.611014] ? __seccomp_filter+0x4a/0x4a0 Aug 22 19:15:10 juju-e4d256-prod-github-runner-207 kernel: [49884.611830] ? __fget_files+0x86/0xc0 Aug 22 19:15:10 juju-e4d256-prod-github-runner-207 kernel: [49884.612596] __x64_sys_ioctl+0x95/0xd0 Aug 22 19:15:10 juju-e4d256-prod-github-runner-207 kernel: [49884.613335] do_syscall_64+0x5c/0xc0 Aug 22 19:15:10 juju-e4d256-prod-github-runner-207 kernel: [49884.614232] ? do_futex+0x162/0x1f0 Aug 22 19:15:10 juju-e4d256-prod-github-runner-207 kernel: [49884.615055] ? __x64_sys_futex+0x78/0x1e0 Aug 22 19:15:10 juju-e4d256-prod-github-runner-207 kernel: [49884.615807] ? __secure_computing+0xa9/0x120 Aug 22 19:15:10 juju-e4d256-prod-github-runner-207 kernel: [49884.616648] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 19:15:10 juju-e4d256-prod-github-runner-207 kernel: [49884.617542] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:15:10 juju-e4d256-prod-github-runner-207 kernel: [49884.618367] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:15:10 juju-e4d256-prod-github-runner-207 kernel: [49884.619216] ? do_syscall_64+0x69/0xc0 Aug 22 19:15:10 juju-e4d256-prod-github-runner-207 kernel: [49884.619921] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:15:10 juju-e4d256-prod-github-runner-207 kernel: [49884.620716] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:15:10 juju-e4d256-prod-github-runner-207 kernel: [49884.621478] ? do_syscall_64+0x69/0xc0 Aug 22 19:15:10 juju-e4d256-prod-github-runner-207 kernel: [49884.622124] ? do_syscall_64+0x69/0xc0 Aug 22 19:15:10 juju-e4d256-prod-github-runner-207 kernel: [49884.622957] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 19:15:10 juju-e4d256-prod-github-runner-207 kernel: [49884.623732] RIP: 0033:0x7faa5d0edaff Aug 22 19:15:10 juju-e4d256-prod-github-runner-207 kernel: [49884.624404] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 19:15:10 juju-e4d256-prod-github-runner-207 kernel: [49884.626555] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 19:15:10 juju-e4d256-prod-github-runner-207 kernel: [49884.627547] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 19:15:10 juju-e4d256-prod-github-runner-207 kernel: [49884.628522] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 19:15:10 juju-e4d256-prod-github-runner-207 kernel: [49884.629472] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 19:15:10 juju-e4d256-prod-github-runner-207 kernel: [49884.630434] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 19:15:10 juju-e4d256-prod-github-runner-207 kernel: [49884.631430] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 19:15:10 juju-e4d256-prod-github-runner-207 kernel: [49884.632387] Aug 22 19:15:38 juju-e4d256-prod-github-runner-207 kernel: [49912.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 46376s! [qemu-system-x86:6715] Aug 22 19:15:38 juju-e4d256-prod-github-runner-207 kernel: [49912.543111] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 19:15:38 juju-e4d256-prod-github-runner-207 kernel: [49912.543177] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 19:15:38 juju-e4d256-prod-github-runner-207 kernel: [49912.556298] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 19:15:38 juju-e4d256-prod-github-runner-207 kernel: [49912.557710] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 19:15:38 juju-e4d256-prod-github-runner-207 kernel: [49912.559130] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:15:38 juju-e4d256-prod-github-runner-207 kernel: [49912.560667] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 19:15:38 juju-e4d256-prod-github-runner-207 kernel: [49912.564185] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 19:15:38 juju-e4d256-prod-github-runner-207 kernel: [49912.565285] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 19:15:38 juju-e4d256-prod-github-runner-207 kernel: [49912.566492] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 19:15:38 juju-e4d256-prod-github-runner-207 kernel: [49912.567711] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 19:15:38 juju-e4d256-prod-github-runner-207 kernel: [49912.569043] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 19:15:38 juju-e4d256-prod-github-runner-207 kernel: [49912.570767] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 19:15:38 juju-e4d256-prod-github-runner-207 kernel: [49912.572567] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 19:15:38 juju-e4d256-prod-github-runner-207 kernel: [49912.574081] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 19:15:38 juju-e4d256-prod-github-runner-207 kernel: [49912.575448] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 19:15:38 juju-e4d256-prod-github-runner-207 kernel: [49912.576702] Call Trace: Aug 22 19:15:38 juju-e4d256-prod-github-runner-207 kernel: [49912.577629] Aug 22 19:15:38 juju-e4d256-prod-github-runner-207 kernel: [49912.578535] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:15:38 juju-e4d256-prod-github-runner-207 kernel: [49912.579858] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:15:38 juju-e4d256-prod-github-runner-207 kernel: [49912.581319] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:15:38 juju-e4d256-prod-github-runner-207 kernel: [49912.583034] ? show_regs.part.0+0x23/0x29 Aug 22 19:15:38 juju-e4d256-prod-github-runner-207 kernel: [49912.584433] ? show_regs.cold+0x8/0xd Aug 22 19:15:38 juju-e4d256-prod-github-runner-207 kernel: [49912.585558] ? watchdog_timer_fn+0x1be/0x220 Aug 22 19:15:38 juju-e4d256-prod-github-runner-207 kernel: [49912.586641] ? lockup_detector_update_enable+0x60/0x60 Aug 22 19:15:38 juju-e4d256-prod-github-runner-207 kernel: [49912.587727] ? __hrtimer_run_queues+0x107/0x230 Aug 22 19:15:38 juju-e4d256-prod-github-runner-207 kernel: [49912.588792] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 19:15:38 juju-e4d256-prod-github-runner-207 kernel: [49912.589826] ? hrtimer_interrupt+0x101/0x220 Aug 22 19:15:38 juju-e4d256-prod-github-runner-207 kernel: [49912.591134] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 19:15:38 juju-e4d256-prod-github-runner-207 kernel: [49912.592729] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 19:15:38 juju-e4d256-prod-github-runner-207 kernel: [49912.594344] Aug 22 19:15:38 juju-e4d256-prod-github-runner-207 kernel: [49912.595618] Aug 22 19:15:38 juju-e4d256-prod-github-runner-207 kernel: [49912.596909] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 19:15:38 juju-e4d256-prod-github-runner-207 kernel: [49912.598549] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:15:38 juju-e4d256-prod-github-runner-207 kernel: [49912.600118] ? _raw_spin_lock+0x22/0x30 Aug 22 19:15:38 juju-e4d256-prod-github-runner-207 kernel: [49912.601124] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:15:38 juju-e4d256-prod-github-runner-207 kernel: [49912.602557] direct_page_fault+0x206/0x310 [kvm] Aug 22 19:15:38 juju-e4d256-prod-github-runner-207 kernel: [49912.604128] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 19:15:38 juju-e4d256-prod-github-runner-207 kernel: [49912.605641] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 19:15:38 juju-e4d256-prod-github-runner-207 kernel: [49912.606927] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 19:15:38 juju-e4d256-prod-github-runner-207 kernel: [49912.607947] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 19:15:38 juju-e4d256-prod-github-runner-207 kernel: [49912.608910] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 19:15:38 juju-e4d256-prod-github-runner-207 kernel: [49912.610007] handle_exit+0x98/0x230 [kvm_amd] Aug 22 19:15:38 juju-e4d256-prod-github-runner-207 kernel: [49912.610980] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 19:15:38 juju-e4d256-prod-github-runner-207 kernel: [49912.611913] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 19:15:38 juju-e4d256-prod-github-runner-207 kernel: [49912.612837] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 19:15:38 juju-e4d256-prod-github-runner-207 kernel: [49912.613742] vcpu_run+0x62/0x2c0 [kvm] Aug 22 19:15:38 juju-e4d256-prod-github-runner-207 kernel: [49912.614578] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 19:15:38 juju-e4d256-prod-github-runner-207 kernel: [49912.615389] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 19:15:38 juju-e4d256-prod-github-runner-207 kernel: [49912.616249] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 19:15:38 juju-e4d256-prod-github-runner-207 kernel: [49912.617051] ? __seccomp_filter+0x4a/0x4a0 Aug 22 19:15:38 juju-e4d256-prod-github-runner-207 kernel: [49912.617830] ? __fget_files+0x86/0xc0 Aug 22 19:15:38 juju-e4d256-prod-github-runner-207 kernel: [49912.618878] __x64_sys_ioctl+0x95/0xd0 Aug 22 19:15:38 juju-e4d256-prod-github-runner-207 kernel: [49912.619597] do_syscall_64+0x5c/0xc0 Aug 22 19:15:38 juju-e4d256-prod-github-runner-207 kernel: [49912.620443] ? do_futex+0x162/0x1f0 Aug 22 19:15:38 juju-e4d256-prod-github-runner-207 kernel: [49912.621093] ? __x64_sys_futex+0x78/0x1e0 Aug 22 19:15:38 juju-e4d256-prod-github-runner-207 kernel: [49912.621770] ? __secure_computing+0xa9/0x120 Aug 22 19:15:38 juju-e4d256-prod-github-runner-207 kernel: [49912.622463] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 19:15:38 juju-e4d256-prod-github-runner-207 kernel: [49912.623244] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:15:38 juju-e4d256-prod-github-runner-207 kernel: [49912.623973] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:15:38 juju-e4d256-prod-github-runner-207 kernel: [49912.624717] ? do_syscall_64+0x69/0xc0 Aug 22 19:15:38 juju-e4d256-prod-github-runner-207 kernel: [49912.625385] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:15:38 juju-e4d256-prod-github-runner-207 kernel: [49912.626100] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:15:38 juju-e4d256-prod-github-runner-207 kernel: [49912.626824] ? do_syscall_64+0x69/0xc0 Aug 22 19:15:38 juju-e4d256-prod-github-runner-207 kernel: [49912.627457] ? do_syscall_64+0x69/0xc0 Aug 22 19:15:38 juju-e4d256-prod-github-runner-207 kernel: [49912.628081] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 19:15:38 juju-e4d256-prod-github-runner-207 kernel: [49912.628791] RIP: 0033:0x7faa5d0edaff Aug 22 19:15:38 juju-e4d256-prod-github-runner-207 kernel: [49912.629417] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 19:15:38 juju-e4d256-prod-github-runner-207 kernel: [49912.631528] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 19:15:38 juju-e4d256-prod-github-runner-207 kernel: [49912.632447] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 19:15:38 juju-e4d256-prod-github-runner-207 kernel: [49912.633339] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 19:15:38 juju-e4d256-prod-github-runner-207 kernel: [49912.634233] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 19:15:38 juju-e4d256-prod-github-runner-207 kernel: [49912.635148] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 19:15:38 juju-e4d256-prod-github-runner-207 kernel: [49912.636037] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 19:15:38 juju-e4d256-prod-github-runner-207 kernel: [49912.636957] Aug 22 19:16:06 juju-e4d256-prod-github-runner-207 kernel: [49940.541981] watchdog: BUG: soft lockup - CPU#1 stuck for 46402s! [qemu-system-x86:6715] Aug 22 19:16:06 juju-e4d256-prod-github-runner-207 kernel: [49940.543711] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 19:16:06 juju-e4d256-prod-github-runner-207 kernel: [49940.543947] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 19:16:06 juju-e4d256-prod-github-runner-207 kernel: [49940.556732] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 19:16:06 juju-e4d256-prod-github-runner-207 kernel: [49940.558133] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 19:16:06 juju-e4d256-prod-github-runner-207 kernel: [49940.559483] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:16:06 juju-e4d256-prod-github-runner-207 kernel: [49940.560642] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 19:16:06 juju-e4d256-prod-github-runner-207 kernel: [49940.563437] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 19:16:06 juju-e4d256-prod-github-runner-207 kernel: [49940.564570] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 19:16:06 juju-e4d256-prod-github-runner-207 kernel: [49940.565840] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 19:16:06 juju-e4d256-prod-github-runner-207 kernel: [49940.567076] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 19:16:06 juju-e4d256-prod-github-runner-207 kernel: [49940.568337] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 19:16:06 juju-e4d256-prod-github-runner-207 kernel: [49940.569519] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 19:16:06 juju-e4d256-prod-github-runner-207 kernel: [49940.570777] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 19:16:06 juju-e4d256-prod-github-runner-207 kernel: [49940.572024] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 19:16:06 juju-e4d256-prod-github-runner-207 kernel: [49940.573138] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 19:16:06 juju-e4d256-prod-github-runner-207 kernel: [49940.574379] Call Trace: Aug 22 19:16:06 juju-e4d256-prod-github-runner-207 kernel: [49940.575299] Aug 22 19:16:06 juju-e4d256-prod-github-runner-207 kernel: [49940.576298] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:16:06 juju-e4d256-prod-github-runner-207 kernel: [49940.577459] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:16:06 juju-e4d256-prod-github-runner-207 kernel: [49940.578605] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:16:06 juju-e4d256-prod-github-runner-207 kernel: [49940.579711] ? show_regs.part.0+0x23/0x29 Aug 22 19:16:06 juju-e4d256-prod-github-runner-207 kernel: [49940.580709] ? show_regs.cold+0x8/0xd Aug 22 19:16:06 juju-e4d256-prod-github-runner-207 kernel: [49940.581685] ? watchdog_timer_fn+0x1be/0x220 Aug 22 19:16:06 juju-e4d256-prod-github-runner-207 kernel: [49940.582760] ? lockup_detector_update_enable+0x60/0x60 Aug 22 19:16:06 juju-e4d256-prod-github-runner-207 kernel: [49940.583951] ? __hrtimer_run_queues+0x107/0x230 Aug 22 19:16:06 juju-e4d256-prod-github-runner-207 kernel: [49940.585073] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 19:16:06 juju-e4d256-prod-github-runner-207 kernel: [49940.586212] ? hrtimer_interrupt+0x101/0x220 Aug 22 19:16:06 juju-e4d256-prod-github-runner-207 kernel: [49940.587328] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 19:16:06 juju-e4d256-prod-github-runner-207 kernel: [49940.588544] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 19:16:06 juju-e4d256-prod-github-runner-207 kernel: [49940.589712] Aug 22 19:16:06 juju-e4d256-prod-github-runner-207 kernel: [49940.590658] Aug 22 19:16:06 juju-e4d256-prod-github-runner-207 kernel: [49940.591550] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 19:16:06 juju-e4d256-prod-github-runner-207 kernel: [49940.592720] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:16:06 juju-e4d256-prod-github-runner-207 kernel: [49940.593888] ? _raw_spin_lock+0x22/0x30 Aug 22 19:16:06 juju-e4d256-prod-github-runner-207 kernel: [49940.594924] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:16:06 juju-e4d256-prod-github-runner-207 kernel: [49940.596045] direct_page_fault+0x206/0x310 [kvm] Aug 22 19:16:06 juju-e4d256-prod-github-runner-207 kernel: [49940.597163] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 19:16:06 juju-e4d256-prod-github-runner-207 kernel: [49940.598323] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 19:16:06 juju-e4d256-prod-github-runner-207 kernel: [49940.599441] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 19:16:06 juju-e4d256-prod-github-runner-207 kernel: [49940.600572] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 19:16:06 juju-e4d256-prod-github-runner-207 kernel: [49940.601638] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 19:16:06 juju-e4d256-prod-github-runner-207 kernel: [49940.602762] handle_exit+0x98/0x230 [kvm_amd] Aug 22 19:16:06 juju-e4d256-prod-github-runner-207 kernel: [49940.603772] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 19:16:06 juju-e4d256-prod-github-runner-207 kernel: [49940.604985] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 19:16:06 juju-e4d256-prod-github-runner-207 kernel: [49940.606205] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 19:16:06 juju-e4d256-prod-github-runner-207 kernel: [49940.607222] vcpu_run+0x62/0x2c0 [kvm] Aug 22 19:16:06 juju-e4d256-prod-github-runner-207 kernel: [49940.608114] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 19:16:06 juju-e4d256-prod-github-runner-207 kernel: [49940.609021] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 19:16:06 juju-e4d256-prod-github-runner-207 kernel: [49940.609981] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 19:16:06 juju-e4d256-prod-github-runner-207 kernel: [49940.610885] ? __seccomp_filter+0x4a/0x4a0 Aug 22 19:16:06 juju-e4d256-prod-github-runner-207 kernel: [49940.611714] ? __fget_files+0x86/0xc0 Aug 22 19:16:06 juju-e4d256-prod-github-runner-207 kernel: [49940.612493] __x64_sys_ioctl+0x95/0xd0 Aug 22 19:16:06 juju-e4d256-prod-github-runner-207 kernel: [49940.613266] do_syscall_64+0x5c/0xc0 Aug 22 19:16:06 juju-e4d256-prod-github-runner-207 kernel: [49940.614005] ? do_futex+0x162/0x1f0 Aug 22 19:16:06 juju-e4d256-prod-github-runner-207 kernel: [49940.614753] ? __x64_sys_futex+0x78/0x1e0 Aug 22 19:16:06 juju-e4d256-prod-github-runner-207 kernel: [49940.615505] ? __secure_computing+0xa9/0x120 Aug 22 19:16:06 juju-e4d256-prod-github-runner-207 kernel: [49940.616291] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 19:16:06 juju-e4d256-prod-github-runner-207 kernel: [49940.617162] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:16:06 juju-e4d256-prod-github-runner-207 kernel: [49940.617980] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:16:06 juju-e4d256-prod-github-runner-207 kernel: [49940.618850] ? do_syscall_64+0x69/0xc0 Aug 22 19:16:06 juju-e4d256-prod-github-runner-207 kernel: [49940.619573] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:16:06 juju-e4d256-prod-github-runner-207 kernel: [49940.620308] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:16:06 juju-e4d256-prod-github-runner-207 kernel: [49940.621035] ? do_syscall_64+0x69/0xc0 Aug 22 19:16:06 juju-e4d256-prod-github-runner-207 kernel: [49940.621673] ? do_syscall_64+0x69/0xc0 Aug 22 19:16:06 juju-e4d256-prod-github-runner-207 kernel: [49940.622508] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 19:16:06 juju-e4d256-prod-github-runner-207 kernel: [49940.623420] RIP: 0033:0x7faa5d0edaff Aug 22 19:16:06 juju-e4d256-prod-github-runner-207 kernel: [49940.624393] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 19:16:06 juju-e4d256-prod-github-runner-207 kernel: [49940.627336] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 19:16:06 juju-e4d256-prod-github-runner-207 kernel: [49940.628472] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 19:16:06 juju-e4d256-prod-github-runner-207 kernel: [49940.629646] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 19:16:06 juju-e4d256-prod-github-runner-207 kernel: [49940.631165] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 19:16:06 juju-e4d256-prod-github-runner-207 kernel: [49940.632198] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 19:16:06 juju-e4d256-prod-github-runner-207 kernel: [49940.633280] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 19:16:06 juju-e4d256-prod-github-runner-207 kernel: [49940.634531] Aug 22 19:16:34 juju-e4d256-prod-github-runner-207 kernel: [49968.541980] watchdog: BUG: soft lockup - CPU#1 stuck for 46428s! [qemu-system-x86:6715] Aug 22 19:16:34 juju-e4d256-prod-github-runner-207 kernel: [49968.543087] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 19:16:34 juju-e4d256-prod-github-runner-207 kernel: [49968.543356] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 19:16:34 juju-e4d256-prod-github-runner-207 kernel: [49968.556139] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 19:16:34 juju-e4d256-prod-github-runner-207 kernel: [49968.557916] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 19:16:34 juju-e4d256-prod-github-runner-207 kernel: [49968.559267] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:16:34 juju-e4d256-prod-github-runner-207 kernel: [49968.560367] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 19:16:34 juju-e4d256-prod-github-runner-207 kernel: [49968.563067] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 19:16:34 juju-e4d256-prod-github-runner-207 kernel: [49968.564133] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 19:16:34 juju-e4d256-prod-github-runner-207 kernel: [49968.565299] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 19:16:34 juju-e4d256-prod-github-runner-207 kernel: [49968.566593] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 19:16:34 juju-e4d256-prod-github-runner-207 kernel: [49968.567928] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 19:16:34 juju-e4d256-prod-github-runner-207 kernel: [49968.569160] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 19:16:34 juju-e4d256-prod-github-runner-207 kernel: [49968.570375] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 19:16:34 juju-e4d256-prod-github-runner-207 kernel: [49968.571629] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 19:16:34 juju-e4d256-prod-github-runner-207 kernel: [49968.573016] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 19:16:34 juju-e4d256-prod-github-runner-207 kernel: [49968.574787] Call Trace: Aug 22 19:16:34 juju-e4d256-prod-github-runner-207 kernel: [49968.576022] Aug 22 19:16:34 juju-e4d256-prod-github-runner-207 kernel: [49968.576955] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:16:34 juju-e4d256-prod-github-runner-207 kernel: [49968.578082] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:16:34 juju-e4d256-prod-github-runner-207 kernel: [49968.579136] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:16:34 juju-e4d256-prod-github-runner-207 kernel: [49968.580224] ? show_regs.part.0+0x23/0x29 Aug 22 19:16:34 juju-e4d256-prod-github-runner-207 kernel: [49968.581234] ? show_regs.cold+0x8/0xd Aug 22 19:16:34 juju-e4d256-prod-github-runner-207 kernel: [49968.582272] ? watchdog_timer_fn+0x1be/0x220 Aug 22 19:16:34 juju-e4d256-prod-github-runner-207 kernel: [49968.583351] ? lockup_detector_update_enable+0x60/0x60 Aug 22 19:16:34 juju-e4d256-prod-github-runner-207 kernel: [49968.584433] ? __hrtimer_run_queues+0x107/0x230 Aug 22 19:16:34 juju-e4d256-prod-github-runner-207 kernel: [49968.585479] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 19:16:34 juju-e4d256-prod-github-runner-207 kernel: [49968.586572] ? hrtimer_interrupt+0x101/0x220 Aug 22 19:16:34 juju-e4d256-prod-github-runner-207 kernel: [49968.587651] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 19:16:34 juju-e4d256-prod-github-runner-207 kernel: [49968.588763] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 19:16:34 juju-e4d256-prod-github-runner-207 kernel: [49968.589870] Aug 22 19:16:34 juju-e4d256-prod-github-runner-207 kernel: [49968.590749] Aug 22 19:16:34 juju-e4d256-prod-github-runner-207 kernel: [49968.591627] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 19:16:34 juju-e4d256-prod-github-runner-207 kernel: [49968.592731] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:16:34 juju-e4d256-prod-github-runner-207 kernel: [49968.593922] ? _raw_spin_lock+0x22/0x30 Aug 22 19:16:34 juju-e4d256-prod-github-runner-207 kernel: [49968.594910] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:16:34 juju-e4d256-prod-github-runner-207 kernel: [49968.595982] direct_page_fault+0x206/0x310 [kvm] Aug 22 19:16:34 juju-e4d256-prod-github-runner-207 kernel: [49968.597045] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 19:16:34 juju-e4d256-prod-github-runner-207 kernel: [49968.598186] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 19:16:34 juju-e4d256-prod-github-runner-207 kernel: [49968.599251] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 19:16:34 juju-e4d256-prod-github-runner-207 kernel: [49968.600295] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 19:16:34 juju-e4d256-prod-github-runner-207 kernel: [49968.601307] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 19:16:34 juju-e4d256-prod-github-runner-207 kernel: [49968.602438] handle_exit+0x98/0x230 [kvm_amd] Aug 22 19:16:34 juju-e4d256-prod-github-runner-207 kernel: [49968.603420] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 19:16:34 juju-e4d256-prod-github-runner-207 kernel: [49968.604371] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 19:16:34 juju-e4d256-prod-github-runner-207 kernel: [49968.605338] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 19:16:34 juju-e4d256-prod-github-runner-207 kernel: [49968.606332] vcpu_run+0x62/0x2c0 [kvm] Aug 22 19:16:34 juju-e4d256-prod-github-runner-207 kernel: [49968.607222] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 19:16:34 juju-e4d256-prod-github-runner-207 kernel: [49968.608117] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 19:16:34 juju-e4d256-prod-github-runner-207 kernel: [49968.608991] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 19:16:34 juju-e4d256-prod-github-runner-207 kernel: [49968.609851] ? __seccomp_filter+0x4a/0x4a0 Aug 22 19:16:34 juju-e4d256-prod-github-runner-207 kernel: [49968.610692] ? __fget_files+0x86/0xc0 Aug 22 19:16:34 juju-e4d256-prod-github-runner-207 kernel: [49968.611439] __x64_sys_ioctl+0x95/0xd0 Aug 22 19:16:34 juju-e4d256-prod-github-runner-207 kernel: [49968.612158] do_syscall_64+0x5c/0xc0 Aug 22 19:16:34 juju-e4d256-prod-github-runner-207 kernel: [49968.612837] ? do_futex+0x162/0x1f0 Aug 22 19:16:34 juju-e4d256-prod-github-runner-207 kernel: [49968.613543] ? __x64_sys_futex+0x78/0x1e0 Aug 22 19:16:34 juju-e4d256-prod-github-runner-207 kernel: [49968.614336] ? __secure_computing+0xa9/0x120 Aug 22 19:16:34 juju-e4d256-prod-github-runner-207 kernel: [49968.615054] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 19:16:34 juju-e4d256-prod-github-runner-207 kernel: [49968.615826] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:16:34 juju-e4d256-prod-github-runner-207 kernel: [49968.616558] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:16:34 juju-e4d256-prod-github-runner-207 kernel: [49968.617294] ? do_syscall_64+0x69/0xc0 Aug 22 19:16:34 juju-e4d256-prod-github-runner-207 kernel: [49968.618025] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:16:34 juju-e4d256-prod-github-runner-207 kernel: [49968.618778] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:16:34 juju-e4d256-prod-github-runner-207 kernel: [49968.619518] ? do_syscall_64+0x69/0xc0 Aug 22 19:16:34 juju-e4d256-prod-github-runner-207 kernel: [49968.620170] ? do_syscall_64+0x69/0xc0 Aug 22 19:16:34 juju-e4d256-prod-github-runner-207 kernel: [49968.620820] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 19:16:34 juju-e4d256-prod-github-runner-207 kernel: [49968.621582] RIP: 0033:0x7faa5d0edaff Aug 22 19:16:34 juju-e4d256-prod-github-runner-207 kernel: [49968.622404] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 19:16:34 juju-e4d256-prod-github-runner-207 kernel: [49968.624788] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 19:16:34 juju-e4d256-prod-github-runner-207 kernel: [49968.625885] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 19:16:34 juju-e4d256-prod-github-runner-207 kernel: [49968.626929] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 19:16:34 juju-e4d256-prod-github-runner-207 kernel: [49968.627983] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 19:16:34 juju-e4d256-prod-github-runner-207 kernel: [49968.629082] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 19:16:34 juju-e4d256-prod-github-runner-207 kernel: [49968.630147] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 19:16:34 juju-e4d256-prod-github-runner-207 kernel: [49968.631202] Aug 22 19:17:02 juju-e4d256-prod-github-runner-207 kernel: [49996.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 46454s! [qemu-system-x86:6715] Aug 22 19:17:02 juju-e4d256-prod-github-runner-207 kernel: [49996.543083] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 19:17:02 juju-e4d256-prod-github-runner-207 kernel: [49996.543148] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 19:17:02 juju-e4d256-prod-github-runner-207 kernel: [49996.555220] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 19:17:02 juju-e4d256-prod-github-runner-207 kernel: [49996.556484] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 19:17:02 juju-e4d256-prod-github-runner-207 kernel: [49996.557716] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:17:02 juju-e4d256-prod-github-runner-207 kernel: [49996.558772] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 19:17:02 juju-e4d256-prod-github-runner-207 kernel: [49996.561316] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 19:17:02 juju-e4d256-prod-github-runner-207 kernel: [49996.562372] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 19:17:02 juju-e4d256-prod-github-runner-207 kernel: [49996.563532] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 19:17:02 juju-e4d256-prod-github-runner-207 kernel: [49996.564699] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 19:17:02 juju-e4d256-prod-github-runner-207 kernel: [49996.565877] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 19:17:02 juju-e4d256-prod-github-runner-207 kernel: [49996.567042] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 19:17:02 juju-e4d256-prod-github-runner-207 kernel: [49996.568212] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 19:17:02 juju-e4d256-prod-github-runner-207 kernel: [49996.569449] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 19:17:02 juju-e4d256-prod-github-runner-207 kernel: [49996.570568] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 19:17:02 juju-e4d256-prod-github-runner-207 kernel: [49996.571776] Call Trace: Aug 22 19:17:02 juju-e4d256-prod-github-runner-207 kernel: [49996.572691] Aug 22 19:17:02 juju-e4d256-prod-github-runner-207 kernel: [49996.573595] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:17:02 juju-e4d256-prod-github-runner-207 kernel: [49996.574630] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:17:02 juju-e4d256-prod-github-runner-207 kernel: [49996.575651] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:17:02 juju-e4d256-prod-github-runner-207 kernel: [49996.576725] ? show_regs.part.0+0x23/0x29 Aug 22 19:17:02 juju-e4d256-prod-github-runner-207 kernel: [49996.577745] ? show_regs.cold+0x8/0xd Aug 22 19:17:02 juju-e4d256-prod-github-runner-207 kernel: [49996.578716] ? watchdog_timer_fn+0x1be/0x220 Aug 22 19:17:02 juju-e4d256-prod-github-runner-207 kernel: [49996.579726] ? lockup_detector_update_enable+0x60/0x60 Aug 22 19:17:02 juju-e4d256-prod-github-runner-207 kernel: [49996.580786] ? __hrtimer_run_queues+0x107/0x230 Aug 22 19:17:02 juju-e4d256-prod-github-runner-207 kernel: [49996.581826] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 19:17:02 juju-e4d256-prod-github-runner-207 kernel: [49996.582850] ? hrtimer_interrupt+0x101/0x220 Aug 22 19:17:02 juju-e4d256-prod-github-runner-207 kernel: [49996.583868] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 19:17:02 juju-e4d256-prod-github-runner-207 kernel: [49996.584935] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 19:17:02 juju-e4d256-prod-github-runner-207 kernel: [49996.585987] Aug 22 19:17:02 juju-e4d256-prod-github-runner-207 kernel: [49996.586841] Aug 22 19:17:02 juju-e4d256-prod-github-runner-207 kernel: [49996.587678] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 19:17:02 juju-e4d256-prod-github-runner-207 kernel: [49996.588708] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:17:02 juju-e4d256-prod-github-runner-207 kernel: [49996.589755] ? _raw_spin_lock+0x22/0x30 Aug 22 19:17:02 juju-e4d256-prod-github-runner-207 kernel: [49996.590700] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:17:02 juju-e4d256-prod-github-runner-207 kernel: [49996.591722] direct_page_fault+0x206/0x310 [kvm] Aug 22 19:17:02 juju-e4d256-prod-github-runner-207 kernel: [49996.592744] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 19:17:02 juju-e4d256-prod-github-runner-207 kernel: [49996.593772] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 19:17:02 juju-e4d256-prod-github-runner-207 kernel: [49996.594772] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 19:17:02 juju-e4d256-prod-github-runner-207 kernel: [49996.595741] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 19:17:02 juju-e4d256-prod-github-runner-207 kernel: [49996.596684] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 19:17:02 juju-e4d256-prod-github-runner-207 kernel: [49996.597824] handle_exit+0x98/0x230 [kvm_amd] Aug 22 19:17:02 juju-e4d256-prod-github-runner-207 kernel: [49996.598810] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 19:17:02 juju-e4d256-prod-github-runner-207 kernel: [49996.599816] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 19:17:02 juju-e4d256-prod-github-runner-207 kernel: [49996.600834] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 19:17:02 juju-e4d256-prod-github-runner-207 kernel: [49996.601849] vcpu_run+0x62/0x2c0 [kvm] Aug 22 19:17:02 juju-e4d256-prod-github-runner-207 kernel: [49996.602735] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 19:17:02 juju-e4d256-prod-github-runner-207 kernel: [49996.603630] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 19:17:02 juju-e4d256-prod-github-runner-207 kernel: [49996.604585] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 19:17:02 juju-e4d256-prod-github-runner-207 kernel: [49996.605502] ? __seccomp_filter+0x4a/0x4a0 Aug 22 19:17:02 juju-e4d256-prod-github-runner-207 kernel: [49996.606348] ? __fget_files+0x86/0xc0 Aug 22 19:17:02 juju-e4d256-prod-github-runner-207 kernel: [49996.607127] __x64_sys_ioctl+0x95/0xd0 Aug 22 19:17:02 juju-e4d256-prod-github-runner-207 kernel: [49996.607894] do_syscall_64+0x5c/0xc0 Aug 22 19:17:02 juju-e4d256-prod-github-runner-207 kernel: [49996.608637] ? do_futex+0x162/0x1f0 Aug 22 19:17:02 juju-e4d256-prod-github-runner-207 kernel: [49996.609361] ? __x64_sys_futex+0x78/0x1e0 Aug 22 19:17:02 juju-e4d256-prod-github-runner-207 kernel: [49996.610143] ? __secure_computing+0xa9/0x120 Aug 22 19:17:02 juju-e4d256-prod-github-runner-207 kernel: [49996.610920] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 19:17:02 juju-e4d256-prod-github-runner-207 kernel: [49996.611786] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:17:02 juju-e4d256-prod-github-runner-207 kernel: [49996.612602] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:17:02 juju-e4d256-prod-github-runner-207 kernel: [49996.613417] ? do_syscall_64+0x69/0xc0 Aug 22 19:17:02 juju-e4d256-prod-github-runner-207 kernel: [49996.614158] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:17:02 juju-e4d256-prod-github-runner-207 kernel: [49996.614960] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:17:02 juju-e4d256-prod-github-runner-207 kernel: [49996.615760] ? do_syscall_64+0x69/0xc0 Aug 22 19:17:02 juju-e4d256-prod-github-runner-207 kernel: [49996.616466] ? do_syscall_64+0x69/0xc0 Aug 22 19:17:02 juju-e4d256-prod-github-runner-207 kernel: [49996.617176] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 19:17:02 juju-e4d256-prod-github-runner-207 kernel: [49996.618001] RIP: 0033:0x7faa5d0edaff Aug 22 19:17:02 juju-e4d256-prod-github-runner-207 kernel: [49996.618698] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 19:17:02 juju-e4d256-prod-github-runner-207 kernel: [49996.621221] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 19:17:02 juju-e4d256-prod-github-runner-207 kernel: [49996.622282] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 19:17:02 juju-e4d256-prod-github-runner-207 kernel: [49996.623303] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 19:17:02 juju-e4d256-prod-github-runner-207 kernel: [49996.624327] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 19:17:02 juju-e4d256-prod-github-runner-207 kernel: [49996.625347] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 19:17:02 juju-e4d256-prod-github-runner-207 kernel: [49996.626388] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 19:17:02 juju-e4d256-prod-github-runner-207 kernel: [49996.627423] Aug 22 19:17:30 juju-e4d256-prod-github-runner-207 kernel: [50024.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 46480s! [qemu-system-x86:6715] Aug 22 19:17:30 juju-e4d256-prod-github-runner-207 kernel: [50024.543109] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 19:17:30 juju-e4d256-prod-github-runner-207 kernel: [50024.543176] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 19:17:30 juju-e4d256-prod-github-runner-207 kernel: [50024.555201] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 19:17:30 juju-e4d256-prod-github-runner-207 kernel: [50024.556463] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 19:17:30 juju-e4d256-prod-github-runner-207 kernel: [50024.557694] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:17:30 juju-e4d256-prod-github-runner-207 kernel: [50024.558750] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 19:17:30 juju-e4d256-prod-github-runner-207 kernel: [50024.561322] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 19:17:30 juju-e4d256-prod-github-runner-207 kernel: [50024.562362] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 19:17:30 juju-e4d256-prod-github-runner-207 kernel: [50024.563535] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 19:17:30 juju-e4d256-prod-github-runner-207 kernel: [50024.564692] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 19:17:30 juju-e4d256-prod-github-runner-207 kernel: [50024.565879] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 19:17:30 juju-e4d256-prod-github-runner-207 kernel: [50024.567039] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 19:17:30 juju-e4d256-prod-github-runner-207 kernel: [50024.568202] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 19:17:30 juju-e4d256-prod-github-runner-207 kernel: [50024.569443] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 19:17:30 juju-e4d256-prod-github-runner-207 kernel: [50024.570549] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 19:17:30 juju-e4d256-prod-github-runner-207 kernel: [50024.571751] Call Trace: Aug 22 19:17:30 juju-e4d256-prod-github-runner-207 kernel: [50024.572663] Aug 22 19:17:30 juju-e4d256-prod-github-runner-207 kernel: [50024.573564] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:17:30 juju-e4d256-prod-github-runner-207 kernel: [50024.574598] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:17:30 juju-e4d256-prod-github-runner-207 kernel: [50024.575617] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:17:30 juju-e4d256-prod-github-runner-207 kernel: [50024.576692] ? show_regs.part.0+0x23/0x29 Aug 22 19:17:30 juju-e4d256-prod-github-runner-207 kernel: [50024.577739] ? show_regs.cold+0x8/0xd Aug 22 19:17:30 juju-e4d256-prod-github-runner-207 kernel: [50024.578920] ? watchdog_timer_fn+0x1be/0x220 Aug 22 19:17:30 juju-e4d256-prod-github-runner-207 kernel: [50024.580505] ? lockup_detector_update_enable+0x60/0x60 Aug 22 19:17:30 juju-e4d256-prod-github-runner-207 kernel: [50024.582611] ? __hrtimer_run_queues+0x107/0x230 Aug 22 19:17:30 juju-e4d256-prod-github-runner-207 kernel: [50024.584270] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 19:17:30 juju-e4d256-prod-github-runner-207 kernel: [50024.585906] ? hrtimer_interrupt+0x101/0x220 Aug 22 19:17:30 juju-e4d256-prod-github-runner-207 kernel: [50024.587519] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 19:17:30 juju-e4d256-prod-github-runner-207 kernel: [50024.589222] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 19:17:30 juju-e4d256-prod-github-runner-207 kernel: [50024.590877] Aug 22 19:17:30 juju-e4d256-prod-github-runner-207 kernel: [50024.592229] Aug 22 19:17:30 juju-e4d256-prod-github-runner-207 kernel: [50024.593552] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 19:17:30 juju-e4d256-prod-github-runner-207 kernel: [50024.595165] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:17:30 juju-e4d256-prod-github-runner-207 kernel: [50024.596738] ? _raw_spin_lock+0x22/0x30 Aug 22 19:17:30 juju-e4d256-prod-github-runner-207 kernel: [50024.598184] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:17:30 juju-e4d256-prod-github-runner-207 kernel: [50024.599748] direct_page_fault+0x206/0x310 [kvm] Aug 22 19:17:30 juju-e4d256-prod-github-runner-207 kernel: [50024.601421] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 19:17:30 juju-e4d256-prod-github-runner-207 kernel: [50024.603206] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 19:17:30 juju-e4d256-prod-github-runner-207 kernel: [50024.604370] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 19:17:30 juju-e4d256-prod-github-runner-207 kernel: [50024.605368] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 19:17:30 juju-e4d256-prod-github-runner-207 kernel: [50024.606319] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 19:17:30 juju-e4d256-prod-github-runner-207 kernel: [50024.607306] handle_exit+0x98/0x230 [kvm_amd] Aug 22 19:17:30 juju-e4d256-prod-github-runner-207 kernel: [50024.608391] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 19:17:30 juju-e4d256-prod-github-runner-207 kernel: [50024.609334] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 19:17:30 juju-e4d256-prod-github-runner-207 kernel: [50024.610270] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 19:17:30 juju-e4d256-prod-github-runner-207 kernel: [50024.611176] vcpu_run+0x62/0x2c0 [kvm] Aug 22 19:17:30 juju-e4d256-prod-github-runner-207 kernel: [50024.611994] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 19:17:30 juju-e4d256-prod-github-runner-207 kernel: [50024.612802] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 19:17:30 juju-e4d256-prod-github-runner-207 kernel: [50024.613671] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 19:17:30 juju-e4d256-prod-github-runner-207 kernel: [50024.614470] ? __seccomp_filter+0x4a/0x4a0 Aug 22 19:17:30 juju-e4d256-prod-github-runner-207 kernel: [50024.615213] ? __fget_files+0x86/0xc0 Aug 22 19:17:30 juju-e4d256-prod-github-runner-207 kernel: [50024.615925] __x64_sys_ioctl+0x95/0xd0 Aug 22 19:17:30 juju-e4d256-prod-github-runner-207 kernel: [50024.616618] do_syscall_64+0x5c/0xc0 Aug 22 19:17:30 juju-e4d256-prod-github-runner-207 kernel: [50024.617305] ? do_futex+0x162/0x1f0 Aug 22 19:17:30 juju-e4d256-prod-github-runner-207 kernel: [50024.617963] ? __x64_sys_futex+0x78/0x1e0 Aug 22 19:17:30 juju-e4d256-prod-github-runner-207 kernel: [50024.618645] ? __secure_computing+0xa9/0x120 Aug 22 19:17:30 juju-e4d256-prod-github-runner-207 kernel: [50024.619338] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 19:17:30 juju-e4d256-prod-github-runner-207 kernel: [50024.620101] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:17:30 juju-e4d256-prod-github-runner-207 kernel: [50024.620825] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:17:30 juju-e4d256-prod-github-runner-207 kernel: [50024.621562] ? do_syscall_64+0x69/0xc0 Aug 22 19:17:30 juju-e4d256-prod-github-runner-207 kernel: [50024.622210] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:17:30 juju-e4d256-prod-github-runner-207 kernel: [50024.622922] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:17:30 juju-e4d256-prod-github-runner-207 kernel: [50024.623621] ? do_syscall_64+0x69/0xc0 Aug 22 19:17:30 juju-e4d256-prod-github-runner-207 kernel: [50024.624249] ? do_syscall_64+0x69/0xc0 Aug 22 19:17:30 juju-e4d256-prod-github-runner-207 kernel: [50024.624873] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 19:17:30 juju-e4d256-prod-github-runner-207 kernel: [50024.625591] RIP: 0033:0x7faa5d0edaff Aug 22 19:17:30 juju-e4d256-prod-github-runner-207 kernel: [50024.626217] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 19:17:30 juju-e4d256-prod-github-runner-207 kernel: [50024.628212] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 19:17:30 juju-e4d256-prod-github-runner-207 kernel: [50024.629152] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 19:17:30 juju-e4d256-prod-github-runner-207 kernel: [50024.630051] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 19:17:30 juju-e4d256-prod-github-runner-207 kernel: [50024.630945] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 19:17:30 juju-e4d256-prod-github-runner-207 kernel: [50024.631837] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 19:17:30 juju-e4d256-prod-github-runner-207 kernel: [50024.632730] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 19:17:30 juju-e4d256-prod-github-runner-207 kernel: [50024.633637] Aug 22 19:17:46 juju-e4d256-prod-github-runner-207 kernel: [50040.524710] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 19:17:46 juju-e4d256-prod-github-runner-207 kernel: [50040.526272] rcu: 1-....: (12441574 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=6015272 Aug 22 19:17:46 juju-e4d256-prod-github-runner-207 kernel: [50040.527404] (t=12480831 jiffies g=23269 q=47696) Aug 22 19:17:46 juju-e4d256-prod-github-runner-207 kernel: [50040.528193] NMI backtrace for cpu 1 Aug 22 19:17:46 juju-e4d256-prod-github-runner-207 kernel: [50040.528922] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 19:17:46 juju-e4d256-prod-github-runner-207 kernel: [50040.530055] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 19:17:46 juju-e4d256-prod-github-runner-207 kernel: [50040.531117] Call Trace: Aug 22 19:17:46 juju-e4d256-prod-github-runner-207 kernel: [50040.531792] Aug 22 19:17:46 juju-e4d256-prod-github-runner-207 kernel: [50040.532447] show_stack+0x52/0x5c Aug 22 19:17:46 juju-e4d256-prod-github-runner-207 kernel: [50040.533193] dump_stack_lvl+0x4a/0x63 Aug 22 19:17:46 juju-e4d256-prod-github-runner-207 kernel: [50040.533939] dump_stack+0x10/0x16 Aug 22 19:17:46 juju-e4d256-prod-github-runner-207 kernel: [50040.534657] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 19:17:46 juju-e4d256-prod-github-runner-207 kernel: [50040.535436] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 19:17:46 juju-e4d256-prod-github-runner-207 kernel: [50040.536213] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 19:17:46 juju-e4d256-prod-github-runner-207 kernel: [50040.537052] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 19:17:46 juju-e4d256-prod-github-runner-207 kernel: [50040.537873] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 19:17:46 juju-e4d256-prod-github-runner-207 kernel: [50040.538756] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 19:17:46 juju-e4d256-prod-github-runner-207 kernel: [50040.539555] print_cpu_stall.cold+0x2f/0xe2 Aug 22 19:17:46 juju-e4d256-prod-github-runner-207 kernel: [50040.540331] ? timekeeping_update+0xf7/0x150 Aug 22 19:17:46 juju-e4d256-prod-github-runner-207 kernel: [50040.541130] check_cpu_stall+0x109/0x270 Aug 22 19:17:46 juju-e4d256-prod-github-runner-207 kernel: [50040.541883] rcu_sched_clock_irq+0x9a/0x250 Aug 22 19:17:46 juju-e4d256-prod-github-runner-207 kernel: [50040.542663] update_process_times+0x94/0xd0 Aug 22 19:17:46 juju-e4d256-prod-github-runner-207 kernel: [50040.543438] tick_sched_handle+0x29/0x70 Aug 22 19:17:46 juju-e4d256-prod-github-runner-207 kernel: [50040.544217] tick_sched_timer+0x8c/0xc0 Aug 22 19:17:46 juju-e4d256-prod-github-runner-207 kernel: [50040.545008] ? tick_nohz_handler+0xb0/0xb0 Aug 22 19:17:46 juju-e4d256-prod-github-runner-207 kernel: [50040.545772] __hrtimer_run_queues+0x107/0x230 Aug 22 19:17:46 juju-e4d256-prod-github-runner-207 kernel: [50040.546577] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 19:17:46 juju-e4d256-prod-github-runner-207 kernel: [50040.547361] hrtimer_interrupt+0x101/0x220 Aug 22 19:17:46 juju-e4d256-prod-github-runner-207 kernel: [50040.548123] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 19:17:46 juju-e4d256-prod-github-runner-207 kernel: [50040.548964] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 19:17:46 juju-e4d256-prod-github-runner-207 kernel: [50040.549771] Aug 22 19:17:46 juju-e4d256-prod-github-runner-207 kernel: [50040.550408] Aug 22 19:17:46 juju-e4d256-prod-github-runner-207 kernel: [50040.551091] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 19:17:46 juju-e4d256-prod-github-runner-207 kernel: [50040.551969] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:17:46 juju-e4d256-prod-github-runner-207 kernel: [50040.552856] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 19:17:46 juju-e4d256-prod-github-runner-207 kernel: [50040.555148] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 19:17:46 juju-e4d256-prod-github-runner-207 kernel: [50040.556046] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 19:17:46 juju-e4d256-prod-github-runner-207 kernel: [50040.557081] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 19:17:46 juju-e4d256-prod-github-runner-207 kernel: [50040.558071] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 19:17:46 juju-e4d256-prod-github-runner-207 kernel: [50040.559045] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 19:17:46 juju-e4d256-prod-github-runner-207 kernel: [50040.560009] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 19:17:46 juju-e4d256-prod-github-runner-207 kernel: [50040.561014] ? _raw_spin_lock+0x22/0x30 Aug 22 19:17:46 juju-e4d256-prod-github-runner-207 kernel: [50040.561851] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:17:46 juju-e4d256-prod-github-runner-207 kernel: [50040.562711] direct_page_fault+0x206/0x310 [kvm] Aug 22 19:17:46 juju-e4d256-prod-github-runner-207 kernel: [50040.563551] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 19:17:46 juju-e4d256-prod-github-runner-207 kernel: [50040.564381] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 19:17:46 juju-e4d256-prod-github-runner-207 kernel: [50040.565242] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 19:17:46 juju-e4d256-prod-github-runner-207 kernel: [50040.566079] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 19:17:46 juju-e4d256-prod-github-runner-207 kernel: [50040.566864] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 19:17:46 juju-e4d256-prod-github-runner-207 kernel: [50040.567684] handle_exit+0x98/0x230 [kvm_amd] Aug 22 19:17:46 juju-e4d256-prod-github-runner-207 kernel: [50040.568444] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 19:17:46 juju-e4d256-prod-github-runner-207 kernel: [50040.569252] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 19:17:46 juju-e4d256-prod-github-runner-207 kernel: [50040.570117] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 19:17:46 juju-e4d256-prod-github-runner-207 kernel: [50040.570958] vcpu_run+0x62/0x2c0 [kvm] Aug 22 19:17:46 juju-e4d256-prod-github-runner-207 kernel: [50040.572587] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 19:17:46 juju-e4d256-prod-github-runner-207 kernel: [50040.573345] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 19:17:46 juju-e4d256-prod-github-runner-207 kernel: [50040.574146] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 19:17:46 juju-e4d256-prod-github-runner-207 kernel: [50040.574904] ? __seccomp_filter+0x4a/0x4a0 Aug 22 19:17:46 juju-e4d256-prod-github-runner-207 kernel: [50040.575620] ? __fget_files+0x86/0xc0 Aug 22 19:17:46 juju-e4d256-prod-github-runner-207 kernel: [50040.576324] __x64_sys_ioctl+0x95/0xd0 Aug 22 19:17:46 juju-e4d256-prod-github-runner-207 kernel: [50040.577132] do_syscall_64+0x5c/0xc0 Aug 22 19:17:46 juju-e4d256-prod-github-runner-207 kernel: [50040.577825] ? do_futex+0x162/0x1f0 Aug 22 19:17:46 juju-e4d256-prod-github-runner-207 kernel: [50040.578497] ? __x64_sys_futex+0x78/0x1e0 Aug 22 19:17:46 juju-e4d256-prod-github-runner-207 kernel: [50040.579198] ? __secure_computing+0xa9/0x120 Aug 22 19:17:46 juju-e4d256-prod-github-runner-207 kernel: [50040.579911] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 19:17:46 juju-e4d256-prod-github-runner-207 kernel: [50040.580696] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:17:46 juju-e4d256-prod-github-runner-207 kernel: [50040.581475] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:17:46 juju-e4d256-prod-github-runner-207 kernel: [50040.582262] ? do_syscall_64+0x69/0xc0 Aug 22 19:17:46 juju-e4d256-prod-github-runner-207 kernel: [50040.582973] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:17:46 juju-e4d256-prod-github-runner-207 kernel: [50040.583745] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:17:46 juju-e4d256-prod-github-runner-207 kernel: [50040.584501] ? do_syscall_64+0x69/0xc0 Aug 22 19:17:46 juju-e4d256-prod-github-runner-207 kernel: [50040.585221] ? do_syscall_64+0x69/0xc0 Aug 22 19:17:46 juju-e4d256-prod-github-runner-207 kernel: [50040.585907] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 19:17:46 juju-e4d256-prod-github-runner-207 kernel: [50040.586689] RIP: 0033:0x7faa5d0edaff Aug 22 19:17:46 juju-e4d256-prod-github-runner-207 kernel: [50040.587561] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 19:17:46 juju-e4d256-prod-github-runner-207 kernel: [50040.589727] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 19:17:46 juju-e4d256-prod-github-runner-207 kernel: [50040.590709] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 19:17:46 juju-e4d256-prod-github-runner-207 kernel: [50040.591660] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 19:17:46 juju-e4d256-prod-github-runner-207 kernel: [50040.592803] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 19:17:46 juju-e4d256-prod-github-runner-207 kernel: [50040.593783] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 19:17:46 juju-e4d256-prod-github-runner-207 kernel: [50040.594722] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 19:17:46 juju-e4d256-prod-github-runner-207 kernel: [50040.595638] Aug 22 19:18:10 juju-e4d256-prod-github-runner-207 kernel: [50064.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 46518s! [qemu-system-x86:6715] Aug 22 19:18:10 juju-e4d256-prod-github-runner-207 kernel: [50064.543082] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 19:18:10 juju-e4d256-prod-github-runner-207 kernel: [50064.543366] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 19:18:10 juju-e4d256-prod-github-runner-207 kernel: [50064.555597] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 19:18:10 juju-e4d256-prod-github-runner-207 kernel: [50064.557079] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 19:18:10 juju-e4d256-prod-github-runner-207 kernel: [50064.558454] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:18:10 juju-e4d256-prod-github-runner-207 kernel: [50064.559621] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 19:18:10 juju-e4d256-prod-github-runner-207 kernel: [50064.562594] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 19:18:10 juju-e4d256-prod-github-runner-207 kernel: [50064.563743] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 19:18:10 juju-e4d256-prod-github-runner-207 kernel: [50064.565060] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 19:18:10 juju-e4d256-prod-github-runner-207 kernel: [50064.566350] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 19:18:10 juju-e4d256-prod-github-runner-207 kernel: [50064.567641] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 19:18:10 juju-e4d256-prod-github-runner-207 kernel: [50064.568937] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 19:18:10 juju-e4d256-prod-github-runner-207 kernel: [50064.570232] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 19:18:10 juju-e4d256-prod-github-runner-207 kernel: [50064.571610] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 19:18:10 juju-e4d256-prod-github-runner-207 kernel: [50064.572823] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 19:18:10 juju-e4d256-prod-github-runner-207 kernel: [50064.574145] Call Trace: Aug 22 19:18:10 juju-e4d256-prod-github-runner-207 kernel: [50064.575111] Aug 22 19:18:10 juju-e4d256-prod-github-runner-207 kernel: [50064.576044] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:18:10 juju-e4d256-prod-github-runner-207 kernel: [50064.577192] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:18:10 juju-e4d256-prod-github-runner-207 kernel: [50064.578334] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:18:10 juju-e4d256-prod-github-runner-207 kernel: [50064.579508] ? show_regs.part.0+0x23/0x29 Aug 22 19:18:10 juju-e4d256-prod-github-runner-207 kernel: [50064.580589] ? show_regs.cold+0x8/0xd Aug 22 19:18:10 juju-e4d256-prod-github-runner-207 kernel: [50064.581664] ? watchdog_timer_fn+0x1be/0x220 Aug 22 19:18:10 juju-e4d256-prod-github-runner-207 kernel: [50064.582759] ? lockup_detector_update_enable+0x60/0x60 Aug 22 19:18:10 juju-e4d256-prod-github-runner-207 kernel: [50064.583936] ? __hrtimer_run_queues+0x107/0x230 Aug 22 19:18:10 juju-e4d256-prod-github-runner-207 kernel: [50064.585086] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 19:18:10 juju-e4d256-prod-github-runner-207 kernel: [50064.586203] ? hrtimer_interrupt+0x101/0x220 Aug 22 19:18:10 juju-e4d256-prod-github-runner-207 kernel: [50064.587310] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 19:18:10 juju-e4d256-prod-github-runner-207 kernel: [50064.588481] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 19:18:10 juju-e4d256-prod-github-runner-207 kernel: [50064.589702] Aug 22 19:18:10 juju-e4d256-prod-github-runner-207 kernel: [50064.592692] Aug 22 19:18:10 juju-e4d256-prod-github-runner-207 kernel: [50064.593604] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 19:18:10 juju-e4d256-prod-github-runner-207 kernel: [50064.594734] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:18:10 juju-e4d256-prod-github-runner-207 kernel: [50064.595883] ? _raw_spin_lock+0x22/0x30 Aug 22 19:18:10 juju-e4d256-prod-github-runner-207 kernel: [50064.596926] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:18:10 juju-e4d256-prod-github-runner-207 kernel: [50064.598034] direct_page_fault+0x206/0x310 [kvm] Aug 22 19:18:10 juju-e4d256-prod-github-runner-207 kernel: [50064.599144] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 19:18:10 juju-e4d256-prod-github-runner-207 kernel: [50064.600240] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 19:18:10 juju-e4d256-prod-github-runner-207 kernel: [50064.601400] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 19:18:10 juju-e4d256-prod-github-runner-207 kernel: [50064.602475] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 19:18:10 juju-e4d256-prod-github-runner-207 kernel: [50064.603519] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 19:18:10 juju-e4d256-prod-github-runner-207 kernel: [50064.604625] handle_exit+0x98/0x230 [kvm_amd] Aug 22 19:18:10 juju-e4d256-prod-github-runner-207 kernel: [50064.605645] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 19:18:10 juju-e4d256-prod-github-runner-207 kernel: [50064.606654] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 19:18:10 juju-e4d256-prod-github-runner-207 kernel: [50064.607676] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 19:18:10 juju-e4d256-prod-github-runner-207 kernel: [50064.608879] vcpu_run+0x62/0x2c0 [kvm] Aug 22 19:18:10 juju-e4d256-prod-github-runner-207 kernel: [50064.609816] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 19:18:10 juju-e4d256-prod-github-runner-207 kernel: [50064.610715] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 19:18:10 juju-e4d256-prod-github-runner-207 kernel: [50064.611671] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 19:18:10 juju-e4d256-prod-github-runner-207 kernel: [50064.612555] ? __seccomp_filter+0x4a/0x4a0 Aug 22 19:18:10 juju-e4d256-prod-github-runner-207 kernel: [50064.613396] ? __fget_files+0x86/0xc0 Aug 22 19:18:10 juju-e4d256-prod-github-runner-207 kernel: [50064.614174] __x64_sys_ioctl+0x95/0xd0 Aug 22 19:18:10 juju-e4d256-prod-github-runner-207 kernel: [50064.614953] do_syscall_64+0x5c/0xc0 Aug 22 19:18:10 juju-e4d256-prod-github-runner-207 kernel: [50064.615693] ? do_futex+0x162/0x1f0 Aug 22 19:18:10 juju-e4d256-prod-github-runner-207 kernel: [50064.616416] ? __x64_sys_futex+0x78/0x1e0 Aug 22 19:18:10 juju-e4d256-prod-github-runner-207 kernel: [50064.617186] ? __secure_computing+0xa9/0x120 Aug 22 19:18:10 juju-e4d256-prod-github-runner-207 kernel: [50064.617966] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 19:18:10 juju-e4d256-prod-github-runner-207 kernel: [50064.618841] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:18:10 juju-e4d256-prod-github-runner-207 kernel: [50064.619659] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:18:10 juju-e4d256-prod-github-runner-207 kernel: [50064.620469] ? do_syscall_64+0x69/0xc0 Aug 22 19:18:10 juju-e4d256-prod-github-runner-207 kernel: [50064.621208] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:18:10 juju-e4d256-prod-github-runner-207 kernel: [50064.622007] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:18:10 juju-e4d256-prod-github-runner-207 kernel: [50064.622801] ? do_syscall_64+0x69/0xc0 Aug 22 19:18:10 juju-e4d256-prod-github-runner-207 kernel: [50064.623506] ? do_syscall_64+0x69/0xc0 Aug 22 19:18:10 juju-e4d256-prod-github-runner-207 kernel: [50064.624220] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 19:18:10 juju-e4d256-prod-github-runner-207 kernel: [50064.625045] RIP: 0033:0x7faa5d0edaff Aug 22 19:18:10 juju-e4d256-prod-github-runner-207 kernel: [50064.625743] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 19:18:10 juju-e4d256-prod-github-runner-207 kernel: [50064.628066] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 19:18:10 juju-e4d256-prod-github-runner-207 kernel: [50064.629151] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 19:18:10 juju-e4d256-prod-github-runner-207 kernel: [50064.630185] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 19:18:10 juju-e4d256-prod-github-runner-207 kernel: [50064.631208] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 19:18:10 juju-e4d256-prod-github-runner-207 kernel: [50064.632231] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 19:18:10 juju-e4d256-prod-github-runner-207 kernel: [50064.633272] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 19:18:10 juju-e4d256-prod-github-runner-207 kernel: [50064.634299] Aug 22 19:18:38 juju-e4d256-prod-github-runner-207 kernel: [50092.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 46544s! [qemu-system-x86:6715] Aug 22 19:18:38 juju-e4d256-prod-github-runner-207 kernel: [50092.543090] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 19:18:38 juju-e4d256-prod-github-runner-207 kernel: [50092.543158] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 19:18:38 juju-e4d256-prod-github-runner-207 kernel: [50092.555288] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 19:18:38 juju-e4d256-prod-github-runner-207 kernel: [50092.556569] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 19:18:38 juju-e4d256-prod-github-runner-207 kernel: [50092.557791] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:18:38 juju-e4d256-prod-github-runner-207 kernel: [50092.558848] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 19:18:38 juju-e4d256-prod-github-runner-207 kernel: [50092.561411] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 19:18:38 juju-e4d256-prod-github-runner-207 kernel: [50092.562468] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 19:18:38 juju-e4d256-prod-github-runner-207 kernel: [50092.563630] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 19:18:38 juju-e4d256-prod-github-runner-207 kernel: [50092.564807] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 19:18:38 juju-e4d256-prod-github-runner-207 kernel: [50092.566018] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 19:18:38 juju-e4d256-prod-github-runner-207 kernel: [50092.567189] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 19:18:38 juju-e4d256-prod-github-runner-207 kernel: [50092.568464] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 19:18:38 juju-e4d256-prod-github-runner-207 kernel: [50092.569712] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 19:18:38 juju-e4d256-prod-github-runner-207 kernel: [50092.570820] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 19:18:38 juju-e4d256-prod-github-runner-207 kernel: [50092.572197] Call Trace: Aug 22 19:18:38 juju-e4d256-prod-github-runner-207 kernel: [50092.573170] Aug 22 19:18:38 juju-e4d256-prod-github-runner-207 kernel: [50092.574060] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:18:38 juju-e4d256-prod-github-runner-207 kernel: [50092.575226] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:18:38 juju-e4d256-prod-github-runner-207 kernel: [50092.576254] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:18:38 juju-e4d256-prod-github-runner-207 kernel: [50092.577358] ? show_regs.part.0+0x23/0x29 Aug 22 19:18:38 juju-e4d256-prod-github-runner-207 kernel: [50092.578355] ? show_regs.cold+0x8/0xd Aug 22 19:18:38 juju-e4d256-prod-github-runner-207 kernel: [50092.579335] ? watchdog_timer_fn+0x1be/0x220 Aug 22 19:18:38 juju-e4d256-prod-github-runner-207 kernel: [50092.580360] ? lockup_detector_update_enable+0x60/0x60 Aug 22 19:18:38 juju-e4d256-prod-github-runner-207 kernel: [50092.581422] ? __hrtimer_run_queues+0x107/0x230 Aug 22 19:18:38 juju-e4d256-prod-github-runner-207 kernel: [50092.582457] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 19:18:38 juju-e4d256-prod-github-runner-207 kernel: [50092.583488] ? hrtimer_interrupt+0x101/0x220 Aug 22 19:18:38 juju-e4d256-prod-github-runner-207 kernel: [50092.584640] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 19:18:38 juju-e4d256-prod-github-runner-207 kernel: [50092.585839] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 19:18:38 juju-e4d256-prod-github-runner-207 kernel: [50092.587032] Aug 22 19:18:38 juju-e4d256-prod-github-runner-207 kernel: [50092.587931] Aug 22 19:18:38 juju-e4d256-prod-github-runner-207 kernel: [50092.588840] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 19:18:38 juju-e4d256-prod-github-runner-207 kernel: [50092.589892] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:18:38 juju-e4d256-prod-github-runner-207 kernel: [50092.591000] ? _raw_spin_lock+0x22/0x30 Aug 22 19:18:38 juju-e4d256-prod-github-runner-207 kernel: [50092.591949] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:18:38 juju-e4d256-prod-github-runner-207 kernel: [50092.593039] direct_page_fault+0x206/0x310 [kvm] Aug 22 19:18:38 juju-e4d256-prod-github-runner-207 kernel: [50092.594067] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 19:18:38 juju-e4d256-prod-github-runner-207 kernel: [50092.595076] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 19:18:38 juju-e4d256-prod-github-runner-207 kernel: [50092.596082] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 19:18:38 juju-e4d256-prod-github-runner-207 kernel: [50092.597098] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 19:18:38 juju-e4d256-prod-github-runner-207 kernel: [50092.598045] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 19:18:38 juju-e4d256-prod-github-runner-207 kernel: [50092.599029] handle_exit+0x98/0x230 [kvm_amd] Aug 22 19:18:38 juju-e4d256-prod-github-runner-207 kernel: [50092.599970] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 19:18:38 juju-e4d256-prod-github-runner-207 kernel: [50092.600952] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 19:18:38 juju-e4d256-prod-github-runner-207 kernel: [50092.601880] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 19:18:38 juju-e4d256-prod-github-runner-207 kernel: [50092.602789] vcpu_run+0x62/0x2c0 [kvm] Aug 22 19:18:38 juju-e4d256-prod-github-runner-207 kernel: [50092.603602] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 19:18:38 juju-e4d256-prod-github-runner-207 kernel: [50092.604440] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 19:18:38 juju-e4d256-prod-github-runner-207 kernel: [50092.605319] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 19:18:38 juju-e4d256-prod-github-runner-207 kernel: [50092.606118] ? __seccomp_filter+0x4a/0x4a0 Aug 22 19:18:38 juju-e4d256-prod-github-runner-207 kernel: [50092.606863] ? __fget_files+0x86/0xc0 Aug 22 19:18:38 juju-e4d256-prod-github-runner-207 kernel: [50092.607566] __x64_sys_ioctl+0x95/0xd0 Aug 22 19:18:38 juju-e4d256-prod-github-runner-207 kernel: [50092.608356] do_syscall_64+0x5c/0xc0 Aug 22 19:18:38 juju-e4d256-prod-github-runner-207 kernel: [50092.609027] ? do_futex+0x162/0x1f0 Aug 22 19:18:38 juju-e4d256-prod-github-runner-207 kernel: [50092.609683] ? __x64_sys_futex+0x78/0x1e0 Aug 22 19:18:38 juju-e4d256-prod-github-runner-207 kernel: [50092.610392] ? __secure_computing+0xa9/0x120 Aug 22 19:18:38 juju-e4d256-prod-github-runner-207 kernel: [50092.611086] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 19:18:38 juju-e4d256-prod-github-runner-207 kernel: [50092.611883] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:18:38 juju-e4d256-prod-github-runner-207 kernel: [50092.612662] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:18:38 juju-e4d256-prod-github-runner-207 kernel: [50092.613437] ? do_syscall_64+0x69/0xc0 Aug 22 19:18:38 juju-e4d256-prod-github-runner-207 kernel: [50092.614106] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:18:38 juju-e4d256-prod-github-runner-207 kernel: [50092.614873] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:18:38 juju-e4d256-prod-github-runner-207 kernel: [50092.615573] ? do_syscall_64+0x69/0xc0 Aug 22 19:18:38 juju-e4d256-prod-github-runner-207 kernel: [50092.616212] ? do_syscall_64+0x69/0xc0 Aug 22 19:18:38 juju-e4d256-prod-github-runner-207 kernel: [50092.616850] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 19:18:38 juju-e4d256-prod-github-runner-207 kernel: [50092.617564] RIP: 0033:0x7faa5d0edaff Aug 22 19:18:38 juju-e4d256-prod-github-runner-207 kernel: [50092.618189] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 19:18:38 juju-e4d256-prod-github-runner-207 kernel: [50092.620180] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 19:18:38 juju-e4d256-prod-github-runner-207 kernel: [50092.621202] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 19:18:38 juju-e4d256-prod-github-runner-207 kernel: [50092.622096] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 19:18:38 juju-e4d256-prod-github-runner-207 kernel: [50092.623024] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 19:18:38 juju-e4d256-prod-github-runner-207 kernel: [50092.623981] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 19:18:38 juju-e4d256-prod-github-runner-207 kernel: [50092.624926] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 19:18:38 juju-e4d256-prod-github-runner-207 kernel: [50092.625852] Aug 22 19:19:06 juju-e4d256-prod-github-runner-207 kernel: [50120.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 46570s! [qemu-system-x86:6715] Aug 22 19:19:06 juju-e4d256-prod-github-runner-207 kernel: [50120.543108] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 19:19:06 juju-e4d256-prod-github-runner-207 kernel: [50120.543174] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 19:19:06 juju-e4d256-prod-github-runner-207 kernel: [50120.555296] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 19:19:06 juju-e4d256-prod-github-runner-207 kernel: [50120.556582] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 19:19:06 juju-e4d256-prod-github-runner-207 kernel: [50120.557815] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:19:06 juju-e4d256-prod-github-runner-207 kernel: [50120.558871] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 19:19:06 juju-e4d256-prod-github-runner-207 kernel: [50120.561422] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 19:19:06 juju-e4d256-prod-github-runner-207 kernel: [50120.562467] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 19:19:06 juju-e4d256-prod-github-runner-207 kernel: [50120.563626] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 19:19:06 juju-e4d256-prod-github-runner-207 kernel: [50120.564796] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 19:19:06 juju-e4d256-prod-github-runner-207 kernel: [50120.565951] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 19:19:06 juju-e4d256-prod-github-runner-207 kernel: [50120.567109] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 19:19:06 juju-e4d256-prod-github-runner-207 kernel: [50120.568281] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 19:19:06 juju-e4d256-prod-github-runner-207 kernel: [50120.569519] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 19:19:06 juju-e4d256-prod-github-runner-207 kernel: [50120.570617] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 19:19:06 juju-e4d256-prod-github-runner-207 kernel: [50120.571813] Call Trace: Aug 22 19:19:06 juju-e4d256-prod-github-runner-207 kernel: [50120.572850] Aug 22 19:19:06 juju-e4d256-prod-github-runner-207 kernel: [50120.573733] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:19:06 juju-e4d256-prod-github-runner-207 kernel: [50120.574763] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:19:06 juju-e4d256-prod-github-runner-207 kernel: [50120.575779] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:19:06 juju-e4d256-prod-github-runner-207 kernel: [50120.576861] ? show_regs.part.0+0x23/0x29 Aug 22 19:19:06 juju-e4d256-prod-github-runner-207 kernel: [50120.577857] ? show_regs.cold+0x8/0xd Aug 22 19:19:06 juju-e4d256-prod-github-runner-207 kernel: [50120.578824] ? watchdog_timer_fn+0x1be/0x220 Aug 22 19:19:06 juju-e4d256-prod-github-runner-207 kernel: [50120.579829] ? lockup_detector_update_enable+0x60/0x60 Aug 22 19:19:06 juju-e4d256-prod-github-runner-207 kernel: [50120.580895] ? __hrtimer_run_queues+0x107/0x230 Aug 22 19:19:06 juju-e4d256-prod-github-runner-207 kernel: [50120.581919] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 19:19:06 juju-e4d256-prod-github-runner-207 kernel: [50120.582945] ? hrtimer_interrupt+0x101/0x220 Aug 22 19:19:06 juju-e4d256-prod-github-runner-207 kernel: [50120.583972] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 19:19:06 juju-e4d256-prod-github-runner-207 kernel: [50120.585045] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 19:19:06 juju-e4d256-prod-github-runner-207 kernel: [50120.586088] Aug 22 19:19:06 juju-e4d256-prod-github-runner-207 kernel: [50120.586938] Aug 22 19:19:06 juju-e4d256-prod-github-runner-207 kernel: [50120.587779] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 19:19:06 juju-e4d256-prod-github-runner-207 kernel: [50120.588815] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:19:06 juju-e4d256-prod-github-runner-207 kernel: [50120.589849] ? _raw_spin_lock+0x22/0x30 Aug 22 19:19:06 juju-e4d256-prod-github-runner-207 kernel: [50120.590796] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:19:06 juju-e4d256-prod-github-runner-207 kernel: [50120.591819] direct_page_fault+0x206/0x310 [kvm] Aug 22 19:19:06 juju-e4d256-prod-github-runner-207 kernel: [50120.592915] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 19:19:06 juju-e4d256-prod-github-runner-207 kernel: [50120.593927] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 19:19:06 juju-e4d256-prod-github-runner-207 kernel: [50120.594937] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 19:19:06 juju-e4d256-prod-github-runner-207 kernel: [50120.595962] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 19:19:06 juju-e4d256-prod-github-runner-207 kernel: [50120.596912] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 19:19:06 juju-e4d256-prod-github-runner-207 kernel: [50120.597889] handle_exit+0x98/0x230 [kvm_amd] Aug 22 19:19:06 juju-e4d256-prod-github-runner-207 kernel: [50120.598778] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 19:19:06 juju-e4d256-prod-github-runner-207 kernel: [50120.599689] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 19:19:06 juju-e4d256-prod-github-runner-207 kernel: [50120.600624] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 19:19:06 juju-e4d256-prod-github-runner-207 kernel: [50120.601532] vcpu_run+0x62/0x2c0 [kvm] Aug 22 19:19:06 juju-e4d256-prod-github-runner-207 kernel: [50120.602340] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 19:19:06 juju-e4d256-prod-github-runner-207 kernel: [50120.603170] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 19:19:06 juju-e4d256-prod-github-runner-207 kernel: [50120.604061] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 19:19:06 juju-e4d256-prod-github-runner-207 kernel: [50120.604861] ? __seccomp_filter+0x4a/0x4a0 Aug 22 19:19:06 juju-e4d256-prod-github-runner-207 kernel: [50120.605619] ? __fget_files+0x86/0xc0 Aug 22 19:19:06 juju-e4d256-prod-github-runner-207 kernel: [50120.606324] __x64_sys_ioctl+0x95/0xd0 Aug 22 19:19:06 juju-e4d256-prod-github-runner-207 kernel: [50120.607022] do_syscall_64+0x5c/0xc0 Aug 22 19:19:06 juju-e4d256-prod-github-runner-207 kernel: [50120.607686] ? do_futex+0x162/0x1f0 Aug 22 19:19:06 juju-e4d256-prod-github-runner-207 kernel: [50120.608363] ? __x64_sys_futex+0x78/0x1e0 Aug 22 19:19:06 juju-e4d256-prod-github-runner-207 kernel: [50120.609040] ? __secure_computing+0xa9/0x120 Aug 22 19:19:06 juju-e4d256-prod-github-runner-207 kernel: [50120.609739] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 19:19:06 juju-e4d256-prod-github-runner-207 kernel: [50120.610498] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:19:06 juju-e4d256-prod-github-runner-207 kernel: [50120.611220] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:19:06 juju-e4d256-prod-github-runner-207 kernel: [50120.611935] ? do_syscall_64+0x69/0xc0 Aug 22 19:19:06 juju-e4d256-prod-github-runner-207 kernel: [50120.612598] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:19:06 juju-e4d256-prod-github-runner-207 kernel: [50120.613303] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:19:06 juju-e4d256-prod-github-runner-207 kernel: [50120.614002] ? do_syscall_64+0x69/0xc0 Aug 22 19:19:06 juju-e4d256-prod-github-runner-207 kernel: [50120.614628] ? do_syscall_64+0x69/0xc0 Aug 22 19:19:06 juju-e4d256-prod-github-runner-207 kernel: [50120.615253] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 19:19:06 juju-e4d256-prod-github-runner-207 kernel: [50120.615978] RIP: 0033:0x7faa5d0edaff Aug 22 19:19:06 juju-e4d256-prod-github-runner-207 kernel: [50120.616608] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 19:19:06 juju-e4d256-prod-github-runner-207 kernel: [50120.618596] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 19:19:06 juju-e4d256-prod-github-runner-207 kernel: [50120.619507] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 19:19:06 juju-e4d256-prod-github-runner-207 kernel: [50120.620407] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 19:19:06 juju-e4d256-prod-github-runner-207 kernel: [50120.621306] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 19:19:06 juju-e4d256-prod-github-runner-207 kernel: [50120.622197] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 19:19:06 juju-e4d256-prod-github-runner-207 kernel: [50120.623087] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 19:19:06 juju-e4d256-prod-github-runner-207 kernel: [50120.623999] Aug 22 19:19:34 juju-e4d256-prod-github-runner-207 kernel: [50148.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 46596s! [qemu-system-x86:6715] Aug 22 19:19:34 juju-e4d256-prod-github-runner-207 kernel: [50148.543692] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 19:19:34 juju-e4d256-prod-github-runner-207 kernel: [50148.543940] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 19:19:34 juju-e4d256-prod-github-runner-207 kernel: [50148.555992] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 19:19:34 juju-e4d256-prod-github-runner-207 kernel: [50148.557258] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 19:19:34 juju-e4d256-prod-github-runner-207 kernel: [50148.558477] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:19:34 juju-e4d256-prod-github-runner-207 kernel: [50148.559532] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 19:19:34 juju-e4d256-prod-github-runner-207 kernel: [50148.562098] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 19:19:34 juju-e4d256-prod-github-runner-207 kernel: [50148.563137] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 19:19:34 juju-e4d256-prod-github-runner-207 kernel: [50148.564307] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 19:19:34 juju-e4d256-prod-github-runner-207 kernel: [50148.565464] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 19:19:34 juju-e4d256-prod-github-runner-207 kernel: [50148.566622] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 19:19:34 juju-e4d256-prod-github-runner-207 kernel: [50148.567797] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 19:19:34 juju-e4d256-prod-github-runner-207 kernel: [50148.568961] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 19:19:34 juju-e4d256-prod-github-runner-207 kernel: [50148.570197] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 19:19:34 juju-e4d256-prod-github-runner-207 kernel: [50148.571292] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 19:19:34 juju-e4d256-prod-github-runner-207 kernel: [50148.572666] Call Trace: Aug 22 19:19:34 juju-e4d256-prod-github-runner-207 kernel: [50148.573582] Aug 22 19:19:34 juju-e4d256-prod-github-runner-207 kernel: [50148.574481] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:19:34 juju-e4d256-prod-github-runner-207 kernel: [50148.575510] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:19:34 juju-e4d256-prod-github-runner-207 kernel: [50148.576542] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:19:34 juju-e4d256-prod-github-runner-207 kernel: [50148.577628] ? show_regs.part.0+0x23/0x29 Aug 22 19:19:34 juju-e4d256-prod-github-runner-207 kernel: [50148.578624] ? show_regs.cold+0x8/0xd Aug 22 19:19:34 juju-e4d256-prod-github-runner-207 kernel: [50148.579603] ? watchdog_timer_fn+0x1be/0x220 Aug 22 19:19:34 juju-e4d256-prod-github-runner-207 kernel: [50148.580608] ? lockup_detector_update_enable+0x60/0x60 Aug 22 19:19:34 juju-e4d256-prod-github-runner-207 kernel: [50148.581669] ? __hrtimer_run_queues+0x107/0x230 Aug 22 19:19:34 juju-e4d256-prod-github-runner-207 kernel: [50148.582693] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 19:19:34 juju-e4d256-prod-github-runner-207 kernel: [50148.583731] ? hrtimer_interrupt+0x101/0x220 Aug 22 19:19:34 juju-e4d256-prod-github-runner-207 kernel: [50148.584745] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 19:19:34 juju-e4d256-prod-github-runner-207 kernel: [50148.585811] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 19:19:34 juju-e4d256-prod-github-runner-207 kernel: [50148.586856] Aug 22 19:19:34 juju-e4d256-prod-github-runner-207 kernel: [50148.587716] Aug 22 19:19:34 juju-e4d256-prod-github-runner-207 kernel: [50148.588553] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 19:19:34 juju-e4d256-prod-github-runner-207 kernel: [50148.589588] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:19:34 juju-e4d256-prod-github-runner-207 kernel: [50148.590626] ? _raw_spin_lock+0x22/0x30 Aug 22 19:19:34 juju-e4d256-prod-github-runner-207 kernel: [50148.591577] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:19:34 juju-e4d256-prod-github-runner-207 kernel: [50148.592609] direct_page_fault+0x206/0x310 [kvm] Aug 22 19:19:34 juju-e4d256-prod-github-runner-207 kernel: [50148.593633] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 19:19:34 juju-e4d256-prod-github-runner-207 kernel: [50148.594642] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 19:19:34 juju-e4d256-prod-github-runner-207 kernel: [50148.595658] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 19:19:34 juju-e4d256-prod-github-runner-207 kernel: [50148.596653] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 19:19:34 juju-e4d256-prod-github-runner-207 kernel: [50148.597598] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 19:19:34 juju-e4d256-prod-github-runner-207 kernel: [50148.598576] handle_exit+0x98/0x230 [kvm_amd] Aug 22 19:19:34 juju-e4d256-prod-github-runner-207 kernel: [50148.599468] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 19:19:34 juju-e4d256-prod-github-runner-207 kernel: [50148.600388] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 19:19:34 juju-e4d256-prod-github-runner-207 kernel: [50148.601312] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 19:19:34 juju-e4d256-prod-github-runner-207 kernel: [50148.602221] vcpu_run+0x62/0x2c0 [kvm] Aug 22 19:19:34 juju-e4d256-prod-github-runner-207 kernel: [50148.603032] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 19:19:34 juju-e4d256-prod-github-runner-207 kernel: [50148.603852] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 19:19:34 juju-e4d256-prod-github-runner-207 kernel: [50148.604708] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 19:19:34 juju-e4d256-prod-github-runner-207 kernel: [50148.605512] ? __seccomp_filter+0x4a/0x4a0 Aug 22 19:19:34 juju-e4d256-prod-github-runner-207 kernel: [50148.606256] ? __fget_files+0x86/0xc0 Aug 22 19:19:34 juju-e4d256-prod-github-runner-207 kernel: [50148.606960] __x64_sys_ioctl+0x95/0xd0 Aug 22 19:19:34 juju-e4d256-prod-github-runner-207 kernel: [50148.607662] do_syscall_64+0x5c/0xc0 Aug 22 19:19:34 juju-e4d256-prod-github-runner-207 kernel: [50148.608335] ? do_futex+0x162/0x1f0 Aug 22 19:19:34 juju-e4d256-prod-github-runner-207 kernel: [50148.608985] ? __x64_sys_futex+0x78/0x1e0 Aug 22 19:19:34 juju-e4d256-prod-github-runner-207 kernel: [50148.609660] ? __secure_computing+0xa9/0x120 Aug 22 19:19:34 juju-e4d256-prod-github-runner-207 kernel: [50148.610352] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 19:19:34 juju-e4d256-prod-github-runner-207 kernel: [50148.611114] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:19:34 juju-e4d256-prod-github-runner-207 kernel: [50148.611855] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:19:34 juju-e4d256-prod-github-runner-207 kernel: [50148.612576] ? do_syscall_64+0x69/0xc0 Aug 22 19:19:34 juju-e4d256-prod-github-runner-207 kernel: [50148.613222] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:19:34 juju-e4d256-prod-github-runner-207 kernel: [50148.613932] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:19:34 juju-e4d256-prod-github-runner-207 kernel: [50148.614629] ? do_syscall_64+0x69/0xc0 Aug 22 19:19:34 juju-e4d256-prod-github-runner-207 kernel: [50148.615258] ? do_syscall_64+0x69/0xc0 Aug 22 19:19:34 juju-e4d256-prod-github-runner-207 kernel: [50148.615890] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 19:19:34 juju-e4d256-prod-github-runner-207 kernel: [50148.616599] RIP: 0033:0x7faa5d0edaff Aug 22 19:19:34 juju-e4d256-prod-github-runner-207 kernel: [50148.617258] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 19:19:34 juju-e4d256-prod-github-runner-207 kernel: [50148.619261] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 19:19:34 juju-e4d256-prod-github-runner-207 kernel: [50148.620206] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 19:19:34 juju-e4d256-prod-github-runner-207 kernel: [50148.621106] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 19:19:34 juju-e4d256-prod-github-runner-207 kernel: [50148.621998] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 19:19:34 juju-e4d256-prod-github-runner-207 kernel: [50148.622887] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 19:19:34 juju-e4d256-prod-github-runner-207 kernel: [50148.623786] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 19:19:34 juju-e4d256-prod-github-runner-207 kernel: [50148.624681] Aug 22 19:20:02 juju-e4d256-prod-github-runner-207 kernel: [50176.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 46622s! [qemu-system-x86:6715] Aug 22 19:20:02 juju-e4d256-prod-github-runner-207 kernel: [50176.543119] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 19:20:02 juju-e4d256-prod-github-runner-207 kernel: [50176.543186] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 19:20:02 juju-e4d256-prod-github-runner-207 kernel: [50176.555991] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 19:20:02 juju-e4d256-prod-github-runner-207 kernel: [50176.557281] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 19:20:02 juju-e4d256-prod-github-runner-207 kernel: [50176.558504] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:20:02 juju-e4d256-prod-github-runner-207 kernel: [50176.559572] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 19:20:02 juju-e4d256-prod-github-runner-207 kernel: [50176.562117] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 19:20:02 juju-e4d256-prod-github-runner-207 kernel: [50176.563161] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 19:20:02 juju-e4d256-prod-github-runner-207 kernel: [50176.564324] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 19:20:02 juju-e4d256-prod-github-runner-207 kernel: [50176.565480] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 19:20:02 juju-e4d256-prod-github-runner-207 kernel: [50176.566643] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 19:20:02 juju-e4d256-prod-github-runner-207 kernel: [50176.567806] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 19:20:02 juju-e4d256-prod-github-runner-207 kernel: [50176.568974] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 19:20:02 juju-e4d256-prod-github-runner-207 kernel: [50176.570208] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 19:20:02 juju-e4d256-prod-github-runner-207 kernel: [50176.571313] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 19:20:02 juju-e4d256-prod-github-runner-207 kernel: [50176.572503] Call Trace: Aug 22 19:20:02 juju-e4d256-prod-github-runner-207 kernel: [50176.573414] Aug 22 19:20:02 juju-e4d256-prod-github-runner-207 kernel: [50176.574297] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:20:02 juju-e4d256-prod-github-runner-207 kernel: [50176.575337] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:20:02 juju-e4d256-prod-github-runner-207 kernel: [50176.576361] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:20:02 juju-e4d256-prod-github-runner-207 kernel: [50176.577432] ? show_regs.part.0+0x23/0x29 Aug 22 19:20:02 juju-e4d256-prod-github-runner-207 kernel: [50176.578426] ? show_regs.cold+0x8/0xd Aug 22 19:20:02 juju-e4d256-prod-github-runner-207 kernel: [50176.579410] ? watchdog_timer_fn+0x1be/0x220 Aug 22 19:20:02 juju-e4d256-prod-github-runner-207 kernel: [50176.580417] ? lockup_detector_update_enable+0x60/0x60 Aug 22 19:20:02 juju-e4d256-prod-github-runner-207 kernel: [50176.581479] ? __hrtimer_run_queues+0x107/0x230 Aug 22 19:20:02 juju-e4d256-prod-github-runner-207 kernel: [50176.582506] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 19:20:02 juju-e4d256-prod-github-runner-207 kernel: [50176.583550] ? hrtimer_interrupt+0x101/0x220 Aug 22 19:20:02 juju-e4d256-prod-github-runner-207 kernel: [50176.584563] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 19:20:02 juju-e4d256-prod-github-runner-207 kernel: [50176.585630] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 19:20:02 juju-e4d256-prod-github-runner-207 kernel: [50176.586673] Aug 22 19:20:02 juju-e4d256-prod-github-runner-207 kernel: [50176.587537] Aug 22 19:20:02 juju-e4d256-prod-github-runner-207 kernel: [50176.588377] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 19:20:02 juju-e4d256-prod-github-runner-207 kernel: [50176.589406] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:20:02 juju-e4d256-prod-github-runner-207 kernel: [50176.590442] ? _raw_spin_lock+0x22/0x30 Aug 22 19:20:02 juju-e4d256-prod-github-runner-207 kernel: [50176.591392] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:20:02 juju-e4d256-prod-github-runner-207 kernel: [50176.592408] direct_page_fault+0x206/0x310 [kvm] Aug 22 19:20:02 juju-e4d256-prod-github-runner-207 kernel: [50176.593430] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 19:20:02 juju-e4d256-prod-github-runner-207 kernel: [50176.594436] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 19:20:02 juju-e4d256-prod-github-runner-207 kernel: [50176.595458] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 19:20:02 juju-e4d256-prod-github-runner-207 kernel: [50176.596434] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 19:20:02 juju-e4d256-prod-github-runner-207 kernel: [50176.597377] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 19:20:02 juju-e4d256-prod-github-runner-207 kernel: [50176.598356] handle_exit+0x98/0x230 [kvm_amd] Aug 22 19:20:02 juju-e4d256-prod-github-runner-207 kernel: [50176.599257] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 19:20:02 juju-e4d256-prod-github-runner-207 kernel: [50176.600168] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 19:20:02 juju-e4d256-prod-github-runner-207 kernel: [50176.601091] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 19:20:02 juju-e4d256-prod-github-runner-207 kernel: [50176.601999] vcpu_run+0x62/0x2c0 [kvm] Aug 22 19:20:02 juju-e4d256-prod-github-runner-207 kernel: [50176.602847] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 19:20:02 juju-e4d256-prod-github-runner-207 kernel: [50176.603784] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 19:20:02 juju-e4d256-prod-github-runner-207 kernel: [50176.604750] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 19:20:02 juju-e4d256-prod-github-runner-207 kernel: [50176.605634] ? __seccomp_filter+0x4a/0x4a0 Aug 22 19:20:02 juju-e4d256-prod-github-runner-207 kernel: [50176.606458] ? __fget_files+0x86/0xc0 Aug 22 19:20:02 juju-e4d256-prod-github-runner-207 kernel: [50176.607258] __x64_sys_ioctl+0x95/0xd0 Aug 22 19:20:02 juju-e4d256-prod-github-runner-207 kernel: [50176.608031] do_syscall_64+0x5c/0xc0 Aug 22 19:20:02 juju-e4d256-prod-github-runner-207 kernel: [50176.608774] ? do_futex+0x162/0x1f0 Aug 22 19:20:02 juju-e4d256-prod-github-runner-207 kernel: [50176.609493] ? __x64_sys_futex+0x78/0x1e0 Aug 22 19:20:02 juju-e4d256-prod-github-runner-207 kernel: [50176.610252] ? __secure_computing+0xa9/0x120 Aug 22 19:20:02 juju-e4d256-prod-github-runner-207 kernel: [50176.611029] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 19:20:02 juju-e4d256-prod-github-runner-207 kernel: [50176.611905] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:20:02 juju-e4d256-prod-github-runner-207 kernel: [50176.612730] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:20:02 juju-e4d256-prod-github-runner-207 kernel: [50176.613566] ? do_syscall_64+0x69/0xc0 Aug 22 19:20:02 juju-e4d256-prod-github-runner-207 kernel: [50176.614286] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:20:02 juju-e4d256-prod-github-runner-207 kernel: [50176.615098] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:20:02 juju-e4d256-prod-github-runner-207 kernel: [50176.615916] ? do_syscall_64+0x69/0xc0 Aug 22 19:20:02 juju-e4d256-prod-github-runner-207 kernel: [50176.616613] ? do_syscall_64+0x69/0xc0 Aug 22 19:20:02 juju-e4d256-prod-github-runner-207 kernel: [50176.617316] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 19:20:02 juju-e4d256-prod-github-runner-207 kernel: [50176.618113] RIP: 0033:0x7faa5d0edaff Aug 22 19:20:02 juju-e4d256-prod-github-runner-207 kernel: [50176.618809] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 19:20:02 juju-e4d256-prod-github-runner-207 kernel: [50176.621133] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 19:20:02 juju-e4d256-prod-github-runner-207 kernel: [50176.622180] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 19:20:02 juju-e4d256-prod-github-runner-207 kernel: [50176.623204] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 19:20:02 juju-e4d256-prod-github-runner-207 kernel: [50176.624245] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 19:20:02 juju-e4d256-prod-github-runner-207 kernel: [50176.625269] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 19:20:02 juju-e4d256-prod-github-runner-207 kernel: [50176.626292] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 19:20:02 juju-e4d256-prod-github-runner-207 kernel: [50176.627334] Aug 22 19:20:30 juju-e4d256-prod-github-runner-207 kernel: [50204.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 46648s! [qemu-system-x86:6715] Aug 22 19:20:30 juju-e4d256-prod-github-runner-207 kernel: [50204.543107] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 19:20:30 juju-e4d256-prod-github-runner-207 kernel: [50204.543175] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 19:20:30 juju-e4d256-prod-github-runner-207 kernel: [50204.555542] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 19:20:30 juju-e4d256-prod-github-runner-207 kernel: [50204.556849] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 19:20:30 juju-e4d256-prod-github-runner-207 kernel: [50204.558074] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:20:30 juju-e4d256-prod-github-runner-207 kernel: [50204.559149] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 19:20:30 juju-e4d256-prod-github-runner-207 kernel: [50204.561698] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 19:20:30 juju-e4d256-prod-github-runner-207 kernel: [50204.562743] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 19:20:30 juju-e4d256-prod-github-runner-207 kernel: [50204.563926] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 19:20:30 juju-e4d256-prod-github-runner-207 kernel: [50204.565106] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 19:20:30 juju-e4d256-prod-github-runner-207 kernel: [50204.566270] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 19:20:30 juju-e4d256-prod-github-runner-207 kernel: [50204.567466] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 19:20:30 juju-e4d256-prod-github-runner-207 kernel: [50204.568662] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 19:20:30 juju-e4d256-prod-github-runner-207 kernel: [50204.569907] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 19:20:30 juju-e4d256-prod-github-runner-207 kernel: [50204.571028] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 19:20:30 juju-e4d256-prod-github-runner-207 kernel: [50204.572227] Call Trace: Aug 22 19:20:30 juju-e4d256-prod-github-runner-207 kernel: [50204.573138] Aug 22 19:20:30 juju-e4d256-prod-github-runner-207 kernel: [50204.574025] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:20:30 juju-e4d256-prod-github-runner-207 kernel: [50204.575063] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:20:30 juju-e4d256-prod-github-runner-207 kernel: [50204.576082] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:20:30 juju-e4d256-prod-github-runner-207 kernel: [50204.577159] ? show_regs.part.0+0x23/0x29 Aug 22 19:20:30 juju-e4d256-prod-github-runner-207 kernel: [50204.578153] ? show_regs.cold+0x8/0xd Aug 22 19:20:30 juju-e4d256-prod-github-runner-207 kernel: [50204.579133] ? watchdog_timer_fn+0x1be/0x220 Aug 22 19:20:30 juju-e4d256-prod-github-runner-207 kernel: [50204.580143] ? lockup_detector_update_enable+0x60/0x60 Aug 22 19:20:30 juju-e4d256-prod-github-runner-207 kernel: [50204.581212] ? __hrtimer_run_queues+0x107/0x230 Aug 22 19:20:30 juju-e4d256-prod-github-runner-207 kernel: [50204.582245] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 19:20:30 juju-e4d256-prod-github-runner-207 kernel: [50204.583285] ? hrtimer_interrupt+0x101/0x220 Aug 22 19:20:30 juju-e4d256-prod-github-runner-207 kernel: [50204.584298] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 19:20:30 juju-e4d256-prod-github-runner-207 kernel: [50204.585364] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 19:20:30 juju-e4d256-prod-github-runner-207 kernel: [50204.586407] Aug 22 19:20:30 juju-e4d256-prod-github-runner-207 kernel: [50204.587268] Aug 22 19:20:30 juju-e4d256-prod-github-runner-207 kernel: [50204.588109] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 19:20:30 juju-e4d256-prod-github-runner-207 kernel: [50204.589142] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:20:30 juju-e4d256-prod-github-runner-207 kernel: [50204.590184] ? _raw_spin_lock+0x22/0x30 Aug 22 19:20:30 juju-e4d256-prod-github-runner-207 kernel: [50204.591142] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:20:30 juju-e4d256-prod-github-runner-207 kernel: [50204.592157] direct_page_fault+0x206/0x310 [kvm] Aug 22 19:20:30 juju-e4d256-prod-github-runner-207 kernel: [50204.593182] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 19:20:30 juju-e4d256-prod-github-runner-207 kernel: [50204.594193] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 19:20:30 juju-e4d256-prod-github-runner-207 kernel: [50204.595199] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 19:20:30 juju-e4d256-prod-github-runner-207 kernel: [50204.596174] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 19:20:30 juju-e4d256-prod-github-runner-207 kernel: [50204.597116] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 19:20:30 juju-e4d256-prod-github-runner-207 kernel: [50204.598089] handle_exit+0x98/0x230 [kvm_amd] Aug 22 19:20:30 juju-e4d256-prod-github-runner-207 kernel: [50204.599029] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 19:20:30 juju-e4d256-prod-github-runner-207 kernel: [50204.599954] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 19:20:30 juju-e4d256-prod-github-runner-207 kernel: [50204.601030] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 19:20:30 juju-e4d256-prod-github-runner-207 kernel: [50204.602054] vcpu_run+0x62/0x2c0 [kvm] Aug 22 19:20:30 juju-e4d256-prod-github-runner-207 kernel: [50204.602868] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 19:20:30 juju-e4d256-prod-github-runner-207 kernel: [50204.603686] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 19:20:30 juju-e4d256-prod-github-runner-207 kernel: [50204.604538] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 19:20:30 juju-e4d256-prod-github-runner-207 kernel: [50204.605354] ? __seccomp_filter+0x4a/0x4a0 Aug 22 19:20:30 juju-e4d256-prod-github-runner-207 kernel: [50204.606098] ? __fget_files+0x86/0xc0 Aug 22 19:20:30 juju-e4d256-prod-github-runner-207 kernel: [50204.606804] __x64_sys_ioctl+0x95/0xd0 Aug 22 19:20:30 juju-e4d256-prod-github-runner-207 kernel: [50204.607503] do_syscall_64+0x5c/0xc0 Aug 22 19:20:30 juju-e4d256-prod-github-runner-207 kernel: [50204.608165] ? do_futex+0x162/0x1f0 Aug 22 19:20:30 juju-e4d256-prod-github-runner-207 kernel: [50204.608896] ? __x64_sys_futex+0x78/0x1e0 Aug 22 19:20:30 juju-e4d256-prod-github-runner-207 kernel: [50204.609696] ? __secure_computing+0xa9/0x120 Aug 22 19:20:30 juju-e4d256-prod-github-runner-207 kernel: [50204.610382] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 19:20:30 juju-e4d256-prod-github-runner-207 kernel: [50204.611156] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:20:30 juju-e4d256-prod-github-runner-207 kernel: [50204.611876] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:20:30 juju-e4d256-prod-github-runner-207 kernel: [50204.612598] ? do_syscall_64+0x69/0xc0 Aug 22 19:20:30 juju-e4d256-prod-github-runner-207 kernel: [50204.613240] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:20:30 juju-e4d256-prod-github-runner-207 kernel: [50204.613944] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:20:30 juju-e4d256-prod-github-runner-207 kernel: [50204.614641] ? do_syscall_64+0x69/0xc0 Aug 22 19:20:30 juju-e4d256-prod-github-runner-207 kernel: [50204.615293] ? do_syscall_64+0x69/0xc0 Aug 22 19:20:30 juju-e4d256-prod-github-runner-207 kernel: [50204.615919] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 19:20:30 juju-e4d256-prod-github-runner-207 kernel: [50204.616625] RIP: 0033:0x7faa5d0edaff Aug 22 19:20:30 juju-e4d256-prod-github-runner-207 kernel: [50204.617257] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 19:20:30 juju-e4d256-prod-github-runner-207 kernel: [50204.619305] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 19:20:30 juju-e4d256-prod-github-runner-207 kernel: [50204.620219] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 19:20:30 juju-e4d256-prod-github-runner-207 kernel: [50204.621112] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 19:20:30 juju-e4d256-prod-github-runner-207 kernel: [50204.622008] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 19:20:30 juju-e4d256-prod-github-runner-207 kernel: [50204.622906] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 19:20:30 juju-e4d256-prod-github-runner-207 kernel: [50204.623794] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 19:20:30 juju-e4d256-prod-github-runner-207 kernel: [50204.624718] Aug 22 19:20:46 juju-e4d256-prod-github-runner-207 kernel: [50220.536706] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 19:20:46 juju-e4d256-prod-github-runner-207 kernel: [50220.538341] rcu: 1-....: (12486440 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=6037116 Aug 22 19:20:46 juju-e4d256-prod-github-runner-207 kernel: [50220.539504] (t=12525834 jiffies g=23269 q=47796) Aug 22 19:20:46 juju-e4d256-prod-github-runner-207 kernel: [50220.540306] NMI backtrace for cpu 1 Aug 22 19:20:46 juju-e4d256-prod-github-runner-207 kernel: [50220.541015] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 19:20:46 juju-e4d256-prod-github-runner-207 kernel: [50220.542124] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 19:20:46 juju-e4d256-prod-github-runner-207 kernel: [50220.543212] Call Trace: Aug 22 19:20:46 juju-e4d256-prod-github-runner-207 kernel: [50220.543888] Aug 22 19:20:46 juju-e4d256-prod-github-runner-207 kernel: [50220.544566] show_stack+0x52/0x5c Aug 22 19:20:46 juju-e4d256-prod-github-runner-207 kernel: [50220.545331] dump_stack_lvl+0x4a/0x63 Aug 22 19:20:46 juju-e4d256-prod-github-runner-207 kernel: [50220.546087] dump_stack+0x10/0x16 Aug 22 19:20:46 juju-e4d256-prod-github-runner-207 kernel: [50220.546832] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 19:20:46 juju-e4d256-prod-github-runner-207 kernel: [50220.547612] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 19:20:46 juju-e4d256-prod-github-runner-207 kernel: [50220.548390] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 19:20:46 juju-e4d256-prod-github-runner-207 kernel: [50220.549219] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 19:20:46 juju-e4d256-prod-github-runner-207 kernel: [50220.550057] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 19:20:46 juju-e4d256-prod-github-runner-207 kernel: [50220.550879] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 19:20:46 juju-e4d256-prod-github-runner-207 kernel: [50220.551656] print_cpu_stall.cold+0x2f/0xe2 Aug 22 19:20:46 juju-e4d256-prod-github-runner-207 kernel: [50220.552433] ? timekeeping_update+0xf7/0x150 Aug 22 19:20:46 juju-e4d256-prod-github-runner-207 kernel: [50220.553211] check_cpu_stall+0x109/0x270 Aug 22 19:20:46 juju-e4d256-prod-github-runner-207 kernel: [50220.553963] rcu_sched_clock_irq+0x9a/0x250 Aug 22 19:20:46 juju-e4d256-prod-github-runner-207 kernel: [50220.554735] update_process_times+0x94/0xd0 Aug 22 19:20:46 juju-e4d256-prod-github-runner-207 kernel: [50220.555508] tick_sched_handle+0x29/0x70 Aug 22 19:20:46 juju-e4d256-prod-github-runner-207 kernel: [50220.556252] tick_sched_timer+0x8c/0xc0 Aug 22 19:20:46 juju-e4d256-prod-github-runner-207 kernel: [50220.556988] ? tick_nohz_handler+0xb0/0xb0 Aug 22 19:20:46 juju-e4d256-prod-github-runner-207 kernel: [50220.557741] __hrtimer_run_queues+0x107/0x230 Aug 22 19:20:46 juju-e4d256-prod-github-runner-207 kernel: [50220.558511] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 19:20:46 juju-e4d256-prod-github-runner-207 kernel: [50220.559303] hrtimer_interrupt+0x101/0x220 Aug 22 19:20:46 juju-e4d256-prod-github-runner-207 kernel: [50220.560062] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 19:20:46 juju-e4d256-prod-github-runner-207 kernel: [50220.560872] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 19:20:46 juju-e4d256-prod-github-runner-207 kernel: [50220.561672] Aug 22 19:20:46 juju-e4d256-prod-github-runner-207 kernel: [50220.562305] Aug 22 19:20:46 juju-e4d256-prod-github-runner-207 kernel: [50220.562945] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 19:20:46 juju-e4d256-prod-github-runner-207 kernel: [50220.563763] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:20:46 juju-e4d256-prod-github-runner-207 kernel: [50220.564644] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 19:20:46 juju-e4d256-prod-github-runner-207 kernel: [50220.566904] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 19:20:46 juju-e4d256-prod-github-runner-207 kernel: [50220.567792] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 19:20:46 juju-e4d256-prod-github-runner-207 kernel: [50220.568785] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 19:20:46 juju-e4d256-prod-github-runner-207 kernel: [50220.569759] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 19:20:46 juju-e4d256-prod-github-runner-207 kernel: [50220.570732] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 19:20:46 juju-e4d256-prod-github-runner-207 kernel: [50220.571695] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 19:20:46 juju-e4d256-prod-github-runner-207 kernel: [50220.572648] ? _raw_spin_lock+0x22/0x30 Aug 22 19:20:46 juju-e4d256-prod-github-runner-207 kernel: [50220.573414] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:20:46 juju-e4d256-prod-github-runner-207 kernel: [50220.574282] direct_page_fault+0x206/0x310 [kvm] Aug 22 19:20:46 juju-e4d256-prod-github-runner-207 kernel: [50220.575139] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 19:20:46 juju-e4d256-prod-github-runner-207 kernel: [50220.575967] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 19:20:46 juju-e4d256-prod-github-runner-207 kernel: [50220.576804] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 19:20:46 juju-e4d256-prod-github-runner-207 kernel: [50220.577634] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 19:20:46 juju-e4d256-prod-github-runner-207 kernel: [50220.578417] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 19:20:46 juju-e4d256-prod-github-runner-207 kernel: [50220.579251] handle_exit+0x98/0x230 [kvm_amd] Aug 22 19:20:46 juju-e4d256-prod-github-runner-207 kernel: [50220.580008] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 19:20:46 juju-e4d256-prod-github-runner-207 kernel: [50220.580789] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 19:20:46 juju-e4d256-prod-github-runner-207 kernel: [50220.581590] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 19:20:46 juju-e4d256-prod-github-runner-207 kernel: [50220.582374] vcpu_run+0x62/0x2c0 [kvm] Aug 22 19:20:46 juju-e4d256-prod-github-runner-207 kernel: [50220.583098] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 19:20:46 juju-e4d256-prod-github-runner-207 kernel: [50220.583830] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 19:20:46 juju-e4d256-prod-github-runner-207 kernel: [50220.584635] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 19:20:46 juju-e4d256-prod-github-runner-207 kernel: [50220.585394] ? __seccomp_filter+0x4a/0x4a0 Aug 22 19:20:46 juju-e4d256-prod-github-runner-207 kernel: [50220.586113] ? __fget_files+0x86/0xc0 Aug 22 19:20:46 juju-e4d256-prod-github-runner-207 kernel: [50220.586813] __x64_sys_ioctl+0x95/0xd0 Aug 22 19:20:46 juju-e4d256-prod-github-runner-207 kernel: [50220.587524] do_syscall_64+0x5c/0xc0 Aug 22 19:20:46 juju-e4d256-prod-github-runner-207 kernel: [50220.588215] ? do_futex+0x162/0x1f0 Aug 22 19:20:46 juju-e4d256-prod-github-runner-207 kernel: [50220.588884] ? __x64_sys_futex+0x78/0x1e0 Aug 22 19:20:46 juju-e4d256-prod-github-runner-207 kernel: [50220.589586] ? __secure_computing+0xa9/0x120 Aug 22 19:20:46 juju-e4d256-prod-github-runner-207 kernel: [50220.590299] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 19:20:46 juju-e4d256-prod-github-runner-207 kernel: [50220.591103] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:20:46 juju-e4d256-prod-github-runner-207 kernel: [50220.591858] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:20:46 juju-e4d256-prod-github-runner-207 kernel: [50220.592612] ? do_syscall_64+0x69/0xc0 Aug 22 19:20:46 juju-e4d256-prod-github-runner-207 kernel: [50220.593300] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:20:46 juju-e4d256-prod-github-runner-207 kernel: [50220.594055] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:20:46 juju-e4d256-prod-github-runner-207 kernel: [50220.594814] ? do_syscall_64+0x69/0xc0 Aug 22 19:20:46 juju-e4d256-prod-github-runner-207 kernel: [50220.595506] ? do_syscall_64+0x69/0xc0 Aug 22 19:20:46 juju-e4d256-prod-github-runner-207 kernel: [50220.596190] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 19:20:46 juju-e4d256-prod-github-runner-207 kernel: [50220.596957] RIP: 0033:0x7faa5d0edaff Aug 22 19:20:46 juju-e4d256-prod-github-runner-207 kernel: [50220.597659] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 19:20:46 juju-e4d256-prod-github-runner-207 kernel: [50220.599770] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 19:20:46 juju-e4d256-prod-github-runner-207 kernel: [50220.600754] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 19:20:46 juju-e4d256-prod-github-runner-207 kernel: [50220.601751] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 19:20:46 juju-e4d256-prod-github-runner-207 kernel: [50220.602714] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 19:20:46 juju-e4d256-prod-github-runner-207 kernel: [50220.603660] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 19:20:46 juju-e4d256-prod-github-runner-207 kernel: [50220.604582] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 19:20:46 juju-e4d256-prod-github-runner-207 kernel: [50220.605501] Aug 22 19:21:10 juju-e4d256-prod-github-runner-207 kernel: [50244.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 46685s! [qemu-system-x86:6715] Aug 22 19:21:10 juju-e4d256-prod-github-runner-207 kernel: [50244.543138] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 19:21:10 juju-e4d256-prod-github-runner-207 kernel: [50244.543432] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 19:21:10 juju-e4d256-prod-github-runner-207 kernel: [50244.555914] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 19:21:10 juju-e4d256-prod-github-runner-207 kernel: [50244.557180] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 19:21:10 juju-e4d256-prod-github-runner-207 kernel: [50244.558422] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:21:10 juju-e4d256-prod-github-runner-207 kernel: [50244.559513] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 19:21:10 juju-e4d256-prod-github-runner-207 kernel: [50244.562065] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 19:21:10 juju-e4d256-prod-github-runner-207 kernel: [50244.563168] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 19:21:10 juju-e4d256-prod-github-runner-207 kernel: [50244.564335] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 19:21:10 juju-e4d256-prod-github-runner-207 kernel: [50244.565494] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 19:21:10 juju-e4d256-prod-github-runner-207 kernel: [50244.566724] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 19:21:10 juju-e4d256-prod-github-runner-207 kernel: [50244.567901] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 19:21:10 juju-e4d256-prod-github-runner-207 kernel: [50244.569065] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 19:21:10 juju-e4d256-prod-github-runner-207 kernel: [50244.570312] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 19:21:10 juju-e4d256-prod-github-runner-207 kernel: [50244.571457] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 19:21:10 juju-e4d256-prod-github-runner-207 kernel: [50244.572646] Call Trace: Aug 22 19:21:10 juju-e4d256-prod-github-runner-207 kernel: [50244.573557] Aug 22 19:21:10 juju-e4d256-prod-github-runner-207 kernel: [50244.574492] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:21:10 juju-e4d256-prod-github-runner-207 kernel: [50244.575546] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:21:10 juju-e4d256-prod-github-runner-207 kernel: [50244.576573] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:21:10 juju-e4d256-prod-github-runner-207 kernel: [50244.577646] ? show_regs.part.0+0x23/0x29 Aug 22 19:21:10 juju-e4d256-prod-github-runner-207 kernel: [50244.578696] ? show_regs.cold+0x8/0xd Aug 22 19:21:10 juju-e4d256-prod-github-runner-207 kernel: [50244.579673] ? watchdog_timer_fn+0x1be/0x220 Aug 22 19:21:10 juju-e4d256-prod-github-runner-207 kernel: [50244.580680] ? lockup_detector_update_enable+0x60/0x60 Aug 22 19:21:10 juju-e4d256-prod-github-runner-207 kernel: [50244.581747] ? __hrtimer_run_queues+0x107/0x230 Aug 22 19:21:10 juju-e4d256-prod-github-runner-207 kernel: [50244.582789] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 19:21:10 juju-e4d256-prod-github-runner-207 kernel: [50244.583817] ? hrtimer_interrupt+0x101/0x220 Aug 22 19:21:10 juju-e4d256-prod-github-runner-207 kernel: [50244.584831] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 19:21:10 juju-e4d256-prod-github-runner-207 kernel: [50244.585897] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 19:21:10 juju-e4d256-prod-github-runner-207 kernel: [50244.586964] Aug 22 19:21:10 juju-e4d256-prod-github-runner-207 kernel: [50244.587819] Aug 22 19:21:10 juju-e4d256-prod-github-runner-207 kernel: [50244.588656] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 19:21:10 juju-e4d256-prod-github-runner-207 kernel: [50244.589689] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:21:10 juju-e4d256-prod-github-runner-207 kernel: [50244.590750] ? _raw_spin_lock+0x22/0x30 Aug 22 19:21:10 juju-e4d256-prod-github-runner-207 kernel: [50244.591702] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:21:10 juju-e4d256-prod-github-runner-207 kernel: [50244.592720] direct_page_fault+0x206/0x310 [kvm] Aug 22 19:21:10 juju-e4d256-prod-github-runner-207 kernel: [50244.593750] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 19:21:10 juju-e4d256-prod-github-runner-207 kernel: [50244.594777] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 19:21:10 juju-e4d256-prod-github-runner-207 kernel: [50244.595780] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 19:21:10 juju-e4d256-prod-github-runner-207 kernel: [50244.596750] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 19:21:10 juju-e4d256-prod-github-runner-207 kernel: [50244.597695] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 19:21:10 juju-e4d256-prod-github-runner-207 kernel: [50244.598691] handle_exit+0x98/0x230 [kvm_amd] Aug 22 19:21:10 juju-e4d256-prod-github-runner-207 kernel: [50244.599589] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 19:21:10 juju-e4d256-prod-github-runner-207 kernel: [50244.600502] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 19:21:10 juju-e4d256-prod-github-runner-207 kernel: [50244.601433] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 19:21:10 juju-e4d256-prod-github-runner-207 kernel: [50244.602337] vcpu_run+0x62/0x2c0 [kvm] Aug 22 19:21:10 juju-e4d256-prod-github-runner-207 kernel: [50244.603165] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 19:21:10 juju-e4d256-prod-github-runner-207 kernel: [50244.603972] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 19:21:10 juju-e4d256-prod-github-runner-207 kernel: [50244.604824] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 19:21:10 juju-e4d256-prod-github-runner-207 kernel: [50244.605625] ? __seccomp_filter+0x4a/0x4a0 Aug 22 19:21:10 juju-e4d256-prod-github-runner-207 kernel: [50244.606368] ? __fget_files+0x86/0xc0 Aug 22 19:21:10 juju-e4d256-prod-github-runner-207 kernel: [50244.607084] __x64_sys_ioctl+0x95/0xd0 Aug 22 19:21:10 juju-e4d256-prod-github-runner-207 kernel: [50244.607779] do_syscall_64+0x5c/0xc0 Aug 22 19:21:10 juju-e4d256-prod-github-runner-207 kernel: [50244.608444] ? do_futex+0x162/0x1f0 Aug 22 19:21:10 juju-e4d256-prod-github-runner-207 kernel: [50244.609093] ? __x64_sys_futex+0x78/0x1e0 Aug 22 19:21:10 juju-e4d256-prod-github-runner-207 kernel: [50244.609768] ? __secure_computing+0xa9/0x120 Aug 22 19:21:10 juju-e4d256-prod-github-runner-207 kernel: [50244.610472] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 19:21:10 juju-e4d256-prod-github-runner-207 kernel: [50244.611233] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:21:10 juju-e4d256-prod-github-runner-207 kernel: [50244.611962] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:21:10 juju-e4d256-prod-github-runner-207 kernel: [50244.612681] ? do_syscall_64+0x69/0xc0 Aug 22 19:21:10 juju-e4d256-prod-github-runner-207 kernel: [50244.613333] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:21:10 juju-e4d256-prod-github-runner-207 kernel: [50244.614036] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:21:10 juju-e4d256-prod-github-runner-207 kernel: [50244.614748] ? do_syscall_64+0x69/0xc0 Aug 22 19:21:10 juju-e4d256-prod-github-runner-207 kernel: [50244.615391] ? do_syscall_64+0x69/0xc0 Aug 22 19:21:10 juju-e4d256-prod-github-runner-207 kernel: [50244.616038] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 19:21:10 juju-e4d256-prod-github-runner-207 kernel: [50244.616744] RIP: 0033:0x7faa5d0edaff Aug 22 19:21:10 juju-e4d256-prod-github-runner-207 kernel: [50244.617369] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 19:21:10 juju-e4d256-prod-github-runner-207 kernel: [50244.619392] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 19:21:10 juju-e4d256-prod-github-runner-207 kernel: [50244.620303] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 19:21:10 juju-e4d256-prod-github-runner-207 kernel: [50244.621195] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 19:21:10 juju-e4d256-prod-github-runner-207 kernel: [50244.622085] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 19:21:10 juju-e4d256-prod-github-runner-207 kernel: [50244.622991] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 19:21:10 juju-e4d256-prod-github-runner-207 kernel: [50244.623884] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 19:21:10 juju-e4d256-prod-github-runner-207 kernel: [50244.624775] Aug 22 19:21:38 juju-e4d256-prod-github-runner-207 kernel: [50272.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 46711s! [qemu-system-x86:6715] Aug 22 19:21:38 juju-e4d256-prod-github-runner-207 kernel: [50272.543089] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 19:21:38 juju-e4d256-prod-github-runner-207 kernel: [50272.543156] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 19:21:38 juju-e4d256-prod-github-runner-207 kernel: [50272.555226] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 19:21:38 juju-e4d256-prod-github-runner-207 kernel: [50272.556494] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 19:21:38 juju-e4d256-prod-github-runner-207 kernel: [50272.557752] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:21:38 juju-e4d256-prod-github-runner-207 kernel: [50272.558846] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 19:21:38 juju-e4d256-prod-github-runner-207 kernel: [50272.561395] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 19:21:38 juju-e4d256-prod-github-runner-207 kernel: [50272.562455] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 19:21:38 juju-e4d256-prod-github-runner-207 kernel: [50272.563617] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 19:21:38 juju-e4d256-prod-github-runner-207 kernel: [50272.564780] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 19:21:38 juju-e4d256-prod-github-runner-207 kernel: [50272.565938] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 19:21:38 juju-e4d256-prod-github-runner-207 kernel: [50272.567126] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 19:21:38 juju-e4d256-prod-github-runner-207 kernel: [50272.568293] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 19:21:38 juju-e4d256-prod-github-runner-207 kernel: [50272.569525] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 19:21:38 juju-e4d256-prod-github-runner-207 kernel: [50272.570637] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 19:21:38 juju-e4d256-prod-github-runner-207 kernel: [50272.571837] Call Trace: Aug 22 19:21:38 juju-e4d256-prod-github-runner-207 kernel: [50272.572748] Aug 22 19:21:38 juju-e4d256-prod-github-runner-207 kernel: [50272.573631] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:21:38 juju-e4d256-prod-github-runner-207 kernel: [50272.574680] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:21:38 juju-e4d256-prod-github-runner-207 kernel: [50272.575708] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:21:38 juju-e4d256-prod-github-runner-207 kernel: [50272.576803] ? show_regs.part.0+0x23/0x29 Aug 22 19:21:38 juju-e4d256-prod-github-runner-207 kernel: [50272.577903] ? show_regs.cold+0x8/0xd Aug 22 19:21:38 juju-e4d256-prod-github-runner-207 kernel: [50272.578914] ? watchdog_timer_fn+0x1be/0x220 Aug 22 19:21:38 juju-e4d256-prod-github-runner-207 kernel: [50272.579931] ? lockup_detector_update_enable+0x60/0x60 Aug 22 19:21:38 juju-e4d256-prod-github-runner-207 kernel: [50272.580994] ? __hrtimer_run_queues+0x107/0x230 Aug 22 19:21:38 juju-e4d256-prod-github-runner-207 kernel: [50272.582021] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 19:21:38 juju-e4d256-prod-github-runner-207 kernel: [50272.583075] ? hrtimer_interrupt+0x101/0x220 Aug 22 19:21:38 juju-e4d256-prod-github-runner-207 kernel: [50272.584094] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 19:21:38 juju-e4d256-prod-github-runner-207 kernel: [50272.585165] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 19:21:38 juju-e4d256-prod-github-runner-207 kernel: [50272.586234] Aug 22 19:21:38 juju-e4d256-prod-github-runner-207 kernel: [50272.587093] Aug 22 19:21:38 juju-e4d256-prod-github-runner-207 kernel: [50272.587932] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 19:21:38 juju-e4d256-prod-github-runner-207 kernel: [50272.588965] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:21:38 juju-e4d256-prod-github-runner-207 kernel: [50272.590005] ? _raw_spin_lock+0x22/0x30 Aug 22 19:21:38 juju-e4d256-prod-github-runner-207 kernel: [50272.590965] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:21:38 juju-e4d256-prod-github-runner-207 kernel: [50272.591985] direct_page_fault+0x206/0x310 [kvm] Aug 22 19:21:38 juju-e4d256-prod-github-runner-207 kernel: [50272.593008] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 19:21:38 juju-e4d256-prod-github-runner-207 kernel: [50272.594016] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 19:21:38 juju-e4d256-prod-github-runner-207 kernel: [50272.595031] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 19:21:38 juju-e4d256-prod-github-runner-207 kernel: [50272.596004] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 19:21:38 juju-e4d256-prod-github-runner-207 kernel: [50272.596950] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 19:21:38 juju-e4d256-prod-github-runner-207 kernel: [50272.597927] handle_exit+0x98/0x230 [kvm_amd] Aug 22 19:21:38 juju-e4d256-prod-github-runner-207 kernel: [50272.598834] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 19:21:38 juju-e4d256-prod-github-runner-207 kernel: [50272.599746] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 19:21:38 juju-e4d256-prod-github-runner-207 kernel: [50272.600675] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 19:21:38 juju-e4d256-prod-github-runner-207 kernel: [50272.601596] vcpu_run+0x62/0x2c0 [kvm] Aug 22 19:21:38 juju-e4d256-prod-github-runner-207 kernel: [50272.602433] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 19:21:38 juju-e4d256-prod-github-runner-207 kernel: [50272.603240] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 19:21:38 juju-e4d256-prod-github-runner-207 kernel: [50272.604092] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 19:21:38 juju-e4d256-prod-github-runner-207 kernel: [50272.604888] ? __seccomp_filter+0x4a/0x4a0 Aug 22 19:21:38 juju-e4d256-prod-github-runner-207 kernel: [50272.605635] ? __fget_files+0x86/0xc0 Aug 22 19:21:38 juju-e4d256-prod-github-runner-207 kernel: [50272.606360] __x64_sys_ioctl+0x95/0xd0 Aug 22 19:21:38 juju-e4d256-prod-github-runner-207 kernel: [50272.607052] do_syscall_64+0x5c/0xc0 Aug 22 19:21:38 juju-e4d256-prod-github-runner-207 kernel: [50272.607720] ? do_futex+0x162/0x1f0 Aug 22 19:21:38 juju-e4d256-prod-github-runner-207 kernel: [50272.608371] ? __x64_sys_futex+0x78/0x1e0 Aug 22 19:21:38 juju-e4d256-prod-github-runner-207 kernel: [50272.609057] ? __secure_computing+0xa9/0x120 Aug 22 19:21:38 juju-e4d256-prod-github-runner-207 kernel: [50272.609759] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 19:21:38 juju-e4d256-prod-github-runner-207 kernel: [50272.610547] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:21:38 juju-e4d256-prod-github-runner-207 kernel: [50272.611268] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:21:38 juju-e4d256-prod-github-runner-207 kernel: [50272.611984] ? do_syscall_64+0x69/0xc0 Aug 22 19:21:38 juju-e4d256-prod-github-runner-207 kernel: [50272.612629] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:21:38 juju-e4d256-prod-github-runner-207 kernel: [50272.613331] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:21:38 juju-e4d256-prod-github-runner-207 kernel: [50272.614025] ? do_syscall_64+0x69/0xc0 Aug 22 19:21:38 juju-e4d256-prod-github-runner-207 kernel: [50272.614667] ? do_syscall_64+0x69/0xc0 Aug 22 19:21:38 juju-e4d256-prod-github-runner-207 kernel: [50272.615295] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 19:21:38 juju-e4d256-prod-github-runner-207 kernel: [50272.616002] RIP: 0033:0x7faa5d0edaff Aug 22 19:21:38 juju-e4d256-prod-github-runner-207 kernel: [50272.616626] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 19:21:38 juju-e4d256-prod-github-runner-207 kernel: [50272.618652] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 19:21:38 juju-e4d256-prod-github-runner-207 kernel: [50272.619567] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 19:21:38 juju-e4d256-prod-github-runner-207 kernel: [50272.620459] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 19:21:38 juju-e4d256-prod-github-runner-207 kernel: [50272.621355] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 19:21:38 juju-e4d256-prod-github-runner-207 kernel: [50272.622260] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 19:21:38 juju-e4d256-prod-github-runner-207 kernel: [50272.623151] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 19:21:38 juju-e4d256-prod-github-runner-207 kernel: [50272.624050] Aug 22 19:22:06 juju-e4d256-prod-github-runner-207 kernel: [50300.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 46738s! [qemu-system-x86:6715] Aug 22 19:22:06 juju-e4d256-prod-github-runner-207 kernel: [50300.543282] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 19:22:06 juju-e4d256-prod-github-runner-207 kernel: [50300.543358] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 19:22:06 juju-e4d256-prod-github-runner-207 kernel: [50300.557508] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 19:22:06 juju-e4d256-prod-github-runner-207 kernel: [50300.558803] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 19:22:06 juju-e4d256-prod-github-runner-207 kernel: [50300.560034] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:22:06 juju-e4d256-prod-github-runner-207 kernel: [50300.561110] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 19:22:06 juju-e4d256-prod-github-runner-207 kernel: [50300.563680] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 19:22:06 juju-e4d256-prod-github-runner-207 kernel: [50300.564765] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 19:22:06 juju-e4d256-prod-github-runner-207 kernel: [50300.565952] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 19:22:06 juju-e4d256-prod-github-runner-207 kernel: [50300.567113] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 19:22:06 juju-e4d256-prod-github-runner-207 kernel: [50300.568280] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 19:22:06 juju-e4d256-prod-github-runner-207 kernel: [50300.569472] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 19:22:06 juju-e4d256-prod-github-runner-207 kernel: [50300.570737] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 19:22:06 juju-e4d256-prod-github-runner-207 kernel: [50300.572027] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 19:22:06 juju-e4d256-prod-github-runner-207 kernel: [50300.573139] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 19:22:06 juju-e4d256-prod-github-runner-207 kernel: [50300.574386] Call Trace: Aug 22 19:22:06 juju-e4d256-prod-github-runner-207 kernel: [50300.575324] Aug 22 19:22:06 juju-e4d256-prod-github-runner-207 kernel: [50300.576220] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:22:06 juju-e4d256-prod-github-runner-207 kernel: [50300.577271] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:22:06 juju-e4d256-prod-github-runner-207 kernel: [50300.578330] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:22:06 juju-e4d256-prod-github-runner-207 kernel: [50300.579460] ? show_regs.part.0+0x23/0x29 Aug 22 19:22:06 juju-e4d256-prod-github-runner-207 kernel: [50300.580475] ? show_regs.cold+0x8/0xd Aug 22 19:22:06 juju-e4d256-prod-github-runner-207 kernel: [50300.581468] ? watchdog_timer_fn+0x1be/0x220 Aug 22 19:22:06 juju-e4d256-prod-github-runner-207 kernel: [50300.582503] ? lockup_detector_update_enable+0x60/0x60 Aug 22 19:22:06 juju-e4d256-prod-github-runner-207 kernel: [50300.583576] ? __hrtimer_run_queues+0x107/0x230 Aug 22 19:22:06 juju-e4d256-prod-github-runner-207 kernel: [50300.584599] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 19:22:06 juju-e4d256-prod-github-runner-207 kernel: [50300.585680] ? hrtimer_interrupt+0x101/0x220 Aug 22 19:22:06 juju-e4d256-prod-github-runner-207 kernel: [50300.586717] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 19:22:06 juju-e4d256-prod-github-runner-207 kernel: [50300.587788] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 19:22:06 juju-e4d256-prod-github-runner-207 kernel: [50300.588833] Aug 22 19:22:06 juju-e4d256-prod-github-runner-207 kernel: [50300.589705] Aug 22 19:22:06 juju-e4d256-prod-github-runner-207 kernel: [50300.590542] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 19:22:06 juju-e4d256-prod-github-runner-207 kernel: [50300.591582] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:22:06 juju-e4d256-prod-github-runner-207 kernel: [50300.592655] ? _raw_spin_lock+0x22/0x30 Aug 22 19:22:06 juju-e4d256-prod-github-runner-207 kernel: [50300.593616] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:22:06 juju-e4d256-prod-github-runner-207 kernel: [50300.594659] direct_page_fault+0x206/0x310 [kvm] Aug 22 19:22:06 juju-e4d256-prod-github-runner-207 kernel: [50300.595691] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 19:22:06 juju-e4d256-prod-github-runner-207 kernel: [50300.596705] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 19:22:06 juju-e4d256-prod-github-runner-207 kernel: [50300.598006] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 19:22:06 juju-e4d256-prod-github-runner-207 kernel: [50300.599148] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 19:22:06 juju-e4d256-prod-github-runner-207 kernel: [50300.600256] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 19:22:06 juju-e4d256-prod-github-runner-207 kernel: [50300.601234] handle_exit+0x98/0x230 [kvm_amd] Aug 22 19:22:06 juju-e4d256-prod-github-runner-207 kernel: [50300.602139] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 19:22:06 juju-e4d256-prod-github-runner-207 kernel: [50300.603062] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 19:22:06 juju-e4d256-prod-github-runner-207 kernel: [50300.603986] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 19:22:06 juju-e4d256-prod-github-runner-207 kernel: [50300.604889] vcpu_run+0x62/0x2c0 [kvm] Aug 22 19:22:06 juju-e4d256-prod-github-runner-207 kernel: [50300.605731] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 19:22:06 juju-e4d256-prod-github-runner-207 kernel: [50300.606542] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 19:22:06 juju-e4d256-prod-github-runner-207 kernel: [50300.607429] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 19:22:06 juju-e4d256-prod-github-runner-207 kernel: [50300.608240] ? __seccomp_filter+0x4a/0x4a0 Aug 22 19:22:06 juju-e4d256-prod-github-runner-207 kernel: [50300.608984] ? __fget_files+0x86/0xc0 Aug 22 19:22:06 juju-e4d256-prod-github-runner-207 kernel: [50300.609720] __x64_sys_ioctl+0x95/0xd0 Aug 22 19:22:06 juju-e4d256-prod-github-runner-207 kernel: [50300.610414] do_syscall_64+0x5c/0xc0 Aug 22 19:22:06 juju-e4d256-prod-github-runner-207 kernel: [50300.611087] ? do_futex+0x162/0x1f0 Aug 22 19:22:06 juju-e4d256-prod-github-runner-207 kernel: [50300.611737] ? __x64_sys_futex+0x78/0x1e0 Aug 22 19:22:06 juju-e4d256-prod-github-runner-207 kernel: [50300.612444] ? __secure_computing+0xa9/0x120 Aug 22 19:22:06 juju-e4d256-prod-github-runner-207 kernel: [50300.613152] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 19:22:06 juju-e4d256-prod-github-runner-207 kernel: [50300.613926] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:22:06 juju-e4d256-prod-github-runner-207 kernel: [50300.614660] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:22:06 juju-e4d256-prod-github-runner-207 kernel: [50300.615377] ? do_syscall_64+0x69/0xc0 Aug 22 19:22:06 juju-e4d256-prod-github-runner-207 kernel: [50300.616023] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:22:06 juju-e4d256-prod-github-runner-207 kernel: [50300.616756] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:22:06 juju-e4d256-prod-github-runner-207 kernel: [50300.617469] ? do_syscall_64+0x69/0xc0 Aug 22 19:22:06 juju-e4d256-prod-github-runner-207 kernel: [50300.618108] ? do_syscall_64+0x69/0xc0 Aug 22 19:22:06 juju-e4d256-prod-github-runner-207 kernel: [50300.618732] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 19:22:06 juju-e4d256-prod-github-runner-207 kernel: [50300.619448] RIP: 0033:0x7faa5d0edaff Aug 22 19:22:06 juju-e4d256-prod-github-runner-207 kernel: [50300.620073] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 19:22:06 juju-e4d256-prod-github-runner-207 kernel: [50300.622095] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 19:22:06 juju-e4d256-prod-github-runner-207 kernel: [50300.623012] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 19:22:06 juju-e4d256-prod-github-runner-207 kernel: [50300.623902] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 19:22:06 juju-e4d256-prod-github-runner-207 kernel: [50300.624793] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 19:22:06 juju-e4d256-prod-github-runner-207 kernel: [50300.625737] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 19:22:06 juju-e4d256-prod-github-runner-207 kernel: [50300.626636] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 19:22:06 juju-e4d256-prod-github-runner-207 kernel: [50300.627554] Aug 22 19:22:34 juju-e4d256-prod-github-runner-207 kernel: [50328.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 46764s! [qemu-system-x86:6715] Aug 22 19:22:34 juju-e4d256-prod-github-runner-207 kernel: [50328.543727] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 19:22:34 juju-e4d256-prod-github-runner-207 kernel: [50328.543978] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 19:22:34 juju-e4d256-prod-github-runner-207 kernel: [50328.556269] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 19:22:34 juju-e4d256-prod-github-runner-207 kernel: [50328.557569] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 19:22:34 juju-e4d256-prod-github-runner-207 kernel: [50328.558810] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:22:34 juju-e4d256-prod-github-runner-207 kernel: [50328.559874] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 19:22:34 juju-e4d256-prod-github-runner-207 kernel: [50328.562516] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 19:22:34 juju-e4d256-prod-github-runner-207 kernel: [50328.563666] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 19:22:34 juju-e4d256-prod-github-runner-207 kernel: [50328.564834] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 19:22:34 juju-e4d256-prod-github-runner-207 kernel: [50328.566015] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 19:22:34 juju-e4d256-prod-github-runner-207 kernel: [50328.567190] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 19:22:34 juju-e4d256-prod-github-runner-207 kernel: [50328.568365] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 19:22:34 juju-e4d256-prod-github-runner-207 kernel: [50328.569546] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 19:22:34 juju-e4d256-prod-github-runner-207 kernel: [50328.570797] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 19:22:34 juju-e4d256-prod-github-runner-207 kernel: [50328.571906] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 19:22:34 juju-e4d256-prod-github-runner-207 kernel: [50328.573115] Call Trace: Aug 22 19:22:34 juju-e4d256-prod-github-runner-207 kernel: [50328.574138] Aug 22 19:22:34 juju-e4d256-prod-github-runner-207 kernel: [50328.575099] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:22:34 juju-e4d256-prod-github-runner-207 kernel: [50328.576227] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:22:34 juju-e4d256-prod-github-runner-207 kernel: [50328.577376] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:22:34 juju-e4d256-prod-github-runner-207 kernel: [50328.578573] ? show_regs.part.0+0x23/0x29 Aug 22 19:22:34 juju-e4d256-prod-github-runner-207 kernel: [50328.579664] ? show_regs.cold+0x8/0xd Aug 22 19:22:34 juju-e4d256-prod-github-runner-207 kernel: [50328.580726] ? watchdog_timer_fn+0x1be/0x220 Aug 22 19:22:34 juju-e4d256-prod-github-runner-207 kernel: [50328.581823] ? lockup_detector_update_enable+0x60/0x60 Aug 22 19:22:34 juju-e4d256-prod-github-runner-207 kernel: [50328.582985] ? __hrtimer_run_queues+0x107/0x230 Aug 22 19:22:34 juju-e4d256-prod-github-runner-207 kernel: [50328.584100] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 19:22:34 juju-e4d256-prod-github-runner-207 kernel: [50328.585212] ? hrtimer_interrupt+0x101/0x220 Aug 22 19:22:34 juju-e4d256-prod-github-runner-207 kernel: [50328.586336] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 19:22:34 juju-e4d256-prod-github-runner-207 kernel: [50328.587512] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 19:22:34 juju-e4d256-prod-github-runner-207 kernel: [50328.588657] Aug 22 19:22:34 juju-e4d256-prod-github-runner-207 kernel: [50328.589578] Aug 22 19:22:34 juju-e4d256-prod-github-runner-207 kernel: [50328.590462] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 19:22:34 juju-e4d256-prod-github-runner-207 kernel: [50328.591601] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:22:34 juju-e4d256-prod-github-runner-207 kernel: [50328.592741] ? _raw_spin_lock+0x22/0x30 Aug 22 19:22:34 juju-e4d256-prod-github-runner-207 kernel: [50328.593778] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:22:34 juju-e4d256-prod-github-runner-207 kernel: [50328.594889] direct_page_fault+0x206/0x310 [kvm] Aug 22 19:22:34 juju-e4d256-prod-github-runner-207 kernel: [50328.596007] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 19:22:34 juju-e4d256-prod-github-runner-207 kernel: [50328.597103] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 19:22:34 juju-e4d256-prod-github-runner-207 kernel: [50328.598216] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 19:22:34 juju-e4d256-prod-github-runner-207 kernel: [50328.599308] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 19:22:34 juju-e4d256-prod-github-runner-207 kernel: [50328.600344] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 19:22:34 juju-e4d256-prod-github-runner-207 kernel: [50328.601448] handle_exit+0x98/0x230 [kvm_amd] Aug 22 19:22:34 juju-e4d256-prod-github-runner-207 kernel: [50328.602429] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 19:22:34 juju-e4d256-prod-github-runner-207 kernel: [50328.603428] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 19:22:34 juju-e4d256-prod-github-runner-207 kernel: [50328.604455] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 19:22:34 juju-e4d256-prod-github-runner-207 kernel: [50328.605465] vcpu_run+0x62/0x2c0 [kvm] Aug 22 19:22:34 juju-e4d256-prod-github-runner-207 kernel: [50328.606352] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 19:22:34 juju-e4d256-prod-github-runner-207 kernel: [50328.607254] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 19:22:34 juju-e4d256-prod-github-runner-207 kernel: [50328.608203] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 19:22:34 juju-e4d256-prod-github-runner-207 kernel: [50328.609085] ? __seccomp_filter+0x4a/0x4a0 Aug 22 19:22:34 juju-e4d256-prod-github-runner-207 kernel: [50328.609924] ? __fget_files+0x86/0xc0 Aug 22 19:22:34 juju-e4d256-prod-github-runner-207 kernel: [50328.610709] __x64_sys_ioctl+0x95/0xd0 Aug 22 19:22:34 juju-e4d256-prod-github-runner-207 kernel: [50328.611476] do_syscall_64+0x5c/0xc0 Aug 22 19:22:34 juju-e4d256-prod-github-runner-207 kernel: [50328.612211] ? do_futex+0x162/0x1f0 Aug 22 19:22:34 juju-e4d256-prod-github-runner-207 kernel: [50328.612928] ? __x64_sys_futex+0x78/0x1e0 Aug 22 19:22:34 juju-e4d256-prod-github-runner-207 kernel: [50328.613705] ? __secure_computing+0xa9/0x120 Aug 22 19:22:34 juju-e4d256-prod-github-runner-207 kernel: [50328.614477] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 19:22:34 juju-e4d256-prod-github-runner-207 kernel: [50328.615340] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:22:34 juju-e4d256-prod-github-runner-207 kernel: [50328.616151] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:22:34 juju-e4d256-prod-github-runner-207 kernel: [50328.616966] ? do_syscall_64+0x69/0xc0 Aug 22 19:22:34 juju-e4d256-prod-github-runner-207 kernel: [50328.617708] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:22:34 juju-e4d256-prod-github-runner-207 kernel: [50328.618504] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:22:34 juju-e4d256-prod-github-runner-207 kernel: [50328.619288] ? do_syscall_64+0x69/0xc0 Aug 22 19:22:34 juju-e4d256-prod-github-runner-207 kernel: [50328.619995] ? do_syscall_64+0x69/0xc0 Aug 22 19:22:34 juju-e4d256-prod-github-runner-207 kernel: [50328.620691] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 19:22:34 juju-e4d256-prod-github-runner-207 kernel: [50328.621507] RIP: 0033:0x7faa5d0edaff Aug 22 19:22:34 juju-e4d256-prod-github-runner-207 kernel: [50328.622246] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 19:22:34 juju-e4d256-prod-github-runner-207 kernel: [50328.624588] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 19:22:34 juju-e4d256-prod-github-runner-207 kernel: [50328.625669] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 19:22:34 juju-e4d256-prod-github-runner-207 kernel: [50328.626699] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 19:22:34 juju-e4d256-prod-github-runner-207 kernel: [50328.627719] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 19:22:34 juju-e4d256-prod-github-runner-207 kernel: [50328.628742] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 19:22:34 juju-e4d256-prod-github-runner-207 kernel: [50328.629786] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 19:22:34 juju-e4d256-prod-github-runner-207 kernel: [50328.630820] Aug 22 19:23:02 juju-e4d256-prod-github-runner-207 kernel: [50356.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 46790s! [qemu-system-x86:6715] Aug 22 19:23:02 juju-e4d256-prod-github-runner-207 kernel: [50356.543107] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 19:23:02 juju-e4d256-prod-github-runner-207 kernel: [50356.543175] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 19:23:02 juju-e4d256-prod-github-runner-207 kernel: [50356.555275] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 19:23:02 juju-e4d256-prod-github-runner-207 kernel: [50356.556559] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 19:23:02 juju-e4d256-prod-github-runner-207 kernel: [50356.557810] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:23:02 juju-e4d256-prod-github-runner-207 kernel: [50356.558865] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 19:23:02 juju-e4d256-prod-github-runner-207 kernel: [50356.561471] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 19:23:02 juju-e4d256-prod-github-runner-207 kernel: [50356.562552] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 19:23:02 juju-e4d256-prod-github-runner-207 kernel: [50356.563734] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 19:23:02 juju-e4d256-prod-github-runner-207 kernel: [50356.564910] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 19:23:02 juju-e4d256-prod-github-runner-207 kernel: [50356.566085] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 19:23:02 juju-e4d256-prod-github-runner-207 kernel: [50356.567245] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 19:23:02 juju-e4d256-prod-github-runner-207 kernel: [50356.568408] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 19:23:02 juju-e4d256-prod-github-runner-207 kernel: [50356.569654] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 19:23:02 juju-e4d256-prod-github-runner-207 kernel: [50356.570751] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 19:23:02 juju-e4d256-prod-github-runner-207 kernel: [50356.571944] Call Trace: Aug 22 19:23:02 juju-e4d256-prod-github-runner-207 kernel: [50356.572860] Aug 22 19:23:02 juju-e4d256-prod-github-runner-207 kernel: [50356.573766] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:23:02 juju-e4d256-prod-github-runner-207 kernel: [50356.574800] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:23:02 juju-e4d256-prod-github-runner-207 kernel: [50356.575825] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:23:02 juju-e4d256-prod-github-runner-207 kernel: [50356.576899] ? show_regs.part.0+0x23/0x29 Aug 22 19:23:02 juju-e4d256-prod-github-runner-207 kernel: [50356.577909] ? show_regs.cold+0x8/0xd Aug 22 19:23:02 juju-e4d256-prod-github-runner-207 kernel: [50356.578883] ? watchdog_timer_fn+0x1be/0x220 Aug 22 19:23:02 juju-e4d256-prod-github-runner-207 kernel: [50356.579890] ? lockup_detector_update_enable+0x60/0x60 Aug 22 19:23:02 juju-e4d256-prod-github-runner-207 kernel: [50356.580957] ? __hrtimer_run_queues+0x107/0x230 Aug 22 19:23:02 juju-e4d256-prod-github-runner-207 kernel: [50356.581996] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 19:23:02 juju-e4d256-prod-github-runner-207 kernel: [50356.583018] ? hrtimer_interrupt+0x101/0x220 Aug 22 19:23:02 juju-e4d256-prod-github-runner-207 kernel: [50356.584036] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 19:23:02 juju-e4d256-prod-github-runner-207 kernel: [50356.585118] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 19:23:02 juju-e4d256-prod-github-runner-207 kernel: [50356.586164] Aug 22 19:23:02 juju-e4d256-prod-github-runner-207 kernel: [50356.587021] Aug 22 19:23:02 juju-e4d256-prod-github-runner-207 kernel: [50356.587858] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 19:23:02 juju-e4d256-prod-github-runner-207 kernel: [50356.588889] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:23:02 juju-e4d256-prod-github-runner-207 kernel: [50356.589982] ? _raw_spin_lock+0x22/0x30 Aug 22 19:23:02 juju-e4d256-prod-github-runner-207 kernel: [50356.590925] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:23:02 juju-e4d256-prod-github-runner-207 kernel: [50356.591944] direct_page_fault+0x206/0x310 [kvm] Aug 22 19:23:02 juju-e4d256-prod-github-runner-207 kernel: [50356.592968] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 19:23:02 juju-e4d256-prod-github-runner-207 kernel: [50356.594008] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 19:23:02 juju-e4d256-prod-github-runner-207 kernel: [50356.595014] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 19:23:02 juju-e4d256-prod-github-runner-207 kernel: [50356.595985] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 19:23:02 juju-e4d256-prod-github-runner-207 kernel: [50356.596932] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 19:23:02 juju-e4d256-prod-github-runner-207 kernel: [50356.597922] handle_exit+0x98/0x230 [kvm_amd] Aug 22 19:23:02 juju-e4d256-prod-github-runner-207 kernel: [50356.598814] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 19:23:02 juju-e4d256-prod-github-runner-207 kernel: [50356.599729] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 19:23:02 juju-e4d256-prod-github-runner-207 kernel: [50356.600659] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 19:23:02 juju-e4d256-prod-github-runner-207 kernel: [50356.601573] vcpu_run+0x62/0x2c0 [kvm] Aug 22 19:23:02 juju-e4d256-prod-github-runner-207 kernel: [50356.602388] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 19:23:02 juju-e4d256-prod-github-runner-207 kernel: [50356.603210] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 19:23:02 juju-e4d256-prod-github-runner-207 kernel: [50356.604066] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 19:23:02 juju-e4d256-prod-github-runner-207 kernel: [50356.604904] ? __seccomp_filter+0x4a/0x4a0 Aug 22 19:23:02 juju-e4d256-prod-github-runner-207 kernel: [50356.605662] ? __fget_files+0x86/0xc0 Aug 22 19:23:02 juju-e4d256-prod-github-runner-207 kernel: [50356.606367] __x64_sys_ioctl+0x95/0xd0 Aug 22 19:23:02 juju-e4d256-prod-github-runner-207 kernel: [50356.607067] do_syscall_64+0x5c/0xc0 Aug 22 19:23:02 juju-e4d256-prod-github-runner-207 kernel: [50356.607732] ? do_futex+0x162/0x1f0 Aug 22 19:23:02 juju-e4d256-prod-github-runner-207 kernel: [50356.608383] ? __x64_sys_futex+0x78/0x1e0 Aug 22 19:23:02 juju-e4d256-prod-github-runner-207 kernel: [50356.609077] ? __secure_computing+0xa9/0x120 Aug 22 19:23:02 juju-e4d256-prod-github-runner-207 kernel: [50356.609769] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 19:23:02 juju-e4d256-prod-github-runner-207 kernel: [50356.610534] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:23:02 juju-e4d256-prod-github-runner-207 kernel: [50356.611257] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:23:02 juju-e4d256-prod-github-runner-207 kernel: [50356.611978] ? do_syscall_64+0x69/0xc0 Aug 22 19:23:02 juju-e4d256-prod-github-runner-207 kernel: [50356.612623] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:23:02 juju-e4d256-prod-github-runner-207 kernel: [50356.613337] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:23:02 juju-e4d256-prod-github-runner-207 kernel: [50356.614035] ? do_syscall_64+0x69/0xc0 Aug 22 19:23:02 juju-e4d256-prod-github-runner-207 kernel: [50356.614659] ? do_syscall_64+0x69/0xc0 Aug 22 19:23:02 juju-e4d256-prod-github-runner-207 kernel: [50356.615283] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 19:23:02 juju-e4d256-prod-github-runner-207 kernel: [50356.615991] RIP: 0033:0x7faa5d0edaff Aug 22 19:23:02 juju-e4d256-prod-github-runner-207 kernel: [50356.616615] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 19:23:02 juju-e4d256-prod-github-runner-207 kernel: [50356.618607] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 19:23:02 juju-e4d256-prod-github-runner-207 kernel: [50356.619517] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 19:23:02 juju-e4d256-prod-github-runner-207 kernel: [50356.620406] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 19:23:02 juju-e4d256-prod-github-runner-207 kernel: [50356.621303] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 19:23:02 juju-e4d256-prod-github-runner-207 kernel: [50356.622199] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 19:23:02 juju-e4d256-prod-github-runner-207 kernel: [50356.623086] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 19:23:02 juju-e4d256-prod-github-runner-207 kernel: [50356.623996] Aug 22 19:23:30 juju-e4d256-prod-github-runner-207 kernel: [50384.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 46816s! [qemu-system-x86:6715] Aug 22 19:23:30 juju-e4d256-prod-github-runner-207 kernel: [50384.543111] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 19:23:30 juju-e4d256-prod-github-runner-207 kernel: [50384.543181] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 19:23:30 juju-e4d256-prod-github-runner-207 kernel: [50384.555216] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 19:23:30 juju-e4d256-prod-github-runner-207 kernel: [50384.556480] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 19:23:30 juju-e4d256-prod-github-runner-207 kernel: [50384.557710] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:23:30 juju-e4d256-prod-github-runner-207 kernel: [50384.558765] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 19:23:30 juju-e4d256-prod-github-runner-207 kernel: [50384.561326] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 19:23:30 juju-e4d256-prod-github-runner-207 kernel: [50384.562374] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 19:23:30 juju-e4d256-prod-github-runner-207 kernel: [50384.563533] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 19:23:30 juju-e4d256-prod-github-runner-207 kernel: [50384.564701] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 19:23:30 juju-e4d256-prod-github-runner-207 kernel: [50384.565862] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 19:23:30 juju-e4d256-prod-github-runner-207 kernel: [50384.567019] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 19:23:30 juju-e4d256-prod-github-runner-207 kernel: [50384.568181] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 19:23:30 juju-e4d256-prod-github-runner-207 kernel: [50384.569426] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 19:23:30 juju-e4d256-prod-github-runner-207 kernel: [50384.570521] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 19:23:30 juju-e4d256-prod-github-runner-207 kernel: [50384.571708] Call Trace: Aug 22 19:23:30 juju-e4d256-prod-github-runner-207 kernel: [50384.572618] Aug 22 19:23:30 juju-e4d256-prod-github-runner-207 kernel: [50384.573519] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:23:30 juju-e4d256-prod-github-runner-207 kernel: [50384.574551] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:23:30 juju-e4d256-prod-github-runner-207 kernel: [50384.575581] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:23:30 juju-e4d256-prod-github-runner-207 kernel: [50384.576682] ? show_regs.part.0+0x23/0x29 Aug 22 19:23:30 juju-e4d256-prod-github-runner-207 kernel: [50384.577683] ? show_regs.cold+0x8/0xd Aug 22 19:23:30 juju-e4d256-prod-github-runner-207 kernel: [50384.578653] ? watchdog_timer_fn+0x1be/0x220 Aug 22 19:23:30 juju-e4d256-prod-github-runner-207 kernel: [50384.579660] ? lockup_detector_update_enable+0x60/0x60 Aug 22 19:23:30 juju-e4d256-prod-github-runner-207 kernel: [50384.580736] ? __hrtimer_run_queues+0x107/0x230 Aug 22 19:23:30 juju-e4d256-prod-github-runner-207 kernel: [50384.581762] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 19:23:30 juju-e4d256-prod-github-runner-207 kernel: [50384.582782] ? hrtimer_interrupt+0x101/0x220 Aug 22 19:23:30 juju-e4d256-prod-github-runner-207 kernel: [50384.583794] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 19:23:30 juju-e4d256-prod-github-runner-207 kernel: [50384.584879] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 19:23:30 juju-e4d256-prod-github-runner-207 kernel: [50384.585944] Aug 22 19:23:30 juju-e4d256-prod-github-runner-207 kernel: [50384.586798] Aug 22 19:23:30 juju-e4d256-prod-github-runner-207 kernel: [50384.587638] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 19:23:30 juju-e4d256-prod-github-runner-207 kernel: [50384.588684] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:23:30 juju-e4d256-prod-github-runner-207 kernel: [50384.589720] ? _raw_spin_lock+0x22/0x30 Aug 22 19:23:30 juju-e4d256-prod-github-runner-207 kernel: [50384.590676] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:23:30 juju-e4d256-prod-github-runner-207 kernel: [50384.591698] direct_page_fault+0x206/0x310 [kvm] Aug 22 19:23:30 juju-e4d256-prod-github-runner-207 kernel: [50384.592734] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 19:23:30 juju-e4d256-prod-github-runner-207 kernel: [50384.593740] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 19:23:30 juju-e4d256-prod-github-runner-207 kernel: [50384.594743] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 19:23:30 juju-e4d256-prod-github-runner-207 kernel: [50384.595711] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 19:23:30 juju-e4d256-prod-github-runner-207 kernel: [50384.596668] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 19:23:30 juju-e4d256-prod-github-runner-207 kernel: [50384.597642] handle_exit+0x98/0x230 [kvm_amd] Aug 22 19:23:30 juju-e4d256-prod-github-runner-207 kernel: [50384.598530] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 19:23:30 juju-e4d256-prod-github-runner-207 kernel: [50384.599441] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 19:23:30 juju-e4d256-prod-github-runner-207 kernel: [50384.600368] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 19:23:30 juju-e4d256-prod-github-runner-207 kernel: [50384.601284] vcpu_run+0x62/0x2c0 [kvm] Aug 22 19:23:30 juju-e4d256-prod-github-runner-207 kernel: [50384.602092] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 19:23:30 juju-e4d256-prod-github-runner-207 kernel: [50384.602896] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 19:23:30 juju-e4d256-prod-github-runner-207 kernel: [50384.603747] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 19:23:30 juju-e4d256-prod-github-runner-207 kernel: [50384.604541] ? __seccomp_filter+0x4a/0x4a0 Aug 22 19:23:30 juju-e4d256-prod-github-runner-207 kernel: [50384.605306] ? __fget_files+0x86/0xc0 Aug 22 19:23:30 juju-e4d256-prod-github-runner-207 kernel: [50384.606018] __x64_sys_ioctl+0x95/0xd0 Aug 22 19:23:30 juju-e4d256-prod-github-runner-207 kernel: [50384.606714] do_syscall_64+0x5c/0xc0 Aug 22 19:23:30 juju-e4d256-prod-github-runner-207 kernel: [50384.607375] ? do_futex+0x162/0x1f0 Aug 22 19:23:30 juju-e4d256-prod-github-runner-207 kernel: [50384.608021] ? __x64_sys_futex+0x78/0x1e0 Aug 22 19:23:30 juju-e4d256-prod-github-runner-207 kernel: [50384.608709] ? __secure_computing+0xa9/0x120 Aug 22 19:23:30 juju-e4d256-prod-github-runner-207 kernel: [50384.609501] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 19:23:30 juju-e4d256-prod-github-runner-207 kernel: [50384.610267] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:23:30 juju-e4d256-prod-github-runner-207 kernel: [50384.610986] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:23:30 juju-e4d256-prod-github-runner-207 kernel: [50384.611701] ? do_syscall_64+0x69/0xc0 Aug 22 19:23:30 juju-e4d256-prod-github-runner-207 kernel: [50384.612349] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:23:30 juju-e4d256-prod-github-runner-207 kernel: [50384.613063] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:23:30 juju-e4d256-prod-github-runner-207 kernel: [50384.613758] ? do_syscall_64+0x69/0xc0 Aug 22 19:23:30 juju-e4d256-prod-github-runner-207 kernel: [50384.614381] ? do_syscall_64+0x69/0xc0 Aug 22 19:23:30 juju-e4d256-prod-github-runner-207 kernel: [50384.615067] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 19:23:30 juju-e4d256-prod-github-runner-207 kernel: [50384.615776] RIP: 0033:0x7faa5d0edaff Aug 22 19:23:30 juju-e4d256-prod-github-runner-207 kernel: [50384.616403] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 19:23:30 juju-e4d256-prod-github-runner-207 kernel: [50384.618392] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 19:23:30 juju-e4d256-prod-github-runner-207 kernel: [50384.619306] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 19:23:30 juju-e4d256-prod-github-runner-207 kernel: [50384.620196] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 19:23:30 juju-e4d256-prod-github-runner-207 kernel: [50384.621116] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 19:23:30 juju-e4d256-prod-github-runner-207 kernel: [50384.622006] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 19:23:30 juju-e4d256-prod-github-runner-207 kernel: [50384.622888] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 19:23:30 juju-e4d256-prod-github-runner-207 kernel: [50384.623784] Aug 22 19:23:46 juju-e4d256-prod-github-runner-207 kernel: [50400.548705] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 19:23:46 juju-e4d256-prod-github-runner-207 kernel: [50400.549718] rcu: 1-....: (12531309 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=6058843 Aug 22 19:23:46 juju-e4d256-prod-github-runner-207 kernel: [50400.550845] (t=12570837 jiffies g=23269 q=47910) Aug 22 19:23:46 juju-e4d256-prod-github-runner-207 kernel: [50400.551631] NMI backtrace for cpu 1 Aug 22 19:23:46 juju-e4d256-prod-github-runner-207 kernel: [50400.552351] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 19:23:46 juju-e4d256-prod-github-runner-207 kernel: [50400.553678] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 19:23:46 juju-e4d256-prod-github-runner-207 kernel: [50400.554735] Call Trace: Aug 22 19:23:46 juju-e4d256-prod-github-runner-207 kernel: [50400.555410] Aug 22 19:23:46 juju-e4d256-prod-github-runner-207 kernel: [50400.556054] show_stack+0x52/0x5c Aug 22 19:23:46 juju-e4d256-prod-github-runner-207 kernel: [50400.556788] dump_stack_lvl+0x4a/0x63 Aug 22 19:23:46 juju-e4d256-prod-github-runner-207 kernel: [50400.557541] dump_stack+0x10/0x16 Aug 22 19:23:46 juju-e4d256-prod-github-runner-207 kernel: [50400.558259] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 19:23:46 juju-e4d256-prod-github-runner-207 kernel: [50400.559187] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 19:23:46 juju-e4d256-prod-github-runner-207 kernel: [50400.559965] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 19:23:46 juju-e4d256-prod-github-runner-207 kernel: [50400.560804] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 19:23:46 juju-e4d256-prod-github-runner-207 kernel: [50400.561623] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 19:23:46 juju-e4d256-prod-github-runner-207 kernel: [50400.562438] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 19:23:46 juju-e4d256-prod-github-runner-207 kernel: [50400.563213] print_cpu_stall.cold+0x2f/0xe2 Aug 22 19:23:46 juju-e4d256-prod-github-runner-207 kernel: [50400.563982] ? timekeeping_update+0xf7/0x150 Aug 22 19:23:46 juju-e4d256-prod-github-runner-207 kernel: [50400.564771] check_cpu_stall+0x109/0x270 Aug 22 19:23:46 juju-e4d256-prod-github-runner-207 kernel: [50400.565518] rcu_sched_clock_irq+0x9a/0x250 Aug 22 19:23:46 juju-e4d256-prod-github-runner-207 kernel: [50400.566410] update_process_times+0x94/0xd0 Aug 22 19:23:46 juju-e4d256-prod-github-runner-207 kernel: [50400.567172] tick_sched_handle+0x29/0x70 Aug 22 19:23:46 juju-e4d256-prod-github-runner-207 kernel: [50400.568044] tick_sched_timer+0x8c/0xc0 Aug 22 19:23:46 juju-e4d256-prod-github-runner-207 kernel: [50400.568801] ? tick_nohz_handler+0xb0/0xb0 Aug 22 19:23:46 juju-e4d256-prod-github-runner-207 kernel: [50400.569561] __hrtimer_run_queues+0x107/0x230 Aug 22 19:23:46 juju-e4d256-prod-github-runner-207 kernel: [50400.570332] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 19:23:46 juju-e4d256-prod-github-runner-207 kernel: [50400.571106] hrtimer_interrupt+0x101/0x220 Aug 22 19:23:46 juju-e4d256-prod-github-runner-207 kernel: [50400.571863] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 19:23:46 juju-e4d256-prod-github-runner-207 kernel: [50400.572704] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 19:23:46 juju-e4d256-prod-github-runner-207 kernel: [50400.573517] Aug 22 19:23:46 juju-e4d256-prod-github-runner-207 kernel: [50400.574152] Aug 22 19:23:46 juju-e4d256-prod-github-runner-207 kernel: [50400.574781] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 19:23:46 juju-e4d256-prod-github-runner-207 kernel: [50400.575607] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:23:46 juju-e4d256-prod-github-runner-207 kernel: [50400.576497] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 19:23:46 juju-e4d256-prod-github-runner-207 kernel: [50400.578715] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 19:23:46 juju-e4d256-prod-github-runner-207 kernel: [50400.579589] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 19:23:46 juju-e4d256-prod-github-runner-207 kernel: [50400.580593] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 19:23:46 juju-e4d256-prod-github-runner-207 kernel: [50400.581571] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 19:23:46 juju-e4d256-prod-github-runner-207 kernel: [50400.582537] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 19:23:46 juju-e4d256-prod-github-runner-207 kernel: [50400.583500] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 19:23:46 juju-e4d256-prod-github-runner-207 kernel: [50400.584469] ? _raw_spin_lock+0x22/0x30 Aug 22 19:23:46 juju-e4d256-prod-github-runner-207 kernel: [50400.585226] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:23:46 juju-e4d256-prod-github-runner-207 kernel: [50400.586082] direct_page_fault+0x206/0x310 [kvm] Aug 22 19:23:46 juju-e4d256-prod-github-runner-207 kernel: [50400.586920] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 19:23:46 juju-e4d256-prod-github-runner-207 kernel: [50400.587748] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 19:23:46 juju-e4d256-prod-github-runner-207 kernel: [50400.588615] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 19:23:46 juju-e4d256-prod-github-runner-207 kernel: [50400.589419] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 19:23:46 juju-e4d256-prod-github-runner-207 kernel: [50400.590207] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 19:23:46 juju-e4d256-prod-github-runner-207 kernel: [50400.591031] handle_exit+0x98/0x230 [kvm_amd] Aug 22 19:23:46 juju-e4d256-prod-github-runner-207 kernel: [50400.591785] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 19:23:46 juju-e4d256-prod-github-runner-207 kernel: [50400.592585] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 19:23:46 juju-e4d256-prod-github-runner-207 kernel: [50400.593393] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 19:23:46 juju-e4d256-prod-github-runner-207 kernel: [50400.594181] vcpu_run+0x62/0x2c0 [kvm] Aug 22 19:23:46 juju-e4d256-prod-github-runner-207 kernel: [50400.594896] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 19:23:46 juju-e4d256-prod-github-runner-207 kernel: [50400.595633] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 19:23:46 juju-e4d256-prod-github-runner-207 kernel: [50400.596435] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 19:23:46 juju-e4d256-prod-github-runner-207 kernel: [50400.597212] ? __seccomp_filter+0x4a/0x4a0 Aug 22 19:23:46 juju-e4d256-prod-github-runner-207 kernel: [50400.597931] ? __fget_files+0x86/0xc0 Aug 22 19:23:46 juju-e4d256-prod-github-runner-207 kernel: [50400.598632] __x64_sys_ioctl+0x95/0xd0 Aug 22 19:23:46 juju-e4d256-prod-github-runner-207 kernel: [50400.599328] do_syscall_64+0x5c/0xc0 Aug 22 19:23:46 juju-e4d256-prod-github-runner-207 kernel: [50400.600008] ? do_futex+0x162/0x1f0 Aug 22 19:23:46 juju-e4d256-prod-github-runner-207 kernel: [50400.600698] ? __x64_sys_futex+0x78/0x1e0 Aug 22 19:23:46 juju-e4d256-prod-github-runner-207 kernel: [50400.601408] ? __secure_computing+0xa9/0x120 Aug 22 19:23:46 juju-e4d256-prod-github-runner-207 kernel: [50400.602123] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 19:23:46 juju-e4d256-prod-github-runner-207 kernel: [50400.602911] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:23:46 juju-e4d256-prod-github-runner-207 kernel: [50400.603672] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:23:46 juju-e4d256-prod-github-runner-207 kernel: [50400.604427] ? do_syscall_64+0x69/0xc0 Aug 22 19:23:46 juju-e4d256-prod-github-runner-207 kernel: [50400.605127] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:23:46 juju-e4d256-prod-github-runner-207 kernel: [50400.605887] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:23:46 juju-e4d256-prod-github-runner-207 kernel: [50400.606644] ? do_syscall_64+0x69/0xc0 Aug 22 19:23:46 juju-e4d256-prod-github-runner-207 kernel: [50400.607341] ? do_syscall_64+0x69/0xc0 Aug 22 19:23:46 juju-e4d256-prod-github-runner-207 kernel: [50400.608026] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 19:23:46 juju-e4d256-prod-github-runner-207 kernel: [50400.608827] RIP: 0033:0x7faa5d0edaff Aug 22 19:23:46 juju-e4d256-prod-github-runner-207 kernel: [50400.609512] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 19:23:46 juju-e4d256-prod-github-runner-207 kernel: [50400.611610] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 19:23:46 juju-e4d256-prod-github-runner-207 kernel: [50400.612582] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 19:23:46 juju-e4d256-prod-github-runner-207 kernel: [50400.613533] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 19:23:46 juju-e4d256-prod-github-runner-207 kernel: [50400.614484] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 19:23:46 juju-e4d256-prod-github-runner-207 kernel: [50400.615422] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 19:23:46 juju-e4d256-prod-github-runner-207 kernel: [50400.616345] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 19:23:46 juju-e4d256-prod-github-runner-207 kernel: [50400.617279] Aug 22 19:24:14 juju-e4d256-prod-github-runner-207 kernel: [50428.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 46857s! [qemu-system-x86:6715] Aug 22 19:24:14 juju-e4d256-prod-github-runner-207 kernel: [50428.543674] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 19:24:14 juju-e4d256-prod-github-runner-207 kernel: [50428.543911] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 19:24:14 juju-e4d256-prod-github-runner-207 kernel: [50428.556040] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 19:24:14 juju-e4d256-prod-github-runner-207 kernel: [50428.557319] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 19:24:14 juju-e4d256-prod-github-runner-207 kernel: [50428.558541] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:24:14 juju-e4d256-prod-github-runner-207 kernel: [50428.559594] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 19:24:14 juju-e4d256-prod-github-runner-207 kernel: [50428.562149] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 19:24:14 juju-e4d256-prod-github-runner-207 kernel: [50428.563189] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 19:24:14 juju-e4d256-prod-github-runner-207 kernel: [50428.564364] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 19:24:14 juju-e4d256-prod-github-runner-207 kernel: [50428.565524] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 19:24:14 juju-e4d256-prod-github-runner-207 kernel: [50428.566683] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 19:24:14 juju-e4d256-prod-github-runner-207 kernel: [50428.567842] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 19:24:14 juju-e4d256-prod-github-runner-207 kernel: [50428.569051] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 19:24:14 juju-e4d256-prod-github-runner-207 kernel: [50428.570291] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 19:24:14 juju-e4d256-prod-github-runner-207 kernel: [50428.571387] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 19:24:14 juju-e4d256-prod-github-runner-207 kernel: [50428.572631] Call Trace: Aug 22 19:24:14 juju-e4d256-prod-github-runner-207 kernel: [50428.573544] Aug 22 19:24:14 juju-e4d256-prod-github-runner-207 kernel: [50428.574445] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:24:14 juju-e4d256-prod-github-runner-207 kernel: [50428.575475] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:24:14 juju-e4d256-prod-github-runner-207 kernel: [50428.576512] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:24:14 juju-e4d256-prod-github-runner-207 kernel: [50428.577605] ? show_regs.part.0+0x23/0x29 Aug 22 19:24:14 juju-e4d256-prod-github-runner-207 kernel: [50428.578601] ? show_regs.cold+0x8/0xd Aug 22 19:24:14 juju-e4d256-prod-github-runner-207 kernel: [50428.579569] ? watchdog_timer_fn+0x1be/0x220 Aug 22 19:24:14 juju-e4d256-prod-github-runner-207 kernel: [50428.580589] ? lockup_detector_update_enable+0x60/0x60 Aug 22 19:24:14 juju-e4d256-prod-github-runner-207 kernel: [50428.581690] ? __hrtimer_run_queues+0x107/0x230 Aug 22 19:24:14 juju-e4d256-prod-github-runner-207 kernel: [50428.582737] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 19:24:14 juju-e4d256-prod-github-runner-207 kernel: [50428.583761] ? hrtimer_interrupt+0x101/0x220 Aug 22 19:24:14 juju-e4d256-prod-github-runner-207 kernel: [50428.584800] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 19:24:14 juju-e4d256-prod-github-runner-207 kernel: [50428.585874] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 19:24:14 juju-e4d256-prod-github-runner-207 kernel: [50428.586915] Aug 22 19:24:14 juju-e4d256-prod-github-runner-207 kernel: [50428.587767] Aug 22 19:24:14 juju-e4d256-prod-github-runner-207 kernel: [50428.588619] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 19:24:14 juju-e4d256-prod-github-runner-207 kernel: [50428.589651] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:24:14 juju-e4d256-prod-github-runner-207 kernel: [50428.590690] ? _raw_spin_lock+0x22/0x30 Aug 22 19:24:14 juju-e4d256-prod-github-runner-207 kernel: [50428.591639] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:24:14 juju-e4d256-prod-github-runner-207 kernel: [50428.592682] direct_page_fault+0x206/0x310 [kvm] Aug 22 19:24:14 juju-e4d256-prod-github-runner-207 kernel: [50428.593705] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 19:24:14 juju-e4d256-prod-github-runner-207 kernel: [50428.594745] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 19:24:14 juju-e4d256-prod-github-runner-207 kernel: [50428.595861] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 19:24:14 juju-e4d256-prod-github-runner-207 kernel: [50428.596961] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 19:24:14 juju-e4d256-prod-github-runner-207 kernel: [50428.597948] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 19:24:14 juju-e4d256-prod-github-runner-207 kernel: [50428.598972] handle_exit+0x98/0x230 [kvm_amd] Aug 22 19:24:14 juju-e4d256-prod-github-runner-207 kernel: [50428.599871] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 19:24:14 juju-e4d256-prod-github-runner-207 kernel: [50428.600813] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 19:24:14 juju-e4d256-prod-github-runner-207 kernel: [50428.601750] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 19:24:14 juju-e4d256-prod-github-runner-207 kernel: [50428.602655] vcpu_run+0x62/0x2c0 [kvm] Aug 22 19:24:14 juju-e4d256-prod-github-runner-207 kernel: [50428.603465] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 19:24:14 juju-e4d256-prod-github-runner-207 kernel: [50428.604292] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 19:24:14 juju-e4d256-prod-github-runner-207 kernel: [50428.605160] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 19:24:14 juju-e4d256-prod-github-runner-207 kernel: [50428.605954] ? __seccomp_filter+0x4a/0x4a0 Aug 22 19:24:14 juju-e4d256-prod-github-runner-207 kernel: [50428.606700] ? __fget_files+0x86/0xc0 Aug 22 19:24:14 juju-e4d256-prod-github-runner-207 kernel: [50428.607401] __x64_sys_ioctl+0x95/0xd0 Aug 22 19:24:14 juju-e4d256-prod-github-runner-207 kernel: [50428.608107] do_syscall_64+0x5c/0xc0 Aug 22 19:24:14 juju-e4d256-prod-github-runner-207 kernel: [50428.608768] ? do_futex+0x162/0x1f0 Aug 22 19:24:14 juju-e4d256-prod-github-runner-207 kernel: [50428.609415] ? __x64_sys_futex+0x78/0x1e0 Aug 22 19:24:14 juju-e4d256-prod-github-runner-207 kernel: [50428.610091] ? __secure_computing+0xa9/0x120 Aug 22 19:24:14 juju-e4d256-prod-github-runner-207 kernel: [50428.610804] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 19:24:14 juju-e4d256-prod-github-runner-207 kernel: [50428.611564] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:24:14 juju-e4d256-prod-github-runner-207 kernel: [50428.612304] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:24:14 juju-e4d256-prod-github-runner-207 kernel: [50428.613021] ? do_syscall_64+0x69/0xc0 Aug 22 19:24:14 juju-e4d256-prod-github-runner-207 kernel: [50428.613671] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:24:14 juju-e4d256-prod-github-runner-207 kernel: [50428.614373] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:24:14 juju-e4d256-prod-github-runner-207 kernel: [50428.615073] ? do_syscall_64+0x69/0xc0 Aug 22 19:24:14 juju-e4d256-prod-github-runner-207 kernel: [50428.615709] ? do_syscall_64+0x69/0xc0 Aug 22 19:24:14 juju-e4d256-prod-github-runner-207 kernel: [50428.616407] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 19:24:14 juju-e4d256-prod-github-runner-207 kernel: [50428.617158] RIP: 0033:0x7faa5d0edaff Aug 22 19:24:14 juju-e4d256-prod-github-runner-207 kernel: [50428.617960] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 19:24:14 juju-e4d256-prod-github-runner-207 kernel: [50428.620072] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 19:24:14 juju-e4d256-prod-github-runner-207 kernel: [50428.621036] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 19:24:14 juju-e4d256-prod-github-runner-207 kernel: [50428.621962] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 19:24:14 juju-e4d256-prod-github-runner-207 kernel: [50428.622863] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 19:24:14 juju-e4d256-prod-github-runner-207 kernel: [50428.623755] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 19:24:14 juju-e4d256-prod-github-runner-207 kernel: [50428.624664] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 19:24:14 juju-e4d256-prod-github-runner-207 kernel: [50428.625582] Aug 22 19:24:42 juju-e4d256-prod-github-runner-207 kernel: [50456.541980] watchdog: BUG: soft lockup - CPU#1 stuck for 46883s! [qemu-system-x86:6715] Aug 22 19:24:42 juju-e4d256-prod-github-runner-207 kernel: [50456.543315] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 19:24:42 juju-e4d256-prod-github-runner-207 kernel: [50456.543383] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 19:24:42 juju-e4d256-prod-github-runner-207 kernel: [50456.557275] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 19:24:42 juju-e4d256-prod-github-runner-207 kernel: [50456.558720] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 19:24:42 juju-e4d256-prod-github-runner-207 kernel: [50456.560119] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:24:42 juju-e4d256-prod-github-runner-207 kernel: [50456.561288] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 19:24:42 juju-e4d256-prod-github-runner-207 kernel: [50456.564175] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 19:24:42 juju-e4d256-prod-github-runner-207 kernel: [50456.565315] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 19:24:42 juju-e4d256-prod-github-runner-207 kernel: [50456.566614] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 19:24:42 juju-e4d256-prod-github-runner-207 kernel: [50456.567924] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 19:24:42 juju-e4d256-prod-github-runner-207 kernel: [50456.569213] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 19:24:42 juju-e4d256-prod-github-runner-207 kernel: [50456.570503] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 19:24:42 juju-e4d256-prod-github-runner-207 kernel: [50456.571828] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 19:24:42 juju-e4d256-prod-github-runner-207 kernel: [50456.573216] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 19:24:42 juju-e4d256-prod-github-runner-207 kernel: [50456.574428] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 19:24:42 juju-e4d256-prod-github-runner-207 kernel: [50456.575770] Call Trace: Aug 22 19:24:42 juju-e4d256-prod-github-runner-207 kernel: [50456.576734] Aug 22 19:24:42 juju-e4d256-prod-github-runner-207 kernel: [50456.577669] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:24:42 juju-e4d256-prod-github-runner-207 kernel: [50456.578787] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:24:42 juju-e4d256-prod-github-runner-207 kernel: [50456.579938] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:24:42 juju-e4d256-prod-github-runner-207 kernel: [50456.581101] ? show_regs.part.0+0x23/0x29 Aug 22 19:24:42 juju-e4d256-prod-github-runner-207 kernel: [50456.582190] ? show_regs.cold+0x8/0xd Aug 22 19:24:42 juju-e4d256-prod-github-runner-207 kernel: [50456.583244] ? watchdog_timer_fn+0x1be/0x220 Aug 22 19:24:42 juju-e4d256-prod-github-runner-207 kernel: [50456.584370] ? lockup_detector_update_enable+0x60/0x60 Aug 22 19:24:42 juju-e4d256-prod-github-runner-207 kernel: [50456.585549] ? __hrtimer_run_queues+0x107/0x230 Aug 22 19:24:42 juju-e4d256-prod-github-runner-207 kernel: [50456.586662] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 19:24:42 juju-e4d256-prod-github-runner-207 kernel: [50456.587789] ? hrtimer_interrupt+0x101/0x220 Aug 22 19:24:42 juju-e4d256-prod-github-runner-207 kernel: [50456.588887] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 19:24:42 juju-e4d256-prod-github-runner-207 kernel: [50456.590051] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 19:24:42 juju-e4d256-prod-github-runner-207 kernel: [50456.591193] Aug 22 19:24:42 juju-e4d256-prod-github-runner-207 kernel: [50456.592108] Aug 22 19:24:42 juju-e4d256-prod-github-runner-207 kernel: [50456.592991] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 19:24:42 juju-e4d256-prod-github-runner-207 kernel: [50456.594122] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:24:42 juju-e4d256-prod-github-runner-207 kernel: [50456.595270] ? _raw_spin_lock+0x22/0x30 Aug 22 19:24:42 juju-e4d256-prod-github-runner-207 kernel: [50456.596361] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:24:42 juju-e4d256-prod-github-runner-207 kernel: [50456.597503] direct_page_fault+0x206/0x310 [kvm] Aug 22 19:24:42 juju-e4d256-prod-github-runner-207 kernel: [50456.598736] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 19:24:42 juju-e4d256-prod-github-runner-207 kernel: [50456.599861] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 19:24:42 juju-e4d256-prod-github-runner-207 kernel: [50456.600962] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 19:24:42 juju-e4d256-prod-github-runner-207 kernel: [50456.602031] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 19:24:42 juju-e4d256-prod-github-runner-207 kernel: [50456.603077] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 19:24:42 juju-e4d256-prod-github-runner-207 kernel: [50456.604188] handle_exit+0x98/0x230 [kvm_amd] Aug 22 19:24:42 juju-e4d256-prod-github-runner-207 kernel: [50456.605173] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 19:24:42 juju-e4d256-prod-github-runner-207 kernel: [50456.606179] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 19:24:42 juju-e4d256-prod-github-runner-207 kernel: [50456.607205] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 19:24:42 juju-e4d256-prod-github-runner-207 kernel: [50456.608226] vcpu_run+0x62/0x2c0 [kvm] Aug 22 19:24:42 juju-e4d256-prod-github-runner-207 kernel: [50456.609120] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 19:24:42 juju-e4d256-prod-github-runner-207 kernel: [50456.610019] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 19:24:42 juju-e4d256-prod-github-runner-207 kernel: [50456.610975] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 19:24:42 juju-e4d256-prod-github-runner-207 kernel: [50456.611884] ? __seccomp_filter+0x4a/0x4a0 Aug 22 19:24:42 juju-e4d256-prod-github-runner-207 kernel: [50456.612716] ? __fget_files+0x86/0xc0 Aug 22 19:24:42 juju-e4d256-prod-github-runner-207 kernel: [50456.613499] __x64_sys_ioctl+0x95/0xd0 Aug 22 19:24:42 juju-e4d256-prod-github-runner-207 kernel: [50456.614284] do_syscall_64+0x5c/0xc0 Aug 22 19:24:42 juju-e4d256-prod-github-runner-207 kernel: [50456.615028] ? do_futex+0x162/0x1f0 Aug 22 19:24:42 juju-e4d256-prod-github-runner-207 kernel: [50456.615794] ? __x64_sys_futex+0x78/0x1e0 Aug 22 19:24:42 juju-e4d256-prod-github-runner-207 kernel: [50456.616512] ? __secure_computing+0xa9/0x120 Aug 22 19:24:42 juju-e4d256-prod-github-runner-207 kernel: [50456.617212] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 19:24:42 juju-e4d256-prod-github-runner-207 kernel: [50456.617996] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:24:42 juju-e4d256-prod-github-runner-207 kernel: [50456.618728] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:24:42 juju-e4d256-prod-github-runner-207 kernel: [50456.619466] ? do_syscall_64+0x69/0xc0 Aug 22 19:24:42 juju-e4d256-prod-github-runner-207 kernel: [50456.620140] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:24:42 juju-e4d256-prod-github-runner-207 kernel: [50456.620848] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:24:42 juju-e4d256-prod-github-runner-207 kernel: [50456.621546] ? do_syscall_64+0x69/0xc0 Aug 22 19:24:42 juju-e4d256-prod-github-runner-207 kernel: [50456.622174] ? do_syscall_64+0x69/0xc0 Aug 22 19:24:42 juju-e4d256-prod-github-runner-207 kernel: [50456.622798] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 19:24:42 juju-e4d256-prod-github-runner-207 kernel: [50456.623506] RIP: 0033:0x7faa5d0edaff Aug 22 19:24:42 juju-e4d256-prod-github-runner-207 kernel: [50456.624145] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 19:24:42 juju-e4d256-prod-github-runner-207 kernel: [50456.626136] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 19:24:42 juju-e4d256-prod-github-runner-207 kernel: [50456.627057] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 19:24:42 juju-e4d256-prod-github-runner-207 kernel: [50456.627960] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 19:24:42 juju-e4d256-prod-github-runner-207 kernel: [50456.628851] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 19:24:42 juju-e4d256-prod-github-runner-207 kernel: [50456.629742] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 19:24:42 juju-e4d256-prod-github-runner-207 kernel: [50456.630637] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 19:24:42 juju-e4d256-prod-github-runner-207 kernel: [50456.631536] Aug 22 19:25:10 juju-e4d256-prod-github-runner-207 kernel: [50484.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 46909s! [qemu-system-x86:6715] Aug 22 19:25:10 juju-e4d256-prod-github-runner-207 kernel: [50484.543134] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 19:25:10 juju-e4d256-prod-github-runner-207 kernel: [50484.543215] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 19:25:10 juju-e4d256-prod-github-runner-207 kernel: [50484.556814] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 19:25:10 juju-e4d256-prod-github-runner-207 kernel: [50484.558097] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 19:25:10 juju-e4d256-prod-github-runner-207 kernel: [50484.559337] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:25:10 juju-e4d256-prod-github-runner-207 kernel: [50484.560417] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 19:25:10 juju-e4d256-prod-github-runner-207 kernel: [50484.563003] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 19:25:10 juju-e4d256-prod-github-runner-207 kernel: [50484.564084] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 19:25:10 juju-e4d256-prod-github-runner-207 kernel: [50484.565250] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 19:25:10 juju-e4d256-prod-github-runner-207 kernel: [50484.566443] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 19:25:10 juju-e4d256-prod-github-runner-207 kernel: [50484.567634] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 19:25:10 juju-e4d256-prod-github-runner-207 kernel: [50484.568807] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 19:25:10 juju-e4d256-prod-github-runner-207 kernel: [50484.569976] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 19:25:10 juju-e4d256-prod-github-runner-207 kernel: [50484.571209] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 19:25:10 juju-e4d256-prod-github-runner-207 kernel: [50484.572378] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 19:25:10 juju-e4d256-prod-github-runner-207 kernel: [50484.573587] Call Trace: Aug 22 19:25:10 juju-e4d256-prod-github-runner-207 kernel: [50484.574715] Aug 22 19:25:10 juju-e4d256-prod-github-runner-207 kernel: [50484.575791] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:25:10 juju-e4d256-prod-github-runner-207 kernel: [50484.577020] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:25:10 juju-e4d256-prod-github-runner-207 kernel: [50484.578075] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:25:10 juju-e4d256-prod-github-runner-207 kernel: [50484.579159] ? show_regs.part.0+0x23/0x29 Aug 22 19:25:10 juju-e4d256-prod-github-runner-207 kernel: [50484.580182] ? show_regs.cold+0x8/0xd Aug 22 19:25:10 juju-e4d256-prod-github-runner-207 kernel: [50484.581161] ? watchdog_timer_fn+0x1be/0x220 Aug 22 19:25:10 juju-e4d256-prod-github-runner-207 kernel: [50484.582195] ? lockup_detector_update_enable+0x60/0x60 Aug 22 19:25:10 juju-e4d256-prod-github-runner-207 kernel: [50484.583272] ? __hrtimer_run_queues+0x107/0x230 Aug 22 19:25:10 juju-e4d256-prod-github-runner-207 kernel: [50484.584326] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 19:25:10 juju-e4d256-prod-github-runner-207 kernel: [50484.585356] ? hrtimer_interrupt+0x101/0x220 Aug 22 19:25:10 juju-e4d256-prod-github-runner-207 kernel: [50484.586378] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 19:25:10 juju-e4d256-prod-github-runner-207 kernel: [50484.587521] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 19:25:10 juju-e4d256-prod-github-runner-207 kernel: [50484.588573] Aug 22 19:25:10 juju-e4d256-prod-github-runner-207 kernel: [50484.589431] Aug 22 19:25:10 juju-e4d256-prod-github-runner-207 kernel: [50484.590274] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 19:25:10 juju-e4d256-prod-github-runner-207 kernel: [50484.591327] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:25:10 juju-e4d256-prod-github-runner-207 kernel: [50484.592386] ? _raw_spin_lock+0x22/0x30 Aug 22 19:25:10 juju-e4d256-prod-github-runner-207 kernel: [50484.593376] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:25:10 juju-e4d256-prod-github-runner-207 kernel: [50484.594404] direct_page_fault+0x206/0x310 [kvm] Aug 22 19:25:10 juju-e4d256-prod-github-runner-207 kernel: [50484.595446] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 19:25:10 juju-e4d256-prod-github-runner-207 kernel: [50484.596566] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 19:25:10 juju-e4d256-prod-github-runner-207 kernel: [50484.597716] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 19:25:10 juju-e4d256-prod-github-runner-207 kernel: [50484.598797] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 19:25:10 juju-e4d256-prod-github-runner-207 kernel: [50484.599845] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 19:25:10 juju-e4d256-prod-github-runner-207 kernel: [50484.601093] handle_exit+0x98/0x230 [kvm_amd] Aug 22 19:25:10 juju-e4d256-prod-github-runner-207 kernel: [50484.602079] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 19:25:10 juju-e4d256-prod-github-runner-207 kernel: [50484.603088] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 19:25:10 juju-e4d256-prod-github-runner-207 kernel: [50484.604126] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 19:25:10 juju-e4d256-prod-github-runner-207 kernel: [50484.605122] vcpu_run+0x62/0x2c0 [kvm] Aug 22 19:25:10 juju-e4d256-prod-github-runner-207 kernel: [50484.606004] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 19:25:10 juju-e4d256-prod-github-runner-207 kernel: [50484.606892] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 19:25:10 juju-e4d256-prod-github-runner-207 kernel: [50484.607853] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 19:25:10 juju-e4d256-prod-github-runner-207 kernel: [50484.608740] ? __seccomp_filter+0x4a/0x4a0 Aug 22 19:25:10 juju-e4d256-prod-github-runner-207 kernel: [50484.609565] ? __fget_files+0x86/0xc0 Aug 22 19:25:10 juju-e4d256-prod-github-runner-207 kernel: [50484.610347] __x64_sys_ioctl+0x95/0xd0 Aug 22 19:25:10 juju-e4d256-prod-github-runner-207 kernel: [50484.611126] do_syscall_64+0x5c/0xc0 Aug 22 19:25:10 juju-e4d256-prod-github-runner-207 kernel: [50484.612073] ? do_futex+0x162/0x1f0 Aug 22 19:25:10 juju-e4d256-prod-github-runner-207 kernel: [50484.612790] ? __x64_sys_futex+0x78/0x1e0 Aug 22 19:25:10 juju-e4d256-prod-github-runner-207 kernel: [50484.613545] ? __secure_computing+0xa9/0x120 Aug 22 19:25:10 juju-e4d256-prod-github-runner-207 kernel: [50484.614324] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 19:25:10 juju-e4d256-prod-github-runner-207 kernel: [50484.615192] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:25:10 juju-e4d256-prod-github-runner-207 kernel: [50484.616030] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:25:10 juju-e4d256-prod-github-runner-207 kernel: [50484.616837] ? do_syscall_64+0x69/0xc0 Aug 22 19:25:10 juju-e4d256-prod-github-runner-207 kernel: [50484.617563] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:25:10 juju-e4d256-prod-github-runner-207 kernel: [50484.618355] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:25:10 juju-e4d256-prod-github-runner-207 kernel: [50484.619148] ? do_syscall_64+0x69/0xc0 Aug 22 19:25:10 juju-e4d256-prod-github-runner-207 kernel: [50484.619861] ? do_syscall_64+0x69/0xc0 Aug 22 19:25:10 juju-e4d256-prod-github-runner-207 kernel: [50484.620558] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 19:25:10 juju-e4d256-prod-github-runner-207 kernel: [50484.621359] RIP: 0033:0x7faa5d0edaff Aug 22 19:25:10 juju-e4d256-prod-github-runner-207 kernel: [50484.622051] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 19:25:10 juju-e4d256-prod-github-runner-207 kernel: [50484.624371] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 19:25:10 juju-e4d256-prod-github-runner-207 kernel: [50484.625427] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 19:25:10 juju-e4d256-prod-github-runner-207 kernel: [50484.626448] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 19:25:10 juju-e4d256-prod-github-runner-207 kernel: [50484.627481] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 19:25:10 juju-e4d256-prod-github-runner-207 kernel: [50484.628499] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 19:25:10 juju-e4d256-prod-github-runner-207 kernel: [50484.629523] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 19:25:10 juju-e4d256-prod-github-runner-207 kernel: [50484.630548] Aug 22 19:25:38 juju-e4d256-prod-github-runner-207 kernel: [50512.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 46935s! [qemu-system-x86:6715] Aug 22 19:25:38 juju-e4d256-prod-github-runner-207 kernel: [50512.543726] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 19:25:38 juju-e4d256-prod-github-runner-207 kernel: [50512.543976] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 19:25:38 juju-e4d256-prod-github-runner-207 kernel: [50512.556131] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 19:25:38 juju-e4d256-prod-github-runner-207 kernel: [50512.557402] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 19:25:38 juju-e4d256-prod-github-runner-207 kernel: [50512.558632] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:25:38 juju-e4d256-prod-github-runner-207 kernel: [50512.559699] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 19:25:38 juju-e4d256-prod-github-runner-207 kernel: [50512.562248] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 19:25:38 juju-e4d256-prod-github-runner-207 kernel: [50512.563306] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 19:25:38 juju-e4d256-prod-github-runner-207 kernel: [50512.564471] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 19:25:38 juju-e4d256-prod-github-runner-207 kernel: [50512.565638] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 19:25:38 juju-e4d256-prod-github-runner-207 kernel: [50512.566799] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 19:25:38 juju-e4d256-prod-github-runner-207 kernel: [50512.567969] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 19:25:38 juju-e4d256-prod-github-runner-207 kernel: [50512.569134] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 19:25:38 juju-e4d256-prod-github-runner-207 kernel: [50512.570366] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 19:25:38 juju-e4d256-prod-github-runner-207 kernel: [50512.571475] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 19:25:38 juju-e4d256-prod-github-runner-207 kernel: [50512.572669] Call Trace: Aug 22 19:25:38 juju-e4d256-prod-github-runner-207 kernel: [50512.573584] Aug 22 19:25:38 juju-e4d256-prod-github-runner-207 kernel: [50512.574482] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:25:38 juju-e4d256-prod-github-runner-207 kernel: [50512.575527] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:25:38 juju-e4d256-prod-github-runner-207 kernel: [50512.576547] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:25:38 juju-e4d256-prod-github-runner-207 kernel: [50512.577641] ? show_regs.part.0+0x23/0x29 Aug 22 19:25:38 juju-e4d256-prod-github-runner-207 kernel: [50512.578637] ? show_regs.cold+0x8/0xd Aug 22 19:25:38 juju-e4d256-prod-github-runner-207 kernel: [50512.579616] ? watchdog_timer_fn+0x1be/0x220 Aug 22 19:25:38 juju-e4d256-prod-github-runner-207 kernel: [50512.580624] ? lockup_detector_update_enable+0x60/0x60 Aug 22 19:25:38 juju-e4d256-prod-github-runner-207 kernel: [50512.581692] ? __hrtimer_run_queues+0x107/0x230 Aug 22 19:25:38 juju-e4d256-prod-github-runner-207 kernel: [50512.582717] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 19:25:38 juju-e4d256-prod-github-runner-207 kernel: [50512.583744] ? hrtimer_interrupt+0x101/0x220 Aug 22 19:25:38 juju-e4d256-prod-github-runner-207 kernel: [50512.584758] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 19:25:38 juju-e4d256-prod-github-runner-207 kernel: [50512.585824] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 19:25:38 juju-e4d256-prod-github-runner-207 kernel: [50512.586868] Aug 22 19:25:38 juju-e4d256-prod-github-runner-207 kernel: [50512.587723] Aug 22 19:25:38 juju-e4d256-prod-github-runner-207 kernel: [50512.588561] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 19:25:38 juju-e4d256-prod-github-runner-207 kernel: [50512.589595] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:25:38 juju-e4d256-prod-github-runner-207 kernel: [50512.590638] ? _raw_spin_lock+0x22/0x30 Aug 22 19:25:38 juju-e4d256-prod-github-runner-207 kernel: [50512.591589] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:25:38 juju-e4d256-prod-github-runner-207 kernel: [50512.592605] direct_page_fault+0x206/0x310 [kvm] Aug 22 19:25:38 juju-e4d256-prod-github-runner-207 kernel: [50512.593638] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 19:25:38 juju-e4d256-prod-github-runner-207 kernel: [50512.594648] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 19:25:38 juju-e4d256-prod-github-runner-207 kernel: [50512.595656] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 19:25:38 juju-e4d256-prod-github-runner-207 kernel: [50512.596644] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 19:25:38 juju-e4d256-prod-github-runner-207 kernel: [50512.597594] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 19:25:38 juju-e4d256-prod-github-runner-207 kernel: [50512.598579] handle_exit+0x98/0x230 [kvm_amd] Aug 22 19:25:38 juju-e4d256-prod-github-runner-207 kernel: [50512.599479] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 19:25:38 juju-e4d256-prod-github-runner-207 kernel: [50512.600392] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 19:25:38 juju-e4d256-prod-github-runner-207 kernel: [50512.601320] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 19:25:38 juju-e4d256-prod-github-runner-207 kernel: [50512.602222] vcpu_run+0x62/0x2c0 [kvm] Aug 22 19:25:38 juju-e4d256-prod-github-runner-207 kernel: [50512.603030] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 19:25:38 juju-e4d256-prod-github-runner-207 kernel: [50512.603851] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 19:25:38 juju-e4d256-prod-github-runner-207 kernel: [50512.604705] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 19:25:38 juju-e4d256-prod-github-runner-207 kernel: [50512.605499] ? __seccomp_filter+0x4a/0x4a0 Aug 22 19:25:38 juju-e4d256-prod-github-runner-207 kernel: [50512.606240] ? __fget_files+0x86/0xc0 Aug 22 19:25:38 juju-e4d256-prod-github-runner-207 kernel: [50512.606945] __x64_sys_ioctl+0x95/0xd0 Aug 22 19:25:38 juju-e4d256-prod-github-runner-207 kernel: [50512.607649] do_syscall_64+0x5c/0xc0 Aug 22 19:25:38 juju-e4d256-prod-github-runner-207 kernel: [50512.608311] ? do_futex+0x162/0x1f0 Aug 22 19:25:38 juju-e4d256-prod-github-runner-207 kernel: [50512.608958] ? __x64_sys_futex+0x78/0x1e0 Aug 22 19:25:38 juju-e4d256-prod-github-runner-207 kernel: [50512.609636] ? __secure_computing+0xa9/0x120 Aug 22 19:25:38 juju-e4d256-prod-github-runner-207 kernel: [50512.610323] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 19:25:38 juju-e4d256-prod-github-runner-207 kernel: [50512.611090] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:25:38 juju-e4d256-prod-github-runner-207 kernel: [50512.611810] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:25:38 juju-e4d256-prod-github-runner-207 kernel: [50512.612530] ? do_syscall_64+0x69/0xc0 Aug 22 19:25:38 juju-e4d256-prod-github-runner-207 kernel: [50512.613174] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:25:38 juju-e4d256-prod-github-runner-207 kernel: [50512.613878] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:25:38 juju-e4d256-prod-github-runner-207 kernel: [50512.614577] ? do_syscall_64+0x69/0xc0 Aug 22 19:25:38 juju-e4d256-prod-github-runner-207 kernel: [50512.615209] ? do_syscall_64+0x69/0xc0 Aug 22 19:25:38 juju-e4d256-prod-github-runner-207 kernel: [50512.615836] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 19:25:38 juju-e4d256-prod-github-runner-207 kernel: [50512.616540] RIP: 0033:0x7faa5d0edaff Aug 22 19:25:38 juju-e4d256-prod-github-runner-207 kernel: [50512.617194] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 19:25:38 juju-e4d256-prod-github-runner-207 kernel: [50512.619189] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 19:25:38 juju-e4d256-prod-github-runner-207 kernel: [50512.620100] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 19:25:38 juju-e4d256-prod-github-runner-207 kernel: [50512.620987] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 19:25:38 juju-e4d256-prod-github-runner-207 kernel: [50512.621874] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 19:25:38 juju-e4d256-prod-github-runner-207 kernel: [50512.622760] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 19:25:38 juju-e4d256-prod-github-runner-207 kernel: [50512.623808] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 19:25:38 juju-e4d256-prod-github-runner-207 kernel: [50512.624702] Aug 22 19:26:06 juju-e4d256-prod-github-runner-207 kernel: [50540.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 46961s! [qemu-system-x86:6715] Aug 22 19:26:06 juju-e4d256-prod-github-runner-207 kernel: [50540.543117] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 19:26:06 juju-e4d256-prod-github-runner-207 kernel: [50540.543186] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 19:26:06 juju-e4d256-prod-github-runner-207 kernel: [50540.555234] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 19:26:06 juju-e4d256-prod-github-runner-207 kernel: [50540.556499] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 19:26:06 juju-e4d256-prod-github-runner-207 kernel: [50540.557721] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:26:06 juju-e4d256-prod-github-runner-207 kernel: [50540.558803] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 19:26:06 juju-e4d256-prod-github-runner-207 kernel: [50540.561365] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 19:26:06 juju-e4d256-prod-github-runner-207 kernel: [50540.562408] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 19:26:06 juju-e4d256-prod-github-runner-207 kernel: [50540.563581] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 19:26:06 juju-e4d256-prod-github-runner-207 kernel: [50540.564747] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 19:26:06 juju-e4d256-prod-github-runner-207 kernel: [50540.565911] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 19:26:06 juju-e4d256-prod-github-runner-207 kernel: [50540.567087] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 19:26:06 juju-e4d256-prod-github-runner-207 kernel: [50540.568266] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 19:26:06 juju-e4d256-prod-github-runner-207 kernel: [50540.569500] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 19:26:06 juju-e4d256-prod-github-runner-207 kernel: [50540.570599] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 19:26:06 juju-e4d256-prod-github-runner-207 kernel: [50540.571806] Call Trace: Aug 22 19:26:06 juju-e4d256-prod-github-runner-207 kernel: [50540.572718] Aug 22 19:26:06 juju-e4d256-prod-github-runner-207 kernel: [50540.573602] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:26:06 juju-e4d256-prod-github-runner-207 kernel: [50540.574632] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:26:06 juju-e4d256-prod-github-runner-207 kernel: [50540.575669] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:26:06 juju-e4d256-prod-github-runner-207 kernel: [50540.576751] ? show_regs.part.0+0x23/0x29 Aug 22 19:26:06 juju-e4d256-prod-github-runner-207 kernel: [50540.577746] ? show_regs.cold+0x8/0xd Aug 22 19:26:06 juju-e4d256-prod-github-runner-207 kernel: [50540.578733] ? watchdog_timer_fn+0x1be/0x220 Aug 22 19:26:06 juju-e4d256-prod-github-runner-207 kernel: [50540.579741] ? lockup_detector_update_enable+0x60/0x60 Aug 22 19:26:06 juju-e4d256-prod-github-runner-207 kernel: [50540.580805] ? __hrtimer_run_queues+0x107/0x230 Aug 22 19:26:06 juju-e4d256-prod-github-runner-207 kernel: [50540.581832] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 19:26:06 juju-e4d256-prod-github-runner-207 kernel: [50540.582868] ? hrtimer_interrupt+0x101/0x220 Aug 22 19:26:06 juju-e4d256-prod-github-runner-207 kernel: [50540.583889] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 19:26:06 juju-e4d256-prod-github-runner-207 kernel: [50540.584957] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 19:26:06 juju-e4d256-prod-github-runner-207 kernel: [50540.586002] Aug 22 19:26:06 juju-e4d256-prod-github-runner-207 kernel: [50540.586867] Aug 22 19:26:06 juju-e4d256-prod-github-runner-207 kernel: [50540.587704] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 19:26:06 juju-e4d256-prod-github-runner-207 kernel: [50540.588737] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:26:06 juju-e4d256-prod-github-runner-207 kernel: [50540.589782] ? _raw_spin_lock+0x22/0x30 Aug 22 19:26:06 juju-e4d256-prod-github-runner-207 kernel: [50540.590739] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:26:06 juju-e4d256-prod-github-runner-207 kernel: [50540.591757] direct_page_fault+0x206/0x310 [kvm] Aug 22 19:26:06 juju-e4d256-prod-github-runner-207 kernel: [50540.592780] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 19:26:06 juju-e4d256-prod-github-runner-207 kernel: [50540.593793] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 19:26:06 juju-e4d256-prod-github-runner-207 kernel: [50540.594809] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 19:26:06 juju-e4d256-prod-github-runner-207 kernel: [50540.595779] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 19:26:06 juju-e4d256-prod-github-runner-207 kernel: [50540.596724] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 19:26:06 juju-e4d256-prod-github-runner-207 kernel: [50540.597702] handle_exit+0x98/0x230 [kvm_amd] Aug 22 19:26:06 juju-e4d256-prod-github-runner-207 kernel: [50540.598593] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 19:26:06 juju-e4d256-prod-github-runner-207 kernel: [50540.599523] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 19:26:06 juju-e4d256-prod-github-runner-207 kernel: [50540.600447] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 19:26:06 juju-e4d256-prod-github-runner-207 kernel: [50540.601362] vcpu_run+0x62/0x2c0 [kvm] Aug 22 19:26:06 juju-e4d256-prod-github-runner-207 kernel: [50540.602174] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 19:26:06 juju-e4d256-prod-github-runner-207 kernel: [50540.602997] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 19:26:06 juju-e4d256-prod-github-runner-207 kernel: [50540.603855] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 19:26:06 juju-e4d256-prod-github-runner-207 kernel: [50540.604654] ? __seccomp_filter+0x4a/0x4a0 Aug 22 19:26:06 juju-e4d256-prod-github-runner-207 kernel: [50540.605399] ? __fget_files+0x86/0xc0 Aug 22 19:26:06 juju-e4d256-prod-github-runner-207 kernel: [50540.606110] __x64_sys_ioctl+0x95/0xd0 Aug 22 19:26:06 juju-e4d256-prod-github-runner-207 kernel: [50540.606818] do_syscall_64+0x5c/0xc0 Aug 22 19:26:06 juju-e4d256-prod-github-runner-207 kernel: [50540.607484] ? do_futex+0x162/0x1f0 Aug 22 19:26:06 juju-e4d256-prod-github-runner-207 kernel: [50540.608132] ? __x64_sys_futex+0x78/0x1e0 Aug 22 19:26:06 juju-e4d256-prod-github-runner-207 kernel: [50540.608806] ? __secure_computing+0xa9/0x120 Aug 22 19:26:06 juju-e4d256-prod-github-runner-207 kernel: [50540.609497] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 19:26:06 juju-e4d256-prod-github-runner-207 kernel: [50540.610257] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:26:06 juju-e4d256-prod-github-runner-207 kernel: [50540.610989] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:26:06 juju-e4d256-prod-github-runner-207 kernel: [50540.611718] ? do_syscall_64+0x69/0xc0 Aug 22 19:26:06 juju-e4d256-prod-github-runner-207 kernel: [50540.612362] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:26:06 juju-e4d256-prod-github-runner-207 kernel: [50540.613064] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:26:06 juju-e4d256-prod-github-runner-207 kernel: [50540.613761] ? do_syscall_64+0x69/0xc0 Aug 22 19:26:06 juju-e4d256-prod-github-runner-207 kernel: [50540.614387] ? do_syscall_64+0x69/0xc0 Aug 22 19:26:06 juju-e4d256-prod-github-runner-207 kernel: [50540.615020] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 19:26:06 juju-e4d256-prod-github-runner-207 kernel: [50540.615726] RIP: 0033:0x7faa5d0edaff Aug 22 19:26:06 juju-e4d256-prod-github-runner-207 kernel: [50540.616351] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 19:26:06 juju-e4d256-prod-github-runner-207 kernel: [50540.618348] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 19:26:06 juju-e4d256-prod-github-runner-207 kernel: [50540.619279] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 19:26:06 juju-e4d256-prod-github-runner-207 kernel: [50540.620175] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 19:26:06 juju-e4d256-prod-github-runner-207 kernel: [50540.621070] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 19:26:06 juju-e4d256-prod-github-runner-207 kernel: [50540.621968] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 19:26:06 juju-e4d256-prod-github-runner-207 kernel: [50540.622871] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 19:26:06 juju-e4d256-prod-github-runner-207 kernel: [50540.623771] Aug 22 19:26:34 juju-e4d256-prod-github-runner-207 kernel: [50568.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 46987s! [qemu-system-x86:6715] Aug 22 19:26:34 juju-e4d256-prod-github-runner-207 kernel: [50568.543120] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 19:26:34 juju-e4d256-prod-github-runner-207 kernel: [50568.543193] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 19:26:34 juju-e4d256-prod-github-runner-207 kernel: [50568.555407] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 19:26:34 juju-e4d256-prod-github-runner-207 kernel: [50568.556664] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 19:26:34 juju-e4d256-prod-github-runner-207 kernel: [50568.557880] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:26:34 juju-e4d256-prod-github-runner-207 kernel: [50568.558946] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 19:26:34 juju-e4d256-prod-github-runner-207 kernel: [50568.561494] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 19:26:34 juju-e4d256-prod-github-runner-207 kernel: [50568.562544] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 19:26:34 juju-e4d256-prod-github-runner-207 kernel: [50568.563704] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 19:26:34 juju-e4d256-prod-github-runner-207 kernel: [50568.564936] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 19:26:34 juju-e4d256-prod-github-runner-207 kernel: [50568.566112] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 19:26:34 juju-e4d256-prod-github-runner-207 kernel: [50568.567295] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 19:26:34 juju-e4d256-prod-github-runner-207 kernel: [50568.568456] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 19:26:34 juju-e4d256-prod-github-runner-207 kernel: [50568.569688] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 19:26:34 juju-e4d256-prod-github-runner-207 kernel: [50568.570804] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 19:26:34 juju-e4d256-prod-github-runner-207 kernel: [50568.572004] Call Trace: Aug 22 19:26:34 juju-e4d256-prod-github-runner-207 kernel: [50568.572912] Aug 22 19:26:34 juju-e4d256-prod-github-runner-207 kernel: [50568.573792] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:26:34 juju-e4d256-prod-github-runner-207 kernel: [50568.574880] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:26:34 juju-e4d256-prod-github-runner-207 kernel: [50568.575909] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:26:34 juju-e4d256-prod-github-runner-207 kernel: [50568.576983] ? show_regs.part.0+0x23/0x29 Aug 22 19:26:34 juju-e4d256-prod-github-runner-207 kernel: [50568.577978] ? show_regs.cold+0x8/0xd Aug 22 19:26:34 juju-e4d256-prod-github-runner-207 kernel: [50568.579081] ? watchdog_timer_fn+0x1be/0x220 Aug 22 19:26:34 juju-e4d256-prod-github-runner-207 kernel: [50568.580099] ? lockup_detector_update_enable+0x60/0x60 Aug 22 19:26:34 juju-e4d256-prod-github-runner-207 kernel: [50568.581165] ? __hrtimer_run_queues+0x107/0x230 Aug 22 19:26:34 juju-e4d256-prod-github-runner-207 kernel: [50568.582255] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 19:26:34 juju-e4d256-prod-github-runner-207 kernel: [50568.583301] ? hrtimer_interrupt+0x101/0x220 Aug 22 19:26:34 juju-e4d256-prod-github-runner-207 kernel: [50568.584322] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 19:26:34 juju-e4d256-prod-github-runner-207 kernel: [50568.585392] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 19:26:34 juju-e4d256-prod-github-runner-207 kernel: [50568.586456] Aug 22 19:26:34 juju-e4d256-prod-github-runner-207 kernel: [50568.587312] Aug 22 19:26:34 juju-e4d256-prod-github-runner-207 kernel: [50568.588156] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 19:26:34 juju-e4d256-prod-github-runner-207 kernel: [50568.589190] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:26:34 juju-e4d256-prod-github-runner-207 kernel: [50568.590225] ? _raw_spin_lock+0x22/0x30 Aug 22 19:26:34 juju-e4d256-prod-github-runner-207 kernel: [50568.591186] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:26:34 juju-e4d256-prod-github-runner-207 kernel: [50568.592202] direct_page_fault+0x206/0x310 [kvm] Aug 22 19:26:34 juju-e4d256-prod-github-runner-207 kernel: [50568.593222] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 19:26:34 juju-e4d256-prod-github-runner-207 kernel: [50568.594234] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 19:26:34 juju-e4d256-prod-github-runner-207 kernel: [50568.595247] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 19:26:34 juju-e4d256-prod-github-runner-207 kernel: [50568.596215] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 19:26:34 juju-e4d256-prod-github-runner-207 kernel: [50568.597158] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 19:26:34 juju-e4d256-prod-github-runner-207 kernel: [50568.598134] handle_exit+0x98/0x230 [kvm_amd] Aug 22 19:26:34 juju-e4d256-prod-github-runner-207 kernel: [50568.599035] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 19:26:34 juju-e4d256-prod-github-runner-207 kernel: [50568.599946] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 19:26:34 juju-e4d256-prod-github-runner-207 kernel: [50568.600874] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 19:26:34 juju-e4d256-prod-github-runner-207 kernel: [50568.601776] vcpu_run+0x62/0x2c0 [kvm] Aug 22 19:26:34 juju-e4d256-prod-github-runner-207 kernel: [50568.602599] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 19:26:34 juju-e4d256-prod-github-runner-207 kernel: [50568.603405] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 19:26:34 juju-e4d256-prod-github-runner-207 kernel: [50568.604257] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 19:26:34 juju-e4d256-prod-github-runner-207 kernel: [50568.605057] ? __seccomp_filter+0x4a/0x4a0 Aug 22 19:26:34 juju-e4d256-prod-github-runner-207 kernel: [50568.605799] ? __fget_files+0x86/0xc0 Aug 22 19:26:34 juju-e4d256-prod-github-runner-207 kernel: [50568.606511] __x64_sys_ioctl+0x95/0xd0 Aug 22 19:26:34 juju-e4d256-prod-github-runner-207 kernel: [50568.607208] do_syscall_64+0x5c/0xc0 Aug 22 19:26:34 juju-e4d256-prod-github-runner-207 kernel: [50568.607869] ? do_futex+0x162/0x1f0 Aug 22 19:26:34 juju-e4d256-prod-github-runner-207 kernel: [50568.608515] ? __x64_sys_futex+0x78/0x1e0 Aug 22 19:26:34 juju-e4d256-prod-github-runner-207 kernel: [50568.609187] ? __secure_computing+0xa9/0x120 Aug 22 19:26:34 juju-e4d256-prod-github-runner-207 kernel: [50568.609874] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 19:26:34 juju-e4d256-prod-github-runner-207 kernel: [50568.610643] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:26:34 juju-e4d256-prod-github-runner-207 kernel: [50568.611364] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:26:34 juju-e4d256-prod-github-runner-207 kernel: [50568.612080] ? do_syscall_64+0x69/0xc0 Aug 22 19:26:34 juju-e4d256-prod-github-runner-207 kernel: [50568.612723] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:26:34 juju-e4d256-prod-github-runner-207 kernel: [50568.613423] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:26:34 juju-e4d256-prod-github-runner-207 kernel: [50568.614116] ? do_syscall_64+0x69/0xc0 Aug 22 19:26:34 juju-e4d256-prod-github-runner-207 kernel: [50568.614756] ? do_syscall_64+0x69/0xc0 Aug 22 19:26:34 juju-e4d256-prod-github-runner-207 kernel: [50568.615383] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 19:26:34 juju-e4d256-prod-github-runner-207 kernel: [50568.616091] RIP: 0033:0x7faa5d0edaff Aug 22 19:26:34 juju-e4d256-prod-github-runner-207 kernel: [50568.616892] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 19:26:34 juju-e4d256-prod-github-runner-207 kernel: [50568.618891] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 19:26:34 juju-e4d256-prod-github-runner-207 kernel: [50568.619801] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 19:26:34 juju-e4d256-prod-github-runner-207 kernel: [50568.620688] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 19:26:34 juju-e4d256-prod-github-runner-207 kernel: [50568.621584] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 19:26:34 juju-e4d256-prod-github-runner-207 kernel: [50568.622485] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 19:26:34 juju-e4d256-prod-github-runner-207 kernel: [50568.623372] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 19:26:34 juju-e4d256-prod-github-runner-207 kernel: [50568.624266] Aug 22 19:26:46 juju-e4d256-prod-github-runner-207 kernel: [50580.560708] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 19:26:46 juju-e4d256-prod-github-runner-207 kernel: [50580.561693] rcu: 1-....: (12576175 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=6080862 Aug 22 19:26:46 juju-e4d256-prod-github-runner-207 kernel: [50580.562836] (t=12615840 jiffies g=23269 q=48034) Aug 22 19:26:46 juju-e4d256-prod-github-runner-207 kernel: [50580.563623] NMI backtrace for cpu 1 Aug 22 19:26:46 juju-e4d256-prod-github-runner-207 kernel: [50580.564336] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 19:26:46 juju-e4d256-prod-github-runner-207 kernel: [50580.565438] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 19:26:46 juju-e4d256-prod-github-runner-207 kernel: [50580.566507] Call Trace: Aug 22 19:26:46 juju-e4d256-prod-github-runner-207 kernel: [50580.567188] Aug 22 19:26:46 juju-e4d256-prod-github-runner-207 kernel: [50580.567831] show_stack+0x52/0x5c Aug 22 19:26:46 juju-e4d256-prod-github-runner-207 kernel: [50580.568556] dump_stack_lvl+0x4a/0x63 Aug 22 19:26:46 juju-e4d256-prod-github-runner-207 kernel: [50580.569302] dump_stack+0x10/0x16 Aug 22 19:26:46 juju-e4d256-prod-github-runner-207 kernel: [50580.570018] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 19:26:46 juju-e4d256-prod-github-runner-207 kernel: [50580.570809] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 19:26:46 juju-e4d256-prod-github-runner-207 kernel: [50580.571592] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 19:26:46 juju-e4d256-prod-github-runner-207 kernel: [50580.572413] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 19:26:46 juju-e4d256-prod-github-runner-207 kernel: [50580.573237] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 19:26:46 juju-e4d256-prod-github-runner-207 kernel: [50580.574046] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 19:26:46 juju-e4d256-prod-github-runner-207 kernel: [50580.574836] print_cpu_stall.cold+0x2f/0xe2 Aug 22 19:26:46 juju-e4d256-prod-github-runner-207 kernel: [50580.575599] ? timekeeping_update+0xf7/0x150 Aug 22 19:26:46 juju-e4d256-prod-github-runner-207 kernel: [50580.576373] check_cpu_stall+0x109/0x270 Aug 22 19:26:46 juju-e4d256-prod-github-runner-207 kernel: [50580.577124] rcu_sched_clock_irq+0x9a/0x250 Aug 22 19:26:46 juju-e4d256-prod-github-runner-207 kernel: [50580.577885] update_process_times+0x94/0xd0 Aug 22 19:26:46 juju-e4d256-prod-github-runner-207 kernel: [50580.578663] tick_sched_handle+0x29/0x70 Aug 22 19:26:46 juju-e4d256-prod-github-runner-207 kernel: [50580.579415] tick_sched_timer+0x8c/0xc0 Aug 22 19:26:46 juju-e4d256-prod-github-runner-207 kernel: [50580.580153] ? tick_nohz_handler+0xb0/0xb0 Aug 22 19:26:46 juju-e4d256-prod-github-runner-207 kernel: [50580.580907] __hrtimer_run_queues+0x107/0x230 Aug 22 19:26:46 juju-e4d256-prod-github-runner-207 kernel: [50580.581680] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 19:26:46 juju-e4d256-prod-github-runner-207 kernel: [50580.582468] hrtimer_interrupt+0x101/0x220 Aug 22 19:26:46 juju-e4d256-prod-github-runner-207 kernel: [50580.583227] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 19:26:46 juju-e4d256-prod-github-runner-207 kernel: [50580.584037] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 19:26:46 juju-e4d256-prod-github-runner-207 kernel: [50580.584843] Aug 22 19:26:46 juju-e4d256-prod-github-runner-207 kernel: [50580.585476] Aug 22 19:26:46 juju-e4d256-prod-github-runner-207 kernel: [50580.586103] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 19:26:46 juju-e4d256-prod-github-runner-207 kernel: [50580.586933] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:26:46 juju-e4d256-prod-github-runner-207 kernel: [50580.587816] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 19:26:46 juju-e4d256-prod-github-runner-207 kernel: [50580.590030] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 19:26:46 juju-e4d256-prod-github-runner-207 kernel: [50580.590918] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 19:26:46 juju-e4d256-prod-github-runner-207 kernel: [50580.591909] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 19:26:46 juju-e4d256-prod-github-runner-207 kernel: [50580.592885] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 19:26:46 juju-e4d256-prod-github-runner-207 kernel: [50580.593848] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 19:26:46 juju-e4d256-prod-github-runner-207 kernel: [50580.594821] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 19:26:46 juju-e4d256-prod-github-runner-207 kernel: [50580.595773] ? _raw_spin_lock+0x22/0x30 Aug 22 19:26:46 juju-e4d256-prod-github-runner-207 kernel: [50580.596535] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:26:46 juju-e4d256-prod-github-runner-207 kernel: [50580.597369] direct_page_fault+0x206/0x310 [kvm] Aug 22 19:26:46 juju-e4d256-prod-github-runner-207 kernel: [50580.598215] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 19:26:46 juju-e4d256-prod-github-runner-207 kernel: [50580.599044] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 19:26:46 juju-e4d256-prod-github-runner-207 kernel: [50580.599872] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 19:26:46 juju-e4d256-prod-github-runner-207 kernel: [50580.600675] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 19:26:46 juju-e4d256-prod-github-runner-207 kernel: [50580.601460] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 19:26:46 juju-e4d256-prod-github-runner-207 kernel: [50580.602290] handle_exit+0x98/0x230 [kvm_amd] Aug 22 19:26:46 juju-e4d256-prod-github-runner-207 kernel: [50580.603045] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 19:26:46 juju-e4d256-prod-github-runner-207 kernel: [50580.603827] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 19:26:46 juju-e4d256-prod-github-runner-207 kernel: [50580.604631] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 19:26:46 juju-e4d256-prod-github-runner-207 kernel: [50580.605421] vcpu_run+0x62/0x2c0 [kvm] Aug 22 19:26:46 juju-e4d256-prod-github-runner-207 kernel: [50580.606134] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 19:26:46 juju-e4d256-prod-github-runner-207 kernel: [50580.606876] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 19:26:46 juju-e4d256-prod-github-runner-207 kernel: [50580.607675] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 19:26:46 juju-e4d256-prod-github-runner-207 kernel: [50580.608434] ? __seccomp_filter+0x4a/0x4a0 Aug 22 19:26:46 juju-e4d256-prod-github-runner-207 kernel: [50580.609157] ? __fget_files+0x86/0xc0 Aug 22 19:26:46 juju-e4d256-prod-github-runner-207 kernel: [50580.609849] __x64_sys_ioctl+0x95/0xd0 Aug 22 19:26:46 juju-e4d256-prod-github-runner-207 kernel: [50580.610554] do_syscall_64+0x5c/0xc0 Aug 22 19:26:46 juju-e4d256-prod-github-runner-207 kernel: [50580.611235] ? do_futex+0x162/0x1f0 Aug 22 19:26:46 juju-e4d256-prod-github-runner-207 kernel: [50580.611904] ? __x64_sys_futex+0x78/0x1e0 Aug 22 19:26:46 juju-e4d256-prod-github-runner-207 kernel: [50580.612610] ? __secure_computing+0xa9/0x120 Aug 22 19:26:46 juju-e4d256-prod-github-runner-207 kernel: [50580.613329] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 19:26:46 juju-e4d256-prod-github-runner-207 kernel: [50580.614117] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:26:46 juju-e4d256-prod-github-runner-207 kernel: [50580.614883] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:26:46 juju-e4d256-prod-github-runner-207 kernel: [50580.615641] ? do_syscall_64+0x69/0xc0 Aug 22 19:26:46 juju-e4d256-prod-github-runner-207 kernel: [50580.616328] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:26:46 juju-e4d256-prod-github-runner-207 kernel: [50580.617082] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:26:46 juju-e4d256-prod-github-runner-207 kernel: [50580.617837] ? do_syscall_64+0x69/0xc0 Aug 22 19:26:46 juju-e4d256-prod-github-runner-207 kernel: [50580.618550] ? do_syscall_64+0x69/0xc0 Aug 22 19:26:46 juju-e4d256-prod-github-runner-207 kernel: [50580.619242] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 19:26:46 juju-e4d256-prod-github-runner-207 kernel: [50580.620010] RIP: 0033:0x7faa5d0edaff Aug 22 19:26:46 juju-e4d256-prod-github-runner-207 kernel: [50580.620696] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 19:26:46 juju-e4d256-prod-github-runner-207 kernel: [50580.622803] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 19:26:46 juju-e4d256-prod-github-runner-207 kernel: [50580.623765] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 19:26:46 juju-e4d256-prod-github-runner-207 kernel: [50580.624711] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 19:26:46 juju-e4d256-prod-github-runner-207 kernel: [50580.625655] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 19:26:46 juju-e4d256-prod-github-runner-207 kernel: [50580.626603] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 19:26:46 juju-e4d256-prod-github-runner-207 kernel: [50580.627534] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 19:26:46 juju-e4d256-prod-github-runner-207 kernel: [50580.628447] Aug 22 19:27:14 juju-e4d256-prod-github-runner-207 kernel: [50608.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 47024s! [qemu-system-x86:6715] Aug 22 19:27:14 juju-e4d256-prod-github-runner-207 kernel: [50608.543852] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 19:27:14 juju-e4d256-prod-github-runner-207 kernel: [50608.544137] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 19:27:14 juju-e4d256-prod-github-runner-207 kernel: [50608.556526] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 19:27:14 juju-e4d256-prod-github-runner-207 kernel: [50608.557797] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 19:27:14 juju-e4d256-prod-github-runner-207 kernel: [50608.559047] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:27:14 juju-e4d256-prod-github-runner-207 kernel: [50608.560119] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 19:27:14 juju-e4d256-prod-github-runner-207 kernel: [50608.562697] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 19:27:14 juju-e4d256-prod-github-runner-207 kernel: [50608.563746] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 19:27:14 juju-e4d256-prod-github-runner-207 kernel: [50608.564930] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 19:27:14 juju-e4d256-prod-github-runner-207 kernel: [50608.566111] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 19:27:14 juju-e4d256-prod-github-runner-207 kernel: [50608.567283] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 19:27:14 juju-e4d256-prod-github-runner-207 kernel: [50608.568521] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 19:27:14 juju-e4d256-prod-github-runner-207 kernel: [50608.569726] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 19:27:14 juju-e4d256-prod-github-runner-207 kernel: [50608.571023] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 19:27:14 juju-e4d256-prod-github-runner-207 kernel: [50608.572139] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 19:27:14 juju-e4d256-prod-github-runner-207 kernel: [50608.573336] Call Trace: Aug 22 19:27:14 juju-e4d256-prod-github-runner-207 kernel: [50608.574290] Aug 22 19:27:14 juju-e4d256-prod-github-runner-207 kernel: [50608.575209] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:27:14 juju-e4d256-prod-github-runner-207 kernel: [50608.576252] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:27:14 juju-e4d256-prod-github-runner-207 kernel: [50608.577279] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:27:14 juju-e4d256-prod-github-runner-207 kernel: [50608.578411] ? show_regs.part.0+0x23/0x29 Aug 22 19:27:14 juju-e4d256-prod-github-runner-207 kernel: [50608.579471] ? show_regs.cold+0x8/0xd Aug 22 19:27:14 juju-e4d256-prod-github-runner-207 kernel: [50608.580469] ? watchdog_timer_fn+0x1be/0x220 Aug 22 19:27:14 juju-e4d256-prod-github-runner-207 kernel: [50608.581495] ? lockup_detector_update_enable+0x60/0x60 Aug 22 19:27:14 juju-e4d256-prod-github-runner-207 kernel: [50608.582623] ? __hrtimer_run_queues+0x107/0x230 Aug 22 19:27:14 juju-e4d256-prod-github-runner-207 kernel: [50608.583655] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 19:27:14 juju-e4d256-prod-github-runner-207 kernel: [50608.584697] ? hrtimer_interrupt+0x101/0x220 Aug 22 19:27:14 juju-e4d256-prod-github-runner-207 kernel: [50608.585729] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 19:27:14 juju-e4d256-prod-github-runner-207 kernel: [50608.586852] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 19:27:14 juju-e4d256-prod-github-runner-207 kernel: [50608.587903] Aug 22 19:27:14 juju-e4d256-prod-github-runner-207 kernel: [50608.588762] Aug 22 19:27:14 juju-e4d256-prod-github-runner-207 kernel: [50608.589613] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 19:27:14 juju-e4d256-prod-github-runner-207 kernel: [50608.590681] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:27:14 juju-e4d256-prod-github-runner-207 kernel: [50608.591727] ? _raw_spin_lock+0x22/0x30 Aug 22 19:27:14 juju-e4d256-prod-github-runner-207 kernel: [50608.592682] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:27:14 juju-e4d256-prod-github-runner-207 kernel: [50608.593709] direct_page_fault+0x206/0x310 [kvm] Aug 22 19:27:14 juju-e4d256-prod-github-runner-207 kernel: [50608.594767] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 19:27:14 juju-e4d256-prod-github-runner-207 kernel: [50608.595784] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 19:27:14 juju-e4d256-prod-github-runner-207 kernel: [50608.596803] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 19:27:14 juju-e4d256-prod-github-runner-207 kernel: [50608.597805] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 19:27:14 juju-e4d256-prod-github-runner-207 kernel: [50608.598768] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 19:27:14 juju-e4d256-prod-github-runner-207 kernel: [50608.599752] handle_exit+0x98/0x230 [kvm_amd] Aug 22 19:27:14 juju-e4d256-prod-github-runner-207 kernel: [50608.600730] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 19:27:14 juju-e4d256-prod-github-runner-207 kernel: [50608.601688] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 19:27:14 juju-e4d256-prod-github-runner-207 kernel: [50608.602635] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 19:27:14 juju-e4d256-prod-github-runner-207 kernel: [50608.603570] vcpu_run+0x62/0x2c0 [kvm] Aug 22 19:27:14 juju-e4d256-prod-github-runner-207 kernel: [50608.604383] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 19:27:14 juju-e4d256-prod-github-runner-207 kernel: [50608.605202] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 19:27:14 juju-e4d256-prod-github-runner-207 kernel: [50608.606119] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 19:27:14 juju-e4d256-prod-github-runner-207 kernel: [50608.606937] ? __seccomp_filter+0x4a/0x4a0 Aug 22 19:27:14 juju-e4d256-prod-github-runner-207 kernel: [50608.607722] ? __fget_files+0x86/0xc0 Aug 22 19:27:14 juju-e4d256-prod-github-runner-207 kernel: [50608.608431] __x64_sys_ioctl+0x95/0xd0 Aug 22 19:27:14 juju-e4d256-prod-github-runner-207 kernel: [50608.609128] do_syscall_64+0x5c/0xc0 Aug 22 19:27:14 juju-e4d256-prod-github-runner-207 kernel: [50608.609796] ? do_futex+0x162/0x1f0 Aug 22 19:27:14 juju-e4d256-prod-github-runner-207 kernel: [50608.610473] ? __x64_sys_futex+0x78/0x1e0 Aug 22 19:27:14 juju-e4d256-prod-github-runner-207 kernel: [50608.611154] ? __secure_computing+0xa9/0x120 Aug 22 19:27:14 juju-e4d256-prod-github-runner-207 kernel: [50608.611864] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 19:27:14 juju-e4d256-prod-github-runner-207 kernel: [50608.612667] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:27:14 juju-e4d256-prod-github-runner-207 kernel: [50608.613393] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:27:14 juju-e4d256-prod-github-runner-207 kernel: [50608.614140] ? do_syscall_64+0x69/0xc0 Aug 22 19:27:14 juju-e4d256-prod-github-runner-207 kernel: [50608.614796] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:27:14 juju-e4d256-prod-github-runner-207 kernel: [50608.615513] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:27:14 juju-e4d256-prod-github-runner-207 kernel: [50608.616215] ? do_syscall_64+0x69/0xc0 Aug 22 19:27:14 juju-e4d256-prod-github-runner-207 kernel: [50608.616860] ? do_syscall_64+0x69/0xc0 Aug 22 19:27:14 juju-e4d256-prod-github-runner-207 kernel: [50608.617486] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 19:27:14 juju-e4d256-prod-github-runner-207 kernel: [50608.618203] RIP: 0033:0x7faa5d0edaff Aug 22 19:27:14 juju-e4d256-prod-github-runner-207 kernel: [50608.618852] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 19:27:14 juju-e4d256-prod-github-runner-207 kernel: [50608.620870] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 19:27:14 juju-e4d256-prod-github-runner-207 kernel: [50608.621808] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 19:27:14 juju-e4d256-prod-github-runner-207 kernel: [50608.622729] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 19:27:14 juju-e4d256-prod-github-runner-207 kernel: [50608.623622] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 19:27:14 juju-e4d256-prod-github-runner-207 kernel: [50608.624510] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 19:27:14 juju-e4d256-prod-github-runner-207 kernel: [50608.625435] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 19:27:14 juju-e4d256-prod-github-runner-207 kernel: [50608.626382] Aug 22 19:27:42 juju-e4d256-prod-github-runner-207 kernel: [50636.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 47050s! [qemu-system-x86:6715] Aug 22 19:27:42 juju-e4d256-prod-github-runner-207 kernel: [50636.543183] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 19:27:42 juju-e4d256-prod-github-runner-207 kernel: [50636.543263] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 19:27:42 juju-e4d256-prod-github-runner-207 kernel: [50636.555335] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 19:27:42 juju-e4d256-prod-github-runner-207 kernel: [50636.556739] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 19:27:42 juju-e4d256-prod-github-runner-207 kernel: [50636.557987] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:27:42 juju-e4d256-prod-github-runner-207 kernel: [50636.559086] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 19:27:42 juju-e4d256-prod-github-runner-207 kernel: [50636.561636] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 19:27:42 juju-e4d256-prod-github-runner-207 kernel: [50636.562695] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 19:27:42 juju-e4d256-prod-github-runner-207 kernel: [50636.563888] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 19:27:42 juju-e4d256-prod-github-runner-207 kernel: [50636.565044] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 19:27:42 juju-e4d256-prod-github-runner-207 kernel: [50636.566213] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 19:27:42 juju-e4d256-prod-github-runner-207 kernel: [50636.567373] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 19:27:42 juju-e4d256-prod-github-runner-207 kernel: [50636.568575] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 19:27:42 juju-e4d256-prod-github-runner-207 kernel: [50636.569828] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 19:27:42 juju-e4d256-prod-github-runner-207 kernel: [50636.570925] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 19:27:42 juju-e4d256-prod-github-runner-207 kernel: [50636.572153] Call Trace: Aug 22 19:27:42 juju-e4d256-prod-github-runner-207 kernel: [50636.573068] Aug 22 19:27:42 juju-e4d256-prod-github-runner-207 kernel: [50636.574007] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:27:42 juju-e4d256-prod-github-runner-207 kernel: [50636.575037] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:27:42 juju-e4d256-prod-github-runner-207 kernel: [50636.576061] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:27:42 juju-e4d256-prod-github-runner-207 kernel: [50636.577173] ? show_regs.part.0+0x23/0x29 Aug 22 19:27:42 juju-e4d256-prod-github-runner-207 kernel: [50636.578181] ? show_regs.cold+0x8/0xd Aug 22 19:27:42 juju-e4d256-prod-github-runner-207 kernel: [50636.579158] ? watchdog_timer_fn+0x1be/0x220 Aug 22 19:27:42 juju-e4d256-prod-github-runner-207 kernel: [50636.580165] ? lockup_detector_update_enable+0x60/0x60 Aug 22 19:27:42 juju-e4d256-prod-github-runner-207 kernel: [50636.581226] ? __hrtimer_run_queues+0x107/0x230 Aug 22 19:27:42 juju-e4d256-prod-github-runner-207 kernel: [50636.582267] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 19:27:42 juju-e4d256-prod-github-runner-207 kernel: [50636.583295] ? hrtimer_interrupt+0x101/0x220 Aug 22 19:27:42 juju-e4d256-prod-github-runner-207 kernel: [50636.584352] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 19:27:42 juju-e4d256-prod-github-runner-207 kernel: [50636.585419] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 19:27:42 juju-e4d256-prod-github-runner-207 kernel: [50636.586481] Aug 22 19:27:42 juju-e4d256-prod-github-runner-207 kernel: [50636.587331] Aug 22 19:27:42 juju-e4d256-prod-github-runner-207 kernel: [50636.588200] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 19:27:42 juju-e4d256-prod-github-runner-207 kernel: [50636.589237] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:27:42 juju-e4d256-prod-github-runner-207 kernel: [50636.590285] ? _raw_spin_lock+0x22/0x30 Aug 22 19:27:42 juju-e4d256-prod-github-runner-207 kernel: [50636.591326] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:27:42 juju-e4d256-prod-github-runner-207 kernel: [50636.592339] direct_page_fault+0x206/0x310 [kvm] Aug 22 19:27:42 juju-e4d256-prod-github-runner-207 kernel: [50636.593366] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 19:27:42 juju-e4d256-prod-github-runner-207 kernel: [50636.594391] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 19:27:42 juju-e4d256-prod-github-runner-207 kernel: [50636.595396] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 19:27:42 juju-e4d256-prod-github-runner-207 kernel: [50636.596369] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 19:27:42 juju-e4d256-prod-github-runner-207 kernel: [50636.597313] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 19:27:42 juju-e4d256-prod-github-runner-207 kernel: [50636.598307] handle_exit+0x98/0x230 [kvm_amd] Aug 22 19:27:42 juju-e4d256-prod-github-runner-207 kernel: [50636.599236] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 19:27:42 juju-e4d256-prod-github-runner-207 kernel: [50636.600149] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 19:27:42 juju-e4d256-prod-github-runner-207 kernel: [50636.601070] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 19:27:42 juju-e4d256-prod-github-runner-207 kernel: [50636.601987] vcpu_run+0x62/0x2c0 [kvm] Aug 22 19:27:42 juju-e4d256-prod-github-runner-207 kernel: [50636.602796] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 19:27:42 juju-e4d256-prod-github-runner-207 kernel: [50636.603602] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 19:27:42 juju-e4d256-prod-github-runner-207 kernel: [50636.604454] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 19:27:42 juju-e4d256-prod-github-runner-207 kernel: [50636.605259] ? __seccomp_filter+0x4a/0x4a0 Aug 22 19:27:42 juju-e4d256-prod-github-runner-207 kernel: [50636.606013] ? __fget_files+0x86/0xc0 Aug 22 19:27:42 juju-e4d256-prod-github-runner-207 kernel: [50636.606715] __x64_sys_ioctl+0x95/0xd0 Aug 22 19:27:42 juju-e4d256-prod-github-runner-207 kernel: [50636.607405] do_syscall_64+0x5c/0xc0 Aug 22 19:27:42 juju-e4d256-prod-github-runner-207 kernel: [50636.608068] ? do_futex+0x162/0x1f0 Aug 22 19:27:42 juju-e4d256-prod-github-runner-207 kernel: [50636.608715] ? __x64_sys_futex+0x78/0x1e0 Aug 22 19:27:42 juju-e4d256-prod-github-runner-207 kernel: [50636.609387] ? __secure_computing+0xa9/0x120 Aug 22 19:27:42 juju-e4d256-prod-github-runner-207 kernel: [50636.610090] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 19:27:42 juju-e4d256-prod-github-runner-207 kernel: [50636.610855] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:27:42 juju-e4d256-prod-github-runner-207 kernel: [50636.611574] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:27:42 juju-e4d256-prod-github-runner-207 kernel: [50636.612290] ? do_syscall_64+0x69/0xc0 Aug 22 19:27:42 juju-e4d256-prod-github-runner-207 kernel: [50636.612932] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:27:42 juju-e4d256-prod-github-runner-207 kernel: [50636.613659] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:27:42 juju-e4d256-prod-github-runner-207 kernel: [50636.614381] ? do_syscall_64+0x69/0xc0 Aug 22 19:27:42 juju-e4d256-prod-github-runner-207 kernel: [50636.615007] ? do_syscall_64+0x69/0xc0 Aug 22 19:27:42 juju-e4d256-prod-github-runner-207 kernel: [50636.615639] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 19:27:42 juju-e4d256-prod-github-runner-207 kernel: [50636.616375] RIP: 0033:0x7faa5d0edaff Aug 22 19:27:42 juju-e4d256-prod-github-runner-207 kernel: [50636.617219] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 19:27:42 juju-e4d256-prod-github-runner-207 kernel: [50636.619380] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 19:27:42 juju-e4d256-prod-github-runner-207 kernel: [50636.620288] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 19:27:42 juju-e4d256-prod-github-runner-207 kernel: [50636.621177] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 19:27:42 juju-e4d256-prod-github-runner-207 kernel: [50636.622077] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 19:27:42 juju-e4d256-prod-github-runner-207 kernel: [50636.622962] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 19:27:42 juju-e4d256-prod-github-runner-207 kernel: [50636.623851] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 19:27:42 juju-e4d256-prod-github-runner-207 kernel: [50636.624741] Aug 22 19:28:10 juju-e4d256-prod-github-runner-207 kernel: [50664.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 47077s! [qemu-system-x86:6715] Aug 22 19:28:10 juju-e4d256-prod-github-runner-207 kernel: [50664.543160] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 19:28:10 juju-e4d256-prod-github-runner-207 kernel: [50664.543240] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 19:28:10 juju-e4d256-prod-github-runner-207 kernel: [50664.555497] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 19:28:10 juju-e4d256-prod-github-runner-207 kernel: [50664.556764] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 19:28:10 juju-e4d256-prod-github-runner-207 kernel: [50664.558006] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:28:10 juju-e4d256-prod-github-runner-207 kernel: [50664.559069] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 19:28:10 juju-e4d256-prod-github-runner-207 kernel: [50664.561637] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 19:28:10 juju-e4d256-prod-github-runner-207 kernel: [50664.562704] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 19:28:10 juju-e4d256-prod-github-runner-207 kernel: [50664.563887] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 19:28:10 juju-e4d256-prod-github-runner-207 kernel: [50664.565052] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 19:28:10 juju-e4d256-prod-github-runner-207 kernel: [50664.566247] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 19:28:10 juju-e4d256-prod-github-runner-207 kernel: [50664.567430] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 19:28:10 juju-e4d256-prod-github-runner-207 kernel: [50664.568614] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 19:28:10 juju-e4d256-prod-github-runner-207 kernel: [50664.569869] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 19:28:10 juju-e4d256-prod-github-runner-207 kernel: [50664.570977] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 19:28:10 juju-e4d256-prod-github-runner-207 kernel: [50664.572183] Call Trace: Aug 22 19:28:10 juju-e4d256-prod-github-runner-207 kernel: [50664.573119] Aug 22 19:28:10 juju-e4d256-prod-github-runner-207 kernel: [50664.574031] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:28:10 juju-e4d256-prod-github-runner-207 kernel: [50664.575068] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:28:10 juju-e4d256-prod-github-runner-207 kernel: [50664.576101] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:28:10 juju-e4d256-prod-github-runner-207 kernel: [50664.577205] ? show_regs.part.0+0x23/0x29 Aug 22 19:28:10 juju-e4d256-prod-github-runner-207 kernel: [50664.578221] ? show_regs.cold+0x8/0xd Aug 22 19:28:10 juju-e4d256-prod-github-runner-207 kernel: [50664.579198] ? watchdog_timer_fn+0x1be/0x220 Aug 22 19:28:10 juju-e4d256-prod-github-runner-207 kernel: [50664.580215] ? lockup_detector_update_enable+0x60/0x60 Aug 22 19:28:10 juju-e4d256-prod-github-runner-207 kernel: [50664.581298] ? __hrtimer_run_queues+0x107/0x230 Aug 22 19:28:10 juju-e4d256-prod-github-runner-207 kernel: [50664.582341] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 19:28:10 juju-e4d256-prod-github-runner-207 kernel: [50664.583406] ? hrtimer_interrupt+0x101/0x220 Aug 22 19:28:10 juju-e4d256-prod-github-runner-207 kernel: [50664.584532] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 19:28:10 juju-e4d256-prod-github-runner-207 kernel: [50664.585636] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 19:28:10 juju-e4d256-prod-github-runner-207 kernel: [50664.586695] Aug 22 19:28:10 juju-e4d256-prod-github-runner-207 kernel: [50664.587570] Aug 22 19:28:10 juju-e4d256-prod-github-runner-207 kernel: [50664.588439] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 19:28:10 juju-e4d256-prod-github-runner-207 kernel: [50664.589518] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:28:10 juju-e4d256-prod-github-runner-207 kernel: [50664.590570] ? _raw_spin_lock+0x22/0x30 Aug 22 19:28:10 juju-e4d256-prod-github-runner-207 kernel: [50664.591521] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:28:10 juju-e4d256-prod-github-runner-207 kernel: [50664.592668] direct_page_fault+0x206/0x310 [kvm] Aug 22 19:28:10 juju-e4d256-prod-github-runner-207 kernel: [50664.593813] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 19:28:10 juju-e4d256-prod-github-runner-207 kernel: [50664.595339] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 19:28:10 juju-e4d256-prod-github-runner-207 kernel: [50664.596359] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 19:28:10 juju-e4d256-prod-github-runner-207 kernel: [50664.597357] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 19:28:10 juju-e4d256-prod-github-runner-207 kernel: [50664.598332] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 19:28:10 juju-e4d256-prod-github-runner-207 kernel: [50664.599334] handle_exit+0x98/0x230 [kvm_amd] Aug 22 19:28:10 juju-e4d256-prod-github-runner-207 kernel: [50664.600237] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 19:28:10 juju-e4d256-prod-github-runner-207 kernel: [50664.601180] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 19:28:10 juju-e4d256-prod-github-runner-207 kernel: [50664.602113] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 19:28:10 juju-e4d256-prod-github-runner-207 kernel: [50664.603033] vcpu_run+0x62/0x2c0 [kvm] Aug 22 19:28:10 juju-e4d256-prod-github-runner-207 kernel: [50664.603864] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 19:28:10 juju-e4d256-prod-github-runner-207 kernel: [50664.604679] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 19:28:10 juju-e4d256-prod-github-runner-207 kernel: [50664.605563] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 19:28:10 juju-e4d256-prod-github-runner-207 kernel: [50664.606365] ? __seccomp_filter+0x4a/0x4a0 Aug 22 19:28:10 juju-e4d256-prod-github-runner-207 kernel: [50664.607111] ? __fget_files+0x86/0xc0 Aug 22 19:28:10 juju-e4d256-prod-github-runner-207 kernel: [50664.607829] __x64_sys_ioctl+0x95/0xd0 Aug 22 19:28:10 juju-e4d256-prod-github-runner-207 kernel: [50664.608529] do_syscall_64+0x5c/0xc0 Aug 22 19:28:10 juju-e4d256-prod-github-runner-207 kernel: [50664.609233] ? do_futex+0x162/0x1f0 Aug 22 19:28:10 juju-e4d256-prod-github-runner-207 kernel: [50664.609890] ? __x64_sys_futex+0x78/0x1e0 Aug 22 19:28:10 juju-e4d256-prod-github-runner-207 kernel: [50664.610568] ? __secure_computing+0xa9/0x120 Aug 22 19:28:10 juju-e4d256-prod-github-runner-207 kernel: [50664.611267] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 19:28:10 juju-e4d256-prod-github-runner-207 kernel: [50664.612034] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:28:10 juju-e4d256-prod-github-runner-207 kernel: [50664.612762] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:28:10 juju-e4d256-prod-github-runner-207 kernel: [50664.613563] ? do_syscall_64+0x69/0xc0 Aug 22 19:28:10 juju-e4d256-prod-github-runner-207 kernel: [50664.614233] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:28:10 juju-e4d256-prod-github-runner-207 kernel: [50664.614945] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:28:10 juju-e4d256-prod-github-runner-207 kernel: [50664.615643] ? do_syscall_64+0x69/0xc0 Aug 22 19:28:10 juju-e4d256-prod-github-runner-207 kernel: [50664.616272] ? do_syscall_64+0x69/0xc0 Aug 22 19:28:10 juju-e4d256-prod-github-runner-207 kernel: [50664.616897] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 19:28:10 juju-e4d256-prod-github-runner-207 kernel: [50664.617627] RIP: 0033:0x7faa5d0edaff Aug 22 19:28:10 juju-e4d256-prod-github-runner-207 kernel: [50664.618269] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 19:28:10 juju-e4d256-prod-github-runner-207 kernel: [50664.620279] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 19:28:10 juju-e4d256-prod-github-runner-207 kernel: [50664.621226] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 19:28:10 juju-e4d256-prod-github-runner-207 kernel: [50664.622155] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 19:28:10 juju-e4d256-prod-github-runner-207 kernel: [50664.623101] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 19:28:10 juju-e4d256-prod-github-runner-207 kernel: [50664.624009] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 19:28:10 juju-e4d256-prod-github-runner-207 kernel: [50664.624913] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 19:28:10 juju-e4d256-prod-github-runner-207 kernel: [50664.625845] Aug 22 19:28:38 juju-e4d256-prod-github-runner-207 kernel: [50692.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 47103s! [qemu-system-x86:6715] Aug 22 19:28:38 juju-e4d256-prod-github-runner-207 kernel: [50692.543962] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 19:28:38 juju-e4d256-prod-github-runner-207 kernel: [50692.544265] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 19:28:38 juju-e4d256-prod-github-runner-207 kernel: [50692.556968] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 19:28:38 juju-e4d256-prod-github-runner-207 kernel: [50692.558312] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 19:28:38 juju-e4d256-prod-github-runner-207 kernel: [50692.559553] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:28:38 juju-e4d256-prod-github-runner-207 kernel: [50692.560612] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 19:28:38 juju-e4d256-prod-github-runner-207 kernel: [50692.563196] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 19:28:38 juju-e4d256-prod-github-runner-207 kernel: [50692.564238] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 19:28:38 juju-e4d256-prod-github-runner-207 kernel: [50692.565400] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 19:28:38 juju-e4d256-prod-github-runner-207 kernel: [50692.566560] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 19:28:38 juju-e4d256-prod-github-runner-207 kernel: [50692.567719] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 19:28:38 juju-e4d256-prod-github-runner-207 kernel: [50692.568923] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 19:28:38 juju-e4d256-prod-github-runner-207 kernel: [50692.570089] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 19:28:38 juju-e4d256-prod-github-runner-207 kernel: [50692.571335] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 19:28:38 juju-e4d256-prod-github-runner-207 kernel: [50692.572450] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 19:28:38 juju-e4d256-prod-github-runner-207 kernel: [50692.573665] Call Trace: Aug 22 19:28:38 juju-e4d256-prod-github-runner-207 kernel: [50692.574589] Aug 22 19:28:38 juju-e4d256-prod-github-runner-207 kernel: [50692.575525] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:28:38 juju-e4d256-prod-github-runner-207 kernel: [50692.576564] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:28:38 juju-e4d256-prod-github-runner-207 kernel: [50692.577602] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:28:38 juju-e4d256-prod-github-runner-207 kernel: [50692.578693] ? show_regs.part.0+0x23/0x29 Aug 22 19:28:38 juju-e4d256-prod-github-runner-207 kernel: [50692.579703] ? show_regs.cold+0x8/0xd Aug 22 19:28:38 juju-e4d256-prod-github-runner-207 kernel: [50692.580681] ? watchdog_timer_fn+0x1be/0x220 Aug 22 19:28:38 juju-e4d256-prod-github-runner-207 kernel: [50692.581699] ? lockup_detector_update_enable+0x60/0x60 Aug 22 19:28:38 juju-e4d256-prod-github-runner-207 kernel: [50692.582762] ? __hrtimer_run_queues+0x107/0x230 Aug 22 19:28:38 juju-e4d256-prod-github-runner-207 kernel: [50692.583794] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 19:28:38 juju-e4d256-prod-github-runner-207 kernel: [50692.584830] ? hrtimer_interrupt+0x101/0x220 Aug 22 19:28:38 juju-e4d256-prod-github-runner-207 kernel: [50692.585844] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 19:28:38 juju-e4d256-prod-github-runner-207 kernel: [50692.586916] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 19:28:38 juju-e4d256-prod-github-runner-207 kernel: [50692.588085] Aug 22 19:28:38 juju-e4d256-prod-github-runner-207 kernel: [50692.588976] Aug 22 19:28:38 juju-e4d256-prod-github-runner-207 kernel: [50692.589822] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 19:28:38 juju-e4d256-prod-github-runner-207 kernel: [50692.590911] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:28:38 juju-e4d256-prod-github-runner-207 kernel: [50692.592006] ? _raw_spin_lock+0x22/0x30 Aug 22 19:28:38 juju-e4d256-prod-github-runner-207 kernel: [50692.593045] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:28:38 juju-e4d256-prod-github-runner-207 kernel: [50692.594073] direct_page_fault+0x206/0x310 [kvm] Aug 22 19:28:38 juju-e4d256-prod-github-runner-207 kernel: [50692.595106] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 19:28:38 juju-e4d256-prod-github-runner-207 kernel: [50692.596159] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 19:28:38 juju-e4d256-prod-github-runner-207 kernel: [50692.597242] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 19:28:38 juju-e4d256-prod-github-runner-207 kernel: [50692.598251] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 19:28:38 juju-e4d256-prod-github-runner-207 kernel: [50692.599222] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 19:28:38 juju-e4d256-prod-github-runner-207 kernel: [50692.600207] handle_exit+0x98/0x230 [kvm_amd] Aug 22 19:28:38 juju-e4d256-prod-github-runner-207 kernel: [50692.601129] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 19:28:38 juju-e4d256-prod-github-runner-207 kernel: [50692.602052] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 19:28:38 juju-e4d256-prod-github-runner-207 kernel: [50692.602982] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 19:28:38 juju-e4d256-prod-github-runner-207 kernel: [50692.603888] vcpu_run+0x62/0x2c0 [kvm] Aug 22 19:28:38 juju-e4d256-prod-github-runner-207 kernel: [50692.604706] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 19:28:38 juju-e4d256-prod-github-runner-207 kernel: [50692.605537] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 19:28:38 juju-e4d256-prod-github-runner-207 kernel: [50692.606390] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 19:28:38 juju-e4d256-prod-github-runner-207 kernel: [50692.607194] ? __seccomp_filter+0x4a/0x4a0 Aug 22 19:28:38 juju-e4d256-prod-github-runner-207 kernel: [50692.607943] ? __fget_files+0x86/0xc0 Aug 22 19:28:38 juju-e4d256-prod-github-runner-207 kernel: [50692.608655] __x64_sys_ioctl+0x95/0xd0 Aug 22 19:28:38 juju-e4d256-prod-github-runner-207 kernel: [50692.609365] do_syscall_64+0x5c/0xc0 Aug 22 19:28:38 juju-e4d256-prod-github-runner-207 kernel: [50692.610030] ? do_futex+0x162/0x1f0 Aug 22 19:28:38 juju-e4d256-prod-github-runner-207 kernel: [50692.610681] ? __x64_sys_futex+0x78/0x1e0 Aug 22 19:28:38 juju-e4d256-prod-github-runner-207 kernel: [50692.611359] ? __secure_computing+0xa9/0x120 Aug 22 19:28:38 juju-e4d256-prod-github-runner-207 kernel: [50692.612079] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 19:28:38 juju-e4d256-prod-github-runner-207 kernel: [50692.612879] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:28:38 juju-e4d256-prod-github-runner-207 kernel: [50692.613615] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:28:38 juju-e4d256-prod-github-runner-207 kernel: [50692.614334] ? do_syscall_64+0x69/0xc0 Aug 22 19:28:38 juju-e4d256-prod-github-runner-207 kernel: [50692.614977] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:28:38 juju-e4d256-prod-github-runner-207 kernel: [50692.615681] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:28:38 juju-e4d256-prod-github-runner-207 kernel: [50692.616374] ? do_syscall_64+0x69/0xc0 Aug 22 19:28:38 juju-e4d256-prod-github-runner-207 kernel: [50692.617042] ? do_syscall_64+0x69/0xc0 Aug 22 19:28:38 juju-e4d256-prod-github-runner-207 kernel: [50692.617741] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 19:28:38 juju-e4d256-prod-github-runner-207 kernel: [50692.618542] RIP: 0033:0x7faa5d0edaff Aug 22 19:28:38 juju-e4d256-prod-github-runner-207 kernel: [50692.619218] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 19:28:38 juju-e4d256-prod-github-runner-207 kernel: [50692.621236] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 19:28:38 juju-e4d256-prod-github-runner-207 kernel: [50692.622147] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 19:28:38 juju-e4d256-prod-github-runner-207 kernel: [50692.623245] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 19:28:38 juju-e4d256-prod-github-runner-207 kernel: [50692.624139] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 19:28:38 juju-e4d256-prod-github-runner-207 kernel: [50692.625058] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 19:28:38 juju-e4d256-prod-github-runner-207 kernel: [50692.625958] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 19:28:38 juju-e4d256-prod-github-runner-207 kernel: [50692.626854] Aug 22 19:29:06 juju-e4d256-prod-github-runner-207 kernel: [50720.541976] watchdog: BUG: soft lockup - CPU#1 stuck for 47129s! [qemu-system-x86:6715] Aug 22 19:29:06 juju-e4d256-prod-github-runner-207 kernel: [50720.544268] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 19:29:06 juju-e4d256-prod-github-runner-207 kernel: [50720.544587] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 19:29:06 juju-e4d256-prod-github-runner-207 kernel: [50720.557326] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 19:29:06 juju-e4d256-prod-github-runner-207 kernel: [50720.558608] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 19:29:06 juju-e4d256-prod-github-runner-207 kernel: [50720.559844] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:29:06 juju-e4d256-prod-github-runner-207 kernel: [50720.560931] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 19:29:06 juju-e4d256-prod-github-runner-207 kernel: [50720.563709] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 19:29:06 juju-e4d256-prod-github-runner-207 kernel: [50720.564783] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 19:29:06 juju-e4d256-prod-github-runner-207 kernel: [50720.565964] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 19:29:06 juju-e4d256-prod-github-runner-207 kernel: [50720.567139] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 19:29:06 juju-e4d256-prod-github-runner-207 kernel: [50720.568320] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 19:29:06 juju-e4d256-prod-github-runner-207 kernel: [50720.569531] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 19:29:06 juju-e4d256-prod-github-runner-207 kernel: [50720.570718] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 19:29:06 juju-e4d256-prod-github-runner-207 kernel: [50720.571975] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 19:29:06 juju-e4d256-prod-github-runner-207 kernel: [50720.573100] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 19:29:06 juju-e4d256-prod-github-runner-207 kernel: [50720.574311] Call Trace: Aug 22 19:29:06 juju-e4d256-prod-github-runner-207 kernel: [50720.575233] Aug 22 19:29:06 juju-e4d256-prod-github-runner-207 kernel: [50720.576133] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:29:06 juju-e4d256-prod-github-runner-207 kernel: [50720.577186] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:29:06 juju-e4d256-prod-github-runner-207 kernel: [50720.578217] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:29:06 juju-e4d256-prod-github-runner-207 kernel: [50720.579369] ? show_regs.part.0+0x23/0x29 Aug 22 19:29:06 juju-e4d256-prod-github-runner-207 kernel: [50720.580391] ? show_regs.cold+0x8/0xd Aug 22 19:29:06 juju-e4d256-prod-github-runner-207 kernel: [50720.581379] ? watchdog_timer_fn+0x1be/0x220 Aug 22 19:29:06 juju-e4d256-prod-github-runner-207 kernel: [50720.582386] ? lockup_detector_update_enable+0x60/0x60 Aug 22 19:29:06 juju-e4d256-prod-github-runner-207 kernel: [50720.583462] ? __hrtimer_run_queues+0x107/0x230 Aug 22 19:29:06 juju-e4d256-prod-github-runner-207 kernel: [50720.584698] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 19:29:06 juju-e4d256-prod-github-runner-207 kernel: [50720.585726] ? hrtimer_interrupt+0x101/0x220 Aug 22 19:29:06 juju-e4d256-prod-github-runner-207 kernel: [50720.586747] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 19:29:06 juju-e4d256-prod-github-runner-207 kernel: [50720.587817] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 19:29:06 juju-e4d256-prod-github-runner-207 kernel: [50720.588876] Aug 22 19:29:06 juju-e4d256-prod-github-runner-207 kernel: [50720.589734] Aug 22 19:29:06 juju-e4d256-prod-github-runner-207 kernel: [50720.590570] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 19:29:06 juju-e4d256-prod-github-runner-207 kernel: [50720.591604] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:29:06 juju-e4d256-prod-github-runner-207 kernel: [50720.592672] ? _raw_spin_lock+0x22/0x30 Aug 22 19:29:06 juju-e4d256-prod-github-runner-207 kernel: [50720.593622] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:29:06 juju-e4d256-prod-github-runner-207 kernel: [50720.594647] direct_page_fault+0x206/0x310 [kvm] Aug 22 19:29:06 juju-e4d256-prod-github-runner-207 kernel: [50720.595676] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 19:29:06 juju-e4d256-prod-github-runner-207 kernel: [50720.596704] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 19:29:06 juju-e4d256-prod-github-runner-207 kernel: [50720.597706] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 19:29:06 juju-e4d256-prod-github-runner-207 kernel: [50720.598712] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 19:29:06 juju-e4d256-prod-github-runner-207 kernel: [50720.599760] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 19:29:06 juju-e4d256-prod-github-runner-207 kernel: [50720.600956] handle_exit+0x98/0x230 [kvm_amd] Aug 22 19:29:06 juju-e4d256-prod-github-runner-207 kernel: [50720.601873] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 19:29:06 juju-e4d256-prod-github-runner-207 kernel: [50720.602796] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 19:29:06 juju-e4d256-prod-github-runner-207 kernel: [50720.603717] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 19:29:06 juju-e4d256-prod-github-runner-207 kernel: [50720.604638] vcpu_run+0x62/0x2c0 [kvm] Aug 22 19:29:06 juju-e4d256-prod-github-runner-207 kernel: [50720.605449] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 19:29:06 juju-e4d256-prod-github-runner-207 kernel: [50720.606287] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 19:29:06 juju-e4d256-prod-github-runner-207 kernel: [50720.607141] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 19:29:06 juju-e4d256-prod-github-runner-207 kernel: [50720.607937] ? __seccomp_filter+0x4a/0x4a0 Aug 22 19:29:06 juju-e4d256-prod-github-runner-207 kernel: [50720.608699] ? __fget_files+0x86/0xc0 Aug 22 19:29:06 juju-e4d256-prod-github-runner-207 kernel: [50720.609403] __x64_sys_ioctl+0x95/0xd0 Aug 22 19:29:06 juju-e4d256-prod-github-runner-207 kernel: [50720.610095] do_syscall_64+0x5c/0xc0 Aug 22 19:29:06 juju-e4d256-prod-github-runner-207 kernel: [50720.610758] ? do_futex+0x162/0x1f0 Aug 22 19:29:06 juju-e4d256-prod-github-runner-207 kernel: [50720.611405] ? __x64_sys_futex+0x78/0x1e0 Aug 22 19:29:06 juju-e4d256-prod-github-runner-207 kernel: [50720.612088] ? __secure_computing+0xa9/0x120 Aug 22 19:29:06 juju-e4d256-prod-github-runner-207 kernel: [50720.612804] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 19:29:06 juju-e4d256-prod-github-runner-207 kernel: [50720.613593] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:29:06 juju-e4d256-prod-github-runner-207 kernel: [50720.614317] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:29:06 juju-e4d256-prod-github-runner-207 kernel: [50720.615038] ? do_syscall_64+0x69/0xc0 Aug 22 19:29:06 juju-e4d256-prod-github-runner-207 kernel: [50720.615685] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:29:06 juju-e4d256-prod-github-runner-207 kernel: [50720.616387] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:29:06 juju-e4d256-prod-github-runner-207 kernel: [50720.617106] ? do_syscall_64+0x69/0xc0 Aug 22 19:29:06 juju-e4d256-prod-github-runner-207 kernel: [50720.617732] ? do_syscall_64+0x69/0xc0 Aug 22 19:29:06 juju-e4d256-prod-github-runner-207 kernel: [50720.618352] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 19:29:06 juju-e4d256-prod-github-runner-207 kernel: [50720.619056] RIP: 0033:0x7faa5d0edaff Aug 22 19:29:06 juju-e4d256-prod-github-runner-207 kernel: [50720.620067] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 19:29:06 juju-e4d256-prod-github-runner-207 kernel: [50720.622132] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 19:29:06 juju-e4d256-prod-github-runner-207 kernel: [50720.623041] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 19:29:06 juju-e4d256-prod-github-runner-207 kernel: [50720.623932] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 19:29:06 juju-e4d256-prod-github-runner-207 kernel: [50720.624833] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 19:29:06 juju-e4d256-prod-github-runner-207 kernel: [50720.625718] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 19:29:06 juju-e4d256-prod-github-runner-207 kernel: [50720.626620] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 19:29:06 juju-e4d256-prod-github-runner-207 kernel: [50720.627524] Aug 22 19:29:34 juju-e4d256-prod-github-runner-207 kernel: [50748.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 47155s! [qemu-system-x86:6715] Aug 22 19:29:34 juju-e4d256-prod-github-runner-207 kernel: [50748.543863] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 19:29:34 juju-e4d256-prod-github-runner-207 kernel: [50748.544187] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 19:29:34 juju-e4d256-prod-github-runner-207 kernel: [50748.556513] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 19:29:34 juju-e4d256-prod-github-runner-207 kernel: [50748.557789] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 19:29:34 juju-e4d256-prod-github-runner-207 kernel: [50748.559077] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:29:34 juju-e4d256-prod-github-runner-207 kernel: [50748.560147] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 19:29:34 juju-e4d256-prod-github-runner-207 kernel: [50748.562703] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 19:29:34 juju-e4d256-prod-github-runner-207 kernel: [50748.563795] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 19:29:34 juju-e4d256-prod-github-runner-207 kernel: [50748.565110] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 19:29:34 juju-e4d256-prod-github-runner-207 kernel: [50748.566335] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 19:29:34 juju-e4d256-prod-github-runner-207 kernel: [50748.567502] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 19:29:34 juju-e4d256-prod-github-runner-207 kernel: [50748.568690] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 19:29:34 juju-e4d256-prod-github-runner-207 kernel: [50748.569859] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 19:29:34 juju-e4d256-prod-github-runner-207 kernel: [50748.571096] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 19:29:34 juju-e4d256-prod-github-runner-207 kernel: [50748.572215] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 19:29:34 juju-e4d256-prod-github-runner-207 kernel: [50748.573420] Call Trace: Aug 22 19:29:34 juju-e4d256-prod-github-runner-207 kernel: [50748.574453] Aug 22 19:29:34 juju-e4d256-prod-github-runner-207 kernel: [50748.575541] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:29:34 juju-e4d256-prod-github-runner-207 kernel: [50748.576588] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:29:34 juju-e4d256-prod-github-runner-207 kernel: [50748.577677] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:29:34 juju-e4d256-prod-github-runner-207 kernel: [50748.579105] ? show_regs.part.0+0x23/0x29 Aug 22 19:29:34 juju-e4d256-prod-github-runner-207 kernel: [50748.580102] ? show_regs.cold+0x8/0xd Aug 22 19:29:34 juju-e4d256-prod-github-runner-207 kernel: [50748.581091] ? watchdog_timer_fn+0x1be/0x220 Aug 22 19:29:34 juju-e4d256-prod-github-runner-207 kernel: [50748.582121] ? lockup_detector_update_enable+0x60/0x60 Aug 22 19:29:34 juju-e4d256-prod-github-runner-207 kernel: [50748.583184] ? __hrtimer_run_queues+0x107/0x230 Aug 22 19:29:34 juju-e4d256-prod-github-runner-207 kernel: [50748.584216] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 19:29:34 juju-e4d256-prod-github-runner-207 kernel: [50748.585241] ? hrtimer_interrupt+0x101/0x220 Aug 22 19:29:34 juju-e4d256-prod-github-runner-207 kernel: [50748.586258] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 19:29:34 juju-e4d256-prod-github-runner-207 kernel: [50748.587323] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 19:29:34 juju-e4d256-prod-github-runner-207 kernel: [50748.588380] Aug 22 19:29:34 juju-e4d256-prod-github-runner-207 kernel: [50748.589231] Aug 22 19:29:34 juju-e4d256-prod-github-runner-207 kernel: [50748.590066] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 19:29:34 juju-e4d256-prod-github-runner-207 kernel: [50748.591097] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:29:34 juju-e4d256-prod-github-runner-207 kernel: [50748.592144] ? _raw_spin_lock+0x22/0x30 Aug 22 19:29:34 juju-e4d256-prod-github-runner-207 kernel: [50748.593086] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:29:34 juju-e4d256-prod-github-runner-207 kernel: [50748.594101] direct_page_fault+0x206/0x310 [kvm] Aug 22 19:29:34 juju-e4d256-prod-github-runner-207 kernel: [50748.595121] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 19:29:34 juju-e4d256-prod-github-runner-207 kernel: [50748.596126] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 19:29:34 juju-e4d256-prod-github-runner-207 kernel: [50748.597137] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 19:29:34 juju-e4d256-prod-github-runner-207 kernel: [50748.598146] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 19:29:34 juju-e4d256-prod-github-runner-207 kernel: [50748.599110] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 19:29:34 juju-e4d256-prod-github-runner-207 kernel: [50748.600095] handle_exit+0x98/0x230 [kvm_amd] Aug 22 19:29:34 juju-e4d256-prod-github-runner-207 kernel: [50748.600997] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 19:29:34 juju-e4d256-prod-github-runner-207 kernel: [50748.601911] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 19:29:34 juju-e4d256-prod-github-runner-207 kernel: [50748.602846] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 19:29:34 juju-e4d256-prod-github-runner-207 kernel: [50748.603757] vcpu_run+0x62/0x2c0 [kvm] Aug 22 19:29:34 juju-e4d256-prod-github-runner-207 kernel: [50748.604595] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 19:29:34 juju-e4d256-prod-github-runner-207 kernel: [50748.605410] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 19:29:34 juju-e4d256-prod-github-runner-207 kernel: [50748.606269] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 19:29:34 juju-e4d256-prod-github-runner-207 kernel: [50748.607072] ? __seccomp_filter+0x4a/0x4a0 Aug 22 19:29:34 juju-e4d256-prod-github-runner-207 kernel: [50748.607815] ? __fget_files+0x86/0xc0 Aug 22 19:29:34 juju-e4d256-prod-github-runner-207 kernel: [50748.608537] __x64_sys_ioctl+0x95/0xd0 Aug 22 19:29:34 juju-e4d256-prod-github-runner-207 kernel: [50748.609232] do_syscall_64+0x5c/0xc0 Aug 22 19:29:34 juju-e4d256-prod-github-runner-207 kernel: [50748.609903] ? do_futex+0x162/0x1f0 Aug 22 19:29:34 juju-e4d256-prod-github-runner-207 kernel: [50748.610554] ? __x64_sys_futex+0x78/0x1e0 Aug 22 19:29:34 juju-e4d256-prod-github-runner-207 kernel: [50748.611227] ? __secure_computing+0xa9/0x120 Aug 22 19:29:34 juju-e4d256-prod-github-runner-207 kernel: [50748.611919] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 19:29:34 juju-e4d256-prod-github-runner-207 kernel: [50748.612723] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:29:34 juju-e4d256-prod-github-runner-207 kernel: [50748.613450] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:29:34 juju-e4d256-prod-github-runner-207 kernel: [50748.614173] ? do_syscall_64+0x69/0xc0 Aug 22 19:29:34 juju-e4d256-prod-github-runner-207 kernel: [50748.614818] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:29:34 juju-e4d256-prod-github-runner-207 kernel: [50748.615522] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:29:34 juju-e4d256-prod-github-runner-207 kernel: [50748.616228] ? do_syscall_64+0x69/0xc0 Aug 22 19:29:34 juju-e4d256-prod-github-runner-207 kernel: [50748.616877] ? do_syscall_64+0x69/0xc0 Aug 22 19:29:34 juju-e4d256-prod-github-runner-207 kernel: [50748.617536] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 19:29:34 juju-e4d256-prod-github-runner-207 kernel: [50748.618291] RIP: 0033:0x7faa5d0edaff Aug 22 19:29:34 juju-e4d256-prod-github-runner-207 kernel: [50748.618966] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 19:29:34 juju-e4d256-prod-github-runner-207 kernel: [50748.620973] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 19:29:34 juju-e4d256-prod-github-runner-207 kernel: [50748.621901] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 19:29:34 juju-e4d256-prod-github-runner-207 kernel: [50748.622793] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 19:29:34 juju-e4d256-prod-github-runner-207 kernel: [50748.623682] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 19:29:34 juju-e4d256-prod-github-runner-207 kernel: [50748.624580] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 19:29:34 juju-e4d256-prod-github-runner-207 kernel: [50748.625477] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 19:29:34 juju-e4d256-prod-github-runner-207 kernel: [50748.626376] Aug 22 19:29:46 juju-e4d256-prod-github-runner-207 kernel: [50760.572709] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 19:29:46 juju-e4d256-prod-github-runner-207 kernel: [50760.574707] rcu: 1-....: (12620984 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=6102505 Aug 22 19:29:46 juju-e4d256-prod-github-runner-207 kernel: [50760.575898] (t=12660843 jiffies g=23269 q=48134) Aug 22 19:29:46 juju-e4d256-prod-github-runner-207 kernel: [50760.576719] NMI backtrace for cpu 1 Aug 22 19:29:46 juju-e4d256-prod-github-runner-207 kernel: [50760.577440] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 19:29:46 juju-e4d256-prod-github-runner-207 kernel: [50760.578539] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 19:29:46 juju-e4d256-prod-github-runner-207 kernel: [50760.579624] Call Trace: Aug 22 19:29:46 juju-e4d256-prod-github-runner-207 kernel: [50760.580317] Aug 22 19:29:46 juju-e4d256-prod-github-runner-207 kernel: [50760.580977] show_stack+0x52/0x5c Aug 22 19:29:46 juju-e4d256-prod-github-runner-207 kernel: [50760.581700] dump_stack_lvl+0x4a/0x63 Aug 22 19:29:46 juju-e4d256-prod-github-runner-207 kernel: [50760.582445] dump_stack+0x10/0x16 Aug 22 19:29:46 juju-e4d256-prod-github-runner-207 kernel: [50760.583167] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 19:29:46 juju-e4d256-prod-github-runner-207 kernel: [50760.583949] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 19:29:46 juju-e4d256-prod-github-runner-207 kernel: [50760.584740] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 19:29:46 juju-e4d256-prod-github-runner-207 kernel: [50760.585554] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 19:29:46 juju-e4d256-prod-github-runner-207 kernel: [50760.586370] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 19:29:46 juju-e4d256-prod-github-runner-207 kernel: [50760.587175] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 19:29:46 juju-e4d256-prod-github-runner-207 kernel: [50760.587943] print_cpu_stall.cold+0x2f/0xe2 Aug 22 19:29:46 juju-e4d256-prod-github-runner-207 kernel: [50760.588715] ? timekeeping_update+0xf7/0x150 Aug 22 19:29:46 juju-e4d256-prod-github-runner-207 kernel: [50760.589488] check_cpu_stall+0x109/0x270 Aug 22 19:29:46 juju-e4d256-prod-github-runner-207 kernel: [50760.590232] rcu_sched_clock_irq+0x9a/0x250 Aug 22 19:29:46 juju-e4d256-prod-github-runner-207 kernel: [50760.590990] update_process_times+0x94/0xd0 Aug 22 19:29:46 juju-e4d256-prod-github-runner-207 kernel: [50760.591746] tick_sched_handle+0x29/0x70 Aug 22 19:29:46 juju-e4d256-prod-github-runner-207 kernel: [50760.592531] tick_sched_timer+0x8c/0xc0 Aug 22 19:29:46 juju-e4d256-prod-github-runner-207 kernel: [50760.593268] ? tick_nohz_handler+0xb0/0xb0 Aug 22 19:29:46 juju-e4d256-prod-github-runner-207 kernel: [50760.594020] __hrtimer_run_queues+0x107/0x230 Aug 22 19:29:46 juju-e4d256-prod-github-runner-207 kernel: [50760.594790] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 19:29:46 juju-e4d256-prod-github-runner-207 kernel: [50760.595685] hrtimer_interrupt+0x101/0x220 Aug 22 19:29:46 juju-e4d256-prod-github-runner-207 kernel: [50760.596613] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 19:29:46 juju-e4d256-prod-github-runner-207 kernel: [50760.597440] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 19:29:46 juju-e4d256-prod-github-runner-207 kernel: [50760.598249] Aug 22 19:29:46 juju-e4d256-prod-github-runner-207 kernel: [50760.598887] Aug 22 19:29:46 juju-e4d256-prod-github-runner-207 kernel: [50760.599517] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 19:29:46 juju-e4d256-prod-github-runner-207 kernel: [50760.600407] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:29:46 juju-e4d256-prod-github-runner-207 kernel: [50760.601308] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 19:29:46 juju-e4d256-prod-github-runner-207 kernel: [50760.603568] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 19:29:46 juju-e4d256-prod-github-runner-207 kernel: [50760.604506] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 19:29:46 juju-e4d256-prod-github-runner-207 kernel: [50760.605544] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 19:29:46 juju-e4d256-prod-github-runner-207 kernel: [50760.606553] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 19:29:46 juju-e4d256-prod-github-runner-207 kernel: [50760.607556] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 19:29:46 juju-e4d256-prod-github-runner-207 kernel: [50760.608568] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 19:29:46 juju-e4d256-prod-github-runner-207 kernel: [50760.609546] ? _raw_spin_lock+0x22/0x30 Aug 22 19:29:46 juju-e4d256-prod-github-runner-207 kernel: [50760.610326] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:29:46 juju-e4d256-prod-github-runner-207 kernel: [50760.611192] direct_page_fault+0x206/0x310 [kvm] Aug 22 19:29:46 juju-e4d256-prod-github-runner-207 kernel: [50760.612059] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 19:29:46 juju-e4d256-prod-github-runner-207 kernel: [50760.612896] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 19:29:46 juju-e4d256-prod-github-runner-207 kernel: [50760.613756] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 19:29:46 juju-e4d256-prod-github-runner-207 kernel: [50760.614600] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 19:29:46 juju-e4d256-prod-github-runner-207 kernel: [50760.615406] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 19:29:46 juju-e4d256-prod-github-runner-207 kernel: [50760.616283] handle_exit+0x98/0x230 [kvm_amd] Aug 22 19:29:46 juju-e4d256-prod-github-runner-207 kernel: [50760.617050] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 19:29:46 juju-e4d256-prod-github-runner-207 kernel: [50760.617846] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 19:29:46 juju-e4d256-prod-github-runner-207 kernel: [50760.618668] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 19:29:46 juju-e4d256-prod-github-runner-207 kernel: [50760.619479] vcpu_run+0x62/0x2c0 [kvm] Aug 22 19:29:46 juju-e4d256-prod-github-runner-207 kernel: [50760.620225] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 19:29:46 juju-e4d256-prod-github-runner-207 kernel: [50760.620980] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 19:29:46 juju-e4d256-prod-github-runner-207 kernel: [50760.621797] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 19:29:46 juju-e4d256-prod-github-runner-207 kernel: [50760.622571] ? __seccomp_filter+0x4a/0x4a0 Aug 22 19:29:46 juju-e4d256-prod-github-runner-207 kernel: [50760.623302] ? __fget_files+0x86/0xc0 Aug 22 19:29:46 juju-e4d256-prod-github-runner-207 kernel: [50760.624018] __x64_sys_ioctl+0x95/0xd0 Aug 22 19:29:46 juju-e4d256-prod-github-runner-207 kernel: [50760.624727] do_syscall_64+0x5c/0xc0 Aug 22 19:29:46 juju-e4d256-prod-github-runner-207 kernel: [50760.625428] ? do_futex+0x162/0x1f0 Aug 22 19:29:46 juju-e4d256-prod-github-runner-207 kernel: [50760.626111] ? __x64_sys_futex+0x78/0x1e0 Aug 22 19:29:46 juju-e4d256-prod-github-runner-207 kernel: [50760.626822] ? __secure_computing+0xa9/0x120 Aug 22 19:29:46 juju-e4d256-prod-github-runner-207 kernel: [50760.627548] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 19:29:46 juju-e4d256-prod-github-runner-207 kernel: [50760.628373] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:29:46 juju-e4d256-prod-github-runner-207 kernel: [50760.629237] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:29:46 juju-e4d256-prod-github-runner-207 kernel: [50760.630017] ? do_syscall_64+0x69/0xc0 Aug 22 19:29:46 juju-e4d256-prod-github-runner-207 kernel: [50760.630724] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:29:46 juju-e4d256-prod-github-runner-207 kernel: [50760.631499] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:29:46 juju-e4d256-prod-github-runner-207 kernel: [50760.632298] ? do_syscall_64+0x69/0xc0 Aug 22 19:29:46 juju-e4d256-prod-github-runner-207 kernel: [50760.633009] ? do_syscall_64+0x69/0xc0 Aug 22 19:29:46 juju-e4d256-prod-github-runner-207 kernel: [50760.633736] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 19:29:46 juju-e4d256-prod-github-runner-207 kernel: [50760.634544] RIP: 0033:0x7faa5d0edaff Aug 22 19:29:46 juju-e4d256-prod-github-runner-207 kernel: [50760.635300] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 19:29:46 juju-e4d256-prod-github-runner-207 kernel: [50760.637468] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 19:29:46 juju-e4d256-prod-github-runner-207 kernel: [50760.638453] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 19:29:46 juju-e4d256-prod-github-runner-207 kernel: [50760.639420] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 19:29:46 juju-e4d256-prod-github-runner-207 kernel: [50760.640410] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 19:29:46 juju-e4d256-prod-github-runner-207 kernel: [50760.641388] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 19:29:46 juju-e4d256-prod-github-runner-207 kernel: [50760.642335] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 19:29:46 juju-e4d256-prod-github-runner-207 kernel: [50760.643269] Aug 22 19:30:14 juju-e4d256-prod-github-runner-207 kernel: [50788.541976] watchdog: BUG: soft lockup - CPU#1 stuck for 47192s! [qemu-system-x86:6715] Aug 22 19:30:14 juju-e4d256-prod-github-runner-207 kernel: [50788.543933] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 19:30:14 juju-e4d256-prod-github-runner-207 kernel: [50788.544246] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 19:30:14 juju-e4d256-prod-github-runner-207 kernel: [50788.556540] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 19:30:14 juju-e4d256-prod-github-runner-207 kernel: [50788.557807] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 19:30:14 juju-e4d256-prod-github-runner-207 kernel: [50788.559024] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:30:14 juju-e4d256-prod-github-runner-207 kernel: [50788.560125] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 19:30:14 juju-e4d256-prod-github-runner-207 kernel: [50788.562680] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 19:30:14 juju-e4d256-prod-github-runner-207 kernel: [50788.563753] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 19:30:14 juju-e4d256-prod-github-runner-207 kernel: [50788.564915] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 19:30:14 juju-e4d256-prod-github-runner-207 kernel: [50788.566068] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 19:30:14 juju-e4d256-prod-github-runner-207 kernel: [50788.567230] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 19:30:14 juju-e4d256-prod-github-runner-207 kernel: [50788.568410] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 19:30:14 juju-e4d256-prod-github-runner-207 kernel: [50788.569586] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 19:30:14 juju-e4d256-prod-github-runner-207 kernel: [50788.570818] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 19:30:14 juju-e4d256-prod-github-runner-207 kernel: [50788.571934] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 19:30:14 juju-e4d256-prod-github-runner-207 kernel: [50788.573132] Call Trace: Aug 22 19:30:14 juju-e4d256-prod-github-runner-207 kernel: [50788.574047] Aug 22 19:30:14 juju-e4d256-prod-github-runner-207 kernel: [50788.574947] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:30:14 juju-e4d256-prod-github-runner-207 kernel: [50788.575983] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:30:14 juju-e4d256-prod-github-runner-207 kernel: [50788.577008] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:30:14 juju-e4d256-prod-github-runner-207 kernel: [50788.578102] ? show_regs.part.0+0x23/0x29 Aug 22 19:30:14 juju-e4d256-prod-github-runner-207 kernel: [50788.579097] ? show_regs.cold+0x8/0xd Aug 22 19:30:14 juju-e4d256-prod-github-runner-207 kernel: [50788.580077] ? watchdog_timer_fn+0x1be/0x220 Aug 22 19:30:14 juju-e4d256-prod-github-runner-207 kernel: [50788.581083] ? lockup_detector_update_enable+0x60/0x60 Aug 22 19:30:14 juju-e4d256-prod-github-runner-207 kernel: [50788.582148] ? __hrtimer_run_queues+0x107/0x230 Aug 22 19:30:14 juju-e4d256-prod-github-runner-207 kernel: [50788.583189] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 19:30:14 juju-e4d256-prod-github-runner-207 kernel: [50788.584235] ? hrtimer_interrupt+0x101/0x220 Aug 22 19:30:14 juju-e4d256-prod-github-runner-207 kernel: [50788.585249] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 19:30:14 juju-e4d256-prod-github-runner-207 kernel: [50788.586315] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 19:30:14 juju-e4d256-prod-github-runner-207 kernel: [50788.587359] Aug 22 19:30:14 juju-e4d256-prod-github-runner-207 kernel: [50788.588221] Aug 22 19:30:14 juju-e4d256-prod-github-runner-207 kernel: [50788.589057] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 19:30:14 juju-e4d256-prod-github-runner-207 kernel: [50788.590127] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:30:14 juju-e4d256-prod-github-runner-207 kernel: [50788.591168] ? _raw_spin_lock+0x22/0x30 Aug 22 19:30:14 juju-e4d256-prod-github-runner-207 kernel: [50788.592124] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:30:14 juju-e4d256-prod-github-runner-207 kernel: [50788.593153] direct_page_fault+0x206/0x310 [kvm] Aug 22 19:30:14 juju-e4d256-prod-github-runner-207 kernel: [50788.594175] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 19:30:14 juju-e4d256-prod-github-runner-207 kernel: [50788.595184] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 19:30:14 juju-e4d256-prod-github-runner-207 kernel: [50788.596194] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 19:30:14 juju-e4d256-prod-github-runner-207 kernel: [50788.597196] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 19:30:14 juju-e4d256-prod-github-runner-207 kernel: [50788.598139] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 19:30:14 juju-e4d256-prod-github-runner-207 kernel: [50788.599118] handle_exit+0x98/0x230 [kvm_amd] Aug 22 19:30:14 juju-e4d256-prod-github-runner-207 kernel: [50788.600028] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 19:30:14 juju-e4d256-prod-github-runner-207 kernel: [50788.600940] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 19:30:14 juju-e4d256-prod-github-runner-207 kernel: [50788.601865] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 19:30:14 juju-e4d256-prod-github-runner-207 kernel: [50788.602765] vcpu_run+0x62/0x2c0 [kvm] Aug 22 19:30:14 juju-e4d256-prod-github-runner-207 kernel: [50788.603576] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 19:30:14 juju-e4d256-prod-github-runner-207 kernel: [50788.604394] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 19:30:14 juju-e4d256-prod-github-runner-207 kernel: [50788.605246] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 19:30:14 juju-e4d256-prod-github-runner-207 kernel: [50788.606040] ? __seccomp_filter+0x4a/0x4a0 Aug 22 19:30:14 juju-e4d256-prod-github-runner-207 kernel: [50788.606779] ? __fget_files+0x86/0xc0 Aug 22 19:30:14 juju-e4d256-prod-github-runner-207 kernel: [50788.607479] __x64_sys_ioctl+0x95/0xd0 Aug 22 19:30:14 juju-e4d256-prod-github-runner-207 kernel: [50788.608181] do_syscall_64+0x5c/0xc0 Aug 22 19:30:14 juju-e4d256-prod-github-runner-207 kernel: [50788.608845] ? do_futex+0x162/0x1f0 Aug 22 19:30:14 juju-e4d256-prod-github-runner-207 kernel: [50788.609490] ? __x64_sys_futex+0x78/0x1e0 Aug 22 19:30:14 juju-e4d256-prod-github-runner-207 kernel: [50788.610160] ? __secure_computing+0xa9/0x120 Aug 22 19:30:14 juju-e4d256-prod-github-runner-207 kernel: [50788.610846] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 19:30:14 juju-e4d256-prod-github-runner-207 kernel: [50788.611603] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:30:14 juju-e4d256-prod-github-runner-207 kernel: [50788.612325] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:30:14 juju-e4d256-prod-github-runner-207 kernel: [50788.613039] ? do_syscall_64+0x69/0xc0 Aug 22 19:30:14 juju-e4d256-prod-github-runner-207 kernel: [50788.613768] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:30:14 juju-e4d256-prod-github-runner-207 kernel: [50788.614473] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:30:14 juju-e4d256-prod-github-runner-207 kernel: [50788.615180] ? do_syscall_64+0x69/0xc0 Aug 22 19:30:14 juju-e4d256-prod-github-runner-207 kernel: [50788.615885] ? do_syscall_64+0x69/0xc0 Aug 22 19:30:14 juju-e4d256-prod-github-runner-207 kernel: [50788.616537] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 19:30:14 juju-e4d256-prod-github-runner-207 kernel: [50788.617269] RIP: 0033:0x7faa5d0edaff Aug 22 19:30:14 juju-e4d256-prod-github-runner-207 kernel: [50788.617933] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 19:30:14 juju-e4d256-prod-github-runner-207 kernel: [50788.620826] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 19:30:14 juju-e4d256-prod-github-runner-207 kernel: [50788.621751] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 19:30:14 juju-e4d256-prod-github-runner-207 kernel: [50788.622641] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 19:30:14 juju-e4d256-prod-github-runner-207 kernel: [50788.623528] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 19:30:14 juju-e4d256-prod-github-runner-207 kernel: [50788.624433] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 19:30:14 juju-e4d256-prod-github-runner-207 kernel: [50788.625318] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 19:30:14 juju-e4d256-prod-github-runner-207 kernel: [50788.626207] Aug 22 19:30:42 juju-e4d256-prod-github-runner-207 kernel: [50816.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 47218s! [qemu-system-x86:6715] Aug 22 19:30:42 juju-e4d256-prod-github-runner-207 kernel: [50816.543889] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 19:30:42 juju-e4d256-prod-github-runner-207 kernel: [50816.544192] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 19:30:42 juju-e4d256-prod-github-runner-207 kernel: [50816.557497] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 19:30:42 juju-e4d256-prod-github-runner-207 kernel: [50816.559186] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 19:30:42 juju-e4d256-prod-github-runner-207 kernel: [50816.560545] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:30:42 juju-e4d256-prod-github-runner-207 kernel: [50816.561641] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 19:30:42 juju-e4d256-prod-github-runner-207 kernel: [50816.564421] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 19:30:42 juju-e4d256-prod-github-runner-207 kernel: [50816.565514] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 19:30:42 juju-e4d256-prod-github-runner-207 kernel: [50816.566736] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 19:30:42 juju-e4d256-prod-github-runner-207 kernel: [50816.568028] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 19:30:42 juju-e4d256-prod-github-runner-207 kernel: [50816.569283] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 19:30:42 juju-e4d256-prod-github-runner-207 kernel: [50816.570485] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 19:30:42 juju-e4d256-prod-github-runner-207 kernel: [50816.571723] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 19:30:42 juju-e4d256-prod-github-runner-207 kernel: [50816.572989] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 19:30:42 juju-e4d256-prod-github-runner-207 kernel: [50816.574111] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 19:30:42 juju-e4d256-prod-github-runner-207 kernel: [50816.575334] Call Trace: Aug 22 19:30:42 juju-e4d256-prod-github-runner-207 kernel: [50816.576272] Aug 22 19:30:42 juju-e4d256-prod-github-runner-207 kernel: [50816.577195] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:30:42 juju-e4d256-prod-github-runner-207 kernel: [50816.578243] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:30:42 juju-e4d256-prod-github-runner-207 kernel: [50816.579288] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:30:42 juju-e4d256-prod-github-runner-207 kernel: [50816.580430] ? show_regs.part.0+0x23/0x29 Aug 22 19:30:42 juju-e4d256-prod-github-runner-207 kernel: [50816.581450] ? show_regs.cold+0x8/0xd Aug 22 19:30:42 juju-e4d256-prod-github-runner-207 kernel: [50816.582481] ? watchdog_timer_fn+0x1be/0x220 Aug 22 19:30:42 juju-e4d256-prod-github-runner-207 kernel: [50816.583593] ? lockup_detector_update_enable+0x60/0x60 Aug 22 19:30:42 juju-e4d256-prod-github-runner-207 kernel: [50816.584689] ? __hrtimer_run_queues+0x107/0x230 Aug 22 19:30:42 juju-e4d256-prod-github-runner-207 kernel: [50816.585741] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 19:30:42 juju-e4d256-prod-github-runner-207 kernel: [50816.586809] ? hrtimer_interrupt+0x101/0x220 Aug 22 19:30:42 juju-e4d256-prod-github-runner-207 kernel: [50816.587872] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 19:30:42 juju-e4d256-prod-github-runner-207 kernel: [50816.588967] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 19:30:42 juju-e4d256-prod-github-runner-207 kernel: [50816.590036] Aug 22 19:30:42 juju-e4d256-prod-github-runner-207 kernel: [50816.590931] Aug 22 19:30:42 juju-e4d256-prod-github-runner-207 kernel: [50816.591825] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 19:30:42 juju-e4d256-prod-github-runner-207 kernel: [50816.592949] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:30:42 juju-e4d256-prod-github-runner-207 kernel: [50816.594077] ? _raw_spin_lock+0x22/0x30 Aug 22 19:30:42 juju-e4d256-prod-github-runner-207 kernel: [50816.595208] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:30:42 juju-e4d256-prod-github-runner-207 kernel: [50816.596435] direct_page_fault+0x206/0x310 [kvm] Aug 22 19:30:42 juju-e4d256-prod-github-runner-207 kernel: [50816.597558] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 19:30:42 juju-e4d256-prod-github-runner-207 kernel: [50816.598697] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 19:30:42 juju-e4d256-prod-github-runner-207 kernel: [50816.599799] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 19:30:42 juju-e4d256-prod-github-runner-207 kernel: [50816.600937] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 19:30:42 juju-e4d256-prod-github-runner-207 kernel: [50816.602075] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 19:30:42 juju-e4d256-prod-github-runner-207 kernel: [50816.603178] handle_exit+0x98/0x230 [kvm_amd] Aug 22 19:30:42 juju-e4d256-prod-github-runner-207 kernel: [50816.604219] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 19:30:42 juju-e4d256-prod-github-runner-207 kernel: [50816.605192] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 19:30:42 juju-e4d256-prod-github-runner-207 kernel: [50816.606139] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 19:30:42 juju-e4d256-prod-github-runner-207 kernel: [50816.607125] vcpu_run+0x62/0x2c0 [kvm] Aug 22 19:30:42 juju-e4d256-prod-github-runner-207 kernel: [50816.607995] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 19:30:42 juju-e4d256-prod-github-runner-207 kernel: [50816.608824] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 19:30:42 juju-e4d256-prod-github-runner-207 kernel: [50816.609700] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 19:30:42 juju-e4d256-prod-github-runner-207 kernel: [50816.610516] ? __seccomp_filter+0x4a/0x4a0 Aug 22 19:30:42 juju-e4d256-prod-github-runner-207 kernel: [50816.611278] ? __fget_files+0x86/0xc0 Aug 22 19:30:42 juju-e4d256-prod-github-runner-207 kernel: [50816.612029] __x64_sys_ioctl+0x95/0xd0 Aug 22 19:30:42 juju-e4d256-prod-github-runner-207 kernel: [50816.612818] do_syscall_64+0x5c/0xc0 Aug 22 19:30:42 juju-e4d256-prod-github-runner-207 kernel: [50816.613514] ? do_futex+0x162/0x1f0 Aug 22 19:30:42 juju-e4d256-prod-github-runner-207 kernel: [50816.614183] ? __x64_sys_futex+0x78/0x1e0 Aug 22 19:30:42 juju-e4d256-prod-github-runner-207 kernel: [50816.614882] ? __secure_computing+0xa9/0x120 Aug 22 19:30:42 juju-e4d256-prod-github-runner-207 kernel: [50816.615611] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 19:30:42 juju-e4d256-prod-github-runner-207 kernel: [50816.616394] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:30:42 juju-e4d256-prod-github-runner-207 kernel: [50816.617139] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:30:42 juju-e4d256-prod-github-runner-207 kernel: [50816.617882] ? do_syscall_64+0x69/0xc0 Aug 22 19:30:42 juju-e4d256-prod-github-runner-207 kernel: [50816.618543] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:30:42 juju-e4d256-prod-github-runner-207 kernel: [50816.619265] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:30:42 juju-e4d256-prod-github-runner-207 kernel: [50816.620001] ? do_syscall_64+0x69/0xc0 Aug 22 19:30:42 juju-e4d256-prod-github-runner-207 kernel: [50816.620642] ? do_syscall_64+0x69/0xc0 Aug 22 19:30:42 juju-e4d256-prod-github-runner-207 kernel: [50816.621285] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 19:30:42 juju-e4d256-prod-github-runner-207 kernel: [50816.622013] RIP: 0033:0x7faa5d0edaff Aug 22 19:30:42 juju-e4d256-prod-github-runner-207 kernel: [50816.622707] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 19:30:42 juju-e4d256-prod-github-runner-207 kernel: [50816.624791] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 19:30:42 juju-e4d256-prod-github-runner-207 kernel: [50816.625733] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 19:30:42 juju-e4d256-prod-github-runner-207 kernel: [50816.626658] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 19:30:42 juju-e4d256-prod-github-runner-207 kernel: [50816.627596] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 19:30:42 juju-e4d256-prod-github-runner-207 kernel: [50816.628514] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 19:30:42 juju-e4d256-prod-github-runner-207 kernel: [50816.629429] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 19:30:42 juju-e4d256-prod-github-runner-207 kernel: [50816.630369] Aug 22 19:31:10 juju-e4d256-prod-github-runner-207 kernel: [50844.542028] watchdog: BUG: soft lockup - CPU#1 stuck for 47244s! [qemu-system-x86:6715] Aug 22 19:31:10 juju-e4d256-prod-github-runner-207 kernel: [50844.543934] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 19:31:10 juju-e4d256-prod-github-runner-207 kernel: [50844.544223] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 19:31:10 juju-e4d256-prod-github-runner-207 kernel: [50844.556383] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 19:31:10 juju-e4d256-prod-github-runner-207 kernel: [50844.557642] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 19:31:10 juju-e4d256-prod-github-runner-207 kernel: [50844.558868] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:31:10 juju-e4d256-prod-github-runner-207 kernel: [50844.559946] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 19:31:10 juju-e4d256-prod-github-runner-207 kernel: [50844.562531] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 19:31:10 juju-e4d256-prod-github-runner-207 kernel: [50844.563590] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 19:31:10 juju-e4d256-prod-github-runner-207 kernel: [50844.564750] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 19:31:10 juju-e4d256-prod-github-runner-207 kernel: [50844.565907] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 19:31:10 juju-e4d256-prod-github-runner-207 kernel: [50844.567114] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 19:31:10 juju-e4d256-prod-github-runner-207 kernel: [50844.568278] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 19:31:10 juju-e4d256-prod-github-runner-207 kernel: [50844.569441] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 19:31:10 juju-e4d256-prod-github-runner-207 kernel: [50844.570673] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 19:31:10 juju-e4d256-prod-github-runner-207 kernel: [50844.571793] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 19:31:10 juju-e4d256-prod-github-runner-207 kernel: [50844.572988] Call Trace: Aug 22 19:31:10 juju-e4d256-prod-github-runner-207 kernel: [50844.573903] Aug 22 19:31:10 juju-e4d256-prod-github-runner-207 kernel: [50844.574793] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:31:10 juju-e4d256-prod-github-runner-207 kernel: [50844.575837] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:31:10 juju-e4d256-prod-github-runner-207 kernel: [50844.576855] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:31:10 juju-e4d256-prod-github-runner-207 kernel: [50844.577953] ? show_regs.part.0+0x23/0x29 Aug 22 19:31:10 juju-e4d256-prod-github-runner-207 kernel: [50844.578956] ? show_regs.cold+0x8/0xd Aug 22 19:31:10 juju-e4d256-prod-github-runner-207 kernel: [50844.579936] ? watchdog_timer_fn+0x1be/0x220 Aug 22 19:31:10 juju-e4d256-prod-github-runner-207 kernel: [50844.580952] ? lockup_detector_update_enable+0x60/0x60 Aug 22 19:31:10 juju-e4d256-prod-github-runner-207 kernel: [50844.582016] ? __hrtimer_run_queues+0x107/0x230 Aug 22 19:31:10 juju-e4d256-prod-github-runner-207 kernel: [50844.583054] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 19:31:10 juju-e4d256-prod-github-runner-207 kernel: [50844.584087] ? hrtimer_interrupt+0x101/0x220 Aug 22 19:31:10 juju-e4d256-prod-github-runner-207 kernel: [50844.585114] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 19:31:10 juju-e4d256-prod-github-runner-207 kernel: [50844.586181] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 19:31:10 juju-e4d256-prod-github-runner-207 kernel: [50844.587253] Aug 22 19:31:10 juju-e4d256-prod-github-runner-207 kernel: [50844.588118] Aug 22 19:31:10 juju-e4d256-prod-github-runner-207 kernel: [50844.588961] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 19:31:10 juju-e4d256-prod-github-runner-207 kernel: [50844.589991] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:31:10 juju-e4d256-prod-github-runner-207 kernel: [50844.591046] ? _raw_spin_lock+0x22/0x30 Aug 22 19:31:10 juju-e4d256-prod-github-runner-207 kernel: [50844.592008] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:31:10 juju-e4d256-prod-github-runner-207 kernel: [50844.593024] direct_page_fault+0x206/0x310 [kvm] Aug 22 19:31:10 juju-e4d256-prod-github-runner-207 kernel: [50844.594047] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 19:31:10 juju-e4d256-prod-github-runner-207 kernel: [50844.595082] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 19:31:10 juju-e4d256-prod-github-runner-207 kernel: [50844.596079] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 19:31:10 juju-e4d256-prod-github-runner-207 kernel: [50844.597078] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 19:31:10 juju-e4d256-prod-github-runner-207 kernel: [50844.598020] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 19:31:10 juju-e4d256-prod-github-runner-207 kernel: [50844.598994] handle_exit+0x98/0x230 [kvm_amd] Aug 22 19:31:10 juju-e4d256-prod-github-runner-207 kernel: [50844.599898] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 19:31:10 juju-e4d256-prod-github-runner-207 kernel: [50844.600808] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 19:31:10 juju-e4d256-prod-github-runner-207 kernel: [50844.601727] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 19:31:10 juju-e4d256-prod-github-runner-207 kernel: [50844.602628] vcpu_run+0x62/0x2c0 [kvm] Aug 22 19:31:10 juju-e4d256-prod-github-runner-207 kernel: [50844.603444] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 19:31:10 juju-e4d256-prod-github-runner-207 kernel: [50844.604249] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 19:31:10 juju-e4d256-prod-github-runner-207 kernel: [50844.605099] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 19:31:10 juju-e4d256-prod-github-runner-207 kernel: [50844.605893] ? __seccomp_filter+0x4a/0x4a0 Aug 22 19:31:10 juju-e4d256-prod-github-runner-207 kernel: [50844.606632] ? __fget_files+0x86/0xc0 Aug 22 19:31:10 juju-e4d256-prod-github-runner-207 kernel: [50844.607348] __x64_sys_ioctl+0x95/0xd0 Aug 22 19:31:10 juju-e4d256-prod-github-runner-207 kernel: [50844.608037] do_syscall_64+0x5c/0xc0 Aug 22 19:31:10 juju-e4d256-prod-github-runner-207 kernel: [50844.608699] ? do_futex+0x162/0x1f0 Aug 22 19:31:10 juju-e4d256-prod-github-runner-207 kernel: [50844.609345] ? __x64_sys_futex+0x78/0x1e0 Aug 22 19:31:10 juju-e4d256-prod-github-runner-207 kernel: [50844.610016] ? __secure_computing+0xa9/0x120 Aug 22 19:31:10 juju-e4d256-prod-github-runner-207 kernel: [50844.610703] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 19:31:10 juju-e4d256-prod-github-runner-207 kernel: [50844.611489] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:31:10 juju-e4d256-prod-github-runner-207 kernel: [50844.612229] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:31:10 juju-e4d256-prod-github-runner-207 kernel: [50844.612959] ? do_syscall_64+0x69/0xc0 Aug 22 19:31:10 juju-e4d256-prod-github-runner-207 kernel: [50844.613605] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:31:10 juju-e4d256-prod-github-runner-207 kernel: [50844.614309] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:31:10 juju-e4d256-prod-github-runner-207 kernel: [50844.615006] ? do_syscall_64+0x69/0xc0 Aug 22 19:31:10 juju-e4d256-prod-github-runner-207 kernel: [50844.615652] ? do_syscall_64+0x69/0xc0 Aug 22 19:31:10 juju-e4d256-prod-github-runner-207 kernel: [50844.616274] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 19:31:10 juju-e4d256-prod-github-runner-207 kernel: [50844.616978] RIP: 0033:0x7faa5d0edaff Aug 22 19:31:10 juju-e4d256-prod-github-runner-207 kernel: [50844.617638] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 19:31:10 juju-e4d256-prod-github-runner-207 kernel: [50844.619674] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 19:31:10 juju-e4d256-prod-github-runner-207 kernel: [50844.620588] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 19:31:10 juju-e4d256-prod-github-runner-207 kernel: [50844.621477] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 19:31:10 juju-e4d256-prod-github-runner-207 kernel: [50844.622371] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 19:31:10 juju-e4d256-prod-github-runner-207 kernel: [50844.623287] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 19:31:10 juju-e4d256-prod-github-runner-207 kernel: [50844.624194] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 19:31:10 juju-e4d256-prod-github-runner-207 kernel: [50844.625094] Aug 22 19:31:38 juju-e4d256-prod-github-runner-207 kernel: [50872.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 47270s! [qemu-system-x86:6715] Aug 22 19:31:38 juju-e4d256-prod-github-runner-207 kernel: [50872.543127] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 19:31:38 juju-e4d256-prod-github-runner-207 kernel: [50872.543202] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 19:31:38 juju-e4d256-prod-github-runner-207 kernel: [50872.555412] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 19:31:38 juju-e4d256-prod-github-runner-207 kernel: [50872.556681] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 19:31:38 juju-e4d256-prod-github-runner-207 kernel: [50872.557902] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:31:38 juju-e4d256-prod-github-runner-207 kernel: [50872.558981] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 19:31:38 juju-e4d256-prod-github-runner-207 kernel: [50872.561538] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 19:31:38 juju-e4d256-prod-github-runner-207 kernel: [50872.562581] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 19:31:38 juju-e4d256-prod-github-runner-207 kernel: [50872.563768] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 19:31:38 juju-e4d256-prod-github-runner-207 kernel: [50872.564933] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 19:31:38 juju-e4d256-prod-github-runner-207 kernel: [50872.566097] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 19:31:38 juju-e4d256-prod-github-runner-207 kernel: [50872.567279] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 19:31:38 juju-e4d256-prod-github-runner-207 kernel: [50872.568453] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 19:31:38 juju-e4d256-prod-github-runner-207 kernel: [50872.569692] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 19:31:38 juju-e4d256-prod-github-runner-207 kernel: [50872.570816] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 19:31:38 juju-e4d256-prod-github-runner-207 kernel: [50872.572020] Call Trace: Aug 22 19:31:38 juju-e4d256-prod-github-runner-207 kernel: [50872.572935] Aug 22 19:31:38 juju-e4d256-prod-github-runner-207 kernel: [50872.573825] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:31:38 juju-e4d256-prod-github-runner-207 kernel: [50872.574874] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:31:38 juju-e4d256-prod-github-runner-207 kernel: [50872.575912] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:31:38 juju-e4d256-prod-github-runner-207 kernel: [50872.576991] ? show_regs.part.0+0x23/0x29 Aug 22 19:31:38 juju-e4d256-prod-github-runner-207 kernel: [50872.577993] ? show_regs.cold+0x8/0xd Aug 22 19:31:38 juju-e4d256-prod-github-runner-207 kernel: [50872.578988] ? watchdog_timer_fn+0x1be/0x220 Aug 22 19:31:38 juju-e4d256-prod-github-runner-207 kernel: [50872.580000] ? lockup_detector_update_enable+0x60/0x60 Aug 22 19:31:38 juju-e4d256-prod-github-runner-207 kernel: [50872.581073] ? __hrtimer_run_queues+0x107/0x230 Aug 22 19:31:38 juju-e4d256-prod-github-runner-207 kernel: [50872.582108] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 19:31:38 juju-e4d256-prod-github-runner-207 kernel: [50872.583165] ? hrtimer_interrupt+0x101/0x220 Aug 22 19:31:38 juju-e4d256-prod-github-runner-207 kernel: [50872.584194] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 19:31:38 juju-e4d256-prod-github-runner-207 kernel: [50872.585272] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 19:31:38 juju-e4d256-prod-github-runner-207 kernel: [50872.586320] Aug 22 19:31:38 juju-e4d256-prod-github-runner-207 kernel: [50872.587182] Aug 22 19:31:38 juju-e4d256-prod-github-runner-207 kernel: [50872.588018] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 19:31:38 juju-e4d256-prod-github-runner-207 kernel: [50872.589050] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:31:38 juju-e4d256-prod-github-runner-207 kernel: [50872.590093] ? _raw_spin_lock+0x22/0x30 Aug 22 19:31:38 juju-e4d256-prod-github-runner-207 kernel: [50872.591054] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:31:38 juju-e4d256-prod-github-runner-207 kernel: [50872.592085] direct_page_fault+0x206/0x310 [kvm] Aug 22 19:31:38 juju-e4d256-prod-github-runner-207 kernel: [50872.593105] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 19:31:38 juju-e4d256-prod-github-runner-207 kernel: [50872.594110] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 19:31:38 juju-e4d256-prod-github-runner-207 kernel: [50872.595133] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 19:31:38 juju-e4d256-prod-github-runner-207 kernel: [50872.596103] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 19:31:38 juju-e4d256-prod-github-runner-207 kernel: [50872.597045] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 19:31:38 juju-e4d256-prod-github-runner-207 kernel: [50872.598020] handle_exit+0x98/0x230 [kvm_amd] Aug 22 19:31:38 juju-e4d256-prod-github-runner-207 kernel: [50872.598927] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 19:31:38 juju-e4d256-prod-github-runner-207 kernel: [50872.599838] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 19:31:38 juju-e4d256-prod-github-runner-207 kernel: [50872.600759] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 19:31:38 juju-e4d256-prod-github-runner-207 kernel: [50872.601660] vcpu_run+0x62/0x2c0 [kvm] Aug 22 19:31:38 juju-e4d256-prod-github-runner-207 kernel: [50872.602475] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 19:31:38 juju-e4d256-prod-github-runner-207 kernel: [50872.603291] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 19:31:38 juju-e4d256-prod-github-runner-207 kernel: [50872.604143] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 19:31:38 juju-e4d256-prod-github-runner-207 kernel: [50872.604937] ? __seccomp_filter+0x4a/0x4a0 Aug 22 19:31:38 juju-e4d256-prod-github-runner-207 kernel: [50872.605682] ? __fget_files+0x86/0xc0 Aug 22 19:31:38 juju-e4d256-prod-github-runner-207 kernel: [50872.606385] __x64_sys_ioctl+0x95/0xd0 Aug 22 19:31:38 juju-e4d256-prod-github-runner-207 kernel: [50872.607086] do_syscall_64+0x5c/0xc0 Aug 22 19:31:38 juju-e4d256-prod-github-runner-207 kernel: [50872.607750] ? do_futex+0x162/0x1f0 Aug 22 19:31:38 juju-e4d256-prod-github-runner-207 kernel: [50872.608397] ? __x64_sys_futex+0x78/0x1e0 Aug 22 19:31:38 juju-e4d256-prod-github-runner-207 kernel: [50872.609068] ? __secure_computing+0xa9/0x120 Aug 22 19:31:38 juju-e4d256-prod-github-runner-207 kernel: [50872.609756] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 19:31:38 juju-e4d256-prod-github-runner-207 kernel: [50872.610517] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:31:38 juju-e4d256-prod-github-runner-207 kernel: [50872.611262] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:31:38 juju-e4d256-prod-github-runner-207 kernel: [50872.611979] ? do_syscall_64+0x69/0xc0 Aug 22 19:31:38 juju-e4d256-prod-github-runner-207 kernel: [50872.612627] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:31:38 juju-e4d256-prod-github-runner-207 kernel: [50872.613330] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:31:38 juju-e4d256-prod-github-runner-207 kernel: [50872.614028] ? do_syscall_64+0x69/0xc0 Aug 22 19:31:38 juju-e4d256-prod-github-runner-207 kernel: [50872.614651] ? do_syscall_64+0x69/0xc0 Aug 22 19:31:38 juju-e4d256-prod-github-runner-207 kernel: [50872.615285] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 19:31:38 juju-e4d256-prod-github-runner-207 kernel: [50872.615990] RIP: 0033:0x7faa5d0edaff Aug 22 19:31:38 juju-e4d256-prod-github-runner-207 kernel: [50872.616612] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 19:31:38 juju-e4d256-prod-github-runner-207 kernel: [50872.618595] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 19:31:38 juju-e4d256-prod-github-runner-207 kernel: [50872.619510] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 19:31:38 juju-e4d256-prod-github-runner-207 kernel: [50872.620562] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 19:31:38 juju-e4d256-prod-github-runner-207 kernel: [50872.621618] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 19:31:38 juju-e4d256-prod-github-runner-207 kernel: [50872.622638] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 19:31:38 juju-e4d256-prod-github-runner-207 kernel: [50872.623679] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 19:31:38 juju-e4d256-prod-github-runner-207 kernel: [50872.624705] Aug 22 19:32:06 juju-e4d256-prod-github-runner-207 kernel: [50900.541980] watchdog: BUG: soft lockup - CPU#1 stuck for 47296s! [qemu-system-x86:6715] Aug 22 19:32:06 juju-e4d256-prod-github-runner-207 kernel: [50900.543889] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 19:32:06 juju-e4d256-prod-github-runner-207 kernel: [50900.544210] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 19:32:06 juju-e4d256-prod-github-runner-207 kernel: [50900.556365] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 19:32:06 juju-e4d256-prod-github-runner-207 kernel: [50900.557649] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 19:32:06 juju-e4d256-prod-github-runner-207 kernel: [50900.558892] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:32:06 juju-e4d256-prod-github-runner-207 kernel: [50900.559973] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 19:32:06 juju-e4d256-prod-github-runner-207 kernel: [50900.562602] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 19:32:06 juju-e4d256-prod-github-runner-207 kernel: [50900.563651] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 19:32:06 juju-e4d256-prod-github-runner-207 kernel: [50900.564811] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 19:32:06 juju-e4d256-prod-github-runner-207 kernel: [50900.565975] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 19:32:06 juju-e4d256-prod-github-runner-207 kernel: [50900.567163] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 19:32:06 juju-e4d256-prod-github-runner-207 kernel: [50900.568338] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 19:32:06 juju-e4d256-prod-github-runner-207 kernel: [50900.569504] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 19:32:06 juju-e4d256-prod-github-runner-207 kernel: [50900.570743] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 19:32:06 juju-e4d256-prod-github-runner-207 kernel: [50900.571878] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 19:32:06 juju-e4d256-prod-github-runner-207 kernel: [50900.573089] Call Trace: Aug 22 19:32:06 juju-e4d256-prod-github-runner-207 kernel: [50900.574001] Aug 22 19:32:06 juju-e4d256-prod-github-runner-207 kernel: [50900.574921] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:32:06 juju-e4d256-prod-github-runner-207 kernel: [50900.576115] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:32:06 juju-e4d256-prod-github-runner-207 kernel: [50900.577132] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:32:06 juju-e4d256-prod-github-runner-207 kernel: [50900.578245] ? show_regs.part.0+0x23/0x29 Aug 22 19:32:06 juju-e4d256-prod-github-runner-207 kernel: [50900.579266] ? show_regs.cold+0x8/0xd Aug 22 19:32:06 juju-e4d256-prod-github-runner-207 kernel: [50900.580236] ? watchdog_timer_fn+0x1be/0x220 Aug 22 19:32:06 juju-e4d256-prod-github-runner-207 kernel: [50900.581259] ? lockup_detector_update_enable+0x60/0x60 Aug 22 19:32:06 juju-e4d256-prod-github-runner-207 kernel: [50900.582350] ? __hrtimer_run_queues+0x107/0x230 Aug 22 19:32:06 juju-e4d256-prod-github-runner-207 kernel: [50900.583417] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 19:32:06 juju-e4d256-prod-github-runner-207 kernel: [50900.584454] ? hrtimer_interrupt+0x101/0x220 Aug 22 19:32:06 juju-e4d256-prod-github-runner-207 kernel: [50900.585491] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 19:32:06 juju-e4d256-prod-github-runner-207 kernel: [50900.586591] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 19:32:06 juju-e4d256-prod-github-runner-207 kernel: [50900.587648] Aug 22 19:32:06 juju-e4d256-prod-github-runner-207 kernel: [50900.588509] Aug 22 19:32:06 juju-e4d256-prod-github-runner-207 kernel: [50900.589345] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 19:32:06 juju-e4d256-prod-github-runner-207 kernel: [50900.590600] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:32:06 juju-e4d256-prod-github-runner-207 kernel: [50900.591645] ? _raw_spin_lock+0x22/0x30 Aug 22 19:32:06 juju-e4d256-prod-github-runner-207 kernel: [50900.592587] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:32:06 juju-e4d256-prod-github-runner-207 kernel: [50900.593619] direct_page_fault+0x206/0x310 [kvm] Aug 22 19:32:06 juju-e4d256-prod-github-runner-207 kernel: [50900.594671] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 19:32:06 juju-e4d256-prod-github-runner-207 kernel: [50900.595702] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 19:32:06 juju-e4d256-prod-github-runner-207 kernel: [50900.596700] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 19:32:06 juju-e4d256-prod-github-runner-207 kernel: [50900.597697] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 19:32:06 juju-e4d256-prod-github-runner-207 kernel: [50900.598660] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 19:32:06 juju-e4d256-prod-github-runner-207 kernel: [50900.599645] handle_exit+0x98/0x230 [kvm_amd] Aug 22 19:32:06 juju-e4d256-prod-github-runner-207 kernel: [50900.600536] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 19:32:06 juju-e4d256-prod-github-runner-207 kernel: [50900.601448] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 19:32:06 juju-e4d256-prod-github-runner-207 kernel: [50900.602397] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 19:32:06 juju-e4d256-prod-github-runner-207 kernel: [50900.603364] vcpu_run+0x62/0x2c0 [kvm] Aug 22 19:32:06 juju-e4d256-prod-github-runner-207 kernel: [50900.604177] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 19:32:06 juju-e4d256-prod-github-runner-207 kernel: [50900.604983] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 19:32:06 juju-e4d256-prod-github-runner-207 kernel: [50900.605857] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 19:32:06 juju-e4d256-prod-github-runner-207 kernel: [50900.606675] ? __seccomp_filter+0x4a/0x4a0 Aug 22 19:32:06 juju-e4d256-prod-github-runner-207 kernel: [50900.607416] ? __fget_files+0x86/0xc0 Aug 22 19:32:06 juju-e4d256-prod-github-runner-207 kernel: [50900.608128] __x64_sys_ioctl+0x95/0xd0 Aug 22 19:32:06 juju-e4d256-prod-github-runner-207 kernel: [50900.608830] do_syscall_64+0x5c/0xc0 Aug 22 19:32:06 juju-e4d256-prod-github-runner-207 kernel: [50900.609499] ? do_futex+0x162/0x1f0 Aug 22 19:32:06 juju-e4d256-prod-github-runner-207 kernel: [50900.610146] ? __x64_sys_futex+0x78/0x1e0 Aug 22 19:32:06 juju-e4d256-prod-github-runner-207 kernel: [50900.610847] ? __secure_computing+0xa9/0x120 Aug 22 19:32:06 juju-e4d256-prod-github-runner-207 kernel: [50900.611535] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 19:32:06 juju-e4d256-prod-github-runner-207 kernel: [50900.612290] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:32:06 juju-e4d256-prod-github-runner-207 kernel: [50900.613008] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:32:06 juju-e4d256-prod-github-runner-207 kernel: [50900.613736] ? do_syscall_64+0x69/0xc0 Aug 22 19:32:06 juju-e4d256-prod-github-runner-207 kernel: [50900.614401] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:32:06 juju-e4d256-prod-github-runner-207 kernel: [50900.615128] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:32:06 juju-e4d256-prod-github-runner-207 kernel: [50900.615835] ? do_syscall_64+0x69/0xc0 Aug 22 19:32:06 juju-e4d256-prod-github-runner-207 kernel: [50900.616465] ? do_syscall_64+0x69/0xc0 Aug 22 19:32:06 juju-e4d256-prod-github-runner-207 kernel: [50900.617086] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 19:32:06 juju-e4d256-prod-github-runner-207 kernel: [50900.617790] RIP: 0033:0x7faa5d0edaff Aug 22 19:32:06 juju-e4d256-prod-github-runner-207 kernel: [50900.618487] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 19:32:06 juju-e4d256-prod-github-runner-207 kernel: [50900.620570] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 19:32:06 juju-e4d256-prod-github-runner-207 kernel: [50900.621503] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 19:32:06 juju-e4d256-prod-github-runner-207 kernel: [50900.622411] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 19:32:06 juju-e4d256-prod-github-runner-207 kernel: [50900.623303] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 19:32:06 juju-e4d256-prod-github-runner-207 kernel: [50900.624221] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 19:32:06 juju-e4d256-prod-github-runner-207 kernel: [50900.625114] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 19:32:06 juju-e4d256-prod-github-runner-207 kernel: [50900.626011] Aug 22 19:32:34 juju-e4d256-prod-github-runner-207 kernel: [50928.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 47322s! [qemu-system-x86:6715] Aug 22 19:32:34 juju-e4d256-prod-github-runner-207 kernel: [50928.543127] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 19:32:34 juju-e4d256-prod-github-runner-207 kernel: [50928.543200] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 19:32:34 juju-e4d256-prod-github-runner-207 kernel: [50928.555547] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 19:32:34 juju-e4d256-prod-github-runner-207 kernel: [50928.556894] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 19:32:34 juju-e4d256-prod-github-runner-207 kernel: [50928.558166] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:32:34 juju-e4d256-prod-github-runner-207 kernel: [50928.559240] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 19:32:34 juju-e4d256-prod-github-runner-207 kernel: [50928.561857] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 19:32:34 juju-e4d256-prod-github-runner-207 kernel: [50928.562931] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 19:32:34 juju-e4d256-prod-github-runner-207 kernel: [50928.564165] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 19:32:34 juju-e4d256-prod-github-runner-207 kernel: [50928.565486] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 19:32:34 juju-e4d256-prod-github-runner-207 kernel: [50928.566806] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 19:32:34 juju-e4d256-prod-github-runner-207 kernel: [50928.568113] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 19:32:34 juju-e4d256-prod-github-runner-207 kernel: [50928.569496] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 19:32:34 juju-e4d256-prod-github-runner-207 kernel: [50928.570913] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 19:32:34 juju-e4d256-prod-github-runner-207 kernel: [50928.572136] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 19:32:34 juju-e4d256-prod-github-runner-207 kernel: [50928.573495] Call Trace: Aug 22 19:32:34 juju-e4d256-prod-github-runner-207 kernel: [50928.574491] Aug 22 19:32:34 juju-e4d256-prod-github-runner-207 kernel: [50928.575425] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:32:34 juju-e4d256-prod-github-runner-207 kernel: [50928.576560] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:32:34 juju-e4d256-prod-github-runner-207 kernel: [50928.577762] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:32:34 juju-e4d256-prod-github-runner-207 kernel: [50928.578973] ? show_regs.part.0+0x23/0x29 Aug 22 19:32:34 juju-e4d256-prod-github-runner-207 kernel: [50928.580067] ? show_regs.cold+0x8/0xd Aug 22 19:32:34 juju-e4d256-prod-github-runner-207 kernel: [50928.581117] ? watchdog_timer_fn+0x1be/0x220 Aug 22 19:32:34 juju-e4d256-prod-github-runner-207 kernel: [50928.582231] ? lockup_detector_update_enable+0x60/0x60 Aug 22 19:32:34 juju-e4d256-prod-github-runner-207 kernel: [50928.583394] ? __hrtimer_run_queues+0x107/0x230 Aug 22 19:32:34 juju-e4d256-prod-github-runner-207 kernel: [50928.584511] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 19:32:34 juju-e4d256-prod-github-runner-207 kernel: [50928.585639] ? hrtimer_interrupt+0x101/0x220 Aug 22 19:32:34 juju-e4d256-prod-github-runner-207 kernel: [50928.586757] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 19:32:34 juju-e4d256-prod-github-runner-207 kernel: [50928.587952] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 19:32:34 juju-e4d256-prod-github-runner-207 kernel: [50928.589296] Aug 22 19:32:34 juju-e4d256-prod-github-runner-207 kernel: [50928.590226] Aug 22 19:32:34 juju-e4d256-prod-github-runner-207 kernel: [50928.591125] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 19:32:34 juju-e4d256-prod-github-runner-207 kernel: [50928.592271] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:32:34 juju-e4d256-prod-github-runner-207 kernel: [50928.593422] ? _raw_spin_lock+0x22/0x30 Aug 22 19:32:34 juju-e4d256-prod-github-runner-207 kernel: [50928.594462] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:32:34 juju-e4d256-prod-github-runner-207 kernel: [50928.595588] direct_page_fault+0x206/0x310 [kvm] Aug 22 19:32:34 juju-e4d256-prod-github-runner-207 kernel: [50928.596715] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 19:32:34 juju-e4d256-prod-github-runner-207 kernel: [50928.597829] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 19:32:34 juju-e4d256-prod-github-runner-207 kernel: [50928.598934] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 19:32:34 juju-e4d256-prod-github-runner-207 kernel: [50928.600006] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 19:32:34 juju-e4d256-prod-github-runner-207 kernel: [50928.601044] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 19:32:34 juju-e4d256-prod-github-runner-207 kernel: [50928.602152] handle_exit+0x98/0x230 [kvm_amd] Aug 22 19:32:34 juju-e4d256-prod-github-runner-207 kernel: [50928.603142] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 19:32:34 juju-e4d256-prod-github-runner-207 kernel: [50928.604148] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 19:32:34 juju-e4d256-prod-github-runner-207 kernel: [50928.605171] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 19:32:34 juju-e4d256-prod-github-runner-207 kernel: [50928.606232] vcpu_run+0x62/0x2c0 [kvm] Aug 22 19:32:34 juju-e4d256-prod-github-runner-207 kernel: [50928.607166] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 19:32:34 juju-e4d256-prod-github-runner-207 kernel: [50928.608151] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 19:32:34 juju-e4d256-prod-github-runner-207 kernel: [50928.609134] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 19:32:34 juju-e4d256-prod-github-runner-207 kernel: [50928.610036] ? __seccomp_filter+0x4a/0x4a0 Aug 22 19:32:34 juju-e4d256-prod-github-runner-207 kernel: [50928.610913] ? __fget_files+0x86/0xc0 Aug 22 19:32:34 juju-e4d256-prod-github-runner-207 kernel: [50928.611692] __x64_sys_ioctl+0x95/0xd0 Aug 22 19:32:34 juju-e4d256-prod-github-runner-207 kernel: [50928.612463] do_syscall_64+0x5c/0xc0 Aug 22 19:32:34 juju-e4d256-prod-github-runner-207 kernel: [50928.613207] ? do_futex+0x162/0x1f0 Aug 22 19:32:34 juju-e4d256-prod-github-runner-207 kernel: [50928.613927] ? __x64_sys_futex+0x78/0x1e0 Aug 22 19:32:34 juju-e4d256-prod-github-runner-207 kernel: [50928.614700] ? __secure_computing+0xa9/0x120 Aug 22 19:32:34 juju-e4d256-prod-github-runner-207 kernel: [50928.615471] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 19:32:34 juju-e4d256-prod-github-runner-207 kernel: [50928.616332] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:32:34 juju-e4d256-prod-github-runner-207 kernel: [50928.617146] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:32:34 juju-e4d256-prod-github-runner-207 kernel: [50928.617954] ? do_syscall_64+0x69/0xc0 Aug 22 19:32:34 juju-e4d256-prod-github-runner-207 kernel: [50928.618691] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:32:34 juju-e4d256-prod-github-runner-207 kernel: [50928.619487] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:32:34 juju-e4d256-prod-github-runner-207 kernel: [50928.620276] ? do_syscall_64+0x69/0xc0 Aug 22 19:32:34 juju-e4d256-prod-github-runner-207 kernel: [50928.620977] ? do_syscall_64+0x69/0xc0 Aug 22 19:32:34 juju-e4d256-prod-github-runner-207 kernel: [50928.621681] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 19:32:34 juju-e4d256-prod-github-runner-207 kernel: [50928.622497] RIP: 0033:0x7faa5d0edaff Aug 22 19:32:34 juju-e4d256-prod-github-runner-207 kernel: [50928.623219] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 19:32:34 juju-e4d256-prod-github-runner-207 kernel: [50928.625548] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 19:32:34 juju-e4d256-prod-github-runner-207 kernel: [50928.626625] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 19:32:34 juju-e4d256-prod-github-runner-207 kernel: [50928.627650] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 19:32:34 juju-e4d256-prod-github-runner-207 kernel: [50928.628678] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 19:32:34 juju-e4d256-prod-github-runner-207 kernel: [50928.629709] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 19:32:34 juju-e4d256-prod-github-runner-207 kernel: [50928.630744] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 19:32:34 juju-e4d256-prod-github-runner-207 kernel: [50928.631770] Aug 22 19:32:46 juju-e4d256-prod-github-runner-207 kernel: [50940.584711] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 19:32:46 juju-e4d256-prod-github-runner-207 kernel: [50940.585699] rcu: 1-....: (12665845 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=6124083 Aug 22 19:32:46 juju-e4d256-prod-github-runner-207 kernel: [50940.586880] (t=12705846 jiffies g=23269 q=48224) Aug 22 19:32:46 juju-e4d256-prod-github-runner-207 kernel: [50940.587685] NMI backtrace for cpu 1 Aug 22 19:32:46 juju-e4d256-prod-github-runner-207 kernel: [50940.588402] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 19:32:46 juju-e4d256-prod-github-runner-207 kernel: [50940.589540] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 19:32:46 juju-e4d256-prod-github-runner-207 kernel: [50940.590639] Call Trace: Aug 22 19:32:46 juju-e4d256-prod-github-runner-207 kernel: [50940.591321] Aug 22 19:32:46 juju-e4d256-prod-github-runner-207 kernel: [50940.591972] show_stack+0x52/0x5c Aug 22 19:32:46 juju-e4d256-prod-github-runner-207 kernel: [50940.592704] dump_stack_lvl+0x4a/0x63 Aug 22 19:32:46 juju-e4d256-prod-github-runner-207 kernel: [50940.593463] dump_stack+0x10/0x16 Aug 22 19:32:46 juju-e4d256-prod-github-runner-207 kernel: [50940.594209] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 19:32:46 juju-e4d256-prod-github-runner-207 kernel: [50940.595006] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 19:32:46 juju-e4d256-prod-github-runner-207 kernel: [50940.595800] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 19:32:46 juju-e4d256-prod-github-runner-207 kernel: [50940.596631] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 19:32:46 juju-e4d256-prod-github-runner-207 kernel: [50940.597463] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 19:32:46 juju-e4d256-prod-github-runner-207 kernel: [50940.598306] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 19:32:46 juju-e4d256-prod-github-runner-207 kernel: [50940.599094] print_cpu_stall.cold+0x2f/0xe2 Aug 22 19:32:46 juju-e4d256-prod-github-runner-207 kernel: [50940.599869] ? timekeeping_update+0xf7/0x150 Aug 22 19:32:46 juju-e4d256-prod-github-runner-207 kernel: [50940.600656] check_cpu_stall+0x109/0x270 Aug 22 19:32:46 juju-e4d256-prod-github-runner-207 kernel: [50940.601418] rcu_sched_clock_irq+0x9a/0x250 Aug 22 19:32:46 juju-e4d256-prod-github-runner-207 kernel: [50940.602223] update_process_times+0x94/0xd0 Aug 22 19:32:46 juju-e4d256-prod-github-runner-207 kernel: [50940.603001] tick_sched_handle+0x29/0x70 Aug 22 19:32:46 juju-e4d256-prod-github-runner-207 kernel: [50940.603765] tick_sched_timer+0x8c/0xc0 Aug 22 19:32:46 juju-e4d256-prod-github-runner-207 kernel: [50940.604512] ? tick_nohz_handler+0xb0/0xb0 Aug 22 19:32:46 juju-e4d256-prod-github-runner-207 kernel: [50940.605279] __hrtimer_run_queues+0x107/0x230 Aug 22 19:32:46 juju-e4d256-prod-github-runner-207 kernel: [50940.606078] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 19:32:46 juju-e4d256-prod-github-runner-207 kernel: [50940.606871] hrtimer_interrupt+0x101/0x220 Aug 22 19:32:46 juju-e4d256-prod-github-runner-207 kernel: [50940.607641] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 19:32:46 juju-e4d256-prod-github-runner-207 kernel: [50940.608470] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 19:32:46 juju-e4d256-prod-github-runner-207 kernel: [50940.609284] Aug 22 19:32:46 juju-e4d256-prod-github-runner-207 kernel: [50940.609957] Aug 22 19:32:46 juju-e4d256-prod-github-runner-207 kernel: [50940.610615] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 19:32:46 juju-e4d256-prod-github-runner-207 kernel: [50940.611447] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:32:46 juju-e4d256-prod-github-runner-207 kernel: [50940.612340] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 19:32:46 juju-e4d256-prod-github-runner-207 kernel: [50940.614615] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 19:32:46 juju-e4d256-prod-github-runner-207 kernel: [50940.615505] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 19:32:46 juju-e4d256-prod-github-runner-207 kernel: [50940.616523] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 19:32:46 juju-e4d256-prod-github-runner-207 kernel: [50940.617519] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 19:32:46 juju-e4d256-prod-github-runner-207 kernel: [50940.618532] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 19:32:46 juju-e4d256-prod-github-runner-207 kernel: [50940.619518] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 19:32:46 juju-e4d256-prod-github-runner-207 kernel: [50940.620503] ? _raw_spin_lock+0x22/0x30 Aug 22 19:32:46 juju-e4d256-prod-github-runner-207 kernel: [50940.621290] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:32:46 juju-e4d256-prod-github-runner-207 kernel: [50940.622159] direct_page_fault+0x206/0x310 [kvm] Aug 22 19:32:46 juju-e4d256-prod-github-runner-207 kernel: [50940.623032] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 19:32:46 juju-e4d256-prod-github-runner-207 kernel: [50940.623902] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 19:32:46 juju-e4d256-prod-github-runner-207 kernel: [50940.624750] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 19:32:46 juju-e4d256-prod-github-runner-207 kernel: [50940.625576] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 19:32:46 juju-e4d256-prod-github-runner-207 kernel: [50940.626410] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 19:32:46 juju-e4d256-prod-github-runner-207 kernel: [50940.627256] handle_exit+0x98/0x230 [kvm_amd] Aug 22 19:32:46 juju-e4d256-prod-github-runner-207 kernel: [50940.628036] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 19:32:46 juju-e4d256-prod-github-runner-207 kernel: [50940.628847] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 19:32:46 juju-e4d256-prod-github-runner-207 kernel: [50940.629660] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 19:32:46 juju-e4d256-prod-github-runner-207 kernel: [50940.630606] vcpu_run+0x62/0x2c0 [kvm] Aug 22 19:32:46 juju-e4d256-prod-github-runner-207 kernel: [50940.631342] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 19:32:46 juju-e4d256-prod-github-runner-207 kernel: [50940.632093] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 19:32:46 juju-e4d256-prod-github-runner-207 kernel: [50940.632911] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 19:32:46 juju-e4d256-prod-github-runner-207 kernel: [50940.633693] ? __seccomp_filter+0x4a/0x4a0 Aug 22 19:32:46 juju-e4d256-prod-github-runner-207 kernel: [50940.634444] ? __fget_files+0x86/0xc0 Aug 22 19:32:46 juju-e4d256-prod-github-runner-207 kernel: [50940.635147] __x64_sys_ioctl+0x95/0xd0 Aug 22 19:32:46 juju-e4d256-prod-github-runner-207 kernel: [50940.635853] do_syscall_64+0x5c/0xc0 Aug 22 19:32:46 juju-e4d256-prod-github-runner-207 kernel: [50940.636547] ? do_futex+0x162/0x1f0 Aug 22 19:32:46 juju-e4d256-prod-github-runner-207 kernel: [50940.637231] ? __x64_sys_futex+0x78/0x1e0 Aug 22 19:32:46 juju-e4d256-prod-github-runner-207 kernel: [50940.637952] ? __secure_computing+0xa9/0x120 Aug 22 19:32:46 juju-e4d256-prod-github-runner-207 kernel: [50940.638680] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 19:32:46 juju-e4d256-prod-github-runner-207 kernel: [50940.639492] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:32:46 juju-e4d256-prod-github-runner-207 kernel: [50940.640261] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:32:46 juju-e4d256-prod-github-runner-207 kernel: [50940.641027] ? do_syscall_64+0x69/0xc0 Aug 22 19:32:46 juju-e4d256-prod-github-runner-207 kernel: [50940.641727] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:32:46 juju-e4d256-prod-github-runner-207 kernel: [50940.642513] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:32:46 juju-e4d256-prod-github-runner-207 kernel: [50940.643279] ? do_syscall_64+0x69/0xc0 Aug 22 19:32:46 juju-e4d256-prod-github-runner-207 kernel: [50940.643990] ? do_syscall_64+0x69/0xc0 Aug 22 19:32:46 juju-e4d256-prod-github-runner-207 kernel: [50940.644694] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 19:32:46 juju-e4d256-prod-github-runner-207 kernel: [50940.645481] RIP: 0033:0x7faa5d0edaff Aug 22 19:32:46 juju-e4d256-prod-github-runner-207 kernel: [50940.646188] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 19:32:46 juju-e4d256-prod-github-runner-207 kernel: [50940.648343] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 19:32:46 juju-e4d256-prod-github-runner-207 kernel: [50940.649327] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 19:32:46 juju-e4d256-prod-github-runner-207 kernel: [50940.650316] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 19:32:46 juju-e4d256-prod-github-runner-207 kernel: [50940.651283] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 19:32:46 juju-e4d256-prod-github-runner-207 kernel: [50940.652251] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 19:32:46 juju-e4d256-prod-github-runner-207 kernel: [50940.653203] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 19:32:46 juju-e4d256-prod-github-runner-207 kernel: [50940.654145] Aug 22 19:33:14 juju-e4d256-prod-github-runner-207 kernel: [50968.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 47360s! [qemu-system-x86:6715] Aug 22 19:33:14 juju-e4d256-prod-github-runner-207 kernel: [50968.543336] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 19:33:14 juju-e4d256-prod-github-runner-207 kernel: [50968.543411] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 19:33:14 juju-e4d256-prod-github-runner-207 kernel: [50968.557476] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 19:33:14 juju-e4d256-prod-github-runner-207 kernel: [50968.558985] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 19:33:14 juju-e4d256-prod-github-runner-207 kernel: [50968.560388] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:33:14 juju-e4d256-prod-github-runner-207 kernel: [50968.561561] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 19:33:14 juju-e4d256-prod-github-runner-207 kernel: [50968.564495] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 19:33:14 juju-e4d256-prod-github-runner-207 kernel: [50968.565655] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 19:33:14 juju-e4d256-prod-github-runner-207 kernel: [50968.566945] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 19:33:14 juju-e4d256-prod-github-runner-207 kernel: [50968.568239] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 19:33:14 juju-e4d256-prod-github-runner-207 kernel: [50968.569537] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 19:33:14 juju-e4d256-prod-github-runner-207 kernel: [50968.570848] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 19:33:14 juju-e4d256-prod-github-runner-207 kernel: [50968.572176] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 19:33:14 juju-e4d256-prod-github-runner-207 kernel: [50968.573604] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 19:33:14 juju-e4d256-prod-github-runner-207 kernel: [50968.574819] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 19:33:14 juju-e4d256-prod-github-runner-207 kernel: [50968.576152] Call Trace: Aug 22 19:33:14 juju-e4d256-prod-github-runner-207 kernel: [50968.577117] Aug 22 19:33:14 juju-e4d256-prod-github-runner-207 kernel: [50968.578072] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:33:14 juju-e4d256-prod-github-runner-207 kernel: [50968.579186] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:33:14 juju-e4d256-prod-github-runner-207 kernel: [50968.580318] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:33:14 juju-e4d256-prod-github-runner-207 kernel: [50968.581509] ? show_regs.part.0+0x23/0x29 Aug 22 19:33:14 juju-e4d256-prod-github-runner-207 kernel: [50968.582616] ? show_regs.cold+0x8/0xd Aug 22 19:33:14 juju-e4d256-prod-github-runner-207 kernel: [50968.583661] ? watchdog_timer_fn+0x1be/0x220 Aug 22 19:33:14 juju-e4d256-prod-github-runner-207 kernel: [50968.584765] ? lockup_detector_update_enable+0x60/0x60 Aug 22 19:33:14 juju-e4d256-prod-github-runner-207 kernel: [50968.585946] ? __hrtimer_run_queues+0x107/0x230 Aug 22 19:33:14 juju-e4d256-prod-github-runner-207 kernel: [50968.587081] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 19:33:14 juju-e4d256-prod-github-runner-207 kernel: [50968.588239] ? hrtimer_interrupt+0x101/0x220 Aug 22 19:33:14 juju-e4d256-prod-github-runner-207 kernel: [50968.589352] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 19:33:14 juju-e4d256-prod-github-runner-207 kernel: [50968.590600] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 19:33:14 juju-e4d256-prod-github-runner-207 kernel: [50968.591751] Aug 22 19:33:14 juju-e4d256-prod-github-runner-207 kernel: [50968.592664] Aug 22 19:33:14 juju-e4d256-prod-github-runner-207 kernel: [50968.593549] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 19:33:14 juju-e4d256-prod-github-runner-207 kernel: [50968.594715] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:33:14 juju-e4d256-prod-github-runner-207 kernel: [50968.595863] ? _raw_spin_lock+0x22/0x30 Aug 22 19:33:14 juju-e4d256-prod-github-runner-207 kernel: [50968.596890] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:33:14 juju-e4d256-prod-github-runner-207 kernel: [50968.598021] direct_page_fault+0x206/0x310 [kvm] Aug 22 19:33:14 juju-e4d256-prod-github-runner-207 kernel: [50968.599139] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 19:33:14 juju-e4d256-prod-github-runner-207 kernel: [50968.600241] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 19:33:14 juju-e4d256-prod-github-runner-207 kernel: [50968.601362] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 19:33:14 juju-e4d256-prod-github-runner-207 kernel: [50968.602453] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 19:33:14 juju-e4d256-prod-github-runner-207 kernel: [50968.603502] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 19:33:14 juju-e4d256-prod-github-runner-207 kernel: [50968.604636] handle_exit+0x98/0x230 [kvm_amd] Aug 22 19:33:14 juju-e4d256-prod-github-runner-207 kernel: [50968.605654] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 19:33:14 juju-e4d256-prod-github-runner-207 kernel: [50968.606706] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 19:33:14 juju-e4d256-prod-github-runner-207 kernel: [50968.607761] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 19:33:14 juju-e4d256-prod-github-runner-207 kernel: [50968.608771] vcpu_run+0x62/0x2c0 [kvm] Aug 22 19:33:14 juju-e4d256-prod-github-runner-207 kernel: [50968.609704] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 19:33:14 juju-e4d256-prod-github-runner-207 kernel: [50968.610666] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 19:33:14 juju-e4d256-prod-github-runner-207 kernel: [50968.611662] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 19:33:14 juju-e4d256-prod-github-runner-207 kernel: [50968.612566] ? __seccomp_filter+0x4a/0x4a0 Aug 22 19:33:14 juju-e4d256-prod-github-runner-207 kernel: [50968.613399] ? __fget_files+0x86/0xc0 Aug 22 19:33:14 juju-e4d256-prod-github-runner-207 kernel: [50968.614219] __x64_sys_ioctl+0x95/0xd0 Aug 22 19:33:14 juju-e4d256-prod-github-runner-207 kernel: [50968.615005] do_syscall_64+0x5c/0xc0 Aug 22 19:33:14 juju-e4d256-prod-github-runner-207 kernel: [50968.615747] ? do_futex+0x162/0x1f0 Aug 22 19:33:14 juju-e4d256-prod-github-runner-207 kernel: [50968.616470] ? __x64_sys_futex+0x78/0x1e0 Aug 22 19:33:14 juju-e4d256-prod-github-runner-207 kernel: [50968.617256] ? __secure_computing+0xa9/0x120 Aug 22 19:33:14 juju-e4d256-prod-github-runner-207 kernel: [50968.618054] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 19:33:14 juju-e4d256-prod-github-runner-207 kernel: [50968.618930] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:33:14 juju-e4d256-prod-github-runner-207 kernel: [50968.619753] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:33:14 juju-e4d256-prod-github-runner-207 kernel: [50968.620569] ? do_syscall_64+0x69/0xc0 Aug 22 19:33:14 juju-e4d256-prod-github-runner-207 kernel: [50968.621297] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:33:14 juju-e4d256-prod-github-runner-207 kernel: [50968.622152] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:33:14 juju-e4d256-prod-github-runner-207 kernel: [50968.622945] ? do_syscall_64+0x69/0xc0 Aug 22 19:33:14 juju-e4d256-prod-github-runner-207 kernel: [50968.623657] ? do_syscall_64+0x69/0xc0 Aug 22 19:33:14 juju-e4d256-prod-github-runner-207 kernel: [50968.624372] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 19:33:14 juju-e4d256-prod-github-runner-207 kernel: [50968.625184] RIP: 0033:0x7faa5d0edaff Aug 22 19:33:14 juju-e4d256-prod-github-runner-207 kernel: [50968.625914] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 19:33:14 juju-e4d256-prod-github-runner-207 kernel: [50968.628238] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 19:33:14 juju-e4d256-prod-github-runner-207 kernel: [50968.629308] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 19:33:14 juju-e4d256-prod-github-runner-207 kernel: [50968.630390] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 19:33:14 juju-e4d256-prod-github-runner-207 kernel: [50968.631432] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 19:33:14 juju-e4d256-prod-github-runner-207 kernel: [50968.632465] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 19:33:14 juju-e4d256-prod-github-runner-207 kernel: [50968.633505] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 19:33:14 juju-e4d256-prod-github-runner-207 kernel: [50968.634582] Aug 22 19:33:42 juju-e4d256-prod-github-runner-207 kernel: [50996.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 47386s! [qemu-system-x86:6715] Aug 22 19:33:42 juju-e4d256-prod-github-runner-207 kernel: [50996.543887] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 19:33:42 juju-e4d256-prod-github-runner-207 kernel: [50996.544196] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 19:33:42 juju-e4d256-prod-github-runner-207 kernel: [50996.556382] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 19:33:42 juju-e4d256-prod-github-runner-207 kernel: [50996.557658] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 19:33:42 juju-e4d256-prod-github-runner-207 kernel: [50996.558914] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:33:42 juju-e4d256-prod-github-runner-207 kernel: [50996.560091] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 19:33:42 juju-e4d256-prod-github-runner-207 kernel: [50996.562679] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 19:33:42 juju-e4d256-prod-github-runner-207 kernel: [50996.563721] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 19:33:42 juju-e4d256-prod-github-runner-207 kernel: [50996.564904] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 19:33:42 juju-e4d256-prod-github-runner-207 kernel: [50996.566092] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 19:33:42 juju-e4d256-prod-github-runner-207 kernel: [50996.567267] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 19:33:42 juju-e4d256-prod-github-runner-207 kernel: [50996.568427] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 19:33:42 juju-e4d256-prod-github-runner-207 kernel: [50996.569634] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 19:33:42 juju-e4d256-prod-github-runner-207 kernel: [50996.570877] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 19:33:42 juju-e4d256-prod-github-runner-207 kernel: [50996.571976] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 19:33:42 juju-e4d256-prod-github-runner-207 kernel: [50996.573197] Call Trace: Aug 22 19:33:42 juju-e4d256-prod-github-runner-207 kernel: [50996.574180] Aug 22 19:33:42 juju-e4d256-prod-github-runner-207 kernel: [50996.575085] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:33:42 juju-e4d256-prod-github-runner-207 kernel: [50996.576113] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:33:42 juju-e4d256-prod-github-runner-207 kernel: [50996.577132] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:33:42 juju-e4d256-prod-github-runner-207 kernel: [50996.578239] ? show_regs.part.0+0x23/0x29 Aug 22 19:33:42 juju-e4d256-prod-github-runner-207 kernel: [50996.579235] ? show_regs.cold+0x8/0xd Aug 22 19:33:42 juju-e4d256-prod-github-runner-207 kernel: [50996.580217] ? watchdog_timer_fn+0x1be/0x220 Aug 22 19:33:42 juju-e4d256-prod-github-runner-207 kernel: [50996.581227] ? lockup_detector_update_enable+0x60/0x60 Aug 22 19:33:42 juju-e4d256-prod-github-runner-207 kernel: [50996.582302] ? __hrtimer_run_queues+0x107/0x230 Aug 22 19:33:42 juju-e4d256-prod-github-runner-207 kernel: [50996.583338] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 19:33:42 juju-e4d256-prod-github-runner-207 kernel: [50996.584423] ? hrtimer_interrupt+0x101/0x220 Aug 22 19:33:42 juju-e4d256-prod-github-runner-207 kernel: [50996.585517] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 19:33:42 juju-e4d256-prod-github-runner-207 kernel: [50996.586677] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 19:33:42 juju-e4d256-prod-github-runner-207 kernel: [50996.587753] Aug 22 19:33:42 juju-e4d256-prod-github-runner-207 kernel: [50996.588612] Aug 22 19:33:42 juju-e4d256-prod-github-runner-207 kernel: [50996.589471] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 19:33:42 juju-e4d256-prod-github-runner-207 kernel: [50996.590627] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:33:42 juju-e4d256-prod-github-runner-207 kernel: [50996.591683] ? _raw_spin_lock+0x22/0x30 Aug 22 19:33:42 juju-e4d256-prod-github-runner-207 kernel: [50996.592638] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:33:42 juju-e4d256-prod-github-runner-207 kernel: [50996.593697] direct_page_fault+0x206/0x310 [kvm] Aug 22 19:33:42 juju-e4d256-prod-github-runner-207 kernel: [50996.594732] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 19:33:42 juju-e4d256-prod-github-runner-207 kernel: [50996.595768] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 19:33:42 juju-e4d256-prod-github-runner-207 kernel: [50996.596777] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 19:33:42 juju-e4d256-prod-github-runner-207 kernel: [50996.597788] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 19:33:42 juju-e4d256-prod-github-runner-207 kernel: [50996.598737] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 19:33:42 juju-e4d256-prod-github-runner-207 kernel: [50996.599726] handle_exit+0x98/0x230 [kvm_amd] Aug 22 19:33:42 juju-e4d256-prod-github-runner-207 kernel: [50996.600634] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 19:33:42 juju-e4d256-prod-github-runner-207 kernel: [50996.601568] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 19:33:42 juju-e4d256-prod-github-runner-207 kernel: [50996.602517] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 19:33:42 juju-e4d256-prod-github-runner-207 kernel: [50996.603431] vcpu_run+0x62/0x2c0 [kvm] Aug 22 19:33:42 juju-e4d256-prod-github-runner-207 kernel: [50996.604241] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 19:33:42 juju-e4d256-prod-github-runner-207 kernel: [50996.605051] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 19:33:42 juju-e4d256-prod-github-runner-207 kernel: [50996.605965] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 19:33:42 juju-e4d256-prod-github-runner-207 kernel: [50996.606775] ? __seccomp_filter+0x4a/0x4a0 Aug 22 19:33:42 juju-e4d256-prod-github-runner-207 kernel: [50996.607517] ? __fget_files+0x86/0xc0 Aug 22 19:33:42 juju-e4d256-prod-github-runner-207 kernel: [50996.608220] __x64_sys_ioctl+0x95/0xd0 Aug 22 19:33:42 juju-e4d256-prod-github-runner-207 kernel: [50996.609026] do_syscall_64+0x5c/0xc0 Aug 22 19:33:42 juju-e4d256-prod-github-runner-207 kernel: [50996.609977] ? do_futex+0x162/0x1f0 Aug 22 19:33:42 juju-e4d256-prod-github-runner-207 kernel: [50996.610702] ? __x64_sys_futex+0x78/0x1e0 Aug 22 19:33:42 juju-e4d256-prod-github-runner-207 kernel: [50996.611454] ? __secure_computing+0xa9/0x120 Aug 22 19:33:42 juju-e4d256-prod-github-runner-207 kernel: [50996.612225] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 19:33:42 juju-e4d256-prod-github-runner-207 kernel: [50996.613091] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:33:42 juju-e4d256-prod-github-runner-207 kernel: [50996.614018] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:33:42 juju-e4d256-prod-github-runner-207 kernel: [50996.614860] ? do_syscall_64+0x69/0xc0 Aug 22 19:33:42 juju-e4d256-prod-github-runner-207 kernel: [50996.615579] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:33:42 juju-e4d256-prod-github-runner-207 kernel: [50996.616372] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:33:42 juju-e4d256-prod-github-runner-207 kernel: [50996.617156] ? do_syscall_64+0x69/0xc0 Aug 22 19:33:42 juju-e4d256-prod-github-runner-207 kernel: [50996.617871] ? do_syscall_64+0x69/0xc0 Aug 22 19:33:42 juju-e4d256-prod-github-runner-207 kernel: [50996.618576] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 19:33:42 juju-e4d256-prod-github-runner-207 kernel: [50996.619380] RIP: 0033:0x7faa5d0edaff Aug 22 19:33:42 juju-e4d256-prod-github-runner-207 kernel: [50996.620125] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 19:33:42 juju-e4d256-prod-github-runner-207 kernel: [50996.622559] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 19:33:42 juju-e4d256-prod-github-runner-207 kernel: [50996.623612] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 19:33:42 juju-e4d256-prod-github-runner-207 kernel: [50996.624636] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 19:33:42 juju-e4d256-prod-github-runner-207 kernel: [50996.625679] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 19:33:42 juju-e4d256-prod-github-runner-207 kernel: [50996.626698] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 19:33:42 juju-e4d256-prod-github-runner-207 kernel: [50996.627717] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 19:33:42 juju-e4d256-prod-github-runner-207 kernel: [50996.628739] Aug 22 19:34:10 juju-e4d256-prod-github-runner-207 kernel: [51024.542006] watchdog: BUG: soft lockup - CPU#1 stuck for 47412s! [qemu-system-x86:6715] Aug 22 19:34:10 juju-e4d256-prod-github-runner-207 kernel: [51024.543217] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 19:34:10 juju-e4d256-prod-github-runner-207 kernel: [51024.543320] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 19:34:10 juju-e4d256-prod-github-runner-207 kernel: [51024.555643] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 19:34:10 juju-e4d256-prod-github-runner-207 kernel: [51024.556949] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 19:34:10 juju-e4d256-prod-github-runner-207 kernel: [51024.558172] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:34:10 juju-e4d256-prod-github-runner-207 kernel: [51024.559235] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 19:34:10 juju-e4d256-prod-github-runner-207 kernel: [51024.561890] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 19:34:10 juju-e4d256-prod-github-runner-207 kernel: [51024.562973] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 19:34:10 juju-e4d256-prod-github-runner-207 kernel: [51024.564152] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 19:34:10 juju-e4d256-prod-github-runner-207 kernel: [51024.565327] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 19:34:10 juju-e4d256-prod-github-runner-207 kernel: [51024.566490] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 19:34:10 juju-e4d256-prod-github-runner-207 kernel: [51024.567661] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 19:34:10 juju-e4d256-prod-github-runner-207 kernel: [51024.568876] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 19:34:10 juju-e4d256-prod-github-runner-207 kernel: [51024.570134] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 19:34:10 juju-e4d256-prod-github-runner-207 kernel: [51024.571234] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 19:34:10 juju-e4d256-prod-github-runner-207 kernel: [51024.572471] Call Trace: Aug 22 19:34:10 juju-e4d256-prod-github-runner-207 kernel: [51024.573420] Aug 22 19:34:10 juju-e4d256-prod-github-runner-207 kernel: [51024.574307] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:34:10 juju-e4d256-prod-github-runner-207 kernel: [51024.575338] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:34:10 juju-e4d256-prod-github-runner-207 kernel: [51024.576357] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:34:10 juju-e4d256-prod-github-runner-207 kernel: [51024.577440] ? show_regs.part.0+0x23/0x29 Aug 22 19:34:10 juju-e4d256-prod-github-runner-207 kernel: [51024.578437] ? show_regs.cold+0x8/0xd Aug 22 19:34:10 juju-e4d256-prod-github-runner-207 kernel: [51024.579413] ? watchdog_timer_fn+0x1be/0x220 Aug 22 19:34:10 juju-e4d256-prod-github-runner-207 kernel: [51024.580421] ? lockup_detector_update_enable+0x60/0x60 Aug 22 19:34:10 juju-e4d256-prod-github-runner-207 kernel: [51024.581523] ? __hrtimer_run_queues+0x107/0x230 Aug 22 19:34:10 juju-e4d256-prod-github-runner-207 kernel: [51024.582593] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 19:34:10 juju-e4d256-prod-github-runner-207 kernel: [51024.583686] ? hrtimer_interrupt+0x101/0x220 Aug 22 19:34:10 juju-e4d256-prod-github-runner-207 kernel: [51024.584784] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 19:34:10 juju-e4d256-prod-github-runner-207 kernel: [51024.585925] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 19:34:10 juju-e4d256-prod-github-runner-207 kernel: [51024.587057] Aug 22 19:34:10 juju-e4d256-prod-github-runner-207 kernel: [51024.587963] Aug 22 19:34:10 juju-e4d256-prod-github-runner-207 kernel: [51024.588801] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 19:34:10 juju-e4d256-prod-github-runner-207 kernel: [51024.590059] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:34:10 juju-e4d256-prod-github-runner-207 kernel: [51024.591101] ? _raw_spin_lock+0x22/0x30 Aug 22 19:34:10 juju-e4d256-prod-github-runner-207 kernel: [51024.592061] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:34:10 juju-e4d256-prod-github-runner-207 kernel: [51024.593210] direct_page_fault+0x206/0x310 [kvm] Aug 22 19:34:10 juju-e4d256-prod-github-runner-207 kernel: [51024.594262] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 19:34:10 juju-e4d256-prod-github-runner-207 kernel: [51024.595273] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 19:34:10 juju-e4d256-prod-github-runner-207 kernel: [51024.596275] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 19:34:10 juju-e4d256-prod-github-runner-207 kernel: [51024.597319] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 19:34:10 juju-e4d256-prod-github-runner-207 kernel: [51024.598298] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 19:34:10 juju-e4d256-prod-github-runner-207 kernel: [51024.599277] handle_exit+0x98/0x230 [kvm_amd] Aug 22 19:34:10 juju-e4d256-prod-github-runner-207 kernel: [51024.600192] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 19:34:10 juju-e4d256-prod-github-runner-207 kernel: [51024.601144] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 19:34:10 juju-e4d256-prod-github-runner-207 kernel: [51024.602106] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 19:34:10 juju-e4d256-prod-github-runner-207 kernel: [51024.603052] vcpu_run+0x62/0x2c0 [kvm] Aug 22 19:34:10 juju-e4d256-prod-github-runner-207 kernel: [51024.603868] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 19:34:10 juju-e4d256-prod-github-runner-207 kernel: [51024.604677] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 19:34:10 juju-e4d256-prod-github-runner-207 kernel: [51024.605556] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 19:34:10 juju-e4d256-prod-github-runner-207 kernel: [51024.606354] ? __seccomp_filter+0x4a/0x4a0 Aug 22 19:34:10 juju-e4d256-prod-github-runner-207 kernel: [51024.607097] ? __fget_files+0x86/0xc0 Aug 22 19:34:10 juju-e4d256-prod-github-runner-207 kernel: [51024.607801] __x64_sys_ioctl+0x95/0xd0 Aug 22 19:34:10 juju-e4d256-prod-github-runner-207 kernel: [51024.608493] do_syscall_64+0x5c/0xc0 Aug 22 19:34:10 juju-e4d256-prod-github-runner-207 kernel: [51024.609181] ? do_futex+0x162/0x1f0 Aug 22 19:34:10 juju-e4d256-prod-github-runner-207 kernel: [51024.609840] ? __x64_sys_futex+0x78/0x1e0 Aug 22 19:34:10 juju-e4d256-prod-github-runner-207 kernel: [51024.610515] ? __secure_computing+0xa9/0x120 Aug 22 19:34:10 juju-e4d256-prod-github-runner-207 kernel: [51024.611205] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 19:34:10 juju-e4d256-prod-github-runner-207 kernel: [51024.611986] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:34:10 juju-e4d256-prod-github-runner-207 kernel: [51024.612710] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:34:10 juju-e4d256-prod-github-runner-207 kernel: [51024.613457] ? do_syscall_64+0x69/0xc0 Aug 22 19:34:10 juju-e4d256-prod-github-runner-207 kernel: [51024.614110] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:34:10 juju-e4d256-prod-github-runner-207 kernel: [51024.614815] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:34:10 juju-e4d256-prod-github-runner-207 kernel: [51024.615512] ? do_syscall_64+0x69/0xc0 Aug 22 19:34:10 juju-e4d256-prod-github-runner-207 kernel: [51024.616138] ? do_syscall_64+0x69/0xc0 Aug 22 19:34:10 juju-e4d256-prod-github-runner-207 kernel: [51024.616768] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 19:34:10 juju-e4d256-prod-github-runner-207 kernel: [51024.617492] RIP: 0033:0x7faa5d0edaff Aug 22 19:34:10 juju-e4d256-prod-github-runner-207 kernel: [51024.618117] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 19:34:10 juju-e4d256-prod-github-runner-207 kernel: [51024.620114] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 19:34:10 juju-e4d256-prod-github-runner-207 kernel: [51024.621057] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 19:34:10 juju-e4d256-prod-github-runner-207 kernel: [51024.621979] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 19:34:10 juju-e4d256-prod-github-runner-207 kernel: [51024.622927] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 19:34:10 juju-e4d256-prod-github-runner-207 kernel: [51024.623830] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 19:34:10 juju-e4d256-prod-github-runner-207 kernel: [51024.624729] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 19:34:10 juju-e4d256-prod-github-runner-207 kernel: [51024.625648] Aug 22 19:34:38 juju-e4d256-prod-github-runner-207 kernel: [51052.542147] watchdog: BUG: soft lockup - CPU#1 stuck for 47438s! [qemu-system-x86:6715] Aug 22 19:34:38 juju-e4d256-prod-github-runner-207 kernel: [51052.543301] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 19:34:38 juju-e4d256-prod-github-runner-207 kernel: [51052.543375] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 19:34:38 juju-e4d256-prod-github-runner-207 kernel: [51052.557345] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 19:34:38 juju-e4d256-prod-github-runner-207 kernel: [51052.558639] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 19:34:38 juju-e4d256-prod-github-runner-207 kernel: [51052.559884] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:34:38 juju-e4d256-prod-github-runner-207 kernel: [51052.560980] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 19:34:38 juju-e4d256-prod-github-runner-207 kernel: [51052.563596] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 19:34:38 juju-e4d256-prod-github-runner-207 kernel: [51052.564698] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 19:34:38 juju-e4d256-prod-github-runner-207 kernel: [51052.565909] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 19:34:38 juju-e4d256-prod-github-runner-207 kernel: [51052.567093] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 19:34:38 juju-e4d256-prod-github-runner-207 kernel: [51052.568307] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 19:34:38 juju-e4d256-prod-github-runner-207 kernel: [51052.569514] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 19:34:38 juju-e4d256-prod-github-runner-207 kernel: [51052.570702] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 19:34:38 juju-e4d256-prod-github-runner-207 kernel: [51052.571977] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 19:34:38 juju-e4d256-prod-github-runner-207 kernel: [51052.573112] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 19:34:38 juju-e4d256-prod-github-runner-207 kernel: [51052.574336] Call Trace: Aug 22 19:34:38 juju-e4d256-prod-github-runner-207 kernel: [51052.575263] Aug 22 19:34:38 juju-e4d256-prod-github-runner-207 kernel: [51052.576186] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:34:38 juju-e4d256-prod-github-runner-207 kernel: [51052.577264] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:34:38 juju-e4d256-prod-github-runner-207 kernel: [51052.578305] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:34:38 juju-e4d256-prod-github-runner-207 kernel: [51052.579393] ? show_regs.part.0+0x23/0x29 Aug 22 19:34:38 juju-e4d256-prod-github-runner-207 kernel: [51052.580410] ? show_regs.cold+0x8/0xd Aug 22 19:34:38 juju-e4d256-prod-github-runner-207 kernel: [51052.581418] ? watchdog_timer_fn+0x1be/0x220 Aug 22 19:34:38 juju-e4d256-prod-github-runner-207 kernel: [51052.582444] ? lockup_detector_update_enable+0x60/0x60 Aug 22 19:34:38 juju-e4d256-prod-github-runner-207 kernel: [51052.583520] ? __hrtimer_run_queues+0x107/0x230 Aug 22 19:34:38 juju-e4d256-prod-github-runner-207 kernel: [51052.584584] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 19:34:38 juju-e4d256-prod-github-runner-207 kernel: [51052.585630] ? hrtimer_interrupt+0x101/0x220 Aug 22 19:34:38 juju-e4d256-prod-github-runner-207 kernel: [51052.586656] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 19:34:38 juju-e4d256-prod-github-runner-207 kernel: [51052.587739] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 19:34:38 juju-e4d256-prod-github-runner-207 kernel: [51052.588818] Aug 22 19:34:38 juju-e4d256-prod-github-runner-207 kernel: [51052.589679] Aug 22 19:34:38 juju-e4d256-prod-github-runner-207 kernel: [51052.590523] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 19:34:38 juju-e4d256-prod-github-runner-207 kernel: [51052.591570] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:34:38 juju-e4d256-prod-github-runner-207 kernel: [51052.592657] ? _raw_spin_lock+0x22/0x30 Aug 22 19:34:38 juju-e4d256-prod-github-runner-207 kernel: [51052.593773] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:34:38 juju-e4d256-prod-github-runner-207 kernel: [51052.594994] direct_page_fault+0x206/0x310 [kvm] Aug 22 19:34:38 juju-e4d256-prod-github-runner-207 kernel: [51052.596094] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 19:34:38 juju-e4d256-prod-github-runner-207 kernel: [51052.597147] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 19:34:38 juju-e4d256-prod-github-runner-207 kernel: [51052.598167] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 19:34:38 juju-e4d256-prod-github-runner-207 kernel: [51052.599157] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 19:34:38 juju-e4d256-prod-github-runner-207 kernel: [51052.600122] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 19:34:38 juju-e4d256-prod-github-runner-207 kernel: [51052.601128] handle_exit+0x98/0x230 [kvm_amd] Aug 22 19:34:38 juju-e4d256-prod-github-runner-207 kernel: [51052.602036] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 19:34:38 juju-e4d256-prod-github-runner-207 kernel: [51052.602988] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 19:34:38 juju-e4d256-prod-github-runner-207 kernel: [51052.603954] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 19:34:38 juju-e4d256-prod-github-runner-207 kernel: [51052.604909] vcpu_run+0x62/0x2c0 [kvm] Aug 22 19:34:38 juju-e4d256-prod-github-runner-207 kernel: [51052.605736] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 19:34:38 juju-e4d256-prod-github-runner-207 kernel: [51052.606559] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 19:34:38 juju-e4d256-prod-github-runner-207 kernel: [51052.607430] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 19:34:38 juju-e4d256-prod-github-runner-207 kernel: [51052.608239] ? __seccomp_filter+0x4a/0x4a0 Aug 22 19:34:38 juju-e4d256-prod-github-runner-207 kernel: [51052.609019] ? __fget_files+0x86/0xc0 Aug 22 19:34:38 juju-e4d256-prod-github-runner-207 kernel: [51052.609733] __x64_sys_ioctl+0x95/0xd0 Aug 22 19:34:38 juju-e4d256-prod-github-runner-207 kernel: [51052.610439] do_syscall_64+0x5c/0xc0 Aug 22 19:34:38 juju-e4d256-prod-github-runner-207 kernel: [51052.611117] ? do_futex+0x162/0x1f0 Aug 22 19:34:38 juju-e4d256-prod-github-runner-207 kernel: [51052.611773] ? __x64_sys_futex+0x78/0x1e0 Aug 22 19:34:38 juju-e4d256-prod-github-runner-207 kernel: [51052.612456] ? __secure_computing+0xa9/0x120 Aug 22 19:34:38 juju-e4d256-prod-github-runner-207 kernel: [51052.613183] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 19:34:38 juju-e4d256-prod-github-runner-207 kernel: [51052.613965] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:34:38 juju-e4d256-prod-github-runner-207 kernel: [51052.614697] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:34:38 juju-e4d256-prod-github-runner-207 kernel: [51052.615427] ? do_syscall_64+0x69/0xc0 Aug 22 19:34:38 juju-e4d256-prod-github-runner-207 kernel: [51052.616087] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:34:38 juju-e4d256-prod-github-runner-207 kernel: [51052.616814] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:34:38 juju-e4d256-prod-github-runner-207 kernel: [51052.617522] ? do_syscall_64+0x69/0xc0 Aug 22 19:34:38 juju-e4d256-prod-github-runner-207 kernel: [51052.618161] ? do_syscall_64+0x69/0xc0 Aug 22 19:34:38 juju-e4d256-prod-github-runner-207 kernel: [51052.618792] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 19:34:38 juju-e4d256-prod-github-runner-207 kernel: [51052.619527] RIP: 0033:0x7faa5d0edaff Aug 22 19:34:38 juju-e4d256-prod-github-runner-207 kernel: [51052.620176] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 19:34:38 juju-e4d256-prod-github-runner-207 kernel: [51052.622246] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 19:34:38 juju-e4d256-prod-github-runner-207 kernel: [51052.623259] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 19:34:38 juju-e4d256-prod-github-runner-207 kernel: [51052.624321] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 19:34:38 juju-e4d256-prod-github-runner-207 kernel: [51052.625429] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 19:34:38 juju-e4d256-prod-github-runner-207 kernel: [51052.626368] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 19:34:38 juju-e4d256-prod-github-runner-207 kernel: [51052.627295] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 19:34:38 juju-e4d256-prod-github-runner-207 kernel: [51052.628242] Aug 22 19:35:06 juju-e4d256-prod-github-runner-207 kernel: [51080.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 47464s! [qemu-system-x86:6715] Aug 22 19:35:06 juju-e4d256-prod-github-runner-207 kernel: [51080.543883] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 19:35:06 juju-e4d256-prod-github-runner-207 kernel: [51080.544204] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 19:35:06 juju-e4d256-prod-github-runner-207 kernel: [51080.556642] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 19:35:06 juju-e4d256-prod-github-runner-207 kernel: [51080.557930] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 19:35:06 juju-e4d256-prod-github-runner-207 kernel: [51080.559185] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:35:06 juju-e4d256-prod-github-runner-207 kernel: [51080.560281] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 19:35:06 juju-e4d256-prod-github-runner-207 kernel: [51080.562887] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 19:35:06 juju-e4d256-prod-github-runner-207 kernel: [51080.563943] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 19:35:06 juju-e4d256-prod-github-runner-207 kernel: [51080.565208] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 19:35:06 juju-e4d256-prod-github-runner-207 kernel: [51080.566390] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 19:35:06 juju-e4d256-prod-github-runner-207 kernel: [51080.567598] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 19:35:06 juju-e4d256-prod-github-runner-207 kernel: [51080.568784] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 19:35:06 juju-e4d256-prod-github-runner-207 kernel: [51080.569969] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 19:35:06 juju-e4d256-prod-github-runner-207 kernel: [51080.571216] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 19:35:06 juju-e4d256-prod-github-runner-207 kernel: [51080.572355] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 19:35:06 juju-e4d256-prod-github-runner-207 kernel: [51080.573573] Call Trace: Aug 22 19:35:06 juju-e4d256-prod-github-runner-207 kernel: [51080.574490] Aug 22 19:35:06 juju-e4d256-prod-github-runner-207 kernel: [51080.575397] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:35:06 juju-e4d256-prod-github-runner-207 kernel: [51080.576490] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:35:06 juju-e4d256-prod-github-runner-207 kernel: [51080.577546] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:35:06 juju-e4d256-prod-github-runner-207 kernel: [51080.578683] ? show_regs.part.0+0x23/0x29 Aug 22 19:35:06 juju-e4d256-prod-github-runner-207 kernel: [51080.579686] ? show_regs.cold+0x8/0xd Aug 22 19:35:06 juju-e4d256-prod-github-runner-207 kernel: [51080.580690] ? watchdog_timer_fn+0x1be/0x220 Aug 22 19:35:06 juju-e4d256-prod-github-runner-207 kernel: [51080.581710] ? lockup_detector_update_enable+0x60/0x60 Aug 22 19:35:06 juju-e4d256-prod-github-runner-207 kernel: [51080.582789] ? __hrtimer_run_queues+0x107/0x230 Aug 22 19:35:06 juju-e4d256-prod-github-runner-207 kernel: [51080.583822] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 19:35:06 juju-e4d256-prod-github-runner-207 kernel: [51080.584869] ? hrtimer_interrupt+0x101/0x220 Aug 22 19:35:06 juju-e4d256-prod-github-runner-207 kernel: [51080.585899] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 19:35:06 juju-e4d256-prod-github-runner-207 kernel: [51080.586975] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 19:35:06 juju-e4d256-prod-github-runner-207 kernel: [51080.588067] Aug 22 19:35:06 juju-e4d256-prod-github-runner-207 kernel: [51080.588950] Aug 22 19:35:06 juju-e4d256-prod-github-runner-207 kernel: [51080.589797] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 19:35:06 juju-e4d256-prod-github-runner-207 kernel: [51080.590845] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:35:06 juju-e4d256-prod-github-runner-207 kernel: [51080.591914] ? _raw_spin_lock+0x22/0x30 Aug 22 19:35:06 juju-e4d256-prod-github-runner-207 kernel: [51080.592940] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:35:06 juju-e4d256-prod-github-runner-207 kernel: [51080.594034] direct_page_fault+0x206/0x310 [kvm] Aug 22 19:35:06 juju-e4d256-prod-github-runner-207 kernel: [51080.595121] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 19:35:06 juju-e4d256-prod-github-runner-207 kernel: [51080.596157] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 19:35:06 juju-e4d256-prod-github-runner-207 kernel: [51080.597186] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 19:35:06 juju-e4d256-prod-github-runner-207 kernel: [51080.598240] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 19:35:06 juju-e4d256-prod-github-runner-207 kernel: [51080.599196] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 19:35:06 juju-e4d256-prod-github-runner-207 kernel: [51080.600199] handle_exit+0x98/0x230 [kvm_amd] Aug 22 19:35:06 juju-e4d256-prod-github-runner-207 kernel: [51080.601146] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 19:35:06 juju-e4d256-prod-github-runner-207 kernel: [51080.602107] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 19:35:06 juju-e4d256-prod-github-runner-207 kernel: [51080.603486] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 19:35:06 juju-e4d256-prod-github-runner-207 kernel: [51080.605118] vcpu_run+0x62/0x2c0 [kvm] Aug 22 19:35:06 juju-e4d256-prod-github-runner-207 kernel: [51080.605966] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 19:35:06 juju-e4d256-prod-github-runner-207 kernel: [51080.606791] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 19:35:06 juju-e4d256-prod-github-runner-207 kernel: [51080.607664] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 19:35:06 juju-e4d256-prod-github-runner-207 kernel: [51080.608550] ? __seccomp_filter+0x4a/0x4a0 Aug 22 19:35:06 juju-e4d256-prod-github-runner-207 kernel: [51080.609305] ? __fget_files+0x86/0xc0 Aug 22 19:35:06 juju-e4d256-prod-github-runner-207 kernel: [51080.610191] __x64_sys_ioctl+0x95/0xd0 Aug 22 19:35:06 juju-e4d256-prod-github-runner-207 kernel: [51080.610987] do_syscall_64+0x5c/0xc0 Aug 22 19:35:06 juju-e4d256-prod-github-runner-207 kernel: [51080.611659] ? do_futex+0x162/0x1f0 Aug 22 19:35:06 juju-e4d256-prod-github-runner-207 kernel: [51080.612332] ? __x64_sys_futex+0x78/0x1e0 Aug 22 19:35:06 juju-e4d256-prod-github-runner-207 kernel: [51080.613048] ? __secure_computing+0xa9/0x120 Aug 22 19:35:06 juju-e4d256-prod-github-runner-207 kernel: [51080.613750] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 19:35:06 juju-e4d256-prod-github-runner-207 kernel: [51080.614530] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:35:06 juju-e4d256-prod-github-runner-207 kernel: [51080.615285] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:35:06 juju-e4d256-prod-github-runner-207 kernel: [51080.616022] ? do_syscall_64+0x69/0xc0 Aug 22 19:35:06 juju-e4d256-prod-github-runner-207 kernel: [51080.616716] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:35:06 juju-e4d256-prod-github-runner-207 kernel: [51080.617457] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:35:06 juju-e4d256-prod-github-runner-207 kernel: [51080.618194] ? do_syscall_64+0x69/0xc0 Aug 22 19:35:06 juju-e4d256-prod-github-runner-207 kernel: [51080.618833] ? do_syscall_64+0x69/0xc0 Aug 22 19:35:06 juju-e4d256-prod-github-runner-207 kernel: [51080.619466] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 19:35:06 juju-e4d256-prod-github-runner-207 kernel: [51080.620185] RIP: 0033:0x7faa5d0edaff Aug 22 19:35:06 juju-e4d256-prod-github-runner-207 kernel: [51080.620881] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 19:35:06 juju-e4d256-prod-github-runner-207 kernel: [51080.623040] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 19:35:06 juju-e4d256-prod-github-runner-207 kernel: [51080.623966] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 19:35:06 juju-e4d256-prod-github-runner-207 kernel: [51080.624895] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 19:35:06 juju-e4d256-prod-github-runner-207 kernel: [51080.625800] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 19:35:06 juju-e4d256-prod-github-runner-207 kernel: [51080.626709] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 19:35:06 juju-e4d256-prod-github-runner-207 kernel: [51080.627632] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 19:35:06 juju-e4d256-prod-github-runner-207 kernel: [51080.628564] Aug 22 19:35:34 juju-e4d256-prod-github-runner-207 kernel: [51108.541980] watchdog: BUG: soft lockup - CPU#1 stuck for 47490s! [qemu-system-x86:6715] Aug 22 19:35:34 juju-e4d256-prod-github-runner-207 kernel: [51108.543244] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 19:35:34 juju-e4d256-prod-github-runner-207 kernel: [51108.543334] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 19:35:34 juju-e4d256-prod-github-runner-207 kernel: [51108.557920] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 19:35:34 juju-e4d256-prod-github-runner-207 kernel: [51108.559731] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 19:35:34 juju-e4d256-prod-github-runner-207 kernel: [51108.561395] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:35:34 juju-e4d256-prod-github-runner-207 kernel: [51108.562520] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 19:35:34 juju-e4d256-prod-github-runner-207 kernel: [51108.565263] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 19:35:34 juju-e4d256-prod-github-runner-207 kernel: [51108.566468] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 19:35:34 juju-e4d256-prod-github-runner-207 kernel: [51108.567720] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 19:35:34 juju-e4d256-prod-github-runner-207 kernel: [51108.569096] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 19:35:34 juju-e4d256-prod-github-runner-207 kernel: [51108.570341] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 19:35:34 juju-e4d256-prod-github-runner-207 kernel: [51108.571617] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 19:35:34 juju-e4d256-prod-github-runner-207 kernel: [51108.573214] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 19:35:34 juju-e4d256-prod-github-runner-207 kernel: [51108.574621] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 19:35:34 juju-e4d256-prod-github-runner-207 kernel: [51108.575990] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 19:35:34 juju-e4d256-prod-github-runner-207 kernel: [51108.577322] Call Trace: Aug 22 19:35:34 juju-e4d256-prod-github-runner-207 kernel: [51108.578391] Aug 22 19:35:34 juju-e4d256-prod-github-runner-207 kernel: [51108.579483] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:35:34 juju-e4d256-prod-github-runner-207 kernel: [51108.580590] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:35:34 juju-e4d256-prod-github-runner-207 kernel: [51108.581716] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:35:34 juju-e4d256-prod-github-runner-207 kernel: [51108.582867] ? show_regs.part.0+0x23/0x29 Aug 22 19:35:34 juju-e4d256-prod-github-runner-207 kernel: [51108.583892] ? show_regs.cold+0x8/0xd Aug 22 19:35:34 juju-e4d256-prod-github-runner-207 kernel: [51108.584891] ? watchdog_timer_fn+0x1be/0x220 Aug 22 19:35:34 juju-e4d256-prod-github-runner-207 kernel: [51108.585952] ? lockup_detector_update_enable+0x60/0x60 Aug 22 19:35:34 juju-e4d256-prod-github-runner-207 kernel: [51108.587057] ? __hrtimer_run_queues+0x107/0x230 Aug 22 19:35:34 juju-e4d256-prod-github-runner-207 kernel: [51108.588139] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 19:35:34 juju-e4d256-prod-github-runner-207 kernel: [51108.589177] ? hrtimer_interrupt+0x101/0x220 Aug 22 19:35:34 juju-e4d256-prod-github-runner-207 kernel: [51108.590226] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 19:35:34 juju-e4d256-prod-github-runner-207 kernel: [51108.591338] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 19:35:34 juju-e4d256-prod-github-runner-207 kernel: [51108.592461] Aug 22 19:35:34 juju-e4d256-prod-github-runner-207 kernel: [51108.593328] Aug 22 19:35:34 juju-e4d256-prod-github-runner-207 kernel: [51108.594174] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 19:35:34 juju-e4d256-prod-github-runner-207 kernel: [51108.595222] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:35:34 juju-e4d256-prod-github-runner-207 kernel: [51108.596362] ? _raw_spin_lock+0x22/0x30 Aug 22 19:35:34 juju-e4d256-prod-github-runner-207 kernel: [51108.597330] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:35:34 juju-e4d256-prod-github-runner-207 kernel: [51108.598364] direct_page_fault+0x206/0x310 [kvm] Aug 22 19:35:34 juju-e4d256-prod-github-runner-207 kernel: [51108.599418] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 19:35:34 juju-e4d256-prod-github-runner-207 kernel: [51108.600458] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 19:35:34 juju-e4d256-prod-github-runner-207 kernel: [51108.601492] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 19:35:34 juju-e4d256-prod-github-runner-207 kernel: [51108.602494] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 19:35:34 juju-e4d256-prod-github-runner-207 kernel: [51108.603460] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 19:35:34 juju-e4d256-prod-github-runner-207 kernel: [51108.604518] handle_exit+0x98/0x230 [kvm_amd] Aug 22 19:35:34 juju-e4d256-prod-github-runner-207 kernel: [51108.605446] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 19:35:34 juju-e4d256-prod-github-runner-207 kernel: [51108.606379] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 19:35:34 juju-e4d256-prod-github-runner-207 kernel: [51108.607430] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 19:35:34 juju-e4d256-prod-github-runner-207 kernel: [51108.608402] vcpu_run+0x62/0x2c0 [kvm] Aug 22 19:35:34 juju-e4d256-prod-github-runner-207 kernel: [51108.609229] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 19:35:34 juju-e4d256-prod-github-runner-207 kernel: [51108.610063] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 19:35:34 juju-e4d256-prod-github-runner-207 kernel: [51108.610943] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 19:35:34 juju-e4d256-prod-github-runner-207 kernel: [51108.611764] ? __seccomp_filter+0x4a/0x4a0 Aug 22 19:35:34 juju-e4d256-prod-github-runner-207 kernel: [51108.612609] ? __fget_files+0x86/0xc0 Aug 22 19:35:34 juju-e4d256-prod-github-runner-207 kernel: [51108.613330] __x64_sys_ioctl+0x95/0xd0 Aug 22 19:35:34 juju-e4d256-prod-github-runner-207 kernel: [51108.614043] do_syscall_64+0x5c/0xc0 Aug 22 19:35:34 juju-e4d256-prod-github-runner-207 kernel: [51108.614728] ? do_futex+0x162/0x1f0 Aug 22 19:35:34 juju-e4d256-prod-github-runner-207 kernel: [51108.615400] ? __x64_sys_futex+0x78/0x1e0 Aug 22 19:35:34 juju-e4d256-prod-github-runner-207 kernel: [51108.616123] ? __secure_computing+0xa9/0x120 Aug 22 19:35:34 juju-e4d256-prod-github-runner-207 kernel: [51108.616832] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 19:35:34 juju-e4d256-prod-github-runner-207 kernel: [51108.617612] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:35:34 juju-e4d256-prod-github-runner-207 kernel: [51108.618347] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:35:34 juju-e4d256-prod-github-runner-207 kernel: [51108.619080] ? do_syscall_64+0x69/0xc0 Aug 22 19:35:34 juju-e4d256-prod-github-runner-207 kernel: [51108.619737] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:35:34 juju-e4d256-prod-github-runner-207 kernel: [51108.620474] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:35:34 juju-e4d256-prod-github-runner-207 kernel: [51108.621184] ? do_syscall_64+0x69/0xc0 Aug 22 19:35:34 juju-e4d256-prod-github-runner-207 kernel: [51108.621821] ? do_syscall_64+0x69/0xc0 Aug 22 19:35:34 juju-e4d256-prod-github-runner-207 kernel: [51108.622456] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 19:35:34 juju-e4d256-prod-github-runner-207 kernel: [51108.623171] RIP: 0033:0x7faa5d0edaff Aug 22 19:35:34 juju-e4d256-prod-github-runner-207 kernel: [51108.623839] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 19:35:34 juju-e4d256-prod-github-runner-207 kernel: [51108.625911] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 19:35:34 juju-e4d256-prod-github-runner-207 kernel: [51108.626849] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 19:35:34 juju-e4d256-prod-github-runner-207 kernel: [51108.627762] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 19:35:34 juju-e4d256-prod-github-runner-207 kernel: [51108.628684] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 19:35:34 juju-e4d256-prod-github-runner-207 kernel: [51108.629604] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 19:35:34 juju-e4d256-prod-github-runner-207 kernel: [51108.630508] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 19:35:34 juju-e4d256-prod-github-runner-207 kernel: [51108.631417] Aug 22 19:35:46 juju-e4d256-prod-github-runner-207 kernel: [51120.596708] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 19:35:46 juju-e4d256-prod-github-runner-207 kernel: [51120.597858] rcu: 1-....: (12710706 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=6145705 Aug 22 19:35:46 juju-e4d256-prod-github-runner-207 kernel: [51120.598981] (t=12750849 jiffies g=23269 q=48348) Aug 22 19:35:46 juju-e4d256-prod-github-runner-207 kernel: [51120.599789] NMI backtrace for cpu 1 Aug 22 19:35:46 juju-e4d256-prod-github-runner-207 kernel: [51120.600498] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 19:35:46 juju-e4d256-prod-github-runner-207 kernel: [51120.601606] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 19:35:46 juju-e4d256-prod-github-runner-207 kernel: [51120.602662] Call Trace: Aug 22 19:35:46 juju-e4d256-prod-github-runner-207 kernel: [51120.603337] Aug 22 19:35:46 juju-e4d256-prod-github-runner-207 kernel: [51120.604055] show_stack+0x52/0x5c Aug 22 19:35:46 juju-e4d256-prod-github-runner-207 kernel: [51120.604791] dump_stack_lvl+0x4a/0x63 Aug 22 19:35:46 juju-e4d256-prod-github-runner-207 kernel: [51120.605538] dump_stack+0x10/0x16 Aug 22 19:35:46 juju-e4d256-prod-github-runner-207 kernel: [51120.606252] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 19:35:46 juju-e4d256-prod-github-runner-207 kernel: [51120.607071] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 19:35:46 juju-e4d256-prod-github-runner-207 kernel: [51120.607954] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 19:35:46 juju-e4d256-prod-github-runner-207 kernel: [51120.608790] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 19:35:46 juju-e4d256-prod-github-runner-207 kernel: [51120.609613] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 19:35:46 juju-e4d256-prod-github-runner-207 kernel: [51120.610425] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 19:35:46 juju-e4d256-prod-github-runner-207 kernel: [51120.611195] print_cpu_stall.cold+0x2f/0xe2 Aug 22 19:35:46 juju-e4d256-prod-github-runner-207 kernel: [51120.612034] ? timekeeping_update+0xf7/0x150 Aug 22 19:35:46 juju-e4d256-prod-github-runner-207 kernel: [51120.612976] check_cpu_stall+0x109/0x270 Aug 22 19:35:46 juju-e4d256-prod-github-runner-207 kernel: [51120.613725] rcu_sched_clock_irq+0x9a/0x250 Aug 22 19:35:46 juju-e4d256-prod-github-runner-207 kernel: [51120.614498] update_process_times+0x94/0xd0 Aug 22 19:35:46 juju-e4d256-prod-github-runner-207 kernel: [51120.615262] tick_sched_handle+0x29/0x70 Aug 22 19:35:46 juju-e4d256-prod-github-runner-207 kernel: [51120.616023] tick_sched_timer+0x8c/0xc0 Aug 22 19:35:46 juju-e4d256-prod-github-runner-207 kernel: [51120.616758] ? tick_nohz_handler+0xb0/0xb0 Aug 22 19:35:46 juju-e4d256-prod-github-runner-207 kernel: [51120.617514] __hrtimer_run_queues+0x107/0x230 Aug 22 19:35:46 juju-e4d256-prod-github-runner-207 kernel: [51120.618287] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 19:35:46 juju-e4d256-prod-github-runner-207 kernel: [51120.619063] hrtimer_interrupt+0x101/0x220 Aug 22 19:35:46 juju-e4d256-prod-github-runner-207 kernel: [51120.619833] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 19:35:46 juju-e4d256-prod-github-runner-207 kernel: [51120.620647] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 19:35:46 juju-e4d256-prod-github-runner-207 kernel: [51120.621452] Aug 22 19:35:46 juju-e4d256-prod-github-runner-207 kernel: [51120.622086] Aug 22 19:35:46 juju-e4d256-prod-github-runner-207 kernel: [51120.622717] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 19:35:46 juju-e4d256-prod-github-runner-207 kernel: [51120.623540] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:35:46 juju-e4d256-prod-github-runner-207 kernel: [51120.624439] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 19:35:46 juju-e4d256-prod-github-runner-207 kernel: [51120.626739] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 19:35:46 juju-e4d256-prod-github-runner-207 kernel: [51120.627890] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 19:35:46 juju-e4d256-prod-github-runner-207 kernel: [51120.628977] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 19:35:46 juju-e4d256-prod-github-runner-207 kernel: [51120.630117] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 19:35:46 juju-e4d256-prod-github-runner-207 kernel: [51120.631088] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 19:35:46 juju-e4d256-prod-github-runner-207 kernel: [51120.632088] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 19:35:46 juju-e4d256-prod-github-runner-207 kernel: [51120.633099] ? _raw_spin_lock+0x22/0x30 Aug 22 19:35:46 juju-e4d256-prod-github-runner-207 kernel: [51120.633885] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:35:46 juju-e4d256-prod-github-runner-207 kernel: [51120.634725] direct_page_fault+0x206/0x310 [kvm] Aug 22 19:35:46 juju-e4d256-prod-github-runner-207 kernel: [51120.635569] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 19:35:46 juju-e4d256-prod-github-runner-207 kernel: [51120.636474] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 19:35:46 juju-e4d256-prod-github-runner-207 kernel: [51120.637312] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 19:35:46 juju-e4d256-prod-github-runner-207 kernel: [51120.638173] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 19:35:46 juju-e4d256-prod-github-runner-207 kernel: [51120.639028] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 19:35:46 juju-e4d256-prod-github-runner-207 kernel: [51120.640059] handle_exit+0x98/0x230 [kvm_amd] Aug 22 19:35:46 juju-e4d256-prod-github-runner-207 kernel: [51120.640832] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 19:35:46 juju-e4d256-prod-github-runner-207 kernel: [51120.641626] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 19:35:46 juju-e4d256-prod-github-runner-207 kernel: [51120.642437] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 19:35:46 juju-e4d256-prod-github-runner-207 kernel: [51120.643225] vcpu_run+0x62/0x2c0 [kvm] Aug 22 19:35:46 juju-e4d256-prod-github-runner-207 kernel: [51120.644134] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 19:35:46 juju-e4d256-prod-github-runner-207 kernel: [51120.644872] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 19:35:46 juju-e4d256-prod-github-runner-207 kernel: [51120.645676] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 19:35:46 juju-e4d256-prod-github-runner-207 kernel: [51120.646447] ? __seccomp_filter+0x4a/0x4a0 Aug 22 19:35:46 juju-e4d256-prod-github-runner-207 kernel: [51120.647180] ? __fget_files+0x86/0xc0 Aug 22 19:35:46 juju-e4d256-prod-github-runner-207 kernel: [51120.647892] __x64_sys_ioctl+0x95/0xd0 Aug 22 19:35:46 juju-e4d256-prod-github-runner-207 kernel: [51120.648589] do_syscall_64+0x5c/0xc0 Aug 22 19:35:46 juju-e4d256-prod-github-runner-207 kernel: [51120.649277] ? do_futex+0x162/0x1f0 Aug 22 19:35:46 juju-e4d256-prod-github-runner-207 kernel: [51120.649957] ? __x64_sys_futex+0x78/0x1e0 Aug 22 19:35:46 juju-e4d256-prod-github-runner-207 kernel: [51120.650891] ? __secure_computing+0xa9/0x120 Aug 22 19:35:46 juju-e4d256-prod-github-runner-207 kernel: [51120.651614] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 19:35:46 juju-e4d256-prod-github-runner-207 kernel: [51120.652425] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:35:46 juju-e4d256-prod-github-runner-207 kernel: [51120.653190] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:35:46 juju-e4d256-prod-github-runner-207 kernel: [51120.653948] ? do_syscall_64+0x69/0xc0 Aug 22 19:35:46 juju-e4d256-prod-github-runner-207 kernel: [51120.654641] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:35:46 juju-e4d256-prod-github-runner-207 kernel: [51120.655400] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:35:46 juju-e4d256-prod-github-runner-207 kernel: [51120.656187] ? do_syscall_64+0x69/0xc0 Aug 22 19:35:46 juju-e4d256-prod-github-runner-207 kernel: [51120.656912] ? do_syscall_64+0x69/0xc0 Aug 22 19:35:46 juju-e4d256-prod-github-runner-207 kernel: [51120.657612] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 19:35:46 juju-e4d256-prod-github-runner-207 kernel: [51120.658476] RIP: 0033:0x7faa5d0edaff Aug 22 19:35:46 juju-e4d256-prod-github-runner-207 kernel: [51120.659202] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 19:35:46 juju-e4d256-prod-github-runner-207 kernel: [51120.661355] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 19:35:46 juju-e4d256-prod-github-runner-207 kernel: [51120.662330] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 19:35:46 juju-e4d256-prod-github-runner-207 kernel: [51120.663287] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 19:35:46 juju-e4d256-prod-github-runner-207 kernel: [51120.664247] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 19:35:46 juju-e4d256-prod-github-runner-207 kernel: [51120.665214] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 19:35:46 juju-e4d256-prod-github-runner-207 kernel: [51120.666168] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 19:35:46 juju-e4d256-prod-github-runner-207 kernel: [51120.667095] Aug 22 19:36:14 juju-e4d256-prod-github-runner-207 kernel: [51148.541981] watchdog: BUG: soft lockup - CPU#1 stuck for 47527s! [qemu-system-x86:6715] Aug 22 19:36:14 juju-e4d256-prod-github-runner-207 kernel: [51148.543553] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 19:36:14 juju-e4d256-prod-github-runner-207 kernel: [51148.543639] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 19:36:14 juju-e4d256-prod-github-runner-207 kernel: [51148.559803] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 19:36:14 juju-e4d256-prod-github-runner-207 kernel: [51148.561277] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 19:36:14 juju-e4d256-prod-github-runner-207 kernel: [51148.563072] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:36:14 juju-e4d256-prod-github-runner-207 kernel: [51148.564440] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 19:36:14 juju-e4d256-prod-github-runner-207 kernel: [51148.568191] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 19:36:14 juju-e4d256-prod-github-runner-207 kernel: [51148.569791] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 19:36:14 juju-e4d256-prod-github-runner-207 kernel: [51148.571488] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 19:36:14 juju-e4d256-prod-github-runner-207 kernel: [51148.573185] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 19:36:14 juju-e4d256-prod-github-runner-207 kernel: [51148.574877] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 19:36:14 juju-e4d256-prod-github-runner-207 kernel: [51148.576503] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 19:36:14 juju-e4d256-prod-github-runner-207 kernel: [51148.578277] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 19:36:14 juju-e4d256-prod-github-runner-207 kernel: [51148.580123] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 19:36:14 juju-e4d256-prod-github-runner-207 kernel: [51148.581891] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 19:36:14 juju-e4d256-prod-github-runner-207 kernel: [51148.583786] Call Trace: Aug 22 19:36:14 juju-e4d256-prod-github-runner-207 kernel: [51148.585155] Aug 22 19:36:14 juju-e4d256-prod-github-runner-207 kernel: [51148.586380] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:36:14 juju-e4d256-prod-github-runner-207 kernel: [51148.587945] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:36:14 juju-e4d256-prod-github-runner-207 kernel: [51148.589352] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:36:14 juju-e4d256-prod-github-runner-207 kernel: [51148.590850] ? show_regs.part.0+0x23/0x29 Aug 22 19:36:14 juju-e4d256-prod-github-runner-207 kernel: [51148.592294] ? show_regs.cold+0x8/0xd Aug 22 19:36:14 juju-e4d256-prod-github-runner-207 kernel: [51148.593685] ? watchdog_timer_fn+0x1be/0x220 Aug 22 19:36:14 juju-e4d256-prod-github-runner-207 kernel: [51148.594851] ? lockup_detector_update_enable+0x60/0x60 Aug 22 19:36:14 juju-e4d256-prod-github-runner-207 kernel: [51148.596431] ? __hrtimer_run_queues+0x107/0x230 Aug 22 19:36:14 juju-e4d256-prod-github-runner-207 kernel: [51148.597557] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 19:36:14 juju-e4d256-prod-github-runner-207 kernel: [51148.598940] ? hrtimer_interrupt+0x101/0x220 Aug 22 19:36:14 juju-e4d256-prod-github-runner-207 kernel: [51148.600438] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 19:36:14 juju-e4d256-prod-github-runner-207 kernel: [51148.601901] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 19:36:14 juju-e4d256-prod-github-runner-207 kernel: [51148.603273] Aug 22 19:36:14 juju-e4d256-prod-github-runner-207 kernel: [51148.604648] Aug 22 19:36:14 juju-e4d256-prod-github-runner-207 kernel: [51148.605920] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 19:36:14 juju-e4d256-prod-github-runner-207 kernel: [51148.607089] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:36:14 juju-e4d256-prod-github-runner-207 kernel: [51148.608606] ? _raw_spin_lock+0x22/0x30 Aug 22 19:36:14 juju-e4d256-prod-github-runner-207 kernel: [51148.609856] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:36:14 juju-e4d256-prod-github-runner-207 kernel: [51148.611366] direct_page_fault+0x206/0x310 [kvm] Aug 22 19:36:14 juju-e4d256-prod-github-runner-207 kernel: [51148.612627] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 19:36:14 juju-e4d256-prod-github-runner-207 kernel: [51148.614148] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 19:36:14 juju-e4d256-prod-github-runner-207 kernel: [51148.615399] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 19:36:14 juju-e4d256-prod-github-runner-207 kernel: [51148.616608] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 19:36:14 juju-e4d256-prod-github-runner-207 kernel: [51148.618039] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 19:36:14 juju-e4d256-prod-github-runner-207 kernel: [51148.619199] handle_exit+0x98/0x230 [kvm_amd] Aug 22 19:36:14 juju-e4d256-prod-github-runner-207 kernel: [51148.620351] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 19:36:14 juju-e4d256-prod-github-runner-207 kernel: [51148.621809] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 19:36:14 juju-e4d256-prod-github-runner-207 kernel: [51148.623014] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 19:36:14 juju-e4d256-prod-github-runner-207 kernel: [51148.624437] vcpu_run+0x62/0x2c0 [kvm] Aug 22 19:36:14 juju-e4d256-prod-github-runner-207 kernel: [51148.625511] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 19:36:14 juju-e4d256-prod-github-runner-207 kernel: [51148.626500] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 19:36:14 juju-e4d256-prod-github-runner-207 kernel: [51148.627703] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 19:36:14 juju-e4d256-prod-github-runner-207 kernel: [51148.628866] ? __seccomp_filter+0x4a/0x4a0 Aug 22 19:36:14 juju-e4d256-prod-github-runner-207 kernel: [51148.629706] ? __fget_files+0x86/0xc0 Aug 22 19:36:14 juju-e4d256-prod-github-runner-207 kernel: [51148.630590] __x64_sys_ioctl+0x95/0xd0 Aug 22 19:36:14 juju-e4d256-prod-github-runner-207 kernel: [51148.631539] do_syscall_64+0x5c/0xc0 Aug 22 19:36:14 juju-e4d256-prod-github-runner-207 kernel: [51148.632540] ? do_futex+0x162/0x1f0 Aug 22 19:36:14 juju-e4d256-prod-github-runner-207 kernel: [51148.633313] ? __x64_sys_futex+0x78/0x1e0 Aug 22 19:36:14 juju-e4d256-prod-github-runner-207 kernel: [51148.634109] ? __secure_computing+0xa9/0x120 Aug 22 19:36:14 juju-e4d256-prod-github-runner-207 kernel: [51148.634882] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 19:36:14 juju-e4d256-prod-github-runner-207 kernel: [51148.635909] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:36:14 juju-e4d256-prod-github-runner-207 kernel: [51148.637025] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:36:14 juju-e4d256-prod-github-runner-207 kernel: [51148.637860] ? do_syscall_64+0x69/0xc0 Aug 22 19:36:14 juju-e4d256-prod-github-runner-207 kernel: [51148.638609] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:36:14 juju-e4d256-prod-github-runner-207 kernel: [51148.639527] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:36:14 juju-e4d256-prod-github-runner-207 kernel: [51148.640446] ? do_syscall_64+0x69/0xc0 Aug 22 19:36:14 juju-e4d256-prod-github-runner-207 kernel: [51148.641427] ? do_syscall_64+0x69/0xc0 Aug 22 19:36:14 juju-e4d256-prod-github-runner-207 kernel: [51148.642251] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 19:36:14 juju-e4d256-prod-github-runner-207 kernel: [51148.643164] RIP: 0033:0x7faa5d0edaff Aug 22 19:36:14 juju-e4d256-prod-github-runner-207 kernel: [51148.644096] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 19:36:14 juju-e4d256-prod-github-runner-207 kernel: [51148.646765] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 19:36:14 juju-e4d256-prod-github-runner-207 kernel: [51148.648025] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 19:36:14 juju-e4d256-prod-github-runner-207 kernel: [51148.649347] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 19:36:14 juju-e4d256-prod-github-runner-207 kernel: [51148.650390] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 19:36:14 juju-e4d256-prod-github-runner-207 kernel: [51148.651577] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 19:36:14 juju-e4d256-prod-github-runner-207 kernel: [51148.652954] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 19:36:14 juju-e4d256-prod-github-runner-207 kernel: [51148.654107] Aug 22 19:36:42 juju-e4d256-prod-github-runner-207 kernel: [51176.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 47553s! [qemu-system-x86:6715] Aug 22 19:36:42 juju-e4d256-prod-github-runner-207 kernel: [51176.543844] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 19:36:42 juju-e4d256-prod-github-runner-207 kernel: [51176.544143] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 19:36:42 juju-e4d256-prod-github-runner-207 kernel: [51176.556499] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 19:36:42 juju-e4d256-prod-github-runner-207 kernel: [51176.557768] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 19:36:42 juju-e4d256-prod-github-runner-207 kernel: [51176.559023] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:36:42 juju-e4d256-prod-github-runner-207 kernel: [51176.560088] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 19:36:42 juju-e4d256-prod-github-runner-207 kernel: [51176.562627] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 19:36:42 juju-e4d256-prod-github-runner-207 kernel: [51176.563690] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 19:36:42 juju-e4d256-prod-github-runner-207 kernel: [51176.564854] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 19:36:42 juju-e4d256-prod-github-runner-207 kernel: [51176.566016] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 19:36:42 juju-e4d256-prod-github-runner-207 kernel: [51176.567192] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 19:36:42 juju-e4d256-prod-github-runner-207 kernel: [51176.568357] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 19:36:42 juju-e4d256-prod-github-runner-207 kernel: [51176.569524] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 19:36:42 juju-e4d256-prod-github-runner-207 kernel: [51176.570819] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 19:36:42 juju-e4d256-prod-github-runner-207 kernel: [51176.571922] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 19:36:42 juju-e4d256-prod-github-runner-207 kernel: [51176.573118] Call Trace: Aug 22 19:36:42 juju-e4d256-prod-github-runner-207 kernel: [51176.574046] Aug 22 19:36:42 juju-e4d256-prod-github-runner-207 kernel: [51176.574944] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:36:42 juju-e4d256-prod-github-runner-207 kernel: [51176.575980] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:36:42 juju-e4d256-prod-github-runner-207 kernel: [51176.577004] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:36:42 juju-e4d256-prod-github-runner-207 kernel: [51176.578093] ? show_regs.part.0+0x23/0x29 Aug 22 19:36:42 juju-e4d256-prod-github-runner-207 kernel: [51176.579102] ? show_regs.cold+0x8/0xd Aug 22 19:36:42 juju-e4d256-prod-github-runner-207 kernel: [51176.580080] ? watchdog_timer_fn+0x1be/0x220 Aug 22 19:36:42 juju-e4d256-prod-github-runner-207 kernel: [51176.581087] ? lockup_detector_update_enable+0x60/0x60 Aug 22 19:36:42 juju-e4d256-prod-github-runner-207 kernel: [51176.582148] ? __hrtimer_run_queues+0x107/0x230 Aug 22 19:36:42 juju-e4d256-prod-github-runner-207 kernel: [51176.583186] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 19:36:42 juju-e4d256-prod-github-runner-207 kernel: [51176.584207] ? hrtimer_interrupt+0x101/0x220 Aug 22 19:36:42 juju-e4d256-prod-github-runner-207 kernel: [51176.585225] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 19:36:42 juju-e4d256-prod-github-runner-207 kernel: [51176.586314] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 19:36:42 juju-e4d256-prod-github-runner-207 kernel: [51176.587371] Aug 22 19:36:42 juju-e4d256-prod-github-runner-207 kernel: [51176.588228] Aug 22 19:36:42 juju-e4d256-prod-github-runner-207 kernel: [51176.589063] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 19:36:42 juju-e4d256-prod-github-runner-207 kernel: [51176.590093] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:36:42 juju-e4d256-prod-github-runner-207 kernel: [51176.591145] ? _raw_spin_lock+0x22/0x30 Aug 22 19:36:42 juju-e4d256-prod-github-runner-207 kernel: [51176.592089] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:36:42 juju-e4d256-prod-github-runner-207 kernel: [51176.593104] direct_page_fault+0x206/0x310 [kvm] Aug 22 19:36:42 juju-e4d256-prod-github-runner-207 kernel: [51176.594128] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 19:36:42 juju-e4d256-prod-github-runner-207 kernel: [51176.595150] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 19:36:42 juju-e4d256-prod-github-runner-207 kernel: [51176.596148] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 19:36:42 juju-e4d256-prod-github-runner-207 kernel: [51176.597142] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 19:36:42 juju-e4d256-prod-github-runner-207 kernel: [51176.598084] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 19:36:42 juju-e4d256-prod-github-runner-207 kernel: [51176.599058] handle_exit+0x98/0x230 [kvm_amd] Aug 22 19:36:42 juju-e4d256-prod-github-runner-207 kernel: [51176.599962] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 19:36:42 juju-e4d256-prod-github-runner-207 kernel: [51176.600872] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 19:36:42 juju-e4d256-prod-github-runner-207 kernel: [51176.601799] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 19:36:42 juju-e4d256-prod-github-runner-207 kernel: [51176.602700] vcpu_run+0x62/0x2c0 [kvm] Aug 22 19:36:42 juju-e4d256-prod-github-runner-207 kernel: [51176.603533] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 19:36:42 juju-e4d256-prod-github-runner-207 kernel: [51176.604338] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 19:36:42 juju-e4d256-prod-github-runner-207 kernel: [51176.605190] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 19:36:42 juju-e4d256-prod-github-runner-207 kernel: [51176.605984] ? __seccomp_filter+0x4a/0x4a0 Aug 22 19:36:42 juju-e4d256-prod-github-runner-207 kernel: [51176.606724] ? __fget_files+0x86/0xc0 Aug 22 19:36:42 juju-e4d256-prod-github-runner-207 kernel: [51176.607441] __x64_sys_ioctl+0x95/0xd0 Aug 22 19:36:42 juju-e4d256-prod-github-runner-207 kernel: [51176.608139] do_syscall_64+0x5c/0xc0 Aug 22 19:36:42 juju-e4d256-prod-github-runner-207 kernel: [51176.608800] ? do_futex+0x162/0x1f0 Aug 22 19:36:42 juju-e4d256-prod-github-runner-207 kernel: [51176.609453] ? __x64_sys_futex+0x78/0x1e0 Aug 22 19:36:42 juju-e4d256-prod-github-runner-207 kernel: [51176.610140] ? __secure_computing+0xa9/0x120 Aug 22 19:36:42 juju-e4d256-prod-github-runner-207 kernel: [51176.610850] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 19:36:42 juju-e4d256-prod-github-runner-207 kernel: [51176.611627] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:36:42 juju-e4d256-prod-github-runner-207 kernel: [51176.612346] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:36:42 juju-e4d256-prod-github-runner-207 kernel: [51176.613065] ? do_syscall_64+0x69/0xc0 Aug 22 19:36:42 juju-e4d256-prod-github-runner-207 kernel: [51176.613711] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:36:42 juju-e4d256-prod-github-runner-207 kernel: [51176.614415] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:36:42 juju-e4d256-prod-github-runner-207 kernel: [51176.615127] ? do_syscall_64+0x69/0xc0 Aug 22 19:36:42 juju-e4d256-prod-github-runner-207 kernel: [51176.615750] ? do_syscall_64+0x69/0xc0 Aug 22 19:36:42 juju-e4d256-prod-github-runner-207 kernel: [51176.616371] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 19:36:42 juju-e4d256-prod-github-runner-207 kernel: [51176.617072] RIP: 0033:0x7faa5d0edaff Aug 22 19:36:42 juju-e4d256-prod-github-runner-207 kernel: [51176.617709] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 19:36:42 juju-e4d256-prod-github-runner-207 kernel: [51176.619696] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 19:36:42 juju-e4d256-prod-github-runner-207 kernel: [51176.620609] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 19:36:42 juju-e4d256-prod-github-runner-207 kernel: [51176.621503] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 19:36:42 juju-e4d256-prod-github-runner-207 kernel: [51176.622389] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 19:36:42 juju-e4d256-prod-github-runner-207 kernel: [51176.623291] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 19:36:42 juju-e4d256-prod-github-runner-207 kernel: [51176.624174] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 19:36:42 juju-e4d256-prod-github-runner-207 kernel: [51176.625060] Aug 22 19:37:10 juju-e4d256-prod-github-runner-207 kernel: [51204.541980] watchdog: BUG: soft lockup - CPU#1 stuck for 47579s! [qemu-system-x86:6715] Aug 22 19:37:10 juju-e4d256-prod-github-runner-207 kernel: [51204.543273] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 19:37:10 juju-e4d256-prod-github-runner-207 kernel: [51204.543361] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 19:37:10 juju-e4d256-prod-github-runner-207 kernel: [51204.557105] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 19:37:10 juju-e4d256-prod-github-runner-207 kernel: [51204.558752] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 19:37:10 juju-e4d256-prod-github-runner-207 kernel: [51204.560198] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:37:10 juju-e4d256-prod-github-runner-207 kernel: [51204.561447] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 19:37:10 juju-e4d256-prod-github-runner-207 kernel: [51204.564463] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 19:37:10 juju-e4d256-prod-github-runner-207 kernel: [51204.565669] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 19:37:10 juju-e4d256-prod-github-runner-207 kernel: [51204.567034] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 19:37:10 juju-e4d256-prod-github-runner-207 kernel: [51204.568357] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 19:37:10 juju-e4d256-prod-github-runner-207 kernel: [51204.569998] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 19:37:10 juju-e4d256-prod-github-runner-207 kernel: [51204.571260] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 19:37:10 juju-e4d256-prod-github-runner-207 kernel: [51204.572599] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 19:37:10 juju-e4d256-prod-github-runner-207 kernel: [51204.574078] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 19:37:10 juju-e4d256-prod-github-runner-207 kernel: [51204.575338] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 19:37:10 juju-e4d256-prod-github-runner-207 kernel: [51204.576677] Call Trace: Aug 22 19:37:10 juju-e4d256-prod-github-runner-207 kernel: [51204.577592] Aug 22 19:37:10 juju-e4d256-prod-github-runner-207 kernel: [51204.578477] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:37:10 juju-e4d256-prod-github-runner-207 kernel: [51204.579522] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:37:10 juju-e4d256-prod-github-runner-207 kernel: [51204.580545] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:37:10 juju-e4d256-prod-github-runner-207 kernel: [51204.581785] ? show_regs.part.0+0x23/0x29 Aug 22 19:37:10 juju-e4d256-prod-github-runner-207 kernel: [51204.582965] ? show_regs.cold+0x8/0xd Aug 22 19:37:10 juju-e4d256-prod-github-runner-207 kernel: [51204.584138] ? watchdog_timer_fn+0x1be/0x220 Aug 22 19:37:10 juju-e4d256-prod-github-runner-207 kernel: [51204.585309] ? lockup_detector_update_enable+0x60/0x60 Aug 22 19:37:10 juju-e4d256-prod-github-runner-207 kernel: [51204.586532] ? __hrtimer_run_queues+0x107/0x230 Aug 22 19:37:10 juju-e4d256-prod-github-runner-207 kernel: [51204.587838] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 19:37:10 juju-e4d256-prod-github-runner-207 kernel: [51204.589025] ? hrtimer_interrupt+0x101/0x220 Aug 22 19:37:10 juju-e4d256-prod-github-runner-207 kernel: [51204.590169] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 19:37:10 juju-e4d256-prod-github-runner-207 kernel: [51204.591371] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 19:37:10 juju-e4d256-prod-github-runner-207 kernel: [51204.592593] Aug 22 19:37:10 juju-e4d256-prod-github-runner-207 kernel: [51204.593605] Aug 22 19:37:10 juju-e4d256-prod-github-runner-207 kernel: [51204.594550] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 19:37:10 juju-e4d256-prod-github-runner-207 kernel: [51204.595721] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:37:10 juju-e4d256-prod-github-runner-207 kernel: [51204.596830] ? _raw_spin_lock+0x22/0x30 Aug 22 19:37:10 juju-e4d256-prod-github-runner-207 kernel: [51204.597933] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:37:10 juju-e4d256-prod-github-runner-207 kernel: [51204.599115] direct_page_fault+0x206/0x310 [kvm] Aug 22 19:37:10 juju-e4d256-prod-github-runner-207 kernel: [51204.600309] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 19:37:10 juju-e4d256-prod-github-runner-207 kernel: [51204.601439] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 19:37:10 juju-e4d256-prod-github-runner-207 kernel: [51204.602611] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 19:37:10 juju-e4d256-prod-github-runner-207 kernel: [51204.603761] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 19:37:10 juju-e4d256-prod-github-runner-207 kernel: [51204.604835] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 19:37:10 juju-e4d256-prod-github-runner-207 kernel: [51204.605961] handle_exit+0x98/0x230 [kvm_amd] Aug 22 19:37:10 juju-e4d256-prod-github-runner-207 kernel: [51204.607063] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 19:37:10 juju-e4d256-prod-github-runner-207 kernel: [51204.608135] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 19:37:10 juju-e4d256-prod-github-runner-207 kernel: [51204.609193] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 19:37:10 juju-e4d256-prod-github-runner-207 kernel: [51204.610254] vcpu_run+0x62/0x2c0 [kvm] Aug 22 19:37:10 juju-e4d256-prod-github-runner-207 kernel: [51204.611238] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 19:37:10 juju-e4d256-prod-github-runner-207 kernel: [51204.612125] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 19:37:10 juju-e4d256-prod-github-runner-207 kernel: [51204.613143] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 19:37:10 juju-e4d256-prod-github-runner-207 kernel: [51204.614061] ? __seccomp_filter+0x4a/0x4a0 Aug 22 19:37:10 juju-e4d256-prod-github-runner-207 kernel: [51204.614934] ? __fget_files+0x86/0xc0 Aug 22 19:37:10 juju-e4d256-prod-github-runner-207 kernel: [51204.615719] __x64_sys_ioctl+0x95/0xd0 Aug 22 19:37:10 juju-e4d256-prod-github-runner-207 kernel: [51204.616521] do_syscall_64+0x5c/0xc0 Aug 22 19:37:10 juju-e4d256-prod-github-runner-207 kernel: [51204.617264] ? do_futex+0x162/0x1f0 Aug 22 19:37:10 juju-e4d256-prod-github-runner-207 kernel: [51204.618031] ? __x64_sys_futex+0x78/0x1e0 Aug 22 19:37:10 juju-e4d256-prod-github-runner-207 kernel: [51204.618774] ? __secure_computing+0xa9/0x120 Aug 22 19:37:10 juju-e4d256-prod-github-runner-207 kernel: [51204.619596] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 19:37:10 juju-e4d256-prod-github-runner-207 kernel: [51204.620432] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:37:10 juju-e4d256-prod-github-runner-207 kernel: [51204.621260] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:37:10 juju-e4d256-prod-github-runner-207 kernel: [51204.622058] ? do_syscall_64+0x69/0xc0 Aug 22 19:37:10 juju-e4d256-prod-github-runner-207 kernel: [51204.622836] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:37:10 juju-e4d256-prod-github-runner-207 kernel: [51204.623664] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:37:10 juju-e4d256-prod-github-runner-207 kernel: [51204.624502] ? do_syscall_64+0x69/0xc0 Aug 22 19:37:10 juju-e4d256-prod-github-runner-207 kernel: [51204.625212] ? do_syscall_64+0x69/0xc0 Aug 22 19:37:10 juju-e4d256-prod-github-runner-207 kernel: [51204.625962] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 19:37:10 juju-e4d256-prod-github-runner-207 kernel: [51204.626956] RIP: 0033:0x7faa5d0edaff Aug 22 19:37:10 juju-e4d256-prod-github-runner-207 kernel: [51204.627662] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 19:37:10 juju-e4d256-prod-github-runner-207 kernel: [51204.629892] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 19:37:10 juju-e4d256-prod-github-runner-207 kernel: [51204.630934] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 19:37:10 juju-e4d256-prod-github-runner-207 kernel: [51204.631950] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 19:37:10 juju-e4d256-prod-github-runner-207 kernel: [51204.633059] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 19:37:10 juju-e4d256-prod-github-runner-207 kernel: [51204.634091] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 19:37:10 juju-e4d256-prod-github-runner-207 kernel: [51204.635168] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 19:37:10 juju-e4d256-prod-github-runner-207 kernel: [51204.636227] Aug 22 19:37:38 juju-e4d256-prod-github-runner-207 kernel: [51232.541980] watchdog: BUG: soft lockup - CPU#1 stuck for 47606s! [qemu-system-x86:6715] Aug 22 19:37:38 juju-e4d256-prod-github-runner-207 kernel: [51232.543438] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 19:37:38 juju-e4d256-prod-github-runner-207 kernel: [51232.543517] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 19:37:38 juju-e4d256-prod-github-runner-207 kernel: [51232.558130] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 19:37:38 juju-e4d256-prod-github-runner-207 kernel: [51232.559815] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 19:37:38 juju-e4d256-prod-github-runner-207 kernel: [51232.561343] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:37:38 juju-e4d256-prod-github-runner-207 kernel: [51232.562684] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 19:37:38 juju-e4d256-prod-github-runner-207 kernel: [51232.565764] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 19:37:38 juju-e4d256-prod-github-runner-207 kernel: [51232.567122] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 19:37:38 juju-e4d256-prod-github-runner-207 kernel: [51232.568537] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 19:37:38 juju-e4d256-prod-github-runner-207 kernel: [51232.569969] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 19:37:38 juju-e4d256-prod-github-runner-207 kernel: [51232.571404] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 19:37:38 juju-e4d256-prod-github-runner-207 kernel: [51232.572852] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 19:37:38 juju-e4d256-prod-github-runner-207 kernel: [51232.574313] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 19:37:38 juju-e4d256-prod-github-runner-207 kernel: [51232.575840] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 19:37:38 juju-e4d256-prod-github-runner-207 kernel: [51232.577131] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 19:37:38 juju-e4d256-prod-github-runner-207 kernel: [51232.578541] Call Trace: Aug 22 19:37:38 juju-e4d256-prod-github-runner-207 kernel: [51232.579608] Aug 22 19:37:38 juju-e4d256-prod-github-runner-207 kernel: [51232.580664] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:37:38 juju-e4d256-prod-github-runner-207 kernel: [51232.581910] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:37:38 juju-e4d256-prod-github-runner-207 kernel: [51232.583198] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:37:38 juju-e4d256-prod-github-runner-207 kernel: [51232.584642] ? show_regs.part.0+0x23/0x29 Aug 22 19:37:38 juju-e4d256-prod-github-runner-207 kernel: [51232.585908] ? show_regs.cold+0x8/0xd Aug 22 19:37:38 juju-e4d256-prod-github-runner-207 kernel: [51232.587145] ? watchdog_timer_fn+0x1be/0x220 Aug 22 19:37:38 juju-e4d256-prod-github-runner-207 kernel: [51232.588391] ? lockup_detector_update_enable+0x60/0x60 Aug 22 19:37:38 juju-e4d256-prod-github-runner-207 kernel: [51232.589697] ? __hrtimer_run_queues+0x107/0x230 Aug 22 19:37:38 juju-e4d256-prod-github-runner-207 kernel: [51232.590973] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 19:37:38 juju-e4d256-prod-github-runner-207 kernel: [51232.592224] ? hrtimer_interrupt+0x101/0x220 Aug 22 19:37:38 juju-e4d256-prod-github-runner-207 kernel: [51232.593506] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 19:37:38 juju-e4d256-prod-github-runner-207 kernel: [51232.594820] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 19:37:38 juju-e4d256-prod-github-runner-207 kernel: [51232.596096] Aug 22 19:37:38 juju-e4d256-prod-github-runner-207 kernel: [51232.597122] Aug 22 19:37:38 juju-e4d256-prod-github-runner-207 kernel: [51232.598146] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 19:37:38 juju-e4d256-prod-github-runner-207 kernel: [51232.599429] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:37:38 juju-e4d256-prod-github-runner-207 kernel: [51232.600760] ? _raw_spin_lock+0x22/0x30 Aug 22 19:37:38 juju-e4d256-prod-github-runner-207 kernel: [51232.601937] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:37:38 juju-e4d256-prod-github-runner-207 kernel: [51232.603179] direct_page_fault+0x206/0x310 [kvm] Aug 22 19:37:38 juju-e4d256-prod-github-runner-207 kernel: [51232.604491] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 19:37:38 juju-e4d256-prod-github-runner-207 kernel: [51232.605742] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 19:37:38 juju-e4d256-prod-github-runner-207 kernel: [51232.607025] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 19:37:38 juju-e4d256-prod-github-runner-207 kernel: [51232.608226] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 19:37:38 juju-e4d256-prod-github-runner-207 kernel: [51232.609397] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 19:37:38 juju-e4d256-prod-github-runner-207 kernel: [51232.610559] handle_exit+0x98/0x230 [kvm_amd] Aug 22 19:37:38 juju-e4d256-prod-github-runner-207 kernel: [51232.611570] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 19:37:38 juju-e4d256-prod-github-runner-207 kernel: [51232.612612] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 19:37:38 juju-e4d256-prod-github-runner-207 kernel: [51232.613682] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 19:37:38 juju-e4d256-prod-github-runner-207 kernel: [51232.614820] vcpu_run+0x62/0x2c0 [kvm] Aug 22 19:37:38 juju-e4d256-prod-github-runner-207 kernel: [51232.615836] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 19:37:38 juju-e4d256-prod-github-runner-207 kernel: [51232.616873] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 19:37:38 juju-e4d256-prod-github-runner-207 kernel: [51232.617981] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 19:37:38 juju-e4d256-prod-github-runner-207 kernel: [51232.618978] ? __seccomp_filter+0x4a/0x4a0 Aug 22 19:37:38 juju-e4d256-prod-github-runner-207 kernel: [51232.619869] ? __fget_files+0x86/0xc0 Aug 22 19:37:38 juju-e4d256-prod-github-runner-207 kernel: [51232.620695] __x64_sys_ioctl+0x95/0xd0 Aug 22 19:37:38 juju-e4d256-prod-github-runner-207 kernel: [51232.621511] do_syscall_64+0x5c/0xc0 Aug 22 19:37:38 juju-e4d256-prod-github-runner-207 kernel: [51232.622351] ? do_futex+0x162/0x1f0 Aug 22 19:37:38 juju-e4d256-prod-github-runner-207 kernel: [51232.623178] ? __x64_sys_futex+0x78/0x1e0 Aug 22 19:37:38 juju-e4d256-prod-github-runner-207 kernel: [51232.624033] ? __secure_computing+0xa9/0x120 Aug 22 19:37:38 juju-e4d256-prod-github-runner-207 kernel: [51232.624892] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 19:37:38 juju-e4d256-prod-github-runner-207 kernel: [51232.625862] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:37:38 juju-e4d256-prod-github-runner-207 kernel: [51232.626806] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:37:38 juju-e4d256-prod-github-runner-207 kernel: [51232.627722] ? do_syscall_64+0x69/0xc0 Aug 22 19:37:38 juju-e4d256-prod-github-runner-207 kernel: [51232.628504] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:37:38 juju-e4d256-prod-github-runner-207 kernel: [51232.629355] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:37:38 juju-e4d256-prod-github-runner-207 kernel: [51232.630231] ? do_syscall_64+0x69/0xc0 Aug 22 19:37:38 juju-e4d256-prod-github-runner-207 kernel: [51232.631029] ? do_syscall_64+0x69/0xc0 Aug 22 19:37:38 juju-e4d256-prod-github-runner-207 kernel: [51232.631828] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 19:37:38 juju-e4d256-prod-github-runner-207 kernel: [51232.632724] RIP: 0033:0x7faa5d0edaff Aug 22 19:37:38 juju-e4d256-prod-github-runner-207 kernel: [51232.633677] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 19:37:38 juju-e4d256-prod-github-runner-207 kernel: [51232.636422] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 19:37:38 juju-e4d256-prod-github-runner-207 kernel: [51232.637619] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 19:37:38 juju-e4d256-prod-github-runner-207 kernel: [51232.638735] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 19:37:38 juju-e4d256-prod-github-runner-207 kernel: [51232.639912] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 19:37:38 juju-e4d256-prod-github-runner-207 kernel: [51232.641071] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 19:37:38 juju-e4d256-prod-github-runner-207 kernel: [51232.642202] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 19:37:38 juju-e4d256-prod-github-runner-207 kernel: [51232.643382] Aug 22 19:38:06 juju-e4d256-prod-github-runner-207 kernel: [51260.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 47632s! [qemu-system-x86:6715] Aug 22 19:38:06 juju-e4d256-prod-github-runner-207 kernel: [51260.544124] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 19:38:06 juju-e4d256-prod-github-runner-207 kernel: [51260.544518] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 19:38:06 juju-e4d256-prod-github-runner-207 kernel: [51260.557670] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 19:38:06 juju-e4d256-prod-github-runner-207 kernel: [51260.559198] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 19:38:06 juju-e4d256-prod-github-runner-207 kernel: [51260.560553] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:38:06 juju-e4d256-prod-github-runner-207 kernel: [51260.561768] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 19:38:06 juju-e4d256-prod-github-runner-207 kernel: [51260.564604] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 19:38:06 juju-e4d256-prod-github-runner-207 kernel: [51260.565794] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 19:38:06 juju-e4d256-prod-github-runner-207 kernel: [51260.567146] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 19:38:06 juju-e4d256-prod-github-runner-207 kernel: [51260.568423] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 19:38:06 juju-e4d256-prod-github-runner-207 kernel: [51260.569667] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 19:38:06 juju-e4d256-prod-github-runner-207 kernel: [51260.570902] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 19:38:06 juju-e4d256-prod-github-runner-207 kernel: [51260.572111] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 19:38:06 juju-e4d256-prod-github-runner-207 kernel: [51260.573397] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 19:38:06 juju-e4d256-prod-github-runner-207 kernel: [51260.574624] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 19:38:06 juju-e4d256-prod-github-runner-207 kernel: [51260.576018] Call Trace: Aug 22 19:38:06 juju-e4d256-prod-github-runner-207 kernel: [51260.577022] Aug 22 19:38:06 juju-e4d256-prod-github-runner-207 kernel: [51260.578000] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:38:06 juju-e4d256-prod-github-runner-207 kernel: [51260.579120] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:38:06 juju-e4d256-prod-github-runner-207 kernel: [51260.580237] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:38:06 juju-e4d256-prod-github-runner-207 kernel: [51260.581543] ? show_regs.part.0+0x23/0x29 Aug 22 19:38:06 juju-e4d256-prod-github-runner-207 kernel: [51260.583103] ? show_regs.cold+0x8/0xd Aug 22 19:38:06 juju-e4d256-prod-github-runner-207 kernel: [51260.584617] ? watchdog_timer_fn+0x1be/0x220 Aug 22 19:38:06 juju-e4d256-prod-github-runner-207 kernel: [51260.586341] ? lockup_detector_update_enable+0x60/0x60 Aug 22 19:38:06 juju-e4d256-prod-github-runner-207 kernel: [51260.588180] ? __hrtimer_run_queues+0x107/0x230 Aug 22 19:38:06 juju-e4d256-prod-github-runner-207 kernel: [51260.590032] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 19:38:06 juju-e4d256-prod-github-runner-207 kernel: [51260.591231] ? hrtimer_interrupt+0x101/0x220 Aug 22 19:38:06 juju-e4d256-prod-github-runner-207 kernel: [51260.592332] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 19:38:06 juju-e4d256-prod-github-runner-207 kernel: [51260.593520] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 19:38:06 juju-e4d256-prod-github-runner-207 kernel: [51260.594677] Aug 22 19:38:06 juju-e4d256-prod-github-runner-207 kernel: [51260.595593] Aug 22 19:38:06 juju-e4d256-prod-github-runner-207 kernel: [51260.596526] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 19:38:06 juju-e4d256-prod-github-runner-207 kernel: [51260.597690] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:38:06 juju-e4d256-prod-github-runner-207 kernel: [51260.598878] ? _raw_spin_lock+0x22/0x30 Aug 22 19:38:06 juju-e4d256-prod-github-runner-207 kernel: [51260.599904] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:38:06 juju-e4d256-prod-github-runner-207 kernel: [51260.601061] direct_page_fault+0x206/0x310 [kvm] Aug 22 19:38:06 juju-e4d256-prod-github-runner-207 kernel: [51260.602213] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 19:38:06 juju-e4d256-prod-github-runner-207 kernel: [51260.603298] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 19:38:06 juju-e4d256-prod-github-runner-207 kernel: [51260.604409] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 19:38:06 juju-e4d256-prod-github-runner-207 kernel: [51260.605667] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 19:38:06 juju-e4d256-prod-github-runner-207 kernel: [51260.606741] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 19:38:06 juju-e4d256-prod-github-runner-207 kernel: [51260.607804] handle_exit+0x98/0x230 [kvm_amd] Aug 22 19:38:06 juju-e4d256-prod-github-runner-207 kernel: [51260.608746] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 19:38:06 juju-e4d256-prod-github-runner-207 kernel: [51260.609697] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 19:38:06 juju-e4d256-prod-github-runner-207 kernel: [51260.610680] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 19:38:06 juju-e4d256-prod-github-runner-207 kernel: [51260.611618] vcpu_run+0x62/0x2c0 [kvm] Aug 22 19:38:06 juju-e4d256-prod-github-runner-207 kernel: [51260.612521] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 19:38:06 juju-e4d256-prod-github-runner-207 kernel: [51260.613568] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 19:38:06 juju-e4d256-prod-github-runner-207 kernel: [51260.614736] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 19:38:06 juju-e4d256-prod-github-runner-207 kernel: [51260.615672] ? __seccomp_filter+0x4a/0x4a0 Aug 22 19:38:06 juju-e4d256-prod-github-runner-207 kernel: [51260.616476] ? __fget_files+0x86/0xc0 Aug 22 19:38:06 juju-e4d256-prod-github-runner-207 kernel: [51260.617211] __x64_sys_ioctl+0x95/0xd0 Aug 22 19:38:06 juju-e4d256-prod-github-runner-207 kernel: [51260.617946] do_syscall_64+0x5c/0xc0 Aug 22 19:38:06 juju-e4d256-prod-github-runner-207 kernel: [51260.618694] ? do_futex+0x162/0x1f0 Aug 22 19:38:06 juju-e4d256-prod-github-runner-207 kernel: [51260.619372] ? __x64_sys_futex+0x78/0x1e0 Aug 22 19:38:06 juju-e4d256-prod-github-runner-207 kernel: [51260.620077] ? __secure_computing+0xa9/0x120 Aug 22 19:38:06 juju-e4d256-prod-github-runner-207 kernel: [51260.620809] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 19:38:06 juju-e4d256-prod-github-runner-207 kernel: [51260.621629] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:38:06 juju-e4d256-prod-github-runner-207 kernel: [51260.622440] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:38:06 juju-e4d256-prod-github-runner-207 kernel: [51260.623232] ? do_syscall_64+0x69/0xc0 Aug 22 19:38:06 juju-e4d256-prod-github-runner-207 kernel: [51260.623936] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:38:06 juju-e4d256-prod-github-runner-207 kernel: [51260.624757] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:38:06 juju-e4d256-prod-github-runner-207 kernel: [51260.625625] ? do_syscall_64+0x69/0xc0 Aug 22 19:38:06 juju-e4d256-prod-github-runner-207 kernel: [51260.626479] ? do_syscall_64+0x69/0xc0 Aug 22 19:38:06 juju-e4d256-prod-github-runner-207 kernel: [51260.627207] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 19:38:06 juju-e4d256-prod-github-runner-207 kernel: [51260.627955] RIP: 0033:0x7faa5d0edaff Aug 22 19:38:06 juju-e4d256-prod-github-runner-207 kernel: [51260.628680] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 19:38:06 juju-e4d256-prod-github-runner-207 kernel: [51260.630885] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 19:38:06 juju-e4d256-prod-github-runner-207 kernel: [51260.631873] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 19:38:06 juju-e4d256-prod-github-runner-207 kernel: [51260.632829] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 19:38:06 juju-e4d256-prod-github-runner-207 kernel: [51260.633812] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 19:38:06 juju-e4d256-prod-github-runner-207 kernel: [51260.634834] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 19:38:06 juju-e4d256-prod-github-runner-207 kernel: [51260.635876] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 19:38:06 juju-e4d256-prod-github-runner-207 kernel: [51260.637058] Aug 22 19:38:34 juju-e4d256-prod-github-runner-207 kernel: [51288.541980] watchdog: BUG: soft lockup - CPU#1 stuck for 47658s! [qemu-system-x86:6715] Aug 22 19:38:34 juju-e4d256-prod-github-runner-207 kernel: [51288.544113] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 19:38:34 juju-e4d256-prod-github-runner-207 kernel: [51288.544431] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 19:38:34 juju-e4d256-prod-github-runner-207 kernel: [51288.558607] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 19:38:34 juju-e4d256-prod-github-runner-207 kernel: [51288.560051] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 19:38:34 juju-e4d256-prod-github-runner-207 kernel: [51288.561444] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:38:34 juju-e4d256-prod-github-runner-207 kernel: [51288.562630] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 19:38:34 juju-e4d256-prod-github-runner-207 kernel: [51288.565518] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 19:38:34 juju-e4d256-prod-github-runner-207 kernel: [51288.566670] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 19:38:34 juju-e4d256-prod-github-runner-207 kernel: [51288.567956] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 19:38:34 juju-e4d256-prod-github-runner-207 kernel: [51288.569246] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 19:38:34 juju-e4d256-prod-github-runner-207 kernel: [51288.570559] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 19:38:34 juju-e4d256-prod-github-runner-207 kernel: [51288.571865] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 19:38:34 juju-e4d256-prod-github-runner-207 kernel: [51288.573164] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 19:38:34 juju-e4d256-prod-github-runner-207 kernel: [51288.574564] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 19:38:34 juju-e4d256-prod-github-runner-207 kernel: [51288.575782] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 19:38:34 juju-e4d256-prod-github-runner-207 kernel: [51288.577119] Call Trace: Aug 22 19:38:34 juju-e4d256-prod-github-runner-207 kernel: [51288.578113] Aug 22 19:38:34 juju-e4d256-prod-github-runner-207 kernel: [51288.579061] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:38:34 juju-e4d256-prod-github-runner-207 kernel: [51288.580170] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:38:34 juju-e4d256-prod-github-runner-207 kernel: [51288.581276] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:38:34 juju-e4d256-prod-github-runner-207 kernel: [51288.582496] ? show_regs.part.0+0x23/0x29 Aug 22 19:38:34 juju-e4d256-prod-github-runner-207 kernel: [51288.583583] ? show_regs.cold+0x8/0xd Aug 22 19:38:34 juju-e4d256-prod-github-runner-207 kernel: [51288.584645] ? watchdog_timer_fn+0x1be/0x220 Aug 22 19:38:34 juju-e4d256-prod-github-runner-207 kernel: [51288.585737] ? lockup_detector_update_enable+0x60/0x60 Aug 22 19:38:34 juju-e4d256-prod-github-runner-207 kernel: [51288.586918] ? __hrtimer_run_queues+0x107/0x230 Aug 22 19:38:34 juju-e4d256-prod-github-runner-207 kernel: [51288.588033] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 19:38:34 juju-e4d256-prod-github-runner-207 kernel: [51288.589146] ? hrtimer_interrupt+0x101/0x220 Aug 22 19:38:34 juju-e4d256-prod-github-runner-207 kernel: [51288.590280] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 19:38:34 juju-e4d256-prod-github-runner-207 kernel: [51288.591450] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 19:38:34 juju-e4d256-prod-github-runner-207 kernel: [51288.592590] Aug 22 19:38:34 juju-e4d256-prod-github-runner-207 kernel: [51288.593487] Aug 22 19:38:34 juju-e4d256-prod-github-runner-207 kernel: [51288.594378] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 19:38:34 juju-e4d256-prod-github-runner-207 kernel: [51288.595524] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:38:34 juju-e4d256-prod-github-runner-207 kernel: [51288.596669] ? _raw_spin_lock+0x22/0x30 Aug 22 19:38:34 juju-e4d256-prod-github-runner-207 kernel: [51288.597694] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:38:34 juju-e4d256-prod-github-runner-207 kernel: [51288.598814] direct_page_fault+0x206/0x310 [kvm] Aug 22 19:38:34 juju-e4d256-prod-github-runner-207 kernel: [51288.599926] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 19:38:34 juju-e4d256-prod-github-runner-207 kernel: [51288.601022] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 19:38:34 juju-e4d256-prod-github-runner-207 kernel: [51288.602126] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 19:38:34 juju-e4d256-prod-github-runner-207 kernel: [51288.603229] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 19:38:34 juju-e4d256-prod-github-runner-207 kernel: [51288.604264] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 19:38:34 juju-e4d256-prod-github-runner-207 kernel: [51288.605349] handle_exit+0x98/0x230 [kvm_amd] Aug 22 19:38:34 juju-e4d256-prod-github-runner-207 kernel: [51288.606354] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 19:38:34 juju-e4d256-prod-github-runner-207 kernel: [51288.607358] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 19:38:34 juju-e4d256-prod-github-runner-207 kernel: [51288.608373] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 19:38:34 juju-e4d256-prod-github-runner-207 kernel: [51288.609367] vcpu_run+0x62/0x2c0 [kvm] Aug 22 19:38:34 juju-e4d256-prod-github-runner-207 kernel: [51288.610311] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 19:38:34 juju-e4d256-prod-github-runner-207 kernel: [51288.611209] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 19:38:34 juju-e4d256-prod-github-runner-207 kernel: [51288.612157] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 19:38:34 juju-e4d256-prod-github-runner-207 kernel: [51288.613034] ? __seccomp_filter+0x4a/0x4a0 Aug 22 19:38:34 juju-e4d256-prod-github-runner-207 kernel: [51288.613886] ? __fget_files+0x86/0xc0 Aug 22 19:38:34 juju-e4d256-prod-github-runner-207 kernel: [51288.614664] __x64_sys_ioctl+0x95/0xd0 Aug 22 19:38:34 juju-e4d256-prod-github-runner-207 kernel: [51288.615432] do_syscall_64+0x5c/0xc0 Aug 22 19:38:34 juju-e4d256-prod-github-runner-207 kernel: [51288.616169] ? do_futex+0x162/0x1f0 Aug 22 19:38:34 juju-e4d256-prod-github-runner-207 kernel: [51288.616889] ? __x64_sys_futex+0x78/0x1e0 Aug 22 19:38:34 juju-e4d256-prod-github-runner-207 kernel: [51288.617643] ? __secure_computing+0xa9/0x120 Aug 22 19:38:34 juju-e4d256-prod-github-runner-207 kernel: [51288.618428] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 19:38:34 juju-e4d256-prod-github-runner-207 kernel: [51288.619288] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:38:34 juju-e4d256-prod-github-runner-207 kernel: [51288.620111] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:38:34 juju-e4d256-prod-github-runner-207 kernel: [51288.620923] ? do_syscall_64+0x69/0xc0 Aug 22 19:38:34 juju-e4d256-prod-github-runner-207 kernel: [51288.621649] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:38:34 juju-e4d256-prod-github-runner-207 kernel: [51288.622454] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:38:34 juju-e4d256-prod-github-runner-207 kernel: [51288.623243] ? do_syscall_64+0x69/0xc0 Aug 22 19:38:34 juju-e4d256-prod-github-runner-207 kernel: [51288.623942] ? do_syscall_64+0x69/0xc0 Aug 22 19:38:34 juju-e4d256-prod-github-runner-207 kernel: [51288.624644] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 19:38:34 juju-e4d256-prod-github-runner-207 kernel: [51288.625454] RIP: 0033:0x7faa5d0edaff Aug 22 19:38:34 juju-e4d256-prod-github-runner-207 kernel: [51288.626206] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 19:38:34 juju-e4d256-prod-github-runner-207 kernel: [51288.628535] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 19:38:34 juju-e4d256-prod-github-runner-207 kernel: [51288.629584] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 19:38:34 juju-e4d256-prod-github-runner-207 kernel: [51288.630614] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 19:38:34 juju-e4d256-prod-github-runner-207 kernel: [51288.631628] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 19:38:34 juju-e4d256-prod-github-runner-207 kernel: [51288.632642] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 19:38:34 juju-e4d256-prod-github-runner-207 kernel: [51288.633658] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 19:38:34 juju-e4d256-prod-github-runner-207 kernel: [51288.634685] Aug 22 19:38:46 juju-e4d256-prod-github-runner-207 kernel: [51300.608709] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 19:38:46 juju-e4d256-prod-github-runner-207 kernel: [51300.610527] rcu: 1-....: (12755551 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=6166972 Aug 22 19:38:46 juju-e4d256-prod-github-runner-207 kernel: [51300.611684] (t=12795852 jiffies g=23269 q=48439) Aug 22 19:38:46 juju-e4d256-prod-github-runner-207 kernel: [51300.612485] NMI backtrace for cpu 1 Aug 22 19:38:46 juju-e4d256-prod-github-runner-207 kernel: [51300.613253] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 19:38:46 juju-e4d256-prod-github-runner-207 kernel: [51300.614426] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 19:38:46 juju-e4d256-prod-github-runner-207 kernel: [51300.615481] Call Trace: Aug 22 19:38:46 juju-e4d256-prod-github-runner-207 kernel: [51300.616155] Aug 22 19:38:46 juju-e4d256-prod-github-runner-207 kernel: [51300.616829] show_stack+0x52/0x5c Aug 22 19:38:46 juju-e4d256-prod-github-runner-207 kernel: [51300.617567] dump_stack_lvl+0x4a/0x63 Aug 22 19:38:46 juju-e4d256-prod-github-runner-207 kernel: [51300.618335] dump_stack+0x10/0x16 Aug 22 19:38:46 juju-e4d256-prod-github-runner-207 kernel: [51300.619049] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 19:38:46 juju-e4d256-prod-github-runner-207 kernel: [51300.619825] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 19:38:46 juju-e4d256-prod-github-runner-207 kernel: [51300.620624] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 19:38:46 juju-e4d256-prod-github-runner-207 kernel: [51300.621485] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 19:38:46 juju-e4d256-prod-github-runner-207 kernel: [51300.622348] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 19:38:46 juju-e4d256-prod-github-runner-207 kernel: [51300.623272] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 19:38:46 juju-e4d256-prod-github-runner-207 kernel: [51300.624068] print_cpu_stall.cold+0x2f/0xe2 Aug 22 19:38:46 juju-e4d256-prod-github-runner-207 kernel: [51300.624849] ? timekeeping_update+0xf7/0x150 Aug 22 19:38:46 juju-e4d256-prod-github-runner-207 kernel: [51300.625722] check_cpu_stall+0x109/0x270 Aug 22 19:38:46 juju-e4d256-prod-github-runner-207 kernel: [51300.626533] rcu_sched_clock_irq+0x9a/0x250 Aug 22 19:38:46 juju-e4d256-prod-github-runner-207 kernel: [51300.627302] update_process_times+0x94/0xd0 Aug 22 19:38:46 juju-e4d256-prod-github-runner-207 kernel: [51300.628099] tick_sched_handle+0x29/0x70 Aug 22 19:38:46 juju-e4d256-prod-github-runner-207 kernel: [51300.628873] tick_sched_timer+0x8c/0xc0 Aug 22 19:38:46 juju-e4d256-prod-github-runner-207 kernel: [51300.629670] ? tick_nohz_handler+0xb0/0xb0 Aug 22 19:38:46 juju-e4d256-prod-github-runner-207 kernel: [51300.630451] __hrtimer_run_queues+0x107/0x230 Aug 22 19:38:46 juju-e4d256-prod-github-runner-207 kernel: [51300.631245] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 19:38:46 juju-e4d256-prod-github-runner-207 kernel: [51300.632023] hrtimer_interrupt+0x101/0x220 Aug 22 19:38:46 juju-e4d256-prod-github-runner-207 kernel: [51300.632786] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 19:38:46 juju-e4d256-prod-github-runner-207 kernel: [51300.633601] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 19:38:46 juju-e4d256-prod-github-runner-207 kernel: [51300.634424] Aug 22 19:38:46 juju-e4d256-prod-github-runner-207 kernel: [51300.635062] Aug 22 19:38:46 juju-e4d256-prod-github-runner-207 kernel: [51300.635698] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 19:38:46 juju-e4d256-prod-github-runner-207 kernel: [51300.636519] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:38:46 juju-e4d256-prod-github-runner-207 kernel: [51300.637404] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 19:38:46 juju-e4d256-prod-github-runner-207 kernel: [51300.639827] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 19:38:46 juju-e4d256-prod-github-runner-207 kernel: [51300.640735] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 19:38:46 juju-e4d256-prod-github-runner-207 kernel: [51300.641850] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 19:38:46 juju-e4d256-prod-github-runner-207 kernel: [51300.642850] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 19:38:46 juju-e4d256-prod-github-runner-207 kernel: [51300.643889] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 19:38:46 juju-e4d256-prod-github-runner-207 kernel: [51300.644953] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 19:38:46 juju-e4d256-prod-github-runner-207 kernel: [51300.645952] ? _raw_spin_lock+0x22/0x30 Aug 22 19:38:46 juju-e4d256-prod-github-runner-207 kernel: [51300.646852] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:38:46 juju-e4d256-prod-github-runner-207 kernel: [51300.647873] direct_page_fault+0x206/0x310 [kvm] Aug 22 19:38:46 juju-e4d256-prod-github-runner-207 kernel: [51300.648801] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 19:38:46 juju-e4d256-prod-github-runner-207 kernel: [51300.649661] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 19:38:46 juju-e4d256-prod-github-runner-207 kernel: [51300.650569] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 19:38:46 juju-e4d256-prod-github-runner-207 kernel: [51300.651428] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 19:38:46 juju-e4d256-prod-github-runner-207 kernel: [51300.652247] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 19:38:46 juju-e4d256-prod-github-runner-207 kernel: [51300.653081] handle_exit+0x98/0x230 [kvm_amd] Aug 22 19:38:46 juju-e4d256-prod-github-runner-207 kernel: [51300.653859] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 19:38:46 juju-e4d256-prod-github-runner-207 kernel: [51300.654660] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 19:38:46 juju-e4d256-prod-github-runner-207 kernel: [51300.655488] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 19:38:46 juju-e4d256-prod-github-runner-207 kernel: [51300.656301] vcpu_run+0x62/0x2c0 [kvm] Aug 22 19:38:46 juju-e4d256-prod-github-runner-207 kernel: [51300.657050] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 19:38:46 juju-e4d256-prod-github-runner-207 kernel: [51300.657836] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 19:38:46 juju-e4d256-prod-github-runner-207 kernel: [51300.658640] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 19:38:46 juju-e4d256-prod-github-runner-207 kernel: [51300.659399] ? __seccomp_filter+0x4a/0x4a0 Aug 22 19:38:46 juju-e4d256-prod-github-runner-207 kernel: [51300.660390] ? __fget_files+0x86/0xc0 Aug 22 19:38:46 juju-e4d256-prod-github-runner-207 kernel: [51300.661088] __x64_sys_ioctl+0x95/0xd0 Aug 22 19:38:46 juju-e4d256-prod-github-runner-207 kernel: [51300.661804] do_syscall_64+0x5c/0xc0 Aug 22 19:38:46 juju-e4d256-prod-github-runner-207 kernel: [51300.662485] ? do_futex+0x162/0x1f0 Aug 22 19:38:46 juju-e4d256-prod-github-runner-207 kernel: [51300.663156] ? __x64_sys_futex+0x78/0x1e0 Aug 22 19:38:46 juju-e4d256-prod-github-runner-207 kernel: [51300.663889] ? __secure_computing+0xa9/0x120 Aug 22 19:38:46 juju-e4d256-prod-github-runner-207 kernel: [51300.664620] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 19:38:46 juju-e4d256-prod-github-runner-207 kernel: [51300.665415] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:38:46 juju-e4d256-prod-github-runner-207 kernel: [51300.666184] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:38:46 juju-e4d256-prod-github-runner-207 kernel: [51300.666944] ? do_syscall_64+0x69/0xc0 Aug 22 19:38:46 juju-e4d256-prod-github-runner-207 kernel: [51300.667642] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:38:46 juju-e4d256-prod-github-runner-207 kernel: [51300.668400] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:38:46 juju-e4d256-prod-github-runner-207 kernel: [51300.669159] ? do_syscall_64+0x69/0xc0 Aug 22 19:38:46 juju-e4d256-prod-github-runner-207 kernel: [51300.669869] ? do_syscall_64+0x69/0xc0 Aug 22 19:38:46 juju-e4d256-prod-github-runner-207 kernel: [51300.670557] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 19:38:46 juju-e4d256-prod-github-runner-207 kernel: [51300.671331] RIP: 0033:0x7faa5d0edaff Aug 22 19:38:46 juju-e4d256-prod-github-runner-207 kernel: [51300.672052] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 19:38:46 juju-e4d256-prod-github-runner-207 kernel: [51300.674198] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 19:38:46 juju-e4d256-prod-github-runner-207 kernel: [51300.675171] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 19:38:46 juju-e4d256-prod-github-runner-207 kernel: [51300.676163] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 19:38:46 juju-e4d256-prod-github-runner-207 kernel: [51300.677116] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 19:38:46 juju-e4d256-prod-github-runner-207 kernel: [51300.678082] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 19:38:46 juju-e4d256-prod-github-runner-207 kernel: [51300.679014] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 19:38:46 juju-e4d256-prod-github-runner-207 kernel: [51300.679948] Aug 22 19:39:14 juju-e4d256-prod-github-runner-207 kernel: [51328.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 47695s! [qemu-system-x86:6715] Aug 22 19:39:14 juju-e4d256-prod-github-runner-207 kernel: [51328.543889] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 19:39:14 juju-e4d256-prod-github-runner-207 kernel: [51328.544206] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 19:39:14 juju-e4d256-prod-github-runner-207 kernel: [51328.556245] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 19:39:14 juju-e4d256-prod-github-runner-207 kernel: [51328.557528] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 19:39:14 juju-e4d256-prod-github-runner-207 kernel: [51328.558752] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:39:14 juju-e4d256-prod-github-runner-207 kernel: [51328.559809] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 19:39:14 juju-e4d256-prod-github-runner-207 kernel: [51328.562417] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 19:39:14 juju-e4d256-prod-github-runner-207 kernel: [51328.563466] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 19:39:14 juju-e4d256-prod-github-runner-207 kernel: [51328.564624] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 19:39:14 juju-e4d256-prod-github-runner-207 kernel: [51328.565814] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 19:39:14 juju-e4d256-prod-github-runner-207 kernel: [51328.566972] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 19:39:14 juju-e4d256-prod-github-runner-207 kernel: [51328.568129] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 19:39:14 juju-e4d256-prod-github-runner-207 kernel: [51328.569294] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 19:39:14 juju-e4d256-prod-github-runner-207 kernel: [51328.570575] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 19:39:14 juju-e4d256-prod-github-runner-207 kernel: [51328.571682] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 19:39:14 juju-e4d256-prod-github-runner-207 kernel: [51328.572882] Call Trace: Aug 22 19:39:14 juju-e4d256-prod-github-runner-207 kernel: [51328.573802] Aug 22 19:39:14 juju-e4d256-prod-github-runner-207 kernel: [51328.574702] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:39:14 juju-e4d256-prod-github-runner-207 kernel: [51328.575729] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:39:14 juju-e4d256-prod-github-runner-207 kernel: [51328.576761] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:39:14 juju-e4d256-prod-github-runner-207 kernel: [51328.577877] ? show_regs.part.0+0x23/0x29 Aug 22 19:39:14 juju-e4d256-prod-github-runner-207 kernel: [51328.578875] ? show_regs.cold+0x8/0xd Aug 22 19:39:14 juju-e4d256-prod-github-runner-207 kernel: [51328.579843] ? watchdog_timer_fn+0x1be/0x220 Aug 22 19:39:14 juju-e4d256-prod-github-runner-207 kernel: [51328.580849] ? lockup_detector_update_enable+0x60/0x60 Aug 22 19:39:14 juju-e4d256-prod-github-runner-207 kernel: [51328.581925] ? __hrtimer_run_queues+0x107/0x230 Aug 22 19:39:14 juju-e4d256-prod-github-runner-207 kernel: [51328.583187] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 19:39:14 juju-e4d256-prod-github-runner-207 kernel: [51328.584215] ? hrtimer_interrupt+0x101/0x220 Aug 22 19:39:14 juju-e4d256-prod-github-runner-207 kernel: [51328.585357] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 19:39:14 juju-e4d256-prod-github-runner-207 kernel: [51328.586456] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 19:39:14 juju-e4d256-prod-github-runner-207 kernel: [51328.587514] Aug 22 19:39:14 juju-e4d256-prod-github-runner-207 kernel: [51328.588365] Aug 22 19:39:14 juju-e4d256-prod-github-runner-207 kernel: [51328.589199] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 19:39:14 juju-e4d256-prod-github-runner-207 kernel: [51328.590246] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:39:14 juju-e4d256-prod-github-runner-207 kernel: [51328.591295] ? _raw_spin_lock+0x22/0x30 Aug 22 19:39:14 juju-e4d256-prod-github-runner-207 kernel: [51328.592247] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:39:14 juju-e4d256-prod-github-runner-207 kernel: [51328.593440] direct_page_fault+0x206/0x310 [kvm] Aug 22 19:39:14 juju-e4d256-prod-github-runner-207 kernel: [51328.594466] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 19:39:14 juju-e4d256-prod-github-runner-207 kernel: [51328.595470] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 19:39:14 juju-e4d256-prod-github-runner-207 kernel: [51328.596472] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 19:39:14 juju-e4d256-prod-github-runner-207 kernel: [51328.597478] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 19:39:14 juju-e4d256-prod-github-runner-207 kernel: [51328.598426] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 19:39:14 juju-e4d256-prod-github-runner-207 kernel: [51328.599402] handle_exit+0x98/0x230 [kvm_amd] Aug 22 19:39:14 juju-e4d256-prod-github-runner-207 kernel: [51328.600290] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 19:39:14 juju-e4d256-prod-github-runner-207 kernel: [51328.601199] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 19:39:14 juju-e4d256-prod-github-runner-207 kernel: [51328.602134] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 19:39:14 juju-e4d256-prod-github-runner-207 kernel: [51328.603033] vcpu_run+0x62/0x2c0 [kvm] Aug 22 19:39:14 juju-e4d256-prod-github-runner-207 kernel: [51328.603845] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 19:39:14 juju-e4d256-prod-github-runner-207 kernel: [51328.604659] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 19:39:14 juju-e4d256-prod-github-runner-207 kernel: [51328.605584] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 19:39:14 juju-e4d256-prod-github-runner-207 kernel: [51328.606382] ? __seccomp_filter+0x4a/0x4a0 Aug 22 19:39:14 juju-e4d256-prod-github-runner-207 kernel: [51328.607129] ? __fget_files+0x86/0xc0 Aug 22 19:39:14 juju-e4d256-prod-github-runner-207 kernel: [51328.607832] __x64_sys_ioctl+0x95/0xd0 Aug 22 19:39:14 juju-e4d256-prod-github-runner-207 kernel: [51328.608524] do_syscall_64+0x5c/0xc0 Aug 22 19:39:14 juju-e4d256-prod-github-runner-207 kernel: [51328.609190] ? do_futex+0x162/0x1f0 Aug 22 19:39:14 juju-e4d256-prod-github-runner-207 kernel: [51328.609848] ? __x64_sys_futex+0x78/0x1e0 Aug 22 19:39:14 juju-e4d256-prod-github-runner-207 kernel: [51328.610518] ? __secure_computing+0xa9/0x120 Aug 22 19:39:14 juju-e4d256-prod-github-runner-207 kernel: [51328.611209] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 19:39:14 juju-e4d256-prod-github-runner-207 kernel: [51328.612029] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:39:14 juju-e4d256-prod-github-runner-207 kernel: [51328.612758] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:39:14 juju-e4d256-prod-github-runner-207 kernel: [51328.613486] ? do_syscall_64+0x69/0xc0 Aug 22 19:39:14 juju-e4d256-prod-github-runner-207 kernel: [51328.614129] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:39:14 juju-e4d256-prod-github-runner-207 kernel: [51328.614845] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:39:14 juju-e4d256-prod-github-runner-207 kernel: [51328.615545] ? do_syscall_64+0x69/0xc0 Aug 22 19:39:14 juju-e4d256-prod-github-runner-207 kernel: [51328.616190] ? do_syscall_64+0x69/0xc0 Aug 22 19:39:14 juju-e4d256-prod-github-runner-207 kernel: [51328.616811] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 19:39:14 juju-e4d256-prod-github-runner-207 kernel: [51328.617529] RIP: 0033:0x7faa5d0edaff Aug 22 19:39:14 juju-e4d256-prod-github-runner-207 kernel: [51328.618189] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 19:39:14 juju-e4d256-prod-github-runner-207 kernel: [51328.620443] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 19:39:14 juju-e4d256-prod-github-runner-207 kernel: [51328.621570] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 19:39:14 juju-e4d256-prod-github-runner-207 kernel: [51328.622460] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 19:39:14 juju-e4d256-prod-github-runner-207 kernel: [51328.623350] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 19:39:14 juju-e4d256-prod-github-runner-207 kernel: [51328.624231] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 19:39:14 juju-e4d256-prod-github-runner-207 kernel: [51328.625114] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 19:39:14 juju-e4d256-prod-github-runner-207 kernel: [51328.626031] Aug 22 19:39:42 juju-e4d256-prod-github-runner-207 kernel: [51356.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 47721s! [qemu-system-x86:6715] Aug 22 19:39:42 juju-e4d256-prod-github-runner-207 kernel: [51356.543905] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 19:39:42 juju-e4d256-prod-github-runner-207 kernel: [51356.544225] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 19:39:42 juju-e4d256-prod-github-runner-207 kernel: [51356.556453] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 19:39:42 juju-e4d256-prod-github-runner-207 kernel: [51356.557730] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 19:39:42 juju-e4d256-prod-github-runner-207 kernel: [51356.558949] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:39:42 juju-e4d256-prod-github-runner-207 kernel: [51356.560009] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 19:39:42 juju-e4d256-prod-github-runner-207 kernel: [51356.562550] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 19:39:42 juju-e4d256-prod-github-runner-207 kernel: [51356.563595] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 19:39:42 juju-e4d256-prod-github-runner-207 kernel: [51356.564761] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 19:39:42 juju-e4d256-prod-github-runner-207 kernel: [51356.565949] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 19:39:42 juju-e4d256-prod-github-runner-207 kernel: [51356.567114] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 19:39:42 juju-e4d256-prod-github-runner-207 kernel: [51356.568375] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 19:39:42 juju-e4d256-prod-github-runner-207 kernel: [51356.569614] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 19:39:42 juju-e4d256-prod-github-runner-207 kernel: [51356.570875] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 19:39:42 juju-e4d256-prod-github-runner-207 kernel: [51356.571979] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 19:39:42 juju-e4d256-prod-github-runner-207 kernel: [51356.573191] Call Trace: Aug 22 19:39:42 juju-e4d256-prod-github-runner-207 kernel: [51356.574106] Aug 22 19:39:42 juju-e4d256-prod-github-runner-207 kernel: [51356.575019] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:39:42 juju-e4d256-prod-github-runner-207 kernel: [51356.576062] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:39:42 juju-e4d256-prod-github-runner-207 kernel: [51356.577101] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:39:42 juju-e4d256-prod-github-runner-207 kernel: [51356.578210] ? show_regs.part.0+0x23/0x29 Aug 22 19:39:42 juju-e4d256-prod-github-runner-207 kernel: [51356.579213] ? show_regs.cold+0x8/0xd Aug 22 19:39:42 juju-e4d256-prod-github-runner-207 kernel: [51356.580186] ? watchdog_timer_fn+0x1be/0x220 Aug 22 19:39:42 juju-e4d256-prod-github-runner-207 kernel: [51356.581210] ? lockup_detector_update_enable+0x60/0x60 Aug 22 19:39:42 juju-e4d256-prod-github-runner-207 kernel: [51356.582285] ? __hrtimer_run_queues+0x107/0x230 Aug 22 19:39:42 juju-e4d256-prod-github-runner-207 kernel: [51356.583314] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 19:39:42 juju-e4d256-prod-github-runner-207 kernel: [51356.584337] ? hrtimer_interrupt+0x101/0x220 Aug 22 19:39:42 juju-e4d256-prod-github-runner-207 kernel: [51356.585363] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 19:39:42 juju-e4d256-prod-github-runner-207 kernel: [51356.586437] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 19:39:42 juju-e4d256-prod-github-runner-207 kernel: [51356.587482] Aug 22 19:39:42 juju-e4d256-prod-github-runner-207 kernel: [51356.588333] Aug 22 19:39:42 juju-e4d256-prod-github-runner-207 kernel: [51356.589182] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 19:39:42 juju-e4d256-prod-github-runner-207 kernel: [51356.590219] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:39:42 juju-e4d256-prod-github-runner-207 kernel: [51356.591259] ? _raw_spin_lock+0x22/0x30 Aug 22 19:39:42 juju-e4d256-prod-github-runner-207 kernel: [51356.592209] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:39:42 juju-e4d256-prod-github-runner-207 kernel: [51356.593237] direct_page_fault+0x206/0x310 [kvm] Aug 22 19:39:42 juju-e4d256-prod-github-runner-207 kernel: [51356.594266] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 19:39:42 juju-e4d256-prod-github-runner-207 kernel: [51356.595357] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 19:39:42 juju-e4d256-prod-github-runner-207 kernel: [51356.596358] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 19:39:42 juju-e4d256-prod-github-runner-207 kernel: [51356.597373] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 19:39:42 juju-e4d256-prod-github-runner-207 kernel: [51356.598319] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 19:39:42 juju-e4d256-prod-github-runner-207 kernel: [51356.599296] handle_exit+0x98/0x230 [kvm_amd] Aug 22 19:39:42 juju-e4d256-prod-github-runner-207 kernel: [51356.600188] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 19:39:42 juju-e4d256-prod-github-runner-207 kernel: [51356.601113] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 19:39:42 juju-e4d256-prod-github-runner-207 kernel: [51356.602040] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 19:39:42 juju-e4d256-prod-github-runner-207 kernel: [51356.602977] vcpu_run+0x62/0x2c0 [kvm] Aug 22 19:39:42 juju-e4d256-prod-github-runner-207 kernel: [51356.603790] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 19:39:42 juju-e4d256-prod-github-runner-207 kernel: [51356.604623] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 19:39:42 juju-e4d256-prod-github-runner-207 kernel: [51356.605554] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 19:39:42 juju-e4d256-prod-github-runner-207 kernel: [51356.606358] ? __seccomp_filter+0x4a/0x4a0 Aug 22 19:39:42 juju-e4d256-prod-github-runner-207 kernel: [51356.607105] ? __fget_files+0x86/0xc0 Aug 22 19:39:42 juju-e4d256-prod-github-runner-207 kernel: [51356.607808] __x64_sys_ioctl+0x95/0xd0 Aug 22 19:39:42 juju-e4d256-prod-github-runner-207 kernel: [51356.608500] do_syscall_64+0x5c/0xc0 Aug 22 19:39:42 juju-e4d256-prod-github-runner-207 kernel: [51356.609176] ? do_futex+0x162/0x1f0 Aug 22 19:39:42 juju-e4d256-prod-github-runner-207 kernel: [51356.609827] ? __x64_sys_futex+0x78/0x1e0 Aug 22 19:39:42 juju-e4d256-prod-github-runner-207 kernel: [51356.610500] ? __secure_computing+0xa9/0x120 Aug 22 19:39:42 juju-e4d256-prod-github-runner-207 kernel: [51356.611189] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 19:39:42 juju-e4d256-prod-github-runner-207 kernel: [51356.611958] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:39:42 juju-e4d256-prod-github-runner-207 kernel: [51356.612677] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:39:42 juju-e4d256-prod-github-runner-207 kernel: [51356.613401] ? do_syscall_64+0x69/0xc0 Aug 22 19:39:42 juju-e4d256-prod-github-runner-207 kernel: [51356.614049] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:39:42 juju-e4d256-prod-github-runner-207 kernel: [51356.614753] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:39:42 juju-e4d256-prod-github-runner-207 kernel: [51356.615452] ? do_syscall_64+0x69/0xc0 Aug 22 19:39:42 juju-e4d256-prod-github-runner-207 kernel: [51356.616075] ? do_syscall_64+0x69/0xc0 Aug 22 19:39:42 juju-e4d256-prod-github-runner-207 kernel: [51356.616696] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 19:39:42 juju-e4d256-prod-github-runner-207 kernel: [51356.617412] RIP: 0033:0x7faa5d0edaff Aug 22 19:39:42 juju-e4d256-prod-github-runner-207 kernel: [51356.618062] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 19:39:42 juju-e4d256-prod-github-runner-207 kernel: [51356.620067] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 19:39:42 juju-e4d256-prod-github-runner-207 kernel: [51356.620981] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 19:39:42 juju-e4d256-prod-github-runner-207 kernel: [51356.621877] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 19:39:42 juju-e4d256-prod-github-runner-207 kernel: [51356.622766] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 19:39:42 juju-e4d256-prod-github-runner-207 kernel: [51356.623654] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 19:39:42 juju-e4d256-prod-github-runner-207 kernel: [51356.624559] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 19:39:42 juju-e4d256-prod-github-runner-207 kernel: [51356.625472] Aug 22 19:40:10 juju-e4d256-prod-github-runner-207 kernel: [51384.541976] watchdog: BUG: soft lockup - CPU#1 stuck for 47747s! [qemu-system-x86:6715] Aug 22 19:40:10 juju-e4d256-prod-github-runner-207 kernel: [51384.543098] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 19:40:10 juju-e4d256-prod-github-runner-207 kernel: [51384.543168] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 19:40:10 juju-e4d256-prod-github-runner-207 kernel: [51384.555504] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 19:40:10 juju-e4d256-prod-github-runner-207 kernel: [51384.556819] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 19:40:10 juju-e4d256-prod-github-runner-207 kernel: [51384.558077] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:40:10 juju-e4d256-prod-github-runner-207 kernel: [51384.559150] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 19:40:10 juju-e4d256-prod-github-runner-207 kernel: [51384.561760] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 19:40:10 juju-e4d256-prod-github-runner-207 kernel: [51384.562818] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 19:40:10 juju-e4d256-prod-github-runner-207 kernel: [51384.563999] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 19:40:10 juju-e4d256-prod-github-runner-207 kernel: [51384.565188] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 19:40:10 juju-e4d256-prod-github-runner-207 kernel: [51384.566354] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 19:40:10 juju-e4d256-prod-github-runner-207 kernel: [51384.567564] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 19:40:10 juju-e4d256-prod-github-runner-207 kernel: [51384.568751] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 19:40:10 juju-e4d256-prod-github-runner-207 kernel: [51384.569984] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 19:40:10 juju-e4d256-prod-github-runner-207 kernel: [51384.571082] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 19:40:10 juju-e4d256-prod-github-runner-207 kernel: [51384.572279] Call Trace: Aug 22 19:40:10 juju-e4d256-prod-github-runner-207 kernel: [51384.573202] Aug 22 19:40:10 juju-e4d256-prod-github-runner-207 kernel: [51384.574112] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:40:10 juju-e4d256-prod-github-runner-207 kernel: [51384.575155] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:40:10 juju-e4d256-prod-github-runner-207 kernel: [51384.576238] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:40:10 juju-e4d256-prod-github-runner-207 kernel: [51384.577336] ? show_regs.part.0+0x23/0x29 Aug 22 19:40:10 juju-e4d256-prod-github-runner-207 kernel: [51384.578333] ? show_regs.cold+0x8/0xd Aug 22 19:40:10 juju-e4d256-prod-github-runner-207 kernel: [51384.579304] ? watchdog_timer_fn+0x1be/0x220 Aug 22 19:40:10 juju-e4d256-prod-github-runner-207 kernel: [51384.580311] ? lockup_detector_update_enable+0x60/0x60 Aug 22 19:40:10 juju-e4d256-prod-github-runner-207 kernel: [51384.581383] ? __hrtimer_run_queues+0x107/0x230 Aug 22 19:40:10 juju-e4d256-prod-github-runner-207 kernel: [51384.582575] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 19:40:10 juju-e4d256-prod-github-runner-207 kernel: [51384.583603] ? hrtimer_interrupt+0x101/0x220 Aug 22 19:40:10 juju-e4d256-prod-github-runner-207 kernel: [51384.584642] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 19:40:10 juju-e4d256-prod-github-runner-207 kernel: [51384.585714] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 19:40:10 juju-e4d256-prod-github-runner-207 kernel: [51384.586763] Aug 22 19:40:10 juju-e4d256-prod-github-runner-207 kernel: [51384.587615] Aug 22 19:40:10 juju-e4d256-prod-github-runner-207 kernel: [51384.588451] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 19:40:10 juju-e4d256-prod-github-runner-207 kernel: [51384.589538] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:40:10 juju-e4d256-prod-github-runner-207 kernel: [51384.590673] ? _raw_spin_lock+0x22/0x30 Aug 22 19:40:10 juju-e4d256-prod-github-runner-207 kernel: [51384.591712] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:40:10 juju-e4d256-prod-github-runner-207 kernel: [51384.592765] direct_page_fault+0x206/0x310 [kvm] Aug 22 19:40:10 juju-e4d256-prod-github-runner-207 kernel: [51384.593795] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 19:40:10 juju-e4d256-prod-github-runner-207 kernel: [51384.594802] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 19:40:10 juju-e4d256-prod-github-runner-207 kernel: [51384.595806] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 19:40:10 juju-e4d256-prod-github-runner-207 kernel: [51384.596785] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 19:40:10 juju-e4d256-prod-github-runner-207 kernel: [51384.597729] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 19:40:10 juju-e4d256-prod-github-runner-207 kernel: [51384.598707] handle_exit+0x98/0x230 [kvm_amd] Aug 22 19:40:10 juju-e4d256-prod-github-runner-207 kernel: [51384.599597] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 19:40:10 juju-e4d256-prod-github-runner-207 kernel: [51384.600513] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 19:40:10 juju-e4d256-prod-github-runner-207 kernel: [51384.601443] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 19:40:10 juju-e4d256-prod-github-runner-207 kernel: [51384.602361] vcpu_run+0x62/0x2c0 [kvm] Aug 22 19:40:10 juju-e4d256-prod-github-runner-207 kernel: [51384.603171] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 19:40:10 juju-e4d256-prod-github-runner-207 kernel: [51384.603976] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 19:40:10 juju-e4d256-prod-github-runner-207 kernel: [51384.604850] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 19:40:10 juju-e4d256-prod-github-runner-207 kernel: [51384.605653] ? __seccomp_filter+0x4a/0x4a0 Aug 22 19:40:10 juju-e4d256-prod-github-runner-207 kernel: [51384.606401] ? __fget_files+0x86/0xc0 Aug 22 19:40:10 juju-e4d256-prod-github-runner-207 kernel: [51384.607106] __x64_sys_ioctl+0x95/0xd0 Aug 22 19:40:10 juju-e4d256-prod-github-runner-207 kernel: [51384.607800] do_syscall_64+0x5c/0xc0 Aug 22 19:40:10 juju-e4d256-prod-github-runner-207 kernel: [51384.608462] ? do_futex+0x162/0x1f0 Aug 22 19:40:10 juju-e4d256-prod-github-runner-207 kernel: [51384.609114] ? __x64_sys_futex+0x78/0x1e0 Aug 22 19:40:10 juju-e4d256-prod-github-runner-207 kernel: [51384.609784] ? __secure_computing+0xa9/0x120 Aug 22 19:40:10 juju-e4d256-prod-github-runner-207 kernel: [51384.610475] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 19:40:10 juju-e4d256-prod-github-runner-207 kernel: [51384.611231] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:40:10 juju-e4d256-prod-github-runner-207 kernel: [51384.611949] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:40:10 juju-e4d256-prod-github-runner-207 kernel: [51384.612687] ? do_syscall_64+0x69/0xc0 Aug 22 19:40:10 juju-e4d256-prod-github-runner-207 kernel: [51384.613335] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:40:10 juju-e4d256-prod-github-runner-207 kernel: [51384.614035] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:40:10 juju-e4d256-prod-github-runner-207 kernel: [51384.614727] ? do_syscall_64+0x69/0xc0 Aug 22 19:40:10 juju-e4d256-prod-github-runner-207 kernel: [51384.615349] ? do_syscall_64+0x69/0xc0 Aug 22 19:40:10 juju-e4d256-prod-github-runner-207 kernel: [51384.615983] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 19:40:10 juju-e4d256-prod-github-runner-207 kernel: [51384.616757] RIP: 0033:0x7faa5d0edaff Aug 22 19:40:10 juju-e4d256-prod-github-runner-207 kernel: [51384.617387] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 19:40:10 juju-e4d256-prod-github-runner-207 kernel: [51384.619375] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 19:40:10 juju-e4d256-prod-github-runner-207 kernel: [51384.620283] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 19:40:10 juju-e4d256-prod-github-runner-207 kernel: [51384.621193] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 19:40:10 juju-e4d256-prod-github-runner-207 kernel: [51384.622113] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 19:40:10 juju-e4d256-prod-github-runner-207 kernel: [51384.623003] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 19:40:10 juju-e4d256-prod-github-runner-207 kernel: [51384.623889] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 19:40:10 juju-e4d256-prod-github-runner-207 kernel: [51384.624790] Aug 22 19:40:38 juju-e4d256-prod-github-runner-207 kernel: [51412.542307] watchdog: BUG: soft lockup - CPU#1 stuck for 47773s! [qemu-system-x86:6715] Aug 22 19:40:38 juju-e4d256-prod-github-runner-207 kernel: [51412.545293] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 19:40:38 juju-e4d256-prod-github-runner-207 kernel: [51412.545368] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 19:40:38 juju-e4d256-prod-github-runner-207 kernel: [51412.572929] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 19:40:38 juju-e4d256-prod-github-runner-207 kernel: [51412.576402] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 19:40:38 juju-e4d256-prod-github-runner-207 kernel: [51412.577632] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:40:38 juju-e4d256-prod-github-runner-207 kernel: [51412.581023] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 19:40:38 juju-e4d256-prod-github-runner-207 kernel: [51412.585857] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 19:40:38 juju-e4d256-prod-github-runner-207 kernel: [51412.588017] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 19:40:38 juju-e4d256-prod-github-runner-207 kernel: [51412.590357] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 19:40:38 juju-e4d256-prod-github-runner-207 kernel: [51412.593777] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 19:40:38 juju-e4d256-prod-github-runner-207 kernel: [51412.594942] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 19:40:38 juju-e4d256-prod-github-runner-207 kernel: [51412.598445] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 19:40:38 juju-e4d256-prod-github-runner-207 kernel: [51412.599617] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 19:40:38 juju-e4d256-prod-github-runner-207 kernel: [51412.603214] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 19:40:38 juju-e4d256-prod-github-runner-207 kernel: [51412.606620] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 19:40:38 juju-e4d256-prod-github-runner-207 kernel: [51412.607818] Call Trace: Aug 22 19:40:38 juju-e4d256-prod-github-runner-207 kernel: [51412.608748] Aug 22 19:40:38 juju-e4d256-prod-github-runner-207 kernel: [51412.611887] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:40:38 juju-e4d256-prod-github-runner-207 kernel: [51412.612939] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:40:38 juju-e4d256-prod-github-runner-207 kernel: [51412.616339] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:40:38 juju-e4d256-prod-github-runner-207 kernel: [51412.617467] ? show_regs.part.0+0x23/0x29 Aug 22 19:40:38 juju-e4d256-prod-github-runner-207 kernel: [51412.620921] ? show_regs.cold+0x8/0xd Aug 22 19:40:38 juju-e4d256-prod-github-runner-207 kernel: [51412.621905] ? watchdog_timer_fn+0x1be/0x220 Aug 22 19:40:38 juju-e4d256-prod-github-runner-207 kernel: [51412.625161] ? lockup_detector_update_enable+0x60/0x60 Aug 22 19:40:38 juju-e4d256-prod-github-runner-207 kernel: [51412.626232] ? __hrtimer_run_queues+0x107/0x230 Aug 22 19:40:38 juju-e4d256-prod-github-runner-207 kernel: [51412.629579] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 19:40:38 juju-e4d256-prod-github-runner-207 kernel: [51412.630612] ? hrtimer_interrupt+0x101/0x220 Aug 22 19:40:38 juju-e4d256-prod-github-runner-207 kernel: [51412.633951] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 19:40:38 juju-e4d256-prod-github-runner-207 kernel: [51412.636786] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 19:40:38 juju-e4d256-prod-github-runner-207 kernel: [51412.638452] Aug 22 19:40:38 juju-e4d256-prod-github-runner-207 kernel: [51412.641814] Aug 22 19:40:38 juju-e4d256-prod-github-runner-207 kernel: [51412.642687] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 19:40:38 juju-e4d256-prod-github-runner-207 kernel: [51412.646067] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:40:38 juju-e4d256-prod-github-runner-207 kernel: [51412.647205] ? _raw_spin_lock+0x22/0x30 Aug 22 19:40:38 juju-e4d256-prod-github-runner-207 kernel: [51412.650443] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:40:38 juju-e4d256-prod-github-runner-207 kernel: [51412.651478] direct_page_fault+0x206/0x310 [kvm] Aug 22 19:40:38 juju-e4d256-prod-github-runner-207 kernel: [51412.654747] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 19:40:38 juju-e4d256-prod-github-runner-207 kernel: [51412.658181] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 19:40:38 juju-e4d256-prod-github-runner-207 kernel: [51412.659386] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 19:40:38 juju-e4d256-prod-github-runner-207 kernel: [51412.662713] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 19:40:38 juju-e4d256-prod-github-runner-207 kernel: [51412.664306] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 19:40:38 juju-e4d256-prod-github-runner-207 kernel: [51412.666997] handle_exit+0x98/0x230 [kvm_amd] Aug 22 19:40:38 juju-e4d256-prod-github-runner-207 kernel: [51412.667901] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 19:40:38 juju-e4d256-prod-github-runner-207 kernel: [51412.668918] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 19:40:38 juju-e4d256-prod-github-runner-207 kernel: [51412.669856] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 19:40:38 juju-e4d256-prod-github-runner-207 kernel: [51412.670758] vcpu_run+0x62/0x2c0 [kvm] Aug 22 19:40:38 juju-e4d256-prod-github-runner-207 kernel: [51412.671567] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 19:40:38 juju-e4d256-prod-github-runner-207 kernel: [51412.672393] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 19:40:38 juju-e4d256-prod-github-runner-207 kernel: [51412.673251] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 19:40:38 juju-e4d256-prod-github-runner-207 kernel: [51412.674051] ? __seccomp_filter+0x4a/0x4a0 Aug 22 19:40:38 juju-e4d256-prod-github-runner-207 kernel: [51412.674798] ? __fget_files+0x86/0xc0 Aug 22 19:40:38 juju-e4d256-prod-github-runner-207 kernel: [51412.675505] __x64_sys_ioctl+0x95/0xd0 Aug 22 19:40:38 juju-e4d256-prod-github-runner-207 kernel: [51412.676195] do_syscall_64+0x5c/0xc0 Aug 22 19:40:38 juju-e4d256-prod-github-runner-207 kernel: [51412.676894] ? do_futex+0x162/0x1f0 Aug 22 19:40:38 juju-e4d256-prod-github-runner-207 kernel: [51412.677541] ? __x64_sys_futex+0x78/0x1e0 Aug 22 19:40:38 juju-e4d256-prod-github-runner-207 kernel: [51412.678214] ? __secure_computing+0xa9/0x120 Aug 22 19:40:38 juju-e4d256-prod-github-runner-207 kernel: [51412.678903] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 19:40:38 juju-e4d256-prod-github-runner-207 kernel: [51412.679662] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:40:38 juju-e4d256-prod-github-runner-207 kernel: [51412.680396] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:40:38 juju-e4d256-prod-github-runner-207 kernel: [51412.681116] ? do_syscall_64+0x69/0xc0 Aug 22 19:40:38 juju-e4d256-prod-github-runner-207 kernel: [51412.681762] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:40:38 juju-e4d256-prod-github-runner-207 kernel: [51412.682465] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:40:38 juju-e4d256-prod-github-runner-207 kernel: [51412.683159] ? do_syscall_64+0x69/0xc0 Aug 22 19:40:38 juju-e4d256-prod-github-runner-207 kernel: [51412.683783] ? do_syscall_64+0x69/0xc0 Aug 22 19:40:38 juju-e4d256-prod-github-runner-207 kernel: [51412.684416] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 19:40:38 juju-e4d256-prod-github-runner-207 kernel: [51412.685125] RIP: 0033:0x7faa5d0edaff Aug 22 19:40:38 juju-e4d256-prod-github-runner-207 kernel: [51412.685749] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 19:40:38 juju-e4d256-prod-github-runner-207 kernel: [51412.687735] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 19:40:38 juju-e4d256-prod-github-runner-207 kernel: [51412.688656] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 19:40:38 juju-e4d256-prod-github-runner-207 kernel: [51412.689546] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 19:40:38 juju-e4d256-prod-github-runner-207 kernel: [51412.690434] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 19:40:38 juju-e4d256-prod-github-runner-207 kernel: [51412.691321] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 19:40:38 juju-e4d256-prod-github-runner-207 kernel: [51412.692213] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 19:40:38 juju-e4d256-prod-github-runner-207 kernel: [51412.693112] Aug 22 19:41:06 juju-e4d256-prod-github-runner-207 kernel: [51440.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 47799s! [qemu-system-x86:6715] Aug 22 19:41:06 juju-e4d256-prod-github-runner-207 kernel: [51440.543877] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 19:41:06 juju-e4d256-prod-github-runner-207 kernel: [51440.544187] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 19:41:06 juju-e4d256-prod-github-runner-207 kernel: [51440.556302] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 19:41:06 juju-e4d256-prod-github-runner-207 kernel: [51440.557573] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 19:41:06 juju-e4d256-prod-github-runner-207 kernel: [51440.558796] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:41:06 juju-e4d256-prod-github-runner-207 kernel: [51440.559849] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 19:41:06 juju-e4d256-prod-github-runner-207 kernel: [51440.562409] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 19:41:06 juju-e4d256-prod-github-runner-207 kernel: [51440.563454] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 19:41:06 juju-e4d256-prod-github-runner-207 kernel: [51440.564625] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 19:41:06 juju-e4d256-prod-github-runner-207 kernel: [51440.565786] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 19:41:06 juju-e4d256-prod-github-runner-207 kernel: [51440.566944] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 19:41:06 juju-e4d256-prod-github-runner-207 kernel: [51440.568125] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 19:41:06 juju-e4d256-prod-github-runner-207 kernel: [51440.569292] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 19:41:06 juju-e4d256-prod-github-runner-207 kernel: [51440.570523] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 19:41:06 juju-e4d256-prod-github-runner-207 kernel: [51440.571620] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 19:41:06 juju-e4d256-prod-github-runner-207 kernel: [51440.572849] Call Trace: Aug 22 19:41:06 juju-e4d256-prod-github-runner-207 kernel: [51440.573895] Aug 22 19:41:06 juju-e4d256-prod-github-runner-207 kernel: [51440.574812] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:41:06 juju-e4d256-prod-github-runner-207 kernel: [51440.575848] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:41:06 juju-e4d256-prod-github-runner-207 kernel: [51440.576882] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:41:06 juju-e4d256-prod-github-runner-207 kernel: [51440.577974] ? show_regs.part.0+0x23/0x29 Aug 22 19:41:06 juju-e4d256-prod-github-runner-207 kernel: [51440.578969] ? show_regs.cold+0x8/0xd Aug 22 19:41:06 juju-e4d256-prod-github-runner-207 kernel: [51440.579948] ? watchdog_timer_fn+0x1be/0x220 Aug 22 19:41:06 juju-e4d256-prod-github-runner-207 kernel: [51440.580955] ? lockup_detector_update_enable+0x60/0x60 Aug 22 19:41:06 juju-e4d256-prod-github-runner-207 kernel: [51440.582021] ? __hrtimer_run_queues+0x107/0x230 Aug 22 19:41:06 juju-e4d256-prod-github-runner-207 kernel: [51440.583047] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 19:41:06 juju-e4d256-prod-github-runner-207 kernel: [51440.584082] ? hrtimer_interrupt+0x101/0x220 Aug 22 19:41:06 juju-e4d256-prod-github-runner-207 kernel: [51440.585107] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 19:41:06 juju-e4d256-prod-github-runner-207 kernel: [51440.586178] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 19:41:06 juju-e4d256-prod-github-runner-207 kernel: [51440.587223] Aug 22 19:41:06 juju-e4d256-prod-github-runner-207 kernel: [51440.588099] Aug 22 19:41:06 juju-e4d256-prod-github-runner-207 kernel: [51440.588950] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 19:41:06 juju-e4d256-prod-github-runner-207 kernel: [51440.589989] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:41:06 juju-e4d256-prod-github-runner-207 kernel: [51440.591040] ? _raw_spin_lock+0x22/0x30 Aug 22 19:41:06 juju-e4d256-prod-github-runner-207 kernel: [51440.592001] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:41:06 juju-e4d256-prod-github-runner-207 kernel: [51440.593021] direct_page_fault+0x206/0x310 [kvm] Aug 22 19:41:06 juju-e4d256-prod-github-runner-207 kernel: [51440.594051] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 19:41:06 juju-e4d256-prod-github-runner-207 kernel: [51440.595061] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 19:41:06 juju-e4d256-prod-github-runner-207 kernel: [51440.596189] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 19:41:06 juju-e4d256-prod-github-runner-207 kernel: [51440.597294] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 19:41:06 juju-e4d256-prod-github-runner-207 kernel: [51440.598331] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 19:41:06 juju-e4d256-prod-github-runner-207 kernel: [51440.599423] handle_exit+0x98/0x230 [kvm_amd] Aug 22 19:41:06 juju-e4d256-prod-github-runner-207 kernel: [51440.600433] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 19:41:06 juju-e4d256-prod-github-runner-207 kernel: [51440.601439] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 19:41:06 juju-e4d256-prod-github-runner-207 kernel: [51440.602453] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 19:41:06 juju-e4d256-prod-github-runner-207 kernel: [51440.603445] vcpu_run+0x62/0x2c0 [kvm] Aug 22 19:41:06 juju-e4d256-prod-github-runner-207 kernel: [51440.604341] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 19:41:06 juju-e4d256-prod-github-runner-207 kernel: [51440.605232] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 19:41:06 juju-e4d256-prod-github-runner-207 kernel: [51440.606185] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 19:41:06 juju-e4d256-prod-github-runner-207 kernel: [51440.607069] ? __seccomp_filter+0x4a/0x4a0 Aug 22 19:41:06 juju-e4d256-prod-github-runner-207 kernel: [51440.607895] ? __fget_files+0x86/0xc0 Aug 22 19:41:06 juju-e4d256-prod-github-runner-207 kernel: [51440.608688] __x64_sys_ioctl+0x95/0xd0 Aug 22 19:41:06 juju-e4d256-prod-github-runner-207 kernel: [51440.609458] do_syscall_64+0x5c/0xc0 Aug 22 19:41:06 juju-e4d256-prod-github-runner-207 kernel: [51440.610199] ? do_futex+0x162/0x1f0 Aug 22 19:41:06 juju-e4d256-prod-github-runner-207 kernel: [51440.610931] ? __x64_sys_futex+0x78/0x1e0 Aug 22 19:41:06 juju-e4d256-prod-github-runner-207 kernel: [51440.611683] ? __secure_computing+0xa9/0x120 Aug 22 19:41:06 juju-e4d256-prod-github-runner-207 kernel: [51440.612463] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 19:41:06 juju-e4d256-prod-github-runner-207 kernel: [51440.613340] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:41:06 juju-e4d256-prod-github-runner-207 kernel: [51440.614162] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:41:06 juju-e4d256-prod-github-runner-207 kernel: [51440.614970] ? do_syscall_64+0x69/0xc0 Aug 22 19:41:06 juju-e4d256-prod-github-runner-207 kernel: [51440.615695] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:41:06 juju-e4d256-prod-github-runner-207 kernel: [51440.616500] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:41:06 juju-e4d256-prod-github-runner-207 kernel: [51440.617289] ? do_syscall_64+0x69/0xc0 Aug 22 19:41:06 juju-e4d256-prod-github-runner-207 kernel: [51440.617989] ? do_syscall_64+0x69/0xc0 Aug 22 19:41:06 juju-e4d256-prod-github-runner-207 kernel: [51440.618691] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 19:41:06 juju-e4d256-prod-github-runner-207 kernel: [51440.619497] RIP: 0033:0x7faa5d0edaff Aug 22 19:41:06 juju-e4d256-prod-github-runner-207 kernel: [51440.620259] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 19:41:06 juju-e4d256-prod-github-runner-207 kernel: [51440.622570] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 19:41:06 juju-e4d256-prod-github-runner-207 kernel: [51440.623658] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 19:41:06 juju-e4d256-prod-github-runner-207 kernel: [51440.624832] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 19:41:06 juju-e4d256-prod-github-runner-207 kernel: [51440.625847] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 19:41:06 juju-e4d256-prod-github-runner-207 kernel: [51440.626867] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 19:41:06 juju-e4d256-prod-github-runner-207 kernel: [51440.627889] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 19:41:06 juju-e4d256-prod-github-runner-207 kernel: [51440.628919] Aug 22 19:41:34 juju-e4d256-prod-github-runner-207 kernel: [51468.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 47825s! [qemu-system-x86:6715] Aug 22 19:41:34 juju-e4d256-prod-github-runner-207 kernel: [51468.543955] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 19:41:34 juju-e4d256-prod-github-runner-207 kernel: [51468.544256] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 19:41:34 juju-e4d256-prod-github-runner-207 kernel: [51468.557371] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 19:41:34 juju-e4d256-prod-github-runner-207 kernel: [51468.558703] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 19:41:34 juju-e4d256-prod-github-runner-207 kernel: [51468.559976] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:41:34 juju-e4d256-prod-github-runner-207 kernel: [51468.561109] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 19:41:34 juju-e4d256-prod-github-runner-207 kernel: [51468.563747] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 19:41:34 juju-e4d256-prod-github-runner-207 kernel: [51468.564812] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 19:41:34 juju-e4d256-prod-github-runner-207 kernel: [51468.566012] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 19:41:34 juju-e4d256-prod-github-runner-207 kernel: [51468.567211] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 19:41:34 juju-e4d256-prod-github-runner-207 kernel: [51468.568398] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 19:41:34 juju-e4d256-prod-github-runner-207 kernel: [51468.569579] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 19:41:34 juju-e4d256-prod-github-runner-207 kernel: [51468.570759] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 19:41:34 juju-e4d256-prod-github-runner-207 kernel: [51468.572056] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 19:41:34 juju-e4d256-prod-github-runner-207 kernel: [51468.573178] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 19:41:34 juju-e4d256-prod-github-runner-207 kernel: [51468.574389] Call Trace: Aug 22 19:41:34 juju-e4d256-prod-github-runner-207 kernel: [51468.575307] Aug 22 19:41:34 juju-e4d256-prod-github-runner-207 kernel: [51468.576227] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:41:34 juju-e4d256-prod-github-runner-207 kernel: [51468.577277] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:41:34 juju-e4d256-prod-github-runner-207 kernel: [51468.578337] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:41:34 juju-e4d256-prod-github-runner-207 kernel: [51468.579480] ? show_regs.part.0+0x23/0x29 Aug 22 19:41:34 juju-e4d256-prod-github-runner-207 kernel: [51468.580515] ? show_regs.cold+0x8/0xd Aug 22 19:41:34 juju-e4d256-prod-github-runner-207 kernel: [51468.581503] ? watchdog_timer_fn+0x1be/0x220 Aug 22 19:41:34 juju-e4d256-prod-github-runner-207 kernel: [51468.582526] ? lockup_detector_update_enable+0x60/0x60 Aug 22 19:41:34 juju-e4d256-prod-github-runner-207 kernel: [51468.583630] ? __hrtimer_run_queues+0x107/0x230 Aug 22 19:41:34 juju-e4d256-prod-github-runner-207 kernel: [51468.584676] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 19:41:34 juju-e4d256-prod-github-runner-207 kernel: [51468.585733] ? hrtimer_interrupt+0x101/0x220 Aug 22 19:41:34 juju-e4d256-prod-github-runner-207 kernel: [51468.586770] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 19:41:34 juju-e4d256-prod-github-runner-207 kernel: [51468.587883] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 19:41:34 juju-e4d256-prod-github-runner-207 kernel: [51468.588960] Aug 22 19:41:34 juju-e4d256-prod-github-runner-207 kernel: [51468.589911] Aug 22 19:41:34 juju-e4d256-prod-github-runner-207 kernel: [51468.590777] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 19:41:34 juju-e4d256-prod-github-runner-207 kernel: [51468.591852] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:41:34 juju-e4d256-prod-github-runner-207 kernel: [51468.592911] ? _raw_spin_lock+0x22/0x30 Aug 22 19:41:34 juju-e4d256-prod-github-runner-207 kernel: [51468.593870] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:41:34 juju-e4d256-prod-github-runner-207 kernel: [51468.594907] direct_page_fault+0x206/0x310 [kvm] Aug 22 19:41:34 juju-e4d256-prod-github-runner-207 kernel: [51468.595960] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 19:41:34 juju-e4d256-prod-github-runner-207 kernel: [51468.596993] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 19:41:34 juju-e4d256-prod-github-runner-207 kernel: [51468.598011] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 19:41:34 juju-e4d256-prod-github-runner-207 kernel: [51468.599043] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 19:41:34 juju-e4d256-prod-github-runner-207 kernel: [51468.600022] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 19:41:34 juju-e4d256-prod-github-runner-207 kernel: [51468.601024] handle_exit+0x98/0x230 [kvm_amd] Aug 22 19:41:34 juju-e4d256-prod-github-runner-207 kernel: [51468.601954] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 19:41:34 juju-e4d256-prod-github-runner-207 kernel: [51468.602888] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 19:41:34 juju-e4d256-prod-github-runner-207 kernel: [51468.603896] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 19:41:34 juju-e4d256-prod-github-runner-207 kernel: [51468.604818] vcpu_run+0x62/0x2c0 [kvm] Aug 22 19:41:34 juju-e4d256-prod-github-runner-207 kernel: [51468.605648] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 19:41:34 juju-e4d256-prod-github-runner-207 kernel: [51468.606468] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 19:41:34 juju-e4d256-prod-github-runner-207 kernel: [51468.607336] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 19:41:34 juju-e4d256-prod-github-runner-207 kernel: [51468.608189] ? __seccomp_filter+0x4a/0x4a0 Aug 22 19:41:34 juju-e4d256-prod-github-runner-207 kernel: [51468.608946] ? __fget_files+0x86/0xc0 Aug 22 19:41:34 juju-e4d256-prod-github-runner-207 kernel: [51468.609663] __x64_sys_ioctl+0x95/0xd0 Aug 22 19:41:34 juju-e4d256-prod-github-runner-207 kernel: [51468.610366] do_syscall_64+0x5c/0xc0 Aug 22 19:41:34 juju-e4d256-prod-github-runner-207 kernel: [51468.611040] ? do_futex+0x162/0x1f0 Aug 22 19:41:34 juju-e4d256-prod-github-runner-207 kernel: [51468.611714] ? __x64_sys_futex+0x78/0x1e0 Aug 22 19:41:34 juju-e4d256-prod-github-runner-207 kernel: [51468.612404] ? __secure_computing+0xa9/0x120 Aug 22 19:41:34 juju-e4d256-prod-github-runner-207 kernel: [51468.613106] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 19:41:34 juju-e4d256-prod-github-runner-207 kernel: [51468.613886] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:41:34 juju-e4d256-prod-github-runner-207 kernel: [51468.614644] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:41:34 juju-e4d256-prod-github-runner-207 kernel: [51468.615396] ? do_syscall_64+0x69/0xc0 Aug 22 19:41:34 juju-e4d256-prod-github-runner-207 kernel: [51468.616078] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:41:34 juju-e4d256-prod-github-runner-207 kernel: [51468.616809] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:41:34 juju-e4d256-prod-github-runner-207 kernel: [51468.617528] ? do_syscall_64+0x69/0xc0 Aug 22 19:41:34 juju-e4d256-prod-github-runner-207 kernel: [51468.618170] ? do_syscall_64+0x69/0xc0 Aug 22 19:41:34 juju-e4d256-prod-github-runner-207 kernel: [51468.618807] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 19:41:34 juju-e4d256-prod-github-runner-207 kernel: [51468.619530] RIP: 0033:0x7faa5d0edaff Aug 22 19:41:34 juju-e4d256-prod-github-runner-207 kernel: [51468.620228] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 19:41:34 juju-e4d256-prod-github-runner-207 kernel: [51468.622291] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 19:41:34 juju-e4d256-prod-github-runner-207 kernel: [51468.623226] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 19:41:34 juju-e4d256-prod-github-runner-207 kernel: [51468.624165] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 19:41:34 juju-e4d256-prod-github-runner-207 kernel: [51468.625087] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 19:41:34 juju-e4d256-prod-github-runner-207 kernel: [51468.626000] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 19:41:34 juju-e4d256-prod-github-runner-207 kernel: [51468.626913] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 19:41:34 juju-e4d256-prod-github-runner-207 kernel: [51468.627841] Aug 22 19:41:46 juju-e4d256-prod-github-runner-207 kernel: [51480.620708] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 19:41:46 juju-e4d256-prod-github-runner-207 kernel: [51480.622458] rcu: 1-....: (12800398 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=6188725 Aug 22 19:41:46 juju-e4d256-prod-github-runner-207 kernel: [51480.623600] (t=12840855 jiffies g=23269 q=48548) Aug 22 19:41:46 juju-e4d256-prod-github-runner-207 kernel: [51480.624387] NMI backtrace for cpu 1 Aug 22 19:41:46 juju-e4d256-prod-github-runner-207 kernel: [51480.625093] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 19:41:46 juju-e4d256-prod-github-runner-207 kernel: [51480.626193] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 19:41:46 juju-e4d256-prod-github-runner-207 kernel: [51480.627247] Call Trace: Aug 22 19:41:46 juju-e4d256-prod-github-runner-207 kernel: [51480.627947] Aug 22 19:41:46 juju-e4d256-prod-github-runner-207 kernel: [51480.628624] show_stack+0x52/0x5c Aug 22 19:41:46 juju-e4d256-prod-github-runner-207 kernel: [51480.629347] dump_stack_lvl+0x4a/0x63 Aug 22 19:41:46 juju-e4d256-prod-github-runner-207 kernel: [51480.630087] dump_stack+0x10/0x16 Aug 22 19:41:46 juju-e4d256-prod-github-runner-207 kernel: [51480.630801] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 19:41:46 juju-e4d256-prod-github-runner-207 kernel: [51480.631620] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 19:41:46 juju-e4d256-prod-github-runner-207 kernel: [51480.632396] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 19:41:46 juju-e4d256-prod-github-runner-207 kernel: [51480.633214] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 19:41:46 juju-e4d256-prod-github-runner-207 kernel: [51480.634031] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 19:41:46 juju-e4d256-prod-github-runner-207 kernel: [51480.634836] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 19:41:46 juju-e4d256-prod-github-runner-207 kernel: [51480.635612] print_cpu_stall.cold+0x2f/0xe2 Aug 22 19:41:46 juju-e4d256-prod-github-runner-207 kernel: [51480.636375] ? timekeeping_update+0xf7/0x150 Aug 22 19:41:46 juju-e4d256-prod-github-runner-207 kernel: [51480.637143] check_cpu_stall+0x109/0x270 Aug 22 19:41:46 juju-e4d256-prod-github-runner-207 kernel: [51480.637956] rcu_sched_clock_irq+0x9a/0x250 Aug 22 19:41:46 juju-e4d256-prod-github-runner-207 kernel: [51480.638718] update_process_times+0x94/0xd0 Aug 22 19:41:46 juju-e4d256-prod-github-runner-207 kernel: [51480.639528] tick_sched_handle+0x29/0x70 Aug 22 19:41:46 juju-e4d256-prod-github-runner-207 kernel: [51480.640279] tick_sched_timer+0x8c/0xc0 Aug 22 19:41:46 juju-e4d256-prod-github-runner-207 kernel: [51480.641071] ? tick_nohz_handler+0xb0/0xb0 Aug 22 19:41:46 juju-e4d256-prod-github-runner-207 kernel: [51480.641837] __hrtimer_run_queues+0x107/0x230 Aug 22 19:41:46 juju-e4d256-prod-github-runner-207 kernel: [51480.642622] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 19:41:46 juju-e4d256-prod-github-runner-207 kernel: [51480.643396] hrtimer_interrupt+0x101/0x220 Aug 22 19:41:46 juju-e4d256-prod-github-runner-207 kernel: [51480.644173] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 19:41:46 juju-e4d256-prod-github-runner-207 kernel: [51480.644982] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 19:41:46 juju-e4d256-prod-github-runner-207 kernel: [51480.645786] Aug 22 19:41:46 juju-e4d256-prod-github-runner-207 kernel: [51480.646419] Aug 22 19:41:46 juju-e4d256-prod-github-runner-207 kernel: [51480.647059] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 19:41:46 juju-e4d256-prod-github-runner-207 kernel: [51480.647888] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:41:46 juju-e4d256-prod-github-runner-207 kernel: [51480.648765] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 19:41:46 juju-e4d256-prod-github-runner-207 kernel: [51480.650966] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 19:41:46 juju-e4d256-prod-github-runner-207 kernel: [51480.651860] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 19:41:46 juju-e4d256-prod-github-runner-207 kernel: [51480.652850] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 19:41:46 juju-e4d256-prod-github-runner-207 kernel: [51480.653823] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 19:41:46 juju-e4d256-prod-github-runner-207 kernel: [51480.654782] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 19:41:46 juju-e4d256-prod-github-runner-207 kernel: [51480.655747] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 19:41:46 juju-e4d256-prod-github-runner-207 kernel: [51480.656871] ? _raw_spin_lock+0x22/0x30 Aug 22 19:41:46 juju-e4d256-prod-github-runner-207 kernel: [51480.657651] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:41:46 juju-e4d256-prod-github-runner-207 kernel: [51480.658507] direct_page_fault+0x206/0x310 [kvm] Aug 22 19:41:46 juju-e4d256-prod-github-runner-207 kernel: [51480.659353] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 19:41:46 juju-e4d256-prod-github-runner-207 kernel: [51480.660216] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 19:41:46 juju-e4d256-prod-github-runner-207 kernel: [51480.661046] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 19:41:46 juju-e4d256-prod-github-runner-207 kernel: [51480.661870] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 19:41:46 juju-e4d256-prod-github-runner-207 kernel: [51480.662656] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 19:41:46 juju-e4d256-prod-github-runner-207 kernel: [51480.663491] handle_exit+0x98/0x230 [kvm_amd] Aug 22 19:41:46 juju-e4d256-prod-github-runner-207 kernel: [51480.664241] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 19:41:46 juju-e4d256-prod-github-runner-207 kernel: [51480.665019] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 19:41:46 juju-e4d256-prod-github-runner-207 kernel: [51480.665818] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 19:41:46 juju-e4d256-prod-github-runner-207 kernel: [51480.666601] vcpu_run+0x62/0x2c0 [kvm] Aug 22 19:41:46 juju-e4d256-prod-github-runner-207 kernel: [51480.667331] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 19:41:46 juju-e4d256-prod-github-runner-207 kernel: [51480.668086] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 19:41:46 juju-e4d256-prod-github-runner-207 kernel: [51480.668898] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 19:41:46 juju-e4d256-prod-github-runner-207 kernel: [51480.669667] ? __seccomp_filter+0x4a/0x4a0 Aug 22 19:41:46 juju-e4d256-prod-github-runner-207 kernel: [51480.670386] ? __fget_files+0x86/0xc0 Aug 22 19:41:46 juju-e4d256-prod-github-runner-207 kernel: [51480.671077] __x64_sys_ioctl+0x95/0xd0 Aug 22 19:41:46 juju-e4d256-prod-github-runner-207 kernel: [51480.671791] do_syscall_64+0x5c/0xc0 Aug 22 19:41:46 juju-e4d256-prod-github-runner-207 kernel: [51480.672472] ? do_futex+0x162/0x1f0 Aug 22 19:41:46 juju-e4d256-prod-github-runner-207 kernel: [51480.673141] ? __x64_sys_futex+0x78/0x1e0 Aug 22 19:41:46 juju-e4d256-prod-github-runner-207 kernel: [51480.673842] ? __secure_computing+0xa9/0x120 Aug 22 19:41:46 juju-e4d256-prod-github-runner-207 kernel: [51480.674578] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 19:41:46 juju-e4d256-prod-github-runner-207 kernel: [51480.675368] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:41:46 juju-e4d256-prod-github-runner-207 kernel: [51480.676128] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:41:46 juju-e4d256-prod-github-runner-207 kernel: [51480.676876] ? do_syscall_64+0x69/0xc0 Aug 22 19:41:46 juju-e4d256-prod-github-runner-207 kernel: [51480.677561] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:41:46 juju-e4d256-prod-github-runner-207 kernel: [51480.678312] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:41:46 juju-e4d256-prod-github-runner-207 kernel: [51480.679066] ? do_syscall_64+0x69/0xc0 Aug 22 19:41:46 juju-e4d256-prod-github-runner-207 kernel: [51480.679769] ? do_syscall_64+0x69/0xc0 Aug 22 19:41:46 juju-e4d256-prod-github-runner-207 kernel: [51480.680454] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 19:41:46 juju-e4d256-prod-github-runner-207 kernel: [51480.681226] RIP: 0033:0x7faa5d0edaff Aug 22 19:41:46 juju-e4d256-prod-github-runner-207 kernel: [51480.681930] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 19:41:46 juju-e4d256-prod-github-runner-207 kernel: [51480.684061] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 19:41:46 juju-e4d256-prod-github-runner-207 kernel: [51480.685027] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 19:41:46 juju-e4d256-prod-github-runner-207 kernel: [51480.685970] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 19:41:46 juju-e4d256-prod-github-runner-207 kernel: [51480.686912] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 19:41:46 juju-e4d256-prod-github-runner-207 kernel: [51480.687865] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 19:41:46 juju-e4d256-prod-github-runner-207 kernel: [51480.688798] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 19:41:46 juju-e4d256-prod-github-runner-207 kernel: [51480.689713] Aug 22 19:42:14 juju-e4d256-prod-github-runner-207 kernel: [51508.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 47863s! [qemu-system-x86:6715] Aug 22 19:42:14 juju-e4d256-prod-github-runner-207 kernel: [51508.543137] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 19:42:14 juju-e4d256-prod-github-runner-207 kernel: [51508.543504] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 19:42:14 juju-e4d256-prod-github-runner-207 kernel: [51508.555658] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 19:42:14 juju-e4d256-prod-github-runner-207 kernel: [51508.556925] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 19:42:14 juju-e4d256-prod-github-runner-207 kernel: [51508.558143] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:42:14 juju-e4d256-prod-github-runner-207 kernel: [51508.559210] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 19:42:14 juju-e4d256-prod-github-runner-207 kernel: [51508.561758] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 19:42:14 juju-e4d256-prod-github-runner-207 kernel: [51508.562801] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 19:42:14 juju-e4d256-prod-github-runner-207 kernel: [51508.563972] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 19:42:14 juju-e4d256-prod-github-runner-207 kernel: [51508.565207] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 19:42:14 juju-e4d256-prod-github-runner-207 kernel: [51508.566364] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 19:42:14 juju-e4d256-prod-github-runner-207 kernel: [51508.567534] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 19:42:14 juju-e4d256-prod-github-runner-207 kernel: [51508.568697] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 19:42:14 juju-e4d256-prod-github-runner-207 kernel: [51508.570047] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 19:42:14 juju-e4d256-prod-github-runner-207 kernel: [51508.571157] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 19:42:14 juju-e4d256-prod-github-runner-207 kernel: [51508.572349] Call Trace: Aug 22 19:42:14 juju-e4d256-prod-github-runner-207 kernel: [51508.573264] Aug 22 19:42:14 juju-e4d256-prod-github-runner-207 kernel: [51508.574147] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:42:14 juju-e4d256-prod-github-runner-207 kernel: [51508.575199] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:42:14 juju-e4d256-prod-github-runner-207 kernel: [51508.576225] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:42:14 juju-e4d256-prod-github-runner-207 kernel: [51508.577303] ? show_regs.part.0+0x23/0x29 Aug 22 19:42:14 juju-e4d256-prod-github-runner-207 kernel: [51508.578316] ? show_regs.cold+0x8/0xd Aug 22 19:42:14 juju-e4d256-prod-github-runner-207 kernel: [51508.579306] ? watchdog_timer_fn+0x1be/0x220 Aug 22 19:42:14 juju-e4d256-prod-github-runner-207 kernel: [51508.580320] ? lockup_detector_update_enable+0x60/0x60 Aug 22 19:42:14 juju-e4d256-prod-github-runner-207 kernel: [51508.581383] ? __hrtimer_run_queues+0x107/0x230 Aug 22 19:42:14 juju-e4d256-prod-github-runner-207 kernel: [51508.582417] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 19:42:14 juju-e4d256-prod-github-runner-207 kernel: [51508.583449] ? hrtimer_interrupt+0x101/0x220 Aug 22 19:42:14 juju-e4d256-prod-github-runner-207 kernel: [51508.584463] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 19:42:14 juju-e4d256-prod-github-runner-207 kernel: [51508.585538] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 19:42:14 juju-e4d256-prod-github-runner-207 kernel: [51508.586585] Aug 22 19:42:14 juju-e4d256-prod-github-runner-207 kernel: [51508.587449] Aug 22 19:42:14 juju-e4d256-prod-github-runner-207 kernel: [51508.588289] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 19:42:14 juju-e4d256-prod-github-runner-207 kernel: [51508.589325] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:42:14 juju-e4d256-prod-github-runner-207 kernel: [51508.590363] ? _raw_spin_lock+0x22/0x30 Aug 22 19:42:14 juju-e4d256-prod-github-runner-207 kernel: [51508.591334] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:42:14 juju-e4d256-prod-github-runner-207 kernel: [51508.592359] direct_page_fault+0x206/0x310 [kvm] Aug 22 19:42:14 juju-e4d256-prod-github-runner-207 kernel: [51508.593393] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 19:42:14 juju-e4d256-prod-github-runner-207 kernel: [51508.594425] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 19:42:14 juju-e4d256-prod-github-runner-207 kernel: [51508.595454] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 19:42:14 juju-e4d256-prod-github-runner-207 kernel: [51508.596433] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 19:42:14 juju-e4d256-prod-github-runner-207 kernel: [51508.597381] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 19:42:14 juju-e4d256-prod-github-runner-207 kernel: [51508.598361] handle_exit+0x98/0x230 [kvm_amd] Aug 22 19:42:14 juju-e4d256-prod-github-runner-207 kernel: [51508.599269] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 19:42:14 juju-e4d256-prod-github-runner-207 kernel: [51508.600186] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 19:42:14 juju-e4d256-prod-github-runner-207 kernel: [51508.601114] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 19:42:14 juju-e4d256-prod-github-runner-207 kernel: [51508.602024] vcpu_run+0x62/0x2c0 [kvm] Aug 22 19:42:14 juju-e4d256-prod-github-runner-207 kernel: [51508.602837] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 19:42:14 juju-e4d256-prod-github-runner-207 kernel: [51508.603684] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 19:42:14 juju-e4d256-prod-github-runner-207 kernel: [51508.604551] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 19:42:14 juju-e4d256-prod-github-runner-207 kernel: [51508.605351] ? __seccomp_filter+0x4a/0x4a0 Aug 22 19:42:14 juju-e4d256-prod-github-runner-207 kernel: [51508.606095] ? __fget_files+0x86/0xc0 Aug 22 19:42:14 juju-e4d256-prod-github-runner-207 kernel: [51508.606801] __x64_sys_ioctl+0x95/0xd0 Aug 22 19:42:14 juju-e4d256-prod-github-runner-207 kernel: [51508.607525] do_syscall_64+0x5c/0xc0 Aug 22 19:42:14 juju-e4d256-prod-github-runner-207 kernel: [51508.608344] ? do_futex+0x162/0x1f0 Aug 22 19:42:14 juju-e4d256-prod-github-runner-207 kernel: [51508.609146] ? __x64_sys_futex+0x78/0x1e0 Aug 22 19:42:14 juju-e4d256-prod-github-runner-207 kernel: [51508.609819] ? __secure_computing+0xa9/0x120 Aug 22 19:42:14 juju-e4d256-prod-github-runner-207 kernel: [51508.610515] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 19:42:14 juju-e4d256-prod-github-runner-207 kernel: [51508.611292] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:42:14 juju-e4d256-prod-github-runner-207 kernel: [51508.612019] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:42:14 juju-e4d256-prod-github-runner-207 kernel: [51508.612736] ? do_syscall_64+0x69/0xc0 Aug 22 19:42:14 juju-e4d256-prod-github-runner-207 kernel: [51508.613387] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:42:14 juju-e4d256-prod-github-runner-207 kernel: [51508.614089] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:42:14 juju-e4d256-prod-github-runner-207 kernel: [51508.614783] ? do_syscall_64+0x69/0xc0 Aug 22 19:42:14 juju-e4d256-prod-github-runner-207 kernel: [51508.615417] ? do_syscall_64+0x69/0xc0 Aug 22 19:42:14 juju-e4d256-prod-github-runner-207 kernel: [51508.616039] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 19:42:14 juju-e4d256-prod-github-runner-207 kernel: [51508.616742] RIP: 0033:0x7faa5d0edaff Aug 22 19:42:14 juju-e4d256-prod-github-runner-207 kernel: [51508.617366] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 19:42:14 juju-e4d256-prod-github-runner-207 kernel: [51508.619353] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 19:42:14 juju-e4d256-prod-github-runner-207 kernel: [51508.620260] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 19:42:14 juju-e4d256-prod-github-runner-207 kernel: [51508.621147] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 19:42:14 juju-e4d256-prod-github-runner-207 kernel: [51508.622034] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 19:42:14 juju-e4d256-prod-github-runner-207 kernel: [51508.622920] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 19:42:14 juju-e4d256-prod-github-runner-207 kernel: [51508.623816] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 19:42:14 juju-e4d256-prod-github-runner-207 kernel: [51508.624705] Aug 22 19:42:42 juju-e4d256-prod-github-runner-207 kernel: [51536.541982] watchdog: BUG: soft lockup - CPU#1 stuck for 47889s! [qemu-system-x86:6715] Aug 22 19:42:42 juju-e4d256-prod-github-runner-207 kernel: [51536.543220] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 19:42:42 juju-e4d256-prod-github-runner-207 kernel: [51536.543299] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 19:42:42 juju-e4d256-prod-github-runner-207 kernel: [51536.556582] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 19:42:42 juju-e4d256-prod-github-runner-207 kernel: [51536.557877] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 19:42:42 juju-e4d256-prod-github-runner-207 kernel: [51536.559177] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:42:42 juju-e4d256-prod-github-runner-207 kernel: [51536.560592] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 19:42:42 juju-e4d256-prod-github-runner-207 kernel: [51536.564480] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 19:42:42 juju-e4d256-prod-github-runner-207 kernel: [51536.566010] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 19:42:42 juju-e4d256-prod-github-runner-207 kernel: [51536.567739] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 19:42:42 juju-e4d256-prod-github-runner-207 kernel: [51536.568926] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 19:42:42 juju-e4d256-prod-github-runner-207 kernel: [51536.570088] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 19:42:42 juju-e4d256-prod-github-runner-207 kernel: [51536.571268] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 19:42:42 juju-e4d256-prod-github-runner-207 kernel: [51536.572443] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 19:42:42 juju-e4d256-prod-github-runner-207 kernel: [51536.573685] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 19:42:42 juju-e4d256-prod-github-runner-207 kernel: [51536.574844] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 19:42:42 juju-e4d256-prod-github-runner-207 kernel: [51536.576065] Call Trace: Aug 22 19:42:42 juju-e4d256-prod-github-runner-207 kernel: [51536.576983] Aug 22 19:42:42 juju-e4d256-prod-github-runner-207 kernel: [51536.577874] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:42:42 juju-e4d256-prod-github-runner-207 kernel: [51536.578942] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:42:42 juju-e4d256-prod-github-runner-207 kernel: [51536.579973] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:42:42 juju-e4d256-prod-github-runner-207 kernel: [51536.581052] ? show_regs.part.0+0x23/0x29 Aug 22 19:42:42 juju-e4d256-prod-github-runner-207 kernel: [51536.582169] ? show_regs.cold+0x8/0xd Aug 22 19:42:42 juju-e4d256-prod-github-runner-207 kernel: [51536.583625] ? watchdog_timer_fn+0x1be/0x220 Aug 22 19:42:42 juju-e4d256-prod-github-runner-207 kernel: [51536.585116] ? lockup_detector_update_enable+0x60/0x60 Aug 22 19:42:42 juju-e4d256-prod-github-runner-207 kernel: [51536.586667] ? __hrtimer_run_queues+0x107/0x230 Aug 22 19:42:42 juju-e4d256-prod-github-runner-207 kernel: [51536.588257] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 19:42:42 juju-e4d256-prod-github-runner-207 kernel: [51536.589690] ? hrtimer_interrupt+0x101/0x220 Aug 22 19:42:42 juju-e4d256-prod-github-runner-207 kernel: [51536.591155] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 19:42:42 juju-e4d256-prod-github-runner-207 kernel: [51536.592386] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 19:42:42 juju-e4d256-prod-github-runner-207 kernel: [51536.593444] Aug 22 19:42:42 juju-e4d256-prod-github-runner-207 kernel: [51536.594307] Aug 22 19:42:42 juju-e4d256-prod-github-runner-207 kernel: [51536.595162] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 19:42:42 juju-e4d256-prod-github-runner-207 kernel: [51536.596203] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:42:42 juju-e4d256-prod-github-runner-207 kernel: [51536.597256] ? _raw_spin_lock+0x22/0x30 Aug 22 19:42:42 juju-e4d256-prod-github-runner-207 kernel: [51536.598214] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:42:42 juju-e4d256-prod-github-runner-207 kernel: [51536.599248] direct_page_fault+0x206/0x310 [kvm] Aug 22 19:42:42 juju-e4d256-prod-github-runner-207 kernel: [51536.600359] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 19:42:42 juju-e4d256-prod-github-runner-207 kernel: [51536.601379] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 19:42:42 juju-e4d256-prod-github-runner-207 kernel: [51536.602437] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 19:42:42 juju-e4d256-prod-github-runner-207 kernel: [51536.603527] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 19:42:42 juju-e4d256-prod-github-runner-207 kernel: [51536.604484] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 19:42:42 juju-e4d256-prod-github-runner-207 kernel: [51536.605501] handle_exit+0x98/0x230 [kvm_amd] Aug 22 19:42:42 juju-e4d256-prod-github-runner-207 kernel: [51536.606418] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 19:42:42 juju-e4d256-prod-github-runner-207 kernel: [51536.607351] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 19:42:42 juju-e4d256-prod-github-runner-207 kernel: [51536.608284] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 19:42:42 juju-e4d256-prod-github-runner-207 kernel: [51536.609199] vcpu_run+0x62/0x2c0 [kvm] Aug 22 19:42:42 juju-e4d256-prod-github-runner-207 kernel: [51536.610025] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 19:42:42 juju-e4d256-prod-github-runner-207 kernel: [51536.610852] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 19:42:42 juju-e4d256-prod-github-runner-207 kernel: [51536.611734] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 19:42:42 juju-e4d256-prod-github-runner-207 kernel: [51536.612613] ? __seccomp_filter+0x4a/0x4a0 Aug 22 19:42:42 juju-e4d256-prod-github-runner-207 kernel: [51536.613669] ? __fget_files+0x86/0xc0 Aug 22 19:42:42 juju-e4d256-prod-github-runner-207 kernel: [51536.614721] __x64_sys_ioctl+0x95/0xd0 Aug 22 19:42:42 juju-e4d256-prod-github-runner-207 kernel: [51536.615785] do_syscall_64+0x5c/0xc0 Aug 22 19:42:42 juju-e4d256-prod-github-runner-207 kernel: [51536.616795] ? do_futex+0x162/0x1f0 Aug 22 19:42:42 juju-e4d256-prod-github-runner-207 kernel: [51536.617750] ? __x64_sys_futex+0x78/0x1e0 Aug 22 19:42:42 juju-e4d256-prod-github-runner-207 kernel: [51536.618798] ? __secure_computing+0xa9/0x120 Aug 22 19:42:42 juju-e4d256-prod-github-runner-207 kernel: [51536.619840] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 19:42:42 juju-e4d256-prod-github-runner-207 kernel: [51536.620986] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:42:42 juju-e4d256-prod-github-runner-207 kernel: [51536.621929] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:42:42 juju-e4d256-prod-github-runner-207 kernel: [51536.622660] ? do_syscall_64+0x69/0xc0 Aug 22 19:42:42 juju-e4d256-prod-github-runner-207 kernel: [51536.623335] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:42:42 juju-e4d256-prod-github-runner-207 kernel: [51536.624049] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:42:42 juju-e4d256-prod-github-runner-207 kernel: [51536.624753] ? do_syscall_64+0x69/0xc0 Aug 22 19:42:42 juju-e4d256-prod-github-runner-207 kernel: [51536.625386] ? do_syscall_64+0x69/0xc0 Aug 22 19:42:42 juju-e4d256-prod-github-runner-207 kernel: [51536.626021] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 19:42:42 juju-e4d256-prod-github-runner-207 kernel: [51536.626737] RIP: 0033:0x7faa5d0edaff Aug 22 19:42:42 juju-e4d256-prod-github-runner-207 kernel: [51536.627380] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 19:42:42 juju-e4d256-prod-github-runner-207 kernel: [51536.629497] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 19:42:42 juju-e4d256-prod-github-runner-207 kernel: [51536.630466] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 19:42:42 juju-e4d256-prod-github-runner-207 kernel: [51536.631392] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 19:42:42 juju-e4d256-prod-github-runner-207 kernel: [51536.632291] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 19:42:42 juju-e4d256-prod-github-runner-207 kernel: [51536.633196] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 19:42:42 juju-e4d256-prod-github-runner-207 kernel: [51536.634097] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 19:42:42 juju-e4d256-prod-github-runner-207 kernel: [51536.635013] Aug 22 19:43:10 juju-e4d256-prod-github-runner-207 kernel: [51564.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 47915s! [qemu-system-x86:6715] Aug 22 19:43:10 juju-e4d256-prod-github-runner-207 kernel: [51564.543755] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 19:43:10 juju-e4d256-prod-github-runner-207 kernel: [51564.544005] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 19:43:10 juju-e4d256-prod-github-runner-207 kernel: [51564.556281] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 19:43:10 juju-e4d256-prod-github-runner-207 kernel: [51564.557544] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 19:43:10 juju-e4d256-prod-github-runner-207 kernel: [51564.558783] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:43:10 juju-e4d256-prod-github-runner-207 kernel: [51564.559846] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 19:43:10 juju-e4d256-prod-github-runner-207 kernel: [51564.562409] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 19:43:10 juju-e4d256-prod-github-runner-207 kernel: [51564.563453] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 19:43:10 juju-e4d256-prod-github-runner-207 kernel: [51564.564624] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 19:43:10 juju-e4d256-prod-github-runner-207 kernel: [51564.565803] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 19:43:10 juju-e4d256-prod-github-runner-207 kernel: [51564.566996] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 19:43:10 juju-e4d256-prod-github-runner-207 kernel: [51564.568186] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 19:43:10 juju-e4d256-prod-github-runner-207 kernel: [51564.569352] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 19:43:10 juju-e4d256-prod-github-runner-207 kernel: [51564.570808] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 19:43:10 juju-e4d256-prod-github-runner-207 kernel: [51564.571919] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 19:43:10 juju-e4d256-prod-github-runner-207 kernel: [51564.573320] Call Trace: Aug 22 19:43:10 juju-e4d256-prod-github-runner-207 kernel: [51564.574240] Aug 22 19:43:10 juju-e4d256-prod-github-runner-207 kernel: [51564.576088] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:43:10 juju-e4d256-prod-github-runner-207 kernel: [51564.577216] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:43:10 juju-e4d256-prod-github-runner-207 kernel: [51564.578429] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:43:10 juju-e4d256-prod-github-runner-207 kernel: [51564.579535] ? show_regs.part.0+0x23/0x29 Aug 22 19:43:10 juju-e4d256-prod-github-runner-207 kernel: [51564.580535] ? show_regs.cold+0x8/0xd Aug 22 19:43:10 juju-e4d256-prod-github-runner-207 kernel: [51564.581506] ? watchdog_timer_fn+0x1be/0x220 Aug 22 19:43:10 juju-e4d256-prod-github-runner-207 kernel: [51564.582587] ? lockup_detector_update_enable+0x60/0x60 Aug 22 19:43:10 juju-e4d256-prod-github-runner-207 kernel: [51564.583851] ? __hrtimer_run_queues+0x107/0x230 Aug 22 19:43:10 juju-e4d256-prod-github-runner-207 kernel: [51564.584881] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 19:43:10 juju-e4d256-prod-github-runner-207 kernel: [51564.585904] ? hrtimer_interrupt+0x101/0x220 Aug 22 19:43:10 juju-e4d256-prod-github-runner-207 kernel: [51564.586949] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 19:43:10 juju-e4d256-prod-github-runner-207 kernel: [51564.588025] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 19:43:10 juju-e4d256-prod-github-runner-207 kernel: [51564.589071] Aug 22 19:43:10 juju-e4d256-prod-github-runner-207 kernel: [51564.589925] Aug 22 19:43:10 juju-e4d256-prod-github-runner-207 kernel: [51564.590846] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 19:43:10 juju-e4d256-prod-github-runner-207 kernel: [51564.591881] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:43:10 juju-e4d256-prod-github-runner-207 kernel: [51564.592921] ? _raw_spin_lock+0x22/0x30 Aug 22 19:43:10 juju-e4d256-prod-github-runner-207 kernel: [51564.593863] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:43:10 juju-e4d256-prod-github-runner-207 kernel: [51564.594911] direct_page_fault+0x206/0x310 [kvm] Aug 22 19:43:10 juju-e4d256-prod-github-runner-207 kernel: [51564.595942] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 19:43:10 juju-e4d256-prod-github-runner-207 kernel: [51564.596952] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 19:43:10 juju-e4d256-prod-github-runner-207 kernel: [51564.597956] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 19:43:10 juju-e4d256-prod-github-runner-207 kernel: [51564.598976] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 19:43:10 juju-e4d256-prod-github-runner-207 kernel: [51564.599921] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 19:43:10 juju-e4d256-prod-github-runner-207 kernel: [51564.600896] handle_exit+0x98/0x230 [kvm_amd] Aug 22 19:43:10 juju-e4d256-prod-github-runner-207 kernel: [51564.601788] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 19:43:10 juju-e4d256-prod-github-runner-207 kernel: [51564.602717] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 19:43:10 juju-e4d256-prod-github-runner-207 kernel: [51564.603641] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 19:43:10 juju-e4d256-prod-github-runner-207 kernel: [51564.604698] vcpu_run+0x62/0x2c0 [kvm] Aug 22 19:43:10 juju-e4d256-prod-github-runner-207 kernel: [51564.605506] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 19:43:10 juju-e4d256-prod-github-runner-207 kernel: [51564.606311] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 19:43:10 juju-e4d256-prod-github-runner-207 kernel: [51564.607170] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 19:43:10 juju-e4d256-prod-github-runner-207 kernel: [51564.607970] ? __seccomp_filter+0x4a/0x4a0 Aug 22 19:43:10 juju-e4d256-prod-github-runner-207 kernel: [51564.608709] ? __fget_files+0x86/0xc0 Aug 22 19:43:10 juju-e4d256-prod-github-runner-207 kernel: [51564.609411] __x64_sys_ioctl+0x95/0xd0 Aug 22 19:43:10 juju-e4d256-prod-github-runner-207 kernel: [51564.610109] do_syscall_64+0x5c/0xc0 Aug 22 19:43:10 juju-e4d256-prod-github-runner-207 kernel: [51564.610781] ? do_futex+0x162/0x1f0 Aug 22 19:43:10 juju-e4d256-prod-github-runner-207 kernel: [51564.611560] ? __x64_sys_futex+0x78/0x1e0 Aug 22 19:43:10 juju-e4d256-prod-github-runner-207 kernel: [51564.612350] ? __secure_computing+0xa9/0x120 Aug 22 19:43:10 juju-e4d256-prod-github-runner-207 kernel: [51564.613049] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 19:43:10 juju-e4d256-prod-github-runner-207 kernel: [51564.613810] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:43:10 juju-e4d256-prod-github-runner-207 kernel: [51564.614561] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:43:10 juju-e4d256-prod-github-runner-207 kernel: [51564.615429] ? do_syscall_64+0x69/0xc0 Aug 22 19:43:10 juju-e4d256-prod-github-runner-207 kernel: [51564.616079] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:43:10 juju-e4d256-prod-github-runner-207 kernel: [51564.616780] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:43:10 juju-e4d256-prod-github-runner-207 kernel: [51564.617481] ? do_syscall_64+0x69/0xc0 Aug 22 19:43:10 juju-e4d256-prod-github-runner-207 kernel: [51564.618105] ? do_syscall_64+0x69/0xc0 Aug 22 19:43:10 juju-e4d256-prod-github-runner-207 kernel: [51564.618761] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 19:43:10 juju-e4d256-prod-github-runner-207 kernel: [51564.619467] RIP: 0033:0x7faa5d0edaff Aug 22 19:43:10 juju-e4d256-prod-github-runner-207 kernel: [51564.620115] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 19:43:10 juju-e4d256-prod-github-runner-207 kernel: [51564.622105] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 19:43:10 juju-e4d256-prod-github-runner-207 kernel: [51564.623042] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 19:43:10 juju-e4d256-prod-github-runner-207 kernel: [51564.623931] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 19:43:10 juju-e4d256-prod-github-runner-207 kernel: [51564.624817] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 19:43:10 juju-e4d256-prod-github-runner-207 kernel: [51564.625702] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 19:43:10 juju-e4d256-prod-github-runner-207 kernel: [51564.626623] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 19:43:10 juju-e4d256-prod-github-runner-207 kernel: [51564.627517] Aug 22 19:43:38 juju-e4d256-prod-github-runner-207 kernel: [51592.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 47941s! [qemu-system-x86:6715] Aug 22 19:43:38 juju-e4d256-prod-github-runner-207 kernel: [51592.544222] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 19:43:38 juju-e4d256-prod-github-runner-207 kernel: [51592.544469] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 19:43:38 juju-e4d256-prod-github-runner-207 kernel: [51592.556649] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 19:43:38 juju-e4d256-prod-github-runner-207 kernel: [51592.557912] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 19:43:38 juju-e4d256-prod-github-runner-207 kernel: [51592.559235] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:43:38 juju-e4d256-prod-github-runner-207 kernel: [51592.560328] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 19:43:38 juju-e4d256-prod-github-runner-207 kernel: [51592.562894] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 19:43:38 juju-e4d256-prod-github-runner-207 kernel: [51592.563958] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 19:43:38 juju-e4d256-prod-github-runner-207 kernel: [51592.565140] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 19:43:38 juju-e4d256-prod-github-runner-207 kernel: [51592.566340] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 19:43:38 juju-e4d256-prod-github-runner-207 kernel: [51592.567523] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 19:43:38 juju-e4d256-prod-github-runner-207 kernel: [51592.568696] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 19:43:38 juju-e4d256-prod-github-runner-207 kernel: [51592.569892] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 19:43:38 juju-e4d256-prod-github-runner-207 kernel: [51592.571195] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 19:43:38 juju-e4d256-prod-github-runner-207 kernel: [51592.572425] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 19:43:38 juju-e4d256-prod-github-runner-207 kernel: [51592.573628] Call Trace: Aug 22 19:43:38 juju-e4d256-prod-github-runner-207 kernel: [51592.574600] Aug 22 19:43:38 juju-e4d256-prod-github-runner-207 kernel: [51592.575513] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:43:38 juju-e4d256-prod-github-runner-207 kernel: [51592.576553] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:43:38 juju-e4d256-prod-github-runner-207 kernel: [51592.577575] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:43:38 juju-e4d256-prod-github-runner-207 kernel: [51592.578679] ? show_regs.part.0+0x23/0x29 Aug 22 19:43:38 juju-e4d256-prod-github-runner-207 kernel: [51592.579702] ? show_regs.cold+0x8/0xd Aug 22 19:43:38 juju-e4d256-prod-github-runner-207 kernel: [51592.580755] ? watchdog_timer_fn+0x1be/0x220 Aug 22 19:43:38 juju-e4d256-prod-github-runner-207 kernel: [51592.581839] ? lockup_detector_update_enable+0x60/0x60 Aug 22 19:43:38 juju-e4d256-prod-github-runner-207 kernel: [51592.583002] ? __hrtimer_run_queues+0x107/0x230 Aug 22 19:43:38 juju-e4d256-prod-github-runner-207 kernel: [51592.584071] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 19:43:38 juju-e4d256-prod-github-runner-207 kernel: [51592.585112] ? hrtimer_interrupt+0x101/0x220 Aug 22 19:43:38 juju-e4d256-prod-github-runner-207 kernel: [51592.586156] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 19:43:38 juju-e4d256-prod-github-runner-207 kernel: [51592.587229] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 19:43:38 juju-e4d256-prod-github-runner-207 kernel: [51592.588276] Aug 22 19:43:38 juju-e4d256-prod-github-runner-207 kernel: [51592.589151] Aug 22 19:43:38 juju-e4d256-prod-github-runner-207 kernel: [51592.590020] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 19:43:38 juju-e4d256-prod-github-runner-207 kernel: [51592.591076] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:43:38 juju-e4d256-prod-github-runner-207 kernel: [51592.592116] ? _raw_spin_lock+0x22/0x30 Aug 22 19:43:38 juju-e4d256-prod-github-runner-207 kernel: [51592.593070] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:43:38 juju-e4d256-prod-github-runner-207 kernel: [51592.594118] direct_page_fault+0x206/0x310 [kvm] Aug 22 19:43:38 juju-e4d256-prod-github-runner-207 kernel: [51592.595156] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 19:43:38 juju-e4d256-prod-github-runner-207 kernel: [51592.596179] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 19:43:38 juju-e4d256-prod-github-runner-207 kernel: [51592.597184] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 19:43:38 juju-e4d256-prod-github-runner-207 kernel: [51592.598276] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 19:43:38 juju-e4d256-prod-github-runner-207 kernel: [51592.599229] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 19:43:38 juju-e4d256-prod-github-runner-207 kernel: [51592.600225] handle_exit+0x98/0x230 [kvm_amd] Aug 22 19:43:38 juju-e4d256-prod-github-runner-207 kernel: [51592.601141] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 19:43:38 juju-e4d256-prod-github-runner-207 kernel: [51592.602101] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 19:43:38 juju-e4d256-prod-github-runner-207 kernel: [51592.603115] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 19:43:38 juju-e4d256-prod-github-runner-207 kernel: [51592.604113] vcpu_run+0x62/0x2c0 [kvm] Aug 22 19:43:38 juju-e4d256-prod-github-runner-207 kernel: [51592.604944] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 19:43:38 juju-e4d256-prod-github-runner-207 kernel: [51592.605771] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 19:43:38 juju-e4d256-prod-github-runner-207 kernel: [51592.606642] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 19:43:38 juju-e4d256-prod-github-runner-207 kernel: [51592.607476] ? __seccomp_filter+0x4a/0x4a0 Aug 22 19:43:38 juju-e4d256-prod-github-runner-207 kernel: [51592.608222] ? __fget_files+0x86/0xc0 Aug 22 19:43:38 juju-e4d256-prod-github-runner-207 kernel: [51592.608926] __x64_sys_ioctl+0x95/0xd0 Aug 22 19:43:38 juju-e4d256-prod-github-runner-207 kernel: [51592.609623] do_syscall_64+0x5c/0xc0 Aug 22 19:43:38 juju-e4d256-prod-github-runner-207 kernel: [51592.610319] ? do_futex+0x162/0x1f0 Aug 22 19:43:38 juju-e4d256-prod-github-runner-207 kernel: [51592.610980] ? __x64_sys_futex+0x78/0x1e0 Aug 22 19:43:38 juju-e4d256-prod-github-runner-207 kernel: [51592.611656] ? __secure_computing+0xa9/0x120 Aug 22 19:43:38 juju-e4d256-prod-github-runner-207 kernel: [51592.612350] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 19:43:38 juju-e4d256-prod-github-runner-207 kernel: [51592.613112] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:43:38 juju-e4d256-prod-github-runner-207 kernel: [51592.613834] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:43:38 juju-e4d256-prod-github-runner-207 kernel: [51592.614636] ? do_syscall_64+0x69/0xc0 Aug 22 19:43:38 juju-e4d256-prod-github-runner-207 kernel: [51592.615302] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:43:38 juju-e4d256-prod-github-runner-207 kernel: [51592.616008] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:43:38 juju-e4d256-prod-github-runner-207 kernel: [51592.616715] ? do_syscall_64+0x69/0xc0 Aug 22 19:43:38 juju-e4d256-prod-github-runner-207 kernel: [51592.617347] ? do_syscall_64+0x69/0xc0 Aug 22 19:43:38 juju-e4d256-prod-github-runner-207 kernel: [51592.617977] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 19:43:38 juju-e4d256-prod-github-runner-207 kernel: [51592.618700] RIP: 0033:0x7faa5d0edaff Aug 22 19:43:38 juju-e4d256-prod-github-runner-207 kernel: [51592.619745] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 19:43:38 juju-e4d256-prod-github-runner-207 kernel: [51592.621761] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 19:43:38 juju-e4d256-prod-github-runner-207 kernel: [51592.622694] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 19:43:38 juju-e4d256-prod-github-runner-207 kernel: [51592.623582] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 19:43:38 juju-e4d256-prod-github-runner-207 kernel: [51592.624474] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 19:43:38 juju-e4d256-prod-github-runner-207 kernel: [51592.625370] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 19:43:38 juju-e4d256-prod-github-runner-207 kernel: [51592.626278] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 19:43:38 juju-e4d256-prod-github-runner-207 kernel: [51592.627266] Aug 22 19:44:06 juju-e4d256-prod-github-runner-207 kernel: [51620.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 47967s! [qemu-system-x86:6715] Aug 22 19:44:06 juju-e4d256-prod-github-runner-207 kernel: [51620.543917] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 19:44:06 juju-e4d256-prod-github-runner-207 kernel: [51620.544145] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 19:44:06 juju-e4d256-prod-github-runner-207 kernel: [51620.556189] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 19:44:06 juju-e4d256-prod-github-runner-207 kernel: [51620.557469] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 19:44:06 juju-e4d256-prod-github-runner-207 kernel: [51620.558706] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:44:06 juju-e4d256-prod-github-runner-207 kernel: [51620.559762] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 19:44:06 juju-e4d256-prod-github-runner-207 kernel: [51620.562467] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 19:44:06 juju-e4d256-prod-github-runner-207 kernel: [51620.563671] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 19:44:06 juju-e4d256-prod-github-runner-207 kernel: [51620.564881] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 19:44:06 juju-e4d256-prod-github-runner-207 kernel: [51620.566078] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 19:44:06 juju-e4d256-prod-github-runner-207 kernel: [51620.567242] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 19:44:06 juju-e4d256-prod-github-runner-207 kernel: [51620.568402] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 19:44:06 juju-e4d256-prod-github-runner-207 kernel: [51620.569571] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 19:44:06 juju-e4d256-prod-github-runner-207 kernel: [51620.570818] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 19:44:06 juju-e4d256-prod-github-runner-207 kernel: [51620.571930] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 19:44:06 juju-e4d256-prod-github-runner-207 kernel: [51620.573185] Call Trace: Aug 22 19:44:06 juju-e4d256-prod-github-runner-207 kernel: [51620.574132] Aug 22 19:44:06 juju-e4d256-prod-github-runner-207 kernel: [51620.575137] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:44:06 juju-e4d256-prod-github-runner-207 kernel: [51620.576173] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:44:06 juju-e4d256-prod-github-runner-207 kernel: [51620.577230] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:44:06 juju-e4d256-prod-github-runner-207 kernel: [51620.578353] ? show_regs.part.0+0x23/0x29 Aug 22 19:44:06 juju-e4d256-prod-github-runner-207 kernel: [51620.579351] ? show_regs.cold+0x8/0xd Aug 22 19:44:06 juju-e4d256-prod-github-runner-207 kernel: [51620.580420] ? watchdog_timer_fn+0x1be/0x220 Aug 22 19:44:06 juju-e4d256-prod-github-runner-207 kernel: [51620.581535] ? lockup_detector_update_enable+0x60/0x60 Aug 22 19:44:06 juju-e4d256-prod-github-runner-207 kernel: [51620.582701] ? __hrtimer_run_queues+0x107/0x230 Aug 22 19:44:06 juju-e4d256-prod-github-runner-207 kernel: [51620.583839] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 19:44:06 juju-e4d256-prod-github-runner-207 kernel: [51620.584991] ? hrtimer_interrupt+0x101/0x220 Aug 22 19:44:06 juju-e4d256-prod-github-runner-207 kernel: [51620.586148] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 19:44:06 juju-e4d256-prod-github-runner-207 kernel: [51620.587253] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 19:44:06 juju-e4d256-prod-github-runner-207 kernel: [51620.588305] Aug 22 19:44:06 juju-e4d256-prod-github-runner-207 kernel: [51620.589167] Aug 22 19:44:06 juju-e4d256-prod-github-runner-207 kernel: [51620.590024] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 19:44:06 juju-e4d256-prod-github-runner-207 kernel: [51620.591063] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:44:06 juju-e4d256-prod-github-runner-207 kernel: [51620.592169] ? _raw_spin_lock+0x22/0x30 Aug 22 19:44:06 juju-e4d256-prod-github-runner-207 kernel: [51620.593386] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:44:06 juju-e4d256-prod-github-runner-207 kernel: [51620.594467] direct_page_fault+0x206/0x310 [kvm] Aug 22 19:44:06 juju-e4d256-prod-github-runner-207 kernel: [51620.595506] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 19:44:06 juju-e4d256-prod-github-runner-207 kernel: [51620.596536] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 19:44:06 juju-e4d256-prod-github-runner-207 kernel: [51620.597564] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 19:44:06 juju-e4d256-prod-github-runner-207 kernel: [51620.598641] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 19:44:06 juju-e4d256-prod-github-runner-207 kernel: [51620.599602] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 19:44:06 juju-e4d256-prod-github-runner-207 kernel: [51620.600579] handle_exit+0x98/0x230 [kvm_amd] Aug 22 19:44:06 juju-e4d256-prod-github-runner-207 kernel: [51620.601475] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 19:44:06 juju-e4d256-prod-github-runner-207 kernel: [51620.602448] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 19:44:06 juju-e4d256-prod-github-runner-207 kernel: [51620.603376] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 19:44:06 juju-e4d256-prod-github-runner-207 kernel: [51620.604284] vcpu_run+0x62/0x2c0 [kvm] Aug 22 19:44:06 juju-e4d256-prod-github-runner-207 kernel: [51620.605120] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 19:44:06 juju-e4d256-prod-github-runner-207 kernel: [51620.605945] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 19:44:06 juju-e4d256-prod-github-runner-207 kernel: [51620.606808] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 19:44:06 juju-e4d256-prod-github-runner-207 kernel: [51620.607629] ? __seccomp_filter+0x4a/0x4a0 Aug 22 19:44:06 juju-e4d256-prod-github-runner-207 kernel: [51620.608378] ? __fget_files+0x86/0xc0 Aug 22 19:44:06 juju-e4d256-prod-github-runner-207 kernel: [51620.609085] __x64_sys_ioctl+0x95/0xd0 Aug 22 19:44:06 juju-e4d256-prod-github-runner-207 kernel: [51620.609809] do_syscall_64+0x5c/0xc0 Aug 22 19:44:06 juju-e4d256-prod-github-runner-207 kernel: [51620.610478] ? do_futex+0x162/0x1f0 Aug 22 19:44:06 juju-e4d256-prod-github-runner-207 kernel: [51620.611145] ? __x64_sys_futex+0x78/0x1e0 Aug 22 19:44:06 juju-e4d256-prod-github-runner-207 kernel: [51620.611830] ? __secure_computing+0xa9/0x120 Aug 22 19:44:06 juju-e4d256-prod-github-runner-207 kernel: [51620.612531] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 19:44:06 juju-e4d256-prod-github-runner-207 kernel: [51620.613298] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:44:06 juju-e4d256-prod-github-runner-207 kernel: [51620.614036] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:44:06 juju-e4d256-prod-github-runner-207 kernel: [51620.614754] ? do_syscall_64+0x69/0xc0 Aug 22 19:44:06 juju-e4d256-prod-github-runner-207 kernel: [51620.615422] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:44:06 juju-e4d256-prod-github-runner-207 kernel: [51620.616144] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:44:06 juju-e4d256-prod-github-runner-207 kernel: [51620.616873] ? do_syscall_64+0x69/0xc0 Aug 22 19:44:06 juju-e4d256-prod-github-runner-207 kernel: [51620.617503] ? do_syscall_64+0x69/0xc0 Aug 22 19:44:06 juju-e4d256-prod-github-runner-207 kernel: [51620.618140] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 19:44:06 juju-e4d256-prod-github-runner-207 kernel: [51620.618889] RIP: 0033:0x7faa5d0edaff Aug 22 19:44:06 juju-e4d256-prod-github-runner-207 kernel: [51620.619565] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 19:44:06 juju-e4d256-prod-github-runner-207 kernel: [51620.621558] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 19:44:06 juju-e4d256-prod-github-runner-207 kernel: [51620.622485] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 19:44:06 juju-e4d256-prod-github-runner-207 kernel: [51620.623551] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 19:44:06 juju-e4d256-prod-github-runner-207 kernel: [51620.624477] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 19:44:06 juju-e4d256-prod-github-runner-207 kernel: [51620.625367] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 19:44:06 juju-e4d256-prod-github-runner-207 kernel: [51620.626293] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 19:44:06 juju-e4d256-prod-github-runner-207 kernel: [51620.627189] Aug 22 19:44:34 juju-e4d256-prod-github-runner-207 kernel: [51648.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 47993s! [qemu-system-x86:6715] Aug 22 19:44:34 juju-e4d256-prod-github-runner-207 kernel: [51648.543757] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 19:44:34 juju-e4d256-prod-github-runner-207 kernel: [51648.544021] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 19:44:34 juju-e4d256-prod-github-runner-207 kernel: [51648.556113] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 19:44:34 juju-e4d256-prod-github-runner-207 kernel: [51648.557395] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 19:44:34 juju-e4d256-prod-github-runner-207 kernel: [51648.558623] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:44:34 juju-e4d256-prod-github-runner-207 kernel: [51648.559677] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 19:44:34 juju-e4d256-prod-github-runner-207 kernel: [51648.562232] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 19:44:34 juju-e4d256-prod-github-runner-207 kernel: [51648.563287] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 19:44:34 juju-e4d256-prod-github-runner-207 kernel: [51648.564453] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 19:44:34 juju-e4d256-prod-github-runner-207 kernel: [51648.565627] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 19:44:34 juju-e4d256-prod-github-runner-207 kernel: [51648.566789] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 19:44:34 juju-e4d256-prod-github-runner-207 kernel: [51648.567958] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 19:44:34 juju-e4d256-prod-github-runner-207 kernel: [51648.569124] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 19:44:34 juju-e4d256-prod-github-runner-207 kernel: [51648.570381] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 19:44:34 juju-e4d256-prod-github-runner-207 kernel: [51648.571481] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 19:44:34 juju-e4d256-prod-github-runner-207 kernel: [51648.572682] Call Trace: Aug 22 19:44:34 juju-e4d256-prod-github-runner-207 kernel: [51648.573612] Aug 22 19:44:34 juju-e4d256-prod-github-runner-207 kernel: [51648.574516] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:44:34 juju-e4d256-prod-github-runner-207 kernel: [51648.575545] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:44:34 juju-e4d256-prod-github-runner-207 kernel: [51648.576569] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:44:34 juju-e4d256-prod-github-runner-207 kernel: [51648.577682] ? show_regs.part.0+0x23/0x29 Aug 22 19:44:34 juju-e4d256-prod-github-runner-207 kernel: [51648.578680] ? show_regs.cold+0x8/0xd Aug 22 19:44:34 juju-e4d256-prod-github-runner-207 kernel: [51648.579649] ? watchdog_timer_fn+0x1be/0x220 Aug 22 19:44:34 juju-e4d256-prod-github-runner-207 kernel: [51648.580659] ? lockup_detector_update_enable+0x60/0x60 Aug 22 19:44:34 juju-e4d256-prod-github-runner-207 kernel: [51648.581729] ? __hrtimer_run_queues+0x107/0x230 Aug 22 19:44:34 juju-e4d256-prod-github-runner-207 kernel: [51648.582755] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 19:44:34 juju-e4d256-prod-github-runner-207 kernel: [51648.583783] ? hrtimer_interrupt+0x101/0x220 Aug 22 19:44:34 juju-e4d256-prod-github-runner-207 kernel: [51648.584797] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 19:44:34 juju-e4d256-prod-github-runner-207 kernel: [51648.585899] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 19:44:34 juju-e4d256-prod-github-runner-207 kernel: [51648.586946] Aug 22 19:44:34 juju-e4d256-prod-github-runner-207 kernel: [51648.587807] Aug 22 19:44:34 juju-e4d256-prod-github-runner-207 kernel: [51648.588644] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 19:44:34 juju-e4d256-prod-github-runner-207 kernel: [51648.589684] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:44:34 juju-e4d256-prod-github-runner-207 kernel: [51648.590725] ? _raw_spin_lock+0x22/0x30 Aug 22 19:44:34 juju-e4d256-prod-github-runner-207 kernel: [51648.591666] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:44:34 juju-e4d256-prod-github-runner-207 kernel: [51648.592679] direct_page_fault+0x206/0x310 [kvm] Aug 22 19:44:34 juju-e4d256-prod-github-runner-207 kernel: [51648.593717] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 19:44:34 juju-e4d256-prod-github-runner-207 kernel: [51648.594726] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 19:44:34 juju-e4d256-prod-github-runner-207 kernel: [51648.595725] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 19:44:34 juju-e4d256-prod-github-runner-207 kernel: [51648.596722] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 19:44:34 juju-e4d256-prod-github-runner-207 kernel: [51648.597682] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 19:44:34 juju-e4d256-prod-github-runner-207 kernel: [51648.598660] handle_exit+0x98/0x230 [kvm_amd] Aug 22 19:44:34 juju-e4d256-prod-github-runner-207 kernel: [51648.599557] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 19:44:34 juju-e4d256-prod-github-runner-207 kernel: [51648.600488] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 19:44:34 juju-e4d256-prod-github-runner-207 kernel: [51648.601432] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 19:44:34 juju-e4d256-prod-github-runner-207 kernel: [51648.602333] vcpu_run+0x62/0x2c0 [kvm] Aug 22 19:44:34 juju-e4d256-prod-github-runner-207 kernel: [51648.603141] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 19:44:34 juju-e4d256-prod-github-runner-207 kernel: [51648.603947] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 19:44:34 juju-e4d256-prod-github-runner-207 kernel: [51648.604798] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 19:44:34 juju-e4d256-prod-github-runner-207 kernel: [51648.605601] ? __seccomp_filter+0x4a/0x4a0 Aug 22 19:44:34 juju-e4d256-prod-github-runner-207 kernel: [51648.606342] ? __fget_files+0x86/0xc0 Aug 22 19:44:34 juju-e4d256-prod-github-runner-207 kernel: [51648.607043] __x64_sys_ioctl+0x95/0xd0 Aug 22 19:44:34 juju-e4d256-prod-github-runner-207 kernel: [51648.607734] do_syscall_64+0x5c/0xc0 Aug 22 19:44:34 juju-e4d256-prod-github-runner-207 kernel: [51648.608399] ? do_futex+0x162/0x1f0 Aug 22 19:44:34 juju-e4d256-prod-github-runner-207 kernel: [51648.609047] ? __x64_sys_futex+0x78/0x1e0 Aug 22 19:44:34 juju-e4d256-prod-github-runner-207 kernel: [51648.609737] ? __secure_computing+0xa9/0x120 Aug 22 19:44:34 juju-e4d256-prod-github-runner-207 kernel: [51648.610425] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 19:44:34 juju-e4d256-prod-github-runner-207 kernel: [51648.611182] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:44:34 juju-e4d256-prod-github-runner-207 kernel: [51648.611902] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:44:34 juju-e4d256-prod-github-runner-207 kernel: [51648.612618] ? do_syscall_64+0x69/0xc0 Aug 22 19:44:34 juju-e4d256-prod-github-runner-207 kernel: [51648.613464] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:44:34 juju-e4d256-prod-github-runner-207 kernel: [51648.614165] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:44:34 juju-e4d256-prod-github-runner-207 kernel: [51648.614861] ? do_syscall_64+0x69/0xc0 Aug 22 19:44:34 juju-e4d256-prod-github-runner-207 kernel: [51648.615483] ? do_syscall_64+0x69/0xc0 Aug 22 19:44:34 juju-e4d256-prod-github-runner-207 kernel: [51648.616104] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 19:44:34 juju-e4d256-prod-github-runner-207 kernel: [51648.616806] RIP: 0033:0x7faa5d0edaff Aug 22 19:44:34 juju-e4d256-prod-github-runner-207 kernel: [51648.617471] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 19:44:34 juju-e4d256-prod-github-runner-207 kernel: [51648.619463] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 19:44:34 juju-e4d256-prod-github-runner-207 kernel: [51648.620371] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 19:44:34 juju-e4d256-prod-github-runner-207 kernel: [51648.621260] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 19:44:34 juju-e4d256-prod-github-runner-207 kernel: [51648.622154] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 19:44:34 juju-e4d256-prod-github-runner-207 kernel: [51648.623046] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 19:44:34 juju-e4d256-prod-github-runner-207 kernel: [51648.623943] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 19:44:34 juju-e4d256-prod-github-runner-207 kernel: [51648.624835] Aug 22 19:44:46 juju-e4d256-prod-github-runner-207 kernel: [51660.632705] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 19:44:46 juju-e4d256-prod-github-runner-207 kernel: [51660.634326] rcu: 1-....: (12845256 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=6210316 Aug 22 19:44:46 juju-e4d256-prod-github-runner-207 kernel: [51660.635456] (t=12885858 jiffies g=23269 q=48674) Aug 22 19:44:46 juju-e4d256-prod-github-runner-207 kernel: [51660.636243] NMI backtrace for cpu 1 Aug 22 19:44:46 juju-e4d256-prod-github-runner-207 kernel: [51660.636952] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 19:44:46 juju-e4d256-prod-github-runner-207 kernel: [51660.638071] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 19:44:46 juju-e4d256-prod-github-runner-207 kernel: [51660.639129] Call Trace: Aug 22 19:44:46 juju-e4d256-prod-github-runner-207 kernel: [51660.639804] Aug 22 19:44:46 juju-e4d256-prod-github-runner-207 kernel: [51660.640456] show_stack+0x52/0x5c Aug 22 19:44:46 juju-e4d256-prod-github-runner-207 kernel: [51660.641203] dump_stack_lvl+0x4a/0x63 Aug 22 19:44:46 juju-e4d256-prod-github-runner-207 kernel: [51660.641948] dump_stack+0x10/0x16 Aug 22 19:44:46 juju-e4d256-prod-github-runner-207 kernel: [51660.642663] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 19:44:46 juju-e4d256-prod-github-runner-207 kernel: [51660.643447] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 19:44:46 juju-e4d256-prod-github-runner-207 kernel: [51660.644226] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 19:44:46 juju-e4d256-prod-github-runner-207 kernel: [51660.645142] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 19:44:46 juju-e4d256-prod-github-runner-207 kernel: [51660.645992] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 19:44:46 juju-e4d256-prod-github-runner-207 kernel: [51660.646795] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 19:44:46 juju-e4d256-prod-github-runner-207 kernel: [51660.647564] print_cpu_stall.cold+0x2f/0xe2 Aug 22 19:44:46 juju-e4d256-prod-github-runner-207 kernel: [51660.648325] ? timekeeping_update+0xf7/0x150 Aug 22 19:44:46 juju-e4d256-prod-github-runner-207 kernel: [51660.649091] check_cpu_stall+0x109/0x270 Aug 22 19:44:46 juju-e4d256-prod-github-runner-207 kernel: [51660.649848] rcu_sched_clock_irq+0x9a/0x250 Aug 22 19:44:46 juju-e4d256-prod-github-runner-207 kernel: [51660.650605] update_process_times+0x94/0xd0 Aug 22 19:44:46 juju-e4d256-prod-github-runner-207 kernel: [51660.651362] tick_sched_handle+0x29/0x70 Aug 22 19:44:46 juju-e4d256-prod-github-runner-207 kernel: [51660.652106] tick_sched_timer+0x8c/0xc0 Aug 22 19:44:46 juju-e4d256-prod-github-runner-207 kernel: [51660.652839] ? tick_nohz_handler+0xb0/0xb0 Aug 22 19:44:46 juju-e4d256-prod-github-runner-207 kernel: [51660.653696] __hrtimer_run_queues+0x107/0x230 Aug 22 19:44:46 juju-e4d256-prod-github-runner-207 kernel: [51660.654467] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 19:44:46 juju-e4d256-prod-github-runner-207 kernel: [51660.655240] hrtimer_interrupt+0x101/0x220 Aug 22 19:44:46 juju-e4d256-prod-github-runner-207 kernel: [51660.655997] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 19:44:46 juju-e4d256-prod-github-runner-207 kernel: [51660.656803] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 19:44:46 juju-e4d256-prod-github-runner-207 kernel: [51660.657608] Aug 22 19:44:46 juju-e4d256-prod-github-runner-207 kernel: [51660.658242] Aug 22 19:44:46 juju-e4d256-prod-github-runner-207 kernel: [51660.658906] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 19:44:46 juju-e4d256-prod-github-runner-207 kernel: [51660.659732] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:44:46 juju-e4d256-prod-github-runner-207 kernel: [51660.660612] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 19:44:46 juju-e4d256-prod-github-runner-207 kernel: [51660.662854] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 19:44:46 juju-e4d256-prod-github-runner-207 kernel: [51660.663726] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 19:44:46 juju-e4d256-prod-github-runner-207 kernel: [51660.664735] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 19:44:46 juju-e4d256-prod-github-runner-207 kernel: [51660.665736] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 19:44:46 juju-e4d256-prod-github-runner-207 kernel: [51660.666700] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 19:44:46 juju-e4d256-prod-github-runner-207 kernel: [51660.667654] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 19:44:46 juju-e4d256-prod-github-runner-207 kernel: [51660.668602] ? _raw_spin_lock+0x22/0x30 Aug 22 19:44:46 juju-e4d256-prod-github-runner-207 kernel: [51660.669421] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:44:46 juju-e4d256-prod-github-runner-207 kernel: [51660.670277] direct_page_fault+0x206/0x310 [kvm] Aug 22 19:44:46 juju-e4d256-prod-github-runner-207 kernel: [51660.671114] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 19:44:46 juju-e4d256-prod-github-runner-207 kernel: [51660.671940] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 19:44:46 juju-e4d256-prod-github-runner-207 kernel: [51660.672776] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 19:44:46 juju-e4d256-prod-github-runner-207 kernel: [51660.673613] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 19:44:46 juju-e4d256-prod-github-runner-207 kernel: [51660.674396] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 19:44:46 juju-e4d256-prod-github-runner-207 kernel: [51660.675311] handle_exit+0x98/0x230 [kvm_amd] Aug 22 19:44:46 juju-e4d256-prod-github-runner-207 kernel: [51660.676078] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 19:44:46 juju-e4d256-prod-github-runner-207 kernel: [51660.676862] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 19:44:46 juju-e4d256-prod-github-runner-207 kernel: [51660.677681] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 19:44:46 juju-e4d256-prod-github-runner-207 kernel: [51660.678463] vcpu_run+0x62/0x2c0 [kvm] Aug 22 19:44:46 juju-e4d256-prod-github-runner-207 kernel: [51660.679177] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 19:44:46 juju-e4d256-prod-github-runner-207 kernel: [51660.679909] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 19:44:46 juju-e4d256-prod-github-runner-207 kernel: [51660.680708] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 19:44:46 juju-e4d256-prod-github-runner-207 kernel: [51660.681484] ? __seccomp_filter+0x4a/0x4a0 Aug 22 19:44:46 juju-e4d256-prod-github-runner-207 kernel: [51660.682205] ? __fget_files+0x86/0xc0 Aug 22 19:44:46 juju-e4d256-prod-github-runner-207 kernel: [51660.682896] __x64_sys_ioctl+0x95/0xd0 Aug 22 19:44:46 juju-e4d256-prod-github-runner-207 kernel: [51660.683588] do_syscall_64+0x5c/0xc0 Aug 22 19:44:46 juju-e4d256-prod-github-runner-207 kernel: [51660.684268] ? do_futex+0x162/0x1f0 Aug 22 19:44:46 juju-e4d256-prod-github-runner-207 kernel: [51660.684938] ? __x64_sys_futex+0x78/0x1e0 Aug 22 19:44:46 juju-e4d256-prod-github-runner-207 kernel: [51660.685647] ? __secure_computing+0xa9/0x120 Aug 22 19:44:46 juju-e4d256-prod-github-runner-207 kernel: [51660.686367] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 19:44:46 juju-e4d256-prod-github-runner-207 kernel: [51660.687155] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:44:46 juju-e4d256-prod-github-runner-207 kernel: [51660.687906] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:44:46 juju-e4d256-prod-github-runner-207 kernel: [51660.688656] ? do_syscall_64+0x69/0xc0 Aug 22 19:44:46 juju-e4d256-prod-github-runner-207 kernel: [51660.689355] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:44:46 juju-e4d256-prod-github-runner-207 kernel: [51660.690107] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:44:46 juju-e4d256-prod-github-runner-207 kernel: [51660.690860] ? do_syscall_64+0x69/0xc0 Aug 22 19:44:46 juju-e4d256-prod-github-runner-207 kernel: [51660.691552] ? do_syscall_64+0x69/0xc0 Aug 22 19:44:46 juju-e4d256-prod-github-runner-207 kernel: [51660.692236] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 19:44:46 juju-e4d256-prod-github-runner-207 kernel: [51660.693003] RIP: 0033:0x7faa5d0edaff Aug 22 19:44:46 juju-e4d256-prod-github-runner-207 kernel: [51660.693721] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 19:44:46 juju-e4d256-prod-github-runner-207 kernel: [51660.695812] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 19:44:46 juju-e4d256-prod-github-runner-207 kernel: [51660.696779] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 19:44:46 juju-e4d256-prod-github-runner-207 kernel: [51660.697735] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 19:44:46 juju-e4d256-prod-github-runner-207 kernel: [51660.698683] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 19:44:46 juju-e4d256-prod-github-runner-207 kernel: [51660.699619] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 19:44:46 juju-e4d256-prod-github-runner-207 kernel: [51660.700540] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 19:44:46 juju-e4d256-prod-github-runner-207 kernel: [51660.701472] Aug 22 19:45:14 juju-e4d256-prod-github-runner-207 kernel: [51688.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 48030s! [qemu-system-x86:6715] Aug 22 19:45:14 juju-e4d256-prod-github-runner-207 kernel: [51688.543718] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 19:45:14 juju-e4d256-prod-github-runner-207 kernel: [51688.543973] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 19:45:14 juju-e4d256-prod-github-runner-207 kernel: [51688.556062] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 19:45:14 juju-e4d256-prod-github-runner-207 kernel: [51688.557347] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 19:45:14 juju-e4d256-prod-github-runner-207 kernel: [51688.558568] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:45:14 juju-e4d256-prod-github-runner-207 kernel: [51688.559627] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 19:45:14 juju-e4d256-prod-github-runner-207 kernel: [51688.562168] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 19:45:14 juju-e4d256-prod-github-runner-207 kernel: [51688.563214] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 19:45:14 juju-e4d256-prod-github-runner-207 kernel: [51688.564389] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 19:45:14 juju-e4d256-prod-github-runner-207 kernel: [51688.565612] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 19:45:14 juju-e4d256-prod-github-runner-207 kernel: [51688.567067] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 19:45:14 juju-e4d256-prod-github-runner-207 kernel: [51688.568269] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 19:45:14 juju-e4d256-prod-github-runner-207 kernel: [51688.569478] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 19:45:14 juju-e4d256-prod-github-runner-207 kernel: [51688.570708] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 19:45:14 juju-e4d256-prod-github-runner-207 kernel: [51688.571808] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 19:45:14 juju-e4d256-prod-github-runner-207 kernel: [51688.573020] Call Trace: Aug 22 19:45:14 juju-e4d256-prod-github-runner-207 kernel: [51688.573938] Aug 22 19:45:14 juju-e4d256-prod-github-runner-207 kernel: [51688.574833] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:45:14 juju-e4d256-prod-github-runner-207 kernel: [51688.575872] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:45:14 juju-e4d256-prod-github-runner-207 kernel: [51688.576919] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:45:14 juju-e4d256-prod-github-runner-207 kernel: [51688.578018] ? show_regs.part.0+0x23/0x29 Aug 22 19:45:14 juju-e4d256-prod-github-runner-207 kernel: [51688.579014] ? show_regs.cold+0x8/0xd Aug 22 19:45:14 juju-e4d256-prod-github-runner-207 kernel: [51688.579984] ? watchdog_timer_fn+0x1be/0x220 Aug 22 19:45:14 juju-e4d256-prod-github-runner-207 kernel: [51688.580999] ? lockup_detector_update_enable+0x60/0x60 Aug 22 19:45:14 juju-e4d256-prod-github-runner-207 kernel: [51688.582064] ? __hrtimer_run_queues+0x107/0x230 Aug 22 19:45:14 juju-e4d256-prod-github-runner-207 kernel: [51688.583097] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 19:45:14 juju-e4d256-prod-github-runner-207 kernel: [51688.584122] ? hrtimer_interrupt+0x101/0x220 Aug 22 19:45:14 juju-e4d256-prod-github-runner-207 kernel: [51688.585142] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 19:45:14 juju-e4d256-prod-github-runner-207 kernel: [51688.586218] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 19:45:14 juju-e4d256-prod-github-runner-207 kernel: [51688.587264] Aug 22 19:45:14 juju-e4d256-prod-github-runner-207 kernel: [51688.588118] Aug 22 19:45:14 juju-e4d256-prod-github-runner-207 kernel: [51688.588965] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 19:45:14 juju-e4d256-prod-github-runner-207 kernel: [51688.590004] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:45:14 juju-e4d256-prod-github-runner-207 kernel: [51688.591039] ? _raw_spin_lock+0x22/0x30 Aug 22 19:45:14 juju-e4d256-prod-github-runner-207 kernel: [51688.591984] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:45:14 juju-e4d256-prod-github-runner-207 kernel: [51688.593010] direct_page_fault+0x206/0x310 [kvm] Aug 22 19:45:14 juju-e4d256-prod-github-runner-207 kernel: [51688.594044] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 19:45:14 juju-e4d256-prod-github-runner-207 kernel: [51688.595058] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 19:45:14 juju-e4d256-prod-github-runner-207 kernel: [51688.596062] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 19:45:14 juju-e4d256-prod-github-runner-207 kernel: [51688.597077] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 19:45:14 juju-e4d256-prod-github-runner-207 kernel: [51688.598028] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 19:45:14 juju-e4d256-prod-github-runner-207 kernel: [51688.599006] handle_exit+0x98/0x230 [kvm_amd] Aug 22 19:45:14 juju-e4d256-prod-github-runner-207 kernel: [51688.599902] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 19:45:14 juju-e4d256-prod-github-runner-207 kernel: [51688.600819] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 19:45:14 juju-e4d256-prod-github-runner-207 kernel: [51688.601760] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 19:45:14 juju-e4d256-prod-github-runner-207 kernel: [51688.602669] vcpu_run+0x62/0x2c0 [kvm] Aug 22 19:45:14 juju-e4d256-prod-github-runner-207 kernel: [51688.603484] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 19:45:14 juju-e4d256-prod-github-runner-207 kernel: [51688.604292] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 19:45:14 juju-e4d256-prod-github-runner-207 kernel: [51688.605155] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 19:45:14 juju-e4d256-prod-github-runner-207 kernel: [51688.605966] ? __seccomp_filter+0x4a/0x4a0 Aug 22 19:45:14 juju-e4d256-prod-github-runner-207 kernel: [51688.606705] ? __fget_files+0x86/0xc0 Aug 22 19:45:14 juju-e4d256-prod-github-runner-207 kernel: [51688.607434] __x64_sys_ioctl+0x95/0xd0 Aug 22 19:45:14 juju-e4d256-prod-github-runner-207 kernel: [51688.608130] do_syscall_64+0x5c/0xc0 Aug 22 19:45:14 juju-e4d256-prod-github-runner-207 kernel: [51688.608796] ? do_futex+0x162/0x1f0 Aug 22 19:45:14 juju-e4d256-prod-github-runner-207 kernel: [51688.609455] ? __x64_sys_futex+0x78/0x1e0 Aug 22 19:45:14 juju-e4d256-prod-github-runner-207 kernel: [51688.610127] ? __secure_computing+0xa9/0x120 Aug 22 19:45:14 juju-e4d256-prod-github-runner-207 kernel: [51688.610814] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 19:45:14 juju-e4d256-prod-github-runner-207 kernel: [51688.611576] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:45:14 juju-e4d256-prod-github-runner-207 kernel: [51688.612296] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:45:14 juju-e4d256-prod-github-runner-207 kernel: [51688.613024] ? do_syscall_64+0x69/0xc0 Aug 22 19:45:14 juju-e4d256-prod-github-runner-207 kernel: [51688.613673] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:45:14 juju-e4d256-prod-github-runner-207 kernel: [51688.614380] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:45:14 juju-e4d256-prod-github-runner-207 kernel: [51688.615073] ? do_syscall_64+0x69/0xc0 Aug 22 19:45:14 juju-e4d256-prod-github-runner-207 kernel: [51688.615694] ? do_syscall_64+0x69/0xc0 Aug 22 19:45:14 juju-e4d256-prod-github-runner-207 kernel: [51688.616319] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 19:45:14 juju-e4d256-prod-github-runner-207 kernel: [51688.617031] RIP: 0033:0x7faa5d0edaff Aug 22 19:45:14 juju-e4d256-prod-github-runner-207 kernel: [51688.617678] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 19:45:14 juju-e4d256-prod-github-runner-207 kernel: [51688.619678] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 19:45:14 juju-e4d256-prod-github-runner-207 kernel: [51688.620590] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 19:45:14 juju-e4d256-prod-github-runner-207 kernel: [51688.621492] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 19:45:14 juju-e4d256-prod-github-runner-207 kernel: [51688.622383] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 19:45:14 juju-e4d256-prod-github-runner-207 kernel: [51688.623276] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 19:45:14 juju-e4d256-prod-github-runner-207 kernel: [51688.624165] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 19:45:14 juju-e4d256-prod-github-runner-207 kernel: [51688.625067] Aug 22 19:45:42 juju-e4d256-prod-github-runner-207 kernel: [51716.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 48056s! [qemu-system-x86:6715] Aug 22 19:45:42 juju-e4d256-prod-github-runner-207 kernel: [51716.543093] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 19:45:42 juju-e4d256-prod-github-runner-207 kernel: [51716.543161] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 19:45:42 juju-e4d256-prod-github-runner-207 kernel: [51716.555559] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 19:45:42 juju-e4d256-prod-github-runner-207 kernel: [51716.556869] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 19:45:42 juju-e4d256-prod-github-runner-207 kernel: [51716.558093] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:45:42 juju-e4d256-prod-github-runner-207 kernel: [51716.559164] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 19:45:42 juju-e4d256-prod-github-runner-207 kernel: [51716.561722] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 19:45:42 juju-e4d256-prod-github-runner-207 kernel: [51716.562771] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 19:45:42 juju-e4d256-prod-github-runner-207 kernel: [51716.563940] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 19:45:42 juju-e4d256-prod-github-runner-207 kernel: [51716.565109] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 19:45:42 juju-e4d256-prod-github-runner-207 kernel: [51716.566268] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 19:45:42 juju-e4d256-prod-github-runner-207 kernel: [51716.567431] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 19:45:42 juju-e4d256-prod-github-runner-207 kernel: [51716.568627] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 19:45:42 juju-e4d256-prod-github-runner-207 kernel: [51716.569872] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 19:45:42 juju-e4d256-prod-github-runner-207 kernel: [51716.570970] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 19:45:42 juju-e4d256-prod-github-runner-207 kernel: [51716.572162] Call Trace: Aug 22 19:45:42 juju-e4d256-prod-github-runner-207 kernel: [51716.573095] Aug 22 19:45:42 juju-e4d256-prod-github-runner-207 kernel: [51716.573980] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:45:42 juju-e4d256-prod-github-runner-207 kernel: [51716.575011] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:45:42 juju-e4d256-prod-github-runner-207 kernel: [51716.576033] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:45:42 juju-e4d256-prod-github-runner-207 kernel: [51716.577125] ? show_regs.part.0+0x23/0x29 Aug 22 19:45:42 juju-e4d256-prod-github-runner-207 kernel: [51716.578124] ? show_regs.cold+0x8/0xd Aug 22 19:45:42 juju-e4d256-prod-github-runner-207 kernel: [51716.579099] ? watchdog_timer_fn+0x1be/0x220 Aug 22 19:45:42 juju-e4d256-prod-github-runner-207 kernel: [51716.580110] ? lockup_detector_update_enable+0x60/0x60 Aug 22 19:45:42 juju-e4d256-prod-github-runner-207 kernel: [51716.581343] ? __hrtimer_run_queues+0x107/0x230 Aug 22 19:45:42 juju-e4d256-prod-github-runner-207 kernel: [51716.582489] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 19:45:42 juju-e4d256-prod-github-runner-207 kernel: [51716.583523] ? hrtimer_interrupt+0x101/0x220 Aug 22 19:45:42 juju-e4d256-prod-github-runner-207 kernel: [51716.584564] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 19:45:42 juju-e4d256-prod-github-runner-207 kernel: [51716.585641] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 19:45:42 juju-e4d256-prod-github-runner-207 kernel: [51716.586689] Aug 22 19:45:42 juju-e4d256-prod-github-runner-207 kernel: [51716.587543] Aug 22 19:45:42 juju-e4d256-prod-github-runner-207 kernel: [51716.588381] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 19:45:42 juju-e4d256-prod-github-runner-207 kernel: [51716.589433] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:45:42 juju-e4d256-prod-github-runner-207 kernel: [51716.590473] ? _raw_spin_lock+0x22/0x30 Aug 22 19:45:42 juju-e4d256-prod-github-runner-207 kernel: [51716.591420] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:45:42 juju-e4d256-prod-github-runner-207 kernel: [51716.592449] direct_page_fault+0x206/0x310 [kvm] Aug 22 19:45:42 juju-e4d256-prod-github-runner-207 kernel: [51716.593488] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 19:45:42 juju-e4d256-prod-github-runner-207 kernel: [51716.594500] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 19:45:42 juju-e4d256-prod-github-runner-207 kernel: [51716.595502] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 19:45:42 juju-e4d256-prod-github-runner-207 kernel: [51716.596486] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 19:45:42 juju-e4d256-prod-github-runner-207 kernel: [51716.597473] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 19:45:42 juju-e4d256-prod-github-runner-207 kernel: [51716.598450] handle_exit+0x98/0x230 [kvm_amd] Aug 22 19:45:42 juju-e4d256-prod-github-runner-207 kernel: [51716.599340] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 19:45:42 juju-e4d256-prod-github-runner-207 kernel: [51716.600252] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 19:45:42 juju-e4d256-prod-github-runner-207 kernel: [51716.601201] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 19:45:42 juju-e4d256-prod-github-runner-207 kernel: [51716.602111] vcpu_run+0x62/0x2c0 [kvm] Aug 22 19:45:42 juju-e4d256-prod-github-runner-207 kernel: [51716.602923] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 19:45:42 juju-e4d256-prod-github-runner-207 kernel: [51716.603736] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 19:45:42 juju-e4d256-prod-github-runner-207 kernel: [51716.604617] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 19:45:42 juju-e4d256-prod-github-runner-207 kernel: [51716.605415] ? __seccomp_filter+0x4a/0x4a0 Aug 22 19:45:42 juju-e4d256-prod-github-runner-207 kernel: [51716.606158] ? __fget_files+0x86/0xc0 Aug 22 19:45:42 juju-e4d256-prod-github-runner-207 kernel: [51716.606863] __x64_sys_ioctl+0x95/0xd0 Aug 22 19:45:42 juju-e4d256-prod-github-runner-207 kernel: [51716.607557] do_syscall_64+0x5c/0xc0 Aug 22 19:45:42 juju-e4d256-prod-github-runner-207 kernel: [51716.608223] ? do_futex+0x162/0x1f0 Aug 22 19:45:42 juju-e4d256-prod-github-runner-207 kernel: [51716.608883] ? __x64_sys_futex+0x78/0x1e0 Aug 22 19:45:42 juju-e4d256-prod-github-runner-207 kernel: [51716.609558] ? __secure_computing+0xa9/0x120 Aug 22 19:45:42 juju-e4d256-prod-github-runner-207 kernel: [51716.610247] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 19:45:42 juju-e4d256-prod-github-runner-207 kernel: [51716.611012] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:45:42 juju-e4d256-prod-github-runner-207 kernel: [51716.611788] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:45:42 juju-e4d256-prod-github-runner-207 kernel: [51716.612738] ? do_syscall_64+0x69/0xc0 Aug 22 19:45:42 juju-e4d256-prod-github-runner-207 kernel: [51716.613408] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:45:42 juju-e4d256-prod-github-runner-207 kernel: [51716.614112] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:45:42 juju-e4d256-prod-github-runner-207 kernel: [51716.614808] ? do_syscall_64+0x69/0xc0 Aug 22 19:45:42 juju-e4d256-prod-github-runner-207 kernel: [51716.615433] ? do_syscall_64+0x69/0xc0 Aug 22 19:45:42 juju-e4d256-prod-github-runner-207 kernel: [51716.616055] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 19:45:42 juju-e4d256-prod-github-runner-207 kernel: [51716.616775] RIP: 0033:0x7faa5d0edaff Aug 22 19:45:42 juju-e4d256-prod-github-runner-207 kernel: [51716.617430] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 19:45:42 juju-e4d256-prod-github-runner-207 kernel: [51716.619415] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 19:45:42 juju-e4d256-prod-github-runner-207 kernel: [51716.620333] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 19:45:42 juju-e4d256-prod-github-runner-207 kernel: [51716.621243] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 19:45:42 juju-e4d256-prod-github-runner-207 kernel: [51716.622140] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 19:45:42 juju-e4d256-prod-github-runner-207 kernel: [51716.623030] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 19:45:42 juju-e4d256-prod-github-runner-207 kernel: [51716.623924] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 19:45:42 juju-e4d256-prod-github-runner-207 kernel: [51716.624828] Aug 22 19:46:10 juju-e4d256-prod-github-runner-207 kernel: [51744.541984] watchdog: BUG: soft lockup - CPU#1 stuck for 48082s! [qemu-system-x86:6715] Aug 22 19:46:10 juju-e4d256-prod-github-runner-207 kernel: [51744.543161] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 19:46:10 juju-e4d256-prod-github-runner-207 kernel: [51744.543325] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 19:46:10 juju-e4d256-prod-github-runner-207 kernel: [51744.555424] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 19:46:10 juju-e4d256-prod-github-runner-207 kernel: [51744.556707] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 19:46:10 juju-e4d256-prod-github-runner-207 kernel: [51744.557944] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:46:10 juju-e4d256-prod-github-runner-207 kernel: [51744.559040] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 19:46:10 juju-e4d256-prod-github-runner-207 kernel: [51744.561624] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 19:46:10 juju-e4d256-prod-github-runner-207 kernel: [51744.562671] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 19:46:10 juju-e4d256-prod-github-runner-207 kernel: [51744.563861] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 19:46:10 juju-e4d256-prod-github-runner-207 kernel: [51744.565072] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 19:46:10 juju-e4d256-prod-github-runner-207 kernel: [51744.566233] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 19:46:10 juju-e4d256-prod-github-runner-207 kernel: [51744.567401] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 19:46:10 juju-e4d256-prod-github-runner-207 kernel: [51744.568610] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 19:46:10 juju-e4d256-prod-github-runner-207 kernel: [51744.569931] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 19:46:10 juju-e4d256-prod-github-runner-207 kernel: [51744.571037] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 19:46:10 juju-e4d256-prod-github-runner-207 kernel: [51744.572251] Call Trace: Aug 22 19:46:10 juju-e4d256-prod-github-runner-207 kernel: [51744.573168] Aug 22 19:46:10 juju-e4d256-prod-github-runner-207 kernel: [51744.574088] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:46:10 juju-e4d256-prod-github-runner-207 kernel: [51744.575163] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:46:10 juju-e4d256-prod-github-runner-207 kernel: [51744.576247] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:46:10 juju-e4d256-prod-github-runner-207 kernel: [51744.577355] ? show_regs.part.0+0x23/0x29 Aug 22 19:46:10 juju-e4d256-prod-github-runner-207 kernel: [51744.578352] ? show_regs.cold+0x8/0xd Aug 22 19:46:10 juju-e4d256-prod-github-runner-207 kernel: [51744.579323] ? watchdog_timer_fn+0x1be/0x220 Aug 22 19:46:10 juju-e4d256-prod-github-runner-207 kernel: [51744.580395] ? lockup_detector_update_enable+0x60/0x60 Aug 22 19:46:10 juju-e4d256-prod-github-runner-207 kernel: [51744.581465] ? __hrtimer_run_queues+0x107/0x230 Aug 22 19:46:10 juju-e4d256-prod-github-runner-207 kernel: [51744.582496] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 19:46:10 juju-e4d256-prod-github-runner-207 kernel: [51744.583519] ? hrtimer_interrupt+0x101/0x220 Aug 22 19:46:10 juju-e4d256-prod-github-runner-207 kernel: [51744.584550] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 19:46:10 juju-e4d256-prod-github-runner-207 kernel: [51744.585638] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 19:46:10 juju-e4d256-prod-github-runner-207 kernel: [51744.586686] Aug 22 19:46:10 juju-e4d256-prod-github-runner-207 kernel: [51744.587569] Aug 22 19:46:10 juju-e4d256-prod-github-runner-207 kernel: [51744.588427] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 19:46:10 juju-e4d256-prod-github-runner-207 kernel: [51744.589472] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:46:10 juju-e4d256-prod-github-runner-207 kernel: [51744.590764] ? _raw_spin_lock+0x22/0x30 Aug 22 19:46:10 juju-e4d256-prod-github-runner-207 kernel: [51744.591715] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:46:10 juju-e4d256-prod-github-runner-207 kernel: [51744.592756] direct_page_fault+0x206/0x310 [kvm] Aug 22 19:46:10 juju-e4d256-prod-github-runner-207 kernel: [51744.593805] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 19:46:10 juju-e4d256-prod-github-runner-207 kernel: [51744.595193] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 19:46:10 juju-e4d256-prod-github-runner-207 kernel: [51744.596509] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 19:46:10 juju-e4d256-prod-github-runner-207 kernel: [51744.597593] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 19:46:10 juju-e4d256-prod-github-runner-207 kernel: [51744.598548] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 19:46:10 juju-e4d256-prod-github-runner-207 kernel: [51744.599819] handle_exit+0x98/0x230 [kvm_amd] Aug 22 19:46:10 juju-e4d256-prod-github-runner-207 kernel: [51744.600988] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 19:46:10 juju-e4d256-prod-github-runner-207 kernel: [51744.602156] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 19:46:10 juju-e4d256-prod-github-runner-207 kernel: [51744.603268] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 19:46:10 juju-e4d256-prod-github-runner-207 kernel: [51744.604446] vcpu_run+0x62/0x2c0 [kvm] Aug 22 19:46:10 juju-e4d256-prod-github-runner-207 kernel: [51744.605462] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 19:46:10 juju-e4d256-prod-github-runner-207 kernel: [51744.606541] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 19:46:10 juju-e4d256-prod-github-runner-207 kernel: [51744.607635] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 19:46:10 juju-e4d256-prod-github-runner-207 kernel: [51744.608603] ? __seccomp_filter+0x4a/0x4a0 Aug 22 19:46:10 juju-e4d256-prod-github-runner-207 kernel: [51744.609352] ? __fget_files+0x86/0xc0 Aug 22 19:46:10 juju-e4d256-prod-github-runner-207 kernel: [51744.610063] __x64_sys_ioctl+0x95/0xd0 Aug 22 19:46:10 juju-e4d256-prod-github-runner-207 kernel: [51744.610759] do_syscall_64+0x5c/0xc0 Aug 22 19:46:10 juju-e4d256-prod-github-runner-207 kernel: [51744.611430] ? do_futex+0x162/0x1f0 Aug 22 19:46:10 juju-e4d256-prod-github-runner-207 kernel: [51744.612093] ? __x64_sys_futex+0x78/0x1e0 Aug 22 19:46:10 juju-e4d256-prod-github-runner-207 kernel: [51744.612794] ? __secure_computing+0xa9/0x120 Aug 22 19:46:10 juju-e4d256-prod-github-runner-207 kernel: [51744.613486] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 19:46:10 juju-e4d256-prod-github-runner-207 kernel: [51744.614245] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:46:10 juju-e4d256-prod-github-runner-207 kernel: [51744.614968] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:46:10 juju-e4d256-prod-github-runner-207 kernel: [51744.615688] ? do_syscall_64+0x69/0xc0 Aug 22 19:46:10 juju-e4d256-prod-github-runner-207 kernel: [51744.616356] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:46:10 juju-e4d256-prod-github-runner-207 kernel: [51744.617073] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:46:10 juju-e4d256-prod-github-runner-207 kernel: [51744.617792] ? do_syscall_64+0x69/0xc0 Aug 22 19:46:10 juju-e4d256-prod-github-runner-207 kernel: [51744.618420] ? do_syscall_64+0x69/0xc0 Aug 22 19:46:10 juju-e4d256-prod-github-runner-207 kernel: [51744.619053] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 19:46:10 juju-e4d256-prod-github-runner-207 kernel: [51744.619757] RIP: 0033:0x7faa5d0edaff Aug 22 19:46:10 juju-e4d256-prod-github-runner-207 kernel: [51744.620403] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 19:46:10 juju-e4d256-prod-github-runner-207 kernel: [51744.622389] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 19:46:10 juju-e4d256-prod-github-runner-207 kernel: [51744.623319] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 19:46:10 juju-e4d256-prod-github-runner-207 kernel: [51744.624291] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 19:46:10 juju-e4d256-prod-github-runner-207 kernel: [51744.625187] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 19:46:10 juju-e4d256-prod-github-runner-207 kernel: [51744.626075] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 19:46:10 juju-e4d256-prod-github-runner-207 kernel: [51744.626964] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 19:46:10 juju-e4d256-prod-github-runner-207 kernel: [51744.627860] Aug 22 19:46:38 juju-e4d256-prod-github-runner-207 kernel: [51772.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 48108s! [qemu-system-x86:6715] Aug 22 19:46:38 juju-e4d256-prod-github-runner-207 kernel: [51772.543786] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 19:46:38 juju-e4d256-prod-github-runner-207 kernel: [51772.544013] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 19:46:38 juju-e4d256-prod-github-runner-207 kernel: [51772.557756] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 19:46:38 juju-e4d256-prod-github-runner-207 kernel: [51772.559104] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 19:46:38 juju-e4d256-prod-github-runner-207 kernel: [51772.560466] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:46:38 juju-e4d256-prod-github-runner-207 kernel: [51772.561586] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 19:46:38 juju-e4d256-prod-github-runner-207 kernel: [51772.564339] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 19:46:38 juju-e4d256-prod-github-runner-207 kernel: [51772.565564] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 19:46:38 juju-e4d256-prod-github-runner-207 kernel: [51772.566837] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 19:46:38 juju-e4d256-prod-github-runner-207 kernel: [51772.568015] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 19:46:38 juju-e4d256-prod-github-runner-207 kernel: [51772.569222] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 19:46:38 juju-e4d256-prod-github-runner-207 kernel: [51772.570419] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 19:46:38 juju-e4d256-prod-github-runner-207 kernel: [51772.571583] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 19:46:38 juju-e4d256-prod-github-runner-207 kernel: [51772.572837] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 19:46:38 juju-e4d256-prod-github-runner-207 kernel: [51772.573935] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 19:46:38 juju-e4d256-prod-github-runner-207 kernel: [51772.575140] Call Trace: Aug 22 19:46:38 juju-e4d256-prod-github-runner-207 kernel: [51772.576077] Aug 22 19:46:38 juju-e4d256-prod-github-runner-207 kernel: [51772.576977] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:46:38 juju-e4d256-prod-github-runner-207 kernel: [51772.578010] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:46:38 juju-e4d256-prod-github-runner-207 kernel: [51772.579035] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:46:38 juju-e4d256-prod-github-runner-207 kernel: [51772.580125] ? show_regs.part.0+0x23/0x29 Aug 22 19:46:38 juju-e4d256-prod-github-runner-207 kernel: [51772.581122] ? show_regs.cold+0x8/0xd Aug 22 19:46:38 juju-e4d256-prod-github-runner-207 kernel: [51772.582099] ? watchdog_timer_fn+0x1be/0x220 Aug 22 19:46:38 juju-e4d256-prod-github-runner-207 kernel: [51772.583106] ? lockup_detector_update_enable+0x60/0x60 Aug 22 19:46:38 juju-e4d256-prod-github-runner-207 kernel: [51772.584182] ? __hrtimer_run_queues+0x107/0x230 Aug 22 19:46:38 juju-e4d256-prod-github-runner-207 kernel: [51772.585217] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 19:46:38 juju-e4d256-prod-github-runner-207 kernel: [51772.586240] ? hrtimer_interrupt+0x101/0x220 Aug 22 19:46:38 juju-e4d256-prod-github-runner-207 kernel: [51772.587255] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 19:46:38 juju-e4d256-prod-github-runner-207 kernel: [51772.588336] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 19:46:38 juju-e4d256-prod-github-runner-207 kernel: [51772.589382] Aug 22 19:46:38 juju-e4d256-prod-github-runner-207 kernel: [51772.590236] Aug 22 19:46:38 juju-e4d256-prod-github-runner-207 kernel: [51772.591079] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 19:46:38 juju-e4d256-prod-github-runner-207 kernel: [51772.592119] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:46:38 juju-e4d256-prod-github-runner-207 kernel: [51772.593160] ? _raw_spin_lock+0x22/0x30 Aug 22 19:46:38 juju-e4d256-prod-github-runner-207 kernel: [51772.594105] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:46:38 juju-e4d256-prod-github-runner-207 kernel: [51772.595124] direct_page_fault+0x206/0x310 [kvm] Aug 22 19:46:38 juju-e4d256-prod-github-runner-207 kernel: [51772.596164] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 19:46:38 juju-e4d256-prod-github-runner-207 kernel: [51772.597174] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 19:46:38 juju-e4d256-prod-github-runner-207 kernel: [51772.598181] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 19:46:38 juju-e4d256-prod-github-runner-207 kernel: [51772.599165] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 19:46:38 juju-e4d256-prod-github-runner-207 kernel: [51772.600150] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 19:46:38 juju-e4d256-prod-github-runner-207 kernel: [51772.601146] handle_exit+0x98/0x230 [kvm_amd] Aug 22 19:46:38 juju-e4d256-prod-github-runner-207 kernel: [51772.602046] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 19:46:38 juju-e4d256-prod-github-runner-207 kernel: [51772.602963] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 19:46:38 juju-e4d256-prod-github-runner-207 kernel: [51772.603901] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 19:46:38 juju-e4d256-prod-github-runner-207 kernel: [51772.604807] vcpu_run+0x62/0x2c0 [kvm] Aug 22 19:46:38 juju-e4d256-prod-github-runner-207 kernel: [51772.605620] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 19:46:38 juju-e4d256-prod-github-runner-207 kernel: [51772.606431] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 19:46:38 juju-e4d256-prod-github-runner-207 kernel: [51772.607291] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 19:46:38 juju-e4d256-prod-github-runner-207 kernel: [51772.608100] ? __seccomp_filter+0x4a/0x4a0 Aug 22 19:46:38 juju-e4d256-prod-github-runner-207 kernel: [51772.608844] ? __fget_files+0x86/0xc0 Aug 22 19:46:38 juju-e4d256-prod-github-runner-207 kernel: [51772.609549] __x64_sys_ioctl+0x95/0xd0 Aug 22 19:46:38 juju-e4d256-prod-github-runner-207 kernel: [51772.610242] do_syscall_64+0x5c/0xc0 Aug 22 19:46:38 juju-e4d256-prod-github-runner-207 kernel: [51772.610907] ? do_futex+0x162/0x1f0 Aug 22 19:46:38 juju-e4d256-prod-github-runner-207 kernel: [51772.611562] ? __x64_sys_futex+0x78/0x1e0 Aug 22 19:46:38 juju-e4d256-prod-github-runner-207 kernel: [51772.612254] ? __secure_computing+0xa9/0x120 Aug 22 19:46:38 juju-e4d256-prod-github-runner-207 kernel: [51772.612944] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 19:46:38 juju-e4d256-prod-github-runner-207 kernel: [51772.613710] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:46:38 juju-e4d256-prod-github-runner-207 kernel: [51772.614437] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:46:38 juju-e4d256-prod-github-runner-207 kernel: [51772.615162] ? do_syscall_64+0x69/0xc0 Aug 22 19:46:38 juju-e4d256-prod-github-runner-207 kernel: [51772.615806] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:46:38 juju-e4d256-prod-github-runner-207 kernel: [51772.616525] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:46:38 juju-e4d256-prod-github-runner-207 kernel: [51772.617222] ? do_syscall_64+0x69/0xc0 Aug 22 19:46:38 juju-e4d256-prod-github-runner-207 kernel: [51772.617846] ? do_syscall_64+0x69/0xc0 Aug 22 19:46:38 juju-e4d256-prod-github-runner-207 kernel: [51772.618468] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 19:46:38 juju-e4d256-prod-github-runner-207 kernel: [51772.619179] RIP: 0033:0x7faa5d0edaff Aug 22 19:46:38 juju-e4d256-prod-github-runner-207 kernel: [51772.619854] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 19:46:38 juju-e4d256-prod-github-runner-207 kernel: [51772.621859] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 19:46:38 juju-e4d256-prod-github-runner-207 kernel: [51772.622773] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 19:46:38 juju-e4d256-prod-github-runner-207 kernel: [51772.623670] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 19:46:38 juju-e4d256-prod-github-runner-207 kernel: [51772.624575] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 19:46:38 juju-e4d256-prod-github-runner-207 kernel: [51772.625468] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 19:46:38 juju-e4d256-prod-github-runner-207 kernel: [51772.626362] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 19:46:38 juju-e4d256-prod-github-runner-207 kernel: [51772.627261] Aug 22 19:47:06 juju-e4d256-prod-github-runner-207 kernel: [51800.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 48135s! [qemu-system-x86:6715] Aug 22 19:47:06 juju-e4d256-prod-github-runner-207 kernel: [51800.543092] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 19:47:06 juju-e4d256-prod-github-runner-207 kernel: [51800.543159] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 19:47:06 juju-e4d256-prod-github-runner-207 kernel: [51800.555227] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 19:47:06 juju-e4d256-prod-github-runner-207 kernel: [51800.556523] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 19:47:06 juju-e4d256-prod-github-runner-207 kernel: [51800.557759] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:47:06 juju-e4d256-prod-github-runner-207 kernel: [51800.558815] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 19:47:06 juju-e4d256-prod-github-runner-207 kernel: [51800.561372] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 19:47:06 juju-e4d256-prod-github-runner-207 kernel: [51800.562416] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 19:47:06 juju-e4d256-prod-github-runner-207 kernel: [51800.563596] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 19:47:06 juju-e4d256-prod-github-runner-207 kernel: [51800.564758] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 19:47:06 juju-e4d256-prod-github-runner-207 kernel: [51800.565919] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 19:47:06 juju-e4d256-prod-github-runner-207 kernel: [51800.567077] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 19:47:06 juju-e4d256-prod-github-runner-207 kernel: [51800.568340] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 19:47:06 juju-e4d256-prod-github-runner-207 kernel: [51800.569667] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 19:47:06 juju-e4d256-prod-github-runner-207 kernel: [51800.570761] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 19:47:06 juju-e4d256-prod-github-runner-207 kernel: [51800.571979] Call Trace: Aug 22 19:47:06 juju-e4d256-prod-github-runner-207 kernel: [51800.572898] Aug 22 19:47:06 juju-e4d256-prod-github-runner-207 kernel: [51800.573783] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:47:06 juju-e4d256-prod-github-runner-207 kernel: [51800.574812] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:47:06 juju-e4d256-prod-github-runner-207 kernel: [51800.575843] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:47:06 juju-e4d256-prod-github-runner-207 kernel: [51800.576917] ? show_regs.part.0+0x23/0x29 Aug 22 19:47:06 juju-e4d256-prod-github-runner-207 kernel: [51800.577916] ? show_regs.cold+0x8/0xd Aug 22 19:47:06 juju-e4d256-prod-github-runner-207 kernel: [51800.578888] ? watchdog_timer_fn+0x1be/0x220 Aug 22 19:47:06 juju-e4d256-prod-github-runner-207 kernel: [51800.579906] ? lockup_detector_update_enable+0x60/0x60 Aug 22 19:47:06 juju-e4d256-prod-github-runner-207 kernel: [51800.580971] ? __hrtimer_run_queues+0x107/0x230 Aug 22 19:47:06 juju-e4d256-prod-github-runner-207 kernel: [51800.581998] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 19:47:06 juju-e4d256-prod-github-runner-207 kernel: [51800.583020] ? hrtimer_interrupt+0x101/0x220 Aug 22 19:47:06 juju-e4d256-prod-github-runner-207 kernel: [51800.584054] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 19:47:06 juju-e4d256-prod-github-runner-207 kernel: [51800.585122] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 19:47:06 juju-e4d256-prod-github-runner-207 kernel: [51800.586166] Aug 22 19:47:06 juju-e4d256-prod-github-runner-207 kernel: [51800.587022] Aug 22 19:47:06 juju-e4d256-prod-github-runner-207 kernel: [51800.587876] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 19:47:06 juju-e4d256-prod-github-runner-207 kernel: [51800.588910] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:47:06 juju-e4d256-prod-github-runner-207 kernel: [51800.589951] ? _raw_spin_lock+0x22/0x30 Aug 22 19:47:06 juju-e4d256-prod-github-runner-207 kernel: [51800.590901] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:47:06 juju-e4d256-prod-github-runner-207 kernel: [51800.591947] direct_page_fault+0x206/0x310 [kvm] Aug 22 19:47:06 juju-e4d256-prod-github-runner-207 kernel: [51800.592983] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 19:47:06 juju-e4d256-prod-github-runner-207 kernel: [51800.593996] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 19:47:06 juju-e4d256-prod-github-runner-207 kernel: [51800.594996] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 19:47:06 juju-e4d256-prod-github-runner-207 kernel: [51800.595990] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 19:47:06 juju-e4d256-prod-github-runner-207 kernel: [51800.596938] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 19:47:06 juju-e4d256-prod-github-runner-207 kernel: [51800.597913] handle_exit+0x98/0x230 [kvm_amd] Aug 22 19:47:06 juju-e4d256-prod-github-runner-207 kernel: [51800.598802] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 19:47:06 juju-e4d256-prod-github-runner-207 kernel: [51800.599748] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 19:47:06 juju-e4d256-prod-github-runner-207 kernel: [51800.600672] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 19:47:06 juju-e4d256-prod-github-runner-207 kernel: [51800.601575] vcpu_run+0x62/0x2c0 [kvm] Aug 22 19:47:06 juju-e4d256-prod-github-runner-207 kernel: [51800.602398] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 19:47:06 juju-e4d256-prod-github-runner-207 kernel: [51800.603217] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 19:47:06 juju-e4d256-prod-github-runner-207 kernel: [51800.604099] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 19:47:06 juju-e4d256-prod-github-runner-207 kernel: [51800.604895] ? __seccomp_filter+0x4a/0x4a0 Aug 22 19:47:06 juju-e4d256-prod-github-runner-207 kernel: [51800.605638] ? __fget_files+0x86/0xc0 Aug 22 19:47:06 juju-e4d256-prod-github-runner-207 kernel: [51800.606341] __x64_sys_ioctl+0x95/0xd0 Aug 22 19:47:06 juju-e4d256-prod-github-runner-207 kernel: [51800.607032] do_syscall_64+0x5c/0xc0 Aug 22 19:47:06 juju-e4d256-prod-github-runner-207 kernel: [51800.607744] ? do_futex+0x162/0x1f0 Aug 22 19:47:06 juju-e4d256-prod-github-runner-207 kernel: [51800.608449] ? __x64_sys_futex+0x78/0x1e0 Aug 22 19:47:06 juju-e4d256-prod-github-runner-207 kernel: [51800.609180] ? __secure_computing+0xa9/0x120 Aug 22 19:47:06 juju-e4d256-prod-github-runner-207 kernel: [51800.609922] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 19:47:06 juju-e4d256-prod-github-runner-207 kernel: [51800.610748] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:47:06 juju-e4d256-prod-github-runner-207 kernel: [51800.611482] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:47:06 juju-e4d256-prod-github-runner-207 kernel: [51800.612309] ? do_syscall_64+0x69/0xc0 Aug 22 19:47:06 juju-e4d256-prod-github-runner-207 kernel: [51800.613008] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:47:06 juju-e4d256-prod-github-runner-207 kernel: [51800.613741] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:47:06 juju-e4d256-prod-github-runner-207 kernel: [51800.614499] ? do_syscall_64+0x69/0xc0 Aug 22 19:47:06 juju-e4d256-prod-github-runner-207 kernel: [51800.615183] ? do_syscall_64+0x69/0xc0 Aug 22 19:47:06 juju-e4d256-prod-github-runner-207 kernel: [51800.615912] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 19:47:06 juju-e4d256-prod-github-runner-207 kernel: [51800.616622] RIP: 0033:0x7faa5d0edaff Aug 22 19:47:06 juju-e4d256-prod-github-runner-207 kernel: [51800.617284] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 19:47:06 juju-e4d256-prod-github-runner-207 kernel: [51800.619392] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 19:47:06 juju-e4d256-prod-github-runner-207 kernel: [51800.620390] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 19:47:06 juju-e4d256-prod-github-runner-207 kernel: [51800.621336] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 19:47:06 juju-e4d256-prod-github-runner-207 kernel: [51800.622233] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 19:47:06 juju-e4d256-prod-github-runner-207 kernel: [51800.623118] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 19:47:06 juju-e4d256-prod-github-runner-207 kernel: [51800.624018] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 19:47:06 juju-e4d256-prod-github-runner-207 kernel: [51800.624912] Aug 22 19:47:34 juju-e4d256-prod-github-runner-207 kernel: [51828.541976] watchdog: BUG: soft lockup - CPU#1 stuck for 48161s! [qemu-system-x86:6715] Aug 22 19:47:34 juju-e4d256-prod-github-runner-207 kernel: [51828.543062] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 19:47:34 juju-e4d256-prod-github-runner-207 kernel: [51828.543126] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 19:47:34 juju-e4d256-prod-github-runner-207 kernel: [51828.555312] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 19:47:34 juju-e4d256-prod-github-runner-207 kernel: [51828.556594] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 19:47:34 juju-e4d256-prod-github-runner-207 kernel: [51828.557823] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:47:34 juju-e4d256-prod-github-runner-207 kernel: [51828.558879] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 19:47:34 juju-e4d256-prod-github-runner-207 kernel: [51828.561447] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 19:47:34 juju-e4d256-prod-github-runner-207 kernel: [51828.562518] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 19:47:34 juju-e4d256-prod-github-runner-207 kernel: [51828.563736] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 19:47:34 juju-e4d256-prod-github-runner-207 kernel: [51828.564893] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 19:47:34 juju-e4d256-prod-github-runner-207 kernel: [51828.566050] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 19:47:34 juju-e4d256-prod-github-runner-207 kernel: [51828.567268] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 19:47:34 juju-e4d256-prod-github-runner-207 kernel: [51828.568437] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 19:47:34 juju-e4d256-prod-github-runner-207 kernel: [51828.569668] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 19:47:34 juju-e4d256-prod-github-runner-207 kernel: [51828.570762] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 19:47:34 juju-e4d256-prod-github-runner-207 kernel: [51828.571968] Call Trace: Aug 22 19:47:34 juju-e4d256-prod-github-runner-207 kernel: [51828.572877] Aug 22 19:47:34 juju-e4d256-prod-github-runner-207 kernel: [51828.573757] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:47:34 juju-e4d256-prod-github-runner-207 kernel: [51828.574786] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:47:34 juju-e4d256-prod-github-runner-207 kernel: [51828.575825] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:47:34 juju-e4d256-prod-github-runner-207 kernel: [51828.576897] ? show_regs.part.0+0x23/0x29 Aug 22 19:47:34 juju-e4d256-prod-github-runner-207 kernel: [51828.577892] ? show_regs.cold+0x8/0xd Aug 22 19:47:34 juju-e4d256-prod-github-runner-207 kernel: [51828.578866] ? watchdog_timer_fn+0x1be/0x220 Aug 22 19:47:34 juju-e4d256-prod-github-runner-207 kernel: [51828.579890] ? lockup_detector_update_enable+0x60/0x60 Aug 22 19:47:34 juju-e4d256-prod-github-runner-207 kernel: [51828.580953] ? __hrtimer_run_queues+0x107/0x230 Aug 22 19:47:34 juju-e4d256-prod-github-runner-207 kernel: [51828.581989] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 19:47:34 juju-e4d256-prod-github-runner-207 kernel: [51828.583024] ? hrtimer_interrupt+0x101/0x220 Aug 22 19:47:34 juju-e4d256-prod-github-runner-207 kernel: [51828.584068] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 19:47:34 juju-e4d256-prod-github-runner-207 kernel: [51828.585136] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 19:47:34 juju-e4d256-prod-github-runner-207 kernel: [51828.586180] Aug 22 19:47:34 juju-e4d256-prod-github-runner-207 kernel: [51828.587037] Aug 22 19:47:34 juju-e4d256-prod-github-runner-207 kernel: [51828.587896] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 19:47:34 juju-e4d256-prod-github-runner-207 kernel: [51828.588927] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:47:34 juju-e4d256-prod-github-runner-207 kernel: [51828.589962] ? _raw_spin_lock+0x22/0x30 Aug 22 19:47:34 juju-e4d256-prod-github-runner-207 kernel: [51828.590905] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:47:34 juju-e4d256-prod-github-runner-207 kernel: [51828.591940] direct_page_fault+0x206/0x310 [kvm] Aug 22 19:47:34 juju-e4d256-prod-github-runner-207 kernel: [51828.592968] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 19:47:34 juju-e4d256-prod-github-runner-207 kernel: [51828.593976] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 19:47:34 juju-e4d256-prod-github-runner-207 kernel: [51828.595003] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 19:47:34 juju-e4d256-prod-github-runner-207 kernel: [51828.595995] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 19:47:34 juju-e4d256-prod-github-runner-207 kernel: [51828.596963] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 19:47:34 juju-e4d256-prod-github-runner-207 kernel: [51828.597942] handle_exit+0x98/0x230 [kvm_amd] Aug 22 19:47:34 juju-e4d256-prod-github-runner-207 kernel: [51828.598878] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 19:47:34 juju-e4d256-prod-github-runner-207 kernel: [51828.599861] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 19:47:34 juju-e4d256-prod-github-runner-207 kernel: [51828.600791] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 19:47:34 juju-e4d256-prod-github-runner-207 kernel: [51828.601694] vcpu_run+0x62/0x2c0 [kvm] Aug 22 19:47:34 juju-e4d256-prod-github-runner-207 kernel: [51828.602504] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 19:47:34 juju-e4d256-prod-github-runner-207 kernel: [51828.603320] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 19:47:34 juju-e4d256-prod-github-runner-207 kernel: [51828.604349] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 19:47:34 juju-e4d256-prod-github-runner-207 kernel: [51828.605146] ? __seccomp_filter+0x4a/0x4a0 Aug 22 19:47:34 juju-e4d256-prod-github-runner-207 kernel: [51828.605888] ? __fget_files+0x86/0xc0 Aug 22 19:47:34 juju-e4d256-prod-github-runner-207 kernel: [51828.606591] __x64_sys_ioctl+0x95/0xd0 Aug 22 19:47:34 juju-e4d256-prod-github-runner-207 kernel: [51828.607291] do_syscall_64+0x5c/0xc0 Aug 22 19:47:34 juju-e4d256-prod-github-runner-207 kernel: [51828.608010] ? do_futex+0x162/0x1f0 Aug 22 19:47:34 juju-e4d256-prod-github-runner-207 kernel: [51828.608658] ? __x64_sys_futex+0x78/0x1e0 Aug 22 19:47:34 juju-e4d256-prod-github-runner-207 kernel: [51828.609328] ? __secure_computing+0xa9/0x120 Aug 22 19:47:34 juju-e4d256-prod-github-runner-207 kernel: [51828.610014] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 19:47:34 juju-e4d256-prod-github-runner-207 kernel: [51828.610775] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:47:34 juju-e4d256-prod-github-runner-207 kernel: [51828.611523] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:47:34 juju-e4d256-prod-github-runner-207 kernel: [51828.612244] ? do_syscall_64+0x69/0xc0 Aug 22 19:47:34 juju-e4d256-prod-github-runner-207 kernel: [51828.612887] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:47:34 juju-e4d256-prod-github-runner-207 kernel: [51828.613593] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:47:34 juju-e4d256-prod-github-runner-207 kernel: [51828.614286] ? do_syscall_64+0x69/0xc0 Aug 22 19:47:34 juju-e4d256-prod-github-runner-207 kernel: [51828.614908] ? do_syscall_64+0x69/0xc0 Aug 22 19:47:34 juju-e4d256-prod-github-runner-207 kernel: [51828.615553] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 19:47:34 juju-e4d256-prod-github-runner-207 kernel: [51828.616261] RIP: 0033:0x7faa5d0edaff Aug 22 19:47:34 juju-e4d256-prod-github-runner-207 kernel: [51828.616894] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 19:47:34 juju-e4d256-prod-github-runner-207 kernel: [51828.618878] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 19:47:34 juju-e4d256-prod-github-runner-207 kernel: [51828.619807] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 19:47:34 juju-e4d256-prod-github-runner-207 kernel: [51828.620701] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 19:47:34 juju-e4d256-prod-github-runner-207 kernel: [51828.621588] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 19:47:34 juju-e4d256-prod-github-runner-207 kernel: [51828.622474] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 19:47:34 juju-e4d256-prod-github-runner-207 kernel: [51828.623372] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 19:47:34 juju-e4d256-prod-github-runner-207 kernel: [51828.624264] Aug 22 19:47:46 juju-e4d256-prod-github-runner-207 kernel: [51840.644709] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 19:47:46 juju-e4d256-prod-github-runner-207 kernel: [51840.645757] rcu: 1-....: (12890122 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=6232053 Aug 22 19:47:46 juju-e4d256-prod-github-runner-207 kernel: [51840.646890] (t=12930861 jiffies g=23269 q=48764) Aug 22 19:47:46 juju-e4d256-prod-github-runner-207 kernel: [51840.647697] NMI backtrace for cpu 1 Aug 22 19:47:46 juju-e4d256-prod-github-runner-207 kernel: [51840.648406] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 19:47:46 juju-e4d256-prod-github-runner-207 kernel: [51840.649705] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 19:47:46 juju-e4d256-prod-github-runner-207 kernel: [51840.650929] Call Trace: Aug 22 19:47:46 juju-e4d256-prod-github-runner-207 kernel: [51840.651706] Aug 22 19:47:46 juju-e4d256-prod-github-runner-207 kernel: [51840.652432] show_stack+0x52/0x5c Aug 22 19:47:46 juju-e4d256-prod-github-runner-207 kernel: [51840.653248] dump_stack_lvl+0x4a/0x63 Aug 22 19:47:46 juju-e4d256-prod-github-runner-207 kernel: [51840.654068] dump_stack+0x10/0x16 Aug 22 19:47:46 juju-e4d256-prod-github-runner-207 kernel: [51840.654858] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 19:47:46 juju-e4d256-prod-github-runner-207 kernel: [51840.655743] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 19:47:46 juju-e4d256-prod-github-runner-207 kernel: [51840.656613] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 19:47:46 juju-e4d256-prod-github-runner-207 kernel: [51840.657528] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 19:47:46 juju-e4d256-prod-github-runner-207 kernel: [51840.658468] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 19:47:46 juju-e4d256-prod-github-runner-207 kernel: [51840.659407] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 19:47:46 juju-e4d256-prod-github-runner-207 kernel: [51840.660269] print_cpu_stall.cold+0x2f/0xe2 Aug 22 19:47:46 juju-e4d256-prod-github-runner-207 kernel: [51840.661119] ? timekeeping_update+0xf7/0x150 Aug 22 19:47:46 juju-e4d256-prod-github-runner-207 kernel: [51840.661973] check_cpu_stall+0x109/0x270 Aug 22 19:47:46 juju-e4d256-prod-github-runner-207 kernel: [51840.662811] rcu_sched_clock_irq+0x9a/0x250 Aug 22 19:47:46 juju-e4d256-prod-github-runner-207 kernel: [51840.663699] update_process_times+0x94/0xd0 Aug 22 19:47:46 juju-e4d256-prod-github-runner-207 kernel: [51840.664546] tick_sched_handle+0x29/0x70 Aug 22 19:47:46 juju-e4d256-prod-github-runner-207 kernel: [51840.665372] tick_sched_timer+0x8c/0xc0 Aug 22 19:47:46 juju-e4d256-prod-github-runner-207 kernel: [51840.666188] ? tick_nohz_handler+0xb0/0xb0 Aug 22 19:47:46 juju-e4d256-prod-github-runner-207 kernel: [51840.667066] __hrtimer_run_queues+0x107/0x230 Aug 22 19:47:46 juju-e4d256-prod-github-runner-207 kernel: [51840.667942] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 19:47:46 juju-e4d256-prod-github-runner-207 kernel: [51840.668808] hrtimer_interrupt+0x101/0x220 Aug 22 19:47:46 juju-e4d256-prod-github-runner-207 kernel: [51840.669653] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 19:47:46 juju-e4d256-prod-github-runner-207 kernel: [51840.670566] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 19:47:46 juju-e4d256-prod-github-runner-207 kernel: [51840.671487] Aug 22 19:47:46 juju-e4d256-prod-github-runner-207 kernel: [51840.672174] Aug 22 19:47:46 juju-e4d256-prod-github-runner-207 kernel: [51840.672850] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 19:47:46 juju-e4d256-prod-github-runner-207 kernel: [51840.673771] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:47:46 juju-e4d256-prod-github-runner-207 kernel: [51840.674767] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 19:47:46 juju-e4d256-prod-github-runner-207 kernel: [51840.677325] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 19:47:46 juju-e4d256-prod-github-runner-207 kernel: [51840.678302] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 19:47:46 juju-e4d256-prod-github-runner-207 kernel: [51840.679447] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 19:47:46 juju-e4d256-prod-github-runner-207 kernel: [51840.680562] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 19:47:46 juju-e4d256-prod-github-runner-207 kernel: [51840.681659] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 19:47:46 juju-e4d256-prod-github-runner-207 kernel: [51840.682753] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 19:47:46 juju-e4d256-prod-github-runner-207 kernel: [51840.683853] ? _raw_spin_lock+0x22/0x30 Aug 22 19:47:46 juju-e4d256-prod-github-runner-207 kernel: [51840.684698] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:47:46 juju-e4d256-prod-github-runner-207 kernel: [51840.685648] direct_page_fault+0x206/0x310 [kvm] Aug 22 19:47:46 juju-e4d256-prod-github-runner-207 kernel: [51840.686585] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 19:47:46 juju-e4d256-prod-github-runner-207 kernel: [51840.687523] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 19:47:46 juju-e4d256-prod-github-runner-207 kernel: [51840.688459] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 19:47:46 juju-e4d256-prod-github-runner-207 kernel: [51840.689372] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 19:47:46 juju-e4d256-prod-github-runner-207 kernel: [51840.690258] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 19:47:46 juju-e4d256-prod-github-runner-207 kernel: [51840.691213] handle_exit+0x98/0x230 [kvm_amd] Aug 22 19:47:46 juju-e4d256-prod-github-runner-207 kernel: [51840.692057] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 19:47:46 juju-e4d256-prod-github-runner-207 kernel: [51840.692947] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 19:47:46 juju-e4d256-prod-github-runner-207 kernel: [51840.693858] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 19:47:46 juju-e4d256-prod-github-runner-207 kernel: [51840.694748] vcpu_run+0x62/0x2c0 [kvm] Aug 22 19:47:46 juju-e4d256-prod-github-runner-207 kernel: [51840.695553] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 19:47:46 juju-e4d256-prod-github-runner-207 kernel: [51840.696380] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 19:47:46 juju-e4d256-prod-github-runner-207 kernel: [51840.697282] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 19:47:46 juju-e4d256-prod-github-runner-207 kernel: [51840.698126] ? __seccomp_filter+0x4a/0x4a0 Aug 22 19:47:46 juju-e4d256-prod-github-runner-207 kernel: [51840.698936] ? __fget_files+0x86/0xc0 Aug 22 19:47:46 juju-e4d256-prod-github-runner-207 kernel: [51840.699765] __x64_sys_ioctl+0x95/0xd0 Aug 22 19:47:46 juju-e4d256-prod-github-runner-207 kernel: [51840.700589] do_syscall_64+0x5c/0xc0 Aug 22 19:47:46 juju-e4d256-prod-github-runner-207 kernel: [51840.701597] ? do_futex+0x162/0x1f0 Aug 22 19:47:46 juju-e4d256-prod-github-runner-207 kernel: [51840.702352] ? __x64_sys_futex+0x78/0x1e0 Aug 22 19:47:46 juju-e4d256-prod-github-runner-207 kernel: [51840.703149] ? __secure_computing+0xa9/0x120 Aug 22 19:47:46 juju-e4d256-prod-github-runner-207 kernel: [51840.703949] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 19:47:46 juju-e4d256-prod-github-runner-207 kernel: [51840.704841] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:47:46 juju-e4d256-prod-github-runner-207 kernel: [51840.705690] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:47:46 juju-e4d256-prod-github-runner-207 kernel: [51840.706547] ? do_syscall_64+0x69/0xc0 Aug 22 19:47:46 juju-e4d256-prod-github-runner-207 kernel: [51840.707334] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:47:46 juju-e4d256-prod-github-runner-207 kernel: [51840.708194] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:47:46 juju-e4d256-prod-github-runner-207 kernel: [51840.709050] ? do_syscall_64+0x69/0xc0 Aug 22 19:47:46 juju-e4d256-prod-github-runner-207 kernel: [51840.709826] ? do_syscall_64+0x69/0xc0 Aug 22 19:47:46 juju-e4d256-prod-github-runner-207 kernel: [51840.710595] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 19:47:46 juju-e4d256-prod-github-runner-207 kernel: [51840.711491] RIP: 0033:0x7faa5d0edaff Aug 22 19:47:46 juju-e4d256-prod-github-runner-207 kernel: [51840.712269] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 19:47:46 juju-e4d256-prod-github-runner-207 kernel: [51840.714720] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 19:47:46 juju-e4d256-prod-github-runner-207 kernel: [51840.715860] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 19:47:46 juju-e4d256-prod-github-runner-207 kernel: [51840.716951] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 19:47:46 juju-e4d256-prod-github-runner-207 kernel: [51840.717988] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 19:47:46 juju-e4d256-prod-github-runner-207 kernel: [51840.719105] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 19:47:46 juju-e4d256-prod-github-runner-207 kernel: [51840.720206] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 19:47:46 juju-e4d256-prod-github-runner-207 kernel: [51840.721180] Aug 22 19:48:14 juju-e4d256-prod-github-runner-207 kernel: [51868.541982] watchdog: BUG: soft lockup - CPU#1 stuck for 48198s! [qemu-system-x86:6715] Aug 22 19:48:14 juju-e4d256-prod-github-runner-207 kernel: [51868.543788] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 19:48:14 juju-e4d256-prod-github-runner-207 kernel: [51868.544013] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 19:48:14 juju-e4d256-prod-github-runner-207 kernel: [51868.556854] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 19:48:14 juju-e4d256-prod-github-runner-207 kernel: [51868.558324] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 19:48:14 juju-e4d256-prod-github-runner-207 kernel: [51868.559811] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:48:14 juju-e4d256-prod-github-runner-207 kernel: [51868.561029] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 19:48:14 juju-e4d256-prod-github-runner-207 kernel: [51868.563922] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 19:48:14 juju-e4d256-prod-github-runner-207 kernel: [51868.565077] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 19:48:14 juju-e4d256-prod-github-runner-207 kernel: [51868.566382] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 19:48:14 juju-e4d256-prod-github-runner-207 kernel: [51868.567724] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 19:48:14 juju-e4d256-prod-github-runner-207 kernel: [51868.569029] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 19:48:14 juju-e4d256-prod-github-runner-207 kernel: [51868.570333] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 19:48:14 juju-e4d256-prod-github-runner-207 kernel: [51868.571651] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 19:48:14 juju-e4d256-prod-github-runner-207 kernel: [51868.573039] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 19:48:14 juju-e4d256-prod-github-runner-207 kernel: [51868.574254] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 19:48:14 juju-e4d256-prod-github-runner-207 kernel: [51868.575604] Call Trace: Aug 22 19:48:14 juju-e4d256-prod-github-runner-207 kernel: [51868.576572] Aug 22 19:48:14 juju-e4d256-prod-github-runner-207 kernel: [51868.577515] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:48:14 juju-e4d256-prod-github-runner-207 kernel: [51868.578656] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:48:14 juju-e4d256-prod-github-runner-207 kernel: [51868.579887] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:48:14 juju-e4d256-prod-github-runner-207 kernel: [51868.581008] ? show_regs.part.0+0x23/0x29 Aug 22 19:48:14 juju-e4d256-prod-github-runner-207 kernel: [51868.582060] ? show_regs.cold+0x8/0xd Aug 22 19:48:14 juju-e4d256-prod-github-runner-207 kernel: [51868.583070] ? watchdog_timer_fn+0x1be/0x220 Aug 22 19:48:14 juju-e4d256-prod-github-runner-207 kernel: [51868.584092] ? lockup_detector_update_enable+0x60/0x60 Aug 22 19:48:14 juju-e4d256-prod-github-runner-207 kernel: [51868.585286] ? __hrtimer_run_queues+0x107/0x230 Aug 22 19:48:14 juju-e4d256-prod-github-runner-207 kernel: [51868.586325] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 19:48:14 juju-e4d256-prod-github-runner-207 kernel: [51868.587496] ? hrtimer_interrupt+0x101/0x220 Aug 22 19:48:14 juju-e4d256-prod-github-runner-207 kernel: [51868.588750] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 19:48:14 juju-e4d256-prod-github-runner-207 kernel: [51868.590140] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 19:48:14 juju-e4d256-prod-github-runner-207 kernel: [51868.591430] Aug 22 19:48:14 juju-e4d256-prod-github-runner-207 kernel: [51868.592504] Aug 22 19:48:14 juju-e4d256-prod-github-runner-207 kernel: [51868.593556] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 19:48:14 juju-e4d256-prod-github-runner-207 kernel: [51868.594870] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:48:14 juju-e4d256-prod-github-runner-207 kernel: [51868.596022] ? _raw_spin_lock+0x22/0x30 Aug 22 19:48:14 juju-e4d256-prod-github-runner-207 kernel: [51868.597046] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:48:14 juju-e4d256-prod-github-runner-207 kernel: [51868.598310] direct_page_fault+0x206/0x310 [kvm] Aug 22 19:48:14 juju-e4d256-prod-github-runner-207 kernel: [51868.599549] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 19:48:14 juju-e4d256-prod-github-runner-207 kernel: [51868.600701] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 19:48:14 juju-e4d256-prod-github-runner-207 kernel: [51868.601915] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 19:48:14 juju-e4d256-prod-github-runner-207 kernel: [51868.603065] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 19:48:14 juju-e4d256-prod-github-runner-207 kernel: [51868.604483] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 19:48:14 juju-e4d256-prod-github-runner-207 kernel: [51868.605769] handle_exit+0x98/0x230 [kvm_amd] Aug 22 19:48:14 juju-e4d256-prod-github-runner-207 kernel: [51868.606919] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 19:48:14 juju-e4d256-prod-github-runner-207 kernel: [51868.607917] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 19:48:14 juju-e4d256-prod-github-runner-207 kernel: [51868.608972] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 19:48:14 juju-e4d256-prod-github-runner-207 kernel: [51868.610247] vcpu_run+0x62/0x2c0 [kvm] Aug 22 19:48:14 juju-e4d256-prod-github-runner-207 kernel: [51868.611218] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 19:48:14 juju-e4d256-prod-github-runner-207 kernel: [51868.612125] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 19:48:14 juju-e4d256-prod-github-runner-207 kernel: [51868.613122] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 19:48:14 juju-e4d256-prod-github-runner-207 kernel: [51868.614331] ? __seccomp_filter+0x4a/0x4a0 Aug 22 19:48:14 juju-e4d256-prod-github-runner-207 kernel: [51868.615537] ? __fget_files+0x86/0xc0 Aug 22 19:48:14 juju-e4d256-prod-github-runner-207 kernel: [51868.616611] __x64_sys_ioctl+0x95/0xd0 Aug 22 19:48:14 juju-e4d256-prod-github-runner-207 kernel: [51868.617718] do_syscall_64+0x5c/0xc0 Aug 22 19:48:14 juju-e4d256-prod-github-runner-207 kernel: [51868.618770] ? do_futex+0x162/0x1f0 Aug 22 19:48:14 juju-e4d256-prod-github-runner-207 kernel: [51868.619788] ? __x64_sys_futex+0x78/0x1e0 Aug 22 19:48:14 juju-e4d256-prod-github-runner-207 kernel: [51868.620838] ? __secure_computing+0xa9/0x120 Aug 22 19:48:14 juju-e4d256-prod-github-runner-207 kernel: [51868.621912] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 19:48:14 juju-e4d256-prod-github-runner-207 kernel: [51868.623028] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:48:14 juju-e4d256-prod-github-runner-207 kernel: [51868.624338] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:48:14 juju-e4d256-prod-github-runner-207 kernel: [51868.625375] ? do_syscall_64+0x69/0xc0 Aug 22 19:48:14 juju-e4d256-prod-github-runner-207 kernel: [51868.626378] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:48:14 juju-e4d256-prod-github-runner-207 kernel: [51868.627454] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:48:14 juju-e4d256-prod-github-runner-207 kernel: [51868.628529] ? do_syscall_64+0x69/0xc0 Aug 22 19:48:14 juju-e4d256-prod-github-runner-207 kernel: [51868.629495] ? do_syscall_64+0x69/0xc0 Aug 22 19:48:14 juju-e4d256-prod-github-runner-207 kernel: [51868.630454] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 19:48:14 juju-e4d256-prod-github-runner-207 kernel: [51868.631465] RIP: 0033:0x7faa5d0edaff Aug 22 19:48:14 juju-e4d256-prod-github-runner-207 kernel: [51868.632446] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 19:48:14 juju-e4d256-prod-github-runner-207 kernel: [51868.635278] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 19:48:14 juju-e4d256-prod-github-runner-207 kernel: [51868.636692] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 19:48:14 juju-e4d256-prod-github-runner-207 kernel: [51868.638052] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 19:48:14 juju-e4d256-prod-github-runner-207 kernel: [51868.639421] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 19:48:14 juju-e4d256-prod-github-runner-207 kernel: [51868.640930] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 19:48:14 juju-e4d256-prod-github-runner-207 kernel: [51868.642221] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 19:48:14 juju-e4d256-prod-github-runner-207 kernel: [51868.643610] Aug 22 19:48:42 juju-e4d256-prod-github-runner-207 kernel: [51896.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 48224s! [qemu-system-x86:6715] Aug 22 19:48:42 juju-e4d256-prod-github-runner-207 kernel: [51896.543589] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 19:48:42 juju-e4d256-prod-github-runner-207 kernel: [51896.543672] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 19:48:42 juju-e4d256-prod-github-runner-207 kernel: [51896.556135] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 19:48:42 juju-e4d256-prod-github-runner-207 kernel: [51896.557434] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 19:48:42 juju-e4d256-prod-github-runner-207 kernel: [51896.558686] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:48:42 juju-e4d256-prod-github-runner-207 kernel: [51896.559762] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 19:48:42 juju-e4d256-prod-github-runner-207 kernel: [51896.562385] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 19:48:42 juju-e4d256-prod-github-runner-207 kernel: [51896.563447] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 19:48:42 juju-e4d256-prod-github-runner-207 kernel: [51896.564635] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 19:48:42 juju-e4d256-prod-github-runner-207 kernel: [51896.565836] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 19:48:42 juju-e4d256-prod-github-runner-207 kernel: [51896.567035] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 19:48:42 juju-e4d256-prod-github-runner-207 kernel: [51896.568377] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 19:48:42 juju-e4d256-prod-github-runner-207 kernel: [51896.569572] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 19:48:42 juju-e4d256-prod-github-runner-207 kernel: [51896.570898] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 19:48:42 juju-e4d256-prod-github-runner-207 kernel: [51896.572052] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 19:48:42 juju-e4d256-prod-github-runner-207 kernel: [51896.573266] Call Trace: Aug 22 19:48:42 juju-e4d256-prod-github-runner-207 kernel: [51896.574390] Aug 22 19:48:42 juju-e4d256-prod-github-runner-207 kernel: [51896.575292] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:48:42 juju-e4d256-prod-github-runner-207 kernel: [51896.576377] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:48:42 juju-e4d256-prod-github-runner-207 kernel: [51896.577438] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:48:42 juju-e4d256-prod-github-runner-207 kernel: [51896.578621] ? show_regs.part.0+0x23/0x29 Aug 22 19:48:42 juju-e4d256-prod-github-runner-207 kernel: [51896.579646] ? show_regs.cold+0x8/0xd Aug 22 19:48:42 juju-e4d256-prod-github-runner-207 kernel: [51896.580670] ? watchdog_timer_fn+0x1be/0x220 Aug 22 19:48:42 juju-e4d256-prod-github-runner-207 kernel: [51896.581724] ? lockup_detector_update_enable+0x60/0x60 Aug 22 19:48:42 juju-e4d256-prod-github-runner-207 kernel: [51896.582823] ? __hrtimer_run_queues+0x107/0x230 Aug 22 19:48:42 juju-e4d256-prod-github-runner-207 kernel: [51896.583905] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 19:48:42 juju-e4d256-prod-github-runner-207 kernel: [51896.584972] ? hrtimer_interrupt+0x101/0x220 Aug 22 19:48:42 juju-e4d256-prod-github-runner-207 kernel: [51896.586021] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 19:48:42 juju-e4d256-prod-github-runner-207 kernel: [51896.587135] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 19:48:42 juju-e4d256-prod-github-runner-207 kernel: [51896.588199] Aug 22 19:48:42 juju-e4d256-prod-github-runner-207 kernel: [51896.589068] Aug 22 19:48:42 juju-e4d256-prod-github-runner-207 kernel: [51896.589932] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 19:48:42 juju-e4d256-prod-github-runner-207 kernel: [51896.591039] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:48:42 juju-e4d256-prod-github-runner-207 kernel: [51896.592131] ? _raw_spin_lock+0x22/0x30 Aug 22 19:48:42 juju-e4d256-prod-github-runner-207 kernel: [51896.593117] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:48:42 juju-e4d256-prod-github-runner-207 kernel: [51896.594211] direct_page_fault+0x206/0x310 [kvm] Aug 22 19:48:42 juju-e4d256-prod-github-runner-207 kernel: [51896.595309] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 19:48:42 juju-e4d256-prod-github-runner-207 kernel: [51896.596374] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 19:48:42 juju-e4d256-prod-github-runner-207 kernel: [51896.597436] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 19:48:42 juju-e4d256-prod-github-runner-207 kernel: [51896.598445] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 19:48:42 juju-e4d256-prod-github-runner-207 kernel: [51896.599438] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 19:48:42 juju-e4d256-prod-github-runner-207 kernel: [51896.600450] handle_exit+0x98/0x230 [kvm_amd] Aug 22 19:48:42 juju-e4d256-prod-github-runner-207 kernel: [51896.601383] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 19:48:42 juju-e4d256-prod-github-runner-207 kernel: [51896.602410] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 19:48:42 juju-e4d256-prod-github-runner-207 kernel: [51896.603375] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 19:48:42 juju-e4d256-prod-github-runner-207 kernel: [51896.604337] vcpu_run+0x62/0x2c0 [kvm] Aug 22 19:48:42 juju-e4d256-prod-github-runner-207 kernel: [51896.605175] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 19:48:42 juju-e4d256-prod-github-runner-207 kernel: [51896.606052] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 19:48:42 juju-e4d256-prod-github-runner-207 kernel: [51896.607033] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 19:48:42 juju-e4d256-prod-github-runner-207 kernel: [51896.607862] ? __seccomp_filter+0x4a/0x4a0 Aug 22 19:48:42 juju-e4d256-prod-github-runner-207 kernel: [51896.608624] ? __fget_files+0x86/0xc0 Aug 22 19:48:42 juju-e4d256-prod-github-runner-207 kernel: [51896.609344] __x64_sys_ioctl+0x95/0xd0 Aug 22 19:48:42 juju-e4d256-prod-github-runner-207 kernel: [51896.610066] do_syscall_64+0x5c/0xc0 Aug 22 19:48:42 juju-e4d256-prod-github-runner-207 kernel: [51896.610817] ? do_futex+0x162/0x1f0 Aug 22 19:48:42 juju-e4d256-prod-github-runner-207 kernel: [51896.611514] ? __x64_sys_futex+0x78/0x1e0 Aug 22 19:48:42 juju-e4d256-prod-github-runner-207 kernel: [51896.612216] ? __secure_computing+0xa9/0x120 Aug 22 19:48:42 juju-e4d256-prod-github-runner-207 kernel: [51896.612925] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 19:48:42 juju-e4d256-prod-github-runner-207 kernel: [51896.613709] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:48:42 juju-e4d256-prod-github-runner-207 kernel: [51896.614482] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:48:42 juju-e4d256-prod-github-runner-207 kernel: [51896.615398] ? do_syscall_64+0x69/0xc0 Aug 22 19:48:42 juju-e4d256-prod-github-runner-207 kernel: [51896.616180] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:48:42 juju-e4d256-prod-github-runner-207 kernel: [51896.617076] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:48:42 juju-e4d256-prod-github-runner-207 kernel: [51896.617813] ? do_syscall_64+0x69/0xc0 Aug 22 19:48:42 juju-e4d256-prod-github-runner-207 kernel: [51896.618487] ? do_syscall_64+0x69/0xc0 Aug 22 19:48:42 juju-e4d256-prod-github-runner-207 kernel: [51896.619124] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 19:48:42 juju-e4d256-prod-github-runner-207 kernel: [51896.619850] RIP: 0033:0x7faa5d0edaff Aug 22 19:48:42 juju-e4d256-prod-github-runner-207 kernel: [51896.620491] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 19:48:42 juju-e4d256-prod-github-runner-207 kernel: [51896.622542] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 19:48:42 juju-e4d256-prod-github-runner-207 kernel: [51896.623472] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 19:48:42 juju-e4d256-prod-github-runner-207 kernel: [51896.624382] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 19:48:42 juju-e4d256-prod-github-runner-207 kernel: [51896.625294] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 19:48:42 juju-e4d256-prod-github-runner-207 kernel: [51896.626201] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 19:48:42 juju-e4d256-prod-github-runner-207 kernel: [51896.627175] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 19:48:42 juju-e4d256-prod-github-runner-207 kernel: [51896.628112] Aug 22 19:49:10 juju-e4d256-prod-github-runner-207 kernel: [51924.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 48250s! [qemu-system-x86:6715] Aug 22 19:49:10 juju-e4d256-prod-github-runner-207 kernel: [51924.543147] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 19:49:10 juju-e4d256-prod-github-runner-207 kernel: [51924.543215] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 19:49:10 juju-e4d256-prod-github-runner-207 kernel: [51924.556004] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 19:49:10 juju-e4d256-prod-github-runner-207 kernel: [51924.557319] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 19:49:10 juju-e4d256-prod-github-runner-207 kernel: [51924.558616] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:49:10 juju-e4d256-prod-github-runner-207 kernel: [51924.559731] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 19:49:10 juju-e4d256-prod-github-runner-207 kernel: [51924.563100] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 19:49:10 juju-e4d256-prod-github-runner-207 kernel: [51924.564881] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 19:49:10 juju-e4d256-prod-github-runner-207 kernel: [51924.566889] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 19:49:10 juju-e4d256-prod-github-runner-207 kernel: [51924.568768] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 19:49:10 juju-e4d256-prod-github-runner-207 kernel: [51924.570137] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 19:49:10 juju-e4d256-prod-github-runner-207 kernel: [51924.571352] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 19:49:10 juju-e4d256-prod-github-runner-207 kernel: [51924.572569] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 19:49:10 juju-e4d256-prod-github-runner-207 kernel: [51924.573831] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 19:49:10 juju-e4d256-prod-github-runner-207 kernel: [51924.575011] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 19:49:10 juju-e4d256-prod-github-runner-207 kernel: [51924.576239] Call Trace: Aug 22 19:49:10 juju-e4d256-prod-github-runner-207 kernel: [51924.577190] Aug 22 19:49:10 juju-e4d256-prod-github-runner-207 kernel: [51924.578136] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:49:10 juju-e4d256-prod-github-runner-207 kernel: [51924.579182] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:49:10 juju-e4d256-prod-github-runner-207 kernel: [51924.580209] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:49:10 juju-e4d256-prod-github-runner-207 kernel: [51924.581292] ? show_regs.part.0+0x23/0x29 Aug 22 19:49:10 juju-e4d256-prod-github-runner-207 kernel: [51924.582313] ? show_regs.cold+0x8/0xd Aug 22 19:49:10 juju-e4d256-prod-github-runner-207 kernel: [51924.583289] ? watchdog_timer_fn+0x1be/0x220 Aug 22 19:49:10 juju-e4d256-prod-github-runner-207 kernel: [51924.584298] ? lockup_detector_update_enable+0x60/0x60 Aug 22 19:49:10 juju-e4d256-prod-github-runner-207 kernel: [51924.585361] ? __hrtimer_run_queues+0x107/0x230 Aug 22 19:49:10 juju-e4d256-prod-github-runner-207 kernel: [51924.586412] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 19:49:10 juju-e4d256-prod-github-runner-207 kernel: [51924.587442] ? hrtimer_interrupt+0x101/0x220 Aug 22 19:49:10 juju-e4d256-prod-github-runner-207 kernel: [51924.588463] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 19:49:10 juju-e4d256-prod-github-runner-207 kernel: [51924.589540] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 19:49:10 juju-e4d256-prod-github-runner-207 kernel: [51924.590614] Aug 22 19:49:10 juju-e4d256-prod-github-runner-207 kernel: [51924.591661] Aug 22 19:49:10 juju-e4d256-prod-github-runner-207 kernel: [51924.592498] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 19:49:10 juju-e4d256-prod-github-runner-207 kernel: [51924.593531] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:49:10 juju-e4d256-prod-github-runner-207 kernel: [51924.594579] ? _raw_spin_lock+0x22/0x30 Aug 22 19:49:10 juju-e4d256-prod-github-runner-207 kernel: [51924.595522] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:49:10 juju-e4d256-prod-github-runner-207 kernel: [51924.596563] direct_page_fault+0x206/0x310 [kvm] Aug 22 19:49:10 juju-e4d256-prod-github-runner-207 kernel: [51924.597654] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 19:49:10 juju-e4d256-prod-github-runner-207 kernel: [51924.598685] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 19:49:10 juju-e4d256-prod-github-runner-207 kernel: [51924.599687] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 19:49:10 juju-e4d256-prod-github-runner-207 kernel: [51924.601004] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 19:49:10 juju-e4d256-prod-github-runner-207 kernel: [51924.602092] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 19:49:10 juju-e4d256-prod-github-runner-207 kernel: [51924.603288] handle_exit+0x98/0x230 [kvm_amd] Aug 22 19:49:10 juju-e4d256-prod-github-runner-207 kernel: [51924.604268] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 19:49:10 juju-e4d256-prod-github-runner-207 kernel: [51924.605284] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 19:49:10 juju-e4d256-prod-github-runner-207 kernel: [51924.606334] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 19:49:10 juju-e4d256-prod-github-runner-207 kernel: [51924.607363] vcpu_run+0x62/0x2c0 [kvm] Aug 22 19:49:10 juju-e4d256-prod-github-runner-207 kernel: [51924.608250] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 19:49:10 juju-e4d256-prod-github-runner-207 kernel: [51924.609191] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 19:49:10 juju-e4d256-prod-github-runner-207 kernel: [51924.610178] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 19:49:10 juju-e4d256-prod-github-runner-207 kernel: [51924.611072] ? __seccomp_filter+0x4a/0x4a0 Aug 22 19:49:10 juju-e4d256-prod-github-runner-207 kernel: [51924.611896] ? __fget_files+0x86/0xc0 Aug 22 19:49:10 juju-e4d256-prod-github-runner-207 kernel: [51924.612679] __x64_sys_ioctl+0x95/0xd0 Aug 22 19:49:10 juju-e4d256-prod-github-runner-207 kernel: [51924.613450] do_syscall_64+0x5c/0xc0 Aug 22 19:49:10 juju-e4d256-prod-github-runner-207 kernel: [51924.614216] ? do_futex+0x162/0x1f0 Aug 22 19:49:10 juju-e4d256-prod-github-runner-207 kernel: [51924.614944] ? __x64_sys_futex+0x78/0x1e0 Aug 22 19:49:10 juju-e4d256-prod-github-runner-207 kernel: [51924.615713] ? __secure_computing+0xa9/0x120 Aug 22 19:49:10 juju-e4d256-prod-github-runner-207 kernel: [51924.616505] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 19:49:10 juju-e4d256-prod-github-runner-207 kernel: [51924.617322] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:49:10 juju-e4d256-prod-github-runner-207 kernel: [51924.618083] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:49:10 juju-e4d256-prod-github-runner-207 kernel: [51924.618810] ? do_syscall_64+0x69/0xc0 Aug 22 19:49:10 juju-e4d256-prod-github-runner-207 kernel: [51924.619462] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:49:10 juju-e4d256-prod-github-runner-207 kernel: [51924.620222] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:49:10 juju-e4d256-prod-github-runner-207 kernel: [51924.620932] ? do_syscall_64+0x69/0xc0 Aug 22 19:49:10 juju-e4d256-prod-github-runner-207 kernel: [51924.621570] ? do_syscall_64+0x69/0xc0 Aug 22 19:49:10 juju-e4d256-prod-github-runner-207 kernel: [51924.622223] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 19:49:10 juju-e4d256-prod-github-runner-207 kernel: [51924.622947] RIP: 0033:0x7faa5d0edaff Aug 22 19:49:10 juju-e4d256-prod-github-runner-207 kernel: [51924.623603] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 19:49:10 juju-e4d256-prod-github-runner-207 kernel: [51924.625621] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 19:49:10 juju-e4d256-prod-github-runner-207 kernel: [51924.626568] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 19:49:10 juju-e4d256-prod-github-runner-207 kernel: [51924.627487] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 19:49:10 juju-e4d256-prod-github-runner-207 kernel: [51924.628393] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 19:49:10 juju-e4d256-prod-github-runner-207 kernel: [51924.629292] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 19:49:10 juju-e4d256-prod-github-runner-207 kernel: [51924.630218] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 19:49:10 juju-e4d256-prod-github-runner-207 kernel: [51924.631141] Aug 22 19:49:38 juju-e4d256-prod-github-runner-207 kernel: [51952.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 48276s! [qemu-system-x86:6715] Aug 22 19:49:38 juju-e4d256-prod-github-runner-207 kernel: [51952.543742] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 19:49:38 juju-e4d256-prod-github-runner-207 kernel: [51952.544004] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 19:49:38 juju-e4d256-prod-github-runner-207 kernel: [51952.556138] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 19:49:38 juju-e4d256-prod-github-runner-207 kernel: [51952.557406] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 19:49:38 juju-e4d256-prod-github-runner-207 kernel: [51952.558652] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:49:38 juju-e4d256-prod-github-runner-207 kernel: [51952.559720] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 19:49:38 juju-e4d256-prod-github-runner-207 kernel: [51952.562326] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 19:49:38 juju-e4d256-prod-github-runner-207 kernel: [51952.563382] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 19:49:38 juju-e4d256-prod-github-runner-207 kernel: [51952.564580] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 19:49:38 juju-e4d256-prod-github-runner-207 kernel: [51952.565793] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 19:49:38 juju-e4d256-prod-github-runner-207 kernel: [51952.566972] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 19:49:38 juju-e4d256-prod-github-runner-207 kernel: [51952.568137] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 19:49:38 juju-e4d256-prod-github-runner-207 kernel: [51952.569309] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 19:49:38 juju-e4d256-prod-github-runner-207 kernel: [51952.570581] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 19:49:38 juju-e4d256-prod-github-runner-207 kernel: [51952.571679] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 19:49:38 juju-e4d256-prod-github-runner-207 kernel: [51952.572879] Call Trace: Aug 22 19:49:38 juju-e4d256-prod-github-runner-207 kernel: [51952.573814] Aug 22 19:49:38 juju-e4d256-prod-github-runner-207 kernel: [51952.574722] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:49:38 juju-e4d256-prod-github-runner-207 kernel: [51952.575758] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:49:38 juju-e4d256-prod-github-runner-207 kernel: [51952.576777] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:49:38 juju-e4d256-prod-github-runner-207 kernel: [51952.577894] ? show_regs.part.0+0x23/0x29 Aug 22 19:49:38 juju-e4d256-prod-github-runner-207 kernel: [51952.578895] ? show_regs.cold+0x8/0xd Aug 22 19:49:38 juju-e4d256-prod-github-runner-207 kernel: [51952.579869] ? watchdog_timer_fn+0x1be/0x220 Aug 22 19:49:38 juju-e4d256-prod-github-runner-207 kernel: [51952.580896] ? lockup_detector_update_enable+0x60/0x60 Aug 22 19:49:38 juju-e4d256-prod-github-runner-207 kernel: [51952.581990] ? __hrtimer_run_queues+0x107/0x230 Aug 22 19:49:38 juju-e4d256-prod-github-runner-207 kernel: [51952.583018] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 19:49:38 juju-e4d256-prod-github-runner-207 kernel: [51952.584045] ? hrtimer_interrupt+0x101/0x220 Aug 22 19:49:38 juju-e4d256-prod-github-runner-207 kernel: [51952.585062] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 19:49:38 juju-e4d256-prod-github-runner-207 kernel: [51952.586144] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 19:49:38 juju-e4d256-prod-github-runner-207 kernel: [51952.587189] Aug 22 19:49:38 juju-e4d256-prod-github-runner-207 kernel: [51952.588045] Aug 22 19:49:38 juju-e4d256-prod-github-runner-207 kernel: [51952.588885] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 19:49:38 juju-e4d256-prod-github-runner-207 kernel: [51952.589939] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:49:38 juju-e4d256-prod-github-runner-207 kernel: [51952.590977] ? _raw_spin_lock+0x22/0x30 Aug 22 19:49:38 juju-e4d256-prod-github-runner-207 kernel: [51952.591930] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:49:38 juju-e4d256-prod-github-runner-207 kernel: [51952.593008] direct_page_fault+0x206/0x310 [kvm] Aug 22 19:49:38 juju-e4d256-prod-github-runner-207 kernel: [51952.594214] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 19:49:38 juju-e4d256-prod-github-runner-207 kernel: [51952.595255] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 19:49:38 juju-e4d256-prod-github-runner-207 kernel: [51952.596274] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 19:49:38 juju-e4d256-prod-github-runner-207 kernel: [51952.597291] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 19:49:38 juju-e4d256-prod-github-runner-207 kernel: [51952.598269] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 19:49:38 juju-e4d256-prod-github-runner-207 kernel: [51952.599245] handle_exit+0x98/0x230 [kvm_amd] Aug 22 19:49:38 juju-e4d256-prod-github-runner-207 kernel: [51952.600157] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 19:49:38 juju-e4d256-prod-github-runner-207 kernel: [51952.601079] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 19:49:38 juju-e4d256-prod-github-runner-207 kernel: [51952.602048] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 19:49:38 juju-e4d256-prod-github-runner-207 kernel: [51952.602960] vcpu_run+0x62/0x2c0 [kvm] Aug 22 19:49:38 juju-e4d256-prod-github-runner-207 kernel: [51952.603771] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 19:49:38 juju-e4d256-prod-github-runner-207 kernel: [51952.604581] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 19:49:38 juju-e4d256-prod-github-runner-207 kernel: [51952.605436] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 19:49:38 juju-e4d256-prod-github-runner-207 kernel: [51952.606258] ? __seccomp_filter+0x4a/0x4a0 Aug 22 19:49:38 juju-e4d256-prod-github-runner-207 kernel: [51952.607006] ? __fget_files+0x86/0xc0 Aug 22 19:49:38 juju-e4d256-prod-github-runner-207 kernel: [51952.607716] __x64_sys_ioctl+0x95/0xd0 Aug 22 19:49:38 juju-e4d256-prod-github-runner-207 kernel: [51952.608441] do_syscall_64+0x5c/0xc0 Aug 22 19:49:38 juju-e4d256-prod-github-runner-207 kernel: [51952.609158] ? do_futex+0x162/0x1f0 Aug 22 19:49:38 juju-e4d256-prod-github-runner-207 kernel: [51952.609845] ? __x64_sys_futex+0x78/0x1e0 Aug 22 19:49:38 juju-e4d256-prod-github-runner-207 kernel: [51952.610525] ? __secure_computing+0xa9/0x120 Aug 22 19:49:38 juju-e4d256-prod-github-runner-207 kernel: [51952.611222] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 19:49:38 juju-e4d256-prod-github-runner-207 kernel: [51952.611992] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:49:38 juju-e4d256-prod-github-runner-207 kernel: [51952.612716] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:49:38 juju-e4d256-prod-github-runner-207 kernel: [51952.613438] ? do_syscall_64+0x69/0xc0 Aug 22 19:49:38 juju-e4d256-prod-github-runner-207 kernel: [51952.614108] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:49:38 juju-e4d256-prod-github-runner-207 kernel: [51952.614814] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:49:38 juju-e4d256-prod-github-runner-207 kernel: [51952.615511] ? do_syscall_64+0x69/0xc0 Aug 22 19:49:38 juju-e4d256-prod-github-runner-207 kernel: [51952.616157] ? do_syscall_64+0x69/0xc0 Aug 22 19:49:38 juju-e4d256-prod-github-runner-207 kernel: [51952.616780] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 19:49:38 juju-e4d256-prod-github-runner-207 kernel: [51952.617487] RIP: 0033:0x7faa5d0edaff Aug 22 19:49:38 juju-e4d256-prod-github-runner-207 kernel: [51952.618169] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 19:49:38 juju-e4d256-prod-github-runner-207 kernel: [51952.620150] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 19:49:38 juju-e4d256-prod-github-runner-207 kernel: [51952.621064] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 19:49:38 juju-e4d256-prod-github-runner-207 kernel: [51952.621969] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 19:49:38 juju-e4d256-prod-github-runner-207 kernel: [51952.622859] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 19:49:38 juju-e4d256-prod-github-runner-207 kernel: [51952.623744] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 19:49:38 juju-e4d256-prod-github-runner-207 kernel: [51952.624643] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 19:49:38 juju-e4d256-prod-github-runner-207 kernel: [51952.625560] Aug 22 19:50:06 juju-e4d256-prod-github-runner-207 kernel: [51980.541983] watchdog: BUG: soft lockup - CPU#1 stuck for 48302s! [qemu-system-x86:6715] Aug 22 19:50:06 juju-e4d256-prod-github-runner-207 kernel: [51980.543119] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 19:50:06 juju-e4d256-prod-github-runner-207 kernel: [51980.543187] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 19:50:06 juju-e4d256-prod-github-runner-207 kernel: [51980.555565] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 19:50:06 juju-e4d256-prod-github-runner-207 kernel: [51980.556869] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 19:50:06 juju-e4d256-prod-github-runner-207 kernel: [51980.558146] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:50:06 juju-e4d256-prod-github-runner-207 kernel: [51980.559258] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 19:50:06 juju-e4d256-prod-github-runner-207 kernel: [51980.561885] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 19:50:06 juju-e4d256-prod-github-runner-207 kernel: [51980.562941] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 19:50:06 juju-e4d256-prod-github-runner-207 kernel: [51980.564129] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 19:50:06 juju-e4d256-prod-github-runner-207 kernel: [51980.565371] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 19:50:06 juju-e4d256-prod-github-runner-207 kernel: [51980.566572] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 19:50:06 juju-e4d256-prod-github-runner-207 kernel: [51980.567757] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 19:50:06 juju-e4d256-prod-github-runner-207 kernel: [51980.568939] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 19:50:06 juju-e4d256-prod-github-runner-207 kernel: [51980.570223] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 19:50:06 juju-e4d256-prod-github-runner-207 kernel: [51980.571382] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 19:50:06 juju-e4d256-prod-github-runner-207 kernel: [51980.572630] Call Trace: Aug 22 19:50:06 juju-e4d256-prod-github-runner-207 kernel: [51980.573637] Aug 22 19:50:06 juju-e4d256-prod-github-runner-207 kernel: [51980.574594] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:50:06 juju-e4d256-prod-github-runner-207 kernel: [51980.575647] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:50:06 juju-e4d256-prod-github-runner-207 kernel: [51980.576682] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:50:06 juju-e4d256-prod-github-runner-207 kernel: [51980.577794] ? show_regs.part.0+0x23/0x29 Aug 22 19:50:06 juju-e4d256-prod-github-runner-207 kernel: [51980.578838] ? show_regs.cold+0x8/0xd Aug 22 19:50:06 juju-e4d256-prod-github-runner-207 kernel: [51980.579855] ? watchdog_timer_fn+0x1be/0x220 Aug 22 19:50:06 juju-e4d256-prod-github-runner-207 kernel: [51980.580892] ? lockup_detector_update_enable+0x60/0x60 Aug 22 19:50:06 juju-e4d256-prod-github-runner-207 kernel: [51980.581995] ? __hrtimer_run_queues+0x107/0x230 Aug 22 19:50:06 juju-e4d256-prod-github-runner-207 kernel: [51980.583054] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 19:50:06 juju-e4d256-prod-github-runner-207 kernel: [51980.584097] ? hrtimer_interrupt+0x101/0x220 Aug 22 19:50:06 juju-e4d256-prod-github-runner-207 kernel: [51980.585159] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 19:50:06 juju-e4d256-prod-github-runner-207 kernel: [51980.586300] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 19:50:06 juju-e4d256-prod-github-runner-207 kernel: [51980.587405] Aug 22 19:50:06 juju-e4d256-prod-github-runner-207 kernel: [51980.588287] Aug 22 19:50:06 juju-e4d256-prod-github-runner-207 kernel: [51980.589155] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 19:50:06 juju-e4d256-prod-github-runner-207 kernel: [51980.590254] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:50:06 juju-e4d256-prod-github-runner-207 kernel: [51980.591315] ? _raw_spin_lock+0x22/0x30 Aug 22 19:50:06 juju-e4d256-prod-github-runner-207 kernel: [51980.592397] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:50:06 juju-e4d256-prod-github-runner-207 kernel: [51980.593552] direct_page_fault+0x206/0x310 [kvm] Aug 22 19:50:06 juju-e4d256-prod-github-runner-207 kernel: [51980.594707] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 19:50:06 juju-e4d256-prod-github-runner-207 kernel: [51980.595791] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 19:50:06 juju-e4d256-prod-github-runner-207 kernel: [51980.596843] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 19:50:06 juju-e4d256-prod-github-runner-207 kernel: [51980.598015] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 19:50:06 juju-e4d256-prod-github-runner-207 kernel: [51980.599006] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 19:50:06 juju-e4d256-prod-github-runner-207 kernel: [51980.600033] handle_exit+0x98/0x230 [kvm_amd] Aug 22 19:50:06 juju-e4d256-prod-github-runner-207 kernel: [51980.600949] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 19:50:06 juju-e4d256-prod-github-runner-207 kernel: [51980.601966] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 19:50:06 juju-e4d256-prod-github-runner-207 kernel: [51980.603002] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 19:50:06 juju-e4d256-prod-github-runner-207 kernel: [51980.603933] vcpu_run+0x62/0x2c0 [kvm] Aug 22 19:50:06 juju-e4d256-prod-github-runner-207 kernel: [51980.604803] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 19:50:06 juju-e4d256-prod-github-runner-207 kernel: [51980.605678] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 19:50:06 juju-e4d256-prod-github-runner-207 kernel: [51980.606594] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 19:50:06 juju-e4d256-prod-github-runner-207 kernel: [51980.607409] ? __seccomp_filter+0x4a/0x4a0 Aug 22 19:50:06 juju-e4d256-prod-github-runner-207 kernel: [51980.608171] ? __fget_files+0x86/0xc0 Aug 22 19:50:06 juju-e4d256-prod-github-runner-207 kernel: [51980.608916] __x64_sys_ioctl+0x95/0xd0 Aug 22 19:50:06 juju-e4d256-prod-github-runner-207 kernel: [51980.609720] do_syscall_64+0x5c/0xc0 Aug 22 19:50:06 juju-e4d256-prod-github-runner-207 kernel: [51980.610405] ? do_futex+0x162/0x1f0 Aug 22 19:50:06 juju-e4d256-prod-github-runner-207 kernel: [51980.611066] ? __x64_sys_futex+0x78/0x1e0 Aug 22 19:50:06 juju-e4d256-prod-github-runner-207 kernel: [51980.611752] ? __secure_computing+0xa9/0x120 Aug 22 19:50:06 juju-e4d256-prod-github-runner-207 kernel: [51980.612471] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 19:50:06 juju-e4d256-prod-github-runner-207 kernel: [51980.613257] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:50:06 juju-e4d256-prod-github-runner-207 kernel: [51980.614011] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:50:06 juju-e4d256-prod-github-runner-207 kernel: [51980.614762] ? do_syscall_64+0x69/0xc0 Aug 22 19:50:06 juju-e4d256-prod-github-runner-207 kernel: [51980.615431] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:50:06 juju-e4d256-prod-github-runner-207 kernel: [51980.616147] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:50:06 juju-e4d256-prod-github-runner-207 kernel: [51980.616855] ? do_syscall_64+0x69/0xc0 Aug 22 19:50:06 juju-e4d256-prod-github-runner-207 kernel: [51980.617552] ? do_syscall_64+0x69/0xc0 Aug 22 19:50:06 juju-e4d256-prod-github-runner-207 kernel: [51980.618206] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 19:50:06 juju-e4d256-prod-github-runner-207 kernel: [51980.618928] RIP: 0033:0x7faa5d0edaff Aug 22 19:50:06 juju-e4d256-prod-github-runner-207 kernel: [51980.619691] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 19:50:06 juju-e4d256-prod-github-runner-207 kernel: [51980.621984] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 19:50:06 juju-e4d256-prod-github-runner-207 kernel: [51980.622953] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 19:50:06 juju-e4d256-prod-github-runner-207 kernel: [51980.623888] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 19:50:06 juju-e4d256-prod-github-runner-207 kernel: [51980.624808] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 19:50:06 juju-e4d256-prod-github-runner-207 kernel: [51980.625745] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 19:50:06 juju-e4d256-prod-github-runner-207 kernel: [51980.626784] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 19:50:06 juju-e4d256-prod-github-runner-207 kernel: [51980.627727] Aug 22 19:50:34 juju-e4d256-prod-github-runner-207 kernel: [52008.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 48328s! [qemu-system-x86:6715] Aug 22 19:50:34 juju-e4d256-prod-github-runner-207 kernel: [52008.543148] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 19:50:34 juju-e4d256-prod-github-runner-207 kernel: [52008.543215] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 19:50:34 juju-e4d256-prod-github-runner-207 kernel: [52008.555360] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 19:50:34 juju-e4d256-prod-github-runner-207 kernel: [52008.556627] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 19:50:34 juju-e4d256-prod-github-runner-207 kernel: [52008.558050] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:50:34 juju-e4d256-prod-github-runner-207 kernel: [52008.559113] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 19:50:34 juju-e4d256-prod-github-runner-207 kernel: [52008.561978] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 19:50:34 juju-e4d256-prod-github-runner-207 kernel: [52008.563039] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 19:50:34 juju-e4d256-prod-github-runner-207 kernel: [52008.564216] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 19:50:34 juju-e4d256-prod-github-runner-207 kernel: [52008.565441] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 19:50:34 juju-e4d256-prod-github-runner-207 kernel: [52008.566611] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 19:50:34 juju-e4d256-prod-github-runner-207 kernel: [52008.567768] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 19:50:34 juju-e4d256-prod-github-runner-207 kernel: [52008.568934] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 19:50:34 juju-e4d256-prod-github-runner-207 kernel: [52008.570250] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 19:50:34 juju-e4d256-prod-github-runner-207 kernel: [52008.571397] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 19:50:34 juju-e4d256-prod-github-runner-207 kernel: [52008.572597] Call Trace: Aug 22 19:50:34 juju-e4d256-prod-github-runner-207 kernel: [52008.573530] Aug 22 19:50:34 juju-e4d256-prod-github-runner-207 kernel: [52008.574414] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:50:34 juju-e4d256-prod-github-runner-207 kernel: [52008.575444] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:50:34 juju-e4d256-prod-github-runner-207 kernel: [52008.576467] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:50:34 juju-e4d256-prod-github-runner-207 kernel: [52008.577559] ? show_regs.part.0+0x23/0x29 Aug 22 19:50:34 juju-e4d256-prod-github-runner-207 kernel: [52008.578555] ? show_regs.cold+0x8/0xd Aug 22 19:50:34 juju-e4d256-prod-github-runner-207 kernel: [52008.579526] ? watchdog_timer_fn+0x1be/0x220 Aug 22 19:50:34 juju-e4d256-prod-github-runner-207 kernel: [52008.580532] ? lockup_detector_update_enable+0x60/0x60 Aug 22 19:50:34 juju-e4d256-prod-github-runner-207 kernel: [52008.581660] ? __hrtimer_run_queues+0x107/0x230 Aug 22 19:50:34 juju-e4d256-prod-github-runner-207 kernel: [52008.582738] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 19:50:34 juju-e4d256-prod-github-runner-207 kernel: [52008.583768] ? hrtimer_interrupt+0x101/0x220 Aug 22 19:50:34 juju-e4d256-prod-github-runner-207 kernel: [52008.584786] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 19:50:34 juju-e4d256-prod-github-runner-207 kernel: [52008.585895] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 19:50:34 juju-e4d256-prod-github-runner-207 kernel: [52008.586946] Aug 22 19:50:34 juju-e4d256-prod-github-runner-207 kernel: [52008.587798] Aug 22 19:50:34 juju-e4d256-prod-github-runner-207 kernel: [52008.588633] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 19:50:34 juju-e4d256-prod-github-runner-207 kernel: [52008.589691] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:50:34 juju-e4d256-prod-github-runner-207 kernel: [52008.590741] ? _raw_spin_lock+0x22/0x30 Aug 22 19:50:34 juju-e4d256-prod-github-runner-207 kernel: [52008.591693] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:50:34 juju-e4d256-prod-github-runner-207 kernel: [52008.592709] direct_page_fault+0x206/0x310 [kvm] Aug 22 19:50:34 juju-e4d256-prod-github-runner-207 kernel: [52008.593891] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 19:50:34 juju-e4d256-prod-github-runner-207 kernel: [52008.594920] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 19:50:34 juju-e4d256-prod-github-runner-207 kernel: [52008.595926] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 19:50:34 juju-e4d256-prod-github-runner-207 kernel: [52008.596896] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 19:50:34 juju-e4d256-prod-github-runner-207 kernel: [52008.597858] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 19:50:34 juju-e4d256-prod-github-runner-207 kernel: [52008.598833] handle_exit+0x98/0x230 [kvm_amd] Aug 22 19:50:34 juju-e4d256-prod-github-runner-207 kernel: [52008.599724] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 19:50:34 juju-e4d256-prod-github-runner-207 kernel: [52008.600636] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 19:50:34 juju-e4d256-prod-github-runner-207 kernel: [52008.601588] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 19:50:34 juju-e4d256-prod-github-runner-207 kernel: [52008.602564] vcpu_run+0x62/0x2c0 [kvm] Aug 22 19:50:34 juju-e4d256-prod-github-runner-207 kernel: [52008.603382] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 19:50:34 juju-e4d256-prod-github-runner-207 kernel: [52008.604193] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 19:50:34 juju-e4d256-prod-github-runner-207 kernel: [52008.605062] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 19:50:34 juju-e4d256-prod-github-runner-207 kernel: [52008.605866] ? __seccomp_filter+0x4a/0x4a0 Aug 22 19:50:34 juju-e4d256-prod-github-runner-207 kernel: [52008.606609] ? __fget_files+0x86/0xc0 Aug 22 19:50:34 juju-e4d256-prod-github-runner-207 kernel: [52008.607312] __x64_sys_ioctl+0x95/0xd0 Aug 22 19:50:34 juju-e4d256-prod-github-runner-207 kernel: [52008.608005] do_syscall_64+0x5c/0xc0 Aug 22 19:50:34 juju-e4d256-prod-github-runner-207 kernel: [52008.608670] ? do_futex+0x162/0x1f0 Aug 22 19:50:34 juju-e4d256-prod-github-runner-207 kernel: [52008.609330] ? __x64_sys_futex+0x78/0x1e0 Aug 22 19:50:34 juju-e4d256-prod-github-runner-207 kernel: [52008.610008] ? __secure_computing+0xa9/0x120 Aug 22 19:50:34 juju-e4d256-prod-github-runner-207 kernel: [52008.610698] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 19:50:34 juju-e4d256-prod-github-runner-207 kernel: [52008.611458] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:50:34 juju-e4d256-prod-github-runner-207 kernel: [52008.612179] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:50:34 juju-e4d256-prod-github-runner-207 kernel: [52008.612895] ? do_syscall_64+0x69/0xc0 Aug 22 19:50:34 juju-e4d256-prod-github-runner-207 kernel: [52008.613547] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:50:34 juju-e4d256-prod-github-runner-207 kernel: [52008.614313] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:50:34 juju-e4d256-prod-github-runner-207 kernel: [52008.615015] ? do_syscall_64+0x69/0xc0 Aug 22 19:50:34 juju-e4d256-prod-github-runner-207 kernel: [52008.615642] ? do_syscall_64+0x69/0xc0 Aug 22 19:50:34 juju-e4d256-prod-github-runner-207 kernel: [52008.616269] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 19:50:34 juju-e4d256-prod-github-runner-207 kernel: [52008.616975] RIP: 0033:0x7faa5d0edaff Aug 22 19:50:34 juju-e4d256-prod-github-runner-207 kernel: [52008.617615] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 19:50:34 juju-e4d256-prod-github-runner-207 kernel: [52008.619602] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 19:50:34 juju-e4d256-prod-github-runner-207 kernel: [52008.620513] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 19:50:34 juju-e4d256-prod-github-runner-207 kernel: [52008.621446] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 19:50:34 juju-e4d256-prod-github-runner-207 kernel: [52008.622418] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 19:50:34 juju-e4d256-prod-github-runner-207 kernel: [52008.623316] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 19:50:34 juju-e4d256-prod-github-runner-207 kernel: [52008.624207] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 19:50:34 juju-e4d256-prod-github-runner-207 kernel: [52008.625181] Aug 22 19:50:46 juju-e4d256-prod-github-runner-207 kernel: [52020.656706] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 19:50:46 juju-e4d256-prod-github-runner-207 kernel: [52020.657806] rcu: 1-....: (12934981 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=6253315 Aug 22 19:50:46 juju-e4d256-prod-github-runner-207 kernel: [52020.659130] (t=12975864 jiffies g=23269 q=48888) Aug 22 19:50:46 juju-e4d256-prod-github-runner-207 kernel: [52020.660017] NMI backtrace for cpu 1 Aug 22 19:50:46 juju-e4d256-prod-github-runner-207 kernel: [52020.660805] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 19:50:46 juju-e4d256-prod-github-runner-207 kernel: [52020.662102] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 19:50:46 juju-e4d256-prod-github-runner-207 kernel: [52020.663324] Call Trace: Aug 22 19:50:46 juju-e4d256-prod-github-runner-207 kernel: [52020.664049] Aug 22 19:50:46 juju-e4d256-prod-github-runner-207 kernel: [52020.664739] show_stack+0x52/0x5c Aug 22 19:50:46 juju-e4d256-prod-github-runner-207 kernel: [52020.665572] dump_stack_lvl+0x4a/0x63 Aug 22 19:50:46 juju-e4d256-prod-github-runner-207 kernel: [52020.666391] dump_stack+0x10/0x16 Aug 22 19:50:46 juju-e4d256-prod-github-runner-207 kernel: [52020.667176] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 19:50:46 juju-e4d256-prod-github-runner-207 kernel: [52020.668049] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 19:50:46 juju-e4d256-prod-github-runner-207 kernel: [52020.668931] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 19:50:46 juju-e4d256-prod-github-runner-207 kernel: [52020.669854] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 19:50:46 juju-e4d256-prod-github-runner-207 kernel: [52020.670777] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 19:50:46 juju-e4d256-prod-github-runner-207 kernel: [52020.671688] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 19:50:46 juju-e4d256-prod-github-runner-207 kernel: [52020.672545] print_cpu_stall.cold+0x2f/0xe2 Aug 22 19:50:46 juju-e4d256-prod-github-runner-207 kernel: [52020.673411] ? timekeeping_update+0xf7/0x150 Aug 22 19:50:46 juju-e4d256-prod-github-runner-207 kernel: [52020.674267] check_cpu_stall+0x109/0x270 Aug 22 19:50:46 juju-e4d256-prod-github-runner-207 kernel: [52020.675096] rcu_sched_clock_irq+0x9a/0x250 Aug 22 19:50:46 juju-e4d256-prod-github-runner-207 kernel: [52020.676087] update_process_times+0x94/0xd0 Aug 22 19:50:46 juju-e4d256-prod-github-runner-207 kernel: [52020.676956] tick_sched_handle+0x29/0x70 Aug 22 19:50:46 juju-e4d256-prod-github-runner-207 kernel: [52020.677785] tick_sched_timer+0x8c/0xc0 Aug 22 19:50:46 juju-e4d256-prod-github-runner-207 kernel: [52020.678599] ? tick_nohz_handler+0xb0/0xb0 Aug 22 19:50:46 juju-e4d256-prod-github-runner-207 kernel: [52020.679435] __hrtimer_run_queues+0x107/0x230 Aug 22 19:50:46 juju-e4d256-prod-github-runner-207 kernel: [52020.680297] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 19:50:46 juju-e4d256-prod-github-runner-207 kernel: [52020.681177] hrtimer_interrupt+0x101/0x220 Aug 22 19:50:46 juju-e4d256-prod-github-runner-207 kernel: [52020.682021] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 19:50:46 juju-e4d256-prod-github-runner-207 kernel: [52020.682930] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 19:50:46 juju-e4d256-prod-github-runner-207 kernel: [52020.683824] Aug 22 19:50:46 juju-e4d256-prod-github-runner-207 kernel: [52020.684504] Aug 22 19:50:46 juju-e4d256-prod-github-runner-207 kernel: [52020.685198] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 19:50:46 juju-e4d256-prod-github-runner-207 kernel: [52020.686118] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:50:46 juju-e4d256-prod-github-runner-207 kernel: [52020.687112] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 19:50:46 juju-e4d256-prod-github-runner-207 kernel: [52020.689831] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 19:50:46 juju-e4d256-prod-github-runner-207 kernel: [52020.690802] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 19:50:46 juju-e4d256-prod-github-runner-207 kernel: [52020.691933] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 19:50:46 juju-e4d256-prod-github-runner-207 kernel: [52020.693066] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 19:50:46 juju-e4d256-prod-github-runner-207 kernel: [52020.694174] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 19:50:46 juju-e4d256-prod-github-runner-207 kernel: [52020.695273] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 19:50:46 juju-e4d256-prod-github-runner-207 kernel: [52020.696366] ? _raw_spin_lock+0x22/0x30 Aug 22 19:50:46 juju-e4d256-prod-github-runner-207 kernel: [52020.697238] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:50:46 juju-e4d256-prod-github-runner-207 kernel: [52020.698158] direct_page_fault+0x206/0x310 [kvm] Aug 22 19:50:46 juju-e4d256-prod-github-runner-207 kernel: [52020.699085] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 19:50:46 juju-e4d256-prod-github-runner-207 kernel: [52020.699998] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 19:50:46 juju-e4d256-prod-github-runner-207 kernel: [52020.700925] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 19:50:46 juju-e4d256-prod-github-runner-207 kernel: [52020.701833] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 19:50:46 juju-e4d256-prod-github-runner-207 kernel: [52020.702717] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 19:50:46 juju-e4d256-prod-github-runner-207 kernel: [52020.703647] handle_exit+0x98/0x230 [kvm_amd] Aug 22 19:50:46 juju-e4d256-prod-github-runner-207 kernel: [52020.704486] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 19:50:46 juju-e4d256-prod-github-runner-207 kernel: [52020.705375] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 19:50:46 juju-e4d256-prod-github-runner-207 kernel: [52020.706275] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 19:50:46 juju-e4d256-prod-github-runner-207 kernel: [52020.707154] vcpu_run+0x62/0x2c0 [kvm] Aug 22 19:50:46 juju-e4d256-prod-github-runner-207 kernel: [52020.707943] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 19:50:46 juju-e4d256-prod-github-runner-207 kernel: [52020.708774] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 19:50:46 juju-e4d256-prod-github-runner-207 kernel: [52020.709696] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 19:50:46 juju-e4d256-prod-github-runner-207 kernel: [52020.710543] ? __seccomp_filter+0x4a/0x4a0 Aug 22 19:50:46 juju-e4d256-prod-github-runner-207 kernel: [52020.711357] ? __fget_files+0x86/0xc0 Aug 22 19:50:46 juju-e4d256-prod-github-runner-207 kernel: [52020.712141] __x64_sys_ioctl+0x95/0xd0 Aug 22 19:50:46 juju-e4d256-prod-github-runner-207 kernel: [52020.712940] do_syscall_64+0x5c/0xc0 Aug 22 19:50:46 juju-e4d256-prod-github-runner-207 kernel: [52020.713698] ? do_futex+0x162/0x1f0 Aug 22 19:50:46 juju-e4d256-prod-github-runner-207 kernel: [52020.714443] ? __x64_sys_futex+0x78/0x1e0 Aug 22 19:50:46 juju-e4d256-prod-github-runner-207 kernel: [52020.715223] ? __secure_computing+0xa9/0x120 Aug 22 19:50:46 juju-e4d256-prod-github-runner-207 kernel: [52020.716029] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 19:50:46 juju-e4d256-prod-github-runner-207 kernel: [52020.716949] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:50:46 juju-e4d256-prod-github-runner-207 kernel: [52020.717802] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:50:46 juju-e4d256-prod-github-runner-207 kernel: [52020.718656] ? do_syscall_64+0x69/0xc0 Aug 22 19:50:46 juju-e4d256-prod-github-runner-207 kernel: [52020.719417] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:50:46 juju-e4d256-prod-github-runner-207 kernel: [52020.720271] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:50:46 juju-e4d256-prod-github-runner-207 kernel: [52020.721140] ? do_syscall_64+0x69/0xc0 Aug 22 19:50:46 juju-e4d256-prod-github-runner-207 kernel: [52020.721910] ? do_syscall_64+0x69/0xc0 Aug 22 19:50:46 juju-e4d256-prod-github-runner-207 kernel: [52020.722668] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 19:50:46 juju-e4d256-prod-github-runner-207 kernel: [52020.723572] RIP: 0033:0x7faa5d0edaff Aug 22 19:50:46 juju-e4d256-prod-github-runner-207 kernel: [52020.724269] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 19:50:46 juju-e4d256-prod-github-runner-207 kernel: [52020.726387] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 19:50:46 juju-e4d256-prod-github-runner-207 kernel: [52020.727350] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 19:50:46 juju-e4d256-prod-github-runner-207 kernel: [52020.728298] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 19:50:46 juju-e4d256-prod-github-runner-207 kernel: [52020.729259] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 19:50:46 juju-e4d256-prod-github-runner-207 kernel: [52020.730202] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 19:50:46 juju-e4d256-prod-github-runner-207 kernel: [52020.731129] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 19:50:46 juju-e4d256-prod-github-runner-207 kernel: [52020.732049] Aug 22 19:51:14 juju-e4d256-prod-github-runner-207 kernel: [52048.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 48365s! [qemu-system-x86:6715] Aug 22 19:51:14 juju-e4d256-prod-github-runner-207 kernel: [52048.543696] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 19:51:14 juju-e4d256-prod-github-runner-207 kernel: [52048.543940] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 19:51:14 juju-e4d256-prod-github-runner-207 kernel: [52048.556133] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 19:51:14 juju-e4d256-prod-github-runner-207 kernel: [52048.557464] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 19:51:14 juju-e4d256-prod-github-runner-207 kernel: [52048.558703] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:51:14 juju-e4d256-prod-github-runner-207 kernel: [52048.559807] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 19:51:14 juju-e4d256-prod-github-runner-207 kernel: [52048.562524] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 19:51:14 juju-e4d256-prod-github-runner-207 kernel: [52048.563581] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 19:51:14 juju-e4d256-prod-github-runner-207 kernel: [52048.564787] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 19:51:14 juju-e4d256-prod-github-runner-207 kernel: [52048.565960] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 19:51:14 juju-e4d256-prod-github-runner-207 kernel: [52048.567120] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 19:51:14 juju-e4d256-prod-github-runner-207 kernel: [52048.568282] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 19:51:14 juju-e4d256-prod-github-runner-207 kernel: [52048.569528] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 19:51:14 juju-e4d256-prod-github-runner-207 kernel: [52048.570761] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 19:51:14 juju-e4d256-prod-github-runner-207 kernel: [52048.571859] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 19:51:14 juju-e4d256-prod-github-runner-207 kernel: [52048.573096] Call Trace: Aug 22 19:51:14 juju-e4d256-prod-github-runner-207 kernel: [52048.574009] Aug 22 19:51:14 juju-e4d256-prod-github-runner-207 kernel: [52048.574906] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:51:14 juju-e4d256-prod-github-runner-207 kernel: [52048.575937] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:51:14 juju-e4d256-prod-github-runner-207 kernel: [52048.577020] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:51:14 juju-e4d256-prod-github-runner-207 kernel: [52048.578136] ? show_regs.part.0+0x23/0x29 Aug 22 19:51:14 juju-e4d256-prod-github-runner-207 kernel: [52048.579138] ? show_regs.cold+0x8/0xd Aug 22 19:51:14 juju-e4d256-prod-github-runner-207 kernel: [52048.580110] ? watchdog_timer_fn+0x1be/0x220 Aug 22 19:51:14 juju-e4d256-prod-github-runner-207 kernel: [52048.581196] ? lockup_detector_update_enable+0x60/0x60 Aug 22 19:51:14 juju-e4d256-prod-github-runner-207 kernel: [52048.582261] ? __hrtimer_run_queues+0x107/0x230 Aug 22 19:51:14 juju-e4d256-prod-github-runner-207 kernel: [52048.583287] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 19:51:14 juju-e4d256-prod-github-runner-207 kernel: [52048.584309] ? hrtimer_interrupt+0x101/0x220 Aug 22 19:51:14 juju-e4d256-prod-github-runner-207 kernel: [52048.585382] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 19:51:14 juju-e4d256-prod-github-runner-207 kernel: [52048.586449] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 19:51:14 juju-e4d256-prod-github-runner-207 kernel: [52048.587492] Aug 22 19:51:14 juju-e4d256-prod-github-runner-207 kernel: [52048.588394] Aug 22 19:51:14 juju-e4d256-prod-github-runner-207 kernel: [52048.589318] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 19:51:14 juju-e4d256-prod-github-runner-207 kernel: [52048.590357] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:51:14 juju-e4d256-prod-github-runner-207 kernel: [52048.591497] ? _raw_spin_lock+0x22/0x30 Aug 22 19:51:14 juju-e4d256-prod-github-runner-207 kernel: [52048.592469] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:51:14 juju-e4d256-prod-github-runner-207 kernel: [52048.593557] direct_page_fault+0x206/0x310 [kvm] Aug 22 19:51:14 juju-e4d256-prod-github-runner-207 kernel: [52048.594585] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 19:51:14 juju-e4d256-prod-github-runner-207 kernel: [52048.595594] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 19:51:14 juju-e4d256-prod-github-runner-207 kernel: [52048.596630] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 19:51:14 juju-e4d256-prod-github-runner-207 kernel: [52048.597643] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 19:51:14 juju-e4d256-prod-github-runner-207 kernel: [52048.598590] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 19:51:14 juju-e4d256-prod-github-runner-207 kernel: [52048.599572] handle_exit+0x98/0x230 [kvm_amd] Aug 22 19:51:14 juju-e4d256-prod-github-runner-207 kernel: [52048.600467] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 19:51:14 juju-e4d256-prod-github-runner-207 kernel: [52048.601432] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 19:51:14 juju-e4d256-prod-github-runner-207 kernel: [52048.602356] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 19:51:14 juju-e4d256-prod-github-runner-207 kernel: [52048.603265] vcpu_run+0x62/0x2c0 [kvm] Aug 22 19:51:14 juju-e4d256-prod-github-runner-207 kernel: [52048.604080] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 19:51:14 juju-e4d256-prod-github-runner-207 kernel: [52048.604930] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 19:51:14 juju-e4d256-prod-github-runner-207 kernel: [52048.605795] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 19:51:14 juju-e4d256-prod-github-runner-207 kernel: [52048.606593] ? __seccomp_filter+0x4a/0x4a0 Aug 22 19:51:14 juju-e4d256-prod-github-runner-207 kernel: [52048.607367] ? __fget_files+0x86/0xc0 Aug 22 19:51:14 juju-e4d256-prod-github-runner-207 kernel: [52048.608085] __x64_sys_ioctl+0x95/0xd0 Aug 22 19:51:14 juju-e4d256-prod-github-runner-207 kernel: [52048.608818] do_syscall_64+0x5c/0xc0 Aug 22 19:51:14 juju-e4d256-prod-github-runner-207 kernel: [52048.609488] ? do_futex+0x162/0x1f0 Aug 22 19:51:14 juju-e4d256-prod-github-runner-207 kernel: [52048.610172] ? __x64_sys_futex+0x78/0x1e0 Aug 22 19:51:14 juju-e4d256-prod-github-runner-207 kernel: [52048.610900] ? __secure_computing+0xa9/0x120 Aug 22 19:51:14 juju-e4d256-prod-github-runner-207 kernel: [52048.611596] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 19:51:14 juju-e4d256-prod-github-runner-207 kernel: [52048.612359] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:51:14 juju-e4d256-prod-github-runner-207 kernel: [52048.613104] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:51:14 juju-e4d256-prod-github-runner-207 kernel: [52048.613822] ? do_syscall_64+0x69/0xc0 Aug 22 19:51:14 juju-e4d256-prod-github-runner-207 kernel: [52048.614468] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:51:14 juju-e4d256-prod-github-runner-207 kernel: [52048.615171] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:51:14 juju-e4d256-prod-github-runner-207 kernel: [52048.615872] ? do_syscall_64+0x69/0xc0 Aug 22 19:51:14 juju-e4d256-prod-github-runner-207 kernel: [52048.616522] ? do_syscall_64+0x69/0xc0 Aug 22 19:51:14 juju-e4d256-prod-github-runner-207 kernel: [52048.617146] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 19:51:14 juju-e4d256-prod-github-runner-207 kernel: [52048.617864] RIP: 0033:0x7faa5d0edaff Aug 22 19:51:14 juju-e4d256-prod-github-runner-207 kernel: [52048.618529] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 19:51:14 juju-e4d256-prod-github-runner-207 kernel: [52048.620620] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 19:51:14 juju-e4d256-prod-github-runner-207 kernel: [52048.621625] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 19:51:14 juju-e4d256-prod-github-runner-207 kernel: [52048.622584] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 19:51:14 juju-e4d256-prod-github-runner-207 kernel: [52048.623484] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 19:51:14 juju-e4d256-prod-github-runner-207 kernel: [52048.624568] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 19:51:14 juju-e4d256-prod-github-runner-207 kernel: [52048.625605] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 19:51:14 juju-e4d256-prod-github-runner-207 kernel: [52048.626643] Aug 22 19:51:42 juju-e4d256-prod-github-runner-207 kernel: [52076.541982] watchdog: BUG: soft lockup - CPU#1 stuck for 48392s! [qemu-system-x86:6715] Aug 22 19:51:42 juju-e4d256-prod-github-runner-207 kernel: [52076.543105] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 19:51:42 juju-e4d256-prod-github-runner-207 kernel: [52076.543176] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 19:51:42 juju-e4d256-prod-github-runner-207 kernel: [52076.555505] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 19:51:42 juju-e4d256-prod-github-runner-207 kernel: [52076.556882] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 19:51:42 juju-e4d256-prod-github-runner-207 kernel: [52076.558151] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:51:42 juju-e4d256-prod-github-runner-207 kernel: [52076.559253] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 19:51:42 juju-e4d256-prod-github-runner-207 kernel: [52076.561824] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 19:51:42 juju-e4d256-prod-github-runner-207 kernel: [52076.563023] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 19:51:42 juju-e4d256-prod-github-runner-207 kernel: [52076.564239] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 19:51:42 juju-e4d256-prod-github-runner-207 kernel: [52076.565543] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 19:51:42 juju-e4d256-prod-github-runner-207 kernel: [52076.567269] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 19:51:42 juju-e4d256-prod-github-runner-207 kernel: [52076.568590] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 19:51:42 juju-e4d256-prod-github-runner-207 kernel: [52076.569784] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 19:51:42 juju-e4d256-prod-github-runner-207 kernel: [52076.571018] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 19:51:42 juju-e4d256-prod-github-runner-207 kernel: [52076.572173] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 19:51:42 juju-e4d256-prod-github-runner-207 kernel: [52076.573377] Call Trace: Aug 22 19:51:42 juju-e4d256-prod-github-runner-207 kernel: [52076.574291] Aug 22 19:51:42 juju-e4d256-prod-github-runner-207 kernel: [52076.575238] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:51:42 juju-e4d256-prod-github-runner-207 kernel: [52076.576471] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:51:42 juju-e4d256-prod-github-runner-207 kernel: [52076.577504] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:51:42 juju-e4d256-prod-github-runner-207 kernel: [52076.578590] ? show_regs.part.0+0x23/0x29 Aug 22 19:51:42 juju-e4d256-prod-github-runner-207 kernel: [52076.579590] ? show_regs.cold+0x8/0xd Aug 22 19:51:42 juju-e4d256-prod-github-runner-207 kernel: [52076.580571] ? watchdog_timer_fn+0x1be/0x220 Aug 22 19:51:42 juju-e4d256-prod-github-runner-207 kernel: [52076.581578] ? lockup_detector_update_enable+0x60/0x60 Aug 22 19:51:42 juju-e4d256-prod-github-runner-207 kernel: [52076.582642] ? __hrtimer_run_queues+0x107/0x230 Aug 22 19:51:42 juju-e4d256-prod-github-runner-207 kernel: [52076.583668] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 19:51:42 juju-e4d256-prod-github-runner-207 kernel: [52076.584712] ? hrtimer_interrupt+0x101/0x220 Aug 22 19:51:42 juju-e4d256-prod-github-runner-207 kernel: [52076.585732] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 19:51:42 juju-e4d256-prod-github-runner-207 kernel: [52076.586812] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 19:51:42 juju-e4d256-prod-github-runner-207 kernel: [52076.587869] Aug 22 19:51:42 juju-e4d256-prod-github-runner-207 kernel: [52076.588756] Aug 22 19:51:42 juju-e4d256-prod-github-runner-207 kernel: [52076.589609] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 19:51:42 juju-e4d256-prod-github-runner-207 kernel: [52076.590658] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:51:42 juju-e4d256-prod-github-runner-207 kernel: [52076.591707] ? _raw_spin_lock+0x22/0x30 Aug 22 19:51:42 juju-e4d256-prod-github-runner-207 kernel: [52076.592689] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:51:42 juju-e4d256-prod-github-runner-207 kernel: [52076.593708] direct_page_fault+0x206/0x310 [kvm] Aug 22 19:51:42 juju-e4d256-prod-github-runner-207 kernel: [52076.594739] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 19:51:42 juju-e4d256-prod-github-runner-207 kernel: [52076.595811] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 19:51:42 juju-e4d256-prod-github-runner-207 kernel: [52076.596954] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 19:51:42 juju-e4d256-prod-github-runner-207 kernel: [52076.598204] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 19:51:42 juju-e4d256-prod-github-runner-207 kernel: [52076.599150] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 19:51:42 juju-e4d256-prod-github-runner-207 kernel: [52076.600149] handle_exit+0x98/0x230 [kvm_amd] Aug 22 19:51:42 juju-e4d256-prod-github-runner-207 kernel: [52076.601058] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 19:51:42 juju-e4d256-prod-github-runner-207 kernel: [52076.601974] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 19:51:42 juju-e4d256-prod-github-runner-207 kernel: [52076.602899] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 19:51:42 juju-e4d256-prod-github-runner-207 kernel: [52076.603845] vcpu_run+0x62/0x2c0 [kvm] Aug 22 19:51:42 juju-e4d256-prod-github-runner-207 kernel: [52076.604721] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 19:51:42 juju-e4d256-prod-github-runner-207 kernel: [52076.605535] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 19:51:42 juju-e4d256-prod-github-runner-207 kernel: [52076.606391] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 19:51:42 juju-e4d256-prod-github-runner-207 kernel: [52076.607195] ? __seccomp_filter+0x4a/0x4a0 Aug 22 19:51:42 juju-e4d256-prod-github-runner-207 kernel: [52076.607942] ? __fget_files+0x86/0xc0 Aug 22 19:51:42 juju-e4d256-prod-github-runner-207 kernel: [52076.608663] __x64_sys_ioctl+0x95/0xd0 Aug 22 19:51:42 juju-e4d256-prod-github-runner-207 kernel: [52076.609361] do_syscall_64+0x5c/0xc0 Aug 22 19:51:42 juju-e4d256-prod-github-runner-207 kernel: [52076.610030] ? do_futex+0x162/0x1f0 Aug 22 19:51:42 juju-e4d256-prod-github-runner-207 kernel: [52076.610687] ? __x64_sys_futex+0x78/0x1e0 Aug 22 19:51:42 juju-e4d256-prod-github-runner-207 kernel: [52076.611364] ? __secure_computing+0xa9/0x120 Aug 22 19:51:42 juju-e4d256-prod-github-runner-207 kernel: [52076.612063] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 19:51:42 juju-e4d256-prod-github-runner-207 kernel: [52076.612870] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:51:42 juju-e4d256-prod-github-runner-207 kernel: [52076.613600] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:51:42 juju-e4d256-prod-github-runner-207 kernel: [52076.614323] ? do_syscall_64+0x69/0xc0 Aug 22 19:51:42 juju-e4d256-prod-github-runner-207 kernel: [52076.614971] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:51:42 juju-e4d256-prod-github-runner-207 kernel: [52076.615676] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:51:42 juju-e4d256-prod-github-runner-207 kernel: [52076.616396] ? do_syscall_64+0x69/0xc0 Aug 22 19:51:42 juju-e4d256-prod-github-runner-207 kernel: [52076.617023] ? do_syscall_64+0x69/0xc0 Aug 22 19:51:42 juju-e4d256-prod-github-runner-207 kernel: [52076.617833] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 19:51:42 juju-e4d256-prod-github-runner-207 kernel: [52076.618540] RIP: 0033:0x7faa5d0edaff Aug 22 19:51:42 juju-e4d256-prod-github-runner-207 kernel: [52076.619171] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 19:51:42 juju-e4d256-prod-github-runner-207 kernel: [52076.621199] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 19:51:42 juju-e4d256-prod-github-runner-207 kernel: [52076.622117] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 19:51:42 juju-e4d256-prod-github-runner-207 kernel: [52076.623007] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 19:51:42 juju-e4d256-prod-github-runner-207 kernel: [52076.623903] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 19:51:42 juju-e4d256-prod-github-runner-207 kernel: [52076.624826] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 19:51:42 juju-e4d256-prod-github-runner-207 kernel: [52076.625765] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 19:51:42 juju-e4d256-prod-github-runner-207 kernel: [52076.626665] Aug 22 19:52:10 juju-e4d256-prod-github-runner-207 kernel: [52104.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 48418s! [qemu-system-x86:6715] Aug 22 19:52:10 juju-e4d256-prod-github-runner-207 kernel: [52104.543075] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 19:52:10 juju-e4d256-prod-github-runner-207 kernel: [52104.543141] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 19:52:10 juju-e4d256-prod-github-runner-207 kernel: [52104.555651] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 19:52:10 juju-e4d256-prod-github-runner-207 kernel: [52104.556953] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 19:52:10 juju-e4d256-prod-github-runner-207 kernel: [52104.558200] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:52:10 juju-e4d256-prod-github-runner-207 kernel: [52104.559280] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 19:52:10 juju-e4d256-prod-github-runner-207 kernel: [52104.561858] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 19:52:10 juju-e4d256-prod-github-runner-207 kernel: [52104.562931] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 19:52:10 juju-e4d256-prod-github-runner-207 kernel: [52104.564142] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 19:52:10 juju-e4d256-prod-github-runner-207 kernel: [52104.565296] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 19:52:10 juju-e4d256-prod-github-runner-207 kernel: [52104.566457] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 19:52:10 juju-e4d256-prod-github-runner-207 kernel: [52104.567630] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 19:52:10 juju-e4d256-prod-github-runner-207 kernel: [52104.568861] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 19:52:10 juju-e4d256-prod-github-runner-207 kernel: [52104.570139] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 19:52:10 juju-e4d256-prod-github-runner-207 kernel: [52104.571240] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 19:52:10 juju-e4d256-prod-github-runner-207 kernel: [52104.572486] Call Trace: Aug 22 19:52:10 juju-e4d256-prod-github-runner-207 kernel: [52104.573402] Aug 22 19:52:10 juju-e4d256-prod-github-runner-207 kernel: [52104.574285] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:52:10 juju-e4d256-prod-github-runner-207 kernel: [52104.575313] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:52:10 juju-e4d256-prod-github-runner-207 kernel: [52104.576590] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:52:10 juju-e4d256-prod-github-runner-207 kernel: [52104.577671] ? show_regs.part.0+0x23/0x29 Aug 22 19:52:10 juju-e4d256-prod-github-runner-207 kernel: [52104.578715] ? show_regs.cold+0x8/0xd Aug 22 19:52:10 juju-e4d256-prod-github-runner-207 kernel: [52104.579755] ? watchdog_timer_fn+0x1be/0x220 Aug 22 19:52:10 juju-e4d256-prod-github-runner-207 kernel: [52104.581099] ? lockup_detector_update_enable+0x60/0x60 Aug 22 19:52:10 juju-e4d256-prod-github-runner-207 kernel: [52104.582452] ? __hrtimer_run_queues+0x107/0x230 Aug 22 19:52:10 juju-e4d256-prod-github-runner-207 kernel: [52104.583578] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 19:52:10 juju-e4d256-prod-github-runner-207 kernel: [52104.584757] ? hrtimer_interrupt+0x101/0x220 Aug 22 19:52:10 juju-e4d256-prod-github-runner-207 kernel: [52104.585988] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 19:52:10 juju-e4d256-prod-github-runner-207 kernel: [52104.587074] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 19:52:10 juju-e4d256-prod-github-runner-207 kernel: [52104.588255] Aug 22 19:52:10 juju-e4d256-prod-github-runner-207 kernel: [52104.589403] Aug 22 19:52:10 juju-e4d256-prod-github-runner-207 kernel: [52104.590527] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 19:52:10 juju-e4d256-prod-github-runner-207 kernel: [52104.591867] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:52:10 juju-e4d256-prod-github-runner-207 kernel: [52104.592925] ? _raw_spin_lock+0x22/0x30 Aug 22 19:52:10 juju-e4d256-prod-github-runner-207 kernel: [52104.593893] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:52:10 juju-e4d256-prod-github-runner-207 kernel: [52104.594963] direct_page_fault+0x206/0x310 [kvm] Aug 22 19:52:10 juju-e4d256-prod-github-runner-207 kernel: [52104.596047] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 19:52:10 juju-e4d256-prod-github-runner-207 kernel: [52104.597266] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 19:52:10 juju-e4d256-prod-github-runner-207 kernel: [52104.598667] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 19:52:10 juju-e4d256-prod-github-runner-207 kernel: [52104.600041] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 19:52:10 juju-e4d256-prod-github-runner-207 kernel: [52104.601367] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 19:52:10 juju-e4d256-prod-github-runner-207 kernel: [52104.602730] handle_exit+0x98/0x230 [kvm_amd] Aug 22 19:52:10 juju-e4d256-prod-github-runner-207 kernel: [52104.603724] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 19:52:10 juju-e4d256-prod-github-runner-207 kernel: [52104.604703] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 19:52:10 juju-e4d256-prod-github-runner-207 kernel: [52104.605666] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 19:52:10 juju-e4d256-prod-github-runner-207 kernel: [52104.606596] vcpu_run+0x62/0x2c0 [kvm] Aug 22 19:52:10 juju-e4d256-prod-github-runner-207 kernel: [52104.607421] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 19:52:10 juju-e4d256-prod-github-runner-207 kernel: [52104.608355] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 19:52:10 juju-e4d256-prod-github-runner-207 kernel: [52104.609229] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 19:52:10 juju-e4d256-prod-github-runner-207 kernel: [52104.610089] ? __seccomp_filter+0x4a/0x4a0 Aug 22 19:52:10 juju-e4d256-prod-github-runner-207 kernel: [52104.611162] ? __fget_files+0x86/0xc0 Aug 22 19:52:10 juju-e4d256-prod-github-runner-207 kernel: [52104.612201] __x64_sys_ioctl+0x95/0xd0 Aug 22 19:52:10 juju-e4d256-prod-github-runner-207 kernel: [52104.613201] do_syscall_64+0x5c/0xc0 Aug 22 19:52:10 juju-e4d256-prod-github-runner-207 kernel: [52104.614113] ? do_futex+0x162/0x1f0 Aug 22 19:52:10 juju-e4d256-prod-github-runner-207 kernel: [52104.614923] ? __x64_sys_futex+0x78/0x1e0 Aug 22 19:52:10 juju-e4d256-prod-github-runner-207 kernel: [52104.615610] ? __secure_computing+0xa9/0x120 Aug 22 19:52:10 juju-e4d256-prod-github-runner-207 kernel: [52104.616381] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 19:52:10 juju-e4d256-prod-github-runner-207 kernel: [52104.617152] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:52:10 juju-e4d256-prod-github-runner-207 kernel: [52104.617885] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:52:10 juju-e4d256-prod-github-runner-207 kernel: [52104.618611] ? do_syscall_64+0x69/0xc0 Aug 22 19:52:10 juju-e4d256-prod-github-runner-207 kernel: [52104.619280] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:52:10 juju-e4d256-prod-github-runner-207 kernel: [52104.620024] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:52:10 juju-e4d256-prod-github-runner-207 kernel: [52104.620737] ? do_syscall_64+0x69/0xc0 Aug 22 19:52:10 juju-e4d256-prod-github-runner-207 kernel: [52104.621369] ? do_syscall_64+0x69/0xc0 Aug 22 19:52:10 juju-e4d256-prod-github-runner-207 kernel: [52104.622008] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 19:52:10 juju-e4d256-prod-github-runner-207 kernel: [52104.622732] RIP: 0033:0x7faa5d0edaff Aug 22 19:52:10 juju-e4d256-prod-github-runner-207 kernel: [52104.623368] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 19:52:10 juju-e4d256-prod-github-runner-207 kernel: [52104.626002] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 19:52:10 juju-e4d256-prod-github-runner-207 kernel: [52104.627204] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 19:52:10 juju-e4d256-prod-github-runner-207 kernel: [52104.628120] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 19:52:10 juju-e4d256-prod-github-runner-207 kernel: [52104.629019] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 19:52:10 juju-e4d256-prod-github-runner-207 kernel: [52104.629924] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 19:52:10 juju-e4d256-prod-github-runner-207 kernel: [52104.630863] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 19:52:10 juju-e4d256-prod-github-runner-207 kernel: [52104.632178] Aug 22 19:52:38 juju-e4d256-prod-github-runner-207 kernel: [52132.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 48444s! [qemu-system-x86:6715] Aug 22 19:52:38 juju-e4d256-prod-github-runner-207 kernel: [52132.543767] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 19:52:38 juju-e4d256-prod-github-runner-207 kernel: [52132.544025] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 19:52:38 juju-e4d256-prod-github-runner-207 kernel: [52132.556527] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 19:52:38 juju-e4d256-prod-github-runner-207 kernel: [52132.557814] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 19:52:38 juju-e4d256-prod-github-runner-207 kernel: [52132.559073] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:52:38 juju-e4d256-prod-github-runner-207 kernel: [52132.560187] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 19:52:38 juju-e4d256-prod-github-runner-207 kernel: [52132.562777] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 19:52:38 juju-e4d256-prod-github-runner-207 kernel: [52132.563870] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 19:52:38 juju-e4d256-prod-github-runner-207 kernel: [52132.565064] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 19:52:38 juju-e4d256-prod-github-runner-207 kernel: [52132.566262] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 19:52:38 juju-e4d256-prod-github-runner-207 kernel: [52132.567455] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 19:52:38 juju-e4d256-prod-github-runner-207 kernel: [52132.568626] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 19:52:38 juju-e4d256-prod-github-runner-207 kernel: [52132.569811] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 19:52:38 juju-e4d256-prod-github-runner-207 kernel: [52132.571075] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 19:52:38 juju-e4d256-prod-github-runner-207 kernel: [52132.572209] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 19:52:38 juju-e4d256-prod-github-runner-207 kernel: [52132.573401] Call Trace: Aug 22 19:52:38 juju-e4d256-prod-github-runner-207 kernel: [52132.574321] Aug 22 19:52:38 juju-e4d256-prod-github-runner-207 kernel: [52132.575252] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:52:38 juju-e4d256-prod-github-runner-207 kernel: [52132.576333] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:52:38 juju-e4d256-prod-github-runner-207 kernel: [52132.577358] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:52:38 juju-e4d256-prod-github-runner-207 kernel: [52132.578467] ? show_regs.part.0+0x23/0x29 Aug 22 19:52:38 juju-e4d256-prod-github-runner-207 kernel: [52132.579495] ? show_regs.cold+0x8/0xd Aug 22 19:52:38 juju-e4d256-prod-github-runner-207 kernel: [52132.580495] ? watchdog_timer_fn+0x1be/0x220 Aug 22 19:52:38 juju-e4d256-prod-github-runner-207 kernel: [52132.581527] ? lockup_detector_update_enable+0x60/0x60 Aug 22 19:52:38 juju-e4d256-prod-github-runner-207 kernel: [52132.582619] ? __hrtimer_run_queues+0x107/0x230 Aug 22 19:52:38 juju-e4d256-prod-github-runner-207 kernel: [52132.583687] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 19:52:38 juju-e4d256-prod-github-runner-207 kernel: [52132.584740] ? hrtimer_interrupt+0x101/0x220 Aug 22 19:52:38 juju-e4d256-prod-github-runner-207 kernel: [52132.585768] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 19:52:38 juju-e4d256-prod-github-runner-207 kernel: [52132.586848] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 19:52:38 juju-e4d256-prod-github-runner-207 kernel: [52132.587917] Aug 22 19:52:38 juju-e4d256-prod-github-runner-207 kernel: [52132.588776] Aug 22 19:52:38 juju-e4d256-prod-github-runner-207 kernel: [52132.589648] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 19:52:38 juju-e4d256-prod-github-runner-207 kernel: [52132.590694] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:52:38 juju-e4d256-prod-github-runner-207 kernel: [52132.591783] ? _raw_spin_lock+0x22/0x30 Aug 22 19:52:38 juju-e4d256-prod-github-runner-207 kernel: [52132.592730] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:52:38 juju-e4d256-prod-github-runner-207 kernel: [52132.593749] direct_page_fault+0x206/0x310 [kvm] Aug 22 19:52:38 juju-e4d256-prod-github-runner-207 kernel: [52132.594774] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 19:52:38 juju-e4d256-prod-github-runner-207 kernel: [52132.595822] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 19:52:38 juju-e4d256-prod-github-runner-207 kernel: [52132.596871] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 19:52:38 juju-e4d256-prod-github-runner-207 kernel: [52132.597878] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 19:52:38 juju-e4d256-prod-github-runner-207 kernel: [52132.598827] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 19:52:38 juju-e4d256-prod-github-runner-207 kernel: [52132.599828] handle_exit+0x98/0x230 [kvm_amd] Aug 22 19:52:38 juju-e4d256-prod-github-runner-207 kernel: [52132.600746] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 19:52:38 juju-e4d256-prod-github-runner-207 kernel: [52132.601707] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 19:52:38 juju-e4d256-prod-github-runner-207 kernel: [52132.602642] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 19:52:38 juju-e4d256-prod-github-runner-207 kernel: [52132.603570] vcpu_run+0x62/0x2c0 [kvm] Aug 22 19:52:38 juju-e4d256-prod-github-runner-207 kernel: [52132.604382] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 19:52:38 juju-e4d256-prod-github-runner-207 kernel: [52132.605194] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 19:52:38 juju-e4d256-prod-github-runner-207 kernel: [52132.606067] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 19:52:38 juju-e4d256-prod-github-runner-207 kernel: [52132.606876] ? __seccomp_filter+0x4a/0x4a0 Aug 22 19:52:38 juju-e4d256-prod-github-runner-207 kernel: [52132.607648] ? __fget_files+0x86/0xc0 Aug 22 19:52:38 juju-e4d256-prod-github-runner-207 kernel: [52132.608376] __x64_sys_ioctl+0x95/0xd0 Aug 22 19:52:38 juju-e4d256-prod-github-runner-207 kernel: [52132.609082] do_syscall_64+0x5c/0xc0 Aug 22 19:52:38 juju-e4d256-prod-github-runner-207 kernel: [52132.609766] ? do_futex+0x162/0x1f0 Aug 22 19:52:38 juju-e4d256-prod-github-runner-207 kernel: [52132.610425] ? __x64_sys_futex+0x78/0x1e0 Aug 22 19:52:38 juju-e4d256-prod-github-runner-207 kernel: [52132.611148] ? __secure_computing+0xa9/0x120 Aug 22 19:52:38 juju-e4d256-prod-github-runner-207 kernel: [52132.611931] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 19:52:38 juju-e4d256-prod-github-runner-207 kernel: [52132.612730] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:52:38 juju-e4d256-prod-github-runner-207 kernel: [52132.613465] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:52:38 juju-e4d256-prod-github-runner-207 kernel: [52132.614186] ? do_syscall_64+0x69/0xc0 Aug 22 19:52:38 juju-e4d256-prod-github-runner-207 kernel: [52132.614836] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:52:38 juju-e4d256-prod-github-runner-207 kernel: [52132.615563] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:52:38 juju-e4d256-prod-github-runner-207 kernel: [52132.616292] ? do_syscall_64+0x69/0xc0 Aug 22 19:52:38 juju-e4d256-prod-github-runner-207 kernel: [52132.616944] ? do_syscall_64+0x69/0xc0 Aug 22 19:52:38 juju-e4d256-prod-github-runner-207 kernel: [52132.617579] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 19:52:38 juju-e4d256-prod-github-runner-207 kernel: [52132.618285] RIP: 0033:0x7faa5d0edaff Aug 22 19:52:38 juju-e4d256-prod-github-runner-207 kernel: [52132.618935] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 19:52:38 juju-e4d256-prod-github-runner-207 kernel: [52132.620959] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 19:52:38 juju-e4d256-prod-github-runner-207 kernel: [52132.621878] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 19:52:38 juju-e4d256-prod-github-runner-207 kernel: [52132.622781] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 19:52:38 juju-e4d256-prod-github-runner-207 kernel: [52132.623694] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 19:52:38 juju-e4d256-prod-github-runner-207 kernel: [52132.624587] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 19:52:38 juju-e4d256-prod-github-runner-207 kernel: [52132.625484] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 19:52:38 juju-e4d256-prod-github-runner-207 kernel: [52132.626407] Aug 22 19:53:06 juju-e4d256-prod-github-runner-207 kernel: [52160.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 48470s! [qemu-system-x86:6715] Aug 22 19:53:06 juju-e4d256-prod-github-runner-207 kernel: [52160.543106] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 19:53:06 juju-e4d256-prod-github-runner-207 kernel: [52160.543176] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 19:53:06 juju-e4d256-prod-github-runner-207 kernel: [52160.555408] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 19:53:06 juju-e4d256-prod-github-runner-207 kernel: [52160.556689] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 19:53:06 juju-e4d256-prod-github-runner-207 kernel: [52160.557923] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:53:06 juju-e4d256-prod-github-runner-207 kernel: [52160.558985] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 19:53:06 juju-e4d256-prod-github-runner-207 kernel: [52160.561573] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 19:53:06 juju-e4d256-prod-github-runner-207 kernel: [52160.562619] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 19:53:06 juju-e4d256-prod-github-runner-207 kernel: [52160.563798] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 19:53:06 juju-e4d256-prod-github-runner-207 kernel: [52160.564976] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 19:53:06 juju-e4d256-prod-github-runner-207 kernel: [52160.566279] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 19:53:06 juju-e4d256-prod-github-runner-207 kernel: [52160.567473] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 19:53:06 juju-e4d256-prod-github-runner-207 kernel: [52160.568648] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 19:53:06 juju-e4d256-prod-github-runner-207 kernel: [52160.569902] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 19:53:06 juju-e4d256-prod-github-runner-207 kernel: [52160.571020] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 19:53:06 juju-e4d256-prod-github-runner-207 kernel: [52160.572236] Call Trace: Aug 22 19:53:06 juju-e4d256-prod-github-runner-207 kernel: [52160.573152] Aug 22 19:53:06 juju-e4d256-prod-github-runner-207 kernel: [52160.574039] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:53:06 juju-e4d256-prod-github-runner-207 kernel: [52160.575095] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:53:06 juju-e4d256-prod-github-runner-207 kernel: [52160.576190] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:53:06 juju-e4d256-prod-github-runner-207 kernel: [52160.577347] ? show_regs.part.0+0x23/0x29 Aug 22 19:53:06 juju-e4d256-prod-github-runner-207 kernel: [52160.578540] ? show_regs.cold+0x8/0xd Aug 22 19:53:06 juju-e4d256-prod-github-runner-207 kernel: [52160.579538] ? watchdog_timer_fn+0x1be/0x220 Aug 22 19:53:06 juju-e4d256-prod-github-runner-207 kernel: [52160.580568] ? lockup_detector_update_enable+0x60/0x60 Aug 22 19:53:06 juju-e4d256-prod-github-runner-207 kernel: [52160.581651] ? __hrtimer_run_queues+0x107/0x230 Aug 22 19:53:06 juju-e4d256-prod-github-runner-207 kernel: [52160.582760] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 19:53:06 juju-e4d256-prod-github-runner-207 kernel: [52160.583801] ? hrtimer_interrupt+0x101/0x220 Aug 22 19:53:06 juju-e4d256-prod-github-runner-207 kernel: [52160.584819] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 19:53:06 juju-e4d256-prod-github-runner-207 kernel: [52160.585903] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 19:53:06 juju-e4d256-prod-github-runner-207 kernel: [52160.586967] Aug 22 19:53:06 juju-e4d256-prod-github-runner-207 kernel: [52160.587881] Aug 22 19:53:06 juju-e4d256-prod-github-runner-207 kernel: [52160.588796] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 19:53:06 juju-e4d256-prod-github-runner-207 kernel: [52160.589846] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:53:06 juju-e4d256-prod-github-runner-207 kernel: [52160.590898] ? _raw_spin_lock+0x22/0x30 Aug 22 19:53:06 juju-e4d256-prod-github-runner-207 kernel: [52160.591881] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:53:06 juju-e4d256-prod-github-runner-207 kernel: [52160.592921] direct_page_fault+0x206/0x310 [kvm] Aug 22 19:53:06 juju-e4d256-prod-github-runner-207 kernel: [52160.593952] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 19:53:06 juju-e4d256-prod-github-runner-207 kernel: [52160.594967] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 19:53:06 juju-e4d256-prod-github-runner-207 kernel: [52160.596054] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 19:53:06 juju-e4d256-prod-github-runner-207 kernel: [52160.597049] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 19:53:06 juju-e4d256-prod-github-runner-207 kernel: [52160.598005] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 19:53:06 juju-e4d256-prod-github-runner-207 kernel: [52160.598989] handle_exit+0x98/0x230 [kvm_amd] Aug 22 19:53:06 juju-e4d256-prod-github-runner-207 kernel: [52160.599899] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 19:53:06 juju-e4d256-prod-github-runner-207 kernel: [52160.600828] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 19:53:06 juju-e4d256-prod-github-runner-207 kernel: [52160.601771] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 19:53:06 juju-e4d256-prod-github-runner-207 kernel: [52160.602684] vcpu_run+0x62/0x2c0 [kvm] Aug 22 19:53:06 juju-e4d256-prod-github-runner-207 kernel: [52160.603524] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 19:53:06 juju-e4d256-prod-github-runner-207 kernel: [52160.604335] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 19:53:06 juju-e4d256-prod-github-runner-207 kernel: [52160.605201] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 19:53:06 juju-e4d256-prod-github-runner-207 kernel: [52160.606014] ? __seccomp_filter+0x4a/0x4a0 Aug 22 19:53:06 juju-e4d256-prod-github-runner-207 kernel: [52160.606762] ? __fget_files+0x86/0xc0 Aug 22 19:53:06 juju-e4d256-prod-github-runner-207 kernel: [52160.607501] __x64_sys_ioctl+0x95/0xd0 Aug 22 19:53:06 juju-e4d256-prod-github-runner-207 kernel: [52160.608306] do_syscall_64+0x5c/0xc0 Aug 22 19:53:06 juju-e4d256-prod-github-runner-207 kernel: [52160.608981] ? do_futex+0x162/0x1f0 Aug 22 19:53:06 juju-e4d256-prod-github-runner-207 kernel: [52160.609631] ? __x64_sys_futex+0x78/0x1e0 Aug 22 19:53:06 juju-e4d256-prod-github-runner-207 kernel: [52160.610304] ? __secure_computing+0xa9/0x120 Aug 22 19:53:06 juju-e4d256-prod-github-runner-207 kernel: [52160.611014] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 19:53:06 juju-e4d256-prod-github-runner-207 kernel: [52160.611788] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:53:06 juju-e4d256-prod-github-runner-207 kernel: [52160.612527] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:53:06 juju-e4d256-prod-github-runner-207 kernel: [52160.613249] ? do_syscall_64+0x69/0xc0 Aug 22 19:53:06 juju-e4d256-prod-github-runner-207 kernel: [52160.613897] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:53:06 juju-e4d256-prod-github-runner-207 kernel: [52160.614602] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:53:06 juju-e4d256-prod-github-runner-207 kernel: [52160.615326] ? do_syscall_64+0x69/0xc0 Aug 22 19:53:06 juju-e4d256-prod-github-runner-207 kernel: [52160.615956] ? do_syscall_64+0x69/0xc0 Aug 22 19:53:06 juju-e4d256-prod-github-runner-207 kernel: [52160.616590] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 19:53:06 juju-e4d256-prod-github-runner-207 kernel: [52160.617315] RIP: 0033:0x7faa5d0edaff Aug 22 19:53:06 juju-e4d256-prod-github-runner-207 kernel: [52160.617968] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 19:53:06 juju-e4d256-prod-github-runner-207 kernel: [52160.619977] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 19:53:06 juju-e4d256-prod-github-runner-207 kernel: [52160.620895] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 19:53:06 juju-e4d256-prod-github-runner-207 kernel: [52160.621804] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 19:53:06 juju-e4d256-prod-github-runner-207 kernel: [52160.622713] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 19:53:06 juju-e4d256-prod-github-runner-207 kernel: [52160.623632] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 19:53:06 juju-e4d256-prod-github-runner-207 kernel: [52160.624531] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 19:53:06 juju-e4d256-prod-github-runner-207 kernel: [52160.625430] Aug 22 19:53:34 juju-e4d256-prod-github-runner-207 kernel: [52188.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 48496s! [qemu-system-x86:6715] Aug 22 19:53:34 juju-e4d256-prod-github-runner-207 kernel: [52188.543123] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 19:53:34 juju-e4d256-prod-github-runner-207 kernel: [52188.543191] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 19:53:34 juju-e4d256-prod-github-runner-207 kernel: [52188.555551] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 19:53:34 juju-e4d256-prod-github-runner-207 kernel: [52188.556879] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 19:53:34 juju-e4d256-prod-github-runner-207 kernel: [52188.558115] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:53:34 juju-e4d256-prod-github-runner-207 kernel: [52188.559232] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 19:53:34 juju-e4d256-prod-github-runner-207 kernel: [52188.561850] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 19:53:34 juju-e4d256-prod-github-runner-207 kernel: [52188.562926] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 19:53:34 juju-e4d256-prod-github-runner-207 kernel: [52188.564091] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 19:53:34 juju-e4d256-prod-github-runner-207 kernel: [52188.565293] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 19:53:34 juju-e4d256-prod-github-runner-207 kernel: [52188.566498] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 19:53:34 juju-e4d256-prod-github-runner-207 kernel: [52188.567714] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 19:53:34 juju-e4d256-prod-github-runner-207 kernel: [52188.568914] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 19:53:34 juju-e4d256-prod-github-runner-207 kernel: [52188.570237] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 19:53:34 juju-e4d256-prod-github-runner-207 kernel: [52188.571376] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 19:53:34 juju-e4d256-prod-github-runner-207 kernel: [52188.572594] Call Trace: Aug 22 19:53:34 juju-e4d256-prod-github-runner-207 kernel: [52188.573523] Aug 22 19:53:34 juju-e4d256-prod-github-runner-207 kernel: [52188.574422] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:53:34 juju-e4d256-prod-github-runner-207 kernel: [52188.575509] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:53:34 juju-e4d256-prod-github-runner-207 kernel: [52188.576606] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:53:34 juju-e4d256-prod-github-runner-207 kernel: [52188.577697] ? show_regs.part.0+0x23/0x29 Aug 22 19:53:34 juju-e4d256-prod-github-runner-207 kernel: [52188.578786] ? show_regs.cold+0x8/0xd Aug 22 19:53:34 juju-e4d256-prod-github-runner-207 kernel: [52188.579792] ? watchdog_timer_fn+0x1be/0x220 Aug 22 19:53:34 juju-e4d256-prod-github-runner-207 kernel: [52188.580872] ? lockup_detector_update_enable+0x60/0x60 Aug 22 19:53:34 juju-e4d256-prod-github-runner-207 kernel: [52188.581952] ? __hrtimer_run_queues+0x107/0x230 Aug 22 19:53:34 juju-e4d256-prod-github-runner-207 kernel: [52188.583019] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 19:53:34 juju-e4d256-prod-github-runner-207 kernel: [52188.584054] ? hrtimer_interrupt+0x101/0x220 Aug 22 19:53:34 juju-e4d256-prod-github-runner-207 kernel: [52188.585069] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 19:53:34 juju-e4d256-prod-github-runner-207 kernel: [52188.586338] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 19:53:34 juju-e4d256-prod-github-runner-207 kernel: [52188.587554] Aug 22 19:53:34 juju-e4d256-prod-github-runner-207 kernel: [52188.588564] Aug 22 19:53:34 juju-e4d256-prod-github-runner-207 kernel: [52188.589454] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 19:53:34 juju-e4d256-prod-github-runner-207 kernel: [52188.590580] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:53:34 juju-e4d256-prod-github-runner-207 kernel: [52188.591701] ? _raw_spin_lock+0x22/0x30 Aug 22 19:53:34 juju-e4d256-prod-github-runner-207 kernel: [52188.592810] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:53:34 juju-e4d256-prod-github-runner-207 kernel: [52188.593952] direct_page_fault+0x206/0x310 [kvm] Aug 22 19:53:34 juju-e4d256-prod-github-runner-207 kernel: [52188.595136] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 19:53:34 juju-e4d256-prod-github-runner-207 kernel: [52188.596303] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 19:53:34 juju-e4d256-prod-github-runner-207 kernel: [52188.597460] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 19:53:34 juju-e4d256-prod-github-runner-207 kernel: [52188.598564] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 19:53:34 juju-e4d256-prod-github-runner-207 kernel: [52188.599575] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 19:53:34 juju-e4d256-prod-github-runner-207 kernel: [52188.600676] handle_exit+0x98/0x230 [kvm_amd] Aug 22 19:53:34 juju-e4d256-prod-github-runner-207 kernel: [52188.601613] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 19:53:34 juju-e4d256-prod-github-runner-207 kernel: [52188.602610] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 19:53:34 juju-e4d256-prod-github-runner-207 kernel: [52188.603650] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 19:53:34 juju-e4d256-prod-github-runner-207 kernel: [52188.604648] vcpu_run+0x62/0x2c0 [kvm] Aug 22 19:53:34 juju-e4d256-prod-github-runner-207 kernel: [52188.605562] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 19:53:34 juju-e4d256-prod-github-runner-207 kernel: [52188.606418] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 19:53:34 juju-e4d256-prod-github-runner-207 kernel: [52188.607477] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 19:53:34 juju-e4d256-prod-github-runner-207 kernel: [52188.608369] ? __seccomp_filter+0x4a/0x4a0 Aug 22 19:53:34 juju-e4d256-prod-github-runner-207 kernel: [52188.609132] ? __fget_files+0x86/0xc0 Aug 22 19:53:34 juju-e4d256-prod-github-runner-207 kernel: [52188.609919] __x64_sys_ioctl+0x95/0xd0 Aug 22 19:53:34 juju-e4d256-prod-github-runner-207 kernel: [52188.610622] do_syscall_64+0x5c/0xc0 Aug 22 19:53:34 juju-e4d256-prod-github-runner-207 kernel: [52188.611330] ? do_futex+0x162/0x1f0 Aug 22 19:53:34 juju-e4d256-prod-github-runner-207 kernel: [52188.611991] ? __x64_sys_futex+0x78/0x1e0 Aug 22 19:53:34 juju-e4d256-prod-github-runner-207 kernel: [52188.612665] ? __secure_computing+0xa9/0x120 Aug 22 19:53:34 juju-e4d256-prod-github-runner-207 kernel: [52188.613357] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 19:53:34 juju-e4d256-prod-github-runner-207 kernel: [52188.614120] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:53:34 juju-e4d256-prod-github-runner-207 kernel: [52188.614857] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:53:34 juju-e4d256-prod-github-runner-207 kernel: [52188.615577] ? do_syscall_64+0x69/0xc0 Aug 22 19:53:34 juju-e4d256-prod-github-runner-207 kernel: [52188.616224] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:53:34 juju-e4d256-prod-github-runner-207 kernel: [52188.616932] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:53:34 juju-e4d256-prod-github-runner-207 kernel: [52188.617687] ? do_syscall_64+0x69/0xc0 Aug 22 19:53:34 juju-e4d256-prod-github-runner-207 kernel: [52188.618331] ? do_syscall_64+0x69/0xc0 Aug 22 19:53:34 juju-e4d256-prod-github-runner-207 kernel: [52188.619008] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 19:53:34 juju-e4d256-prod-github-runner-207 kernel: [52188.619926] RIP: 0033:0x7faa5d0edaff Aug 22 19:53:34 juju-e4d256-prod-github-runner-207 kernel: [52188.620660] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 19:53:34 juju-e4d256-prod-github-runner-207 kernel: [52188.622711] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 19:53:34 juju-e4d256-prod-github-runner-207 kernel: [52188.623811] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 19:53:34 juju-e4d256-prod-github-runner-207 kernel: [52188.624863] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 19:53:34 juju-e4d256-prod-github-runner-207 kernel: [52188.625889] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 19:53:34 juju-e4d256-prod-github-runner-207 kernel: [52188.626939] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 19:53:34 juju-e4d256-prod-github-runner-207 kernel: [52188.627966] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 19:53:34 juju-e4d256-prod-github-runner-207 kernel: [52188.628997] Aug 22 19:53:46 juju-e4d256-prod-github-runner-207 kernel: [52200.668705] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 19:53:46 juju-e4d256-prod-github-runner-207 kernel: [52200.669659] rcu: 1-....: (12979841 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=6274934 Aug 22 19:53:46 juju-e4d256-prod-github-runner-207 kernel: [52200.670795] (t=13020867 jiffies g=23269 q=48978) Aug 22 19:53:46 juju-e4d256-prod-github-runner-207 kernel: [52200.671628] NMI backtrace for cpu 1 Aug 22 19:53:46 juju-e4d256-prod-github-runner-207 kernel: [52200.672340] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 19:53:46 juju-e4d256-prod-github-runner-207 kernel: [52200.673444] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 19:53:46 juju-e4d256-prod-github-runner-207 kernel: [52200.674497] Call Trace: Aug 22 19:53:46 juju-e4d256-prod-github-runner-207 kernel: [52200.675192] Aug 22 19:53:46 juju-e4d256-prod-github-runner-207 kernel: [52200.675842] show_stack+0x52/0x5c Aug 22 19:53:46 juju-e4d256-prod-github-runner-207 kernel: [52200.676565] dump_stack_lvl+0x4a/0x63 Aug 22 19:53:46 juju-e4d256-prod-github-runner-207 kernel: [52200.677311] dump_stack+0x10/0x16 Aug 22 19:53:46 juju-e4d256-prod-github-runner-207 kernel: [52200.678026] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 19:53:46 juju-e4d256-prod-github-runner-207 kernel: [52200.679124] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 19:53:46 juju-e4d256-prod-github-runner-207 kernel: [52200.679928] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 19:53:46 juju-e4d256-prod-github-runner-207 kernel: [52200.680746] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 19:53:46 juju-e4d256-prod-github-runner-207 kernel: [52200.681562] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 19:53:46 juju-e4d256-prod-github-runner-207 kernel: [52200.682372] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 19:53:46 juju-e4d256-prod-github-runner-207 kernel: [52200.683169] print_cpu_stall.cold+0x2f/0xe2 Aug 22 19:53:46 juju-e4d256-prod-github-runner-207 kernel: [52200.683932] ? timekeeping_update+0xf7/0x150 Aug 22 19:53:46 juju-e4d256-prod-github-runner-207 kernel: [52200.684707] check_cpu_stall+0x109/0x270 Aug 22 19:53:46 juju-e4d256-prod-github-runner-207 kernel: [52200.685462] rcu_sched_clock_irq+0x9a/0x250 Aug 22 19:53:46 juju-e4d256-prod-github-runner-207 kernel: [52200.686221] update_process_times+0x94/0xd0 Aug 22 19:53:46 juju-e4d256-prod-github-runner-207 kernel: [52200.686996] tick_sched_handle+0x29/0x70 Aug 22 19:53:46 juju-e4d256-prod-github-runner-207 kernel: [52200.687838] tick_sched_timer+0x8c/0xc0 Aug 22 19:53:46 juju-e4d256-prod-github-runner-207 kernel: [52200.688656] ? tick_nohz_handler+0xb0/0xb0 Aug 22 19:53:46 juju-e4d256-prod-github-runner-207 kernel: [52200.689487] __hrtimer_run_queues+0x107/0x230 Aug 22 19:53:46 juju-e4d256-prod-github-runner-207 kernel: [52200.690340] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 19:53:46 juju-e4d256-prod-github-runner-207 kernel: [52200.691212] hrtimer_interrupt+0x101/0x220 Aug 22 19:53:46 juju-e4d256-prod-github-runner-207 kernel: [52200.692052] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 19:53:46 juju-e4d256-prod-github-runner-207 kernel: [52200.692956] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 19:53:46 juju-e4d256-prod-github-runner-207 kernel: [52200.693855] Aug 22 19:53:46 juju-e4d256-prod-github-runner-207 kernel: [52200.694549] Aug 22 19:53:46 juju-e4d256-prod-github-runner-207 kernel: [52200.695235] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 19:53:46 juju-e4d256-prod-github-runner-207 kernel: [52200.696148] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:53:46 juju-e4d256-prod-github-runner-207 kernel: [52200.697134] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 19:53:46 juju-e4d256-prod-github-runner-207 kernel: [52200.699694] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 19:53:46 juju-e4d256-prod-github-runner-207 kernel: [52200.700669] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 19:53:46 juju-e4d256-prod-github-runner-207 kernel: [52200.701801] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 19:53:46 juju-e4d256-prod-github-runner-207 kernel: [52200.702934] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 19:53:46 juju-e4d256-prod-github-runner-207 kernel: [52200.704036] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 19:53:46 juju-e4d256-prod-github-runner-207 kernel: [52200.705133] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 19:53:46 juju-e4d256-prod-github-runner-207 kernel: [52200.706225] ? _raw_spin_lock+0x22/0x30 Aug 22 19:53:46 juju-e4d256-prod-github-runner-207 kernel: [52200.707079] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:53:46 juju-e4d256-prod-github-runner-207 kernel: [52200.708009] direct_page_fault+0x206/0x310 [kvm] Aug 22 19:53:46 juju-e4d256-prod-github-runner-207 kernel: [52200.708944] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 19:53:46 juju-e4d256-prod-github-runner-207 kernel: [52200.709863] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 19:53:46 juju-e4d256-prod-github-runner-207 kernel: [52200.710795] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 19:53:46 juju-e4d256-prod-github-runner-207 kernel: [52200.711694] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 19:53:46 juju-e4d256-prod-github-runner-207 kernel: [52200.712571] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 19:53:46 juju-e4d256-prod-github-runner-207 kernel: [52200.713507] handle_exit+0x98/0x230 [kvm_amd] Aug 22 19:53:46 juju-e4d256-prod-github-runner-207 kernel: [52200.714345] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 19:53:46 juju-e4d256-prod-github-runner-207 kernel: [52200.715233] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 19:53:46 juju-e4d256-prod-github-runner-207 kernel: [52200.716129] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 19:53:46 juju-e4d256-prod-github-runner-207 kernel: [52200.717014] vcpu_run+0x62/0x2c0 [kvm] Aug 22 19:53:46 juju-e4d256-prod-github-runner-207 kernel: [52200.717803] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 19:53:46 juju-e4d256-prod-github-runner-207 kernel: [52200.718643] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 19:53:46 juju-e4d256-prod-github-runner-207 kernel: [52200.719544] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 19:53:46 juju-e4d256-prod-github-runner-207 kernel: [52200.720390] ? __seccomp_filter+0x4a/0x4a0 Aug 22 19:53:46 juju-e4d256-prod-github-runner-207 kernel: [52200.721192] ? __fget_files+0x86/0xc0 Aug 22 19:53:46 juju-e4d256-prod-github-runner-207 kernel: [52200.721959] __x64_sys_ioctl+0x95/0xd0 Aug 22 19:53:46 juju-e4d256-prod-github-runner-207 kernel: [52200.722742] do_syscall_64+0x5c/0xc0 Aug 22 19:53:46 juju-e4d256-prod-github-runner-207 kernel: [52200.723500] ? do_futex+0x162/0x1f0 Aug 22 19:53:46 juju-e4d256-prod-github-runner-207 kernel: [52200.724240] ? __x64_sys_futex+0x78/0x1e0 Aug 22 19:53:46 juju-e4d256-prod-github-runner-207 kernel: [52200.725020] ? __secure_computing+0xa9/0x120 Aug 22 19:53:46 juju-e4d256-prod-github-runner-207 kernel: [52200.725824] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 19:53:46 juju-e4d256-prod-github-runner-207 kernel: [52200.726738] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:53:46 juju-e4d256-prod-github-runner-207 kernel: [52200.727586] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:53:46 juju-e4d256-prod-github-runner-207 kernel: [52200.728431] ? do_syscall_64+0x69/0xc0 Aug 22 19:53:46 juju-e4d256-prod-github-runner-207 kernel: [52200.729196] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:53:46 juju-e4d256-prod-github-runner-207 kernel: [52200.730048] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:53:46 juju-e4d256-prod-github-runner-207 kernel: [52200.730911] ? do_syscall_64+0x69/0xc0 Aug 22 19:53:46 juju-e4d256-prod-github-runner-207 kernel: [52200.731681] ? do_syscall_64+0x69/0xc0 Aug 22 19:53:46 juju-e4d256-prod-github-runner-207 kernel: [52200.732449] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 19:53:46 juju-e4d256-prod-github-runner-207 kernel: [52200.733315] RIP: 0033:0x7faa5d0edaff Aug 22 19:53:46 juju-e4d256-prod-github-runner-207 kernel: [52200.734073] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 19:53:46 juju-e4d256-prod-github-runner-207 kernel: [52200.736526] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 19:53:46 juju-e4d256-prod-github-runner-207 kernel: [52200.737630] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 19:53:46 juju-e4d256-prod-github-runner-207 kernel: [52200.738733] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 19:53:46 juju-e4d256-prod-github-runner-207 kernel: [52200.739822] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 19:53:46 juju-e4d256-prod-github-runner-207 kernel: [52200.740899] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 19:53:46 juju-e4d256-prod-github-runner-207 kernel: [52200.741961] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 19:53:46 juju-e4d256-prod-github-runner-207 kernel: [52200.743028] Aug 22 19:54:14 juju-e4d256-prod-github-runner-207 kernel: [52228.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 48533s! [qemu-system-x86:6715] Aug 22 19:54:14 juju-e4d256-prod-github-runner-207 kernel: [52228.543903] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 19:54:14 juju-e4d256-prod-github-runner-207 kernel: [52228.544145] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 19:54:14 juju-e4d256-prod-github-runner-207 kernel: [52228.558325] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 19:54:14 juju-e4d256-prod-github-runner-207 kernel: [52228.560024] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 19:54:14 juju-e4d256-prod-github-runner-207 kernel: [52228.561427] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:54:14 juju-e4d256-prod-github-runner-207 kernel: [52228.562631] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 19:54:14 juju-e4d256-prod-github-runner-207 kernel: [52228.565632] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 19:54:14 juju-e4d256-prod-github-runner-207 kernel: [52228.566991] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 19:54:14 juju-e4d256-prod-github-runner-207 kernel: [52228.568293] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 19:54:14 juju-e4d256-prod-github-runner-207 kernel: [52228.569631] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 19:54:14 juju-e4d256-prod-github-runner-207 kernel: [52228.570971] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 19:54:14 juju-e4d256-prod-github-runner-207 kernel: [52228.572275] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 19:54:14 juju-e4d256-prod-github-runner-207 kernel: [52228.573600] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 19:54:14 juju-e4d256-prod-github-runner-207 kernel: [52228.575024] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 19:54:14 juju-e4d256-prod-github-runner-207 kernel: [52228.576235] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 19:54:14 juju-e4d256-prod-github-runner-207 kernel: [52228.577576] Call Trace: Aug 22 19:54:14 juju-e4d256-prod-github-runner-207 kernel: [52228.578567] Aug 22 19:54:14 juju-e4d256-prod-github-runner-207 kernel: [52228.579721] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:54:14 juju-e4d256-prod-github-runner-207 kernel: [52228.580865] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:54:14 juju-e4d256-prod-github-runner-207 kernel: [52228.581988] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:54:14 juju-e4d256-prod-github-runner-207 kernel: [52228.583399] ? show_regs.part.0+0x23/0x29 Aug 22 19:54:14 juju-e4d256-prod-github-runner-207 kernel: [52228.584523] ? show_regs.cold+0x8/0xd Aug 22 19:54:14 juju-e4d256-prod-github-runner-207 kernel: [52228.585601] ? watchdog_timer_fn+0x1be/0x220 Aug 22 19:54:14 juju-e4d256-prod-github-runner-207 kernel: [52228.586783] ? lockup_detector_update_enable+0x60/0x60 Aug 22 19:54:14 juju-e4d256-prod-github-runner-207 kernel: [52228.587958] ? __hrtimer_run_queues+0x107/0x230 Aug 22 19:54:14 juju-e4d256-prod-github-runner-207 kernel: [52228.589092] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 19:54:14 juju-e4d256-prod-github-runner-207 kernel: [52228.590241] ? hrtimer_interrupt+0x101/0x220 Aug 22 19:54:14 juju-e4d256-prod-github-runner-207 kernel: [52228.591348] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 19:54:14 juju-e4d256-prod-github-runner-207 kernel: [52228.592522] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 19:54:14 juju-e4d256-prod-github-runner-207 kernel: [52228.593677] Aug 22 19:54:14 juju-e4d256-prod-github-runner-207 kernel: [52228.594628] Aug 22 19:54:14 juju-e4d256-prod-github-runner-207 kernel: [52228.595531] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 19:54:14 juju-e4d256-prod-github-runner-207 kernel: [52228.596689] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:54:14 juju-e4d256-prod-github-runner-207 kernel: [52228.597923] ? _raw_spin_lock+0x22/0x30 Aug 22 19:54:14 juju-e4d256-prod-github-runner-207 kernel: [52228.598982] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:54:14 juju-e4d256-prod-github-runner-207 kernel: [52228.600107] direct_page_fault+0x206/0x310 [kvm] Aug 22 19:54:14 juju-e4d256-prod-github-runner-207 kernel: [52228.601308] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 19:54:14 juju-e4d256-prod-github-runner-207 kernel: [52228.602460] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 19:54:14 juju-e4d256-prod-github-runner-207 kernel: [52228.603583] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 19:54:14 juju-e4d256-prod-github-runner-207 kernel: [52228.604717] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 19:54:14 juju-e4d256-prod-github-runner-207 kernel: [52228.605777] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 19:54:14 juju-e4d256-prod-github-runner-207 kernel: [52228.606901] handle_exit+0x98/0x230 [kvm_amd] Aug 22 19:54:14 juju-e4d256-prod-github-runner-207 kernel: [52228.607897] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 19:54:14 juju-e4d256-prod-github-runner-207 kernel: [52228.608914] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 19:54:14 juju-e4d256-prod-github-runner-207 kernel: [52228.610052] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 19:54:14 juju-e4d256-prod-github-runner-207 kernel: [52228.611091] vcpu_run+0x62/0x2c0 [kvm] Aug 22 19:54:14 juju-e4d256-prod-github-runner-207 kernel: [52228.611996] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 19:54:14 juju-e4d256-prod-github-runner-207 kernel: [52228.612898] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 19:54:14 juju-e4d256-prod-github-runner-207 kernel: [52228.613860] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 19:54:14 juju-e4d256-prod-github-runner-207 kernel: [52228.614785] ? __seccomp_filter+0x4a/0x4a0 Aug 22 19:54:14 juju-e4d256-prod-github-runner-207 kernel: [52228.615633] ? __fget_files+0x86/0xc0 Aug 22 19:54:14 juju-e4d256-prod-github-runner-207 kernel: [52228.616423] __x64_sys_ioctl+0x95/0xd0 Aug 22 19:54:14 juju-e4d256-prod-github-runner-207 kernel: [52228.617199] do_syscall_64+0x5c/0xc0 Aug 22 19:54:14 juju-e4d256-prod-github-runner-207 kernel: [52228.617954] ? do_futex+0x162/0x1f0 Aug 22 19:54:14 juju-e4d256-prod-github-runner-207 kernel: [52228.618695] ? __x64_sys_futex+0x78/0x1e0 Aug 22 19:54:14 juju-e4d256-prod-github-runner-207 kernel: [52228.619459] ? __secure_computing+0xa9/0x120 Aug 22 19:54:14 juju-e4d256-prod-github-runner-207 kernel: [52228.620246] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 19:54:14 juju-e4d256-prod-github-runner-207 kernel: [52228.621116] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:54:14 juju-e4d256-prod-github-runner-207 kernel: [52228.622014] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:54:14 juju-e4d256-prod-github-runner-207 kernel: [52228.622855] ? do_syscall_64+0x69/0xc0 Aug 22 19:54:14 juju-e4d256-prod-github-runner-207 kernel: [52228.623585] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:54:14 juju-e4d256-prod-github-runner-207 kernel: [52228.624387] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:54:14 juju-e4d256-prod-github-runner-207 kernel: [52228.625186] ? do_syscall_64+0x69/0xc0 Aug 22 19:54:14 juju-e4d256-prod-github-runner-207 kernel: [52228.625895] ? do_syscall_64+0x69/0xc0 Aug 22 19:54:14 juju-e4d256-prod-github-runner-207 kernel: [52228.626620] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 19:54:14 juju-e4d256-prod-github-runner-207 kernel: [52228.627430] RIP: 0033:0x7faa5d0edaff Aug 22 19:54:14 juju-e4d256-prod-github-runner-207 kernel: [52228.628173] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 19:54:14 juju-e4d256-prod-github-runner-207 kernel: [52228.630535] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 19:54:14 juju-e4d256-prod-github-runner-207 kernel: [52228.631599] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 19:54:14 juju-e4d256-prod-github-runner-207 kernel: [52228.632631] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 19:54:14 juju-e4d256-prod-github-runner-207 kernel: [52228.633674] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 19:54:14 juju-e4d256-prod-github-runner-207 kernel: [52228.634721] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 19:54:14 juju-e4d256-prod-github-runner-207 kernel: [52228.635784] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 19:54:14 juju-e4d256-prod-github-runner-207 kernel: [52228.636836] Aug 22 19:54:42 juju-e4d256-prod-github-runner-207 kernel: [52256.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 48559s! [qemu-system-x86:6715] Aug 22 19:54:42 juju-e4d256-prod-github-runner-207 kernel: [52256.543115] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 19:54:42 juju-e4d256-prod-github-runner-207 kernel: [52256.543184] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 19:54:42 juju-e4d256-prod-github-runner-207 kernel: [52256.555475] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 19:54:42 juju-e4d256-prod-github-runner-207 kernel: [52256.556741] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 19:54:42 juju-e4d256-prod-github-runner-207 kernel: [52256.557965] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:54:42 juju-e4d256-prod-github-runner-207 kernel: [52256.559022] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 19:54:42 juju-e4d256-prod-github-runner-207 kernel: [52256.561558] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 19:54:42 juju-e4d256-prod-github-runner-207 kernel: [52256.562614] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 19:54:42 juju-e4d256-prod-github-runner-207 kernel: [52256.563773] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 19:54:42 juju-e4d256-prod-github-runner-207 kernel: [52256.564935] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 19:54:42 juju-e4d256-prod-github-runner-207 kernel: [52256.566102] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 19:54:42 juju-e4d256-prod-github-runner-207 kernel: [52256.567286] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 19:54:42 juju-e4d256-prod-github-runner-207 kernel: [52256.568451] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 19:54:42 juju-e4d256-prod-github-runner-207 kernel: [52256.569685] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 19:54:42 juju-e4d256-prod-github-runner-207 kernel: [52256.570801] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 19:54:42 juju-e4d256-prod-github-runner-207 kernel: [52256.572019] Call Trace: Aug 22 19:54:42 juju-e4d256-prod-github-runner-207 kernel: [52256.572943] Aug 22 19:54:42 juju-e4d256-prod-github-runner-207 kernel: [52256.573856] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:54:42 juju-e4d256-prod-github-runner-207 kernel: [52256.574903] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:54:42 juju-e4d256-prod-github-runner-207 kernel: [52256.575941] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:54:42 juju-e4d256-prod-github-runner-207 kernel: [52256.577031] ? show_regs.part.0+0x23/0x29 Aug 22 19:54:42 juju-e4d256-prod-github-runner-207 kernel: [52256.578193] ? show_regs.cold+0x8/0xd Aug 22 19:54:42 juju-e4d256-prod-github-runner-207 kernel: [52256.579273] ? watchdog_timer_fn+0x1be/0x220 Aug 22 19:54:42 juju-e4d256-prod-github-runner-207 kernel: [52256.580298] ? lockup_detector_update_enable+0x60/0x60 Aug 22 19:54:42 juju-e4d256-prod-github-runner-207 kernel: [52256.581374] ? __hrtimer_run_queues+0x107/0x230 Aug 22 19:54:42 juju-e4d256-prod-github-runner-207 kernel: [52256.582426] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 19:54:42 juju-e4d256-prod-github-runner-207 kernel: [52256.583462] ? hrtimer_interrupt+0x101/0x220 Aug 22 19:54:42 juju-e4d256-prod-github-runner-207 kernel: [52256.584504] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 19:54:42 juju-e4d256-prod-github-runner-207 kernel: [52256.585596] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 19:54:42 juju-e4d256-prod-github-runner-207 kernel: [52256.586666] Aug 22 19:54:42 juju-e4d256-prod-github-runner-207 kernel: [52256.587527] Aug 22 19:54:42 juju-e4d256-prod-github-runner-207 kernel: [52256.588379] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 19:54:42 juju-e4d256-prod-github-runner-207 kernel: [52256.589424] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:54:42 juju-e4d256-prod-github-runner-207 kernel: [52256.590501] ? _raw_spin_lock+0x22/0x30 Aug 22 19:54:42 juju-e4d256-prod-github-runner-207 kernel: [52256.591460] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:54:42 juju-e4d256-prod-github-runner-207 kernel: [52256.592490] direct_page_fault+0x206/0x310 [kvm] Aug 22 19:54:42 juju-e4d256-prod-github-runner-207 kernel: [52256.593525] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 19:54:42 juju-e4d256-prod-github-runner-207 kernel: [52256.594578] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 19:54:42 juju-e4d256-prod-github-runner-207 kernel: [52256.595612] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 19:54:42 juju-e4d256-prod-github-runner-207 kernel: [52256.596686] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 19:54:42 juju-e4d256-prod-github-runner-207 kernel: [52256.597678] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 19:54:42 juju-e4d256-prod-github-runner-207 kernel: [52256.598702] handle_exit+0x98/0x230 [kvm_amd] Aug 22 19:54:42 juju-e4d256-prod-github-runner-207 kernel: [52256.599617] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 19:54:42 juju-e4d256-prod-github-runner-207 kernel: [52256.600563] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 19:54:42 juju-e4d256-prod-github-runner-207 kernel: [52256.601524] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 19:54:42 juju-e4d256-prod-github-runner-207 kernel: [52256.602478] vcpu_run+0x62/0x2c0 [kvm] Aug 22 19:54:42 juju-e4d256-prod-github-runner-207 kernel: [52256.603316] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 19:54:42 juju-e4d256-prod-github-runner-207 kernel: [52256.604153] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 19:54:42 juju-e4d256-prod-github-runner-207 kernel: [52256.605035] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 19:54:42 juju-e4d256-prod-github-runner-207 kernel: [52256.605882] ? __seccomp_filter+0x4a/0x4a0 Aug 22 19:54:42 juju-e4d256-prod-github-runner-207 kernel: [52256.606647] ? __fget_files+0x86/0xc0 Aug 22 19:54:42 juju-e4d256-prod-github-runner-207 kernel: [52256.607375] __x64_sys_ioctl+0x95/0xd0 Aug 22 19:54:42 juju-e4d256-prod-github-runner-207 kernel: [52256.608086] do_syscall_64+0x5c/0xc0 Aug 22 19:54:42 juju-e4d256-prod-github-runner-207 kernel: [52256.608775] ? do_futex+0x162/0x1f0 Aug 22 19:54:42 juju-e4d256-prod-github-runner-207 kernel: [52256.609446] ? __x64_sys_futex+0x78/0x1e0 Aug 22 19:54:42 juju-e4d256-prod-github-runner-207 kernel: [52256.610170] ? __secure_computing+0xa9/0x120 Aug 22 19:54:42 juju-e4d256-prod-github-runner-207 kernel: [52256.610885] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 19:54:42 juju-e4d256-prod-github-runner-207 kernel: [52256.611673] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:54:42 juju-e4d256-prod-github-runner-207 kernel: [52256.612422] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:54:42 juju-e4d256-prod-github-runner-207 kernel: [52256.613164] ? do_syscall_64+0x69/0xc0 Aug 22 19:54:42 juju-e4d256-prod-github-runner-207 kernel: [52256.613845] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:54:42 juju-e4d256-prod-github-runner-207 kernel: [52256.614579] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:54:42 juju-e4d256-prod-github-runner-207 kernel: [52256.615298] ? do_syscall_64+0x69/0xc0 Aug 22 19:54:42 juju-e4d256-prod-github-runner-207 kernel: [52256.615955] ? do_syscall_64+0x69/0xc0 Aug 22 19:54:42 juju-e4d256-prod-github-runner-207 kernel: [52256.616599] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 19:54:42 juju-e4d256-prod-github-runner-207 kernel: [52256.617346] RIP: 0033:0x7faa5d0edaff Aug 22 19:54:42 juju-e4d256-prod-github-runner-207 kernel: [52256.618028] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 19:54:42 juju-e4d256-prod-github-runner-207 kernel: [52256.620095] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 19:54:42 juju-e4d256-prod-github-runner-207 kernel: [52256.621047] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 19:54:42 juju-e4d256-prod-github-runner-207 kernel: [52256.621995] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 19:54:42 juju-e4d256-prod-github-runner-207 kernel: [52256.622923] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 19:54:42 juju-e4d256-prod-github-runner-207 kernel: [52256.623841] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 19:54:42 juju-e4d256-prod-github-runner-207 kernel: [52256.624766] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 19:54:42 juju-e4d256-prod-github-runner-207 kernel: [52256.625695] Aug 22 19:55:10 juju-e4d256-prod-github-runner-207 kernel: [52284.541981] watchdog: BUG: soft lockup - CPU#1 stuck for 48585s! [qemu-system-x86:6715] Aug 22 19:55:10 juju-e4d256-prod-github-runner-207 kernel: [52284.543096] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 19:55:10 juju-e4d256-prod-github-runner-207 kernel: [52284.543165] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 19:55:10 juju-e4d256-prod-github-runner-207 kernel: [52284.555359] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 19:55:10 juju-e4d256-prod-github-runner-207 kernel: [52284.556584] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 19:55:10 juju-e4d256-prod-github-runner-207 kernel: [52284.557778] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:55:10 juju-e4d256-prod-github-runner-207 kernel: [52284.558812] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 19:55:10 juju-e4d256-prod-github-runner-207 kernel: [52284.561280] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 19:55:10 juju-e4d256-prod-github-runner-207 kernel: [52284.562318] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 19:55:10 juju-e4d256-prod-github-runner-207 kernel: [52284.563449] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 19:55:10 juju-e4d256-prod-github-runner-207 kernel: [52284.564577] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 19:55:10 juju-e4d256-prod-github-runner-207 kernel: [52284.565729] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 19:55:10 juju-e4d256-prod-github-runner-207 kernel: [52284.566860] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 19:55:10 juju-e4d256-prod-github-runner-207 kernel: [52284.567995] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 19:55:10 juju-e4d256-prod-github-runner-207 kernel: [52284.569193] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 19:55:10 juju-e4d256-prod-github-runner-207 kernel: [52284.570278] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 19:55:10 juju-e4d256-prod-github-runner-207 kernel: [52284.571445] Call Trace: Aug 22 19:55:10 juju-e4d256-prod-github-runner-207 kernel: [52284.572346] Aug 22 19:55:10 juju-e4d256-prod-github-runner-207 kernel: [52284.573222] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:55:10 juju-e4d256-prod-github-runner-207 kernel: [52284.574252] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:55:10 juju-e4d256-prod-github-runner-207 kernel: [52284.575254] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:55:10 juju-e4d256-prod-github-runner-207 kernel: [52284.576308] ? show_regs.part.0+0x23/0x29 Aug 22 19:55:10 juju-e4d256-prod-github-runner-207 kernel: [52284.577293] ? show_regs.cold+0x8/0xd Aug 22 19:55:10 juju-e4d256-prod-github-runner-207 kernel: [52284.578362] ? watchdog_timer_fn+0x1be/0x220 Aug 22 19:55:10 juju-e4d256-prod-github-runner-207 kernel: [52284.579396] ? lockup_detector_update_enable+0x60/0x60 Aug 22 19:55:10 juju-e4d256-prod-github-runner-207 kernel: [52284.580438] ? __hrtimer_run_queues+0x107/0x230 Aug 22 19:55:10 juju-e4d256-prod-github-runner-207 kernel: [52284.581472] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 19:55:10 juju-e4d256-prod-github-runner-207 kernel: [52284.582479] ? hrtimer_interrupt+0x101/0x220 Aug 22 19:55:10 juju-e4d256-prod-github-runner-207 kernel: [52284.583479] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 19:55:10 juju-e4d256-prod-github-runner-207 kernel: [52284.584532] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 19:55:10 juju-e4d256-prod-github-runner-207 kernel: [52284.585577] Aug 22 19:55:10 juju-e4d256-prod-github-runner-207 kernel: [52284.586420] Aug 22 19:55:10 juju-e4d256-prod-github-runner-207 kernel: [52284.587252] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 19:55:10 juju-e4d256-prod-github-runner-207 kernel: [52284.588268] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:55:10 juju-e4d256-prod-github-runner-207 kernel: [52284.589285] ? _raw_spin_lock+0x22/0x30 Aug 22 19:55:10 juju-e4d256-prod-github-runner-207 kernel: [52284.590231] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:55:10 juju-e4d256-prod-github-runner-207 kernel: [52284.591230] direct_page_fault+0x206/0x310 [kvm] Aug 22 19:55:10 juju-e4d256-prod-github-runner-207 kernel: [52284.592231] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 19:55:10 juju-e4d256-prod-github-runner-207 kernel: [52284.593217] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 19:55:10 juju-e4d256-prod-github-runner-207 kernel: [52284.594217] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 19:55:10 juju-e4d256-prod-github-runner-207 kernel: [52284.595166] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 19:55:10 juju-e4d256-prod-github-runner-207 kernel: [52284.596135] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 19:55:10 juju-e4d256-prod-github-runner-207 kernel: [52284.597119] handle_exit+0x98/0x230 [kvm_amd] Aug 22 19:55:10 juju-e4d256-prod-github-runner-207 kernel: [52284.598123] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 19:55:10 juju-e4d256-prod-github-runner-207 kernel: [52284.599066] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 19:55:10 juju-e4d256-prod-github-runner-207 kernel: [52284.599992] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 19:55:10 juju-e4d256-prod-github-runner-207 kernel: [52284.600891] vcpu_run+0x62/0x2c0 [kvm] Aug 22 19:55:10 juju-e4d256-prod-github-runner-207 kernel: [52284.601818] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 19:55:10 juju-e4d256-prod-github-runner-207 kernel: [52284.602637] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 19:55:10 juju-e4d256-prod-github-runner-207 kernel: [52284.603497] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 19:55:10 juju-e4d256-prod-github-runner-207 kernel: [52284.604291] ? __seccomp_filter+0x4a/0x4a0 Aug 22 19:55:10 juju-e4d256-prod-github-runner-207 kernel: [52284.605036] ? __fget_files+0x86/0xc0 Aug 22 19:55:10 juju-e4d256-prod-github-runner-207 kernel: [52284.605837] __x64_sys_ioctl+0x95/0xd0 Aug 22 19:55:10 juju-e4d256-prod-github-runner-207 kernel: [52284.606541] do_syscall_64+0x5c/0xc0 Aug 22 19:55:10 juju-e4d256-prod-github-runner-207 kernel: [52284.607208] ? do_futex+0x162/0x1f0 Aug 22 19:55:10 juju-e4d256-prod-github-runner-207 kernel: [52284.607856] ? __x64_sys_futex+0x78/0x1e0 Aug 22 19:55:10 juju-e4d256-prod-github-runner-207 kernel: [52284.608526] ? __secure_computing+0xa9/0x120 Aug 22 19:55:10 juju-e4d256-prod-github-runner-207 kernel: [52284.609221] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 19:55:10 juju-e4d256-prod-github-runner-207 kernel: [52284.610105] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:55:10 juju-e4d256-prod-github-runner-207 kernel: [52284.610836] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:55:10 juju-e4d256-prod-github-runner-207 kernel: [52284.611559] ? do_syscall_64+0x69/0xc0 Aug 22 19:55:10 juju-e4d256-prod-github-runner-207 kernel: [52284.612203] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:55:10 juju-e4d256-prod-github-runner-207 kernel: [52284.612905] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:55:10 juju-e4d256-prod-github-runner-207 kernel: [52284.613646] ? do_syscall_64+0x69/0xc0 Aug 22 19:55:10 juju-e4d256-prod-github-runner-207 kernel: [52284.614277] ? do_syscall_64+0x69/0xc0 Aug 22 19:55:10 juju-e4d256-prod-github-runner-207 kernel: [52284.614900] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 19:55:10 juju-e4d256-prod-github-runner-207 kernel: [52284.615609] RIP: 0033:0x7faa5d0edaff Aug 22 19:55:10 juju-e4d256-prod-github-runner-207 kernel: [52284.616232] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 19:55:10 juju-e4d256-prod-github-runner-207 kernel: [52284.618295] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 19:55:10 juju-e4d256-prod-github-runner-207 kernel: [52284.619220] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 19:55:10 juju-e4d256-prod-github-runner-207 kernel: [52284.620109] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 19:55:10 juju-e4d256-prod-github-runner-207 kernel: [52284.620997] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 19:55:10 juju-e4d256-prod-github-runner-207 kernel: [52284.621949] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 19:55:10 juju-e4d256-prod-github-runner-207 kernel: [52284.622846] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 19:55:10 juju-e4d256-prod-github-runner-207 kernel: [52284.623739] Aug 22 19:55:38 juju-e4d256-prod-github-runner-207 kernel: [52312.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 48611s! [qemu-system-x86:6715] Aug 22 19:55:38 juju-e4d256-prod-github-runner-207 kernel: [52312.543745] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 19:55:38 juju-e4d256-prod-github-runner-207 kernel: [52312.544003] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 19:55:38 juju-e4d256-prod-github-runner-207 kernel: [52312.556150] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 19:55:38 juju-e4d256-prod-github-runner-207 kernel: [52312.557473] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 19:55:38 juju-e4d256-prod-github-runner-207 kernel: [52312.558696] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:55:38 juju-e4d256-prod-github-runner-207 kernel: [52312.559754] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 19:55:38 juju-e4d256-prod-github-runner-207 kernel: [52312.562376] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 19:55:38 juju-e4d256-prod-github-runner-207 kernel: [52312.563419] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 19:55:38 juju-e4d256-prod-github-runner-207 kernel: [52312.564597] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 19:55:38 juju-e4d256-prod-github-runner-207 kernel: [52312.565776] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 19:55:38 juju-e4d256-prod-github-runner-207 kernel: [52312.566936] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 19:55:38 juju-e4d256-prod-github-runner-207 kernel: [52312.568101] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 19:55:38 juju-e4d256-prod-github-runner-207 kernel: [52312.569288] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 19:55:38 juju-e4d256-prod-github-runner-207 kernel: [52312.570533] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 19:55:38 juju-e4d256-prod-github-runner-207 kernel: [52312.571644] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 19:55:38 juju-e4d256-prod-github-runner-207 kernel: [52312.572841] Call Trace: Aug 22 19:55:38 juju-e4d256-prod-github-runner-207 kernel: [52312.573775] Aug 22 19:55:38 juju-e4d256-prod-github-runner-207 kernel: [52312.574716] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:55:38 juju-e4d256-prod-github-runner-207 kernel: [52312.575768] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:55:38 juju-e4d256-prod-github-runner-207 kernel: [52312.576800] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:55:38 juju-e4d256-prod-github-runner-207 kernel: [52312.577926] ? show_regs.part.0+0x23/0x29 Aug 22 19:55:38 juju-e4d256-prod-github-runner-207 kernel: [52312.579051] ? show_regs.cold+0x8/0xd Aug 22 19:55:38 juju-e4d256-prod-github-runner-207 kernel: [52312.580123] ? watchdog_timer_fn+0x1be/0x220 Aug 22 19:55:38 juju-e4d256-prod-github-runner-207 kernel: [52312.581307] ? lockup_detector_update_enable+0x60/0x60 Aug 22 19:55:38 juju-e4d256-prod-github-runner-207 kernel: [52312.582501] ? __hrtimer_run_queues+0x107/0x230 Aug 22 19:55:38 juju-e4d256-prod-github-runner-207 kernel: [52312.583625] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 19:55:38 juju-e4d256-prod-github-runner-207 kernel: [52312.584770] ? hrtimer_interrupt+0x101/0x220 Aug 22 19:55:38 juju-e4d256-prod-github-runner-207 kernel: [52312.585934] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 19:55:38 juju-e4d256-prod-github-runner-207 kernel: [52312.587128] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 19:55:38 juju-e4d256-prod-github-runner-207 kernel: [52312.588277] Aug 22 19:55:38 juju-e4d256-prod-github-runner-207 kernel: [52312.589212] Aug 22 19:55:38 juju-e4d256-prod-github-runner-207 kernel: [52312.590114] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 19:55:38 juju-e4d256-prod-github-runner-207 kernel: [52312.591261] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:55:38 juju-e4d256-prod-github-runner-207 kernel: [52312.592415] ? _raw_spin_lock+0x22/0x30 Aug 22 19:55:38 juju-e4d256-prod-github-runner-207 kernel: [52312.593483] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:55:38 juju-e4d256-prod-github-runner-207 kernel: [52312.594617] direct_page_fault+0x206/0x310 [kvm] Aug 22 19:55:38 juju-e4d256-prod-github-runner-207 kernel: [52312.595750] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 19:55:38 juju-e4d256-prod-github-runner-207 kernel: [52312.596862] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 19:55:38 juju-e4d256-prod-github-runner-207 kernel: [52312.597988] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 19:55:38 juju-e4d256-prod-github-runner-207 kernel: [52312.599116] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 19:55:38 juju-e4d256-prod-github-runner-207 kernel: [52312.600163] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 19:55:38 juju-e4d256-prod-github-runner-207 kernel: [52312.601283] handle_exit+0x98/0x230 [kvm_amd] Aug 22 19:55:38 juju-e4d256-prod-github-runner-207 kernel: [52312.602281] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 19:55:38 juju-e4d256-prod-github-runner-207 kernel: [52312.603294] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 19:55:38 juju-e4d256-prod-github-runner-207 kernel: [52312.604319] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 19:55:38 juju-e4d256-prod-github-runner-207 kernel: [52312.605348] vcpu_run+0x62/0x2c0 [kvm] Aug 22 19:55:38 juju-e4d256-prod-github-runner-207 kernel: [52312.606241] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 19:55:38 juju-e4d256-prod-github-runner-207 kernel: [52312.607151] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 19:55:38 juju-e4d256-prod-github-runner-207 kernel: [52312.608123] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 19:55:38 juju-e4d256-prod-github-runner-207 kernel: [52312.609029] ? __seccomp_filter+0x4a/0x4a0 Aug 22 19:55:38 juju-e4d256-prod-github-runner-207 kernel: [52312.609900] ? __fget_files+0x86/0xc0 Aug 22 19:55:38 juju-e4d256-prod-github-runner-207 kernel: [52312.610714] __x64_sys_ioctl+0x95/0xd0 Aug 22 19:55:38 juju-e4d256-prod-github-runner-207 kernel: [52312.611525] do_syscall_64+0x5c/0xc0 Aug 22 19:55:38 juju-e4d256-prod-github-runner-207 kernel: [52312.612332] ? do_futex+0x162/0x1f0 Aug 22 19:55:38 juju-e4d256-prod-github-runner-207 kernel: [52312.613118] ? __x64_sys_futex+0x78/0x1e0 Aug 22 19:55:38 juju-e4d256-prod-github-runner-207 kernel: [52312.613919] ? __secure_computing+0xa9/0x120 Aug 22 19:55:38 juju-e4d256-prod-github-runner-207 kernel: [52312.614712] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 19:55:38 juju-e4d256-prod-github-runner-207 kernel: [52312.615589] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:55:38 juju-e4d256-prod-github-runner-207 kernel: [52312.616430] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:55:38 juju-e4d256-prod-github-runner-207 kernel: [52312.617293] ? do_syscall_64+0x69/0xc0 Aug 22 19:55:38 juju-e4d256-prod-github-runner-207 kernel: [52312.618025] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:55:38 juju-e4d256-prod-github-runner-207 kernel: [52312.618830] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:55:38 juju-e4d256-prod-github-runner-207 kernel: [52312.619627] ? do_syscall_64+0x69/0xc0 Aug 22 19:55:38 juju-e4d256-prod-github-runner-207 kernel: [52312.620329] ? do_syscall_64+0x69/0xc0 Aug 22 19:55:38 juju-e4d256-prod-github-runner-207 kernel: [52312.621033] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 19:55:38 juju-e4d256-prod-github-runner-207 kernel: [52312.621866] RIP: 0033:0x7faa5d0edaff Aug 22 19:55:38 juju-e4d256-prod-github-runner-207 kernel: [52312.622605] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 19:55:38 juju-e4d256-prod-github-runner-207 kernel: [52312.624955] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 19:55:38 juju-e4d256-prod-github-runner-207 kernel: [52312.626034] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 19:55:38 juju-e4d256-prod-github-runner-207 kernel: [52312.627265] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 19:55:38 juju-e4d256-prod-github-runner-207 kernel: [52312.628291] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 19:55:38 juju-e4d256-prod-github-runner-207 kernel: [52312.629357] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 19:55:38 juju-e4d256-prod-github-runner-207 kernel: [52312.630391] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 19:55:38 juju-e4d256-prod-github-runner-207 kernel: [52312.631437] Aug 22 19:56:06 juju-e4d256-prod-github-runner-207 kernel: [52340.541981] watchdog: BUG: soft lockup - CPU#1 stuck for 48637s! [qemu-system-x86:6715] Aug 22 19:56:06 juju-e4d256-prod-github-runner-207 kernel: [52340.543094] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 19:56:06 juju-e4d256-prod-github-runner-207 kernel: [52340.543160] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 19:56:06 juju-e4d256-prod-github-runner-207 kernel: [52340.555564] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 19:56:06 juju-e4d256-prod-github-runner-207 kernel: [52340.556857] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 19:56:06 juju-e4d256-prod-github-runner-207 kernel: [52340.558076] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:56:06 juju-e4d256-prod-github-runner-207 kernel: [52340.559138] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 19:56:06 juju-e4d256-prod-github-runner-207 kernel: [52340.561712] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 19:56:06 juju-e4d256-prod-github-runner-207 kernel: [52340.562757] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 19:56:06 juju-e4d256-prod-github-runner-207 kernel: [52340.563931] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 19:56:06 juju-e4d256-prod-github-runner-207 kernel: [52340.565114] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 19:56:06 juju-e4d256-prod-github-runner-207 kernel: [52340.566278] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 19:56:06 juju-e4d256-prod-github-runner-207 kernel: [52340.567446] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 19:56:06 juju-e4d256-prod-github-runner-207 kernel: [52340.568620] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 19:56:06 juju-e4d256-prod-github-runner-207 kernel: [52340.569883] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 19:56:06 juju-e4d256-prod-github-runner-207 kernel: [52340.570987] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 19:56:06 juju-e4d256-prod-github-runner-207 kernel: [52340.572182] Call Trace: Aug 22 19:56:06 juju-e4d256-prod-github-runner-207 kernel: [52340.573121] Aug 22 19:56:06 juju-e4d256-prod-github-runner-207 kernel: [52340.574015] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:56:06 juju-e4d256-prod-github-runner-207 kernel: [52340.575057] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:56:06 juju-e4d256-prod-github-runner-207 kernel: [52340.576077] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:56:06 juju-e4d256-prod-github-runner-207 kernel: [52340.577174] ? show_regs.part.0+0x23/0x29 Aug 22 19:56:06 juju-e4d256-prod-github-runner-207 kernel: [52340.578175] ? show_regs.cold+0x8/0xd Aug 22 19:56:06 juju-e4d256-prod-github-runner-207 kernel: [52340.579152] ? watchdog_timer_fn+0x1be/0x220 Aug 22 19:56:06 juju-e4d256-prod-github-runner-207 kernel: [52340.580185] ? lockup_detector_update_enable+0x60/0x60 Aug 22 19:56:06 juju-e4d256-prod-github-runner-207 kernel: [52340.581264] ? __hrtimer_run_queues+0x107/0x230 Aug 22 19:56:06 juju-e4d256-prod-github-runner-207 kernel: [52340.582325] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 19:56:06 juju-e4d256-prod-github-runner-207 kernel: [52340.583472] ? hrtimer_interrupt+0x101/0x220 Aug 22 19:56:06 juju-e4d256-prod-github-runner-207 kernel: [52340.584493] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 19:56:06 juju-e4d256-prod-github-runner-207 kernel: [52340.585606] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 19:56:06 juju-e4d256-prod-github-runner-207 kernel: [52340.586657] Aug 22 19:56:06 juju-e4d256-prod-github-runner-207 kernel: [52340.587509] Aug 22 19:56:06 juju-e4d256-prod-github-runner-207 kernel: [52340.588351] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 19:56:06 juju-e4d256-prod-github-runner-207 kernel: [52340.589409] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:56:06 juju-e4d256-prod-github-runner-207 kernel: [52340.590455] ? _raw_spin_lock+0x22/0x30 Aug 22 19:56:06 juju-e4d256-prod-github-runner-207 kernel: [52340.591403] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:56:06 juju-e4d256-prod-github-runner-207 kernel: [52340.592433] direct_page_fault+0x206/0x310 [kvm] Aug 22 19:56:06 juju-e4d256-prod-github-runner-207 kernel: [52340.593482] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 19:56:06 juju-e4d256-prod-github-runner-207 kernel: [52340.594493] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 19:56:06 juju-e4d256-prod-github-runner-207 kernel: [52340.595498] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 19:56:06 juju-e4d256-prod-github-runner-207 kernel: [52340.596474] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 19:56:06 juju-e4d256-prod-github-runner-207 kernel: [52340.597439] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 19:56:06 juju-e4d256-prod-github-runner-207 kernel: [52340.598417] handle_exit+0x98/0x230 [kvm_amd] Aug 22 19:56:06 juju-e4d256-prod-github-runner-207 kernel: [52340.599308] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 19:56:06 juju-e4d256-prod-github-runner-207 kernel: [52340.600230] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 19:56:06 juju-e4d256-prod-github-runner-207 kernel: [52340.601174] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 19:56:06 juju-e4d256-prod-github-runner-207 kernel: [52340.602083] vcpu_run+0x62/0x2c0 [kvm] Aug 22 19:56:06 juju-e4d256-prod-github-runner-207 kernel: [52340.602896] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 19:56:06 juju-e4d256-prod-github-runner-207 kernel: [52340.603715] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 19:56:06 juju-e4d256-prod-github-runner-207 kernel: [52340.604570] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 19:56:06 juju-e4d256-prod-github-runner-207 kernel: [52340.605412] ? __seccomp_filter+0x4a/0x4a0 Aug 22 19:56:06 juju-e4d256-prod-github-runner-207 kernel: [52340.606160] ? __fget_files+0x86/0xc0 Aug 22 19:56:06 juju-e4d256-prod-github-runner-207 kernel: [52340.606866] __x64_sys_ioctl+0x95/0xd0 Aug 22 19:56:06 juju-e4d256-prod-github-runner-207 kernel: [52340.607565] do_syscall_64+0x5c/0xc0 Aug 22 19:56:06 juju-e4d256-prod-github-runner-207 kernel: [52340.608230] ? do_futex+0x162/0x1f0 Aug 22 19:56:06 juju-e4d256-prod-github-runner-207 kernel: [52340.608892] ? __x64_sys_futex+0x78/0x1e0 Aug 22 19:56:06 juju-e4d256-prod-github-runner-207 kernel: [52340.609568] ? __secure_computing+0xa9/0x120 Aug 22 19:56:06 juju-e4d256-prod-github-runner-207 kernel: [52340.610259] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 19:56:06 juju-e4d256-prod-github-runner-207 kernel: [52340.611034] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:56:06 juju-e4d256-prod-github-runner-207 kernel: [52340.611763] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:56:06 juju-e4d256-prod-github-runner-207 kernel: [52340.612486] ? do_syscall_64+0x69/0xc0 Aug 22 19:56:06 juju-e4d256-prod-github-runner-207 kernel: [52340.613150] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:56:06 juju-e4d256-prod-github-runner-207 kernel: [52340.613865] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:56:06 juju-e4d256-prod-github-runner-207 kernel: [52340.614563] ? do_syscall_64+0x69/0xc0 Aug 22 19:56:06 juju-e4d256-prod-github-runner-207 kernel: [52340.615194] ? do_syscall_64+0x69/0xc0 Aug 22 19:56:06 juju-e4d256-prod-github-runner-207 kernel: [52340.615826] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 19:56:06 juju-e4d256-prod-github-runner-207 kernel: [52340.616536] RIP: 0033:0x7faa5d0edaff Aug 22 19:56:06 juju-e4d256-prod-github-runner-207 kernel: [52340.617207] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 19:56:06 juju-e4d256-prod-github-runner-207 kernel: [52340.619202] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 19:56:06 juju-e4d256-prod-github-runner-207 kernel: [52340.620115] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 19:56:06 juju-e4d256-prod-github-runner-207 kernel: [52340.621047] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 19:56:06 juju-e4d256-prod-github-runner-207 kernel: [52340.621942] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 19:56:06 juju-e4d256-prod-github-runner-207 kernel: [52340.622839] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 19:56:06 juju-e4d256-prod-github-runner-207 kernel: [52340.623730] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 19:56:06 juju-e4d256-prod-github-runner-207 kernel: [52340.624630] Aug 22 19:56:34 juju-e4d256-prod-github-runner-207 kernel: [52368.541980] watchdog: BUG: soft lockup - CPU#1 stuck for 48664s! [qemu-system-x86:6715] Aug 22 19:56:34 juju-e4d256-prod-github-runner-207 kernel: [52368.543079] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 19:56:34 juju-e4d256-prod-github-runner-207 kernel: [52368.543145] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 19:56:34 juju-e4d256-prod-github-runner-207 kernel: [52368.555270] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 19:56:34 juju-e4d256-prod-github-runner-207 kernel: [52368.556778] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 19:56:34 juju-e4d256-prod-github-runner-207 kernel: [52368.558064] RIP: 0010:native_queued_spin_lock_slowpath+0xc/0x40 Aug 22 19:56:34 juju-e4d256-prod-github-runner-207 kernel: [52368.559149] Code: fe ff ff eb af 4c 89 fe 48 c7 c7 20 99 e9 89 e8 ca 69 55 00 e9 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 <8b> 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 eb Aug 22 19:56:34 juju-e4d256-prod-github-runner-207 kernel: [52368.561774] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 19:56:34 juju-e4d256-prod-github-runner-207 kernel: [52368.562867] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 19:56:34 juju-e4d256-prod-github-runner-207 kernel: [52368.564082] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 19:56:34 juju-e4d256-prod-github-runner-207 kernel: [52368.565272] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 19:56:34 juju-e4d256-prod-github-runner-207 kernel: [52368.566434] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 19:56:34 juju-e4d256-prod-github-runner-207 kernel: [52368.567613] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 19:56:34 juju-e4d256-prod-github-runner-207 kernel: [52368.568866] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 19:56:34 juju-e4d256-prod-github-runner-207 kernel: [52368.570131] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 19:56:34 juju-e4d256-prod-github-runner-207 kernel: [52368.571254] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 19:56:34 juju-e4d256-prod-github-runner-207 kernel: [52368.572483] Call Trace: Aug 22 19:56:34 juju-e4d256-prod-github-runner-207 kernel: [52368.573425] Aug 22 19:56:34 juju-e4d256-prod-github-runner-207 kernel: [52368.574332] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:56:34 juju-e4d256-prod-github-runner-207 kernel: [52368.575375] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:56:34 juju-e4d256-prod-github-runner-207 kernel: [52368.576425] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:56:34 juju-e4d256-prod-github-runner-207 kernel: [52368.577507] ? show_regs.part.0+0x23/0x29 Aug 22 19:56:34 juju-e4d256-prod-github-runner-207 kernel: [52368.578508] ? show_regs.cold+0x8/0xd Aug 22 19:56:34 juju-e4d256-prod-github-runner-207 kernel: [52368.579535] ? watchdog_timer_fn+0x1be/0x220 Aug 22 19:56:34 juju-e4d256-prod-github-runner-207 kernel: [52368.580580] ? lockup_detector_update_enable+0x60/0x60 Aug 22 19:56:34 juju-e4d256-prod-github-runner-207 kernel: [52368.581644] ? __hrtimer_run_queues+0x107/0x230 Aug 22 19:56:34 juju-e4d256-prod-github-runner-207 kernel: [52368.582673] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 19:56:34 juju-e4d256-prod-github-runner-207 kernel: [52368.583704] ? hrtimer_interrupt+0x101/0x220 Aug 22 19:56:34 juju-e4d256-prod-github-runner-207 kernel: [52368.584746] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 19:56:34 juju-e4d256-prod-github-runner-207 kernel: [52368.585817] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 19:56:34 juju-e4d256-prod-github-runner-207 kernel: [52368.586866] Aug 22 19:56:34 juju-e4d256-prod-github-runner-207 kernel: [52368.587723] Aug 22 19:56:34 juju-e4d256-prod-github-runner-207 kernel: [52368.588586] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 19:56:34 juju-e4d256-prod-github-runner-207 kernel: [52368.589662] ? native_queued_spin_lock_slowpath+0xc/0x40 Aug 22 19:56:34 juju-e4d256-prod-github-runner-207 kernel: [52368.590708] ? _raw_spin_lock+0x22/0x30 Aug 22 19:56:34 juju-e4d256-prod-github-runner-207 kernel: [52368.591652] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:56:34 juju-e4d256-prod-github-runner-207 kernel: [52368.592687] direct_page_fault+0x206/0x310 [kvm] Aug 22 19:56:34 juju-e4d256-prod-github-runner-207 kernel: [52368.593743] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 19:56:34 juju-e4d256-prod-github-runner-207 kernel: [52368.594785] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 19:56:34 juju-e4d256-prod-github-runner-207 kernel: [52368.595797] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 19:56:34 juju-e4d256-prod-github-runner-207 kernel: [52368.596811] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 19:56:34 juju-e4d256-prod-github-runner-207 kernel: [52368.597779] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 19:56:34 juju-e4d256-prod-github-runner-207 kernel: [52368.598815] handle_exit+0x98/0x230 [kvm_amd] Aug 22 19:56:34 juju-e4d256-prod-github-runner-207 kernel: [52368.599742] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 19:56:34 juju-e4d256-prod-github-runner-207 kernel: [52368.600720] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 19:56:34 juju-e4d256-prod-github-runner-207 kernel: [52368.601672] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 19:56:34 juju-e4d256-prod-github-runner-207 kernel: [52368.602605] vcpu_run+0x62/0x2c0 [kvm] Aug 22 19:56:34 juju-e4d256-prod-github-runner-207 kernel: [52368.603444] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 19:56:34 juju-e4d256-prod-github-runner-207 kernel: [52368.604278] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 19:56:34 juju-e4d256-prod-github-runner-207 kernel: [52368.605189] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 19:56:34 juju-e4d256-prod-github-runner-207 kernel: [52368.606007] ? __seccomp_filter+0x4a/0x4a0 Aug 22 19:56:34 juju-e4d256-prod-github-runner-207 kernel: [52368.606764] ? __fget_files+0x86/0xc0 Aug 22 19:56:34 juju-e4d256-prod-github-runner-207 kernel: [52368.607476] __x64_sys_ioctl+0x95/0xd0 Aug 22 19:56:34 juju-e4d256-prod-github-runner-207 kernel: [52368.608201] do_syscall_64+0x5c/0xc0 Aug 22 19:56:34 juju-e4d256-prod-github-runner-207 kernel: [52368.608998] ? do_futex+0x162/0x1f0 Aug 22 19:56:34 juju-e4d256-prod-github-runner-207 kernel: [52368.609751] ? __x64_sys_futex+0x78/0x1e0 Aug 22 19:56:34 juju-e4d256-prod-github-runner-207 kernel: [52368.610634] ? __secure_computing+0xa9/0x120 Aug 22 19:56:34 juju-e4d256-prod-github-runner-207 kernel: [52368.611341] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 19:56:34 juju-e4d256-prod-github-runner-207 kernel: [52368.612107] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:56:34 juju-e4d256-prod-github-runner-207 kernel: [52368.612868] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:56:34 juju-e4d256-prod-github-runner-207 kernel: [52368.613770] ? do_syscall_64+0x69/0xc0 Aug 22 19:56:34 juju-e4d256-prod-github-runner-207 kernel: [52368.614464] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:56:34 juju-e4d256-prod-github-runner-207 kernel: [52368.615173] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:56:34 juju-e4d256-prod-github-runner-207 kernel: [52368.615886] ? do_syscall_64+0x69/0xc0 Aug 22 19:56:34 juju-e4d256-prod-github-runner-207 kernel: [52368.616543] ? do_syscall_64+0x69/0xc0 Aug 22 19:56:34 juju-e4d256-prod-github-runner-207 kernel: [52368.617173] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 19:56:34 juju-e4d256-prod-github-runner-207 kernel: [52368.617881] RIP: 0033:0x7faa5d0edaff Aug 22 19:56:34 juju-e4d256-prod-github-runner-207 kernel: [52368.618535] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 19:56:34 juju-e4d256-prod-github-runner-207 kernel: [52368.620600] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 19:56:34 juju-e4d256-prod-github-runner-207 kernel: [52368.621555] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 19:56:34 juju-e4d256-prod-github-runner-207 kernel: [52368.622449] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 19:56:34 juju-e4d256-prod-github-runner-207 kernel: [52368.623405] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 19:56:34 juju-e4d256-prod-github-runner-207 kernel: [52368.624387] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 19:56:34 juju-e4d256-prod-github-runner-207 kernel: [52368.625338] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 19:56:34 juju-e4d256-prod-github-runner-207 kernel: [52368.626253] Aug 22 19:56:46 juju-e4d256-prod-github-runner-207 kernel: [52380.680706] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 19:56:46 juju-e4d256-prod-github-runner-207 kernel: [52380.681677] rcu: 1-....: (13024704 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=6296356 Aug 22 19:56:46 juju-e4d256-prod-github-runner-207 kernel: [52380.682829] (t=13065870 jiffies g=23269 q=49102) Aug 22 19:56:46 juju-e4d256-prod-github-runner-207 kernel: [52380.683625] NMI backtrace for cpu 1 Aug 22 19:56:46 juju-e4d256-prod-github-runner-207 kernel: [52380.684365] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 19:56:46 juju-e4d256-prod-github-runner-207 kernel: [52380.685494] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 19:56:46 juju-e4d256-prod-github-runner-207 kernel: [52380.686549] Call Trace: Aug 22 19:56:46 juju-e4d256-prod-github-runner-207 kernel: [52380.687238] Aug 22 19:56:46 juju-e4d256-prod-github-runner-207 kernel: [52380.687896] show_stack+0x52/0x5c Aug 22 19:56:46 juju-e4d256-prod-github-runner-207 kernel: [52380.688658] dump_stack_lvl+0x4a/0x63 Aug 22 19:56:46 juju-e4d256-prod-github-runner-207 kernel: [52380.689406] dump_stack+0x10/0x16 Aug 22 19:56:46 juju-e4d256-prod-github-runner-207 kernel: [52380.690127] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 19:56:46 juju-e4d256-prod-github-runner-207 kernel: [52380.690907] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 19:56:46 juju-e4d256-prod-github-runner-207 kernel: [52380.691690] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 19:56:46 juju-e4d256-prod-github-runner-207 kernel: [52380.692628] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 19:56:46 juju-e4d256-prod-github-runner-207 kernel: [52380.693481] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 19:56:46 juju-e4d256-prod-github-runner-207 kernel: [52380.694299] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 19:56:46 juju-e4d256-prod-github-runner-207 kernel: [52380.695072] print_cpu_stall.cold+0x2f/0xe2 Aug 22 19:56:46 juju-e4d256-prod-github-runner-207 kernel: [52380.695836] ? timekeeping_update+0xf7/0x150 Aug 22 19:56:46 juju-e4d256-prod-github-runner-207 kernel: [52380.696635] check_cpu_stall+0x109/0x270 Aug 22 19:56:46 juju-e4d256-prod-github-runner-207 kernel: [52380.697395] rcu_sched_clock_irq+0x9a/0x250 Aug 22 19:56:46 juju-e4d256-prod-github-runner-207 kernel: [52380.698199] update_process_times+0x94/0xd0 Aug 22 19:56:46 juju-e4d256-prod-github-runner-207 kernel: [52380.698984] tick_sched_handle+0x29/0x70 Aug 22 19:56:46 juju-e4d256-prod-github-runner-207 kernel: [52380.699733] tick_sched_timer+0x8c/0xc0 Aug 22 19:56:46 juju-e4d256-prod-github-runner-207 kernel: [52380.700495] ? tick_nohz_handler+0xb0/0xb0 Aug 22 19:56:46 juju-e4d256-prod-github-runner-207 kernel: [52380.701257] __hrtimer_run_queues+0x107/0x230 Aug 22 19:56:46 juju-e4d256-prod-github-runner-207 kernel: [52380.702028] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 19:56:46 juju-e4d256-prod-github-runner-207 kernel: [52380.702833] hrtimer_interrupt+0x101/0x220 Aug 22 19:56:46 juju-e4d256-prod-github-runner-207 kernel: [52380.703633] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 19:56:46 juju-e4d256-prod-github-runner-207 kernel: [52380.704473] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 19:56:46 juju-e4d256-prod-github-runner-207 kernel: [52380.705276] Aug 22 19:56:46 juju-e4d256-prod-github-runner-207 kernel: [52380.705910] Aug 22 19:56:46 juju-e4d256-prod-github-runner-207 kernel: [52380.706542] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 19:56:46 juju-e4d256-prod-github-runner-207 kernel: [52380.707360] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:56:46 juju-e4d256-prod-github-runner-207 kernel: [52380.708290] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 19:56:46 juju-e4d256-prod-github-runner-207 kernel: [52380.710525] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 19:56:46 juju-e4d256-prod-github-runner-207 kernel: [52380.711404] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 19:56:46 juju-e4d256-prod-github-runner-207 kernel: [52380.712417] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 19:56:46 juju-e4d256-prod-github-runner-207 kernel: [52380.713438] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 19:56:46 juju-e4d256-prod-github-runner-207 kernel: [52380.714426] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 19:56:46 juju-e4d256-prod-github-runner-207 kernel: [52380.715378] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 19:56:46 juju-e4d256-prod-github-runner-207 kernel: [52380.716357] ? _raw_spin_lock+0x22/0x30 Aug 22 19:56:46 juju-e4d256-prod-github-runner-207 kernel: [52380.717115] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:56:46 juju-e4d256-prod-github-runner-207 kernel: [52380.718012] direct_page_fault+0x206/0x310 [kvm] Aug 22 19:56:46 juju-e4d256-prod-github-runner-207 kernel: [52380.718930] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 19:56:46 juju-e4d256-prod-github-runner-207 kernel: [52380.719773] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 19:56:46 juju-e4d256-prod-github-runner-207 kernel: [52380.720620] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 19:56:46 juju-e4d256-prod-github-runner-207 kernel: [52380.721424] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 19:56:46 juju-e4d256-prod-github-runner-207 kernel: [52380.722226] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 19:56:46 juju-e4d256-prod-github-runner-207 kernel: [52380.723059] handle_exit+0x98/0x230 [kvm_amd] Aug 22 19:56:46 juju-e4d256-prod-github-runner-207 kernel: [52380.723855] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 19:56:46 juju-e4d256-prod-github-runner-207 kernel: [52380.724665] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 19:56:46 juju-e4d256-prod-github-runner-207 kernel: [52380.725469] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 19:56:46 juju-e4d256-prod-github-runner-207 kernel: [52380.726251] vcpu_run+0x62/0x2c0 [kvm] Aug 22 19:56:46 juju-e4d256-prod-github-runner-207 kernel: [52380.726963] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 19:56:46 juju-e4d256-prod-github-runner-207 kernel: [52380.727698] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 19:56:46 juju-e4d256-prod-github-runner-207 kernel: [52380.728519] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 19:56:46 juju-e4d256-prod-github-runner-207 kernel: [52380.729288] ? __seccomp_filter+0x4a/0x4a0 Aug 22 19:56:46 juju-e4d256-prod-github-runner-207 kernel: [52380.730007] ? __fget_files+0x86/0xc0 Aug 22 19:56:46 juju-e4d256-prod-github-runner-207 kernel: [52380.730698] __x64_sys_ioctl+0x95/0xd0 Aug 22 19:56:46 juju-e4d256-prod-github-runner-207 kernel: [52380.731398] do_syscall_64+0x5c/0xc0 Aug 22 19:56:46 juju-e4d256-prod-github-runner-207 kernel: [52380.732088] ? do_futex+0x162/0x1f0 Aug 22 19:56:46 juju-e4d256-prod-github-runner-207 kernel: [52380.732788] ? __x64_sys_futex+0x78/0x1e0 Aug 22 19:56:46 juju-e4d256-prod-github-runner-207 kernel: [52380.733495] ? __secure_computing+0xa9/0x120 Aug 22 19:56:46 juju-e4d256-prod-github-runner-207 kernel: [52380.734247] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 19:56:46 juju-e4d256-prod-github-runner-207 kernel: [52380.735041] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:56:46 juju-e4d256-prod-github-runner-207 kernel: [52380.735796] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:56:46 juju-e4d256-prod-github-runner-207 kernel: [52380.736573] ? do_syscall_64+0x69/0xc0 Aug 22 19:56:46 juju-e4d256-prod-github-runner-207 kernel: [52380.737262] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:56:46 juju-e4d256-prod-github-runner-207 kernel: [52380.738014] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:56:46 juju-e4d256-prod-github-runner-207 kernel: [52380.738772] ? do_syscall_64+0x69/0xc0 Aug 22 19:56:46 juju-e4d256-prod-github-runner-207 kernel: [52380.739471] ? do_syscall_64+0x69/0xc0 Aug 22 19:56:46 juju-e4d256-prod-github-runner-207 kernel: [52380.740157] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 19:56:46 juju-e4d256-prod-github-runner-207 kernel: [52380.740940] RIP: 0033:0x7faa5d0edaff Aug 22 19:56:46 juju-e4d256-prod-github-runner-207 kernel: [52380.741623] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 19:56:46 juju-e4d256-prod-github-runner-207 kernel: [52380.743722] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 19:56:46 juju-e4d256-prod-github-runner-207 kernel: [52380.744752] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 19:56:46 juju-e4d256-prod-github-runner-207 kernel: [52380.745704] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 19:56:46 juju-e4d256-prod-github-runner-207 kernel: [52380.746651] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 19:56:46 juju-e4d256-prod-github-runner-207 kernel: [52380.747594] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 19:56:46 juju-e4d256-prod-github-runner-207 kernel: [52380.748712] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 19:56:46 juju-e4d256-prod-github-runner-207 kernel: [52380.749643] Aug 22 19:57:14 juju-e4d256-prod-github-runner-207 kernel: [52408.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 48701s! [qemu-system-x86:6715] Aug 22 19:57:14 juju-e4d256-prod-github-runner-207 kernel: [52408.543752] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 19:57:14 juju-e4d256-prod-github-runner-207 kernel: [52408.544026] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 19:57:14 juju-e4d256-prod-github-runner-207 kernel: [52408.556443] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 19:57:14 juju-e4d256-prod-github-runner-207 kernel: [52408.557753] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 19:57:14 juju-e4d256-prod-github-runner-207 kernel: [52408.558982] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:57:14 juju-e4d256-prod-github-runner-207 kernel: [52408.560174] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 19:57:14 juju-e4d256-prod-github-runner-207 kernel: [52408.563054] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 19:57:14 juju-e4d256-prod-github-runner-207 kernel: [52408.564408] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 19:57:14 juju-e4d256-prod-github-runner-207 kernel: [52408.565702] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 19:57:14 juju-e4d256-prod-github-runner-207 kernel: [52408.566995] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 19:57:14 juju-e4d256-prod-github-runner-207 kernel: [52408.568313] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 19:57:14 juju-e4d256-prod-github-runner-207 kernel: [52408.569613] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 19:57:14 juju-e4d256-prod-github-runner-207 kernel: [52408.570910] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 19:57:14 juju-e4d256-prod-github-runner-207 kernel: [52408.572305] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 19:57:14 juju-e4d256-prod-github-runner-207 kernel: [52408.573517] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 19:57:14 juju-e4d256-prod-github-runner-207 kernel: [52408.574847] Call Trace: Aug 22 19:57:14 juju-e4d256-prod-github-runner-207 kernel: [52408.575811] Aug 22 19:57:14 juju-e4d256-prod-github-runner-207 kernel: [52408.576761] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:57:14 juju-e4d256-prod-github-runner-207 kernel: [52408.577888] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:57:14 juju-e4d256-prod-github-runner-207 kernel: [52408.578991] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:57:14 juju-e4d256-prod-github-runner-207 kernel: [52408.580185] ? show_regs.part.0+0x23/0x29 Aug 22 19:57:14 juju-e4d256-prod-github-runner-207 kernel: [52408.581261] ? show_regs.cold+0x8/0xd Aug 22 19:57:14 juju-e4d256-prod-github-runner-207 kernel: [52408.582304] ? watchdog_timer_fn+0x1be/0x220 Aug 22 19:57:14 juju-e4d256-prod-github-runner-207 kernel: [52408.583411] ? lockup_detector_update_enable+0x60/0x60 Aug 22 19:57:14 juju-e4d256-prod-github-runner-207 kernel: [52408.584595] ? __hrtimer_run_queues+0x107/0x230 Aug 22 19:57:14 juju-e4d256-prod-github-runner-207 kernel: [52408.585709] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 19:57:14 juju-e4d256-prod-github-runner-207 kernel: [52408.586819] ? hrtimer_interrupt+0x101/0x220 Aug 22 19:57:14 juju-e4d256-prod-github-runner-207 kernel: [52408.587937] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 19:57:14 juju-e4d256-prod-github-runner-207 kernel: [52408.589099] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 19:57:14 juju-e4d256-prod-github-runner-207 kernel: [52408.590243] Aug 22 19:57:14 juju-e4d256-prod-github-runner-207 kernel: [52408.591140] Aug 22 19:57:14 juju-e4d256-prod-github-runner-207 kernel: [52408.592048] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 19:57:14 juju-e4d256-prod-github-runner-207 kernel: [52408.593184] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:57:14 juju-e4d256-prod-github-runner-207 kernel: [52408.594328] ? _raw_spin_lock+0x22/0x30 Aug 22 19:57:14 juju-e4d256-prod-github-runner-207 kernel: [52408.595348] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:57:14 juju-e4d256-prod-github-runner-207 kernel: [52408.596458] direct_page_fault+0x206/0x310 [kvm] Aug 22 19:57:14 juju-e4d256-prod-github-runner-207 kernel: [52408.597577] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 19:57:14 juju-e4d256-prod-github-runner-207 kernel: [52408.598671] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 19:57:14 juju-e4d256-prod-github-runner-207 kernel: [52408.599766] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 19:57:14 juju-e4d256-prod-github-runner-207 kernel: [52408.600873] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 19:57:14 juju-e4d256-prod-github-runner-207 kernel: [52408.601913] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 19:57:14 juju-e4d256-prod-github-runner-207 kernel: [52408.602997] handle_exit+0x98/0x230 [kvm_amd] Aug 22 19:57:14 juju-e4d256-prod-github-runner-207 kernel: [52408.604009] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 19:57:14 juju-e4d256-prod-github-runner-207 kernel: [52408.605022] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 19:57:14 juju-e4d256-prod-github-runner-207 kernel: [52408.606050] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 19:57:14 juju-e4d256-prod-github-runner-207 kernel: [52408.607054] vcpu_run+0x62/0x2c0 [kvm] Aug 22 19:57:14 juju-e4d256-prod-github-runner-207 kernel: [52408.607954] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 19:57:14 juju-e4d256-prod-github-runner-207 kernel: [52408.608851] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 19:57:14 juju-e4d256-prod-github-runner-207 kernel: [52408.609796] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 19:57:14 juju-e4d256-prod-github-runner-207 kernel: [52408.610672] ? __seccomp_filter+0x4a/0x4a0 Aug 22 19:57:14 juju-e4d256-prod-github-runner-207 kernel: [52408.611492] ? __fget_files+0x86/0xc0 Aug 22 19:57:14 juju-e4d256-prod-github-runner-207 kernel: [52408.612280] __x64_sys_ioctl+0x95/0xd0 Aug 22 19:57:14 juju-e4d256-prod-github-runner-207 kernel: [52408.613050] do_syscall_64+0x5c/0xc0 Aug 22 19:57:14 juju-e4d256-prod-github-runner-207 kernel: [52408.613786] ? do_futex+0x162/0x1f0 Aug 22 19:57:14 juju-e4d256-prod-github-runner-207 kernel: [52408.614499] ? __x64_sys_futex+0x78/0x1e0 Aug 22 19:57:14 juju-e4d256-prod-github-runner-207 kernel: [52408.615247] ? __secure_computing+0xa9/0x120 Aug 22 19:57:14 juju-e4d256-prod-github-runner-207 kernel: [52408.616046] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 19:57:14 juju-e4d256-prod-github-runner-207 kernel: [52408.616906] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:57:14 juju-e4d256-prod-github-runner-207 kernel: [52408.617714] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:57:14 juju-e4d256-prod-github-runner-207 kernel: [52408.618520] ? do_syscall_64+0x69/0xc0 Aug 22 19:57:14 juju-e4d256-prod-github-runner-207 kernel: [52408.619235] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:57:14 juju-e4d256-prod-github-runner-207 kernel: [52408.620046] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:57:14 juju-e4d256-prod-github-runner-207 kernel: [52408.620830] ? do_syscall_64+0x69/0xc0 Aug 22 19:57:14 juju-e4d256-prod-github-runner-207 kernel: [52408.621527] ? do_syscall_64+0x69/0xc0 Aug 22 19:57:14 juju-e4d256-prod-github-runner-207 kernel: [52408.622220] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 19:57:14 juju-e4d256-prod-github-runner-207 kernel: [52408.623017] RIP: 0033:0x7faa5d0edaff Aug 22 19:57:14 juju-e4d256-prod-github-runner-207 kernel: [52408.623734] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 19:57:14 juju-e4d256-prod-github-runner-207 kernel: [52408.626057] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 19:57:14 juju-e4d256-prod-github-runner-207 kernel: [52408.627102] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 19:57:14 juju-e4d256-prod-github-runner-207 kernel: [52408.628134] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 19:57:14 juju-e4d256-prod-github-runner-207 kernel: [52408.629158] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 19:57:14 juju-e4d256-prod-github-runner-207 kernel: [52408.630176] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 19:57:14 juju-e4d256-prod-github-runner-207 kernel: [52408.631195] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 19:57:14 juju-e4d256-prod-github-runner-207 kernel: [52408.632235] Aug 22 19:57:42 juju-e4d256-prod-github-runner-207 kernel: [52436.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 48727s! [qemu-system-x86:6715] Aug 22 19:57:42 juju-e4d256-prod-github-runner-207 kernel: [52436.543081] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 19:57:42 juju-e4d256-prod-github-runner-207 kernel: [52436.543149] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 19:57:42 juju-e4d256-prod-github-runner-207 kernel: [52436.555351] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 19:57:42 juju-e4d256-prod-github-runner-207 kernel: [52436.556646] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 19:57:42 juju-e4d256-prod-github-runner-207 kernel: [52436.557886] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:57:42 juju-e4d256-prod-github-runner-207 kernel: [52436.558951] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 19:57:42 juju-e4d256-prod-github-runner-207 kernel: [52436.561867] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 19:57:42 juju-e4d256-prod-github-runner-207 kernel: [52436.563007] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 19:57:42 juju-e4d256-prod-github-runner-207 kernel: [52436.564328] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 19:57:42 juju-e4d256-prod-github-runner-207 kernel: [52436.565617] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 19:57:42 juju-e4d256-prod-github-runner-207 kernel: [52436.566987] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 19:57:42 juju-e4d256-prod-github-runner-207 kernel: [52436.568188] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 19:57:42 juju-e4d256-prod-github-runner-207 kernel: [52436.569369] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 19:57:42 juju-e4d256-prod-github-runner-207 kernel: [52436.570623] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 19:57:42 juju-e4d256-prod-github-runner-207 kernel: [52436.571847] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 19:57:42 juju-e4d256-prod-github-runner-207 kernel: [52436.573171] Call Trace: Aug 22 19:57:42 juju-e4d256-prod-github-runner-207 kernel: [52436.574132] Aug 22 19:57:42 juju-e4d256-prod-github-runner-207 kernel: [52436.575059] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:57:42 juju-e4d256-prod-github-runner-207 kernel: [52436.576340] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:57:42 juju-e4d256-prod-github-runner-207 kernel: [52436.577445] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:57:42 juju-e4d256-prod-github-runner-207 kernel: [52436.578605] ? show_regs.part.0+0x23/0x29 Aug 22 19:57:42 juju-e4d256-prod-github-runner-207 kernel: [52436.579688] ? show_regs.cold+0x8/0xd Aug 22 19:57:42 juju-e4d256-prod-github-runner-207 kernel: [52436.580730] ? watchdog_timer_fn+0x1be/0x220 Aug 22 19:57:42 juju-e4d256-prod-github-runner-207 kernel: [52436.581825] ? lockup_detector_update_enable+0x60/0x60 Aug 22 19:57:42 juju-e4d256-prod-github-runner-207 kernel: [52436.582991] ? __hrtimer_run_queues+0x107/0x230 Aug 22 19:57:42 juju-e4d256-prod-github-runner-207 kernel: [52436.584121] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 19:57:42 juju-e4d256-prod-github-runner-207 kernel: [52436.585231] ? hrtimer_interrupt+0x101/0x220 Aug 22 19:57:42 juju-e4d256-prod-github-runner-207 kernel: [52436.586326] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 19:57:42 juju-e4d256-prod-github-runner-207 kernel: [52436.587508] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 19:57:42 juju-e4d256-prod-github-runner-207 kernel: [52436.588647] Aug 22 19:57:42 juju-e4d256-prod-github-runner-207 kernel: [52436.589545] Aug 22 19:57:42 juju-e4d256-prod-github-runner-207 kernel: [52436.590425] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 19:57:42 juju-e4d256-prod-github-runner-207 kernel: [52436.591572] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:57:42 juju-e4d256-prod-github-runner-207 kernel: [52436.592710] ? _raw_spin_lock+0x22/0x30 Aug 22 19:57:42 juju-e4d256-prod-github-runner-207 kernel: [52436.593732] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:57:42 juju-e4d256-prod-github-runner-207 kernel: [52436.594832] direct_page_fault+0x206/0x310 [kvm] Aug 22 19:57:42 juju-e4d256-prod-github-runner-207 kernel: [52436.595955] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 19:57:42 juju-e4d256-prod-github-runner-207 kernel: [52436.597051] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 19:57:42 juju-e4d256-prod-github-runner-207 kernel: [52436.598136] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 19:57:42 juju-e4d256-prod-github-runner-207 kernel: [52436.599198] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 19:57:42 juju-e4d256-prod-github-runner-207 kernel: [52436.600256] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 19:57:42 juju-e4d256-prod-github-runner-207 kernel: [52436.601337] handle_exit+0x98/0x230 [kvm_amd] Aug 22 19:57:42 juju-e4d256-prod-github-runner-207 kernel: [52436.602317] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 19:57:42 juju-e4d256-prod-github-runner-207 kernel: [52436.603317] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 19:57:42 juju-e4d256-prod-github-runner-207 kernel: [52436.604349] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 19:57:42 juju-e4d256-prod-github-runner-207 kernel: [52436.605345] vcpu_run+0x62/0x2c0 [kvm] Aug 22 19:57:42 juju-e4d256-prod-github-runner-207 kernel: [52436.606224] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 19:57:42 juju-e4d256-prod-github-runner-207 kernel: [52436.607115] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 19:57:42 juju-e4d256-prod-github-runner-207 kernel: [52436.608084] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 19:57:42 juju-e4d256-prod-github-runner-207 kernel: [52436.608976] ? __seccomp_filter+0x4a/0x4a0 Aug 22 19:57:42 juju-e4d256-prod-github-runner-207 kernel: [52436.609806] ? __fget_files+0x86/0xc0 Aug 22 19:57:42 juju-e4d256-prod-github-runner-207 kernel: [52436.610580] __x64_sys_ioctl+0x95/0xd0 Aug 22 19:57:42 juju-e4d256-prod-github-runner-207 kernel: [52436.611347] do_syscall_64+0x5c/0xc0 Aug 22 19:57:42 juju-e4d256-prod-github-runner-207 kernel: [52436.612099] ? do_futex+0x162/0x1f0 Aug 22 19:57:42 juju-e4d256-prod-github-runner-207 kernel: [52436.612822] ? __x64_sys_futex+0x78/0x1e0 Aug 22 19:57:42 juju-e4d256-prod-github-runner-207 kernel: [52436.613577] ? __secure_computing+0xa9/0x120 Aug 22 19:57:42 juju-e4d256-prod-github-runner-207 kernel: [52436.614349] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 19:57:42 juju-e4d256-prod-github-runner-207 kernel: [52436.615227] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:57:42 juju-e4d256-prod-github-runner-207 kernel: [52436.616052] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:57:42 juju-e4d256-prod-github-runner-207 kernel: [52436.616865] ? do_syscall_64+0x69/0xc0 Aug 22 19:57:42 juju-e4d256-prod-github-runner-207 kernel: [52436.617588] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:57:42 juju-e4d256-prod-github-runner-207 kernel: [52436.618387] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:57:42 juju-e4d256-prod-github-runner-207 kernel: [52436.619174] ? do_syscall_64+0x69/0xc0 Aug 22 19:57:42 juju-e4d256-prod-github-runner-207 kernel: [52436.619881] ? do_syscall_64+0x69/0xc0 Aug 22 19:57:42 juju-e4d256-prod-github-runner-207 kernel: [52436.620581] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 19:57:42 juju-e4d256-prod-github-runner-207 kernel: [52436.621390] RIP: 0033:0x7faa5d0edaff Aug 22 19:57:42 juju-e4d256-prod-github-runner-207 kernel: [52436.622108] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 19:57:42 juju-e4d256-prod-github-runner-207 kernel: [52436.624462] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 19:57:42 juju-e4d256-prod-github-runner-207 kernel: [52436.625526] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 19:57:42 juju-e4d256-prod-github-runner-207 kernel: [52436.626551] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 19:57:42 juju-e4d256-prod-github-runner-207 kernel: [52436.627586] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 19:57:42 juju-e4d256-prod-github-runner-207 kernel: [52436.628605] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 19:57:42 juju-e4d256-prod-github-runner-207 kernel: [52436.629623] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 19:57:42 juju-e4d256-prod-github-runner-207 kernel: [52436.630651] Aug 22 19:58:10 juju-e4d256-prod-github-runner-207 kernel: [52464.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 48753s! [qemu-system-x86:6715] Aug 22 19:58:10 juju-e4d256-prod-github-runner-207 kernel: [52464.543129] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 19:58:10 juju-e4d256-prod-github-runner-207 kernel: [52464.543198] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 19:58:10 juju-e4d256-prod-github-runner-207 kernel: [52464.555584] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 19:58:10 juju-e4d256-prod-github-runner-207 kernel: [52464.556846] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 19:58:10 juju-e4d256-prod-github-runner-207 kernel: [52464.558067] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:58:10 juju-e4d256-prod-github-runner-207 kernel: [52464.559131] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 19:58:10 juju-e4d256-prod-github-runner-207 kernel: [52464.561674] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 19:58:10 juju-e4d256-prod-github-runner-207 kernel: [52464.562716] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 19:58:10 juju-e4d256-prod-github-runner-207 kernel: [52464.563888] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 19:58:10 juju-e4d256-prod-github-runner-207 kernel: [52464.565050] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 19:58:10 juju-e4d256-prod-github-runner-207 kernel: [52464.566211] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 19:58:10 juju-e4d256-prod-github-runner-207 kernel: [52464.567377] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 19:58:10 juju-e4d256-prod-github-runner-207 kernel: [52464.568544] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 19:58:10 juju-e4d256-prod-github-runner-207 kernel: [52464.569778] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 19:58:10 juju-e4d256-prod-github-runner-207 kernel: [52464.570877] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 19:58:10 juju-e4d256-prod-github-runner-207 kernel: [52464.572076] Call Trace: Aug 22 19:58:10 juju-e4d256-prod-github-runner-207 kernel: [52464.572989] Aug 22 19:58:10 juju-e4d256-prod-github-runner-207 kernel: [52464.573870] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:58:10 juju-e4d256-prod-github-runner-207 kernel: [52464.574899] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:58:10 juju-e4d256-prod-github-runner-207 kernel: [52464.575927] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:58:10 juju-e4d256-prod-github-runner-207 kernel: [52464.577005] ? show_regs.part.0+0x23/0x29 Aug 22 19:58:10 juju-e4d256-prod-github-runner-207 kernel: [52464.577999] ? show_regs.cold+0x8/0xd Aug 22 19:58:10 juju-e4d256-prod-github-runner-207 kernel: [52464.578969] ? watchdog_timer_fn+0x1be/0x220 Aug 22 19:58:10 juju-e4d256-prod-github-runner-207 kernel: [52464.579987] ? lockup_detector_update_enable+0x60/0x60 Aug 22 19:58:10 juju-e4d256-prod-github-runner-207 kernel: [52464.581049] ? __hrtimer_run_queues+0x107/0x230 Aug 22 19:58:10 juju-e4d256-prod-github-runner-207 kernel: [52464.582076] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 19:58:10 juju-e4d256-prod-github-runner-207 kernel: [52464.583102] ? hrtimer_interrupt+0x101/0x220 Aug 22 19:58:10 juju-e4d256-prod-github-runner-207 kernel: [52464.584134] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 19:58:10 juju-e4d256-prod-github-runner-207 kernel: [52464.585200] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 19:58:10 juju-e4d256-prod-github-runner-207 kernel: [52464.586249] Aug 22 19:58:10 juju-e4d256-prod-github-runner-207 kernel: [52464.587100] Aug 22 19:58:10 juju-e4d256-prod-github-runner-207 kernel: [52464.587944] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 19:58:10 juju-e4d256-prod-github-runner-207 kernel: [52464.588974] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:58:10 juju-e4d256-prod-github-runner-207 kernel: [52464.590020] ? _raw_spin_lock+0x22/0x30 Aug 22 19:58:10 juju-e4d256-prod-github-runner-207 kernel: [52464.590964] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:58:10 juju-e4d256-prod-github-runner-207 kernel: [52464.591987] direct_page_fault+0x206/0x310 [kvm] Aug 22 19:58:10 juju-e4d256-prod-github-runner-207 kernel: [52464.593012] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 19:58:10 juju-e4d256-prod-github-runner-207 kernel: [52464.594022] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 19:58:10 juju-e4d256-prod-github-runner-207 kernel: [52464.595021] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 19:58:10 juju-e4d256-prod-github-runner-207 kernel: [52464.596000] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 19:58:10 juju-e4d256-prod-github-runner-207 kernel: [52464.596943] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 19:58:10 juju-e4d256-prod-github-runner-207 kernel: [52464.597920] handle_exit+0x98/0x230 [kvm_amd] Aug 22 19:58:10 juju-e4d256-prod-github-runner-207 kernel: [52464.598810] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 19:58:10 juju-e4d256-prod-github-runner-207 kernel: [52464.599730] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 19:58:10 juju-e4d256-prod-github-runner-207 kernel: [52464.600653] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 19:58:10 juju-e4d256-prod-github-runner-207 kernel: [52464.601554] vcpu_run+0x62/0x2c0 [kvm] Aug 22 19:58:10 juju-e4d256-prod-github-runner-207 kernel: [52464.602364] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 19:58:10 juju-e4d256-prod-github-runner-207 kernel: [52464.603175] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 19:58:10 juju-e4d256-prod-github-runner-207 kernel: [52464.604024] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 19:58:10 juju-e4d256-prod-github-runner-207 kernel: [52464.604820] ? __seccomp_filter+0x4a/0x4a0 Aug 22 19:58:10 juju-e4d256-prod-github-runner-207 kernel: [52464.605565] ? __fget_files+0x86/0xc0 Aug 22 19:58:10 juju-e4d256-prod-github-runner-207 kernel: [52464.606266] __x64_sys_ioctl+0x95/0xd0 Aug 22 19:58:10 juju-e4d256-prod-github-runner-207 kernel: [52464.606963] do_syscall_64+0x5c/0xc0 Aug 22 19:58:10 juju-e4d256-prod-github-runner-207 kernel: [52464.607630] ? do_futex+0x162/0x1f0 Aug 22 19:58:10 juju-e4d256-prod-github-runner-207 kernel: [52464.608276] ? __x64_sys_futex+0x78/0x1e0 Aug 22 19:58:10 juju-e4d256-prod-github-runner-207 kernel: [52464.608946] ? __secure_computing+0xa9/0x120 Aug 22 19:58:10 juju-e4d256-prod-github-runner-207 kernel: [52464.609638] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 19:58:10 juju-e4d256-prod-github-runner-207 kernel: [52464.610400] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:58:10 juju-e4d256-prod-github-runner-207 kernel: [52464.611133] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:58:10 juju-e4d256-prod-github-runner-207 kernel: [52464.611847] ? do_syscall_64+0x69/0xc0 Aug 22 19:58:10 juju-e4d256-prod-github-runner-207 kernel: [52464.612537] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:58:10 juju-e4d256-prod-github-runner-207 kernel: [52464.613238] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:58:10 juju-e4d256-prod-github-runner-207 kernel: [52464.613932] ? do_syscall_64+0x69/0xc0 Aug 22 19:58:10 juju-e4d256-prod-github-runner-207 kernel: [52464.614557] ? do_syscall_64+0x69/0xc0 Aug 22 19:58:10 juju-e4d256-prod-github-runner-207 kernel: [52464.615186] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 19:58:10 juju-e4d256-prod-github-runner-207 kernel: [52464.615893] RIP: 0033:0x7faa5d0edaff Aug 22 19:58:10 juju-e4d256-prod-github-runner-207 kernel: [52464.616513] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 19:58:10 juju-e4d256-prod-github-runner-207 kernel: [52464.618489] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 19:58:10 juju-e4d256-prod-github-runner-207 kernel: [52464.619404] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 19:58:10 juju-e4d256-prod-github-runner-207 kernel: [52464.620291] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 19:58:10 juju-e4d256-prod-github-runner-207 kernel: [52464.621184] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 19:58:10 juju-e4d256-prod-github-runner-207 kernel: [52464.622068] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 19:58:10 juju-e4d256-prod-github-runner-207 kernel: [52464.622953] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 19:58:10 juju-e4d256-prod-github-runner-207 kernel: [52464.623853] Aug 22 19:58:38 juju-e4d256-prod-github-runner-207 kernel: [52492.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 48779s! [qemu-system-x86:6715] Aug 22 19:58:38 juju-e4d256-prod-github-runner-207 kernel: [52492.543754] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 19:58:38 juju-e4d256-prod-github-runner-207 kernel: [52492.544013] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 19:58:38 juju-e4d256-prod-github-runner-207 kernel: [52492.556394] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 19:58:38 juju-e4d256-prod-github-runner-207 kernel: [52492.557704] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 19:58:38 juju-e4d256-prod-github-runner-207 kernel: [52492.558949] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:58:38 juju-e4d256-prod-github-runner-207 kernel: [52492.560028] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 19:58:38 juju-e4d256-prod-github-runner-207 kernel: [52492.562647] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 19:58:38 juju-e4d256-prod-github-runner-207 kernel: [52492.563736] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 19:58:38 juju-e4d256-prod-github-runner-207 kernel: [52492.564932] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 19:58:38 juju-e4d256-prod-github-runner-207 kernel: [52492.566119] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 19:58:38 juju-e4d256-prod-github-runner-207 kernel: [52492.567316] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 19:58:38 juju-e4d256-prod-github-runner-207 kernel: [52492.568501] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 19:58:38 juju-e4d256-prod-github-runner-207 kernel: [52492.569684] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 19:58:38 juju-e4d256-prod-github-runner-207 kernel: [52492.570964] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 19:58:38 juju-e4d256-prod-github-runner-207 kernel: [52492.572308] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 19:58:38 juju-e4d256-prod-github-runner-207 kernel: [52492.573746] Call Trace: Aug 22 19:58:38 juju-e4d256-prod-github-runner-207 kernel: [52492.574666] Aug 22 19:58:38 juju-e4d256-prod-github-runner-207 kernel: [52492.575634] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:58:38 juju-e4d256-prod-github-runner-207 kernel: [52492.576704] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:58:38 juju-e4d256-prod-github-runner-207 kernel: [52492.577754] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:58:38 juju-e4d256-prod-github-runner-207 kernel: [52492.578922] ? show_regs.part.0+0x23/0x29 Aug 22 19:58:38 juju-e4d256-prod-github-runner-207 kernel: [52492.579931] ? show_regs.cold+0x8/0xd Aug 22 19:58:38 juju-e4d256-prod-github-runner-207 kernel: [52492.580953] ? watchdog_timer_fn+0x1be/0x220 Aug 22 19:58:38 juju-e4d256-prod-github-runner-207 kernel: [52492.582003] ? lockup_detector_update_enable+0x60/0x60 Aug 22 19:58:38 juju-e4d256-prod-github-runner-207 kernel: [52492.583202] ? __hrtimer_run_queues+0x107/0x230 Aug 22 19:58:38 juju-e4d256-prod-github-runner-207 kernel: [52492.584274] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 19:58:38 juju-e4d256-prod-github-runner-207 kernel: [52492.585354] ? hrtimer_interrupt+0x101/0x220 Aug 22 19:58:38 juju-e4d256-prod-github-runner-207 kernel: [52492.586462] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 19:58:38 juju-e4d256-prod-github-runner-207 kernel: [52492.587620] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 19:58:38 juju-e4d256-prod-github-runner-207 kernel: [52492.588696] Aug 22 19:58:38 juju-e4d256-prod-github-runner-207 kernel: [52492.589560] Aug 22 19:58:38 juju-e4d256-prod-github-runner-207 kernel: [52492.590405] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 19:58:38 juju-e4d256-prod-github-runner-207 kernel: [52492.591664] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:58:38 juju-e4d256-prod-github-runner-207 kernel: [52492.592762] ? _raw_spin_lock+0x22/0x30 Aug 22 19:58:38 juju-e4d256-prod-github-runner-207 kernel: [52492.593761] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:58:38 juju-e4d256-prod-github-runner-207 kernel: [52492.594816] direct_page_fault+0x206/0x310 [kvm] Aug 22 19:58:38 juju-e4d256-prod-github-runner-207 kernel: [52492.595850] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 19:58:38 juju-e4d256-prod-github-runner-207 kernel: [52492.596889] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 19:58:38 juju-e4d256-prod-github-runner-207 kernel: [52492.597947] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 19:58:38 juju-e4d256-prod-github-runner-207 kernel: [52492.598998] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 19:58:38 juju-e4d256-prod-github-runner-207 kernel: [52492.600149] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 19:58:38 juju-e4d256-prod-github-runner-207 kernel: [52492.601142] handle_exit+0x98/0x230 [kvm_amd] Aug 22 19:58:38 juju-e4d256-prod-github-runner-207 kernel: [52492.602053] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 19:58:38 juju-e4d256-prod-github-runner-207 kernel: [52492.603016] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 19:58:38 juju-e4d256-prod-github-runner-207 kernel: [52492.603974] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 19:58:38 juju-e4d256-prod-github-runner-207 kernel: [52492.604898] vcpu_run+0x62/0x2c0 [kvm] Aug 22 19:58:38 juju-e4d256-prod-github-runner-207 kernel: [52492.605729] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 19:58:38 juju-e4d256-prod-github-runner-207 kernel: [52492.606576] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 19:58:38 juju-e4d256-prod-github-runner-207 kernel: [52492.607492] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 19:58:38 juju-e4d256-prod-github-runner-207 kernel: [52492.608350] ? __seccomp_filter+0x4a/0x4a0 Aug 22 19:58:38 juju-e4d256-prod-github-runner-207 kernel: [52492.609117] ? __fget_files+0x86/0xc0 Aug 22 19:58:38 juju-e4d256-prod-github-runner-207 kernel: [52492.609845] __x64_sys_ioctl+0x95/0xd0 Aug 22 19:58:38 juju-e4d256-prod-github-runner-207 kernel: [52492.610543] do_syscall_64+0x5c/0xc0 Aug 22 19:58:38 juju-e4d256-prod-github-runner-207 kernel: [52492.611230] ? do_futex+0x162/0x1f0 Aug 22 19:58:38 juju-e4d256-prod-github-runner-207 kernel: [52492.611931] ? __x64_sys_futex+0x78/0x1e0 Aug 22 19:58:38 juju-e4d256-prod-github-runner-207 kernel: [52492.612660] ? __secure_computing+0xa9/0x120 Aug 22 19:58:38 juju-e4d256-prod-github-runner-207 kernel: [52492.613717] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 19:58:38 juju-e4d256-prod-github-runner-207 kernel: [52492.614788] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:58:38 juju-e4d256-prod-github-runner-207 kernel: [52492.615528] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:58:38 juju-e4d256-prod-github-runner-207 kernel: [52492.616256] ? do_syscall_64+0x69/0xc0 Aug 22 19:58:38 juju-e4d256-prod-github-runner-207 kernel: [52492.616923] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:58:38 juju-e4d256-prod-github-runner-207 kernel: [52492.617648] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:58:38 juju-e4d256-prod-github-runner-207 kernel: [52492.618364] ? do_syscall_64+0x69/0xc0 Aug 22 19:58:38 juju-e4d256-prod-github-runner-207 kernel: [52492.619012] ? do_syscall_64+0x69/0xc0 Aug 22 19:58:38 juju-e4d256-prod-github-runner-207 kernel: [52492.619646] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 19:58:38 juju-e4d256-prod-github-runner-207 kernel: [52492.620386] RIP: 0033:0x7faa5d0edaff Aug 22 19:58:38 juju-e4d256-prod-github-runner-207 kernel: [52492.621053] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 19:58:38 juju-e4d256-prod-github-runner-207 kernel: [52492.623132] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 19:58:38 juju-e4d256-prod-github-runner-207 kernel: [52492.624076] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 19:58:38 juju-e4d256-prod-github-runner-207 kernel: [52492.625020] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 19:58:38 juju-e4d256-prod-github-runner-207 kernel: [52492.625927] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 19:58:38 juju-e4d256-prod-github-runner-207 kernel: [52492.626835] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 19:58:38 juju-e4d256-prod-github-runner-207 kernel: [52492.627751] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 19:58:38 juju-e4d256-prod-github-runner-207 kernel: [52492.628659] Aug 22 19:59:06 juju-e4d256-prod-github-runner-207 kernel: [52520.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 48805s! [qemu-system-x86:6715] Aug 22 19:59:06 juju-e4d256-prod-github-runner-207 kernel: [52520.543095] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 19:59:06 juju-e4d256-prod-github-runner-207 kernel: [52520.543161] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 19:59:06 juju-e4d256-prod-github-runner-207 kernel: [52520.555313] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 19:59:06 juju-e4d256-prod-github-runner-207 kernel: [52520.556582] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 19:59:06 juju-e4d256-prod-github-runner-207 kernel: [52520.557798] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:59:06 juju-e4d256-prod-github-runner-207 kernel: [52520.558870] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 19:59:06 juju-e4d256-prod-github-runner-207 kernel: [52520.561432] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 19:59:06 juju-e4d256-prod-github-runner-207 kernel: [52520.562507] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 19:59:06 juju-e4d256-prod-github-runner-207 kernel: [52520.563851] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 19:59:06 juju-e4d256-prod-github-runner-207 kernel: [52520.565295] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 19:59:06 juju-e4d256-prod-github-runner-207 kernel: [52520.566611] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 19:59:06 juju-e4d256-prod-github-runner-207 kernel: [52520.568097] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 19:59:06 juju-e4d256-prod-github-runner-207 kernel: [52520.569409] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 19:59:06 juju-e4d256-prod-github-runner-207 kernel: [52520.571016] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 19:59:06 juju-e4d256-prod-github-runner-207 kernel: [52520.572239] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 19:59:06 juju-e4d256-prod-github-runner-207 kernel: [52520.573577] Call Trace: Aug 22 19:59:06 juju-e4d256-prod-github-runner-207 kernel: [52520.574572] Aug 22 19:59:06 juju-e4d256-prod-github-runner-207 kernel: [52520.575502] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:59:06 juju-e4d256-prod-github-runner-207 kernel: [52520.576655] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:59:06 juju-e4d256-prod-github-runner-207 kernel: [52520.577808] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:59:06 juju-e4d256-prod-github-runner-207 kernel: [52520.579209] ? show_regs.part.0+0x23/0x29 Aug 22 19:59:06 juju-e4d256-prod-github-runner-207 kernel: [52520.580505] ? show_regs.cold+0x8/0xd Aug 22 19:59:06 juju-e4d256-prod-github-runner-207 kernel: [52520.581554] ? watchdog_timer_fn+0x1be/0x220 Aug 22 19:59:06 juju-e4d256-prod-github-runner-207 kernel: [52520.582668] ? lockup_detector_update_enable+0x60/0x60 Aug 22 19:59:06 juju-e4d256-prod-github-runner-207 kernel: [52520.583848] ? __hrtimer_run_queues+0x107/0x230 Aug 22 19:59:06 juju-e4d256-prod-github-runner-207 kernel: [52520.584983] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 19:59:06 juju-e4d256-prod-github-runner-207 kernel: [52520.586107] ? hrtimer_interrupt+0x101/0x220 Aug 22 19:59:06 juju-e4d256-prod-github-runner-207 kernel: [52520.587232] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 19:59:06 juju-e4d256-prod-github-runner-207 kernel: [52520.588419] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 19:59:06 juju-e4d256-prod-github-runner-207 kernel: [52520.589571] Aug 22 19:59:06 juju-e4d256-prod-github-runner-207 kernel: [52520.590503] Aug 22 19:59:06 juju-e4d256-prod-github-runner-207 kernel: [52520.591427] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 19:59:06 juju-e4d256-prod-github-runner-207 kernel: [52520.592574] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:59:06 juju-e4d256-prod-github-runner-207 kernel: [52520.593725] ? _raw_spin_lock+0x22/0x30 Aug 22 19:59:06 juju-e4d256-prod-github-runner-207 kernel: [52520.594771] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:59:06 juju-e4d256-prod-github-runner-207 kernel: [52520.595895] direct_page_fault+0x206/0x310 [kvm] Aug 22 19:59:06 juju-e4d256-prod-github-runner-207 kernel: [52520.597017] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 19:59:06 juju-e4d256-prod-github-runner-207 kernel: [52520.598124] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 19:59:06 juju-e4d256-prod-github-runner-207 kernel: [52520.599242] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 19:59:06 juju-e4d256-prod-github-runner-207 kernel: [52520.600322] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 19:59:06 juju-e4d256-prod-github-runner-207 kernel: [52520.601364] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 19:59:06 juju-e4d256-prod-github-runner-207 kernel: [52520.602477] handle_exit+0x98/0x230 [kvm_amd] Aug 22 19:59:06 juju-e4d256-prod-github-runner-207 kernel: [52520.603469] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 19:59:06 juju-e4d256-prod-github-runner-207 kernel: [52520.604483] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 19:59:06 juju-e4d256-prod-github-runner-207 kernel: [52520.605519] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 19:59:06 juju-e4d256-prod-github-runner-207 kernel: [52520.606538] vcpu_run+0x62/0x2c0 [kvm] Aug 22 19:59:06 juju-e4d256-prod-github-runner-207 kernel: [52520.607431] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 19:59:06 juju-e4d256-prod-github-runner-207 kernel: [52520.608328] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 19:59:06 juju-e4d256-prod-github-runner-207 kernel: [52520.609282] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 19:59:06 juju-e4d256-prod-github-runner-207 kernel: [52520.610170] ? __seccomp_filter+0x4a/0x4a0 Aug 22 19:59:06 juju-e4d256-prod-github-runner-207 kernel: [52520.611012] ? __fget_files+0x86/0xc0 Aug 22 19:59:06 juju-e4d256-prod-github-runner-207 kernel: [52520.611793] __x64_sys_ioctl+0x95/0xd0 Aug 22 19:59:06 juju-e4d256-prod-github-runner-207 kernel: [52520.612562] do_syscall_64+0x5c/0xc0 Aug 22 19:59:06 juju-e4d256-prod-github-runner-207 kernel: [52520.613316] ? do_futex+0x162/0x1f0 Aug 22 19:59:06 juju-e4d256-prod-github-runner-207 kernel: [52520.614039] ? __x64_sys_futex+0x78/0x1e0 Aug 22 19:59:06 juju-e4d256-prod-github-runner-207 kernel: [52520.614818] ? __secure_computing+0xa9/0x120 Aug 22 19:59:06 juju-e4d256-prod-github-runner-207 kernel: [52520.615600] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 19:59:06 juju-e4d256-prod-github-runner-207 kernel: [52520.616466] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:59:06 juju-e4d256-prod-github-runner-207 kernel: [52520.617292] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:59:06 juju-e4d256-prod-github-runner-207 kernel: [52520.618112] ? do_syscall_64+0x69/0xc0 Aug 22 19:59:06 juju-e4d256-prod-github-runner-207 kernel: [52520.618850] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:59:06 juju-e4d256-prod-github-runner-207 kernel: [52520.619655] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:59:06 juju-e4d256-prod-github-runner-207 kernel: [52520.620451] ? do_syscall_64+0x69/0xc0 Aug 22 19:59:06 juju-e4d256-prod-github-runner-207 kernel: [52520.621154] ? do_syscall_64+0x69/0xc0 Aug 22 19:59:06 juju-e4d256-prod-github-runner-207 kernel: [52520.621854] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 19:59:06 juju-e4d256-prod-github-runner-207 kernel: [52520.622688] RIP: 0033:0x7faa5d0edaff Aug 22 19:59:06 juju-e4d256-prod-github-runner-207 kernel: [52520.623414] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 19:59:06 juju-e4d256-prod-github-runner-207 kernel: [52520.625759] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 19:59:06 juju-e4d256-prod-github-runner-207 kernel: [52520.626844] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 19:59:06 juju-e4d256-prod-github-runner-207 kernel: [52520.627883] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 19:59:06 juju-e4d256-prod-github-runner-207 kernel: [52520.628911] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 19:59:06 juju-e4d256-prod-github-runner-207 kernel: [52520.629940] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 19:59:06 juju-e4d256-prod-github-runner-207 kernel: [52520.630992] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 19:59:06 juju-e4d256-prod-github-runner-207 kernel: [52520.632028] Aug 22 19:59:34 juju-e4d256-prod-github-runner-207 kernel: [52548.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 48831s! [qemu-system-x86:6715] Aug 22 19:59:34 juju-e4d256-prod-github-runner-207 kernel: [52548.543985] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 19:59:34 juju-e4d256-prod-github-runner-207 kernel: [52548.544249] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 19:59:34 juju-e4d256-prod-github-runner-207 kernel: [52548.556423] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 19:59:34 juju-e4d256-prod-github-runner-207 kernel: [52548.557727] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 19:59:34 juju-e4d256-prod-github-runner-207 kernel: [52548.559015] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:59:34 juju-e4d256-prod-github-runner-207 kernel: [52548.560081] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 19:59:34 juju-e4d256-prod-github-runner-207 kernel: [52548.562669] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 19:59:34 juju-e4d256-prod-github-runner-207 kernel: [52548.563720] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 19:59:34 juju-e4d256-prod-github-runner-207 kernel: [52548.564885] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 19:59:34 juju-e4d256-prod-github-runner-207 kernel: [52548.566070] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 19:59:34 juju-e4d256-prod-github-runner-207 kernel: [52548.567261] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 19:59:34 juju-e4d256-prod-github-runner-207 kernel: [52548.568494] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 19:59:34 juju-e4d256-prod-github-runner-207 kernel: [52548.569702] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 19:59:34 juju-e4d256-prod-github-runner-207 kernel: [52548.571097] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 19:59:34 juju-e4d256-prod-github-runner-207 kernel: [52548.572305] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 19:59:34 juju-e4d256-prod-github-runner-207 kernel: [52548.573597] Call Trace: Aug 22 19:59:34 juju-e4d256-prod-github-runner-207 kernel: [52548.574529] Aug 22 19:59:34 juju-e4d256-prod-github-runner-207 kernel: [52548.575510] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:59:34 juju-e4d256-prod-github-runner-207 kernel: [52548.576599] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 19:59:34 juju-e4d256-prod-github-runner-207 kernel: [52548.577707] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:59:34 juju-e4d256-prod-github-runner-207 kernel: [52548.578878] ? show_regs.part.0+0x23/0x29 Aug 22 19:59:34 juju-e4d256-prod-github-runner-207 kernel: [52548.579975] ? show_regs.cold+0x8/0xd Aug 22 19:59:34 juju-e4d256-prod-github-runner-207 kernel: [52548.581018] ? watchdog_timer_fn+0x1be/0x220 Aug 22 19:59:34 juju-e4d256-prod-github-runner-207 kernel: [52548.582047] ? lockup_detector_update_enable+0x60/0x60 Aug 22 19:59:34 juju-e4d256-prod-github-runner-207 kernel: [52548.583151] ? __hrtimer_run_queues+0x107/0x230 Aug 22 19:59:34 juju-e4d256-prod-github-runner-207 kernel: [52548.584217] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 19:59:34 juju-e4d256-prod-github-runner-207 kernel: [52548.585347] ? hrtimer_interrupt+0x101/0x220 Aug 22 19:59:34 juju-e4d256-prod-github-runner-207 kernel: [52548.586399] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 19:59:34 juju-e4d256-prod-github-runner-207 kernel: [52548.587470] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 19:59:34 juju-e4d256-prod-github-runner-207 kernel: [52548.588517] Aug 22 19:59:34 juju-e4d256-prod-github-runner-207 kernel: [52548.589370] Aug 22 19:59:34 juju-e4d256-prod-github-runner-207 kernel: [52548.590230] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 19:59:34 juju-e4d256-prod-github-runner-207 kernel: [52548.591273] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:59:34 juju-e4d256-prod-github-runner-207 kernel: [52548.592310] ? _raw_spin_lock+0x22/0x30 Aug 22 19:59:34 juju-e4d256-prod-github-runner-207 kernel: [52548.593255] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:59:34 juju-e4d256-prod-github-runner-207 kernel: [52548.594301] direct_page_fault+0x206/0x310 [kvm] Aug 22 19:59:34 juju-e4d256-prod-github-runner-207 kernel: [52548.595329] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 19:59:34 juju-e4d256-prod-github-runner-207 kernel: [52548.596343] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 19:59:34 juju-e4d256-prod-github-runner-207 kernel: [52548.597345] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 19:59:34 juju-e4d256-prod-github-runner-207 kernel: [52548.598371] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 19:59:34 juju-e4d256-prod-github-runner-207 kernel: [52548.599323] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 19:59:34 juju-e4d256-prod-github-runner-207 kernel: [52548.600309] handle_exit+0x98/0x230 [kvm_amd] Aug 22 19:59:34 juju-e4d256-prod-github-runner-207 kernel: [52548.601211] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 19:59:34 juju-e4d256-prod-github-runner-207 kernel: [52548.602141] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 19:59:34 juju-e4d256-prod-github-runner-207 kernel: [52548.603079] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 19:59:34 juju-e4d256-prod-github-runner-207 kernel: [52548.604013] vcpu_run+0x62/0x2c0 [kvm] Aug 22 19:59:34 juju-e4d256-prod-github-runner-207 kernel: [52548.604862] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 19:59:34 juju-e4d256-prod-github-runner-207 kernel: [52548.605676] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 19:59:34 juju-e4d256-prod-github-runner-207 kernel: [52548.606580] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 19:59:34 juju-e4d256-prod-github-runner-207 kernel: [52548.607382] ? __seccomp_filter+0x4a/0x4a0 Aug 22 19:59:34 juju-e4d256-prod-github-runner-207 kernel: [52548.608134] ? __fget_files+0x86/0xc0 Aug 22 19:59:34 juju-e4d256-prod-github-runner-207 kernel: [52548.608865] __x64_sys_ioctl+0x95/0xd0 Aug 22 19:59:34 juju-e4d256-prod-github-runner-207 kernel: [52548.609577] do_syscall_64+0x5c/0xc0 Aug 22 19:59:34 juju-e4d256-prod-github-runner-207 kernel: [52548.610306] ? do_futex+0x162/0x1f0 Aug 22 19:59:34 juju-e4d256-prod-github-runner-207 kernel: [52548.610969] ? __x64_sys_futex+0x78/0x1e0 Aug 22 19:59:34 juju-e4d256-prod-github-runner-207 kernel: [52548.611646] ? __secure_computing+0xa9/0x120 Aug 22 19:59:34 juju-e4d256-prod-github-runner-207 kernel: [52548.612341] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 19:59:34 juju-e4d256-prod-github-runner-207 kernel: [52548.613109] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:59:34 juju-e4d256-prod-github-runner-207 kernel: [52548.613850] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:59:34 juju-e4d256-prod-github-runner-207 kernel: [52548.614615] ? do_syscall_64+0x69/0xc0 Aug 22 19:59:34 juju-e4d256-prod-github-runner-207 kernel: [52548.615269] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:59:34 juju-e4d256-prod-github-runner-207 kernel: [52548.615976] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:59:34 juju-e4d256-prod-github-runner-207 kernel: [52548.616674] ? do_syscall_64+0x69/0xc0 Aug 22 19:59:34 juju-e4d256-prod-github-runner-207 kernel: [52548.617305] ? do_syscall_64+0x69/0xc0 Aug 22 19:59:34 juju-e4d256-prod-github-runner-207 kernel: [52548.617934] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 19:59:34 juju-e4d256-prod-github-runner-207 kernel: [52548.618674] RIP: 0033:0x7faa5d0edaff Aug 22 19:59:34 juju-e4d256-prod-github-runner-207 kernel: [52548.619363] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 19:59:34 juju-e4d256-prod-github-runner-207 kernel: [52548.621441] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 19:59:34 juju-e4d256-prod-github-runner-207 kernel: [52548.622399] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 19:59:34 juju-e4d256-prod-github-runner-207 kernel: [52548.623330] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 19:59:34 juju-e4d256-prod-github-runner-207 kernel: [52548.624269] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 19:59:34 juju-e4d256-prod-github-runner-207 kernel: [52548.625189] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 19:59:34 juju-e4d256-prod-github-runner-207 kernel: [52548.626111] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 19:59:34 juju-e4d256-prod-github-runner-207 kernel: [52548.627012] Aug 22 19:59:46 juju-e4d256-prod-github-runner-207 kernel: [52560.692705] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 19:59:46 juju-e4d256-prod-github-runner-207 kernel: [52560.694306] rcu: 1-....: (13069567 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=6317995 Aug 22 19:59:46 juju-e4d256-prod-github-runner-207 kernel: [52560.695429] (t=13110873 jiffies g=23269 q=49202) Aug 22 19:59:46 juju-e4d256-prod-github-runner-207 kernel: [52560.696245] NMI backtrace for cpu 1 Aug 22 19:59:46 juju-e4d256-prod-github-runner-207 kernel: [52560.696957] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 19:59:46 juju-e4d256-prod-github-runner-207 kernel: [52560.698070] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 19:59:46 juju-e4d256-prod-github-runner-207 kernel: [52560.699122] Call Trace: Aug 22 19:59:46 juju-e4d256-prod-github-runner-207 kernel: [52560.699793] Aug 22 19:59:46 juju-e4d256-prod-github-runner-207 kernel: [52560.700451] show_stack+0x52/0x5c Aug 22 19:59:46 juju-e4d256-prod-github-runner-207 kernel: [52560.701174] dump_stack_lvl+0x4a/0x63 Aug 22 19:59:46 juju-e4d256-prod-github-runner-207 kernel: [52560.701929] dump_stack+0x10/0x16 Aug 22 19:59:46 juju-e4d256-prod-github-runner-207 kernel: [52560.702643] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 19:59:46 juju-e4d256-prod-github-runner-207 kernel: [52560.703420] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 19:59:46 juju-e4d256-prod-github-runner-207 kernel: [52560.704195] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 19:59:46 juju-e4d256-prod-github-runner-207 kernel: [52560.705013] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 19:59:46 juju-e4d256-prod-github-runner-207 kernel: [52560.705828] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 19:59:46 juju-e4d256-prod-github-runner-207 kernel: [52560.706642] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 19:59:46 juju-e4d256-prod-github-runner-207 kernel: [52560.707411] print_cpu_stall.cold+0x2f/0xe2 Aug 22 19:59:46 juju-e4d256-prod-github-runner-207 kernel: [52560.708172] ? timekeeping_update+0xf7/0x150 Aug 22 19:59:46 juju-e4d256-prod-github-runner-207 kernel: [52560.708940] check_cpu_stall+0x109/0x270 Aug 22 19:59:46 juju-e4d256-prod-github-runner-207 kernel: [52560.709685] rcu_sched_clock_irq+0x9a/0x250 Aug 22 19:59:46 juju-e4d256-prod-github-runner-207 kernel: [52560.710457] update_process_times+0x94/0xd0 Aug 22 19:59:46 juju-e4d256-prod-github-runner-207 kernel: [52560.711215] tick_sched_handle+0x29/0x70 Aug 22 19:59:46 juju-e4d256-prod-github-runner-207 kernel: [52560.711960] tick_sched_timer+0x8c/0xc0 Aug 22 19:59:46 juju-e4d256-prod-github-runner-207 kernel: [52560.712695] ? tick_nohz_handler+0xb0/0xb0 Aug 22 19:59:46 juju-e4d256-prod-github-runner-207 kernel: [52560.713453] __hrtimer_run_queues+0x107/0x230 Aug 22 19:59:46 juju-e4d256-prod-github-runner-207 kernel: [52560.714234] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 19:59:46 juju-e4d256-prod-github-runner-207 kernel: [52560.715022] hrtimer_interrupt+0x101/0x220 Aug 22 19:59:46 juju-e4d256-prod-github-runner-207 kernel: [52560.715794] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 19:59:46 juju-e4d256-prod-github-runner-207 kernel: [52560.716642] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 19:59:46 juju-e4d256-prod-github-runner-207 kernel: [52560.717564] Aug 22 19:59:46 juju-e4d256-prod-github-runner-207 kernel: [52560.718230] Aug 22 19:59:46 juju-e4d256-prod-github-runner-207 kernel: [52560.718860] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 19:59:46 juju-e4d256-prod-github-runner-207 kernel: [52560.719681] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 19:59:46 juju-e4d256-prod-github-runner-207 kernel: [52560.720564] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 19:59:46 juju-e4d256-prod-github-runner-207 kernel: [52560.722785] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 19:59:46 juju-e4d256-prod-github-runner-207 kernel: [52560.723666] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 19:59:46 juju-e4d256-prod-github-runner-207 kernel: [52560.724661] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 19:59:46 juju-e4d256-prod-github-runner-207 kernel: [52560.725654] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 19:59:46 juju-e4d256-prod-github-runner-207 kernel: [52560.726638] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 19:59:46 juju-e4d256-prod-github-runner-207 kernel: [52560.727593] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 19:59:46 juju-e4d256-prod-github-runner-207 kernel: [52560.728541] ? _raw_spin_lock+0x22/0x30 Aug 22 19:59:46 juju-e4d256-prod-github-runner-207 kernel: [52560.729308] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 19:59:46 juju-e4d256-prod-github-runner-207 kernel: [52560.730171] direct_page_fault+0x206/0x310 [kvm] Aug 22 19:59:46 juju-e4d256-prod-github-runner-207 kernel: [52560.731008] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 19:59:46 juju-e4d256-prod-github-runner-207 kernel: [52560.731835] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 19:59:46 juju-e4d256-prod-github-runner-207 kernel: [52560.732668] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 19:59:46 juju-e4d256-prod-github-runner-207 kernel: [52560.733494] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 19:59:46 juju-e4d256-prod-github-runner-207 kernel: [52560.734287] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 19:59:46 juju-e4d256-prod-github-runner-207 kernel: [52560.735114] handle_exit+0x98/0x230 [kvm_amd] Aug 22 19:59:46 juju-e4d256-prod-github-runner-207 kernel: [52560.735868] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 19:59:46 juju-e4d256-prod-github-runner-207 kernel: [52560.736655] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 19:59:46 juju-e4d256-prod-github-runner-207 kernel: [52560.737453] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 19:59:46 juju-e4d256-prod-github-runner-207 kernel: [52560.738288] vcpu_run+0x62/0x2c0 [kvm] Aug 22 19:59:46 juju-e4d256-prod-github-runner-207 kernel: [52560.739018] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 19:59:46 juju-e4d256-prod-github-runner-207 kernel: [52560.739749] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 19:59:46 juju-e4d256-prod-github-runner-207 kernel: [52560.740547] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 19:59:46 juju-e4d256-prod-github-runner-207 kernel: [52560.741390] ? __seccomp_filter+0x4a/0x4a0 Aug 22 19:59:46 juju-e4d256-prod-github-runner-207 kernel: [52560.742135] ? __fget_files+0x86/0xc0 Aug 22 19:59:46 juju-e4d256-prod-github-runner-207 kernel: [52560.742829] __x64_sys_ioctl+0x95/0xd0 Aug 22 19:59:46 juju-e4d256-prod-github-runner-207 kernel: [52560.743522] do_syscall_64+0x5c/0xc0 Aug 22 19:59:46 juju-e4d256-prod-github-runner-207 kernel: [52560.744208] ? do_futex+0x162/0x1f0 Aug 22 19:59:46 juju-e4d256-prod-github-runner-207 kernel: [52560.744879] ? __x64_sys_futex+0x78/0x1e0 Aug 22 19:59:46 juju-e4d256-prod-github-runner-207 kernel: [52560.745580] ? __secure_computing+0xa9/0x120 Aug 22 19:59:46 juju-e4d256-prod-github-runner-207 kernel: [52560.746313] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 19:59:46 juju-e4d256-prod-github-runner-207 kernel: [52560.747104] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:59:46 juju-e4d256-prod-github-runner-207 kernel: [52560.747857] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:59:46 juju-e4d256-prod-github-runner-207 kernel: [52560.748787] ? do_syscall_64+0x69/0xc0 Aug 22 19:59:46 juju-e4d256-prod-github-runner-207 kernel: [52560.749475] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 19:59:46 juju-e4d256-prod-github-runner-207 kernel: [52560.750239] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 19:59:46 juju-e4d256-prod-github-runner-207 kernel: [52560.751006] ? do_syscall_64+0x69/0xc0 Aug 22 19:59:46 juju-e4d256-prod-github-runner-207 kernel: [52560.751704] ? do_syscall_64+0x69/0xc0 Aug 22 19:59:46 juju-e4d256-prod-github-runner-207 kernel: [52560.752390] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 19:59:46 juju-e4d256-prod-github-runner-207 kernel: [52560.753180] RIP: 0033:0x7faa5d0edaff Aug 22 19:59:46 juju-e4d256-prod-github-runner-207 kernel: [52560.753924] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 19:59:46 juju-e4d256-prod-github-runner-207 kernel: [52560.756037] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 19:59:46 juju-e4d256-prod-github-runner-207 kernel: [52560.757023] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 19:59:46 juju-e4d256-prod-github-runner-207 kernel: [52560.757992] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 19:59:46 juju-e4d256-prod-github-runner-207 kernel: [52560.758936] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 19:59:46 juju-e4d256-prod-github-runner-207 kernel: [52560.759874] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 19:59:46 juju-e4d256-prod-github-runner-207 kernel: [52560.760795] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 19:59:46 juju-e4d256-prod-github-runner-207 kernel: [52560.761709] Aug 22 20:00:14 juju-e4d256-prod-github-runner-207 kernel: [52588.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 48868s! [qemu-system-x86:6715] Aug 22 20:00:14 juju-e4d256-prod-github-runner-207 kernel: [52588.543769] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 20:00:14 juju-e4d256-prod-github-runner-207 kernel: [52588.544011] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 20:00:14 juju-e4d256-prod-github-runner-207 kernel: [52588.556437] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 20:00:14 juju-e4d256-prod-github-runner-207 kernel: [52588.557730] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 20:00:14 juju-e4d256-prod-github-runner-207 kernel: [52588.558959] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:00:14 juju-e4d256-prod-github-runner-207 kernel: [52588.560019] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 20:00:14 juju-e4d256-prod-github-runner-207 kernel: [52588.562578] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 20:00:14 juju-e4d256-prod-github-runner-207 kernel: [52588.563635] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 20:00:14 juju-e4d256-prod-github-runner-207 kernel: [52588.564803] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 20:00:14 juju-e4d256-prod-github-runner-207 kernel: [52588.565988] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 20:00:14 juju-e4d256-prod-github-runner-207 kernel: [52588.567155] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 20:00:14 juju-e4d256-prod-github-runner-207 kernel: [52588.568322] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 20:00:14 juju-e4d256-prod-github-runner-207 kernel: [52588.569489] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 20:00:14 juju-e4d256-prod-github-runner-207 kernel: [52588.570739] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 20:00:14 juju-e4d256-prod-github-runner-207 kernel: [52588.571843] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 20:00:14 juju-e4d256-prod-github-runner-207 kernel: [52588.573038] Call Trace: Aug 22 20:00:14 juju-e4d256-prod-github-runner-207 kernel: [52588.573977] Aug 22 20:00:14 juju-e4d256-prod-github-runner-207 kernel: [52588.574879] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:00:14 juju-e4d256-prod-github-runner-207 kernel: [52588.575913] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:00:14 juju-e4d256-prod-github-runner-207 kernel: [52588.576937] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:00:14 juju-e4d256-prod-github-runner-207 kernel: [52588.578049] ? show_regs.part.0+0x23/0x29 Aug 22 20:00:14 juju-e4d256-prod-github-runner-207 kernel: [52588.579057] ? show_regs.cold+0x8/0xd Aug 22 20:00:14 juju-e4d256-prod-github-runner-207 kernel: [52588.580032] ? watchdog_timer_fn+0x1be/0x220 Aug 22 20:00:14 juju-e4d256-prod-github-runner-207 kernel: [52588.581043] ? lockup_detector_update_enable+0x60/0x60 Aug 22 20:00:14 juju-e4d256-prod-github-runner-207 kernel: [52588.582125] ? __hrtimer_run_queues+0x107/0x230 Aug 22 20:00:14 juju-e4d256-prod-github-runner-207 kernel: [52588.583156] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 20:00:14 juju-e4d256-prod-github-runner-207 kernel: [52588.584192] ? hrtimer_interrupt+0x101/0x220 Aug 22 20:00:14 juju-e4d256-prod-github-runner-207 kernel: [52588.585207] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 20:00:14 juju-e4d256-prod-github-runner-207 kernel: [52588.586294] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 20:00:14 juju-e4d256-prod-github-runner-207 kernel: [52588.587351] Aug 22 20:00:14 juju-e4d256-prod-github-runner-207 kernel: [52588.588204] Aug 22 20:00:14 juju-e4d256-prod-github-runner-207 kernel: [52588.589047] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 20:00:14 juju-e4d256-prod-github-runner-207 kernel: [52588.590101] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:00:14 juju-e4d256-prod-github-runner-207 kernel: [52588.591146] ? _raw_spin_lock+0x22/0x30 Aug 22 20:00:14 juju-e4d256-prod-github-runner-207 kernel: [52588.592090] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:00:14 juju-e4d256-prod-github-runner-207 kernel: [52588.593120] direct_page_fault+0x206/0x310 [kvm] Aug 22 20:00:14 juju-e4d256-prod-github-runner-207 kernel: [52588.594178] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 20:00:14 juju-e4d256-prod-github-runner-207 kernel: [52588.595199] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 20:00:14 juju-e4d256-prod-github-runner-207 kernel: [52588.596209] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 20:00:14 juju-e4d256-prod-github-runner-207 kernel: [52588.597221] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 20:00:14 juju-e4d256-prod-github-runner-207 kernel: [52588.598185] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 20:00:14 juju-e4d256-prod-github-runner-207 kernel: [52588.599161] handle_exit+0x98/0x230 [kvm_amd] Aug 22 20:00:14 juju-e4d256-prod-github-runner-207 kernel: [52588.600052] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 20:00:14 juju-e4d256-prod-github-runner-207 kernel: [52588.600973] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 20:00:14 juju-e4d256-prod-github-runner-207 kernel: [52588.601913] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 20:00:14 juju-e4d256-prod-github-runner-207 kernel: [52588.602826] vcpu_run+0x62/0x2c0 [kvm] Aug 22 20:00:14 juju-e4d256-prod-github-runner-207 kernel: [52588.603641] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 20:00:14 juju-e4d256-prod-github-runner-207 kernel: [52588.604450] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 20:00:14 juju-e4d256-prod-github-runner-207 kernel: [52588.605306] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 20:00:14 juju-e4d256-prod-github-runner-207 kernel: [52588.606124] ? __seccomp_filter+0x4a/0x4a0 Aug 22 20:00:14 juju-e4d256-prod-github-runner-207 kernel: [52588.606875] ? __fget_files+0x86/0xc0 Aug 22 20:00:14 juju-e4d256-prod-github-runner-207 kernel: [52588.607581] __x64_sys_ioctl+0x95/0xd0 Aug 22 20:00:14 juju-e4d256-prod-github-runner-207 kernel: [52588.608276] do_syscall_64+0x5c/0xc0 Aug 22 20:00:14 juju-e4d256-prod-github-runner-207 kernel: [52588.608943] ? do_futex+0x162/0x1f0 Aug 22 20:00:14 juju-e4d256-prod-github-runner-207 kernel: [52588.609623] ? __x64_sys_futex+0x78/0x1e0 Aug 22 20:00:14 juju-e4d256-prod-github-runner-207 kernel: [52588.610299] ? __secure_computing+0xa9/0x120 Aug 22 20:00:14 juju-e4d256-prod-github-runner-207 kernel: [52588.610991] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 20:00:14 juju-e4d256-prod-github-runner-207 kernel: [52588.611750] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:00:14 juju-e4d256-prod-github-runner-207 kernel: [52588.612479] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:00:14 juju-e4d256-prod-github-runner-207 kernel: [52588.613207] ? do_syscall_64+0x69/0xc0 Aug 22 20:00:14 juju-e4d256-prod-github-runner-207 kernel: [52588.613873] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:00:14 juju-e4d256-prod-github-runner-207 kernel: [52588.614579] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:00:14 juju-e4d256-prod-github-runner-207 kernel: [52588.615281] ? do_syscall_64+0x69/0xc0 Aug 22 20:00:14 juju-e4d256-prod-github-runner-207 kernel: [52588.615906] ? do_syscall_64+0x69/0xc0 Aug 22 20:00:14 juju-e4d256-prod-github-runner-207 kernel: [52588.616541] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 20:00:14 juju-e4d256-prod-github-runner-207 kernel: [52588.617262] RIP: 0033:0x7faa5d0edaff Aug 22 20:00:14 juju-e4d256-prod-github-runner-207 kernel: [52588.617949] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 20:00:14 juju-e4d256-prod-github-runner-207 kernel: [52588.619936] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 20:00:14 juju-e4d256-prod-github-runner-207 kernel: [52588.620849] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 20:00:14 juju-e4d256-prod-github-runner-207 kernel: [52588.621773] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 20:00:14 juju-e4d256-prod-github-runner-207 kernel: [52588.622666] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 20:00:14 juju-e4d256-prod-github-runner-207 kernel: [52588.623594] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 20:00:14 juju-e4d256-prod-github-runner-207 kernel: [52588.624515] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 20:00:14 juju-e4d256-prod-github-runner-207 kernel: [52588.625439] Aug 22 20:00:42 juju-e4d256-prod-github-runner-207 kernel: [52616.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 48894s! [qemu-system-x86:6715] Aug 22 20:00:42 juju-e4d256-prod-github-runner-207 kernel: [52616.543749] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 20:00:42 juju-e4d256-prod-github-runner-207 kernel: [52616.544007] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 20:00:42 juju-e4d256-prod-github-runner-207 kernel: [52616.556322] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 20:00:42 juju-e4d256-prod-github-runner-207 kernel: [52616.557608] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 20:00:42 juju-e4d256-prod-github-runner-207 kernel: [52616.558835] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:00:42 juju-e4d256-prod-github-runner-207 kernel: [52616.559891] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 20:00:42 juju-e4d256-prod-github-runner-207 kernel: [52616.562558] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 20:00:42 juju-e4d256-prod-github-runner-207 kernel: [52616.563633] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 20:00:42 juju-e4d256-prod-github-runner-207 kernel: [52616.564800] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 20:00:42 juju-e4d256-prod-github-runner-207 kernel: [52616.565994] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 20:00:42 juju-e4d256-prod-github-runner-207 kernel: [52616.567152] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 20:00:42 juju-e4d256-prod-github-runner-207 kernel: [52616.568314] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 20:00:42 juju-e4d256-prod-github-runner-207 kernel: [52616.569506] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 20:00:42 juju-e4d256-prod-github-runner-207 kernel: [52616.570738] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 20:00:42 juju-e4d256-prod-github-runner-207 kernel: [52616.571836] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 20:00:42 juju-e4d256-prod-github-runner-207 kernel: [52616.573086] Call Trace: Aug 22 20:00:42 juju-e4d256-prod-github-runner-207 kernel: [52616.574015] Aug 22 20:00:42 juju-e4d256-prod-github-runner-207 kernel: [52616.574984] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:00:42 juju-e4d256-prod-github-runner-207 kernel: [52616.576027] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:00:42 juju-e4d256-prod-github-runner-207 kernel: [52616.577052] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:00:42 juju-e4d256-prod-github-runner-207 kernel: [52616.578178] ? show_regs.part.0+0x23/0x29 Aug 22 20:00:42 juju-e4d256-prod-github-runner-207 kernel: [52616.579182] ? show_regs.cold+0x8/0xd Aug 22 20:00:42 juju-e4d256-prod-github-runner-207 kernel: [52616.580153] ? watchdog_timer_fn+0x1be/0x220 Aug 22 20:00:42 juju-e4d256-prod-github-runner-207 kernel: [52616.581184] ? lockup_detector_update_enable+0x60/0x60 Aug 22 20:00:42 juju-e4d256-prod-github-runner-207 kernel: [52616.582251] ? __hrtimer_run_queues+0x107/0x230 Aug 22 20:00:42 juju-e4d256-prod-github-runner-207 kernel: [52616.583280] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 20:00:42 juju-e4d256-prod-github-runner-207 kernel: [52616.584322] ? hrtimer_interrupt+0x101/0x220 Aug 22 20:00:42 juju-e4d256-prod-github-runner-207 kernel: [52616.585383] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 20:00:42 juju-e4d256-prod-github-runner-207 kernel: [52616.586550] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 20:00:42 juju-e4d256-prod-github-runner-207 kernel: [52616.587606] Aug 22 20:00:42 juju-e4d256-prod-github-runner-207 kernel: [52616.588460] Aug 22 20:00:42 juju-e4d256-prod-github-runner-207 kernel: [52616.589324] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 20:00:42 juju-e4d256-prod-github-runner-207 kernel: [52616.590359] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:00:42 juju-e4d256-prod-github-runner-207 kernel: [52616.591445] ? _raw_spin_lock+0x22/0x30 Aug 22 20:00:42 juju-e4d256-prod-github-runner-207 kernel: [52616.592477] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:00:42 juju-e4d256-prod-github-runner-207 kernel: [52616.593544] direct_page_fault+0x206/0x310 [kvm] Aug 22 20:00:42 juju-e4d256-prod-github-runner-207 kernel: [52616.594575] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 20:00:42 juju-e4d256-prod-github-runner-207 kernel: [52616.595583] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 20:00:42 juju-e4d256-prod-github-runner-207 kernel: [52616.596608] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 20:00:42 juju-e4d256-prod-github-runner-207 kernel: [52616.597637] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 20:00:42 juju-e4d256-prod-github-runner-207 kernel: [52616.598583] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 20:00:42 juju-e4d256-prod-github-runner-207 kernel: [52616.599567] handle_exit+0x98/0x230 [kvm_amd] Aug 22 20:00:42 juju-e4d256-prod-github-runner-207 kernel: [52616.600463] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 20:00:42 juju-e4d256-prod-github-runner-207 kernel: [52616.601398] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 20:00:42 juju-e4d256-prod-github-runner-207 kernel: [52616.602326] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 20:00:42 juju-e4d256-prod-github-runner-207 kernel: [52616.603230] vcpu_run+0x62/0x2c0 [kvm] Aug 22 20:00:42 juju-e4d256-prod-github-runner-207 kernel: [52616.604049] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 20:00:42 juju-e4d256-prod-github-runner-207 kernel: [52616.604859] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 20:00:42 juju-e4d256-prod-github-runner-207 kernel: [52616.605736] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 20:00:42 juju-e4d256-prod-github-runner-207 kernel: [52616.606542] ? __seccomp_filter+0x4a/0x4a0 Aug 22 20:00:42 juju-e4d256-prod-github-runner-207 kernel: [52616.607288] ? __fget_files+0x86/0xc0 Aug 22 20:00:42 juju-e4d256-prod-github-runner-207 kernel: [52616.608000] __x64_sys_ioctl+0x95/0xd0 Aug 22 20:00:42 juju-e4d256-prod-github-runner-207 kernel: [52616.608701] do_syscall_64+0x5c/0xc0 Aug 22 20:00:42 juju-e4d256-prod-github-runner-207 kernel: [52616.609387] ? do_futex+0x162/0x1f0 Aug 22 20:00:42 juju-e4d256-prod-github-runner-207 kernel: [52616.610045] ? __x64_sys_futex+0x78/0x1e0 Aug 22 20:00:42 juju-e4d256-prod-github-runner-207 kernel: [52616.610726] ? __secure_computing+0xa9/0x120 Aug 22 20:00:42 juju-e4d256-prod-github-runner-207 kernel: [52616.611419] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 20:00:42 juju-e4d256-prod-github-runner-207 kernel: [52616.612186] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:00:42 juju-e4d256-prod-github-runner-207 kernel: [52616.612910] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:00:42 juju-e4d256-prod-github-runner-207 kernel: [52616.613649] ? do_syscall_64+0x69/0xc0 Aug 22 20:00:42 juju-e4d256-prod-github-runner-207 kernel: [52616.614299] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:00:42 juju-e4d256-prod-github-runner-207 kernel: [52616.615004] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:00:42 juju-e4d256-prod-github-runner-207 kernel: [52616.615706] ? do_syscall_64+0x69/0xc0 Aug 22 20:00:42 juju-e4d256-prod-github-runner-207 kernel: [52616.616332] ? do_syscall_64+0x69/0xc0 Aug 22 20:00:42 juju-e4d256-prod-github-runner-207 kernel: [52616.616962] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 20:00:42 juju-e4d256-prod-github-runner-207 kernel: [52616.617690] RIP: 0033:0x7faa5d0edaff Aug 22 20:00:42 juju-e4d256-prod-github-runner-207 kernel: [52616.618393] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 20:00:42 juju-e4d256-prod-github-runner-207 kernel: [52616.620412] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 20:00:42 juju-e4d256-prod-github-runner-207 kernel: [52616.621393] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 20:00:42 juju-e4d256-prod-github-runner-207 kernel: [52616.622404] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 20:00:42 juju-e4d256-prod-github-runner-207 kernel: [52616.623304] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 20:00:42 juju-e4d256-prod-github-runner-207 kernel: [52616.624636] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 20:00:42 juju-e4d256-prod-github-runner-207 kernel: [52616.625634] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 20:00:42 juju-e4d256-prod-github-runner-207 kernel: [52616.626629] Aug 22 20:01:10 juju-e4d256-prod-github-runner-207 kernel: [52644.541976] watchdog: BUG: soft lockup - CPU#1 stuck for 48921s! [qemu-system-x86:6715] Aug 22 20:01:10 juju-e4d256-prod-github-runner-207 kernel: [52644.543099] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 20:01:10 juju-e4d256-prod-github-runner-207 kernel: [52644.543165] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 20:01:10 juju-e4d256-prod-github-runner-207 kernel: [52644.555177] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 20:01:10 juju-e4d256-prod-github-runner-207 kernel: [52644.556440] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 20:01:10 juju-e4d256-prod-github-runner-207 kernel: [52644.557667] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:01:10 juju-e4d256-prod-github-runner-207 kernel: [52644.558720] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 20:01:10 juju-e4d256-prod-github-runner-207 kernel: [52644.561268] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 20:01:10 juju-e4d256-prod-github-runner-207 kernel: [52644.562307] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 20:01:10 juju-e4d256-prod-github-runner-207 kernel: [52644.563466] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 20:01:10 juju-e4d256-prod-github-runner-207 kernel: [52644.564628] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 20:01:10 juju-e4d256-prod-github-runner-207 kernel: [52644.565791] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 20:01:10 juju-e4d256-prod-github-runner-207 kernel: [52644.566954] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 20:01:10 juju-e4d256-prod-github-runner-207 kernel: [52644.568116] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 20:01:10 juju-e4d256-prod-github-runner-207 kernel: [52644.569358] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 20:01:10 juju-e4d256-prod-github-runner-207 kernel: [52644.570454] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 20:01:10 juju-e4d256-prod-github-runner-207 kernel: [52644.571645] Call Trace: Aug 22 20:01:10 juju-e4d256-prod-github-runner-207 kernel: [52644.572555] Aug 22 20:01:10 juju-e4d256-prod-github-runner-207 kernel: [52644.573447] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:01:10 juju-e4d256-prod-github-runner-207 kernel: [52644.574476] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:01:10 juju-e4d256-prod-github-runner-207 kernel: [52644.575494] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:01:10 juju-e4d256-prod-github-runner-207 kernel: [52644.576567] ? show_regs.part.0+0x23/0x29 Aug 22 20:01:10 juju-e4d256-prod-github-runner-207 kernel: [52644.577568] ? show_regs.cold+0x8/0xd Aug 22 20:01:10 juju-e4d256-prod-github-runner-207 kernel: [52644.578538] ? watchdog_timer_fn+0x1be/0x220 Aug 22 20:01:10 juju-e4d256-prod-github-runner-207 kernel: [52644.579543] ? lockup_detector_update_enable+0x60/0x60 Aug 22 20:01:10 juju-e4d256-prod-github-runner-207 kernel: [52644.580602] ? __hrtimer_run_queues+0x107/0x230 Aug 22 20:01:10 juju-e4d256-prod-github-runner-207 kernel: [52644.581634] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 20:01:10 juju-e4d256-prod-github-runner-207 kernel: [52644.582655] ? hrtimer_interrupt+0x101/0x220 Aug 22 20:01:10 juju-e4d256-prod-github-runner-207 kernel: [52644.583675] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 20:01:10 juju-e4d256-prod-github-runner-207 kernel: [52644.584743] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 20:01:10 juju-e4d256-prod-github-runner-207 kernel: [52644.585803] Aug 22 20:01:10 juju-e4d256-prod-github-runner-207 kernel: [52644.586655] Aug 22 20:01:10 juju-e4d256-prod-github-runner-207 kernel: [52644.587490] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 20:01:10 juju-e4d256-prod-github-runner-207 kernel: [52644.588520] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:01:10 juju-e4d256-prod-github-runner-207 kernel: [52644.589570] ? _raw_spin_lock+0x22/0x30 Aug 22 20:01:10 juju-e4d256-prod-github-runner-207 kernel: [52644.590518] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:01:10 juju-e4d256-prod-github-runner-207 kernel: [52644.591534] direct_page_fault+0x206/0x310 [kvm] Aug 22 20:01:10 juju-e4d256-prod-github-runner-207 kernel: [52644.592558] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 20:01:10 juju-e4d256-prod-github-runner-207 kernel: [52644.593580] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 20:01:10 juju-e4d256-prod-github-runner-207 kernel: [52644.594579] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 20:01:10 juju-e4d256-prod-github-runner-207 kernel: [52644.595547] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 20:01:10 juju-e4d256-prod-github-runner-207 kernel: [52644.596492] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 20:01:10 juju-e4d256-prod-github-runner-207 kernel: [52644.597485] handle_exit+0x98/0x230 [kvm_amd] Aug 22 20:01:10 juju-e4d256-prod-github-runner-207 kernel: [52644.598375] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 20:01:10 juju-e4d256-prod-github-runner-207 kernel: [52644.599287] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 20:01:10 juju-e4d256-prod-github-runner-207 kernel: [52644.600209] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 20:01:10 juju-e4d256-prod-github-runner-207 kernel: [52644.601126] vcpu_run+0x62/0x2c0 [kvm] Aug 22 20:01:10 juju-e4d256-prod-github-runner-207 kernel: [52644.601937] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 20:01:10 juju-e4d256-prod-github-runner-207 kernel: [52644.602745] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 20:01:10 juju-e4d256-prod-github-runner-207 kernel: [52644.603597] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 20:01:10 juju-e4d256-prod-github-runner-207 kernel: [52644.604391] ? __seccomp_filter+0x4a/0x4a0 Aug 22 20:01:10 juju-e4d256-prod-github-runner-207 kernel: [52644.605155] ? __fget_files+0x86/0xc0 Aug 22 20:01:10 juju-e4d256-prod-github-runner-207 kernel: [52644.605858] __x64_sys_ioctl+0x95/0xd0 Aug 22 20:01:10 juju-e4d256-prod-github-runner-207 kernel: [52644.606547] do_syscall_64+0x5c/0xc0 Aug 22 20:01:10 juju-e4d256-prod-github-runner-207 kernel: [52644.607226] ? do_futex+0x162/0x1f0 Aug 22 20:01:10 juju-e4d256-prod-github-runner-207 kernel: [52644.607880] ? __x64_sys_futex+0x78/0x1e0 Aug 22 20:01:10 juju-e4d256-prod-github-runner-207 kernel: [52644.608551] ? __secure_computing+0xa9/0x120 Aug 22 20:01:10 juju-e4d256-prod-github-runner-207 kernel: [52644.609246] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 20:01:10 juju-e4d256-prod-github-runner-207 kernel: [52644.610003] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:01:10 juju-e4d256-prod-github-runner-207 kernel: [52644.610723] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:01:10 juju-e4d256-prod-github-runner-207 kernel: [52644.611437] ? do_syscall_64+0x69/0xc0 Aug 22 20:01:10 juju-e4d256-prod-github-runner-207 kernel: [52644.612085] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:01:10 juju-e4d256-prod-github-runner-207 kernel: [52644.612790] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:01:10 juju-e4d256-prod-github-runner-207 kernel: [52644.613495] ? do_syscall_64+0x69/0xc0 Aug 22 20:01:10 juju-e4d256-prod-github-runner-207 kernel: [52644.614118] ? do_syscall_64+0x69/0xc0 Aug 22 20:01:10 juju-e4d256-prod-github-runner-207 kernel: [52644.614738] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 20:01:10 juju-e4d256-prod-github-runner-207 kernel: [52644.615441] RIP: 0033:0x7faa5d0edaff Aug 22 20:01:10 juju-e4d256-prod-github-runner-207 kernel: [52644.616064] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 20:01:10 juju-e4d256-prod-github-runner-207 kernel: [52644.618055] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 20:01:10 juju-e4d256-prod-github-runner-207 kernel: [52644.618963] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 20:01:10 juju-e4d256-prod-github-runner-207 kernel: [52644.619851] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 20:01:10 juju-e4d256-prod-github-runner-207 kernel: [52644.620737] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 20:01:10 juju-e4d256-prod-github-runner-207 kernel: [52644.621627] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 20:01:10 juju-e4d256-prod-github-runner-207 kernel: [52644.622513] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 20:01:10 juju-e4d256-prod-github-runner-207 kernel: [52644.623404] Aug 22 20:01:38 juju-e4d256-prod-github-runner-207 kernel: [52672.541976] watchdog: BUG: soft lockup - CPU#1 stuck for 48947s! [qemu-system-x86:6715] Aug 22 20:01:38 juju-e4d256-prod-github-runner-207 kernel: [52672.543662] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 20:01:38 juju-e4d256-prod-github-runner-207 kernel: [52672.543902] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 20:01:38 juju-e4d256-prod-github-runner-207 kernel: [52672.556194] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 20:01:38 juju-e4d256-prod-github-runner-207 kernel: [52672.557474] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 20:01:38 juju-e4d256-prod-github-runner-207 kernel: [52672.558693] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:01:38 juju-e4d256-prod-github-runner-207 kernel: [52672.559750] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 20:01:38 juju-e4d256-prod-github-runner-207 kernel: [52672.562315] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 20:01:38 juju-e4d256-prod-github-runner-207 kernel: [52672.563362] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 20:01:38 juju-e4d256-prod-github-runner-207 kernel: [52672.564536] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 20:01:38 juju-e4d256-prod-github-runner-207 kernel: [52672.565697] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 20:01:38 juju-e4d256-prod-github-runner-207 kernel: [52672.566861] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 20:01:38 juju-e4d256-prod-github-runner-207 kernel: [52672.568040] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 20:01:38 juju-e4d256-prod-github-runner-207 kernel: [52672.569234] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 20:01:38 juju-e4d256-prod-github-runner-207 kernel: [52672.570483] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 20:01:38 juju-e4d256-prod-github-runner-207 kernel: [52672.571590] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 20:01:38 juju-e4d256-prod-github-runner-207 kernel: [52672.572808] Call Trace: Aug 22 20:01:38 juju-e4d256-prod-github-runner-207 kernel: [52672.573726] Aug 22 20:01:38 juju-e4d256-prod-github-runner-207 kernel: [52672.574629] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:01:38 juju-e4d256-prod-github-runner-207 kernel: [52672.575668] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:01:38 juju-e4d256-prod-github-runner-207 kernel: [52672.576712] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:01:38 juju-e4d256-prod-github-runner-207 kernel: [52672.577804] ? show_regs.part.0+0x23/0x29 Aug 22 20:01:38 juju-e4d256-prod-github-runner-207 kernel: [52672.578807] ? show_regs.cold+0x8/0xd Aug 22 20:01:38 juju-e4d256-prod-github-runner-207 kernel: [52672.579785] ? watchdog_timer_fn+0x1be/0x220 Aug 22 20:01:38 juju-e4d256-prod-github-runner-207 kernel: [52672.580811] ? lockup_detector_update_enable+0x60/0x60 Aug 22 20:01:38 juju-e4d256-prod-github-runner-207 kernel: [52672.581884] ? __hrtimer_run_queues+0x107/0x230 Aug 22 20:01:38 juju-e4d256-prod-github-runner-207 kernel: [52672.582927] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 20:01:38 juju-e4d256-prod-github-runner-207 kernel: [52672.583956] ? hrtimer_interrupt+0x101/0x220 Aug 22 20:01:38 juju-e4d256-prod-github-runner-207 kernel: [52672.584983] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 20:01:38 juju-e4d256-prod-github-runner-207 kernel: [52672.586058] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 20:01:38 juju-e4d256-prod-github-runner-207 kernel: [52672.587103] Aug 22 20:01:38 juju-e4d256-prod-github-runner-207 kernel: [52672.587955] Aug 22 20:01:38 juju-e4d256-prod-github-runner-207 kernel: [52672.588806] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 20:01:38 juju-e4d256-prod-github-runner-207 kernel: [52672.589841] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:01:38 juju-e4d256-prod-github-runner-207 kernel: [52672.590880] ? _raw_spin_lock+0x22/0x30 Aug 22 20:01:38 juju-e4d256-prod-github-runner-207 kernel: [52672.591829] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:01:38 juju-e4d256-prod-github-runner-207 kernel: [52672.592856] direct_page_fault+0x206/0x310 [kvm] Aug 22 20:01:38 juju-e4d256-prod-github-runner-207 kernel: [52672.593882] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 20:01:38 juju-e4d256-prod-github-runner-207 kernel: [52672.594891] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 20:01:38 juju-e4d256-prod-github-runner-207 kernel: [52672.596066] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 20:01:38 juju-e4d256-prod-github-runner-207 kernel: [52672.597391] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 20:01:38 juju-e4d256-prod-github-runner-207 kernel: [52672.598343] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 20:01:38 juju-e4d256-prod-github-runner-207 kernel: [52672.599321] handle_exit+0x98/0x230 [kvm_amd] Aug 22 20:01:38 juju-e4d256-prod-github-runner-207 kernel: [52672.600213] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 20:01:38 juju-e4d256-prod-github-runner-207 kernel: [52672.601141] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 20:01:38 juju-e4d256-prod-github-runner-207 kernel: [52672.602070] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 20:01:38 juju-e4d256-prod-github-runner-207 kernel: [52672.602974] vcpu_run+0x62/0x2c0 [kvm] Aug 22 20:01:38 juju-e4d256-prod-github-runner-207 kernel: [52672.603784] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 20:01:38 juju-e4d256-prod-github-runner-207 kernel: [52672.604613] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 20:01:38 juju-e4d256-prod-github-runner-207 kernel: [52672.605469] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 20:01:38 juju-e4d256-prod-github-runner-207 kernel: [52672.606266] ? __seccomp_filter+0x4a/0x4a0 Aug 22 20:01:38 juju-e4d256-prod-github-runner-207 kernel: [52672.607013] ? __fget_files+0x86/0xc0 Aug 22 20:01:38 juju-e4d256-prod-github-runner-207 kernel: [52672.607721] __x64_sys_ioctl+0x95/0xd0 Aug 22 20:01:38 juju-e4d256-prod-github-runner-207 kernel: [52672.608413] do_syscall_64+0x5c/0xc0 Aug 22 20:01:38 juju-e4d256-prod-github-runner-207 kernel: [52672.609091] ? do_futex+0x162/0x1f0 Aug 22 20:01:38 juju-e4d256-prod-github-runner-207 kernel: [52672.609741] ? __x64_sys_futex+0x78/0x1e0 Aug 22 20:01:38 juju-e4d256-prod-github-runner-207 kernel: [52672.610420] ? __secure_computing+0xa9/0x120 Aug 22 20:01:38 juju-e4d256-prod-github-runner-207 kernel: [52672.611112] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 20:01:38 juju-e4d256-prod-github-runner-207 kernel: [52672.611873] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:01:38 juju-e4d256-prod-github-runner-207 kernel: [52672.612609] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:01:38 juju-e4d256-prod-github-runner-207 kernel: [52672.613335] ? do_syscall_64+0x69/0xc0 Aug 22 20:01:38 juju-e4d256-prod-github-runner-207 kernel: [52672.613981] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:01:38 juju-e4d256-prod-github-runner-207 kernel: [52672.614686] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:01:38 juju-e4d256-prod-github-runner-207 kernel: [52672.615381] ? do_syscall_64+0x69/0xc0 Aug 22 20:01:38 juju-e4d256-prod-github-runner-207 kernel: [52672.616006] ? do_syscall_64+0x69/0xc0 Aug 22 20:01:38 juju-e4d256-prod-github-runner-207 kernel: [52672.616639] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 20:01:38 juju-e4d256-prod-github-runner-207 kernel: [52672.617354] RIP: 0033:0x7faa5d0edaff Aug 22 20:01:38 juju-e4d256-prod-github-runner-207 kernel: [52672.618002] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 20:01:38 juju-e4d256-prod-github-runner-207 kernel: [52672.619995] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 20:01:38 juju-e4d256-prod-github-runner-207 kernel: [52672.620919] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 20:01:38 juju-e4d256-prod-github-runner-207 kernel: [52672.621827] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 20:01:38 juju-e4d256-prod-github-runner-207 kernel: [52672.622715] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 20:01:38 juju-e4d256-prod-github-runner-207 kernel: [52672.623599] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 20:01:38 juju-e4d256-prod-github-runner-207 kernel: [52672.624498] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 20:01:38 juju-e4d256-prod-github-runner-207 kernel: [52672.625393] Aug 22 20:02:06 juju-e4d256-prod-github-runner-207 kernel: [52700.541976] watchdog: BUG: soft lockup - CPU#1 stuck for 48973s! [qemu-system-x86:6715] Aug 22 20:02:06 juju-e4d256-prod-github-runner-207 kernel: [52700.543088] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 20:02:06 juju-e4d256-prod-github-runner-207 kernel: [52700.543154] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 20:02:06 juju-e4d256-prod-github-runner-207 kernel: [52700.555288] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 20:02:06 juju-e4d256-prod-github-runner-207 kernel: [52700.556571] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 20:02:06 juju-e4d256-prod-github-runner-207 kernel: [52700.557788] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:02:06 juju-e4d256-prod-github-runner-207 kernel: [52700.558845] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 20:02:06 juju-e4d256-prod-github-runner-207 kernel: [52700.563126] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 20:02:06 juju-e4d256-prod-github-runner-207 kernel: [52700.564380] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 20:02:06 juju-e4d256-prod-github-runner-207 kernel: [52700.565562] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 20:02:06 juju-e4d256-prod-github-runner-207 kernel: [52700.566734] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 20:02:06 juju-e4d256-prod-github-runner-207 kernel: [52700.567892] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 20:02:06 juju-e4d256-prod-github-runner-207 kernel: [52700.569070] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 20:02:06 juju-e4d256-prod-github-runner-207 kernel: [52700.570233] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 20:02:06 juju-e4d256-prod-github-runner-207 kernel: [52700.571464] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 20:02:06 juju-e4d256-prod-github-runner-207 kernel: [52700.572582] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 20:02:06 juju-e4d256-prod-github-runner-207 kernel: [52700.573772] Call Trace: Aug 22 20:02:06 juju-e4d256-prod-github-runner-207 kernel: [52700.574684] Aug 22 20:02:06 juju-e4d256-prod-github-runner-207 kernel: [52700.575568] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:02:06 juju-e4d256-prod-github-runner-207 kernel: [52700.576611] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:02:06 juju-e4d256-prod-github-runner-207 kernel: [52700.577632] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:02:06 juju-e4d256-prod-github-runner-207 kernel: [52700.578705] ? show_regs.part.0+0x23/0x29 Aug 22 20:02:06 juju-e4d256-prod-github-runner-207 kernel: [52700.579766] ? show_regs.cold+0x8/0xd Aug 22 20:02:06 juju-e4d256-prod-github-runner-207 kernel: [52700.580762] ? watchdog_timer_fn+0x1be/0x220 Aug 22 20:02:06 juju-e4d256-prod-github-runner-207 kernel: [52700.581778] ? lockup_detector_update_enable+0x60/0x60 Aug 22 20:02:06 juju-e4d256-prod-github-runner-207 kernel: [52700.582841] ? __hrtimer_run_queues+0x107/0x230 Aug 22 20:02:06 juju-e4d256-prod-github-runner-207 kernel: [52700.583869] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 20:02:06 juju-e4d256-prod-github-runner-207 kernel: [52700.584907] ? hrtimer_interrupt+0x101/0x220 Aug 22 20:02:06 juju-e4d256-prod-github-runner-207 kernel: [52700.585928] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 20:02:06 juju-e4d256-prod-github-runner-207 kernel: [52700.586998] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 20:02:06 juju-e4d256-prod-github-runner-207 kernel: [52700.588048] Aug 22 20:02:06 juju-e4d256-prod-github-runner-207 kernel: [52700.588936] Aug 22 20:02:06 juju-e4d256-prod-github-runner-207 kernel: [52700.589778] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 20:02:06 juju-e4d256-prod-github-runner-207 kernel: [52700.590856] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:02:06 juju-e4d256-prod-github-runner-207 kernel: [52700.591912] ? _raw_spin_lock+0x22/0x30 Aug 22 20:02:06 juju-e4d256-prod-github-runner-207 kernel: [52700.592896] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:02:06 juju-e4d256-prod-github-runner-207 kernel: [52700.593923] direct_page_fault+0x206/0x310 [kvm] Aug 22 20:02:06 juju-e4d256-prod-github-runner-207 kernel: [52700.594952] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 20:02:06 juju-e4d256-prod-github-runner-207 kernel: [52700.595962] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 20:02:06 juju-e4d256-prod-github-runner-207 kernel: [52700.596995] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 20:02:06 juju-e4d256-prod-github-runner-207 kernel: [52700.597967] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 20:02:06 juju-e4d256-prod-github-runner-207 kernel: [52700.598910] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 20:02:06 juju-e4d256-prod-github-runner-207 kernel: [52700.599886] handle_exit+0x98/0x230 [kvm_amd] Aug 22 20:02:06 juju-e4d256-prod-github-runner-207 kernel: [52700.600793] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 20:02:06 juju-e4d256-prod-github-runner-207 kernel: [52700.601712] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 20:02:06 juju-e4d256-prod-github-runner-207 kernel: [52700.602638] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 20:02:06 juju-e4d256-prod-github-runner-207 kernel: [52700.603570] vcpu_run+0x62/0x2c0 [kvm] Aug 22 20:02:06 juju-e4d256-prod-github-runner-207 kernel: [52700.604514] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 20:02:06 juju-e4d256-prod-github-runner-207 kernel: [52700.605374] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 20:02:06 juju-e4d256-prod-github-runner-207 kernel: [52700.606265] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 20:02:06 juju-e4d256-prod-github-runner-207 kernel: [52700.607113] ? __seccomp_filter+0x4a/0x4a0 Aug 22 20:02:06 juju-e4d256-prod-github-runner-207 kernel: [52700.607861] ? __fget_files+0x86/0xc0 Aug 22 20:02:06 juju-e4d256-prod-github-runner-207 kernel: [52700.608585] __x64_sys_ioctl+0x95/0xd0 Aug 22 20:02:06 juju-e4d256-prod-github-runner-207 kernel: [52700.609279] do_syscall_64+0x5c/0xc0 Aug 22 20:02:06 juju-e4d256-prod-github-runner-207 kernel: [52700.609945] ? do_futex+0x162/0x1f0 Aug 22 20:02:06 juju-e4d256-prod-github-runner-207 kernel: [52700.610600] ? __x64_sys_futex+0x78/0x1e0 Aug 22 20:02:06 juju-e4d256-prod-github-runner-207 kernel: [52700.611274] ? __secure_computing+0xa9/0x120 Aug 22 20:02:06 juju-e4d256-prod-github-runner-207 kernel: [52700.611968] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 20:02:06 juju-e4d256-prod-github-runner-207 kernel: [52700.612751] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:02:06 juju-e4d256-prod-github-runner-207 kernel: [52700.613478] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:02:06 juju-e4d256-prod-github-runner-207 kernel: [52700.614196] ? do_syscall_64+0x69/0xc0 Aug 22 20:02:06 juju-e4d256-prod-github-runner-207 kernel: [52700.614842] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:02:06 juju-e4d256-prod-github-runner-207 kernel: [52700.615550] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:02:06 juju-e4d256-prod-github-runner-207 kernel: [52700.616256] ? do_syscall_64+0x69/0xc0 Aug 22 20:02:06 juju-e4d256-prod-github-runner-207 kernel: [52700.616888] ? do_syscall_64+0x69/0xc0 Aug 22 20:02:06 juju-e4d256-prod-github-runner-207 kernel: [52700.617510] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 20:02:06 juju-e4d256-prod-github-runner-207 kernel: [52700.618218] RIP: 0033:0x7faa5d0edaff Aug 22 20:02:06 juju-e4d256-prod-github-runner-207 kernel: [52700.618842] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 20:02:06 juju-e4d256-prod-github-runner-207 kernel: [52700.620860] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 20:02:06 juju-e4d256-prod-github-runner-207 kernel: [52700.621782] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 20:02:06 juju-e4d256-prod-github-runner-207 kernel: [52700.622678] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 20:02:06 juju-e4d256-prod-github-runner-207 kernel: [52700.623568] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 20:02:06 juju-e4d256-prod-github-runner-207 kernel: [52700.624482] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 20:02:06 juju-e4d256-prod-github-runner-207 kernel: [52700.625403] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 20:02:06 juju-e4d256-prod-github-runner-207 kernel: [52700.626303] Aug 22 20:02:34 juju-e4d256-prod-github-runner-207 kernel: [52728.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 48999s! [qemu-system-x86:6715] Aug 22 20:02:34 juju-e4d256-prod-github-runner-207 kernel: [52728.543081] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 20:02:34 juju-e4d256-prod-github-runner-207 kernel: [52728.543145] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 20:02:34 juju-e4d256-prod-github-runner-207 kernel: [52728.555476] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 20:02:34 juju-e4d256-prod-github-runner-207 kernel: [52728.556782] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 20:02:34 juju-e4d256-prod-github-runner-207 kernel: [52728.558004] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:02:34 juju-e4d256-prod-github-runner-207 kernel: [52728.559061] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 20:02:34 juju-e4d256-prod-github-runner-207 kernel: [52728.561645] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 20:02:34 juju-e4d256-prod-github-runner-207 kernel: [52728.562702] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 20:02:34 juju-e4d256-prod-github-runner-207 kernel: [52728.563874] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 20:02:34 juju-e4d256-prod-github-runner-207 kernel: [52728.565033] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 20:02:34 juju-e4d256-prod-github-runner-207 kernel: [52728.566196] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 20:02:34 juju-e4d256-prod-github-runner-207 kernel: [52728.567356] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 20:02:34 juju-e4d256-prod-github-runner-207 kernel: [52728.568534] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 20:02:34 juju-e4d256-prod-github-runner-207 kernel: [52728.569773] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 20:02:34 juju-e4d256-prod-github-runner-207 kernel: [52728.570870] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 20:02:34 juju-e4d256-prod-github-runner-207 kernel: [52728.572078] Call Trace: Aug 22 20:02:34 juju-e4d256-prod-github-runner-207 kernel: [52728.572989] Aug 22 20:02:34 juju-e4d256-prod-github-runner-207 kernel: [52728.573871] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:02:34 juju-e4d256-prod-github-runner-207 kernel: [52728.574931] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:02:34 juju-e4d256-prod-github-runner-207 kernel: [52728.575985] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:02:34 juju-e4d256-prod-github-runner-207 kernel: [52728.577075] ? show_regs.part.0+0x23/0x29 Aug 22 20:02:34 juju-e4d256-prod-github-runner-207 kernel: [52728.578075] ? show_regs.cold+0x8/0xd Aug 22 20:02:34 juju-e4d256-prod-github-runner-207 kernel: [52728.579045] ? watchdog_timer_fn+0x1be/0x220 Aug 22 20:02:34 juju-e4d256-prod-github-runner-207 kernel: [52728.580063] ? lockup_detector_update_enable+0x60/0x60 Aug 22 20:02:34 juju-e4d256-prod-github-runner-207 kernel: [52728.581122] ? __hrtimer_run_queues+0x107/0x230 Aug 22 20:02:34 juju-e4d256-prod-github-runner-207 kernel: [52728.582145] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 20:02:34 juju-e4d256-prod-github-runner-207 kernel: [52728.583171] ? hrtimer_interrupt+0x101/0x220 Aug 22 20:02:34 juju-e4d256-prod-github-runner-207 kernel: [52728.584193] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 20:02:34 juju-e4d256-prod-github-runner-207 kernel: [52728.585271] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 20:02:34 juju-e4d256-prod-github-runner-207 kernel: [52728.586314] Aug 22 20:02:34 juju-e4d256-prod-github-runner-207 kernel: [52728.587165] Aug 22 20:02:34 juju-e4d256-prod-github-runner-207 kernel: [52728.588034] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 20:02:34 juju-e4d256-prod-github-runner-207 kernel: [52728.589065] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:02:34 juju-e4d256-prod-github-runner-207 kernel: [52728.590100] ? _raw_spin_lock+0x22/0x30 Aug 22 20:02:34 juju-e4d256-prod-github-runner-207 kernel: [52728.591048] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:02:34 juju-e4d256-prod-github-runner-207 kernel: [52728.592074] direct_page_fault+0x206/0x310 [kvm] Aug 22 20:02:34 juju-e4d256-prod-github-runner-207 kernel: [52728.593098] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 20:02:34 juju-e4d256-prod-github-runner-207 kernel: [52728.594111] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 20:02:34 juju-e4d256-prod-github-runner-207 kernel: [52728.595112] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 20:02:34 juju-e4d256-prod-github-runner-207 kernel: [52728.596094] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 20:02:34 juju-e4d256-prod-github-runner-207 kernel: [52728.597039] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 20:02:34 juju-e4d256-prod-github-runner-207 kernel: [52728.598021] handle_exit+0x98/0x230 [kvm_amd] Aug 22 20:02:34 juju-e4d256-prod-github-runner-207 kernel: [52728.598912] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 20:02:34 juju-e4d256-prod-github-runner-207 kernel: [52728.599835] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 20:02:34 juju-e4d256-prod-github-runner-207 kernel: [52728.600764] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 20:02:34 juju-e4d256-prod-github-runner-207 kernel: [52728.601665] vcpu_run+0x62/0x2c0 [kvm] Aug 22 20:02:34 juju-e4d256-prod-github-runner-207 kernel: [52728.602475] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 20:02:34 juju-e4d256-prod-github-runner-207 kernel: [52728.603286] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 20:02:34 juju-e4d256-prod-github-runner-207 kernel: [52728.604159] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 20:02:34 juju-e4d256-prod-github-runner-207 kernel: [52728.604973] ? __seccomp_filter+0x4a/0x4a0 Aug 22 20:02:34 juju-e4d256-prod-github-runner-207 kernel: [52728.605714] ? __fget_files+0x86/0xc0 Aug 22 20:02:34 juju-e4d256-prod-github-runner-207 kernel: [52728.606416] __x64_sys_ioctl+0x95/0xd0 Aug 22 20:02:34 juju-e4d256-prod-github-runner-207 kernel: [52728.607105] do_syscall_64+0x5c/0xc0 Aug 22 20:02:34 juju-e4d256-prod-github-runner-207 kernel: [52728.607781] ? do_futex+0x162/0x1f0 Aug 22 20:02:34 juju-e4d256-prod-github-runner-207 kernel: [52728.608427] ? __x64_sys_futex+0x78/0x1e0 Aug 22 20:02:34 juju-e4d256-prod-github-runner-207 kernel: [52728.609102] ? __secure_computing+0xa9/0x120 Aug 22 20:02:34 juju-e4d256-prod-github-runner-207 kernel: [52728.609795] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 20:02:34 juju-e4d256-prod-github-runner-207 kernel: [52728.610551] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:02:34 juju-e4d256-prod-github-runner-207 kernel: [52728.611271] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:02:34 juju-e4d256-prod-github-runner-207 kernel: [52728.612029] ? do_syscall_64+0x69/0xc0 Aug 22 20:02:34 juju-e4d256-prod-github-runner-207 kernel: [52728.612689] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:02:34 juju-e4d256-prod-github-runner-207 kernel: [52728.613391] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:02:34 juju-e4d256-prod-github-runner-207 kernel: [52728.614086] ? do_syscall_64+0x69/0xc0 Aug 22 20:02:34 juju-e4d256-prod-github-runner-207 kernel: [52728.614711] ? do_syscall_64+0x69/0xc0 Aug 22 20:02:34 juju-e4d256-prod-github-runner-207 kernel: [52728.615332] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 20:02:34 juju-e4d256-prod-github-runner-207 kernel: [52728.616044] RIP: 0033:0x7faa5d0edaff Aug 22 20:02:34 juju-e4d256-prod-github-runner-207 kernel: [52728.616668] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 20:02:34 juju-e4d256-prod-github-runner-207 kernel: [52728.618641] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 20:02:34 juju-e4d256-prod-github-runner-207 kernel: [52728.619549] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 20:02:34 juju-e4d256-prod-github-runner-207 kernel: [52728.620453] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 20:02:34 juju-e4d256-prod-github-runner-207 kernel: [52728.621342] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 20:02:34 juju-e4d256-prod-github-runner-207 kernel: [52728.622227] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 20:02:34 juju-e4d256-prod-github-runner-207 kernel: [52728.623117] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 20:02:34 juju-e4d256-prod-github-runner-207 kernel: [52728.624017] Aug 22 20:02:46 juju-e4d256-prod-github-runner-207 kernel: [52740.704706] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 20:02:46 juju-e4d256-prod-github-runner-207 kernel: [52740.705692] rcu: 1-....: (13114436 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=6339735 Aug 22 20:02:46 juju-e4d256-prod-github-runner-207 kernel: [52740.706963] (t=13155876 jiffies g=23269 q=49316) Aug 22 20:02:46 juju-e4d256-prod-github-runner-207 kernel: [52740.707849] NMI backtrace for cpu 1 Aug 22 20:02:46 juju-e4d256-prod-github-runner-207 kernel: [52740.708615] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 20:02:46 juju-e4d256-prod-github-runner-207 kernel: [52740.709737] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 20:02:46 juju-e4d256-prod-github-runner-207 kernel: [52740.710789] Call Trace: Aug 22 20:02:46 juju-e4d256-prod-github-runner-207 kernel: [52740.711461] Aug 22 20:02:46 juju-e4d256-prod-github-runner-207 kernel: [52740.712124] show_stack+0x52/0x5c Aug 22 20:02:46 juju-e4d256-prod-github-runner-207 kernel: [52740.712852] dump_stack_lvl+0x4a/0x63 Aug 22 20:02:46 juju-e4d256-prod-github-runner-207 kernel: [52740.713598] dump_stack+0x10/0x16 Aug 22 20:02:46 juju-e4d256-prod-github-runner-207 kernel: [52740.714315] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 20:02:46 juju-e4d256-prod-github-runner-207 kernel: [52740.715094] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 20:02:46 juju-e4d256-prod-github-runner-207 kernel: [52740.715885] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 20:02:46 juju-e4d256-prod-github-runner-207 kernel: [52740.716706] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 20:02:46 juju-e4d256-prod-github-runner-207 kernel: [52740.717528] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 20:02:46 juju-e4d256-prod-github-runner-207 kernel: [52740.718338] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 20:02:46 juju-e4d256-prod-github-runner-207 kernel: [52740.719110] print_cpu_stall.cold+0x2f/0xe2 Aug 22 20:02:46 juju-e4d256-prod-github-runner-207 kernel: [52740.719893] ? timekeeping_update+0xf7/0x150 Aug 22 20:02:46 juju-e4d256-prod-github-runner-207 kernel: [52740.720663] check_cpu_stall+0x109/0x270 Aug 22 20:02:46 juju-e4d256-prod-github-runner-207 kernel: [52740.721417] rcu_sched_clock_irq+0x9a/0x250 Aug 22 20:02:46 juju-e4d256-prod-github-runner-207 kernel: [52740.722187] update_process_times+0x94/0xd0 Aug 22 20:02:46 juju-e4d256-prod-github-runner-207 kernel: [52740.722946] tick_sched_handle+0x29/0x70 Aug 22 20:02:46 juju-e4d256-prod-github-runner-207 kernel: [52740.723712] tick_sched_timer+0x8c/0xc0 Aug 22 20:02:46 juju-e4d256-prod-github-runner-207 kernel: [52740.724453] ? tick_nohz_handler+0xb0/0xb0 Aug 22 20:02:46 juju-e4d256-prod-github-runner-207 kernel: [52740.725208] __hrtimer_run_queues+0x107/0x230 Aug 22 20:02:46 juju-e4d256-prod-github-runner-207 kernel: [52740.725995] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 20:02:46 juju-e4d256-prod-github-runner-207 kernel: [52740.726785] hrtimer_interrupt+0x101/0x220 Aug 22 20:02:46 juju-e4d256-prod-github-runner-207 kernel: [52740.727554] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 20:02:46 juju-e4d256-prod-github-runner-207 kernel: [52740.728378] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 20:02:46 juju-e4d256-prod-github-runner-207 kernel: [52740.729179] Aug 22 20:02:46 juju-e4d256-prod-github-runner-207 kernel: [52740.729813] Aug 22 20:02:46 juju-e4d256-prod-github-runner-207 kernel: [52740.730445] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 20:02:46 juju-e4d256-prod-github-runner-207 kernel: [52740.731267] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:02:46 juju-e4d256-prod-github-runner-207 kernel: [52740.732151] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 20:02:46 juju-e4d256-prod-github-runner-207 kernel: [52740.734611] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 20:02:46 juju-e4d256-prod-github-runner-207 kernel: [52740.735524] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 20:02:46 juju-e4d256-prod-github-runner-207 kernel: [52740.736527] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 20:02:46 juju-e4d256-prod-github-runner-207 kernel: [52740.737507] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 20:02:46 juju-e4d256-prod-github-runner-207 kernel: [52740.738486] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 20:02:46 juju-e4d256-prod-github-runner-207 kernel: [52740.739462] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 20:02:46 juju-e4d256-prod-github-runner-207 kernel: [52740.740438] ? _raw_spin_lock+0x22/0x30 Aug 22 20:02:46 juju-e4d256-prod-github-runner-207 kernel: [52740.741201] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:02:46 juju-e4d256-prod-github-runner-207 kernel: [52740.742037] direct_page_fault+0x206/0x310 [kvm] Aug 22 20:02:46 juju-e4d256-prod-github-runner-207 kernel: [52740.742874] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 20:02:46 juju-e4d256-prod-github-runner-207 kernel: [52740.743725] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 20:02:46 juju-e4d256-prod-github-runner-207 kernel: [52740.744551] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 20:02:46 juju-e4d256-prod-github-runner-207 kernel: [52740.745371] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 20:02:46 juju-e4d256-prod-github-runner-207 kernel: [52740.746157] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 20:02:46 juju-e4d256-prod-github-runner-207 kernel: [52740.746994] handle_exit+0x98/0x230 [kvm_amd] Aug 22 20:02:46 juju-e4d256-prod-github-runner-207 kernel: [52740.747781] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 20:02:46 juju-e4d256-prod-github-runner-207 kernel: [52740.748613] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 20:02:46 juju-e4d256-prod-github-runner-207 kernel: [52740.749421] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 20:02:46 juju-e4d256-prod-github-runner-207 kernel: [52740.750207] vcpu_run+0x62/0x2c0 [kvm] Aug 22 20:02:46 juju-e4d256-prod-github-runner-207 kernel: [52740.750923] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 20:02:46 juju-e4d256-prod-github-runner-207 kernel: [52740.751672] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 20:02:46 juju-e4d256-prod-github-runner-207 kernel: [52740.752476] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 20:02:46 juju-e4d256-prod-github-runner-207 kernel: [52740.753243] ? __seccomp_filter+0x4a/0x4a0 Aug 22 20:02:46 juju-e4d256-prod-github-runner-207 kernel: [52740.753970] ? __fget_files+0x86/0xc0 Aug 22 20:02:46 juju-e4d256-prod-github-runner-207 kernel: [52740.754664] __x64_sys_ioctl+0x95/0xd0 Aug 22 20:02:46 juju-e4d256-prod-github-runner-207 kernel: [52740.755360] do_syscall_64+0x5c/0xc0 Aug 22 20:02:46 juju-e4d256-prod-github-runner-207 kernel: [52740.756056] ? do_futex+0x162/0x1f0 Aug 22 20:02:46 juju-e4d256-prod-github-runner-207 kernel: [52740.756727] ? __x64_sys_futex+0x78/0x1e0 Aug 22 20:02:46 juju-e4d256-prod-github-runner-207 kernel: [52740.757428] ? __secure_computing+0xa9/0x120 Aug 22 20:02:46 juju-e4d256-prod-github-runner-207 kernel: [52740.758143] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 20:02:46 juju-e4d256-prod-github-runner-207 kernel: [52740.758947] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:02:46 juju-e4d256-prod-github-runner-207 kernel: [52740.759739] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:02:46 juju-e4d256-prod-github-runner-207 kernel: [52740.760500] ? do_syscall_64+0x69/0xc0 Aug 22 20:02:46 juju-e4d256-prod-github-runner-207 kernel: [52740.761198] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:02:46 juju-e4d256-prod-github-runner-207 kernel: [52740.761958] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:02:46 juju-e4d256-prod-github-runner-207 kernel: [52740.762760] ? do_syscall_64+0x69/0xc0 Aug 22 20:02:46 juju-e4d256-prod-github-runner-207 kernel: [52740.763460] ? do_syscall_64+0x69/0xc0 Aug 22 20:02:46 juju-e4d256-prod-github-runner-207 kernel: [52740.764163] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 20:02:46 juju-e4d256-prod-github-runner-207 kernel: [52740.764936] RIP: 0033:0x7faa5d0edaff Aug 22 20:02:46 juju-e4d256-prod-github-runner-207 kernel: [52740.765631] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 20:02:46 juju-e4d256-prod-github-runner-207 kernel: [52740.767747] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 20:02:46 juju-e4d256-prod-github-runner-207 kernel: [52740.768714] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 20:02:46 juju-e4d256-prod-github-runner-207 kernel: [52740.769660] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 20:02:46 juju-e4d256-prod-github-runner-207 kernel: [52740.770637] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 20:02:46 juju-e4d256-prod-github-runner-207 kernel: [52740.771593] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 20:02:46 juju-e4d256-prod-github-runner-207 kernel: [52740.772522] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 20:02:46 juju-e4d256-prod-github-runner-207 kernel: [52740.773434] Aug 22 20:03:14 juju-e4d256-prod-github-runner-207 kernel: [52768.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 49036s! [qemu-system-x86:6715] Aug 22 20:03:14 juju-e4d256-prod-github-runner-207 kernel: [52768.544217] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 20:03:14 juju-e4d256-prod-github-runner-207 kernel: [52768.544506] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 20:03:14 juju-e4d256-prod-github-runner-207 kernel: [52768.556670] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 20:03:14 juju-e4d256-prod-github-runner-207 kernel: [52768.558127] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 20:03:14 juju-e4d256-prod-github-runner-207 kernel: [52768.559545] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:03:14 juju-e4d256-prod-github-runner-207 kernel: [52768.560720] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 20:03:14 juju-e4d256-prod-github-runner-207 kernel: [52768.563640] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 20:03:14 juju-e4d256-prod-github-runner-207 kernel: [52768.564795] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 20:03:14 juju-e4d256-prod-github-runner-207 kernel: [52768.566106] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 20:03:14 juju-e4d256-prod-github-runner-207 kernel: [52768.567415] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 20:03:14 juju-e4d256-prod-github-runner-207 kernel: [52768.568712] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 20:03:14 juju-e4d256-prod-github-runner-207 kernel: [52768.570021] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 20:03:14 juju-e4d256-prod-github-runner-207 kernel: [52768.571355] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 20:03:14 juju-e4d256-prod-github-runner-207 kernel: [52768.572740] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 20:03:14 juju-e4d256-prod-github-runner-207 kernel: [52768.573952] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 20:03:14 juju-e4d256-prod-github-runner-207 kernel: [52768.575304] Call Trace: Aug 22 20:03:14 juju-e4d256-prod-github-runner-207 kernel: [52768.576277] Aug 22 20:03:14 juju-e4d256-prod-github-runner-207 kernel: [52768.577228] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:03:14 juju-e4d256-prod-github-runner-207 kernel: [52768.578352] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:03:14 juju-e4d256-prod-github-runner-207 kernel: [52768.579488] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:03:14 juju-e4d256-prod-github-runner-207 kernel: [52768.580678] ? show_regs.part.0+0x23/0x29 Aug 22 20:03:14 juju-e4d256-prod-github-runner-207 kernel: [52768.581759] ? show_regs.cold+0x8/0xd Aug 22 20:03:14 juju-e4d256-prod-github-runner-207 kernel: [52768.582817] ? watchdog_timer_fn+0x1be/0x220 Aug 22 20:03:14 juju-e4d256-prod-github-runner-207 kernel: [52768.583928] ? lockup_detector_update_enable+0x60/0x60 Aug 22 20:03:14 juju-e4d256-prod-github-runner-207 kernel: [52768.585108] ? __hrtimer_run_queues+0x107/0x230 Aug 22 20:03:14 juju-e4d256-prod-github-runner-207 kernel: [52768.586229] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 20:03:14 juju-e4d256-prod-github-runner-207 kernel: [52768.587355] ? hrtimer_interrupt+0x101/0x220 Aug 22 20:03:14 juju-e4d256-prod-github-runner-207 kernel: [52768.588464] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 20:03:14 juju-e4d256-prod-github-runner-207 kernel: [52768.589654] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 20:03:14 juju-e4d256-prod-github-runner-207 kernel: [52768.590798] Aug 22 20:03:14 juju-e4d256-prod-github-runner-207 kernel: [52768.591734] Aug 22 20:03:14 juju-e4d256-prod-github-runner-207 kernel: [52768.592627] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 20:03:14 juju-e4d256-prod-github-runner-207 kernel: [52768.593766] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:03:14 juju-e4d256-prod-github-runner-207 kernel: [52768.594916] ? _raw_spin_lock+0x22/0x30 Aug 22 20:03:14 juju-e4d256-prod-github-runner-207 kernel: [52768.595980] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:03:14 juju-e4d256-prod-github-runner-207 kernel: [52768.597093] direct_page_fault+0x206/0x310 [kvm] Aug 22 20:03:14 juju-e4d256-prod-github-runner-207 kernel: [52768.598216] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 20:03:14 juju-e4d256-prod-github-runner-207 kernel: [52768.599346] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 20:03:14 juju-e4d256-prod-github-runner-207 kernel: [52768.600459] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 20:03:14 juju-e4d256-prod-github-runner-207 kernel: [52768.601569] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 20:03:14 juju-e4d256-prod-github-runner-207 kernel: [52768.602620] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 20:03:14 juju-e4d256-prod-github-runner-207 kernel: [52768.603734] handle_exit+0x98/0x230 [kvm_amd] Aug 22 20:03:14 juju-e4d256-prod-github-runner-207 kernel: [52768.604721] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 20:03:14 juju-e4d256-prod-github-runner-207 kernel: [52768.605725] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 20:03:14 juju-e4d256-prod-github-runner-207 kernel: [52768.606754] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 20:03:14 juju-e4d256-prod-github-runner-207 kernel: [52768.607771] vcpu_run+0x62/0x2c0 [kvm] Aug 22 20:03:14 juju-e4d256-prod-github-runner-207 kernel: [52768.608696] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 20:03:14 juju-e4d256-prod-github-runner-207 kernel: [52768.609599] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 20:03:14 juju-e4d256-prod-github-runner-207 kernel: [52768.610556] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 20:03:14 juju-e4d256-prod-github-runner-207 kernel: [52768.611463] ? __seccomp_filter+0x4a/0x4a0 Aug 22 20:03:14 juju-e4d256-prod-github-runner-207 kernel: [52768.612294] ? __fget_files+0x86/0xc0 Aug 22 20:03:14 juju-e4d256-prod-github-runner-207 kernel: [52768.613071] __x64_sys_ioctl+0x95/0xd0 Aug 22 20:03:14 juju-e4d256-prod-github-runner-207 kernel: [52768.613837] do_syscall_64+0x5c/0xc0 Aug 22 20:03:14 juju-e4d256-prod-github-runner-207 kernel: [52768.614586] ? do_futex+0x162/0x1f0 Aug 22 20:03:14 juju-e4d256-prod-github-runner-207 kernel: [52768.615341] ? __x64_sys_futex+0x78/0x1e0 Aug 22 20:03:14 juju-e4d256-prod-github-runner-207 kernel: [52768.616102] ? __secure_computing+0xa9/0x120 Aug 22 20:03:14 juju-e4d256-prod-github-runner-207 kernel: [52768.616877] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 20:03:14 juju-e4d256-prod-github-runner-207 kernel: [52768.617743] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:03:14 juju-e4d256-prod-github-runner-207 kernel: [52768.618564] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:03:14 juju-e4d256-prod-github-runner-207 kernel: [52768.619400] ? do_syscall_64+0x69/0xc0 Aug 22 20:03:14 juju-e4d256-prod-github-runner-207 kernel: [52768.620125] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:03:14 juju-e4d256-prod-github-runner-207 kernel: [52768.620928] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:03:14 juju-e4d256-prod-github-runner-207 kernel: [52768.621729] ? do_syscall_64+0x69/0xc0 Aug 22 20:03:14 juju-e4d256-prod-github-runner-207 kernel: [52768.622434] ? do_syscall_64+0x69/0xc0 Aug 22 20:03:14 juju-e4d256-prod-github-runner-207 kernel: [52768.623131] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 20:03:14 juju-e4d256-prod-github-runner-207 kernel: [52768.623954] RIP: 0033:0x7faa5d0edaff Aug 22 20:03:14 juju-e4d256-prod-github-runner-207 kernel: [52768.624686] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 20:03:14 juju-e4d256-prod-github-runner-207 kernel: [52768.627011] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 20:03:14 juju-e4d256-prod-github-runner-207 kernel: [52768.628094] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 20:03:14 juju-e4d256-prod-github-runner-207 kernel: [52768.629130] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 20:03:14 juju-e4d256-prod-github-runner-207 kernel: [52768.630156] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 20:03:14 juju-e4d256-prod-github-runner-207 kernel: [52768.631181] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 20:03:14 juju-e4d256-prod-github-runner-207 kernel: [52768.632230] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 20:03:14 juju-e4d256-prod-github-runner-207 kernel: [52768.633293] Aug 22 20:03:42 juju-e4d256-prod-github-runner-207 kernel: [52796.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 49062s! [qemu-system-x86:6715] Aug 22 20:03:42 juju-e4d256-prod-github-runner-207 kernel: [52796.543134] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 20:03:42 juju-e4d256-prod-github-runner-207 kernel: [52796.543201] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 20:03:42 juju-e4d256-prod-github-runner-207 kernel: [52796.555373] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 20:03:42 juju-e4d256-prod-github-runner-207 kernel: [52796.556647] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 20:03:42 juju-e4d256-prod-github-runner-207 kernel: [52796.557875] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:03:42 juju-e4d256-prod-github-runner-207 kernel: [52796.558950] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 20:03:42 juju-e4d256-prod-github-runner-207 kernel: [52796.561498] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 20:03:42 juju-e4d256-prod-github-runner-207 kernel: [52796.562549] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 20:03:42 juju-e4d256-prod-github-runner-207 kernel: [52796.563748] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 20:03:42 juju-e4d256-prod-github-runner-207 kernel: [52796.564916] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 20:03:42 juju-e4d256-prod-github-runner-207 kernel: [52796.566078] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 20:03:42 juju-e4d256-prod-github-runner-207 kernel: [52796.567259] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 20:03:42 juju-e4d256-prod-github-runner-207 kernel: [52796.568430] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 20:03:42 juju-e4d256-prod-github-runner-207 kernel: [52796.569663] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 20:03:42 juju-e4d256-prod-github-runner-207 kernel: [52796.570766] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 20:03:42 juju-e4d256-prod-github-runner-207 kernel: [52796.571977] Call Trace: Aug 22 20:03:42 juju-e4d256-prod-github-runner-207 kernel: [52796.572892] Aug 22 20:03:42 juju-e4d256-prod-github-runner-207 kernel: [52796.573782] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:03:42 juju-e4d256-prod-github-runner-207 kernel: [52796.574820] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:03:42 juju-e4d256-prod-github-runner-207 kernel: [52796.575858] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:03:42 juju-e4d256-prod-github-runner-207 kernel: [52796.576935] ? show_regs.part.0+0x23/0x29 Aug 22 20:03:42 juju-e4d256-prod-github-runner-207 kernel: [52796.577947] ? show_regs.cold+0x8/0xd Aug 22 20:03:42 juju-e4d256-prod-github-runner-207 kernel: [52796.578945] ? watchdog_timer_fn+0x1be/0x220 Aug 22 20:03:42 juju-e4d256-prod-github-runner-207 kernel: [52796.579958] ? lockup_detector_update_enable+0x60/0x60 Aug 22 20:03:42 juju-e4d256-prod-github-runner-207 kernel: [52796.581022] ? __hrtimer_run_queues+0x107/0x230 Aug 22 20:03:42 juju-e4d256-prod-github-runner-207 kernel: [52796.582050] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 20:03:42 juju-e4d256-prod-github-runner-207 kernel: [52796.583093] ? hrtimer_interrupt+0x101/0x220 Aug 22 20:03:42 juju-e4d256-prod-github-runner-207 kernel: [52796.584117] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 20:03:42 juju-e4d256-prod-github-runner-207 kernel: [52796.585192] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 20:03:42 juju-e4d256-prod-github-runner-207 kernel: [52796.586243] Aug 22 20:03:42 juju-e4d256-prod-github-runner-207 kernel: [52796.587128] Aug 22 20:03:42 juju-e4d256-prod-github-runner-207 kernel: [52796.587987] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 20:03:42 juju-e4d256-prod-github-runner-207 kernel: [52796.589020] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:03:42 juju-e4d256-prod-github-runner-207 kernel: [52796.590058] ? _raw_spin_lock+0x22/0x30 Aug 22 20:03:42 juju-e4d256-prod-github-runner-207 kernel: [52796.591026] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:03:42 juju-e4d256-prod-github-runner-207 kernel: [52796.592054] direct_page_fault+0x206/0x310 [kvm] Aug 22 20:03:42 juju-e4d256-prod-github-runner-207 kernel: [52796.593229] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 20:03:42 juju-e4d256-prod-github-runner-207 kernel: [52796.594236] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 20:03:42 juju-e4d256-prod-github-runner-207 kernel: [52796.595290] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 20:03:42 juju-e4d256-prod-github-runner-207 kernel: [52796.596263] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 20:03:42 juju-e4d256-prod-github-runner-207 kernel: [52796.597208] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 20:03:42 juju-e4d256-prod-github-runner-207 kernel: [52796.598185] handle_exit+0x98/0x230 [kvm_amd] Aug 22 20:03:42 juju-e4d256-prod-github-runner-207 kernel: [52796.599093] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 20:03:42 juju-e4d256-prod-github-runner-207 kernel: [52796.600017] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 20:03:42 juju-e4d256-prod-github-runner-207 kernel: [52796.600948] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 20:03:42 juju-e4d256-prod-github-runner-207 kernel: [52796.601853] vcpu_run+0x62/0x2c0 [kvm] Aug 22 20:03:42 juju-e4d256-prod-github-runner-207 kernel: [52796.602670] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 20:03:42 juju-e4d256-prod-github-runner-207 kernel: [52796.603501] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 20:03:42 juju-e4d256-prod-github-runner-207 kernel: [52796.604356] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 20:03:42 juju-e4d256-prod-github-runner-207 kernel: [52796.605152] ? __seccomp_filter+0x4a/0x4a0 Aug 22 20:03:42 juju-e4d256-prod-github-runner-207 kernel: [52796.605901] ? __fget_files+0x86/0xc0 Aug 22 20:03:42 juju-e4d256-prod-github-runner-207 kernel: [52796.606619] __x64_sys_ioctl+0x95/0xd0 Aug 22 20:03:42 juju-e4d256-prod-github-runner-207 kernel: [52796.607331] do_syscall_64+0x5c/0xc0 Aug 22 20:03:42 juju-e4d256-prod-github-runner-207 kernel: [52796.608024] ? do_futex+0x162/0x1f0 Aug 22 20:03:42 juju-e4d256-prod-github-runner-207 kernel: [52796.608682] ? __x64_sys_futex+0x78/0x1e0 Aug 22 20:03:42 juju-e4d256-prod-github-runner-207 kernel: [52796.609356] ? __secure_computing+0xa9/0x120 Aug 22 20:03:42 juju-e4d256-prod-github-runner-207 kernel: [52796.610046] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 20:03:42 juju-e4d256-prod-github-runner-207 kernel: [52796.610807] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:03:42 juju-e4d256-prod-github-runner-207 kernel: [52796.611552] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:03:42 juju-e4d256-prod-github-runner-207 kernel: [52796.612270] ? do_syscall_64+0x69/0xc0 Aug 22 20:03:42 juju-e4d256-prod-github-runner-207 kernel: [52796.612916] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:03:42 juju-e4d256-prod-github-runner-207 kernel: [52796.613621] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:03:42 juju-e4d256-prod-github-runner-207 kernel: [52796.614316] ? do_syscall_64+0x69/0xc0 Aug 22 20:03:42 juju-e4d256-prod-github-runner-207 kernel: [52796.614955] ? do_syscall_64+0x69/0xc0 Aug 22 20:03:42 juju-e4d256-prod-github-runner-207 kernel: [52796.615584] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 20:03:42 juju-e4d256-prod-github-runner-207 kernel: [52796.616289] RIP: 0033:0x7faa5d0edaff Aug 22 20:03:42 juju-e4d256-prod-github-runner-207 kernel: [52796.616948] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 20:03:42 juju-e4d256-prod-github-runner-207 kernel: [52796.618959] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 20:03:42 juju-e4d256-prod-github-runner-207 kernel: [52796.619872] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 20:03:42 juju-e4d256-prod-github-runner-207 kernel: [52796.620761] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 20:03:42 juju-e4d256-prod-github-runner-207 kernel: [52796.621655] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 20:03:42 juju-e4d256-prod-github-runner-207 kernel: [52796.622551] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 20:03:42 juju-e4d256-prod-github-runner-207 kernel: [52796.623463] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 20:03:42 juju-e4d256-prod-github-runner-207 kernel: [52796.624366] Aug 22 20:04:10 juju-e4d256-prod-github-runner-207 kernel: [52824.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 49088s! [qemu-system-x86:6715] Aug 22 20:04:10 juju-e4d256-prod-github-runner-207 kernel: [52824.543350] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 20:04:10 juju-e4d256-prod-github-runner-207 kernel: [52824.543418] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 20:04:10 juju-e4d256-prod-github-runner-207 kernel: [52824.556017] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 20:04:10 juju-e4d256-prod-github-runner-207 kernel: [52824.557282] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 20:04:10 juju-e4d256-prod-github-runner-207 kernel: [52824.558519] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:04:10 juju-e4d256-prod-github-runner-207 kernel: [52824.559587] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 20:04:10 juju-e4d256-prod-github-runner-207 kernel: [52824.562529] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 20:04:10 juju-e4d256-prod-github-runner-207 kernel: [52824.563579] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 20:04:10 juju-e4d256-prod-github-runner-207 kernel: [52824.564749] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 20:04:10 juju-e4d256-prod-github-runner-207 kernel: [52824.565910] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 20:04:10 juju-e4d256-prod-github-runner-207 kernel: [52824.567085] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 20:04:10 juju-e4d256-prod-github-runner-207 kernel: [52824.568249] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 20:04:10 juju-e4d256-prod-github-runner-207 kernel: [52824.569417] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 20:04:10 juju-e4d256-prod-github-runner-207 kernel: [52824.570884] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 20:04:10 juju-e4d256-prod-github-runner-207 kernel: [52824.572115] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 20:04:10 juju-e4d256-prod-github-runner-207 kernel: [52824.573478] Call Trace: Aug 22 20:04:10 juju-e4d256-prod-github-runner-207 kernel: [52824.574461] Aug 22 20:04:10 juju-e4d256-prod-github-runner-207 kernel: [52824.575430] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:04:10 juju-e4d256-prod-github-runner-207 kernel: [52824.576570] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:04:10 juju-e4d256-prod-github-runner-207 kernel: [52824.577685] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:04:10 juju-e4d256-prod-github-runner-207 kernel: [52824.578867] ? show_regs.part.0+0x23/0x29 Aug 22 20:04:10 juju-e4d256-prod-github-runner-207 kernel: [52824.579956] ? show_regs.cold+0x8/0xd Aug 22 20:04:10 juju-e4d256-prod-github-runner-207 kernel: [52824.581021] ? watchdog_timer_fn+0x1be/0x220 Aug 22 20:04:10 juju-e4d256-prod-github-runner-207 kernel: [52824.582125] ? lockup_detector_update_enable+0x60/0x60 Aug 22 20:04:10 juju-e4d256-prod-github-runner-207 kernel: [52824.583402] ? __hrtimer_run_queues+0x107/0x230 Aug 22 20:04:10 juju-e4d256-prod-github-runner-207 kernel: [52824.584533] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 20:04:10 juju-e4d256-prod-github-runner-207 kernel: [52824.585723] ? hrtimer_interrupt+0x101/0x220 Aug 22 20:04:10 juju-e4d256-prod-github-runner-207 kernel: [52824.586923] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 20:04:10 juju-e4d256-prod-github-runner-207 kernel: [52824.588037] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 20:04:10 juju-e4d256-prod-github-runner-207 kernel: [52824.589087] Aug 22 20:04:10 juju-e4d256-prod-github-runner-207 kernel: [52824.589948] Aug 22 20:04:10 juju-e4d256-prod-github-runner-207 kernel: [52824.590876] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 20:04:10 juju-e4d256-prod-github-runner-207 kernel: [52824.591920] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:04:10 juju-e4d256-prod-github-runner-207 kernel: [52824.592966] ? _raw_spin_lock+0x22/0x30 Aug 22 20:04:10 juju-e4d256-prod-github-runner-207 kernel: [52824.593914] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:04:10 juju-e4d256-prod-github-runner-207 kernel: [52824.594966] direct_page_fault+0x206/0x310 [kvm] Aug 22 20:04:10 juju-e4d256-prod-github-runner-207 kernel: [52824.596011] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 20:04:10 juju-e4d256-prod-github-runner-207 kernel: [52824.597158] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 20:04:10 juju-e4d256-prod-github-runner-207 kernel: [52824.598188] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 20:04:10 juju-e4d256-prod-github-runner-207 kernel: [52824.599189] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 20:04:10 juju-e4d256-prod-github-runner-207 kernel: [52824.600199] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 20:04:10 juju-e4d256-prod-github-runner-207 kernel: [52824.601283] handle_exit+0x98/0x230 [kvm_amd] Aug 22 20:04:10 juju-e4d256-prod-github-runner-207 kernel: [52824.602236] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 20:04:10 juju-e4d256-prod-github-runner-207 kernel: [52824.603342] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 20:04:10 juju-e4d256-prod-github-runner-207 kernel: [52824.604380] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 20:04:10 juju-e4d256-prod-github-runner-207 kernel: [52824.605410] vcpu_run+0x62/0x2c0 [kvm] Aug 22 20:04:10 juju-e4d256-prod-github-runner-207 kernel: [52824.606312] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 20:04:10 juju-e4d256-prod-github-runner-207 kernel: [52824.607244] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 20:04:10 juju-e4d256-prod-github-runner-207 kernel: [52824.608207] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 20:04:10 juju-e4d256-prod-github-runner-207 kernel: [52824.609098] ? __seccomp_filter+0x4a/0x4a0 Aug 22 20:04:10 juju-e4d256-prod-github-runner-207 kernel: [52824.609930] ? __fget_files+0x86/0xc0 Aug 22 20:04:10 juju-e4d256-prod-github-runner-207 kernel: [52824.610730] __x64_sys_ioctl+0x95/0xd0 Aug 22 20:04:10 juju-e4d256-prod-github-runner-207 kernel: [52824.611521] do_syscall_64+0x5c/0xc0 Aug 22 20:04:10 juju-e4d256-prod-github-runner-207 kernel: [52824.612270] ? do_futex+0x162/0x1f0 Aug 22 20:04:10 juju-e4d256-prod-github-runner-207 kernel: [52824.612991] ? __x64_sys_futex+0x78/0x1e0 Aug 22 20:04:10 juju-e4d256-prod-github-runner-207 kernel: [52824.613762] ? __secure_computing+0xa9/0x120 Aug 22 20:04:10 juju-e4d256-prod-github-runner-207 kernel: [52824.614563] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 20:04:10 juju-e4d256-prod-github-runner-207 kernel: [52824.615441] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:04:10 juju-e4d256-prod-github-runner-207 kernel: [52824.616264] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:04:10 juju-e4d256-prod-github-runner-207 kernel: [52824.617082] ? do_syscall_64+0x69/0xc0 Aug 22 20:04:10 juju-e4d256-prod-github-runner-207 kernel: [52824.617805] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:04:10 juju-e4d256-prod-github-runner-207 kernel: [52824.618624] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:04:10 juju-e4d256-prod-github-runner-207 kernel: [52824.619416] ? do_syscall_64+0x69/0xc0 Aug 22 20:04:10 juju-e4d256-prod-github-runner-207 kernel: [52824.620138] ? do_syscall_64+0x69/0xc0 Aug 22 20:04:10 juju-e4d256-prod-github-runner-207 kernel: [52824.620868] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 20:04:10 juju-e4d256-prod-github-runner-207 kernel: [52824.621683] RIP: 0033:0x7faa5d0edaff Aug 22 20:04:10 juju-e4d256-prod-github-runner-207 kernel: [52824.622389] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 20:04:10 juju-e4d256-prod-github-runner-207 kernel: [52824.626972] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 20:04:10 juju-e4d256-prod-github-runner-207 kernel: [52824.627985] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 20:04:10 juju-e4d256-prod-github-runner-207 kernel: [52824.628879] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 20:04:10 juju-e4d256-prod-github-runner-207 kernel: [52824.629765] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 20:04:10 juju-e4d256-prod-github-runner-207 kernel: [52824.630675] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 20:04:10 juju-e4d256-prod-github-runner-207 kernel: [52824.631566] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 20:04:10 juju-e4d256-prod-github-runner-207 kernel: [52824.632491] Aug 22 20:04:38 juju-e4d256-prod-github-runner-207 kernel: [52852.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 49114s! [qemu-system-x86:6715] Aug 22 20:04:38 juju-e4d256-prod-github-runner-207 kernel: [52852.543719] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 20:04:38 juju-e4d256-prod-github-runner-207 kernel: [52852.543972] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 20:04:38 juju-e4d256-prod-github-runner-207 kernel: [52852.556328] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 20:04:38 juju-e4d256-prod-github-runner-207 kernel: [52852.557595] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 20:04:38 juju-e4d256-prod-github-runner-207 kernel: [52852.558826] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:04:38 juju-e4d256-prod-github-runner-207 kernel: [52852.559882] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 20:04:38 juju-e4d256-prod-github-runner-207 kernel: [52852.562444] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 20:04:38 juju-e4d256-prod-github-runner-207 kernel: [52852.563486] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 20:04:38 juju-e4d256-prod-github-runner-207 kernel: [52852.564648] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 20:04:38 juju-e4d256-prod-github-runner-207 kernel: [52852.565808] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 20:04:38 juju-e4d256-prod-github-runner-207 kernel: [52852.566986] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 20:04:38 juju-e4d256-prod-github-runner-207 kernel: [52852.568147] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 20:04:38 juju-e4d256-prod-github-runner-207 kernel: [52852.569312] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 20:04:38 juju-e4d256-prod-github-runner-207 kernel: [52852.570563] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 20:04:38 juju-e4d256-prod-github-runner-207 kernel: [52852.571661] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 20:04:38 juju-e4d256-prod-github-runner-207 kernel: [52852.572867] Call Trace: Aug 22 20:04:38 juju-e4d256-prod-github-runner-207 kernel: [52852.573779] Aug 22 20:04:38 juju-e4d256-prod-github-runner-207 kernel: [52852.574687] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:04:38 juju-e4d256-prod-github-runner-207 kernel: [52852.575717] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:04:38 juju-e4d256-prod-github-runner-207 kernel: [52852.576742] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:04:38 juju-e4d256-prod-github-runner-207 kernel: [52852.577829] ? show_regs.part.0+0x23/0x29 Aug 22 20:04:38 juju-e4d256-prod-github-runner-207 kernel: [52852.578842] ? show_regs.cold+0x8/0xd Aug 22 20:04:38 juju-e4d256-prod-github-runner-207 kernel: [52852.579813] ? watchdog_timer_fn+0x1be/0x220 Aug 22 20:04:38 juju-e4d256-prod-github-runner-207 kernel: [52852.580820] ? lockup_detector_update_enable+0x60/0x60 Aug 22 20:04:38 juju-e4d256-prod-github-runner-207 kernel: [52852.581994] ? __hrtimer_run_queues+0x107/0x230 Aug 22 20:04:38 juju-e4d256-prod-github-runner-207 kernel: [52852.583532] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 20:04:38 juju-e4d256-prod-github-runner-207 kernel: [52852.584644] ? hrtimer_interrupt+0x101/0x220 Aug 22 20:04:38 juju-e4d256-prod-github-runner-207 kernel: [52852.585741] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 20:04:38 juju-e4d256-prod-github-runner-207 kernel: [52852.586950] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 20:04:38 juju-e4d256-prod-github-runner-207 kernel: [52852.588090] Aug 22 20:04:38 juju-e4d256-prod-github-runner-207 kernel: [52852.588992] Aug 22 20:04:38 juju-e4d256-prod-github-runner-207 kernel: [52852.589877] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 20:04:38 juju-e4d256-prod-github-runner-207 kernel: [52852.591126] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:04:38 juju-e4d256-prod-github-runner-207 kernel: [52852.592273] ? _raw_spin_lock+0x22/0x30 Aug 22 20:04:38 juju-e4d256-prod-github-runner-207 kernel: [52852.593339] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:04:38 juju-e4d256-prod-github-runner-207 kernel: [52852.594470] direct_page_fault+0x206/0x310 [kvm] Aug 22 20:04:38 juju-e4d256-prod-github-runner-207 kernel: [52852.595597] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 20:04:38 juju-e4d256-prod-github-runner-207 kernel: [52852.596693] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 20:04:38 juju-e4d256-prod-github-runner-207 kernel: [52852.597786] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 20:04:38 juju-e4d256-prod-github-runner-207 kernel: [52852.598886] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 20:04:38 juju-e4d256-prod-github-runner-207 kernel: [52852.599924] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 20:04:38 juju-e4d256-prod-github-runner-207 kernel: [52852.601087] handle_exit+0x98/0x230 [kvm_amd] Aug 22 20:04:38 juju-e4d256-prod-github-runner-207 kernel: [52852.602068] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 20:04:38 juju-e4d256-prod-github-runner-207 kernel: [52852.603093] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 20:04:38 juju-e4d256-prod-github-runner-207 kernel: [52852.604117] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 20:04:38 juju-e4d256-prod-github-runner-207 kernel: [52852.605119] vcpu_run+0x62/0x2c0 [kvm] Aug 22 20:04:38 juju-e4d256-prod-github-runner-207 kernel: [52852.606006] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 20:04:38 juju-e4d256-prod-github-runner-207 kernel: [52852.606920] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 20:04:38 juju-e4d256-prod-github-runner-207 kernel: [52852.607890] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 20:04:38 juju-e4d256-prod-github-runner-207 kernel: [52852.608775] ? __seccomp_filter+0x4a/0x4a0 Aug 22 20:04:38 juju-e4d256-prod-github-runner-207 kernel: [52852.609607] ? __fget_files+0x86/0xc0 Aug 22 20:04:38 juju-e4d256-prod-github-runner-207 kernel: [52852.610412] __x64_sys_ioctl+0x95/0xd0 Aug 22 20:04:38 juju-e4d256-prod-github-runner-207 kernel: [52852.611187] do_syscall_64+0x5c/0xc0 Aug 22 20:04:38 juju-e4d256-prod-github-runner-207 kernel: [52852.611920] ? do_futex+0x162/0x1f0 Aug 22 20:04:38 juju-e4d256-prod-github-runner-207 kernel: [52852.612696] ? __x64_sys_futex+0x78/0x1e0 Aug 22 20:04:38 juju-e4d256-prod-github-runner-207 kernel: [52852.613535] ? __secure_computing+0xa9/0x120 Aug 22 20:04:38 juju-e4d256-prod-github-runner-207 kernel: [52852.614388] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 20:04:38 juju-e4d256-prod-github-runner-207 kernel: [52852.615255] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:04:38 juju-e4d256-prod-github-runner-207 kernel: [52852.616072] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:04:38 juju-e4d256-prod-github-runner-207 kernel: [52852.616885] ? do_syscall_64+0x69/0xc0 Aug 22 20:04:38 juju-e4d256-prod-github-runner-207 kernel: [52852.617603] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:04:38 juju-e4d256-prod-github-runner-207 kernel: [52852.618409] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:04:38 juju-e4d256-prod-github-runner-207 kernel: [52852.619200] ? do_syscall_64+0x69/0xc0 Aug 22 20:04:38 juju-e4d256-prod-github-runner-207 kernel: [52852.619901] ? do_syscall_64+0x69/0xc0 Aug 22 20:04:38 juju-e4d256-prod-github-runner-207 kernel: [52852.620597] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 20:04:38 juju-e4d256-prod-github-runner-207 kernel: [52852.621399] RIP: 0033:0x7faa5d0edaff Aug 22 20:04:38 juju-e4d256-prod-github-runner-207 kernel: [52852.622110] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 20:04:38 juju-e4d256-prod-github-runner-207 kernel: [52852.624435] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 20:04:38 juju-e4d256-prod-github-runner-207 kernel: [52852.625489] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 20:04:38 juju-e4d256-prod-github-runner-207 kernel: [52852.626532] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 20:04:38 juju-e4d256-prod-github-runner-207 kernel: [52852.627552] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 20:04:38 juju-e4d256-prod-github-runner-207 kernel: [52852.628572] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 20:04:38 juju-e4d256-prod-github-runner-207 kernel: [52852.629593] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 20:04:38 juju-e4d256-prod-github-runner-207 kernel: [52852.630633] Aug 22 20:05:06 juju-e4d256-prod-github-runner-207 kernel: [52880.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 49140s! [qemu-system-x86:6715] Aug 22 20:05:06 juju-e4d256-prod-github-runner-207 kernel: [52880.543077] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 20:05:06 juju-e4d256-prod-github-runner-207 kernel: [52880.543142] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 20:05:06 juju-e4d256-prod-github-runner-207 kernel: [52880.555207] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 20:05:06 juju-e4d256-prod-github-runner-207 kernel: [52880.556472] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 20:05:06 juju-e4d256-prod-github-runner-207 kernel: [52880.557698] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:05:06 juju-e4d256-prod-github-runner-207 kernel: [52880.558773] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 20:05:06 juju-e4d256-prod-github-runner-207 kernel: [52880.561324] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 20:05:06 juju-e4d256-prod-github-runner-207 kernel: [52880.562389] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 20:05:06 juju-e4d256-prod-github-runner-207 kernel: [52880.563552] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 20:05:06 juju-e4d256-prod-github-runner-207 kernel: [52880.564717] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 20:05:06 juju-e4d256-prod-github-runner-207 kernel: [52880.565894] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 20:05:06 juju-e4d256-prod-github-runner-207 kernel: [52880.567056] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 20:05:06 juju-e4d256-prod-github-runner-207 kernel: [52880.568221] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 20:05:06 juju-e4d256-prod-github-runner-207 kernel: [52880.569458] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 20:05:06 juju-e4d256-prod-github-runner-207 kernel: [52880.570575] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 20:05:06 juju-e4d256-prod-github-runner-207 kernel: [52880.571775] Call Trace: Aug 22 20:05:06 juju-e4d256-prod-github-runner-207 kernel: [52880.572686] Aug 22 20:05:06 juju-e4d256-prod-github-runner-207 kernel: [52880.573570] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:05:06 juju-e4d256-prod-github-runner-207 kernel: [52880.574617] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:05:06 juju-e4d256-prod-github-runner-207 kernel: [52880.575639] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:05:06 juju-e4d256-prod-github-runner-207 kernel: [52880.576712] ? show_regs.part.0+0x23/0x29 Aug 22 20:05:06 juju-e4d256-prod-github-runner-207 kernel: [52880.577709] ? show_regs.cold+0x8/0xd Aug 22 20:05:06 juju-e4d256-prod-github-runner-207 kernel: [52880.578692] ? watchdog_timer_fn+0x1be/0x220 Aug 22 20:05:06 juju-e4d256-prod-github-runner-207 kernel: [52880.579705] ? lockup_detector_update_enable+0x60/0x60 Aug 22 20:05:06 juju-e4d256-prod-github-runner-207 kernel: [52880.580767] ? __hrtimer_run_queues+0x107/0x230 Aug 22 20:05:06 juju-e4d256-prod-github-runner-207 kernel: [52880.581808] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 20:05:06 juju-e4d256-prod-github-runner-207 kernel: [52880.582832] ? hrtimer_interrupt+0x101/0x220 Aug 22 20:05:06 juju-e4d256-prod-github-runner-207 kernel: [52880.583845] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 20:05:06 juju-e4d256-prod-github-runner-207 kernel: [52880.584911] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 20:05:06 juju-e4d256-prod-github-runner-207 kernel: [52880.585974] Aug 22 20:05:06 juju-e4d256-prod-github-runner-207 kernel: [52880.586830] Aug 22 20:05:06 juju-e4d256-prod-github-runner-207 kernel: [52880.587676] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 20:05:06 juju-e4d256-prod-github-runner-207 kernel: [52880.588718] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:05:06 juju-e4d256-prod-github-runner-207 kernel: [52880.589756] ? _raw_spin_lock+0x22/0x30 Aug 22 20:05:06 juju-e4d256-prod-github-runner-207 kernel: [52880.590718] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:05:06 juju-e4d256-prod-github-runner-207 kernel: [52880.591736] direct_page_fault+0x206/0x310 [kvm] Aug 22 20:05:06 juju-e4d256-prod-github-runner-207 kernel: [52880.592759] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 20:05:06 juju-e4d256-prod-github-runner-207 kernel: [52880.593774] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 20:05:06 juju-e4d256-prod-github-runner-207 kernel: [52880.594789] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 20:05:06 juju-e4d256-prod-github-runner-207 kernel: [52880.595764] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 20:05:06 juju-e4d256-prod-github-runner-207 kernel: [52880.596708] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 20:05:06 juju-e4d256-prod-github-runner-207 kernel: [52880.597687] handle_exit+0x98/0x230 [kvm_amd] Aug 22 20:05:06 juju-e4d256-prod-github-runner-207 kernel: [52880.598611] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 20:05:06 juju-e4d256-prod-github-runner-207 kernel: [52880.599523] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 20:05:06 juju-e4d256-prod-github-runner-207 kernel: [52880.600466] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 20:05:06 juju-e4d256-prod-github-runner-207 kernel: [52880.601388] vcpu_run+0x62/0x2c0 [kvm] Aug 22 20:05:06 juju-e4d256-prod-github-runner-207 kernel: [52880.602223] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 20:05:06 juju-e4d256-prod-github-runner-207 kernel: [52880.603035] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 20:05:06 juju-e4d256-prod-github-runner-207 kernel: [52880.604212] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 20:05:06 juju-e4d256-prod-github-runner-207 kernel: [52880.605107] ? __seccomp_filter+0x4a/0x4a0 Aug 22 20:05:06 juju-e4d256-prod-github-runner-207 kernel: [52880.605962] ? __fget_files+0x86/0xc0 Aug 22 20:05:06 juju-e4d256-prod-github-runner-207 kernel: [52880.606743] __x64_sys_ioctl+0x95/0xd0 Aug 22 20:05:06 juju-e4d256-prod-github-runner-207 kernel: [52880.607513] do_syscall_64+0x5c/0xc0 Aug 22 20:05:06 juju-e4d256-prod-github-runner-207 kernel: [52880.608254] ? do_futex+0x162/0x1f0 Aug 22 20:05:06 juju-e4d256-prod-github-runner-207 kernel: [52880.608979] ? __x64_sys_futex+0x78/0x1e0 Aug 22 20:05:06 juju-e4d256-prod-github-runner-207 kernel: [52880.609739] ? __secure_computing+0xa9/0x120 Aug 22 20:05:06 juju-e4d256-prod-github-runner-207 kernel: [52880.610534] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 20:05:06 juju-e4d256-prod-github-runner-207 kernel: [52880.611400] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:05:06 juju-e4d256-prod-github-runner-207 kernel: [52880.612214] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:05:06 juju-e4d256-prod-github-runner-207 kernel: [52880.613026] ? do_syscall_64+0x69/0xc0 Aug 22 20:05:06 juju-e4d256-prod-github-runner-207 kernel: [52880.613756] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:05:06 juju-e4d256-prod-github-runner-207 kernel: [52880.614594] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:05:06 juju-e4d256-prod-github-runner-207 kernel: [52880.615387] ? do_syscall_64+0x69/0xc0 Aug 22 20:05:06 juju-e4d256-prod-github-runner-207 kernel: [52880.616092] ? do_syscall_64+0x69/0xc0 Aug 22 20:05:06 juju-e4d256-prod-github-runner-207 kernel: [52880.616793] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 20:05:06 juju-e4d256-prod-github-runner-207 kernel: [52880.617607] RIP: 0033:0x7faa5d0edaff Aug 22 20:05:06 juju-e4d256-prod-github-runner-207 kernel: [52880.618358] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 20:05:06 juju-e4d256-prod-github-runner-207 kernel: [52880.620690] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 20:05:06 juju-e4d256-prod-github-runner-207 kernel: [52880.621751] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 20:05:06 juju-e4d256-prod-github-runner-207 kernel: [52880.622794] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 20:05:06 juju-e4d256-prod-github-runner-207 kernel: [52880.623820] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 20:05:06 juju-e4d256-prod-github-runner-207 kernel: [52880.624848] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 20:05:06 juju-e4d256-prod-github-runner-207 kernel: [52880.625899] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 20:05:06 juju-e4d256-prod-github-runner-207 kernel: [52880.626939] Aug 22 20:05:34 juju-e4d256-prod-github-runner-207 kernel: [52908.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 49166s! [qemu-system-x86:6715] Aug 22 20:05:34 juju-e4d256-prod-github-runner-207 kernel: [52908.543096] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 20:05:34 juju-e4d256-prod-github-runner-207 kernel: [52908.543166] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 20:05:34 juju-e4d256-prod-github-runner-207 kernel: [52908.555257] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 20:05:34 juju-e4d256-prod-github-runner-207 kernel: [52908.556542] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 20:05:34 juju-e4d256-prod-github-runner-207 kernel: [52908.557782] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:05:34 juju-e4d256-prod-github-runner-207 kernel: [52908.558841] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 20:05:34 juju-e4d256-prod-github-runner-207 kernel: [52908.561393] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 20:05:34 juju-e4d256-prod-github-runner-207 kernel: [52908.562447] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 20:05:34 juju-e4d256-prod-github-runner-207 kernel: [52908.563609] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 20:05:34 juju-e4d256-prod-github-runner-207 kernel: [52908.564768] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 20:05:34 juju-e4d256-prod-github-runner-207 kernel: [52908.565939] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 20:05:34 juju-e4d256-prod-github-runner-207 kernel: [52908.567103] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 20:05:34 juju-e4d256-prod-github-runner-207 kernel: [52908.568272] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 20:05:34 juju-e4d256-prod-github-runner-207 kernel: [52908.569526] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 20:05:34 juju-e4d256-prod-github-runner-207 kernel: [52908.570623] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 20:05:34 juju-e4d256-prod-github-runner-207 kernel: [52908.571819] Call Trace: Aug 22 20:05:34 juju-e4d256-prod-github-runner-207 kernel: [52908.572732] Aug 22 20:05:34 juju-e4d256-prod-github-runner-207 kernel: [52908.573644] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:05:34 juju-e4d256-prod-github-runner-207 kernel: [52908.574677] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:05:34 juju-e4d256-prod-github-runner-207 kernel: [52908.575703] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:05:34 juju-e4d256-prod-github-runner-207 kernel: [52908.576783] ? show_regs.part.0+0x23/0x29 Aug 22 20:05:34 juju-e4d256-prod-github-runner-207 kernel: [52908.577795] ? show_regs.cold+0x8/0xd Aug 22 20:05:34 juju-e4d256-prod-github-runner-207 kernel: [52908.578779] ? watchdog_timer_fn+0x1be/0x220 Aug 22 20:05:34 juju-e4d256-prod-github-runner-207 kernel: [52908.579799] ? lockup_detector_update_enable+0x60/0x60 Aug 22 20:05:34 juju-e4d256-prod-github-runner-207 kernel: [52908.580863] ? __hrtimer_run_queues+0x107/0x230 Aug 22 20:05:34 juju-e4d256-prod-github-runner-207 kernel: [52908.581906] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 20:05:34 juju-e4d256-prod-github-runner-207 kernel: [52908.582934] ? hrtimer_interrupt+0x101/0x220 Aug 22 20:05:34 juju-e4d256-prod-github-runner-207 kernel: [52908.583957] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 20:05:34 juju-e4d256-prod-github-runner-207 kernel: [52908.585142] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 20:05:34 juju-e4d256-prod-github-runner-207 kernel: [52908.586314] Aug 22 20:05:34 juju-e4d256-prod-github-runner-207 kernel: [52908.587227] Aug 22 20:05:34 juju-e4d256-prod-github-runner-207 kernel: [52908.588129] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 20:05:34 juju-e4d256-prod-github-runner-207 kernel: [52908.589278] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:05:34 juju-e4d256-prod-github-runner-207 kernel: [52908.590444] ? _raw_spin_lock+0x22/0x30 Aug 22 20:05:34 juju-e4d256-prod-github-runner-207 kernel: [52908.591474] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:05:34 juju-e4d256-prod-github-runner-207 kernel: [52908.592598] direct_page_fault+0x206/0x310 [kvm] Aug 22 20:05:34 juju-e4d256-prod-github-runner-207 kernel: [52908.593731] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 20:05:34 juju-e4d256-prod-github-runner-207 kernel: [52908.594835] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 20:05:34 juju-e4d256-prod-github-runner-207 kernel: [52908.595981] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 20:05:34 juju-e4d256-prod-github-runner-207 kernel: [52908.597058] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 20:05:34 juju-e4d256-prod-github-runner-207 kernel: [52908.598115] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 20:05:34 juju-e4d256-prod-github-runner-207 kernel: [52908.599205] handle_exit+0x98/0x230 [kvm_amd] Aug 22 20:05:34 juju-e4d256-prod-github-runner-207 kernel: [52908.600186] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 20:05:34 juju-e4d256-prod-github-runner-207 kernel: [52908.601186] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 20:05:34 juju-e4d256-prod-github-runner-207 kernel: [52908.602221] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 20:05:34 juju-e4d256-prod-github-runner-207 kernel: [52908.603222] vcpu_run+0x62/0x2c0 [kvm] Aug 22 20:05:34 juju-e4d256-prod-github-runner-207 kernel: [52908.604109] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 20:05:34 juju-e4d256-prod-github-runner-207 kernel: [52908.605003] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 20:05:34 juju-e4d256-prod-github-runner-207 kernel: [52908.605970] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 20:05:34 juju-e4d256-prod-github-runner-207 kernel: [52908.606859] ? __seccomp_filter+0x4a/0x4a0 Aug 22 20:05:34 juju-e4d256-prod-github-runner-207 kernel: [52908.607684] ? __fget_files+0x86/0xc0 Aug 22 20:05:34 juju-e4d256-prod-github-runner-207 kernel: [52908.608463] __x64_sys_ioctl+0x95/0xd0 Aug 22 20:05:34 juju-e4d256-prod-github-runner-207 kernel: [52908.609233] do_syscall_64+0x5c/0xc0 Aug 22 20:05:34 juju-e4d256-prod-github-runner-207 kernel: [52908.609991] ? do_futex+0x162/0x1f0 Aug 22 20:05:34 juju-e4d256-prod-github-runner-207 kernel: [52908.610718] ? __x64_sys_futex+0x78/0x1e0 Aug 22 20:05:34 juju-e4d256-prod-github-runner-207 kernel: [52908.611472] ? __secure_computing+0xa9/0x120 Aug 22 20:05:34 juju-e4d256-prod-github-runner-207 kernel: [52908.612240] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 20:05:34 juju-e4d256-prod-github-runner-207 kernel: [52908.613105] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:05:34 juju-e4d256-prod-github-runner-207 kernel: [52908.613930] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:05:34 juju-e4d256-prod-github-runner-207 kernel: [52908.614686] ? do_syscall_64+0x69/0xc0 Aug 22 20:05:34 juju-e4d256-prod-github-runner-207 kernel: [52908.615339] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:05:34 juju-e4d256-prod-github-runner-207 kernel: [52908.616044] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:05:34 juju-e4d256-prod-github-runner-207 kernel: [52908.616740] ? do_syscall_64+0x69/0xc0 Aug 22 20:05:34 juju-e4d256-prod-github-runner-207 kernel: [52908.617365] ? do_syscall_64+0x69/0xc0 Aug 22 20:05:34 juju-e4d256-prod-github-runner-207 kernel: [52908.618016] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 20:05:34 juju-e4d256-prod-github-runner-207 kernel: [52908.618721] RIP: 0033:0x7faa5d0edaff Aug 22 20:05:34 juju-e4d256-prod-github-runner-207 kernel: [52908.619345] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 20:05:34 juju-e4d256-prod-github-runner-207 kernel: [52908.621347] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 20:05:34 juju-e4d256-prod-github-runner-207 kernel: [52908.622280] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 20:05:34 juju-e4d256-prod-github-runner-207 kernel: [52908.623169] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 20:05:34 juju-e4d256-prod-github-runner-207 kernel: [52908.624062] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 20:05:34 juju-e4d256-prod-github-runner-207 kernel: [52908.624950] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 20:05:34 juju-e4d256-prod-github-runner-207 kernel: [52908.625855] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 20:05:34 juju-e4d256-prod-github-runner-207 kernel: [52908.626751] Aug 22 20:05:46 juju-e4d256-prod-github-runner-207 kernel: [52920.716706] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 20:05:46 juju-e4d256-prod-github-runner-207 kernel: [52920.717681] rcu: 1-....: (13159298 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=6361411 Aug 22 20:05:46 juju-e4d256-prod-github-runner-207 kernel: [52920.718855] (t=13200879 jiffies g=23269 q=49416) Aug 22 20:05:46 juju-e4d256-prod-github-runner-207 kernel: [52920.719643] NMI backtrace for cpu 1 Aug 22 20:05:46 juju-e4d256-prod-github-runner-207 kernel: [52920.720370] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 20:05:46 juju-e4d256-prod-github-runner-207 kernel: [52920.721707] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 20:05:46 juju-e4d256-prod-github-runner-207 kernel: [52920.722961] Call Trace: Aug 22 20:05:46 juju-e4d256-prod-github-runner-207 kernel: [52920.724117] Aug 22 20:05:46 juju-e4d256-prod-github-runner-207 kernel: [52920.724958] show_stack+0x52/0x5c Aug 22 20:05:46 juju-e4d256-prod-github-runner-207 kernel: [52920.725711] dump_stack_lvl+0x4a/0x63 Aug 22 20:05:46 juju-e4d256-prod-github-runner-207 kernel: [52920.726461] dump_stack+0x10/0x16 Aug 22 20:05:46 juju-e4d256-prod-github-runner-207 kernel: [52920.727180] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 20:05:46 juju-e4d256-prod-github-runner-207 kernel: [52920.727965] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 20:05:46 juju-e4d256-prod-github-runner-207 kernel: [52920.728952] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 20:05:46 juju-e4d256-prod-github-runner-207 kernel: [52920.729853] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 20:05:46 juju-e4d256-prod-github-runner-207 kernel: [52920.730695] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 20:05:46 juju-e4d256-prod-github-runner-207 kernel: [52920.731541] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 20:05:46 juju-e4d256-prod-github-runner-207 kernel: [52920.732387] print_cpu_stall.cold+0x2f/0xe2 Aug 22 20:05:46 juju-e4d256-prod-github-runner-207 kernel: [52920.733245] ? timekeeping_update+0xf7/0x150 Aug 22 20:05:46 juju-e4d256-prod-github-runner-207 kernel: [52920.734054] check_cpu_stall+0x109/0x270 Aug 22 20:05:46 juju-e4d256-prod-github-runner-207 kernel: [52920.734879] rcu_sched_clock_irq+0x9a/0x250 Aug 22 20:05:46 juju-e4d256-prod-github-runner-207 kernel: [52920.735662] update_process_times+0x94/0xd0 Aug 22 20:05:46 juju-e4d256-prod-github-runner-207 kernel: [52920.736433] tick_sched_handle+0x29/0x70 Aug 22 20:05:46 juju-e4d256-prod-github-runner-207 kernel: [52920.737185] tick_sched_timer+0x8c/0xc0 Aug 22 20:05:46 juju-e4d256-prod-github-runner-207 kernel: [52920.737949] ? tick_nohz_handler+0xb0/0xb0 Aug 22 20:05:46 juju-e4d256-prod-github-runner-207 kernel: [52920.738811] __hrtimer_run_queues+0x107/0x230 Aug 22 20:05:46 juju-e4d256-prod-github-runner-207 kernel: [52920.740030] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 20:05:46 juju-e4d256-prod-github-runner-207 kernel: [52920.740892] hrtimer_interrupt+0x101/0x220 Aug 22 20:05:46 juju-e4d256-prod-github-runner-207 kernel: [52920.741677] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 20:05:46 juju-e4d256-prod-github-runner-207 kernel: [52920.742494] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 20:05:46 juju-e4d256-prod-github-runner-207 kernel: [52920.743298] Aug 22 20:05:46 juju-e4d256-prod-github-runner-207 kernel: [52920.743940] Aug 22 20:05:46 juju-e4d256-prod-github-runner-207 kernel: [52920.744598] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 20:05:46 juju-e4d256-prod-github-runner-207 kernel: [52920.745473] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:05:46 juju-e4d256-prod-github-runner-207 kernel: [52920.746369] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 20:05:46 juju-e4d256-prod-github-runner-207 kernel: [52920.748706] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 20:05:46 juju-e4d256-prod-github-runner-207 kernel: [52920.749641] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 20:05:46 juju-e4d256-prod-github-runner-207 kernel: [52920.750681] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 20:05:46 juju-e4d256-prod-github-runner-207 kernel: [52920.751680] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 20:05:46 juju-e4d256-prod-github-runner-207 kernel: [52920.752694] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 20:05:46 juju-e4d256-prod-github-runner-207 kernel: [52920.753738] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 20:05:46 juju-e4d256-prod-github-runner-207 kernel: [52920.754811] ? _raw_spin_lock+0x22/0x30 Aug 22 20:05:46 juju-e4d256-prod-github-runner-207 kernel: [52920.755593] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:05:46 juju-e4d256-prod-github-runner-207 kernel: [52920.756439] direct_page_fault+0x206/0x310 [kvm] Aug 22 20:05:46 juju-e4d256-prod-github-runner-207 kernel: [52920.757326] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 20:05:46 juju-e4d256-prod-github-runner-207 kernel: [52920.758205] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 20:05:46 juju-e4d256-prod-github-runner-207 kernel: [52920.759062] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 20:05:46 juju-e4d256-prod-github-runner-207 kernel: [52920.759867] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 20:05:46 juju-e4d256-prod-github-runner-207 kernel: [52920.760657] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 20:05:46 juju-e4d256-prod-github-runner-207 kernel: [52920.761505] handle_exit+0x98/0x230 [kvm_amd] Aug 22 20:05:46 juju-e4d256-prod-github-runner-207 kernel: [52920.762279] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 20:05:46 juju-e4d256-prod-github-runner-207 kernel: [52920.763073] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 20:05:46 juju-e4d256-prod-github-runner-207 kernel: [52920.763879] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 20:05:46 juju-e4d256-prod-github-runner-207 kernel: [52920.764670] vcpu_run+0x62/0x2c0 [kvm] Aug 22 20:05:46 juju-e4d256-prod-github-runner-207 kernel: [52920.765434] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 20:05:46 juju-e4d256-prod-github-runner-207 kernel: [52920.766201] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 20:05:46 juju-e4d256-prod-github-runner-207 kernel: [52920.767022] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 20:05:46 juju-e4d256-prod-github-runner-207 kernel: [52920.767806] ? __seccomp_filter+0x4a/0x4a0 Aug 22 20:05:46 juju-e4d256-prod-github-runner-207 kernel: [52920.768547] ? __fget_files+0x86/0xc0 Aug 22 20:05:46 juju-e4d256-prod-github-runner-207 kernel: [52920.769330] __x64_sys_ioctl+0x95/0xd0 Aug 22 20:05:46 juju-e4d256-prod-github-runner-207 kernel: [52920.770033] do_syscall_64+0x5c/0xc0 Aug 22 20:05:46 juju-e4d256-prod-github-runner-207 kernel: [52920.770720] ? do_futex+0x162/0x1f0 Aug 22 20:05:46 juju-e4d256-prod-github-runner-207 kernel: [52920.771394] ? __x64_sys_futex+0x78/0x1e0 Aug 22 20:05:46 juju-e4d256-prod-github-runner-207 kernel: [52920.772103] ? __secure_computing+0xa9/0x120 Aug 22 20:05:46 juju-e4d256-prod-github-runner-207 kernel: [52920.772821] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 20:05:46 juju-e4d256-prod-github-runner-207 kernel: [52920.773624] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:05:46 juju-e4d256-prod-github-runner-207 kernel: [52920.774379] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:05:46 juju-e4d256-prod-github-runner-207 kernel: [52920.775138] ? do_syscall_64+0x69/0xc0 Aug 22 20:05:46 juju-e4d256-prod-github-runner-207 kernel: [52920.775827] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:05:46 juju-e4d256-prod-github-runner-207 kernel: [52920.776585] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:05:46 juju-e4d256-prod-github-runner-207 kernel: [52920.777351] ? do_syscall_64+0x69/0xc0 Aug 22 20:05:46 juju-e4d256-prod-github-runner-207 kernel: [52920.778052] ? do_syscall_64+0x69/0xc0 Aug 22 20:05:46 juju-e4d256-prod-github-runner-207 kernel: [52920.778738] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 20:05:46 juju-e4d256-prod-github-runner-207 kernel: [52920.779509] RIP: 0033:0x7faa5d0edaff Aug 22 20:05:46 juju-e4d256-prod-github-runner-207 kernel: [52920.780191] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 20:05:46 juju-e4d256-prod-github-runner-207 kernel: [52920.782302] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 20:05:46 juju-e4d256-prod-github-runner-207 kernel: [52920.783267] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 20:05:46 juju-e4d256-prod-github-runner-207 kernel: [52920.784226] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 20:05:46 juju-e4d256-prod-github-runner-207 kernel: [52920.785186] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 20:05:46 juju-e4d256-prod-github-runner-207 kernel: [52920.786145] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 20:05:46 juju-e4d256-prod-github-runner-207 kernel: [52920.787071] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 20:05:46 juju-e4d256-prod-github-runner-207 kernel: [52920.787988] Aug 22 20:06:14 juju-e4d256-prod-github-runner-207 kernel: [52948.541981] watchdog: BUG: soft lockup - CPU#1 stuck for 49204s! [qemu-system-x86:6715] Aug 22 20:06:14 juju-e4d256-prod-github-runner-207 kernel: [52948.543708] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 20:06:14 juju-e4d256-prod-github-runner-207 kernel: [52948.543958] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 20:06:14 juju-e4d256-prod-github-runner-207 kernel: [52948.556104] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 20:06:14 juju-e4d256-prod-github-runner-207 kernel: [52948.557532] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 20:06:14 juju-e4d256-prod-github-runner-207 kernel: [52948.558755] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:06:14 juju-e4d256-prod-github-runner-207 kernel: [52948.559810] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 20:06:14 juju-e4d256-prod-github-runner-207 kernel: [52948.562382] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 20:06:14 juju-e4d256-prod-github-runner-207 kernel: [52948.563445] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 20:06:14 juju-e4d256-prod-github-runner-207 kernel: [52948.564647] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 20:06:14 juju-e4d256-prod-github-runner-207 kernel: [52948.565837] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 20:06:14 juju-e4d256-prod-github-runner-207 kernel: [52948.567031] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 20:06:14 juju-e4d256-prod-github-runner-207 kernel: [52948.568205] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 20:06:14 juju-e4d256-prod-github-runner-207 kernel: [52948.569407] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 20:06:14 juju-e4d256-prod-github-runner-207 kernel: [52948.570673] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 20:06:14 juju-e4d256-prod-github-runner-207 kernel: [52948.571833] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 20:06:14 juju-e4d256-prod-github-runner-207 kernel: [52948.573093] Call Trace: Aug 22 20:06:14 juju-e4d256-prod-github-runner-207 kernel: [52948.574013] Aug 22 20:06:14 juju-e4d256-prod-github-runner-207 kernel: [52948.574908] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:06:14 juju-e4d256-prod-github-runner-207 kernel: [52948.575938] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:06:14 juju-e4d256-prod-github-runner-207 kernel: [52948.577005] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:06:14 juju-e4d256-prod-github-runner-207 kernel: [52948.578119] ? show_regs.part.0+0x23/0x29 Aug 22 20:06:14 juju-e4d256-prod-github-runner-207 kernel: [52948.579160] ? show_regs.cold+0x8/0xd Aug 22 20:06:14 juju-e4d256-prod-github-runner-207 kernel: [52948.580138] ? watchdog_timer_fn+0x1be/0x220 Aug 22 20:06:14 juju-e4d256-prod-github-runner-207 kernel: [52948.581167] ? lockup_detector_update_enable+0x60/0x60 Aug 22 20:06:14 juju-e4d256-prod-github-runner-207 kernel: [52948.582231] ? __hrtimer_run_queues+0x107/0x230 Aug 22 20:06:14 juju-e4d256-prod-github-runner-207 kernel: [52948.583263] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 20:06:14 juju-e4d256-prod-github-runner-207 kernel: [52948.584326] ? hrtimer_interrupt+0x101/0x220 Aug 22 20:06:14 juju-e4d256-prod-github-runner-207 kernel: [52948.585372] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 20:06:14 juju-e4d256-prod-github-runner-207 kernel: [52948.586486] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 20:06:14 juju-e4d256-prod-github-runner-207 kernel: [52948.587536] Aug 22 20:06:14 juju-e4d256-prod-github-runner-207 kernel: [52948.588387] Aug 22 20:06:14 juju-e4d256-prod-github-runner-207 kernel: [52948.589259] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 20:06:14 juju-e4d256-prod-github-runner-207 kernel: [52948.590295] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:06:14 juju-e4d256-prod-github-runner-207 kernel: [52948.591335] ? _raw_spin_lock+0x22/0x30 Aug 22 20:06:14 juju-e4d256-prod-github-runner-207 kernel: [52948.592280] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:06:14 juju-e4d256-prod-github-runner-207 kernel: [52948.593329] direct_page_fault+0x206/0x310 [kvm] Aug 22 20:06:14 juju-e4d256-prod-github-runner-207 kernel: [52948.594356] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 20:06:14 juju-e4d256-prod-github-runner-207 kernel: [52948.595369] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 20:06:14 juju-e4d256-prod-github-runner-207 kernel: [52948.596373] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 20:06:14 juju-e4d256-prod-github-runner-207 kernel: [52948.597417] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 20:06:14 juju-e4d256-prod-github-runner-207 kernel: [52948.598372] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 20:06:14 juju-e4d256-prod-github-runner-207 kernel: [52948.599351] handle_exit+0x98/0x230 [kvm_amd] Aug 22 20:06:14 juju-e4d256-prod-github-runner-207 kernel: [52948.600248] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 20:06:14 juju-e4d256-prod-github-runner-207 kernel: [52948.601216] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 20:06:14 juju-e4d256-prod-github-runner-207 kernel: [52948.602206] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 20:06:14 juju-e4d256-prod-github-runner-207 kernel: [52948.603165] vcpu_run+0x62/0x2c0 [kvm] Aug 22 20:06:14 juju-e4d256-prod-github-runner-207 kernel: [52948.603987] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 20:06:14 juju-e4d256-prod-github-runner-207 kernel: [52948.604804] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 20:06:14 juju-e4d256-prod-github-runner-207 kernel: [52948.605687] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 20:06:14 juju-e4d256-prod-github-runner-207 kernel: [52948.606491] ? __seccomp_filter+0x4a/0x4a0 Aug 22 20:06:14 juju-e4d256-prod-github-runner-207 kernel: [52948.607236] ? __fget_files+0x86/0xc0 Aug 22 20:06:14 juju-e4d256-prod-github-runner-207 kernel: [52948.607946] __x64_sys_ioctl+0x95/0xd0 Aug 22 20:06:14 juju-e4d256-prod-github-runner-207 kernel: [52948.608642] do_syscall_64+0x5c/0xc0 Aug 22 20:06:14 juju-e4d256-prod-github-runner-207 kernel: [52948.609343] ? do_futex+0x162/0x1f0 Aug 22 20:06:14 juju-e4d256-prod-github-runner-207 kernel: [52948.610005] ? __x64_sys_futex+0x78/0x1e0 Aug 22 20:06:14 juju-e4d256-prod-github-runner-207 kernel: [52948.611132] ? __secure_computing+0xa9/0x120 Aug 22 20:06:14 juju-e4d256-prod-github-runner-207 kernel: [52948.613315] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 20:06:14 juju-e4d256-prod-github-runner-207 kernel: [52948.614092] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:06:14 juju-e4d256-prod-github-runner-207 kernel: [52948.614814] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:06:14 juju-e4d256-prod-github-runner-207 kernel: [52948.615593] ? do_syscall_64+0x69/0xc0 Aug 22 20:06:14 juju-e4d256-prod-github-runner-207 kernel: [52948.616245] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:06:14 juju-e4d256-prod-github-runner-207 kernel: [52948.616981] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:06:14 juju-e4d256-prod-github-runner-207 kernel: [52948.617681] ? do_syscall_64+0x69/0xc0 Aug 22 20:06:14 juju-e4d256-prod-github-runner-207 kernel: [52948.618307] ? do_syscall_64+0x69/0xc0 Aug 22 20:06:14 juju-e4d256-prod-github-runner-207 kernel: [52948.618931] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 20:06:14 juju-e4d256-prod-github-runner-207 kernel: [52948.619639] RIP: 0033:0x7faa5d0edaff Aug 22 20:06:14 juju-e4d256-prod-github-runner-207 kernel: [52948.620302] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 20:06:14 juju-e4d256-prod-github-runner-207 kernel: [52948.622373] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 20:06:14 juju-e4d256-prod-github-runner-207 kernel: [52948.623350] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 20:06:14 juju-e4d256-prod-github-runner-207 kernel: [52948.624267] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 20:06:14 juju-e4d256-prod-github-runner-207 kernel: [52948.625346] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 20:06:14 juju-e4d256-prod-github-runner-207 kernel: [52948.626242] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 20:06:14 juju-e4d256-prod-github-runner-207 kernel: [52948.627157] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 20:06:14 juju-e4d256-prod-github-runner-207 kernel: [52948.628053] Aug 22 20:06:42 juju-e4d256-prod-github-runner-207 kernel: [52976.541980] watchdog: BUG: soft lockup - CPU#1 stuck for 49230s! [qemu-system-x86:6715] Aug 22 20:06:42 juju-e4d256-prod-github-runner-207 kernel: [52976.543179] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 20:06:42 juju-e4d256-prod-github-runner-207 kernel: [52976.543248] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 20:06:42 juju-e4d256-prod-github-runner-207 kernel: [52976.555530] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 20:06:42 juju-e4d256-prod-github-runner-207 kernel: [52976.556807] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 20:06:42 juju-e4d256-prod-github-runner-207 kernel: [52976.558051] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:06:42 juju-e4d256-prod-github-runner-207 kernel: [52976.559132] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 20:06:42 juju-e4d256-prod-github-runner-207 kernel: [52976.561722] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 20:06:42 juju-e4d256-prod-github-runner-207 kernel: [52976.562771] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 20:06:42 juju-e4d256-prod-github-runner-207 kernel: [52976.563945] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 20:06:42 juju-e4d256-prod-github-runner-207 kernel: [52976.565186] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 20:06:42 juju-e4d256-prod-github-runner-207 kernel: [52976.566551] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 20:06:42 juju-e4d256-prod-github-runner-207 kernel: [52976.567718] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 20:06:42 juju-e4d256-prod-github-runner-207 kernel: [52976.568912] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 20:06:42 juju-e4d256-prod-github-runner-207 kernel: [52976.570175] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 20:06:42 juju-e4d256-prod-github-runner-207 kernel: [52976.571292] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 20:06:42 juju-e4d256-prod-github-runner-207 kernel: [52976.572503] Call Trace: Aug 22 20:06:42 juju-e4d256-prod-github-runner-207 kernel: [52976.573431] Aug 22 20:06:42 juju-e4d256-prod-github-runner-207 kernel: [52976.574313] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:06:42 juju-e4d256-prod-github-runner-207 kernel: [52976.575371] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:06:42 juju-e4d256-prod-github-runner-207 kernel: [52976.576416] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:06:42 juju-e4d256-prod-github-runner-207 kernel: [52976.577516] ? show_regs.part.0+0x23/0x29 Aug 22 20:06:42 juju-e4d256-prod-github-runner-207 kernel: [52976.578520] ? show_regs.cold+0x8/0xd Aug 22 20:06:42 juju-e4d256-prod-github-runner-207 kernel: [52976.579490] ? watchdog_timer_fn+0x1be/0x220 Aug 22 20:06:42 juju-e4d256-prod-github-runner-207 kernel: [52976.580510] ? lockup_detector_update_enable+0x60/0x60 Aug 22 20:06:42 juju-e4d256-prod-github-runner-207 kernel: [52976.581597] ? __hrtimer_run_queues+0x107/0x230 Aug 22 20:06:42 juju-e4d256-prod-github-runner-207 kernel: [52976.582629] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 20:06:42 juju-e4d256-prod-github-runner-207 kernel: [52976.583651] ? hrtimer_interrupt+0x101/0x220 Aug 22 20:06:42 juju-e4d256-prod-github-runner-207 kernel: [52976.584676] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 20:06:42 juju-e4d256-prod-github-runner-207 kernel: [52976.585752] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 20:06:42 juju-e4d256-prod-github-runner-207 kernel: [52976.586797] Aug 22 20:06:42 juju-e4d256-prod-github-runner-207 kernel: [52976.587653] Aug 22 20:06:42 juju-e4d256-prod-github-runner-207 kernel: [52976.588489] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 20:06:42 juju-e4d256-prod-github-runner-207 kernel: [52976.589532] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:06:42 juju-e4d256-prod-github-runner-207 kernel: [52976.590582] ? _raw_spin_lock+0x22/0x30 Aug 22 20:06:42 juju-e4d256-prod-github-runner-207 kernel: [52976.591526] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:06:42 juju-e4d256-prod-github-runner-207 kernel: [52976.592541] direct_page_fault+0x206/0x310 [kvm] Aug 22 20:06:42 juju-e4d256-prod-github-runner-207 kernel: [52976.593583] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 20:06:42 juju-e4d256-prod-github-runner-207 kernel: [52976.594593] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 20:06:42 juju-e4d256-prod-github-runner-207 kernel: [52976.595617] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 20:06:42 juju-e4d256-prod-github-runner-207 kernel: [52976.596612] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 20:06:42 juju-e4d256-prod-github-runner-207 kernel: [52976.597563] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 20:06:42 juju-e4d256-prod-github-runner-207 kernel: [52976.598538] handle_exit+0x98/0x230 [kvm_amd] Aug 22 20:06:42 juju-e4d256-prod-github-runner-207 kernel: [52976.599428] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 20:06:42 juju-e4d256-prod-github-runner-207 kernel: [52976.600339] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 20:06:42 juju-e4d256-prod-github-runner-207 kernel: [52976.601296] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 20:06:42 juju-e4d256-prod-github-runner-207 kernel: [52976.602209] vcpu_run+0x62/0x2c0 [kvm] Aug 22 20:06:42 juju-e4d256-prod-github-runner-207 kernel: [52976.603019] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 20:06:42 juju-e4d256-prod-github-runner-207 kernel: [52976.603825] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 20:06:42 juju-e4d256-prod-github-runner-207 kernel: [52976.604686] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 20:06:42 juju-e4d256-prod-github-runner-207 kernel: [52976.605482] ? __seccomp_filter+0x4a/0x4a0 Aug 22 20:06:42 juju-e4d256-prod-github-runner-207 kernel: [52976.606248] ? __fget_files+0x86/0xc0 Aug 22 20:06:42 juju-e4d256-prod-github-runner-207 kernel: [52976.606961] __x64_sys_ioctl+0x95/0xd0 Aug 22 20:06:42 juju-e4d256-prod-github-runner-207 kernel: [52976.607699] do_syscall_64+0x5c/0xc0 Aug 22 20:06:42 juju-e4d256-prod-github-runner-207 kernel: [52976.608375] ? do_futex+0x162/0x1f0 Aug 22 20:06:42 juju-e4d256-prod-github-runner-207 kernel: [52976.609042] ? __x64_sys_futex+0x78/0x1e0 Aug 22 20:06:42 juju-e4d256-prod-github-runner-207 kernel: [52976.609716] ? __secure_computing+0xa9/0x120 Aug 22 20:06:42 juju-e4d256-prod-github-runner-207 kernel: [52976.610430] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 20:06:42 juju-e4d256-prod-github-runner-207 kernel: [52976.611207] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:06:42 juju-e4d256-prod-github-runner-207 kernel: [52976.611937] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:06:42 juju-e4d256-prod-github-runner-207 kernel: [52976.612670] ? do_syscall_64+0x69/0xc0 Aug 22 20:06:42 juju-e4d256-prod-github-runner-207 kernel: [52976.613317] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:06:42 juju-e4d256-prod-github-runner-207 kernel: [52976.614018] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:06:42 juju-e4d256-prod-github-runner-207 kernel: [52976.614711] ? do_syscall_64+0x69/0xc0 Aug 22 20:06:42 juju-e4d256-prod-github-runner-207 kernel: [52976.615339] ? do_syscall_64+0x69/0xc0 Aug 22 20:06:42 juju-e4d256-prod-github-runner-207 kernel: [52976.615996] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 20:06:42 juju-e4d256-prod-github-runner-207 kernel: [52976.616732] RIP: 0033:0x7faa5d0edaff Aug 22 20:06:42 juju-e4d256-prod-github-runner-207 kernel: [52976.617378] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 20:06:42 juju-e4d256-prod-github-runner-207 kernel: [52976.619353] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 20:06:42 juju-e4d256-prod-github-runner-207 kernel: [52976.620263] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 20:06:42 juju-e4d256-prod-github-runner-207 kernel: [52976.621163] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 20:06:42 juju-e4d256-prod-github-runner-207 kernel: [52976.622063] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 20:06:42 juju-e4d256-prod-github-runner-207 kernel: [52976.622987] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 20:06:42 juju-e4d256-prod-github-runner-207 kernel: [52976.623877] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 20:06:42 juju-e4d256-prod-github-runner-207 kernel: [52976.624776] Aug 22 20:07:10 juju-e4d256-prod-github-runner-207 kernel: [53004.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 49256s! [qemu-system-x86:6715] Aug 22 20:07:10 juju-e4d256-prod-github-runner-207 kernel: [53004.543606] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 20:07:10 juju-e4d256-prod-github-runner-207 kernel: [53004.543682] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 20:07:10 juju-e4d256-prod-github-runner-207 kernel: [53004.556057] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 20:07:10 juju-e4d256-prod-github-runner-207 kernel: [53004.557351] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 20:07:10 juju-e4d256-prod-github-runner-207 kernel: [53004.558574] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:07:10 juju-e4d256-prod-github-runner-207 kernel: [53004.559628] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 20:07:10 juju-e4d256-prod-github-runner-207 kernel: [53004.562180] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 20:07:10 juju-e4d256-prod-github-runner-207 kernel: [53004.563219] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 20:07:10 juju-e4d256-prod-github-runner-207 kernel: [53004.564438] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 20:07:10 juju-e4d256-prod-github-runner-207 kernel: [53004.565854] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 20:07:10 juju-e4d256-prod-github-runner-207 kernel: [53004.567044] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 20:07:10 juju-e4d256-prod-github-runner-207 kernel: [53004.568283] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 20:07:10 juju-e4d256-prod-github-runner-207 kernel: [53004.570053] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 20:07:10 juju-e4d256-prod-github-runner-207 kernel: [53004.572136] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 20:07:10 juju-e4d256-prod-github-runner-207 kernel: [53004.573761] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 20:07:10 juju-e4d256-prod-github-runner-207 kernel: [53004.575470] Call Trace: Aug 22 20:07:10 juju-e4d256-prod-github-runner-207 kernel: [53004.576483] Aug 22 20:07:10 juju-e4d256-prod-github-runner-207 kernel: [53004.577395] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:07:10 juju-e4d256-prod-github-runner-207 kernel: [53004.578424] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:07:10 juju-e4d256-prod-github-runner-207 kernel: [53004.579441] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:07:10 juju-e4d256-prod-github-runner-207 kernel: [53004.580532] ? show_regs.part.0+0x23/0x29 Aug 22 20:07:10 juju-e4d256-prod-github-runner-207 kernel: [53004.581551] ? show_regs.cold+0x8/0xd Aug 22 20:07:10 juju-e4d256-prod-github-runner-207 kernel: [53004.582538] ? watchdog_timer_fn+0x1be/0x220 Aug 22 20:07:10 juju-e4d256-prod-github-runner-207 kernel: [53004.583550] ? lockup_detector_update_enable+0x60/0x60 Aug 22 20:07:10 juju-e4d256-prod-github-runner-207 kernel: [53004.584645] ? __hrtimer_run_queues+0x107/0x230 Aug 22 20:07:10 juju-e4d256-prod-github-runner-207 kernel: [53004.585691] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 20:07:10 juju-e4d256-prod-github-runner-207 kernel: [53004.586777] ? hrtimer_interrupt+0x101/0x220 Aug 22 20:07:10 juju-e4d256-prod-github-runner-207 kernel: [53004.587812] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 20:07:10 juju-e4d256-prod-github-runner-207 kernel: [53004.588896] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 20:07:10 juju-e4d256-prod-github-runner-207 kernel: [53004.589964] Aug 22 20:07:10 juju-e4d256-prod-github-runner-207 kernel: [53004.590829] Aug 22 20:07:10 juju-e4d256-prod-github-runner-207 kernel: [53004.591665] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 20:07:10 juju-e4d256-prod-github-runner-207 kernel: [53004.592731] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:07:10 juju-e4d256-prod-github-runner-207 kernel: [53004.593771] ? _raw_spin_lock+0x22/0x30 Aug 22 20:07:10 juju-e4d256-prod-github-runner-207 kernel: [53004.594818] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:07:10 juju-e4d256-prod-github-runner-207 kernel: [53004.595854] direct_page_fault+0x206/0x310 [kvm] Aug 22 20:07:10 juju-e4d256-prod-github-runner-207 kernel: [53004.596905] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 20:07:10 juju-e4d256-prod-github-runner-207 kernel: [53004.597971] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 20:07:10 juju-e4d256-prod-github-runner-207 kernel: [53004.598982] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 20:07:10 juju-e4d256-prod-github-runner-207 kernel: [53004.599956] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 20:07:10 juju-e4d256-prod-github-runner-207 kernel: [53004.600919] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 20:07:10 juju-e4d256-prod-github-runner-207 kernel: [53004.601899] handle_exit+0x98/0x230 [kvm_amd] Aug 22 20:07:10 juju-e4d256-prod-github-runner-207 kernel: [53004.602829] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 20:07:10 juju-e4d256-prod-github-runner-207 kernel: [53004.603931] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 20:07:10 juju-e4d256-prod-github-runner-207 kernel: [53004.605033] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 20:07:10 juju-e4d256-prod-github-runner-207 kernel: [53004.606007] vcpu_run+0x62/0x2c0 [kvm] Aug 22 20:07:10 juju-e4d256-prod-github-runner-207 kernel: [53004.606925] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 20:07:10 juju-e4d256-prod-github-runner-207 kernel: [53004.607941] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 20:07:10 juju-e4d256-prod-github-runner-207 kernel: [53004.609181] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 20:07:10 juju-e4d256-prod-github-runner-207 kernel: [53004.610359] ? __seccomp_filter+0x4a/0x4a0 Aug 22 20:07:10 juju-e4d256-prod-github-runner-207 kernel: [53004.611447] ? __fget_files+0x86/0xc0 Aug 22 20:07:10 juju-e4d256-prod-github-runner-207 kernel: [53004.612468] __x64_sys_ioctl+0x95/0xd0 Aug 22 20:07:10 juju-e4d256-prod-github-runner-207 kernel: [53004.613491] do_syscall_64+0x5c/0xc0 Aug 22 20:07:10 juju-e4d256-prod-github-runner-207 kernel: [53004.614441] ? do_futex+0x162/0x1f0 Aug 22 20:07:10 juju-e4d256-prod-github-runner-207 kernel: [53004.615374] ? __x64_sys_futex+0x78/0x1e0 Aug 22 20:07:10 juju-e4d256-prod-github-runner-207 kernel: [53004.616363] ? __secure_computing+0xa9/0x120 Aug 22 20:07:10 juju-e4d256-prod-github-runner-207 kernel: [53004.617384] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 20:07:10 juju-e4d256-prod-github-runner-207 kernel: [53004.618550] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:07:10 juju-e4d256-prod-github-runner-207 kernel: [53004.619573] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:07:10 juju-e4d256-prod-github-runner-207 kernel: [53004.620599] ? do_syscall_64+0x69/0xc0 Aug 22 20:07:10 juju-e4d256-prod-github-runner-207 kernel: [53004.621324] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:07:10 juju-e4d256-prod-github-runner-207 kernel: [53004.622034] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:07:10 juju-e4d256-prod-github-runner-207 kernel: [53004.622730] ? do_syscall_64+0x69/0xc0 Aug 22 20:07:10 juju-e4d256-prod-github-runner-207 kernel: [53004.623354] ? do_syscall_64+0x69/0xc0 Aug 22 20:07:10 juju-e4d256-prod-github-runner-207 kernel: [53004.623980] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 20:07:10 juju-e4d256-prod-github-runner-207 kernel: [53004.624696] RIP: 0033:0x7faa5d0edaff Aug 22 20:07:10 juju-e4d256-prod-github-runner-207 kernel: [53004.625371] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 20:07:10 juju-e4d256-prod-github-runner-207 kernel: [53004.627350] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 20:07:10 juju-e4d256-prod-github-runner-207 kernel: [53004.628282] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 20:07:10 juju-e4d256-prod-github-runner-207 kernel: [53004.629178] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 20:07:10 juju-e4d256-prod-github-runner-207 kernel: [53004.630066] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 20:07:10 juju-e4d256-prod-github-runner-207 kernel: [53004.630952] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 20:07:10 juju-e4d256-prod-github-runner-207 kernel: [53004.631844] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 20:07:10 juju-e4d256-prod-github-runner-207 kernel: [53004.632757] Aug 22 20:07:38 juju-e4d256-prod-github-runner-207 kernel: [53032.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 49282s! [qemu-system-x86:6715] Aug 22 20:07:38 juju-e4d256-prod-github-runner-207 kernel: [53032.543195] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 20:07:38 juju-e4d256-prod-github-runner-207 kernel: [53032.543336] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 20:07:38 juju-e4d256-prod-github-runner-207 kernel: [53032.555766] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 20:07:38 juju-e4d256-prod-github-runner-207 kernel: [53032.557042] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 20:07:38 juju-e4d256-prod-github-runner-207 kernel: [53032.558258] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:07:38 juju-e4d256-prod-github-runner-207 kernel: [53032.559320] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 20:07:38 juju-e4d256-prod-github-runner-207 kernel: [53032.561884] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 20:07:38 juju-e4d256-prod-github-runner-207 kernel: [53032.563056] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 20:07:38 juju-e4d256-prod-github-runner-207 kernel: [53032.564332] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 20:07:38 juju-e4d256-prod-github-runner-207 kernel: [53032.565500] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 20:07:38 juju-e4d256-prod-github-runner-207 kernel: [53032.566668] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 20:07:38 juju-e4d256-prod-github-runner-207 kernel: [53032.567842] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 20:07:38 juju-e4d256-prod-github-runner-207 kernel: [53032.569051] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 20:07:38 juju-e4d256-prod-github-runner-207 kernel: [53032.570295] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 20:07:38 juju-e4d256-prod-github-runner-207 kernel: [53032.571394] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 20:07:38 juju-e4d256-prod-github-runner-207 kernel: [53032.572596] Call Trace: Aug 22 20:07:38 juju-e4d256-prod-github-runner-207 kernel: [53032.573515] Aug 22 20:07:38 juju-e4d256-prod-github-runner-207 kernel: [53032.574403] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:07:38 juju-e4d256-prod-github-runner-207 kernel: [53032.575447] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:07:38 juju-e4d256-prod-github-runner-207 kernel: [53032.576513] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:07:38 juju-e4d256-prod-github-runner-207 kernel: [53032.577630] ? show_regs.part.0+0x23/0x29 Aug 22 20:07:38 juju-e4d256-prod-github-runner-207 kernel: [53032.578629] ? show_regs.cold+0x8/0xd Aug 22 20:07:38 juju-e4d256-prod-github-runner-207 kernel: [53032.579620] ? watchdog_timer_fn+0x1be/0x220 Aug 22 20:07:38 juju-e4d256-prod-github-runner-207 kernel: [53032.580667] ? lockup_detector_update_enable+0x60/0x60 Aug 22 20:07:38 juju-e4d256-prod-github-runner-207 kernel: [53032.581731] ? __hrtimer_run_queues+0x107/0x230 Aug 22 20:07:38 juju-e4d256-prod-github-runner-207 kernel: [53032.582757] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 20:07:38 juju-e4d256-prod-github-runner-207 kernel: [53032.583779] ? hrtimer_interrupt+0x101/0x220 Aug 22 20:07:38 juju-e4d256-prod-github-runner-207 kernel: [53032.584813] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 20:07:38 juju-e4d256-prod-github-runner-207 kernel: [53032.585885] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 20:07:38 juju-e4d256-prod-github-runner-207 kernel: [53032.586928] Aug 22 20:07:38 juju-e4d256-prod-github-runner-207 kernel: [53032.587779] Aug 22 20:07:38 juju-e4d256-prod-github-runner-207 kernel: [53032.588626] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 20:07:38 juju-e4d256-prod-github-runner-207 kernel: [53032.589664] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:07:38 juju-e4d256-prod-github-runner-207 kernel: [53032.590793] ? _raw_spin_lock+0x22/0x30 Aug 22 20:07:38 juju-e4d256-prod-github-runner-207 kernel: [53032.591742] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:07:38 juju-e4d256-prod-github-runner-207 kernel: [53032.592770] direct_page_fault+0x206/0x310 [kvm] Aug 22 20:07:38 juju-e4d256-prod-github-runner-207 kernel: [53032.593792] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 20:07:38 juju-e4d256-prod-github-runner-207 kernel: [53032.594804] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 20:07:38 juju-e4d256-prod-github-runner-207 kernel: [53032.595818] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 20:07:38 juju-e4d256-prod-github-runner-207 kernel: [53032.596822] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 20:07:38 juju-e4d256-prod-github-runner-207 kernel: [53032.597771] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 20:07:38 juju-e4d256-prod-github-runner-207 kernel: [53032.598755] handle_exit+0x98/0x230 [kvm_amd] Aug 22 20:07:38 juju-e4d256-prod-github-runner-207 kernel: [53032.599644] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 20:07:38 juju-e4d256-prod-github-runner-207 kernel: [53032.600580] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 20:07:38 juju-e4d256-prod-github-runner-207 kernel: [53032.601527] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 20:07:38 juju-e4d256-prod-github-runner-207 kernel: [53032.602429] vcpu_run+0x62/0x2c0 [kvm] Aug 22 20:07:38 juju-e4d256-prod-github-runner-207 kernel: [53032.603238] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 20:07:38 juju-e4d256-prod-github-runner-207 kernel: [53032.604072] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 20:07:38 juju-e4d256-prod-github-runner-207 kernel: [53032.604931] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 20:07:38 juju-e4d256-prod-github-runner-207 kernel: [53032.605733] ? __seccomp_filter+0x4a/0x4a0 Aug 22 20:07:38 juju-e4d256-prod-github-runner-207 kernel: [53032.606510] ? __fget_files+0x86/0xc0 Aug 22 20:07:38 juju-e4d256-prod-github-runner-207 kernel: [53032.607241] __x64_sys_ioctl+0x95/0xd0 Aug 22 20:07:38 juju-e4d256-prod-github-runner-207 kernel: [53032.607960] do_syscall_64+0x5c/0xc0 Aug 22 20:07:38 juju-e4d256-prod-github-runner-207 kernel: [53032.608630] ? do_futex+0x162/0x1f0 Aug 22 20:07:38 juju-e4d256-prod-github-runner-207 kernel: [53032.609280] ? __x64_sys_futex+0x78/0x1e0 Aug 22 20:07:38 juju-e4d256-prod-github-runner-207 kernel: [53032.609954] ? __secure_computing+0xa9/0x120 Aug 22 20:07:38 juju-e4d256-prod-github-runner-207 kernel: [53032.610656] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 20:07:38 juju-e4d256-prod-github-runner-207 kernel: [53032.611426] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:07:38 juju-e4d256-prod-github-runner-207 kernel: [53032.612175] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:07:38 juju-e4d256-prod-github-runner-207 kernel: [53032.612899] ? do_syscall_64+0x69/0xc0 Aug 22 20:07:38 juju-e4d256-prod-github-runner-207 kernel: [53032.613547] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:07:38 juju-e4d256-prod-github-runner-207 kernel: [53032.614248] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:07:38 juju-e4d256-prod-github-runner-207 kernel: [53032.614944] ? do_syscall_64+0x69/0xc0 Aug 22 20:07:38 juju-e4d256-prod-github-runner-207 kernel: [53032.615572] ? do_syscall_64+0x69/0xc0 Aug 22 20:07:38 juju-e4d256-prod-github-runner-207 kernel: [53032.616211] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 20:07:38 juju-e4d256-prod-github-runner-207 kernel: [53032.616927] RIP: 0033:0x7faa5d0edaff Aug 22 20:07:38 juju-e4d256-prod-github-runner-207 kernel: [53032.617551] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 20:07:38 juju-e4d256-prod-github-runner-207 kernel: [53032.619531] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 20:07:38 juju-e4d256-prod-github-runner-207 kernel: [53032.620463] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 20:07:38 juju-e4d256-prod-github-runner-207 kernel: [53032.621366] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 20:07:38 juju-e4d256-prod-github-runner-207 kernel: [53032.622270] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 20:07:38 juju-e4d256-prod-github-runner-207 kernel: [53032.623162] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 20:07:38 juju-e4d256-prod-github-runner-207 kernel: [53032.624067] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 20:07:38 juju-e4d256-prod-github-runner-207 kernel: [53032.624961] Aug 22 20:08:06 juju-e4d256-prod-github-runner-207 kernel: [53060.541976] watchdog: BUG: soft lockup - CPU#1 stuck for 49308s! [qemu-system-x86:6715] Aug 22 20:08:06 juju-e4d256-prod-github-runner-207 kernel: [53060.543851] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 20:08:06 juju-e4d256-prod-github-runner-207 kernel: [53060.544055] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 20:08:06 juju-e4d256-prod-github-runner-207 kernel: [53060.558182] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 20:08:06 juju-e4d256-prod-github-runner-207 kernel: [53060.559680] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 20:08:06 juju-e4d256-prod-github-runner-207 kernel: [53060.561074] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:08:06 juju-e4d256-prod-github-runner-207 kernel: [53060.562271] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 20:08:06 juju-e4d256-prod-github-runner-207 kernel: [53060.565193] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 20:08:06 juju-e4d256-prod-github-runner-207 kernel: [53060.566346] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 20:08:06 juju-e4d256-prod-github-runner-207 kernel: [53060.567665] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 20:08:06 juju-e4d256-prod-github-runner-207 kernel: [53060.568968] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 20:08:06 juju-e4d256-prod-github-runner-207 kernel: [53060.570268] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 20:08:06 juju-e4d256-prod-github-runner-207 kernel: [53060.571583] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 20:08:06 juju-e4d256-prod-github-runner-207 kernel: [53060.572891] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 20:08:06 juju-e4d256-prod-github-runner-207 kernel: [53060.574282] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 20:08:06 juju-e4d256-prod-github-runner-207 kernel: [53060.575501] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 20:08:06 juju-e4d256-prod-github-runner-207 kernel: [53060.576854] Call Trace: Aug 22 20:08:06 juju-e4d256-prod-github-runner-207 kernel: [53060.577821] Aug 22 20:08:06 juju-e4d256-prod-github-runner-207 kernel: [53060.578769] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:08:06 juju-e4d256-prod-github-runner-207 kernel: [53060.579918] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:08:06 juju-e4d256-prod-github-runner-207 kernel: [53060.581035] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:08:06 juju-e4d256-prod-github-runner-207 kernel: [53060.582400] ? show_regs.part.0+0x23/0x29 Aug 22 20:08:06 juju-e4d256-prod-github-runner-207 kernel: [53060.583481] ? show_regs.cold+0x8/0xd Aug 22 20:08:06 juju-e4d256-prod-github-runner-207 kernel: [53060.584548] ? watchdog_timer_fn+0x1be/0x220 Aug 22 20:08:06 juju-e4d256-prod-github-runner-207 kernel: [53060.585653] ? lockup_detector_update_enable+0x60/0x60 Aug 22 20:08:06 juju-e4d256-prod-github-runner-207 kernel: [53060.586816] ? __hrtimer_run_queues+0x107/0x230 Aug 22 20:08:06 juju-e4d256-prod-github-runner-207 kernel: [53060.587997] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 20:08:06 juju-e4d256-prod-github-runner-207 kernel: [53060.589132] ? hrtimer_interrupt+0x101/0x220 Aug 22 20:08:06 juju-e4d256-prod-github-runner-207 kernel: [53060.590240] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 20:08:06 juju-e4d256-prod-github-runner-207 kernel: [53060.591408] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 20:08:06 juju-e4d256-prod-github-runner-207 kernel: [53060.592579] Aug 22 20:08:06 juju-e4d256-prod-github-runner-207 kernel: [53060.593479] Aug 22 20:08:06 juju-e4d256-prod-github-runner-207 kernel: [53060.594361] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 20:08:06 juju-e4d256-prod-github-runner-207 kernel: [53060.595493] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:08:06 juju-e4d256-prod-github-runner-207 kernel: [53060.596667] ? _raw_spin_lock+0x22/0x30 Aug 22 20:08:06 juju-e4d256-prod-github-runner-207 kernel: [53060.597705] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:08:06 juju-e4d256-prod-github-runner-207 kernel: [53060.598822] direct_page_fault+0x206/0x310 [kvm] Aug 22 20:08:06 juju-e4d256-prod-github-runner-207 kernel: [53060.599961] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 20:08:06 juju-e4d256-prod-github-runner-207 kernel: [53060.601066] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 20:08:06 juju-e4d256-prod-github-runner-207 kernel: [53060.602165] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 20:08:06 juju-e4d256-prod-github-runner-207 kernel: [53060.603425] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 20:08:06 juju-e4d256-prod-github-runner-207 kernel: [53060.604610] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 20:08:06 juju-e4d256-prod-github-runner-207 kernel: [53060.605600] handle_exit+0x98/0x230 [kvm_amd] Aug 22 20:08:06 juju-e4d256-prod-github-runner-207 kernel: [53060.606495] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 20:08:06 juju-e4d256-prod-github-runner-207 kernel: [53060.607412] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 20:08:06 juju-e4d256-prod-github-runner-207 kernel: [53060.608363] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 20:08:06 juju-e4d256-prod-github-runner-207 kernel: [53060.609269] vcpu_run+0x62/0x2c0 [kvm] Aug 22 20:08:06 juju-e4d256-prod-github-runner-207 kernel: [53060.610081] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 20:08:06 juju-e4d256-prod-github-runner-207 kernel: [53060.610894] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 20:08:06 juju-e4d256-prod-github-runner-207 kernel: [53060.611764] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 20:08:06 juju-e4d256-prod-github-runner-207 kernel: [53060.612564] ? __seccomp_filter+0x4a/0x4a0 Aug 22 20:08:06 juju-e4d256-prod-github-runner-207 kernel: [53060.613310] ? __fget_files+0x86/0xc0 Aug 22 20:08:06 juju-e4d256-prod-github-runner-207 kernel: [53060.614020] __x64_sys_ioctl+0x95/0xd0 Aug 22 20:08:06 juju-e4d256-prod-github-runner-207 kernel: [53060.614715] do_syscall_64+0x5c/0xc0 Aug 22 20:08:06 juju-e4d256-prod-github-runner-207 kernel: [53060.615383] ? do_futex+0x162/0x1f0 Aug 22 20:08:06 juju-e4d256-prod-github-runner-207 kernel: [53060.616065] ? __x64_sys_futex+0x78/0x1e0 Aug 22 20:08:06 juju-e4d256-prod-github-runner-207 kernel: [53060.616739] ? __secure_computing+0xa9/0x120 Aug 22 20:08:06 juju-e4d256-prod-github-runner-207 kernel: [53060.617429] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 20:08:06 juju-e4d256-prod-github-runner-207 kernel: [53060.618190] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:08:06 juju-e4d256-prod-github-runner-207 kernel: [53060.618912] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:08:06 juju-e4d256-prod-github-runner-207 kernel: [53060.619655] ? do_syscall_64+0x69/0xc0 Aug 22 20:08:06 juju-e4d256-prod-github-runner-207 kernel: [53060.620309] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:08:06 juju-e4d256-prod-github-runner-207 kernel: [53060.621013] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:08:06 juju-e4d256-prod-github-runner-207 kernel: [53060.621710] ? do_syscall_64+0x69/0xc0 Aug 22 20:08:06 juju-e4d256-prod-github-runner-207 kernel: [53060.622337] ? do_syscall_64+0x69/0xc0 Aug 22 20:08:06 juju-e4d256-prod-github-runner-207 kernel: [53060.622966] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 20:08:06 juju-e4d256-prod-github-runner-207 kernel: [53060.623689] RIP: 0033:0x7faa5d0edaff Aug 22 20:08:06 juju-e4d256-prod-github-runner-207 kernel: [53060.624362] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 20:08:06 juju-e4d256-prod-github-runner-207 kernel: [53060.626362] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 20:08:06 juju-e4d256-prod-github-runner-207 kernel: [53060.627319] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 20:08:06 juju-e4d256-prod-github-runner-207 kernel: [53060.628233] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 20:08:06 juju-e4d256-prod-github-runner-207 kernel: [53060.629128] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 20:08:06 juju-e4d256-prod-github-runner-207 kernel: [53060.630014] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 20:08:06 juju-e4d256-prod-github-runner-207 kernel: [53060.630903] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 20:08:06 juju-e4d256-prod-github-runner-207 kernel: [53060.631821] Aug 22 20:08:34 juju-e4d256-prod-github-runner-207 kernel: [53088.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 49334s! [qemu-system-x86:6715] Aug 22 20:08:34 juju-e4d256-prod-github-runner-207 kernel: [53088.543092] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 20:08:34 juju-e4d256-prod-github-runner-207 kernel: [53088.543172] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 20:08:34 juju-e4d256-prod-github-runner-207 kernel: [53088.555251] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 20:08:34 juju-e4d256-prod-github-runner-207 kernel: [53088.556523] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 20:08:34 juju-e4d256-prod-github-runner-207 kernel: [53088.557753] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:08:34 juju-e4d256-prod-github-runner-207 kernel: [53088.558808] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 20:08:34 juju-e4d256-prod-github-runner-207 kernel: [53088.561377] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 20:08:34 juju-e4d256-prod-github-runner-207 kernel: [53088.562419] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 20:08:34 juju-e4d256-prod-github-runner-207 kernel: [53088.563602] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 20:08:34 juju-e4d256-prod-github-runner-207 kernel: [53088.564769] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 20:08:34 juju-e4d256-prod-github-runner-207 kernel: [53088.565929] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 20:08:34 juju-e4d256-prod-github-runner-207 kernel: [53088.567090] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 20:08:34 juju-e4d256-prod-github-runner-207 kernel: [53088.568271] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 20:08:34 juju-e4d256-prod-github-runner-207 kernel: [53088.569510] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 20:08:34 juju-e4d256-prod-github-runner-207 kernel: [53088.570607] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 20:08:34 juju-e4d256-prod-github-runner-207 kernel: [53088.571822] Call Trace: Aug 22 20:08:34 juju-e4d256-prod-github-runner-207 kernel: [53088.572736] Aug 22 20:08:34 juju-e4d256-prod-github-runner-207 kernel: [53088.573702] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:08:34 juju-e4d256-prod-github-runner-207 kernel: [53088.574834] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:08:34 juju-e4d256-prod-github-runner-207 kernel: [53088.575981] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:08:34 juju-e4d256-prod-github-runner-207 kernel: [53088.577152] ? show_regs.part.0+0x23/0x29 Aug 22 20:08:34 juju-e4d256-prod-github-runner-207 kernel: [53088.578243] ? show_regs.cold+0x8/0xd Aug 22 20:08:34 juju-e4d256-prod-github-runner-207 kernel: [53088.579312] ? watchdog_timer_fn+0x1be/0x220 Aug 22 20:08:34 juju-e4d256-prod-github-runner-207 kernel: [53088.580423] ? lockup_detector_update_enable+0x60/0x60 Aug 22 20:08:34 juju-e4d256-prod-github-runner-207 kernel: [53088.581593] ? __hrtimer_run_queues+0x107/0x230 Aug 22 20:08:34 juju-e4d256-prod-github-runner-207 kernel: [53088.582723] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 20:08:34 juju-e4d256-prod-github-runner-207 kernel: [53088.583853] ? hrtimer_interrupt+0x101/0x220 Aug 22 20:08:34 juju-e4d256-prod-github-runner-207 kernel: [53088.584968] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 20:08:34 juju-e4d256-prod-github-runner-207 kernel: [53088.586139] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 20:08:34 juju-e4d256-prod-github-runner-207 kernel: [53088.587297] Aug 22 20:08:34 juju-e4d256-prod-github-runner-207 kernel: [53088.588213] Aug 22 20:08:34 juju-e4d256-prod-github-runner-207 kernel: [53088.589098] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 20:08:34 juju-e4d256-prod-github-runner-207 kernel: [53088.590228] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:08:34 juju-e4d256-prod-github-runner-207 kernel: [53088.591398] ? _raw_spin_lock+0x22/0x30 Aug 22 20:08:34 juju-e4d256-prod-github-runner-207 kernel: [53088.592426] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:08:34 juju-e4d256-prod-github-runner-207 kernel: [53088.593541] direct_page_fault+0x206/0x310 [kvm] Aug 22 20:08:34 juju-e4d256-prod-github-runner-207 kernel: [53088.594798] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 20:08:34 juju-e4d256-prod-github-runner-207 kernel: [53088.595934] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 20:08:34 juju-e4d256-prod-github-runner-207 kernel: [53088.597037] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 20:08:34 juju-e4d256-prod-github-runner-207 kernel: [53088.598103] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 20:08:34 juju-e4d256-prod-github-runner-207 kernel: [53088.599149] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 20:08:34 juju-e4d256-prod-github-runner-207 kernel: [53088.600259] handle_exit+0x98/0x230 [kvm_amd] Aug 22 20:08:34 juju-e4d256-prod-github-runner-207 kernel: [53088.601239] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 20:08:34 juju-e4d256-prod-github-runner-207 kernel: [53088.602244] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 20:08:34 juju-e4d256-prod-github-runner-207 kernel: [53088.603315] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 20:08:34 juju-e4d256-prod-github-runner-207 kernel: [53088.604338] vcpu_run+0x62/0x2c0 [kvm] Aug 22 20:08:34 juju-e4d256-prod-github-runner-207 kernel: [53088.605243] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 20:08:34 juju-e4d256-prod-github-runner-207 kernel: [53088.606177] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 20:08:34 juju-e4d256-prod-github-runner-207 kernel: [53088.607258] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 20:08:34 juju-e4d256-prod-github-runner-207 kernel: [53088.608076] ? __seccomp_filter+0x4a/0x4a0 Aug 22 20:08:34 juju-e4d256-prod-github-runner-207 kernel: [53088.608822] ? __fget_files+0x86/0xc0 Aug 22 20:08:34 juju-e4d256-prod-github-runner-207 kernel: [53088.609530] __x64_sys_ioctl+0x95/0xd0 Aug 22 20:08:34 juju-e4d256-prod-github-runner-207 kernel: [53088.610225] do_syscall_64+0x5c/0xc0 Aug 22 20:08:34 juju-e4d256-prod-github-runner-207 kernel: [53088.610895] ? do_futex+0x162/0x1f0 Aug 22 20:08:34 juju-e4d256-prod-github-runner-207 kernel: [53088.611568] ? __x64_sys_futex+0x78/0x1e0 Aug 22 20:08:34 juju-e4d256-prod-github-runner-207 kernel: [53088.612272] ? __secure_computing+0xa9/0x120 Aug 22 20:08:34 juju-e4d256-prod-github-runner-207 kernel: [53088.612968] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 20:08:34 juju-e4d256-prod-github-runner-207 kernel: [53088.613731] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:08:34 juju-e4d256-prod-github-runner-207 kernel: [53088.614454] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:08:34 juju-e4d256-prod-github-runner-207 kernel: [53088.615197] ? do_syscall_64+0x69/0xc0 Aug 22 20:08:34 juju-e4d256-prod-github-runner-207 kernel: [53088.615847] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:08:34 juju-e4d256-prod-github-runner-207 kernel: [53088.616555] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:08:34 juju-e4d256-prod-github-runner-207 kernel: [53088.617253] ? do_syscall_64+0x69/0xc0 Aug 22 20:08:34 juju-e4d256-prod-github-runner-207 kernel: [53088.617883] ? do_syscall_64+0x69/0xc0 Aug 22 20:08:34 juju-e4d256-prod-github-runner-207 kernel: [53088.618511] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 20:08:34 juju-e4d256-prod-github-runner-207 kernel: [53088.619240] RIP: 0033:0x7faa5d0edaff Aug 22 20:08:34 juju-e4d256-prod-github-runner-207 kernel: [53088.619878] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 20:08:34 juju-e4d256-prod-github-runner-207 kernel: [53088.621870] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 20:08:34 juju-e4d256-prod-github-runner-207 kernel: [53088.622790] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 20:08:34 juju-e4d256-prod-github-runner-207 kernel: [53088.623698] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 20:08:34 juju-e4d256-prod-github-runner-207 kernel: [53088.624590] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 20:08:34 juju-e4d256-prod-github-runner-207 kernel: [53088.625485] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 20:08:34 juju-e4d256-prod-github-runner-207 kernel: [53088.626382] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 20:08:34 juju-e4d256-prod-github-runner-207 kernel: [53088.627287] Aug 22 20:08:46 juju-e4d256-prod-github-runner-207 kernel: [53100.728711] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 20:08:46 juju-e4d256-prod-github-runner-207 kernel: [53100.729702] rcu: 1-....: (13204162 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=6383096 Aug 22 20:08:46 juju-e4d256-prod-github-runner-207 kernel: [53100.730836] (t=13245882 jiffies g=23269 q=49530) Aug 22 20:08:46 juju-e4d256-prod-github-runner-207 kernel: [53100.731711] NMI backtrace for cpu 1 Aug 22 20:08:46 juju-e4d256-prod-github-runner-207 kernel: [53100.732441] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 20:08:46 juju-e4d256-prod-github-runner-207 kernel: [53100.733878] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 20:08:46 juju-e4d256-prod-github-runner-207 kernel: [53100.735329] Call Trace: Aug 22 20:08:46 juju-e4d256-prod-github-runner-207 kernel: [53100.736286] Aug 22 20:08:46 juju-e4d256-prod-github-runner-207 kernel: [53100.737202] show_stack+0x52/0x5c Aug 22 20:08:46 juju-e4d256-prod-github-runner-207 kernel: [53100.738275] dump_stack_lvl+0x4a/0x63 Aug 22 20:08:46 juju-e4d256-prod-github-runner-207 kernel: [53100.739357] dump_stack+0x10/0x16 Aug 22 20:08:46 juju-e4d256-prod-github-runner-207 kernel: [53100.740367] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 20:08:46 juju-e4d256-prod-github-runner-207 kernel: [53100.741461] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 20:08:46 juju-e4d256-prod-github-runner-207 kernel: [53100.742552] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 20:08:46 juju-e4d256-prod-github-runner-207 kernel: [53100.743702] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 20:08:46 juju-e4d256-prod-github-runner-207 kernel: [53100.744832] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 20:08:46 juju-e4d256-prod-github-runner-207 kernel: [53100.745956] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 20:08:46 juju-e4d256-prod-github-runner-207 kernel: [53100.747070] print_cpu_stall.cold+0x2f/0xe2 Aug 22 20:08:46 juju-e4d256-prod-github-runner-207 kernel: [53100.748129] ? timekeeping_update+0xf7/0x150 Aug 22 20:08:46 juju-e4d256-prod-github-runner-207 kernel: [53100.749196] check_cpu_stall+0x109/0x270 Aug 22 20:08:46 juju-e4d256-prod-github-runner-207 kernel: [53100.750226] rcu_sched_clock_irq+0x9a/0x250 Aug 22 20:08:46 juju-e4d256-prod-github-runner-207 kernel: [53100.751301] update_process_times+0x94/0xd0 Aug 22 20:08:46 juju-e4d256-prod-github-runner-207 kernel: [53100.752353] tick_sched_handle+0x29/0x70 Aug 22 20:08:46 juju-e4d256-prod-github-runner-207 kernel: [53100.753387] tick_sched_timer+0x8c/0xc0 Aug 22 20:08:46 juju-e4d256-prod-github-runner-207 kernel: [53100.754412] ? tick_nohz_handler+0xb0/0xb0 Aug 22 20:08:46 juju-e4d256-prod-github-runner-207 kernel: [53100.755479] __hrtimer_run_queues+0x107/0x230 Aug 22 20:08:46 juju-e4d256-prod-github-runner-207 kernel: [53100.756549] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 20:08:46 juju-e4d256-prod-github-runner-207 kernel: [53100.757617] hrtimer_interrupt+0x101/0x220 Aug 22 20:08:46 juju-e4d256-prod-github-runner-207 kernel: [53100.758665] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 20:08:46 juju-e4d256-prod-github-runner-207 kernel: [53100.759785] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 20:08:46 juju-e4d256-prod-github-runner-207 kernel: [53100.760875] Aug 22 20:08:46 juju-e4d256-prod-github-runner-207 kernel: [53100.761767] Aug 22 20:08:46 juju-e4d256-prod-github-runner-207 kernel: [53100.762651] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 20:08:46 juju-e4d256-prod-github-runner-207 kernel: [53100.763774] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:08:46 juju-e4d256-prod-github-runner-207 kernel: [53100.764981] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 20:08:46 juju-e4d256-prod-github-runner-207 kernel: [53100.767741] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 20:08:46 juju-e4d256-prod-github-runner-207 kernel: [53100.768758] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 20:08:46 juju-e4d256-prod-github-runner-207 kernel: [53100.769872] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 20:08:46 juju-e4d256-prod-github-runner-207 kernel: [53100.770887] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 20:08:46 juju-e4d256-prod-github-runner-207 kernel: [53100.771924] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 20:08:46 juju-e4d256-prod-github-runner-207 kernel: [53100.772889] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 20:08:46 juju-e4d256-prod-github-runner-207 kernel: [53100.773906] ? _raw_spin_lock+0x22/0x30 Aug 22 20:08:46 juju-e4d256-prod-github-runner-207 kernel: [53100.774682] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:08:46 juju-e4d256-prod-github-runner-207 kernel: [53100.775543] direct_page_fault+0x206/0x310 [kvm] Aug 22 20:08:46 juju-e4d256-prod-github-runner-207 kernel: [53100.776389] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 20:08:46 juju-e4d256-prod-github-runner-207 kernel: [53100.777240] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 20:08:46 juju-e4d256-prod-github-runner-207 kernel: [53100.778083] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 20:08:46 juju-e4d256-prod-github-runner-207 kernel: [53100.778913] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 20:08:46 juju-e4d256-prod-github-runner-207 kernel: [53100.779792] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 20:08:46 juju-e4d256-prod-github-runner-207 kernel: [53100.780633] handle_exit+0x98/0x230 [kvm_amd] Aug 22 20:08:46 juju-e4d256-prod-github-runner-207 kernel: [53100.781416] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 20:08:46 juju-e4d256-prod-github-runner-207 kernel: [53100.782234] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 20:08:46 juju-e4d256-prod-github-runner-207 kernel: [53100.783096] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 20:08:46 juju-e4d256-prod-github-runner-207 kernel: [53100.783918] vcpu_run+0x62/0x2c0 [kvm] Aug 22 20:08:46 juju-e4d256-prod-github-runner-207 kernel: [53100.784653] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 20:08:46 juju-e4d256-prod-github-runner-207 kernel: [53100.785391] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 20:08:46 juju-e4d256-prod-github-runner-207 kernel: [53100.786197] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 20:08:46 juju-e4d256-prod-github-runner-207 kernel: [53100.786960] ? __seccomp_filter+0x4a/0x4a0 Aug 22 20:08:46 juju-e4d256-prod-github-runner-207 kernel: [53100.787706] ? __fget_files+0x86/0xc0 Aug 22 20:08:46 juju-e4d256-prod-github-runner-207 kernel: [53100.788414] __x64_sys_ioctl+0x95/0xd0 Aug 22 20:08:46 juju-e4d256-prod-github-runner-207 kernel: [53100.789116] do_syscall_64+0x5c/0xc0 Aug 22 20:08:46 juju-e4d256-prod-github-runner-207 kernel: [53100.790010] ? do_futex+0x162/0x1f0 Aug 22 20:08:46 juju-e4d256-prod-github-runner-207 kernel: [53100.790709] ? __x64_sys_futex+0x78/0x1e0 Aug 22 20:08:46 juju-e4d256-prod-github-runner-207 kernel: [53100.791438] ? __secure_computing+0xa9/0x120 Aug 22 20:08:46 juju-e4d256-prod-github-runner-207 kernel: [53100.792182] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 20:08:46 juju-e4d256-prod-github-runner-207 kernel: [53100.793144] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:08:46 juju-e4d256-prod-github-runner-207 kernel: [53100.793900] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:08:46 juju-e4d256-prod-github-runner-207 kernel: [53100.794887] ? do_syscall_64+0x69/0xc0 Aug 22 20:08:46 juju-e4d256-prod-github-runner-207 kernel: [53100.795635] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:08:46 juju-e4d256-prod-github-runner-207 kernel: [53100.796431] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:08:46 juju-e4d256-prod-github-runner-207 kernel: [53100.797240] ? do_syscall_64+0x69/0xc0 Aug 22 20:08:46 juju-e4d256-prod-github-runner-207 kernel: [53100.797952] ? do_syscall_64+0x69/0xc0 Aug 22 20:08:46 juju-e4d256-prod-github-runner-207 kernel: [53100.798696] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 20:08:46 juju-e4d256-prod-github-runner-207 kernel: [53100.799649] RIP: 0033:0x7faa5d0edaff Aug 22 20:08:46 juju-e4d256-prod-github-runner-207 kernel: [53100.800432] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 20:08:46 juju-e4d256-prod-github-runner-207 kernel: [53100.802620] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 20:08:46 juju-e4d256-prod-github-runner-207 kernel: [53100.803657] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 20:08:46 juju-e4d256-prod-github-runner-207 kernel: [53100.804679] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 20:08:46 juju-e4d256-prod-github-runner-207 kernel: [53100.805636] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 20:08:46 juju-e4d256-prod-github-runner-207 kernel: [53100.806614] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 20:08:46 juju-e4d256-prod-github-runner-207 kernel: [53100.807582] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 20:08:46 juju-e4d256-prod-github-runner-207 kernel: [53100.808511] Aug 22 20:09:14 juju-e4d256-prod-github-runner-207 kernel: [53128.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 49371s! [qemu-system-x86:6715] Aug 22 20:09:14 juju-e4d256-prod-github-runner-207 kernel: [53128.543413] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 20:09:14 juju-e4d256-prod-github-runner-207 kernel: [53128.543636] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 20:09:14 juju-e4d256-prod-github-runner-207 kernel: [53128.556987] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 20:09:14 juju-e4d256-prod-github-runner-207 kernel: [53128.558244] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 20:09:14 juju-e4d256-prod-github-runner-207 kernel: [53128.559474] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:09:14 juju-e4d256-prod-github-runner-207 kernel: [53128.560528] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 20:09:14 juju-e4d256-prod-github-runner-207 kernel: [53128.563109] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 20:09:14 juju-e4d256-prod-github-runner-207 kernel: [53128.564153] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 20:09:14 juju-e4d256-prod-github-runner-207 kernel: [53128.565312] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 20:09:14 juju-e4d256-prod-github-runner-207 kernel: [53128.566468] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 20:09:14 juju-e4d256-prod-github-runner-207 kernel: [53128.567635] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 20:09:14 juju-e4d256-prod-github-runner-207 kernel: [53128.568793] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 20:09:14 juju-e4d256-prod-github-runner-207 kernel: [53128.569957] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 20:09:14 juju-e4d256-prod-github-runner-207 kernel: [53128.571197] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 20:09:14 juju-e4d256-prod-github-runner-207 kernel: [53128.572291] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 20:09:14 juju-e4d256-prod-github-runner-207 kernel: [53128.573488] Call Trace: Aug 22 20:09:14 juju-e4d256-prod-github-runner-207 kernel: [53128.574580] Aug 22 20:09:14 juju-e4d256-prod-github-runner-207 kernel: [53128.575512] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:09:14 juju-e4d256-prod-github-runner-207 kernel: [53128.576557] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:09:14 juju-e4d256-prod-github-runner-207 kernel: [53128.577596] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:09:14 juju-e4d256-prod-github-runner-207 kernel: [53128.578725] ? show_regs.part.0+0x23/0x29 Aug 22 20:09:14 juju-e4d256-prod-github-runner-207 kernel: [53128.579725] ? show_regs.cold+0x8/0xd Aug 22 20:09:14 juju-e4d256-prod-github-runner-207 kernel: [53128.580702] ? watchdog_timer_fn+0x1be/0x220 Aug 22 20:09:14 juju-e4d256-prod-github-runner-207 kernel: [53128.581711] ? lockup_detector_update_enable+0x60/0x60 Aug 22 20:09:14 juju-e4d256-prod-github-runner-207 kernel: [53128.582807] ? __hrtimer_run_queues+0x107/0x230 Aug 22 20:09:14 juju-e4d256-prod-github-runner-207 kernel: [53128.583880] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 20:09:14 juju-e4d256-prod-github-runner-207 kernel: [53128.584913] ? hrtimer_interrupt+0x101/0x220 Aug 22 20:09:14 juju-e4d256-prod-github-runner-207 kernel: [53128.585928] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 20:09:14 juju-e4d256-prod-github-runner-207 kernel: [53128.587027] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 20:09:14 juju-e4d256-prod-github-runner-207 kernel: [53128.588079] Aug 22 20:09:14 juju-e4d256-prod-github-runner-207 kernel: [53128.588933] Aug 22 20:09:14 juju-e4d256-prod-github-runner-207 kernel: [53128.589769] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 20:09:14 juju-e4d256-prod-github-runner-207 kernel: [53128.590843] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:09:14 juju-e4d256-prod-github-runner-207 kernel: [53128.591902] ? _raw_spin_lock+0x22/0x30 Aug 22 20:09:14 juju-e4d256-prod-github-runner-207 kernel: [53128.592860] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:09:14 juju-e4d256-prod-github-runner-207 kernel: [53128.593883] direct_page_fault+0x206/0x310 [kvm] Aug 22 20:09:14 juju-e4d256-prod-github-runner-207 kernel: [53128.594924] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 20:09:14 juju-e4d256-prod-github-runner-207 kernel: [53128.595934] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 20:09:14 juju-e4d256-prod-github-runner-207 kernel: [53128.596940] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 20:09:14 juju-e4d256-prod-github-runner-207 kernel: [53128.598050] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 20:09:14 juju-e4d256-prod-github-runner-207 kernel: [53128.599114] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 20:09:14 juju-e4d256-prod-github-runner-207 kernel: [53128.600195] handle_exit+0x98/0x230 [kvm_amd] Aug 22 20:09:14 juju-e4d256-prod-github-runner-207 kernel: [53128.601171] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 20:09:14 juju-e4d256-prod-github-runner-207 kernel: [53128.602187] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 20:09:14 juju-e4d256-prod-github-runner-207 kernel: [53128.603214] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 20:09:14 juju-e4d256-prod-github-runner-207 kernel: [53128.604224] vcpu_run+0x62/0x2c0 [kvm] Aug 22 20:09:14 juju-e4d256-prod-github-runner-207 kernel: [53128.605110] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 20:09:14 juju-e4d256-prod-github-runner-207 kernel: [53128.606012] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 20:09:14 juju-e4d256-prod-github-runner-207 kernel: [53128.606981] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 20:09:14 juju-e4d256-prod-github-runner-207 kernel: [53128.607863] ? __seccomp_filter+0x4a/0x4a0 Aug 22 20:09:14 juju-e4d256-prod-github-runner-207 kernel: [53128.608689] ? __fget_files+0x86/0xc0 Aug 22 20:09:14 juju-e4d256-prod-github-runner-207 kernel: [53128.609477] __x64_sys_ioctl+0x95/0xd0 Aug 22 20:09:14 juju-e4d256-prod-github-runner-207 kernel: [53128.610278] do_syscall_64+0x5c/0xc0 Aug 22 20:09:14 juju-e4d256-prod-github-runner-207 kernel: [53128.611055] ? do_futex+0x162/0x1f0 Aug 22 20:09:14 juju-e4d256-prod-github-runner-207 kernel: [53128.611784] ? __x64_sys_futex+0x78/0x1e0 Aug 22 20:09:14 juju-e4d256-prod-github-runner-207 kernel: [53128.612539] ? __secure_computing+0xa9/0x120 Aug 22 20:09:14 juju-e4d256-prod-github-runner-207 kernel: [53128.613321] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 20:09:14 juju-e4d256-prod-github-runner-207 kernel: [53128.614192] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:09:14 juju-e4d256-prod-github-runner-207 kernel: [53128.615037] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:09:14 juju-e4d256-prod-github-runner-207 kernel: [53128.615858] ? do_syscall_64+0x69/0xc0 Aug 22 20:09:14 juju-e4d256-prod-github-runner-207 kernel: [53128.616583] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:09:14 juju-e4d256-prod-github-runner-207 kernel: [53128.617388] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:09:14 juju-e4d256-prod-github-runner-207 kernel: [53128.618182] ? do_syscall_64+0x69/0xc0 Aug 22 20:09:14 juju-e4d256-prod-github-runner-207 kernel: [53128.618907] ? do_syscall_64+0x69/0xc0 Aug 22 20:09:14 juju-e4d256-prod-github-runner-207 kernel: [53128.619616] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 20:09:14 juju-e4d256-prod-github-runner-207 kernel: [53128.620430] RIP: 0033:0x7faa5d0edaff Aug 22 20:09:14 juju-e4d256-prod-github-runner-207 kernel: [53128.621159] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 20:09:14 juju-e4d256-prod-github-runner-207 kernel: [53128.623543] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 20:09:14 juju-e4d256-prod-github-runner-207 kernel: [53128.624612] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 20:09:14 juju-e4d256-prod-github-runner-207 kernel: [53128.625654] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 20:09:14 juju-e4d256-prod-github-runner-207 kernel: [53128.626709] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 20:09:14 juju-e4d256-prod-github-runner-207 kernel: [53128.627736] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 20:09:14 juju-e4d256-prod-github-runner-207 kernel: [53128.628766] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 20:09:14 juju-e4d256-prod-github-runner-207 kernel: [53128.629801] Aug 22 20:09:42 juju-e4d256-prod-github-runner-207 kernel: [53156.541981] watchdog: BUG: soft lockup - CPU#1 stuck for 49397s! [qemu-system-x86:6715] Aug 22 20:09:42 juju-e4d256-prod-github-runner-207 kernel: [53156.543699] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 20:09:42 juju-e4d256-prod-github-runner-207 kernel: [53156.543848] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 20:09:42 juju-e4d256-prod-github-runner-207 kernel: [53156.556368] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 20:09:42 juju-e4d256-prod-github-runner-207 kernel: [53156.557715] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 20:09:42 juju-e4d256-prod-github-runner-207 kernel: [53156.559113] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:09:42 juju-e4d256-prod-github-runner-207 kernel: [53156.560417] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 20:09:42 juju-e4d256-prod-github-runner-207 kernel: [53156.563092] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 20:09:42 juju-e4d256-prod-github-runner-207 kernel: [53156.564192] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 20:09:42 juju-e4d256-prod-github-runner-207 kernel: [53156.565394] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 20:09:42 juju-e4d256-prod-github-runner-207 kernel: [53156.566574] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 20:09:42 juju-e4d256-prod-github-runner-207 kernel: [53156.567748] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 20:09:42 juju-e4d256-prod-github-runner-207 kernel: [53156.568919] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 20:09:42 juju-e4d256-prod-github-runner-207 kernel: [53156.570144] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 20:09:42 juju-e4d256-prod-github-runner-207 kernel: [53156.571430] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 20:09:42 juju-e4d256-prod-github-runner-207 kernel: [53156.572551] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 20:09:42 juju-e4d256-prod-github-runner-207 kernel: [53156.573776] Call Trace: Aug 22 20:09:42 juju-e4d256-prod-github-runner-207 kernel: [53156.574732] Aug 22 20:09:42 juju-e4d256-prod-github-runner-207 kernel: [53156.575623] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:09:42 juju-e4d256-prod-github-runner-207 kernel: [53156.576696] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:09:42 juju-e4d256-prod-github-runner-207 kernel: [53156.577734] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:09:42 juju-e4d256-prod-github-runner-207 kernel: [53156.578832] ? show_regs.part.0+0x23/0x29 Aug 22 20:09:42 juju-e4d256-prod-github-runner-207 kernel: [53156.579885] ? show_regs.cold+0x8/0xd Aug 22 20:09:42 juju-e4d256-prod-github-runner-207 kernel: [53156.580876] ? watchdog_timer_fn+0x1be/0x220 Aug 22 20:09:42 juju-e4d256-prod-github-runner-207 kernel: [53156.581893] ? lockup_detector_update_enable+0x60/0x60 Aug 22 20:09:42 juju-e4d256-prod-github-runner-207 kernel: [53156.583015] ? __hrtimer_run_queues+0x107/0x230 Aug 22 20:09:42 juju-e4d256-prod-github-runner-207 kernel: [53156.584055] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 20:09:42 juju-e4d256-prod-github-runner-207 kernel: [53156.585124] ? hrtimer_interrupt+0x101/0x220 Aug 22 20:09:42 juju-e4d256-prod-github-runner-207 kernel: [53156.586140] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 20:09:42 juju-e4d256-prod-github-runner-207 kernel: [53156.587218] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 20:09:42 juju-e4d256-prod-github-runner-207 kernel: [53156.588340] Aug 22 20:09:42 juju-e4d256-prod-github-runner-207 kernel: [53156.589239] Aug 22 20:09:42 juju-e4d256-prod-github-runner-207 kernel: [53156.590096] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 20:09:42 juju-e4d256-prod-github-runner-207 kernel: [53156.591187] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:09:42 juju-e4d256-prod-github-runner-207 kernel: [53156.592246] ? _raw_spin_lock+0x22/0x30 Aug 22 20:09:42 juju-e4d256-prod-github-runner-207 kernel: [53156.593225] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:09:42 juju-e4d256-prod-github-runner-207 kernel: [53156.594245] direct_page_fault+0x206/0x310 [kvm] Aug 22 20:09:42 juju-e4d256-prod-github-runner-207 kernel: [53156.595276] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 20:09:42 juju-e4d256-prod-github-runner-207 kernel: [53156.596295] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 20:09:42 juju-e4d256-prod-github-runner-207 kernel: [53156.597303] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 20:09:42 juju-e4d256-prod-github-runner-207 kernel: [53156.598308] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 20:09:42 juju-e4d256-prod-github-runner-207 kernel: [53156.599286] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 20:09:42 juju-e4d256-prod-github-runner-207 kernel: [53156.600272] handle_exit+0x98/0x230 [kvm_amd] Aug 22 20:09:42 juju-e4d256-prod-github-runner-207 kernel: [53156.601210] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 20:09:42 juju-e4d256-prod-github-runner-207 kernel: [53156.602150] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 20:09:42 juju-e4d256-prod-github-runner-207 kernel: [53156.603169] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 20:09:42 juju-e4d256-prod-github-runner-207 kernel: [53156.604095] vcpu_run+0x62/0x2c0 [kvm] Aug 22 20:09:42 juju-e4d256-prod-github-runner-207 kernel: [53156.604913] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 20:09:42 juju-e4d256-prod-github-runner-207 kernel: [53156.605726] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 20:09:42 juju-e4d256-prod-github-runner-207 kernel: [53156.606612] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 20:09:42 juju-e4d256-prod-github-runner-207 kernel: [53156.607423] ? __seccomp_filter+0x4a/0x4a0 Aug 22 20:09:42 juju-e4d256-prod-github-runner-207 kernel: [53156.608171] ? __fget_files+0x86/0xc0 Aug 22 20:09:42 juju-e4d256-prod-github-runner-207 kernel: [53156.608878] __x64_sys_ioctl+0x95/0xd0 Aug 22 20:09:42 juju-e4d256-prod-github-runner-207 kernel: [53156.609608] do_syscall_64+0x5c/0xc0 Aug 22 20:09:42 juju-e4d256-prod-github-runner-207 kernel: [53156.610325] ? do_futex+0x162/0x1f0 Aug 22 20:09:42 juju-e4d256-prod-github-runner-207 kernel: [53156.611018] ? __x64_sys_futex+0x78/0x1e0 Aug 22 20:09:42 juju-e4d256-prod-github-runner-207 kernel: [53156.611745] ? __secure_computing+0xa9/0x120 Aug 22 20:09:42 juju-e4d256-prod-github-runner-207 kernel: [53156.612448] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 20:09:42 juju-e4d256-prod-github-runner-207 kernel: [53156.613216] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:09:42 juju-e4d256-prod-github-runner-207 kernel: [53156.613995] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:09:42 juju-e4d256-prod-github-runner-207 kernel: [53156.614766] ? do_syscall_64+0x69/0xc0 Aug 22 20:09:42 juju-e4d256-prod-github-runner-207 kernel: [53156.615461] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:09:42 juju-e4d256-prod-github-runner-207 kernel: [53156.616171] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:09:42 juju-e4d256-prod-github-runner-207 kernel: [53156.616891] ? do_syscall_64+0x69/0xc0 Aug 22 20:09:42 juju-e4d256-prod-github-runner-207 kernel: [53156.617528] ? do_syscall_64+0x69/0xc0 Aug 22 20:09:42 juju-e4d256-prod-github-runner-207 kernel: [53156.618211] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 20:09:42 juju-e4d256-prod-github-runner-207 kernel: [53156.618972] RIP: 0033:0x7faa5d0edaff Aug 22 20:09:42 juju-e4d256-prod-github-runner-207 kernel: [53156.619645] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 20:09:42 juju-e4d256-prod-github-runner-207 kernel: [53156.621838] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 20:09:42 juju-e4d256-prod-github-runner-207 kernel: [53156.622900] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 20:09:42 juju-e4d256-prod-github-runner-207 kernel: [53156.623857] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 20:09:42 juju-e4d256-prod-github-runner-207 kernel: [53156.624829] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 20:09:42 juju-e4d256-prod-github-runner-207 kernel: [53156.625790] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 20:09:42 juju-e4d256-prod-github-runner-207 kernel: [53156.626798] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 20:09:42 juju-e4d256-prod-github-runner-207 kernel: [53156.627764] Aug 22 20:10:10 juju-e4d256-prod-github-runner-207 kernel: [53184.541980] watchdog: BUG: soft lockup - CPU#1 stuck for 49423s! [qemu-system-x86:6715] Aug 22 20:10:10 juju-e4d256-prod-github-runner-207 kernel: [53184.543077] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 20:10:10 juju-e4d256-prod-github-runner-207 kernel: [53184.543144] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 20:10:10 juju-e4d256-prod-github-runner-207 kernel: [53184.555340] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 20:10:10 juju-e4d256-prod-github-runner-207 kernel: [53184.556606] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 20:10:10 juju-e4d256-prod-github-runner-207 kernel: [53184.557832] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:10:10 juju-e4d256-prod-github-runner-207 kernel: [53184.558892] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 20:10:10 juju-e4d256-prod-github-runner-207 kernel: [53184.561432] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 20:10:10 juju-e4d256-prod-github-runner-207 kernel: [53184.562484] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 20:10:10 juju-e4d256-prod-github-runner-207 kernel: [53184.563644] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 20:10:10 juju-e4d256-prod-github-runner-207 kernel: [53184.564801] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 20:10:10 juju-e4d256-prod-github-runner-207 kernel: [53184.565958] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 20:10:10 juju-e4d256-prod-github-runner-207 kernel: [53184.567135] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 20:10:10 juju-e4d256-prod-github-runner-207 kernel: [53184.568300] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 20:10:10 juju-e4d256-prod-github-runner-207 kernel: [53184.569537] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 20:10:10 juju-e4d256-prod-github-runner-207 kernel: [53184.570647] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 20:10:10 juju-e4d256-prod-github-runner-207 kernel: [53184.571844] Call Trace: Aug 22 20:10:10 juju-e4d256-prod-github-runner-207 kernel: [53184.572753] Aug 22 20:10:10 juju-e4d256-prod-github-runner-207 kernel: [53184.573635] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:10:10 juju-e4d256-prod-github-runner-207 kernel: [53184.574672] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:10:10 juju-e4d256-prod-github-runner-207 kernel: [53184.575707] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:10:10 juju-e4d256-prod-github-runner-207 kernel: [53184.576802] ? show_regs.part.0+0x23/0x29 Aug 22 20:10:10 juju-e4d256-prod-github-runner-207 kernel: [53184.577835] ? show_regs.cold+0x8/0xd Aug 22 20:10:10 juju-e4d256-prod-github-runner-207 kernel: [53184.578834] ? watchdog_timer_fn+0x1be/0x220 Aug 22 20:10:10 juju-e4d256-prod-github-runner-207 kernel: [53184.579859] ? lockup_detector_update_enable+0x60/0x60 Aug 22 20:10:10 juju-e4d256-prod-github-runner-207 kernel: [53184.580931] ? __hrtimer_run_queues+0x107/0x230 Aug 22 20:10:10 juju-e4d256-prod-github-runner-207 kernel: [53184.581999] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 20:10:10 juju-e4d256-prod-github-runner-207 kernel: [53184.583038] ? hrtimer_interrupt+0x101/0x220 Aug 22 20:10:10 juju-e4d256-prod-github-runner-207 kernel: [53184.584060] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 20:10:10 juju-e4d256-prod-github-runner-207 kernel: [53184.585146] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 20:10:10 juju-e4d256-prod-github-runner-207 kernel: [53184.586236] Aug 22 20:10:10 juju-e4d256-prod-github-runner-207 kernel: [53184.587100] Aug 22 20:10:10 juju-e4d256-prod-github-runner-207 kernel: [53184.587947] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 20:10:10 juju-e4d256-prod-github-runner-207 kernel: [53184.589000] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:10:10 juju-e4d256-prod-github-runner-207 kernel: [53184.590062] ? _raw_spin_lock+0x22/0x30 Aug 22 20:10:10 juju-e4d256-prod-github-runner-207 kernel: [53184.591090] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:10:10 juju-e4d256-prod-github-runner-207 kernel: [53184.592120] direct_page_fault+0x206/0x310 [kvm] Aug 22 20:10:10 juju-e4d256-prod-github-runner-207 kernel: [53184.593162] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 20:10:10 juju-e4d256-prod-github-runner-207 kernel: [53184.594206] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 20:10:10 juju-e4d256-prod-github-runner-207 kernel: [53184.595216] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 20:10:10 juju-e4d256-prod-github-runner-207 kernel: [53184.596193] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 20:10:10 juju-e4d256-prod-github-runner-207 kernel: [53184.597143] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 20:10:10 juju-e4d256-prod-github-runner-207 kernel: [53184.598141] handle_exit+0x98/0x230 [kvm_amd] Aug 22 20:10:10 juju-e4d256-prod-github-runner-207 kernel: [53184.599037] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 20:10:10 juju-e4d256-prod-github-runner-207 kernel: [53184.599949] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 20:10:10 juju-e4d256-prod-github-runner-207 kernel: [53184.600870] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 20:10:10 juju-e4d256-prod-github-runner-207 kernel: [53184.601771] vcpu_run+0x62/0x2c0 [kvm] Aug 22 20:10:10 juju-e4d256-prod-github-runner-207 kernel: [53184.602591] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 20:10:10 juju-e4d256-prod-github-runner-207 kernel: [53184.603395] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 20:10:10 juju-e4d256-prod-github-runner-207 kernel: [53184.604250] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 20:10:10 juju-e4d256-prod-github-runner-207 kernel: [53184.605044] ? __seccomp_filter+0x4a/0x4a0 Aug 22 20:10:10 juju-e4d256-prod-github-runner-207 kernel: [53184.605785] ? __fget_files+0x86/0xc0 Aug 22 20:10:10 juju-e4d256-prod-github-runner-207 kernel: [53184.606492] __x64_sys_ioctl+0x95/0xd0 Aug 22 20:10:10 juju-e4d256-prod-github-runner-207 kernel: [53184.607183] do_syscall_64+0x5c/0xc0 Aug 22 20:10:10 juju-e4d256-prod-github-runner-207 kernel: [53184.607846] ? do_futex+0x162/0x1f0 Aug 22 20:10:10 juju-e4d256-prod-github-runner-207 kernel: [53184.608490] ? __x64_sys_futex+0x78/0x1e0 Aug 22 20:10:10 juju-e4d256-prod-github-runner-207 kernel: [53184.609162] ? __secure_computing+0xa9/0x120 Aug 22 20:10:10 juju-e4d256-prod-github-runner-207 kernel: [53184.609849] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 20:10:10 juju-e4d256-prod-github-runner-207 kernel: [53184.610615] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:10:10 juju-e4d256-prod-github-runner-207 kernel: [53184.611335] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:10:10 juju-e4d256-prod-github-runner-207 kernel: [53184.612051] ? do_syscall_64+0x69/0xc0 Aug 22 20:10:10 juju-e4d256-prod-github-runner-207 kernel: [53184.612695] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:10:10 juju-e4d256-prod-github-runner-207 kernel: [53184.613396] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:10:10 juju-e4d256-prod-github-runner-207 kernel: [53184.614095] ? do_syscall_64+0x69/0xc0 Aug 22 20:10:10 juju-e4d256-prod-github-runner-207 kernel: [53184.614724] ? do_syscall_64+0x69/0xc0 Aug 22 20:10:10 juju-e4d256-prod-github-runner-207 kernel: [53184.615344] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 20:10:10 juju-e4d256-prod-github-runner-207 kernel: [53184.616046] RIP: 0033:0x7faa5d0edaff Aug 22 20:10:10 juju-e4d256-prod-github-runner-207 kernel: [53184.616672] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 20:10:10 juju-e4d256-prod-github-runner-207 kernel: [53184.618665] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 20:10:10 juju-e4d256-prod-github-runner-207 kernel: [53184.619574] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 20:10:10 juju-e4d256-prod-github-runner-207 kernel: [53184.620465] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 20:10:10 juju-e4d256-prod-github-runner-207 kernel: [53184.621353] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 20:10:10 juju-e4d256-prod-github-runner-207 kernel: [53184.622247] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 20:10:10 juju-e4d256-prod-github-runner-207 kernel: [53184.623136] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 20:10:10 juju-e4d256-prod-github-runner-207 kernel: [53184.624028] Aug 22 20:10:38 juju-e4d256-prod-github-runner-207 kernel: [53212.541981] watchdog: BUG: soft lockup - CPU#1 stuck for 49450s! [qemu-system-x86:6715] Aug 22 20:10:38 juju-e4d256-prod-github-runner-207 kernel: [53212.543365] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 20:10:38 juju-e4d256-prod-github-runner-207 kernel: [53212.543534] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 20:10:38 juju-e4d256-prod-github-runner-207 kernel: [53212.558054] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 20:10:38 juju-e4d256-prod-github-runner-207 kernel: [53212.559504] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 20:10:38 juju-e4d256-prod-github-runner-207 kernel: [53212.560899] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:10:38 juju-e4d256-prod-github-runner-207 kernel: [53212.562098] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 20:10:38 juju-e4d256-prod-github-runner-207 kernel: [53212.564995] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 20:10:38 juju-e4d256-prod-github-runner-207 kernel: [53212.566160] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 20:10:38 juju-e4d256-prod-github-runner-207 kernel: [53212.567476] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 20:10:38 juju-e4d256-prod-github-runner-207 kernel: [53212.568767] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 20:10:38 juju-e4d256-prod-github-runner-207 kernel: [53212.570102] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 20:10:38 juju-e4d256-prod-github-runner-207 kernel: [53212.571402] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 20:10:38 juju-e4d256-prod-github-runner-207 kernel: [53212.572703] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 20:10:38 juju-e4d256-prod-github-runner-207 kernel: [53212.573988] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 20:10:38 juju-e4d256-prod-github-runner-207 kernel: [53212.575092] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 20:10:38 juju-e4d256-prod-github-runner-207 kernel: [53212.576309] Call Trace: Aug 22 20:10:38 juju-e4d256-prod-github-runner-207 kernel: [53212.577226] Aug 22 20:10:38 juju-e4d256-prod-github-runner-207 kernel: [53212.578147] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:10:38 juju-e4d256-prod-github-runner-207 kernel: [53212.579297] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:10:38 juju-e4d256-prod-github-runner-207 kernel: [53212.580423] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:10:38 juju-e4d256-prod-github-runner-207 kernel: [53212.581657] ? show_regs.part.0+0x23/0x29 Aug 22 20:10:38 juju-e4d256-prod-github-runner-207 kernel: [53212.582743] ? show_regs.cold+0x8/0xd Aug 22 20:10:38 juju-e4d256-prod-github-runner-207 kernel: [53212.583808] ? watchdog_timer_fn+0x1be/0x220 Aug 22 20:10:38 juju-e4d256-prod-github-runner-207 kernel: [53212.584963] ? lockup_detector_update_enable+0x60/0x60 Aug 22 20:10:38 juju-e4d256-prod-github-runner-207 kernel: [53212.586216] ? __hrtimer_run_queues+0x107/0x230 Aug 22 20:10:38 juju-e4d256-prod-github-runner-207 kernel: [53212.587349] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 20:10:38 juju-e4d256-prod-github-runner-207 kernel: [53212.588466] ? hrtimer_interrupt+0x101/0x220 Aug 22 20:10:38 juju-e4d256-prod-github-runner-207 kernel: [53212.589595] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 20:10:38 juju-e4d256-prod-github-runner-207 kernel: [53212.590863] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 20:10:38 juju-e4d256-prod-github-runner-207 kernel: [53212.592029] Aug 22 20:10:38 juju-e4d256-prod-github-runner-207 kernel: [53212.592934] Aug 22 20:10:38 juju-e4d256-prod-github-runner-207 kernel: [53212.593872] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 20:10:38 juju-e4d256-prod-github-runner-207 kernel: [53212.595052] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:10:38 juju-e4d256-prod-github-runner-207 kernel: [53212.596225] ? _raw_spin_lock+0x22/0x30 Aug 22 20:10:38 juju-e4d256-prod-github-runner-207 kernel: [53212.597249] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:10:38 juju-e4d256-prod-github-runner-207 kernel: [53212.598394] direct_page_fault+0x206/0x310 [kvm] Aug 22 20:10:38 juju-e4d256-prod-github-runner-207 kernel: [53212.599531] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 20:10:38 juju-e4d256-prod-github-runner-207 kernel: [53212.600629] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 20:10:38 juju-e4d256-prod-github-runner-207 kernel: [53212.601748] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 20:10:38 juju-e4d256-prod-github-runner-207 kernel: [53212.602871] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 20:10:38 juju-e4d256-prod-github-runner-207 kernel: [53212.603917] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 20:10:38 juju-e4d256-prod-github-runner-207 kernel: [53212.605012] handle_exit+0x98/0x230 [kvm_amd] Aug 22 20:10:38 juju-e4d256-prod-github-runner-207 kernel: [53212.606031] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 20:10:38 juju-e4d256-prod-github-runner-207 kernel: [53212.607044] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 20:10:38 juju-e4d256-prod-github-runner-207 kernel: [53212.608110] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 20:10:38 juju-e4d256-prod-github-runner-207 kernel: [53212.609158] vcpu_run+0x62/0x2c0 [kvm] Aug 22 20:10:38 juju-e4d256-prod-github-runner-207 kernel: [53212.610101] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 20:10:38 juju-e4d256-prod-github-runner-207 kernel: [53212.611010] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 20:10:38 juju-e4d256-prod-github-runner-207 kernel: [53212.611981] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 20:10:38 juju-e4d256-prod-github-runner-207 kernel: [53212.612872] ? __seccomp_filter+0x4a/0x4a0 Aug 22 20:10:38 juju-e4d256-prod-github-runner-207 kernel: [53212.613675] ? __fget_files+0x86/0xc0 Aug 22 20:10:38 juju-e4d256-prod-github-runner-207 kernel: [53212.614414] __x64_sys_ioctl+0x95/0xd0 Aug 22 20:10:38 juju-e4d256-prod-github-runner-207 kernel: [53212.615119] do_syscall_64+0x5c/0xc0 Aug 22 20:10:38 juju-e4d256-prod-github-runner-207 kernel: [53212.615998] ? do_futex+0x162/0x1f0 Aug 22 20:10:38 juju-e4d256-prod-github-runner-207 kernel: [53212.616656] ? __x64_sys_futex+0x78/0x1e0 Aug 22 20:10:38 juju-e4d256-prod-github-runner-207 kernel: [53212.617336] ? __secure_computing+0xa9/0x120 Aug 22 20:10:38 juju-e4d256-prod-github-runner-207 kernel: [53212.618262] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 20:10:38 juju-e4d256-prod-github-runner-207 kernel: [53212.619044] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:10:38 juju-e4d256-prod-github-runner-207 kernel: [53212.619989] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:10:38 juju-e4d256-prod-github-runner-207 kernel: [53212.620755] ? do_syscall_64+0x69/0xc0 Aug 22 20:10:38 juju-e4d256-prod-github-runner-207 kernel: [53212.621496] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:10:38 juju-e4d256-prod-github-runner-207 kernel: [53212.622247] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:10:38 juju-e4d256-prod-github-runner-207 kernel: [53212.622946] ? do_syscall_64+0x69/0xc0 Aug 22 20:10:38 juju-e4d256-prod-github-runner-207 kernel: [53212.623599] ? do_syscall_64+0x69/0xc0 Aug 22 20:10:38 juju-e4d256-prod-github-runner-207 kernel: [53212.624241] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 20:10:38 juju-e4d256-prod-github-runner-207 kernel: [53212.624968] RIP: 0033:0x7faa5d0edaff Aug 22 20:10:38 juju-e4d256-prod-github-runner-207 kernel: [53212.625598] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 20:10:38 juju-e4d256-prod-github-runner-207 kernel: [53212.627632] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 20:10:38 juju-e4d256-prod-github-runner-207 kernel: [53212.628571] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 20:10:38 juju-e4d256-prod-github-runner-207 kernel: [53212.629485] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 20:10:38 juju-e4d256-prod-github-runner-207 kernel: [53212.630464] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 20:10:38 juju-e4d256-prod-github-runner-207 kernel: [53212.631394] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 20:10:38 juju-e4d256-prod-github-runner-207 kernel: [53212.632291] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 20:10:38 juju-e4d256-prod-github-runner-207 kernel: [53212.633191] Aug 22 20:11:06 juju-e4d256-prod-github-runner-207 kernel: [53240.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 49476s! [qemu-system-x86:6715] Aug 22 20:11:06 juju-e4d256-prod-github-runner-207 kernel: [53240.543965] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 20:11:06 juju-e4d256-prod-github-runner-207 kernel: [53240.544166] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 20:11:06 juju-e4d256-prod-github-runner-207 kernel: [53240.557474] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 20:11:06 juju-e4d256-prod-github-runner-207 kernel: [53240.558945] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 20:11:06 juju-e4d256-prod-github-runner-207 kernel: [53240.560349] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:11:06 juju-e4d256-prod-github-runner-207 kernel: [53240.561566] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 20:11:06 juju-e4d256-prod-github-runner-207 kernel: [53240.564461] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 20:11:06 juju-e4d256-prod-github-runner-207 kernel: [53240.565631] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 20:11:06 juju-e4d256-prod-github-runner-207 kernel: [53240.566941] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 20:11:06 juju-e4d256-prod-github-runner-207 kernel: [53240.568244] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 20:11:06 juju-e4d256-prod-github-runner-207 kernel: [53240.569571] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 20:11:06 juju-e4d256-prod-github-runner-207 kernel: [53240.570904] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 20:11:06 juju-e4d256-prod-github-runner-207 kernel: [53240.572239] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 20:11:06 juju-e4d256-prod-github-runner-207 kernel: [53240.573663] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 20:11:06 juju-e4d256-prod-github-runner-207 kernel: [53240.574883] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 20:11:06 juju-e4d256-prod-github-runner-207 kernel: [53240.576216] Call Trace: Aug 22 20:11:06 juju-e4d256-prod-github-runner-207 kernel: [53240.577188] Aug 22 20:11:06 juju-e4d256-prod-github-runner-207 kernel: [53240.578164] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:11:06 juju-e4d256-prod-github-runner-207 kernel: [53240.579289] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:11:06 juju-e4d256-prod-github-runner-207 kernel: [53240.580398] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:11:06 juju-e4d256-prod-github-runner-207 kernel: [53240.581666] ? show_regs.part.0+0x23/0x29 Aug 22 20:11:06 juju-e4d256-prod-github-runner-207 kernel: [53240.582771] ? show_regs.cold+0x8/0xd Aug 22 20:11:06 juju-e4d256-prod-github-runner-207 kernel: [53240.583827] ? watchdog_timer_fn+0x1be/0x220 Aug 22 20:11:06 juju-e4d256-prod-github-runner-207 kernel: [53240.584922] ? lockup_detector_update_enable+0x60/0x60 Aug 22 20:11:06 juju-e4d256-prod-github-runner-207 kernel: [53240.586123] ? __hrtimer_run_queues+0x107/0x230 Aug 22 20:11:06 juju-e4d256-prod-github-runner-207 kernel: [53240.587248] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 20:11:06 juju-e4d256-prod-github-runner-207 kernel: [53240.588364] ? hrtimer_interrupt+0x101/0x220 Aug 22 20:11:06 juju-e4d256-prod-github-runner-207 kernel: [53240.589495] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 20:11:06 juju-e4d256-prod-github-runner-207 kernel: [53240.590668] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 20:11:06 juju-e4d256-prod-github-runner-207 kernel: [53240.591813] Aug 22 20:11:06 juju-e4d256-prod-github-runner-207 kernel: [53240.592714] Aug 22 20:11:06 juju-e4d256-prod-github-runner-207 kernel: [53240.593622] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 20:11:06 juju-e4d256-prod-github-runner-207 kernel: [53240.594764] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:11:06 juju-e4d256-prod-github-runner-207 kernel: [53240.595924] ? _raw_spin_lock+0x22/0x30 Aug 22 20:11:06 juju-e4d256-prod-github-runner-207 kernel: [53240.596953] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:11:06 juju-e4d256-prod-github-runner-207 kernel: [53240.600186] direct_page_fault+0x206/0x310 [kvm] Aug 22 20:11:06 juju-e4d256-prod-github-runner-207 kernel: [53240.601349] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 20:11:06 juju-e4d256-prod-github-runner-207 kernel: [53240.602456] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 20:11:06 juju-e4d256-prod-github-runner-207 kernel: [53240.603559] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 20:11:06 juju-e4d256-prod-github-runner-207 kernel: [53240.604667] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 20:11:06 juju-e4d256-prod-github-runner-207 kernel: [53240.605749] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 20:11:06 juju-e4d256-prod-github-runner-207 kernel: [53240.606844] handle_exit+0x98/0x230 [kvm_amd] Aug 22 20:11:06 juju-e4d256-prod-github-runner-207 kernel: [53240.607843] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 20:11:06 juju-e4d256-prod-github-runner-207 kernel: [53240.608876] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 20:11:06 juju-e4d256-prod-github-runner-207 kernel: [53240.609949] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 20:11:06 juju-e4d256-prod-github-runner-207 kernel: [53240.610951] vcpu_run+0x62/0x2c0 [kvm] Aug 22 20:11:06 juju-e4d256-prod-github-runner-207 kernel: [53240.611835] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 20:11:06 juju-e4d256-prod-github-runner-207 kernel: [53240.612748] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 20:11:06 juju-e4d256-prod-github-runner-207 kernel: [53240.613741] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 20:11:06 juju-e4d256-prod-github-runner-207 kernel: [53240.614664] ? __seccomp_filter+0x4a/0x4a0 Aug 22 20:11:06 juju-e4d256-prod-github-runner-207 kernel: [53240.615511] ? __fget_files+0x86/0xc0 Aug 22 20:11:06 juju-e4d256-prod-github-runner-207 kernel: [53240.616298] __x64_sys_ioctl+0x95/0xd0 Aug 22 20:11:06 juju-e4d256-prod-github-runner-207 kernel: [53240.617075] do_syscall_64+0x5c/0xc0 Aug 22 20:11:06 juju-e4d256-prod-github-runner-207 kernel: [53240.617838] ? do_futex+0x162/0x1f0 Aug 22 20:11:06 juju-e4d256-prod-github-runner-207 kernel: [53240.618566] ? __x64_sys_futex+0x78/0x1e0 Aug 22 20:11:06 juju-e4d256-prod-github-runner-207 kernel: [53240.619323] ? __secure_computing+0xa9/0x120 Aug 22 20:11:06 juju-e4d256-prod-github-runner-207 kernel: [53240.620101] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 20:11:06 juju-e4d256-prod-github-runner-207 kernel: [53240.620973] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:11:06 juju-e4d256-prod-github-runner-207 kernel: [53240.621830] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:11:06 juju-e4d256-prod-github-runner-207 kernel: [53240.622653] ? do_syscall_64+0x69/0xc0 Aug 22 20:11:06 juju-e4d256-prod-github-runner-207 kernel: [53240.623386] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:11:06 juju-e4d256-prod-github-runner-207 kernel: [53240.624194] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:11:06 juju-e4d256-prod-github-runner-207 kernel: [53240.624994] ? do_syscall_64+0x69/0xc0 Aug 22 20:11:06 juju-e4d256-prod-github-runner-207 kernel: [53240.625727] ? do_syscall_64+0x69/0xc0 Aug 22 20:11:06 juju-e4d256-prod-github-runner-207 kernel: [53240.626436] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 20:11:06 juju-e4d256-prod-github-runner-207 kernel: [53240.627267] RIP: 0033:0x7faa5d0edaff Aug 22 20:11:06 juju-e4d256-prod-github-runner-207 kernel: [53240.628034] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 20:11:06 juju-e4d256-prod-github-runner-207 kernel: [53240.630439] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 20:11:06 juju-e4d256-prod-github-runner-207 kernel: [53240.631503] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 20:11:06 juju-e4d256-prod-github-runner-207 kernel: [53240.632555] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 20:11:06 juju-e4d256-prod-github-runner-207 kernel: [53240.633635] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 20:11:06 juju-e4d256-prod-github-runner-207 kernel: [53240.634672] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 20:11:06 juju-e4d256-prod-github-runner-207 kernel: [53240.635697] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 20:11:06 juju-e4d256-prod-github-runner-207 kernel: [53240.636730] Aug 22 20:11:34 juju-e4d256-prod-github-runner-207 kernel: [53268.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 49502s! [qemu-system-x86:6715] Aug 22 20:11:34 juju-e4d256-prod-github-runner-207 kernel: [53268.543313] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 20:11:34 juju-e4d256-prod-github-runner-207 kernel: [53268.543379] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 20:11:34 juju-e4d256-prod-github-runner-207 kernel: [53268.557654] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 20:11:34 juju-e4d256-prod-github-runner-207 kernel: [53268.559142] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 20:11:34 juju-e4d256-prod-github-runner-207 kernel: [53268.560551] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:11:34 juju-e4d256-prod-github-runner-207 kernel: [53268.561770] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 20:11:34 juju-e4d256-prod-github-runner-207 kernel: [53268.564717] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 20:11:34 juju-e4d256-prod-github-runner-207 kernel: [53268.565950] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 20:11:34 juju-e4d256-prod-github-runner-207 kernel: [53268.567278] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 20:11:34 juju-e4d256-prod-github-runner-207 kernel: [53268.568601] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 20:11:34 juju-e4d256-prod-github-runner-207 kernel: [53268.569948] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 20:11:34 juju-e4d256-prod-github-runner-207 kernel: [53268.571267] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 20:11:34 juju-e4d256-prod-github-runner-207 kernel: [53268.572587] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 20:11:34 juju-e4d256-prod-github-runner-207 kernel: [53268.574027] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 20:11:34 juju-e4d256-prod-github-runner-207 kernel: [53268.575258] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 20:11:34 juju-e4d256-prod-github-runner-207 kernel: [53268.576599] Call Trace: Aug 22 20:11:34 juju-e4d256-prod-github-runner-207 kernel: [53268.577606] Aug 22 20:11:34 juju-e4d256-prod-github-runner-207 kernel: [53268.578564] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:11:34 juju-e4d256-prod-github-runner-207 kernel: [53268.579784] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:11:34 juju-e4d256-prod-github-runner-207 kernel: [53268.580991] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:11:34 juju-e4d256-prod-github-runner-207 kernel: [53268.582317] ? show_regs.part.0+0x23/0x29 Aug 22 20:11:34 juju-e4d256-prod-github-runner-207 kernel: [53268.583606] ? show_regs.cold+0x8/0xd Aug 22 20:11:34 juju-e4d256-prod-github-runner-207 kernel: [53268.584704] ? watchdog_timer_fn+0x1be/0x220 Aug 22 20:11:34 juju-e4d256-prod-github-runner-207 kernel: [53268.586057] ? lockup_detector_update_enable+0x60/0x60 Aug 22 20:11:34 juju-e4d256-prod-github-runner-207 kernel: [53268.587416] ? __hrtimer_run_queues+0x107/0x230 Aug 22 20:11:34 juju-e4d256-prod-github-runner-207 kernel: [53268.588487] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 20:11:34 juju-e4d256-prod-github-runner-207 kernel: [53268.589540] ? hrtimer_interrupt+0x101/0x220 Aug 22 20:11:34 juju-e4d256-prod-github-runner-207 kernel: [53268.590580] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 20:11:34 juju-e4d256-prod-github-runner-207 kernel: [53268.591652] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 20:11:34 juju-e4d256-prod-github-runner-207 kernel: [53268.592703] Aug 22 20:11:34 juju-e4d256-prod-github-runner-207 kernel: [53268.593594] Aug 22 20:11:34 juju-e4d256-prod-github-runner-207 kernel: [53268.594446] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 20:11:34 juju-e4d256-prod-github-runner-207 kernel: [53268.595481] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:11:34 juju-e4d256-prod-github-runner-207 kernel: [53268.596527] ? _raw_spin_lock+0x22/0x30 Aug 22 20:11:34 juju-e4d256-prod-github-runner-207 kernel: [53268.597496] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:11:34 juju-e4d256-prod-github-runner-207 kernel: [53268.598525] direct_page_fault+0x206/0x310 [kvm] Aug 22 20:11:34 juju-e4d256-prod-github-runner-207 kernel: [53268.599554] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 20:11:34 juju-e4d256-prod-github-runner-207 kernel: [53268.600569] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 20:11:34 juju-e4d256-prod-github-runner-207 kernel: [53268.601678] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 20:11:34 juju-e4d256-prod-github-runner-207 kernel: [53268.602661] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 20:11:34 juju-e4d256-prod-github-runner-207 kernel: [53268.603614] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 20:11:34 juju-e4d256-prod-github-runner-207 kernel: [53268.604596] handle_exit+0x98/0x230 [kvm_amd] Aug 22 20:11:34 juju-e4d256-prod-github-runner-207 kernel: [53268.605558] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 20:11:34 juju-e4d256-prod-github-runner-207 kernel: [53268.606659] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 20:11:34 juju-e4d256-prod-github-runner-207 kernel: [53268.607587] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 20:11:34 juju-e4d256-prod-github-runner-207 kernel: [53268.608648] vcpu_run+0x62/0x2c0 [kvm] Aug 22 20:11:34 juju-e4d256-prod-github-runner-207 kernel: [53268.609477] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 20:11:34 juju-e4d256-prod-github-runner-207 kernel: [53268.610320] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 20:11:34 juju-e4d256-prod-github-runner-207 kernel: [53268.611183] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 20:11:34 juju-e4d256-prod-github-runner-207 kernel: [53268.612013] ? __seccomp_filter+0x4a/0x4a0 Aug 22 20:11:34 juju-e4d256-prod-github-runner-207 kernel: [53268.612772] ? __fget_files+0x86/0xc0 Aug 22 20:11:34 juju-e4d256-prod-github-runner-207 kernel: [53268.613510] __x64_sys_ioctl+0x95/0xd0 Aug 22 20:11:34 juju-e4d256-prod-github-runner-207 kernel: [53268.614210] do_syscall_64+0x5c/0xc0 Aug 22 20:11:34 juju-e4d256-prod-github-runner-207 kernel: [53268.614880] ? do_futex+0x162/0x1f0 Aug 22 20:11:34 juju-e4d256-prod-github-runner-207 kernel: [53268.615537] ? __x64_sys_futex+0x78/0x1e0 Aug 22 20:11:34 juju-e4d256-prod-github-runner-207 kernel: [53268.616214] ? __secure_computing+0xa9/0x120 Aug 22 20:11:34 juju-e4d256-prod-github-runner-207 kernel: [53268.616931] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 20:11:34 juju-e4d256-prod-github-runner-207 kernel: [53268.617695] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:11:34 juju-e4d256-prod-github-runner-207 kernel: [53268.618424] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:11:34 juju-e4d256-prod-github-runner-207 kernel: [53268.619157] ? do_syscall_64+0x69/0xc0 Aug 22 20:11:34 juju-e4d256-prod-github-runner-207 kernel: [53268.619805] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:11:34 juju-e4d256-prod-github-runner-207 kernel: [53268.620516] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:11:34 juju-e4d256-prod-github-runner-207 kernel: [53268.621238] ? do_syscall_64+0x69/0xc0 Aug 22 20:11:34 juju-e4d256-prod-github-runner-207 kernel: [53268.621866] ? do_syscall_64+0x69/0xc0 Aug 22 20:11:34 juju-e4d256-prod-github-runner-207 kernel: [53268.622678] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 20:11:34 juju-e4d256-prod-github-runner-207 kernel: [53268.623388] RIP: 0033:0x7faa5d0edaff Aug 22 20:11:34 juju-e4d256-prod-github-runner-207 kernel: [53268.624036] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 20:11:34 juju-e4d256-prod-github-runner-207 kernel: [53268.626053] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 20:11:34 juju-e4d256-prod-github-runner-207 kernel: [53268.627057] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 20:11:34 juju-e4d256-prod-github-runner-207 kernel: [53268.627970] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 20:11:34 juju-e4d256-prod-github-runner-207 kernel: [53268.628865] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 20:11:34 juju-e4d256-prod-github-runner-207 kernel: [53268.629776] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 20:11:34 juju-e4d256-prod-github-runner-207 kernel: [53268.630664] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 20:11:34 juju-e4d256-prod-github-runner-207 kernel: [53268.631740] Aug 22 20:11:46 juju-e4d256-prod-github-runner-207 kernel: [53280.740715] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 20:11:46 juju-e4d256-prod-github-runner-207 kernel: [53280.742219] rcu: 1-....: (13249020 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=6404478 Aug 22 20:11:46 juju-e4d256-prod-github-runner-207 kernel: [53280.743353] (t=13290885 jiffies g=23269 q=49630) Aug 22 20:11:46 juju-e4d256-prod-github-runner-207 kernel: [53280.744190] NMI backtrace for cpu 1 Aug 22 20:11:46 juju-e4d256-prod-github-runner-207 kernel: [53280.744952] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 20:11:46 juju-e4d256-prod-github-runner-207 kernel: [53280.746053] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 20:11:46 juju-e4d256-prod-github-runner-207 kernel: [53280.747110] Call Trace: Aug 22 20:11:46 juju-e4d256-prod-github-runner-207 kernel: [53280.747789] Aug 22 20:11:46 juju-e4d256-prod-github-runner-207 kernel: [53280.748432] show_stack+0x52/0x5c Aug 22 20:11:46 juju-e4d256-prod-github-runner-207 kernel: [53280.749171] dump_stack_lvl+0x4a/0x63 Aug 22 20:11:46 juju-e4d256-prod-github-runner-207 kernel: [53280.749915] dump_stack+0x10/0x16 Aug 22 20:11:46 juju-e4d256-prod-github-runner-207 kernel: [53280.750633] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 20:11:46 juju-e4d256-prod-github-runner-207 kernel: [53280.751460] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 20:11:46 juju-e4d256-prod-github-runner-207 kernel: [53280.752546] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 20:11:46 juju-e4d256-prod-github-runner-207 kernel: [53280.753697] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 20:11:46 juju-e4d256-prod-github-runner-207 kernel: [53280.754805] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 20:11:46 juju-e4d256-prod-github-runner-207 kernel: [53280.755886] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 20:11:46 juju-e4d256-prod-github-runner-207 kernel: [53280.756669] print_cpu_stall.cold+0x2f/0xe2 Aug 22 20:11:46 juju-e4d256-prod-github-runner-207 kernel: [53280.757454] ? timekeeping_update+0xf7/0x150 Aug 22 20:11:46 juju-e4d256-prod-github-runner-207 kernel: [53280.758225] check_cpu_stall+0x109/0x270 Aug 22 20:11:46 juju-e4d256-prod-github-runner-207 kernel: [53280.758973] rcu_sched_clock_irq+0x9a/0x250 Aug 22 20:11:46 juju-e4d256-prod-github-runner-207 kernel: [53280.759770] update_process_times+0x94/0xd0 Aug 22 20:11:46 juju-e4d256-prod-github-runner-207 kernel: [53280.760675] tick_sched_handle+0x29/0x70 Aug 22 20:11:46 juju-e4d256-prod-github-runner-207 kernel: [53280.761700] tick_sched_timer+0x8c/0xc0 Aug 22 20:11:46 juju-e4d256-prod-github-runner-207 kernel: [53280.762694] ? tick_nohz_handler+0xb0/0xb0 Aug 22 20:11:46 juju-e4d256-prod-github-runner-207 kernel: [53280.763737] __hrtimer_run_queues+0x107/0x230 Aug 22 20:11:46 juju-e4d256-prod-github-runner-207 kernel: [53280.764820] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 20:11:46 juju-e4d256-prod-github-runner-207 kernel: [53280.765726] hrtimer_interrupt+0x101/0x220 Aug 22 20:11:46 juju-e4d256-prod-github-runner-207 kernel: [53280.766487] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 20:11:46 juju-e4d256-prod-github-runner-207 kernel: [53280.767306] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 20:11:46 juju-e4d256-prod-github-runner-207 kernel: [53280.768109] Aug 22 20:11:46 juju-e4d256-prod-github-runner-207 kernel: [53280.768764] Aug 22 20:11:46 juju-e4d256-prod-github-runner-207 kernel: [53280.769403] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 20:11:46 juju-e4d256-prod-github-runner-207 kernel: [53280.770222] RIP: 0010:native_queued_spin_lock_slowpath+0xc/0x40 Aug 22 20:11:46 juju-e4d256-prod-github-runner-207 kernel: [53280.771099] Code: fe ff ff eb af 4c 89 fe 48 c7 c7 20 99 e9 89 e8 ca 69 55 00 e9 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 <8b> 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 eb Aug 22 20:11:46 juju-e4d256-prod-github-runner-207 kernel: [53280.773346] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 20:11:46 juju-e4d256-prod-github-runner-207 kernel: [53280.774223] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 20:11:46 juju-e4d256-prod-github-runner-207 kernel: [53280.775450] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 20:11:46 juju-e4d256-prod-github-runner-207 kernel: [53280.776845] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 20:11:46 juju-e4d256-prod-github-runner-207 kernel: [53280.778180] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 20:11:46 juju-e4d256-prod-github-runner-207 kernel: [53280.779444] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 20:11:46 juju-e4d256-prod-github-runner-207 kernel: [53280.780458] ? _raw_spin_lock+0x22/0x30 Aug 22 20:11:46 juju-e4d256-prod-github-runner-207 kernel: [53280.781245] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:11:46 juju-e4d256-prod-github-runner-207 kernel: [53280.782083] direct_page_fault+0x206/0x310 [kvm] Aug 22 20:11:46 juju-e4d256-prod-github-runner-207 kernel: [53280.782927] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 20:11:46 juju-e4d256-prod-github-runner-207 kernel: [53280.783756] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 20:11:46 juju-e4d256-prod-github-runner-207 kernel: [53280.784579] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 20:11:46 juju-e4d256-prod-github-runner-207 kernel: [53280.785588] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 20:11:46 juju-e4d256-prod-github-runner-207 kernel: [53280.786649] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 20:11:46 juju-e4d256-prod-github-runner-207 kernel: [53280.787756] handle_exit+0x98/0x230 [kvm_amd] Aug 22 20:11:46 juju-e4d256-prod-github-runner-207 kernel: [53280.788828] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 20:11:46 juju-e4d256-prod-github-runner-207 kernel: [53280.789759] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 20:11:46 juju-e4d256-prod-github-runner-207 kernel: [53280.790571] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 20:11:46 juju-e4d256-prod-github-runner-207 kernel: [53280.791362] vcpu_run+0x62/0x2c0 [kvm] Aug 22 20:11:46 juju-e4d256-prod-github-runner-207 kernel: [53280.792078] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 20:11:46 juju-e4d256-prod-github-runner-207 kernel: [53280.792833] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 20:11:46 juju-e4d256-prod-github-runner-207 kernel: [53280.793636] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 20:11:46 juju-e4d256-prod-github-runner-207 kernel: [53280.794402] ? __seccomp_filter+0x4a/0x4a0 Aug 22 20:11:46 juju-e4d256-prod-github-runner-207 kernel: [53280.795126] ? __fget_files+0x86/0xc0 Aug 22 20:11:46 juju-e4d256-prod-github-runner-207 kernel: [53280.795821] __x64_sys_ioctl+0x95/0xd0 Aug 22 20:11:46 juju-e4d256-prod-github-runner-207 kernel: [53280.796517] do_syscall_64+0x5c/0xc0 Aug 22 20:11:46 juju-e4d256-prod-github-runner-207 kernel: [53280.797219] ? do_futex+0x162/0x1f0 Aug 22 20:11:46 juju-e4d256-prod-github-runner-207 kernel: [53280.797892] ? __x64_sys_futex+0x78/0x1e0 Aug 22 20:11:46 juju-e4d256-prod-github-runner-207 kernel: [53280.798592] ? __secure_computing+0xa9/0x120 Aug 22 20:11:46 juju-e4d256-prod-github-runner-207 kernel: [53280.799309] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 20:11:46 juju-e4d256-prod-github-runner-207 kernel: [53280.800201] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:11:46 juju-e4d256-prod-github-runner-207 kernel: [53280.801243] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:11:46 juju-e4d256-prod-github-runner-207 kernel: [53280.802026] ? do_syscall_64+0x69/0xc0 Aug 22 20:11:46 juju-e4d256-prod-github-runner-207 kernel: [53280.802726] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:11:46 juju-e4d256-prod-github-runner-207 kernel: [53280.803503] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:11:46 juju-e4d256-prod-github-runner-207 kernel: [53280.804307] ? do_syscall_64+0x69/0xc0 Aug 22 20:11:46 juju-e4d256-prod-github-runner-207 kernel: [53280.805096] ? do_syscall_64+0x69/0xc0 Aug 22 20:11:46 juju-e4d256-prod-github-runner-207 kernel: [53280.805790] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 20:11:46 juju-e4d256-prod-github-runner-207 kernel: [53280.806701] RIP: 0033:0x7faa5d0edaff Aug 22 20:11:46 juju-e4d256-prod-github-runner-207 kernel: [53280.807477] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 20:11:46 juju-e4d256-prod-github-runner-207 kernel: [53280.809937] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 20:11:46 juju-e4d256-prod-github-runner-207 kernel: [53280.811079] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 20:11:46 juju-e4d256-prod-github-runner-207 kernel: [53280.812044] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 20:11:46 juju-e4d256-prod-github-runner-207 kernel: [53280.813018] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 20:11:46 juju-e4d256-prod-github-runner-207 kernel: [53280.813961] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 20:11:46 juju-e4d256-prod-github-runner-207 kernel: [53280.814884] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 20:11:46 juju-e4d256-prod-github-runner-207 kernel: [53280.815801] Aug 22 20:12:14 juju-e4d256-prod-github-runner-207 kernel: [53308.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 49539s! [qemu-system-x86:6715] Aug 22 20:12:14 juju-e4d256-prod-github-runner-207 kernel: [53308.543718] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 20:12:14 juju-e4d256-prod-github-runner-207 kernel: [53308.543978] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 20:12:14 juju-e4d256-prod-github-runner-207 kernel: [53308.556512] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 20:12:14 juju-e4d256-prod-github-runner-207 kernel: [53308.557780] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 20:12:14 juju-e4d256-prod-github-runner-207 kernel: [53308.558997] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:12:14 juju-e4d256-prod-github-runner-207 kernel: [53308.560059] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 20:12:14 juju-e4d256-prod-github-runner-207 kernel: [53308.562646] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 20:12:14 juju-e4d256-prod-github-runner-207 kernel: [53308.563687] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 20:12:14 juju-e4d256-prod-github-runner-207 kernel: [53308.564863] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 20:12:14 juju-e4d256-prod-github-runner-207 kernel: [53308.566028] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 20:12:14 juju-e4d256-prod-github-runner-207 kernel: [53308.567187] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 20:12:14 juju-e4d256-prod-github-runner-207 kernel: [53308.568345] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 20:12:14 juju-e4d256-prod-github-runner-207 kernel: [53308.569528] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 20:12:14 juju-e4d256-prod-github-runner-207 kernel: [53308.570786] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 20:12:14 juju-e4d256-prod-github-runner-207 kernel: [53308.571883] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 20:12:14 juju-e4d256-prod-github-runner-207 kernel: [53308.573087] Call Trace: Aug 22 20:12:14 juju-e4d256-prod-github-runner-207 kernel: [53308.573998] Aug 22 20:12:14 juju-e4d256-prod-github-runner-207 kernel: [53308.574896] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:12:14 juju-e4d256-prod-github-runner-207 kernel: [53308.575926] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:12:14 juju-e4d256-prod-github-runner-207 kernel: [53308.576964] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:12:14 juju-e4d256-prod-github-runner-207 kernel: [53308.578050] ? show_regs.part.0+0x23/0x29 Aug 22 20:12:14 juju-e4d256-prod-github-runner-207 kernel: [53308.579082] ? show_regs.cold+0x8/0xd Aug 22 20:12:14 juju-e4d256-prod-github-runner-207 kernel: [53308.580105] ? watchdog_timer_fn+0x1be/0x220 Aug 22 20:12:14 juju-e4d256-prod-github-runner-207 kernel: [53308.581141] ? lockup_detector_update_enable+0x60/0x60 Aug 22 20:12:14 juju-e4d256-prod-github-runner-207 kernel: [53308.582208] ? __hrtimer_run_queues+0x107/0x230 Aug 22 20:12:14 juju-e4d256-prod-github-runner-207 kernel: [53308.583232] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 20:12:14 juju-e4d256-prod-github-runner-207 kernel: [53308.584251] ? hrtimer_interrupt+0x101/0x220 Aug 22 20:12:14 juju-e4d256-prod-github-runner-207 kernel: [53308.585282] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 20:12:14 juju-e4d256-prod-github-runner-207 kernel: [53308.586347] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 20:12:14 juju-e4d256-prod-github-runner-207 kernel: [53308.587389] Aug 22 20:12:14 juju-e4d256-prod-github-runner-207 kernel: [53308.588240] Aug 22 20:12:14 juju-e4d256-prod-github-runner-207 kernel: [53308.589090] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 20:12:14 juju-e4d256-prod-github-runner-207 kernel: [53308.590120] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:12:14 juju-e4d256-prod-github-runner-207 kernel: [53308.591161] ? _raw_spin_lock+0x22/0x30 Aug 22 20:12:14 juju-e4d256-prod-github-runner-207 kernel: [53308.592103] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:12:14 juju-e4d256-prod-github-runner-207 kernel: [53308.593131] direct_page_fault+0x206/0x310 [kvm] Aug 22 20:12:14 juju-e4d256-prod-github-runner-207 kernel: [53308.594157] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 20:12:14 juju-e4d256-prod-github-runner-207 kernel: [53308.595162] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 20:12:14 juju-e4d256-prod-github-runner-207 kernel: [53308.596237] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 20:12:14 juju-e4d256-prod-github-runner-207 kernel: [53308.597253] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 20:12:14 juju-e4d256-prod-github-runner-207 kernel: [53308.598196] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 20:12:14 juju-e4d256-prod-github-runner-207 kernel: [53308.599174] handle_exit+0x98/0x230 [kvm_amd] Aug 22 20:12:14 juju-e4d256-prod-github-runner-207 kernel: [53308.600080] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 20:12:14 juju-e4d256-prod-github-runner-207 kernel: [53308.601025] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 20:12:14 juju-e4d256-prod-github-runner-207 kernel: [53308.601950] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 20:12:14 juju-e4d256-prod-github-runner-207 kernel: [53308.602849] vcpu_run+0x62/0x2c0 [kvm] Aug 22 20:12:14 juju-e4d256-prod-github-runner-207 kernel: [53308.603663] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 20:12:14 juju-e4d256-prod-github-runner-207 kernel: [53308.604495] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 20:12:14 juju-e4d256-prod-github-runner-207 kernel: [53308.605350] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 20:12:14 juju-e4d256-prod-github-runner-207 kernel: [53308.606184] ? __seccomp_filter+0x4a/0x4a0 Aug 22 20:12:14 juju-e4d256-prod-github-runner-207 kernel: [53308.606936] ? __fget_files+0x86/0xc0 Aug 22 20:12:14 juju-e4d256-prod-github-runner-207 kernel: [53308.607638] __x64_sys_ioctl+0x95/0xd0 Aug 22 20:12:14 juju-e4d256-prod-github-runner-207 kernel: [53308.608330] do_syscall_64+0x5c/0xc0 Aug 22 20:12:14 juju-e4d256-prod-github-runner-207 kernel: [53308.609029] ? do_futex+0x162/0x1f0 Aug 22 20:12:14 juju-e4d256-prod-github-runner-207 kernel: [53308.609776] ? __x64_sys_futex+0x78/0x1e0 Aug 22 20:12:14 juju-e4d256-prod-github-runner-207 kernel: [53308.610456] ? __secure_computing+0xa9/0x120 Aug 22 20:12:14 juju-e4d256-prod-github-runner-207 kernel: [53308.611144] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 20:12:14 juju-e4d256-prod-github-runner-207 kernel: [53308.611910] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:12:14 juju-e4d256-prod-github-runner-207 kernel: [53308.612647] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:12:14 juju-e4d256-prod-github-runner-207 kernel: [53308.613363] ? do_syscall_64+0x69/0xc0 Aug 22 20:12:14 juju-e4d256-prod-github-runner-207 kernel: [53308.614005] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:12:14 juju-e4d256-prod-github-runner-207 kernel: [53308.614704] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:12:14 juju-e4d256-prod-github-runner-207 kernel: [53308.615396] ? do_syscall_64+0x69/0xc0 Aug 22 20:12:14 juju-e4d256-prod-github-runner-207 kernel: [53308.616019] ? do_syscall_64+0x69/0xc0 Aug 22 20:12:14 juju-e4d256-prod-github-runner-207 kernel: [53308.616656] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 20:12:14 juju-e4d256-prod-github-runner-207 kernel: [53308.617359] RIP: 0033:0x7faa5d0edaff Aug 22 20:12:14 juju-e4d256-prod-github-runner-207 kernel: [53308.618001] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 20:12:14 juju-e4d256-prod-github-runner-207 kernel: [53308.619978] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 20:12:14 juju-e4d256-prod-github-runner-207 kernel: [53308.620908] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 20:12:14 juju-e4d256-prod-github-runner-207 kernel: [53308.621794] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 20:12:14 juju-e4d256-prod-github-runner-207 kernel: [53308.622679] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 20:12:14 juju-e4d256-prod-github-runner-207 kernel: [53308.623562] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 20:12:14 juju-e4d256-prod-github-runner-207 kernel: [53308.624459] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 20:12:14 juju-e4d256-prod-github-runner-207 kernel: [53308.625349] Aug 22 20:12:42 juju-e4d256-prod-github-runner-207 kernel: [53336.541980] watchdog: BUG: soft lockup - CPU#1 stuck for 49565s! [qemu-system-x86:6715] Aug 22 20:12:42 juju-e4d256-prod-github-runner-207 kernel: [53336.543100] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 20:12:42 juju-e4d256-prod-github-runner-207 kernel: [53336.543169] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 20:12:42 juju-e4d256-prod-github-runner-207 kernel: [53336.555224] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 20:12:42 juju-e4d256-prod-github-runner-207 kernel: [53336.556513] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 20:12:42 juju-e4d256-prod-github-runner-207 kernel: [53336.557733] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:12:42 juju-e4d256-prod-github-runner-207 kernel: [53336.558792] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 20:12:42 juju-e4d256-prod-github-runner-207 kernel: [53336.561373] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 20:12:42 juju-e4d256-prod-github-runner-207 kernel: [53336.562539] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 20:12:42 juju-e4d256-prod-github-runner-207 kernel: [53336.563702] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 20:12:42 juju-e4d256-prod-github-runner-207 kernel: [53336.564883] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 20:12:42 juju-e4d256-prod-github-runner-207 kernel: [53336.566049] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 20:12:42 juju-e4d256-prod-github-runner-207 kernel: [53336.567346] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 20:12:42 juju-e4d256-prod-github-runner-207 kernel: [53336.568546] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 20:12:42 juju-e4d256-prod-github-runner-207 kernel: [53336.569797] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 20:12:42 juju-e4d256-prod-github-runner-207 kernel: [53336.570932] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 20:12:42 juju-e4d256-prod-github-runner-207 kernel: [53336.572190] Call Trace: Aug 22 20:12:42 juju-e4d256-prod-github-runner-207 kernel: [53336.573122] Aug 22 20:12:42 juju-e4d256-prod-github-runner-207 kernel: [53336.574008] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:12:42 juju-e4d256-prod-github-runner-207 kernel: [53336.575053] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:12:42 juju-e4d256-prod-github-runner-207 kernel: [53336.576096] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:12:42 juju-e4d256-prod-github-runner-207 kernel: [53336.577183] ? show_regs.part.0+0x23/0x29 Aug 22 20:12:42 juju-e4d256-prod-github-runner-207 kernel: [53336.578187] ? show_regs.cold+0x8/0xd Aug 22 20:12:42 juju-e4d256-prod-github-runner-207 kernel: [53336.579157] ? watchdog_timer_fn+0x1be/0x220 Aug 22 20:12:42 juju-e4d256-prod-github-runner-207 kernel: [53336.580343] ? lockup_detector_update_enable+0x60/0x60 Aug 22 20:12:42 juju-e4d256-prod-github-runner-207 kernel: [53336.581417] ? __hrtimer_run_queues+0x107/0x230 Aug 22 20:12:42 juju-e4d256-prod-github-runner-207 kernel: [53336.582444] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 20:12:42 juju-e4d256-prod-github-runner-207 kernel: [53336.583466] ? hrtimer_interrupt+0x101/0x220 Aug 22 20:12:42 juju-e4d256-prod-github-runner-207 kernel: [53336.584500] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 20:12:42 juju-e4d256-prod-github-runner-207 kernel: [53336.585568] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 20:12:42 juju-e4d256-prod-github-runner-207 kernel: [53336.586611] Aug 22 20:12:42 juju-e4d256-prod-github-runner-207 kernel: [53336.587462] Aug 22 20:12:42 juju-e4d256-prod-github-runner-207 kernel: [53336.588308] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 20:12:42 juju-e4d256-prod-github-runner-207 kernel: [53336.589341] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:12:42 juju-e4d256-prod-github-runner-207 kernel: [53336.590381] ? _raw_spin_lock+0x22/0x30 Aug 22 20:12:42 juju-e4d256-prod-github-runner-207 kernel: [53336.591325] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:12:42 juju-e4d256-prod-github-runner-207 kernel: [53336.592358] direct_page_fault+0x206/0x310 [kvm] Aug 22 20:12:42 juju-e4d256-prod-github-runner-207 kernel: [53336.593380] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 20:12:42 juju-e4d256-prod-github-runner-207 kernel: [53336.594387] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 20:12:42 juju-e4d256-prod-github-runner-207 kernel: [53336.595384] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 20:12:42 juju-e4d256-prod-github-runner-207 kernel: [53336.596365] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 20:12:42 juju-e4d256-prod-github-runner-207 kernel: [53336.597310] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 20:12:42 juju-e4d256-prod-github-runner-207 kernel: [53336.598288] handle_exit+0x98/0x230 [kvm_amd] Aug 22 20:12:42 juju-e4d256-prod-github-runner-207 kernel: [53336.599182] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 20:12:42 juju-e4d256-prod-github-runner-207 kernel: [53336.600108] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 20:12:42 juju-e4d256-prod-github-runner-207 kernel: [53336.601035] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 20:12:42 juju-e4d256-prod-github-runner-207 kernel: [53336.601938] vcpu_run+0x62/0x2c0 [kvm] Aug 22 20:12:42 juju-e4d256-prod-github-runner-207 kernel: [53336.602751] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 20:12:42 juju-e4d256-prod-github-runner-207 kernel: [53336.603557] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 20:12:42 juju-e4d256-prod-github-runner-207 kernel: [53336.604433] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 20:12:42 juju-e4d256-prod-github-runner-207 kernel: [53336.605229] ? __seccomp_filter+0x4a/0x4a0 Aug 22 20:12:42 juju-e4d256-prod-github-runner-207 kernel: [53336.605968] ? __fget_files+0x86/0xc0 Aug 22 20:12:42 juju-e4d256-prod-github-runner-207 kernel: [53336.606670] __x64_sys_ioctl+0x95/0xd0 Aug 22 20:12:42 juju-e4d256-prod-github-runner-207 kernel: [53336.607362] do_syscall_64+0x5c/0xc0 Aug 22 20:12:42 juju-e4d256-prod-github-runner-207 kernel: [53336.608041] ? do_futex+0x162/0x1f0 Aug 22 20:12:42 juju-e4d256-prod-github-runner-207 kernel: [53336.608695] ? __x64_sys_futex+0x78/0x1e0 Aug 22 20:12:42 juju-e4d256-prod-github-runner-207 kernel: [53336.609368] ? __secure_computing+0xa9/0x120 Aug 22 20:12:42 juju-e4d256-prod-github-runner-207 kernel: [53336.610056] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 20:12:42 juju-e4d256-prod-github-runner-207 kernel: [53336.610814] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:12:42 juju-e4d256-prod-github-runner-207 kernel: [53336.611536] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:12:42 juju-e4d256-prod-github-runner-207 kernel: [53336.612261] ? do_syscall_64+0x69/0xc0 Aug 22 20:12:42 juju-e4d256-prod-github-runner-207 kernel: [53336.612912] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:12:42 juju-e4d256-prod-github-runner-207 kernel: [53336.613615] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:12:42 juju-e4d256-prod-github-runner-207 kernel: [53336.614310] ? do_syscall_64+0x69/0xc0 Aug 22 20:12:42 juju-e4d256-prod-github-runner-207 kernel: [53336.614937] ? do_syscall_64+0x69/0xc0 Aug 22 20:12:42 juju-e4d256-prod-github-runner-207 kernel: [53336.615559] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 20:12:42 juju-e4d256-prod-github-runner-207 kernel: [53336.616272] RIP: 0033:0x7faa5d0edaff Aug 22 20:12:42 juju-e4d256-prod-github-runner-207 kernel: [53336.616914] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 20:12:42 juju-e4d256-prod-github-runner-207 kernel: [53336.618901] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 20:12:42 juju-e4d256-prod-github-runner-207 kernel: [53336.619820] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 20:12:42 juju-e4d256-prod-github-runner-207 kernel: [53336.621581] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 20:12:42 juju-e4d256-prod-github-runner-207 kernel: [53336.622473] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 20:12:42 juju-e4d256-prod-github-runner-207 kernel: [53336.623362] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 20:12:42 juju-e4d256-prod-github-runner-207 kernel: [53336.624257] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 20:12:42 juju-e4d256-prod-github-runner-207 kernel: [53336.625202] Aug 22 20:13:10 juju-e4d256-prod-github-runner-207 kernel: [53364.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 49591s! [qemu-system-x86:6715] Aug 22 20:13:10 juju-e4d256-prod-github-runner-207 kernel: [53364.543072] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 20:13:10 juju-e4d256-prod-github-runner-207 kernel: [53364.543141] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 20:13:10 juju-e4d256-prod-github-runner-207 kernel: [53364.556019] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 20:13:10 juju-e4d256-prod-github-runner-207 kernel: [53364.557314] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 20:13:10 juju-e4d256-prod-github-runner-207 kernel: [53364.558534] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:13:10 juju-e4d256-prod-github-runner-207 kernel: [53364.559592] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 20:13:10 juju-e4d256-prod-github-runner-207 kernel: [53364.562188] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 20:13:10 juju-e4d256-prod-github-runner-207 kernel: [53364.563232] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 20:13:10 juju-e4d256-prod-github-runner-207 kernel: [53364.564411] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 20:13:10 juju-e4d256-prod-github-runner-207 kernel: [53364.565579] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 20:13:10 juju-e4d256-prod-github-runner-207 kernel: [53364.566737] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 20:13:10 juju-e4d256-prod-github-runner-207 kernel: [53364.567924] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 20:13:10 juju-e4d256-prod-github-runner-207 kernel: [53364.569102] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 20:13:10 juju-e4d256-prod-github-runner-207 kernel: [53364.570335] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 20:13:10 juju-e4d256-prod-github-runner-207 kernel: [53364.571438] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 20:13:10 juju-e4d256-prod-github-runner-207 kernel: [53364.572669] Call Trace: Aug 22 20:13:10 juju-e4d256-prod-github-runner-207 kernel: [53364.573586] Aug 22 20:13:10 juju-e4d256-prod-github-runner-207 kernel: [53364.574527] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:13:10 juju-e4d256-prod-github-runner-207 kernel: [53364.575567] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:13:10 juju-e4d256-prod-github-runner-207 kernel: [53364.576614] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:13:10 juju-e4d256-prod-github-runner-207 kernel: [53364.577704] ? show_regs.part.0+0x23/0x29 Aug 22 20:13:10 juju-e4d256-prod-github-runner-207 kernel: [53364.578700] ? show_regs.cold+0x8/0xd Aug 22 20:13:10 juju-e4d256-prod-github-runner-207 kernel: [53364.579689] ? watchdog_timer_fn+0x1be/0x220 Aug 22 20:13:10 juju-e4d256-prod-github-runner-207 kernel: [53364.580716] ? lockup_detector_update_enable+0x60/0x60 Aug 22 20:13:10 juju-e4d256-prod-github-runner-207 kernel: [53364.581782] ? __hrtimer_run_queues+0x107/0x230 Aug 22 20:13:10 juju-e4d256-prod-github-runner-207 kernel: [53364.582820] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 20:13:10 juju-e4d256-prod-github-runner-207 kernel: [53364.583869] ? hrtimer_interrupt+0x101/0x220 Aug 22 20:13:10 juju-e4d256-prod-github-runner-207 kernel: [53364.584890] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 20:13:10 juju-e4d256-prod-github-runner-207 kernel: [53364.585956] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 20:13:10 juju-e4d256-prod-github-runner-207 kernel: [53364.587052] Aug 22 20:13:10 juju-e4d256-prod-github-runner-207 kernel: [53364.587942] Aug 22 20:13:10 juju-e4d256-prod-github-runner-207 kernel: [53364.588801] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 20:13:10 juju-e4d256-prod-github-runner-207 kernel: [53364.589872] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:13:10 juju-e4d256-prod-github-runner-207 kernel: [53364.590978] ? _raw_spin_lock+0x22/0x30 Aug 22 20:13:10 juju-e4d256-prod-github-runner-207 kernel: [53364.591958] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:13:10 juju-e4d256-prod-github-runner-207 kernel: [53364.592988] direct_page_fault+0x206/0x310 [kvm] Aug 22 20:13:10 juju-e4d256-prod-github-runner-207 kernel: [53364.594025] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 20:13:10 juju-e4d256-prod-github-runner-207 kernel: [53364.595033] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 20:13:10 juju-e4d256-prod-github-runner-207 kernel: [53364.596046] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 20:13:10 juju-e4d256-prod-github-runner-207 kernel: [53364.597017] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 20:13:10 juju-e4d256-prod-github-runner-207 kernel: [53364.597964] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 20:13:10 juju-e4d256-prod-github-runner-207 kernel: [53364.598946] handle_exit+0x98/0x230 [kvm_amd] Aug 22 20:13:10 juju-e4d256-prod-github-runner-207 kernel: [53364.599890] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 20:13:10 juju-e4d256-prod-github-runner-207 kernel: [53364.600808] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 20:13:10 juju-e4d256-prod-github-runner-207 kernel: [53364.601729] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 20:13:10 juju-e4d256-prod-github-runner-207 kernel: [53364.602629] vcpu_run+0x62/0x2c0 [kvm] Aug 22 20:13:10 juju-e4d256-prod-github-runner-207 kernel: [53364.603438] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 20:13:10 juju-e4d256-prod-github-runner-207 kernel: [53364.604272] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 20:13:10 juju-e4d256-prod-github-runner-207 kernel: [53364.605122] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 20:13:10 juju-e4d256-prod-github-runner-207 kernel: [53364.605915] ? __seccomp_filter+0x4a/0x4a0 Aug 22 20:13:10 juju-e4d256-prod-github-runner-207 kernel: [53364.606678] ? __fget_files+0x86/0xc0 Aug 22 20:13:10 juju-e4d256-prod-github-runner-207 kernel: [53364.607426] __x64_sys_ioctl+0x95/0xd0 Aug 22 20:13:10 juju-e4d256-prod-github-runner-207 kernel: [53364.608172] do_syscall_64+0x5c/0xc0 Aug 22 20:13:10 juju-e4d256-prod-github-runner-207 kernel: [53364.608849] ? do_futex+0x162/0x1f0 Aug 22 20:13:10 juju-e4d256-prod-github-runner-207 kernel: [53364.609540] ? __x64_sys_futex+0x78/0x1e0 Aug 22 20:13:10 juju-e4d256-prod-github-runner-207 kernel: [53364.610214] ? __secure_computing+0xa9/0x120 Aug 22 20:13:10 juju-e4d256-prod-github-runner-207 kernel: [53364.610917] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 20:13:10 juju-e4d256-prod-github-runner-207 kernel: [53364.611700] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:13:10 juju-e4d256-prod-github-runner-207 kernel: [53364.612420] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:13:10 juju-e4d256-prod-github-runner-207 kernel: [53364.613148] ? do_syscall_64+0x69/0xc0 Aug 22 20:13:10 juju-e4d256-prod-github-runner-207 kernel: [53364.613791] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:13:10 juju-e4d256-prod-github-runner-207 kernel: [53364.614500] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:13:10 juju-e4d256-prod-github-runner-207 kernel: [53364.615228] ? do_syscall_64+0x69/0xc0 Aug 22 20:13:10 juju-e4d256-prod-github-runner-207 kernel: [53364.615900] ? do_syscall_64+0x69/0xc0 Aug 22 20:13:10 juju-e4d256-prod-github-runner-207 kernel: [53364.616537] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 20:13:10 juju-e4d256-prod-github-runner-207 kernel: [53364.617260] RIP: 0033:0x7faa5d0edaff Aug 22 20:13:10 juju-e4d256-prod-github-runner-207 kernel: [53364.617897] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 20:13:10 juju-e4d256-prod-github-runner-207 kernel: [53364.619937] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 20:13:10 juju-e4d256-prod-github-runner-207 kernel: [53364.620848] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 20:13:10 juju-e4d256-prod-github-runner-207 kernel: [53364.621742] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 20:13:10 juju-e4d256-prod-github-runner-207 kernel: [53364.622658] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 20:13:10 juju-e4d256-prod-github-runner-207 kernel: [53364.623593] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 20:13:10 juju-e4d256-prod-github-runner-207 kernel: [53364.624574] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 20:13:10 juju-e4d256-prod-github-runner-207 kernel: [53364.625548] Aug 22 20:13:38 juju-e4d256-prod-github-runner-207 kernel: [53392.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 49617s! [qemu-system-x86:6715] Aug 22 20:13:38 juju-e4d256-prod-github-runner-207 kernel: [53392.543127] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 20:13:38 juju-e4d256-prod-github-runner-207 kernel: [53392.543193] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 20:13:38 juju-e4d256-prod-github-runner-207 kernel: [53392.555354] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 20:13:38 juju-e4d256-prod-github-runner-207 kernel: [53392.556621] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 20:13:38 juju-e4d256-prod-github-runner-207 kernel: [53392.557850] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:13:38 juju-e4d256-prod-github-runner-207 kernel: [53392.558915] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 20:13:38 juju-e4d256-prod-github-runner-207 kernel: [53392.561486] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 20:13:38 juju-e4d256-prod-github-runner-207 kernel: [53392.562528] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 20:13:38 juju-e4d256-prod-github-runner-207 kernel: [53392.563699] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 20:13:38 juju-e4d256-prod-github-runner-207 kernel: [53392.564860] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 20:13:38 juju-e4d256-prod-github-runner-207 kernel: [53392.566019] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 20:13:38 juju-e4d256-prod-github-runner-207 kernel: [53392.567253] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 20:13:38 juju-e4d256-prod-github-runner-207 kernel: [53392.568640] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 20:13:38 juju-e4d256-prod-github-runner-207 kernel: [53392.569889] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 20:13:38 juju-e4d256-prod-github-runner-207 kernel: [53392.570991] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 20:13:38 juju-e4d256-prod-github-runner-207 kernel: [53392.572210] Call Trace: Aug 22 20:13:38 juju-e4d256-prod-github-runner-207 kernel: [53392.573125] Aug 22 20:13:38 juju-e4d256-prod-github-runner-207 kernel: [53392.574011] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:13:38 juju-e4d256-prod-github-runner-207 kernel: [53392.575049] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:13:38 juju-e4d256-prod-github-runner-207 kernel: [53392.576090] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:13:38 juju-e4d256-prod-github-runner-207 kernel: [53392.577172] ? show_regs.part.0+0x23/0x29 Aug 22 20:13:38 juju-e4d256-prod-github-runner-207 kernel: [53392.578173] ? show_regs.cold+0x8/0xd Aug 22 20:13:38 juju-e4d256-prod-github-runner-207 kernel: [53392.579149] ? watchdog_timer_fn+0x1be/0x220 Aug 22 20:13:38 juju-e4d256-prod-github-runner-207 kernel: [53392.580193] ? lockup_detector_update_enable+0x60/0x60 Aug 22 20:13:38 juju-e4d256-prod-github-runner-207 kernel: [53392.581267] ? __hrtimer_run_queues+0x107/0x230 Aug 22 20:13:38 juju-e4d256-prod-github-runner-207 kernel: [53392.582312] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 20:13:38 juju-e4d256-prod-github-runner-207 kernel: [53392.583358] ? hrtimer_interrupt+0x101/0x220 Aug 22 20:13:38 juju-e4d256-prod-github-runner-207 kernel: [53392.584381] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 20:13:38 juju-e4d256-prod-github-runner-207 kernel: [53392.585458] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 20:13:38 juju-e4d256-prod-github-runner-207 kernel: [53392.586532] Aug 22 20:13:38 juju-e4d256-prod-github-runner-207 kernel: [53392.587416] Aug 22 20:13:38 juju-e4d256-prod-github-runner-207 kernel: [53392.588260] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 20:13:38 juju-e4d256-prod-github-runner-207 kernel: [53392.589292] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:13:38 juju-e4d256-prod-github-runner-207 kernel: [53392.590353] ? _raw_spin_lock+0x22/0x30 Aug 22 20:13:38 juju-e4d256-prod-github-runner-207 kernel: [53392.591331] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:13:38 juju-e4d256-prod-github-runner-207 kernel: [53392.592350] direct_page_fault+0x206/0x310 [kvm] Aug 22 20:13:38 juju-e4d256-prod-github-runner-207 kernel: [53392.593374] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 20:13:38 juju-e4d256-prod-github-runner-207 kernel: [53392.594383] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 20:13:38 juju-e4d256-prod-github-runner-207 kernel: [53392.595399] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 20:13:38 juju-e4d256-prod-github-runner-207 kernel: [53392.596370] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 20:13:38 juju-e4d256-prod-github-runner-207 kernel: [53392.597316] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 20:13:38 juju-e4d256-prod-github-runner-207 kernel: [53392.598304] handle_exit+0x98/0x230 [kvm_amd] Aug 22 20:13:38 juju-e4d256-prod-github-runner-207 kernel: [53392.599200] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 20:13:38 juju-e4d256-prod-github-runner-207 kernel: [53392.600142] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 20:13:38 juju-e4d256-prod-github-runner-207 kernel: [53392.601072] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 20:13:38 juju-e4d256-prod-github-runner-207 kernel: [53392.601978] vcpu_run+0x62/0x2c0 [kvm] Aug 22 20:13:38 juju-e4d256-prod-github-runner-207 kernel: [53392.602793] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 20:13:38 juju-e4d256-prod-github-runner-207 kernel: [53392.603627] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 20:13:38 juju-e4d256-prod-github-runner-207 kernel: [53392.604488] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 20:13:38 juju-e4d256-prod-github-runner-207 kernel: [53392.605287] ? __seccomp_filter+0x4a/0x4a0 Aug 22 20:13:38 juju-e4d256-prod-github-runner-207 kernel: [53392.606033] ? __fget_files+0x86/0xc0 Aug 22 20:13:38 juju-e4d256-prod-github-runner-207 kernel: [53392.606738] __x64_sys_ioctl+0x95/0xd0 Aug 22 20:13:38 juju-e4d256-prod-github-runner-207 kernel: [53392.607454] do_syscall_64+0x5c/0xc0 Aug 22 20:13:38 juju-e4d256-prod-github-runner-207 kernel: [53392.608122] ? do_futex+0x162/0x1f0 Aug 22 20:13:38 juju-e4d256-prod-github-runner-207 kernel: [53392.608772] ? __x64_sys_futex+0x78/0x1e0 Aug 22 20:13:38 juju-e4d256-prod-github-runner-207 kernel: [53392.609446] ? __secure_computing+0xa9/0x120 Aug 22 20:13:38 juju-e4d256-prod-github-runner-207 kernel: [53392.610136] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 20:13:38 juju-e4d256-prod-github-runner-207 kernel: [53392.610903] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:13:38 juju-e4d256-prod-github-runner-207 kernel: [53392.611643] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:13:38 juju-e4d256-prod-github-runner-207 kernel: [53392.612363] ? do_syscall_64+0x69/0xc0 Aug 22 20:13:38 juju-e4d256-prod-github-runner-207 kernel: [53392.613008] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:13:38 juju-e4d256-prod-github-runner-207 kernel: [53392.613718] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:13:38 juju-e4d256-prod-github-runner-207 kernel: [53392.614413] ? do_syscall_64+0x69/0xc0 Aug 22 20:13:38 juju-e4d256-prod-github-runner-207 kernel: [53392.615037] ? do_syscall_64+0x69/0xc0 Aug 22 20:13:38 juju-e4d256-prod-github-runner-207 kernel: [53392.615672] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 20:13:38 juju-e4d256-prod-github-runner-207 kernel: [53392.616380] RIP: 0033:0x7faa5d0edaff Aug 22 20:13:38 juju-e4d256-prod-github-runner-207 kernel: [53392.617004] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 20:13:38 juju-e4d256-prod-github-runner-207 kernel: [53392.618991] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 20:13:38 juju-e4d256-prod-github-runner-207 kernel: [53392.619940] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 20:13:38 juju-e4d256-prod-github-runner-207 kernel: [53392.620840] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 20:13:38 juju-e4d256-prod-github-runner-207 kernel: [53392.621753] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 20:13:38 juju-e4d256-prod-github-runner-207 kernel: [53392.622653] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 20:13:38 juju-e4d256-prod-github-runner-207 kernel: [53392.623676] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 20:13:38 juju-e4d256-prod-github-runner-207 kernel: [53392.624580] Aug 22 20:14:06 juju-e4d256-prod-github-runner-207 kernel: [53420.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 49643s! [qemu-system-x86:6715] Aug 22 20:14:06 juju-e4d256-prod-github-runner-207 kernel: [53420.543725] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 20:14:06 juju-e4d256-prod-github-runner-207 kernel: [53420.543967] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 20:14:06 juju-e4d256-prod-github-runner-207 kernel: [53420.556164] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 20:14:06 juju-e4d256-prod-github-runner-207 kernel: [53420.557437] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 20:14:06 juju-e4d256-prod-github-runner-207 kernel: [53420.558688] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:14:06 juju-e4d256-prod-github-runner-207 kernel: [53420.559772] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 20:14:06 juju-e4d256-prod-github-runner-207 kernel: [53420.562334] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 20:14:06 juju-e4d256-prod-github-runner-207 kernel: [53420.563399] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 20:14:06 juju-e4d256-prod-github-runner-207 kernel: [53420.564564] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 20:14:06 juju-e4d256-prod-github-runner-207 kernel: [53420.565735] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 20:14:06 juju-e4d256-prod-github-runner-207 kernel: [53420.566915] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 20:14:06 juju-e4d256-prod-github-runner-207 kernel: [53420.568128] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 20:14:06 juju-e4d256-prod-github-runner-207 kernel: [53420.569530] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 20:14:06 juju-e4d256-prod-github-runner-207 kernel: [53420.570800] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 20:14:06 juju-e4d256-prod-github-runner-207 kernel: [53420.571958] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 20:14:06 juju-e4d256-prod-github-runner-207 kernel: [53420.573189] Call Trace: Aug 22 20:14:06 juju-e4d256-prod-github-runner-207 kernel: [53420.574111] Aug 22 20:14:06 juju-e4d256-prod-github-runner-207 kernel: [53420.575031] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:14:06 juju-e4d256-prod-github-runner-207 kernel: [53420.576088] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:14:06 juju-e4d256-prod-github-runner-207 kernel: [53420.577132] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:14:06 juju-e4d256-prod-github-runner-207 kernel: [53420.578251] ? show_regs.part.0+0x23/0x29 Aug 22 20:14:06 juju-e4d256-prod-github-runner-207 kernel: [53420.579273] ? show_regs.cold+0x8/0xd Aug 22 20:14:06 juju-e4d256-prod-github-runner-207 kernel: [53420.580259] ? watchdog_timer_fn+0x1be/0x220 Aug 22 20:14:06 juju-e4d256-prod-github-runner-207 kernel: [53420.581292] ? lockup_detector_update_enable+0x60/0x60 Aug 22 20:14:06 juju-e4d256-prod-github-runner-207 kernel: [53420.582400] ? __hrtimer_run_queues+0x107/0x230 Aug 22 20:14:06 juju-e4d256-prod-github-runner-207 kernel: [53420.583463] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 20:14:06 juju-e4d256-prod-github-runner-207 kernel: [53420.584508] ? hrtimer_interrupt+0x101/0x220 Aug 22 20:14:06 juju-e4d256-prod-github-runner-207 kernel: [53420.585541] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 20:14:06 juju-e4d256-prod-github-runner-207 kernel: [53420.586646] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 20:14:06 juju-e4d256-prod-github-runner-207 kernel: [53420.587776] Aug 22 20:14:06 juju-e4d256-prod-github-runner-207 kernel: [53420.588689] Aug 22 20:14:06 juju-e4d256-prod-github-runner-207 kernel: [53420.589545] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 20:14:06 juju-e4d256-prod-github-runner-207 kernel: [53420.590599] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:14:06 juju-e4d256-prod-github-runner-207 kernel: [53420.591703] ? _raw_spin_lock+0x22/0x30 Aug 22 20:14:06 juju-e4d256-prod-github-runner-207 kernel: [53420.592679] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:14:06 juju-e4d256-prod-github-runner-207 kernel: [53420.593724] direct_page_fault+0x206/0x310 [kvm] Aug 22 20:14:06 juju-e4d256-prod-github-runner-207 kernel: [53420.594771] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 20:14:06 juju-e4d256-prod-github-runner-207 kernel: [53420.595814] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 20:14:06 juju-e4d256-prod-github-runner-207 kernel: [53420.596842] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 20:14:06 juju-e4d256-prod-github-runner-207 kernel: [53420.597897] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 20:14:06 juju-e4d256-prod-github-runner-207 kernel: [53420.598865] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 20:14:06 juju-e4d256-prod-github-runner-207 kernel: [53420.599897] handle_exit+0x98/0x230 [kvm_amd] Aug 22 20:14:06 juju-e4d256-prod-github-runner-207 kernel: [53420.600812] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 20:14:06 juju-e4d256-prod-github-runner-207 kernel: [53420.601756] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 20:14:06 juju-e4d256-prod-github-runner-207 kernel: [53420.602701] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 20:14:06 juju-e4d256-prod-github-runner-207 kernel: [53420.603656] vcpu_run+0x62/0x2c0 [kvm] Aug 22 20:14:06 juju-e4d256-prod-github-runner-207 kernel: [53420.604482] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 20:14:06 juju-e4d256-prod-github-runner-207 kernel: [53420.605308] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 20:14:06 juju-e4d256-prod-github-runner-207 kernel: [53420.606179] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 20:14:06 juju-e4d256-prod-github-runner-207 kernel: [53420.607014] ? __seccomp_filter+0x4a/0x4a0 Aug 22 20:14:06 juju-e4d256-prod-github-runner-207 kernel: [53420.607775] ? __fget_files+0x86/0xc0 Aug 22 20:14:06 juju-e4d256-prod-github-runner-207 kernel: [53420.608504] __x64_sys_ioctl+0x95/0xd0 Aug 22 20:14:06 juju-e4d256-prod-github-runner-207 kernel: [53420.609220] do_syscall_64+0x5c/0xc0 Aug 22 20:14:06 juju-e4d256-prod-github-runner-207 kernel: [53420.609900] ? do_futex+0x162/0x1f0 Aug 22 20:14:06 juju-e4d256-prod-github-runner-207 kernel: [53420.610568] ? __x64_sys_futex+0x78/0x1e0 Aug 22 20:14:06 juju-e4d256-prod-github-runner-207 kernel: [53420.611288] ? __secure_computing+0xa9/0x120 Aug 22 20:14:06 juju-e4d256-prod-github-runner-207 kernel: [53420.612011] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 20:14:06 juju-e4d256-prod-github-runner-207 kernel: [53420.612801] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:14:06 juju-e4d256-prod-github-runner-207 kernel: [53420.613552] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:14:06 juju-e4d256-prod-github-runner-207 kernel: [53420.614291] ? do_syscall_64+0x69/0xc0 Aug 22 20:14:06 juju-e4d256-prod-github-runner-207 kernel: [53420.614988] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:14:06 juju-e4d256-prod-github-runner-207 kernel: [53420.615702] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:14:06 juju-e4d256-prod-github-runner-207 kernel: [53420.616405] ? do_syscall_64+0x69/0xc0 Aug 22 20:14:06 juju-e4d256-prod-github-runner-207 kernel: [53420.617045] ? do_syscall_64+0x69/0xc0 Aug 22 20:14:06 juju-e4d256-prod-github-runner-207 kernel: [53420.617691] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 20:14:06 juju-e4d256-prod-github-runner-207 kernel: [53420.618405] RIP: 0033:0x7faa5d0edaff Aug 22 20:14:06 juju-e4d256-prod-github-runner-207 kernel: [53420.619098] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 20:14:06 juju-e4d256-prod-github-runner-207 kernel: [53420.621143] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 20:14:06 juju-e4d256-prod-github-runner-207 kernel: [53420.622066] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 20:14:06 juju-e4d256-prod-github-runner-207 kernel: [53420.622981] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 20:14:06 juju-e4d256-prod-github-runner-207 kernel: [53420.623914] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 20:14:06 juju-e4d256-prod-github-runner-207 kernel: [53420.624841] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 20:14:06 juju-e4d256-prod-github-runner-207 kernel: [53420.625755] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 20:14:06 juju-e4d256-prod-github-runner-207 kernel: [53420.626663] Aug 22 20:14:34 juju-e4d256-prod-github-runner-207 kernel: [53448.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 49669s! [qemu-system-x86:6715] Aug 22 20:14:34 juju-e4d256-prod-github-runner-207 kernel: [53448.543097] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 20:14:34 juju-e4d256-prod-github-runner-207 kernel: [53448.543163] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 20:14:34 juju-e4d256-prod-github-runner-207 kernel: [53448.555385] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 20:14:34 juju-e4d256-prod-github-runner-207 kernel: [53448.556656] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 20:14:34 juju-e4d256-prod-github-runner-207 kernel: [53448.557886] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:14:34 juju-e4d256-prod-github-runner-207 kernel: [53448.558953] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 20:14:34 juju-e4d256-prod-github-runner-207 kernel: [53448.561542] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 20:14:34 juju-e4d256-prod-github-runner-207 kernel: [53448.562582] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 20:14:34 juju-e4d256-prod-github-runner-207 kernel: [53448.563756] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 20:14:34 juju-e4d256-prod-github-runner-207 kernel: [53448.564920] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 20:14:34 juju-e4d256-prod-github-runner-207 kernel: [53448.566083] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 20:14:34 juju-e4d256-prod-github-runner-207 kernel: [53448.567248] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 20:14:34 juju-e4d256-prod-github-runner-207 kernel: [53448.568411] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 20:14:34 juju-e4d256-prod-github-runner-207 kernel: [53448.569649] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 20:14:34 juju-e4d256-prod-github-runner-207 kernel: [53448.570767] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 20:14:34 juju-e4d256-prod-github-runner-207 kernel: [53448.571955] Call Trace: Aug 22 20:14:34 juju-e4d256-prod-github-runner-207 kernel: [53448.572864] Aug 22 20:14:34 juju-e4d256-prod-github-runner-207 kernel: [53448.573757] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:14:34 juju-e4d256-prod-github-runner-207 kernel: [53448.574793] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:14:34 juju-e4d256-prod-github-runner-207 kernel: [53448.575813] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:14:34 juju-e4d256-prod-github-runner-207 kernel: [53448.576889] ? show_regs.part.0+0x23/0x29 Aug 22 20:14:34 juju-e4d256-prod-github-runner-207 kernel: [53448.577883] ? show_regs.cold+0x8/0xd Aug 22 20:14:34 juju-e4d256-prod-github-runner-207 kernel: [53448.578867] ? watchdog_timer_fn+0x1be/0x220 Aug 22 20:14:34 juju-e4d256-prod-github-runner-207 kernel: [53448.579874] ? lockup_detector_update_enable+0x60/0x60 Aug 22 20:14:34 juju-e4d256-prod-github-runner-207 kernel: [53448.580932] ? __hrtimer_run_queues+0x107/0x230 Aug 22 20:14:34 juju-e4d256-prod-github-runner-207 kernel: [53448.581955] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 20:14:34 juju-e4d256-prod-github-runner-207 kernel: [53448.583145] ? hrtimer_interrupt+0x101/0x220 Aug 22 20:14:34 juju-e4d256-prod-github-runner-207 kernel: [53448.584156] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 20:14:34 juju-e4d256-prod-github-runner-207 kernel: [53448.585220] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 20:14:34 juju-e4d256-prod-github-runner-207 kernel: [53448.586263] Aug 22 20:14:34 juju-e4d256-prod-github-runner-207 kernel: [53448.587121] Aug 22 20:14:34 juju-e4d256-prod-github-runner-207 kernel: [53448.587956] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 20:14:34 juju-e4d256-prod-github-runner-207 kernel: [53448.588984] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:14:34 juju-e4d256-prod-github-runner-207 kernel: [53448.590032] ? _raw_spin_lock+0x22/0x30 Aug 22 20:14:34 juju-e4d256-prod-github-runner-207 kernel: [53448.590995] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:14:34 juju-e4d256-prod-github-runner-207 kernel: [53448.592011] direct_page_fault+0x206/0x310 [kvm] Aug 22 20:14:34 juju-e4d256-prod-github-runner-207 kernel: [53448.593033] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 20:14:34 juju-e4d256-prod-github-runner-207 kernel: [53448.594040] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 20:14:34 juju-e4d256-prod-github-runner-207 kernel: [53448.595049] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 20:14:34 juju-e4d256-prod-github-runner-207 kernel: [53448.596019] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 20:14:34 juju-e4d256-prod-github-runner-207 kernel: [53448.597155] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 20:14:34 juju-e4d256-prod-github-runner-207 kernel: [53448.598133] handle_exit+0x98/0x230 [kvm_amd] Aug 22 20:14:34 juju-e4d256-prod-github-runner-207 kernel: [53448.599037] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 20:14:34 juju-e4d256-prod-github-runner-207 kernel: [53448.599951] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 20:14:34 juju-e4d256-prod-github-runner-207 kernel: [53448.600902] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 20:14:34 juju-e4d256-prod-github-runner-207 kernel: [53448.601807] vcpu_run+0x62/0x2c0 [kvm] Aug 22 20:14:34 juju-e4d256-prod-github-runner-207 kernel: [53448.602650] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 20:14:34 juju-e4d256-prod-github-runner-207 kernel: [53448.603468] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 20:14:34 juju-e4d256-prod-github-runner-207 kernel: [53448.604507] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 20:14:34 juju-e4d256-prod-github-runner-207 kernel: [53448.605312] ? __seccomp_filter+0x4a/0x4a0 Aug 22 20:14:34 juju-e4d256-prod-github-runner-207 kernel: [53448.606054] ? __fget_files+0x86/0xc0 Aug 22 20:14:34 juju-e4d256-prod-github-runner-207 kernel: [53448.606777] __x64_sys_ioctl+0x95/0xd0 Aug 22 20:14:34 juju-e4d256-prod-github-runner-207 kernel: [53448.607471] do_syscall_64+0x5c/0xc0 Aug 22 20:14:34 juju-e4d256-prod-github-runner-207 kernel: [53448.608136] ? do_futex+0x162/0x1f0 Aug 22 20:14:34 juju-e4d256-prod-github-runner-207 kernel: [53448.608784] ? __x64_sys_futex+0x78/0x1e0 Aug 22 20:14:34 juju-e4d256-prod-github-runner-207 kernel: [53448.609459] ? __secure_computing+0xa9/0x120 Aug 22 20:14:34 juju-e4d256-prod-github-runner-207 kernel: [53448.610150] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 20:14:34 juju-e4d256-prod-github-runner-207 kernel: [53448.610944] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:14:34 juju-e4d256-prod-github-runner-207 kernel: [53448.611671] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:14:34 juju-e4d256-prod-github-runner-207 kernel: [53448.612390] ? do_syscall_64+0x69/0xc0 Aug 22 20:14:34 juju-e4d256-prod-github-runner-207 kernel: [53448.613036] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:14:34 juju-e4d256-prod-github-runner-207 kernel: [53448.613740] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:14:34 juju-e4d256-prod-github-runner-207 kernel: [53448.614436] ? do_syscall_64+0x69/0xc0 Aug 22 20:14:34 juju-e4d256-prod-github-runner-207 kernel: [53448.615078] ? do_syscall_64+0x69/0xc0 Aug 22 20:14:34 juju-e4d256-prod-github-runner-207 kernel: [53448.615705] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 20:14:34 juju-e4d256-prod-github-runner-207 kernel: [53448.616412] RIP: 0033:0x7faa5d0edaff Aug 22 20:14:34 juju-e4d256-prod-github-runner-207 kernel: [53448.617124] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 20:14:34 juju-e4d256-prod-github-runner-207 kernel: [53448.619551] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 20:14:34 juju-e4d256-prod-github-runner-207 kernel: [53448.620598] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 20:14:34 juju-e4d256-prod-github-runner-207 kernel: [53448.621813] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 20:14:34 juju-e4d256-prod-github-runner-207 kernel: [53448.622846] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 20:14:34 juju-e4d256-prod-github-runner-207 kernel: [53448.623868] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 20:14:34 juju-e4d256-prod-github-runner-207 kernel: [53448.624889] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 20:14:34 juju-e4d256-prod-github-runner-207 kernel: [53448.625916] Aug 22 20:14:46 juju-e4d256-prod-github-runner-207 kernel: [53460.752705] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 20:14:46 juju-e4d256-prod-github-runner-207 kernel: [53460.753652] rcu: 1-....: (13293886 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=6426240 Aug 22 20:14:46 juju-e4d256-prod-github-runner-207 kernel: [53460.754792] (t=13335888 jiffies g=23269 q=49730) Aug 22 20:14:46 juju-e4d256-prod-github-runner-207 kernel: [53460.755579] NMI backtrace for cpu 1 Aug 22 20:14:46 juju-e4d256-prod-github-runner-207 kernel: [53460.756286] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 20:14:46 juju-e4d256-prod-github-runner-207 kernel: [53460.757389] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 20:14:46 juju-e4d256-prod-github-runner-207 kernel: [53460.758455] Call Trace: Aug 22 20:14:46 juju-e4d256-prod-github-runner-207 kernel: [53460.759134] Aug 22 20:14:46 juju-e4d256-prod-github-runner-207 kernel: [53460.759777] show_stack+0x52/0x5c Aug 22 20:14:46 juju-e4d256-prod-github-runner-207 kernel: [53460.760501] dump_stack_lvl+0x4a/0x63 Aug 22 20:14:46 juju-e4d256-prod-github-runner-207 kernel: [53460.761248] dump_stack+0x10/0x16 Aug 22 20:14:46 juju-e4d256-prod-github-runner-207 kernel: [53460.761965] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 20:14:46 juju-e4d256-prod-github-runner-207 kernel: [53460.762758] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 20:14:46 juju-e4d256-prod-github-runner-207 kernel: [53460.763536] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 20:14:46 juju-e4d256-prod-github-runner-207 kernel: [53460.764354] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 20:14:46 juju-e4d256-prod-github-runner-207 kernel: [53460.765173] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 20:14:46 juju-e4d256-prod-github-runner-207 kernel: [53460.765983] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 20:14:46 juju-e4d256-prod-github-runner-207 kernel: [53460.766766] print_cpu_stall.cold+0x2f/0xe2 Aug 22 20:14:46 juju-e4d256-prod-github-runner-207 kernel: [53460.767531] ? timekeeping_update+0xf7/0x150 Aug 22 20:14:46 juju-e4d256-prod-github-runner-207 kernel: [53460.768328] check_cpu_stall+0x109/0x270 Aug 22 20:14:46 juju-e4d256-prod-github-runner-207 kernel: [53460.769078] rcu_sched_clock_irq+0x9a/0x250 Aug 22 20:14:46 juju-e4d256-prod-github-runner-207 kernel: [53460.769840] update_process_times+0x94/0xd0 Aug 22 20:14:46 juju-e4d256-prod-github-runner-207 kernel: [53460.770612] tick_sched_handle+0x29/0x70 Aug 22 20:14:46 juju-e4d256-prod-github-runner-207 kernel: [53460.771359] tick_sched_timer+0x8c/0xc0 Aug 22 20:14:46 juju-e4d256-prod-github-runner-207 kernel: [53460.772103] ? tick_nohz_handler+0xb0/0xb0 Aug 22 20:14:46 juju-e4d256-prod-github-runner-207 kernel: [53460.772857] __hrtimer_run_queues+0x107/0x230 Aug 22 20:14:46 juju-e4d256-prod-github-runner-207 kernel: [53460.773634] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 20:14:46 juju-e4d256-prod-github-runner-207 kernel: [53460.774408] hrtimer_interrupt+0x101/0x220 Aug 22 20:14:46 juju-e4d256-prod-github-runner-207 kernel: [53460.775186] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 20:14:46 juju-e4d256-prod-github-runner-207 kernel: [53460.775999] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 20:14:46 juju-e4d256-prod-github-runner-207 kernel: [53460.776800] Aug 22 20:14:46 juju-e4d256-prod-github-runner-207 kernel: [53460.777435] Aug 22 20:14:46 juju-e4d256-prod-github-runner-207 kernel: [53460.778068] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 20:14:46 juju-e4d256-prod-github-runner-207 kernel: [53460.778901] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:14:46 juju-e4d256-prod-github-runner-207 kernel: [53460.779784] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 20:14:46 juju-e4d256-prod-github-runner-207 kernel: [53460.781990] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 20:14:46 juju-e4d256-prod-github-runner-207 kernel: [53460.782872] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 20:14:46 juju-e4d256-prod-github-runner-207 kernel: [53460.783865] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 20:14:46 juju-e4d256-prod-github-runner-207 kernel: [53460.784847] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 20:14:46 juju-e4d256-prod-github-runner-207 kernel: [53460.785810] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 20:14:46 juju-e4d256-prod-github-runner-207 kernel: [53460.786772] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 20:14:46 juju-e4d256-prod-github-runner-207 kernel: [53460.787731] ? _raw_spin_lock+0x22/0x30 Aug 22 20:14:46 juju-e4d256-prod-github-runner-207 kernel: [53460.788491] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:14:46 juju-e4d256-prod-github-runner-207 kernel: [53460.789328] direct_page_fault+0x206/0x310 [kvm] Aug 22 20:14:46 juju-e4d256-prod-github-runner-207 kernel: [53460.790170] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 20:14:46 juju-e4d256-prod-github-runner-207 kernel: [53460.791003] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 20:14:46 juju-e4d256-prod-github-runner-207 kernel: [53460.791825] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 20:14:46 juju-e4d256-prod-github-runner-207 kernel: [53460.792629] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 20:14:46 juju-e4d256-prod-github-runner-207 kernel: [53460.793415] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 20:14:46 juju-e4d256-prod-github-runner-207 kernel: [53460.794237] handle_exit+0x98/0x230 [kvm_amd] Aug 22 20:14:46 juju-e4d256-prod-github-runner-207 kernel: [53460.795000] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 20:14:46 juju-e4d256-prod-github-runner-207 kernel: [53460.795781] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 20:14:46 juju-e4d256-prod-github-runner-207 kernel: [53460.796579] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 20:14:46 juju-e4d256-prod-github-runner-207 kernel: [53460.797365] vcpu_run+0x62/0x2c0 [kvm] Aug 22 20:14:46 juju-e4d256-prod-github-runner-207 kernel: [53460.798101] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 20:14:46 juju-e4d256-prod-github-runner-207 kernel: [53460.798856] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 20:14:46 juju-e4d256-prod-github-runner-207 kernel: [53460.799658] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 20:14:46 juju-e4d256-prod-github-runner-207 kernel: [53460.800417] ? __seccomp_filter+0x4a/0x4a0 Aug 22 20:14:46 juju-e4d256-prod-github-runner-207 kernel: [53460.801136] ? __fget_files+0x86/0xc0 Aug 22 20:14:46 juju-e4d256-prod-github-runner-207 kernel: [53460.801831] __x64_sys_ioctl+0x95/0xd0 Aug 22 20:14:46 juju-e4d256-prod-github-runner-207 kernel: [53460.802535] do_syscall_64+0x5c/0xc0 Aug 22 20:14:46 juju-e4d256-prod-github-runner-207 kernel: [53460.803224] ? do_futex+0x162/0x1f0 Aug 22 20:14:46 juju-e4d256-prod-github-runner-207 kernel: [53460.803897] ? __x64_sys_futex+0x78/0x1e0 Aug 22 20:14:46 juju-e4d256-prod-github-runner-207 kernel: [53460.804599] ? __secure_computing+0xa9/0x120 Aug 22 20:14:46 juju-e4d256-prod-github-runner-207 kernel: [53460.805316] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 20:14:46 juju-e4d256-prod-github-runner-207 kernel: [53460.806112] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:14:46 juju-e4d256-prod-github-runner-207 kernel: [53460.806879] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:14:46 juju-e4d256-prod-github-runner-207 kernel: [53460.807635] ? do_syscall_64+0x69/0xc0 Aug 22 20:14:46 juju-e4d256-prod-github-runner-207 kernel: [53460.808326] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:14:46 juju-e4d256-prod-github-runner-207 kernel: [53460.809084] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:14:46 juju-e4d256-prod-github-runner-207 kernel: [53460.809842] ? do_syscall_64+0x69/0xc0 Aug 22 20:14:46 juju-e4d256-prod-github-runner-207 kernel: [53460.810548] ? do_syscall_64+0x69/0xc0 Aug 22 20:14:46 juju-e4d256-prod-github-runner-207 kernel: [53460.811237] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 20:14:46 juju-e4d256-prod-github-runner-207 kernel: [53460.812011] RIP: 0033:0x7faa5d0edaff Aug 22 20:14:46 juju-e4d256-prod-github-runner-207 kernel: [53460.812695] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 20:14:46 juju-e4d256-prod-github-runner-207 kernel: [53460.814805] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 20:14:46 juju-e4d256-prod-github-runner-207 kernel: [53460.815768] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 20:14:46 juju-e4d256-prod-github-runner-207 kernel: [53460.816714] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 20:14:46 juju-e4d256-prod-github-runner-207 kernel: [53460.817661] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 20:14:46 juju-e4d256-prod-github-runner-207 kernel: [53460.818611] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 20:14:46 juju-e4d256-prod-github-runner-207 kernel: [53460.819542] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 20:14:46 juju-e4d256-prod-github-runner-207 kernel: [53460.820457] Aug 22 20:15:14 juju-e4d256-prod-github-runner-207 kernel: [53488.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 49707s! [qemu-system-x86:6715] Aug 22 20:15:14 juju-e4d256-prod-github-runner-207 kernel: [53488.543219] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 20:15:14 juju-e4d256-prod-github-runner-207 kernel: [53488.543467] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 20:15:14 juju-e4d256-prod-github-runner-207 kernel: [53488.555963] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 20:15:14 juju-e4d256-prod-github-runner-207 kernel: [53488.557280] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 20:15:14 juju-e4d256-prod-github-runner-207 kernel: [53488.558524] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:15:14 juju-e4d256-prod-github-runner-207 kernel: [53488.559590] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 20:15:14 juju-e4d256-prod-github-runner-207 kernel: [53488.562193] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 20:15:14 juju-e4d256-prod-github-runner-207 kernel: [53488.563247] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 20:15:14 juju-e4d256-prod-github-runner-207 kernel: [53488.564426] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 20:15:14 juju-e4d256-prod-github-runner-207 kernel: [53488.565603] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 20:15:14 juju-e4d256-prod-github-runner-207 kernel: [53488.566808] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 20:15:14 juju-e4d256-prod-github-runner-207 kernel: [53488.567997] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 20:15:14 juju-e4d256-prod-github-runner-207 kernel: [53488.569170] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 20:15:14 juju-e4d256-prod-github-runner-207 kernel: [53488.570428] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 20:15:14 juju-e4d256-prod-github-runner-207 kernel: [53488.571549] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 20:15:14 juju-e4d256-prod-github-runner-207 kernel: [53488.572768] Call Trace: Aug 22 20:15:14 juju-e4d256-prod-github-runner-207 kernel: [53488.573734] Aug 22 20:15:14 juju-e4d256-prod-github-runner-207 kernel: [53488.574668] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:15:14 juju-e4d256-prod-github-runner-207 kernel: [53488.575704] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:15:14 juju-e4d256-prod-github-runner-207 kernel: [53488.576749] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:15:14 juju-e4d256-prod-github-runner-207 kernel: [53488.577880] ? show_regs.part.0+0x23/0x29 Aug 22 20:15:14 juju-e4d256-prod-github-runner-207 kernel: [53488.578905] ? show_regs.cold+0x8/0xd Aug 22 20:15:14 juju-e4d256-prod-github-runner-207 kernel: [53488.579883] ? watchdog_timer_fn+0x1be/0x220 Aug 22 20:15:14 juju-e4d256-prod-github-runner-207 kernel: [53488.580897] ? lockup_detector_update_enable+0x60/0x60 Aug 22 20:15:14 juju-e4d256-prod-github-runner-207 kernel: [53488.581994] ? __hrtimer_run_queues+0x107/0x230 Aug 22 20:15:14 juju-e4d256-prod-github-runner-207 kernel: [53488.583051] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 20:15:14 juju-e4d256-prod-github-runner-207 kernel: [53488.584080] ? hrtimer_interrupt+0x101/0x220 Aug 22 20:15:14 juju-e4d256-prod-github-runner-207 kernel: [53488.585102] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 20:15:14 juju-e4d256-prod-github-runner-207 kernel: [53488.586188] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 20:15:14 juju-e4d256-prod-github-runner-207 kernel: [53488.587262] Aug 22 20:15:14 juju-e4d256-prod-github-runner-207 kernel: [53488.588140] Aug 22 20:15:14 juju-e4d256-prod-github-runner-207 kernel: [53488.588987] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 20:15:14 juju-e4d256-prod-github-runner-207 kernel: [53488.590030] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:15:14 juju-e4d256-prod-github-runner-207 kernel: [53488.591083] ? _raw_spin_lock+0x22/0x30 Aug 22 20:15:14 juju-e4d256-prod-github-runner-207 kernel: [53488.592041] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:15:14 juju-e4d256-prod-github-runner-207 kernel: [53488.593082] direct_page_fault+0x206/0x310 [kvm] Aug 22 20:15:14 juju-e4d256-prod-github-runner-207 kernel: [53488.594135] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 20:15:14 juju-e4d256-prod-github-runner-207 kernel: [53488.595151] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 20:15:14 juju-e4d256-prod-github-runner-207 kernel: [53488.596162] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 20:15:14 juju-e4d256-prod-github-runner-207 kernel: [53488.597160] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 20:15:14 juju-e4d256-prod-github-runner-207 kernel: [53488.598164] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 20:15:14 juju-e4d256-prod-github-runner-207 kernel: [53488.599153] handle_exit+0x98/0x230 [kvm_amd] Aug 22 20:15:14 juju-e4d256-prod-github-runner-207 kernel: [53488.600056] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 20:15:14 juju-e4d256-prod-github-runner-207 kernel: [53488.600977] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 20:15:14 juju-e4d256-prod-github-runner-207 kernel: [53488.601919] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 20:15:14 juju-e4d256-prod-github-runner-207 kernel: [53488.602846] vcpu_run+0x62/0x2c0 [kvm] Aug 22 20:15:14 juju-e4d256-prod-github-runner-207 kernel: [53488.603675] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 20:15:14 juju-e4d256-prod-github-runner-207 kernel: [53488.604488] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 20:15:14 juju-e4d256-prod-github-runner-207 kernel: [53488.605356] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 20:15:14 juju-e4d256-prod-github-runner-207 kernel: [53488.606182] ? __seccomp_filter+0x4a/0x4a0 Aug 22 20:15:14 juju-e4d256-prod-github-runner-207 kernel: [53488.606931] ? __fget_files+0x86/0xc0 Aug 22 20:15:14 juju-e4d256-prod-github-runner-207 kernel: [53488.607643] __x64_sys_ioctl+0x95/0xd0 Aug 22 20:15:14 juju-e4d256-prod-github-runner-207 kernel: [53488.608395] do_syscall_64+0x5c/0xc0 Aug 22 20:15:14 juju-e4d256-prod-github-runner-207 kernel: [53488.609068] ? do_futex+0x162/0x1f0 Aug 22 20:15:14 juju-e4d256-prod-github-runner-207 kernel: [53488.609721] ? __x64_sys_futex+0x78/0x1e0 Aug 22 20:15:14 juju-e4d256-prod-github-runner-207 kernel: [53488.610418] ? __secure_computing+0xa9/0x120 Aug 22 20:15:14 juju-e4d256-prod-github-runner-207 kernel: [53488.611114] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 20:15:14 juju-e4d256-prod-github-runner-207 kernel: [53488.611880] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:15:14 juju-e4d256-prod-github-runner-207 kernel: [53488.612616] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:15:14 juju-e4d256-prod-github-runner-207 kernel: [53488.613350] ? do_syscall_64+0x69/0xc0 Aug 22 20:15:14 juju-e4d256-prod-github-runner-207 kernel: [53488.614003] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:15:14 juju-e4d256-prod-github-runner-207 kernel: [53488.614735] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:15:14 juju-e4d256-prod-github-runner-207 kernel: [53488.615460] ? do_syscall_64+0x69/0xc0 Aug 22 20:15:14 juju-e4d256-prod-github-runner-207 kernel: [53488.616099] ? do_syscall_64+0x69/0xc0 Aug 22 20:15:14 juju-e4d256-prod-github-runner-207 kernel: [53488.616733] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 20:15:14 juju-e4d256-prod-github-runner-207 kernel: [53488.617458] RIP: 0033:0x7faa5d0edaff Aug 22 20:15:14 juju-e4d256-prod-github-runner-207 kernel: [53488.618160] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 20:15:14 juju-e4d256-prod-github-runner-207 kernel: [53488.620401] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 20:15:14 juju-e4d256-prod-github-runner-207 kernel: [53488.621315] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 20:15:14 juju-e4d256-prod-github-runner-207 kernel: [53488.622231] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 20:15:14 juju-e4d256-prod-github-runner-207 kernel: [53488.623152] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 20:15:14 juju-e4d256-prod-github-runner-207 kernel: [53488.624056] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 20:15:14 juju-e4d256-prod-github-runner-207 kernel: [53488.624958] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 20:15:14 juju-e4d256-prod-github-runner-207 kernel: [53488.625864] Aug 22 20:15:42 juju-e4d256-prod-github-runner-207 kernel: [53516.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 49733s! [qemu-system-x86:6715] Aug 22 20:15:42 juju-e4d256-prod-github-runner-207 kernel: [53516.543683] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 20:15:42 juju-e4d256-prod-github-runner-207 kernel: [53516.543837] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 20:15:42 juju-e4d256-prod-github-runner-207 kernel: [53516.556259] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 20:15:42 juju-e4d256-prod-github-runner-207 kernel: [53516.557548] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 20:15:42 juju-e4d256-prod-github-runner-207 kernel: [53516.558948] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:15:42 juju-e4d256-prod-github-runner-207 kernel: [53516.560005] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 20:15:42 juju-e4d256-prod-github-runner-207 kernel: [53516.562590] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 20:15:42 juju-e4d256-prod-github-runner-207 kernel: [53516.563637] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 20:15:42 juju-e4d256-prod-github-runner-207 kernel: [53516.564805] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 20:15:42 juju-e4d256-prod-github-runner-207 kernel: [53516.565986] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 20:15:42 juju-e4d256-prod-github-runner-207 kernel: [53516.567162] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 20:15:42 juju-e4d256-prod-github-runner-207 kernel: [53516.568325] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 20:15:42 juju-e4d256-prod-github-runner-207 kernel: [53516.569499] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 20:15:42 juju-e4d256-prod-github-runner-207 kernel: [53516.570755] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 20:15:42 juju-e4d256-prod-github-runner-207 kernel: [53516.571860] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 20:15:42 juju-e4d256-prod-github-runner-207 kernel: [53516.573168] Call Trace: Aug 22 20:15:42 juju-e4d256-prod-github-runner-207 kernel: [53516.574089] Aug 22 20:15:42 juju-e4d256-prod-github-runner-207 kernel: [53516.574973] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:15:42 juju-e4d256-prod-github-runner-207 kernel: [53516.576193] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:15:42 juju-e4d256-prod-github-runner-207 kernel: [53516.577225] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:15:42 juju-e4d256-prod-github-runner-207 kernel: [53516.578315] ? show_regs.part.0+0x23/0x29 Aug 22 20:15:42 juju-e4d256-prod-github-runner-207 kernel: [53516.579318] ? show_regs.cold+0x8/0xd Aug 22 20:15:42 juju-e4d256-prod-github-runner-207 kernel: [53516.580293] ? watchdog_timer_fn+0x1be/0x220 Aug 22 20:15:42 juju-e4d256-prod-github-runner-207 kernel: [53516.581330] ? lockup_detector_update_enable+0x60/0x60 Aug 22 20:15:42 juju-e4d256-prod-github-runner-207 kernel: [53516.582453] ? __hrtimer_run_queues+0x107/0x230 Aug 22 20:15:42 juju-e4d256-prod-github-runner-207 kernel: [53516.583486] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 20:15:42 juju-e4d256-prod-github-runner-207 kernel: [53516.584512] ? hrtimer_interrupt+0x101/0x220 Aug 22 20:15:42 juju-e4d256-prod-github-runner-207 kernel: [53516.585530] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 20:15:42 juju-e4d256-prod-github-runner-207 kernel: [53516.586613] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 20:15:42 juju-e4d256-prod-github-runner-207 kernel: [53516.587674] Aug 22 20:15:42 juju-e4d256-prod-github-runner-207 kernel: [53516.588530] Aug 22 20:15:42 juju-e4d256-prod-github-runner-207 kernel: [53516.589368] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 20:15:42 juju-e4d256-prod-github-runner-207 kernel: [53516.590413] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:15:42 juju-e4d256-prod-github-runner-207 kernel: [53516.591455] ? _raw_spin_lock+0x22/0x30 Aug 22 20:15:42 juju-e4d256-prod-github-runner-207 kernel: [53516.592409] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:15:42 juju-e4d256-prod-github-runner-207 kernel: [53516.593434] direct_page_fault+0x206/0x310 [kvm] Aug 22 20:15:42 juju-e4d256-prod-github-runner-207 kernel: [53516.594477] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 20:15:42 juju-e4d256-prod-github-runner-207 kernel: [53516.595485] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 20:15:42 juju-e4d256-prod-github-runner-207 kernel: [53516.596684] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 20:15:42 juju-e4d256-prod-github-runner-207 kernel: [53516.597978] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 20:15:42 juju-e4d256-prod-github-runner-207 kernel: [53516.599056] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 20:15:42 juju-e4d256-prod-github-runner-207 kernel: [53516.600035] handle_exit+0x98/0x230 [kvm_amd] Aug 22 20:15:42 juju-e4d256-prod-github-runner-207 kernel: [53516.600934] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 20:15:42 juju-e4d256-prod-github-runner-207 kernel: [53516.601864] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 20:15:42 juju-e4d256-prod-github-runner-207 kernel: [53516.602797] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 20:15:42 juju-e4d256-prod-github-runner-207 kernel: [53516.603711] vcpu_run+0x62/0x2c0 [kvm] Aug 22 20:15:42 juju-e4d256-prod-github-runner-207 kernel: [53516.604524] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 20:15:42 juju-e4d256-prod-github-runner-207 kernel: [53516.605334] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 20:15:42 juju-e4d256-prod-github-runner-207 kernel: [53516.606221] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 20:15:42 juju-e4d256-prod-github-runner-207 kernel: [53516.607036] ? __seccomp_filter+0x4a/0x4a0 Aug 22 20:15:42 juju-e4d256-prod-github-runner-207 kernel: [53516.607785] ? __fget_files+0x86/0xc0 Aug 22 20:15:42 juju-e4d256-prod-github-runner-207 kernel: [53516.608513] __x64_sys_ioctl+0x95/0xd0 Aug 22 20:15:42 juju-e4d256-prod-github-runner-207 kernel: [53516.609222] do_syscall_64+0x5c/0xc0 Aug 22 20:15:42 juju-e4d256-prod-github-runner-207 kernel: [53516.610138] ? do_futex+0x162/0x1f0 Aug 22 20:15:42 juju-e4d256-prod-github-runner-207 kernel: [53516.611069] ? __x64_sys_futex+0x78/0x1e0 Aug 22 20:15:42 juju-e4d256-prod-github-runner-207 kernel: [53516.611855] ? __secure_computing+0xa9/0x120 Aug 22 20:15:42 juju-e4d256-prod-github-runner-207 kernel: [53516.612578] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 20:15:42 juju-e4d256-prod-github-runner-207 kernel: [53516.613358] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:15:42 juju-e4d256-prod-github-runner-207 kernel: [53516.614137] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:15:42 juju-e4d256-prod-github-runner-207 kernel: [53516.614861] ? do_syscall_64+0x69/0xc0 Aug 22 20:15:42 juju-e4d256-prod-github-runner-207 kernel: [53516.615505] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:15:42 juju-e4d256-prod-github-runner-207 kernel: [53516.616205] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:15:42 juju-e4d256-prod-github-runner-207 kernel: [53516.616904] ? do_syscall_64+0x69/0xc0 Aug 22 20:15:42 juju-e4d256-prod-github-runner-207 kernel: [53516.617527] ? do_syscall_64+0x69/0xc0 Aug 22 20:15:42 juju-e4d256-prod-github-runner-207 kernel: [53516.618154] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 20:15:42 juju-e4d256-prod-github-runner-207 kernel: [53516.618894] RIP: 0033:0x7faa5d0edaff Aug 22 20:15:42 juju-e4d256-prod-github-runner-207 kernel: [53516.619554] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 20:15:42 juju-e4d256-prod-github-runner-207 kernel: [53516.621577] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 20:15:42 juju-e4d256-prod-github-runner-207 kernel: [53516.622513] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 20:15:42 juju-e4d256-prod-github-runner-207 kernel: [53516.623402] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 20:15:42 juju-e4d256-prod-github-runner-207 kernel: [53516.624322] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 20:15:42 juju-e4d256-prod-github-runner-207 kernel: [53516.625217] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 20:15:42 juju-e4d256-prod-github-runner-207 kernel: [53516.626151] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 20:15:42 juju-e4d256-prod-github-runner-207 kernel: [53516.627055] Aug 22 20:16:10 juju-e4d256-prod-github-runner-207 kernel: [53544.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 49759s! [qemu-system-x86:6715] Aug 22 20:16:10 juju-e4d256-prod-github-runner-207 kernel: [53544.543124] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 20:16:10 juju-e4d256-prod-github-runner-207 kernel: [53544.543195] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 20:16:10 juju-e4d256-prod-github-runner-207 kernel: [53544.556059] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 20:16:10 juju-e4d256-prod-github-runner-207 kernel: [53544.557566] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 20:16:10 juju-e4d256-prod-github-runner-207 kernel: [53544.558890] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:16:10 juju-e4d256-prod-github-runner-207 kernel: [53544.560119] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 20:16:10 juju-e4d256-prod-github-runner-207 kernel: [53544.563278] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 20:16:10 juju-e4d256-prod-github-runner-207 kernel: [53544.564376] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 20:16:10 juju-e4d256-prod-github-runner-207 kernel: [53544.565590] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 20:16:10 juju-e4d256-prod-github-runner-207 kernel: [53544.566767] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 20:16:10 juju-e4d256-prod-github-runner-207 kernel: [53544.567980] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 20:16:10 juju-e4d256-prod-github-runner-207 kernel: [53544.569216] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 20:16:10 juju-e4d256-prod-github-runner-207 kernel: [53544.570671] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 20:16:10 juju-e4d256-prod-github-runner-207 kernel: [53544.571985] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 20:16:10 juju-e4d256-prod-github-runner-207 kernel: [53544.573346] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 20:16:10 juju-e4d256-prod-github-runner-207 kernel: [53544.574690] Call Trace: Aug 22 20:16:10 juju-e4d256-prod-github-runner-207 kernel: [53544.575647] Aug 22 20:16:10 juju-e4d256-prod-github-runner-207 kernel: [53544.576546] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:16:10 juju-e4d256-prod-github-runner-207 kernel: [53544.577627] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:16:10 juju-e4d256-prod-github-runner-207 kernel: [53544.578705] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:16:10 juju-e4d256-prod-github-runner-207 kernel: [53544.579837] ? show_regs.part.0+0x23/0x29 Aug 22 20:16:10 juju-e4d256-prod-github-runner-207 kernel: [53544.580858] ? show_regs.cold+0x8/0xd Aug 22 20:16:10 juju-e4d256-prod-github-runner-207 kernel: [53544.581859] ? watchdog_timer_fn+0x1be/0x220 Aug 22 20:16:10 juju-e4d256-prod-github-runner-207 kernel: [53544.582882] ? lockup_detector_update_enable+0x60/0x60 Aug 22 20:16:10 juju-e4d256-prod-github-runner-207 kernel: [53544.583996] ? __hrtimer_run_queues+0x107/0x230 Aug 22 20:16:10 juju-e4d256-prod-github-runner-207 kernel: [53544.585080] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 20:16:10 juju-e4d256-prod-github-runner-207 kernel: [53544.586156] ? hrtimer_interrupt+0x101/0x220 Aug 22 20:16:10 juju-e4d256-prod-github-runner-207 kernel: [53544.587190] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 20:16:10 juju-e4d256-prod-github-runner-207 kernel: [53544.588288] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 20:16:10 juju-e4d256-prod-github-runner-207 kernel: [53544.589521] Aug 22 20:16:10 juju-e4d256-prod-github-runner-207 kernel: [53544.590506] Aug 22 20:16:10 juju-e4d256-prod-github-runner-207 kernel: [53544.591359] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 20:16:10 juju-e4d256-prod-github-runner-207 kernel: [53544.592411] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:16:10 juju-e4d256-prod-github-runner-207 kernel: [53544.593499] ? _raw_spin_lock+0x22/0x30 Aug 22 20:16:10 juju-e4d256-prod-github-runner-207 kernel: [53544.594477] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:16:10 juju-e4d256-prod-github-runner-207 kernel: [53544.595516] direct_page_fault+0x206/0x310 [kvm] Aug 22 20:16:10 juju-e4d256-prod-github-runner-207 kernel: [53544.596560] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 20:16:10 juju-e4d256-prod-github-runner-207 kernel: [53544.597612] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 20:16:10 juju-e4d256-prod-github-runner-207 kernel: [53544.598632] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 20:16:10 juju-e4d256-prod-github-runner-207 kernel: [53544.599620] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 20:16:10 juju-e4d256-prod-github-runner-207 kernel: [53544.600582] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 20:16:10 juju-e4d256-prod-github-runner-207 kernel: [53544.601607] handle_exit+0x98/0x230 [kvm_amd] Aug 22 20:16:10 juju-e4d256-prod-github-runner-207 kernel: [53544.602527] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 20:16:10 juju-e4d256-prod-github-runner-207 kernel: [53544.603475] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 20:16:10 juju-e4d256-prod-github-runner-207 kernel: [53544.604422] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 20:16:10 juju-e4d256-prod-github-runner-207 kernel: [53544.605344] vcpu_run+0x62/0x2c0 [kvm] Aug 22 20:16:10 juju-e4d256-prod-github-runner-207 kernel: [53544.606186] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 20:16:10 juju-e4d256-prod-github-runner-207 kernel: [53544.607024] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 20:16:10 juju-e4d256-prod-github-runner-207 kernel: [53544.607894] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 20:16:10 juju-e4d256-prod-github-runner-207 kernel: [53544.608713] ? __seccomp_filter+0x4a/0x4a0 Aug 22 20:16:10 juju-e4d256-prod-github-runner-207 kernel: [53544.609481] ? __fget_files+0x86/0xc0 Aug 22 20:16:10 juju-e4d256-prod-github-runner-207 kernel: [53544.610203] __x64_sys_ioctl+0x95/0xd0 Aug 22 20:16:10 juju-e4d256-prod-github-runner-207 kernel: [53544.610907] do_syscall_64+0x5c/0xc0 Aug 22 20:16:10 juju-e4d256-prod-github-runner-207 kernel: [53544.611689] ? do_futex+0x162/0x1f0 Aug 22 20:16:10 juju-e4d256-prod-github-runner-207 kernel: [53544.612355] ? __x64_sys_futex+0x78/0x1e0 Aug 22 20:16:10 juju-e4d256-prod-github-runner-207 kernel: [53544.613255] ? __secure_computing+0xa9/0x120 Aug 22 20:16:10 juju-e4d256-prod-github-runner-207 kernel: [53544.614020] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 20:16:10 juju-e4d256-prod-github-runner-207 kernel: [53544.614800] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:16:10 juju-e4d256-prod-github-runner-207 kernel: [53544.615558] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:16:10 juju-e4d256-prod-github-runner-207 kernel: [53544.616512] ? do_syscall_64+0x69/0xc0 Aug 22 20:16:10 juju-e4d256-prod-github-runner-207 kernel: [53544.617181] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:16:10 juju-e4d256-prod-github-runner-207 kernel: [53544.617970] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:16:10 juju-e4d256-prod-github-runner-207 kernel: [53544.618684] ? do_syscall_64+0x69/0xc0 Aug 22 20:16:10 juju-e4d256-prod-github-runner-207 kernel: [53544.619327] ? do_syscall_64+0x69/0xc0 Aug 22 20:16:10 juju-e4d256-prod-github-runner-207 kernel: [53544.619985] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 20:16:10 juju-e4d256-prod-github-runner-207 kernel: [53544.620929] RIP: 0033:0x7faa5d0edaff Aug 22 20:16:10 juju-e4d256-prod-github-runner-207 kernel: [53544.621606] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 20:16:10 juju-e4d256-prod-github-runner-207 kernel: [53544.623725] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 20:16:10 juju-e4d256-prod-github-runner-207 kernel: [53544.624660] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 20:16:10 juju-e4d256-prod-github-runner-207 kernel: [53544.625609] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 20:16:10 juju-e4d256-prod-github-runner-207 kernel: [53544.626525] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 20:16:10 juju-e4d256-prod-github-runner-207 kernel: [53544.627433] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 20:16:10 juju-e4d256-prod-github-runner-207 kernel: [53544.628348] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 20:16:10 juju-e4d256-prod-github-runner-207 kernel: [53544.629267] Aug 22 20:16:38 juju-e4d256-prod-github-runner-207 kernel: [53572.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 49785s! [qemu-system-x86:6715] Aug 22 20:16:38 juju-e4d256-prod-github-runner-207 kernel: [53572.543139] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 20:16:38 juju-e4d256-prod-github-runner-207 kernel: [53572.543207] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 20:16:38 juju-e4d256-prod-github-runner-207 kernel: [53572.555278] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 20:16:38 juju-e4d256-prod-github-runner-207 kernel: [53572.556542] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 20:16:38 juju-e4d256-prod-github-runner-207 kernel: [53572.557766] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:16:38 juju-e4d256-prod-github-runner-207 kernel: [53572.558821] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 20:16:38 juju-e4d256-prod-github-runner-207 kernel: [53572.561379] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 20:16:38 juju-e4d256-prod-github-runner-207 kernel: [53572.562421] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 20:16:38 juju-e4d256-prod-github-runner-207 kernel: [53572.563580] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 20:16:38 juju-e4d256-prod-github-runner-207 kernel: [53572.564744] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 20:16:38 juju-e4d256-prod-github-runner-207 kernel: [53572.565910] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 20:16:38 juju-e4d256-prod-github-runner-207 kernel: [53572.567076] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 20:16:38 juju-e4d256-prod-github-runner-207 kernel: [53572.568240] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 20:16:38 juju-e4d256-prod-github-runner-207 kernel: [53572.569489] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 20:16:38 juju-e4d256-prod-github-runner-207 kernel: [53572.570594] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 20:16:38 juju-e4d256-prod-github-runner-207 kernel: [53572.571786] Call Trace: Aug 22 20:16:38 juju-e4d256-prod-github-runner-207 kernel: [53572.572699] Aug 22 20:16:38 juju-e4d256-prod-github-runner-207 kernel: [53572.573595] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:16:38 juju-e4d256-prod-github-runner-207 kernel: [53572.574633] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:16:38 juju-e4d256-prod-github-runner-207 kernel: [53572.575654] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:16:38 juju-e4d256-prod-github-runner-207 kernel: [53572.576772] ? show_regs.part.0+0x23/0x29 Aug 22 20:16:38 juju-e4d256-prod-github-runner-207 kernel: [53572.577788] ? show_regs.cold+0x8/0xd Aug 22 20:16:38 juju-e4d256-prod-github-runner-207 kernel: [53572.578761] ? watchdog_timer_fn+0x1be/0x220 Aug 22 20:16:38 juju-e4d256-prod-github-runner-207 kernel: [53572.579960] ? lockup_detector_update_enable+0x60/0x60 Aug 22 20:16:38 juju-e4d256-prod-github-runner-207 kernel: [53572.581200] ? __hrtimer_run_queues+0x107/0x230 Aug 22 20:16:38 juju-e4d256-prod-github-runner-207 kernel: [53572.582228] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 20:16:38 juju-e4d256-prod-github-runner-207 kernel: [53572.583258] ? hrtimer_interrupt+0x101/0x220 Aug 22 20:16:38 juju-e4d256-prod-github-runner-207 kernel: [53572.584278] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 20:16:38 juju-e4d256-prod-github-runner-207 kernel: [53572.585369] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 20:16:38 juju-e4d256-prod-github-runner-207 kernel: [53572.586416] Aug 22 20:16:38 juju-e4d256-prod-github-runner-207 kernel: [53572.587272] Aug 22 20:16:38 juju-e4d256-prod-github-runner-207 kernel: [53572.588108] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 20:16:38 juju-e4d256-prod-github-runner-207 kernel: [53572.589152] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:16:38 juju-e4d256-prod-github-runner-207 kernel: [53572.590194] ? _raw_spin_lock+0x22/0x30 Aug 22 20:16:38 juju-e4d256-prod-github-runner-207 kernel: [53572.591141] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:16:38 juju-e4d256-prod-github-runner-207 kernel: [53572.592159] direct_page_fault+0x206/0x310 [kvm] Aug 22 20:16:38 juju-e4d256-prod-github-runner-207 kernel: [53572.593198] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 20:16:38 juju-e4d256-prod-github-runner-207 kernel: [53572.594207] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 20:16:38 juju-e4d256-prod-github-runner-207 kernel: [53572.595207] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 20:16:38 juju-e4d256-prod-github-runner-207 kernel: [53572.596175] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 20:16:38 juju-e4d256-prod-github-runner-207 kernel: [53572.597135] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 20:16:38 juju-e4d256-prod-github-runner-207 kernel: [53572.598111] handle_exit+0x98/0x230 [kvm_amd] Aug 22 20:16:38 juju-e4d256-prod-github-runner-207 kernel: [53572.599002] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 20:16:38 juju-e4d256-prod-github-runner-207 kernel: [53572.599919] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 20:16:38 juju-e4d256-prod-github-runner-207 kernel: [53572.600840] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 20:16:38 juju-e4d256-prod-github-runner-207 kernel: [53572.601755] vcpu_run+0x62/0x2c0 [kvm] Aug 22 20:16:38 juju-e4d256-prod-github-runner-207 kernel: [53572.602565] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 20:16:38 juju-e4d256-prod-github-runner-207 kernel: [53572.603370] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 20:16:38 juju-e4d256-prod-github-runner-207 kernel: [53572.604221] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 20:16:38 juju-e4d256-prod-github-runner-207 kernel: [53572.605027] ? __seccomp_filter+0x4a/0x4a0 Aug 22 20:16:38 juju-e4d256-prod-github-runner-207 kernel: [53572.605769] ? __fget_files+0x86/0xc0 Aug 22 20:16:38 juju-e4d256-prod-github-runner-207 kernel: [53572.606474] __x64_sys_ioctl+0x95/0xd0 Aug 22 20:16:38 juju-e4d256-prod-github-runner-207 kernel: [53572.607196] do_syscall_64+0x5c/0xc0 Aug 22 20:16:38 juju-e4d256-prod-github-runner-207 kernel: [53572.607861] ? do_futex+0x162/0x1f0 Aug 22 20:16:38 juju-e4d256-prod-github-runner-207 kernel: [53572.608510] ? __x64_sys_futex+0x78/0x1e0 Aug 22 20:16:38 juju-e4d256-prod-github-runner-207 kernel: [53572.609198] ? __secure_computing+0xa9/0x120 Aug 22 20:16:38 juju-e4d256-prod-github-runner-207 kernel: [53572.609888] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 20:16:38 juju-e4d256-prod-github-runner-207 kernel: [53572.610647] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:16:38 juju-e4d256-prod-github-runner-207 kernel: [53572.611370] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:16:38 juju-e4d256-prod-github-runner-207 kernel: [53572.612087] ? do_syscall_64+0x69/0xc0 Aug 22 20:16:38 juju-e4d256-prod-github-runner-207 kernel: [53572.612731] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:16:38 juju-e4d256-prod-github-runner-207 kernel: [53572.613443] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:16:38 juju-e4d256-prod-github-runner-207 kernel: [53572.614137] ? do_syscall_64+0x69/0xc0 Aug 22 20:16:38 juju-e4d256-prod-github-runner-207 kernel: [53572.614761] ? do_syscall_64+0x69/0xc0 Aug 22 20:16:38 juju-e4d256-prod-github-runner-207 kernel: [53572.615383] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 20:16:38 juju-e4d256-prod-github-runner-207 kernel: [53572.616088] RIP: 0033:0x7faa5d0edaff Aug 22 20:16:38 juju-e4d256-prod-github-runner-207 kernel: [53572.616713] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 20:16:38 juju-e4d256-prod-github-runner-207 kernel: [53572.618704] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 20:16:38 juju-e4d256-prod-github-runner-207 kernel: [53572.619612] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 20:16:38 juju-e4d256-prod-github-runner-207 kernel: [53572.620500] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 20:16:38 juju-e4d256-prod-github-runner-207 kernel: [53572.621394] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 20:16:38 juju-e4d256-prod-github-runner-207 kernel: [53572.622282] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 20:16:38 juju-e4d256-prod-github-runner-207 kernel: [53572.623169] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 20:16:38 juju-e4d256-prod-github-runner-207 kernel: [53572.624068] Aug 22 20:17:06 juju-e4d256-prod-github-runner-207 kernel: [53600.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 49811s! [qemu-system-x86:6715] Aug 22 20:17:06 juju-e4d256-prod-github-runner-207 kernel: [53600.543705] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 20:17:06 juju-e4d256-prod-github-runner-207 kernel: [53600.543929] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 20:17:06 juju-e4d256-prod-github-runner-207 kernel: [53600.556081] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 20:17:06 juju-e4d256-prod-github-runner-207 kernel: [53600.557360] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 20:17:06 juju-e4d256-prod-github-runner-207 kernel: [53600.558580] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:17:06 juju-e4d256-prod-github-runner-207 kernel: [53600.559639] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 20:17:06 juju-e4d256-prod-github-runner-207 kernel: [53600.562312] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 20:17:06 juju-e4d256-prod-github-runner-207 kernel: [53600.563358] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 20:17:06 juju-e4d256-prod-github-runner-207 kernel: [53600.564522] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 20:17:06 juju-e4d256-prod-github-runner-207 kernel: [53600.565724] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 20:17:06 juju-e4d256-prod-github-runner-207 kernel: [53600.566885] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 20:17:06 juju-e4d256-prod-github-runner-207 kernel: [53600.568046] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 20:17:06 juju-e4d256-prod-github-runner-207 kernel: [53600.569229] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 20:17:06 juju-e4d256-prod-github-runner-207 kernel: [53600.570468] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 20:17:06 juju-e4d256-prod-github-runner-207 kernel: [53600.571570] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 20:17:06 juju-e4d256-prod-github-runner-207 kernel: [53600.572782] Call Trace: Aug 22 20:17:06 juju-e4d256-prod-github-runner-207 kernel: [53600.573695] Aug 22 20:17:06 juju-e4d256-prod-github-runner-207 kernel: [53600.574595] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:17:06 juju-e4d256-prod-github-runner-207 kernel: [53600.575638] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:17:06 juju-e4d256-prod-github-runner-207 kernel: [53600.576688] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:17:06 juju-e4d256-prod-github-runner-207 kernel: [53600.577786] ? show_regs.part.0+0x23/0x29 Aug 22 20:17:06 juju-e4d256-prod-github-runner-207 kernel: [53600.578789] ? show_regs.cold+0x8/0xd Aug 22 20:17:06 juju-e4d256-prod-github-runner-207 kernel: [53600.579760] ? watchdog_timer_fn+0x1be/0x220 Aug 22 20:17:06 juju-e4d256-prod-github-runner-207 kernel: [53600.580792] ? lockup_detector_update_enable+0x60/0x60 Aug 22 20:17:06 juju-e4d256-prod-github-runner-207 kernel: [53600.581858] ? __hrtimer_run_queues+0x107/0x230 Aug 22 20:17:06 juju-e4d256-prod-github-runner-207 kernel: [53600.582888] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 20:17:06 juju-e4d256-prod-github-runner-207 kernel: [53600.583911] ? hrtimer_interrupt+0x101/0x220 Aug 22 20:17:06 juju-e4d256-prod-github-runner-207 kernel: [53600.584956] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 20:17:06 juju-e4d256-prod-github-runner-207 kernel: [53600.586034] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 20:17:06 juju-e4d256-prod-github-runner-207 kernel: [53600.587083] Aug 22 20:17:06 juju-e4d256-prod-github-runner-207 kernel: [53600.587939] Aug 22 20:17:06 juju-e4d256-prod-github-runner-207 kernel: [53600.588796] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 20:17:06 juju-e4d256-prod-github-runner-207 kernel: [53600.589842] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:17:06 juju-e4d256-prod-github-runner-207 kernel: [53600.590910] ? _raw_spin_lock+0x22/0x30 Aug 22 20:17:06 juju-e4d256-prod-github-runner-207 kernel: [53600.591868] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:17:06 juju-e4d256-prod-github-runner-207 kernel: [53600.592920] direct_page_fault+0x206/0x310 [kvm] Aug 22 20:17:06 juju-e4d256-prod-github-runner-207 kernel: [53600.593949] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 20:17:06 juju-e4d256-prod-github-runner-207 kernel: [53600.594963] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 20:17:06 juju-e4d256-prod-github-runner-207 kernel: [53600.595975] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 20:17:06 juju-e4d256-prod-github-runner-207 kernel: [53600.597014] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 20:17:06 juju-e4d256-prod-github-runner-207 kernel: [53600.598108] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 20:17:06 juju-e4d256-prod-github-runner-207 kernel: [53600.599217] handle_exit+0x98/0x230 [kvm_amd] Aug 22 20:17:06 juju-e4d256-prod-github-runner-207 kernel: [53600.600201] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 20:17:06 juju-e4d256-prod-github-runner-207 kernel: [53600.601152] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 20:17:06 juju-e4d256-prod-github-runner-207 kernel: [53600.602098] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 20:17:06 juju-e4d256-prod-github-runner-207 kernel: [53600.603010] vcpu_run+0x62/0x2c0 [kvm] Aug 22 20:17:06 juju-e4d256-prod-github-runner-207 kernel: [53600.603827] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 20:17:06 juju-e4d256-prod-github-runner-207 kernel: [53600.604640] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 20:17:06 juju-e4d256-prod-github-runner-207 kernel: [53600.605535] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 20:17:06 juju-e4d256-prod-github-runner-207 kernel: [53600.606343] ? __seccomp_filter+0x4a/0x4a0 Aug 22 20:17:06 juju-e4d256-prod-github-runner-207 kernel: [53600.607094] ? __fget_files+0x86/0xc0 Aug 22 20:17:06 juju-e4d256-prod-github-runner-207 kernel: [53600.607805] __x64_sys_ioctl+0x95/0xd0 Aug 22 20:17:06 juju-e4d256-prod-github-runner-207 kernel: [53600.608505] do_syscall_64+0x5c/0xc0 Aug 22 20:17:06 juju-e4d256-prod-github-runner-207 kernel: [53600.609200] ? do_futex+0x162/0x1f0 Aug 22 20:17:06 juju-e4d256-prod-github-runner-207 kernel: [53600.609853] ? __x64_sys_futex+0x78/0x1e0 Aug 22 20:17:06 juju-e4d256-prod-github-runner-207 kernel: [53600.610581] ? __secure_computing+0xa9/0x120 Aug 22 20:17:06 juju-e4d256-prod-github-runner-207 kernel: [53600.611298] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 20:17:06 juju-e4d256-prod-github-runner-207 kernel: [53600.612078] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:17:06 juju-e4d256-prod-github-runner-207 kernel: [53600.612827] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:17:06 juju-e4d256-prod-github-runner-207 kernel: [53600.613554] ? do_syscall_64+0x69/0xc0 Aug 22 20:17:06 juju-e4d256-prod-github-runner-207 kernel: [53600.614203] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:17:06 juju-e4d256-prod-github-runner-207 kernel: [53600.614909] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:17:06 juju-e4d256-prod-github-runner-207 kernel: [53600.615610] ? do_syscall_64+0x69/0xc0 Aug 22 20:17:06 juju-e4d256-prod-github-runner-207 kernel: [53600.616251] ? do_syscall_64+0x69/0xc0 Aug 22 20:17:06 juju-e4d256-prod-github-runner-207 kernel: [53600.616900] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 20:17:06 juju-e4d256-prod-github-runner-207 kernel: [53600.617641] RIP: 0033:0x7faa5d0edaff Aug 22 20:17:06 juju-e4d256-prod-github-runner-207 kernel: [53600.618332] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 20:17:06 juju-e4d256-prod-github-runner-207 kernel: [53600.620359] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 20:17:06 juju-e4d256-prod-github-runner-207 kernel: [53600.621324] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 20:17:06 juju-e4d256-prod-github-runner-207 kernel: [53600.622224] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 20:17:06 juju-e4d256-prod-github-runner-207 kernel: [53600.623116] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 20:17:06 juju-e4d256-prod-github-runner-207 kernel: [53600.624009] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 20:17:06 juju-e4d256-prod-github-runner-207 kernel: [53600.624929] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 20:17:06 juju-e4d256-prod-github-runner-207 kernel: [53600.625840] Aug 22 20:17:34 juju-e4d256-prod-github-runner-207 kernel: [53628.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 49837s! [qemu-system-x86:6715] Aug 22 20:17:34 juju-e4d256-prod-github-runner-207 kernel: [53628.543097] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 20:17:34 juju-e4d256-prod-github-runner-207 kernel: [53628.543165] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 20:17:34 juju-e4d256-prod-github-runner-207 kernel: [53628.555270] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 20:17:34 juju-e4d256-prod-github-runner-207 kernel: [53628.556555] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 20:17:34 juju-e4d256-prod-github-runner-207 kernel: [53628.557778] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:17:34 juju-e4d256-prod-github-runner-207 kernel: [53628.558833] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 20:17:34 juju-e4d256-prod-github-runner-207 kernel: [53628.561376] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 20:17:34 juju-e4d256-prod-github-runner-207 kernel: [53628.562415] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 20:17:34 juju-e4d256-prod-github-runner-207 kernel: [53628.563573] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 20:17:34 juju-e4d256-prod-github-runner-207 kernel: [53628.564736] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 20:17:34 juju-e4d256-prod-github-runner-207 kernel: [53628.565894] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 20:17:34 juju-e4d256-prod-github-runner-207 kernel: [53628.567053] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 20:17:34 juju-e4d256-prod-github-runner-207 kernel: [53628.568218] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 20:17:34 juju-e4d256-prod-github-runner-207 kernel: [53628.569459] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 20:17:34 juju-e4d256-prod-github-runner-207 kernel: [53628.570553] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 20:17:34 juju-e4d256-prod-github-runner-207 kernel: [53628.571743] Call Trace: Aug 22 20:17:34 juju-e4d256-prod-github-runner-207 kernel: [53628.572666] Aug 22 20:17:34 juju-e4d256-prod-github-runner-207 kernel: [53628.573550] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:17:34 juju-e4d256-prod-github-runner-207 kernel: [53628.574577] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:17:34 juju-e4d256-prod-github-runner-207 kernel: [53628.575593] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:17:34 juju-e4d256-prod-github-runner-207 kernel: [53628.576680] ? show_regs.part.0+0x23/0x29 Aug 22 20:17:34 juju-e4d256-prod-github-runner-207 kernel: [53628.577725] ? show_regs.cold+0x8/0xd Aug 22 20:17:34 juju-e4d256-prod-github-runner-207 kernel: [53628.578708] ? watchdog_timer_fn+0x1be/0x220 Aug 22 20:17:34 juju-e4d256-prod-github-runner-207 kernel: [53628.579716] ? lockup_detector_update_enable+0x60/0x60 Aug 22 20:17:34 juju-e4d256-prod-github-runner-207 kernel: [53628.580797] ? __hrtimer_run_queues+0x107/0x230 Aug 22 20:17:34 juju-e4d256-prod-github-runner-207 kernel: [53628.581827] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 20:17:34 juju-e4d256-prod-github-runner-207 kernel: [53628.582849] ? hrtimer_interrupt+0x101/0x220 Aug 22 20:17:34 juju-e4d256-prod-github-runner-207 kernel: [53628.583868] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 20:17:34 juju-e4d256-prod-github-runner-207 kernel: [53628.584945] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 20:17:34 juju-e4d256-prod-github-runner-207 kernel: [53628.585990] Aug 22 20:17:34 juju-e4d256-prod-github-runner-207 kernel: [53628.586841] Aug 22 20:17:34 juju-e4d256-prod-github-runner-207 kernel: [53628.587682] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 20:17:34 juju-e4d256-prod-github-runner-207 kernel: [53628.588727] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:17:34 juju-e4d256-prod-github-runner-207 kernel: [53628.589768] ? _raw_spin_lock+0x22/0x30 Aug 22 20:17:34 juju-e4d256-prod-github-runner-207 kernel: [53628.590719] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:17:34 juju-e4d256-prod-github-runner-207 kernel: [53628.591738] direct_page_fault+0x206/0x310 [kvm] Aug 22 20:17:34 juju-e4d256-prod-github-runner-207 kernel: [53628.592777] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 20:17:34 juju-e4d256-prod-github-runner-207 kernel: [53628.593788] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 20:17:34 juju-e4d256-prod-github-runner-207 kernel: [53628.594787] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 20:17:34 juju-e4d256-prod-github-runner-207 kernel: [53628.595757] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 20:17:34 juju-e4d256-prod-github-runner-207 kernel: [53628.596711] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 20:17:34 juju-e4d256-prod-github-runner-207 kernel: [53628.597696] handle_exit+0x98/0x230 [kvm_amd] Aug 22 20:17:34 juju-e4d256-prod-github-runner-207 kernel: [53628.598589] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 20:17:34 juju-e4d256-prod-github-runner-207 kernel: [53628.599501] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 20:17:34 juju-e4d256-prod-github-runner-207 kernel: [53628.600448] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 20:17:34 juju-e4d256-prod-github-runner-207 kernel: [53628.601356] vcpu_run+0x62/0x2c0 [kvm] Aug 22 20:17:34 juju-e4d256-prod-github-runner-207 kernel: [53628.602168] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 20:17:34 juju-e4d256-prod-github-runner-207 kernel: [53628.602979] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 20:17:34 juju-e4d256-prod-github-runner-207 kernel: [53628.603835] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 20:17:34 juju-e4d256-prod-github-runner-207 kernel: [53628.604641] ? __seccomp_filter+0x4a/0x4a0 Aug 22 20:17:34 juju-e4d256-prod-github-runner-207 kernel: [53628.605388] ? __fget_files+0x86/0xc0 Aug 22 20:17:34 juju-e4d256-prod-github-runner-207 kernel: [53628.606092] __x64_sys_ioctl+0x95/0xd0 Aug 22 20:17:34 juju-e4d256-prod-github-runner-207 kernel: [53628.606785] do_syscall_64+0x5c/0xc0 Aug 22 20:17:34 juju-e4d256-prod-github-runner-207 kernel: [53628.607528] ? do_futex+0x162/0x1f0 Aug 22 20:17:34 juju-e4d256-prod-github-runner-207 kernel: [53628.608193] ? __x64_sys_futex+0x78/0x1e0 Aug 22 20:17:34 juju-e4d256-prod-github-runner-207 kernel: [53628.608889] ? __secure_computing+0xa9/0x120 Aug 22 20:17:34 juju-e4d256-prod-github-runner-207 kernel: [53628.609579] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 20:17:34 juju-e4d256-prod-github-runner-207 kernel: [53628.610336] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:17:34 juju-e4d256-prod-github-runner-207 kernel: [53628.611056] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:17:34 juju-e4d256-prod-github-runner-207 kernel: [53628.611771] ? do_syscall_64+0x69/0xc0 Aug 22 20:17:34 juju-e4d256-prod-github-runner-207 kernel: [53628.612426] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:17:34 juju-e4d256-prod-github-runner-207 kernel: [53628.613130] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:17:34 juju-e4d256-prod-github-runner-207 kernel: [53628.613823] ? do_syscall_64+0x69/0xc0 Aug 22 20:17:34 juju-e4d256-prod-github-runner-207 kernel: [53628.614445] ? do_syscall_64+0x69/0xc0 Aug 22 20:17:34 juju-e4d256-prod-github-runner-207 kernel: [53628.615067] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 20:17:34 juju-e4d256-prod-github-runner-207 kernel: [53628.615771] RIP: 0033:0x7faa5d0edaff Aug 22 20:17:34 juju-e4d256-prod-github-runner-207 kernel: [53628.616444] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 20:17:34 juju-e4d256-prod-github-runner-207 kernel: [53628.618469] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 20:17:34 juju-e4d256-prod-github-runner-207 kernel: [53628.619379] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 20:17:34 juju-e4d256-prod-github-runner-207 kernel: [53628.620267] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 20:17:34 juju-e4d256-prod-github-runner-207 kernel: [53628.621164] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 20:17:34 juju-e4d256-prod-github-runner-207 kernel: [53628.622050] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 20:17:34 juju-e4d256-prod-github-runner-207 kernel: [53628.622935] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 20:17:34 juju-e4d256-prod-github-runner-207 kernel: [53628.623824] Aug 22 20:17:46 juju-e4d256-prod-github-runner-207 kernel: [53640.764710] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 20:17:46 juju-e4d256-prod-github-runner-207 kernel: [53640.765671] rcu: 1-....: (13338754 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=6447944 Aug 22 20:17:46 juju-e4d256-prod-github-runner-207 kernel: [53640.766794] (t=13380891 jiffies g=23269 q=49973) Aug 22 20:17:46 juju-e4d256-prod-github-runner-207 kernel: [53640.767584] NMI backtrace for cpu 1 Aug 22 20:17:46 juju-e4d256-prod-github-runner-207 kernel: [53640.768316] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 20:17:46 juju-e4d256-prod-github-runner-207 kernel: [53640.769444] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 20:17:46 juju-e4d256-prod-github-runner-207 kernel: [53640.770518] Call Trace: Aug 22 20:17:46 juju-e4d256-prod-github-runner-207 kernel: [53640.771195] Aug 22 20:17:46 juju-e4d256-prod-github-runner-207 kernel: [53640.771840] show_stack+0x52/0x5c Aug 22 20:17:46 juju-e4d256-prod-github-runner-207 kernel: [53640.772616] dump_stack_lvl+0x4a/0x63 Aug 22 20:17:46 juju-e4d256-prod-github-runner-207 kernel: [53640.773375] dump_stack+0x10/0x16 Aug 22 20:17:46 juju-e4d256-prod-github-runner-207 kernel: [53640.774116] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 20:17:46 juju-e4d256-prod-github-runner-207 kernel: [53640.774922] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 20:17:46 juju-e4d256-prod-github-runner-207 kernel: [53640.775735] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 20:17:46 juju-e4d256-prod-github-runner-207 kernel: [53640.776578] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 20:17:46 juju-e4d256-prod-github-runner-207 kernel: [53640.777409] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 20:17:46 juju-e4d256-prod-github-runner-207 kernel: [53640.778222] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 20:17:46 juju-e4d256-prod-github-runner-207 kernel: [53640.779014] print_cpu_stall.cold+0x2f/0xe2 Aug 22 20:17:46 juju-e4d256-prod-github-runner-207 kernel: [53640.779792] ? timekeeping_update+0xf7/0x150 Aug 22 20:17:46 juju-e4d256-prod-github-runner-207 kernel: [53640.780628] check_cpu_stall+0x109/0x270 Aug 22 20:17:46 juju-e4d256-prod-github-runner-207 kernel: [53640.781392] rcu_sched_clock_irq+0x9a/0x250 Aug 22 20:17:46 juju-e4d256-prod-github-runner-207 kernel: [53640.782156] update_process_times+0x94/0xd0 Aug 22 20:17:46 juju-e4d256-prod-github-runner-207 kernel: [53640.782959] tick_sched_handle+0x29/0x70 Aug 22 20:17:46 juju-e4d256-prod-github-runner-207 kernel: [53640.783898] tick_sched_timer+0x8c/0xc0 Aug 22 20:17:46 juju-e4d256-prod-github-runner-207 kernel: [53640.784726] ? tick_nohz_handler+0xb0/0xb0 Aug 22 20:17:46 juju-e4d256-prod-github-runner-207 kernel: [53640.785509] __hrtimer_run_queues+0x107/0x230 Aug 22 20:17:46 juju-e4d256-prod-github-runner-207 kernel: [53640.786294] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 20:17:46 juju-e4d256-prod-github-runner-207 kernel: [53640.787074] hrtimer_interrupt+0x101/0x220 Aug 22 20:17:46 juju-e4d256-prod-github-runner-207 kernel: [53640.787836] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 20:17:46 juju-e4d256-prod-github-runner-207 kernel: [53640.788661] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 20:17:46 juju-e4d256-prod-github-runner-207 kernel: [53640.789478] Aug 22 20:17:46 juju-e4d256-prod-github-runner-207 kernel: [53640.790121] Aug 22 20:17:46 juju-e4d256-prod-github-runner-207 kernel: [53640.790766] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 20:17:46 juju-e4d256-prod-github-runner-207 kernel: [53640.791593] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:17:46 juju-e4d256-prod-github-runner-207 kernel: [53640.792494] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 20:17:46 juju-e4d256-prod-github-runner-207 kernel: [53640.794739] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 20:17:46 juju-e4d256-prod-github-runner-207 kernel: [53640.795637] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 20:17:46 juju-e4d256-prod-github-runner-207 kernel: [53640.796662] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 20:17:46 juju-e4d256-prod-github-runner-207 kernel: [53640.797643] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 20:17:46 juju-e4d256-prod-github-runner-207 kernel: [53640.798616] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 20:17:46 juju-e4d256-prod-github-runner-207 kernel: [53640.799574] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 20:17:46 juju-e4d256-prod-github-runner-207 kernel: [53640.800553] ? _raw_spin_lock+0x22/0x30 Aug 22 20:17:46 juju-e4d256-prod-github-runner-207 kernel: [53640.801332] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:17:46 juju-e4d256-prod-github-runner-207 kernel: [53640.802183] direct_page_fault+0x206/0x310 [kvm] Aug 22 20:17:46 juju-e4d256-prod-github-runner-207 kernel: [53640.803029] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 20:17:46 juju-e4d256-prod-github-runner-207 kernel: [53640.803863] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 20:17:46 juju-e4d256-prod-github-runner-207 kernel: [53640.804707] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 20:17:46 juju-e4d256-prod-github-runner-207 kernel: [53640.805526] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 20:17:46 juju-e4d256-prod-github-runner-207 kernel: [53640.806329] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 20:17:46 juju-e4d256-prod-github-runner-207 kernel: [53640.807165] handle_exit+0x98/0x230 [kvm_amd] Aug 22 20:17:46 juju-e4d256-prod-github-runner-207 kernel: [53640.807931] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 20:17:46 juju-e4d256-prod-github-runner-207 kernel: [53640.808741] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 20:17:46 juju-e4d256-prod-github-runner-207 kernel: [53640.809546] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 20:17:46 juju-e4d256-prod-github-runner-207 kernel: [53640.810348] vcpu_run+0x62/0x2c0 [kvm] Aug 22 20:17:46 juju-e4d256-prod-github-runner-207 kernel: [53640.811087] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 20:17:46 juju-e4d256-prod-github-runner-207 kernel: [53640.811836] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 20:17:46 juju-e4d256-prod-github-runner-207 kernel: [53640.812662] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 20:17:46 juju-e4d256-prod-github-runner-207 kernel: [53640.813431] ? __seccomp_filter+0x4a/0x4a0 Aug 22 20:17:46 juju-e4d256-prod-github-runner-207 kernel: [53640.814258] ? __fget_files+0x86/0xc0 Aug 22 20:17:46 juju-e4d256-prod-github-runner-207 kernel: [53640.815131] __x64_sys_ioctl+0x95/0xd0 Aug 22 20:17:46 juju-e4d256-prod-github-runner-207 kernel: [53640.815852] do_syscall_64+0x5c/0xc0 Aug 22 20:17:46 juju-e4d256-prod-github-runner-207 kernel: [53640.816594] ? do_futex+0x162/0x1f0 Aug 22 20:17:46 juju-e4d256-prod-github-runner-207 kernel: [53640.817281] ? __x64_sys_futex+0x78/0x1e0 Aug 22 20:17:46 juju-e4d256-prod-github-runner-207 kernel: [53640.817990] ? __secure_computing+0xa9/0x120 Aug 22 20:17:46 juju-e4d256-prod-github-runner-207 kernel: [53640.818713] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 20:17:46 juju-e4d256-prod-github-runner-207 kernel: [53640.819509] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:17:46 juju-e4d256-prod-github-runner-207 kernel: [53640.820286] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:17:46 juju-e4d256-prod-github-runner-207 kernel: [53640.821056] ? do_syscall_64+0x69/0xc0 Aug 22 20:17:46 juju-e4d256-prod-github-runner-207 kernel: [53640.821771] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:17:46 juju-e4d256-prod-github-runner-207 kernel: [53640.822537] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:17:46 juju-e4d256-prod-github-runner-207 kernel: [53640.823304] ? do_syscall_64+0x69/0xc0 Aug 22 20:17:46 juju-e4d256-prod-github-runner-207 kernel: [53640.824003] ? do_syscall_64+0x69/0xc0 Aug 22 20:17:46 juju-e4d256-prod-github-runner-207 kernel: [53640.824711] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 20:17:46 juju-e4d256-prod-github-runner-207 kernel: [53640.825498] RIP: 0033:0x7faa5d0edaff Aug 22 20:17:46 juju-e4d256-prod-github-runner-207 kernel: [53640.826188] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 20:17:46 juju-e4d256-prod-github-runner-207 kernel: [53640.828332] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 20:17:46 juju-e4d256-prod-github-runner-207 kernel: [53640.829342] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 20:17:46 juju-e4d256-prod-github-runner-207 kernel: [53640.830297] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 20:17:46 juju-e4d256-prod-github-runner-207 kernel: [53640.831273] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 20:17:46 juju-e4d256-prod-github-runner-207 kernel: [53640.832263] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 20:17:46 juju-e4d256-prod-github-runner-207 kernel: [53640.833209] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 20:17:46 juju-e4d256-prod-github-runner-207 kernel: [53640.834152] Aug 22 20:18:14 juju-e4d256-prod-github-runner-207 kernel: [53668.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 49874s! [qemu-system-x86:6715] Aug 22 20:18:14 juju-e4d256-prod-github-runner-207 kernel: [53668.543163] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 20:18:14 juju-e4d256-prod-github-runner-207 kernel: [53668.543348] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 20:18:14 juju-e4d256-prod-github-runner-207 kernel: [53668.555528] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 20:18:14 juju-e4d256-prod-github-runner-207 kernel: [53668.556876] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 20:18:14 juju-e4d256-prod-github-runner-207 kernel: [53668.558124] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:18:14 juju-e4d256-prod-github-runner-207 kernel: [53668.559204] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 20:18:14 juju-e4d256-prod-github-runner-207 kernel: [53668.561835] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 20:18:14 juju-e4d256-prod-github-runner-207 kernel: [53668.562891] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 20:18:14 juju-e4d256-prod-github-runner-207 kernel: [53668.564084] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 20:18:14 juju-e4d256-prod-github-runner-207 kernel: [53668.565253] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 20:18:14 juju-e4d256-prod-github-runner-207 kernel: [53668.566428] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 20:18:14 juju-e4d256-prod-github-runner-207 kernel: [53668.567630] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 20:18:14 juju-e4d256-prod-github-runner-207 kernel: [53668.568838] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 20:18:14 juju-e4d256-prod-github-runner-207 kernel: [53668.570111] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 20:18:14 juju-e4d256-prod-github-runner-207 kernel: [53668.571232] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 20:18:14 juju-e4d256-prod-github-runner-207 kernel: [53668.572495] Call Trace: Aug 22 20:18:14 juju-e4d256-prod-github-runner-207 kernel: [53668.573428] Aug 22 20:18:14 juju-e4d256-prod-github-runner-207 kernel: [53668.574322] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:18:14 juju-e4d256-prod-github-runner-207 kernel: [53668.575357] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:18:14 juju-e4d256-prod-github-runner-207 kernel: [53668.576411] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:18:14 juju-e4d256-prod-github-runner-207 kernel: [53668.577685] ? show_regs.part.0+0x23/0x29 Aug 22 20:18:14 juju-e4d256-prod-github-runner-207 kernel: [53668.578691] ? show_regs.cold+0x8/0xd Aug 22 20:18:14 juju-e4d256-prod-github-runner-207 kernel: [53668.579666] ? watchdog_timer_fn+0x1be/0x220 Aug 22 20:18:14 juju-e4d256-prod-github-runner-207 kernel: [53668.580704] ? lockup_detector_update_enable+0x60/0x60 Aug 22 20:18:14 juju-e4d256-prod-github-runner-207 kernel: [53668.581790] ? __hrtimer_run_queues+0x107/0x230 Aug 22 20:18:14 juju-e4d256-prod-github-runner-207 kernel: [53668.582834] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 20:18:14 juju-e4d256-prod-github-runner-207 kernel: [53668.583887] ? hrtimer_interrupt+0x101/0x220 Aug 22 20:18:14 juju-e4d256-prod-github-runner-207 kernel: [53668.584910] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 20:18:14 juju-e4d256-prod-github-runner-207 kernel: [53668.585987] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 20:18:14 juju-e4d256-prod-github-runner-207 kernel: [53668.587045] Aug 22 20:18:14 juju-e4d256-prod-github-runner-207 kernel: [53668.587949] Aug 22 20:18:14 juju-e4d256-prod-github-runner-207 kernel: [53668.588797] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 20:18:14 juju-e4d256-prod-github-runner-207 kernel: [53668.589836] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:18:14 juju-e4d256-prod-github-runner-207 kernel: [53668.590876] ? _raw_spin_lock+0x22/0x30 Aug 22 20:18:14 juju-e4d256-prod-github-runner-207 kernel: [53668.591842] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:18:14 juju-e4d256-prod-github-runner-207 kernel: [53668.592868] direct_page_fault+0x206/0x310 [kvm] Aug 22 20:18:14 juju-e4d256-prod-github-runner-207 kernel: [53668.593902] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 20:18:14 juju-e4d256-prod-github-runner-207 kernel: [53668.594914] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 20:18:14 juju-e4d256-prod-github-runner-207 kernel: [53668.595958] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 20:18:14 juju-e4d256-prod-github-runner-207 kernel: [53668.596967] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 20:18:14 juju-e4d256-prod-github-runner-207 kernel: [53668.597974] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 20:18:14 juju-e4d256-prod-github-runner-207 kernel: [53668.599116] handle_exit+0x98/0x230 [kvm_amd] Aug 22 20:18:14 juju-e4d256-prod-github-runner-207 kernel: [53668.600135] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 20:18:14 juju-e4d256-prod-github-runner-207 kernel: [53668.601174] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 20:18:14 juju-e4d256-prod-github-runner-207 kernel: [53668.602222] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 20:18:14 juju-e4d256-prod-github-runner-207 kernel: [53668.603240] vcpu_run+0x62/0x2c0 [kvm] Aug 22 20:18:14 juju-e4d256-prod-github-runner-207 kernel: [53668.604160] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 20:18:14 juju-e4d256-prod-github-runner-207 kernel: [53668.605042] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 20:18:14 juju-e4d256-prod-github-runner-207 kernel: [53668.605907] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 20:18:14 juju-e4d256-prod-github-runner-207 kernel: [53668.606706] ? __seccomp_filter+0x4a/0x4a0 Aug 22 20:18:14 juju-e4d256-prod-github-runner-207 kernel: [53668.607470] ? __fget_files+0x86/0xc0 Aug 22 20:18:14 juju-e4d256-prod-github-runner-207 kernel: [53668.608379] __x64_sys_ioctl+0x95/0xd0 Aug 22 20:18:14 juju-e4d256-prod-github-runner-207 kernel: [53668.609120] do_syscall_64+0x5c/0xc0 Aug 22 20:18:14 juju-e4d256-prod-github-runner-207 kernel: [53668.609801] ? do_futex+0x162/0x1f0 Aug 22 20:18:14 juju-e4d256-prod-github-runner-207 kernel: [53668.610453] ? __x64_sys_futex+0x78/0x1e0 Aug 22 20:18:14 juju-e4d256-prod-github-runner-207 kernel: [53668.611129] ? __secure_computing+0xa9/0x120 Aug 22 20:18:14 juju-e4d256-prod-github-runner-207 kernel: [53668.611845] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 20:18:14 juju-e4d256-prod-github-runner-207 kernel: [53668.612608] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:18:14 juju-e4d256-prod-github-runner-207 kernel: [53668.613331] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:18:14 juju-e4d256-prod-github-runner-207 kernel: [53668.614057] ? do_syscall_64+0x69/0xc0 Aug 22 20:18:14 juju-e4d256-prod-github-runner-207 kernel: [53668.614703] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:18:14 juju-e4d256-prod-github-runner-207 kernel: [53668.615411] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:18:14 juju-e4d256-prod-github-runner-207 kernel: [53668.616131] ? do_syscall_64+0x69/0xc0 Aug 22 20:18:14 juju-e4d256-prod-github-runner-207 kernel: [53668.616757] ? do_syscall_64+0x69/0xc0 Aug 22 20:18:14 juju-e4d256-prod-github-runner-207 kernel: [53668.617386] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 20:18:14 juju-e4d256-prod-github-runner-207 kernel: [53668.618117] RIP: 0033:0x7faa5d0edaff Aug 22 20:18:14 juju-e4d256-prod-github-runner-207 kernel: [53668.618815] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 20:18:14 juju-e4d256-prod-github-runner-207 kernel: [53668.620832] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 20:18:14 juju-e4d256-prod-github-runner-207 kernel: [53668.621748] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 20:18:14 juju-e4d256-prod-github-runner-207 kernel: [53668.622637] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 20:18:14 juju-e4d256-prod-github-runner-207 kernel: [53668.623529] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 20:18:14 juju-e4d256-prod-github-runner-207 kernel: [53668.624435] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 20:18:14 juju-e4d256-prod-github-runner-207 kernel: [53668.625323] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 20:18:14 juju-e4d256-prod-github-runner-207 kernel: [53668.626215] Aug 22 20:18:42 juju-e4d256-prod-github-runner-207 kernel: [53696.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 49900s! [qemu-system-x86:6715] Aug 22 20:18:42 juju-e4d256-prod-github-runner-207 kernel: [53696.543716] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 20:18:42 juju-e4d256-prod-github-runner-207 kernel: [53696.543893] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 20:18:42 juju-e4d256-prod-github-runner-207 kernel: [53696.556036] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 20:18:42 juju-e4d256-prod-github-runner-207 kernel: [53696.557300] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 20:18:42 juju-e4d256-prod-github-runner-207 kernel: [53696.558518] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:18:42 juju-e4d256-prod-github-runner-207 kernel: [53696.559595] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 20:18:42 juju-e4d256-prod-github-runner-207 kernel: [53696.562143] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 20:18:42 juju-e4d256-prod-github-runner-207 kernel: [53696.563185] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 20:18:42 juju-e4d256-prod-github-runner-207 kernel: [53696.564353] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 20:18:42 juju-e4d256-prod-github-runner-207 kernel: [53696.565513] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 20:18:42 juju-e4d256-prod-github-runner-207 kernel: [53696.566674] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 20:18:42 juju-e4d256-prod-github-runner-207 kernel: [53696.567847] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 20:18:42 juju-e4d256-prod-github-runner-207 kernel: [53696.569013] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 20:18:42 juju-e4d256-prod-github-runner-207 kernel: [53696.570244] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 20:18:42 juju-e4d256-prod-github-runner-207 kernel: [53696.571340] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 20:18:42 juju-e4d256-prod-github-runner-207 kernel: [53696.572542] Call Trace: Aug 22 20:18:42 juju-e4d256-prod-github-runner-207 kernel: [53696.573454] Aug 22 20:18:42 juju-e4d256-prod-github-runner-207 kernel: [53696.574345] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:18:42 juju-e4d256-prod-github-runner-207 kernel: [53696.575377] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:18:42 juju-e4d256-prod-github-runner-207 kernel: [53696.576451] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:18:42 juju-e4d256-prod-github-runner-207 kernel: [53696.577584] ? show_regs.part.0+0x23/0x29 Aug 22 20:18:42 juju-e4d256-prod-github-runner-207 kernel: [53696.578587] ? show_regs.cold+0x8/0xd Aug 22 20:18:42 juju-e4d256-prod-github-runner-207 kernel: [53696.579578] ? watchdog_timer_fn+0x1be/0x220 Aug 22 20:18:42 juju-e4d256-prod-github-runner-207 kernel: [53696.580586] ? lockup_detector_update_enable+0x60/0x60 Aug 22 20:18:42 juju-e4d256-prod-github-runner-207 kernel: [53696.581653] ? __hrtimer_run_queues+0x107/0x230 Aug 22 20:18:42 juju-e4d256-prod-github-runner-207 kernel: [53696.582679] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 20:18:42 juju-e4d256-prod-github-runner-207 kernel: [53696.583825] ? hrtimer_interrupt+0x101/0x220 Aug 22 20:18:42 juju-e4d256-prod-github-runner-207 kernel: [53696.584859] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 20:18:42 juju-e4d256-prod-github-runner-207 kernel: [53696.585930] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 20:18:42 juju-e4d256-prod-github-runner-207 kernel: [53696.586977] Aug 22 20:18:42 juju-e4d256-prod-github-runner-207 kernel: [53696.587846] Aug 22 20:18:42 juju-e4d256-prod-github-runner-207 kernel: [53696.588684] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 20:18:42 juju-e4d256-prod-github-runner-207 kernel: [53696.589718] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:18:42 juju-e4d256-prod-github-runner-207 kernel: [53696.590756] ? _raw_spin_lock+0x22/0x30 Aug 22 20:18:42 juju-e4d256-prod-github-runner-207 kernel: [53696.591712] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:18:42 juju-e4d256-prod-github-runner-207 kernel: [53696.592730] direct_page_fault+0x206/0x310 [kvm] Aug 22 20:18:42 juju-e4d256-prod-github-runner-207 kernel: [53696.593754] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 20:18:42 juju-e4d256-prod-github-runner-207 kernel: [53696.594768] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 20:18:42 juju-e4d256-prod-github-runner-207 kernel: [53696.595778] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 20:18:42 juju-e4d256-prod-github-runner-207 kernel: [53696.596756] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 20:18:42 juju-e4d256-prod-github-runner-207 kernel: [53696.597701] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 20:18:42 juju-e4d256-prod-github-runner-207 kernel: [53696.598677] handle_exit+0x98/0x230 [kvm_amd] Aug 22 20:18:42 juju-e4d256-prod-github-runner-207 kernel: [53696.599582] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 20:18:42 juju-e4d256-prod-github-runner-207 kernel: [53696.600512] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 20:18:42 juju-e4d256-prod-github-runner-207 kernel: [53696.601435] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 20:18:42 juju-e4d256-prod-github-runner-207 kernel: [53696.602335] vcpu_run+0x62/0x2c0 [kvm] Aug 22 20:18:42 juju-e4d256-prod-github-runner-207 kernel: [53696.603144] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 20:18:42 juju-e4d256-prod-github-runner-207 kernel: [53696.603960] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 20:18:42 juju-e4d256-prod-github-runner-207 kernel: [53696.604812] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 20:18:42 juju-e4d256-prod-github-runner-207 kernel: [53696.605607] ? __seccomp_filter+0x4a/0x4a0 Aug 22 20:18:42 juju-e4d256-prod-github-runner-207 kernel: [53696.606373] ? __fget_files+0x86/0xc0 Aug 22 20:18:42 juju-e4d256-prod-github-runner-207 kernel: [53696.607106] __x64_sys_ioctl+0x95/0xd0 Aug 22 20:18:42 juju-e4d256-prod-github-runner-207 kernel: [53696.607816] do_syscall_64+0x5c/0xc0 Aug 22 20:18:42 juju-e4d256-prod-github-runner-207 kernel: [53696.608480] ? do_futex+0x162/0x1f0 Aug 22 20:18:42 juju-e4d256-prod-github-runner-207 kernel: [53696.609127] ? __x64_sys_futex+0x78/0x1e0 Aug 22 20:18:42 juju-e4d256-prod-github-runner-207 kernel: [53696.609799] ? __secure_computing+0xa9/0x120 Aug 22 20:18:42 juju-e4d256-prod-github-runner-207 kernel: [53696.610488] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 20:18:42 juju-e4d256-prod-github-runner-207 kernel: [53696.611248] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:18:42 juju-e4d256-prod-github-runner-207 kernel: [53696.611988] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:18:42 juju-e4d256-prod-github-runner-207 kernel: [53696.612711] ? do_syscall_64+0x69/0xc0 Aug 22 20:18:42 juju-e4d256-prod-github-runner-207 kernel: [53696.613383] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:18:42 juju-e4d256-prod-github-runner-207 kernel: [53696.614286] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:18:42 juju-e4d256-prod-github-runner-207 kernel: [53696.615160] ? do_syscall_64+0x69/0xc0 Aug 22 20:18:42 juju-e4d256-prod-github-runner-207 kernel: [53696.615804] ? do_syscall_64+0x69/0xc0 Aug 22 20:18:42 juju-e4d256-prod-github-runner-207 kernel: [53696.616501] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 20:18:42 juju-e4d256-prod-github-runner-207 kernel: [53696.617211] RIP: 0033:0x7faa5d0edaff Aug 22 20:18:42 juju-e4d256-prod-github-runner-207 kernel: [53696.617851] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 20:18:42 juju-e4d256-prod-github-runner-207 kernel: [53696.619864] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 20:18:42 juju-e4d256-prod-github-runner-207 kernel: [53696.620778] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 20:18:42 juju-e4d256-prod-github-runner-207 kernel: [53696.621671] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 20:18:42 juju-e4d256-prod-github-runner-207 kernel: [53696.622563] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 20:18:42 juju-e4d256-prod-github-runner-207 kernel: [53696.623463] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 20:18:42 juju-e4d256-prod-github-runner-207 kernel: [53696.624356] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 20:18:42 juju-e4d256-prod-github-runner-207 kernel: [53696.625252] Aug 22 20:19:10 juju-e4d256-prod-github-runner-207 kernel: [53724.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 49926s! [qemu-system-x86:6715] Aug 22 20:19:10 juju-e4d256-prod-github-runner-207 kernel: [53724.543129] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 20:19:10 juju-e4d256-prod-github-runner-207 kernel: [53724.543196] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 20:19:10 juju-e4d256-prod-github-runner-207 kernel: [53724.555496] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 20:19:10 juju-e4d256-prod-github-runner-207 kernel: [53724.556775] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 20:19:10 juju-e4d256-prod-github-runner-207 kernel: [53724.558000] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:19:10 juju-e4d256-prod-github-runner-207 kernel: [53724.559079] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 20:19:10 juju-e4d256-prod-github-runner-207 kernel: [53724.561674] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 20:19:10 juju-e4d256-prod-github-runner-207 kernel: [53724.562729] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 20:19:10 juju-e4d256-prod-github-runner-207 kernel: [53724.563929] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 20:19:10 juju-e4d256-prod-github-runner-207 kernel: [53724.565116] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 20:19:10 juju-e4d256-prod-github-runner-207 kernel: [53724.566286] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 20:19:10 juju-e4d256-prod-github-runner-207 kernel: [53724.567484] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 20:19:10 juju-e4d256-prod-github-runner-207 kernel: [53724.568657] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 20:19:10 juju-e4d256-prod-github-runner-207 kernel: [53724.569924] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 20:19:10 juju-e4d256-prod-github-runner-207 kernel: [53724.571057] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 20:19:10 juju-e4d256-prod-github-runner-207 kernel: [53724.572272] Call Trace: Aug 22 20:19:10 juju-e4d256-prod-github-runner-207 kernel: [53724.573198] Aug 22 20:19:10 juju-e4d256-prod-github-runner-207 kernel: [53724.574094] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:19:10 juju-e4d256-prod-github-runner-207 kernel: [53724.575154] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:19:10 juju-e4d256-prod-github-runner-207 kernel: [53724.576193] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:19:10 juju-e4d256-prod-github-runner-207 kernel: [53724.577278] ? show_regs.part.0+0x23/0x29 Aug 22 20:19:10 juju-e4d256-prod-github-runner-207 kernel: [53724.578282] ? show_regs.cold+0x8/0xd Aug 22 20:19:10 juju-e4d256-prod-github-runner-207 kernel: [53724.579284] ? watchdog_timer_fn+0x1be/0x220 Aug 22 20:19:10 juju-e4d256-prod-github-runner-207 kernel: [53724.580324] ? lockup_detector_update_enable+0x60/0x60 Aug 22 20:19:10 juju-e4d256-prod-github-runner-207 kernel: [53724.581417] ? __hrtimer_run_queues+0x107/0x230 Aug 22 20:19:10 juju-e4d256-prod-github-runner-207 kernel: [53724.582470] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 20:19:10 juju-e4d256-prod-github-runner-207 kernel: [53724.583546] ? hrtimer_interrupt+0x101/0x220 Aug 22 20:19:10 juju-e4d256-prod-github-runner-207 kernel: [53724.584584] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 20:19:10 juju-e4d256-prod-github-runner-207 kernel: [53724.585699] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 20:19:10 juju-e4d256-prod-github-runner-207 kernel: [53724.586764] Aug 22 20:19:10 juju-e4d256-prod-github-runner-207 kernel: [53724.587648] Aug 22 20:19:10 juju-e4d256-prod-github-runner-207 kernel: [53724.588492] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 20:19:10 juju-e4d256-prod-github-runner-207 kernel: [53724.589545] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:19:10 juju-e4d256-prod-github-runner-207 kernel: [53724.590613] ? _raw_spin_lock+0x22/0x30 Aug 22 20:19:10 juju-e4d256-prod-github-runner-207 kernel: [53724.591609] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:19:10 juju-e4d256-prod-github-runner-207 kernel: [53724.592640] direct_page_fault+0x206/0x310 [kvm] Aug 22 20:19:10 juju-e4d256-prod-github-runner-207 kernel: [53724.593677] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 20:19:10 juju-e4d256-prod-github-runner-207 kernel: [53724.594698] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 20:19:10 juju-e4d256-prod-github-runner-207 kernel: [53724.595728] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 20:19:10 juju-e4d256-prod-github-runner-207 kernel: [53724.596724] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 20:19:10 juju-e4d256-prod-github-runner-207 kernel: [53724.597677] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 20:19:10 juju-e4d256-prod-github-runner-207 kernel: [53724.598665] handle_exit+0x98/0x230 [kvm_amd] Aug 22 20:19:10 juju-e4d256-prod-github-runner-207 kernel: [53724.599582] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 20:19:10 juju-e4d256-prod-github-runner-207 kernel: [53724.600514] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 20:19:10 juju-e4d256-prod-github-runner-207 kernel: [53724.601512] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 20:19:10 juju-e4d256-prod-github-runner-207 kernel: [53724.602432] vcpu_run+0x62/0x2c0 [kvm] Aug 22 20:19:10 juju-e4d256-prod-github-runner-207 kernel: [53724.603271] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 20:19:10 juju-e4d256-prod-github-runner-207 kernel: [53724.604087] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 20:19:10 juju-e4d256-prod-github-runner-207 kernel: [53724.604959] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 20:19:10 juju-e4d256-prod-github-runner-207 kernel: [53724.605778] ? __seccomp_filter+0x4a/0x4a0 Aug 22 20:19:10 juju-e4d256-prod-github-runner-207 kernel: [53724.606539] ? __fget_files+0x86/0xc0 Aug 22 20:19:10 juju-e4d256-prod-github-runner-207 kernel: [53724.607281] __x64_sys_ioctl+0x95/0xd0 Aug 22 20:19:10 juju-e4d256-prod-github-runner-207 kernel: [53724.607987] do_syscall_64+0x5c/0xc0 Aug 22 20:19:10 juju-e4d256-prod-github-runner-207 kernel: [53724.608834] ? do_futex+0x162/0x1f0 Aug 22 20:19:10 juju-e4d256-prod-github-runner-207 kernel: [53724.609502] ? __x64_sys_futex+0x78/0x1e0 Aug 22 20:19:10 juju-e4d256-prod-github-runner-207 kernel: [53724.610182] ? __secure_computing+0xa9/0x120 Aug 22 20:19:10 juju-e4d256-prod-github-runner-207 kernel: [53724.611081] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 20:19:10 juju-e4d256-prod-github-runner-207 kernel: [53724.611913] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:19:10 juju-e4d256-prod-github-runner-207 kernel: [53724.612655] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:19:10 juju-e4d256-prod-github-runner-207 kernel: [53724.613392] ? do_syscall_64+0x69/0xc0 Aug 22 20:19:10 juju-e4d256-prod-github-runner-207 kernel: [53724.614049] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:19:10 juju-e4d256-prod-github-runner-207 kernel: [53724.614763] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:19:10 juju-e4d256-prod-github-runner-207 kernel: [53724.615494] ? do_syscall_64+0x69/0xc0 Aug 22 20:19:10 juju-e4d256-prod-github-runner-207 kernel: [53724.616130] ? do_syscall_64+0x69/0xc0 Aug 22 20:19:10 juju-e4d256-prod-github-runner-207 kernel: [53724.616771] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 20:19:10 juju-e4d256-prod-github-runner-207 kernel: [53724.617488] RIP: 0033:0x7faa5d0edaff Aug 22 20:19:10 juju-e4d256-prod-github-runner-207 kernel: [53724.618125] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 20:19:10 juju-e4d256-prod-github-runner-207 kernel: [53724.620151] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 20:19:10 juju-e4d256-prod-github-runner-207 kernel: [53724.621124] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 20:19:10 juju-e4d256-prod-github-runner-207 kernel: [53724.622059] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 20:19:10 juju-e4d256-prod-github-runner-207 kernel: [53724.623021] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 20:19:10 juju-e4d256-prod-github-runner-207 kernel: [53724.623948] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 20:19:10 juju-e4d256-prod-github-runner-207 kernel: [53724.624855] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 20:19:10 juju-e4d256-prod-github-runner-207 kernel: [53724.625772] Aug 22 20:19:38 juju-e4d256-prod-github-runner-207 kernel: [53752.541981] watchdog: BUG: soft lockup - CPU#1 stuck for 49952s! [qemu-system-x86:6715] Aug 22 20:19:38 juju-e4d256-prod-github-runner-207 kernel: [53752.543114] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 20:19:38 juju-e4d256-prod-github-runner-207 kernel: [53752.543184] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 20:19:38 juju-e4d256-prod-github-runner-207 kernel: [53752.555735] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 20:19:38 juju-e4d256-prod-github-runner-207 kernel: [53752.557063] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 20:19:38 juju-e4d256-prod-github-runner-207 kernel: [53752.558334] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:19:38 juju-e4d256-prod-github-runner-207 kernel: [53752.559426] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 20:19:38 juju-e4d256-prod-github-runner-207 kernel: [53752.562053] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 20:19:38 juju-e4d256-prod-github-runner-207 kernel: [53752.563449] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 20:19:38 juju-e4d256-prod-github-runner-207 kernel: [53752.564619] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 20:19:38 juju-e4d256-prod-github-runner-207 kernel: [53752.565785] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 20:19:38 juju-e4d256-prod-github-runner-207 kernel: [53752.566994] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 20:19:38 juju-e4d256-prod-github-runner-207 kernel: [53752.568188] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 20:19:38 juju-e4d256-prod-github-runner-207 kernel: [53752.569367] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 20:19:38 juju-e4d256-prod-github-runner-207 kernel: [53752.570624] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 20:19:38 juju-e4d256-prod-github-runner-207 kernel: [53752.571960] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 20:19:38 juju-e4d256-prod-github-runner-207 kernel: [53752.573183] Call Trace: Aug 22 20:19:38 juju-e4d256-prod-github-runner-207 kernel: [53752.574119] Aug 22 20:19:38 juju-e4d256-prod-github-runner-207 kernel: [53752.575157] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:19:38 juju-e4d256-prod-github-runner-207 kernel: [53752.576251] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:19:38 juju-e4d256-prod-github-runner-207 kernel: [53752.577520] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:19:38 juju-e4d256-prod-github-runner-207 kernel: [53752.578629] ? show_regs.part.0+0x23/0x29 Aug 22 20:19:38 juju-e4d256-prod-github-runner-207 kernel: [53752.579838] ? show_regs.cold+0x8/0xd Aug 22 20:19:38 juju-e4d256-prod-github-runner-207 kernel: [53752.580827] ? watchdog_timer_fn+0x1be/0x220 Aug 22 20:19:38 juju-e4d256-prod-github-runner-207 kernel: [53752.581861] ? lockup_detector_update_enable+0x60/0x60 Aug 22 20:19:38 juju-e4d256-prod-github-runner-207 kernel: [53752.582971] ? __hrtimer_run_queues+0x107/0x230 Aug 22 20:19:38 juju-e4d256-prod-github-runner-207 kernel: [53752.584028] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 20:19:38 juju-e4d256-prod-github-runner-207 kernel: [53752.585067] ? hrtimer_interrupt+0x101/0x220 Aug 22 20:19:38 juju-e4d256-prod-github-runner-207 kernel: [53752.586099] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 20:19:38 juju-e4d256-prod-github-runner-207 kernel: [53752.587212] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 20:19:38 juju-e4d256-prod-github-runner-207 kernel: [53752.588291] Aug 22 20:19:38 juju-e4d256-prod-github-runner-207 kernel: [53752.589181] Aug 22 20:19:38 juju-e4d256-prod-github-runner-207 kernel: [53752.590028] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 20:19:38 juju-e4d256-prod-github-runner-207 kernel: [53752.591105] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:19:38 juju-e4d256-prod-github-runner-207 kernel: [53752.592162] ? _raw_spin_lock+0x22/0x30 Aug 22 20:19:38 juju-e4d256-prod-github-runner-207 kernel: [53752.593163] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:19:38 juju-e4d256-prod-github-runner-207 kernel: [53752.594237] direct_page_fault+0x206/0x310 [kvm] Aug 22 20:19:38 juju-e4d256-prod-github-runner-207 kernel: [53752.595303] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 20:19:38 juju-e4d256-prod-github-runner-207 kernel: [53752.596340] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 20:19:38 juju-e4d256-prod-github-runner-207 kernel: [53752.597369] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 20:19:38 juju-e4d256-prod-github-runner-207 kernel: [53752.598359] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 20:19:38 juju-e4d256-prod-github-runner-207 kernel: [53752.599358] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 20:19:38 juju-e4d256-prod-github-runner-207 kernel: [53752.600355] handle_exit+0x98/0x230 [kvm_amd] Aug 22 20:19:38 juju-e4d256-prod-github-runner-207 kernel: [53752.601272] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 20:19:38 juju-e4d256-prod-github-runner-207 kernel: [53752.602221] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 20:19:38 juju-e4d256-prod-github-runner-207 kernel: [53752.603328] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 20:19:38 juju-e4d256-prod-github-runner-207 kernel: [53752.604447] vcpu_run+0x62/0x2c0 [kvm] Aug 22 20:19:38 juju-e4d256-prod-github-runner-207 kernel: [53752.605304] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 20:19:38 juju-e4d256-prod-github-runner-207 kernel: [53752.606125] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 20:19:38 juju-e4d256-prod-github-runner-207 kernel: [53752.607020] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 20:19:38 juju-e4d256-prod-github-runner-207 kernel: [53752.607857] ? __seccomp_filter+0x4a/0x4a0 Aug 22 20:19:38 juju-e4d256-prod-github-runner-207 kernel: [53752.608647] ? __fget_files+0x86/0xc0 Aug 22 20:19:38 juju-e4d256-prod-github-runner-207 kernel: [53752.609365] __x64_sys_ioctl+0x95/0xd0 Aug 22 20:19:38 juju-e4d256-prod-github-runner-207 kernel: [53752.610081] do_syscall_64+0x5c/0xc0 Aug 22 20:19:38 juju-e4d256-prod-github-runner-207 kernel: [53752.610767] ? do_futex+0x162/0x1f0 Aug 22 20:19:38 juju-e4d256-prod-github-runner-207 kernel: [53752.611434] ? __x64_sys_futex+0x78/0x1e0 Aug 22 20:19:38 juju-e4d256-prod-github-runner-207 kernel: [53752.612125] ? __secure_computing+0xa9/0x120 Aug 22 20:19:38 juju-e4d256-prod-github-runner-207 kernel: [53752.612848] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 20:19:38 juju-e4d256-prod-github-runner-207 kernel: [53752.613661] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:19:38 juju-e4d256-prod-github-runner-207 kernel: [53752.614400] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:19:38 juju-e4d256-prod-github-runner-207 kernel: [53752.615158] ? do_syscall_64+0x69/0xc0 Aug 22 20:19:38 juju-e4d256-prod-github-runner-207 kernel: [53752.615813] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:19:38 juju-e4d256-prod-github-runner-207 kernel: [53752.616530] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:19:38 juju-e4d256-prod-github-runner-207 kernel: [53752.617232] ? do_syscall_64+0x69/0xc0 Aug 22 20:19:38 juju-e4d256-prod-github-runner-207 kernel: [53752.617859] ? do_syscall_64+0x69/0xc0 Aug 22 20:19:38 juju-e4d256-prod-github-runner-207 kernel: [53752.618482] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 20:19:38 juju-e4d256-prod-github-runner-207 kernel: [53752.619256] RIP: 0033:0x7faa5d0edaff Aug 22 20:19:38 juju-e4d256-prod-github-runner-207 kernel: [53752.619894] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 20:19:38 juju-e4d256-prod-github-runner-207 kernel: [53752.621926] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 20:19:38 juju-e4d256-prod-github-runner-207 kernel: [53752.622880] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 20:19:38 juju-e4d256-prod-github-runner-207 kernel: [53752.623775] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 20:19:38 juju-e4d256-prod-github-runner-207 kernel: [53752.624699] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 20:19:38 juju-e4d256-prod-github-runner-207 kernel: [53752.625650] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 20:19:38 juju-e4d256-prod-github-runner-207 kernel: [53752.626574] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 20:19:38 juju-e4d256-prod-github-runner-207 kernel: [53752.627513] Aug 22 20:20:06 juju-e4d256-prod-github-runner-207 kernel: [53780.541981] watchdog: BUG: soft lockup - CPU#1 stuck for 49979s! [qemu-system-x86:6715] Aug 22 20:20:06 juju-e4d256-prod-github-runner-207 kernel: [53780.544015] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 20:20:06 juju-e4d256-prod-github-runner-207 kernel: [53780.544268] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 20:20:06 juju-e4d256-prod-github-runner-207 kernel: [53780.558343] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 20:20:06 juju-e4d256-prod-github-runner-207 kernel: [53780.559825] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 20:20:06 juju-e4d256-prod-github-runner-207 kernel: [53780.561213] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:20:06 juju-e4d256-prod-github-runner-207 kernel: [53780.562380] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 20:20:06 juju-e4d256-prod-github-runner-207 kernel: [53780.565289] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 20:20:06 juju-e4d256-prod-github-runner-207 kernel: [53780.566438] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 20:20:06 juju-e4d256-prod-github-runner-207 kernel: [53780.567732] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 20:20:06 juju-e4d256-prod-github-runner-207 kernel: [53780.569025] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 20:20:06 juju-e4d256-prod-github-runner-207 kernel: [53780.570321] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 20:20:06 juju-e4d256-prod-github-runner-207 kernel: [53780.571626] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 20:20:06 juju-e4d256-prod-github-runner-207 kernel: [53780.572927] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 20:20:06 juju-e4d256-prod-github-runner-207 kernel: [53780.574304] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 20:20:06 juju-e4d256-prod-github-runner-207 kernel: [53780.575525] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 20:20:06 juju-e4d256-prod-github-runner-207 kernel: [53780.576868] Call Trace: Aug 22 20:20:06 juju-e4d256-prod-github-runner-207 kernel: [53780.577838] Aug 22 20:20:06 juju-e4d256-prod-github-runner-207 kernel: [53780.578806] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:20:06 juju-e4d256-prod-github-runner-207 kernel: [53780.579929] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:20:06 juju-e4d256-prod-github-runner-207 kernel: [53780.581035] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:20:06 juju-e4d256-prod-github-runner-207 kernel: [53780.582225] ? show_regs.part.0+0x23/0x29 Aug 22 20:20:06 juju-e4d256-prod-github-runner-207 kernel: [53780.583311] ? show_regs.cold+0x8/0xd Aug 22 20:20:06 juju-e4d256-prod-github-runner-207 kernel: [53780.584365] ? watchdog_timer_fn+0x1be/0x220 Aug 22 20:20:06 juju-e4d256-prod-github-runner-207 kernel: [53780.585459] ? lockup_detector_update_enable+0x60/0x60 Aug 22 20:20:06 juju-e4d256-prod-github-runner-207 kernel: [53780.586686] ? __hrtimer_run_queues+0x107/0x230 Aug 22 20:20:06 juju-e4d256-prod-github-runner-207 kernel: [53780.587848] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 20:20:06 juju-e4d256-prod-github-runner-207 kernel: [53780.588980] ? hrtimer_interrupt+0x101/0x220 Aug 22 20:20:06 juju-e4d256-prod-github-runner-207 kernel: [53780.590085] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 20:20:06 juju-e4d256-prod-github-runner-207 kernel: [53780.591286] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 20:20:06 juju-e4d256-prod-github-runner-207 kernel: [53780.592430] Aug 22 20:20:06 juju-e4d256-prod-github-runner-207 kernel: [53780.593333] Aug 22 20:20:06 juju-e4d256-prod-github-runner-207 kernel: [53780.594215] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 20:20:06 juju-e4d256-prod-github-runner-207 kernel: [53780.595366] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:20:06 juju-e4d256-prod-github-runner-207 kernel: [53780.596517] ? _raw_spin_lock+0x22/0x30 Aug 22 20:20:06 juju-e4d256-prod-github-runner-207 kernel: [53780.597542] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:20:06 juju-e4d256-prod-github-runner-207 kernel: [53780.598669] direct_page_fault+0x206/0x310 [kvm] Aug 22 20:20:06 juju-e4d256-prod-github-runner-207 kernel: [53780.599783] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 20:20:06 juju-e4d256-prod-github-runner-207 kernel: [53780.600876] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 20:20:06 juju-e4d256-prod-github-runner-207 kernel: [53780.601980] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 20:20:06 juju-e4d256-prod-github-runner-207 kernel: [53780.603094] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 20:20:06 juju-e4d256-prod-github-runner-207 kernel: [53780.604137] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 20:20:06 juju-e4d256-prod-github-runner-207 kernel: [53780.605214] handle_exit+0x98/0x230 [kvm_amd] Aug 22 20:20:06 juju-e4d256-prod-github-runner-207 kernel: [53780.606195] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 20:20:06 juju-e4d256-prod-github-runner-207 kernel: [53780.607225] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 20:20:06 juju-e4d256-prod-github-runner-207 kernel: [53780.608248] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 20:20:06 juju-e4d256-prod-github-runner-207 kernel: [53780.609245] vcpu_run+0x62/0x2c0 [kvm] Aug 22 20:20:06 juju-e4d256-prod-github-runner-207 kernel: [53780.610137] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 20:20:06 juju-e4d256-prod-github-runner-207 kernel: [53780.611050] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 20:20:06 juju-e4d256-prod-github-runner-207 kernel: [53780.612002] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 20:20:06 juju-e4d256-prod-github-runner-207 kernel: [53780.612884] ? __seccomp_filter+0x4a/0x4a0 Aug 22 20:20:06 juju-e4d256-prod-github-runner-207 kernel: [53780.613706] ? __fget_files+0x86/0xc0 Aug 22 20:20:06 juju-e4d256-prod-github-runner-207 kernel: [53780.614501] __x64_sys_ioctl+0x95/0xd0 Aug 22 20:20:06 juju-e4d256-prod-github-runner-207 kernel: [53780.615276] do_syscall_64+0x5c/0xc0 Aug 22 20:20:06 juju-e4d256-prod-github-runner-207 kernel: [53780.616009] ? do_futex+0x162/0x1f0 Aug 22 20:20:06 juju-e4d256-prod-github-runner-207 kernel: [53780.616726] ? __x64_sys_futex+0x78/0x1e0 Aug 22 20:20:06 juju-e4d256-prod-github-runner-207 kernel: [53780.617497] ? __secure_computing+0xa9/0x120 Aug 22 20:20:06 juju-e4d256-prod-github-runner-207 kernel: [53780.618278] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 20:20:06 juju-e4d256-prod-github-runner-207 kernel: [53780.619093] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:20:06 juju-e4d256-prod-github-runner-207 kernel: [53780.619815] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:20:06 juju-e4d256-prod-github-runner-207 kernel: [53780.620536] ? do_syscall_64+0x69/0xc0 Aug 22 20:20:06 juju-e4d256-prod-github-runner-207 kernel: [53780.621182] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:20:06 juju-e4d256-prod-github-runner-207 kernel: [53780.621887] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:20:06 juju-e4d256-prod-github-runner-207 kernel: [53780.622598] ? do_syscall_64+0x69/0xc0 Aug 22 20:20:06 juju-e4d256-prod-github-runner-207 kernel: [53780.623231] ? do_syscall_64+0x69/0xc0 Aug 22 20:20:06 juju-e4d256-prod-github-runner-207 kernel: [53780.623856] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 20:20:06 juju-e4d256-prod-github-runner-207 kernel: [53780.624564] RIP: 0033:0x7faa5d0edaff Aug 22 20:20:06 juju-e4d256-prod-github-runner-207 kernel: [53780.625235] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 20:20:06 juju-e4d256-prod-github-runner-207 kernel: [53780.627249] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 20:20:06 juju-e4d256-prod-github-runner-207 kernel: [53780.628164] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 20:20:06 juju-e4d256-prod-github-runner-207 kernel: [53780.629058] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 20:20:06 juju-e4d256-prod-github-runner-207 kernel: [53780.629950] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 20:20:06 juju-e4d256-prod-github-runner-207 kernel: [53780.630848] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 20:20:06 juju-e4d256-prod-github-runner-207 kernel: [53780.631739] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 20:20:06 juju-e4d256-prod-github-runner-207 kernel: [53780.632640] Aug 22 20:20:34 juju-e4d256-prod-github-runner-207 kernel: [53808.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 50005s! [qemu-system-x86:6715] Aug 22 20:20:34 juju-e4d256-prod-github-runner-207 kernel: [53808.543277] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 20:20:34 juju-e4d256-prod-github-runner-207 kernel: [53808.543348] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 20:20:34 juju-e4d256-prod-github-runner-207 kernel: [53808.557258] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 20:20:34 juju-e4d256-prod-github-runner-207 kernel: [53808.558736] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 20:20:34 juju-e4d256-prod-github-runner-207 kernel: [53808.560124] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:20:34 juju-e4d256-prod-github-runner-207 kernel: [53808.561291] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 20:20:34 juju-e4d256-prod-github-runner-207 kernel: [53808.564214] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 20:20:34 juju-e4d256-prod-github-runner-207 kernel: [53808.565410] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 20:20:34 juju-e4d256-prod-github-runner-207 kernel: [53808.566715] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 20:20:34 juju-e4d256-prod-github-runner-207 kernel: [53808.568007] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 20:20:34 juju-e4d256-prod-github-runner-207 kernel: [53808.569296] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 20:20:34 juju-e4d256-prod-github-runner-207 kernel: [53808.570612] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 20:20:34 juju-e4d256-prod-github-runner-207 kernel: [53808.571909] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 20:20:34 juju-e4d256-prod-github-runner-207 kernel: [53808.573302] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 20:20:34 juju-e4d256-prod-github-runner-207 kernel: [53808.574522] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 20:20:34 juju-e4d256-prod-github-runner-207 kernel: [53808.575851] Call Trace: Aug 22 20:20:34 juju-e4d256-prod-github-runner-207 kernel: [53808.576816] Aug 22 20:20:34 juju-e4d256-prod-github-runner-207 kernel: [53808.577747] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:20:34 juju-e4d256-prod-github-runner-207 kernel: [53808.578898] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:20:34 juju-e4d256-prod-github-runner-207 kernel: [53808.580010] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:20:34 juju-e4d256-prod-github-runner-207 kernel: [53808.581180] ? show_regs.part.0+0x23/0x29 Aug 22 20:20:34 juju-e4d256-prod-github-runner-207 kernel: [53808.582274] ? show_regs.cold+0x8/0xd Aug 22 20:20:34 juju-e4d256-prod-github-runner-207 kernel: [53808.583326] ? watchdog_timer_fn+0x1be/0x220 Aug 22 20:20:34 juju-e4d256-prod-github-runner-207 kernel: [53808.584418] ? lockup_detector_update_enable+0x60/0x60 Aug 22 20:20:34 juju-e4d256-prod-github-runner-207 kernel: [53808.585587] ? __hrtimer_run_queues+0x107/0x230 Aug 22 20:20:34 juju-e4d256-prod-github-runner-207 kernel: [53808.586725] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 20:20:34 juju-e4d256-prod-github-runner-207 kernel: [53808.587834] ? hrtimer_interrupt+0x101/0x220 Aug 22 20:20:34 juju-e4d256-prod-github-runner-207 kernel: [53808.588939] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 20:20:34 juju-e4d256-prod-github-runner-207 kernel: [53808.590139] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 20:20:34 juju-e4d256-prod-github-runner-207 kernel: [53808.591287] Aug 22 20:20:34 juju-e4d256-prod-github-runner-207 kernel: [53808.592192] Aug 22 20:20:34 juju-e4d256-prod-github-runner-207 kernel: [53808.593075] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 20:20:34 juju-e4d256-prod-github-runner-207 kernel: [53808.594229] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:20:34 juju-e4d256-prod-github-runner-207 kernel: [53808.595380] ? _raw_spin_lock+0x22/0x30 Aug 22 20:20:34 juju-e4d256-prod-github-runner-207 kernel: [53808.596407] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:20:34 juju-e4d256-prod-github-runner-207 kernel: [53808.597524] direct_page_fault+0x206/0x310 [kvm] Aug 22 20:20:34 juju-e4d256-prod-github-runner-207 kernel: [53808.598650] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 20:20:34 juju-e4d256-prod-github-runner-207 kernel: [53808.599751] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 20:20:34 juju-e4d256-prod-github-runner-207 kernel: [53808.600845] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 20:20:34 juju-e4d256-prod-github-runner-207 kernel: [53808.601911] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 20:20:34 juju-e4d256-prod-github-runner-207 kernel: [53808.602966] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 20:20:34 juju-e4d256-prod-github-runner-207 kernel: [53808.604049] handle_exit+0x98/0x230 [kvm_amd] Aug 22 20:20:34 juju-e4d256-prod-github-runner-207 kernel: [53808.605031] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 20:20:34 juju-e4d256-prod-github-runner-207 kernel: [53808.606051] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 20:20:34 juju-e4d256-prod-github-runner-207 kernel: [53808.607071] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 20:20:34 juju-e4d256-prod-github-runner-207 kernel: [53808.608066] vcpu_run+0x62/0x2c0 [kvm] Aug 22 20:20:34 juju-e4d256-prod-github-runner-207 kernel: [53808.608946] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 20:20:34 juju-e4d256-prod-github-runner-207 kernel: [53808.609835] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 20:20:34 juju-e4d256-prod-github-runner-207 kernel: [53808.610796] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 20:20:34 juju-e4d256-prod-github-runner-207 kernel: [53808.611684] ? __seccomp_filter+0x4a/0x4a0 Aug 22 20:20:34 juju-e4d256-prod-github-runner-207 kernel: [53808.612504] ? __fget_files+0x86/0xc0 Aug 22 20:20:34 juju-e4d256-prod-github-runner-207 kernel: [53808.613279] __x64_sys_ioctl+0x95/0xd0 Aug 22 20:20:34 juju-e4d256-prod-github-runner-207 kernel: [53808.614065] do_syscall_64+0x5c/0xc0 Aug 22 20:20:34 juju-e4d256-prod-github-runner-207 kernel: [53808.614808] ? do_futex+0x162/0x1f0 Aug 22 20:20:34 juju-e4d256-prod-github-runner-207 kernel: [53808.615534] ? __x64_sys_futex+0x78/0x1e0 Aug 22 20:20:34 juju-e4d256-prod-github-runner-207 kernel: [53808.616284] ? __secure_computing+0xa9/0x120 Aug 22 20:20:34 juju-e4d256-prod-github-runner-207 kernel: [53808.617060] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 20:20:34 juju-e4d256-prod-github-runner-207 kernel: [53808.617922] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:20:34 juju-e4d256-prod-github-runner-207 kernel: [53808.618757] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:20:34 juju-e4d256-prod-github-runner-207 kernel: [53808.619562] ? do_syscall_64+0x69/0xc0 Aug 22 20:20:34 juju-e4d256-prod-github-runner-207 kernel: [53808.620277] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:20:34 juju-e4d256-prod-github-runner-207 kernel: [53808.621077] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:20:34 juju-e4d256-prod-github-runner-207 kernel: [53808.621859] ? do_syscall_64+0x69/0xc0 Aug 22 20:20:34 juju-e4d256-prod-github-runner-207 kernel: [53808.622661] ? do_syscall_64+0x69/0xc0 Aug 22 20:20:34 juju-e4d256-prod-github-runner-207 kernel: [53808.623363] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 20:20:34 juju-e4d256-prod-github-runner-207 kernel: [53808.624179] RIP: 0033:0x7faa5d0edaff Aug 22 20:20:34 juju-e4d256-prod-github-runner-207 kernel: [53808.624879] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 20:20:34 juju-e4d256-prod-github-runner-207 kernel: [53808.627210] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 20:20:34 juju-e4d256-prod-github-runner-207 kernel: [53808.628261] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 20:20:34 juju-e4d256-prod-github-runner-207 kernel: [53808.629281] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 20:20:34 juju-e4d256-prod-github-runner-207 kernel: [53808.630315] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 20:20:34 juju-e4d256-prod-github-runner-207 kernel: [53808.631336] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 20:20:34 juju-e4d256-prod-github-runner-207 kernel: [53808.632352] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 20:20:34 juju-e4d256-prod-github-runner-207 kernel: [53808.633372] Aug 22 20:20:46 juju-e4d256-prod-github-runner-207 kernel: [53820.776707] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 20:20:46 juju-e4d256-prod-github-runner-207 kernel: [53820.777673] rcu: 1-....: (13383617 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=6469582 Aug 22 20:20:46 juju-e4d256-prod-github-runner-207 kernel: [53820.778982] (t=13425894 jiffies g=23269 q=50073) Aug 22 20:20:46 juju-e4d256-prod-github-runner-207 kernel: [53820.779770] NMI backtrace for cpu 1 Aug 22 20:20:46 juju-e4d256-prod-github-runner-207 kernel: [53820.780477] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 20:20:46 juju-e4d256-prod-github-runner-207 kernel: [53820.781613] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 20:20:46 juju-e4d256-prod-github-runner-207 kernel: [53820.782703] Call Trace: Aug 22 20:20:46 juju-e4d256-prod-github-runner-207 kernel: [53820.783405] Aug 22 20:20:46 juju-e4d256-prod-github-runner-207 kernel: [53820.784066] show_stack+0x52/0x5c Aug 22 20:20:46 juju-e4d256-prod-github-runner-207 kernel: [53820.784791] dump_stack_lvl+0x4a/0x63 Aug 22 20:20:46 juju-e4d256-prod-github-runner-207 kernel: [53820.785542] dump_stack+0x10/0x16 Aug 22 20:20:46 juju-e4d256-prod-github-runner-207 kernel: [53820.786285] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 20:20:46 juju-e4d256-prod-github-runner-207 kernel: [53820.787228] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 20:20:46 juju-e4d256-prod-github-runner-207 kernel: [53820.788003] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 20:20:46 juju-e4d256-prod-github-runner-207 kernel: [53820.788819] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 20:20:46 juju-e4d256-prod-github-runner-207 kernel: [53820.789636] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 20:20:46 juju-e4d256-prod-github-runner-207 kernel: [53820.790454] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 20:20:46 juju-e4d256-prod-github-runner-207 kernel: [53820.791230] print_cpu_stall.cold+0x2f/0xe2 Aug 22 20:20:46 juju-e4d256-prod-github-runner-207 kernel: [53820.791998] ? timekeeping_update+0xf7/0x150 Aug 22 20:20:46 juju-e4d256-prod-github-runner-207 kernel: [53820.792772] check_cpu_stall+0x109/0x270 Aug 22 20:20:46 juju-e4d256-prod-github-runner-207 kernel: [53820.793550] rcu_sched_clock_irq+0x9a/0x250 Aug 22 20:20:46 juju-e4d256-prod-github-runner-207 kernel: [53820.794349] update_process_times+0x94/0xd0 Aug 22 20:20:46 juju-e4d256-prod-github-runner-207 kernel: [53820.795114] tick_sched_handle+0x29/0x70 Aug 22 20:20:46 juju-e4d256-prod-github-runner-207 kernel: [53820.795861] tick_sched_timer+0x8c/0xc0 Aug 22 20:20:46 juju-e4d256-prod-github-runner-207 kernel: [53820.796603] ? tick_nohz_handler+0xb0/0xb0 Aug 22 20:20:46 juju-e4d256-prod-github-runner-207 kernel: [53820.797360] __hrtimer_run_queues+0x107/0x230 Aug 22 20:20:46 juju-e4d256-prod-github-runner-207 kernel: [53820.798144] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 20:20:46 juju-e4d256-prod-github-runner-207 kernel: [53820.798922] hrtimer_interrupt+0x101/0x220 Aug 22 20:20:46 juju-e4d256-prod-github-runner-207 kernel: [53820.799684] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 20:20:46 juju-e4d256-prod-github-runner-207 kernel: [53820.800499] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 20:20:46 juju-e4d256-prod-github-runner-207 kernel: [53820.801304] Aug 22 20:20:46 juju-e4d256-prod-github-runner-207 kernel: [53820.801952] Aug 22 20:20:46 juju-e4d256-prod-github-runner-207 kernel: [53820.802669] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 20:20:46 juju-e4d256-prod-github-runner-207 kernel: [53820.803519] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:20:46 juju-e4d256-prod-github-runner-207 kernel: [53820.804438] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 20:20:46 juju-e4d256-prod-github-runner-207 kernel: [53820.806686] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 20:20:46 juju-e4d256-prod-github-runner-207 kernel: [53820.807627] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 20:20:46 juju-e4d256-prod-github-runner-207 kernel: [53820.808636] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 20:20:46 juju-e4d256-prod-github-runner-207 kernel: [53820.809620] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 20:20:46 juju-e4d256-prod-github-runner-207 kernel: [53820.810613] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 20:20:46 juju-e4d256-prod-github-runner-207 kernel: [53820.811650] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 20:20:46 juju-e4d256-prod-github-runner-207 kernel: [53820.812622] ? _raw_spin_lock+0x22/0x30 Aug 22 20:20:46 juju-e4d256-prod-github-runner-207 kernel: [53820.813410] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:20:46 juju-e4d256-prod-github-runner-207 kernel: [53820.814315] direct_page_fault+0x206/0x310 [kvm] Aug 22 20:20:46 juju-e4d256-prod-github-runner-207 kernel: [53820.815193] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 20:20:46 juju-e4d256-prod-github-runner-207 kernel: [53820.816030] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 20:20:46 juju-e4d256-prod-github-runner-207 kernel: [53820.816859] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 20:20:46 juju-e4d256-prod-github-runner-207 kernel: [53820.817666] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 20:20:46 juju-e4d256-prod-github-runner-207 kernel: [53820.818481] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 20:20:46 juju-e4d256-prod-github-runner-207 kernel: [53820.819352] handle_exit+0x98/0x230 [kvm_amd] Aug 22 20:20:46 juju-e4d256-prod-github-runner-207 kernel: [53820.820127] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 20:20:46 juju-e4d256-prod-github-runner-207 kernel: [53820.820918] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 20:20:46 juju-e4d256-prod-github-runner-207 kernel: [53820.821728] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 20:20:46 juju-e4d256-prod-github-runner-207 kernel: [53820.822536] vcpu_run+0x62/0x2c0 [kvm] Aug 22 20:20:46 juju-e4d256-prod-github-runner-207 kernel: [53820.823256] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 20:20:46 juju-e4d256-prod-github-runner-207 kernel: [53820.824076] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 20:20:46 juju-e4d256-prod-github-runner-207 kernel: [53820.824921] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 20:20:46 juju-e4d256-prod-github-runner-207 kernel: [53820.825724] ? __seccomp_filter+0x4a/0x4a0 Aug 22 20:20:46 juju-e4d256-prod-github-runner-207 kernel: [53820.826460] ? __fget_files+0x86/0xc0 Aug 22 20:20:46 juju-e4d256-prod-github-runner-207 kernel: [53820.827154] __x64_sys_ioctl+0x95/0xd0 Aug 22 20:20:46 juju-e4d256-prod-github-runner-207 kernel: [53820.827854] do_syscall_64+0x5c/0xc0 Aug 22 20:20:46 juju-e4d256-prod-github-runner-207 kernel: [53820.828585] ? do_futex+0x162/0x1f0 Aug 22 20:20:46 juju-e4d256-prod-github-runner-207 kernel: [53820.829272] ? __x64_sys_futex+0x78/0x1e0 Aug 22 20:20:46 juju-e4d256-prod-github-runner-207 kernel: [53820.829996] ? __secure_computing+0xa9/0x120 Aug 22 20:20:46 juju-e4d256-prod-github-runner-207 kernel: [53820.830719] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 20:20:46 juju-e4d256-prod-github-runner-207 kernel: [53820.831516] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:20:46 juju-e4d256-prod-github-runner-207 kernel: [53820.832275] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:20:46 juju-e4d256-prod-github-runner-207 kernel: [53820.833041] ? do_syscall_64+0x69/0xc0 Aug 22 20:20:46 juju-e4d256-prod-github-runner-207 kernel: [53820.833785] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:20:46 juju-e4d256-prod-github-runner-207 kernel: [53820.834583] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:20:46 juju-e4d256-prod-github-runner-207 kernel: [53820.835371] ? do_syscall_64+0x69/0xc0 Aug 22 20:20:46 juju-e4d256-prod-github-runner-207 kernel: [53820.836081] ? do_syscall_64+0x69/0xc0 Aug 22 20:20:46 juju-e4d256-prod-github-runner-207 kernel: [53820.836772] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 20:20:46 juju-e4d256-prod-github-runner-207 kernel: [53820.837572] RIP: 0033:0x7faa5d0edaff Aug 22 20:20:46 juju-e4d256-prod-github-runner-207 kernel: [53820.838291] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 20:20:46 juju-e4d256-prod-github-runner-207 kernel: [53820.840417] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 20:20:46 juju-e4d256-prod-github-runner-207 kernel: [53820.841388] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 20:20:46 juju-e4d256-prod-github-runner-207 kernel: [53820.842405] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 20:20:46 juju-e4d256-prod-github-runner-207 kernel: [53820.843362] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 20:20:46 juju-e4d256-prod-github-runner-207 kernel: [53820.844350] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 20:20:46 juju-e4d256-prod-github-runner-207 kernel: [53820.845285] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 20:20:46 juju-e4d256-prod-github-runner-207 kernel: [53820.846235] Aug 22 20:21:14 juju-e4d256-prod-github-runner-207 kernel: [53848.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 50042s! [qemu-system-x86:6715] Aug 22 20:21:14 juju-e4d256-prod-github-runner-207 kernel: [53848.543115] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 20:21:14 juju-e4d256-prod-github-runner-207 kernel: [53848.543180] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 20:21:14 juju-e4d256-prod-github-runner-207 kernel: [53848.555311] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 20:21:14 juju-e4d256-prod-github-runner-207 kernel: [53848.556572] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 20:21:14 juju-e4d256-prod-github-runner-207 kernel: [53848.557802] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:21:14 juju-e4d256-prod-github-runner-207 kernel: [53848.558857] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 20:21:14 juju-e4d256-prod-github-runner-207 kernel: [53848.561407] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 20:21:14 juju-e4d256-prod-github-runner-207 kernel: [53848.562462] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 20:21:14 juju-e4d256-prod-github-runner-207 kernel: [53848.563620] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 20:21:14 juju-e4d256-prod-github-runner-207 kernel: [53848.564776] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 20:21:14 juju-e4d256-prod-github-runner-207 kernel: [53848.565957] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 20:21:14 juju-e4d256-prod-github-runner-207 kernel: [53848.567118] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 20:21:14 juju-e4d256-prod-github-runner-207 kernel: [53848.568284] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 20:21:14 juju-e4d256-prod-github-runner-207 kernel: [53848.569527] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 20:21:14 juju-e4d256-prod-github-runner-207 kernel: [53848.570637] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 20:21:14 juju-e4d256-prod-github-runner-207 kernel: [53848.571828] Call Trace: Aug 22 20:21:14 juju-e4d256-prod-github-runner-207 kernel: [53848.572738] Aug 22 20:21:14 juju-e4d256-prod-github-runner-207 kernel: [53848.573816] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:21:14 juju-e4d256-prod-github-runner-207 kernel: [53848.575027] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:21:14 juju-e4d256-prod-github-runner-207 kernel: [53848.576055] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:21:14 juju-e4d256-prod-github-runner-207 kernel: [53848.577127] ? show_regs.part.0+0x23/0x29 Aug 22 20:21:14 juju-e4d256-prod-github-runner-207 kernel: [53848.578143] ? show_regs.cold+0x8/0xd Aug 22 20:21:14 juju-e4d256-prod-github-runner-207 kernel: [53848.579120] ? watchdog_timer_fn+0x1be/0x220 Aug 22 20:21:14 juju-e4d256-prod-github-runner-207 kernel: [53848.580125] ? lockup_detector_update_enable+0x60/0x60 Aug 22 20:21:14 juju-e4d256-prod-github-runner-207 kernel: [53848.581190] ? __hrtimer_run_queues+0x107/0x230 Aug 22 20:21:14 juju-e4d256-prod-github-runner-207 kernel: [53848.582233] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 20:21:14 juju-e4d256-prod-github-runner-207 kernel: [53848.583256] ? hrtimer_interrupt+0x101/0x220 Aug 22 20:21:14 juju-e4d256-prod-github-runner-207 kernel: [53848.584269] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 20:21:14 juju-e4d256-prod-github-runner-207 kernel: [53848.585339] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 20:21:14 juju-e4d256-prod-github-runner-207 kernel: [53848.586397] Aug 22 20:21:14 juju-e4d256-prod-github-runner-207 kernel: [53848.587254] Aug 22 20:21:14 juju-e4d256-prod-github-runner-207 kernel: [53848.588096] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 20:21:14 juju-e4d256-prod-github-runner-207 kernel: [53848.589129] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:21:14 juju-e4d256-prod-github-runner-207 kernel: [53848.590178] ? _raw_spin_lock+0x22/0x30 Aug 22 20:21:14 juju-e4d256-prod-github-runner-207 kernel: [53848.591148] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:21:14 juju-e4d256-prod-github-runner-207 kernel: [53848.592179] direct_page_fault+0x206/0x310 [kvm] Aug 22 20:21:14 juju-e4d256-prod-github-runner-207 kernel: [53848.593210] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 20:21:14 juju-e4d256-prod-github-runner-207 kernel: [53848.594238] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 20:21:14 juju-e4d256-prod-github-runner-207 kernel: [53848.595244] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 20:21:14 juju-e4d256-prod-github-runner-207 kernel: [53848.596211] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 20:21:14 juju-e4d256-prod-github-runner-207 kernel: [53848.597158] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 20:21:14 juju-e4d256-prod-github-runner-207 kernel: [53848.598150] handle_exit+0x98/0x230 [kvm_amd] Aug 22 20:21:14 juju-e4d256-prod-github-runner-207 kernel: [53848.599046] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 20:21:14 juju-e4d256-prod-github-runner-207 kernel: [53848.599957] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 20:21:14 juju-e4d256-prod-github-runner-207 kernel: [53848.600955] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 20:21:14 juju-e4d256-prod-github-runner-207 kernel: [53848.601887] vcpu_run+0x62/0x2c0 [kvm] Aug 22 20:21:14 juju-e4d256-prod-github-runner-207 kernel: [53848.602701] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 20:21:14 juju-e4d256-prod-github-runner-207 kernel: [53848.603508] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 20:21:14 juju-e4d256-prod-github-runner-207 kernel: [53848.604361] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 20:21:14 juju-e4d256-prod-github-runner-207 kernel: [53848.605157] ? __seccomp_filter+0x4a/0x4a0 Aug 22 20:21:14 juju-e4d256-prod-github-runner-207 kernel: [53848.605918] ? __fget_files+0x86/0xc0 Aug 22 20:21:14 juju-e4d256-prod-github-runner-207 kernel: [53848.606630] __x64_sys_ioctl+0x95/0xd0 Aug 22 20:21:14 juju-e4d256-prod-github-runner-207 kernel: [53848.607322] do_syscall_64+0x5c/0xc0 Aug 22 20:21:14 juju-e4d256-prod-github-runner-207 kernel: [53848.607991] ? do_futex+0x162/0x1f0 Aug 22 20:21:14 juju-e4d256-prod-github-runner-207 kernel: [53848.608639] ? __x64_sys_futex+0x78/0x1e0 Aug 22 20:21:14 juju-e4d256-prod-github-runner-207 kernel: [53848.609314] ? __secure_computing+0xa9/0x120 Aug 22 20:21:14 juju-e4d256-prod-github-runner-207 kernel: [53848.610021] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 20:21:14 juju-e4d256-prod-github-runner-207 kernel: [53848.610781] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:21:14 juju-e4d256-prod-github-runner-207 kernel: [53848.611502] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:21:14 juju-e4d256-prod-github-runner-207 kernel: [53848.612220] ? do_syscall_64+0x69/0xc0 Aug 22 20:21:14 juju-e4d256-prod-github-runner-207 kernel: [53848.612864] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:21:14 juju-e4d256-prod-github-runner-207 kernel: [53848.613581] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:21:14 juju-e4d256-prod-github-runner-207 kernel: [53848.614288] ? do_syscall_64+0x69/0xc0 Aug 22 20:21:14 juju-e4d256-prod-github-runner-207 kernel: [53848.614913] ? do_syscall_64+0x69/0xc0 Aug 22 20:21:14 juju-e4d256-prod-github-runner-207 kernel: [53848.615536] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 20:21:14 juju-e4d256-prod-github-runner-207 kernel: [53848.616243] RIP: 0033:0x7faa5d0edaff Aug 22 20:21:14 juju-e4d256-prod-github-runner-207 kernel: [53848.616873] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 20:21:14 juju-e4d256-prod-github-runner-207 kernel: [53848.618871] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 20:21:14 juju-e4d256-prod-github-runner-207 kernel: [53848.619782] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 20:21:14 juju-e4d256-prod-github-runner-207 kernel: [53848.620676] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 20:21:14 juju-e4d256-prod-github-runner-207 kernel: [53848.621584] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 20:21:14 juju-e4d256-prod-github-runner-207 kernel: [53848.622476] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 20:21:14 juju-e4d256-prod-github-runner-207 kernel: [53848.623370] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 20:21:14 juju-e4d256-prod-github-runner-207 kernel: [53848.624269] Aug 22 20:21:42 juju-e4d256-prod-github-runner-207 kernel: [53876.541981] watchdog: BUG: soft lockup - CPU#1 stuck for 50068s! [qemu-system-x86:6715] Aug 22 20:21:42 juju-e4d256-prod-github-runner-207 kernel: [53876.543660] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 20:21:42 juju-e4d256-prod-github-runner-207 kernel: [53876.543908] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 20:21:42 juju-e4d256-prod-github-runner-207 kernel: [53876.556155] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 20:21:42 juju-e4d256-prod-github-runner-207 kernel: [53876.557458] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 20:21:42 juju-e4d256-prod-github-runner-207 kernel: [53876.558687] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:21:42 juju-e4d256-prod-github-runner-207 kernel: [53876.559744] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 20:21:42 juju-e4d256-prod-github-runner-207 kernel: [53876.562331] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 20:21:42 juju-e4d256-prod-github-runner-207 kernel: [53876.563395] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 20:21:42 juju-e4d256-prod-github-runner-207 kernel: [53876.564564] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 20:21:42 juju-e4d256-prod-github-runner-207 kernel: [53876.565769] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 20:21:42 juju-e4d256-prod-github-runner-207 kernel: [53876.566948] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 20:21:42 juju-e4d256-prod-github-runner-207 kernel: [53876.568141] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 20:21:42 juju-e4d256-prod-github-runner-207 kernel: [53876.569365] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 20:21:42 juju-e4d256-prod-github-runner-207 kernel: [53876.570616] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 20:21:42 juju-e4d256-prod-github-runner-207 kernel: [53876.571721] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 20:21:42 juju-e4d256-prod-github-runner-207 kernel: [53876.572977] Call Trace: Aug 22 20:21:42 juju-e4d256-prod-github-runner-207 kernel: [53876.573923] Aug 22 20:21:42 juju-e4d256-prod-github-runner-207 kernel: [53876.574826] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:21:42 juju-e4d256-prod-github-runner-207 kernel: [53876.575859] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:21:42 juju-e4d256-prod-github-runner-207 kernel: [53876.576896] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:21:42 juju-e4d256-prod-github-runner-207 kernel: [53876.578026] ? show_regs.part.0+0x23/0x29 Aug 22 20:21:42 juju-e4d256-prod-github-runner-207 kernel: [53876.579029] ? show_regs.cold+0x8/0xd Aug 22 20:21:42 juju-e4d256-prod-github-runner-207 kernel: [53876.580004] ? watchdog_timer_fn+0x1be/0x220 Aug 22 20:21:42 juju-e4d256-prod-github-runner-207 kernel: [53876.581053] ? lockup_detector_update_enable+0x60/0x60 Aug 22 20:21:42 juju-e4d256-prod-github-runner-207 kernel: [53876.582162] ? __hrtimer_run_queues+0x107/0x230 Aug 22 20:21:42 juju-e4d256-prod-github-runner-207 kernel: [53876.583223] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 20:21:42 juju-e4d256-prod-github-runner-207 kernel: [53876.584250] ? hrtimer_interrupt+0x101/0x220 Aug 22 20:21:42 juju-e4d256-prod-github-runner-207 kernel: [53876.585286] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 20:21:42 juju-e4d256-prod-github-runner-207 kernel: [53876.586355] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 20:21:42 juju-e4d256-prod-github-runner-207 kernel: [53876.587424] Aug 22 20:21:42 juju-e4d256-prod-github-runner-207 kernel: [53876.588311] Aug 22 20:21:42 juju-e4d256-prod-github-runner-207 kernel: [53876.589165] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 20:21:42 juju-e4d256-prod-github-runner-207 kernel: [53876.590255] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:21:42 juju-e4d256-prod-github-runner-207 kernel: [53876.591308] ? _raw_spin_lock+0x22/0x30 Aug 22 20:21:42 juju-e4d256-prod-github-runner-207 kernel: [53876.592275] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:21:42 juju-e4d256-prod-github-runner-207 kernel: [53876.593366] direct_page_fault+0x206/0x310 [kvm] Aug 22 20:21:42 juju-e4d256-prod-github-runner-207 kernel: [53876.594413] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 20:21:42 juju-e4d256-prod-github-runner-207 kernel: [53876.595441] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 20:21:42 juju-e4d256-prod-github-runner-207 kernel: [53876.596459] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 20:21:42 juju-e4d256-prod-github-runner-207 kernel: [53876.597499] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 20:21:42 juju-e4d256-prod-github-runner-207 kernel: [53876.598457] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 20:21:42 juju-e4d256-prod-github-runner-207 kernel: [53876.599499] handle_exit+0x98/0x230 [kvm_amd] Aug 22 20:21:42 juju-e4d256-prod-github-runner-207 kernel: [53876.600395] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 20:21:42 juju-e4d256-prod-github-runner-207 kernel: [53876.601538] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 20:21:42 juju-e4d256-prod-github-runner-207 kernel: [53876.602593] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 20:21:42 juju-e4d256-prod-github-runner-207 kernel: [53876.603534] vcpu_run+0x62/0x2c0 [kvm] Aug 22 20:21:42 juju-e4d256-prod-github-runner-207 kernel: [53876.604373] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 20:21:42 juju-e4d256-prod-github-runner-207 kernel: [53876.605204] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 20:21:42 juju-e4d256-prod-github-runner-207 kernel: [53876.606082] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 20:21:42 juju-e4d256-prod-github-runner-207 kernel: [53876.606881] ? __seccomp_filter+0x4a/0x4a0 Aug 22 20:21:42 juju-e4d256-prod-github-runner-207 kernel: [53876.607630] ? __fget_files+0x86/0xc0 Aug 22 20:21:42 juju-e4d256-prod-github-runner-207 kernel: [53876.608365] __x64_sys_ioctl+0x95/0xd0 Aug 22 20:21:42 juju-e4d256-prod-github-runner-207 kernel: [53876.609084] do_syscall_64+0x5c/0xc0 Aug 22 20:21:42 juju-e4d256-prod-github-runner-207 kernel: [53876.609774] ? do_futex+0x162/0x1f0 Aug 22 20:21:42 juju-e4d256-prod-github-runner-207 kernel: [53876.610529] ? __x64_sys_futex+0x78/0x1e0 Aug 22 20:21:42 juju-e4d256-prod-github-runner-207 kernel: [53876.611301] ? __secure_computing+0xa9/0x120 Aug 22 20:21:42 juju-e4d256-prod-github-runner-207 kernel: [53876.612095] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 20:21:42 juju-e4d256-prod-github-runner-207 kernel: [53876.612984] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:21:42 juju-e4d256-prod-github-runner-207 kernel: [53876.613829] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:21:42 juju-e4d256-prod-github-runner-207 kernel: [53876.614658] ? do_syscall_64+0x69/0xc0 Aug 22 20:21:42 juju-e4d256-prod-github-runner-207 kernel: [53876.615383] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:21:42 juju-e4d256-prod-github-runner-207 kernel: [53876.616180] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:21:42 juju-e4d256-prod-github-runner-207 kernel: [53876.616977] ? do_syscall_64+0x69/0xc0 Aug 22 20:21:42 juju-e4d256-prod-github-runner-207 kernel: [53876.617711] ? do_syscall_64+0x69/0xc0 Aug 22 20:21:42 juju-e4d256-prod-github-runner-207 kernel: [53876.618411] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 20:21:42 juju-e4d256-prod-github-runner-207 kernel: [53876.619208] RIP: 0033:0x7faa5d0edaff Aug 22 20:21:42 juju-e4d256-prod-github-runner-207 kernel: [53876.619944] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 20:21:42 juju-e4d256-prod-github-runner-207 kernel: [53876.622291] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 20:21:42 juju-e4d256-prod-github-runner-207 kernel: [53876.623344] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 20:21:42 juju-e4d256-prod-github-runner-207 kernel: [53876.624369] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 20:21:42 juju-e4d256-prod-github-runner-207 kernel: [53876.625407] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 20:21:42 juju-e4d256-prod-github-runner-207 kernel: [53876.626430] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 20:21:42 juju-e4d256-prod-github-runner-207 kernel: [53876.627457] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 20:21:42 juju-e4d256-prod-github-runner-207 kernel: [53876.628486] Aug 22 20:22:10 juju-e4d256-prod-github-runner-207 kernel: [53904.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 50094s! [qemu-system-x86:6715] Aug 22 20:22:10 juju-e4d256-prod-github-runner-207 kernel: [53904.543101] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 20:22:10 juju-e4d256-prod-github-runner-207 kernel: [53904.543171] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 20:22:10 juju-e4d256-prod-github-runner-207 kernel: [53904.555287] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 20:22:10 juju-e4d256-prod-github-runner-207 kernel: [53904.556550] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 20:22:10 juju-e4d256-prod-github-runner-207 kernel: [53904.557792] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:22:10 juju-e4d256-prod-github-runner-207 kernel: [53904.558849] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 20:22:10 juju-e4d256-prod-github-runner-207 kernel: [53904.561422] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 20:22:10 juju-e4d256-prod-github-runner-207 kernel: [53904.562472] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 20:22:10 juju-e4d256-prod-github-runner-207 kernel: [53904.563635] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 20:22:10 juju-e4d256-prod-github-runner-207 kernel: [53904.564800] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 20:22:10 juju-e4d256-prod-github-runner-207 kernel: [53904.565982] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 20:22:10 juju-e4d256-prod-github-runner-207 kernel: [53904.567146] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 20:22:10 juju-e4d256-prod-github-runner-207 kernel: [53904.568313] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 20:22:10 juju-e4d256-prod-github-runner-207 kernel: [53904.569563] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 20:22:10 juju-e4d256-prod-github-runner-207 kernel: [53904.570664] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 20:22:10 juju-e4d256-prod-github-runner-207 kernel: [53904.571857] Call Trace: Aug 22 20:22:10 juju-e4d256-prod-github-runner-207 kernel: [53904.572770] Aug 22 20:22:10 juju-e4d256-prod-github-runner-207 kernel: [53904.573668] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:22:10 juju-e4d256-prod-github-runner-207 kernel: [53904.574699] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:22:10 juju-e4d256-prod-github-runner-207 kernel: [53904.575723] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:22:10 juju-e4d256-prod-github-runner-207 kernel: [53904.576800] ? show_regs.part.0+0x23/0x29 Aug 22 20:22:10 juju-e4d256-prod-github-runner-207 kernel: [53904.577815] ? show_regs.cold+0x8/0xd Aug 22 20:22:10 juju-e4d256-prod-github-runner-207 kernel: [53904.578784] ? watchdog_timer_fn+0x1be/0x220 Aug 22 20:22:10 juju-e4d256-prod-github-runner-207 kernel: [53904.579810] ? lockup_detector_update_enable+0x60/0x60 Aug 22 20:22:10 juju-e4d256-prod-github-runner-207 kernel: [53904.580889] ? __hrtimer_run_queues+0x107/0x230 Aug 22 20:22:10 juju-e4d256-prod-github-runner-207 kernel: [53904.581916] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 20:22:10 juju-e4d256-prod-github-runner-207 kernel: [53904.582942] ? hrtimer_interrupt+0x101/0x220 Aug 22 20:22:10 juju-e4d256-prod-github-runner-207 kernel: [53904.583954] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 20:22:10 juju-e4d256-prod-github-runner-207 kernel: [53904.585038] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 20:22:10 juju-e4d256-prod-github-runner-207 kernel: [53904.586087] Aug 22 20:22:10 juju-e4d256-prod-github-runner-207 kernel: [53904.586940] Aug 22 20:22:10 juju-e4d256-prod-github-runner-207 kernel: [53904.587773] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 20:22:10 juju-e4d256-prod-github-runner-207 kernel: [53904.588807] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:22:10 juju-e4d256-prod-github-runner-207 kernel: [53904.589856] ? _raw_spin_lock+0x22/0x30 Aug 22 20:22:10 juju-e4d256-prod-github-runner-207 kernel: [53904.590800] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:22:10 juju-e4d256-prod-github-runner-207 kernel: [53904.591823] direct_page_fault+0x206/0x310 [kvm] Aug 22 20:22:10 juju-e4d256-prod-github-runner-207 kernel: [53904.592867] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 20:22:10 juju-e4d256-prod-github-runner-207 kernel: [53904.593876] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 20:22:10 juju-e4d256-prod-github-runner-207 kernel: [53904.594877] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 20:22:10 juju-e4d256-prod-github-runner-207 kernel: [53904.595852] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 20:22:10 juju-e4d256-prod-github-runner-207 kernel: [53904.596794] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 20:22:10 juju-e4d256-prod-github-runner-207 kernel: [53904.597804] handle_exit+0x98/0x230 [kvm_amd] Aug 22 20:22:10 juju-e4d256-prod-github-runner-207 kernel: [53904.598694] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 20:22:10 juju-e4d256-prod-github-runner-207 kernel: [53904.599609] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 20:22:10 juju-e4d256-prod-github-runner-207 kernel: [53904.600537] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 20:22:10 juju-e4d256-prod-github-runner-207 kernel: [53904.601457] vcpu_run+0x62/0x2c0 [kvm] Aug 22 20:22:10 juju-e4d256-prod-github-runner-207 kernel: [53904.602268] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 20:22:10 juju-e4d256-prod-github-runner-207 kernel: [53904.603075] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 20:22:10 juju-e4d256-prod-github-runner-207 kernel: [53904.603928] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 20:22:10 juju-e4d256-prod-github-runner-207 kernel: [53904.604731] ? __seccomp_filter+0x4a/0x4a0 Aug 22 20:22:10 juju-e4d256-prod-github-runner-207 kernel: [53904.605488] ? __fget_files+0x86/0xc0 Aug 22 20:22:10 juju-e4d256-prod-github-runner-207 kernel: [53904.606193] __x64_sys_ioctl+0x95/0xd0 Aug 22 20:22:10 juju-e4d256-prod-github-runner-207 kernel: [53904.606890] do_syscall_64+0x5c/0xc0 Aug 22 20:22:10 juju-e4d256-prod-github-runner-207 kernel: [53904.607555] ? do_futex+0x162/0x1f0 Aug 22 20:22:10 juju-e4d256-prod-github-runner-207 kernel: [53904.608203] ? __x64_sys_futex+0x78/0x1e0 Aug 22 20:22:10 juju-e4d256-prod-github-runner-207 kernel: [53904.608897] ? __secure_computing+0xa9/0x120 Aug 22 20:22:10 juju-e4d256-prod-github-runner-207 kernel: [53904.609588] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 20:22:10 juju-e4d256-prod-github-runner-207 kernel: [53904.610348] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:22:10 juju-e4d256-prod-github-runner-207 kernel: [53904.611081] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:22:10 juju-e4d256-prod-github-runner-207 kernel: [53904.611799] ? do_syscall_64+0x69/0xc0 Aug 22 20:22:10 juju-e4d256-prod-github-runner-207 kernel: [53904.612444] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:22:10 juju-e4d256-prod-github-runner-207 kernel: [53904.613157] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:22:10 juju-e4d256-prod-github-runner-207 kernel: [53904.613858] ? do_syscall_64+0x69/0xc0 Aug 22 20:22:10 juju-e4d256-prod-github-runner-207 kernel: [53904.614483] ? do_syscall_64+0x69/0xc0 Aug 22 20:22:10 juju-e4d256-prod-github-runner-207 kernel: [53904.615106] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 20:22:10 juju-e4d256-prod-github-runner-207 kernel: [53904.615817] RIP: 0033:0x7faa5d0edaff Aug 22 20:22:10 juju-e4d256-prod-github-runner-207 kernel: [53904.616448] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 20:22:10 juju-e4d256-prod-github-runner-207 kernel: [53904.618450] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 20:22:10 juju-e4d256-prod-github-runner-207 kernel: [53904.619365] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 20:22:10 juju-e4d256-prod-github-runner-207 kernel: [53904.620253] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 20:22:10 juju-e4d256-prod-github-runner-207 kernel: [53904.621163] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 20:22:10 juju-e4d256-prod-github-runner-207 kernel: [53904.622049] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 20:22:10 juju-e4d256-prod-github-runner-207 kernel: [53904.622942] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 20:22:10 juju-e4d256-prod-github-runner-207 kernel: [53904.623833] Aug 22 20:22:38 juju-e4d256-prod-github-runner-207 kernel: [53932.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 50120s! [qemu-system-x86:6715] Aug 22 20:22:38 juju-e4d256-prod-github-runner-207 kernel: [53932.543173] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 20:22:38 juju-e4d256-prod-github-runner-207 kernel: [53932.543365] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 20:22:38 juju-e4d256-prod-github-runner-207 kernel: [53932.555603] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 20:22:38 juju-e4d256-prod-github-runner-207 kernel: [53932.556897] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 20:22:38 juju-e4d256-prod-github-runner-207 kernel: [53932.558116] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:22:38 juju-e4d256-prod-github-runner-207 kernel: [53932.559176] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 20:22:38 juju-e4d256-prod-github-runner-207 kernel: [53932.561736] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 20:22:38 juju-e4d256-prod-github-runner-207 kernel: [53932.562788] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 20:22:38 juju-e4d256-prod-github-runner-207 kernel: [53932.563950] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 20:22:38 juju-e4d256-prod-github-runner-207 kernel: [53932.565131] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 20:22:38 juju-e4d256-prod-github-runner-207 kernel: [53932.566293] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 20:22:38 juju-e4d256-prod-github-runner-207 kernel: [53932.567460] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 20:22:38 juju-e4d256-prod-github-runner-207 kernel: [53932.568647] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 20:22:38 juju-e4d256-prod-github-runner-207 kernel: [53932.569882] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 20:22:38 juju-e4d256-prod-github-runner-207 kernel: [53932.570985] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 20:22:38 juju-e4d256-prod-github-runner-207 kernel: [53932.572178] Call Trace: Aug 22 20:22:38 juju-e4d256-prod-github-runner-207 kernel: [53932.573102] Aug 22 20:22:38 juju-e4d256-prod-github-runner-207 kernel: [53932.574000] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:22:38 juju-e4d256-prod-github-runner-207 kernel: [53932.575038] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:22:38 juju-e4d256-prod-github-runner-207 kernel: [53932.576065] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:22:38 juju-e4d256-prod-github-runner-207 kernel: [53932.577184] ? show_regs.part.0+0x23/0x29 Aug 22 20:22:38 juju-e4d256-prod-github-runner-207 kernel: [53932.578186] ? show_regs.cold+0x8/0xd Aug 22 20:22:38 juju-e4d256-prod-github-runner-207 kernel: [53932.579157] ? watchdog_timer_fn+0x1be/0x220 Aug 22 20:22:38 juju-e4d256-prod-github-runner-207 kernel: [53932.580165] ? lockup_detector_update_enable+0x60/0x60 Aug 22 20:22:38 juju-e4d256-prod-github-runner-207 kernel: [53932.581241] ? __hrtimer_run_queues+0x107/0x230 Aug 22 20:22:38 juju-e4d256-prod-github-runner-207 kernel: [53932.582292] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 20:22:38 juju-e4d256-prod-github-runner-207 kernel: [53932.583502] ? hrtimer_interrupt+0x101/0x220 Aug 22 20:22:38 juju-e4d256-prod-github-runner-207 kernel: [53932.584541] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 20:22:38 juju-e4d256-prod-github-runner-207 kernel: [53932.585611] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 20:22:38 juju-e4d256-prod-github-runner-207 kernel: [53932.586655] Aug 22 20:22:38 juju-e4d256-prod-github-runner-207 kernel: [53932.587507] Aug 22 20:22:38 juju-e4d256-prod-github-runner-207 kernel: [53932.588342] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 20:22:38 juju-e4d256-prod-github-runner-207 kernel: [53932.589410] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:22:38 juju-e4d256-prod-github-runner-207 kernel: [53932.590448] ? _raw_spin_lock+0x22/0x30 Aug 22 20:22:38 juju-e4d256-prod-github-runner-207 kernel: [53932.591397] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:22:38 juju-e4d256-prod-github-runner-207 kernel: [53932.592415] direct_page_fault+0x206/0x310 [kvm] Aug 22 20:22:38 juju-e4d256-prod-github-runner-207 kernel: [53932.593463] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 20:22:38 juju-e4d256-prod-github-runner-207 kernel: [53932.594469] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 20:22:38 juju-e4d256-prod-github-runner-207 kernel: [53932.595468] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 20:22:38 juju-e4d256-prod-github-runner-207 kernel: [53932.596461] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 20:22:38 juju-e4d256-prod-github-runner-207 kernel: [53932.597424] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 20:22:38 juju-e4d256-prod-github-runner-207 kernel: [53932.598399] handle_exit+0x98/0x230 [kvm_amd] Aug 22 20:22:38 juju-e4d256-prod-github-runner-207 kernel: [53932.599289] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 20:22:38 juju-e4d256-prod-github-runner-207 kernel: [53932.600205] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 20:22:38 juju-e4d256-prod-github-runner-207 kernel: [53932.601144] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 20:22:38 juju-e4d256-prod-github-runner-207 kernel: [53932.602051] vcpu_run+0x62/0x2c0 [kvm] Aug 22 20:22:38 juju-e4d256-prod-github-runner-207 kernel: [53932.602932] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 20:22:38 juju-e4d256-prod-github-runner-207 kernel: [53932.603743] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 20:22:38 juju-e4d256-prod-github-runner-207 kernel: [53932.604748] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 20:22:38 juju-e4d256-prod-github-runner-207 kernel: [53932.605547] ? __seccomp_filter+0x4a/0x4a0 Aug 22 20:22:38 juju-e4d256-prod-github-runner-207 kernel: [53932.606290] ? __fget_files+0x86/0xc0 Aug 22 20:22:38 juju-e4d256-prod-github-runner-207 kernel: [53932.606999] __x64_sys_ioctl+0x95/0xd0 Aug 22 20:22:38 juju-e4d256-prod-github-runner-207 kernel: [53932.607696] do_syscall_64+0x5c/0xc0 Aug 22 20:22:38 juju-e4d256-prod-github-runner-207 kernel: [53932.608361] ? do_futex+0x162/0x1f0 Aug 22 20:22:38 juju-e4d256-prod-github-runner-207 kernel: [53932.609126] ? __x64_sys_futex+0x78/0x1e0 Aug 22 20:22:38 juju-e4d256-prod-github-runner-207 kernel: [53932.609807] ? __secure_computing+0xa9/0x120 Aug 22 20:22:38 juju-e4d256-prod-github-runner-207 kernel: [53932.610497] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 20:22:38 juju-e4d256-prod-github-runner-207 kernel: [53932.611257] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:22:38 juju-e4d256-prod-github-runner-207 kernel: [53932.611983] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:22:38 juju-e4d256-prod-github-runner-207 kernel: [53932.612726] ? do_syscall_64+0x69/0xc0 Aug 22 20:22:38 juju-e4d256-prod-github-runner-207 kernel: [53932.613371] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:22:38 juju-e4d256-prod-github-runner-207 kernel: [53932.614074] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:22:38 juju-e4d256-prod-github-runner-207 kernel: [53932.614768] ? do_syscall_64+0x69/0xc0 Aug 22 20:22:38 juju-e4d256-prod-github-runner-207 kernel: [53932.615392] ? do_syscall_64+0x69/0xc0 Aug 22 20:22:38 juju-e4d256-prod-github-runner-207 kernel: [53932.616021] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 20:22:38 juju-e4d256-prod-github-runner-207 kernel: [53932.616739] RIP: 0033:0x7faa5d0edaff Aug 22 20:22:38 juju-e4d256-prod-github-runner-207 kernel: [53932.617401] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 20:22:38 juju-e4d256-prod-github-runner-207 kernel: [53932.619392] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 20:22:38 juju-e4d256-prod-github-runner-207 kernel: [53932.620391] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 20:22:38 juju-e4d256-prod-github-runner-207 kernel: [53932.621289] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 20:22:38 juju-e4d256-prod-github-runner-207 kernel: [53932.622182] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 20:22:38 juju-e4d256-prod-github-runner-207 kernel: [53932.623068] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 20:22:38 juju-e4d256-prod-github-runner-207 kernel: [53932.623954] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 20:22:38 juju-e4d256-prod-github-runner-207 kernel: [53932.624870] Aug 22 20:23:06 juju-e4d256-prod-github-runner-207 kernel: [53960.541980] watchdog: BUG: soft lockup - CPU#1 stuck for 50146s! [qemu-system-x86:6715] Aug 22 20:23:06 juju-e4d256-prod-github-runner-207 kernel: [53960.543695] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 20:23:06 juju-e4d256-prod-github-runner-207 kernel: [53960.543862] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 20:23:06 juju-e4d256-prod-github-runner-207 kernel: [53960.555965] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 20:23:06 juju-e4d256-prod-github-runner-207 kernel: [53960.557245] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 20:23:06 juju-e4d256-prod-github-runner-207 kernel: [53960.558463] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:23:06 juju-e4d256-prod-github-runner-207 kernel: [53960.559518] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 20:23:06 juju-e4d256-prod-github-runner-207 kernel: [53960.562095] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 20:23:06 juju-e4d256-prod-github-runner-207 kernel: [53960.563147] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 20:23:06 juju-e4d256-prod-github-runner-207 kernel: [53960.564322] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 20:23:06 juju-e4d256-prod-github-runner-207 kernel: [53960.565483] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 20:23:06 juju-e4d256-prod-github-runner-207 kernel: [53960.566649] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 20:23:06 juju-e4d256-prod-github-runner-207 kernel: [53960.567814] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 20:23:06 juju-e4d256-prod-github-runner-207 kernel: [53960.568987] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 20:23:06 juju-e4d256-prod-github-runner-207 kernel: [53960.570242] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 20:23:06 juju-e4d256-prod-github-runner-207 kernel: [53960.571337] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 20:23:06 juju-e4d256-prod-github-runner-207 kernel: [53960.572607] Call Trace: Aug 22 20:23:06 juju-e4d256-prod-github-runner-207 kernel: [53960.573542] Aug 22 20:23:06 juju-e4d256-prod-github-runner-207 kernel: [53960.574434] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:23:06 juju-e4d256-prod-github-runner-207 kernel: [53960.575460] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:23:06 juju-e4d256-prod-github-runner-207 kernel: [53960.576494] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:23:06 juju-e4d256-prod-github-runner-207 kernel: [53960.577580] ? show_regs.part.0+0x23/0x29 Aug 22 20:23:06 juju-e4d256-prod-github-runner-207 kernel: [53960.578577] ? show_regs.cold+0x8/0xd Aug 22 20:23:06 juju-e4d256-prod-github-runner-207 kernel: [53960.579546] ? watchdog_timer_fn+0x1be/0x220 Aug 22 20:23:06 juju-e4d256-prod-github-runner-207 kernel: [53960.580572] ? lockup_detector_update_enable+0x60/0x60 Aug 22 20:23:06 juju-e4d256-prod-github-runner-207 kernel: [53960.581636] ? __hrtimer_run_queues+0x107/0x230 Aug 22 20:23:06 juju-e4d256-prod-github-runner-207 kernel: [53960.582690] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 20:23:06 juju-e4d256-prod-github-runner-207 kernel: [53960.583727] ? hrtimer_interrupt+0x101/0x220 Aug 22 20:23:06 juju-e4d256-prod-github-runner-207 kernel: [53960.584763] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 20:23:06 juju-e4d256-prod-github-runner-207 kernel: [53960.585840] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 20:23:06 juju-e4d256-prod-github-runner-207 kernel: [53960.586886] Aug 22 20:23:06 juju-e4d256-prod-github-runner-207 kernel: [53960.587739] Aug 22 20:23:06 juju-e4d256-prod-github-runner-207 kernel: [53960.588587] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 20:23:06 juju-e4d256-prod-github-runner-207 kernel: [53960.589624] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:23:06 juju-e4d256-prod-github-runner-207 kernel: [53960.590663] ? _raw_spin_lock+0x22/0x30 Aug 22 20:23:06 juju-e4d256-prod-github-runner-207 kernel: [53960.591608] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:23:06 juju-e4d256-prod-github-runner-207 kernel: [53960.592655] direct_page_fault+0x206/0x310 [kvm] Aug 22 20:23:06 juju-e4d256-prod-github-runner-207 kernel: [53960.593702] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 20:23:06 juju-e4d256-prod-github-runner-207 kernel: [53960.594711] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 20:23:06 juju-e4d256-prod-github-runner-207 kernel: [53960.595715] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 20:23:06 juju-e4d256-prod-github-runner-207 kernel: [53960.596709] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 20:23:06 juju-e4d256-prod-github-runner-207 kernel: [53960.597656] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 20:23:06 juju-e4d256-prod-github-runner-207 kernel: [53960.598633] handle_exit+0x98/0x230 [kvm_amd] Aug 22 20:23:06 juju-e4d256-prod-github-runner-207 kernel: [53960.599524] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 20:23:06 juju-e4d256-prod-github-runner-207 kernel: [53960.600447] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 20:23:06 juju-e4d256-prod-github-runner-207 kernel: [53960.601371] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 20:23:06 juju-e4d256-prod-github-runner-207 kernel: [53960.602279] vcpu_run+0x62/0x2c0 [kvm] Aug 22 20:23:06 juju-e4d256-prod-github-runner-207 kernel: [53960.603113] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 20:23:06 juju-e4d256-prod-github-runner-207 kernel: [53960.603939] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 20:23:06 juju-e4d256-prod-github-runner-207 kernel: [53960.604806] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 20:23:06 juju-e4d256-prod-github-runner-207 kernel: [53960.605601] ? __seccomp_filter+0x4a/0x4a0 Aug 22 20:23:06 juju-e4d256-prod-github-runner-207 kernel: [53960.606341] ? __fget_files+0x86/0xc0 Aug 22 20:23:06 juju-e4d256-prod-github-runner-207 kernel: [53960.607048] __x64_sys_ioctl+0x95/0xd0 Aug 22 20:23:06 juju-e4d256-prod-github-runner-207 kernel: [53960.607741] do_syscall_64+0x5c/0xc0 Aug 22 20:23:06 juju-e4d256-prod-github-runner-207 kernel: [53960.608420] ? do_futex+0x162/0x1f0 Aug 22 20:23:06 juju-e4d256-prod-github-runner-207 kernel: [53960.609068] ? __x64_sys_futex+0x78/0x1e0 Aug 22 20:23:06 juju-e4d256-prod-github-runner-207 kernel: [53960.609740] ? __secure_computing+0xa9/0x120 Aug 22 20:23:06 juju-e4d256-prod-github-runner-207 kernel: [53960.610428] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 20:23:06 juju-e4d256-prod-github-runner-207 kernel: [53960.611185] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:23:06 juju-e4d256-prod-github-runner-207 kernel: [53960.611908] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:23:06 juju-e4d256-prod-github-runner-207 kernel: [53960.612632] ? do_syscall_64+0x69/0xc0 Aug 22 20:23:06 juju-e4d256-prod-github-runner-207 kernel: [53960.613281] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:23:06 juju-e4d256-prod-github-runner-207 kernel: [53960.613993] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:23:06 juju-e4d256-prod-github-runner-207 kernel: [53960.614688] ? do_syscall_64+0x69/0xc0 Aug 22 20:23:06 juju-e4d256-prod-github-runner-207 kernel: [53960.615314] ? do_syscall_64+0x69/0xc0 Aug 22 20:23:06 juju-e4d256-prod-github-runner-207 kernel: [53960.615934] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 20:23:06 juju-e4d256-prod-github-runner-207 kernel: [53960.616657] RIP: 0033:0x7faa5d0edaff Aug 22 20:23:06 juju-e4d256-prod-github-runner-207 kernel: [53960.617296] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 20:23:06 juju-e4d256-prod-github-runner-207 kernel: [53960.619287] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 20:23:06 juju-e4d256-prod-github-runner-207 kernel: [53960.620205] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 20:23:06 juju-e4d256-prod-github-runner-207 kernel: [53960.621096] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 20:23:06 juju-e4d256-prod-github-runner-207 kernel: [53960.621984] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 20:23:06 juju-e4d256-prod-github-runner-207 kernel: [53960.622871] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 20:23:06 juju-e4d256-prod-github-runner-207 kernel: [53960.623771] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 20:23:06 juju-e4d256-prod-github-runner-207 kernel: [53960.624686] Aug 22 20:23:34 juju-e4d256-prod-github-runner-207 kernel: [53988.541980] watchdog: BUG: soft lockup - CPU#1 stuck for 50172s! [qemu-system-x86:6715] Aug 22 20:23:34 juju-e4d256-prod-github-runner-207 kernel: [53988.543653] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 20:23:34 juju-e4d256-prod-github-runner-207 kernel: [53988.543733] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 20:23:34 juju-e4d256-prod-github-runner-207 kernel: [53988.556050] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 20:23:34 juju-e4d256-prod-github-runner-207 kernel: [53988.557323] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 20:23:34 juju-e4d256-prod-github-runner-207 kernel: [53988.558541] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:23:34 juju-e4d256-prod-github-runner-207 kernel: [53988.559603] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 20:23:34 juju-e4d256-prod-github-runner-207 kernel: [53988.562159] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 20:23:34 juju-e4d256-prod-github-runner-207 kernel: [53988.563205] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 20:23:34 juju-e4d256-prod-github-runner-207 kernel: [53988.564529] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 20:23:34 juju-e4d256-prod-github-runner-207 kernel: [53988.566347] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 20:23:34 juju-e4d256-prod-github-runner-207 kernel: [53988.568197] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 20:23:34 juju-e4d256-prod-github-runner-207 kernel: [53988.569996] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 20:23:34 juju-e4d256-prod-github-runner-207 kernel: [53988.571813] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 20:23:34 juju-e4d256-prod-github-runner-207 kernel: [53988.573754] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 20:23:34 juju-e4d256-prod-github-runner-207 kernel: [53988.575470] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 20:23:34 juju-e4d256-prod-github-runner-207 kernel: [53988.577345] Call Trace: Aug 22 20:23:34 juju-e4d256-prod-github-runner-207 kernel: [53988.578799] Aug 22 20:23:34 juju-e4d256-prod-github-runner-207 kernel: [53988.580209] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:23:34 juju-e4d256-prod-github-runner-207 kernel: [53988.581834] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:23:34 juju-e4d256-prod-github-runner-207 kernel: [53988.583430] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:23:34 juju-e4d256-prod-github-runner-207 kernel: [53988.585184] ? show_regs.part.0+0x23/0x29 Aug 22 20:23:34 juju-e4d256-prod-github-runner-207 kernel: [53988.586820] ? show_regs.cold+0x8/0xd Aug 22 20:23:34 juju-e4d256-prod-github-runner-207 kernel: [53988.588079] ? watchdog_timer_fn+0x1be/0x220 Aug 22 20:23:34 juju-e4d256-prod-github-runner-207 kernel: [53988.589114] ? lockup_detector_update_enable+0x60/0x60 Aug 22 20:23:34 juju-e4d256-prod-github-runner-207 kernel: [53988.590183] ? __hrtimer_run_queues+0x107/0x230 Aug 22 20:23:34 juju-e4d256-prod-github-runner-207 kernel: [53988.591216] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 20:23:34 juju-e4d256-prod-github-runner-207 kernel: [53988.592259] ? hrtimer_interrupt+0x101/0x220 Aug 22 20:23:34 juju-e4d256-prod-github-runner-207 kernel: [53988.593280] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 20:23:34 juju-e4d256-prod-github-runner-207 kernel: [53988.594350] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 20:23:34 juju-e4d256-prod-github-runner-207 kernel: [53988.595399] Aug 22 20:23:34 juju-e4d256-prod-github-runner-207 kernel: [53988.596267] Aug 22 20:23:34 juju-e4d256-prod-github-runner-207 kernel: [53988.597105] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 20:23:34 juju-e4d256-prod-github-runner-207 kernel: [53988.598139] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:23:34 juju-e4d256-prod-github-runner-207 kernel: [53988.599184] ? _raw_spin_lock+0x22/0x30 Aug 22 20:23:34 juju-e4d256-prod-github-runner-207 kernel: [53988.600143] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:23:34 juju-e4d256-prod-github-runner-207 kernel: [53988.601171] direct_page_fault+0x206/0x310 [kvm] Aug 22 20:23:34 juju-e4d256-prod-github-runner-207 kernel: [53988.602239] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 20:23:34 juju-e4d256-prod-github-runner-207 kernel: [53988.603277] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 20:23:34 juju-e4d256-prod-github-runner-207 kernel: [53988.604547] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 20:23:34 juju-e4d256-prod-github-runner-207 kernel: [53988.605523] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 20:23:34 juju-e4d256-prod-github-runner-207 kernel: [53988.606471] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 20:23:34 juju-e4d256-prod-github-runner-207 kernel: [53988.607475] handle_exit+0x98/0x230 [kvm_amd] Aug 22 20:23:34 juju-e4d256-prod-github-runner-207 kernel: [53988.608406] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 20:23:34 juju-e4d256-prod-github-runner-207 kernel: [53988.609347] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 20:23:34 juju-e4d256-prod-github-runner-207 kernel: [53988.610357] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 20:23:34 juju-e4d256-prod-github-runner-207 kernel: [53988.611279] vcpu_run+0x62/0x2c0 [kvm] Aug 22 20:23:34 juju-e4d256-prod-github-runner-207 kernel: [53988.612130] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 20:23:34 juju-e4d256-prod-github-runner-207 kernel: [53988.613003] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 20:23:34 juju-e4d256-prod-github-runner-207 kernel: [53988.613878] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 20:23:34 juju-e4d256-prod-github-runner-207 kernel: [53988.614822] ? __seccomp_filter+0x4a/0x4a0 Aug 22 20:23:34 juju-e4d256-prod-github-runner-207 kernel: [53988.615999] ? __fget_files+0x86/0xc0 Aug 22 20:23:34 juju-e4d256-prod-github-runner-207 kernel: [53988.617110] __x64_sys_ioctl+0x95/0xd0 Aug 22 20:23:34 juju-e4d256-prod-github-runner-207 kernel: [53988.618193] do_syscall_64+0x5c/0xc0 Aug 22 20:23:34 juju-e4d256-prod-github-runner-207 kernel: [53988.619229] ? do_futex+0x162/0x1f0 Aug 22 20:23:34 juju-e4d256-prod-github-runner-207 kernel: [53988.620266] ? __x64_sys_futex+0x78/0x1e0 Aug 22 20:23:34 juju-e4d256-prod-github-runner-207 kernel: [53988.621327] ? __secure_computing+0xa9/0x120 Aug 22 20:23:34 juju-e4d256-prod-github-runner-207 kernel: [53988.622405] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 20:23:34 juju-e4d256-prod-github-runner-207 kernel: [53988.623582] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:23:34 juju-e4d256-prod-github-runner-207 kernel: [53988.624716] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:23:34 juju-e4d256-prod-github-runner-207 kernel: [53988.625836] ? do_syscall_64+0x69/0xc0 Aug 22 20:23:34 juju-e4d256-prod-github-runner-207 kernel: [53988.626840] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:23:34 juju-e4d256-prod-github-runner-207 kernel: [53988.627939] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:23:34 juju-e4d256-prod-github-runner-207 kernel: [53988.629014] ? do_syscall_64+0x69/0xc0 Aug 22 20:23:34 juju-e4d256-prod-github-runner-207 kernel: [53988.629991] ? do_syscall_64+0x69/0xc0 Aug 22 20:23:34 juju-e4d256-prod-github-runner-207 kernel: [53988.630975] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 20:23:34 juju-e4d256-prod-github-runner-207 kernel: [53988.632243] RIP: 0033:0x7faa5d0edaff Aug 22 20:23:34 juju-e4d256-prod-github-runner-207 kernel: [53988.633212] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 20:23:34 juju-e4d256-prod-github-runner-207 kernel: [53988.636369] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 20:23:34 juju-e4d256-prod-github-runner-207 kernel: [53988.637618] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 20:23:34 juju-e4d256-prod-github-runner-207 kernel: [53988.638535] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 20:23:34 juju-e4d256-prod-github-runner-207 kernel: [53988.639434] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 20:23:34 juju-e4d256-prod-github-runner-207 kernel: [53988.640343] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 20:23:34 juju-e4d256-prod-github-runner-207 kernel: [53988.641244] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 20:23:34 juju-e4d256-prod-github-runner-207 kernel: [53988.642142] Aug 22 20:23:46 juju-e4d256-prod-github-runner-207 kernel: [54000.788710] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 20:23:46 juju-e4d256-prod-github-runner-207 kernel: [54000.789667] rcu: 1-....: (13428479 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=6491368 Aug 22 20:23:46 juju-e4d256-prod-github-runner-207 kernel: [54000.790816] (t=13470897 jiffies g=23269 q=50187) Aug 22 20:23:46 juju-e4d256-prod-github-runner-207 kernel: [54000.791609] NMI backtrace for cpu 1 Aug 22 20:23:46 juju-e4d256-prod-github-runner-207 kernel: [54000.794393] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 20:23:46 juju-e4d256-prod-github-runner-207 kernel: [54000.795516] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 20:23:46 juju-e4d256-prod-github-runner-207 kernel: [54000.796603] Call Trace: Aug 22 20:23:46 juju-e4d256-prod-github-runner-207 kernel: [54000.799347] Aug 22 20:23:46 juju-e4d256-prod-github-runner-207 kernel: [54000.800012] show_stack+0x52/0x5c Aug 22 20:23:46 juju-e4d256-prod-github-runner-207 kernel: [54000.800742] dump_stack_lvl+0x4a/0x63 Aug 22 20:23:46 juju-e4d256-prod-github-runner-207 kernel: [54000.801491] dump_stack+0x10/0x16 Aug 22 20:23:46 juju-e4d256-prod-github-runner-207 kernel: [54000.802210] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 20:23:46 juju-e4d256-prod-github-runner-207 kernel: [54000.802996] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 20:23:46 juju-e4d256-prod-github-runner-207 kernel: [54000.803794] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 20:23:46 juju-e4d256-prod-github-runner-207 kernel: [54000.804623] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 20:23:46 juju-e4d256-prod-github-runner-207 kernel: [54000.805449] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 20:23:46 juju-e4d256-prod-github-runner-207 kernel: [54000.806265] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 20:23:46 juju-e4d256-prod-github-runner-207 kernel: [54000.807044] print_cpu_stall.cold+0x2f/0xe2 Aug 22 20:23:46 juju-e4d256-prod-github-runner-207 kernel: [54000.807835] ? timekeeping_update+0xf7/0x150 Aug 22 20:23:46 juju-e4d256-prod-github-runner-207 kernel: [54000.808618] check_cpu_stall+0x109/0x270 Aug 22 20:23:46 juju-e4d256-prod-github-runner-207 kernel: [54000.809370] rcu_sched_clock_irq+0x9a/0x250 Aug 22 20:23:46 juju-e4d256-prod-github-runner-207 kernel: [54000.810135] update_process_times+0x94/0xd0 Aug 22 20:23:46 juju-e4d256-prod-github-runner-207 kernel: [54000.810900] tick_sched_handle+0x29/0x70 Aug 22 20:23:46 juju-e4d256-prod-github-runner-207 kernel: [54000.811665] tick_sched_timer+0x8c/0xc0 Aug 22 20:23:46 juju-e4d256-prod-github-runner-207 kernel: [54000.812414] ? tick_nohz_handler+0xb0/0xb0 Aug 22 20:23:46 juju-e4d256-prod-github-runner-207 kernel: [54000.813173] __hrtimer_run_queues+0x107/0x230 Aug 22 20:23:46 juju-e4d256-prod-github-runner-207 kernel: [54000.813952] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 20:23:46 juju-e4d256-prod-github-runner-207 kernel: [54000.814732] hrtimer_interrupt+0x101/0x220 Aug 22 20:23:46 juju-e4d256-prod-github-runner-207 kernel: [54000.815501] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 20:23:46 juju-e4d256-prod-github-runner-207 kernel: [54000.816337] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 20:23:46 juju-e4d256-prod-github-runner-207 kernel: [54000.817144] Aug 22 20:23:46 juju-e4d256-prod-github-runner-207 kernel: [54000.817785] Aug 22 20:23:46 juju-e4d256-prod-github-runner-207 kernel: [54000.818414] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 20:23:46 juju-e4d256-prod-github-runner-207 kernel: [54000.819238] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:23:46 juju-e4d256-prod-github-runner-207 kernel: [54000.820140] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 20:23:46 juju-e4d256-prod-github-runner-207 kernel: [54000.822405] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 20:23:46 juju-e4d256-prod-github-runner-207 kernel: [54000.823285] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 20:23:46 juju-e4d256-prod-github-runner-207 kernel: [54000.824305] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 20:23:46 juju-e4d256-prod-github-runner-207 kernel: [54000.825289] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 20:23:46 juju-e4d256-prod-github-runner-207 kernel: [54000.826258] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 20:23:46 juju-e4d256-prod-github-runner-207 kernel: [54000.827223] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 20:23:46 juju-e4d256-prod-github-runner-207 kernel: [54000.828196] ? _raw_spin_lock+0x22/0x30 Aug 22 20:23:46 juju-e4d256-prod-github-runner-207 kernel: [54000.828959] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:23:46 juju-e4d256-prod-github-runner-207 kernel: [54000.829804] direct_page_fault+0x206/0x310 [kvm] Aug 22 20:23:46 juju-e4d256-prod-github-runner-207 kernel: [54000.830650] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 20:23:46 juju-e4d256-prod-github-runner-207 kernel: [54000.831489] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 20:23:46 juju-e4d256-prod-github-runner-207 kernel: [54000.832332] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 20:23:46 juju-e4d256-prod-github-runner-207 kernel: [54000.833142] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 20:23:46 juju-e4d256-prod-github-runner-207 kernel: [54000.833931] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 20:23:46 juju-e4d256-prod-github-runner-207 kernel: [54000.834759] handle_exit+0x98/0x230 [kvm_amd] Aug 22 20:23:46 juju-e4d256-prod-github-runner-207 kernel: [54000.835520] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 20:23:46 juju-e4d256-prod-github-runner-207 kernel: [54000.836317] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 20:23:46 juju-e4d256-prod-github-runner-207 kernel: [54000.837123] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 20:23:46 juju-e4d256-prod-github-runner-207 kernel: [54000.837917] vcpu_run+0x62/0x2c0 [kvm] Aug 22 20:23:46 juju-e4d256-prod-github-runner-207 kernel: [54000.838637] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 20:23:46 juju-e4d256-prod-github-runner-207 kernel: [54000.839376] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 20:23:46 juju-e4d256-prod-github-runner-207 kernel: [54000.840190] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 20:23:46 juju-e4d256-prod-github-runner-207 kernel: [54000.840951] ? __seccomp_filter+0x4a/0x4a0 Aug 22 20:23:46 juju-e4d256-prod-github-runner-207 kernel: [54000.841674] ? __fget_files+0x86/0xc0 Aug 22 20:23:46 juju-e4d256-prod-github-runner-207 kernel: [54000.842386] __x64_sys_ioctl+0x95/0xd0 Aug 22 20:23:46 juju-e4d256-prod-github-runner-207 kernel: [54000.843078] do_syscall_64+0x5c/0xc0 Aug 22 20:23:46 juju-e4d256-prod-github-runner-207 kernel: [54000.843768] ? do_futex+0x162/0x1f0 Aug 22 20:23:46 juju-e4d256-prod-github-runner-207 kernel: [54000.844441] ? __x64_sys_futex+0x78/0x1e0 Aug 22 20:23:46 juju-e4d256-prod-github-runner-207 kernel: [54000.845325] ? __secure_computing+0xa9/0x120 Aug 22 20:23:46 juju-e4d256-prod-github-runner-207 kernel: [54000.846042] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 20:23:46 juju-e4d256-prod-github-runner-207 kernel: [54000.846831] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:23:46 juju-e4d256-prod-github-runner-207 kernel: [54000.847586] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:23:46 juju-e4d256-prod-github-runner-207 kernel: [54000.848355] ? do_syscall_64+0x69/0xc0 Aug 22 20:23:46 juju-e4d256-prod-github-runner-207 kernel: [54000.849042] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:23:46 juju-e4d256-prod-github-runner-207 kernel: [54000.849795] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:23:46 juju-e4d256-prod-github-runner-207 kernel: [54000.850580] ? do_syscall_64+0x69/0xc0 Aug 22 20:23:46 juju-e4d256-prod-github-runner-207 kernel: [54000.851287] ? do_syscall_64+0x69/0xc0 Aug 22 20:23:46 juju-e4d256-prod-github-runner-207 kernel: [54000.851996] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 20:23:46 juju-e4d256-prod-github-runner-207 kernel: [54000.852766] RIP: 0033:0x7faa5d0edaff Aug 22 20:23:46 juju-e4d256-prod-github-runner-207 kernel: [54000.853448] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 20:23:46 juju-e4d256-prod-github-runner-207 kernel: [54000.855544] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 20:23:46 juju-e4d256-prod-github-runner-207 kernel: [54000.856523] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 20:23:46 juju-e4d256-prod-github-runner-207 kernel: [54000.857473] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 20:23:46 juju-e4d256-prod-github-runner-207 kernel: [54000.858415] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 20:23:46 juju-e4d256-prod-github-runner-207 kernel: [54000.859369] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 20:23:46 juju-e4d256-prod-github-runner-207 kernel: [54000.860385] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 20:23:46 juju-e4d256-prod-github-runner-207 kernel: [54000.861298] Aug 22 20:24:14 juju-e4d256-prod-github-runner-207 kernel: [54028.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 50210s! [qemu-system-x86:6715] Aug 22 20:24:14 juju-e4d256-prod-github-runner-207 kernel: [54028.543769] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 20:24:14 juju-e4d256-prod-github-runner-207 kernel: [54028.544034] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 20:24:14 juju-e4d256-prod-github-runner-207 kernel: [54028.556213] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 20:24:14 juju-e4d256-prod-github-runner-207 kernel: [54028.557483] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 20:24:14 juju-e4d256-prod-github-runner-207 kernel: [54028.558700] RIP: 0010:native_queued_spin_lock_slowpath+0xc/0x40 Aug 22 20:24:14 juju-e4d256-prod-github-runner-207 kernel: [54028.559762] Code: fe ff ff eb af 4c 89 fe 48 c7 c7 20 99 e9 89 e8 ca 69 55 00 e9 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 <8b> 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 eb Aug 22 20:24:14 juju-e4d256-prod-github-runner-207 kernel: [54028.562314] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 20:24:14 juju-e4d256-prod-github-runner-207 kernel: [54028.563368] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 20:24:14 juju-e4d256-prod-github-runner-207 kernel: [54028.564531] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 20:24:14 juju-e4d256-prod-github-runner-207 kernel: [54028.565707] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 20:24:14 juju-e4d256-prod-github-runner-207 kernel: [54028.566874] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 20:24:14 juju-e4d256-prod-github-runner-207 kernel: [54028.568052] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 20:24:14 juju-e4d256-prod-github-runner-207 kernel: [54028.569222] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 20:24:14 juju-e4d256-prod-github-runner-207 kernel: [54028.570451] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 20:24:14 juju-e4d256-prod-github-runner-207 kernel: [54028.571565] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 20:24:14 juju-e4d256-prod-github-runner-207 kernel: [54028.572757] Call Trace: Aug 22 20:24:14 juju-e4d256-prod-github-runner-207 kernel: [54028.573667] Aug 22 20:24:14 juju-e4d256-prod-github-runner-207 kernel: [54028.574560] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:24:14 juju-e4d256-prod-github-runner-207 kernel: [54028.575626] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:24:14 juju-e4d256-prod-github-runner-207 kernel: [54028.576676] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:24:14 juju-e4d256-prod-github-runner-207 kernel: [54028.577797] ? show_regs.part.0+0x23/0x29 Aug 22 20:24:14 juju-e4d256-prod-github-runner-207 kernel: [54028.578815] ? show_regs.cold+0x8/0xd Aug 22 20:24:14 juju-e4d256-prod-github-runner-207 kernel: [54028.579857] ? watchdog_timer_fn+0x1be/0x220 Aug 22 20:24:14 juju-e4d256-prod-github-runner-207 kernel: [54028.580863] ? lockup_detector_update_enable+0x60/0x60 Aug 22 20:24:14 juju-e4d256-prod-github-runner-207 kernel: [54028.581927] ? __hrtimer_run_queues+0x107/0x230 Aug 22 20:24:14 juju-e4d256-prod-github-runner-207 kernel: [54028.582950] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 20:24:14 juju-e4d256-prod-github-runner-207 kernel: [54028.583979] ? hrtimer_interrupt+0x101/0x220 Aug 22 20:24:14 juju-e4d256-prod-github-runner-207 kernel: [54028.584997] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 20:24:14 juju-e4d256-prod-github-runner-207 kernel: [54028.586172] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 20:24:14 juju-e4d256-prod-github-runner-207 kernel: [54028.587255] Aug 22 20:24:14 juju-e4d256-prod-github-runner-207 kernel: [54028.588133] Aug 22 20:24:14 juju-e4d256-prod-github-runner-207 kernel: [54028.588971] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 20:24:14 juju-e4d256-prod-github-runner-207 kernel: [54028.590005] ? native_queued_spin_lock_slowpath+0xc/0x40 Aug 22 20:24:14 juju-e4d256-prod-github-runner-207 kernel: [54028.591043] ? _raw_spin_lock+0x22/0x30 Aug 22 20:24:14 juju-e4d256-prod-github-runner-207 kernel: [54028.591994] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:24:14 juju-e4d256-prod-github-runner-207 kernel: [54028.593009] direct_page_fault+0x206/0x310 [kvm] Aug 22 20:24:14 juju-e4d256-prod-github-runner-207 kernel: [54028.594037] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 20:24:14 juju-e4d256-prod-github-runner-207 kernel: [54028.595042] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 20:24:14 juju-e4d256-prod-github-runner-207 kernel: [54028.596050] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 20:24:14 juju-e4d256-prod-github-runner-207 kernel: [54028.597063] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 20:24:14 juju-e4d256-prod-github-runner-207 kernel: [54028.598034] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 20:24:14 juju-e4d256-prod-github-runner-207 kernel: [54028.599018] handle_exit+0x98/0x230 [kvm_amd] Aug 22 20:24:14 juju-e4d256-prod-github-runner-207 kernel: [54028.599948] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 20:24:14 juju-e4d256-prod-github-runner-207 kernel: [54028.600861] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 20:24:14 juju-e4d256-prod-github-runner-207 kernel: [54028.601816] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 20:24:14 juju-e4d256-prod-github-runner-207 kernel: [54028.602723] vcpu_run+0x62/0x2c0 [kvm] Aug 22 20:24:14 juju-e4d256-prod-github-runner-207 kernel: [54028.603546] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 20:24:14 juju-e4d256-prod-github-runner-207 kernel: [54028.604359] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 20:24:14 juju-e4d256-prod-github-runner-207 kernel: [54028.605209] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 20:24:14 juju-e4d256-prod-github-runner-207 kernel: [54028.606004] ? __seccomp_filter+0x4a/0x4a0 Aug 22 20:24:14 juju-e4d256-prod-github-runner-207 kernel: [54028.606750] ? __fget_files+0x86/0xc0 Aug 22 20:24:14 juju-e4d256-prod-github-runner-207 kernel: [54028.607505] __x64_sys_ioctl+0x95/0xd0 Aug 22 20:24:14 juju-e4d256-prod-github-runner-207 kernel: [54028.608202] do_syscall_64+0x5c/0xc0 Aug 22 20:24:14 juju-e4d256-prod-github-runner-207 kernel: [54028.608865] ? do_futex+0x162/0x1f0 Aug 22 20:24:14 juju-e4d256-prod-github-runner-207 kernel: [54028.609512] ? __x64_sys_futex+0x78/0x1e0 Aug 22 20:24:14 juju-e4d256-prod-github-runner-207 kernel: [54028.610189] ? __secure_computing+0xa9/0x120 Aug 22 20:24:14 juju-e4d256-prod-github-runner-207 kernel: [54028.610878] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 20:24:14 juju-e4d256-prod-github-runner-207 kernel: [54028.611645] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:24:14 juju-e4d256-prod-github-runner-207 kernel: [54028.612366] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:24:14 juju-e4d256-prod-github-runner-207 kernel: [54028.613087] ? do_syscall_64+0x69/0xc0 Aug 22 20:24:14 juju-e4d256-prod-github-runner-207 kernel: [54028.613729] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:24:14 juju-e4d256-prod-github-runner-207 kernel: [54028.614430] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:24:14 juju-e4d256-prod-github-runner-207 kernel: [54028.615128] ? do_syscall_64+0x69/0xc0 Aug 22 20:24:14 juju-e4d256-prod-github-runner-207 kernel: [54028.615771] ? do_syscall_64+0x69/0xc0 Aug 22 20:24:14 juju-e4d256-prod-github-runner-207 kernel: [54028.616391] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 20:24:14 juju-e4d256-prod-github-runner-207 kernel: [54028.617103] RIP: 0033:0x7faa5d0edaff Aug 22 20:24:14 juju-e4d256-prod-github-runner-207 kernel: [54028.617782] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 20:24:14 juju-e4d256-prod-github-runner-207 kernel: [54028.619788] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 20:24:14 juju-e4d256-prod-github-runner-207 kernel: [54028.620698] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 20:24:14 juju-e4d256-prod-github-runner-207 kernel: [54028.621593] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 20:24:14 juju-e4d256-prod-github-runner-207 kernel: [54028.622481] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 20:24:14 juju-e4d256-prod-github-runner-207 kernel: [54028.623372] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 20:24:14 juju-e4d256-prod-github-runner-207 kernel: [54028.624261] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 20:24:14 juju-e4d256-prod-github-runner-207 kernel: [54028.625150] Aug 22 20:24:42 juju-e4d256-prod-github-runner-207 kernel: [54056.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 50236s! [qemu-system-x86:6715] Aug 22 20:24:42 juju-e4d256-prod-github-runner-207 kernel: [54056.543126] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 20:24:42 juju-e4d256-prod-github-runner-207 kernel: [54056.543195] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 20:24:42 juju-e4d256-prod-github-runner-207 kernel: [54056.555356] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 20:24:42 juju-e4d256-prod-github-runner-207 kernel: [54056.556624] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 20:24:42 juju-e4d256-prod-github-runner-207 kernel: [54056.557844] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:24:42 juju-e4d256-prod-github-runner-207 kernel: [54056.558905] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 20:24:42 juju-e4d256-prod-github-runner-207 kernel: [54056.561470] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 20:24:42 juju-e4d256-prod-github-runner-207 kernel: [54056.562517] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 20:24:42 juju-e4d256-prod-github-runner-207 kernel: [54056.563710] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 20:24:42 juju-e4d256-prod-github-runner-207 kernel: [54056.564896] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 20:24:42 juju-e4d256-prod-github-runner-207 kernel: [54056.566062] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 20:24:42 juju-e4d256-prod-github-runner-207 kernel: [54056.567248] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 20:24:42 juju-e4d256-prod-github-runner-207 kernel: [54056.568416] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 20:24:42 juju-e4d256-prod-github-runner-207 kernel: [54056.569664] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 20:24:42 juju-e4d256-prod-github-runner-207 kernel: [54056.570845] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 20:24:42 juju-e4d256-prod-github-runner-207 kernel: [54056.572216] Call Trace: Aug 22 20:24:42 juju-e4d256-prod-github-runner-207 kernel: [54056.573366] Aug 22 20:24:42 juju-e4d256-prod-github-runner-207 kernel: [54056.574390] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:24:42 juju-e4d256-prod-github-runner-207 kernel: [54056.575480] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:24:42 juju-e4d256-prod-github-runner-207 kernel: [54056.576563] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:24:42 juju-e4d256-prod-github-runner-207 kernel: [54056.577657] ? show_regs.part.0+0x23/0x29 Aug 22 20:24:42 juju-e4d256-prod-github-runner-207 kernel: [54056.578664] ? show_regs.cold+0x8/0xd Aug 22 20:24:42 juju-e4d256-prod-github-runner-207 kernel: [54056.579742] ? watchdog_timer_fn+0x1be/0x220 Aug 22 20:24:42 juju-e4d256-prod-github-runner-207 kernel: [54056.580759] ? lockup_detector_update_enable+0x60/0x60 Aug 22 20:24:42 juju-e4d256-prod-github-runner-207 kernel: [54056.581832] ? __hrtimer_run_queues+0x107/0x230 Aug 22 20:24:42 juju-e4d256-prod-github-runner-207 kernel: [54056.582867] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 20:24:42 juju-e4d256-prod-github-runner-207 kernel: [54056.583916] ? hrtimer_interrupt+0x101/0x220 Aug 22 20:24:42 juju-e4d256-prod-github-runner-207 kernel: [54056.584938] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 20:24:42 juju-e4d256-prod-github-runner-207 kernel: [54056.586010] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 20:24:42 juju-e4d256-prod-github-runner-207 kernel: [54056.587082] Aug 22 20:24:42 juju-e4d256-prod-github-runner-207 kernel: [54056.587943] Aug 22 20:24:42 juju-e4d256-prod-github-runner-207 kernel: [54056.588783] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 20:24:42 juju-e4d256-prod-github-runner-207 kernel: [54056.589882] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:24:42 juju-e4d256-prod-github-runner-207 kernel: [54056.590956] ? _raw_spin_lock+0x22/0x30 Aug 22 20:24:42 juju-e4d256-prod-github-runner-207 kernel: [54056.591905] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:24:42 juju-e4d256-prod-github-runner-207 kernel: [54056.592930] direct_page_fault+0x206/0x310 [kvm] Aug 22 20:24:42 juju-e4d256-prod-github-runner-207 kernel: [54056.593973] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 20:24:42 juju-e4d256-prod-github-runner-207 kernel: [54056.595016] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 20:24:42 juju-e4d256-prod-github-runner-207 kernel: [54056.596026] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 20:24:42 juju-e4d256-prod-github-runner-207 kernel: [54056.596997] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 20:24:42 juju-e4d256-prod-github-runner-207 kernel: [54056.597941] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 20:24:42 juju-e4d256-prod-github-runner-207 kernel: [54056.598938] handle_exit+0x98/0x230 [kvm_amd] Aug 22 20:24:42 juju-e4d256-prod-github-runner-207 kernel: [54056.599873] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 20:24:42 juju-e4d256-prod-github-runner-207 kernel: [54056.600809] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 20:24:42 juju-e4d256-prod-github-runner-207 kernel: [54056.601735] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 20:24:42 juju-e4d256-prod-github-runner-207 kernel: [54056.602662] vcpu_run+0x62/0x2c0 [kvm] Aug 22 20:24:42 juju-e4d256-prod-github-runner-207 kernel: [54056.603495] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 20:24:42 juju-e4d256-prod-github-runner-207 kernel: [54056.604306] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 20:24:42 juju-e4d256-prod-github-runner-207 kernel: [54056.605162] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 20:24:42 juju-e4d256-prod-github-runner-207 kernel: [54056.605983] ? __seccomp_filter+0x4a/0x4a0 Aug 22 20:24:42 juju-e4d256-prod-github-runner-207 kernel: [54056.606784] ? __fget_files+0x86/0xc0 Aug 22 20:24:42 juju-e4d256-prod-github-runner-207 kernel: [54056.607515] __x64_sys_ioctl+0x95/0xd0 Aug 22 20:24:42 juju-e4d256-prod-github-runner-207 kernel: [54056.608214] do_syscall_64+0x5c/0xc0 Aug 22 20:24:42 juju-e4d256-prod-github-runner-207 kernel: [54056.608884] ? do_futex+0x162/0x1f0 Aug 22 20:24:42 juju-e4d256-prod-github-runner-207 kernel: [54056.609532] ? __x64_sys_futex+0x78/0x1e0 Aug 22 20:24:42 juju-e4d256-prod-github-runner-207 kernel: [54056.610212] ? __secure_computing+0xa9/0x120 Aug 22 20:24:42 juju-e4d256-prod-github-runner-207 kernel: [54056.610903] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 20:24:42 juju-e4d256-prod-github-runner-207 kernel: [54056.611723] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:24:42 juju-e4d256-prod-github-runner-207 kernel: [54056.612461] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:24:42 juju-e4d256-prod-github-runner-207 kernel: [54056.613228] ? do_syscall_64+0x69/0xc0 Aug 22 20:24:42 juju-e4d256-prod-github-runner-207 kernel: [54056.613900] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:24:42 juju-e4d256-prod-github-runner-207 kernel: [54056.614604] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:24:42 juju-e4d256-prod-github-runner-207 kernel: [54056.615344] ? do_syscall_64+0x69/0xc0 Aug 22 20:24:42 juju-e4d256-prod-github-runner-207 kernel: [54056.615980] ? do_syscall_64+0x69/0xc0 Aug 22 20:24:42 juju-e4d256-prod-github-runner-207 kernel: [54056.616603] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 20:24:42 juju-e4d256-prod-github-runner-207 kernel: [54056.617314] RIP: 0033:0x7faa5d0edaff Aug 22 20:24:42 juju-e4d256-prod-github-runner-207 kernel: [54056.617966] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 20:24:42 juju-e4d256-prod-github-runner-207 kernel: [54056.619991] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 20:24:42 juju-e4d256-prod-github-runner-207 kernel: [54056.620907] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 20:24:42 juju-e4d256-prod-github-runner-207 kernel: [54056.621799] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 20:24:42 juju-e4d256-prod-github-runner-207 kernel: [54056.622695] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 20:24:42 juju-e4d256-prod-github-runner-207 kernel: [54056.623694] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 20:24:42 juju-e4d256-prod-github-runner-207 kernel: [54056.624602] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 20:24:42 juju-e4d256-prod-github-runner-207 kernel: [54056.625506] Aug 22 20:25:10 juju-e4d256-prod-github-runner-207 kernel: [54084.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 50262s! [qemu-system-x86:6715] Aug 22 20:25:10 juju-e4d256-prod-github-runner-207 kernel: [54084.543176] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 20:25:10 juju-e4d256-prod-github-runner-207 kernel: [54084.543246] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 20:25:10 juju-e4d256-prod-github-runner-207 kernel: [54084.555442] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 20:25:10 juju-e4d256-prod-github-runner-207 kernel: [54084.556720] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 20:25:10 juju-e4d256-prod-github-runner-207 kernel: [54084.557946] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:25:10 juju-e4d256-prod-github-runner-207 kernel: [54084.559297] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 20:25:10 juju-e4d256-prod-github-runner-207 kernel: [54084.563199] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 20:25:10 juju-e4d256-prod-github-runner-207 kernel: [54084.564914] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 20:25:10 juju-e4d256-prod-github-runner-207 kernel: [54084.566781] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 20:25:10 juju-e4d256-prod-github-runner-207 kernel: [54084.568347] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 20:25:10 juju-e4d256-prod-github-runner-207 kernel: [54084.569545] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 20:25:10 juju-e4d256-prod-github-runner-207 kernel: [54084.570746] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 20:25:10 juju-e4d256-prod-github-runner-207 kernel: [54084.571939] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 20:25:10 juju-e4d256-prod-github-runner-207 kernel: [54084.573187] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 20:25:10 juju-e4d256-prod-github-runner-207 kernel: [54084.574298] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 20:25:10 juju-e4d256-prod-github-runner-207 kernel: [54084.575522] Call Trace: Aug 22 20:25:10 juju-e4d256-prod-github-runner-207 kernel: [54084.576447] Aug 22 20:25:10 juju-e4d256-prod-github-runner-207 kernel: [54084.577338] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:25:10 juju-e4d256-prod-github-runner-207 kernel: [54084.578378] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:25:10 juju-e4d256-prod-github-runner-207 kernel: [54084.579434] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:25:10 juju-e4d256-prod-github-runner-207 kernel: [54084.580515] ? show_regs.part.0+0x23/0x29 Aug 22 20:25:10 juju-e4d256-prod-github-runner-207 kernel: [54084.581521] ? show_regs.cold+0x8/0xd Aug 22 20:25:10 juju-e4d256-prod-github-runner-207 kernel: [54084.582498] ? watchdog_timer_fn+0x1be/0x220 Aug 22 20:25:10 juju-e4d256-prod-github-runner-207 kernel: [54084.583526] ? lockup_detector_update_enable+0x60/0x60 Aug 22 20:25:10 juju-e4d256-prod-github-runner-207 kernel: [54084.584595] ? __hrtimer_run_queues+0x107/0x230 Aug 22 20:25:10 juju-e4d256-prod-github-runner-207 kernel: [54084.585629] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 20:25:10 juju-e4d256-prod-github-runner-207 kernel: [54084.586673] ? hrtimer_interrupt+0x101/0x220 Aug 22 20:25:10 juju-e4d256-prod-github-runner-207 kernel: [54084.587698] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 20:25:10 juju-e4d256-prod-github-runner-207 kernel: [54084.588773] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 20:25:10 juju-e4d256-prod-github-runner-207 kernel: [54084.589825] Aug 22 20:25:10 juju-e4d256-prod-github-runner-207 kernel: [54084.590697] Aug 22 20:25:10 juju-e4d256-prod-github-runner-207 kernel: [54084.591545] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 20:25:10 juju-e4d256-prod-github-runner-207 kernel: [54084.592587] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:25:10 juju-e4d256-prod-github-runner-207 kernel: [54084.593635] ? _raw_spin_lock+0x22/0x30 Aug 22 20:25:10 juju-e4d256-prod-github-runner-207 kernel: [54084.594604] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:25:10 juju-e4d256-prod-github-runner-207 kernel: [54084.595635] direct_page_fault+0x206/0x310 [kvm] Aug 22 20:25:10 juju-e4d256-prod-github-runner-207 kernel: [54084.596675] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 20:25:10 juju-e4d256-prod-github-runner-207 kernel: [54084.597692] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 20:25:10 juju-e4d256-prod-github-runner-207 kernel: [54084.598713] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 20:25:10 juju-e4d256-prod-github-runner-207 kernel: [54084.599696] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 20:25:10 juju-e4d256-prod-github-runner-207 kernel: [54084.600653] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 20:25:10 juju-e4d256-prod-github-runner-207 kernel: [54084.601647] handle_exit+0x98/0x230 [kvm_amd] Aug 22 20:25:10 juju-e4d256-prod-github-runner-207 kernel: [54084.602551] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 20:25:10 juju-e4d256-prod-github-runner-207 kernel: [54084.603529] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 20:25:10 juju-e4d256-prod-github-runner-207 kernel: [54084.604472] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 20:25:10 juju-e4d256-prod-github-runner-207 kernel: [54084.605382] vcpu_run+0x62/0x2c0 [kvm] Aug 22 20:25:10 juju-e4d256-prod-github-runner-207 kernel: [54084.606207] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 20:25:10 juju-e4d256-prod-github-runner-207 kernel: [54084.607041] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 20:25:10 juju-e4d256-prod-github-runner-207 kernel: [54084.607901] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 20:25:10 juju-e4d256-prod-github-runner-207 kernel: [54084.608707] ? __seccomp_filter+0x4a/0x4a0 Aug 22 20:25:10 juju-e4d256-prod-github-runner-207 kernel: [54084.609461] ? __fget_files+0x86/0xc0 Aug 22 20:25:10 juju-e4d256-prod-github-runner-207 kernel: [54084.610252] __x64_sys_ioctl+0x95/0xd0 Aug 22 20:25:10 juju-e4d256-prod-github-runner-207 kernel: [54084.610975] do_syscall_64+0x5c/0xc0 Aug 22 20:25:10 juju-e4d256-prod-github-runner-207 kernel: [54084.611651] ? do_futex+0x162/0x1f0 Aug 22 20:25:10 juju-e4d256-prod-github-runner-207 kernel: [54084.612307] ? __x64_sys_futex+0x78/0x1e0 Aug 22 20:25:10 juju-e4d256-prod-github-runner-207 kernel: [54084.612986] ? __secure_computing+0xa9/0x120 Aug 22 20:25:10 juju-e4d256-prod-github-runner-207 kernel: [54084.613686] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 20:25:10 juju-e4d256-prod-github-runner-207 kernel: [54084.614454] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:25:10 juju-e4d256-prod-github-runner-207 kernel: [54084.615232] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:25:10 juju-e4d256-prod-github-runner-207 kernel: [54084.615957] ? do_syscall_64+0x69/0xc0 Aug 22 20:25:10 juju-e4d256-prod-github-runner-207 kernel: [54084.616607] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:25:10 juju-e4d256-prod-github-runner-207 kernel: [54084.617321] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:25:10 juju-e4d256-prod-github-runner-207 kernel: [54084.618022] ? do_syscall_64+0x69/0xc0 Aug 22 20:25:10 juju-e4d256-prod-github-runner-207 kernel: [54084.618662] ? do_syscall_64+0x69/0xc0 Aug 22 20:25:10 juju-e4d256-prod-github-runner-207 kernel: [54084.619298] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 20:25:10 juju-e4d256-prod-github-runner-207 kernel: [54084.620020] RIP: 0033:0x7faa5d0edaff Aug 22 20:25:10 juju-e4d256-prod-github-runner-207 kernel: [54084.620649] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 20:25:10 juju-e4d256-prod-github-runner-207 kernel: [54084.622667] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 20:25:10 juju-e4d256-prod-github-runner-207 kernel: [54084.623590] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 20:25:10 juju-e4d256-prod-github-runner-207 kernel: [54084.624487] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 20:25:10 juju-e4d256-prod-github-runner-207 kernel: [54084.625384] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 20:25:10 juju-e4d256-prod-github-runner-207 kernel: [54084.626282] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 20:25:10 juju-e4d256-prod-github-runner-207 kernel: [54084.627188] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 20:25:10 juju-e4d256-prod-github-runner-207 kernel: [54084.628088] Aug 22 20:25:38 juju-e4d256-prod-github-runner-207 kernel: [54112.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 50288s! [qemu-system-x86:6715] Aug 22 20:25:38 juju-e4d256-prod-github-runner-207 kernel: [54112.543162] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 20:25:38 juju-e4d256-prod-github-runner-207 kernel: [54112.543232] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 20:25:38 juju-e4d256-prod-github-runner-207 kernel: [54112.555320] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 20:25:38 juju-e4d256-prod-github-runner-207 kernel: [54112.556589] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 20:25:38 juju-e4d256-prod-github-runner-207 kernel: [54112.557809] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:25:38 juju-e4d256-prod-github-runner-207 kernel: [54112.558878] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 20:25:38 juju-e4d256-prod-github-runner-207 kernel: [54112.561428] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 20:25:38 juju-e4d256-prod-github-runner-207 kernel: [54112.562482] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 20:25:38 juju-e4d256-prod-github-runner-207 kernel: [54112.563645] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 20:25:38 juju-e4d256-prod-github-runner-207 kernel: [54112.564804] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 20:25:38 juju-e4d256-prod-github-runner-207 kernel: [54112.565969] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 20:25:38 juju-e4d256-prod-github-runner-207 kernel: [54112.567151] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 20:25:38 juju-e4d256-prod-github-runner-207 kernel: [54112.568318] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 20:25:38 juju-e4d256-prod-github-runner-207 kernel: [54112.569554] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 20:25:38 juju-e4d256-prod-github-runner-207 kernel: [54112.570798] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 20:25:38 juju-e4d256-prod-github-runner-207 kernel: [54112.572386] Call Trace: Aug 22 20:25:38 juju-e4d256-prod-github-runner-207 kernel: [54112.573395] Aug 22 20:25:38 juju-e4d256-prod-github-runner-207 kernel: [54112.574352] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:25:38 juju-e4d256-prod-github-runner-207 kernel: [54112.575493] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:25:38 juju-e4d256-prod-github-runner-207 kernel: [54112.576602] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:25:38 juju-e4d256-prod-github-runner-207 kernel: [54112.577788] ? show_regs.part.0+0x23/0x29 Aug 22 20:25:38 juju-e4d256-prod-github-runner-207 kernel: [54112.578900] ? show_regs.cold+0x8/0xd Aug 22 20:25:38 juju-e4d256-prod-github-runner-207 kernel: [54112.579948] ? watchdog_timer_fn+0x1be/0x220 Aug 22 20:25:38 juju-e4d256-prod-github-runner-207 kernel: [54112.581136] ? lockup_detector_update_enable+0x60/0x60 Aug 22 20:25:38 juju-e4d256-prod-github-runner-207 kernel: [54112.582327] ? __hrtimer_run_queues+0x107/0x230 Aug 22 20:25:38 juju-e4d256-prod-github-runner-207 kernel: [54112.583454] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 20:25:38 juju-e4d256-prod-github-runner-207 kernel: [54112.584584] ? hrtimer_interrupt+0x101/0x220 Aug 22 20:25:38 juju-e4d256-prod-github-runner-207 kernel: [54112.585688] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 20:25:38 juju-e4d256-prod-github-runner-207 kernel: [54112.586871] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 20:25:38 juju-e4d256-prod-github-runner-207 kernel: [54112.588086] Aug 22 20:25:38 juju-e4d256-prod-github-runner-207 kernel: [54112.589203] Aug 22 20:25:38 juju-e4d256-prod-github-runner-207 kernel: [54112.590073] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 20:25:38 juju-e4d256-prod-github-runner-207 kernel: [54112.591150] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:25:38 juju-e4d256-prod-github-runner-207 kernel: [54112.592197] ? _raw_spin_lock+0x22/0x30 Aug 22 20:25:38 juju-e4d256-prod-github-runner-207 kernel: [54112.593164] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:25:38 juju-e4d256-prod-github-runner-207 kernel: [54112.594197] direct_page_fault+0x206/0x310 [kvm] Aug 22 20:25:38 juju-e4d256-prod-github-runner-207 kernel: [54112.595239] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 20:25:38 juju-e4d256-prod-github-runner-207 kernel: [54112.596248] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 20:25:38 juju-e4d256-prod-github-runner-207 kernel: [54112.597247] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 20:25:38 juju-e4d256-prod-github-runner-207 kernel: [54112.598230] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 20:25:38 juju-e4d256-prod-github-runner-207 kernel: [54112.599175] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 20:25:38 juju-e4d256-prod-github-runner-207 kernel: [54112.600156] handle_exit+0x98/0x230 [kvm_amd] Aug 22 20:25:38 juju-e4d256-prod-github-runner-207 kernel: [54112.601088] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 20:25:38 juju-e4d256-prod-github-runner-207 kernel: [54112.602048] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 20:25:38 juju-e4d256-prod-github-runner-207 kernel: [54112.603139] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 20:25:38 juju-e4d256-prod-github-runner-207 kernel: [54112.604156] vcpu_run+0x62/0x2c0 [kvm] Aug 22 20:25:38 juju-e4d256-prod-github-runner-207 kernel: [54112.604996] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 20:25:38 juju-e4d256-prod-github-runner-207 kernel: [54112.605819] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 20:25:38 juju-e4d256-prod-github-runner-207 kernel: [54112.606695] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 20:25:38 juju-e4d256-prod-github-runner-207 kernel: [54112.607606] ? __seccomp_filter+0x4a/0x4a0 Aug 22 20:25:38 juju-e4d256-prod-github-runner-207 kernel: [54112.608449] ? __fget_files+0x86/0xc0 Aug 22 20:25:38 juju-e4d256-prod-github-runner-207 kernel: [54112.609258] __x64_sys_ioctl+0x95/0xd0 Aug 22 20:25:38 juju-e4d256-prod-github-runner-207 kernel: [54112.610048] do_syscall_64+0x5c/0xc0 Aug 22 20:25:38 juju-e4d256-prod-github-runner-207 kernel: [54112.610827] ? do_futex+0x162/0x1f0 Aug 22 20:25:38 juju-e4d256-prod-github-runner-207 kernel: [54112.611563] ? __x64_sys_futex+0x78/0x1e0 Aug 22 20:25:38 juju-e4d256-prod-github-runner-207 kernel: [54112.612327] ? __secure_computing+0xa9/0x120 Aug 22 20:25:38 juju-e4d256-prod-github-runner-207 kernel: [54112.613127] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 20:25:38 juju-e4d256-prod-github-runner-207 kernel: [54112.614005] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:25:38 juju-e4d256-prod-github-runner-207 kernel: [54112.614838] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:25:38 juju-e4d256-prod-github-runner-207 kernel: [54112.615647] ? do_syscall_64+0x69/0xc0 Aug 22 20:25:38 juju-e4d256-prod-github-runner-207 kernel: [54112.616367] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:25:38 juju-e4d256-prod-github-runner-207 kernel: [54112.617174] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:25:38 juju-e4d256-prod-github-runner-207 kernel: [54112.617982] ? do_syscall_64+0x69/0xc0 Aug 22 20:25:38 juju-e4d256-prod-github-runner-207 kernel: [54112.618698] ? do_syscall_64+0x69/0xc0 Aug 22 20:25:38 juju-e4d256-prod-github-runner-207 kernel: [54112.619394] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 20:25:38 juju-e4d256-prod-github-runner-207 kernel: [54112.620194] RIP: 0033:0x7faa5d0edaff Aug 22 20:25:38 juju-e4d256-prod-github-runner-207 kernel: [54112.620885] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 20:25:38 juju-e4d256-prod-github-runner-207 kernel: [54112.623213] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 20:25:38 juju-e4d256-prod-github-runner-207 kernel: [54112.624264] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 20:25:38 juju-e4d256-prod-github-runner-207 kernel: [54112.625288] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 20:25:38 juju-e4d256-prod-github-runner-207 kernel: [54112.626321] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 20:25:38 juju-e4d256-prod-github-runner-207 kernel: [54112.627345] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 20:25:38 juju-e4d256-prod-github-runner-207 kernel: [54112.628367] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 20:25:38 juju-e4d256-prod-github-runner-207 kernel: [54112.629393] Aug 22 20:26:06 juju-e4d256-prod-github-runner-207 kernel: [54140.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 50314s! [qemu-system-x86:6715] Aug 22 20:26:06 juju-e4d256-prod-github-runner-207 kernel: [54140.543773] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 20:26:06 juju-e4d256-prod-github-runner-207 kernel: [54140.544220] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 20:26:06 juju-e4d256-prod-github-runner-207 kernel: [54140.558389] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 20:26:06 juju-e4d256-prod-github-runner-207 kernel: [54140.561824] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 20:26:06 juju-e4d256-prod-github-runner-207 kernel: [54140.563071] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:26:06 juju-e4d256-prod-github-runner-207 kernel: [54140.564126] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 20:26:06 juju-e4d256-prod-github-runner-207 kernel: [54140.570972] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 20:26:06 juju-e4d256-prod-github-runner-207 kernel: [54140.572217] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 20:26:06 juju-e4d256-prod-github-runner-207 kernel: [54140.573440] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 20:26:06 juju-e4d256-prod-github-runner-207 kernel: [54140.574630] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 20:26:06 juju-e4d256-prod-github-runner-207 kernel: [54140.576012] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 20:26:06 juju-e4d256-prod-github-runner-207 kernel: [54140.577199] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 20:26:06 juju-e4d256-prod-github-runner-207 kernel: [54140.578400] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 20:26:06 juju-e4d256-prod-github-runner-207 kernel: [54140.579658] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 20:26:06 juju-e4d256-prod-github-runner-207 kernel: [54140.580845] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 20:26:06 juju-e4d256-prod-github-runner-207 kernel: [54140.582188] Call Trace: Aug 22 20:26:06 juju-e4d256-prod-github-runner-207 kernel: [54140.583188] Aug 22 20:26:06 juju-e4d256-prod-github-runner-207 kernel: [54140.584105] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:26:06 juju-e4d256-prod-github-runner-207 kernel: [54140.585139] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:26:06 juju-e4d256-prod-github-runner-207 kernel: [54140.586188] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:26:06 juju-e4d256-prod-github-runner-207 kernel: [54140.587284] ? show_regs.part.0+0x23/0x29 Aug 22 20:26:06 juju-e4d256-prod-github-runner-207 kernel: [54140.588280] ? show_regs.cold+0x8/0xd Aug 22 20:26:06 juju-e4d256-prod-github-runner-207 kernel: [54140.589250] ? watchdog_timer_fn+0x1be/0x220 Aug 22 20:26:06 juju-e4d256-prod-github-runner-207 kernel: [54140.590273] ? lockup_detector_update_enable+0x60/0x60 Aug 22 20:26:06 juju-e4d256-prod-github-runner-207 kernel: [54140.591342] ? __hrtimer_run_queues+0x107/0x230 Aug 22 20:26:06 juju-e4d256-prod-github-runner-207 kernel: [54140.592368] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 20:26:06 juju-e4d256-prod-github-runner-207 kernel: [54140.593401] ? hrtimer_interrupt+0x101/0x220 Aug 22 20:26:06 juju-e4d256-prod-github-runner-207 kernel: [54140.594435] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 20:26:06 juju-e4d256-prod-github-runner-207 kernel: [54140.595503] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 20:26:06 juju-e4d256-prod-github-runner-207 kernel: [54140.596548] Aug 22 20:26:06 juju-e4d256-prod-github-runner-207 kernel: [54140.597404] Aug 22 20:26:06 juju-e4d256-prod-github-runner-207 kernel: [54140.598255] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 20:26:06 juju-e4d256-prod-github-runner-207 kernel: [54140.599290] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:26:06 juju-e4d256-prod-github-runner-207 kernel: [54140.600333] ? _raw_spin_lock+0x22/0x30 Aug 22 20:26:06 juju-e4d256-prod-github-runner-207 kernel: [54140.601279] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:26:06 juju-e4d256-prod-github-runner-207 kernel: [54140.602312] direct_page_fault+0x206/0x310 [kvm] Aug 22 20:26:06 juju-e4d256-prod-github-runner-207 kernel: [54140.603344] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 20:26:06 juju-e4d256-prod-github-runner-207 kernel: [54140.604355] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 20:26:06 juju-e4d256-prod-github-runner-207 kernel: [54140.605359] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 20:26:06 juju-e4d256-prod-github-runner-207 kernel: [54140.606382] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 20:26:06 juju-e4d256-prod-github-runner-207 kernel: [54140.607336] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 20:26:06 juju-e4d256-prod-github-runner-207 kernel: [54140.608318] handle_exit+0x98/0x230 [kvm_amd] Aug 22 20:26:06 juju-e4d256-prod-github-runner-207 kernel: [54140.609213] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 20:26:06 juju-e4d256-prod-github-runner-207 kernel: [54140.610143] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 20:26:06 juju-e4d256-prod-github-runner-207 kernel: [54140.611070] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 20:26:06 juju-e4d256-prod-github-runner-207 kernel: [54140.611975] vcpu_run+0x62/0x2c0 [kvm] Aug 22 20:26:06 juju-e4d256-prod-github-runner-207 kernel: [54140.612786] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 20:26:06 juju-e4d256-prod-github-runner-207 kernel: [54140.613594] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 20:26:06 juju-e4d256-prod-github-runner-207 kernel: [54140.614462] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 20:26:06 juju-e4d256-prod-github-runner-207 kernel: [54140.615259] ? __seccomp_filter+0x4a/0x4a0 Aug 22 20:26:06 juju-e4d256-prod-github-runner-207 kernel: [54140.616007] ? __fget_files+0x86/0xc0 Aug 22 20:26:06 juju-e4d256-prod-github-runner-207 kernel: [54140.616710] __x64_sys_ioctl+0x95/0xd0 Aug 22 20:26:06 juju-e4d256-prod-github-runner-207 kernel: [54140.617404] do_syscall_64+0x5c/0xc0 Aug 22 20:26:06 juju-e4d256-prod-github-runner-207 kernel: [54140.618083] ? do_futex+0x162/0x1f0 Aug 22 20:26:06 juju-e4d256-prod-github-runner-207 kernel: [54140.618734] ? __x64_sys_futex+0x78/0x1e0 Aug 22 20:26:06 juju-e4d256-prod-github-runner-207 kernel: [54140.619410] ? __secure_computing+0xa9/0x120 Aug 22 20:26:06 juju-e4d256-prod-github-runner-207 kernel: [54140.620104] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 20:26:06 juju-e4d256-prod-github-runner-207 kernel: [54140.620865] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:26:06 juju-e4d256-prod-github-runner-207 kernel: [54140.621588] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:26:06 juju-e4d256-prod-github-runner-207 kernel: [54140.622323] ? do_syscall_64+0x69/0xc0 Aug 22 20:26:06 juju-e4d256-prod-github-runner-207 kernel: [54140.622970] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:26:06 juju-e4d256-prod-github-runner-207 kernel: [54140.623675] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:26:06 juju-e4d256-prod-github-runner-207 kernel: [54140.624372] ? do_syscall_64+0x69/0xc0 Aug 22 20:26:06 juju-e4d256-prod-github-runner-207 kernel: [54140.624996] ? do_syscall_64+0x69/0xc0 Aug 22 20:26:06 juju-e4d256-prod-github-runner-207 kernel: [54140.625620] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 20:26:06 juju-e4d256-prod-github-runner-207 kernel: [54140.626346] RIP: 0033:0x7faa5d0edaff Aug 22 20:26:06 juju-e4d256-prod-github-runner-207 kernel: [54140.627020] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 20:26:06 juju-e4d256-prod-github-runner-207 kernel: [54140.629015] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 20:26:06 juju-e4d256-prod-github-runner-207 kernel: [54140.629939] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 20:26:06 juju-e4d256-prod-github-runner-207 kernel: [54140.630829] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 20:26:06 juju-e4d256-prod-github-runner-207 kernel: [54140.631718] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 20:26:06 juju-e4d256-prod-github-runner-207 kernel: [54140.632605] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 20:26:06 juju-e4d256-prod-github-runner-207 kernel: [54140.633495] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 20:26:06 juju-e4d256-prod-github-runner-207 kernel: [54140.634401] Aug 22 20:26:34 juju-e4d256-prod-github-runner-207 kernel: [54168.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 50340s! [qemu-system-x86:6715] Aug 22 20:26:34 juju-e4d256-prod-github-runner-207 kernel: [54168.543732] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 20:26:34 juju-e4d256-prod-github-runner-207 kernel: [54168.543988] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 20:26:34 juju-e4d256-prod-github-runner-207 kernel: [54168.556060] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 20:26:34 juju-e4d256-prod-github-runner-207 kernel: [54168.557321] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 20:26:34 juju-e4d256-prod-github-runner-207 kernel: [54168.558551] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:26:34 juju-e4d256-prod-github-runner-207 kernel: [54168.559606] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 20:26:34 juju-e4d256-prod-github-runner-207 kernel: [54168.562170] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 20:26:34 juju-e4d256-prod-github-runner-207 kernel: [54168.563210] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 20:26:34 juju-e4d256-prod-github-runner-207 kernel: [54168.564373] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 20:26:34 juju-e4d256-prod-github-runner-207 kernel: [54168.565545] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 20:26:34 juju-e4d256-prod-github-runner-207 kernel: [54168.566703] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 20:26:34 juju-e4d256-prod-github-runner-207 kernel: [54168.567863] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 20:26:34 juju-e4d256-prod-github-runner-207 kernel: [54168.569026] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 20:26:34 juju-e4d256-prod-github-runner-207 kernel: [54168.570266] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 20:26:34 juju-e4d256-prod-github-runner-207 kernel: [54168.571368] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 20:26:34 juju-e4d256-prod-github-runner-207 kernel: [54168.572558] Call Trace: Aug 22 20:26:34 juju-e4d256-prod-github-runner-207 kernel: [54168.573469] Aug 22 20:26:34 juju-e4d256-prod-github-runner-207 kernel: [54168.574399] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:26:34 juju-e4d256-prod-github-runner-207 kernel: [54168.575563] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:26:34 juju-e4d256-prod-github-runner-207 kernel: [54168.576583] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:26:34 juju-e4d256-prod-github-runner-207 kernel: [54168.577692] ? show_regs.part.0+0x23/0x29 Aug 22 20:26:34 juju-e4d256-prod-github-runner-207 kernel: [54168.578687] ? show_regs.cold+0x8/0xd Aug 22 20:26:34 juju-e4d256-prod-github-runner-207 kernel: [54168.579657] ? watchdog_timer_fn+0x1be/0x220 Aug 22 20:26:34 juju-e4d256-prod-github-runner-207 kernel: [54168.580671] ? lockup_detector_update_enable+0x60/0x60 Aug 22 20:26:34 juju-e4d256-prod-github-runner-207 kernel: [54168.581757] ? __hrtimer_run_queues+0x107/0x230 Aug 22 20:26:34 juju-e4d256-prod-github-runner-207 kernel: [54168.582786] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 20:26:34 juju-e4d256-prod-github-runner-207 kernel: [54168.583813] ? hrtimer_interrupt+0x101/0x220 Aug 22 20:26:34 juju-e4d256-prod-github-runner-207 kernel: [54168.584827] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 20:26:34 juju-e4d256-prod-github-runner-207 kernel: [54168.585912] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 20:26:34 juju-e4d256-prod-github-runner-207 kernel: [54168.586964] Aug 22 20:26:34 juju-e4d256-prod-github-runner-207 kernel: [54168.587814] Aug 22 20:26:34 juju-e4d256-prod-github-runner-207 kernel: [54168.588650] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 20:26:34 juju-e4d256-prod-github-runner-207 kernel: [54168.589702] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:26:34 juju-e4d256-prod-github-runner-207 kernel: [54168.590743] ? _raw_spin_lock+0x22/0x30 Aug 22 20:26:34 juju-e4d256-prod-github-runner-207 kernel: [54168.591691] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:26:34 juju-e4d256-prod-github-runner-207 kernel: [54168.592704] direct_page_fault+0x206/0x310 [kvm] Aug 22 20:26:34 juju-e4d256-prod-github-runner-207 kernel: [54168.593733] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 20:26:34 juju-e4d256-prod-github-runner-207 kernel: [54168.594740] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 20:26:34 juju-e4d256-prod-github-runner-207 kernel: [54168.595748] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 20:26:34 juju-e4d256-prod-github-runner-207 kernel: [54168.596746] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 20:26:34 juju-e4d256-prod-github-runner-207 kernel: [54168.597707] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 20:26:34 juju-e4d256-prod-github-runner-207 kernel: [54168.598686] handle_exit+0x98/0x230 [kvm_amd] Aug 22 20:26:34 juju-e4d256-prod-github-runner-207 kernel: [54168.599579] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 20:26:34 juju-e4d256-prod-github-runner-207 kernel: [54168.600495] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 20:26:34 juju-e4d256-prod-github-runner-207 kernel: [54168.601421] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 20:26:34 juju-e4d256-prod-github-runner-207 kernel: [54168.602338] vcpu_run+0x62/0x2c0 [kvm] Aug 22 20:26:34 juju-e4d256-prod-github-runner-207 kernel: [54168.603154] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 20:26:34 juju-e4d256-prod-github-runner-207 kernel: [54168.603960] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 20:26:34 juju-e4d256-prod-github-runner-207 kernel: [54168.604813] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 20:26:34 juju-e4d256-prod-github-runner-207 kernel: [54168.605627] ? __seccomp_filter+0x4a/0x4a0 Aug 22 20:26:34 juju-e4d256-prod-github-runner-207 kernel: [54168.606372] ? __fget_files+0x86/0xc0 Aug 22 20:26:34 juju-e4d256-prod-github-runner-207 kernel: [54168.607082] __x64_sys_ioctl+0x95/0xd0 Aug 22 20:26:34 juju-e4d256-prod-github-runner-207 kernel: [54168.607784] do_syscall_64+0x5c/0xc0 Aug 22 20:26:34 juju-e4d256-prod-github-runner-207 kernel: [54168.608451] ? do_futex+0x162/0x1f0 Aug 22 20:26:34 juju-e4d256-prod-github-runner-207 kernel: [54168.609099] ? __x64_sys_futex+0x78/0x1e0 Aug 22 20:26:34 juju-e4d256-prod-github-runner-207 kernel: [54168.609786] ? __secure_computing+0xa9/0x120 Aug 22 20:26:34 juju-e4d256-prod-github-runner-207 kernel: [54168.610482] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 20:26:34 juju-e4d256-prod-github-runner-207 kernel: [54168.611251] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:26:34 juju-e4d256-prod-github-runner-207 kernel: [54168.611976] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:26:34 juju-e4d256-prod-github-runner-207 kernel: [54168.612696] ? do_syscall_64+0x69/0xc0 Aug 22 20:26:34 juju-e4d256-prod-github-runner-207 kernel: [54168.613342] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:26:34 juju-e4d256-prod-github-runner-207 kernel: [54168.614061] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:26:34 juju-e4d256-prod-github-runner-207 kernel: [54168.614757] ? do_syscall_64+0x69/0xc0 Aug 22 20:26:34 juju-e4d256-prod-github-runner-207 kernel: [54168.615389] ? do_syscall_64+0x69/0xc0 Aug 22 20:26:34 juju-e4d256-prod-github-runner-207 kernel: [54168.616011] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 20:26:34 juju-e4d256-prod-github-runner-207 kernel: [54168.616719] RIP: 0033:0x7faa5d0edaff Aug 22 20:26:34 juju-e4d256-prod-github-runner-207 kernel: [54168.617389] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 20:26:34 juju-e4d256-prod-github-runner-207 kernel: [54168.619397] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 20:26:34 juju-e4d256-prod-github-runner-207 kernel: [54168.620308] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 20:26:34 juju-e4d256-prod-github-runner-207 kernel: [54168.621198] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 20:26:34 juju-e4d256-prod-github-runner-207 kernel: [54168.622101] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 20:26:34 juju-e4d256-prod-github-runner-207 kernel: [54168.622986] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 20:26:34 juju-e4d256-prod-github-runner-207 kernel: [54168.623873] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 20:26:34 juju-e4d256-prod-github-runner-207 kernel: [54168.624767] Aug 22 20:26:46 juju-e4d256-prod-github-runner-207 kernel: [54180.800706] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 20:26:46 juju-e4d256-prod-github-runner-207 kernel: [54180.802361] rcu: 1-....: (13473341 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=6512978 Aug 22 20:26:46 juju-e4d256-prod-github-runner-207 kernel: [54180.803493] (t=13515900 jiffies g=23269 q=50287) Aug 22 20:26:46 juju-e4d256-prod-github-runner-207 kernel: [54180.804280] NMI backtrace for cpu 1 Aug 22 20:26:46 juju-e4d256-prod-github-runner-207 kernel: [54180.804987] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 20:26:46 juju-e4d256-prod-github-runner-207 kernel: [54180.806118] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 20:26:46 juju-e4d256-prod-github-runner-207 kernel: [54180.807178] Call Trace: Aug 22 20:26:46 juju-e4d256-prod-github-runner-207 kernel: [54180.807966] Aug 22 20:26:46 juju-e4d256-prod-github-runner-207 kernel: [54180.808628] show_stack+0x52/0x5c Aug 22 20:26:46 juju-e4d256-prod-github-runner-207 kernel: [54180.809352] dump_stack_lvl+0x4a/0x63 Aug 22 20:26:46 juju-e4d256-prod-github-runner-207 kernel: [54180.810108] dump_stack+0x10/0x16 Aug 22 20:26:46 juju-e4d256-prod-github-runner-207 kernel: [54180.810831] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 20:26:46 juju-e4d256-prod-github-runner-207 kernel: [54180.811616] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 20:26:46 juju-e4d256-prod-github-runner-207 kernel: [54180.812388] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 20:26:46 juju-e4d256-prod-github-runner-207 kernel: [54180.813203] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 20:26:46 juju-e4d256-prod-github-runner-207 kernel: [54180.814037] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 20:26:46 juju-e4d256-prod-github-runner-207 kernel: [54180.814858] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 20:26:46 juju-e4d256-prod-github-runner-207 kernel: [54180.815628] print_cpu_stall.cold+0x2f/0xe2 Aug 22 20:26:46 juju-e4d256-prod-github-runner-207 kernel: [54180.816416] ? timekeeping_update+0xf7/0x150 Aug 22 20:26:46 juju-e4d256-prod-github-runner-207 kernel: [54180.817186] check_cpu_stall+0x109/0x270 Aug 22 20:26:46 juju-e4d256-prod-github-runner-207 kernel: [54180.817981] rcu_sched_clock_irq+0x9a/0x250 Aug 22 20:26:46 juju-e4d256-prod-github-runner-207 kernel: [54180.818750] update_process_times+0x94/0xd0 Aug 22 20:26:46 juju-e4d256-prod-github-runner-207 kernel: [54180.819508] tick_sched_handle+0x29/0x70 Aug 22 20:26:46 juju-e4d256-prod-github-runner-207 kernel: [54180.820250] tick_sched_timer+0x8c/0xc0 Aug 22 20:26:46 juju-e4d256-prod-github-runner-207 kernel: [54180.821006] ? tick_nohz_handler+0xb0/0xb0 Aug 22 20:26:46 juju-e4d256-prod-github-runner-207 kernel: [54180.821796] __hrtimer_run_queues+0x107/0x230 Aug 22 20:26:46 juju-e4d256-prod-github-runner-207 kernel: [54180.822592] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 20:26:46 juju-e4d256-prod-github-runner-207 kernel: [54180.823382] hrtimer_interrupt+0x101/0x220 Aug 22 20:26:46 juju-e4d256-prod-github-runner-207 kernel: [54180.824143] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 20:26:46 juju-e4d256-prod-github-runner-207 kernel: [54180.824959] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 20:26:46 juju-e4d256-prod-github-runner-207 kernel: [54180.825797] Aug 22 20:26:46 juju-e4d256-prod-github-runner-207 kernel: [54180.826444] Aug 22 20:26:46 juju-e4d256-prod-github-runner-207 kernel: [54180.827091] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 20:26:46 juju-e4d256-prod-github-runner-207 kernel: [54180.827909] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:26:46 juju-e4d256-prod-github-runner-207 kernel: [54180.828810] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 20:26:46 juju-e4d256-prod-github-runner-207 kernel: [54180.831025] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 20:26:46 juju-e4d256-prod-github-runner-207 kernel: [54180.831897] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 20:26:46 juju-e4d256-prod-github-runner-207 kernel: [54180.832890] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 20:26:46 juju-e4d256-prod-github-runner-207 kernel: [54180.833882] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 20:26:46 juju-e4d256-prod-github-runner-207 kernel: [54180.834846] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 20:26:46 juju-e4d256-prod-github-runner-207 kernel: [54180.835809] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 20:26:46 juju-e4d256-prod-github-runner-207 kernel: [54180.836851] ? _raw_spin_lock+0x22/0x30 Aug 22 20:26:46 juju-e4d256-prod-github-runner-207 kernel: [54180.837629] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:26:46 juju-e4d256-prod-github-runner-207 kernel: [54180.838553] direct_page_fault+0x206/0x310 [kvm] Aug 22 20:26:46 juju-e4d256-prod-github-runner-207 kernel: [54180.839441] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 20:26:46 juju-e4d256-prod-github-runner-207 kernel: [54180.840270] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 20:26:46 juju-e4d256-prod-github-runner-207 kernel: [54180.841102] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 20:26:46 juju-e4d256-prod-github-runner-207 kernel: [54180.841944] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 20:26:46 juju-e4d256-prod-github-runner-207 kernel: [54180.842724] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 20:26:46 juju-e4d256-prod-github-runner-207 kernel: [54180.843542] handle_exit+0x98/0x230 [kvm_amd] Aug 22 20:26:46 juju-e4d256-prod-github-runner-207 kernel: [54180.844291] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 20:26:46 juju-e4d256-prod-github-runner-207 kernel: [54180.845069] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 20:26:46 juju-e4d256-prod-github-runner-207 kernel: [54180.845877] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 20:26:46 juju-e4d256-prod-github-runner-207 kernel: [54180.846657] vcpu_run+0x62/0x2c0 [kvm] Aug 22 20:26:46 juju-e4d256-prod-github-runner-207 kernel: [54180.847368] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 20:26:46 juju-e4d256-prod-github-runner-207 kernel: [54180.848099] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 20:26:46 juju-e4d256-prod-github-runner-207 kernel: [54180.848914] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 20:26:46 juju-e4d256-prod-github-runner-207 kernel: [54180.849693] ? __seccomp_filter+0x4a/0x4a0 Aug 22 20:26:46 juju-e4d256-prod-github-runner-207 kernel: [54180.850414] ? __fget_files+0x86/0xc0 Aug 22 20:26:46 juju-e4d256-prod-github-runner-207 kernel: [54180.851104] __x64_sys_ioctl+0x95/0xd0 Aug 22 20:26:46 juju-e4d256-prod-github-runner-207 kernel: [54180.851798] do_syscall_64+0x5c/0xc0 Aug 22 20:26:46 juju-e4d256-prod-github-runner-207 kernel: [54180.852475] ? do_futex+0x162/0x1f0 Aug 22 20:26:46 juju-e4d256-prod-github-runner-207 kernel: [54180.853145] ? __x64_sys_futex+0x78/0x1e0 Aug 22 20:26:46 juju-e4d256-prod-github-runner-207 kernel: [54180.853855] ? __secure_computing+0xa9/0x120 Aug 22 20:26:46 juju-e4d256-prod-github-runner-207 kernel: [54180.854573] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 20:26:46 juju-e4d256-prod-github-runner-207 kernel: [54180.855360] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:26:46 juju-e4d256-prod-github-runner-207 kernel: [54180.856112] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:26:46 juju-e4d256-prod-github-runner-207 kernel: [54180.856864] ? do_syscall_64+0x69/0xc0 Aug 22 20:26:46 juju-e4d256-prod-github-runner-207 kernel: [54180.857557] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:26:46 juju-e4d256-prod-github-runner-207 kernel: [54180.858311] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:26:46 juju-e4d256-prod-github-runner-207 kernel: [54180.859078] ? do_syscall_64+0x69/0xc0 Aug 22 20:26:46 juju-e4d256-prod-github-runner-207 kernel: [54180.859778] ? do_syscall_64+0x69/0xc0 Aug 22 20:26:46 juju-e4d256-prod-github-runner-207 kernel: [54180.860462] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 20:26:46 juju-e4d256-prod-github-runner-207 kernel: [54180.861232] RIP: 0033:0x7faa5d0edaff Aug 22 20:26:46 juju-e4d256-prod-github-runner-207 kernel: [54180.861938] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 20:26:46 juju-e4d256-prod-github-runner-207 kernel: [54180.864037] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 20:26:46 juju-e4d256-prod-github-runner-207 kernel: [54180.864995] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 20:26:46 juju-e4d256-prod-github-runner-207 kernel: [54180.865979] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 20:26:46 juju-e4d256-prod-github-runner-207 kernel: [54180.866934] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 20:26:46 juju-e4d256-prod-github-runner-207 kernel: [54180.867872] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 20:26:46 juju-e4d256-prod-github-runner-207 kernel: [54180.868796] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 20:26:46 juju-e4d256-prod-github-runner-207 kernel: [54180.869785] Aug 22 20:27:14 juju-e4d256-prod-github-runner-207 kernel: [54208.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 50377s! [qemu-system-x86:6715] Aug 22 20:27:14 juju-e4d256-prod-github-runner-207 kernel: [54208.543073] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 20:27:14 juju-e4d256-prod-github-runner-207 kernel: [54208.543384] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 20:27:14 juju-e4d256-prod-github-runner-207 kernel: [54208.555074] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 20:27:14 juju-e4d256-prod-github-runner-207 kernel: [54208.556294] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 20:27:14 juju-e4d256-prod-github-runner-207 kernel: [54208.557489] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:27:14 juju-e4d256-prod-github-runner-207 kernel: [54208.558522] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 20:27:14 juju-e4d256-prod-github-runner-207 kernel: [54208.560985] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 20:27:14 juju-e4d256-prod-github-runner-207 kernel: [54208.562020] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 20:27:14 juju-e4d256-prod-github-runner-207 kernel: [54208.563152] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 20:27:14 juju-e4d256-prod-github-runner-207 kernel: [54208.564282] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 20:27:14 juju-e4d256-prod-github-runner-207 kernel: [54208.565444] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 20:27:14 juju-e4d256-prod-github-runner-207 kernel: [54208.566579] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 20:27:14 juju-e4d256-prod-github-runner-207 kernel: [54208.567717] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 20:27:14 juju-e4d256-prod-github-runner-207 kernel: [54208.568915] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 20:27:14 juju-e4d256-prod-github-runner-207 kernel: [54208.570143] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 20:27:14 juju-e4d256-prod-github-runner-207 kernel: [54208.571333] Call Trace: Aug 22 20:27:14 juju-e4d256-prod-github-runner-207 kernel: [54208.572249] Aug 22 20:27:14 juju-e4d256-prod-github-runner-207 kernel: [54208.573199] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:27:14 juju-e4d256-prod-github-runner-207 kernel: [54208.574250] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:27:14 juju-e4d256-prod-github-runner-207 kernel: [54208.575272] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:27:14 juju-e4d256-prod-github-runner-207 kernel: [54208.576347] ? show_regs.part.0+0x23/0x29 Aug 22 20:27:14 juju-e4d256-prod-github-runner-207 kernel: [54208.577404] ? show_regs.cold+0x8/0xd Aug 22 20:27:14 juju-e4d256-prod-github-runner-207 kernel: [54208.578377] ? watchdog_timer_fn+0x1be/0x220 Aug 22 20:27:14 juju-e4d256-prod-github-runner-207 kernel: [54208.579383] ? lockup_detector_update_enable+0x60/0x60 Aug 22 20:27:14 juju-e4d256-prod-github-runner-207 kernel: [54208.580447] ? __hrtimer_run_queues+0x107/0x230 Aug 22 20:27:14 juju-e4d256-prod-github-runner-207 kernel: [54208.581589] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 20:27:14 juju-e4d256-prod-github-runner-207 kernel: [54208.582615] ? hrtimer_interrupt+0x101/0x220 Aug 22 20:27:14 juju-e4d256-prod-github-runner-207 kernel: [54208.583629] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 20:27:14 juju-e4d256-prod-github-runner-207 kernel: [54208.584697] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 20:27:14 juju-e4d256-prod-github-runner-207 kernel: [54208.585850] Aug 22 20:27:14 juju-e4d256-prod-github-runner-207 kernel: [54208.586705] Aug 22 20:27:14 juju-e4d256-prod-github-runner-207 kernel: [54208.587542] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 20:27:14 juju-e4d256-prod-github-runner-207 kernel: [54208.588575] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:27:14 juju-e4d256-prod-github-runner-207 kernel: [54208.589677] ? _raw_spin_lock+0x22/0x30 Aug 22 20:27:14 juju-e4d256-prod-github-runner-207 kernel: [54208.590625] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:27:14 juju-e4d256-prod-github-runner-207 kernel: [54208.591644] direct_page_fault+0x206/0x310 [kvm] Aug 22 20:27:14 juju-e4d256-prod-github-runner-207 kernel: [54208.592669] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 20:27:14 juju-e4d256-prod-github-runner-207 kernel: [54208.593745] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 20:27:14 juju-e4d256-prod-github-runner-207 kernel: [54208.594748] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 20:27:14 juju-e4d256-prod-github-runner-207 kernel: [54208.595722] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 20:27:14 juju-e4d256-prod-github-runner-207 kernel: [54208.596669] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 20:27:14 juju-e4d256-prod-github-runner-207 kernel: [54208.597706] handle_exit+0x98/0x230 [kvm_amd] Aug 22 20:27:14 juju-e4d256-prod-github-runner-207 kernel: [54208.598600] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 20:27:14 juju-e4d256-prod-github-runner-207 kernel: [54208.599518] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 20:27:14 juju-e4d256-prod-github-runner-207 kernel: [54208.600441] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 20:27:14 juju-e4d256-prod-github-runner-207 kernel: [54208.601415] vcpu_run+0x62/0x2c0 [kvm] Aug 22 20:27:14 juju-e4d256-prod-github-runner-207 kernel: [54208.602230] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 20:27:14 juju-e4d256-prod-github-runner-207 kernel: [54208.603037] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 20:27:14 juju-e4d256-prod-github-runner-207 kernel: [54208.603890] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 20:27:14 juju-e4d256-prod-github-runner-207 kernel: [54208.604687] ? __seccomp_filter+0x4a/0x4a0 Aug 22 20:27:14 juju-e4d256-prod-github-runner-207 kernel: [54208.605486] ? __fget_files+0x86/0xc0 Aug 22 20:27:14 juju-e4d256-prod-github-runner-207 kernel: [54208.606195] __x64_sys_ioctl+0x95/0xd0 Aug 22 20:27:14 juju-e4d256-prod-github-runner-207 kernel: [54208.606891] do_syscall_64+0x5c/0xc0 Aug 22 20:27:14 juju-e4d256-prod-github-runner-207 kernel: [54208.607554] ? do_futex+0x162/0x1f0 Aug 22 20:27:14 juju-e4d256-prod-github-runner-207 kernel: [54208.608203] ? __x64_sys_futex+0x78/0x1e0 Aug 22 20:27:14 juju-e4d256-prod-github-runner-207 kernel: [54208.608877] ? __secure_computing+0xa9/0x120 Aug 22 20:27:14 juju-e4d256-prod-github-runner-207 kernel: [54208.609637] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 20:27:14 juju-e4d256-prod-github-runner-207 kernel: [54208.610401] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:27:14 juju-e4d256-prod-github-runner-207 kernel: [54208.611124] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:27:14 juju-e4d256-prod-github-runner-207 kernel: [54208.611843] ? do_syscall_64+0x69/0xc0 Aug 22 20:27:14 juju-e4d256-prod-github-runner-207 kernel: [54208.612488] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:27:14 juju-e4d256-prod-github-runner-207 kernel: [54208.613272] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:27:14 juju-e4d256-prod-github-runner-207 kernel: [54208.613972] ? do_syscall_64+0x69/0xc0 Aug 22 20:27:14 juju-e4d256-prod-github-runner-207 kernel: [54208.614596] ? do_syscall_64+0x69/0xc0 Aug 22 20:27:14 juju-e4d256-prod-github-runner-207 kernel: [54208.615216] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 20:27:14 juju-e4d256-prod-github-runner-207 kernel: [54208.615918] RIP: 0033:0x7faa5d0edaff Aug 22 20:27:14 juju-e4d256-prod-github-runner-207 kernel: [54208.616539] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 20:27:14 juju-e4d256-prod-github-runner-207 kernel: [54208.618575] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 20:27:14 juju-e4d256-prod-github-runner-207 kernel: [54208.619483] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 20:27:14 juju-e4d256-prod-github-runner-207 kernel: [54208.620369] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 20:27:14 juju-e4d256-prod-github-runner-207 kernel: [54208.621331] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 20:27:14 juju-e4d256-prod-github-runner-207 kernel: [54208.622223] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 20:27:14 juju-e4d256-prod-github-runner-207 kernel: [54208.623111] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 20:27:14 juju-e4d256-prod-github-runner-207 kernel: [54208.624002] Aug 22 20:27:42 juju-e4d256-prod-github-runner-207 kernel: [54236.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 50403s! [qemu-system-x86:6715] Aug 22 20:27:42 juju-e4d256-prod-github-runner-207 kernel: [54236.543754] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 20:27:42 juju-e4d256-prod-github-runner-207 kernel: [54236.544018] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 20:27:42 juju-e4d256-prod-github-runner-207 kernel: [54236.556115] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 20:27:42 juju-e4d256-prod-github-runner-207 kernel: [54236.557426] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 20:27:42 juju-e4d256-prod-github-runner-207 kernel: [54236.558667] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:27:42 juju-e4d256-prod-github-runner-207 kernel: [54236.559740] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 20:27:42 juju-e4d256-prod-github-runner-207 kernel: [54236.562312] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 20:27:42 juju-e4d256-prod-github-runner-207 kernel: [54236.563355] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 20:27:42 juju-e4d256-prod-github-runner-207 kernel: [54236.564516] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 20:27:42 juju-e4d256-prod-github-runner-207 kernel: [54236.565704] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 20:27:42 juju-e4d256-prod-github-runner-207 kernel: [54236.566864] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 20:27:42 juju-e4d256-prod-github-runner-207 kernel: [54236.568026] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 20:27:42 juju-e4d256-prod-github-runner-207 kernel: [54236.569206] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 20:27:42 juju-e4d256-prod-github-runner-207 kernel: [54236.570442] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 20:27:42 juju-e4d256-prod-github-runner-207 kernel: [54236.571539] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 20:27:42 juju-e4d256-prod-github-runner-207 kernel: [54236.572748] Call Trace: Aug 22 20:27:42 juju-e4d256-prod-github-runner-207 kernel: [54236.573801] Aug 22 20:27:42 juju-e4d256-prod-github-runner-207 kernel: [54236.574715] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:27:42 juju-e4d256-prod-github-runner-207 kernel: [54236.575779] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:27:42 juju-e4d256-prod-github-runner-207 kernel: [54236.576816] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:27:42 juju-e4d256-prod-github-runner-207 kernel: [54236.577918] ? show_regs.part.0+0x23/0x29 Aug 22 20:27:42 juju-e4d256-prod-github-runner-207 kernel: [54236.578920] ? show_regs.cold+0x8/0xd Aug 22 20:27:42 juju-e4d256-prod-github-runner-207 kernel: [54236.579894] ? watchdog_timer_fn+0x1be/0x220 Aug 22 20:27:42 juju-e4d256-prod-github-runner-207 kernel: [54236.580919] ? lockup_detector_update_enable+0x60/0x60 Aug 22 20:27:42 juju-e4d256-prod-github-runner-207 kernel: [54236.581986] ? __hrtimer_run_queues+0x107/0x230 Aug 22 20:27:42 juju-e4d256-prod-github-runner-207 kernel: [54236.583014] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 20:27:42 juju-e4d256-prod-github-runner-207 kernel: [54236.584037] ? hrtimer_interrupt+0x101/0x220 Aug 22 20:27:42 juju-e4d256-prod-github-runner-207 kernel: [54236.585069] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 20:27:42 juju-e4d256-prod-github-runner-207 kernel: [54236.586137] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 20:27:42 juju-e4d256-prod-github-runner-207 kernel: [54236.587182] Aug 22 20:27:42 juju-e4d256-prod-github-runner-207 kernel: [54236.588035] Aug 22 20:27:42 juju-e4d256-prod-github-runner-207 kernel: [54236.588881] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 20:27:42 juju-e4d256-prod-github-runner-207 kernel: [54236.589920] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:27:42 juju-e4d256-prod-github-runner-207 kernel: [54236.590962] ? _raw_spin_lock+0x22/0x30 Aug 22 20:27:42 juju-e4d256-prod-github-runner-207 kernel: [54236.591909] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:27:42 juju-e4d256-prod-github-runner-207 kernel: [54236.592940] direct_page_fault+0x206/0x310 [kvm] Aug 22 20:27:42 juju-e4d256-prod-github-runner-207 kernel: [54236.593969] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 20:27:42 juju-e4d256-prod-github-runner-207 kernel: [54236.594976] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 20:27:42 juju-e4d256-prod-github-runner-207 kernel: [54236.595981] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 20:27:42 juju-e4d256-prod-github-runner-207 kernel: [54236.597001] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 20:27:42 juju-e4d256-prod-github-runner-207 kernel: [54236.597947] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 20:27:42 juju-e4d256-prod-github-runner-207 kernel: [54236.598925] handle_exit+0x98/0x230 [kvm_amd] Aug 22 20:27:42 juju-e4d256-prod-github-runner-207 kernel: [54236.599820] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 20:27:42 juju-e4d256-prod-github-runner-207 kernel: [54236.600744] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 20:27:42 juju-e4d256-prod-github-runner-207 kernel: [54236.601674] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 20:27:42 juju-e4d256-prod-github-runner-207 kernel: [54236.602576] vcpu_run+0x62/0x2c0 [kvm] Aug 22 20:27:42 juju-e4d256-prod-github-runner-207 kernel: [54236.603397] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 20:27:42 juju-e4d256-prod-github-runner-207 kernel: [54236.604219] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 20:27:42 juju-e4d256-prod-github-runner-207 kernel: [54236.605094] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 20:27:42 juju-e4d256-prod-github-runner-207 kernel: [54236.605893] ? __seccomp_filter+0x4a/0x4a0 Aug 22 20:27:42 juju-e4d256-prod-github-runner-207 kernel: [54236.606639] ? __fget_files+0x86/0xc0 Aug 22 20:27:42 juju-e4d256-prod-github-runner-207 kernel: [54236.607348] __x64_sys_ioctl+0x95/0xd0 Aug 22 20:27:42 juju-e4d256-prod-github-runner-207 kernel: [54236.608048] do_syscall_64+0x5c/0xc0 Aug 22 20:27:42 juju-e4d256-prod-github-runner-207 kernel: [54236.608735] ? do_futex+0x162/0x1f0 Aug 22 20:27:42 juju-e4d256-prod-github-runner-207 kernel: [54236.609407] ? __x64_sys_futex+0x78/0x1e0 Aug 22 20:27:42 juju-e4d256-prod-github-runner-207 kernel: [54236.610081] ? __secure_computing+0xa9/0x120 Aug 22 20:27:42 juju-e4d256-prod-github-runner-207 kernel: [54236.610771] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 20:27:42 juju-e4d256-prod-github-runner-207 kernel: [54236.611534] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:27:42 juju-e4d256-prod-github-runner-207 kernel: [54236.612255] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:27:42 juju-e4d256-prod-github-runner-207 kernel: [54236.612995] ? do_syscall_64+0x69/0xc0 Aug 22 20:27:42 juju-e4d256-prod-github-runner-207 kernel: [54236.613643] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:27:42 juju-e4d256-prod-github-runner-207 kernel: [54236.614346] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:27:42 juju-e4d256-prod-github-runner-207 kernel: [54236.615040] ? do_syscall_64+0x69/0xc0 Aug 22 20:27:42 juju-e4d256-prod-github-runner-207 kernel: [54236.615667] ? do_syscall_64+0x69/0xc0 Aug 22 20:27:42 juju-e4d256-prod-github-runner-207 kernel: [54236.616290] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 20:27:42 juju-e4d256-prod-github-runner-207 kernel: [54236.617000] RIP: 0033:0x7faa5d0edaff Aug 22 20:27:42 juju-e4d256-prod-github-runner-207 kernel: [54236.617663] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 20:27:42 juju-e4d256-prod-github-runner-207 kernel: [54236.619650] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 20:27:42 juju-e4d256-prod-github-runner-207 kernel: [54236.620561] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 20:27:42 juju-e4d256-prod-github-runner-207 kernel: [54236.621457] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 20:27:42 juju-e4d256-prod-github-runner-207 kernel: [54236.622348] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 20:27:42 juju-e4d256-prod-github-runner-207 kernel: [54236.623239] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 20:27:42 juju-e4d256-prod-github-runner-207 kernel: [54236.624124] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 20:27:42 juju-e4d256-prod-github-runner-207 kernel: [54236.625028] Aug 22 20:28:10 juju-e4d256-prod-github-runner-207 kernel: [54264.541980] watchdog: BUG: soft lockup - CPU#1 stuck for 50429s! [qemu-system-x86:6715] Aug 22 20:28:10 juju-e4d256-prod-github-runner-207 kernel: [54264.543194] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 20:28:10 juju-e4d256-prod-github-runner-207 kernel: [54264.543268] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 20:28:10 juju-e4d256-prod-github-runner-207 kernel: [54264.555628] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 20:28:10 juju-e4d256-prod-github-runner-207 kernel: [54264.556921] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 20:28:10 juju-e4d256-prod-github-runner-207 kernel: [54264.558154] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:28:10 juju-e4d256-prod-github-runner-207 kernel: [54264.559222] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 20:28:10 juju-e4d256-prod-github-runner-207 kernel: [54264.561817] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 20:28:10 juju-e4d256-prod-github-runner-207 kernel: [54264.562876] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 20:28:10 juju-e4d256-prod-github-runner-207 kernel: [54264.564052] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 20:28:10 juju-e4d256-prod-github-runner-207 kernel: [54264.565242] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 20:28:10 juju-e4d256-prod-github-runner-207 kernel: [54264.566418] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 20:28:10 juju-e4d256-prod-github-runner-207 kernel: [54264.567590] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 20:28:10 juju-e4d256-prod-github-runner-207 kernel: [54264.568781] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 20:28:10 juju-e4d256-prod-github-runner-207 kernel: [54264.570025] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 20:28:10 juju-e4d256-prod-github-runner-207 kernel: [54264.571134] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 20:28:10 juju-e4d256-prod-github-runner-207 kernel: [54264.572390] Call Trace: Aug 22 20:28:10 juju-e4d256-prod-github-runner-207 kernel: [54264.573318] Aug 22 20:28:10 juju-e4d256-prod-github-runner-207 kernel: [54264.574208] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:28:10 juju-e4d256-prod-github-runner-207 kernel: [54264.575241] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:28:10 juju-e4d256-prod-github-runner-207 kernel: [54264.576263] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:28:10 juju-e4d256-prod-github-runner-207 kernel: [54264.577360] ? show_regs.part.0+0x23/0x29 Aug 22 20:28:10 juju-e4d256-prod-github-runner-207 kernel: [54264.578358] ? show_regs.cold+0x8/0xd Aug 22 20:28:10 juju-e4d256-prod-github-runner-207 kernel: [54264.579331] ? watchdog_timer_fn+0x1be/0x220 Aug 22 20:28:10 juju-e4d256-prod-github-runner-207 kernel: [54264.580358] ? lockup_detector_update_enable+0x60/0x60 Aug 22 20:28:10 juju-e4d256-prod-github-runner-207 kernel: [54264.581423] ? __hrtimer_run_queues+0x107/0x230 Aug 22 20:28:10 juju-e4d256-prod-github-runner-207 kernel: [54264.582457] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 20:28:10 juju-e4d256-prod-github-runner-207 kernel: [54264.583481] ? hrtimer_interrupt+0x101/0x220 Aug 22 20:28:10 juju-e4d256-prod-github-runner-207 kernel: [54264.584507] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 20:28:10 juju-e4d256-prod-github-runner-207 kernel: [54264.585583] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 20:28:10 juju-e4d256-prod-github-runner-207 kernel: [54264.586636] Aug 22 20:28:10 juju-e4d256-prod-github-runner-207 kernel: [54264.587490] Aug 22 20:28:10 juju-e4d256-prod-github-runner-207 kernel: [54264.588346] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 20:28:10 juju-e4d256-prod-github-runner-207 kernel: [54264.589381] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:28:10 juju-e4d256-prod-github-runner-207 kernel: [54264.590425] ? _raw_spin_lock+0x22/0x30 Aug 22 20:28:10 juju-e4d256-prod-github-runner-207 kernel: [54264.591370] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:28:10 juju-e4d256-prod-github-runner-207 kernel: [54264.592409] direct_page_fault+0x206/0x310 [kvm] Aug 22 20:28:10 juju-e4d256-prod-github-runner-207 kernel: [54264.593440] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 20:28:10 juju-e4d256-prod-github-runner-207 kernel: [54264.594449] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 20:28:10 juju-e4d256-prod-github-runner-207 kernel: [54264.595453] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 20:28:10 juju-e4d256-prod-github-runner-207 kernel: [54264.596442] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 20:28:10 juju-e4d256-prod-github-runner-207 kernel: [54264.597394] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 20:28:10 juju-e4d256-prod-github-runner-207 kernel: [54264.598377] handle_exit+0x98/0x230 [kvm_amd] Aug 22 20:28:10 juju-e4d256-prod-github-runner-207 kernel: [54264.599276] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 20:28:10 juju-e4d256-prod-github-runner-207 kernel: [54264.600192] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 20:28:10 juju-e4d256-prod-github-runner-207 kernel: [54264.601142] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 20:28:10 juju-e4d256-prod-github-runner-207 kernel: [54264.602055] vcpu_run+0x62/0x2c0 [kvm] Aug 22 20:28:10 juju-e4d256-prod-github-runner-207 kernel: [54264.602866] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 20:28:10 juju-e4d256-prod-github-runner-207 kernel: [54264.603680] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 20:28:10 juju-e4d256-prod-github-runner-207 kernel: [54264.604549] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 20:28:10 juju-e4d256-prod-github-runner-207 kernel: [54264.605354] ? __seccomp_filter+0x4a/0x4a0 Aug 22 20:28:10 juju-e4d256-prod-github-runner-207 kernel: [54264.606105] ? __fget_files+0x86/0xc0 Aug 22 20:28:10 juju-e4d256-prod-github-runner-207 kernel: [54264.606809] __x64_sys_ioctl+0x95/0xd0 Aug 22 20:28:10 juju-e4d256-prod-github-runner-207 kernel: [54264.607501] do_syscall_64+0x5c/0xc0 Aug 22 20:28:10 juju-e4d256-prod-github-runner-207 kernel: [54264.608173] ? do_futex+0x162/0x1f0 Aug 22 20:28:10 juju-e4d256-prod-github-runner-207 kernel: [54264.608837] ? __x64_sys_futex+0x78/0x1e0 Aug 22 20:28:10 juju-e4d256-prod-github-runner-207 kernel: [54264.609513] ? __secure_computing+0xa9/0x120 Aug 22 20:28:10 juju-e4d256-prod-github-runner-207 kernel: [54264.610204] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 20:28:10 juju-e4d256-prod-github-runner-207 kernel: [54264.610965] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:28:10 juju-e4d256-prod-github-runner-207 kernel: [54264.611687] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:28:10 juju-e4d256-prod-github-runner-207 kernel: [54264.612417] ? do_syscall_64+0x69/0xc0 Aug 22 20:28:10 juju-e4d256-prod-github-runner-207 kernel: [54264.613067] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:28:10 juju-e4d256-prod-github-runner-207 kernel: [54264.613771] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:28:10 juju-e4d256-prod-github-runner-207 kernel: [54264.614466] ? do_syscall_64+0x69/0xc0 Aug 22 20:28:10 juju-e4d256-prod-github-runner-207 kernel: [54264.615090] ? do_syscall_64+0x69/0xc0 Aug 22 20:28:10 juju-e4d256-prod-github-runner-207 kernel: [54264.615713] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 20:28:10 juju-e4d256-prod-github-runner-207 kernel: [54264.616435] RIP: 0033:0x7faa5d0edaff Aug 22 20:28:10 juju-e4d256-prod-github-runner-207 kernel: [54264.617063] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 20:28:10 juju-e4d256-prod-github-runner-207 kernel: [54264.619063] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 20:28:10 juju-e4d256-prod-github-runner-207 kernel: [54264.619976] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 20:28:10 juju-e4d256-prod-github-runner-207 kernel: [54264.620881] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 20:28:10 juju-e4d256-prod-github-runner-207 kernel: [54264.621783] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 20:28:10 juju-e4d256-prod-github-runner-207 kernel: [54264.622679] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 20:28:10 juju-e4d256-prod-github-runner-207 kernel: [54264.623606] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 20:28:10 juju-e4d256-prod-github-runner-207 kernel: [54264.624522] Aug 22 20:28:38 juju-e4d256-prod-github-runner-207 kernel: [54292.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 50455s! [qemu-system-x86:6715] Aug 22 20:28:38 juju-e4d256-prod-github-runner-207 kernel: [54292.543115] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 20:28:38 juju-e4d256-prod-github-runner-207 kernel: [54292.543186] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 20:28:38 juju-e4d256-prod-github-runner-207 kernel: [54292.555349] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 20:28:38 juju-e4d256-prod-github-runner-207 kernel: [54292.556634] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 20:28:38 juju-e4d256-prod-github-runner-207 kernel: [54292.557859] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:28:38 juju-e4d256-prod-github-runner-207 kernel: [54292.558918] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 20:28:38 juju-e4d256-prod-github-runner-207 kernel: [54292.561484] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 20:28:38 juju-e4d256-prod-github-runner-207 kernel: [54292.562529] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 20:28:38 juju-e4d256-prod-github-runner-207 kernel: [54292.563696] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 20:28:38 juju-e4d256-prod-github-runner-207 kernel: [54292.564885] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 20:28:38 juju-e4d256-prod-github-runner-207 kernel: [54292.566050] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 20:28:38 juju-e4d256-prod-github-runner-207 kernel: [54292.567209] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 20:28:38 juju-e4d256-prod-github-runner-207 kernel: [54292.568393] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 20:28:38 juju-e4d256-prod-github-runner-207 kernel: [54292.569762] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 20:28:38 juju-e4d256-prod-github-runner-207 kernel: [54292.570859] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 20:28:38 juju-e4d256-prod-github-runner-207 kernel: [54292.572070] Call Trace: Aug 22 20:28:38 juju-e4d256-prod-github-runner-207 kernel: [54292.572983] Aug 22 20:28:38 juju-e4d256-prod-github-runner-207 kernel: [54292.573869] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:28:38 juju-e4d256-prod-github-runner-207 kernel: [54292.574909] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:28:38 juju-e4d256-prod-github-runner-207 kernel: [54292.575930] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:28:38 juju-e4d256-prod-github-runner-207 kernel: [54292.577024] ? show_regs.part.0+0x23/0x29 Aug 22 20:28:38 juju-e4d256-prod-github-runner-207 kernel: [54292.578021] ? show_regs.cold+0x8/0xd Aug 22 20:28:38 juju-e4d256-prod-github-runner-207 kernel: [54292.578995] ? watchdog_timer_fn+0x1be/0x220 Aug 22 20:28:38 juju-e4d256-prod-github-runner-207 kernel: [54292.580023] ? lockup_detector_update_enable+0x60/0x60 Aug 22 20:28:38 juju-e4d256-prod-github-runner-207 kernel: [54292.581092] ? __hrtimer_run_queues+0x107/0x230 Aug 22 20:28:38 juju-e4d256-prod-github-runner-207 kernel: [54292.582121] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 20:28:38 juju-e4d256-prod-github-runner-207 kernel: [54292.583144] ? hrtimer_interrupt+0x101/0x220 Aug 22 20:28:38 juju-e4d256-prod-github-runner-207 kernel: [54292.584186] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 20:28:38 juju-e4d256-prod-github-runner-207 kernel: [54292.585259] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 20:28:38 juju-e4d256-prod-github-runner-207 kernel: [54292.586306] Aug 22 20:28:38 juju-e4d256-prod-github-runner-207 kernel: [54292.587160] Aug 22 20:28:38 juju-e4d256-prod-github-runner-207 kernel: [54292.588010] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 20:28:38 juju-e4d256-prod-github-runner-207 kernel: [54292.589044] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:28:38 juju-e4d256-prod-github-runner-207 kernel: [54292.590089] ? _raw_spin_lock+0x22/0x30 Aug 22 20:28:38 juju-e4d256-prod-github-runner-207 kernel: [54292.591036] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:28:38 juju-e4d256-prod-github-runner-207 kernel: [54292.592069] direct_page_fault+0x206/0x310 [kvm] Aug 22 20:28:38 juju-e4d256-prod-github-runner-207 kernel: [54292.593093] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 20:28:38 juju-e4d256-prod-github-runner-207 kernel: [54292.594101] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 20:28:38 juju-e4d256-prod-github-runner-207 kernel: [54292.595103] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 20:28:38 juju-e4d256-prod-github-runner-207 kernel: [54292.596090] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 20:28:38 juju-e4d256-prod-github-runner-207 kernel: [54292.597041] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 20:28:38 juju-e4d256-prod-github-runner-207 kernel: [54292.598020] handle_exit+0x98/0x230 [kvm_amd] Aug 22 20:28:38 juju-e4d256-prod-github-runner-207 kernel: [54292.598913] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 20:28:38 juju-e4d256-prod-github-runner-207 kernel: [54292.599829] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 20:28:38 juju-e4d256-prod-github-runner-207 kernel: [54292.600776] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 20:28:38 juju-e4d256-prod-github-runner-207 kernel: [54292.601681] vcpu_run+0x62/0x2c0 [kvm] Aug 22 20:28:38 juju-e4d256-prod-github-runner-207 kernel: [54292.602497] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 20:28:38 juju-e4d256-prod-github-runner-207 kernel: [54292.603306] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 20:28:38 juju-e4d256-prod-github-runner-207 kernel: [54292.604181] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 20:28:38 juju-e4d256-prod-github-runner-207 kernel: [54292.604981] ? __seccomp_filter+0x4a/0x4a0 Aug 22 20:28:38 juju-e4d256-prod-github-runner-207 kernel: [54292.605732] ? __fget_files+0x86/0xc0 Aug 22 20:28:38 juju-e4d256-prod-github-runner-207 kernel: [54292.606442] __x64_sys_ioctl+0x95/0xd0 Aug 22 20:28:38 juju-e4d256-prod-github-runner-207 kernel: [54292.607136] do_syscall_64+0x5c/0xc0 Aug 22 20:28:38 juju-e4d256-prod-github-runner-207 kernel: [54292.607807] ? do_futex+0x162/0x1f0 Aug 22 20:28:38 juju-e4d256-prod-github-runner-207 kernel: [54292.608473] ? __x64_sys_futex+0x78/0x1e0 Aug 22 20:28:38 juju-e4d256-prod-github-runner-207 kernel: [54292.609147] ? __secure_computing+0xa9/0x120 Aug 22 20:28:38 juju-e4d256-prod-github-runner-207 kernel: [54292.609837] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 20:28:38 juju-e4d256-prod-github-runner-207 kernel: [54292.610597] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:28:38 juju-e4d256-prod-github-runner-207 kernel: [54292.611322] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:28:38 juju-e4d256-prod-github-runner-207 kernel: [54292.612053] ? do_syscall_64+0x69/0xc0 Aug 22 20:28:38 juju-e4d256-prod-github-runner-207 kernel: [54292.612702] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:28:38 juju-e4d256-prod-github-runner-207 kernel: [54292.613404] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:28:38 juju-e4d256-prod-github-runner-207 kernel: [54292.614098] ? do_syscall_64+0x69/0xc0 Aug 22 20:28:38 juju-e4d256-prod-github-runner-207 kernel: [54292.614721] ? do_syscall_64+0x69/0xc0 Aug 22 20:28:38 juju-e4d256-prod-github-runner-207 kernel: [54292.615343] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 20:28:38 juju-e4d256-prod-github-runner-207 kernel: [54292.616063] RIP: 0033:0x7faa5d0edaff Aug 22 20:28:38 juju-e4d256-prod-github-runner-207 kernel: [54292.616689] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 20:28:38 juju-e4d256-prod-github-runner-207 kernel: [54292.618681] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 20:28:38 juju-e4d256-prod-github-runner-207 kernel: [54292.619590] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 20:28:38 juju-e4d256-prod-github-runner-207 kernel: [54292.620493] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 20:28:38 juju-e4d256-prod-github-runner-207 kernel: [54292.621386] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 20:28:38 juju-e4d256-prod-github-runner-207 kernel: [54292.622273] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 20:28:38 juju-e4d256-prod-github-runner-207 kernel: [54292.623159] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 20:28:38 juju-e4d256-prod-github-runner-207 kernel: [54292.624069] Aug 22 20:29:06 juju-e4d256-prod-github-runner-207 kernel: [54320.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 50481s! [qemu-system-x86:6715] Aug 22 20:29:06 juju-e4d256-prod-github-runner-207 kernel: [54320.543191] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 20:29:06 juju-e4d256-prod-github-runner-207 kernel: [54320.543397] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 20:29:06 juju-e4d256-prod-github-runner-207 kernel: [54320.555463] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 20:29:06 juju-e4d256-prod-github-runner-207 kernel: [54320.556745] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 20:29:06 juju-e4d256-prod-github-runner-207 kernel: [54320.557973] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:29:06 juju-e4d256-prod-github-runner-207 kernel: [54320.559032] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 20:29:06 juju-e4d256-prod-github-runner-207 kernel: [54320.561584] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 20:29:06 juju-e4d256-prod-github-runner-207 kernel: [54320.562632] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 20:29:06 juju-e4d256-prod-github-runner-207 kernel: [54320.563811] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 20:29:06 juju-e4d256-prod-github-runner-207 kernel: [54320.564970] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 20:29:06 juju-e4d256-prod-github-runner-207 kernel: [54320.566130] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 20:29:06 juju-e4d256-prod-github-runner-207 kernel: [54320.567289] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 20:29:06 juju-e4d256-prod-github-runner-207 kernel: [54320.568506] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 20:29:06 juju-e4d256-prod-github-runner-207 kernel: [54320.569736] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 20:29:06 juju-e4d256-prod-github-runner-207 kernel: [54320.570828] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 20:29:06 juju-e4d256-prod-github-runner-207 kernel: [54320.572034] Call Trace: Aug 22 20:29:06 juju-e4d256-prod-github-runner-207 kernel: [54320.572955] Aug 22 20:29:06 juju-e4d256-prod-github-runner-207 kernel: [54320.573839] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:29:06 juju-e4d256-prod-github-runner-207 kernel: [54320.574867] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:29:06 juju-e4d256-prod-github-runner-207 kernel: [54320.575905] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:29:06 juju-e4d256-prod-github-runner-207 kernel: [54320.577016] ? show_regs.part.0+0x23/0x29 Aug 22 20:29:06 juju-e4d256-prod-github-runner-207 kernel: [54320.578073] ? show_regs.cold+0x8/0xd Aug 22 20:29:06 juju-e4d256-prod-github-runner-207 kernel: [54320.579049] ? watchdog_timer_fn+0x1be/0x220 Aug 22 20:29:06 juju-e4d256-prod-github-runner-207 kernel: [54320.580082] ? lockup_detector_update_enable+0x60/0x60 Aug 22 20:29:06 juju-e4d256-prod-github-runner-207 kernel: [54320.581152] ? __hrtimer_run_queues+0x107/0x230 Aug 22 20:29:06 juju-e4d256-prod-github-runner-207 kernel: [54320.582179] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 20:29:06 juju-e4d256-prod-github-runner-207 kernel: [54320.583214] ? hrtimer_interrupt+0x101/0x220 Aug 22 20:29:06 juju-e4d256-prod-github-runner-207 kernel: [54320.584259] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 20:29:06 juju-e4d256-prod-github-runner-207 kernel: [54320.585339] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 20:29:06 juju-e4d256-prod-github-runner-207 kernel: [54320.586393] Aug 22 20:29:06 juju-e4d256-prod-github-runner-207 kernel: [54320.587247] Aug 22 20:29:06 juju-e4d256-prod-github-runner-207 kernel: [54320.588117] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 20:29:06 juju-e4d256-prod-github-runner-207 kernel: [54320.589162] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:29:06 juju-e4d256-prod-github-runner-207 kernel: [54320.590200] ? _raw_spin_lock+0x22/0x30 Aug 22 20:29:06 juju-e4d256-prod-github-runner-207 kernel: [54320.591145] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:29:06 juju-e4d256-prod-github-runner-207 kernel: [54320.592178] direct_page_fault+0x206/0x310 [kvm] Aug 22 20:29:06 juju-e4d256-prod-github-runner-207 kernel: [54320.593202] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 20:29:06 juju-e4d256-prod-github-runner-207 kernel: [54320.594226] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 20:29:06 juju-e4d256-prod-github-runner-207 kernel: [54320.595257] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 20:29:06 juju-e4d256-prod-github-runner-207 kernel: [54320.596271] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 20:29:06 juju-e4d256-prod-github-runner-207 kernel: [54320.597356] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 20:29:06 juju-e4d256-prod-github-runner-207 kernel: [54320.598334] handle_exit+0x98/0x230 [kvm_amd] Aug 22 20:29:06 juju-e4d256-prod-github-runner-207 kernel: [54320.599253] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 20:29:06 juju-e4d256-prod-github-runner-207 kernel: [54320.600185] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 20:29:06 juju-e4d256-prod-github-runner-207 kernel: [54320.601109] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 20:29:06 juju-e4d256-prod-github-runner-207 kernel: [54320.602011] vcpu_run+0x62/0x2c0 [kvm] Aug 22 20:29:06 juju-e4d256-prod-github-runner-207 kernel: [54320.602825] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 20:29:06 juju-e4d256-prod-github-runner-207 kernel: [54320.603646] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 20:29:06 juju-e4d256-prod-github-runner-207 kernel: [54320.604511] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 20:29:06 juju-e4d256-prod-github-runner-207 kernel: [54320.605309] ? __seccomp_filter+0x4a/0x4a0 Aug 22 20:29:06 juju-e4d256-prod-github-runner-207 kernel: [54320.606052] ? __fget_files+0x86/0xc0 Aug 22 20:29:06 juju-e4d256-prod-github-runner-207 kernel: [54320.606762] __x64_sys_ioctl+0x95/0xd0 Aug 22 20:29:06 juju-e4d256-prod-github-runner-207 kernel: [54320.607458] do_syscall_64+0x5c/0xc0 Aug 22 20:29:06 juju-e4d256-prod-github-runner-207 kernel: [54320.608138] ? do_futex+0x162/0x1f0 Aug 22 20:29:06 juju-e4d256-prod-github-runner-207 kernel: [54320.608786] ? __x64_sys_futex+0x78/0x1e0 Aug 22 20:29:06 juju-e4d256-prod-github-runner-207 kernel: [54320.609468] ? __secure_computing+0xa9/0x120 Aug 22 20:29:06 juju-e4d256-prod-github-runner-207 kernel: [54320.610160] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 20:29:06 juju-e4d256-prod-github-runner-207 kernel: [54320.611047] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:29:06 juju-e4d256-prod-github-runner-207 kernel: [54320.611781] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:29:06 juju-e4d256-prod-github-runner-207 kernel: [54320.612499] ? do_syscall_64+0x69/0xc0 Aug 22 20:29:06 juju-e4d256-prod-github-runner-207 kernel: [54320.613144] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:29:06 juju-e4d256-prod-github-runner-207 kernel: [54320.613846] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:29:06 juju-e4d256-prod-github-runner-207 kernel: [54320.614550] ? do_syscall_64+0x69/0xc0 Aug 22 20:29:06 juju-e4d256-prod-github-runner-207 kernel: [54320.615175] ? do_syscall_64+0x69/0xc0 Aug 22 20:29:06 juju-e4d256-prod-github-runner-207 kernel: [54320.615817] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 20:29:06 juju-e4d256-prod-github-runner-207 kernel: [54320.616521] RIP: 0033:0x7faa5d0edaff Aug 22 20:29:06 juju-e4d256-prod-github-runner-207 kernel: [54320.617264] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 20:29:06 juju-e4d256-prod-github-runner-207 kernel: [54320.619268] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 20:29:06 juju-e4d256-prod-github-runner-207 kernel: [54320.620201] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 20:29:06 juju-e4d256-prod-github-runner-207 kernel: [54320.621095] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 20:29:06 juju-e4d256-prod-github-runner-207 kernel: [54320.621989] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 20:29:06 juju-e4d256-prod-github-runner-207 kernel: [54320.622877] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 20:29:06 juju-e4d256-prod-github-runner-207 kernel: [54320.623784] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 20:29:06 juju-e4d256-prod-github-runner-207 kernel: [54320.624693] Aug 22 20:29:34 juju-e4d256-prod-github-runner-207 kernel: [54348.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 50508s! [qemu-system-x86:6715] Aug 22 20:29:34 juju-e4d256-prod-github-runner-207 kernel: [54348.543739] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 20:29:34 juju-e4d256-prod-github-runner-207 kernel: [54348.543924] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 20:29:34 juju-e4d256-prod-github-runner-207 kernel: [54348.556390] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 20:29:34 juju-e4d256-prod-github-runner-207 kernel: [54348.557665] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 20:29:34 juju-e4d256-prod-github-runner-207 kernel: [54348.558892] RIP: 0010:native_queued_spin_lock_slowpath+0xc/0x40 Aug 22 20:29:34 juju-e4d256-prod-github-runner-207 kernel: [54348.559967] Code: fe ff ff eb af 4c 89 fe 48 c7 c7 20 99 e9 89 e8 ca 69 55 00 e9 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 <8b> 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 eb Aug 22 20:29:34 juju-e4d256-prod-github-runner-207 kernel: [54348.562516] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 20:29:34 juju-e4d256-prod-github-runner-207 kernel: [54348.563628] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 20:29:34 juju-e4d256-prod-github-runner-207 kernel: [54348.564987] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 20:29:34 juju-e4d256-prod-github-runner-207 kernel: [54348.566163] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 20:29:34 juju-e4d256-prod-github-runner-207 kernel: [54348.567350] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 20:29:34 juju-e4d256-prod-github-runner-207 kernel: [54348.568511] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 20:29:34 juju-e4d256-prod-github-runner-207 kernel: [54348.569677] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 20:29:34 juju-e4d256-prod-github-runner-207 kernel: [54348.570907] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 20:29:34 juju-e4d256-prod-github-runner-207 kernel: [54348.572017] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 20:29:34 juju-e4d256-prod-github-runner-207 kernel: [54348.573208] Call Trace: Aug 22 20:29:34 juju-e4d256-prod-github-runner-207 kernel: [54348.574124] Aug 22 20:29:34 juju-e4d256-prod-github-runner-207 kernel: [54348.575026] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:29:34 juju-e4d256-prod-github-runner-207 kernel: [54348.576084] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:29:34 juju-e4d256-prod-github-runner-207 kernel: [54348.577112] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:29:34 juju-e4d256-prod-github-runner-207 kernel: [54348.578187] ? show_regs.part.0+0x23/0x29 Aug 22 20:29:34 juju-e4d256-prod-github-runner-207 kernel: [54348.579184] ? show_regs.cold+0x8/0xd Aug 22 20:29:34 juju-e4d256-prod-github-runner-207 kernel: [54348.580178] ? watchdog_timer_fn+0x1be/0x220 Aug 22 20:29:34 juju-e4d256-prod-github-runner-207 kernel: [54348.581188] ? lockup_detector_update_enable+0x60/0x60 Aug 22 20:29:34 juju-e4d256-prod-github-runner-207 kernel: [54348.582268] ? __hrtimer_run_queues+0x107/0x230 Aug 22 20:29:34 juju-e4d256-prod-github-runner-207 kernel: [54348.583349] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 20:29:34 juju-e4d256-prod-github-runner-207 kernel: [54348.584589] ? hrtimer_interrupt+0x101/0x220 Aug 22 20:29:34 juju-e4d256-prod-github-runner-207 kernel: [54348.585672] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 20:29:34 juju-e4d256-prod-github-runner-207 kernel: [54348.586748] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 20:29:34 juju-e4d256-prod-github-runner-207 kernel: [54348.587819] Aug 22 20:29:34 juju-e4d256-prod-github-runner-207 kernel: [54348.588675] Aug 22 20:29:34 juju-e4d256-prod-github-runner-207 kernel: [54348.589513] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 20:29:34 juju-e4d256-prod-github-runner-207 kernel: [54348.590552] ? native_queued_spin_lock_slowpath+0xc/0x40 Aug 22 20:29:34 juju-e4d256-prod-github-runner-207 kernel: [54348.591620] ? _raw_spin_lock+0x22/0x30 Aug 22 20:29:34 juju-e4d256-prod-github-runner-207 kernel: [54348.592583] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:29:34 juju-e4d256-prod-github-runner-207 kernel: [54348.593627] direct_page_fault+0x206/0x310 [kvm] Aug 22 20:29:34 juju-e4d256-prod-github-runner-207 kernel: [54348.594656] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 20:29:34 juju-e4d256-prod-github-runner-207 kernel: [54348.595709] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 20:29:34 juju-e4d256-prod-github-runner-207 kernel: [54348.596720] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 20:29:34 juju-e4d256-prod-github-runner-207 kernel: [54348.597713] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 20:29:34 juju-e4d256-prod-github-runner-207 kernel: [54348.598668] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 20:29:34 juju-e4d256-prod-github-runner-207 kernel: [54348.599663] handle_exit+0x98/0x230 [kvm_amd] Aug 22 20:29:34 juju-e4d256-prod-github-runner-207 kernel: [54348.600563] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 20:29:34 juju-e4d256-prod-github-runner-207 kernel: [54348.601491] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 20:29:34 juju-e4d256-prod-github-runner-207 kernel: [54348.602425] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 20:29:34 juju-e4d256-prod-github-runner-207 kernel: [54348.603347] vcpu_run+0x62/0x2c0 [kvm] Aug 22 20:29:34 juju-e4d256-prod-github-runner-207 kernel: [54348.604160] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 20:29:34 juju-e4d256-prod-github-runner-207 kernel: [54348.604972] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 20:29:34 juju-e4d256-prod-github-runner-207 kernel: [54348.605824] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 20:29:34 juju-e4d256-prod-github-runner-207 kernel: [54348.606620] ? __seccomp_filter+0x4a/0x4a0 Aug 22 20:29:34 juju-e4d256-prod-github-runner-207 kernel: [54348.607403] ? __fget_files+0x86/0xc0 Aug 22 20:29:34 juju-e4d256-prod-github-runner-207 kernel: [54348.608272] __x64_sys_ioctl+0x95/0xd0 Aug 22 20:29:34 juju-e4d256-prod-github-runner-207 kernel: [54348.609044] do_syscall_64+0x5c/0xc0 Aug 22 20:29:34 juju-e4d256-prod-github-runner-207 kernel: [54348.609739] ? do_futex+0x162/0x1f0 Aug 22 20:29:34 juju-e4d256-prod-github-runner-207 kernel: [54348.610402] ? __x64_sys_futex+0x78/0x1e0 Aug 22 20:29:34 juju-e4d256-prod-github-runner-207 kernel: [54348.611087] ? __secure_computing+0xa9/0x120 Aug 22 20:29:34 juju-e4d256-prod-github-runner-207 kernel: [54348.611811] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 20:29:34 juju-e4d256-prod-github-runner-207 kernel: [54348.612599] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:29:34 juju-e4d256-prod-github-runner-207 kernel: [54348.613332] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:29:34 juju-e4d256-prod-github-runner-207 kernel: [54348.614049] ? do_syscall_64+0x69/0xc0 Aug 22 20:29:34 juju-e4d256-prod-github-runner-207 kernel: [54348.614693] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:29:34 juju-e4d256-prod-github-runner-207 kernel: [54348.615419] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:29:34 juju-e4d256-prod-github-runner-207 kernel: [54348.616120] ? do_syscall_64+0x69/0xc0 Aug 22 20:29:34 juju-e4d256-prod-github-runner-207 kernel: [54348.616745] ? do_syscall_64+0x69/0xc0 Aug 22 20:29:34 juju-e4d256-prod-github-runner-207 kernel: [54348.617368] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 20:29:34 juju-e4d256-prod-github-runner-207 kernel: [54348.618077] RIP: 0033:0x7faa5d0edaff Aug 22 20:29:34 juju-e4d256-prod-github-runner-207 kernel: [54348.618729] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 20:29:34 juju-e4d256-prod-github-runner-207 kernel: [54348.620733] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 20:29:34 juju-e4d256-prod-github-runner-207 kernel: [54348.621642] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 20:29:34 juju-e4d256-prod-github-runner-207 kernel: [54348.622529] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 20:29:34 juju-e4d256-prod-github-runner-207 kernel: [54348.623426] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 20:29:34 juju-e4d256-prod-github-runner-207 kernel: [54348.624318] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 20:29:34 juju-e4d256-prod-github-runner-207 kernel: [54348.625229] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 20:29:34 juju-e4d256-prod-github-runner-207 kernel: [54348.626135] Aug 22 20:29:46 juju-e4d256-prod-github-runner-207 kernel: [54360.812707] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 20:29:46 juju-e4d256-prod-github-runner-207 kernel: [54360.813734] rcu: 1-....: (13518210 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=6534894 Aug 22 20:29:46 juju-e4d256-prod-github-runner-207 kernel: [54360.814872] (t=13560903 jiffies g=23269 q=50411) Aug 22 20:29:46 juju-e4d256-prod-github-runner-207 kernel: [54360.815684] NMI backtrace for cpu 1 Aug 22 20:29:46 juju-e4d256-prod-github-runner-207 kernel: [54360.816408] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 20:29:46 juju-e4d256-prod-github-runner-207 kernel: [54360.817518] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 20:29:46 juju-e4d256-prod-github-runner-207 kernel: [54360.818580] Call Trace: Aug 22 20:29:46 juju-e4d256-prod-github-runner-207 kernel: [54360.819264] Aug 22 20:29:46 juju-e4d256-prod-github-runner-207 kernel: [54360.819916] show_stack+0x52/0x5c Aug 22 20:29:46 juju-e4d256-prod-github-runner-207 kernel: [54360.820643] dump_stack_lvl+0x4a/0x63 Aug 22 20:29:46 juju-e4d256-prod-github-runner-207 kernel: [54360.821392] dump_stack+0x10/0x16 Aug 22 20:29:46 juju-e4d256-prod-github-runner-207 kernel: [54360.822110] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 20:29:46 juju-e4d256-prod-github-runner-207 kernel: [54360.822895] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 20:29:46 juju-e4d256-prod-github-runner-207 kernel: [54360.823689] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 20:29:46 juju-e4d256-prod-github-runner-207 kernel: [54360.824514] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 20:29:46 juju-e4d256-prod-github-runner-207 kernel: [54360.825334] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 20:29:46 juju-e4d256-prod-github-runner-207 kernel: [54360.826148] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 20:29:46 juju-e4d256-prod-github-runner-207 kernel: [54360.826920] print_cpu_stall.cold+0x2f/0xe2 Aug 22 20:29:46 juju-e4d256-prod-github-runner-207 kernel: [54360.827696] ? timekeeping_update+0xf7/0x150 Aug 22 20:29:46 juju-e4d256-prod-github-runner-207 kernel: [54360.828469] check_cpu_stall+0x109/0x270 Aug 22 20:29:46 juju-e4d256-prod-github-runner-207 kernel: [54360.829218] rcu_sched_clock_irq+0x9a/0x250 Aug 22 20:29:46 juju-e4d256-prod-github-runner-207 kernel: [54360.829979] update_process_times+0x94/0xd0 Aug 22 20:29:46 juju-e4d256-prod-github-runner-207 kernel: [54360.830741] tick_sched_handle+0x29/0x70 Aug 22 20:29:46 juju-e4d256-prod-github-runner-207 kernel: [54360.831501] tick_sched_timer+0x8c/0xc0 Aug 22 20:29:46 juju-e4d256-prod-github-runner-207 kernel: [54360.832249] ? tick_nohz_handler+0xb0/0xb0 Aug 22 20:29:46 juju-e4d256-prod-github-runner-207 kernel: [54360.833004] __hrtimer_run_queues+0x107/0x230 Aug 22 20:29:46 juju-e4d256-prod-github-runner-207 kernel: [54360.833779] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 20:29:46 juju-e4d256-prod-github-runner-207 kernel: [54360.834601] hrtimer_interrupt+0x101/0x220 Aug 22 20:29:46 juju-e4d256-prod-github-runner-207 kernel: [54360.835371] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 20:29:46 juju-e4d256-prod-github-runner-207 kernel: [54360.836187] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 20:29:46 juju-e4d256-prod-github-runner-207 kernel: [54360.836991] Aug 22 20:29:46 juju-e4d256-prod-github-runner-207 kernel: [54360.837627] Aug 22 20:29:46 juju-e4d256-prod-github-runner-207 kernel: [54360.838255] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 20:29:46 juju-e4d256-prod-github-runner-207 kernel: [54360.839077] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:29:46 juju-e4d256-prod-github-runner-207 kernel: [54360.839965] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 20:29:46 juju-e4d256-prod-github-runner-207 kernel: [54360.842178] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 20:29:46 juju-e4d256-prod-github-runner-207 kernel: [54360.843051] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 20:29:46 juju-e4d256-prod-github-runner-207 kernel: [54360.844052] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 20:29:46 juju-e4d256-prod-github-runner-207 kernel: [54360.845032] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 20:29:46 juju-e4d256-prod-github-runner-207 kernel: [54360.845996] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 20:29:46 juju-e4d256-prod-github-runner-207 kernel: [54360.846948] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 20:29:46 juju-e4d256-prod-github-runner-207 kernel: [54360.847915] ? _raw_spin_lock+0x22/0x30 Aug 22 20:29:46 juju-e4d256-prod-github-runner-207 kernel: [54360.848675] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:29:46 juju-e4d256-prod-github-runner-207 kernel: [54360.849509] direct_page_fault+0x206/0x310 [kvm] Aug 22 20:29:46 juju-e4d256-prod-github-runner-207 kernel: [54360.850346] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 20:29:46 juju-e4d256-prod-github-runner-207 kernel: [54360.851198] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 20:29:46 juju-e4d256-prod-github-runner-207 kernel: [54360.852021] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 20:29:46 juju-e4d256-prod-github-runner-207 kernel: [54360.852823] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 20:29:46 juju-e4d256-prod-github-runner-207 kernel: [54360.853606] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 20:29:46 juju-e4d256-prod-github-runner-207 kernel: [54360.854424] handle_exit+0x98/0x230 [kvm_amd] Aug 22 20:29:46 juju-e4d256-prod-github-runner-207 kernel: [54360.855254] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 20:29:46 juju-e4d256-prod-github-runner-207 kernel: [54360.856039] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 20:29:46 juju-e4d256-prod-github-runner-207 kernel: [54360.856835] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 20:29:46 juju-e4d256-prod-github-runner-207 kernel: [54360.857624] vcpu_run+0x62/0x2c0 [kvm] Aug 22 20:29:46 juju-e4d256-prod-github-runner-207 kernel: [54360.858336] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 20:29:46 juju-e4d256-prod-github-runner-207 kernel: [54360.859071] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 20:29:46 juju-e4d256-prod-github-runner-207 kernel: [54360.859885] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 20:29:46 juju-e4d256-prod-github-runner-207 kernel: [54360.860648] ? __seccomp_filter+0x4a/0x4a0 Aug 22 20:29:46 juju-e4d256-prod-github-runner-207 kernel: [54360.861372] ? __fget_files+0x86/0xc0 Aug 22 20:29:46 juju-e4d256-prod-github-runner-207 kernel: [54360.862069] __x64_sys_ioctl+0x95/0xd0 Aug 22 20:29:46 juju-e4d256-prod-github-runner-207 kernel: [54360.862773] do_syscall_64+0x5c/0xc0 Aug 22 20:29:46 juju-e4d256-prod-github-runner-207 kernel: [54360.863595] ? do_futex+0x162/0x1f0 Aug 22 20:29:46 juju-e4d256-prod-github-runner-207 kernel: [54360.864298] ? __x64_sys_futex+0x78/0x1e0 Aug 22 20:29:46 juju-e4d256-prod-github-runner-207 kernel: [54360.865003] ? __secure_computing+0xa9/0x120 Aug 22 20:29:46 juju-e4d256-prod-github-runner-207 kernel: [54360.865736] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 20:29:46 juju-e4d256-prod-github-runner-207 kernel: [54360.866522] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:29:46 juju-e4d256-prod-github-runner-207 kernel: [54360.867298] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:29:46 juju-e4d256-prod-github-runner-207 kernel: [54360.868050] ? do_syscall_64+0x69/0xc0 Aug 22 20:29:46 juju-e4d256-prod-github-runner-207 kernel: [54360.868739] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:29:46 juju-e4d256-prod-github-runner-207 kernel: [54360.869495] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:29:46 juju-e4d256-prod-github-runner-207 kernel: [54360.870254] ? do_syscall_64+0x69/0xc0 Aug 22 20:29:46 juju-e4d256-prod-github-runner-207 kernel: [54360.870948] ? do_syscall_64+0x69/0xc0 Aug 22 20:29:46 juju-e4d256-prod-github-runner-207 kernel: [54360.871639] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 20:29:46 juju-e4d256-prod-github-runner-207 kernel: [54360.872414] RIP: 0033:0x7faa5d0edaff Aug 22 20:29:46 juju-e4d256-prod-github-runner-207 kernel: [54360.873112] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 20:29:46 juju-e4d256-prod-github-runner-207 kernel: [54360.875225] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 20:29:46 juju-e4d256-prod-github-runner-207 kernel: [54360.876190] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 20:29:46 juju-e4d256-prod-github-runner-207 kernel: [54360.877134] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 20:29:46 juju-e4d256-prod-github-runner-207 kernel: [54360.878080] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 20:29:46 juju-e4d256-prod-github-runner-207 kernel: [54360.879018] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 20:29:46 juju-e4d256-prod-github-runner-207 kernel: [54360.879952] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 20:29:46 juju-e4d256-prod-github-runner-207 kernel: [54360.880863] Aug 22 20:30:14 juju-e4d256-prod-github-runner-207 kernel: [54388.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 50545s! [qemu-system-x86:6715] Aug 22 20:30:14 juju-e4d256-prod-github-runner-207 kernel: [54388.543246] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 20:30:14 juju-e4d256-prod-github-runner-207 kernel: [54388.543328] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 20:30:14 juju-e4d256-prod-github-runner-207 kernel: [54388.555813] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 20:30:14 juju-e4d256-prod-github-runner-207 kernel: [54388.557096] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 20:30:14 juju-e4d256-prod-github-runner-207 kernel: [54388.558350] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:30:14 juju-e4d256-prod-github-runner-207 kernel: [54388.559427] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 20:30:14 juju-e4d256-prod-github-runner-207 kernel: [54388.561984] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 20:30:14 juju-e4d256-prod-github-runner-207 kernel: [54388.563078] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 20:30:14 juju-e4d256-prod-github-runner-207 kernel: [54388.564267] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 20:30:14 juju-e4d256-prod-github-runner-207 kernel: [54388.565430] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 20:30:14 juju-e4d256-prod-github-runner-207 kernel: [54388.566595] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 20:30:14 juju-e4d256-prod-github-runner-207 kernel: [54388.567871] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 20:30:14 juju-e4d256-prod-github-runner-207 kernel: [54388.569127] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 20:30:14 juju-e4d256-prod-github-runner-207 kernel: [54388.570376] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 20:30:14 juju-e4d256-prod-github-runner-207 kernel: [54388.571497] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 20:30:14 juju-e4d256-prod-github-runner-207 kernel: [54388.572707] Call Trace: Aug 22 20:30:14 juju-e4d256-prod-github-runner-207 kernel: [54388.573639] Aug 22 20:30:14 juju-e4d256-prod-github-runner-207 kernel: [54388.574534] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:30:14 juju-e4d256-prod-github-runner-207 kernel: [54388.575696] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:30:14 juju-e4d256-prod-github-runner-207 kernel: [54388.576762] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:30:14 juju-e4d256-prod-github-runner-207 kernel: [54388.577893] ? show_regs.part.0+0x23/0x29 Aug 22 20:30:14 juju-e4d256-prod-github-runner-207 kernel: [54388.578923] ? show_regs.cold+0x8/0xd Aug 22 20:30:14 juju-e4d256-prod-github-runner-207 kernel: [54388.579897] ? watchdog_timer_fn+0x1be/0x220 Aug 22 20:30:14 juju-e4d256-prod-github-runner-207 kernel: [54388.580910] ? lockup_detector_update_enable+0x60/0x60 Aug 22 20:30:14 juju-e4d256-prod-github-runner-207 kernel: [54388.581974] ? __hrtimer_run_queues+0x107/0x230 Aug 22 20:30:14 juju-e4d256-prod-github-runner-207 kernel: [54388.583009] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 20:30:14 juju-e4d256-prod-github-runner-207 kernel: [54388.584038] ? hrtimer_interrupt+0x101/0x220 Aug 22 20:30:14 juju-e4d256-prod-github-runner-207 kernel: [54388.585058] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 20:30:14 juju-e4d256-prod-github-runner-207 kernel: [54388.586126] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 20:30:14 juju-e4d256-prod-github-runner-207 kernel: [54388.587183] Aug 22 20:30:14 juju-e4d256-prod-github-runner-207 kernel: [54388.588036] Aug 22 20:30:14 juju-e4d256-prod-github-runner-207 kernel: [54388.588878] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 20:30:14 juju-e4d256-prod-github-runner-207 kernel: [54388.589912] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:30:14 juju-e4d256-prod-github-runner-207 kernel: [54388.590969] ? _raw_spin_lock+0x22/0x30 Aug 22 20:30:14 juju-e4d256-prod-github-runner-207 kernel: [54388.591916] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:30:14 juju-e4d256-prod-github-runner-207 kernel: [54388.592936] direct_page_fault+0x206/0x310 [kvm] Aug 22 20:30:14 juju-e4d256-prod-github-runner-207 kernel: [54388.593959] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 20:30:14 juju-e4d256-prod-github-runner-207 kernel: [54388.594980] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 20:30:14 juju-e4d256-prod-github-runner-207 kernel: [54388.596007] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 20:30:14 juju-e4d256-prod-github-runner-207 kernel: [54388.596979] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 20:30:14 juju-e4d256-prod-github-runner-207 kernel: [54388.597924] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 20:30:14 juju-e4d256-prod-github-runner-207 kernel: [54388.598913] handle_exit+0x98/0x230 [kvm_amd] Aug 22 20:30:14 juju-e4d256-prod-github-runner-207 kernel: [54388.599811] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 20:30:14 juju-e4d256-prod-github-runner-207 kernel: [54388.600722] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 20:30:14 juju-e4d256-prod-github-runner-207 kernel: [54388.601654] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 20:30:14 juju-e4d256-prod-github-runner-207 kernel: [54388.602562] vcpu_run+0x62/0x2c0 [kvm] Aug 22 20:30:14 juju-e4d256-prod-github-runner-207 kernel: [54388.603380] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 20:30:14 juju-e4d256-prod-github-runner-207 kernel: [54388.604188] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 20:30:14 juju-e4d256-prod-github-runner-207 kernel: [54388.605041] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 20:30:14 juju-e4d256-prod-github-runner-207 kernel: [54388.605838] ? __seccomp_filter+0x4a/0x4a0 Aug 22 20:30:14 juju-e4d256-prod-github-runner-207 kernel: [54388.606586] ? __fget_files+0x86/0xc0 Aug 22 20:30:14 juju-e4d256-prod-github-runner-207 kernel: [54388.607309] __x64_sys_ioctl+0x95/0xd0 Aug 22 20:30:14 juju-e4d256-prod-github-runner-207 kernel: [54388.608025] do_syscall_64+0x5c/0xc0 Aug 22 20:30:14 juju-e4d256-prod-github-runner-207 kernel: [54388.608704] ? do_futex+0x162/0x1f0 Aug 22 20:30:14 juju-e4d256-prod-github-runner-207 kernel: [54388.609353] ? __x64_sys_futex+0x78/0x1e0 Aug 22 20:30:14 juju-e4d256-prod-github-runner-207 kernel: [54388.610025] ? __secure_computing+0xa9/0x120 Aug 22 20:30:14 juju-e4d256-prod-github-runner-207 kernel: [54388.610715] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 20:30:14 juju-e4d256-prod-github-runner-207 kernel: [54388.611483] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:30:14 juju-e4d256-prod-github-runner-207 kernel: [54388.612205] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:30:14 juju-e4d256-prod-github-runner-207 kernel: [54388.612921] ? do_syscall_64+0x69/0xc0 Aug 22 20:30:14 juju-e4d256-prod-github-runner-207 kernel: [54388.613565] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:30:14 juju-e4d256-prod-github-runner-207 kernel: [54388.614273] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:30:14 juju-e4d256-prod-github-runner-207 kernel: [54388.615148] ? do_syscall_64+0x69/0xc0 Aug 22 20:30:14 juju-e4d256-prod-github-runner-207 kernel: [54388.615905] ? do_syscall_64+0x69/0xc0 Aug 22 20:30:14 juju-e4d256-prod-github-runner-207 kernel: [54388.616527] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 20:30:14 juju-e4d256-prod-github-runner-207 kernel: [54388.617235] RIP: 0033:0x7faa5d0edaff Aug 22 20:30:14 juju-e4d256-prod-github-runner-207 kernel: [54388.617863] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 20:30:14 juju-e4d256-prod-github-runner-207 kernel: [54388.619867] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 20:30:14 juju-e4d256-prod-github-runner-207 kernel: [54388.620790] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 20:30:14 juju-e4d256-prod-github-runner-207 kernel: [54388.621681] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 20:30:14 juju-e4d256-prod-github-runner-207 kernel: [54388.622620] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 20:30:14 juju-e4d256-prod-github-runner-207 kernel: [54388.623525] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 20:30:14 juju-e4d256-prod-github-runner-207 kernel: [54388.624415] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 20:30:14 juju-e4d256-prod-github-runner-207 kernel: [54388.625316] Aug 22 20:30:42 juju-e4d256-prod-github-runner-207 kernel: [54416.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 50571s! [qemu-system-x86:6715] Aug 22 20:30:42 juju-e4d256-prod-github-runner-207 kernel: [54416.543998] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 20:30:42 juju-e4d256-prod-github-runner-207 kernel: [54416.544320] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 20:30:42 juju-e4d256-prod-github-runner-207 kernel: [54416.556607] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 20:30:42 juju-e4d256-prod-github-runner-207 kernel: [54416.557891] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 20:30:42 juju-e4d256-prod-github-runner-207 kernel: [54416.559131] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:30:42 juju-e4d256-prod-github-runner-207 kernel: [54416.560190] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 20:30:42 juju-e4d256-prod-github-runner-207 kernel: [54416.564995] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 20:30:42 juju-e4d256-prod-github-runner-207 kernel: [54416.566119] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 20:30:42 juju-e4d256-prod-github-runner-207 kernel: [54416.567292] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 20:30:42 juju-e4d256-prod-github-runner-207 kernel: [54416.568451] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 20:30:42 juju-e4d256-prod-github-runner-207 kernel: [54416.569617] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 20:30:42 juju-e4d256-prod-github-runner-207 kernel: [54416.570783] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 20:30:42 juju-e4d256-prod-github-runner-207 kernel: [54416.571951] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 20:30:42 juju-e4d256-prod-github-runner-207 kernel: [54416.573188] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 20:30:42 juju-e4d256-prod-github-runner-207 kernel: [54416.574285] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 20:30:42 juju-e4d256-prod-github-runner-207 kernel: [54416.575500] Call Trace: Aug 22 20:30:42 juju-e4d256-prod-github-runner-207 kernel: [54416.576466] Aug 22 20:30:42 juju-e4d256-prod-github-runner-207 kernel: [54416.577385] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:30:42 juju-e4d256-prod-github-runner-207 kernel: [54416.578441] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:30:42 juju-e4d256-prod-github-runner-207 kernel: [54416.579480] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:30:42 juju-e4d256-prod-github-runner-207 kernel: [54416.580594] ? show_regs.part.0+0x23/0x29 Aug 22 20:30:42 juju-e4d256-prod-github-runner-207 kernel: [54416.581800] ? show_regs.cold+0x8/0xd Aug 22 20:30:42 juju-e4d256-prod-github-runner-207 kernel: [54416.582910] ? watchdog_timer_fn+0x1be/0x220 Aug 22 20:30:42 juju-e4d256-prod-github-runner-207 kernel: [54416.584018] ? lockup_detector_update_enable+0x60/0x60 Aug 22 20:30:42 juju-e4d256-prod-github-runner-207 kernel: [54416.585190] ? __hrtimer_run_queues+0x107/0x230 Aug 22 20:30:42 juju-e4d256-prod-github-runner-207 kernel: [54416.586309] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 20:30:42 juju-e4d256-prod-github-runner-207 kernel: [54416.587452] ? hrtimer_interrupt+0x101/0x220 Aug 22 20:30:42 juju-e4d256-prod-github-runner-207 kernel: [54416.588569] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 20:30:42 juju-e4d256-prod-github-runner-207 kernel: [54416.589743] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 20:30:42 juju-e4d256-prod-github-runner-207 kernel: [54416.590942] Aug 22 20:30:42 juju-e4d256-prod-github-runner-207 kernel: [54416.592011] Aug 22 20:30:42 juju-e4d256-prod-github-runner-207 kernel: [54416.592905] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 20:30:42 juju-e4d256-prod-github-runner-207 kernel: [54416.594037] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:30:42 juju-e4d256-prod-github-runner-207 kernel: [54416.595233] ? _raw_spin_lock+0x22/0x30 Aug 22 20:30:42 juju-e4d256-prod-github-runner-207 kernel: [54416.596311] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:30:42 juju-e4d256-prod-github-runner-207 kernel: [54416.597449] direct_page_fault+0x206/0x310 [kvm] Aug 22 20:30:42 juju-e4d256-prod-github-runner-207 kernel: [54416.598580] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 20:30:42 juju-e4d256-prod-github-runner-207 kernel: [54416.599678] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 20:30:42 juju-e4d256-prod-github-runner-207 kernel: [54416.600767] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 20:30:42 juju-e4d256-prod-github-runner-207 kernel: [54416.601880] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 20:30:42 juju-e4d256-prod-github-runner-207 kernel: [54416.602960] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 20:30:42 juju-e4d256-prod-github-runner-207 kernel: [54416.604051] handle_exit+0x98/0x230 [kvm_amd] Aug 22 20:30:42 juju-e4d256-prod-github-runner-207 kernel: [54416.605027] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 20:30:42 juju-e4d256-prod-github-runner-207 kernel: [54416.606031] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 20:30:42 juju-e4d256-prod-github-runner-207 kernel: [54416.607129] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 20:30:42 juju-e4d256-prod-github-runner-207 kernel: [54416.608133] vcpu_run+0x62/0x2c0 [kvm] Aug 22 20:30:42 juju-e4d256-prod-github-runner-207 kernel: [54416.609032] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 20:30:42 juju-e4d256-prod-github-runner-207 kernel: [54416.609943] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 20:30:42 juju-e4d256-prod-github-runner-207 kernel: [54416.610908] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 20:30:42 juju-e4d256-prod-github-runner-207 kernel: [54416.611790] ? __seccomp_filter+0x4a/0x4a0 Aug 22 20:30:42 juju-e4d256-prod-github-runner-207 kernel: [54416.612622] ? __fget_files+0x86/0xc0 Aug 22 20:30:42 juju-e4d256-prod-github-runner-207 kernel: [54416.613399] __x64_sys_ioctl+0x95/0xd0 Aug 22 20:30:42 juju-e4d256-prod-github-runner-207 kernel: [54416.614165] do_syscall_64+0x5c/0xc0 Aug 22 20:30:42 juju-e4d256-prod-github-runner-207 kernel: [54416.614916] ? do_futex+0x162/0x1f0 Aug 22 20:30:42 juju-e4d256-prod-github-runner-207 kernel: [54416.615639] ? __x64_sys_futex+0x78/0x1e0 Aug 22 20:30:42 juju-e4d256-prod-github-runner-207 kernel: [54416.616396] ? __secure_computing+0xa9/0x120 Aug 22 20:30:42 juju-e4d256-prod-github-runner-207 kernel: [54416.617178] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 20:30:42 juju-e4d256-prod-github-runner-207 kernel: [54416.618042] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:30:42 juju-e4d256-prod-github-runner-207 kernel: [54416.618904] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:30:42 juju-e4d256-prod-github-runner-207 kernel: [54416.619721] ? do_syscall_64+0x69/0xc0 Aug 22 20:30:42 juju-e4d256-prod-github-runner-207 kernel: [54416.620443] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:30:42 juju-e4d256-prod-github-runner-207 kernel: [54416.621238] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:30:42 juju-e4d256-prod-github-runner-207 kernel: [54416.622024] ? do_syscall_64+0x69/0xc0 Aug 22 20:30:42 juju-e4d256-prod-github-runner-207 kernel: [54416.622748] ? do_syscall_64+0x69/0xc0 Aug 22 20:30:42 juju-e4d256-prod-github-runner-207 kernel: [54416.623518] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 20:30:42 juju-e4d256-prod-github-runner-207 kernel: [54416.624400] RIP: 0033:0x7faa5d0edaff Aug 22 20:30:42 juju-e4d256-prod-github-runner-207 kernel: [54416.625143] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 20:30:42 juju-e4d256-prod-github-runner-207 kernel: [54416.627479] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 20:30:42 juju-e4d256-prod-github-runner-207 kernel: [54416.628562] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 20:30:42 juju-e4d256-prod-github-runner-207 kernel: [54416.629580] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 20:30:42 juju-e4d256-prod-github-runner-207 kernel: [54416.630624] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 20:30:42 juju-e4d256-prod-github-runner-207 kernel: [54416.631667] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 20:30:42 juju-e4d256-prod-github-runner-207 kernel: [54416.632692] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 20:30:42 juju-e4d256-prod-github-runner-207 kernel: [54416.633714] Aug 22 20:31:10 juju-e4d256-prod-github-runner-207 kernel: [54444.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 50597s! [qemu-system-x86:6715] Aug 22 20:31:10 juju-e4d256-prod-github-runner-207 kernel: [54444.543912] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 20:31:10 juju-e4d256-prod-github-runner-207 kernel: [54444.544210] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 20:31:10 juju-e4d256-prod-github-runner-207 kernel: [54444.556308] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 20:31:10 juju-e4d256-prod-github-runner-207 kernel: [54444.557569] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 20:31:10 juju-e4d256-prod-github-runner-207 kernel: [54444.558796] RIP: 0010:native_queued_spin_lock_slowpath+0xc/0x40 Aug 22 20:31:10 juju-e4d256-prod-github-runner-207 kernel: [54444.559846] Code: fe ff ff eb af 4c 89 fe 48 c7 c7 20 99 e9 89 e8 ca 69 55 00 e9 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 <8b> 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 eb Aug 22 20:31:10 juju-e4d256-prod-github-runner-207 kernel: [54444.562388] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 20:31:10 juju-e4d256-prod-github-runner-207 kernel: [54444.563439] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 20:31:10 juju-e4d256-prod-github-runner-207 kernel: [54444.564604] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 20:31:10 juju-e4d256-prod-github-runner-207 kernel: [54444.565764] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 20:31:10 juju-e4d256-prod-github-runner-207 kernel: [54444.566936] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 20:31:10 juju-e4d256-prod-github-runner-207 kernel: [54444.568100] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 20:31:10 juju-e4d256-prod-github-runner-207 kernel: [54444.569269] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 20:31:10 juju-e4d256-prod-github-runner-207 kernel: [54444.570507] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 20:31:10 juju-e4d256-prod-github-runner-207 kernel: [54444.571612] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 20:31:10 juju-e4d256-prod-github-runner-207 kernel: [54444.572808] Call Trace: Aug 22 20:31:10 juju-e4d256-prod-github-runner-207 kernel: [54444.573720] Aug 22 20:31:10 juju-e4d256-prod-github-runner-207 kernel: [54444.574628] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:31:10 juju-e4d256-prod-github-runner-207 kernel: [54444.575659] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:31:10 juju-e4d256-prod-github-runner-207 kernel: [54444.576684] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:31:10 juju-e4d256-prod-github-runner-207 kernel: [54444.577781] ? show_regs.part.0+0x23/0x29 Aug 22 20:31:10 juju-e4d256-prod-github-runner-207 kernel: [54444.578784] ? show_regs.cold+0x8/0xd Aug 22 20:31:10 juju-e4d256-prod-github-runner-207 kernel: [54444.579759] ? watchdog_timer_fn+0x1be/0x220 Aug 22 20:31:10 juju-e4d256-prod-github-runner-207 kernel: [54444.580769] ? lockup_detector_update_enable+0x60/0x60 Aug 22 20:31:10 juju-e4d256-prod-github-runner-207 kernel: [54444.581830] ? __hrtimer_run_queues+0x107/0x230 Aug 22 20:31:10 juju-e4d256-prod-github-runner-207 kernel: [54444.582863] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 20:31:10 juju-e4d256-prod-github-runner-207 kernel: [54444.583891] ? hrtimer_interrupt+0x101/0x220 Aug 22 20:31:10 juju-e4d256-prod-github-runner-207 kernel: [54444.584903] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 20:31:10 juju-e4d256-prod-github-runner-207 kernel: [54444.585971] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 20:31:10 juju-e4d256-prod-github-runner-207 kernel: [54444.587023] Aug 22 20:31:10 juju-e4d256-prod-github-runner-207 kernel: [54444.587874] Aug 22 20:31:10 juju-e4d256-prod-github-runner-207 kernel: [54444.588709] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 20:31:10 juju-e4d256-prod-github-runner-207 kernel: [54444.589738] ? native_queued_spin_lock_slowpath+0xc/0x40 Aug 22 20:31:10 juju-e4d256-prod-github-runner-207 kernel: [54444.590782] ? _raw_spin_lock+0x22/0x30 Aug 22 20:31:10 juju-e4d256-prod-github-runner-207 kernel: [54444.591721] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:31:10 juju-e4d256-prod-github-runner-207 kernel: [54444.592733] direct_page_fault+0x206/0x310 [kvm] Aug 22 20:31:10 juju-e4d256-prod-github-runner-207 kernel: [54444.593755] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 20:31:10 juju-e4d256-prod-github-runner-207 kernel: [54444.594774] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 20:31:10 juju-e4d256-prod-github-runner-207 kernel: [54444.595768] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 20:31:10 juju-e4d256-prod-github-runner-207 kernel: [54444.596757] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 20:31:10 juju-e4d256-prod-github-runner-207 kernel: [54444.597698] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 20:31:10 juju-e4d256-prod-github-runner-207 kernel: [54444.598684] handle_exit+0x98/0x230 [kvm_amd] Aug 22 20:31:10 juju-e4d256-prod-github-runner-207 kernel: [54444.599575] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 20:31:10 juju-e4d256-prod-github-runner-207 kernel: [54444.600484] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 20:31:10 juju-e4d256-prod-github-runner-207 kernel: [54444.601411] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 20:31:10 juju-e4d256-prod-github-runner-207 kernel: [54444.602324] vcpu_run+0x62/0x2c0 [kvm] Aug 22 20:31:10 juju-e4d256-prod-github-runner-207 kernel: [54444.603138] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 20:31:10 juju-e4d256-prod-github-runner-207 kernel: [54444.603949] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 20:31:10 juju-e4d256-prod-github-runner-207 kernel: [54444.604799] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 20:31:10 juju-e4d256-prod-github-runner-207 kernel: [54444.605592] ? __seccomp_filter+0x4a/0x4a0 Aug 22 20:31:10 juju-e4d256-prod-github-runner-207 kernel: [54444.606343] ? __fget_files+0x86/0xc0 Aug 22 20:31:10 juju-e4d256-prod-github-runner-207 kernel: [54444.607050] __x64_sys_ioctl+0x95/0xd0 Aug 22 20:31:10 juju-e4d256-prod-github-runner-207 kernel: [54444.607741] do_syscall_64+0x5c/0xc0 Aug 22 20:31:10 juju-e4d256-prod-github-runner-207 kernel: [54444.608404] ? do_futex+0x162/0x1f0 Aug 22 20:31:10 juju-e4d256-prod-github-runner-207 kernel: [54444.609051] ? __x64_sys_futex+0x78/0x1e0 Aug 22 20:31:10 juju-e4d256-prod-github-runner-207 kernel: [54444.609722] ? __secure_computing+0xa9/0x120 Aug 22 20:31:10 juju-e4d256-prod-github-runner-207 kernel: [54444.610419] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 20:31:10 juju-e4d256-prod-github-runner-207 kernel: [54444.611185] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:31:10 juju-e4d256-prod-github-runner-207 kernel: [54444.611909] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:31:10 juju-e4d256-prod-github-runner-207 kernel: [54444.612628] ? do_syscall_64+0x69/0xc0 Aug 22 20:31:10 juju-e4d256-prod-github-runner-207 kernel: [54444.613273] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:31:10 juju-e4d256-prod-github-runner-207 kernel: [54444.613977] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:31:10 juju-e4d256-prod-github-runner-207 kernel: [54444.614694] ? do_syscall_64+0x69/0xc0 Aug 22 20:31:10 juju-e4d256-prod-github-runner-207 kernel: [54444.615317] ? do_syscall_64+0x69/0xc0 Aug 22 20:31:10 juju-e4d256-prod-github-runner-207 kernel: [54444.615941] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 20:31:10 juju-e4d256-prod-github-runner-207 kernel: [54444.616648] RIP: 0033:0x7faa5d0edaff Aug 22 20:31:10 juju-e4d256-prod-github-runner-207 kernel: [54444.617301] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 20:31:10 juju-e4d256-prod-github-runner-207 kernel: [54444.619293] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 20:31:10 juju-e4d256-prod-github-runner-207 kernel: [54444.620209] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 20:31:10 juju-e4d256-prod-github-runner-207 kernel: [54444.621096] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 20:31:10 juju-e4d256-prod-github-runner-207 kernel: [54444.621990] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 20:31:10 juju-e4d256-prod-github-runner-207 kernel: [54444.622885] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 20:31:10 juju-e4d256-prod-github-runner-207 kernel: [54444.623777] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 20:31:10 juju-e4d256-prod-github-runner-207 kernel: [54444.624669] Aug 22 20:31:38 juju-e4d256-prod-github-runner-207 kernel: [54472.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 50623s! [qemu-system-x86:6715] Aug 22 20:31:38 juju-e4d256-prod-github-runner-207 kernel: [54472.544050] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 20:31:38 juju-e4d256-prod-github-runner-207 kernel: [54472.544365] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 20:31:38 juju-e4d256-prod-github-runner-207 kernel: [54472.556764] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 20:31:38 juju-e4d256-prod-github-runner-207 kernel: [54472.558055] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 20:31:38 juju-e4d256-prod-github-runner-207 kernel: [54472.559277] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:31:38 juju-e4d256-prod-github-runner-207 kernel: [54472.560341] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 20:31:38 juju-e4d256-prod-github-runner-207 kernel: [54472.562963] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 20:31:38 juju-e4d256-prod-github-runner-207 kernel: [54472.564027] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 20:31:38 juju-e4d256-prod-github-runner-207 kernel: [54472.565193] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 20:31:38 juju-e4d256-prod-github-runner-207 kernel: [54472.566422] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 20:31:38 juju-e4d256-prod-github-runner-207 kernel: [54472.567595] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 20:31:38 juju-e4d256-prod-github-runner-207 kernel: [54472.568792] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 20:31:38 juju-e4d256-prod-github-runner-207 kernel: [54472.570071] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 20:31:38 juju-e4d256-prod-github-runner-207 kernel: [54472.571396] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 20:31:38 juju-e4d256-prod-github-runner-207 kernel: [54472.572515] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 20:31:38 juju-e4d256-prod-github-runner-207 kernel: [54472.573837] Call Trace: Aug 22 20:31:38 juju-e4d256-prod-github-runner-207 kernel: [54472.574804] Aug 22 20:31:38 juju-e4d256-prod-github-runner-207 kernel: [54472.575719] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:31:38 juju-e4d256-prod-github-runner-207 kernel: [54472.576767] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:31:38 juju-e4d256-prod-github-runner-207 kernel: [54472.577817] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:31:38 juju-e4d256-prod-github-runner-207 kernel: [54472.578927] ? show_regs.part.0+0x23/0x29 Aug 22 20:31:38 juju-e4d256-prod-github-runner-207 kernel: [54472.579933] ? show_regs.cold+0x8/0xd Aug 22 20:31:38 juju-e4d256-prod-github-runner-207 kernel: [54472.580972] ? watchdog_timer_fn+0x1be/0x220 Aug 22 20:31:38 juju-e4d256-prod-github-runner-207 kernel: [54472.582019] ? lockup_detector_update_enable+0x60/0x60 Aug 22 20:31:38 juju-e4d256-prod-github-runner-207 kernel: [54472.583087] ? __hrtimer_run_queues+0x107/0x230 Aug 22 20:31:38 juju-e4d256-prod-github-runner-207 kernel: [54472.584129] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 20:31:38 juju-e4d256-prod-github-runner-207 kernel: [54472.585165] ? hrtimer_interrupt+0x101/0x220 Aug 22 20:31:38 juju-e4d256-prod-github-runner-207 kernel: [54472.586307] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 20:31:38 juju-e4d256-prod-github-runner-207 kernel: [54472.587462] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 20:31:38 juju-e4d256-prod-github-runner-207 kernel: [54472.588789] Aug 22 20:31:38 juju-e4d256-prod-github-runner-207 kernel: [54472.589646] Aug 22 20:31:38 juju-e4d256-prod-github-runner-207 kernel: [54472.590510] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 20:31:38 juju-e4d256-prod-github-runner-207 kernel: [54472.591545] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:31:38 juju-e4d256-prod-github-runner-207 kernel: [54472.592589] ? _raw_spin_lock+0x22/0x30 Aug 22 20:31:38 juju-e4d256-prod-github-runner-207 kernel: [54472.593537] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:31:38 juju-e4d256-prod-github-runner-207 kernel: [54472.594584] direct_page_fault+0x206/0x310 [kvm] Aug 22 20:31:38 juju-e4d256-prod-github-runner-207 kernel: [54472.595641] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 20:31:38 juju-e4d256-prod-github-runner-207 kernel: [54472.596655] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 20:31:38 juju-e4d256-prod-github-runner-207 kernel: [54472.597657] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 20:31:38 juju-e4d256-prod-github-runner-207 kernel: [54472.598737] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 20:31:38 juju-e4d256-prod-github-runner-207 kernel: [54472.599729] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 20:31:38 juju-e4d256-prod-github-runner-207 kernel: [54472.600720] handle_exit+0x98/0x230 [kvm_amd] Aug 22 20:31:38 juju-e4d256-prod-github-runner-207 kernel: [54472.601620] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 20:31:38 juju-e4d256-prod-github-runner-207 kernel: [54472.602614] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 20:31:38 juju-e4d256-prod-github-runner-207 kernel: [54472.603559] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 20:31:38 juju-e4d256-prod-github-runner-207 kernel: [54472.604465] vcpu_run+0x62/0x2c0 [kvm] Aug 22 20:31:38 juju-e4d256-prod-github-runner-207 kernel: [54472.605278] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 20:31:38 juju-e4d256-prod-github-runner-207 kernel: [54472.606211] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 20:31:38 juju-e4d256-prod-github-runner-207 kernel: [54472.607220] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 20:31:38 juju-e4d256-prod-github-runner-207 kernel: [54472.608030] ? __seccomp_filter+0x4a/0x4a0 Aug 22 20:31:38 juju-e4d256-prod-github-runner-207 kernel: [54472.608857] ? __fget_files+0x86/0xc0 Aug 22 20:31:38 juju-e4d256-prod-github-runner-207 kernel: [54472.609797] __x64_sys_ioctl+0x95/0xd0 Aug 22 20:31:38 juju-e4d256-prod-github-runner-207 kernel: [54472.610693] do_syscall_64+0x5c/0xc0 Aug 22 20:31:38 juju-e4d256-prod-github-runner-207 kernel: [54472.611720] ? do_futex+0x162/0x1f0 Aug 22 20:31:38 juju-e4d256-prod-github-runner-207 kernel: [54472.612381] ? __x64_sys_futex+0x78/0x1e0 Aug 22 20:31:38 juju-e4d256-prod-github-runner-207 kernel: [54472.613062] ? __secure_computing+0xa9/0x120 Aug 22 20:31:38 juju-e4d256-prod-github-runner-207 kernel: [54472.613797] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 20:31:38 juju-e4d256-prod-github-runner-207 kernel: [54472.614563] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:31:38 juju-e4d256-prod-github-runner-207 kernel: [54472.615412] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:31:38 juju-e4d256-prod-github-runner-207 kernel: [54472.616236] ? do_syscall_64+0x69/0xc0 Aug 22 20:31:38 juju-e4d256-prod-github-runner-207 kernel: [54472.616887] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:31:38 juju-e4d256-prod-github-runner-207 kernel: [54472.617600] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:31:38 juju-e4d256-prod-github-runner-207 kernel: [54472.618352] ? do_syscall_64+0x69/0xc0 Aug 22 20:31:38 juju-e4d256-prod-github-runner-207 kernel: [54472.618985] ? do_syscall_64+0x69/0xc0 Aug 22 20:31:38 juju-e4d256-prod-github-runner-207 kernel: [54472.619612] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 20:31:38 juju-e4d256-prod-github-runner-207 kernel: [54472.620379] RIP: 0033:0x7faa5d0edaff Aug 22 20:31:38 juju-e4d256-prod-github-runner-207 kernel: [54472.621059] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 20:31:38 juju-e4d256-prod-github-runner-207 kernel: [54472.623081] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 20:31:38 juju-e4d256-prod-github-runner-207 kernel: [54472.624007] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 20:31:38 juju-e4d256-prod-github-runner-207 kernel: [54472.625049] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 20:31:38 juju-e4d256-prod-github-runner-207 kernel: [54472.625997] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 20:31:38 juju-e4d256-prod-github-runner-207 kernel: [54472.626923] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 20:31:38 juju-e4d256-prod-github-runner-207 kernel: [54472.627854] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 20:31:38 juju-e4d256-prod-github-runner-207 kernel: [54472.628769] Aug 22 20:32:06 juju-e4d256-prod-github-runner-207 kernel: [54500.541980] watchdog: BUG: soft lockup - CPU#1 stuck for 50649s! [qemu-system-x86:6715] Aug 22 20:32:06 juju-e4d256-prod-github-runner-207 kernel: [54500.544204] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 20:32:06 juju-e4d256-prod-github-runner-207 kernel: [54500.544508] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 20:32:06 juju-e4d256-prod-github-runner-207 kernel: [54500.557101] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 20:32:06 juju-e4d256-prod-github-runner-207 kernel: [54500.558552] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 20:32:06 juju-e4d256-prod-github-runner-207 kernel: [54500.559864] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:32:06 juju-e4d256-prod-github-runner-207 kernel: [54500.560957] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 20:32:06 juju-e4d256-prod-github-runner-207 kernel: [54500.563621] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 20:32:06 juju-e4d256-prod-github-runner-207 kernel: [54500.564696] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 20:32:06 juju-e4d256-prod-github-runner-207 kernel: [54500.565910] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 20:32:06 juju-e4d256-prod-github-runner-207 kernel: [54500.567093] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 20:32:06 juju-e4d256-prod-github-runner-207 kernel: [54500.568289] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 20:32:06 juju-e4d256-prod-github-runner-207 kernel: [54500.569492] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 20:32:06 juju-e4d256-prod-github-runner-207 kernel: [54500.570702] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 20:32:06 juju-e4d256-prod-github-runner-207 kernel: [54500.571991] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 20:32:06 juju-e4d256-prod-github-runner-207 kernel: [54500.573119] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 20:32:06 juju-e4d256-prod-github-runner-207 kernel: [54500.574350] Call Trace: Aug 22 20:32:06 juju-e4d256-prod-github-runner-207 kernel: [54500.575269] Aug 22 20:32:06 juju-e4d256-prod-github-runner-207 kernel: [54500.576179] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:32:06 juju-e4d256-prod-github-runner-207 kernel: [54500.577240] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:32:06 juju-e4d256-prod-github-runner-207 kernel: [54500.578296] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:32:06 juju-e4d256-prod-github-runner-207 kernel: [54500.579423] ? show_regs.part.0+0x23/0x29 Aug 22 20:32:06 juju-e4d256-prod-github-runner-207 kernel: [54500.580433] ? show_regs.cold+0x8/0xd Aug 22 20:32:06 juju-e4d256-prod-github-runner-207 kernel: [54500.581435] ? watchdog_timer_fn+0x1be/0x220 Aug 22 20:32:06 juju-e4d256-prod-github-runner-207 kernel: [54500.582505] ? lockup_detector_update_enable+0x60/0x60 Aug 22 20:32:06 juju-e4d256-prod-github-runner-207 kernel: [54500.583584] ? __hrtimer_run_queues+0x107/0x230 Aug 22 20:32:06 juju-e4d256-prod-github-runner-207 kernel: [54500.584626] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 20:32:06 juju-e4d256-prod-github-runner-207 kernel: [54500.585717] ? hrtimer_interrupt+0x101/0x220 Aug 22 20:32:06 juju-e4d256-prod-github-runner-207 kernel: [54500.586757] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 20:32:06 juju-e4d256-prod-github-runner-207 kernel: [54500.587843] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 20:32:06 juju-e4d256-prod-github-runner-207 kernel: [54500.588904] Aug 22 20:32:06 juju-e4d256-prod-github-runner-207 kernel: [54500.589790] Aug 22 20:32:06 juju-e4d256-prod-github-runner-207 kernel: [54500.590632] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 20:32:06 juju-e4d256-prod-github-runner-207 kernel: [54500.591714] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:32:06 juju-e4d256-prod-github-runner-207 kernel: [54500.592778] ? _raw_spin_lock+0x22/0x30 Aug 22 20:32:06 juju-e4d256-prod-github-runner-207 kernel: [54500.593757] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:32:06 juju-e4d256-prod-github-runner-207 kernel: [54500.594796] direct_page_fault+0x206/0x310 [kvm] Aug 22 20:32:06 juju-e4d256-prod-github-runner-207 kernel: [54500.595866] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 20:32:06 juju-e4d256-prod-github-runner-207 kernel: [54500.596896] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 20:32:06 juju-e4d256-prod-github-runner-207 kernel: [54500.597951] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 20:32:06 juju-e4d256-prod-github-runner-207 kernel: [54500.599016] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 20:32:06 juju-e4d256-prod-github-runner-207 kernel: [54500.599993] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 20:32:06 juju-e4d256-prod-github-runner-207 kernel: [54500.600984] handle_exit+0x98/0x230 [kvm_amd] Aug 22 20:32:06 juju-e4d256-prod-github-runner-207 kernel: [54500.601916] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 20:32:06 juju-e4d256-prod-github-runner-207 kernel: [54500.602876] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 20:32:06 juju-e4d256-prod-github-runner-207 kernel: [54500.603822] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 20:32:06 juju-e4d256-prod-github-runner-207 kernel: [54500.604737] vcpu_run+0x62/0x2c0 [kvm] Aug 22 20:32:06 juju-e4d256-prod-github-runner-207 kernel: [54500.605573] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 20:32:06 juju-e4d256-prod-github-runner-207 kernel: [54500.606500] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 20:32:06 juju-e4d256-prod-github-runner-207 kernel: [54500.607440] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 20:32:06 juju-e4d256-prod-github-runner-207 kernel: [54500.608287] ? __seccomp_filter+0x4a/0x4a0 Aug 22 20:32:06 juju-e4d256-prod-github-runner-207 kernel: [54500.609135] ? __fget_files+0x86/0xc0 Aug 22 20:32:06 juju-e4d256-prod-github-runner-207 kernel: [54500.609875] __x64_sys_ioctl+0x95/0xd0 Aug 22 20:32:06 juju-e4d256-prod-github-runner-207 kernel: [54500.610584] do_syscall_64+0x5c/0xc0 Aug 22 20:32:06 juju-e4d256-prod-github-runner-207 kernel: [54500.611263] ? do_futex+0x162/0x1f0 Aug 22 20:32:06 juju-e4d256-prod-github-runner-207 kernel: [54500.611931] ? __x64_sys_futex+0x78/0x1e0 Aug 22 20:32:06 juju-e4d256-prod-github-runner-207 kernel: [54500.612619] ? __secure_computing+0xa9/0x120 Aug 22 20:32:06 juju-e4d256-prod-github-runner-207 kernel: [54500.613362] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 20:32:06 juju-e4d256-prod-github-runner-207 kernel: [54500.614222] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:32:06 juju-e4d256-prod-github-runner-207 kernel: [54500.615015] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:32:06 juju-e4d256-prod-github-runner-207 kernel: [54500.615752] ? do_syscall_64+0x69/0xc0 Aug 22 20:32:06 juju-e4d256-prod-github-runner-207 kernel: [54500.616432] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:32:06 juju-e4d256-prod-github-runner-207 kernel: [54500.617188] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:32:06 juju-e4d256-prod-github-runner-207 kernel: [54500.617935] ? do_syscall_64+0x69/0xc0 Aug 22 20:32:06 juju-e4d256-prod-github-runner-207 kernel: [54500.618574] ? do_syscall_64+0x69/0xc0 Aug 22 20:32:06 juju-e4d256-prod-github-runner-207 kernel: [54500.619223] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 20:32:06 juju-e4d256-prod-github-runner-207 kernel: [54500.620013] RIP: 0033:0x7faa5d0edaff Aug 22 20:32:06 juju-e4d256-prod-github-runner-207 kernel: [54500.620719] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 20:32:06 juju-e4d256-prod-github-runner-207 kernel: [54500.622884] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 20:32:06 juju-e4d256-prod-github-runner-207 kernel: [54500.623835] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 20:32:06 juju-e4d256-prod-github-runner-207 kernel: [54500.624803] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 20:32:06 juju-e4d256-prod-github-runner-207 kernel: [54500.625855] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 20:32:06 juju-e4d256-prod-github-runner-207 kernel: [54500.626801] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 20:32:06 juju-e4d256-prod-github-runner-207 kernel: [54500.627742] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 20:32:06 juju-e4d256-prod-github-runner-207 kernel: [54500.628727] Aug 22 20:32:34 juju-e4d256-prod-github-runner-207 kernel: [54528.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 50675s! [qemu-system-x86:6715] Aug 22 20:32:34 juju-e4d256-prod-github-runner-207 kernel: [54528.544031] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 20:32:34 juju-e4d256-prod-github-runner-207 kernel: [54528.544322] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 20:32:34 juju-e4d256-prod-github-runner-207 kernel: [54528.556448] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 20:32:34 juju-e4d256-prod-github-runner-207 kernel: [54528.557728] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 20:32:34 juju-e4d256-prod-github-runner-207 kernel: [54528.558948] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:32:34 juju-e4d256-prod-github-runner-207 kernel: [54528.560031] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 20:32:34 juju-e4d256-prod-github-runner-207 kernel: [54528.562674] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 20:32:34 juju-e4d256-prod-github-runner-207 kernel: [54528.563713] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 20:32:34 juju-e4d256-prod-github-runner-207 kernel: [54528.564912] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 20:32:34 juju-e4d256-prod-github-runner-207 kernel: [54528.566107] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 20:32:34 juju-e4d256-prod-github-runner-207 kernel: [54528.567293] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 20:32:34 juju-e4d256-prod-github-runner-207 kernel: [54528.568451] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 20:32:34 juju-e4d256-prod-github-runner-207 kernel: [54528.569656] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 20:32:34 juju-e4d256-prod-github-runner-207 kernel: [54528.570893] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 20:32:34 juju-e4d256-prod-github-runner-207 kernel: [54528.571986] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 20:32:34 juju-e4d256-prod-github-runner-207 kernel: [54528.573197] Call Trace: Aug 22 20:32:34 juju-e4d256-prod-github-runner-207 kernel: [54528.574105] Aug 22 20:32:34 juju-e4d256-prod-github-runner-207 kernel: [54528.575002] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:32:34 juju-e4d256-prod-github-runner-207 kernel: [54528.576033] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:32:34 juju-e4d256-prod-github-runner-207 kernel: [54528.577066] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:32:34 juju-e4d256-prod-github-runner-207 kernel: [54528.578336] ? show_regs.part.0+0x23/0x29 Aug 22 20:32:34 juju-e4d256-prod-github-runner-207 kernel: [54528.579341] ? show_regs.cold+0x8/0xd Aug 22 20:32:34 juju-e4d256-prod-github-runner-207 kernel: [54528.580396] ? watchdog_timer_fn+0x1be/0x220 Aug 22 20:32:34 juju-e4d256-prod-github-runner-207 kernel: [54528.581434] ? lockup_detector_update_enable+0x60/0x60 Aug 22 20:32:34 juju-e4d256-prod-github-runner-207 kernel: [54528.582502] ? __hrtimer_run_queues+0x107/0x230 Aug 22 20:32:34 juju-e4d256-prod-github-runner-207 kernel: [54528.583567] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 20:32:34 juju-e4d256-prod-github-runner-207 kernel: [54528.584629] ? hrtimer_interrupt+0x101/0x220 Aug 22 20:32:34 juju-e4d256-prod-github-runner-207 kernel: [54528.585666] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 20:32:34 juju-e4d256-prod-github-runner-207 kernel: [54528.586735] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 20:32:34 juju-e4d256-prod-github-runner-207 kernel: [54528.587784] Aug 22 20:32:34 juju-e4d256-prod-github-runner-207 kernel: [54528.588650] Aug 22 20:32:34 juju-e4d256-prod-github-runner-207 kernel: [54528.589524] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 20:32:34 juju-e4d256-prod-github-runner-207 kernel: [54528.590561] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:32:34 juju-e4d256-prod-github-runner-207 kernel: [54528.591607] ? _raw_spin_lock+0x22/0x30 Aug 22 20:32:34 juju-e4d256-prod-github-runner-207 kernel: [54528.592551] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:32:34 juju-e4d256-prod-github-runner-207 kernel: [54528.593595] direct_page_fault+0x206/0x310 [kvm] Aug 22 20:32:34 juju-e4d256-prod-github-runner-207 kernel: [54528.594643] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 20:32:34 juju-e4d256-prod-github-runner-207 kernel: [54528.595684] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 20:32:34 juju-e4d256-prod-github-runner-207 kernel: [54528.596695] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 20:32:34 juju-e4d256-prod-github-runner-207 kernel: [54528.597721] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 20:32:34 juju-e4d256-prod-github-runner-207 kernel: [54528.598695] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 20:32:34 juju-e4d256-prod-github-runner-207 kernel: [54528.599695] handle_exit+0x98/0x230 [kvm_amd] Aug 22 20:32:34 juju-e4d256-prod-github-runner-207 kernel: [54528.600594] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 20:32:34 juju-e4d256-prod-github-runner-207 kernel: [54528.601544] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 20:32:34 juju-e4d256-prod-github-runner-207 kernel: [54528.602467] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 20:32:34 juju-e4d256-prod-github-runner-207 kernel: [54528.603374] vcpu_run+0x62/0x2c0 [kvm] Aug 22 20:32:34 juju-e4d256-prod-github-runner-207 kernel: [54528.604191] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 20:32:34 juju-e4d256-prod-github-runner-207 kernel: [54528.605015] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 20:32:34 juju-e4d256-prod-github-runner-207 kernel: [54528.605882] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 20:32:34 juju-e4d256-prod-github-runner-207 kernel: [54528.606713] ? __seccomp_filter+0x4a/0x4a0 Aug 22 20:32:34 juju-e4d256-prod-github-runner-207 kernel: [54528.607463] ? __fget_files+0x86/0xc0 Aug 22 20:32:34 juju-e4d256-prod-github-runner-207 kernel: [54528.608176] __x64_sys_ioctl+0x95/0xd0 Aug 22 20:32:34 juju-e4d256-prod-github-runner-207 kernel: [54528.608877] do_syscall_64+0x5c/0xc0 Aug 22 20:32:34 juju-e4d256-prod-github-runner-207 kernel: [54528.609581] ? do_futex+0x162/0x1f0 Aug 22 20:32:34 juju-e4d256-prod-github-runner-207 kernel: [54528.610264] ? __x64_sys_futex+0x78/0x1e0 Aug 22 20:32:34 juju-e4d256-prod-github-runner-207 kernel: [54528.610938] ? __secure_computing+0xa9/0x120 Aug 22 20:32:34 juju-e4d256-prod-github-runner-207 kernel: [54528.611628] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 20:32:34 juju-e4d256-prod-github-runner-207 kernel: [54528.612411] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:32:34 juju-e4d256-prod-github-runner-207 kernel: [54528.613166] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:32:34 juju-e4d256-prod-github-runner-207 kernel: [54528.613924] ? do_syscall_64+0x69/0xc0 Aug 22 20:32:34 juju-e4d256-prod-github-runner-207 kernel: [54528.614570] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:32:34 juju-e4d256-prod-github-runner-207 kernel: [54528.615285] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:32:34 juju-e4d256-prod-github-runner-207 kernel: [54528.615980] ? do_syscall_64+0x69/0xc0 Aug 22 20:32:34 juju-e4d256-prod-github-runner-207 kernel: [54528.616630] ? do_syscall_64+0x69/0xc0 Aug 22 20:32:34 juju-e4d256-prod-github-runner-207 kernel: [54528.617272] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 20:32:34 juju-e4d256-prod-github-runner-207 kernel: [54528.617978] RIP: 0033:0x7faa5d0edaff Aug 22 20:32:34 juju-e4d256-prod-github-runner-207 kernel: [54528.618645] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 20:32:34 juju-e4d256-prod-github-runner-207 kernel: [54528.620636] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 20:32:34 juju-e4d256-prod-github-runner-207 kernel: [54528.621571] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 20:32:34 juju-e4d256-prod-github-runner-207 kernel: [54528.622465] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 20:32:34 juju-e4d256-prod-github-runner-207 kernel: [54528.623369] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 20:32:34 juju-e4d256-prod-github-runner-207 kernel: [54528.624279] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 20:32:34 juju-e4d256-prod-github-runner-207 kernel: [54528.625333] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 20:32:34 juju-e4d256-prod-github-runner-207 kernel: [54528.626402] Aug 22 20:32:46 juju-e4d256-prod-github-runner-207 kernel: [54540.824707] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 20:32:46 juju-e4d256-prod-github-runner-207 kernel: [54540.826633] rcu: 1-....: (13563066 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=6556357 Aug 22 20:32:46 juju-e4d256-prod-github-runner-207 kernel: [54540.827756] (t=13605906 jiffies g=23269 q=50503) Aug 22 20:32:46 juju-e4d256-prod-github-runner-207 kernel: [54540.828540] NMI backtrace for cpu 1 Aug 22 20:32:46 juju-e4d256-prod-github-runner-207 kernel: [54540.829266] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 20:32:46 juju-e4d256-prod-github-runner-207 kernel: [54540.830375] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 20:32:46 juju-e4d256-prod-github-runner-207 kernel: [54540.831436] Call Trace: Aug 22 20:32:46 juju-e4d256-prod-github-runner-207 kernel: [54540.832108] Aug 22 20:32:46 juju-e4d256-prod-github-runner-207 kernel: [54540.832766] show_stack+0x52/0x5c Aug 22 20:32:46 juju-e4d256-prod-github-runner-207 kernel: [54540.833672] dump_stack_lvl+0x4a/0x63 Aug 22 20:32:46 juju-e4d256-prod-github-runner-207 kernel: [54540.834422] dump_stack+0x10/0x16 Aug 22 20:32:46 juju-e4d256-prod-github-runner-207 kernel: [54540.835137] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 20:32:46 juju-e4d256-prod-github-runner-207 kernel: [54540.835916] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 20:32:46 juju-e4d256-prod-github-runner-207 kernel: [54540.836697] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 20:32:46 juju-e4d256-prod-github-runner-207 kernel: [54540.837558] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 20:32:46 juju-e4d256-prod-github-runner-207 kernel: [54540.838382] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 20:32:46 juju-e4d256-prod-github-runner-207 kernel: [54540.839189] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 20:32:46 juju-e4d256-prod-github-runner-207 kernel: [54540.839960] print_cpu_stall.cold+0x2f/0xe2 Aug 22 20:32:46 juju-e4d256-prod-github-runner-207 kernel: [54540.840723] ? timekeeping_update+0xf7/0x150 Aug 22 20:32:46 juju-e4d256-prod-github-runner-207 kernel: [54540.841499] check_cpu_stall+0x109/0x270 Aug 22 20:32:46 juju-e4d256-prod-github-runner-207 kernel: [54540.842245] rcu_sched_clock_irq+0x9a/0x250 Aug 22 20:32:46 juju-e4d256-prod-github-runner-207 kernel: [54540.843015] update_process_times+0x94/0xd0 Aug 22 20:32:46 juju-e4d256-prod-github-runner-207 kernel: [54540.843799] tick_sched_handle+0x29/0x70 Aug 22 20:32:46 juju-e4d256-prod-github-runner-207 kernel: [54540.844546] tick_sched_timer+0x8c/0xc0 Aug 22 20:32:46 juju-e4d256-prod-github-runner-207 kernel: [54540.845294] ? tick_nohz_handler+0xb0/0xb0 Aug 22 20:32:46 juju-e4d256-prod-github-runner-207 kernel: [54540.846052] __hrtimer_run_queues+0x107/0x230 Aug 22 20:32:46 juju-e4d256-prod-github-runner-207 kernel: [54540.846827] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 20:32:46 juju-e4d256-prod-github-runner-207 kernel: [54540.847608] hrtimer_interrupt+0x101/0x220 Aug 22 20:32:46 juju-e4d256-prod-github-runner-207 kernel: [54540.848364] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 20:32:46 juju-e4d256-prod-github-runner-207 kernel: [54540.849180] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 20:32:46 juju-e4d256-prod-github-runner-207 kernel: [54540.849981] Aug 22 20:32:46 juju-e4d256-prod-github-runner-207 kernel: [54540.850614] Aug 22 20:32:46 juju-e4d256-prod-github-runner-207 kernel: [54540.851240] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 20:32:46 juju-e4d256-prod-github-runner-207 kernel: [54540.852073] RIP: 0010:native_queued_spin_lock_slowpath+0xc/0x40 Aug 22 20:32:46 juju-e4d256-prod-github-runner-207 kernel: [54540.852965] Code: fe ff ff eb af 4c 89 fe 48 c7 c7 20 99 e9 89 e8 ca 69 55 00 e9 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 <8b> 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 eb Aug 22 20:32:46 juju-e4d256-prod-github-runner-207 kernel: [54540.855164] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 20:32:46 juju-e4d256-prod-github-runner-207 kernel: [54540.856041] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 20:32:46 juju-e4d256-prod-github-runner-207 kernel: [54540.857056] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 20:32:46 juju-e4d256-prod-github-runner-207 kernel: [54540.858058] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 20:32:46 juju-e4d256-prod-github-runner-207 kernel: [54540.859021] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 20:32:46 juju-e4d256-prod-github-runner-207 kernel: [54540.859980] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 20:32:46 juju-e4d256-prod-github-runner-207 kernel: [54540.860977] ? _raw_spin_lock+0x22/0x30 Aug 22 20:32:46 juju-e4d256-prod-github-runner-207 kernel: [54540.861749] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:32:46 juju-e4d256-prod-github-runner-207 kernel: [54540.862602] direct_page_fault+0x206/0x310 [kvm] Aug 22 20:32:46 juju-e4d256-prod-github-runner-207 kernel: [54540.863438] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 20:32:46 juju-e4d256-prod-github-runner-207 kernel: [54540.864263] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 20:32:46 juju-e4d256-prod-github-runner-207 kernel: [54540.865126] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 20:32:46 juju-e4d256-prod-github-runner-207 kernel: [54540.865954] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 20:32:46 juju-e4d256-prod-github-runner-207 kernel: [54540.866751] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 20:32:46 juju-e4d256-prod-github-runner-207 kernel: [54540.867585] handle_exit+0x98/0x230 [kvm_amd] Aug 22 20:32:46 juju-e4d256-prod-github-runner-207 kernel: [54540.868338] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 20:32:46 juju-e4d256-prod-github-runner-207 kernel: [54540.869142] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 20:32:46 juju-e4d256-prod-github-runner-207 kernel: [54540.869951] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 20:32:46 juju-e4d256-prod-github-runner-207 kernel: [54540.870747] vcpu_run+0x62/0x2c0 [kvm] Aug 22 20:32:46 juju-e4d256-prod-github-runner-207 kernel: [54540.871473] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 20:32:46 juju-e4d256-prod-github-runner-207 kernel: [54540.872216] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 20:32:46 juju-e4d256-prod-github-runner-207 kernel: [54540.873024] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 20:32:46 juju-e4d256-prod-github-runner-207 kernel: [54540.873799] ? __seccomp_filter+0x4a/0x4a0 Aug 22 20:32:46 juju-e4d256-prod-github-runner-207 kernel: [54540.874518] ? __fget_files+0x86/0xc0 Aug 22 20:32:46 juju-e4d256-prod-github-runner-207 kernel: [54540.875211] __x64_sys_ioctl+0x95/0xd0 Aug 22 20:32:46 juju-e4d256-prod-github-runner-207 kernel: [54540.875904] do_syscall_64+0x5c/0xc0 Aug 22 20:32:46 juju-e4d256-prod-github-runner-207 kernel: [54540.876596] ? do_futex+0x162/0x1f0 Aug 22 20:32:46 juju-e4d256-prod-github-runner-207 kernel: [54540.877301] ? __x64_sys_futex+0x78/0x1e0 Aug 22 20:32:46 juju-e4d256-prod-github-runner-207 kernel: [54540.878014] ? __secure_computing+0xa9/0x120 Aug 22 20:32:46 juju-e4d256-prod-github-runner-207 kernel: [54540.878744] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 20:32:46 juju-e4d256-prod-github-runner-207 kernel: [54540.879536] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:32:46 juju-e4d256-prod-github-runner-207 kernel: [54540.880293] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:32:46 juju-e4d256-prod-github-runner-207 kernel: [54540.881060] ? do_syscall_64+0x69/0xc0 Aug 22 20:32:46 juju-e4d256-prod-github-runner-207 kernel: [54540.881753] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:32:46 juju-e4d256-prod-github-runner-207 kernel: [54540.882529] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:32:46 juju-e4d256-prod-github-runner-207 kernel: [54540.883287] ? do_syscall_64+0x69/0xc0 Aug 22 20:32:46 juju-e4d256-prod-github-runner-207 kernel: [54540.884001] ? do_syscall_64+0x69/0xc0 Aug 22 20:32:46 juju-e4d256-prod-github-runner-207 kernel: [54540.884696] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 20:32:46 juju-e4d256-prod-github-runner-207 kernel: [54540.885508] RIP: 0033:0x7faa5d0edaff Aug 22 20:32:46 juju-e4d256-prod-github-runner-207 kernel: [54540.886233] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 20:32:46 juju-e4d256-prod-github-runner-207 kernel: [54540.888368] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 20:32:46 juju-e4d256-prod-github-runner-207 kernel: [54540.889341] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 20:32:46 juju-e4d256-prod-github-runner-207 kernel: [54540.890287] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 20:32:46 juju-e4d256-prod-github-runner-207 kernel: [54540.891234] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 20:32:46 juju-e4d256-prod-github-runner-207 kernel: [54540.892175] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 20:32:46 juju-e4d256-prod-github-runner-207 kernel: [54540.893119] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 20:32:46 juju-e4d256-prod-github-runner-207 kernel: [54540.894038] Aug 22 20:33:14 juju-e4d256-prod-github-runner-207 kernel: [54568.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 50712s! [qemu-system-x86:6715] Aug 22 20:33:14 juju-e4d256-prod-github-runner-207 kernel: [54568.543946] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 20:33:14 juju-e4d256-prod-github-runner-207 kernel: [54568.544268] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 20:33:14 juju-e4d256-prod-github-runner-207 kernel: [54568.556623] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 20:33:14 juju-e4d256-prod-github-runner-207 kernel: [54568.557911] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 20:33:14 juju-e4d256-prod-github-runner-207 kernel: [54568.559122] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:33:14 juju-e4d256-prod-github-runner-207 kernel: [54568.560178] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 20:33:14 juju-e4d256-prod-github-runner-207 kernel: [54568.562760] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 20:33:14 juju-e4d256-prod-github-runner-207 kernel: [54568.563816] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 20:33:14 juju-e4d256-prod-github-runner-207 kernel: [54568.565040] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 20:33:14 juju-e4d256-prod-github-runner-207 kernel: [54568.566240] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 20:33:14 juju-e4d256-prod-github-runner-207 kernel: [54568.567399] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 20:33:14 juju-e4d256-prod-github-runner-207 kernel: [54568.568582] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 20:33:14 juju-e4d256-prod-github-runner-207 kernel: [54568.569750] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 20:33:14 juju-e4d256-prod-github-runner-207 kernel: [54568.570986] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 20:33:14 juju-e4d256-prod-github-runner-207 kernel: [54568.572087] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 20:33:14 juju-e4d256-prod-github-runner-207 kernel: [54568.573293] Call Trace: Aug 22 20:33:14 juju-e4d256-prod-github-runner-207 kernel: [54568.574229] Aug 22 20:33:14 juju-e4d256-prod-github-runner-207 kernel: [54568.575138] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:33:14 juju-e4d256-prod-github-runner-207 kernel: [54568.576169] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:33:14 juju-e4d256-prod-github-runner-207 kernel: [54568.577211] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:33:14 juju-e4d256-prod-github-runner-207 kernel: [54568.578313] ? show_regs.part.0+0x23/0x29 Aug 22 20:33:14 juju-e4d256-prod-github-runner-207 kernel: [54568.579447] ? show_regs.cold+0x8/0xd Aug 22 20:33:14 juju-e4d256-prod-github-runner-207 kernel: [54568.580424] ? watchdog_timer_fn+0x1be/0x220 Aug 22 20:33:14 juju-e4d256-prod-github-runner-207 kernel: [54568.581619] ? lockup_detector_update_enable+0x60/0x60 Aug 22 20:33:14 juju-e4d256-prod-github-runner-207 kernel: [54568.582725] ? __hrtimer_run_queues+0x107/0x230 Aug 22 20:33:14 juju-e4d256-prod-github-runner-207 kernel: [54568.583765] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 20:33:14 juju-e4d256-prod-github-runner-207 kernel: [54568.584827] ? hrtimer_interrupt+0x101/0x220 Aug 22 20:33:14 juju-e4d256-prod-github-runner-207 kernel: [54568.585854] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 20:33:14 juju-e4d256-prod-github-runner-207 kernel: [54568.586923] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 20:33:14 juju-e4d256-prod-github-runner-207 kernel: [54568.587998] Aug 22 20:33:14 juju-e4d256-prod-github-runner-207 kernel: [54568.588904] Aug 22 20:33:14 juju-e4d256-prod-github-runner-207 kernel: [54568.589788] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 20:33:14 juju-e4d256-prod-github-runner-207 kernel: [54568.590863] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:33:14 juju-e4d256-prod-github-runner-207 kernel: [54568.591920] ? _raw_spin_lock+0x22/0x30 Aug 22 20:33:14 juju-e4d256-prod-github-runner-207 kernel: [54568.592926] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:33:14 juju-e4d256-prod-github-runner-207 kernel: [54568.593981] direct_page_fault+0x206/0x310 [kvm] Aug 22 20:33:14 juju-e4d256-prod-github-runner-207 kernel: [54568.595056] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 20:33:14 juju-e4d256-prod-github-runner-207 kernel: [54568.596121] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 20:33:14 juju-e4d256-prod-github-runner-207 kernel: [54568.597148] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 20:33:14 juju-e4d256-prod-github-runner-207 kernel: [54568.598195] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 20:33:14 juju-e4d256-prod-github-runner-207 kernel: [54568.599152] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 20:33:14 juju-e4d256-prod-github-runner-207 kernel: [54568.600143] handle_exit+0x98/0x230 [kvm_amd] Aug 22 20:33:14 juju-e4d256-prod-github-runner-207 kernel: [54568.601059] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 20:33:14 juju-e4d256-prod-github-runner-207 kernel: [54568.601981] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 20:33:14 juju-e4d256-prod-github-runner-207 kernel: [54568.602906] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 20:33:14 juju-e4d256-prod-github-runner-207 kernel: [54568.603822] vcpu_run+0x62/0x2c0 [kvm] Aug 22 20:33:14 juju-e4d256-prod-github-runner-207 kernel: [54568.604678] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 20:33:14 juju-e4d256-prod-github-runner-207 kernel: [54568.605536] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 20:33:14 juju-e4d256-prod-github-runner-207 kernel: [54568.606424] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 20:33:14 juju-e4d256-prod-github-runner-207 kernel: [54568.607223] ? __seccomp_filter+0x4a/0x4a0 Aug 22 20:33:14 juju-e4d256-prod-github-runner-207 kernel: [54568.607980] ? __fget_files+0x86/0xc0 Aug 22 20:33:14 juju-e4d256-prod-github-runner-207 kernel: [54568.608698] __x64_sys_ioctl+0x95/0xd0 Aug 22 20:33:14 juju-e4d256-prod-github-runner-207 kernel: [54568.609394] do_syscall_64+0x5c/0xc0 Aug 22 20:33:14 juju-e4d256-prod-github-runner-207 kernel: [54568.610064] ? do_futex+0x162/0x1f0 Aug 22 20:33:14 juju-e4d256-prod-github-runner-207 kernel: [54568.610713] ? __x64_sys_futex+0x78/0x1e0 Aug 22 20:33:14 juju-e4d256-prod-github-runner-207 kernel: [54568.611390] ? __secure_computing+0xa9/0x120 Aug 22 20:33:14 juju-e4d256-prod-github-runner-207 kernel: [54568.612089] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 20:33:14 juju-e4d256-prod-github-runner-207 kernel: [54568.612862] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:33:14 juju-e4d256-prod-github-runner-207 kernel: [54568.613607] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:33:14 juju-e4d256-prod-github-runner-207 kernel: [54568.614355] ? do_syscall_64+0x69/0xc0 Aug 22 20:33:14 juju-e4d256-prod-github-runner-207 kernel: [54568.615003] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:33:14 juju-e4d256-prod-github-runner-207 kernel: [54568.615767] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:33:14 juju-e4d256-prod-github-runner-207 kernel: [54568.616488] ? do_syscall_64+0x69/0xc0 Aug 22 20:33:14 juju-e4d256-prod-github-runner-207 kernel: [54568.617116] ? do_syscall_64+0x69/0xc0 Aug 22 20:33:14 juju-e4d256-prod-github-runner-207 kernel: [54568.617742] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 20:33:14 juju-e4d256-prod-github-runner-207 kernel: [54568.618451] RIP: 0033:0x7faa5d0edaff Aug 22 20:33:14 juju-e4d256-prod-github-runner-207 kernel: [54568.619113] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 20:33:14 juju-e4d256-prod-github-runner-207 kernel: [54568.621117] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 20:33:14 juju-e4d256-prod-github-runner-207 kernel: [54568.622031] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 20:33:14 juju-e4d256-prod-github-runner-207 kernel: [54568.622926] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 20:33:14 juju-e4d256-prod-github-runner-207 kernel: [54568.623855] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 20:33:14 juju-e4d256-prod-github-runner-207 kernel: [54568.624766] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 20:33:14 juju-e4d256-prod-github-runner-207 kernel: [54568.625711] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 20:33:14 juju-e4d256-prod-github-runner-207 kernel: [54568.626621] Aug 22 20:33:42 juju-e4d256-prod-github-runner-207 kernel: [54596.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 50738s! [qemu-system-x86:6715] Aug 22 20:33:42 juju-e4d256-prod-github-runner-207 kernel: [54596.543095] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 20:33:42 juju-e4d256-prod-github-runner-207 kernel: [54596.543178] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 20:33:42 juju-e4d256-prod-github-runner-207 kernel: [54596.555414] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 20:33:42 juju-e4d256-prod-github-runner-207 kernel: [54596.556692] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 20:33:42 juju-e4d256-prod-github-runner-207 kernel: [54596.557913] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:33:42 juju-e4d256-prod-github-runner-207 kernel: [54596.558965] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 20:33:42 juju-e4d256-prod-github-runner-207 kernel: [54596.561521] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 20:33:42 juju-e4d256-prod-github-runner-207 kernel: [54596.562577] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 20:33:42 juju-e4d256-prod-github-runner-207 kernel: [54596.563736] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 20:33:42 juju-e4d256-prod-github-runner-207 kernel: [54596.564917] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 20:33:42 juju-e4d256-prod-github-runner-207 kernel: [54596.566076] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 20:33:42 juju-e4d256-prod-github-runner-207 kernel: [54596.567236] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 20:33:42 juju-e4d256-prod-github-runner-207 kernel: [54596.568412] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 20:33:42 juju-e4d256-prod-github-runner-207 kernel: [54596.569642] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 20:33:42 juju-e4d256-prod-github-runner-207 kernel: [54596.570743] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 20:33:42 juju-e4d256-prod-github-runner-207 kernel: [54596.571976] Call Trace: Aug 22 20:33:42 juju-e4d256-prod-github-runner-207 kernel: [54596.572984] Aug 22 20:33:42 juju-e4d256-prod-github-runner-207 kernel: [54596.573869] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:33:42 juju-e4d256-prod-github-runner-207 kernel: [54596.575049] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:33:42 juju-e4d256-prod-github-runner-207 kernel: [54596.576232] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:33:42 juju-e4d256-prod-github-runner-207 kernel: [54596.577307] ? show_regs.part.0+0x23/0x29 Aug 22 20:33:42 juju-e4d256-prod-github-runner-207 kernel: [54596.578302] ? show_regs.cold+0x8/0xd Aug 22 20:33:42 juju-e4d256-prod-github-runner-207 kernel: [54596.579270] ? watchdog_timer_fn+0x1be/0x220 Aug 22 20:33:42 juju-e4d256-prod-github-runner-207 kernel: [54596.580291] ? lockup_detector_update_enable+0x60/0x60 Aug 22 20:33:42 juju-e4d256-prod-github-runner-207 kernel: [54596.581353] ? __hrtimer_run_queues+0x107/0x230 Aug 22 20:33:42 juju-e4d256-prod-github-runner-207 kernel: [54596.582377] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 20:33:42 juju-e4d256-prod-github-runner-207 kernel: [54596.583398] ? hrtimer_interrupt+0x101/0x220 Aug 22 20:33:42 juju-e4d256-prod-github-runner-207 kernel: [54596.584417] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 20:33:42 juju-e4d256-prod-github-runner-207 kernel: [54596.585483] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 20:33:42 juju-e4d256-prod-github-runner-207 kernel: [54596.586526] Aug 22 20:33:42 juju-e4d256-prod-github-runner-207 kernel: [54596.587377] Aug 22 20:33:42 juju-e4d256-prod-github-runner-207 kernel: [54596.588230] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 20:33:42 juju-e4d256-prod-github-runner-207 kernel: [54596.589259] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:33:42 juju-e4d256-prod-github-runner-207 kernel: [54596.590294] ? _raw_spin_lock+0x22/0x30 Aug 22 20:33:42 juju-e4d256-prod-github-runner-207 kernel: [54596.591236] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:33:42 juju-e4d256-prod-github-runner-207 kernel: [54596.592299] direct_page_fault+0x206/0x310 [kvm] Aug 22 20:33:42 juju-e4d256-prod-github-runner-207 kernel: [54596.593325] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 20:33:42 juju-e4d256-prod-github-runner-207 kernel: [54596.594346] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 20:33:42 juju-e4d256-prod-github-runner-207 kernel: [54596.595349] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 20:33:42 juju-e4d256-prod-github-runner-207 kernel: [54596.596363] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 20:33:42 juju-e4d256-prod-github-runner-207 kernel: [54596.597516] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 20:33:42 juju-e4d256-prod-github-runner-207 kernel: [54596.598495] handle_exit+0x98/0x230 [kvm_amd] Aug 22 20:33:42 juju-e4d256-prod-github-runner-207 kernel: [54596.599390] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 20:33:42 juju-e4d256-prod-github-runner-207 kernel: [54596.600323] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 20:33:42 juju-e4d256-prod-github-runner-207 kernel: [54596.601243] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 20:33:42 juju-e4d256-prod-github-runner-207 kernel: [54596.602147] vcpu_run+0x62/0x2c0 [kvm] Aug 22 20:33:42 juju-e4d256-prod-github-runner-207 kernel: [54596.602961] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 20:33:42 juju-e4d256-prod-github-runner-207 kernel: [54596.603765] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 20:33:42 juju-e4d256-prod-github-runner-207 kernel: [54596.604627] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 20:33:42 juju-e4d256-prod-github-runner-207 kernel: [54596.605429] ? __seccomp_filter+0x4a/0x4a0 Aug 22 20:33:42 juju-e4d256-prod-github-runner-207 kernel: [54596.606196] ? __fget_files+0x86/0xc0 Aug 22 20:33:42 juju-e4d256-prod-github-runner-207 kernel: [54596.606984] __x64_sys_ioctl+0x95/0xd0 Aug 22 20:33:42 juju-e4d256-prod-github-runner-207 kernel: [54596.607677] do_syscall_64+0x5c/0xc0 Aug 22 20:33:42 juju-e4d256-prod-github-runner-207 kernel: [54596.608363] ? do_futex+0x162/0x1f0 Aug 22 20:33:42 juju-e4d256-prod-github-runner-207 kernel: [54596.609009] ? __x64_sys_futex+0x78/0x1e0 Aug 22 20:33:42 juju-e4d256-prod-github-runner-207 kernel: [54596.609684] ? __secure_computing+0xa9/0x120 Aug 22 20:33:42 juju-e4d256-prod-github-runner-207 kernel: [54596.610370] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 20:33:42 juju-e4d256-prod-github-runner-207 kernel: [54596.611129] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:33:42 juju-e4d256-prod-github-runner-207 kernel: [54596.611855] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:33:42 juju-e4d256-prod-github-runner-207 kernel: [54596.612584] ? do_syscall_64+0x69/0xc0 Aug 22 20:33:42 juju-e4d256-prod-github-runner-207 kernel: [54596.613228] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:33:42 juju-e4d256-prod-github-runner-207 kernel: [54596.613928] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:33:42 juju-e4d256-prod-github-runner-207 kernel: [54596.614625] ? do_syscall_64+0x69/0xc0 Aug 22 20:33:42 juju-e4d256-prod-github-runner-207 kernel: [54596.615247] ? do_syscall_64+0x69/0xc0 Aug 22 20:33:42 juju-e4d256-prod-github-runner-207 kernel: [54596.615865] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 20:33:42 juju-e4d256-prod-github-runner-207 kernel: [54596.616575] RIP: 0033:0x7faa5d0edaff Aug 22 20:33:42 juju-e4d256-prod-github-runner-207 kernel: [54596.617217] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 20:33:42 juju-e4d256-prod-github-runner-207 kernel: [54596.619204] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 20:33:42 juju-e4d256-prod-github-runner-207 kernel: [54596.620111] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 20:33:42 juju-e4d256-prod-github-runner-207 kernel: [54596.621011] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 20:33:42 juju-e4d256-prod-github-runner-207 kernel: [54596.621910] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 20:33:42 juju-e4d256-prod-github-runner-207 kernel: [54596.622814] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 20:33:42 juju-e4d256-prod-github-runner-207 kernel: [54596.623723] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 20:33:42 juju-e4d256-prod-github-runner-207 kernel: [54596.624650] Aug 22 20:34:10 juju-e4d256-prod-github-runner-207 kernel: [54624.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 50765s! [qemu-system-x86:6715] Aug 22 20:34:10 juju-e4d256-prod-github-runner-207 kernel: [54624.543887] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 20:34:10 juju-e4d256-prod-github-runner-207 kernel: [54624.544189] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 20:34:10 juju-e4d256-prod-github-runner-207 kernel: [54624.556471] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 20:34:10 juju-e4d256-prod-github-runner-207 kernel: [54624.557751] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 20:34:10 juju-e4d256-prod-github-runner-207 kernel: [54624.558983] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:34:10 juju-e4d256-prod-github-runner-207 kernel: [54624.560118] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 20:34:10 juju-e4d256-prod-github-runner-207 kernel: [54624.563521] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 20:34:10 juju-e4d256-prod-github-runner-207 kernel: [54624.564949] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 20:34:10 juju-e4d256-prod-github-runner-207 kernel: [54624.568810] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 20:34:10 juju-e4d256-prod-github-runner-207 kernel: [54624.570418] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 20:34:10 juju-e4d256-prod-github-runner-207 kernel: [54624.572071] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 20:34:10 juju-e4d256-prod-github-runner-207 kernel: [54624.573721] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 20:34:10 juju-e4d256-prod-github-runner-207 kernel: [54624.575323] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 20:34:10 juju-e4d256-prod-github-runner-207 kernel: [54624.577096] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 20:34:10 juju-e4d256-prod-github-runner-207 kernel: [54624.578657] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 20:34:10 juju-e4d256-prod-github-runner-207 kernel: [54624.580053] Call Trace: Aug 22 20:34:10 juju-e4d256-prod-github-runner-207 kernel: [54624.581009] Aug 22 20:34:10 juju-e4d256-prod-github-runner-207 kernel: [54624.581937] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:34:10 juju-e4d256-prod-github-runner-207 kernel: [54624.582972] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:34:10 juju-e4d256-prod-github-runner-207 kernel: [54624.584015] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:34:10 juju-e4d256-prod-github-runner-207 kernel: [54624.585118] ? show_regs.part.0+0x23/0x29 Aug 22 20:34:10 juju-e4d256-prod-github-runner-207 kernel: [54624.586119] ? show_regs.cold+0x8/0xd Aug 22 20:34:10 juju-e4d256-prod-github-runner-207 kernel: [54624.587093] ? watchdog_timer_fn+0x1be/0x220 Aug 22 20:34:10 juju-e4d256-prod-github-runner-207 kernel: [54624.588193] ? lockup_detector_update_enable+0x60/0x60 Aug 22 20:34:10 juju-e4d256-prod-github-runner-207 kernel: [54624.589265] ? __hrtimer_run_queues+0x107/0x230 Aug 22 20:34:10 juju-e4d256-prod-github-runner-207 kernel: [54624.590298] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 20:34:10 juju-e4d256-prod-github-runner-207 kernel: [54624.591415] ? hrtimer_interrupt+0x101/0x220 Aug 22 20:34:10 juju-e4d256-prod-github-runner-207 kernel: [54624.592547] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 20:34:10 juju-e4d256-prod-github-runner-207 kernel: [54624.593630] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 20:34:10 juju-e4d256-prod-github-runner-207 kernel: [54624.594685] Aug 22 20:34:10 juju-e4d256-prod-github-runner-207 kernel: [54624.595539] Aug 22 20:34:10 juju-e4d256-prod-github-runner-207 kernel: [54624.596398] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 20:34:10 juju-e4d256-prod-github-runner-207 kernel: [54624.597437] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:34:10 juju-e4d256-prod-github-runner-207 kernel: [54624.598478] ? _raw_spin_lock+0x22/0x30 Aug 22 20:34:10 juju-e4d256-prod-github-runner-207 kernel: [54624.599424] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:34:10 juju-e4d256-prod-github-runner-207 kernel: [54624.600473] direct_page_fault+0x206/0x310 [kvm] Aug 22 20:34:10 juju-e4d256-prod-github-runner-207 kernel: [54624.601498] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 20:34:10 juju-e4d256-prod-github-runner-207 kernel: [54624.602507] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 20:34:10 juju-e4d256-prod-github-runner-207 kernel: [54624.603508] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 20:34:10 juju-e4d256-prod-github-runner-207 kernel: [54624.604533] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 20:34:10 juju-e4d256-prod-github-runner-207 kernel: [54624.605514] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 20:34:10 juju-e4d256-prod-github-runner-207 kernel: [54624.606512] handle_exit+0x98/0x230 [kvm_amd] Aug 22 20:34:10 juju-e4d256-prod-github-runner-207 kernel: [54624.607443] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 20:34:10 juju-e4d256-prod-github-runner-207 kernel: [54624.608390] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 20:34:10 juju-e4d256-prod-github-runner-207 kernel: [54624.609325] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 20:34:10 juju-e4d256-prod-github-runner-207 kernel: [54624.610236] vcpu_run+0x62/0x2c0 [kvm] Aug 22 20:34:10 juju-e4d256-prod-github-runner-207 kernel: [54624.611048] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 20:34:10 juju-e4d256-prod-github-runner-207 kernel: [54624.611902] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 20:34:10 juju-e4d256-prod-github-runner-207 kernel: [54624.612776] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 20:34:10 juju-e4d256-prod-github-runner-207 kernel: [54624.613574] ? __seccomp_filter+0x4a/0x4a0 Aug 22 20:34:10 juju-e4d256-prod-github-runner-207 kernel: [54624.614318] ? __fget_files+0x86/0xc0 Aug 22 20:34:10 juju-e4d256-prod-github-runner-207 kernel: [54624.615023] __x64_sys_ioctl+0x95/0xd0 Aug 22 20:34:10 juju-e4d256-prod-github-runner-207 kernel: [54624.615728] do_syscall_64+0x5c/0xc0 Aug 22 20:34:10 juju-e4d256-prod-github-runner-207 kernel: [54624.616454] ? do_futex+0x162/0x1f0 Aug 22 20:34:10 juju-e4d256-prod-github-runner-207 kernel: [54624.617141] ? __x64_sys_futex+0x78/0x1e0 Aug 22 20:34:10 juju-e4d256-prod-github-runner-207 kernel: [54624.617842] ? __secure_computing+0xa9/0x120 Aug 22 20:34:10 juju-e4d256-prod-github-runner-207 kernel: [54624.618539] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 20:34:10 juju-e4d256-prod-github-runner-207 kernel: [54624.619347] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:34:10 juju-e4d256-prod-github-runner-207 kernel: [54624.620094] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:34:10 juju-e4d256-prod-github-runner-207 kernel: [54624.621001] ? do_syscall_64+0x69/0xc0 Aug 22 20:34:10 juju-e4d256-prod-github-runner-207 kernel: [54624.621666] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:34:10 juju-e4d256-prod-github-runner-207 kernel: [54624.622428] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:34:10 juju-e4d256-prod-github-runner-207 kernel: [54624.623138] ? do_syscall_64+0x69/0xc0 Aug 22 20:34:10 juju-e4d256-prod-github-runner-207 kernel: [54624.623814] ? do_syscall_64+0x69/0xc0 Aug 22 20:34:10 juju-e4d256-prod-github-runner-207 kernel: [54624.624448] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 20:34:10 juju-e4d256-prod-github-runner-207 kernel: [54624.625238] RIP: 0033:0x7faa5d0edaff Aug 22 20:34:10 juju-e4d256-prod-github-runner-207 kernel: [54624.625928] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 20:34:10 juju-e4d256-prod-github-runner-207 kernel: [54624.628042] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 20:34:10 juju-e4d256-prod-github-runner-207 kernel: [54624.628969] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 20:34:10 juju-e4d256-prod-github-runner-207 kernel: [54624.629864] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 20:34:10 juju-e4d256-prod-github-runner-207 kernel: [54624.630777] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 20:34:10 juju-e4d256-prod-github-runner-207 kernel: [54624.631675] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 20:34:10 juju-e4d256-prod-github-runner-207 kernel: [54624.632589] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 20:34:10 juju-e4d256-prod-github-runner-207 kernel: [54624.633778] Aug 22 20:34:38 juju-e4d256-prod-github-runner-207 kernel: [54652.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 50791s! [qemu-system-x86:6715] Aug 22 20:34:38 juju-e4d256-prod-github-runner-207 kernel: [54652.543889] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 20:34:38 juju-e4d256-prod-github-runner-207 kernel: [54652.544197] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 20:34:38 juju-e4d256-prod-github-runner-207 kernel: [54652.556552] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 20:34:38 juju-e4d256-prod-github-runner-207 kernel: [54652.557838] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 20:34:38 juju-e4d256-prod-github-runner-207 kernel: [54652.559072] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:34:38 juju-e4d256-prod-github-runner-207 kernel: [54652.560167] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 20:34:38 juju-e4d256-prod-github-runner-207 kernel: [54652.562731] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 20:34:38 juju-e4d256-prod-github-runner-207 kernel: [54652.563793] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 20:34:38 juju-e4d256-prod-github-runner-207 kernel: [54652.564964] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 20:34:38 juju-e4d256-prod-github-runner-207 kernel: [54652.566131] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 20:34:38 juju-e4d256-prod-github-runner-207 kernel: [54652.567301] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 20:34:38 juju-e4d256-prod-github-runner-207 kernel: [54652.568498] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 20:34:38 juju-e4d256-prod-github-runner-207 kernel: [54652.569673] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 20:34:38 juju-e4d256-prod-github-runner-207 kernel: [54652.570915] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 20:34:38 juju-e4d256-prod-github-runner-207 kernel: [54652.572087] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 20:34:38 juju-e4d256-prod-github-runner-207 kernel: [54652.573301] Call Trace: Aug 22 20:34:38 juju-e4d256-prod-github-runner-207 kernel: [54652.574220] Aug 22 20:34:38 juju-e4d256-prod-github-runner-207 kernel: [54652.575166] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:34:38 juju-e4d256-prod-github-runner-207 kernel: [54652.576234] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:34:38 juju-e4d256-prod-github-runner-207 kernel: [54652.577260] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:34:38 juju-e4d256-prod-github-runner-207 kernel: [54652.578371] ? show_regs.part.0+0x23/0x29 Aug 22 20:34:38 juju-e4d256-prod-github-runner-207 kernel: [54652.579481] ? show_regs.cold+0x8/0xd Aug 22 20:34:38 juju-e4d256-prod-github-runner-207 kernel: [54652.580554] ? watchdog_timer_fn+0x1be/0x220 Aug 22 20:34:38 juju-e4d256-prod-github-runner-207 kernel: [54652.581572] ? lockup_detector_update_enable+0x60/0x60 Aug 22 20:34:38 juju-e4d256-prod-github-runner-207 kernel: [54652.582661] ? __hrtimer_run_queues+0x107/0x230 Aug 22 20:34:38 juju-e4d256-prod-github-runner-207 kernel: [54652.583729] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 20:34:38 juju-e4d256-prod-github-runner-207 kernel: [54652.584759] ? hrtimer_interrupt+0x101/0x220 Aug 22 20:34:38 juju-e4d256-prod-github-runner-207 kernel: [54652.585850] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 20:34:38 juju-e4d256-prod-github-runner-207 kernel: [54652.586949] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 20:34:38 juju-e4d256-prod-github-runner-207 kernel: [54652.588027] Aug 22 20:34:38 juju-e4d256-prod-github-runner-207 kernel: [54652.588890] Aug 22 20:34:38 juju-e4d256-prod-github-runner-207 kernel: [54652.589735] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 20:34:38 juju-e4d256-prod-github-runner-207 kernel: [54652.590793] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:34:38 juju-e4d256-prod-github-runner-207 kernel: [54652.591855] ? _raw_spin_lock+0x22/0x30 Aug 22 20:34:38 juju-e4d256-prod-github-runner-207 kernel: [54652.593091] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:34:38 juju-e4d256-prod-github-runner-207 kernel: [54652.594124] direct_page_fault+0x206/0x310 [kvm] Aug 22 20:34:38 juju-e4d256-prod-github-runner-207 kernel: [54652.595152] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 20:34:38 juju-e4d256-prod-github-runner-207 kernel: [54652.596182] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 20:34:38 juju-e4d256-prod-github-runner-207 kernel: [54652.597189] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 20:34:38 juju-e4d256-prod-github-runner-207 kernel: [54652.598204] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 20:34:38 juju-e4d256-prod-github-runner-207 kernel: [54652.599153] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 20:34:38 juju-e4d256-prod-github-runner-207 kernel: [54652.600144] handle_exit+0x98/0x230 [kvm_amd] Aug 22 20:34:38 juju-e4d256-prod-github-runner-207 kernel: [54652.601042] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 20:34:38 juju-e4d256-prod-github-runner-207 kernel: [54652.601963] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 20:34:38 juju-e4d256-prod-github-runner-207 kernel: [54652.602892] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 20:34:38 juju-e4d256-prod-github-runner-207 kernel: [54652.603813] vcpu_run+0x62/0x2c0 [kvm] Aug 22 20:34:38 juju-e4d256-prod-github-runner-207 kernel: [54652.604629] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 20:34:38 juju-e4d256-prod-github-runner-207 kernel: [54652.605448] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 20:34:38 juju-e4d256-prod-github-runner-207 kernel: [54652.606305] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 20:34:38 juju-e4d256-prod-github-runner-207 kernel: [54652.607106] ? __seccomp_filter+0x4a/0x4a0 Aug 22 20:34:38 juju-e4d256-prod-github-runner-207 kernel: [54652.607874] ? __fget_files+0x86/0xc0 Aug 22 20:34:38 juju-e4d256-prod-github-runner-207 kernel: [54652.608584] __x64_sys_ioctl+0x95/0xd0 Aug 22 20:34:38 juju-e4d256-prod-github-runner-207 kernel: [54652.609281] do_syscall_64+0x5c/0xc0 Aug 22 20:34:38 juju-e4d256-prod-github-runner-207 kernel: [54652.609950] ? do_futex+0x162/0x1f0 Aug 22 20:34:38 juju-e4d256-prod-github-runner-207 kernel: [54652.610601] ? __x64_sys_futex+0x78/0x1e0 Aug 22 20:34:38 juju-e4d256-prod-github-runner-207 kernel: [54652.611278] ? __secure_computing+0xa9/0x120 Aug 22 20:34:38 juju-e4d256-prod-github-runner-207 kernel: [54652.611992] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 20:34:38 juju-e4d256-prod-github-runner-207 kernel: [54652.612757] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:34:38 juju-e4d256-prod-github-runner-207 kernel: [54652.613483] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:34:38 juju-e4d256-prod-github-runner-207 kernel: [54652.614239] ? do_syscall_64+0x69/0xc0 Aug 22 20:34:38 juju-e4d256-prod-github-runner-207 kernel: [54652.614908] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:34:38 juju-e4d256-prod-github-runner-207 kernel: [54652.615631] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:34:38 juju-e4d256-prod-github-runner-207 kernel: [54652.616331] ? do_syscall_64+0x69/0xc0 Aug 22 20:34:38 juju-e4d256-prod-github-runner-207 kernel: [54652.616959] ? do_syscall_64+0x69/0xc0 Aug 22 20:34:38 juju-e4d256-prod-github-runner-207 kernel: [54652.617588] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 20:34:38 juju-e4d256-prod-github-runner-207 kernel: [54652.618298] RIP: 0033:0x7faa5d0edaff Aug 22 20:34:38 juju-e4d256-prod-github-runner-207 kernel: [54652.618980] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 20:34:38 juju-e4d256-prod-github-runner-207 kernel: [54652.621008] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 20:34:38 juju-e4d256-prod-github-runner-207 kernel: [54652.622001] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 20:34:38 juju-e4d256-prod-github-runner-207 kernel: [54652.622896] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 20:34:38 juju-e4d256-prod-github-runner-207 kernel: [54652.623808] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 20:34:38 juju-e4d256-prod-github-runner-207 kernel: [54652.624702] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 20:34:38 juju-e4d256-prod-github-runner-207 kernel: [54652.625599] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 20:34:38 juju-e4d256-prod-github-runner-207 kernel: [54652.626493] Aug 22 20:35:06 juju-e4d256-prod-github-runner-207 kernel: [54680.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 50817s! [qemu-system-x86:6715] Aug 22 20:35:06 juju-e4d256-prod-github-runner-207 kernel: [54680.543837] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 20:35:06 juju-e4d256-prod-github-runner-207 kernel: [54680.544126] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 20:35:06 juju-e4d256-prod-github-runner-207 kernel: [54680.556496] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 20:35:06 juju-e4d256-prod-github-runner-207 kernel: [54680.557762] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 20:35:06 juju-e4d256-prod-github-runner-207 kernel: [54680.558978] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:35:06 juju-e4d256-prod-github-runner-207 kernel: [54680.560202] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 20:35:06 juju-e4d256-prod-github-runner-207 kernel: [54680.562910] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 20:35:06 juju-e4d256-prod-github-runner-207 kernel: [54680.563965] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 20:35:06 juju-e4d256-prod-github-runner-207 kernel: [54680.565124] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 20:35:06 juju-e4d256-prod-github-runner-207 kernel: [54680.566366] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 20:35:06 juju-e4d256-prod-github-runner-207 kernel: [54680.567562] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 20:35:06 juju-e4d256-prod-github-runner-207 kernel: [54680.568727] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 20:35:06 juju-e4d256-prod-github-runner-207 kernel: [54680.569917] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 20:35:06 juju-e4d256-prod-github-runner-207 kernel: [54680.571178] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 20:35:06 juju-e4d256-prod-github-runner-207 kernel: [54680.572271] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 20:35:06 juju-e4d256-prod-github-runner-207 kernel: [54680.573461] Call Trace: Aug 22 20:35:06 juju-e4d256-prod-github-runner-207 kernel: [54680.574368] Aug 22 20:35:06 juju-e4d256-prod-github-runner-207 kernel: [54680.575282] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:35:06 juju-e4d256-prod-github-runner-207 kernel: [54680.576314] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:35:06 juju-e4d256-prod-github-runner-207 kernel: [54680.577335] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:35:06 juju-e4d256-prod-github-runner-207 kernel: [54680.578465] ? show_regs.part.0+0x23/0x29 Aug 22 20:35:06 juju-e4d256-prod-github-runner-207 kernel: [54680.579488] ? show_regs.cold+0x8/0xd Aug 22 20:35:06 juju-e4d256-prod-github-runner-207 kernel: [54680.580493] ? watchdog_timer_fn+0x1be/0x220 Aug 22 20:35:06 juju-e4d256-prod-github-runner-207 kernel: [54680.581537] ? lockup_detector_update_enable+0x60/0x60 Aug 22 20:35:06 juju-e4d256-prod-github-runner-207 kernel: [54680.582602] ? __hrtimer_run_queues+0x107/0x230 Aug 22 20:35:06 juju-e4d256-prod-github-runner-207 kernel: [54680.583684] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 20:35:06 juju-e4d256-prod-github-runner-207 kernel: [54680.584717] ? hrtimer_interrupt+0x101/0x220 Aug 22 20:35:06 juju-e4d256-prod-github-runner-207 kernel: [54680.585754] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 20:35:06 juju-e4d256-prod-github-runner-207 kernel: [54680.586829] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 20:35:06 juju-e4d256-prod-github-runner-207 kernel: [54680.587956] Aug 22 20:35:06 juju-e4d256-prod-github-runner-207 kernel: [54680.588831] Aug 22 20:35:06 juju-e4d256-prod-github-runner-207 kernel: [54680.589673] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 20:35:06 juju-e4d256-prod-github-runner-207 kernel: [54680.590765] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:35:06 juju-e4d256-prod-github-runner-207 kernel: [54680.591830] ? _raw_spin_lock+0x22/0x30 Aug 22 20:35:06 juju-e4d256-prod-github-runner-207 kernel: [54680.592781] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:35:06 juju-e4d256-prod-github-runner-207 kernel: [54680.593801] direct_page_fault+0x206/0x310 [kvm] Aug 22 20:35:06 juju-e4d256-prod-github-runner-207 kernel: [54680.594880] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 20:35:06 juju-e4d256-prod-github-runner-207 kernel: [54680.595986] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 20:35:06 juju-e4d256-prod-github-runner-207 kernel: [54680.597016] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 20:35:06 juju-e4d256-prod-github-runner-207 kernel: [54680.598035] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 20:35:06 juju-e4d256-prod-github-runner-207 kernel: [54680.598986] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 20:35:06 juju-e4d256-prod-github-runner-207 kernel: [54680.599985] handle_exit+0x98/0x230 [kvm_amd] Aug 22 20:35:06 juju-e4d256-prod-github-runner-207 kernel: [54680.600919] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 20:35:06 juju-e4d256-prod-github-runner-207 kernel: [54680.601853] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 20:35:06 juju-e4d256-prod-github-runner-207 kernel: [54680.602785] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 20:35:06 juju-e4d256-prod-github-runner-207 kernel: [54680.603704] vcpu_run+0x62/0x2c0 [kvm] Aug 22 20:35:06 juju-e4d256-prod-github-runner-207 kernel: [54680.604517] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 20:35:06 juju-e4d256-prod-github-runner-207 kernel: [54680.605332] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 20:35:06 juju-e4d256-prod-github-runner-207 kernel: [54680.606216] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 20:35:06 juju-e4d256-prod-github-runner-207 kernel: [54680.607017] ? __seccomp_filter+0x4a/0x4a0 Aug 22 20:35:06 juju-e4d256-prod-github-runner-207 kernel: [54680.607780] ? __fget_files+0x86/0xc0 Aug 22 20:35:06 juju-e4d256-prod-github-runner-207 kernel: [54680.608490] __x64_sys_ioctl+0x95/0xd0 Aug 22 20:35:06 juju-e4d256-prod-github-runner-207 kernel: [54680.609187] do_syscall_64+0x5c/0xc0 Aug 22 20:35:06 juju-e4d256-prod-github-runner-207 kernel: [54680.609890] ? do_futex+0x162/0x1f0 Aug 22 20:35:06 juju-e4d256-prod-github-runner-207 kernel: [54680.610544] ? __x64_sys_futex+0x78/0x1e0 Aug 22 20:35:06 juju-e4d256-prod-github-runner-207 kernel: [54680.611299] ? __secure_computing+0xa9/0x120 Aug 22 20:35:06 juju-e4d256-prod-github-runner-207 kernel: [54680.612001] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 20:35:06 juju-e4d256-prod-github-runner-207 kernel: [54680.612782] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:35:06 juju-e4d256-prod-github-runner-207 kernel: [54680.613504] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:35:06 juju-e4d256-prod-github-runner-207 kernel: [54680.614228] ? do_syscall_64+0x69/0xc0 Aug 22 20:35:06 juju-e4d256-prod-github-runner-207 kernel: [54680.614878] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:35:06 juju-e4d256-prod-github-runner-207 kernel: [54680.615591] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:35:06 juju-e4d256-prod-github-runner-207 kernel: [54680.616304] ? do_syscall_64+0x69/0xc0 Aug 22 20:35:06 juju-e4d256-prod-github-runner-207 kernel: [54680.616935] ? do_syscall_64+0x69/0xc0 Aug 22 20:35:06 juju-e4d256-prod-github-runner-207 kernel: [54680.617556] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 20:35:06 juju-e4d256-prod-github-runner-207 kernel: [54680.618260] RIP: 0033:0x7faa5d0edaff Aug 22 20:35:06 juju-e4d256-prod-github-runner-207 kernel: [54680.618928] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 20:35:06 juju-e4d256-prod-github-runner-207 kernel: [54680.620946] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 20:35:06 juju-e4d256-prod-github-runner-207 kernel: [54680.621901] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 20:35:06 juju-e4d256-prod-github-runner-207 kernel: [54680.622814] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 20:35:06 juju-e4d256-prod-github-runner-207 kernel: [54680.623765] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 20:35:06 juju-e4d256-prod-github-runner-207 kernel: [54680.624723] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 20:35:06 juju-e4d256-prod-github-runner-207 kernel: [54680.625657] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 20:35:06 juju-e4d256-prod-github-runner-207 kernel: [54680.626612] Aug 22 20:35:34 juju-e4d256-prod-github-runner-207 kernel: [54708.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 50843s! [qemu-system-x86:6715] Aug 22 20:35:34 juju-e4d256-prod-github-runner-207 kernel: [54708.543136] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 20:35:34 juju-e4d256-prod-github-runner-207 kernel: [54708.543210] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 20:35:34 juju-e4d256-prod-github-runner-207 kernel: [54708.555557] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 20:35:34 juju-e4d256-prod-github-runner-207 kernel: [54708.556833] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 20:35:34 juju-e4d256-prod-github-runner-207 kernel: [54708.558064] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:35:34 juju-e4d256-prod-github-runner-207 kernel: [54708.559143] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 20:35:34 juju-e4d256-prod-github-runner-207 kernel: [54708.561700] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 20:35:34 juju-e4d256-prod-github-runner-207 kernel: [54708.562756] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 20:35:34 juju-e4d256-prod-github-runner-207 kernel: [54708.563926] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 20:35:34 juju-e4d256-prod-github-runner-207 kernel: [54708.565091] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 20:35:34 juju-e4d256-prod-github-runner-207 kernel: [54708.566252] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 20:35:34 juju-e4d256-prod-github-runner-207 kernel: [54708.567436] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 20:35:34 juju-e4d256-prod-github-runner-207 kernel: [54708.568610] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 20:35:34 juju-e4d256-prod-github-runner-207 kernel: [54708.569852] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 20:35:34 juju-e4d256-prod-github-runner-207 kernel: [54708.570966] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 20:35:34 juju-e4d256-prod-github-runner-207 kernel: [54708.572173] Call Trace: Aug 22 20:35:34 juju-e4d256-prod-github-runner-207 kernel: [54708.573090] Aug 22 20:35:34 juju-e4d256-prod-github-runner-207 kernel: [54708.573982] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:35:34 juju-e4d256-prod-github-runner-207 kernel: [54708.575032] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:35:34 juju-e4d256-prod-github-runner-207 kernel: [54708.576056] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:35:34 juju-e4d256-prod-github-runner-207 kernel: [54708.577133] ? show_regs.part.0+0x23/0x29 Aug 22 20:35:34 juju-e4d256-prod-github-runner-207 kernel: [54708.578133] ? show_regs.cold+0x8/0xd Aug 22 20:35:34 juju-e4d256-prod-github-runner-207 kernel: [54708.579118] ? watchdog_timer_fn+0x1be/0x220 Aug 22 20:35:34 juju-e4d256-prod-github-runner-207 kernel: [54708.580129] ? lockup_detector_update_enable+0x60/0x60 Aug 22 20:35:34 juju-e4d256-prod-github-runner-207 kernel: [54708.581194] ? __hrtimer_run_queues+0x107/0x230 Aug 22 20:35:34 juju-e4d256-prod-github-runner-207 kernel: [54708.582222] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 20:35:34 juju-e4d256-prod-github-runner-207 kernel: [54708.583282] ? hrtimer_interrupt+0x101/0x220 Aug 22 20:35:34 juju-e4d256-prod-github-runner-207 kernel: [54708.584299] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 20:35:34 juju-e4d256-prod-github-runner-207 kernel: [54708.585371] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 20:35:34 juju-e4d256-prod-github-runner-207 kernel: [54708.586419] Aug 22 20:35:34 juju-e4d256-prod-github-runner-207 kernel: [54708.587350] Aug 22 20:35:34 juju-e4d256-prod-github-runner-207 kernel: [54708.588206] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 20:35:34 juju-e4d256-prod-github-runner-207 kernel: [54708.589247] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:35:34 juju-e4d256-prod-github-runner-207 kernel: [54708.590430] ? _raw_spin_lock+0x22/0x30 Aug 22 20:35:34 juju-e4d256-prod-github-runner-207 kernel: [54708.591498] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:35:34 juju-e4d256-prod-github-runner-207 kernel: [54708.592617] direct_page_fault+0x206/0x310 [kvm] Aug 22 20:35:34 juju-e4d256-prod-github-runner-207 kernel: [54708.593732] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 20:35:34 juju-e4d256-prod-github-runner-207 kernel: [54708.594850] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 20:35:34 juju-e4d256-prod-github-runner-207 kernel: [54708.595943] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 20:35:34 juju-e4d256-prod-github-runner-207 kernel: [54708.597115] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 20:35:34 juju-e4d256-prod-github-runner-207 kernel: [54708.598149] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 20:35:34 juju-e4d256-prod-github-runner-207 kernel: [54708.599274] handle_exit+0x98/0x230 [kvm_amd] Aug 22 20:35:34 juju-e4d256-prod-github-runner-207 kernel: [54708.600255] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 20:35:34 juju-e4d256-prod-github-runner-207 kernel: [54708.601443] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 20:35:34 juju-e4d256-prod-github-runner-207 kernel: [54708.602613] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 20:35:34 juju-e4d256-prod-github-runner-207 kernel: [54708.603641] vcpu_run+0x62/0x2c0 [kvm] Aug 22 20:35:34 juju-e4d256-prod-github-runner-207 kernel: [54708.604531] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 20:35:34 juju-e4d256-prod-github-runner-207 kernel: [54708.605439] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 20:35:34 juju-e4d256-prod-github-runner-207 kernel: [54708.606391] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 20:35:34 juju-e4d256-prod-github-runner-207 kernel: [54708.607298] ? __seccomp_filter+0x4a/0x4a0 Aug 22 20:35:34 juju-e4d256-prod-github-runner-207 kernel: [54708.608120] ? __fget_files+0x86/0xc0 Aug 22 20:35:34 juju-e4d256-prod-github-runner-207 kernel: [54708.608897] __x64_sys_ioctl+0x95/0xd0 Aug 22 20:35:34 juju-e4d256-prod-github-runner-207 kernel: [54708.609674] do_syscall_64+0x5c/0xc0 Aug 22 20:35:34 juju-e4d256-prod-github-runner-207 kernel: [54708.610419] ? do_futex+0x162/0x1f0 Aug 22 20:35:34 juju-e4d256-prod-github-runner-207 kernel: [54708.611147] ? __x64_sys_futex+0x78/0x1e0 Aug 22 20:35:34 juju-e4d256-prod-github-runner-207 kernel: [54708.611902] ? __secure_computing+0xa9/0x120 Aug 22 20:35:34 juju-e4d256-prod-github-runner-207 kernel: [54708.612673] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 20:35:34 juju-e4d256-prod-github-runner-207 kernel: [54708.613538] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:35:34 juju-e4d256-prod-github-runner-207 kernel: [54708.614353] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:35:34 juju-e4d256-prod-github-runner-207 kernel: [54708.615179] ? do_syscall_64+0x69/0xc0 Aug 22 20:35:34 juju-e4d256-prod-github-runner-207 kernel: [54708.615898] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:35:34 juju-e4d256-prod-github-runner-207 kernel: [54708.616700] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:35:34 juju-e4d256-prod-github-runner-207 kernel: [54708.617490] ? do_syscall_64+0x69/0xc0 Aug 22 20:35:34 juju-e4d256-prod-github-runner-207 kernel: [54708.618188] ? do_syscall_64+0x69/0xc0 Aug 22 20:35:34 juju-e4d256-prod-github-runner-207 kernel: [54708.618899] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 20:35:34 juju-e4d256-prod-github-runner-207 kernel: [54708.619706] RIP: 0033:0x7faa5d0edaff Aug 22 20:35:34 juju-e4d256-prod-github-runner-207 kernel: [54708.620407] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 20:35:34 juju-e4d256-prod-github-runner-207 kernel: [54708.622738] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 20:35:34 juju-e4d256-prod-github-runner-207 kernel: [54708.623790] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 20:35:34 juju-e4d256-prod-github-runner-207 kernel: [54708.624811] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 20:35:34 juju-e4d256-prod-github-runner-207 kernel: [54708.625832] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 20:35:34 juju-e4d256-prod-github-runner-207 kernel: [54708.626868] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 20:35:34 juju-e4d256-prod-github-runner-207 kernel: [54708.627889] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 20:35:34 juju-e4d256-prod-github-runner-207 kernel: [54708.628923] Aug 22 20:35:46 juju-e4d256-prod-github-runner-207 kernel: [54720.836706] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 20:35:46 juju-e4d256-prod-github-runner-207 kernel: [54720.837784] rcu: 1-....: (13607927 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=6578101 Aug 22 20:35:46 juju-e4d256-prod-github-runner-207 kernel: [54720.838920] (t=13650909 jiffies g=23269 q=50627) Aug 22 20:35:46 juju-e4d256-prod-github-runner-207 kernel: [54720.839803] NMI backtrace for cpu 1 Aug 22 20:35:46 juju-e4d256-prod-github-runner-207 kernel: [54720.840643] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 20:35:46 juju-e4d256-prod-github-runner-207 kernel: [54720.841758] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 20:35:46 juju-e4d256-prod-github-runner-207 kernel: [54720.842872] Call Trace: Aug 22 20:35:46 juju-e4d256-prod-github-runner-207 kernel: [54720.843550] Aug 22 20:35:46 juju-e4d256-prod-github-runner-207 kernel: [54720.844194] show_stack+0x52/0x5c Aug 22 20:35:46 juju-e4d256-prod-github-runner-207 kernel: [54720.844917] dump_stack_lvl+0x4a/0x63 Aug 22 20:35:46 juju-e4d256-prod-github-runner-207 kernel: [54720.845662] dump_stack+0x10/0x16 Aug 22 20:35:46 juju-e4d256-prod-github-runner-207 kernel: [54720.846385] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 20:35:46 juju-e4d256-prod-github-runner-207 kernel: [54720.847177] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 20:35:46 juju-e4d256-prod-github-runner-207 kernel: [54720.847955] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 20:35:46 juju-e4d256-prod-github-runner-207 kernel: [54720.848772] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 20:35:46 juju-e4d256-prod-github-runner-207 kernel: [54720.849594] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 20:35:46 juju-e4d256-prod-github-runner-207 kernel: [54720.850398] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 20:35:46 juju-e4d256-prod-github-runner-207 kernel: [54720.851178] print_cpu_stall.cold+0x2f/0xe2 Aug 22 20:35:46 juju-e4d256-prod-github-runner-207 kernel: [54720.851942] ? timekeeping_update+0xf7/0x150 Aug 22 20:35:46 juju-e4d256-prod-github-runner-207 kernel: [54720.852711] check_cpu_stall+0x109/0x270 Aug 22 20:35:46 juju-e4d256-prod-github-runner-207 kernel: [54720.853457] rcu_sched_clock_irq+0x9a/0x250 Aug 22 20:35:46 juju-e4d256-prod-github-runner-207 kernel: [54720.854217] update_process_times+0x94/0xd0 Aug 22 20:35:46 juju-e4d256-prod-github-runner-207 kernel: [54720.854981] tick_sched_handle+0x29/0x70 Aug 22 20:35:46 juju-e4d256-prod-github-runner-207 kernel: [54720.855727] tick_sched_timer+0x8c/0xc0 Aug 22 20:35:46 juju-e4d256-prod-github-runner-207 kernel: [54720.856464] ? tick_nohz_handler+0xb0/0xb0 Aug 22 20:35:46 juju-e4d256-prod-github-runner-207 kernel: [54720.857218] __hrtimer_run_queues+0x107/0x230 Aug 22 20:35:46 juju-e4d256-prod-github-runner-207 kernel: [54720.858004] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 20:35:46 juju-e4d256-prod-github-runner-207 kernel: [54720.858792] hrtimer_interrupt+0x101/0x220 Aug 22 20:35:46 juju-e4d256-prod-github-runner-207 kernel: [54720.859560] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 20:35:46 juju-e4d256-prod-github-runner-207 kernel: [54720.860462] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 20:35:46 juju-e4d256-prod-github-runner-207 kernel: [54720.861389] Aug 22 20:35:46 juju-e4d256-prod-github-runner-207 kernel: [54720.862024] Aug 22 20:35:46 juju-e4d256-prod-github-runner-207 kernel: [54720.862677] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 20:35:46 juju-e4d256-prod-github-runner-207 kernel: [54720.863499] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:35:46 juju-e4d256-prod-github-runner-207 kernel: [54720.864385] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 20:35:46 juju-e4d256-prod-github-runner-207 kernel: [54720.866604] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 20:35:46 juju-e4d256-prod-github-runner-207 kernel: [54720.867485] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 20:35:46 juju-e4d256-prod-github-runner-207 kernel: [54720.868474] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 20:35:46 juju-e4d256-prod-github-runner-207 kernel: [54720.869454] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 20:35:46 juju-e4d256-prod-github-runner-207 kernel: [54720.870414] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 20:35:46 juju-e4d256-prod-github-runner-207 kernel: [54720.871382] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 20:35:46 juju-e4d256-prod-github-runner-207 kernel: [54720.872344] ? _raw_spin_lock+0x22/0x30 Aug 22 20:35:46 juju-e4d256-prod-github-runner-207 kernel: [54720.873117] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:35:46 juju-e4d256-prod-github-runner-207 kernel: [54720.873976] direct_page_fault+0x206/0x310 [kvm] Aug 22 20:35:46 juju-e4d256-prod-github-runner-207 kernel: [54720.874829] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 20:35:46 juju-e4d256-prod-github-runner-207 kernel: [54720.875657] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 20:35:46 juju-e4d256-prod-github-runner-207 kernel: [54720.876494] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 20:35:46 juju-e4d256-prod-github-runner-207 kernel: [54720.877322] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 20:35:46 juju-e4d256-prod-github-runner-207 kernel: [54720.878106] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 20:35:46 juju-e4d256-prod-github-runner-207 kernel: [54720.878941] handle_exit+0x98/0x230 [kvm_amd] Aug 22 20:35:46 juju-e4d256-prod-github-runner-207 kernel: [54720.879694] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 20:35:46 juju-e4d256-prod-github-runner-207 kernel: [54720.880474] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 20:35:46 juju-e4d256-prod-github-runner-207 kernel: [54720.881272] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 20:35:46 juju-e4d256-prod-github-runner-207 kernel: [54720.882056] vcpu_run+0x62/0x2c0 [kvm] Aug 22 20:35:46 juju-e4d256-prod-github-runner-207 kernel: [54720.882778] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 20:35:46 juju-e4d256-prod-github-runner-207 kernel: [54720.883521] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 20:35:46 juju-e4d256-prod-github-runner-207 kernel: [54720.884329] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 20:35:46 juju-e4d256-prod-github-runner-207 kernel: [54720.885090] ? __seccomp_filter+0x4a/0x4a0 Aug 22 20:35:46 juju-e4d256-prod-github-runner-207 kernel: [54720.885808] ? __fget_files+0x86/0xc0 Aug 22 20:35:46 juju-e4d256-prod-github-runner-207 kernel: [54720.886506] __x64_sys_ioctl+0x95/0xd0 Aug 22 20:35:46 juju-e4d256-prod-github-runner-207 kernel: [54720.887209] do_syscall_64+0x5c/0xc0 Aug 22 20:35:46 juju-e4d256-prod-github-runner-207 kernel: [54720.887899] ? do_futex+0x162/0x1f0 Aug 22 20:35:46 juju-e4d256-prod-github-runner-207 kernel: [54720.888581] ? __x64_sys_futex+0x78/0x1e0 Aug 22 20:35:46 juju-e4d256-prod-github-runner-207 kernel: [54720.889281] ? __secure_computing+0xa9/0x120 Aug 22 20:35:46 juju-e4d256-prod-github-runner-207 kernel: [54720.890000] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 20:35:46 juju-e4d256-prod-github-runner-207 kernel: [54720.890800] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:35:46 juju-e4d256-prod-github-runner-207 kernel: [54720.891551] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:35:46 juju-e4d256-prod-github-runner-207 kernel: [54720.892489] ? do_syscall_64+0x69/0xc0 Aug 22 20:35:46 juju-e4d256-prod-github-runner-207 kernel: [54720.893177] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:35:46 juju-e4d256-prod-github-runner-207 kernel: [54720.893938] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:35:46 juju-e4d256-prod-github-runner-207 kernel: [54720.894701] ? do_syscall_64+0x69/0xc0 Aug 22 20:35:46 juju-e4d256-prod-github-runner-207 kernel: [54720.895393] ? do_syscall_64+0x69/0xc0 Aug 22 20:35:46 juju-e4d256-prod-github-runner-207 kernel: [54720.896106] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 20:35:46 juju-e4d256-prod-github-runner-207 kernel: [54720.897202] RIP: 0033:0x7faa5d0edaff Aug 22 20:35:46 juju-e4d256-prod-github-runner-207 kernel: [54720.897947] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 20:35:46 juju-e4d256-prod-github-runner-207 kernel: [54720.900098] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 20:35:46 juju-e4d256-prod-github-runner-207 kernel: [54720.901062] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 20:35:46 juju-e4d256-prod-github-runner-207 kernel: [54720.902012] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 20:35:46 juju-e4d256-prod-github-runner-207 kernel: [54720.902972] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 20:35:46 juju-e4d256-prod-github-runner-207 kernel: [54720.903919] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 20:35:46 juju-e4d256-prod-github-runner-207 kernel: [54720.904840] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 20:35:46 juju-e4d256-prod-github-runner-207 kernel: [54720.905750] Aug 22 20:36:14 juju-e4d256-prod-github-runner-207 kernel: [54748.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 50880s! [qemu-system-x86:6715] Aug 22 20:36:14 juju-e4d256-prod-github-runner-207 kernel: [54748.543833] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 20:36:14 juju-e4d256-prod-github-runner-207 kernel: [54748.544105] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 20:36:14 juju-e4d256-prod-github-runner-207 kernel: [54748.556630] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 20:36:14 juju-e4d256-prod-github-runner-207 kernel: [54748.557890] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 20:36:14 juju-e4d256-prod-github-runner-207 kernel: [54748.559121] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:36:14 juju-e4d256-prod-github-runner-207 kernel: [54748.560172] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 20:36:14 juju-e4d256-prod-github-runner-207 kernel: [54748.562728] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 20:36:14 juju-e4d256-prod-github-runner-207 kernel: [54748.563767] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 20:36:14 juju-e4d256-prod-github-runner-207 kernel: [54748.564973] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 20:36:14 juju-e4d256-prod-github-runner-207 kernel: [54748.566137] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 20:36:14 juju-e4d256-prod-github-runner-207 kernel: [54748.567317] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 20:36:14 juju-e4d256-prod-github-runner-207 kernel: [54748.568477] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 20:36:14 juju-e4d256-prod-github-runner-207 kernel: [54748.569640] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 20:36:14 juju-e4d256-prod-github-runner-207 kernel: [54748.570885] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 20:36:14 juju-e4d256-prod-github-runner-207 kernel: [54748.572066] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 20:36:14 juju-e4d256-prod-github-runner-207 kernel: [54748.573254] Call Trace: Aug 22 20:36:14 juju-e4d256-prod-github-runner-207 kernel: [54748.574164] Aug 22 20:36:14 juju-e4d256-prod-github-runner-207 kernel: [54748.575065] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:36:14 juju-e4d256-prod-github-runner-207 kernel: [54748.576097] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:36:14 juju-e4d256-prod-github-runner-207 kernel: [54748.577117] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:36:14 juju-e4d256-prod-github-runner-207 kernel: [54748.578201] ? show_regs.part.0+0x23/0x29 Aug 22 20:36:14 juju-e4d256-prod-github-runner-207 kernel: [54748.579195] ? show_regs.cold+0x8/0xd Aug 22 20:36:14 juju-e4d256-prod-github-runner-207 kernel: [54748.580164] ? watchdog_timer_fn+0x1be/0x220 Aug 22 20:36:14 juju-e4d256-prod-github-runner-207 kernel: [54748.581169] ? lockup_detector_update_enable+0x60/0x60 Aug 22 20:36:14 juju-e4d256-prod-github-runner-207 kernel: [54748.582249] ? __hrtimer_run_queues+0x107/0x230 Aug 22 20:36:14 juju-e4d256-prod-github-runner-207 kernel: [54748.583284] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 20:36:14 juju-e4d256-prod-github-runner-207 kernel: [54748.584331] ? hrtimer_interrupt+0x101/0x220 Aug 22 20:36:14 juju-e4d256-prod-github-runner-207 kernel: [54748.585343] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 20:36:14 juju-e4d256-prod-github-runner-207 kernel: [54748.586421] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 20:36:14 juju-e4d256-prod-github-runner-207 kernel: [54748.587465] Aug 22 20:36:14 juju-e4d256-prod-github-runner-207 kernel: [54748.588315] Aug 22 20:36:14 juju-e4d256-prod-github-runner-207 kernel: [54748.589156] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 20:36:14 juju-e4d256-prod-github-runner-207 kernel: [54748.590218] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:36:14 juju-e4d256-prod-github-runner-207 kernel: [54748.591334] ? _raw_spin_lock+0x22/0x30 Aug 22 20:36:14 juju-e4d256-prod-github-runner-207 kernel: [54748.592281] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:36:14 juju-e4d256-prod-github-runner-207 kernel: [54748.593297] direct_page_fault+0x206/0x310 [kvm] Aug 22 20:36:14 juju-e4d256-prod-github-runner-207 kernel: [54748.594379] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 20:36:14 juju-e4d256-prod-github-runner-207 kernel: [54748.595400] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 20:36:14 juju-e4d256-prod-github-runner-207 kernel: [54748.596430] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 20:36:14 juju-e4d256-prod-github-runner-207 kernel: [54748.597420] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 20:36:14 juju-e4d256-prod-github-runner-207 kernel: [54748.598453] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 20:36:14 juju-e4d256-prod-github-runner-207 kernel: [54748.599466] handle_exit+0x98/0x230 [kvm_amd] Aug 22 20:36:14 juju-e4d256-prod-github-runner-207 kernel: [54748.600403] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 20:36:14 juju-e4d256-prod-github-runner-207 kernel: [54748.601322] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 20:36:14 juju-e4d256-prod-github-runner-207 kernel: [54748.602290] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 20:36:14 juju-e4d256-prod-github-runner-207 kernel: [54748.603203] vcpu_run+0x62/0x2c0 [kvm] Aug 22 20:36:14 juju-e4d256-prod-github-runner-207 kernel: [54748.604014] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 20:36:14 juju-e4d256-prod-github-runner-207 kernel: [54748.604822] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 20:36:14 juju-e4d256-prod-github-runner-207 kernel: [54748.605676] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 20:36:14 juju-e4d256-prod-github-runner-207 kernel: [54748.606513] ? __seccomp_filter+0x4a/0x4a0 Aug 22 20:36:14 juju-e4d256-prod-github-runner-207 kernel: [54748.607263] ? __fget_files+0x86/0xc0 Aug 22 20:36:14 juju-e4d256-prod-github-runner-207 kernel: [54748.607997] __x64_sys_ioctl+0x95/0xd0 Aug 22 20:36:14 juju-e4d256-prod-github-runner-207 kernel: [54748.608690] do_syscall_64+0x5c/0xc0 Aug 22 20:36:14 juju-e4d256-prod-github-runner-207 kernel: [54748.609371] ? do_futex+0x162/0x1f0 Aug 22 20:36:14 juju-e4d256-prod-github-runner-207 kernel: [54748.610027] ? __x64_sys_futex+0x78/0x1e0 Aug 22 20:36:14 juju-e4d256-prod-github-runner-207 kernel: [54748.610711] ? __secure_computing+0xa9/0x120 Aug 22 20:36:14 juju-e4d256-prod-github-runner-207 kernel: [54748.611424] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 20:36:14 juju-e4d256-prod-github-runner-207 kernel: [54748.612192] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:36:14 juju-e4d256-prod-github-runner-207 kernel: [54748.612925] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:36:14 juju-e4d256-prod-github-runner-207 kernel: [54748.613642] ? do_syscall_64+0x69/0xc0 Aug 22 20:36:14 juju-e4d256-prod-github-runner-207 kernel: [54748.614323] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:36:14 juju-e4d256-prod-github-runner-207 kernel: [54748.615029] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:36:14 juju-e4d256-prod-github-runner-207 kernel: [54748.615741] ? do_syscall_64+0x69/0xc0 Aug 22 20:36:14 juju-e4d256-prod-github-runner-207 kernel: [54748.616376] ? do_syscall_64+0x69/0xc0 Aug 22 20:36:14 juju-e4d256-prod-github-runner-207 kernel: [54748.616998] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 20:36:14 juju-e4d256-prod-github-runner-207 kernel: [54748.617704] RIP: 0033:0x7faa5d0edaff Aug 22 20:36:14 juju-e4d256-prod-github-runner-207 kernel: [54748.618350] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 20:36:14 juju-e4d256-prod-github-runner-207 kernel: [54748.620341] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 20:36:14 juju-e4d256-prod-github-runner-207 kernel: [54748.621255] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 20:36:14 juju-e4d256-prod-github-runner-207 kernel: [54748.622150] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 20:36:14 juju-e4d256-prod-github-runner-207 kernel: [54748.623047] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 20:36:14 juju-e4d256-prod-github-runner-207 kernel: [54748.623936] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 20:36:14 juju-e4d256-prod-github-runner-207 kernel: [54748.624847] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 20:36:14 juju-e4d256-prod-github-runner-207 kernel: [54748.625739] Aug 22 20:36:42 juju-e4d256-prod-github-runner-207 kernel: [54776.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 50906s! [qemu-system-x86:6715] Aug 22 20:36:42 juju-e4d256-prod-github-runner-207 kernel: [54776.543141] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 20:36:42 juju-e4d256-prod-github-runner-207 kernel: [54776.543215] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 20:36:42 juju-e4d256-prod-github-runner-207 kernel: [54776.555468] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 20:36:42 juju-e4d256-prod-github-runner-207 kernel: [54776.556857] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 20:36:42 juju-e4d256-prod-github-runner-207 kernel: [54776.558190] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:36:42 juju-e4d256-prod-github-runner-207 kernel: [54776.559266] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 20:36:42 juju-e4d256-prod-github-runner-207 kernel: [54776.561866] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 20:36:42 juju-e4d256-prod-github-runner-207 kernel: [54776.562975] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 20:36:42 juju-e4d256-prod-github-runner-207 kernel: [54776.564347] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 20:36:42 juju-e4d256-prod-github-runner-207 kernel: [54776.565666] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 20:36:42 juju-e4d256-prod-github-runner-207 kernel: [54776.566932] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 20:36:42 juju-e4d256-prod-github-runner-207 kernel: [54776.568094] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 20:36:42 juju-e4d256-prod-github-runner-207 kernel: [54776.569265] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 20:36:42 juju-e4d256-prod-github-runner-207 kernel: [54776.570524] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 20:36:42 juju-e4d256-prod-github-runner-207 kernel: [54776.571631] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 20:36:42 juju-e4d256-prod-github-runner-207 kernel: [54776.572838] Call Trace: Aug 22 20:36:42 juju-e4d256-prod-github-runner-207 kernel: [54776.573753] Aug 22 20:36:42 juju-e4d256-prod-github-runner-207 kernel: [54776.574666] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:36:42 juju-e4d256-prod-github-runner-207 kernel: [54776.575700] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:36:42 juju-e4d256-prod-github-runner-207 kernel: [54776.576723] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:36:42 juju-e4d256-prod-github-runner-207 kernel: [54776.577807] ? show_regs.part.0+0x23/0x29 Aug 22 20:36:42 juju-e4d256-prod-github-runner-207 kernel: [54776.578869] ? show_regs.cold+0x8/0xd Aug 22 20:36:42 juju-e4d256-prod-github-runner-207 kernel: [54776.579863] ? watchdog_timer_fn+0x1be/0x220 Aug 22 20:36:42 juju-e4d256-prod-github-runner-207 kernel: [54776.580876] ? lockup_detector_update_enable+0x60/0x60 Aug 22 20:36:42 juju-e4d256-prod-github-runner-207 kernel: [54776.581966] ? __hrtimer_run_queues+0x107/0x230 Aug 22 20:36:42 juju-e4d256-prod-github-runner-207 kernel: [54776.583033] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 20:36:42 juju-e4d256-prod-github-runner-207 kernel: [54776.584120] ? hrtimer_interrupt+0x101/0x220 Aug 22 20:36:42 juju-e4d256-prod-github-runner-207 kernel: [54776.585188] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 20:36:42 juju-e4d256-prod-github-runner-207 kernel: [54776.586307] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 20:36:42 juju-e4d256-prod-github-runner-207 kernel: [54776.587391] Aug 22 20:36:42 juju-e4d256-prod-github-runner-207 kernel: [54776.588302] Aug 22 20:36:42 juju-e4d256-prod-github-runner-207 kernel: [54776.589235] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 20:36:42 juju-e4d256-prod-github-runner-207 kernel: [54776.590329] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:36:42 juju-e4d256-prod-github-runner-207 kernel: [54776.591430] ? _raw_spin_lock+0x22/0x30 Aug 22 20:36:42 juju-e4d256-prod-github-runner-207 kernel: [54776.592446] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:36:42 juju-e4d256-prod-github-runner-207 kernel: [54776.593601] direct_page_fault+0x206/0x310 [kvm] Aug 22 20:36:42 juju-e4d256-prod-github-runner-207 kernel: [54776.594730] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 20:36:42 juju-e4d256-prod-github-runner-207 kernel: [54776.595760] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 20:36:42 juju-e4d256-prod-github-runner-207 kernel: [54776.596791] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 20:36:42 juju-e4d256-prod-github-runner-207 kernel: [54776.597775] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 20:36:42 juju-e4d256-prod-github-runner-207 kernel: [54776.598797] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 20:36:42 juju-e4d256-prod-github-runner-207 kernel: [54776.599857] handle_exit+0x98/0x230 [kvm_amd] Aug 22 20:36:42 juju-e4d256-prod-github-runner-207 kernel: [54776.600832] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 20:36:42 juju-e4d256-prod-github-runner-207 kernel: [54776.601785] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 20:36:42 juju-e4d256-prod-github-runner-207 kernel: [54776.602812] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 20:36:42 juju-e4d256-prod-github-runner-207 kernel: [54776.603784] vcpu_run+0x62/0x2c0 [kvm] Aug 22 20:36:42 juju-e4d256-prod-github-runner-207 kernel: [54776.604722] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 20:36:42 juju-e4d256-prod-github-runner-207 kernel: [54776.605620] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 20:36:42 juju-e4d256-prod-github-runner-207 kernel: [54776.606509] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 20:36:42 juju-e4d256-prod-github-runner-207 kernel: [54776.607348] ? __seccomp_filter+0x4a/0x4a0 Aug 22 20:36:42 juju-e4d256-prod-github-runner-207 kernel: [54776.608113] ? __fget_files+0x86/0xc0 Aug 22 20:36:42 juju-e4d256-prod-github-runner-207 kernel: [54776.609017] __x64_sys_ioctl+0x95/0xd0 Aug 22 20:36:42 juju-e4d256-prod-github-runner-207 kernel: [54776.609759] do_syscall_64+0x5c/0xc0 Aug 22 20:36:42 juju-e4d256-prod-github-runner-207 kernel: [54776.610454] ? do_futex+0x162/0x1f0 Aug 22 20:36:42 juju-e4d256-prod-github-runner-207 kernel: [54776.611107] ? __x64_sys_futex+0x78/0x1e0 Aug 22 20:36:42 juju-e4d256-prod-github-runner-207 kernel: [54776.611784] ? __secure_computing+0xa9/0x120 Aug 22 20:36:42 juju-e4d256-prod-github-runner-207 kernel: [54776.612477] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 20:36:42 juju-e4d256-prod-github-runner-207 kernel: [54776.613262] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:36:42 juju-e4d256-prod-github-runner-207 kernel: [54776.614040] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:36:42 juju-e4d256-prod-github-runner-207 kernel: [54776.614772] ? do_syscall_64+0x69/0xc0 Aug 22 20:36:42 juju-e4d256-prod-github-runner-207 kernel: [54776.615443] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:36:42 juju-e4d256-prod-github-runner-207 kernel: [54776.616223] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:36:42 juju-e4d256-prod-github-runner-207 kernel: [54776.616951] ? do_syscall_64+0x69/0xc0 Aug 22 20:36:42 juju-e4d256-prod-github-runner-207 kernel: [54776.617582] ? do_syscall_64+0x69/0xc0 Aug 22 20:36:42 juju-e4d256-prod-github-runner-207 kernel: [54776.618246] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 20:36:42 juju-e4d256-prod-github-runner-207 kernel: [54776.618973] RIP: 0033:0x7faa5d0edaff Aug 22 20:36:42 juju-e4d256-prod-github-runner-207 kernel: [54776.619606] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 20:36:42 juju-e4d256-prod-github-runner-207 kernel: [54776.621637] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 20:36:42 juju-e4d256-prod-github-runner-207 kernel: [54776.622568] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 20:36:42 juju-e4d256-prod-github-runner-207 kernel: [54776.623798] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 20:36:42 juju-e4d256-prod-github-runner-207 kernel: [54776.625074] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 20:36:42 juju-e4d256-prod-github-runner-207 kernel: [54776.626515] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 20:36:42 juju-e4d256-prod-github-runner-207 kernel: [54776.627434] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 20:36:42 juju-e4d256-prod-github-runner-207 kernel: [54776.628362] Aug 22 20:37:10 juju-e4d256-prod-github-runner-207 kernel: [54804.541981] watchdog: BUG: soft lockup - CPU#1 stuck for 50932s! [qemu-system-x86:6715] Aug 22 20:37:10 juju-e4d256-prod-github-runner-207 kernel: [54804.543130] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 20:37:10 juju-e4d256-prod-github-runner-207 kernel: [54804.543204] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 20:37:10 juju-e4d256-prod-github-runner-207 kernel: [54804.555456] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 20:37:10 juju-e4d256-prod-github-runner-207 kernel: [54804.556722] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 20:37:10 juju-e4d256-prod-github-runner-207 kernel: [54804.557976] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:37:10 juju-e4d256-prod-github-runner-207 kernel: [54804.559067] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 20:37:10 juju-e4d256-prod-github-runner-207 kernel: [54804.561640] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 20:37:10 juju-e4d256-prod-github-runner-207 kernel: [54804.562683] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 20:37:10 juju-e4d256-prod-github-runner-207 kernel: [54804.563859] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 20:37:10 juju-e4d256-prod-github-runner-207 kernel: [54804.565035] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 20:37:10 juju-e4d256-prod-github-runner-207 kernel: [54804.566261] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 20:37:10 juju-e4d256-prod-github-runner-207 kernel: [54804.567438] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 20:37:10 juju-e4d256-prod-github-runner-207 kernel: [54804.568604] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 20:37:10 juju-e4d256-prod-github-runner-207 kernel: [54804.569859] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 20:37:10 juju-e4d256-prod-github-runner-207 kernel: [54804.570960] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 20:37:10 juju-e4d256-prod-github-runner-207 kernel: [54804.572157] Call Trace: Aug 22 20:37:10 juju-e4d256-prod-github-runner-207 kernel: [54804.573074] Aug 22 20:37:10 juju-e4d256-prod-github-runner-207 kernel: [54804.573978] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:37:10 juju-e4d256-prod-github-runner-207 kernel: [54804.575009] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:37:10 juju-e4d256-prod-github-runner-207 kernel: [54804.576029] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:37:10 juju-e4d256-prod-github-runner-207 kernel: [54804.577119] ? show_regs.part.0+0x23/0x29 Aug 22 20:37:10 juju-e4d256-prod-github-runner-207 kernel: [54804.578139] ? show_regs.cold+0x8/0xd Aug 22 20:37:10 juju-e4d256-prod-github-runner-207 kernel: [54804.579113] ? watchdog_timer_fn+0x1be/0x220 Aug 22 20:37:10 juju-e4d256-prod-github-runner-207 kernel: [54804.580120] ? lockup_detector_update_enable+0x60/0x60 Aug 22 20:37:10 juju-e4d256-prod-github-runner-207 kernel: [54804.581182] ? __hrtimer_run_queues+0x107/0x230 Aug 22 20:37:10 juju-e4d256-prod-github-runner-207 kernel: [54804.582237] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 20:37:10 juju-e4d256-prod-github-runner-207 kernel: [54804.583268] ? hrtimer_interrupt+0x101/0x220 Aug 22 20:37:10 juju-e4d256-prod-github-runner-207 kernel: [54804.584285] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 20:37:10 juju-e4d256-prod-github-runner-207 kernel: [54804.585363] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 20:37:10 juju-e4d256-prod-github-runner-207 kernel: [54804.586502] Aug 22 20:37:10 juju-e4d256-prod-github-runner-207 kernel: [54804.587377] Aug 22 20:37:10 juju-e4d256-prod-github-runner-207 kernel: [54804.588241] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 20:37:10 juju-e4d256-prod-github-runner-207 kernel: [54804.589288] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:37:10 juju-e4d256-prod-github-runner-207 kernel: [54804.590358] ? _raw_spin_lock+0x22/0x30 Aug 22 20:37:10 juju-e4d256-prod-github-runner-207 kernel: [54804.591336] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:37:10 juju-e4d256-prod-github-runner-207 kernel: [54804.592362] direct_page_fault+0x206/0x310 [kvm] Aug 22 20:37:10 juju-e4d256-prod-github-runner-207 kernel: [54804.593382] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 20:37:10 juju-e4d256-prod-github-runner-207 kernel: [54804.594411] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 20:37:10 juju-e4d256-prod-github-runner-207 kernel: [54804.595426] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 20:37:10 juju-e4d256-prod-github-runner-207 kernel: [54804.596424] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 20:37:10 juju-e4d256-prod-github-runner-207 kernel: [54804.597653] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 20:37:10 juju-e4d256-prod-github-runner-207 kernel: [54804.598644] handle_exit+0x98/0x230 [kvm_amd] Aug 22 20:37:10 juju-e4d256-prod-github-runner-207 kernel: [54804.599537] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 20:37:10 juju-e4d256-prod-github-runner-207 kernel: [54804.600449] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 20:37:10 juju-e4d256-prod-github-runner-207 kernel: [54804.601374] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 20:37:10 juju-e4d256-prod-github-runner-207 kernel: [54804.602289] vcpu_run+0x62/0x2c0 [kvm] Aug 22 20:37:10 juju-e4d256-prod-github-runner-207 kernel: [54804.603105] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 20:37:10 juju-e4d256-prod-github-runner-207 kernel: [54804.603930] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 20:37:10 juju-e4d256-prod-github-runner-207 kernel: [54804.604791] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 20:37:10 juju-e4d256-prod-github-runner-207 kernel: [54804.605601] ? __seccomp_filter+0x4a/0x4a0 Aug 22 20:37:10 juju-e4d256-prod-github-runner-207 kernel: [54804.606344] ? __fget_files+0x86/0xc0 Aug 22 20:37:10 juju-e4d256-prod-github-runner-207 kernel: [54804.607046] __x64_sys_ioctl+0x95/0xd0 Aug 22 20:37:10 juju-e4d256-prod-github-runner-207 kernel: [54804.607742] do_syscall_64+0x5c/0xc0 Aug 22 20:37:10 juju-e4d256-prod-github-runner-207 kernel: [54804.608410] ? do_futex+0x162/0x1f0 Aug 22 20:37:10 juju-e4d256-prod-github-runner-207 kernel: [54804.609064] ? __x64_sys_futex+0x78/0x1e0 Aug 22 20:37:10 juju-e4d256-prod-github-runner-207 kernel: [54804.609755] ? __secure_computing+0xa9/0x120 Aug 22 20:37:10 juju-e4d256-prod-github-runner-207 kernel: [54804.610458] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 20:37:10 juju-e4d256-prod-github-runner-207 kernel: [54804.611230] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:37:10 juju-e4d256-prod-github-runner-207 kernel: [54804.611952] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:37:10 juju-e4d256-prod-github-runner-207 kernel: [54804.612681] ? do_syscall_64+0x69/0xc0 Aug 22 20:37:10 juju-e4d256-prod-github-runner-207 kernel: [54804.613327] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:37:10 juju-e4d256-prod-github-runner-207 kernel: [54804.614057] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:37:10 juju-e4d256-prod-github-runner-207 kernel: [54804.614811] ? do_syscall_64+0x69/0xc0 Aug 22 20:37:10 juju-e4d256-prod-github-runner-207 kernel: [54804.615502] ? do_syscall_64+0x69/0xc0 Aug 22 20:37:10 juju-e4d256-prod-github-runner-207 kernel: [54804.616138] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 20:37:10 juju-e4d256-prod-github-runner-207 kernel: [54804.616854] RIP: 0033:0x7faa5d0edaff Aug 22 20:37:10 juju-e4d256-prod-github-runner-207 kernel: [54804.617502] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 20:37:10 juju-e4d256-prod-github-runner-207 kernel: [54804.619496] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 20:37:10 juju-e4d256-prod-github-runner-207 kernel: [54804.620404] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 20:37:10 juju-e4d256-prod-github-runner-207 kernel: [54804.621299] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 20:37:10 juju-e4d256-prod-github-runner-207 kernel: [54804.622219] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 20:37:10 juju-e4d256-prod-github-runner-207 kernel: [54804.623107] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 20:37:10 juju-e4d256-prod-github-runner-207 kernel: [54804.623999] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 20:37:10 juju-e4d256-prod-github-runner-207 kernel: [54804.624887] Aug 22 20:37:38 juju-e4d256-prod-github-runner-207 kernel: [54832.541981] watchdog: BUG: soft lockup - CPU#1 stuck for 50958s! [qemu-system-x86:6715] Aug 22 20:37:38 juju-e4d256-prod-github-runner-207 kernel: [54832.543856] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 20:37:38 juju-e4d256-prod-github-runner-207 kernel: [54832.544147] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 20:37:38 juju-e4d256-prod-github-runner-207 kernel: [54832.556499] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 20:37:38 juju-e4d256-prod-github-runner-207 kernel: [54832.557789] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 20:37:38 juju-e4d256-prod-github-runner-207 kernel: [54832.559016] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:37:38 juju-e4d256-prod-github-runner-207 kernel: [54832.560075] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 20:37:38 juju-e4d256-prod-github-runner-207 kernel: [54832.562640] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 20:37:38 juju-e4d256-prod-github-runner-207 kernel: [54832.563694] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 20:37:38 juju-e4d256-prod-github-runner-207 kernel: [54832.564862] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 20:37:38 juju-e4d256-prod-github-runner-207 kernel: [54832.566061] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 20:37:38 juju-e4d256-prod-github-runner-207 kernel: [54832.567233] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 20:37:38 juju-e4d256-prod-github-runner-207 kernel: [54832.568395] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 20:37:38 juju-e4d256-prod-github-runner-207 kernel: [54832.569582] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 20:37:38 juju-e4d256-prod-github-runner-207 kernel: [54832.570817] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 20:37:38 juju-e4d256-prod-github-runner-207 kernel: [54832.571929] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 20:37:38 juju-e4d256-prod-github-runner-207 kernel: [54832.573148] Call Trace: Aug 22 20:37:38 juju-e4d256-prod-github-runner-207 kernel: [54832.574064] Aug 22 20:37:38 juju-e4d256-prod-github-runner-207 kernel: [54832.574962] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:37:38 juju-e4d256-prod-github-runner-207 kernel: [54832.576008] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:37:38 juju-e4d256-prod-github-runner-207 kernel: [54832.577042] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:37:38 juju-e4d256-prod-github-runner-207 kernel: [54832.578220] ? show_regs.part.0+0x23/0x29 Aug 22 20:37:38 juju-e4d256-prod-github-runner-207 kernel: [54832.579242] ? show_regs.cold+0x8/0xd Aug 22 20:37:38 juju-e4d256-prod-github-runner-207 kernel: [54832.580225] ? watchdog_timer_fn+0x1be/0x220 Aug 22 20:37:38 juju-e4d256-prod-github-runner-207 kernel: [54832.581259] ? lockup_detector_update_enable+0x60/0x60 Aug 22 20:37:38 juju-e4d256-prod-github-runner-207 kernel: [54832.582358] ? __hrtimer_run_queues+0x107/0x230 Aug 22 20:37:38 juju-e4d256-prod-github-runner-207 kernel: [54832.583510] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 20:37:38 juju-e4d256-prod-github-runner-207 kernel: [54832.584544] ? hrtimer_interrupt+0x101/0x220 Aug 22 20:37:38 juju-e4d256-prod-github-runner-207 kernel: [54832.585586] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 20:37:38 juju-e4d256-prod-github-runner-207 kernel: [54832.586685] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 20:37:38 juju-e4d256-prod-github-runner-207 kernel: [54832.587734] Aug 22 20:37:38 juju-e4d256-prod-github-runner-207 kernel: [54832.588613] Aug 22 20:37:38 juju-e4d256-prod-github-runner-207 kernel: [54832.589502] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 20:37:38 juju-e4d256-prod-github-runner-207 kernel: [54832.590586] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:37:38 juju-e4d256-prod-github-runner-207 kernel: [54832.591634] ? _raw_spin_lock+0x22/0x30 Aug 22 20:37:38 juju-e4d256-prod-github-runner-207 kernel: [54832.592611] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:37:38 juju-e4d256-prod-github-runner-207 kernel: [54832.593965] direct_page_fault+0x206/0x310 [kvm] Aug 22 20:37:38 juju-e4d256-prod-github-runner-207 kernel: [54832.595022] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 20:37:38 juju-e4d256-prod-github-runner-207 kernel: [54832.596038] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 20:37:38 juju-e4d256-prod-github-runner-207 kernel: [54832.597060] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 20:37:38 juju-e4d256-prod-github-runner-207 kernel: [54832.598135] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 20:37:38 juju-e4d256-prod-github-runner-207 kernel: [54832.599185] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 20:37:38 juju-e4d256-prod-github-runner-207 kernel: [54832.600273] handle_exit+0x98/0x230 [kvm_amd] Aug 22 20:37:38 juju-e4d256-prod-github-runner-207 kernel: [54832.601287] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 20:37:38 juju-e4d256-prod-github-runner-207 kernel: [54832.602377] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 20:37:38 juju-e4d256-prod-github-runner-207 kernel: [54832.603349] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 20:37:38 juju-e4d256-prod-github-runner-207 kernel: [54832.604289] vcpu_run+0x62/0x2c0 [kvm] Aug 22 20:37:38 juju-e4d256-prod-github-runner-207 kernel: [54832.605106] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 20:37:38 juju-e4d256-prod-github-runner-207 kernel: [54832.605998] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 20:37:38 juju-e4d256-prod-github-runner-207 kernel: [54832.606879] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 20:37:38 juju-e4d256-prod-github-runner-207 kernel: [54832.607747] ? __seccomp_filter+0x4a/0x4a0 Aug 22 20:37:38 juju-e4d256-prod-github-runner-207 kernel: [54832.608507] ? __fget_files+0x86/0xc0 Aug 22 20:37:38 juju-e4d256-prod-github-runner-207 kernel: [54832.609234] __x64_sys_ioctl+0x95/0xd0 Aug 22 20:37:38 juju-e4d256-prod-github-runner-207 kernel: [54832.609931] do_syscall_64+0x5c/0xc0 Aug 22 20:37:38 juju-e4d256-prod-github-runner-207 kernel: [54832.610599] ? do_futex+0x162/0x1f0 Aug 22 20:37:38 juju-e4d256-prod-github-runner-207 kernel: [54832.611251] ? __x64_sys_futex+0x78/0x1e0 Aug 22 20:37:38 juju-e4d256-prod-github-runner-207 kernel: [54832.611940] ? __secure_computing+0xa9/0x120 Aug 22 20:37:38 juju-e4d256-prod-github-runner-207 kernel: [54832.612648] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 20:37:38 juju-e4d256-prod-github-runner-207 kernel: [54832.613447] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:37:38 juju-e4d256-prod-github-runner-207 kernel: [54832.614173] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:37:38 juju-e4d256-prod-github-runner-207 kernel: [54832.614891] ? do_syscall_64+0x69/0xc0 Aug 22 20:37:38 juju-e4d256-prod-github-runner-207 kernel: [54832.615535] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:37:38 juju-e4d256-prod-github-runner-207 kernel: [54832.616238] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:37:38 juju-e4d256-prod-github-runner-207 kernel: [54832.616940] ? do_syscall_64+0x69/0xc0 Aug 22 20:37:38 juju-e4d256-prod-github-runner-207 kernel: [54832.617582] ? do_syscall_64+0x69/0xc0 Aug 22 20:37:38 juju-e4d256-prod-github-runner-207 kernel: [54832.618206] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 20:37:38 juju-e4d256-prod-github-runner-207 kernel: [54832.618918] RIP: 0033:0x7faa5d0edaff Aug 22 20:37:38 juju-e4d256-prod-github-runner-207 kernel: [54832.619603] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 20:37:38 juju-e4d256-prod-github-runner-207 kernel: [54832.621619] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 20:37:38 juju-e4d256-prod-github-runner-207 kernel: [54832.622570] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 20:37:38 juju-e4d256-prod-github-runner-207 kernel: [54832.623463] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 20:37:38 juju-e4d256-prod-github-runner-207 kernel: [54832.624414] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 20:37:38 juju-e4d256-prod-github-runner-207 kernel: [54832.625418] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 20:37:38 juju-e4d256-prod-github-runner-207 kernel: [54832.626427] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 20:37:38 juju-e4d256-prod-github-runner-207 kernel: [54832.627419] Aug 22 20:38:06 juju-e4d256-prod-github-runner-207 kernel: [54860.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 50984s! [qemu-system-x86:6715] Aug 22 20:38:06 juju-e4d256-prod-github-runner-207 kernel: [54860.543116] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 20:38:06 juju-e4d256-prod-github-runner-207 kernel: [54860.543189] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 20:38:06 juju-e4d256-prod-github-runner-207 kernel: [54860.555447] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 20:38:06 juju-e4d256-prod-github-runner-207 kernel: [54860.556702] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 20:38:06 juju-e4d256-prod-github-runner-207 kernel: [54860.557934] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:38:06 juju-e4d256-prod-github-runner-207 kernel: [54860.558987] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 20:38:06 juju-e4d256-prod-github-runner-207 kernel: [54860.561690] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 20:38:06 juju-e4d256-prod-github-runner-207 kernel: [54860.562806] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 20:38:06 juju-e4d256-prod-github-runner-207 kernel: [54860.563999] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 20:38:06 juju-e4d256-prod-github-runner-207 kernel: [54860.565252] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 20:38:06 juju-e4d256-prod-github-runner-207 kernel: [54860.566490] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 20:38:06 juju-e4d256-prod-github-runner-207 kernel: [54860.567721] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 20:38:06 juju-e4d256-prod-github-runner-207 kernel: [54860.569201] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 20:38:06 juju-e4d256-prod-github-runner-207 kernel: [54860.570493] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 20:38:06 juju-e4d256-prod-github-runner-207 kernel: [54860.571943] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 20:38:06 juju-e4d256-prod-github-runner-207 kernel: [54860.573322] Call Trace: Aug 22 20:38:06 juju-e4d256-prod-github-runner-207 kernel: [54860.574243] Aug 22 20:38:06 juju-e4d256-prod-github-runner-207 kernel: [54860.575131] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:38:06 juju-e4d256-prod-github-runner-207 kernel: [54860.576210] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:38:06 juju-e4d256-prod-github-runner-207 kernel: [54860.577293] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:38:06 juju-e4d256-prod-github-runner-207 kernel: [54860.578439] ? show_regs.part.0+0x23/0x29 Aug 22 20:38:06 juju-e4d256-prod-github-runner-207 kernel: [54860.579485] ? show_regs.cold+0x8/0xd Aug 22 20:38:06 juju-e4d256-prod-github-runner-207 kernel: [54860.580556] ? watchdog_timer_fn+0x1be/0x220 Aug 22 20:38:06 juju-e4d256-prod-github-runner-207 kernel: [54860.581848] ? lockup_detector_update_enable+0x60/0x60 Aug 22 20:38:06 juju-e4d256-prod-github-runner-207 kernel: [54860.583018] ? __hrtimer_run_queues+0x107/0x230 Aug 22 20:38:06 juju-e4d256-prod-github-runner-207 kernel: [54860.584178] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 20:38:06 juju-e4d256-prod-github-runner-207 kernel: [54860.585242] ? hrtimer_interrupt+0x101/0x220 Aug 22 20:38:06 juju-e4d256-prod-github-runner-207 kernel: [54860.586258] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 20:38:06 juju-e4d256-prod-github-runner-207 kernel: [54860.587324] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 20:38:06 juju-e4d256-prod-github-runner-207 kernel: [54860.588426] Aug 22 20:38:06 juju-e4d256-prod-github-runner-207 kernel: [54860.589357] Aug 22 20:38:06 juju-e4d256-prod-github-runner-207 kernel: [54860.590294] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 20:38:06 juju-e4d256-prod-github-runner-207 kernel: [54860.591339] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:38:06 juju-e4d256-prod-github-runner-207 kernel: [54860.592418] ? _raw_spin_lock+0x22/0x30 Aug 22 20:38:06 juju-e4d256-prod-github-runner-207 kernel: [54860.593438] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:38:06 juju-e4d256-prod-github-runner-207 kernel: [54860.594519] direct_page_fault+0x206/0x310 [kvm] Aug 22 20:38:06 juju-e4d256-prod-github-runner-207 kernel: [54860.595582] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 20:38:06 juju-e4d256-prod-github-runner-207 kernel: [54860.596647] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 20:38:06 juju-e4d256-prod-github-runner-207 kernel: [54860.597706] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 20:38:06 juju-e4d256-prod-github-runner-207 kernel: [54860.598678] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 20:38:06 juju-e4d256-prod-github-runner-207 kernel: [54860.599716] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 20:38:06 juju-e4d256-prod-github-runner-207 kernel: [54860.600879] handle_exit+0x98/0x230 [kvm_amd] Aug 22 20:38:06 juju-e4d256-prod-github-runner-207 kernel: [54860.601833] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 20:38:06 juju-e4d256-prod-github-runner-207 kernel: [54860.602824] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 20:38:06 juju-e4d256-prod-github-runner-207 kernel: [54860.603891] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 20:38:06 juju-e4d256-prod-github-runner-207 kernel: [54860.604903] vcpu_run+0x62/0x2c0 [kvm] Aug 22 20:38:06 juju-e4d256-prod-github-runner-207 kernel: [54860.605850] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 20:38:06 juju-e4d256-prod-github-runner-207 kernel: [54860.606715] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 20:38:06 juju-e4d256-prod-github-runner-207 kernel: [54860.607651] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 20:38:06 juju-e4d256-prod-github-runner-207 kernel: [54860.608528] ? __seccomp_filter+0x4a/0x4a0 Aug 22 20:38:06 juju-e4d256-prod-github-runner-207 kernel: [54860.609331] ? __fget_files+0x86/0xc0 Aug 22 20:38:06 juju-e4d256-prod-github-runner-207 kernel: [54860.610132] __x64_sys_ioctl+0x95/0xd0 Aug 22 20:38:06 juju-e4d256-prod-github-runner-207 kernel: [54860.610882] do_syscall_64+0x5c/0xc0 Aug 22 20:38:06 juju-e4d256-prod-github-runner-207 kernel: [54860.611548] ? do_futex+0x162/0x1f0 Aug 22 20:38:06 juju-e4d256-prod-github-runner-207 kernel: [54860.612212] ? __x64_sys_futex+0x78/0x1e0 Aug 22 20:38:06 juju-e4d256-prod-github-runner-207 kernel: [54860.612927] ? __secure_computing+0xa9/0x120 Aug 22 20:38:06 juju-e4d256-prod-github-runner-207 kernel: [54860.613619] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 20:38:06 juju-e4d256-prod-github-runner-207 kernel: [54860.614398] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:38:06 juju-e4d256-prod-github-runner-207 kernel: [54860.615125] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:38:06 juju-e4d256-prod-github-runner-207 kernel: [54860.615843] ? do_syscall_64+0x69/0xc0 Aug 22 20:38:06 juju-e4d256-prod-github-runner-207 kernel: [54860.616497] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:38:06 juju-e4d256-prod-github-runner-207 kernel: [54860.617233] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:38:06 juju-e4d256-prod-github-runner-207 kernel: [54860.617934] ? do_syscall_64+0x69/0xc0 Aug 22 20:38:06 juju-e4d256-prod-github-runner-207 kernel: [54860.618559] ? do_syscall_64+0x69/0xc0 Aug 22 20:38:06 juju-e4d256-prod-github-runner-207 kernel: [54860.619181] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 20:38:06 juju-e4d256-prod-github-runner-207 kernel: [54860.619886] RIP: 0033:0x7faa5d0edaff Aug 22 20:38:06 juju-e4d256-prod-github-runner-207 kernel: [54860.620527] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 20:38:06 juju-e4d256-prod-github-runner-207 kernel: [54860.622535] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 20:38:06 juju-e4d256-prod-github-runner-207 kernel: [54860.623443] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 20:38:06 juju-e4d256-prod-github-runner-207 kernel: [54860.624350] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 20:38:06 juju-e4d256-prod-github-runner-207 kernel: [54860.625286] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 20:38:06 juju-e4d256-prod-github-runner-207 kernel: [54860.626177] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 20:38:06 juju-e4d256-prod-github-runner-207 kernel: [54860.627073] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 20:38:06 juju-e4d256-prod-github-runner-207 kernel: [54860.627961] Aug 22 20:38:34 juju-e4d256-prod-github-runner-207 kernel: [54888.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 51010s! [qemu-system-x86:6715] Aug 22 20:38:34 juju-e4d256-prod-github-runner-207 kernel: [54888.543106] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 20:38:34 juju-e4d256-prod-github-runner-207 kernel: [54888.543185] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 20:38:34 juju-e4d256-prod-github-runner-207 kernel: [54888.555235] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 20:38:34 juju-e4d256-prod-github-runner-207 kernel: [54888.556607] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 20:38:34 juju-e4d256-prod-github-runner-207 kernel: [54888.557994] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:38:34 juju-e4d256-prod-github-runner-207 kernel: [54888.559316] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 20:38:34 juju-e4d256-prod-github-runner-207 kernel: [54888.562236] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 20:38:34 juju-e4d256-prod-github-runner-207 kernel: [54888.563361] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 20:38:34 juju-e4d256-prod-github-runner-207 kernel: [54888.564590] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 20:38:34 juju-e4d256-prod-github-runner-207 kernel: [54888.565835] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 20:38:34 juju-e4d256-prod-github-runner-207 kernel: [54888.567145] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 20:38:34 juju-e4d256-prod-github-runner-207 kernel: [54888.568327] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 20:38:34 juju-e4d256-prod-github-runner-207 kernel: [54888.569520] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 20:38:34 juju-e4d256-prod-github-runner-207 kernel: [54888.570763] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 20:38:34 juju-e4d256-prod-github-runner-207 kernel: [54888.571861] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 20:38:34 juju-e4d256-prod-github-runner-207 kernel: [54888.573064] Call Trace: Aug 22 20:38:34 juju-e4d256-prod-github-runner-207 kernel: [54888.573980] Aug 22 20:38:34 juju-e4d256-prod-github-runner-207 kernel: [54888.574871] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:38:34 juju-e4d256-prod-github-runner-207 kernel: [54888.575930] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:38:34 juju-e4d256-prod-github-runner-207 kernel: [54888.576983] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:38:34 juju-e4d256-prod-github-runner-207 kernel: [54888.578058] ? show_regs.part.0+0x23/0x29 Aug 22 20:38:34 juju-e4d256-prod-github-runner-207 kernel: [54888.579054] ? show_regs.cold+0x8/0xd Aug 22 20:38:34 juju-e4d256-prod-github-runner-207 kernel: [54888.580036] ? watchdog_timer_fn+0x1be/0x220 Aug 22 20:38:34 juju-e4d256-prod-github-runner-207 kernel: [54888.581075] ? lockup_detector_update_enable+0x60/0x60 Aug 22 20:38:34 juju-e4d256-prod-github-runner-207 kernel: [54888.582153] ? __hrtimer_run_queues+0x107/0x230 Aug 22 20:38:34 juju-e4d256-prod-github-runner-207 kernel: [54888.583216] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 20:38:34 juju-e4d256-prod-github-runner-207 kernel: [54888.584299] ? hrtimer_interrupt+0x101/0x220 Aug 22 20:38:34 juju-e4d256-prod-github-runner-207 kernel: [54888.585432] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 20:38:34 juju-e4d256-prod-github-runner-207 kernel: [54888.586540] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 20:38:34 juju-e4d256-prod-github-runner-207 kernel: [54888.587597] Aug 22 20:38:34 juju-e4d256-prod-github-runner-207 kernel: [54888.588469] Aug 22 20:38:34 juju-e4d256-prod-github-runner-207 kernel: [54888.589315] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 20:38:34 juju-e4d256-prod-github-runner-207 kernel: [54888.590364] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:38:34 juju-e4d256-prod-github-runner-207 kernel: [54888.591485] ? _raw_spin_lock+0x22/0x30 Aug 22 20:38:34 juju-e4d256-prod-github-runner-207 kernel: [54888.592588] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:38:34 juju-e4d256-prod-github-runner-207 kernel: [54888.593630] direct_page_fault+0x206/0x310 [kvm] Aug 22 20:38:34 juju-e4d256-prod-github-runner-207 kernel: [54888.594690] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 20:38:34 juju-e4d256-prod-github-runner-207 kernel: [54888.595710] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 20:38:34 juju-e4d256-prod-github-runner-207 kernel: [54888.596759] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 20:38:34 juju-e4d256-prod-github-runner-207 kernel: [54888.597734] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 20:38:34 juju-e4d256-prod-github-runner-207 kernel: [54888.598685] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 20:38:34 juju-e4d256-prod-github-runner-207 kernel: [54888.599687] handle_exit+0x98/0x230 [kvm_amd] Aug 22 20:38:34 juju-e4d256-prod-github-runner-207 kernel: [54888.600606] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 20:38:34 juju-e4d256-prod-github-runner-207 kernel: [54888.601520] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 20:38:34 juju-e4d256-prod-github-runner-207 kernel: [54888.602447] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 20:38:34 juju-e4d256-prod-github-runner-207 kernel: [54888.603348] vcpu_run+0x62/0x2c0 [kvm] Aug 22 20:38:34 juju-e4d256-prod-github-runner-207 kernel: [54888.604167] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 20:38:34 juju-e4d256-prod-github-runner-207 kernel: [54888.605032] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 20:38:34 juju-e4d256-prod-github-runner-207 kernel: [54888.606118] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 20:38:34 juju-e4d256-prod-github-runner-207 kernel: [54888.607159] ? __seccomp_filter+0x4a/0x4a0 Aug 22 20:38:34 juju-e4d256-prod-github-runner-207 kernel: [54888.607912] ? __fget_files+0x86/0xc0 Aug 22 20:38:34 juju-e4d256-prod-github-runner-207 kernel: [54888.608646] __x64_sys_ioctl+0x95/0xd0 Aug 22 20:38:34 juju-e4d256-prod-github-runner-207 kernel: [54888.609348] do_syscall_64+0x5c/0xc0 Aug 22 20:38:34 juju-e4d256-prod-github-runner-207 kernel: [54888.610030] ? do_futex+0x162/0x1f0 Aug 22 20:38:34 juju-e4d256-prod-github-runner-207 kernel: [54888.610699] ? __x64_sys_futex+0x78/0x1e0 Aug 22 20:38:34 juju-e4d256-prod-github-runner-207 kernel: [54888.611385] ? __secure_computing+0xa9/0x120 Aug 22 20:38:34 juju-e4d256-prod-github-runner-207 kernel: [54888.612083] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 20:38:34 juju-e4d256-prod-github-runner-207 kernel: [54888.612876] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:38:34 juju-e4d256-prod-github-runner-207 kernel: [54888.613662] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:38:34 juju-e4d256-prod-github-runner-207 kernel: [54888.614416] ? do_syscall_64+0x69/0xc0 Aug 22 20:38:34 juju-e4d256-prod-github-runner-207 kernel: [54888.615063] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:38:34 juju-e4d256-prod-github-runner-207 kernel: [54888.615821] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:38:34 juju-e4d256-prod-github-runner-207 kernel: [54888.616540] ? do_syscall_64+0x69/0xc0 Aug 22 20:38:34 juju-e4d256-prod-github-runner-207 kernel: [54888.617168] ? do_syscall_64+0x69/0xc0 Aug 22 20:38:34 juju-e4d256-prod-github-runner-207 kernel: [54888.617791] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 20:38:34 juju-e4d256-prod-github-runner-207 kernel: [54888.618503] RIP: 0033:0x7faa5d0edaff Aug 22 20:38:34 juju-e4d256-prod-github-runner-207 kernel: [54888.619130] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 20:38:34 juju-e4d256-prod-github-runner-207 kernel: [54888.621139] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 20:38:34 juju-e4d256-prod-github-runner-207 kernel: [54888.622055] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 20:38:34 juju-e4d256-prod-github-runner-207 kernel: [54888.622944] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 20:38:34 juju-e4d256-prod-github-runner-207 kernel: [54888.623835] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 20:38:34 juju-e4d256-prod-github-runner-207 kernel: [54888.624814] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 20:38:34 juju-e4d256-prod-github-runner-207 kernel: [54888.625994] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 20:38:34 juju-e4d256-prod-github-runner-207 kernel: [54888.627162] Aug 22 20:38:46 juju-e4d256-prod-github-runner-207 kernel: [54900.848709] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 20:38:46 juju-e4d256-prod-github-runner-207 kernel: [54900.850450] rcu: 1-....: (13652793 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=6599602 Aug 22 20:38:46 juju-e4d256-prod-github-runner-207 kernel: [54900.851583] (t=13695912 jiffies g=23269 q=50718) Aug 22 20:38:46 juju-e4d256-prod-github-runner-207 kernel: [54900.852401] NMI backtrace for cpu 1 Aug 22 20:38:46 juju-e4d256-prod-github-runner-207 kernel: [54900.853110] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 20:38:46 juju-e4d256-prod-github-runner-207 kernel: [54900.854221] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 20:38:46 juju-e4d256-prod-github-runner-207 kernel: [54900.855317] Call Trace: Aug 22 20:38:46 juju-e4d256-prod-github-runner-207 kernel: [54900.856007] Aug 22 20:38:46 juju-e4d256-prod-github-runner-207 kernel: [54900.856690] show_stack+0x52/0x5c Aug 22 20:38:46 juju-e4d256-prod-github-runner-207 kernel: [54900.857418] dump_stack_lvl+0x4a/0x63 Aug 22 20:38:46 juju-e4d256-prod-github-runner-207 kernel: [54900.858163] dump_stack+0x10/0x16 Aug 22 20:38:46 juju-e4d256-prod-github-runner-207 kernel: [54900.858879] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 20:38:46 juju-e4d256-prod-github-runner-207 kernel: [54900.859664] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 20:38:46 juju-e4d256-prod-github-runner-207 kernel: [54900.860457] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 20:38:46 juju-e4d256-prod-github-runner-207 kernel: [54900.861283] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 20:38:46 juju-e4d256-prod-github-runner-207 kernel: [54900.862124] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 20:38:46 juju-e4d256-prod-github-runner-207 kernel: [54900.862932] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 20:38:46 juju-e4d256-prod-github-runner-207 kernel: [54900.863711] print_cpu_stall.cold+0x2f/0xe2 Aug 22 20:38:46 juju-e4d256-prod-github-runner-207 kernel: [54900.864508] ? timekeeping_update+0xf7/0x150 Aug 22 20:38:46 juju-e4d256-prod-github-runner-207 kernel: [54900.865282] check_cpu_stall+0x109/0x270 Aug 22 20:38:46 juju-e4d256-prod-github-runner-207 kernel: [54900.866036] rcu_sched_clock_irq+0x9a/0x250 Aug 22 20:38:46 juju-e4d256-prod-github-runner-207 kernel: [54900.866814] update_process_times+0x94/0xd0 Aug 22 20:38:46 juju-e4d256-prod-github-runner-207 kernel: [54900.867572] tick_sched_handle+0x29/0x70 Aug 22 20:38:46 juju-e4d256-prod-github-runner-207 kernel: [54900.868338] tick_sched_timer+0x8c/0xc0 Aug 22 20:38:46 juju-e4d256-prod-github-runner-207 kernel: [54900.869076] ? tick_nohz_handler+0xb0/0xb0 Aug 22 20:38:46 juju-e4d256-prod-github-runner-207 kernel: [54900.869833] __hrtimer_run_queues+0x107/0x230 Aug 22 20:38:46 juju-e4d256-prod-github-runner-207 kernel: [54900.870607] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 20:38:46 juju-e4d256-prod-github-runner-207 kernel: [54900.871394] hrtimer_interrupt+0x101/0x220 Aug 22 20:38:46 juju-e4d256-prod-github-runner-207 kernel: [54900.872159] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 20:38:46 juju-e4d256-prod-github-runner-207 kernel: [54900.872991] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 20:38:46 juju-e4d256-prod-github-runner-207 kernel: [54900.873793] Aug 22 20:38:46 juju-e4d256-prod-github-runner-207 kernel: [54900.874428] Aug 22 20:38:46 juju-e4d256-prod-github-runner-207 kernel: [54900.875056] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 20:38:46 juju-e4d256-prod-github-runner-207 kernel: [54900.875874] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:38:46 juju-e4d256-prod-github-runner-207 kernel: [54900.876770] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 20:38:46 juju-e4d256-prod-github-runner-207 kernel: [54900.878974] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 20:38:46 juju-e4d256-prod-github-runner-207 kernel: [54900.879846] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 20:38:46 juju-e4d256-prod-github-runner-207 kernel: [54900.880866] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 20:38:46 juju-e4d256-prod-github-runner-207 kernel: [54900.881848] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 20:38:46 juju-e4d256-prod-github-runner-207 kernel: [54900.882812] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 20:38:46 juju-e4d256-prod-github-runner-207 kernel: [54900.883765] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 20:38:46 juju-e4d256-prod-github-runner-207 kernel: [54900.884742] ? _raw_spin_lock+0x22/0x30 Aug 22 20:38:46 juju-e4d256-prod-github-runner-207 kernel: [54900.885580] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:38:46 juju-e4d256-prod-github-runner-207 kernel: [54900.886550] direct_page_fault+0x206/0x310 [kvm] Aug 22 20:38:46 juju-e4d256-prod-github-runner-207 kernel: [54900.887461] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 20:38:46 juju-e4d256-prod-github-runner-207 kernel: [54900.888350] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 20:38:46 juju-e4d256-prod-github-runner-207 kernel: [54900.889379] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 20:38:46 juju-e4d256-prod-github-runner-207 kernel: [54900.890224] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 20:38:46 juju-e4d256-prod-github-runner-207 kernel: [54900.891014] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 20:38:46 juju-e4d256-prod-github-runner-207 kernel: [54900.891864] handle_exit+0x98/0x230 [kvm_amd] Aug 22 20:38:46 juju-e4d256-prod-github-runner-207 kernel: [54900.892658] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 20:38:46 juju-e4d256-prod-github-runner-207 kernel: [54900.893445] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 20:38:46 juju-e4d256-prod-github-runner-207 kernel: [54900.894253] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 20:38:46 juju-e4d256-prod-github-runner-207 kernel: [54900.895053] vcpu_run+0x62/0x2c0 [kvm] Aug 22 20:38:46 juju-e4d256-prod-github-runner-207 kernel: [54900.895767] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 20:38:46 juju-e4d256-prod-github-runner-207 kernel: [54900.896537] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 20:38:46 juju-e4d256-prod-github-runner-207 kernel: [54900.897346] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 20:38:46 juju-e4d256-prod-github-runner-207 kernel: [54900.898129] ? __seccomp_filter+0x4a/0x4a0 Aug 22 20:38:46 juju-e4d256-prod-github-runner-207 kernel: [54900.898849] ? __fget_files+0x86/0xc0 Aug 22 20:38:46 juju-e4d256-prod-github-runner-207 kernel: [54900.899541] __x64_sys_ioctl+0x95/0xd0 Aug 22 20:38:46 juju-e4d256-prod-github-runner-207 kernel: [54900.900368] do_syscall_64+0x5c/0xc0 Aug 22 20:38:46 juju-e4d256-prod-github-runner-207 kernel: [54900.901062] ? do_futex+0x162/0x1f0 Aug 22 20:38:46 juju-e4d256-prod-github-runner-207 kernel: [54900.901737] ? __x64_sys_futex+0x78/0x1e0 Aug 22 20:38:46 juju-e4d256-prod-github-runner-207 kernel: [54900.902444] ? __secure_computing+0xa9/0x120 Aug 22 20:38:46 juju-e4d256-prod-github-runner-207 kernel: [54900.903161] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 20:38:46 juju-e4d256-prod-github-runner-207 kernel: [54900.903952] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:38:46 juju-e4d256-prod-github-runner-207 kernel: [54900.904724] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:38:46 juju-e4d256-prod-github-runner-207 kernel: [54900.905491] ? do_syscall_64+0x69/0xc0 Aug 22 20:38:46 juju-e4d256-prod-github-runner-207 kernel: [54900.906182] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:38:46 juju-e4d256-prod-github-runner-207 kernel: [54900.906960] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:38:46 juju-e4d256-prod-github-runner-207 kernel: [54900.907719] ? do_syscall_64+0x69/0xc0 Aug 22 20:38:46 juju-e4d256-prod-github-runner-207 kernel: [54900.908432] ? do_syscall_64+0x69/0xc0 Aug 22 20:38:46 juju-e4d256-prod-github-runner-207 kernel: [54900.909122] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 20:38:46 juju-e4d256-prod-github-runner-207 kernel: [54900.909908] RIP: 0033:0x7faa5d0edaff Aug 22 20:38:46 juju-e4d256-prod-github-runner-207 kernel: [54900.910622] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 20:38:46 juju-e4d256-prod-github-runner-207 kernel: [54900.912740] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 20:38:46 juju-e4d256-prod-github-runner-207 kernel: [54900.913712] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 20:38:46 juju-e4d256-prod-github-runner-207 kernel: [54900.914658] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 20:38:46 juju-e4d256-prod-github-runner-207 kernel: [54900.915653] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 20:38:46 juju-e4d256-prod-github-runner-207 kernel: [54900.916622] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 20:38:46 juju-e4d256-prod-github-runner-207 kernel: [54900.917547] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 20:38:46 juju-e4d256-prod-github-runner-207 kernel: [54900.918473] Aug 22 20:39:14 juju-e4d256-prod-github-runner-207 kernel: [54928.541981] watchdog: BUG: soft lockup - CPU#1 stuck for 51048s! [qemu-system-x86:6715] Aug 22 20:39:14 juju-e4d256-prod-github-runner-207 kernel: [54928.543254] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 20:39:14 juju-e4d256-prod-github-runner-207 kernel: [54928.543631] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 20:39:14 juju-e4d256-prod-github-runner-207 kernel: [54928.556778] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 20:39:14 juju-e4d256-prod-github-runner-207 kernel: [54928.558061] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 20:39:14 juju-e4d256-prod-github-runner-207 kernel: [54928.559306] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:39:14 juju-e4d256-prod-github-runner-207 kernel: [54928.560397] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 20:39:14 juju-e4d256-prod-github-runner-207 kernel: [54928.563018] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 20:39:14 juju-e4d256-prod-github-runner-207 kernel: [54928.564105] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 20:39:14 juju-e4d256-prod-github-runner-207 kernel: [54928.565274] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 20:39:14 juju-e4d256-prod-github-runner-207 kernel: [54928.566442] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 20:39:14 juju-e4d256-prod-github-runner-207 kernel: [54928.567618] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 20:39:14 juju-e4d256-prod-github-runner-207 kernel: [54928.568800] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 20:39:14 juju-e4d256-prod-github-runner-207 kernel: [54928.569975] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 20:39:14 juju-e4d256-prod-github-runner-207 kernel: [54928.571216] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 20:39:14 juju-e4d256-prod-github-runner-207 kernel: [54928.572340] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 20:39:14 juju-e4d256-prod-github-runner-207 kernel: [54928.573585] Call Trace: Aug 22 20:39:14 juju-e4d256-prod-github-runner-207 kernel: [54928.574501] Aug 22 20:39:14 juju-e4d256-prod-github-runner-207 kernel: [54928.575508] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:39:14 juju-e4d256-prod-github-runner-207 kernel: [54928.576559] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:39:14 juju-e4d256-prod-github-runner-207 kernel: [54928.577593] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:39:14 juju-e4d256-prod-github-runner-207 kernel: [54928.578690] ? show_regs.part.0+0x23/0x29 Aug 22 20:39:14 juju-e4d256-prod-github-runner-207 kernel: [54928.579689] ? show_regs.cold+0x8/0xd Aug 22 20:39:14 juju-e4d256-prod-github-runner-207 kernel: [54928.580676] ? watchdog_timer_fn+0x1be/0x220 Aug 22 20:39:14 juju-e4d256-prod-github-runner-207 kernel: [54928.581692] ? lockup_detector_update_enable+0x60/0x60 Aug 22 20:39:14 juju-e4d256-prod-github-runner-207 kernel: [54928.582770] ? __hrtimer_run_queues+0x107/0x230 Aug 22 20:39:14 juju-e4d256-prod-github-runner-207 kernel: [54928.583801] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 20:39:14 juju-e4d256-prod-github-runner-207 kernel: [54928.584840] ? hrtimer_interrupt+0x101/0x220 Aug 22 20:39:14 juju-e4d256-prod-github-runner-207 kernel: [54928.585858] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 20:39:14 juju-e4d256-prod-github-runner-207 kernel: [54928.586930] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 20:39:14 juju-e4d256-prod-github-runner-207 kernel: [54928.587996] Aug 22 20:39:14 juju-e4d256-prod-github-runner-207 kernel: [54928.588860] Aug 22 20:39:14 juju-e4d256-prod-github-runner-207 kernel: [54928.589700] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 20:39:14 juju-e4d256-prod-github-runner-207 kernel: [54928.590741] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:39:14 juju-e4d256-prod-github-runner-207 kernel: [54928.591805] ? _raw_spin_lock+0x22/0x30 Aug 22 20:39:14 juju-e4d256-prod-github-runner-207 kernel: [54928.592785] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:39:14 juju-e4d256-prod-github-runner-207 kernel: [54928.593819] direct_page_fault+0x206/0x310 [kvm] Aug 22 20:39:14 juju-e4d256-prod-github-runner-207 kernel: [54928.595049] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 20:39:14 juju-e4d256-prod-github-runner-207 kernel: [54928.596109] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 20:39:14 juju-e4d256-prod-github-runner-207 kernel: [54928.597136] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 20:39:14 juju-e4d256-prod-github-runner-207 kernel: [54928.598119] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 20:39:14 juju-e4d256-prod-github-runner-207 kernel: [54928.599073] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 20:39:14 juju-e4d256-prod-github-runner-207 kernel: [54928.600081] handle_exit+0x98/0x230 [kvm_amd] Aug 22 20:39:14 juju-e4d256-prod-github-runner-207 kernel: [54928.600979] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 20:39:14 juju-e4d256-prod-github-runner-207 kernel: [54928.601895] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 20:39:14 juju-e4d256-prod-github-runner-207 kernel: [54928.602827] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 20:39:14 juju-e4d256-prod-github-runner-207 kernel: [54928.603740] vcpu_run+0x62/0x2c0 [kvm] Aug 22 20:39:14 juju-e4d256-prod-github-runner-207 kernel: [54928.604571] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 20:39:14 juju-e4d256-prod-github-runner-207 kernel: [54928.605394] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 20:39:14 juju-e4d256-prod-github-runner-207 kernel: [54928.606250] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 20:39:14 juju-e4d256-prod-github-runner-207 kernel: [54928.607056] ? __seccomp_filter+0x4a/0x4a0 Aug 22 20:39:14 juju-e4d256-prod-github-runner-207 kernel: [54928.607799] ? __fget_files+0x86/0xc0 Aug 22 20:39:14 juju-e4d256-prod-github-runner-207 kernel: [54928.608533] __x64_sys_ioctl+0x95/0xd0 Aug 22 20:39:14 juju-e4d256-prod-github-runner-207 kernel: [54928.609231] do_syscall_64+0x5c/0xc0 Aug 22 20:39:14 juju-e4d256-prod-github-runner-207 kernel: [54928.609907] ? do_futex+0x162/0x1f0 Aug 22 20:39:14 juju-e4d256-prod-github-runner-207 kernel: [54928.610558] ? __x64_sys_futex+0x78/0x1e0 Aug 22 20:39:14 juju-e4d256-prod-github-runner-207 kernel: [54928.611236] ? __secure_computing+0xa9/0x120 Aug 22 20:39:14 juju-e4d256-prod-github-runner-207 kernel: [54928.611942] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 20:39:14 juju-e4d256-prod-github-runner-207 kernel: [54928.612705] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:39:14 juju-e4d256-prod-github-runner-207 kernel: [54928.613428] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:39:14 juju-e4d256-prod-github-runner-207 kernel: [54928.614146] ? do_syscall_64+0x69/0xc0 Aug 22 20:39:14 juju-e4d256-prod-github-runner-207 kernel: [54928.614794] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:39:14 juju-e4d256-prod-github-runner-207 kernel: [54928.615506] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:39:14 juju-e4d256-prod-github-runner-207 kernel: [54928.616225] ? do_syscall_64+0x69/0xc0 Aug 22 20:39:14 juju-e4d256-prod-github-runner-207 kernel: [54928.616856] ? do_syscall_64+0x69/0xc0 Aug 22 20:39:14 juju-e4d256-prod-github-runner-207 kernel: [54928.617479] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 20:39:14 juju-e4d256-prod-github-runner-207 kernel: [54928.618184] RIP: 0033:0x7faa5d0edaff Aug 22 20:39:14 juju-e4d256-prod-github-runner-207 kernel: [54928.618807] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 20:39:14 juju-e4d256-prod-github-runner-207 kernel: [54928.620816] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 20:39:14 juju-e4d256-prod-github-runner-207 kernel: [54928.621727] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 20:39:14 juju-e4d256-prod-github-runner-207 kernel: [54928.622625] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 20:39:14 juju-e4d256-prod-github-runner-207 kernel: [54928.623523] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 20:39:14 juju-e4d256-prod-github-runner-207 kernel: [54928.624436] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 20:39:14 juju-e4d256-prod-github-runner-207 kernel: [54928.625323] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 20:39:14 juju-e4d256-prod-github-runner-207 kernel: [54928.626224] Aug 22 20:39:42 juju-e4d256-prod-github-runner-207 kernel: [54956.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 51074s! [qemu-system-x86:6715] Aug 22 20:39:42 juju-e4d256-prod-github-runner-207 kernel: [54956.543102] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 20:39:42 juju-e4d256-prod-github-runner-207 kernel: [54956.543178] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 20:39:42 juju-e4d256-prod-github-runner-207 kernel: [54956.555286] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 20:39:42 juju-e4d256-prod-github-runner-207 kernel: [54956.556593] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 20:39:42 juju-e4d256-prod-github-runner-207 kernel: [54956.560220] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:39:42 juju-e4d256-prod-github-runner-207 kernel: [54956.561287] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 20:39:42 juju-e4d256-prod-github-runner-207 kernel: [54956.563842] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 20:39:42 juju-e4d256-prod-github-runner-207 kernel: [54956.564887] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 20:39:42 juju-e4d256-prod-github-runner-207 kernel: [54956.566045] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 20:39:42 juju-e4d256-prod-github-runner-207 kernel: [54956.567201] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 20:39:42 juju-e4d256-prod-github-runner-207 kernel: [54956.568369] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 20:39:42 juju-e4d256-prod-github-runner-207 kernel: [54956.569528] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 20:39:42 juju-e4d256-prod-github-runner-207 kernel: [54956.570696] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 20:39:42 juju-e4d256-prod-github-runner-207 kernel: [54956.571944] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 20:39:42 juju-e4d256-prod-github-runner-207 kernel: [54956.573041] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 20:39:42 juju-e4d256-prod-github-runner-207 kernel: [54956.574229] Call Trace: Aug 22 20:39:42 juju-e4d256-prod-github-runner-207 kernel: [54956.575162] Aug 22 20:39:42 juju-e4d256-prod-github-runner-207 kernel: [54956.576094] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:39:42 juju-e4d256-prod-github-runner-207 kernel: [54956.577140] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:39:42 juju-e4d256-prod-github-runner-207 kernel: [54956.578198] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:39:42 juju-e4d256-prod-github-runner-207 kernel: [54956.579275] ? show_regs.part.0+0x23/0x29 Aug 22 20:39:42 juju-e4d256-prod-github-runner-207 kernel: [54956.580296] ? show_regs.cold+0x8/0xd Aug 22 20:39:42 juju-e4d256-prod-github-runner-207 kernel: [54956.581273] ? watchdog_timer_fn+0x1be/0x220 Aug 22 20:39:42 juju-e4d256-prod-github-runner-207 kernel: [54956.582282] ? lockup_detector_update_enable+0x60/0x60 Aug 22 20:39:42 juju-e4d256-prod-github-runner-207 kernel: [54956.583348] ? __hrtimer_run_queues+0x107/0x230 Aug 22 20:39:42 juju-e4d256-prod-github-runner-207 kernel: [54956.584390] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 20:39:42 juju-e4d256-prod-github-runner-207 kernel: [54956.585419] ? hrtimer_interrupt+0x101/0x220 Aug 22 20:39:42 juju-e4d256-prod-github-runner-207 kernel: [54956.586439] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 20:39:42 juju-e4d256-prod-github-runner-207 kernel: [54956.587506] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 20:39:42 juju-e4d256-prod-github-runner-207 kernel: [54956.588583] Aug 22 20:39:42 juju-e4d256-prod-github-runner-207 kernel: [54956.589448] Aug 22 20:39:42 juju-e4d256-prod-github-runner-207 kernel: [54956.590291] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 20:39:42 juju-e4d256-prod-github-runner-207 kernel: [54956.591323] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:39:42 juju-e4d256-prod-github-runner-207 kernel: [54956.592399] ? _raw_spin_lock+0x22/0x30 Aug 22 20:39:42 juju-e4d256-prod-github-runner-207 kernel: [54956.593354] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:39:42 juju-e4d256-prod-github-runner-207 kernel: [54956.594372] direct_page_fault+0x206/0x310 [kvm] Aug 22 20:39:42 juju-e4d256-prod-github-runner-207 kernel: [54956.595400] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 20:39:42 juju-e4d256-prod-github-runner-207 kernel: [54956.596425] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 20:39:42 juju-e4d256-prod-github-runner-207 kernel: [54956.597434] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 20:39:42 juju-e4d256-prod-github-runner-207 kernel: [54956.598405] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 20:39:42 juju-e4d256-prod-github-runner-207 kernel: [54956.599356] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 20:39:42 juju-e4d256-prod-github-runner-207 kernel: [54956.600345] handle_exit+0x98/0x230 [kvm_amd] Aug 22 20:39:42 juju-e4d256-prod-github-runner-207 kernel: [54956.601237] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 20:39:42 juju-e4d256-prod-github-runner-207 kernel: [54956.602154] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 20:39:42 juju-e4d256-prod-github-runner-207 kernel: [54956.603089] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 20:39:42 juju-e4d256-prod-github-runner-207 kernel: [54956.604016] vcpu_run+0x62/0x2c0 [kvm] Aug 22 20:39:42 juju-e4d256-prod-github-runner-207 kernel: [54956.604829] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 20:39:42 juju-e4d256-prod-github-runner-207 kernel: [54956.605642] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 20:39:42 juju-e4d256-prod-github-runner-207 kernel: [54956.606501] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 20:39:42 juju-e4d256-prod-github-runner-207 kernel: [54956.607308] ? __seccomp_filter+0x4a/0x4a0 Aug 22 20:39:42 juju-e4d256-prod-github-runner-207 kernel: [54956.608105] ? __fget_files+0x86/0xc0 Aug 22 20:39:42 juju-e4d256-prod-github-runner-207 kernel: [54956.608821] __x64_sys_ioctl+0x95/0xd0 Aug 22 20:39:42 juju-e4d256-prod-github-runner-207 kernel: [54956.609537] do_syscall_64+0x5c/0xc0 Aug 22 20:39:42 juju-e4d256-prod-github-runner-207 kernel: [54956.610206] ? do_futex+0x162/0x1f0 Aug 22 20:39:42 juju-e4d256-prod-github-runner-207 kernel: [54956.610856] ? __x64_sys_futex+0x78/0x1e0 Aug 22 20:39:42 juju-e4d256-prod-github-runner-207 kernel: [54956.611529] ? __secure_computing+0xa9/0x120 Aug 22 20:39:42 juju-e4d256-prod-github-runner-207 kernel: [54956.612236] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 20:39:42 juju-e4d256-prod-github-runner-207 kernel: [54956.612996] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:39:42 juju-e4d256-prod-github-runner-207 kernel: [54956.613717] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:39:42 juju-e4d256-prod-github-runner-207 kernel: [54956.614451] ? do_syscall_64+0x69/0xc0 Aug 22 20:39:42 juju-e4d256-prod-github-runner-207 kernel: [54956.615100] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:39:42 juju-e4d256-prod-github-runner-207 kernel: [54956.615816] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:39:42 juju-e4d256-prod-github-runner-207 kernel: [54956.616513] ? do_syscall_64+0x69/0xc0 Aug 22 20:39:42 juju-e4d256-prod-github-runner-207 kernel: [54956.617147] ? do_syscall_64+0x69/0xc0 Aug 22 20:39:42 juju-e4d256-prod-github-runner-207 kernel: [54956.617841] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 20:39:42 juju-e4d256-prod-github-runner-207 kernel: [54956.618622] RIP: 0033:0x7faa5d0edaff Aug 22 20:39:42 juju-e4d256-prod-github-runner-207 kernel: [54956.619268] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 20:39:42 juju-e4d256-prod-github-runner-207 kernel: [54956.621260] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 20:39:42 juju-e4d256-prod-github-runner-207 kernel: [54956.622311] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 20:39:42 juju-e4d256-prod-github-runner-207 kernel: [54956.623201] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 20:39:42 juju-e4d256-prod-github-runner-207 kernel: [54956.624104] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 20:39:42 juju-e4d256-prod-github-runner-207 kernel: [54956.624989] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 20:39:42 juju-e4d256-prod-github-runner-207 kernel: [54956.625875] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 20:39:42 juju-e4d256-prod-github-runner-207 kernel: [54956.626765] Aug 22 20:40:10 juju-e4d256-prod-github-runner-207 kernel: [54984.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 51100s! [qemu-system-x86:6715] Aug 22 20:40:10 juju-e4d256-prod-github-runner-207 kernel: [54984.543117] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 20:40:10 juju-e4d256-prod-github-runner-207 kernel: [54984.543192] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 20:40:10 juju-e4d256-prod-github-runner-207 kernel: [54984.555486] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 20:40:10 juju-e4d256-prod-github-runner-207 kernel: [54984.556766] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 20:40:10 juju-e4d256-prod-github-runner-207 kernel: [54984.558026] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:40:10 juju-e4d256-prod-github-runner-207 kernel: [54984.559102] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 20:40:10 juju-e4d256-prod-github-runner-207 kernel: [54984.561691] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 20:40:10 juju-e4d256-prod-github-runner-207 kernel: [54984.562739] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 20:40:10 juju-e4d256-prod-github-runner-207 kernel: [54984.563917] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 20:40:10 juju-e4d256-prod-github-runner-207 kernel: [54984.565088] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 20:40:10 juju-e4d256-prod-github-runner-207 kernel: [54984.566265] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 20:40:10 juju-e4d256-prod-github-runner-207 kernel: [54984.567449] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 20:40:10 juju-e4d256-prod-github-runner-207 kernel: [54984.568630] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 20:40:10 juju-e4d256-prod-github-runner-207 kernel: [54984.569892] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 20:40:10 juju-e4d256-prod-github-runner-207 kernel: [54984.570999] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 20:40:10 juju-e4d256-prod-github-runner-207 kernel: [54984.572244] Call Trace: Aug 22 20:40:10 juju-e4d256-prod-github-runner-207 kernel: [54984.573166] Aug 22 20:40:10 juju-e4d256-prod-github-runner-207 kernel: [54984.574053] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:40:10 juju-e4d256-prod-github-runner-207 kernel: [54984.575100] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:40:10 juju-e4d256-prod-github-runner-207 kernel: [54984.576155] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:40:10 juju-e4d256-prod-github-runner-207 kernel: [54984.577261] ? show_regs.part.0+0x23/0x29 Aug 22 20:40:10 juju-e4d256-prod-github-runner-207 kernel: [54984.578311] ? show_regs.cold+0x8/0xd Aug 22 20:40:10 juju-e4d256-prod-github-runner-207 kernel: [54984.579344] ? watchdog_timer_fn+0x1be/0x220 Aug 22 20:40:10 juju-e4d256-prod-github-runner-207 kernel: [54984.580378] ? lockup_detector_update_enable+0x60/0x60 Aug 22 20:40:10 juju-e4d256-prod-github-runner-207 kernel: [54984.581454] ? __hrtimer_run_queues+0x107/0x230 Aug 22 20:40:10 juju-e4d256-prod-github-runner-207 kernel: [54984.582495] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 20:40:10 juju-e4d256-prod-github-runner-207 kernel: [54984.583562] ? hrtimer_interrupt+0x101/0x220 Aug 22 20:40:10 juju-e4d256-prod-github-runner-207 kernel: [54984.584606] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 20:40:10 juju-e4d256-prod-github-runner-207 kernel: [54984.585695] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 20:40:10 juju-e4d256-prod-github-runner-207 kernel: [54984.586759] Aug 22 20:40:10 juju-e4d256-prod-github-runner-207 kernel: [54984.587630] Aug 22 20:40:10 juju-e4d256-prod-github-runner-207 kernel: [54984.588628] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 20:40:10 juju-e4d256-prod-github-runner-207 kernel: [54984.589875] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:40:10 juju-e4d256-prod-github-runner-207 kernel: [54984.590935] ? _raw_spin_lock+0x22/0x30 Aug 22 20:40:10 juju-e4d256-prod-github-runner-207 kernel: [54984.591910] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:40:10 juju-e4d256-prod-github-runner-207 kernel: [54984.592946] direct_page_fault+0x206/0x310 [kvm] Aug 22 20:40:10 juju-e4d256-prod-github-runner-207 kernel: [54984.593998] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 20:40:10 juju-e4d256-prod-github-runner-207 kernel: [54984.595049] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 20:40:10 juju-e4d256-prod-github-runner-207 kernel: [54984.596087] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 20:40:10 juju-e4d256-prod-github-runner-207 kernel: [54984.597082] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 20:40:10 juju-e4d256-prod-github-runner-207 kernel: [54984.598046] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 20:40:10 juju-e4d256-prod-github-runner-207 kernel: [54984.599056] handle_exit+0x98/0x230 [kvm_amd] Aug 22 20:40:10 juju-e4d256-prod-github-runner-207 kernel: [54984.599991] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 20:40:10 juju-e4d256-prod-github-runner-207 kernel: [54984.600927] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 20:40:10 juju-e4d256-prod-github-runner-207 kernel: [54984.601875] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 20:40:10 juju-e4d256-prod-github-runner-207 kernel: [54984.602800] vcpu_run+0x62/0x2c0 [kvm] Aug 22 20:40:10 juju-e4d256-prod-github-runner-207 kernel: [54984.603643] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 20:40:10 juju-e4d256-prod-github-runner-207 kernel: [54984.604483] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 20:40:10 juju-e4d256-prod-github-runner-207 kernel: [54984.605369] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 20:40:10 juju-e4d256-prod-github-runner-207 kernel: [54984.606187] ? __seccomp_filter+0x4a/0x4a0 Aug 22 20:40:10 juju-e4d256-prod-github-runner-207 kernel: [54984.606946] ? __fget_files+0x86/0xc0 Aug 22 20:40:10 juju-e4d256-prod-github-runner-207 kernel: [54984.607681] __x64_sys_ioctl+0x95/0xd0 Aug 22 20:40:10 juju-e4d256-prod-github-runner-207 kernel: [54984.608396] do_syscall_64+0x5c/0xc0 Aug 22 20:40:10 juju-e4d256-prod-github-runner-207 kernel: [54984.609080] ? do_futex+0x162/0x1f0 Aug 22 20:40:10 juju-e4d256-prod-github-runner-207 kernel: [54984.609754] ? __x64_sys_futex+0x78/0x1e0 Aug 22 20:40:10 juju-e4d256-prod-github-runner-207 kernel: [54984.610455] ? __secure_computing+0xa9/0x120 Aug 22 20:40:10 juju-e4d256-prod-github-runner-207 kernel: [54984.611163] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 20:40:10 juju-e4d256-prod-github-runner-207 kernel: [54984.611957] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:40:10 juju-e4d256-prod-github-runner-207 kernel: [54984.612697] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:40:10 juju-e4d256-prod-github-runner-207 kernel: [54984.613442] ? do_syscall_64+0x69/0xc0 Aug 22 20:40:10 juju-e4d256-prod-github-runner-207 kernel: [54984.614099] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:40:10 juju-e4d256-prod-github-runner-207 kernel: [54984.614827] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:40:10 juju-e4d256-prod-github-runner-207 kernel: [54984.615590] ? do_syscall_64+0x69/0xc0 Aug 22 20:40:10 juju-e4d256-prod-github-runner-207 kernel: [54984.616237] ? do_syscall_64+0x69/0xc0 Aug 22 20:40:10 juju-e4d256-prod-github-runner-207 kernel: [54984.616895] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 20:40:10 juju-e4d256-prod-github-runner-207 kernel: [54984.617613] RIP: 0033:0x7faa5d0edaff Aug 22 20:40:10 juju-e4d256-prod-github-runner-207 kernel: [54984.618255] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 20:40:10 juju-e4d256-prod-github-runner-207 kernel: [54984.620316] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 20:40:10 juju-e4d256-prod-github-runner-207 kernel: [54984.621266] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 20:40:10 juju-e4d256-prod-github-runner-207 kernel: [54984.622183] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 20:40:10 juju-e4d256-prod-github-runner-207 kernel: [54984.623093] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 20:40:10 juju-e4d256-prod-github-runner-207 kernel: [54984.624013] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 20:40:10 juju-e4d256-prod-github-runner-207 kernel: [54984.624980] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 20:40:10 juju-e4d256-prod-github-runner-207 kernel: [54984.625913] Aug 22 20:40:38 juju-e4d256-prod-github-runner-207 kernel: [55012.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 51126s! [qemu-system-x86:6715] Aug 22 20:40:38 juju-e4d256-prod-github-runner-207 kernel: [55012.543855] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 20:40:38 juju-e4d256-prod-github-runner-207 kernel: [55012.544150] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 20:40:38 juju-e4d256-prod-github-runner-207 kernel: [55012.556686] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 20:40:38 juju-e4d256-prod-github-runner-207 kernel: [55012.557951] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 20:40:38 juju-e4d256-prod-github-runner-207 kernel: [55012.559232] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:40:38 juju-e4d256-prod-github-runner-207 kernel: [55012.560294] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 20:40:38 juju-e4d256-prod-github-runner-207 kernel: [55012.562841] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 20:40:38 juju-e4d256-prod-github-runner-207 kernel: [55012.563924] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 20:40:38 juju-e4d256-prod-github-runner-207 kernel: [55012.565112] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 20:40:38 juju-e4d256-prod-github-runner-207 kernel: [55012.566295] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 20:40:38 juju-e4d256-prod-github-runner-207 kernel: [55012.567476] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 20:40:38 juju-e4d256-prod-github-runner-207 kernel: [55012.568645] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 20:40:38 juju-e4d256-prod-github-runner-207 kernel: [55012.569813] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 20:40:38 juju-e4d256-prod-github-runner-207 kernel: [55012.571060] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 20:40:38 juju-e4d256-prod-github-runner-207 kernel: [55012.572160] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 20:40:38 juju-e4d256-prod-github-runner-207 kernel: [55012.573352] Call Trace: Aug 22 20:40:38 juju-e4d256-prod-github-runner-207 kernel: [55012.574262] Aug 22 20:40:38 juju-e4d256-prod-github-runner-207 kernel: [55012.575172] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:40:38 juju-e4d256-prod-github-runner-207 kernel: [55012.576200] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:40:38 juju-e4d256-prod-github-runner-207 kernel: [55012.577229] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:40:38 juju-e4d256-prod-github-runner-207 kernel: [55012.578328] ? show_regs.part.0+0x23/0x29 Aug 22 20:40:38 juju-e4d256-prod-github-runner-207 kernel: [55012.579338] ? show_regs.cold+0x8/0xd Aug 22 20:40:38 juju-e4d256-prod-github-runner-207 kernel: [55012.580309] ? watchdog_timer_fn+0x1be/0x220 Aug 22 20:40:38 juju-e4d256-prod-github-runner-207 kernel: [55012.581314] ? lockup_detector_update_enable+0x60/0x60 Aug 22 20:40:38 juju-e4d256-prod-github-runner-207 kernel: [55012.582374] ? __hrtimer_run_queues+0x107/0x230 Aug 22 20:40:38 juju-e4d256-prod-github-runner-207 kernel: [55012.583416] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 20:40:38 juju-e4d256-prod-github-runner-207 kernel: [55012.584445] ? hrtimer_interrupt+0x101/0x220 Aug 22 20:40:38 juju-e4d256-prod-github-runner-207 kernel: [55012.585463] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 20:40:38 juju-e4d256-prod-github-runner-207 kernel: [55012.586536] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 20:40:38 juju-e4d256-prod-github-runner-207 kernel: [55012.587598] Aug 22 20:40:38 juju-e4d256-prod-github-runner-207 kernel: [55012.588456] Aug 22 20:40:38 juju-e4d256-prod-github-runner-207 kernel: [55012.589291] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 20:40:38 juju-e4d256-prod-github-runner-207 kernel: [55012.590328] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:40:38 juju-e4d256-prod-github-runner-207 kernel: [55012.591399] ? _raw_spin_lock+0x22/0x30 Aug 22 20:40:38 juju-e4d256-prod-github-runner-207 kernel: [55012.592365] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:40:38 juju-e4d256-prod-github-runner-207 kernel: [55012.593387] direct_page_fault+0x206/0x310 [kvm] Aug 22 20:40:38 juju-e4d256-prod-github-runner-207 kernel: [55012.594423] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 20:40:38 juju-e4d256-prod-github-runner-207 kernel: [55012.595441] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 20:40:38 juju-e4d256-prod-github-runner-207 kernel: [55012.596444] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 20:40:38 juju-e4d256-prod-github-runner-207 kernel: [55012.597448] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 20:40:38 juju-e4d256-prod-github-runner-207 kernel: [55012.598415] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 20:40:38 juju-e4d256-prod-github-runner-207 kernel: [55012.599415] handle_exit+0x98/0x230 [kvm_amd] Aug 22 20:40:38 juju-e4d256-prod-github-runner-207 kernel: [55012.600309] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 20:40:38 juju-e4d256-prod-github-runner-207 kernel: [55012.601245] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 20:40:38 juju-e4d256-prod-github-runner-207 kernel: [55012.602171] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 20:40:38 juju-e4d256-prod-github-runner-207 kernel: [55012.603085] vcpu_run+0x62/0x2c0 [kvm] Aug 22 20:40:38 juju-e4d256-prod-github-runner-207 kernel: [55012.603896] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 20:40:38 juju-e4d256-prod-github-runner-207 kernel: [55012.604702] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 20:40:38 juju-e4d256-prod-github-runner-207 kernel: [55012.605559] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 20:40:38 juju-e4d256-prod-github-runner-207 kernel: [55012.606355] ? __seccomp_filter+0x4a/0x4a0 Aug 22 20:40:38 juju-e4d256-prod-github-runner-207 kernel: [55012.607125] ? __fget_files+0x86/0xc0 Aug 22 20:40:38 juju-e4d256-prod-github-runner-207 kernel: [55012.607834] __x64_sys_ioctl+0x95/0xd0 Aug 22 20:40:38 juju-e4d256-prod-github-runner-207 kernel: [55012.608538] do_syscall_64+0x5c/0xc0 Aug 22 20:40:38 juju-e4d256-prod-github-runner-207 kernel: [55012.609204] ? do_futex+0x162/0x1f0 Aug 22 20:40:38 juju-e4d256-prod-github-runner-207 kernel: [55012.609856] ? __x64_sys_futex+0x78/0x1e0 Aug 22 20:40:38 juju-e4d256-prod-github-runner-207 kernel: [55012.610536] ? __secure_computing+0xa9/0x120 Aug 22 20:40:38 juju-e4d256-prod-github-runner-207 kernel: [55012.611244] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 20:40:38 juju-e4d256-prod-github-runner-207 kernel: [55012.612078] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:40:38 juju-e4d256-prod-github-runner-207 kernel: [55012.612803] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:40:38 juju-e4d256-prod-github-runner-207 kernel: [55012.613521] ? do_syscall_64+0x69/0xc0 Aug 22 20:40:38 juju-e4d256-prod-github-runner-207 kernel: [55012.614164] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:40:38 juju-e4d256-prod-github-runner-207 kernel: [55012.614865] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:40:38 juju-e4d256-prod-github-runner-207 kernel: [55012.615579] ? do_syscall_64+0x69/0xc0 Aug 22 20:40:38 juju-e4d256-prod-github-runner-207 kernel: [55012.616201] ? do_syscall_64+0x69/0xc0 Aug 22 20:40:38 juju-e4d256-prod-github-runner-207 kernel: [55012.616823] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 20:40:38 juju-e4d256-prod-github-runner-207 kernel: [55012.617532] RIP: 0033:0x7faa5d0edaff Aug 22 20:40:38 juju-e4d256-prod-github-runner-207 kernel: [55012.618195] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 20:40:38 juju-e4d256-prod-github-runner-207 kernel: [55012.620196] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 20:40:38 juju-e4d256-prod-github-runner-207 kernel: [55012.621108] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 20:40:38 juju-e4d256-prod-github-runner-207 kernel: [55012.621997] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 20:40:38 juju-e4d256-prod-github-runner-207 kernel: [55012.622896] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 20:40:38 juju-e4d256-prod-github-runner-207 kernel: [55012.623784] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 20:40:38 juju-e4d256-prod-github-runner-207 kernel: [55012.624677] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 20:40:38 juju-e4d256-prod-github-runner-207 kernel: [55012.625569] Aug 22 20:41:06 juju-e4d256-prod-github-runner-207 kernel: [55040.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 51152s! [qemu-system-x86:6715] Aug 22 20:41:06 juju-e4d256-prod-github-runner-207 kernel: [55040.543130] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 20:41:06 juju-e4d256-prod-github-runner-207 kernel: [55040.543205] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 20:41:06 juju-e4d256-prod-github-runner-207 kernel: [55040.555259] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 20:41:06 juju-e4d256-prod-github-runner-207 kernel: [55040.556528] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 20:41:06 juju-e4d256-prod-github-runner-207 kernel: [55040.557751] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:41:06 juju-e4d256-prod-github-runner-207 kernel: [55040.558835] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 20:41:06 juju-e4d256-prod-github-runner-207 kernel: [55040.561382] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 20:41:06 juju-e4d256-prod-github-runner-207 kernel: [55040.562428] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 20:41:06 juju-e4d256-prod-github-runner-207 kernel: [55040.563598] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 20:41:06 juju-e4d256-prod-github-runner-207 kernel: [55040.564764] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 20:41:06 juju-e4d256-prod-github-runner-207 kernel: [55040.565921] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 20:41:06 juju-e4d256-prod-github-runner-207 kernel: [55040.567099] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 20:41:06 juju-e4d256-prod-github-runner-207 kernel: [55040.568264] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 20:41:06 juju-e4d256-prod-github-runner-207 kernel: [55040.569494] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 20:41:06 juju-e4d256-prod-github-runner-207 kernel: [55040.570609] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 20:41:06 juju-e4d256-prod-github-runner-207 kernel: [55040.571802] Call Trace: Aug 22 20:41:06 juju-e4d256-prod-github-runner-207 kernel: [55040.572713] Aug 22 20:41:06 juju-e4d256-prod-github-runner-207 kernel: [55040.573610] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:41:06 juju-e4d256-prod-github-runner-207 kernel: [55040.574660] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:41:06 juju-e4d256-prod-github-runner-207 kernel: [55040.575679] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:41:06 juju-e4d256-prod-github-runner-207 kernel: [55040.576754] ? show_regs.part.0+0x23/0x29 Aug 22 20:41:06 juju-e4d256-prod-github-runner-207 kernel: [55040.577749] ? show_regs.cold+0x8/0xd Aug 22 20:41:06 juju-e4d256-prod-github-runner-207 kernel: [55040.578758] ? watchdog_timer_fn+0x1be/0x220 Aug 22 20:41:06 juju-e4d256-prod-github-runner-207 kernel: [55040.579776] ? lockup_detector_update_enable+0x60/0x60 Aug 22 20:41:06 juju-e4d256-prod-github-runner-207 kernel: [55040.580841] ? __hrtimer_run_queues+0x107/0x230 Aug 22 20:41:06 juju-e4d256-prod-github-runner-207 kernel: [55040.581867] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 20:41:06 juju-e4d256-prod-github-runner-207 kernel: [55040.582919] ? hrtimer_interrupt+0x101/0x220 Aug 22 20:41:06 juju-e4d256-prod-github-runner-207 kernel: [55040.583947] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 20:41:06 juju-e4d256-prod-github-runner-207 kernel: [55040.585017] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 20:41:06 juju-e4d256-prod-github-runner-207 kernel: [55040.586077] Aug 22 20:41:06 juju-e4d256-prod-github-runner-207 kernel: [55040.586983] Aug 22 20:41:06 juju-e4d256-prod-github-runner-207 kernel: [55040.587852] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 20:41:06 juju-e4d256-prod-github-runner-207 kernel: [55040.588899] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:41:06 juju-e4d256-prod-github-runner-207 kernel: [55040.589954] ? _raw_spin_lock+0x22/0x30 Aug 22 20:41:06 juju-e4d256-prod-github-runner-207 kernel: [55040.590934] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:41:06 juju-e4d256-prod-github-runner-207 kernel: [55040.591961] direct_page_fault+0x206/0x310 [kvm] Aug 22 20:41:06 juju-e4d256-prod-github-runner-207 kernel: [55040.592991] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 20:41:06 juju-e4d256-prod-github-runner-207 kernel: [55040.593999] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 20:41:06 juju-e4d256-prod-github-runner-207 kernel: [55040.595017] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 20:41:06 juju-e4d256-prod-github-runner-207 kernel: [55040.595985] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 20:41:06 juju-e4d256-prod-github-runner-207 kernel: [55040.597008] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 20:41:06 juju-e4d256-prod-github-runner-207 kernel: [55040.598005] handle_exit+0x98/0x230 [kvm_amd] Aug 22 20:41:06 juju-e4d256-prod-github-runner-207 kernel: [55040.598922] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 20:41:06 juju-e4d256-prod-github-runner-207 kernel: [55040.599838] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 20:41:06 juju-e4d256-prod-github-runner-207 kernel: [55040.600770] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 20:41:06 juju-e4d256-prod-github-runner-207 kernel: [55040.601814] vcpu_run+0x62/0x2c0 [kvm] Aug 22 20:41:06 juju-e4d256-prod-github-runner-207 kernel: [55040.602727] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 20:41:06 juju-e4d256-prod-github-runner-207 kernel: [55040.603622] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 20:41:06 juju-e4d256-prod-github-runner-207 kernel: [55040.604575] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 20:41:06 juju-e4d256-prod-github-runner-207 kernel: [55040.605460] ? __seccomp_filter+0x4a/0x4a0 Aug 22 20:41:06 juju-e4d256-prod-github-runner-207 kernel: [55040.606287] ? __fget_files+0x86/0xc0 Aug 22 20:41:06 juju-e4d256-prod-github-runner-207 kernel: [55040.607030] __x64_sys_ioctl+0x95/0xd0 Aug 22 20:41:06 juju-e4d256-prod-github-runner-207 kernel: [55040.607728] do_syscall_64+0x5c/0xc0 Aug 22 20:41:06 juju-e4d256-prod-github-runner-207 kernel: [55040.608393] ? do_futex+0x162/0x1f0 Aug 22 20:41:06 juju-e4d256-prod-github-runner-207 kernel: [55040.609051] ? __x64_sys_futex+0x78/0x1e0 Aug 22 20:41:06 juju-e4d256-prod-github-runner-207 kernel: [55040.609736] ? __secure_computing+0xa9/0x120 Aug 22 20:41:06 juju-e4d256-prod-github-runner-207 kernel: [55040.610432] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 20:41:06 juju-e4d256-prod-github-runner-207 kernel: [55040.611352] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:41:06 juju-e4d256-prod-github-runner-207 kernel: [55040.612161] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:41:06 juju-e4d256-prod-github-runner-207 kernel: [55040.613088] ? do_syscall_64+0x69/0xc0 Aug 22 20:41:06 juju-e4d256-prod-github-runner-207 kernel: [55040.613753] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:41:06 juju-e4d256-prod-github-runner-207 kernel: [55040.614471] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:41:06 juju-e4d256-prod-github-runner-207 kernel: [55040.615196] ? do_syscall_64+0x69/0xc0 Aug 22 20:41:06 juju-e4d256-prod-github-runner-207 kernel: [55040.615822] ? do_syscall_64+0x69/0xc0 Aug 22 20:41:06 juju-e4d256-prod-github-runner-207 kernel: [55040.616443] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 20:41:06 juju-e4d256-prod-github-runner-207 kernel: [55040.617154] RIP: 0033:0x7faa5d0edaff Aug 22 20:41:06 juju-e4d256-prod-github-runner-207 kernel: [55040.617785] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 20:41:06 juju-e4d256-prod-github-runner-207 kernel: [55040.619793] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 20:41:06 juju-e4d256-prod-github-runner-207 kernel: [55040.620724] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 20:41:06 juju-e4d256-prod-github-runner-207 kernel: [55040.621618] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 20:41:06 juju-e4d256-prod-github-runner-207 kernel: [55040.622526] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 20:41:06 juju-e4d256-prod-github-runner-207 kernel: [55040.623451] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 20:41:06 juju-e4d256-prod-github-runner-207 kernel: [55040.624399] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 20:41:06 juju-e4d256-prod-github-runner-207 kernel: [55040.625321] Aug 22 20:41:34 juju-e4d256-prod-github-runner-207 kernel: [55068.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 51178s! [qemu-system-x86:6715] Aug 22 20:41:34 juju-e4d256-prod-github-runner-207 kernel: [55068.543131] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 20:41:34 juju-e4d256-prod-github-runner-207 kernel: [55068.543206] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 20:41:34 juju-e4d256-prod-github-runner-207 kernel: [55068.555750] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 20:41:34 juju-e4d256-prod-github-runner-207 kernel: [55068.557037] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 20:41:34 juju-e4d256-prod-github-runner-207 kernel: [55068.558281] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:41:34 juju-e4d256-prod-github-runner-207 kernel: [55068.559351] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 20:41:34 juju-e4d256-prod-github-runner-207 kernel: [55068.561966] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 20:41:34 juju-e4d256-prod-github-runner-207 kernel: [55068.563036] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 20:41:34 juju-e4d256-prod-github-runner-207 kernel: [55068.564219] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 20:41:34 juju-e4d256-prod-github-runner-207 kernel: [55068.565401] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 20:41:34 juju-e4d256-prod-github-runner-207 kernel: [55068.566597] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 20:41:34 juju-e4d256-prod-github-runner-207 kernel: [55068.567783] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 20:41:34 juju-e4d256-prod-github-runner-207 kernel: [55068.568971] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 20:41:34 juju-e4d256-prod-github-runner-207 kernel: [55068.570245] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 20:41:34 juju-e4d256-prod-github-runner-207 kernel: [55068.571369] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 20:41:34 juju-e4d256-prod-github-runner-207 kernel: [55068.572576] Call Trace: Aug 22 20:41:34 juju-e4d256-prod-github-runner-207 kernel: [55068.573501] Aug 22 20:41:34 juju-e4d256-prod-github-runner-207 kernel: [55068.574408] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:41:34 juju-e4d256-prod-github-runner-207 kernel: [55068.575464] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:41:34 juju-e4d256-prod-github-runner-207 kernel: [55068.576491] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:41:34 juju-e4d256-prod-github-runner-207 kernel: [55068.577578] ? show_regs.part.0+0x23/0x29 Aug 22 20:41:34 juju-e4d256-prod-github-runner-207 kernel: [55068.578622] ? show_regs.cold+0x8/0xd Aug 22 20:41:34 juju-e4d256-prod-github-runner-207 kernel: [55068.579607] ? watchdog_timer_fn+0x1be/0x220 Aug 22 20:41:34 juju-e4d256-prod-github-runner-207 kernel: [55068.580630] ? lockup_detector_update_enable+0x60/0x60 Aug 22 20:41:34 juju-e4d256-prod-github-runner-207 kernel: [55068.581709] ? __hrtimer_run_queues+0x107/0x230 Aug 22 20:41:34 juju-e4d256-prod-github-runner-207 kernel: [55068.582798] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 20:41:34 juju-e4d256-prod-github-runner-207 kernel: [55068.583840] ? hrtimer_interrupt+0x101/0x220 Aug 22 20:41:34 juju-e4d256-prod-github-runner-207 kernel: [55068.584874] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 20:41:34 juju-e4d256-prod-github-runner-207 kernel: [55068.585981] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 20:41:34 juju-e4d256-prod-github-runner-207 kernel: [55068.587054] Aug 22 20:41:34 juju-e4d256-prod-github-runner-207 kernel: [55068.587913] Aug 22 20:41:34 juju-e4d256-prod-github-runner-207 kernel: [55068.588755] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 20:41:34 juju-e4d256-prod-github-runner-207 kernel: [55068.589949] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:41:34 juju-e4d256-prod-github-runner-207 kernel: [55068.591176] ? _raw_spin_lock+0x22/0x30 Aug 22 20:41:34 juju-e4d256-prod-github-runner-207 kernel: [55068.592155] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:41:34 juju-e4d256-prod-github-runner-207 kernel: [55068.593199] direct_page_fault+0x206/0x310 [kvm] Aug 22 20:41:34 juju-e4d256-prod-github-runner-207 kernel: [55068.594253] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 20:41:34 juju-e4d256-prod-github-runner-207 kernel: [55068.595290] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 20:41:34 juju-e4d256-prod-github-runner-207 kernel: [55068.596310] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 20:41:34 juju-e4d256-prod-github-runner-207 kernel: [55068.597297] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 20:41:34 juju-e4d256-prod-github-runner-207 kernel: [55068.598265] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 20:41:34 juju-e4d256-prod-github-runner-207 kernel: [55068.599266] handle_exit+0x98/0x230 [kvm_amd] Aug 22 20:41:34 juju-e4d256-prod-github-runner-207 kernel: [55068.600172] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 20:41:34 juju-e4d256-prod-github-runner-207 kernel: [55068.601106] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 20:41:34 juju-e4d256-prod-github-runner-207 kernel: [55068.602052] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 20:41:34 juju-e4d256-prod-github-runner-207 kernel: [55068.602987] vcpu_run+0x62/0x2c0 [kvm] Aug 22 20:41:34 juju-e4d256-prod-github-runner-207 kernel: [55068.603832] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 20:41:34 juju-e4d256-prod-github-runner-207 kernel: [55068.604654] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 20:41:34 juju-e4d256-prod-github-runner-207 kernel: [55068.605519] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 20:41:34 juju-e4d256-prod-github-runner-207 kernel: [55068.606334] ? __seccomp_filter+0x4a/0x4a0 Aug 22 20:41:34 juju-e4d256-prod-github-runner-207 kernel: [55068.607087] ? __fget_files+0x86/0xc0 Aug 22 20:41:34 juju-e4d256-prod-github-runner-207 kernel: [55068.607894] __x64_sys_ioctl+0x95/0xd0 Aug 22 20:41:34 juju-e4d256-prod-github-runner-207 kernel: [55068.608618] do_syscall_64+0x5c/0xc0 Aug 22 20:41:34 juju-e4d256-prod-github-runner-207 kernel: [55068.609297] ? do_futex+0x162/0x1f0 Aug 22 20:41:34 juju-e4d256-prod-github-runner-207 kernel: [55068.609975] ? __x64_sys_futex+0x78/0x1e0 Aug 22 20:41:34 juju-e4d256-prod-github-runner-207 kernel: [55068.610680] ? __secure_computing+0xa9/0x120 Aug 22 20:41:34 juju-e4d256-prod-github-runner-207 kernel: [55068.611400] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 20:41:34 juju-e4d256-prod-github-runner-207 kernel: [55068.612190] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:41:34 juju-e4d256-prod-github-runner-207 kernel: [55068.612926] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:41:34 juju-e4d256-prod-github-runner-207 kernel: [55068.613658] ? do_syscall_64+0x69/0xc0 Aug 22 20:41:34 juju-e4d256-prod-github-runner-207 kernel: [55068.614330] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:41:34 juju-e4d256-prod-github-runner-207 kernel: [55068.615051] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:41:34 juju-e4d256-prod-github-runner-207 kernel: [55068.615768] ? do_syscall_64+0x69/0xc0 Aug 22 20:41:34 juju-e4d256-prod-github-runner-207 kernel: [55068.616412] ? do_syscall_64+0x69/0xc0 Aug 22 20:41:34 juju-e4d256-prod-github-runner-207 kernel: [55068.617061] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 20:41:34 juju-e4d256-prod-github-runner-207 kernel: [55068.617788] RIP: 0033:0x7faa5d0edaff Aug 22 20:41:34 juju-e4d256-prod-github-runner-207 kernel: [55068.618436] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 20:41:34 juju-e4d256-prod-github-runner-207 kernel: [55068.620474] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 20:41:34 juju-e4d256-prod-github-runner-207 kernel: [55068.621405] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 20:41:34 juju-e4d256-prod-github-runner-207 kernel: [55068.622325] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 20:41:34 juju-e4d256-prod-github-runner-207 kernel: [55068.623237] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 20:41:34 juju-e4d256-prod-github-runner-207 kernel: [55068.624154] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 20:41:34 juju-e4d256-prod-github-runner-207 kernel: [55068.625065] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 20:41:34 juju-e4d256-prod-github-runner-207 kernel: [55068.625977] Aug 22 20:41:46 juju-e4d256-prod-github-runner-207 kernel: [55080.860706] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 20:41:46 juju-e4d256-prod-github-runner-207 kernel: [55080.861745] rcu: 1-....: (13697660 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=6621206 Aug 22 20:41:46 juju-e4d256-prod-github-runner-207 kernel: [55080.862947] (t=13740915 jiffies g=23269 q=50819) Aug 22 20:41:46 juju-e4d256-prod-github-runner-207 kernel: [55080.863739] NMI backtrace for cpu 1 Aug 22 20:41:46 juju-e4d256-prod-github-runner-207 kernel: [55080.864447] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 20:41:46 juju-e4d256-prod-github-runner-207 kernel: [55080.865743] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 20:41:46 juju-e4d256-prod-github-runner-207 kernel: [55080.866822] Call Trace: Aug 22 20:41:46 juju-e4d256-prod-github-runner-207 kernel: [55080.867497] Aug 22 20:41:46 juju-e4d256-prod-github-runner-207 kernel: [55080.868158] show_stack+0x52/0x5c Aug 22 20:41:46 juju-e4d256-prod-github-runner-207 kernel: [55080.868897] dump_stack_lvl+0x4a/0x63 Aug 22 20:41:46 juju-e4d256-prod-github-runner-207 kernel: [55080.869645] dump_stack+0x10/0x16 Aug 22 20:41:46 juju-e4d256-prod-github-runner-207 kernel: [55080.870376] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 20:41:46 juju-e4d256-prod-github-runner-207 kernel: [55080.871167] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 20:41:46 juju-e4d256-prod-github-runner-207 kernel: [55080.871959] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 20:41:46 juju-e4d256-prod-github-runner-207 kernel: [55080.872776] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 20:41:46 juju-e4d256-prod-github-runner-207 kernel: [55080.873593] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 20:41:46 juju-e4d256-prod-github-runner-207 kernel: [55080.874428] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 20:41:46 juju-e4d256-prod-github-runner-207 kernel: [55080.875213] print_cpu_stall.cold+0x2f/0xe2 Aug 22 20:41:46 juju-e4d256-prod-github-runner-207 kernel: [55080.876010] ? timekeeping_update+0xf7/0x150 Aug 22 20:41:46 juju-e4d256-prod-github-runner-207 kernel: [55080.876779] check_cpu_stall+0x109/0x270 Aug 22 20:41:46 juju-e4d256-prod-github-runner-207 kernel: [55080.877524] rcu_sched_clock_irq+0x9a/0x250 Aug 22 20:41:46 juju-e4d256-prod-github-runner-207 kernel: [55080.878297] update_process_times+0x94/0xd0 Aug 22 20:41:46 juju-e4d256-prod-github-runner-207 kernel: [55080.879056] tick_sched_handle+0x29/0x70 Aug 22 20:41:46 juju-e4d256-prod-github-runner-207 kernel: [55080.879799] tick_sched_timer+0x8c/0xc0 Aug 22 20:41:46 juju-e4d256-prod-github-runner-207 kernel: [55080.880535] ? tick_nohz_handler+0xb0/0xb0 Aug 22 20:41:46 juju-e4d256-prod-github-runner-207 kernel: [55080.881289] __hrtimer_run_queues+0x107/0x230 Aug 22 20:41:46 juju-e4d256-prod-github-runner-207 kernel: [55080.882077] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 20:41:46 juju-e4d256-prod-github-runner-207 kernel: [55080.882876] hrtimer_interrupt+0x101/0x220 Aug 22 20:41:46 juju-e4d256-prod-github-runner-207 kernel: [55080.883805] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 20:41:46 juju-e4d256-prod-github-runner-207 kernel: [55080.884618] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 20:41:46 juju-e4d256-prod-github-runner-207 kernel: [55080.885422] Aug 22 20:41:46 juju-e4d256-prod-github-runner-207 kernel: [55080.886069] Aug 22 20:41:46 juju-e4d256-prod-github-runner-207 kernel: [55080.886696] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 20:41:46 juju-e4d256-prod-github-runner-207 kernel: [55080.887512] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:41:46 juju-e4d256-prod-github-runner-207 kernel: [55080.888393] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 20:41:46 juju-e4d256-prod-github-runner-207 kernel: [55080.890597] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 20:41:46 juju-e4d256-prod-github-runner-207 kernel: [55080.891480] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 20:41:46 juju-e4d256-prod-github-runner-207 kernel: [55080.892475] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 20:41:46 juju-e4d256-prod-github-runner-207 kernel: [55080.893457] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 20:41:46 juju-e4d256-prod-github-runner-207 kernel: [55080.894430] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 20:41:46 juju-e4d256-prod-github-runner-207 kernel: [55080.895384] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 20:41:46 juju-e4d256-prod-github-runner-207 kernel: [55080.896334] ? _raw_spin_lock+0x22/0x30 Aug 22 20:41:46 juju-e4d256-prod-github-runner-207 kernel: [55080.897099] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:41:46 juju-e4d256-prod-github-runner-207 kernel: [55080.897955] direct_page_fault+0x206/0x310 [kvm] Aug 22 20:41:46 juju-e4d256-prod-github-runner-207 kernel: [55080.898803] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 20:41:46 juju-e4d256-prod-github-runner-207 kernel: [55080.899630] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 20:41:46 juju-e4d256-prod-github-runner-207 kernel: [55080.900481] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 20:41:46 juju-e4d256-prod-github-runner-207 kernel: [55080.901305] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 20:41:46 juju-e4d256-prod-github-runner-207 kernel: [55080.902102] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 20:41:46 juju-e4d256-prod-github-runner-207 kernel: [55080.902925] handle_exit+0x98/0x230 [kvm_amd] Aug 22 20:41:46 juju-e4d256-prod-github-runner-207 kernel: [55080.903683] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 20:41:46 juju-e4d256-prod-github-runner-207 kernel: [55080.904464] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 20:41:46 juju-e4d256-prod-github-runner-207 kernel: [55080.905263] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 20:41:46 juju-e4d256-prod-github-runner-207 kernel: [55080.906057] vcpu_run+0x62/0x2c0 [kvm] Aug 22 20:41:46 juju-e4d256-prod-github-runner-207 kernel: [55080.906772] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 20:41:46 juju-e4d256-prod-github-runner-207 kernel: [55080.907504] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 20:41:46 juju-e4d256-prod-github-runner-207 kernel: [55080.908304] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 20:41:46 juju-e4d256-prod-github-runner-207 kernel: [55080.909065] ? __seccomp_filter+0x4a/0x4a0 Aug 22 20:41:46 juju-e4d256-prod-github-runner-207 kernel: [55080.909789] ? __fget_files+0x86/0xc0 Aug 22 20:41:46 juju-e4d256-prod-github-runner-207 kernel: [55080.910527] __x64_sys_ioctl+0x95/0xd0 Aug 22 20:41:46 juju-e4d256-prod-github-runner-207 kernel: [55080.911225] do_syscall_64+0x5c/0xc0 Aug 22 20:41:46 juju-e4d256-prod-github-runner-207 kernel: [55080.911905] ? do_futex+0x162/0x1f0 Aug 22 20:41:46 juju-e4d256-prod-github-runner-207 kernel: [55080.912580] ? __x64_sys_futex+0x78/0x1e0 Aug 22 20:41:46 juju-e4d256-prod-github-runner-207 kernel: [55080.913287] ? __secure_computing+0xa9/0x120 Aug 22 20:41:46 juju-e4d256-prod-github-runner-207 kernel: [55080.914002] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 20:41:46 juju-e4d256-prod-github-runner-207 kernel: [55080.914800] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:41:46 juju-e4d256-prod-github-runner-207 kernel: [55080.915553] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:41:46 juju-e4d256-prod-github-runner-207 kernel: [55080.916309] ? do_syscall_64+0x69/0xc0 Aug 22 20:41:46 juju-e4d256-prod-github-runner-207 kernel: [55080.916997] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:41:46 juju-e4d256-prod-github-runner-207 kernel: [55080.917750] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:41:46 juju-e4d256-prod-github-runner-207 kernel: [55080.918518] ? do_syscall_64+0x69/0xc0 Aug 22 20:41:46 juju-e4d256-prod-github-runner-207 kernel: [55080.919216] ? do_syscall_64+0x69/0xc0 Aug 22 20:41:46 juju-e4d256-prod-github-runner-207 kernel: [55080.919902] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 20:41:46 juju-e4d256-prod-github-runner-207 kernel: [55080.920675] RIP: 0033:0x7faa5d0edaff Aug 22 20:41:46 juju-e4d256-prod-github-runner-207 kernel: [55080.921385] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 20:41:46 juju-e4d256-prod-github-runner-207 kernel: [55080.923491] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 20:41:46 juju-e4d256-prod-github-runner-207 kernel: [55080.924450] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 20:41:46 juju-e4d256-prod-github-runner-207 kernel: [55080.925394] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 20:41:46 juju-e4d256-prod-github-runner-207 kernel: [55080.926366] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 20:41:46 juju-e4d256-prod-github-runner-207 kernel: [55080.927308] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 20:41:46 juju-e4d256-prod-github-runner-207 kernel: [55080.928242] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 20:41:46 juju-e4d256-prod-github-runner-207 kernel: [55080.929156] Aug 22 20:42:14 juju-e4d256-prod-github-runner-207 kernel: [55108.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 51215s! [qemu-system-x86:6715] Aug 22 20:42:14 juju-e4d256-prod-github-runner-207 kernel: [55108.544036] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 20:42:14 juju-e4d256-prod-github-runner-207 kernel: [55108.544314] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 20:42:14 juju-e4d256-prod-github-runner-207 kernel: [55108.556670] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 20:42:14 juju-e4d256-prod-github-runner-207 kernel: [55108.557944] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 20:42:14 juju-e4d256-prod-github-runner-207 kernel: [55108.559165] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:42:14 juju-e4d256-prod-github-runner-207 kernel: [55108.560222] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 20:42:14 juju-e4d256-prod-github-runner-207 kernel: [55108.562864] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 20:42:14 juju-e4d256-prod-github-runner-207 kernel: [55108.563923] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 20:42:14 juju-e4d256-prod-github-runner-207 kernel: [55108.565239] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 20:42:14 juju-e4d256-prod-github-runner-207 kernel: [55108.566555] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 20:42:14 juju-e4d256-prod-github-runner-207 kernel: [55108.567846] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 20:42:14 juju-e4d256-prod-github-runner-207 kernel: [55108.569138] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 20:42:14 juju-e4d256-prod-github-runner-207 kernel: [55108.570456] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 20:42:14 juju-e4d256-prod-github-runner-207 kernel: [55108.571869] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 20:42:14 juju-e4d256-prod-github-runner-207 kernel: [55108.573085] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 20:42:14 juju-e4d256-prod-github-runner-207 kernel: [55108.574437] Call Trace: Aug 22 20:42:14 juju-e4d256-prod-github-runner-207 kernel: [55108.575407] Aug 22 20:42:14 juju-e4d256-prod-github-runner-207 kernel: [55108.576341] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:42:14 juju-e4d256-prod-github-runner-207 kernel: [55108.577457] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:42:14 juju-e4d256-prod-github-runner-207 kernel: [55108.578581] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:42:14 juju-e4d256-prod-github-runner-207 kernel: [55108.579760] ? show_regs.part.0+0x23/0x29 Aug 22 20:42:14 juju-e4d256-prod-github-runner-207 kernel: [55108.580845] ? show_regs.cold+0x8/0xd Aug 22 20:42:14 juju-e4d256-prod-github-runner-207 kernel: [55108.581905] ? watchdog_timer_fn+0x1be/0x220 Aug 22 20:42:14 juju-e4d256-prod-github-runner-207 kernel: [55108.582997] ? lockup_detector_update_enable+0x60/0x60 Aug 22 20:42:14 juju-e4d256-prod-github-runner-207 kernel: [55108.584156] ? __hrtimer_run_queues+0x107/0x230 Aug 22 20:42:14 juju-e4d256-prod-github-runner-207 kernel: [55108.585266] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 20:42:14 juju-e4d256-prod-github-runner-207 kernel: [55108.586393] ? hrtimer_interrupt+0x101/0x220 Aug 22 20:42:14 juju-e4d256-prod-github-runner-207 kernel: [55108.587501] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 20:42:14 juju-e4d256-prod-github-runner-207 kernel: [55108.588679] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 20:42:14 juju-e4d256-prod-github-runner-207 kernel: [55108.589860] Aug 22 20:42:14 juju-e4d256-prod-github-runner-207 kernel: [55108.590767] Aug 22 20:42:14 juju-e4d256-prod-github-runner-207 kernel: [55108.591653] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 20:42:14 juju-e4d256-prod-github-runner-207 kernel: [55108.592784] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:42:14 juju-e4d256-prod-github-runner-207 kernel: [55108.593941] ? _raw_spin_lock+0x22/0x30 Aug 22 20:42:14 juju-e4d256-prod-github-runner-207 kernel: [55108.594965] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:42:14 juju-e4d256-prod-github-runner-207 kernel: [55108.596106] direct_page_fault+0x206/0x310 [kvm] Aug 22 20:42:14 juju-e4d256-prod-github-runner-207 kernel: [55108.597239] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 20:42:14 juju-e4d256-prod-github-runner-207 kernel: [55108.598379] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 20:42:14 juju-e4d256-prod-github-runner-207 kernel: [55108.599501] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 20:42:14 juju-e4d256-prod-github-runner-207 kernel: [55108.600579] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 20:42:14 juju-e4d256-prod-github-runner-207 kernel: [55108.601647] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 20:42:14 juju-e4d256-prod-github-runner-207 kernel: [55108.602758] handle_exit+0x98/0x230 [kvm_amd] Aug 22 20:42:14 juju-e4d256-prod-github-runner-207 kernel: [55108.603748] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 20:42:14 juju-e4d256-prod-github-runner-207 kernel: [55108.604757] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 20:42:14 juju-e4d256-prod-github-runner-207 kernel: [55108.605798] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 20:42:14 juju-e4d256-prod-github-runner-207 kernel: [55108.606808] vcpu_run+0x62/0x2c0 [kvm] Aug 22 20:42:14 juju-e4d256-prod-github-runner-207 kernel: [55108.607698] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 20:42:14 juju-e4d256-prod-github-runner-207 kernel: [55108.608594] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 20:42:14 juju-e4d256-prod-github-runner-207 kernel: [55108.609543] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 20:42:14 juju-e4d256-prod-github-runner-207 kernel: [55108.610439] ? __seccomp_filter+0x4a/0x4a0 Aug 22 20:42:14 juju-e4d256-prod-github-runner-207 kernel: [55108.611281] ? __fget_files+0x86/0xc0 Aug 22 20:42:14 juju-e4d256-prod-github-runner-207 kernel: [55108.612064] __x64_sys_ioctl+0x95/0xd0 Aug 22 20:42:14 juju-e4d256-prod-github-runner-207 kernel: [55108.612830] do_syscall_64+0x5c/0xc0 Aug 22 20:42:14 juju-e4d256-prod-github-runner-207 kernel: [55108.613563] ? do_futex+0x162/0x1f0 Aug 22 20:42:14 juju-e4d256-prod-github-runner-207 kernel: [55108.614292] ? __x64_sys_futex+0x78/0x1e0 Aug 22 20:42:14 juju-e4d256-prod-github-runner-207 kernel: [55108.615046] ? __secure_computing+0xa9/0x120 Aug 22 20:42:14 juju-e4d256-prod-github-runner-207 kernel: [55108.615825] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 20:42:14 juju-e4d256-prod-github-runner-207 kernel: [55108.616683] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:42:14 juju-e4d256-prod-github-runner-207 kernel: [55108.617501] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:42:14 juju-e4d256-prod-github-runner-207 kernel: [55108.618320] ? do_syscall_64+0x69/0xc0 Aug 22 20:42:14 juju-e4d256-prod-github-runner-207 kernel: [55108.619055] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:42:14 juju-e4d256-prod-github-runner-207 kernel: [55108.619847] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:42:14 juju-e4d256-prod-github-runner-207 kernel: [55108.620631] ? do_syscall_64+0x69/0xc0 Aug 22 20:42:14 juju-e4d256-prod-github-runner-207 kernel: [55108.621331] ? do_syscall_64+0x69/0xc0 Aug 22 20:42:14 juju-e4d256-prod-github-runner-207 kernel: [55108.622043] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 20:42:14 juju-e4d256-prod-github-runner-207 kernel: [55108.622844] RIP: 0033:0x7faa5d0edaff Aug 22 20:42:14 juju-e4d256-prod-github-runner-207 kernel: [55108.623540] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 20:42:14 juju-e4d256-prod-github-runner-207 kernel: [55108.625875] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 20:42:14 juju-e4d256-prod-github-runner-207 kernel: [55108.626923] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 20:42:14 juju-e4d256-prod-github-runner-207 kernel: [55108.627946] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 20:42:14 juju-e4d256-prod-github-runner-207 kernel: [55108.628962] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 20:42:14 juju-e4d256-prod-github-runner-207 kernel: [55108.629995] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 20:42:14 juju-e4d256-prod-github-runner-207 kernel: [55108.631014] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 20:42:14 juju-e4d256-prod-github-runner-207 kernel: [55108.632038] Aug 22 20:42:42 juju-e4d256-prod-github-runner-207 kernel: [55136.541980] watchdog: BUG: soft lockup - CPU#1 stuck for 51241s! [qemu-system-x86:6715] Aug 22 20:42:42 juju-e4d256-prod-github-runner-207 kernel: [55136.543099] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 20:42:42 juju-e4d256-prod-github-runner-207 kernel: [55136.543174] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 20:42:42 juju-e4d256-prod-github-runner-207 kernel: [55136.555455] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 20:42:42 juju-e4d256-prod-github-runner-207 kernel: [55136.556821] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 20:42:42 juju-e4d256-prod-github-runner-207 kernel: [55136.558124] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:42:42 juju-e4d256-prod-github-runner-207 kernel: [55136.559189] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 20:42:42 juju-e4d256-prod-github-runner-207 kernel: [55136.561917] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 20:42:42 juju-e4d256-prod-github-runner-207 kernel: [55136.562976] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 20:42:42 juju-e4d256-prod-github-runner-207 kernel: [55136.564151] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 20:42:42 juju-e4d256-prod-github-runner-207 kernel: [55136.565331] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 20:42:42 juju-e4d256-prod-github-runner-207 kernel: [55136.566549] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 20:42:42 juju-e4d256-prod-github-runner-207 kernel: [55136.567729] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 20:42:42 juju-e4d256-prod-github-runner-207 kernel: [55136.568903] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 20:42:42 juju-e4d256-prod-github-runner-207 kernel: [55136.570260] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 20:42:42 juju-e4d256-prod-github-runner-207 kernel: [55136.571382] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 20:42:42 juju-e4d256-prod-github-runner-207 kernel: [55136.572612] Call Trace: Aug 22 20:42:42 juju-e4d256-prod-github-runner-207 kernel: [55136.573560] Aug 22 20:42:42 juju-e4d256-prod-github-runner-207 kernel: [55136.574446] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:42:42 juju-e4d256-prod-github-runner-207 kernel: [55136.575496] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:42:42 juju-e4d256-prod-github-runner-207 kernel: [55136.576579] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:42:42 juju-e4d256-prod-github-runner-207 kernel: [55136.577732] ? show_regs.part.0+0x23/0x29 Aug 22 20:42:42 juju-e4d256-prod-github-runner-207 kernel: [55136.578763] ? show_regs.cold+0x8/0xd Aug 22 20:42:42 juju-e4d256-prod-github-runner-207 kernel: [55136.579740] ? watchdog_timer_fn+0x1be/0x220 Aug 22 20:42:42 juju-e4d256-prod-github-runner-207 kernel: [55136.580998] ? lockup_detector_update_enable+0x60/0x60 Aug 22 20:42:42 juju-e4d256-prod-github-runner-207 kernel: [55136.582158] ? __hrtimer_run_queues+0x107/0x230 Aug 22 20:42:42 juju-e4d256-prod-github-runner-207 kernel: [55136.583197] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 20:42:42 juju-e4d256-prod-github-runner-207 kernel: [55136.584225] ? hrtimer_interrupt+0x101/0x220 Aug 22 20:42:42 juju-e4d256-prod-github-runner-207 kernel: [55136.585246] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 20:42:42 juju-e4d256-prod-github-runner-207 kernel: [55136.586451] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 20:42:42 juju-e4d256-prod-github-runner-207 kernel: [55136.587521] Aug 22 20:42:42 juju-e4d256-prod-github-runner-207 kernel: [55136.588380] Aug 22 20:42:42 juju-e4d256-prod-github-runner-207 kernel: [55136.589223] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 20:42:42 juju-e4d256-prod-github-runner-207 kernel: [55136.590326] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:42:42 juju-e4d256-prod-github-runner-207 kernel: [55136.591485] ? _raw_spin_lock+0x22/0x30 Aug 22 20:42:42 juju-e4d256-prod-github-runner-207 kernel: [55136.592609] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:42:42 juju-e4d256-prod-github-runner-207 kernel: [55136.593660] direct_page_fault+0x206/0x310 [kvm] Aug 22 20:42:42 juju-e4d256-prod-github-runner-207 kernel: [55136.594725] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 20:42:42 juju-e4d256-prod-github-runner-207 kernel: [55136.595744] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 20:42:42 juju-e4d256-prod-github-runner-207 kernel: [55136.596748] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 20:42:42 juju-e4d256-prod-github-runner-207 kernel: [55136.597860] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 20:42:42 juju-e4d256-prod-github-runner-207 kernel: [55136.598848] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 20:42:42 juju-e4d256-prod-github-runner-207 kernel: [55136.599902] handle_exit+0x98/0x230 [kvm_amd] Aug 22 20:42:42 juju-e4d256-prod-github-runner-207 kernel: [55136.600816] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 20:42:42 juju-e4d256-prod-github-runner-207 kernel: [55136.601757] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 20:42:42 juju-e4d256-prod-github-runner-207 kernel: [55136.602792] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 20:42:42 juju-e4d256-prod-github-runner-207 kernel: [55136.603713] vcpu_run+0x62/0x2c0 [kvm] Aug 22 20:42:42 juju-e4d256-prod-github-runner-207 kernel: [55136.604528] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 20:42:42 juju-e4d256-prod-github-runner-207 kernel: [55136.605398] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 20:42:42 juju-e4d256-prod-github-runner-207 kernel: [55136.606272] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 20:42:42 juju-e4d256-prod-github-runner-207 kernel: [55136.607100] ? __seccomp_filter+0x4a/0x4a0 Aug 22 20:42:42 juju-e4d256-prod-github-runner-207 kernel: [55136.607842] ? __fget_files+0x86/0xc0 Aug 22 20:42:42 juju-e4d256-prod-github-runner-207 kernel: [55136.608544] __x64_sys_ioctl+0x95/0xd0 Aug 22 20:42:42 juju-e4d256-prod-github-runner-207 kernel: [55136.609238] do_syscall_64+0x5c/0xc0 Aug 22 20:42:42 juju-e4d256-prod-github-runner-207 kernel: [55136.609926] ? do_futex+0x162/0x1f0 Aug 22 20:42:42 juju-e4d256-prod-github-runner-207 kernel: [55136.610574] ? __x64_sys_futex+0x78/0x1e0 Aug 22 20:42:42 juju-e4d256-prod-github-runner-207 kernel: [55136.611255] ? __secure_computing+0xa9/0x120 Aug 22 20:42:42 juju-e4d256-prod-github-runner-207 kernel: [55136.611962] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 20:42:42 juju-e4d256-prod-github-runner-207 kernel: [55136.612754] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:42:42 juju-e4d256-prod-github-runner-207 kernel: [55136.613537] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:42:42 juju-e4d256-prod-github-runner-207 kernel: [55136.614300] ? do_syscall_64+0x69/0xc0 Aug 22 20:42:42 juju-e4d256-prod-github-runner-207 kernel: [55136.614982] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:42:42 juju-e4d256-prod-github-runner-207 kernel: [55136.615778] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:42:42 juju-e4d256-prod-github-runner-207 kernel: [55136.616482] ? do_syscall_64+0x69/0xc0 Aug 22 20:42:42 juju-e4d256-prod-github-runner-207 kernel: [55136.617182] ? do_syscall_64+0x69/0xc0 Aug 22 20:42:42 juju-e4d256-prod-github-runner-207 kernel: [55136.617843] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 20:42:42 juju-e4d256-prod-github-runner-207 kernel: [55136.618775] RIP: 0033:0x7faa5d0edaff Aug 22 20:42:42 juju-e4d256-prod-github-runner-207 kernel: [55136.619400] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 20:42:42 juju-e4d256-prod-github-runner-207 kernel: [55136.621494] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 20:42:42 juju-e4d256-prod-github-runner-207 kernel: [55136.622482] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 20:42:42 juju-e4d256-prod-github-runner-207 kernel: [55136.623429] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 20:42:42 juju-e4d256-prod-github-runner-207 kernel: [55136.624325] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 20:42:42 juju-e4d256-prod-github-runner-207 kernel: [55136.625216] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 20:42:42 juju-e4d256-prod-github-runner-207 kernel: [55136.626131] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 20:42:42 juju-e4d256-prod-github-runner-207 kernel: [55136.627159] Aug 22 20:43:10 juju-e4d256-prod-github-runner-207 kernel: [55164.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 51267s! [qemu-system-x86:6715] Aug 22 20:43:10 juju-e4d256-prod-github-runner-207 kernel: [55164.543111] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 20:43:10 juju-e4d256-prod-github-runner-207 kernel: [55164.543186] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 20:43:10 juju-e4d256-prod-github-runner-207 kernel: [55164.555487] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 20:43:10 juju-e4d256-prod-github-runner-207 kernel: [55164.556753] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 20:43:10 juju-e4d256-prod-github-runner-207 kernel: [55164.558035] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:43:10 juju-e4d256-prod-github-runner-207 kernel: [55164.559106] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 20:43:10 juju-e4d256-prod-github-runner-207 kernel: [55164.561694] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 20:43:10 juju-e4d256-prod-github-runner-207 kernel: [55164.562743] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 20:43:10 juju-e4d256-prod-github-runner-207 kernel: [55164.563938] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 20:43:10 juju-e4d256-prod-github-runner-207 kernel: [55164.565137] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 20:43:10 juju-e4d256-prod-github-runner-207 kernel: [55164.566317] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 20:43:10 juju-e4d256-prod-github-runner-207 kernel: [55164.567496] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 20:43:10 juju-e4d256-prod-github-runner-207 kernel: [55164.568682] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 20:43:10 juju-e4d256-prod-github-runner-207 kernel: [55164.569957] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 20:43:10 juju-e4d256-prod-github-runner-207 kernel: [55164.571078] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 20:43:10 juju-e4d256-prod-github-runner-207 kernel: [55164.572294] Call Trace: Aug 22 20:43:10 juju-e4d256-prod-github-runner-207 kernel: [55164.573260] Aug 22 20:43:10 juju-e4d256-prod-github-runner-207 kernel: [55164.574162] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:43:10 juju-e4d256-prod-github-runner-207 kernel: [55164.575199] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:43:10 juju-e4d256-prod-github-runner-207 kernel: [55164.576220] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:43:10 juju-e4d256-prod-github-runner-207 kernel: [55164.577311] ? show_regs.part.0+0x23/0x29 Aug 22 20:43:10 juju-e4d256-prod-github-runner-207 kernel: [55164.578310] ? show_regs.cold+0x8/0xd Aug 22 20:43:10 juju-e4d256-prod-github-runner-207 kernel: [55164.579279] ? watchdog_timer_fn+0x1be/0x220 Aug 22 20:43:10 juju-e4d256-prod-github-runner-207 kernel: [55164.580288] ? lockup_detector_update_enable+0x60/0x60 Aug 22 20:43:10 juju-e4d256-prod-github-runner-207 kernel: [55164.581372] ? __hrtimer_run_queues+0x107/0x230 Aug 22 20:43:10 juju-e4d256-prod-github-runner-207 kernel: [55164.582421] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 20:43:10 juju-e4d256-prod-github-runner-207 kernel: [55164.583451] ? hrtimer_interrupt+0x101/0x220 Aug 22 20:43:10 juju-e4d256-prod-github-runner-207 kernel: [55164.584469] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 20:43:10 juju-e4d256-prod-github-runner-207 kernel: [55164.585555] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 20:43:10 juju-e4d256-prod-github-runner-207 kernel: [55164.586607] Aug 22 20:43:10 juju-e4d256-prod-github-runner-207 kernel: [55164.587648] Aug 22 20:43:10 juju-e4d256-prod-github-runner-207 kernel: [55164.588498] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 20:43:10 juju-e4d256-prod-github-runner-207 kernel: [55164.589551] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:43:10 juju-e4d256-prod-github-runner-207 kernel: [55164.590593] ? _raw_spin_lock+0x22/0x30 Aug 22 20:43:10 juju-e4d256-prod-github-runner-207 kernel: [55164.591539] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:43:10 juju-e4d256-prod-github-runner-207 kernel: [55164.592748] direct_page_fault+0x206/0x310 [kvm] Aug 22 20:43:10 juju-e4d256-prod-github-runner-207 kernel: [55164.593783] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 20:43:10 juju-e4d256-prod-github-runner-207 kernel: [55164.594798] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 20:43:10 juju-e4d256-prod-github-runner-207 kernel: [55164.595800] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 20:43:10 juju-e4d256-prod-github-runner-207 kernel: [55164.596772] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 20:43:10 juju-e4d256-prod-github-runner-207 kernel: [55164.597783] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 20:43:10 juju-e4d256-prod-github-runner-207 kernel: [55164.598786] handle_exit+0x98/0x230 [kvm_amd] Aug 22 20:43:10 juju-e4d256-prod-github-runner-207 kernel: [55164.599688] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 20:43:10 juju-e4d256-prod-github-runner-207 kernel: [55164.600606] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 20:43:10 juju-e4d256-prod-github-runner-207 kernel: [55164.601581] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 20:43:10 juju-e4d256-prod-github-runner-207 kernel: [55164.602497] vcpu_run+0x62/0x2c0 [kvm] Aug 22 20:43:10 juju-e4d256-prod-github-runner-207 kernel: [55164.603315] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 20:43:10 juju-e4d256-prod-github-runner-207 kernel: [55164.604123] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 20:43:10 juju-e4d256-prod-github-runner-207 kernel: [55164.604976] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 20:43:10 juju-e4d256-prod-github-runner-207 kernel: [55164.605786] ? __seccomp_filter+0x4a/0x4a0 Aug 22 20:43:10 juju-e4d256-prod-github-runner-207 kernel: [55164.606554] ? __fget_files+0x86/0xc0 Aug 22 20:43:10 juju-e4d256-prod-github-runner-207 kernel: [55164.607262] __x64_sys_ioctl+0x95/0xd0 Aug 22 20:43:10 juju-e4d256-prod-github-runner-207 kernel: [55164.607954] do_syscall_64+0x5c/0xc0 Aug 22 20:43:10 juju-e4d256-prod-github-runner-207 kernel: [55164.608619] ? do_futex+0x162/0x1f0 Aug 22 20:43:10 juju-e4d256-prod-github-runner-207 kernel: [55164.609399] ? __x64_sys_futex+0x78/0x1e0 Aug 22 20:43:10 juju-e4d256-prod-github-runner-207 kernel: [55164.610164] ? __secure_computing+0xa9/0x120 Aug 22 20:43:10 juju-e4d256-prod-github-runner-207 kernel: [55164.610960] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 20:43:10 juju-e4d256-prod-github-runner-207 kernel: [55164.611830] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:43:10 juju-e4d256-prod-github-runner-207 kernel: [55164.612646] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:43:10 juju-e4d256-prod-github-runner-207 kernel: [55164.613482] ? do_syscall_64+0x69/0xc0 Aug 22 20:43:10 juju-e4d256-prod-github-runner-207 kernel: [55164.614212] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:43:10 juju-e4d256-prod-github-runner-207 kernel: [55164.615010] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:43:10 juju-e4d256-prod-github-runner-207 kernel: [55164.615798] ? do_syscall_64+0x69/0xc0 Aug 22 20:43:10 juju-e4d256-prod-github-runner-207 kernel: [55164.616500] ? do_syscall_64+0x69/0xc0 Aug 22 20:43:10 juju-e4d256-prod-github-runner-207 kernel: [55164.617226] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 20:43:10 juju-e4d256-prod-github-runner-207 kernel: [55164.618035] RIP: 0033:0x7faa5d0edaff Aug 22 20:43:10 juju-e4d256-prod-github-runner-207 kernel: [55164.618735] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 20:43:10 juju-e4d256-prod-github-runner-207 kernel: [55164.621078] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 20:43:10 juju-e4d256-prod-github-runner-207 kernel: [55164.622153] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 20:43:10 juju-e4d256-prod-github-runner-207 kernel: [55164.623182] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 20:43:10 juju-e4d256-prod-github-runner-207 kernel: [55164.624207] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 20:43:10 juju-e4d256-prod-github-runner-207 kernel: [55164.625272] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 20:43:10 juju-e4d256-prod-github-runner-207 kernel: [55164.626303] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 20:43:10 juju-e4d256-prod-github-runner-207 kernel: [55164.627369] Aug 22 20:43:38 juju-e4d256-prod-github-runner-207 kernel: [55192.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 51294s! [qemu-system-x86:6715] Aug 22 20:43:38 juju-e4d256-prod-github-runner-207 kernel: [55192.543883] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 20:43:38 juju-e4d256-prod-github-runner-207 kernel: [55192.544181] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 20:43:38 juju-e4d256-prod-github-runner-207 kernel: [55192.556349] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 20:43:38 juju-e4d256-prod-github-runner-207 kernel: [55192.557632] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 20:43:38 juju-e4d256-prod-github-runner-207 kernel: [55192.558850] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:43:38 juju-e4d256-prod-github-runner-207 kernel: [55192.559907] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 20:43:38 juju-e4d256-prod-github-runner-207 kernel: [55192.562480] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 20:43:38 juju-e4d256-prod-github-runner-207 kernel: [55192.563537] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 20:43:38 juju-e4d256-prod-github-runner-207 kernel: [55192.564723] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 20:43:38 juju-e4d256-prod-github-runner-207 kernel: [55192.565892] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 20:43:38 juju-e4d256-prod-github-runner-207 kernel: [55192.567058] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 20:43:38 juju-e4d256-prod-github-runner-207 kernel: [55192.568217] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 20:43:38 juju-e4d256-prod-github-runner-207 kernel: [55192.569535] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 20:43:38 juju-e4d256-prod-github-runner-207 kernel: [55192.570940] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 20:43:38 juju-e4d256-prod-github-runner-207 kernel: [55192.572170] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 20:43:38 juju-e4d256-prod-github-runner-207 kernel: [55192.573569] Call Trace: Aug 22 20:43:38 juju-e4d256-prod-github-runner-207 kernel: [55192.574531] Aug 22 20:43:38 juju-e4d256-prod-github-runner-207 kernel: [55192.575469] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:43:38 juju-e4d256-prod-github-runner-207 kernel: [55192.576577] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:43:38 juju-e4d256-prod-github-runner-207 kernel: [55192.577723] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:43:38 juju-e4d256-prod-github-runner-207 kernel: [55192.578917] ? show_regs.part.0+0x23/0x29 Aug 22 20:43:38 juju-e4d256-prod-github-runner-207 kernel: [55192.580003] ? show_regs.cold+0x8/0xd Aug 22 20:43:38 juju-e4d256-prod-github-runner-207 kernel: [55192.581068] ? watchdog_timer_fn+0x1be/0x220 Aug 22 20:43:38 juju-e4d256-prod-github-runner-207 kernel: [55192.582164] ? lockup_detector_update_enable+0x60/0x60 Aug 22 20:43:38 juju-e4d256-prod-github-runner-207 kernel: [55192.583328] ? __hrtimer_run_queues+0x107/0x230 Aug 22 20:43:38 juju-e4d256-prod-github-runner-207 kernel: [55192.584455] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 20:43:38 juju-e4d256-prod-github-runner-207 kernel: [55192.585690] ? hrtimer_interrupt+0x101/0x220 Aug 22 20:43:38 juju-e4d256-prod-github-runner-207 kernel: [55192.586786] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 20:43:38 juju-e4d256-prod-github-runner-207 kernel: [55192.587951] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 20:43:38 juju-e4d256-prod-github-runner-207 kernel: [55192.589111] Aug 22 20:43:38 juju-e4d256-prod-github-runner-207 kernel: [55192.590011] Aug 22 20:43:38 juju-e4d256-prod-github-runner-207 kernel: [55192.590890] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 20:43:38 juju-e4d256-prod-github-runner-207 kernel: [55192.592022] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:43:38 juju-e4d256-prod-github-runner-207 kernel: [55192.593182] ? _raw_spin_lock+0x22/0x30 Aug 22 20:43:38 juju-e4d256-prod-github-runner-207 kernel: [55192.594208] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:43:38 juju-e4d256-prod-github-runner-207 kernel: [55192.595310] direct_page_fault+0x206/0x310 [kvm] Aug 22 20:43:38 juju-e4d256-prod-github-runner-207 kernel: [55192.596424] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 20:43:38 juju-e4d256-prod-github-runner-207 kernel: [55192.597535] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 20:43:38 juju-e4d256-prod-github-runner-207 kernel: [55192.598620] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 20:43:38 juju-e4d256-prod-github-runner-207 kernel: [55192.599706] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 20:43:38 juju-e4d256-prod-github-runner-207 kernel: [55192.600763] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 20:43:38 juju-e4d256-prod-github-runner-207 kernel: [55192.601851] handle_exit+0x98/0x230 [kvm_amd] Aug 22 20:43:38 juju-e4d256-prod-github-runner-207 kernel: [55192.602833] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 20:43:38 juju-e4d256-prod-github-runner-207 kernel: [55192.603833] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 20:43:38 juju-e4d256-prod-github-runner-207 kernel: [55192.604883] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 20:43:38 juju-e4d256-prod-github-runner-207 kernel: [55192.605877] vcpu_run+0x62/0x2c0 [kvm] Aug 22 20:43:38 juju-e4d256-prod-github-runner-207 kernel: [55192.606764] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 20:43:38 juju-e4d256-prod-github-runner-207 kernel: [55192.607666] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 20:43:38 juju-e4d256-prod-github-runner-207 kernel: [55192.608615] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 20:43:38 juju-e4d256-prod-github-runner-207 kernel: [55192.609509] ? __seccomp_filter+0x4a/0x4a0 Aug 22 20:43:38 juju-e4d256-prod-github-runner-207 kernel: [55192.610336] ? __fget_files+0x86/0xc0 Aug 22 20:43:38 juju-e4d256-prod-github-runner-207 kernel: [55192.611113] __x64_sys_ioctl+0x95/0xd0 Aug 22 20:43:38 juju-e4d256-prod-github-runner-207 kernel: [55192.611884] do_syscall_64+0x5c/0xc0 Aug 22 20:43:38 juju-e4d256-prod-github-runner-207 kernel: [55192.612618] ? do_futex+0x162/0x1f0 Aug 22 20:43:38 juju-e4d256-prod-github-runner-207 kernel: [55192.613354] ? __x64_sys_futex+0x78/0x1e0 Aug 22 20:43:38 juju-e4d256-prod-github-runner-207 kernel: [55192.614106] ? __secure_computing+0xa9/0x120 Aug 22 20:43:38 juju-e4d256-prod-github-runner-207 kernel: [55192.614879] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 20:43:38 juju-e4d256-prod-github-runner-207 kernel: [55192.615736] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:43:38 juju-e4d256-prod-github-runner-207 kernel: [55192.616551] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:43:38 juju-e4d256-prod-github-runner-207 kernel: [55192.617377] ? do_syscall_64+0x69/0xc0 Aug 22 20:43:38 juju-e4d256-prod-github-runner-207 kernel: [55192.618099] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:43:38 juju-e4d256-prod-github-runner-207 kernel: [55192.619061] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:43:38 juju-e4d256-prod-github-runner-207 kernel: [55192.619995] ? do_syscall_64+0x69/0xc0 Aug 22 20:43:38 juju-e4d256-prod-github-runner-207 kernel: [55192.620927] ? do_syscall_64+0x69/0xc0 Aug 22 20:43:38 juju-e4d256-prod-github-runner-207 kernel: [55192.621684] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 20:43:38 juju-e4d256-prod-github-runner-207 kernel: [55192.622488] RIP: 0033:0x7faa5d0edaff Aug 22 20:43:38 juju-e4d256-prod-github-runner-207 kernel: [55192.623218] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 20:43:38 juju-e4d256-prod-github-runner-207 kernel: [55192.625577] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 20:43:38 juju-e4d256-prod-github-runner-207 kernel: [55192.626626] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 20:43:38 juju-e4d256-prod-github-runner-207 kernel: [55192.627646] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 20:43:38 juju-e4d256-prod-github-runner-207 kernel: [55192.628715] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 20:43:38 juju-e4d256-prod-github-runner-207 kernel: [55192.629748] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 20:43:38 juju-e4d256-prod-github-runner-207 kernel: [55192.630779] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 20:43:38 juju-e4d256-prod-github-runner-207 kernel: [55192.631815] Aug 22 20:44:06 juju-e4d256-prod-github-runner-207 kernel: [55220.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 51320s! [qemu-system-x86:6715] Aug 22 20:44:06 juju-e4d256-prod-github-runner-207 kernel: [55220.543108] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 20:44:06 juju-e4d256-prod-github-runner-207 kernel: [55220.543185] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 20:44:06 juju-e4d256-prod-github-runner-207 kernel: [55220.555544] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 20:44:06 juju-e4d256-prod-github-runner-207 kernel: [55220.556831] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 20:44:06 juju-e4d256-prod-github-runner-207 kernel: [55220.558071] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:44:06 juju-e4d256-prod-github-runner-207 kernel: [55220.559128] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 20:44:06 juju-e4d256-prod-github-runner-207 kernel: [55220.561888] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 20:44:06 juju-e4d256-prod-github-runner-207 kernel: [55220.562968] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 20:44:06 juju-e4d256-prod-github-runner-207 kernel: [55220.564140] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 20:44:06 juju-e4d256-prod-github-runner-207 kernel: [55220.565337] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 20:44:06 juju-e4d256-prod-github-runner-207 kernel: [55220.566504] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 20:44:06 juju-e4d256-prod-github-runner-207 kernel: [55220.567682] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 20:44:06 juju-e4d256-prod-github-runner-207 kernel: [55220.568873] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 20:44:06 juju-e4d256-prod-github-runner-207 kernel: [55220.570110] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 20:44:06 juju-e4d256-prod-github-runner-207 kernel: [55220.571220] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 20:44:06 juju-e4d256-prod-github-runner-207 kernel: [55220.572428] Call Trace: Aug 22 20:44:06 juju-e4d256-prod-github-runner-207 kernel: [55220.573341] Aug 22 20:44:06 juju-e4d256-prod-github-runner-207 kernel: [55220.574224] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:44:06 juju-e4d256-prod-github-runner-207 kernel: [55220.575252] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:44:06 juju-e4d256-prod-github-runner-207 kernel: [55220.576280] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:44:06 juju-e4d256-prod-github-runner-207 kernel: [55220.577372] ? show_regs.part.0+0x23/0x29 Aug 22 20:44:06 juju-e4d256-prod-github-runner-207 kernel: [55220.578376] ? show_regs.cold+0x8/0xd Aug 22 20:44:06 juju-e4d256-prod-github-runner-207 kernel: [55220.579349] ? watchdog_timer_fn+0x1be/0x220 Aug 22 20:44:06 juju-e4d256-prod-github-runner-207 kernel: [55220.580366] ? lockup_detector_update_enable+0x60/0x60 Aug 22 20:44:06 juju-e4d256-prod-github-runner-207 kernel: [55220.581435] ? __hrtimer_run_queues+0x107/0x230 Aug 22 20:44:06 juju-e4d256-prod-github-runner-207 kernel: [55220.582468] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 20:44:06 juju-e4d256-prod-github-runner-207 kernel: [55220.583491] ? hrtimer_interrupt+0x101/0x220 Aug 22 20:44:06 juju-e4d256-prod-github-runner-207 kernel: [55220.584524] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 20:44:06 juju-e4d256-prod-github-runner-207 kernel: [55220.585591] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 20:44:06 juju-e4d256-prod-github-runner-207 kernel: [55220.586652] Aug 22 20:44:06 juju-e4d256-prod-github-runner-207 kernel: [55220.587503] Aug 22 20:44:06 juju-e4d256-prod-github-runner-207 kernel: [55220.588366] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 20:44:06 juju-e4d256-prod-github-runner-207 kernel: [55220.589412] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:44:06 juju-e4d256-prod-github-runner-207 kernel: [55220.590471] ? _raw_spin_lock+0x22/0x30 Aug 22 20:44:06 juju-e4d256-prod-github-runner-207 kernel: [55220.591438] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:44:06 juju-e4d256-prod-github-runner-207 kernel: [55220.592496] direct_page_fault+0x206/0x310 [kvm] Aug 22 20:44:06 juju-e4d256-prod-github-runner-207 kernel: [55220.593524] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 20:44:06 juju-e4d256-prod-github-runner-207 kernel: [55220.594530] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 20:44:06 juju-e4d256-prod-github-runner-207 kernel: [55220.595527] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 20:44:06 juju-e4d256-prod-github-runner-207 kernel: [55220.596517] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 20:44:06 juju-e4d256-prod-github-runner-207 kernel: [55220.597510] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 20:44:06 juju-e4d256-prod-github-runner-207 kernel: [55220.598499] handle_exit+0x98/0x230 [kvm_amd] Aug 22 20:44:06 juju-e4d256-prod-github-runner-207 kernel: [55220.599401] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 20:44:06 juju-e4d256-prod-github-runner-207 kernel: [55220.600312] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 20:44:06 juju-e4d256-prod-github-runner-207 kernel: [55220.601251] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 20:44:06 juju-e4d256-prod-github-runner-207 kernel: [55220.602195] vcpu_run+0x62/0x2c0 [kvm] Aug 22 20:44:06 juju-e4d256-prod-github-runner-207 kernel: [55220.603013] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 20:44:06 juju-e4d256-prod-github-runner-207 kernel: [55220.603848] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 20:44:06 juju-e4d256-prod-github-runner-207 kernel: [55220.604726] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 20:44:06 juju-e4d256-prod-github-runner-207 kernel: [55220.605538] ? __seccomp_filter+0x4a/0x4a0 Aug 22 20:44:06 juju-e4d256-prod-github-runner-207 kernel: [55220.606278] ? __fget_files+0x86/0xc0 Aug 22 20:44:06 juju-e4d256-prod-github-runner-207 kernel: [55220.606994] __x64_sys_ioctl+0x95/0xd0 Aug 22 20:44:06 juju-e4d256-prod-github-runner-207 kernel: [55220.607685] do_syscall_64+0x5c/0xc0 Aug 22 20:44:06 juju-e4d256-prod-github-runner-207 kernel: [55220.608374] ? do_futex+0x162/0x1f0 Aug 22 20:44:06 juju-e4d256-prod-github-runner-207 kernel: [55220.609032] ? __x64_sys_futex+0x78/0x1e0 Aug 22 20:44:06 juju-e4d256-prod-github-runner-207 kernel: [55220.609740] ? __secure_computing+0xa9/0x120 Aug 22 20:44:06 juju-e4d256-prod-github-runner-207 kernel: [55220.610430] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 20:44:06 juju-e4d256-prod-github-runner-207 kernel: [55220.611187] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:44:06 juju-e4d256-prod-github-runner-207 kernel: [55220.611928] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:44:06 juju-e4d256-prod-github-runner-207 kernel: [55220.612688] ? do_syscall_64+0x69/0xc0 Aug 22 20:44:06 juju-e4d256-prod-github-runner-207 kernel: [55220.613350] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:44:06 juju-e4d256-prod-github-runner-207 kernel: [55220.614050] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:44:06 juju-e4d256-prod-github-runner-207 kernel: [55220.614751] ? do_syscall_64+0x69/0xc0 Aug 22 20:44:06 juju-e4d256-prod-github-runner-207 kernel: [55220.615372] ? do_syscall_64+0x69/0xc0 Aug 22 20:44:06 juju-e4d256-prod-github-runner-207 kernel: [55220.615997] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 20:44:06 juju-e4d256-prod-github-runner-207 kernel: [55220.616712] RIP: 0033:0x7faa5d0edaff Aug 22 20:44:06 juju-e4d256-prod-github-runner-207 kernel: [55220.617353] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 20:44:06 juju-e4d256-prod-github-runner-207 kernel: [55220.619346] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 20:44:06 juju-e4d256-prod-github-runner-207 kernel: [55220.620256] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 20:44:06 juju-e4d256-prod-github-runner-207 kernel: [55220.621164] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 20:44:06 juju-e4d256-prod-github-runner-207 kernel: [55220.622065] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 20:44:06 juju-e4d256-prod-github-runner-207 kernel: [55220.622958] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 20:44:06 juju-e4d256-prod-github-runner-207 kernel: [55220.623855] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 20:44:06 juju-e4d256-prod-github-runner-207 kernel: [55220.624762] Aug 22 20:44:34 juju-e4d256-prod-github-runner-207 kernel: [55248.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 51346s! [qemu-system-x86:6715] Aug 22 20:44:34 juju-e4d256-prod-github-runner-207 kernel: [55248.543112] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 20:44:34 juju-e4d256-prod-github-runner-207 kernel: [55248.543187] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 20:44:34 juju-e4d256-prod-github-runner-207 kernel: [55248.555925] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 20:44:34 juju-e4d256-prod-github-runner-207 kernel: [55248.557266] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 20:44:34 juju-e4d256-prod-github-runner-207 kernel: [55248.558541] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:44:34 juju-e4d256-prod-github-runner-207 kernel: [55248.559623] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 20:44:34 juju-e4d256-prod-github-runner-207 kernel: [55248.562235] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 20:44:34 juju-e4d256-prod-github-runner-207 kernel: [55248.563293] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 20:44:34 juju-e4d256-prod-github-runner-207 kernel: [55248.564510] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 20:44:34 juju-e4d256-prod-github-runner-207 kernel: [55248.565778] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 20:44:34 juju-e4d256-prod-github-runner-207 kernel: [55248.566974] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 20:44:34 juju-e4d256-prod-github-runner-207 kernel: [55248.568199] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 20:44:34 juju-e4d256-prod-github-runner-207 kernel: [55248.569477] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 20:44:34 juju-e4d256-prod-github-runner-207 kernel: [55248.570820] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 20:44:34 juju-e4d256-prod-github-runner-207 kernel: [55248.571943] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 20:44:34 juju-e4d256-prod-github-runner-207 kernel: [55248.573175] Call Trace: Aug 22 20:44:34 juju-e4d256-prod-github-runner-207 kernel: [55248.574210] Aug 22 20:44:34 juju-e4d256-prod-github-runner-207 kernel: [55248.575184] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:44:34 juju-e4d256-prod-github-runner-207 kernel: [55248.576322] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:44:34 juju-e4d256-prod-github-runner-207 kernel: [55248.577377] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:44:34 juju-e4d256-prod-github-runner-207 kernel: [55248.578467] ? show_regs.part.0+0x23/0x29 Aug 22 20:44:34 juju-e4d256-prod-github-runner-207 kernel: [55248.579476] ? show_regs.cold+0x8/0xd Aug 22 20:44:34 juju-e4d256-prod-github-runner-207 kernel: [55248.580487] ? watchdog_timer_fn+0x1be/0x220 Aug 22 20:44:34 juju-e4d256-prod-github-runner-207 kernel: [55248.581509] ? lockup_detector_update_enable+0x60/0x60 Aug 22 20:44:34 juju-e4d256-prod-github-runner-207 kernel: [55248.582594] ? __hrtimer_run_queues+0x107/0x230 Aug 22 20:44:34 juju-e4d256-prod-github-runner-207 kernel: [55248.583641] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 20:44:34 juju-e4d256-prod-github-runner-207 kernel: [55248.584692] ? hrtimer_interrupt+0x101/0x220 Aug 22 20:44:34 juju-e4d256-prod-github-runner-207 kernel: [55248.585722] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 20:44:34 juju-e4d256-prod-github-runner-207 kernel: [55248.586815] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 20:44:34 juju-e4d256-prod-github-runner-207 kernel: [55248.587879] Aug 22 20:44:34 juju-e4d256-prod-github-runner-207 kernel: [55248.588746] Aug 22 20:44:34 juju-e4d256-prod-github-runner-207 kernel: [55248.589591] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 20:44:34 juju-e4d256-prod-github-runner-207 kernel: [55248.590638] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:44:34 juju-e4d256-prod-github-runner-207 kernel: [55248.591691] ? _raw_spin_lock+0x22/0x30 Aug 22 20:44:34 juju-e4d256-prod-github-runner-207 kernel: [55248.592690] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:44:34 juju-e4d256-prod-github-runner-207 kernel: [55248.593870] direct_page_fault+0x206/0x310 [kvm] Aug 22 20:44:34 juju-e4d256-prod-github-runner-207 kernel: [55248.595048] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 20:44:34 juju-e4d256-prod-github-runner-207 kernel: [55248.596136] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 20:44:34 juju-e4d256-prod-github-runner-207 kernel: [55248.597187] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 20:44:34 juju-e4d256-prod-github-runner-207 kernel: [55248.598228] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 20:44:34 juju-e4d256-prod-github-runner-207 kernel: [55248.599316] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 20:44:34 juju-e4d256-prod-github-runner-207 kernel: [55248.600467] handle_exit+0x98/0x230 [kvm_amd] Aug 22 20:44:34 juju-e4d256-prod-github-runner-207 kernel: [55248.601452] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 20:44:34 juju-e4d256-prod-github-runner-207 kernel: [55248.602411] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 20:44:34 juju-e4d256-prod-github-runner-207 kernel: [55248.603442] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 20:44:34 juju-e4d256-prod-github-runner-207 kernel: [55248.604548] vcpu_run+0x62/0x2c0 [kvm] Aug 22 20:44:34 juju-e4d256-prod-github-runner-207 kernel: [55248.605398] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 20:44:34 juju-e4d256-prod-github-runner-207 kernel: [55248.606294] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 20:44:34 juju-e4d256-prod-github-runner-207 kernel: [55248.607241] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 20:44:34 juju-e4d256-prod-github-runner-207 kernel: [55248.608134] ? __seccomp_filter+0x4a/0x4a0 Aug 22 20:44:34 juju-e4d256-prod-github-runner-207 kernel: [55248.608944] ? __fget_files+0x86/0xc0 Aug 22 20:44:34 juju-e4d256-prod-github-runner-207 kernel: [55248.609667] __x64_sys_ioctl+0x95/0xd0 Aug 22 20:44:34 juju-e4d256-prod-github-runner-207 kernel: [55248.610369] do_syscall_64+0x5c/0xc0 Aug 22 20:44:34 juju-e4d256-prod-github-runner-207 kernel: [55248.611047] ? do_futex+0x162/0x1f0 Aug 22 20:44:34 juju-e4d256-prod-github-runner-207 kernel: [55248.611705] ? __x64_sys_futex+0x78/0x1e0 Aug 22 20:44:34 juju-e4d256-prod-github-runner-207 kernel: [55248.612419] ? __secure_computing+0xa9/0x120 Aug 22 20:44:34 juju-e4d256-prod-github-runner-207 kernel: [55248.613188] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 20:44:34 juju-e4d256-prod-github-runner-207 kernel: [55248.614176] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:44:34 juju-e4d256-prod-github-runner-207 kernel: [55248.614917] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:44:34 juju-e4d256-prod-github-runner-207 kernel: [55248.615651] ? do_syscall_64+0x69/0xc0 Aug 22 20:44:34 juju-e4d256-prod-github-runner-207 kernel: [55248.616341] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:44:34 juju-e4d256-prod-github-runner-207 kernel: [55248.617059] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:44:34 juju-e4d256-prod-github-runner-207 kernel: [55248.617772] ? do_syscall_64+0x69/0xc0 Aug 22 20:44:34 juju-e4d256-prod-github-runner-207 kernel: [55248.618452] ? do_syscall_64+0x69/0xc0 Aug 22 20:44:34 juju-e4d256-prod-github-runner-207 kernel: [55248.619094] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 20:44:34 juju-e4d256-prod-github-runner-207 kernel: [55248.619918] RIP: 0033:0x7faa5d0edaff Aug 22 20:44:34 juju-e4d256-prod-github-runner-207 kernel: [55248.620626] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 20:44:34 juju-e4d256-prod-github-runner-207 kernel: [55248.622675] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 20:44:34 juju-e4d256-prod-github-runner-207 kernel: [55248.623610] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 20:44:34 juju-e4d256-prod-github-runner-207 kernel: [55248.624543] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 20:44:34 juju-e4d256-prod-github-runner-207 kernel: [55248.625459] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 20:44:34 juju-e4d256-prod-github-runner-207 kernel: [55248.626380] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 20:44:34 juju-e4d256-prod-github-runner-207 kernel: [55248.627302] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 20:44:34 juju-e4d256-prod-github-runner-207 kernel: [55248.628297] Aug 22 20:44:46 juju-e4d256-prod-github-runner-207 kernel: [55260.872705] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 20:44:46 juju-e4d256-prod-github-runner-207 kernel: [55260.874463] rcu: 1-....: (13742523 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=6642877 Aug 22 20:44:46 juju-e4d256-prod-github-runner-207 kernel: [55260.875607] (t=13785918 jiffies g=23269 q=50943) Aug 22 20:44:46 juju-e4d256-prod-github-runner-207 kernel: [55260.876414] NMI backtrace for cpu 1 Aug 22 20:44:46 juju-e4d256-prod-github-runner-207 kernel: [55260.877123] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 20:44:46 juju-e4d256-prod-github-runner-207 kernel: [55260.878223] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 20:44:46 juju-e4d256-prod-github-runner-207 kernel: [55260.879289] Call Trace: Aug 22 20:44:46 juju-e4d256-prod-github-runner-207 kernel: [55260.879977] Aug 22 20:44:46 juju-e4d256-prod-github-runner-207 kernel: [55260.880632] show_stack+0x52/0x5c Aug 22 20:44:46 juju-e4d256-prod-github-runner-207 kernel: [55260.881389] dump_stack_lvl+0x4a/0x63 Aug 22 20:44:46 juju-e4d256-prod-github-runner-207 kernel: [55260.882134] dump_stack+0x10/0x16 Aug 22 20:44:46 juju-e4d256-prod-github-runner-207 kernel: [55260.882850] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 20:44:46 juju-e4d256-prod-github-runner-207 kernel: [55260.883630] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 20:44:46 juju-e4d256-prod-github-runner-207 kernel: [55260.884415] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 20:44:46 juju-e4d256-prod-github-runner-207 kernel: [55260.885248] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 20:44:46 juju-e4d256-prod-github-runner-207 kernel: [55260.886082] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 20:44:46 juju-e4d256-prod-github-runner-207 kernel: [55260.886887] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 20:44:46 juju-e4d256-prod-github-runner-207 kernel: [55260.887657] print_cpu_stall.cold+0x2f/0xe2 Aug 22 20:44:46 juju-e4d256-prod-github-runner-207 kernel: [55260.888438] ? timekeeping_update+0xf7/0x150 Aug 22 20:44:46 juju-e4d256-prod-github-runner-207 kernel: [55260.889275] check_cpu_stall+0x109/0x270 Aug 22 20:44:46 juju-e4d256-prod-github-runner-207 kernel: [55260.890045] rcu_sched_clock_irq+0x9a/0x250 Aug 22 20:44:46 juju-e4d256-prod-github-runner-207 kernel: [55260.890803] update_process_times+0x94/0xd0 Aug 22 20:44:46 juju-e4d256-prod-github-runner-207 kernel: [55260.891561] tick_sched_handle+0x29/0x70 Aug 22 20:44:46 juju-e4d256-prod-github-runner-207 kernel: [55260.892312] tick_sched_timer+0x8c/0xc0 Aug 22 20:44:46 juju-e4d256-prod-github-runner-207 kernel: [55260.893052] ? tick_nohz_handler+0xb0/0xb0 Aug 22 20:44:46 juju-e4d256-prod-github-runner-207 kernel: [55260.893802] __hrtimer_run_queues+0x107/0x230 Aug 22 20:44:46 juju-e4d256-prod-github-runner-207 kernel: [55260.894571] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 20:44:46 juju-e4d256-prod-github-runner-207 kernel: [55260.895342] hrtimer_interrupt+0x101/0x220 Aug 22 20:44:46 juju-e4d256-prod-github-runner-207 kernel: [55260.896203] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 20:44:46 juju-e4d256-prod-github-runner-207 kernel: [55260.897014] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 20:44:46 juju-e4d256-prod-github-runner-207 kernel: [55260.897851] Aug 22 20:44:46 juju-e4d256-prod-github-runner-207 kernel: [55260.898492] Aug 22 20:44:46 juju-e4d256-prod-github-runner-207 kernel: [55260.899118] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 20:44:46 juju-e4d256-prod-github-runner-207 kernel: [55260.899945] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:44:46 juju-e4d256-prod-github-runner-207 kernel: [55260.900855] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 20:44:46 juju-e4d256-prod-github-runner-207 kernel: [55260.903058] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 20:44:46 juju-e4d256-prod-github-runner-207 kernel: [55260.903944] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 20:44:46 juju-e4d256-prod-github-runner-207 kernel: [55260.904944] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 20:44:46 juju-e4d256-prod-github-runner-207 kernel: [55260.905921] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 20:44:46 juju-e4d256-prod-github-runner-207 kernel: [55260.906892] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 20:44:46 juju-e4d256-prod-github-runner-207 kernel: [55260.907865] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 20:44:46 juju-e4d256-prod-github-runner-207 kernel: [55260.908821] ? _raw_spin_lock+0x22/0x30 Aug 22 20:44:46 juju-e4d256-prod-github-runner-207 kernel: [55260.909583] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:44:46 juju-e4d256-prod-github-runner-207 kernel: [55260.910432] direct_page_fault+0x206/0x310 [kvm] Aug 22 20:44:46 juju-e4d256-prod-github-runner-207 kernel: [55260.911279] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 20:44:46 juju-e4d256-prod-github-runner-207 kernel: [55260.912127] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 20:44:46 juju-e4d256-prod-github-runner-207 kernel: [55260.912980] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 20:44:46 juju-e4d256-prod-github-runner-207 kernel: [55260.913822] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 20:44:46 juju-e4d256-prod-github-runner-207 kernel: [55260.914626] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 20:44:46 juju-e4d256-prod-github-runner-207 kernel: [55260.915528] handle_exit+0x98/0x230 [kvm_amd] Aug 22 20:44:46 juju-e4d256-prod-github-runner-207 kernel: [55260.916366] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 20:44:46 juju-e4d256-prod-github-runner-207 kernel: [55260.917249] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 20:44:46 juju-e4d256-prod-github-runner-207 kernel: [55260.918050] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 20:44:46 juju-e4d256-prod-github-runner-207 kernel: [55260.918853] vcpu_run+0x62/0x2c0 [kvm] Aug 22 20:44:46 juju-e4d256-prod-github-runner-207 kernel: [55260.919564] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 20:44:46 juju-e4d256-prod-github-runner-207 kernel: [55260.920306] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 20:44:46 juju-e4d256-prod-github-runner-207 kernel: [55260.921101] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 20:44:46 juju-e4d256-prod-github-runner-207 kernel: [55260.921907] ? __seccomp_filter+0x4a/0x4a0 Aug 22 20:44:46 juju-e4d256-prod-github-runner-207 kernel: [55260.922628] ? __fget_files+0x86/0xc0 Aug 22 20:44:46 juju-e4d256-prod-github-runner-207 kernel: [55260.923318] __x64_sys_ioctl+0x95/0xd0 Aug 22 20:44:46 juju-e4d256-prod-github-runner-207 kernel: [55260.924031] do_syscall_64+0x5c/0xc0 Aug 22 20:44:46 juju-e4d256-prod-github-runner-207 kernel: [55260.924711] ? do_futex+0x162/0x1f0 Aug 22 20:44:46 juju-e4d256-prod-github-runner-207 kernel: [55260.925386] ? __x64_sys_futex+0x78/0x1e0 Aug 22 20:44:46 juju-e4d256-prod-github-runner-207 kernel: [55260.926085] ? __secure_computing+0xa9/0x120 Aug 22 20:44:46 juju-e4d256-prod-github-runner-207 kernel: [55260.926810] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 20:44:46 juju-e4d256-prod-github-runner-207 kernel: [55260.927614] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:44:46 juju-e4d256-prod-github-runner-207 kernel: [55260.928404] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:44:46 juju-e4d256-prod-github-runner-207 kernel: [55260.929173] ? do_syscall_64+0x69/0xc0 Aug 22 20:44:46 juju-e4d256-prod-github-runner-207 kernel: [55260.929858] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:44:46 juju-e4d256-prod-github-runner-207 kernel: [55260.930609] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:44:46 juju-e4d256-prod-github-runner-207 kernel: [55260.931383] ? do_syscall_64+0x69/0xc0 Aug 22 20:44:46 juju-e4d256-prod-github-runner-207 kernel: [55260.932096] ? do_syscall_64+0x69/0xc0 Aug 22 20:44:46 juju-e4d256-prod-github-runner-207 kernel: [55260.932781] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 20:44:46 juju-e4d256-prod-github-runner-207 kernel: [55260.933553] RIP: 0033:0x7faa5d0edaff Aug 22 20:44:46 juju-e4d256-prod-github-runner-207 kernel: [55260.934260] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 20:44:46 juju-e4d256-prod-github-runner-207 kernel: [55260.936392] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 20:44:46 juju-e4d256-prod-github-runner-207 kernel: [55260.937358] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 20:44:46 juju-e4d256-prod-github-runner-207 kernel: [55260.938304] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 20:44:46 juju-e4d256-prod-github-runner-207 kernel: [55260.939252] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 20:44:46 juju-e4d256-prod-github-runner-207 kernel: [55260.940205] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 20:44:46 juju-e4d256-prod-github-runner-207 kernel: [55260.941128] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 20:44:46 juju-e4d256-prod-github-runner-207 kernel: [55260.942041] Aug 22 20:45:14 juju-e4d256-prod-github-runner-207 kernel: [55288.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 51383s! [qemu-system-x86:6715] Aug 22 20:45:14 juju-e4d256-prod-github-runner-207 kernel: [55288.543148] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 20:45:14 juju-e4d256-prod-github-runner-207 kernel: [55288.543552] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 20:45:14 juju-e4d256-prod-github-runner-207 kernel: [55288.556281] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 20:45:14 juju-e4d256-prod-github-runner-207 kernel: [55288.557890] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 20:45:14 juju-e4d256-prod-github-runner-207 kernel: [55288.559163] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:45:14 juju-e4d256-prod-github-runner-207 kernel: [55288.560331] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 20:45:14 juju-e4d256-prod-github-runner-207 kernel: [55288.563030] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 20:45:14 juju-e4d256-prod-github-runner-207 kernel: [55288.564235] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 20:45:14 juju-e4d256-prod-github-runner-207 kernel: [55288.565488] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 20:45:14 juju-e4d256-prod-github-runner-207 kernel: [55288.566782] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 20:45:14 juju-e4d256-prod-github-runner-207 kernel: [55288.568047] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 20:45:14 juju-e4d256-prod-github-runner-207 kernel: [55288.569291] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 20:45:14 juju-e4d256-prod-github-runner-207 kernel: [55288.570630] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 20:45:14 juju-e4d256-prod-github-runner-207 kernel: [55288.572041] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 20:45:14 juju-e4d256-prod-github-runner-207 kernel: [55288.573275] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 20:45:14 juju-e4d256-prod-github-runner-207 kernel: [55288.574641] Call Trace: Aug 22 20:45:14 juju-e4d256-prod-github-runner-207 kernel: [55288.575619] Aug 22 20:45:14 juju-e4d256-prod-github-runner-207 kernel: [55288.576578] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:45:14 juju-e4d256-prod-github-runner-207 kernel: [55288.577714] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:45:14 juju-e4d256-prod-github-runner-207 kernel: [55288.578815] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:45:14 juju-e4d256-prod-github-runner-207 kernel: [55288.580009] ? show_regs.part.0+0x23/0x29 Aug 22 20:45:14 juju-e4d256-prod-github-runner-207 kernel: [55288.581103] ? show_regs.cold+0x8/0xd Aug 22 20:45:14 juju-e4d256-prod-github-runner-207 kernel: [55288.582159] ? watchdog_timer_fn+0x1be/0x220 Aug 22 20:45:14 juju-e4d256-prod-github-runner-207 kernel: [55288.583269] ? lockup_detector_update_enable+0x60/0x60 Aug 22 20:45:14 juju-e4d256-prod-github-runner-207 kernel: [55288.584438] ? __hrtimer_run_queues+0x107/0x230 Aug 22 20:45:14 juju-e4d256-prod-github-runner-207 kernel: [55288.585524] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 20:45:14 juju-e4d256-prod-github-runner-207 kernel: [55288.586609] ? hrtimer_interrupt+0x101/0x220 Aug 22 20:45:14 juju-e4d256-prod-github-runner-207 kernel: [55288.587696] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 20:45:14 juju-e4d256-prod-github-runner-207 kernel: [55288.588793] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 20:45:14 juju-e4d256-prod-github-runner-207 kernel: [55288.589924] Aug 22 20:45:14 juju-e4d256-prod-github-runner-207 kernel: [55288.591099] Aug 22 20:45:14 juju-e4d256-prod-github-runner-207 kernel: [55288.592043] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 20:45:14 juju-e4d256-prod-github-runner-207 kernel: [55288.593155] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:45:14 juju-e4d256-prod-github-runner-207 kernel: [55288.594326] ? _raw_spin_lock+0x22/0x30 Aug 22 20:45:14 juju-e4d256-prod-github-runner-207 kernel: [55288.595343] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:45:14 juju-e4d256-prod-github-runner-207 kernel: [55288.596522] direct_page_fault+0x206/0x310 [kvm] Aug 22 20:45:14 juju-e4d256-prod-github-runner-207 kernel: [55288.597690] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 20:45:14 juju-e4d256-prod-github-runner-207 kernel: [55288.598996] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 20:45:14 juju-e4d256-prod-github-runner-207 kernel: [55288.600135] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 20:45:14 juju-e4d256-prod-github-runner-207 kernel: [55288.601215] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 20:45:14 juju-e4d256-prod-github-runner-207 kernel: [55288.602309] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 20:45:14 juju-e4d256-prod-github-runner-207 kernel: [55288.603413] handle_exit+0x98/0x230 [kvm_amd] Aug 22 20:45:14 juju-e4d256-prod-github-runner-207 kernel: [55288.604407] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 20:45:14 juju-e4d256-prod-github-runner-207 kernel: [55288.605419] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 20:45:14 juju-e4d256-prod-github-runner-207 kernel: [55288.606442] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 20:45:14 juju-e4d256-prod-github-runner-207 kernel: [55288.607378] vcpu_run+0x62/0x2c0 [kvm] Aug 22 20:45:14 juju-e4d256-prod-github-runner-207 kernel: [55288.608238] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 20:45:14 juju-e4d256-prod-github-runner-207 kernel: [55288.609064] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 20:45:14 juju-e4d256-prod-github-runner-207 kernel: [55288.609941] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 20:45:14 juju-e4d256-prod-github-runner-207 kernel: [55288.610772] ? __seccomp_filter+0x4a/0x4a0 Aug 22 20:45:14 juju-e4d256-prod-github-runner-207 kernel: [55288.611564] ? __fget_files+0x86/0xc0 Aug 22 20:45:14 juju-e4d256-prod-github-runner-207 kernel: [55288.612279] __x64_sys_ioctl+0x95/0xd0 Aug 22 20:45:14 juju-e4d256-prod-github-runner-207 kernel: [55288.612997] do_syscall_64+0x5c/0xc0 Aug 22 20:45:14 juju-e4d256-prod-github-runner-207 kernel: [55288.613735] ? do_futex+0x162/0x1f0 Aug 22 20:45:14 juju-e4d256-prod-github-runner-207 kernel: [55288.614432] ? __x64_sys_futex+0x78/0x1e0 Aug 22 20:45:14 juju-e4d256-prod-github-runner-207 kernel: [55288.615161] ? __secure_computing+0xa9/0x120 Aug 22 20:45:14 juju-e4d256-prod-github-runner-207 kernel: [55288.615903] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 20:45:14 juju-e4d256-prod-github-runner-207 kernel: [55288.616723] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:45:14 juju-e4d256-prod-github-runner-207 kernel: [55288.617487] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:45:14 juju-e4d256-prod-github-runner-207 kernel: [55288.618314] ? do_syscall_64+0x69/0xc0 Aug 22 20:45:14 juju-e4d256-prod-github-runner-207 kernel: [55288.619016] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:45:14 juju-e4d256-prod-github-runner-207 kernel: [55288.619798] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:45:14 juju-e4d256-prod-github-runner-207 kernel: [55288.620535] ? do_syscall_64+0x69/0xc0 Aug 22 20:45:14 juju-e4d256-prod-github-runner-207 kernel: [55288.621213] ? do_syscall_64+0x69/0xc0 Aug 22 20:45:14 juju-e4d256-prod-github-runner-207 kernel: [55288.621855] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 20:45:14 juju-e4d256-prod-github-runner-207 kernel: [55288.622602] RIP: 0033:0x7faa5d0edaff Aug 22 20:45:14 juju-e4d256-prod-github-runner-207 kernel: [55288.623281] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 20:45:14 juju-e4d256-prod-github-runner-207 kernel: [55288.625400] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 20:45:14 juju-e4d256-prod-github-runner-207 kernel: [55288.626354] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 20:45:14 juju-e4d256-prod-github-runner-207 kernel: [55288.627273] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 20:45:14 juju-e4d256-prod-github-runner-207 kernel: [55288.628307] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 20:45:14 juju-e4d256-prod-github-runner-207 kernel: [55288.629260] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 20:45:14 juju-e4d256-prod-github-runner-207 kernel: [55288.630236] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 20:45:14 juju-e4d256-prod-github-runner-207 kernel: [55288.631158] Aug 22 20:45:42 juju-e4d256-prod-github-runner-207 kernel: [55316.541980] watchdog: BUG: soft lockup - CPU#1 stuck for 51409s! [qemu-system-x86:6715] Aug 22 20:45:42 juju-e4d256-prod-github-runner-207 kernel: [55316.543118] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 20:45:42 juju-e4d256-prod-github-runner-207 kernel: [55316.543213] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 20:45:42 juju-e4d256-prod-github-runner-207 kernel: [55316.556749] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 20:45:42 juju-e4d256-prod-github-runner-207 kernel: [55316.558123] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 20:45:42 juju-e4d256-prod-github-runner-207 kernel: [55316.559415] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:45:42 juju-e4d256-prod-github-runner-207 kernel: [55316.560505] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 20:45:42 juju-e4d256-prod-github-runner-207 kernel: [55316.563197] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 20:45:42 juju-e4d256-prod-github-runner-207 kernel: [55316.564259] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 20:45:42 juju-e4d256-prod-github-runner-207 kernel: [55316.565479] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 20:45:42 juju-e4d256-prod-github-runner-207 kernel: [55316.566894] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 20:45:42 juju-e4d256-prod-github-runner-207 kernel: [55316.568115] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 20:45:42 juju-e4d256-prod-github-runner-207 kernel: [55316.569304] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 20:45:42 juju-e4d256-prod-github-runner-207 kernel: [55316.570561] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 20:45:42 juju-e4d256-prod-github-runner-207 kernel: [55316.571888] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 20:45:42 juju-e4d256-prod-github-runner-207 kernel: [55316.573019] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 20:45:42 juju-e4d256-prod-github-runner-207 kernel: [55316.574233] Call Trace: Aug 22 20:45:42 juju-e4d256-prod-github-runner-207 kernel: [55316.575181] Aug 22 20:45:42 juju-e4d256-prod-github-runner-207 kernel: [55316.576082] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:45:42 juju-e4d256-prod-github-runner-207 kernel: [55316.577148] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:45:42 juju-e4d256-prod-github-runner-207 kernel: [55316.578198] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:45:42 juju-e4d256-prod-github-runner-207 kernel: [55316.579312] ? show_regs.part.0+0x23/0x29 Aug 22 20:45:42 juju-e4d256-prod-github-runner-207 kernel: [55316.580344] ? show_regs.cold+0x8/0xd Aug 22 20:45:42 juju-e4d256-prod-github-runner-207 kernel: [55316.581375] ? watchdog_timer_fn+0x1be/0x220 Aug 22 20:45:42 juju-e4d256-prod-github-runner-207 kernel: [55316.582443] ? lockup_detector_update_enable+0x60/0x60 Aug 22 20:45:42 juju-e4d256-prod-github-runner-207 kernel: [55316.583540] ? __hrtimer_run_queues+0x107/0x230 Aug 22 20:45:42 juju-e4d256-prod-github-runner-207 kernel: [55316.584629] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 20:45:42 juju-e4d256-prod-github-runner-207 kernel: [55316.585676] ? hrtimer_interrupt+0x101/0x220 Aug 22 20:45:42 juju-e4d256-prod-github-runner-207 kernel: [55316.586721] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 20:45:42 juju-e4d256-prod-github-runner-207 kernel: [55316.587862] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 20:45:42 juju-e4d256-prod-github-runner-207 kernel: [55316.588937] Aug 22 20:45:42 juju-e4d256-prod-github-runner-207 kernel: [55316.589800] Aug 22 20:45:42 juju-e4d256-prod-github-runner-207 kernel: [55316.590646] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 20:45:42 juju-e4d256-prod-github-runner-207 kernel: [55316.591743] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:45:42 juju-e4d256-prod-github-runner-207 kernel: [55316.592950] ? _raw_spin_lock+0x22/0x30 Aug 22 20:45:42 juju-e4d256-prod-github-runner-207 kernel: [55316.593917] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:45:42 juju-e4d256-prod-github-runner-207 kernel: [55316.594988] direct_page_fault+0x206/0x310 [kvm] Aug 22 20:45:42 juju-e4d256-prod-github-runner-207 kernel: [55316.596052] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 20:45:42 juju-e4d256-prod-github-runner-207 kernel: [55316.597076] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 20:45:42 juju-e4d256-prod-github-runner-207 kernel: [55316.598114] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 20:45:42 juju-e4d256-prod-github-runner-207 kernel: [55316.599119] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 20:45:42 juju-e4d256-prod-github-runner-207 kernel: [55316.600098] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 20:45:42 juju-e4d256-prod-github-runner-207 kernel: [55316.601095] handle_exit+0x98/0x230 [kvm_amd] Aug 22 20:45:42 juju-e4d256-prod-github-runner-207 kernel: [55316.602025] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 20:45:42 juju-e4d256-prod-github-runner-207 kernel: [55316.602990] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 20:45:42 juju-e4d256-prod-github-runner-207 kernel: [55316.603954] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 20:45:42 juju-e4d256-prod-github-runner-207 kernel: [55316.604892] vcpu_run+0x62/0x2c0 [kvm] Aug 22 20:45:42 juju-e4d256-prod-github-runner-207 kernel: [55316.605717] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 20:45:42 juju-e4d256-prod-github-runner-207 kernel: [55316.606539] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 20:45:42 juju-e4d256-prod-github-runner-207 kernel: [55316.607445] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 20:45:42 juju-e4d256-prod-github-runner-207 kernel: [55316.608300] ? __seccomp_filter+0x4a/0x4a0 Aug 22 20:45:42 juju-e4d256-prod-github-runner-207 kernel: [55316.609061] ? __fget_files+0x86/0xc0 Aug 22 20:45:42 juju-e4d256-prod-github-runner-207 kernel: [55316.609779] __x64_sys_ioctl+0x95/0xd0 Aug 22 20:45:42 juju-e4d256-prod-github-runner-207 kernel: [55316.610528] do_syscall_64+0x5c/0xc0 Aug 22 20:45:42 juju-e4d256-prod-github-runner-207 kernel: [55316.611237] ? do_futex+0x162/0x1f0 Aug 22 20:45:42 juju-e4d256-prod-github-runner-207 kernel: [55316.611903] ? __x64_sys_futex+0x78/0x1e0 Aug 22 20:45:42 juju-e4d256-prod-github-runner-207 kernel: [55316.612639] ? __secure_computing+0xa9/0x120 Aug 22 20:45:42 juju-e4d256-prod-github-runner-207 kernel: [55316.613366] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 20:45:42 juju-e4d256-prod-github-runner-207 kernel: [55316.614210] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:45:42 juju-e4d256-prod-github-runner-207 kernel: [55316.614958] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:45:42 juju-e4d256-prod-github-runner-207 kernel: [55316.615721] ? do_syscall_64+0x69/0xc0 Aug 22 20:45:42 juju-e4d256-prod-github-runner-207 kernel: [55316.616385] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:45:42 juju-e4d256-prod-github-runner-207 kernel: [55316.617151] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:45:42 juju-e4d256-prod-github-runner-207 kernel: [55316.617898] ? do_syscall_64+0x69/0xc0 Aug 22 20:45:42 juju-e4d256-prod-github-runner-207 kernel: [55316.618694] ? do_syscall_64+0x69/0xc0 Aug 22 20:45:42 juju-e4d256-prod-github-runner-207 kernel: [55316.619387] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 20:45:42 juju-e4d256-prod-github-runner-207 kernel: [55316.620122] RIP: 0033:0x7faa5d0edaff Aug 22 20:45:42 juju-e4d256-prod-github-runner-207 kernel: [55316.620769] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 20:45:42 juju-e4d256-prod-github-runner-207 kernel: [55316.622838] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 20:45:42 juju-e4d256-prod-github-runner-207 kernel: [55316.623832] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 20:45:42 juju-e4d256-prod-github-runner-207 kernel: [55316.624744] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 20:45:42 juju-e4d256-prod-github-runner-207 kernel: [55316.625658] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 20:45:42 juju-e4d256-prod-github-runner-207 kernel: [55316.626574] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 20:45:42 juju-e4d256-prod-github-runner-207 kernel: [55316.627503] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 20:45:42 juju-e4d256-prod-github-runner-207 kernel: [55316.628428] Aug 22 20:46:10 juju-e4d256-prod-github-runner-207 kernel: [55344.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 51435s! [qemu-system-x86:6715] Aug 22 20:46:10 juju-e4d256-prod-github-runner-207 kernel: [55344.543132] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 20:46:10 juju-e4d256-prod-github-runner-207 kernel: [55344.543202] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 20:46:10 juju-e4d256-prod-github-runner-207 kernel: [55344.555521] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 20:46:10 juju-e4d256-prod-github-runner-207 kernel: [55344.556799] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 20:46:10 juju-e4d256-prod-github-runner-207 kernel: [55344.558023] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:46:10 juju-e4d256-prod-github-runner-207 kernel: [55344.559112] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 20:46:10 juju-e4d256-prod-github-runner-207 kernel: [55344.562008] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 20:46:10 juju-e4d256-prod-github-runner-207 kernel: [55344.563207] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 20:46:10 juju-e4d256-prod-github-runner-207 kernel: [55344.564528] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 20:46:10 juju-e4d256-prod-github-runner-207 kernel: [55344.565863] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 20:46:10 juju-e4d256-prod-github-runner-207 kernel: [55344.567193] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 20:46:10 juju-e4d256-prod-github-runner-207 kernel: [55344.568482] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 20:46:10 juju-e4d256-prod-github-runner-207 kernel: [55344.569793] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 20:46:10 juju-e4d256-prod-github-runner-207 kernel: [55344.571194] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 20:46:10 juju-e4d256-prod-github-runner-207 kernel: [55344.572409] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 20:46:10 juju-e4d256-prod-github-runner-207 kernel: [55344.573743] Call Trace: Aug 22 20:46:10 juju-e4d256-prod-github-runner-207 kernel: [55344.574709] Aug 22 20:46:10 juju-e4d256-prod-github-runner-207 kernel: [55344.575667] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:46:10 juju-e4d256-prod-github-runner-207 kernel: [55344.576801] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:46:10 juju-e4d256-prod-github-runner-207 kernel: [55344.577929] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:46:10 juju-e4d256-prod-github-runner-207 kernel: [55344.579110] ? show_regs.part.0+0x23/0x29 Aug 22 20:46:10 juju-e4d256-prod-github-runner-207 kernel: [55344.580196] ? show_regs.cold+0x8/0xd Aug 22 20:46:10 juju-e4d256-prod-github-runner-207 kernel: [55344.581241] ? watchdog_timer_fn+0x1be/0x220 Aug 22 20:46:10 juju-e4d256-prod-github-runner-207 kernel: [55344.582343] ? lockup_detector_update_enable+0x60/0x60 Aug 22 20:46:10 juju-e4d256-prod-github-runner-207 kernel: [55344.583518] ? __hrtimer_run_queues+0x107/0x230 Aug 22 20:46:10 juju-e4d256-prod-github-runner-207 kernel: [55344.584635] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 20:46:10 juju-e4d256-prod-github-runner-207 kernel: [55344.585744] ? hrtimer_interrupt+0x101/0x220 Aug 22 20:46:10 juju-e4d256-prod-github-runner-207 kernel: [55344.586858] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 20:46:10 juju-e4d256-prod-github-runner-207 kernel: [55344.588042] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 20:46:10 juju-e4d256-prod-github-runner-207 kernel: [55344.589192] Aug 22 20:46:10 juju-e4d256-prod-github-runner-207 kernel: [55344.590095] Aug 22 20:46:10 juju-e4d256-prod-github-runner-207 kernel: [55344.591001] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 20:46:10 juju-e4d256-prod-github-runner-207 kernel: [55344.592143] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:46:10 juju-e4d256-prod-github-runner-207 kernel: [55344.593294] ? _raw_spin_lock+0x22/0x30 Aug 22 20:46:10 juju-e4d256-prod-github-runner-207 kernel: [55344.594330] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:46:10 juju-e4d256-prod-github-runner-207 kernel: [55344.595462] direct_page_fault+0x206/0x310 [kvm] Aug 22 20:46:10 juju-e4d256-prod-github-runner-207 kernel: [55344.596579] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 20:46:10 juju-e4d256-prod-github-runner-207 kernel: [55344.597789] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 20:46:10 juju-e4d256-prod-github-runner-207 kernel: [55344.598902] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 20:46:10 juju-e4d256-prod-github-runner-207 kernel: [55344.599974] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 20:46:10 juju-e4d256-prod-github-runner-207 kernel: [55344.601104] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 20:46:10 juju-e4d256-prod-github-runner-207 kernel: [55344.602213] handle_exit+0x98/0x230 [kvm_amd] Aug 22 20:46:10 juju-e4d256-prod-github-runner-207 kernel: [55344.603203] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 20:46:10 juju-e4d256-prod-github-runner-207 kernel: [55344.604224] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 20:46:10 juju-e4d256-prod-github-runner-207 kernel: [55344.605248] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 20:46:10 juju-e4d256-prod-github-runner-207 kernel: [55344.606255] vcpu_run+0x62/0x2c0 [kvm] Aug 22 20:46:10 juju-e4d256-prod-github-runner-207 kernel: [55344.607152] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 20:46:10 juju-e4d256-prod-github-runner-207 kernel: [55344.608044] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 20:46:10 juju-e4d256-prod-github-runner-207 kernel: [55344.609006] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 20:46:10 juju-e4d256-prod-github-runner-207 kernel: [55344.609891] ? __seccomp_filter+0x4a/0x4a0 Aug 22 20:46:10 juju-e4d256-prod-github-runner-207 kernel: [55344.610712] ? __fget_files+0x86/0xc0 Aug 22 20:46:10 juju-e4d256-prod-github-runner-207 kernel: [55344.611514] __x64_sys_ioctl+0x95/0xd0 Aug 22 20:46:10 juju-e4d256-prod-github-runner-207 kernel: [55344.612337] do_syscall_64+0x5c/0xc0 Aug 22 20:46:10 juju-e4d256-prod-github-runner-207 kernel: [55344.613061] ? do_futex+0x162/0x1f0 Aug 22 20:46:10 juju-e4d256-prod-github-runner-207 kernel: [55344.613714] ? __x64_sys_futex+0x78/0x1e0 Aug 22 20:46:10 juju-e4d256-prod-github-runner-207 kernel: [55344.614391] ? __secure_computing+0xa9/0x120 Aug 22 20:46:10 juju-e4d256-prod-github-runner-207 kernel: [55344.615119] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 20:46:10 juju-e4d256-prod-github-runner-207 kernel: [55344.615898] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:46:10 juju-e4d256-prod-github-runner-207 kernel: [55344.616628] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:46:10 juju-e4d256-prod-github-runner-207 kernel: [55344.617353] ? do_syscall_64+0x69/0xc0 Aug 22 20:46:10 juju-e4d256-prod-github-runner-207 kernel: [55344.618001] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:46:10 juju-e4d256-prod-github-runner-207 kernel: [55344.618705] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:46:10 juju-e4d256-prod-github-runner-207 kernel: [55344.619414] ? do_syscall_64+0x69/0xc0 Aug 22 20:46:10 juju-e4d256-prod-github-runner-207 kernel: [55344.620046] ? do_syscall_64+0x69/0xc0 Aug 22 20:46:10 juju-e4d256-prod-github-runner-207 kernel: [55344.620672] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 20:46:10 juju-e4d256-prod-github-runner-207 kernel: [55344.621380] RIP: 0033:0x7faa5d0edaff Aug 22 20:46:10 juju-e4d256-prod-github-runner-207 kernel: [55344.622007] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 20:46:10 juju-e4d256-prod-github-runner-207 kernel: [55344.624010] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 20:46:10 juju-e4d256-prod-github-runner-207 kernel: [55344.624923] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 20:46:10 juju-e4d256-prod-github-runner-207 kernel: [55344.625823] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 20:46:10 juju-e4d256-prod-github-runner-207 kernel: [55344.626725] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 20:46:10 juju-e4d256-prod-github-runner-207 kernel: [55344.627633] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 20:46:10 juju-e4d256-prod-github-runner-207 kernel: [55344.628532] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 20:46:10 juju-e4d256-prod-github-runner-207 kernel: [55344.629436] Aug 22 20:46:38 juju-e4d256-prod-github-runner-207 kernel: [55372.541981] watchdog: BUG: soft lockup - CPU#1 stuck for 51461s! [qemu-system-x86:6715] Aug 22 20:46:38 juju-e4d256-prod-github-runner-207 kernel: [55372.543990] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 20:46:38 juju-e4d256-prod-github-runner-207 kernel: [55372.544308] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 20:46:38 juju-e4d256-prod-github-runner-207 kernel: [55372.556774] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 20:46:38 juju-e4d256-prod-github-runner-207 kernel: [55372.558079] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 20:46:38 juju-e4d256-prod-github-runner-207 kernel: [55372.559381] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:46:38 juju-e4d256-prod-github-runner-207 kernel: [55372.560518] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 20:46:38 juju-e4d256-prod-github-runner-207 kernel: [55372.563138] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 20:46:38 juju-e4d256-prod-github-runner-207 kernel: [55372.564190] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 20:46:38 juju-e4d256-prod-github-runner-207 kernel: [55372.565349] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 20:46:38 juju-e4d256-prod-github-runner-207 kernel: [55372.566524] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 20:46:38 juju-e4d256-prod-github-runner-207 kernel: [55372.567686] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 20:46:38 juju-e4d256-prod-github-runner-207 kernel: [55372.568843] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 20:46:38 juju-e4d256-prod-github-runner-207 kernel: [55372.570034] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 20:46:38 juju-e4d256-prod-github-runner-207 kernel: [55372.571329] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 20:46:38 juju-e4d256-prod-github-runner-207 kernel: [55372.572431] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 20:46:38 juju-e4d256-prod-github-runner-207 kernel: [55372.573622] Call Trace: Aug 22 20:46:38 juju-e4d256-prod-github-runner-207 kernel: [55372.574558] Aug 22 20:46:38 juju-e4d256-prod-github-runner-207 kernel: [55372.575459] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:46:38 juju-e4d256-prod-github-runner-207 kernel: [55372.576489] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:46:38 juju-e4d256-prod-github-runner-207 kernel: [55372.577515] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:46:38 juju-e4d256-prod-github-runner-207 kernel: [55372.578633] ? show_regs.part.0+0x23/0x29 Aug 22 20:46:38 juju-e4d256-prod-github-runner-207 kernel: [55372.579633] ? show_regs.cold+0x8/0xd Aug 22 20:46:38 juju-e4d256-prod-github-runner-207 kernel: [55372.580604] ? watchdog_timer_fn+0x1be/0x220 Aug 22 20:46:38 juju-e4d256-prod-github-runner-207 kernel: [55372.581613] ? lockup_detector_update_enable+0x60/0x60 Aug 22 20:46:38 juju-e4d256-prod-github-runner-207 kernel: [55372.582686] ? __hrtimer_run_queues+0x107/0x230 Aug 22 20:46:38 juju-e4d256-prod-github-runner-207 kernel: [55372.583712] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 20:46:38 juju-e4d256-prod-github-runner-207 kernel: [55372.584738] ? hrtimer_interrupt+0x101/0x220 Aug 22 20:46:38 juju-e4d256-prod-github-runner-207 kernel: [55372.585757] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 20:46:38 juju-e4d256-prod-github-runner-207 kernel: [55372.586878] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 20:46:38 juju-e4d256-prod-github-runner-207 kernel: [55372.587930] Aug 22 20:46:38 juju-e4d256-prod-github-runner-207 kernel: [55372.588787] Aug 22 20:46:38 juju-e4d256-prod-github-runner-207 kernel: [55372.589629] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 20:46:38 juju-e4d256-prod-github-runner-207 kernel: [55372.590678] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:46:38 juju-e4d256-prod-github-runner-207 kernel: [55372.591716] ? _raw_spin_lock+0x22/0x30 Aug 22 20:46:38 juju-e4d256-prod-github-runner-207 kernel: [55372.592666] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:46:38 juju-e4d256-prod-github-runner-207 kernel: [55372.593686] direct_page_fault+0x206/0x310 [kvm] Aug 22 20:46:38 juju-e4d256-prod-github-runner-207 kernel: [55372.594723] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 20:46:38 juju-e4d256-prod-github-runner-207 kernel: [55372.595730] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 20:46:38 juju-e4d256-prod-github-runner-207 kernel: [55372.596735] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 20:46:38 juju-e4d256-prod-github-runner-207 kernel: [55372.597748] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 20:46:38 juju-e4d256-prod-github-runner-207 kernel: [55372.598800] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 20:46:38 juju-e4d256-prod-github-runner-207 kernel: [55372.599778] handle_exit+0x98/0x230 [kvm_amd] Aug 22 20:46:38 juju-e4d256-prod-github-runner-207 kernel: [55372.600689] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 20:46:38 juju-e4d256-prod-github-runner-207 kernel: [55372.601614] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 20:46:38 juju-e4d256-prod-github-runner-207 kernel: [55372.602584] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 20:46:38 juju-e4d256-prod-github-runner-207 kernel: [55372.603493] vcpu_run+0x62/0x2c0 [kvm] Aug 22 20:46:38 juju-e4d256-prod-github-runner-207 kernel: [55372.604303] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 20:46:38 juju-e4d256-prod-github-runner-207 kernel: [55372.605115] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 20:46:38 juju-e4d256-prod-github-runner-207 kernel: [55372.605968] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 20:46:38 juju-e4d256-prod-github-runner-207 kernel: [55372.606772] ? __seccomp_filter+0x4a/0x4a0 Aug 22 20:46:38 juju-e4d256-prod-github-runner-207 kernel: [55372.607513] ? __fget_files+0x86/0xc0 Aug 22 20:46:38 juju-e4d256-prod-github-runner-207 kernel: [55372.608216] __x64_sys_ioctl+0x95/0xd0 Aug 22 20:46:38 juju-e4d256-prod-github-runner-207 kernel: [55372.608907] do_syscall_64+0x5c/0xc0 Aug 22 20:46:38 juju-e4d256-prod-github-runner-207 kernel: [55372.609569] ? do_futex+0x162/0x1f0 Aug 22 20:46:38 juju-e4d256-prod-github-runner-207 kernel: [55372.610215] ? __x64_sys_futex+0x78/0x1e0 Aug 22 20:46:38 juju-e4d256-prod-github-runner-207 kernel: [55372.610897] ? __secure_computing+0xa9/0x120 Aug 22 20:46:38 juju-e4d256-prod-github-runner-207 kernel: [55372.611590] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 20:46:38 juju-e4d256-prod-github-runner-207 kernel: [55372.612377] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:46:38 juju-e4d256-prod-github-runner-207 kernel: [55372.613097] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:46:38 juju-e4d256-prod-github-runner-207 kernel: [55372.613811] ? do_syscall_64+0x69/0xc0 Aug 22 20:46:38 juju-e4d256-prod-github-runner-207 kernel: [55372.614484] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:46:38 juju-e4d256-prod-github-runner-207 kernel: [55372.615188] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:46:38 juju-e4d256-prod-github-runner-207 kernel: [55372.615896] ? do_syscall_64+0x69/0xc0 Aug 22 20:46:38 juju-e4d256-prod-github-runner-207 kernel: [55372.616532] ? do_syscall_64+0x69/0xc0 Aug 22 20:46:38 juju-e4d256-prod-github-runner-207 kernel: [55372.617156] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 20:46:38 juju-e4d256-prod-github-runner-207 kernel: [55372.617858] RIP: 0033:0x7faa5d0edaff Aug 22 20:46:38 juju-e4d256-prod-github-runner-207 kernel: [55372.618545] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 20:46:38 juju-e4d256-prod-github-runner-207 kernel: [55372.620522] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 20:46:38 juju-e4d256-prod-github-runner-207 kernel: [55372.621430] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 20:46:38 juju-e4d256-prod-github-runner-207 kernel: [55372.622316] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 20:46:38 juju-e4d256-prod-github-runner-207 kernel: [55372.623212] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 20:46:38 juju-e4d256-prod-github-runner-207 kernel: [55372.624096] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 20:46:38 juju-e4d256-prod-github-runner-207 kernel: [55372.624996] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 20:46:38 juju-e4d256-prod-github-runner-207 kernel: [55372.625925] Aug 22 20:47:06 juju-e4d256-prod-github-runner-207 kernel: [55400.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 51487s! [qemu-system-x86:6715] Aug 22 20:47:06 juju-e4d256-prod-github-runner-207 kernel: [55400.543121] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 20:47:06 juju-e4d256-prod-github-runner-207 kernel: [55400.543199] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 20:47:06 juju-e4d256-prod-github-runner-207 kernel: [55400.555301] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 20:47:06 juju-e4d256-prod-github-runner-207 kernel: [55400.556567] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 20:47:06 juju-e4d256-prod-github-runner-207 kernel: [55400.557796] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:47:06 juju-e4d256-prod-github-runner-207 kernel: [55400.558865] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 20:47:06 juju-e4d256-prod-github-runner-207 kernel: [55400.561415] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 20:47:06 juju-e4d256-prod-github-runner-207 kernel: [55400.562472] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 20:47:06 juju-e4d256-prod-github-runner-207 kernel: [55400.563645] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 20:47:06 juju-e4d256-prod-github-runner-207 kernel: [55400.564808] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 20:47:06 juju-e4d256-prod-github-runner-207 kernel: [55400.565967] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 20:47:06 juju-e4d256-prod-github-runner-207 kernel: [55400.567141] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 20:47:06 juju-e4d256-prod-github-runner-207 kernel: [55400.568306] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 20:47:06 juju-e4d256-prod-github-runner-207 kernel: [55400.569540] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 20:47:06 juju-e4d256-prod-github-runner-207 kernel: [55400.570721] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 20:47:06 juju-e4d256-prod-github-runner-207 kernel: [55400.571938] Call Trace: Aug 22 20:47:06 juju-e4d256-prod-github-runner-207 kernel: [55400.572872] Aug 22 20:47:06 juju-e4d256-prod-github-runner-207 kernel: [55400.573774] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:47:06 juju-e4d256-prod-github-runner-207 kernel: [55400.574839] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:47:06 juju-e4d256-prod-github-runner-207 kernel: [55400.575881] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:47:06 juju-e4d256-prod-github-runner-207 kernel: [55400.576971] ? show_regs.part.0+0x23/0x29 Aug 22 20:47:06 juju-e4d256-prod-github-runner-207 kernel: [55400.578097] ? show_regs.cold+0x8/0xd Aug 22 20:47:06 juju-e4d256-prod-github-runner-207 kernel: [55400.579079] ? watchdog_timer_fn+0x1be/0x220 Aug 22 20:47:06 juju-e4d256-prod-github-runner-207 kernel: [55400.580086] ? lockup_detector_update_enable+0x60/0x60 Aug 22 20:47:06 juju-e4d256-prod-github-runner-207 kernel: [55400.581147] ? __hrtimer_run_queues+0x107/0x230 Aug 22 20:47:06 juju-e4d256-prod-github-runner-207 kernel: [55400.582214] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 20:47:06 juju-e4d256-prod-github-runner-207 kernel: [55400.583242] ? hrtimer_interrupt+0x101/0x220 Aug 22 20:47:06 juju-e4d256-prod-github-runner-207 kernel: [55400.584262] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 20:47:06 juju-e4d256-prod-github-runner-207 kernel: [55400.585334] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 20:47:06 juju-e4d256-prod-github-runner-207 kernel: [55400.586400] Aug 22 20:47:06 juju-e4d256-prod-github-runner-207 kernel: [55400.587253] Aug 22 20:47:06 juju-e4d256-prod-github-runner-207 kernel: [55400.588091] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 20:47:06 juju-e4d256-prod-github-runner-207 kernel: [55400.589129] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:47:06 juju-e4d256-prod-github-runner-207 kernel: [55400.590181] ? _raw_spin_lock+0x22/0x30 Aug 22 20:47:06 juju-e4d256-prod-github-runner-207 kernel: [55400.591125] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:47:06 juju-e4d256-prod-github-runner-207 kernel: [55400.592143] direct_page_fault+0x206/0x310 [kvm] Aug 22 20:47:06 juju-e4d256-prod-github-runner-207 kernel: [55400.593172] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 20:47:06 juju-e4d256-prod-github-runner-207 kernel: [55400.594191] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 20:47:06 juju-e4d256-prod-github-runner-207 kernel: [55400.595193] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 20:47:06 juju-e4d256-prod-github-runner-207 kernel: [55400.596167] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 20:47:06 juju-e4d256-prod-github-runner-207 kernel: [55400.597112] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 20:47:06 juju-e4d256-prod-github-runner-207 kernel: [55400.598090] handle_exit+0x98/0x230 [kvm_amd] Aug 22 20:47:06 juju-e4d256-prod-github-runner-207 kernel: [55400.599004] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 20:47:06 juju-e4d256-prod-github-runner-207 kernel: [55400.599943] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 20:47:06 juju-e4d256-prod-github-runner-207 kernel: [55400.600887] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 20:47:06 juju-e4d256-prod-github-runner-207 kernel: [55400.601870] vcpu_run+0x62/0x2c0 [kvm] Aug 22 20:47:06 juju-e4d256-prod-github-runner-207 kernel: [55400.602720] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 20:47:06 juju-e4d256-prod-github-runner-207 kernel: [55400.603571] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 20:47:06 juju-e4d256-prod-github-runner-207 kernel: [55400.604454] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 20:47:06 juju-e4d256-prod-github-runner-207 kernel: [55400.605251] ? __seccomp_filter+0x4a/0x4a0 Aug 22 20:47:06 juju-e4d256-prod-github-runner-207 kernel: [55400.606010] ? __fget_files+0x86/0xc0 Aug 22 20:47:06 juju-e4d256-prod-github-runner-207 kernel: [55400.606759] __x64_sys_ioctl+0x95/0xd0 Aug 22 20:47:06 juju-e4d256-prod-github-runner-207 kernel: [55400.607472] do_syscall_64+0x5c/0xc0 Aug 22 20:47:06 juju-e4d256-prod-github-runner-207 kernel: [55400.608136] ? do_futex+0x162/0x1f0 Aug 22 20:47:06 juju-e4d256-prod-github-runner-207 kernel: [55400.608784] ? __x64_sys_futex+0x78/0x1e0 Aug 22 20:47:06 juju-e4d256-prod-github-runner-207 kernel: [55400.609456] ? __secure_computing+0xa9/0x120 Aug 22 20:47:06 juju-e4d256-prod-github-runner-207 kernel: [55400.610158] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 20:47:06 juju-e4d256-prod-github-runner-207 kernel: [55400.610917] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:47:06 juju-e4d256-prod-github-runner-207 kernel: [55400.611682] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:47:06 juju-e4d256-prod-github-runner-207 kernel: [55400.612627] ? do_syscall_64+0x69/0xc0 Aug 22 20:47:06 juju-e4d256-prod-github-runner-207 kernel: [55400.613275] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:47:06 juju-e4d256-prod-github-runner-207 kernel: [55400.613979] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:47:06 juju-e4d256-prod-github-runner-207 kernel: [55400.614684] ? do_syscall_64+0x69/0xc0 Aug 22 20:47:06 juju-e4d256-prod-github-runner-207 kernel: [55400.615309] ? do_syscall_64+0x69/0xc0 Aug 22 20:47:06 juju-e4d256-prod-github-runner-207 kernel: [55400.615932] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 20:47:06 juju-e4d256-prod-github-runner-207 kernel: [55400.616637] RIP: 0033:0x7faa5d0edaff Aug 22 20:47:06 juju-e4d256-prod-github-runner-207 kernel: [55400.617263] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 20:47:06 juju-e4d256-prod-github-runner-207 kernel: [55400.619282] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 20:47:06 juju-e4d256-prod-github-runner-207 kernel: [55400.620196] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 20:47:06 juju-e4d256-prod-github-runner-207 kernel: [55400.621091] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 20:47:06 juju-e4d256-prod-github-runner-207 kernel: [55400.621978] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 20:47:06 juju-e4d256-prod-github-runner-207 kernel: [55400.622886] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 20:47:06 juju-e4d256-prod-github-runner-207 kernel: [55400.623778] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 20:47:06 juju-e4d256-prod-github-runner-207 kernel: [55400.624669] Aug 22 20:47:34 juju-e4d256-prod-github-runner-207 kernel: [55428.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 51513s! [qemu-system-x86:6715] Aug 22 20:47:34 juju-e4d256-prod-github-runner-207 kernel: [55428.543092] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 20:47:34 juju-e4d256-prod-github-runner-207 kernel: [55428.543167] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 20:47:34 juju-e4d256-prod-github-runner-207 kernel: [55428.555224] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 20:47:34 juju-e4d256-prod-github-runner-207 kernel: [55428.556484] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 20:47:34 juju-e4d256-prod-github-runner-207 kernel: [55428.557712] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:47:34 juju-e4d256-prod-github-runner-207 kernel: [55428.558800] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 20:47:34 juju-e4d256-prod-github-runner-207 kernel: [55428.561350] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 20:47:34 juju-e4d256-prod-github-runner-207 kernel: [55428.562397] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 20:47:34 juju-e4d256-prod-github-runner-207 kernel: [55428.563564] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 20:47:34 juju-e4d256-prod-github-runner-207 kernel: [55428.564726] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 20:47:34 juju-e4d256-prod-github-runner-207 kernel: [55428.565892] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 20:47:34 juju-e4d256-prod-github-runner-207 kernel: [55428.567204] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 20:47:34 juju-e4d256-prod-github-runner-207 kernel: [55428.568422] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 20:47:34 juju-e4d256-prod-github-runner-207 kernel: [55428.569664] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 20:47:34 juju-e4d256-prod-github-runner-207 kernel: [55428.570767] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 20:47:34 juju-e4d256-prod-github-runner-207 kernel: [55428.571957] Call Trace: Aug 22 20:47:34 juju-e4d256-prod-github-runner-207 kernel: [55428.572873] Aug 22 20:47:34 juju-e4d256-prod-github-runner-207 kernel: [55428.573761] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:47:34 juju-e4d256-prod-github-runner-207 kernel: [55428.574797] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:47:34 juju-e4d256-prod-github-runner-207 kernel: [55428.575815] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:47:34 juju-e4d256-prod-github-runner-207 kernel: [55428.576894] ? show_regs.part.0+0x23/0x29 Aug 22 20:47:34 juju-e4d256-prod-github-runner-207 kernel: [55428.577898] ? show_regs.cold+0x8/0xd Aug 22 20:47:34 juju-e4d256-prod-github-runner-207 kernel: [55428.578874] ? watchdog_timer_fn+0x1be/0x220 Aug 22 20:47:34 juju-e4d256-prod-github-runner-207 kernel: [55428.579883] ? lockup_detector_update_enable+0x60/0x60 Aug 22 20:47:34 juju-e4d256-prod-github-runner-207 kernel: [55428.580949] ? __hrtimer_run_queues+0x107/0x230 Aug 22 20:47:34 juju-e4d256-prod-github-runner-207 kernel: [55428.581985] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 20:47:34 juju-e4d256-prod-github-runner-207 kernel: [55428.583026] ? hrtimer_interrupt+0x101/0x220 Aug 22 20:47:34 juju-e4d256-prod-github-runner-207 kernel: [55428.584041] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 20:47:34 juju-e4d256-prod-github-runner-207 kernel: [55428.585112] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 20:47:34 juju-e4d256-prod-github-runner-207 kernel: [55428.586172] Aug 22 20:47:34 juju-e4d256-prod-github-runner-207 kernel: [55428.587024] Aug 22 20:47:34 juju-e4d256-prod-github-runner-207 kernel: [55428.587864] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 20:47:34 juju-e4d256-prod-github-runner-207 kernel: [55428.588894] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:47:34 juju-e4d256-prod-github-runner-207 kernel: [55428.589938] ? _raw_spin_lock+0x22/0x30 Aug 22 20:47:34 juju-e4d256-prod-github-runner-207 kernel: [55428.590887] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:47:34 juju-e4d256-prod-github-runner-207 kernel: [55428.591907] direct_page_fault+0x206/0x310 [kvm] Aug 22 20:47:34 juju-e4d256-prod-github-runner-207 kernel: [55428.592928] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 20:47:34 juju-e4d256-prod-github-runner-207 kernel: [55428.593947] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 20:47:34 juju-e4d256-prod-github-runner-207 kernel: [55428.594946] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 20:47:34 juju-e4d256-prod-github-runner-207 kernel: [55428.595925] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 20:47:34 juju-e4d256-prod-github-runner-207 kernel: [55428.596867] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 20:47:34 juju-e4d256-prod-github-runner-207 kernel: [55428.597852] handle_exit+0x98/0x230 [kvm_amd] Aug 22 20:47:34 juju-e4d256-prod-github-runner-207 kernel: [55428.598747] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 20:47:34 juju-e4d256-prod-github-runner-207 kernel: [55428.599659] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 20:47:34 juju-e4d256-prod-github-runner-207 kernel: [55428.600581] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 20:47:34 juju-e4d256-prod-github-runner-207 kernel: [55428.601527] vcpu_run+0x62/0x2c0 [kvm] Aug 22 20:47:34 juju-e4d256-prod-github-runner-207 kernel: [55428.602347] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 20:47:34 juju-e4d256-prod-github-runner-207 kernel: [55428.603152] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 20:47:34 juju-e4d256-prod-github-runner-207 kernel: [55428.604008] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 20:47:34 juju-e4d256-prod-github-runner-207 kernel: [55428.604807] ? __seccomp_filter+0x4a/0x4a0 Aug 22 20:47:34 juju-e4d256-prod-github-runner-207 kernel: [55428.605547] ? __fget_files+0x86/0xc0 Aug 22 20:47:34 juju-e4d256-prod-github-runner-207 kernel: [55428.606268] __x64_sys_ioctl+0x95/0xd0 Aug 22 20:47:34 juju-e4d256-prod-github-runner-207 kernel: [55428.606959] do_syscall_64+0x5c/0xc0 Aug 22 20:47:34 juju-e4d256-prod-github-runner-207 kernel: [55428.607624] ? do_futex+0x162/0x1f0 Aug 22 20:47:34 juju-e4d256-prod-github-runner-207 kernel: [55428.608275] ? __x64_sys_futex+0x78/0x1e0 Aug 22 20:47:34 juju-e4d256-prod-github-runner-207 kernel: [55428.608959] ? __secure_computing+0xa9/0x120 Aug 22 20:47:34 juju-e4d256-prod-github-runner-207 kernel: [55428.609649] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 20:47:34 juju-e4d256-prod-github-runner-207 kernel: [55428.610413] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:47:34 juju-e4d256-prod-github-runner-207 kernel: [55428.611132] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:47:34 juju-e4d256-prod-github-runner-207 kernel: [55428.611852] ? do_syscall_64+0x69/0xc0 Aug 22 20:47:34 juju-e4d256-prod-github-runner-207 kernel: [55428.612493] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:47:34 juju-e4d256-prod-github-runner-207 kernel: [55428.613194] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:47:34 juju-e4d256-prod-github-runner-207 kernel: [55428.613898] ? do_syscall_64+0x69/0xc0 Aug 22 20:47:34 juju-e4d256-prod-github-runner-207 kernel: [55428.614520] ? do_syscall_64+0x69/0xc0 Aug 22 20:47:34 juju-e4d256-prod-github-runner-207 kernel: [55428.615146] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 20:47:34 juju-e4d256-prod-github-runner-207 kernel: [55428.615849] RIP: 0033:0x7faa5d0edaff Aug 22 20:47:34 juju-e4d256-prod-github-runner-207 kernel: [55428.616473] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 20:47:34 juju-e4d256-prod-github-runner-207 kernel: [55428.618477] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 20:47:34 juju-e4d256-prod-github-runner-207 kernel: [55428.619385] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 20:47:34 juju-e4d256-prod-github-runner-207 kernel: [55428.620272] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 20:47:34 juju-e4d256-prod-github-runner-207 kernel: [55428.621161] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 20:47:34 juju-e4d256-prod-github-runner-207 kernel: [55428.622056] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 20:47:34 juju-e4d256-prod-github-runner-207 kernel: [55428.622962] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 20:47:34 juju-e4d256-prod-github-runner-207 kernel: [55428.623854] Aug 22 20:47:46 juju-e4d256-prod-github-runner-207 kernel: [55440.884705] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 20:47:46 juju-e4d256-prod-github-runner-207 kernel: [55440.885706] rcu: 1-....: (13787388 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=6664497 Aug 22 20:47:46 juju-e4d256-prod-github-runner-207 kernel: [55440.886828] (t=13830921 jiffies g=23269 q=51043) Aug 22 20:47:46 juju-e4d256-prod-github-runner-207 kernel: [55440.887614] NMI backtrace for cpu 1 Aug 22 20:47:46 juju-e4d256-prod-github-runner-207 kernel: [55440.888327] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 20:47:46 juju-e4d256-prod-github-runner-207 kernel: [55440.889428] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 20:47:46 juju-e4d256-prod-github-runner-207 kernel: [55440.890499] Call Trace: Aug 22 20:47:46 juju-e4d256-prod-github-runner-207 kernel: [55440.891187] Aug 22 20:47:46 juju-e4d256-prod-github-runner-207 kernel: [55440.891832] show_stack+0x52/0x5c Aug 22 20:47:46 juju-e4d256-prod-github-runner-207 kernel: [55440.892557] dump_stack_lvl+0x4a/0x63 Aug 22 20:47:46 juju-e4d256-prod-github-runner-207 kernel: [55440.893302] dump_stack+0x10/0x16 Aug 22 20:47:46 juju-e4d256-prod-github-runner-207 kernel: [55440.894038] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 20:47:46 juju-e4d256-prod-github-runner-207 kernel: [55440.894954] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 20:47:46 juju-e4d256-prod-github-runner-207 kernel: [55440.895733] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 20:47:46 juju-e4d256-prod-github-runner-207 kernel: [55440.896562] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 20:47:46 juju-e4d256-prod-github-runner-207 kernel: [55440.897387] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 20:47:46 juju-e4d256-prod-github-runner-207 kernel: [55440.898209] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 20:47:46 juju-e4d256-prod-github-runner-207 kernel: [55440.898980] print_cpu_stall.cold+0x2f/0xe2 Aug 22 20:47:46 juju-e4d256-prod-github-runner-207 kernel: [55440.899772] ? timekeeping_update+0xf7/0x150 Aug 22 20:47:46 juju-e4d256-prod-github-runner-207 kernel: [55440.900542] check_cpu_stall+0x109/0x270 Aug 22 20:47:46 juju-e4d256-prod-github-runner-207 kernel: [55440.901289] rcu_sched_clock_irq+0x9a/0x250 Aug 22 20:47:46 juju-e4d256-prod-github-runner-207 kernel: [55440.902057] update_process_times+0x94/0xd0 Aug 22 20:47:46 juju-e4d256-prod-github-runner-207 kernel: [55440.902817] tick_sched_handle+0x29/0x70 Aug 22 20:47:46 juju-e4d256-prod-github-runner-207 kernel: [55440.903569] tick_sched_timer+0x8c/0xc0 Aug 22 20:47:46 juju-e4d256-prod-github-runner-207 kernel: [55440.904306] ? tick_nohz_handler+0xb0/0xb0 Aug 22 20:47:46 juju-e4d256-prod-github-runner-207 kernel: [55440.905061] __hrtimer_run_queues+0x107/0x230 Aug 22 20:47:46 juju-e4d256-prod-github-runner-207 kernel: [55440.905838] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 20:47:46 juju-e4d256-prod-github-runner-207 kernel: [55440.906616] hrtimer_interrupt+0x101/0x220 Aug 22 20:47:46 juju-e4d256-prod-github-runner-207 kernel: [55440.907373] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 20:47:46 juju-e4d256-prod-github-runner-207 kernel: [55440.908189] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 20:47:46 juju-e4d256-prod-github-runner-207 kernel: [55440.908989] Aug 22 20:47:46 juju-e4d256-prod-github-runner-207 kernel: [55440.909624] Aug 22 20:47:46 juju-e4d256-prod-github-runner-207 kernel: [55440.910283] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 20:47:46 juju-e4d256-prod-github-runner-207 kernel: [55440.911103] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:47:46 juju-e4d256-prod-github-runner-207 kernel: [55440.912014] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 20:47:46 juju-e4d256-prod-github-runner-207 kernel: [55440.914310] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 20:47:46 juju-e4d256-prod-github-runner-207 kernel: [55440.915184] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 20:47:46 juju-e4d256-prod-github-runner-207 kernel: [55440.916183] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 20:47:46 juju-e4d256-prod-github-runner-207 kernel: [55440.917159] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 20:47:46 juju-e4d256-prod-github-runner-207 kernel: [55440.918132] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 20:47:46 juju-e4d256-prod-github-runner-207 kernel: [55440.919084] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 20:47:46 juju-e4d256-prod-github-runner-207 kernel: [55440.920037] ? _raw_spin_lock+0x22/0x30 Aug 22 20:47:46 juju-e4d256-prod-github-runner-207 kernel: [55440.920798] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:47:46 juju-e4d256-prod-github-runner-207 kernel: [55440.921638] direct_page_fault+0x206/0x310 [kvm] Aug 22 20:47:46 juju-e4d256-prod-github-runner-207 kernel: [55440.922489] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 20:47:46 juju-e4d256-prod-github-runner-207 kernel: [55440.923313] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 20:47:46 juju-e4d256-prod-github-runner-207 kernel: [55440.924138] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 20:47:46 juju-e4d256-prod-github-runner-207 kernel: [55440.924947] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 20:47:46 juju-e4d256-prod-github-runner-207 kernel: [55440.925746] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 20:47:46 juju-e4d256-prod-github-runner-207 kernel: [55440.926566] handle_exit+0x98/0x230 [kvm_amd] Aug 22 20:47:46 juju-e4d256-prod-github-runner-207 kernel: [55440.927318] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 20:47:46 juju-e4d256-prod-github-runner-207 kernel: [55440.928103] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 20:47:46 juju-e4d256-prod-github-runner-207 kernel: [55440.928905] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 20:47:46 juju-e4d256-prod-github-runner-207 kernel: [55440.929703] vcpu_run+0x62/0x2c0 [kvm] Aug 22 20:47:46 juju-e4d256-prod-github-runner-207 kernel: [55440.930417] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 20:47:46 juju-e4d256-prod-github-runner-207 kernel: [55440.931146] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 20:47:46 juju-e4d256-prod-github-runner-207 kernel: [55440.931950] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 20:47:46 juju-e4d256-prod-github-runner-207 kernel: [55440.932708] ? __seccomp_filter+0x4a/0x4a0 Aug 22 20:47:46 juju-e4d256-prod-github-runner-207 kernel: [55440.933426] ? __fget_files+0x86/0xc0 Aug 22 20:47:46 juju-e4d256-prod-github-runner-207 kernel: [55440.934130] __x64_sys_ioctl+0x95/0xd0 Aug 22 20:47:46 juju-e4d256-prod-github-runner-207 kernel: [55440.934828] do_syscall_64+0x5c/0xc0 Aug 22 20:47:46 juju-e4d256-prod-github-runner-207 kernel: [55440.935507] ? do_futex+0x162/0x1f0 Aug 22 20:47:46 juju-e4d256-prod-github-runner-207 kernel: [55440.936176] ? __x64_sys_futex+0x78/0x1e0 Aug 22 20:47:46 juju-e4d256-prod-github-runner-207 kernel: [55440.937029] ? __secure_computing+0xa9/0x120 Aug 22 20:47:46 juju-e4d256-prod-github-runner-207 kernel: [55440.937758] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 20:47:46 juju-e4d256-prod-github-runner-207 kernel: [55440.938582] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:47:46 juju-e4d256-prod-github-runner-207 kernel: [55440.939348] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:47:46 juju-e4d256-prod-github-runner-207 kernel: [55440.940111] ? do_syscall_64+0x69/0xc0 Aug 22 20:47:46 juju-e4d256-prod-github-runner-207 kernel: [55440.940800] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:47:46 juju-e4d256-prod-github-runner-207 kernel: [55440.941554] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:47:46 juju-e4d256-prod-github-runner-207 kernel: [55440.942339] ? do_syscall_64+0x69/0xc0 Aug 22 20:47:46 juju-e4d256-prod-github-runner-207 kernel: [55440.943032] ? do_syscall_64+0x69/0xc0 Aug 22 20:47:46 juju-e4d256-prod-github-runner-207 kernel: [55440.943716] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 20:47:46 juju-e4d256-prod-github-runner-207 kernel: [55440.944483] RIP: 0033:0x7faa5d0edaff Aug 22 20:47:46 juju-e4d256-prod-github-runner-207 kernel: [55440.945182] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 20:47:46 juju-e4d256-prod-github-runner-207 kernel: [55440.947305] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 20:47:46 juju-e4d256-prod-github-runner-207 kernel: [55440.948265] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 20:47:46 juju-e4d256-prod-github-runner-207 kernel: [55440.949209] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 20:47:46 juju-e4d256-prod-github-runner-207 kernel: [55440.950168] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 20:47:46 juju-e4d256-prod-github-runner-207 kernel: [55440.951138] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 20:47:46 juju-e4d256-prod-github-runner-207 kernel: [55440.952077] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 20:47:46 juju-e4d256-prod-github-runner-207 kernel: [55440.952989] Aug 22 20:48:14 juju-e4d256-prod-github-runner-207 kernel: [55468.541980] watchdog: BUG: soft lockup - CPU#1 stuck for 51551s! [qemu-system-x86:6715] Aug 22 20:48:14 juju-e4d256-prod-github-runner-207 kernel: [55468.543849] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 20:48:14 juju-e4d256-prod-github-runner-207 kernel: [55468.544164] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 20:48:14 juju-e4d256-prod-github-runner-207 kernel: [55468.556393] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 20:48:14 juju-e4d256-prod-github-runner-207 kernel: [55468.557709] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 20:48:14 juju-e4d256-prod-github-runner-207 kernel: [55468.558937] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:48:14 juju-e4d256-prod-github-runner-207 kernel: [55468.559991] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 20:48:14 juju-e4d256-prod-github-runner-207 kernel: [55468.562589] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 20:48:14 juju-e4d256-prod-github-runner-207 kernel: [55468.563660] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 20:48:14 juju-e4d256-prod-github-runner-207 kernel: [55468.564818] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 20:48:14 juju-e4d256-prod-github-runner-207 kernel: [55468.565987] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 20:48:14 juju-e4d256-prod-github-runner-207 kernel: [55468.567160] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 20:48:14 juju-e4d256-prod-github-runner-207 kernel: [55468.568340] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 20:48:14 juju-e4d256-prod-github-runner-207 kernel: [55468.569537] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 20:48:14 juju-e4d256-prod-github-runner-207 kernel: [55468.570770] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 20:48:14 juju-e4d256-prod-github-runner-207 kernel: [55468.571867] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 20:48:14 juju-e4d256-prod-github-runner-207 kernel: [55468.573065] Call Trace: Aug 22 20:48:14 juju-e4d256-prod-github-runner-207 kernel: [55468.573994] Aug 22 20:48:14 juju-e4d256-prod-github-runner-207 kernel: [55468.574889] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:48:14 juju-e4d256-prod-github-runner-207 kernel: [55468.575916] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:48:14 juju-e4d256-prod-github-runner-207 kernel: [55468.576936] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:48:14 juju-e4d256-prod-github-runner-207 kernel: [55468.578043] ? show_regs.part.0+0x23/0x29 Aug 22 20:48:14 juju-e4d256-prod-github-runner-207 kernel: [55468.579052] ? show_regs.cold+0x8/0xd Aug 22 20:48:14 juju-e4d256-prod-github-runner-207 kernel: [55468.580062] ? watchdog_timer_fn+0x1be/0x220 Aug 22 20:48:14 juju-e4d256-prod-github-runner-207 kernel: [55468.581081] ? lockup_detector_update_enable+0x60/0x60 Aug 22 20:48:14 juju-e4d256-prod-github-runner-207 kernel: [55468.582158] ? __hrtimer_run_queues+0x107/0x230 Aug 22 20:48:14 juju-e4d256-prod-github-runner-207 kernel: [55468.583188] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 20:48:14 juju-e4d256-prod-github-runner-207 kernel: [55468.584228] ? hrtimer_interrupt+0x101/0x220 Aug 22 20:48:14 juju-e4d256-prod-github-runner-207 kernel: [55468.585246] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 20:48:14 juju-e4d256-prod-github-runner-207 kernel: [55468.586371] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 20:48:14 juju-e4d256-prod-github-runner-207 kernel: [55468.587416] Aug 22 20:48:14 juju-e4d256-prod-github-runner-207 kernel: [55468.588273] Aug 22 20:48:14 juju-e4d256-prod-github-runner-207 kernel: [55468.589133] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 20:48:14 juju-e4d256-prod-github-runner-207 kernel: [55468.590188] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:48:14 juju-e4d256-prod-github-runner-207 kernel: [55468.591260] ? _raw_spin_lock+0x22/0x30 Aug 22 20:48:14 juju-e4d256-prod-github-runner-207 kernel: [55468.592212] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:48:14 juju-e4d256-prod-github-runner-207 kernel: [55468.593228] direct_page_fault+0x206/0x310 [kvm] Aug 22 20:48:14 juju-e4d256-prod-github-runner-207 kernel: [55468.594278] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 20:48:14 juju-e4d256-prod-github-runner-207 kernel: [55468.595300] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 20:48:14 juju-e4d256-prod-github-runner-207 kernel: [55468.596298] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 20:48:14 juju-e4d256-prod-github-runner-207 kernel: [55468.597302] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 20:48:14 juju-e4d256-prod-github-runner-207 kernel: [55468.598262] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 20:48:14 juju-e4d256-prod-github-runner-207 kernel: [55468.599252] handle_exit+0x98/0x230 [kvm_amd] Aug 22 20:48:14 juju-e4d256-prod-github-runner-207 kernel: [55468.600150] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 20:48:14 juju-e4d256-prod-github-runner-207 kernel: [55468.601068] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 20:48:14 juju-e4d256-prod-github-runner-207 kernel: [55468.602009] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 20:48:14 juju-e4d256-prod-github-runner-207 kernel: [55468.602910] vcpu_run+0x62/0x2c0 [kvm] Aug 22 20:48:14 juju-e4d256-prod-github-runner-207 kernel: [55468.603718] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 20:48:14 juju-e4d256-prod-github-runner-207 kernel: [55468.604531] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 20:48:14 juju-e4d256-prod-github-runner-207 kernel: [55468.605402] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 20:48:14 juju-e4d256-prod-github-runner-207 kernel: [55468.606208] ? __seccomp_filter+0x4a/0x4a0 Aug 22 20:48:14 juju-e4d256-prod-github-runner-207 kernel: [55468.606950] ? __fget_files+0x86/0xc0 Aug 22 20:48:14 juju-e4d256-prod-github-runner-207 kernel: [55468.607685] __x64_sys_ioctl+0x95/0xd0 Aug 22 20:48:14 juju-e4d256-prod-github-runner-207 kernel: [55468.608382] do_syscall_64+0x5c/0xc0 Aug 22 20:48:14 juju-e4d256-prod-github-runner-207 kernel: [55468.609054] ? do_futex+0x162/0x1f0 Aug 22 20:48:14 juju-e4d256-prod-github-runner-207 kernel: [55468.609724] ? __x64_sys_futex+0x78/0x1e0 Aug 22 20:48:14 juju-e4d256-prod-github-runner-207 kernel: [55468.610425] ? __secure_computing+0xa9/0x120 Aug 22 20:48:14 juju-e4d256-prod-github-runner-207 kernel: [55468.611117] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 20:48:14 juju-e4d256-prod-github-runner-207 kernel: [55468.611872] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:48:14 juju-e4d256-prod-github-runner-207 kernel: [55468.612594] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:48:14 juju-e4d256-prod-github-runner-207 kernel: [55468.613307] ? do_syscall_64+0x69/0xc0 Aug 22 20:48:14 juju-e4d256-prod-github-runner-207 kernel: [55468.613954] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:48:14 juju-e4d256-prod-github-runner-207 kernel: [55468.614670] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:48:14 juju-e4d256-prod-github-runner-207 kernel: [55468.615371] ? do_syscall_64+0x69/0xc0 Aug 22 20:48:14 juju-e4d256-prod-github-runner-207 kernel: [55468.615993] ? do_syscall_64+0x69/0xc0 Aug 22 20:48:14 juju-e4d256-prod-github-runner-207 kernel: [55468.616611] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 20:48:14 juju-e4d256-prod-github-runner-207 kernel: [55468.617316] RIP: 0033:0x7faa5d0edaff Aug 22 20:48:14 juju-e4d256-prod-github-runner-207 kernel: [55468.617989] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 20:48:14 juju-e4d256-prod-github-runner-207 kernel: [55468.619978] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 20:48:14 juju-e4d256-prod-github-runner-207 kernel: [55468.620888] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 20:48:14 juju-e4d256-prod-github-runner-207 kernel: [55468.621825] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 20:48:14 juju-e4d256-prod-github-runner-207 kernel: [55468.622718] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 20:48:14 juju-e4d256-prod-github-runner-207 kernel: [55468.623607] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 20:48:14 juju-e4d256-prod-github-runner-207 kernel: [55468.624496] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 20:48:14 juju-e4d256-prod-github-runner-207 kernel: [55468.625415] Aug 22 20:48:42 juju-e4d256-prod-github-runner-207 kernel: [55496.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 51577s! [qemu-system-x86:6715] Aug 22 20:48:42 juju-e4d256-prod-github-runner-207 kernel: [55496.543125] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 20:48:42 juju-e4d256-prod-github-runner-207 kernel: [55496.543197] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 20:48:42 juju-e4d256-prod-github-runner-207 kernel: [55496.555925] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 20:48:42 juju-e4d256-prod-github-runner-207 kernel: [55496.557229] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 20:48:42 juju-e4d256-prod-github-runner-207 kernel: [55496.558479] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:48:42 juju-e4d256-prod-github-runner-207 kernel: [55496.559555] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 20:48:42 juju-e4d256-prod-github-runner-207 kernel: [55496.562131] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 20:48:42 juju-e4d256-prod-github-runner-207 kernel: [55496.563176] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 20:48:42 juju-e4d256-prod-github-runner-207 kernel: [55496.564410] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 20:48:42 juju-e4d256-prod-github-runner-207 kernel: [55496.565966] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 20:48:42 juju-e4d256-prod-github-runner-207 kernel: [55496.567135] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 20:48:42 juju-e4d256-prod-github-runner-207 kernel: [55496.568459] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 20:48:42 juju-e4d256-prod-github-runner-207 kernel: [55496.569737] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 20:48:42 juju-e4d256-prod-github-runner-207 kernel: [55496.571030] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 20:48:42 juju-e4d256-prod-github-runner-207 kernel: [55496.572137] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 20:48:42 juju-e4d256-prod-github-runner-207 kernel: [55496.573460] Call Trace: Aug 22 20:48:42 juju-e4d256-prod-github-runner-207 kernel: [55496.574426] Aug 22 20:48:42 juju-e4d256-prod-github-runner-207 kernel: [55496.575323] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:48:42 juju-e4d256-prod-github-runner-207 kernel: [55496.576511] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:48:42 juju-e4d256-prod-github-runner-207 kernel: [55496.577898] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:48:42 juju-e4d256-prod-github-runner-207 kernel: [55496.579338] ? show_regs.part.0+0x23/0x29 Aug 22 20:48:42 juju-e4d256-prod-github-runner-207 kernel: [55496.580608] ? show_regs.cold+0x8/0xd Aug 22 20:48:42 juju-e4d256-prod-github-runner-207 kernel: [55496.581704] ? watchdog_timer_fn+0x1be/0x220 Aug 22 20:48:42 juju-e4d256-prod-github-runner-207 kernel: [55496.582822] ? lockup_detector_update_enable+0x60/0x60 Aug 22 20:48:42 juju-e4d256-prod-github-runner-207 kernel: [55496.583911] ? __hrtimer_run_queues+0x107/0x230 Aug 22 20:48:42 juju-e4d256-prod-github-runner-207 kernel: [55496.584956] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 20:48:42 juju-e4d256-prod-github-runner-207 kernel: [55496.586034] ? hrtimer_interrupt+0x101/0x220 Aug 22 20:48:42 juju-e4d256-prod-github-runner-207 kernel: [55496.587068] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 20:48:42 juju-e4d256-prod-github-runner-207 kernel: [55496.588139] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 20:48:42 juju-e4d256-prod-github-runner-207 kernel: [55496.589229] Aug 22 20:48:42 juju-e4d256-prod-github-runner-207 kernel: [55496.590161] Aug 22 20:48:42 juju-e4d256-prod-github-runner-207 kernel: [55496.591022] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 20:48:42 juju-e4d256-prod-github-runner-207 kernel: [55496.592069] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:48:42 juju-e4d256-prod-github-runner-207 kernel: [55496.593136] ? _raw_spin_lock+0x22/0x30 Aug 22 20:48:42 juju-e4d256-prod-github-runner-207 kernel: [55496.594116] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:48:42 juju-e4d256-prod-github-runner-207 kernel: [55496.595162] direct_page_fault+0x206/0x310 [kvm] Aug 22 20:48:42 juju-e4d256-prod-github-runner-207 kernel: [55496.596251] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 20:48:42 juju-e4d256-prod-github-runner-207 kernel: [55496.597306] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 20:48:42 juju-e4d256-prod-github-runner-207 kernel: [55496.598336] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 20:48:42 juju-e4d256-prod-github-runner-207 kernel: [55496.599320] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 20:48:42 juju-e4d256-prod-github-runner-207 kernel: [55496.600267] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 20:48:42 juju-e4d256-prod-github-runner-207 kernel: [55496.601266] handle_exit+0x98/0x230 [kvm_amd] Aug 22 20:48:42 juju-e4d256-prod-github-runner-207 kernel: [55496.602169] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 20:48:42 juju-e4d256-prod-github-runner-207 kernel: [55496.603104] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 20:48:42 juju-e4d256-prod-github-runner-207 kernel: [55496.604045] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 20:48:42 juju-e4d256-prod-github-runner-207 kernel: [55496.604961] vcpu_run+0x62/0x2c0 [kvm] Aug 22 20:48:42 juju-e4d256-prod-github-runner-207 kernel: [55496.605874] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 20:48:42 juju-e4d256-prod-github-runner-207 kernel: [55496.606701] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 20:48:42 juju-e4d256-prod-github-runner-207 kernel: [55496.607567] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 20:48:42 juju-e4d256-prod-github-runner-207 kernel: [55496.608377] ? __seccomp_filter+0x4a/0x4a0 Aug 22 20:48:42 juju-e4d256-prod-github-runner-207 kernel: [55496.609142] ? __fget_files+0x86/0xc0 Aug 22 20:48:42 juju-e4d256-prod-github-runner-207 kernel: [55496.609852] __x64_sys_ioctl+0x95/0xd0 Aug 22 20:48:42 juju-e4d256-prod-github-runner-207 kernel: [55496.610568] do_syscall_64+0x5c/0xc0 Aug 22 20:48:42 juju-e4d256-prod-github-runner-207 kernel: [55496.611251] ? do_futex+0x162/0x1f0 Aug 22 20:48:42 juju-e4d256-prod-github-runner-207 kernel: [55496.611908] ? __x64_sys_futex+0x78/0x1e0 Aug 22 20:48:42 juju-e4d256-prod-github-runner-207 kernel: [55496.612586] ? __secure_computing+0xa9/0x120 Aug 22 20:48:42 juju-e4d256-prod-github-runner-207 kernel: [55496.613302] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 20:48:42 juju-e4d256-prod-github-runner-207 kernel: [55496.614073] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:48:42 juju-e4d256-prod-github-runner-207 kernel: [55496.614798] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:48:42 juju-e4d256-prod-github-runner-207 kernel: [55496.615540] ? do_syscall_64+0x69/0xc0 Aug 22 20:48:42 juju-e4d256-prod-github-runner-207 kernel: [55496.616200] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:48:42 juju-e4d256-prod-github-runner-207 kernel: [55496.616916] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:48:42 juju-e4d256-prod-github-runner-207 kernel: [55496.617628] ? do_syscall_64+0x69/0xc0 Aug 22 20:48:42 juju-e4d256-prod-github-runner-207 kernel: [55496.618255] ? do_syscall_64+0x69/0xc0 Aug 22 20:48:42 juju-e4d256-prod-github-runner-207 kernel: [55496.618879] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 20:48:42 juju-e4d256-prod-github-runner-207 kernel: [55496.619594] RIP: 0033:0x7faa5d0edaff Aug 22 20:48:42 juju-e4d256-prod-github-runner-207 kernel: [55496.620222] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 20:48:42 juju-e4d256-prod-github-runner-207 kernel: [55496.622725] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 20:48:42 juju-e4d256-prod-github-runner-207 kernel: [55496.623837] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 20:48:42 juju-e4d256-prod-github-runner-207 kernel: [55496.624731] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 20:48:42 juju-e4d256-prod-github-runner-207 kernel: [55496.625640] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 20:48:42 juju-e4d256-prod-github-runner-207 kernel: [55496.626763] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 20:48:42 juju-e4d256-prod-github-runner-207 kernel: [55496.627677] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 20:48:42 juju-e4d256-prod-github-runner-207 kernel: [55496.628771] Aug 22 20:49:10 juju-e4d256-prod-github-runner-207 kernel: [55524.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 51603s! [qemu-system-x86:6715] Aug 22 20:49:10 juju-e4d256-prod-github-runner-207 kernel: [55524.543100] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 20:49:10 juju-e4d256-prod-github-runner-207 kernel: [55524.543174] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 20:49:10 juju-e4d256-prod-github-runner-207 kernel: [55524.555680] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 20:49:10 juju-e4d256-prod-github-runner-207 kernel: [55524.557423] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 20:49:10 juju-e4d256-prod-github-runner-207 kernel: [55524.559141] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:49:10 juju-e4d256-prod-github-runner-207 kernel: [55524.560292] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 20:49:10 juju-e4d256-prod-github-runner-207 kernel: [55524.563078] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 20:49:10 juju-e4d256-prod-github-runner-207 kernel: [55524.564408] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 20:49:10 juju-e4d256-prod-github-runner-207 kernel: [55524.565603] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 20:49:10 juju-e4d256-prod-github-runner-207 kernel: [55524.566761] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 20:49:10 juju-e4d256-prod-github-runner-207 kernel: [55524.567919] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 20:49:10 juju-e4d256-prod-github-runner-207 kernel: [55524.569097] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 20:49:10 juju-e4d256-prod-github-runner-207 kernel: [55524.570269] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 20:49:10 juju-e4d256-prod-github-runner-207 kernel: [55524.571505] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 20:49:10 juju-e4d256-prod-github-runner-207 kernel: [55524.572608] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 20:49:10 juju-e4d256-prod-github-runner-207 kernel: [55524.573844] Call Trace: Aug 22 20:49:10 juju-e4d256-prod-github-runner-207 kernel: [55524.574792] Aug 22 20:49:10 juju-e4d256-prod-github-runner-207 kernel: [55524.575742] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:49:10 juju-e4d256-prod-github-runner-207 kernel: [55524.576889] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:49:10 juju-e4d256-prod-github-runner-207 kernel: [55524.578010] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:49:10 juju-e4d256-prod-github-runner-207 kernel: [55524.579178] ? show_regs.part.0+0x23/0x29 Aug 22 20:49:10 juju-e4d256-prod-github-runner-207 kernel: [55524.580295] ? show_regs.cold+0x8/0xd Aug 22 20:49:10 juju-e4d256-prod-github-runner-207 kernel: [55524.581368] ? watchdog_timer_fn+0x1be/0x220 Aug 22 20:49:10 juju-e4d256-prod-github-runner-207 kernel: [55524.582472] ? lockup_detector_update_enable+0x60/0x60 Aug 22 20:49:10 juju-e4d256-prod-github-runner-207 kernel: [55524.583641] ? __hrtimer_run_queues+0x107/0x230 Aug 22 20:49:10 juju-e4d256-prod-github-runner-207 kernel: [55524.584775] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 20:49:10 juju-e4d256-prod-github-runner-207 kernel: [55524.585900] ? hrtimer_interrupt+0x101/0x220 Aug 22 20:49:10 juju-e4d256-prod-github-runner-207 kernel: [55524.587012] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 20:49:10 juju-e4d256-prod-github-runner-207 kernel: [55524.588192] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 20:49:10 juju-e4d256-prod-github-runner-207 kernel: [55524.589361] Aug 22 20:49:10 juju-e4d256-prod-github-runner-207 kernel: [55524.590265] Aug 22 20:49:10 juju-e4d256-prod-github-runner-207 kernel: [55524.591331] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 20:49:10 juju-e4d256-prod-github-runner-207 kernel: [55524.592483] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:49:10 juju-e4d256-prod-github-runner-207 kernel: [55524.593658] ? _raw_spin_lock+0x22/0x30 Aug 22 20:49:10 juju-e4d256-prod-github-runner-207 kernel: [55524.594768] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:49:10 juju-e4d256-prod-github-runner-207 kernel: [55524.595888] direct_page_fault+0x206/0x310 [kvm] Aug 22 20:49:10 juju-e4d256-prod-github-runner-207 kernel: [55524.597038] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 20:49:10 juju-e4d256-prod-github-runner-207 kernel: [55524.598138] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 20:49:10 juju-e4d256-prod-github-runner-207 kernel: [55524.599228] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 20:49:10 juju-e4d256-prod-github-runner-207 kernel: [55524.600293] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 20:49:10 juju-e4d256-prod-github-runner-207 kernel: [55524.601444] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 20:49:10 juju-e4d256-prod-github-runner-207 kernel: [55524.602533] handle_exit+0x98/0x230 [kvm_amd] Aug 22 20:49:10 juju-e4d256-prod-github-runner-207 kernel: [55524.603511] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 20:49:10 juju-e4d256-prod-github-runner-207 kernel: [55524.604526] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 20:49:10 juju-e4d256-prod-github-runner-207 kernel: [55524.605570] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 20:49:10 juju-e4d256-prod-github-runner-207 kernel: [55524.606566] vcpu_run+0x62/0x2c0 [kvm] Aug 22 20:49:10 juju-e4d256-prod-github-runner-207 kernel: [55524.607448] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 20:49:10 juju-e4d256-prod-github-runner-207 kernel: [55524.608339] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 20:49:10 juju-e4d256-prod-github-runner-207 kernel: [55524.609300] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 20:49:10 juju-e4d256-prod-github-runner-207 kernel: [55524.610190] ? __seccomp_filter+0x4a/0x4a0 Aug 22 20:49:10 juju-e4d256-prod-github-runner-207 kernel: [55524.611014] ? __fget_files+0x86/0xc0 Aug 22 20:49:10 juju-e4d256-prod-github-runner-207 kernel: [55524.611791] __x64_sys_ioctl+0x95/0xd0 Aug 22 20:49:10 juju-e4d256-prod-github-runner-207 kernel: [55524.612575] do_syscall_64+0x5c/0xc0 Aug 22 20:49:10 juju-e4d256-prod-github-runner-207 kernel: [55524.613321] ? do_futex+0x162/0x1f0 Aug 22 20:49:10 juju-e4d256-prod-github-runner-207 kernel: [55524.614038] ? __x64_sys_futex+0x78/0x1e0 Aug 22 20:49:10 juju-e4d256-prod-github-runner-207 kernel: [55524.614789] ? __secure_computing+0xa9/0x120 Aug 22 20:49:10 juju-e4d256-prod-github-runner-207 kernel: [55524.615564] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 20:49:10 juju-e4d256-prod-github-runner-207 kernel: [55524.616429] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:49:10 juju-e4d256-prod-github-runner-207 kernel: [55524.617347] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:49:10 juju-e4d256-prod-github-runner-207 kernel: [55524.618162] ? do_syscall_64+0x69/0xc0 Aug 22 20:49:10 juju-e4d256-prod-github-runner-207 kernel: [55524.618884] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:49:10 juju-e4d256-prod-github-runner-207 kernel: [55524.619769] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:49:10 juju-e4d256-prod-github-runner-207 kernel: [55524.620626] ? do_syscall_64+0x69/0xc0 Aug 22 20:49:10 juju-e4d256-prod-github-runner-207 kernel: [55524.621452] ? do_syscall_64+0x69/0xc0 Aug 22 20:49:10 juju-e4d256-prod-github-runner-207 kernel: [55524.622437] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 20:49:10 juju-e4d256-prod-github-runner-207 kernel: [55524.623342] RIP: 0033:0x7faa5d0edaff Aug 22 20:49:10 juju-e4d256-prod-github-runner-207 kernel: [55524.624113] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 20:49:10 juju-e4d256-prod-github-runner-207 kernel: [55524.626702] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 20:49:10 juju-e4d256-prod-github-runner-207 kernel: [55524.627812] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 20:49:10 juju-e4d256-prod-github-runner-207 kernel: [55524.629016] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 20:49:10 juju-e4d256-prod-github-runner-207 kernel: [55524.630410] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 20:49:10 juju-e4d256-prod-github-runner-207 kernel: [55524.631481] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 20:49:10 juju-e4d256-prod-github-runner-207 kernel: [55524.632611] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 20:49:10 juju-e4d256-prod-github-runner-207 kernel: [55524.633816] Aug 22 20:49:38 juju-e4d256-prod-github-runner-207 kernel: [55552.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 51629s! [qemu-system-x86:6715] Aug 22 20:49:38 juju-e4d256-prod-github-runner-207 kernel: [55552.543966] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 20:49:38 juju-e4d256-prod-github-runner-207 kernel: [55552.544275] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 20:49:38 juju-e4d256-prod-github-runner-207 kernel: [55552.556516] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 20:49:38 juju-e4d256-prod-github-runner-207 kernel: [55552.557787] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 20:49:38 juju-e4d256-prod-github-runner-207 kernel: [55552.559013] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:49:38 juju-e4d256-prod-github-runner-207 kernel: [55552.560091] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 20:49:38 juju-e4d256-prod-github-runner-207 kernel: [55552.562694] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 20:49:38 juju-e4d256-prod-github-runner-207 kernel: [55552.563751] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 20:49:38 juju-e4d256-prod-github-runner-207 kernel: [55552.565023] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 20:49:38 juju-e4d256-prod-github-runner-207 kernel: [55552.566214] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 20:49:38 juju-e4d256-prod-github-runner-207 kernel: [55552.567374] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 20:49:38 juju-e4d256-prod-github-runner-207 kernel: [55552.568565] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 20:49:38 juju-e4d256-prod-github-runner-207 kernel: [55552.569739] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 20:49:38 juju-e4d256-prod-github-runner-207 kernel: [55552.571177] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 20:49:38 juju-e4d256-prod-github-runner-207 kernel: [55552.572299] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 20:49:38 juju-e4d256-prod-github-runner-207 kernel: [55552.573531] Call Trace: Aug 22 20:49:38 juju-e4d256-prod-github-runner-207 kernel: [55552.574492] Aug 22 20:49:38 juju-e4d256-prod-github-runner-207 kernel: [55552.575406] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:49:38 juju-e4d256-prod-github-runner-207 kernel: [55552.576465] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:49:38 juju-e4d256-prod-github-runner-207 kernel: [55552.577489] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:49:38 juju-e4d256-prod-github-runner-207 kernel: [55552.578588] ? show_regs.part.0+0x23/0x29 Aug 22 20:49:38 juju-e4d256-prod-github-runner-207 kernel: [55552.579703] ? show_regs.cold+0x8/0xd Aug 22 20:49:38 juju-e4d256-prod-github-runner-207 kernel: [55552.580894] ? watchdog_timer_fn+0x1be/0x220 Aug 22 20:49:38 juju-e4d256-prod-github-runner-207 kernel: [55552.582183] ? lockup_detector_update_enable+0x60/0x60 Aug 22 20:49:38 juju-e4d256-prod-github-runner-207 kernel: [55552.583593] ? __hrtimer_run_queues+0x107/0x230 Aug 22 20:49:38 juju-e4d256-prod-github-runner-207 kernel: [55552.584988] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 20:49:38 juju-e4d256-prod-github-runner-207 kernel: [55552.586388] ? hrtimer_interrupt+0x101/0x220 Aug 22 20:49:38 juju-e4d256-prod-github-runner-207 kernel: [55552.587725] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 20:49:38 juju-e4d256-prod-github-runner-207 kernel: [55552.588838] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 20:49:38 juju-e4d256-prod-github-runner-207 kernel: [55552.590114] Aug 22 20:49:38 juju-e4d256-prod-github-runner-207 kernel: [55552.590985] Aug 22 20:49:38 juju-e4d256-prod-github-runner-207 kernel: [55552.591832] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 20:49:38 juju-e4d256-prod-github-runner-207 kernel: [55552.592890] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:49:38 juju-e4d256-prod-github-runner-207 kernel: [55552.593983] ? _raw_spin_lock+0x22/0x30 Aug 22 20:49:38 juju-e4d256-prod-github-runner-207 kernel: [55552.594952] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:49:38 juju-e4d256-prod-github-runner-207 kernel: [55552.595987] direct_page_fault+0x206/0x310 [kvm] Aug 22 20:49:38 juju-e4d256-prod-github-runner-207 kernel: [55552.597045] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 20:49:38 juju-e4d256-prod-github-runner-207 kernel: [55552.598062] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 20:49:38 juju-e4d256-prod-github-runner-207 kernel: [55552.599096] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 20:49:38 juju-e4d256-prod-github-runner-207 kernel: [55552.600262] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 20:49:38 juju-e4d256-prod-github-runner-207 kernel: [55552.601424] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 20:49:38 juju-e4d256-prod-github-runner-207 kernel: [55552.602408] handle_exit+0x98/0x230 [kvm_amd] Aug 22 20:49:38 juju-e4d256-prod-github-runner-207 kernel: [55552.603304] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 20:49:38 juju-e4d256-prod-github-runner-207 kernel: [55552.604235] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 20:49:38 juju-e4d256-prod-github-runner-207 kernel: [55552.605178] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 20:49:38 juju-e4d256-prod-github-runner-207 kernel: [55552.606087] vcpu_run+0x62/0x2c0 [kvm] Aug 22 20:49:38 juju-e4d256-prod-github-runner-207 kernel: [55552.606905] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 20:49:38 juju-e4d256-prod-github-runner-207 kernel: [55552.607715] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 20:49:38 juju-e4d256-prod-github-runner-207 kernel: [55552.608586] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 20:49:38 juju-e4d256-prod-github-runner-207 kernel: [55552.609421] ? __seccomp_filter+0x4a/0x4a0 Aug 22 20:49:38 juju-e4d256-prod-github-runner-207 kernel: [55552.610182] ? __fget_files+0x86/0xc0 Aug 22 20:49:38 juju-e4d256-prod-github-runner-207 kernel: [55552.610887] __x64_sys_ioctl+0x95/0xd0 Aug 22 20:49:38 juju-e4d256-prod-github-runner-207 kernel: [55552.611581] do_syscall_64+0x5c/0xc0 Aug 22 20:49:38 juju-e4d256-prod-github-runner-207 kernel: [55552.612252] ? do_futex+0x162/0x1f0 Aug 22 20:49:38 juju-e4d256-prod-github-runner-207 kernel: [55552.612917] ? __x64_sys_futex+0x78/0x1e0 Aug 22 20:49:38 juju-e4d256-prod-github-runner-207 kernel: [55552.613593] ? __secure_computing+0xa9/0x120 Aug 22 20:49:38 juju-e4d256-prod-github-runner-207 kernel: [55552.614289] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 20:49:38 juju-e4d256-prod-github-runner-207 kernel: [55552.615065] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:49:38 juju-e4d256-prod-github-runner-207 kernel: [55552.615826] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:49:38 juju-e4d256-prod-github-runner-207 kernel: [55552.616571] ? do_syscall_64+0x69/0xc0 Aug 22 20:49:38 juju-e4d256-prod-github-runner-207 kernel: [55552.617222] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:49:38 juju-e4d256-prod-github-runner-207 kernel: [55552.617926] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:49:38 juju-e4d256-prod-github-runner-207 kernel: [55552.618623] ? do_syscall_64+0x69/0xc0 Aug 22 20:49:38 juju-e4d256-prod-github-runner-207 kernel: [55552.619250] ? do_syscall_64+0x69/0xc0 Aug 22 20:49:38 juju-e4d256-prod-github-runner-207 kernel: [55552.619874] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 20:49:38 juju-e4d256-prod-github-runner-207 kernel: [55552.620625] RIP: 0033:0x7faa5d0edaff Aug 22 20:49:38 juju-e4d256-prod-github-runner-207 kernel: [55552.621297] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 20:49:38 juju-e4d256-prod-github-runner-207 kernel: [55552.623333] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 20:49:38 juju-e4d256-prod-github-runner-207 kernel: [55552.624263] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 20:49:38 juju-e4d256-prod-github-runner-207 kernel: [55552.625165] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 20:49:38 juju-e4d256-prod-github-runner-207 kernel: [55552.626080] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 20:49:38 juju-e4d256-prod-github-runner-207 kernel: [55552.626996] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 20:49:38 juju-e4d256-prod-github-runner-207 kernel: [55552.627895] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 20:49:38 juju-e4d256-prod-github-runner-207 kernel: [55552.628808] Aug 22 20:50:06 juju-e4d256-prod-github-runner-207 kernel: [55580.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 51655s! [qemu-system-x86:6715] Aug 22 20:50:06 juju-e4d256-prod-github-runner-207 kernel: [55580.543178] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 20:50:06 juju-e4d256-prod-github-runner-207 kernel: [55580.543260] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 20:50:06 juju-e4d256-prod-github-runner-207 kernel: [55580.557777] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 20:50:06 juju-e4d256-prod-github-runner-207 kernel: [55580.559054] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 20:50:06 juju-e4d256-prod-github-runner-207 kernel: [55580.560528] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:50:06 juju-e4d256-prod-github-runner-207 kernel: [55580.561612] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 20:50:06 juju-e4d256-prod-github-runner-207 kernel: [55580.564220] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 20:50:06 juju-e4d256-prod-github-runner-207 kernel: [55580.565282] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 20:50:06 juju-e4d256-prod-github-runner-207 kernel: [55580.566510] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 20:50:06 juju-e4d256-prod-github-runner-207 kernel: [55580.567699] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 20:50:06 juju-e4d256-prod-github-runner-207 kernel: [55580.568922] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 20:50:06 juju-e4d256-prod-github-runner-207 kernel: [55580.570095] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 20:50:06 juju-e4d256-prod-github-runner-207 kernel: [55580.571262] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 20:50:06 juju-e4d256-prod-github-runner-207 kernel: [55580.572536] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 20:50:06 juju-e4d256-prod-github-runner-207 kernel: [55580.573638] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 20:50:06 juju-e4d256-prod-github-runner-207 kernel: [55580.574834] Call Trace: Aug 22 20:50:06 juju-e4d256-prod-github-runner-207 kernel: [55580.575757] Aug 22 20:50:06 juju-e4d256-prod-github-runner-207 kernel: [55580.576665] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:50:06 juju-e4d256-prod-github-runner-207 kernel: [55580.577709] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:50:06 juju-e4d256-prod-github-runner-207 kernel: [55580.578804] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:50:06 juju-e4d256-prod-github-runner-207 kernel: [55580.579909] ? show_regs.part.0+0x23/0x29 Aug 22 20:50:06 juju-e4d256-prod-github-runner-207 kernel: [55580.580940] ? show_regs.cold+0x8/0xd Aug 22 20:50:06 juju-e4d256-prod-github-runner-207 kernel: [55580.581938] ? watchdog_timer_fn+0x1be/0x220 Aug 22 20:50:06 juju-e4d256-prod-github-runner-207 kernel: [55580.583058] ? lockup_detector_update_enable+0x60/0x60 Aug 22 20:50:06 juju-e4d256-prod-github-runner-207 kernel: [55580.584170] ? __hrtimer_run_queues+0x107/0x230 Aug 22 20:50:06 juju-e4d256-prod-github-runner-207 kernel: [55580.585218] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 20:50:06 juju-e4d256-prod-github-runner-207 kernel: [55580.586272] ? hrtimer_interrupt+0x101/0x220 Aug 22 20:50:06 juju-e4d256-prod-github-runner-207 kernel: [55580.587319] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 20:50:06 juju-e4d256-prod-github-runner-207 kernel: [55580.588407] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 20:50:06 juju-e4d256-prod-github-runner-207 kernel: [55580.589482] Aug 22 20:50:06 juju-e4d256-prod-github-runner-207 kernel: [55580.590337] Aug 22 20:50:06 juju-e4d256-prod-github-runner-207 kernel: [55580.591223] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 20:50:06 juju-e4d256-prod-github-runner-207 kernel: [55580.592311] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:50:06 juju-e4d256-prod-github-runner-207 kernel: [55580.593499] ? _raw_spin_lock+0x22/0x30 Aug 22 20:50:06 juju-e4d256-prod-github-runner-207 kernel: [55580.594558] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:50:06 juju-e4d256-prod-github-runner-207 kernel: [55580.595703] direct_page_fault+0x206/0x310 [kvm] Aug 22 20:50:06 juju-e4d256-prod-github-runner-207 kernel: [55580.596905] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 20:50:06 juju-e4d256-prod-github-runner-207 kernel: [55580.598027] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 20:50:06 juju-e4d256-prod-github-runner-207 kernel: [55580.599133] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 20:50:06 juju-e4d256-prod-github-runner-207 kernel: [55580.600243] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 20:50:06 juju-e4d256-prod-github-runner-207 kernel: [55580.601289] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 20:50:06 juju-e4d256-prod-github-runner-207 kernel: [55580.602379] handle_exit+0x98/0x230 [kvm_amd] Aug 22 20:50:06 juju-e4d256-prod-github-runner-207 kernel: [55580.603380] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 20:50:06 juju-e4d256-prod-github-runner-207 kernel: [55580.604335] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 20:50:06 juju-e4d256-prod-github-runner-207 kernel: [55580.605283] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 20:50:06 juju-e4d256-prod-github-runner-207 kernel: [55580.606202] vcpu_run+0x62/0x2c0 [kvm] Aug 22 20:50:06 juju-e4d256-prod-github-runner-207 kernel: [55580.607032] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 20:50:06 juju-e4d256-prod-github-runner-207 kernel: [55580.607856] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 20:50:06 juju-e4d256-prod-github-runner-207 kernel: [55580.608758] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 20:50:06 juju-e4d256-prod-github-runner-207 kernel: [55580.609574] ? __seccomp_filter+0x4a/0x4a0 Aug 22 20:50:06 juju-e4d256-prod-github-runner-207 kernel: [55580.610327] ? __fget_files+0x86/0xc0 Aug 22 20:50:06 juju-e4d256-prod-github-runner-207 kernel: [55580.611046] __x64_sys_ioctl+0x95/0xd0 Aug 22 20:50:06 juju-e4d256-prod-github-runner-207 kernel: [55580.611768] do_syscall_64+0x5c/0xc0 Aug 22 20:50:06 juju-e4d256-prod-github-runner-207 kernel: [55580.612462] ? do_futex+0x162/0x1f0 Aug 22 20:50:06 juju-e4d256-prod-github-runner-207 kernel: [55580.613124] ? __x64_sys_futex+0x78/0x1e0 Aug 22 20:50:06 juju-e4d256-prod-github-runner-207 kernel: [55580.613799] ? __secure_computing+0xa9/0x120 Aug 22 20:50:06 juju-e4d256-prod-github-runner-207 kernel: [55580.614489] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 20:50:06 juju-e4d256-prod-github-runner-207 kernel: [55580.615345] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:50:06 juju-e4d256-prod-github-runner-207 kernel: [55580.616122] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:50:06 juju-e4d256-prod-github-runner-207 kernel: [55580.616847] ? do_syscall_64+0x69/0xc0 Aug 22 20:50:06 juju-e4d256-prod-github-runner-207 kernel: [55580.617532] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:50:06 juju-e4d256-prod-github-runner-207 kernel: [55580.618262] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:50:06 juju-e4d256-prod-github-runner-207 kernel: [55580.618965] ? do_syscall_64+0x69/0xc0 Aug 22 20:50:06 juju-e4d256-prod-github-runner-207 kernel: [55580.619594] ? do_syscall_64+0x69/0xc0 Aug 22 20:50:06 juju-e4d256-prod-github-runner-207 kernel: [55580.620242] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 20:50:06 juju-e4d256-prod-github-runner-207 kernel: [55580.620954] RIP: 0033:0x7faa5d0edaff Aug 22 20:50:06 juju-e4d256-prod-github-runner-207 kernel: [55580.621579] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 20:50:06 juju-e4d256-prod-github-runner-207 kernel: [55580.623564] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 20:50:06 juju-e4d256-prod-github-runner-207 kernel: [55580.624513] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 20:50:06 juju-e4d256-prod-github-runner-207 kernel: [55580.625410] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 20:50:06 juju-e4d256-prod-github-runner-207 kernel: [55580.626315] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 20:50:06 juju-e4d256-prod-github-runner-207 kernel: [55580.627245] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 20:50:06 juju-e4d256-prod-github-runner-207 kernel: [55580.628208] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 20:50:06 juju-e4d256-prod-github-runner-207 kernel: [55580.629127] Aug 22 20:50:34 juju-e4d256-prod-github-runner-207 kernel: [55608.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 51681s! [qemu-system-x86:6715] Aug 22 20:50:34 juju-e4d256-prod-github-runner-207 kernel: [55608.543130] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 20:50:34 juju-e4d256-prod-github-runner-207 kernel: [55608.543205] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 20:50:34 juju-e4d256-prod-github-runner-207 kernel: [55608.555342] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 20:50:34 juju-e4d256-prod-github-runner-207 kernel: [55608.556657] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 20:50:34 juju-e4d256-prod-github-runner-207 kernel: [55608.557994] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:50:34 juju-e4d256-prod-github-runner-207 kernel: [55608.559051] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 20:50:34 juju-e4d256-prod-github-runner-207 kernel: [55608.561628] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 20:50:34 juju-e4d256-prod-github-runner-207 kernel: [55608.562684] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 20:50:34 juju-e4d256-prod-github-runner-207 kernel: [55608.563861] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 20:50:34 juju-e4d256-prod-github-runner-207 kernel: [55608.565033] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 20:50:34 juju-e4d256-prod-github-runner-207 kernel: [55608.566200] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 20:50:34 juju-e4d256-prod-github-runner-207 kernel: [55608.567361] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 20:50:34 juju-e4d256-prod-github-runner-207 kernel: [55608.568549] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 20:50:34 juju-e4d256-prod-github-runner-207 kernel: [55608.569781] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 20:50:34 juju-e4d256-prod-github-runner-207 kernel: [55608.570896] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 20:50:34 juju-e4d256-prod-github-runner-207 kernel: [55608.572115] Call Trace: Aug 22 20:50:34 juju-e4d256-prod-github-runner-207 kernel: [55608.573028] Aug 22 20:50:34 juju-e4d256-prod-github-runner-207 kernel: [55608.573917] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:50:34 juju-e4d256-prod-github-runner-207 kernel: [55608.574945] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:50:34 juju-e4d256-prod-github-runner-207 kernel: [55608.575980] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:50:34 juju-e4d256-prod-github-runner-207 kernel: [55608.577068] ? show_regs.part.0+0x23/0x29 Aug 22 20:50:34 juju-e4d256-prod-github-runner-207 kernel: [55608.578067] ? show_regs.cold+0x8/0xd Aug 22 20:50:34 juju-e4d256-prod-github-runner-207 kernel: [55608.579057] ? watchdog_timer_fn+0x1be/0x220 Aug 22 20:50:34 juju-e4d256-prod-github-runner-207 kernel: [55608.580085] ? lockup_detector_update_enable+0x60/0x60 Aug 22 20:50:34 juju-e4d256-prod-github-runner-207 kernel: [55608.581148] ? __hrtimer_run_queues+0x107/0x230 Aug 22 20:50:34 juju-e4d256-prod-github-runner-207 kernel: [55608.582192] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 20:50:34 juju-e4d256-prod-github-runner-207 kernel: [55608.583223] ? hrtimer_interrupt+0x101/0x220 Aug 22 20:50:34 juju-e4d256-prod-github-runner-207 kernel: [55608.584277] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 20:50:34 juju-e4d256-prod-github-runner-207 kernel: [55608.585348] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 20:50:34 juju-e4d256-prod-github-runner-207 kernel: [55608.586399] Aug 22 20:50:34 juju-e4d256-prod-github-runner-207 kernel: [55608.587262] Aug 22 20:50:34 juju-e4d256-prod-github-runner-207 kernel: [55608.588126] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 20:50:34 juju-e4d256-prod-github-runner-207 kernel: [55608.589182] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:50:34 juju-e4d256-prod-github-runner-207 kernel: [55608.590240] ? _raw_spin_lock+0x22/0x30 Aug 22 20:50:34 juju-e4d256-prod-github-runner-207 kernel: [55608.591184] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:50:34 juju-e4d256-prod-github-runner-207 kernel: [55608.592225] direct_page_fault+0x206/0x310 [kvm] Aug 22 20:50:34 juju-e4d256-prod-github-runner-207 kernel: [55608.593260] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 20:50:34 juju-e4d256-prod-github-runner-207 kernel: [55608.594270] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 20:50:34 juju-e4d256-prod-github-runner-207 kernel: [55608.595270] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 20:50:34 juju-e4d256-prod-github-runner-207 kernel: [55608.596258] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 20:50:34 juju-e4d256-prod-github-runner-207 kernel: [55608.597227] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 20:50:34 juju-e4d256-prod-github-runner-207 kernel: [55608.598208] handle_exit+0x98/0x230 [kvm_amd] Aug 22 20:50:34 juju-e4d256-prod-github-runner-207 kernel: [55608.599102] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 20:50:34 juju-e4d256-prod-github-runner-207 kernel: [55608.600037] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 20:50:34 juju-e4d256-prod-github-runner-207 kernel: [55608.600974] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 20:50:34 juju-e4d256-prod-github-runner-207 kernel: [55608.601880] vcpu_run+0x62/0x2c0 [kvm] Aug 22 20:50:34 juju-e4d256-prod-github-runner-207 kernel: [55608.602711] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 20:50:34 juju-e4d256-prod-github-runner-207 kernel: [55608.603528] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 20:50:34 juju-e4d256-prod-github-runner-207 kernel: [55608.604395] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 20:50:34 juju-e4d256-prod-github-runner-207 kernel: [55608.605197] ? __seccomp_filter+0x4a/0x4a0 Aug 22 20:50:34 juju-e4d256-prod-github-runner-207 kernel: [55608.605945] ? __fget_files+0x86/0xc0 Aug 22 20:50:34 juju-e4d256-prod-github-runner-207 kernel: [55608.606655] __x64_sys_ioctl+0x95/0xd0 Aug 22 20:50:34 juju-e4d256-prod-github-runner-207 kernel: [55608.607356] do_syscall_64+0x5c/0xc0 Aug 22 20:50:34 juju-e4d256-prod-github-runner-207 kernel: [55608.608034] ? do_futex+0x162/0x1f0 Aug 22 20:50:34 juju-e4d256-prod-github-runner-207 kernel: [55608.608701] ? __x64_sys_futex+0x78/0x1e0 Aug 22 20:50:34 juju-e4d256-prod-github-runner-207 kernel: [55608.609374] ? __secure_computing+0xa9/0x120 Aug 22 20:50:34 juju-e4d256-prod-github-runner-207 kernel: [55608.610067] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 20:50:34 juju-e4d256-prod-github-runner-207 kernel: [55608.610829] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:50:34 juju-e4d256-prod-github-runner-207 kernel: [55608.611549] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:50:34 juju-e4d256-prod-github-runner-207 kernel: [55608.612282] ? do_syscall_64+0x69/0xc0 Aug 22 20:50:34 juju-e4d256-prod-github-runner-207 kernel: [55608.612950] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:50:34 juju-e4d256-prod-github-runner-207 kernel: [55608.613676] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:50:34 juju-e4d256-prod-github-runner-207 kernel: [55608.614385] ? do_syscall_64+0x69/0xc0 Aug 22 20:50:34 juju-e4d256-prod-github-runner-207 kernel: [55608.615023] ? do_syscall_64+0x69/0xc0 Aug 22 20:50:34 juju-e4d256-prod-github-runner-207 kernel: [55608.615660] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 20:50:34 juju-e4d256-prod-github-runner-207 kernel: [55608.616368] RIP: 0033:0x7faa5d0edaff Aug 22 20:50:34 juju-e4d256-prod-github-runner-207 kernel: [55608.616992] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 20:50:34 juju-e4d256-prod-github-runner-207 kernel: [55608.618998] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 20:50:34 juju-e4d256-prod-github-runner-207 kernel: [55608.619949] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 20:50:34 juju-e4d256-prod-github-runner-207 kernel: [55608.620843] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 20:50:34 juju-e4d256-prod-github-runner-207 kernel: [55608.621780] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 20:50:34 juju-e4d256-prod-github-runner-207 kernel: [55608.622667] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 20:50:34 juju-e4d256-prod-github-runner-207 kernel: [55608.623562] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 20:50:34 juju-e4d256-prod-github-runner-207 kernel: [55608.624471] Aug 22 20:50:46 juju-e4d256-prod-github-runner-207 kernel: [55620.896708] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 20:50:46 juju-e4d256-prod-github-runner-207 kernel: [55620.897685] rcu: 1-....: (13832250 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=6686203 Aug 22 20:50:46 juju-e4d256-prod-github-runner-207 kernel: [55620.898813] (t=13875924 jiffies g=23269 q=51158) Aug 22 20:50:46 juju-e4d256-prod-github-runner-207 kernel: [55620.899621] NMI backtrace for cpu 1 Aug 22 20:50:46 juju-e4d256-prod-github-runner-207 kernel: [55620.900343] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 20:50:46 juju-e4d256-prod-github-runner-207 kernel: [55620.901453] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 20:50:46 juju-e4d256-prod-github-runner-207 kernel: [55620.902517] Call Trace: Aug 22 20:50:46 juju-e4d256-prod-github-runner-207 kernel: [55620.903192] Aug 22 20:50:46 juju-e4d256-prod-github-runner-207 kernel: [55620.903888] show_stack+0x52/0x5c Aug 22 20:50:46 juju-e4d256-prod-github-runner-207 kernel: [55620.904625] dump_stack_lvl+0x4a/0x63 Aug 22 20:50:46 juju-e4d256-prod-github-runner-207 kernel: [55620.905370] dump_stack+0x10/0x16 Aug 22 20:50:46 juju-e4d256-prod-github-runner-207 kernel: [55620.906085] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 20:50:46 juju-e4d256-prod-github-runner-207 kernel: [55620.906863] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 20:50:46 juju-e4d256-prod-github-runner-207 kernel: [55620.907654] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 20:50:46 juju-e4d256-prod-github-runner-207 kernel: [55620.908476] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 20:50:46 juju-e4d256-prod-github-runner-207 kernel: [55620.909301] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 20:50:46 juju-e4d256-prod-github-runner-207 kernel: [55620.910105] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 20:50:46 juju-e4d256-prod-github-runner-207 kernel: [55620.911080] print_cpu_stall.cold+0x2f/0xe2 Aug 22 20:50:46 juju-e4d256-prod-github-runner-207 kernel: [55620.912022] ? timekeeping_update+0xf7/0x150 Aug 22 20:50:46 juju-e4d256-prod-github-runner-207 kernel: [55620.912808] check_cpu_stall+0x109/0x270 Aug 22 20:50:46 juju-e4d256-prod-github-runner-207 kernel: [55620.913565] rcu_sched_clock_irq+0x9a/0x250 Aug 22 20:50:46 juju-e4d256-prod-github-runner-207 kernel: [55620.914339] update_process_times+0x94/0xd0 Aug 22 20:50:46 juju-e4d256-prod-github-runner-207 kernel: [55620.915111] tick_sched_handle+0x29/0x70 Aug 22 20:50:46 juju-e4d256-prod-github-runner-207 kernel: [55620.915875] tick_sched_timer+0x8c/0xc0 Aug 22 20:50:46 juju-e4d256-prod-github-runner-207 kernel: [55620.916623] ? tick_nohz_handler+0xb0/0xb0 Aug 22 20:50:46 juju-e4d256-prod-github-runner-207 kernel: [55620.917420] __hrtimer_run_queues+0x107/0x230 Aug 22 20:50:46 juju-e4d256-prod-github-runner-207 kernel: [55620.918208] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 20:50:46 juju-e4d256-prod-github-runner-207 kernel: [55620.918996] hrtimer_interrupt+0x101/0x220 Aug 22 20:50:46 juju-e4d256-prod-github-runner-207 kernel: [55620.919782] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 20:50:46 juju-e4d256-prod-github-runner-207 kernel: [55620.920603] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 20:50:46 juju-e4d256-prod-github-runner-207 kernel: [55620.921507] Aug 22 20:50:46 juju-e4d256-prod-github-runner-207 kernel: [55620.922214] Aug 22 20:50:46 juju-e4d256-prod-github-runner-207 kernel: [55620.922874] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 20:50:46 juju-e4d256-prod-github-runner-207 kernel: [55620.923746] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:50:46 juju-e4d256-prod-github-runner-207 kernel: [55620.924655] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 20:50:46 juju-e4d256-prod-github-runner-207 kernel: [55620.927411] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 20:50:46 juju-e4d256-prod-github-runner-207 kernel: [55620.928354] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 20:50:46 juju-e4d256-prod-github-runner-207 kernel: [55620.929368] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 20:50:46 juju-e4d256-prod-github-runner-207 kernel: [55620.930372] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 20:50:46 juju-e4d256-prod-github-runner-207 kernel: [55620.931359] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 20:50:46 juju-e4d256-prod-github-runner-207 kernel: [55620.932340] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 20:50:46 juju-e4d256-prod-github-runner-207 kernel: [55620.933305] ? _raw_spin_lock+0x22/0x30 Aug 22 20:50:46 juju-e4d256-prod-github-runner-207 kernel: [55620.934073] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:50:46 juju-e4d256-prod-github-runner-207 kernel: [55620.934926] direct_page_fault+0x206/0x310 [kvm] Aug 22 20:50:46 juju-e4d256-prod-github-runner-207 kernel: [55620.935802] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 20:50:46 juju-e4d256-prod-github-runner-207 kernel: [55620.936641] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 20:50:46 juju-e4d256-prod-github-runner-207 kernel: [55620.937494] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 20:50:46 juju-e4d256-prod-github-runner-207 kernel: [55620.938301] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 20:50:46 juju-e4d256-prod-github-runner-207 kernel: [55620.939093] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 20:50:46 juju-e4d256-prod-github-runner-207 kernel: [55620.939937] handle_exit+0x98/0x230 [kvm_amd] Aug 22 20:50:46 juju-e4d256-prod-github-runner-207 kernel: [55620.940713] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 20:50:46 juju-e4d256-prod-github-runner-207 kernel: [55620.941513] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 20:50:46 juju-e4d256-prod-github-runner-207 kernel: [55620.942329] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 20:50:46 juju-e4d256-prod-github-runner-207 kernel: [55620.943139] vcpu_run+0x62/0x2c0 [kvm] Aug 22 20:50:46 juju-e4d256-prod-github-runner-207 kernel: [55620.943883] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 20:50:46 juju-e4d256-prod-github-runner-207 kernel: [55620.944634] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 20:50:46 juju-e4d256-prod-github-runner-207 kernel: [55620.945441] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 20:50:46 juju-e4d256-prod-github-runner-207 kernel: [55620.946206] ? __seccomp_filter+0x4a/0x4a0 Aug 22 20:50:46 juju-e4d256-prod-github-runner-207 kernel: [55620.946929] ? __fget_files+0x86/0xc0 Aug 22 20:50:46 juju-e4d256-prod-github-runner-207 kernel: [55620.947638] __x64_sys_ioctl+0x95/0xd0 Aug 22 20:50:46 juju-e4d256-prod-github-runner-207 kernel: [55620.948347] do_syscall_64+0x5c/0xc0 Aug 22 20:50:46 juju-e4d256-prod-github-runner-207 kernel: [55620.949041] ? do_futex+0x162/0x1f0 Aug 22 20:50:46 juju-e4d256-prod-github-runner-207 kernel: [55620.949725] ? __x64_sys_futex+0x78/0x1e0 Aug 22 20:50:46 juju-e4d256-prod-github-runner-207 kernel: [55620.950429] ? __secure_computing+0xa9/0x120 Aug 22 20:50:46 juju-e4d256-prod-github-runner-207 kernel: [55620.951149] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 20:50:46 juju-e4d256-prod-github-runner-207 kernel: [55620.951980] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:50:46 juju-e4d256-prod-github-runner-207 kernel: [55620.952792] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:50:46 juju-e4d256-prod-github-runner-207 kernel: [55620.953566] ? do_syscall_64+0x69/0xc0 Aug 22 20:50:46 juju-e4d256-prod-github-runner-207 kernel: [55620.954262] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:50:46 juju-e4d256-prod-github-runner-207 kernel: [55620.955032] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:50:46 juju-e4d256-prod-github-runner-207 kernel: [55620.955824] ? do_syscall_64+0x69/0xc0 Aug 22 20:50:46 juju-e4d256-prod-github-runner-207 kernel: [55620.956526] ? do_syscall_64+0x69/0xc0 Aug 22 20:50:46 juju-e4d256-prod-github-runner-207 kernel: [55620.957214] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 20:50:46 juju-e4d256-prod-github-runner-207 kernel: [55620.957984] RIP: 0033:0x7faa5d0edaff Aug 22 20:50:46 juju-e4d256-prod-github-runner-207 kernel: [55620.958679] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 20:50:46 juju-e4d256-prod-github-runner-207 kernel: [55620.960958] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 20:50:46 juju-e4d256-prod-github-runner-207 kernel: [55620.962048] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 20:50:46 juju-e4d256-prod-github-runner-207 kernel: [55620.963005] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 20:50:46 juju-e4d256-prod-github-runner-207 kernel: [55620.963968] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 20:50:46 juju-e4d256-prod-github-runner-207 kernel: [55620.964915] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 20:50:46 juju-e4d256-prod-github-runner-207 kernel: [55620.965853] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 20:50:46 juju-e4d256-prod-github-runner-207 kernel: [55620.966783] Aug 22 20:51:14 juju-e4d256-prod-github-runner-207 kernel: [55648.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 51718s! [qemu-system-x86:6715] Aug 22 20:51:14 juju-e4d256-prod-github-runner-207 kernel: [55648.543839] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 20:51:14 juju-e4d256-prod-github-runner-207 kernel: [55648.544339] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 20:51:14 juju-e4d256-prod-github-runner-207 kernel: [55648.556796] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 20:51:14 juju-e4d256-prod-github-runner-207 kernel: [55648.558093] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 20:51:14 juju-e4d256-prod-github-runner-207 kernel: [55648.559352] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:51:14 juju-e4d256-prod-github-runner-207 kernel: [55648.560430] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 20:51:14 juju-e4d256-prod-github-runner-207 kernel: [55648.563023] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 20:51:14 juju-e4d256-prod-github-runner-207 kernel: [55648.564101] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 20:51:14 juju-e4d256-prod-github-runner-207 kernel: [55648.565289] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 20:51:14 juju-e4d256-prod-github-runner-207 kernel: [55648.566469] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 20:51:14 juju-e4d256-prod-github-runner-207 kernel: [55648.567669] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 20:51:14 juju-e4d256-prod-github-runner-207 kernel: [55648.569024] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 20:51:14 juju-e4d256-prod-github-runner-207 kernel: [55648.570212] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 20:51:14 juju-e4d256-prod-github-runner-207 kernel: [55648.571485] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 20:51:14 juju-e4d256-prod-github-runner-207 kernel: [55648.572608] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 20:51:14 juju-e4d256-prod-github-runner-207 kernel: [55648.573826] Call Trace: Aug 22 20:51:14 juju-e4d256-prod-github-runner-207 kernel: [55648.574749] Aug 22 20:51:14 juju-e4d256-prod-github-runner-207 kernel: [55648.575665] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:51:14 juju-e4d256-prod-github-runner-207 kernel: [55648.576709] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:51:14 juju-e4d256-prod-github-runner-207 kernel: [55648.577743] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:51:14 juju-e4d256-prod-github-runner-207 kernel: [55648.578850] ? show_regs.part.0+0x23/0x29 Aug 22 20:51:14 juju-e4d256-prod-github-runner-207 kernel: [55648.579876] ? show_regs.cold+0x8/0xd Aug 22 20:51:14 juju-e4d256-prod-github-runner-207 kernel: [55648.580872] ? watchdog_timer_fn+0x1be/0x220 Aug 22 20:51:14 juju-e4d256-prod-github-runner-207 kernel: [55648.581903] ? lockup_detector_update_enable+0x60/0x60 Aug 22 20:51:14 juju-e4d256-prod-github-runner-207 kernel: [55648.582979] ? __hrtimer_run_queues+0x107/0x230 Aug 22 20:51:14 juju-e4d256-prod-github-runner-207 kernel: [55648.584038] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 20:51:14 juju-e4d256-prod-github-runner-207 kernel: [55648.585094] ? hrtimer_interrupt+0x101/0x220 Aug 22 20:51:14 juju-e4d256-prod-github-runner-207 kernel: [55648.586124] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 20:51:14 juju-e4d256-prod-github-runner-207 kernel: [55648.587228] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 20:51:14 juju-e4d256-prod-github-runner-207 kernel: [55648.588299] Aug 22 20:51:14 juju-e4d256-prod-github-runner-207 kernel: [55648.589162] Aug 22 20:51:14 juju-e4d256-prod-github-runner-207 kernel: [55648.590010] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 20:51:14 juju-e4d256-prod-github-runner-207 kernel: [55648.591059] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:51:14 juju-e4d256-prod-github-runner-207 kernel: [55648.592127] ? _raw_spin_lock+0x22/0x30 Aug 22 20:51:14 juju-e4d256-prod-github-runner-207 kernel: [55648.593082] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:51:14 juju-e4d256-prod-github-runner-207 kernel: [55648.594120] direct_page_fault+0x206/0x310 [kvm] Aug 22 20:51:14 juju-e4d256-prod-github-runner-207 kernel: [55648.595171] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 20:51:14 juju-e4d256-prod-github-runner-207 kernel: [55648.596196] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 20:51:14 juju-e4d256-prod-github-runner-207 kernel: [55648.597216] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 20:51:14 juju-e4d256-prod-github-runner-207 kernel: [55648.598245] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 20:51:14 juju-e4d256-prod-github-runner-207 kernel: [55648.599224] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 20:51:14 juju-e4d256-prod-github-runner-207 kernel: [55648.600226] handle_exit+0x98/0x230 [kvm_amd] Aug 22 20:51:14 juju-e4d256-prod-github-runner-207 kernel: [55648.601131] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 20:51:14 juju-e4d256-prod-github-runner-207 kernel: [55648.602063] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 20:51:14 juju-e4d256-prod-github-runner-207 kernel: [55648.603007] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 20:51:14 juju-e4d256-prod-github-runner-207 kernel: [55648.603957] vcpu_run+0x62/0x2c0 [kvm] Aug 22 20:51:14 juju-e4d256-prod-github-runner-207 kernel: [55648.604780] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 20:51:14 juju-e4d256-prod-github-runner-207 kernel: [55648.605602] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 20:51:14 juju-e4d256-prod-github-runner-207 kernel: [55648.606472] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 20:51:14 juju-e4d256-prod-github-runner-207 kernel: [55648.607295] ? __seccomp_filter+0x4a/0x4a0 Aug 22 20:51:14 juju-e4d256-prod-github-runner-207 kernel: [55648.608049] ? __fget_files+0x86/0xc0 Aug 22 20:51:14 juju-e4d256-prod-github-runner-207 kernel: [55648.608763] __x64_sys_ioctl+0x95/0xd0 Aug 22 20:51:14 juju-e4d256-prod-github-runner-207 kernel: [55648.609471] do_syscall_64+0x5c/0xc0 Aug 22 20:51:14 juju-e4d256-prod-github-runner-207 kernel: [55648.610151] ? do_futex+0x162/0x1f0 Aug 22 20:51:14 juju-e4d256-prod-github-runner-207 kernel: [55648.610809] ? __x64_sys_futex+0x78/0x1e0 Aug 22 20:51:14 juju-e4d256-prod-github-runner-207 kernel: [55648.611506] ? __secure_computing+0xa9/0x120 Aug 22 20:51:14 juju-e4d256-prod-github-runner-207 kernel: [55648.612207] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 20:51:14 juju-e4d256-prod-github-runner-207 kernel: [55648.612981] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:51:14 juju-e4d256-prod-github-runner-207 kernel: [55648.613716] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:51:14 juju-e4d256-prod-github-runner-207 kernel: [55648.614450] ? do_syscall_64+0x69/0xc0 Aug 22 20:51:14 juju-e4d256-prod-github-runner-207 kernel: [55648.615107] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:51:14 juju-e4d256-prod-github-runner-207 kernel: [55648.615828] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:51:14 juju-e4d256-prod-github-runner-207 kernel: [55648.616539] ? do_syscall_64+0x69/0xc0 Aug 22 20:51:14 juju-e4d256-prod-github-runner-207 kernel: [55648.617172] ? do_syscall_64+0x69/0xc0 Aug 22 20:51:14 juju-e4d256-prod-github-runner-207 kernel: [55648.617801] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 20:51:14 juju-e4d256-prod-github-runner-207 kernel: [55648.618519] RIP: 0033:0x7faa5d0edaff Aug 22 20:51:14 juju-e4d256-prod-github-runner-207 kernel: [55648.619198] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 20:51:14 juju-e4d256-prod-github-runner-207 kernel: [55648.621350] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 20:51:14 juju-e4d256-prod-github-runner-207 kernel: [55648.622281] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 20:51:14 juju-e4d256-prod-github-runner-207 kernel: [55648.623215] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 20:51:14 juju-e4d256-prod-github-runner-207 kernel: [55648.624131] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 20:51:14 juju-e4d256-prod-github-runner-207 kernel: [55648.625040] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 20:51:14 juju-e4d256-prod-github-runner-207 kernel: [55648.625959] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 20:51:14 juju-e4d256-prod-github-runner-207 kernel: [55648.626869] Aug 22 20:51:42 juju-e4d256-prod-github-runner-207 kernel: [55676.541976] watchdog: BUG: soft lockup - CPU#1 stuck for 51744s! [qemu-system-x86:6715] Aug 22 20:51:42 juju-e4d256-prod-github-runner-207 kernel: [55676.543112] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 20:51:42 juju-e4d256-prod-github-runner-207 kernel: [55676.543185] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 20:51:42 juju-e4d256-prod-github-runner-207 kernel: [55676.555492] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 20:51:42 juju-e4d256-prod-github-runner-207 kernel: [55676.556781] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 20:51:42 juju-e4d256-prod-github-runner-207 kernel: [55676.558036] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:51:42 juju-e4d256-prod-github-runner-207 kernel: [55676.559125] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 20:51:42 juju-e4d256-prod-github-runner-207 kernel: [55676.561764] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 20:51:42 juju-e4d256-prod-github-runner-207 kernel: [55676.562862] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 20:51:42 juju-e4d256-prod-github-runner-207 kernel: [55676.564182] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 20:51:42 juju-e4d256-prod-github-runner-207 kernel: [55676.565910] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 20:51:42 juju-e4d256-prod-github-runner-207 kernel: [55676.567442] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 20:51:42 juju-e4d256-prod-github-runner-207 kernel: [55676.568873] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 20:51:42 juju-e4d256-prod-github-runner-207 kernel: [55676.570106] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 20:51:42 juju-e4d256-prod-github-runner-207 kernel: [55676.571380] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 20:51:42 juju-e4d256-prod-github-runner-207 kernel: [55676.572547] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 20:51:42 juju-e4d256-prod-github-runner-207 kernel: [55676.573770] Call Trace: Aug 22 20:51:42 juju-e4d256-prod-github-runner-207 kernel: [55676.574709] Aug 22 20:51:42 juju-e4d256-prod-github-runner-207 kernel: [55676.575644] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:51:42 juju-e4d256-prod-github-runner-207 kernel: [55676.576723] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:51:42 juju-e4d256-prod-github-runner-207 kernel: [55676.577759] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:51:42 juju-e4d256-prod-github-runner-207 kernel: [55676.578899] ? show_regs.part.0+0x23/0x29 Aug 22 20:51:42 juju-e4d256-prod-github-runner-207 kernel: [55676.579917] ? show_regs.cold+0x8/0xd Aug 22 20:51:42 juju-e4d256-prod-github-runner-207 kernel: [55676.580920] ? watchdog_timer_fn+0x1be/0x220 Aug 22 20:51:42 juju-e4d256-prod-github-runner-207 kernel: [55676.581947] ? lockup_detector_update_enable+0x60/0x60 Aug 22 20:51:42 juju-e4d256-prod-github-runner-207 kernel: [55676.583041] ? __hrtimer_run_queues+0x107/0x230 Aug 22 20:51:42 juju-e4d256-prod-github-runner-207 kernel: [55676.584108] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 20:51:42 juju-e4d256-prod-github-runner-207 kernel: [55676.585155] ? hrtimer_interrupt+0x101/0x220 Aug 22 20:51:42 juju-e4d256-prod-github-runner-207 kernel: [55676.586184] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 20:51:42 juju-e4d256-prod-github-runner-207 kernel: [55676.587321] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 20:51:42 juju-e4d256-prod-github-runner-207 kernel: [55676.588392] Aug 22 20:51:42 juju-e4d256-prod-github-runner-207 kernel: [55676.589249] Aug 22 20:51:42 juju-e4d256-prod-github-runner-207 kernel: [55676.590093] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 20:51:42 juju-e4d256-prod-github-runner-207 kernel: [55676.591160] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:51:42 juju-e4d256-prod-github-runner-207 kernel: [55676.592213] ? _raw_spin_lock+0x22/0x30 Aug 22 20:51:42 juju-e4d256-prod-github-runner-207 kernel: [55676.593172] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:51:42 juju-e4d256-prod-github-runner-207 kernel: [55676.594287] direct_page_fault+0x206/0x310 [kvm] Aug 22 20:51:42 juju-e4d256-prod-github-runner-207 kernel: [55676.595359] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 20:51:42 juju-e4d256-prod-github-runner-207 kernel: [55676.596377] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 20:51:42 juju-e4d256-prod-github-runner-207 kernel: [55676.597387] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 20:51:42 juju-e4d256-prod-github-runner-207 kernel: [55676.598363] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 20:51:42 juju-e4d256-prod-github-runner-207 kernel: [55676.599329] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 20:51:42 juju-e4d256-prod-github-runner-207 kernel: [55676.600315] handle_exit+0x98/0x230 [kvm_amd] Aug 22 20:51:42 juju-e4d256-prod-github-runner-207 kernel: [55676.601212] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 20:51:42 juju-e4d256-prod-github-runner-207 kernel: [55676.602127] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 20:51:42 juju-e4d256-prod-github-runner-207 kernel: [55676.603069] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 20:51:42 juju-e4d256-prod-github-runner-207 kernel: [55676.603975] vcpu_run+0x62/0x2c0 [kvm] Aug 22 20:51:42 juju-e4d256-prod-github-runner-207 kernel: [55676.604787] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 20:51:42 juju-e4d256-prod-github-runner-207 kernel: [55676.605596] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 20:51:42 juju-e4d256-prod-github-runner-207 kernel: [55676.606456] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 20:51:42 juju-e4d256-prod-github-runner-207 kernel: [55676.607266] ? __seccomp_filter+0x4a/0x4a0 Aug 22 20:51:42 juju-e4d256-prod-github-runner-207 kernel: [55676.608010] ? __fget_files+0x86/0xc0 Aug 22 20:51:42 juju-e4d256-prod-github-runner-207 kernel: [55676.608715] __x64_sys_ioctl+0x95/0xd0 Aug 22 20:51:42 juju-e4d256-prod-github-runner-207 kernel: [55676.609407] do_syscall_64+0x5c/0xc0 Aug 22 20:51:42 juju-e4d256-prod-github-runner-207 kernel: [55676.610078] ? do_futex+0x162/0x1f0 Aug 22 20:51:42 juju-e4d256-prod-github-runner-207 kernel: [55676.610729] ? __x64_sys_futex+0x78/0x1e0 Aug 22 20:51:42 juju-e4d256-prod-github-runner-207 kernel: [55676.611420] ? __secure_computing+0xa9/0x120 Aug 22 20:51:42 juju-e4d256-prod-github-runner-207 kernel: [55676.612111] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 20:51:42 juju-e4d256-prod-github-runner-207 kernel: [55676.612871] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:51:42 juju-e4d256-prod-github-runner-207 kernel: [55676.613594] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:51:42 juju-e4d256-prod-github-runner-207 kernel: [55676.614313] ? do_syscall_64+0x69/0xc0 Aug 22 20:51:42 juju-e4d256-prod-github-runner-207 kernel: [55676.614973] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:51:42 juju-e4d256-prod-github-runner-207 kernel: [55676.615678] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:51:42 juju-e4d256-prod-github-runner-207 kernel: [55676.616372] ? do_syscall_64+0x69/0xc0 Aug 22 20:51:42 juju-e4d256-prod-github-runner-207 kernel: [55676.616996] ? do_syscall_64+0x69/0xc0 Aug 22 20:51:42 juju-e4d256-prod-github-runner-207 kernel: [55676.617658] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 20:51:42 juju-e4d256-prod-github-runner-207 kernel: [55676.618364] RIP: 0033:0x7faa5d0edaff Aug 22 20:51:42 juju-e4d256-prod-github-runner-207 kernel: [55676.618999] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 20:51:42 juju-e4d256-prod-github-runner-207 kernel: [55676.621006] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 20:51:42 juju-e4d256-prod-github-runner-207 kernel: [55676.621925] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 20:51:42 juju-e4d256-prod-github-runner-207 kernel: [55676.622828] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 20:51:42 juju-e4d256-prod-github-runner-207 kernel: [55676.623728] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 20:51:42 juju-e4d256-prod-github-runner-207 kernel: [55676.624670] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 20:51:42 juju-e4d256-prod-github-runner-207 kernel: [55676.625573] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 20:51:42 juju-e4d256-prod-github-runner-207 kernel: [55676.626463] Aug 22 20:52:10 juju-e4d256-prod-github-runner-207 kernel: [55704.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 51770s! [qemu-system-x86:6715] Aug 22 20:52:10 juju-e4d256-prod-github-runner-207 kernel: [55704.543175] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 20:52:10 juju-e4d256-prod-github-runner-207 kernel: [55704.543249] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 20:52:10 juju-e4d256-prod-github-runner-207 kernel: [55704.555750] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 20:52:10 juju-e4d256-prod-github-runner-207 kernel: [55704.557039] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 20:52:10 juju-e4d256-prod-github-runner-207 kernel: [55704.558285] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:52:10 juju-e4d256-prod-github-runner-207 kernel: [55704.559359] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 20:52:10 juju-e4d256-prod-github-runner-207 kernel: [55704.561889] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 20:52:10 juju-e4d256-prod-github-runner-207 kernel: [55704.562942] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 20:52:10 juju-e4d256-prod-github-runner-207 kernel: [55704.564113] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 20:52:10 juju-e4d256-prod-github-runner-207 kernel: [55704.565284] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 20:52:10 juju-e4d256-prod-github-runner-207 kernel: [55704.566448] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 20:52:10 juju-e4d256-prod-github-runner-207 kernel: [55704.567620] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 20:52:10 juju-e4d256-prod-github-runner-207 kernel: [55704.568776] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 20:52:10 juju-e4d256-prod-github-runner-207 kernel: [55704.570003] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 20:52:10 juju-e4d256-prod-github-runner-207 kernel: [55704.571113] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 20:52:10 juju-e4d256-prod-github-runner-207 kernel: [55704.572299] Call Trace: Aug 22 20:52:10 juju-e4d256-prod-github-runner-207 kernel: [55704.573207] Aug 22 20:52:10 juju-e4d256-prod-github-runner-207 kernel: [55704.574088] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:52:10 juju-e4d256-prod-github-runner-207 kernel: [55704.575126] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:52:10 juju-e4d256-prod-github-runner-207 kernel: [55704.576152] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:52:10 juju-e4d256-prod-github-runner-207 kernel: [55704.577236] ? show_regs.part.0+0x23/0x29 Aug 22 20:52:10 juju-e4d256-prod-github-runner-207 kernel: [55704.578228] ? show_regs.cold+0x8/0xd Aug 22 20:52:10 juju-e4d256-prod-github-runner-207 kernel: [55704.579213] ? watchdog_timer_fn+0x1be/0x220 Aug 22 20:52:10 juju-e4d256-prod-github-runner-207 kernel: [55704.580231] ? lockup_detector_update_enable+0x60/0x60 Aug 22 20:52:10 juju-e4d256-prod-github-runner-207 kernel: [55704.581516] ? __hrtimer_run_queues+0x107/0x230 Aug 22 20:52:10 juju-e4d256-prod-github-runner-207 kernel: [55704.582555] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 20:52:10 juju-e4d256-prod-github-runner-207 kernel: [55704.583577] ? hrtimer_interrupt+0x101/0x220 Aug 22 20:52:10 juju-e4d256-prod-github-runner-207 kernel: [55704.584589] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 20:52:10 juju-e4d256-prod-github-runner-207 kernel: [55704.585658] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 20:52:10 juju-e4d256-prod-github-runner-207 kernel: [55704.586721] Aug 22 20:52:10 juju-e4d256-prod-github-runner-207 kernel: [55704.587572] Aug 22 20:52:10 juju-e4d256-prod-github-runner-207 kernel: [55704.588409] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 20:52:10 juju-e4d256-prod-github-runner-207 kernel: [55704.589442] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:52:10 juju-e4d256-prod-github-runner-207 kernel: [55704.590488] ? _raw_spin_lock+0x22/0x30 Aug 22 20:52:10 juju-e4d256-prod-github-runner-207 kernel: [55704.591451] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:52:10 juju-e4d256-prod-github-runner-207 kernel: [55704.592468] direct_page_fault+0x206/0x310 [kvm] Aug 22 20:52:10 juju-e4d256-prod-github-runner-207 kernel: [55704.593504] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 20:52:10 juju-e4d256-prod-github-runner-207 kernel: [55704.594534] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 20:52:10 juju-e4d256-prod-github-runner-207 kernel: [55704.595541] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 20:52:10 juju-e4d256-prod-github-runner-207 kernel: [55704.596512] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 20:52:10 juju-e4d256-prod-github-runner-207 kernel: [55704.597458] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 20:52:10 juju-e4d256-prod-github-runner-207 kernel: [55704.598440] handle_exit+0x98/0x230 [kvm_amd] Aug 22 20:52:10 juju-e4d256-prod-github-runner-207 kernel: [55704.599346] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 20:52:10 juju-e4d256-prod-github-runner-207 kernel: [55704.600258] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 20:52:10 juju-e4d256-prod-github-runner-207 kernel: [55704.601181] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 20:52:10 juju-e4d256-prod-github-runner-207 kernel: [55704.602084] vcpu_run+0x62/0x2c0 [kvm] Aug 22 20:52:10 juju-e4d256-prod-github-runner-207 kernel: [55704.602906] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 20:52:10 juju-e4d256-prod-github-runner-207 kernel: [55704.603733] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 20:52:10 juju-e4d256-prod-github-runner-207 kernel: [55704.604595] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 20:52:10 juju-e4d256-prod-github-runner-207 kernel: [55704.605393] ? __seccomp_filter+0x4a/0x4a0 Aug 22 20:52:10 juju-e4d256-prod-github-runner-207 kernel: [55704.606135] ? __fget_files+0x86/0xc0 Aug 22 20:52:10 juju-e4d256-prod-github-runner-207 kernel: [55704.606851] __x64_sys_ioctl+0x95/0xd0 Aug 22 20:52:10 juju-e4d256-prod-github-runner-207 kernel: [55704.607543] do_syscall_64+0x5c/0xc0 Aug 22 20:52:10 juju-e4d256-prod-github-runner-207 kernel: [55704.608206] ? do_futex+0x162/0x1f0 Aug 22 20:52:10 juju-e4d256-prod-github-runner-207 kernel: [55704.608859] ? __x64_sys_futex+0x78/0x1e0 Aug 22 20:52:10 juju-e4d256-prod-github-runner-207 kernel: [55704.609531] ? __secure_computing+0xa9/0x120 Aug 22 20:52:10 juju-e4d256-prod-github-runner-207 kernel: [55704.610219] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 20:52:10 juju-e4d256-prod-github-runner-207 kernel: [55704.611009] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:52:10 juju-e4d256-prod-github-runner-207 kernel: [55704.611736] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:52:10 juju-e4d256-prod-github-runner-207 kernel: [55704.612452] ? do_syscall_64+0x69/0xc0 Aug 22 20:52:10 juju-e4d256-prod-github-runner-207 kernel: [55704.613095] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:52:10 juju-e4d256-prod-github-runner-207 kernel: [55704.613796] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:52:10 juju-e4d256-prod-github-runner-207 kernel: [55704.614502] ? do_syscall_64+0x69/0xc0 Aug 22 20:52:10 juju-e4d256-prod-github-runner-207 kernel: [55704.615125] ? do_syscall_64+0x69/0xc0 Aug 22 20:52:10 juju-e4d256-prod-github-runner-207 kernel: [55704.615750] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 20:52:10 juju-e4d256-prod-github-runner-207 kernel: [55704.616453] RIP: 0033:0x7faa5d0edaff Aug 22 20:52:10 juju-e4d256-prod-github-runner-207 kernel: [55704.617077] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 20:52:10 juju-e4d256-prod-github-runner-207 kernel: [55704.619070] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 20:52:10 juju-e4d256-prod-github-runner-207 kernel: [55704.619994] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 20:52:10 juju-e4d256-prod-github-runner-207 kernel: [55704.620887] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 20:52:10 juju-e4d256-prod-github-runner-207 kernel: [55704.621784] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 20:52:10 juju-e4d256-prod-github-runner-207 kernel: [55704.622705] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 20:52:10 juju-e4d256-prod-github-runner-207 kernel: [55704.623613] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 20:52:10 juju-e4d256-prod-github-runner-207 kernel: [55704.624502] Aug 22 20:52:38 juju-e4d256-prod-github-runner-207 kernel: [55732.541981] watchdog: BUG: soft lockup - CPU#1 stuck for 51796s! [qemu-system-x86:6715] Aug 22 20:52:38 juju-e4d256-prod-github-runner-207 kernel: [55732.543888] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 20:52:38 juju-e4d256-prod-github-runner-207 kernel: [55732.544176] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 20:52:38 juju-e4d256-prod-github-runner-207 kernel: [55732.556615] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 20:52:38 juju-e4d256-prod-github-runner-207 kernel: [55732.557924] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 20:52:38 juju-e4d256-prod-github-runner-207 kernel: [55732.559215] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:52:38 juju-e4d256-prod-github-runner-207 kernel: [55732.560289] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 20:52:38 juju-e4d256-prod-github-runner-207 kernel: [55732.562956] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 20:52:38 juju-e4d256-prod-github-runner-207 kernel: [55732.564013] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 20:52:38 juju-e4d256-prod-github-runner-207 kernel: [55732.565179] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 20:52:38 juju-e4d256-prod-github-runner-207 kernel: [55732.566361] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 20:52:38 juju-e4d256-prod-github-runner-207 kernel: [55732.567564] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 20:52:38 juju-e4d256-prod-github-runner-207 kernel: [55732.568749] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 20:52:38 juju-e4d256-prod-github-runner-207 kernel: [55732.569922] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 20:52:38 juju-e4d256-prod-github-runner-207 kernel: [55732.571170] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 20:52:38 juju-e4d256-prod-github-runner-207 kernel: [55732.572410] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 20:52:38 juju-e4d256-prod-github-runner-207 kernel: [55732.573652] Call Trace: Aug 22 20:52:38 juju-e4d256-prod-github-runner-207 kernel: [55732.574675] Aug 22 20:52:38 juju-e4d256-prod-github-runner-207 kernel: [55732.575576] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:52:38 juju-e4d256-prod-github-runner-207 kernel: [55732.576608] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:52:38 juju-e4d256-prod-github-runner-207 kernel: [55732.577671] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:52:38 juju-e4d256-prod-github-runner-207 kernel: [55732.578811] ? show_regs.part.0+0x23/0x29 Aug 22 20:52:38 juju-e4d256-prod-github-runner-207 kernel: [55732.579827] ? show_regs.cold+0x8/0xd Aug 22 20:52:38 juju-e4d256-prod-github-runner-207 kernel: [55732.580809] ? watchdog_timer_fn+0x1be/0x220 Aug 22 20:52:38 juju-e4d256-prod-github-runner-207 kernel: [55732.581825] ? lockup_detector_update_enable+0x60/0x60 Aug 22 20:52:38 juju-e4d256-prod-github-runner-207 kernel: [55732.582934] ? __hrtimer_run_queues+0x107/0x230 Aug 22 20:52:38 juju-e4d256-prod-github-runner-207 kernel: [55732.584006] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 20:52:38 juju-e4d256-prod-github-runner-207 kernel: [55732.585042] ? hrtimer_interrupt+0x101/0x220 Aug 22 20:52:38 juju-e4d256-prod-github-runner-207 kernel: [55732.586060] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 20:52:38 juju-e4d256-prod-github-runner-207 kernel: [55732.587246] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 20:52:38 juju-e4d256-prod-github-runner-207 kernel: [55732.588428] Aug 22 20:52:38 juju-e4d256-prod-github-runner-207 kernel: [55732.589305] Aug 22 20:52:38 juju-e4d256-prod-github-runner-207 kernel: [55732.590169] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 20:52:38 juju-e4d256-prod-github-runner-207 kernel: [55732.591212] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:52:38 juju-e4d256-prod-github-runner-207 kernel: [55732.592393] ? _raw_spin_lock+0x22/0x30 Aug 22 20:52:38 juju-e4d256-prod-github-runner-207 kernel: [55732.593370] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:52:38 juju-e4d256-prod-github-runner-207 kernel: [55732.594453] direct_page_fault+0x206/0x310 [kvm] Aug 22 20:52:38 juju-e4d256-prod-github-runner-207 kernel: [55732.595528] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 20:52:38 juju-e4d256-prod-github-runner-207 kernel: [55732.596552] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 20:52:38 juju-e4d256-prod-github-runner-207 kernel: [55732.597602] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 20:52:38 juju-e4d256-prod-github-runner-207 kernel: [55732.598685] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 20:52:38 juju-e4d256-prod-github-runner-207 kernel: [55732.599648] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 20:52:38 juju-e4d256-prod-github-runner-207 kernel: [55732.600637] handle_exit+0x98/0x230 [kvm_amd] Aug 22 20:52:38 juju-e4d256-prod-github-runner-207 kernel: [55732.601535] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 20:52:38 juju-e4d256-prod-github-runner-207 kernel: [55732.602467] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 20:52:38 juju-e4d256-prod-github-runner-207 kernel: [55732.603426] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 20:52:38 juju-e4d256-prod-github-runner-207 kernel: [55732.604373] vcpu_run+0x62/0x2c0 [kvm] Aug 22 20:52:38 juju-e4d256-prod-github-runner-207 kernel: [55732.605193] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 20:52:38 juju-e4d256-prod-github-runner-207 kernel: [55732.606003] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 20:52:38 juju-e4d256-prod-github-runner-207 kernel: [55732.606875] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 20:52:38 juju-e4d256-prod-github-runner-207 kernel: [55732.607692] ? __seccomp_filter+0x4a/0x4a0 Aug 22 20:52:38 juju-e4d256-prod-github-runner-207 kernel: [55732.608461] ? __fget_files+0x86/0xc0 Aug 22 20:52:38 juju-e4d256-prod-github-runner-207 kernel: [55732.609178] __x64_sys_ioctl+0x95/0xd0 Aug 22 20:52:38 juju-e4d256-prod-github-runner-207 kernel: [55732.609889] do_syscall_64+0x5c/0xc0 Aug 22 20:52:38 juju-e4d256-prod-github-runner-207 kernel: [55732.610571] ? do_futex+0x162/0x1f0 Aug 22 20:52:38 juju-e4d256-prod-github-runner-207 kernel: [55732.611229] ? __x64_sys_futex+0x78/0x1e0 Aug 22 20:52:38 juju-e4d256-prod-github-runner-207 kernel: [55732.611911] ? __secure_computing+0xa9/0x120 Aug 22 20:52:38 juju-e4d256-prod-github-runner-207 kernel: [55732.612603] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 20:52:38 juju-e4d256-prod-github-runner-207 kernel: [55732.613400] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:52:38 juju-e4d256-prod-github-runner-207 kernel: [55732.614162] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:52:38 juju-e4d256-prod-github-runner-207 kernel: [55732.614945] ? do_syscall_64+0x69/0xc0 Aug 22 20:52:38 juju-e4d256-prod-github-runner-207 kernel: [55732.615595] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:52:38 juju-e4d256-prod-github-runner-207 kernel: [55732.616312] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:52:38 juju-e4d256-prod-github-runner-207 kernel: [55732.617065] ? do_syscall_64+0x69/0xc0 Aug 22 20:52:38 juju-e4d256-prod-github-runner-207 kernel: [55732.617698] ? do_syscall_64+0x69/0xc0 Aug 22 20:52:38 juju-e4d256-prod-github-runner-207 kernel: [55732.618340] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 20:52:38 juju-e4d256-prod-github-runner-207 kernel: [55732.619091] RIP: 0033:0x7faa5d0edaff Aug 22 20:52:38 juju-e4d256-prod-github-runner-207 kernel: [55732.619770] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 20:52:38 juju-e4d256-prod-github-runner-207 kernel: [55732.621775] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 20:52:38 juju-e4d256-prod-github-runner-207 kernel: [55732.622698] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 20:52:38 juju-e4d256-prod-github-runner-207 kernel: [55732.623601] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 20:52:38 juju-e4d256-prod-github-runner-207 kernel: [55732.624536] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 20:52:38 juju-e4d256-prod-github-runner-207 kernel: [55732.625458] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 20:52:38 juju-e4d256-prod-github-runner-207 kernel: [55732.626368] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 20:52:38 juju-e4d256-prod-github-runner-207 kernel: [55732.627393] Aug 22 20:53:06 juju-e4d256-prod-github-runner-207 kernel: [55760.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 51823s! [qemu-system-x86:6715] Aug 22 20:53:06 juju-e4d256-prod-github-runner-207 kernel: [55760.543110] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 20:53:06 juju-e4d256-prod-github-runner-207 kernel: [55760.543184] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 20:53:06 juju-e4d256-prod-github-runner-207 kernel: [55760.555364] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 20:53:06 juju-e4d256-prod-github-runner-207 kernel: [55760.556642] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 20:53:06 juju-e4d256-prod-github-runner-207 kernel: [55760.557893] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:53:06 juju-e4d256-prod-github-runner-207 kernel: [55760.558953] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 20:53:06 juju-e4d256-prod-github-runner-207 kernel: [55760.561508] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 20:53:06 juju-e4d256-prod-github-runner-207 kernel: [55760.562570] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 20:53:06 juju-e4d256-prod-github-runner-207 kernel: [55760.563763] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 20:53:06 juju-e4d256-prod-github-runner-207 kernel: [55760.565076] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 20:53:06 juju-e4d256-prod-github-runner-207 kernel: [55760.566270] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 20:53:06 juju-e4d256-prod-github-runner-207 kernel: [55760.567449] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 20:53:06 juju-e4d256-prod-github-runner-207 kernel: [55760.568743] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 20:53:06 juju-e4d256-prod-github-runner-207 kernel: [55760.569994] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 20:53:06 juju-e4d256-prod-github-runner-207 kernel: [55760.571097] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 20:53:06 juju-e4d256-prod-github-runner-207 kernel: [55760.572316] Call Trace: Aug 22 20:53:06 juju-e4d256-prod-github-runner-207 kernel: [55760.573253] Aug 22 20:53:06 juju-e4d256-prod-github-runner-207 kernel: [55760.574158] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:53:06 juju-e4d256-prod-github-runner-207 kernel: [55760.575199] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:53:06 juju-e4d256-prod-github-runner-207 kernel: [55760.576224] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:53:06 juju-e4d256-prod-github-runner-207 kernel: [55760.577313] ? show_regs.part.0+0x23/0x29 Aug 22 20:53:06 juju-e4d256-prod-github-runner-207 kernel: [55760.578337] ? show_regs.cold+0x8/0xd Aug 22 20:53:06 juju-e4d256-prod-github-runner-207 kernel: [55760.579322] ? watchdog_timer_fn+0x1be/0x220 Aug 22 20:53:06 juju-e4d256-prod-github-runner-207 kernel: [55760.580334] ? lockup_detector_update_enable+0x60/0x60 Aug 22 20:53:06 juju-e4d256-prod-github-runner-207 kernel: [55760.581400] ? __hrtimer_run_queues+0x107/0x230 Aug 22 20:53:06 juju-e4d256-prod-github-runner-207 kernel: [55760.582457] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 20:53:06 juju-e4d256-prod-github-runner-207 kernel: [55760.583506] ? hrtimer_interrupt+0x101/0x220 Aug 22 20:53:06 juju-e4d256-prod-github-runner-207 kernel: [55760.584529] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 20:53:06 juju-e4d256-prod-github-runner-207 kernel: [55760.585608] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 20:53:06 juju-e4d256-prod-github-runner-207 kernel: [55760.586668] Aug 22 20:53:06 juju-e4d256-prod-github-runner-207 kernel: [55760.587543] Aug 22 20:53:06 juju-e4d256-prod-github-runner-207 kernel: [55760.588402] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 20:53:06 juju-e4d256-prod-github-runner-207 kernel: [55760.589444] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:53:06 juju-e4d256-prod-github-runner-207 kernel: [55760.590496] ? _raw_spin_lock+0x22/0x30 Aug 22 20:53:06 juju-e4d256-prod-github-runner-207 kernel: [55760.591452] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:53:06 juju-e4d256-prod-github-runner-207 kernel: [55760.592482] direct_page_fault+0x206/0x310 [kvm] Aug 22 20:53:06 juju-e4d256-prod-github-runner-207 kernel: [55760.593512] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 20:53:06 juju-e4d256-prod-github-runner-207 kernel: [55760.594695] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 20:53:06 juju-e4d256-prod-github-runner-207 kernel: [55760.595717] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 20:53:06 juju-e4d256-prod-github-runner-207 kernel: [55760.596887] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 20:53:06 juju-e4d256-prod-github-runner-207 kernel: [55760.597865] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 20:53:06 juju-e4d256-prod-github-runner-207 kernel: [55760.598864] handle_exit+0x98/0x230 [kvm_amd] Aug 22 20:53:06 juju-e4d256-prod-github-runner-207 kernel: [55760.599765] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 20:53:06 juju-e4d256-prod-github-runner-207 kernel: [55760.600685] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 20:53:06 juju-e4d256-prod-github-runner-207 kernel: [55760.601619] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 20:53:06 juju-e4d256-prod-github-runner-207 kernel: [55760.602538] vcpu_run+0x62/0x2c0 [kvm] Aug 22 20:53:06 juju-e4d256-prod-github-runner-207 kernel: [55760.603361] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 20:53:06 juju-e4d256-prod-github-runner-207 kernel: [55760.604193] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 20:53:06 juju-e4d256-prod-github-runner-207 kernel: [55760.605056] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 20:53:06 juju-e4d256-prod-github-runner-207 kernel: [55760.605871] ? __seccomp_filter+0x4a/0x4a0 Aug 22 20:53:06 juju-e4d256-prod-github-runner-207 kernel: [55760.606621] ? __fget_files+0x86/0xc0 Aug 22 20:53:06 juju-e4d256-prod-github-runner-207 kernel: [55760.607334] __x64_sys_ioctl+0x95/0xd0 Aug 22 20:53:06 juju-e4d256-prod-github-runner-207 kernel: [55760.608038] do_syscall_64+0x5c/0xc0 Aug 22 20:53:06 juju-e4d256-prod-github-runner-207 kernel: [55760.608710] ? do_futex+0x162/0x1f0 Aug 22 20:53:06 juju-e4d256-prod-github-runner-207 kernel: [55760.609382] ? __x64_sys_futex+0x78/0x1e0 Aug 22 20:53:06 juju-e4d256-prod-github-runner-207 kernel: [55760.610073] ? __secure_computing+0xa9/0x120 Aug 22 20:53:06 juju-e4d256-prod-github-runner-207 kernel: [55760.610768] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 20:53:06 juju-e4d256-prod-github-runner-207 kernel: [55760.611539] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:53:06 juju-e4d256-prod-github-runner-207 kernel: [55760.612265] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:53:06 juju-e4d256-prod-github-runner-207 kernel: [55760.612987] ? do_syscall_64+0x69/0xc0 Aug 22 20:53:06 juju-e4d256-prod-github-runner-207 kernel: [55760.613650] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:53:06 juju-e4d256-prod-github-runner-207 kernel: [55760.614410] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:53:06 juju-e4d256-prod-github-runner-207 kernel: [55760.615120] ? do_syscall_64+0x69/0xc0 Aug 22 20:53:06 juju-e4d256-prod-github-runner-207 kernel: [55760.615758] ? do_syscall_64+0x69/0xc0 Aug 22 20:53:06 juju-e4d256-prod-github-runner-207 kernel: [55760.616387] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 20:53:06 juju-e4d256-prod-github-runner-207 kernel: [55760.617092] RIP: 0033:0x7faa5d0edaff Aug 22 20:53:06 juju-e4d256-prod-github-runner-207 kernel: [55760.617718] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 20:53:06 juju-e4d256-prod-github-runner-207 kernel: [55760.619741] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 20:53:06 juju-e4d256-prod-github-runner-207 kernel: [55760.620668] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 20:53:06 juju-e4d256-prod-github-runner-207 kernel: [55760.621564] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 20:53:06 juju-e4d256-prod-github-runner-207 kernel: [55760.622495] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 20:53:06 juju-e4d256-prod-github-runner-207 kernel: [55760.623392] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 20:53:06 juju-e4d256-prod-github-runner-207 kernel: [55760.624430] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 20:53:06 juju-e4d256-prod-github-runner-207 kernel: [55760.625403] Aug 22 20:53:34 juju-e4d256-prod-github-runner-207 kernel: [55788.541981] watchdog: BUG: soft lockup - CPU#1 stuck for 51849s! [qemu-system-x86:6715] Aug 22 20:53:34 juju-e4d256-prod-github-runner-207 kernel: [55788.543117] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 20:53:34 juju-e4d256-prod-github-runner-207 kernel: [55788.543192] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 20:53:34 juju-e4d256-prod-github-runner-207 kernel: [55788.555502] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 20:53:34 juju-e4d256-prod-github-runner-207 kernel: [55788.556768] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 20:53:34 juju-e4d256-prod-github-runner-207 kernel: [55788.557998] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:53:34 juju-e4d256-prod-github-runner-207 kernel: [55788.559054] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 20:53:34 juju-e4d256-prod-github-runner-207 kernel: [55788.561603] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 20:53:34 juju-e4d256-prod-github-runner-207 kernel: [55788.562643] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 20:53:34 juju-e4d256-prod-github-runner-207 kernel: [55788.563874] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 20:53:34 juju-e4d256-prod-github-runner-207 kernel: [55788.565055] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 20:53:34 juju-e4d256-prod-github-runner-207 kernel: [55788.566280] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 20:53:34 juju-e4d256-prod-github-runner-207 kernel: [55788.567478] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 20:53:34 juju-e4d256-prod-github-runner-207 kernel: [55788.568787] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 20:53:34 juju-e4d256-prod-github-runner-207 kernel: [55788.570048] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 20:53:34 juju-e4d256-prod-github-runner-207 kernel: [55788.571149] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 20:53:34 juju-e4d256-prod-github-runner-207 kernel: [55788.572348] Call Trace: Aug 22 20:53:34 juju-e4d256-prod-github-runner-207 kernel: [55788.573258] Aug 22 20:53:34 juju-e4d256-prod-github-runner-207 kernel: [55788.574194] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:53:34 juju-e4d256-prod-github-runner-207 kernel: [55788.575239] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:53:34 juju-e4d256-prod-github-runner-207 kernel: [55788.576266] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:53:34 juju-e4d256-prod-github-runner-207 kernel: [55788.577349] ? show_regs.part.0+0x23/0x29 Aug 22 20:53:34 juju-e4d256-prod-github-runner-207 kernel: [55788.578363] ? show_regs.cold+0x8/0xd Aug 22 20:53:34 juju-e4d256-prod-github-runner-207 kernel: [55788.579337] ? watchdog_timer_fn+0x1be/0x220 Aug 22 20:53:34 juju-e4d256-prod-github-runner-207 kernel: [55788.580357] ? lockup_detector_update_enable+0x60/0x60 Aug 22 20:53:34 juju-e4d256-prod-github-runner-207 kernel: [55788.581427] ? __hrtimer_run_queues+0x107/0x230 Aug 22 20:53:34 juju-e4d256-prod-github-runner-207 kernel: [55788.582473] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 20:53:34 juju-e4d256-prod-github-runner-207 kernel: [55788.583497] ? hrtimer_interrupt+0x101/0x220 Aug 22 20:53:34 juju-e4d256-prod-github-runner-207 kernel: [55788.584664] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 20:53:34 juju-e4d256-prod-github-runner-207 kernel: [55788.585756] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 20:53:34 juju-e4d256-prod-github-runner-207 kernel: [55788.586851] Aug 22 20:53:34 juju-e4d256-prod-github-runner-207 kernel: [55788.587713] Aug 22 20:53:34 juju-e4d256-prod-github-runner-207 kernel: [55788.588694] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 20:53:34 juju-e4d256-prod-github-runner-207 kernel: [55788.589759] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:53:34 juju-e4d256-prod-github-runner-207 kernel: [55788.590803] ? _raw_spin_lock+0x22/0x30 Aug 22 20:53:34 juju-e4d256-prod-github-runner-207 kernel: [55788.591748] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:53:34 juju-e4d256-prod-github-runner-207 kernel: [55788.592823] direct_page_fault+0x206/0x310 [kvm] Aug 22 20:53:34 juju-e4d256-prod-github-runner-207 kernel: [55788.593918] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 20:53:34 juju-e4d256-prod-github-runner-207 kernel: [55788.594944] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 20:53:34 juju-e4d256-prod-github-runner-207 kernel: [55788.595954] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 20:53:34 juju-e4d256-prod-github-runner-207 kernel: [55788.596978] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 20:53:34 juju-e4d256-prod-github-runner-207 kernel: [55788.597941] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 20:53:34 juju-e4d256-prod-github-runner-207 kernel: [55788.598919] handle_exit+0x98/0x230 [kvm_amd] Aug 22 20:53:34 juju-e4d256-prod-github-runner-207 kernel: [55788.599811] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 20:53:34 juju-e4d256-prod-github-runner-207 kernel: [55788.600727] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 20:53:34 juju-e4d256-prod-github-runner-207 kernel: [55788.601663] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 20:53:34 juju-e4d256-prod-github-runner-207 kernel: [55788.602568] vcpu_run+0x62/0x2c0 [kvm] Aug 22 20:53:34 juju-e4d256-prod-github-runner-207 kernel: [55788.603378] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 20:53:34 juju-e4d256-prod-github-runner-207 kernel: [55788.604188] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 20:53:34 juju-e4d256-prod-github-runner-207 kernel: [55788.605044] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 20:53:34 juju-e4d256-prod-github-runner-207 kernel: [55788.605861] ? __seccomp_filter+0x4a/0x4a0 Aug 22 20:53:34 juju-e4d256-prod-github-runner-207 kernel: [55788.606606] ? __fget_files+0x86/0xc0 Aug 22 20:53:34 juju-e4d256-prod-github-runner-207 kernel: [55788.607317] __x64_sys_ioctl+0x95/0xd0 Aug 22 20:53:34 juju-e4d256-prod-github-runner-207 kernel: [55788.608011] do_syscall_64+0x5c/0xc0 Aug 22 20:53:34 juju-e4d256-prod-github-runner-207 kernel: [55788.608678] ? do_futex+0x162/0x1f0 Aug 22 20:53:34 juju-e4d256-prod-github-runner-207 kernel: [55788.609329] ? __x64_sys_futex+0x78/0x1e0 Aug 22 20:53:34 juju-e4d256-prod-github-runner-207 kernel: [55788.610016] ? __secure_computing+0xa9/0x120 Aug 22 20:53:34 juju-e4d256-prod-github-runner-207 kernel: [55788.610709] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 20:53:34 juju-e4d256-prod-github-runner-207 kernel: [55788.611477] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:53:34 juju-e4d256-prod-github-runner-207 kernel: [55788.612206] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:53:34 juju-e4d256-prod-github-runner-207 kernel: [55788.612934] ? do_syscall_64+0x69/0xc0 Aug 22 20:53:34 juju-e4d256-prod-github-runner-207 kernel: [55788.613668] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:53:34 juju-e4d256-prod-github-runner-207 kernel: [55788.614378] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:53:34 juju-e4d256-prod-github-runner-207 kernel: [55788.615095] ? do_syscall_64+0x69/0xc0 Aug 22 20:53:34 juju-e4d256-prod-github-runner-207 kernel: [55788.615720] ? do_syscall_64+0x69/0xc0 Aug 22 20:53:34 juju-e4d256-prod-github-runner-207 kernel: [55788.616344] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 20:53:34 juju-e4d256-prod-github-runner-207 kernel: [55788.617049] RIP: 0033:0x7faa5d0edaff Aug 22 20:53:34 juju-e4d256-prod-github-runner-207 kernel: [55788.617692] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 20:53:34 juju-e4d256-prod-github-runner-207 kernel: [55788.619681] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 20:53:34 juju-e4d256-prod-github-runner-207 kernel: [55788.620597] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 20:53:34 juju-e4d256-prod-github-runner-207 kernel: [55788.621508] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 20:53:34 juju-e4d256-prod-github-runner-207 kernel: [55788.622399] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 20:53:34 juju-e4d256-prod-github-runner-207 kernel: [55788.623352] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 20:53:34 juju-e4d256-prod-github-runner-207 kernel: [55788.624246] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 20:53:34 juju-e4d256-prod-github-runner-207 kernel: [55788.625143] Aug 22 20:53:47 juju-e4d256-prod-github-runner-207 kernel: [55800.908706] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 20:53:47 juju-e4d256-prod-github-runner-207 kernel: [55800.909702] rcu: 1-....: (13877117 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=6707736 Aug 22 20:53:47 juju-e4d256-prod-github-runner-207 kernel: [55800.910838] (t=13920927 jiffies g=23269 q=51272) Aug 22 20:53:47 juju-e4d256-prod-github-runner-207 kernel: [55800.911636] NMI backtrace for cpu 1 Aug 22 20:53:47 juju-e4d256-prod-github-runner-207 kernel: [55800.912348] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 20:53:47 juju-e4d256-prod-github-runner-207 kernel: [55800.913468] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 20:53:47 juju-e4d256-prod-github-runner-207 kernel: [55800.914634] Call Trace: Aug 22 20:53:47 juju-e4d256-prod-github-runner-207 kernel: [55800.915312] Aug 22 20:53:47 juju-e4d256-prod-github-runner-207 kernel: [55800.915958] show_stack+0x52/0x5c Aug 22 20:53:47 juju-e4d256-prod-github-runner-207 kernel: [55800.916684] dump_stack_lvl+0x4a/0x63 Aug 22 20:53:47 juju-e4d256-prod-github-runner-207 kernel: [55800.917470] dump_stack+0x10/0x16 Aug 22 20:53:47 juju-e4d256-prod-github-runner-207 kernel: [55800.918192] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 20:53:47 juju-e4d256-prod-github-runner-207 kernel: [55800.918972] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 20:53:47 juju-e4d256-prod-github-runner-207 kernel: [55800.919769] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 20:53:47 juju-e4d256-prod-github-runner-207 kernel: [55800.920602] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 20:53:47 juju-e4d256-prod-github-runner-207 kernel: [55800.921442] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 20:53:47 juju-e4d256-prod-github-runner-207 kernel: [55800.922389] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 20:53:47 juju-e4d256-prod-github-runner-207 kernel: [55800.923257] print_cpu_stall.cold+0x2f/0xe2 Aug 22 20:53:47 juju-e4d256-prod-github-runner-207 kernel: [55800.924113] ? timekeeping_update+0xf7/0x150 Aug 22 20:53:47 juju-e4d256-prod-github-runner-207 kernel: [55800.924982] check_cpu_stall+0x109/0x270 Aug 22 20:53:47 juju-e4d256-prod-github-runner-207 kernel: [55800.925849] rcu_sched_clock_irq+0x9a/0x250 Aug 22 20:53:47 juju-e4d256-prod-github-runner-207 kernel: [55800.926711] update_process_times+0x94/0xd0 Aug 22 20:53:47 juju-e4d256-prod-github-runner-207 kernel: [55800.927569] tick_sched_handle+0x29/0x70 Aug 22 20:53:47 juju-e4d256-prod-github-runner-207 kernel: [55800.928400] tick_sched_timer+0x8c/0xc0 Aug 22 20:53:47 juju-e4d256-prod-github-runner-207 kernel: [55800.929220] ? tick_nohz_handler+0xb0/0xb0 Aug 22 20:53:47 juju-e4d256-prod-github-runner-207 kernel: [55800.930112] __hrtimer_run_queues+0x107/0x230 Aug 22 20:53:47 juju-e4d256-prod-github-runner-207 kernel: [55800.930980] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 20:53:47 juju-e4d256-prod-github-runner-207 kernel: [55800.931874] hrtimer_interrupt+0x101/0x220 Aug 22 20:53:47 juju-e4d256-prod-github-runner-207 kernel: [55800.932737] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 20:53:47 juju-e4d256-prod-github-runner-207 kernel: [55800.933696] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 20:53:47 juju-e4d256-prod-github-runner-207 kernel: [55800.934609] Aug 22 20:53:47 juju-e4d256-prod-github-runner-207 kernel: [55800.935291] Aug 22 20:53:47 juju-e4d256-prod-github-runner-207 kernel: [55800.935975] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 20:53:47 juju-e4d256-prod-github-runner-207 kernel: [55800.936900] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:53:47 juju-e4d256-prod-github-runner-207 kernel: [55800.938118] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 20:53:47 juju-e4d256-prod-github-runner-207 kernel: [55800.940566] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 20:53:47 juju-e4d256-prod-github-runner-207 kernel: [55800.941463] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 20:53:47 juju-e4d256-prod-github-runner-207 kernel: [55800.942459] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 20:53:47 juju-e4d256-prod-github-runner-207 kernel: [55800.943439] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 20:53:47 juju-e4d256-prod-github-runner-207 kernel: [55800.944402] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 20:53:47 juju-e4d256-prod-github-runner-207 kernel: [55800.945395] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 20:53:47 juju-e4d256-prod-github-runner-207 kernel: [55800.946355] ? _raw_spin_lock+0x22/0x30 Aug 22 20:53:47 juju-e4d256-prod-github-runner-207 kernel: [55800.947118] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:53:47 juju-e4d256-prod-github-runner-207 kernel: [55800.947955] direct_page_fault+0x206/0x310 [kvm] Aug 22 20:53:47 juju-e4d256-prod-github-runner-207 kernel: [55800.948827] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 20:53:47 juju-e4d256-prod-github-runner-207 kernel: [55800.949675] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 20:53:47 juju-e4d256-prod-github-runner-207 kernel: [55800.950501] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 20:53:47 juju-e4d256-prod-github-runner-207 kernel: [55800.951308] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 20:53:47 juju-e4d256-prod-github-runner-207 kernel: [55800.952093] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 20:53:47 juju-e4d256-prod-github-runner-207 kernel: [55800.952920] handle_exit+0x98/0x230 [kvm_amd] Aug 22 20:53:47 juju-e4d256-prod-github-runner-207 kernel: [55800.953679] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 20:53:47 juju-e4d256-prod-github-runner-207 kernel: [55800.954463] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 20:53:47 juju-e4d256-prod-github-runner-207 kernel: [55800.955262] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 20:53:47 juju-e4d256-prod-github-runner-207 kernel: [55800.956051] vcpu_run+0x62/0x2c0 [kvm] Aug 22 20:53:47 juju-e4d256-prod-github-runner-207 kernel: [55800.956767] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 20:53:47 juju-e4d256-prod-github-runner-207 kernel: [55800.957521] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 20:53:47 juju-e4d256-prod-github-runner-207 kernel: [55800.958324] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 20:53:47 juju-e4d256-prod-github-runner-207 kernel: [55800.959088] ? __seccomp_filter+0x4a/0x4a0 Aug 22 20:53:47 juju-e4d256-prod-github-runner-207 kernel: [55800.959826] ? __fget_files+0x86/0xc0 Aug 22 20:53:47 juju-e4d256-prod-github-runner-207 kernel: [55800.960536] __x64_sys_ioctl+0x95/0xd0 Aug 22 20:53:47 juju-e4d256-prod-github-runner-207 kernel: [55800.961231] do_syscall_64+0x5c/0xc0 Aug 22 20:53:47 juju-e4d256-prod-github-runner-207 kernel: [55800.961932] ? do_futex+0x162/0x1f0 Aug 22 20:53:47 juju-e4d256-prod-github-runner-207 kernel: [55800.962609] ? __x64_sys_futex+0x78/0x1e0 Aug 22 20:53:47 juju-e4d256-prod-github-runner-207 kernel: [55800.963309] ? __secure_computing+0xa9/0x120 Aug 22 20:53:47 juju-e4d256-prod-github-runner-207 kernel: [55800.964027] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 20:53:47 juju-e4d256-prod-github-runner-207 kernel: [55800.964825] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:53:47 juju-e4d256-prod-github-runner-207 kernel: [55800.965595] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:53:47 juju-e4d256-prod-github-runner-207 kernel: [55800.966350] ? do_syscall_64+0x69/0xc0 Aug 22 20:53:47 juju-e4d256-prod-github-runner-207 kernel: [55800.967038] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:53:47 juju-e4d256-prod-github-runner-207 kernel: [55800.967794] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:53:47 juju-e4d256-prod-github-runner-207 kernel: [55800.968550] ? do_syscall_64+0x69/0xc0 Aug 22 20:53:47 juju-e4d256-prod-github-runner-207 kernel: [55800.969245] ? do_syscall_64+0x69/0xc0 Aug 22 20:53:47 juju-e4d256-prod-github-runner-207 kernel: [55800.969950] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 20:53:47 juju-e4d256-prod-github-runner-207 kernel: [55800.970727] RIP: 0033:0x7faa5d0edaff Aug 22 20:53:47 juju-e4d256-prod-github-runner-207 kernel: [55800.971411] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 20:53:47 juju-e4d256-prod-github-runner-207 kernel: [55800.973532] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 20:53:47 juju-e4d256-prod-github-runner-207 kernel: [55800.974495] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 20:53:47 juju-e4d256-prod-github-runner-207 kernel: [55800.975461] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 20:53:47 juju-e4d256-prod-github-runner-207 kernel: [55800.976409] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 20:53:47 juju-e4d256-prod-github-runner-207 kernel: [55800.977368] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 20:53:47 juju-e4d256-prod-github-runner-207 kernel: [55800.978295] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 20:53:47 juju-e4d256-prod-github-runner-207 kernel: [55800.979206] Aug 22 20:54:14 juju-e4d256-prod-github-runner-207 kernel: [55828.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 51886s! [qemu-system-x86:6715] Aug 22 20:54:14 juju-e4d256-prod-github-runner-207 kernel: [55828.543888] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 20:54:14 juju-e4d256-prod-github-runner-207 kernel: [55828.544185] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 20:54:14 juju-e4d256-prod-github-runner-207 kernel: [55828.556545] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 20:54:14 juju-e4d256-prod-github-runner-207 kernel: [55828.557839] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 20:54:14 juju-e4d256-prod-github-runner-207 kernel: [55828.559090] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:54:14 juju-e4d256-prod-github-runner-207 kernel: [55828.560146] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 20:54:14 juju-e4d256-prod-github-runner-207 kernel: [55828.562718] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 20:54:14 juju-e4d256-prod-github-runner-207 kernel: [55828.563798] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 20:54:14 juju-e4d256-prod-github-runner-207 kernel: [55828.565012] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 20:54:14 juju-e4d256-prod-github-runner-207 kernel: [55828.566178] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 20:54:14 juju-e4d256-prod-github-runner-207 kernel: [55828.567413] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 20:54:14 juju-e4d256-prod-github-runner-207 kernel: [55828.568602] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 20:54:14 juju-e4d256-prod-github-runner-207 kernel: [55828.569801] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 20:54:14 juju-e4d256-prod-github-runner-207 kernel: [55828.571031] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 20:54:14 juju-e4d256-prod-github-runner-207 kernel: [55828.572134] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 20:54:14 juju-e4d256-prod-github-runner-207 kernel: [55828.573339] Call Trace: Aug 22 20:54:14 juju-e4d256-prod-github-runner-207 kernel: [55828.574255] Aug 22 20:54:14 juju-e4d256-prod-github-runner-207 kernel: [55828.575152] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:54:14 juju-e4d256-prod-github-runner-207 kernel: [55828.576309] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:54:14 juju-e4d256-prod-github-runner-207 kernel: [55828.577337] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:54:14 juju-e4d256-prod-github-runner-207 kernel: [55828.578624] ? show_regs.part.0+0x23/0x29 Aug 22 20:54:14 juju-e4d256-prod-github-runner-207 kernel: [55828.579649] ? show_regs.cold+0x8/0xd Aug 22 20:54:14 juju-e4d256-prod-github-runner-207 kernel: [55828.580641] ? watchdog_timer_fn+0x1be/0x220 Aug 22 20:54:14 juju-e4d256-prod-github-runner-207 kernel: [55828.581682] ? lockup_detector_update_enable+0x60/0x60 Aug 22 20:54:14 juju-e4d256-prod-github-runner-207 kernel: [55828.582762] ? __hrtimer_run_queues+0x107/0x230 Aug 22 20:54:14 juju-e4d256-prod-github-runner-207 kernel: [55828.583841] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 20:54:14 juju-e4d256-prod-github-runner-207 kernel: [55828.584903] ? hrtimer_interrupt+0x101/0x220 Aug 22 20:54:14 juju-e4d256-prod-github-runner-207 kernel: [55828.585956] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 20:54:14 juju-e4d256-prod-github-runner-207 kernel: [55828.587042] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 20:54:14 juju-e4d256-prod-github-runner-207 kernel: [55828.588117] Aug 22 20:54:14 juju-e4d256-prod-github-runner-207 kernel: [55828.588980] Aug 22 20:54:14 juju-e4d256-prod-github-runner-207 kernel: [55828.589934] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 20:54:14 juju-e4d256-prod-github-runner-207 kernel: [55828.590976] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:54:14 juju-e4d256-prod-github-runner-207 kernel: [55828.592010] ? _raw_spin_lock+0x22/0x30 Aug 22 20:54:14 juju-e4d256-prod-github-runner-207 kernel: [55828.592972] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:54:14 juju-e4d256-prod-github-runner-207 kernel: [55828.594018] direct_page_fault+0x206/0x310 [kvm] Aug 22 20:54:14 juju-e4d256-prod-github-runner-207 kernel: [55828.595047] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 20:54:14 juju-e4d256-prod-github-runner-207 kernel: [55828.596052] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 20:54:14 juju-e4d256-prod-github-runner-207 kernel: [55828.597066] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 20:54:14 juju-e4d256-prod-github-runner-207 kernel: [55828.598077] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 20:54:14 juju-e4d256-prod-github-runner-207 kernel: [55828.599029] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 20:54:14 juju-e4d256-prod-github-runner-207 kernel: [55828.600005] handle_exit+0x98/0x230 [kvm_amd] Aug 22 20:54:14 juju-e4d256-prod-github-runner-207 kernel: [55828.600896] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 20:54:14 juju-e4d256-prod-github-runner-207 kernel: [55828.601817] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 20:54:14 juju-e4d256-prod-github-runner-207 kernel: [55828.602739] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 20:54:14 juju-e4d256-prod-github-runner-207 kernel: [55828.603641] vcpu_run+0x62/0x2c0 [kvm] Aug 22 20:54:14 juju-e4d256-prod-github-runner-207 kernel: [55828.604450] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 20:54:14 juju-e4d256-prod-github-runner-207 kernel: [55828.605284] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 20:54:14 juju-e4d256-prod-github-runner-207 kernel: [55828.606138] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 20:54:14 juju-e4d256-prod-github-runner-207 kernel: [55828.606933] ? __seccomp_filter+0x4a/0x4a0 Aug 22 20:54:14 juju-e4d256-prod-github-runner-207 kernel: [55828.607687] ? __fget_files+0x86/0xc0 Aug 22 20:54:14 juju-e4d256-prod-github-runner-207 kernel: [55828.608399] __x64_sys_ioctl+0x95/0xd0 Aug 22 20:54:14 juju-e4d256-prod-github-runner-207 kernel: [55828.609099] do_syscall_64+0x5c/0xc0 Aug 22 20:54:14 juju-e4d256-prod-github-runner-207 kernel: [55828.609834] ? do_futex+0x162/0x1f0 Aug 22 20:54:14 juju-e4d256-prod-github-runner-207 kernel: [55828.610757] ? __x64_sys_futex+0x78/0x1e0 Aug 22 20:54:14 juju-e4d256-prod-github-runner-207 kernel: [55828.611453] ? __secure_computing+0xa9/0x120 Aug 22 20:54:14 juju-e4d256-prod-github-runner-207 kernel: [55828.612159] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 20:54:14 juju-e4d256-prod-github-runner-207 kernel: [55828.612932] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:54:14 juju-e4d256-prod-github-runner-207 kernel: [55828.613665] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:54:14 juju-e4d256-prod-github-runner-207 kernel: [55828.614401] ? do_syscall_64+0x69/0xc0 Aug 22 20:54:14 juju-e4d256-prod-github-runner-207 kernel: [55828.615057] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:54:14 juju-e4d256-prod-github-runner-207 kernel: [55828.615763] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:54:14 juju-e4d256-prod-github-runner-207 kernel: [55828.616471] ? do_syscall_64+0x69/0xc0 Aug 22 20:54:14 juju-e4d256-prod-github-runner-207 kernel: [55828.617154] ? do_syscall_64+0x69/0xc0 Aug 22 20:54:14 juju-e4d256-prod-github-runner-207 kernel: [55828.617801] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 20:54:14 juju-e4d256-prod-github-runner-207 kernel: [55828.618539] RIP: 0033:0x7faa5d0edaff Aug 22 20:54:14 juju-e4d256-prod-github-runner-207 kernel: [55828.619237] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 20:54:14 juju-e4d256-prod-github-runner-207 kernel: [55828.621392] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 20:54:14 juju-e4d256-prod-github-runner-207 kernel: [55828.622325] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 20:54:14 juju-e4d256-prod-github-runner-207 kernel: [55828.623215] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 20:54:14 juju-e4d256-prod-github-runner-207 kernel: [55828.624107] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 20:54:14 juju-e4d256-prod-github-runner-207 kernel: [55828.625008] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 20:54:14 juju-e4d256-prod-github-runner-207 kernel: [55828.625895] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 20:54:14 juju-e4d256-prod-github-runner-207 kernel: [55828.626820] Aug 22 20:54:42 juju-e4d256-prod-github-runner-207 kernel: [55856.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 51912s! [qemu-system-x86:6715] Aug 22 20:54:42 juju-e4d256-prod-github-runner-207 kernel: [55856.543270] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 20:54:42 juju-e4d256-prod-github-runner-207 kernel: [55856.543343] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 20:54:42 juju-e4d256-prod-github-runner-207 kernel: [55856.557382] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 20:54:42 juju-e4d256-prod-github-runner-207 kernel: [55856.558837] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 20:54:42 juju-e4d256-prod-github-runner-207 kernel: [55856.560213] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:54:42 juju-e4d256-prod-github-runner-207 kernel: [55856.561400] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 20:54:42 juju-e4d256-prod-github-runner-207 kernel: [55856.564287] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 20:54:42 juju-e4d256-prod-github-runner-207 kernel: [55856.565455] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 20:54:42 juju-e4d256-prod-github-runner-207 kernel: [55856.566757] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 20:54:42 juju-e4d256-prod-github-runner-207 kernel: [55856.568062] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 20:54:42 juju-e4d256-prod-github-runner-207 kernel: [55856.569569] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 20:54:42 juju-e4d256-prod-github-runner-207 kernel: [55856.570867] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 20:54:42 juju-e4d256-prod-github-runner-207 kernel: [55856.572354] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 20:54:42 juju-e4d256-prod-github-runner-207 kernel: [55856.573774] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 20:54:42 juju-e4d256-prod-github-runner-207 kernel: [55856.574987] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 20:54:42 juju-e4d256-prod-github-runner-207 kernel: [55856.576322] Call Trace: Aug 22 20:54:42 juju-e4d256-prod-github-runner-207 kernel: [55856.577377] Aug 22 20:54:42 juju-e4d256-prod-github-runner-207 kernel: [55856.578339] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:54:42 juju-e4d256-prod-github-runner-207 kernel: [55856.579462] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:54:42 juju-e4d256-prod-github-runner-207 kernel: [55856.580579] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:54:42 juju-e4d256-prod-github-runner-207 kernel: [55856.581788] ? show_regs.part.0+0x23/0x29 Aug 22 20:54:42 juju-e4d256-prod-github-runner-207 kernel: [55856.582874] ? show_regs.cold+0x8/0xd Aug 22 20:54:42 juju-e4d256-prod-github-runner-207 kernel: [55856.583929] ? watchdog_timer_fn+0x1be/0x220 Aug 22 20:54:42 juju-e4d256-prod-github-runner-207 kernel: [55856.585055] ? lockup_detector_update_enable+0x60/0x60 Aug 22 20:54:42 juju-e4d256-prod-github-runner-207 kernel: [55856.586225] ? __hrtimer_run_queues+0x107/0x230 Aug 22 20:54:42 juju-e4d256-prod-github-runner-207 kernel: [55856.587358] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 20:54:42 juju-e4d256-prod-github-runner-207 kernel: [55856.588479] ? hrtimer_interrupt+0x101/0x220 Aug 22 20:54:42 juju-e4d256-prod-github-runner-207 kernel: [55856.589630] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 20:54:42 juju-e4d256-prod-github-runner-207 kernel: [55856.590808] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 20:54:42 juju-e4d256-prod-github-runner-207 kernel: [55856.591965] Aug 22 20:54:42 juju-e4d256-prod-github-runner-207 kernel: [55856.592903] Aug 22 20:54:42 juju-e4d256-prod-github-runner-207 kernel: [55856.593793] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 20:54:42 juju-e4d256-prod-github-runner-207 kernel: [55856.594963] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:54:42 juju-e4d256-prod-github-runner-207 kernel: [55856.596044] ? _raw_spin_lock+0x22/0x30 Aug 22 20:54:42 juju-e4d256-prod-github-runner-207 kernel: [55856.597026] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:54:42 juju-e4d256-prod-github-runner-207 kernel: [55856.598056] direct_page_fault+0x206/0x310 [kvm] Aug 22 20:54:42 juju-e4d256-prod-github-runner-207 kernel: [55856.599089] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 20:54:42 juju-e4d256-prod-github-runner-207 kernel: [55856.600103] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 20:54:42 juju-e4d256-prod-github-runner-207 kernel: [55856.601134] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 20:54:42 juju-e4d256-prod-github-runner-207 kernel: [55856.602115] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 20:54:42 juju-e4d256-prod-github-runner-207 kernel: [55856.603067] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 20:54:42 juju-e4d256-prod-github-runner-207 kernel: [55856.604056] handle_exit+0x98/0x230 [kvm_amd] Aug 22 20:54:42 juju-e4d256-prod-github-runner-207 kernel: [55856.604977] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 20:54:42 juju-e4d256-prod-github-runner-207 kernel: [55856.605897] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 20:54:42 juju-e4d256-prod-github-runner-207 kernel: [55856.606823] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 20:54:42 juju-e4d256-prod-github-runner-207 kernel: [55856.607727] vcpu_run+0x62/0x2c0 [kvm] Aug 22 20:54:42 juju-e4d256-prod-github-runner-207 kernel: [55856.608540] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 20:54:42 juju-e4d256-prod-github-runner-207 kernel: [55856.609370] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 20:54:42 juju-e4d256-prod-github-runner-207 kernel: [55856.610227] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 20:54:42 juju-e4d256-prod-github-runner-207 kernel: [55856.611026] ? __seccomp_filter+0x4a/0x4a0 Aug 22 20:54:42 juju-e4d256-prod-github-runner-207 kernel: [55856.611771] ? __fget_files+0x86/0xc0 Aug 22 20:54:42 juju-e4d256-prod-github-runner-207 kernel: [55856.612516] __x64_sys_ioctl+0x95/0xd0 Aug 22 20:54:42 juju-e4d256-prod-github-runner-207 kernel: [55856.613249] do_syscall_64+0x5c/0xc0 Aug 22 20:54:42 juju-e4d256-prod-github-runner-207 kernel: [55856.613922] ? do_futex+0x162/0x1f0 Aug 22 20:54:42 juju-e4d256-prod-github-runner-207 kernel: [55856.614571] ? __x64_sys_futex+0x78/0x1e0 Aug 22 20:54:42 juju-e4d256-prod-github-runner-207 kernel: [55856.615258] ? __secure_computing+0xa9/0x120 Aug 22 20:54:42 juju-e4d256-prod-github-runner-207 kernel: [55856.615956] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 20:54:42 juju-e4d256-prod-github-runner-207 kernel: [55856.616748] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:54:42 juju-e4d256-prod-github-runner-207 kernel: [55856.617472] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:54:42 juju-e4d256-prod-github-runner-207 kernel: [55856.618190] ? do_syscall_64+0x69/0xc0 Aug 22 20:54:42 juju-e4d256-prod-github-runner-207 kernel: [55856.618865] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:54:42 juju-e4d256-prod-github-runner-207 kernel: [55856.619570] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:54:42 juju-e4d256-prod-github-runner-207 kernel: [55856.620286] ? do_syscall_64+0x69/0xc0 Aug 22 20:54:42 juju-e4d256-prod-github-runner-207 kernel: [55856.620946] ? do_syscall_64+0x69/0xc0 Aug 22 20:54:42 juju-e4d256-prod-github-runner-207 kernel: [55856.621615] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 20:54:42 juju-e4d256-prod-github-runner-207 kernel: [55856.622323] RIP: 0033:0x7faa5d0edaff Aug 22 20:54:42 juju-e4d256-prod-github-runner-207 kernel: [55856.622949] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 20:54:42 juju-e4d256-prod-github-runner-207 kernel: [55856.625001] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 20:54:42 juju-e4d256-prod-github-runner-207 kernel: [55856.625922] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 20:54:42 juju-e4d256-prod-github-runner-207 kernel: [55856.626812] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 20:54:42 juju-e4d256-prod-github-runner-207 kernel: [55856.627704] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 20:54:42 juju-e4d256-prod-github-runner-207 kernel: [55856.628626] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 20:54:42 juju-e4d256-prod-github-runner-207 kernel: [55856.629541] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 20:54:42 juju-e4d256-prod-github-runner-207 kernel: [55856.630464] Aug 22 20:55:10 juju-e4d256-prod-github-runner-207 kernel: [55884.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 51938s! [qemu-system-x86:6715] Aug 22 20:55:10 juju-e4d256-prod-github-runner-207 kernel: [55884.543260] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 20:55:10 juju-e4d256-prod-github-runner-207 kernel: [55884.543344] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 20:55:10 juju-e4d256-prod-github-runner-207 kernel: [55884.556050] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 20:55:10 juju-e4d256-prod-github-runner-207 kernel: [55884.557351] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 20:55:10 juju-e4d256-prod-github-runner-207 kernel: [55884.558589] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:55:10 juju-e4d256-prod-github-runner-207 kernel: [55884.559666] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 20:55:10 juju-e4d256-prod-github-runner-207 kernel: [55884.562356] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 20:55:10 juju-e4d256-prod-github-runner-207 kernel: [55884.563418] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 20:55:10 juju-e4d256-prod-github-runner-207 kernel: [55884.564613] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 20:55:10 juju-e4d256-prod-github-runner-207 kernel: [55884.565782] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 20:55:10 juju-e4d256-prod-github-runner-207 kernel: [55884.566950] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 20:55:10 juju-e4d256-prod-github-runner-207 kernel: [55884.568115] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 20:55:10 juju-e4d256-prod-github-runner-207 kernel: [55884.569297] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 20:55:10 juju-e4d256-prod-github-runner-207 kernel: [55884.570646] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 20:55:10 juju-e4d256-prod-github-runner-207 kernel: [55884.571818] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 20:55:10 juju-e4d256-prod-github-runner-207 kernel: [55884.573289] Call Trace: Aug 22 20:55:10 juju-e4d256-prod-github-runner-207 kernel: [55884.574208] Aug 22 20:55:10 juju-e4d256-prod-github-runner-207 kernel: [55884.575095] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:55:10 juju-e4d256-prod-github-runner-207 kernel: [55884.576133] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:55:10 juju-e4d256-prod-github-runner-207 kernel: [55884.577197] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:55:10 juju-e4d256-prod-github-runner-207 kernel: [55884.578276] ? show_regs.part.0+0x23/0x29 Aug 22 20:55:10 juju-e4d256-prod-github-runner-207 kernel: [55884.579289] ? show_regs.cold+0x8/0xd Aug 22 20:55:10 juju-e4d256-prod-github-runner-207 kernel: [55884.580361] ? watchdog_timer_fn+0x1be/0x220 Aug 22 20:55:10 juju-e4d256-prod-github-runner-207 kernel: [55884.581390] ? lockup_detector_update_enable+0x60/0x60 Aug 22 20:55:10 juju-e4d256-prod-github-runner-207 kernel: [55884.582466] ? __hrtimer_run_queues+0x107/0x230 Aug 22 20:55:10 juju-e4d256-prod-github-runner-207 kernel: [55884.583520] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 20:55:10 juju-e4d256-prod-github-runner-207 kernel: [55884.584865] ? hrtimer_interrupt+0x101/0x220 Aug 22 20:55:10 juju-e4d256-prod-github-runner-207 kernel: [55884.585893] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 20:55:10 juju-e4d256-prod-github-runner-207 kernel: [55884.586961] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 20:55:10 juju-e4d256-prod-github-runner-207 kernel: [55884.588006] Aug 22 20:55:10 juju-e4d256-prod-github-runner-207 kernel: [55884.588897] Aug 22 20:55:10 juju-e4d256-prod-github-runner-207 kernel: [55884.589773] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 20:55:10 juju-e4d256-prod-github-runner-207 kernel: [55884.590847] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:55:10 juju-e4d256-prod-github-runner-207 kernel: [55884.591935] ? _raw_spin_lock+0x22/0x30 Aug 22 20:55:10 juju-e4d256-prod-github-runner-207 kernel: [55884.592980] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:55:10 juju-e4d256-prod-github-runner-207 kernel: [55884.594041] direct_page_fault+0x206/0x310 [kvm] Aug 22 20:55:10 juju-e4d256-prod-github-runner-207 kernel: [55884.595078] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 20:55:10 juju-e4d256-prod-github-runner-207 kernel: [55884.596130] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 20:55:10 juju-e4d256-prod-github-runner-207 kernel: [55884.597166] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 20:55:10 juju-e4d256-prod-github-runner-207 kernel: [55884.598144] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 20:55:10 juju-e4d256-prod-github-runner-207 kernel: [55884.599103] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 20:55:10 juju-e4d256-prod-github-runner-207 kernel: [55884.600084] handle_exit+0x98/0x230 [kvm_amd] Aug 22 20:55:10 juju-e4d256-prod-github-runner-207 kernel: [55884.601002] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 20:55:10 juju-e4d256-prod-github-runner-207 kernel: [55884.601959] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 20:55:10 juju-e4d256-prod-github-runner-207 kernel: [55884.602910] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 20:55:10 juju-e4d256-prod-github-runner-207 kernel: [55884.603824] vcpu_run+0x62/0x2c0 [kvm] Aug 22 20:55:10 juju-e4d256-prod-github-runner-207 kernel: [55884.604768] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 20:55:10 juju-e4d256-prod-github-runner-207 kernel: [55884.605675] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 20:55:10 juju-e4d256-prod-github-runner-207 kernel: [55884.606544] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 20:55:10 juju-e4d256-prod-github-runner-207 kernel: [55884.607366] ? __seccomp_filter+0x4a/0x4a0 Aug 22 20:55:10 juju-e4d256-prod-github-runner-207 kernel: [55884.608126] ? __fget_files+0x86/0xc0 Aug 22 20:55:10 juju-e4d256-prod-github-runner-207 kernel: [55884.608869] __x64_sys_ioctl+0x95/0xd0 Aug 22 20:55:10 juju-e4d256-prod-github-runner-207 kernel: [55884.609569] do_syscall_64+0x5c/0xc0 Aug 22 20:55:10 juju-e4d256-prod-github-runner-207 kernel: [55884.610234] ? do_futex+0x162/0x1f0 Aug 22 20:55:10 juju-e4d256-prod-github-runner-207 kernel: [55884.610882] ? __x64_sys_futex+0x78/0x1e0 Aug 22 20:55:10 juju-e4d256-prod-github-runner-207 kernel: [55884.611560] ? __secure_computing+0xa9/0x120 Aug 22 20:55:10 juju-e4d256-prod-github-runner-207 kernel: [55884.612249] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 20:55:10 juju-e4d256-prod-github-runner-207 kernel: [55884.613037] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:55:10 juju-e4d256-prod-github-runner-207 kernel: [55884.613765] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:55:10 juju-e4d256-prod-github-runner-207 kernel: [55884.614483] ? do_syscall_64+0x69/0xc0 Aug 22 20:55:10 juju-e4d256-prod-github-runner-207 kernel: [55884.615128] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:55:10 juju-e4d256-prod-github-runner-207 kernel: [55884.615898] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:55:10 juju-e4d256-prod-github-runner-207 kernel: [55884.616692] ? do_syscall_64+0x69/0xc0 Aug 22 20:55:10 juju-e4d256-prod-github-runner-207 kernel: [55884.617322] ? do_syscall_64+0x69/0xc0 Aug 22 20:55:10 juju-e4d256-prod-github-runner-207 kernel: [55884.617961] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 20:55:10 juju-e4d256-prod-github-runner-207 kernel: [55884.618684] RIP: 0033:0x7faa5d0edaff Aug 22 20:55:10 juju-e4d256-prod-github-runner-207 kernel: [55884.619316] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 20:55:10 juju-e4d256-prod-github-runner-207 kernel: [55884.621324] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 20:55:10 juju-e4d256-prod-github-runner-207 kernel: [55884.622238] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 20:55:10 juju-e4d256-prod-github-runner-207 kernel: [55884.623134] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 20:55:10 juju-e4d256-prod-github-runner-207 kernel: [55884.624029] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 20:55:10 juju-e4d256-prod-github-runner-207 kernel: [55884.625038] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 20:55:10 juju-e4d256-prod-github-runner-207 kernel: [55884.625958] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 20:55:10 juju-e4d256-prod-github-runner-207 kernel: [55884.626857] Aug 22 20:55:38 juju-e4d256-prod-github-runner-207 kernel: [55912.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 51964s! [qemu-system-x86:6715] Aug 22 20:55:38 juju-e4d256-prod-github-runner-207 kernel: [55912.543889] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 20:55:38 juju-e4d256-prod-github-runner-207 kernel: [55912.544211] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 20:55:38 juju-e4d256-prod-github-runner-207 kernel: [55912.556436] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 20:55:38 juju-e4d256-prod-github-runner-207 kernel: [55912.557704] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 20:55:38 juju-e4d256-prod-github-runner-207 kernel: [55912.558925] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:55:38 juju-e4d256-prod-github-runner-207 kernel: [55912.560016] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 20:55:38 juju-e4d256-prod-github-runner-207 kernel: [55912.562571] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 20:55:38 juju-e4d256-prod-github-runner-207 kernel: [55912.563614] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 20:55:38 juju-e4d256-prod-github-runner-207 kernel: [55912.564792] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 20:55:38 juju-e4d256-prod-github-runner-207 kernel: [55912.566015] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 20:55:38 juju-e4d256-prod-github-runner-207 kernel: [55912.567178] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 20:55:38 juju-e4d256-prod-github-runner-207 kernel: [55912.568349] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 20:55:38 juju-e4d256-prod-github-runner-207 kernel: [55912.569520] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 20:55:38 juju-e4d256-prod-github-runner-207 kernel: [55912.570760] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 20:55:38 juju-e4d256-prod-github-runner-207 kernel: [55912.571857] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 20:55:38 juju-e4d256-prod-github-runner-207 kernel: [55912.573059] Call Trace: Aug 22 20:55:38 juju-e4d256-prod-github-runner-207 kernel: [55912.573969] Aug 22 20:55:38 juju-e4d256-prod-github-runner-207 kernel: [55912.574863] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:55:38 juju-e4d256-prod-github-runner-207 kernel: [55912.575990] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:55:38 juju-e4d256-prod-github-runner-207 kernel: [55912.577356] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:55:38 juju-e4d256-prod-github-runner-207 kernel: [55912.578711] ? show_regs.part.0+0x23/0x29 Aug 22 20:55:38 juju-e4d256-prod-github-runner-207 kernel: [55912.579721] ? show_regs.cold+0x8/0xd Aug 22 20:55:38 juju-e4d256-prod-github-runner-207 kernel: [55912.580713] ? watchdog_timer_fn+0x1be/0x220 Aug 22 20:55:38 juju-e4d256-prod-github-runner-207 kernel: [55912.581729] ? lockup_detector_update_enable+0x60/0x60 Aug 22 20:55:38 juju-e4d256-prod-github-runner-207 kernel: [55912.582794] ? __hrtimer_run_queues+0x107/0x230 Aug 22 20:55:38 juju-e4d256-prod-github-runner-207 kernel: [55912.583821] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 20:55:38 juju-e4d256-prod-github-runner-207 kernel: [55912.584865] ? hrtimer_interrupt+0x101/0x220 Aug 22 20:55:38 juju-e4d256-prod-github-runner-207 kernel: [55912.585987] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 20:55:38 juju-e4d256-prod-github-runner-207 kernel: [55912.587186] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 20:55:38 juju-e4d256-prod-github-runner-207 kernel: [55912.588263] Aug 22 20:55:38 juju-e4d256-prod-github-runner-207 kernel: [55912.589147] Aug 22 20:55:38 juju-e4d256-prod-github-runner-207 kernel: [55912.589984] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 20:55:38 juju-e4d256-prod-github-runner-207 kernel: [55912.591017] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:55:38 juju-e4d256-prod-github-runner-207 kernel: [55912.592072] ? _raw_spin_lock+0x22/0x30 Aug 22 20:55:38 juju-e4d256-prod-github-runner-207 kernel: [55912.593018] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:55:38 juju-e4d256-prod-github-runner-207 kernel: [55912.594061] direct_page_fault+0x206/0x310 [kvm] Aug 22 20:55:38 juju-e4d256-prod-github-runner-207 kernel: [55912.595090] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 20:55:38 juju-e4d256-prod-github-runner-207 kernel: [55912.596123] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 20:55:38 juju-e4d256-prod-github-runner-207 kernel: [55912.597129] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 20:55:38 juju-e4d256-prod-github-runner-207 kernel: [55912.598147] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 20:55:38 juju-e4d256-prod-github-runner-207 kernel: [55912.599091] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 20:55:38 juju-e4d256-prod-github-runner-207 kernel: [55912.600076] handle_exit+0x98/0x230 [kvm_amd] Aug 22 20:55:38 juju-e4d256-prod-github-runner-207 kernel: [55912.600999] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 20:55:38 juju-e4d256-prod-github-runner-207 kernel: [55912.601927] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 20:55:38 juju-e4d256-prod-github-runner-207 kernel: [55912.602914] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 20:55:38 juju-e4d256-prod-github-runner-207 kernel: [55912.603847] vcpu_run+0x62/0x2c0 [kvm] Aug 22 20:55:38 juju-e4d256-prod-github-runner-207 kernel: [55912.604697] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 20:55:38 juju-e4d256-prod-github-runner-207 kernel: [55912.605541] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 20:55:38 juju-e4d256-prod-github-runner-207 kernel: [55912.606397] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 20:55:38 juju-e4d256-prod-github-runner-207 kernel: [55912.607195] ? __seccomp_filter+0x4a/0x4a0 Aug 22 20:55:38 juju-e4d256-prod-github-runner-207 kernel: [55912.607945] ? __fget_files+0x86/0xc0 Aug 22 20:55:38 juju-e4d256-prod-github-runner-207 kernel: [55912.608660] __x64_sys_ioctl+0x95/0xd0 Aug 22 20:55:38 juju-e4d256-prod-github-runner-207 kernel: [55912.609350] do_syscall_64+0x5c/0xc0 Aug 22 20:55:38 juju-e4d256-prod-github-runner-207 kernel: [55912.610013] ? do_futex+0x162/0x1f0 Aug 22 20:55:38 juju-e4d256-prod-github-runner-207 kernel: [55912.610664] ? __x64_sys_futex+0x78/0x1e0 Aug 22 20:55:38 juju-e4d256-prod-github-runner-207 kernel: [55912.611332] ? __secure_computing+0xa9/0x120 Aug 22 20:55:38 juju-e4d256-prod-github-runner-207 kernel: [55912.612040] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 20:55:38 juju-e4d256-prod-github-runner-207 kernel: [55912.612796] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:55:38 juju-e4d256-prod-github-runner-207 kernel: [55912.613513] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:55:38 juju-e4d256-prod-github-runner-207 kernel: [55912.614226] ? do_syscall_64+0x69/0xc0 Aug 22 20:55:38 juju-e4d256-prod-github-runner-207 kernel: [55912.614867] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:55:38 juju-e4d256-prod-github-runner-207 kernel: [55912.615565] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:55:38 juju-e4d256-prod-github-runner-207 kernel: [55912.616271] ? do_syscall_64+0x69/0xc0 Aug 22 20:55:38 juju-e4d256-prod-github-runner-207 kernel: [55912.616893] ? do_syscall_64+0x69/0xc0 Aug 22 20:55:38 juju-e4d256-prod-github-runner-207 kernel: [55912.617544] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 20:55:38 juju-e4d256-prod-github-runner-207 kernel: [55912.618250] RIP: 0033:0x7faa5d0edaff Aug 22 20:55:38 juju-e4d256-prod-github-runner-207 kernel: [55912.618904] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 20:55:38 juju-e4d256-prod-github-runner-207 kernel: [55912.621037] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 20:55:38 juju-e4d256-prod-github-runner-207 kernel: [55912.621961] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 20:55:38 juju-e4d256-prod-github-runner-207 kernel: [55912.622858] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 20:55:38 juju-e4d256-prod-github-runner-207 kernel: [55912.623838] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 20:55:38 juju-e4d256-prod-github-runner-207 kernel: [55912.624744] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 20:55:38 juju-e4d256-prod-github-runner-207 kernel: [55912.625637] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 20:55:38 juju-e4d256-prod-github-runner-207 kernel: [55912.626529] Aug 22 20:56:06 juju-e4d256-prod-github-runner-207 kernel: [55940.541976] watchdog: BUG: soft lockup - CPU#1 stuck for 51990s! [qemu-system-x86:6715] Aug 22 20:56:06 juju-e4d256-prod-github-runner-207 kernel: [55940.543074] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 20:56:06 juju-e4d256-prod-github-runner-207 kernel: [55940.543144] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 20:56:06 juju-e4d256-prod-github-runner-207 kernel: [55940.555856] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 20:56:06 juju-e4d256-prod-github-runner-207 kernel: [55940.557125] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 20:56:06 juju-e4d256-prod-github-runner-207 kernel: [55940.558368] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:56:06 juju-e4d256-prod-github-runner-207 kernel: [55940.559427] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 20:56:06 juju-e4d256-prod-github-runner-207 kernel: [55940.562018] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 20:56:06 juju-e4d256-prod-github-runner-207 kernel: [55940.563064] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 20:56:06 juju-e4d256-prod-github-runner-207 kernel: [55940.564489] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 20:56:06 juju-e4d256-prod-github-runner-207 kernel: [55940.565658] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 20:56:06 juju-e4d256-prod-github-runner-207 kernel: [55940.566831] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 20:56:06 juju-e4d256-prod-github-runner-207 kernel: [55940.568012] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 20:56:06 juju-e4d256-prod-github-runner-207 kernel: [55940.569256] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 20:56:06 juju-e4d256-prod-github-runner-207 kernel: [55940.570527] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 20:56:06 juju-e4d256-prod-github-runner-207 kernel: [55940.571707] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 20:56:06 juju-e4d256-prod-github-runner-207 kernel: [55940.572907] Call Trace: Aug 22 20:56:06 juju-e4d256-prod-github-runner-207 kernel: [55940.573817] Aug 22 20:56:06 juju-e4d256-prod-github-runner-207 kernel: [55940.574698] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:56:06 juju-e4d256-prod-github-runner-207 kernel: [55940.575745] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:56:06 juju-e4d256-prod-github-runner-207 kernel: [55940.576768] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:56:06 juju-e4d256-prod-github-runner-207 kernel: [55940.577977] ? show_regs.part.0+0x23/0x29 Aug 22 20:56:06 juju-e4d256-prod-github-runner-207 kernel: [55940.578986] ? show_regs.cold+0x8/0xd Aug 22 20:56:06 juju-e4d256-prod-github-runner-207 kernel: [55940.580003] ? watchdog_timer_fn+0x1be/0x220 Aug 22 20:56:06 juju-e4d256-prod-github-runner-207 kernel: [55940.581014] ? lockup_detector_update_enable+0x60/0x60 Aug 22 20:56:06 juju-e4d256-prod-github-runner-207 kernel: [55940.582087] ? __hrtimer_run_queues+0x107/0x230 Aug 22 20:56:06 juju-e4d256-prod-github-runner-207 kernel: [55940.583135] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 20:56:06 juju-e4d256-prod-github-runner-207 kernel: [55940.584187] ? hrtimer_interrupt+0x101/0x220 Aug 22 20:56:06 juju-e4d256-prod-github-runner-207 kernel: [55940.585203] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 20:56:06 juju-e4d256-prod-github-runner-207 kernel: [55940.586273] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 20:56:06 juju-e4d256-prod-github-runner-207 kernel: [55940.587321] Aug 22 20:56:06 juju-e4d256-prod-github-runner-207 kernel: [55940.588210] Aug 22 20:56:06 juju-e4d256-prod-github-runner-207 kernel: [55940.589095] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 20:56:06 juju-e4d256-prod-github-runner-207 kernel: [55940.590154] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:56:06 juju-e4d256-prod-github-runner-207 kernel: [55940.591219] ? _raw_spin_lock+0x22/0x30 Aug 22 20:56:06 juju-e4d256-prod-github-runner-207 kernel: [55940.592220] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:56:06 juju-e4d256-prod-github-runner-207 kernel: [55940.593244] direct_page_fault+0x206/0x310 [kvm] Aug 22 20:56:06 juju-e4d256-prod-github-runner-207 kernel: [55940.594288] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 20:56:06 juju-e4d256-prod-github-runner-207 kernel: [55940.595294] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 20:56:06 juju-e4d256-prod-github-runner-207 kernel: [55940.596314] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 20:56:06 juju-e4d256-prod-github-runner-207 kernel: [55940.597283] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 20:56:06 juju-e4d256-prod-github-runner-207 kernel: [55940.598228] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 20:56:06 juju-e4d256-prod-github-runner-207 kernel: [55940.599208] handle_exit+0x98/0x230 [kvm_amd] Aug 22 20:56:06 juju-e4d256-prod-github-runner-207 kernel: [55940.600119] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 20:56:06 juju-e4d256-prod-github-runner-207 kernel: [55940.601039] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 20:56:06 juju-e4d256-prod-github-runner-207 kernel: [55940.601961] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 20:56:06 juju-e4d256-prod-github-runner-207 kernel: [55940.602865] vcpu_run+0x62/0x2c0 [kvm] Aug 22 20:56:06 juju-e4d256-prod-github-runner-207 kernel: [55940.603689] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 20:56:06 juju-e4d256-prod-github-runner-207 kernel: [55940.604496] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 20:56:06 juju-e4d256-prod-github-runner-207 kernel: [55940.605348] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 20:56:06 juju-e4d256-prod-github-runner-207 kernel: [55940.606144] ? __seccomp_filter+0x4a/0x4a0 Aug 22 20:56:06 juju-e4d256-prod-github-runner-207 kernel: [55940.606897] ? __fget_files+0x86/0xc0 Aug 22 20:56:06 juju-e4d256-prod-github-runner-207 kernel: [55940.607599] __x64_sys_ioctl+0x95/0xd0 Aug 22 20:56:06 juju-e4d256-prod-github-runner-207 kernel: [55940.608310] do_syscall_64+0x5c/0xc0 Aug 22 20:56:06 juju-e4d256-prod-github-runner-207 kernel: [55940.608976] ? do_futex+0x162/0x1f0 Aug 22 20:56:06 juju-e4d256-prod-github-runner-207 kernel: [55940.609623] ? __x64_sys_futex+0x78/0x1e0 Aug 22 20:56:06 juju-e4d256-prod-github-runner-207 kernel: [55940.610297] ? __secure_computing+0xa9/0x120 Aug 22 20:56:06 juju-e4d256-prod-github-runner-207 kernel: [55940.610991] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 20:56:06 juju-e4d256-prod-github-runner-207 kernel: [55940.611764] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:56:06 juju-e4d256-prod-github-runner-207 kernel: [55940.612503] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:56:06 juju-e4d256-prod-github-runner-207 kernel: [55940.613239] ? do_syscall_64+0x69/0xc0 Aug 22 20:56:06 juju-e4d256-prod-github-runner-207 kernel: [55940.613890] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:56:06 juju-e4d256-prod-github-runner-207 kernel: [55940.614591] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:56:06 juju-e4d256-prod-github-runner-207 kernel: [55940.615285] ? do_syscall_64+0x69/0xc0 Aug 22 20:56:06 juju-e4d256-prod-github-runner-207 kernel: [55940.615940] ? do_syscall_64+0x69/0xc0 Aug 22 20:56:06 juju-e4d256-prod-github-runner-207 kernel: [55940.616563] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 20:56:06 juju-e4d256-prod-github-runner-207 kernel: [55940.617272] RIP: 0033:0x7faa5d0edaff Aug 22 20:56:06 juju-e4d256-prod-github-runner-207 kernel: [55940.617901] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 20:56:06 juju-e4d256-prod-github-runner-207 kernel: [55940.619907] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 20:56:06 juju-e4d256-prod-github-runner-207 kernel: [55940.620832] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 20:56:06 juju-e4d256-prod-github-runner-207 kernel: [55940.621726] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 20:56:06 juju-e4d256-prod-github-runner-207 kernel: [55940.622626] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 20:56:06 juju-e4d256-prod-github-runner-207 kernel: [55940.623625] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 20:56:06 juju-e4d256-prod-github-runner-207 kernel: [55940.624558] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 20:56:06 juju-e4d256-prod-github-runner-207 kernel: [55940.625462] Aug 22 20:56:34 juju-e4d256-prod-github-runner-207 kernel: [55968.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 52016s! [qemu-system-x86:6715] Aug 22 20:56:34 juju-e4d256-prod-github-runner-207 kernel: [55968.543266] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 20:56:34 juju-e4d256-prod-github-runner-207 kernel: [55968.543352] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 20:56:34 juju-e4d256-prod-github-runner-207 kernel: [55968.555540] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 20:56:34 juju-e4d256-prod-github-runner-207 kernel: [55968.556843] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 20:56:34 juju-e4d256-prod-github-runner-207 kernel: [55968.558066] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:56:34 juju-e4d256-prod-github-runner-207 kernel: [55968.559129] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 20:56:34 juju-e4d256-prod-github-runner-207 kernel: [55968.561699] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 20:56:34 juju-e4d256-prod-github-runner-207 kernel: [55968.562742] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 20:56:34 juju-e4d256-prod-github-runner-207 kernel: [55968.563921] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 20:56:34 juju-e4d256-prod-github-runner-207 kernel: [55968.565085] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 20:56:34 juju-e4d256-prod-github-runner-207 kernel: [55968.566268] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 20:56:34 juju-e4d256-prod-github-runner-207 kernel: [55968.567439] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 20:56:34 juju-e4d256-prod-github-runner-207 kernel: [55968.568656] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 20:56:34 juju-e4d256-prod-github-runner-207 kernel: [55968.569899] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 20:56:34 juju-e4d256-prod-github-runner-207 kernel: [55968.570998] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 20:56:34 juju-e4d256-prod-github-runner-207 kernel: [55968.572257] Call Trace: Aug 22 20:56:34 juju-e4d256-prod-github-runner-207 kernel: [55968.573218] Aug 22 20:56:34 juju-e4d256-prod-github-runner-207 kernel: [55968.574172] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:56:34 juju-e4d256-prod-github-runner-207 kernel: [55968.575223] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:56:34 juju-e4d256-prod-github-runner-207 kernel: [55968.576257] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:56:34 juju-e4d256-prod-github-runner-207 kernel: [55968.577333] ? show_regs.part.0+0x23/0x29 Aug 22 20:56:34 juju-e4d256-prod-github-runner-207 kernel: [55968.578365] ? show_regs.cold+0x8/0xd Aug 22 20:56:34 juju-e4d256-prod-github-runner-207 kernel: [55968.579353] ? watchdog_timer_fn+0x1be/0x220 Aug 22 20:56:34 juju-e4d256-prod-github-runner-207 kernel: [55968.580367] ? lockup_detector_update_enable+0x60/0x60 Aug 22 20:56:34 juju-e4d256-prod-github-runner-207 kernel: [55968.581504] ? __hrtimer_run_queues+0x107/0x230 Aug 22 20:56:34 juju-e4d256-prod-github-runner-207 kernel: [55968.582547] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 20:56:34 juju-e4d256-prod-github-runner-207 kernel: [55968.583591] ? hrtimer_interrupt+0x101/0x220 Aug 22 20:56:34 juju-e4d256-prod-github-runner-207 kernel: [55968.584614] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 20:56:34 juju-e4d256-prod-github-runner-207 kernel: [55968.585692] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 20:56:34 juju-e4d256-prod-github-runner-207 kernel: [55968.586743] Aug 22 20:56:34 juju-e4d256-prod-github-runner-207 kernel: [55968.587603] Aug 22 20:56:34 juju-e4d256-prod-github-runner-207 kernel: [55968.588445] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 20:56:34 juju-e4d256-prod-github-runner-207 kernel: [55968.589480] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:56:34 juju-e4d256-prod-github-runner-207 kernel: [55968.590518] ? _raw_spin_lock+0x22/0x30 Aug 22 20:56:34 juju-e4d256-prod-github-runner-207 kernel: [55968.591479] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:56:34 juju-e4d256-prod-github-runner-207 kernel: [55968.592500] direct_page_fault+0x206/0x310 [kvm] Aug 22 20:56:34 juju-e4d256-prod-github-runner-207 kernel: [55968.593538] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 20:56:34 juju-e4d256-prod-github-runner-207 kernel: [55968.594558] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 20:56:34 juju-e4d256-prod-github-runner-207 kernel: [55968.595568] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 20:56:34 juju-e4d256-prod-github-runner-207 kernel: [55968.596543] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 20:56:34 juju-e4d256-prod-github-runner-207 kernel: [55968.597499] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 20:56:34 juju-e4d256-prod-github-runner-207 kernel: [55968.598476] handle_exit+0x98/0x230 [kvm_amd] Aug 22 20:56:34 juju-e4d256-prod-github-runner-207 kernel: [55968.599380] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 20:56:34 juju-e4d256-prod-github-runner-207 kernel: [55968.600298] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 20:56:34 juju-e4d256-prod-github-runner-207 kernel: [55968.601225] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 20:56:34 juju-e4d256-prod-github-runner-207 kernel: [55968.602136] vcpu_run+0x62/0x2c0 [kvm] Aug 22 20:56:34 juju-e4d256-prod-github-runner-207 kernel: [55968.602945] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 20:56:34 juju-e4d256-prod-github-runner-207 kernel: [55968.603763] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 20:56:34 juju-e4d256-prod-github-runner-207 kernel: [55968.604623] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 20:56:34 juju-e4d256-prod-github-runner-207 kernel: [55968.605420] ? __seccomp_filter+0x4a/0x4a0 Aug 22 20:56:34 juju-e4d256-prod-github-runner-207 kernel: [55968.606164] ? __fget_files+0x86/0xc0 Aug 22 20:56:34 juju-e4d256-prod-github-runner-207 kernel: [55968.606867] __x64_sys_ioctl+0x95/0xd0 Aug 22 20:56:34 juju-e4d256-prod-github-runner-207 kernel: [55968.607575] do_syscall_64+0x5c/0xc0 Aug 22 20:56:34 juju-e4d256-prod-github-runner-207 kernel: [55968.608240] ? do_futex+0x162/0x1f0 Aug 22 20:56:34 juju-e4d256-prod-github-runner-207 kernel: [55968.608887] ? __x64_sys_futex+0x78/0x1e0 Aug 22 20:56:34 juju-e4d256-prod-github-runner-207 kernel: [55968.609572] ? __secure_computing+0xa9/0x120 Aug 22 20:56:34 juju-e4d256-prod-github-runner-207 kernel: [55968.610264] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 20:56:34 juju-e4d256-prod-github-runner-207 kernel: [55968.611088] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:56:34 juju-e4d256-prod-github-runner-207 kernel: [55968.611861] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:56:34 juju-e4d256-prod-github-runner-207 kernel: [55968.612582] ? do_syscall_64+0x69/0xc0 Aug 22 20:56:34 juju-e4d256-prod-github-runner-207 kernel: [55968.613340] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:56:34 juju-e4d256-prod-github-runner-207 kernel: [55968.614042] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:56:34 juju-e4d256-prod-github-runner-207 kernel: [55968.614737] ? do_syscall_64+0x69/0xc0 Aug 22 20:56:34 juju-e4d256-prod-github-runner-207 kernel: [55968.615384] ? do_syscall_64+0x69/0xc0 Aug 22 20:56:34 juju-e4d256-prod-github-runner-207 kernel: [55968.616006] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 20:56:34 juju-e4d256-prod-github-runner-207 kernel: [55968.616711] RIP: 0033:0x7faa5d0edaff Aug 22 20:56:34 juju-e4d256-prod-github-runner-207 kernel: [55968.617368] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 20:56:34 juju-e4d256-prod-github-runner-207 kernel: [55968.619371] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 20:56:34 juju-e4d256-prod-github-runner-207 kernel: [55968.620282] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 20:56:34 juju-e4d256-prod-github-runner-207 kernel: [55968.621179] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 20:56:34 juju-e4d256-prod-github-runner-207 kernel: [55968.622069] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 20:56:34 juju-e4d256-prod-github-runner-207 kernel: [55968.622960] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 20:56:34 juju-e4d256-prod-github-runner-207 kernel: [55968.623860] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 20:56:34 juju-e4d256-prod-github-runner-207 kernel: [55968.624757] Aug 22 20:56:47 juju-e4d256-prod-github-runner-207 kernel: [55980.920709] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 20:56:47 juju-e4d256-prod-github-runner-207 kernel: [55980.921663] rcu: 1-....: (13921983 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=6729504 Aug 22 20:56:47 juju-e4d256-prod-github-runner-207 kernel: [55980.922780] (t=13965930 jiffies g=23269 q=51372) Aug 22 20:56:47 juju-e4d256-prod-github-runner-207 kernel: [55980.923577] NMI backtrace for cpu 1 Aug 22 20:56:47 juju-e4d256-prod-github-runner-207 kernel: [55980.924293] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 20:56:47 juju-e4d256-prod-github-runner-207 kernel: [55980.925392] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 20:56:47 juju-e4d256-prod-github-runner-207 kernel: [55980.926445] Call Trace: Aug 22 20:56:47 juju-e4d256-prod-github-runner-207 kernel: [55980.927125] Aug 22 20:56:47 juju-e4d256-prod-github-runner-207 kernel: [55980.927787] show_stack+0x52/0x5c Aug 22 20:56:47 juju-e4d256-prod-github-runner-207 kernel: [55980.928508] dump_stack_lvl+0x4a/0x63 Aug 22 20:56:47 juju-e4d256-prod-github-runner-207 kernel: [55980.929251] dump_stack+0x10/0x16 Aug 22 20:56:47 juju-e4d256-prod-github-runner-207 kernel: [55980.929965] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 20:56:47 juju-e4d256-prod-github-runner-207 kernel: [55980.930755] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 20:56:47 juju-e4d256-prod-github-runner-207 kernel: [55980.931604] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 20:56:47 juju-e4d256-prod-github-runner-207 kernel: [55980.932441] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 20:56:47 juju-e4d256-prod-github-runner-207 kernel: [55980.933262] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 20:56:47 juju-e4d256-prod-github-runner-207 kernel: [55980.934068] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 20:56:47 juju-e4d256-prod-github-runner-207 kernel: [55980.934839] print_cpu_stall.cold+0x2f/0xe2 Aug 22 20:56:47 juju-e4d256-prod-github-runner-207 kernel: [55980.935617] ? timekeeping_update+0xf7/0x150 Aug 22 20:56:47 juju-e4d256-prod-github-runner-207 kernel: [55980.936392] check_cpu_stall+0x109/0x270 Aug 22 20:56:47 juju-e4d256-prod-github-runner-207 kernel: [55980.937136] rcu_sched_clock_irq+0x9a/0x250 Aug 22 20:56:47 juju-e4d256-prod-github-runner-207 kernel: [55980.937896] update_process_times+0x94/0xd0 Aug 22 20:56:47 juju-e4d256-prod-github-runner-207 kernel: [55980.938657] tick_sched_handle+0x29/0x70 Aug 22 20:56:47 juju-e4d256-prod-github-runner-207 kernel: [55980.939415] tick_sched_timer+0x8c/0xc0 Aug 22 20:56:47 juju-e4d256-prod-github-runner-207 kernel: [55980.940152] ? tick_nohz_handler+0xb0/0xb0 Aug 22 20:56:47 juju-e4d256-prod-github-runner-207 kernel: [55980.940905] __hrtimer_run_queues+0x107/0x230 Aug 22 20:56:47 juju-e4d256-prod-github-runner-207 kernel: [55980.941675] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 20:56:47 juju-e4d256-prod-github-runner-207 kernel: [55980.942453] hrtimer_interrupt+0x101/0x220 Aug 22 20:56:47 juju-e4d256-prod-github-runner-207 kernel: [55980.943220] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 20:56:47 juju-e4d256-prod-github-runner-207 kernel: [55980.944031] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 20:56:47 juju-e4d256-prod-github-runner-207 kernel: [55980.944829] Aug 22 20:56:47 juju-e4d256-prod-github-runner-207 kernel: [55980.945461] Aug 22 20:56:47 juju-e4d256-prod-github-runner-207 kernel: [55980.946090] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 20:56:47 juju-e4d256-prod-github-runner-207 kernel: [55980.946908] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:56:47 juju-e4d256-prod-github-runner-207 kernel: [55980.947794] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 20:56:47 juju-e4d256-prod-github-runner-207 kernel: [55980.950023] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 20:56:47 juju-e4d256-prod-github-runner-207 kernel: [55980.950911] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 20:56:47 juju-e4d256-prod-github-runner-207 kernel: [55980.951944] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 20:56:47 juju-e4d256-prod-github-runner-207 kernel: [55980.952923] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 20:56:47 juju-e4d256-prod-github-runner-207 kernel: [55980.953890] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 20:56:47 juju-e4d256-prod-github-runner-207 kernel: [55980.954840] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 20:56:47 juju-e4d256-prod-github-runner-207 kernel: [55980.955815] ? _raw_spin_lock+0x22/0x30 Aug 22 20:56:47 juju-e4d256-prod-github-runner-207 kernel: [55980.956570] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:56:47 juju-e4d256-prod-github-runner-207 kernel: [55980.957402] direct_page_fault+0x206/0x310 [kvm] Aug 22 20:56:47 juju-e4d256-prod-github-runner-207 kernel: [55980.958242] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 20:56:47 juju-e4d256-prod-github-runner-207 kernel: [55980.959065] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 20:56:47 juju-e4d256-prod-github-runner-207 kernel: [55980.960106] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 20:56:47 juju-e4d256-prod-github-runner-207 kernel: [55980.960913] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 20:56:47 juju-e4d256-prod-github-runner-207 kernel: [55980.961694] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 20:56:47 juju-e4d256-prod-github-runner-207 kernel: [55980.962512] handle_exit+0x98/0x230 [kvm_amd] Aug 22 20:56:47 juju-e4d256-prod-github-runner-207 kernel: [55980.963282] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 20:56:47 juju-e4d256-prod-github-runner-207 kernel: [55980.964063] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 20:56:47 juju-e4d256-prod-github-runner-207 kernel: [55980.964863] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 20:56:47 juju-e4d256-prod-github-runner-207 kernel: [55980.965650] vcpu_run+0x62/0x2c0 [kvm] Aug 22 20:56:47 juju-e4d256-prod-github-runner-207 kernel: [55980.966361] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 20:56:47 juju-e4d256-prod-github-runner-207 kernel: [55980.967093] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 20:56:47 juju-e4d256-prod-github-runner-207 kernel: [55980.967901] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 20:56:47 juju-e4d256-prod-github-runner-207 kernel: [55980.968773] ? __seccomp_filter+0x4a/0x4a0 Aug 22 20:56:47 juju-e4d256-prod-github-runner-207 kernel: [55980.969490] ? __fget_files+0x86/0xc0 Aug 22 20:56:47 juju-e4d256-prod-github-runner-207 kernel: [55980.970178] __x64_sys_ioctl+0x95/0xd0 Aug 22 20:56:47 juju-e4d256-prod-github-runner-207 kernel: [55980.970870] do_syscall_64+0x5c/0xc0 Aug 22 20:56:47 juju-e4d256-prod-github-runner-207 kernel: [55980.971559] ? do_futex+0x162/0x1f0 Aug 22 20:56:47 juju-e4d256-prod-github-runner-207 kernel: [55980.972228] ? __x64_sys_futex+0x78/0x1e0 Aug 22 20:56:47 juju-e4d256-prod-github-runner-207 kernel: [55980.972926] ? __secure_computing+0xa9/0x120 Aug 22 20:56:47 juju-e4d256-prod-github-runner-207 kernel: [55980.973640] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 20:56:47 juju-e4d256-prod-github-runner-207 kernel: [55980.974428] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:56:47 juju-e4d256-prod-github-runner-207 kernel: [55980.975178] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:56:47 juju-e4d256-prod-github-runner-207 kernel: [55980.975941] ? do_syscall_64+0x69/0xc0 Aug 22 20:56:47 juju-e4d256-prod-github-runner-207 kernel: [55980.976627] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:56:47 juju-e4d256-prod-github-runner-207 kernel: [55980.977417] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:56:47 juju-e4d256-prod-github-runner-207 kernel: [55980.978171] ? do_syscall_64+0x69/0xc0 Aug 22 20:56:47 juju-e4d256-prod-github-runner-207 kernel: [55980.978861] ? do_syscall_64+0x69/0xc0 Aug 22 20:56:47 juju-e4d256-prod-github-runner-207 kernel: [55980.979596] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 20:56:47 juju-e4d256-prod-github-runner-207 kernel: [55980.980398] RIP: 0033:0x7faa5d0edaff Aug 22 20:56:47 juju-e4d256-prod-github-runner-207 kernel: [55980.981080] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 20:56:47 juju-e4d256-prod-github-runner-207 kernel: [55980.983186] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 20:56:47 juju-e4d256-prod-github-runner-207 kernel: [55980.984165] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 20:56:47 juju-e4d256-prod-github-runner-207 kernel: [55980.985110] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 20:56:47 juju-e4d256-prod-github-runner-207 kernel: [55980.986052] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 20:56:47 juju-e4d256-prod-github-runner-207 kernel: [55980.986997] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 20:56:47 juju-e4d256-prod-github-runner-207 kernel: [55980.987949] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 20:56:47 juju-e4d256-prod-github-runner-207 kernel: [55980.988868] Aug 22 20:57:14 juju-e4d256-prod-github-runner-207 kernel: [56008.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 52054s! [qemu-system-x86:6715] Aug 22 20:57:14 juju-e4d256-prod-github-runner-207 kernel: [56008.543898] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 20:57:14 juju-e4d256-prod-github-runner-207 kernel: [56008.544195] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 20:57:14 juju-e4d256-prod-github-runner-207 kernel: [56008.556478] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 20:57:14 juju-e4d256-prod-github-runner-207 kernel: [56008.557740] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 20:57:14 juju-e4d256-prod-github-runner-207 kernel: [56008.559010] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:57:14 juju-e4d256-prod-github-runner-207 kernel: [56008.560095] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 20:57:14 juju-e4d256-prod-github-runner-207 kernel: [56008.562655] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 20:57:14 juju-e4d256-prod-github-runner-207 kernel: [56008.563716] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 20:57:14 juju-e4d256-prod-github-runner-207 kernel: [56008.564929] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 20:57:14 juju-e4d256-prod-github-runner-207 kernel: [56008.566086] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 20:57:14 juju-e4d256-prod-github-runner-207 kernel: [56008.567304] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 20:57:14 juju-e4d256-prod-github-runner-207 kernel: [56008.568468] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 20:57:14 juju-e4d256-prod-github-runner-207 kernel: [56008.569633] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 20:57:14 juju-e4d256-prod-github-runner-207 kernel: [56008.570877] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 20:57:14 juju-e4d256-prod-github-runner-207 kernel: [56008.571972] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 20:57:14 juju-e4d256-prod-github-runner-207 kernel: [56008.573160] Call Trace: Aug 22 20:57:14 juju-e4d256-prod-github-runner-207 kernel: [56008.574080] Aug 22 20:57:14 juju-e4d256-prod-github-runner-207 kernel: [56008.574986] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:57:14 juju-e4d256-prod-github-runner-207 kernel: [56008.576018] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:57:14 juju-e4d256-prod-github-runner-207 kernel: [56008.577044] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:57:14 juju-e4d256-prod-github-runner-207 kernel: [56008.578141] ? show_regs.part.0+0x23/0x29 Aug 22 20:57:14 juju-e4d256-prod-github-runner-207 kernel: [56008.579153] ? show_regs.cold+0x8/0xd Aug 22 20:57:14 juju-e4d256-prod-github-runner-207 kernel: [56008.580129] ? watchdog_timer_fn+0x1be/0x220 Aug 22 20:57:14 juju-e4d256-prod-github-runner-207 kernel: [56008.581137] ? lockup_detector_update_enable+0x60/0x60 Aug 22 20:57:14 juju-e4d256-prod-github-runner-207 kernel: [56008.582198] ? __hrtimer_run_queues+0x107/0x230 Aug 22 20:57:14 juju-e4d256-prod-github-runner-207 kernel: [56008.583231] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 20:57:14 juju-e4d256-prod-github-runner-207 kernel: [56008.584259] ? hrtimer_interrupt+0x101/0x220 Aug 22 20:57:14 juju-e4d256-prod-github-runner-207 kernel: [56008.585286] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 20:57:14 juju-e4d256-prod-github-runner-207 kernel: [56008.586360] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 20:57:14 juju-e4d256-prod-github-runner-207 kernel: [56008.587420] Aug 22 20:57:14 juju-e4d256-prod-github-runner-207 kernel: [56008.588272] Aug 22 20:57:14 juju-e4d256-prod-github-runner-207 kernel: [56008.589123] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 20:57:14 juju-e4d256-prod-github-runner-207 kernel: [56008.590179] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:57:14 juju-e4d256-prod-github-runner-207 kernel: [56008.591253] ? _raw_spin_lock+0x22/0x30 Aug 22 20:57:14 juju-e4d256-prod-github-runner-207 kernel: [56008.592197] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:57:14 juju-e4d256-prod-github-runner-207 kernel: [56008.593232] direct_page_fault+0x206/0x310 [kvm] Aug 22 20:57:14 juju-e4d256-prod-github-runner-207 kernel: [56008.594275] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 20:57:14 juju-e4d256-prod-github-runner-207 kernel: [56008.595320] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 20:57:14 juju-e4d256-prod-github-runner-207 kernel: [56008.596344] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 20:57:14 juju-e4d256-prod-github-runner-207 kernel: [56008.597357] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 20:57:14 juju-e4d256-prod-github-runner-207 kernel: [56008.598304] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 20:57:14 juju-e4d256-prod-github-runner-207 kernel: [56008.599304] handle_exit+0x98/0x230 [kvm_amd] Aug 22 20:57:14 juju-e4d256-prod-github-runner-207 kernel: [56008.600201] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 20:57:14 juju-e4d256-prod-github-runner-207 kernel: [56008.601117] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 20:57:14 juju-e4d256-prod-github-runner-207 kernel: [56008.602050] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 20:57:14 juju-e4d256-prod-github-runner-207 kernel: [56008.602978] vcpu_run+0x62/0x2c0 [kvm] Aug 22 20:57:14 juju-e4d256-prod-github-runner-207 kernel: [56008.603795] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 20:57:14 juju-e4d256-prod-github-runner-207 kernel: [56008.604602] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 20:57:14 juju-e4d256-prod-github-runner-207 kernel: [56008.605472] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 20:57:14 juju-e4d256-prod-github-runner-207 kernel: [56008.606274] ? __seccomp_filter+0x4a/0x4a0 Aug 22 20:57:14 juju-e4d256-prod-github-runner-207 kernel: [56008.607029] ? __fget_files+0x86/0xc0 Aug 22 20:57:14 juju-e4d256-prod-github-runner-207 kernel: [56008.607734] __x64_sys_ioctl+0x95/0xd0 Aug 22 20:57:14 juju-e4d256-prod-github-runner-207 kernel: [56008.608428] do_syscall_64+0x5c/0xc0 Aug 22 20:57:14 juju-e4d256-prod-github-runner-207 kernel: [56008.609094] ? do_futex+0x162/0x1f0 Aug 22 20:57:14 juju-e4d256-prod-github-runner-207 kernel: [56008.609749] ? __x64_sys_futex+0x78/0x1e0 Aug 22 20:57:14 juju-e4d256-prod-github-runner-207 kernel: [56008.610424] ? __secure_computing+0xa9/0x120 Aug 22 20:57:14 juju-e4d256-prod-github-runner-207 kernel: [56008.611129] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 20:57:14 juju-e4d256-prod-github-runner-207 kernel: [56008.611898] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:57:14 juju-e4d256-prod-github-runner-207 kernel: [56008.612626] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:57:14 juju-e4d256-prod-github-runner-207 kernel: [56008.613344] ? do_syscall_64+0x69/0xc0 Aug 22 20:57:14 juju-e4d256-prod-github-runner-207 kernel: [56008.613999] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:57:14 juju-e4d256-prod-github-runner-207 kernel: [56008.614709] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:57:14 juju-e4d256-prod-github-runner-207 kernel: [56008.615442] ? do_syscall_64+0x69/0xc0 Aug 22 20:57:14 juju-e4d256-prod-github-runner-207 kernel: [56008.616083] ? do_syscall_64+0x69/0xc0 Aug 22 20:57:14 juju-e4d256-prod-github-runner-207 kernel: [56008.616708] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 20:57:14 juju-e4d256-prod-github-runner-207 kernel: [56008.617416] RIP: 0033:0x7faa5d0edaff Aug 22 20:57:14 juju-e4d256-prod-github-runner-207 kernel: [56008.618079] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 20:57:14 juju-e4d256-prod-github-runner-207 kernel: [56008.620122] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 20:57:14 juju-e4d256-prod-github-runner-207 kernel: [56008.621045] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 20:57:14 juju-e4d256-prod-github-runner-207 kernel: [56008.621967] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 20:57:14 juju-e4d256-prod-github-runner-207 kernel: [56008.622874] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 20:57:14 juju-e4d256-prod-github-runner-207 kernel: [56008.623759] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 20:57:14 juju-e4d256-prod-github-runner-207 kernel: [56008.624655] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 20:57:14 juju-e4d256-prod-github-runner-207 kernel: [56008.625553] Aug 22 20:57:42 juju-e4d256-prod-github-runner-207 kernel: [56036.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 52080s! [qemu-system-x86:6715] Aug 22 20:57:42 juju-e4d256-prod-github-runner-207 kernel: [56036.543143] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 20:57:42 juju-e4d256-prod-github-runner-207 kernel: [56036.543224] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 20:57:42 juju-e4d256-prod-github-runner-207 kernel: [56036.555541] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 20:57:42 juju-e4d256-prod-github-runner-207 kernel: [56036.556817] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 20:57:42 juju-e4d256-prod-github-runner-207 kernel: [56036.558049] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:57:42 juju-e4d256-prod-github-runner-207 kernel: [56036.559156] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 20:57:42 juju-e4d256-prod-github-runner-207 kernel: [56036.561725] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 20:57:42 juju-e4d256-prod-github-runner-207 kernel: [56036.562941] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 20:57:42 juju-e4d256-prod-github-runner-207 kernel: [56036.564271] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 20:57:42 juju-e4d256-prod-github-runner-207 kernel: [56036.565594] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 20:57:42 juju-e4d256-prod-github-runner-207 kernel: [56036.567100] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 20:57:42 juju-e4d256-prod-github-runner-207 kernel: [56036.568389] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 20:57:42 juju-e4d256-prod-github-runner-207 kernel: [56036.569696] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 20:57:42 juju-e4d256-prod-github-runner-207 kernel: [56036.571108] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 20:57:42 juju-e4d256-prod-github-runner-207 kernel: [56036.572318] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 20:57:42 juju-e4d256-prod-github-runner-207 kernel: [56036.573673] Call Trace: Aug 22 20:57:42 juju-e4d256-prod-github-runner-207 kernel: [56036.574844] Aug 22 20:57:42 juju-e4d256-prod-github-runner-207 kernel: [56036.575782] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:57:42 juju-e4d256-prod-github-runner-207 kernel: [56036.576901] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:57:42 juju-e4d256-prod-github-runner-207 kernel: [56036.578008] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:57:42 juju-e4d256-prod-github-runner-207 kernel: [56036.579267] ? show_regs.part.0+0x23/0x29 Aug 22 20:57:42 juju-e4d256-prod-github-runner-207 kernel: [56036.580365] ? show_regs.cold+0x8/0xd Aug 22 20:57:42 juju-e4d256-prod-github-runner-207 kernel: [56036.581417] ? watchdog_timer_fn+0x1be/0x220 Aug 22 20:57:42 juju-e4d256-prod-github-runner-207 kernel: [56036.582509] ? lockup_detector_update_enable+0x60/0x60 Aug 22 20:57:42 juju-e4d256-prod-github-runner-207 kernel: [56036.583695] ? __hrtimer_run_queues+0x107/0x230 Aug 22 20:57:42 juju-e4d256-prod-github-runner-207 kernel: [56036.584812] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 20:57:42 juju-e4d256-prod-github-runner-207 kernel: [56036.586118] ? hrtimer_interrupt+0x101/0x220 Aug 22 20:57:42 juju-e4d256-prod-github-runner-207 kernel: [56036.587225] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 20:57:42 juju-e4d256-prod-github-runner-207 kernel: [56036.588399] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 20:57:42 juju-e4d256-prod-github-runner-207 kernel: [56036.589742] Aug 22 20:57:42 juju-e4d256-prod-github-runner-207 kernel: [56036.590681] Aug 22 20:57:42 juju-e4d256-prod-github-runner-207 kernel: [56036.591762] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 20:57:42 juju-e4d256-prod-github-runner-207 kernel: [56036.592895] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:57:42 juju-e4d256-prod-github-runner-207 kernel: [56036.594051] ? _raw_spin_lock+0x22/0x30 Aug 22 20:57:42 juju-e4d256-prod-github-runner-207 kernel: [56036.595089] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:57:42 juju-e4d256-prod-github-runner-207 kernel: [56036.596207] direct_page_fault+0x206/0x310 [kvm] Aug 22 20:57:42 juju-e4d256-prod-github-runner-207 kernel: [56036.597327] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 20:57:42 juju-e4d256-prod-github-runner-207 kernel: [56036.598430] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 20:57:42 juju-e4d256-prod-github-runner-207 kernel: [56036.599542] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 20:57:42 juju-e4d256-prod-github-runner-207 kernel: [56036.600621] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 20:57:42 juju-e4d256-prod-github-runner-207 kernel: [56036.601671] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 20:57:42 juju-e4d256-prod-github-runner-207 kernel: [56036.602790] handle_exit+0x98/0x230 [kvm_amd] Aug 22 20:57:42 juju-e4d256-prod-github-runner-207 kernel: [56036.603775] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 20:57:42 juju-e4d256-prod-github-runner-207 kernel: [56036.604785] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 20:57:42 juju-e4d256-prod-github-runner-207 kernel: [56036.605815] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 20:57:42 juju-e4d256-prod-github-runner-207 kernel: [56036.606839] vcpu_run+0x62/0x2c0 [kvm] Aug 22 20:57:42 juju-e4d256-prod-github-runner-207 kernel: [56036.607748] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 20:57:42 juju-e4d256-prod-github-runner-207 kernel: [56036.608703] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 20:57:42 juju-e4d256-prod-github-runner-207 kernel: [56036.609757] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 20:57:42 juju-e4d256-prod-github-runner-207 kernel: [56036.610756] ? __seccomp_filter+0x4a/0x4a0 Aug 22 20:57:42 juju-e4d256-prod-github-runner-207 kernel: [56036.611503] ? __fget_files+0x86/0xc0 Aug 22 20:57:42 juju-e4d256-prod-github-runner-207 kernel: [56036.612207] __x64_sys_ioctl+0x95/0xd0 Aug 22 20:57:42 juju-e4d256-prod-github-runner-207 kernel: [56036.612901] do_syscall_64+0x5c/0xc0 Aug 22 20:57:42 juju-e4d256-prod-github-runner-207 kernel: [56036.613565] ? do_futex+0x162/0x1f0 Aug 22 20:57:42 juju-e4d256-prod-github-runner-207 kernel: [56036.614218] ? __x64_sys_futex+0x78/0x1e0 Aug 22 20:57:42 juju-e4d256-prod-github-runner-207 kernel: [56036.614904] ? __secure_computing+0xa9/0x120 Aug 22 20:57:42 juju-e4d256-prod-github-runner-207 kernel: [56036.615595] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 20:57:42 juju-e4d256-prod-github-runner-207 kernel: [56036.616354] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:57:42 juju-e4d256-prod-github-runner-207 kernel: [56036.617078] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:57:42 juju-e4d256-prod-github-runner-207 kernel: [56036.617800] ? do_syscall_64+0x69/0xc0 Aug 22 20:57:42 juju-e4d256-prod-github-runner-207 kernel: [56036.618444] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:57:42 juju-e4d256-prod-github-runner-207 kernel: [56036.619176] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:57:42 juju-e4d256-prod-github-runner-207 kernel: [56036.619870] ? do_syscall_64+0x69/0xc0 Aug 22 20:57:42 juju-e4d256-prod-github-runner-207 kernel: [56036.620494] ? do_syscall_64+0x69/0xc0 Aug 22 20:57:42 juju-e4d256-prod-github-runner-207 kernel: [56036.621123] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 20:57:42 juju-e4d256-prod-github-runner-207 kernel: [56036.621828] RIP: 0033:0x7faa5d0edaff Aug 22 20:57:42 juju-e4d256-prod-github-runner-207 kernel: [56036.622451] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 20:57:42 juju-e4d256-prod-github-runner-207 kernel: [56036.624440] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 20:57:42 juju-e4d256-prod-github-runner-207 kernel: [56036.625359] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 20:57:42 juju-e4d256-prod-github-runner-207 kernel: [56036.626251] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 20:57:42 juju-e4d256-prod-github-runner-207 kernel: [56036.627149] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 20:57:42 juju-e4d256-prod-github-runner-207 kernel: [56036.628095] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 20:57:42 juju-e4d256-prod-github-runner-207 kernel: [56036.629030] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 20:57:42 juju-e4d256-prod-github-runner-207 kernel: [56036.629966] Aug 22 20:58:10 juju-e4d256-prod-github-runner-207 kernel: [56064.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 52106s! [qemu-system-x86:6715] Aug 22 20:58:10 juju-e4d256-prod-github-runner-207 kernel: [56064.543104] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 20:58:10 juju-e4d256-prod-github-runner-207 kernel: [56064.543189] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 20:58:10 juju-e4d256-prod-github-runner-207 kernel: [56064.555697] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 20:58:10 juju-e4d256-prod-github-runner-207 kernel: [56064.557018] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 20:58:10 juju-e4d256-prod-github-runner-207 kernel: [56064.558271] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:58:10 juju-e4d256-prod-github-runner-207 kernel: [56064.559380] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 20:58:10 juju-e4d256-prod-github-runner-207 kernel: [56064.561928] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 20:58:10 juju-e4d256-prod-github-runner-207 kernel: [56064.562983] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 20:58:10 juju-e4d256-prod-github-runner-207 kernel: [56064.564143] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 20:58:10 juju-e4d256-prod-github-runner-207 kernel: [56064.565301] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 20:58:10 juju-e4d256-prod-github-runner-207 kernel: [56064.566485] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 20:58:10 juju-e4d256-prod-github-runner-207 kernel: [56064.567652] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 20:58:10 juju-e4d256-prod-github-runner-207 kernel: [56064.568819] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 20:58:10 juju-e4d256-prod-github-runner-207 kernel: [56064.570055] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 20:58:10 juju-e4d256-prod-github-runner-207 kernel: [56064.571161] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 20:58:10 juju-e4d256-prod-github-runner-207 kernel: [56064.572355] Call Trace: Aug 22 20:58:10 juju-e4d256-prod-github-runner-207 kernel: [56064.573267] Aug 22 20:58:10 juju-e4d256-prod-github-runner-207 kernel: [56064.574150] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:58:10 juju-e4d256-prod-github-runner-207 kernel: [56064.575190] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:58:10 juju-e4d256-prod-github-runner-207 kernel: [56064.576216] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:58:10 juju-e4d256-prod-github-runner-207 kernel: [56064.577290] ? show_regs.part.0+0x23/0x29 Aug 22 20:58:10 juju-e4d256-prod-github-runner-207 kernel: [56064.578299] ? show_regs.cold+0x8/0xd Aug 22 20:58:10 juju-e4d256-prod-github-runner-207 kernel: [56064.579275] ? watchdog_timer_fn+0x1be/0x220 Aug 22 20:58:10 juju-e4d256-prod-github-runner-207 kernel: [56064.580281] ? lockup_detector_update_enable+0x60/0x60 Aug 22 20:58:10 juju-e4d256-prod-github-runner-207 kernel: [56064.581360] ? __hrtimer_run_queues+0x107/0x230 Aug 22 20:58:10 juju-e4d256-prod-github-runner-207 kernel: [56064.582457] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 20:58:10 juju-e4d256-prod-github-runner-207 kernel: [56064.583486] ? hrtimer_interrupt+0x101/0x220 Aug 22 20:58:10 juju-e4d256-prod-github-runner-207 kernel: [56064.584506] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 20:58:10 juju-e4d256-prod-github-runner-207 kernel: [56064.585579] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 20:58:10 juju-e4d256-prod-github-runner-207 kernel: [56064.586671] Aug 22 20:58:10 juju-e4d256-prod-github-runner-207 kernel: [56064.587527] Aug 22 20:58:10 juju-e4d256-prod-github-runner-207 kernel: [56064.588369] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 20:58:10 juju-e4d256-prod-github-runner-207 kernel: [56064.589405] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:58:10 juju-e4d256-prod-github-runner-207 kernel: [56064.590451] ? _raw_spin_lock+0x22/0x30 Aug 22 20:58:10 juju-e4d256-prod-github-runner-207 kernel: [56064.591402] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:58:10 juju-e4d256-prod-github-runner-207 kernel: [56064.592445] direct_page_fault+0x206/0x310 [kvm] Aug 22 20:58:10 juju-e4d256-prod-github-runner-207 kernel: [56064.593480] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 20:58:10 juju-e4d256-prod-github-runner-207 kernel: [56064.594529] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 20:58:10 juju-e4d256-prod-github-runner-207 kernel: [56064.595546] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 20:58:10 juju-e4d256-prod-github-runner-207 kernel: [56064.596521] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 20:58:10 juju-e4d256-prod-github-runner-207 kernel: [56064.597473] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 20:58:10 juju-e4d256-prod-github-runner-207 kernel: [56064.598513] handle_exit+0x98/0x230 [kvm_amd] Aug 22 20:58:10 juju-e4d256-prod-github-runner-207 kernel: [56064.599406] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 20:58:10 juju-e4d256-prod-github-runner-207 kernel: [56064.600320] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 20:58:10 juju-e4d256-prod-github-runner-207 kernel: [56064.601250] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 20:58:10 juju-e4d256-prod-github-runner-207 kernel: [56064.602199] vcpu_run+0x62/0x2c0 [kvm] Aug 22 20:58:10 juju-e4d256-prod-github-runner-207 kernel: [56064.603027] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 20:58:10 juju-e4d256-prod-github-runner-207 kernel: [56064.603841] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 20:58:10 juju-e4d256-prod-github-runner-207 kernel: [56064.604769] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 20:58:10 juju-e4d256-prod-github-runner-207 kernel: [56064.605578] ? __seccomp_filter+0x4a/0x4a0 Aug 22 20:58:10 juju-e4d256-prod-github-runner-207 kernel: [56064.606334] ? __fget_files+0x86/0xc0 Aug 22 20:58:10 juju-e4d256-prod-github-runner-207 kernel: [56064.607040] __x64_sys_ioctl+0x95/0xd0 Aug 22 20:58:10 juju-e4d256-prod-github-runner-207 kernel: [56064.607733] do_syscall_64+0x5c/0xc0 Aug 22 20:58:10 juju-e4d256-prod-github-runner-207 kernel: [56064.608418] ? do_futex+0x162/0x1f0 Aug 22 20:58:10 juju-e4d256-prod-github-runner-207 kernel: [56064.609076] ? __x64_sys_futex+0x78/0x1e0 Aug 22 20:58:10 juju-e4d256-prod-github-runner-207 kernel: [56064.609750] ? __secure_computing+0xa9/0x120 Aug 22 20:58:10 juju-e4d256-prod-github-runner-207 kernel: [56064.610454] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 20:58:10 juju-e4d256-prod-github-runner-207 kernel: [56064.611217] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:58:10 juju-e4d256-prod-github-runner-207 kernel: [56064.611947] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:58:10 juju-e4d256-prod-github-runner-207 kernel: [56064.612670] ? do_syscall_64+0x69/0xc0 Aug 22 20:58:10 juju-e4d256-prod-github-runner-207 kernel: [56064.613316] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:58:10 juju-e4d256-prod-github-runner-207 kernel: [56064.614040] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:58:10 juju-e4d256-prod-github-runner-207 kernel: [56064.614753] ? do_syscall_64+0x69/0xc0 Aug 22 20:58:10 juju-e4d256-prod-github-runner-207 kernel: [56064.615380] ? do_syscall_64+0x69/0xc0 Aug 22 20:58:10 juju-e4d256-prod-github-runner-207 kernel: [56064.616012] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 20:58:10 juju-e4d256-prod-github-runner-207 kernel: [56064.616779] RIP: 0033:0x7faa5d0edaff Aug 22 20:58:10 juju-e4d256-prod-github-runner-207 kernel: [56064.617416] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 20:58:10 juju-e4d256-prod-github-runner-207 kernel: [56064.619461] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 20:58:10 juju-e4d256-prod-github-runner-207 kernel: [56064.620590] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 20:58:10 juju-e4d256-prod-github-runner-207 kernel: [56064.621669] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 20:58:10 juju-e4d256-prod-github-runner-207 kernel: [56064.622599] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 20:58:10 juju-e4d256-prod-github-runner-207 kernel: [56064.623491] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 20:58:10 juju-e4d256-prod-github-runner-207 kernel: [56064.624382] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 20:58:10 juju-e4d256-prod-github-runner-207 kernel: [56064.625280] Aug 22 20:58:38 juju-e4d256-prod-github-runner-207 kernel: [56092.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 52132s! [qemu-system-x86:6715] Aug 22 20:58:38 juju-e4d256-prod-github-runner-207 kernel: [56092.543857] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 20:58:38 juju-e4d256-prod-github-runner-207 kernel: [56092.544162] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 20:58:38 juju-e4d256-prod-github-runner-207 kernel: [56092.556237] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 20:58:38 juju-e4d256-prod-github-runner-207 kernel: [56092.557500] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 20:58:38 juju-e4d256-prod-github-runner-207 kernel: [56092.558730] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:58:38 juju-e4d256-prod-github-runner-207 kernel: [56092.559787] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 20:58:38 juju-e4d256-prod-github-runner-207 kernel: [56092.562336] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 20:58:38 juju-e4d256-prod-github-runner-207 kernel: [56092.563383] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 20:58:38 juju-e4d256-prod-github-runner-207 kernel: [56092.564542] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 20:58:38 juju-e4d256-prod-github-runner-207 kernel: [56092.565699] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 20:58:38 juju-e4d256-prod-github-runner-207 kernel: [56092.566864] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 20:58:38 juju-e4d256-prod-github-runner-207 kernel: [56092.568028] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 20:58:38 juju-e4d256-prod-github-runner-207 kernel: [56092.569194] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 20:58:38 juju-e4d256-prod-github-runner-207 kernel: [56092.570431] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 20:58:38 juju-e4d256-prod-github-runner-207 kernel: [56092.571532] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 20:58:38 juju-e4d256-prod-github-runner-207 kernel: [56092.572720] Call Trace: Aug 22 20:58:38 juju-e4d256-prod-github-runner-207 kernel: [56092.573648] Aug 22 20:58:38 juju-e4d256-prod-github-runner-207 kernel: [56092.574554] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:58:38 juju-e4d256-prod-github-runner-207 kernel: [56092.575582] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:58:38 juju-e4d256-prod-github-runner-207 kernel: [56092.576601] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:58:38 juju-e4d256-prod-github-runner-207 kernel: [56092.577687] ? show_regs.part.0+0x23/0x29 Aug 22 20:58:38 juju-e4d256-prod-github-runner-207 kernel: [56092.578690] ? show_regs.cold+0x8/0xd Aug 22 20:58:38 juju-e4d256-prod-github-runner-207 kernel: [56092.579668] ? watchdog_timer_fn+0x1be/0x220 Aug 22 20:58:38 juju-e4d256-prod-github-runner-207 kernel: [56092.580685] ? lockup_detector_update_enable+0x60/0x60 Aug 22 20:58:38 juju-e4d256-prod-github-runner-207 kernel: [56092.581812] ? __hrtimer_run_queues+0x107/0x230 Aug 22 20:58:38 juju-e4d256-prod-github-runner-207 kernel: [56092.582852] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 20:58:38 juju-e4d256-prod-github-runner-207 kernel: [56092.583875] ? hrtimer_interrupt+0x101/0x220 Aug 22 20:58:38 juju-e4d256-prod-github-runner-207 kernel: [56092.584889] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 20:58:38 juju-e4d256-prod-github-runner-207 kernel: [56092.585964] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 20:58:38 juju-e4d256-prod-github-runner-207 kernel: [56092.587008] Aug 22 20:58:38 juju-e4d256-prod-github-runner-207 kernel: [56092.587859] Aug 22 20:58:38 juju-e4d256-prod-github-runner-207 kernel: [56092.588700] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 20:58:38 juju-e4d256-prod-github-runner-207 kernel: [56092.589738] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:58:38 juju-e4d256-prod-github-runner-207 kernel: [56092.590783] ? _raw_spin_lock+0x22/0x30 Aug 22 20:58:38 juju-e4d256-prod-github-runner-207 kernel: [56092.591727] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:58:38 juju-e4d256-prod-github-runner-207 kernel: [56092.592779] direct_page_fault+0x206/0x310 [kvm] Aug 22 20:58:38 juju-e4d256-prod-github-runner-207 kernel: [56092.593805] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 20:58:38 juju-e4d256-prod-github-runner-207 kernel: [56092.594821] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 20:58:38 juju-e4d256-prod-github-runner-207 kernel: [56092.595820] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 20:58:38 juju-e4d256-prod-github-runner-207 kernel: [56092.596820] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 20:58:38 juju-e4d256-prod-github-runner-207 kernel: [56092.597765] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 20:58:38 juju-e4d256-prod-github-runner-207 kernel: [56092.598791] handle_exit+0x98/0x230 [kvm_amd] Aug 22 20:58:38 juju-e4d256-prod-github-runner-207 kernel: [56092.599722] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 20:58:38 juju-e4d256-prod-github-runner-207 kernel: [56092.600640] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 20:58:38 juju-e4d256-prod-github-runner-207 kernel: [56092.601568] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 20:58:38 juju-e4d256-prod-github-runner-207 kernel: [56092.602491] vcpu_run+0x62/0x2c0 [kvm] Aug 22 20:58:38 juju-e4d256-prod-github-runner-207 kernel: [56092.603301] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 20:58:38 juju-e4d256-prod-github-runner-207 kernel: [56092.604258] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 20:58:38 juju-e4d256-prod-github-runner-207 kernel: [56092.605128] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 20:58:38 juju-e4d256-prod-github-runner-207 kernel: [56092.605960] ? __seccomp_filter+0x4a/0x4a0 Aug 22 20:58:38 juju-e4d256-prod-github-runner-207 kernel: [56092.606702] ? __fget_files+0x86/0xc0 Aug 22 20:58:38 juju-e4d256-prod-github-runner-207 kernel: [56092.607412] __x64_sys_ioctl+0x95/0xd0 Aug 22 20:58:38 juju-e4d256-prod-github-runner-207 kernel: [56092.608104] do_syscall_64+0x5c/0xc0 Aug 22 20:58:38 juju-e4d256-prod-github-runner-207 kernel: [56092.608773] ? do_futex+0x162/0x1f0 Aug 22 20:58:38 juju-e4d256-prod-github-runner-207 kernel: [56092.609420] ? __x64_sys_futex+0x78/0x1e0 Aug 22 20:58:38 juju-e4d256-prod-github-runner-207 kernel: [56092.610104] ? __secure_computing+0xa9/0x120 Aug 22 20:58:38 juju-e4d256-prod-github-runner-207 kernel: [56092.610792] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 20:58:38 juju-e4d256-prod-github-runner-207 kernel: [56092.611550] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:58:38 juju-e4d256-prod-github-runner-207 kernel: [56092.612269] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:58:38 juju-e4d256-prod-github-runner-207 kernel: [56092.612986] ? do_syscall_64+0x69/0xc0 Aug 22 20:58:38 juju-e4d256-prod-github-runner-207 kernel: [56092.613629] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:58:38 juju-e4d256-prod-github-runner-207 kernel: [56092.614349] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:58:38 juju-e4d256-prod-github-runner-207 kernel: [56092.615042] ? do_syscall_64+0x69/0xc0 Aug 22 20:58:38 juju-e4d256-prod-github-runner-207 kernel: [56092.615666] ? do_syscall_64+0x69/0xc0 Aug 22 20:58:38 juju-e4d256-prod-github-runner-207 kernel: [56092.616286] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 20:58:38 juju-e4d256-prod-github-runner-207 kernel: [56092.616989] RIP: 0033:0x7faa5d0edaff Aug 22 20:58:38 juju-e4d256-prod-github-runner-207 kernel: [56092.617643] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 20:58:38 juju-e4d256-prod-github-runner-207 kernel: [56092.619634] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 20:58:38 juju-e4d256-prod-github-runner-207 kernel: [56092.620548] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 20:58:38 juju-e4d256-prod-github-runner-207 kernel: [56092.621437] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 20:58:38 juju-e4d256-prod-github-runner-207 kernel: [56092.622334] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 20:58:38 juju-e4d256-prod-github-runner-207 kernel: [56092.623223] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 20:58:38 juju-e4d256-prod-github-runner-207 kernel: [56092.624113] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 20:58:38 juju-e4d256-prod-github-runner-207 kernel: [56092.625014] Aug 22 20:59:06 juju-e4d256-prod-github-runner-207 kernel: [56120.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 52158s! [qemu-system-x86:6715] Aug 22 20:59:06 juju-e4d256-prod-github-runner-207 kernel: [56120.543116] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 20:59:06 juju-e4d256-prod-github-runner-207 kernel: [56120.543193] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 20:59:06 juju-e4d256-prod-github-runner-207 kernel: [56120.555338] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 20:59:06 juju-e4d256-prod-github-runner-207 kernel: [56120.556604] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 20:59:06 juju-e4d256-prod-github-runner-207 kernel: [56120.557843] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:59:06 juju-e4d256-prod-github-runner-207 kernel: [56120.558908] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 20:59:06 juju-e4d256-prod-github-runner-207 kernel: [56120.561455] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 20:59:06 juju-e4d256-prod-github-runner-207 kernel: [56120.562522] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 20:59:06 juju-e4d256-prod-github-runner-207 kernel: [56120.563692] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 20:59:06 juju-e4d256-prod-github-runner-207 kernel: [56120.564859] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 20:59:06 juju-e4d256-prod-github-runner-207 kernel: [56120.566219] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 20:59:06 juju-e4d256-prod-github-runner-207 kernel: [56120.567402] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 20:59:06 juju-e4d256-prod-github-runner-207 kernel: [56120.568608] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 20:59:06 juju-e4d256-prod-github-runner-207 kernel: [56120.569880] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 20:59:06 juju-e4d256-prod-github-runner-207 kernel: [56120.571010] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 20:59:06 juju-e4d256-prod-github-runner-207 kernel: [56120.572207] Call Trace: Aug 22 20:59:06 juju-e4d256-prod-github-runner-207 kernel: [56120.573132] Aug 22 20:59:06 juju-e4d256-prod-github-runner-207 kernel: [56120.574046] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:59:06 juju-e4d256-prod-github-runner-207 kernel: [56120.575077] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:59:06 juju-e4d256-prod-github-runner-207 kernel: [56120.576095] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:59:06 juju-e4d256-prod-github-runner-207 kernel: [56120.577175] ? show_regs.part.0+0x23/0x29 Aug 22 20:59:06 juju-e4d256-prod-github-runner-207 kernel: [56120.578193] ? show_regs.cold+0x8/0xd Aug 22 20:59:06 juju-e4d256-prod-github-runner-207 kernel: [56120.579168] ? watchdog_timer_fn+0x1be/0x220 Aug 22 20:59:06 juju-e4d256-prod-github-runner-207 kernel: [56120.580175] ? lockup_detector_update_enable+0x60/0x60 Aug 22 20:59:06 juju-e4d256-prod-github-runner-207 kernel: [56120.581240] ? __hrtimer_run_queues+0x107/0x230 Aug 22 20:59:06 juju-e4d256-prod-github-runner-207 kernel: [56120.582281] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 20:59:06 juju-e4d256-prod-github-runner-207 kernel: [56120.583317] ? hrtimer_interrupt+0x101/0x220 Aug 22 20:59:06 juju-e4d256-prod-github-runner-207 kernel: [56120.584337] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 20:59:06 juju-e4d256-prod-github-runner-207 kernel: [56120.585406] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 20:59:06 juju-e4d256-prod-github-runner-207 kernel: [56120.586466] Aug 22 20:59:06 juju-e4d256-prod-github-runner-207 kernel: [56120.587319] Aug 22 20:59:06 juju-e4d256-prod-github-runner-207 kernel: [56120.588155] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 20:59:06 juju-e4d256-prod-github-runner-207 kernel: [56120.589206] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:59:06 juju-e4d256-prod-github-runner-207 kernel: [56120.590259] ? _raw_spin_lock+0x22/0x30 Aug 22 20:59:06 juju-e4d256-prod-github-runner-207 kernel: [56120.591204] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:59:06 juju-e4d256-prod-github-runner-207 kernel: [56120.592249] direct_page_fault+0x206/0x310 [kvm] Aug 22 20:59:06 juju-e4d256-prod-github-runner-207 kernel: [56120.593284] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 20:59:06 juju-e4d256-prod-github-runner-207 kernel: [56120.594371] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 20:59:06 juju-e4d256-prod-github-runner-207 kernel: [56120.595382] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 20:59:06 juju-e4d256-prod-github-runner-207 kernel: [56120.596355] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 20:59:06 juju-e4d256-prod-github-runner-207 kernel: [56120.597305] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 20:59:06 juju-e4d256-prod-github-runner-207 kernel: [56120.598301] handle_exit+0x98/0x230 [kvm_amd] Aug 22 20:59:06 juju-e4d256-prod-github-runner-207 kernel: [56120.599205] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 20:59:06 juju-e4d256-prod-github-runner-207 kernel: [56120.600124] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 20:59:06 juju-e4d256-prod-github-runner-207 kernel: [56120.601060] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 20:59:06 juju-e4d256-prod-github-runner-207 kernel: [56120.602024] vcpu_run+0x62/0x2c0 [kvm] Aug 22 20:59:06 juju-e4d256-prod-github-runner-207 kernel: [56120.602852] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 20:59:06 juju-e4d256-prod-github-runner-207 kernel: [56120.603666] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 20:59:06 juju-e4d256-prod-github-runner-207 kernel: [56120.604540] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 20:59:06 juju-e4d256-prod-github-runner-207 kernel: [56120.605342] ? __seccomp_filter+0x4a/0x4a0 Aug 22 20:59:06 juju-e4d256-prod-github-runner-207 kernel: [56120.606106] ? __fget_files+0x86/0xc0 Aug 22 20:59:06 juju-e4d256-prod-github-runner-207 kernel: [56120.606817] __x64_sys_ioctl+0x95/0xd0 Aug 22 20:59:06 juju-e4d256-prod-github-runner-207 kernel: [56120.607512] do_syscall_64+0x5c/0xc0 Aug 22 20:59:06 juju-e4d256-prod-github-runner-207 kernel: [56120.608178] ? do_futex+0x162/0x1f0 Aug 22 20:59:06 juju-e4d256-prod-github-runner-207 kernel: [56120.608884] ? __x64_sys_futex+0x78/0x1e0 Aug 22 20:59:06 juju-e4d256-prod-github-runner-207 kernel: [56120.609605] ? __secure_computing+0xa9/0x120 Aug 22 20:59:06 juju-e4d256-prod-github-runner-207 kernel: [56120.610301] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 20:59:06 juju-e4d256-prod-github-runner-207 kernel: [56120.611078] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:59:06 juju-e4d256-prod-github-runner-207 kernel: [56120.611821] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:59:06 juju-e4d256-prod-github-runner-207 kernel: [56120.612613] ? do_syscall_64+0x69/0xc0 Aug 22 20:59:06 juju-e4d256-prod-github-runner-207 kernel: [56120.613281] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:59:06 juju-e4d256-prod-github-runner-207 kernel: [56120.614026] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:59:06 juju-e4d256-prod-github-runner-207 kernel: [56120.614780] ? do_syscall_64+0x69/0xc0 Aug 22 20:59:06 juju-e4d256-prod-github-runner-207 kernel: [56120.615431] ? do_syscall_64+0x69/0xc0 Aug 22 20:59:06 juju-e4d256-prod-github-runner-207 kernel: [56120.616059] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 20:59:06 juju-e4d256-prod-github-runner-207 kernel: [56120.616767] RIP: 0033:0x7faa5d0edaff Aug 22 20:59:06 juju-e4d256-prod-github-runner-207 kernel: [56120.617394] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 20:59:06 juju-e4d256-prod-github-runner-207 kernel: [56120.619454] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 20:59:06 juju-e4d256-prod-github-runner-207 kernel: [56120.620397] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 20:59:06 juju-e4d256-prod-github-runner-207 kernel: [56120.621299] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 20:59:06 juju-e4d256-prod-github-runner-207 kernel: [56120.622246] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 20:59:06 juju-e4d256-prod-github-runner-207 kernel: [56120.623149] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 20:59:06 juju-e4d256-prod-github-runner-207 kernel: [56120.624039] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 20:59:06 juju-e4d256-prod-github-runner-207 kernel: [56120.625012] Aug 22 20:59:34 juju-e4d256-prod-github-runner-207 kernel: [56148.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 52184s! [qemu-system-x86:6715] Aug 22 20:59:34 juju-e4d256-prod-github-runner-207 kernel: [56148.543131] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 20:59:34 juju-e4d256-prod-github-runner-207 kernel: [56148.543201] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 20:59:34 juju-e4d256-prod-github-runner-207 kernel: [56148.556026] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 20:59:34 juju-e4d256-prod-github-runner-207 kernel: [56148.557361] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 20:59:34 juju-e4d256-prod-github-runner-207 kernel: [56148.558640] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:59:34 juju-e4d256-prod-github-runner-207 kernel: [56148.559745] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 20:59:34 juju-e4d256-prod-github-runner-207 kernel: [56148.562434] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 20:59:34 juju-e4d256-prod-github-runner-207 kernel: [56148.563628] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 20:59:34 juju-e4d256-prod-github-runner-207 kernel: [56148.564871] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 20:59:34 juju-e4d256-prod-github-runner-207 kernel: [56148.566090] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 20:59:34 juju-e4d256-prod-github-runner-207 kernel: [56148.567311] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 20:59:34 juju-e4d256-prod-github-runner-207 kernel: [56148.568532] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 20:59:34 juju-e4d256-prod-github-runner-207 kernel: [56148.569905] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 20:59:34 juju-e4d256-prod-github-runner-207 kernel: [56148.571172] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 20:59:34 juju-e4d256-prod-github-runner-207 kernel: [56148.572348] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 20:59:34 juju-e4d256-prod-github-runner-207 kernel: [56148.573629] Call Trace: Aug 22 20:59:34 juju-e4d256-prod-github-runner-207 kernel: [56148.574575] Aug 22 20:59:34 juju-e4d256-prod-github-runner-207 kernel: [56148.575506] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:59:34 juju-e4d256-prod-github-runner-207 kernel: [56148.576577] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 20:59:34 juju-e4d256-prod-github-runner-207 kernel: [56148.577727] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:59:34 juju-e4d256-prod-github-runner-207 kernel: [56148.578850] ? show_regs.part.0+0x23/0x29 Aug 22 20:59:34 juju-e4d256-prod-github-runner-207 kernel: [56148.579880] ? show_regs.cold+0x8/0xd Aug 22 20:59:34 juju-e4d256-prod-github-runner-207 kernel: [56148.580911] ? watchdog_timer_fn+0x1be/0x220 Aug 22 20:59:34 juju-e4d256-prod-github-runner-207 kernel: [56148.581983] ? lockup_detector_update_enable+0x60/0x60 Aug 22 20:59:34 juju-e4d256-prod-github-runner-207 kernel: [56148.583105] ? __hrtimer_run_queues+0x107/0x230 Aug 22 20:59:34 juju-e4d256-prod-github-runner-207 kernel: [56148.584180] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 20:59:34 juju-e4d256-prod-github-runner-207 kernel: [56148.585266] ? hrtimer_interrupt+0x101/0x220 Aug 22 20:59:34 juju-e4d256-prod-github-runner-207 kernel: [56148.586317] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 20:59:34 juju-e4d256-prod-github-runner-207 kernel: [56148.587442] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 20:59:34 juju-e4d256-prod-github-runner-207 kernel: [56148.588538] Aug 22 20:59:34 juju-e4d256-prod-github-runner-207 kernel: [56148.589456] Aug 22 20:59:34 juju-e4d256-prod-github-runner-207 kernel: [56148.590332] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 20:59:34 juju-e4d256-prod-github-runner-207 kernel: [56148.591384] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:59:34 juju-e4d256-prod-github-runner-207 kernel: [56148.592469] ? _raw_spin_lock+0x22/0x30 Aug 22 20:59:34 juju-e4d256-prod-github-runner-207 kernel: [56148.593469] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:59:34 juju-e4d256-prod-github-runner-207 kernel: [56148.594544] direct_page_fault+0x206/0x310 [kvm] Aug 22 20:59:34 juju-e4d256-prod-github-runner-207 kernel: [56148.595614] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 20:59:34 juju-e4d256-prod-github-runner-207 kernel: [56148.596670] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 20:59:34 juju-e4d256-prod-github-runner-207 kernel: [56148.597730] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 20:59:34 juju-e4d256-prod-github-runner-207 kernel: [56148.598753] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 20:59:34 juju-e4d256-prod-github-runner-207 kernel: [56148.599722] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 20:59:34 juju-e4d256-prod-github-runner-207 kernel: [56148.600742] handle_exit+0x98/0x230 [kvm_amd] Aug 22 20:59:34 juju-e4d256-prod-github-runner-207 kernel: [56148.601681] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 20:59:34 juju-e4d256-prod-github-runner-207 kernel: [56148.602636] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 20:59:34 juju-e4d256-prod-github-runner-207 kernel: [56148.603601] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 20:59:34 juju-e4d256-prod-github-runner-207 kernel: [56148.604557] vcpu_run+0x62/0x2c0 [kvm] Aug 22 20:59:34 juju-e4d256-prod-github-runner-207 kernel: [56148.605401] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 20:59:34 juju-e4d256-prod-github-runner-207 kernel: [56148.606212] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 20:59:34 juju-e4d256-prod-github-runner-207 kernel: [56148.607080] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 20:59:34 juju-e4d256-prod-github-runner-207 kernel: [56148.607880] ? __seccomp_filter+0x4a/0x4a0 Aug 22 20:59:34 juju-e4d256-prod-github-runner-207 kernel: [56148.608660] ? __fget_files+0x86/0xc0 Aug 22 20:59:34 juju-e4d256-prod-github-runner-207 kernel: [56148.609404] __x64_sys_ioctl+0x95/0xd0 Aug 22 20:59:34 juju-e4d256-prod-github-runner-207 kernel: [56148.610101] do_syscall_64+0x5c/0xc0 Aug 22 20:59:34 juju-e4d256-prod-github-runner-207 kernel: [56148.610766] ? do_futex+0x162/0x1f0 Aug 22 20:59:34 juju-e4d256-prod-github-runner-207 kernel: [56148.611441] ? __x64_sys_futex+0x78/0x1e0 Aug 22 20:59:34 juju-e4d256-prod-github-runner-207 kernel: [56148.612129] ? __secure_computing+0xa9/0x120 Aug 22 20:59:34 juju-e4d256-prod-github-runner-207 kernel: [56148.612826] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 20:59:34 juju-e4d256-prod-github-runner-207 kernel: [56148.613600] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:59:34 juju-e4d256-prod-github-runner-207 kernel: [56148.614322] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:59:34 juju-e4d256-prod-github-runner-207 kernel: [56148.615039] ? do_syscall_64+0x69/0xc0 Aug 22 20:59:34 juju-e4d256-prod-github-runner-207 kernel: [56148.615684] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:59:34 juju-e4d256-prod-github-runner-207 kernel: [56148.616387] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:59:34 juju-e4d256-prod-github-runner-207 kernel: [56148.617087] ? do_syscall_64+0x69/0xc0 Aug 22 20:59:34 juju-e4d256-prod-github-runner-207 kernel: [56148.617727] ? do_syscall_64+0x69/0xc0 Aug 22 20:59:34 juju-e4d256-prod-github-runner-207 kernel: [56148.618357] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 20:59:34 juju-e4d256-prod-github-runner-207 kernel: [56148.619061] RIP: 0033:0x7faa5d0edaff Aug 22 20:59:34 juju-e4d256-prod-github-runner-207 kernel: [56148.619685] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 20:59:34 juju-e4d256-prod-github-runner-207 kernel: [56148.621705] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 20:59:34 juju-e4d256-prod-github-runner-207 kernel: [56148.622627] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 20:59:34 juju-e4d256-prod-github-runner-207 kernel: [56148.623541] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 20:59:34 juju-e4d256-prod-github-runner-207 kernel: [56148.624432] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 20:59:34 juju-e4d256-prod-github-runner-207 kernel: [56148.625334] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 20:59:34 juju-e4d256-prod-github-runner-207 kernel: [56148.626230] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 20:59:34 juju-e4d256-prod-github-runner-207 kernel: [56148.627123] Aug 22 20:59:47 juju-e4d256-prod-github-runner-207 kernel: [56160.932705] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 20:59:47 juju-e4d256-prod-github-runner-207 kernel: [56160.933689] rcu: 1-....: (13966849 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=6751117 Aug 22 20:59:47 juju-e4d256-prod-github-runner-207 kernel: [56160.934816] (t=14010933 jiffies g=23269 q=51472) Aug 22 20:59:47 juju-e4d256-prod-github-runner-207 kernel: [56160.935601] NMI backtrace for cpu 1 Aug 22 20:59:47 juju-e4d256-prod-github-runner-207 kernel: [56160.936307] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 20:59:47 juju-e4d256-prod-github-runner-207 kernel: [56160.937460] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 20:59:47 juju-e4d256-prod-github-runner-207 kernel: [56160.938524] Call Trace: Aug 22 20:59:47 juju-e4d256-prod-github-runner-207 kernel: [56160.939197] Aug 22 20:59:47 juju-e4d256-prod-github-runner-207 kernel: [56160.939840] show_stack+0x52/0x5c Aug 22 20:59:47 juju-e4d256-prod-github-runner-207 kernel: [56160.940566] dump_stack_lvl+0x4a/0x63 Aug 22 20:59:47 juju-e4d256-prod-github-runner-207 kernel: [56160.941344] dump_stack+0x10/0x16 Aug 22 20:59:47 juju-e4d256-prod-github-runner-207 kernel: [56160.942060] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 20:59:47 juju-e4d256-prod-github-runner-207 kernel: [56160.942839] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 20:59:47 juju-e4d256-prod-github-runner-207 kernel: [56160.943614] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 20:59:47 juju-e4d256-prod-github-runner-207 kernel: [56160.944500] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 20:59:47 juju-e4d256-prod-github-runner-207 kernel: [56160.945338] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 20:59:47 juju-e4d256-prod-github-runner-207 kernel: [56160.946143] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 20:59:47 juju-e4d256-prod-github-runner-207 kernel: [56160.947011] print_cpu_stall.cold+0x2f/0xe2 Aug 22 20:59:47 juju-e4d256-prod-github-runner-207 kernel: [56160.947773] ? timekeeping_update+0xf7/0x150 Aug 22 20:59:47 juju-e4d256-prod-github-runner-207 kernel: [56160.948542] check_cpu_stall+0x109/0x270 Aug 22 20:59:47 juju-e4d256-prod-github-runner-207 kernel: [56160.949302] rcu_sched_clock_irq+0x9a/0x250 Aug 22 20:59:47 juju-e4d256-prod-github-runner-207 kernel: [56160.950067] update_process_times+0x94/0xd0 Aug 22 20:59:47 juju-e4d256-prod-github-runner-207 kernel: [56160.950825] tick_sched_handle+0x29/0x70 Aug 22 20:59:47 juju-e4d256-prod-github-runner-207 kernel: [56160.951569] tick_sched_timer+0x8c/0xc0 Aug 22 20:59:47 juju-e4d256-prod-github-runner-207 kernel: [56160.952304] ? tick_nohz_handler+0xb0/0xb0 Aug 22 20:59:47 juju-e4d256-prod-github-runner-207 kernel: [56160.953068] __hrtimer_run_queues+0x107/0x230 Aug 22 20:59:47 juju-e4d256-prod-github-runner-207 kernel: [56160.953840] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 20:59:47 juju-e4d256-prod-github-runner-207 kernel: [56160.954619] hrtimer_interrupt+0x101/0x220 Aug 22 20:59:47 juju-e4d256-prod-github-runner-207 kernel: [56160.955376] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 20:59:47 juju-e4d256-prod-github-runner-207 kernel: [56160.956192] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 20:59:47 juju-e4d256-prod-github-runner-207 kernel: [56160.956993] Aug 22 20:59:47 juju-e4d256-prod-github-runner-207 kernel: [56160.957637] Aug 22 20:59:47 juju-e4d256-prod-github-runner-207 kernel: [56160.958265] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 20:59:47 juju-e4d256-prod-github-runner-207 kernel: [56160.959082] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 20:59:47 juju-e4d256-prod-github-runner-207 kernel: [56160.959961] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 20:59:47 juju-e4d256-prod-github-runner-207 kernel: [56160.962182] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 20:59:47 juju-e4d256-prod-github-runner-207 kernel: [56160.963054] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 20:59:47 juju-e4d256-prod-github-runner-207 kernel: [56160.964047] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 20:59:47 juju-e4d256-prod-github-runner-207 kernel: [56160.965042] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 20:59:47 juju-e4d256-prod-github-runner-207 kernel: [56160.966005] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 20:59:47 juju-e4d256-prod-github-runner-207 kernel: [56160.966959] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 20:59:47 juju-e4d256-prod-github-runner-207 kernel: [56160.967913] ? _raw_spin_lock+0x22/0x30 Aug 22 20:59:47 juju-e4d256-prod-github-runner-207 kernel: [56160.968670] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 20:59:47 juju-e4d256-prod-github-runner-207 kernel: [56160.969539] direct_page_fault+0x206/0x310 [kvm] Aug 22 20:59:47 juju-e4d256-prod-github-runner-207 kernel: [56160.970377] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 20:59:47 juju-e4d256-prod-github-runner-207 kernel: [56160.971204] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 20:59:47 juju-e4d256-prod-github-runner-207 kernel: [56160.972026] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 20:59:47 juju-e4d256-prod-github-runner-207 kernel: [56160.972830] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 20:59:47 juju-e4d256-prod-github-runner-207 kernel: [56160.973626] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 20:59:47 juju-e4d256-prod-github-runner-207 kernel: [56160.974445] handle_exit+0x98/0x230 [kvm_amd] Aug 22 20:59:47 juju-e4d256-prod-github-runner-207 kernel: [56160.975199] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 20:59:47 juju-e4d256-prod-github-runner-207 kernel: [56160.975980] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 20:59:47 juju-e4d256-prod-github-runner-207 kernel: [56160.976777] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 20:59:47 juju-e4d256-prod-github-runner-207 kernel: [56160.977605] vcpu_run+0x62/0x2c0 [kvm] Aug 22 20:59:47 juju-e4d256-prod-github-runner-207 kernel: [56160.978318] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 20:59:47 juju-e4d256-prod-github-runner-207 kernel: [56160.979048] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 20:59:47 juju-e4d256-prod-github-runner-207 kernel: [56160.979847] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 20:59:47 juju-e4d256-prod-github-runner-207 kernel: [56160.980605] ? __seccomp_filter+0x4a/0x4a0 Aug 22 20:59:47 juju-e4d256-prod-github-runner-207 kernel: [56160.981350] ? __fget_files+0x86/0xc0 Aug 22 20:59:47 juju-e4d256-prod-github-runner-207 kernel: [56160.982042] __x64_sys_ioctl+0x95/0xd0 Aug 22 20:59:47 juju-e4d256-prod-github-runner-207 kernel: [56160.982734] do_syscall_64+0x5c/0xc0 Aug 22 20:59:47 juju-e4d256-prod-github-runner-207 kernel: [56160.983413] ? do_futex+0x162/0x1f0 Aug 22 20:59:47 juju-e4d256-prod-github-runner-207 kernel: [56160.984083] ? __x64_sys_futex+0x78/0x1e0 Aug 22 20:59:47 juju-e4d256-prod-github-runner-207 kernel: [56160.984781] ? __secure_computing+0xa9/0x120 Aug 22 20:59:47 juju-e4d256-prod-github-runner-207 kernel: [56160.985509] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 20:59:47 juju-e4d256-prod-github-runner-207 kernel: [56160.986298] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:59:47 juju-e4d256-prod-github-runner-207 kernel: [56160.987049] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:59:47 juju-e4d256-prod-github-runner-207 kernel: [56160.987799] ? do_syscall_64+0x69/0xc0 Aug 22 20:59:47 juju-e4d256-prod-github-runner-207 kernel: [56160.988485] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 20:59:47 juju-e4d256-prod-github-runner-207 kernel: [56160.989256] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 20:59:47 juju-e4d256-prod-github-runner-207 kernel: [56160.990013] ? do_syscall_64+0x69/0xc0 Aug 22 20:59:47 juju-e4d256-prod-github-runner-207 kernel: [56160.990705] ? do_syscall_64+0x69/0xc0 Aug 22 20:59:47 juju-e4d256-prod-github-runner-207 kernel: [56160.991391] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 20:59:47 juju-e4d256-prod-github-runner-207 kernel: [56160.992158] RIP: 0033:0x7faa5d0edaff Aug 22 20:59:47 juju-e4d256-prod-github-runner-207 kernel: [56160.992839] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 20:59:47 juju-e4d256-prod-github-runner-207 kernel: [56160.994948] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 20:59:47 juju-e4d256-prod-github-runner-207 kernel: [56160.995910] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 20:59:47 juju-e4d256-prod-github-runner-207 kernel: [56160.996852] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 20:59:47 juju-e4d256-prod-github-runner-207 kernel: [56160.997811] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 20:59:47 juju-e4d256-prod-github-runner-207 kernel: [56160.998746] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 20:59:47 juju-e4d256-prod-github-runner-207 kernel: [56160.999673] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 20:59:47 juju-e4d256-prod-github-runner-207 kernel: [56161.000596] Aug 22 21:00:14 juju-e4d256-prod-github-runner-207 kernel: [56188.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 52221s! [qemu-system-x86:6715] Aug 22 21:00:14 juju-e4d256-prod-github-runner-207 kernel: [56188.543844] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 21:00:14 juju-e4d256-prod-github-runner-207 kernel: [56188.544126] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 21:00:14 juju-e4d256-prod-github-runner-207 kernel: [56188.556562] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 21:00:14 juju-e4d256-prod-github-runner-207 kernel: [56188.557870] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 21:00:14 juju-e4d256-prod-github-runner-207 kernel: [56188.559109] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:00:14 juju-e4d256-prod-github-runner-207 kernel: [56188.560163] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 21:00:14 juju-e4d256-prod-github-runner-207 kernel: [56188.562747] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 21:00:14 juju-e4d256-prod-github-runner-207 kernel: [56188.563814] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 21:00:14 juju-e4d256-prod-github-runner-207 kernel: [56188.565001] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 21:00:14 juju-e4d256-prod-github-runner-207 kernel: [56188.566186] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 21:00:14 juju-e4d256-prod-github-runner-207 kernel: [56188.567368] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 21:00:14 juju-e4d256-prod-github-runner-207 kernel: [56188.568553] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 21:00:14 juju-e4d256-prod-github-runner-207 kernel: [56188.569736] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 21:00:14 juju-e4d256-prod-github-runner-207 kernel: [56188.570976] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 21:00:14 juju-e4d256-prod-github-runner-207 kernel: [56188.572076] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 21:00:14 juju-e4d256-prod-github-runner-207 kernel: [56188.573310] Call Trace: Aug 22 21:00:14 juju-e4d256-prod-github-runner-207 kernel: [56188.574230] Aug 22 21:00:14 juju-e4d256-prod-github-runner-207 kernel: [56188.575127] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:00:14 juju-e4d256-prod-github-runner-207 kernel: [56188.576160] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:00:14 juju-e4d256-prod-github-runner-207 kernel: [56188.577254] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:00:14 juju-e4d256-prod-github-runner-207 kernel: [56188.578404] ? show_regs.part.0+0x23/0x29 Aug 22 21:00:14 juju-e4d256-prod-github-runner-207 kernel: [56188.579448] ? show_regs.cold+0x8/0xd Aug 22 21:00:14 juju-e4d256-prod-github-runner-207 kernel: [56188.580499] ? watchdog_timer_fn+0x1be/0x220 Aug 22 21:00:14 juju-e4d256-prod-github-runner-207 kernel: [56188.581637] ? lockup_detector_update_enable+0x60/0x60 Aug 22 21:00:14 juju-e4d256-prod-github-runner-207 kernel: [56188.582745] ? __hrtimer_run_queues+0x107/0x230 Aug 22 21:00:14 juju-e4d256-prod-github-runner-207 kernel: [56188.583827] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 21:00:14 juju-e4d256-prod-github-runner-207 kernel: [56188.584921] ? hrtimer_interrupt+0x101/0x220 Aug 22 21:00:14 juju-e4d256-prod-github-runner-207 kernel: [56188.585995] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 21:00:14 juju-e4d256-prod-github-runner-207 kernel: [56188.587133] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 21:00:14 juju-e4d256-prod-github-runner-207 kernel: [56188.588233] Aug 22 21:00:14 juju-e4d256-prod-github-runner-207 kernel: [56188.589141] Aug 22 21:00:14 juju-e4d256-prod-github-runner-207 kernel: [56188.590039] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 21:00:14 juju-e4d256-prod-github-runner-207 kernel: [56188.591126] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:00:14 juju-e4d256-prod-github-runner-207 kernel: [56188.592201] ? _raw_spin_lock+0x22/0x30 Aug 22 21:00:14 juju-e4d256-prod-github-runner-207 kernel: [56188.593220] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:00:14 juju-e4d256-prod-github-runner-207 kernel: [56188.594281] direct_page_fault+0x206/0x310 [kvm] Aug 22 21:00:14 juju-e4d256-prod-github-runner-207 kernel: [56188.595389] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 21:00:14 juju-e4d256-prod-github-runner-207 kernel: [56188.596440] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 21:00:14 juju-e4d256-prod-github-runner-207 kernel: [56188.597524] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 21:00:14 juju-e4d256-prod-github-runner-207 kernel: [56188.598575] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 21:00:14 juju-e4d256-prod-github-runner-207 kernel: [56188.599546] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 21:00:14 juju-e4d256-prod-github-runner-207 kernel: [56188.600540] handle_exit+0x98/0x230 [kvm_amd] Aug 22 21:00:14 juju-e4d256-prod-github-runner-207 kernel: [56188.601503] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 21:00:14 juju-e4d256-prod-github-runner-207 kernel: [56188.602469] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 21:00:14 juju-e4d256-prod-github-runner-207 kernel: [56188.603402] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 21:00:14 juju-e4d256-prod-github-runner-207 kernel: [56188.604338] vcpu_run+0x62/0x2c0 [kvm] Aug 22 21:00:14 juju-e4d256-prod-github-runner-207 kernel: [56188.605171] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 21:00:14 juju-e4d256-prod-github-runner-207 kernel: [56188.606017] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 21:00:14 juju-e4d256-prod-github-runner-207 kernel: [56188.606893] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 21:00:14 juju-e4d256-prod-github-runner-207 kernel: [56188.607693] ? __seccomp_filter+0x4a/0x4a0 Aug 22 21:00:14 juju-e4d256-prod-github-runner-207 kernel: [56188.608443] ? __fget_files+0x86/0xc0 Aug 22 21:00:14 juju-e4d256-prod-github-runner-207 kernel: [56188.609166] __x64_sys_ioctl+0x95/0xd0 Aug 22 21:00:14 juju-e4d256-prod-github-runner-207 kernel: [56188.609862] do_syscall_64+0x5c/0xc0 Aug 22 21:00:14 juju-e4d256-prod-github-runner-207 kernel: [56188.610527] ? do_futex+0x162/0x1f0 Aug 22 21:00:14 juju-e4d256-prod-github-runner-207 kernel: [56188.611179] ? __x64_sys_futex+0x78/0x1e0 Aug 22 21:00:14 juju-e4d256-prod-github-runner-207 kernel: [56188.611856] ? __secure_computing+0xa9/0x120 Aug 22 21:00:14 juju-e4d256-prod-github-runner-207 kernel: [56188.612545] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 21:00:14 juju-e4d256-prod-github-runner-207 kernel: [56188.613359] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:00:14 juju-e4d256-prod-github-runner-207 kernel: [56188.614090] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:00:14 juju-e4d256-prod-github-runner-207 kernel: [56188.614808] ? do_syscall_64+0x69/0xc0 Aug 22 21:00:14 juju-e4d256-prod-github-runner-207 kernel: [56188.615454] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:00:14 juju-e4d256-prod-github-runner-207 kernel: [56188.616158] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:00:14 juju-e4d256-prod-github-runner-207 kernel: [56188.616888] ? do_syscall_64+0x69/0xc0 Aug 22 21:00:14 juju-e4d256-prod-github-runner-207 kernel: [56188.617524] ? do_syscall_64+0x69/0xc0 Aug 22 21:00:14 juju-e4d256-prod-github-runner-207 kernel: [56188.618150] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 21:00:14 juju-e4d256-prod-github-runner-207 kernel: [56188.618858] RIP: 0033:0x7faa5d0edaff Aug 22 21:00:14 juju-e4d256-prod-github-runner-207 kernel: [56188.619530] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 21:00:14 juju-e4d256-prod-github-runner-207 kernel: [56188.621546] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 21:00:14 juju-e4d256-prod-github-runner-207 kernel: [56188.622458] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 21:00:14 juju-e4d256-prod-github-runner-207 kernel: [56188.623350] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 21:00:14 juju-e4d256-prod-github-runner-207 kernel: [56188.624243] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 21:00:14 juju-e4d256-prod-github-runner-207 kernel: [56188.625167] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 21:00:14 juju-e4d256-prod-github-runner-207 kernel: [56188.626099] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 21:00:14 juju-e4d256-prod-github-runner-207 kernel: [56188.627019] Aug 22 21:00:42 juju-e4d256-prod-github-runner-207 kernel: [56216.541983] watchdog: BUG: soft lockup - CPU#1 stuck for 52247s! [qemu-system-x86:6715] Aug 22 21:00:42 juju-e4d256-prod-github-runner-207 kernel: [56216.543123] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 21:00:42 juju-e4d256-prod-github-runner-207 kernel: [56216.543199] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 21:00:42 juju-e4d256-prod-github-runner-207 kernel: [56216.555543] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 21:00:42 juju-e4d256-prod-github-runner-207 kernel: [56216.556841] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 21:00:42 juju-e4d256-prod-github-runner-207 kernel: [56216.558070] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:00:42 juju-e4d256-prod-github-runner-207 kernel: [56216.559126] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 21:00:42 juju-e4d256-prod-github-runner-207 kernel: [56216.561686] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 21:00:42 juju-e4d256-prod-github-runner-207 kernel: [56216.562726] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 21:00:42 juju-e4d256-prod-github-runner-207 kernel: [56216.563890] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 21:00:42 juju-e4d256-prod-github-runner-207 kernel: [56216.565067] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 21:00:42 juju-e4d256-prod-github-runner-207 kernel: [56216.566228] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 21:00:42 juju-e4d256-prod-github-runner-207 kernel: [56216.567394] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 21:00:42 juju-e4d256-prod-github-runner-207 kernel: [56216.568596] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 21:00:42 juju-e4d256-prod-github-runner-207 kernel: [56216.569847] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 21:00:42 juju-e4d256-prod-github-runner-207 kernel: [56216.570944] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 21:00:42 juju-e4d256-prod-github-runner-207 kernel: [56216.572138] Call Trace: Aug 22 21:00:42 juju-e4d256-prod-github-runner-207 kernel: [56216.573061] Aug 22 21:00:42 juju-e4d256-prod-github-runner-207 kernel: [56216.573950] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:00:42 juju-e4d256-prod-github-runner-207 kernel: [56216.575023] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:00:42 juju-e4d256-prod-github-runner-207 kernel: [56216.576073] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:00:42 juju-e4d256-prod-github-runner-207 kernel: [56216.577197] ? show_regs.part.0+0x23/0x29 Aug 22 21:00:42 juju-e4d256-prod-github-runner-207 kernel: [56216.578193] ? show_regs.cold+0x8/0xd Aug 22 21:00:42 juju-e4d256-prod-github-runner-207 kernel: [56216.579162] ? watchdog_timer_fn+0x1be/0x220 Aug 22 21:00:42 juju-e4d256-prod-github-runner-207 kernel: [56216.580173] ? lockup_detector_update_enable+0x60/0x60 Aug 22 21:00:42 juju-e4d256-prod-github-runner-207 kernel: [56216.581254] ? __hrtimer_run_queues+0x107/0x230 Aug 22 21:00:42 juju-e4d256-prod-github-runner-207 kernel: [56216.582341] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 21:00:42 juju-e4d256-prod-github-runner-207 kernel: [56216.583363] ? hrtimer_interrupt+0x101/0x220 Aug 22 21:00:42 juju-e4d256-prod-github-runner-207 kernel: [56216.584386] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 21:00:42 juju-e4d256-prod-github-runner-207 kernel: [56216.585454] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 21:00:42 juju-e4d256-prod-github-runner-207 kernel: [56216.586500] Aug 22 21:00:42 juju-e4d256-prod-github-runner-207 kernel: [56216.587350] Aug 22 21:00:42 juju-e4d256-prod-github-runner-207 kernel: [56216.588185] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 21:00:42 juju-e4d256-prod-github-runner-207 kernel: [56216.589317] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:00:42 juju-e4d256-prod-github-runner-207 kernel: [56216.590372] ? _raw_spin_lock+0x22/0x30 Aug 22 21:00:42 juju-e4d256-prod-github-runner-207 kernel: [56216.591554] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:00:42 juju-e4d256-prod-github-runner-207 kernel: [56216.592805] direct_page_fault+0x206/0x310 [kvm] Aug 22 21:00:42 juju-e4d256-prod-github-runner-207 kernel: [56216.593836] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 21:00:42 juju-e4d256-prod-github-runner-207 kernel: [56216.594851] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 21:00:42 juju-e4d256-prod-github-runner-207 kernel: [56216.595882] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 21:00:42 juju-e4d256-prod-github-runner-207 kernel: [56216.596887] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 21:00:42 juju-e4d256-prod-github-runner-207 kernel: [56216.597868] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 21:00:42 juju-e4d256-prod-github-runner-207 kernel: [56216.598879] handle_exit+0x98/0x230 [kvm_amd] Aug 22 21:00:42 juju-e4d256-prod-github-runner-207 kernel: [56216.599772] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 21:00:42 juju-e4d256-prod-github-runner-207 kernel: [56216.600698] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 21:00:42 juju-e4d256-prod-github-runner-207 kernel: [56216.601624] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 21:00:42 juju-e4d256-prod-github-runner-207 kernel: [56216.602532] vcpu_run+0x62/0x2c0 [kvm] Aug 22 21:00:42 juju-e4d256-prod-github-runner-207 kernel: [56216.603343] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 21:00:42 juju-e4d256-prod-github-runner-207 kernel: [56216.604183] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 21:00:42 juju-e4d256-prod-github-runner-207 kernel: [56216.605092] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 21:00:42 juju-e4d256-prod-github-runner-207 kernel: [56216.605890] ? __seccomp_filter+0x4a/0x4a0 Aug 22 21:00:42 juju-e4d256-prod-github-runner-207 kernel: [56216.606631] ? __fget_files+0x86/0xc0 Aug 22 21:00:42 juju-e4d256-prod-github-runner-207 kernel: [56216.607334] __x64_sys_ioctl+0x95/0xd0 Aug 22 21:00:42 juju-e4d256-prod-github-runner-207 kernel: [56216.608065] do_syscall_64+0x5c/0xc0 Aug 22 21:00:42 juju-e4d256-prod-github-runner-207 kernel: [56216.608750] ? do_futex+0x162/0x1f0 Aug 22 21:00:42 juju-e4d256-prod-github-runner-207 kernel: [56216.609399] ? __x64_sys_futex+0x78/0x1e0 Aug 22 21:00:42 juju-e4d256-prod-github-runner-207 kernel: [56216.610071] ? __secure_computing+0xa9/0x120 Aug 22 21:00:42 juju-e4d256-prod-github-runner-207 kernel: [56216.610766] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 21:00:42 juju-e4d256-prod-github-runner-207 kernel: [56216.611526] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:00:42 juju-e4d256-prod-github-runner-207 kernel: [56216.612247] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:00:42 juju-e4d256-prod-github-runner-207 kernel: [56216.612972] ? do_syscall_64+0x69/0xc0 Aug 22 21:00:42 juju-e4d256-prod-github-runner-207 kernel: [56216.613622] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:00:42 juju-e4d256-prod-github-runner-207 kernel: [56216.614348] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:00:42 juju-e4d256-prod-github-runner-207 kernel: [56216.615043] ? do_syscall_64+0x69/0xc0 Aug 22 21:00:42 juju-e4d256-prod-github-runner-207 kernel: [56216.615667] ? do_syscall_64+0x69/0xc0 Aug 22 21:00:42 juju-e4d256-prod-github-runner-207 kernel: [56216.616288] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 21:00:42 juju-e4d256-prod-github-runner-207 kernel: [56216.617002] RIP: 0033:0x7faa5d0edaff Aug 22 21:00:42 juju-e4d256-prod-github-runner-207 kernel: [56216.617633] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 21:00:42 juju-e4d256-prod-github-runner-207 kernel: [56216.619617] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 21:00:42 juju-e4d256-prod-github-runner-207 kernel: [56216.620546] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 21:00:42 juju-e4d256-prod-github-runner-207 kernel: [56216.621436] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 21:00:42 juju-e4d256-prod-github-runner-207 kernel: [56216.622321] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 21:00:42 juju-e4d256-prod-github-runner-207 kernel: [56216.623242] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 21:00:42 juju-e4d256-prod-github-runner-207 kernel: [56216.624148] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 21:00:42 juju-e4d256-prod-github-runner-207 kernel: [56216.625054] Aug 22 21:01:10 juju-e4d256-prod-github-runner-207 kernel: [56244.541981] watchdog: BUG: soft lockup - CPU#1 stuck for 52273s! [qemu-system-x86:6715] Aug 22 21:01:10 juju-e4d256-prod-github-runner-207 kernel: [56244.543154] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 21:01:10 juju-e4d256-prod-github-runner-207 kernel: [56244.543226] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 21:01:10 juju-e4d256-prod-github-runner-207 kernel: [56244.555687] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 21:01:10 juju-e4d256-prod-github-runner-207 kernel: [56244.557002] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 21:01:10 juju-e4d256-prod-github-runner-207 kernel: [56244.558258] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:01:10 juju-e4d256-prod-github-runner-207 kernel: [56244.559333] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 21:01:10 juju-e4d256-prod-github-runner-207 kernel: [56244.561932] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 21:01:10 juju-e4d256-prod-github-runner-207 kernel: [56244.562984] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 21:01:10 juju-e4d256-prod-github-runner-207 kernel: [56244.564181] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 21:01:10 juju-e4d256-prod-github-runner-207 kernel: [56244.565358] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 21:01:10 juju-e4d256-prod-github-runner-207 kernel: [56244.566538] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 21:01:10 juju-e4d256-prod-github-runner-207 kernel: [56244.567718] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 21:01:10 juju-e4d256-prod-github-runner-207 kernel: [56244.568944] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 21:01:10 juju-e4d256-prod-github-runner-207 kernel: [56244.570198] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 21:01:10 juju-e4d256-prod-github-runner-207 kernel: [56244.571307] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 21:01:10 juju-e4d256-prod-github-runner-207 kernel: [56244.572549] Call Trace: Aug 22 21:01:10 juju-e4d256-prod-github-runner-207 kernel: [56244.573468] Aug 22 21:01:10 juju-e4d256-prod-github-runner-207 kernel: [56244.574355] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:01:10 juju-e4d256-prod-github-runner-207 kernel: [56244.575408] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:01:10 juju-e4d256-prod-github-runner-207 kernel: [56244.576462] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:01:10 juju-e4d256-prod-github-runner-207 kernel: [56244.577600] ? show_regs.part.0+0x23/0x29 Aug 22 21:01:10 juju-e4d256-prod-github-runner-207 kernel: [56244.578610] ? show_regs.cold+0x8/0xd Aug 22 21:01:10 juju-e4d256-prod-github-runner-207 kernel: [56244.579586] ? watchdog_timer_fn+0x1be/0x220 Aug 22 21:01:10 juju-e4d256-prod-github-runner-207 kernel: [56244.580636] ? lockup_detector_update_enable+0x60/0x60 Aug 22 21:01:10 juju-e4d256-prod-github-runner-207 kernel: [56244.581725] ? __hrtimer_run_queues+0x107/0x230 Aug 22 21:01:10 juju-e4d256-prod-github-runner-207 kernel: [56244.582812] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 21:01:10 juju-e4d256-prod-github-runner-207 kernel: [56244.583857] ? hrtimer_interrupt+0x101/0x220 Aug 22 21:01:10 juju-e4d256-prod-github-runner-207 kernel: [56244.584914] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 21:01:10 juju-e4d256-prod-github-runner-207 kernel: [56244.586000] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 21:01:10 juju-e4d256-prod-github-runner-207 kernel: [56244.587059] Aug 22 21:01:10 juju-e4d256-prod-github-runner-207 kernel: [56244.587919] Aug 22 21:01:10 juju-e4d256-prod-github-runner-207 kernel: [56244.588777] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 21:01:10 juju-e4d256-prod-github-runner-207 kernel: [56244.589827] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:01:10 juju-e4d256-prod-github-runner-207 kernel: [56244.590877] ? _raw_spin_lock+0x22/0x30 Aug 22 21:01:10 juju-e4d256-prod-github-runner-207 kernel: [56244.591868] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:01:10 juju-e4d256-prod-github-runner-207 kernel: [56244.592919] direct_page_fault+0x206/0x310 [kvm] Aug 22 21:01:10 juju-e4d256-prod-github-runner-207 kernel: [56244.593998] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 21:01:10 juju-e4d256-prod-github-runner-207 kernel: [56244.595062] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 21:01:10 juju-e4d256-prod-github-runner-207 kernel: [56244.596150] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 21:01:10 juju-e4d256-prod-github-runner-207 kernel: [56244.597232] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 21:01:10 juju-e4d256-prod-github-runner-207 kernel: [56244.598258] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 21:01:10 juju-e4d256-prod-github-runner-207 kernel: [56244.599251] handle_exit+0x98/0x230 [kvm_amd] Aug 22 21:01:10 juju-e4d256-prod-github-runner-207 kernel: [56244.600172] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 21:01:10 juju-e4d256-prod-github-runner-207 kernel: [56244.601111] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 21:01:10 juju-e4d256-prod-github-runner-207 kernel: [56244.602067] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 21:01:10 juju-e4d256-prod-github-runner-207 kernel: [56244.602996] vcpu_run+0x62/0x2c0 [kvm] Aug 22 21:01:10 juju-e4d256-prod-github-runner-207 kernel: [56244.603818] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 21:01:10 juju-e4d256-prod-github-runner-207 kernel: [56244.604668] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 21:01:10 juju-e4d256-prod-github-runner-207 kernel: [56244.605538] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 21:01:10 juju-e4d256-prod-github-runner-207 kernel: [56244.606351] ? __seccomp_filter+0x4a/0x4a0 Aug 22 21:01:10 juju-e4d256-prod-github-runner-207 kernel: [56244.607102] ? __fget_files+0x86/0xc0 Aug 22 21:01:10 juju-e4d256-prod-github-runner-207 kernel: [56244.607813] __x64_sys_ioctl+0x95/0xd0 Aug 22 21:01:10 juju-e4d256-prod-github-runner-207 kernel: [56244.608521] do_syscall_64+0x5c/0xc0 Aug 22 21:01:10 juju-e4d256-prod-github-runner-207 kernel: [56244.609199] ? do_futex+0x162/0x1f0 Aug 22 21:01:10 juju-e4d256-prod-github-runner-207 kernel: [56244.609854] ? __x64_sys_futex+0x78/0x1e0 Aug 22 21:01:10 juju-e4d256-prod-github-runner-207 kernel: [56244.610534] ? __secure_computing+0xa9/0x120 Aug 22 21:01:10 juju-e4d256-prod-github-runner-207 kernel: [56244.611235] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 21:01:10 juju-e4d256-prod-github-runner-207 kernel: [56244.612018] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:01:10 juju-e4d256-prod-github-runner-207 kernel: [56244.612748] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:01:10 juju-e4d256-prod-github-runner-207 kernel: [56244.613479] ? do_syscall_64+0x69/0xc0 Aug 22 21:01:10 juju-e4d256-prod-github-runner-207 kernel: [56244.614139] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:01:10 juju-e4d256-prod-github-runner-207 kernel: [56244.614855] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:01:10 juju-e4d256-prod-github-runner-207 kernel: [56244.615561] ? do_syscall_64+0x69/0xc0 Aug 22 21:01:10 juju-e4d256-prod-github-runner-207 kernel: [56244.616214] ? do_syscall_64+0x69/0xc0 Aug 22 21:01:10 juju-e4d256-prod-github-runner-207 kernel: [56244.616848] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 21:01:10 juju-e4d256-prod-github-runner-207 kernel: [56244.617578] RIP: 0033:0x7faa5d0edaff Aug 22 21:01:10 juju-e4d256-prod-github-runner-207 kernel: [56244.618222] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 21:01:10 juju-e4d256-prod-github-runner-207 kernel: [56244.620465] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 21:01:10 juju-e4d256-prod-github-runner-207 kernel: [56244.621405] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 21:01:10 juju-e4d256-prod-github-runner-207 kernel: [56244.622343] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 21:01:10 juju-e4d256-prod-github-runner-207 kernel: [56244.623250] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 21:01:10 juju-e4d256-prod-github-runner-207 kernel: [56244.624194] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 21:01:10 juju-e4d256-prod-github-runner-207 kernel: [56244.625090] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 21:01:10 juju-e4d256-prod-github-runner-207 kernel: [56244.626008] Aug 22 21:01:38 juju-e4d256-prod-github-runner-207 kernel: [56272.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 52299s! [qemu-system-x86:6715] Aug 22 21:01:38 juju-e4d256-prod-github-runner-207 kernel: [56272.543874] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 21:01:38 juju-e4d256-prod-github-runner-207 kernel: [56272.544162] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 21:01:38 juju-e4d256-prod-github-runner-207 kernel: [56272.556497] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 21:01:38 juju-e4d256-prod-github-runner-207 kernel: [56272.557808] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 21:01:38 juju-e4d256-prod-github-runner-207 kernel: [56272.559047] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:01:38 juju-e4d256-prod-github-runner-207 kernel: [56272.560140] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 21:01:38 juju-e4d256-prod-github-runner-207 kernel: [56272.562681] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 21:01:38 juju-e4d256-prod-github-runner-207 kernel: [56272.563743] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 21:01:38 juju-e4d256-prod-github-runner-207 kernel: [56272.564899] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 21:01:38 juju-e4d256-prod-github-runner-207 kernel: [56272.566052] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 21:01:38 juju-e4d256-prod-github-runner-207 kernel: [56272.567215] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 21:01:38 juju-e4d256-prod-github-runner-207 kernel: [56272.568387] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 21:01:38 juju-e4d256-prod-github-runner-207 kernel: [56272.569548] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 21:01:38 juju-e4d256-prod-github-runner-207 kernel: [56272.570779] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 21:01:38 juju-e4d256-prod-github-runner-207 kernel: [56272.571887] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 21:01:38 juju-e4d256-prod-github-runner-207 kernel: [56272.573105] Call Trace: Aug 22 21:01:38 juju-e4d256-prod-github-runner-207 kernel: [56272.574015] Aug 22 21:01:38 juju-e4d256-prod-github-runner-207 kernel: [56272.574911] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:01:38 juju-e4d256-prod-github-runner-207 kernel: [56272.575950] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:01:38 juju-e4d256-prod-github-runner-207 kernel: [56272.576970] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:01:38 juju-e4d256-prod-github-runner-207 kernel: [56272.578060] ? show_regs.part.0+0x23/0x29 Aug 22 21:01:38 juju-e4d256-prod-github-runner-207 kernel: [56272.579057] ? show_regs.cold+0x8/0xd Aug 22 21:01:38 juju-e4d256-prod-github-runner-207 kernel: [56272.580035] ? watchdog_timer_fn+0x1be/0x220 Aug 22 21:01:38 juju-e4d256-prod-github-runner-207 kernel: [56272.581041] ? lockup_detector_update_enable+0x60/0x60 Aug 22 21:01:38 juju-e4d256-prod-github-runner-207 kernel: [56272.582111] ? __hrtimer_run_queues+0x107/0x230 Aug 22 21:01:38 juju-e4d256-prod-github-runner-207 kernel: [56272.583137] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 21:01:38 juju-e4d256-prod-github-runner-207 kernel: [56272.584164] ? hrtimer_interrupt+0x101/0x220 Aug 22 21:01:38 juju-e4d256-prod-github-runner-207 kernel: [56272.585188] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 21:01:38 juju-e4d256-prod-github-runner-207 kernel: [56272.586253] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 21:01:38 juju-e4d256-prod-github-runner-207 kernel: [56272.587295] Aug 22 21:01:38 juju-e4d256-prod-github-runner-207 kernel: [56272.588154] Aug 22 21:01:38 juju-e4d256-prod-github-runner-207 kernel: [56272.588996] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 21:01:38 juju-e4d256-prod-github-runner-207 kernel: [56272.590031] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:01:38 juju-e4d256-prod-github-runner-207 kernel: [56272.591078] ? _raw_spin_lock+0x22/0x30 Aug 22 21:01:38 juju-e4d256-prod-github-runner-207 kernel: [56272.592035] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:01:38 juju-e4d256-prod-github-runner-207 kernel: [56272.593067] direct_page_fault+0x206/0x310 [kvm] Aug 22 21:01:38 juju-e4d256-prod-github-runner-207 kernel: [56272.594108] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 21:01:38 juju-e4d256-prod-github-runner-207 kernel: [56272.595119] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 21:01:38 juju-e4d256-prod-github-runner-207 kernel: [56272.596124] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 21:01:38 juju-e4d256-prod-github-runner-207 kernel: [56272.597124] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 21:01:38 juju-e4d256-prod-github-runner-207 kernel: [56272.598075] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 21:01:38 juju-e4d256-prod-github-runner-207 kernel: [56272.599052] handle_exit+0x98/0x230 [kvm_amd] Aug 22 21:01:38 juju-e4d256-prod-github-runner-207 kernel: [56272.599950] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 21:01:38 juju-e4d256-prod-github-runner-207 kernel: [56272.600861] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 21:01:38 juju-e4d256-prod-github-runner-207 kernel: [56272.601787] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 21:01:38 juju-e4d256-prod-github-runner-207 kernel: [56272.602689] vcpu_run+0x62/0x2c0 [kvm] Aug 22 21:01:38 juju-e4d256-prod-github-runner-207 kernel: [56272.603497] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 21:01:38 juju-e4d256-prod-github-runner-207 kernel: [56272.604308] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 21:01:38 juju-e4d256-prod-github-runner-207 kernel: [56272.605162] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 21:01:38 juju-e4d256-prod-github-runner-207 kernel: [56272.605955] ? __seccomp_filter+0x4a/0x4a0 Aug 22 21:01:38 juju-e4d256-prod-github-runner-207 kernel: [56272.606693] ? __fget_files+0x86/0xc0 Aug 22 21:01:38 juju-e4d256-prod-github-runner-207 kernel: [56272.607392] __x64_sys_ioctl+0x95/0xd0 Aug 22 21:01:38 juju-e4d256-prod-github-runner-207 kernel: [56272.608098] do_syscall_64+0x5c/0xc0 Aug 22 21:01:38 juju-e4d256-prod-github-runner-207 kernel: [56272.608760] ? do_futex+0x162/0x1f0 Aug 22 21:01:38 juju-e4d256-prod-github-runner-207 kernel: [56272.609405] ? __x64_sys_futex+0x78/0x1e0 Aug 22 21:01:38 juju-e4d256-prod-github-runner-207 kernel: [56272.610087] ? __secure_computing+0xa9/0x120 Aug 22 21:01:38 juju-e4d256-prod-github-runner-207 kernel: [56272.610774] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 21:01:38 juju-e4d256-prod-github-runner-207 kernel: [56272.611536] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:01:38 juju-e4d256-prod-github-runner-207 kernel: [56272.612272] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:01:38 juju-e4d256-prod-github-runner-207 kernel: [56272.612991] ? do_syscall_64+0x69/0xc0 Aug 22 21:01:38 juju-e4d256-prod-github-runner-207 kernel: [56272.613648] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:01:38 juju-e4d256-prod-github-runner-207 kernel: [56272.614353] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:01:38 juju-e4d256-prod-github-runner-207 kernel: [56272.615042] ? do_syscall_64+0x69/0xc0 Aug 22 21:01:38 juju-e4d256-prod-github-runner-207 kernel: [56272.615678] ? do_syscall_64+0x69/0xc0 Aug 22 21:01:38 juju-e4d256-prod-github-runner-207 kernel: [56272.616296] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 21:01:38 juju-e4d256-prod-github-runner-207 kernel: [56272.617019] RIP: 0033:0x7faa5d0edaff Aug 22 21:01:38 juju-e4d256-prod-github-runner-207 kernel: [56272.617666] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 21:01:38 juju-e4d256-prod-github-runner-207 kernel: [56272.619692] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 21:01:38 juju-e4d256-prod-github-runner-207 kernel: [56272.620605] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 21:01:38 juju-e4d256-prod-github-runner-207 kernel: [56272.621674] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 21:01:38 juju-e4d256-prod-github-runner-207 kernel: [56272.622560] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 21:01:38 juju-e4d256-prod-github-runner-207 kernel: [56272.623447] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 21:01:38 juju-e4d256-prod-github-runner-207 kernel: [56272.624349] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 21:01:38 juju-e4d256-prod-github-runner-207 kernel: [56272.625239] Aug 22 21:02:06 juju-e4d256-prod-github-runner-207 kernel: [56300.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 52325s! [qemu-system-x86:6715] Aug 22 21:02:06 juju-e4d256-prod-github-runner-207 kernel: [56300.543118] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 21:02:06 juju-e4d256-prod-github-runner-207 kernel: [56300.543195] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 21:02:06 juju-e4d256-prod-github-runner-207 kernel: [56300.555344] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 21:02:06 juju-e4d256-prod-github-runner-207 kernel: [56300.556616] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 21:02:06 juju-e4d256-prod-github-runner-207 kernel: [56300.557840] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:02:06 juju-e4d256-prod-github-runner-207 kernel: [56300.558905] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 21:02:06 juju-e4d256-prod-github-runner-207 kernel: [56300.561482] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 21:02:06 juju-e4d256-prod-github-runner-207 kernel: [56300.562528] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 21:02:06 juju-e4d256-prod-github-runner-207 kernel: [56300.563717] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 21:02:06 juju-e4d256-prod-github-runner-207 kernel: [56300.564882] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 21:02:06 juju-e4d256-prod-github-runner-207 kernel: [56300.566046] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 21:02:06 juju-e4d256-prod-github-runner-207 kernel: [56300.567224] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 21:02:06 juju-e4d256-prod-github-runner-207 kernel: [56300.568402] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 21:02:06 juju-e4d256-prod-github-runner-207 kernel: [56300.569634] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 21:02:06 juju-e4d256-prod-github-runner-207 kernel: [56300.570730] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 21:02:06 juju-e4d256-prod-github-runner-207 kernel: [56300.571942] Call Trace: Aug 22 21:02:06 juju-e4d256-prod-github-runner-207 kernel: [56300.572855] Aug 22 21:02:06 juju-e4d256-prod-github-runner-207 kernel: [56300.573739] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:02:06 juju-e4d256-prod-github-runner-207 kernel: [56300.574798] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:02:06 juju-e4d256-prod-github-runner-207 kernel: [56300.575832] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:02:06 juju-e4d256-prod-github-runner-207 kernel: [56300.576919] ? show_regs.part.0+0x23/0x29 Aug 22 21:02:06 juju-e4d256-prod-github-runner-207 kernel: [56300.577924] ? show_regs.cold+0x8/0xd Aug 22 21:02:06 juju-e4d256-prod-github-runner-207 kernel: [56300.578903] ? watchdog_timer_fn+0x1be/0x220 Aug 22 21:02:06 juju-e4d256-prod-github-runner-207 kernel: [56300.579926] ? lockup_detector_update_enable+0x60/0x60 Aug 22 21:02:06 juju-e4d256-prod-github-runner-207 kernel: [56300.580990] ? __hrtimer_run_queues+0x107/0x230 Aug 22 21:02:06 juju-e4d256-prod-github-runner-207 kernel: [56300.582016] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 21:02:06 juju-e4d256-prod-github-runner-207 kernel: [56300.583051] ? hrtimer_interrupt+0x101/0x220 Aug 22 21:02:06 juju-e4d256-prod-github-runner-207 kernel: [56300.584088] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 21:02:06 juju-e4d256-prod-github-runner-207 kernel: [56300.585158] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 21:02:06 juju-e4d256-prod-github-runner-207 kernel: [56300.586203] Aug 22 21:02:06 juju-e4d256-prod-github-runner-207 kernel: [56300.587098] Aug 22 21:02:06 juju-e4d256-prod-github-runner-207 kernel: [56300.587951] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 21:02:06 juju-e4d256-prod-github-runner-207 kernel: [56300.588992] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:02:06 juju-e4d256-prod-github-runner-207 kernel: [56300.590032] ? _raw_spin_lock+0x22/0x30 Aug 22 21:02:06 juju-e4d256-prod-github-runner-207 kernel: [56300.590985] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:02:06 juju-e4d256-prod-github-runner-207 kernel: [56300.592021] direct_page_fault+0x206/0x310 [kvm] Aug 22 21:02:06 juju-e4d256-prod-github-runner-207 kernel: [56300.593045] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 21:02:06 juju-e4d256-prod-github-runner-207 kernel: [56300.594054] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 21:02:06 juju-e4d256-prod-github-runner-207 kernel: [56300.595090] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 21:02:06 juju-e4d256-prod-github-runner-207 kernel: [56300.596149] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 21:02:06 juju-e4d256-prod-github-runner-207 kernel: [56300.597125] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 21:02:06 juju-e4d256-prod-github-runner-207 kernel: [56300.598118] handle_exit+0x98/0x230 [kvm_amd] Aug 22 21:02:06 juju-e4d256-prod-github-runner-207 kernel: [56300.599014] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 21:02:06 juju-e4d256-prod-github-runner-207 kernel: [56300.599949] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 21:02:06 juju-e4d256-prod-github-runner-207 kernel: [56300.600892] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 21:02:06 juju-e4d256-prod-github-runner-207 kernel: [56300.601803] vcpu_run+0x62/0x2c0 [kvm] Aug 22 21:02:06 juju-e4d256-prod-github-runner-207 kernel: [56300.602619] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 21:02:06 juju-e4d256-prod-github-runner-207 kernel: [56300.603449] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 21:02:06 juju-e4d256-prod-github-runner-207 kernel: [56300.604330] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 21:02:06 juju-e4d256-prod-github-runner-207 kernel: [56300.605149] ? __seccomp_filter+0x4a/0x4a0 Aug 22 21:02:06 juju-e4d256-prod-github-runner-207 kernel: [56300.605897] ? __fget_files+0x86/0xc0 Aug 22 21:02:06 juju-e4d256-prod-github-runner-207 kernel: [56300.606642] __x64_sys_ioctl+0x95/0xd0 Aug 22 21:02:06 juju-e4d256-prod-github-runner-207 kernel: [56300.607355] do_syscall_64+0x5c/0xc0 Aug 22 21:02:06 juju-e4d256-prod-github-runner-207 kernel: [56300.608024] ? do_futex+0x162/0x1f0 Aug 22 21:02:06 juju-e4d256-prod-github-runner-207 kernel: [56300.608674] ? __x64_sys_futex+0x78/0x1e0 Aug 22 21:02:06 juju-e4d256-prod-github-runner-207 kernel: [56300.609349] ? __secure_computing+0xa9/0x120 Aug 22 21:02:06 juju-e4d256-prod-github-runner-207 kernel: [56300.610039] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 21:02:06 juju-e4d256-prod-github-runner-207 kernel: [56300.610799] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:02:06 juju-e4d256-prod-github-runner-207 kernel: [56300.611531] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:02:06 juju-e4d256-prod-github-runner-207 kernel: [56300.612280] ? do_syscall_64+0x69/0xc0 Aug 22 21:02:06 juju-e4d256-prod-github-runner-207 kernel: [56300.612935] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:02:06 juju-e4d256-prod-github-runner-207 kernel: [56300.613639] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:02:06 juju-e4d256-prod-github-runner-207 kernel: [56300.614335] ? do_syscall_64+0x69/0xc0 Aug 22 21:02:06 juju-e4d256-prod-github-runner-207 kernel: [56300.615002] ? do_syscall_64+0x69/0xc0 Aug 22 21:02:06 juju-e4d256-prod-github-runner-207 kernel: [56300.615658] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 21:02:06 juju-e4d256-prod-github-runner-207 kernel: [56300.616371] RIP: 0033:0x7faa5d0edaff Aug 22 21:02:06 juju-e4d256-prod-github-runner-207 kernel: [56300.617213] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 21:02:06 juju-e4d256-prod-github-runner-207 kernel: [56300.619224] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 21:02:06 juju-e4d256-prod-github-runner-207 kernel: [56300.620167] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 21:02:06 juju-e4d256-prod-github-runner-207 kernel: [56300.621099] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 21:02:06 juju-e4d256-prod-github-runner-207 kernel: [56300.621993] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 21:02:06 juju-e4d256-prod-github-runner-207 kernel: [56300.622925] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 21:02:06 juju-e4d256-prod-github-runner-207 kernel: [56300.623831] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 21:02:06 juju-e4d256-prod-github-runner-207 kernel: [56300.624723] Aug 22 21:02:34 juju-e4d256-prod-github-runner-207 kernel: [56328.542006] watchdog: BUG: soft lockup - CPU#1 stuck for 52352s! [qemu-system-x86:6715] Aug 22 21:02:34 juju-e4d256-prod-github-runner-207 kernel: [56328.543160] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 21:02:34 juju-e4d256-prod-github-runner-207 kernel: [56328.543235] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 21:02:34 juju-e4d256-prod-github-runner-207 kernel: [56328.556622] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 21:02:34 juju-e4d256-prod-github-runner-207 kernel: [56328.558150] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 21:02:34 juju-e4d256-prod-github-runner-207 kernel: [56328.559478] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:02:34 juju-e4d256-prod-github-runner-207 kernel: [56328.560604] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 21:02:34 juju-e4d256-prod-github-runner-207 kernel: [56328.563219] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 21:02:34 juju-e4d256-prod-github-runner-207 kernel: [56328.564334] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 21:02:34 juju-e4d256-prod-github-runner-207 kernel: [56328.565523] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 21:02:34 juju-e4d256-prod-github-runner-207 kernel: [56328.566707] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 21:02:34 juju-e4d256-prod-github-runner-207 kernel: [56328.567917] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 21:02:34 juju-e4d256-prod-github-runner-207 kernel: [56328.569136] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 21:02:34 juju-e4d256-prod-github-runner-207 kernel: [56328.570389] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 21:02:34 juju-e4d256-prod-github-runner-207 kernel: [56328.571704] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 21:02:34 juju-e4d256-prod-github-runner-207 kernel: [56328.572824] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 21:02:34 juju-e4d256-prod-github-runner-207 kernel: [56328.574040] Call Trace: Aug 22 21:02:34 juju-e4d256-prod-github-runner-207 kernel: [56328.574962] Aug 22 21:02:34 juju-e4d256-prod-github-runner-207 kernel: [56328.576061] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:02:34 juju-e4d256-prod-github-runner-207 kernel: [56328.577497] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:02:34 juju-e4d256-prod-github-runner-207 kernel: [56328.578861] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:02:34 juju-e4d256-prod-github-runner-207 kernel: [56328.580262] ? show_regs.part.0+0x23/0x29 Aug 22 21:02:34 juju-e4d256-prod-github-runner-207 kernel: [56328.581599] ? show_regs.cold+0x8/0xd Aug 22 21:02:34 juju-e4d256-prod-github-runner-207 kernel: [56328.582966] ? watchdog_timer_fn+0x1be/0x220 Aug 22 21:02:34 juju-e4d256-prod-github-runner-207 kernel: [56328.584428] ? lockup_detector_update_enable+0x60/0x60 Aug 22 21:02:34 juju-e4d256-prod-github-runner-207 kernel: [56328.586002] ? __hrtimer_run_queues+0x107/0x230 Aug 22 21:02:34 juju-e4d256-prod-github-runner-207 kernel: [56328.587195] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 21:02:34 juju-e4d256-prod-github-runner-207 kernel: [56328.588269] ? hrtimer_interrupt+0x101/0x220 Aug 22 21:02:34 juju-e4d256-prod-github-runner-207 kernel: [56328.589295] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 21:02:34 juju-e4d256-prod-github-runner-207 kernel: [56328.590375] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 21:02:34 juju-e4d256-prod-github-runner-207 kernel: [56328.591604] Aug 22 21:02:34 juju-e4d256-prod-github-runner-207 kernel: [56328.592468] Aug 22 21:02:34 juju-e4d256-prod-github-runner-207 kernel: [56328.593315] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 21:02:34 juju-e4d256-prod-github-runner-207 kernel: [56328.594509] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:02:34 juju-e4d256-prod-github-runner-207 kernel: [56328.595579] ? _raw_spin_lock+0x22/0x30 Aug 22 21:02:34 juju-e4d256-prod-github-runner-207 kernel: [56328.596535] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:02:34 juju-e4d256-prod-github-runner-207 kernel: [56328.597563] direct_page_fault+0x206/0x310 [kvm] Aug 22 21:02:34 juju-e4d256-prod-github-runner-207 kernel: [56328.598594] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 21:02:34 juju-e4d256-prod-github-runner-207 kernel: [56328.599635] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 21:02:34 juju-e4d256-prod-github-runner-207 kernel: [56328.600644] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 21:02:34 juju-e4d256-prod-github-runner-207 kernel: [56328.601620] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 21:02:34 juju-e4d256-prod-github-runner-207 kernel: [56328.602573] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 21:02:34 juju-e4d256-prod-github-runner-207 kernel: [56328.603658] handle_exit+0x98/0x230 [kvm_amd] Aug 22 21:02:34 juju-e4d256-prod-github-runner-207 kernel: [56328.604848] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 21:02:34 juju-e4d256-prod-github-runner-207 kernel: [56328.606066] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 21:02:34 juju-e4d256-prod-github-runner-207 kernel: [56328.607312] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 21:02:34 juju-e4d256-prod-github-runner-207 kernel: [56328.608578] vcpu_run+0x62/0x2c0 [kvm] Aug 22 21:02:34 juju-e4d256-prod-github-runner-207 kernel: [56328.609662] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 21:02:34 juju-e4d256-prod-github-runner-207 kernel: [56328.610761] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 21:02:34 juju-e4d256-prod-github-runner-207 kernel: [56328.611991] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 21:02:34 juju-e4d256-prod-github-runner-207 kernel: [56328.613031] ? __seccomp_filter+0x4a/0x4a0 Aug 22 21:02:34 juju-e4d256-prod-github-runner-207 kernel: [56328.613989] ? __fget_files+0x86/0xc0 Aug 22 21:02:34 juju-e4d256-prod-github-runner-207 kernel: [56328.614941] __x64_sys_ioctl+0x95/0xd0 Aug 22 21:02:34 juju-e4d256-prod-github-runner-207 kernel: [56328.615744] do_syscall_64+0x5c/0xc0 Aug 22 21:02:34 juju-e4d256-prod-github-runner-207 kernel: [56328.616677] ? do_futex+0x162/0x1f0 Aug 22 21:02:34 juju-e4d256-prod-github-runner-207 kernel: [56328.617552] ? __x64_sys_futex+0x78/0x1e0 Aug 22 21:02:34 juju-e4d256-prod-github-runner-207 kernel: [56328.618487] ? __secure_computing+0xa9/0x120 Aug 22 21:02:34 juju-e4d256-prod-github-runner-207 kernel: [56328.619458] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 21:02:34 juju-e4d256-prod-github-runner-207 kernel: [56328.620626] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:02:34 juju-e4d256-prod-github-runner-207 kernel: [56328.621742] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:02:34 juju-e4d256-prod-github-runner-207 kernel: [56328.622846] ? do_syscall_64+0x69/0xc0 Aug 22 21:02:34 juju-e4d256-prod-github-runner-207 kernel: [56328.623824] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:02:34 juju-e4d256-prod-github-runner-207 kernel: [56328.624637] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:02:34 juju-e4d256-prod-github-runner-207 kernel: [56328.625340] ? do_syscall_64+0x69/0xc0 Aug 22 21:02:34 juju-e4d256-prod-github-runner-207 kernel: [56328.625974] ? do_syscall_64+0x69/0xc0 Aug 22 21:02:34 juju-e4d256-prod-github-runner-207 kernel: [56328.626603] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 21:02:34 juju-e4d256-prod-github-runner-207 kernel: [56328.627336] RIP: 0033:0x7faa5d0edaff Aug 22 21:02:34 juju-e4d256-prod-github-runner-207 kernel: [56328.628167] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 21:02:34 juju-e4d256-prod-github-runner-207 kernel: [56328.630894] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 21:02:34 juju-e4d256-prod-github-runner-207 kernel: [56328.632094] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 21:02:34 juju-e4d256-prod-github-runner-207 kernel: [56328.633021] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 21:02:34 juju-e4d256-prod-github-runner-207 kernel: [56328.633936] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 21:02:34 juju-e4d256-prod-github-runner-207 kernel: [56328.634831] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 21:02:34 juju-e4d256-prod-github-runner-207 kernel: [56328.635761] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 21:02:34 juju-e4d256-prod-github-runner-207 kernel: [56328.636665] Aug 22 21:02:47 juju-e4d256-prod-github-runner-207 kernel: [56340.944707] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 21:02:47 juju-e4d256-prod-github-runner-207 kernel: [56340.945707] rcu: 1-....: (14011713 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=6772696 Aug 22 21:02:47 juju-e4d256-prod-github-runner-207 kernel: [56340.946828] (t=14055936 jiffies g=23269 q=51586) Aug 22 21:02:47 juju-e4d256-prod-github-runner-207 kernel: [56340.947629] NMI backtrace for cpu 1 Aug 22 21:02:47 juju-e4d256-prod-github-runner-207 kernel: [56340.948336] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 21:02:47 juju-e4d256-prod-github-runner-207 kernel: [56340.949458] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 21:02:47 juju-e4d256-prod-github-runner-207 kernel: [56340.950519] Call Trace: Aug 22 21:02:47 juju-e4d256-prod-github-runner-207 kernel: [56340.951204] Aug 22 21:02:47 juju-e4d256-prod-github-runner-207 kernel: [56340.951856] show_stack+0x52/0x5c Aug 22 21:02:47 juju-e4d256-prod-github-runner-207 kernel: [56340.952579] dump_stack_lvl+0x4a/0x63 Aug 22 21:02:47 juju-e4d256-prod-github-runner-207 kernel: [56340.953329] dump_stack+0x10/0x16 Aug 22 21:02:47 juju-e4d256-prod-github-runner-207 kernel: [56340.954086] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 21:02:47 juju-e4d256-prod-github-runner-207 kernel: [56340.954925] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 21:02:47 juju-e4d256-prod-github-runner-207 kernel: [56340.955750] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 21:02:47 juju-e4d256-prod-github-runner-207 kernel: [56340.956570] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 21:02:47 juju-e4d256-prod-github-runner-207 kernel: [56340.957391] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 21:02:47 juju-e4d256-prod-github-runner-207 kernel: [56340.958197] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 21:02:47 juju-e4d256-prod-github-runner-207 kernel: [56340.959000] print_cpu_stall.cold+0x2f/0xe2 Aug 22 21:02:47 juju-e4d256-prod-github-runner-207 kernel: [56340.959766] ? timekeeping_update+0xf7/0x150 Aug 22 21:02:47 juju-e4d256-prod-github-runner-207 kernel: [56340.960533] check_cpu_stall+0x109/0x270 Aug 22 21:02:47 juju-e4d256-prod-github-runner-207 kernel: [56340.961285] rcu_sched_clock_irq+0x9a/0x250 Aug 22 21:02:47 juju-e4d256-prod-github-runner-207 kernel: [56340.962064] update_process_times+0x94/0xd0 Aug 22 21:02:47 juju-e4d256-prod-github-runner-207 kernel: [56340.962825] tick_sched_handle+0x29/0x70 Aug 22 21:02:47 juju-e4d256-prod-github-runner-207 kernel: [56340.963576] tick_sched_timer+0x8c/0xc0 Aug 22 21:02:47 juju-e4d256-prod-github-runner-207 kernel: [56340.964313] ? tick_nohz_handler+0xb0/0xb0 Aug 22 21:02:47 juju-e4d256-prod-github-runner-207 kernel: [56340.965070] __hrtimer_run_queues+0x107/0x230 Aug 22 21:02:47 juju-e4d256-prod-github-runner-207 kernel: [56340.965853] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 21:02:47 juju-e4d256-prod-github-runner-207 kernel: [56340.966636] hrtimer_interrupt+0x101/0x220 Aug 22 21:02:47 juju-e4d256-prod-github-runner-207 kernel: [56340.967413] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 21:02:47 juju-e4d256-prod-github-runner-207 kernel: [56340.968227] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 21:02:47 juju-e4d256-prod-github-runner-207 kernel: [56340.969025] Aug 22 21:02:47 juju-e4d256-prod-github-runner-207 kernel: [56340.969657] Aug 22 21:02:47 juju-e4d256-prod-github-runner-207 kernel: [56340.970282] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 21:02:47 juju-e4d256-prod-github-runner-207 kernel: [56340.971115] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:02:47 juju-e4d256-prod-github-runner-207 kernel: [56340.971993] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 21:02:47 juju-e4d256-prod-github-runner-207 kernel: [56340.974190] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 21:02:47 juju-e4d256-prod-github-runner-207 kernel: [56340.975069] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 21:02:47 juju-e4d256-prod-github-runner-207 kernel: [56340.976064] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 21:02:47 juju-e4d256-prod-github-runner-207 kernel: [56340.977039] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 21:02:47 juju-e4d256-prod-github-runner-207 kernel: [56340.978004] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 21:02:47 juju-e4d256-prod-github-runner-207 kernel: [56340.978991] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 21:02:47 juju-e4d256-prod-github-runner-207 kernel: [56340.979947] ? _raw_spin_lock+0x22/0x30 Aug 22 21:02:47 juju-e4d256-prod-github-runner-207 kernel: [56340.980700] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:02:47 juju-e4d256-prod-github-runner-207 kernel: [56340.981531] direct_page_fault+0x206/0x310 [kvm] Aug 22 21:02:47 juju-e4d256-prod-github-runner-207 kernel: [56340.982370] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 21:02:47 juju-e4d256-prod-github-runner-207 kernel: [56340.983206] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 21:02:47 juju-e4d256-prod-github-runner-207 kernel: [56340.984029] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 21:02:47 juju-e4d256-prod-github-runner-207 kernel: [56340.984830] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 21:02:47 juju-e4d256-prod-github-runner-207 kernel: [56340.985613] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 21:02:47 juju-e4d256-prod-github-runner-207 kernel: [56340.986455] handle_exit+0x98/0x230 [kvm_amd] Aug 22 21:02:47 juju-e4d256-prod-github-runner-207 kernel: [56340.987224] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 21:02:47 juju-e4d256-prod-github-runner-207 kernel: [56340.988004] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 21:02:47 juju-e4d256-prod-github-runner-207 kernel: [56340.988797] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 21:02:47 juju-e4d256-prod-github-runner-207 kernel: [56340.989576] vcpu_run+0x62/0x2c0 [kvm] Aug 22 21:02:47 juju-e4d256-prod-github-runner-207 kernel: [56340.990315] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 21:02:47 juju-e4d256-prod-github-runner-207 kernel: [56340.991060] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 21:02:47 juju-e4d256-prod-github-runner-207 kernel: [56340.991860] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 21:02:47 juju-e4d256-prod-github-runner-207 kernel: [56340.992621] ? __seccomp_filter+0x4a/0x4a0 Aug 22 21:02:47 juju-e4d256-prod-github-runner-207 kernel: [56340.993339] ? __fget_files+0x86/0xc0 Aug 22 21:02:47 juju-e4d256-prod-github-runner-207 kernel: [56340.994030] __x64_sys_ioctl+0x95/0xd0 Aug 22 21:02:47 juju-e4d256-prod-github-runner-207 kernel: [56340.994725] do_syscall_64+0x5c/0xc0 Aug 22 21:02:47 juju-e4d256-prod-github-runner-207 kernel: [56340.995425] ? do_futex+0x162/0x1f0 Aug 22 21:02:47 juju-e4d256-prod-github-runner-207 kernel: [56340.996130] ? __x64_sys_futex+0x78/0x1e0 Aug 22 21:02:47 juju-e4d256-prod-github-runner-207 kernel: [56340.996836] ? __secure_computing+0xa9/0x120 Aug 22 21:02:47 juju-e4d256-prod-github-runner-207 kernel: [56340.997547] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 21:02:47 juju-e4d256-prod-github-runner-207 kernel: [56340.998332] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:02:47 juju-e4d256-prod-github-runner-207 kernel: [56340.999122] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:02:47 juju-e4d256-prod-github-runner-207 kernel: [56340.999875] ? do_syscall_64+0x69/0xc0 Aug 22 21:02:47 juju-e4d256-prod-github-runner-207 kernel: [56341.000561] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:02:47 juju-e4d256-prod-github-runner-207 kernel: [56341.001315] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:02:47 juju-e4d256-prod-github-runner-207 kernel: [56341.002071] ? do_syscall_64+0x69/0xc0 Aug 22 21:02:47 juju-e4d256-prod-github-runner-207 kernel: [56341.002762] ? do_syscall_64+0x69/0xc0 Aug 22 21:02:47 juju-e4d256-prod-github-runner-207 kernel: [56341.003456] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 21:02:47 juju-e4d256-prod-github-runner-207 kernel: [56341.004224] RIP: 0033:0x7faa5d0edaff Aug 22 21:02:47 juju-e4d256-prod-github-runner-207 kernel: [56341.004903] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 21:02:47 juju-e4d256-prod-github-runner-207 kernel: [56341.007006] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 21:02:47 juju-e4d256-prod-github-runner-207 kernel: [56341.007964] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 21:02:47 juju-e4d256-prod-github-runner-207 kernel: [56341.008906] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 21:02:47 juju-e4d256-prod-github-runner-207 kernel: [56341.009847] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 21:02:47 juju-e4d256-prod-github-runner-207 kernel: [56341.010788] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 21:02:47 juju-e4d256-prod-github-runner-207 kernel: [56341.011727] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 21:02:47 juju-e4d256-prod-github-runner-207 kernel: [56341.012638] Aug 22 21:03:14 juju-e4d256-prod-github-runner-207 kernel: [56368.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 52389s! [qemu-system-x86:6715] Aug 22 21:03:14 juju-e4d256-prod-github-runner-207 kernel: [56368.543853] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 21:03:14 juju-e4d256-prod-github-runner-207 kernel: [56368.544160] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 21:03:14 juju-e4d256-prod-github-runner-207 kernel: [56368.556495] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 21:03:14 juju-e4d256-prod-github-runner-207 kernel: [56368.557841] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 21:03:14 juju-e4d256-prod-github-runner-207 kernel: [56368.559235] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:03:14 juju-e4d256-prod-github-runner-207 kernel: [56368.560469] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 21:03:14 juju-e4d256-prod-github-runner-207 kernel: [56368.563071] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 21:03:14 juju-e4d256-prod-github-runner-207 kernel: [56368.564119] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 21:03:14 juju-e4d256-prod-github-runner-207 kernel: [56368.565321] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 21:03:14 juju-e4d256-prod-github-runner-207 kernel: [56368.566484] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 21:03:14 juju-e4d256-prod-github-runner-207 kernel: [56368.567656] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 21:03:14 juju-e4d256-prod-github-runner-207 kernel: [56368.568817] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 21:03:14 juju-e4d256-prod-github-runner-207 kernel: [56368.569982] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 21:03:14 juju-e4d256-prod-github-runner-207 kernel: [56368.571221] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 21:03:14 juju-e4d256-prod-github-runner-207 kernel: [56368.572324] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 21:03:14 juju-e4d256-prod-github-runner-207 kernel: [56368.573517] Call Trace: Aug 22 21:03:14 juju-e4d256-prod-github-runner-207 kernel: [56368.574439] Aug 22 21:03:14 juju-e4d256-prod-github-runner-207 kernel: [56368.575423] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:03:14 juju-e4d256-prod-github-runner-207 kernel: [56368.576469] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:03:14 juju-e4d256-prod-github-runner-207 kernel: [56368.577493] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:03:14 juju-e4d256-prod-github-runner-207 kernel: [56368.578616] ? show_regs.part.0+0x23/0x29 Aug 22 21:03:14 juju-e4d256-prod-github-runner-207 kernel: [56368.579615] ? show_regs.cold+0x8/0xd Aug 22 21:03:14 juju-e4d256-prod-github-runner-207 kernel: [56368.580588] ? watchdog_timer_fn+0x1be/0x220 Aug 22 21:03:14 juju-e4d256-prod-github-runner-207 kernel: [56368.581595] ? lockup_detector_update_enable+0x60/0x60 Aug 22 21:03:14 juju-e4d256-prod-github-runner-207 kernel: [56368.582678] ? __hrtimer_run_queues+0x107/0x230 Aug 22 21:03:14 juju-e4d256-prod-github-runner-207 kernel: [56368.583706] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 21:03:14 juju-e4d256-prod-github-runner-207 kernel: [56368.584734] ? hrtimer_interrupt+0x101/0x220 Aug 22 21:03:14 juju-e4d256-prod-github-runner-207 kernel: [56368.585747] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 21:03:14 juju-e4d256-prod-github-runner-207 kernel: [56368.586840] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 21:03:14 juju-e4d256-prod-github-runner-207 kernel: [56368.587890] Aug 22 21:03:14 juju-e4d256-prod-github-runner-207 kernel: [56368.588744] Aug 22 21:03:14 juju-e4d256-prod-github-runner-207 kernel: [56368.589581] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 21:03:14 juju-e4d256-prod-github-runner-207 kernel: [56368.590633] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:03:14 juju-e4d256-prod-github-runner-207 kernel: [56368.591673] ? _raw_spin_lock+0x22/0x30 Aug 22 21:03:14 juju-e4d256-prod-github-runner-207 kernel: [56368.592625] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:03:14 juju-e4d256-prod-github-runner-207 kernel: [56368.593644] direct_page_fault+0x206/0x310 [kvm] Aug 22 21:03:14 juju-e4d256-prod-github-runner-207 kernel: [56368.594691] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 21:03:14 juju-e4d256-prod-github-runner-207 kernel: [56368.595710] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 21:03:14 juju-e4d256-prod-github-runner-207 kernel: [56368.596721] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 21:03:14 juju-e4d256-prod-github-runner-207 kernel: [56368.597737] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 21:03:14 juju-e4d256-prod-github-runner-207 kernel: [56368.598711] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 21:03:14 juju-e4d256-prod-github-runner-207 kernel: [56368.599694] handle_exit+0x98/0x230 [kvm_amd] Aug 22 21:03:14 juju-e4d256-prod-github-runner-207 kernel: [56368.600586] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 21:03:14 juju-e4d256-prod-github-runner-207 kernel: [56368.601505] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 21:03:14 juju-e4d256-prod-github-runner-207 kernel: [56368.602435] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 21:03:14 juju-e4d256-prod-github-runner-207 kernel: [56368.603356] vcpu_run+0x62/0x2c0 [kvm] Aug 22 21:03:14 juju-e4d256-prod-github-runner-207 kernel: [56368.604174] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 21:03:14 juju-e4d256-prod-github-runner-207 kernel: [56368.604988] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 21:03:14 juju-e4d256-prod-github-runner-207 kernel: [56368.605863] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 21:03:14 juju-e4d256-prod-github-runner-207 kernel: [56368.606684] ? __seccomp_filter+0x4a/0x4a0 Aug 22 21:03:14 juju-e4d256-prod-github-runner-207 kernel: [56368.607429] ? __fget_files+0x86/0xc0 Aug 22 21:03:14 juju-e4d256-prod-github-runner-207 kernel: [56368.608140] __x64_sys_ioctl+0x95/0xd0 Aug 22 21:03:14 juju-e4d256-prod-github-runner-207 kernel: [56368.608834] do_syscall_64+0x5c/0xc0 Aug 22 21:03:14 juju-e4d256-prod-github-runner-207 kernel: [56368.609501] ? do_futex+0x162/0x1f0 Aug 22 21:03:14 juju-e4d256-prod-github-runner-207 kernel: [56368.610161] ? __x64_sys_futex+0x78/0x1e0 Aug 22 21:03:14 juju-e4d256-prod-github-runner-207 kernel: [56368.610884] ? __secure_computing+0xa9/0x120 Aug 22 21:03:14 juju-e4d256-prod-github-runner-207 kernel: [56368.611643] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 21:03:14 juju-e4d256-prod-github-runner-207 kernel: [56368.612417] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:03:14 juju-e4d256-prod-github-runner-207 kernel: [56368.613148] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:03:14 juju-e4d256-prod-github-runner-207 kernel: [56368.613871] ? do_syscall_64+0x69/0xc0 Aug 22 21:03:14 juju-e4d256-prod-github-runner-207 kernel: [56368.614576] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:03:14 juju-e4d256-prod-github-runner-207 kernel: [56368.615283] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:03:14 juju-e4d256-prod-github-runner-207 kernel: [56368.615979] ? do_syscall_64+0x69/0xc0 Aug 22 21:03:14 juju-e4d256-prod-github-runner-207 kernel: [56368.616605] ? do_syscall_64+0x69/0xc0 Aug 22 21:03:14 juju-e4d256-prod-github-runner-207 kernel: [56368.617231] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 21:03:14 juju-e4d256-prod-github-runner-207 kernel: [56368.617939] RIP: 0033:0x7faa5d0edaff Aug 22 21:03:14 juju-e4d256-prod-github-runner-207 kernel: [56368.618631] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 21:03:14 juju-e4d256-prod-github-runner-207 kernel: [56368.620635] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 21:03:14 juju-e4d256-prod-github-runner-207 kernel: [56368.621566] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 21:03:14 juju-e4d256-prod-github-runner-207 kernel: [56368.622476] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 21:03:14 juju-e4d256-prod-github-runner-207 kernel: [56368.623405] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 21:03:14 juju-e4d256-prod-github-runner-207 kernel: [56368.624304] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 21:03:14 juju-e4d256-prod-github-runner-207 kernel: [56368.625197] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 21:03:14 juju-e4d256-prod-github-runner-207 kernel: [56368.626088] Aug 22 21:03:42 juju-e4d256-prod-github-runner-207 kernel: [56396.542537] watchdog: BUG: soft lockup - CPU#1 stuck for 52415s! [qemu-system-x86:6715] Aug 22 21:03:42 juju-e4d256-prod-github-runner-207 kernel: [56396.544801] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 21:03:42 juju-e4d256-prod-github-runner-207 kernel: [56396.544874] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 21:03:42 juju-e4d256-prod-github-runner-207 kernel: [56396.573942] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 21:03:42 juju-e4d256-prod-github-runner-207 kernel: [56396.575304] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 21:03:42 juju-e4d256-prod-github-runner-207 kernel: [56396.578597] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:03:42 juju-e4d256-prod-github-runner-207 kernel: [56396.581525] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 21:03:42 juju-e4d256-prod-github-runner-207 kernel: [56396.588340] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 21:03:42 juju-e4d256-prod-github-runner-207 kernel: [56396.589421] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 21:03:42 juju-e4d256-prod-github-runner-207 kernel: [56396.592573] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 21:03:42 juju-e4d256-prod-github-runner-207 kernel: [56396.595793] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 21:03:42 juju-e4d256-prod-github-runner-207 kernel: [56396.597024] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 21:03:42 juju-e4d256-prod-github-runner-207 kernel: [56396.600162] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 21:03:42 juju-e4d256-prod-github-runner-207 kernel: [56396.603355] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 21:03:42 juju-e4d256-prod-github-runner-207 kernel: [56396.606577] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 21:03:42 juju-e4d256-prod-github-runner-207 kernel: [56396.607758] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 21:03:42 juju-e4d256-prod-github-runner-207 kernel: [56396.611190] Call Trace: Aug 22 21:03:42 juju-e4d256-prod-github-runner-207 kernel: [56396.612115] Aug 22 21:03:42 juju-e4d256-prod-github-runner-207 kernel: [56396.615406] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:03:42 juju-e4d256-prod-github-runner-207 kernel: [56396.616627] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:03:42 juju-e4d256-prod-github-runner-207 kernel: [56396.617667] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:03:42 juju-e4d256-prod-github-runner-207 kernel: [56396.620952] ? show_regs.part.0+0x23/0x29 Aug 22 21:03:42 juju-e4d256-prod-github-runner-207 kernel: [56396.621958] ? show_regs.cold+0x8/0xd Aug 22 21:03:42 juju-e4d256-prod-github-runner-207 kernel: [56396.625157] ? watchdog_timer_fn+0x1be/0x220 Aug 22 21:03:42 juju-e4d256-prod-github-runner-207 kernel: [56396.626202] ? lockup_detector_update_enable+0x60/0x60 Aug 22 21:03:42 juju-e4d256-prod-github-runner-207 kernel: [56396.627801] ? __hrtimer_run_queues+0x107/0x230 Aug 22 21:03:42 juju-e4d256-prod-github-runner-207 kernel: [56396.630570] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 21:03:42 juju-e4d256-prod-github-runner-207 kernel: [56396.633733] ? hrtimer_interrupt+0x101/0x220 Aug 22 21:03:42 juju-e4d256-prod-github-runner-207 kernel: [56396.634794] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 21:03:42 juju-e4d256-prod-github-runner-207 kernel: [56396.637968] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 21:03:42 juju-e4d256-prod-github-runner-207 kernel: [56396.641248] Aug 22 21:03:42 juju-e4d256-prod-github-runner-207 kernel: [56396.642120] Aug 22 21:03:42 juju-e4d256-prod-github-runner-207 kernel: [56396.645118] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 21:03:42 juju-e4d256-prod-github-runner-207 kernel: [56396.646213] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:03:42 juju-e4d256-prod-github-runner-207 kernel: [56396.649420] ? _raw_spin_lock+0x22/0x30 Aug 22 21:03:42 juju-e4d256-prod-github-runner-207 kernel: [56396.652463] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:03:42 juju-e4d256-prod-github-runner-207 kernel: [56396.653549] direct_page_fault+0x206/0x310 [kvm] Aug 22 21:03:42 juju-e4d256-prod-github-runner-207 kernel: [56396.656764] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 21:03:42 juju-e4d256-prod-github-runner-207 kernel: [56396.659881] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 21:03:42 juju-e4d256-prod-github-runner-207 kernel: [56396.660910] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 21:03:42 juju-e4d256-prod-github-runner-207 kernel: [56396.661889] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 21:03:42 juju-e4d256-prod-github-runner-207 kernel: [56396.664826] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 21:03:42 juju-e4d256-prod-github-runner-207 kernel: [56396.665830] handle_exit+0x98/0x230 [kvm_amd] Aug 22 21:03:42 juju-e4d256-prod-github-runner-207 kernel: [56396.669191] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 21:03:42 juju-e4d256-prod-github-runner-207 kernel: [56396.670129] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 21:03:42 juju-e4d256-prod-github-runner-207 kernel: [56396.671141] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 21:03:42 juju-e4d256-prod-github-runner-207 kernel: [56396.674258] vcpu_run+0x62/0x2c0 [kvm] Aug 22 21:03:42 juju-e4d256-prod-github-runner-207 kernel: [56396.675074] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 21:03:42 juju-e4d256-prod-github-runner-207 kernel: [56396.676415] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 21:03:42 juju-e4d256-prod-github-runner-207 kernel: [56396.679031] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 21:03:42 juju-e4d256-prod-github-runner-207 kernel: [56396.681896] ? __seccomp_filter+0x4a/0x4a0 Aug 22 21:03:42 juju-e4d256-prod-github-runner-207 kernel: [56396.682697] ? __fget_files+0x86/0xc0 Aug 22 21:03:42 juju-e4d256-prod-github-runner-207 kernel: [56396.683421] __x64_sys_ioctl+0x95/0xd0 Aug 22 21:03:42 juju-e4d256-prod-github-runner-207 kernel: [56396.684644] do_syscall_64+0x5c/0xc0 Aug 22 21:03:42 juju-e4d256-prod-github-runner-207 kernel: [56396.686941] ? do_futex+0x162/0x1f0 Aug 22 21:03:42 juju-e4d256-prod-github-runner-207 kernel: [56396.687598] ? __x64_sys_futex+0x78/0x1e0 Aug 22 21:03:42 juju-e4d256-prod-github-runner-207 kernel: [56396.688296] ? __secure_computing+0xa9/0x120 Aug 22 21:03:42 juju-e4d256-prod-github-runner-207 kernel: [56396.690050] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 21:03:42 juju-e4d256-prod-github-runner-207 kernel: [56396.691842] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:03:42 juju-e4d256-prod-github-runner-207 kernel: [56396.692572] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:03:42 juju-e4d256-prod-github-runner-207 kernel: [56396.694443] ? do_syscall_64+0x69/0xc0 Aug 22 21:03:42 juju-e4d256-prod-github-runner-207 kernel: [56396.696200] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:03:42 juju-e4d256-prod-github-runner-207 kernel: [56396.696910] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:03:42 juju-e4d256-prod-github-runner-207 kernel: [56396.697608] ? do_syscall_64+0x69/0xc0 Aug 22 21:03:42 juju-e4d256-prod-github-runner-207 kernel: [56396.700287] ? do_syscall_64+0x69/0xc0 Aug 22 21:03:42 juju-e4d256-prod-github-runner-207 kernel: [56396.700936] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 21:03:42 juju-e4d256-prod-github-runner-207 kernel: [56396.701663] RIP: 0033:0x7faa5d0edaff Aug 22 21:03:42 juju-e4d256-prod-github-runner-207 kernel: [56396.704475] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 21:03:42 juju-e4d256-prod-github-runner-207 kernel: [56396.706513] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 21:03:42 juju-e4d256-prod-github-runner-207 kernel: [56396.707428] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 21:03:42 juju-e4d256-prod-github-runner-207 kernel: [56396.708323] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 21:03:42 juju-e4d256-prod-github-runner-207 kernel: [56396.709241] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 21:03:42 juju-e4d256-prod-github-runner-207 kernel: [56396.710134] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 21:03:42 juju-e4d256-prod-github-runner-207 kernel: [56396.711053] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 21:03:42 juju-e4d256-prod-github-runner-207 kernel: [56396.711946] Aug 22 21:04:10 juju-e4d256-prod-github-runner-207 kernel: [56424.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 52441s! [qemu-system-x86:6715] Aug 22 21:04:10 juju-e4d256-prod-github-runner-207 kernel: [56424.543109] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 21:04:10 juju-e4d256-prod-github-runner-207 kernel: [56424.543182] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 21:04:10 juju-e4d256-prod-github-runner-207 kernel: [56424.555449] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 21:04:10 juju-e4d256-prod-github-runner-207 kernel: [56424.556820] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 21:04:10 juju-e4d256-prod-github-runner-207 kernel: [56424.558068] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:04:10 juju-e4d256-prod-github-runner-207 kernel: [56424.559167] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 21:04:10 juju-e4d256-prod-github-runner-207 kernel: [56424.561773] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 21:04:10 juju-e4d256-prod-github-runner-207 kernel: [56424.562844] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 21:04:10 juju-e4d256-prod-github-runner-207 kernel: [56424.564012] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 21:04:10 juju-e4d256-prod-github-runner-207 kernel: [56424.565176] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 21:04:10 juju-e4d256-prod-github-runner-207 kernel: [56424.566356] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 21:04:10 juju-e4d256-prod-github-runner-207 kernel: [56424.567526] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 21:04:10 juju-e4d256-prod-github-runner-207 kernel: [56424.568715] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 21:04:10 juju-e4d256-prod-github-runner-207 kernel: [56424.569968] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 21:04:10 juju-e4d256-prod-github-runner-207 kernel: [56424.571075] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 21:04:10 juju-e4d256-prod-github-runner-207 kernel: [56424.572270] Call Trace: Aug 22 21:04:10 juju-e4d256-prod-github-runner-207 kernel: [56424.573183] Aug 22 21:04:10 juju-e4d256-prod-github-runner-207 kernel: [56424.574087] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:04:10 juju-e4d256-prod-github-runner-207 kernel: [56424.575134] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:04:10 juju-e4d256-prod-github-runner-207 kernel: [56424.576183] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:04:10 juju-e4d256-prod-github-runner-207 kernel: [56424.577262] ? show_regs.part.0+0x23/0x29 Aug 22 21:04:10 juju-e4d256-prod-github-runner-207 kernel: [56424.578289] ? show_regs.cold+0x8/0xd Aug 22 21:04:10 juju-e4d256-prod-github-runner-207 kernel: [56424.579268] ? watchdog_timer_fn+0x1be/0x220 Aug 22 21:04:10 juju-e4d256-prod-github-runner-207 kernel: [56424.580276] ? lockup_detector_update_enable+0x60/0x60 Aug 22 21:04:10 juju-e4d256-prod-github-runner-207 kernel: [56424.581345] ? __hrtimer_run_queues+0x107/0x230 Aug 22 21:04:10 juju-e4d256-prod-github-runner-207 kernel: [56424.582394] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 21:04:10 juju-e4d256-prod-github-runner-207 kernel: [56424.583417] ? hrtimer_interrupt+0x101/0x220 Aug 22 21:04:10 juju-e4d256-prod-github-runner-207 kernel: [56424.584437] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 21:04:10 juju-e4d256-prod-github-runner-207 kernel: [56424.585509] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 21:04:10 juju-e4d256-prod-github-runner-207 kernel: [56424.586572] Aug 22 21:04:10 juju-e4d256-prod-github-runner-207 kernel: [56424.587552] Aug 22 21:04:10 juju-e4d256-prod-github-runner-207 kernel: [56424.588443] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 21:04:10 juju-e4d256-prod-github-runner-207 kernel: [56424.589511] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:04:10 juju-e4d256-prod-github-runner-207 kernel: [56424.590574] ? _raw_spin_lock+0x22/0x30 Aug 22 21:04:10 juju-e4d256-prod-github-runner-207 kernel: [56424.591563] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:04:10 juju-e4d256-prod-github-runner-207 kernel: [56424.592624] direct_page_fault+0x206/0x310 [kvm] Aug 22 21:04:10 juju-e4d256-prod-github-runner-207 kernel: [56424.593669] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 21:04:10 juju-e4d256-prod-github-runner-207 kernel: [56424.594737] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 21:04:10 juju-e4d256-prod-github-runner-207 kernel: [56424.595747] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 21:04:10 juju-e4d256-prod-github-runner-207 kernel: [56424.596715] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 21:04:10 juju-e4d256-prod-github-runner-207 kernel: [56424.597684] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 21:04:10 juju-e4d256-prod-github-runner-207 kernel: [56424.598834] handle_exit+0x98/0x230 [kvm_amd] Aug 22 21:04:10 juju-e4d256-prod-github-runner-207 kernel: [56424.599787] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 21:04:10 juju-e4d256-prod-github-runner-207 kernel: [56424.600770] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 21:04:10 juju-e4d256-prod-github-runner-207 kernel: [56424.601698] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 21:04:10 juju-e4d256-prod-github-runner-207 kernel: [56424.602651] vcpu_run+0x62/0x2c0 [kvm] Aug 22 21:04:10 juju-e4d256-prod-github-runner-207 kernel: [56424.603466] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 21:04:10 juju-e4d256-prod-github-runner-207 kernel: [56424.604281] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 21:04:10 juju-e4d256-prod-github-runner-207 kernel: [56424.605167] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 21:04:10 juju-e4d256-prod-github-runner-207 kernel: [56424.606002] ? __seccomp_filter+0x4a/0x4a0 Aug 22 21:04:10 juju-e4d256-prod-github-runner-207 kernel: [56424.606753] ? __fget_files+0x86/0xc0 Aug 22 21:04:10 juju-e4d256-prod-github-runner-207 kernel: [56424.607459] __x64_sys_ioctl+0x95/0xd0 Aug 22 21:04:10 juju-e4d256-prod-github-runner-207 kernel: [56424.608166] do_syscall_64+0x5c/0xc0 Aug 22 21:04:10 juju-e4d256-prod-github-runner-207 kernel: [56424.608844] ? do_futex+0x162/0x1f0 Aug 22 21:04:10 juju-e4d256-prod-github-runner-207 kernel: [56424.609574] ? __x64_sys_futex+0x78/0x1e0 Aug 22 21:04:10 juju-e4d256-prod-github-runner-207 kernel: [56424.610286] ? __secure_computing+0xa9/0x120 Aug 22 21:04:10 juju-e4d256-prod-github-runner-207 kernel: [56424.610984] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 21:04:10 juju-e4d256-prod-github-runner-207 kernel: [56424.611754] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:04:10 juju-e4d256-prod-github-runner-207 kernel: [56424.612481] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:04:10 juju-e4d256-prod-github-runner-207 kernel: [56424.613203] ? do_syscall_64+0x69/0xc0 Aug 22 21:04:10 juju-e4d256-prod-github-runner-207 kernel: [56424.613902] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:04:10 juju-e4d256-prod-github-runner-207 kernel: [56424.614624] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:04:10 juju-e4d256-prod-github-runner-207 kernel: [56424.615319] ? do_syscall_64+0x69/0xc0 Aug 22 21:04:10 juju-e4d256-prod-github-runner-207 kernel: [56424.615998] ? do_syscall_64+0x69/0xc0 Aug 22 21:04:10 juju-e4d256-prod-github-runner-207 kernel: [56424.616630] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 21:04:10 juju-e4d256-prod-github-runner-207 kernel: [56424.617375] RIP: 0033:0x7faa5d0edaff Aug 22 21:04:10 juju-e4d256-prod-github-runner-207 kernel: [56424.618033] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 21:04:10 juju-e4d256-prod-github-runner-207 kernel: [56424.620137] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 21:04:10 juju-e4d256-prod-github-runner-207 kernel: [56424.621071] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 21:04:10 juju-e4d256-prod-github-runner-207 kernel: [56424.621982] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 21:04:10 juju-e4d256-prod-github-runner-207 kernel: [56424.622911] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 21:04:10 juju-e4d256-prod-github-runner-207 kernel: [56424.623858] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 21:04:10 juju-e4d256-prod-github-runner-207 kernel: [56424.624773] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 21:04:10 juju-e4d256-prod-github-runner-207 kernel: [56424.625677] Aug 22 21:04:38 juju-e4d256-prod-github-runner-207 kernel: [56452.541980] watchdog: BUG: soft lockup - CPU#1 stuck for 52467s! [qemu-system-x86:6715] Aug 22 21:04:38 juju-e4d256-prod-github-runner-207 kernel: [56452.544299] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 21:04:38 juju-e4d256-prod-github-runner-207 kernel: [56452.544604] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 21:04:38 juju-e4d256-prod-github-runner-207 kernel: [56452.557134] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 21:04:38 juju-e4d256-prod-github-runner-207 kernel: [56452.558412] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 21:04:38 juju-e4d256-prod-github-runner-207 kernel: [56452.559634] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:04:38 juju-e4d256-prod-github-runner-207 kernel: [56452.560695] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 21:04:38 juju-e4d256-prod-github-runner-207 kernel: [56452.563268] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 21:04:38 juju-e4d256-prod-github-runner-207 kernel: [56452.564311] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 21:04:38 juju-e4d256-prod-github-runner-207 kernel: [56452.565504] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 21:04:38 juju-e4d256-prod-github-runner-207 kernel: [56452.566677] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 21:04:38 juju-e4d256-prod-github-runner-207 kernel: [56452.567849] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 21:04:38 juju-e4d256-prod-github-runner-207 kernel: [56452.569018] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 21:04:38 juju-e4d256-prod-github-runner-207 kernel: [56452.570193] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 21:04:38 juju-e4d256-prod-github-runner-207 kernel: [56452.571433] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 21:04:38 juju-e4d256-prod-github-runner-207 kernel: [56452.572556] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 21:04:38 juju-e4d256-prod-github-runner-207 kernel: [56452.573772] Call Trace: Aug 22 21:04:38 juju-e4d256-prod-github-runner-207 kernel: [56452.574686] Aug 22 21:04:38 juju-e4d256-prod-github-runner-207 kernel: [56452.575770] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:04:38 juju-e4d256-prod-github-runner-207 kernel: [56452.576816] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:04:38 juju-e4d256-prod-github-runner-207 kernel: [56452.577856] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:04:38 juju-e4d256-prod-github-runner-207 kernel: [56452.579104] ? show_regs.part.0+0x23/0x29 Aug 22 21:04:38 juju-e4d256-prod-github-runner-207 kernel: [56452.580184] ? show_regs.cold+0x8/0xd Aug 22 21:04:38 juju-e4d256-prod-github-runner-207 kernel: [56452.581230] ? watchdog_timer_fn+0x1be/0x220 Aug 22 21:04:38 juju-e4d256-prod-github-runner-207 kernel: [56452.582342] ? lockup_detector_update_enable+0x60/0x60 Aug 22 21:04:38 juju-e4d256-prod-github-runner-207 kernel: [56452.583506] ? __hrtimer_run_queues+0x107/0x230 Aug 22 21:04:38 juju-e4d256-prod-github-runner-207 kernel: [56452.584622] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 21:04:38 juju-e4d256-prod-github-runner-207 kernel: [56452.585744] ? hrtimer_interrupt+0x101/0x220 Aug 22 21:04:38 juju-e4d256-prod-github-runner-207 kernel: [56452.586846] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 21:04:38 juju-e4d256-prod-github-runner-207 kernel: [56452.588019] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 21:04:38 juju-e4d256-prod-github-runner-207 kernel: [56452.589156] Aug 22 21:04:38 juju-e4d256-prod-github-runner-207 kernel: [56452.590071] Aug 22 21:04:38 juju-e4d256-prod-github-runner-207 kernel: [56452.590955] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 21:04:38 juju-e4d256-prod-github-runner-207 kernel: [56452.592087] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:04:38 juju-e4d256-prod-github-runner-207 kernel: [56452.593237] ? _raw_spin_lock+0x22/0x30 Aug 22 21:04:38 juju-e4d256-prod-github-runner-207 kernel: [56452.594275] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:04:38 juju-e4d256-prod-github-runner-207 kernel: [56452.595385] direct_page_fault+0x206/0x310 [kvm] Aug 22 21:04:38 juju-e4d256-prod-github-runner-207 kernel: [56452.596502] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 21:04:38 juju-e4d256-prod-github-runner-207 kernel: [56452.597621] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 21:04:38 juju-e4d256-prod-github-runner-207 kernel: [56452.598816] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 21:04:38 juju-e4d256-prod-github-runner-207 kernel: [56452.599861] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 21:04:38 juju-e4d256-prod-github-runner-207 kernel: [56452.600831] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 21:04:38 juju-e4d256-prod-github-runner-207 kernel: [56452.601851] handle_exit+0x98/0x230 [kvm_amd] Aug 22 21:04:38 juju-e4d256-prod-github-runner-207 kernel: [56452.602794] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 21:04:38 juju-e4d256-prod-github-runner-207 kernel: [56452.603878] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 21:04:38 juju-e4d256-prod-github-runner-207 kernel: [56452.604930] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 21:04:38 juju-e4d256-prod-github-runner-207 kernel: [56452.605953] vcpu_run+0x62/0x2c0 [kvm] Aug 22 21:04:38 juju-e4d256-prod-github-runner-207 kernel: [56452.606837] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 21:04:38 juju-e4d256-prod-github-runner-207 kernel: [56452.607731] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 21:04:38 juju-e4d256-prod-github-runner-207 kernel: [56452.608692] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 21:04:38 juju-e4d256-prod-github-runner-207 kernel: [56452.609593] ? __seccomp_filter+0x4a/0x4a0 Aug 22 21:04:38 juju-e4d256-prod-github-runner-207 kernel: [56452.610432] ? __fget_files+0x86/0xc0 Aug 22 21:04:38 juju-e4d256-prod-github-runner-207 kernel: [56452.611217] __x64_sys_ioctl+0x95/0xd0 Aug 22 21:04:38 juju-e4d256-prod-github-runner-207 kernel: [56452.611993] do_syscall_64+0x5c/0xc0 Aug 22 21:04:38 juju-e4d256-prod-github-runner-207 kernel: [56452.612744] ? do_futex+0x162/0x1f0 Aug 22 21:04:38 juju-e4d256-prod-github-runner-207 kernel: [56452.613472] ? __x64_sys_futex+0x78/0x1e0 Aug 22 21:04:38 juju-e4d256-prod-github-runner-207 kernel: [56452.614237] ? __secure_computing+0xa9/0x120 Aug 22 21:04:38 juju-e4d256-prod-github-runner-207 kernel: [56452.615020] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 21:04:38 juju-e4d256-prod-github-runner-207 kernel: [56452.615886] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:04:38 juju-e4d256-prod-github-runner-207 kernel: [56452.616705] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:04:38 juju-e4d256-prod-github-runner-207 kernel: [56452.617536] ? do_syscall_64+0x69/0xc0 Aug 22 21:04:38 juju-e4d256-prod-github-runner-207 kernel: [56452.618262] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:04:38 juju-e4d256-prod-github-runner-207 kernel: [56452.619065] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:04:38 juju-e4d256-prod-github-runner-207 kernel: [56452.619860] ? do_syscall_64+0x69/0xc0 Aug 22 21:04:38 juju-e4d256-prod-github-runner-207 kernel: [56452.620565] ? do_syscall_64+0x69/0xc0 Aug 22 21:04:38 juju-e4d256-prod-github-runner-207 kernel: [56452.621263] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 21:04:38 juju-e4d256-prod-github-runner-207 kernel: [56452.622076] RIP: 0033:0x7faa5d0edaff Aug 22 21:04:38 juju-e4d256-prod-github-runner-207 kernel: [56452.622802] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 21:04:38 juju-e4d256-prod-github-runner-207 kernel: [56452.625150] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 21:04:38 juju-e4d256-prod-github-runner-207 kernel: [56452.626244] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 21:04:38 juju-e4d256-prod-github-runner-207 kernel: [56452.627264] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 21:04:38 juju-e4d256-prod-github-runner-207 kernel: [56452.628289] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 21:04:38 juju-e4d256-prod-github-runner-207 kernel: [56452.629313] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 21:04:38 juju-e4d256-prod-github-runner-207 kernel: [56452.630345] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 21:04:38 juju-e4d256-prod-github-runner-207 kernel: [56452.631378] Aug 22 21:05:06 juju-e4d256-prod-github-runner-207 kernel: [56480.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 52493s! [qemu-system-x86:6715] Aug 22 21:05:06 juju-e4d256-prod-github-runner-207 kernel: [56480.543111] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 21:05:06 juju-e4d256-prod-github-runner-207 kernel: [56480.543184] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 21:05:06 juju-e4d256-prod-github-runner-207 kernel: [56480.555340] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 21:05:06 juju-e4d256-prod-github-runner-207 kernel: [56480.556618] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 21:05:06 juju-e4d256-prod-github-runner-207 kernel: [56480.557861] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:05:06 juju-e4d256-prod-github-runner-207 kernel: [56480.558917] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 21:05:06 juju-e4d256-prod-github-runner-207 kernel: [56480.561493] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 21:05:06 juju-e4d256-prod-github-runner-207 kernel: [56480.562594] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 21:05:06 juju-e4d256-prod-github-runner-207 kernel: [56480.563754] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 21:05:06 juju-e4d256-prod-github-runner-207 kernel: [56480.564913] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 21:05:06 juju-e4d256-prod-github-runner-207 kernel: [56480.566095] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 21:05:06 juju-e4d256-prod-github-runner-207 kernel: [56480.567282] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 21:05:06 juju-e4d256-prod-github-runner-207 kernel: [56480.568492] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 21:05:06 juju-e4d256-prod-github-runner-207 kernel: [56480.569778] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 21:05:06 juju-e4d256-prod-github-runner-207 kernel: [56480.570902] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 21:05:06 juju-e4d256-prod-github-runner-207 kernel: [56480.572111] Call Trace: Aug 22 21:05:06 juju-e4d256-prod-github-runner-207 kernel: [56480.573035] Aug 22 21:05:06 juju-e4d256-prod-github-runner-207 kernel: [56480.573948] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:05:06 juju-e4d256-prod-github-runner-207 kernel: [56480.574976] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:05:06 juju-e4d256-prod-github-runner-207 kernel: [56480.575998] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:05:06 juju-e4d256-prod-github-runner-207 kernel: [56480.577079] ? show_regs.part.0+0x23/0x29 Aug 22 21:05:06 juju-e4d256-prod-github-runner-207 kernel: [56480.578093] ? show_regs.cold+0x8/0xd Aug 22 21:05:06 juju-e4d256-prod-github-runner-207 kernel: [56480.579068] ? watchdog_timer_fn+0x1be/0x220 Aug 22 21:05:06 juju-e4d256-prod-github-runner-207 kernel: [56480.580125] ? lockup_detector_update_enable+0x60/0x60 Aug 22 21:05:06 juju-e4d256-prod-github-runner-207 kernel: [56480.581233] ? __hrtimer_run_queues+0x107/0x230 Aug 22 21:05:06 juju-e4d256-prod-github-runner-207 kernel: [56480.582262] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 21:05:06 juju-e4d256-prod-github-runner-207 kernel: [56480.583287] ? hrtimer_interrupt+0x101/0x220 Aug 22 21:05:06 juju-e4d256-prod-github-runner-207 kernel: [56480.584307] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 21:05:06 juju-e4d256-prod-github-runner-207 kernel: [56480.585390] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 21:05:06 juju-e4d256-prod-github-runner-207 kernel: [56480.586437] Aug 22 21:05:06 juju-e4d256-prod-github-runner-207 kernel: [56480.587291] Aug 22 21:05:06 juju-e4d256-prod-github-runner-207 kernel: [56480.588132] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 21:05:06 juju-e4d256-prod-github-runner-207 kernel: [56480.589180] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:05:06 juju-e4d256-prod-github-runner-207 kernel: [56480.590223] ? _raw_spin_lock+0x22/0x30 Aug 22 21:05:06 juju-e4d256-prod-github-runner-207 kernel: [56480.591198] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:05:06 juju-e4d256-prod-github-runner-207 kernel: [56480.592235] direct_page_fault+0x206/0x310 [kvm] Aug 22 21:05:06 juju-e4d256-prod-github-runner-207 kernel: [56480.593277] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 21:05:06 juju-e4d256-prod-github-runner-207 kernel: [56480.594290] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 21:05:06 juju-e4d256-prod-github-runner-207 kernel: [56480.595288] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 21:05:06 juju-e4d256-prod-github-runner-207 kernel: [56480.596258] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 21:05:06 juju-e4d256-prod-github-runner-207 kernel: [56480.597227] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 21:05:06 juju-e4d256-prod-github-runner-207 kernel: [56480.598208] handle_exit+0x98/0x230 [kvm_amd] Aug 22 21:05:06 juju-e4d256-prod-github-runner-207 kernel: [56480.599100] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 21:05:06 juju-e4d256-prod-github-runner-207 kernel: [56480.600013] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 21:05:06 juju-e4d256-prod-github-runner-207 kernel: [56480.600942] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 21:05:06 juju-e4d256-prod-github-runner-207 kernel: [56480.601880] vcpu_run+0x62/0x2c0 [kvm] Aug 22 21:05:06 juju-e4d256-prod-github-runner-207 kernel: [56480.602698] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 21:05:06 juju-e4d256-prod-github-runner-207 kernel: [56480.603651] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 21:05:06 juju-e4d256-prod-github-runner-207 kernel: [56480.604516] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 21:05:06 juju-e4d256-prod-github-runner-207 kernel: [56480.605331] ? __seccomp_filter+0x4a/0x4a0 Aug 22 21:05:06 juju-e4d256-prod-github-runner-207 kernel: [56480.606094] ? __fget_files+0x86/0xc0 Aug 22 21:05:06 juju-e4d256-prod-github-runner-207 kernel: [56480.606799] __x64_sys_ioctl+0x95/0xd0 Aug 22 21:05:06 juju-e4d256-prod-github-runner-207 kernel: [56480.607490] do_syscall_64+0x5c/0xc0 Aug 22 21:05:06 juju-e4d256-prod-github-runner-207 kernel: [56480.608156] ? do_futex+0x162/0x1f0 Aug 22 21:05:06 juju-e4d256-prod-github-runner-207 kernel: [56480.608803] ? __x64_sys_futex+0x78/0x1e0 Aug 22 21:05:06 juju-e4d256-prod-github-runner-207 kernel: [56480.609498] ? __secure_computing+0xa9/0x120 Aug 22 21:05:06 juju-e4d256-prod-github-runner-207 kernel: [56480.610187] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 21:05:06 juju-e4d256-prod-github-runner-207 kernel: [56480.610946] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:05:06 juju-e4d256-prod-github-runner-207 kernel: [56480.611677] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:05:06 juju-e4d256-prod-github-runner-207 kernel: [56480.612394] ? do_syscall_64+0x69/0xc0 Aug 22 21:05:06 juju-e4d256-prod-github-runner-207 kernel: [56480.613038] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:05:06 juju-e4d256-prod-github-runner-207 kernel: [56480.613756] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:05:06 juju-e4d256-prod-github-runner-207 kernel: [56480.614451] ? do_syscall_64+0x69/0xc0 Aug 22 21:05:06 juju-e4d256-prod-github-runner-207 kernel: [56480.615087] ? do_syscall_64+0x69/0xc0 Aug 22 21:05:06 juju-e4d256-prod-github-runner-207 kernel: [56480.615708] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 21:05:06 juju-e4d256-prod-github-runner-207 kernel: [56480.616417] RIP: 0033:0x7faa5d0edaff Aug 22 21:05:06 juju-e4d256-prod-github-runner-207 kernel: [56480.617063] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 21:05:06 juju-e4d256-prod-github-runner-207 kernel: [56480.619083] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 21:05:06 juju-e4d256-prod-github-runner-207 kernel: [56480.619995] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 21:05:06 juju-e4d256-prod-github-runner-207 kernel: [56480.620900] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 21:05:06 juju-e4d256-prod-github-runner-207 kernel: [56480.621809] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 21:05:06 juju-e4d256-prod-github-runner-207 kernel: [56480.622793] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 21:05:06 juju-e4d256-prod-github-runner-207 kernel: [56480.623680] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 21:05:06 juju-e4d256-prod-github-runner-207 kernel: [56480.624575] Aug 22 21:05:34 juju-e4d256-prod-github-runner-207 kernel: [56508.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 52519s! [qemu-system-x86:6715] Aug 22 21:05:34 juju-e4d256-prod-github-runner-207 kernel: [56508.543120] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 21:05:34 juju-e4d256-prod-github-runner-207 kernel: [56508.543195] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 21:05:34 juju-e4d256-prod-github-runner-207 kernel: [56508.555571] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 21:05:34 juju-e4d256-prod-github-runner-207 kernel: [56508.556872] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 21:05:34 juju-e4d256-prod-github-runner-207 kernel: [56508.558106] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:05:34 juju-e4d256-prod-github-runner-207 kernel: [56508.559164] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 21:05:34 juju-e4d256-prod-github-runner-207 kernel: [56508.561734] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 21:05:34 juju-e4d256-prod-github-runner-207 kernel: [56508.562779] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 21:05:34 juju-e4d256-prod-github-runner-207 kernel: [56508.563952] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 21:05:34 juju-e4d256-prod-github-runner-207 kernel: [56508.565144] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 21:05:34 juju-e4d256-prod-github-runner-207 kernel: [56508.566312] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 21:05:34 juju-e4d256-prod-github-runner-207 kernel: [56508.567658] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 21:05:34 juju-e4d256-prod-github-runner-207 kernel: [56508.568997] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 21:05:34 juju-e4d256-prod-github-runner-207 kernel: [56508.570394] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 21:05:34 juju-e4d256-prod-github-runner-207 kernel: [56508.571608] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 21:05:34 juju-e4d256-prod-github-runner-207 kernel: [56508.572964] Call Trace: Aug 22 21:05:34 juju-e4d256-prod-github-runner-207 kernel: [56508.573932] Aug 22 21:05:34 juju-e4d256-prod-github-runner-207 kernel: [56508.574871] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:05:34 juju-e4d256-prod-github-runner-207 kernel: [56508.576004] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:05:34 juju-e4d256-prod-github-runner-207 kernel: [56508.577127] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:05:34 juju-e4d256-prod-github-runner-207 kernel: [56508.578292] ? show_regs.part.0+0x23/0x29 Aug 22 21:05:34 juju-e4d256-prod-github-runner-207 kernel: [56508.579394] ? show_regs.cold+0x8/0xd Aug 22 21:05:34 juju-e4d256-prod-github-runner-207 kernel: [56508.580457] ? watchdog_timer_fn+0x1be/0x220 Aug 22 21:05:34 juju-e4d256-prod-github-runner-207 kernel: [56508.581608] ? lockup_detector_update_enable+0x60/0x60 Aug 22 21:05:34 juju-e4d256-prod-github-runner-207 kernel: [56508.582776] ? __hrtimer_run_queues+0x107/0x230 Aug 22 21:05:34 juju-e4d256-prod-github-runner-207 kernel: [56508.583893] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 21:05:34 juju-e4d256-prod-github-runner-207 kernel: [56508.585027] ? hrtimer_interrupt+0x101/0x220 Aug 22 21:05:34 juju-e4d256-prod-github-runner-207 kernel: [56508.586125] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 21:05:34 juju-e4d256-prod-github-runner-207 kernel: [56508.587293] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 21:05:34 juju-e4d256-prod-github-runner-207 kernel: [56508.588439] Aug 22 21:05:34 juju-e4d256-prod-github-runner-207 kernel: [56508.589352] Aug 22 21:05:34 juju-e4d256-prod-github-runner-207 kernel: [56508.590238] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 21:05:34 juju-e4d256-prod-github-runner-207 kernel: [56508.591384] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:05:34 juju-e4d256-prod-github-runner-207 kernel: [56508.592526] ? _raw_spin_lock+0x22/0x30 Aug 22 21:05:34 juju-e4d256-prod-github-runner-207 kernel: [56508.593568] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:05:34 juju-e4d256-prod-github-runner-207 kernel: [56508.594683] direct_page_fault+0x206/0x310 [kvm] Aug 22 21:05:34 juju-e4d256-prod-github-runner-207 kernel: [56508.595815] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 21:05:34 juju-e4d256-prod-github-runner-207 kernel: [56508.596936] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 21:05:34 juju-e4d256-prod-github-runner-207 kernel: [56508.598035] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 21:05:34 juju-e4d256-prod-github-runner-207 kernel: [56508.599115] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 21:05:34 juju-e4d256-prod-github-runner-207 kernel: [56508.600149] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 21:05:34 juju-e4d256-prod-github-runner-207 kernel: [56508.601255] handle_exit+0x98/0x230 [kvm_amd] Aug 22 21:05:34 juju-e4d256-prod-github-runner-207 kernel: [56508.602236] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 21:05:34 juju-e4d256-prod-github-runner-207 kernel: [56508.603251] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 21:05:34 juju-e4d256-prod-github-runner-207 kernel: [56508.604278] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 21:05:34 juju-e4d256-prod-github-runner-207 kernel: [56508.605301] vcpu_run+0x62/0x2c0 [kvm] Aug 22 21:05:34 juju-e4d256-prod-github-runner-207 kernel: [56508.606191] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 21:05:34 juju-e4d256-prod-github-runner-207 kernel: [56508.607107] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 21:05:34 juju-e4d256-prod-github-runner-207 kernel: [56508.608074] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 21:05:34 juju-e4d256-prod-github-runner-207 kernel: [56508.608980] ? __seccomp_filter+0x4a/0x4a0 Aug 22 21:05:34 juju-e4d256-prod-github-runner-207 kernel: [56508.609804] ? __fget_files+0x86/0xc0 Aug 22 21:05:34 juju-e4d256-prod-github-runner-207 kernel: [56508.610587] __x64_sys_ioctl+0x95/0xd0 Aug 22 21:05:34 juju-e4d256-prod-github-runner-207 kernel: [56508.611357] do_syscall_64+0x5c/0xc0 Aug 22 21:05:34 juju-e4d256-prod-github-runner-207 kernel: [56508.612100] ? do_futex+0x162/0x1f0 Aug 22 21:05:34 juju-e4d256-prod-github-runner-207 kernel: [56508.612842] ? __x64_sys_futex+0x78/0x1e0 Aug 22 21:05:34 juju-e4d256-prod-github-runner-207 kernel: [56508.613716] ? __secure_computing+0xa9/0x120 Aug 22 21:05:34 juju-e4d256-prod-github-runner-207 kernel: [56508.614489] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 21:05:34 juju-e4d256-prod-github-runner-207 kernel: [56508.615521] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:05:34 juju-e4d256-prod-github-runner-207 kernel: [56508.616336] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:05:34 juju-e4d256-prod-github-runner-207 kernel: [56508.617178] ? do_syscall_64+0x69/0xc0 Aug 22 21:05:34 juju-e4d256-prod-github-runner-207 kernel: [56508.617910] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:05:34 juju-e4d256-prod-github-runner-207 kernel: [56508.618710] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:05:34 juju-e4d256-prod-github-runner-207 kernel: [56508.619501] ? do_syscall_64+0x69/0xc0 Aug 22 21:05:34 juju-e4d256-prod-github-runner-207 kernel: [56508.620201] ? do_syscall_64+0x69/0xc0 Aug 22 21:05:34 juju-e4d256-prod-github-runner-207 kernel: [56508.620919] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 21:05:34 juju-e4d256-prod-github-runner-207 kernel: [56508.621727] RIP: 0033:0x7faa5d0edaff Aug 22 21:05:34 juju-e4d256-prod-github-runner-207 kernel: [56508.622430] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 21:05:34 juju-e4d256-prod-github-runner-207 kernel: [56508.624776] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 21:05:34 juju-e4d256-prod-github-runner-207 kernel: [56508.625857] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 21:05:34 juju-e4d256-prod-github-runner-207 kernel: [56508.626898] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 21:05:34 juju-e4d256-prod-github-runner-207 kernel: [56508.627934] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 21:05:34 juju-e4d256-prod-github-runner-207 kernel: [56508.628975] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 21:05:34 juju-e4d256-prod-github-runner-207 kernel: [56508.630005] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 21:05:34 juju-e4d256-prod-github-runner-207 kernel: [56508.631028] Aug 22 21:05:47 juju-e4d256-prod-github-runner-207 kernel: [56520.956707] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 21:05:47 juju-e4d256-prod-github-runner-207 kernel: [56520.957714] rcu: 1-....: (14056557 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=6793855 Aug 22 21:05:47 juju-e4d256-prod-github-runner-207 kernel: [56520.958852] (t=14100939 jiffies g=23269 q=51686) Aug 22 21:05:47 juju-e4d256-prod-github-runner-207 kernel: [56520.959677] NMI backtrace for cpu 1 Aug 22 21:05:47 juju-e4d256-prod-github-runner-207 kernel: [56520.960404] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 21:05:47 juju-e4d256-prod-github-runner-207 kernel: [56520.961541] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 21:05:47 juju-e4d256-prod-github-runner-207 kernel: [56520.962614] Call Trace: Aug 22 21:05:47 juju-e4d256-prod-github-runner-207 kernel: [56520.963298] Aug 22 21:05:47 juju-e4d256-prod-github-runner-207 kernel: [56520.963946] show_stack+0x52/0x5c Aug 22 21:05:47 juju-e4d256-prod-github-runner-207 kernel: [56520.964694] dump_stack_lvl+0x4a/0x63 Aug 22 21:05:47 juju-e4d256-prod-github-runner-207 kernel: [56520.965449] dump_stack+0x10/0x16 Aug 22 21:05:47 juju-e4d256-prod-github-runner-207 kernel: [56520.966173] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 21:05:47 juju-e4d256-prod-github-runner-207 kernel: [56520.966962] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 21:05:47 juju-e4d256-prod-github-runner-207 kernel: [56520.967754] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 21:05:47 juju-e4d256-prod-github-runner-207 kernel: [56520.968589] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 21:05:47 juju-e4d256-prod-github-runner-207 kernel: [56520.969444] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 21:05:47 juju-e4d256-prod-github-runner-207 kernel: [56520.970266] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 21:05:47 juju-e4d256-prod-github-runner-207 kernel: [56520.971059] print_cpu_stall.cold+0x2f/0xe2 Aug 22 21:05:47 juju-e4d256-prod-github-runner-207 kernel: [56520.971841] ? timekeeping_update+0xf7/0x150 Aug 22 21:05:47 juju-e4d256-prod-github-runner-207 kernel: [56520.972622] check_cpu_stall+0x109/0x270 Aug 22 21:05:47 juju-e4d256-prod-github-runner-207 kernel: [56520.973390] rcu_sched_clock_irq+0x9a/0x250 Aug 22 21:05:47 juju-e4d256-prod-github-runner-207 kernel: [56520.974163] update_process_times+0x94/0xd0 Aug 22 21:05:47 juju-e4d256-prod-github-runner-207 kernel: [56520.974941] tick_sched_handle+0x29/0x70 Aug 22 21:05:47 juju-e4d256-prod-github-runner-207 kernel: [56520.975712] tick_sched_timer+0x8c/0xc0 Aug 22 21:05:47 juju-e4d256-prod-github-runner-207 kernel: [56520.976463] ? tick_nohz_handler+0xb0/0xb0 Aug 22 21:05:47 juju-e4d256-prod-github-runner-207 kernel: [56520.977243] __hrtimer_run_queues+0x107/0x230 Aug 22 21:05:47 juju-e4d256-prod-github-runner-207 kernel: [56520.978035] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 21:05:47 juju-e4d256-prod-github-runner-207 kernel: [56520.978821] hrtimer_interrupt+0x101/0x220 Aug 22 21:05:47 juju-e4d256-prod-github-runner-207 kernel: [56520.979607] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 21:05:47 juju-e4d256-prod-github-runner-207 kernel: [56520.980433] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 21:05:47 juju-e4d256-prod-github-runner-207 kernel: [56520.981276] Aug 22 21:05:47 juju-e4d256-prod-github-runner-207 kernel: [56520.981930] Aug 22 21:05:47 juju-e4d256-prod-github-runner-207 kernel: [56520.982563] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 21:05:47 juju-e4d256-prod-github-runner-207 kernel: [56520.983396] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:05:47 juju-e4d256-prod-github-runner-207 kernel: [56520.984287] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 21:05:47 juju-e4d256-prod-github-runner-207 kernel: [56520.986579] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 21:05:47 juju-e4d256-prod-github-runner-207 kernel: [56520.987461] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 21:05:47 juju-e4d256-prod-github-runner-207 kernel: [56520.988481] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 21:05:47 juju-e4d256-prod-github-runner-207 kernel: [56520.989491] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 21:05:47 juju-e4d256-prod-github-runner-207 kernel: [56520.990473] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 21:05:47 juju-e4d256-prod-github-runner-207 kernel: [56520.991454] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 21:05:47 juju-e4d256-prod-github-runner-207 kernel: [56520.992450] ? _raw_spin_lock+0x22/0x30 Aug 22 21:05:47 juju-e4d256-prod-github-runner-207 kernel: [56520.993254] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:05:47 juju-e4d256-prod-github-runner-207 kernel: [56520.994175] direct_page_fault+0x206/0x310 [kvm] Aug 22 21:05:47 juju-e4d256-prod-github-runner-207 kernel: [56520.995031] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 21:05:47 juju-e4d256-prod-github-runner-207 kernel: [56520.995872] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 21:05:47 juju-e4d256-prod-github-runner-207 kernel: [56520.996721] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 21:05:47 juju-e4d256-prod-github-runner-207 kernel: [56520.997527] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 21:05:47 juju-e4d256-prod-github-runner-207 kernel: [56520.998316] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 21:05:47 juju-e4d256-prod-github-runner-207 kernel: [56520.999142] handle_exit+0x98/0x230 [kvm_amd] Aug 22 21:05:47 juju-e4d256-prod-github-runner-207 kernel: [56520.999896] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 21:05:47 juju-e4d256-prod-github-runner-207 kernel: [56521.000702] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 21:05:47 juju-e4d256-prod-github-runner-207 kernel: [56521.001503] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 21:05:47 juju-e4d256-prod-github-runner-207 kernel: [56521.002288] vcpu_run+0x62/0x2c0 [kvm] Aug 22 21:05:47 juju-e4d256-prod-github-runner-207 kernel: [56521.003010] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 21:05:47 juju-e4d256-prod-github-runner-207 kernel: [56521.003741] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 21:05:47 juju-e4d256-prod-github-runner-207 kernel: [56521.004542] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 21:05:47 juju-e4d256-prod-github-runner-207 kernel: [56521.005311] ? __seccomp_filter+0x4a/0x4a0 Aug 22 21:05:47 juju-e4d256-prod-github-runner-207 kernel: [56521.006030] ? __fget_files+0x86/0xc0 Aug 22 21:05:47 juju-e4d256-prod-github-runner-207 kernel: [56521.006722] __x64_sys_ioctl+0x95/0xd0 Aug 22 21:05:47 juju-e4d256-prod-github-runner-207 kernel: [56521.007505] do_syscall_64+0x5c/0xc0 Aug 22 21:05:47 juju-e4d256-prod-github-runner-207 kernel: [56521.008234] ? do_futex+0x162/0x1f0 Aug 22 21:05:47 juju-e4d256-prod-github-runner-207 kernel: [56521.008918] ? __x64_sys_futex+0x78/0x1e0 Aug 22 21:05:47 juju-e4d256-prod-github-runner-207 kernel: [56521.009619] ? __secure_computing+0xa9/0x120 Aug 22 21:05:47 juju-e4d256-prod-github-runner-207 kernel: [56521.010345] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 21:05:47 juju-e4d256-prod-github-runner-207 kernel: [56521.011133] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:05:47 juju-e4d256-prod-github-runner-207 kernel: [56521.011895] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:05:47 juju-e4d256-prod-github-runner-207 kernel: [56521.012653] ? do_syscall_64+0x69/0xc0 Aug 22 21:05:47 juju-e4d256-prod-github-runner-207 kernel: [56521.013355] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:05:47 juju-e4d256-prod-github-runner-207 kernel: [56521.014115] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:05:47 juju-e4d256-prod-github-runner-207 kernel: [56521.014880] ? do_syscall_64+0x69/0xc0 Aug 22 21:05:47 juju-e4d256-prod-github-runner-207 kernel: [56521.015581] ? do_syscall_64+0x69/0xc0 Aug 22 21:05:47 juju-e4d256-prod-github-runner-207 kernel: [56521.016269] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 21:05:47 juju-e4d256-prod-github-runner-207 kernel: [56521.017056] RIP: 0033:0x7faa5d0edaff Aug 22 21:05:47 juju-e4d256-prod-github-runner-207 kernel: [56521.017746] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 21:05:47 juju-e4d256-prod-github-runner-207 kernel: [56521.019857] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 21:05:47 juju-e4d256-prod-github-runner-207 kernel: [56521.020842] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 21:05:47 juju-e4d256-prod-github-runner-207 kernel: [56521.021788] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 21:05:47 juju-e4d256-prod-github-runner-207 kernel: [56521.022740] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 21:05:47 juju-e4d256-prod-github-runner-207 kernel: [56521.023680] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 21:05:47 juju-e4d256-prod-github-runner-207 kernel: [56521.024605] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 21:05:47 juju-e4d256-prod-github-runner-207 kernel: [56521.025534] Aug 22 21:06:14 juju-e4d256-prod-github-runner-207 kernel: [56548.541985] watchdog: BUG: soft lockup - CPU#1 stuck for 52556s! [qemu-system-x86:6715] Aug 22 21:06:14 juju-e4d256-prod-github-runner-207 kernel: [56548.543899] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 21:06:14 juju-e4d256-prod-github-runner-207 kernel: [56548.544201] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 21:06:14 juju-e4d256-prod-github-runner-207 kernel: [56548.556440] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 21:06:14 juju-e4d256-prod-github-runner-207 kernel: [56548.557710] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 21:06:14 juju-e4d256-prod-github-runner-207 kernel: [56548.558986] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:06:14 juju-e4d256-prod-github-runner-207 kernel: [56548.560041] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 21:06:14 juju-e4d256-prod-github-runner-207 kernel: [56548.562606] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 21:06:14 juju-e4d256-prod-github-runner-207 kernel: [56548.563685] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 21:06:14 juju-e4d256-prod-github-runner-207 kernel: [56548.564859] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 21:06:14 juju-e4d256-prod-github-runner-207 kernel: [56548.566036] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 21:06:14 juju-e4d256-prod-github-runner-207 kernel: [56548.567198] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 21:06:14 juju-e4d256-prod-github-runner-207 kernel: [56548.568375] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 21:06:14 juju-e4d256-prod-github-runner-207 kernel: [56548.569572] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 21:06:14 juju-e4d256-prod-github-runner-207 kernel: [56548.570806] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 21:06:14 juju-e4d256-prod-github-runner-207 kernel: [56548.571906] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 21:06:14 juju-e4d256-prod-github-runner-207 kernel: [56548.573110] Call Trace: Aug 22 21:06:14 juju-e4d256-prod-github-runner-207 kernel: [56548.574020] Aug 22 21:06:14 juju-e4d256-prod-github-runner-207 kernel: [56548.574917] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:06:14 juju-e4d256-prod-github-runner-207 kernel: [56548.575955] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:06:14 juju-e4d256-prod-github-runner-207 kernel: [56548.577000] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:06:14 juju-e4d256-prod-github-runner-207 kernel: [56548.578185] ? show_regs.part.0+0x23/0x29 Aug 22 21:06:14 juju-e4d256-prod-github-runner-207 kernel: [56548.579195] ? show_regs.cold+0x8/0xd Aug 22 21:06:14 juju-e4d256-prod-github-runner-207 kernel: [56548.580188] ? watchdog_timer_fn+0x1be/0x220 Aug 22 21:06:14 juju-e4d256-prod-github-runner-207 kernel: [56548.581238] ? lockup_detector_update_enable+0x60/0x60 Aug 22 21:06:14 juju-e4d256-prod-github-runner-207 kernel: [56548.582325] ? __hrtimer_run_queues+0x107/0x230 Aug 22 21:06:14 juju-e4d256-prod-github-runner-207 kernel: [56548.583397] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 21:06:14 juju-e4d256-prod-github-runner-207 kernel: [56548.584479] ? hrtimer_interrupt+0x101/0x220 Aug 22 21:06:14 juju-e4d256-prod-github-runner-207 kernel: [56548.585687] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 21:06:14 juju-e4d256-prod-github-runner-207 kernel: [56548.586758] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 21:06:14 juju-e4d256-prod-github-runner-207 kernel: [56548.587807] Aug 22 21:06:14 juju-e4d256-prod-github-runner-207 kernel: [56548.588681] Aug 22 21:06:14 juju-e4d256-prod-github-runner-207 kernel: [56548.589524] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 21:06:14 juju-e4d256-prod-github-runner-207 kernel: [56548.590565] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:06:14 juju-e4d256-prod-github-runner-207 kernel: [56548.591761] ? _raw_spin_lock+0x22/0x30 Aug 22 21:06:14 juju-e4d256-prod-github-runner-207 kernel: [56548.592718] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:06:14 juju-e4d256-prod-github-runner-207 kernel: [56548.593745] direct_page_fault+0x206/0x310 [kvm] Aug 22 21:06:14 juju-e4d256-prod-github-runner-207 kernel: [56548.594772] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 21:06:14 juju-e4d256-prod-github-runner-207 kernel: [56548.595781] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 21:06:14 juju-e4d256-prod-github-runner-207 kernel: [56548.596799] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 21:06:14 juju-e4d256-prod-github-runner-207 kernel: [56548.597818] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 21:06:14 juju-e4d256-prod-github-runner-207 kernel: [56548.598766] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 21:06:14 juju-e4d256-prod-github-runner-207 kernel: [56548.599759] handle_exit+0x98/0x230 [kvm_amd] Aug 22 21:06:14 juju-e4d256-prod-github-runner-207 kernel: [56548.600671] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 21:06:14 juju-e4d256-prod-github-runner-207 kernel: [56548.601593] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 21:06:14 juju-e4d256-prod-github-runner-207 kernel: [56548.602542] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 21:06:14 juju-e4d256-prod-github-runner-207 kernel: [56548.603449] vcpu_run+0x62/0x2c0 [kvm] Aug 22 21:06:14 juju-e4d256-prod-github-runner-207 kernel: [56548.604272] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 21:06:14 juju-e4d256-prod-github-runner-207 kernel: [56548.605097] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 21:06:14 juju-e4d256-prod-github-runner-207 kernel: [56548.605954] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 21:06:14 juju-e4d256-prod-github-runner-207 kernel: [56548.606753] ? __seccomp_filter+0x4a/0x4a0 Aug 22 21:06:14 juju-e4d256-prod-github-runner-207 kernel: [56548.607497] ? __fget_files+0x86/0xc0 Aug 22 21:06:14 juju-e4d256-prod-github-runner-207 kernel: [56548.608202] __x64_sys_ioctl+0x95/0xd0 Aug 22 21:06:14 juju-e4d256-prod-github-runner-207 kernel: [56548.608908] do_syscall_64+0x5c/0xc0 Aug 22 21:06:14 juju-e4d256-prod-github-runner-207 kernel: [56548.609576] ? do_futex+0x162/0x1f0 Aug 22 21:06:14 juju-e4d256-prod-github-runner-207 kernel: [56548.610226] ? __x64_sys_futex+0x78/0x1e0 Aug 22 21:06:14 juju-e4d256-prod-github-runner-207 kernel: [56548.610906] ? __secure_computing+0xa9/0x120 Aug 22 21:06:14 juju-e4d256-prod-github-runner-207 kernel: [56548.611597] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 21:06:14 juju-e4d256-prod-github-runner-207 kernel: [56548.612375] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:06:14 juju-e4d256-prod-github-runner-207 kernel: [56548.613100] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:06:14 juju-e4d256-prod-github-runner-207 kernel: [56548.613835] ? do_syscall_64+0x69/0xc0 Aug 22 21:06:14 juju-e4d256-prod-github-runner-207 kernel: [56548.614483] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:06:14 juju-e4d256-prod-github-runner-207 kernel: [56548.615187] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:06:14 juju-e4d256-prod-github-runner-207 kernel: [56548.615891] ? do_syscall_64+0x69/0xc0 Aug 22 21:06:14 juju-e4d256-prod-github-runner-207 kernel: [56548.616527] ? do_syscall_64+0x69/0xc0 Aug 22 21:06:14 juju-e4d256-prod-github-runner-207 kernel: [56548.617155] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 21:06:14 juju-e4d256-prod-github-runner-207 kernel: [56548.617862] RIP: 0033:0x7faa5d0edaff Aug 22 21:06:14 juju-e4d256-prod-github-runner-207 kernel: [56548.618554] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 21:06:14 juju-e4d256-prod-github-runner-207 kernel: [56548.620573] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 21:06:14 juju-e4d256-prod-github-runner-207 kernel: [56548.621492] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 21:06:14 juju-e4d256-prod-github-runner-207 kernel: [56548.622385] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 21:06:14 juju-e4d256-prod-github-runner-207 kernel: [56548.623288] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 21:06:14 juju-e4d256-prod-github-runner-207 kernel: [56548.624178] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 21:06:14 juju-e4d256-prod-github-runner-207 kernel: [56548.625083] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 21:06:14 juju-e4d256-prod-github-runner-207 kernel: [56548.625981] Aug 22 21:06:42 juju-e4d256-prod-github-runner-207 kernel: [56576.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 52583s! [qemu-system-x86:6715] Aug 22 21:06:42 juju-e4d256-prod-github-runner-207 kernel: [56576.543136] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 21:06:42 juju-e4d256-prod-github-runner-207 kernel: [56576.543207] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 21:06:42 juju-e4d256-prod-github-runner-207 kernel: [56576.555470] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 21:06:42 juju-e4d256-prod-github-runner-207 kernel: [56576.556767] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 21:06:42 juju-e4d256-prod-github-runner-207 kernel: [56576.557990] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:06:42 juju-e4d256-prod-github-runner-207 kernel: [56576.559055] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 21:06:42 juju-e4d256-prod-github-runner-207 kernel: [56576.561661] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 21:06:42 juju-e4d256-prod-github-runner-207 kernel: [56576.562714] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 21:06:42 juju-e4d256-prod-github-runner-207 kernel: [56576.563886] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 21:06:42 juju-e4d256-prod-github-runner-207 kernel: [56576.565059] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 21:06:42 juju-e4d256-prod-github-runner-207 kernel: [56576.566231] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 21:06:42 juju-e4d256-prod-github-runner-207 kernel: [56576.567404] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 21:06:42 juju-e4d256-prod-github-runner-207 kernel: [56576.568601] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 21:06:42 juju-e4d256-prod-github-runner-207 kernel: [56576.569842] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 21:06:42 juju-e4d256-prod-github-runner-207 kernel: [56576.570956] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 21:06:42 juju-e4d256-prod-github-runner-207 kernel: [56576.572218] Call Trace: Aug 22 21:06:42 juju-e4d256-prod-github-runner-207 kernel: [56576.573162] Aug 22 21:06:42 juju-e4d256-prod-github-runner-207 kernel: [56576.574059] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:06:42 juju-e4d256-prod-github-runner-207 kernel: [56576.575093] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:06:42 juju-e4d256-prod-github-runner-207 kernel: [56576.576147] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:06:42 juju-e4d256-prod-github-runner-207 kernel: [56576.577244] ? show_regs.part.0+0x23/0x29 Aug 22 21:06:42 juju-e4d256-prod-github-runner-207 kernel: [56576.578247] ? show_regs.cold+0x8/0xd Aug 22 21:06:42 juju-e4d256-prod-github-runner-207 kernel: [56576.579293] ? watchdog_timer_fn+0x1be/0x220 Aug 22 21:06:42 juju-e4d256-prod-github-runner-207 kernel: [56576.580357] ? lockup_detector_update_enable+0x60/0x60 Aug 22 21:06:42 juju-e4d256-prod-github-runner-207 kernel: [56576.581486] ? __hrtimer_run_queues+0x107/0x230 Aug 22 21:06:42 juju-e4d256-prod-github-runner-207 kernel: [56576.582557] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 21:06:42 juju-e4d256-prod-github-runner-207 kernel: [56576.583597] ? hrtimer_interrupt+0x101/0x220 Aug 22 21:06:42 juju-e4d256-prod-github-runner-207 kernel: [56576.584650] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 21:06:42 juju-e4d256-prod-github-runner-207 kernel: [56576.585727] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 21:06:42 juju-e4d256-prod-github-runner-207 kernel: [56576.586795] Aug 22 21:06:42 juju-e4d256-prod-github-runner-207 kernel: [56576.587661] Aug 22 21:06:42 juju-e4d256-prod-github-runner-207 kernel: [56576.588528] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 21:06:42 juju-e4d256-prod-github-runner-207 kernel: [56576.589573] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:06:42 juju-e4d256-prod-github-runner-207 kernel: [56576.590614] ? _raw_spin_lock+0x22/0x30 Aug 22 21:06:42 juju-e4d256-prod-github-runner-207 kernel: [56576.591580] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:06:42 juju-e4d256-prod-github-runner-207 kernel: [56576.592694] direct_page_fault+0x206/0x310 [kvm] Aug 22 21:06:42 juju-e4d256-prod-github-runner-207 kernel: [56576.593742] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 21:06:42 juju-e4d256-prod-github-runner-207 kernel: [56576.594758] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 21:06:42 juju-e4d256-prod-github-runner-207 kernel: [56576.595771] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 21:06:42 juju-e4d256-prod-github-runner-207 kernel: [56576.596768] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 21:06:42 juju-e4d256-prod-github-runner-207 kernel: [56576.597731] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 21:06:42 juju-e4d256-prod-github-runner-207 kernel: [56576.598742] handle_exit+0x98/0x230 [kvm_amd] Aug 22 21:06:42 juju-e4d256-prod-github-runner-207 kernel: [56576.599640] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 21:06:42 juju-e4d256-prod-github-runner-207 kernel: [56576.600573] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 21:06:42 juju-e4d256-prod-github-runner-207 kernel: [56576.601517] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 21:06:42 juju-e4d256-prod-github-runner-207 kernel: [56576.602483] vcpu_run+0x62/0x2c0 [kvm] Aug 22 21:06:42 juju-e4d256-prod-github-runner-207 kernel: [56576.603311] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 21:06:42 juju-e4d256-prod-github-runner-207 kernel: [56576.604164] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 21:06:42 juju-e4d256-prod-github-runner-207 kernel: [56576.605041] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 21:06:42 juju-e4d256-prod-github-runner-207 kernel: [56576.605843] ? __seccomp_filter+0x4a/0x4a0 Aug 22 21:06:42 juju-e4d256-prod-github-runner-207 kernel: [56576.606613] ? __fget_files+0x86/0xc0 Aug 22 21:06:42 juju-e4d256-prod-github-runner-207 kernel: [56576.607329] __x64_sys_ioctl+0x95/0xd0 Aug 22 21:06:42 juju-e4d256-prod-github-runner-207 kernel: [56576.608050] do_syscall_64+0x5c/0xc0 Aug 22 21:06:42 juju-e4d256-prod-github-runner-207 kernel: [56576.608749] ? do_futex+0x162/0x1f0 Aug 22 21:06:42 juju-e4d256-prod-github-runner-207 kernel: [56576.609425] ? __x64_sys_futex+0x78/0x1e0 Aug 22 21:06:42 juju-e4d256-prod-github-runner-207 kernel: [56576.610213] ? __secure_computing+0xa9/0x120 Aug 22 21:06:42 juju-e4d256-prod-github-runner-207 kernel: [56576.611035] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 21:06:42 juju-e4d256-prod-github-runner-207 kernel: [56576.611832] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:06:42 juju-e4d256-prod-github-runner-207 kernel: [56576.612597] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:06:42 juju-e4d256-prod-github-runner-207 kernel: [56576.613348] ? do_syscall_64+0x69/0xc0 Aug 22 21:06:42 juju-e4d256-prod-github-runner-207 kernel: [56576.614014] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:06:42 juju-e4d256-prod-github-runner-207 kernel: [56576.614734] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:06:42 juju-e4d256-prod-github-runner-207 kernel: [56576.615439] ? do_syscall_64+0x69/0xc0 Aug 22 21:06:42 juju-e4d256-prod-github-runner-207 kernel: [56576.616085] ? do_syscall_64+0x69/0xc0 Aug 22 21:06:42 juju-e4d256-prod-github-runner-207 kernel: [56576.616714] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 21:06:42 juju-e4d256-prod-github-runner-207 kernel: [56576.617443] RIP: 0033:0x7faa5d0edaff Aug 22 21:06:42 juju-e4d256-prod-github-runner-207 kernel: [56576.618103] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 21:06:42 juju-e4d256-prod-github-runner-207 kernel: [56576.620126] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 21:06:42 juju-e4d256-prod-github-runner-207 kernel: [56576.621046] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 21:06:42 juju-e4d256-prod-github-runner-207 kernel: [56576.621949] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 21:06:42 juju-e4d256-prod-github-runner-207 kernel: [56576.622857] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 21:06:42 juju-e4d256-prod-github-runner-207 kernel: [56576.623795] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 21:06:42 juju-e4d256-prod-github-runner-207 kernel: [56576.624782] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 21:06:42 juju-e4d256-prod-github-runner-207 kernel: [56576.625681] Aug 22 21:07:10 juju-e4d256-prod-github-runner-207 kernel: [56604.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 52609s! [qemu-system-x86:6715] Aug 22 21:07:10 juju-e4d256-prod-github-runner-207 kernel: [56604.543113] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 21:07:10 juju-e4d256-prod-github-runner-207 kernel: [56604.543186] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 21:07:10 juju-e4d256-prod-github-runner-207 kernel: [56604.555573] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 21:07:10 juju-e4d256-prod-github-runner-207 kernel: [56604.556944] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 21:07:10 juju-e4d256-prod-github-runner-207 kernel: [56604.558330] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:07:10 juju-e4d256-prod-github-runner-207 kernel: [56604.559430] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 21:07:10 juju-e4d256-prod-github-runner-207 kernel: [56604.561997] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 21:07:10 juju-e4d256-prod-github-runner-207 kernel: [56604.563055] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 21:07:10 juju-e4d256-prod-github-runner-207 kernel: [56604.564302] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 21:07:10 juju-e4d256-prod-github-runner-207 kernel: [56604.565467] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 21:07:10 juju-e4d256-prod-github-runner-207 kernel: [56604.566626] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 21:07:10 juju-e4d256-prod-github-runner-207 kernel: [56604.567838] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 21:07:10 juju-e4d256-prod-github-runner-207 kernel: [56604.569010] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 21:07:10 juju-e4d256-prod-github-runner-207 kernel: [56604.570234] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 21:07:10 juju-e4d256-prod-github-runner-207 kernel: [56604.571365] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 21:07:10 juju-e4d256-prod-github-runner-207 kernel: [56604.572577] Call Trace: Aug 22 21:07:10 juju-e4d256-prod-github-runner-207 kernel: [56604.573490] Aug 22 21:07:10 juju-e4d256-prod-github-runner-207 kernel: [56604.574388] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:07:10 juju-e4d256-prod-github-runner-207 kernel: [56604.575418] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:07:10 juju-e4d256-prod-github-runner-207 kernel: [56604.576525] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:07:10 juju-e4d256-prod-github-runner-207 kernel: [56604.577618] ? show_regs.part.0+0x23/0x29 Aug 22 21:07:10 juju-e4d256-prod-github-runner-207 kernel: [56604.578630] ? show_regs.cold+0x8/0xd Aug 22 21:07:10 juju-e4d256-prod-github-runner-207 kernel: [56604.579602] ? watchdog_timer_fn+0x1be/0x220 Aug 22 21:07:10 juju-e4d256-prod-github-runner-207 kernel: [56604.580629] ? lockup_detector_update_enable+0x60/0x60 Aug 22 21:07:10 juju-e4d256-prod-github-runner-207 kernel: [56604.581694] ? __hrtimer_run_queues+0x107/0x230 Aug 22 21:07:10 juju-e4d256-prod-github-runner-207 kernel: [56604.582733] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 21:07:10 juju-e4d256-prod-github-runner-207 kernel: [56604.583763] ? hrtimer_interrupt+0x101/0x220 Aug 22 21:07:10 juju-e4d256-prod-github-runner-207 kernel: [56604.584776] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 21:07:10 juju-e4d256-prod-github-runner-207 kernel: [56604.585841] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 21:07:10 juju-e4d256-prod-github-runner-207 kernel: [56604.586902] Aug 22 21:07:10 juju-e4d256-prod-github-runner-207 kernel: [56604.587765] Aug 22 21:07:10 juju-e4d256-prod-github-runner-207 kernel: [56604.588605] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 21:07:10 juju-e4d256-prod-github-runner-207 kernel: [56604.589642] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:07:10 juju-e4d256-prod-github-runner-207 kernel: [56604.590685] ? _raw_spin_lock+0x22/0x30 Aug 22 21:07:10 juju-e4d256-prod-github-runner-207 kernel: [56604.591628] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:07:10 juju-e4d256-prod-github-runner-207 kernel: [56604.592658] direct_page_fault+0x206/0x310 [kvm] Aug 22 21:07:10 juju-e4d256-prod-github-runner-207 kernel: [56604.593680] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 21:07:10 juju-e4d256-prod-github-runner-207 kernel: [56604.594694] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 21:07:10 juju-e4d256-prod-github-runner-207 kernel: [56604.595704] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 21:07:10 juju-e4d256-prod-github-runner-207 kernel: [56604.596674] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 21:07:10 juju-e4d256-prod-github-runner-207 kernel: [56604.597619] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 21:07:10 juju-e4d256-prod-github-runner-207 kernel: [56604.598603] handle_exit+0x98/0x230 [kvm_amd] Aug 22 21:07:10 juju-e4d256-prod-github-runner-207 kernel: [56604.599491] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 21:07:10 juju-e4d256-prod-github-runner-207 kernel: [56604.600418] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 21:07:10 juju-e4d256-prod-github-runner-207 kernel: [56604.601345] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 21:07:10 juju-e4d256-prod-github-runner-207 kernel: [56604.602253] vcpu_run+0x62/0x2c0 [kvm] Aug 22 21:07:10 juju-e4d256-prod-github-runner-207 kernel: [56604.603060] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 21:07:10 juju-e4d256-prod-github-runner-207 kernel: [56604.603880] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 21:07:10 juju-e4d256-prod-github-runner-207 kernel: [56604.604741] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 21:07:10 juju-e4d256-prod-github-runner-207 kernel: [56604.605535] ? __seccomp_filter+0x4a/0x4a0 Aug 22 21:07:10 juju-e4d256-prod-github-runner-207 kernel: [56604.606275] ? __fget_files+0x86/0xc0 Aug 22 21:07:10 juju-e4d256-prod-github-runner-207 kernel: [56604.606976] __x64_sys_ioctl+0x95/0xd0 Aug 22 21:07:10 juju-e4d256-prod-github-runner-207 kernel: [56604.607673] do_syscall_64+0x5c/0xc0 Aug 22 21:07:10 juju-e4d256-prod-github-runner-207 kernel: [56604.608343] ? do_futex+0x162/0x1f0 Aug 22 21:07:10 juju-e4d256-prod-github-runner-207 kernel: [56604.608990] ? __x64_sys_futex+0x78/0x1e0 Aug 22 21:07:10 juju-e4d256-prod-github-runner-207 kernel: [56604.609659] ? __secure_computing+0xa9/0x120 Aug 22 21:07:10 juju-e4d256-prod-github-runner-207 kernel: [56604.610345] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 21:07:10 juju-e4d256-prod-github-runner-207 kernel: [56604.611100] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:07:10 juju-e4d256-prod-github-runner-207 kernel: [56604.611831] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:07:10 juju-e4d256-prod-github-runner-207 kernel: [56604.612544] ? do_syscall_64+0x69/0xc0 Aug 22 21:07:10 juju-e4d256-prod-github-runner-207 kernel: [56604.613186] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:07:10 juju-e4d256-prod-github-runner-207 kernel: [56604.613884] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:07:10 juju-e4d256-prod-github-runner-207 kernel: [56604.614575] ? do_syscall_64+0x69/0xc0 Aug 22 21:07:10 juju-e4d256-prod-github-runner-207 kernel: [56604.615202] ? do_syscall_64+0x69/0xc0 Aug 22 21:07:10 juju-e4d256-prod-github-runner-207 kernel: [56604.615835] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 21:07:10 juju-e4d256-prod-github-runner-207 kernel: [56604.616538] RIP: 0033:0x7faa5d0edaff Aug 22 21:07:10 juju-e4d256-prod-github-runner-207 kernel: [56604.617161] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 21:07:10 juju-e4d256-prod-github-runner-207 kernel: [56604.619150] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 21:07:10 juju-e4d256-prod-github-runner-207 kernel: [56604.620082] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 21:07:10 juju-e4d256-prod-github-runner-207 kernel: [56604.620967] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 21:07:10 juju-e4d256-prod-github-runner-207 kernel: [56604.621857] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 21:07:10 juju-e4d256-prod-github-runner-207 kernel: [56604.622748] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 21:07:10 juju-e4d256-prod-github-runner-207 kernel: [56604.623633] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 21:07:10 juju-e4d256-prod-github-runner-207 kernel: [56604.624538] Aug 22 21:07:38 juju-e4d256-prod-github-runner-207 kernel: [56632.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 52635s! [qemu-system-x86:6715] Aug 22 21:07:38 juju-e4d256-prod-github-runner-207 kernel: [56632.543977] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 21:07:38 juju-e4d256-prod-github-runner-207 kernel: [56632.544319] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 21:07:38 juju-e4d256-prod-github-runner-207 kernel: [56632.556930] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 21:07:38 juju-e4d256-prod-github-runner-207 kernel: [56632.558262] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 21:07:38 juju-e4d256-prod-github-runner-207 kernel: [56632.559584] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:07:38 juju-e4d256-prod-github-runner-207 kernel: [56632.560895] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 21:07:38 juju-e4d256-prod-github-runner-207 kernel: [56632.563775] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 21:07:38 juju-e4d256-prod-github-runner-207 kernel: [56632.564934] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 21:07:38 juju-e4d256-prod-github-runner-207 kernel: [56632.566119] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 21:07:38 juju-e4d256-prod-github-runner-207 kernel: [56632.567692] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 21:07:38 juju-e4d256-prod-github-runner-207 kernel: [56632.568874] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 21:07:38 juju-e4d256-prod-github-runner-207 kernel: [56632.570059] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 21:07:38 juju-e4d256-prod-github-runner-207 kernel: [56632.571246] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 21:07:38 juju-e4d256-prod-github-runner-207 kernel: [56632.572571] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 21:07:38 juju-e4d256-prod-github-runner-207 kernel: [56632.573683] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 21:07:38 juju-e4d256-prod-github-runner-207 kernel: [56632.575002] Call Trace: Aug 22 21:07:38 juju-e4d256-prod-github-runner-207 kernel: [56632.576093] Aug 22 21:07:38 juju-e4d256-prod-github-runner-207 kernel: [56632.577135] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:07:38 juju-e4d256-prod-github-runner-207 kernel: [56632.578203] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:07:38 juju-e4d256-prod-github-runner-207 kernel: [56632.579326] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:07:38 juju-e4d256-prod-github-runner-207 kernel: [56632.580662] ? show_regs.part.0+0x23/0x29 Aug 22 21:07:38 juju-e4d256-prod-github-runner-207 kernel: [56632.581770] ? show_regs.cold+0x8/0xd Aug 22 21:07:38 juju-e4d256-prod-github-runner-207 kernel: [56632.582817] ? watchdog_timer_fn+0x1be/0x220 Aug 22 21:07:38 juju-e4d256-prod-github-runner-207 kernel: [56632.583922] ? lockup_detector_update_enable+0x60/0x60 Aug 22 21:07:38 juju-e4d256-prod-github-runner-207 kernel: [56632.585079] ? __hrtimer_run_queues+0x107/0x230 Aug 22 21:07:38 juju-e4d256-prod-github-runner-207 kernel: [56632.586163] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 21:07:38 juju-e4d256-prod-github-runner-207 kernel: [56632.587236] ? hrtimer_interrupt+0x101/0x220 Aug 22 21:07:38 juju-e4d256-prod-github-runner-207 kernel: [56632.588346] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 21:07:38 juju-e4d256-prod-github-runner-207 kernel: [56632.589471] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 21:07:38 juju-e4d256-prod-github-runner-207 kernel: [56632.590609] Aug 22 21:07:38 juju-e4d256-prod-github-runner-207 kernel: [56632.591570] Aug 22 21:07:38 juju-e4d256-prod-github-runner-207 kernel: [56632.592418] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 21:07:38 juju-e4d256-prod-github-runner-207 kernel: [56632.593460] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:07:38 juju-e4d256-prod-github-runner-207 kernel: [56632.594507] ? _raw_spin_lock+0x22/0x30 Aug 22 21:07:38 juju-e4d256-prod-github-runner-207 kernel: [56632.595486] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:07:38 juju-e4d256-prod-github-runner-207 kernel: [56632.596519] direct_page_fault+0x206/0x310 [kvm] Aug 22 21:07:38 juju-e4d256-prod-github-runner-207 kernel: [56632.597549] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 21:07:38 juju-e4d256-prod-github-runner-207 kernel: [56632.598570] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 21:07:38 juju-e4d256-prod-github-runner-207 kernel: [56632.599587] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 21:07:38 juju-e4d256-prod-github-runner-207 kernel: [56632.600659] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 21:07:38 juju-e4d256-prod-github-runner-207 kernel: [56632.601780] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 21:07:38 juju-e4d256-prod-github-runner-207 kernel: [56632.602774] handle_exit+0x98/0x230 [kvm_amd] Aug 22 21:07:38 juju-e4d256-prod-github-runner-207 kernel: [56632.603692] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 21:07:38 juju-e4d256-prod-github-runner-207 kernel: [56632.604613] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 21:07:38 juju-e4d256-prod-github-runner-207 kernel: [56632.605548] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 21:07:38 juju-e4d256-prod-github-runner-207 kernel: [56632.606514] vcpu_run+0x62/0x2c0 [kvm] Aug 22 21:07:38 juju-e4d256-prod-github-runner-207 kernel: [56632.607340] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 21:07:38 juju-e4d256-prod-github-runner-207 kernel: [56632.608150] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 21:07:38 juju-e4d256-prod-github-runner-207 kernel: [56632.609007] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 21:07:38 juju-e4d256-prod-github-runner-207 kernel: [56632.609807] ? __seccomp_filter+0x4a/0x4a0 Aug 22 21:07:38 juju-e4d256-prod-github-runner-207 kernel: [56632.610550] ? __fget_files+0x86/0xc0 Aug 22 21:07:38 juju-e4d256-prod-github-runner-207 kernel: [56632.611409] __x64_sys_ioctl+0x95/0xd0 Aug 22 21:07:38 juju-e4d256-prod-github-runner-207 kernel: [56632.612121] do_syscall_64+0x5c/0xc0 Aug 22 21:07:38 juju-e4d256-prod-github-runner-207 kernel: [56632.612795] ? do_futex+0x162/0x1f0 Aug 22 21:07:38 juju-e4d256-prod-github-runner-207 kernel: [56632.613448] ? __x64_sys_futex+0x78/0x1e0 Aug 22 21:07:38 juju-e4d256-prod-github-runner-207 kernel: [56632.614122] ? __secure_computing+0xa9/0x120 Aug 22 21:07:38 juju-e4d256-prod-github-runner-207 kernel: [56632.614818] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 21:07:38 juju-e4d256-prod-github-runner-207 kernel: [56632.615593] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:07:38 juju-e4d256-prod-github-runner-207 kernel: [56632.616317] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:07:38 juju-e4d256-prod-github-runner-207 kernel: [56632.617034] ? do_syscall_64+0x69/0xc0 Aug 22 21:07:38 juju-e4d256-prod-github-runner-207 kernel: [56632.617679] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:07:38 juju-e4d256-prod-github-runner-207 kernel: [56632.618382] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:07:38 juju-e4d256-prod-github-runner-207 kernel: [56632.619077] ? do_syscall_64+0x69/0xc0 Aug 22 21:07:38 juju-e4d256-prod-github-runner-207 kernel: [56632.619719] ? do_syscall_64+0x69/0xc0 Aug 22 21:07:38 juju-e4d256-prod-github-runner-207 kernel: [56632.620342] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 21:07:38 juju-e4d256-prod-github-runner-207 kernel: [56632.621053] RIP: 0033:0x7faa5d0edaff Aug 22 21:07:38 juju-e4d256-prod-github-runner-207 kernel: [56632.621712] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 21:07:38 juju-e4d256-prod-github-runner-207 kernel: [56632.623714] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 21:07:38 juju-e4d256-prod-github-runner-207 kernel: [56632.624637] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 21:07:38 juju-e4d256-prod-github-runner-207 kernel: [56632.625526] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 21:07:38 juju-e4d256-prod-github-runner-207 kernel: [56632.626414] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 21:07:38 juju-e4d256-prod-github-runner-207 kernel: [56632.627309] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 21:07:38 juju-e4d256-prod-github-runner-207 kernel: [56632.628196] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 21:07:38 juju-e4d256-prod-github-runner-207 kernel: [56632.629091] Aug 22 21:08:06 juju-e4d256-prod-github-runner-207 kernel: [56660.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 52661s! [qemu-system-x86:6715] Aug 22 21:08:06 juju-e4d256-prod-github-runner-207 kernel: [56660.543181] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 21:08:06 juju-e4d256-prod-github-runner-207 kernel: [56660.543266] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 21:08:06 juju-e4d256-prod-github-runner-207 kernel: [56660.556680] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 21:08:06 juju-e4d256-prod-github-runner-207 kernel: [56660.557976] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 21:08:06 juju-e4d256-prod-github-runner-207 kernel: [56660.559283] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:08:06 juju-e4d256-prod-github-runner-207 kernel: [56660.560384] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 21:08:06 juju-e4d256-prod-github-runner-207 kernel: [56660.563021] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 21:08:06 juju-e4d256-prod-github-runner-207 kernel: [56660.564085] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 21:08:06 juju-e4d256-prod-github-runner-207 kernel: [56660.565273] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 21:08:06 juju-e4d256-prod-github-runner-207 kernel: [56660.566459] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 21:08:06 juju-e4d256-prod-github-runner-207 kernel: [56660.567665] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 21:08:06 juju-e4d256-prod-github-runner-207 kernel: [56660.568858] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 21:08:06 juju-e4d256-prod-github-runner-207 kernel: [56660.570076] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 21:08:06 juju-e4d256-prod-github-runner-207 kernel: [56660.571369] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 21:08:06 juju-e4d256-prod-github-runner-207 kernel: [56660.572488] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 21:08:06 juju-e4d256-prod-github-runner-207 kernel: [56660.573706] Call Trace: Aug 22 21:08:06 juju-e4d256-prod-github-runner-207 kernel: [56660.574627] Aug 22 21:08:06 juju-e4d256-prod-github-runner-207 kernel: [56660.575533] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:08:06 juju-e4d256-prod-github-runner-207 kernel: [56660.576582] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:08:06 juju-e4d256-prod-github-runner-207 kernel: [56660.577622] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:08:06 juju-e4d256-prod-github-runner-207 kernel: [56660.578716] ? show_regs.part.0+0x23/0x29 Aug 22 21:08:06 juju-e4d256-prod-github-runner-207 kernel: [56660.579767] ? show_regs.cold+0x8/0xd Aug 22 21:08:06 juju-e4d256-prod-github-runner-207 kernel: [56660.580776] ? watchdog_timer_fn+0x1be/0x220 Aug 22 21:08:06 juju-e4d256-prod-github-runner-207 kernel: [56660.581811] ? lockup_detector_update_enable+0x60/0x60 Aug 22 21:08:06 juju-e4d256-prod-github-runner-207 kernel: [56660.582885] ? __hrtimer_run_queues+0x107/0x230 Aug 22 21:08:06 juju-e4d256-prod-github-runner-207 kernel: [56660.583999] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 21:08:06 juju-e4d256-prod-github-runner-207 kernel: [56660.585027] ? hrtimer_interrupt+0x101/0x220 Aug 22 21:08:06 juju-e4d256-prod-github-runner-207 kernel: [56660.586043] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 21:08:06 juju-e4d256-prod-github-runner-207 kernel: [56660.587133] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 21:08:06 juju-e4d256-prod-github-runner-207 kernel: [56660.588181] Aug 22 21:08:06 juju-e4d256-prod-github-runner-207 kernel: [56660.589035] Aug 22 21:08:06 juju-e4d256-prod-github-runner-207 kernel: [56660.589874] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 21:08:06 juju-e4d256-prod-github-runner-207 kernel: [56660.590920] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:08:06 juju-e4d256-prod-github-runner-207 kernel: [56660.591982] ? _raw_spin_lock+0x22/0x30 Aug 22 21:08:06 juju-e4d256-prod-github-runner-207 kernel: [56660.592930] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:08:06 juju-e4d256-prod-github-runner-207 kernel: [56660.593958] direct_page_fault+0x206/0x310 [kvm] Aug 22 21:08:06 juju-e4d256-prod-github-runner-207 kernel: [56660.595004] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 21:08:06 juju-e4d256-prod-github-runner-207 kernel: [56660.596012] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 21:08:06 juju-e4d256-prod-github-runner-207 kernel: [56660.597017] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 21:08:06 juju-e4d256-prod-github-runner-207 kernel: [56660.598004] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 21:08:06 juju-e4d256-prod-github-runner-207 kernel: [56660.599214] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 21:08:06 juju-e4d256-prod-github-runner-207 kernel: [56660.600203] handle_exit+0x98/0x230 [kvm_amd] Aug 22 21:08:06 juju-e4d256-prod-github-runner-207 kernel: [56660.601096] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 21:08:06 juju-e4d256-prod-github-runner-207 kernel: [56660.602017] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 21:08:06 juju-e4d256-prod-github-runner-207 kernel: [56660.602967] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 21:08:06 juju-e4d256-prod-github-runner-207 kernel: [56660.603869] vcpu_run+0x62/0x2c0 [kvm] Aug 22 21:08:06 juju-e4d256-prod-github-runner-207 kernel: [56660.604681] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 21:08:06 juju-e4d256-prod-github-runner-207 kernel: [56660.605490] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 21:08:06 juju-e4d256-prod-github-runner-207 kernel: [56660.606349] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 21:08:06 juju-e4d256-prod-github-runner-207 kernel: [56660.607159] ? __seccomp_filter+0x4a/0x4a0 Aug 22 21:08:06 juju-e4d256-prod-github-runner-207 kernel: [56660.607900] ? __fget_files+0x86/0xc0 Aug 22 21:08:06 juju-e4d256-prod-github-runner-207 kernel: [56660.608602] __x64_sys_ioctl+0x95/0xd0 Aug 22 21:08:06 juju-e4d256-prod-github-runner-207 kernel: [56660.609342] do_syscall_64+0x5c/0xc0 Aug 22 21:08:06 juju-e4d256-prod-github-runner-207 kernel: [56660.610013] ? do_futex+0x162/0x1f0 Aug 22 21:08:06 juju-e4d256-prod-github-runner-207 kernel: [56660.610661] ? __x64_sys_futex+0x78/0x1e0 Aug 22 21:08:06 juju-e4d256-prod-github-runner-207 kernel: [56660.611349] ? __secure_computing+0xa9/0x120 Aug 22 21:08:06 juju-e4d256-prod-github-runner-207 kernel: [56660.612048] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 21:08:06 juju-e4d256-prod-github-runner-207 kernel: [56660.612838] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:08:06 juju-e4d256-prod-github-runner-207 kernel: [56660.613580] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:08:06 juju-e4d256-prod-github-runner-207 kernel: [56660.614303] ? do_syscall_64+0x69/0xc0 Aug 22 21:08:06 juju-e4d256-prod-github-runner-207 kernel: [56660.614958] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:08:06 juju-e4d256-prod-github-runner-207 kernel: [56660.615660] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:08:06 juju-e4d256-prod-github-runner-207 kernel: [56660.616355] ? do_syscall_64+0x69/0xc0 Aug 22 21:08:06 juju-e4d256-prod-github-runner-207 kernel: [56660.617018] ? do_syscall_64+0x69/0xc0 Aug 22 21:08:06 juju-e4d256-prod-github-runner-207 kernel: [56660.617643] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 21:08:06 juju-e4d256-prod-github-runner-207 kernel: [56660.618353] RIP: 0033:0x7faa5d0edaff Aug 22 21:08:06 juju-e4d256-prod-github-runner-207 kernel: [56660.618992] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 21:08:06 juju-e4d256-prod-github-runner-207 kernel: [56660.620977] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 21:08:06 juju-e4d256-prod-github-runner-207 kernel: [56660.621891] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 21:08:06 juju-e4d256-prod-github-runner-207 kernel: [56660.622780] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 21:08:06 juju-e4d256-prod-github-runner-207 kernel: [56660.623677] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 21:08:06 juju-e4d256-prod-github-runner-207 kernel: [56660.624563] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 21:08:06 juju-e4d256-prod-github-runner-207 kernel: [56660.625458] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 21:08:06 juju-e4d256-prod-github-runner-207 kernel: [56660.626348] Aug 22 21:08:34 juju-e4d256-prod-github-runner-207 kernel: [56688.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 52687s! [qemu-system-x86:6715] Aug 22 21:08:34 juju-e4d256-prod-github-runner-207 kernel: [56688.543123] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 21:08:34 juju-e4d256-prod-github-runner-207 kernel: [56688.543196] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 21:08:34 juju-e4d256-prod-github-runner-207 kernel: [56688.555847] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 21:08:34 juju-e4d256-prod-github-runner-207 kernel: [56688.557166] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 21:08:34 juju-e4d256-prod-github-runner-207 kernel: [56688.558397] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:08:34 juju-e4d256-prod-github-runner-207 kernel: [56688.559475] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 21:08:34 juju-e4d256-prod-github-runner-207 kernel: [56688.562062] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 21:08:34 juju-e4d256-prod-github-runner-207 kernel: [56688.563161] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 21:08:34 juju-e4d256-prod-github-runner-207 kernel: [56688.564330] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 21:08:34 juju-e4d256-prod-github-runner-207 kernel: [56688.565547] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 21:08:34 juju-e4d256-prod-github-runner-207 kernel: [56688.566731] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 21:08:34 juju-e4d256-prod-github-runner-207 kernel: [56688.568045] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 21:08:34 juju-e4d256-prod-github-runner-207 kernel: [56688.569274] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 21:08:34 juju-e4d256-prod-github-runner-207 kernel: [56688.570525] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 21:08:34 juju-e4d256-prod-github-runner-207 kernel: [56688.571659] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 21:08:34 juju-e4d256-prod-github-runner-207 kernel: [56688.572879] Call Trace: Aug 22 21:08:34 juju-e4d256-prod-github-runner-207 kernel: [56688.573821] Aug 22 21:08:34 juju-e4d256-prod-github-runner-207 kernel: [56688.574739] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:08:34 juju-e4d256-prod-github-runner-207 kernel: [56688.575818] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:08:34 juju-e4d256-prod-github-runner-207 kernel: [56688.576845] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:08:34 juju-e4d256-prod-github-runner-207 kernel: [56688.577921] ? show_regs.part.0+0x23/0x29 Aug 22 21:08:34 juju-e4d256-prod-github-runner-207 kernel: [56688.579099] ? show_regs.cold+0x8/0xd Aug 22 21:08:34 juju-e4d256-prod-github-runner-207 kernel: [56688.580107] ? watchdog_timer_fn+0x1be/0x220 Aug 22 21:08:34 juju-e4d256-prod-github-runner-207 kernel: [56688.581130] ? lockup_detector_update_enable+0x60/0x60 Aug 22 21:08:34 juju-e4d256-prod-github-runner-207 kernel: [56688.582196] ? __hrtimer_run_queues+0x107/0x230 Aug 22 21:08:34 juju-e4d256-prod-github-runner-207 kernel: [56688.583274] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 21:08:34 juju-e4d256-prod-github-runner-207 kernel: [56688.584312] ? hrtimer_interrupt+0x101/0x220 Aug 22 21:08:34 juju-e4d256-prod-github-runner-207 kernel: [56688.585348] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 21:08:34 juju-e4d256-prod-github-runner-207 kernel: [56688.586480] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 21:08:34 juju-e4d256-prod-github-runner-207 kernel: [56688.587568] Aug 22 21:08:34 juju-e4d256-prod-github-runner-207 kernel: [56688.588426] Aug 22 21:08:34 juju-e4d256-prod-github-runner-207 kernel: [56688.589268] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 21:08:34 juju-e4d256-prod-github-runner-207 kernel: [56688.590323] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:08:34 juju-e4d256-prod-github-runner-207 kernel: [56688.591405] ? _raw_spin_lock+0x22/0x30 Aug 22 21:08:34 juju-e4d256-prod-github-runner-207 kernel: [56688.592353] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:08:34 juju-e4d256-prod-github-runner-207 kernel: [56688.593407] direct_page_fault+0x206/0x310 [kvm] Aug 22 21:08:34 juju-e4d256-prod-github-runner-207 kernel: [56688.594448] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 21:08:34 juju-e4d256-prod-github-runner-207 kernel: [56688.595483] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 21:08:34 juju-e4d256-prod-github-runner-207 kernel: [56688.596566] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 21:08:34 juju-e4d256-prod-github-runner-207 kernel: [56688.597551] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 21:08:34 juju-e4d256-prod-github-runner-207 kernel: [56688.598510] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 21:08:34 juju-e4d256-prod-github-runner-207 kernel: [56688.599537] handle_exit+0x98/0x230 [kvm_amd] Aug 22 21:08:34 juju-e4d256-prod-github-runner-207 kernel: [56688.600479] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 21:08:34 juju-e4d256-prod-github-runner-207 kernel: [56688.601437] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 21:08:34 juju-e4d256-prod-github-runner-207 kernel: [56688.602380] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 21:08:34 juju-e4d256-prod-github-runner-207 kernel: [56688.603327] vcpu_run+0x62/0x2c0 [kvm] Aug 22 21:08:34 juju-e4d256-prod-github-runner-207 kernel: [56688.604161] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 21:08:34 juju-e4d256-prod-github-runner-207 kernel: [56688.604987] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 21:08:34 juju-e4d256-prod-github-runner-207 kernel: [56688.605903] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 21:08:34 juju-e4d256-prod-github-runner-207 kernel: [56688.606909] ? __seccomp_filter+0x4a/0x4a0 Aug 22 21:08:34 juju-e4d256-prod-github-runner-207 kernel: [56688.607667] ? __fget_files+0x86/0xc0 Aug 22 21:08:34 juju-e4d256-prod-github-runner-207 kernel: [56688.608402] __x64_sys_ioctl+0x95/0xd0 Aug 22 21:08:34 juju-e4d256-prod-github-runner-207 kernel: [56688.609098] do_syscall_64+0x5c/0xc0 Aug 22 21:08:34 juju-e4d256-prod-github-runner-207 kernel: [56688.609823] ? do_futex+0x162/0x1f0 Aug 22 21:08:34 juju-e4d256-prod-github-runner-207 kernel: [56688.610557] ? __x64_sys_futex+0x78/0x1e0 Aug 22 21:08:34 juju-e4d256-prod-github-runner-207 kernel: [56688.611279] ? __secure_computing+0xa9/0x120 Aug 22 21:08:34 juju-e4d256-prod-github-runner-207 kernel: [56688.612004] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 21:08:34 juju-e4d256-prod-github-runner-207 kernel: [56688.612773] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:08:34 juju-e4d256-prod-github-runner-207 kernel: [56688.613515] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:08:34 juju-e4d256-prod-github-runner-207 kernel: [56688.614250] ? do_syscall_64+0x69/0xc0 Aug 22 21:08:34 juju-e4d256-prod-github-runner-207 kernel: [56688.614951] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:08:34 juju-e4d256-prod-github-runner-207 kernel: [56688.615660] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:08:34 juju-e4d256-prod-github-runner-207 kernel: [56688.616372] ? do_syscall_64+0x69/0xc0 Aug 22 21:08:34 juju-e4d256-prod-github-runner-207 kernel: [56688.617017] ? do_syscall_64+0x69/0xc0 Aug 22 21:08:34 juju-e4d256-prod-github-runner-207 kernel: [56688.617647] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 21:08:34 juju-e4d256-prod-github-runner-207 kernel: [56688.618356] RIP: 0033:0x7faa5d0edaff Aug 22 21:08:34 juju-e4d256-prod-github-runner-207 kernel: [56688.619001] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 21:08:34 juju-e4d256-prod-github-runner-207 kernel: [56688.620984] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 21:08:34 juju-e4d256-prod-github-runner-207 kernel: [56688.621899] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 21:08:34 juju-e4d256-prod-github-runner-207 kernel: [56688.622832] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 21:08:34 juju-e4d256-prod-github-runner-207 kernel: [56688.623723] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 21:08:34 juju-e4d256-prod-github-runner-207 kernel: [56688.624645] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 21:08:34 juju-e4d256-prod-github-runner-207 kernel: [56688.625534] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 21:08:34 juju-e4d256-prod-github-runner-207 kernel: [56688.626637] Aug 22 21:08:47 juju-e4d256-prod-github-runner-207 kernel: [56700.968706] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 21:08:47 juju-e4d256-prod-github-runner-207 kernel: [56700.969685] rcu: 1-....: (14101422 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=6815608 Aug 22 21:08:47 juju-e4d256-prod-github-runner-207 kernel: [56700.970872] (t=14145942 jiffies g=23269 q=51800) Aug 22 21:08:47 juju-e4d256-prod-github-runner-207 kernel: [56700.971686] NMI backtrace for cpu 1 Aug 22 21:08:47 juju-e4d256-prod-github-runner-207 kernel: [56700.972403] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 21:08:47 juju-e4d256-prod-github-runner-207 kernel: [56700.973508] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 21:08:47 juju-e4d256-prod-github-runner-207 kernel: [56700.974581] Call Trace: Aug 22 21:08:47 juju-e4d256-prod-github-runner-207 kernel: [56700.975257] Aug 22 21:08:47 juju-e4d256-prod-github-runner-207 kernel: [56700.975917] show_stack+0x52/0x5c Aug 22 21:08:47 juju-e4d256-prod-github-runner-207 kernel: [56700.976644] dump_stack_lvl+0x4a/0x63 Aug 22 21:08:47 juju-e4d256-prod-github-runner-207 kernel: [56700.977392] dump_stack+0x10/0x16 Aug 22 21:08:47 juju-e4d256-prod-github-runner-207 kernel: [56700.978121] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 21:08:47 juju-e4d256-prod-github-runner-207 kernel: [56700.978925] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 21:08:47 juju-e4d256-prod-github-runner-207 kernel: [56700.979704] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 21:08:47 juju-e4d256-prod-github-runner-207 kernel: [56700.980528] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 21:08:47 juju-e4d256-prod-github-runner-207 kernel: [56700.981346] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 21:08:47 juju-e4d256-prod-github-runner-207 kernel: [56700.982153] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 21:08:47 juju-e4d256-prod-github-runner-207 kernel: [56700.982987] print_cpu_stall.cold+0x2f/0xe2 Aug 22 21:08:47 juju-e4d256-prod-github-runner-207 kernel: [56700.983758] ? timekeeping_update+0xf7/0x150 Aug 22 21:08:47 juju-e4d256-prod-github-runner-207 kernel: [56700.984534] check_cpu_stall+0x109/0x270 Aug 22 21:08:47 juju-e4d256-prod-github-runner-207 kernel: [56700.985403] rcu_sched_clock_irq+0x9a/0x250 Aug 22 21:08:47 juju-e4d256-prod-github-runner-207 kernel: [56700.986263] update_process_times+0x94/0xd0 Aug 22 21:08:47 juju-e4d256-prod-github-runner-207 kernel: [56700.987138] tick_sched_handle+0x29/0x70 Aug 22 21:08:47 juju-e4d256-prod-github-runner-207 kernel: [56700.987973] tick_sched_timer+0x8c/0xc0 Aug 22 21:08:47 juju-e4d256-prod-github-runner-207 kernel: [56700.988789] ? tick_nohz_handler+0xb0/0xb0 Aug 22 21:08:47 juju-e4d256-prod-github-runner-207 kernel: [56700.989669] __hrtimer_run_queues+0x107/0x230 Aug 22 21:08:47 juju-e4d256-prod-github-runner-207 kernel: [56700.990560] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 21:08:47 juju-e4d256-prod-github-runner-207 kernel: [56700.991447] hrtimer_interrupt+0x101/0x220 Aug 22 21:08:47 juju-e4d256-prod-github-runner-207 kernel: [56700.992315] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 21:08:47 juju-e4d256-prod-github-runner-207 kernel: [56700.993227] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 21:08:47 juju-e4d256-prod-github-runner-207 kernel: [56700.994122] Aug 22 21:08:47 juju-e4d256-prod-github-runner-207 kernel: [56700.994825] Aug 22 21:08:47 juju-e4d256-prod-github-runner-207 kernel: [56700.995501] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 21:08:47 juju-e4d256-prod-github-runner-207 kernel: [56700.996431] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:08:47 juju-e4d256-prod-github-runner-207 kernel: [56700.997434] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 21:08:47 juju-e4d256-prod-github-runner-207 kernel: [56700.999999] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 21:08:47 juju-e4d256-prod-github-runner-207 kernel: [56701.001034] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 21:08:47 juju-e4d256-prod-github-runner-207 kernel: [56701.002202] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 21:08:47 juju-e4d256-prod-github-runner-207 kernel: [56701.003367] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 21:08:47 juju-e4d256-prod-github-runner-207 kernel: [56701.004469] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 21:08:47 juju-e4d256-prod-github-runner-207 kernel: [56701.005591] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 21:08:47 juju-e4d256-prod-github-runner-207 kernel: [56701.006706] ? _raw_spin_lock+0x22/0x30 Aug 22 21:08:47 juju-e4d256-prod-github-runner-207 kernel: [56701.007552] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:08:47 juju-e4d256-prod-github-runner-207 kernel: [56701.008485] direct_page_fault+0x206/0x310 [kvm] Aug 22 21:08:47 juju-e4d256-prod-github-runner-207 kernel: [56701.009419] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 21:08:47 juju-e4d256-prod-github-runner-207 kernel: [56701.010355] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 21:08:47 juju-e4d256-prod-github-runner-207 kernel: [56701.011281] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 21:08:47 juju-e4d256-prod-github-runner-207 kernel: [56701.012185] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 21:08:47 juju-e4d256-prod-github-runner-207 kernel: [56701.013059] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 21:08:47 juju-e4d256-prod-github-runner-207 kernel: [56701.013991] handle_exit+0x98/0x230 [kvm_amd] Aug 22 21:08:47 juju-e4d256-prod-github-runner-207 kernel: [56701.014863] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 21:08:47 juju-e4d256-prod-github-runner-207 kernel: [56701.015739] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 21:08:47 juju-e4d256-prod-github-runner-207 kernel: [56701.016678] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 21:08:47 juju-e4d256-prod-github-runner-207 kernel: [56701.017567] vcpu_run+0x62/0x2c0 [kvm] Aug 22 21:08:47 juju-e4d256-prod-github-runner-207 kernel: [56701.018359] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 21:08:47 juju-e4d256-prod-github-runner-207 kernel: [56701.019281] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 21:08:47 juju-e4d256-prod-github-runner-207 kernel: [56701.020184] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 21:08:47 juju-e4d256-prod-github-runner-207 kernel: [56701.021079] ? __seccomp_filter+0x4a/0x4a0 Aug 22 21:08:47 juju-e4d256-prod-github-runner-207 kernel: [56701.021857] ? __fget_files+0x86/0xc0 Aug 22 21:08:47 juju-e4d256-prod-github-runner-207 kernel: [56701.022588] __x64_sys_ioctl+0x95/0xd0 Aug 22 21:08:47 juju-e4d256-prod-github-runner-207 kernel: [56701.023302] do_syscall_64+0x5c/0xc0 Aug 22 21:08:47 juju-e4d256-prod-github-runner-207 kernel: [56701.024088] ? do_futex+0x162/0x1f0 Aug 22 21:08:47 juju-e4d256-prod-github-runner-207 kernel: [56701.024786] ? __x64_sys_futex+0x78/0x1e0 Aug 22 21:08:47 juju-e4d256-prod-github-runner-207 kernel: [56701.025494] ? __secure_computing+0xa9/0x120 Aug 22 21:08:47 juju-e4d256-prod-github-runner-207 kernel: [56701.026211] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 21:08:47 juju-e4d256-prod-github-runner-207 kernel: [56701.027017] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:08:47 juju-e4d256-prod-github-runner-207 kernel: [56701.027771] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:08:47 juju-e4d256-prod-github-runner-207 kernel: [56701.028530] ? do_syscall_64+0x69/0xc0 Aug 22 21:08:47 juju-e4d256-prod-github-runner-207 kernel: [56701.029221] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:08:47 juju-e4d256-prod-github-runner-207 kernel: [56701.029979] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:08:47 juju-e4d256-prod-github-runner-207 kernel: [56701.030758] ? do_syscall_64+0x69/0xc0 Aug 22 21:08:47 juju-e4d256-prod-github-runner-207 kernel: [56701.031461] ? do_syscall_64+0x69/0xc0 Aug 22 21:08:47 juju-e4d256-prod-github-runner-207 kernel: [56701.032148] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 21:08:47 juju-e4d256-prod-github-runner-207 kernel: [56701.032918] RIP: 0033:0x7faa5d0edaff Aug 22 21:08:47 juju-e4d256-prod-github-runner-207 kernel: [56701.033602] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 21:08:47 juju-e4d256-prod-github-runner-207 kernel: [56701.035916] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 21:08:47 juju-e4d256-prod-github-runner-207 kernel: [56701.036887] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 21:08:47 juju-e4d256-prod-github-runner-207 kernel: [56701.037838] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 21:08:47 juju-e4d256-prod-github-runner-207 kernel: [56701.038803] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 21:08:47 juju-e4d256-prod-github-runner-207 kernel: [56701.039745] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 21:08:47 juju-e4d256-prod-github-runner-207 kernel: [56701.040677] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 21:08:47 juju-e4d256-prod-github-runner-207 kernel: [56701.041600] Aug 22 21:09:14 juju-e4d256-prod-github-runner-207 kernel: [56728.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 52724s! [qemu-system-x86:6715] Aug 22 21:09:14 juju-e4d256-prod-github-runner-207 kernel: [56728.543909] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 21:09:14 juju-e4d256-prod-github-runner-207 kernel: [56728.544225] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 21:09:14 juju-e4d256-prod-github-runner-207 kernel: [56728.556419] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 21:09:14 juju-e4d256-prod-github-runner-207 kernel: [56728.557688] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 21:09:14 juju-e4d256-prod-github-runner-207 kernel: [56728.558915] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:09:14 juju-e4d256-prod-github-runner-207 kernel: [56728.559974] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 21:09:14 juju-e4d256-prod-github-runner-207 kernel: [56728.562536] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 21:09:14 juju-e4d256-prod-github-runner-207 kernel: [56728.563588] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 21:09:14 juju-e4d256-prod-github-runner-207 kernel: [56728.564751] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 21:09:14 juju-e4d256-prod-github-runner-207 kernel: [56728.565910] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 21:09:14 juju-e4d256-prod-github-runner-207 kernel: [56728.567115] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 21:09:14 juju-e4d256-prod-github-runner-207 kernel: [56728.568308] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 21:09:14 juju-e4d256-prod-github-runner-207 kernel: [56728.569499] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 21:09:14 juju-e4d256-prod-github-runner-207 kernel: [56728.570760] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 21:09:14 juju-e4d256-prod-github-runner-207 kernel: [56728.571870] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 21:09:14 juju-e4d256-prod-github-runner-207 kernel: [56728.573065] Call Trace: Aug 22 21:09:14 juju-e4d256-prod-github-runner-207 kernel: [56728.573977] Aug 22 21:09:14 juju-e4d256-prod-github-runner-207 kernel: [56728.574885] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:09:14 juju-e4d256-prod-github-runner-207 kernel: [56728.575919] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:09:14 juju-e4d256-prod-github-runner-207 kernel: [56728.576938] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:09:14 juju-e4d256-prod-github-runner-207 kernel: [56728.578054] ? show_regs.part.0+0x23/0x29 Aug 22 21:09:14 juju-e4d256-prod-github-runner-207 kernel: [56728.579062] ? show_regs.cold+0x8/0xd Aug 22 21:09:14 juju-e4d256-prod-github-runner-207 kernel: [56728.580031] ? watchdog_timer_fn+0x1be/0x220 Aug 22 21:09:14 juju-e4d256-prod-github-runner-207 kernel: [56728.581038] ? lockup_detector_update_enable+0x60/0x60 Aug 22 21:09:14 juju-e4d256-prod-github-runner-207 kernel: [56728.582148] ? __hrtimer_run_queues+0x107/0x230 Aug 22 21:09:14 juju-e4d256-prod-github-runner-207 kernel: [56728.583207] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 21:09:14 juju-e4d256-prod-github-runner-207 kernel: [56728.584235] ? hrtimer_interrupt+0x101/0x220 Aug 22 21:09:14 juju-e4d256-prod-github-runner-207 kernel: [56728.585254] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 21:09:14 juju-e4d256-prod-github-runner-207 kernel: [56728.586381] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 21:09:14 juju-e4d256-prod-github-runner-207 kernel: [56728.587428] Aug 22 21:09:14 juju-e4d256-prod-github-runner-207 kernel: [56728.588306] Aug 22 21:09:14 juju-e4d256-prod-github-runner-207 kernel: [56728.589151] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 21:09:14 juju-e4d256-prod-github-runner-207 kernel: [56728.590232] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:09:14 juju-e4d256-prod-github-runner-207 kernel: [56728.591291] ? _raw_spin_lock+0x22/0x30 Aug 22 21:09:14 juju-e4d256-prod-github-runner-207 kernel: [56728.592273] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:09:14 juju-e4d256-prod-github-runner-207 kernel: [56728.593298] direct_page_fault+0x206/0x310 [kvm] Aug 22 21:09:14 juju-e4d256-prod-github-runner-207 kernel: [56728.594334] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 21:09:14 juju-e4d256-prod-github-runner-207 kernel: [56728.595346] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 21:09:14 juju-e4d256-prod-github-runner-207 kernel: [56728.596352] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 21:09:14 juju-e4d256-prod-github-runner-207 kernel: [56728.597366] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 21:09:14 juju-e4d256-prod-github-runner-207 kernel: [56728.598344] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 21:09:14 juju-e4d256-prod-github-runner-207 kernel: [56728.599354] handle_exit+0x98/0x230 [kvm_amd] Aug 22 21:09:14 juju-e4d256-prod-github-runner-207 kernel: [56728.600258] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 21:09:14 juju-e4d256-prod-github-runner-207 kernel: [56728.601178] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 21:09:14 juju-e4d256-prod-github-runner-207 kernel: [56728.602128] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 21:09:14 juju-e4d256-prod-github-runner-207 kernel: [56728.603046] vcpu_run+0x62/0x2c0 [kvm] Aug 22 21:09:14 juju-e4d256-prod-github-runner-207 kernel: [56728.603890] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 21:09:14 juju-e4d256-prod-github-runner-207 kernel: [56728.604703] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 21:09:14 juju-e4d256-prod-github-runner-207 kernel: [56728.605560] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 21:09:14 juju-e4d256-prod-github-runner-207 kernel: [56728.606364] ? __seccomp_filter+0x4a/0x4a0 Aug 22 21:09:14 juju-e4d256-prod-github-runner-207 kernel: [56728.607110] ? __fget_files+0x86/0xc0 Aug 22 21:09:14 juju-e4d256-prod-github-runner-207 kernel: [56728.607817] __x64_sys_ioctl+0x95/0xd0 Aug 22 21:09:14 juju-e4d256-prod-github-runner-207 kernel: [56728.608507] do_syscall_64+0x5c/0xc0 Aug 22 21:09:14 juju-e4d256-prod-github-runner-207 kernel: [56728.609302] ? do_futex+0x162/0x1f0 Aug 22 21:09:14 juju-e4d256-prod-github-runner-207 kernel: [56728.609946] ? __x64_sys_futex+0x78/0x1e0 Aug 22 21:09:14 juju-e4d256-prod-github-runner-207 kernel: [56728.610655] ? __secure_computing+0xa9/0x120 Aug 22 21:09:14 juju-e4d256-prod-github-runner-207 kernel: [56728.611346] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 21:09:14 juju-e4d256-prod-github-runner-207 kernel: [56728.612103] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:09:14 juju-e4d256-prod-github-runner-207 kernel: [56728.612825] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:09:14 juju-e4d256-prod-github-runner-207 kernel: [56728.613546] ? do_syscall_64+0x69/0xc0 Aug 22 21:09:14 juju-e4d256-prod-github-runner-207 kernel: [56728.614226] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:09:14 juju-e4d256-prod-github-runner-207 kernel: [56728.614928] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:09:14 juju-e4d256-prod-github-runner-207 kernel: [56728.615627] ? do_syscall_64+0x69/0xc0 Aug 22 21:09:14 juju-e4d256-prod-github-runner-207 kernel: [56728.616250] ? do_syscall_64+0x69/0xc0 Aug 22 21:09:14 juju-e4d256-prod-github-runner-207 kernel: [56728.616876] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 21:09:14 juju-e4d256-prod-github-runner-207 kernel: [56728.617579] RIP: 0033:0x7faa5d0edaff Aug 22 21:09:14 juju-e4d256-prod-github-runner-207 kernel: [56728.618245] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 21:09:14 juju-e4d256-prod-github-runner-207 kernel: [56728.620244] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 21:09:14 juju-e4d256-prod-github-runner-207 kernel: [56728.621147] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 21:09:14 juju-e4d256-prod-github-runner-207 kernel: [56728.622027] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 21:09:14 juju-e4d256-prod-github-runner-207 kernel: [56728.622915] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 21:09:14 juju-e4d256-prod-github-runner-207 kernel: [56728.623792] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 21:09:14 juju-e4d256-prod-github-runner-207 kernel: [56728.624671] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 21:09:14 juju-e4d256-prod-github-runner-207 kernel: [56728.625554] Aug 22 21:09:42 juju-e4d256-prod-github-runner-207 kernel: [56756.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 52750s! [qemu-system-x86:6715] Aug 22 21:09:42 juju-e4d256-prod-github-runner-207 kernel: [56756.543149] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 21:09:42 juju-e4d256-prod-github-runner-207 kernel: [56756.543225] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 21:09:42 juju-e4d256-prod-github-runner-207 kernel: [56756.555617] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 21:09:42 juju-e4d256-prod-github-runner-207 kernel: [56756.556889] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 21:09:42 juju-e4d256-prod-github-runner-207 kernel: [56756.558335] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:09:42 juju-e4d256-prod-github-runner-207 kernel: [56756.559523] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 21:09:42 juju-e4d256-prod-github-runner-207 kernel: [56756.562431] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 21:09:42 juju-e4d256-prod-github-runner-207 kernel: [56756.563605] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 21:09:42 juju-e4d256-prod-github-runner-207 kernel: [56756.565098] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 21:09:42 juju-e4d256-prod-github-runner-207 kernel: [56756.566400] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 21:09:42 juju-e4d256-prod-github-runner-207 kernel: [56756.567895] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 21:09:42 juju-e4d256-prod-github-runner-207 kernel: [56756.569220] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 21:09:42 juju-e4d256-prod-github-runner-207 kernel: [56756.570535] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 21:09:42 juju-e4d256-prod-github-runner-207 kernel: [56756.571915] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 21:09:42 juju-e4d256-prod-github-runner-207 kernel: [56756.573114] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 21:09:42 juju-e4d256-prod-github-runner-207 kernel: [56756.574450] Call Trace: Aug 22 21:09:42 juju-e4d256-prod-github-runner-207 kernel: [56756.575415] Aug 22 21:09:42 juju-e4d256-prod-github-runner-207 kernel: [56756.576338] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:09:42 juju-e4d256-prod-github-runner-207 kernel: [56756.577450] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:09:42 juju-e4d256-prod-github-runner-207 kernel: [56756.578574] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:09:42 juju-e4d256-prod-github-runner-207 kernel: [56756.579757] ? show_regs.part.0+0x23/0x29 Aug 22 21:09:42 juju-e4d256-prod-github-runner-207 kernel: [56756.580857] ? show_regs.cold+0x8/0xd Aug 22 21:09:42 juju-e4d256-prod-github-runner-207 kernel: [56756.581931] ? watchdog_timer_fn+0x1be/0x220 Aug 22 21:09:42 juju-e4d256-prod-github-runner-207 kernel: [56756.583030] ? lockup_detector_update_enable+0x60/0x60 Aug 22 21:09:42 juju-e4d256-prod-github-runner-207 kernel: [56756.584200] ? __hrtimer_run_queues+0x107/0x230 Aug 22 21:09:42 juju-e4d256-prod-github-runner-207 kernel: [56756.585329] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 21:09:42 juju-e4d256-prod-github-runner-207 kernel: [56756.586460] ? hrtimer_interrupt+0x101/0x220 Aug 22 21:09:42 juju-e4d256-prod-github-runner-207 kernel: [56756.587560] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 21:09:42 juju-e4d256-prod-github-runner-207 kernel: [56756.588723] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 21:09:42 juju-e4d256-prod-github-runner-207 kernel: [56756.589873] Aug 22 21:09:42 juju-e4d256-prod-github-runner-207 kernel: [56756.590781] Aug 22 21:09:42 juju-e4d256-prod-github-runner-207 kernel: [56756.591662] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 21:09:42 juju-e4d256-prod-github-runner-207 kernel: [56756.592794] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:09:42 juju-e4d256-prod-github-runner-207 kernel: [56756.593946] ? _raw_spin_lock+0x22/0x30 Aug 22 21:09:42 juju-e4d256-prod-github-runner-207 kernel: [56756.594969] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:09:42 juju-e4d256-prod-github-runner-207 kernel: [56756.596079] direct_page_fault+0x206/0x310 [kvm] Aug 22 21:09:42 juju-e4d256-prod-github-runner-207 kernel: [56756.597204] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 21:09:42 juju-e4d256-prod-github-runner-207 kernel: [56756.598320] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 21:09:42 juju-e4d256-prod-github-runner-207 kernel: [56756.599418] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 21:09:42 juju-e4d256-prod-github-runner-207 kernel: [56756.600513] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 21:09:42 juju-e4d256-prod-github-runner-207 kernel: [56756.601552] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 21:09:42 juju-e4d256-prod-github-runner-207 kernel: [56756.602666] handle_exit+0x98/0x230 [kvm_amd] Aug 22 21:09:42 juju-e4d256-prod-github-runner-207 kernel: [56756.603678] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 21:09:42 juju-e4d256-prod-github-runner-207 kernel: [56756.604679] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 21:09:42 juju-e4d256-prod-github-runner-207 kernel: [56756.605698] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 21:09:42 juju-e4d256-prod-github-runner-207 kernel: [56756.606707] vcpu_run+0x62/0x2c0 [kvm] Aug 22 21:09:42 juju-e4d256-prod-github-runner-207 kernel: [56756.607603] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 21:09:42 juju-e4d256-prod-github-runner-207 kernel: [56756.608533] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 21:09:42 juju-e4d256-prod-github-runner-207 kernel: [56756.609488] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 21:09:42 juju-e4d256-prod-github-runner-207 kernel: [56756.610389] ? __seccomp_filter+0x4a/0x4a0 Aug 22 21:09:42 juju-e4d256-prod-github-runner-207 kernel: [56756.611210] ? __fget_files+0x86/0xc0 Aug 22 21:09:42 juju-e4d256-prod-github-runner-207 kernel: [56756.611983] __x64_sys_ioctl+0x95/0xd0 Aug 22 21:09:42 juju-e4d256-prod-github-runner-207 kernel: [56756.612748] do_syscall_64+0x5c/0xc0 Aug 22 21:09:42 juju-e4d256-prod-github-runner-207 kernel: [56756.613485] ? do_futex+0x162/0x1f0 Aug 22 21:09:42 juju-e4d256-prod-github-runner-207 kernel: [56756.614217] ? __x64_sys_futex+0x78/0x1e0 Aug 22 21:09:42 juju-e4d256-prod-github-runner-207 kernel: [56756.614975] ? __secure_computing+0xa9/0x120 Aug 22 21:09:42 juju-e4d256-prod-github-runner-207 kernel: [56756.615749] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 21:09:42 juju-e4d256-prod-github-runner-207 kernel: [56756.616609] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:09:42 juju-e4d256-prod-github-runner-207 kernel: [56756.617422] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:09:42 juju-e4d256-prod-github-runner-207 kernel: [56756.618254] ? do_syscall_64+0x69/0xc0 Aug 22 21:09:42 juju-e4d256-prod-github-runner-207 kernel: [56756.618975] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:09:42 juju-e4d256-prod-github-runner-207 kernel: [56756.619774] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:09:42 juju-e4d256-prod-github-runner-207 kernel: [56756.620582] ? do_syscall_64+0x69/0xc0 Aug 22 21:09:42 juju-e4d256-prod-github-runner-207 kernel: [56756.621291] ? do_syscall_64+0x69/0xc0 Aug 22 21:09:42 juju-e4d256-prod-github-runner-207 kernel: [56756.622013] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 21:09:42 juju-e4d256-prod-github-runner-207 kernel: [56756.622816] RIP: 0033:0x7faa5d0edaff Aug 22 21:09:42 juju-e4d256-prod-github-runner-207 kernel: [56756.623550] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 21:09:42 juju-e4d256-prod-github-runner-207 kernel: [56756.625886] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 21:09:42 juju-e4d256-prod-github-runner-207 kernel: [56756.626937] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 21:09:42 juju-e4d256-prod-github-runner-207 kernel: [56756.627957] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 21:09:42 juju-e4d256-prod-github-runner-207 kernel: [56756.628983] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 21:09:42 juju-e4d256-prod-github-runner-207 kernel: [56756.630014] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 21:09:42 juju-e4d256-prod-github-runner-207 kernel: [56756.631034] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 21:09:42 juju-e4d256-prod-github-runner-207 kernel: [56756.632062] Aug 22 21:10:10 juju-e4d256-prod-github-runner-207 kernel: [56784.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 52776s! [qemu-system-x86:6715] Aug 22 21:10:10 juju-e4d256-prod-github-runner-207 kernel: [56784.543146] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 21:10:10 juju-e4d256-prod-github-runner-207 kernel: [56784.543222] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 21:10:10 juju-e4d256-prod-github-runner-207 kernel: [56784.555808] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 21:10:10 juju-e4d256-prod-github-runner-207 kernel: [56784.557143] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 21:10:10 juju-e4d256-prod-github-runner-207 kernel: [56784.558431] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:10:10 juju-e4d256-prod-github-runner-207 kernel: [56784.559559] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 21:10:10 juju-e4d256-prod-github-runner-207 kernel: [56784.562215] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 21:10:10 juju-e4d256-prod-github-runner-207 kernel: [56784.563297] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 21:10:10 juju-e4d256-prod-github-runner-207 kernel: [56784.564487] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 21:10:10 juju-e4d256-prod-github-runner-207 kernel: [56784.565789] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 21:10:10 juju-e4d256-prod-github-runner-207 kernel: [56784.566969] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 21:10:10 juju-e4d256-prod-github-runner-207 kernel: [56784.568190] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 21:10:10 juju-e4d256-prod-github-runner-207 kernel: [56784.569380] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 21:10:10 juju-e4d256-prod-github-runner-207 kernel: [56784.570688] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 21:10:10 juju-e4d256-prod-github-runner-207 kernel: [56784.571833] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 21:10:10 juju-e4d256-prod-github-runner-207 kernel: [56784.573321] Call Trace: Aug 22 21:10:10 juju-e4d256-prod-github-runner-207 kernel: [56784.574270] Aug 22 21:10:10 juju-e4d256-prod-github-runner-207 kernel: [56784.575244] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:10:10 juju-e4d256-prod-github-runner-207 kernel: [56784.576317] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:10:10 juju-e4d256-prod-github-runner-207 kernel: [56784.577353] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:10:10 juju-e4d256-prod-github-runner-207 kernel: [56784.578458] ? show_regs.part.0+0x23/0x29 Aug 22 21:10:10 juju-e4d256-prod-github-runner-207 kernel: [56784.579493] ? show_regs.cold+0x8/0xd Aug 22 21:10:10 juju-e4d256-prod-github-runner-207 kernel: [56784.580492] ? watchdog_timer_fn+0x1be/0x220 Aug 22 21:10:10 juju-e4d256-prod-github-runner-207 kernel: [56784.581534] ? lockup_detector_update_enable+0x60/0x60 Aug 22 21:10:10 juju-e4d256-prod-github-runner-207 kernel: [56784.582610] ? __hrtimer_run_queues+0x107/0x230 Aug 22 21:10:10 juju-e4d256-prod-github-runner-207 kernel: [56784.583682] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 21:10:10 juju-e4d256-prod-github-runner-207 kernel: [56784.584727] ? hrtimer_interrupt+0x101/0x220 Aug 22 21:10:10 juju-e4d256-prod-github-runner-207 kernel: [56784.585774] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 21:10:10 juju-e4d256-prod-github-runner-207 kernel: [56784.586855] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 21:10:10 juju-e4d256-prod-github-runner-207 kernel: [56784.587913] Aug 22 21:10:10 juju-e4d256-prod-github-runner-207 kernel: [56784.588775] Aug 22 21:10:10 juju-e4d256-prod-github-runner-207 kernel: [56784.589717] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 21:10:10 juju-e4d256-prod-github-runner-207 kernel: [56784.590828] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:10:10 juju-e4d256-prod-github-runner-207 kernel: [56784.591923] ? _raw_spin_lock+0x22/0x30 Aug 22 21:10:10 juju-e4d256-prod-github-runner-207 kernel: [56784.592907] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:10:10 juju-e4d256-prod-github-runner-207 kernel: [56784.593963] direct_page_fault+0x206/0x310 [kvm] Aug 22 21:10:10 juju-e4d256-prod-github-runner-207 kernel: [56784.595016] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 21:10:10 juju-e4d256-prod-github-runner-207 kernel: [56784.596059] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 21:10:10 juju-e4d256-prod-github-runner-207 kernel: [56784.597085] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 21:10:10 juju-e4d256-prod-github-runner-207 kernel: [56784.598140] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 21:10:10 juju-e4d256-prod-github-runner-207 kernel: [56784.599163] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 21:10:10 juju-e4d256-prod-github-runner-207 kernel: [56784.600165] handle_exit+0x98/0x230 [kvm_amd] Aug 22 21:10:10 juju-e4d256-prod-github-runner-207 kernel: [56784.601071] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 21:10:10 juju-e4d256-prod-github-runner-207 kernel: [56784.602022] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 21:10:10 juju-e4d256-prod-github-runner-207 kernel: [56784.602966] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 21:10:10 juju-e4d256-prod-github-runner-207 kernel: [56784.603907] vcpu_run+0x62/0x2c0 [kvm] Aug 22 21:10:10 juju-e4d256-prod-github-runner-207 kernel: [56784.604734] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 21:10:10 juju-e4d256-prod-github-runner-207 kernel: [56784.605622] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 21:10:10 juju-e4d256-prod-github-runner-207 kernel: [56784.606502] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 21:10:10 juju-e4d256-prod-github-runner-207 kernel: [56784.607321] ? __seccomp_filter+0x4a/0x4a0 Aug 22 21:10:10 juju-e4d256-prod-github-runner-207 kernel: [56784.608097] ? __fget_files+0x86/0xc0 Aug 22 21:10:10 juju-e4d256-prod-github-runner-207 kernel: [56784.608842] __x64_sys_ioctl+0x95/0xd0 Aug 22 21:10:10 juju-e4d256-prod-github-runner-207 kernel: [56784.609582] do_syscall_64+0x5c/0xc0 Aug 22 21:10:10 juju-e4d256-prod-github-runner-207 kernel: [56784.610285] ? do_futex+0x162/0x1f0 Aug 22 21:10:10 juju-e4d256-prod-github-runner-207 kernel: [56784.610946] ? __x64_sys_futex+0x78/0x1e0 Aug 22 21:10:10 juju-e4d256-prod-github-runner-207 kernel: [56784.611633] ? __secure_computing+0xa9/0x120 Aug 22 21:10:10 juju-e4d256-prod-github-runner-207 kernel: [56784.612351] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 21:10:10 juju-e4d256-prod-github-runner-207 kernel: [56784.613135] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:10:10 juju-e4d256-prod-github-runner-207 kernel: [56784.613888] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:10:10 juju-e4d256-prod-github-runner-207 kernel: [56784.614702] ? do_syscall_64+0x69/0xc0 Aug 22 21:10:10 juju-e4d256-prod-github-runner-207 kernel: [56784.615422] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:10:10 juju-e4d256-prod-github-runner-207 kernel: [56784.616288] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:10:10 juju-e4d256-prod-github-runner-207 kernel: [56784.617097] ? do_syscall_64+0x69/0xc0 Aug 22 21:10:10 juju-e4d256-prod-github-runner-207 kernel: [56784.617870] ? do_syscall_64+0x69/0xc0 Aug 22 21:10:10 juju-e4d256-prod-github-runner-207 kernel: [56784.618517] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 21:10:10 juju-e4d256-prod-github-runner-207 kernel: [56784.619247] RIP: 0033:0x7faa5d0edaff Aug 22 21:10:10 juju-e4d256-prod-github-runner-207 kernel: [56784.619882] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 21:10:10 juju-e4d256-prod-github-runner-207 kernel: [56784.621971] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 21:10:10 juju-e4d256-prod-github-runner-207 kernel: [56784.622921] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 21:10:10 juju-e4d256-prod-github-runner-207 kernel: [56784.623854] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 21:10:10 juju-e4d256-prod-github-runner-207 kernel: [56784.624757] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 21:10:10 juju-e4d256-prod-github-runner-207 kernel: [56784.625684] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 21:10:10 juju-e4d256-prod-github-runner-207 kernel: [56784.626593] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 21:10:10 juju-e4d256-prod-github-runner-207 kernel: [56784.627506] Aug 22 21:10:38 juju-e4d256-prod-github-runner-207 kernel: [56812.541976] watchdog: BUG: soft lockup - CPU#1 stuck for 52802s! [qemu-system-x86:6715] Aug 22 21:10:38 juju-e4d256-prod-github-runner-207 kernel: [56812.543896] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 21:10:38 juju-e4d256-prod-github-runner-207 kernel: [56812.544230] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 21:10:38 juju-e4d256-prod-github-runner-207 kernel: [56812.557137] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 21:10:38 juju-e4d256-prod-github-runner-207 kernel: [56812.558510] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 21:10:38 juju-e4d256-prod-github-runner-207 kernel: [56812.560067] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:10:38 juju-e4d256-prod-github-runner-207 kernel: [56812.561328] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 21:10:38 juju-e4d256-prod-github-runner-207 kernel: [56812.563951] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 21:10:38 juju-e4d256-prod-github-runner-207 kernel: [56812.565042] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 21:10:38 juju-e4d256-prod-github-runner-207 kernel: [56812.566260] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 21:10:38 juju-e4d256-prod-github-runner-207 kernel: [56812.567447] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 21:10:38 juju-e4d256-prod-github-runner-207 kernel: [56812.568628] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 21:10:38 juju-e4d256-prod-github-runner-207 kernel: [56812.569831] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 21:10:38 juju-e4d256-prod-github-runner-207 kernel: [56812.571029] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 21:10:38 juju-e4d256-prod-github-runner-207 kernel: [56812.572344] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 21:10:38 juju-e4d256-prod-github-runner-207 kernel: [56812.573500] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 21:10:38 juju-e4d256-prod-github-runner-207 kernel: [56812.574745] Call Trace: Aug 22 21:10:38 juju-e4d256-prod-github-runner-207 kernel: [56812.575705] Aug 22 21:10:38 juju-e4d256-prod-github-runner-207 kernel: [56812.576785] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:10:38 juju-e4d256-prod-github-runner-207 kernel: [56812.577851] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:10:38 juju-e4d256-prod-github-runner-207 kernel: [56812.578922] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:10:38 juju-e4d256-prod-github-runner-207 kernel: [56812.580039] ? show_regs.part.0+0x23/0x29 Aug 22 21:10:38 juju-e4d256-prod-github-runner-207 kernel: [56812.581092] ? show_regs.cold+0x8/0xd Aug 22 21:10:38 juju-e4d256-prod-github-runner-207 kernel: [56812.582085] ? watchdog_timer_fn+0x1be/0x220 Aug 22 21:10:38 juju-e4d256-prod-github-runner-207 kernel: [56812.583109] ? lockup_detector_update_enable+0x60/0x60 Aug 22 21:10:38 juju-e4d256-prod-github-runner-207 kernel: [56812.584184] ? __hrtimer_run_queues+0x107/0x230 Aug 22 21:10:38 juju-e4d256-prod-github-runner-207 kernel: [56812.585252] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 21:10:38 juju-e4d256-prod-github-runner-207 kernel: [56812.586285] ? hrtimer_interrupt+0x101/0x220 Aug 22 21:10:38 juju-e4d256-prod-github-runner-207 kernel: [56812.587306] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 21:10:38 juju-e4d256-prod-github-runner-207 kernel: [56812.588386] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 21:10:38 juju-e4d256-prod-github-runner-207 kernel: [56812.589473] Aug 22 21:10:38 juju-e4d256-prod-github-runner-207 kernel: [56812.590329] Aug 22 21:10:38 juju-e4d256-prod-github-runner-207 kernel: [56812.591361] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 21:10:38 juju-e4d256-prod-github-runner-207 kernel: [56812.592456] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:10:38 juju-e4d256-prod-github-runner-207 kernel: [56812.593523] ? _raw_spin_lock+0x22/0x30 Aug 22 21:10:38 juju-e4d256-prod-github-runner-207 kernel: [56812.594488] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:10:38 juju-e4d256-prod-github-runner-207 kernel: [56812.595524] direct_page_fault+0x206/0x310 [kvm] Aug 22 21:10:38 juju-e4d256-prod-github-runner-207 kernel: [56812.596558] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 21:10:38 juju-e4d256-prod-github-runner-207 kernel: [56812.597596] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 21:10:38 juju-e4d256-prod-github-runner-207 kernel: [56812.598610] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 21:10:38 juju-e4d256-prod-github-runner-207 kernel: [56812.599627] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 21:10:38 juju-e4d256-prod-github-runner-207 kernel: [56812.600586] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 21:10:38 juju-e4d256-prod-github-runner-207 kernel: [56812.601585] handle_exit+0x98/0x230 [kvm_amd] Aug 22 21:10:38 juju-e4d256-prod-github-runner-207 kernel: [56812.602488] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 21:10:38 juju-e4d256-prod-github-runner-207 kernel: [56812.603411] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 21:10:38 juju-e4d256-prod-github-runner-207 kernel: [56812.604367] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 21:10:38 juju-e4d256-prod-github-runner-207 kernel: [56812.605282] vcpu_run+0x62/0x2c0 [kvm] Aug 22 21:10:38 juju-e4d256-prod-github-runner-207 kernel: [56812.606100] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 21:10:38 juju-e4d256-prod-github-runner-207 kernel: [56812.606972] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 21:10:38 juju-e4d256-prod-github-runner-207 kernel: [56812.607879] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 21:10:38 juju-e4d256-prod-github-runner-207 kernel: [56812.608692] ? __seccomp_filter+0x4a/0x4a0 Aug 22 21:10:38 juju-e4d256-prod-github-runner-207 kernel: [56812.609453] ? __fget_files+0x86/0xc0 Aug 22 21:10:38 juju-e4d256-prod-github-runner-207 kernel: [56812.610166] __x64_sys_ioctl+0x95/0xd0 Aug 22 21:10:38 juju-e4d256-prod-github-runner-207 kernel: [56812.610896] do_syscall_64+0x5c/0xc0 Aug 22 21:10:38 juju-e4d256-prod-github-runner-207 kernel: [56812.611582] ? do_futex+0x162/0x1f0 Aug 22 21:10:38 juju-e4d256-prod-github-runner-207 kernel: [56812.612259] ? __x64_sys_futex+0x78/0x1e0 Aug 22 21:10:38 juju-e4d256-prod-github-runner-207 kernel: [56812.612964] ? __secure_computing+0xa9/0x120 Aug 22 21:10:38 juju-e4d256-prod-github-runner-207 kernel: [56812.613777] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 21:10:38 juju-e4d256-prod-github-runner-207 kernel: [56812.614589] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:10:38 juju-e4d256-prod-github-runner-207 kernel: [56812.615333] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:10:38 juju-e4d256-prod-github-runner-207 kernel: [56812.616193] ? do_syscall_64+0x69/0xc0 Aug 22 21:10:38 juju-e4d256-prod-github-runner-207 kernel: [56812.616938] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:10:38 juju-e4d256-prod-github-runner-207 kernel: [56812.617664] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:10:38 juju-e4d256-prod-github-runner-207 kernel: [56812.618371] ? do_syscall_64+0x69/0xc0 Aug 22 21:10:38 juju-e4d256-prod-github-runner-207 kernel: [56812.619002] ? do_syscall_64+0x69/0xc0 Aug 22 21:10:38 juju-e4d256-prod-github-runner-207 kernel: [56812.619632] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 21:10:38 juju-e4d256-prod-github-runner-207 kernel: [56812.620370] RIP: 0033:0x7faa5d0edaff Aug 22 21:10:38 juju-e4d256-prod-github-runner-207 kernel: [56812.621072] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 21:10:38 juju-e4d256-prod-github-runner-207 kernel: [56812.623113] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 21:10:38 juju-e4d256-prod-github-runner-207 kernel: [56812.624069] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 21:10:38 juju-e4d256-prod-github-runner-207 kernel: [56812.625023] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 21:10:38 juju-e4d256-prod-github-runner-207 kernel: [56812.625956] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 21:10:38 juju-e4d256-prod-github-runner-207 kernel: [56812.626874] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 21:10:38 juju-e4d256-prod-github-runner-207 kernel: [56812.627779] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 21:10:38 juju-e4d256-prod-github-runner-207 kernel: [56812.628686] Aug 22 21:11:06 juju-e4d256-prod-github-runner-207 kernel: [56840.541980] watchdog: BUG: soft lockup - CPU#1 stuck for 52828s! [qemu-system-x86:6715] Aug 22 21:11:06 juju-e4d256-prod-github-runner-207 kernel: [56840.543115] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 21:11:06 juju-e4d256-prod-github-runner-207 kernel: [56840.543188] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 21:11:06 juju-e4d256-prod-github-runner-207 kernel: [56840.555614] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 21:11:06 juju-e4d256-prod-github-runner-207 kernel: [56840.556912] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 21:11:06 juju-e4d256-prod-github-runner-207 kernel: [56840.558154] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:11:06 juju-e4d256-prod-github-runner-207 kernel: [56840.559458] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 21:11:06 juju-e4d256-prod-github-runner-207 kernel: [56840.562079] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 21:11:06 juju-e4d256-prod-github-runner-207 kernel: [56840.563133] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 21:11:06 juju-e4d256-prod-github-runner-207 kernel: [56840.564328] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 21:11:06 juju-e4d256-prod-github-runner-207 kernel: [56840.565792] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 21:11:06 juju-e4d256-prod-github-runner-207 kernel: [56840.566999] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 21:11:06 juju-e4d256-prod-github-runner-207 kernel: [56840.568188] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 21:11:06 juju-e4d256-prod-github-runner-207 kernel: [56840.569410] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 21:11:06 juju-e4d256-prod-github-runner-207 kernel: [56840.570727] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 21:11:06 juju-e4d256-prod-github-runner-207 kernel: [56840.571848] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 21:11:06 juju-e4d256-prod-github-runner-207 kernel: [56840.573082] Call Trace: Aug 22 21:11:06 juju-e4d256-prod-github-runner-207 kernel: [56840.574050] Aug 22 21:11:06 juju-e4d256-prod-github-runner-207 kernel: [56840.574955] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:11:06 juju-e4d256-prod-github-runner-207 kernel: [56840.576002] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:11:06 juju-e4d256-prod-github-runner-207 kernel: [56840.577057] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:11:06 juju-e4d256-prod-github-runner-207 kernel: [56840.578167] ? show_regs.part.0+0x23/0x29 Aug 22 21:11:06 juju-e4d256-prod-github-runner-207 kernel: [56840.579178] ? show_regs.cold+0x8/0xd Aug 22 21:11:06 juju-e4d256-prod-github-runner-207 kernel: [56840.580162] ? watchdog_timer_fn+0x1be/0x220 Aug 22 21:11:06 juju-e4d256-prod-github-runner-207 kernel: [56840.581382] ? lockup_detector_update_enable+0x60/0x60 Aug 22 21:11:06 juju-e4d256-prod-github-runner-207 kernel: [56840.582609] ? __hrtimer_run_queues+0x107/0x230 Aug 22 21:11:06 juju-e4d256-prod-github-runner-207 kernel: [56840.583661] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 21:11:06 juju-e4d256-prod-github-runner-207 kernel: [56840.584727] ? hrtimer_interrupt+0x101/0x220 Aug 22 21:11:06 juju-e4d256-prod-github-runner-207 kernel: [56840.585854] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 21:11:06 juju-e4d256-prod-github-runner-207 kernel: [56840.586956] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 21:11:06 juju-e4d256-prod-github-runner-207 kernel: [56840.588023] Aug 22 21:11:06 juju-e4d256-prod-github-runner-207 kernel: [56840.588910] Aug 22 21:11:06 juju-e4d256-prod-github-runner-207 kernel: [56840.589767] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 21:11:06 juju-e4d256-prod-github-runner-207 kernel: [56840.590832] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:11:06 juju-e4d256-prod-github-runner-207 kernel: [56840.591899] ? _raw_spin_lock+0x22/0x30 Aug 22 21:11:06 juju-e4d256-prod-github-runner-207 kernel: [56840.592902] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:11:06 juju-e4d256-prod-github-runner-207 kernel: [56840.594018] direct_page_fault+0x206/0x310 [kvm] Aug 22 21:11:06 juju-e4d256-prod-github-runner-207 kernel: [56840.595122] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 21:11:06 juju-e4d256-prod-github-runner-207 kernel: [56840.596211] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 21:11:06 juju-e4d256-prod-github-runner-207 kernel: [56840.597350] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 21:11:06 juju-e4d256-prod-github-runner-207 kernel: [56840.598383] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 21:11:06 juju-e4d256-prod-github-runner-207 kernel: [56840.599403] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 21:11:06 juju-e4d256-prod-github-runner-207 kernel: [56840.600447] handle_exit+0x98/0x230 [kvm_amd] Aug 22 21:11:06 juju-e4d256-prod-github-runner-207 kernel: [56840.601558] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 21:11:06 juju-e4d256-prod-github-runner-207 kernel: [56840.602542] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 21:11:06 juju-e4d256-prod-github-runner-207 kernel: [56840.603553] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 21:11:06 juju-e4d256-prod-github-runner-207 kernel: [56840.604531] vcpu_run+0x62/0x2c0 [kvm] Aug 22 21:11:06 juju-e4d256-prod-github-runner-207 kernel: [56840.605442] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 21:11:06 juju-e4d256-prod-github-runner-207 kernel: [56840.606314] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 21:11:06 juju-e4d256-prod-github-runner-207 kernel: [56840.607260] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 21:11:06 juju-e4d256-prod-github-runner-207 kernel: [56840.608114] ? __seccomp_filter+0x4a/0x4a0 Aug 22 21:11:06 juju-e4d256-prod-github-runner-207 kernel: [56840.608904] ? __fget_files+0x86/0xc0 Aug 22 21:11:06 juju-e4d256-prod-github-runner-207 kernel: [56840.609679] __x64_sys_ioctl+0x95/0xd0 Aug 22 21:11:06 juju-e4d256-prod-github-runner-207 kernel: [56840.610453] do_syscall_64+0x5c/0xc0 Aug 22 21:11:06 juju-e4d256-prod-github-runner-207 kernel: [56840.611306] ? do_futex+0x162/0x1f0 Aug 22 21:11:06 juju-e4d256-prod-github-runner-207 kernel: [56840.612017] ? __x64_sys_futex+0x78/0x1e0 Aug 22 21:11:06 juju-e4d256-prod-github-runner-207 kernel: [56840.612740] ? __secure_computing+0xa9/0x120 Aug 22 21:11:06 juju-e4d256-prod-github-runner-207 kernel: [56840.613448] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 21:11:06 juju-e4d256-prod-github-runner-207 kernel: [56840.614230] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:11:06 juju-e4d256-prod-github-runner-207 kernel: [56840.615152] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:11:06 juju-e4d256-prod-github-runner-207 kernel: [56840.615895] ? do_syscall_64+0x69/0xc0 Aug 22 21:11:06 juju-e4d256-prod-github-runner-207 kernel: [56840.616553] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:11:06 juju-e4d256-prod-github-runner-207 kernel: [56840.617297] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:11:06 juju-e4d256-prod-github-runner-207 kernel: [56840.618019] ? do_syscall_64+0x69/0xc0 Aug 22 21:11:06 juju-e4d256-prod-github-runner-207 kernel: [56840.618661] ? do_syscall_64+0x69/0xc0 Aug 22 21:11:06 juju-e4d256-prod-github-runner-207 kernel: [56840.619297] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 21:11:06 juju-e4d256-prod-github-runner-207 kernel: [56840.620015] RIP: 0033:0x7faa5d0edaff Aug 22 21:11:06 juju-e4d256-prod-github-runner-207 kernel: [56840.620674] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 21:11:06 juju-e4d256-prod-github-runner-207 kernel: [56840.622742] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 21:11:06 juju-e4d256-prod-github-runner-207 kernel: [56840.623688] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 21:11:06 juju-e4d256-prod-github-runner-207 kernel: [56840.624603] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 21:11:06 juju-e4d256-prod-github-runner-207 kernel: [56840.625530] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 21:11:06 juju-e4d256-prod-github-runner-207 kernel: [56840.626438] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 21:11:06 juju-e4d256-prod-github-runner-207 kernel: [56840.627349] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 21:11:06 juju-e4d256-prod-github-runner-207 kernel: [56840.628265] Aug 22 21:11:34 juju-e4d256-prod-github-runner-207 kernel: [56868.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 52854s! [qemu-system-x86:6715] Aug 22 21:11:34 juju-e4d256-prod-github-runner-207 kernel: [56868.543292] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 21:11:34 juju-e4d256-prod-github-runner-207 kernel: [56868.543369] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 21:11:34 juju-e4d256-prod-github-runner-207 kernel: [56868.557345] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 21:11:34 juju-e4d256-prod-github-runner-207 kernel: [56868.558806] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 21:11:34 juju-e4d256-prod-github-runner-207 kernel: [56868.560189] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:11:34 juju-e4d256-prod-github-runner-207 kernel: [56868.561376] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 21:11:34 juju-e4d256-prod-github-runner-207 kernel: [56868.564258] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 21:11:34 juju-e4d256-prod-github-runner-207 kernel: [56868.565422] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 21:11:34 juju-e4d256-prod-github-runner-207 kernel: [56868.566716] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 21:11:34 juju-e4d256-prod-github-runner-207 kernel: [56868.568016] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 21:11:34 juju-e4d256-prod-github-runner-207 kernel: [56868.569342] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 21:11:34 juju-e4d256-prod-github-runner-207 kernel: [56868.570635] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 21:11:34 juju-e4d256-prod-github-runner-207 kernel: [56868.571937] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 21:11:34 juju-e4d256-prod-github-runner-207 kernel: [56868.573324] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 21:11:34 juju-e4d256-prod-github-runner-207 kernel: [56868.574538] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 21:11:34 juju-e4d256-prod-github-runner-207 kernel: [56868.575869] Call Trace: Aug 22 21:11:34 juju-e4d256-prod-github-runner-207 kernel: [56868.576852] Aug 22 21:11:34 juju-e4d256-prod-github-runner-207 kernel: [56868.577784] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:11:34 juju-e4d256-prod-github-runner-207 kernel: [56868.578947] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:11:34 juju-e4d256-prod-github-runner-207 kernel: [56868.580101] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:11:34 juju-e4d256-prod-github-runner-207 kernel: [56868.581284] ? show_regs.part.0+0x23/0x29 Aug 22 21:11:34 juju-e4d256-prod-github-runner-207 kernel: [56868.582361] ? show_regs.cold+0x8/0xd Aug 22 21:11:34 juju-e4d256-prod-github-runner-207 kernel: [56868.583413] ? watchdog_timer_fn+0x1be/0x220 Aug 22 21:11:34 juju-e4d256-prod-github-runner-207 kernel: [56868.584528] ? lockup_detector_update_enable+0x60/0x60 Aug 22 21:11:34 juju-e4d256-prod-github-runner-207 kernel: [56868.585700] ? __hrtimer_run_queues+0x107/0x230 Aug 22 21:11:34 juju-e4d256-prod-github-runner-207 kernel: [56868.586820] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 21:11:34 juju-e4d256-prod-github-runner-207 kernel: [56868.587957] ? hrtimer_interrupt+0x101/0x220 Aug 22 21:11:34 juju-e4d256-prod-github-runner-207 kernel: [56868.589074] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 21:11:34 juju-e4d256-prod-github-runner-207 kernel: [56868.590269] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 21:11:34 juju-e4d256-prod-github-runner-207 kernel: [56868.591426] Aug 22 21:11:34 juju-e4d256-prod-github-runner-207 kernel: [56868.592336] Aug 22 21:11:34 juju-e4d256-prod-github-runner-207 kernel: [56868.593236] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 21:11:34 juju-e4d256-prod-github-runner-207 kernel: [56868.594372] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:11:34 juju-e4d256-prod-github-runner-207 kernel: [56868.595521] ? _raw_spin_lock+0x22/0x30 Aug 22 21:11:34 juju-e4d256-prod-github-runner-207 kernel: [56868.596570] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:11:34 juju-e4d256-prod-github-runner-207 kernel: [56868.597685] direct_page_fault+0x206/0x310 [kvm] Aug 22 21:11:34 juju-e4d256-prod-github-runner-207 kernel: [56868.598806] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 21:11:34 juju-e4d256-prod-github-runner-207 kernel: [56868.599919] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 21:11:34 juju-e4d256-prod-github-runner-207 kernel: [56868.601066] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 21:11:34 juju-e4d256-prod-github-runner-207 kernel: [56868.602143] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 21:11:34 juju-e4d256-prod-github-runner-207 kernel: [56868.603197] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 21:11:34 juju-e4d256-prod-github-runner-207 kernel: [56868.604299] handle_exit+0x98/0x230 [kvm_amd] Aug 22 21:11:34 juju-e4d256-prod-github-runner-207 kernel: [56868.605303] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 21:11:34 juju-e4d256-prod-github-runner-207 kernel: [56868.606315] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 21:11:34 juju-e4d256-prod-github-runner-207 kernel: [56868.607335] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 21:11:34 juju-e4d256-prod-github-runner-207 kernel: [56868.608358] vcpu_run+0x62/0x2c0 [kvm] Aug 22 21:11:34 juju-e4d256-prod-github-runner-207 kernel: [56868.609265] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 21:11:34 juju-e4d256-prod-github-runner-207 kernel: [56868.610171] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 21:11:34 juju-e4d256-prod-github-runner-207 kernel: [56868.611126] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 21:11:34 juju-e4d256-prod-github-runner-207 kernel: [56868.612011] ? __seccomp_filter+0x4a/0x4a0 Aug 22 21:11:34 juju-e4d256-prod-github-runner-207 kernel: [56868.612957] ? __fget_files+0x86/0xc0 Aug 22 21:11:34 juju-e4d256-prod-github-runner-207 kernel: [56868.613744] __x64_sys_ioctl+0x95/0xd0 Aug 22 21:11:34 juju-e4d256-prod-github-runner-207 kernel: [56868.614518] do_syscall_64+0x5c/0xc0 Aug 22 21:11:34 juju-e4d256-prod-github-runner-207 kernel: [56868.615253] ? do_futex+0x162/0x1f0 Aug 22 21:11:34 juju-e4d256-prod-github-runner-207 kernel: [56868.615971] ? __x64_sys_futex+0x78/0x1e0 Aug 22 21:11:34 juju-e4d256-prod-github-runner-207 kernel: [56868.616743] ? __secure_computing+0xa9/0x120 Aug 22 21:11:34 juju-e4d256-prod-github-runner-207 kernel: [56868.617600] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 21:11:34 juju-e4d256-prod-github-runner-207 kernel: [56868.618467] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:11:34 juju-e4d256-prod-github-runner-207 kernel: [56868.619322] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:11:34 juju-e4d256-prod-github-runner-207 kernel: [56868.620174] ? do_syscall_64+0x69/0xc0 Aug 22 21:11:34 juju-e4d256-prod-github-runner-207 kernel: [56868.620919] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:11:34 juju-e4d256-prod-github-runner-207 kernel: [56868.621742] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:11:34 juju-e4d256-prod-github-runner-207 kernel: [56868.622549] ? do_syscall_64+0x69/0xc0 Aug 22 21:11:34 juju-e4d256-prod-github-runner-207 kernel: [56868.623260] ? do_syscall_64+0x69/0xc0 Aug 22 21:11:34 juju-e4d256-prod-github-runner-207 kernel: [56868.623959] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 21:11:34 juju-e4d256-prod-github-runner-207 kernel: [56868.624790] RIP: 0033:0x7faa5d0edaff Aug 22 21:11:34 juju-e4d256-prod-github-runner-207 kernel: [56868.625493] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 21:11:34 juju-e4d256-prod-github-runner-207 kernel: [56868.627836] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 21:11:34 juju-e4d256-prod-github-runner-207 kernel: [56868.628920] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 21:11:34 juju-e4d256-prod-github-runner-207 kernel: [56868.629955] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 21:11:34 juju-e4d256-prod-github-runner-207 kernel: [56868.631001] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 21:11:34 juju-e4d256-prod-github-runner-207 kernel: [56868.632064] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 21:11:34 juju-e4d256-prod-github-runner-207 kernel: [56868.633104] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 21:11:34 juju-e4d256-prod-github-runner-207 kernel: [56868.634137] Aug 22 21:11:47 juju-e4d256-prod-github-runner-207 kernel: [56880.980706] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 21:11:47 juju-e4d256-prod-github-runner-207 kernel: [56880.981697] rcu: 1-....: (14146282 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=6837110 Aug 22 21:11:47 juju-e4d256-prod-github-runner-207 kernel: [56880.982819] (t=14190945 jiffies g=23269 q=51900) Aug 22 21:11:47 juju-e4d256-prod-github-runner-207 kernel: [56880.983610] NMI backtrace for cpu 1 Aug 22 21:11:47 juju-e4d256-prod-github-runner-207 kernel: [56880.984337] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 21:11:47 juju-e4d256-prod-github-runner-207 kernel: [56880.985458] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 21:11:47 juju-e4d256-prod-github-runner-207 kernel: [56880.986520] Call Trace: Aug 22 21:11:47 juju-e4d256-prod-github-runner-207 kernel: [56880.987207] Aug 22 21:11:47 juju-e4d256-prod-github-runner-207 kernel: [56880.987860] show_stack+0x52/0x5c Aug 22 21:11:47 juju-e4d256-prod-github-runner-207 kernel: [56880.988602] dump_stack_lvl+0x4a/0x63 Aug 22 21:11:47 juju-e4d256-prod-github-runner-207 kernel: [56880.989350] dump_stack+0x10/0x16 Aug 22 21:11:47 juju-e4d256-prod-github-runner-207 kernel: [56880.990064] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 21:11:47 juju-e4d256-prod-github-runner-207 kernel: [56880.990842] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 21:11:47 juju-e4d256-prod-github-runner-207 kernel: [56880.991624] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 21:11:47 juju-e4d256-prod-github-runner-207 kernel: [56880.992449] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 21:11:47 juju-e4d256-prod-github-runner-207 kernel: [56880.993297] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 21:11:47 juju-e4d256-prod-github-runner-207 kernel: [56880.994109] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 21:11:47 juju-e4d256-prod-github-runner-207 kernel: [56880.994881] print_cpu_stall.cold+0x2f/0xe2 Aug 22 21:11:47 juju-e4d256-prod-github-runner-207 kernel: [56880.995646] ? timekeeping_update+0xf7/0x150 Aug 22 21:11:47 juju-e4d256-prod-github-runner-207 kernel: [56880.996429] check_cpu_stall+0x109/0x270 Aug 22 21:11:47 juju-e4d256-prod-github-runner-207 kernel: [56880.997184] rcu_sched_clock_irq+0x9a/0x250 Aug 22 21:11:47 juju-e4d256-prod-github-runner-207 kernel: [56880.997946] update_process_times+0x94/0xd0 Aug 22 21:11:47 juju-e4d256-prod-github-runner-207 kernel: [56880.998711] tick_sched_handle+0x29/0x70 Aug 22 21:11:47 juju-e4d256-prod-github-runner-207 kernel: [56880.999457] tick_sched_timer+0x8c/0xc0 Aug 22 21:11:47 juju-e4d256-prod-github-runner-207 kernel: [56881.000283] ? tick_nohz_handler+0xb0/0xb0 Aug 22 21:11:47 juju-e4d256-prod-github-runner-207 kernel: [56881.001071] __hrtimer_run_queues+0x107/0x230 Aug 22 21:11:47 juju-e4d256-prod-github-runner-207 kernel: [56881.001851] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 21:11:47 juju-e4d256-prod-github-runner-207 kernel: [56881.002658] hrtimer_interrupt+0x101/0x220 Aug 22 21:11:47 juju-e4d256-prod-github-runner-207 kernel: [56881.003433] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 21:11:47 juju-e4d256-prod-github-runner-207 kernel: [56881.004266] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 21:11:47 juju-e4d256-prod-github-runner-207 kernel: [56881.005101] Aug 22 21:11:47 juju-e4d256-prod-github-runner-207 kernel: [56881.005763] Aug 22 21:11:47 juju-e4d256-prod-github-runner-207 kernel: [56881.006399] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 21:11:47 juju-e4d256-prod-github-runner-207 kernel: [56881.007216] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:11:47 juju-e4d256-prod-github-runner-207 kernel: [56881.008093] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 21:11:47 juju-e4d256-prod-github-runner-207 kernel: [56881.010320] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 21:11:47 juju-e4d256-prod-github-runner-207 kernel: [56881.011195] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 21:11:47 juju-e4d256-prod-github-runner-207 kernel: [56881.012198] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 21:11:47 juju-e4d256-prod-github-runner-207 kernel: [56881.013178] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 21:11:47 juju-e4d256-prod-github-runner-207 kernel: [56881.014136] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 21:11:47 juju-e4d256-prod-github-runner-207 kernel: [56881.015108] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 21:11:47 juju-e4d256-prod-github-runner-207 kernel: [56881.016071] ? _raw_spin_lock+0x22/0x30 Aug 22 21:11:47 juju-e4d256-prod-github-runner-207 kernel: [56881.016858] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:11:47 juju-e4d256-prod-github-runner-207 kernel: [56881.017699] direct_page_fault+0x206/0x310 [kvm] Aug 22 21:11:47 juju-e4d256-prod-github-runner-207 kernel: [56881.018560] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 21:11:47 juju-e4d256-prod-github-runner-207 kernel: [56881.019433] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 21:11:47 juju-e4d256-prod-github-runner-207 kernel: [56881.020325] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 21:11:47 juju-e4d256-prod-github-runner-207 kernel: [56881.021130] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 21:11:47 juju-e4d256-prod-github-runner-207 kernel: [56881.021915] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 21:11:47 juju-e4d256-prod-github-runner-207 kernel: [56881.022742] handle_exit+0x98/0x230 [kvm_amd] Aug 22 21:11:47 juju-e4d256-prod-github-runner-207 kernel: [56881.023509] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 21:11:47 juju-e4d256-prod-github-runner-207 kernel: [56881.024304] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 21:11:47 juju-e4d256-prod-github-runner-207 kernel: [56881.025122] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 21:11:47 juju-e4d256-prod-github-runner-207 kernel: [56881.025942] vcpu_run+0x62/0x2c0 [kvm] Aug 22 21:11:47 juju-e4d256-prod-github-runner-207 kernel: [56881.026658] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 21:11:47 juju-e4d256-prod-github-runner-207 kernel: [56881.027400] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 21:11:47 juju-e4d256-prod-github-runner-207 kernel: [56881.028213] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 21:11:47 juju-e4d256-prod-github-runner-207 kernel: [56881.028971] ? __seccomp_filter+0x4a/0x4a0 Aug 22 21:11:47 juju-e4d256-prod-github-runner-207 kernel: [56881.029688] ? __fget_files+0x86/0xc0 Aug 22 21:11:47 juju-e4d256-prod-github-runner-207 kernel: [56881.030376] __x64_sys_ioctl+0x95/0xd0 Aug 22 21:11:47 juju-e4d256-prod-github-runner-207 kernel: [56881.031066] do_syscall_64+0x5c/0xc0 Aug 22 21:11:47 juju-e4d256-prod-github-runner-207 kernel: [56881.031741] ? do_futex+0x162/0x1f0 Aug 22 21:11:47 juju-e4d256-prod-github-runner-207 kernel: [56881.032443] ? __x64_sys_futex+0x78/0x1e0 Aug 22 21:11:47 juju-e4d256-prod-github-runner-207 kernel: [56881.033150] ? __secure_computing+0xa9/0x120 Aug 22 21:11:47 juju-e4d256-prod-github-runner-207 kernel: [56881.033866] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 21:11:47 juju-e4d256-prod-github-runner-207 kernel: [56881.034657] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:11:47 juju-e4d256-prod-github-runner-207 kernel: [56881.035413] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:11:47 juju-e4d256-prod-github-runner-207 kernel: [56881.036162] ? do_syscall_64+0x69/0xc0 Aug 22 21:11:47 juju-e4d256-prod-github-runner-207 kernel: [56881.036860] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:11:47 juju-e4d256-prod-github-runner-207 kernel: [56881.037613] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:11:47 juju-e4d256-prod-github-runner-207 kernel: [56881.038371] ? do_syscall_64+0x69/0xc0 Aug 22 21:11:47 juju-e4d256-prod-github-runner-207 kernel: [56881.039062] ? do_syscall_64+0x69/0xc0 Aug 22 21:11:47 juju-e4d256-prod-github-runner-207 kernel: [56881.039750] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 21:11:47 juju-e4d256-prod-github-runner-207 kernel: [56881.040525] RIP: 0033:0x7faa5d0edaff Aug 22 21:11:47 juju-e4d256-prod-github-runner-207 kernel: [56881.041231] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 21:11:47 juju-e4d256-prod-github-runner-207 kernel: [56881.043335] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 21:11:47 juju-e4d256-prod-github-runner-207 kernel: [56881.044313] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 21:11:47 juju-e4d256-prod-github-runner-207 kernel: [56881.045281] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 21:11:47 juju-e4d256-prod-github-runner-207 kernel: [56881.046229] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 21:11:47 juju-e4d256-prod-github-runner-207 kernel: [56881.047184] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 21:11:47 juju-e4d256-prod-github-runner-207 kernel: [56881.048131] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 21:11:47 juju-e4d256-prod-github-runner-207 kernel: [56881.049486] Aug 22 21:12:14 juju-e4d256-prod-github-runner-207 kernel: [56908.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 52892s! [qemu-system-x86:6715] Aug 22 21:12:14 juju-e4d256-prod-github-runner-207 kernel: [56908.543997] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 21:12:14 juju-e4d256-prod-github-runner-207 kernel: [56908.544321] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 21:12:14 juju-e4d256-prod-github-runner-207 kernel: [56908.556870] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 21:12:14 juju-e4d256-prod-github-runner-207 kernel: [56908.558190] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 21:12:14 juju-e4d256-prod-github-runner-207 kernel: [56908.559536] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:12:14 juju-e4d256-prod-github-runner-207 kernel: [56908.560740] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 21:12:14 juju-e4d256-prod-github-runner-207 kernel: [56908.563448] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 21:12:14 juju-e4d256-prod-github-runner-207 kernel: [56908.564536] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 21:12:14 juju-e4d256-prod-github-runner-207 kernel: [56908.565724] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 21:12:14 juju-e4d256-prod-github-runner-207 kernel: [56908.567032] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 21:12:14 juju-e4d256-prod-github-runner-207 kernel: [56908.568414] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 21:12:14 juju-e4d256-prod-github-runner-207 kernel: [56908.569618] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 21:12:14 juju-e4d256-prod-github-runner-207 kernel: [56908.570803] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 21:12:14 juju-e4d256-prod-github-runner-207 kernel: [56908.572076] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 21:12:14 juju-e4d256-prod-github-runner-207 kernel: [56908.573193] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 21:12:14 juju-e4d256-prod-github-runner-207 kernel: [56908.574418] Call Trace: Aug 22 21:12:14 juju-e4d256-prod-github-runner-207 kernel: [56908.575343] Aug 22 21:12:14 juju-e4d256-prod-github-runner-207 kernel: [56908.576276] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:12:14 juju-e4d256-prod-github-runner-207 kernel: [56908.577319] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:12:14 juju-e4d256-prod-github-runner-207 kernel: [56908.578358] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:12:14 juju-e4d256-prod-github-runner-207 kernel: [56908.579539] ? show_regs.part.0+0x23/0x29 Aug 22 21:12:14 juju-e4d256-prod-github-runner-207 kernel: [56908.580577] ? show_regs.cold+0x8/0xd Aug 22 21:12:14 juju-e4d256-prod-github-runner-207 kernel: [56908.581563] ? watchdog_timer_fn+0x1be/0x220 Aug 22 21:12:14 juju-e4d256-prod-github-runner-207 kernel: [56908.582588] ? lockup_detector_update_enable+0x60/0x60 Aug 22 21:12:14 juju-e4d256-prod-github-runner-207 kernel: [56908.583680] ? __hrtimer_run_queues+0x107/0x230 Aug 22 21:12:14 juju-e4d256-prod-github-runner-207 kernel: [56908.584742] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 21:12:14 juju-e4d256-prod-github-runner-207 kernel: [56908.585793] ? hrtimer_interrupt+0x101/0x220 Aug 22 21:12:14 juju-e4d256-prod-github-runner-207 kernel: [56908.586845] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 21:12:14 juju-e4d256-prod-github-runner-207 kernel: [56908.587962] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 21:12:14 juju-e4d256-prod-github-runner-207 kernel: [56908.589040] Aug 22 21:12:14 juju-e4d256-prod-github-runner-207 kernel: [56908.589961] Aug 22 21:12:14 juju-e4d256-prod-github-runner-207 kernel: [56908.590881] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 21:12:14 juju-e4d256-prod-github-runner-207 kernel: [56908.592055] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:12:14 juju-e4d256-prod-github-runner-207 kernel: [56908.593126] ? _raw_spin_lock+0x22/0x30 Aug 22 21:12:14 juju-e4d256-prod-github-runner-207 kernel: [56908.594087] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:12:14 juju-e4d256-prod-github-runner-207 kernel: [56908.595128] direct_page_fault+0x206/0x310 [kvm] Aug 22 21:12:14 juju-e4d256-prod-github-runner-207 kernel: [56908.596190] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 21:12:14 juju-e4d256-prod-github-runner-207 kernel: [56908.597236] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 21:12:14 juju-e4d256-prod-github-runner-207 kernel: [56908.598271] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 21:12:14 juju-e4d256-prod-github-runner-207 kernel: [56908.599453] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 21:12:14 juju-e4d256-prod-github-runner-207 kernel: [56908.600471] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 21:12:14 juju-e4d256-prod-github-runner-207 kernel: [56908.601481] handle_exit+0x98/0x230 [kvm_amd] Aug 22 21:12:14 juju-e4d256-prod-github-runner-207 kernel: [56908.602420] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 21:12:14 juju-e4d256-prod-github-runner-207 kernel: [56908.603368] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 21:12:14 juju-e4d256-prod-github-runner-207 kernel: [56908.604348] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 21:12:14 juju-e4d256-prod-github-runner-207 kernel: [56908.605303] vcpu_run+0x62/0x2c0 [kvm] Aug 22 21:12:14 juju-e4d256-prod-github-runner-207 kernel: [56908.606135] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 21:12:14 juju-e4d256-prod-github-runner-207 kernel: [56908.606969] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 21:12:14 juju-e4d256-prod-github-runner-207 kernel: [56908.607855] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 21:12:14 juju-e4d256-prod-github-runner-207 kernel: [56908.608673] ? __seccomp_filter+0x4a/0x4a0 Aug 22 21:12:14 juju-e4d256-prod-github-runner-207 kernel: [56908.609476] ? __fget_files+0x86/0xc0 Aug 22 21:12:14 juju-e4d256-prod-github-runner-207 kernel: [56908.610225] __x64_sys_ioctl+0x95/0xd0 Aug 22 21:12:14 juju-e4d256-prod-github-runner-207 kernel: [56908.610949] do_syscall_64+0x5c/0xc0 Aug 22 21:12:14 juju-e4d256-prod-github-runner-207 kernel: [56908.611631] ? do_futex+0x162/0x1f0 Aug 22 21:12:14 juju-e4d256-prod-github-runner-207 kernel: [56908.612358] ? __x64_sys_futex+0x78/0x1e0 Aug 22 21:12:14 juju-e4d256-prod-github-runner-207 kernel: [56908.613061] ? __secure_computing+0xa9/0x120 Aug 22 21:12:14 juju-e4d256-prod-github-runner-207 kernel: [56908.613804] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 21:12:14 juju-e4d256-prod-github-runner-207 kernel: [56908.614590] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:12:14 juju-e4d256-prod-github-runner-207 kernel: [56908.615361] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:12:14 juju-e4d256-prod-github-runner-207 kernel: [56908.616155] ? do_syscall_64+0x69/0xc0 Aug 22 21:12:14 juju-e4d256-prod-github-runner-207 kernel: [56908.616861] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:12:14 juju-e4d256-prod-github-runner-207 kernel: [56908.617647] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:12:14 juju-e4d256-prod-github-runner-207 kernel: [56908.618392] ? do_syscall_64+0x69/0xc0 Aug 22 21:12:14 juju-e4d256-prod-github-runner-207 kernel: [56908.619077] ? do_syscall_64+0x69/0xc0 Aug 22 21:12:14 juju-e4d256-prod-github-runner-207 kernel: [56908.619754] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 21:12:14 juju-e4d256-prod-github-runner-207 kernel: [56908.620579] RIP: 0033:0x7faa5d0edaff Aug 22 21:12:14 juju-e4d256-prod-github-runner-207 kernel: [56908.621292] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 21:12:14 juju-e4d256-prod-github-runner-207 kernel: [56908.623515] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 21:12:14 juju-e4d256-prod-github-runner-207 kernel: [56908.624470] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 21:12:14 juju-e4d256-prod-github-runner-207 kernel: [56908.625423] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 21:12:14 juju-e4d256-prod-github-runner-207 kernel: [56908.626375] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 21:12:14 juju-e4d256-prod-github-runner-207 kernel: [56908.627302] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 21:12:14 juju-e4d256-prod-github-runner-207 kernel: [56908.628442] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 21:12:14 juju-e4d256-prod-github-runner-207 kernel: [56908.629373] Aug 22 21:12:42 juju-e4d256-prod-github-runner-207 kernel: [56936.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 52918s! [qemu-system-x86:6715] Aug 22 21:12:42 juju-e4d256-prod-github-runner-207 kernel: [56936.543093] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 21:12:42 juju-e4d256-prod-github-runner-207 kernel: [56936.543166] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 21:12:42 juju-e4d256-prod-github-runner-207 kernel: [56936.555925] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 21:12:42 juju-e4d256-prod-github-runner-207 kernel: [56936.557191] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 21:12:42 juju-e4d256-prod-github-runner-207 kernel: [56936.558411] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:12:42 juju-e4d256-prod-github-runner-207 kernel: [56936.559469] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 21:12:42 juju-e4d256-prod-github-runner-207 kernel: [56936.562025] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 21:12:42 juju-e4d256-prod-github-runner-207 kernel: [56936.563068] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 21:12:42 juju-e4d256-prod-github-runner-207 kernel: [56936.564240] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 21:12:42 juju-e4d256-prod-github-runner-207 kernel: [56936.565406] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 21:12:42 juju-e4d256-prod-github-runner-207 kernel: [56936.566571] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 21:12:42 juju-e4d256-prod-github-runner-207 kernel: [56936.567768] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 21:12:42 juju-e4d256-prod-github-runner-207 kernel: [56936.568987] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 21:12:42 juju-e4d256-prod-github-runner-207 kernel: [56936.570222] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 21:12:42 juju-e4d256-prod-github-runner-207 kernel: [56936.571318] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 21:12:42 juju-e4d256-prod-github-runner-207 kernel: [56936.572531] Call Trace: Aug 22 21:12:42 juju-e4d256-prod-github-runner-207 kernel: [56936.573443] Aug 22 21:12:42 juju-e4d256-prod-github-runner-207 kernel: [56936.574328] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:12:42 juju-e4d256-prod-github-runner-207 kernel: [56936.575449] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:12:42 juju-e4d256-prod-github-runner-207 kernel: [56936.576563] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:12:42 juju-e4d256-prod-github-runner-207 kernel: [56936.577645] ? show_regs.part.0+0x23/0x29 Aug 22 21:12:42 juju-e4d256-prod-github-runner-207 kernel: [56936.578642] ? show_regs.cold+0x8/0xd Aug 22 21:12:42 juju-e4d256-prod-github-runner-207 kernel: [56936.579642] ? watchdog_timer_fn+0x1be/0x220 Aug 22 21:12:42 juju-e4d256-prod-github-runner-207 kernel: [56936.580653] ? lockup_detector_update_enable+0x60/0x60 Aug 22 21:12:42 juju-e4d256-prod-github-runner-207 kernel: [56936.581716] ? __hrtimer_run_queues+0x107/0x230 Aug 22 21:12:42 juju-e4d256-prod-github-runner-207 kernel: [56936.582742] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 21:12:42 juju-e4d256-prod-github-runner-207 kernel: [56936.583849] ? hrtimer_interrupt+0x101/0x220 Aug 22 21:12:42 juju-e4d256-prod-github-runner-207 kernel: [56936.584876] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 21:12:42 juju-e4d256-prod-github-runner-207 kernel: [56936.585944] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 21:12:42 juju-e4d256-prod-github-runner-207 kernel: [56936.586988] Aug 22 21:12:42 juju-e4d256-prod-github-runner-207 kernel: [56936.587868] Aug 22 21:12:42 juju-e4d256-prod-github-runner-207 kernel: [56936.588709] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 21:12:42 juju-e4d256-prod-github-runner-207 kernel: [56936.589739] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:12:42 juju-e4d256-prod-github-runner-207 kernel: [56936.590776] ? _raw_spin_lock+0x22/0x30 Aug 22 21:12:42 juju-e4d256-prod-github-runner-207 kernel: [56936.591734] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:12:42 juju-e4d256-prod-github-runner-207 kernel: [56936.592761] direct_page_fault+0x206/0x310 [kvm] Aug 22 21:12:42 juju-e4d256-prod-github-runner-207 kernel: [56936.593829] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 21:12:42 juju-e4d256-prod-github-runner-207 kernel: [56936.594865] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 21:12:42 juju-e4d256-prod-github-runner-207 kernel: [56936.595901] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 21:12:42 juju-e4d256-prod-github-runner-207 kernel: [56936.596874] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 21:12:42 juju-e4d256-prod-github-runner-207 kernel: [56936.597957] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 21:12:42 juju-e4d256-prod-github-runner-207 kernel: [56936.598942] handle_exit+0x98/0x230 [kvm_amd] Aug 22 21:12:42 juju-e4d256-prod-github-runner-207 kernel: [56936.599868] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 21:12:42 juju-e4d256-prod-github-runner-207 kernel: [56936.600866] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 21:12:42 juju-e4d256-prod-github-runner-207 kernel: [56936.601796] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 21:12:42 juju-e4d256-prod-github-runner-207 kernel: [56936.602709] vcpu_run+0x62/0x2c0 [kvm] Aug 22 21:12:42 juju-e4d256-prod-github-runner-207 kernel: [56936.603534] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 21:12:42 juju-e4d256-prod-github-runner-207 kernel: [56936.604344] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 21:12:42 juju-e4d256-prod-github-runner-207 kernel: [56936.605208] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 21:12:42 juju-e4d256-prod-github-runner-207 kernel: [56936.606044] ? __seccomp_filter+0x4a/0x4a0 Aug 22 21:12:42 juju-e4d256-prod-github-runner-207 kernel: [56936.606804] ? __fget_files+0x86/0xc0 Aug 22 21:12:42 juju-e4d256-prod-github-runner-207 kernel: [56936.607537] __x64_sys_ioctl+0x95/0xd0 Aug 22 21:12:42 juju-e4d256-prod-github-runner-207 kernel: [56936.608236] do_syscall_64+0x5c/0xc0 Aug 22 21:12:42 juju-e4d256-prod-github-runner-207 kernel: [56936.608902] ? do_futex+0x162/0x1f0 Aug 22 21:12:42 juju-e4d256-prod-github-runner-207 kernel: [56936.609557] ? __x64_sys_futex+0x78/0x1e0 Aug 22 21:12:42 juju-e4d256-prod-github-runner-207 kernel: [56936.610232] ? __secure_computing+0xa9/0x120 Aug 22 21:12:42 juju-e4d256-prod-github-runner-207 kernel: [56936.610923] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 21:12:42 juju-e4d256-prod-github-runner-207 kernel: [56936.611751] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:12:42 juju-e4d256-prod-github-runner-207 kernel: [56936.612475] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:12:42 juju-e4d256-prod-github-runner-207 kernel: [56936.613204] ? do_syscall_64+0x69/0xc0 Aug 22 21:12:42 juju-e4d256-prod-github-runner-207 kernel: [56936.613851] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:12:42 juju-e4d256-prod-github-runner-207 kernel: [56936.614553] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:12:42 juju-e4d256-prod-github-runner-207 kernel: [56936.615249] ? do_syscall_64+0x69/0xc0 Aug 22 21:12:42 juju-e4d256-prod-github-runner-207 kernel: [56936.615890] ? do_syscall_64+0x69/0xc0 Aug 22 21:12:42 juju-e4d256-prod-github-runner-207 kernel: [56936.616515] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 21:12:42 juju-e4d256-prod-github-runner-207 kernel: [56936.617224] RIP: 0033:0x7faa5d0edaff Aug 22 21:12:42 juju-e4d256-prod-github-runner-207 kernel: [56936.617913] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 21:12:42 juju-e4d256-prod-github-runner-207 kernel: [56936.619937] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 21:12:42 juju-e4d256-prod-github-runner-207 kernel: [56936.620850] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 21:12:42 juju-e4d256-prod-github-runner-207 kernel: [56936.621747] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 21:12:42 juju-e4d256-prod-github-runner-207 kernel: [56936.622636] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 21:12:42 juju-e4d256-prod-github-runner-207 kernel: [56936.623540] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 21:12:42 juju-e4d256-prod-github-runner-207 kernel: [56936.624430] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 21:12:42 juju-e4d256-prod-github-runner-207 kernel: [56936.625327] Aug 22 21:13:10 juju-e4d256-prod-github-runner-207 kernel: [56964.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 52944s! [qemu-system-x86:6715] Aug 22 21:13:10 juju-e4d256-prod-github-runner-207 kernel: [56964.543135] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 21:13:10 juju-e4d256-prod-github-runner-207 kernel: [56964.543238] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 21:13:10 juju-e4d256-prod-github-runner-207 kernel: [56964.556321] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 21:13:10 juju-e4d256-prod-github-runner-207 kernel: [56964.557610] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 21:13:10 juju-e4d256-prod-github-runner-207 kernel: [56964.558864] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:13:10 juju-e4d256-prod-github-runner-207 kernel: [56964.559952] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 21:13:10 juju-e4d256-prod-github-runner-207 kernel: [56964.562575] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 21:13:10 juju-e4d256-prod-github-runner-207 kernel: [56964.563660] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 21:13:10 juju-e4d256-prod-github-runner-207 kernel: [56964.564856] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 21:13:10 juju-e4d256-prod-github-runner-207 kernel: [56964.566053] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 21:13:10 juju-e4d256-prod-github-runner-207 kernel: [56964.567256] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 21:13:10 juju-e4d256-prod-github-runner-207 kernel: [56964.568437] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 21:13:10 juju-e4d256-prod-github-runner-207 kernel: [56964.569629] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 21:13:10 juju-e4d256-prod-github-runner-207 kernel: [56964.570890] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 21:13:10 juju-e4d256-prod-github-runner-207 kernel: [56964.572015] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 21:13:10 juju-e4d256-prod-github-runner-207 kernel: [56964.573227] Call Trace: Aug 22 21:13:10 juju-e4d256-prod-github-runner-207 kernel: [56964.574159] Aug 22 21:13:10 juju-e4d256-prod-github-runner-207 kernel: [56964.575086] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:13:10 juju-e4d256-prod-github-runner-207 kernel: [56964.576181] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:13:10 juju-e4d256-prod-github-runner-207 kernel: [56964.577258] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:13:10 juju-e4d256-prod-github-runner-207 kernel: [56964.578361] ? show_regs.part.0+0x23/0x29 Aug 22 21:13:10 juju-e4d256-prod-github-runner-207 kernel: [56964.579492] ? show_regs.cold+0x8/0xd Aug 22 21:13:10 juju-e4d256-prod-github-runner-207 kernel: [56964.580568] ? watchdog_timer_fn+0x1be/0x220 Aug 22 21:13:10 juju-e4d256-prod-github-runner-207 kernel: [56964.581587] ? lockup_detector_update_enable+0x60/0x60 Aug 22 21:13:10 juju-e4d256-prod-github-runner-207 kernel: [56964.582663] ? __hrtimer_run_queues+0x107/0x230 Aug 22 21:13:10 juju-e4d256-prod-github-runner-207 kernel: [56964.583720] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 21:13:10 juju-e4d256-prod-github-runner-207 kernel: [56964.584755] ? hrtimer_interrupt+0x101/0x220 Aug 22 21:13:10 juju-e4d256-prod-github-runner-207 kernel: [56964.585797] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 21:13:10 juju-e4d256-prod-github-runner-207 kernel: [56964.586885] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 21:13:10 juju-e4d256-prod-github-runner-207 kernel: [56964.587954] Aug 22 21:13:10 juju-e4d256-prod-github-runner-207 kernel: [56964.588813] Aug 22 21:13:10 juju-e4d256-prod-github-runner-207 kernel: [56964.589678] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 21:13:10 juju-e4d256-prod-github-runner-207 kernel: [56964.590733] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:13:10 juju-e4d256-prod-github-runner-207 kernel: [56964.591800] ? _raw_spin_lock+0x22/0x30 Aug 22 21:13:10 juju-e4d256-prod-github-runner-207 kernel: [56964.592763] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:13:10 juju-e4d256-prod-github-runner-207 kernel: [56964.593793] direct_page_fault+0x206/0x310 [kvm] Aug 22 21:13:10 juju-e4d256-prod-github-runner-207 kernel: [56964.594832] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 21:13:10 juju-e4d256-prod-github-runner-207 kernel: [56964.595870] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 21:13:10 juju-e4d256-prod-github-runner-207 kernel: [56964.596953] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 21:13:10 juju-e4d256-prod-github-runner-207 kernel: [56964.597969] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 21:13:10 juju-e4d256-prod-github-runner-207 kernel: [56964.598929] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 21:13:10 juju-e4d256-prod-github-runner-207 kernel: [56964.599935] handle_exit+0x98/0x230 [kvm_amd] Aug 22 21:13:10 juju-e4d256-prod-github-runner-207 kernel: [56964.600844] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 21:13:10 juju-e4d256-prod-github-runner-207 kernel: [56964.601772] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 21:13:10 juju-e4d256-prod-github-runner-207 kernel: [56964.602707] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 21:13:10 juju-e4d256-prod-github-runner-207 kernel: [56964.603636] vcpu_run+0x62/0x2c0 [kvm] Aug 22 21:13:10 juju-e4d256-prod-github-runner-207 kernel: [56964.604470] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 21:13:10 juju-e4d256-prod-github-runner-207 kernel: [56964.605309] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 21:13:10 juju-e4d256-prod-github-runner-207 kernel: [56964.606190] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 21:13:10 juju-e4d256-prod-github-runner-207 kernel: [56964.607002] ? __seccomp_filter+0x4a/0x4a0 Aug 22 21:13:10 juju-e4d256-prod-github-runner-207 kernel: [56964.607776] ? __fget_files+0x86/0xc0 Aug 22 21:13:10 juju-e4d256-prod-github-runner-207 kernel: [56964.608498] __x64_sys_ioctl+0x95/0xd0 Aug 22 21:13:10 juju-e4d256-prod-github-runner-207 kernel: [56964.609206] do_syscall_64+0x5c/0xc0 Aug 22 21:13:10 juju-e4d256-prod-github-runner-207 kernel: [56964.609881] ? do_futex+0x162/0x1f0 Aug 22 21:13:10 juju-e4d256-prod-github-runner-207 kernel: [56964.610540] ? __x64_sys_futex+0x78/0x1e0 Aug 22 21:13:10 juju-e4d256-prod-github-runner-207 kernel: [56964.611242] ? __secure_computing+0xa9/0x120 Aug 22 21:13:10 juju-e4d256-prod-github-runner-207 kernel: [56964.611945] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 21:13:10 juju-e4d256-prod-github-runner-207 kernel: [56964.612719] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:13:10 juju-e4d256-prod-github-runner-207 kernel: [56964.613458] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:13:10 juju-e4d256-prod-github-runner-207 kernel: [56964.614197] ? do_syscall_64+0x69/0xc0 Aug 22 21:13:10 juju-e4d256-prod-github-runner-207 kernel: [56964.614856] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:13:10 juju-e4d256-prod-github-runner-207 kernel: [56964.615575] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:13:10 juju-e4d256-prod-github-runner-207 kernel: [56964.616286] ? do_syscall_64+0x69/0xc0 Aug 22 21:13:10 juju-e4d256-prod-github-runner-207 kernel: [56964.616920] ? do_syscall_64+0x69/0xc0 Aug 22 21:13:10 juju-e4d256-prod-github-runner-207 kernel: [56964.617552] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 21:13:10 juju-e4d256-prod-github-runner-207 kernel: [56964.618275] RIP: 0033:0x7faa5d0edaff Aug 22 21:13:10 juju-e4d256-prod-github-runner-207 kernel: [56964.618904] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 21:13:10 juju-e4d256-prod-github-runner-207 kernel: [56964.621025] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 21:13:10 juju-e4d256-prod-github-runner-207 kernel: [56964.621971] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 21:13:10 juju-e4d256-prod-github-runner-207 kernel: [56964.622875] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 21:13:10 juju-e4d256-prod-github-runner-207 kernel: [56964.623806] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 21:13:10 juju-e4d256-prod-github-runner-207 kernel: [56964.624719] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 21:13:10 juju-e4d256-prod-github-runner-207 kernel: [56964.625625] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 21:13:10 juju-e4d256-prod-github-runner-207 kernel: [56964.626577] Aug 22 21:13:38 juju-e4d256-prod-github-runner-207 kernel: [56992.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 52970s! [qemu-system-x86:6715] Aug 22 21:13:38 juju-e4d256-prod-github-runner-207 kernel: [56992.543135] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 21:13:38 juju-e4d256-prod-github-runner-207 kernel: [56992.543208] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 21:13:38 juju-e4d256-prod-github-runner-207 kernel: [56992.555575] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 21:13:38 juju-e4d256-prod-github-runner-207 kernel: [56992.556869] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 21:13:38 juju-e4d256-prod-github-runner-207 kernel: [56992.558092] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:13:38 juju-e4d256-prod-github-runner-207 kernel: [56992.559192] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 21:13:38 juju-e4d256-prod-github-runner-207 kernel: [56992.561792] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 21:13:38 juju-e4d256-prod-github-runner-207 kernel: [56992.562853] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 21:13:38 juju-e4d256-prod-github-runner-207 kernel: [56992.564020] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 21:13:38 juju-e4d256-prod-github-runner-207 kernel: [56992.565184] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 21:13:38 juju-e4d256-prod-github-runner-207 kernel: [56992.566349] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 21:13:38 juju-e4d256-prod-github-runner-207 kernel: [56992.567527] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 21:13:38 juju-e4d256-prod-github-runner-207 kernel: [56992.568701] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 21:13:38 juju-e4d256-prod-github-runner-207 kernel: [56992.569936] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 21:13:38 juju-e4d256-prod-github-runner-207 kernel: [56992.571087] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 21:13:38 juju-e4d256-prod-github-runner-207 kernel: [56992.572287] Call Trace: Aug 22 21:13:38 juju-e4d256-prod-github-runner-207 kernel: [56992.573201] Aug 22 21:13:38 juju-e4d256-prod-github-runner-207 kernel: [56992.574091] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:13:38 juju-e4d256-prod-github-runner-207 kernel: [56992.575329] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:13:38 juju-e4d256-prod-github-runner-207 kernel: [56992.576357] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:13:38 juju-e4d256-prod-github-runner-207 kernel: [56992.577430] ? show_regs.part.0+0x23/0x29 Aug 22 21:13:38 juju-e4d256-prod-github-runner-207 kernel: [56992.578431] ? show_regs.cold+0x8/0xd Aug 22 21:13:38 juju-e4d256-prod-github-runner-207 kernel: [56992.579416] ? watchdog_timer_fn+0x1be/0x220 Aug 22 21:13:38 juju-e4d256-prod-github-runner-207 kernel: [56992.580427] ? lockup_detector_update_enable+0x60/0x60 Aug 22 21:13:38 juju-e4d256-prod-github-runner-207 kernel: [56992.581489] ? __hrtimer_run_queues+0x107/0x230 Aug 22 21:13:38 juju-e4d256-prod-github-runner-207 kernel: [56992.582516] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 21:13:38 juju-e4d256-prod-github-runner-207 kernel: [56992.583549] ? hrtimer_interrupt+0x101/0x220 Aug 22 21:13:38 juju-e4d256-prod-github-runner-207 kernel: [56992.584567] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 21:13:38 juju-e4d256-prod-github-runner-207 kernel: [56992.585639] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 21:13:38 juju-e4d256-prod-github-runner-207 kernel: [56992.586685] Aug 22 21:13:38 juju-e4d256-prod-github-runner-207 kernel: [56992.587553] Aug 22 21:13:38 juju-e4d256-prod-github-runner-207 kernel: [56992.588391] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 21:13:38 juju-e4d256-prod-github-runner-207 kernel: [56992.589422] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:13:38 juju-e4d256-prod-github-runner-207 kernel: [56992.590460] ? _raw_spin_lock+0x22/0x30 Aug 22 21:13:38 juju-e4d256-prod-github-runner-207 kernel: [56992.591419] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:13:38 juju-e4d256-prod-github-runner-207 kernel: [56992.592465] direct_page_fault+0x206/0x310 [kvm] Aug 22 21:13:38 juju-e4d256-prod-github-runner-207 kernel: [56992.593495] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 21:13:38 juju-e4d256-prod-github-runner-207 kernel: [56992.594501] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 21:13:38 juju-e4d256-prod-github-runner-207 kernel: [56992.595514] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 21:13:38 juju-e4d256-prod-github-runner-207 kernel: [56992.596483] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 21:13:38 juju-e4d256-prod-github-runner-207 kernel: [56992.597471] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 21:13:38 juju-e4d256-prod-github-runner-207 kernel: [56992.598449] handle_exit+0x98/0x230 [kvm_amd] Aug 22 21:13:38 juju-e4d256-prod-github-runner-207 kernel: [56992.599388] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 21:13:38 juju-e4d256-prod-github-runner-207 kernel: [56992.600308] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 21:13:38 juju-e4d256-prod-github-runner-207 kernel: [56992.601248] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 21:13:38 juju-e4d256-prod-github-runner-207 kernel: [56992.602192] vcpu_run+0x62/0x2c0 [kvm] Aug 22 21:13:38 juju-e4d256-prod-github-runner-207 kernel: [56992.603029] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 21:13:38 juju-e4d256-prod-github-runner-207 kernel: [56992.603844] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 21:13:38 juju-e4d256-prod-github-runner-207 kernel: [56992.604698] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 21:13:38 juju-e4d256-prod-github-runner-207 kernel: [56992.605511] ? __seccomp_filter+0x4a/0x4a0 Aug 22 21:13:38 juju-e4d256-prod-github-runner-207 kernel: [56992.606255] ? __fget_files+0x86/0xc0 Aug 22 21:13:38 juju-e4d256-prod-github-runner-207 kernel: [56992.606969] __x64_sys_ioctl+0x95/0xd0 Aug 22 21:13:38 juju-e4d256-prod-github-runner-207 kernel: [56992.607662] do_syscall_64+0x5c/0xc0 Aug 22 21:13:38 juju-e4d256-prod-github-runner-207 kernel: [56992.608328] ? do_futex+0x162/0x1f0 Aug 22 21:13:38 juju-e4d256-prod-github-runner-207 kernel: [56992.608977] ? __x64_sys_futex+0x78/0x1e0 Aug 22 21:13:38 juju-e4d256-prod-github-runner-207 kernel: [56992.609656] ? __secure_computing+0xa9/0x120 Aug 22 21:13:38 juju-e4d256-prod-github-runner-207 kernel: [56992.610351] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 21:13:38 juju-e4d256-prod-github-runner-207 kernel: [56992.611227] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:13:38 juju-e4d256-prod-github-runner-207 kernel: [56992.612091] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:13:38 juju-e4d256-prod-github-runner-207 kernel: [56992.612867] ? do_syscall_64+0x69/0xc0 Aug 22 21:13:38 juju-e4d256-prod-github-runner-207 kernel: [56992.613525] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:13:38 juju-e4d256-prod-github-runner-207 kernel: [56992.614230] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:13:38 juju-e4d256-prod-github-runner-207 kernel: [56992.615042] ? do_syscall_64+0x69/0xc0 Aug 22 21:13:38 juju-e4d256-prod-github-runner-207 kernel: [56992.615749] ? do_syscall_64+0x69/0xc0 Aug 22 21:13:38 juju-e4d256-prod-github-runner-207 kernel: [56992.616452] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 21:13:38 juju-e4d256-prod-github-runner-207 kernel: [56992.617255] RIP: 0033:0x7faa5d0edaff Aug 22 21:13:38 juju-e4d256-prod-github-runner-207 kernel: [56992.617948] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 21:13:38 juju-e4d256-prod-github-runner-207 kernel: [56992.620297] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 21:13:38 juju-e4d256-prod-github-runner-207 kernel: [56992.621355] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 21:13:38 juju-e4d256-prod-github-runner-207 kernel: [56992.622447] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 21:13:38 juju-e4d256-prod-github-runner-207 kernel: [56992.623370] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 21:13:38 juju-e4d256-prod-github-runner-207 kernel: [56992.624255] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 21:13:38 juju-e4d256-prod-github-runner-207 kernel: [56992.625306] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 21:13:38 juju-e4d256-prod-github-runner-207 kernel: [56992.626556] Aug 22 21:14:06 juju-e4d256-prod-github-runner-207 kernel: [57020.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 52996s! [qemu-system-x86:6715] Aug 22 21:14:06 juju-e4d256-prod-github-runner-207 kernel: [57020.543829] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 21:14:06 juju-e4d256-prod-github-runner-207 kernel: [57020.544102] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 21:14:06 juju-e4d256-prod-github-runner-207 kernel: [57020.556413] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 21:14:06 juju-e4d256-prod-github-runner-207 kernel: [57020.557855] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 21:14:06 juju-e4d256-prod-github-runner-207 kernel: [57020.559094] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:14:06 juju-e4d256-prod-github-runner-207 kernel: [57020.560161] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 21:14:06 juju-e4d256-prod-github-runner-207 kernel: [57020.562741] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 21:14:06 juju-e4d256-prod-github-runner-207 kernel: [57020.563796] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 21:14:06 juju-e4d256-prod-github-runner-207 kernel: [57020.564960] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 21:14:06 juju-e4d256-prod-github-runner-207 kernel: [57020.566120] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 21:14:06 juju-e4d256-prod-github-runner-207 kernel: [57020.567287] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 21:14:06 juju-e4d256-prod-github-runner-207 kernel: [57020.568454] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 21:14:06 juju-e4d256-prod-github-runner-207 kernel: [57020.569630] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 21:14:06 juju-e4d256-prod-github-runner-207 kernel: [57020.570870] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 21:14:06 juju-e4d256-prod-github-runner-207 kernel: [57020.571973] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 21:14:06 juju-e4d256-prod-github-runner-207 kernel: [57020.573184] Call Trace: Aug 22 21:14:06 juju-e4d256-prod-github-runner-207 kernel: [57020.574103] Aug 22 21:14:06 juju-e4d256-prod-github-runner-207 kernel: [57020.575024] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:14:06 juju-e4d256-prod-github-runner-207 kernel: [57020.576064] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:14:06 juju-e4d256-prod-github-runner-207 kernel: [57020.577096] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:14:06 juju-e4d256-prod-github-runner-207 kernel: [57020.578203] ? show_regs.part.0+0x23/0x29 Aug 22 21:14:06 juju-e4d256-prod-github-runner-207 kernel: [57020.579284] ? show_regs.cold+0x8/0xd Aug 22 21:14:06 juju-e4d256-prod-github-runner-207 kernel: [57020.580257] ? watchdog_timer_fn+0x1be/0x220 Aug 22 21:14:06 juju-e4d256-prod-github-runner-207 kernel: [57020.581269] ? lockup_detector_update_enable+0x60/0x60 Aug 22 21:14:06 juju-e4d256-prod-github-runner-207 kernel: [57020.582352] ? __hrtimer_run_queues+0x107/0x230 Aug 22 21:14:06 juju-e4d256-prod-github-runner-207 kernel: [57020.583394] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 21:14:06 juju-e4d256-prod-github-runner-207 kernel: [57020.584420] ? hrtimer_interrupt+0x101/0x220 Aug 22 21:14:06 juju-e4d256-prod-github-runner-207 kernel: [57020.585442] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 21:14:06 juju-e4d256-prod-github-runner-207 kernel: [57020.586679] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 21:14:06 juju-e4d256-prod-github-runner-207 kernel: [57020.588129] Aug 22 21:14:06 juju-e4d256-prod-github-runner-207 kernel: [57020.589026] Aug 22 21:14:06 juju-e4d256-prod-github-runner-207 kernel: [57020.590003] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 21:14:06 juju-e4d256-prod-github-runner-207 kernel: [57020.591074] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:14:06 juju-e4d256-prod-github-runner-207 kernel: [57020.592134] ? _raw_spin_lock+0x22/0x30 Aug 22 21:14:06 juju-e4d256-prod-github-runner-207 kernel: [57020.593093] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:14:06 juju-e4d256-prod-github-runner-207 kernel: [57020.594157] direct_page_fault+0x206/0x310 [kvm] Aug 22 21:14:06 juju-e4d256-prod-github-runner-207 kernel: [57020.595222] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 21:14:06 juju-e4d256-prod-github-runner-207 kernel: [57020.596327] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 21:14:06 juju-e4d256-prod-github-runner-207 kernel: [57020.597411] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 21:14:06 juju-e4d256-prod-github-runner-207 kernel: [57020.598432] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 21:14:06 juju-e4d256-prod-github-runner-207 kernel: [57020.599566] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 21:14:06 juju-e4d256-prod-github-runner-207 kernel: [57020.600550] handle_exit+0x98/0x230 [kvm_amd] Aug 22 21:14:06 juju-e4d256-prod-github-runner-207 kernel: [57020.601463] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 21:14:06 juju-e4d256-prod-github-runner-207 kernel: [57020.602381] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 21:14:06 juju-e4d256-prod-github-runner-207 kernel: [57020.603337] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 21:14:06 juju-e4d256-prod-github-runner-207 kernel: [57020.604263] vcpu_run+0x62/0x2c0 [kvm] Aug 22 21:14:06 juju-e4d256-prod-github-runner-207 kernel: [57020.605076] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 21:14:06 juju-e4d256-prod-github-runner-207 kernel: [57020.605882] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 21:14:06 juju-e4d256-prod-github-runner-207 kernel: [57020.606763] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 21:14:06 juju-e4d256-prod-github-runner-207 kernel: [57020.607571] ? __seccomp_filter+0x4a/0x4a0 Aug 22 21:14:06 juju-e4d256-prod-github-runner-207 kernel: [57020.608422] ? __fget_files+0x86/0xc0 Aug 22 21:14:06 juju-e4d256-prod-github-runner-207 kernel: [57020.609125] __x64_sys_ioctl+0x95/0xd0 Aug 22 21:14:06 juju-e4d256-prod-github-runner-207 kernel: [57020.609817] do_syscall_64+0x5c/0xc0 Aug 22 21:14:06 juju-e4d256-prod-github-runner-207 kernel: [57020.610493] ? do_futex+0x162/0x1f0 Aug 22 21:14:06 juju-e4d256-prod-github-runner-207 kernel: [57020.611144] ? __x64_sys_futex+0x78/0x1e0 Aug 22 21:14:06 juju-e4d256-prod-github-runner-207 kernel: [57020.611816] ? __secure_computing+0xa9/0x120 Aug 22 21:14:06 juju-e4d256-prod-github-runner-207 kernel: [57020.612510] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 21:14:06 juju-e4d256-prod-github-runner-207 kernel: [57020.613282] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:14:06 juju-e4d256-prod-github-runner-207 kernel: [57020.614022] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:14:06 juju-e4d256-prod-github-runner-207 kernel: [57020.614764] ? do_syscall_64+0x69/0xc0 Aug 22 21:14:06 juju-e4d256-prod-github-runner-207 kernel: [57020.615438] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:14:06 juju-e4d256-prod-github-runner-207 kernel: [57020.616144] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:14:06 juju-e4d256-prod-github-runner-207 kernel: [57020.616844] ? do_syscall_64+0x69/0xc0 Aug 22 21:14:06 juju-e4d256-prod-github-runner-207 kernel: [57020.617470] ? do_syscall_64+0x69/0xc0 Aug 22 21:14:06 juju-e4d256-prod-github-runner-207 kernel: [57020.618091] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 21:14:06 juju-e4d256-prod-github-runner-207 kernel: [57020.618813] RIP: 0033:0x7faa5d0edaff Aug 22 21:14:06 juju-e4d256-prod-github-runner-207 kernel: [57020.619485] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 21:14:06 juju-e4d256-prod-github-runner-207 kernel: [57020.621479] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 21:14:06 juju-e4d256-prod-github-runner-207 kernel: [57020.622393] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 21:14:06 juju-e4d256-prod-github-runner-207 kernel: [57020.623305] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 21:14:06 juju-e4d256-prod-github-runner-207 kernel: [57020.624198] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 21:14:06 juju-e4d256-prod-github-runner-207 kernel: [57020.625097] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 21:14:06 juju-e4d256-prod-github-runner-207 kernel: [57020.625987] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 21:14:06 juju-e4d256-prod-github-runner-207 kernel: [57020.626907] Aug 22 21:14:34 juju-e4d256-prod-github-runner-207 kernel: [57048.541981] watchdog: BUG: soft lockup - CPU#1 stuck for 53022s! [qemu-system-x86:6715] Aug 22 21:14:34 juju-e4d256-prod-github-runner-207 kernel: [57048.543174] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 21:14:34 juju-e4d256-prod-github-runner-207 kernel: [57048.543250] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 21:14:34 juju-e4d256-prod-github-runner-207 kernel: [57048.555353] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 21:14:34 juju-e4d256-prod-github-runner-207 kernel: [57048.556631] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 21:14:34 juju-e4d256-prod-github-runner-207 kernel: [57048.557930] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:14:34 juju-e4d256-prod-github-runner-207 kernel: [57048.559014] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 21:14:34 juju-e4d256-prod-github-runner-207 kernel: [57048.561599] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 21:14:34 juju-e4d256-prod-github-runner-207 kernel: [57048.562772] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 21:14:34 juju-e4d256-prod-github-runner-207 kernel: [57048.563984] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 21:14:34 juju-e4d256-prod-github-runner-207 kernel: [57048.565160] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 21:14:34 juju-e4d256-prod-github-runner-207 kernel: [57048.566345] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 21:14:34 juju-e4d256-prod-github-runner-207 kernel: [57048.567526] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 21:14:34 juju-e4d256-prod-github-runner-207 kernel: [57048.568701] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 21:14:34 juju-e4d256-prod-github-runner-207 kernel: [57048.569950] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 21:14:34 juju-e4d256-prod-github-runner-207 kernel: [57048.571072] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 21:14:34 juju-e4d256-prod-github-runner-207 kernel: [57048.572266] Call Trace: Aug 22 21:14:34 juju-e4d256-prod-github-runner-207 kernel: [57048.573181] Aug 22 21:14:34 juju-e4d256-prod-github-runner-207 kernel: [57048.574071] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:14:34 juju-e4d256-prod-github-runner-207 kernel: [57048.575109] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:14:34 juju-e4d256-prod-github-runner-207 kernel: [57048.576129] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:14:34 juju-e4d256-prod-github-runner-207 kernel: [57048.577209] ? show_regs.part.0+0x23/0x29 Aug 22 21:14:34 juju-e4d256-prod-github-runner-207 kernel: [57048.578219] ? show_regs.cold+0x8/0xd Aug 22 21:14:34 juju-e4d256-prod-github-runner-207 kernel: [57048.579201] ? watchdog_timer_fn+0x1be/0x220 Aug 22 21:14:34 juju-e4d256-prod-github-runner-207 kernel: [57048.580229] ? lockup_detector_update_enable+0x60/0x60 Aug 22 21:14:34 juju-e4d256-prod-github-runner-207 kernel: [57048.581291] ? __hrtimer_run_queues+0x107/0x230 Aug 22 21:14:34 juju-e4d256-prod-github-runner-207 kernel: [57048.582343] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 21:14:34 juju-e4d256-prod-github-runner-207 kernel: [57048.583369] ? hrtimer_interrupt+0x101/0x220 Aug 22 21:14:34 juju-e4d256-prod-github-runner-207 kernel: [57048.584383] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 21:14:34 juju-e4d256-prod-github-runner-207 kernel: [57048.585451] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 21:14:34 juju-e4d256-prod-github-runner-207 kernel: [57048.586545] Aug 22 21:14:34 juju-e4d256-prod-github-runner-207 kernel: [57048.587623] Aug 22 21:14:34 juju-e4d256-prod-github-runner-207 kernel: [57048.588559] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 21:14:34 juju-e4d256-prod-github-runner-207 kernel: [57048.589697] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:14:34 juju-e4d256-prod-github-runner-207 kernel: [57048.590862] ? _raw_spin_lock+0x22/0x30 Aug 22 21:14:34 juju-e4d256-prod-github-runner-207 kernel: [57048.591881] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:14:34 juju-e4d256-prod-github-runner-207 kernel: [57048.593000] direct_page_fault+0x206/0x310 [kvm] Aug 22 21:14:34 juju-e4d256-prod-github-runner-207 kernel: [57048.594130] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 21:14:34 juju-e4d256-prod-github-runner-207 kernel: [57048.595237] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 21:14:34 juju-e4d256-prod-github-runner-207 kernel: [57048.596329] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 21:14:34 juju-e4d256-prod-github-runner-207 kernel: [57048.597396] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 21:14:34 juju-e4d256-prod-github-runner-207 kernel: [57048.598467] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 21:14:34 juju-e4d256-prod-github-runner-207 kernel: [57048.599559] handle_exit+0x98/0x230 [kvm_amd] Aug 22 21:14:34 juju-e4d256-prod-github-runner-207 kernel: [57048.600549] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 21:14:34 juju-e4d256-prod-github-runner-207 kernel: [57048.601567] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 21:14:34 juju-e4d256-prod-github-runner-207 kernel: [57048.602622] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 21:14:34 juju-e4d256-prod-github-runner-207 kernel: [57048.603625] vcpu_run+0x62/0x2c0 [kvm] Aug 22 21:14:34 juju-e4d256-prod-github-runner-207 kernel: [57048.604510] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 21:14:34 juju-e4d256-prod-github-runner-207 kernel: [57048.605422] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 21:14:34 juju-e4d256-prod-github-runner-207 kernel: [57048.606400] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 21:14:34 juju-e4d256-prod-github-runner-207 kernel: [57048.607295] ? __seccomp_filter+0x4a/0x4a0 Aug 22 21:14:34 juju-e4d256-prod-github-runner-207 kernel: [57048.608130] ? __fget_files+0x86/0xc0 Aug 22 21:14:34 juju-e4d256-prod-github-runner-207 kernel: [57048.608910] __x64_sys_ioctl+0x95/0xd0 Aug 22 21:14:34 juju-e4d256-prod-github-runner-207 kernel: [57048.609684] do_syscall_64+0x5c/0xc0 Aug 22 21:14:34 juju-e4d256-prod-github-runner-207 kernel: [57048.610585] ? do_futex+0x162/0x1f0 Aug 22 21:14:34 juju-e4d256-prod-github-runner-207 kernel: [57048.611475] ? __x64_sys_futex+0x78/0x1e0 Aug 22 21:14:34 juju-e4d256-prod-github-runner-207 kernel: [57048.612241] ? __secure_computing+0xa9/0x120 Aug 22 21:14:34 juju-e4d256-prod-github-runner-207 kernel: [57048.613046] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 21:14:34 juju-e4d256-prod-github-runner-207 kernel: [57048.613919] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:14:34 juju-e4d256-prod-github-runner-207 kernel: [57048.614761] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:14:34 juju-e4d256-prod-github-runner-207 kernel: [57048.615583] ? do_syscall_64+0x69/0xc0 Aug 22 21:14:34 juju-e4d256-prod-github-runner-207 kernel: [57048.616316] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:14:34 juju-e4d256-prod-github-runner-207 kernel: [57048.617114] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:14:34 juju-e4d256-prod-github-runner-207 kernel: [57048.617905] ? do_syscall_64+0x69/0xc0 Aug 22 21:14:34 juju-e4d256-prod-github-runner-207 kernel: [57048.618625] ? do_syscall_64+0x69/0xc0 Aug 22 21:14:34 juju-e4d256-prod-github-runner-207 kernel: [57048.619332] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 21:14:34 juju-e4d256-prod-github-runner-207 kernel: [57048.620146] RIP: 0033:0x7faa5d0edaff Aug 22 21:14:34 juju-e4d256-prod-github-runner-207 kernel: [57048.620855] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 21:14:34 juju-e4d256-prod-github-runner-207 kernel: [57048.623204] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 21:14:34 juju-e4d256-prod-github-runner-207 kernel: [57048.624263] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 21:14:34 juju-e4d256-prod-github-runner-207 kernel: [57048.625293] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 21:14:34 juju-e4d256-prod-github-runner-207 kernel: [57048.626333] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 21:14:34 juju-e4d256-prod-github-runner-207 kernel: [57048.627361] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 21:14:34 juju-e4d256-prod-github-runner-207 kernel: [57048.628385] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 21:14:34 juju-e4d256-prod-github-runner-207 kernel: [57048.629408] Aug 22 21:14:47 juju-e4d256-prod-github-runner-207 kernel: [57060.992911] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 21:14:47 juju-e4d256-prod-github-runner-207 kernel: [57060.994931] rcu: 1-....: (14191147 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=6858459 Aug 22 21:14:47 juju-e4d256-prod-github-runner-207 kernel: [57060.996048] (t=14235948 jiffies g=23269 q=52034) Aug 22 21:14:47 juju-e4d256-prod-github-runner-207 kernel: [57060.999026] NMI backtrace for cpu 1 Aug 22 21:14:47 juju-e4d256-prod-github-runner-207 kernel: [57060.999744] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 21:14:47 juju-e4d256-prod-github-runner-207 kernel: [57061.003075] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 21:14:47 juju-e4d256-prod-github-runner-207 kernel: [57061.004320] Call Trace: Aug 22 21:14:47 juju-e4d256-prod-github-runner-207 kernel: [57061.007013] Aug 22 21:14:47 juju-e4d256-prod-github-runner-207 kernel: [57061.007713] show_stack+0x52/0x5c Aug 22 21:14:47 juju-e4d256-prod-github-runner-207 kernel: [57061.010715] dump_stack_lvl+0x4a/0x63 Aug 22 21:14:47 juju-e4d256-prod-github-runner-207 kernel: [57061.011608] dump_stack+0x10/0x16 Aug 22 21:14:47 juju-e4d256-prod-github-runner-207 kernel: [57061.014276] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 21:14:47 juju-e4d256-prod-github-runner-207 kernel: [57061.015610] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 21:14:47 juju-e4d256-prod-github-runner-207 kernel: [57061.016488] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 21:14:47 juju-e4d256-prod-github-runner-207 kernel: [57061.019489] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 21:14:47 juju-e4d256-prod-github-runner-207 kernel: [57061.020440] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 21:14:47 juju-e4d256-prod-github-runner-207 kernel: [57061.022921] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 21:14:47 juju-e4d256-prod-github-runner-207 kernel: [57061.024309] print_cpu_stall.cold+0x2f/0xe2 Aug 22 21:14:47 juju-e4d256-prod-github-runner-207 kernel: [57061.025165] ? timekeeping_update+0xf7/0x150 Aug 22 21:14:47 juju-e4d256-prod-github-runner-207 kernel: [57061.027986] check_cpu_stall+0x109/0x270 Aug 22 21:14:47 juju-e4d256-prod-github-runner-207 kernel: [57061.028836] rcu_sched_clock_irq+0x9a/0x250 Aug 22 21:14:47 juju-e4d256-prod-github-runner-207 kernel: [57061.031645] update_process_times+0x94/0xd0 Aug 22 21:14:47 juju-e4d256-prod-github-runner-207 kernel: [57061.032525] tick_sched_handle+0x29/0x70 Aug 22 21:14:47 juju-e4d256-prod-github-runner-207 kernel: [57061.035503] tick_sched_timer+0x8c/0xc0 Aug 22 21:14:47 juju-e4d256-prod-github-runner-207 kernel: [57061.036270] ? tick_nohz_handler+0xb0/0xb0 Aug 22 21:14:47 juju-e4d256-prod-github-runner-207 kernel: [57061.039282] __hrtimer_run_queues+0x107/0x230 Aug 22 21:14:47 juju-e4d256-prod-github-runner-207 kernel: [57061.040154] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 21:14:47 juju-e4d256-prod-github-runner-207 kernel: [57061.043071] hrtimer_interrupt+0x101/0x220 Aug 22 21:14:47 juju-e4d256-prod-github-runner-207 kernel: [57061.044221] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 21:14:47 juju-e4d256-prod-github-runner-207 kernel: [57061.047253] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 21:14:47 juju-e4d256-prod-github-runner-207 kernel: [57061.050290] Aug 22 21:14:47 juju-e4d256-prod-github-runner-207 kernel: [57061.051105] Aug 22 21:14:47 juju-e4d256-prod-github-runner-207 kernel: [57061.051849] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 21:14:47 juju-e4d256-prod-github-runner-207 kernel: [57061.055109] RIP: 0010:native_queued_spin_lock_slowpath+0xc/0x40 Aug 22 21:14:47 juju-e4d256-prod-github-runner-207 kernel: [57061.058521] Code: fe ff ff eb af 4c 89 fe 48 c7 c7 20 99 e9 89 e8 ca 69 55 00 e9 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 <8b> 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 eb Aug 22 21:14:47 juju-e4d256-prod-github-runner-207 kernel: [57061.063969] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 21:14:47 juju-e4d256-prod-github-runner-207 kernel: [57061.067426] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 21:14:47 juju-e4d256-prod-github-runner-207 kernel: [57061.068744] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 21:14:47 juju-e4d256-prod-github-runner-207 kernel: [57061.072150] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 21:14:47 juju-e4d256-prod-github-runner-207 kernel: [57061.075544] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 21:14:47 juju-e4d256-prod-github-runner-207 kernel: [57061.076667] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 21:14:47 juju-e4d256-prod-github-runner-207 kernel: [57061.079932] ? _raw_spin_lock+0x22/0x30 Aug 22 21:14:47 juju-e4d256-prod-github-runner-207 kernel: [57061.080781] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:14:47 juju-e4d256-prod-github-runner-207 kernel: [57061.083897] direct_page_fault+0x206/0x310 [kvm] Aug 22 21:14:47 juju-e4d256-prod-github-runner-207 kernel: [57061.084842] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 21:14:47 juju-e4d256-prod-github-runner-207 kernel: [57061.088082] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 21:14:47 juju-e4d256-prod-github-runner-207 kernel: [57061.088958] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 21:14:47 juju-e4d256-prod-github-runner-207 kernel: [57061.091939] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 21:14:47 juju-e4d256-prod-github-runner-207 kernel: [57061.092742] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 21:14:47 juju-e4d256-prod-github-runner-207 kernel: [57061.095623] handle_exit+0x98/0x230 [kvm_amd] Aug 22 21:14:47 juju-e4d256-prod-github-runner-207 kernel: [57061.096391] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 21:14:47 juju-e4d256-prod-github-runner-207 kernel: [57061.097270] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 21:14:47 juju-e4d256-prod-github-runner-207 kernel: [57061.100378] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 21:14:47 juju-e4d256-prod-github-runner-207 kernel: [57061.101209] vcpu_run+0x62/0x2c0 [kvm] Aug 22 21:14:47 juju-e4d256-prod-github-runner-207 kernel: [57061.104221] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 21:14:47 juju-e4d256-prod-github-runner-207 kernel: [57061.104972] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 21:14:47 juju-e4d256-prod-github-runner-207 kernel: [57061.106380] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 21:14:47 juju-e4d256-prod-github-runner-207 kernel: [57061.108926] ? __seccomp_filter+0x4a/0x4a0 Aug 22 21:14:47 juju-e4d256-prod-github-runner-207 kernel: [57061.109656] ? __fget_files+0x86/0xc0 Aug 22 21:14:47 juju-e4d256-prod-github-runner-207 kernel: [57061.112688] __x64_sys_ioctl+0x95/0xd0 Aug 22 21:14:47 juju-e4d256-prod-github-runner-207 kernel: [57061.113403] do_syscall_64+0x5c/0xc0 Aug 22 21:14:47 juju-e4d256-prod-github-runner-207 kernel: [57061.114196] ? do_futex+0x162/0x1f0 Aug 22 21:14:47 juju-e4d256-prod-github-runner-207 kernel: [57061.117197] ? __x64_sys_futex+0x78/0x1e0 Aug 22 21:14:47 juju-e4d256-prod-github-runner-207 kernel: [57061.117993] ? __secure_computing+0xa9/0x120 Aug 22 21:14:47 juju-e4d256-prod-github-runner-207 kernel: [57061.118820] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 21:14:47 juju-e4d256-prod-github-runner-207 kernel: [57061.119724] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:14:47 juju-e4d256-prod-github-runner-207 kernel: [57061.120573] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:14:47 juju-e4d256-prod-github-runner-207 kernel: [57061.121419] ? do_syscall_64+0x69/0xc0 Aug 22 21:14:47 juju-e4d256-prod-github-runner-207 kernel: [57061.122208] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:14:47 juju-e4d256-prod-github-runner-207 kernel: [57061.123062] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:14:47 juju-e4d256-prod-github-runner-207 kernel: [57061.123921] ? do_syscall_64+0x69/0xc0 Aug 22 21:14:47 juju-e4d256-prod-github-runner-207 kernel: [57061.124693] ? do_syscall_64+0x69/0xc0 Aug 22 21:14:47 juju-e4d256-prod-github-runner-207 kernel: [57061.125457] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 21:14:47 juju-e4d256-prod-github-runner-207 kernel: [57061.126349] RIP: 0033:0x7faa5d0edaff Aug 22 21:14:47 juju-e4d256-prod-github-runner-207 kernel: [57061.127108] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 21:14:47 juju-e4d256-prod-github-runner-207 kernel: [57061.129546] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 21:14:47 juju-e4d256-prod-github-runner-207 kernel: [57061.130670] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 21:14:47 juju-e4d256-prod-github-runner-207 kernel: [57061.131810] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 21:14:47 juju-e4d256-prod-github-runner-207 kernel: [57061.132901] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 21:14:47 juju-e4d256-prod-github-runner-207 kernel: [57061.134017] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 21:14:47 juju-e4d256-prod-github-runner-207 kernel: [57061.135082] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 21:14:47 juju-e4d256-prod-github-runner-207 kernel: [57061.136139] Aug 22 21:15:14 juju-e4d256-prod-github-runner-207 kernel: [57088.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 53059s! [qemu-system-x86:6715] Aug 22 21:15:14 juju-e4d256-prod-github-runner-207 kernel: [57088.543147] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 21:15:14 juju-e4d256-prod-github-runner-207 kernel: [57088.543220] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 21:15:14 juju-e4d256-prod-github-runner-207 kernel: [57088.555767] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 21:15:14 juju-e4d256-prod-github-runner-207 kernel: [57088.557066] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 21:15:14 juju-e4d256-prod-github-runner-207 kernel: [57088.558347] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:15:14 juju-e4d256-prod-github-runner-207 kernel: [57088.559432] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 21:15:14 juju-e4d256-prod-github-runner-207 kernel: [57088.562061] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 21:15:14 juju-e4d256-prod-github-runner-207 kernel: [57088.563123] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 21:15:14 juju-e4d256-prod-github-runner-207 kernel: [57088.564308] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 21:15:14 juju-e4d256-prod-github-runner-207 kernel: [57088.565494] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 21:15:14 juju-e4d256-prod-github-runner-207 kernel: [57088.566707] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 21:15:14 juju-e4d256-prod-github-runner-207 kernel: [57088.567885] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 21:15:14 juju-e4d256-prod-github-runner-207 kernel: [57088.569073] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 21:15:14 juju-e4d256-prod-github-runner-207 kernel: [57088.570351] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 21:15:14 juju-e4d256-prod-github-runner-207 kernel: [57088.571472] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 21:15:14 juju-e4d256-prod-github-runner-207 kernel: [57088.572695] Call Trace: Aug 22 21:15:14 juju-e4d256-prod-github-runner-207 kernel: [57088.573631] Aug 22 21:15:14 juju-e4d256-prod-github-runner-207 kernel: [57088.574525] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:15:14 juju-e4d256-prod-github-runner-207 kernel: [57088.575772] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:15:14 juju-e4d256-prod-github-runner-207 kernel: [57088.577036] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:15:14 juju-e4d256-prod-github-runner-207 kernel: [57088.578170] ? show_regs.part.0+0x23/0x29 Aug 22 21:15:14 juju-e4d256-prod-github-runner-207 kernel: [57088.579388] ? show_regs.cold+0x8/0xd Aug 22 21:15:14 juju-e4d256-prod-github-runner-207 kernel: [57088.580376] ? watchdog_timer_fn+0x1be/0x220 Aug 22 21:15:14 juju-e4d256-prod-github-runner-207 kernel: [57088.581402] ? lockup_detector_update_enable+0x60/0x60 Aug 22 21:15:14 juju-e4d256-prod-github-runner-207 kernel: [57088.582516] ? __hrtimer_run_queues+0x107/0x230 Aug 22 21:15:14 juju-e4d256-prod-github-runner-207 kernel: [57088.583565] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 21:15:14 juju-e4d256-prod-github-runner-207 kernel: [57088.584601] ? hrtimer_interrupt+0x101/0x220 Aug 22 21:15:14 juju-e4d256-prod-github-runner-207 kernel: [57088.585653] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 21:15:14 juju-e4d256-prod-github-runner-207 kernel: [57088.586741] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 21:15:14 juju-e4d256-prod-github-runner-207 kernel: [57088.587806] Aug 22 21:15:14 juju-e4d256-prod-github-runner-207 kernel: [57088.588669] Aug 22 21:15:14 juju-e4d256-prod-github-runner-207 kernel: [57088.589516] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 21:15:14 juju-e4d256-prod-github-runner-207 kernel: [57088.590580] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:15:14 juju-e4d256-prod-github-runner-207 kernel: [57088.591637] ? _raw_spin_lock+0x22/0x30 Aug 22 21:15:14 juju-e4d256-prod-github-runner-207 kernel: [57088.592596] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:15:14 juju-e4d256-prod-github-runner-207 kernel: [57088.593842] direct_page_fault+0x206/0x310 [kvm] Aug 22 21:15:14 juju-e4d256-prod-github-runner-207 kernel: [57088.594888] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 21:15:14 juju-e4d256-prod-github-runner-207 kernel: [57088.595922] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 21:15:14 juju-e4d256-prod-github-runner-207 kernel: [57088.597002] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 21:15:14 juju-e4d256-prod-github-runner-207 kernel: [57088.598257] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 21:15:14 juju-e4d256-prod-github-runner-207 kernel: [57088.599244] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 21:15:14 juju-e4d256-prod-github-runner-207 kernel: [57088.600258] handle_exit+0x98/0x230 [kvm_amd] Aug 22 21:15:14 juju-e4d256-prod-github-runner-207 kernel: [57088.601286] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 21:15:14 juju-e4d256-prod-github-runner-207 kernel: [57088.602284] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 21:15:14 juju-e4d256-prod-github-runner-207 kernel: [57088.603236] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 21:15:14 juju-e4d256-prod-github-runner-207 kernel: [57088.604234] vcpu_run+0x62/0x2c0 [kvm] Aug 22 21:15:14 juju-e4d256-prod-github-runner-207 kernel: [57088.605120] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 21:15:14 juju-e4d256-prod-github-runner-207 kernel: [57088.606014] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 21:15:14 juju-e4d256-prod-github-runner-207 kernel: [57088.606908] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 21:15:14 juju-e4d256-prod-github-runner-207 kernel: [57088.607723] ? __seccomp_filter+0x4a/0x4a0 Aug 22 21:15:14 juju-e4d256-prod-github-runner-207 kernel: [57088.608507] ? __fget_files+0x86/0xc0 Aug 22 21:15:14 juju-e4d256-prod-github-runner-207 kernel: [57088.609328] __x64_sys_ioctl+0x95/0xd0 Aug 22 21:15:14 juju-e4d256-prod-github-runner-207 kernel: [57088.610072] do_syscall_64+0x5c/0xc0 Aug 22 21:15:14 juju-e4d256-prod-github-runner-207 kernel: [57088.610762] ? do_futex+0x162/0x1f0 Aug 22 21:15:14 juju-e4d256-prod-github-runner-207 kernel: [57088.611431] ? __x64_sys_futex+0x78/0x1e0 Aug 22 21:15:14 juju-e4d256-prod-github-runner-207 kernel: [57088.612159] ? __secure_computing+0xa9/0x120 Aug 22 21:15:14 juju-e4d256-prod-github-runner-207 kernel: [57088.612890] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 21:15:14 juju-e4d256-prod-github-runner-207 kernel: [57088.613704] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:15:14 juju-e4d256-prod-github-runner-207 kernel: [57088.614454] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:15:14 juju-e4d256-prod-github-runner-207 kernel: [57088.615193] ? do_syscall_64+0x69/0xc0 Aug 22 21:15:14 juju-e4d256-prod-github-runner-207 kernel: [57088.615854] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:15:14 juju-e4d256-prod-github-runner-207 kernel: [57088.616624] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:15:14 juju-e4d256-prod-github-runner-207 kernel: [57088.617377] ? do_syscall_64+0x69/0xc0 Aug 22 21:15:14 juju-e4d256-prod-github-runner-207 kernel: [57088.618059] ? do_syscall_64+0x69/0xc0 Aug 22 21:15:14 juju-e4d256-prod-github-runner-207 kernel: [57088.618703] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 21:15:14 juju-e4d256-prod-github-runner-207 kernel: [57088.619427] RIP: 0033:0x7faa5d0edaff Aug 22 21:15:14 juju-e4d256-prod-github-runner-207 kernel: [57088.620113] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 21:15:14 juju-e4d256-prod-github-runner-207 kernel: [57088.622250] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 21:15:14 juju-e4d256-prod-github-runner-207 kernel: [57088.623415] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 21:15:14 juju-e4d256-prod-github-runner-207 kernel: [57088.624439] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 21:15:14 juju-e4d256-prod-github-runner-207 kernel: [57088.625422] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 21:15:14 juju-e4d256-prod-github-runner-207 kernel: [57088.626403] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 21:15:14 juju-e4d256-prod-github-runner-207 kernel: [57088.627319] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 21:15:14 juju-e4d256-prod-github-runner-207 kernel: [57088.628246] Aug 22 21:15:42 juju-e4d256-prod-github-runner-207 kernel: [57116.541980] watchdog: BUG: soft lockup - CPU#1 stuck for 53085s! [qemu-system-x86:6715] Aug 22 21:15:42 juju-e4d256-prod-github-runner-207 kernel: [57116.543881] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 21:15:42 juju-e4d256-prod-github-runner-207 kernel: [57116.544189] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 21:15:42 juju-e4d256-prod-github-runner-207 kernel: [57116.556312] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 21:15:42 juju-e4d256-prod-github-runner-207 kernel: [57116.557596] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 21:15:42 juju-e4d256-prod-github-runner-207 kernel: [57116.558839] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:15:42 juju-e4d256-prod-github-runner-207 kernel: [57116.559904] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 21:15:42 juju-e4d256-prod-github-runner-207 kernel: [57116.562506] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 21:15:42 juju-e4d256-prod-github-runner-207 kernel: [57116.563675] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 21:15:42 juju-e4d256-prod-github-runner-207 kernel: [57116.564846] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 21:15:42 juju-e4d256-prod-github-runner-207 kernel: [57116.566042] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 21:15:42 juju-e4d256-prod-github-runner-207 kernel: [57116.567221] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 21:15:42 juju-e4d256-prod-github-runner-207 kernel: [57116.568392] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 21:15:42 juju-e4d256-prod-github-runner-207 kernel: [57116.569609] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 21:15:42 juju-e4d256-prod-github-runner-207 kernel: [57116.570840] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 21:15:42 juju-e4d256-prod-github-runner-207 kernel: [57116.571955] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 21:15:42 juju-e4d256-prod-github-runner-207 kernel: [57116.573156] Call Trace: Aug 22 21:15:42 juju-e4d256-prod-github-runner-207 kernel: [57116.574093] Aug 22 21:15:42 juju-e4d256-prod-github-runner-207 kernel: [57116.575008] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:15:42 juju-e4d256-prod-github-runner-207 kernel: [57116.576076] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:15:42 juju-e4d256-prod-github-runner-207 kernel: [57116.577105] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:15:42 juju-e4d256-prod-github-runner-207 kernel: [57116.578210] ? show_regs.part.0+0x23/0x29 Aug 22 21:15:42 juju-e4d256-prod-github-runner-207 kernel: [57116.579217] ? show_regs.cold+0x8/0xd Aug 22 21:15:42 juju-e4d256-prod-github-runner-207 kernel: [57116.580196] ? watchdog_timer_fn+0x1be/0x220 Aug 22 21:15:42 juju-e4d256-prod-github-runner-207 kernel: [57116.581201] ? lockup_detector_update_enable+0x60/0x60 Aug 22 21:15:42 juju-e4d256-prod-github-runner-207 kernel: [57116.582287] ? __hrtimer_run_queues+0x107/0x230 Aug 22 21:15:42 juju-e4d256-prod-github-runner-207 kernel: [57116.583312] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 21:15:42 juju-e4d256-prod-github-runner-207 kernel: [57116.584344] ? hrtimer_interrupt+0x101/0x220 Aug 22 21:15:42 juju-e4d256-prod-github-runner-207 kernel: [57116.585379] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 21:15:42 juju-e4d256-prod-github-runner-207 kernel: [57116.586446] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 21:15:42 juju-e4d256-prod-github-runner-207 kernel: [57116.587490] Aug 22 21:15:42 juju-e4d256-prod-github-runner-207 kernel: [57116.588356] Aug 22 21:15:42 juju-e4d256-prod-github-runner-207 kernel: [57116.589200] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 21:15:42 juju-e4d256-prod-github-runner-207 kernel: [57116.590265] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:15:42 juju-e4d256-prod-github-runner-207 kernel: [57116.591321] ? _raw_spin_lock+0x22/0x30 Aug 22 21:15:42 juju-e4d256-prod-github-runner-207 kernel: [57116.592286] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:15:42 juju-e4d256-prod-github-runner-207 kernel: [57116.593337] direct_page_fault+0x206/0x310 [kvm] Aug 22 21:15:42 juju-e4d256-prod-github-runner-207 kernel: [57116.594382] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 21:15:42 juju-e4d256-prod-github-runner-207 kernel: [57116.595401] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 21:15:42 juju-e4d256-prod-github-runner-207 kernel: [57116.596401] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 21:15:42 juju-e4d256-prod-github-runner-207 kernel: [57116.597416] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 21:15:42 juju-e4d256-prod-github-runner-207 kernel: [57116.598369] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 21:15:42 juju-e4d256-prod-github-runner-207 kernel: [57116.599357] handle_exit+0x98/0x230 [kvm_amd] Aug 22 21:15:42 juju-e4d256-prod-github-runner-207 kernel: [57116.600261] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 21:15:42 juju-e4d256-prod-github-runner-207 kernel: [57116.601196] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 21:15:42 juju-e4d256-prod-github-runner-207 kernel: [57116.602185] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 21:15:42 juju-e4d256-prod-github-runner-207 kernel: [57116.603101] vcpu_run+0x62/0x2c0 [kvm] Aug 22 21:15:42 juju-e4d256-prod-github-runner-207 kernel: [57116.603925] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 21:15:42 juju-e4d256-prod-github-runner-207 kernel: [57116.604747] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 21:15:42 juju-e4d256-prod-github-runner-207 kernel: [57116.605660] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 21:15:42 juju-e4d256-prod-github-runner-207 kernel: [57116.606491] ? __seccomp_filter+0x4a/0x4a0 Aug 22 21:15:42 juju-e4d256-prod-github-runner-207 kernel: [57116.607245] ? __fget_files+0x86/0xc0 Aug 22 21:15:42 juju-e4d256-prod-github-runner-207 kernel: [57116.607976] __x64_sys_ioctl+0x95/0xd0 Aug 22 21:15:42 juju-e4d256-prod-github-runner-207 kernel: [57116.608682] do_syscall_64+0x5c/0xc0 Aug 22 21:15:42 juju-e4d256-prod-github-runner-207 kernel: [57116.609366] ? do_futex+0x162/0x1f0 Aug 22 21:15:42 juju-e4d256-prod-github-runner-207 kernel: [57116.610035] ? __x64_sys_futex+0x78/0x1e0 Aug 22 21:15:42 juju-e4d256-prod-github-runner-207 kernel: [57116.610729] ? __secure_computing+0xa9/0x120 Aug 22 21:15:42 juju-e4d256-prod-github-runner-207 kernel: [57116.611419] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 21:15:42 juju-e4d256-prod-github-runner-207 kernel: [57116.612186] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:15:42 juju-e4d256-prod-github-runner-207 kernel: [57116.612923] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:15:42 juju-e4d256-prod-github-runner-207 kernel: [57116.613667] ? do_syscall_64+0x69/0xc0 Aug 22 21:15:42 juju-e4d256-prod-github-runner-207 kernel: [57116.614357] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:15:42 juju-e4d256-prod-github-runner-207 kernel: [57116.615070] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:15:42 juju-e4d256-prod-github-runner-207 kernel: [57116.615773] ? do_syscall_64+0x69/0xc0 Aug 22 21:15:42 juju-e4d256-prod-github-runner-207 kernel: [57116.616406] ? do_syscall_64+0x69/0xc0 Aug 22 21:15:42 juju-e4d256-prod-github-runner-207 kernel: [57116.617039] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 21:15:42 juju-e4d256-prod-github-runner-207 kernel: [57116.617756] RIP: 0033:0x7faa5d0edaff Aug 22 21:15:42 juju-e4d256-prod-github-runner-207 kernel: [57116.618412] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 21:15:42 juju-e4d256-prod-github-runner-207 kernel: [57116.620403] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 21:15:42 juju-e4d256-prod-github-runner-207 kernel: [57116.621337] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 21:15:42 juju-e4d256-prod-github-runner-207 kernel: [57116.622223] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 21:15:42 juju-e4d256-prod-github-runner-207 kernel: [57116.623109] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 21:15:42 juju-e4d256-prod-github-runner-207 kernel: [57116.623994] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 21:15:42 juju-e4d256-prod-github-runner-207 kernel: [57116.624880] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 21:15:42 juju-e4d256-prod-github-runner-207 kernel: [57116.625789] Aug 22 21:16:10 juju-e4d256-prod-github-runner-207 kernel: [57144.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 53112s! [qemu-system-x86:6715] Aug 22 21:16:10 juju-e4d256-prod-github-runner-207 kernel: [57144.543111] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 21:16:10 juju-e4d256-prod-github-runner-207 kernel: [57144.543190] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 21:16:10 juju-e4d256-prod-github-runner-207 kernel: [57144.555396] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 21:16:10 juju-e4d256-prod-github-runner-207 kernel: [57144.556657] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 21:16:10 juju-e4d256-prod-github-runner-207 kernel: [57144.557899] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:16:10 juju-e4d256-prod-github-runner-207 kernel: [57144.558959] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 21:16:10 juju-e4d256-prod-github-runner-207 kernel: [57144.561511] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 21:16:10 juju-e4d256-prod-github-runner-207 kernel: [57144.562557] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 21:16:10 juju-e4d256-prod-github-runner-207 kernel: [57144.563716] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 21:16:10 juju-e4d256-prod-github-runner-207 kernel: [57144.564905] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 21:16:10 juju-e4d256-prod-github-runner-207 kernel: [57144.566100] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 21:16:10 juju-e4d256-prod-github-runner-207 kernel: [57144.567259] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 21:16:10 juju-e4d256-prod-github-runner-207 kernel: [57144.568424] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 21:16:10 juju-e4d256-prod-github-runner-207 kernel: [57144.569669] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 21:16:10 juju-e4d256-prod-github-runner-207 kernel: [57144.570769] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 21:16:10 juju-e4d256-prod-github-runner-207 kernel: [57144.571961] Call Trace: Aug 22 21:16:10 juju-e4d256-prod-github-runner-207 kernel: [57144.572882] Aug 22 21:16:10 juju-e4d256-prod-github-runner-207 kernel: [57144.573765] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:16:10 juju-e4d256-prod-github-runner-207 kernel: [57144.574797] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:16:10 juju-e4d256-prod-github-runner-207 kernel: [57144.575827] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:16:10 juju-e4d256-prod-github-runner-207 kernel: [57144.576928] ? show_regs.part.0+0x23/0x29 Aug 22 21:16:10 juju-e4d256-prod-github-runner-207 kernel: [57144.577926] ? show_regs.cold+0x8/0xd Aug 22 21:16:10 juju-e4d256-prod-github-runner-207 kernel: [57144.578904] ? watchdog_timer_fn+0x1be/0x220 Aug 22 21:16:10 juju-e4d256-prod-github-runner-207 kernel: [57144.579910] ? lockup_detector_update_enable+0x60/0x60 Aug 22 21:16:10 juju-e4d256-prod-github-runner-207 kernel: [57144.581017] ? __hrtimer_run_queues+0x107/0x230 Aug 22 21:16:10 juju-e4d256-prod-github-runner-207 kernel: [57144.582050] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 21:16:10 juju-e4d256-prod-github-runner-207 kernel: [57144.583073] ? hrtimer_interrupt+0x101/0x220 Aug 22 21:16:10 juju-e4d256-prod-github-runner-207 kernel: [57144.584086] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 21:16:10 juju-e4d256-prod-github-runner-207 kernel: [57144.585179] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 21:16:10 juju-e4d256-prod-github-runner-207 kernel: [57144.586223] Aug 22 21:16:10 juju-e4d256-prod-github-runner-207 kernel: [57144.587074] Aug 22 21:16:10 juju-e4d256-prod-github-runner-207 kernel: [57144.587913] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 21:16:10 juju-e4d256-prod-github-runner-207 kernel: [57144.588963] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:16:10 juju-e4d256-prod-github-runner-207 kernel: [57144.590004] ? _raw_spin_lock+0x22/0x30 Aug 22 21:16:10 juju-e4d256-prod-github-runner-207 kernel: [57144.590964] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:16:10 juju-e4d256-prod-github-runner-207 kernel: [57144.591989] direct_page_fault+0x206/0x310 [kvm] Aug 22 21:16:10 juju-e4d256-prod-github-runner-207 kernel: [57144.593043] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 21:16:10 juju-e4d256-prod-github-runner-207 kernel: [57144.594054] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 21:16:10 juju-e4d256-prod-github-runner-207 kernel: [57144.595066] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 21:16:10 juju-e4d256-prod-github-runner-207 kernel: [57144.596031] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 21:16:10 juju-e4d256-prod-github-runner-207 kernel: [57144.596999] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 21:16:10 juju-e4d256-prod-github-runner-207 kernel: [57144.597980] handle_exit+0x98/0x230 [kvm_amd] Aug 22 21:16:10 juju-e4d256-prod-github-runner-207 kernel: [57144.598870] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 21:16:10 juju-e4d256-prod-github-runner-207 kernel: [57144.599786] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 21:16:10 juju-e4d256-prod-github-runner-207 kernel: [57144.600709] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 21:16:10 juju-e4d256-prod-github-runner-207 kernel: [57144.601632] vcpu_run+0x62/0x2c0 [kvm] Aug 22 21:16:10 juju-e4d256-prod-github-runner-207 kernel: [57144.602443] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 21:16:10 juju-e4d256-prod-github-runner-207 kernel: [57144.603252] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 21:16:10 juju-e4d256-prod-github-runner-207 kernel: [57144.604110] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 21:16:10 juju-e4d256-prod-github-runner-207 kernel: [57144.604930] ? __seccomp_filter+0x4a/0x4a0 Aug 22 21:16:10 juju-e4d256-prod-github-runner-207 kernel: [57144.605701] ? __fget_files+0x86/0xc0 Aug 22 21:16:10 juju-e4d256-prod-github-runner-207 kernel: [57144.606430] __x64_sys_ioctl+0x95/0xd0 Aug 22 21:16:10 juju-e4d256-prod-github-runner-207 kernel: [57144.607127] do_syscall_64+0x5c/0xc0 Aug 22 21:16:10 juju-e4d256-prod-github-runner-207 kernel: [57144.607793] ? do_futex+0x162/0x1f0 Aug 22 21:16:10 juju-e4d256-prod-github-runner-207 kernel: [57144.608441] ? __x64_sys_futex+0x78/0x1e0 Aug 22 21:16:10 juju-e4d256-prod-github-runner-207 kernel: [57144.609135] ? __secure_computing+0xa9/0x120 Aug 22 21:16:10 juju-e4d256-prod-github-runner-207 kernel: [57144.609828] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 21:16:10 juju-e4d256-prod-github-runner-207 kernel: [57144.610588] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:16:10 juju-e4d256-prod-github-runner-207 kernel: [57144.611318] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:16:10 juju-e4d256-prod-github-runner-207 kernel: [57144.612036] ? do_syscall_64+0x69/0xc0 Aug 22 21:16:10 juju-e4d256-prod-github-runner-207 kernel: [57144.612724] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:16:10 juju-e4d256-prod-github-runner-207 kernel: [57144.613509] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:16:10 juju-e4d256-prod-github-runner-207 kernel: [57144.614247] ? do_syscall_64+0x69/0xc0 Aug 22 21:16:10 juju-e4d256-prod-github-runner-207 kernel: [57144.614935] ? do_syscall_64+0x69/0xc0 Aug 22 21:16:10 juju-e4d256-prod-github-runner-207 kernel: [57144.615573] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 21:16:10 juju-e4d256-prod-github-runner-207 kernel: [57144.616281] RIP: 0033:0x7faa5d0edaff Aug 22 21:16:10 juju-e4d256-prod-github-runner-207 kernel: [57144.616978] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 21:16:10 juju-e4d256-prod-github-runner-207 kernel: [57144.619037] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 21:16:10 juju-e4d256-prod-github-runner-207 kernel: [57144.620043] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 21:16:10 juju-e4d256-prod-github-runner-207 kernel: [57144.621025] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 21:16:10 juju-e4d256-prod-github-runner-207 kernel: [57144.621945] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 21:16:10 juju-e4d256-prod-github-runner-207 kernel: [57144.622859] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 21:16:10 juju-e4d256-prod-github-runner-207 kernel: [57144.623775] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 21:16:10 juju-e4d256-prod-github-runner-207 kernel: [57144.624673] Aug 22 21:16:38 juju-e4d256-prod-github-runner-207 kernel: [57172.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 53138s! [qemu-system-x86:6715] Aug 22 21:16:38 juju-e4d256-prod-github-runner-207 kernel: [57172.543131] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 21:16:38 juju-e4d256-prod-github-runner-207 kernel: [57172.543205] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 21:16:38 juju-e4d256-prod-github-runner-207 kernel: [57172.555323] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 21:16:38 juju-e4d256-prod-github-runner-207 kernel: [57172.556597] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 21:16:38 juju-e4d256-prod-github-runner-207 kernel: [57172.557869] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:16:38 juju-e4d256-prod-github-runner-207 kernel: [57172.558994] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 21:16:38 juju-e4d256-prod-github-runner-207 kernel: [57172.561774] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 21:16:38 juju-e4d256-prod-github-runner-207 kernel: [57172.562831] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 21:16:38 juju-e4d256-prod-github-runner-207 kernel: [57172.564017] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 21:16:38 juju-e4d256-prod-github-runner-207 kernel: [57172.565204] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 21:16:38 juju-e4d256-prod-github-runner-207 kernel: [57172.566369] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 21:16:38 juju-e4d256-prod-github-runner-207 kernel: [57172.567528] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 21:16:38 juju-e4d256-prod-github-runner-207 kernel: [57172.568703] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 21:16:38 juju-e4d256-prod-github-runner-207 kernel: [57172.569941] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 21:16:38 juju-e4d256-prod-github-runner-207 kernel: [57172.571036] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 21:16:38 juju-e4d256-prod-github-runner-207 kernel: [57172.572227] Call Trace: Aug 22 21:16:38 juju-e4d256-prod-github-runner-207 kernel: [57172.573155] Aug 22 21:16:38 juju-e4d256-prod-github-runner-207 kernel: [57172.574048] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:16:38 juju-e4d256-prod-github-runner-207 kernel: [57172.575085] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:16:38 juju-e4d256-prod-github-runner-207 kernel: [57172.576106] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:16:38 juju-e4d256-prod-github-runner-207 kernel: [57172.577210] ? show_regs.part.0+0x23/0x29 Aug 22 21:16:38 juju-e4d256-prod-github-runner-207 kernel: [57172.578219] ? show_regs.cold+0x8/0xd Aug 22 21:16:38 juju-e4d256-prod-github-runner-207 kernel: [57172.579196] ? watchdog_timer_fn+0x1be/0x220 Aug 22 21:16:38 juju-e4d256-prod-github-runner-207 kernel: [57172.580203] ? lockup_detector_update_enable+0x60/0x60 Aug 22 21:16:38 juju-e4d256-prod-github-runner-207 kernel: [57172.581281] ? __hrtimer_run_queues+0x107/0x230 Aug 22 21:16:38 juju-e4d256-prod-github-runner-207 kernel: [57172.582314] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 21:16:38 juju-e4d256-prod-github-runner-207 kernel: [57172.583343] ? hrtimer_interrupt+0x101/0x220 Aug 22 21:16:38 juju-e4d256-prod-github-runner-207 kernel: [57172.584362] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 21:16:38 juju-e4d256-prod-github-runner-207 kernel: [57172.585435] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 21:16:38 juju-e4d256-prod-github-runner-207 kernel: [57172.586505] Aug 22 21:16:38 juju-e4d256-prod-github-runner-207 kernel: [57172.587357] Aug 22 21:16:38 juju-e4d256-prod-github-runner-207 kernel: [57172.588197] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 21:16:38 juju-e4d256-prod-github-runner-207 kernel: [57172.589245] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:16:38 juju-e4d256-prod-github-runner-207 kernel: [57172.590279] ? _raw_spin_lock+0x22/0x30 Aug 22 21:16:38 juju-e4d256-prod-github-runner-207 kernel: [57172.591230] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:16:38 juju-e4d256-prod-github-runner-207 kernel: [57172.592249] direct_page_fault+0x206/0x310 [kvm] Aug 22 21:16:38 juju-e4d256-prod-github-runner-207 kernel: [57172.593287] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 21:16:38 juju-e4d256-prod-github-runner-207 kernel: [57172.594381] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 21:16:38 juju-e4d256-prod-github-runner-207 kernel: [57172.595402] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 21:16:38 juju-e4d256-prod-github-runner-207 kernel: [57172.596382] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 21:16:38 juju-e4d256-prod-github-runner-207 kernel: [57172.597348] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 21:16:38 juju-e4d256-prod-github-runner-207 kernel: [57172.598327] handle_exit+0x98/0x230 [kvm_amd] Aug 22 21:16:38 juju-e4d256-prod-github-runner-207 kernel: [57172.599217] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 21:16:38 juju-e4d256-prod-github-runner-207 kernel: [57172.600133] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 21:16:38 juju-e4d256-prod-github-runner-207 kernel: [57172.601070] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 21:16:38 juju-e4d256-prod-github-runner-207 kernel: [57172.601973] vcpu_run+0x62/0x2c0 [kvm] Aug 22 21:16:38 juju-e4d256-prod-github-runner-207 kernel: [57172.602785] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 21:16:38 juju-e4d256-prod-github-runner-207 kernel: [57172.603598] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 21:16:38 juju-e4d256-prod-github-runner-207 kernel: [57172.604455] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 21:16:38 juju-e4d256-prod-github-runner-207 kernel: [57172.605269] ? __seccomp_filter+0x4a/0x4a0 Aug 22 21:16:38 juju-e4d256-prod-github-runner-207 kernel: [57172.606014] ? __fget_files+0x86/0xc0 Aug 22 21:16:38 juju-e4d256-prod-github-runner-207 kernel: [57172.606738] __x64_sys_ioctl+0x95/0xd0 Aug 22 21:16:38 juju-e4d256-prod-github-runner-207 kernel: [57172.607462] do_syscall_64+0x5c/0xc0 Aug 22 21:16:38 juju-e4d256-prod-github-runner-207 kernel: [57172.608220] ? do_futex+0x162/0x1f0 Aug 22 21:16:38 juju-e4d256-prod-github-runner-207 kernel: [57172.608918] ? __x64_sys_futex+0x78/0x1e0 Aug 22 21:16:38 juju-e4d256-prod-github-runner-207 kernel: [57172.609602] ? __secure_computing+0xa9/0x120 Aug 22 21:16:38 juju-e4d256-prod-github-runner-207 kernel: [57172.610299] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 21:16:38 juju-e4d256-prod-github-runner-207 kernel: [57172.611058] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:16:38 juju-e4d256-prod-github-runner-207 kernel: [57172.611782] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:16:38 juju-e4d256-prod-github-runner-207 kernel: [57172.612552] ? do_syscall_64+0x69/0xc0 Aug 22 21:16:38 juju-e4d256-prod-github-runner-207 kernel: [57172.613203] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:16:38 juju-e4d256-prod-github-runner-207 kernel: [57172.613906] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:16:38 juju-e4d256-prod-github-runner-207 kernel: [57172.614599] ? do_syscall_64+0x69/0xc0 Aug 22 21:16:38 juju-e4d256-prod-github-runner-207 kernel: [57172.615226] ? do_syscall_64+0x69/0xc0 Aug 22 21:16:38 juju-e4d256-prod-github-runner-207 kernel: [57172.615852] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 21:16:38 juju-e4d256-prod-github-runner-207 kernel: [57172.616609] RIP: 0033:0x7faa5d0edaff Aug 22 21:16:38 juju-e4d256-prod-github-runner-207 kernel: [57172.617288] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 21:16:38 juju-e4d256-prod-github-runner-207 kernel: [57172.619268] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 21:16:38 juju-e4d256-prod-github-runner-207 kernel: [57172.620198] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 21:16:38 juju-e4d256-prod-github-runner-207 kernel: [57172.621099] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 21:16:38 juju-e4d256-prod-github-runner-207 kernel: [57172.621987] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 21:16:38 juju-e4d256-prod-github-runner-207 kernel: [57172.622873] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 21:16:38 juju-e4d256-prod-github-runner-207 kernel: [57172.623760] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 21:16:38 juju-e4d256-prod-github-runner-207 kernel: [57172.624670] Aug 22 21:17:06 juju-e4d256-prod-github-runner-207 kernel: [57200.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 53164s! [qemu-system-x86:6715] Aug 22 21:17:06 juju-e4d256-prod-github-runner-207 kernel: [57200.543873] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 21:17:06 juju-e4d256-prod-github-runner-207 kernel: [57200.544195] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 21:17:06 juju-e4d256-prod-github-runner-207 kernel: [57200.556602] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 21:17:06 juju-e4d256-prod-github-runner-207 kernel: [57200.557922] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 21:17:06 juju-e4d256-prod-github-runner-207 kernel: [57200.559161] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:17:06 juju-e4d256-prod-github-runner-207 kernel: [57200.560265] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 21:17:06 juju-e4d256-prod-github-runner-207 kernel: [57200.562955] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 21:17:06 juju-e4d256-prod-github-runner-207 kernel: [57200.564055] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 21:17:06 juju-e4d256-prod-github-runner-207 kernel: [57200.565248] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 21:17:06 juju-e4d256-prod-github-runner-207 kernel: [57200.566555] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 21:17:06 juju-e4d256-prod-github-runner-207 kernel: [57200.567782] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 21:17:06 juju-e4d256-prod-github-runner-207 kernel: [57200.569002] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 21:17:06 juju-e4d256-prod-github-runner-207 kernel: [57200.570267] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 21:17:06 juju-e4d256-prod-github-runner-207 kernel: [57200.571566] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 21:17:06 juju-e4d256-prod-github-runner-207 kernel: [57200.572706] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 21:17:06 juju-e4d256-prod-github-runner-207 kernel: [57200.573902] Call Trace: Aug 22 21:17:06 juju-e4d256-prod-github-runner-207 kernel: [57200.574882] Aug 22 21:17:06 juju-e4d256-prod-github-runner-207 kernel: [57200.575782] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:17:06 juju-e4d256-prod-github-runner-207 kernel: [57200.576828] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:17:06 juju-e4d256-prod-github-runner-207 kernel: [57200.577863] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:17:06 juju-e4d256-prod-github-runner-207 kernel: [57200.578971] ? show_regs.part.0+0x23/0x29 Aug 22 21:17:06 juju-e4d256-prod-github-runner-207 kernel: [57200.579967] ? show_regs.cold+0x8/0xd Aug 22 21:17:06 juju-e4d256-prod-github-runner-207 kernel: [57200.580972] ? watchdog_timer_fn+0x1be/0x220 Aug 22 21:17:06 juju-e4d256-prod-github-runner-207 kernel: [57200.581988] ? lockup_detector_update_enable+0x60/0x60 Aug 22 21:17:06 juju-e4d256-prod-github-runner-207 kernel: [57200.583111] ? __hrtimer_run_queues+0x107/0x230 Aug 22 21:17:06 juju-e4d256-prod-github-runner-207 kernel: [57200.584179] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 21:17:06 juju-e4d256-prod-github-runner-207 kernel: [57200.585217] ? hrtimer_interrupt+0x101/0x220 Aug 22 21:17:06 juju-e4d256-prod-github-runner-207 kernel: [57200.586301] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 21:17:06 juju-e4d256-prod-github-runner-207 kernel: [57200.587376] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 21:17:06 juju-e4d256-prod-github-runner-207 kernel: [57200.588446] Aug 22 21:17:06 juju-e4d256-prod-github-runner-207 kernel: [57200.589300] Aug 22 21:17:06 juju-e4d256-prod-github-runner-207 kernel: [57200.590137] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 21:17:06 juju-e4d256-prod-github-runner-207 kernel: [57200.591167] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:17:06 juju-e4d256-prod-github-runner-207 kernel: [57200.592304] ? _raw_spin_lock+0x22/0x30 Aug 22 21:17:06 juju-e4d256-prod-github-runner-207 kernel: [57200.593266] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:17:06 juju-e4d256-prod-github-runner-207 kernel: [57200.594297] direct_page_fault+0x206/0x310 [kvm] Aug 22 21:17:06 juju-e4d256-prod-github-runner-207 kernel: [57200.595342] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 21:17:06 juju-e4d256-prod-github-runner-207 kernel: [57200.596390] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 21:17:06 juju-e4d256-prod-github-runner-207 kernel: [57200.597395] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 21:17:06 juju-e4d256-prod-github-runner-207 kernel: [57200.598405] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 21:17:06 juju-e4d256-prod-github-runner-207 kernel: [57200.599348] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 21:17:06 juju-e4d256-prod-github-runner-207 kernel: [57200.600340] handle_exit+0x98/0x230 [kvm_amd] Aug 22 21:17:06 juju-e4d256-prod-github-runner-207 kernel: [57200.601256] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 21:17:06 juju-e4d256-prod-github-runner-207 kernel: [57200.602197] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 21:17:06 juju-e4d256-prod-github-runner-207 kernel: [57200.603127] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 21:17:06 juju-e4d256-prod-github-runner-207 kernel: [57200.604029] vcpu_run+0x62/0x2c0 [kvm] Aug 22 21:17:06 juju-e4d256-prod-github-runner-207 kernel: [57200.604854] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 21:17:06 juju-e4d256-prod-github-runner-207 kernel: [57200.605659] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 21:17:06 juju-e4d256-prod-github-runner-207 kernel: [57200.606713] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 21:17:06 juju-e4d256-prod-github-runner-207 kernel: [57200.607661] ? __seccomp_filter+0x4a/0x4a0 Aug 22 21:17:06 juju-e4d256-prod-github-runner-207 kernel: [57200.608431] ? __fget_files+0x86/0xc0 Aug 22 21:17:06 juju-e4d256-prod-github-runner-207 kernel: [57200.609135] __x64_sys_ioctl+0x95/0xd0 Aug 22 21:17:06 juju-e4d256-prod-github-runner-207 kernel: [57200.609826] do_syscall_64+0x5c/0xc0 Aug 22 21:17:06 juju-e4d256-prod-github-runner-207 kernel: [57200.610492] ? do_futex+0x162/0x1f0 Aug 22 21:17:06 juju-e4d256-prod-github-runner-207 kernel: [57200.611138] ? __x64_sys_futex+0x78/0x1e0 Aug 22 21:17:06 juju-e4d256-prod-github-runner-207 kernel: [57200.611814] ? __secure_computing+0xa9/0x120 Aug 22 21:17:06 juju-e4d256-prod-github-runner-207 kernel: [57200.612539] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 21:17:06 juju-e4d256-prod-github-runner-207 kernel: [57200.613300] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:17:06 juju-e4d256-prod-github-runner-207 kernel: [57200.614020] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:17:06 juju-e4d256-prod-github-runner-207 kernel: [57200.614734] ? do_syscall_64+0x69/0xc0 Aug 22 21:17:06 juju-e4d256-prod-github-runner-207 kernel: [57200.615381] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:17:06 juju-e4d256-prod-github-runner-207 kernel: [57200.616116] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:17:06 juju-e4d256-prod-github-runner-207 kernel: [57200.616834] ? do_syscall_64+0x69/0xc0 Aug 22 21:17:06 juju-e4d256-prod-github-runner-207 kernel: [57200.617482] ? do_syscall_64+0x69/0xc0 Aug 22 21:17:06 juju-e4d256-prod-github-runner-207 kernel: [57200.618103] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 21:17:06 juju-e4d256-prod-github-runner-207 kernel: [57200.618812] RIP: 0033:0x7faa5d0edaff Aug 22 21:17:06 juju-e4d256-prod-github-runner-207 kernel: [57200.619466] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 21:17:06 juju-e4d256-prod-github-runner-207 kernel: [57200.621483] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 21:17:06 juju-e4d256-prod-github-runner-207 kernel: [57200.622391] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 21:17:06 juju-e4d256-prod-github-runner-207 kernel: [57200.623286] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 21:17:06 juju-e4d256-prod-github-runner-207 kernel: [57200.624189] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 21:17:06 juju-e4d256-prod-github-runner-207 kernel: [57200.625072] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 21:17:06 juju-e4d256-prod-github-runner-207 kernel: [57200.625963] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 21:17:06 juju-e4d256-prod-github-runner-207 kernel: [57200.626859] Aug 22 21:17:34 juju-e4d256-prod-github-runner-207 kernel: [57228.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 53190s! [qemu-system-x86:6715] Aug 22 21:17:34 juju-e4d256-prod-github-runner-207 kernel: [57228.543115] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 21:17:34 juju-e4d256-prod-github-runner-207 kernel: [57228.543192] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 21:17:34 juju-e4d256-prod-github-runner-207 kernel: [57228.555346] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 21:17:34 juju-e4d256-prod-github-runner-207 kernel: [57228.556633] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 21:17:34 juju-e4d256-prod-github-runner-207 kernel: [57228.557883] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:17:34 juju-e4d256-prod-github-runner-207 kernel: [57228.558986] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 21:17:34 juju-e4d256-prod-github-runner-207 kernel: [57228.561637] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 21:17:34 juju-e4d256-prod-github-runner-207 kernel: [57228.562795] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 21:17:34 juju-e4d256-prod-github-runner-207 kernel: [57228.564070] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 21:17:34 juju-e4d256-prod-github-runner-207 kernel: [57228.565248] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 21:17:34 juju-e4d256-prod-github-runner-207 kernel: [57228.566618] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 21:17:34 juju-e4d256-prod-github-runner-207 kernel: [57228.567829] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 21:17:34 juju-e4d256-prod-github-runner-207 kernel: [57228.569028] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 21:17:34 juju-e4d256-prod-github-runner-207 kernel: [57228.570459] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 21:17:34 juju-e4d256-prod-github-runner-207 kernel: [57228.571572] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 21:17:34 juju-e4d256-prod-github-runner-207 kernel: [57228.572811] Call Trace: Aug 22 21:17:34 juju-e4d256-prod-github-runner-207 kernel: [57228.573756] Aug 22 21:17:34 juju-e4d256-prod-github-runner-207 kernel: [57228.574662] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:17:34 juju-e4d256-prod-github-runner-207 kernel: [57228.575744] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:17:34 juju-e4d256-prod-github-runner-207 kernel: [57228.576817] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:17:34 juju-e4d256-prod-github-runner-207 kernel: [57228.577903] ? show_regs.part.0+0x23/0x29 Aug 22 21:17:34 juju-e4d256-prod-github-runner-207 kernel: [57228.578932] ? show_regs.cold+0x8/0xd Aug 22 21:17:34 juju-e4d256-prod-github-runner-207 kernel: [57228.579940] ? watchdog_timer_fn+0x1be/0x220 Aug 22 21:17:34 juju-e4d256-prod-github-runner-207 kernel: [57228.580958] ? lockup_detector_update_enable+0x60/0x60 Aug 22 21:17:34 juju-e4d256-prod-github-runner-207 kernel: [57228.582027] ? __hrtimer_run_queues+0x107/0x230 Aug 22 21:17:34 juju-e4d256-prod-github-runner-207 kernel: [57228.583056] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 21:17:34 juju-e4d256-prod-github-runner-207 kernel: [57228.584109] ? hrtimer_interrupt+0x101/0x220 Aug 22 21:17:34 juju-e4d256-prod-github-runner-207 kernel: [57228.585138] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 21:17:34 juju-e4d256-prod-github-runner-207 kernel: [57228.586277] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 21:17:34 juju-e4d256-prod-github-runner-207 kernel: [57228.587370] Aug 22 21:17:34 juju-e4d256-prod-github-runner-207 kernel: [57228.588283] Aug 22 21:17:34 juju-e4d256-prod-github-runner-207 kernel: [57228.589133] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 21:17:34 juju-e4d256-prod-github-runner-207 kernel: [57228.590178] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:17:34 juju-e4d256-prod-github-runner-207 kernel: [57228.591226] ? _raw_spin_lock+0x22/0x30 Aug 22 21:17:34 juju-e4d256-prod-github-runner-207 kernel: [57228.592190] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:17:34 juju-e4d256-prod-github-runner-207 kernel: [57228.593218] direct_page_fault+0x206/0x310 [kvm] Aug 22 21:17:34 juju-e4d256-prod-github-runner-207 kernel: [57228.594269] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 21:17:34 juju-e4d256-prod-github-runner-207 kernel: [57228.595288] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 21:17:34 juju-e4d256-prod-github-runner-207 kernel: [57228.596308] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 21:17:34 juju-e4d256-prod-github-runner-207 kernel: [57228.597287] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 21:17:34 juju-e4d256-prod-github-runner-207 kernel: [57228.598233] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 21:17:34 juju-e4d256-prod-github-runner-207 kernel: [57228.599220] handle_exit+0x98/0x230 [kvm_amd] Aug 22 21:17:34 juju-e4d256-prod-github-runner-207 kernel: [57228.600136] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 21:17:34 juju-e4d256-prod-github-runner-207 kernel: [57228.601059] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 21:17:34 juju-e4d256-prod-github-runner-207 kernel: [57228.601989] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 21:17:34 juju-e4d256-prod-github-runner-207 kernel: [57228.602897] vcpu_run+0x62/0x2c0 [kvm] Aug 22 21:17:34 juju-e4d256-prod-github-runner-207 kernel: [57228.603717] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 21:17:34 juju-e4d256-prod-github-runner-207 kernel: [57228.604540] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 21:17:34 juju-e4d256-prod-github-runner-207 kernel: [57228.605402] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 21:17:34 juju-e4d256-prod-github-runner-207 kernel: [57228.606213] ? __seccomp_filter+0x4a/0x4a0 Aug 22 21:17:34 juju-e4d256-prod-github-runner-207 kernel: [57228.606956] ? __fget_files+0x86/0xc0 Aug 22 21:17:34 juju-e4d256-prod-github-runner-207 kernel: [57228.607670] __x64_sys_ioctl+0x95/0xd0 Aug 22 21:17:34 juju-e4d256-prod-github-runner-207 kernel: [57228.608385] do_syscall_64+0x5c/0xc0 Aug 22 21:17:34 juju-e4d256-prod-github-runner-207 kernel: [57228.609063] ? do_futex+0x162/0x1f0 Aug 22 21:17:34 juju-e4d256-prod-github-runner-207 kernel: [57228.609726] ? __x64_sys_futex+0x78/0x1e0 Aug 22 21:17:34 juju-e4d256-prod-github-runner-207 kernel: [57228.610403] ? __secure_computing+0xa9/0x120 Aug 22 21:17:34 juju-e4d256-prod-github-runner-207 kernel: [57228.611166] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 21:17:34 juju-e4d256-prod-github-runner-207 kernel: [57228.611993] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:17:34 juju-e4d256-prod-github-runner-207 kernel: [57228.612780] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:17:34 juju-e4d256-prod-github-runner-207 kernel: [57228.613555] ? do_syscall_64+0x69/0xc0 Aug 22 21:17:34 juju-e4d256-prod-github-runner-207 kernel: [57228.614217] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:17:34 juju-e4d256-prod-github-runner-207 kernel: [57228.614931] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:17:34 juju-e4d256-prod-github-runner-207 kernel: [57228.615630] ? do_syscall_64+0x69/0xc0 Aug 22 21:17:34 juju-e4d256-prod-github-runner-207 kernel: [57228.616294] ? do_syscall_64+0x69/0xc0 Aug 22 21:17:34 juju-e4d256-prod-github-runner-207 kernel: [57228.616942] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 21:17:34 juju-e4d256-prod-github-runner-207 kernel: [57228.617650] RIP: 0033:0x7faa5d0edaff Aug 22 21:17:34 juju-e4d256-prod-github-runner-207 kernel: [57228.618279] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 21:17:34 juju-e4d256-prod-github-runner-207 kernel: [57228.620313] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 21:17:34 juju-e4d256-prod-github-runner-207 kernel: [57228.621230] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 21:17:34 juju-e4d256-prod-github-runner-207 kernel: [57228.622122] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 21:17:34 juju-e4d256-prod-github-runner-207 kernel: [57228.623008] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 21:17:34 juju-e4d256-prod-github-runner-207 kernel: [57228.623909] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 21:17:34 juju-e4d256-prod-github-runner-207 kernel: [57228.624825] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 21:17:34 juju-e4d256-prod-github-runner-207 kernel: [57228.625726] Aug 22 21:17:47 juju-e4d256-prod-github-runner-207 kernel: [57241.004708] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 21:17:47 juju-e4d256-prod-github-runner-207 kernel: [57241.005692] rcu: 1-....: (14235994 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=6879929 Aug 22 21:17:47 juju-e4d256-prod-github-runner-207 kernel: [57241.006880] (t=14280951 jiffies g=23269 q=52253) Aug 22 21:17:47 juju-e4d256-prod-github-runner-207 kernel: [57241.007701] NMI backtrace for cpu 1 Aug 22 21:17:47 juju-e4d256-prod-github-runner-207 kernel: [57241.008426] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 21:17:47 juju-e4d256-prod-github-runner-207 kernel: [57241.009583] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 21:17:47 juju-e4d256-prod-github-runner-207 kernel: [57241.010684] Call Trace: Aug 22 21:17:47 juju-e4d256-prod-github-runner-207 kernel: [57241.011372] Aug 22 21:17:47 juju-e4d256-prod-github-runner-207 kernel: [57241.012040] show_stack+0x52/0x5c Aug 22 21:17:47 juju-e4d256-prod-github-runner-207 kernel: [57241.012780] dump_stack_lvl+0x4a/0x63 Aug 22 21:17:47 juju-e4d256-prod-github-runner-207 kernel: [57241.013561] dump_stack+0x10/0x16 Aug 22 21:17:47 juju-e4d256-prod-github-runner-207 kernel: [57241.014295] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 21:17:47 juju-e4d256-prod-github-runner-207 kernel: [57241.015136] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 21:17:47 juju-e4d256-prod-github-runner-207 kernel: [57241.015959] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 21:17:47 juju-e4d256-prod-github-runner-207 kernel: [57241.016802] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 21:17:47 juju-e4d256-prod-github-runner-207 kernel: [57241.017685] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 21:17:47 juju-e4d256-prod-github-runner-207 kernel: [57241.018508] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 21:17:47 juju-e4d256-prod-github-runner-207 kernel: [57241.019293] print_cpu_stall.cold+0x2f/0xe2 Aug 22 21:17:47 juju-e4d256-prod-github-runner-207 kernel: [57241.020090] ? timekeeping_update+0xf7/0x150 Aug 22 21:17:47 juju-e4d256-prod-github-runner-207 kernel: [57241.020879] check_cpu_stall+0x109/0x270 Aug 22 21:17:47 juju-e4d256-prod-github-runner-207 kernel: [57241.021643] rcu_sched_clock_irq+0x9a/0x250 Aug 22 21:17:47 juju-e4d256-prod-github-runner-207 kernel: [57241.022436] update_process_times+0x94/0xd0 Aug 22 21:17:47 juju-e4d256-prod-github-runner-207 kernel: [57241.023211] tick_sched_handle+0x29/0x70 Aug 22 21:17:47 juju-e4d256-prod-github-runner-207 kernel: [57241.023996] tick_sched_timer+0x8c/0xc0 Aug 22 21:17:47 juju-e4d256-prod-github-runner-207 kernel: [57241.024747] ? tick_nohz_handler+0xb0/0xb0 Aug 22 21:17:47 juju-e4d256-prod-github-runner-207 kernel: [57241.025526] __hrtimer_run_queues+0x107/0x230 Aug 22 21:17:47 juju-e4d256-prod-github-runner-207 kernel: [57241.026318] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 21:17:47 juju-e4d256-prod-github-runner-207 kernel: [57241.027148] hrtimer_interrupt+0x101/0x220 Aug 22 21:17:47 juju-e4d256-prod-github-runner-207 kernel: [57241.027957] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 21:17:47 juju-e4d256-prod-github-runner-207 kernel: [57241.028807] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 21:17:47 juju-e4d256-prod-github-runner-207 kernel: [57241.029626] Aug 22 21:17:47 juju-e4d256-prod-github-runner-207 kernel: [57241.030286] Aug 22 21:17:47 juju-e4d256-prod-github-runner-207 kernel: [57241.030932] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 21:17:47 juju-e4d256-prod-github-runner-207 kernel: [57241.031835] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:17:47 juju-e4d256-prod-github-runner-207 kernel: [57241.032740] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 21:17:47 juju-e4d256-prod-github-runner-207 kernel: [57241.034995] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 21:17:47 juju-e4d256-prod-github-runner-207 kernel: [57241.035918] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 21:17:47 juju-e4d256-prod-github-runner-207 kernel: [57241.036964] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 21:17:47 juju-e4d256-prod-github-runner-207 kernel: [57241.037995] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 21:17:47 juju-e4d256-prod-github-runner-207 kernel: [57241.038984] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 21:17:47 juju-e4d256-prod-github-runner-207 kernel: [57241.039990] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 21:17:47 juju-e4d256-prod-github-runner-207 kernel: [57241.040960] ? _raw_spin_lock+0x22/0x30 Aug 22 21:17:47 juju-e4d256-prod-github-runner-207 kernel: [57241.041727] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:17:47 juju-e4d256-prod-github-runner-207 kernel: [57241.042577] direct_page_fault+0x206/0x310 [kvm] Aug 22 21:17:47 juju-e4d256-prod-github-runner-207 kernel: [57241.043430] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 21:17:47 juju-e4d256-prod-github-runner-207 kernel: [57241.044283] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 21:17:47 juju-e4d256-prod-github-runner-207 kernel: [57241.045118] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 21:17:47 juju-e4d256-prod-github-runner-207 kernel: [57241.046009] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 21:17:47 juju-e4d256-prod-github-runner-207 kernel: [57241.046815] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 21:17:47 juju-e4d256-prod-github-runner-207 kernel: [57241.047682] handle_exit+0x98/0x230 [kvm_amd] Aug 22 21:17:47 juju-e4d256-prod-github-runner-207 kernel: [57241.048454] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 21:17:47 juju-e4d256-prod-github-runner-207 kernel: [57241.049267] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 21:17:47 juju-e4d256-prod-github-runner-207 kernel: [57241.050085] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 21:17:47 juju-e4d256-prod-github-runner-207 kernel: [57241.050889] vcpu_run+0x62/0x2c0 [kvm] Aug 22 21:17:47 juju-e4d256-prod-github-runner-207 kernel: [57241.051615] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 21:17:47 juju-e4d256-prod-github-runner-207 kernel: [57241.052387] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 21:17:47 juju-e4d256-prod-github-runner-207 kernel: [57241.053206] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 21:17:47 juju-e4d256-prod-github-runner-207 kernel: [57241.053998] ? __seccomp_filter+0x4a/0x4a0 Aug 22 21:17:47 juju-e4d256-prod-github-runner-207 kernel: [57241.054736] ? __fget_files+0x86/0xc0 Aug 22 21:17:47 juju-e4d256-prod-github-runner-207 kernel: [57241.055448] __x64_sys_ioctl+0x95/0xd0 Aug 22 21:17:47 juju-e4d256-prod-github-runner-207 kernel: [57241.056176] do_syscall_64+0x5c/0xc0 Aug 22 21:17:47 juju-e4d256-prod-github-runner-207 kernel: [57241.056871] ? do_futex+0x162/0x1f0 Aug 22 21:17:47 juju-e4d256-prod-github-runner-207 kernel: [57241.057558] ? __x64_sys_futex+0x78/0x1e0 Aug 22 21:17:47 juju-e4d256-prod-github-runner-207 kernel: [57241.058272] ? __secure_computing+0xa9/0x120 Aug 22 21:17:47 juju-e4d256-prod-github-runner-207 kernel: [57241.059011] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 21:17:47 juju-e4d256-prod-github-runner-207 kernel: [57241.059839] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:17:47 juju-e4d256-prod-github-runner-207 kernel: [57241.060611] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:17:47 juju-e4d256-prod-github-runner-207 kernel: [57241.061385] ? do_syscall_64+0x69/0xc0 Aug 22 21:17:47 juju-e4d256-prod-github-runner-207 kernel: [57241.062086] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:17:47 juju-e4d256-prod-github-runner-207 kernel: [57241.062858] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:17:47 juju-e4d256-prod-github-runner-207 kernel: [57241.063648] ? do_syscall_64+0x69/0xc0 Aug 22 21:17:47 juju-e4d256-prod-github-runner-207 kernel: [57241.064356] ? do_syscall_64+0x69/0xc0 Aug 22 21:17:47 juju-e4d256-prod-github-runner-207 kernel: [57241.065058] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 21:17:47 juju-e4d256-prod-github-runner-207 kernel: [57241.065844] RIP: 0033:0x7faa5d0edaff Aug 22 21:17:47 juju-e4d256-prod-github-runner-207 kernel: [57241.066540] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 21:17:47 juju-e4d256-prod-github-runner-207 kernel: [57241.068743] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 21:17:47 juju-e4d256-prod-github-runner-207 kernel: [57241.069742] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 21:17:47 juju-e4d256-prod-github-runner-207 kernel: [57241.070710] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 21:17:47 juju-e4d256-prod-github-runner-207 kernel: [57241.071691] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 21:17:47 juju-e4d256-prod-github-runner-207 kernel: [57241.072653] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 21:17:47 juju-e4d256-prod-github-runner-207 kernel: [57241.073599] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 21:17:47 juju-e4d256-prod-github-runner-207 kernel: [57241.074529] Aug 22 21:18:14 juju-e4d256-prod-github-runner-207 kernel: [57268.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 53227s! [qemu-system-x86:6715] Aug 22 21:18:14 juju-e4d256-prod-github-runner-207 kernel: [57268.543137] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 21:18:14 juju-e4d256-prod-github-runner-207 kernel: [57268.543213] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 21:18:14 juju-e4d256-prod-github-runner-207 kernel: [57268.555327] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 21:18:14 juju-e4d256-prod-github-runner-207 kernel: [57268.556591] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 21:18:14 juju-e4d256-prod-github-runner-207 kernel: [57268.557979] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:18:14 juju-e4d256-prod-github-runner-207 kernel: [57268.559032] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 21:18:14 juju-e4d256-prod-github-runner-207 kernel: [57268.561595] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 21:18:14 juju-e4d256-prod-github-runner-207 kernel: [57268.562646] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 21:18:14 juju-e4d256-prod-github-runner-207 kernel: [57268.563854] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 21:18:14 juju-e4d256-prod-github-runner-207 kernel: [57268.565108] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 21:18:14 juju-e4d256-prod-github-runner-207 kernel: [57268.566279] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 21:18:14 juju-e4d256-prod-github-runner-207 kernel: [57268.567465] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 21:18:14 juju-e4d256-prod-github-runner-207 kernel: [57268.568659] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 21:18:14 juju-e4d256-prod-github-runner-207 kernel: [57268.569918] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 21:18:14 juju-e4d256-prod-github-runner-207 kernel: [57268.571044] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 21:18:14 juju-e4d256-prod-github-runner-207 kernel: [57268.572251] Call Trace: Aug 22 21:18:14 juju-e4d256-prod-github-runner-207 kernel: [57268.573169] Aug 22 21:18:14 juju-e4d256-prod-github-runner-207 kernel: [57268.574054] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:18:14 juju-e4d256-prod-github-runner-207 kernel: [57268.575094] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:18:14 juju-e4d256-prod-github-runner-207 kernel: [57268.576131] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:18:14 juju-e4d256-prod-github-runner-207 kernel: [57268.577205] ? show_regs.part.0+0x23/0x29 Aug 22 21:18:14 juju-e4d256-prod-github-runner-207 kernel: [57268.578202] ? show_regs.cold+0x8/0xd Aug 22 21:18:14 juju-e4d256-prod-github-runner-207 kernel: [57268.579172] ? watchdog_timer_fn+0x1be/0x220 Aug 22 21:18:14 juju-e4d256-prod-github-runner-207 kernel: [57268.580192] ? lockup_detector_update_enable+0x60/0x60 Aug 22 21:18:14 juju-e4d256-prod-github-runner-207 kernel: [57268.581253] ? __hrtimer_run_queues+0x107/0x230 Aug 22 21:18:14 juju-e4d256-prod-github-runner-207 kernel: [57268.582284] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 21:18:14 juju-e4d256-prod-github-runner-207 kernel: [57268.583320] ? hrtimer_interrupt+0x101/0x220 Aug 22 21:18:14 juju-e4d256-prod-github-runner-207 kernel: [57268.584341] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 21:18:14 juju-e4d256-prod-github-runner-207 kernel: [57268.585408] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 21:18:14 juju-e4d256-prod-github-runner-207 kernel: [57268.586465] Aug 22 21:18:14 juju-e4d256-prod-github-runner-207 kernel: [57268.587327] Aug 22 21:18:14 juju-e4d256-prod-github-runner-207 kernel: [57268.588165] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 21:18:14 juju-e4d256-prod-github-runner-207 kernel: [57268.589198] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:18:14 juju-e4d256-prod-github-runner-207 kernel: [57268.590237] ? _raw_spin_lock+0x22/0x30 Aug 22 21:18:14 juju-e4d256-prod-github-runner-207 kernel: [57268.591181] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:18:14 juju-e4d256-prod-github-runner-207 kernel: [57268.592213] direct_page_fault+0x206/0x310 [kvm] Aug 22 21:18:14 juju-e4d256-prod-github-runner-207 kernel: [57268.593238] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 21:18:14 juju-e4d256-prod-github-runner-207 kernel: [57268.594248] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 21:18:14 juju-e4d256-prod-github-runner-207 kernel: [57268.595249] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 21:18:14 juju-e4d256-prod-github-runner-207 kernel: [57268.596231] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 21:18:14 juju-e4d256-prod-github-runner-207 kernel: [57268.597177] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 21:18:14 juju-e4d256-prod-github-runner-207 kernel: [57268.598182] handle_exit+0x98/0x230 [kvm_amd] Aug 22 21:18:14 juju-e4d256-prod-github-runner-207 kernel: [57268.599080] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 21:18:14 juju-e4d256-prod-github-runner-207 kernel: [57268.600037] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 21:18:14 juju-e4d256-prod-github-runner-207 kernel: [57268.600968] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 21:18:14 juju-e4d256-prod-github-runner-207 kernel: [57268.601878] vcpu_run+0x62/0x2c0 [kvm] Aug 22 21:18:14 juju-e4d256-prod-github-runner-207 kernel: [57268.602696] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 21:18:14 juju-e4d256-prod-github-runner-207 kernel: [57268.603561] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 21:18:14 juju-e4d256-prod-github-runner-207 kernel: [57268.604428] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 21:18:14 juju-e4d256-prod-github-runner-207 kernel: [57268.605229] ? __seccomp_filter+0x4a/0x4a0 Aug 22 21:18:14 juju-e4d256-prod-github-runner-207 kernel: [57268.605977] ? __fget_files+0x86/0xc0 Aug 22 21:18:14 juju-e4d256-prod-github-runner-207 kernel: [57268.606694] __x64_sys_ioctl+0x95/0xd0 Aug 22 21:18:14 juju-e4d256-prod-github-runner-207 kernel: [57268.607459] do_syscall_64+0x5c/0xc0 Aug 22 21:18:14 juju-e4d256-prod-github-runner-207 kernel: [57268.608169] ? do_futex+0x162/0x1f0 Aug 22 21:18:14 juju-e4d256-prod-github-runner-207 kernel: [57268.608831] ? __x64_sys_futex+0x78/0x1e0 Aug 22 21:18:14 juju-e4d256-prod-github-runner-207 kernel: [57268.609504] ? __secure_computing+0xa9/0x120 Aug 22 21:18:14 juju-e4d256-prod-github-runner-207 kernel: [57268.610198] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 21:18:14 juju-e4d256-prod-github-runner-207 kernel: [57268.610979] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:18:14 juju-e4d256-prod-github-runner-207 kernel: [57268.611720] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:18:14 juju-e4d256-prod-github-runner-207 kernel: [57268.612440] ? do_syscall_64+0x69/0xc0 Aug 22 21:18:14 juju-e4d256-prod-github-runner-207 kernel: [57268.613088] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:18:14 juju-e4d256-prod-github-runner-207 kernel: [57268.613801] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:18:14 juju-e4d256-prod-github-runner-207 kernel: [57268.614497] ? do_syscall_64+0x69/0xc0 Aug 22 21:18:14 juju-e4d256-prod-github-runner-207 kernel: [57268.615127] ? do_syscall_64+0x69/0xc0 Aug 22 21:18:14 juju-e4d256-prod-github-runner-207 kernel: [57268.615827] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 21:18:14 juju-e4d256-prod-github-runner-207 kernel: [57268.616551] RIP: 0033:0x7faa5d0edaff Aug 22 21:18:14 juju-e4d256-prod-github-runner-207 kernel: [57268.617180] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 21:18:14 juju-e4d256-prod-github-runner-207 kernel: [57268.619181] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 21:18:14 juju-e4d256-prod-github-runner-207 kernel: [57268.620140] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 21:18:14 juju-e4d256-prod-github-runner-207 kernel: [57268.621037] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 21:18:14 juju-e4d256-prod-github-runner-207 kernel: [57268.621925] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 21:18:14 juju-e4d256-prod-github-runner-207 kernel: [57268.622819] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 21:18:14 juju-e4d256-prod-github-runner-207 kernel: [57268.623723] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 21:18:14 juju-e4d256-prod-github-runner-207 kernel: [57268.624647] Aug 22 21:18:42 juju-e4d256-prod-github-runner-207 kernel: [57296.541984] watchdog: BUG: soft lockup - CPU#1 stuck for 53253s! [qemu-system-x86:6715] Aug 22 21:18:42 juju-e4d256-prod-github-runner-207 kernel: [57296.545786] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 21:18:42 juju-e4d256-prod-github-runner-207 kernel: [57296.546146] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 21:18:42 juju-e4d256-prod-github-runner-207 kernel: [57296.558564] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 21:18:42 juju-e4d256-prod-github-runner-207 kernel: [57296.559854] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 21:18:42 juju-e4d256-prod-github-runner-207 kernel: [57296.561084] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:18:42 juju-e4d256-prod-github-runner-207 kernel: [57296.562143] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 21:18:42 juju-e4d256-prod-github-runner-207 kernel: [57296.564714] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 21:18:42 juju-e4d256-prod-github-runner-207 kernel: [57296.565766] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 21:18:42 juju-e4d256-prod-github-runner-207 kernel: [57296.566939] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 21:18:42 juju-e4d256-prod-github-runner-207 kernel: [57296.568103] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 21:18:42 juju-e4d256-prod-github-runner-207 kernel: [57296.569261] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 21:18:42 juju-e4d256-prod-github-runner-207 kernel: [57296.570422] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 21:18:42 juju-e4d256-prod-github-runner-207 kernel: [57296.571604] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 21:18:42 juju-e4d256-prod-github-runner-207 kernel: [57296.572856] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 21:18:42 juju-e4d256-prod-github-runner-207 kernel: [57296.573966] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 21:18:42 juju-e4d256-prod-github-runner-207 kernel: [57296.575204] Call Trace: Aug 22 21:18:42 juju-e4d256-prod-github-runner-207 kernel: [57296.576118] Aug 22 21:18:42 juju-e4d256-prod-github-runner-207 kernel: [57296.577018] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:18:42 juju-e4d256-prod-github-runner-207 kernel: [57296.578047] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:18:42 juju-e4d256-prod-github-runner-207 kernel: [57296.579084] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:18:42 juju-e4d256-prod-github-runner-207 kernel: [57296.580182] ? show_regs.part.0+0x23/0x29 Aug 22 21:18:42 juju-e4d256-prod-github-runner-207 kernel: [57296.581179] ? show_regs.cold+0x8/0xd Aug 22 21:18:42 juju-e4d256-prod-github-runner-207 kernel: [57296.582149] ? watchdog_timer_fn+0x1be/0x220 Aug 22 21:18:42 juju-e4d256-prod-github-runner-207 kernel: [57296.583171] ? lockup_detector_update_enable+0x60/0x60 Aug 22 21:18:42 juju-e4d256-prod-github-runner-207 kernel: [57296.584239] ? __hrtimer_run_queues+0x107/0x230 Aug 22 21:18:42 juju-e4d256-prod-github-runner-207 kernel: [57296.585270] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 21:18:42 juju-e4d256-prod-github-runner-207 kernel: [57296.586353] ? hrtimer_interrupt+0x101/0x220 Aug 22 21:18:42 juju-e4d256-prod-github-runner-207 kernel: [57296.587408] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 21:18:42 juju-e4d256-prod-github-runner-207 kernel: [57296.588659] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 21:18:42 juju-e4d256-prod-github-runner-207 kernel: [57296.589743] Aug 22 21:18:42 juju-e4d256-prod-github-runner-207 kernel: [57296.590764] Aug 22 21:18:42 juju-e4d256-prod-github-runner-207 kernel: [57296.591633] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 21:18:42 juju-e4d256-prod-github-runner-207 kernel: [57296.592673] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:18:42 juju-e4d256-prod-github-runner-207 kernel: [57296.593713] ? _raw_spin_lock+0x22/0x30 Aug 22 21:18:42 juju-e4d256-prod-github-runner-207 kernel: [57296.594685] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:18:42 juju-e4d256-prod-github-runner-207 kernel: [57296.595740] direct_page_fault+0x206/0x310 [kvm] Aug 22 21:18:42 juju-e4d256-prod-github-runner-207 kernel: [57296.596770] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 21:18:42 juju-e4d256-prod-github-runner-207 kernel: [57296.597784] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 21:18:42 juju-e4d256-prod-github-runner-207 kernel: [57296.598784] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 21:18:42 juju-e4d256-prod-github-runner-207 kernel: [57296.599817] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 21:18:42 juju-e4d256-prod-github-runner-207 kernel: [57296.600766] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 21:18:42 juju-e4d256-prod-github-runner-207 kernel: [57296.601746] handle_exit+0x98/0x230 [kvm_amd] Aug 22 21:18:42 juju-e4d256-prod-github-runner-207 kernel: [57296.602643] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 21:18:42 juju-e4d256-prod-github-runner-207 kernel: [57296.603587] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 21:18:42 juju-e4d256-prod-github-runner-207 kernel: [57296.604515] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 21:18:42 juju-e4d256-prod-github-runner-207 kernel: [57296.605426] vcpu_run+0x62/0x2c0 [kvm] Aug 22 21:18:42 juju-e4d256-prod-github-runner-207 kernel: [57296.606244] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 21:18:42 juju-e4d256-prod-github-runner-207 kernel: [57296.607072] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 21:18:42 juju-e4d256-prod-github-runner-207 kernel: [57296.607928] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 21:18:42 juju-e4d256-prod-github-runner-207 kernel: [57296.608732] ? __seccomp_filter+0x4a/0x4a0 Aug 22 21:18:42 juju-e4d256-prod-github-runner-207 kernel: [57296.609487] ? __fget_files+0x86/0xc0 Aug 22 21:18:42 juju-e4d256-prod-github-runner-207 kernel: [57296.610194] __x64_sys_ioctl+0x95/0xd0 Aug 22 21:18:42 juju-e4d256-prod-github-runner-207 kernel: [57296.610891] do_syscall_64+0x5c/0xc0 Aug 22 21:18:42 juju-e4d256-prod-github-runner-207 kernel: [57296.611576] ? do_futex+0x162/0x1f0 Aug 22 21:18:42 juju-e4d256-prod-github-runner-207 kernel: [57296.612229] ? __x64_sys_futex+0x78/0x1e0 Aug 22 21:18:42 juju-e4d256-prod-github-runner-207 kernel: [57296.612905] ? __secure_computing+0xa9/0x120 Aug 22 21:18:42 juju-e4d256-prod-github-runner-207 kernel: [57296.613599] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 21:18:42 juju-e4d256-prod-github-runner-207 kernel: [57296.614376] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:18:42 juju-e4d256-prod-github-runner-207 kernel: [57296.615122] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:18:42 juju-e4d256-prod-github-runner-207 kernel: [57296.615844] ? do_syscall_64+0x69/0xc0 Aug 22 21:18:42 juju-e4d256-prod-github-runner-207 kernel: [57296.616494] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:18:42 juju-e4d256-prod-github-runner-207 kernel: [57296.617200] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:18:42 juju-e4d256-prod-github-runner-207 kernel: [57296.617896] ? do_syscall_64+0x69/0xc0 Aug 22 21:18:42 juju-e4d256-prod-github-runner-207 kernel: [57296.618526] ? do_syscall_64+0x69/0xc0 Aug 22 21:18:42 juju-e4d256-prod-github-runner-207 kernel: [57296.619164] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 21:18:42 juju-e4d256-prod-github-runner-207 kernel: [57296.619877] RIP: 0033:0x7faa5d0edaff Aug 22 21:18:42 juju-e4d256-prod-github-runner-207 kernel: [57296.620550] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 21:18:42 juju-e4d256-prod-github-runner-207 kernel: [57296.622553] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 21:18:42 juju-e4d256-prod-github-runner-207 kernel: [57296.623483] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 21:18:42 juju-e4d256-prod-github-runner-207 kernel: [57296.624380] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 21:18:42 juju-e4d256-prod-github-runner-207 kernel: [57296.625284] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 21:18:42 juju-e4d256-prod-github-runner-207 kernel: [57296.626184] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 21:18:42 juju-e4d256-prod-github-runner-207 kernel: [57296.627094] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 21:18:42 juju-e4d256-prod-github-runner-207 kernel: [57296.628042] Aug 22 21:19:10 juju-e4d256-prod-github-runner-207 kernel: [57324.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 53279s! [qemu-system-x86:6715] Aug 22 21:19:10 juju-e4d256-prod-github-runner-207 kernel: [57324.543846] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 21:19:10 juju-e4d256-prod-github-runner-207 kernel: [57324.544146] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 21:19:10 juju-e4d256-prod-github-runner-207 kernel: [57324.556302] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 21:19:10 juju-e4d256-prod-github-runner-207 kernel: [57324.557579] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 21:19:10 juju-e4d256-prod-github-runner-207 kernel: [57324.558818] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:19:10 juju-e4d256-prod-github-runner-207 kernel: [57324.559873] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 21:19:10 juju-e4d256-prod-github-runner-207 kernel: [57324.562433] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 21:19:10 juju-e4d256-prod-github-runner-207 kernel: [57324.563521] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 21:19:10 juju-e4d256-prod-github-runner-207 kernel: [57324.564715] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 21:19:10 juju-e4d256-prod-github-runner-207 kernel: [57324.565913] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 21:19:10 juju-e4d256-prod-github-runner-207 kernel: [57324.567117] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 21:19:10 juju-e4d256-prod-github-runner-207 kernel: [57324.568286] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 21:19:10 juju-e4d256-prod-github-runner-207 kernel: [57324.569558] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 21:19:10 juju-e4d256-prod-github-runner-207 kernel: [57324.570823] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 21:19:10 juju-e4d256-prod-github-runner-207 kernel: [57324.571925] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 21:19:10 juju-e4d256-prod-github-runner-207 kernel: [57324.573150] Call Trace: Aug 22 21:19:10 juju-e4d256-prod-github-runner-207 kernel: [57324.574128] Aug 22 21:19:10 juju-e4d256-prod-github-runner-207 kernel: [57324.575143] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:19:10 juju-e4d256-prod-github-runner-207 kernel: [57324.576243] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:19:10 juju-e4d256-prod-github-runner-207 kernel: [57324.577314] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:19:10 juju-e4d256-prod-github-runner-207 kernel: [57324.578415] ? show_regs.part.0+0x23/0x29 Aug 22 21:19:10 juju-e4d256-prod-github-runner-207 kernel: [57324.579439] ? show_regs.cold+0x8/0xd Aug 22 21:19:10 juju-e4d256-prod-github-runner-207 kernel: [57324.580411] ? watchdog_timer_fn+0x1be/0x220 Aug 22 21:19:10 juju-e4d256-prod-github-runner-207 kernel: [57324.581463] ? lockup_detector_update_enable+0x60/0x60 Aug 22 21:19:10 juju-e4d256-prod-github-runner-207 kernel: [57324.582564] ? __hrtimer_run_queues+0x107/0x230 Aug 22 21:19:10 juju-e4d256-prod-github-runner-207 kernel: [57324.583636] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 21:19:10 juju-e4d256-prod-github-runner-207 kernel: [57324.584667] ? hrtimer_interrupt+0x101/0x220 Aug 22 21:19:10 juju-e4d256-prod-github-runner-207 kernel: [57324.585686] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 21:19:10 juju-e4d256-prod-github-runner-207 kernel: [57324.586775] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 21:19:10 juju-e4d256-prod-github-runner-207 kernel: [57324.587852] Aug 22 21:19:10 juju-e4d256-prod-github-runner-207 kernel: [57324.588712] Aug 22 21:19:10 juju-e4d256-prod-github-runner-207 kernel: [57324.589560] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 21:19:10 juju-e4d256-prod-github-runner-207 kernel: [57324.590604] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:19:10 juju-e4d256-prod-github-runner-207 kernel: [57324.591656] ? _raw_spin_lock+0x22/0x30 Aug 22 21:19:10 juju-e4d256-prod-github-runner-207 kernel: [57324.592613] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:19:10 juju-e4d256-prod-github-runner-207 kernel: [57324.593636] direct_page_fault+0x206/0x310 [kvm] Aug 22 21:19:10 juju-e4d256-prod-github-runner-207 kernel: [57324.594681] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 21:19:10 juju-e4d256-prod-github-runner-207 kernel: [57324.595708] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 21:19:10 juju-e4d256-prod-github-runner-207 kernel: [57324.596719] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 21:19:10 juju-e4d256-prod-github-runner-207 kernel: [57324.597739] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 21:19:10 juju-e4d256-prod-github-runner-207 kernel: [57324.598761] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 21:19:10 juju-e4d256-prod-github-runner-207 kernel: [57324.599979] handle_exit+0x98/0x230 [kvm_amd] Aug 22 21:19:10 juju-e4d256-prod-github-runner-207 kernel: [57324.600980] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 21:19:10 juju-e4d256-prod-github-runner-207 kernel: [57324.601993] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 21:19:10 juju-e4d256-prod-github-runner-207 kernel: [57324.602992] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 21:19:10 juju-e4d256-prod-github-runner-207 kernel: [57324.603947] vcpu_run+0x62/0x2c0 [kvm] Aug 22 21:19:10 juju-e4d256-prod-github-runner-207 kernel: [57324.604765] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 21:19:10 juju-e4d256-prod-github-runner-207 kernel: [57324.605576] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 21:19:10 juju-e4d256-prod-github-runner-207 kernel: [57324.606434] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 21:19:10 juju-e4d256-prod-github-runner-207 kernel: [57324.607249] ? __seccomp_filter+0x4a/0x4a0 Aug 22 21:19:10 juju-e4d256-prod-github-runner-207 kernel: [57324.608013] ? __fget_files+0x86/0xc0 Aug 22 21:19:10 juju-e4d256-prod-github-runner-207 kernel: [57324.608725] __x64_sys_ioctl+0x95/0xd0 Aug 22 21:19:10 juju-e4d256-prod-github-runner-207 kernel: [57324.609421] do_syscall_64+0x5c/0xc0 Aug 22 21:19:10 juju-e4d256-prod-github-runner-207 kernel: [57324.610089] ? do_futex+0x162/0x1f0 Aug 22 21:19:10 juju-e4d256-prod-github-runner-207 kernel: [57324.610752] ? __x64_sys_futex+0x78/0x1e0 Aug 22 21:19:10 juju-e4d256-prod-github-runner-207 kernel: [57324.611429] ? __secure_computing+0xa9/0x120 Aug 22 21:19:10 juju-e4d256-prod-github-runner-207 kernel: [57324.612132] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 21:19:10 juju-e4d256-prod-github-runner-207 kernel: [57324.612900] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:19:10 juju-e4d256-prod-github-runner-207 kernel: [57324.613624] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:19:10 juju-e4d256-prod-github-runner-207 kernel: [57324.614351] ? do_syscall_64+0x69/0xc0 Aug 22 21:19:10 juju-e4d256-prod-github-runner-207 kernel: [57324.615022] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:19:10 juju-e4d256-prod-github-runner-207 kernel: [57324.615865] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:19:10 juju-e4d256-prod-github-runner-207 kernel: [57324.616582] ? do_syscall_64+0x69/0xc0 Aug 22 21:19:10 juju-e4d256-prod-github-runner-207 kernel: [57324.617221] ? do_syscall_64+0x69/0xc0 Aug 22 21:19:10 juju-e4d256-prod-github-runner-207 kernel: [57324.617849] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 21:19:10 juju-e4d256-prod-github-runner-207 kernel: [57324.618585] RIP: 0033:0x7faa5d0edaff Aug 22 21:19:10 juju-e4d256-prod-github-runner-207 kernel: [57324.619248] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 21:19:10 juju-e4d256-prod-github-runner-207 kernel: [57324.621483] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 21:19:10 juju-e4d256-prod-github-runner-207 kernel: [57324.622421] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 21:19:10 juju-e4d256-prod-github-runner-207 kernel: [57324.623347] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 21:19:10 juju-e4d256-prod-github-runner-207 kernel: [57324.624255] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 21:19:10 juju-e4d256-prod-github-runner-207 kernel: [57324.625149] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 21:19:10 juju-e4d256-prod-github-runner-207 kernel: [57324.626039] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 21:19:10 juju-e4d256-prod-github-runner-207 kernel: [57324.626940] Aug 22 21:19:38 juju-e4d256-prod-github-runner-207 kernel: [57352.541980] watchdog: BUG: soft lockup - CPU#1 stuck for 53305s! [qemu-system-x86:6715] Aug 22 21:19:38 juju-e4d256-prod-github-runner-207 kernel: [57352.543848] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 21:19:38 juju-e4d256-prod-github-runner-207 kernel: [57352.544143] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 21:19:38 juju-e4d256-prod-github-runner-207 kernel: [57352.556259] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 21:19:38 juju-e4d256-prod-github-runner-207 kernel: [57352.557523] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 21:19:38 juju-e4d256-prod-github-runner-207 kernel: [57352.558750] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:19:38 juju-e4d256-prod-github-runner-207 kernel: [57352.559918] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 21:19:38 juju-e4d256-prod-github-runner-207 kernel: [57352.562488] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 21:19:38 juju-e4d256-prod-github-runner-207 kernel: [57352.563534] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 21:19:38 juju-e4d256-prod-github-runner-207 kernel: [57352.564695] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 21:19:38 juju-e4d256-prod-github-runner-207 kernel: [57352.565858] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 21:19:38 juju-e4d256-prod-github-runner-207 kernel: [57352.567027] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 21:19:38 juju-e4d256-prod-github-runner-207 kernel: [57352.568186] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 21:19:38 juju-e4d256-prod-github-runner-207 kernel: [57352.569348] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 21:19:38 juju-e4d256-prod-github-runner-207 kernel: [57352.570587] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 21:19:38 juju-e4d256-prod-github-runner-207 kernel: [57352.571683] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 21:19:38 juju-e4d256-prod-github-runner-207 kernel: [57352.572871] Call Trace: Aug 22 21:19:38 juju-e4d256-prod-github-runner-207 kernel: [57352.573782] Aug 22 21:19:38 juju-e4d256-prod-github-runner-207 kernel: [57352.574694] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:19:38 juju-e4d256-prod-github-runner-207 kernel: [57352.575762] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:19:38 juju-e4d256-prod-github-runner-207 kernel: [57352.576809] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:19:38 juju-e4d256-prod-github-runner-207 kernel: [57352.577903] ? show_regs.part.0+0x23/0x29 Aug 22 21:19:38 juju-e4d256-prod-github-runner-207 kernel: [57352.578918] ? show_regs.cold+0x8/0xd Aug 22 21:19:38 juju-e4d256-prod-github-runner-207 kernel: [57352.579900] ? watchdog_timer_fn+0x1be/0x220 Aug 22 21:19:38 juju-e4d256-prod-github-runner-207 kernel: [57352.580959] ? lockup_detector_update_enable+0x60/0x60 Aug 22 21:19:38 juju-e4d256-prod-github-runner-207 kernel: [57352.582122] ? __hrtimer_run_queues+0x107/0x230 Aug 22 21:19:38 juju-e4d256-prod-github-runner-207 kernel: [57352.583172] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 21:19:38 juju-e4d256-prod-github-runner-207 kernel: [57352.584235] ? hrtimer_interrupt+0x101/0x220 Aug 22 21:19:38 juju-e4d256-prod-github-runner-207 kernel: [57352.585334] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 21:19:38 juju-e4d256-prod-github-runner-207 kernel: [57352.586493] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 21:19:38 juju-e4d256-prod-github-runner-207 kernel: [57352.587628] Aug 22 21:19:38 juju-e4d256-prod-github-runner-207 kernel: [57352.588539] Aug 22 21:19:38 juju-e4d256-prod-github-runner-207 kernel: [57352.589430] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 21:19:38 juju-e4d256-prod-github-runner-207 kernel: [57352.590545] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:19:38 juju-e4d256-prod-github-runner-207 kernel: [57352.591640] ? _raw_spin_lock+0x22/0x30 Aug 22 21:19:38 juju-e4d256-prod-github-runner-207 kernel: [57352.592652] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:19:38 juju-e4d256-prod-github-runner-207 kernel: [57352.593756] direct_page_fault+0x206/0x310 [kvm] Aug 22 21:19:38 juju-e4d256-prod-github-runner-207 kernel: [57352.594833] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 21:19:38 juju-e4d256-prod-github-runner-207 kernel: [57352.595903] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 21:19:38 juju-e4d256-prod-github-runner-207 kernel: [57352.596903] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 21:19:38 juju-e4d256-prod-github-runner-207 kernel: [57352.597906] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 21:19:38 juju-e4d256-prod-github-runner-207 kernel: [57352.598871] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 21:19:38 juju-e4d256-prod-github-runner-207 kernel: [57352.599848] handle_exit+0x98/0x230 [kvm_amd] Aug 22 21:19:38 juju-e4d256-prod-github-runner-207 kernel: [57352.600739] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 21:19:38 juju-e4d256-prod-github-runner-207 kernel: [57352.601653] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 21:19:38 juju-e4d256-prod-github-runner-207 kernel: [57352.602592] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 21:19:38 juju-e4d256-prod-github-runner-207 kernel: [57352.603499] vcpu_run+0x62/0x2c0 [kvm] Aug 22 21:19:38 juju-e4d256-prod-github-runner-207 kernel: [57352.604308] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 21:19:38 juju-e4d256-prod-github-runner-207 kernel: [57352.605114] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 21:19:38 juju-e4d256-prod-github-runner-207 kernel: [57352.606041] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 21:19:38 juju-e4d256-prod-github-runner-207 kernel: [57352.606869] ? __seccomp_filter+0x4a/0x4a0 Aug 22 21:19:38 juju-e4d256-prod-github-runner-207 kernel: [57352.607612] ? __fget_files+0x86/0xc0 Aug 22 21:19:38 juju-e4d256-prod-github-runner-207 kernel: [57352.608314] __x64_sys_ioctl+0x95/0xd0 Aug 22 21:19:38 juju-e4d256-prod-github-runner-207 kernel: [57352.609047] do_syscall_64+0x5c/0xc0 Aug 22 21:19:38 juju-e4d256-prod-github-runner-207 kernel: [57352.609715] ? do_futex+0x162/0x1f0 Aug 22 21:19:38 juju-e4d256-prod-github-runner-207 kernel: [57352.610375] ? __x64_sys_futex+0x78/0x1e0 Aug 22 21:19:38 juju-e4d256-prod-github-runner-207 kernel: [57352.611086] ? __secure_computing+0xa9/0x120 Aug 22 21:19:38 juju-e4d256-prod-github-runner-207 kernel: [57352.611777] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 21:19:38 juju-e4d256-prod-github-runner-207 kernel: [57352.612542] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:19:38 juju-e4d256-prod-github-runner-207 kernel: [57352.613276] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:19:38 juju-e4d256-prod-github-runner-207 kernel: [57352.614017] ? do_syscall_64+0x69/0xc0 Aug 22 21:19:38 juju-e4d256-prod-github-runner-207 kernel: [57352.614682] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:19:38 juju-e4d256-prod-github-runner-207 kernel: [57352.615387] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:19:38 juju-e4d256-prod-github-runner-207 kernel: [57352.616080] ? do_syscall_64+0x69/0xc0 Aug 22 21:19:38 juju-e4d256-prod-github-runner-207 kernel: [57352.616702] ? do_syscall_64+0x69/0xc0 Aug 22 21:19:38 juju-e4d256-prod-github-runner-207 kernel: [57352.617320] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 21:19:38 juju-e4d256-prod-github-runner-207 kernel: [57352.618030] RIP: 0033:0x7faa5d0edaff Aug 22 21:19:38 juju-e4d256-prod-github-runner-207 kernel: [57352.618696] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 21:19:38 juju-e4d256-prod-github-runner-207 kernel: [57352.620678] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 21:19:38 juju-e4d256-prod-github-runner-207 kernel: [57352.621730] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 21:19:38 juju-e4d256-prod-github-runner-207 kernel: [57352.622740] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 21:19:38 juju-e4d256-prod-github-runner-207 kernel: [57352.623667] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 21:19:38 juju-e4d256-prod-github-runner-207 kernel: [57352.624562] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 21:19:38 juju-e4d256-prod-github-runner-207 kernel: [57352.625460] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 21:19:38 juju-e4d256-prod-github-runner-207 kernel: [57352.626385] Aug 22 21:20:06 juju-e4d256-prod-github-runner-207 kernel: [57380.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 53331s! [qemu-system-x86:6715] Aug 22 21:20:06 juju-e4d256-prod-github-runner-207 kernel: [57380.543867] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 21:20:06 juju-e4d256-prod-github-runner-207 kernel: [57380.544143] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 21:20:06 juju-e4d256-prod-github-runner-207 kernel: [57380.556269] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 21:20:06 juju-e4d256-prod-github-runner-207 kernel: [57380.557545] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 21:20:06 juju-e4d256-prod-github-runner-207 kernel: [57380.558783] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:20:06 juju-e4d256-prod-github-runner-207 kernel: [57380.559851] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 21:20:06 juju-e4d256-prod-github-runner-207 kernel: [57380.562420] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 21:20:06 juju-e4d256-prod-github-runner-207 kernel: [57380.563472] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 21:20:06 juju-e4d256-prod-github-runner-207 kernel: [57380.564640] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 21:20:06 juju-e4d256-prod-github-runner-207 kernel: [57380.565990] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 21:20:06 juju-e4d256-prod-github-runner-207 kernel: [57380.567154] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 21:20:06 juju-e4d256-prod-github-runner-207 kernel: [57380.568324] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 21:20:06 juju-e4d256-prod-github-runner-207 kernel: [57380.569498] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 21:20:06 juju-e4d256-prod-github-runner-207 kernel: [57380.570743] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 21:20:06 juju-e4d256-prod-github-runner-207 kernel: [57380.571846] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 21:20:06 juju-e4d256-prod-github-runner-207 kernel: [57380.573041] Call Trace: Aug 22 21:20:06 juju-e4d256-prod-github-runner-207 kernel: [57380.573967] Aug 22 21:20:06 juju-e4d256-prod-github-runner-207 kernel: [57380.575014] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:20:06 juju-e4d256-prod-github-runner-207 kernel: [57380.576135] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:20:06 juju-e4d256-prod-github-runner-207 kernel: [57380.577159] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:20:06 juju-e4d256-prod-github-runner-207 kernel: [57380.578275] ? show_regs.part.0+0x23/0x29 Aug 22 21:20:06 juju-e4d256-prod-github-runner-207 kernel: [57380.579278] ? show_regs.cold+0x8/0xd Aug 22 21:20:06 juju-e4d256-prod-github-runner-207 kernel: [57380.580252] ? watchdog_timer_fn+0x1be/0x220 Aug 22 21:20:06 juju-e4d256-prod-github-runner-207 kernel: [57380.581299] ? lockup_detector_update_enable+0x60/0x60 Aug 22 21:20:06 juju-e4d256-prod-github-runner-207 kernel: [57380.582378] ? __hrtimer_run_queues+0x107/0x230 Aug 22 21:20:06 juju-e4d256-prod-github-runner-207 kernel: [57380.583409] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 21:20:06 juju-e4d256-prod-github-runner-207 kernel: [57380.584443] ? hrtimer_interrupt+0x101/0x220 Aug 22 21:20:06 juju-e4d256-prod-github-runner-207 kernel: [57380.585461] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 21:20:06 juju-e4d256-prod-github-runner-207 kernel: [57380.586582] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 21:20:06 juju-e4d256-prod-github-runner-207 kernel: [57380.587633] Aug 22 21:20:06 juju-e4d256-prod-github-runner-207 kernel: [57380.588489] Aug 22 21:20:06 juju-e4d256-prod-github-runner-207 kernel: [57380.589331] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 21:20:06 juju-e4d256-prod-github-runner-207 kernel: [57380.590381] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:20:06 juju-e4d256-prod-github-runner-207 kernel: [57380.591424] ? _raw_spin_lock+0x22/0x30 Aug 22 21:20:06 juju-e4d256-prod-github-runner-207 kernel: [57380.592373] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:20:06 juju-e4d256-prod-github-runner-207 kernel: [57380.593396] direct_page_fault+0x206/0x310 [kvm] Aug 22 21:20:06 juju-e4d256-prod-github-runner-207 kernel: [57380.594441] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 21:20:06 juju-e4d256-prod-github-runner-207 kernel: [57380.595504] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 21:20:06 juju-e4d256-prod-github-runner-207 kernel: [57380.596513] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 21:20:06 juju-e4d256-prod-github-runner-207 kernel: [57380.597520] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 21:20:06 juju-e4d256-prod-github-runner-207 kernel: [57380.598479] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 21:20:06 juju-e4d256-prod-github-runner-207 kernel: [57380.599466] handle_exit+0x98/0x230 [kvm_amd] Aug 22 21:20:06 juju-e4d256-prod-github-runner-207 kernel: [57380.600369] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 21:20:06 juju-e4d256-prod-github-runner-207 kernel: [57380.601287] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 21:20:06 juju-e4d256-prod-github-runner-207 kernel: [57380.602235] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 21:20:06 juju-e4d256-prod-github-runner-207 kernel: [57380.603145] vcpu_run+0x62/0x2c0 [kvm] Aug 22 21:20:06 juju-e4d256-prod-github-runner-207 kernel: [57380.603956] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 21:20:06 juju-e4d256-prod-github-runner-207 kernel: [57380.604762] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 21:20:06 juju-e4d256-prod-github-runner-207 kernel: [57380.605616] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 21:20:06 juju-e4d256-prod-github-runner-207 kernel: [57380.606426] ? __seccomp_filter+0x4a/0x4a0 Aug 22 21:20:06 juju-e4d256-prod-github-runner-207 kernel: [57380.607173] ? __fget_files+0x86/0xc0 Aug 22 21:20:06 juju-e4d256-prod-github-runner-207 kernel: [57380.607882] __x64_sys_ioctl+0x95/0xd0 Aug 22 21:20:06 juju-e4d256-prod-github-runner-207 kernel: [57380.608575] do_syscall_64+0x5c/0xc0 Aug 22 21:20:06 juju-e4d256-prod-github-runner-207 kernel: [57380.609244] ? do_futex+0x162/0x1f0 Aug 22 21:20:06 juju-e4d256-prod-github-runner-207 kernel: [57380.609906] ? __x64_sys_futex+0x78/0x1e0 Aug 22 21:20:06 juju-e4d256-prod-github-runner-207 kernel: [57380.610579] ? __secure_computing+0xa9/0x120 Aug 22 21:20:06 juju-e4d256-prod-github-runner-207 kernel: [57380.611270] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 21:20:06 juju-e4d256-prod-github-runner-207 kernel: [57380.612030] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:20:06 juju-e4d256-prod-github-runner-207 kernel: [57380.612751] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:20:06 juju-e4d256-prod-github-runner-207 kernel: [57380.613474] ? do_syscall_64+0x69/0xc0 Aug 22 21:20:06 juju-e4d256-prod-github-runner-207 kernel: [57380.614168] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:20:06 juju-e4d256-prod-github-runner-207 kernel: [57380.614899] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:20:06 juju-e4d256-prod-github-runner-207 kernel: [57380.615595] ? do_syscall_64+0x69/0xc0 Aug 22 21:20:06 juju-e4d256-prod-github-runner-207 kernel: [57380.616221] ? do_syscall_64+0x69/0xc0 Aug 22 21:20:06 juju-e4d256-prod-github-runner-207 kernel: [57380.616846] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 21:20:06 juju-e4d256-prod-github-runner-207 kernel: [57380.617553] RIP: 0033:0x7faa5d0edaff Aug 22 21:20:06 juju-e4d256-prod-github-runner-207 kernel: [57380.618223] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 21:20:06 juju-e4d256-prod-github-runner-207 kernel: [57380.620218] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 21:20:06 juju-e4d256-prod-github-runner-207 kernel: [57380.621130] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 21:20:06 juju-e4d256-prod-github-runner-207 kernel: [57380.622029] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 21:20:06 juju-e4d256-prod-github-runner-207 kernel: [57380.622923] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 21:20:06 juju-e4d256-prod-github-runner-207 kernel: [57380.623812] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 21:20:06 juju-e4d256-prod-github-runner-207 kernel: [57380.624705] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 21:20:06 juju-e4d256-prod-github-runner-207 kernel: [57380.625599] Aug 22 21:20:34 juju-e4d256-prod-github-runner-207 kernel: [57408.541985] watchdog: BUG: soft lockup - CPU#1 stuck for 53357s! [qemu-system-x86:6715] Aug 22 21:20:34 juju-e4d256-prod-github-runner-207 kernel: [57408.543919] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 21:20:34 juju-e4d256-prod-github-runner-207 kernel: [57408.544221] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 21:20:34 juju-e4d256-prod-github-runner-207 kernel: [57408.556445] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 21:20:34 juju-e4d256-prod-github-runner-207 kernel: [57408.557719] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 21:20:34 juju-e4d256-prod-github-runner-207 kernel: [57408.558945] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:20:34 juju-e4d256-prod-github-runner-207 kernel: [57408.560000] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 21:20:34 juju-e4d256-prod-github-runner-207 kernel: [57408.562576] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 21:20:34 juju-e4d256-prod-github-runner-207 kernel: [57408.563622] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 21:20:34 juju-e4d256-prod-github-runner-207 kernel: [57408.564815] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 21:20:34 juju-e4d256-prod-github-runner-207 kernel: [57408.566009] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 21:20:34 juju-e4d256-prod-github-runner-207 kernel: [57408.567175] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 21:20:34 juju-e4d256-prod-github-runner-207 kernel: [57408.568339] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 21:20:34 juju-e4d256-prod-github-runner-207 kernel: [57408.569527] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 21:20:34 juju-e4d256-prod-github-runner-207 kernel: [57408.570757] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 21:20:34 juju-e4d256-prod-github-runner-207 kernel: [57408.572045] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 21:20:34 juju-e4d256-prod-github-runner-207 kernel: [57408.573262] Call Trace: Aug 22 21:20:34 juju-e4d256-prod-github-runner-207 kernel: [57408.574188] Aug 22 21:20:34 juju-e4d256-prod-github-runner-207 kernel: [57408.575136] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:20:34 juju-e4d256-prod-github-runner-207 kernel: [57408.576249] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:20:34 juju-e4d256-prod-github-runner-207 kernel: [57408.577274] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:20:34 juju-e4d256-prod-github-runner-207 kernel: [57408.578407] ? show_regs.part.0+0x23/0x29 Aug 22 21:20:34 juju-e4d256-prod-github-runner-207 kernel: [57408.579402] ? show_regs.cold+0x8/0xd Aug 22 21:20:34 juju-e4d256-prod-github-runner-207 kernel: [57408.580404] ? watchdog_timer_fn+0x1be/0x220 Aug 22 21:20:34 juju-e4d256-prod-github-runner-207 kernel: [57408.581425] ? lockup_detector_update_enable+0x60/0x60 Aug 22 21:20:34 juju-e4d256-prod-github-runner-207 kernel: [57408.582514] ? __hrtimer_run_queues+0x107/0x230 Aug 22 21:20:34 juju-e4d256-prod-github-runner-207 kernel: [57408.583552] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 21:20:34 juju-e4d256-prod-github-runner-207 kernel: [57408.584600] ? hrtimer_interrupt+0x101/0x220 Aug 22 21:20:34 juju-e4d256-prod-github-runner-207 kernel: [57408.585680] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 21:20:34 juju-e4d256-prod-github-runner-207 kernel: [57408.586768] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 21:20:34 juju-e4d256-prod-github-runner-207 kernel: [57408.587828] Aug 22 21:20:34 juju-e4d256-prod-github-runner-207 kernel: [57408.588698] Aug 22 21:20:34 juju-e4d256-prod-github-runner-207 kernel: [57408.589632] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 21:20:34 juju-e4d256-prod-github-runner-207 kernel: [57408.590673] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:20:34 juju-e4d256-prod-github-runner-207 kernel: [57408.591712] ? _raw_spin_lock+0x22/0x30 Aug 22 21:20:34 juju-e4d256-prod-github-runner-207 kernel: [57408.592662] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:20:34 juju-e4d256-prod-github-runner-207 kernel: [57408.593700] direct_page_fault+0x206/0x310 [kvm] Aug 22 21:20:34 juju-e4d256-prod-github-runner-207 kernel: [57408.594727] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 21:20:34 juju-e4d256-prod-github-runner-207 kernel: [57408.595801] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 21:20:34 juju-e4d256-prod-github-runner-207 kernel: [57408.596804] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 21:20:34 juju-e4d256-prod-github-runner-207 kernel: [57408.597836] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 21:20:34 juju-e4d256-prod-github-runner-207 kernel: [57408.598783] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 21:20:34 juju-e4d256-prod-github-runner-207 kernel: [57408.599770] handle_exit+0x98/0x230 [kvm_amd] Aug 22 21:20:34 juju-e4d256-prod-github-runner-207 kernel: [57408.600666] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 21:20:34 juju-e4d256-prod-github-runner-207 kernel: [57408.601722] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 21:20:34 juju-e4d256-prod-github-runner-207 kernel: [57408.602736] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 21:20:34 juju-e4d256-prod-github-runner-207 kernel: [57408.603649] vcpu_run+0x62/0x2c0 [kvm] Aug 22 21:20:34 juju-e4d256-prod-github-runner-207 kernel: [57408.604459] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 21:20:34 juju-e4d256-prod-github-runner-207 kernel: [57408.605269] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 21:20:34 juju-e4d256-prod-github-runner-207 kernel: [57408.606156] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 21:20:34 juju-e4d256-prod-github-runner-207 kernel: [57408.606967] ? __seccomp_filter+0x4a/0x4a0 Aug 22 21:20:34 juju-e4d256-prod-github-runner-207 kernel: [57408.607725] ? __fget_files+0x86/0xc0 Aug 22 21:20:34 juju-e4d256-prod-github-runner-207 kernel: [57408.608445] __x64_sys_ioctl+0x95/0xd0 Aug 22 21:20:34 juju-e4d256-prod-github-runner-207 kernel: [57408.609143] do_syscall_64+0x5c/0xc0 Aug 22 21:20:34 juju-e4d256-prod-github-runner-207 kernel: [57408.609845] ? do_futex+0x162/0x1f0 Aug 22 21:20:34 juju-e4d256-prod-github-runner-207 kernel: [57408.610500] ? __x64_sys_futex+0x78/0x1e0 Aug 22 21:20:34 juju-e4d256-prod-github-runner-207 kernel: [57408.611195] ? __secure_computing+0xa9/0x120 Aug 22 21:20:34 juju-e4d256-prod-github-runner-207 kernel: [57408.611891] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 21:20:34 juju-e4d256-prod-github-runner-207 kernel: [57408.612656] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:20:34 juju-e4d256-prod-github-runner-207 kernel: [57408.613378] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:20:34 juju-e4d256-prod-github-runner-207 kernel: [57408.614103] ? do_syscall_64+0x69/0xc0 Aug 22 21:20:34 juju-e4d256-prod-github-runner-207 kernel: [57408.614748] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:20:34 juju-e4d256-prod-github-runner-207 kernel: [57408.615455] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:20:34 juju-e4d256-prod-github-runner-207 kernel: [57408.616154] ? do_syscall_64+0x69/0xc0 Aug 22 21:20:34 juju-e4d256-prod-github-runner-207 kernel: [57408.616777] ? do_syscall_64+0x69/0xc0 Aug 22 21:20:34 juju-e4d256-prod-github-runner-207 kernel: [57408.617398] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 21:20:34 juju-e4d256-prod-github-runner-207 kernel: [57408.618123] RIP: 0033:0x7faa5d0edaff Aug 22 21:20:34 juju-e4d256-prod-github-runner-207 kernel: [57408.618785] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 21:20:34 juju-e4d256-prod-github-runner-207 kernel: [57408.620811] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 21:20:34 juju-e4d256-prod-github-runner-207 kernel: [57408.621748] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 21:20:34 juju-e4d256-prod-github-runner-207 kernel: [57408.622639] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 21:20:34 juju-e4d256-prod-github-runner-207 kernel: [57408.623531] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 21:20:34 juju-e4d256-prod-github-runner-207 kernel: [57408.624606] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 21:20:34 juju-e4d256-prod-github-runner-207 kernel: [57408.625506] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 21:20:34 juju-e4d256-prod-github-runner-207 kernel: [57408.626431] Aug 22 21:20:47 juju-e4d256-prod-github-runner-207 kernel: [57421.016704] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 21:20:47 juju-e4d256-prod-github-runner-207 kernel: [57421.017682] rcu: 1-....: (14280853 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=6901376 Aug 22 21:20:47 juju-e4d256-prod-github-runner-207 kernel: [57421.018820] (t=14325954 jiffies g=23269 q=52377) Aug 22 21:20:47 juju-e4d256-prod-github-runner-207 kernel: [57421.019638] NMI backtrace for cpu 1 Aug 22 21:20:47 juju-e4d256-prod-github-runner-207 kernel: [57421.020357] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 21:20:47 juju-e4d256-prod-github-runner-207 kernel: [57421.021477] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 21:20:47 juju-e4d256-prod-github-runner-207 kernel: [57421.022538] Call Trace: Aug 22 21:20:47 juju-e4d256-prod-github-runner-207 kernel: [57421.023216] Aug 22 21:20:47 juju-e4d256-prod-github-runner-207 kernel: [57421.023860] show_stack+0x52/0x5c Aug 22 21:20:47 juju-e4d256-prod-github-runner-207 kernel: [57421.024591] dump_stack_lvl+0x4a/0x63 Aug 22 21:20:47 juju-e4d256-prod-github-runner-207 kernel: [57421.025336] dump_stack+0x10/0x16 Aug 22 21:20:47 juju-e4d256-prod-github-runner-207 kernel: [57421.026061] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 21:20:47 juju-e4d256-prod-github-runner-207 kernel: [57421.026839] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 21:20:47 juju-e4d256-prod-github-runner-207 kernel: [57421.027616] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 21:20:47 juju-e4d256-prod-github-runner-207 kernel: [57421.028433] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 21:20:47 juju-e4d256-prod-github-runner-207 kernel: [57421.029255] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 21:20:47 juju-e4d256-prod-github-runner-207 kernel: [57421.030072] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 21:20:47 juju-e4d256-prod-github-runner-207 kernel: [57421.030843] print_cpu_stall.cold+0x2f/0xe2 Aug 22 21:20:47 juju-e4d256-prod-github-runner-207 kernel: [57421.031614] ? timekeeping_update+0xf7/0x150 Aug 22 21:20:47 juju-e4d256-prod-github-runner-207 kernel: [57421.032382] check_cpu_stall+0x109/0x270 Aug 22 21:20:47 juju-e4d256-prod-github-runner-207 kernel: [57421.033126] rcu_sched_clock_irq+0x9a/0x250 Aug 22 21:20:47 juju-e4d256-prod-github-runner-207 kernel: [57421.033893] update_process_times+0x94/0xd0 Aug 22 21:20:47 juju-e4d256-prod-github-runner-207 kernel: [57421.034652] tick_sched_handle+0x29/0x70 Aug 22 21:20:47 juju-e4d256-prod-github-runner-207 kernel: [57421.035394] tick_sched_timer+0x8c/0xc0 Aug 22 21:20:47 juju-e4d256-prod-github-runner-207 kernel: [57421.036128] ? tick_nohz_handler+0xb0/0xb0 Aug 22 21:20:47 juju-e4d256-prod-github-runner-207 kernel: [57421.036885] __hrtimer_run_queues+0x107/0x230 Aug 22 21:20:47 juju-e4d256-prod-github-runner-207 kernel: [57421.037665] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 21:20:47 juju-e4d256-prod-github-runner-207 kernel: [57421.038437] hrtimer_interrupt+0x101/0x220 Aug 22 21:20:47 juju-e4d256-prod-github-runner-207 kernel: [57421.039193] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 21:20:47 juju-e4d256-prod-github-runner-207 kernel: [57421.040003] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 21:20:47 juju-e4d256-prod-github-runner-207 kernel: [57421.040802] Aug 22 21:20:47 juju-e4d256-prod-github-runner-207 kernel: [57421.041443] Aug 22 21:20:47 juju-e4d256-prod-github-runner-207 kernel: [57421.042072] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 21:20:47 juju-e4d256-prod-github-runner-207 kernel: [57421.042892] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:20:47 juju-e4d256-prod-github-runner-207 kernel: [57421.043773] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 21:20:47 juju-e4d256-prod-github-runner-207 kernel: [57421.045986] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 21:20:47 juju-e4d256-prod-github-runner-207 kernel: [57421.046862] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 21:20:47 juju-e4d256-prod-github-runner-207 kernel: [57421.047849] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 21:20:47 juju-e4d256-prod-github-runner-207 kernel: [57421.048827] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 21:20:47 juju-e4d256-prod-github-runner-207 kernel: [57421.049795] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 21:20:47 juju-e4d256-prod-github-runner-207 kernel: [57421.050749] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 21:20:47 juju-e4d256-prod-github-runner-207 kernel: [57421.051703] ? _raw_spin_lock+0x22/0x30 Aug 22 21:20:47 juju-e4d256-prod-github-runner-207 kernel: [57421.052460] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:20:47 juju-e4d256-prod-github-runner-207 kernel: [57421.053297] direct_page_fault+0x206/0x310 [kvm] Aug 22 21:20:47 juju-e4d256-prod-github-runner-207 kernel: [57421.054141] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 21:20:47 juju-e4d256-prod-github-runner-207 kernel: [57421.054965] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 21:20:47 juju-e4d256-prod-github-runner-207 kernel: [57421.055790] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 21:20:47 juju-e4d256-prod-github-runner-207 kernel: [57421.056591] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 21:20:47 juju-e4d256-prod-github-runner-207 kernel: [57421.057399] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 21:20:47 juju-e4d256-prod-github-runner-207 kernel: [57421.058224] handle_exit+0x98/0x230 [kvm_amd] Aug 22 21:20:47 juju-e4d256-prod-github-runner-207 kernel: [57421.058981] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 21:20:47 juju-e4d256-prod-github-runner-207 kernel: [57421.059761] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 21:20:47 juju-e4d256-prod-github-runner-207 kernel: [57421.060556] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 21:20:47 juju-e4d256-prod-github-runner-207 kernel: [57421.061339] vcpu_run+0x62/0x2c0 [kvm] Aug 22 21:20:47 juju-e4d256-prod-github-runner-207 kernel: [57421.062068] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 21:20:47 juju-e4d256-prod-github-runner-207 kernel: [57421.062807] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 21:20:47 juju-e4d256-prod-github-runner-207 kernel: [57421.063724] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 21:20:47 juju-e4d256-prod-github-runner-207 kernel: [57421.064494] ? __seccomp_filter+0x4a/0x4a0 Aug 22 21:20:47 juju-e4d256-prod-github-runner-207 kernel: [57421.065218] ? __fget_files+0x86/0xc0 Aug 22 21:20:47 juju-e4d256-prod-github-runner-207 kernel: [57421.065923] __x64_sys_ioctl+0x95/0xd0 Aug 22 21:20:47 juju-e4d256-prod-github-runner-207 kernel: [57421.066622] do_syscall_64+0x5c/0xc0 Aug 22 21:20:47 juju-e4d256-prod-github-runner-207 kernel: [57421.067301] ? do_futex+0x162/0x1f0 Aug 22 21:20:47 juju-e4d256-prod-github-runner-207 kernel: [57421.067971] ? __x64_sys_futex+0x78/0x1e0 Aug 22 21:20:47 juju-e4d256-prod-github-runner-207 kernel: [57421.068675] ? __secure_computing+0xa9/0x120 Aug 22 21:20:47 juju-e4d256-prod-github-runner-207 kernel: [57421.069401] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 21:20:47 juju-e4d256-prod-github-runner-207 kernel: [57421.070188] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:20:47 juju-e4d256-prod-github-runner-207 kernel: [57421.070956] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:20:47 juju-e4d256-prod-github-runner-207 kernel: [57421.071750] ? do_syscall_64+0x69/0xc0 Aug 22 21:20:47 juju-e4d256-prod-github-runner-207 kernel: [57421.072459] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:20:47 juju-e4d256-prod-github-runner-207 kernel: [57421.073223] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:20:47 juju-e4d256-prod-github-runner-207 kernel: [57421.073988] ? do_syscall_64+0x69/0xc0 Aug 22 21:20:47 juju-e4d256-prod-github-runner-207 kernel: [57421.074679] ? do_syscall_64+0x69/0xc0 Aug 22 21:20:47 juju-e4d256-prod-github-runner-207 kernel: [57421.075363] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 21:20:47 juju-e4d256-prod-github-runner-207 kernel: [57421.076130] RIP: 0033:0x7faa5d0edaff Aug 22 21:20:47 juju-e4d256-prod-github-runner-207 kernel: [57421.076832] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 21:20:47 juju-e4d256-prod-github-runner-207 kernel: [57421.078963] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 21:20:47 juju-e4d256-prod-github-runner-207 kernel: [57421.079931] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 21:20:47 juju-e4d256-prod-github-runner-207 kernel: [57421.080878] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 21:20:47 juju-e4d256-prod-github-runner-207 kernel: [57421.081834] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 21:20:47 juju-e4d256-prod-github-runner-207 kernel: [57421.082773] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 21:20:47 juju-e4d256-prod-github-runner-207 kernel: [57421.083711] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 21:20:47 juju-e4d256-prod-github-runner-207 kernel: [57421.084640] Aug 22 21:21:14 juju-e4d256-prod-github-runner-207 kernel: [57448.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 53395s! [qemu-system-x86:6715] Aug 22 21:21:14 juju-e4d256-prod-github-runner-207 kernel: [57448.543121] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 21:21:14 juju-e4d256-prod-github-runner-207 kernel: [57448.543197] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 21:21:14 juju-e4d256-prod-github-runner-207 kernel: [57448.555437] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 21:21:14 juju-e4d256-prod-github-runner-207 kernel: [57448.556712] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 21:21:14 juju-e4d256-prod-github-runner-207 kernel: [57448.557964] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:21:14 juju-e4d256-prod-github-runner-207 kernel: [57448.559067] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 21:21:14 juju-e4d256-prod-github-runner-207 kernel: [57448.561808] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 21:21:14 juju-e4d256-prod-github-runner-207 kernel: [57448.562864] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 21:21:14 juju-e4d256-prod-github-runner-207 kernel: [57448.564029] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 21:21:14 juju-e4d256-prod-github-runner-207 kernel: [57448.565202] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 21:21:14 juju-e4d256-prod-github-runner-207 kernel: [57448.566372] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 21:21:14 juju-e4d256-prod-github-runner-207 kernel: [57448.567533] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 21:21:14 juju-e4d256-prod-github-runner-207 kernel: [57448.568696] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 21:21:14 juju-e4d256-prod-github-runner-207 kernel: [57448.569944] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 21:21:14 juju-e4d256-prod-github-runner-207 kernel: [57448.571058] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 21:21:14 juju-e4d256-prod-github-runner-207 kernel: [57448.572334] Call Trace: Aug 22 21:21:14 juju-e4d256-prod-github-runner-207 kernel: [57448.573270] Aug 22 21:21:14 juju-e4d256-prod-github-runner-207 kernel: [57448.574158] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:21:14 juju-e4d256-prod-github-runner-207 kernel: [57448.575200] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:21:14 juju-e4d256-prod-github-runner-207 kernel: [57448.576225] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:21:14 juju-e4d256-prod-github-runner-207 kernel: [57448.577312] ? show_regs.part.0+0x23/0x29 Aug 22 21:21:14 juju-e4d256-prod-github-runner-207 kernel: [57448.578316] ? show_regs.cold+0x8/0xd Aug 22 21:21:14 juju-e4d256-prod-github-runner-207 kernel: [57448.579285] ? watchdog_timer_fn+0x1be/0x220 Aug 22 21:21:14 juju-e4d256-prod-github-runner-207 kernel: [57448.580291] ? lockup_detector_update_enable+0x60/0x60 Aug 22 21:21:14 juju-e4d256-prod-github-runner-207 kernel: [57448.581366] ? __hrtimer_run_queues+0x107/0x230 Aug 22 21:21:14 juju-e4d256-prod-github-runner-207 kernel: [57448.582392] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 21:21:14 juju-e4d256-prod-github-runner-207 kernel: [57448.583420] ? hrtimer_interrupt+0x101/0x220 Aug 22 21:21:14 juju-e4d256-prod-github-runner-207 kernel: [57448.584433] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 21:21:14 juju-e4d256-prod-github-runner-207 kernel: [57448.585515] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 21:21:14 juju-e4d256-prod-github-runner-207 kernel: [57448.586563] Aug 22 21:21:14 juju-e4d256-prod-github-runner-207 kernel: [57448.587417] Aug 22 21:21:14 juju-e4d256-prod-github-runner-207 kernel: [57448.588258] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 21:21:14 juju-e4d256-prod-github-runner-207 kernel: [57448.589309] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:21:14 juju-e4d256-prod-github-runner-207 kernel: [57448.590348] ? _raw_spin_lock+0x22/0x30 Aug 22 21:21:14 juju-e4d256-prod-github-runner-207 kernel: [57448.591296] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:21:14 juju-e4d256-prod-github-runner-207 kernel: [57448.592310] direct_page_fault+0x206/0x310 [kvm] Aug 22 21:21:14 juju-e4d256-prod-github-runner-207 kernel: [57448.593348] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 21:21:14 juju-e4d256-prod-github-runner-207 kernel: [57448.594365] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 21:21:14 juju-e4d256-prod-github-runner-207 kernel: [57448.595365] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 21:21:14 juju-e4d256-prod-github-runner-207 kernel: [57448.596373] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 21:21:14 juju-e4d256-prod-github-runner-207 kernel: [57448.597342] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 21:21:14 juju-e4d256-prod-github-runner-207 kernel: [57448.598330] handle_exit+0x98/0x230 [kvm_amd] Aug 22 21:21:14 juju-e4d256-prod-github-runner-207 kernel: [57448.599244] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 21:21:14 juju-e4d256-prod-github-runner-207 kernel: [57448.600252] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 21:21:14 juju-e4d256-prod-github-runner-207 kernel: [57448.601254] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 21:21:14 juju-e4d256-prod-github-runner-207 kernel: [57448.602193] vcpu_run+0x62/0x2c0 [kvm] Aug 22 21:21:14 juju-e4d256-prod-github-runner-207 kernel: [57448.603104] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 21:21:14 juju-e4d256-prod-github-runner-207 kernel: [57448.603924] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 21:21:14 juju-e4d256-prod-github-runner-207 kernel: [57448.604777] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 21:21:14 juju-e4d256-prod-github-runner-207 kernel: [57448.605581] ? __seccomp_filter+0x4a/0x4a0 Aug 22 21:21:14 juju-e4d256-prod-github-runner-207 kernel: [57448.606323] ? __fget_files+0x86/0xc0 Aug 22 21:21:14 juju-e4d256-prod-github-runner-207 kernel: [57448.607041] __x64_sys_ioctl+0x95/0xd0 Aug 22 21:21:14 juju-e4d256-prod-github-runner-207 kernel: [57448.607754] do_syscall_64+0x5c/0xc0 Aug 22 21:21:14 juju-e4d256-prod-github-runner-207 kernel: [57448.608437] ? do_futex+0x162/0x1f0 Aug 22 21:21:14 juju-e4d256-prod-github-runner-207 kernel: [57448.609105] ? __x64_sys_futex+0x78/0x1e0 Aug 22 21:21:14 juju-e4d256-prod-github-runner-207 kernel: [57448.609915] ? __secure_computing+0xa9/0x120 Aug 22 21:21:14 juju-e4d256-prod-github-runner-207 kernel: [57448.610604] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 21:21:14 juju-e4d256-prod-github-runner-207 kernel: [57448.611384] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:21:14 juju-e4d256-prod-github-runner-207 kernel: [57448.612110] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:21:14 juju-e4d256-prod-github-runner-207 kernel: [57448.612828] ? do_syscall_64+0x69/0xc0 Aug 22 21:21:14 juju-e4d256-prod-github-runner-207 kernel: [57448.613492] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:21:14 juju-e4d256-prod-github-runner-207 kernel: [57448.614210] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:21:14 juju-e4d256-prod-github-runner-207 kernel: [57448.614908] ? do_syscall_64+0x69/0xc0 Aug 22 21:21:14 juju-e4d256-prod-github-runner-207 kernel: [57448.615706] ? do_syscall_64+0x69/0xc0 Aug 22 21:21:14 juju-e4d256-prod-github-runner-207 kernel: [57448.616331] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 21:21:14 juju-e4d256-prod-github-runner-207 kernel: [57448.617051] RIP: 0033:0x7faa5d0edaff Aug 22 21:21:14 juju-e4d256-prod-github-runner-207 kernel: [57448.617676] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 21:21:14 juju-e4d256-prod-github-runner-207 kernel: [57448.619663] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 21:21:14 juju-e4d256-prod-github-runner-207 kernel: [57448.620579] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 21:21:14 juju-e4d256-prod-github-runner-207 kernel: [57448.621474] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 21:21:14 juju-e4d256-prod-github-runner-207 kernel: [57448.622375] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 21:21:14 juju-e4d256-prod-github-runner-207 kernel: [57448.623268] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 21:21:14 juju-e4d256-prod-github-runner-207 kernel: [57448.624159] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 21:21:14 juju-e4d256-prod-github-runner-207 kernel: [57448.625073] Aug 22 21:21:42 juju-e4d256-prod-github-runner-207 kernel: [57476.541984] watchdog: BUG: soft lockup - CPU#1 stuck for 53421s! [qemu-system-x86:6715] Aug 22 21:21:42 juju-e4d256-prod-github-runner-207 kernel: [57476.544367] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 21:21:42 juju-e4d256-prod-github-runner-207 kernel: [57476.544757] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 21:21:42 juju-e4d256-prod-github-runner-207 kernel: [57476.562843] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 21:21:42 juju-e4d256-prod-github-runner-207 kernel: [57476.564901] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 21:21:42 juju-e4d256-prod-github-runner-207 kernel: [57476.566737] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:21:42 juju-e4d256-prod-github-runner-207 kernel: [57476.568433] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 21:21:42 juju-e4d256-prod-github-runner-207 kernel: [57476.572949] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 21:21:42 juju-e4d256-prod-github-runner-207 kernel: [57476.574659] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 21:21:42 juju-e4d256-prod-github-runner-207 kernel: [57476.576514] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 21:21:42 juju-e4d256-prod-github-runner-207 kernel: [57476.578707] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 21:21:42 juju-e4d256-prod-github-runner-207 kernel: [57476.580390] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 21:21:42 juju-e4d256-prod-github-runner-207 kernel: [57476.582051] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 21:21:42 juju-e4d256-prod-github-runner-207 kernel: [57476.583736] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 21:21:42 juju-e4d256-prod-github-runner-207 kernel: [57476.585747] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 21:21:42 juju-e4d256-prod-github-runner-207 kernel: [57476.587267] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 21:21:42 juju-e4d256-prod-github-runner-207 kernel: [57476.588976] Call Trace: Aug 22 21:21:42 juju-e4d256-prod-github-runner-207 kernel: [57476.590255] Aug 22 21:21:42 juju-e4d256-prod-github-runner-207 kernel: [57476.591520] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:21:42 juju-e4d256-prod-github-runner-207 kernel: [57476.592949] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:21:42 juju-e4d256-prod-github-runner-207 kernel: [57476.594019] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:21:42 juju-e4d256-prod-github-runner-207 kernel: [57476.595415] ? show_regs.part.0+0x23/0x29 Aug 22 21:21:42 juju-e4d256-prod-github-runner-207 kernel: [57476.596829] ? show_regs.cold+0x8/0xd Aug 22 21:21:42 juju-e4d256-prod-github-runner-207 kernel: [57476.598072] ? watchdog_timer_fn+0x1be/0x220 Aug 22 21:21:42 juju-e4d256-prod-github-runner-207 kernel: [57476.599518] ? lockup_detector_update_enable+0x60/0x60 Aug 22 21:21:42 juju-e4d256-prod-github-runner-207 kernel: [57476.601045] ? __hrtimer_run_queues+0x107/0x230 Aug 22 21:21:42 juju-e4d256-prod-github-runner-207 kernel: [57476.602485] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 21:21:42 juju-e4d256-prod-github-runner-207 kernel: [57476.603939] ? hrtimer_interrupt+0x101/0x220 Aug 22 21:21:42 juju-e4d256-prod-github-runner-207 kernel: [57476.605487] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 21:21:42 juju-e4d256-prod-github-runner-207 kernel: [57476.607071] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 21:21:42 juju-e4d256-prod-github-runner-207 kernel: [57476.608541] Aug 22 21:21:42 juju-e4d256-prod-github-runner-207 kernel: [57476.609753] Aug 22 21:21:42 juju-e4d256-prod-github-runner-207 kernel: [57476.610938] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 21:21:42 juju-e4d256-prod-github-runner-207 kernel: [57476.612438] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:21:42 juju-e4d256-prod-github-runner-207 kernel: [57476.613924] ? _raw_spin_lock+0x22/0x30 Aug 22 21:21:42 juju-e4d256-prod-github-runner-207 kernel: [57476.615271] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:21:42 juju-e4d256-prod-github-runner-207 kernel: [57476.616814] direct_page_fault+0x206/0x310 [kvm] Aug 22 21:21:42 juju-e4d256-prod-github-runner-207 kernel: [57476.617874] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 21:21:42 juju-e4d256-prod-github-runner-207 kernel: [57476.618893] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 21:21:42 juju-e4d256-prod-github-runner-207 kernel: [57476.619926] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 21:21:42 juju-e4d256-prod-github-runner-207 kernel: [57476.620995] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 21:21:42 juju-e4d256-prod-github-runner-207 kernel: [57476.622012] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 21:21:42 juju-e4d256-prod-github-runner-207 kernel: [57476.623015] handle_exit+0x98/0x230 [kvm_amd] Aug 22 21:21:42 juju-e4d256-prod-github-runner-207 kernel: [57476.623917] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 21:21:42 juju-e4d256-prod-github-runner-207 kernel: [57476.624914] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 21:21:42 juju-e4d256-prod-github-runner-207 kernel: [57476.625868] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 21:21:42 juju-e4d256-prod-github-runner-207 kernel: [57476.626784] vcpu_run+0x62/0x2c0 [kvm] Aug 22 21:21:42 juju-e4d256-prod-github-runner-207 kernel: [57476.627601] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 21:21:42 juju-e4d256-prod-github-runner-207 kernel: [57476.628421] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 21:21:42 juju-e4d256-prod-github-runner-207 kernel: [57476.629309] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 21:21:42 juju-e4d256-prod-github-runner-207 kernel: [57476.630121] ? __seccomp_filter+0x4a/0x4a0 Aug 22 21:21:42 juju-e4d256-prod-github-runner-207 kernel: [57476.630900] ? __fget_files+0x86/0xc0 Aug 22 21:21:42 juju-e4d256-prod-github-runner-207 kernel: [57476.631625] __x64_sys_ioctl+0x95/0xd0 Aug 22 21:21:42 juju-e4d256-prod-github-runner-207 kernel: [57476.632338] do_syscall_64+0x5c/0xc0 Aug 22 21:21:42 juju-e4d256-prod-github-runner-207 kernel: [57476.633043] ? do_futex+0x162/0x1f0 Aug 22 21:21:42 juju-e4d256-prod-github-runner-207 kernel: [57476.633700] ? __x64_sys_futex+0x78/0x1e0 Aug 22 21:21:42 juju-e4d256-prod-github-runner-207 kernel: [57476.634379] ? __secure_computing+0xa9/0x120 Aug 22 21:21:42 juju-e4d256-prod-github-runner-207 kernel: [57476.635139] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 21:21:42 juju-e4d256-prod-github-runner-207 kernel: [57476.635961] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:21:42 juju-e4d256-prod-github-runner-207 kernel: [57476.636799] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:21:42 juju-e4d256-prod-github-runner-207 kernel: [57476.637538] ? do_syscall_64+0x69/0xc0 Aug 22 21:21:42 juju-e4d256-prod-github-runner-207 kernel: [57476.638194] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:21:42 juju-e4d256-prod-github-runner-207 kernel: [57476.638909] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:21:42 juju-e4d256-prod-github-runner-207 kernel: [57476.639618] ? do_syscall_64+0x69/0xc0 Aug 22 21:21:42 juju-e4d256-prod-github-runner-207 kernel: [57476.640298] ? do_syscall_64+0x69/0xc0 Aug 22 21:21:42 juju-e4d256-prod-github-runner-207 kernel: [57476.640988] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 21:21:42 juju-e4d256-prod-github-runner-207 kernel: [57476.641735] RIP: 0033:0x7faa5d0edaff Aug 22 21:21:42 juju-e4d256-prod-github-runner-207 kernel: [57476.642482] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 21:21:42 juju-e4d256-prod-github-runner-207 kernel: [57476.644525] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 21:21:42 juju-e4d256-prod-github-runner-207 kernel: [57476.645525] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 21:21:42 juju-e4d256-prod-github-runner-207 kernel: [57476.646439] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 21:21:42 juju-e4d256-prod-github-runner-207 kernel: [57476.647347] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 21:21:42 juju-e4d256-prod-github-runner-207 kernel: [57476.648266] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 21:21:42 juju-e4d256-prod-github-runner-207 kernel: [57476.649206] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 21:21:42 juju-e4d256-prod-github-runner-207 kernel: [57476.650127] Aug 22 21:22:10 juju-e4d256-prod-github-runner-207 kernel: [57504.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 53447s! [qemu-system-x86:6715] Aug 22 21:22:10 juju-e4d256-prod-github-runner-207 kernel: [57504.543100] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 21:22:10 juju-e4d256-prod-github-runner-207 kernel: [57504.543178] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 21:22:10 juju-e4d256-prod-github-runner-207 kernel: [57504.555351] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 21:22:10 juju-e4d256-prod-github-runner-207 kernel: [57504.556636] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 21:22:10 juju-e4d256-prod-github-runner-207 kernel: [57504.557859] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:22:10 juju-e4d256-prod-github-runner-207 kernel: [57504.558937] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 21:22:10 juju-e4d256-prod-github-runner-207 kernel: [57504.561538] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 21:22:10 juju-e4d256-prod-github-runner-207 kernel: [57504.562586] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 21:22:10 juju-e4d256-prod-github-runner-207 kernel: [57504.563748] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 21:22:10 juju-e4d256-prod-github-runner-207 kernel: [57504.564917] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 21:22:10 juju-e4d256-prod-github-runner-207 kernel: [57504.566079] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 21:22:10 juju-e4d256-prod-github-runner-207 kernel: [57504.567242] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 21:22:10 juju-e4d256-prod-github-runner-207 kernel: [57504.568437] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 21:22:10 juju-e4d256-prod-github-runner-207 kernel: [57504.569709] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 21:22:10 juju-e4d256-prod-github-runner-207 kernel: [57504.570815] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 21:22:10 juju-e4d256-prod-github-runner-207 kernel: [57504.572021] Call Trace: Aug 22 21:22:10 juju-e4d256-prod-github-runner-207 kernel: [57504.572997] Aug 22 21:22:10 juju-e4d256-prod-github-runner-207 kernel: [57504.573888] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:22:10 juju-e4d256-prod-github-runner-207 kernel: [57504.574930] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:22:10 juju-e4d256-prod-github-runner-207 kernel: [57504.575960] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:22:10 juju-e4d256-prod-github-runner-207 kernel: [57504.577056] ? show_regs.part.0+0x23/0x29 Aug 22 21:22:10 juju-e4d256-prod-github-runner-207 kernel: [57504.578055] ? show_regs.cold+0x8/0xd Aug 22 21:22:10 juju-e4d256-prod-github-runner-207 kernel: [57504.579036] ? watchdog_timer_fn+0x1be/0x220 Aug 22 21:22:10 juju-e4d256-prod-github-runner-207 kernel: [57504.580053] ? lockup_detector_update_enable+0x60/0x60 Aug 22 21:22:10 juju-e4d256-prod-github-runner-207 kernel: [57504.581156] ? __hrtimer_run_queues+0x107/0x230 Aug 22 21:22:10 juju-e4d256-prod-github-runner-207 kernel: [57504.582191] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 21:22:10 juju-e4d256-prod-github-runner-207 kernel: [57504.583235] ? hrtimer_interrupt+0x101/0x220 Aug 22 21:22:10 juju-e4d256-prod-github-runner-207 kernel: [57504.584260] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 21:22:10 juju-e4d256-prod-github-runner-207 kernel: [57504.585345] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 21:22:10 juju-e4d256-prod-github-runner-207 kernel: [57504.586403] Aug 22 21:22:10 juju-e4d256-prod-github-runner-207 kernel: [57504.587267] Aug 22 21:22:10 juju-e4d256-prod-github-runner-207 kernel: [57504.588117] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 21:22:10 juju-e4d256-prod-github-runner-207 kernel: [57504.589178] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:22:10 juju-e4d256-prod-github-runner-207 kernel: [57504.590232] ? _raw_spin_lock+0x22/0x30 Aug 22 21:22:10 juju-e4d256-prod-github-runner-207 kernel: [57504.591178] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:22:10 juju-e4d256-prod-github-runner-207 kernel: [57504.592196] direct_page_fault+0x206/0x310 [kvm] Aug 22 21:22:10 juju-e4d256-prod-github-runner-207 kernel: [57504.593257] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 21:22:10 juju-e4d256-prod-github-runner-207 kernel: [57504.594276] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 21:22:10 juju-e4d256-prod-github-runner-207 kernel: [57504.595275] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 21:22:10 juju-e4d256-prod-github-runner-207 kernel: [57504.596267] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 21:22:10 juju-e4d256-prod-github-runner-207 kernel: [57504.597252] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 21:22:10 juju-e4d256-prod-github-runner-207 kernel: [57504.598256] handle_exit+0x98/0x230 [kvm_amd] Aug 22 21:22:10 juju-e4d256-prod-github-runner-207 kernel: [57504.599149] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 21:22:10 juju-e4d256-prod-github-runner-207 kernel: [57504.600067] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 21:22:10 juju-e4d256-prod-github-runner-207 kernel: [57504.600999] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 21:22:10 juju-e4d256-prod-github-runner-207 kernel: [57504.601902] vcpu_run+0x62/0x2c0 [kvm] Aug 22 21:22:10 juju-e4d256-prod-github-runner-207 kernel: [57504.602712] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 21:22:10 juju-e4d256-prod-github-runner-207 kernel: [57504.603522] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 21:22:10 juju-e4d256-prod-github-runner-207 kernel: [57504.604395] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 21:22:10 juju-e4d256-prod-github-runner-207 kernel: [57504.605238] ? __seccomp_filter+0x4a/0x4a0 Aug 22 21:22:10 juju-e4d256-prod-github-runner-207 kernel: [57504.605989] ? __fget_files+0x86/0xc0 Aug 22 21:22:10 juju-e4d256-prod-github-runner-207 kernel: [57504.606694] __x64_sys_ioctl+0x95/0xd0 Aug 22 21:22:10 juju-e4d256-prod-github-runner-207 kernel: [57504.607386] do_syscall_64+0x5c/0xc0 Aug 22 21:22:10 juju-e4d256-prod-github-runner-207 kernel: [57504.608050] ? do_futex+0x162/0x1f0 Aug 22 21:22:10 juju-e4d256-prod-github-runner-207 kernel: [57504.608710] ? __x64_sys_futex+0x78/0x1e0 Aug 22 21:22:10 juju-e4d256-prod-github-runner-207 kernel: [57504.609384] ? __secure_computing+0xa9/0x120 Aug 22 21:22:10 juju-e4d256-prod-github-runner-207 kernel: [57504.610077] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 21:22:10 juju-e4d256-prod-github-runner-207 kernel: [57504.610841] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:22:10 juju-e4d256-prod-github-runner-207 kernel: [57504.611562] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:22:10 juju-e4d256-prod-github-runner-207 kernel: [57504.612281] ? do_syscall_64+0x69/0xc0 Aug 22 21:22:10 juju-e4d256-prod-github-runner-207 kernel: [57504.612939] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:22:10 juju-e4d256-prod-github-runner-207 kernel: [57504.613653] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:22:10 juju-e4d256-prod-github-runner-207 kernel: [57504.614347] ? do_syscall_64+0x69/0xc0 Aug 22 21:22:10 juju-e4d256-prod-github-runner-207 kernel: [57504.614970] ? do_syscall_64+0x69/0xc0 Aug 22 21:22:10 juju-e4d256-prod-github-runner-207 kernel: [57504.615592] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 21:22:10 juju-e4d256-prod-github-runner-207 kernel: [57504.616295] RIP: 0033:0x7faa5d0edaff Aug 22 21:22:10 juju-e4d256-prod-github-runner-207 kernel: [57504.616970] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 21:22:10 juju-e4d256-prod-github-runner-207 kernel: [57504.618970] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 21:22:10 juju-e4d256-prod-github-runner-207 kernel: [57504.619880] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 21:22:10 juju-e4d256-prod-github-runner-207 kernel: [57504.620780] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 21:22:10 juju-e4d256-prod-github-runner-207 kernel: [57504.621669] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 21:22:10 juju-e4d256-prod-github-runner-207 kernel: [57504.622557] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 21:22:10 juju-e4d256-prod-github-runner-207 kernel: [57504.623445] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 21:22:10 juju-e4d256-prod-github-runner-207 kernel: [57504.624342] Aug 22 21:22:38 juju-e4d256-prod-github-runner-207 kernel: [57532.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 53473s! [qemu-system-x86:6715] Aug 22 21:22:38 juju-e4d256-prod-github-runner-207 kernel: [57532.543100] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 21:22:38 juju-e4d256-prod-github-runner-207 kernel: [57532.543173] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 21:22:38 juju-e4d256-prod-github-runner-207 kernel: [57532.555461] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 21:22:38 juju-e4d256-prod-github-runner-207 kernel: [57532.556740] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 21:22:38 juju-e4d256-prod-github-runner-207 kernel: [57532.557960] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:22:38 juju-e4d256-prod-github-runner-207 kernel: [57532.559016] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 21:22:38 juju-e4d256-prod-github-runner-207 kernel: [57532.561578] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 21:22:38 juju-e4d256-prod-github-runner-207 kernel: [57532.562618] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 21:22:38 juju-e4d256-prod-github-runner-207 kernel: [57532.563783] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 21:22:38 juju-e4d256-prod-github-runner-207 kernel: [57532.564955] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 21:22:38 juju-e4d256-prod-github-runner-207 kernel: [57532.566116] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 21:22:38 juju-e4d256-prod-github-runner-207 kernel: [57532.567276] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 21:22:38 juju-e4d256-prod-github-runner-207 kernel: [57532.568450] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 21:22:38 juju-e4d256-prod-github-runner-207 kernel: [57532.569689] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 21:22:38 juju-e4d256-prod-github-runner-207 kernel: [57532.570785] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 21:22:38 juju-e4d256-prod-github-runner-207 kernel: [57532.571991] Call Trace: Aug 22 21:22:38 juju-e4d256-prod-github-runner-207 kernel: [57532.572906] Aug 22 21:22:38 juju-e4d256-prod-github-runner-207 kernel: [57532.573789] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:22:38 juju-e4d256-prod-github-runner-207 kernel: [57532.574826] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:22:38 juju-e4d256-prod-github-runner-207 kernel: [57532.575845] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:22:38 juju-e4d256-prod-github-runner-207 kernel: [57532.576949] ? show_regs.part.0+0x23/0x29 Aug 22 21:22:38 juju-e4d256-prod-github-runner-207 kernel: [57532.577944] ? show_regs.cold+0x8/0xd Aug 22 21:22:38 juju-e4d256-prod-github-runner-207 kernel: [57532.578912] ? watchdog_timer_fn+0x1be/0x220 Aug 22 21:22:38 juju-e4d256-prod-github-runner-207 kernel: [57532.579917] ? lockup_detector_update_enable+0x60/0x60 Aug 22 21:22:38 juju-e4d256-prod-github-runner-207 kernel: [57532.580990] ? __hrtimer_run_queues+0x107/0x230 Aug 22 21:22:38 juju-e4d256-prod-github-runner-207 kernel: [57532.582032] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 21:22:38 juju-e4d256-prod-github-runner-207 kernel: [57532.583056] ? hrtimer_interrupt+0x101/0x220 Aug 22 21:22:38 juju-e4d256-prod-github-runner-207 kernel: [57532.584133] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 21:22:38 juju-e4d256-prod-github-runner-207 kernel: [57532.585215] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 21:22:38 juju-e4d256-prod-github-runner-207 kernel: [57532.586265] Aug 22 21:22:38 juju-e4d256-prod-github-runner-207 kernel: [57532.587116] Aug 22 21:22:38 juju-e4d256-prod-github-runner-207 kernel: [57532.587980] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 21:22:38 juju-e4d256-prod-github-runner-207 kernel: [57532.589035] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:22:38 juju-e4d256-prod-github-runner-207 kernel: [57532.590075] ? _raw_spin_lock+0x22/0x30 Aug 22 21:22:38 juju-e4d256-prod-github-runner-207 kernel: [57532.591030] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:22:38 juju-e4d256-prod-github-runner-207 kernel: [57532.592070] direct_page_fault+0x206/0x310 [kvm] Aug 22 21:22:38 juju-e4d256-prod-github-runner-207 kernel: [57532.593269] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 21:22:38 juju-e4d256-prod-github-runner-207 kernel: [57532.594286] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 21:22:38 juju-e4d256-prod-github-runner-207 kernel: [57532.595423] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 21:22:38 juju-e4d256-prod-github-runner-207 kernel: [57532.596443] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 21:22:38 juju-e4d256-prod-github-runner-207 kernel: [57532.597395] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 21:22:38 juju-e4d256-prod-github-runner-207 kernel: [57532.598376] handle_exit+0x98/0x230 [kvm_amd] Aug 22 21:22:38 juju-e4d256-prod-github-runner-207 kernel: [57532.599267] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 21:22:38 juju-e4d256-prod-github-runner-207 kernel: [57532.600200] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 21:22:38 juju-e4d256-prod-github-runner-207 kernel: [57532.601150] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 21:22:38 juju-e4d256-prod-github-runner-207 kernel: [57532.602062] vcpu_run+0x62/0x2c0 [kvm] Aug 22 21:22:38 juju-e4d256-prod-github-runner-207 kernel: [57532.602892] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 21:22:38 juju-e4d256-prod-github-runner-207 kernel: [57532.603712] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 21:22:38 juju-e4d256-prod-github-runner-207 kernel: [57532.604597] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 21:22:38 juju-e4d256-prod-github-runner-207 kernel: [57532.605403] ? __seccomp_filter+0x4a/0x4a0 Aug 22 21:22:38 juju-e4d256-prod-github-runner-207 kernel: [57532.606157] ? __fget_files+0x86/0xc0 Aug 22 21:22:38 juju-e4d256-prod-github-runner-207 kernel: [57532.606895] __x64_sys_ioctl+0x95/0xd0 Aug 22 21:22:38 juju-e4d256-prod-github-runner-207 kernel: [57532.607605] do_syscall_64+0x5c/0xc0 Aug 22 21:22:38 juju-e4d256-prod-github-runner-207 kernel: [57532.608293] ? do_futex+0x162/0x1f0 Aug 22 21:22:38 juju-e4d256-prod-github-runner-207 kernel: [57532.608941] ? __x64_sys_futex+0x78/0x1e0 Aug 22 21:22:38 juju-e4d256-prod-github-runner-207 kernel: [57532.609613] ? __secure_computing+0xa9/0x120 Aug 22 21:22:38 juju-e4d256-prod-github-runner-207 kernel: [57532.610300] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 21:22:38 juju-e4d256-prod-github-runner-207 kernel: [57532.611084] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:22:38 juju-e4d256-prod-github-runner-207 kernel: [57532.611801] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:22:38 juju-e4d256-prod-github-runner-207 kernel: [57532.612531] ? do_syscall_64+0x69/0xc0 Aug 22 21:22:38 juju-e4d256-prod-github-runner-207 kernel: [57532.613180] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:22:38 juju-e4d256-prod-github-runner-207 kernel: [57532.613886] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:22:38 juju-e4d256-prod-github-runner-207 kernel: [57532.614585] ? do_syscall_64+0x69/0xc0 Aug 22 21:22:38 juju-e4d256-prod-github-runner-207 kernel: [57532.615208] ? do_syscall_64+0x69/0xc0 Aug 22 21:22:38 juju-e4d256-prod-github-runner-207 kernel: [57532.615833] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 21:22:38 juju-e4d256-prod-github-runner-207 kernel: [57532.616579] RIP: 0033:0x7faa5d0edaff Aug 22 21:22:38 juju-e4d256-prod-github-runner-207 kernel: [57532.617235] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 21:22:38 juju-e4d256-prod-github-runner-207 kernel: [57532.619227] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 21:22:38 juju-e4d256-prod-github-runner-207 kernel: [57532.620158] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 21:22:38 juju-e4d256-prod-github-runner-207 kernel: [57532.621053] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 21:22:38 juju-e4d256-prod-github-runner-207 kernel: [57532.621990] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 21:22:38 juju-e4d256-prod-github-runner-207 kernel: [57532.622886] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 21:22:38 juju-e4d256-prod-github-runner-207 kernel: [57532.623774] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 21:22:38 juju-e4d256-prod-github-runner-207 kernel: [57532.624679] Aug 22 21:23:06 juju-e4d256-prod-github-runner-207 kernel: [57560.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 53499s! [qemu-system-x86:6715] Aug 22 21:23:06 juju-e4d256-prod-github-runner-207 kernel: [57560.543904] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 21:23:06 juju-e4d256-prod-github-runner-207 kernel: [57560.544208] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 21:23:06 juju-e4d256-prod-github-runner-207 kernel: [57560.556418] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 21:23:06 juju-e4d256-prod-github-runner-207 kernel: [57560.557688] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 21:23:06 juju-e4d256-prod-github-runner-207 kernel: [57560.558903] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:23:06 juju-e4d256-prod-github-runner-207 kernel: [57560.559972] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 21:23:06 juju-e4d256-prod-github-runner-207 kernel: [57560.562595] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 21:23:06 juju-e4d256-prod-github-runner-207 kernel: [57560.563646] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 21:23:06 juju-e4d256-prod-github-runner-207 kernel: [57560.564808] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 21:23:06 juju-e4d256-prod-github-runner-207 kernel: [57560.565992] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 21:23:06 juju-e4d256-prod-github-runner-207 kernel: [57560.567162] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 21:23:06 juju-e4d256-prod-github-runner-207 kernel: [57560.568334] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 21:23:06 juju-e4d256-prod-github-runner-207 kernel: [57560.569498] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 21:23:06 juju-e4d256-prod-github-runner-207 kernel: [57560.570732] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 21:23:06 juju-e4d256-prod-github-runner-207 kernel: [57560.571874] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 21:23:06 juju-e4d256-prod-github-runner-207 kernel: [57560.573109] Call Trace: Aug 22 21:23:06 juju-e4d256-prod-github-runner-207 kernel: [57560.574033] Aug 22 21:23:06 juju-e4d256-prod-github-runner-207 kernel: [57560.574936] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:23:06 juju-e4d256-prod-github-runner-207 kernel: [57560.575986] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:23:06 juju-e4d256-prod-github-runner-207 kernel: [57560.577011] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:23:06 juju-e4d256-prod-github-runner-207 kernel: [57560.578116] ? show_regs.part.0+0x23/0x29 Aug 22 21:23:06 juju-e4d256-prod-github-runner-207 kernel: [57560.579160] ? show_regs.cold+0x8/0xd Aug 22 21:23:06 juju-e4d256-prod-github-runner-207 kernel: [57560.580189] ? watchdog_timer_fn+0x1be/0x220 Aug 22 21:23:06 juju-e4d256-prod-github-runner-207 kernel: [57560.581214] ? lockup_detector_update_enable+0x60/0x60 Aug 22 21:23:06 juju-e4d256-prod-github-runner-207 kernel: [57560.582279] ? __hrtimer_run_queues+0x107/0x230 Aug 22 21:23:06 juju-e4d256-prod-github-runner-207 kernel: [57560.583332] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 21:23:06 juju-e4d256-prod-github-runner-207 kernel: [57560.584404] ? hrtimer_interrupt+0x101/0x220 Aug 22 21:23:06 juju-e4d256-prod-github-runner-207 kernel: [57560.585431] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 21:23:06 juju-e4d256-prod-github-runner-207 kernel: [57560.586507] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 21:23:06 juju-e4d256-prod-github-runner-207 kernel: [57560.587552] Aug 22 21:23:06 juju-e4d256-prod-github-runner-207 kernel: [57560.588418] Aug 22 21:23:06 juju-e4d256-prod-github-runner-207 kernel: [57560.589255] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 21:23:06 juju-e4d256-prod-github-runner-207 kernel: [57560.590287] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:23:06 juju-e4d256-prod-github-runner-207 kernel: [57560.591331] ? _raw_spin_lock+0x22/0x30 Aug 22 21:23:06 juju-e4d256-prod-github-runner-207 kernel: [57560.592290] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:23:06 juju-e4d256-prod-github-runner-207 kernel: [57560.593307] direct_page_fault+0x206/0x310 [kvm] Aug 22 21:23:06 juju-e4d256-prod-github-runner-207 kernel: [57560.594331] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 21:23:06 juju-e4d256-prod-github-runner-207 kernel: [57560.595351] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 21:23:06 juju-e4d256-prod-github-runner-207 kernel: [57560.596367] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 21:23:06 juju-e4d256-prod-github-runner-207 kernel: [57560.597486] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 21:23:06 juju-e4d256-prod-github-runner-207 kernel: [57560.598437] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 21:23:06 juju-e4d256-prod-github-runner-207 kernel: [57560.599427] handle_exit+0x98/0x230 [kvm_amd] Aug 22 21:23:06 juju-e4d256-prod-github-runner-207 kernel: [57560.600356] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 21:23:06 juju-e4d256-prod-github-runner-207 kernel: [57560.601282] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 21:23:06 juju-e4d256-prod-github-runner-207 kernel: [57560.602211] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 21:23:06 juju-e4d256-prod-github-runner-207 kernel: [57560.603118] vcpu_run+0x62/0x2c0 [kvm] Aug 22 21:23:06 juju-e4d256-prod-github-runner-207 kernel: [57560.603958] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 21:23:06 juju-e4d256-prod-github-runner-207 kernel: [57560.604770] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 21:23:06 juju-e4d256-prod-github-runner-207 kernel: [57560.605637] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 21:23:06 juju-e4d256-prod-github-runner-207 kernel: [57560.606448] ? __seccomp_filter+0x4a/0x4a0 Aug 22 21:23:06 juju-e4d256-prod-github-runner-207 kernel: [57560.607193] ? __fget_files+0x86/0xc0 Aug 22 21:23:06 juju-e4d256-prod-github-runner-207 kernel: [57560.607915] __x64_sys_ioctl+0x95/0xd0 Aug 22 21:23:06 juju-e4d256-prod-github-runner-207 kernel: [57560.608642] do_syscall_64+0x5c/0xc0 Aug 22 21:23:06 juju-e4d256-prod-github-runner-207 kernel: [57560.609315] ? do_futex+0x162/0x1f0 Aug 22 21:23:06 juju-e4d256-prod-github-runner-207 kernel: [57560.609972] ? __x64_sys_futex+0x78/0x1e0 Aug 22 21:23:06 juju-e4d256-prod-github-runner-207 kernel: [57560.610651] ? __secure_computing+0xa9/0x120 Aug 22 21:23:06 juju-e4d256-prod-github-runner-207 kernel: [57560.611350] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 21:23:06 juju-e4d256-prod-github-runner-207 kernel: [57560.612125] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:23:06 juju-e4d256-prod-github-runner-207 kernel: [57560.612882] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:23:06 juju-e4d256-prod-github-runner-207 kernel: [57560.613640] ? do_syscall_64+0x69/0xc0 Aug 22 21:23:06 juju-e4d256-prod-github-runner-207 kernel: [57560.614317] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:23:06 juju-e4d256-prod-github-runner-207 kernel: [57560.615038] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:23:06 juju-e4d256-prod-github-runner-207 kernel: [57560.615770] ? do_syscall_64+0x69/0xc0 Aug 22 21:23:06 juju-e4d256-prod-github-runner-207 kernel: [57560.616398] ? do_syscall_64+0x69/0xc0 Aug 22 21:23:06 juju-e4d256-prod-github-runner-207 kernel: [57560.617033] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 21:23:06 juju-e4d256-prod-github-runner-207 kernel: [57560.617739] RIP: 0033:0x7faa5d0edaff Aug 22 21:23:06 juju-e4d256-prod-github-runner-207 kernel: [57560.618423] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 21:23:06 juju-e4d256-prod-github-runner-207 kernel: [57560.620468] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 21:23:06 juju-e4d256-prod-github-runner-207 kernel: [57560.621386] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 21:23:06 juju-e4d256-prod-github-runner-207 kernel: [57560.622279] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 21:23:06 juju-e4d256-prod-github-runner-207 kernel: [57560.623184] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 21:23:06 juju-e4d256-prod-github-runner-207 kernel: [57560.624109] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 21:23:06 juju-e4d256-prod-github-runner-207 kernel: [57560.624991] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 21:23:06 juju-e4d256-prod-github-runner-207 kernel: [57560.625889] Aug 22 21:23:34 juju-e4d256-prod-github-runner-207 kernel: [57588.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 53525s! [qemu-system-x86:6715] Aug 22 21:23:34 juju-e4d256-prod-github-runner-207 kernel: [57588.543108] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 21:23:34 juju-e4d256-prod-github-runner-207 kernel: [57588.543185] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 21:23:34 juju-e4d256-prod-github-runner-207 kernel: [57588.555627] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 21:23:34 juju-e4d256-prod-github-runner-207 kernel: [57588.556932] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 21:23:34 juju-e4d256-prod-github-runner-207 kernel: [57588.558332] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:23:34 juju-e4d256-prod-github-runner-207 kernel: [57588.559422] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 21:23:34 juju-e4d256-prod-github-runner-207 kernel: [57588.562029] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 21:23:34 juju-e4d256-prod-github-runner-207 kernel: [57588.563103] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 21:23:34 juju-e4d256-prod-github-runner-207 kernel: [57588.564306] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 21:23:34 juju-e4d256-prod-github-runner-207 kernel: [57588.565486] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 21:23:34 juju-e4d256-prod-github-runner-207 kernel: [57588.566665] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 21:23:34 juju-e4d256-prod-github-runner-207 kernel: [57588.567859] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 21:23:34 juju-e4d256-prod-github-runner-207 kernel: [57588.569045] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 21:23:34 juju-e4d256-prod-github-runner-207 kernel: [57588.570306] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 21:23:34 juju-e4d256-prod-github-runner-207 kernel: [57588.571437] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 21:23:34 juju-e4d256-prod-github-runner-207 kernel: [57588.572664] Call Trace: Aug 22 21:23:34 juju-e4d256-prod-github-runner-207 kernel: [57588.573585] Aug 22 21:23:34 juju-e4d256-prod-github-runner-207 kernel: [57588.574478] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:23:34 juju-e4d256-prod-github-runner-207 kernel: [57588.575556] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:23:34 juju-e4d256-prod-github-runner-207 kernel: [57588.576598] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:23:34 juju-e4d256-prod-github-runner-207 kernel: [57588.577688] ? show_regs.part.0+0x23/0x29 Aug 22 21:23:34 juju-e4d256-prod-github-runner-207 kernel: [57588.578697] ? show_regs.cold+0x8/0xd Aug 22 21:23:34 juju-e4d256-prod-github-runner-207 kernel: [57588.579689] ? watchdog_timer_fn+0x1be/0x220 Aug 22 21:23:34 juju-e4d256-prod-github-runner-207 kernel: [57588.580703] ? lockup_detector_update_enable+0x60/0x60 Aug 22 21:23:34 juju-e4d256-prod-github-runner-207 kernel: [57588.581787] ? __hrtimer_run_queues+0x107/0x230 Aug 22 21:23:34 juju-e4d256-prod-github-runner-207 kernel: [57588.582826] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 21:23:34 juju-e4d256-prod-github-runner-207 kernel: [57588.583877] ? hrtimer_interrupt+0x101/0x220 Aug 22 21:23:34 juju-e4d256-prod-github-runner-207 kernel: [57588.584937] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 21:23:34 juju-e4d256-prod-github-runner-207 kernel: [57588.586033] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 21:23:34 juju-e4d256-prod-github-runner-207 kernel: [57588.587097] Aug 22 21:23:34 juju-e4d256-prod-github-runner-207 kernel: [57588.587971] Aug 22 21:23:34 juju-e4d256-prod-github-runner-207 kernel: [57588.588812] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 21:23:34 juju-e4d256-prod-github-runner-207 kernel: [57588.589860] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:23:34 juju-e4d256-prod-github-runner-207 kernel: [57588.590915] ? _raw_spin_lock+0x22/0x30 Aug 22 21:23:34 juju-e4d256-prod-github-runner-207 kernel: [57588.591875] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:23:34 juju-e4d256-prod-github-runner-207 kernel: [57588.592902] direct_page_fault+0x206/0x310 [kvm] Aug 22 21:23:34 juju-e4d256-prod-github-runner-207 kernel: [57588.593941] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 21:23:34 juju-e4d256-prod-github-runner-207 kernel: [57588.594970] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 21:23:34 juju-e4d256-prod-github-runner-207 kernel: [57588.596010] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 21:23:34 juju-e4d256-prod-github-runner-207 kernel: [57588.596989] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 21:23:34 juju-e4d256-prod-github-runner-207 kernel: [57588.597953] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 21:23:34 juju-e4d256-prod-github-runner-207 kernel: [57588.598943] handle_exit+0x98/0x230 [kvm_amd] Aug 22 21:23:34 juju-e4d256-prod-github-runner-207 kernel: [57588.599850] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 21:23:34 juju-e4d256-prod-github-runner-207 kernel: [57588.600779] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 21:23:34 juju-e4d256-prod-github-runner-207 kernel: [57588.601715] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 21:23:34 juju-e4d256-prod-github-runner-207 kernel: [57588.602670] vcpu_run+0x62/0x2c0 [kvm] Aug 22 21:23:34 juju-e4d256-prod-github-runner-207 kernel: [57588.603526] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 21:23:34 juju-e4d256-prod-github-runner-207 kernel: [57588.604348] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 21:23:34 juju-e4d256-prod-github-runner-207 kernel: [57588.605236] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 21:23:34 juju-e4d256-prod-github-runner-207 kernel: [57588.606054] ? __seccomp_filter+0x4a/0x4a0 Aug 22 21:23:34 juju-e4d256-prod-github-runner-207 kernel: [57588.606805] ? __fget_files+0x86/0xc0 Aug 22 21:23:34 juju-e4d256-prod-github-runner-207 kernel: [57588.607535] __x64_sys_ioctl+0x95/0xd0 Aug 22 21:23:34 juju-e4d256-prod-github-runner-207 kernel: [57588.608237] do_syscall_64+0x5c/0xc0 Aug 22 21:23:34 juju-e4d256-prod-github-runner-207 kernel: [57588.608908] ? do_futex+0x162/0x1f0 Aug 22 21:23:34 juju-e4d256-prod-github-runner-207 kernel: [57588.609564] ? __x64_sys_futex+0x78/0x1e0 Aug 22 21:23:34 juju-e4d256-prod-github-runner-207 kernel: [57588.610246] ? __secure_computing+0xa9/0x120 Aug 22 21:23:34 juju-e4d256-prod-github-runner-207 kernel: [57588.610945] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 21:23:34 juju-e4d256-prod-github-runner-207 kernel: [57588.611727] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:23:34 juju-e4d256-prod-github-runner-207 kernel: [57588.612462] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:23:34 juju-e4d256-prod-github-runner-207 kernel: [57588.613198] ? do_syscall_64+0x69/0xc0 Aug 22 21:23:34 juju-e4d256-prod-github-runner-207 kernel: [57588.613852] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:23:34 juju-e4d256-prod-github-runner-207 kernel: [57588.614569] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:23:34 juju-e4d256-prod-github-runner-207 kernel: [57588.615294] ? do_syscall_64+0x69/0xc0 Aug 22 21:23:34 juju-e4d256-prod-github-runner-207 kernel: [57588.615930] ? do_syscall_64+0x69/0xc0 Aug 22 21:23:34 juju-e4d256-prod-github-runner-207 kernel: [57588.616567] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 21:23:34 juju-e4d256-prod-github-runner-207 kernel: [57588.617287] RIP: 0033:0x7faa5d0edaff Aug 22 21:23:34 juju-e4d256-prod-github-runner-207 kernel: [57588.617943] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 21:23:34 juju-e4d256-prod-github-runner-207 kernel: [57588.619999] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 21:23:34 juju-e4d256-prod-github-runner-207 kernel: [57588.620929] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 21:23:34 juju-e4d256-prod-github-runner-207 kernel: [57588.621833] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 21:23:34 juju-e4d256-prod-github-runner-207 kernel: [57588.622758] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 21:23:34 juju-e4d256-prod-github-runner-207 kernel: [57588.623675] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 21:23:34 juju-e4d256-prod-github-runner-207 kernel: [57588.624586] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 21:23:34 juju-e4d256-prod-github-runner-207 kernel: [57588.625498] Aug 22 21:23:47 juju-e4d256-prod-github-runner-207 kernel: [57601.028705] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 21:23:47 juju-e4d256-prod-github-runner-207 kernel: [57601.029685] rcu: 1-....: (14325712 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=6923121 Aug 22 21:23:47 juju-e4d256-prod-github-runner-207 kernel: [57601.030845] (t=14370957 jiffies g=23269 q=52467) Aug 22 21:23:47 juju-e4d256-prod-github-runner-207 kernel: [57601.031662] NMI backtrace for cpu 1 Aug 22 21:23:47 juju-e4d256-prod-github-runner-207 kernel: [57601.032406] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 21:23:47 juju-e4d256-prod-github-runner-207 kernel: [57601.033540] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 21:23:47 juju-e4d256-prod-github-runner-207 kernel: [57601.034751] Call Trace: Aug 22 21:23:47 juju-e4d256-prod-github-runner-207 kernel: [57601.035446] Aug 22 21:23:47 juju-e4d256-prod-github-runner-207 kernel: [57601.036097] show_stack+0x52/0x5c Aug 22 21:23:47 juju-e4d256-prod-github-runner-207 kernel: [57601.036861] dump_stack_lvl+0x4a/0x63 Aug 22 21:23:47 juju-e4d256-prod-github-runner-207 kernel: [57601.037614] dump_stack+0x10/0x16 Aug 22 21:23:47 juju-e4d256-prod-github-runner-207 kernel: [57601.038356] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 21:23:47 juju-e4d256-prod-github-runner-207 kernel: [57601.039162] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 21:23:47 juju-e4d256-prod-github-runner-207 kernel: [57601.039958] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 21:23:47 juju-e4d256-prod-github-runner-207 kernel: [57601.040793] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 21:23:47 juju-e4d256-prod-github-runner-207 kernel: [57601.041628] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 21:23:47 juju-e4d256-prod-github-runner-207 kernel: [57601.042453] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 21:23:47 juju-e4d256-prod-github-runner-207 kernel: [57601.043428] print_cpu_stall.cold+0x2f/0xe2 Aug 22 21:23:47 juju-e4d256-prod-github-runner-207 kernel: [57601.044200] ? timekeeping_update+0xf7/0x150 Aug 22 21:23:47 juju-e4d256-prod-github-runner-207 kernel: [57601.044979] check_cpu_stall+0x109/0x270 Aug 22 21:23:47 juju-e4d256-prod-github-runner-207 kernel: [57601.045732] rcu_sched_clock_irq+0x9a/0x250 Aug 22 21:23:47 juju-e4d256-prod-github-runner-207 kernel: [57601.046493] update_process_times+0x94/0xd0 Aug 22 21:23:47 juju-e4d256-prod-github-runner-207 kernel: [57601.047266] tick_sched_handle+0x29/0x70 Aug 22 21:23:47 juju-e4d256-prod-github-runner-207 kernel: [57601.048011] tick_sched_timer+0x8c/0xc0 Aug 22 21:23:47 juju-e4d256-prod-github-runner-207 kernel: [57601.048747] ? tick_nohz_handler+0xb0/0xb0 Aug 22 21:23:47 juju-e4d256-prod-github-runner-207 kernel: [57601.049511] __hrtimer_run_queues+0x107/0x230 Aug 22 21:23:47 juju-e4d256-prod-github-runner-207 kernel: [57601.050293] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 21:23:47 juju-e4d256-prod-github-runner-207 kernel: [57601.051076] hrtimer_interrupt+0x101/0x220 Aug 22 21:23:47 juju-e4d256-prod-github-runner-207 kernel: [57601.051851] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 21:23:47 juju-e4d256-prod-github-runner-207 kernel: [57601.052660] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 21:23:47 juju-e4d256-prod-github-runner-207 kernel: [57601.053459] Aug 22 21:23:47 juju-e4d256-prod-github-runner-207 kernel: [57601.054094] Aug 22 21:23:47 juju-e4d256-prod-github-runner-207 kernel: [57601.054723] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 21:23:47 juju-e4d256-prod-github-runner-207 kernel: [57601.055555] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:23:47 juju-e4d256-prod-github-runner-207 kernel: [57601.056432] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 21:23:47 juju-e4d256-prod-github-runner-207 kernel: [57601.058661] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 21:23:47 juju-e4d256-prod-github-runner-207 kernel: [57601.059548] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 21:23:47 juju-e4d256-prod-github-runner-207 kernel: [57601.060542] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 21:23:47 juju-e4d256-prod-github-runner-207 kernel: [57601.061525] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 21:23:47 juju-e4d256-prod-github-runner-207 kernel: [57601.062503] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 21:23:47 juju-e4d256-prod-github-runner-207 kernel: [57601.063477] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 21:23:47 juju-e4d256-prod-github-runner-207 kernel: [57601.064434] ? _raw_spin_lock+0x22/0x30 Aug 22 21:23:47 juju-e4d256-prod-github-runner-207 kernel: [57601.065193] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:23:47 juju-e4d256-prod-github-runner-207 kernel: [57601.066075] direct_page_fault+0x206/0x310 [kvm] Aug 22 21:23:47 juju-e4d256-prod-github-runner-207 kernel: [57601.066914] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 21:23:47 juju-e4d256-prod-github-runner-207 kernel: [57601.067750] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 21:23:47 juju-e4d256-prod-github-runner-207 kernel: [57601.068603] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 21:23:47 juju-e4d256-prod-github-runner-207 kernel: [57601.069432] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 21:23:47 juju-e4d256-prod-github-runner-207 kernel: [57601.070219] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 21:23:47 juju-e4d256-prod-github-runner-207 kernel: [57601.071053] handle_exit+0x98/0x230 [kvm_amd] Aug 22 21:23:47 juju-e4d256-prod-github-runner-207 kernel: [57601.071817] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 21:23:47 juju-e4d256-prod-github-runner-207 kernel: [57601.072604] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 21:23:47 juju-e4d256-prod-github-runner-207 kernel: [57601.073402] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 21:23:47 juju-e4d256-prod-github-runner-207 kernel: [57601.074185] vcpu_run+0x62/0x2c0 [kvm] Aug 22 21:23:47 juju-e4d256-prod-github-runner-207 kernel: [57601.074904] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 21:23:47 juju-e4d256-prod-github-runner-207 kernel: [57601.075644] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 21:23:47 juju-e4d256-prod-github-runner-207 kernel: [57601.076447] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 21:23:47 juju-e4d256-prod-github-runner-207 kernel: [57601.077206] ? __seccomp_filter+0x4a/0x4a0 Aug 22 21:23:47 juju-e4d256-prod-github-runner-207 kernel: [57601.077923] ? __fget_files+0x86/0xc0 Aug 22 21:23:47 juju-e4d256-prod-github-runner-207 kernel: [57601.078619] __x64_sys_ioctl+0x95/0xd0 Aug 22 21:23:47 juju-e4d256-prod-github-runner-207 kernel: [57601.079357] do_syscall_64+0x5c/0xc0 Aug 22 21:23:47 juju-e4d256-prod-github-runner-207 kernel: [57601.080041] ? do_futex+0x162/0x1f0 Aug 22 21:23:47 juju-e4d256-prod-github-runner-207 kernel: [57601.080719] ? __x64_sys_futex+0x78/0x1e0 Aug 22 21:23:47 juju-e4d256-prod-github-runner-207 kernel: [57601.081432] ? __secure_computing+0xa9/0x120 Aug 22 21:23:47 juju-e4d256-prod-github-runner-207 kernel: [57601.082149] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 21:23:47 juju-e4d256-prod-github-runner-207 kernel: [57601.082944] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:23:47 juju-e4d256-prod-github-runner-207 kernel: [57601.083711] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:23:47 juju-e4d256-prod-github-runner-207 kernel: [57601.084478] ? do_syscall_64+0x69/0xc0 Aug 22 21:23:47 juju-e4d256-prod-github-runner-207 kernel: [57601.085187] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:23:47 juju-e4d256-prod-github-runner-207 kernel: [57601.085943] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:23:47 juju-e4d256-prod-github-runner-207 kernel: [57601.086707] ? do_syscall_64+0x69/0xc0 Aug 22 21:23:47 juju-e4d256-prod-github-runner-207 kernel: [57601.087421] ? do_syscall_64+0x69/0xc0 Aug 22 21:23:47 juju-e4d256-prod-github-runner-207 kernel: [57601.088108] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 21:23:47 juju-e4d256-prod-github-runner-207 kernel: [57601.088877] RIP: 0033:0x7faa5d0edaff Aug 22 21:23:47 juju-e4d256-prod-github-runner-207 kernel: [57601.089564] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 21:23:47 juju-e4d256-prod-github-runner-207 kernel: [57601.091684] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 21:23:47 juju-e4d256-prod-github-runner-207 kernel: [57601.092658] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 21:23:47 juju-e4d256-prod-github-runner-207 kernel: [57601.093605] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 21:23:47 juju-e4d256-prod-github-runner-207 kernel: [57601.094545] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 21:23:47 juju-e4d256-prod-github-runner-207 kernel: [57601.095500] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 21:23:47 juju-e4d256-prod-github-runner-207 kernel: [57601.096426] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 21:23:47 juju-e4d256-prod-github-runner-207 kernel: [57601.097345] Aug 22 21:24:14 juju-e4d256-prod-github-runner-207 kernel: [57628.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 53562s! [qemu-system-x86:6715] Aug 22 21:24:14 juju-e4d256-prod-github-runner-207 kernel: [57628.543158] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 21:24:14 juju-e4d256-prod-github-runner-207 kernel: [57628.543233] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 21:24:14 juju-e4d256-prod-github-runner-207 kernel: [57628.555465] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 21:24:14 juju-e4d256-prod-github-runner-207 kernel: [57628.556735] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 21:24:14 juju-e4d256-prod-github-runner-207 kernel: [57628.557967] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:24:14 juju-e4d256-prod-github-runner-207 kernel: [57628.559097] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 21:24:14 juju-e4d256-prod-github-runner-207 kernel: [57628.561685] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 21:24:14 juju-e4d256-prod-github-runner-207 kernel: [57628.562735] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 21:24:14 juju-e4d256-prod-github-runner-207 kernel: [57628.564255] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 21:24:14 juju-e4d256-prod-github-runner-207 kernel: [57628.565438] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 21:24:14 juju-e4d256-prod-github-runner-207 kernel: [57628.566609] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 21:24:14 juju-e4d256-prod-github-runner-207 kernel: [57628.567803] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 21:24:14 juju-e4d256-prod-github-runner-207 kernel: [57628.568986] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 21:24:14 juju-e4d256-prod-github-runner-207 kernel: [57628.570226] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 21:24:14 juju-e4d256-prod-github-runner-207 kernel: [57628.571338] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 21:24:14 juju-e4d256-prod-github-runner-207 kernel: [57628.572526] Call Trace: Aug 22 21:24:14 juju-e4d256-prod-github-runner-207 kernel: [57628.573438] Aug 22 21:24:14 juju-e4d256-prod-github-runner-207 kernel: [57628.574327] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:24:14 juju-e4d256-prod-github-runner-207 kernel: [57628.575372] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:24:14 juju-e4d256-prod-github-runner-207 kernel: [57628.576401] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:24:14 juju-e4d256-prod-github-runner-207 kernel: [57628.577474] ? show_regs.part.0+0x23/0x29 Aug 22 21:24:14 juju-e4d256-prod-github-runner-207 kernel: [57628.578495] ? show_regs.cold+0x8/0xd Aug 22 21:24:14 juju-e4d256-prod-github-runner-207 kernel: [57628.579549] ? watchdog_timer_fn+0x1be/0x220 Aug 22 21:24:14 juju-e4d256-prod-github-runner-207 kernel: [57628.580571] ? lockup_detector_update_enable+0x60/0x60 Aug 22 21:24:14 juju-e4d256-prod-github-runner-207 kernel: [57628.581632] ? __hrtimer_run_queues+0x107/0x230 Aug 22 21:24:14 juju-e4d256-prod-github-runner-207 kernel: [57628.582656] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 21:24:14 juju-e4d256-prod-github-runner-207 kernel: [57628.583689] ? hrtimer_interrupt+0x101/0x220 Aug 22 21:24:14 juju-e4d256-prod-github-runner-207 kernel: [57628.584753] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 21:24:14 juju-e4d256-prod-github-runner-207 kernel: [57628.585833] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 21:24:14 juju-e4d256-prod-github-runner-207 kernel: [57628.586916] Aug 22 21:24:14 juju-e4d256-prod-github-runner-207 kernel: [57628.587780] Aug 22 21:24:14 juju-e4d256-prod-github-runner-207 kernel: [57628.588620] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 21:24:14 juju-e4d256-prod-github-runner-207 kernel: [57628.589698] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:24:14 juju-e4d256-prod-github-runner-207 kernel: [57628.590755] ? _raw_spin_lock+0x22/0x30 Aug 22 21:24:14 juju-e4d256-prod-github-runner-207 kernel: [57628.591715] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:24:14 juju-e4d256-prod-github-runner-207 kernel: [57628.592730] direct_page_fault+0x206/0x310 [kvm] Aug 22 21:24:14 juju-e4d256-prod-github-runner-207 kernel: [57628.593755] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 21:24:14 juju-e4d256-prod-github-runner-207 kernel: [57628.594788] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 21:24:14 juju-e4d256-prod-github-runner-207 kernel: [57628.595800] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 21:24:14 juju-e4d256-prod-github-runner-207 kernel: [57628.596780] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 21:24:14 juju-e4d256-prod-github-runner-207 kernel: [57628.597731] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 21:24:14 juju-e4d256-prod-github-runner-207 kernel: [57628.598721] handle_exit+0x98/0x230 [kvm_amd] Aug 22 21:24:14 juju-e4d256-prod-github-runner-207 kernel: [57628.599689] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 21:24:14 juju-e4d256-prod-github-runner-207 kernel: [57628.600654] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 21:24:14 juju-e4d256-prod-github-runner-207 kernel: [57628.601592] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 21:24:14 juju-e4d256-prod-github-runner-207 kernel: [57628.602499] vcpu_run+0x62/0x2c0 [kvm] Aug 22 21:24:14 juju-e4d256-prod-github-runner-207 kernel: [57628.603322] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 21:24:14 juju-e4d256-prod-github-runner-207 kernel: [57628.604148] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 21:24:14 juju-e4d256-prod-github-runner-207 kernel: [57628.605036] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 21:24:14 juju-e4d256-prod-github-runner-207 kernel: [57628.605862] ? __seccomp_filter+0x4a/0x4a0 Aug 22 21:24:14 juju-e4d256-prod-github-runner-207 kernel: [57628.606636] ? __fget_files+0x86/0xc0 Aug 22 21:24:14 juju-e4d256-prod-github-runner-207 kernel: [57628.607356] __x64_sys_ioctl+0x95/0xd0 Aug 22 21:24:14 juju-e4d256-prod-github-runner-207 kernel: [57628.608048] do_syscall_64+0x5c/0xc0 Aug 22 21:24:14 juju-e4d256-prod-github-runner-207 kernel: [57628.608717] ? do_futex+0x162/0x1f0 Aug 22 21:24:14 juju-e4d256-prod-github-runner-207 kernel: [57628.609364] ? __x64_sys_futex+0x78/0x1e0 Aug 22 21:24:14 juju-e4d256-prod-github-runner-207 kernel: [57628.610073] ? __secure_computing+0xa9/0x120 Aug 22 21:24:14 juju-e4d256-prod-github-runner-207 kernel: [57628.610789] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 21:24:14 juju-e4d256-prod-github-runner-207 kernel: [57628.611551] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:24:14 juju-e4d256-prod-github-runner-207 kernel: [57628.612272] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:24:14 juju-e4d256-prod-github-runner-207 kernel: [57628.612993] ? do_syscall_64+0x69/0xc0 Aug 22 21:24:14 juju-e4d256-prod-github-runner-207 kernel: [57628.613652] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:24:14 juju-e4d256-prod-github-runner-207 kernel: [57628.614357] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:24:14 juju-e4d256-prod-github-runner-207 kernel: [57628.615091] ? do_syscall_64+0x69/0xc0 Aug 22 21:24:14 juju-e4d256-prod-github-runner-207 kernel: [57628.615736] ? do_syscall_64+0x69/0xc0 Aug 22 21:24:14 juju-e4d256-prod-github-runner-207 kernel: [57628.616360] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 21:24:14 juju-e4d256-prod-github-runner-207 kernel: [57628.617070] RIP: 0033:0x7faa5d0edaff Aug 22 21:24:14 juju-e4d256-prod-github-runner-207 kernel: [57628.617694] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 21:24:14 juju-e4d256-prod-github-runner-207 kernel: [57628.619730] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 21:24:14 juju-e4d256-prod-github-runner-207 kernel: [57628.620704] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 21:24:14 juju-e4d256-prod-github-runner-207 kernel: [57628.621629] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 21:24:14 juju-e4d256-prod-github-runner-207 kernel: [57628.622519] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 21:24:14 juju-e4d256-prod-github-runner-207 kernel: [57628.623421] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 21:24:14 juju-e4d256-prod-github-runner-207 kernel: [57628.624306] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 21:24:14 juju-e4d256-prod-github-runner-207 kernel: [57628.625196] Aug 22 21:24:42 juju-e4d256-prod-github-runner-207 kernel: [57656.541980] watchdog: BUG: soft lockup - CPU#1 stuck for 53588s! [qemu-system-x86:6715] Aug 22 21:24:42 juju-e4d256-prod-github-runner-207 kernel: [57656.543861] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 21:24:42 juju-e4d256-prod-github-runner-207 kernel: [57656.544160] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 21:24:42 juju-e4d256-prod-github-runner-207 kernel: [57656.556293] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 21:24:42 juju-e4d256-prod-github-runner-207 kernel: [57656.557561] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 21:24:42 juju-e4d256-prod-github-runner-207 kernel: [57656.558790] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:24:42 juju-e4d256-prod-github-runner-207 kernel: [57656.559846] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 21:24:42 juju-e4d256-prod-github-runner-207 kernel: [57656.562391] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 21:24:42 juju-e4d256-prod-github-runner-207 kernel: [57656.563442] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 21:24:42 juju-e4d256-prod-github-runner-207 kernel: [57656.564596] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 21:24:42 juju-e4d256-prod-github-runner-207 kernel: [57656.565759] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 21:24:42 juju-e4d256-prod-github-runner-207 kernel: [57656.567776] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 21:24:42 juju-e4d256-prod-github-runner-207 kernel: [57656.568936] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 21:24:42 juju-e4d256-prod-github-runner-207 kernel: [57656.570269] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 21:24:42 juju-e4d256-prod-github-runner-207 kernel: [57656.571536] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 21:24:42 juju-e4d256-prod-github-runner-207 kernel: [57656.572642] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 21:24:42 juju-e4d256-prod-github-runner-207 kernel: [57656.573869] Call Trace: Aug 22 21:24:42 juju-e4d256-prod-github-runner-207 kernel: [57656.574812] Aug 22 21:24:42 juju-e4d256-prod-github-runner-207 kernel: [57656.575718] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:24:42 juju-e4d256-prod-github-runner-207 kernel: [57656.576770] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:24:42 juju-e4d256-prod-github-runner-207 kernel: [57656.577794] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:24:42 juju-e4d256-prod-github-runner-207 kernel: [57656.578909] ? show_regs.part.0+0x23/0x29 Aug 22 21:24:42 juju-e4d256-prod-github-runner-207 kernel: [57656.579919] ? show_regs.cold+0x8/0xd Aug 22 21:24:42 juju-e4d256-prod-github-runner-207 kernel: [57656.580890] ? watchdog_timer_fn+0x1be/0x220 Aug 22 21:24:42 juju-e4d256-prod-github-runner-207 kernel: [57656.581899] ? lockup_detector_update_enable+0x60/0x60 Aug 22 21:24:42 juju-e4d256-prod-github-runner-207 kernel: [57656.582981] ? __hrtimer_run_queues+0x107/0x230 Aug 22 21:24:42 juju-e4d256-prod-github-runner-207 kernel: [57656.584009] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 21:24:42 juju-e4d256-prod-github-runner-207 kernel: [57656.585029] ? hrtimer_interrupt+0x101/0x220 Aug 22 21:24:42 juju-e4d256-prod-github-runner-207 kernel: [57656.586042] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 21:24:42 juju-e4d256-prod-github-runner-207 kernel: [57656.587123] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 21:24:42 juju-e4d256-prod-github-runner-207 kernel: [57656.588180] Aug 22 21:24:42 juju-e4d256-prod-github-runner-207 kernel: [57656.589035] Aug 22 21:24:42 juju-e4d256-prod-github-runner-207 kernel: [57656.589872] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 21:24:42 juju-e4d256-prod-github-runner-207 kernel: [57656.590916] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:24:42 juju-e4d256-prod-github-runner-207 kernel: [57656.591960] ? _raw_spin_lock+0x22/0x30 Aug 22 21:24:42 juju-e4d256-prod-github-runner-207 kernel: [57656.592904] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:24:42 juju-e4d256-prod-github-runner-207 kernel: [57656.593957] direct_page_fault+0x206/0x310 [kvm] Aug 22 21:24:42 juju-e4d256-prod-github-runner-207 kernel: [57656.594992] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 21:24:42 juju-e4d256-prod-github-runner-207 kernel: [57656.596001] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 21:24:42 juju-e4d256-prod-github-runner-207 kernel: [57656.597007] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 21:24:42 juju-e4d256-prod-github-runner-207 kernel: [57656.598007] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 21:24:42 juju-e4d256-prod-github-runner-207 kernel: [57656.599107] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 21:24:42 juju-e4d256-prod-github-runner-207 kernel: [57656.600086] handle_exit+0x98/0x230 [kvm_amd] Aug 22 21:24:42 juju-e4d256-prod-github-runner-207 kernel: [57656.601025] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 21:24:42 juju-e4d256-prod-github-runner-207 kernel: [57656.601960] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 21:24:42 juju-e4d256-prod-github-runner-207 kernel: [57656.602917] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 21:24:42 juju-e4d256-prod-github-runner-207 kernel: [57656.603837] vcpu_run+0x62/0x2c0 [kvm] Aug 22 21:24:42 juju-e4d256-prod-github-runner-207 kernel: [57656.604682] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 21:24:42 juju-e4d256-prod-github-runner-207 kernel: [57656.605508] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 21:24:42 juju-e4d256-prod-github-runner-207 kernel: [57656.606391] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 21:24:42 juju-e4d256-prod-github-runner-207 kernel: [57656.607247] ? __seccomp_filter+0x4a/0x4a0 Aug 22 21:24:42 juju-e4d256-prod-github-runner-207 kernel: [57656.607994] ? __fget_files+0x86/0xc0 Aug 22 21:24:42 juju-e4d256-prod-github-runner-207 kernel: [57656.608697] __x64_sys_ioctl+0x95/0xd0 Aug 22 21:24:42 juju-e4d256-prod-github-runner-207 kernel: [57656.609388] do_syscall_64+0x5c/0xc0 Aug 22 21:24:42 juju-e4d256-prod-github-runner-207 kernel: [57656.610052] ? do_futex+0x162/0x1f0 Aug 22 21:24:42 juju-e4d256-prod-github-runner-207 kernel: [57656.610712] ? __x64_sys_futex+0x78/0x1e0 Aug 22 21:24:42 juju-e4d256-prod-github-runner-207 kernel: [57656.611398] ? __secure_computing+0xa9/0x120 Aug 22 21:24:42 juju-e4d256-prod-github-runner-207 kernel: [57656.612087] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 21:24:42 juju-e4d256-prod-github-runner-207 kernel: [57656.612844] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:24:42 juju-e4d256-prod-github-runner-207 kernel: [57656.613565] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:24:42 juju-e4d256-prod-github-runner-207 kernel: [57656.614285] ? do_syscall_64+0x69/0xc0 Aug 22 21:24:42 juju-e4d256-prod-github-runner-207 kernel: [57656.614943] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:24:42 juju-e4d256-prod-github-runner-207 kernel: [57656.615643] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:24:42 juju-e4d256-prod-github-runner-207 kernel: [57656.616334] ? do_syscall_64+0x69/0xc0 Aug 22 21:24:42 juju-e4d256-prod-github-runner-207 kernel: [57656.616960] ? do_syscall_64+0x69/0xc0 Aug 22 21:24:42 juju-e4d256-prod-github-runner-207 kernel: [57656.617602] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 21:24:42 juju-e4d256-prod-github-runner-207 kernel: [57656.618312] RIP: 0033:0x7faa5d0edaff Aug 22 21:24:42 juju-e4d256-prod-github-runner-207 kernel: [57656.618980] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 21:24:42 juju-e4d256-prod-github-runner-207 kernel: [57656.620965] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 21:24:42 juju-e4d256-prod-github-runner-207 kernel: [57656.621873] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 21:24:42 juju-e4d256-prod-github-runner-207 kernel: [57656.622770] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 21:24:42 juju-e4d256-prod-github-runner-207 kernel: [57656.623654] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 21:24:42 juju-e4d256-prod-github-runner-207 kernel: [57656.624542] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 21:24:42 juju-e4d256-prod-github-runner-207 kernel: [57656.625427] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 21:24:42 juju-e4d256-prod-github-runner-207 kernel: [57656.626317] Aug 22 21:25:10 juju-e4d256-prod-github-runner-207 kernel: [57684.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 53614s! [qemu-system-x86:6715] Aug 22 21:25:10 juju-e4d256-prod-github-runner-207 kernel: [57684.543120] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 21:25:10 juju-e4d256-prod-github-runner-207 kernel: [57684.543194] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 21:25:10 juju-e4d256-prod-github-runner-207 kernel: [57684.555620] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 21:25:10 juju-e4d256-prod-github-runner-207 kernel: [57684.556908] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 21:25:10 juju-e4d256-prod-github-runner-207 kernel: [57684.558165] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:25:10 juju-e4d256-prod-github-runner-207 kernel: [57684.559246] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 21:25:10 juju-e4d256-prod-github-runner-207 kernel: [57684.561876] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 21:25:10 juju-e4d256-prod-github-runner-207 kernel: [57684.562960] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 21:25:10 juju-e4d256-prod-github-runner-207 kernel: [57684.564169] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 21:25:10 juju-e4d256-prod-github-runner-207 kernel: [57684.565366] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 21:25:10 juju-e4d256-prod-github-runner-207 kernel: [57684.566560] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 21:25:10 juju-e4d256-prod-github-runner-207 kernel: [57684.567742] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 21:25:10 juju-e4d256-prod-github-runner-207 kernel: [57684.568928] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 21:25:10 juju-e4d256-prod-github-runner-207 kernel: [57684.570204] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 21:25:10 juju-e4d256-prod-github-runner-207 kernel: [57684.571340] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 21:25:10 juju-e4d256-prod-github-runner-207 kernel: [57684.572584] Call Trace: Aug 22 21:25:10 juju-e4d256-prod-github-runner-207 kernel: [57684.573517] Aug 22 21:25:10 juju-e4d256-prod-github-runner-207 kernel: [57684.574422] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:25:10 juju-e4d256-prod-github-runner-207 kernel: [57684.575495] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:25:10 juju-e4d256-prod-github-runner-207 kernel: [57684.576546] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:25:10 juju-e4d256-prod-github-runner-207 kernel: [57684.577655] ? show_regs.part.0+0x23/0x29 Aug 22 21:25:10 juju-e4d256-prod-github-runner-207 kernel: [57684.578713] ? show_regs.cold+0x8/0xd Aug 22 21:25:10 juju-e4d256-prod-github-runner-207 kernel: [57684.579746] ? watchdog_timer_fn+0x1be/0x220 Aug 22 21:25:10 juju-e4d256-prod-github-runner-207 kernel: [57684.580766] ? lockup_detector_update_enable+0x60/0x60 Aug 22 21:25:10 juju-e4d256-prod-github-runner-207 kernel: [57684.581842] ? __hrtimer_run_queues+0x107/0x230 Aug 22 21:25:10 juju-e4d256-prod-github-runner-207 kernel: [57684.583051] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 21:25:10 juju-e4d256-prod-github-runner-207 kernel: [57684.584108] ? hrtimer_interrupt+0x101/0x220 Aug 22 21:25:10 juju-e4d256-prod-github-runner-207 kernel: [57684.585162] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 21:25:10 juju-e4d256-prod-github-runner-207 kernel: [57684.586313] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 21:25:10 juju-e4d256-prod-github-runner-207 kernel: [57684.587444] Aug 22 21:25:10 juju-e4d256-prod-github-runner-207 kernel: [57684.588330] Aug 22 21:25:10 juju-e4d256-prod-github-runner-207 kernel: [57684.589177] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 21:25:10 juju-e4d256-prod-github-runner-207 kernel: [57684.590289] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:25:10 juju-e4d256-prod-github-runner-207 kernel: [57684.591351] ? _raw_spin_lock+0x22/0x30 Aug 22 21:25:10 juju-e4d256-prod-github-runner-207 kernel: [57684.592482] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:25:10 juju-e4d256-prod-github-runner-207 kernel: [57684.593757] direct_page_fault+0x206/0x310 [kvm] Aug 22 21:25:10 juju-e4d256-prod-github-runner-207 kernel: [57684.594996] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 21:25:10 juju-e4d256-prod-github-runner-207 kernel: [57684.596060] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 21:25:10 juju-e4d256-prod-github-runner-207 kernel: [57684.597123] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 21:25:10 juju-e4d256-prod-github-runner-207 kernel: [57684.598268] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 21:25:10 juju-e4d256-prod-github-runner-207 kernel: [57684.599276] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 21:25:10 juju-e4d256-prod-github-runner-207 kernel: [57684.600307] handle_exit+0x98/0x230 [kvm_amd] Aug 22 21:25:10 juju-e4d256-prod-github-runner-207 kernel: [57684.601272] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 21:25:10 juju-e4d256-prod-github-runner-207 kernel: [57684.602223] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 21:25:10 juju-e4d256-prod-github-runner-207 kernel: [57684.603443] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 21:25:10 juju-e4d256-prod-github-runner-207 kernel: [57684.604395] vcpu_run+0x62/0x2c0 [kvm] Aug 22 21:25:10 juju-e4d256-prod-github-runner-207 kernel: [57684.605243] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 21:25:10 juju-e4d256-prod-github-runner-207 kernel: [57684.606077] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 21:25:10 juju-e4d256-prod-github-runner-207 kernel: [57684.606958] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 21:25:10 juju-e4d256-prod-github-runner-207 kernel: [57684.607777] ? __seccomp_filter+0x4a/0x4a0 Aug 22 21:25:10 juju-e4d256-prod-github-runner-207 kernel: [57684.608538] ? __fget_files+0x86/0xc0 Aug 22 21:25:10 juju-e4d256-prod-github-runner-207 kernel: [57684.609256] __x64_sys_ioctl+0x95/0xd0 Aug 22 21:25:10 juju-e4d256-prod-github-runner-207 kernel: [57684.609963] do_syscall_64+0x5c/0xc0 Aug 22 21:25:10 juju-e4d256-prod-github-runner-207 kernel: [57684.610654] ? do_futex+0x162/0x1f0 Aug 22 21:25:10 juju-e4d256-prod-github-runner-207 kernel: [57684.611489] ? __x64_sys_futex+0x78/0x1e0 Aug 22 21:25:10 juju-e4d256-prod-github-runner-207 kernel: [57684.612386] ? __secure_computing+0xa9/0x120 Aug 22 21:25:10 juju-e4d256-prod-github-runner-207 kernel: [57684.613233] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 21:25:10 juju-e4d256-prod-github-runner-207 kernel: [57684.614042] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:25:10 juju-e4d256-prod-github-runner-207 kernel: [57684.614908] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:25:10 juju-e4d256-prod-github-runner-207 kernel: [57684.615749] ? do_syscall_64+0x69/0xc0 Aug 22 21:25:10 juju-e4d256-prod-github-runner-207 kernel: [57684.616449] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:25:10 juju-e4d256-prod-github-runner-207 kernel: [57684.617343] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:25:10 juju-e4d256-prod-github-runner-207 kernel: [57684.618170] ? do_syscall_64+0x69/0xc0 Aug 22 21:25:10 juju-e4d256-prod-github-runner-207 kernel: [57684.618823] ? do_syscall_64+0x69/0xc0 Aug 22 21:25:10 juju-e4d256-prod-github-runner-207 kernel: [57684.619527] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 21:25:10 juju-e4d256-prod-github-runner-207 kernel: [57684.620283] RIP: 0033:0x7faa5d0edaff Aug 22 21:25:10 juju-e4d256-prod-github-runner-207 kernel: [57684.620923] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 21:25:10 juju-e4d256-prod-github-runner-207 kernel: [57684.623003] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 21:25:10 juju-e4d256-prod-github-runner-207 kernel: [57684.623988] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 21:25:10 juju-e4d256-prod-github-runner-207 kernel: [57684.624901] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 21:25:10 juju-e4d256-prod-github-runner-207 kernel: [57684.625822] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 21:25:10 juju-e4d256-prod-github-runner-207 kernel: [57684.626759] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 21:25:10 juju-e4d256-prod-github-runner-207 kernel: [57684.627663] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 21:25:10 juju-e4d256-prod-github-runner-207 kernel: [57684.628570] Aug 22 21:25:38 juju-e4d256-prod-github-runner-207 kernel: [57712.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 53640s! [qemu-system-x86:6715] Aug 22 21:25:38 juju-e4d256-prod-github-runner-207 kernel: [57712.543169] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 21:25:38 juju-e4d256-prod-github-runner-207 kernel: [57712.543245] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 21:25:38 juju-e4d256-prod-github-runner-207 kernel: [57712.555470] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 21:25:38 juju-e4d256-prod-github-runner-207 kernel: [57712.556730] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 21:25:38 juju-e4d256-prod-github-runner-207 kernel: [57712.557957] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:25:38 juju-e4d256-prod-github-runner-207 kernel: [57712.559008] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 21:25:38 juju-e4d256-prod-github-runner-207 kernel: [57712.561541] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 21:25:38 juju-e4d256-prod-github-runner-207 kernel: [57712.562587] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 21:25:38 juju-e4d256-prod-github-runner-207 kernel: [57712.563744] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 21:25:38 juju-e4d256-prod-github-runner-207 kernel: [57712.564931] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 21:25:38 juju-e4d256-prod-github-runner-207 kernel: [57712.566119] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 21:25:38 juju-e4d256-prod-github-runner-207 kernel: [57712.567278] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 21:25:38 juju-e4d256-prod-github-runner-207 kernel: [57712.568441] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 21:25:38 juju-e4d256-prod-github-runner-207 kernel: [57712.569672] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 21:25:38 juju-e4d256-prod-github-runner-207 kernel: [57712.570781] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 21:25:38 juju-e4d256-prod-github-runner-207 kernel: [57712.571970] Call Trace: Aug 22 21:25:38 juju-e4d256-prod-github-runner-207 kernel: [57712.572886] Aug 22 21:25:38 juju-e4d256-prod-github-runner-207 kernel: [57712.573782] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:25:38 juju-e4d256-prod-github-runner-207 kernel: [57712.574809] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:25:38 juju-e4d256-prod-github-runner-207 kernel: [57712.575832] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:25:38 juju-e4d256-prod-github-runner-207 kernel: [57712.576942] ? show_regs.part.0+0x23/0x29 Aug 22 21:25:38 juju-e4d256-prod-github-runner-207 kernel: [57712.577952] ? show_regs.cold+0x8/0xd Aug 22 21:25:38 juju-e4d256-prod-github-runner-207 kernel: [57712.578921] ? watchdog_timer_fn+0x1be/0x220 Aug 22 21:25:38 juju-e4d256-prod-github-runner-207 kernel: [57712.579932] ? lockup_detector_update_enable+0x60/0x60 Aug 22 21:25:38 juju-e4d256-prod-github-runner-207 kernel: [57712.581072] ? __hrtimer_run_queues+0x107/0x230 Aug 22 21:25:38 juju-e4d256-prod-github-runner-207 kernel: [57712.582106] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 21:25:38 juju-e4d256-prod-github-runner-207 kernel: [57712.583143] ? hrtimer_interrupt+0x101/0x220 Aug 22 21:25:38 juju-e4d256-prod-github-runner-207 kernel: [57712.584166] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 21:25:38 juju-e4d256-prod-github-runner-207 kernel: [57712.585246] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 21:25:38 juju-e4d256-prod-github-runner-207 kernel: [57712.586312] Aug 22 21:25:38 juju-e4d256-prod-github-runner-207 kernel: [57712.587172] Aug 22 21:25:38 juju-e4d256-prod-github-runner-207 kernel: [57712.588018] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 21:25:38 juju-e4d256-prod-github-runner-207 kernel: [57712.589075] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:25:38 juju-e4d256-prod-github-runner-207 kernel: [57712.590154] ? _raw_spin_lock+0x22/0x30 Aug 22 21:25:38 juju-e4d256-prod-github-runner-207 kernel: [57712.591098] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:25:38 juju-e4d256-prod-github-runner-207 kernel: [57712.592119] direct_page_fault+0x206/0x310 [kvm] Aug 22 21:25:38 juju-e4d256-prod-github-runner-207 kernel: [57712.593147] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 21:25:38 juju-e4d256-prod-github-runner-207 kernel: [57712.594191] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 21:25:38 juju-e4d256-prod-github-runner-207 kernel: [57712.595207] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 21:25:38 juju-e4d256-prod-github-runner-207 kernel: [57712.596188] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 21:25:38 juju-e4d256-prod-github-runner-207 kernel: [57712.597138] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 21:25:38 juju-e4d256-prod-github-runner-207 kernel: [57712.598135] handle_exit+0x98/0x230 [kvm_amd] Aug 22 21:25:38 juju-e4d256-prod-github-runner-207 kernel: [57712.599029] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 21:25:38 juju-e4d256-prod-github-runner-207 kernel: [57712.599937] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 21:25:38 juju-e4d256-prod-github-runner-207 kernel: [57712.600854] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 21:25:38 juju-e4d256-prod-github-runner-207 kernel: [57712.601767] vcpu_run+0x62/0x2c0 [kvm] Aug 22 21:25:38 juju-e4d256-prod-github-runner-207 kernel: [57712.602577] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 21:25:38 juju-e4d256-prod-github-runner-207 kernel: [57712.603381] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 21:25:38 juju-e4d256-prod-github-runner-207 kernel: [57712.604236] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 21:25:38 juju-e4d256-prod-github-runner-207 kernel: [57712.605030] ? __seccomp_filter+0x4a/0x4a0 Aug 22 21:25:38 juju-e4d256-prod-github-runner-207 kernel: [57712.605788] ? __fget_files+0x86/0xc0 Aug 22 21:25:38 juju-e4d256-prod-github-runner-207 kernel: [57712.606491] __x64_sys_ioctl+0x95/0xd0 Aug 22 21:25:38 juju-e4d256-prod-github-runner-207 kernel: [57712.607179] do_syscall_64+0x5c/0xc0 Aug 22 21:25:38 juju-e4d256-prod-github-runner-207 kernel: [57712.607840] ? do_futex+0x162/0x1f0 Aug 22 21:25:38 juju-e4d256-prod-github-runner-207 kernel: [57712.608503] ? __x64_sys_futex+0x78/0x1e0 Aug 22 21:25:38 juju-e4d256-prod-github-runner-207 kernel: [57712.609176] ? __secure_computing+0xa9/0x120 Aug 22 21:25:38 juju-e4d256-prod-github-runner-207 kernel: [57712.609877] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 21:25:38 juju-e4d256-prod-github-runner-207 kernel: [57712.610634] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:25:38 juju-e4d256-prod-github-runner-207 kernel: [57712.611352] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:25:38 juju-e4d256-prod-github-runner-207 kernel: [57712.612070] ? do_syscall_64+0x69/0xc0 Aug 22 21:25:38 juju-e4d256-prod-github-runner-207 kernel: [57712.612718] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:25:38 juju-e4d256-prod-github-runner-207 kernel: [57712.613420] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:25:38 juju-e4d256-prod-github-runner-207 kernel: [57712.614119] ? do_syscall_64+0x69/0xc0 Aug 22 21:25:38 juju-e4d256-prod-github-runner-207 kernel: [57712.614749] ? do_syscall_64+0x69/0xc0 Aug 22 21:25:38 juju-e4d256-prod-github-runner-207 kernel: [57712.615367] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 21:25:38 juju-e4d256-prod-github-runner-207 kernel: [57712.616068] RIP: 0033:0x7faa5d0edaff Aug 22 21:25:38 juju-e4d256-prod-github-runner-207 kernel: [57712.616689] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 21:25:38 juju-e4d256-prod-github-runner-207 kernel: [57712.618677] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 21:25:38 juju-e4d256-prod-github-runner-207 kernel: [57712.619588] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 21:25:38 juju-e4d256-prod-github-runner-207 kernel: [57712.620478] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 21:25:38 juju-e4d256-prod-github-runner-207 kernel: [57712.621362] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 21:25:38 juju-e4d256-prod-github-runner-207 kernel: [57712.622456] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 21:25:38 juju-e4d256-prod-github-runner-207 kernel: [57712.623359] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 21:25:38 juju-e4d256-prod-github-runner-207 kernel: [57712.624248] Aug 22 21:26:06 juju-e4d256-prod-github-runner-207 kernel: [57740.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 53667s! [qemu-system-x86:6715] Aug 22 21:26:06 juju-e4d256-prod-github-runner-207 kernel: [57740.543915] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 21:26:06 juju-e4d256-prod-github-runner-207 kernel: [57740.544226] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 21:26:06 juju-e4d256-prod-github-runner-207 kernel: [57740.556405] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 21:26:06 juju-e4d256-prod-github-runner-207 kernel: [57740.557694] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 21:26:06 juju-e4d256-prod-github-runner-207 kernel: [57740.559126] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:26:06 juju-e4d256-prod-github-runner-207 kernel: [57740.560191] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 21:26:06 juju-e4d256-prod-github-runner-207 kernel: [57740.562788] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 21:26:06 juju-e4d256-prod-github-runner-207 kernel: [57740.563839] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 21:26:06 juju-e4d256-prod-github-runner-207 kernel: [57740.564999] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 21:26:06 juju-e4d256-prod-github-runner-207 kernel: [57740.568401] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 21:26:06 juju-e4d256-prod-github-runner-207 kernel: [57740.569783] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 21:26:06 juju-e4d256-prod-github-runner-207 kernel: [57740.571091] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 21:26:06 juju-e4d256-prod-github-runner-207 kernel: [57740.572432] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 21:26:06 juju-e4d256-prod-github-runner-207 kernel: [57740.573841] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 21:26:06 juju-e4d256-prod-github-runner-207 kernel: [57740.575066] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 21:26:06 juju-e4d256-prod-github-runner-207 kernel: [57740.576431] Call Trace: Aug 22 21:26:06 juju-e4d256-prod-github-runner-207 kernel: [57740.577428] Aug 22 21:26:06 juju-e4d256-prod-github-runner-207 kernel: [57740.578380] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:26:06 juju-e4d256-prod-github-runner-207 kernel: [57740.579504] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:26:06 juju-e4d256-prod-github-runner-207 kernel: [57740.580611] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:26:06 juju-e4d256-prod-github-runner-207 kernel: [57740.581812] ? show_regs.part.0+0x23/0x29 Aug 22 21:26:06 juju-e4d256-prod-github-runner-207 kernel: [57740.582893] ? show_regs.cold+0x8/0xd Aug 22 21:26:06 juju-e4d256-prod-github-runner-207 kernel: [57740.583946] ? watchdog_timer_fn+0x1be/0x220 Aug 22 21:26:06 juju-e4d256-prod-github-runner-207 kernel: [57740.585041] ? lockup_detector_update_enable+0x60/0x60 Aug 22 21:26:06 juju-e4d256-prod-github-runner-207 kernel: [57740.586231] ? __hrtimer_run_queues+0x107/0x230 Aug 22 21:26:06 juju-e4d256-prod-github-runner-207 kernel: [57740.587354] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 21:26:06 juju-e4d256-prod-github-runner-207 kernel: [57740.588462] ? hrtimer_interrupt+0x101/0x220 Aug 22 21:26:06 juju-e4d256-prod-github-runner-207 kernel: [57740.589581] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 21:26:06 juju-e4d256-prod-github-runner-207 kernel: [57740.590748] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 21:26:06 juju-e4d256-prod-github-runner-207 kernel: [57740.591886] Aug 22 21:26:06 juju-e4d256-prod-github-runner-207 kernel: [57740.592791] Aug 22 21:26:06 juju-e4d256-prod-github-runner-207 kernel: [57740.593712] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 21:26:06 juju-e4d256-prod-github-runner-207 kernel: [57740.594975] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:26:06 juju-e4d256-prod-github-runner-207 kernel: [57740.596117] ? _raw_spin_lock+0x22/0x30 Aug 22 21:26:06 juju-e4d256-prod-github-runner-207 kernel: [57740.597134] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:26:06 juju-e4d256-prod-github-runner-207 kernel: [57740.598244] direct_page_fault+0x206/0x310 [kvm] Aug 22 21:26:06 juju-e4d256-prod-github-runner-207 kernel: [57740.599386] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 21:26:06 juju-e4d256-prod-github-runner-207 kernel: [57740.600486] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 21:26:06 juju-e4d256-prod-github-runner-207 kernel: [57740.601614] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 21:26:06 juju-e4d256-prod-github-runner-207 kernel: [57740.602742] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 21:26:06 juju-e4d256-prod-github-runner-207 kernel: [57740.603798] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 21:26:06 juju-e4d256-prod-github-runner-207 kernel: [57740.605006] handle_exit+0x98/0x230 [kvm_amd] Aug 22 21:26:06 juju-e4d256-prod-github-runner-207 kernel: [57740.606007] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 21:26:06 juju-e4d256-prod-github-runner-207 kernel: [57740.607021] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 21:26:06 juju-e4d256-prod-github-runner-207 kernel: [57740.608048] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 21:26:06 juju-e4d256-prod-github-runner-207 kernel: [57740.609048] vcpu_run+0x62/0x2c0 [kvm] Aug 22 21:26:06 juju-e4d256-prod-github-runner-207 kernel: [57740.609959] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 21:26:06 juju-e4d256-prod-github-runner-207 kernel: [57740.610885] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 21:26:06 juju-e4d256-prod-github-runner-207 kernel: [57740.611843] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 21:26:06 juju-e4d256-prod-github-runner-207 kernel: [57740.612722] ? __seccomp_filter+0x4a/0x4a0 Aug 22 21:26:06 juju-e4d256-prod-github-runner-207 kernel: [57740.613587] ? __fget_files+0x86/0xc0 Aug 22 21:26:06 juju-e4d256-prod-github-runner-207 kernel: [57740.614364] __x64_sys_ioctl+0x95/0xd0 Aug 22 21:26:06 juju-e4d256-prod-github-runner-207 kernel: [57740.615132] do_syscall_64+0x5c/0xc0 Aug 22 21:26:06 juju-e4d256-prod-github-runner-207 kernel: [57740.615888] ? do_futex+0x162/0x1f0 Aug 22 21:26:06 juju-e4d256-prod-github-runner-207 kernel: [57740.616604] ? __x64_sys_futex+0x78/0x1e0 Aug 22 21:26:06 juju-e4d256-prod-github-runner-207 kernel: [57740.617355] ? __secure_computing+0xa9/0x120 Aug 22 21:26:06 juju-e4d256-prod-github-runner-207 kernel: [57740.618199] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 21:26:06 juju-e4d256-prod-github-runner-207 kernel: [57740.619063] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:26:06 juju-e4d256-prod-github-runner-207 kernel: [57740.619878] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:26:06 juju-e4d256-prod-github-runner-207 kernel: [57740.620689] ? do_syscall_64+0x69/0xc0 Aug 22 21:26:06 juju-e4d256-prod-github-runner-207 kernel: [57740.621429] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:26:06 juju-e4d256-prod-github-runner-207 kernel: [57740.622222] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:26:06 juju-e4d256-prod-github-runner-207 kernel: [57740.623009] ? do_syscall_64+0x69/0xc0 Aug 22 21:26:06 juju-e4d256-prod-github-runner-207 kernel: [57740.623709] ? do_syscall_64+0x69/0xc0 Aug 22 21:26:06 juju-e4d256-prod-github-runner-207 kernel: [57740.624403] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 21:26:06 juju-e4d256-prod-github-runner-207 kernel: [57740.625206] RIP: 0033:0x7faa5d0edaff Aug 22 21:26:06 juju-e4d256-prod-github-runner-207 kernel: [57740.625957] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 21:26:06 juju-e4d256-prod-github-runner-207 kernel: [57740.628266] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 21:26:06 juju-e4d256-prod-github-runner-207 kernel: [57740.629318] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 21:26:06 juju-e4d256-prod-github-runner-207 kernel: [57740.630343] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 21:26:06 juju-e4d256-prod-github-runner-207 kernel: [57740.631364] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 21:26:06 juju-e4d256-prod-github-runner-207 kernel: [57740.632382] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 21:26:06 juju-e4d256-prod-github-runner-207 kernel: [57740.633432] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 21:26:06 juju-e4d256-prod-github-runner-207 kernel: [57740.634450] Aug 22 21:26:34 juju-e4d256-prod-github-runner-207 kernel: [57768.541980] watchdog: BUG: soft lockup - CPU#1 stuck for 53693s! [qemu-system-x86:6715] Aug 22 21:26:34 juju-e4d256-prod-github-runner-207 kernel: [57768.543154] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 21:26:34 juju-e4d256-prod-github-runner-207 kernel: [57768.543228] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 21:26:34 juju-e4d256-prod-github-runner-207 kernel: [57768.555709] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 21:26:34 juju-e4d256-prod-github-runner-207 kernel: [57768.556997] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 21:26:34 juju-e4d256-prod-github-runner-207 kernel: [57768.558396] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:26:34 juju-e4d256-prod-github-runner-207 kernel: [57768.559565] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 21:26:34 juju-e4d256-prod-github-runner-207 kernel: [57768.562185] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 21:26:34 juju-e4d256-prod-github-runner-207 kernel: [57768.563240] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 21:26:34 juju-e4d256-prod-github-runner-207 kernel: [57768.564428] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 21:26:34 juju-e4d256-prod-github-runner-207 kernel: [57768.565634] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 21:26:34 juju-e4d256-prod-github-runner-207 kernel: [57768.566818] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 21:26:34 juju-e4d256-prod-github-runner-207 kernel: [57768.568047] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 21:26:34 juju-e4d256-prod-github-runner-207 kernel: [57768.569283] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 21:26:34 juju-e4d256-prod-github-runner-207 kernel: [57768.570552] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 21:26:34 juju-e4d256-prod-github-runner-207 kernel: [57768.571677] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 21:26:34 juju-e4d256-prod-github-runner-207 kernel: [57768.572890] Call Trace: Aug 22 21:26:34 juju-e4d256-prod-github-runner-207 kernel: [57768.573836] Aug 22 21:26:34 juju-e4d256-prod-github-runner-207 kernel: [57768.574733] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:26:34 juju-e4d256-prod-github-runner-207 kernel: [57768.575792] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:26:34 juju-e4d256-prod-github-runner-207 kernel: [57768.576827] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:26:34 juju-e4d256-prod-github-runner-207 kernel: [57768.577941] ? show_regs.part.0+0x23/0x29 Aug 22 21:26:34 juju-e4d256-prod-github-runner-207 kernel: [57768.578955] ? show_regs.cold+0x8/0xd Aug 22 21:26:34 juju-e4d256-prod-github-runner-207 kernel: [57768.579942] ? watchdog_timer_fn+0x1be/0x220 Aug 22 21:26:34 juju-e4d256-prod-github-runner-207 kernel: [57768.580972] ? lockup_detector_update_enable+0x60/0x60 Aug 22 21:26:34 juju-e4d256-prod-github-runner-207 kernel: [57768.582054] ? __hrtimer_run_queues+0x107/0x230 Aug 22 21:26:34 juju-e4d256-prod-github-runner-207 kernel: [57768.583093] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 21:26:34 juju-e4d256-prod-github-runner-207 kernel: [57768.584127] ? hrtimer_interrupt+0x101/0x220 Aug 22 21:26:34 juju-e4d256-prod-github-runner-207 kernel: [57768.585189] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 21:26:34 juju-e4d256-prod-github-runner-207 kernel: [57768.586283] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 21:26:34 juju-e4d256-prod-github-runner-207 kernel: [57768.587351] Aug 22 21:26:34 juju-e4d256-prod-github-runner-207 kernel: [57768.588209] Aug 22 21:26:34 juju-e4d256-prod-github-runner-207 kernel: [57768.589068] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 21:26:34 juju-e4d256-prod-github-runner-207 kernel: [57768.590185] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:26:34 juju-e4d256-prod-github-runner-207 kernel: [57768.591269] ? _raw_spin_lock+0x22/0x30 Aug 22 21:26:34 juju-e4d256-prod-github-runner-207 kernel: [57768.592224] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:26:34 juju-e4d256-prod-github-runner-207 kernel: [57768.593288] direct_page_fault+0x206/0x310 [kvm] Aug 22 21:26:34 juju-e4d256-prod-github-runner-207 kernel: [57768.594339] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 21:26:34 juju-e4d256-prod-github-runner-207 kernel: [57768.595362] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 21:26:34 juju-e4d256-prod-github-runner-207 kernel: [57768.596392] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 21:26:34 juju-e4d256-prod-github-runner-207 kernel: [57768.597400] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 21:26:34 juju-e4d256-prod-github-runner-207 kernel: [57768.598372] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 21:26:34 juju-e4d256-prod-github-runner-207 kernel: [57768.599363] handle_exit+0x98/0x230 [kvm_amd] Aug 22 21:26:34 juju-e4d256-prod-github-runner-207 kernel: [57768.600267] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 21:26:34 juju-e4d256-prod-github-runner-207 kernel: [57768.601215] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 21:26:34 juju-e4d256-prod-github-runner-207 kernel: [57768.602156] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 21:26:34 juju-e4d256-prod-github-runner-207 kernel: [57768.603078] vcpu_run+0x62/0x2c0 [kvm] Aug 22 21:26:34 juju-e4d256-prod-github-runner-207 kernel: [57768.603900] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 21:26:34 juju-e4d256-prod-github-runner-207 kernel: [57768.604725] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 21:26:34 juju-e4d256-prod-github-runner-207 kernel: [57768.605641] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 21:26:34 juju-e4d256-prod-github-runner-207 kernel: [57768.606461] ? __seccomp_filter+0x4a/0x4a0 Aug 22 21:26:34 juju-e4d256-prod-github-runner-207 kernel: [57768.607216] ? __fget_files+0x86/0xc0 Aug 22 21:26:34 juju-e4d256-prod-github-runner-207 kernel: [57768.607930] __x64_sys_ioctl+0x95/0xd0 Aug 22 21:26:34 juju-e4d256-prod-github-runner-207 kernel: [57768.608634] do_syscall_64+0x5c/0xc0 Aug 22 21:26:34 juju-e4d256-prod-github-runner-207 kernel: [57768.609328] ? do_futex+0x162/0x1f0 Aug 22 21:26:34 juju-e4d256-prod-github-runner-207 kernel: [57768.609989] ? __x64_sys_futex+0x78/0x1e0 Aug 22 21:26:34 juju-e4d256-prod-github-runner-207 kernel: [57768.610680] ? __secure_computing+0xa9/0x120 Aug 22 21:26:34 juju-e4d256-prod-github-runner-207 kernel: [57768.611391] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 21:26:34 juju-e4d256-prod-github-runner-207 kernel: [57768.612170] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:26:34 juju-e4d256-prod-github-runner-207 kernel: [57768.612905] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:26:34 juju-e4d256-prod-github-runner-207 kernel: [57768.613657] ? do_syscall_64+0x69/0xc0 Aug 22 21:26:34 juju-e4d256-prod-github-runner-207 kernel: [57768.614314] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:26:34 juju-e4d256-prod-github-runner-207 kernel: [57768.615025] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:26:34 juju-e4d256-prod-github-runner-207 kernel: [57768.615723] ? do_syscall_64+0x69/0xc0 Aug 22 21:26:34 juju-e4d256-prod-github-runner-207 kernel: [57768.616349] ? do_syscall_64+0x69/0xc0 Aug 22 21:26:34 juju-e4d256-prod-github-runner-207 kernel: [57768.616988] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 21:26:34 juju-e4d256-prod-github-runner-207 kernel: [57768.617720] RIP: 0033:0x7faa5d0edaff Aug 22 21:26:34 juju-e4d256-prod-github-runner-207 kernel: [57768.618379] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 21:26:34 juju-e4d256-prod-github-runner-207 kernel: [57768.620368] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 21:26:34 juju-e4d256-prod-github-runner-207 kernel: [57768.621302] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 21:26:34 juju-e4d256-prod-github-runner-207 kernel: [57768.622199] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 21:26:34 juju-e4d256-prod-github-runner-207 kernel: [57768.623082] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 21:26:34 juju-e4d256-prod-github-runner-207 kernel: [57768.623965] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 21:26:34 juju-e4d256-prod-github-runner-207 kernel: [57768.624849] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 21:26:34 juju-e4d256-prod-github-runner-207 kernel: [57768.625753] Aug 22 21:26:47 juju-e4d256-prod-github-runner-207 kernel: [57781.040707] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 21:26:47 juju-e4d256-prod-github-runner-207 kernel: [57781.041691] rcu: 1-....: (14370576 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=6944754 Aug 22 21:26:47 juju-e4d256-prod-github-runner-207 kernel: [57781.042815] (t=14415960 jiffies g=23269 q=52591) Aug 22 21:26:47 juju-e4d256-prod-github-runner-207 kernel: [57781.043602] NMI backtrace for cpu 1 Aug 22 21:26:47 juju-e4d256-prod-github-runner-207 kernel: [57781.044353] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 21:26:47 juju-e4d256-prod-github-runner-207 kernel: [57781.045467] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 21:26:47 juju-e4d256-prod-github-runner-207 kernel: [57781.046527] Call Trace: Aug 22 21:26:47 juju-e4d256-prod-github-runner-207 kernel: [57781.047205] Aug 22 21:26:47 juju-e4d256-prod-github-runner-207 kernel: [57781.047871] show_stack+0x52/0x5c Aug 22 21:26:47 juju-e4d256-prod-github-runner-207 kernel: [57781.048602] dump_stack_lvl+0x4a/0x63 Aug 22 21:26:47 juju-e4d256-prod-github-runner-207 kernel: [57781.049397] dump_stack+0x10/0x16 Aug 22 21:26:47 juju-e4d256-prod-github-runner-207 kernel: [57781.050120] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 21:26:47 juju-e4d256-prod-github-runner-207 kernel: [57781.050900] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 21:26:47 juju-e4d256-prod-github-runner-207 kernel: [57781.051678] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 21:26:47 juju-e4d256-prod-github-runner-207 kernel: [57781.052500] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 21:26:47 juju-e4d256-prod-github-runner-207 kernel: [57781.053334] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 21:26:47 juju-e4d256-prod-github-runner-207 kernel: [57781.054148] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 21:26:47 juju-e4d256-prod-github-runner-207 kernel: [57781.054919] print_cpu_stall.cold+0x2f/0xe2 Aug 22 21:26:47 juju-e4d256-prod-github-runner-207 kernel: [57781.055682] ? timekeeping_update+0xf7/0x150 Aug 22 21:26:47 juju-e4d256-prod-github-runner-207 kernel: [57781.056451] check_cpu_stall+0x109/0x270 Aug 22 21:26:47 juju-e4d256-prod-github-runner-207 kernel: [57781.057206] rcu_sched_clock_irq+0x9a/0x250 Aug 22 21:26:47 juju-e4d256-prod-github-runner-207 kernel: [57781.057968] update_process_times+0x94/0xd0 Aug 22 21:26:47 juju-e4d256-prod-github-runner-207 kernel: [57781.058727] tick_sched_handle+0x29/0x70 Aug 22 21:26:47 juju-e4d256-prod-github-runner-207 kernel: [57781.059477] tick_sched_timer+0x8c/0xc0 Aug 22 21:26:47 juju-e4d256-prod-github-runner-207 kernel: [57781.060213] ? tick_nohz_handler+0xb0/0xb0 Aug 22 21:26:47 juju-e4d256-prod-github-runner-207 kernel: [57781.060979] __hrtimer_run_queues+0x107/0x230 Aug 22 21:26:47 juju-e4d256-prod-github-runner-207 kernel: [57781.061752] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 21:26:47 juju-e4d256-prod-github-runner-207 kernel: [57781.062526] hrtimer_interrupt+0x101/0x220 Aug 22 21:26:47 juju-e4d256-prod-github-runner-207 kernel: [57781.063284] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 21:26:47 juju-e4d256-prod-github-runner-207 kernel: [57781.064093] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 21:26:47 juju-e4d256-prod-github-runner-207 kernel: [57781.064903] Aug 22 21:26:47 juju-e4d256-prod-github-runner-207 kernel: [57781.065537] Aug 22 21:26:47 juju-e4d256-prod-github-runner-207 kernel: [57781.066165] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 21:26:47 juju-e4d256-prod-github-runner-207 kernel: [57781.066981] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:26:47 juju-e4d256-prod-github-runner-207 kernel: [57781.067863] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 21:26:47 juju-e4d256-prod-github-runner-207 kernel: [57781.070075] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 21:26:47 juju-e4d256-prod-github-runner-207 kernel: [57781.070953] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 21:26:47 juju-e4d256-prod-github-runner-207 kernel: [57781.071946] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 21:26:47 juju-e4d256-prod-github-runner-207 kernel: [57781.072941] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 21:26:47 juju-e4d256-prod-github-runner-207 kernel: [57781.073903] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 21:26:47 juju-e4d256-prod-github-runner-207 kernel: [57781.074857] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 21:26:47 juju-e4d256-prod-github-runner-207 kernel: [57781.075811] ? _raw_spin_lock+0x22/0x30 Aug 22 21:26:47 juju-e4d256-prod-github-runner-207 kernel: [57781.076568] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:26:47 juju-e4d256-prod-github-runner-207 kernel: [57781.077410] direct_page_fault+0x206/0x310 [kvm] Aug 22 21:26:47 juju-e4d256-prod-github-runner-207 kernel: [57781.078257] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 21:26:47 juju-e4d256-prod-github-runner-207 kernel: [57781.079083] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 21:26:47 juju-e4d256-prod-github-runner-207 kernel: [57781.079909] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 21:26:47 juju-e4d256-prod-github-runner-207 kernel: [57781.080716] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 21:26:47 juju-e4d256-prod-github-runner-207 kernel: [57781.081526] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 21:26:47 juju-e4d256-prod-github-runner-207 kernel: [57781.082347] handle_exit+0x98/0x230 [kvm_amd] Aug 22 21:26:47 juju-e4d256-prod-github-runner-207 kernel: [57781.083099] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 21:26:47 juju-e4d256-prod-github-runner-207 kernel: [57781.083881] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 21:26:47 juju-e4d256-prod-github-runner-207 kernel: [57781.084678] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 21:26:47 juju-e4d256-prod-github-runner-207 kernel: [57781.085469] vcpu_run+0x62/0x2c0 [kvm] Aug 22 21:26:47 juju-e4d256-prod-github-runner-207 kernel: [57781.086182] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 21:26:47 juju-e4d256-prod-github-runner-207 kernel: [57781.086913] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 21:26:47 juju-e4d256-prod-github-runner-207 kernel: [57781.087712] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 21:26:47 juju-e4d256-prod-github-runner-207 kernel: [57781.088476] ? __seccomp_filter+0x4a/0x4a0 Aug 22 21:26:47 juju-e4d256-prod-github-runner-207 kernel: [57781.089241] ? __fget_files+0x86/0xc0 Aug 22 21:26:47 juju-e4d256-prod-github-runner-207 kernel: [57781.089935] __x64_sys_ioctl+0x95/0xd0 Aug 22 21:26:47 juju-e4d256-prod-github-runner-207 kernel: [57781.090628] do_syscall_64+0x5c/0xc0 Aug 22 21:26:47 juju-e4d256-prod-github-runner-207 kernel: [57781.091307] ? do_futex+0x162/0x1f0 Aug 22 21:26:47 juju-e4d256-prod-github-runner-207 kernel: [57781.091977] ? __x64_sys_futex+0x78/0x1e0 Aug 22 21:26:47 juju-e4d256-prod-github-runner-207 kernel: [57781.092681] ? __secure_computing+0xa9/0x120 Aug 22 21:26:47 juju-e4d256-prod-github-runner-207 kernel: [57781.093414] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 21:26:47 juju-e4d256-prod-github-runner-207 kernel: [57781.094208] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:26:47 juju-e4d256-prod-github-runner-207 kernel: [57781.094961] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:26:47 juju-e4d256-prod-github-runner-207 kernel: [57781.095712] ? do_syscall_64+0x69/0xc0 Aug 22 21:26:47 juju-e4d256-prod-github-runner-207 kernel: [57781.096405] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:26:47 juju-e4d256-prod-github-runner-207 kernel: [57781.097178] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:26:47 juju-e4d256-prod-github-runner-207 kernel: [57781.097934] ? do_syscall_64+0x69/0xc0 Aug 22 21:26:47 juju-e4d256-prod-github-runner-207 kernel: [57781.098628] ? do_syscall_64+0x69/0xc0 Aug 22 21:26:47 juju-e4d256-prod-github-runner-207 kernel: [57781.099321] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 21:26:47 juju-e4d256-prod-github-runner-207 kernel: [57781.100093] RIP: 0033:0x7faa5d0edaff Aug 22 21:26:47 juju-e4d256-prod-github-runner-207 kernel: [57781.100777] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 21:26:47 juju-e4d256-prod-github-runner-207 kernel: [57781.102882] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 21:26:47 juju-e4d256-prod-github-runner-207 kernel: [57781.103851] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 21:26:47 juju-e4d256-prod-github-runner-207 kernel: [57781.104797] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 21:26:47 juju-e4d256-prod-github-runner-207 kernel: [57781.105761] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 21:26:47 juju-e4d256-prod-github-runner-207 kernel: [57781.106699] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 21:26:47 juju-e4d256-prod-github-runner-207 kernel: [57781.107623] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 21:26:47 juju-e4d256-prod-github-runner-207 kernel: [57781.108537] Aug 22 21:27:14 juju-e4d256-prod-github-runner-207 kernel: [57808.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 53730s! [qemu-system-x86:6715] Aug 22 21:27:14 juju-e4d256-prod-github-runner-207 kernel: [57808.543123] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 21:27:14 juju-e4d256-prod-github-runner-207 kernel: [57808.543200] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 21:27:14 juju-e4d256-prod-github-runner-207 kernel: [57808.555403] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 21:27:14 juju-e4d256-prod-github-runner-207 kernel: [57808.556715] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 21:27:14 juju-e4d256-prod-github-runner-207 kernel: [57808.557938] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:27:14 juju-e4d256-prod-github-runner-207 kernel: [57808.558997] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 21:27:14 juju-e4d256-prod-github-runner-207 kernel: [57808.561559] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 21:27:14 juju-e4d256-prod-github-runner-207 kernel: [57808.562631] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 21:27:14 juju-e4d256-prod-github-runner-207 kernel: [57808.563809] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 21:27:14 juju-e4d256-prod-github-runner-207 kernel: [57808.564984] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 21:27:14 juju-e4d256-prod-github-runner-207 kernel: [57808.566147] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 21:27:14 juju-e4d256-prod-github-runner-207 kernel: [57808.567317] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 21:27:14 juju-e4d256-prod-github-runner-207 kernel: [57808.568503] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 21:27:14 juju-e4d256-prod-github-runner-207 kernel: [57808.569763] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 21:27:14 juju-e4d256-prod-github-runner-207 kernel: [57808.570869] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 21:27:14 juju-e4d256-prod-github-runner-207 kernel: [57808.572064] Call Trace: Aug 22 21:27:14 juju-e4d256-prod-github-runner-207 kernel: [57808.572999] Aug 22 21:27:14 juju-e4d256-prod-github-runner-207 kernel: [57808.573885] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:27:14 juju-e4d256-prod-github-runner-207 kernel: [57808.574916] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:27:14 juju-e4d256-prod-github-runner-207 kernel: [57808.575943] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:27:14 juju-e4d256-prod-github-runner-207 kernel: [57808.577030] ? show_regs.part.0+0x23/0x29 Aug 22 21:27:14 juju-e4d256-prod-github-runner-207 kernel: [57808.578033] ? show_regs.cold+0x8/0xd Aug 22 21:27:14 juju-e4d256-prod-github-runner-207 kernel: [57808.579010] ? watchdog_timer_fn+0x1be/0x220 Aug 22 21:27:14 juju-e4d256-prod-github-runner-207 kernel: [57808.580018] ? lockup_detector_update_enable+0x60/0x60 Aug 22 21:27:14 juju-e4d256-prod-github-runner-207 kernel: [57808.581088] ? __hrtimer_run_queues+0x107/0x230 Aug 22 21:27:14 juju-e4d256-prod-github-runner-207 kernel: [57808.582234] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 21:27:14 juju-e4d256-prod-github-runner-207 kernel: [57808.583346] ? hrtimer_interrupt+0x101/0x220 Aug 22 21:27:14 juju-e4d256-prod-github-runner-207 kernel: [57808.584448] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 21:27:14 juju-e4d256-prod-github-runner-207 kernel: [57808.585623] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 21:27:14 juju-e4d256-prod-github-runner-207 kernel: [57808.586768] Aug 22 21:27:14 juju-e4d256-prod-github-runner-207 kernel: [57808.587666] Aug 22 21:27:14 juju-e4d256-prod-github-runner-207 kernel: [57808.588572] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 21:27:14 juju-e4d256-prod-github-runner-207 kernel: [57808.589712] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:27:14 juju-e4d256-prod-github-runner-207 kernel: [57808.590850] ? _raw_spin_lock+0x22/0x30 Aug 22 21:27:14 juju-e4d256-prod-github-runner-207 kernel: [57808.591863] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:27:14 juju-e4d256-prod-github-runner-207 kernel: [57808.592994] direct_page_fault+0x206/0x310 [kvm] Aug 22 21:27:14 juju-e4d256-prod-github-runner-207 kernel: [57808.594136] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 21:27:14 juju-e4d256-prod-github-runner-207 kernel: [57808.595231] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 21:27:14 juju-e4d256-prod-github-runner-207 kernel: [57808.596319] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 21:27:14 juju-e4d256-prod-github-runner-207 kernel: [57808.597407] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 21:27:14 juju-e4d256-prod-github-runner-207 kernel: [57808.598441] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 21:27:14 juju-e4d256-prod-github-runner-207 kernel: [57808.599657] handle_exit+0x98/0x230 [kvm_amd] Aug 22 21:27:14 juju-e4d256-prod-github-runner-207 kernel: [57808.600651] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 21:27:14 juju-e4d256-prod-github-runner-207 kernel: [57808.601656] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 21:27:14 juju-e4d256-prod-github-runner-207 kernel: [57808.602673] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 21:27:14 juju-e4d256-prod-github-runner-207 kernel: [57808.603673] vcpu_run+0x62/0x2c0 [kvm] Aug 22 21:27:14 juju-e4d256-prod-github-runner-207 kernel: [57808.604568] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 21:27:14 juju-e4d256-prod-github-runner-207 kernel: [57808.605457] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 21:27:14 juju-e4d256-prod-github-runner-207 kernel: [57808.606421] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 21:27:14 juju-e4d256-prod-github-runner-207 kernel: [57808.607306] ? __seccomp_filter+0x4a/0x4a0 Aug 22 21:27:14 juju-e4d256-prod-github-runner-207 kernel: [57808.608141] ? __fget_files+0x86/0xc0 Aug 22 21:27:14 juju-e4d256-prod-github-runner-207 kernel: [57808.609095] __x64_sys_ioctl+0x95/0xd0 Aug 22 21:27:14 juju-e4d256-prod-github-runner-207 kernel: [57808.609877] do_syscall_64+0x5c/0xc0 Aug 22 21:27:14 juju-e4d256-prod-github-runner-207 kernel: [57808.610622] ? do_futex+0x162/0x1f0 Aug 22 21:27:14 juju-e4d256-prod-github-runner-207 kernel: [57808.611336] ? __x64_sys_futex+0x78/0x1e0 Aug 22 21:27:14 juju-e4d256-prod-github-runner-207 kernel: [57808.612084] ? __secure_computing+0xa9/0x120 Aug 22 21:27:14 juju-e4d256-prod-github-runner-207 kernel: [57808.612874] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 21:27:14 juju-e4d256-prod-github-runner-207 kernel: [57808.613738] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:27:14 juju-e4d256-prod-github-runner-207 kernel: [57808.614558] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:27:14 juju-e4d256-prod-github-runner-207 kernel: [57808.615369] ? do_syscall_64+0x69/0xc0 Aug 22 21:27:14 juju-e4d256-prod-github-runner-207 kernel: [57808.616086] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:27:14 juju-e4d256-prod-github-runner-207 kernel: [57808.616905] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:27:14 juju-e4d256-prod-github-runner-207 kernel: [57808.617699] ? do_syscall_64+0x69/0xc0 Aug 22 21:27:14 juju-e4d256-prod-github-runner-207 kernel: [57808.618404] ? do_syscall_64+0x69/0xc0 Aug 22 21:27:14 juju-e4d256-prod-github-runner-207 kernel: [57808.619099] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 21:27:14 juju-e4d256-prod-github-runner-207 kernel: [57808.619908] RIP: 0033:0x7faa5d0edaff Aug 22 21:27:14 juju-e4d256-prod-github-runner-207 kernel: [57808.620620] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 21:27:14 juju-e4d256-prod-github-runner-207 kernel: [57808.622944] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 21:27:14 juju-e4d256-prod-github-runner-207 kernel: [57808.624001] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 21:27:14 juju-e4d256-prod-github-runner-207 kernel: [57808.625061] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 21:27:14 juju-e4d256-prod-github-runner-207 kernel: [57808.626094] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 21:27:14 juju-e4d256-prod-github-runner-207 kernel: [57808.627114] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 21:27:14 juju-e4d256-prod-github-runner-207 kernel: [57808.628134] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 21:27:14 juju-e4d256-prod-github-runner-207 kernel: [57808.629195] Aug 22 21:27:42 juju-e4d256-prod-github-runner-207 kernel: [57836.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 53756s! [qemu-system-x86:6715] Aug 22 21:27:42 juju-e4d256-prod-github-runner-207 kernel: [57836.543876] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 21:27:42 juju-e4d256-prod-github-runner-207 kernel: [57836.544184] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 21:27:42 juju-e4d256-prod-github-runner-207 kernel: [57836.556345] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 21:27:42 juju-e4d256-prod-github-runner-207 kernel: [57836.557634] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 21:27:42 juju-e4d256-prod-github-runner-207 kernel: [57836.558857] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:27:42 juju-e4d256-prod-github-runner-207 kernel: [57836.559917] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 21:27:42 juju-e4d256-prod-github-runner-207 kernel: [57836.562467] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 21:27:42 juju-e4d256-prod-github-runner-207 kernel: [57836.563509] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 21:27:42 juju-e4d256-prod-github-runner-207 kernel: [57836.564689] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 21:27:42 juju-e4d256-prod-github-runner-207 kernel: [57836.565863] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 21:27:42 juju-e4d256-prod-github-runner-207 kernel: [57836.567020] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 21:27:42 juju-e4d256-prod-github-runner-207 kernel: [57836.568179] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 21:27:42 juju-e4d256-prod-github-runner-207 kernel: [57836.569373] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 21:27:42 juju-e4d256-prod-github-runner-207 kernel: [57836.570637] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 21:27:42 juju-e4d256-prod-github-runner-207 kernel: [57836.571738] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 21:27:42 juju-e4d256-prod-github-runner-207 kernel: [57836.572948] Call Trace: Aug 22 21:27:42 juju-e4d256-prod-github-runner-207 kernel: [57836.573860] Aug 22 21:27:42 juju-e4d256-prod-github-runner-207 kernel: [57836.574757] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:27:42 juju-e4d256-prod-github-runner-207 kernel: [57836.575790] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:27:42 juju-e4d256-prod-github-runner-207 kernel: [57836.576821] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:27:42 juju-e4d256-prod-github-runner-207 kernel: [57836.577914] ? show_regs.part.0+0x23/0x29 Aug 22 21:27:42 juju-e4d256-prod-github-runner-207 kernel: [57836.578912] ? show_regs.cold+0x8/0xd Aug 22 21:27:42 juju-e4d256-prod-github-runner-207 kernel: [57836.579882] ? watchdog_timer_fn+0x1be/0x220 Aug 22 21:27:42 juju-e4d256-prod-github-runner-207 kernel: [57836.580898] ? lockup_detector_update_enable+0x60/0x60 Aug 22 21:27:42 juju-e4d256-prod-github-runner-207 kernel: [57836.581966] ? __hrtimer_run_queues+0x107/0x230 Aug 22 21:27:42 juju-e4d256-prod-github-runner-207 kernel: [57836.582994] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 21:27:42 juju-e4d256-prod-github-runner-207 kernel: [57836.584038] ? hrtimer_interrupt+0x101/0x220 Aug 22 21:27:42 juju-e4d256-prod-github-runner-207 kernel: [57836.585069] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 21:27:42 juju-e4d256-prod-github-runner-207 kernel: [57836.586133] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 21:27:42 juju-e4d256-prod-github-runner-207 kernel: [57836.587182] Aug 22 21:27:42 juju-e4d256-prod-github-runner-207 kernel: [57836.588039] Aug 22 21:27:42 juju-e4d256-prod-github-runner-207 kernel: [57836.588881] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 21:27:42 juju-e4d256-prod-github-runner-207 kernel: [57836.589912] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:27:42 juju-e4d256-prod-github-runner-207 kernel: [57836.590964] ? _raw_spin_lock+0x22/0x30 Aug 22 21:27:42 juju-e4d256-prod-github-runner-207 kernel: [57836.591930] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:27:42 juju-e4d256-prod-github-runner-207 kernel: [57836.592971] direct_page_fault+0x206/0x310 [kvm] Aug 22 21:27:42 juju-e4d256-prod-github-runner-207 kernel: [57836.594000] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 21:27:42 juju-e4d256-prod-github-runner-207 kernel: [57836.595027] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 21:27:42 juju-e4d256-prod-github-runner-207 kernel: [57836.596030] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 21:27:42 juju-e4d256-prod-github-runner-207 kernel: [57836.597039] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 21:27:42 juju-e4d256-prod-github-runner-207 kernel: [57836.597984] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 21:27:42 juju-e4d256-prod-github-runner-207 kernel: [57836.598970] handle_exit+0x98/0x230 [kvm_amd] Aug 22 21:27:42 juju-e4d256-prod-github-runner-207 kernel: [57836.599860] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 21:27:42 juju-e4d256-prod-github-runner-207 kernel: [57836.600784] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 21:27:42 juju-e4d256-prod-github-runner-207 kernel: [57836.601707] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 21:27:42 juju-e4d256-prod-github-runner-207 kernel: [57836.602608] vcpu_run+0x62/0x2c0 [kvm] Aug 22 21:27:42 juju-e4d256-prod-github-runner-207 kernel: [57836.603419] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 21:27:42 juju-e4d256-prod-github-runner-207 kernel: [57836.604239] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 21:27:42 juju-e4d256-prod-github-runner-207 kernel: [57836.605133] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 21:27:42 juju-e4d256-prod-github-runner-207 kernel: [57836.605955] ? __seccomp_filter+0x4a/0x4a0 Aug 22 21:27:42 juju-e4d256-prod-github-runner-207 kernel: [57836.606719] ? __fget_files+0x86/0xc0 Aug 22 21:27:42 juju-e4d256-prod-github-runner-207 kernel: [57836.607442] __x64_sys_ioctl+0x95/0xd0 Aug 22 21:27:42 juju-e4d256-prod-github-runner-207 kernel: [57836.608151] do_syscall_64+0x5c/0xc0 Aug 22 21:27:42 juju-e4d256-prod-github-runner-207 kernel: [57836.608831] ? do_futex+0x162/0x1f0 Aug 22 21:27:42 juju-e4d256-prod-github-runner-207 kernel: [57836.609488] ? __x64_sys_futex+0x78/0x1e0 Aug 22 21:27:42 juju-e4d256-prod-github-runner-207 kernel: [57836.610166] ? __secure_computing+0xa9/0x120 Aug 22 21:27:42 juju-e4d256-prod-github-runner-207 kernel: [57836.610855] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 21:27:42 juju-e4d256-prod-github-runner-207 kernel: [57836.611764] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:27:42 juju-e4d256-prod-github-runner-207 kernel: [57836.612492] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:27:42 juju-e4d256-prod-github-runner-207 kernel: [57836.613209] ? do_syscall_64+0x69/0xc0 Aug 22 21:27:42 juju-e4d256-prod-github-runner-207 kernel: [57836.613864] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:27:42 juju-e4d256-prod-github-runner-207 kernel: [57836.614571] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:27:42 juju-e4d256-prod-github-runner-207 kernel: [57836.615266] ? do_syscall_64+0x69/0xc0 Aug 22 21:27:42 juju-e4d256-prod-github-runner-207 kernel: [57836.615889] ? do_syscall_64+0x69/0xc0 Aug 22 21:27:42 juju-e4d256-prod-github-runner-207 kernel: [57836.616517] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 21:27:42 juju-e4d256-prod-github-runner-207 kernel: [57836.617238] RIP: 0033:0x7faa5d0edaff Aug 22 21:27:42 juju-e4d256-prod-github-runner-207 kernel: [57836.617888] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 21:27:42 juju-e4d256-prod-github-runner-207 kernel: [57836.619886] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 21:27:42 juju-e4d256-prod-github-runner-207 kernel: [57836.620803] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 21:27:42 juju-e4d256-prod-github-runner-207 kernel: [57836.621692] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 21:27:42 juju-e4d256-prod-github-runner-207 kernel: [57836.622579] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 21:27:42 juju-e4d256-prod-github-runner-207 kernel: [57836.623469] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 21:27:42 juju-e4d256-prod-github-runner-207 kernel: [57836.624367] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 21:27:42 juju-e4d256-prod-github-runner-207 kernel: [57836.625263] Aug 22 21:28:10 juju-e4d256-prod-github-runner-207 kernel: [57864.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 53782s! [qemu-system-x86:6715] Aug 22 21:28:10 juju-e4d256-prod-github-runner-207 kernel: [57864.543096] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 21:28:10 juju-e4d256-prod-github-runner-207 kernel: [57864.543170] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 21:28:10 juju-e4d256-prod-github-runner-207 kernel: [57864.555566] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 21:28:10 juju-e4d256-prod-github-runner-207 kernel: [57864.556854] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 21:28:10 juju-e4d256-prod-github-runner-207 kernel: [57864.558078] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:28:10 juju-e4d256-prod-github-runner-207 kernel: [57864.559149] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 21:28:10 juju-e4d256-prod-github-runner-207 kernel: [57864.561743] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 21:28:10 juju-e4d256-prod-github-runner-207 kernel: [57864.562785] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 21:28:10 juju-e4d256-prod-github-runner-207 kernel: [57864.563959] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 21:28:10 juju-e4d256-prod-github-runner-207 kernel: [57864.565118] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 21:28:10 juju-e4d256-prod-github-runner-207 kernel: [57864.566277] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 21:28:10 juju-e4d256-prod-github-runner-207 kernel: [57864.567441] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 21:28:10 juju-e4d256-prod-github-runner-207 kernel: [57864.568622] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 21:28:10 juju-e4d256-prod-github-runner-207 kernel: [57864.569854] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 21:28:10 juju-e4d256-prod-github-runner-207 kernel: [57864.570953] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 21:28:10 juju-e4d256-prod-github-runner-207 kernel: [57864.572156] Call Trace: Aug 22 21:28:10 juju-e4d256-prod-github-runner-207 kernel: [57864.573073] Aug 22 21:28:10 juju-e4d256-prod-github-runner-207 kernel: [57864.573955] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:28:10 juju-e4d256-prod-github-runner-207 kernel: [57864.575013] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:28:10 juju-e4d256-prod-github-runner-207 kernel: [57864.576067] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:28:10 juju-e4d256-prod-github-runner-207 kernel: [57864.577145] ? show_regs.part.0+0x23/0x29 Aug 22 21:28:10 juju-e4d256-prod-github-runner-207 kernel: [57864.578145] ? show_regs.cold+0x8/0xd Aug 22 21:28:10 juju-e4d256-prod-github-runner-207 kernel: [57864.579117] ? watchdog_timer_fn+0x1be/0x220 Aug 22 21:28:10 juju-e4d256-prod-github-runner-207 kernel: [57864.580144] ? lockup_detector_update_enable+0x60/0x60 Aug 22 21:28:10 juju-e4d256-prod-github-runner-207 kernel: [57864.581205] ? __hrtimer_run_queues+0x107/0x230 Aug 22 21:28:10 juju-e4d256-prod-github-runner-207 kernel: [57864.582236] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 21:28:10 juju-e4d256-prod-github-runner-207 kernel: [57864.583263] ? hrtimer_interrupt+0x101/0x220 Aug 22 21:28:10 juju-e4d256-prod-github-runner-207 kernel: [57864.584288] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 21:28:10 juju-e4d256-prod-github-runner-207 kernel: [57864.585361] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 21:28:10 juju-e4d256-prod-github-runner-207 kernel: [57864.586407] Aug 22 21:28:10 juju-e4d256-prod-github-runner-207 kernel: [57864.587259] Aug 22 21:28:10 juju-e4d256-prod-github-runner-207 kernel: [57864.588109] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 21:28:10 juju-e4d256-prod-github-runner-207 kernel: [57864.589147] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:28:10 juju-e4d256-prod-github-runner-207 kernel: [57864.590190] ? _raw_spin_lock+0x22/0x30 Aug 22 21:28:10 juju-e4d256-prod-github-runner-207 kernel: [57864.591134] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:28:10 juju-e4d256-prod-github-runner-207 kernel: [57864.592194] direct_page_fault+0x206/0x310 [kvm] Aug 22 21:28:10 juju-e4d256-prod-github-runner-207 kernel: [57864.593225] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 21:28:10 juju-e4d256-prod-github-runner-207 kernel: [57864.594235] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 21:28:10 juju-e4d256-prod-github-runner-207 kernel: [57864.595240] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 21:28:10 juju-e4d256-prod-github-runner-207 kernel: [57864.596224] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 21:28:10 juju-e4d256-prod-github-runner-207 kernel: [57864.597166] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 21:28:10 juju-e4d256-prod-github-runner-207 kernel: [57864.598141] handle_exit+0x98/0x230 [kvm_amd] Aug 22 21:28:10 juju-e4d256-prod-github-runner-207 kernel: [57864.599058] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 21:28:10 juju-e4d256-prod-github-runner-207 kernel: [57864.600005] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 21:28:10 juju-e4d256-prod-github-runner-207 kernel: [57864.600928] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 21:28:10 juju-e4d256-prod-github-runner-207 kernel: [57864.601830] vcpu_run+0x62/0x2c0 [kvm] Aug 22 21:28:10 juju-e4d256-prod-github-runner-207 kernel: [57864.602639] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 21:28:10 juju-e4d256-prod-github-runner-207 kernel: [57864.603447] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 21:28:10 juju-e4d256-prod-github-runner-207 kernel: [57864.604342] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 21:28:10 juju-e4d256-prod-github-runner-207 kernel: [57864.605148] ? __seccomp_filter+0x4a/0x4a0 Aug 22 21:28:10 juju-e4d256-prod-github-runner-207 kernel: [57864.605891] ? __fget_files+0x86/0xc0 Aug 22 21:28:10 juju-e4d256-prod-github-runner-207 kernel: [57864.606592] __x64_sys_ioctl+0x95/0xd0 Aug 22 21:28:10 juju-e4d256-prod-github-runner-207 kernel: [57864.607281] do_syscall_64+0x5c/0xc0 Aug 22 21:28:10 juju-e4d256-prod-github-runner-207 kernel: [57864.607959] ? do_futex+0x162/0x1f0 Aug 22 21:28:10 juju-e4d256-prod-github-runner-207 kernel: [57864.608610] ? __x64_sys_futex+0x78/0x1e0 Aug 22 21:28:10 juju-e4d256-prod-github-runner-207 kernel: [57864.609284] ? __secure_computing+0xa9/0x120 Aug 22 21:28:10 juju-e4d256-prod-github-runner-207 kernel: [57864.609970] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 21:28:10 juju-e4d256-prod-github-runner-207 kernel: [57864.610779] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:28:10 juju-e4d256-prod-github-runner-207 kernel: [57864.611519] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:28:10 juju-e4d256-prod-github-runner-207 kernel: [57864.612253] ? do_syscall_64+0x69/0xc0 Aug 22 21:28:10 juju-e4d256-prod-github-runner-207 kernel: [57864.612899] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:28:10 juju-e4d256-prod-github-runner-207 kernel: [57864.613606] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:28:10 juju-e4d256-prod-github-runner-207 kernel: [57864.614305] ? do_syscall_64+0x69/0xc0 Aug 22 21:28:10 juju-e4d256-prod-github-runner-207 kernel: [57864.614927] ? do_syscall_64+0x69/0xc0 Aug 22 21:28:10 juju-e4d256-prod-github-runner-207 kernel: [57864.615546] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 21:28:10 juju-e4d256-prod-github-runner-207 kernel: [57864.616267] RIP: 0033:0x7faa5d0edaff Aug 22 21:28:10 juju-e4d256-prod-github-runner-207 kernel: [57864.616901] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 21:28:10 juju-e4d256-prod-github-runner-207 kernel: [57864.618884] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 21:28:10 juju-e4d256-prod-github-runner-207 kernel: [57864.619794] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 21:28:10 juju-e4d256-prod-github-runner-207 kernel: [57864.620708] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 21:28:10 juju-e4d256-prod-github-runner-207 kernel: [57864.621596] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 21:28:10 juju-e4d256-prod-github-runner-207 kernel: [57864.622498] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 21:28:10 juju-e4d256-prod-github-runner-207 kernel: [57864.623519] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 21:28:10 juju-e4d256-prod-github-runner-207 kernel: [57864.624464] Aug 22 21:28:38 juju-e4d256-prod-github-runner-207 kernel: [57892.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 53808s! [qemu-system-x86:6715] Aug 22 21:28:38 juju-e4d256-prod-github-runner-207 kernel: [57892.543145] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 21:28:38 juju-e4d256-prod-github-runner-207 kernel: [57892.543221] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 21:28:38 juju-e4d256-prod-github-runner-207 kernel: [57892.555539] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 21:28:38 juju-e4d256-prod-github-runner-207 kernel: [57892.556808] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 21:28:38 juju-e4d256-prod-github-runner-207 kernel: [57892.558025] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:28:38 juju-e4d256-prod-github-runner-207 kernel: [57892.559080] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 21:28:38 juju-e4d256-prod-github-runner-207 kernel: [57892.561648] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 21:28:38 juju-e4d256-prod-github-runner-207 kernel: [57892.562693] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 21:28:38 juju-e4d256-prod-github-runner-207 kernel: [57892.563872] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 21:28:38 juju-e4d256-prod-github-runner-207 kernel: [57892.565105] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 21:28:38 juju-e4d256-prod-github-runner-207 kernel: [57892.566275] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 21:28:38 juju-e4d256-prod-github-runner-207 kernel: [57892.567436] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 21:28:38 juju-e4d256-prod-github-runner-207 kernel: [57892.568613] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 21:28:38 juju-e4d256-prod-github-runner-207 kernel: [57892.569850] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 21:28:38 juju-e4d256-prod-github-runner-207 kernel: [57892.570960] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 21:28:38 juju-e4d256-prod-github-runner-207 kernel: [57892.572167] Call Trace: Aug 22 21:28:38 juju-e4d256-prod-github-runner-207 kernel: [57892.573085] Aug 22 21:28:38 juju-e4d256-prod-github-runner-207 kernel: [57892.573968] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:28:38 juju-e4d256-prod-github-runner-207 kernel: [57892.575001] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:28:38 juju-e4d256-prod-github-runner-207 kernel: [57892.576037] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:28:38 juju-e4d256-prod-github-runner-207 kernel: [57892.577116] ? show_regs.part.0+0x23/0x29 Aug 22 21:28:38 juju-e4d256-prod-github-runner-207 kernel: [57892.578113] ? show_regs.cold+0x8/0xd Aug 22 21:28:38 juju-e4d256-prod-github-runner-207 kernel: [57892.579081] ? watchdog_timer_fn+0x1be/0x220 Aug 22 21:28:38 juju-e4d256-prod-github-runner-207 kernel: [57892.580129] ? lockup_detector_update_enable+0x60/0x60 Aug 22 21:28:38 juju-e4d256-prod-github-runner-207 kernel: [57892.581212] ? __hrtimer_run_queues+0x107/0x230 Aug 22 21:28:38 juju-e4d256-prod-github-runner-207 kernel: [57892.582294] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 21:28:38 juju-e4d256-prod-github-runner-207 kernel: [57892.583320] ? hrtimer_interrupt+0x101/0x220 Aug 22 21:28:38 juju-e4d256-prod-github-runner-207 kernel: [57892.584347] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 21:28:38 juju-e4d256-prod-github-runner-207 kernel: [57892.585511] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 21:28:38 juju-e4d256-prod-github-runner-207 kernel: [57892.586556] Aug 22 21:28:38 juju-e4d256-prod-github-runner-207 kernel: [57892.587410] Aug 22 21:28:38 juju-e4d256-prod-github-runner-207 kernel: [57892.588292] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 21:28:38 juju-e4d256-prod-github-runner-207 kernel: [57892.589329] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:28:38 juju-e4d256-prod-github-runner-207 kernel: [57892.590370] ? _raw_spin_lock+0x22/0x30 Aug 22 21:28:38 juju-e4d256-prod-github-runner-207 kernel: [57892.591324] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:28:38 juju-e4d256-prod-github-runner-207 kernel: [57892.592372] direct_page_fault+0x206/0x310 [kvm] Aug 22 21:28:38 juju-e4d256-prod-github-runner-207 kernel: [57892.593395] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 21:28:38 juju-e4d256-prod-github-runner-207 kernel: [57892.594402] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 21:28:38 juju-e4d256-prod-github-runner-207 kernel: [57892.595437] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 21:28:38 juju-e4d256-prod-github-runner-207 kernel: [57892.596436] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 21:28:38 juju-e4d256-prod-github-runner-207 kernel: [57892.597404] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 21:28:38 juju-e4d256-prod-github-runner-207 kernel: [57892.598528] handle_exit+0x98/0x230 [kvm_amd] Aug 22 21:28:38 juju-e4d256-prod-github-runner-207 kernel: [57892.599422] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 21:28:38 juju-e4d256-prod-github-runner-207 kernel: [57892.600431] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 21:28:38 juju-e4d256-prod-github-runner-207 kernel: [57892.601368] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 21:28:38 juju-e4d256-prod-github-runner-207 kernel: [57892.602271] vcpu_run+0x62/0x2c0 [kvm] Aug 22 21:28:38 juju-e4d256-prod-github-runner-207 kernel: [57892.603083] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 21:28:38 juju-e4d256-prod-github-runner-207 kernel: [57892.603914] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 21:28:38 juju-e4d256-prod-github-runner-207 kernel: [57892.604767] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 21:28:38 juju-e4d256-prod-github-runner-207 kernel: [57892.605567] ? __seccomp_filter+0x4a/0x4a0 Aug 22 21:28:38 juju-e4d256-prod-github-runner-207 kernel: [57892.606312] ? __fget_files+0x86/0xc0 Aug 22 21:28:38 juju-e4d256-prod-github-runner-207 kernel: [57892.607014] __x64_sys_ioctl+0x95/0xd0 Aug 22 21:28:38 juju-e4d256-prod-github-runner-207 kernel: [57892.607746] do_syscall_64+0x5c/0xc0 Aug 22 21:28:38 juju-e4d256-prod-github-runner-207 kernel: [57892.608433] ? do_futex+0x162/0x1f0 Aug 22 21:28:38 juju-e4d256-prod-github-runner-207 kernel: [57892.609082] ? __x64_sys_futex+0x78/0x1e0 Aug 22 21:28:38 juju-e4d256-prod-github-runner-207 kernel: [57892.609758] ? __secure_computing+0xa9/0x120 Aug 22 21:28:38 juju-e4d256-prod-github-runner-207 kernel: [57892.610453] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 21:28:38 juju-e4d256-prod-github-runner-207 kernel: [57892.611212] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:28:38 juju-e4d256-prod-github-runner-207 kernel: [57892.611947] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:28:38 juju-e4d256-prod-github-runner-207 kernel: [57892.612663] ? do_syscall_64+0x69/0xc0 Aug 22 21:28:38 juju-e4d256-prod-github-runner-207 kernel: [57892.613329] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:28:38 juju-e4d256-prod-github-runner-207 kernel: [57892.614033] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:28:38 juju-e4d256-prod-github-runner-207 kernel: [57892.614728] ? do_syscall_64+0x69/0xc0 Aug 22 21:28:38 juju-e4d256-prod-github-runner-207 kernel: [57892.615356] ? do_syscall_64+0x69/0xc0 Aug 22 21:28:38 juju-e4d256-prod-github-runner-207 kernel: [57892.615988] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 21:28:38 juju-e4d256-prod-github-runner-207 kernel: [57892.616698] RIP: 0033:0x7faa5d0edaff Aug 22 21:28:38 juju-e4d256-prod-github-runner-207 kernel: [57892.617335] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 21:28:38 juju-e4d256-prod-github-runner-207 kernel: [57892.619397] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 21:28:38 juju-e4d256-prod-github-runner-207 kernel: [57892.620341] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 21:28:38 juju-e4d256-prod-github-runner-207 kernel: [57892.621243] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 21:28:38 juju-e4d256-prod-github-runner-207 kernel: [57892.622146] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 21:28:38 juju-e4d256-prod-github-runner-207 kernel: [57892.623038] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 21:28:38 juju-e4d256-prod-github-runner-207 kernel: [57892.624004] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 21:28:38 juju-e4d256-prod-github-runner-207 kernel: [57892.624913] Aug 22 21:29:06 juju-e4d256-prod-github-runner-207 kernel: [57920.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 53834s! [qemu-system-x86:6715] Aug 22 21:29:06 juju-e4d256-prod-github-runner-207 kernel: [57920.543187] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 21:29:06 juju-e4d256-prod-github-runner-207 kernel: [57920.543463] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 21:29:06 juju-e4d256-prod-github-runner-207 kernel: [57920.555736] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 21:29:06 juju-e4d256-prod-github-runner-207 kernel: [57920.557011] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 21:29:06 juju-e4d256-prod-github-runner-207 kernel: [57920.558226] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:29:06 juju-e4d256-prod-github-runner-207 kernel: [57920.559360] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 21:29:06 juju-e4d256-prod-github-runner-207 kernel: [57920.562106] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 21:29:06 juju-e4d256-prod-github-runner-207 kernel: [57920.563153] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 21:29:06 juju-e4d256-prod-github-runner-207 kernel: [57920.564326] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 21:29:06 juju-e4d256-prod-github-runner-207 kernel: [57920.565483] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 21:29:06 juju-e4d256-prod-github-runner-207 kernel: [57920.566658] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 21:29:06 juju-e4d256-prod-github-runner-207 kernel: [57920.567833] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 21:29:06 juju-e4d256-prod-github-runner-207 kernel: [57920.569004] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 21:29:06 juju-e4d256-prod-github-runner-207 kernel: [57920.570256] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 21:29:06 juju-e4d256-prod-github-runner-207 kernel: [57920.571366] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 21:29:06 juju-e4d256-prod-github-runner-207 kernel: [57920.572597] Call Trace: Aug 22 21:29:06 juju-e4d256-prod-github-runner-207 kernel: [57920.573535] Aug 22 21:29:06 juju-e4d256-prod-github-runner-207 kernel: [57920.574447] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:29:06 juju-e4d256-prod-github-runner-207 kernel: [57920.575533] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:29:06 juju-e4d256-prod-github-runner-207 kernel: [57920.576556] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:29:06 juju-e4d256-prod-github-runner-207 kernel: [57920.577759] ? show_regs.part.0+0x23/0x29 Aug 22 21:29:06 juju-e4d256-prod-github-runner-207 kernel: [57920.578910] ? show_regs.cold+0x8/0xd Aug 22 21:29:06 juju-e4d256-prod-github-runner-207 kernel: [57920.580025] ? watchdog_timer_fn+0x1be/0x220 Aug 22 21:29:06 juju-e4d256-prod-github-runner-207 kernel: [57920.581177] ? lockup_detector_update_enable+0x60/0x60 Aug 22 21:29:06 juju-e4d256-prod-github-runner-207 kernel: [57920.582366] ? __hrtimer_run_queues+0x107/0x230 Aug 22 21:29:06 juju-e4d256-prod-github-runner-207 kernel: [57920.583426] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 21:29:06 juju-e4d256-prod-github-runner-207 kernel: [57920.584449] ? hrtimer_interrupt+0x101/0x220 Aug 22 21:29:06 juju-e4d256-prod-github-runner-207 kernel: [57920.585466] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 21:29:06 juju-e4d256-prod-github-runner-207 kernel: [57920.586612] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 21:29:06 juju-e4d256-prod-github-runner-207 kernel: [57920.587672] Aug 22 21:29:06 juju-e4d256-prod-github-runner-207 kernel: [57920.588526] Aug 22 21:29:06 juju-e4d256-prod-github-runner-207 kernel: [57920.589362] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 21:29:06 juju-e4d256-prod-github-runner-207 kernel: [57920.590394] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:29:06 juju-e4d256-prod-github-runner-207 kernel: [57920.591444] ? _raw_spin_lock+0x22/0x30 Aug 22 21:29:06 juju-e4d256-prod-github-runner-207 kernel: [57920.592391] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:29:06 juju-e4d256-prod-github-runner-207 kernel: [57920.593409] direct_page_fault+0x206/0x310 [kvm] Aug 22 21:29:06 juju-e4d256-prod-github-runner-207 kernel: [57920.594432] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 21:29:06 juju-e4d256-prod-github-runner-207 kernel: [57920.595447] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 21:29:06 juju-e4d256-prod-github-runner-207 kernel: [57920.596448] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 21:29:06 juju-e4d256-prod-github-runner-207 kernel: [57920.597464] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 21:29:06 juju-e4d256-prod-github-runner-207 kernel: [57920.598407] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 21:29:06 juju-e4d256-prod-github-runner-207 kernel: [57920.599392] handle_exit+0x98/0x230 [kvm_amd] Aug 22 21:29:06 juju-e4d256-prod-github-runner-207 kernel: [57920.600289] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 21:29:06 juju-e4d256-prod-github-runner-207 kernel: [57920.601202] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 21:29:06 juju-e4d256-prod-github-runner-207 kernel: [57920.602124] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 21:29:06 juju-e4d256-prod-github-runner-207 kernel: [57920.603026] vcpu_run+0x62/0x2c0 [kvm] Aug 22 21:29:06 juju-e4d256-prod-github-runner-207 kernel: [57920.603845] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 21:29:06 juju-e4d256-prod-github-runner-207 kernel: [57920.604652] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 21:29:06 juju-e4d256-prod-github-runner-207 kernel: [57920.605509] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 21:29:06 juju-e4d256-prod-github-runner-207 kernel: [57920.606303] ? __seccomp_filter+0x4a/0x4a0 Aug 22 21:29:06 juju-e4d256-prod-github-runner-207 kernel: [57920.607052] ? __fget_files+0x86/0xc0 Aug 22 21:29:06 juju-e4d256-prod-github-runner-207 kernel: [57920.607761] __x64_sys_ioctl+0x95/0xd0 Aug 22 21:29:06 juju-e4d256-prod-github-runner-207 kernel: [57920.608452] do_syscall_64+0x5c/0xc0 Aug 22 21:29:06 juju-e4d256-prod-github-runner-207 kernel: [57920.609115] ? do_futex+0x162/0x1f0 Aug 22 21:29:06 juju-e4d256-prod-github-runner-207 kernel: [57920.609765] ? __x64_sys_futex+0x78/0x1e0 Aug 22 21:29:06 juju-e4d256-prod-github-runner-207 kernel: [57920.610436] ? __secure_computing+0xa9/0x120 Aug 22 21:29:06 juju-e4d256-prod-github-runner-207 kernel: [57920.611123] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 21:29:06 juju-e4d256-prod-github-runner-207 kernel: [57920.611887] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:29:06 juju-e4d256-prod-github-runner-207 kernel: [57920.612612] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:29:06 juju-e4d256-prod-github-runner-207 kernel: [57920.613326] ? do_syscall_64+0x69/0xc0 Aug 22 21:29:06 juju-e4d256-prod-github-runner-207 kernel: [57920.613968] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:29:06 juju-e4d256-prod-github-runner-207 kernel: [57920.614669] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:29:06 juju-e4d256-prod-github-runner-207 kernel: [57920.615372] ? do_syscall_64+0x69/0xc0 Aug 22 21:29:06 juju-e4d256-prod-github-runner-207 kernel: [57920.615996] ? do_syscall_64+0x69/0xc0 Aug 22 21:29:06 juju-e4d256-prod-github-runner-207 kernel: [57920.616616] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 21:29:06 juju-e4d256-prod-github-runner-207 kernel: [57920.617324] RIP: 0033:0x7faa5d0edaff Aug 22 21:29:06 juju-e4d256-prod-github-runner-207 kernel: [57920.617974] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 21:29:06 juju-e4d256-prod-github-runner-207 kernel: [57920.619977] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 21:29:06 juju-e4d256-prod-github-runner-207 kernel: [57920.620887] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 21:29:06 juju-e4d256-prod-github-runner-207 kernel: [57920.621882] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 21:29:06 juju-e4d256-prod-github-runner-207 kernel: [57920.622773] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 21:29:06 juju-e4d256-prod-github-runner-207 kernel: [57920.623664] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 21:29:06 juju-e4d256-prod-github-runner-207 kernel: [57920.624553] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 21:29:06 juju-e4d256-prod-github-runner-207 kernel: [57920.625454] Aug 22 21:29:34 juju-e4d256-prod-github-runner-207 kernel: [57948.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 53860s! [qemu-system-x86:6715] Aug 22 21:29:34 juju-e4d256-prod-github-runner-207 kernel: [57948.543866] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 21:29:34 juju-e4d256-prod-github-runner-207 kernel: [57948.544076] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 21:29:34 juju-e4d256-prod-github-runner-207 kernel: [57948.556139] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 21:29:34 juju-e4d256-prod-github-runner-207 kernel: [57948.557402] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 21:29:34 juju-e4d256-prod-github-runner-207 kernel: [57948.558620] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:29:34 juju-e4d256-prod-github-runner-207 kernel: [57948.559690] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 21:29:34 juju-e4d256-prod-github-runner-207 kernel: [57948.562236] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 21:29:34 juju-e4d256-prod-github-runner-207 kernel: [57948.563294] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 21:29:34 juju-e4d256-prod-github-runner-207 kernel: [57948.564460] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 21:29:34 juju-e4d256-prod-github-runner-207 kernel: [57948.565620] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 21:29:34 juju-e4d256-prod-github-runner-207 kernel: [57948.566784] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 21:29:34 juju-e4d256-prod-github-runner-207 kernel: [57948.567957] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 21:29:34 juju-e4d256-prod-github-runner-207 kernel: [57948.569120] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 21:29:34 juju-e4d256-prod-github-runner-207 kernel: [57948.570352] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 21:29:34 juju-e4d256-prod-github-runner-207 kernel: [57948.571459] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 21:29:34 juju-e4d256-prod-github-runner-207 kernel: [57948.572649] Call Trace: Aug 22 21:29:34 juju-e4d256-prod-github-runner-207 kernel: [57948.573565] Aug 22 21:29:34 juju-e4d256-prod-github-runner-207 kernel: [57948.574456] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:29:34 juju-e4d256-prod-github-runner-207 kernel: [57948.575488] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:29:34 juju-e4d256-prod-github-runner-207 kernel: [57948.576512] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:29:34 juju-e4d256-prod-github-runner-207 kernel: [57948.577586] ? show_regs.part.0+0x23/0x29 Aug 22 21:29:34 juju-e4d256-prod-github-runner-207 kernel: [57948.578579] ? show_regs.cold+0x8/0xd Aug 22 21:29:34 juju-e4d256-prod-github-runner-207 kernel: [57948.579569] ? watchdog_timer_fn+0x1be/0x220 Aug 22 21:29:34 juju-e4d256-prod-github-runner-207 kernel: [57948.580575] ? lockup_detector_update_enable+0x60/0x60 Aug 22 21:29:34 juju-e4d256-prod-github-runner-207 kernel: [57948.581637] ? __hrtimer_run_queues+0x107/0x230 Aug 22 21:29:34 juju-e4d256-prod-github-runner-207 kernel: [57948.582662] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 21:29:34 juju-e4d256-prod-github-runner-207 kernel: [57948.583692] ? hrtimer_interrupt+0x101/0x220 Aug 22 21:29:34 juju-e4d256-prod-github-runner-207 kernel: [57948.584710] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 21:29:34 juju-e4d256-prod-github-runner-207 kernel: [57948.585780] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 21:29:34 juju-e4d256-prod-github-runner-207 kernel: [57948.586825] Aug 22 21:29:34 juju-e4d256-prod-github-runner-207 kernel: [57948.587683] Aug 22 21:29:34 juju-e4d256-prod-github-runner-207 kernel: [57948.588518] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 21:29:34 juju-e4d256-prod-github-runner-207 kernel: [57948.589575] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:29:34 juju-e4d256-prod-github-runner-207 kernel: [57948.590621] ? _raw_spin_lock+0x22/0x30 Aug 22 21:29:34 juju-e4d256-prod-github-runner-207 kernel: [57948.591584] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:29:34 juju-e4d256-prod-github-runner-207 kernel: [57948.592598] direct_page_fault+0x206/0x310 [kvm] Aug 22 21:29:34 juju-e4d256-prod-github-runner-207 kernel: [57948.593619] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 21:29:34 juju-e4d256-prod-github-runner-207 kernel: [57948.594624] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 21:29:34 juju-e4d256-prod-github-runner-207 kernel: [57948.595634] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 21:29:34 juju-e4d256-prod-github-runner-207 kernel: [57948.596611] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 21:29:34 juju-e4d256-prod-github-runner-207 kernel: [57948.597553] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 21:29:34 juju-e4d256-prod-github-runner-207 kernel: [57948.598531] handle_exit+0x98/0x230 [kvm_amd] Aug 22 21:29:34 juju-e4d256-prod-github-runner-207 kernel: [57948.599438] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 21:29:34 juju-e4d256-prod-github-runner-207 kernel: [57948.600349] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 21:29:34 juju-e4d256-prod-github-runner-207 kernel: [57948.601276] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 21:29:34 juju-e4d256-prod-github-runner-207 kernel: [57948.602177] vcpu_run+0x62/0x2c0 [kvm] Aug 22 21:29:34 juju-e4d256-prod-github-runner-207 kernel: [57948.603026] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 21:29:34 juju-e4d256-prod-github-runner-207 kernel: [57948.603832] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 21:29:34 juju-e4d256-prod-github-runner-207 kernel: [57948.604681] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 21:29:34 juju-e4d256-prod-github-runner-207 kernel: [57948.605480] ? __seccomp_filter+0x4a/0x4a0 Aug 22 21:29:34 juju-e4d256-prod-github-runner-207 kernel: [57948.606233] ? __fget_files+0x86/0xc0 Aug 22 21:29:34 juju-e4d256-prod-github-runner-207 kernel: [57948.607004] __x64_sys_ioctl+0x95/0xd0 Aug 22 21:29:34 juju-e4d256-prod-github-runner-207 kernel: [57948.607698] do_syscall_64+0x5c/0xc0 Aug 22 21:29:34 juju-e4d256-prod-github-runner-207 kernel: [57948.608414] ? do_futex+0x162/0x1f0 Aug 22 21:29:34 juju-e4d256-prod-github-runner-207 kernel: [57948.609091] ? __x64_sys_futex+0x78/0x1e0 Aug 22 21:29:34 juju-e4d256-prod-github-runner-207 kernel: [57948.609775] ? __secure_computing+0xa9/0x120 Aug 22 21:29:34 juju-e4d256-prod-github-runner-207 kernel: [57948.610463] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 21:29:34 juju-e4d256-prod-github-runner-207 kernel: [57948.611251] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:29:34 juju-e4d256-prod-github-runner-207 kernel: [57948.612047] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:29:34 juju-e4d256-prod-github-runner-207 kernel: [57948.612768] ? do_syscall_64+0x69/0xc0 Aug 22 21:29:34 juju-e4d256-prod-github-runner-207 kernel: [57948.613413] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:29:34 juju-e4d256-prod-github-runner-207 kernel: [57948.614119] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:29:34 juju-e4d256-prod-github-runner-207 kernel: [57948.614814] ? do_syscall_64+0x69/0xc0 Aug 22 21:29:34 juju-e4d256-prod-github-runner-207 kernel: [57948.615456] ? do_syscall_64+0x69/0xc0 Aug 22 21:29:34 juju-e4d256-prod-github-runner-207 kernel: [57948.616077] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 21:29:34 juju-e4d256-prod-github-runner-207 kernel: [57948.616782] RIP: 0033:0x7faa5d0edaff Aug 22 21:29:34 juju-e4d256-prod-github-runner-207 kernel: [57948.617419] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 21:29:34 juju-e4d256-prod-github-runner-207 kernel: [57948.619450] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 21:29:34 juju-e4d256-prod-github-runner-207 kernel: [57948.620373] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 21:29:34 juju-e4d256-prod-github-runner-207 kernel: [57948.621260] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 21:29:34 juju-e4d256-prod-github-runner-207 kernel: [57948.622180] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 21:29:34 juju-e4d256-prod-github-runner-207 kernel: [57948.623096] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 21:29:34 juju-e4d256-prod-github-runner-207 kernel: [57948.623989] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 21:29:34 juju-e4d256-prod-github-runner-207 kernel: [57948.624879] Aug 22 21:29:47 juju-e4d256-prod-github-runner-207 kernel: [57961.052710] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 21:29:47 juju-e4d256-prod-github-runner-207 kernel: [57961.053750] rcu: 1-....: (14415442 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=6966699 Aug 22 21:29:47 juju-e4d256-prod-github-runner-207 kernel: [57961.054996] (t=14460963 jiffies g=23269 q=52691) Aug 22 21:29:47 juju-e4d256-prod-github-runner-207 kernel: [57961.055790] NMI backtrace for cpu 1 Aug 22 21:29:47 juju-e4d256-prod-github-runner-207 kernel: [57961.056510] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 21:29:47 juju-e4d256-prod-github-runner-207 kernel: [57961.057638] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 21:29:47 juju-e4d256-prod-github-runner-207 kernel: [57961.058696] Call Trace: Aug 22 21:29:47 juju-e4d256-prod-github-runner-207 kernel: [57961.059386] Aug 22 21:29:47 juju-e4d256-prod-github-runner-207 kernel: [57961.060030] show_stack+0x52/0x5c Aug 22 21:29:47 juju-e4d256-prod-github-runner-207 kernel: [57961.060752] dump_stack_lvl+0x4a/0x63 Aug 22 21:29:47 juju-e4d256-prod-github-runner-207 kernel: [57961.061499] dump_stack+0x10/0x16 Aug 22 21:29:47 juju-e4d256-prod-github-runner-207 kernel: [57961.062214] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 21:29:47 juju-e4d256-prod-github-runner-207 kernel: [57961.063008] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 21:29:47 juju-e4d256-prod-github-runner-207 kernel: [57961.063787] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 21:29:47 juju-e4d256-prod-github-runner-207 kernel: [57961.064605] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 21:29:47 juju-e4d256-prod-github-runner-207 kernel: [57961.065424] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 21:29:47 juju-e4d256-prod-github-runner-207 kernel: [57961.066244] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 21:29:47 juju-e4d256-prod-github-runner-207 kernel: [57961.067030] print_cpu_stall.cold+0x2f/0xe2 Aug 22 21:29:47 juju-e4d256-prod-github-runner-207 kernel: [57961.067798] ? timekeeping_update+0xf7/0x150 Aug 22 21:29:47 juju-e4d256-prod-github-runner-207 kernel: [57961.068571] check_cpu_stall+0x109/0x270 Aug 22 21:29:47 juju-e4d256-prod-github-runner-207 kernel: [57961.069316] rcu_sched_clock_irq+0x9a/0x250 Aug 22 21:29:47 juju-e4d256-prod-github-runner-207 kernel: [57961.070076] update_process_times+0x94/0xd0 Aug 22 21:29:47 juju-e4d256-prod-github-runner-207 kernel: [57961.070846] tick_sched_handle+0x29/0x70 Aug 22 21:29:47 juju-e4d256-prod-github-runner-207 kernel: [57961.071591] tick_sched_timer+0x8c/0xc0 Aug 22 21:29:47 juju-e4d256-prod-github-runner-207 kernel: [57961.072334] ? tick_nohz_handler+0xb0/0xb0 Aug 22 21:29:47 juju-e4d256-prod-github-runner-207 kernel: [57961.073091] __hrtimer_run_queues+0x107/0x230 Aug 22 21:29:47 juju-e4d256-prod-github-runner-207 kernel: [57961.073863] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 21:29:47 juju-e4d256-prod-github-runner-207 kernel: [57961.074653] hrtimer_interrupt+0x101/0x220 Aug 22 21:29:47 juju-e4d256-prod-github-runner-207 kernel: [57961.075470] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 21:29:47 juju-e4d256-prod-github-runner-207 kernel: [57961.076282] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 21:29:47 juju-e4d256-prod-github-runner-207 kernel: [57961.077079] Aug 22 21:29:47 juju-e4d256-prod-github-runner-207 kernel: [57961.077711] Aug 22 21:29:47 juju-e4d256-prod-github-runner-207 kernel: [57961.078337] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 21:29:47 juju-e4d256-prod-github-runner-207 kernel: [57961.079160] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:29:47 juju-e4d256-prod-github-runner-207 kernel: [57961.080044] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 21:29:47 juju-e4d256-prod-github-runner-207 kernel: [57961.082254] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 21:29:47 juju-e4d256-prod-github-runner-207 kernel: [57961.083130] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 21:29:47 juju-e4d256-prod-github-runner-207 kernel: [57961.084114] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 21:29:47 juju-e4d256-prod-github-runner-207 kernel: [57961.085081] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 21:29:47 juju-e4d256-prod-github-runner-207 kernel: [57961.086036] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 21:29:47 juju-e4d256-prod-github-runner-207 kernel: [57961.086996] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 21:29:47 juju-e4d256-prod-github-runner-207 kernel: [57961.087946] ? _raw_spin_lock+0x22/0x30 Aug 22 21:29:47 juju-e4d256-prod-github-runner-207 kernel: [57961.088706] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:29:47 juju-e4d256-prod-github-runner-207 kernel: [57961.089535] direct_page_fault+0x206/0x310 [kvm] Aug 22 21:29:47 juju-e4d256-prod-github-runner-207 kernel: [57961.090368] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 21:29:47 juju-e4d256-prod-github-runner-207 kernel: [57961.091202] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 21:29:47 juju-e4d256-prod-github-runner-207 kernel: [57961.092021] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 21:29:47 juju-e4d256-prod-github-runner-207 kernel: [57961.092820] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 21:29:47 juju-e4d256-prod-github-runner-207 kernel: [57961.093614] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 21:29:47 juju-e4d256-prod-github-runner-207 kernel: [57961.094436] handle_exit+0x98/0x230 [kvm_amd] Aug 22 21:29:47 juju-e4d256-prod-github-runner-207 kernel: [57961.095208] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 21:29:47 juju-e4d256-prod-github-runner-207 kernel: [57961.095988] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 21:29:47 juju-e4d256-prod-github-runner-207 kernel: [57961.096781] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 21:29:47 juju-e4d256-prod-github-runner-207 kernel: [57961.097566] vcpu_run+0x62/0x2c0 [kvm] Aug 22 21:29:47 juju-e4d256-prod-github-runner-207 kernel: [57961.098276] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 21:29:47 juju-e4d256-prod-github-runner-207 kernel: [57961.099017] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 21:29:47 juju-e4d256-prod-github-runner-207 kernel: [57961.099814] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 21:29:47 juju-e4d256-prod-github-runner-207 kernel: [57961.100574] ? __seccomp_filter+0x4a/0x4a0 Aug 22 21:29:47 juju-e4d256-prod-github-runner-207 kernel: [57961.101305] ? __fget_files+0x86/0xc0 Aug 22 21:29:47 juju-e4d256-prod-github-runner-207 kernel: [57961.102006] __x64_sys_ioctl+0x95/0xd0 Aug 22 21:29:47 juju-e4d256-prod-github-runner-207 kernel: [57961.102698] do_syscall_64+0x5c/0xc0 Aug 22 21:29:47 juju-e4d256-prod-github-runner-207 kernel: [57961.103398] ? do_futex+0x162/0x1f0 Aug 22 21:29:47 juju-e4d256-prod-github-runner-207 kernel: [57961.104069] ? __x64_sys_futex+0x78/0x1e0 Aug 22 21:29:47 juju-e4d256-prod-github-runner-207 kernel: [57961.104766] ? __secure_computing+0xa9/0x120 Aug 22 21:29:47 juju-e4d256-prod-github-runner-207 kernel: [57961.105477] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 21:29:47 juju-e4d256-prod-github-runner-207 kernel: [57961.106263] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:29:47 juju-e4d256-prod-github-runner-207 kernel: [57961.107026] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:29:47 juju-e4d256-prod-github-runner-207 kernel: [57961.107778] ? do_syscall_64+0x69/0xc0 Aug 22 21:29:47 juju-e4d256-prod-github-runner-207 kernel: [57961.108732] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:29:47 juju-e4d256-prod-github-runner-207 kernel: [57961.109511] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:29:47 juju-e4d256-prod-github-runner-207 kernel: [57961.110282] ? do_syscall_64+0x69/0xc0 Aug 22 21:29:47 juju-e4d256-prod-github-runner-207 kernel: [57961.110986] ? do_syscall_64+0x69/0xc0 Aug 22 21:29:47 juju-e4d256-prod-github-runner-207 kernel: [57961.111672] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 21:29:47 juju-e4d256-prod-github-runner-207 kernel: [57961.112450] RIP: 0033:0x7faa5d0edaff Aug 22 21:29:47 juju-e4d256-prod-github-runner-207 kernel: [57961.113137] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 21:29:47 juju-e4d256-prod-github-runner-207 kernel: [57961.115245] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 21:29:47 juju-e4d256-prod-github-runner-207 kernel: [57961.116218] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 21:29:47 juju-e4d256-prod-github-runner-207 kernel: [57961.117181] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 21:29:47 juju-e4d256-prod-github-runner-207 kernel: [57961.118134] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 21:29:47 juju-e4d256-prod-github-runner-207 kernel: [57961.119089] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 21:29:47 juju-e4d256-prod-github-runner-207 kernel: [57961.120015] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 21:29:47 juju-e4d256-prod-github-runner-207 kernel: [57961.120928] Aug 22 21:30:14 juju-e4d256-prod-github-runner-207 kernel: [57988.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 53898s! [qemu-system-x86:6715] Aug 22 21:30:14 juju-e4d256-prod-github-runner-207 kernel: [57988.543152] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 21:30:14 juju-e4d256-prod-github-runner-207 kernel: [57988.543231] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 21:30:14 juju-e4d256-prod-github-runner-207 kernel: [57988.555924] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 21:30:14 juju-e4d256-prod-github-runner-207 kernel: [57988.557208] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 21:30:14 juju-e4d256-prod-github-runner-207 kernel: [57988.558454] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:30:14 juju-e4d256-prod-github-runner-207 kernel: [57988.559526] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 21:30:14 juju-e4d256-prod-github-runner-207 kernel: [57988.562109] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 21:30:14 juju-e4d256-prod-github-runner-207 kernel: [57988.563177] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 21:30:14 juju-e4d256-prod-github-runner-207 kernel: [57988.564347] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 21:30:14 juju-e4d256-prod-github-runner-207 kernel: [57988.565574] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 21:30:14 juju-e4d256-prod-github-runner-207 kernel: [57988.566774] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 21:30:14 juju-e4d256-prod-github-runner-207 kernel: [57988.567945] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 21:30:14 juju-e4d256-prod-github-runner-207 kernel: [57988.569121] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 21:30:14 juju-e4d256-prod-github-runner-207 kernel: [57988.570374] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 21:30:14 juju-e4d256-prod-github-runner-207 kernel: [57988.571506] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 21:30:14 juju-e4d256-prod-github-runner-207 kernel: [57988.572702] Call Trace: Aug 22 21:30:14 juju-e4d256-prod-github-runner-207 kernel: [57988.573651] Aug 22 21:30:14 juju-e4d256-prod-github-runner-207 kernel: [57988.574645] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:30:14 juju-e4d256-prod-github-runner-207 kernel: [57988.575730] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:30:14 juju-e4d256-prod-github-runner-207 kernel: [57988.576769] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:30:14 juju-e4d256-prod-github-runner-207 kernel: [57988.577859] ? show_regs.part.0+0x23/0x29 Aug 22 21:30:14 juju-e4d256-prod-github-runner-207 kernel: [57988.579256] ? show_regs.cold+0x8/0xd Aug 22 21:30:14 juju-e4d256-prod-github-runner-207 kernel: [57988.580483] ? watchdog_timer_fn+0x1be/0x220 Aug 22 21:30:14 juju-e4d256-prod-github-runner-207 kernel: [57988.581524] ? lockup_detector_update_enable+0x60/0x60 Aug 22 21:30:14 juju-e4d256-prod-github-runner-207 kernel: [57988.582621] ? __hrtimer_run_queues+0x107/0x230 Aug 22 21:30:14 juju-e4d256-prod-github-runner-207 kernel: [57988.583673] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 21:30:14 juju-e4d256-prod-github-runner-207 kernel: [57988.584708] ? hrtimer_interrupt+0x101/0x220 Aug 22 21:30:14 juju-e4d256-prod-github-runner-207 kernel: [57988.585745] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 21:30:14 juju-e4d256-prod-github-runner-207 kernel: [57988.586855] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 21:30:14 juju-e4d256-prod-github-runner-207 kernel: [57988.587914] Aug 22 21:30:14 juju-e4d256-prod-github-runner-207 kernel: [57988.588824] Aug 22 21:30:14 juju-e4d256-prod-github-runner-207 kernel: [57988.589668] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 21:30:14 juju-e4d256-prod-github-runner-207 kernel: [57988.590734] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:30:14 juju-e4d256-prod-github-runner-207 kernel: [57988.591793] ? _raw_spin_lock+0x22/0x30 Aug 22 21:30:14 juju-e4d256-prod-github-runner-207 kernel: [57988.592750] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:30:14 juju-e4d256-prod-github-runner-207 kernel: [57988.593838] direct_page_fault+0x206/0x310 [kvm] Aug 22 21:30:14 juju-e4d256-prod-github-runner-207 kernel: [57988.594896] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 21:30:14 juju-e4d256-prod-github-runner-207 kernel: [57988.595941] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 21:30:14 juju-e4d256-prod-github-runner-207 kernel: [57988.597005] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 21:30:14 juju-e4d256-prod-github-runner-207 kernel: [57988.597993] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 21:30:14 juju-e4d256-prod-github-runner-207 kernel: [57988.598956] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 21:30:14 juju-e4d256-prod-github-runner-207 kernel: [57988.599951] handle_exit+0x98/0x230 [kvm_amd] Aug 22 21:30:14 juju-e4d256-prod-github-runner-207 kernel: [57988.600868] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 21:30:14 juju-e4d256-prod-github-runner-207 kernel: [57988.601826] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 21:30:14 juju-e4d256-prod-github-runner-207 kernel: [57988.602807] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 21:30:14 juju-e4d256-prod-github-runner-207 kernel: [57988.603771] vcpu_run+0x62/0x2c0 [kvm] Aug 22 21:30:14 juju-e4d256-prod-github-runner-207 kernel: [57988.604664] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 21:30:14 juju-e4d256-prod-github-runner-207 kernel: [57988.605489] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 21:30:14 juju-e4d256-prod-github-runner-207 kernel: [57988.606514] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 21:30:14 juju-e4d256-prod-github-runner-207 kernel: [57988.607358] ? __seccomp_filter+0x4a/0x4a0 Aug 22 21:30:14 juju-e4d256-prod-github-runner-207 kernel: [57988.608110] ? __fget_files+0x86/0xc0 Aug 22 21:30:14 juju-e4d256-prod-github-runner-207 kernel: [57988.608841] __x64_sys_ioctl+0x95/0xd0 Aug 22 21:30:14 juju-e4d256-prod-github-runner-207 kernel: [57988.609552] do_syscall_64+0x5c/0xc0 Aug 22 21:30:14 juju-e4d256-prod-github-runner-207 kernel: [57988.610223] ? do_futex+0x162/0x1f0 Aug 22 21:30:14 juju-e4d256-prod-github-runner-207 kernel: [57988.610907] ? __x64_sys_futex+0x78/0x1e0 Aug 22 21:30:14 juju-e4d256-prod-github-runner-207 kernel: [57988.611595] ? __secure_computing+0xa9/0x120 Aug 22 21:30:14 juju-e4d256-prod-github-runner-207 kernel: [57988.612306] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 21:30:14 juju-e4d256-prod-github-runner-207 kernel: [57988.613075] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:30:14 juju-e4d256-prod-github-runner-207 kernel: [57988.613815] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:30:14 juju-e4d256-prod-github-runner-207 kernel: [57988.614564] ? do_syscall_64+0x69/0xc0 Aug 22 21:30:14 juju-e4d256-prod-github-runner-207 kernel: [57988.615222] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:30:14 juju-e4d256-prod-github-runner-207 kernel: [57988.615930] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:30:14 juju-e4d256-prod-github-runner-207 kernel: [57988.616639] ? do_syscall_64+0x69/0xc0 Aug 22 21:30:14 juju-e4d256-prod-github-runner-207 kernel: [57988.617320] ? do_syscall_64+0x69/0xc0 Aug 22 21:30:14 juju-e4d256-prod-github-runner-207 kernel: [57988.617953] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 21:30:14 juju-e4d256-prod-github-runner-207 kernel: [57988.618680] RIP: 0033:0x7faa5d0edaff Aug 22 21:30:14 juju-e4d256-prod-github-runner-207 kernel: [57988.619313] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 21:30:14 juju-e4d256-prod-github-runner-207 kernel: [57988.621357] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 21:30:14 juju-e4d256-prod-github-runner-207 kernel: [57988.622299] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 21:30:14 juju-e4d256-prod-github-runner-207 kernel: [57988.623221] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 21:30:14 juju-e4d256-prod-github-runner-207 kernel: [57988.624115] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 21:30:14 juju-e4d256-prod-github-runner-207 kernel: [57988.625008] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 21:30:14 juju-e4d256-prod-github-runner-207 kernel: [57988.625911] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 21:30:14 juju-e4d256-prod-github-runner-207 kernel: [57988.626843] Aug 22 21:30:42 juju-e4d256-prod-github-runner-207 kernel: [58016.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 53924s! [qemu-system-x86:6715] Aug 22 21:30:42 juju-e4d256-prod-github-runner-207 kernel: [58016.543846] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 21:30:42 juju-e4d256-prod-github-runner-207 kernel: [58016.544132] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 21:30:42 juju-e4d256-prod-github-runner-207 kernel: [58016.556640] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 21:30:42 juju-e4d256-prod-github-runner-207 kernel: [58016.558119] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 21:30:42 juju-e4d256-prod-github-runner-207 kernel: [58016.559341] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:30:42 juju-e4d256-prod-github-runner-207 kernel: [58016.560457] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 21:30:42 juju-e4d256-prod-github-runner-207 kernel: [58016.563087] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 21:30:42 juju-e4d256-prod-github-runner-207 kernel: [58016.564288] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 21:30:42 juju-e4d256-prod-github-runner-207 kernel: [58016.565469] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 21:30:42 juju-e4d256-prod-github-runner-207 kernel: [58016.566757] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 21:30:42 juju-e4d256-prod-github-runner-207 kernel: [58016.568031] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 21:30:42 juju-e4d256-prod-github-runner-207 kernel: [58016.569243] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 21:30:42 juju-e4d256-prod-github-runner-207 kernel: [58016.570427] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 21:30:42 juju-e4d256-prod-github-runner-207 kernel: [58016.571702] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 21:30:42 juju-e4d256-prod-github-runner-207 kernel: [58016.572870] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 21:30:42 juju-e4d256-prod-github-runner-207 kernel: [58016.574097] Call Trace: Aug 22 21:30:42 juju-e4d256-prod-github-runner-207 kernel: [58016.575082] Aug 22 21:30:42 juju-e4d256-prod-github-runner-207 kernel: [58016.575992] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:30:42 juju-e4d256-prod-github-runner-207 kernel: [58016.577094] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:30:42 juju-e4d256-prod-github-runner-207 kernel: [58016.578147] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:30:42 juju-e4d256-prod-github-runner-207 kernel: [58016.579301] ? show_regs.part.0+0x23/0x29 Aug 22 21:30:42 juju-e4d256-prod-github-runner-207 kernel: [58016.580298] ? show_regs.cold+0x8/0xd Aug 22 21:30:42 juju-e4d256-prod-github-runner-207 kernel: [58016.581339] ? watchdog_timer_fn+0x1be/0x220 Aug 22 21:30:42 juju-e4d256-prod-github-runner-207 kernel: [58016.582365] ? lockup_detector_update_enable+0x60/0x60 Aug 22 21:30:42 juju-e4d256-prod-github-runner-207 kernel: [58016.583513] ? __hrtimer_run_queues+0x107/0x230 Aug 22 21:30:42 juju-e4d256-prod-github-runner-207 kernel: [58016.584559] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 21:30:42 juju-e4d256-prod-github-runner-207 kernel: [58016.585706] ? hrtimer_interrupt+0x101/0x220 Aug 22 21:30:42 juju-e4d256-prod-github-runner-207 kernel: [58016.586768] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 21:30:42 juju-e4d256-prod-github-runner-207 kernel: [58016.587906] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 21:30:42 juju-e4d256-prod-github-runner-207 kernel: [58016.589021] Aug 22 21:30:42 juju-e4d256-prod-github-runner-207 kernel: [58016.589878] Aug 22 21:30:42 juju-e4d256-prod-github-runner-207 kernel: [58016.590737] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 21:30:42 juju-e4d256-prod-github-runner-207 kernel: [58016.591949] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:30:42 juju-e4d256-prod-github-runner-207 kernel: [58016.593104] ? _raw_spin_lock+0x22/0x30 Aug 22 21:30:42 juju-e4d256-prod-github-runner-207 kernel: [58016.594086] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:30:42 juju-e4d256-prod-github-runner-207 kernel: [58016.595114] direct_page_fault+0x206/0x310 [kvm] Aug 22 21:30:42 juju-e4d256-prod-github-runner-207 kernel: [58016.596217] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 21:30:42 juju-e4d256-prod-github-runner-207 kernel: [58016.597307] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 21:30:42 juju-e4d256-prod-github-runner-207 kernel: [58016.598341] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 21:30:42 juju-e4d256-prod-github-runner-207 kernel: [58016.599481] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 21:30:42 juju-e4d256-prod-github-runner-207 kernel: [58016.600544] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 21:30:42 juju-e4d256-prod-github-runner-207 kernel: [58016.601664] handle_exit+0x98/0x230 [kvm_amd] Aug 22 21:30:42 juju-e4d256-prod-github-runner-207 kernel: [58016.602797] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 21:30:42 juju-e4d256-prod-github-runner-207 kernel: [58016.603976] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 21:30:42 juju-e4d256-prod-github-runner-207 kernel: [58016.605091] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 21:30:42 juju-e4d256-prod-github-runner-207 kernel: [58016.606014] vcpu_run+0x62/0x2c0 [kvm] Aug 22 21:30:42 juju-e4d256-prod-github-runner-207 kernel: [58016.606999] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 21:30:42 juju-e4d256-prod-github-runner-207 kernel: [58016.607845] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 21:30:42 juju-e4d256-prod-github-runner-207 kernel: [58016.608785] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 21:30:42 juju-e4d256-prod-github-runner-207 kernel: [58016.609650] ? __seccomp_filter+0x4a/0x4a0 Aug 22 21:30:42 juju-e4d256-prod-github-runner-207 kernel: [58016.610527] ? __fget_files+0x86/0xc0 Aug 22 21:30:42 juju-e4d256-prod-github-runner-207 kernel: [58016.611388] __x64_sys_ioctl+0x95/0xd0 Aug 22 21:30:42 juju-e4d256-prod-github-runner-207 kernel: [58016.612179] do_syscall_64+0x5c/0xc0 Aug 22 21:30:42 juju-e4d256-prod-github-runner-207 kernel: [58016.612915] ? do_futex+0x162/0x1f0 Aug 22 21:30:42 juju-e4d256-prod-github-runner-207 kernel: [58016.613710] ? __x64_sys_futex+0x78/0x1e0 Aug 22 21:30:42 juju-e4d256-prod-github-runner-207 kernel: [58016.614529] ? __secure_computing+0xa9/0x120 Aug 22 21:30:42 juju-e4d256-prod-github-runner-207 kernel: [58016.615503] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 21:30:42 juju-e4d256-prod-github-runner-207 kernel: [58016.616397] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:30:42 juju-e4d256-prod-github-runner-207 kernel: [58016.617304] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:30:42 juju-e4d256-prod-github-runner-207 kernel: [58016.618172] ? do_syscall_64+0x69/0xc0 Aug 22 21:30:42 juju-e4d256-prod-github-runner-207 kernel: [58016.618896] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:30:42 juju-e4d256-prod-github-runner-207 kernel: [58016.619705] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:30:42 juju-e4d256-prod-github-runner-207 kernel: [58016.620623] ? do_syscall_64+0x69/0xc0 Aug 22 21:30:42 juju-e4d256-prod-github-runner-207 kernel: [58016.621339] ? do_syscall_64+0x69/0xc0 Aug 22 21:30:42 juju-e4d256-prod-github-runner-207 kernel: [58016.622042] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 21:30:42 juju-e4d256-prod-github-runner-207 kernel: [58016.622949] RIP: 0033:0x7faa5d0edaff Aug 22 21:30:42 juju-e4d256-prod-github-runner-207 kernel: [58016.623689] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 21:30:42 juju-e4d256-prod-github-runner-207 kernel: [58016.626193] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 21:30:42 juju-e4d256-prod-github-runner-207 kernel: [58016.627314] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 21:30:42 juju-e4d256-prod-github-runner-207 kernel: [58016.628352] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 21:30:42 juju-e4d256-prod-github-runner-207 kernel: [58016.629442] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 21:30:42 juju-e4d256-prod-github-runner-207 kernel: [58016.630561] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 21:30:42 juju-e4d256-prod-github-runner-207 kernel: [58016.631648] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 21:30:42 juju-e4d256-prod-github-runner-207 kernel: [58016.632695] Aug 22 21:31:10 juju-e4d256-prod-github-runner-207 kernel: [58044.541981] watchdog: BUG: soft lockup - CPU#1 stuck for 53950s! [qemu-system-x86:6715] Aug 22 21:31:10 juju-e4d256-prod-github-runner-207 kernel: [58044.543112] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 21:31:10 juju-e4d256-prod-github-runner-207 kernel: [58044.543187] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 21:31:10 juju-e4d256-prod-github-runner-207 kernel: [58044.555979] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 21:31:10 juju-e4d256-prod-github-runner-207 kernel: [58044.557327] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 21:31:10 juju-e4d256-prod-github-runner-207 kernel: [58044.558601] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:31:10 juju-e4d256-prod-github-runner-207 kernel: [58044.559661] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 21:31:10 juju-e4d256-prod-github-runner-207 kernel: [58044.562242] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 21:31:10 juju-e4d256-prod-github-runner-207 kernel: [58044.563309] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 21:31:10 juju-e4d256-prod-github-runner-207 kernel: [58044.564506] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 21:31:10 juju-e4d256-prod-github-runner-207 kernel: [58044.565686] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 21:31:10 juju-e4d256-prod-github-runner-207 kernel: [58044.566873] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 21:31:10 juju-e4d256-prod-github-runner-207 kernel: [58044.568068] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 21:31:10 juju-e4d256-prod-github-runner-207 kernel: [58044.569333] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 21:31:10 juju-e4d256-prod-github-runner-207 kernel: [58044.571466] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 21:31:10 juju-e4d256-prod-github-runner-207 kernel: [58044.572579] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 21:31:10 juju-e4d256-prod-github-runner-207 kernel: [58044.573797] Call Trace: Aug 22 21:31:10 juju-e4d256-prod-github-runner-207 kernel: [58044.574716] Aug 22 21:31:10 juju-e4d256-prod-github-runner-207 kernel: [58044.575627] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:31:10 juju-e4d256-prod-github-runner-207 kernel: [58044.576781] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:31:10 juju-e4d256-prod-github-runner-207 kernel: [58044.577925] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:31:10 juju-e4d256-prod-github-runner-207 kernel: [58044.579055] ? show_regs.part.0+0x23/0x29 Aug 22 21:31:10 juju-e4d256-prod-github-runner-207 kernel: [58044.580102] ? show_regs.cold+0x8/0xd Aug 22 21:31:10 juju-e4d256-prod-github-runner-207 kernel: [58044.581079] ? watchdog_timer_fn+0x1be/0x220 Aug 22 21:31:10 juju-e4d256-prod-github-runner-207 kernel: [58044.582138] ? lockup_detector_update_enable+0x60/0x60 Aug 22 21:31:10 juju-e4d256-prod-github-runner-207 kernel: [58044.583261] ? __hrtimer_run_queues+0x107/0x230 Aug 22 21:31:10 juju-e4d256-prod-github-runner-207 kernel: [58044.584299] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 21:31:10 juju-e4d256-prod-github-runner-207 kernel: [58044.585323] ? hrtimer_interrupt+0x101/0x220 Aug 22 21:31:10 juju-e4d256-prod-github-runner-207 kernel: [58044.586366] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 21:31:10 juju-e4d256-prod-github-runner-207 kernel: [58044.587444] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 21:31:10 juju-e4d256-prod-github-runner-207 kernel: [58044.588536] Aug 22 21:31:10 juju-e4d256-prod-github-runner-207 kernel: [58044.589404] Aug 22 21:31:10 juju-e4d256-prod-github-runner-207 kernel: [58044.590272] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 21:31:10 juju-e4d256-prod-github-runner-207 kernel: [58044.591306] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:31:10 juju-e4d256-prod-github-runner-207 kernel: [58044.592405] ? _raw_spin_lock+0x22/0x30 Aug 22 21:31:10 juju-e4d256-prod-github-runner-207 kernel: [58044.593370] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:31:10 juju-e4d256-prod-github-runner-207 kernel: [58044.594417] direct_page_fault+0x206/0x310 [kvm] Aug 22 21:31:10 juju-e4d256-prod-github-runner-207 kernel: [58044.595443] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 21:31:10 juju-e4d256-prod-github-runner-207 kernel: [58044.596452] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 21:31:10 juju-e4d256-prod-github-runner-207 kernel: [58044.597461] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 21:31:10 juju-e4d256-prod-github-runner-207 kernel: [58044.598481] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 21:31:10 juju-e4d256-prod-github-runner-207 kernel: [58044.599436] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 21:31:10 juju-e4d256-prod-github-runner-207 kernel: [58044.600415] handle_exit+0x98/0x230 [kvm_amd] Aug 22 21:31:10 juju-e4d256-prod-github-runner-207 kernel: [58044.601320] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 21:31:10 juju-e4d256-prod-github-runner-207 kernel: [58044.602356] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 21:31:10 juju-e4d256-prod-github-runner-207 kernel: [58044.603298] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 21:31:10 juju-e4d256-prod-github-runner-207 kernel: [58044.604214] vcpu_run+0x62/0x2c0 [kvm] Aug 22 21:31:10 juju-e4d256-prod-github-runner-207 kernel: [58044.605026] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 21:31:10 juju-e4d256-prod-github-runner-207 kernel: [58044.605878] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 21:31:10 juju-e4d256-prod-github-runner-207 kernel: [58044.606736] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 21:31:10 juju-e4d256-prod-github-runner-207 kernel: [58044.607542] ? __seccomp_filter+0x4a/0x4a0 Aug 22 21:31:10 juju-e4d256-prod-github-runner-207 kernel: [58044.608295] ? __fget_files+0x86/0xc0 Aug 22 21:31:10 juju-e4d256-prod-github-runner-207 kernel: [58044.609004] __x64_sys_ioctl+0x95/0xd0 Aug 22 21:31:10 juju-e4d256-prod-github-runner-207 kernel: [58044.609696] do_syscall_64+0x5c/0xc0 Aug 22 21:31:10 juju-e4d256-prod-github-runner-207 kernel: [58044.610380] ? do_futex+0x162/0x1f0 Aug 22 21:31:10 juju-e4d256-prod-github-runner-207 kernel: [58044.611035] ? __x64_sys_futex+0x78/0x1e0 Aug 22 21:31:10 juju-e4d256-prod-github-runner-207 kernel: [58044.611708] ? __secure_computing+0xa9/0x120 Aug 22 21:31:10 juju-e4d256-prod-github-runner-207 kernel: [58044.612427] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 21:31:10 juju-e4d256-prod-github-runner-207 kernel: [58044.613203] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:31:10 juju-e4d256-prod-github-runner-207 kernel: [58044.613971] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:31:10 juju-e4d256-prod-github-runner-207 kernel: [58044.614697] ? do_syscall_64+0x69/0xc0 Aug 22 21:31:10 juju-e4d256-prod-github-runner-207 kernel: [58044.615399] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:31:10 juju-e4d256-prod-github-runner-207 kernel: [58044.616152] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:31:10 juju-e4d256-prod-github-runner-207 kernel: [58044.616858] ? do_syscall_64+0x69/0xc0 Aug 22 21:31:10 juju-e4d256-prod-github-runner-207 kernel: [58044.617484] ? do_syscall_64+0x69/0xc0 Aug 22 21:31:10 juju-e4d256-prod-github-runner-207 kernel: [58044.618128] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 21:31:10 juju-e4d256-prod-github-runner-207 kernel: [58044.618837] RIP: 0033:0x7faa5d0edaff Aug 22 21:31:10 juju-e4d256-prod-github-runner-207 kernel: [58044.619464] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 21:31:10 juju-e4d256-prod-github-runner-207 kernel: [58044.621460] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 21:31:10 juju-e4d256-prod-github-runner-207 kernel: [58044.622386] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 21:31:10 juju-e4d256-prod-github-runner-207 kernel: [58044.623425] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 21:31:10 juju-e4d256-prod-github-runner-207 kernel: [58044.624315] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 21:31:10 juju-e4d256-prod-github-runner-207 kernel: [58044.625203] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 21:31:10 juju-e4d256-prod-github-runner-207 kernel: [58044.626106] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 21:31:10 juju-e4d256-prod-github-runner-207 kernel: [58044.627011] Aug 22 21:31:38 juju-e4d256-prod-github-runner-207 kernel: [58072.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 53976s! [qemu-system-x86:6715] Aug 22 21:31:38 juju-e4d256-prod-github-runner-207 kernel: [58072.543288] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 21:31:38 juju-e4d256-prod-github-runner-207 kernel: [58072.543363] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 21:31:38 juju-e4d256-prod-github-runner-207 kernel: [58072.555825] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 21:31:38 juju-e4d256-prod-github-runner-207 kernel: [58072.557093] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 21:31:38 juju-e4d256-prod-github-runner-207 kernel: [58072.558328] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:31:38 juju-e4d256-prod-github-runner-207 kernel: [58072.559421] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 21:31:38 juju-e4d256-prod-github-runner-207 kernel: [58072.561978] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 21:31:38 juju-e4d256-prod-github-runner-207 kernel: [58072.563020] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 21:31:38 juju-e4d256-prod-github-runner-207 kernel: [58072.564186] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 21:31:38 juju-e4d256-prod-github-runner-207 kernel: [58072.565348] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 21:31:38 juju-e4d256-prod-github-runner-207 kernel: [58072.566570] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 21:31:38 juju-e4d256-prod-github-runner-207 kernel: [58072.567773] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 21:31:38 juju-e4d256-prod-github-runner-207 kernel: [58072.568941] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 21:31:38 juju-e4d256-prod-github-runner-207 kernel: [58072.570194] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 21:31:38 juju-e4d256-prod-github-runner-207 kernel: [58072.571292] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 21:31:38 juju-e4d256-prod-github-runner-207 kernel: [58072.572500] Call Trace: Aug 22 21:31:38 juju-e4d256-prod-github-runner-207 kernel: [58072.573441] Aug 22 21:31:38 juju-e4d256-prod-github-runner-207 kernel: [58072.574394] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:31:38 juju-e4d256-prod-github-runner-207 kernel: [58072.575479] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:31:38 juju-e4d256-prod-github-runner-207 kernel: [58072.576509] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:31:38 juju-e4d256-prod-github-runner-207 kernel: [58072.577632] ? show_regs.part.0+0x23/0x29 Aug 22 21:31:38 juju-e4d256-prod-github-runner-207 kernel: [58072.578631] ? show_regs.cold+0x8/0xd Aug 22 21:31:38 juju-e4d256-prod-github-runner-207 kernel: [58072.579602] ? watchdog_timer_fn+0x1be/0x220 Aug 22 21:31:38 juju-e4d256-prod-github-runner-207 kernel: [58072.580621] ? lockup_detector_update_enable+0x60/0x60 Aug 22 21:31:38 juju-e4d256-prod-github-runner-207 kernel: [58072.581709] ? __hrtimer_run_queues+0x107/0x230 Aug 22 21:31:38 juju-e4d256-prod-github-runner-207 kernel: [58072.582764] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 21:31:38 juju-e4d256-prod-github-runner-207 kernel: [58072.583794] ? hrtimer_interrupt+0x101/0x220 Aug 22 21:31:38 juju-e4d256-prod-github-runner-207 kernel: [58072.584810] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 21:31:38 juju-e4d256-prod-github-runner-207 kernel: [58072.585900] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 21:31:38 juju-e4d256-prod-github-runner-207 kernel: [58072.586946] Aug 22 21:31:38 juju-e4d256-prod-github-runner-207 kernel: [58072.587800] Aug 22 21:31:38 juju-e4d256-prod-github-runner-207 kernel: [58072.588642] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 21:31:38 juju-e4d256-prod-github-runner-207 kernel: [58072.589729] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:31:38 juju-e4d256-prod-github-runner-207 kernel: [58072.590775] ? _raw_spin_lock+0x22/0x30 Aug 22 21:31:38 juju-e4d256-prod-github-runner-207 kernel: [58072.591718] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:31:38 juju-e4d256-prod-github-runner-207 kernel: [58072.592755] direct_page_fault+0x206/0x310 [kvm] Aug 22 21:31:38 juju-e4d256-prod-github-runner-207 kernel: [58072.593794] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 21:31:38 juju-e4d256-prod-github-runner-207 kernel: [58072.594816] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 21:31:38 juju-e4d256-prod-github-runner-207 kernel: [58072.595818] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 21:31:38 juju-e4d256-prod-github-runner-207 kernel: [58072.596792] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 21:31:38 juju-e4d256-prod-github-runner-207 kernel: [58072.597804] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 21:31:38 juju-e4d256-prod-github-runner-207 kernel: [58072.598794] handle_exit+0x98/0x230 [kvm_amd] Aug 22 21:31:38 juju-e4d256-prod-github-runner-207 kernel: [58072.599685] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 21:31:38 juju-e4d256-prod-github-runner-207 kernel: [58072.600598] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 21:31:38 juju-e4d256-prod-github-runner-207 kernel: [58072.601542] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 21:31:38 juju-e4d256-prod-github-runner-207 kernel: [58072.602448] vcpu_run+0x62/0x2c0 [kvm] Aug 22 21:31:38 juju-e4d256-prod-github-runner-207 kernel: [58072.603264] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 21:31:38 juju-e4d256-prod-github-runner-207 kernel: [58072.604071] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 21:31:38 juju-e4d256-prod-github-runner-207 kernel: [58072.604924] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 21:31:38 juju-e4d256-prod-github-runner-207 kernel: [58072.605737] ? __seccomp_filter+0x4a/0x4a0 Aug 22 21:31:38 juju-e4d256-prod-github-runner-207 kernel: [58072.606479] ? __fget_files+0x86/0xc0 Aug 22 21:31:38 juju-e4d256-prod-github-runner-207 kernel: [58072.607182] __x64_sys_ioctl+0x95/0xd0 Aug 22 21:31:38 juju-e4d256-prod-github-runner-207 kernel: [58072.607874] do_syscall_64+0x5c/0xc0 Aug 22 21:31:38 juju-e4d256-prod-github-runner-207 kernel: [58072.608544] ? do_futex+0x162/0x1f0 Aug 22 21:31:38 juju-e4d256-prod-github-runner-207 kernel: [58072.609193] ? __x64_sys_futex+0x78/0x1e0 Aug 22 21:31:38 juju-e4d256-prod-github-runner-207 kernel: [58072.609878] ? __secure_computing+0xa9/0x120 Aug 22 21:31:38 juju-e4d256-prod-github-runner-207 kernel: [58072.610586] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 21:31:38 juju-e4d256-prod-github-runner-207 kernel: [58072.611353] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:31:38 juju-e4d256-prod-github-runner-207 kernel: [58072.612085] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:31:38 juju-e4d256-prod-github-runner-207 kernel: [58072.612808] ? do_syscall_64+0x69/0xc0 Aug 22 21:31:38 juju-e4d256-prod-github-runner-207 kernel: [58072.613467] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:31:38 juju-e4d256-prod-github-runner-207 kernel: [58072.614173] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:31:38 juju-e4d256-prod-github-runner-207 kernel: [58072.614867] ? do_syscall_64+0x69/0xc0 Aug 22 21:31:38 juju-e4d256-prod-github-runner-207 kernel: [58072.615498] ? do_syscall_64+0x69/0xc0 Aug 22 21:31:38 juju-e4d256-prod-github-runner-207 kernel: [58072.616118] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 21:31:38 juju-e4d256-prod-github-runner-207 kernel: [58072.616850] RIP: 0033:0x7faa5d0edaff Aug 22 21:31:38 juju-e4d256-prod-github-runner-207 kernel: [58072.617506] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 21:31:38 juju-e4d256-prod-github-runner-207 kernel: [58072.619516] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 21:31:38 juju-e4d256-prod-github-runner-207 kernel: [58072.620470] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 21:31:38 juju-e4d256-prod-github-runner-207 kernel: [58072.621386] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 21:31:38 juju-e4d256-prod-github-runner-207 kernel: [58072.622273] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 21:31:38 juju-e4d256-prod-github-runner-207 kernel: [58072.623165] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 21:31:38 juju-e4d256-prod-github-runner-207 kernel: [58072.624057] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 21:31:38 juju-e4d256-prod-github-runner-207 kernel: [58072.624989] Aug 22 21:32:06 juju-e4d256-prod-github-runner-207 kernel: [58100.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 54002s! [qemu-system-x86:6715] Aug 22 21:32:06 juju-e4d256-prod-github-runner-207 kernel: [58100.543821] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 21:32:06 juju-e4d256-prod-github-runner-207 kernel: [58100.544110] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 21:32:06 juju-e4d256-prod-github-runner-207 kernel: [58100.556445] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 21:32:06 juju-e4d256-prod-github-runner-207 kernel: [58100.557770] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 21:32:06 juju-e4d256-prod-github-runner-207 kernel: [58100.559017] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:32:06 juju-e4d256-prod-github-runner-207 kernel: [58100.560098] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 21:32:06 juju-e4d256-prod-github-runner-207 kernel: [58100.562761] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 21:32:06 juju-e4d256-prod-github-runner-207 kernel: [58100.563816] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 21:32:06 juju-e4d256-prod-github-runner-207 kernel: [58100.564993] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 21:32:06 juju-e4d256-prod-github-runner-207 kernel: [58100.566180] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 21:32:06 juju-e4d256-prod-github-runner-207 kernel: [58100.567425] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 21:32:06 juju-e4d256-prod-github-runner-207 kernel: [58100.568600] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 21:32:06 juju-e4d256-prod-github-runner-207 kernel: [58100.569799] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 21:32:06 juju-e4d256-prod-github-runner-207 kernel: [58100.571054] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 21:32:06 juju-e4d256-prod-github-runner-207 kernel: [58100.572163] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 21:32:06 juju-e4d256-prod-github-runner-207 kernel: [58100.573384] Call Trace: Aug 22 21:32:06 juju-e4d256-prod-github-runner-207 kernel: [58100.574340] Aug 22 21:32:06 juju-e4d256-prod-github-runner-207 kernel: [58100.575245] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:32:06 juju-e4d256-prod-github-runner-207 kernel: [58100.576285] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:32:06 juju-e4d256-prod-github-runner-207 kernel: [58100.577335] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:32:06 juju-e4d256-prod-github-runner-207 kernel: [58100.578444] ? show_regs.part.0+0x23/0x29 Aug 22 21:32:06 juju-e4d256-prod-github-runner-207 kernel: [58100.579459] ? show_regs.cold+0x8/0xd Aug 22 21:32:06 juju-e4d256-prod-github-runner-207 kernel: [58100.580440] ? watchdog_timer_fn+0x1be/0x220 Aug 22 21:32:06 juju-e4d256-prod-github-runner-207 kernel: [58100.581499] ? lockup_detector_update_enable+0x60/0x60 Aug 22 21:32:06 juju-e4d256-prod-github-runner-207 kernel: [58100.582714] ? __hrtimer_run_queues+0x107/0x230 Aug 22 21:32:06 juju-e4d256-prod-github-runner-207 kernel: [58100.583769] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 21:32:06 juju-e4d256-prod-github-runner-207 kernel: [58100.584837] ? hrtimer_interrupt+0x101/0x220 Aug 22 21:32:06 juju-e4d256-prod-github-runner-207 kernel: [58100.585888] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 21:32:06 juju-e4d256-prod-github-runner-207 kernel: [58100.586980] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 21:32:06 juju-e4d256-prod-github-runner-207 kernel: [58100.588045] Aug 22 21:32:06 juju-e4d256-prod-github-runner-207 kernel: [58100.588909] Aug 22 21:32:06 juju-e4d256-prod-github-runner-207 kernel: [58100.589756] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 21:32:06 juju-e4d256-prod-github-runner-207 kernel: [58100.590803] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:32:06 juju-e4d256-prod-github-runner-207 kernel: [58100.591860] ? _raw_spin_lock+0x22/0x30 Aug 22 21:32:06 juju-e4d256-prod-github-runner-207 kernel: [58100.592843] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:32:06 juju-e4d256-prod-github-runner-207 kernel: [58100.593948] direct_page_fault+0x206/0x310 [kvm] Aug 22 21:32:06 juju-e4d256-prod-github-runner-207 kernel: [58100.594986] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 21:32:06 juju-e4d256-prod-github-runner-207 kernel: [58100.596242] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 21:32:06 juju-e4d256-prod-github-runner-207 kernel: [58100.597358] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 21:32:06 juju-e4d256-prod-github-runner-207 kernel: [58100.598395] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 21:32:06 juju-e4d256-prod-github-runner-207 kernel: [58100.599353] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 21:32:06 juju-e4d256-prod-github-runner-207 kernel: [58100.600339] handle_exit+0x98/0x230 [kvm_amd] Aug 22 21:32:06 juju-e4d256-prod-github-runner-207 kernel: [58100.601256] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 21:32:06 juju-e4d256-prod-github-runner-207 kernel: [58100.602186] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 21:32:06 juju-e4d256-prod-github-runner-207 kernel: [58100.603125] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 21:32:06 juju-e4d256-prod-github-runner-207 kernel: [58100.604043] vcpu_run+0x62/0x2c0 [kvm] Aug 22 21:32:06 juju-e4d256-prod-github-runner-207 kernel: [58100.604863] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 21:32:06 juju-e4d256-prod-github-runner-207 kernel: [58100.605692] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 21:32:06 juju-e4d256-prod-github-runner-207 kernel: [58100.606559] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 21:32:06 juju-e4d256-prod-github-runner-207 kernel: [58100.607364] ? __seccomp_filter+0x4a/0x4a0 Aug 22 21:32:06 juju-e4d256-prod-github-runner-207 kernel: [58100.608116] ? __fget_files+0x86/0xc0 Aug 22 21:32:06 juju-e4d256-prod-github-runner-207 kernel: [58100.608836] __x64_sys_ioctl+0x95/0xd0 Aug 22 21:32:06 juju-e4d256-prod-github-runner-207 kernel: [58100.609557] do_syscall_64+0x5c/0xc0 Aug 22 21:32:06 juju-e4d256-prod-github-runner-207 kernel: [58100.610274] ? do_futex+0x162/0x1f0 Aug 22 21:32:06 juju-e4d256-prod-github-runner-207 kernel: [58100.610941] ? __x64_sys_futex+0x78/0x1e0 Aug 22 21:32:06 juju-e4d256-prod-github-runner-207 kernel: [58100.611625] ? __secure_computing+0xa9/0x120 Aug 22 21:32:06 juju-e4d256-prod-github-runner-207 kernel: [58100.612326] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 21:32:06 juju-e4d256-prod-github-runner-207 kernel: [58100.613133] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:32:06 juju-e4d256-prod-github-runner-207 kernel: [58100.613872] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:32:06 juju-e4d256-prod-github-runner-207 kernel: [58100.614617] ? do_syscall_64+0x69/0xc0 Aug 22 21:32:06 juju-e4d256-prod-github-runner-207 kernel: [58100.615297] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:32:06 juju-e4d256-prod-github-runner-207 kernel: [58100.616019] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:32:06 juju-e4d256-prod-github-runner-207 kernel: [58100.616751] ? do_syscall_64+0x69/0xc0 Aug 22 21:32:06 juju-e4d256-prod-github-runner-207 kernel: [58100.617401] ? do_syscall_64+0x69/0xc0 Aug 22 21:32:06 juju-e4d256-prod-github-runner-207 kernel: [58100.618031] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 21:32:06 juju-e4d256-prod-github-runner-207 kernel: [58100.618756] RIP: 0033:0x7faa5d0edaff Aug 22 21:32:06 juju-e4d256-prod-github-runner-207 kernel: [58100.619423] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 21:32:06 juju-e4d256-prod-github-runner-207 kernel: [58100.621495] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 21:32:06 juju-e4d256-prod-github-runner-207 kernel: [58100.622441] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 21:32:06 juju-e4d256-prod-github-runner-207 kernel: [58100.623361] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 21:32:06 juju-e4d256-prod-github-runner-207 kernel: [58100.624273] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 21:32:06 juju-e4d256-prod-github-runner-207 kernel: [58100.625195] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 21:32:06 juju-e4d256-prod-github-runner-207 kernel: [58100.626126] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 21:32:06 juju-e4d256-prod-github-runner-207 kernel: [58100.627125] Aug 22 21:32:34 juju-e4d256-prod-github-runner-207 kernel: [58128.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 54028s! [qemu-system-x86:6715] Aug 22 21:32:34 juju-e4d256-prod-github-runner-207 kernel: [58128.543101] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 21:32:34 juju-e4d256-prod-github-runner-207 kernel: [58128.543176] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 21:32:34 juju-e4d256-prod-github-runner-207 kernel: [58128.555297] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 21:32:34 juju-e4d256-prod-github-runner-207 kernel: [58128.556566] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 21:32:34 juju-e4d256-prod-github-runner-207 kernel: [58128.557833] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:32:34 juju-e4d256-prod-github-runner-207 kernel: [58128.558894] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 21:32:34 juju-e4d256-prod-github-runner-207 kernel: [58128.561457] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 21:32:34 juju-e4d256-prod-github-runner-207 kernel: [58128.562507] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 21:32:34 juju-e4d256-prod-github-runner-207 kernel: [58128.563671] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 21:32:34 juju-e4d256-prod-github-runner-207 kernel: [58128.564853] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 21:32:34 juju-e4d256-prod-github-runner-207 kernel: [58128.566019] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 21:32:34 juju-e4d256-prod-github-runner-207 kernel: [58128.567191] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 21:32:34 juju-e4d256-prod-github-runner-207 kernel: [58128.568352] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 21:32:34 juju-e4d256-prod-github-runner-207 kernel: [58128.569607] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 21:32:34 juju-e4d256-prod-github-runner-207 kernel: [58128.570708] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 21:32:34 juju-e4d256-prod-github-runner-207 kernel: [58128.571933] Call Trace: Aug 22 21:32:34 juju-e4d256-prod-github-runner-207 kernel: [58128.572874] Aug 22 21:32:34 juju-e4d256-prod-github-runner-207 kernel: [58128.573759] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:32:34 juju-e4d256-prod-github-runner-207 kernel: [58128.574801] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:32:34 juju-e4d256-prod-github-runner-207 kernel: [58128.575831] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:32:34 juju-e4d256-prod-github-runner-207 kernel: [58128.576927] ? show_regs.part.0+0x23/0x29 Aug 22 21:32:34 juju-e4d256-prod-github-runner-207 kernel: [58128.577925] ? show_regs.cold+0x8/0xd Aug 22 21:32:34 juju-e4d256-prod-github-runner-207 kernel: [58128.578895] ? watchdog_timer_fn+0x1be/0x220 Aug 22 21:32:34 juju-e4d256-prod-github-runner-207 kernel: [58128.579900] ? lockup_detector_update_enable+0x60/0x60 Aug 22 21:32:34 juju-e4d256-prod-github-runner-207 kernel: [58128.580971] ? __hrtimer_run_queues+0x107/0x230 Aug 22 21:32:34 juju-e4d256-prod-github-runner-207 kernel: [58128.582003] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 21:32:34 juju-e4d256-prod-github-runner-207 kernel: [58128.583036] ? hrtimer_interrupt+0x101/0x220 Aug 22 21:32:34 juju-e4d256-prod-github-runner-207 kernel: [58128.584054] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 21:32:34 juju-e4d256-prod-github-runner-207 kernel: [58128.585139] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 21:32:34 juju-e4d256-prod-github-runner-207 kernel: [58128.586184] Aug 22 21:32:34 juju-e4d256-prod-github-runner-207 kernel: [58128.587050] Aug 22 21:32:34 juju-e4d256-prod-github-runner-207 kernel: [58128.587888] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 21:32:34 juju-e4d256-prod-github-runner-207 kernel: [58128.588943] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:32:34 juju-e4d256-prod-github-runner-207 kernel: [58128.589982] ? _raw_spin_lock+0x22/0x30 Aug 22 21:32:34 juju-e4d256-prod-github-runner-207 kernel: [58128.590977] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:32:34 juju-e4d256-prod-github-runner-207 kernel: [58128.592153] direct_page_fault+0x206/0x310 [kvm] Aug 22 21:32:34 juju-e4d256-prod-github-runner-207 kernel: [58128.593190] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 21:32:34 juju-e4d256-prod-github-runner-207 kernel: [58128.594198] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 21:32:34 juju-e4d256-prod-github-runner-207 kernel: [58128.595197] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 21:32:34 juju-e4d256-prod-github-runner-207 kernel: [58128.596166] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 21:32:34 juju-e4d256-prod-github-runner-207 kernel: [58128.597138] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 21:32:34 juju-e4d256-prod-github-runner-207 kernel: [58128.598162] handle_exit+0x98/0x230 [kvm_amd] Aug 22 21:32:34 juju-e4d256-prod-github-runner-207 kernel: [58128.599060] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 21:32:34 juju-e4d256-prod-github-runner-207 kernel: [58128.599972] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 21:32:34 juju-e4d256-prod-github-runner-207 kernel: [58128.600911] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 21:32:34 juju-e4d256-prod-github-runner-207 kernel: [58128.601853] vcpu_run+0x62/0x2c0 [kvm] Aug 22 21:32:34 juju-e4d256-prod-github-runner-207 kernel: [58128.602682] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 21:32:34 juju-e4d256-prod-github-runner-207 kernel: [58128.603489] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 21:32:34 juju-e4d256-prod-github-runner-207 kernel: [58128.604340] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 21:32:34 juju-e4d256-prod-github-runner-207 kernel: [58128.605150] ? __seccomp_filter+0x4a/0x4a0 Aug 22 21:32:34 juju-e4d256-prod-github-runner-207 kernel: [58128.605889] ? __fget_files+0x86/0xc0 Aug 22 21:32:34 juju-e4d256-prod-github-runner-207 kernel: [58128.606590] __x64_sys_ioctl+0x95/0xd0 Aug 22 21:32:34 juju-e4d256-prod-github-runner-207 kernel: [58128.607279] do_syscall_64+0x5c/0xc0 Aug 22 21:32:34 juju-e4d256-prod-github-runner-207 kernel: [58128.607946] ? do_futex+0x162/0x1f0 Aug 22 21:32:34 juju-e4d256-prod-github-runner-207 kernel: [58128.608593] ? __x64_sys_futex+0x78/0x1e0 Aug 22 21:32:34 juju-e4d256-prod-github-runner-207 kernel: [58128.609274] ? __secure_computing+0xa9/0x120 Aug 22 21:32:34 juju-e4d256-prod-github-runner-207 kernel: [58128.609960] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 21:32:34 juju-e4d256-prod-github-runner-207 kernel: [58128.610722] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:32:34 juju-e4d256-prod-github-runner-207 kernel: [58128.611442] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:32:34 juju-e4d256-prod-github-runner-207 kernel: [58128.612199] ? do_syscall_64+0x69/0xc0 Aug 22 21:32:34 juju-e4d256-prod-github-runner-207 kernel: [58128.612879] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:32:34 juju-e4d256-prod-github-runner-207 kernel: [58128.613720] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:32:34 juju-e4d256-prod-github-runner-207 kernel: [58128.614436] ? do_syscall_64+0x69/0xc0 Aug 22 21:32:34 juju-e4d256-prod-github-runner-207 kernel: [58128.615058] ? do_syscall_64+0x69/0xc0 Aug 22 21:32:34 juju-e4d256-prod-github-runner-207 kernel: [58128.615682] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 21:32:34 juju-e4d256-prod-github-runner-207 kernel: [58128.616406] RIP: 0033:0x7faa5d0edaff Aug 22 21:32:34 juju-e4d256-prod-github-runner-207 kernel: [58128.617159] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 21:32:34 juju-e4d256-prod-github-runner-207 kernel: [58128.619256] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 21:32:34 juju-e4d256-prod-github-runner-207 kernel: [58128.620168] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 21:32:34 juju-e4d256-prod-github-runner-207 kernel: [58128.621074] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 21:32:34 juju-e4d256-prod-github-runner-207 kernel: [58128.621966] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 21:32:34 juju-e4d256-prod-github-runner-207 kernel: [58128.622863] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 21:32:34 juju-e4d256-prod-github-runner-207 kernel: [58128.623754] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 21:32:34 juju-e4d256-prod-github-runner-207 kernel: [58128.624642] Aug 22 21:32:47 juju-e4d256-prod-github-runner-207 kernel: [58141.064708] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 21:32:47 juju-e4d256-prod-github-runner-207 kernel: [58141.065687] rcu: 1-....: (14460307 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=6988401 Aug 22 21:32:47 juju-e4d256-prod-github-runner-207 kernel: [58141.066815] (t=14505966 jiffies g=23269 q=52807) Aug 22 21:32:47 juju-e4d256-prod-github-runner-207 kernel: [58141.067599] NMI backtrace for cpu 1 Aug 22 21:32:47 juju-e4d256-prod-github-runner-207 kernel: [58141.068306] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 21:32:47 juju-e4d256-prod-github-runner-207 kernel: [58141.069427] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 21:32:47 juju-e4d256-prod-github-runner-207 kernel: [58141.070481] Call Trace: Aug 22 21:32:47 juju-e4d256-prod-github-runner-207 kernel: [58141.071155] Aug 22 21:32:47 juju-e4d256-prod-github-runner-207 kernel: [58141.071800] show_stack+0x52/0x5c Aug 22 21:32:47 juju-e4d256-prod-github-runner-207 kernel: [58141.072523] dump_stack_lvl+0x4a/0x63 Aug 22 21:32:47 juju-e4d256-prod-github-runner-207 kernel: [58141.073283] dump_stack+0x10/0x16 Aug 22 21:32:47 juju-e4d256-prod-github-runner-207 kernel: [58141.073999] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 21:32:47 juju-e4d256-prod-github-runner-207 kernel: [58141.074779] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 21:32:47 juju-e4d256-prod-github-runner-207 kernel: [58141.075564] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 21:32:47 juju-e4d256-prod-github-runner-207 kernel: [58141.076396] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 21:32:47 juju-e4d256-prod-github-runner-207 kernel: [58141.077255] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 21:32:47 juju-e4d256-prod-github-runner-207 kernel: [58141.078077] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 21:32:47 juju-e4d256-prod-github-runner-207 kernel: [58141.078853] print_cpu_stall.cold+0x2f/0xe2 Aug 22 21:32:47 juju-e4d256-prod-github-runner-207 kernel: [58141.079616] ? timekeeping_update+0xf7/0x150 Aug 22 21:32:47 juju-e4d256-prod-github-runner-207 kernel: [58141.080391] check_cpu_stall+0x109/0x270 Aug 22 21:32:47 juju-e4d256-prod-github-runner-207 kernel: [58141.081153] rcu_sched_clock_irq+0x9a/0x250 Aug 22 21:32:47 juju-e4d256-prod-github-runner-207 kernel: [58141.081916] update_process_times+0x94/0xd0 Aug 22 21:32:47 juju-e4d256-prod-github-runner-207 kernel: [58141.082677] tick_sched_handle+0x29/0x70 Aug 22 21:32:47 juju-e4d256-prod-github-runner-207 kernel: [58141.083426] tick_sched_timer+0x8c/0xc0 Aug 22 21:32:47 juju-e4d256-prod-github-runner-207 kernel: [58141.084164] ? tick_nohz_handler+0xb0/0xb0 Aug 22 21:32:47 juju-e4d256-prod-github-runner-207 kernel: [58141.084934] __hrtimer_run_queues+0x107/0x230 Aug 22 21:32:47 juju-e4d256-prod-github-runner-207 kernel: [58141.085713] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 21:32:47 juju-e4d256-prod-github-runner-207 kernel: [58141.086489] hrtimer_interrupt+0x101/0x220 Aug 22 21:32:47 juju-e4d256-prod-github-runner-207 kernel: [58141.087256] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 21:32:47 juju-e4d256-prod-github-runner-207 kernel: [58141.088085] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 21:32:47 juju-e4d256-prod-github-runner-207 kernel: [58141.088937] Aug 22 21:32:47 juju-e4d256-prod-github-runner-207 kernel: [58141.089583] Aug 22 21:32:47 juju-e4d256-prod-github-runner-207 kernel: [58141.090212] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 21:32:47 juju-e4d256-prod-github-runner-207 kernel: [58141.091032] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:32:47 juju-e4d256-prod-github-runner-207 kernel: [58141.091917] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 21:32:47 juju-e4d256-prod-github-runner-207 kernel: [58141.094137] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 21:32:47 juju-e4d256-prod-github-runner-207 kernel: [58141.095012] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 21:32:47 juju-e4d256-prod-github-runner-207 kernel: [58141.096006] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 21:32:47 juju-e4d256-prod-github-runner-207 kernel: [58141.096996] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 21:32:47 juju-e4d256-prod-github-runner-207 kernel: [58141.097960] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 21:32:47 juju-e4d256-prod-github-runner-207 kernel: [58141.098920] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 21:32:47 juju-e4d256-prod-github-runner-207 kernel: [58141.099875] ? _raw_spin_lock+0x22/0x30 Aug 22 21:32:47 juju-e4d256-prod-github-runner-207 kernel: [58141.100652] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:32:47 juju-e4d256-prod-github-runner-207 kernel: [58141.101493] direct_page_fault+0x206/0x310 [kvm] Aug 22 21:32:47 juju-e4d256-prod-github-runner-207 kernel: [58141.102337] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 21:32:47 juju-e4d256-prod-github-runner-207 kernel: [58141.103164] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 21:32:47 juju-e4d256-prod-github-runner-207 kernel: [58141.103986] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 21:32:47 juju-e4d256-prod-github-runner-207 kernel: [58141.104810] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 21:32:47 juju-e4d256-prod-github-runner-207 kernel: [58141.105595] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 21:32:47 juju-e4d256-prod-github-runner-207 kernel: [58141.106418] handle_exit+0x98/0x230 [kvm_amd] Aug 22 21:32:47 juju-e4d256-prod-github-runner-207 kernel: [58141.107171] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 21:32:47 juju-e4d256-prod-github-runner-207 kernel: [58141.107967] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 21:32:47 juju-e4d256-prod-github-runner-207 kernel: [58141.108774] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 21:32:47 juju-e4d256-prod-github-runner-207 kernel: [58141.109560] vcpu_run+0x62/0x2c0 [kvm] Aug 22 21:32:47 juju-e4d256-prod-github-runner-207 kernel: [58141.110276] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 21:32:47 juju-e4d256-prod-github-runner-207 kernel: [58141.111014] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 21:32:47 juju-e4d256-prod-github-runner-207 kernel: [58141.111819] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 21:32:47 juju-e4d256-prod-github-runner-207 kernel: [58141.112596] ? __seccomp_filter+0x4a/0x4a0 Aug 22 21:32:47 juju-e4d256-prod-github-runner-207 kernel: [58141.113317] ? __fget_files+0x86/0xc0 Aug 22 21:32:47 juju-e4d256-prod-github-runner-207 kernel: [58141.114043] __x64_sys_ioctl+0x95/0xd0 Aug 22 21:32:47 juju-e4d256-prod-github-runner-207 kernel: [58141.114768] do_syscall_64+0x5c/0xc0 Aug 22 21:32:47 juju-e4d256-prod-github-runner-207 kernel: [58141.115482] ? do_futex+0x162/0x1f0 Aug 22 21:32:47 juju-e4d256-prod-github-runner-207 kernel: [58141.116170] ? __x64_sys_futex+0x78/0x1e0 Aug 22 21:32:47 juju-e4d256-prod-github-runner-207 kernel: [58141.116903] ? __secure_computing+0xa9/0x120 Aug 22 21:32:47 juju-e4d256-prod-github-runner-207 kernel: [58141.117630] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 21:32:47 juju-e4d256-prod-github-runner-207 kernel: [58141.118421] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:32:47 juju-e4d256-prod-github-runner-207 kernel: [58141.119180] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:32:47 juju-e4d256-prod-github-runner-207 kernel: [58141.119937] ? do_syscall_64+0x69/0xc0 Aug 22 21:32:47 juju-e4d256-prod-github-runner-207 kernel: [58141.120650] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:32:47 juju-e4d256-prod-github-runner-207 kernel: [58141.121423] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:32:47 juju-e4d256-prod-github-runner-207 kernel: [58141.122334] ? do_syscall_64+0x69/0xc0 Aug 22 21:32:47 juju-e4d256-prod-github-runner-207 kernel: [58141.123034] ? do_syscall_64+0x69/0xc0 Aug 22 21:32:47 juju-e4d256-prod-github-runner-207 kernel: [58141.123739] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 21:32:47 juju-e4d256-prod-github-runner-207 kernel: [58141.124510] RIP: 0033:0x7faa5d0edaff Aug 22 21:32:47 juju-e4d256-prod-github-runner-207 kernel: [58141.125209] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 21:32:47 juju-e4d256-prod-github-runner-207 kernel: [58141.127302] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 21:32:47 juju-e4d256-prod-github-runner-207 kernel: [58141.128386] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 21:32:47 juju-e4d256-prod-github-runner-207 kernel: [58141.129345] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 21:32:47 juju-e4d256-prod-github-runner-207 kernel: [58141.130293] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 21:32:47 juju-e4d256-prod-github-runner-207 kernel: [58141.131233] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 21:32:47 juju-e4d256-prod-github-runner-207 kernel: [58141.132162] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 21:32:47 juju-e4d256-prod-github-runner-207 kernel: [58141.133087] Aug 22 21:33:14 juju-e4d256-prod-github-runner-207 kernel: [58168.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 54065s! [qemu-system-x86:6715] Aug 22 21:33:14 juju-e4d256-prod-github-runner-207 kernel: [58168.543115] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 21:33:14 juju-e4d256-prod-github-runner-207 kernel: [58168.543191] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 21:33:14 juju-e4d256-prod-github-runner-207 kernel: [58168.555406] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 21:33:14 juju-e4d256-prod-github-runner-207 kernel: [58168.556681] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 21:33:14 juju-e4d256-prod-github-runner-207 kernel: [58168.557909] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:33:14 juju-e4d256-prod-github-runner-207 kernel: [58168.558965] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 21:33:14 juju-e4d256-prod-github-runner-207 kernel: [58168.561509] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 21:33:14 juju-e4d256-prod-github-runner-207 kernel: [58168.562551] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 21:33:14 juju-e4d256-prod-github-runner-207 kernel: [58168.563715] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 21:33:14 juju-e4d256-prod-github-runner-207 kernel: [58168.564882] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 21:33:14 juju-e4d256-prod-github-runner-207 kernel: [58168.566040] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 21:33:14 juju-e4d256-prod-github-runner-207 kernel: [58168.567203] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 21:33:14 juju-e4d256-prod-github-runner-207 kernel: [58168.568386] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 21:33:14 juju-e4d256-prod-github-runner-207 kernel: [58168.569621] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 21:33:14 juju-e4d256-prod-github-runner-207 kernel: [58168.570738] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 21:33:14 juju-e4d256-prod-github-runner-207 kernel: [58168.571966] Call Trace: Aug 22 21:33:14 juju-e4d256-prod-github-runner-207 kernel: [58168.572894] Aug 22 21:33:14 juju-e4d256-prod-github-runner-207 kernel: [58168.573784] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:33:14 juju-e4d256-prod-github-runner-207 kernel: [58168.574813] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:33:14 juju-e4d256-prod-github-runner-207 kernel: [58168.575834] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:33:14 juju-e4d256-prod-github-runner-207 kernel: [58168.576937] ? show_regs.part.0+0x23/0x29 Aug 22 21:33:14 juju-e4d256-prod-github-runner-207 kernel: [58168.577941] ? show_regs.cold+0x8/0xd Aug 22 21:33:14 juju-e4d256-prod-github-runner-207 kernel: [58168.578917] ? watchdog_timer_fn+0x1be/0x220 Aug 22 21:33:14 juju-e4d256-prod-github-runner-207 kernel: [58168.579925] ? lockup_detector_update_enable+0x60/0x60 Aug 22 21:33:14 juju-e4d256-prod-github-runner-207 kernel: [58168.581009] ? __hrtimer_run_queues+0x107/0x230 Aug 22 21:33:14 juju-e4d256-prod-github-runner-207 kernel: [58168.582040] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 21:33:14 juju-e4d256-prod-github-runner-207 kernel: [58168.583082] ? hrtimer_interrupt+0x101/0x220 Aug 22 21:33:14 juju-e4d256-prod-github-runner-207 kernel: [58168.584104] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 21:33:14 juju-e4d256-prod-github-runner-207 kernel: [58168.585184] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 21:33:14 juju-e4d256-prod-github-runner-207 kernel: [58168.586227] Aug 22 21:33:14 juju-e4d256-prod-github-runner-207 kernel: [58168.587079] Aug 22 21:33:14 juju-e4d256-prod-github-runner-207 kernel: [58168.587914] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 21:33:14 juju-e4d256-prod-github-runner-207 kernel: [58168.588957] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:33:14 juju-e4d256-prod-github-runner-207 kernel: [58168.590002] ? _raw_spin_lock+0x22/0x30 Aug 22 21:33:14 juju-e4d256-prod-github-runner-207 kernel: [58168.590947] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:33:14 juju-e4d256-prod-github-runner-207 kernel: [58168.591966] direct_page_fault+0x206/0x310 [kvm] Aug 22 21:33:14 juju-e4d256-prod-github-runner-207 kernel: [58168.593068] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 21:33:14 juju-e4d256-prod-github-runner-207 kernel: [58168.594078] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 21:33:14 juju-e4d256-prod-github-runner-207 kernel: [58168.595111] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 21:33:14 juju-e4d256-prod-github-runner-207 kernel: [58168.596140] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 21:33:14 juju-e4d256-prod-github-runner-207 kernel: [58168.597124] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 21:33:14 juju-e4d256-prod-github-runner-207 kernel: [58168.598101] handle_exit+0x98/0x230 [kvm_amd] Aug 22 21:33:14 juju-e4d256-prod-github-runner-207 kernel: [58168.598993] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 21:33:14 juju-e4d256-prod-github-runner-207 kernel: [58168.599948] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 21:33:14 juju-e4d256-prod-github-runner-207 kernel: [58168.600898] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 21:33:14 juju-e4d256-prod-github-runner-207 kernel: [58168.601800] vcpu_run+0x62/0x2c0 [kvm] Aug 22 21:33:14 juju-e4d256-prod-github-runner-207 kernel: [58168.602611] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 21:33:14 juju-e4d256-prod-github-runner-207 kernel: [58168.603421] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 21:33:14 juju-e4d256-prod-github-runner-207 kernel: [58168.604297] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 21:33:14 juju-e4d256-prod-github-runner-207 kernel: [58168.605096] ? __seccomp_filter+0x4a/0x4a0 Aug 22 21:33:14 juju-e4d256-prod-github-runner-207 kernel: [58168.605839] ? __fget_files+0x86/0xc0 Aug 22 21:33:14 juju-e4d256-prod-github-runner-207 kernel: [58168.606701] __x64_sys_ioctl+0x95/0xd0 Aug 22 21:33:14 juju-e4d256-prod-github-runner-207 kernel: [58168.607398] do_syscall_64+0x5c/0xc0 Aug 22 21:33:14 juju-e4d256-prod-github-runner-207 kernel: [58168.608091] ? do_futex+0x162/0x1f0 Aug 22 21:33:14 juju-e4d256-prod-github-runner-207 kernel: [58168.608754] ? __x64_sys_futex+0x78/0x1e0 Aug 22 21:33:14 juju-e4d256-prod-github-runner-207 kernel: [58168.609430] ? __secure_computing+0xa9/0x120 Aug 22 21:33:14 juju-e4d256-prod-github-runner-207 kernel: [58168.610138] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 21:33:14 juju-e4d256-prod-github-runner-207 kernel: [58168.610910] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:33:14 juju-e4d256-prod-github-runner-207 kernel: [58168.611640] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:33:14 juju-e4d256-prod-github-runner-207 kernel: [58168.612381] ? do_syscall_64+0x69/0xc0 Aug 22 21:33:14 juju-e4d256-prod-github-runner-207 kernel: [58168.613042] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:33:14 juju-e4d256-prod-github-runner-207 kernel: [58168.613751] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:33:14 juju-e4d256-prod-github-runner-207 kernel: [58168.614452] ? do_syscall_64+0x69/0xc0 Aug 22 21:33:14 juju-e4d256-prod-github-runner-207 kernel: [58168.615077] ? do_syscall_64+0x69/0xc0 Aug 22 21:33:14 juju-e4d256-prod-github-runner-207 kernel: [58168.615731] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 21:33:14 juju-e4d256-prod-github-runner-207 kernel: [58168.616463] RIP: 0033:0x7faa5d0edaff Aug 22 21:33:14 juju-e4d256-prod-github-runner-207 kernel: [58168.617120] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 21:33:14 juju-e4d256-prod-github-runner-207 kernel: [58168.619105] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 21:33:14 juju-e4d256-prod-github-runner-207 kernel: [58168.620026] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 21:33:14 juju-e4d256-prod-github-runner-207 kernel: [58168.620924] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 21:33:14 juju-e4d256-prod-github-runner-207 kernel: [58168.621819] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 21:33:14 juju-e4d256-prod-github-runner-207 kernel: [58168.622704] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 21:33:14 juju-e4d256-prod-github-runner-207 kernel: [58168.623591] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 21:33:14 juju-e4d256-prod-github-runner-207 kernel: [58168.624512] Aug 22 21:33:42 juju-e4d256-prod-github-runner-207 kernel: [58196.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 54091s! [qemu-system-x86:6715] Aug 22 21:33:42 juju-e4d256-prod-github-runner-207 kernel: [58196.543854] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 21:33:42 juju-e4d256-prod-github-runner-207 kernel: [58196.544176] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 21:33:42 juju-e4d256-prod-github-runner-207 kernel: [58196.556258] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 21:33:42 juju-e4d256-prod-github-runner-207 kernel: [58196.557526] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 21:33:42 juju-e4d256-prod-github-runner-207 kernel: [58196.558751] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:33:42 juju-e4d256-prod-github-runner-207 kernel: [58196.559810] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 21:33:42 juju-e4d256-prod-github-runner-207 kernel: [58196.562370] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 21:33:42 juju-e4d256-prod-github-runner-207 kernel: [58196.563426] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 21:33:42 juju-e4d256-prod-github-runner-207 kernel: [58196.564605] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 21:33:42 juju-e4d256-prod-github-runner-207 kernel: [58196.565764] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 21:33:42 juju-e4d256-prod-github-runner-207 kernel: [58196.566929] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 21:33:42 juju-e4d256-prod-github-runner-207 kernel: [58196.568096] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 21:33:42 juju-e4d256-prod-github-runner-207 kernel: [58196.569263] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 21:33:42 juju-e4d256-prod-github-runner-207 kernel: [58196.570499] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 21:33:42 juju-e4d256-prod-github-runner-207 kernel: [58196.571596] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 21:33:42 juju-e4d256-prod-github-runner-207 kernel: [58196.572793] Call Trace: Aug 22 21:33:42 juju-e4d256-prod-github-runner-207 kernel: [58196.573706] Aug 22 21:33:42 juju-e4d256-prod-github-runner-207 kernel: [58196.574600] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:33:42 juju-e4d256-prod-github-runner-207 kernel: [58196.575631] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:33:42 juju-e4d256-prod-github-runner-207 kernel: [58196.576672] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:33:42 juju-e4d256-prod-github-runner-207 kernel: [58196.577762] ? show_regs.part.0+0x23/0x29 Aug 22 21:33:42 juju-e4d256-prod-github-runner-207 kernel: [58196.578757] ? show_regs.cold+0x8/0xd Aug 22 21:33:42 juju-e4d256-prod-github-runner-207 kernel: [58196.579727] ? watchdog_timer_fn+0x1be/0x220 Aug 22 21:33:42 juju-e4d256-prod-github-runner-207 kernel: [58196.580742] ? lockup_detector_update_enable+0x60/0x60 Aug 22 21:33:42 juju-e4d256-prod-github-runner-207 kernel: [58196.581804] ? __hrtimer_run_queues+0x107/0x230 Aug 22 21:33:42 juju-e4d256-prod-github-runner-207 kernel: [58196.582832] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 21:33:42 juju-e4d256-prod-github-runner-207 kernel: [58196.583856] ? hrtimer_interrupt+0x101/0x220 Aug 22 21:33:42 juju-e4d256-prod-github-runner-207 kernel: [58196.584886] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 21:33:42 juju-e4d256-prod-github-runner-207 kernel: [58196.585956] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 21:33:42 juju-e4d256-prod-github-runner-207 kernel: [58196.587000] Aug 22 21:33:42 juju-e4d256-prod-github-runner-207 kernel: [58196.587852] Aug 22 21:33:42 juju-e4d256-prod-github-runner-207 kernel: [58196.588695] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 21:33:42 juju-e4d256-prod-github-runner-207 kernel: [58196.589772] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:33:42 juju-e4d256-prod-github-runner-207 kernel: [58196.590826] ? _raw_spin_lock+0x22/0x30 Aug 22 21:33:42 juju-e4d256-prod-github-runner-207 kernel: [58196.591769] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:33:42 juju-e4d256-prod-github-runner-207 kernel: [58196.592792] direct_page_fault+0x206/0x310 [kvm] Aug 22 21:33:42 juju-e4d256-prod-github-runner-207 kernel: [58196.593814] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 21:33:42 juju-e4d256-prod-github-runner-207 kernel: [58196.594821] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 21:33:42 juju-e4d256-prod-github-runner-207 kernel: [58196.595819] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 21:33:42 juju-e4d256-prod-github-runner-207 kernel: [58196.596821] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 21:33:42 juju-e4d256-prod-github-runner-207 kernel: [58196.597765] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 21:33:42 juju-e4d256-prod-github-runner-207 kernel: [58196.598746] handle_exit+0x98/0x230 [kvm_amd] Aug 22 21:33:42 juju-e4d256-prod-github-runner-207 kernel: [58196.599637] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 21:33:42 juju-e4d256-prod-github-runner-207 kernel: [58196.600558] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 21:33:42 juju-e4d256-prod-github-runner-207 kernel: [58196.601479] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 21:33:42 juju-e4d256-prod-github-runner-207 kernel: [58196.602378] vcpu_run+0x62/0x2c0 [kvm] Aug 22 21:33:42 juju-e4d256-prod-github-runner-207 kernel: [58196.603185] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 21:33:42 juju-e4d256-prod-github-runner-207 kernel: [58196.604001] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 21:33:42 juju-e4d256-prod-github-runner-207 kernel: [58196.604853] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 21:33:42 juju-e4d256-prod-github-runner-207 kernel: [58196.605653] ? __seccomp_filter+0x4a/0x4a0 Aug 22 21:33:42 juju-e4d256-prod-github-runner-207 kernel: [58196.606393] ? __fget_files+0x86/0xc0 Aug 22 21:33:42 juju-e4d256-prod-github-runner-207 kernel: [58196.607093] __x64_sys_ioctl+0x95/0xd0 Aug 22 21:33:42 juju-e4d256-prod-github-runner-207 kernel: [58196.607783] do_syscall_64+0x5c/0xc0 Aug 22 21:33:42 juju-e4d256-prod-github-runner-207 kernel: [58196.608451] ? do_futex+0x162/0x1f0 Aug 22 21:33:42 juju-e4d256-prod-github-runner-207 kernel: [58196.609096] ? __x64_sys_futex+0x78/0x1e0 Aug 22 21:33:42 juju-e4d256-prod-github-runner-207 kernel: [58196.609766] ? __secure_computing+0xa9/0x120 Aug 22 21:33:42 juju-e4d256-prod-github-runner-207 kernel: [58196.610451] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 21:33:42 juju-e4d256-prod-github-runner-207 kernel: [58196.611213] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:33:42 juju-e4d256-prod-github-runner-207 kernel: [58196.611938] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:33:42 juju-e4d256-prod-github-runner-207 kernel: [58196.612652] ? do_syscall_64+0x69/0xc0 Aug 22 21:33:42 juju-e4d256-prod-github-runner-207 kernel: [58196.613294] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:33:42 juju-e4d256-prod-github-runner-207 kernel: [58196.613993] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:33:42 juju-e4d256-prod-github-runner-207 kernel: [58196.614684] ? do_syscall_64+0x69/0xc0 Aug 22 21:33:42 juju-e4d256-prod-github-runner-207 kernel: [58196.615315] ? do_syscall_64+0x69/0xc0 Aug 22 21:33:42 juju-e4d256-prod-github-runner-207 kernel: [58196.615946] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 21:33:42 juju-e4d256-prod-github-runner-207 kernel: [58196.616648] RIP: 0033:0x7faa5d0edaff Aug 22 21:33:42 juju-e4d256-prod-github-runner-207 kernel: [58196.617316] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 21:33:42 juju-e4d256-prod-github-runner-207 kernel: [58196.619296] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 21:33:42 juju-e4d256-prod-github-runner-207 kernel: [58196.620282] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 21:33:42 juju-e4d256-prod-github-runner-207 kernel: [58196.621184] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 21:33:42 juju-e4d256-prod-github-runner-207 kernel: [58196.622072] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 21:33:42 juju-e4d256-prod-github-runner-207 kernel: [58196.622957] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 21:33:42 juju-e4d256-prod-github-runner-207 kernel: [58196.623843] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 21:33:42 juju-e4d256-prod-github-runner-207 kernel: [58196.624749] Aug 22 21:34:10 juju-e4d256-prod-github-runner-207 kernel: [58224.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 54117s! [qemu-system-x86:6715] Aug 22 21:34:10 juju-e4d256-prod-github-runner-207 kernel: [58224.543119] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 21:34:10 juju-e4d256-prod-github-runner-207 kernel: [58224.543192] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 21:34:10 juju-e4d256-prod-github-runner-207 kernel: [58224.555530] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 21:34:10 juju-e4d256-prod-github-runner-207 kernel: [58224.556845] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 21:34:10 juju-e4d256-prod-github-runner-207 kernel: [58224.558075] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:34:10 juju-e4d256-prod-github-runner-207 kernel: [58224.559151] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 21:34:10 juju-e4d256-prod-github-runner-207 kernel: [58224.561815] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 21:34:10 juju-e4d256-prod-github-runner-207 kernel: [58224.562903] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 21:34:10 juju-e4d256-prod-github-runner-207 kernel: [58224.564112] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 21:34:10 juju-e4d256-prod-github-runner-207 kernel: [58224.565291] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 21:34:10 juju-e4d256-prod-github-runner-207 kernel: [58224.566458] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 21:34:10 juju-e4d256-prod-github-runner-207 kernel: [58224.567645] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 21:34:10 juju-e4d256-prod-github-runner-207 kernel: [58224.568862] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 21:34:10 juju-e4d256-prod-github-runner-207 kernel: [58224.570127] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 21:34:10 juju-e4d256-prod-github-runner-207 kernel: [58224.571252] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 21:34:10 juju-e4d256-prod-github-runner-207 kernel: [58224.572475] Call Trace: Aug 22 21:34:10 juju-e4d256-prod-github-runner-207 kernel: [58224.573401] Aug 22 21:34:10 juju-e4d256-prod-github-runner-207 kernel: [58224.574318] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:34:10 juju-e4d256-prod-github-runner-207 kernel: [58224.575356] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:34:10 juju-e4d256-prod-github-runner-207 kernel: [58224.576390] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:34:10 juju-e4d256-prod-github-runner-207 kernel: [58224.577496] ? show_regs.part.0+0x23/0x29 Aug 22 21:34:10 juju-e4d256-prod-github-runner-207 kernel: [58224.578493] ? show_regs.cold+0x8/0xd Aug 22 21:34:10 juju-e4d256-prod-github-runner-207 kernel: [58224.579468] ? watchdog_timer_fn+0x1be/0x220 Aug 22 21:34:10 juju-e4d256-prod-github-runner-207 kernel: [58224.580493] ? lockup_detector_update_enable+0x60/0x60 Aug 22 21:34:10 juju-e4d256-prod-github-runner-207 kernel: [58224.581570] ? __hrtimer_run_queues+0x107/0x230 Aug 22 21:34:10 juju-e4d256-prod-github-runner-207 kernel: [58224.582628] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 21:34:10 juju-e4d256-prod-github-runner-207 kernel: [58224.583700] ? hrtimer_interrupt+0x101/0x220 Aug 22 21:34:10 juju-e4d256-prod-github-runner-207 kernel: [58224.584741] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 21:34:10 juju-e4d256-prod-github-runner-207 kernel: [58224.585827] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 21:34:10 juju-e4d256-prod-github-runner-207 kernel: [58224.586907] Aug 22 21:34:10 juju-e4d256-prod-github-runner-207 kernel: [58224.587779] Aug 22 21:34:10 juju-e4d256-prod-github-runner-207 kernel: [58224.588625] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 21:34:10 juju-e4d256-prod-github-runner-207 kernel: [58224.589693] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:34:10 juju-e4d256-prod-github-runner-207 kernel: [58224.590749] ? _raw_spin_lock+0x22/0x30 Aug 22 21:34:10 juju-e4d256-prod-github-runner-207 kernel: [58224.591709] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:34:10 juju-e4d256-prod-github-runner-207 kernel: [58224.592735] direct_page_fault+0x206/0x310 [kvm] Aug 22 21:34:10 juju-e4d256-prod-github-runner-207 kernel: [58224.593766] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 21:34:10 juju-e4d256-prod-github-runner-207 kernel: [58224.594804] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 21:34:10 juju-e4d256-prod-github-runner-207 kernel: [58224.595871] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 21:34:10 juju-e4d256-prod-github-runner-207 kernel: [58224.596859] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 21:34:10 juju-e4d256-prod-github-runner-207 kernel: [58224.597808] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 21:34:10 juju-e4d256-prod-github-runner-207 kernel: [58224.598784] handle_exit+0x98/0x230 [kvm_amd] Aug 22 21:34:10 juju-e4d256-prod-github-runner-207 kernel: [58224.599705] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 21:34:10 juju-e4d256-prod-github-runner-207 kernel: [58224.600622] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 21:34:10 juju-e4d256-prod-github-runner-207 kernel: [58224.601600] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 21:34:10 juju-e4d256-prod-github-runner-207 kernel: [58224.602529] vcpu_run+0x62/0x2c0 [kvm] Aug 22 21:34:10 juju-e4d256-prod-github-runner-207 kernel: [58224.603345] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 21:34:10 juju-e4d256-prod-github-runner-207 kernel: [58224.604190] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 21:34:10 juju-e4d256-prod-github-runner-207 kernel: [58224.605047] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 21:34:10 juju-e4d256-prod-github-runner-207 kernel: [58224.605869] ? __seccomp_filter+0x4a/0x4a0 Aug 22 21:34:10 juju-e4d256-prod-github-runner-207 kernel: [58224.606629] ? __fget_files+0x86/0xc0 Aug 22 21:34:10 juju-e4d256-prod-github-runner-207 kernel: [58224.607349] __x64_sys_ioctl+0x95/0xd0 Aug 22 21:34:10 juju-e4d256-prod-github-runner-207 kernel: [58224.608087] do_syscall_64+0x5c/0xc0 Aug 22 21:34:10 juju-e4d256-prod-github-runner-207 kernel: [58224.608766] ? do_futex+0x162/0x1f0 Aug 22 21:34:10 juju-e4d256-prod-github-runner-207 kernel: [58224.609416] ? __x64_sys_futex+0x78/0x1e0 Aug 22 21:34:10 juju-e4d256-prod-github-runner-207 kernel: [58224.610099] ? __secure_computing+0xa9/0x120 Aug 22 21:34:10 juju-e4d256-prod-github-runner-207 kernel: [58224.610786] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 21:34:10 juju-e4d256-prod-github-runner-207 kernel: [58224.611557] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:34:10 juju-e4d256-prod-github-runner-207 kernel: [58224.612287] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:34:10 juju-e4d256-prod-github-runner-207 kernel: [58224.613000] ? do_syscall_64+0x69/0xc0 Aug 22 21:34:10 juju-e4d256-prod-github-runner-207 kernel: [58224.613646] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:34:10 juju-e4d256-prod-github-runner-207 kernel: [58224.614348] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:34:10 juju-e4d256-prod-github-runner-207 kernel: [58224.615128] ? do_syscall_64+0x69/0xc0 Aug 22 21:34:10 juju-e4d256-prod-github-runner-207 kernel: [58224.615782] ? do_syscall_64+0x69/0xc0 Aug 22 21:34:10 juju-e4d256-prod-github-runner-207 kernel: [58224.616402] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 21:34:10 juju-e4d256-prod-github-runner-207 kernel: [58224.617120] RIP: 0033:0x7faa5d0edaff Aug 22 21:34:10 juju-e4d256-prod-github-runner-207 kernel: [58224.617750] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 21:34:10 juju-e4d256-prod-github-runner-207 kernel: [58224.619758] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 21:34:10 juju-e4d256-prod-github-runner-207 kernel: [58224.620666] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 21:34:10 juju-e4d256-prod-github-runner-207 kernel: [58224.621745] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 21:34:10 juju-e4d256-prod-github-runner-207 kernel: [58224.622643] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 21:34:10 juju-e4d256-prod-github-runner-207 kernel: [58224.623529] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 21:34:10 juju-e4d256-prod-github-runner-207 kernel: [58224.624432] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 21:34:10 juju-e4d256-prod-github-runner-207 kernel: [58224.625347] Aug 22 21:34:38 juju-e4d256-prod-github-runner-207 kernel: [58252.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 54143s! [qemu-system-x86:6715] Aug 22 21:34:38 juju-e4d256-prod-github-runner-207 kernel: [58252.543109] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 21:34:38 juju-e4d256-prod-github-runner-207 kernel: [58252.543184] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 21:34:38 juju-e4d256-prod-github-runner-207 kernel: [58252.555424] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 21:34:38 juju-e4d256-prod-github-runner-207 kernel: [58252.556690] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 21:34:38 juju-e4d256-prod-github-runner-207 kernel: [58252.557911] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:34:38 juju-e4d256-prod-github-runner-207 kernel: [58252.558974] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 21:34:38 juju-e4d256-prod-github-runner-207 kernel: [58252.561533] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 21:34:38 juju-e4d256-prod-github-runner-207 kernel: [58252.562574] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 21:34:38 juju-e4d256-prod-github-runner-207 kernel: [58252.563757] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 21:34:38 juju-e4d256-prod-github-runner-207 kernel: [58252.564922] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 21:34:38 juju-e4d256-prod-github-runner-207 kernel: [58252.566085] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 21:34:38 juju-e4d256-prod-github-runner-207 kernel: [58252.567245] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 21:34:38 juju-e4d256-prod-github-runner-207 kernel: [58252.568517] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 21:34:38 juju-e4d256-prod-github-runner-207 kernel: [58252.569870] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 21:34:38 juju-e4d256-prod-github-runner-207 kernel: [58252.570974] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 21:34:38 juju-e4d256-prod-github-runner-207 kernel: [58252.572185] Call Trace: Aug 22 21:34:38 juju-e4d256-prod-github-runner-207 kernel: [58252.573101] Aug 22 21:34:38 juju-e4d256-prod-github-runner-207 kernel: [58252.573991] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:34:38 juju-e4d256-prod-github-runner-207 kernel: [58252.575029] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:34:38 juju-e4d256-prod-github-runner-207 kernel: [58252.576070] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:34:38 juju-e4d256-prod-github-runner-207 kernel: [58252.577154] ? show_regs.part.0+0x23/0x29 Aug 22 21:34:38 juju-e4d256-prod-github-runner-207 kernel: [58252.578156] ? show_regs.cold+0x8/0xd Aug 22 21:34:38 juju-e4d256-prod-github-runner-207 kernel: [58252.579126] ? watchdog_timer_fn+0x1be/0x220 Aug 22 21:34:38 juju-e4d256-prod-github-runner-207 kernel: [58252.580154] ? lockup_detector_update_enable+0x60/0x60 Aug 22 21:34:38 juju-e4d256-prod-github-runner-207 kernel: [58252.581216] ? __hrtimer_run_queues+0x107/0x230 Aug 22 21:34:38 juju-e4d256-prod-github-runner-207 kernel: [58252.582241] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 21:34:38 juju-e4d256-prod-github-runner-207 kernel: [58252.583262] ? hrtimer_interrupt+0x101/0x220 Aug 22 21:34:38 juju-e4d256-prod-github-runner-207 kernel: [58252.584336] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 21:34:38 juju-e4d256-prod-github-runner-207 kernel: [58252.585407] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 21:34:38 juju-e4d256-prod-github-runner-207 kernel: [58252.586453] Aug 22 21:34:38 juju-e4d256-prod-github-runner-207 kernel: [58252.587319] Aug 22 21:34:38 juju-e4d256-prod-github-runner-207 kernel: [58252.588156] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 21:34:38 juju-e4d256-prod-github-runner-207 kernel: [58252.589189] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:34:38 juju-e4d256-prod-github-runner-207 kernel: [58252.590232] ? _raw_spin_lock+0x22/0x30 Aug 22 21:34:38 juju-e4d256-prod-github-runner-207 kernel: [58252.591181] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:34:38 juju-e4d256-prod-github-runner-207 kernel: [58252.592244] direct_page_fault+0x206/0x310 [kvm] Aug 22 21:34:38 juju-e4d256-prod-github-runner-207 kernel: [58252.593269] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 21:34:38 juju-e4d256-prod-github-runner-207 kernel: [58252.594277] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 21:34:38 juju-e4d256-prod-github-runner-207 kernel: [58252.595277] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 21:34:38 juju-e4d256-prod-github-runner-207 kernel: [58252.596273] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 21:34:38 juju-e4d256-prod-github-runner-207 kernel: [58252.597224] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 21:34:38 juju-e4d256-prod-github-runner-207 kernel: [58252.598200] handle_exit+0x98/0x230 [kvm_amd] Aug 22 21:34:38 juju-e4d256-prod-github-runner-207 kernel: [58252.599101] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 21:34:38 juju-e4d256-prod-github-runner-207 kernel: [58252.600056] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 21:34:38 juju-e4d256-prod-github-runner-207 kernel: [58252.600985] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 21:34:38 juju-e4d256-prod-github-runner-207 kernel: [58252.601899] vcpu_run+0x62/0x2c0 [kvm] Aug 22 21:34:38 juju-e4d256-prod-github-runner-207 kernel: [58252.602708] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 21:34:38 juju-e4d256-prod-github-runner-207 kernel: [58252.603538] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 21:34:38 juju-e4d256-prod-github-runner-207 kernel: [58252.604390] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 21:34:38 juju-e4d256-prod-github-runner-207 kernel: [58252.605184] ? __seccomp_filter+0x4a/0x4a0 Aug 22 21:34:38 juju-e4d256-prod-github-runner-207 kernel: [58252.605934] ? __fget_files+0x86/0xc0 Aug 22 21:34:38 juju-e4d256-prod-github-runner-207 kernel: [58252.606637] __x64_sys_ioctl+0x95/0xd0 Aug 22 21:34:38 juju-e4d256-prod-github-runner-207 kernel: [58252.607357] do_syscall_64+0x5c/0xc0 Aug 22 21:34:38 juju-e4d256-prod-github-runner-207 kernel: [58252.608058] ? do_futex+0x162/0x1f0 Aug 22 21:34:38 juju-e4d256-prod-github-runner-207 kernel: [58252.608709] ? __x64_sys_futex+0x78/0x1e0 Aug 22 21:34:38 juju-e4d256-prod-github-runner-207 kernel: [58252.609381] ? __secure_computing+0xa9/0x120 Aug 22 21:34:38 juju-e4d256-prod-github-runner-207 kernel: [58252.610067] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 21:34:38 juju-e4d256-prod-github-runner-207 kernel: [58252.610823] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:34:38 juju-e4d256-prod-github-runner-207 kernel: [58252.611562] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:34:38 juju-e4d256-prod-github-runner-207 kernel: [58252.612279] ? do_syscall_64+0x69/0xc0 Aug 22 21:34:38 juju-e4d256-prod-github-runner-207 kernel: [58252.612921] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:34:38 juju-e4d256-prod-github-runner-207 kernel: [58252.613621] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:34:38 juju-e4d256-prod-github-runner-207 kernel: [58252.614312] ? do_syscall_64+0x69/0xc0 Aug 22 21:34:38 juju-e4d256-prod-github-runner-207 kernel: [58252.614934] ? do_syscall_64+0x69/0xc0 Aug 22 21:34:38 juju-e4d256-prod-github-runner-207 kernel: [58252.615584] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 21:34:38 juju-e4d256-prod-github-runner-207 kernel: [58252.616315] RIP: 0033:0x7faa5d0edaff Aug 22 21:34:38 juju-e4d256-prod-github-runner-207 kernel: [58252.616937] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 21:34:38 juju-e4d256-prod-github-runner-207 kernel: [58252.618914] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 21:34:38 juju-e4d256-prod-github-runner-207 kernel: [58252.619848] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 21:34:38 juju-e4d256-prod-github-runner-207 kernel: [58252.620731] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 21:34:38 juju-e4d256-prod-github-runner-207 kernel: [58252.621615] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 21:34:38 juju-e4d256-prod-github-runner-207 kernel: [58252.622502] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 21:34:38 juju-e4d256-prod-github-runner-207 kernel: [58252.623408] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 21:34:38 juju-e4d256-prod-github-runner-207 kernel: [58252.624302] Aug 22 21:35:06 juju-e4d256-prod-github-runner-207 kernel: [58280.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 54169s! [qemu-system-x86:6715] Aug 22 21:35:06 juju-e4d256-prod-github-runner-207 kernel: [58280.543187] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 21:35:06 juju-e4d256-prod-github-runner-207 kernel: [58280.543260] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 21:35:06 juju-e4d256-prod-github-runner-207 kernel: [58280.555728] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 21:35:06 juju-e4d256-prod-github-runner-207 kernel: [58280.557029] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 21:35:06 juju-e4d256-prod-github-runner-207 kernel: [58280.558276] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:35:06 juju-e4d256-prod-github-runner-207 kernel: [58280.559373] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 21:35:06 juju-e4d256-prod-github-runner-207 kernel: [58280.562050] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 21:35:06 juju-e4d256-prod-github-runner-207 kernel: [58280.563188] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 21:35:06 juju-e4d256-prod-github-runner-207 kernel: [58280.564378] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 21:35:06 juju-e4d256-prod-github-runner-207 kernel: [58280.565566] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 21:35:06 juju-e4d256-prod-github-runner-207 kernel: [58280.566793] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 21:35:06 juju-e4d256-prod-github-runner-207 kernel: [58280.568023] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 21:35:06 juju-e4d256-prod-github-runner-207 kernel: [58280.569309] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 21:35:06 juju-e4d256-prod-github-runner-207 kernel: [58280.570568] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 21:35:06 juju-e4d256-prod-github-runner-207 kernel: [58280.571709] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 21:35:06 juju-e4d256-prod-github-runner-207 kernel: [58280.572923] Call Trace: Aug 22 21:35:06 juju-e4d256-prod-github-runner-207 kernel: [58280.573847] Aug 22 21:35:06 juju-e4d256-prod-github-runner-207 kernel: [58280.574744] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:35:06 juju-e4d256-prod-github-runner-207 kernel: [58280.575841] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:35:06 juju-e4d256-prod-github-runner-207 kernel: [58280.576886] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:35:06 juju-e4d256-prod-github-runner-207 kernel: [58280.577978] ? show_regs.part.0+0x23/0x29 Aug 22 21:35:06 juju-e4d256-prod-github-runner-207 kernel: [58280.578987] ? show_regs.cold+0x8/0xd Aug 22 21:35:06 juju-e4d256-prod-github-runner-207 kernel: [58280.579983] ? watchdog_timer_fn+0x1be/0x220 Aug 22 21:35:06 juju-e4d256-prod-github-runner-207 kernel: [58280.581224] ? lockup_detector_update_enable+0x60/0x60 Aug 22 21:35:06 juju-e4d256-prod-github-runner-207 kernel: [58280.582332] ? __hrtimer_run_queues+0x107/0x230 Aug 22 21:35:06 juju-e4d256-prod-github-runner-207 kernel: [58280.583406] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 21:35:06 juju-e4d256-prod-github-runner-207 kernel: [58280.584441] ? hrtimer_interrupt+0x101/0x220 Aug 22 21:35:06 juju-e4d256-prod-github-runner-207 kernel: [58280.585489] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 21:35:06 juju-e4d256-prod-github-runner-207 kernel: [58280.586581] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 21:35:06 juju-e4d256-prod-github-runner-207 kernel: [58280.587656] Aug 22 21:35:06 juju-e4d256-prod-github-runner-207 kernel: [58280.588515] Aug 22 21:35:06 juju-e4d256-prod-github-runner-207 kernel: [58280.589361] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 21:35:06 juju-e4d256-prod-github-runner-207 kernel: [58280.590410] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:35:06 juju-e4d256-prod-github-runner-207 kernel: [58280.591487] ? _raw_spin_lock+0x22/0x30 Aug 22 21:35:06 juju-e4d256-prod-github-runner-207 kernel: [58280.592445] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:35:06 juju-e4d256-prod-github-runner-207 kernel: [58280.593481] direct_page_fault+0x206/0x310 [kvm] Aug 22 21:35:06 juju-e4d256-prod-github-runner-207 kernel: [58280.594523] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 21:35:06 juju-e4d256-prod-github-runner-207 kernel: [58280.595576] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 21:35:06 juju-e4d256-prod-github-runner-207 kernel: [58280.596596] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 21:35:06 juju-e4d256-prod-github-runner-207 kernel: [58280.597582] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 21:35:06 juju-e4d256-prod-github-runner-207 kernel: [58280.598542] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 21:35:06 juju-e4d256-prod-github-runner-207 kernel: [58280.599543] handle_exit+0x98/0x230 [kvm_amd] Aug 22 21:35:06 juju-e4d256-prod-github-runner-207 kernel: [58280.600450] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 21:35:06 juju-e4d256-prod-github-runner-207 kernel: [58280.601382] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 21:35:06 juju-e4d256-prod-github-runner-207 kernel: [58280.602340] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 21:35:06 juju-e4d256-prod-github-runner-207 kernel: [58280.603287] vcpu_run+0x62/0x2c0 [kvm] Aug 22 21:35:06 juju-e4d256-prod-github-runner-207 kernel: [58280.604122] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 21:35:06 juju-e4d256-prod-github-runner-207 kernel: [58280.604961] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 21:35:06 juju-e4d256-prod-github-runner-207 kernel: [58280.605851] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 21:35:06 juju-e4d256-prod-github-runner-207 kernel: [58280.606661] ? __seccomp_filter+0x4a/0x4a0 Aug 22 21:35:06 juju-e4d256-prod-github-runner-207 kernel: [58280.607438] ? __fget_files+0x86/0xc0 Aug 22 21:35:06 juju-e4d256-prod-github-runner-207 kernel: [58280.608153] __x64_sys_ioctl+0x95/0xd0 Aug 22 21:35:06 juju-e4d256-prod-github-runner-207 kernel: [58280.608855] do_syscall_64+0x5c/0xc0 Aug 22 21:35:06 juju-e4d256-prod-github-runner-207 kernel: [58280.609530] ? do_futex+0x162/0x1f0 Aug 22 21:35:06 juju-e4d256-prod-github-runner-207 kernel: [58280.610200] ? __x64_sys_futex+0x78/0x1e0 Aug 22 21:35:06 juju-e4d256-prod-github-runner-207 kernel: [58280.610936] ? __secure_computing+0xa9/0x120 Aug 22 21:35:06 juju-e4d256-prod-github-runner-207 kernel: [58280.611674] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 21:35:06 juju-e4d256-prod-github-runner-207 kernel: [58280.612470] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:35:06 juju-e4d256-prod-github-runner-207 kernel: [58280.613206] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:35:06 juju-e4d256-prod-github-runner-207 kernel: [58280.613936] ? do_syscall_64+0x69/0xc0 Aug 22 21:35:06 juju-e4d256-prod-github-runner-207 kernel: [58280.614595] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:35:06 juju-e4d256-prod-github-runner-207 kernel: [58280.615331] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:35:06 juju-e4d256-prod-github-runner-207 kernel: [58280.616043] ? do_syscall_64+0x69/0xc0 Aug 22 21:35:06 juju-e4d256-prod-github-runner-207 kernel: [58280.616683] ? do_syscall_64+0x69/0xc0 Aug 22 21:35:06 juju-e4d256-prod-github-runner-207 kernel: [58280.617330] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 21:35:06 juju-e4d256-prod-github-runner-207 kernel: [58280.618062] RIP: 0033:0x7faa5d0edaff Aug 22 21:35:06 juju-e4d256-prod-github-runner-207 kernel: [58280.618730] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 21:35:06 juju-e4d256-prod-github-runner-207 kernel: [58280.620907] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 21:35:06 juju-e4d256-prod-github-runner-207 kernel: [58280.621955] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 21:35:06 juju-e4d256-prod-github-runner-207 kernel: [58280.622945] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 21:35:06 juju-e4d256-prod-github-runner-207 kernel: [58280.623954] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 21:35:06 juju-e4d256-prod-github-runner-207 kernel: [58280.624924] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 21:35:06 juju-e4d256-prod-github-runner-207 kernel: [58280.625940] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 21:35:06 juju-e4d256-prod-github-runner-207 kernel: [58280.626909] Aug 22 21:35:34 juju-e4d256-prod-github-runner-207 kernel: [58308.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 54196s! [qemu-system-x86:6715] Aug 22 21:35:34 juju-e4d256-prod-github-runner-207 kernel: [58308.543888] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 21:35:34 juju-e4d256-prod-github-runner-207 kernel: [58308.544212] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 21:35:34 juju-e4d256-prod-github-runner-207 kernel: [58308.556306] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 21:35:34 juju-e4d256-prod-github-runner-207 kernel: [58308.557571] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 21:35:34 juju-e4d256-prod-github-runner-207 kernel: [58308.558790] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:35:34 juju-e4d256-prod-github-runner-207 kernel: [58308.559847] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 21:35:34 juju-e4d256-prod-github-runner-207 kernel: [58308.562403] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 21:35:34 juju-e4d256-prod-github-runner-207 kernel: [58308.563451] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 21:35:34 juju-e4d256-prod-github-runner-207 kernel: [58308.564607] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 21:35:34 juju-e4d256-prod-github-runner-207 kernel: [58308.565762] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 21:35:34 juju-e4d256-prod-github-runner-207 kernel: [58308.566934] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 21:35:34 juju-e4d256-prod-github-runner-207 kernel: [58308.568091] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 21:35:34 juju-e4d256-prod-github-runner-207 kernel: [58308.569253] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 21:35:34 juju-e4d256-prod-github-runner-207 kernel: [58308.570493] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 21:35:34 juju-e4d256-prod-github-runner-207 kernel: [58308.571628] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 21:35:34 juju-e4d256-prod-github-runner-207 kernel: [58308.572818] Call Trace: Aug 22 21:35:34 juju-e4d256-prod-github-runner-207 kernel: [58308.573727] Aug 22 21:35:34 juju-e4d256-prod-github-runner-207 kernel: [58308.574619] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:35:34 juju-e4d256-prod-github-runner-207 kernel: [58308.575674] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:35:34 juju-e4d256-prod-github-runner-207 kernel: [58308.576698] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:35:34 juju-e4d256-prod-github-runner-207 kernel: [58308.577795] ? show_regs.part.0+0x23/0x29 Aug 22 21:35:34 juju-e4d256-prod-github-runner-207 kernel: [58308.578806] ? show_regs.cold+0x8/0xd Aug 22 21:35:34 juju-e4d256-prod-github-runner-207 kernel: [58308.579775] ? watchdog_timer_fn+0x1be/0x220 Aug 22 21:35:34 juju-e4d256-prod-github-runner-207 kernel: [58308.580780] ? lockup_detector_update_enable+0x60/0x60 Aug 22 21:35:34 juju-e4d256-prod-github-runner-207 kernel: [58308.581873] ? __hrtimer_run_queues+0x107/0x230 Aug 22 21:35:34 juju-e4d256-prod-github-runner-207 kernel: [58308.582934] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 21:35:34 juju-e4d256-prod-github-runner-207 kernel: [58308.583966] ? hrtimer_interrupt+0x101/0x220 Aug 22 21:35:34 juju-e4d256-prod-github-runner-207 kernel: [58308.584979] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 21:35:34 juju-e4d256-prod-github-runner-207 kernel: [58308.586053] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 21:35:34 juju-e4d256-prod-github-runner-207 kernel: [58308.587107] Aug 22 21:35:34 juju-e4d256-prod-github-runner-207 kernel: [58308.587959] Aug 22 21:35:34 juju-e4d256-prod-github-runner-207 kernel: [58308.588800] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 21:35:34 juju-e4d256-prod-github-runner-207 kernel: [58308.589830] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:35:34 juju-e4d256-prod-github-runner-207 kernel: [58308.590875] ? _raw_spin_lock+0x22/0x30 Aug 22 21:35:34 juju-e4d256-prod-github-runner-207 kernel: [58308.591824] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:35:34 juju-e4d256-prod-github-runner-207 kernel: [58308.592836] direct_page_fault+0x206/0x310 [kvm] Aug 22 21:35:34 juju-e4d256-prod-github-runner-207 kernel: [58308.593861] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 21:35:34 juju-e4d256-prod-github-runner-207 kernel: [58308.594893] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 21:35:34 juju-e4d256-prod-github-runner-207 kernel: [58308.595898] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 21:35:34 juju-e4d256-prod-github-runner-207 kernel: [58308.596898] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 21:35:34 juju-e4d256-prod-github-runner-207 kernel: [58308.597847] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 21:35:34 juju-e4d256-prod-github-runner-207 kernel: [58308.598838] handle_exit+0x98/0x230 [kvm_amd] Aug 22 21:35:34 juju-e4d256-prod-github-runner-207 kernel: [58308.599728] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 21:35:34 juju-e4d256-prod-github-runner-207 kernel: [58308.600640] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 21:35:34 juju-e4d256-prod-github-runner-207 kernel: [58308.601562] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 21:35:34 juju-e4d256-prod-github-runner-207 kernel: [58308.602464] vcpu_run+0x62/0x2c0 [kvm] Aug 22 21:35:34 juju-e4d256-prod-github-runner-207 kernel: [58308.603282] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 21:35:34 juju-e4d256-prod-github-runner-207 kernel: [58308.604165] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 21:35:34 juju-e4d256-prod-github-runner-207 kernel: [58308.605016] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 21:35:34 juju-e4d256-prod-github-runner-207 kernel: [58308.605811] ? __seccomp_filter+0x4a/0x4a0 Aug 22 21:35:34 juju-e4d256-prod-github-runner-207 kernel: [58308.606550] ? __fget_files+0x86/0xc0 Aug 22 21:35:34 juju-e4d256-prod-github-runner-207 kernel: [58308.607259] __x64_sys_ioctl+0x95/0xd0 Aug 22 21:35:34 juju-e4d256-prod-github-runner-207 kernel: [58308.607950] do_syscall_64+0x5c/0xc0 Aug 22 21:35:34 juju-e4d256-prod-github-runner-207 kernel: [58308.608614] ? do_futex+0x162/0x1f0 Aug 22 21:35:34 juju-e4d256-prod-github-runner-207 kernel: [58308.609261] ? __x64_sys_futex+0x78/0x1e0 Aug 22 21:35:34 juju-e4d256-prod-github-runner-207 kernel: [58308.609932] ? __secure_computing+0xa9/0x120 Aug 22 21:35:34 juju-e4d256-prod-github-runner-207 kernel: [58308.610624] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 21:35:34 juju-e4d256-prod-github-runner-207 kernel: [58308.611401] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:35:34 juju-e4d256-prod-github-runner-207 kernel: [58308.612121] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:35:34 juju-e4d256-prod-github-runner-207 kernel: [58308.612835] ? do_syscall_64+0x69/0xc0 Aug 22 21:35:34 juju-e4d256-prod-github-runner-207 kernel: [58308.613476] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:35:34 juju-e4d256-prod-github-runner-207 kernel: [58308.614174] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:35:34 juju-e4d256-prod-github-runner-207 kernel: [58308.614877] ? do_syscall_64+0x69/0xc0 Aug 22 21:35:34 juju-e4d256-prod-github-runner-207 kernel: [58308.615500] ? do_syscall_64+0x69/0xc0 Aug 22 21:35:34 juju-e4d256-prod-github-runner-207 kernel: [58308.616119] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 21:35:34 juju-e4d256-prod-github-runner-207 kernel: [58308.616820] RIP: 0033:0x7faa5d0edaff Aug 22 21:35:34 juju-e4d256-prod-github-runner-207 kernel: [58308.617481] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 21:35:34 juju-e4d256-prod-github-runner-207 kernel: [58308.619486] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 21:35:34 juju-e4d256-prod-github-runner-207 kernel: [58308.620405] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 21:35:34 juju-e4d256-prod-github-runner-207 kernel: [58308.621295] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 21:35:34 juju-e4d256-prod-github-runner-207 kernel: [58308.622183] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 21:35:34 juju-e4d256-prod-github-runner-207 kernel: [58308.623079] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 21:35:34 juju-e4d256-prod-github-runner-207 kernel: [58308.623970] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 21:35:34 juju-e4d256-prod-github-runner-207 kernel: [58308.624858] Aug 22 21:35:47 juju-e4d256-prod-github-runner-207 kernel: [58321.076705] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 21:35:47 juju-e4d256-prod-github-runner-207 kernel: [58321.077696] rcu: 1-....: (14505174 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=7010313 Aug 22 21:35:47 juju-e4d256-prod-github-runner-207 kernel: [58321.078889] (t=14550969 jiffies g=23269 q=52908) Aug 22 21:35:47 juju-e4d256-prod-github-runner-207 kernel: [58321.079704] NMI backtrace for cpu 1 Aug 22 21:35:47 juju-e4d256-prod-github-runner-207 kernel: [58321.080420] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 21:35:47 juju-e4d256-prod-github-runner-207 kernel: [58321.081558] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 21:35:47 juju-e4d256-prod-github-runner-207 kernel: [58321.082661] Call Trace: Aug 22 21:35:47 juju-e4d256-prod-github-runner-207 kernel: [58321.083340] Aug 22 21:35:47 juju-e4d256-prod-github-runner-207 kernel: [58321.083987] show_stack+0x52/0x5c Aug 22 21:35:47 juju-e4d256-prod-github-runner-207 kernel: [58321.084718] dump_stack_lvl+0x4a/0x63 Aug 22 21:35:47 juju-e4d256-prod-github-runner-207 kernel: [58321.085471] dump_stack+0x10/0x16 Aug 22 21:35:47 juju-e4d256-prod-github-runner-207 kernel: [58321.086195] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 21:35:47 juju-e4d256-prod-github-runner-207 kernel: [58321.087138] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 21:35:47 juju-e4d256-prod-github-runner-207 kernel: [58321.087936] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 21:35:47 juju-e4d256-prod-github-runner-207 kernel: [58321.088770] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 21:35:47 juju-e4d256-prod-github-runner-207 kernel: [58321.089766] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 21:35:47 juju-e4d256-prod-github-runner-207 kernel: [58321.090586] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 21:35:47 juju-e4d256-prod-github-runner-207 kernel: [58321.091400] print_cpu_stall.cold+0x2f/0xe2 Aug 22 21:35:47 juju-e4d256-prod-github-runner-207 kernel: [58321.092212] ? timekeeping_update+0xf7/0x150 Aug 22 21:35:47 juju-e4d256-prod-github-runner-207 kernel: [58321.093056] check_cpu_stall+0x109/0x270 Aug 22 21:35:47 juju-e4d256-prod-github-runner-207 kernel: [58321.093830] rcu_sched_clock_irq+0x9a/0x250 Aug 22 21:35:47 juju-e4d256-prod-github-runner-207 kernel: [58321.094606] update_process_times+0x94/0xd0 Aug 22 21:35:47 juju-e4d256-prod-github-runner-207 kernel: [58321.095395] tick_sched_handle+0x29/0x70 Aug 22 21:35:47 juju-e4d256-prod-github-runner-207 kernel: [58321.096146] tick_sched_timer+0x8c/0xc0 Aug 22 21:35:47 juju-e4d256-prod-github-runner-207 kernel: [58321.096887] ? tick_nohz_handler+0xb0/0xb0 Aug 22 21:35:47 juju-e4d256-prod-github-runner-207 kernel: [58321.097650] __hrtimer_run_queues+0x107/0x230 Aug 22 21:35:47 juju-e4d256-prod-github-runner-207 kernel: [58321.098430] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 21:35:47 juju-e4d256-prod-github-runner-207 kernel: [58321.099228] hrtimer_interrupt+0x101/0x220 Aug 22 21:35:47 juju-e4d256-prod-github-runner-207 kernel: [58321.099997] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 21:35:47 juju-e4d256-prod-github-runner-207 kernel: [58321.100817] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 21:35:47 juju-e4d256-prod-github-runner-207 kernel: [58321.101627] Aug 22 21:35:47 juju-e4d256-prod-github-runner-207 kernel: [58321.102264] Aug 22 21:35:47 juju-e4d256-prod-github-runner-207 kernel: [58321.102910] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 21:35:47 juju-e4d256-prod-github-runner-207 kernel: [58321.103743] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:35:47 juju-e4d256-prod-github-runner-207 kernel: [58321.104637] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 21:35:47 juju-e4d256-prod-github-runner-207 kernel: [58321.106901] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 21:35:47 juju-e4d256-prod-github-runner-207 kernel: [58321.107785] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 21:35:47 juju-e4d256-prod-github-runner-207 kernel: [58321.108810] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 21:35:47 juju-e4d256-prod-github-runner-207 kernel: [58321.109825] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 21:35:47 juju-e4d256-prod-github-runner-207 kernel: [58321.110826] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 21:35:47 juju-e4d256-prod-github-runner-207 kernel: [58321.111820] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 21:35:47 juju-e4d256-prod-github-runner-207 kernel: [58321.112794] ? _raw_spin_lock+0x22/0x30 Aug 22 21:35:47 juju-e4d256-prod-github-runner-207 kernel: [58321.113562] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:35:47 juju-e4d256-prod-github-runner-207 kernel: [58321.114411] direct_page_fault+0x206/0x310 [kvm] Aug 22 21:35:47 juju-e4d256-prod-github-runner-207 kernel: [58321.115277] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 21:35:47 juju-e4d256-prod-github-runner-207 kernel: [58321.116119] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 21:35:47 juju-e4d256-prod-github-runner-207 kernel: [58321.116951] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 21:35:47 juju-e4d256-prod-github-runner-207 kernel: [58321.117764] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 21:35:47 juju-e4d256-prod-github-runner-207 kernel: [58321.118558] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 21:35:47 juju-e4d256-prod-github-runner-207 kernel: [58321.119419] handle_exit+0x98/0x230 [kvm_amd] Aug 22 21:35:47 juju-e4d256-prod-github-runner-207 kernel: [58321.120184] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 21:35:47 juju-e4d256-prod-github-runner-207 kernel: [58321.120975] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 21:35:47 juju-e4d256-prod-github-runner-207 kernel: [58321.121785] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 21:35:47 juju-e4d256-prod-github-runner-207 kernel: [58321.122581] vcpu_run+0x62/0x2c0 [kvm] Aug 22 21:35:47 juju-e4d256-prod-github-runner-207 kernel: [58321.123314] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 21:35:47 juju-e4d256-prod-github-runner-207 kernel: [58321.124055] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 21:35:47 juju-e4d256-prod-github-runner-207 kernel: [58321.124868] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 21:35:47 juju-e4d256-prod-github-runner-207 kernel: [58321.125641] ? __seccomp_filter+0x4a/0x4a0 Aug 22 21:35:47 juju-e4d256-prod-github-runner-207 kernel: [58321.126371] ? __fget_files+0x86/0xc0 Aug 22 21:35:47 juju-e4d256-prod-github-runner-207 kernel: [58321.127089] __x64_sys_ioctl+0x95/0xd0 Aug 22 21:35:47 juju-e4d256-prod-github-runner-207 kernel: [58321.127793] do_syscall_64+0x5c/0xc0 Aug 22 21:35:47 juju-e4d256-prod-github-runner-207 kernel: [58321.128482] ? do_futex+0x162/0x1f0 Aug 22 21:35:47 juju-e4d256-prod-github-runner-207 kernel: [58321.129165] ? __x64_sys_futex+0x78/0x1e0 Aug 22 21:35:47 juju-e4d256-prod-github-runner-207 kernel: [58321.129893] ? __secure_computing+0xa9/0x120 Aug 22 21:35:47 juju-e4d256-prod-github-runner-207 kernel: [58321.130652] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 21:35:47 juju-e4d256-prod-github-runner-207 kernel: [58321.131453] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:35:47 juju-e4d256-prod-github-runner-207 kernel: [58321.132225] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:35:47 juju-e4d256-prod-github-runner-207 kernel: [58321.132987] ? do_syscall_64+0x69/0xc0 Aug 22 21:35:47 juju-e4d256-prod-github-runner-207 kernel: [58321.133688] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:35:47 juju-e4d256-prod-github-runner-207 kernel: [58321.134453] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:35:47 juju-e4d256-prod-github-runner-207 kernel: [58321.135235] ? do_syscall_64+0x69/0xc0 Aug 22 21:35:47 juju-e4d256-prod-github-runner-207 kernel: [58321.135947] ? do_syscall_64+0x69/0xc0 Aug 22 21:35:47 juju-e4d256-prod-github-runner-207 kernel: [58321.136658] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 21:35:47 juju-e4d256-prod-github-runner-207 kernel: [58321.137439] RIP: 0033:0x7faa5d0edaff Aug 22 21:35:47 juju-e4d256-prod-github-runner-207 kernel: [58321.138134] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 21:35:47 juju-e4d256-prod-github-runner-207 kernel: [58321.140306] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 21:35:47 juju-e4d256-prod-github-runner-207 kernel: [58321.141297] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 21:35:47 juju-e4d256-prod-github-runner-207 kernel: [58321.142260] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 21:35:47 juju-e4d256-prod-github-runner-207 kernel: [58321.143308] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 21:35:47 juju-e4d256-prod-github-runner-207 kernel: [58321.144270] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 21:35:47 juju-e4d256-prod-github-runner-207 kernel: [58321.145213] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 21:35:47 juju-e4d256-prod-github-runner-207 kernel: [58321.146143] Aug 22 21:36:14 juju-e4d256-prod-github-runner-207 kernel: [58348.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 54233s! [qemu-system-x86:6715] Aug 22 21:36:14 juju-e4d256-prod-github-runner-207 kernel: [58348.543181] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 21:36:14 juju-e4d256-prod-github-runner-207 kernel: [58348.543256] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 21:36:14 juju-e4d256-prod-github-runner-207 kernel: [58348.556045] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 21:36:14 juju-e4d256-prod-github-runner-207 kernel: [58348.557311] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 21:36:14 juju-e4d256-prod-github-runner-207 kernel: [58348.558568] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:36:14 juju-e4d256-prod-github-runner-207 kernel: [58348.559629] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 21:36:14 juju-e4d256-prod-github-runner-207 kernel: [58348.562182] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 21:36:14 juju-e4d256-prod-github-runner-207 kernel: [58348.563254] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 21:36:14 juju-e4d256-prod-github-runner-207 kernel: [58348.564439] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 21:36:14 juju-e4d256-prod-github-runner-207 kernel: [58348.565607] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 21:36:14 juju-e4d256-prod-github-runner-207 kernel: [58348.566801] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 21:36:14 juju-e4d256-prod-github-runner-207 kernel: [58348.568007] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 21:36:14 juju-e4d256-prod-github-runner-207 kernel: [58348.569179] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 21:36:14 juju-e4d256-prod-github-runner-207 kernel: [58348.570489] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 21:36:14 juju-e4d256-prod-github-runner-207 kernel: [58348.571656] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 21:36:14 juju-e4d256-prod-github-runner-207 kernel: [58348.572901] Call Trace: Aug 22 21:36:14 juju-e4d256-prod-github-runner-207 kernel: [58348.573820] Aug 22 21:36:14 juju-e4d256-prod-github-runner-207 kernel: [58348.574740] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:36:14 juju-e4d256-prod-github-runner-207 kernel: [58348.575795] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:36:14 juju-e4d256-prod-github-runner-207 kernel: [58348.576818] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:36:14 juju-e4d256-prod-github-runner-207 kernel: [58348.577894] ? show_regs.part.0+0x23/0x29 Aug 22 21:36:14 juju-e4d256-prod-github-runner-207 kernel: [58348.578919] ? show_regs.cold+0x8/0xd Aug 22 21:36:14 juju-e4d256-prod-github-runner-207 kernel: [58348.579890] ? watchdog_timer_fn+0x1be/0x220 Aug 22 21:36:14 juju-e4d256-prod-github-runner-207 kernel: [58348.580897] ? lockup_detector_update_enable+0x60/0x60 Aug 22 21:36:14 juju-e4d256-prod-github-runner-207 kernel: [58348.581962] ? __hrtimer_run_queues+0x107/0x230 Aug 22 21:36:14 juju-e4d256-prod-github-runner-207 kernel: [58348.583019] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 21:36:14 juju-e4d256-prod-github-runner-207 kernel: [58348.584082] ? hrtimer_interrupt+0x101/0x220 Aug 22 21:36:14 juju-e4d256-prod-github-runner-207 kernel: [58348.585124] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 21:36:14 juju-e4d256-prod-github-runner-207 kernel: [58348.586194] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 21:36:14 juju-e4d256-prod-github-runner-207 kernel: [58348.587267] Aug 22 21:36:14 juju-e4d256-prod-github-runner-207 kernel: [58348.588121] Aug 22 21:36:14 juju-e4d256-prod-github-runner-207 kernel: [58348.588963] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 21:36:14 juju-e4d256-prod-github-runner-207 kernel: [58348.589995] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:36:14 juju-e4d256-prod-github-runner-207 kernel: [58348.591056] ? _raw_spin_lock+0x22/0x30 Aug 22 21:36:14 juju-e4d256-prod-github-runner-207 kernel: [58348.592062] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:36:14 juju-e4d256-prod-github-runner-207 kernel: [58348.593112] direct_page_fault+0x206/0x310 [kvm] Aug 22 21:36:14 juju-e4d256-prod-github-runner-207 kernel: [58348.594140] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 21:36:14 juju-e4d256-prod-github-runner-207 kernel: [58348.595182] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 21:36:14 juju-e4d256-prod-github-runner-207 kernel: [58348.596185] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 21:36:14 juju-e4d256-prod-github-runner-207 kernel: [58348.597154] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 21:36:14 juju-e4d256-prod-github-runner-207 kernel: [58348.598102] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 21:36:14 juju-e4d256-prod-github-runner-207 kernel: [58348.599099] handle_exit+0x98/0x230 [kvm_amd] Aug 22 21:36:14 juju-e4d256-prod-github-runner-207 kernel: [58348.599992] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 21:36:14 juju-e4d256-prod-github-runner-207 kernel: [58348.600911] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 21:36:14 juju-e4d256-prod-github-runner-207 kernel: [58348.601850] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 21:36:14 juju-e4d256-prod-github-runner-207 kernel: [58348.602768] vcpu_run+0x62/0x2c0 [kvm] Aug 22 21:36:14 juju-e4d256-prod-github-runner-207 kernel: [58348.603584] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 21:36:14 juju-e4d256-prod-github-runner-207 kernel: [58348.604398] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 21:36:14 juju-e4d256-prod-github-runner-207 kernel: [58348.605253] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 21:36:14 juju-e4d256-prod-github-runner-207 kernel: [58348.606050] ? __seccomp_filter+0x4a/0x4a0 Aug 22 21:36:14 juju-e4d256-prod-github-runner-207 kernel: [58348.606807] ? __fget_files+0x86/0xc0 Aug 22 21:36:14 juju-e4d256-prod-github-runner-207 kernel: [58348.607511] __x64_sys_ioctl+0x95/0xd0 Aug 22 21:36:14 juju-e4d256-prod-github-runner-207 kernel: [58348.608204] do_syscall_64+0x5c/0xc0 Aug 22 21:36:14 juju-e4d256-prod-github-runner-207 kernel: [58348.608928] ? do_futex+0x162/0x1f0 Aug 22 21:36:14 juju-e4d256-prod-github-runner-207 kernel: [58348.609611] ? __x64_sys_futex+0x78/0x1e0 Aug 22 21:36:14 juju-e4d256-prod-github-runner-207 kernel: [58348.610331] ? __secure_computing+0xa9/0x120 Aug 22 21:36:14 juju-e4d256-prod-github-runner-207 kernel: [58348.611069] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 21:36:14 juju-e4d256-prod-github-runner-207 kernel: [58348.611830] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:36:14 juju-e4d256-prod-github-runner-207 kernel: [58348.612595] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:36:14 juju-e4d256-prod-github-runner-207 kernel: [58348.613315] ? do_syscall_64+0x69/0xc0 Aug 22 21:36:14 juju-e4d256-prod-github-runner-207 kernel: [58348.613968] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:36:14 juju-e4d256-prod-github-runner-207 kernel: [58348.614689] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:36:14 juju-e4d256-prod-github-runner-207 kernel: [58348.615385] ? do_syscall_64+0x69/0xc0 Aug 22 21:36:14 juju-e4d256-prod-github-runner-207 kernel: [58348.616010] ? do_syscall_64+0x69/0xc0 Aug 22 21:36:14 juju-e4d256-prod-github-runner-207 kernel: [58348.616631] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 21:36:14 juju-e4d256-prod-github-runner-207 kernel: [58348.617342] RIP: 0033:0x7faa5d0edaff Aug 22 21:36:14 juju-e4d256-prod-github-runner-207 kernel: [58348.617971] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 21:36:14 juju-e4d256-prod-github-runner-207 kernel: [58348.619979] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 21:36:14 juju-e4d256-prod-github-runner-207 kernel: [58348.620945] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 21:36:14 juju-e4d256-prod-github-runner-207 kernel: [58348.621846] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 21:36:14 juju-e4d256-prod-github-runner-207 kernel: [58348.622772] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 21:36:14 juju-e4d256-prod-github-runner-207 kernel: [58348.623675] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 21:36:14 juju-e4d256-prod-github-runner-207 kernel: [58348.624576] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 21:36:14 juju-e4d256-prod-github-runner-207 kernel: [58348.625495] Aug 22 21:36:42 juju-e4d256-prod-github-runner-207 kernel: [58376.541983] watchdog: BUG: soft lockup - CPU#1 stuck for 54259s! [qemu-system-x86:6715] Aug 22 21:36:42 juju-e4d256-prod-github-runner-207 kernel: [58376.543872] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 21:36:42 juju-e4d256-prod-github-runner-207 kernel: [58376.544174] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 21:36:42 juju-e4d256-prod-github-runner-207 kernel: [58376.556648] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 21:36:42 juju-e4d256-prod-github-runner-207 kernel: [58376.557961] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 21:36:42 juju-e4d256-prod-github-runner-207 kernel: [58376.559499] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:36:42 juju-e4d256-prod-github-runner-207 kernel: [58376.560562] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 21:36:42 juju-e4d256-prod-github-runner-207 kernel: [58376.563682] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 21:36:42 juju-e4d256-prod-github-runner-207 kernel: [58376.564851] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 21:36:42 juju-e4d256-prod-github-runner-207 kernel: [58376.566214] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 21:36:42 juju-e4d256-prod-github-runner-207 kernel: [58376.567582] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 21:36:42 juju-e4d256-prod-github-runner-207 kernel: [58376.568888] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 21:36:42 juju-e4d256-prod-github-runner-207 kernel: [58376.570209] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 21:36:42 juju-e4d256-prod-github-runner-207 kernel: [58376.571524] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 21:36:42 juju-e4d256-prod-github-runner-207 kernel: [58376.572917] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 21:36:42 juju-e4d256-prod-github-runner-207 kernel: [58376.574161] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 21:36:42 juju-e4d256-prod-github-runner-207 kernel: [58376.575498] Call Trace: Aug 22 21:36:42 juju-e4d256-prod-github-runner-207 kernel: [58376.576493] Aug 22 21:36:42 juju-e4d256-prod-github-runner-207 kernel: [58376.577473] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:36:42 juju-e4d256-prod-github-runner-207 kernel: [58376.578700] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:36:42 juju-e4d256-prod-github-runner-207 kernel: [58376.579896] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:36:42 juju-e4d256-prod-github-runner-207 kernel: [58376.581132] ? show_regs.part.0+0x23/0x29 Aug 22 21:36:42 juju-e4d256-prod-github-runner-207 kernel: [58376.582248] ? show_regs.cold+0x8/0xd Aug 22 21:36:42 juju-e4d256-prod-github-runner-207 kernel: [58376.583255] ? watchdog_timer_fn+0x1be/0x220 Aug 22 21:36:42 juju-e4d256-prod-github-runner-207 kernel: [58376.584302] ? lockup_detector_update_enable+0x60/0x60 Aug 22 21:36:42 juju-e4d256-prod-github-runner-207 kernel: [58376.585404] ? __hrtimer_run_queues+0x107/0x230 Aug 22 21:36:42 juju-e4d256-prod-github-runner-207 kernel: [58376.586462] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 21:36:42 juju-e4d256-prod-github-runner-207 kernel: [58376.587537] ? hrtimer_interrupt+0x101/0x220 Aug 22 21:36:42 juju-e4d256-prod-github-runner-207 kernel: [58376.588607] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 21:36:42 juju-e4d256-prod-github-runner-207 kernel: [58376.589711] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 21:36:42 juju-e4d256-prod-github-runner-207 kernel: [58376.590787] Aug 22 21:36:42 juju-e4d256-prod-github-runner-207 kernel: [58376.591648] Aug 22 21:36:42 juju-e4d256-prod-github-runner-207 kernel: [58376.592491] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 21:36:42 juju-e4d256-prod-github-runner-207 kernel: [58376.593537] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:36:42 juju-e4d256-prod-github-runner-207 kernel: [58376.594637] ? _raw_spin_lock+0x22/0x30 Aug 22 21:36:42 juju-e4d256-prod-github-runner-207 kernel: [58376.595605] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:36:42 juju-e4d256-prod-github-runner-207 kernel: [58376.596703] direct_page_fault+0x206/0x310 [kvm] Aug 22 21:36:42 juju-e4d256-prod-github-runner-207 kernel: [58376.597781] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 21:36:42 juju-e4d256-prod-github-runner-207 kernel: [58376.598823] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 21:36:42 juju-e4d256-prod-github-runner-207 kernel: [58376.599867] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 21:36:42 juju-e4d256-prod-github-runner-207 kernel: [58376.600920] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 21:36:42 juju-e4d256-prod-github-runner-207 kernel: [58376.601878] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 21:36:42 juju-e4d256-prod-github-runner-207 kernel: [58376.602881] handle_exit+0x98/0x230 [kvm_amd] Aug 22 21:36:42 juju-e4d256-prod-github-runner-207 kernel: [58376.603780] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 21:36:42 juju-e4d256-prod-github-runner-207 kernel: [58376.604698] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 21:36:42 juju-e4d256-prod-github-runner-207 kernel: [58376.605627] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 21:36:42 juju-e4d256-prod-github-runner-207 kernel: [58376.606586] vcpu_run+0x62/0x2c0 [kvm] Aug 22 21:36:42 juju-e4d256-prod-github-runner-207 kernel: [58376.607434] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 21:36:42 juju-e4d256-prod-github-runner-207 kernel: [58376.608310] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 21:36:42 juju-e4d256-prod-github-runner-207 kernel: [58376.609214] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 21:36:42 juju-e4d256-prod-github-runner-207 kernel: [58376.610060] ? __seccomp_filter+0x4a/0x4a0 Aug 22 21:36:42 juju-e4d256-prod-github-runner-207 kernel: [58376.610825] ? __fget_files+0x86/0xc0 Aug 22 21:36:42 juju-e4d256-prod-github-runner-207 kernel: [58376.611553] __x64_sys_ioctl+0x95/0xd0 Aug 22 21:36:42 juju-e4d256-prod-github-runner-207 kernel: [58376.612256] do_syscall_64+0x5c/0xc0 Aug 22 21:36:42 juju-e4d256-prod-github-runner-207 kernel: [58376.612932] ? do_futex+0x162/0x1f0 Aug 22 21:36:42 juju-e4d256-prod-github-runner-207 kernel: [58376.613606] ? __x64_sys_futex+0x78/0x1e0 Aug 22 21:36:42 juju-e4d256-prod-github-runner-207 kernel: [58376.614340] ? __secure_computing+0xa9/0x120 Aug 22 21:36:42 juju-e4d256-prod-github-runner-207 kernel: [58376.615037] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 21:36:42 juju-e4d256-prod-github-runner-207 kernel: [58376.615814] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:36:42 juju-e4d256-prod-github-runner-207 kernel: [58376.616586] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:36:42 juju-e4d256-prod-github-runner-207 kernel: [58376.617356] ? do_syscall_64+0x69/0xc0 Aug 22 21:36:42 juju-e4d256-prod-github-runner-207 kernel: [58376.618069] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:36:42 juju-e4d256-prod-github-runner-207 kernel: [58376.618814] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:36:42 juju-e4d256-prod-github-runner-207 kernel: [58376.619524] ? do_syscall_64+0x69/0xc0 Aug 22 21:36:42 juju-e4d256-prod-github-runner-207 kernel: [58376.620162] ? do_syscall_64+0x69/0xc0 Aug 22 21:36:42 juju-e4d256-prod-github-runner-207 kernel: [58376.620791] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 21:36:42 juju-e4d256-prod-github-runner-207 kernel: [58376.621519] RIP: 0033:0x7faa5d0edaff Aug 22 21:36:42 juju-e4d256-prod-github-runner-207 kernel: [58376.622217] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 21:36:42 juju-e4d256-prod-github-runner-207 kernel: [58376.624588] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 21:36:42 juju-e4d256-prod-github-runner-207 kernel: [58376.625651] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 21:36:42 juju-e4d256-prod-github-runner-207 kernel: [58376.626709] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 21:36:42 juju-e4d256-prod-github-runner-207 kernel: [58376.627746] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 21:36:42 juju-e4d256-prod-github-runner-207 kernel: [58376.628692] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 21:36:42 juju-e4d256-prod-github-runner-207 kernel: [58376.629626] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 21:36:42 juju-e4d256-prod-github-runner-207 kernel: [58376.630594] Aug 22 21:37:10 juju-e4d256-prod-github-runner-207 kernel: [58404.541980] watchdog: BUG: soft lockup - CPU#1 stuck for 54285s! [qemu-system-x86:6715] Aug 22 21:37:10 juju-e4d256-prod-github-runner-207 kernel: [58404.543109] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 21:37:10 juju-e4d256-prod-github-runner-207 kernel: [58404.543185] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 21:37:10 juju-e4d256-prod-github-runner-207 kernel: [58404.555313] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 21:37:10 juju-e4d256-prod-github-runner-207 kernel: [58404.556593] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 21:37:10 juju-e4d256-prod-github-runner-207 kernel: [58404.557826] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:37:10 juju-e4d256-prod-github-runner-207 kernel: [58404.558882] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 21:37:10 juju-e4d256-prod-github-runner-207 kernel: [58404.561506] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 21:37:10 juju-e4d256-prod-github-runner-207 kernel: [58404.562577] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 21:37:10 juju-e4d256-prod-github-runner-207 kernel: [58404.563746] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 21:37:10 juju-e4d256-prod-github-runner-207 kernel: [58404.564914] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 21:37:10 juju-e4d256-prod-github-runner-207 kernel: [58404.566091] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 21:37:10 juju-e4d256-prod-github-runner-207 kernel: [58404.567264] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 21:37:10 juju-e4d256-prod-github-runner-207 kernel: [58404.568459] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 21:37:10 juju-e4d256-prod-github-runner-207 kernel: [58404.569721] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 21:37:10 juju-e4d256-prod-github-runner-207 kernel: [58404.570826] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 21:37:10 juju-e4d256-prod-github-runner-207 kernel: [58404.572022] Call Trace: Aug 22 21:37:10 juju-e4d256-prod-github-runner-207 kernel: [58404.572936] Aug 22 21:37:10 juju-e4d256-prod-github-runner-207 kernel: [58404.573842] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:37:10 juju-e4d256-prod-github-runner-207 kernel: [58404.574879] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:37:10 juju-e4d256-prod-github-runner-207 kernel: [58404.575902] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:37:10 juju-e4d256-prod-github-runner-207 kernel: [58404.577035] ? show_regs.part.0+0x23/0x29 Aug 22 21:37:10 juju-e4d256-prod-github-runner-207 kernel: [58404.578314] ? show_regs.cold+0x8/0xd Aug 22 21:37:10 juju-e4d256-prod-github-runner-207 kernel: [58404.579888] ? watchdog_timer_fn+0x1be/0x220 Aug 22 21:37:10 juju-e4d256-prod-github-runner-207 kernel: [58404.581413] ? lockup_detector_update_enable+0x60/0x60 Aug 22 21:37:10 juju-e4d256-prod-github-runner-207 kernel: [58404.583111] ? __hrtimer_run_queues+0x107/0x230 Aug 22 21:37:10 juju-e4d256-prod-github-runner-207 kernel: [58404.584730] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 21:37:10 juju-e4d256-prod-github-runner-207 kernel: [58404.586388] ? hrtimer_interrupt+0x101/0x220 Aug 22 21:37:10 juju-e4d256-prod-github-runner-207 kernel: [58404.587507] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 21:37:10 juju-e4d256-prod-github-runner-207 kernel: [58404.588583] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 21:37:10 juju-e4d256-prod-github-runner-207 kernel: [58404.589655] Aug 22 21:37:10 juju-e4d256-prod-github-runner-207 kernel: [58404.590517] Aug 22 21:37:10 juju-e4d256-prod-github-runner-207 kernel: [58404.591366] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 21:37:10 juju-e4d256-prod-github-runner-207 kernel: [58404.592960] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:37:10 juju-e4d256-prod-github-runner-207 kernel: [58404.594630] ? _raw_spin_lock+0x22/0x30 Aug 22 21:37:10 juju-e4d256-prod-github-runner-207 kernel: [58404.596105] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:37:10 juju-e4d256-prod-github-runner-207 kernel: [58404.597743] direct_page_fault+0x206/0x310 [kvm] Aug 22 21:37:10 juju-e4d256-prod-github-runner-207 kernel: [58404.599378] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 21:37:10 juju-e4d256-prod-github-runner-207 kernel: [58404.600671] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 21:37:10 juju-e4d256-prod-github-runner-207 kernel: [58404.601912] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 21:37:10 juju-e4d256-prod-github-runner-207 kernel: [58404.602895] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 21:37:10 juju-e4d256-prod-github-runner-207 kernel: [58404.603854] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 21:37:10 juju-e4d256-prod-github-runner-207 kernel: [58404.604845] handle_exit+0x98/0x230 [kvm_amd] Aug 22 21:37:10 juju-e4d256-prod-github-runner-207 kernel: [58404.605765] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 21:37:10 juju-e4d256-prod-github-runner-207 kernel: [58404.606686] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 21:37:10 juju-e4d256-prod-github-runner-207 kernel: [58404.607615] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 21:37:10 juju-e4d256-prod-github-runner-207 kernel: [58404.608533] vcpu_run+0x62/0x2c0 [kvm] Aug 22 21:37:10 juju-e4d256-prod-github-runner-207 kernel: [58404.609351] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 21:37:10 juju-e4d256-prod-github-runner-207 kernel: [58404.610181] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 21:37:10 juju-e4d256-prod-github-runner-207 kernel: [58404.611043] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 21:37:10 juju-e4d256-prod-github-runner-207 kernel: [58404.611919] ? __seccomp_filter+0x4a/0x4a0 Aug 22 21:37:10 juju-e4d256-prod-github-runner-207 kernel: [58404.612722] ? __fget_files+0x86/0xc0 Aug 22 21:37:10 juju-e4d256-prod-github-runner-207 kernel: [58404.613531] __x64_sys_ioctl+0x95/0xd0 Aug 22 21:37:10 juju-e4d256-prod-github-runner-207 kernel: [58404.614363] do_syscall_64+0x5c/0xc0 Aug 22 21:37:10 juju-e4d256-prod-github-runner-207 kernel: [58404.615144] ? do_futex+0x162/0x1f0 Aug 22 21:37:10 juju-e4d256-prod-github-runner-207 kernel: [58404.615888] ? __x64_sys_futex+0x78/0x1e0 Aug 22 21:37:10 juju-e4d256-prod-github-runner-207 kernel: [58404.616586] ? __secure_computing+0xa9/0x120 Aug 22 21:37:10 juju-e4d256-prod-github-runner-207 kernel: [58404.617279] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 21:37:10 juju-e4d256-prod-github-runner-207 kernel: [58404.618099] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:37:10 juju-e4d256-prod-github-runner-207 kernel: [58404.618831] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:37:10 juju-e4d256-prod-github-runner-207 kernel: [58404.619678] ? do_syscall_64+0x69/0xc0 Aug 22 21:37:10 juju-e4d256-prod-github-runner-207 kernel: [58404.620343] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:37:10 juju-e4d256-prod-github-runner-207 kernel: [58404.621052] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:37:10 juju-e4d256-prod-github-runner-207 kernel: [58404.621802] ? do_syscall_64+0x69/0xc0 Aug 22 21:37:10 juju-e4d256-prod-github-runner-207 kernel: [58404.622433] ? do_syscall_64+0x69/0xc0 Aug 22 21:37:10 juju-e4d256-prod-github-runner-207 kernel: [58404.623062] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 21:37:10 juju-e4d256-prod-github-runner-207 kernel: [58404.623772] RIP: 0033:0x7faa5d0edaff Aug 22 21:37:10 juju-e4d256-prod-github-runner-207 kernel: [58404.624402] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 21:37:10 juju-e4d256-prod-github-runner-207 kernel: [58404.626428] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 21:37:10 juju-e4d256-prod-github-runner-207 kernel: [58404.627343] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 21:37:10 juju-e4d256-prod-github-runner-207 kernel: [58404.628235] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 21:37:10 juju-e4d256-prod-github-runner-207 kernel: [58404.629126] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 21:37:10 juju-e4d256-prod-github-runner-207 kernel: [58404.630036] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 21:37:10 juju-e4d256-prod-github-runner-207 kernel: [58404.630931] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 21:37:10 juju-e4d256-prod-github-runner-207 kernel: [58404.631831] Aug 22 21:37:38 juju-e4d256-prod-github-runner-207 kernel: [58432.541981] watchdog: BUG: soft lockup - CPU#1 stuck for 54311s! [qemu-system-x86:6715] Aug 22 21:37:38 juju-e4d256-prod-github-runner-207 kernel: [58432.543105] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 21:37:38 juju-e4d256-prod-github-runner-207 kernel: [58432.543180] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 21:37:38 juju-e4d256-prod-github-runner-207 kernel: [58432.556887] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 21:37:38 juju-e4d256-prod-github-runner-207 kernel: [58432.559011] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 21:37:38 juju-e4d256-prod-github-runner-207 kernel: [58432.560831] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:37:38 juju-e4d256-prod-github-runner-207 kernel: [58432.562006] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 21:37:38 juju-e4d256-prod-github-runner-207 kernel: [58432.564751] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 21:37:38 juju-e4d256-prod-github-runner-207 kernel: [58432.565887] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 21:37:38 juju-e4d256-prod-github-runner-207 kernel: [58432.567097] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 21:37:38 juju-e4d256-prod-github-runner-207 kernel: [58432.568284] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 21:37:38 juju-e4d256-prod-github-runner-207 kernel: [58432.569479] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 21:37:38 juju-e4d256-prod-github-runner-207 kernel: [58432.570648] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 21:37:38 juju-e4d256-prod-github-runner-207 kernel: [58432.571835] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 21:37:38 juju-e4d256-prod-github-runner-207 kernel: [58432.573138] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 21:37:38 juju-e4d256-prod-github-runner-207 kernel: [58432.574293] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 21:37:38 juju-e4d256-prod-github-runner-207 kernel: [58432.575569] Call Trace: Aug 22 21:37:38 juju-e4d256-prod-github-runner-207 kernel: [58432.576550] Aug 22 21:37:38 juju-e4d256-prod-github-runner-207 kernel: [58432.577501] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:37:38 juju-e4d256-prod-github-runner-207 kernel: [58432.578598] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:37:38 juju-e4d256-prod-github-runner-207 kernel: [58432.579633] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:37:38 juju-e4d256-prod-github-runner-207 kernel: [58432.580710] ? show_regs.part.0+0x23/0x29 Aug 22 21:37:38 juju-e4d256-prod-github-runner-207 kernel: [58432.581736] ? show_regs.cold+0x8/0xd Aug 22 21:37:38 juju-e4d256-prod-github-runner-207 kernel: [58432.582736] ? watchdog_timer_fn+0x1be/0x220 Aug 22 21:37:38 juju-e4d256-prod-github-runner-207 kernel: [58432.583819] ? lockup_detector_update_enable+0x60/0x60 Aug 22 21:37:38 juju-e4d256-prod-github-runner-207 kernel: [58432.584967] ? __hrtimer_run_queues+0x107/0x230 Aug 22 21:37:38 juju-e4d256-prod-github-runner-207 kernel: [58432.586045] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 21:37:38 juju-e4d256-prod-github-runner-207 kernel: [58432.587098] ? hrtimer_interrupt+0x101/0x220 Aug 22 21:37:38 juju-e4d256-prod-github-runner-207 kernel: [58432.588135] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 21:37:38 juju-e4d256-prod-github-runner-207 kernel: [58432.589212] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 21:37:38 juju-e4d256-prod-github-runner-207 kernel: [58432.590284] Aug 22 21:37:38 juju-e4d256-prod-github-runner-207 kernel: [58432.591139] Aug 22 21:37:38 juju-e4d256-prod-github-runner-207 kernel: [58432.591988] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 21:37:38 juju-e4d256-prod-github-runner-207 kernel: [58432.593043] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:37:38 juju-e4d256-prod-github-runner-207 kernel: [58432.594128] ? _raw_spin_lock+0x22/0x30 Aug 22 21:37:38 juju-e4d256-prod-github-runner-207 kernel: [58432.595091] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:37:38 juju-e4d256-prod-github-runner-207 kernel: [58432.596110] direct_page_fault+0x206/0x310 [kvm] Aug 22 21:37:38 juju-e4d256-prod-github-runner-207 kernel: [58432.597140] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 21:37:38 juju-e4d256-prod-github-runner-207 kernel: [58432.598238] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 21:37:38 juju-e4d256-prod-github-runner-207 kernel: [58432.599290] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 21:37:38 juju-e4d256-prod-github-runner-207 kernel: [58432.600284] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 21:37:38 juju-e4d256-prod-github-runner-207 kernel: [58432.601248] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 21:37:38 juju-e4d256-prod-github-runner-207 kernel: [58432.602264] handle_exit+0x98/0x230 [kvm_amd] Aug 22 21:37:38 juju-e4d256-prod-github-runner-207 kernel: [58432.603187] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 21:37:38 juju-e4d256-prod-github-runner-207 kernel: [58432.604122] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 21:37:38 juju-e4d256-prod-github-runner-207 kernel: [58432.605061] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 21:37:38 juju-e4d256-prod-github-runner-207 kernel: [58432.606000] vcpu_run+0x62/0x2c0 [kvm] Aug 22 21:37:38 juju-e4d256-prod-github-runner-207 kernel: [58432.606812] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 21:37:38 juju-e4d256-prod-github-runner-207 kernel: [58432.607624] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 21:37:38 juju-e4d256-prod-github-runner-207 kernel: [58432.608497] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 21:37:38 juju-e4d256-prod-github-runner-207 kernel: [58432.609356] ? __seccomp_filter+0x4a/0x4a0 Aug 22 21:37:38 juju-e4d256-prod-github-runner-207 kernel: [58432.610109] ? __fget_files+0x86/0xc0 Aug 22 21:37:38 juju-e4d256-prod-github-runner-207 kernel: [58432.610820] __x64_sys_ioctl+0x95/0xd0 Aug 22 21:37:38 juju-e4d256-prod-github-runner-207 kernel: [58432.611513] do_syscall_64+0x5c/0xc0 Aug 22 21:37:38 juju-e4d256-prod-github-runner-207 kernel: [58432.612184] ? do_futex+0x162/0x1f0 Aug 22 21:37:38 juju-e4d256-prod-github-runner-207 kernel: [58432.612852] ? __x64_sys_futex+0x78/0x1e0 Aug 22 21:37:38 juju-e4d256-prod-github-runner-207 kernel: [58432.613545] ? __secure_computing+0xa9/0x120 Aug 22 21:37:38 juju-e4d256-prod-github-runner-207 kernel: [58432.614255] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 21:37:38 juju-e4d256-prod-github-runner-207 kernel: [58432.615020] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:37:38 juju-e4d256-prod-github-runner-207 kernel: [58432.615767] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:37:38 juju-e4d256-prod-github-runner-207 kernel: [58432.616499] ? do_syscall_64+0x69/0xc0 Aug 22 21:37:38 juju-e4d256-prod-github-runner-207 kernel: [58432.617147] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:37:38 juju-e4d256-prod-github-runner-207 kernel: [58432.617875] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:37:38 juju-e4d256-prod-github-runner-207 kernel: [58432.618592] ? do_syscall_64+0x69/0xc0 Aug 22 21:37:38 juju-e4d256-prod-github-runner-207 kernel: [58432.619236] ? do_syscall_64+0x69/0xc0 Aug 22 21:37:38 juju-e4d256-prod-github-runner-207 kernel: [58432.619869] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 21:37:38 juju-e4d256-prod-github-runner-207 kernel: [58432.620588] RIP: 0033:0x7faa5d0edaff Aug 22 21:37:38 juju-e4d256-prod-github-runner-207 kernel: [58432.621234] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 21:37:38 juju-e4d256-prod-github-runner-207 kernel: [58432.623347] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 21:37:38 juju-e4d256-prod-github-runner-207 kernel: [58432.624288] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 21:37:38 juju-e4d256-prod-github-runner-207 kernel: [58432.625197] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 21:37:38 juju-e4d256-prod-github-runner-207 kernel: [58432.626130] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 21:37:38 juju-e4d256-prod-github-runner-207 kernel: [58432.627082] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 21:37:38 juju-e4d256-prod-github-runner-207 kernel: [58432.628088] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 21:37:38 juju-e4d256-prod-github-runner-207 kernel: [58432.629133] Aug 22 21:38:06 juju-e4d256-prod-github-runner-207 kernel: [58460.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 54337s! [qemu-system-x86:6715] Aug 22 21:38:06 juju-e4d256-prod-github-runner-207 kernel: [58460.543134] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 21:38:06 juju-e4d256-prod-github-runner-207 kernel: [58460.543207] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 21:38:06 juju-e4d256-prod-github-runner-207 kernel: [58460.555540] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 21:38:06 juju-e4d256-prod-github-runner-207 kernel: [58460.556901] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 21:38:06 juju-e4d256-prod-github-runner-207 kernel: [58460.558380] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:38:06 juju-e4d256-prod-github-runner-207 kernel: [58460.559459] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 21:38:06 juju-e4d256-prod-github-runner-207 kernel: [58460.562446] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 21:38:06 juju-e4d256-prod-github-runner-207 kernel: [58460.563505] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 21:38:06 juju-e4d256-prod-github-runner-207 kernel: [58460.564688] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 21:38:06 juju-e4d256-prod-github-runner-207 kernel: [58460.565878] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 21:38:06 juju-e4d256-prod-github-runner-207 kernel: [58460.567057] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 21:38:06 juju-e4d256-prod-github-runner-207 kernel: [58460.568246] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 21:38:06 juju-e4d256-prod-github-runner-207 kernel: [58460.569823] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 21:38:06 juju-e4d256-prod-github-runner-207 kernel: [58460.571089] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 21:38:06 juju-e4d256-prod-github-runner-207 kernel: [58460.572211] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 21:38:06 juju-e4d256-prod-github-runner-207 kernel: [58460.573450] Call Trace: Aug 22 21:38:06 juju-e4d256-prod-github-runner-207 kernel: [58460.574368] Aug 22 21:38:06 juju-e4d256-prod-github-runner-207 kernel: [58460.575257] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:38:06 juju-e4d256-prod-github-runner-207 kernel: [58460.576301] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:38:06 juju-e4d256-prod-github-runner-207 kernel: [58460.577377] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:38:06 juju-e4d256-prod-github-runner-207 kernel: [58460.578473] ? show_regs.part.0+0x23/0x29 Aug 22 21:38:06 juju-e4d256-prod-github-runner-207 kernel: [58460.579484] ? show_regs.cold+0x8/0xd Aug 22 21:38:06 juju-e4d256-prod-github-runner-207 kernel: [58460.580464] ? watchdog_timer_fn+0x1be/0x220 Aug 22 21:38:06 juju-e4d256-prod-github-runner-207 kernel: [58460.581498] ? lockup_detector_update_enable+0x60/0x60 Aug 22 21:38:06 juju-e4d256-prod-github-runner-207 kernel: [58460.582571] ? __hrtimer_run_queues+0x107/0x230 Aug 22 21:38:06 juju-e4d256-prod-github-runner-207 kernel: [58460.583633] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 21:38:06 juju-e4d256-prod-github-runner-207 kernel: [58460.584690] ? hrtimer_interrupt+0x101/0x220 Aug 22 21:38:06 juju-e4d256-prod-github-runner-207 kernel: [58460.585727] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 21:38:06 juju-e4d256-prod-github-runner-207 kernel: [58460.586815] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 21:38:06 juju-e4d256-prod-github-runner-207 kernel: [58460.587866] Aug 22 21:38:06 juju-e4d256-prod-github-runner-207 kernel: [58460.588728] Aug 22 21:38:06 juju-e4d256-prod-github-runner-207 kernel: [58460.589599] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 21:38:06 juju-e4d256-prod-github-runner-207 kernel: [58460.590640] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:38:06 juju-e4d256-prod-github-runner-207 kernel: [58460.591687] ? _raw_spin_lock+0x22/0x30 Aug 22 21:38:06 juju-e4d256-prod-github-runner-207 kernel: [58460.592637] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:38:06 juju-e4d256-prod-github-runner-207 kernel: [58460.593700] direct_page_fault+0x206/0x310 [kvm] Aug 22 21:38:06 juju-e4d256-prod-github-runner-207 kernel: [58460.594809] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 21:38:06 juju-e4d256-prod-github-runner-207 kernel: [58460.595931] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 21:38:06 juju-e4d256-prod-github-runner-207 kernel: [58460.596954] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 21:38:06 juju-e4d256-prod-github-runner-207 kernel: [58460.597963] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 21:38:06 juju-e4d256-prod-github-runner-207 kernel: [58460.598930] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 21:38:06 juju-e4d256-prod-github-runner-207 kernel: [58460.599929] handle_exit+0x98/0x230 [kvm_amd] Aug 22 21:38:06 juju-e4d256-prod-github-runner-207 kernel: [58460.600831] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 21:38:06 juju-e4d256-prod-github-runner-207 kernel: [58460.601774] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 21:38:06 juju-e4d256-prod-github-runner-207 kernel: [58460.602711] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 21:38:06 juju-e4d256-prod-github-runner-207 kernel: [58460.603626] vcpu_run+0x62/0x2c0 [kvm] Aug 22 21:38:06 juju-e4d256-prod-github-runner-207 kernel: [58460.604455] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 21:38:06 juju-e4d256-prod-github-runner-207 kernel: [58460.605310] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 21:38:06 juju-e4d256-prod-github-runner-207 kernel: [58460.606180] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 21:38:06 juju-e4d256-prod-github-runner-207 kernel: [58460.606990] ? __seccomp_filter+0x4a/0x4a0 Aug 22 21:38:06 juju-e4d256-prod-github-runner-207 kernel: [58460.607742] ? __fget_files+0x86/0xc0 Aug 22 21:38:06 juju-e4d256-prod-github-runner-207 kernel: [58460.608455] __x64_sys_ioctl+0x95/0xd0 Aug 22 21:38:06 juju-e4d256-prod-github-runner-207 kernel: [58460.609173] do_syscall_64+0x5c/0xc0 Aug 22 21:38:06 juju-e4d256-prod-github-runner-207 kernel: [58460.609854] ? do_futex+0x162/0x1f0 Aug 22 21:38:06 juju-e4d256-prod-github-runner-207 kernel: [58460.610511] ? __x64_sys_futex+0x78/0x1e0 Aug 22 21:38:06 juju-e4d256-prod-github-runner-207 kernel: [58460.611194] ? __secure_computing+0xa9/0x120 Aug 22 21:38:06 juju-e4d256-prod-github-runner-207 kernel: [58460.611895] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 21:38:06 juju-e4d256-prod-github-runner-207 kernel: [58460.612671] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:38:06 juju-e4d256-prod-github-runner-207 kernel: [58460.613492] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:38:06 juju-e4d256-prod-github-runner-207 kernel: [58460.614231] ? do_syscall_64+0x69/0xc0 Aug 22 21:38:06 juju-e4d256-prod-github-runner-207 kernel: [58460.614889] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:38:06 juju-e4d256-prod-github-runner-207 kernel: [58460.615604] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:38:06 juju-e4d256-prod-github-runner-207 kernel: [58460.616309] ? do_syscall_64+0x69/0xc0 Aug 22 21:38:06 juju-e4d256-prod-github-runner-207 kernel: [58460.616948] ? do_syscall_64+0x69/0xc0 Aug 22 21:38:06 juju-e4d256-prod-github-runner-207 kernel: [58460.617589] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 21:38:06 juju-e4d256-prod-github-runner-207 kernel: [58460.618307] RIP: 0033:0x7faa5d0edaff Aug 22 21:38:06 juju-e4d256-prod-github-runner-207 kernel: [58460.618946] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 21:38:06 juju-e4d256-prod-github-runner-207 kernel: [58460.621047] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 21:38:06 juju-e4d256-prod-github-runner-207 kernel: [58460.621970] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 21:38:06 juju-e4d256-prod-github-runner-207 kernel: [58460.622877] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 21:38:06 juju-e4d256-prod-github-runner-207 kernel: [58460.623781] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 21:38:06 juju-e4d256-prod-github-runner-207 kernel: [58460.624691] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 21:38:06 juju-e4d256-prod-github-runner-207 kernel: [58460.625606] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 21:38:06 juju-e4d256-prod-github-runner-207 kernel: [58460.626510] Aug 22 21:38:34 juju-e4d256-prod-github-runner-207 kernel: [58488.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 54363s! [qemu-system-x86:6715] Aug 22 21:38:34 juju-e4d256-prod-github-runner-207 kernel: [58488.543878] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 21:38:34 juju-e4d256-prod-github-runner-207 kernel: [58488.544186] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 21:38:34 juju-e4d256-prod-github-runner-207 kernel: [58488.556298] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 21:38:34 juju-e4d256-prod-github-runner-207 kernel: [58488.557584] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 21:38:34 juju-e4d256-prod-github-runner-207 kernel: [58488.558800] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:38:34 juju-e4d256-prod-github-runner-207 kernel: [58488.559860] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 21:38:34 juju-e4d256-prod-github-runner-207 kernel: [58488.562412] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 21:38:34 juju-e4d256-prod-github-runner-207 kernel: [58488.563451] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 21:38:34 juju-e4d256-prod-github-runner-207 kernel: [58488.564613] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 21:38:34 juju-e4d256-prod-github-runner-207 kernel: [58488.565776] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 21:38:34 juju-e4d256-prod-github-runner-207 kernel: [58488.566934] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 21:38:34 juju-e4d256-prod-github-runner-207 kernel: [58488.568098] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 21:38:34 juju-e4d256-prod-github-runner-207 kernel: [58488.569268] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 21:38:34 juju-e4d256-prod-github-runner-207 kernel: [58488.570502] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 21:38:34 juju-e4d256-prod-github-runner-207 kernel: [58488.571600] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 21:38:34 juju-e4d256-prod-github-runner-207 kernel: [58488.572803] Call Trace: Aug 22 21:38:34 juju-e4d256-prod-github-runner-207 kernel: [58488.573715] Aug 22 21:38:34 juju-e4d256-prod-github-runner-207 kernel: [58488.574612] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:38:34 juju-e4d256-prod-github-runner-207 kernel: [58488.575641] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:38:34 juju-e4d256-prod-github-runner-207 kernel: [58488.576677] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:38:34 juju-e4d256-prod-github-runner-207 kernel: [58488.577777] ? show_regs.part.0+0x23/0x29 Aug 22 21:38:34 juju-e4d256-prod-github-runner-207 kernel: [58488.578772] ? show_regs.cold+0x8/0xd Aug 22 21:38:34 juju-e4d256-prod-github-runner-207 kernel: [58488.579746] ? watchdog_timer_fn+0x1be/0x220 Aug 22 21:38:34 juju-e4d256-prod-github-runner-207 kernel: [58488.580758] ? lockup_detector_update_enable+0x60/0x60 Aug 22 21:38:34 juju-e4d256-prod-github-runner-207 kernel: [58488.581828] ? __hrtimer_run_queues+0x107/0x230 Aug 22 21:38:34 juju-e4d256-prod-github-runner-207 kernel: [58488.582864] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 21:38:34 juju-e4d256-prod-github-runner-207 kernel: [58488.583886] ? hrtimer_interrupt+0x101/0x220 Aug 22 21:38:34 juju-e4d256-prod-github-runner-207 kernel: [58488.584913] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 21:38:34 juju-e4d256-prod-github-runner-207 kernel: [58488.586050] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 21:38:34 juju-e4d256-prod-github-runner-207 kernel: [58488.587157] Aug 22 21:38:34 juju-e4d256-prod-github-runner-207 kernel: [58488.588011] Aug 22 21:38:34 juju-e4d256-prod-github-runner-207 kernel: [58488.588881] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 21:38:34 juju-e4d256-prod-github-runner-207 kernel: [58488.589949] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:38:34 juju-e4d256-prod-github-runner-207 kernel: [58488.590988] ? _raw_spin_lock+0x22/0x30 Aug 22 21:38:34 juju-e4d256-prod-github-runner-207 kernel: [58488.591930] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:38:34 juju-e4d256-prod-github-runner-207 kernel: [58488.592972] direct_page_fault+0x206/0x310 [kvm] Aug 22 21:38:34 juju-e4d256-prod-github-runner-207 kernel: [58488.594150] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 21:38:34 juju-e4d256-prod-github-runner-207 kernel: [58488.595161] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 21:38:34 juju-e4d256-prod-github-runner-207 kernel: [58488.596165] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 21:38:34 juju-e4d256-prod-github-runner-207 kernel: [58488.597288] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 21:38:34 juju-e4d256-prod-github-runner-207 kernel: [58488.598258] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 21:38:34 juju-e4d256-prod-github-runner-207 kernel: [58488.599238] handle_exit+0x98/0x230 [kvm_amd] Aug 22 21:38:34 juju-e4d256-prod-github-runner-207 kernel: [58488.600130] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 21:38:34 juju-e4d256-prod-github-runner-207 kernel: [58488.601093] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 21:38:34 juju-e4d256-prod-github-runner-207 kernel: [58488.602019] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 21:38:34 juju-e4d256-prod-github-runner-207 kernel: [58488.602925] vcpu_run+0x62/0x2c0 [kvm] Aug 22 21:38:34 juju-e4d256-prod-github-runner-207 kernel: [58488.603735] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 21:38:34 juju-e4d256-prod-github-runner-207 kernel: [58488.604546] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 21:38:34 juju-e4d256-prod-github-runner-207 kernel: [58488.605429] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 21:38:34 juju-e4d256-prod-github-runner-207 kernel: [58488.606223] ? __seccomp_filter+0x4a/0x4a0 Aug 22 21:38:34 juju-e4d256-prod-github-runner-207 kernel: [58488.606974] ? __fget_files+0x86/0xc0 Aug 22 21:38:34 juju-e4d256-prod-github-runner-207 kernel: [58488.607686] __x64_sys_ioctl+0x95/0xd0 Aug 22 21:38:34 juju-e4d256-prod-github-runner-207 kernel: [58488.608382] do_syscall_64+0x5c/0xc0 Aug 22 21:38:34 juju-e4d256-prod-github-runner-207 kernel: [58488.609055] ? do_futex+0x162/0x1f0 Aug 22 21:38:34 juju-e4d256-prod-github-runner-207 kernel: [58488.609703] ? __x64_sys_futex+0x78/0x1e0 Aug 22 21:38:34 juju-e4d256-prod-github-runner-207 kernel: [58488.610376] ? __secure_computing+0xa9/0x120 Aug 22 21:38:34 juju-e4d256-prod-github-runner-207 kernel: [58488.611065] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 21:38:34 juju-e4d256-prod-github-runner-207 kernel: [58488.611845] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:38:34 juju-e4d256-prod-github-runner-207 kernel: [58488.612570] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:38:34 juju-e4d256-prod-github-runner-207 kernel: [58488.613309] ? do_syscall_64+0x69/0xc0 Aug 22 21:38:34 juju-e4d256-prod-github-runner-207 kernel: [58488.613954] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:38:34 juju-e4d256-prod-github-runner-207 kernel: [58488.614658] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:38:34 juju-e4d256-prod-github-runner-207 kernel: [58488.615353] ? do_syscall_64+0x69/0xc0 Aug 22 21:38:34 juju-e4d256-prod-github-runner-207 kernel: [58488.615975] ? do_syscall_64+0x69/0xc0 Aug 22 21:38:34 juju-e4d256-prod-github-runner-207 kernel: [58488.616595] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 21:38:34 juju-e4d256-prod-github-runner-207 kernel: [58488.617309] RIP: 0033:0x7faa5d0edaff Aug 22 21:38:34 juju-e4d256-prod-github-runner-207 kernel: [58488.617976] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 21:38:34 juju-e4d256-prod-github-runner-207 kernel: [58488.619993] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 21:38:34 juju-e4d256-prod-github-runner-207 kernel: [58488.620912] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 21:38:34 juju-e4d256-prod-github-runner-207 kernel: [58488.621821] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 21:38:34 juju-e4d256-prod-github-runner-207 kernel: [58488.622721] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 21:38:34 juju-e4d256-prod-github-runner-207 kernel: [58488.623608] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 21:38:34 juju-e4d256-prod-github-runner-207 kernel: [58488.624501] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 21:38:34 juju-e4d256-prod-github-runner-207 kernel: [58488.625407] Aug 22 21:38:47 juju-e4d256-prod-github-runner-207 kernel: [58501.088708] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 21:38:47 juju-e4d256-prod-github-runner-207 kernel: [58501.089754] rcu: 1-....: (14550038 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=7031708 Aug 22 21:38:47 juju-e4d256-prod-github-runner-207 kernel: [58501.090934] (t=14595972 jiffies g=23269 q=53023) Aug 22 21:38:47 juju-e4d256-prod-github-runner-207 kernel: [58501.091777] NMI backtrace for cpu 1 Aug 22 21:38:47 juju-e4d256-prod-github-runner-207 kernel: [58501.092555] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 21:38:47 juju-e4d256-prod-github-runner-207 kernel: [58501.093725] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 21:38:47 juju-e4d256-prod-github-runner-207 kernel: [58501.094842] Call Trace: Aug 22 21:38:47 juju-e4d256-prod-github-runner-207 kernel: [58501.095561] Aug 22 21:38:47 juju-e4d256-prod-github-runner-207 kernel: [58501.096254] show_stack+0x52/0x5c Aug 22 21:38:47 juju-e4d256-prod-github-runner-207 kernel: [58501.097044] dump_stack_lvl+0x4a/0x63 Aug 22 21:38:47 juju-e4d256-prod-github-runner-207 kernel: [58501.097848] dump_stack+0x10/0x16 Aug 22 21:38:47 juju-e4d256-prod-github-runner-207 kernel: [58501.098607] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 21:38:47 juju-e4d256-prod-github-runner-207 kernel: [58501.099435] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 21:38:47 juju-e4d256-prod-github-runner-207 kernel: [58501.100251] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 21:38:47 juju-e4d256-prod-github-runner-207 kernel: [58501.101128] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 21:38:47 juju-e4d256-prod-github-runner-207 kernel: [58501.102009] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 21:38:47 juju-e4d256-prod-github-runner-207 kernel: [58501.102861] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 21:38:47 juju-e4d256-prod-github-runner-207 kernel: [58501.103680] print_cpu_stall.cold+0x2f/0xe2 Aug 22 21:38:47 juju-e4d256-prod-github-runner-207 kernel: [58501.104496] ? timekeeping_update+0xf7/0x150 Aug 22 21:38:47 juju-e4d256-prod-github-runner-207 kernel: [58501.105330] check_cpu_stall+0x109/0x270 Aug 22 21:38:47 juju-e4d256-prod-github-runner-207 kernel: [58501.106123] rcu_sched_clock_irq+0x9a/0x250 Aug 22 21:38:47 juju-e4d256-prod-github-runner-207 kernel: [58501.106945] update_process_times+0x94/0xd0 Aug 22 21:38:47 juju-e4d256-prod-github-runner-207 kernel: [58501.107770] tick_sched_handle+0x29/0x70 Aug 22 21:38:47 juju-e4d256-prod-github-runner-207 kernel: [58501.108597] tick_sched_timer+0x8c/0xc0 Aug 22 21:38:47 juju-e4d256-prod-github-runner-207 kernel: [58501.109394] ? tick_nohz_handler+0xb0/0xb0 Aug 22 21:38:47 juju-e4d256-prod-github-runner-207 kernel: [58501.110199] __hrtimer_run_queues+0x107/0x230 Aug 22 21:38:47 juju-e4d256-prod-github-runner-207 kernel: [58501.111028] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 21:38:47 juju-e4d256-prod-github-runner-207 kernel: [58501.111864] hrtimer_interrupt+0x101/0x220 Aug 22 21:38:47 juju-e4d256-prod-github-runner-207 kernel: [58501.112699] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 21:38:47 juju-e4d256-prod-github-runner-207 kernel: [58501.113561] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 21:38:47 juju-e4d256-prod-github-runner-207 kernel: [58501.114423] Aug 22 21:38:47 juju-e4d256-prod-github-runner-207 kernel: [58501.115085] Aug 22 21:38:47 juju-e4d256-prod-github-runner-207 kernel: [58501.115759] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 21:38:47 juju-e4d256-prod-github-runner-207 kernel: [58501.116652] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:38:47 juju-e4d256-prod-github-runner-207 kernel: [58501.117602] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 21:38:47 juju-e4d256-prod-github-runner-207 kernel: [58501.119963] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 21:38:47 juju-e4d256-prod-github-runner-207 kernel: [58501.120942] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 21:38:47 juju-e4d256-prod-github-runner-207 kernel: [58501.122021] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 21:38:47 juju-e4d256-prod-github-runner-207 kernel: [58501.123068] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 21:38:47 juju-e4d256-prod-github-runner-207 kernel: [58501.124093] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 21:38:47 juju-e4d256-prod-github-runner-207 kernel: [58501.125124] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 21:38:47 juju-e4d256-prod-github-runner-207 kernel: [58501.126158] ? _raw_spin_lock+0x22/0x30 Aug 22 21:38:47 juju-e4d256-prod-github-runner-207 kernel: [58501.126968] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:38:47 juju-e4d256-prod-github-runner-207 kernel: [58501.127862] direct_page_fault+0x206/0x310 [kvm] Aug 22 21:38:47 juju-e4d256-prod-github-runner-207 kernel: [58501.128773] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 21:38:47 juju-e4d256-prod-github-runner-207 kernel: [58501.129652] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 21:38:47 juju-e4d256-prod-github-runner-207 kernel: [58501.130501] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 21:38:47 juju-e4d256-prod-github-runner-207 kernel: [58501.131369] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 21:38:47 juju-e4d256-prod-github-runner-207 kernel: [58501.132191] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 21:38:47 juju-e4d256-prod-github-runner-207 kernel: [58501.133108] handle_exit+0x98/0x230 [kvm_amd] Aug 22 21:38:47 juju-e4d256-prod-github-runner-207 kernel: [58501.133914] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 21:38:47 juju-e4d256-prod-github-runner-207 kernel: [58501.134764] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 21:38:47 juju-e4d256-prod-github-runner-207 kernel: [58501.135621] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 21:38:47 juju-e4d256-prod-github-runner-207 kernel: [58501.136434] vcpu_run+0x62/0x2c0 [kvm] Aug 22 21:38:47 juju-e4d256-prod-github-runner-207 kernel: [58501.137197] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 21:38:47 juju-e4d256-prod-github-runner-207 kernel: [58501.137988] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 21:38:47 juju-e4d256-prod-github-runner-207 kernel: [58501.138859] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 21:38:47 juju-e4d256-prod-github-runner-207 kernel: [58501.139656] ? __seccomp_filter+0x4a/0x4a0 Aug 22 21:38:47 juju-e4d256-prod-github-runner-207 kernel: [58501.140421] ? __fget_files+0x86/0xc0 Aug 22 21:38:47 juju-e4d256-prod-github-runner-207 kernel: [58501.141192] __x64_sys_ioctl+0x95/0xd0 Aug 22 21:38:47 juju-e4d256-prod-github-runner-207 kernel: [58501.141930] do_syscall_64+0x5c/0xc0 Aug 22 21:38:47 juju-e4d256-prod-github-runner-207 kernel: [58501.142661] ? do_futex+0x162/0x1f0 Aug 22 21:38:47 juju-e4d256-prod-github-runner-207 kernel: [58501.143382] ? __x64_sys_futex+0x78/0x1e0 Aug 22 21:38:47 juju-e4d256-prod-github-runner-207 kernel: [58501.144140] ? __secure_computing+0xa9/0x120 Aug 22 21:38:47 juju-e4d256-prod-github-runner-207 kernel: [58501.144930] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 21:38:47 juju-e4d256-prod-github-runner-207 kernel: [58501.145976] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:38:47 juju-e4d256-prod-github-runner-207 kernel: [58501.146783] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:38:47 juju-e4d256-prod-github-runner-207 kernel: [58501.147583] ? do_syscall_64+0x69/0xc0 Aug 22 21:38:47 juju-e4d256-prod-github-runner-207 kernel: [58501.148321] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:38:47 juju-e4d256-prod-github-runner-207 kernel: [58501.149145] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:38:47 juju-e4d256-prod-github-runner-207 kernel: [58501.149946] ? do_syscall_64+0x69/0xc0 Aug 22 21:38:47 juju-e4d256-prod-github-runner-207 kernel: [58501.150679] ? do_syscall_64+0x69/0xc0 Aug 22 21:38:47 juju-e4d256-prod-github-runner-207 kernel: [58501.151425] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 21:38:47 juju-e4d256-prod-github-runner-207 kernel: [58501.152242] RIP: 0033:0x7faa5d0edaff Aug 22 21:38:47 juju-e4d256-prod-github-runner-207 kernel: [58501.152995] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 21:38:47 juju-e4d256-prod-github-runner-207 kernel: [58501.155242] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 21:38:47 juju-e4d256-prod-github-runner-207 kernel: [58501.156266] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 21:38:47 juju-e4d256-prod-github-runner-207 kernel: [58501.157303] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 21:38:47 juju-e4d256-prod-github-runner-207 kernel: [58501.158303] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 21:38:47 juju-e4d256-prod-github-runner-207 kernel: [58501.159249] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 21:38:47 juju-e4d256-prod-github-runner-207 kernel: [58501.160182] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 21:38:47 juju-e4d256-prod-github-runner-207 kernel: [58501.161117] Aug 22 21:39:14 juju-e4d256-prod-github-runner-207 kernel: [58528.541980] watchdog: BUG: soft lockup - CPU#1 stuck for 54400s! [qemu-system-x86:6715] Aug 22 21:39:14 juju-e4d256-prod-github-runner-207 kernel: [58528.543858] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 21:39:14 juju-e4d256-prod-github-runner-207 kernel: [58528.543936] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 21:39:14 juju-e4d256-prod-github-runner-207 kernel: [58528.558135] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 21:39:14 juju-e4d256-prod-github-runner-207 kernel: [58528.559400] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 21:39:14 juju-e4d256-prod-github-runner-207 kernel: [58528.560633] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:39:14 juju-e4d256-prod-github-runner-207 kernel: [58528.561692] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 21:39:14 juju-e4d256-prod-github-runner-207 kernel: [58528.564274] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 21:39:14 juju-e4d256-prod-github-runner-207 kernel: [58528.565325] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 21:39:14 juju-e4d256-prod-github-runner-207 kernel: [58528.566491] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 21:39:14 juju-e4d256-prod-github-runner-207 kernel: [58528.567655] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 21:39:14 juju-e4d256-prod-github-runner-207 kernel: [58528.568836] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 21:39:14 juju-e4d256-prod-github-runner-207 kernel: [58528.569998] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 21:39:14 juju-e4d256-prod-github-runner-207 kernel: [58528.571164] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 21:39:14 juju-e4d256-prod-github-runner-207 kernel: [58528.572425] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 21:39:14 juju-e4d256-prod-github-runner-207 kernel: [58528.573617] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 21:39:14 juju-e4d256-prod-github-runner-207 kernel: [58528.574884] Call Trace: Aug 22 21:39:14 juju-e4d256-prod-github-runner-207 kernel: [58528.576023] Aug 22 21:39:14 juju-e4d256-prod-github-runner-207 kernel: [58528.576993] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:39:14 juju-e4d256-prod-github-runner-207 kernel: [58528.578119] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:39:14 juju-e4d256-prod-github-runner-207 kernel: [58528.579237] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:39:14 juju-e4d256-prod-github-runner-207 kernel: [58528.580444] ? show_regs.part.0+0x23/0x29 Aug 22 21:39:14 juju-e4d256-prod-github-runner-207 kernel: [58528.581537] ? show_regs.cold+0x8/0xd Aug 22 21:39:14 juju-e4d256-prod-github-runner-207 kernel: [58528.582599] ? watchdog_timer_fn+0x1be/0x220 Aug 22 21:39:14 juju-e4d256-prod-github-runner-207 kernel: [58528.583705] ? lockup_detector_update_enable+0x60/0x60 Aug 22 21:39:14 juju-e4d256-prod-github-runner-207 kernel: [58528.584898] ? __hrtimer_run_queues+0x107/0x230 Aug 22 21:39:14 juju-e4d256-prod-github-runner-207 kernel: [58528.586026] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 21:39:14 juju-e4d256-prod-github-runner-207 kernel: [58528.587134] ? hrtimer_interrupt+0x101/0x220 Aug 22 21:39:14 juju-e4d256-prod-github-runner-207 kernel: [58528.588254] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 21:39:14 juju-e4d256-prod-github-runner-207 kernel: [58528.589422] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 21:39:14 juju-e4d256-prod-github-runner-207 kernel: [58528.590578] Aug 22 21:39:14 juju-e4d256-prod-github-runner-207 kernel: [58528.591482] Aug 22 21:39:14 juju-e4d256-prod-github-runner-207 kernel: [58528.592387] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 21:39:14 juju-e4d256-prod-github-runner-207 kernel: [58528.593530] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:39:14 juju-e4d256-prod-github-runner-207 kernel: [58528.594681] ? _raw_spin_lock+0x22/0x30 Aug 22 21:39:14 juju-e4d256-prod-github-runner-207 kernel: [58528.595709] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:39:14 juju-e4d256-prod-github-runner-207 kernel: [58528.596835] direct_page_fault+0x206/0x310 [kvm] Aug 22 21:39:14 juju-e4d256-prod-github-runner-207 kernel: [58528.597968] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 21:39:14 juju-e4d256-prod-github-runner-207 kernel: [58528.599103] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 21:39:14 juju-e4d256-prod-github-runner-207 kernel: [58528.600289] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 21:39:14 juju-e4d256-prod-github-runner-207 kernel: [58528.601435] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 21:39:14 juju-e4d256-prod-github-runner-207 kernel: [58528.602494] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 21:39:14 juju-e4d256-prod-github-runner-207 kernel: [58528.603621] handle_exit+0x98/0x230 [kvm_amd] Aug 22 21:39:14 juju-e4d256-prod-github-runner-207 kernel: [58528.604644] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 21:39:14 juju-e4d256-prod-github-runner-207 kernel: [58528.605683] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 21:39:14 juju-e4d256-prod-github-runner-207 kernel: [58528.606724] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 21:39:14 juju-e4d256-prod-github-runner-207 kernel: [58528.607736] vcpu_run+0x62/0x2c0 [kvm] Aug 22 21:39:14 juju-e4d256-prod-github-runner-207 kernel: [58528.608654] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 21:39:14 juju-e4d256-prod-github-runner-207 kernel: [58528.609568] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 21:39:14 juju-e4d256-prod-github-runner-207 kernel: [58528.610551] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 21:39:14 juju-e4d256-prod-github-runner-207 kernel: [58528.611453] ? __seccomp_filter+0x4a/0x4a0 Aug 22 21:39:14 juju-e4d256-prod-github-runner-207 kernel: [58528.612309] ? __fget_files+0x86/0xc0 Aug 22 21:39:14 juju-e4d256-prod-github-runner-207 kernel: [58528.613111] __x64_sys_ioctl+0x95/0xd0 Aug 22 21:39:14 juju-e4d256-prod-github-runner-207 kernel: [58528.613894] do_syscall_64+0x5c/0xc0 Aug 22 21:39:14 juju-e4d256-prod-github-runner-207 kernel: [58528.614656] ? do_futex+0x162/0x1f0 Aug 22 21:39:14 juju-e4d256-prod-github-runner-207 kernel: [58528.615389] ? __x64_sys_futex+0x78/0x1e0 Aug 22 21:39:14 juju-e4d256-prod-github-runner-207 kernel: [58528.616168] ? __secure_computing+0xa9/0x120 Aug 22 21:39:14 juju-e4d256-prod-github-runner-207 kernel: [58528.616964] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 21:39:14 juju-e4d256-prod-github-runner-207 kernel: [58528.617828] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:39:14 juju-e4d256-prod-github-runner-207 kernel: [58528.618649] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:39:14 juju-e4d256-prod-github-runner-207 kernel: [58528.619459] ? do_syscall_64+0x69/0xc0 Aug 22 21:39:14 juju-e4d256-prod-github-runner-207 kernel: [58528.620208] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:39:14 juju-e4d256-prod-github-runner-207 kernel: [58528.621015] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:39:14 juju-e4d256-prod-github-runner-207 kernel: [58528.621822] ? do_syscall_64+0x69/0xc0 Aug 22 21:39:14 juju-e4d256-prod-github-runner-207 kernel: [58528.622544] ? do_syscall_64+0x69/0xc0 Aug 22 21:39:14 juju-e4d256-prod-github-runner-207 kernel: [58528.623248] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 21:39:14 juju-e4d256-prod-github-runner-207 kernel: [58528.624054] RIP: 0033:0x7faa5d0edaff Aug 22 21:39:14 juju-e4d256-prod-github-runner-207 kernel: [58528.624774] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 21:39:14 juju-e4d256-prod-github-runner-207 kernel: [58528.627093] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 21:39:14 juju-e4d256-prod-github-runner-207 kernel: [58528.628152] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 21:39:14 juju-e4d256-prod-github-runner-207 kernel: [58528.629206] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 21:39:14 juju-e4d256-prod-github-runner-207 kernel: [58528.630244] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 21:39:14 juju-e4d256-prod-github-runner-207 kernel: [58528.631274] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 21:39:14 juju-e4d256-prod-github-runner-207 kernel: [58528.632310] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 21:39:14 juju-e4d256-prod-github-runner-207 kernel: [58528.633335] Aug 22 21:39:42 juju-e4d256-prod-github-runner-207 kernel: [58556.542003] watchdog: BUG: soft lockup - CPU#1 stuck for 54427s! [qemu-system-x86:6715] Aug 22 21:39:42 juju-e4d256-prod-github-runner-207 kernel: [58556.543200] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 21:39:42 juju-e4d256-prod-github-runner-207 kernel: [58556.543434] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 21:39:42 juju-e4d256-prod-github-runner-207 kernel: [58556.555713] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 21:39:42 juju-e4d256-prod-github-runner-207 kernel: [58556.557201] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 21:39:42 juju-e4d256-prod-github-runner-207 kernel: [58556.558481] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:39:42 juju-e4d256-prod-github-runner-207 kernel: [58556.559576] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 21:39:42 juju-e4d256-prod-github-runner-207 kernel: [58556.562198] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 21:39:42 juju-e4d256-prod-github-runner-207 kernel: [58556.563264] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 21:39:42 juju-e4d256-prod-github-runner-207 kernel: [58556.564473] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 21:39:42 juju-e4d256-prod-github-runner-207 kernel: [58556.565646] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 21:39:42 juju-e4d256-prod-github-runner-207 kernel: [58556.566815] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 21:39:42 juju-e4d256-prod-github-runner-207 kernel: [58556.568020] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 21:39:42 juju-e4d256-prod-github-runner-207 kernel: [58556.569202] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 21:39:42 juju-e4d256-prod-github-runner-207 kernel: [58556.570449] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 21:39:42 juju-e4d256-prod-github-runner-207 kernel: [58556.571565] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 21:39:42 juju-e4d256-prod-github-runner-207 kernel: [58556.572804] Call Trace: Aug 22 21:39:42 juju-e4d256-prod-github-runner-207 kernel: [58556.573733] Aug 22 21:39:42 juju-e4d256-prod-github-runner-207 kernel: [58556.574628] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:39:42 juju-e4d256-prod-github-runner-207 kernel: [58556.575673] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:39:42 juju-e4d256-prod-github-runner-207 kernel: [58556.576733] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:39:42 juju-e4d256-prod-github-runner-207 kernel: [58556.577991] ? show_regs.part.0+0x23/0x29 Aug 22 21:39:42 juju-e4d256-prod-github-runner-207 kernel: [58556.579019] ? show_regs.cold+0x8/0xd Aug 22 21:39:42 juju-e4d256-prod-github-runner-207 kernel: [58556.580038] ? watchdog_timer_fn+0x1be/0x220 Aug 22 21:39:42 juju-e4d256-prod-github-runner-207 kernel: [58556.581056] ? lockup_detector_update_enable+0x60/0x60 Aug 22 21:39:42 juju-e4d256-prod-github-runner-207 kernel: [58556.582130] ? __hrtimer_run_queues+0x107/0x230 Aug 22 21:39:42 juju-e4d256-prod-github-runner-207 kernel: [58556.583170] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 21:39:42 juju-e4d256-prod-github-runner-207 kernel: [58556.584230] ? hrtimer_interrupt+0x101/0x220 Aug 22 21:39:42 juju-e4d256-prod-github-runner-207 kernel: [58556.585254] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 21:39:42 juju-e4d256-prod-github-runner-207 kernel: [58556.586331] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 21:39:42 juju-e4d256-prod-github-runner-207 kernel: [58556.587425] Aug 22 21:39:42 juju-e4d256-prod-github-runner-207 kernel: [58556.588330] Aug 22 21:39:42 juju-e4d256-prod-github-runner-207 kernel: [58556.589179] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 21:39:42 juju-e4d256-prod-github-runner-207 kernel: [58556.590216] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:39:42 juju-e4d256-prod-github-runner-207 kernel: [58556.591266] ? _raw_spin_lock+0x22/0x30 Aug 22 21:39:42 juju-e4d256-prod-github-runner-207 kernel: [58556.592303] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:39:42 juju-e4d256-prod-github-runner-207 kernel: [58556.593337] direct_page_fault+0x206/0x310 [kvm] Aug 22 21:39:42 juju-e4d256-prod-github-runner-207 kernel: [58556.594437] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 21:39:42 juju-e4d256-prod-github-runner-207 kernel: [58556.595479] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 21:39:42 juju-e4d256-prod-github-runner-207 kernel: [58556.596534] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 21:39:42 juju-e4d256-prod-github-runner-207 kernel: [58556.597576] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 21:39:42 juju-e4d256-prod-github-runner-207 kernel: [58556.598549] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 21:39:42 juju-e4d256-prod-github-runner-207 kernel: [58556.599555] handle_exit+0x98/0x230 [kvm_amd] Aug 22 21:39:42 juju-e4d256-prod-github-runner-207 kernel: [58556.600485] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 21:39:42 juju-e4d256-prod-github-runner-207 kernel: [58556.601436] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 21:39:42 juju-e4d256-prod-github-runner-207 kernel: [58556.602371] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 21:39:42 juju-e4d256-prod-github-runner-207 kernel: [58556.603287] vcpu_run+0x62/0x2c0 [kvm] Aug 22 21:39:42 juju-e4d256-prod-github-runner-207 kernel: [58556.604156] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 21:39:42 juju-e4d256-prod-github-runner-207 kernel: [58556.604977] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 21:39:42 juju-e4d256-prod-github-runner-207 kernel: [58556.605845] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 21:39:42 juju-e4d256-prod-github-runner-207 kernel: [58556.606667] ? __seccomp_filter+0x4a/0x4a0 Aug 22 21:39:42 juju-e4d256-prod-github-runner-207 kernel: [58556.607466] ? __fget_files+0x86/0xc0 Aug 22 21:39:42 juju-e4d256-prod-github-runner-207 kernel: [58556.608214] __x64_sys_ioctl+0x95/0xd0 Aug 22 21:39:42 juju-e4d256-prod-github-runner-207 kernel: [58556.608917] do_syscall_64+0x5c/0xc0 Aug 22 21:39:42 juju-e4d256-prod-github-runner-207 kernel: [58556.609586] ? do_futex+0x162/0x1f0 Aug 22 21:39:42 juju-e4d256-prod-github-runner-207 kernel: [58556.610235] ? __x64_sys_futex+0x78/0x1e0 Aug 22 21:39:42 juju-e4d256-prod-github-runner-207 kernel: [58556.610909] ? __secure_computing+0xa9/0x120 Aug 22 21:39:42 juju-e4d256-prod-github-runner-207 kernel: [58556.611621] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 21:39:42 juju-e4d256-prod-github-runner-207 kernel: [58556.612416] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:39:42 juju-e4d256-prod-github-runner-207 kernel: [58556.613148] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:39:42 juju-e4d256-prod-github-runner-207 kernel: [58556.613876] ? do_syscall_64+0x69/0xc0 Aug 22 21:39:42 juju-e4d256-prod-github-runner-207 kernel: [58556.614598] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:39:42 juju-e4d256-prod-github-runner-207 kernel: [58556.615323] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:39:42 juju-e4d256-prod-github-runner-207 kernel: [58556.616051] ? do_syscall_64+0x69/0xc0 Aug 22 21:39:42 juju-e4d256-prod-github-runner-207 kernel: [58556.616684] ? do_syscall_64+0x69/0xc0 Aug 22 21:39:42 juju-e4d256-prod-github-runner-207 kernel: [58556.617309] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 21:39:42 juju-e4d256-prod-github-runner-207 kernel: [58556.618029] RIP: 0033:0x7faa5d0edaff Aug 22 21:39:42 juju-e4d256-prod-github-runner-207 kernel: [58556.618700] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 21:39:42 juju-e4d256-prod-github-runner-207 kernel: [58556.620968] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 21:39:42 juju-e4d256-prod-github-runner-207 kernel: [58556.622132] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 21:39:42 juju-e4d256-prod-github-runner-207 kernel: [58556.623031] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 21:39:42 juju-e4d256-prod-github-runner-207 kernel: [58556.623976] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 21:39:42 juju-e4d256-prod-github-runner-207 kernel: [58556.624866] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 21:39:42 juju-e4d256-prod-github-runner-207 kernel: [58556.625793] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 21:39:42 juju-e4d256-prod-github-runner-207 kernel: [58556.626710] Aug 22 21:40:10 juju-e4d256-prod-github-runner-207 kernel: [58584.541981] watchdog: BUG: soft lockup - CPU#1 stuck for 54453s! [qemu-system-x86:6715] Aug 22 21:40:10 juju-e4d256-prod-github-runner-207 kernel: [58584.543819] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 21:40:10 juju-e4d256-prod-github-runner-207 kernel: [58584.544038] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 21:40:10 juju-e4d256-prod-github-runner-207 kernel: [58584.557078] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 21:40:10 juju-e4d256-prod-github-runner-207 kernel: [58584.558416] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 21:40:10 juju-e4d256-prod-github-runner-207 kernel: [58584.559766] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:40:10 juju-e4d256-prod-github-runner-207 kernel: [58584.560996] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 21:40:10 juju-e4d256-prod-github-runner-207 kernel: [58584.563719] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 21:40:10 juju-e4d256-prod-github-runner-207 kernel: [58584.564773] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 21:40:10 juju-e4d256-prod-github-runner-207 kernel: [58584.565941] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 21:40:10 juju-e4d256-prod-github-runner-207 kernel: [58584.567110] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 21:40:10 juju-e4d256-prod-github-runner-207 kernel: [58584.568302] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 21:40:10 juju-e4d256-prod-github-runner-207 kernel: [58584.569463] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 21:40:10 juju-e4d256-prod-github-runner-207 kernel: [58584.570645] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 21:40:10 juju-e4d256-prod-github-runner-207 kernel: [58584.571934] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 21:40:10 juju-e4d256-prod-github-runner-207 kernel: [58584.573037] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 21:40:10 juju-e4d256-prod-github-runner-207 kernel: [58584.574279] Call Trace: Aug 22 21:40:10 juju-e4d256-prod-github-runner-207 kernel: [58584.575226] Aug 22 21:40:10 juju-e4d256-prod-github-runner-207 kernel: [58584.576161] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:40:10 juju-e4d256-prod-github-runner-207 kernel: [58584.577207] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:40:10 juju-e4d256-prod-github-runner-207 kernel: [58584.578328] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:40:10 juju-e4d256-prod-github-runner-207 kernel: [58584.579431] ? show_regs.part.0+0x23/0x29 Aug 22 21:40:10 juju-e4d256-prod-github-runner-207 kernel: [58584.580491] ? show_regs.cold+0x8/0xd Aug 22 21:40:10 juju-e4d256-prod-github-runner-207 kernel: [58584.581489] ? watchdog_timer_fn+0x1be/0x220 Aug 22 21:40:10 juju-e4d256-prod-github-runner-207 kernel: [58584.582570] ? lockup_detector_update_enable+0x60/0x60 Aug 22 21:40:10 juju-e4d256-prod-github-runner-207 kernel: [58584.583667] ? __hrtimer_run_queues+0x107/0x230 Aug 22 21:40:10 juju-e4d256-prod-github-runner-207 kernel: [58584.584718] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 21:40:10 juju-e4d256-prod-github-runner-207 kernel: [58584.585749] ? hrtimer_interrupt+0x101/0x220 Aug 22 21:40:10 juju-e4d256-prod-github-runner-207 kernel: [58584.586784] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 21:40:10 juju-e4d256-prod-github-runner-207 kernel: [58584.587879] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 21:40:10 juju-e4d256-prod-github-runner-207 kernel: [58584.588940] Aug 22 21:40:10 juju-e4d256-prod-github-runner-207 kernel: [58584.589823] Aug 22 21:40:10 juju-e4d256-prod-github-runner-207 kernel: [58584.590669] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 21:40:10 juju-e4d256-prod-github-runner-207 kernel: [58584.591746] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:40:10 juju-e4d256-prod-github-runner-207 kernel: [58584.592818] ? _raw_spin_lock+0x22/0x30 Aug 22 21:40:10 juju-e4d256-prod-github-runner-207 kernel: [58584.593779] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:40:10 juju-e4d256-prod-github-runner-207 kernel: [58584.594818] direct_page_fault+0x206/0x310 [kvm] Aug 22 21:40:10 juju-e4d256-prod-github-runner-207 kernel: [58584.595911] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 21:40:10 juju-e4d256-prod-github-runner-207 kernel: [58584.596964] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 21:40:10 juju-e4d256-prod-github-runner-207 kernel: [58584.598005] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 21:40:10 juju-e4d256-prod-github-runner-207 kernel: [58584.599023] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 21:40:10 juju-e4d256-prod-github-runner-207 kernel: [58584.600034] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 21:40:10 juju-e4d256-prod-github-runner-207 kernel: [58584.601064] handle_exit+0x98/0x230 [kvm_amd] Aug 22 21:40:10 juju-e4d256-prod-github-runner-207 kernel: [58584.601966] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 21:40:10 juju-e4d256-prod-github-runner-207 kernel: [58584.602911] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 21:40:10 juju-e4d256-prod-github-runner-207 kernel: [58584.603898] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 21:40:10 juju-e4d256-prod-github-runner-207 kernel: [58584.604815] vcpu_run+0x62/0x2c0 [kvm] Aug 22 21:40:10 juju-e4d256-prod-github-runner-207 kernel: [58584.605631] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 21:40:10 juju-e4d256-prod-github-runner-207 kernel: [58584.606439] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 21:40:10 juju-e4d256-prod-github-runner-207 kernel: [58584.607355] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 21:40:10 juju-e4d256-prod-github-runner-207 kernel: [58584.608233] ? __seccomp_filter+0x4a/0x4a0 Aug 22 21:40:10 juju-e4d256-prod-github-runner-207 kernel: [58584.608984] ? __fget_files+0x86/0xc0 Aug 22 21:40:10 juju-e4d256-prod-github-runner-207 kernel: [58584.609688] __x64_sys_ioctl+0x95/0xd0 Aug 22 21:40:10 juju-e4d256-prod-github-runner-207 kernel: [58584.610405] do_syscall_64+0x5c/0xc0 Aug 22 21:40:10 juju-e4d256-prod-github-runner-207 kernel: [58584.611099] ? do_futex+0x162/0x1f0 Aug 22 21:40:10 juju-e4d256-prod-github-runner-207 kernel: [58584.611800] ? __x64_sys_futex+0x78/0x1e0 Aug 22 21:40:10 juju-e4d256-prod-github-runner-207 kernel: [58584.612495] ? __secure_computing+0xa9/0x120 Aug 22 21:40:10 juju-e4d256-prod-github-runner-207 kernel: [58584.613209] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 21:40:10 juju-e4d256-prod-github-runner-207 kernel: [58584.613991] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:40:10 juju-e4d256-prod-github-runner-207 kernel: [58584.614726] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:40:10 juju-e4d256-prod-github-runner-207 kernel: [58584.615458] ? do_syscall_64+0x69/0xc0 Aug 22 21:40:10 juju-e4d256-prod-github-runner-207 kernel: [58584.616116] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:40:10 juju-e4d256-prod-github-runner-207 kernel: [58584.616828] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:40:10 juju-e4d256-prod-github-runner-207 kernel: [58584.617554] ? do_syscall_64+0x69/0xc0 Aug 22 21:40:10 juju-e4d256-prod-github-runner-207 kernel: [58584.618177] ? do_syscall_64+0x69/0xc0 Aug 22 21:40:10 juju-e4d256-prod-github-runner-207 kernel: [58584.618799] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 21:40:10 juju-e4d256-prod-github-runner-207 kernel: [58584.619503] RIP: 0033:0x7faa5d0edaff Aug 22 21:40:10 juju-e4d256-prod-github-runner-207 kernel: [58584.620160] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 21:40:10 juju-e4d256-prod-github-runner-207 kernel: [58584.622180] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 21:40:10 juju-e4d256-prod-github-runner-207 kernel: [58584.623104] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 21:40:10 juju-e4d256-prod-github-runner-207 kernel: [58584.624020] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 21:40:10 juju-e4d256-prod-github-runner-207 kernel: [58584.624914] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 21:40:10 juju-e4d256-prod-github-runner-207 kernel: [58584.625798] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 21:40:10 juju-e4d256-prod-github-runner-207 kernel: [58584.626684] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 21:40:10 juju-e4d256-prod-github-runner-207 kernel: [58584.627598] Aug 22 21:40:38 juju-e4d256-prod-github-runner-207 kernel: [58612.541980] watchdog: BUG: soft lockup - CPU#1 stuck for 54479s! [qemu-system-x86:6715] Aug 22 21:40:38 juju-e4d256-prod-github-runner-207 kernel: [58612.543089] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 21:40:38 juju-e4d256-prod-github-runner-207 kernel: [58612.543161] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 21:40:38 juju-e4d256-prod-github-runner-207 kernel: [58612.555333] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 21:40:38 juju-e4d256-prod-github-runner-207 kernel: [58612.556593] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 21:40:38 juju-e4d256-prod-github-runner-207 kernel: [58612.557807] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:40:38 juju-e4d256-prod-github-runner-207 kernel: [58612.559036] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 21:40:38 juju-e4d256-prod-github-runner-207 kernel: [58612.561949] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 21:40:38 juju-e4d256-prod-github-runner-207 kernel: [58612.563132] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 21:40:38 juju-e4d256-prod-github-runner-207 kernel: [58612.564516] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 21:40:38 juju-e4d256-prod-github-runner-207 kernel: [58612.565816] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 21:40:38 juju-e4d256-prod-github-runner-207 kernel: [58612.567123] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 21:40:38 juju-e4d256-prod-github-runner-207 kernel: [58612.568440] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 21:40:38 juju-e4d256-prod-github-runner-207 kernel: [58612.569750] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 21:40:38 juju-e4d256-prod-github-runner-207 kernel: [58612.571133] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 21:40:38 juju-e4d256-prod-github-runner-207 kernel: [58612.572359] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 21:40:38 juju-e4d256-prod-github-runner-207 kernel: [58612.573686] Call Trace: Aug 22 21:40:38 juju-e4d256-prod-github-runner-207 kernel: [58612.574651] Aug 22 21:40:38 juju-e4d256-prod-github-runner-207 kernel: [58612.575612] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:40:38 juju-e4d256-prod-github-runner-207 kernel: [58612.576741] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:40:38 juju-e4d256-prod-github-runner-207 kernel: [58612.577876] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:40:38 juju-e4d256-prod-github-runner-207 kernel: [58612.579091] ? show_regs.part.0+0x23/0x29 Aug 22 21:40:38 juju-e4d256-prod-github-runner-207 kernel: [58612.580201] ? show_regs.cold+0x8/0xd Aug 22 21:40:38 juju-e4d256-prod-github-runner-207 kernel: [58612.581246] ? watchdog_timer_fn+0x1be/0x220 Aug 22 21:40:38 juju-e4d256-prod-github-runner-207 kernel: [58612.582335] ? lockup_detector_update_enable+0x60/0x60 Aug 22 21:40:38 juju-e4d256-prod-github-runner-207 kernel: [58612.583548] ? __hrtimer_run_queues+0x107/0x230 Aug 22 21:40:38 juju-e4d256-prod-github-runner-207 kernel: [58612.584666] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 21:40:38 juju-e4d256-prod-github-runner-207 kernel: [58612.585775] ? hrtimer_interrupt+0x101/0x220 Aug 22 21:40:38 juju-e4d256-prod-github-runner-207 kernel: [58612.587022] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 21:40:38 juju-e4d256-prod-github-runner-207 kernel: [58612.588193] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 21:40:38 juju-e4d256-prod-github-runner-207 kernel: [58612.589564] Aug 22 21:40:38 juju-e4d256-prod-github-runner-207 kernel: [58612.590470] Aug 22 21:40:38 juju-e4d256-prod-github-runner-207 kernel: [58612.591588] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 21:40:38 juju-e4d256-prod-github-runner-207 kernel: [58612.592720] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:40:38 juju-e4d256-prod-github-runner-207 kernel: [58612.593837] ? _raw_spin_lock+0x22/0x30 Aug 22 21:40:38 juju-e4d256-prod-github-runner-207 kernel: [58612.594817] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:40:38 juju-e4d256-prod-github-runner-207 kernel: [58612.595876] direct_page_fault+0x206/0x310 [kvm] Aug 22 21:40:38 juju-e4d256-prod-github-runner-207 kernel: [58612.596908] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 21:40:38 juju-e4d256-prod-github-runner-207 kernel: [58612.598024] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 21:40:38 juju-e4d256-prod-github-runner-207 kernel: [58612.599028] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 21:40:38 juju-e4d256-prod-github-runner-207 kernel: [58612.600012] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 21:40:38 juju-e4d256-prod-github-runner-207 kernel: [58612.600964] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 21:40:38 juju-e4d256-prod-github-runner-207 kernel: [58612.601974] handle_exit+0x98/0x230 [kvm_amd] Aug 22 21:40:38 juju-e4d256-prod-github-runner-207 kernel: [58612.602875] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 21:40:38 juju-e4d256-prod-github-runner-207 kernel: [58612.603921] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 21:40:38 juju-e4d256-prod-github-runner-207 kernel: [58612.604950] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 21:40:38 juju-e4d256-prod-github-runner-207 kernel: [58612.605957] vcpu_run+0x62/0x2c0 [kvm] Aug 22 21:40:38 juju-e4d256-prod-github-runner-207 kernel: [58612.606851] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 21:40:38 juju-e4d256-prod-github-runner-207 kernel: [58612.607791] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 21:40:38 juju-e4d256-prod-github-runner-207 kernel: [58612.608671] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 21:40:38 juju-e4d256-prod-github-runner-207 kernel: [58612.609472] ? __seccomp_filter+0x4a/0x4a0 Aug 22 21:40:38 juju-e4d256-prod-github-runner-207 kernel: [58612.610224] ? __fget_files+0x86/0xc0 Aug 22 21:40:38 juju-e4d256-prod-github-runner-207 kernel: [58612.610929] __x64_sys_ioctl+0x95/0xd0 Aug 22 21:40:38 juju-e4d256-prod-github-runner-207 kernel: [58612.611658] do_syscall_64+0x5c/0xc0 Aug 22 21:40:38 juju-e4d256-prod-github-runner-207 kernel: [58612.612326] ? do_futex+0x162/0x1f0 Aug 22 21:40:38 juju-e4d256-prod-github-runner-207 kernel: [58612.612975] ? __x64_sys_futex+0x78/0x1e0 Aug 22 21:40:38 juju-e4d256-prod-github-runner-207 kernel: [58612.613722] ? __secure_computing+0xa9/0x120 Aug 22 21:40:38 juju-e4d256-prod-github-runner-207 kernel: [58612.614437] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 21:40:38 juju-e4d256-prod-github-runner-207 kernel: [58612.615241] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:40:38 juju-e4d256-prod-github-runner-207 kernel: [58612.615996] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:40:38 juju-e4d256-prod-github-runner-207 kernel: [58612.616760] ? do_syscall_64+0x69/0xc0 Aug 22 21:40:38 juju-e4d256-prod-github-runner-207 kernel: [58612.617439] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:40:38 juju-e4d256-prod-github-runner-207 kernel: [58612.618169] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:40:38 juju-e4d256-prod-github-runner-207 kernel: [58612.618895] ? do_syscall_64+0x69/0xc0 Aug 22 21:40:38 juju-e4d256-prod-github-runner-207 kernel: [58612.619546] ? do_syscall_64+0x69/0xc0 Aug 22 21:40:38 juju-e4d256-prod-github-runner-207 kernel: [58612.620178] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 21:40:38 juju-e4d256-prod-github-runner-207 kernel: [58612.620910] RIP: 0033:0x7faa5d0edaff Aug 22 21:40:38 juju-e4d256-prod-github-runner-207 kernel: [58612.621553] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 21:40:38 juju-e4d256-prod-github-runner-207 kernel: [58612.623623] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 21:40:38 juju-e4d256-prod-github-runner-207 kernel: [58612.624575] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 21:40:38 juju-e4d256-prod-github-runner-207 kernel: [58612.625509] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 21:40:38 juju-e4d256-prod-github-runner-207 kernel: [58612.626442] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 21:40:38 juju-e4d256-prod-github-runner-207 kernel: [58612.627398] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 21:40:38 juju-e4d256-prod-github-runner-207 kernel: [58612.628338] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 21:40:38 juju-e4d256-prod-github-runner-207 kernel: [58612.629261] Aug 22 21:41:06 juju-e4d256-prod-github-runner-207 kernel: [58640.541984] watchdog: BUG: soft lockup - CPU#1 stuck for 54505s! [qemu-system-x86:6715] Aug 22 21:41:06 juju-e4d256-prod-github-runner-207 kernel: [58640.543511] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 21:41:06 juju-e4d256-prod-github-runner-207 kernel: [58640.543600] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 21:41:06 juju-e4d256-prod-github-runner-207 kernel: [58640.559567] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 21:41:06 juju-e4d256-prod-github-runner-207 kernel: [58640.561539] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 21:41:06 juju-e4d256-prod-github-runner-207 kernel: [58640.563280] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:41:06 juju-e4d256-prod-github-runner-207 kernel: [58640.565917] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 21:41:06 juju-e4d256-prod-github-runner-207 kernel: [58640.569965] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 21:41:06 juju-e4d256-prod-github-runner-207 kernel: [58640.571535] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 21:41:06 juju-e4d256-prod-github-runner-207 kernel: [58640.572708] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 21:41:06 juju-e4d256-prod-github-runner-207 kernel: [58640.573916] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 21:41:06 juju-e4d256-prod-github-runner-207 kernel: [58640.575111] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 21:41:06 juju-e4d256-prod-github-runner-207 kernel: [58640.576294] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 21:41:06 juju-e4d256-prod-github-runner-207 kernel: [58640.577553] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 21:41:06 juju-e4d256-prod-github-runner-207 kernel: [58640.578829] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 21:41:06 juju-e4d256-prod-github-runner-207 kernel: [58640.579987] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 21:41:06 juju-e4d256-prod-github-runner-207 kernel: [58640.581180] Call Trace: Aug 22 21:41:06 juju-e4d256-prod-github-runner-207 kernel: [58640.582094] Aug 22 21:41:06 juju-e4d256-prod-github-runner-207 kernel: [58640.583247] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:41:06 juju-e4d256-prod-github-runner-207 kernel: [58640.584601] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:41:06 juju-e4d256-prod-github-runner-207 kernel: [58640.585852] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:41:06 juju-e4d256-prod-github-runner-207 kernel: [58640.586959] ? show_regs.part.0+0x23/0x29 Aug 22 21:41:06 juju-e4d256-prod-github-runner-207 kernel: [58640.587994] ? show_regs.cold+0x8/0xd Aug 22 21:41:06 juju-e4d256-prod-github-runner-207 kernel: [58640.588987] ? watchdog_timer_fn+0x1be/0x220 Aug 22 21:41:06 juju-e4d256-prod-github-runner-207 kernel: [58640.590010] ? lockup_detector_update_enable+0x60/0x60 Aug 22 21:41:06 juju-e4d256-prod-github-runner-207 kernel: [58640.591158] ? __hrtimer_run_queues+0x107/0x230 Aug 22 21:41:06 juju-e4d256-prod-github-runner-207 kernel: [58640.592217] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 21:41:06 juju-e4d256-prod-github-runner-207 kernel: [58640.593248] ? hrtimer_interrupt+0x101/0x220 Aug 22 21:41:06 juju-e4d256-prod-github-runner-207 kernel: [58640.594282] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 21:41:06 juju-e4d256-prod-github-runner-207 kernel: [58640.595378] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 21:41:06 juju-e4d256-prod-github-runner-207 kernel: [58640.596449] Aug 22 21:41:06 juju-e4d256-prod-github-runner-207 kernel: [58640.597317] Aug 22 21:41:06 juju-e4d256-prod-github-runner-207 kernel: [58640.598186] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 21:41:06 juju-e4d256-prod-github-runner-207 kernel: [58640.599350] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:41:06 juju-e4d256-prod-github-runner-207 kernel: [58640.600442] ? _raw_spin_lock+0x22/0x30 Aug 22 21:41:06 juju-e4d256-prod-github-runner-207 kernel: [58640.601703] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:41:06 juju-e4d256-prod-github-runner-207 kernel: [58640.602970] direct_page_fault+0x206/0x310 [kvm] Aug 22 21:41:06 juju-e4d256-prod-github-runner-207 kernel: [58640.604144] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 21:41:06 juju-e4d256-prod-github-runner-207 kernel: [58640.605404] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 21:41:06 juju-e4d256-prod-github-runner-207 kernel: [58640.606439] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 21:41:06 juju-e4d256-prod-github-runner-207 kernel: [58640.607556] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 21:41:06 juju-e4d256-prod-github-runner-207 kernel: [58640.608599] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 21:41:06 juju-e4d256-prod-github-runner-207 kernel: [58640.609654] handle_exit+0x98/0x230 [kvm_amd] Aug 22 21:41:06 juju-e4d256-prod-github-runner-207 kernel: [58640.610562] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 21:41:06 juju-e4d256-prod-github-runner-207 kernel: [58640.611518] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 21:41:06 juju-e4d256-prod-github-runner-207 kernel: [58640.612500] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 21:41:06 juju-e4d256-prod-github-runner-207 kernel: [58640.613496] vcpu_run+0x62/0x2c0 [kvm] Aug 22 21:41:06 juju-e4d256-prod-github-runner-207 kernel: [58640.614349] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 21:41:06 juju-e4d256-prod-github-runner-207 kernel: [58640.615244] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 21:41:06 juju-e4d256-prod-github-runner-207 kernel: [58640.616122] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 21:41:06 juju-e4d256-prod-github-runner-207 kernel: [58640.616929] ? __seccomp_filter+0x4a/0x4a0 Aug 22 21:41:06 juju-e4d256-prod-github-runner-207 kernel: [58640.617685] ? __fget_files+0x86/0xc0 Aug 22 21:41:06 juju-e4d256-prod-github-runner-207 kernel: [58640.620834] __x64_sys_ioctl+0x95/0xd0 Aug 22 21:41:06 juju-e4d256-prod-github-runner-207 kernel: [58640.621588] do_syscall_64+0x5c/0xc0 Aug 22 21:41:06 juju-e4d256-prod-github-runner-207 kernel: [58640.622272] ? do_futex+0x162/0x1f0 Aug 22 21:41:06 juju-e4d256-prod-github-runner-207 kernel: [58640.623000] ? __x64_sys_futex+0x78/0x1e0 Aug 22 21:41:06 juju-e4d256-prod-github-runner-207 kernel: [58640.623733] ? __secure_computing+0xa9/0x120 Aug 22 21:41:06 juju-e4d256-prod-github-runner-207 kernel: [58640.624452] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 21:41:06 juju-e4d256-prod-github-runner-207 kernel: [58640.627681] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:41:06 juju-e4d256-prod-github-runner-207 kernel: [58640.628432] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:41:06 juju-e4d256-prod-github-runner-207 kernel: [58640.629201] ? do_syscall_64+0x69/0xc0 Aug 22 21:41:06 juju-e4d256-prod-github-runner-207 kernel: [58640.629890] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:41:06 juju-e4d256-prod-github-runner-207 kernel: [58640.630611] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:41:06 juju-e4d256-prod-github-runner-207 kernel: [58640.631372] ? do_syscall_64+0x69/0xc0 Aug 22 21:41:06 juju-e4d256-prod-github-runner-207 kernel: [58640.634143] ? do_syscall_64+0x69/0xc0 Aug 22 21:41:06 juju-e4d256-prod-github-runner-207 kernel: [58640.634794] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 21:41:06 juju-e4d256-prod-github-runner-207 kernel: [58640.635545] RIP: 0033:0x7faa5d0edaff Aug 22 21:41:06 juju-e4d256-prod-github-runner-207 kernel: [58640.636187] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 21:41:06 juju-e4d256-prod-github-runner-207 kernel: [58640.638217] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 21:41:06 juju-e4d256-prod-github-runner-207 kernel: [58640.641393] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 21:41:06 juju-e4d256-prod-github-runner-207 kernel: [58640.642335] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 21:41:06 juju-e4d256-prod-github-runner-207 kernel: [58640.643269] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 21:41:06 juju-e4d256-prod-github-runner-207 kernel: [58640.644197] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 21:41:06 juju-e4d256-prod-github-runner-207 kernel: [58640.645105] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 21:41:06 juju-e4d256-prod-github-runner-207 kernel: [58640.646072] Aug 22 21:41:34 juju-e4d256-prod-github-runner-207 kernel: [58668.541983] watchdog: BUG: soft lockup - CPU#1 stuck for 54531s! [qemu-system-x86:6715] Aug 22 21:41:34 juju-e4d256-prod-github-runner-207 kernel: [58668.543935] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 21:41:34 juju-e4d256-prod-github-runner-207 kernel: [58668.544234] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 21:41:34 juju-e4d256-prod-github-runner-207 kernel: [58668.556510] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 21:41:34 juju-e4d256-prod-github-runner-207 kernel: [58668.557782] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 21:41:34 juju-e4d256-prod-github-runner-207 kernel: [58668.559242] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:41:34 juju-e4d256-prod-github-runner-207 kernel: [58668.560428] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 21:41:34 juju-e4d256-prod-github-runner-207 kernel: [58668.563340] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 21:41:34 juju-e4d256-prod-github-runner-207 kernel: [58668.564491] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 21:41:34 juju-e4d256-prod-github-runner-207 kernel: [58668.565795] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 21:41:34 juju-e4d256-prod-github-runner-207 kernel: [58668.567128] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 21:41:34 juju-e4d256-prod-github-runner-207 kernel: [58668.568441] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 21:41:34 juju-e4d256-prod-github-runner-207 kernel: [58668.569742] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 21:41:34 juju-e4d256-prod-github-runner-207 kernel: [58668.571092] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 21:41:34 juju-e4d256-prod-github-runner-207 kernel: [58668.572511] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 21:41:34 juju-e4d256-prod-github-runner-207 kernel: [58668.573730] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 21:41:34 juju-e4d256-prod-github-runner-207 kernel: [58668.575089] Call Trace: Aug 22 21:41:34 juju-e4d256-prod-github-runner-207 kernel: [58668.576249] Aug 22 21:41:34 juju-e4d256-prod-github-runner-207 kernel: [58668.577203] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:41:34 juju-e4d256-prod-github-runner-207 kernel: [58668.578326] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:41:34 juju-e4d256-prod-github-runner-207 kernel: [58668.579468] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:41:34 juju-e4d256-prod-github-runner-207 kernel: [58668.580683] ? show_regs.part.0+0x23/0x29 Aug 22 21:41:34 juju-e4d256-prod-github-runner-207 kernel: [58668.581770] ? show_regs.cold+0x8/0xd Aug 22 21:41:34 juju-e4d256-prod-github-runner-207 kernel: [58668.582851] ? watchdog_timer_fn+0x1be/0x220 Aug 22 21:41:34 juju-e4d256-prod-github-runner-207 kernel: [58668.583979] ? lockup_detector_update_enable+0x60/0x60 Aug 22 21:41:34 juju-e4d256-prod-github-runner-207 kernel: [58668.585291] ? __hrtimer_run_queues+0x107/0x230 Aug 22 21:41:34 juju-e4d256-prod-github-runner-207 kernel: [58668.586586] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 21:41:34 juju-e4d256-prod-github-runner-207 kernel: [58668.587703] ? hrtimer_interrupt+0x101/0x220 Aug 22 21:41:34 juju-e4d256-prod-github-runner-207 kernel: [58668.588806] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 21:41:34 juju-e4d256-prod-github-runner-207 kernel: [58668.589978] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 21:41:34 juju-e4d256-prod-github-runner-207 kernel: [58668.591138] Aug 22 21:41:34 juju-e4d256-prod-github-runner-207 kernel: [58668.592051] Aug 22 21:41:34 juju-e4d256-prod-github-runner-207 kernel: [58668.592941] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 21:41:34 juju-e4d256-prod-github-runner-207 kernel: [58668.594077] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:41:34 juju-e4d256-prod-github-runner-207 kernel: [58668.595244] ? _raw_spin_lock+0x22/0x30 Aug 22 21:41:34 juju-e4d256-prod-github-runner-207 kernel: [58668.596269] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:41:34 juju-e4d256-prod-github-runner-207 kernel: [58668.597385] direct_page_fault+0x206/0x310 [kvm] Aug 22 21:41:34 juju-e4d256-prod-github-runner-207 kernel: [58668.598501] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 21:41:34 juju-e4d256-prod-github-runner-207 kernel: [58668.599657] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 21:41:34 juju-e4d256-prod-github-runner-207 kernel: [58668.600749] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 21:41:34 juju-e4d256-prod-github-runner-207 kernel: [58668.601870] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 21:41:34 juju-e4d256-prod-github-runner-207 kernel: [58668.602941] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 21:41:34 juju-e4d256-prod-github-runner-207 kernel: [58668.604024] handle_exit+0x98/0x230 [kvm_amd] Aug 22 21:41:34 juju-e4d256-prod-github-runner-207 kernel: [58668.605009] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 21:41:34 juju-e4d256-prod-github-runner-207 kernel: [58668.606018] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 21:41:34 juju-e4d256-prod-github-runner-207 kernel: [58668.607053] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 21:41:34 juju-e4d256-prod-github-runner-207 kernel: [58668.608054] vcpu_run+0x62/0x2c0 [kvm] Aug 22 21:41:34 juju-e4d256-prod-github-runner-207 kernel: [58668.608943] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 21:41:34 juju-e4d256-prod-github-runner-207 kernel: [58668.609866] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 21:41:34 juju-e4d256-prod-github-runner-207 kernel: [58668.610859] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 21:41:34 juju-e4d256-prod-github-runner-207 kernel: [58668.611746] ? __seccomp_filter+0x4a/0x4a0 Aug 22 21:41:34 juju-e4d256-prod-github-runner-207 kernel: [58668.612573] ? __fget_files+0x86/0xc0 Aug 22 21:41:34 juju-e4d256-prod-github-runner-207 kernel: [58668.613366] __x64_sys_ioctl+0x95/0xd0 Aug 22 21:41:34 juju-e4d256-prod-github-runner-207 kernel: [58668.614144] do_syscall_64+0x5c/0xc0 Aug 22 21:41:34 juju-e4d256-prod-github-runner-207 kernel: [58668.614977] ? do_futex+0x162/0x1f0 Aug 22 21:41:34 juju-e4d256-prod-github-runner-207 kernel: [58668.615704] ? __x64_sys_futex+0x78/0x1e0 Aug 22 21:41:34 juju-e4d256-prod-github-runner-207 kernel: [58668.616455] ? __secure_computing+0xa9/0x120 Aug 22 21:41:34 juju-e4d256-prod-github-runner-207 kernel: [58668.617261] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 21:41:34 juju-e4d256-prod-github-runner-207 kernel: [58668.618140] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:41:34 juju-e4d256-prod-github-runner-207 kernel: [58668.618990] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:41:34 juju-e4d256-prod-github-runner-207 kernel: [58668.619804] ? do_syscall_64+0x69/0xc0 Aug 22 21:41:34 juju-e4d256-prod-github-runner-207 kernel: [58668.620531] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:41:34 juju-e4d256-prod-github-runner-207 kernel: [58668.621350] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:41:34 juju-e4d256-prod-github-runner-207 kernel: [58668.622166] ? do_syscall_64+0x69/0xc0 Aug 22 21:41:34 juju-e4d256-prod-github-runner-207 kernel: [58668.622888] ? do_syscall_64+0x69/0xc0 Aug 22 21:41:34 juju-e4d256-prod-github-runner-207 kernel: [58668.623588] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 21:41:34 juju-e4d256-prod-github-runner-207 kernel: [58668.624419] RIP: 0033:0x7faa5d0edaff Aug 22 21:41:34 juju-e4d256-prod-github-runner-207 kernel: [58668.625173] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 21:41:34 juju-e4d256-prod-github-runner-207 kernel: [58668.627540] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 21:41:34 juju-e4d256-prod-github-runner-207 kernel: [58668.628611] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 21:41:34 juju-e4d256-prod-github-runner-207 kernel: [58668.629640] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 21:41:34 juju-e4d256-prod-github-runner-207 kernel: [58668.630693] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 21:41:34 juju-e4d256-prod-github-runner-207 kernel: [58668.631716] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 21:41:34 juju-e4d256-prod-github-runner-207 kernel: [58668.632744] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 21:41:34 juju-e4d256-prod-github-runner-207 kernel: [58668.633778] Aug 22 21:41:47 juju-e4d256-prod-github-runner-207 kernel: [58681.100715] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 21:41:47 juju-e4d256-prod-github-runner-207 kernel: [58681.101850] rcu: 1-....: (14594894 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=7053123 Aug 22 21:41:47 juju-e4d256-prod-github-runner-207 kernel: [58681.103255] (t=14640975 jiffies g=23269 q=53123) Aug 22 21:41:47 juju-e4d256-prod-github-runner-207 kernel: [58681.104158] NMI backtrace for cpu 1 Aug 22 21:41:47 juju-e4d256-prod-github-runner-207 kernel: [58681.104999] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 21:41:47 juju-e4d256-prod-github-runner-207 kernel: [58681.106413] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 21:41:47 juju-e4d256-prod-github-runner-207 kernel: [58681.107810] Call Trace: Aug 22 21:41:47 juju-e4d256-prod-github-runner-207 kernel: [58681.108614] Aug 22 21:41:47 juju-e4d256-prod-github-runner-207 kernel: [58681.109417] show_stack+0x52/0x5c Aug 22 21:41:47 juju-e4d256-prod-github-runner-207 kernel: [58681.110277] dump_stack_lvl+0x4a/0x63 Aug 22 21:41:47 juju-e4d256-prod-github-runner-207 kernel: [58681.111185] dump_stack+0x10/0x16 Aug 22 21:41:47 juju-e4d256-prod-github-runner-207 kernel: [58681.112018] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 21:41:47 juju-e4d256-prod-github-runner-207 kernel: [58681.112947] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 21:41:47 juju-e4d256-prod-github-runner-207 kernel: [58681.113890] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 21:41:47 juju-e4d256-prod-github-runner-207 kernel: [58681.114867] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 21:41:47 juju-e4d256-prod-github-runner-207 kernel: [58681.115797] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 21:41:47 juju-e4d256-prod-github-runner-207 kernel: [58681.117157] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 21:41:47 juju-e4d256-prod-github-runner-207 kernel: [58681.118050] print_cpu_stall.cold+0x2f/0xe2 Aug 22 21:41:47 juju-e4d256-prod-github-runner-207 kernel: [58681.119021] ? timekeeping_update+0xf7/0x150 Aug 22 21:41:47 juju-e4d256-prod-github-runner-207 kernel: [58681.119933] check_cpu_stall+0x109/0x270 Aug 22 21:41:47 juju-e4d256-prod-github-runner-207 kernel: [58681.120759] rcu_sched_clock_irq+0x9a/0x250 Aug 22 21:41:47 juju-e4d256-prod-github-runner-207 kernel: [58681.121660] update_process_times+0x94/0xd0 Aug 22 21:41:47 juju-e4d256-prod-github-runner-207 kernel: [58681.122577] tick_sched_handle+0x29/0x70 Aug 22 21:41:47 juju-e4d256-prod-github-runner-207 kernel: [58681.123563] tick_sched_timer+0x8c/0xc0 Aug 22 21:41:47 juju-e4d256-prod-github-runner-207 kernel: [58681.124451] ? tick_nohz_handler+0xb0/0xb0 Aug 22 21:41:47 juju-e4d256-prod-github-runner-207 kernel: [58681.125299] __hrtimer_run_queues+0x107/0x230 Aug 22 21:41:47 juju-e4d256-prod-github-runner-207 kernel: [58681.126177] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 21:41:47 juju-e4d256-prod-github-runner-207 kernel: [58681.127040] hrtimer_interrupt+0x101/0x220 Aug 22 21:41:47 juju-e4d256-prod-github-runner-207 kernel: [58681.127898] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 21:41:47 juju-e4d256-prod-github-runner-207 kernel: [58681.128853] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 21:41:47 juju-e4d256-prod-github-runner-207 kernel: [58681.129748] Aug 22 21:41:47 juju-e4d256-prod-github-runner-207 kernel: [58681.130589] Aug 22 21:41:47 juju-e4d256-prod-github-runner-207 kernel: [58681.131330] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 21:41:47 juju-e4d256-prod-github-runner-207 kernel: [58681.132279] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:41:47 juju-e4d256-prod-github-runner-207 kernel: [58681.133348] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 21:41:47 juju-e4d256-prod-github-runner-207 kernel: [58681.135867] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 21:41:47 juju-e4d256-prod-github-runner-207 kernel: [58681.136901] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 21:41:47 juju-e4d256-prod-github-runner-207 kernel: [58681.138103] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 21:41:47 juju-e4d256-prod-github-runner-207 kernel: [58681.139244] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 21:41:47 juju-e4d256-prod-github-runner-207 kernel: [58681.140345] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 21:41:47 juju-e4d256-prod-github-runner-207 kernel: [58681.141432] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 21:41:47 juju-e4d256-prod-github-runner-207 kernel: [58681.142565] ? _raw_spin_lock+0x22/0x30 Aug 22 21:41:47 juju-e4d256-prod-github-runner-207 kernel: [58681.143412] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:41:47 juju-e4d256-prod-github-runner-207 kernel: [58681.144360] direct_page_fault+0x206/0x310 [kvm] Aug 22 21:41:47 juju-e4d256-prod-github-runner-207 kernel: [58681.145302] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 21:41:47 juju-e4d256-prod-github-runner-207 kernel: [58681.146232] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 21:41:47 juju-e4d256-prod-github-runner-207 kernel: [58681.147191] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 21:41:47 juju-e4d256-prod-github-runner-207 kernel: [58681.148091] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 21:41:47 juju-e4d256-prod-github-runner-207 kernel: [58681.148969] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 21:41:47 juju-e4d256-prod-github-runner-207 kernel: [58681.149901] handle_exit+0x98/0x230 [kvm_amd] Aug 22 21:41:47 juju-e4d256-prod-github-runner-207 kernel: [58681.150773] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 21:41:47 juju-e4d256-prod-github-runner-207 kernel: [58681.151651] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 21:41:47 juju-e4d256-prod-github-runner-207 kernel: [58681.152548] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 21:41:47 juju-e4d256-prod-github-runner-207 kernel: [58681.153520] vcpu_run+0x62/0x2c0 [kvm] Aug 22 21:41:47 juju-e4d256-prod-github-runner-207 kernel: [58681.154326] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 21:41:47 juju-e4d256-prod-github-runner-207 kernel: [58681.155176] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 21:41:47 juju-e4d256-prod-github-runner-207 kernel: [58681.156079] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 21:41:47 juju-e4d256-prod-github-runner-207 kernel: [58681.157219] ? __seccomp_filter+0x4a/0x4a0 Aug 22 21:41:47 juju-e4d256-prod-github-runner-207 kernel: [58681.158044] ? __fget_files+0x86/0xc0 Aug 22 21:41:47 juju-e4d256-prod-github-runner-207 kernel: [58681.158844] __x64_sys_ioctl+0x95/0xd0 Aug 22 21:41:47 juju-e4d256-prod-github-runner-207 kernel: [58681.159619] do_syscall_64+0x5c/0xc0 Aug 22 21:41:47 juju-e4d256-prod-github-runner-207 kernel: [58681.160380] ? do_futex+0x162/0x1f0 Aug 22 21:41:47 juju-e4d256-prod-github-runner-207 kernel: [58681.161130] ? __x64_sys_futex+0x78/0x1e0 Aug 22 21:41:47 juju-e4d256-prod-github-runner-207 kernel: [58681.161921] ? __secure_computing+0xa9/0x120 Aug 22 21:41:47 juju-e4d256-prod-github-runner-207 kernel: [58681.162755] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 21:41:47 juju-e4d256-prod-github-runner-207 kernel: [58681.163706] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:41:47 juju-e4d256-prod-github-runner-207 kernel: [58681.164586] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:41:47 juju-e4d256-prod-github-runner-207 kernel: [58681.165447] ? do_syscall_64+0x69/0xc0 Aug 22 21:41:47 juju-e4d256-prod-github-runner-207 kernel: [58681.166210] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:41:47 juju-e4d256-prod-github-runner-207 kernel: [58681.167084] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:41:47 juju-e4d256-prod-github-runner-207 kernel: [58681.167941] ? do_syscall_64+0x69/0xc0 Aug 22 21:41:47 juju-e4d256-prod-github-runner-207 kernel: [58681.168709] ? do_syscall_64+0x69/0xc0 Aug 22 21:41:47 juju-e4d256-prod-github-runner-207 kernel: [58681.169478] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 21:41:47 juju-e4d256-prod-github-runner-207 kernel: [58681.170368] RIP: 0033:0x7faa5d0edaff Aug 22 21:41:47 juju-e4d256-prod-github-runner-207 kernel: [58681.171130] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 21:41:47 juju-e4d256-prod-github-runner-207 kernel: [58681.173552] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 21:41:47 juju-e4d256-prod-github-runner-207 kernel: [58681.174664] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 21:41:47 juju-e4d256-prod-github-runner-207 kernel: [58681.175746] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 21:41:47 juju-e4d256-prod-github-runner-207 kernel: [58681.176829] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 21:41:47 juju-e4d256-prod-github-runner-207 kernel: [58681.177902] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 21:41:47 juju-e4d256-prod-github-runner-207 kernel: [58681.178971] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 21:41:47 juju-e4d256-prod-github-runner-207 kernel: [58681.180024] Aug 22 21:42:14 juju-e4d256-prod-github-runner-207 kernel: [58708.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 54568s! [qemu-system-x86:6715] Aug 22 21:42:14 juju-e4d256-prod-github-runner-207 kernel: [58708.543189] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 21:42:14 juju-e4d256-prod-github-runner-207 kernel: [58708.543265] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 21:42:14 juju-e4d256-prod-github-runner-207 kernel: [58708.555571] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 21:42:14 juju-e4d256-prod-github-runner-207 kernel: [58708.556851] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 21:42:14 juju-e4d256-prod-github-runner-207 kernel: [58708.558117] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:42:14 juju-e4d256-prod-github-runner-207 kernel: [58708.559181] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 21:42:14 juju-e4d256-prod-github-runner-207 kernel: [58708.561790] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 21:42:14 juju-e4d256-prod-github-runner-207 kernel: [58708.562875] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 21:42:14 juju-e4d256-prod-github-runner-207 kernel: [58708.564060] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 21:42:14 juju-e4d256-prod-github-runner-207 kernel: [58708.565262] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 21:42:14 juju-e4d256-prod-github-runner-207 kernel: [58708.566458] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 21:42:14 juju-e4d256-prod-github-runner-207 kernel: [58708.567622] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 21:42:14 juju-e4d256-prod-github-runner-207 kernel: [58708.568797] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 21:42:14 juju-e4d256-prod-github-runner-207 kernel: [58708.570086] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 21:42:14 juju-e4d256-prod-github-runner-207 kernel: [58708.571210] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 21:42:14 juju-e4d256-prod-github-runner-207 kernel: [58708.572419] Call Trace: Aug 22 21:42:14 juju-e4d256-prod-github-runner-207 kernel: [58708.573335] Aug 22 21:42:14 juju-e4d256-prod-github-runner-207 kernel: [58708.574245] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:42:14 juju-e4d256-prod-github-runner-207 kernel: [58708.575287] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:42:14 juju-e4d256-prod-github-runner-207 kernel: [58708.576433] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:42:14 juju-e4d256-prod-github-runner-207 kernel: [58708.577637] ? show_regs.part.0+0x23/0x29 Aug 22 21:42:14 juju-e4d256-prod-github-runner-207 kernel: [58708.578766] ? show_regs.cold+0x8/0xd Aug 22 21:42:14 juju-e4d256-prod-github-runner-207 kernel: [58708.579817] ? watchdog_timer_fn+0x1be/0x220 Aug 22 21:42:14 juju-e4d256-prod-github-runner-207 kernel: [58708.580920] ? lockup_detector_update_enable+0x60/0x60 Aug 22 21:42:14 juju-e4d256-prod-github-runner-207 kernel: [58708.582117] ? __hrtimer_run_queues+0x107/0x230 Aug 22 21:42:14 juju-e4d256-prod-github-runner-207 kernel: [58708.583246] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 21:42:14 juju-e4d256-prod-github-runner-207 kernel: [58708.584380] ? hrtimer_interrupt+0x101/0x220 Aug 22 21:42:14 juju-e4d256-prod-github-runner-207 kernel: [58708.585480] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 21:42:14 juju-e4d256-prod-github-runner-207 kernel: [58708.586661] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 21:42:14 juju-e4d256-prod-github-runner-207 kernel: [58708.587806] Aug 22 21:42:14 juju-e4d256-prod-github-runner-207 kernel: [58708.588713] Aug 22 21:42:14 juju-e4d256-prod-github-runner-207 kernel: [58708.589607] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 21:42:14 juju-e4d256-prod-github-runner-207 kernel: [58708.590787] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:42:14 juju-e4d256-prod-github-runner-207 kernel: [58708.591940] ? _raw_spin_lock+0x22/0x30 Aug 22 21:42:14 juju-e4d256-prod-github-runner-207 kernel: [58708.592965] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:42:14 juju-e4d256-prod-github-runner-207 kernel: [58708.594107] direct_page_fault+0x206/0x310 [kvm] Aug 22 21:42:14 juju-e4d256-prod-github-runner-207 kernel: [58708.595231] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 21:42:14 juju-e4d256-prod-github-runner-207 kernel: [58708.596330] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 21:42:14 juju-e4d256-prod-github-runner-207 kernel: [58708.597472] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 21:42:14 juju-e4d256-prod-github-runner-207 kernel: [58708.598587] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 21:42:14 juju-e4d256-prod-github-runner-207 kernel: [58708.599654] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 21:42:14 juju-e4d256-prod-github-runner-207 kernel: [58708.600774] handle_exit+0x98/0x230 [kvm_amd] Aug 22 21:42:14 juju-e4d256-prod-github-runner-207 kernel: [58708.601794] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 21:42:14 juju-e4d256-prod-github-runner-207 kernel: [58708.602838] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 21:42:14 juju-e4d256-prod-github-runner-207 kernel: [58708.603867] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 21:42:14 juju-e4d256-prod-github-runner-207 kernel: [58708.604871] vcpu_run+0x62/0x2c0 [kvm] Aug 22 21:42:14 juju-e4d256-prod-github-runner-207 kernel: [58708.605763] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 21:42:14 juju-e4d256-prod-github-runner-207 kernel: [58708.606676] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 21:42:14 juju-e4d256-prod-github-runner-207 kernel: [58708.607645] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 21:42:14 juju-e4d256-prod-github-runner-207 kernel: [58708.608569] ? __seccomp_filter+0x4a/0x4a0 Aug 22 21:42:14 juju-e4d256-prod-github-runner-207 kernel: [58708.609420] ? __fget_files+0x86/0xc0 Aug 22 21:42:14 juju-e4d256-prod-github-runner-207 kernel: [58708.610241] __x64_sys_ioctl+0x95/0xd0 Aug 22 21:42:14 juju-e4d256-prod-github-runner-207 kernel: [58708.611012] do_syscall_64+0x5c/0xc0 Aug 22 21:42:14 juju-e4d256-prod-github-runner-207 kernel: [58708.611767] ? do_futex+0x162/0x1f0 Aug 22 21:42:14 juju-e4d256-prod-github-runner-207 kernel: [58708.612505] ? __x64_sys_futex+0x78/0x1e0 Aug 22 21:42:14 juju-e4d256-prod-github-runner-207 kernel: [58708.613268] ? __secure_computing+0xa9/0x120 Aug 22 21:42:14 juju-e4d256-prod-github-runner-207 kernel: [58708.614072] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 21:42:14 juju-e4d256-prod-github-runner-207 kernel: [58708.614944] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:42:14 juju-e4d256-prod-github-runner-207 kernel: [58708.615913] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:42:14 juju-e4d256-prod-github-runner-207 kernel: [58708.616722] ? do_syscall_64+0x69/0xc0 Aug 22 21:42:14 juju-e4d256-prod-github-runner-207 kernel: [58708.617448] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:42:14 juju-e4d256-prod-github-runner-207 kernel: [58708.618256] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:42:14 juju-e4d256-prod-github-runner-207 kernel: [58708.619125] ? do_syscall_64+0x69/0xc0 Aug 22 21:42:14 juju-e4d256-prod-github-runner-207 kernel: [58708.619829] ? do_syscall_64+0x69/0xc0 Aug 22 21:42:14 juju-e4d256-prod-github-runner-207 kernel: [58708.620530] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 21:42:14 juju-e4d256-prod-github-runner-207 kernel: [58708.621335] RIP: 0033:0x7faa5d0edaff Aug 22 21:42:14 juju-e4d256-prod-github-runner-207 kernel: [58708.622052] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 21:42:14 juju-e4d256-prod-github-runner-207 kernel: [58708.624385] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 21:42:14 juju-e4d256-prod-github-runner-207 kernel: [58708.625447] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 21:42:14 juju-e4d256-prod-github-runner-207 kernel: [58708.626501] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 21:42:14 juju-e4d256-prod-github-runner-207 kernel: [58708.627535] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 21:42:14 juju-e4d256-prod-github-runner-207 kernel: [58708.628566] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 21:42:14 juju-e4d256-prod-github-runner-207 kernel: [58708.629624] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 21:42:14 juju-e4d256-prod-github-runner-207 kernel: [58708.630576] Aug 22 21:42:42 juju-e4d256-prod-github-runner-207 kernel: [58736.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 54594s! [qemu-system-x86:6715] Aug 22 21:42:42 juju-e4d256-prod-github-runner-207 kernel: [58736.544069] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 21:42:42 juju-e4d256-prod-github-runner-207 kernel: [58736.544376] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 21:42:42 juju-e4d256-prod-github-runner-207 kernel: [58736.557122] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 21:42:42 juju-e4d256-prod-github-runner-207 kernel: [58736.558670] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 21:42:42 juju-e4d256-prod-github-runner-207 kernel: [58736.560280] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:42:42 juju-e4d256-prod-github-runner-207 kernel: [58736.561476] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 21:42:42 juju-e4d256-prod-github-runner-207 kernel: [58736.564386] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 21:42:42 juju-e4d256-prod-github-runner-207 kernel: [58736.565555] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 21:42:42 juju-e4d256-prod-github-runner-207 kernel: [58736.566867] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 21:42:42 juju-e4d256-prod-github-runner-207 kernel: [58736.568165] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 21:42:42 juju-e4d256-prod-github-runner-207 kernel: [58736.569472] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 21:42:42 juju-e4d256-prod-github-runner-207 kernel: [58736.570789] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 21:42:42 juju-e4d256-prod-github-runner-207 kernel: [58736.572087] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 21:42:42 juju-e4d256-prod-github-runner-207 kernel: [58736.573473] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 21:42:42 juju-e4d256-prod-github-runner-207 kernel: [58736.574710] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 21:42:42 juju-e4d256-prod-github-runner-207 kernel: [58736.576050] Call Trace: Aug 22 21:42:42 juju-e4d256-prod-github-runner-207 kernel: [58736.577020] Aug 22 21:42:42 juju-e4d256-prod-github-runner-207 kernel: [58736.577995] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:42:42 juju-e4d256-prod-github-runner-207 kernel: [58736.579121] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:42:42 juju-e4d256-prod-github-runner-207 kernel: [58736.580233] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:42:42 juju-e4d256-prod-github-runner-207 kernel: [58736.581445] ? show_regs.part.0+0x23/0x29 Aug 22 21:42:42 juju-e4d256-prod-github-runner-207 kernel: [58736.582549] ? show_regs.cold+0x8/0xd Aug 22 21:42:42 juju-e4d256-prod-github-runner-207 kernel: [58736.583618] ? watchdog_timer_fn+0x1be/0x220 Aug 22 21:42:42 juju-e4d256-prod-github-runner-207 kernel: [58736.584729] ? lockup_detector_update_enable+0x60/0x60 Aug 22 21:42:42 juju-e4d256-prod-github-runner-207 kernel: [58736.585911] ? __hrtimer_run_queues+0x107/0x230 Aug 22 21:42:42 juju-e4d256-prod-github-runner-207 kernel: [58736.587037] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 21:42:42 juju-e4d256-prod-github-runner-207 kernel: [58736.588154] ? hrtimer_interrupt+0x101/0x220 Aug 22 21:42:42 juju-e4d256-prod-github-runner-207 kernel: [58736.589256] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 21:42:42 juju-e4d256-prod-github-runner-207 kernel: [58736.590459] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 21:42:42 juju-e4d256-prod-github-runner-207 kernel: [58736.591636] Aug 22 21:42:42 juju-e4d256-prod-github-runner-207 kernel: [58736.592548] Aug 22 21:42:42 juju-e4d256-prod-github-runner-207 kernel: [58736.593442] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 21:42:42 juju-e4d256-prod-github-runner-207 kernel: [58736.594639] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:42:42 juju-e4d256-prod-github-runner-207 kernel: [58736.595792] ? _raw_spin_lock+0x22/0x30 Aug 22 21:42:42 juju-e4d256-prod-github-runner-207 kernel: [58736.596820] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:42:42 juju-e4d256-prod-github-runner-207 kernel: [58736.597958] direct_page_fault+0x206/0x310 [kvm] Aug 22 21:42:42 juju-e4d256-prod-github-runner-207 kernel: [58736.599103] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 21:42:42 juju-e4d256-prod-github-runner-207 kernel: [58736.600220] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 21:42:42 juju-e4d256-prod-github-runner-207 kernel: [58736.601318] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 21:42:42 juju-e4d256-prod-github-runner-207 kernel: [58736.602433] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 21:42:42 juju-e4d256-prod-github-runner-207 kernel: [58736.603480] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 21:42:42 juju-e4d256-prod-github-runner-207 kernel: [58736.604575] handle_exit+0x98/0x230 [kvm_amd] Aug 22 21:42:42 juju-e4d256-prod-github-runner-207 kernel: [58736.605557] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 21:42:42 juju-e4d256-prod-github-runner-207 kernel: [58736.606576] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 21:42:42 juju-e4d256-prod-github-runner-207 kernel: [58736.607602] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 21:42:42 juju-e4d256-prod-github-runner-207 kernel: [58736.608606] vcpu_run+0x62/0x2c0 [kvm] Aug 22 21:42:42 juju-e4d256-prod-github-runner-207 kernel: [58736.609495] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 21:42:42 juju-e4d256-prod-github-runner-207 kernel: [58736.610408] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 21:42:42 juju-e4d256-prod-github-runner-207 kernel: [58736.611363] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 21:42:42 juju-e4d256-prod-github-runner-207 kernel: [58736.612260] ? __seccomp_filter+0x4a/0x4a0 Aug 22 21:42:42 juju-e4d256-prod-github-runner-207 kernel: [58736.613093] ? __fget_files+0x86/0xc0 Aug 22 21:42:42 juju-e4d256-prod-github-runner-207 kernel: [58736.613904] __x64_sys_ioctl+0x95/0xd0 Aug 22 21:42:42 juju-e4d256-prod-github-runner-207 kernel: [58736.614682] do_syscall_64+0x5c/0xc0 Aug 22 21:42:42 juju-e4d256-prod-github-runner-207 kernel: [58736.615421] ? do_futex+0x162/0x1f0 Aug 22 21:42:42 juju-e4d256-prod-github-runner-207 kernel: [58736.616148] ? __x64_sys_futex+0x78/0x1e0 Aug 22 21:42:42 juju-e4d256-prod-github-runner-207 kernel: [58736.616903] ? __secure_computing+0xa9/0x120 Aug 22 21:42:42 juju-e4d256-prod-github-runner-207 kernel: [58736.617708] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 21:42:42 juju-e4d256-prod-github-runner-207 kernel: [58736.618573] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:42:42 juju-e4d256-prod-github-runner-207 kernel: [58736.619386] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:42:42 juju-e4d256-prod-github-runner-207 kernel: [58736.620198] ? do_syscall_64+0x69/0xc0 Aug 22 21:42:42 juju-e4d256-prod-github-runner-207 kernel: [58736.620920] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:42:42 juju-e4d256-prod-github-runner-207 kernel: [58736.621752] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:42:42 juju-e4d256-prod-github-runner-207 kernel: [58736.622542] ? do_syscall_64+0x69/0xc0 Aug 22 21:42:42 juju-e4d256-prod-github-runner-207 kernel: [58736.623242] ? do_syscall_64+0x69/0xc0 Aug 22 21:42:42 juju-e4d256-prod-github-runner-207 kernel: [58736.623946] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 21:42:42 juju-e4d256-prod-github-runner-207 kernel: [58736.624753] RIP: 0033:0x7faa5d0edaff Aug 22 21:42:42 juju-e4d256-prod-github-runner-207 kernel: [58736.625474] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 21:42:42 juju-e4d256-prod-github-runner-207 kernel: [58736.627806] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 21:42:42 juju-e4d256-prod-github-runner-207 kernel: [58736.628860] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 21:42:42 juju-e4d256-prod-github-runner-207 kernel: [58736.629898] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 21:42:42 juju-e4d256-prod-github-runner-207 kernel: [58736.630926] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 21:42:42 juju-e4d256-prod-github-runner-207 kernel: [58736.631958] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 21:42:42 juju-e4d256-prod-github-runner-207 kernel: [58736.632980] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 21:42:42 juju-e4d256-prod-github-runner-207 kernel: [58736.634053] Aug 22 21:43:10 juju-e4d256-prod-github-runner-207 kernel: [58764.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 54620s! [qemu-system-x86:6715] Aug 22 21:43:10 juju-e4d256-prod-github-runner-207 kernel: [58764.543285] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 21:43:10 juju-e4d256-prod-github-runner-207 kernel: [58764.543359] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 21:43:10 juju-e4d256-prod-github-runner-207 kernel: [58764.557626] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 21:43:10 juju-e4d256-prod-github-runner-207 kernel: [58764.559077] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 21:43:10 juju-e4d256-prod-github-runner-207 kernel: [58764.560455] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:43:10 juju-e4d256-prod-github-runner-207 kernel: [58764.561635] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 21:43:10 juju-e4d256-prod-github-runner-207 kernel: [58764.564640] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 21:43:10 juju-e4d256-prod-github-runner-207 kernel: [58764.565794] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 21:43:10 juju-e4d256-prod-github-runner-207 kernel: [58764.567206] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 21:43:10 juju-e4d256-prod-github-runner-207 kernel: [58764.568508] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 21:43:10 juju-e4d256-prod-github-runner-207 kernel: [58764.569822] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 21:43:10 juju-e4d256-prod-github-runner-207 kernel: [58764.571119] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 21:43:10 juju-e4d256-prod-github-runner-207 kernel: [58764.572416] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 21:43:10 juju-e4d256-prod-github-runner-207 kernel: [58764.573817] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 21:43:10 juju-e4d256-prod-github-runner-207 kernel: [58764.575024] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 21:43:10 juju-e4d256-prod-github-runner-207 kernel: [58764.576347] Call Trace: Aug 22 21:43:10 juju-e4d256-prod-github-runner-207 kernel: [58764.577326] Aug 22 21:43:10 juju-e4d256-prod-github-runner-207 kernel: [58764.578255] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:43:10 juju-e4d256-prod-github-runner-207 kernel: [58764.579381] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:43:10 juju-e4d256-prod-github-runner-207 kernel: [58764.580514] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:43:10 juju-e4d256-prod-github-runner-207 kernel: [58764.581708] ? show_regs.part.0+0x23/0x29 Aug 22 21:43:10 juju-e4d256-prod-github-runner-207 kernel: [58764.582781] ? show_regs.cold+0x8/0xd Aug 22 21:43:10 juju-e4d256-prod-github-runner-207 kernel: [58764.583828] ? watchdog_timer_fn+0x1be/0x220 Aug 22 21:43:10 juju-e4d256-prod-github-runner-207 kernel: [58764.584923] ? lockup_detector_update_enable+0x60/0x60 Aug 22 21:43:10 juju-e4d256-prod-github-runner-207 kernel: [58764.586106] ? __hrtimer_run_queues+0x107/0x230 Aug 22 21:43:10 juju-e4d256-prod-github-runner-207 kernel: [58764.587223] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 21:43:10 juju-e4d256-prod-github-runner-207 kernel: [58764.588330] ? hrtimer_interrupt+0x101/0x220 Aug 22 21:43:10 juju-e4d256-prod-github-runner-207 kernel: [58764.589462] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 21:43:10 juju-e4d256-prod-github-runner-207 kernel: [58764.590636] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 21:43:10 juju-e4d256-prod-github-runner-207 kernel: [58764.591777] Aug 22 21:43:10 juju-e4d256-prod-github-runner-207 kernel: [58764.592676] Aug 22 21:43:10 juju-e4d256-prod-github-runner-207 kernel: [58764.593571] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 21:43:10 juju-e4d256-prod-github-runner-207 kernel: [58764.594715] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:43:10 juju-e4d256-prod-github-runner-207 kernel: [58764.595934] ? _raw_spin_lock+0x22/0x30 Aug 22 21:43:10 juju-e4d256-prod-github-runner-207 kernel: [58764.596958] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:43:10 juju-e4d256-prod-github-runner-207 kernel: [58764.598086] direct_page_fault+0x206/0x310 [kvm] Aug 22 21:43:10 juju-e4d256-prod-github-runner-207 kernel: [58764.599208] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 21:43:10 juju-e4d256-prod-github-runner-207 kernel: [58764.600310] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 21:43:10 juju-e4d256-prod-github-runner-207 kernel: [58764.601420] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 21:43:10 juju-e4d256-prod-github-runner-207 kernel: [58764.602489] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 21:43:10 juju-e4d256-prod-github-runner-207 kernel: [58764.603526] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 21:43:10 juju-e4d256-prod-github-runner-207 kernel: [58764.604614] handle_exit+0x98/0x230 [kvm_amd] Aug 22 21:43:10 juju-e4d256-prod-github-runner-207 kernel: [58764.605610] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 21:43:10 juju-e4d256-prod-github-runner-207 kernel: [58764.606629] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 21:43:10 juju-e4d256-prod-github-runner-207 kernel: [58764.607659] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 21:43:10 juju-e4d256-prod-github-runner-207 kernel: [58764.608664] vcpu_run+0x62/0x2c0 [kvm] Aug 22 21:43:10 juju-e4d256-prod-github-runner-207 kernel: [58764.609576] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 21:43:10 juju-e4d256-prod-github-runner-207 kernel: [58764.610488] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 21:43:10 juju-e4d256-prod-github-runner-207 kernel: [58764.611444] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 21:43:10 juju-e4d256-prod-github-runner-207 kernel: [58764.612333] ? __seccomp_filter+0x4a/0x4a0 Aug 22 21:43:10 juju-e4d256-prod-github-runner-207 kernel: [58764.613158] ? __fget_files+0x86/0xc0 Aug 22 21:43:10 juju-e4d256-prod-github-runner-207 kernel: [58764.613954] __x64_sys_ioctl+0x95/0xd0 Aug 22 21:43:10 juju-e4d256-prod-github-runner-207 kernel: [58764.614723] do_syscall_64+0x5c/0xc0 Aug 22 21:43:10 juju-e4d256-prod-github-runner-207 kernel: [58764.615465] ? do_futex+0x162/0x1f0 Aug 22 21:43:10 juju-e4d256-prod-github-runner-207 kernel: [58764.616186] ? __x64_sys_futex+0x78/0x1e0 Aug 22 21:43:10 juju-e4d256-prod-github-runner-207 kernel: [58764.616941] ? __secure_computing+0xa9/0x120 Aug 22 21:43:10 juju-e4d256-prod-github-runner-207 kernel: [58764.617728] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 21:43:10 juju-e4d256-prod-github-runner-207 kernel: [58764.618596] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:43:10 juju-e4d256-prod-github-runner-207 kernel: [58764.619413] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:43:10 juju-e4d256-prod-github-runner-207 kernel: [58764.620232] ? do_syscall_64+0x69/0xc0 Aug 22 21:43:10 juju-e4d256-prod-github-runner-207 kernel: [58764.620958] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:43:10 juju-e4d256-prod-github-runner-207 kernel: [58764.621766] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:43:10 juju-e4d256-prod-github-runner-207 kernel: [58764.622557] ? do_syscall_64+0x69/0xc0 Aug 22 21:43:10 juju-e4d256-prod-github-runner-207 kernel: [58764.623263] ? do_syscall_64+0x69/0xc0 Aug 22 21:43:10 juju-e4d256-prod-github-runner-207 kernel: [58764.623971] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 21:43:10 juju-e4d256-prod-github-runner-207 kernel: [58764.624786] RIP: 0033:0x7faa5d0edaff Aug 22 21:43:10 juju-e4d256-prod-github-runner-207 kernel: [58764.625509] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 21:43:10 juju-e4d256-prod-github-runner-207 kernel: [58764.627847] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 21:43:10 juju-e4d256-prod-github-runner-207 kernel: [58764.628896] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 21:43:10 juju-e4d256-prod-github-runner-207 kernel: [58764.629934] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 21:43:10 juju-e4d256-prod-github-runner-207 kernel: [58764.630968] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 21:43:10 juju-e4d256-prod-github-runner-207 kernel: [58764.631990] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 21:43:10 juju-e4d256-prod-github-runner-207 kernel: [58764.633010] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 21:43:10 juju-e4d256-prod-github-runner-207 kernel: [58764.634056] Aug 22 21:43:38 juju-e4d256-prod-github-runner-207 kernel: [58792.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 54646s! [qemu-system-x86:6715] Aug 22 21:43:38 juju-e4d256-prod-github-runner-207 kernel: [58792.543118] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 21:43:38 juju-e4d256-prod-github-runner-207 kernel: [58792.543191] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 21:43:38 juju-e4d256-prod-github-runner-207 kernel: [58792.555413] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 21:43:38 juju-e4d256-prod-github-runner-207 kernel: [58792.556674] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 21:43:38 juju-e4d256-prod-github-runner-207 kernel: [58792.557901] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:43:38 juju-e4d256-prod-github-runner-207 kernel: [58792.558960] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 21:43:38 juju-e4d256-prod-github-runner-207 kernel: [58792.561571] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 21:43:38 juju-e4d256-prod-github-runner-207 kernel: [58792.562617] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 21:43:38 juju-e4d256-prod-github-runner-207 kernel: [58792.563777] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 21:43:38 juju-e4d256-prod-github-runner-207 kernel: [58792.564951] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 21:43:38 juju-e4d256-prod-github-runner-207 kernel: [58792.566111] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 21:43:38 juju-e4d256-prod-github-runner-207 kernel: [58792.567269] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 21:43:38 juju-e4d256-prod-github-runner-207 kernel: [58792.568439] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 21:43:38 juju-e4d256-prod-github-runner-207 kernel: [58792.569687] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 21:43:38 juju-e4d256-prod-github-runner-207 kernel: [58792.570800] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 21:43:38 juju-e4d256-prod-github-runner-207 kernel: [58792.572039] Call Trace: Aug 22 21:43:38 juju-e4d256-prod-github-runner-207 kernel: [58792.572975] Aug 22 21:43:38 juju-e4d256-prod-github-runner-207 kernel: [58792.573863] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:43:38 juju-e4d256-prod-github-runner-207 kernel: [58792.574895] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:43:38 juju-e4d256-prod-github-runner-207 kernel: [58792.575911] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:43:38 juju-e4d256-prod-github-runner-207 kernel: [58792.577040] ? show_regs.part.0+0x23/0x29 Aug 22 21:43:38 juju-e4d256-prod-github-runner-207 kernel: [58792.578053] ? show_regs.cold+0x8/0xd Aug 22 21:43:38 juju-e4d256-prod-github-runner-207 kernel: [58792.579022] ? watchdog_timer_fn+0x1be/0x220 Aug 22 21:43:38 juju-e4d256-prod-github-runner-207 kernel: [58792.580029] ? lockup_detector_update_enable+0x60/0x60 Aug 22 21:43:38 juju-e4d256-prod-github-runner-207 kernel: [58792.581132] ? __hrtimer_run_queues+0x107/0x230 Aug 22 21:43:38 juju-e4d256-prod-github-runner-207 kernel: [58792.582173] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 21:43:38 juju-e4d256-prod-github-runner-207 kernel: [58792.583221] ? hrtimer_interrupt+0x101/0x220 Aug 22 21:43:38 juju-e4d256-prod-github-runner-207 kernel: [58792.584245] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 21:43:38 juju-e4d256-prod-github-runner-207 kernel: [58792.585365] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 21:43:38 juju-e4d256-prod-github-runner-207 kernel: [58792.586409] Aug 22 21:43:38 juju-e4d256-prod-github-runner-207 kernel: [58792.587264] Aug 22 21:43:38 juju-e4d256-prod-github-runner-207 kernel: [58792.588100] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 21:43:38 juju-e4d256-prod-github-runner-207 kernel: [58792.589159] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:43:38 juju-e4d256-prod-github-runner-207 kernel: [58792.590201] ? _raw_spin_lock+0x22/0x30 Aug 22 21:43:38 juju-e4d256-prod-github-runner-207 kernel: [58792.591147] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:43:38 juju-e4d256-prod-github-runner-207 kernel: [58792.592163] direct_page_fault+0x206/0x310 [kvm] Aug 22 21:43:38 juju-e4d256-prod-github-runner-207 kernel: [58792.593229] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 21:43:38 juju-e4d256-prod-github-runner-207 kernel: [58792.594248] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 21:43:38 juju-e4d256-prod-github-runner-207 kernel: [58792.595263] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 21:43:38 juju-e4d256-prod-github-runner-207 kernel: [58792.596237] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 21:43:38 juju-e4d256-prod-github-runner-207 kernel: [58792.597198] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 21:43:38 juju-e4d256-prod-github-runner-207 kernel: [58792.598174] handle_exit+0x98/0x230 [kvm_amd] Aug 22 21:43:38 juju-e4d256-prod-github-runner-207 kernel: [58792.599066] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 21:43:38 juju-e4d256-prod-github-runner-207 kernel: [58792.600001] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 21:43:38 juju-e4d256-prod-github-runner-207 kernel: [58792.600966] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 21:43:38 juju-e4d256-prod-github-runner-207 kernel: [58792.601894] vcpu_run+0x62/0x2c0 [kvm] Aug 22 21:43:38 juju-e4d256-prod-github-runner-207 kernel: [58792.602712] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 21:43:38 juju-e4d256-prod-github-runner-207 kernel: [58792.603585] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 21:43:38 juju-e4d256-prod-github-runner-207 kernel: [58792.604438] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 21:43:38 juju-e4d256-prod-github-runner-207 kernel: [58792.605260] ? __seccomp_filter+0x4a/0x4a0 Aug 22 21:43:38 juju-e4d256-prod-github-runner-207 kernel: [58792.606007] ? __fget_files+0x86/0xc0 Aug 22 21:43:38 juju-e4d256-prod-github-runner-207 kernel: [58792.606734] __x64_sys_ioctl+0x95/0xd0 Aug 22 21:43:38 juju-e4d256-prod-github-runner-207 kernel: [58792.607444] do_syscall_64+0x5c/0xc0 Aug 22 21:43:38 juju-e4d256-prod-github-runner-207 kernel: [58792.608208] ? do_futex+0x162/0x1f0 Aug 22 21:43:38 juju-e4d256-prod-github-runner-207 kernel: [58792.608856] ? __x64_sys_futex+0x78/0x1e0 Aug 22 21:43:38 juju-e4d256-prod-github-runner-207 kernel: [58792.609542] ? __secure_computing+0xa9/0x120 Aug 22 21:43:38 juju-e4d256-prod-github-runner-207 kernel: [58792.610231] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 21:43:38 juju-e4d256-prod-github-runner-207 kernel: [58792.610989] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:43:38 juju-e4d256-prod-github-runner-207 kernel: [58792.611710] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:43:38 juju-e4d256-prod-github-runner-207 kernel: [58792.612432] ? do_syscall_64+0x69/0xc0 Aug 22 21:43:38 juju-e4d256-prod-github-runner-207 kernel: [58792.613140] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:43:38 juju-e4d256-prod-github-runner-207 kernel: [58792.613860] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:43:38 juju-e4d256-prod-github-runner-207 kernel: [58792.614563] ? do_syscall_64+0x69/0xc0 Aug 22 21:43:38 juju-e4d256-prod-github-runner-207 kernel: [58792.615192] ? do_syscall_64+0x69/0xc0 Aug 22 21:43:38 juju-e4d256-prod-github-runner-207 kernel: [58792.615823] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 21:43:38 juju-e4d256-prod-github-runner-207 kernel: [58792.616533] RIP: 0033:0x7faa5d0edaff Aug 22 21:43:38 juju-e4d256-prod-github-runner-207 kernel: [58792.617184] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 21:43:38 juju-e4d256-prod-github-runner-207 kernel: [58792.619180] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 21:43:38 juju-e4d256-prod-github-runner-207 kernel: [58792.620098] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 21:43:38 juju-e4d256-prod-github-runner-207 kernel: [58792.621015] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 21:43:38 juju-e4d256-prod-github-runner-207 kernel: [58792.621912] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 21:43:38 juju-e4d256-prod-github-runner-207 kernel: [58792.622806] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 21:43:38 juju-e4d256-prod-github-runner-207 kernel: [58792.623712] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 21:43:38 juju-e4d256-prod-github-runner-207 kernel: [58792.624640] Aug 22 21:44:06 juju-e4d256-prod-github-runner-207 kernel: [58820.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 54672s! [qemu-system-x86:6715] Aug 22 21:44:06 juju-e4d256-prod-github-runner-207 kernel: [58820.543406] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 21:44:06 juju-e4d256-prod-github-runner-207 kernel: [58820.543503] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 21:44:06 juju-e4d256-prod-github-runner-207 kernel: [58820.556139] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 21:44:06 juju-e4d256-prod-github-runner-207 kernel: [58820.557421] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 21:44:06 juju-e4d256-prod-github-runner-207 kernel: [58820.558660] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:44:06 juju-e4d256-prod-github-runner-207 kernel: [58820.559726] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 21:44:06 juju-e4d256-prod-github-runner-207 kernel: [58820.562285] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 21:44:06 juju-e4d256-prod-github-runner-207 kernel: [58820.563327] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 21:44:06 juju-e4d256-prod-github-runner-207 kernel: [58820.564489] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 21:44:06 juju-e4d256-prod-github-runner-207 kernel: [58820.565693] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 21:44:06 juju-e4d256-prod-github-runner-207 kernel: [58820.567038] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 21:44:06 juju-e4d256-prod-github-runner-207 kernel: [58820.568200] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 21:44:06 juju-e4d256-prod-github-runner-207 kernel: [58820.569537] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 21:44:06 juju-e4d256-prod-github-runner-207 kernel: [58820.570778] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 21:44:06 juju-e4d256-prod-github-runner-207 kernel: [58820.571891] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 21:44:06 juju-e4d256-prod-github-runner-207 kernel: [58820.573108] Call Trace: Aug 22 21:44:06 juju-e4d256-prod-github-runner-207 kernel: [58820.574023] Aug 22 21:44:06 juju-e4d256-prod-github-runner-207 kernel: [58820.574914] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:44:06 juju-e4d256-prod-github-runner-207 kernel: [58820.575962] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:44:06 juju-e4d256-prod-github-runner-207 kernel: [58820.577013] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:44:06 juju-e4d256-prod-github-runner-207 kernel: [58820.578103] ? show_regs.part.0+0x23/0x29 Aug 22 21:44:06 juju-e4d256-prod-github-runner-207 kernel: [58820.579154] ? show_regs.cold+0x8/0xd Aug 22 21:44:06 juju-e4d256-prod-github-runner-207 kernel: [58820.580134] ? watchdog_timer_fn+0x1be/0x220 Aug 22 21:44:06 juju-e4d256-prod-github-runner-207 kernel: [58820.581901] ? lockup_detector_update_enable+0x60/0x60 Aug 22 21:44:06 juju-e4d256-prod-github-runner-207 kernel: [58820.582991] ? __hrtimer_run_queues+0x107/0x230 Aug 22 21:44:06 juju-e4d256-prod-github-runner-207 kernel: [58820.584028] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 21:44:06 juju-e4d256-prod-github-runner-207 kernel: [58820.585075] ? hrtimer_interrupt+0x101/0x220 Aug 22 21:44:06 juju-e4d256-prod-github-runner-207 kernel: [58820.586105] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 21:44:06 juju-e4d256-prod-github-runner-207 kernel: [58820.587206] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 21:44:06 juju-e4d256-prod-github-runner-207 kernel: [58820.588268] Aug 22 21:44:06 juju-e4d256-prod-github-runner-207 kernel: [58820.589148] Aug 22 21:44:06 juju-e4d256-prod-github-runner-207 kernel: [58820.590003] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 21:44:06 juju-e4d256-prod-github-runner-207 kernel: [58820.591058] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:44:06 juju-e4d256-prod-github-runner-207 kernel: [58820.592141] ? _raw_spin_lock+0x22/0x30 Aug 22 21:44:06 juju-e4d256-prod-github-runner-207 kernel: [58820.593132] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:44:06 juju-e4d256-prod-github-runner-207 kernel: [58820.594183] direct_page_fault+0x206/0x310 [kvm] Aug 22 21:44:06 juju-e4d256-prod-github-runner-207 kernel: [58820.595216] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 21:44:06 juju-e4d256-prod-github-runner-207 kernel: [58820.596246] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 21:44:06 juju-e4d256-prod-github-runner-207 kernel: [58820.597286] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 21:44:06 juju-e4d256-prod-github-runner-207 kernel: [58820.598279] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 21:44:06 juju-e4d256-prod-github-runner-207 kernel: [58820.599223] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 21:44:06 juju-e4d256-prod-github-runner-207 kernel: [58820.600204] handle_exit+0x98/0x230 [kvm_amd] Aug 22 21:44:06 juju-e4d256-prod-github-runner-207 kernel: [58820.601123] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 21:44:06 juju-e4d256-prod-github-runner-207 kernel: [58820.602054] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 21:44:06 juju-e4d256-prod-github-runner-207 kernel: [58820.602989] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 21:44:06 juju-e4d256-prod-github-runner-207 kernel: [58820.603898] vcpu_run+0x62/0x2c0 [kvm] Aug 22 21:44:06 juju-e4d256-prod-github-runner-207 kernel: [58820.604728] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 21:44:06 juju-e4d256-prod-github-runner-207 kernel: [58820.605538] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 21:44:06 juju-e4d256-prod-github-runner-207 kernel: [58820.606414] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 21:44:06 juju-e4d256-prod-github-runner-207 kernel: [58820.607220] ? __seccomp_filter+0x4a/0x4a0 Aug 22 21:44:06 juju-e4d256-prod-github-runner-207 kernel: [58820.608006] ? __fget_files+0x86/0xc0 Aug 22 21:44:06 juju-e4d256-prod-github-runner-207 kernel: [58820.608743] __x64_sys_ioctl+0x95/0xd0 Aug 22 21:44:06 juju-e4d256-prod-github-runner-207 kernel: [58820.609438] do_syscall_64+0x5c/0xc0 Aug 22 21:44:06 juju-e4d256-prod-github-runner-207 kernel: [58820.612160] ? do_futex+0x162/0x1f0 Aug 22 21:44:06 juju-e4d256-prod-github-runner-207 kernel: [58820.612846] ? __x64_sys_futex+0x78/0x1e0 Aug 22 21:44:06 juju-e4d256-prod-github-runner-207 kernel: [58820.613534] ? __secure_computing+0xa9/0x120 Aug 22 21:44:06 juju-e4d256-prod-github-runner-207 kernel: [58820.614226] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 21:44:06 juju-e4d256-prod-github-runner-207 kernel: [58820.614996] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:44:06 juju-e4d256-prod-github-runner-207 kernel: [58820.617769] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:44:06 juju-e4d256-prod-github-runner-207 kernel: [58820.618513] ? do_syscall_64+0x69/0xc0 Aug 22 21:44:06 juju-e4d256-prod-github-runner-207 kernel: [58820.619163] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:44:06 juju-e4d256-prod-github-runner-207 kernel: [58820.619889] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:44:06 juju-e4d256-prod-github-runner-207 kernel: [58820.620600] ? do_syscall_64+0x69/0xc0 Aug 22 21:44:06 juju-e4d256-prod-github-runner-207 kernel: [58820.621224] ? do_syscall_64+0x69/0xc0 Aug 22 21:44:06 juju-e4d256-prod-github-runner-207 kernel: [58820.621852] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 21:44:06 juju-e4d256-prod-github-runner-207 kernel: [58820.622576] RIP: 0033:0x7faa5d0edaff Aug 22 21:44:06 juju-e4d256-prod-github-runner-207 kernel: [58820.623211] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 21:44:06 juju-e4d256-prod-github-runner-207 kernel: [58820.625236] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 21:44:06 juju-e4d256-prod-github-runner-207 kernel: [58820.626148] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 21:44:06 juju-e4d256-prod-github-runner-207 kernel: [58820.627036] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 21:44:06 juju-e4d256-prod-github-runner-207 kernel: [58820.627950] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 21:44:06 juju-e4d256-prod-github-runner-207 kernel: [58820.628882] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 21:44:06 juju-e4d256-prod-github-runner-207 kernel: [58820.629779] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 21:44:06 juju-e4d256-prod-github-runner-207 kernel: [58820.630674] Aug 22 21:44:34 juju-e4d256-prod-github-runner-207 kernel: [58848.541981] watchdog: BUG: soft lockup - CPU#1 stuck for 54698s! [qemu-system-x86:6715] Aug 22 21:44:34 juju-e4d256-prod-github-runner-207 kernel: [58848.543859] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 21:44:34 juju-e4d256-prod-github-runner-207 kernel: [58848.544161] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 21:44:34 juju-e4d256-prod-github-runner-207 kernel: [58848.557175] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 21:44:34 juju-e4d256-prod-github-runner-207 kernel: [58848.558476] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 21:44:34 juju-e4d256-prod-github-runner-207 kernel: [58848.559720] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:44:34 juju-e4d256-prod-github-runner-207 kernel: [58848.560816] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 21:44:34 juju-e4d256-prod-github-runner-207 kernel: [58848.563466] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 21:44:34 juju-e4d256-prod-github-runner-207 kernel: [58848.564568] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 21:44:34 juju-e4d256-prod-github-runner-207 kernel: [58848.565756] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 21:44:34 juju-e4d256-prod-github-runner-207 kernel: [58848.566935] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 21:44:34 juju-e4d256-prod-github-runner-207 kernel: [58848.568108] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 21:44:34 juju-e4d256-prod-github-runner-207 kernel: [58848.569296] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 21:44:34 juju-e4d256-prod-github-runner-207 kernel: [58848.570472] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 21:44:34 juju-e4d256-prod-github-runner-207 kernel: [58848.571741] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 21:44:34 juju-e4d256-prod-github-runner-207 kernel: [58848.572904] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 21:44:34 juju-e4d256-prod-github-runner-207 kernel: [58848.574124] Call Trace: Aug 22 21:44:34 juju-e4d256-prod-github-runner-207 kernel: [58848.575098] Aug 22 21:44:34 juju-e4d256-prod-github-runner-207 kernel: [58848.576044] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:44:34 juju-e4d256-prod-github-runner-207 kernel: [58848.577113] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:44:34 juju-e4d256-prod-github-runner-207 kernel: [58848.578139] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:44:34 juju-e4d256-prod-github-runner-207 kernel: [58848.579213] ? show_regs.part.0+0x23/0x29 Aug 22 21:44:34 juju-e4d256-prod-github-runner-207 kernel: [58848.580227] ? show_regs.cold+0x8/0xd Aug 22 21:44:34 juju-e4d256-prod-github-runner-207 kernel: [58848.581200] ? watchdog_timer_fn+0x1be/0x220 Aug 22 21:44:34 juju-e4d256-prod-github-runner-207 kernel: [58848.582225] ? lockup_detector_update_enable+0x60/0x60 Aug 22 21:44:34 juju-e4d256-prod-github-runner-207 kernel: [58848.583290] ? __hrtimer_run_queues+0x107/0x230 Aug 22 21:44:34 juju-e4d256-prod-github-runner-207 kernel: [58848.584335] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 21:44:34 juju-e4d256-prod-github-runner-207 kernel: [58848.585458] ? hrtimer_interrupt+0x101/0x220 Aug 22 21:44:34 juju-e4d256-prod-github-runner-207 kernel: [58848.586588] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 21:44:34 juju-e4d256-prod-github-runner-207 kernel: [58848.587711] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 21:44:34 juju-e4d256-prod-github-runner-207 kernel: [58848.588791] Aug 22 21:44:34 juju-e4d256-prod-github-runner-207 kernel: [58848.589653] Aug 22 21:44:34 juju-e4d256-prod-github-runner-207 kernel: [58848.590493] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 21:44:34 juju-e4d256-prod-github-runner-207 kernel: [58848.591523] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:44:34 juju-e4d256-prod-github-runner-207 kernel: [58848.592583] ? _raw_spin_lock+0x22/0x30 Aug 22 21:44:34 juju-e4d256-prod-github-runner-207 kernel: [58848.593533] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:44:34 juju-e4d256-prod-github-runner-207 kernel: [58848.594549] direct_page_fault+0x206/0x310 [kvm] Aug 22 21:44:34 juju-e4d256-prod-github-runner-207 kernel: [58848.595571] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 21:44:34 juju-e4d256-prod-github-runner-207 kernel: [58848.596599] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 21:44:34 juju-e4d256-prod-github-runner-207 kernel: [58848.597604] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 21:44:34 juju-e4d256-prod-github-runner-207 kernel: [58848.598692] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 21:44:34 juju-e4d256-prod-github-runner-207 kernel: [58848.599733] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 21:44:34 juju-e4d256-prod-github-runner-207 kernel: [58848.600829] handle_exit+0x98/0x230 [kvm_amd] Aug 22 21:44:34 juju-e4d256-prod-github-runner-207 kernel: [58848.601808] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 21:44:34 juju-e4d256-prod-github-runner-207 kernel: [58848.602850] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 21:44:34 juju-e4d256-prod-github-runner-207 kernel: [58848.603900] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 21:44:34 juju-e4d256-prod-github-runner-207 kernel: [58848.604922] vcpu_run+0x62/0x2c0 [kvm] Aug 22 21:44:34 juju-e4d256-prod-github-runner-207 kernel: [58848.605807] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 21:44:34 juju-e4d256-prod-github-runner-207 kernel: [58848.606696] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 21:44:34 juju-e4d256-prod-github-runner-207 kernel: [58848.607645] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 21:44:34 juju-e4d256-prod-github-runner-207 kernel: [58848.608548] ? __seccomp_filter+0x4a/0x4a0 Aug 22 21:44:34 juju-e4d256-prod-github-runner-207 kernel: [58848.609377] ? __fget_files+0x86/0xc0 Aug 22 21:44:34 juju-e4d256-prod-github-runner-207 kernel: [58848.610160] __x64_sys_ioctl+0x95/0xd0 Aug 22 21:44:34 juju-e4d256-prod-github-runner-207 kernel: [58848.610927] do_syscall_64+0x5c/0xc0 Aug 22 21:44:34 juju-e4d256-prod-github-runner-207 kernel: [58848.611658] ? do_futex+0x162/0x1f0 Aug 22 21:44:34 juju-e4d256-prod-github-runner-207 kernel: [58848.612417] ? __x64_sys_futex+0x78/0x1e0 Aug 22 21:44:34 juju-e4d256-prod-github-runner-207 kernel: [58848.613188] ? __secure_computing+0xa9/0x120 Aug 22 21:44:34 juju-e4d256-prod-github-runner-207 kernel: [58848.613978] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 21:44:34 juju-e4d256-prod-github-runner-207 kernel: [58848.614835] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:44:34 juju-e4d256-prod-github-runner-207 kernel: [58848.615643] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:44:34 juju-e4d256-prod-github-runner-207 kernel: [58848.616538] ? do_syscall_64+0x69/0xc0 Aug 22 21:44:34 juju-e4d256-prod-github-runner-207 kernel: [58848.617236] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:44:34 juju-e4d256-prod-github-runner-207 kernel: [58848.617968] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:44:34 juju-e4d256-prod-github-runner-207 kernel: [58848.618770] ? do_syscall_64+0x69/0xc0 Aug 22 21:44:34 juju-e4d256-prod-github-runner-207 kernel: [58848.619472] ? do_syscall_64+0x69/0xc0 Aug 22 21:44:34 juju-e4d256-prod-github-runner-207 kernel: [58848.620167] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 21:44:34 juju-e4d256-prod-github-runner-207 kernel: [58848.620987] RIP: 0033:0x7faa5d0edaff Aug 22 21:44:34 juju-e4d256-prod-github-runner-207 kernel: [58848.621726] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 21:44:34 juju-e4d256-prod-github-runner-207 kernel: [58848.624055] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 21:44:34 juju-e4d256-prod-github-runner-207 kernel: [58848.625140] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 21:44:34 juju-e4d256-prod-github-runner-207 kernel: [58848.626176] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 21:44:34 juju-e4d256-prod-github-runner-207 kernel: [58848.627193] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 21:44:34 juju-e4d256-prod-github-runner-207 kernel: [58848.628231] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 21:44:34 juju-e4d256-prod-github-runner-207 kernel: [58848.629250] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 21:44:34 juju-e4d256-prod-github-runner-207 kernel: [58848.630267] Aug 22 21:44:47 juju-e4d256-prod-github-runner-207 kernel: [58861.112710] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 21:44:47 juju-e4d256-prod-github-runner-207 kernel: [58861.113710] rcu: 1-....: (14639751 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=7074552 Aug 22 21:44:47 juju-e4d256-prod-github-runner-207 kernel: [58861.114976] (t=14685978 jiffies g=23269 q=53223) Aug 22 21:44:47 juju-e4d256-prod-github-runner-207 kernel: [58861.115848] NMI backtrace for cpu 1 Aug 22 21:44:47 juju-e4d256-prod-github-runner-207 kernel: [58861.116664] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 21:44:47 juju-e4d256-prod-github-runner-207 kernel: [58861.117823] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 21:44:47 juju-e4d256-prod-github-runner-207 kernel: [58861.119011] Call Trace: Aug 22 21:44:47 juju-e4d256-prod-github-runner-207 kernel: [58861.119736] Aug 22 21:44:47 juju-e4d256-prod-github-runner-207 kernel: [58861.120411] show_stack+0x52/0x5c Aug 22 21:44:47 juju-e4d256-prod-github-runner-207 kernel: [58861.121231] dump_stack_lvl+0x4a/0x63 Aug 22 21:44:47 juju-e4d256-prod-github-runner-207 kernel: [58861.122046] dump_stack+0x10/0x16 Aug 22 21:44:47 juju-e4d256-prod-github-runner-207 kernel: [58861.122798] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 21:44:47 juju-e4d256-prod-github-runner-207 kernel: [58861.123715] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 21:44:47 juju-e4d256-prod-github-runner-207 kernel: [58861.124527] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 21:44:47 juju-e4d256-prod-github-runner-207 kernel: [58861.125380] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 21:44:47 juju-e4d256-prod-github-runner-207 kernel: [58861.126238] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 21:44:47 juju-e4d256-prod-github-runner-207 kernel: [58861.127099] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 21:44:47 juju-e4d256-prod-github-runner-207 kernel: [58861.127945] print_cpu_stall.cold+0x2f/0xe2 Aug 22 21:44:47 juju-e4d256-prod-github-runner-207 kernel: [58861.128822] ? timekeeping_update+0xf7/0x150 Aug 22 21:44:47 juju-e4d256-prod-github-runner-207 kernel: [58861.129655] check_cpu_stall+0x109/0x270 Aug 22 21:44:47 juju-e4d256-prod-github-runner-207 kernel: [58861.130422] rcu_sched_clock_irq+0x9a/0x250 Aug 22 21:44:47 juju-e4d256-prod-github-runner-207 kernel: [58861.131453] update_process_times+0x94/0xd0 Aug 22 21:44:47 juju-e4d256-prod-github-runner-207 kernel: [58861.132517] tick_sched_handle+0x29/0x70 Aug 22 21:44:47 juju-e4d256-prod-github-runner-207 kernel: [58861.133526] tick_sched_timer+0x8c/0xc0 Aug 22 21:44:47 juju-e4d256-prod-github-runner-207 kernel: [58861.134521] ? tick_nohz_handler+0xb0/0xb0 Aug 22 21:44:47 juju-e4d256-prod-github-runner-207 kernel: [58861.135565] __hrtimer_run_queues+0x107/0x230 Aug 22 21:44:47 juju-e4d256-prod-github-runner-207 kernel: [58861.136628] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 21:44:47 juju-e4d256-prod-github-runner-207 kernel: [58861.137689] hrtimer_interrupt+0x101/0x220 Aug 22 21:44:47 juju-e4d256-prod-github-runner-207 kernel: [58861.138759] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 21:44:47 juju-e4d256-prod-github-runner-207 kernel: [58861.139883] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 21:44:47 juju-e4d256-prod-github-runner-207 kernel: [58861.140999] Aug 22 21:44:47 juju-e4d256-prod-github-runner-207 kernel: [58861.141892] Aug 22 21:44:47 juju-e4d256-prod-github-runner-207 kernel: [58861.142764] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 21:44:47 juju-e4d256-prod-github-runner-207 kernel: [58861.143880] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:44:47 juju-e4d256-prod-github-runner-207 kernel: [58861.145102] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 21:44:47 juju-e4d256-prod-github-runner-207 kernel: [58861.148086] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 21:44:47 juju-e4d256-prod-github-runner-207 kernel: [58861.149266] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 21:44:47 juju-e4d256-prod-github-runner-207 kernel: [58861.150271] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 21:44:47 juju-e4d256-prod-github-runner-207 kernel: [58861.151248] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 21:44:47 juju-e4d256-prod-github-runner-207 kernel: [58861.152241] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 21:44:47 juju-e4d256-prod-github-runner-207 kernel: [58861.153204] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 21:44:47 juju-e4d256-prod-github-runner-207 kernel: [58861.154170] ? _raw_spin_lock+0x22/0x30 Aug 22 21:44:47 juju-e4d256-prod-github-runner-207 kernel: [58861.154934] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:44:47 juju-e4d256-prod-github-runner-207 kernel: [58861.155770] direct_page_fault+0x206/0x310 [kvm] Aug 22 21:44:47 juju-e4d256-prod-github-runner-207 kernel: [58861.156628] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 21:44:47 juju-e4d256-prod-github-runner-207 kernel: [58861.157607] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 21:44:47 juju-e4d256-prod-github-runner-207 kernel: [58861.158756] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 21:44:47 juju-e4d256-prod-github-runner-207 kernel: [58861.159845] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 21:44:47 juju-e4d256-prod-github-runner-207 kernel: [58861.160945] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 21:44:47 juju-e4d256-prod-github-runner-207 kernel: [58861.162080] handle_exit+0x98/0x230 [kvm_amd] Aug 22 21:44:47 juju-e4d256-prod-github-runner-207 kernel: [58861.163093] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 21:44:47 juju-e4d256-prod-github-runner-207 kernel: [58861.164186] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 21:44:47 juju-e4d256-prod-github-runner-207 kernel: [58861.165262] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 21:44:47 juju-e4d256-prod-github-runner-207 kernel: [58861.166326] vcpu_run+0x62/0x2c0 [kvm] Aug 22 21:44:47 juju-e4d256-prod-github-runner-207 kernel: [58861.167279] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 21:44:47 juju-e4d256-prod-github-runner-207 kernel: [58861.168303] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 21:44:47 juju-e4d256-prod-github-runner-207 kernel: [58861.169395] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 21:44:47 juju-e4d256-prod-github-runner-207 kernel: [58861.170425] ? __seccomp_filter+0x4a/0x4a0 Aug 22 21:44:47 juju-e4d256-prod-github-runner-207 kernel: [58861.171277] ? __fget_files+0x86/0xc0 Aug 22 21:44:47 juju-e4d256-prod-github-runner-207 kernel: [58861.171975] __x64_sys_ioctl+0x95/0xd0 Aug 22 21:44:47 juju-e4d256-prod-github-runner-207 kernel: [58861.172685] do_syscall_64+0x5c/0xc0 Aug 22 21:44:47 juju-e4d256-prod-github-runner-207 kernel: [58861.173369] ? do_futex+0x162/0x1f0 Aug 22 21:44:47 juju-e4d256-prod-github-runner-207 kernel: [58861.174045] ? __x64_sys_futex+0x78/0x1e0 Aug 22 21:44:47 juju-e4d256-prod-github-runner-207 kernel: [58861.174750] ? __secure_computing+0xa9/0x120 Aug 22 21:44:47 juju-e4d256-prod-github-runner-207 kernel: [58861.175474] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 21:44:47 juju-e4d256-prod-github-runner-207 kernel: [58861.176282] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:44:47 juju-e4d256-prod-github-runner-207 kernel: [58861.177039] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:44:47 juju-e4d256-prod-github-runner-207 kernel: [58861.177796] ? do_syscall_64+0x69/0xc0 Aug 22 21:44:47 juju-e4d256-prod-github-runner-207 kernel: [58861.178487] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:44:47 juju-e4d256-prod-github-runner-207 kernel: [58861.179244] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:44:47 juju-e4d256-prod-github-runner-207 kernel: [58861.180006] ? do_syscall_64+0x69/0xc0 Aug 22 21:44:47 juju-e4d256-prod-github-runner-207 kernel: [58861.180715] ? do_syscall_64+0x69/0xc0 Aug 22 21:44:47 juju-e4d256-prod-github-runner-207 kernel: [58861.181411] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 21:44:47 juju-e4d256-prod-github-runner-207 kernel: [58861.182239] RIP: 0033:0x7faa5d0edaff Aug 22 21:44:47 juju-e4d256-prod-github-runner-207 kernel: [58861.183182] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 21:44:47 juju-e4d256-prod-github-runner-207 kernel: [58861.186059] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 21:44:47 juju-e4d256-prod-github-runner-207 kernel: [58861.187395] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 21:44:47 juju-e4d256-prod-github-runner-207 kernel: [58861.188683] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 21:44:47 juju-e4d256-prod-github-runner-207 kernel: [58861.189640] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 21:44:47 juju-e4d256-prod-github-runner-207 kernel: [58861.190878] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 21:44:47 juju-e4d256-prod-github-runner-207 kernel: [58861.192163] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 21:44:47 juju-e4d256-prod-github-runner-207 kernel: [58861.193435] Aug 22 21:45:14 juju-e4d256-prod-github-runner-207 kernel: [58888.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 54736s! [qemu-system-x86:6715] Aug 22 21:45:14 juju-e4d256-prod-github-runner-207 kernel: [58888.543150] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 21:45:14 juju-e4d256-prod-github-runner-207 kernel: [58888.543218] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 21:45:14 juju-e4d256-prod-github-runner-207 kernel: [58888.555437] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 21:45:14 juju-e4d256-prod-github-runner-207 kernel: [58888.558964] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 21:45:14 juju-e4d256-prod-github-runner-207 kernel: [58888.560230] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:45:14 juju-e4d256-prod-github-runner-207 kernel: [58888.561304] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 21:45:14 juju-e4d256-prod-github-runner-207 kernel: [58888.563875] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 21:45:14 juju-e4d256-prod-github-runner-207 kernel: [58888.564921] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 21:45:14 juju-e4d256-prod-github-runner-207 kernel: [58888.566082] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 21:45:14 juju-e4d256-prod-github-runner-207 kernel: [58888.567290] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 21:45:14 juju-e4d256-prod-github-runner-207 kernel: [58888.568472] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 21:45:14 juju-e4d256-prod-github-runner-207 kernel: [58888.569654] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 21:45:14 juju-e4d256-prod-github-runner-207 kernel: [58888.570821] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 21:45:14 juju-e4d256-prod-github-runner-207 kernel: [58888.572068] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 21:45:14 juju-e4d256-prod-github-runner-207 kernel: [58888.573169] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 21:45:14 juju-e4d256-prod-github-runner-207 kernel: [58888.574361] Call Trace: Aug 22 21:45:14 juju-e4d256-prod-github-runner-207 kernel: [58888.575271] Aug 22 21:45:14 juju-e4d256-prod-github-runner-207 kernel: [58888.576359] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:45:14 juju-e4d256-prod-github-runner-207 kernel: [58888.577393] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:45:14 juju-e4d256-prod-github-runner-207 kernel: [58888.578467] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:45:14 juju-e4d256-prod-github-runner-207 kernel: [58888.579762] ? show_regs.part.0+0x23/0x29 Aug 22 21:45:14 juju-e4d256-prod-github-runner-207 kernel: [58888.580766] ? show_regs.cold+0x8/0xd Aug 22 21:45:14 juju-e4d256-prod-github-runner-207 kernel: [58888.581768] ? watchdog_timer_fn+0x1be/0x220 Aug 22 21:45:14 juju-e4d256-prod-github-runner-207 kernel: [58888.582782] ? lockup_detector_update_enable+0x60/0x60 Aug 22 21:45:14 juju-e4d256-prod-github-runner-207 kernel: [58888.583867] ? __hrtimer_run_queues+0x107/0x230 Aug 22 21:45:14 juju-e4d256-prod-github-runner-207 kernel: [58888.585024] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 21:45:14 juju-e4d256-prod-github-runner-207 kernel: [58888.586051] ? hrtimer_interrupt+0x101/0x220 Aug 22 21:45:14 juju-e4d256-prod-github-runner-207 kernel: [58888.587067] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 21:45:14 juju-e4d256-prod-github-runner-207 kernel: [58888.588150] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 21:45:14 juju-e4d256-prod-github-runner-207 kernel: [58888.589207] Aug 22 21:45:14 juju-e4d256-prod-github-runner-207 kernel: [58888.590063] Aug 22 21:45:14 juju-e4d256-prod-github-runner-207 kernel: [58888.590900] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 21:45:14 juju-e4d256-prod-github-runner-207 kernel: [58888.591949] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:45:14 juju-e4d256-prod-github-runner-207 kernel: [58888.592988] ? _raw_spin_lock+0x22/0x30 Aug 22 21:45:14 juju-e4d256-prod-github-runner-207 kernel: [58888.593932] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:45:14 juju-e4d256-prod-github-runner-207 kernel: [58888.594957] direct_page_fault+0x206/0x310 [kvm] Aug 22 21:45:14 juju-e4d256-prod-github-runner-207 kernel: [58888.595993] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 21:45:14 juju-e4d256-prod-github-runner-207 kernel: [58888.597002] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 21:45:14 juju-e4d256-prod-github-runner-207 kernel: [58888.598002] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 21:45:14 juju-e4d256-prod-github-runner-207 kernel: [58888.598976] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 21:45:14 juju-e4d256-prod-github-runner-207 kernel: [58888.600090] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 21:45:14 juju-e4d256-prod-github-runner-207 kernel: [58888.601307] handle_exit+0x98/0x230 [kvm_amd] Aug 22 21:45:14 juju-e4d256-prod-github-runner-207 kernel: [58888.602208] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 21:45:14 juju-e4d256-prod-github-runner-207 kernel: [58888.603131] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 21:45:14 juju-e4d256-prod-github-runner-207 kernel: [58888.604081] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 21:45:14 juju-e4d256-prod-github-runner-207 kernel: [58888.605003] vcpu_run+0x62/0x2c0 [kvm] Aug 22 21:45:14 juju-e4d256-prod-github-runner-207 kernel: [58888.605825] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 21:45:14 juju-e4d256-prod-github-runner-207 kernel: [58888.606633] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 21:45:14 juju-e4d256-prod-github-runner-207 kernel: [58888.607505] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 21:45:14 juju-e4d256-prod-github-runner-207 kernel: [58888.608337] ? __seccomp_filter+0x4a/0x4a0 Aug 22 21:45:14 juju-e4d256-prod-github-runner-207 kernel: [58888.609098] ? __fget_files+0x86/0xc0 Aug 22 21:45:14 juju-e4d256-prod-github-runner-207 kernel: [58888.609807] __x64_sys_ioctl+0x95/0xd0 Aug 22 21:45:14 juju-e4d256-prod-github-runner-207 kernel: [58888.610506] do_syscall_64+0x5c/0xc0 Aug 22 21:45:14 juju-e4d256-prod-github-runner-207 kernel: [58888.611173] ? do_futex+0x162/0x1f0 Aug 22 21:45:14 juju-e4d256-prod-github-runner-207 kernel: [58888.611845] ? __x64_sys_futex+0x78/0x1e0 Aug 22 21:45:14 juju-e4d256-prod-github-runner-207 kernel: [58888.612540] ? __secure_computing+0xa9/0x120 Aug 22 21:45:14 juju-e4d256-prod-github-runner-207 kernel: [58888.613252] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 21:45:14 juju-e4d256-prod-github-runner-207 kernel: [58888.614043] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:45:14 juju-e4d256-prod-github-runner-207 kernel: [58888.614770] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:45:14 juju-e4d256-prod-github-runner-207 kernel: [58888.615494] ? do_syscall_64+0x69/0xc0 Aug 22 21:45:14 juju-e4d256-prod-github-runner-207 kernel: [58888.616154] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:45:14 juju-e4d256-prod-github-runner-207 kernel: [58888.616865] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:45:14 juju-e4d256-prod-github-runner-207 kernel: [58888.617576] ? do_syscall_64+0x69/0xc0 Aug 22 21:45:14 juju-e4d256-prod-github-runner-207 kernel: [58888.618204] ? do_syscall_64+0x69/0xc0 Aug 22 21:45:14 juju-e4d256-prod-github-runner-207 kernel: [58888.618840] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 21:45:14 juju-e4d256-prod-github-runner-207 kernel: [58888.619550] RIP: 0033:0x7faa5d0edaff Aug 22 21:45:14 juju-e4d256-prod-github-runner-207 kernel: [58888.620207] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 21:45:14 juju-e4d256-prod-github-runner-207 kernel: [58888.622222] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 21:45:14 juju-e4d256-prod-github-runner-207 kernel: [58888.623144] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 21:45:14 juju-e4d256-prod-github-runner-207 kernel: [58888.624100] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 21:45:14 juju-e4d256-prod-github-runner-207 kernel: [58888.624999] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 21:45:14 juju-e4d256-prod-github-runner-207 kernel: [58888.625893] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 21:45:14 juju-e4d256-prod-github-runner-207 kernel: [58888.626791] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 21:45:14 juju-e4d256-prod-github-runner-207 kernel: [58888.627694] Aug 22 21:45:42 juju-e4d256-prod-github-runner-207 kernel: [58916.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 54762s! [qemu-system-x86:6715] Aug 22 21:45:42 juju-e4d256-prod-github-runner-207 kernel: [58916.543891] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 21:45:42 juju-e4d256-prod-github-runner-207 kernel: [58916.544219] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 21:45:42 juju-e4d256-prod-github-runner-207 kernel: [58916.556565] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 21:45:42 juju-e4d256-prod-github-runner-207 kernel: [58916.557853] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 21:45:42 juju-e4d256-prod-github-runner-207 kernel: [58916.559074] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:45:42 juju-e4d256-prod-github-runner-207 kernel: [58916.560144] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 21:45:42 juju-e4d256-prod-github-runner-207 kernel: [58916.562718] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 21:45:42 juju-e4d256-prod-github-runner-207 kernel: [58916.563836] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 21:45:42 juju-e4d256-prod-github-runner-207 kernel: [58916.565036] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 21:45:42 juju-e4d256-prod-github-runner-207 kernel: [58916.566209] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 21:45:42 juju-e4d256-prod-github-runner-207 kernel: [58916.567407] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 21:45:42 juju-e4d256-prod-github-runner-207 kernel: [58916.568573] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 21:45:42 juju-e4d256-prod-github-runner-207 kernel: [58916.569840] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 21:45:42 juju-e4d256-prod-github-runner-207 kernel: [58916.571104] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 21:45:42 juju-e4d256-prod-github-runner-207 kernel: [58916.572240] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 21:45:42 juju-e4d256-prod-github-runner-207 kernel: [58916.573444] Call Trace: Aug 22 21:45:42 juju-e4d256-prod-github-runner-207 kernel: [58916.574375] Aug 22 21:45:42 juju-e4d256-prod-github-runner-207 kernel: [58916.575295] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:45:42 juju-e4d256-prod-github-runner-207 kernel: [58916.576366] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:45:42 juju-e4d256-prod-github-runner-207 kernel: [58916.577391] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:45:42 juju-e4d256-prod-github-runner-207 kernel: [58916.578538] ? show_regs.part.0+0x23/0x29 Aug 22 21:45:42 juju-e4d256-prod-github-runner-207 kernel: [58916.579545] ? show_regs.cold+0x8/0xd Aug 22 21:45:42 juju-e4d256-prod-github-runner-207 kernel: [58916.580514] ? watchdog_timer_fn+0x1be/0x220 Aug 22 21:45:42 juju-e4d256-prod-github-runner-207 kernel: [58916.581527] ? lockup_detector_update_enable+0x60/0x60 Aug 22 21:45:42 juju-e4d256-prod-github-runner-207 kernel: [58916.582638] ? __hrtimer_run_queues+0x107/0x230 Aug 22 21:45:42 juju-e4d256-prod-github-runner-207 kernel: [58916.583676] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 21:45:42 juju-e4d256-prod-github-runner-207 kernel: [58916.584697] ? hrtimer_interrupt+0x101/0x220 Aug 22 21:45:42 juju-e4d256-prod-github-runner-207 kernel: [58916.585711] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 21:45:42 juju-e4d256-prod-github-runner-207 kernel: [58916.586785] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 21:45:42 juju-e4d256-prod-github-runner-207 kernel: [58916.587847] Aug 22 21:45:42 juju-e4d256-prod-github-runner-207 kernel: [58916.588704] Aug 22 21:45:42 juju-e4d256-prod-github-runner-207 kernel: [58916.589541] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 21:45:42 juju-e4d256-prod-github-runner-207 kernel: [58916.590571] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:45:42 juju-e4d256-prod-github-runner-207 kernel: [58916.591712] ? _raw_spin_lock+0x22/0x30 Aug 22 21:45:42 juju-e4d256-prod-github-runner-207 kernel: [58916.592731] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:45:42 juju-e4d256-prod-github-runner-207 kernel: [58916.593751] direct_page_fault+0x206/0x310 [kvm] Aug 22 21:45:42 juju-e4d256-prod-github-runner-207 kernel: [58916.594772] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 21:45:42 juju-e4d256-prod-github-runner-207 kernel: [58916.595798] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 21:45:42 juju-e4d256-prod-github-runner-207 kernel: [58916.596798] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 21:45:42 juju-e4d256-prod-github-runner-207 kernel: [58916.597810] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 21:45:42 juju-e4d256-prod-github-runner-207 kernel: [58916.598751] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 21:45:42 juju-e4d256-prod-github-runner-207 kernel: [58916.599738] handle_exit+0x98/0x230 [kvm_amd] Aug 22 21:45:42 juju-e4d256-prod-github-runner-207 kernel: [58916.600746] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 21:45:42 juju-e4d256-prod-github-runner-207 kernel: [58916.601686] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 21:45:42 juju-e4d256-prod-github-runner-207 kernel: [58916.602636] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 21:45:42 juju-e4d256-prod-github-runner-207 kernel: [58916.603579] vcpu_run+0x62/0x2c0 [kvm] Aug 22 21:45:42 juju-e4d256-prod-github-runner-207 kernel: [58916.604410] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 21:45:42 juju-e4d256-prod-github-runner-207 kernel: [58916.605237] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 21:45:42 juju-e4d256-prod-github-runner-207 kernel: [58916.606097] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 21:45:42 juju-e4d256-prod-github-runner-207 kernel: [58916.606896] ? __seccomp_filter+0x4a/0x4a0 Aug 22 21:45:42 juju-e4d256-prod-github-runner-207 kernel: [58916.607663] ? __fget_files+0x86/0xc0 Aug 22 21:45:42 juju-e4d256-prod-github-runner-207 kernel: [58916.608372] __x64_sys_ioctl+0x95/0xd0 Aug 22 21:45:42 juju-e4d256-prod-github-runner-207 kernel: [58916.609071] do_syscall_64+0x5c/0xc0 Aug 22 21:45:42 juju-e4d256-prod-github-runner-207 kernel: [58916.609738] ? do_futex+0x162/0x1f0 Aug 22 21:45:42 juju-e4d256-prod-github-runner-207 kernel: [58916.610389] ? __x64_sys_futex+0x78/0x1e0 Aug 22 21:45:42 juju-e4d256-prod-github-runner-207 kernel: [58916.611064] ? __secure_computing+0xa9/0x120 Aug 22 21:45:42 juju-e4d256-prod-github-runner-207 kernel: [58916.611777] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 21:45:42 juju-e4d256-prod-github-runner-207 kernel: [58916.612542] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:45:42 juju-e4d256-prod-github-runner-207 kernel: [58916.613263] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:45:42 juju-e4d256-prod-github-runner-207 kernel: [58916.613980] ? do_syscall_64+0x69/0xc0 Aug 22 21:45:42 juju-e4d256-prod-github-runner-207 kernel: [58916.614625] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:45:42 juju-e4d256-prod-github-runner-207 kernel: [58916.615346] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:45:42 juju-e4d256-prod-github-runner-207 kernel: [58916.616041] ? do_syscall_64+0x69/0xc0 Aug 22 21:45:42 juju-e4d256-prod-github-runner-207 kernel: [58916.616670] ? do_syscall_64+0x69/0xc0 Aug 22 21:45:42 juju-e4d256-prod-github-runner-207 kernel: [58916.617297] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 21:45:42 juju-e4d256-prod-github-runner-207 kernel: [58916.618001] RIP: 0033:0x7faa5d0edaff Aug 22 21:45:42 juju-e4d256-prod-github-runner-207 kernel: [58916.618662] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 21:45:42 juju-e4d256-prod-github-runner-207 kernel: [58916.620667] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 21:45:42 juju-e4d256-prod-github-runner-207 kernel: [58916.621589] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 21:45:42 juju-e4d256-prod-github-runner-207 kernel: [58916.622489] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 21:45:42 juju-e4d256-prod-github-runner-207 kernel: [58916.623390] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 21:45:42 juju-e4d256-prod-github-runner-207 kernel: [58916.624277] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 21:45:42 juju-e4d256-prod-github-runner-207 kernel: [58916.625161] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 21:45:42 juju-e4d256-prod-github-runner-207 kernel: [58916.626051] Aug 22 21:46:10 juju-e4d256-prod-github-runner-207 kernel: [58944.542102] watchdog: BUG: soft lockup - CPU#1 stuck for 54788s! [qemu-system-x86:6715] Aug 22 21:46:10 juju-e4d256-prod-github-runner-207 kernel: [58944.543248] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 21:46:10 juju-e4d256-prod-github-runner-207 kernel: [58944.543324] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 21:46:10 juju-e4d256-prod-github-runner-207 kernel: [58944.556663] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 21:46:10 juju-e4d256-prod-github-runner-207 kernel: [58944.557943] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 21:46:10 juju-e4d256-prod-github-runner-207 kernel: [58944.559319] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:46:10 juju-e4d256-prod-github-runner-207 kernel: [58944.560564] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 21:46:10 juju-e4d256-prod-github-runner-207 kernel: [58944.563181] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 21:46:10 juju-e4d256-prod-github-runner-207 kernel: [58944.564561] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 21:46:10 juju-e4d256-prod-github-runner-207 kernel: [58944.565731] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 21:46:10 juju-e4d256-prod-github-runner-207 kernel: [58944.566922] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 21:46:10 juju-e4d256-prod-github-runner-207 kernel: [58944.568115] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 21:46:10 juju-e4d256-prod-github-runner-207 kernel: [58944.569288] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 21:46:10 juju-e4d256-prod-github-runner-207 kernel: [58944.570474] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 21:46:10 juju-e4d256-prod-github-runner-207 kernel: [58944.571762] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 21:46:10 juju-e4d256-prod-github-runner-207 kernel: [58944.572964] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 21:46:10 juju-e4d256-prod-github-runner-207 kernel: [58944.574406] Call Trace: Aug 22 21:46:10 juju-e4d256-prod-github-runner-207 kernel: [58944.575345] Aug 22 21:46:10 juju-e4d256-prod-github-runner-207 kernel: [58944.576276] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:46:10 juju-e4d256-prod-github-runner-207 kernel: [58944.577359] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:46:10 juju-e4d256-prod-github-runner-207 kernel: [58944.578396] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:46:10 juju-e4d256-prod-github-runner-207 kernel: [58944.579490] ? show_regs.part.0+0x23/0x29 Aug 22 21:46:10 juju-e4d256-prod-github-runner-207 kernel: [58944.580494] ? show_regs.cold+0x8/0xd Aug 22 21:46:10 juju-e4d256-prod-github-runner-207 kernel: [58944.581483] ? watchdog_timer_fn+0x1be/0x220 Aug 22 21:46:10 juju-e4d256-prod-github-runner-207 kernel: [58944.582518] ? lockup_detector_update_enable+0x60/0x60 Aug 22 21:46:10 juju-e4d256-prod-github-runner-207 kernel: [58944.583601] ? __hrtimer_run_queues+0x107/0x230 Aug 22 21:46:10 juju-e4d256-prod-github-runner-207 kernel: [58944.584641] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 21:46:10 juju-e4d256-prod-github-runner-207 kernel: [58944.585669] ? hrtimer_interrupt+0x101/0x220 Aug 22 21:46:10 juju-e4d256-prod-github-runner-207 kernel: [58944.586687] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 21:46:10 juju-e4d256-prod-github-runner-207 kernel: [58944.587791] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 21:46:10 juju-e4d256-prod-github-runner-207 kernel: [58944.588845] Aug 22 21:46:10 juju-e4d256-prod-github-runner-207 kernel: [58944.589701] Aug 22 21:46:10 juju-e4d256-prod-github-runner-207 kernel: [58944.590608] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 21:46:10 juju-e4d256-prod-github-runner-207 kernel: [58944.591681] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:46:10 juju-e4d256-prod-github-runner-207 kernel: [58944.592763] ? _raw_spin_lock+0x22/0x30 Aug 22 21:46:10 juju-e4d256-prod-github-runner-207 kernel: [58944.593711] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:46:10 juju-e4d256-prod-github-runner-207 kernel: [58944.594731] direct_page_fault+0x206/0x310 [kvm] Aug 22 21:46:10 juju-e4d256-prod-github-runner-207 kernel: [58944.595771] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 21:46:10 juju-e4d256-prod-github-runner-207 kernel: [58944.596808] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 21:46:10 juju-e4d256-prod-github-runner-207 kernel: [58944.597821] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 21:46:10 juju-e4d256-prod-github-runner-207 kernel: [58944.598811] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 21:46:10 juju-e4d256-prod-github-runner-207 kernel: [58944.599794] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 21:46:10 juju-e4d256-prod-github-runner-207 kernel: [58944.600775] handle_exit+0x98/0x230 [kvm_amd] Aug 22 21:46:10 juju-e4d256-prod-github-runner-207 kernel: [58944.601678] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 21:46:10 juju-e4d256-prod-github-runner-207 kernel: [58944.602647] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 21:46:10 juju-e4d256-prod-github-runner-207 kernel: [58944.603605] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 21:46:10 juju-e4d256-prod-github-runner-207 kernel: [58944.604516] vcpu_run+0x62/0x2c0 [kvm] Aug 22 21:46:10 juju-e4d256-prod-github-runner-207 kernel: [58944.605335] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 21:46:10 juju-e4d256-prod-github-runner-207 kernel: [58944.606157] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 21:46:10 juju-e4d256-prod-github-runner-207 kernel: [58944.607042] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 21:46:10 juju-e4d256-prod-github-runner-207 kernel: [58944.607854] ? __seccomp_filter+0x4a/0x4a0 Aug 22 21:46:10 juju-e4d256-prod-github-runner-207 kernel: [58944.608608] ? __fget_files+0x86/0xc0 Aug 22 21:46:10 juju-e4d256-prod-github-runner-207 kernel: [58944.609322] __x64_sys_ioctl+0x95/0xd0 Aug 22 21:46:10 juju-e4d256-prod-github-runner-207 kernel: [58944.610016] do_syscall_64+0x5c/0xc0 Aug 22 21:46:10 juju-e4d256-prod-github-runner-207 kernel: [58944.610682] ? do_futex+0x162/0x1f0 Aug 22 21:46:10 juju-e4d256-prod-github-runner-207 kernel: [58944.611350] ? __x64_sys_futex+0x78/0x1e0 Aug 22 21:46:10 juju-e4d256-prod-github-runner-207 kernel: [58944.612033] ? __secure_computing+0xa9/0x120 Aug 22 21:46:10 juju-e4d256-prod-github-runner-207 kernel: [58944.612751] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 21:46:10 juju-e4d256-prod-github-runner-207 kernel: [58944.613528] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:46:10 juju-e4d256-prod-github-runner-207 kernel: [58944.614256] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:46:10 juju-e4d256-prod-github-runner-207 kernel: [58944.614991] ? do_syscall_64+0x69/0xc0 Aug 22 21:46:10 juju-e4d256-prod-github-runner-207 kernel: [58944.615636] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:46:10 juju-e4d256-prod-github-runner-207 kernel: [58944.616341] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:46:10 juju-e4d256-prod-github-runner-207 kernel: [58944.617039] ? do_syscall_64+0x69/0xc0 Aug 22 21:46:10 juju-e4d256-prod-github-runner-207 kernel: [58944.617665] ? do_syscall_64+0x69/0xc0 Aug 22 21:46:10 juju-e4d256-prod-github-runner-207 kernel: [58944.618297] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 21:46:10 juju-e4d256-prod-github-runner-207 kernel: [58944.619039] RIP: 0033:0x7faa5d0edaff Aug 22 21:46:10 juju-e4d256-prod-github-runner-207 kernel: [58944.619671] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 21:46:10 juju-e4d256-prod-github-runner-207 kernel: [58944.621666] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 21:46:10 juju-e4d256-prod-github-runner-207 kernel: [58944.622588] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 21:46:10 juju-e4d256-prod-github-runner-207 kernel: [58944.623575] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 21:46:10 juju-e4d256-prod-github-runner-207 kernel: [58944.624473] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 21:46:10 juju-e4d256-prod-github-runner-207 kernel: [58944.625368] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 21:46:10 juju-e4d256-prod-github-runner-207 kernel: [58944.626256] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 21:46:10 juju-e4d256-prod-github-runner-207 kernel: [58944.627167] Aug 22 21:46:38 juju-e4d256-prod-github-runner-207 kernel: [58972.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 54814s! [qemu-system-x86:6715] Aug 22 21:46:38 juju-e4d256-prod-github-runner-207 kernel: [58972.543156] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 21:46:38 juju-e4d256-prod-github-runner-207 kernel: [58972.543233] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 21:46:38 juju-e4d256-prod-github-runner-207 kernel: [58972.555675] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 21:46:38 juju-e4d256-prod-github-runner-207 kernel: [58972.556966] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 21:46:38 juju-e4d256-prod-github-runner-207 kernel: [58972.558222] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:46:38 juju-e4d256-prod-github-runner-207 kernel: [58972.559446] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 21:46:38 juju-e4d256-prod-github-runner-207 kernel: [58972.562137] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 21:46:38 juju-e4d256-prod-github-runner-207 kernel: [58972.563218] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 21:46:38 juju-e4d256-prod-github-runner-207 kernel: [58972.564403] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 21:46:38 juju-e4d256-prod-github-runner-207 kernel: [58972.565585] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 21:46:38 juju-e4d256-prod-github-runner-207 kernel: [58972.566775] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 21:46:38 juju-e4d256-prod-github-runner-207 kernel: [58972.567953] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 21:46:38 juju-e4d256-prod-github-runner-207 kernel: [58972.569134] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 21:46:38 juju-e4d256-prod-github-runner-207 kernel: [58972.570394] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 21:46:38 juju-e4d256-prod-github-runner-207 kernel: [58972.571541] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 21:46:38 juju-e4d256-prod-github-runner-207 kernel: [58972.572755] Call Trace: Aug 22 21:46:38 juju-e4d256-prod-github-runner-207 kernel: [58972.573675] Aug 22 21:46:38 juju-e4d256-prod-github-runner-207 kernel: [58972.574565] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:46:38 juju-e4d256-prod-github-runner-207 kernel: [58972.575616] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:46:38 juju-e4d256-prod-github-runner-207 kernel: [58972.576798] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:46:38 juju-e4d256-prod-github-runner-207 kernel: [58972.577878] ? show_regs.part.0+0x23/0x29 Aug 22 21:46:38 juju-e4d256-prod-github-runner-207 kernel: [58972.578898] ? show_regs.cold+0x8/0xd Aug 22 21:46:38 juju-e4d256-prod-github-runner-207 kernel: [58972.579881] ? watchdog_timer_fn+0x1be/0x220 Aug 22 21:46:38 juju-e4d256-prod-github-runner-207 kernel: [58972.580905] ? lockup_detector_update_enable+0x60/0x60 Aug 22 21:46:38 juju-e4d256-prod-github-runner-207 kernel: [58972.581989] ? __hrtimer_run_queues+0x107/0x230 Aug 22 21:46:38 juju-e4d256-prod-github-runner-207 kernel: [58972.583044] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 21:46:38 juju-e4d256-prod-github-runner-207 kernel: [58972.584079] ? hrtimer_interrupt+0x101/0x220 Aug 22 21:46:38 juju-e4d256-prod-github-runner-207 kernel: [58972.585102] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 21:46:38 juju-e4d256-prod-github-runner-207 kernel: [58972.586184] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 21:46:38 juju-e4d256-prod-github-runner-207 kernel: [58972.587249] Aug 22 21:46:38 juju-e4d256-prod-github-runner-207 kernel: [58972.588105] Aug 22 21:46:38 juju-e4d256-prod-github-runner-207 kernel: [58972.588949] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 21:46:38 juju-e4d256-prod-github-runner-207 kernel: [58972.589994] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:46:38 juju-e4d256-prod-github-runner-207 kernel: [58972.591053] ? _raw_spin_lock+0x22/0x30 Aug 22 21:46:38 juju-e4d256-prod-github-runner-207 kernel: [58972.592003] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:46:38 juju-e4d256-prod-github-runner-207 kernel: [58972.593032] direct_page_fault+0x206/0x310 [kvm] Aug 22 21:46:38 juju-e4d256-prod-github-runner-207 kernel: [58972.594066] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 21:46:38 juju-e4d256-prod-github-runner-207 kernel: [58972.595096] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 21:46:38 juju-e4d256-prod-github-runner-207 kernel: [58972.596104] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 21:46:38 juju-e4d256-prod-github-runner-207 kernel: [58972.597081] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 21:46:38 juju-e4d256-prod-github-runner-207 kernel: [58972.598035] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 21:46:38 juju-e4d256-prod-github-runner-207 kernel: [58972.599039] handle_exit+0x98/0x230 [kvm_amd] Aug 22 21:46:38 juju-e4d256-prod-github-runner-207 kernel: [58972.599937] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 21:46:38 juju-e4d256-prod-github-runner-207 kernel: [58972.600863] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 21:46:38 juju-e4d256-prod-github-runner-207 kernel: [58972.601795] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 21:46:38 juju-e4d256-prod-github-runner-207 kernel: [58972.602723] vcpu_run+0x62/0x2c0 [kvm] Aug 22 21:46:38 juju-e4d256-prod-github-runner-207 kernel: [58972.603541] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 21:46:38 juju-e4d256-prod-github-runner-207 kernel: [58972.604357] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 21:46:38 juju-e4d256-prod-github-runner-207 kernel: [58972.605224] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 21:46:38 juju-e4d256-prod-github-runner-207 kernel: [58972.606032] ? __seccomp_filter+0x4a/0x4a0 Aug 22 21:46:38 juju-e4d256-prod-github-runner-207 kernel: [58972.606800] ? __fget_files+0x86/0xc0 Aug 22 21:46:38 juju-e4d256-prod-github-runner-207 kernel: [58972.607513] __x64_sys_ioctl+0x95/0xd0 Aug 22 21:46:38 juju-e4d256-prod-github-runner-207 kernel: [58972.608226] do_syscall_64+0x5c/0xc0 Aug 22 21:46:38 juju-e4d256-prod-github-runner-207 kernel: [58972.608917] ? do_futex+0x162/0x1f0 Aug 22 21:46:38 juju-e4d256-prod-github-runner-207 kernel: [58972.609572] ? __x64_sys_futex+0x78/0x1e0 Aug 22 21:46:38 juju-e4d256-prod-github-runner-207 kernel: [58972.610532] ? __secure_computing+0xa9/0x120 Aug 22 21:46:38 juju-e4d256-prod-github-runner-207 kernel: [58972.611584] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 21:46:38 juju-e4d256-prod-github-runner-207 kernel: [58972.612754] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:46:38 juju-e4d256-prod-github-runner-207 kernel: [58972.613697] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:46:38 juju-e4d256-prod-github-runner-207 kernel: [58972.614648] ? do_syscall_64+0x69/0xc0 Aug 22 21:46:38 juju-e4d256-prod-github-runner-207 kernel: [58972.615306] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:46:38 juju-e4d256-prod-github-runner-207 kernel: [58972.616035] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:46:38 juju-e4d256-prod-github-runner-207 kernel: [58972.616928] ? do_syscall_64+0x69/0xc0 Aug 22 21:46:38 juju-e4d256-prod-github-runner-207 kernel: [58972.617561] ? do_syscall_64+0x69/0xc0 Aug 22 21:46:38 juju-e4d256-prod-github-runner-207 kernel: [58972.618194] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 21:46:38 juju-e4d256-prod-github-runner-207 kernel: [58972.618921] RIP: 0033:0x7faa5d0edaff Aug 22 21:46:38 juju-e4d256-prod-github-runner-207 kernel: [58972.619554] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 21:46:38 juju-e4d256-prod-github-runner-207 kernel: [58972.621612] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 21:46:38 juju-e4d256-prod-github-runner-207 kernel: [58972.622551] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 21:46:38 juju-e4d256-prod-github-runner-207 kernel: [58972.623472] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 21:46:38 juju-e4d256-prod-github-runner-207 kernel: [58972.624388] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 21:46:38 juju-e4d256-prod-github-runner-207 kernel: [58972.625297] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 21:46:38 juju-e4d256-prod-github-runner-207 kernel: [58972.626202] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 21:46:38 juju-e4d256-prod-github-runner-207 kernel: [58972.627120] Aug 22 21:47:06 juju-e4d256-prod-github-runner-207 kernel: [59000.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 54840s! [qemu-system-x86:6715] Aug 22 21:47:06 juju-e4d256-prod-github-runner-207 kernel: [59000.543179] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 21:47:06 juju-e4d256-prod-github-runner-207 kernel: [59000.543257] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 21:47:06 juju-e4d256-prod-github-runner-207 kernel: [59000.555783] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 21:47:06 juju-e4d256-prod-github-runner-207 kernel: [59000.557098] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 21:47:06 juju-e4d256-prod-github-runner-207 kernel: [59000.558367] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:47:06 juju-e4d256-prod-github-runner-207 kernel: [59000.559459] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 21:47:06 juju-e4d256-prod-github-runner-207 kernel: [59000.562101] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 21:47:06 juju-e4d256-prod-github-runner-207 kernel: [59000.563174] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 21:47:06 juju-e4d256-prod-github-runner-207 kernel: [59000.564364] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 21:47:06 juju-e4d256-prod-github-runner-207 kernel: [59000.565555] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 21:47:06 juju-e4d256-prod-github-runner-207 kernel: [59000.566737] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 21:47:06 juju-e4d256-prod-github-runner-207 kernel: [59000.567915] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 21:47:06 juju-e4d256-prod-github-runner-207 kernel: [59000.569141] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 21:47:06 juju-e4d256-prod-github-runner-207 kernel: [59000.570436] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 21:47:06 juju-e4d256-prod-github-runner-207 kernel: [59000.571565] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 21:47:06 juju-e4d256-prod-github-runner-207 kernel: [59000.572791] Call Trace: Aug 22 21:47:06 juju-e4d256-prod-github-runner-207 kernel: [59000.573724] Aug 22 21:47:06 juju-e4d256-prod-github-runner-207 kernel: [59000.574637] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:47:06 juju-e4d256-prod-github-runner-207 kernel: [59000.575675] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:47:06 juju-e4d256-prod-github-runner-207 kernel: [59000.576729] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:47:06 juju-e4d256-prod-github-runner-207 kernel: [59000.577812] ? show_regs.part.0+0x23/0x29 Aug 22 21:47:06 juju-e4d256-prod-github-runner-207 kernel: [59000.578867] ? show_regs.cold+0x8/0xd Aug 22 21:47:06 juju-e4d256-prod-github-runner-207 kernel: [59000.579854] ? watchdog_timer_fn+0x1be/0x220 Aug 22 21:47:06 juju-e4d256-prod-github-runner-207 kernel: [59000.580868] ? lockup_detector_update_enable+0x60/0x60 Aug 22 21:47:06 juju-e4d256-prod-github-runner-207 kernel: [59000.581933] ? __hrtimer_run_queues+0x107/0x230 Aug 22 21:47:06 juju-e4d256-prod-github-runner-207 kernel: [59000.583040] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 21:47:06 juju-e4d256-prod-github-runner-207 kernel: [59000.584120] ? hrtimer_interrupt+0x101/0x220 Aug 22 21:47:06 juju-e4d256-prod-github-runner-207 kernel: [59000.585141] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 21:47:06 juju-e4d256-prod-github-runner-207 kernel: [59000.586240] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 21:47:06 juju-e4d256-prod-github-runner-207 kernel: [59000.587320] Aug 22 21:47:06 juju-e4d256-prod-github-runner-207 kernel: [59000.588179] Aug 22 21:47:06 juju-e4d256-prod-github-runner-207 kernel: [59000.589051] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 21:47:06 juju-e4d256-prod-github-runner-207 kernel: [59000.590135] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:47:06 juju-e4d256-prod-github-runner-207 kernel: [59000.591249] ? _raw_spin_lock+0x22/0x30 Aug 22 21:47:06 juju-e4d256-prod-github-runner-207 kernel: [59000.592247] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:47:06 juju-e4d256-prod-github-runner-207 kernel: [59000.593300] direct_page_fault+0x206/0x310 [kvm] Aug 22 21:47:06 juju-e4d256-prod-github-runner-207 kernel: [59000.594369] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 21:47:06 juju-e4d256-prod-github-runner-207 kernel: [59000.595390] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 21:47:06 juju-e4d256-prod-github-runner-207 kernel: [59000.596416] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 21:47:06 juju-e4d256-prod-github-runner-207 kernel: [59000.597394] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 21:47:06 juju-e4d256-prod-github-runner-207 kernel: [59000.598362] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 21:47:06 juju-e4d256-prod-github-runner-207 kernel: [59000.599363] handle_exit+0x98/0x230 [kvm_amd] Aug 22 21:47:06 juju-e4d256-prod-github-runner-207 kernel: [59000.600267] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 21:47:06 juju-e4d256-prod-github-runner-207 kernel: [59000.601192] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 21:47:06 juju-e4d256-prod-github-runner-207 kernel: [59000.602125] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 21:47:06 juju-e4d256-prod-github-runner-207 kernel: [59000.603046] vcpu_run+0x62/0x2c0 [kvm] Aug 22 21:47:06 juju-e4d256-prod-github-runner-207 kernel: [59000.603864] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 21:47:06 juju-e4d256-prod-github-runner-207 kernel: [59000.604740] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 21:47:06 juju-e4d256-prod-github-runner-207 kernel: [59000.605601] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 21:47:06 juju-e4d256-prod-github-runner-207 kernel: [59000.606447] ? __seccomp_filter+0x4a/0x4a0 Aug 22 21:47:06 juju-e4d256-prod-github-runner-207 kernel: [59000.607209] ? __fget_files+0x86/0xc0 Aug 22 21:47:06 juju-e4d256-prod-github-runner-207 kernel: [59000.607938] __x64_sys_ioctl+0x95/0xd0 Aug 22 21:47:06 juju-e4d256-prod-github-runner-207 kernel: [59000.608639] do_syscall_64+0x5c/0xc0 Aug 22 21:47:06 juju-e4d256-prod-github-runner-207 kernel: [59000.609319] ? do_futex+0x162/0x1f0 Aug 22 21:47:06 juju-e4d256-prod-github-runner-207 kernel: [59000.609970] ? __x64_sys_futex+0x78/0x1e0 Aug 22 21:47:06 juju-e4d256-prod-github-runner-207 kernel: [59000.610666] ? __secure_computing+0xa9/0x120 Aug 22 21:47:06 juju-e4d256-prod-github-runner-207 kernel: [59000.611369] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 21:47:06 juju-e4d256-prod-github-runner-207 kernel: [59000.612130] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:47:06 juju-e4d256-prod-github-runner-207 kernel: [59000.612868] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:47:06 juju-e4d256-prod-github-runner-207 kernel: [59000.613626] ? do_syscall_64+0x69/0xc0 Aug 22 21:47:06 juju-e4d256-prod-github-runner-207 kernel: [59000.614329] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:47:06 juju-e4d256-prod-github-runner-207 kernel: [59000.615159] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:47:06 juju-e4d256-prod-github-runner-207 kernel: [59000.615913] ? do_syscall_64+0x69/0xc0 Aug 22 21:47:06 juju-e4d256-prod-github-runner-207 kernel: [59000.616546] ? do_syscall_64+0x69/0xc0 Aug 22 21:47:06 juju-e4d256-prod-github-runner-207 kernel: [59000.617175] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 21:47:06 juju-e4d256-prod-github-runner-207 kernel: [59000.617884] RIP: 0033:0x7faa5d0edaff Aug 22 21:47:06 juju-e4d256-prod-github-runner-207 kernel: [59000.618525] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 21:47:06 juju-e4d256-prod-github-runner-207 kernel: [59000.620508] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 21:47:06 juju-e4d256-prod-github-runner-207 kernel: [59000.621462] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 21:47:06 juju-e4d256-prod-github-runner-207 kernel: [59000.622389] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 21:47:06 juju-e4d256-prod-github-runner-207 kernel: [59000.623285] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 21:47:06 juju-e4d256-prod-github-runner-207 kernel: [59000.624174] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 21:47:06 juju-e4d256-prod-github-runner-207 kernel: [59000.625095] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 21:47:06 juju-e4d256-prod-github-runner-207 kernel: [59000.626010] Aug 22 21:47:34 juju-e4d256-prod-github-runner-207 kernel: [59028.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 54866s! [qemu-system-x86:6715] Aug 22 21:47:34 juju-e4d256-prod-github-runner-207 kernel: [59028.543800] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 21:47:34 juju-e4d256-prod-github-runner-207 kernel: [59028.544079] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 21:47:34 juju-e4d256-prod-github-runner-207 kernel: [59028.556277] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 21:47:34 juju-e4d256-prod-github-runner-207 kernel: [59028.557555] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 21:47:34 juju-e4d256-prod-github-runner-207 kernel: [59028.558862] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:47:34 juju-e4d256-prod-github-runner-207 kernel: [59028.559930] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 21:47:34 juju-e4d256-prod-github-runner-207 kernel: [59028.562611] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 21:47:34 juju-e4d256-prod-github-runner-207 kernel: [59028.563669] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 21:47:34 juju-e4d256-prod-github-runner-207 kernel: [59028.564832] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 21:47:34 juju-e4d256-prod-github-runner-207 kernel: [59028.566007] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 21:47:34 juju-e4d256-prod-github-runner-207 kernel: [59028.567170] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 21:47:34 juju-e4d256-prod-github-runner-207 kernel: [59028.568333] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 21:47:34 juju-e4d256-prod-github-runner-207 kernel: [59028.569496] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 21:47:34 juju-e4d256-prod-github-runner-207 kernel: [59028.570735] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 21:47:34 juju-e4d256-prod-github-runner-207 kernel: [59028.571831] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 21:47:34 juju-e4d256-prod-github-runner-207 kernel: [59028.573021] Call Trace: Aug 22 21:47:34 juju-e4d256-prod-github-runner-207 kernel: [59028.573953] Aug 22 21:47:34 juju-e4d256-prod-github-runner-207 kernel: [59028.574852] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:47:34 juju-e4d256-prod-github-runner-207 kernel: [59028.575882] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:47:34 juju-e4d256-prod-github-runner-207 kernel: [59028.576905] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:47:34 juju-e4d256-prod-github-runner-207 kernel: [59028.578011] ? show_regs.part.0+0x23/0x29 Aug 22 21:47:34 juju-e4d256-prod-github-runner-207 kernel: [59028.579006] ? show_regs.cold+0x8/0xd Aug 22 21:47:34 juju-e4d256-prod-github-runner-207 kernel: [59028.579980] ? watchdog_timer_fn+0x1be/0x220 Aug 22 21:47:34 juju-e4d256-prod-github-runner-207 kernel: [59028.580985] ? lockup_detector_update_enable+0x60/0x60 Aug 22 21:47:34 juju-e4d256-prod-github-runner-207 kernel: [59028.582071] ? __hrtimer_run_queues+0x107/0x230 Aug 22 21:47:34 juju-e4d256-prod-github-runner-207 kernel: [59028.583111] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 21:47:34 juju-e4d256-prod-github-runner-207 kernel: [59028.584132] ? hrtimer_interrupt+0x101/0x220 Aug 22 21:47:34 juju-e4d256-prod-github-runner-207 kernel: [59028.585143] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 21:47:34 juju-e4d256-prod-github-runner-207 kernel: [59028.586215] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 21:47:34 juju-e4d256-prod-github-runner-207 kernel: [59028.587264] Aug 22 21:47:34 juju-e4d256-prod-github-runner-207 kernel: [59028.588115] Aug 22 21:47:34 juju-e4d256-prod-github-runner-207 kernel: [59028.588975] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 21:47:34 juju-e4d256-prod-github-runner-207 kernel: [59028.590045] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:47:34 juju-e4d256-prod-github-runner-207 kernel: [59028.591146] ? _raw_spin_lock+0x22/0x30 Aug 22 21:47:34 juju-e4d256-prod-github-runner-207 kernel: [59028.592088] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:47:34 juju-e4d256-prod-github-runner-207 kernel: [59028.593102] direct_page_fault+0x206/0x310 [kvm] Aug 22 21:47:34 juju-e4d256-prod-github-runner-207 kernel: [59028.594319] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 21:47:34 juju-e4d256-prod-github-runner-207 kernel: [59028.595325] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 21:47:34 juju-e4d256-prod-github-runner-207 kernel: [59028.596343] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 21:47:34 juju-e4d256-prod-github-runner-207 kernel: [59028.597365] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 21:47:34 juju-e4d256-prod-github-runner-207 kernel: [59028.598342] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 21:47:34 juju-e4d256-prod-github-runner-207 kernel: [59028.599324] handle_exit+0x98/0x230 [kvm_amd] Aug 22 21:47:34 juju-e4d256-prod-github-runner-207 kernel: [59028.600213] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 21:47:34 juju-e4d256-prod-github-runner-207 kernel: [59028.601123] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 21:47:34 juju-e4d256-prod-github-runner-207 kernel: [59028.602062] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 21:47:34 juju-e4d256-prod-github-runner-207 kernel: [59028.602969] vcpu_run+0x62/0x2c0 [kvm] Aug 22 21:47:34 juju-e4d256-prod-github-runner-207 kernel: [59028.603777] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 21:47:34 juju-e4d256-prod-github-runner-207 kernel: [59028.604581] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 21:47:34 juju-e4d256-prod-github-runner-207 kernel: [59028.605433] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 21:47:34 juju-e4d256-prod-github-runner-207 kernel: [59028.606240] ? __seccomp_filter+0x4a/0x4a0 Aug 22 21:47:34 juju-e4d256-prod-github-runner-207 kernel: [59028.606980] ? __fget_files+0x86/0xc0 Aug 22 21:47:34 juju-e4d256-prod-github-runner-207 kernel: [59028.607680] __x64_sys_ioctl+0x95/0xd0 Aug 22 21:47:34 juju-e4d256-prod-github-runner-207 kernel: [59028.608369] do_syscall_64+0x5c/0xc0 Aug 22 21:47:34 juju-e4d256-prod-github-runner-207 kernel: [59028.609035] ? do_futex+0x162/0x1f0 Aug 22 21:47:34 juju-e4d256-prod-github-runner-207 kernel: [59028.609680] ? __x64_sys_futex+0x78/0x1e0 Aug 22 21:47:34 juju-e4d256-prod-github-runner-207 kernel: [59028.610383] ? __secure_computing+0xa9/0x120 Aug 22 21:47:34 juju-e4d256-prod-github-runner-207 kernel: [59028.611071] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 21:47:34 juju-e4d256-prod-github-runner-207 kernel: [59028.611845] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:47:34 juju-e4d256-prod-github-runner-207 kernel: [59028.612584] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:47:34 juju-e4d256-prod-github-runner-207 kernel: [59028.613297] ? do_syscall_64+0x69/0xc0 Aug 22 21:47:34 juju-e4d256-prod-github-runner-207 kernel: [59028.613953] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:47:34 juju-e4d256-prod-github-runner-207 kernel: [59028.614657] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:47:34 juju-e4d256-prod-github-runner-207 kernel: [59028.615348] ? do_syscall_64+0x69/0xc0 Aug 22 21:47:34 juju-e4d256-prod-github-runner-207 kernel: [59028.615971] ? do_syscall_64+0x69/0xc0 Aug 22 21:47:34 juju-e4d256-prod-github-runner-207 kernel: [59028.616589] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 21:47:34 juju-e4d256-prod-github-runner-207 kernel: [59028.617291] RIP: 0033:0x7faa5d0edaff Aug 22 21:47:34 juju-e4d256-prod-github-runner-207 kernel: [59028.617960] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 21:47:34 juju-e4d256-prod-github-runner-207 kernel: [59028.619960] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 21:47:34 juju-e4d256-prod-github-runner-207 kernel: [59028.620866] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 21:47:34 juju-e4d256-prod-github-runner-207 kernel: [59028.621766] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 21:47:34 juju-e4d256-prod-github-runner-207 kernel: [59028.622657] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 21:47:34 juju-e4d256-prod-github-runner-207 kernel: [59028.623538] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 21:47:34 juju-e4d256-prod-github-runner-207 kernel: [59028.624427] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 21:47:34 juju-e4d256-prod-github-runner-207 kernel: [59028.625326] Aug 22 21:47:47 juju-e4d256-prod-github-runner-207 kernel: [59041.124710] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 21:47:47 juju-e4d256-prod-github-runner-207 kernel: [59041.125690] rcu: 1-....: (14684614 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=7096127 Aug 22 21:47:47 juju-e4d256-prod-github-runner-207 kernel: [59041.126840] (t=14730981 jiffies g=23269 q=53337) Aug 22 21:47:47 juju-e4d256-prod-github-runner-207 kernel: [59041.127633] NMI backtrace for cpu 1 Aug 22 21:47:47 juju-e4d256-prod-github-runner-207 kernel: [59041.128352] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 21:47:47 juju-e4d256-prod-github-runner-207 kernel: [59041.129469] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 21:47:47 juju-e4d256-prod-github-runner-207 kernel: [59041.130569] Call Trace: Aug 22 21:47:47 juju-e4d256-prod-github-runner-207 kernel: [59041.131272] Aug 22 21:47:47 juju-e4d256-prod-github-runner-207 kernel: [59041.131931] show_stack+0x52/0x5c Aug 22 21:47:47 juju-e4d256-prod-github-runner-207 kernel: [59041.132658] dump_stack_lvl+0x4a/0x63 Aug 22 21:47:47 juju-e4d256-prod-github-runner-207 kernel: [59041.133410] dump_stack+0x10/0x16 Aug 22 21:47:47 juju-e4d256-prod-github-runner-207 kernel: [59041.134145] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 21:47:47 juju-e4d256-prod-github-runner-207 kernel: [59041.134930] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 21:47:47 juju-e4d256-prod-github-runner-207 kernel: [59041.135714] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 21:47:47 juju-e4d256-prod-github-runner-207 kernel: [59041.136539] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 21:47:47 juju-e4d256-prod-github-runner-207 kernel: [59041.137364] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 21:47:47 juju-e4d256-prod-github-runner-207 kernel: [59041.138183] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 21:47:47 juju-e4d256-prod-github-runner-207 kernel: [59041.138959] print_cpu_stall.cold+0x2f/0xe2 Aug 22 21:47:47 juju-e4d256-prod-github-runner-207 kernel: [59041.139733] ? timekeeping_update+0xf7/0x150 Aug 22 21:47:47 juju-e4d256-prod-github-runner-207 kernel: [59041.140506] check_cpu_stall+0x109/0x270 Aug 22 21:47:47 juju-e4d256-prod-github-runner-207 kernel: [59041.141257] rcu_sched_clock_irq+0x9a/0x250 Aug 22 21:47:47 juju-e4d256-prod-github-runner-207 kernel: [59041.142033] update_process_times+0x94/0xd0 Aug 22 21:47:47 juju-e4d256-prod-github-runner-207 kernel: [59041.142805] tick_sched_handle+0x29/0x70 Aug 22 21:47:47 juju-e4d256-prod-github-runner-207 kernel: [59041.143651] tick_sched_timer+0x8c/0xc0 Aug 22 21:47:47 juju-e4d256-prod-github-runner-207 kernel: [59041.144463] ? tick_nohz_handler+0xb0/0xb0 Aug 22 21:47:47 juju-e4d256-prod-github-runner-207 kernel: [59041.145230] __hrtimer_run_queues+0x107/0x230 Aug 22 21:47:47 juju-e4d256-prod-github-runner-207 kernel: [59041.146042] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 21:47:47 juju-e4d256-prod-github-runner-207 kernel: [59041.146824] hrtimer_interrupt+0x101/0x220 Aug 22 21:47:47 juju-e4d256-prod-github-runner-207 kernel: [59041.147590] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 21:47:47 juju-e4d256-prod-github-runner-207 kernel: [59041.148412] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 21:47:47 juju-e4d256-prod-github-runner-207 kernel: [59041.149224] Aug 22 21:47:47 juju-e4d256-prod-github-runner-207 kernel: [59041.149884] Aug 22 21:47:47 juju-e4d256-prod-github-runner-207 kernel: [59041.150520] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 21:47:47 juju-e4d256-prod-github-runner-207 kernel: [59041.151348] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:47:47 juju-e4d256-prod-github-runner-207 kernel: [59041.152261] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 21:47:47 juju-e4d256-prod-github-runner-207 kernel: [59041.154553] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 21:47:47 juju-e4d256-prod-github-runner-207 kernel: [59041.155442] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 21:47:47 juju-e4d256-prod-github-runner-207 kernel: [59041.156452] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 21:47:47 juju-e4d256-prod-github-runner-207 kernel: [59041.157440] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 21:47:47 juju-e4d256-prod-github-runner-207 kernel: [59041.158428] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 21:47:47 juju-e4d256-prod-github-runner-207 kernel: [59041.159400] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 21:47:47 juju-e4d256-prod-github-runner-207 kernel: [59041.160366] ? _raw_spin_lock+0x22/0x30 Aug 22 21:47:47 juju-e4d256-prod-github-runner-207 kernel: [59041.161133] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:47:47 juju-e4d256-prod-github-runner-207 kernel: [59041.162006] direct_page_fault+0x206/0x310 [kvm] Aug 22 21:47:47 juju-e4d256-prod-github-runner-207 kernel: [59041.162852] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 21:47:47 juju-e4d256-prod-github-runner-207 kernel: [59041.163687] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 21:47:47 juju-e4d256-prod-github-runner-207 kernel: [59041.164517] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 21:47:47 juju-e4d256-prod-github-runner-207 kernel: [59041.165327] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 21:47:47 juju-e4d256-prod-github-runner-207 kernel: [59041.166127] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 21:47:47 juju-e4d256-prod-github-runner-207 kernel: [59041.166948] handle_exit+0x98/0x230 [kvm_amd] Aug 22 21:47:47 juju-e4d256-prod-github-runner-207 kernel: [59041.167708] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 21:47:47 juju-e4d256-prod-github-runner-207 kernel: [59041.168639] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 21:47:47 juju-e4d256-prod-github-runner-207 kernel: [59041.169576] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 21:47:47 juju-e4d256-prod-github-runner-207 kernel: [59041.170535] vcpu_run+0x62/0x2c0 [kvm] Aug 22 21:47:47 juju-e4d256-prod-github-runner-207 kernel: [59041.171336] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 21:47:47 juju-e4d256-prod-github-runner-207 kernel: [59041.172174] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 21:47:47 juju-e4d256-prod-github-runner-207 kernel: [59041.173076] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 21:47:47 juju-e4d256-prod-github-runner-207 kernel: [59041.173946] ? __seccomp_filter+0x4a/0x4a0 Aug 22 21:47:47 juju-e4d256-prod-github-runner-207 kernel: [59041.174752] ? __fget_files+0x86/0xc0 Aug 22 21:47:47 juju-e4d256-prod-github-runner-207 kernel: [59041.175520] __x64_sys_ioctl+0x95/0xd0 Aug 22 21:47:47 juju-e4d256-prod-github-runner-207 kernel: [59041.176289] do_syscall_64+0x5c/0xc0 Aug 22 21:47:47 juju-e4d256-prod-github-runner-207 kernel: [59041.177049] ? do_futex+0x162/0x1f0 Aug 22 21:47:47 juju-e4d256-prod-github-runner-207 kernel: [59041.177821] ? __x64_sys_futex+0x78/0x1e0 Aug 22 21:47:47 juju-e4d256-prod-github-runner-207 kernel: [59041.178608] ? __secure_computing+0xa9/0x120 Aug 22 21:47:47 juju-e4d256-prod-github-runner-207 kernel: [59041.179421] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 21:47:47 juju-e4d256-prod-github-runner-207 kernel: [59041.180324] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:47:47 juju-e4d256-prod-github-runner-207 kernel: [59041.181184] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:47:47 juju-e4d256-prod-github-runner-207 kernel: [59041.182130] ? do_syscall_64+0x69/0xc0 Aug 22 21:47:47 juju-e4d256-prod-github-runner-207 kernel: [59041.182906] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:47:47 juju-e4d256-prod-github-runner-207 kernel: [59041.183765] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:47:47 juju-e4d256-prod-github-runner-207 kernel: [59041.184619] ? do_syscall_64+0x69/0xc0 Aug 22 21:47:47 juju-e4d256-prod-github-runner-207 kernel: [59041.185386] ? do_syscall_64+0x69/0xc0 Aug 22 21:47:47 juju-e4d256-prod-github-runner-207 kernel: [59041.186180] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 21:47:47 juju-e4d256-prod-github-runner-207 kernel: [59041.187052] RIP: 0033:0x7faa5d0edaff Aug 22 21:47:47 juju-e4d256-prod-github-runner-207 kernel: [59041.187804] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 21:47:47 juju-e4d256-prod-github-runner-207 kernel: [59041.190271] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 21:47:47 juju-e4d256-prod-github-runner-207 kernel: [59041.191387] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 21:47:47 juju-e4d256-prod-github-runner-207 kernel: [59041.192470] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 21:47:47 juju-e4d256-prod-github-runner-207 kernel: [59041.193574] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 21:47:47 juju-e4d256-prod-github-runner-207 kernel: [59041.194678] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 21:47:47 juju-e4d256-prod-github-runner-207 kernel: [59041.195741] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 21:47:47 juju-e4d256-prod-github-runner-207 kernel: [59041.196819] Aug 22 21:48:14 juju-e4d256-prod-github-runner-207 kernel: [59068.541980] watchdog: BUG: soft lockup - CPU#1 stuck for 54903s! [qemu-system-x86:6715] Aug 22 21:48:14 juju-e4d256-prod-github-runner-207 kernel: [59068.543164] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 21:48:14 juju-e4d256-prod-github-runner-207 kernel: [59068.543237] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 21:48:14 juju-e4d256-prod-github-runner-207 kernel: [59068.556397] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 21:48:14 juju-e4d256-prod-github-runner-207 kernel: [59068.557764] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 21:48:14 juju-e4d256-prod-github-runner-207 kernel: [59068.559023] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:48:14 juju-e4d256-prod-github-runner-207 kernel: [59068.560131] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 21:48:14 juju-e4d256-prod-github-runner-207 kernel: [59068.562804] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 21:48:14 juju-e4d256-prod-github-runner-207 kernel: [59068.563874] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 21:48:14 juju-e4d256-prod-github-runner-207 kernel: [59068.565104] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 21:48:14 juju-e4d256-prod-github-runner-207 kernel: [59068.566319] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 21:48:14 juju-e4d256-prod-github-runner-207 kernel: [59068.567541] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 21:48:14 juju-e4d256-prod-github-runner-207 kernel: [59068.568741] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 21:48:14 juju-e4d256-prod-github-runner-207 kernel: [59068.569990] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 21:48:14 juju-e4d256-prod-github-runner-207 kernel: [59068.571256] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 21:48:14 juju-e4d256-prod-github-runner-207 kernel: [59068.572461] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 21:48:14 juju-e4d256-prod-github-runner-207 kernel: [59068.573711] Call Trace: Aug 22 21:48:14 juju-e4d256-prod-github-runner-207 kernel: [59068.574684] Aug 22 21:48:14 juju-e4d256-prod-github-runner-207 kernel: [59068.575609] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:48:14 juju-e4d256-prod-github-runner-207 kernel: [59068.576731] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:48:14 juju-e4d256-prod-github-runner-207 kernel: [59068.577856] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:48:14 juju-e4d256-prod-github-runner-207 kernel: [59068.578988] ? show_regs.part.0+0x23/0x29 Aug 22 21:48:14 juju-e4d256-prod-github-runner-207 kernel: [59068.580020] ? show_regs.cold+0x8/0xd Aug 22 21:48:14 juju-e4d256-prod-github-runner-207 kernel: [59068.581053] ? watchdog_timer_fn+0x1be/0x220 Aug 22 21:48:14 juju-e4d256-prod-github-runner-207 kernel: [59068.582107] ? lockup_detector_update_enable+0x60/0x60 Aug 22 21:48:14 juju-e4d256-prod-github-runner-207 kernel: [59068.583200] ? __hrtimer_run_queues+0x107/0x230 Aug 22 21:48:14 juju-e4d256-prod-github-runner-207 kernel: [59068.584287] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 21:48:14 juju-e4d256-prod-github-runner-207 kernel: [59068.585355] ? hrtimer_interrupt+0x101/0x220 Aug 22 21:48:14 juju-e4d256-prod-github-runner-207 kernel: [59068.586441] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 21:48:14 juju-e4d256-prod-github-runner-207 kernel: [59068.587687] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 21:48:14 juju-e4d256-prod-github-runner-207 kernel: [59068.588782] Aug 22 21:48:14 juju-e4d256-prod-github-runner-207 kernel: [59068.589681] Aug 22 21:48:14 juju-e4d256-prod-github-runner-207 kernel: [59068.590753] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 21:48:14 juju-e4d256-prod-github-runner-207 kernel: [59068.592009] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:48:14 juju-e4d256-prod-github-runner-207 kernel: [59068.593268] ? _raw_spin_lock+0x22/0x30 Aug 22 21:48:14 juju-e4d256-prod-github-runner-207 kernel: [59068.594261] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:48:14 juju-e4d256-prod-github-runner-207 kernel: [59068.595316] direct_page_fault+0x206/0x310 [kvm] Aug 22 21:48:14 juju-e4d256-prod-github-runner-207 kernel: [59068.596385] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 21:48:14 juju-e4d256-prod-github-runner-207 kernel: [59068.597481] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 21:48:14 juju-e4d256-prod-github-runner-207 kernel: [59068.598646] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 21:48:14 juju-e4d256-prod-github-runner-207 kernel: [59068.599702] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 21:48:14 juju-e4d256-prod-github-runner-207 kernel: [59068.600695] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 21:48:14 juju-e4d256-prod-github-runner-207 kernel: [59068.601854] handle_exit+0x98/0x230 [kvm_amd] Aug 22 21:48:14 juju-e4d256-prod-github-runner-207 kernel: [59068.603103] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 21:48:14 juju-e4d256-prod-github-runner-207 kernel: [59068.604132] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 21:48:14 juju-e4d256-prod-github-runner-207 kernel: [59068.605082] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 21:48:14 juju-e4d256-prod-github-runner-207 kernel: [59068.606055] vcpu_run+0x62/0x2c0 [kvm] Aug 22 21:48:14 juju-e4d256-prod-github-runner-207 kernel: [59068.606888] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 21:48:14 juju-e4d256-prod-github-runner-207 kernel: [59068.607718] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 21:48:14 juju-e4d256-prod-github-runner-207 kernel: [59068.608620] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 21:48:14 juju-e4d256-prod-github-runner-207 kernel: [59068.609721] ? __seccomp_filter+0x4a/0x4a0 Aug 22 21:48:14 juju-e4d256-prod-github-runner-207 kernel: [59068.610585] ? __fget_files+0x86/0xc0 Aug 22 21:48:14 juju-e4d256-prod-github-runner-207 kernel: [59068.611326] __x64_sys_ioctl+0x95/0xd0 Aug 22 21:48:14 juju-e4d256-prod-github-runner-207 kernel: [59068.612047] do_syscall_64+0x5c/0xc0 Aug 22 21:48:14 juju-e4d256-prod-github-runner-207 kernel: [59068.612756] ? do_futex+0x162/0x1f0 Aug 22 21:48:14 juju-e4d256-prod-github-runner-207 kernel: [59068.613589] ? __x64_sys_futex+0x78/0x1e0 Aug 22 21:48:14 juju-e4d256-prod-github-runner-207 kernel: [59068.614568] ? __secure_computing+0xa9/0x120 Aug 22 21:48:14 juju-e4d256-prod-github-runner-207 kernel: [59068.615590] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 21:48:14 juju-e4d256-prod-github-runner-207 kernel: [59068.616680] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:48:14 juju-e4d256-prod-github-runner-207 kernel: [59068.617731] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:48:14 juju-e4d256-prod-github-runner-207 kernel: [59068.618773] ? do_syscall_64+0x69/0xc0 Aug 22 21:48:14 juju-e4d256-prod-github-runner-207 kernel: [59068.619704] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:48:14 juju-e4d256-prod-github-runner-207 kernel: [59068.620738] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:48:14 juju-e4d256-prod-github-runner-207 kernel: [59068.621550] ? do_syscall_64+0x69/0xc0 Aug 22 21:48:14 juju-e4d256-prod-github-runner-207 kernel: [59068.622196] ? do_syscall_64+0x69/0xc0 Aug 22 21:48:14 juju-e4d256-prod-github-runner-207 kernel: [59068.622873] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 21:48:14 juju-e4d256-prod-github-runner-207 kernel: [59068.623610] RIP: 0033:0x7faa5d0edaff Aug 22 21:48:14 juju-e4d256-prod-github-runner-207 kernel: [59068.624272] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 21:48:14 juju-e4d256-prod-github-runner-207 kernel: [59068.626363] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 21:48:14 juju-e4d256-prod-github-runner-207 kernel: [59068.627297] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 21:48:14 juju-e4d256-prod-github-runner-207 kernel: [59068.628244] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 21:48:14 juju-e4d256-prod-github-runner-207 kernel: [59068.629179] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 21:48:14 juju-e4d256-prod-github-runner-207 kernel: [59068.630192] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 21:48:14 juju-e4d256-prod-github-runner-207 kernel: [59068.631147] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 21:48:14 juju-e4d256-prod-github-runner-207 kernel: [59068.632163] Aug 22 21:48:42 juju-e4d256-prod-github-runner-207 kernel: [59096.541980] watchdog: BUG: soft lockup - CPU#1 stuck for 54929s! [qemu-system-x86:6715] Aug 22 21:48:42 juju-e4d256-prod-github-runner-207 kernel: [59096.543845] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 21:48:42 juju-e4d256-prod-github-runner-207 kernel: [59096.544157] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 21:48:42 juju-e4d256-prod-github-runner-207 kernel: [59096.556580] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 21:48:42 juju-e4d256-prod-github-runner-207 kernel: [59096.557877] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 21:48:42 juju-e4d256-prod-github-runner-207 kernel: [59096.559096] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:48:42 juju-e4d256-prod-github-runner-207 kernel: [59096.560176] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 21:48:42 juju-e4d256-prod-github-runner-207 kernel: [59096.562922] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 21:48:42 juju-e4d256-prod-github-runner-207 kernel: [59096.563965] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 21:48:42 juju-e4d256-prod-github-runner-207 kernel: [59096.565146] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 21:48:42 juju-e4d256-prod-github-runner-207 kernel: [59096.566343] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 21:48:42 juju-e4d256-prod-github-runner-207 kernel: [59096.567524] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 21:48:42 juju-e4d256-prod-github-runner-207 kernel: [59096.568693] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 21:48:42 juju-e4d256-prod-github-runner-207 kernel: [59096.569887] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 21:48:42 juju-e4d256-prod-github-runner-207 kernel: [59096.571131] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 21:48:42 juju-e4d256-prod-github-runner-207 kernel: [59096.572226] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 21:48:42 juju-e4d256-prod-github-runner-207 kernel: [59096.573443] Call Trace: Aug 22 21:48:42 juju-e4d256-prod-github-runner-207 kernel: [59096.574361] Aug 22 21:48:42 juju-e4d256-prod-github-runner-207 kernel: [59096.575262] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:48:42 juju-e4d256-prod-github-runner-207 kernel: [59096.576292] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:48:42 juju-e4d256-prod-github-runner-207 kernel: [59096.577375] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:48:42 juju-e4d256-prod-github-runner-207 kernel: [59096.578478] ? show_regs.part.0+0x23/0x29 Aug 22 21:48:42 juju-e4d256-prod-github-runner-207 kernel: [59096.579486] ? show_regs.cold+0x8/0xd Aug 22 21:48:42 juju-e4d256-prod-github-runner-207 kernel: [59096.580470] ? watchdog_timer_fn+0x1be/0x220 Aug 22 21:48:42 juju-e4d256-prod-github-runner-207 kernel: [59096.581514] ? lockup_detector_update_enable+0x60/0x60 Aug 22 21:48:42 juju-e4d256-prod-github-runner-207 kernel: [59096.582575] ? __hrtimer_run_queues+0x107/0x230 Aug 22 21:48:42 juju-e4d256-prod-github-runner-207 kernel: [59096.583606] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 21:48:42 juju-e4d256-prod-github-runner-207 kernel: [59096.584633] ? hrtimer_interrupt+0x101/0x220 Aug 22 21:48:42 juju-e4d256-prod-github-runner-207 kernel: [59096.585661] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 21:48:42 juju-e4d256-prod-github-runner-207 kernel: [59096.586730] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 21:48:42 juju-e4d256-prod-github-runner-207 kernel: [59096.587828] Aug 22 21:48:42 juju-e4d256-prod-github-runner-207 kernel: [59096.588692] Aug 22 21:48:42 juju-e4d256-prod-github-runner-207 kernel: [59096.589546] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 21:48:42 juju-e4d256-prod-github-runner-207 kernel: [59096.590584] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:48:42 juju-e4d256-prod-github-runner-207 kernel: [59096.591619] ? _raw_spin_lock+0x22/0x30 Aug 22 21:48:42 juju-e4d256-prod-github-runner-207 kernel: [59096.592564] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:48:42 juju-e4d256-prod-github-runner-207 kernel: [59096.593615] direct_page_fault+0x206/0x310 [kvm] Aug 22 21:48:42 juju-e4d256-prod-github-runner-207 kernel: [59096.594644] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 21:48:42 juju-e4d256-prod-github-runner-207 kernel: [59096.595651] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 21:48:42 juju-e4d256-prod-github-runner-207 kernel: [59096.596676] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 21:48:42 juju-e4d256-prod-github-runner-207 kernel: [59096.597735] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 21:48:42 juju-e4d256-prod-github-runner-207 kernel: [59096.598693] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 21:48:42 juju-e4d256-prod-github-runner-207 kernel: [59096.599676] handle_exit+0x98/0x230 [kvm_amd] Aug 22 21:48:42 juju-e4d256-prod-github-runner-207 kernel: [59096.600569] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 21:48:42 juju-e4d256-prod-github-runner-207 kernel: [59096.601505] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 21:48:42 juju-e4d256-prod-github-runner-207 kernel: [59096.602442] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 21:48:42 juju-e4d256-prod-github-runner-207 kernel: [59096.603364] vcpu_run+0x62/0x2c0 [kvm] Aug 22 21:48:42 juju-e4d256-prod-github-runner-207 kernel: [59096.604174] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 21:48:42 juju-e4d256-prod-github-runner-207 kernel: [59096.604999] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 21:48:42 juju-e4d256-prod-github-runner-207 kernel: [59096.605854] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 21:48:42 juju-e4d256-prod-github-runner-207 kernel: [59096.606650] ? __seccomp_filter+0x4a/0x4a0 Aug 22 21:48:42 juju-e4d256-prod-github-runner-207 kernel: [59096.607395] ? __fget_files+0x86/0xc0 Aug 22 21:48:42 juju-e4d256-prod-github-runner-207 kernel: [59096.608133] __x64_sys_ioctl+0x95/0xd0 Aug 22 21:48:42 juju-e4d256-prod-github-runner-207 kernel: [59096.608831] do_syscall_64+0x5c/0xc0 Aug 22 21:48:42 juju-e4d256-prod-github-runner-207 kernel: [59096.609520] ? do_futex+0x162/0x1f0 Aug 22 21:48:42 juju-e4d256-prod-github-runner-207 kernel: [59096.610169] ? __x64_sys_futex+0x78/0x1e0 Aug 22 21:48:42 juju-e4d256-prod-github-runner-207 kernel: [59096.610842] ? __secure_computing+0xa9/0x120 Aug 22 21:48:42 juju-e4d256-prod-github-runner-207 kernel: [59096.611531] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 21:48:42 juju-e4d256-prod-github-runner-207 kernel: [59096.612289] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:48:42 juju-e4d256-prod-github-runner-207 kernel: [59096.613019] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:48:42 juju-e4d256-prod-github-runner-207 kernel: [59096.613738] ? do_syscall_64+0x69/0xc0 Aug 22 21:48:42 juju-e4d256-prod-github-runner-207 kernel: [59096.614384] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:48:42 juju-e4d256-prod-github-runner-207 kernel: [59096.615087] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:48:42 juju-e4d256-prod-github-runner-207 kernel: [59096.615811] ? do_syscall_64+0x69/0xc0 Aug 22 21:48:42 juju-e4d256-prod-github-runner-207 kernel: [59096.616435] ? do_syscall_64+0x69/0xc0 Aug 22 21:48:42 juju-e4d256-prod-github-runner-207 kernel: [59096.617067] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 21:48:42 juju-e4d256-prod-github-runner-207 kernel: [59096.617781] RIP: 0033:0x7faa5d0edaff Aug 22 21:48:42 juju-e4d256-prod-github-runner-207 kernel: [59096.618465] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 21:48:42 juju-e4d256-prod-github-runner-207 kernel: [59096.620471] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 21:48:42 juju-e4d256-prod-github-runner-207 kernel: [59096.621429] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 21:48:42 juju-e4d256-prod-github-runner-207 kernel: [59096.622321] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 21:48:42 juju-e4d256-prod-github-runner-207 kernel: [59096.623210] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 21:48:42 juju-e4d256-prod-github-runner-207 kernel: [59096.624095] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 21:48:42 juju-e4d256-prod-github-runner-207 kernel: [59096.625001] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 21:48:42 juju-e4d256-prod-github-runner-207 kernel: [59096.625953] Aug 22 21:49:10 juju-e4d256-prod-github-runner-207 kernel: [59124.541976] watchdog: BUG: soft lockup - CPU#1 stuck for 54956s! [qemu-system-x86:6715] Aug 22 21:49:10 juju-e4d256-prod-github-runner-207 kernel: [59124.543814] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 21:49:10 juju-e4d256-prod-github-runner-207 kernel: [59124.544110] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 21:49:10 juju-e4d256-prod-github-runner-207 kernel: [59124.557121] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 21:49:10 juju-e4d256-prod-github-runner-207 kernel: [59124.558504] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 21:49:10 juju-e4d256-prod-github-runner-207 kernel: [59124.560029] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:49:10 juju-e4d256-prod-github-runner-207 kernel: [59124.561369] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 21:49:10 juju-e4d256-prod-github-runner-207 kernel: [59124.564018] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 21:49:10 juju-e4d256-prod-github-runner-207 kernel: [59124.565124] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 21:49:10 juju-e4d256-prod-github-runner-207 kernel: [59124.566293] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 21:49:10 juju-e4d256-prod-github-runner-207 kernel: [59124.567458] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 21:49:10 juju-e4d256-prod-github-runner-207 kernel: [59124.568670] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 21:49:10 juju-e4d256-prod-github-runner-207 kernel: [59124.569862] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 21:49:10 juju-e4d256-prod-github-runner-207 kernel: [59124.571037] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 21:49:10 juju-e4d256-prod-github-runner-207 kernel: [59124.572281] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 21:49:10 juju-e4d256-prod-github-runner-207 kernel: [59124.573407] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 21:49:10 juju-e4d256-prod-github-runner-207 kernel: [59124.574660] Call Trace: Aug 22 21:49:10 juju-e4d256-prod-github-runner-207 kernel: [59124.575587] Aug 22 21:49:10 juju-e4d256-prod-github-runner-207 kernel: [59124.576490] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:49:10 juju-e4d256-prod-github-runner-207 kernel: [59124.577538] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:49:10 juju-e4d256-prod-github-runner-207 kernel: [59124.578603] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:49:10 juju-e4d256-prod-github-runner-207 kernel: [59124.579736] ? show_regs.part.0+0x23/0x29 Aug 22 21:49:10 juju-e4d256-prod-github-runner-207 kernel: [59124.580758] ? show_regs.cold+0x8/0xd Aug 22 21:49:10 juju-e4d256-prod-github-runner-207 kernel: [59124.581742] ? watchdog_timer_fn+0x1be/0x220 Aug 22 21:49:10 juju-e4d256-prod-github-runner-207 kernel: [59124.582761] ? lockup_detector_update_enable+0x60/0x60 Aug 22 21:49:10 juju-e4d256-prod-github-runner-207 kernel: [59124.583929] ? __hrtimer_run_queues+0x107/0x230 Aug 22 21:49:10 juju-e4d256-prod-github-runner-207 kernel: [59124.585019] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 21:49:10 juju-e4d256-prod-github-runner-207 kernel: [59124.586065] ? hrtimer_interrupt+0x101/0x220 Aug 22 21:49:10 juju-e4d256-prod-github-runner-207 kernel: [59124.587086] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 21:49:10 juju-e4d256-prod-github-runner-207 kernel: [59124.588159] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 21:49:10 juju-e4d256-prod-github-runner-207 kernel: [59124.589285] Aug 22 21:49:10 juju-e4d256-prod-github-runner-207 kernel: [59124.590187] Aug 22 21:49:10 juju-e4d256-prod-github-runner-207 kernel: [59124.591161] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 21:49:10 juju-e4d256-prod-github-runner-207 kernel: [59124.592262] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:49:10 juju-e4d256-prod-github-runner-207 kernel: [59124.593504] ? _raw_spin_lock+0x22/0x30 Aug 22 21:49:10 juju-e4d256-prod-github-runner-207 kernel: [59124.594865] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:49:10 juju-e4d256-prod-github-runner-207 kernel: [59124.596305] direct_page_fault+0x206/0x310 [kvm] Aug 22 21:49:10 juju-e4d256-prod-github-runner-207 kernel: [59124.597787] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 21:49:10 juju-e4d256-prod-github-runner-207 kernel: [59124.599242] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 21:49:10 juju-e4d256-prod-github-runner-207 kernel: [59124.600731] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 21:49:10 juju-e4d256-prod-github-runner-207 kernel: [59124.602203] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 21:49:10 juju-e4d256-prod-github-runner-207 kernel: [59124.603578] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 21:49:10 juju-e4d256-prod-github-runner-207 kernel: [59124.605054] handle_exit+0x98/0x230 [kvm_amd] Aug 22 21:49:10 juju-e4d256-prod-github-runner-207 kernel: [59124.606315] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 21:49:10 juju-e4d256-prod-github-runner-207 kernel: [59124.607588] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 21:49:10 juju-e4d256-prod-github-runner-207 kernel: [59124.609362] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 21:49:10 juju-e4d256-prod-github-runner-207 kernel: [59124.610655] vcpu_run+0x62/0x2c0 [kvm] Aug 22 21:49:10 juju-e4d256-prod-github-runner-207 kernel: [59124.611869] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 21:49:10 juju-e4d256-prod-github-runner-207 kernel: [59124.613106] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 21:49:10 juju-e4d256-prod-github-runner-207 kernel: [59124.614388] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 21:49:10 juju-e4d256-prod-github-runner-207 kernel: [59124.615467] ? __seccomp_filter+0x4a/0x4a0 Aug 22 21:49:10 juju-e4d256-prod-github-runner-207 kernel: [59124.616492] ? __fget_files+0x86/0xc0 Aug 22 21:49:10 juju-e4d256-prod-github-runner-207 kernel: [59124.617545] __x64_sys_ioctl+0x95/0xd0 Aug 22 21:49:10 juju-e4d256-prod-github-runner-207 kernel: [59124.618582] do_syscall_64+0x5c/0xc0 Aug 22 21:49:10 juju-e4d256-prod-github-runner-207 kernel: [59124.619589] ? do_futex+0x162/0x1f0 Aug 22 21:49:10 juju-e4d256-prod-github-runner-207 kernel: [59124.620531] ? __x64_sys_futex+0x78/0x1e0 Aug 22 21:49:10 juju-e4d256-prod-github-runner-207 kernel: [59124.621607] ? __secure_computing+0xa9/0x120 Aug 22 21:49:10 juju-e4d256-prod-github-runner-207 kernel: [59124.622714] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 21:49:10 juju-e4d256-prod-github-runner-207 kernel: [59124.624052] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:49:10 juju-e4d256-prod-github-runner-207 kernel: [59124.625159] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:49:10 juju-e4d256-prod-github-runner-207 kernel: [59124.626271] ? do_syscall_64+0x69/0xc0 Aug 22 21:49:10 juju-e4d256-prod-github-runner-207 kernel: [59124.627211] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:49:10 juju-e4d256-prod-github-runner-207 kernel: [59124.628301] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:49:10 juju-e4d256-prod-github-runner-207 kernel: [59124.629375] ? do_syscall_64+0x69/0xc0 Aug 22 21:49:10 juju-e4d256-prod-github-runner-207 kernel: [59124.630258] ? do_syscall_64+0x69/0xc0 Aug 22 21:49:10 juju-e4d256-prod-github-runner-207 kernel: [59124.631205] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 21:49:10 juju-e4d256-prod-github-runner-207 kernel: [59124.632230] RIP: 0033:0x7faa5d0edaff Aug 22 21:49:10 juju-e4d256-prod-github-runner-207 kernel: [59124.633231] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 21:49:10 juju-e4d256-prod-github-runner-207 kernel: [59124.636096] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 21:49:10 juju-e4d256-prod-github-runner-207 kernel: [59124.637339] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 21:49:10 juju-e4d256-prod-github-runner-207 kernel: [59124.638565] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 21:49:10 juju-e4d256-prod-github-runner-207 kernel: [59124.639895] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 21:49:10 juju-e4d256-prod-github-runner-207 kernel: [59124.641273] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 21:49:10 juju-e4d256-prod-github-runner-207 kernel: [59124.642574] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 21:49:10 juju-e4d256-prod-github-runner-207 kernel: [59124.643879] Aug 22 21:49:38 juju-e4d256-prod-github-runner-207 kernel: [59152.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 54982s! [qemu-system-x86:6715] Aug 22 21:49:38 juju-e4d256-prod-github-runner-207 kernel: [59152.543891] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 21:49:38 juju-e4d256-prod-github-runner-207 kernel: [59152.544195] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 21:49:38 juju-e4d256-prod-github-runner-207 kernel: [59152.556877] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 21:49:38 juju-e4d256-prod-github-runner-207 kernel: [59152.558149] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 21:49:38 juju-e4d256-prod-github-runner-207 kernel: [59152.559360] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:49:38 juju-e4d256-prod-github-runner-207 kernel: [59152.560570] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 21:49:38 juju-e4d256-prod-github-runner-207 kernel: [59152.563177] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 21:49:38 juju-e4d256-prod-github-runner-207 kernel: [59152.564225] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 21:49:38 juju-e4d256-prod-github-runner-207 kernel: [59152.565400] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 21:49:38 juju-e4d256-prod-github-runner-207 kernel: [59152.566560] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 21:49:38 juju-e4d256-prod-github-runner-207 kernel: [59152.567719] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 21:49:38 juju-e4d256-prod-github-runner-207 kernel: [59152.568897] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 21:49:38 juju-e4d256-prod-github-runner-207 kernel: [59152.570063] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 21:49:38 juju-e4d256-prod-github-runner-207 kernel: [59152.571293] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 21:49:38 juju-e4d256-prod-github-runner-207 kernel: [59152.572424] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 21:49:38 juju-e4d256-prod-github-runner-207 kernel: [59152.573643] Call Trace: Aug 22 21:49:38 juju-e4d256-prod-github-runner-207 kernel: [59152.574555] Aug 22 21:49:38 juju-e4d256-prod-github-runner-207 kernel: [59152.575448] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:49:38 juju-e4d256-prod-github-runner-207 kernel: [59152.576508] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:49:38 juju-e4d256-prod-github-runner-207 kernel: [59152.577535] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:49:38 juju-e4d256-prod-github-runner-207 kernel: [59152.578630] ? show_regs.part.0+0x23/0x29 Aug 22 21:49:38 juju-e4d256-prod-github-runner-207 kernel: [59152.579631] ? show_regs.cold+0x8/0xd Aug 22 21:49:38 juju-e4d256-prod-github-runner-207 kernel: [59152.580624] ? watchdog_timer_fn+0x1be/0x220 Aug 22 21:49:38 juju-e4d256-prod-github-runner-207 kernel: [59152.581670] ? lockup_detector_update_enable+0x60/0x60 Aug 22 21:49:38 juju-e4d256-prod-github-runner-207 kernel: [59152.582752] ? __hrtimer_run_queues+0x107/0x230 Aug 22 21:49:38 juju-e4d256-prod-github-runner-207 kernel: [59152.583838] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 21:49:38 juju-e4d256-prod-github-runner-207 kernel: [59152.584950] ? hrtimer_interrupt+0x101/0x220 Aug 22 21:49:38 juju-e4d256-prod-github-runner-207 kernel: [59152.586017] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 21:49:38 juju-e4d256-prod-github-runner-207 kernel: [59152.587125] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 21:49:38 juju-e4d256-prod-github-runner-207 kernel: [59152.588221] Aug 22 21:49:38 juju-e4d256-prod-github-runner-207 kernel: [59152.589123] Aug 22 21:49:38 juju-e4d256-prod-github-runner-207 kernel: [59152.590017] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 21:49:38 juju-e4d256-prod-github-runner-207 kernel: [59152.591184] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:49:38 juju-e4d256-prod-github-runner-207 kernel: [59152.593342] ? _raw_spin_lock+0x22/0x30 Aug 22 21:49:38 juju-e4d256-prod-github-runner-207 kernel: [59152.594352] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:49:38 juju-e4d256-prod-github-runner-207 kernel: [59152.595416] direct_page_fault+0x206/0x310 [kvm] Aug 22 21:49:38 juju-e4d256-prod-github-runner-207 kernel: [59152.596508] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 21:49:38 juju-e4d256-prod-github-runner-207 kernel: [59152.597538] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 21:49:38 juju-e4d256-prod-github-runner-207 kernel: [59152.598567] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 21:49:38 juju-e4d256-prod-github-runner-207 kernel: [59152.599582] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 21:49:38 juju-e4d256-prod-github-runner-207 kernel: [59152.600549] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 21:49:38 juju-e4d256-prod-github-runner-207 kernel: [59152.601539] handle_exit+0x98/0x230 [kvm_amd] Aug 22 21:49:38 juju-e4d256-prod-github-runner-207 kernel: [59152.602457] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 21:49:38 juju-e4d256-prod-github-runner-207 kernel: [59152.603397] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 21:49:38 juju-e4d256-prod-github-runner-207 kernel: [59152.604378] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 21:49:38 juju-e4d256-prod-github-runner-207 kernel: [59152.605533] vcpu_run+0x62/0x2c0 [kvm] Aug 22 21:49:38 juju-e4d256-prod-github-runner-207 kernel: [59152.606357] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 21:49:38 juju-e4d256-prod-github-runner-207 kernel: [59152.607164] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 21:49:38 juju-e4d256-prod-github-runner-207 kernel: [59152.608019] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 21:49:38 juju-e4d256-prod-github-runner-207 kernel: [59152.608843] ? __seccomp_filter+0x4a/0x4a0 Aug 22 21:49:38 juju-e4d256-prod-github-runner-207 kernel: [59152.609585] ? __fget_files+0x86/0xc0 Aug 22 21:49:38 juju-e4d256-prod-github-runner-207 kernel: [59152.610288] __x64_sys_ioctl+0x95/0xd0 Aug 22 21:49:38 juju-e4d256-prod-github-runner-207 kernel: [59152.611004] do_syscall_64+0x5c/0xc0 Aug 22 21:49:38 juju-e4d256-prod-github-runner-207 kernel: [59152.611673] ? do_futex+0x162/0x1f0 Aug 22 21:49:38 juju-e4d256-prod-github-runner-207 kernel: [59152.612338] ? __x64_sys_futex+0x78/0x1e0 Aug 22 21:49:38 juju-e4d256-prod-github-runner-207 kernel: [59152.613014] ? __secure_computing+0xa9/0x120 Aug 22 21:49:38 juju-e4d256-prod-github-runner-207 kernel: [59152.613719] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 21:49:38 juju-e4d256-prod-github-runner-207 kernel: [59152.614505] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:49:38 juju-e4d256-prod-github-runner-207 kernel: [59152.615225] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:49:38 juju-e4d256-prod-github-runner-207 kernel: [59152.615958] ? do_syscall_64+0x69/0xc0 Aug 22 21:49:38 juju-e4d256-prod-github-runner-207 kernel: [59152.616646] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:49:38 juju-e4d256-prod-github-runner-207 kernel: [59152.617363] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:49:38 juju-e4d256-prod-github-runner-207 kernel: [59152.618184] ? do_syscall_64+0x69/0xc0 Aug 22 21:49:38 juju-e4d256-prod-github-runner-207 kernel: [59152.618814] ? do_syscall_64+0x69/0xc0 Aug 22 21:49:38 juju-e4d256-prod-github-runner-207 kernel: [59152.619440] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 21:49:38 juju-e4d256-prod-github-runner-207 kernel: [59152.620151] RIP: 0033:0x7faa5d0edaff Aug 22 21:49:38 juju-e4d256-prod-github-runner-207 kernel: [59152.620821] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 21:49:38 juju-e4d256-prod-github-runner-207 kernel: [59152.622805] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 21:49:38 juju-e4d256-prod-github-runner-207 kernel: [59152.623730] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 21:49:38 juju-e4d256-prod-github-runner-207 kernel: [59152.624652] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 21:49:38 juju-e4d256-prod-github-runner-207 kernel: [59152.625552] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 21:49:38 juju-e4d256-prod-github-runner-207 kernel: [59152.626541] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 21:49:38 juju-e4d256-prod-github-runner-207 kernel: [59152.627433] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 21:49:38 juju-e4d256-prod-github-runner-207 kernel: [59152.628351] Aug 22 21:50:06 juju-e4d256-prod-github-runner-207 kernel: [59180.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 55008s! [qemu-system-x86:6715] Aug 22 21:50:06 juju-e4d256-prod-github-runner-207 kernel: [59180.543094] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 21:50:06 juju-e4d256-prod-github-runner-207 kernel: [59180.543168] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 21:50:06 juju-e4d256-prod-github-runner-207 kernel: [59180.555314] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 21:50:06 juju-e4d256-prod-github-runner-207 kernel: [59180.556589] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 21:50:06 juju-e4d256-prod-github-runner-207 kernel: [59180.557865] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:50:06 juju-e4d256-prod-github-runner-207 kernel: [59180.558938] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 21:50:06 juju-e4d256-prod-github-runner-207 kernel: [59180.561556] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 21:50:06 juju-e4d256-prod-github-runner-207 kernel: [59180.562851] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 21:50:06 juju-e4d256-prod-github-runner-207 kernel: [59180.564030] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 21:50:06 juju-e4d256-prod-github-runner-207 kernel: [59180.565190] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 21:50:06 juju-e4d256-prod-github-runner-207 kernel: [59180.566350] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 21:50:06 juju-e4d256-prod-github-runner-207 kernel: [59180.567542] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 21:50:06 juju-e4d256-prod-github-runner-207 kernel: [59180.568721] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 21:50:06 juju-e4d256-prod-github-runner-207 kernel: [59180.569953] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 21:50:06 juju-e4d256-prod-github-runner-207 kernel: [59180.571135] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 21:50:06 juju-e4d256-prod-github-runner-207 kernel: [59180.572350] Call Trace: Aug 22 21:50:06 juju-e4d256-prod-github-runner-207 kernel: [59180.573270] Aug 22 21:50:06 juju-e4d256-prod-github-runner-207 kernel: [59180.574154] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:50:06 juju-e4d256-prod-github-runner-207 kernel: [59180.575185] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:50:06 juju-e4d256-prod-github-runner-207 kernel: [59180.576230] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:50:06 juju-e4d256-prod-github-runner-207 kernel: [59180.577321] ? show_regs.part.0+0x23/0x29 Aug 22 21:50:06 juju-e4d256-prod-github-runner-207 kernel: [59180.578322] ? show_regs.cold+0x8/0xd Aug 22 21:50:06 juju-e4d256-prod-github-runner-207 kernel: [59180.579299] ? watchdog_timer_fn+0x1be/0x220 Aug 22 21:50:06 juju-e4d256-prod-github-runner-207 kernel: [59180.580345] ? lockup_detector_update_enable+0x60/0x60 Aug 22 21:50:06 juju-e4d256-prod-github-runner-207 kernel: [59180.581411] ? __hrtimer_run_queues+0x107/0x230 Aug 22 21:50:06 juju-e4d256-prod-github-runner-207 kernel: [59180.582437] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 21:50:06 juju-e4d256-prod-github-runner-207 kernel: [59180.583459] ? hrtimer_interrupt+0x101/0x220 Aug 22 21:50:06 juju-e4d256-prod-github-runner-207 kernel: [59180.584480] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 21:50:06 juju-e4d256-prod-github-runner-207 kernel: [59180.585548] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 21:50:06 juju-e4d256-prod-github-runner-207 kernel: [59180.586601] Aug 22 21:50:06 juju-e4d256-prod-github-runner-207 kernel: [59180.587456] Aug 22 21:50:06 juju-e4d256-prod-github-runner-207 kernel: [59180.588302] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 21:50:06 juju-e4d256-prod-github-runner-207 kernel: [59180.589339] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:50:06 juju-e4d256-prod-github-runner-207 kernel: [59180.590383] ? _raw_spin_lock+0x22/0x30 Aug 22 21:50:06 juju-e4d256-prod-github-runner-207 kernel: [59180.591333] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:50:06 juju-e4d256-prod-github-runner-207 kernel: [59180.592368] direct_page_fault+0x206/0x310 [kvm] Aug 22 21:50:06 juju-e4d256-prod-github-runner-207 kernel: [59180.593405] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 21:50:06 juju-e4d256-prod-github-runner-207 kernel: [59180.594417] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 21:50:06 juju-e4d256-prod-github-runner-207 kernel: [59180.595422] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 21:50:06 juju-e4d256-prod-github-runner-207 kernel: [59180.596409] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 21:50:06 juju-e4d256-prod-github-runner-207 kernel: [59180.597355] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 21:50:06 juju-e4d256-prod-github-runner-207 kernel: [59180.598339] handle_exit+0x98/0x230 [kvm_amd] Aug 22 21:50:06 juju-e4d256-prod-github-runner-207 kernel: [59180.599232] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 21:50:06 juju-e4d256-prod-github-runner-207 kernel: [59180.600158] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 21:50:06 juju-e4d256-prod-github-runner-207 kernel: [59180.601086] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 21:50:06 juju-e4d256-prod-github-runner-207 kernel: [59180.601990] vcpu_run+0x62/0x2c0 [kvm] Aug 22 21:50:06 juju-e4d256-prod-github-runner-207 kernel: [59180.602802] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 21:50:06 juju-e4d256-prod-github-runner-207 kernel: [59180.603669] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 21:50:06 juju-e4d256-prod-github-runner-207 kernel: [59180.604545] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 21:50:06 juju-e4d256-prod-github-runner-207 kernel: [59180.605502] ? __seccomp_filter+0x4a/0x4a0 Aug 22 21:50:06 juju-e4d256-prod-github-runner-207 kernel: [59180.606248] ? __fget_files+0x86/0xc0 Aug 22 21:50:06 juju-e4d256-prod-github-runner-207 kernel: [59180.606956] __x64_sys_ioctl+0x95/0xd0 Aug 22 21:50:06 juju-e4d256-prod-github-runner-207 kernel: [59180.607667] do_syscall_64+0x5c/0xc0 Aug 22 21:50:06 juju-e4d256-prod-github-runner-207 kernel: [59180.608539] ? do_futex+0x162/0x1f0 Aug 22 21:50:06 juju-e4d256-prod-github-runner-207 kernel: [59180.609195] ? __x64_sys_futex+0x78/0x1e0 Aug 22 21:50:06 juju-e4d256-prod-github-runner-207 kernel: [59180.609867] ? __secure_computing+0xa9/0x120 Aug 22 21:50:06 juju-e4d256-prod-github-runner-207 kernel: [59180.610557] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 21:50:06 juju-e4d256-prod-github-runner-207 kernel: [59180.611318] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:50:06 juju-e4d256-prod-github-runner-207 kernel: [59180.612065] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:50:06 juju-e4d256-prod-github-runner-207 kernel: [59180.612786] ? do_syscall_64+0x69/0xc0 Aug 22 21:50:06 juju-e4d256-prod-github-runner-207 kernel: [59180.613433] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:50:06 juju-e4d256-prod-github-runner-207 kernel: [59180.614145] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:50:06 juju-e4d256-prod-github-runner-207 kernel: [59180.614843] ? do_syscall_64+0x69/0xc0 Aug 22 21:50:06 juju-e4d256-prod-github-runner-207 kernel: [59180.615486] ? do_syscall_64+0x69/0xc0 Aug 22 21:50:06 juju-e4d256-prod-github-runner-207 kernel: [59180.616147] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 21:50:06 juju-e4d256-prod-github-runner-207 kernel: [59180.616856] RIP: 0033:0x7faa5d0edaff Aug 22 21:50:06 juju-e4d256-prod-github-runner-207 kernel: [59180.617485] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 21:50:06 juju-e4d256-prod-github-runner-207 kernel: [59180.619822] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 21:50:06 juju-e4d256-prod-github-runner-207 kernel: [59180.620779] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 21:50:06 juju-e4d256-prod-github-runner-207 kernel: [59180.621676] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 21:50:06 juju-e4d256-prod-github-runner-207 kernel: [59180.622580] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 21:50:06 juju-e4d256-prod-github-runner-207 kernel: [59180.623471] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 21:50:06 juju-e4d256-prod-github-runner-207 kernel: [59180.624397] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 21:50:06 juju-e4d256-prod-github-runner-207 kernel: [59180.625302] Aug 22 21:50:34 juju-e4d256-prod-github-runner-207 kernel: [59208.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 55034s! [qemu-system-x86:6715] Aug 22 21:50:34 juju-e4d256-prod-github-runner-207 kernel: [59208.543918] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 21:50:34 juju-e4d256-prod-github-runner-207 kernel: [59208.544229] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 21:50:34 juju-e4d256-prod-github-runner-207 kernel: [59208.556379] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 21:50:34 juju-e4d256-prod-github-runner-207 kernel: [59208.557658] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 21:50:34 juju-e4d256-prod-github-runner-207 kernel: [59208.558890] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:50:34 juju-e4d256-prod-github-runner-207 kernel: [59208.559964] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 21:50:34 juju-e4d256-prod-github-runner-207 kernel: [59208.562717] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 21:50:34 juju-e4d256-prod-github-runner-207 kernel: [59208.563900] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 21:50:34 juju-e4d256-prod-github-runner-207 kernel: [59208.565064] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 21:50:34 juju-e4d256-prod-github-runner-207 kernel: [59208.566223] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 21:50:34 juju-e4d256-prod-github-runner-207 kernel: [59208.567410] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 21:50:34 juju-e4d256-prod-github-runner-207 kernel: [59208.568601] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 21:50:34 juju-e4d256-prod-github-runner-207 kernel: [59208.569773] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 21:50:34 juju-e4d256-prod-github-runner-207 kernel: [59208.571006] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 21:50:34 juju-e4d256-prod-github-runner-207 kernel: [59208.572117] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 21:50:34 juju-e4d256-prod-github-runner-207 kernel: [59208.573342] Call Trace: Aug 22 21:50:34 juju-e4d256-prod-github-runner-207 kernel: [59208.574265] Aug 22 21:50:34 juju-e4d256-prod-github-runner-207 kernel: [59208.575166] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:50:34 juju-e4d256-prod-github-runner-207 kernel: [59208.576217] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:50:34 juju-e4d256-prod-github-runner-207 kernel: [59208.577240] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:50:34 juju-e4d256-prod-github-runner-207 kernel: [59208.578343] ? show_regs.part.0+0x23/0x29 Aug 22 21:50:34 juju-e4d256-prod-github-runner-207 kernel: [59208.579351] ? show_regs.cold+0x8/0xd Aug 22 21:50:34 juju-e4d256-prod-github-runner-207 kernel: [59208.580340] ? watchdog_timer_fn+0x1be/0x220 Aug 22 21:50:34 juju-e4d256-prod-github-runner-207 kernel: [59208.581347] ? lockup_detector_update_enable+0x60/0x60 Aug 22 21:50:34 juju-e4d256-prod-github-runner-207 kernel: [59208.582419] ? __hrtimer_run_queues+0x107/0x230 Aug 22 21:50:34 juju-e4d256-prod-github-runner-207 kernel: [59208.583461] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 21:50:34 juju-e4d256-prod-github-runner-207 kernel: [59208.584519] ? hrtimer_interrupt+0x101/0x220 Aug 22 21:50:34 juju-e4d256-prod-github-runner-207 kernel: [59208.585539] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 21:50:34 juju-e4d256-prod-github-runner-207 kernel: [59208.586605] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 21:50:34 juju-e4d256-prod-github-runner-207 kernel: [59208.587669] Aug 22 21:50:34 juju-e4d256-prod-github-runner-207 kernel: [59208.588537] Aug 22 21:50:34 juju-e4d256-prod-github-runner-207 kernel: [59208.589388] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 21:50:34 juju-e4d256-prod-github-runner-207 kernel: [59208.590423] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:50:34 juju-e4d256-prod-github-runner-207 kernel: [59208.591460] ? _raw_spin_lock+0x22/0x30 Aug 22 21:50:34 juju-e4d256-prod-github-runner-207 kernel: [59208.592427] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:50:34 juju-e4d256-prod-github-runner-207 kernel: [59208.593459] direct_page_fault+0x206/0x310 [kvm] Aug 22 21:50:34 juju-e4d256-prod-github-runner-207 kernel: [59208.594500] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 21:50:34 juju-e4d256-prod-github-runner-207 kernel: [59208.595512] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 21:50:34 juju-e4d256-prod-github-runner-207 kernel: [59208.596526] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 21:50:34 juju-e4d256-prod-github-runner-207 kernel: [59208.597527] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 21:50:34 juju-e4d256-prod-github-runner-207 kernel: [59208.598483] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 21:50:34 juju-e4d256-prod-github-runner-207 kernel: [59208.599474] handle_exit+0x98/0x230 [kvm_amd] Aug 22 21:50:34 juju-e4d256-prod-github-runner-207 kernel: [59208.600406] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 21:50:34 juju-e4d256-prod-github-runner-207 kernel: [59208.601325] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 21:50:34 juju-e4d256-prod-github-runner-207 kernel: [59208.602252] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 21:50:34 juju-e4d256-prod-github-runner-207 kernel: [59208.603224] vcpu_run+0x62/0x2c0 [kvm] Aug 22 21:50:34 juju-e4d256-prod-github-runner-207 kernel: [59208.604054] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 21:50:34 juju-e4d256-prod-github-runner-207 kernel: [59208.604877] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 21:50:34 juju-e4d256-prod-github-runner-207 kernel: [59208.605731] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 21:50:34 juju-e4d256-prod-github-runner-207 kernel: [59208.606526] ? __seccomp_filter+0x4a/0x4a0 Aug 22 21:50:34 juju-e4d256-prod-github-runner-207 kernel: [59208.607267] ? __fget_files+0x86/0xc0 Aug 22 21:50:34 juju-e4d256-prod-github-runner-207 kernel: [59208.607986] __x64_sys_ioctl+0x95/0xd0 Aug 22 21:50:34 juju-e4d256-prod-github-runner-207 kernel: [59208.608690] do_syscall_64+0x5c/0xc0 Aug 22 21:50:34 juju-e4d256-prod-github-runner-207 kernel: [59208.609360] ? do_futex+0x162/0x1f0 Aug 22 21:50:34 juju-e4d256-prod-github-runner-207 kernel: [59208.610029] ? __x64_sys_futex+0x78/0x1e0 Aug 22 21:50:34 juju-e4d256-prod-github-runner-207 kernel: [59208.610708] ? __secure_computing+0xa9/0x120 Aug 22 21:50:34 juju-e4d256-prod-github-runner-207 kernel: [59208.611396] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 21:50:34 juju-e4d256-prod-github-runner-207 kernel: [59208.612187] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:50:34 juju-e4d256-prod-github-runner-207 kernel: [59208.612915] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:50:34 juju-e4d256-prod-github-runner-207 kernel: [59208.613647] ? do_syscall_64+0x69/0xc0 Aug 22 21:50:34 juju-e4d256-prod-github-runner-207 kernel: [59208.614297] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:50:34 juju-e4d256-prod-github-runner-207 kernel: [59208.615011] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:50:34 juju-e4d256-prod-github-runner-207 kernel: [59208.615718] ? do_syscall_64+0x69/0xc0 Aug 22 21:50:34 juju-e4d256-prod-github-runner-207 kernel: [59208.616345] ? do_syscall_64+0x69/0xc0 Aug 22 21:50:34 juju-e4d256-prod-github-runner-207 kernel: [59208.616967] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 21:50:34 juju-e4d256-prod-github-runner-207 kernel: [59208.617672] RIP: 0033:0x7faa5d0edaff Aug 22 21:50:34 juju-e4d256-prod-github-runner-207 kernel: [59208.618320] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 21:50:34 juju-e4d256-prod-github-runner-207 kernel: [59208.620337] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 21:50:34 juju-e4d256-prod-github-runner-207 kernel: [59208.621252] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 21:50:34 juju-e4d256-prod-github-runner-207 kernel: [59208.622145] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 21:50:34 juju-e4d256-prod-github-runner-207 kernel: [59208.623034] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 21:50:34 juju-e4d256-prod-github-runner-207 kernel: [59208.624001] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 21:50:34 juju-e4d256-prod-github-runner-207 kernel: [59208.624913] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 21:50:34 juju-e4d256-prod-github-runner-207 kernel: [59208.625810] Aug 22 21:50:47 juju-e4d256-prod-github-runner-207 kernel: [59221.136708] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 21:50:47 juju-e4d256-prod-github-runner-207 kernel: [59221.137679] rcu: 1-....: (14729470 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=7117657 Aug 22 21:50:47 juju-e4d256-prod-github-runner-207 kernel: [59221.138821] (t=14775984 jiffies g=23269 q=53437) Aug 22 21:50:47 juju-e4d256-prod-github-runner-207 kernel: [59221.139657] NMI backtrace for cpu 1 Aug 22 21:50:47 juju-e4d256-prod-github-runner-207 kernel: [59221.140366] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 21:50:47 juju-e4d256-prod-github-runner-207 kernel: [59221.141476] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 21:50:47 juju-e4d256-prod-github-runner-207 kernel: [59221.142533] Call Trace: Aug 22 21:50:47 juju-e4d256-prod-github-runner-207 kernel: [59221.143207] Aug 22 21:50:47 juju-e4d256-prod-github-runner-207 kernel: [59221.143869] show_stack+0x52/0x5c Aug 22 21:50:47 juju-e4d256-prod-github-runner-207 kernel: [59221.144592] dump_stack_lvl+0x4a/0x63 Aug 22 21:50:47 juju-e4d256-prod-github-runner-207 kernel: [59221.145358] dump_stack+0x10/0x16 Aug 22 21:50:47 juju-e4d256-prod-github-runner-207 kernel: [59221.146085] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 21:50:47 juju-e4d256-prod-github-runner-207 kernel: [59221.146879] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 21:50:47 juju-e4d256-prod-github-runner-207 kernel: [59221.147713] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 21:50:47 juju-e4d256-prod-github-runner-207 kernel: [59221.148533] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 21:50:47 juju-e4d256-prod-github-runner-207 kernel: [59221.149350] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 21:50:47 juju-e4d256-prod-github-runner-207 kernel: [59221.150155] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 21:50:47 juju-e4d256-prod-github-runner-207 kernel: [59221.151034] print_cpu_stall.cold+0x2f/0xe2 Aug 22 21:50:47 juju-e4d256-prod-github-runner-207 kernel: [59221.151944] ? timekeeping_update+0xf7/0x150 Aug 22 21:50:47 juju-e4d256-prod-github-runner-207 kernel: [59221.152796] check_cpu_stall+0x109/0x270 Aug 22 21:50:47 juju-e4d256-prod-github-runner-207 kernel: [59221.153617] rcu_sched_clock_irq+0x9a/0x250 Aug 22 21:50:47 juju-e4d256-prod-github-runner-207 kernel: [59221.154466] update_process_times+0x94/0xd0 Aug 22 21:50:47 juju-e4d256-prod-github-runner-207 kernel: [59221.155310] tick_sched_handle+0x29/0x70 Aug 22 21:50:47 juju-e4d256-prod-github-runner-207 kernel: [59221.156142] tick_sched_timer+0x8c/0xc0 Aug 22 21:50:47 juju-e4d256-prod-github-runner-207 kernel: [59221.156991] ? tick_nohz_handler+0xb0/0xb0 Aug 22 21:50:47 juju-e4d256-prod-github-runner-207 kernel: [59221.157825] __hrtimer_run_queues+0x107/0x230 Aug 22 21:50:47 juju-e4d256-prod-github-runner-207 kernel: [59221.158682] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 21:50:47 juju-e4d256-prod-github-runner-207 kernel: [59221.159555] hrtimer_interrupt+0x101/0x220 Aug 22 21:50:47 juju-e4d256-prod-github-runner-207 kernel: [59221.160406] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 21:50:47 juju-e4d256-prod-github-runner-207 kernel: [59221.161324] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 21:50:47 juju-e4d256-prod-github-runner-207 kernel: [59221.162228] Aug 22 21:50:47 juju-e4d256-prod-github-runner-207 kernel: [59221.162913] Aug 22 21:50:47 juju-e4d256-prod-github-runner-207 kernel: [59221.163613] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 21:50:47 juju-e4d256-prod-github-runner-207 kernel: [59221.164550] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:50:47 juju-e4d256-prod-github-runner-207 kernel: [59221.165563] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 21:50:47 juju-e4d256-prod-github-runner-207 kernel: [59221.168139] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 21:50:47 juju-e4d256-prod-github-runner-207 kernel: [59221.169339] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 21:50:47 juju-e4d256-prod-github-runner-207 kernel: [59221.170613] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 21:50:47 juju-e4d256-prod-github-runner-207 kernel: [59221.171733] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 21:50:47 juju-e4d256-prod-github-runner-207 kernel: [59221.172830] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 21:50:47 juju-e4d256-prod-github-runner-207 kernel: [59221.173919] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 21:50:47 juju-e4d256-prod-github-runner-207 kernel: [59221.175005] ? _raw_spin_lock+0x22/0x30 Aug 22 21:50:47 juju-e4d256-prod-github-runner-207 kernel: [59221.175856] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:50:47 juju-e4d256-prod-github-runner-207 kernel: [59221.176783] direct_page_fault+0x206/0x310 [kvm] Aug 22 21:50:47 juju-e4d256-prod-github-runner-207 kernel: [59221.177713] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 21:50:47 juju-e4d256-prod-github-runner-207 kernel: [59221.178626] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 21:50:47 juju-e4d256-prod-github-runner-207 kernel: [59221.179584] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 21:50:47 juju-e4d256-prod-github-runner-207 kernel: [59221.180491] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 21:50:47 juju-e4d256-prod-github-runner-207 kernel: [59221.181392] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 21:50:47 juju-e4d256-prod-github-runner-207 kernel: [59221.182360] handle_exit+0x98/0x230 [kvm_amd] Aug 22 21:50:47 juju-e4d256-prod-github-runner-207 kernel: [59221.183215] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 21:50:47 juju-e4d256-prod-github-runner-207 kernel: [59221.184132] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 21:50:47 juju-e4d256-prod-github-runner-207 kernel: [59221.185040] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 21:50:47 juju-e4d256-prod-github-runner-207 kernel: [59221.185924] vcpu_run+0x62/0x2c0 [kvm] Aug 22 21:50:47 juju-e4d256-prod-github-runner-207 kernel: [59221.186741] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 21:50:47 juju-e4d256-prod-github-runner-207 kernel: [59221.187611] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 21:50:47 juju-e4d256-prod-github-runner-207 kernel: [59221.190872] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 21:50:47 juju-e4d256-prod-github-runner-207 kernel: [59221.191764] ? __seccomp_filter+0x4a/0x4a0 Aug 22 21:50:47 juju-e4d256-prod-github-runner-207 kernel: [59221.192561] ? __fget_files+0x86/0xc0 Aug 22 21:50:47 juju-e4d256-prod-github-runner-207 kernel: [59221.193329] __x64_sys_ioctl+0x95/0xd0 Aug 22 21:50:47 juju-e4d256-prod-github-runner-207 kernel: [59221.194100] do_syscall_64+0x5c/0xc0 Aug 22 21:50:47 juju-e4d256-prod-github-runner-207 kernel: [59221.194855] ? do_futex+0x162/0x1f0 Aug 22 21:50:47 juju-e4d256-prod-github-runner-207 kernel: [59221.197844] ? __x64_sys_futex+0x78/0x1e0 Aug 22 21:50:47 juju-e4d256-prod-github-runner-207 kernel: [59221.198632] ? __secure_computing+0xa9/0x120 Aug 22 21:50:47 juju-e4d256-prod-github-runner-207 kernel: [59221.199444] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 21:50:47 juju-e4d256-prod-github-runner-207 kernel: [59221.200346] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:50:47 juju-e4d256-prod-github-runner-207 kernel: [59221.201281] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:50:47 juju-e4d256-prod-github-runner-207 kernel: [59221.202130] ? do_syscall_64+0x69/0xc0 Aug 22 21:50:47 juju-e4d256-prod-github-runner-207 kernel: [59221.202898] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:50:47 juju-e4d256-prod-github-runner-207 kernel: [59221.203768] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:50:47 juju-e4d256-prod-github-runner-207 kernel: [59221.204617] ? do_syscall_64+0x69/0xc0 Aug 22 21:50:47 juju-e4d256-prod-github-runner-207 kernel: [59221.205386] ? do_syscall_64+0x69/0xc0 Aug 22 21:50:47 juju-e4d256-prod-github-runner-207 kernel: [59221.206157] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 21:50:47 juju-e4d256-prod-github-runner-207 kernel: [59221.207028] RIP: 0033:0x7faa5d0edaff Aug 22 21:50:47 juju-e4d256-prod-github-runner-207 kernel: [59221.207825] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 21:50:47 juju-e4d256-prod-github-runner-207 kernel: [59221.210255] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 21:50:47 juju-e4d256-prod-github-runner-207 kernel: [59221.211356] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 21:50:47 juju-e4d256-prod-github-runner-207 kernel: [59221.212439] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 21:50:47 juju-e4d256-prod-github-runner-207 kernel: [59221.213523] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 21:50:47 juju-e4d256-prod-github-runner-207 kernel: [59221.214606] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 21:50:47 juju-e4d256-prod-github-runner-207 kernel: [59221.215676] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 21:50:47 juju-e4d256-prod-github-runner-207 kernel: [59221.216723] Aug 22 21:51:14 juju-e4d256-prod-github-runner-207 kernel: [59248.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 55071s! [qemu-system-x86:6715] Aug 22 21:51:14 juju-e4d256-prod-github-runner-207 kernel: [59248.543121] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 21:51:14 juju-e4d256-prod-github-runner-207 kernel: [59248.543194] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 21:51:14 juju-e4d256-prod-github-runner-207 kernel: [59248.555314] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 21:51:14 juju-e4d256-prod-github-runner-207 kernel: [59248.556578] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 21:51:14 juju-e4d256-prod-github-runner-207 kernel: [59248.557796] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:51:14 juju-e4d256-prod-github-runner-207 kernel: [59248.558862] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 21:51:14 juju-e4d256-prod-github-runner-207 kernel: [59248.561495] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 21:51:14 juju-e4d256-prod-github-runner-207 kernel: [59248.562555] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 21:51:14 juju-e4d256-prod-github-runner-207 kernel: [59248.563743] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 21:51:14 juju-e4d256-prod-github-runner-207 kernel: [59248.564911] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 21:51:14 juju-e4d256-prod-github-runner-207 kernel: [59248.566070] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 21:51:14 juju-e4d256-prod-github-runner-207 kernel: [59248.567285] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 21:51:14 juju-e4d256-prod-github-runner-207 kernel: [59248.568459] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 21:51:14 juju-e4d256-prod-github-runner-207 kernel: [59248.569699] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 21:51:14 juju-e4d256-prod-github-runner-207 kernel: [59248.570803] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 21:51:14 juju-e4d256-prod-github-runner-207 kernel: [59248.572015] Call Trace: Aug 22 21:51:14 juju-e4d256-prod-github-runner-207 kernel: [59248.572967] Aug 22 21:51:14 juju-e4d256-prod-github-runner-207 kernel: [59248.573874] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:51:14 juju-e4d256-prod-github-runner-207 kernel: [59248.574909] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:51:14 juju-e4d256-prod-github-runner-207 kernel: [59248.575947] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:51:14 juju-e4d256-prod-github-runner-207 kernel: [59248.577021] ? show_regs.part.0+0x23/0x29 Aug 22 21:51:14 juju-e4d256-prod-github-runner-207 kernel: [59248.578015] ? show_regs.cold+0x8/0xd Aug 22 21:51:14 juju-e4d256-prod-github-runner-207 kernel: [59248.579012] ? watchdog_timer_fn+0x1be/0x220 Aug 22 21:51:14 juju-e4d256-prod-github-runner-207 kernel: [59248.580249] ? lockup_detector_update_enable+0x60/0x60 Aug 22 21:51:14 juju-e4d256-prod-github-runner-207 kernel: [59248.581320] ? __hrtimer_run_queues+0x107/0x230 Aug 22 21:51:14 juju-e4d256-prod-github-runner-207 kernel: [59248.582360] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 21:51:14 juju-e4d256-prod-github-runner-207 kernel: [59248.583409] ? hrtimer_interrupt+0x101/0x220 Aug 22 21:51:14 juju-e4d256-prod-github-runner-207 kernel: [59248.584431] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 21:51:14 juju-e4d256-prod-github-runner-207 kernel: [59248.585501] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 21:51:14 juju-e4d256-prod-github-runner-207 kernel: [59248.586547] Aug 22 21:51:14 juju-e4d256-prod-github-runner-207 kernel: [59248.587423] Aug 22 21:51:14 juju-e4d256-prod-github-runner-207 kernel: [59248.588261] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 21:51:14 juju-e4d256-prod-github-runner-207 kernel: [59248.589294] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:51:14 juju-e4d256-prod-github-runner-207 kernel: [59248.590336] ? _raw_spin_lock+0x22/0x30 Aug 22 21:51:14 juju-e4d256-prod-github-runner-207 kernel: [59248.591296] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:51:14 juju-e4d256-prod-github-runner-207 kernel: [59248.592327] direct_page_fault+0x206/0x310 [kvm] Aug 22 21:51:14 juju-e4d256-prod-github-runner-207 kernel: [59248.593357] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 21:51:14 juju-e4d256-prod-github-runner-207 kernel: [59248.594366] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 21:51:14 juju-e4d256-prod-github-runner-207 kernel: [59248.595382] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 21:51:14 juju-e4d256-prod-github-runner-207 kernel: [59248.596352] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 21:51:14 juju-e4d256-prod-github-runner-207 kernel: [59248.597295] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 21:51:14 juju-e4d256-prod-github-runner-207 kernel: [59248.598273] handle_exit+0x98/0x230 [kvm_amd] Aug 22 21:51:14 juju-e4d256-prod-github-runner-207 kernel: [59248.599184] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 21:51:14 juju-e4d256-prod-github-runner-207 kernel: [59248.600103] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 21:51:14 juju-e4d256-prod-github-runner-207 kernel: [59248.601028] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 21:51:14 juju-e4d256-prod-github-runner-207 kernel: [59248.601931] vcpu_run+0x62/0x2c0 [kvm] Aug 22 21:51:14 juju-e4d256-prod-github-runner-207 kernel: [59248.602742] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 21:51:14 juju-e4d256-prod-github-runner-207 kernel: [59248.603568] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 21:51:14 juju-e4d256-prod-github-runner-207 kernel: [59248.604427] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 21:51:14 juju-e4d256-prod-github-runner-207 kernel: [59248.605240] ? __seccomp_filter+0x4a/0x4a0 Aug 22 21:51:14 juju-e4d256-prod-github-runner-207 kernel: [59248.605988] ? __fget_files+0x86/0xc0 Aug 22 21:51:14 juju-e4d256-prod-github-runner-207 kernel: [59248.606692] __x64_sys_ioctl+0x95/0xd0 Aug 22 21:51:14 juju-e4d256-prod-github-runner-207 kernel: [59248.607425] do_syscall_64+0x5c/0xc0 Aug 22 21:51:14 juju-e4d256-prod-github-runner-207 kernel: [59248.608100] ? do_futex+0x162/0x1f0 Aug 22 21:51:14 juju-e4d256-prod-github-runner-207 kernel: [59248.608753] ? __x64_sys_futex+0x78/0x1e0 Aug 22 21:51:14 juju-e4d256-prod-github-runner-207 kernel: [59248.609473] ? __secure_computing+0xa9/0x120 Aug 22 21:51:14 juju-e4d256-prod-github-runner-207 kernel: [59248.610221] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 21:51:14 juju-e4d256-prod-github-runner-207 kernel: [59248.611017] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:51:14 juju-e4d256-prod-github-runner-207 kernel: [59248.611818] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:51:14 juju-e4d256-prod-github-runner-207 kernel: [59248.612553] ? do_syscall_64+0x69/0xc0 Aug 22 21:51:14 juju-e4d256-prod-github-runner-207 kernel: [59248.613229] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:51:14 juju-e4d256-prod-github-runner-207 kernel: [59248.613944] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:51:14 juju-e4d256-prod-github-runner-207 kernel: [59248.614641] ? do_syscall_64+0x69/0xc0 Aug 22 21:51:14 juju-e4d256-prod-github-runner-207 kernel: [59248.615329] ? do_syscall_64+0x69/0xc0 Aug 22 21:51:14 juju-e4d256-prod-github-runner-207 kernel: [59248.615963] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 21:51:14 juju-e4d256-prod-github-runner-207 kernel: [59248.616800] RIP: 0033:0x7faa5d0edaff Aug 22 21:51:14 juju-e4d256-prod-github-runner-207 kernel: [59248.617513] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 21:51:14 juju-e4d256-prod-github-runner-207 kernel: [59248.619853] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 21:51:14 juju-e4d256-prod-github-runner-207 kernel: [59248.620912] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 21:51:14 juju-e4d256-prod-github-runner-207 kernel: [59248.621936] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 21:51:14 juju-e4d256-prod-github-runner-207 kernel: [59248.622957] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 21:51:14 juju-e4d256-prod-github-runner-207 kernel: [59248.623999] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 21:51:14 juju-e4d256-prod-github-runner-207 kernel: [59248.625032] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 21:51:14 juju-e4d256-prod-github-runner-207 kernel: [59248.626099] Aug 22 21:51:42 juju-e4d256-prod-github-runner-207 kernel: [59276.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 55097s! [qemu-system-x86:6715] Aug 22 21:51:42 juju-e4d256-prod-github-runner-207 kernel: [59276.543103] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 21:51:42 juju-e4d256-prod-github-runner-207 kernel: [59276.543177] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 21:51:42 juju-e4d256-prod-github-runner-207 kernel: [59276.555314] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 21:51:42 juju-e4d256-prod-github-runner-207 kernel: [59276.556577] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 21:51:42 juju-e4d256-prod-github-runner-207 kernel: [59276.557796] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:51:42 juju-e4d256-prod-github-runner-207 kernel: [59276.558867] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 21:51:42 juju-e4d256-prod-github-runner-207 kernel: [59276.561413] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 21:51:42 juju-e4d256-prod-github-runner-207 kernel: [59276.562453] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 21:51:42 juju-e4d256-prod-github-runner-207 kernel: [59276.563620] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 21:51:42 juju-e4d256-prod-github-runner-207 kernel: [59276.564776] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 21:51:42 juju-e4d256-prod-github-runner-207 kernel: [59276.565937] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 21:51:42 juju-e4d256-prod-github-runner-207 kernel: [59276.567111] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 21:51:42 juju-e4d256-prod-github-runner-207 kernel: [59276.568279] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 21:51:42 juju-e4d256-prod-github-runner-207 kernel: [59276.569507] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 21:51:42 juju-e4d256-prod-github-runner-207 kernel: [59276.570602] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 21:51:42 juju-e4d256-prod-github-runner-207 kernel: [59276.571800] Call Trace: Aug 22 21:51:42 juju-e4d256-prod-github-runner-207 kernel: [59276.572709] Aug 22 21:51:42 juju-e4d256-prod-github-runner-207 kernel: [59276.573590] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:51:42 juju-e4d256-prod-github-runner-207 kernel: [59276.574616] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:51:42 juju-e4d256-prod-github-runner-207 kernel: [59276.575674] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:51:42 juju-e4d256-prod-github-runner-207 kernel: [59276.576749] ? show_regs.part.0+0x23/0x29 Aug 22 21:51:42 juju-e4d256-prod-github-runner-207 kernel: [59276.577763] ? show_regs.cold+0x8/0xd Aug 22 21:51:42 juju-e4d256-prod-github-runner-207 kernel: [59276.578760] ? watchdog_timer_fn+0x1be/0x220 Aug 22 21:51:42 juju-e4d256-prod-github-runner-207 kernel: [59276.579766] ? lockup_detector_update_enable+0x60/0x60 Aug 22 21:51:42 juju-e4d256-prod-github-runner-207 kernel: [59276.580825] ? __hrtimer_run_queues+0x107/0x230 Aug 22 21:51:42 juju-e4d256-prod-github-runner-207 kernel: [59276.581855] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 21:51:42 juju-e4d256-prod-github-runner-207 kernel: [59276.582883] ? hrtimer_interrupt+0x101/0x220 Aug 22 21:51:42 juju-e4d256-prod-github-runner-207 kernel: [59276.583905] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 21:51:42 juju-e4d256-prod-github-runner-207 kernel: [59276.584975] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 21:51:42 juju-e4d256-prod-github-runner-207 kernel: [59276.586029] Aug 22 21:51:42 juju-e4d256-prod-github-runner-207 kernel: [59276.586910] Aug 22 21:51:42 juju-e4d256-prod-github-runner-207 kernel: [59276.587786] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 21:51:42 juju-e4d256-prod-github-runner-207 kernel: [59276.588822] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:51:42 juju-e4d256-prod-github-runner-207 kernel: [59276.589862] ? _raw_spin_lock+0x22/0x30 Aug 22 21:51:42 juju-e4d256-prod-github-runner-207 kernel: [59276.590970] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:51:42 juju-e4d256-prod-github-runner-207 kernel: [59276.591995] direct_page_fault+0x206/0x310 [kvm] Aug 22 21:51:42 juju-e4d256-prod-github-runner-207 kernel: [59276.593018] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 21:51:42 juju-e4d256-prod-github-runner-207 kernel: [59276.594035] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 21:51:42 juju-e4d256-prod-github-runner-207 kernel: [59276.595051] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 21:51:42 juju-e4d256-prod-github-runner-207 kernel: [59276.596034] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 21:51:42 juju-e4d256-prod-github-runner-207 kernel: [59276.597038] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 21:51:42 juju-e4d256-prod-github-runner-207 kernel: [59276.598015] handle_exit+0x98/0x230 [kvm_amd] Aug 22 21:51:42 juju-e4d256-prod-github-runner-207 kernel: [59276.598917] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 21:51:42 juju-e4d256-prod-github-runner-207 kernel: [59276.599830] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 21:51:42 juju-e4d256-prod-github-runner-207 kernel: [59276.600753] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 21:51:42 juju-e4d256-prod-github-runner-207 kernel: [59276.601670] vcpu_run+0x62/0x2c0 [kvm] Aug 22 21:51:42 juju-e4d256-prod-github-runner-207 kernel: [59276.602479] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 21:51:42 juju-e4d256-prod-github-runner-207 kernel: [59276.603300] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 21:51:42 juju-e4d256-prod-github-runner-207 kernel: [59276.604156] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 21:51:42 juju-e4d256-prod-github-runner-207 kernel: [59276.604971] ? __seccomp_filter+0x4a/0x4a0 Aug 22 21:51:42 juju-e4d256-prod-github-runner-207 kernel: [59276.605717] ? __fget_files+0x86/0xc0 Aug 22 21:51:42 juju-e4d256-prod-github-runner-207 kernel: [59276.606429] __x64_sys_ioctl+0x95/0xd0 Aug 22 21:51:42 juju-e4d256-prod-github-runner-207 kernel: [59276.607133] do_syscall_64+0x5c/0xc0 Aug 22 21:51:42 juju-e4d256-prod-github-runner-207 kernel: [59276.607798] ? do_futex+0x162/0x1f0 Aug 22 21:51:42 juju-e4d256-prod-github-runner-207 kernel: [59276.608481] ? __x64_sys_futex+0x78/0x1e0 Aug 22 21:51:42 juju-e4d256-prod-github-runner-207 kernel: [59276.609159] ? __secure_computing+0xa9/0x120 Aug 22 21:51:42 juju-e4d256-prod-github-runner-207 kernel: [59276.609853] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 21:51:42 juju-e4d256-prod-github-runner-207 kernel: [59276.610619] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:51:42 juju-e4d256-prod-github-runner-207 kernel: [59276.611354] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:51:42 juju-e4d256-prod-github-runner-207 kernel: [59276.612075] ? do_syscall_64+0x69/0xc0 Aug 22 21:51:42 juju-e4d256-prod-github-runner-207 kernel: [59276.612756] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:51:42 juju-e4d256-prod-github-runner-207 kernel: [59276.613461] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:51:42 juju-e4d256-prod-github-runner-207 kernel: [59276.614156] ? do_syscall_64+0x69/0xc0 Aug 22 21:51:42 juju-e4d256-prod-github-runner-207 kernel: [59276.614804] ? do_syscall_64+0x69/0xc0 Aug 22 21:51:42 juju-e4d256-prod-github-runner-207 kernel: [59276.615433] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 21:51:42 juju-e4d256-prod-github-runner-207 kernel: [59276.616160] RIP: 0033:0x7faa5d0edaff Aug 22 21:51:42 juju-e4d256-prod-github-runner-207 kernel: [59276.616785] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 21:51:42 juju-e4d256-prod-github-runner-207 kernel: [59276.618789] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 21:51:42 juju-e4d256-prod-github-runner-207 kernel: [59276.619695] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 21:51:42 juju-e4d256-prod-github-runner-207 kernel: [59276.620581] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 21:51:42 juju-e4d256-prod-github-runner-207 kernel: [59276.621484] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 21:51:42 juju-e4d256-prod-github-runner-207 kernel: [59276.622750] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 21:51:42 juju-e4d256-prod-github-runner-207 kernel: [59276.623679] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 21:51:42 juju-e4d256-prod-github-runner-207 kernel: [59276.624669] Aug 22 21:52:10 juju-e4d256-prod-github-runner-207 kernel: [59304.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 55123s! [qemu-system-x86:6715] Aug 22 21:52:10 juju-e4d256-prod-github-runner-207 kernel: [59304.543915] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 21:52:10 juju-e4d256-prod-github-runner-207 kernel: [59304.544230] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 21:52:10 juju-e4d256-prod-github-runner-207 kernel: [59304.556396] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 21:52:10 juju-e4d256-prod-github-runner-207 kernel: [59304.557665] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 21:52:10 juju-e4d256-prod-github-runner-207 kernel: [59304.558913] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:52:10 juju-e4d256-prod-github-runner-207 kernel: [59304.559971] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 21:52:10 juju-e4d256-prod-github-runner-207 kernel: [59304.562526] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 21:52:10 juju-e4d256-prod-github-runner-207 kernel: [59304.563568] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 21:52:10 juju-e4d256-prod-github-runner-207 kernel: [59304.564739] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 21:52:10 juju-e4d256-prod-github-runner-207 kernel: [59304.565912] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 21:52:10 juju-e4d256-prod-github-runner-207 kernel: [59304.567093] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 21:52:10 juju-e4d256-prod-github-runner-207 kernel: [59304.568255] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 21:52:10 juju-e4d256-prod-github-runner-207 kernel: [59304.569428] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 21:52:10 juju-e4d256-prod-github-runner-207 kernel: [59304.571574] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 21:52:10 juju-e4d256-prod-github-runner-207 kernel: [59304.572705] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 21:52:10 juju-e4d256-prod-github-runner-207 kernel: [59304.573906] Call Trace: Aug 22 21:52:10 juju-e4d256-prod-github-runner-207 kernel: [59304.574857] Aug 22 21:52:10 juju-e4d256-prod-github-runner-207 kernel: [59304.575764] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:52:10 juju-e4d256-prod-github-runner-207 kernel: [59304.576798] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:52:10 juju-e4d256-prod-github-runner-207 kernel: [59304.577824] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:52:10 juju-e4d256-prod-github-runner-207 kernel: [59304.578945] ? show_regs.part.0+0x23/0x29 Aug 22 21:52:10 juju-e4d256-prod-github-runner-207 kernel: [59304.579945] ? show_regs.cold+0x8/0xd Aug 22 21:52:10 juju-e4d256-prod-github-runner-207 kernel: [59304.580917] ? watchdog_timer_fn+0x1be/0x220 Aug 22 21:52:10 juju-e4d256-prod-github-runner-207 kernel: [59304.581931] ? lockup_detector_update_enable+0x60/0x60 Aug 22 21:52:10 juju-e4d256-prod-github-runner-207 kernel: [59304.583012] ? __hrtimer_run_queues+0x107/0x230 Aug 22 21:52:10 juju-e4d256-prod-github-runner-207 kernel: [59304.584055] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 21:52:10 juju-e4d256-prod-github-runner-207 kernel: [59304.585093] ? hrtimer_interrupt+0x101/0x220 Aug 22 21:52:10 juju-e4d256-prod-github-runner-207 kernel: [59304.586122] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 21:52:10 juju-e4d256-prod-github-runner-207 kernel: [59304.587297] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 21:52:10 juju-e4d256-prod-github-runner-207 kernel: [59304.588425] Aug 22 21:52:10 juju-e4d256-prod-github-runner-207 kernel: [59304.589486] Aug 22 21:52:10 juju-e4d256-prod-github-runner-207 kernel: [59304.590345] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 21:52:10 juju-e4d256-prod-github-runner-207 kernel: [59304.591426] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:52:10 juju-e4d256-prod-github-runner-207 kernel: [59304.592468] ? _raw_spin_lock+0x22/0x30 Aug 22 21:52:10 juju-e4d256-prod-github-runner-207 kernel: [59304.593415] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:52:10 juju-e4d256-prod-github-runner-207 kernel: [59304.594466] direct_page_fault+0x206/0x310 [kvm] Aug 22 21:52:10 juju-e4d256-prod-github-runner-207 kernel: [59304.595512] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 21:52:10 juju-e4d256-prod-github-runner-207 kernel: [59304.596529] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 21:52:10 juju-e4d256-prod-github-runner-207 kernel: [59304.597538] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 21:52:10 juju-e4d256-prod-github-runner-207 kernel: [59304.598610] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 21:52:10 juju-e4d256-prod-github-runner-207 kernel: [59304.599561] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 21:52:10 juju-e4d256-prod-github-runner-207 kernel: [59304.600545] handle_exit+0x98/0x230 [kvm_amd] Aug 22 21:52:10 juju-e4d256-prod-github-runner-207 kernel: [59304.601442] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 21:52:10 juju-e4d256-prod-github-runner-207 kernel: [59304.602426] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 21:52:10 juju-e4d256-prod-github-runner-207 kernel: [59304.603374] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 21:52:10 juju-e4d256-prod-github-runner-207 kernel: [59304.604281] vcpu_run+0x62/0x2c0 [kvm] Aug 22 21:52:10 juju-e4d256-prod-github-runner-207 kernel: [59304.605099] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 21:52:10 juju-e4d256-prod-github-runner-207 kernel: [59304.605910] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 21:52:10 juju-e4d256-prod-github-runner-207 kernel: [59304.606779] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 21:52:10 juju-e4d256-prod-github-runner-207 kernel: [59304.607606] ? __seccomp_filter+0x4a/0x4a0 Aug 22 21:52:10 juju-e4d256-prod-github-runner-207 kernel: [59304.608378] ? __fget_files+0x86/0xc0 Aug 22 21:52:10 juju-e4d256-prod-github-runner-207 kernel: [59304.609087] __x64_sys_ioctl+0x95/0xd0 Aug 22 21:52:10 juju-e4d256-prod-github-runner-207 kernel: [59304.609783] do_syscall_64+0x5c/0xc0 Aug 22 21:52:10 juju-e4d256-prod-github-runner-207 kernel: [59304.610473] ? do_futex+0x162/0x1f0 Aug 22 21:52:10 juju-e4d256-prod-github-runner-207 kernel: [59304.611128] ? __x64_sys_futex+0x78/0x1e0 Aug 22 21:52:10 juju-e4d256-prod-github-runner-207 kernel: [59304.611805] ? __secure_computing+0xa9/0x120 Aug 22 21:52:10 juju-e4d256-prod-github-runner-207 kernel: [59304.612498] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 21:52:10 juju-e4d256-prod-github-runner-207 kernel: [59304.613277] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:52:10 juju-e4d256-prod-github-runner-207 kernel: [59304.614003] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:52:10 juju-e4d256-prod-github-runner-207 kernel: [59304.614745] ? do_syscall_64+0x69/0xc0 Aug 22 21:52:10 juju-e4d256-prod-github-runner-207 kernel: [59304.615401] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:52:10 juju-e4d256-prod-github-runner-207 kernel: [59304.616112] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:52:10 juju-e4d256-prod-github-runner-207 kernel: [59304.616814] ? do_syscall_64+0x69/0xc0 Aug 22 21:52:10 juju-e4d256-prod-github-runner-207 kernel: [59304.617445] ? do_syscall_64+0x69/0xc0 Aug 22 21:52:10 juju-e4d256-prod-github-runner-207 kernel: [59304.618074] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 21:52:10 juju-e4d256-prod-github-runner-207 kernel: [59304.618845] RIP: 0033:0x7faa5d0edaff Aug 22 21:52:10 juju-e4d256-prod-github-runner-207 kernel: [59304.619522] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 21:52:10 juju-e4d256-prod-github-runner-207 kernel: [59304.621606] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 21:52:10 juju-e4d256-prod-github-runner-207 kernel: [59304.622604] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 21:52:10 juju-e4d256-prod-github-runner-207 kernel: [59304.623503] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 21:52:10 juju-e4d256-prod-github-runner-207 kernel: [59304.624783] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 21:52:10 juju-e4d256-prod-github-runner-207 kernel: [59304.625677] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 21:52:10 juju-e4d256-prod-github-runner-207 kernel: [59304.626656] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 21:52:10 juju-e4d256-prod-github-runner-207 kernel: [59304.627572] Aug 22 21:52:38 juju-e4d256-prod-github-runner-207 kernel: [59332.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 55149s! [qemu-system-x86:6715] Aug 22 21:52:38 juju-e4d256-prod-github-runner-207 kernel: [59332.543096] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 21:52:38 juju-e4d256-prod-github-runner-207 kernel: [59332.543169] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 21:52:38 juju-e4d256-prod-github-runner-207 kernel: [59332.555255] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 21:52:38 juju-e4d256-prod-github-runner-207 kernel: [59332.556520] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 21:52:38 juju-e4d256-prod-github-runner-207 kernel: [59332.557740] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:52:38 juju-e4d256-prod-github-runner-207 kernel: [59332.558802] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 21:52:38 juju-e4d256-prod-github-runner-207 kernel: [59332.561340] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 21:52:38 juju-e4d256-prod-github-runner-207 kernel: [59332.562393] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 21:52:38 juju-e4d256-prod-github-runner-207 kernel: [59332.563577] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 21:52:38 juju-e4d256-prod-github-runner-207 kernel: [59332.564746] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 21:52:38 juju-e4d256-prod-github-runner-207 kernel: [59332.566094] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 21:52:38 juju-e4d256-prod-github-runner-207 kernel: [59332.567258] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 21:52:38 juju-e4d256-prod-github-runner-207 kernel: [59332.568424] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 21:52:38 juju-e4d256-prod-github-runner-207 kernel: [59332.569654] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 21:52:38 juju-e4d256-prod-github-runner-207 kernel: [59332.570755] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 21:52:38 juju-e4d256-prod-github-runner-207 kernel: [59332.571947] Call Trace: Aug 22 21:52:38 juju-e4d256-prod-github-runner-207 kernel: [59332.572857] Aug 22 21:52:38 juju-e4d256-prod-github-runner-207 kernel: [59332.573739] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:52:38 juju-e4d256-prod-github-runner-207 kernel: [59332.574775] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:52:38 juju-e4d256-prod-github-runner-207 kernel: [59332.575794] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:52:38 juju-e4d256-prod-github-runner-207 kernel: [59332.576867] ? show_regs.part.0+0x23/0x29 Aug 22 21:52:38 juju-e4d256-prod-github-runner-207 kernel: [59332.577862] ? show_regs.cold+0x8/0xd Aug 22 21:52:38 juju-e4d256-prod-github-runner-207 kernel: [59332.578841] ? watchdog_timer_fn+0x1be/0x220 Aug 22 21:52:38 juju-e4d256-prod-github-runner-207 kernel: [59332.579853] ? lockup_detector_update_enable+0x60/0x60 Aug 22 21:52:38 juju-e4d256-prod-github-runner-207 kernel: [59332.580914] ? __hrtimer_run_queues+0x107/0x230 Aug 22 21:52:38 juju-e4d256-prod-github-runner-207 kernel: [59332.581939] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 21:52:38 juju-e4d256-prod-github-runner-207 kernel: [59332.582975] ? hrtimer_interrupt+0x101/0x220 Aug 22 21:52:38 juju-e4d256-prod-github-runner-207 kernel: [59332.583990] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 21:52:38 juju-e4d256-prod-github-runner-207 kernel: [59332.585056] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 21:52:38 juju-e4d256-prod-github-runner-207 kernel: [59332.586111] Aug 22 21:52:38 juju-e4d256-prod-github-runner-207 kernel: [59332.586968] Aug 22 21:52:38 juju-e4d256-prod-github-runner-207 kernel: [59332.587804] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 21:52:38 juju-e4d256-prod-github-runner-207 kernel: [59332.588836] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:52:38 juju-e4d256-prod-github-runner-207 kernel: [59332.589871] ? _raw_spin_lock+0x22/0x30 Aug 22 21:52:38 juju-e4d256-prod-github-runner-207 kernel: [59332.590893] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:52:38 juju-e4d256-prod-github-runner-207 kernel: [59332.591922] direct_page_fault+0x206/0x310 [kvm] Aug 22 21:52:38 juju-e4d256-prod-github-runner-207 kernel: [59332.592946] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 21:52:38 juju-e4d256-prod-github-runner-207 kernel: [59332.593955] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 21:52:38 juju-e4d256-prod-github-runner-207 kernel: [59332.594964] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 21:52:38 juju-e4d256-prod-github-runner-207 kernel: [59332.595937] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 21:52:38 juju-e4d256-prod-github-runner-207 kernel: [59332.596915] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 21:52:38 juju-e4d256-prod-github-runner-207 kernel: [59332.597894] handle_exit+0x98/0x230 [kvm_amd] Aug 22 21:52:38 juju-e4d256-prod-github-runner-207 kernel: [59332.598795] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 21:52:38 juju-e4d256-prod-github-runner-207 kernel: [59332.599708] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 21:52:38 juju-e4d256-prod-github-runner-207 kernel: [59332.600645] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 21:52:38 juju-e4d256-prod-github-runner-207 kernel: [59332.601561] vcpu_run+0x62/0x2c0 [kvm] Aug 22 21:52:38 juju-e4d256-prod-github-runner-207 kernel: [59332.602396] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 21:52:38 juju-e4d256-prod-github-runner-207 kernel: [59332.603222] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 21:52:38 juju-e4d256-prod-github-runner-207 kernel: [59332.604083] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 21:52:38 juju-e4d256-prod-github-runner-207 kernel: [59332.604914] ? __seccomp_filter+0x4a/0x4a0 Aug 22 21:52:38 juju-e4d256-prod-github-runner-207 kernel: [59332.605658] ? __fget_files+0x86/0xc0 Aug 22 21:52:38 juju-e4d256-prod-github-runner-207 kernel: [59332.606387] __x64_sys_ioctl+0x95/0xd0 Aug 22 21:52:38 juju-e4d256-prod-github-runner-207 kernel: [59332.607087] do_syscall_64+0x5c/0xc0 Aug 22 21:52:38 juju-e4d256-prod-github-runner-207 kernel: [59332.607753] ? do_futex+0x162/0x1f0 Aug 22 21:52:38 juju-e4d256-prod-github-runner-207 kernel: [59332.608405] ? __x64_sys_futex+0x78/0x1e0 Aug 22 21:52:38 juju-e4d256-prod-github-runner-207 kernel: [59332.609106] ? __secure_computing+0xa9/0x120 Aug 22 21:52:38 juju-e4d256-prod-github-runner-207 kernel: [59332.609811] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 21:52:38 juju-e4d256-prod-github-runner-207 kernel: [59332.610589] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:52:38 juju-e4d256-prod-github-runner-207 kernel: [59332.611310] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:52:38 juju-e4d256-prod-github-runner-207 kernel: [59332.612029] ? do_syscall_64+0x69/0xc0 Aug 22 21:52:38 juju-e4d256-prod-github-runner-207 kernel: [59332.612674] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:52:38 juju-e4d256-prod-github-runner-207 kernel: [59332.613377] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:52:38 juju-e4d256-prod-github-runner-207 kernel: [59332.614081] ? do_syscall_64+0x69/0xc0 Aug 22 21:52:38 juju-e4d256-prod-github-runner-207 kernel: [59332.614707] ? do_syscall_64+0x69/0xc0 Aug 22 21:52:38 juju-e4d256-prod-github-runner-207 kernel: [59332.615330] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 21:52:38 juju-e4d256-prod-github-runner-207 kernel: [59332.616036] RIP: 0033:0x7faa5d0edaff Aug 22 21:52:38 juju-e4d256-prod-github-runner-207 kernel: [59332.616683] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 21:52:38 juju-e4d256-prod-github-runner-207 kernel: [59332.618688] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 21:52:38 juju-e4d256-prod-github-runner-207 kernel: [59332.619604] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 21:52:38 juju-e4d256-prod-github-runner-207 kernel: [59332.620492] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 21:52:38 juju-e4d256-prod-github-runner-207 kernel: [59332.621381] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 21:52:38 juju-e4d256-prod-github-runner-207 kernel: [59332.622295] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 21:52:38 juju-e4d256-prod-github-runner-207 kernel: [59332.623193] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 21:52:38 juju-e4d256-prod-github-runner-207 kernel: [59332.624086] Aug 22 21:53:06 juju-e4d256-prod-github-runner-207 kernel: [59360.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 55175s! [qemu-system-x86:6715] Aug 22 21:53:06 juju-e4d256-prod-github-runner-207 kernel: [59360.543103] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 21:53:06 juju-e4d256-prod-github-runner-207 kernel: [59360.543178] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 21:53:06 juju-e4d256-prod-github-runner-207 kernel: [59360.555325] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 21:53:06 juju-e4d256-prod-github-runner-207 kernel: [59360.556592] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 21:53:06 juju-e4d256-prod-github-runner-207 kernel: [59360.557823] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:53:06 juju-e4d256-prod-github-runner-207 kernel: [59360.558880] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 21:53:06 juju-e4d256-prod-github-runner-207 kernel: [59360.561427] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 21:53:06 juju-e4d256-prod-github-runner-207 kernel: [59360.562484] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 21:53:06 juju-e4d256-prod-github-runner-207 kernel: [59360.563645] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 21:53:06 juju-e4d256-prod-github-runner-207 kernel: [59360.564831] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 21:53:06 juju-e4d256-prod-github-runner-207 kernel: [59360.566018] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 21:53:06 juju-e4d256-prod-github-runner-207 kernel: [59360.567183] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 21:53:06 juju-e4d256-prod-github-runner-207 kernel: [59360.568349] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 21:53:06 juju-e4d256-prod-github-runner-207 kernel: [59360.569580] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 21:53:06 juju-e4d256-prod-github-runner-207 kernel: [59360.570714] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 21:53:06 juju-e4d256-prod-github-runner-207 kernel: [59360.571907] Call Trace: Aug 22 21:53:06 juju-e4d256-prod-github-runner-207 kernel: [59360.572818] Aug 22 21:53:06 juju-e4d256-prod-github-runner-207 kernel: [59360.573735] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:53:06 juju-e4d256-prod-github-runner-207 kernel: [59360.574774] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:53:06 juju-e4d256-prod-github-runner-207 kernel: [59360.575845] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:53:06 juju-e4d256-prod-github-runner-207 kernel: [59360.576935] ? show_regs.part.0+0x23/0x29 Aug 22 21:53:06 juju-e4d256-prod-github-runner-207 kernel: [59360.577950] ? show_regs.cold+0x8/0xd Aug 22 21:53:06 juju-e4d256-prod-github-runner-207 kernel: [59360.578922] ? watchdog_timer_fn+0x1be/0x220 Aug 22 21:53:06 juju-e4d256-prod-github-runner-207 kernel: [59360.579931] ? lockup_detector_update_enable+0x60/0x60 Aug 22 21:53:06 juju-e4d256-prod-github-runner-207 kernel: [59360.581024] ? __hrtimer_run_queues+0x107/0x230 Aug 22 21:53:06 juju-e4d256-prod-github-runner-207 kernel: [59360.582080] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 21:53:06 juju-e4d256-prod-github-runner-207 kernel: [59360.583111] ? hrtimer_interrupt+0x101/0x220 Aug 22 21:53:06 juju-e4d256-prod-github-runner-207 kernel: [59360.584154] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 21:53:06 juju-e4d256-prod-github-runner-207 kernel: [59360.585236] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 21:53:06 juju-e4d256-prod-github-runner-207 kernel: [59360.586310] Aug 22 21:53:06 juju-e4d256-prod-github-runner-207 kernel: [59360.587193] Aug 22 21:53:06 juju-e4d256-prod-github-runner-207 kernel: [59360.588043] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 21:53:06 juju-e4d256-prod-github-runner-207 kernel: [59360.589119] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:53:06 juju-e4d256-prod-github-runner-207 kernel: [59360.590218] ? _raw_spin_lock+0x22/0x30 Aug 22 21:53:06 juju-e4d256-prod-github-runner-207 kernel: [59360.591167] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:53:06 juju-e4d256-prod-github-runner-207 kernel: [59360.592189] direct_page_fault+0x206/0x310 [kvm] Aug 22 21:53:06 juju-e4d256-prod-github-runner-207 kernel: [59360.593213] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 21:53:06 juju-e4d256-prod-github-runner-207 kernel: [59360.594254] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 21:53:06 juju-e4d256-prod-github-runner-207 kernel: [59360.595279] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 21:53:06 juju-e4d256-prod-github-runner-207 kernel: [59360.596252] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 21:53:06 juju-e4d256-prod-github-runner-207 kernel: [59360.597199] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 21:53:06 juju-e4d256-prod-github-runner-207 kernel: [59360.598197] handle_exit+0x98/0x230 [kvm_amd] Aug 22 21:53:06 juju-e4d256-prod-github-runner-207 kernel: [59360.599095] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 21:53:06 juju-e4d256-prod-github-runner-207 kernel: [59360.600016] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 21:53:06 juju-e4d256-prod-github-runner-207 kernel: [59360.600943] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 21:53:06 juju-e4d256-prod-github-runner-207 kernel: [59360.601864] vcpu_run+0x62/0x2c0 [kvm] Aug 22 21:53:06 juju-e4d256-prod-github-runner-207 kernel: [59360.602739] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 21:53:06 juju-e4d256-prod-github-runner-207 kernel: [59360.603564] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 21:53:06 juju-e4d256-prod-github-runner-207 kernel: [59360.604420] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 21:53:06 juju-e4d256-prod-github-runner-207 kernel: [59360.605233] ? __seccomp_filter+0x4a/0x4a0 Aug 22 21:53:06 juju-e4d256-prod-github-runner-207 kernel: [59360.606055] ? __fget_files+0x86/0xc0 Aug 22 21:53:06 juju-e4d256-prod-github-runner-207 kernel: [59360.606776] __x64_sys_ioctl+0x95/0xd0 Aug 22 21:53:06 juju-e4d256-prod-github-runner-207 kernel: [59360.607500] do_syscall_64+0x5c/0xc0 Aug 22 21:53:06 juju-e4d256-prod-github-runner-207 kernel: [59360.608176] ? do_futex+0x162/0x1f0 Aug 22 21:53:06 juju-e4d256-prod-github-runner-207 kernel: [59360.608829] ? __x64_sys_futex+0x78/0x1e0 Aug 22 21:53:06 juju-e4d256-prod-github-runner-207 kernel: [59360.609506] ? __secure_computing+0xa9/0x120 Aug 22 21:53:06 juju-e4d256-prod-github-runner-207 kernel: [59360.610224] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 21:53:06 juju-e4d256-prod-github-runner-207 kernel: [59360.610993] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:53:06 juju-e4d256-prod-github-runner-207 kernel: [59360.611716] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:53:06 juju-e4d256-prod-github-runner-207 kernel: [59360.612432] ? do_syscall_64+0x69/0xc0 Aug 22 21:53:06 juju-e4d256-prod-github-runner-207 kernel: [59360.613082] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:53:06 juju-e4d256-prod-github-runner-207 kernel: [59360.613802] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:53:06 juju-e4d256-prod-github-runner-207 kernel: [59360.614503] ? do_syscall_64+0x69/0xc0 Aug 22 21:53:06 juju-e4d256-prod-github-runner-207 kernel: [59360.615132] ? do_syscall_64+0x69/0xc0 Aug 22 21:53:06 juju-e4d256-prod-github-runner-207 kernel: [59360.615763] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 21:53:06 juju-e4d256-prod-github-runner-207 kernel: [59360.616471] RIP: 0033:0x7faa5d0edaff Aug 22 21:53:06 juju-e4d256-prod-github-runner-207 kernel: [59360.617099] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 21:53:06 juju-e4d256-prod-github-runner-207 kernel: [59360.619130] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 21:53:06 juju-e4d256-prod-github-runner-207 kernel: [59360.620042] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 21:53:06 juju-e4d256-prod-github-runner-207 kernel: [59360.620953] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 21:53:06 juju-e4d256-prod-github-runner-207 kernel: [59360.621878] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 21:53:06 juju-e4d256-prod-github-runner-207 kernel: [59360.622816] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 21:53:06 juju-e4d256-prod-github-runner-207 kernel: [59360.623712] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 21:53:06 juju-e4d256-prod-github-runner-207 kernel: [59360.624606] Aug 22 21:53:34 juju-e4d256-prod-github-runner-207 kernel: [59388.541983] watchdog: BUG: soft lockup - CPU#1 stuck for 55201s! [qemu-system-x86:6715] Aug 22 21:53:34 juju-e4d256-prod-github-runner-207 kernel: [59388.544096] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 21:53:34 juju-e4d256-prod-github-runner-207 kernel: [59388.544406] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 21:53:34 juju-e4d256-prod-github-runner-207 kernel: [59388.558777] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 21:53:34 juju-e4d256-prod-github-runner-207 kernel: [59388.560243] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 21:53:34 juju-e4d256-prod-github-runner-207 kernel: [59388.561660] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:53:34 juju-e4d256-prod-github-runner-207 kernel: [59388.562843] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 21:53:34 juju-e4d256-prod-github-runner-207 kernel: [59388.565756] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 21:53:34 juju-e4d256-prod-github-runner-207 kernel: [59388.566914] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 21:53:34 juju-e4d256-prod-github-runner-207 kernel: [59388.568209] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 21:53:34 juju-e4d256-prod-github-runner-207 kernel: [59388.569516] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 21:53:34 juju-e4d256-prod-github-runner-207 kernel: [59388.570816] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 21:53:34 juju-e4d256-prod-github-runner-207 kernel: [59388.572108] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 21:53:34 juju-e4d256-prod-github-runner-207 kernel: [59388.573431] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 21:53:34 juju-e4d256-prod-github-runner-207 kernel: [59388.574819] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 21:53:34 juju-e4d256-prod-github-runner-207 kernel: [59388.576047] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 21:53:34 juju-e4d256-prod-github-runner-207 kernel: [59388.577406] Call Trace: Aug 22 21:53:34 juju-e4d256-prod-github-runner-207 kernel: [59388.578386] Aug 22 21:53:34 juju-e4d256-prod-github-runner-207 kernel: [59388.579333] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:53:34 juju-e4d256-prod-github-runner-207 kernel: [59388.580453] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:53:34 juju-e4d256-prod-github-runner-207 kernel: [59388.581655] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:53:34 juju-e4d256-prod-github-runner-207 kernel: [59388.582881] ? show_regs.part.0+0x23/0x29 Aug 22 21:53:34 juju-e4d256-prod-github-runner-207 kernel: [59388.583964] ? show_regs.cold+0x8/0xd Aug 22 21:53:34 juju-e4d256-prod-github-runner-207 kernel: [59388.585008] ? watchdog_timer_fn+0x1be/0x220 Aug 22 21:53:34 juju-e4d256-prod-github-runner-207 kernel: [59388.586221] ? lockup_detector_update_enable+0x60/0x60 Aug 22 21:53:34 juju-e4d256-prod-github-runner-207 kernel: [59388.587405] ? __hrtimer_run_queues+0x107/0x230 Aug 22 21:53:34 juju-e4d256-prod-github-runner-207 kernel: [59388.588527] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 21:53:34 juju-e4d256-prod-github-runner-207 kernel: [59388.589658] ? hrtimer_interrupt+0x101/0x220 Aug 22 21:53:34 juju-e4d256-prod-github-runner-207 kernel: [59388.590762] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 21:53:34 juju-e4d256-prod-github-runner-207 kernel: [59388.591937] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 21:53:34 juju-e4d256-prod-github-runner-207 kernel: [59388.593095] Aug 22 21:53:34 juju-e4d256-prod-github-runner-207 kernel: [59388.594023] Aug 22 21:53:34 juju-e4d256-prod-github-runner-207 kernel: [59388.594915] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 21:53:34 juju-e4d256-prod-github-runner-207 kernel: [59388.596055] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:53:34 juju-e4d256-prod-github-runner-207 kernel: [59388.597206] ? _raw_spin_lock+0x22/0x30 Aug 22 21:53:34 juju-e4d256-prod-github-runner-207 kernel: [59388.598255] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:53:34 juju-e4d256-prod-github-runner-207 kernel: [59388.599371] direct_page_fault+0x206/0x310 [kvm] Aug 22 21:53:34 juju-e4d256-prod-github-runner-207 kernel: [59388.600497] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 21:53:34 juju-e4d256-prod-github-runner-207 kernel: [59388.601625] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 21:53:34 juju-e4d256-prod-github-runner-207 kernel: [59388.602736] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 21:53:34 juju-e4d256-prod-github-runner-207 kernel: [59388.603853] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 21:53:34 juju-e4d256-prod-github-runner-207 kernel: [59388.604906] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 21:53:34 juju-e4d256-prod-github-runner-207 kernel: [59388.606053] handle_exit+0x98/0x230 [kvm_amd] Aug 22 21:53:34 juju-e4d256-prod-github-runner-207 kernel: [59388.607053] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 21:53:34 juju-e4d256-prod-github-runner-207 kernel: [59388.608114] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 21:53:34 juju-e4d256-prod-github-runner-207 kernel: [59388.609211] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 21:53:34 juju-e4d256-prod-github-runner-207 kernel: [59388.610271] vcpu_run+0x62/0x2c0 [kvm] Aug 22 21:53:34 juju-e4d256-prod-github-runner-207 kernel: [59388.611173] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 21:53:34 juju-e4d256-prod-github-runner-207 kernel: [59388.612076] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 21:53:34 juju-e4d256-prod-github-runner-207 kernel: [59388.613063] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 21:53:34 juju-e4d256-prod-github-runner-207 kernel: [59388.614027] ? __seccomp_filter+0x4a/0x4a0 Aug 22 21:53:34 juju-e4d256-prod-github-runner-207 kernel: [59388.614887] ? __fget_files+0x86/0xc0 Aug 22 21:53:34 juju-e4d256-prod-github-runner-207 kernel: [59388.615850] __x64_sys_ioctl+0x95/0xd0 Aug 22 21:53:34 juju-e4d256-prod-github-runner-207 kernel: [59388.616633] do_syscall_64+0x5c/0xc0 Aug 22 21:53:34 juju-e4d256-prod-github-runner-207 kernel: [59388.617401] ? do_futex+0x162/0x1f0 Aug 22 21:53:34 juju-e4d256-prod-github-runner-207 kernel: [59388.618137] ? __x64_sys_futex+0x78/0x1e0 Aug 22 21:53:34 juju-e4d256-prod-github-runner-207 kernel: [59388.618985] ? __secure_computing+0xa9/0x120 Aug 22 21:53:34 juju-e4d256-prod-github-runner-207 kernel: [59388.619699] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 21:53:34 juju-e4d256-prod-github-runner-207 kernel: [59388.620467] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:53:34 juju-e4d256-prod-github-runner-207 kernel: [59388.621195] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:53:34 juju-e4d256-prod-github-runner-207 kernel: [59388.621939] ? do_syscall_64+0x69/0xc0 Aug 22 21:53:34 juju-e4d256-prod-github-runner-207 kernel: [59388.622589] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:53:34 juju-e4d256-prod-github-runner-207 kernel: [59388.623302] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:53:34 juju-e4d256-prod-github-runner-207 kernel: [59388.624043] ? do_syscall_64+0x69/0xc0 Aug 22 21:53:34 juju-e4d256-prod-github-runner-207 kernel: [59388.624803] ? do_syscall_64+0x69/0xc0 Aug 22 21:53:34 juju-e4d256-prod-github-runner-207 kernel: [59388.625568] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 21:53:34 juju-e4d256-prod-github-runner-207 kernel: [59388.626381] RIP: 0033:0x7faa5d0edaff Aug 22 21:53:34 juju-e4d256-prod-github-runner-207 kernel: [59388.627118] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 21:53:34 juju-e4d256-prod-github-runner-207 kernel: [59388.629471] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 21:53:34 juju-e4d256-prod-github-runner-207 kernel: [59388.630568] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 21:53:34 juju-e4d256-prod-github-runner-207 kernel: [59388.631598] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 21:53:34 juju-e4d256-prod-github-runner-207 kernel: [59388.632636] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 21:53:34 juju-e4d256-prod-github-runner-207 kernel: [59388.633689] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 21:53:34 juju-e4d256-prod-github-runner-207 kernel: [59388.634735] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 21:53:34 juju-e4d256-prod-github-runner-207 kernel: [59388.635788] Aug 22 21:53:47 juju-e4d256-prod-github-runner-207 kernel: [59401.148709] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 21:53:47 juju-e4d256-prod-github-runner-207 kernel: [59401.150562] rcu: 1-....: (14774333 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=7139025 Aug 22 21:53:47 juju-e4d256-prod-github-runner-207 kernel: [59401.151687] (t=14820987 jiffies g=23269 q=53551) Aug 22 21:53:47 juju-e4d256-prod-github-runner-207 kernel: [59401.152472] NMI backtrace for cpu 1 Aug 22 21:53:47 juju-e4d256-prod-github-runner-207 kernel: [59401.153199] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 21:53:47 juju-e4d256-prod-github-runner-207 kernel: [59401.154304] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 21:53:47 juju-e4d256-prod-github-runner-207 kernel: [59401.155367] Call Trace: Aug 22 21:53:47 juju-e4d256-prod-github-runner-207 kernel: [59401.156054] Aug 22 21:53:47 juju-e4d256-prod-github-runner-207 kernel: [59401.156716] show_stack+0x52/0x5c Aug 22 21:53:47 juju-e4d256-prod-github-runner-207 kernel: [59401.157451] dump_stack_lvl+0x4a/0x63 Aug 22 21:53:47 juju-e4d256-prod-github-runner-207 kernel: [59401.158196] dump_stack+0x10/0x16 Aug 22 21:53:47 juju-e4d256-prod-github-runner-207 kernel: [59401.158931] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 21:53:47 juju-e4d256-prod-github-runner-207 kernel: [59401.159713] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 21:53:47 juju-e4d256-prod-github-runner-207 kernel: [59401.160499] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 21:53:47 juju-e4d256-prod-github-runner-207 kernel: [59401.161398] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 21:53:47 juju-e4d256-prod-github-runner-207 kernel: [59401.162226] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 21:53:47 juju-e4d256-prod-github-runner-207 kernel: [59401.163036] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 21:53:47 juju-e4d256-prod-github-runner-207 kernel: [59401.163805] print_cpu_stall.cold+0x2f/0xe2 Aug 22 21:53:47 juju-e4d256-prod-github-runner-207 kernel: [59401.164569] ? timekeeping_update+0xf7/0x150 Aug 22 21:53:47 juju-e4d256-prod-github-runner-207 kernel: [59401.165359] check_cpu_stall+0x109/0x270 Aug 22 21:53:47 juju-e4d256-prod-github-runner-207 kernel: [59401.166111] rcu_sched_clock_irq+0x9a/0x250 Aug 22 21:53:47 juju-e4d256-prod-github-runner-207 kernel: [59401.166870] update_process_times+0x94/0xd0 Aug 22 21:53:47 juju-e4d256-prod-github-runner-207 kernel: [59401.167669] tick_sched_handle+0x29/0x70 Aug 22 21:53:47 juju-e4d256-prod-github-runner-207 kernel: [59401.168429] tick_sched_timer+0x8c/0xc0 Aug 22 21:53:47 juju-e4d256-prod-github-runner-207 kernel: [59401.169229] ? tick_nohz_handler+0xb0/0xb0 Aug 22 21:53:47 juju-e4d256-prod-github-runner-207 kernel: [59401.169982] __hrtimer_run_queues+0x107/0x230 Aug 22 21:53:47 juju-e4d256-prod-github-runner-207 kernel: [59401.170753] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 21:53:47 juju-e4d256-prod-github-runner-207 kernel: [59401.171531] hrtimer_interrupt+0x101/0x220 Aug 22 21:53:47 juju-e4d256-prod-github-runner-207 kernel: [59401.172299] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 21:53:47 juju-e4d256-prod-github-runner-207 kernel: [59401.173110] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 21:53:47 juju-e4d256-prod-github-runner-207 kernel: [59401.173939] Aug 22 21:53:47 juju-e4d256-prod-github-runner-207 kernel: [59401.174580] Aug 22 21:53:47 juju-e4d256-prod-github-runner-207 kernel: [59401.175210] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 21:53:47 juju-e4d256-prod-github-runner-207 kernel: [59401.176029] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:53:47 juju-e4d256-prod-github-runner-207 kernel: [59401.176961] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 21:53:47 juju-e4d256-prod-github-runner-207 kernel: [59401.179221] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 21:53:47 juju-e4d256-prod-github-runner-207 kernel: [59401.180104] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 21:53:47 juju-e4d256-prod-github-runner-207 kernel: [59401.181095] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 21:53:47 juju-e4d256-prod-github-runner-207 kernel: [59401.182151] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 21:53:47 juju-e4d256-prod-github-runner-207 kernel: [59401.183196] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 21:53:47 juju-e4d256-prod-github-runner-207 kernel: [59401.184392] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 21:53:47 juju-e4d256-prod-github-runner-207 kernel: [59401.185538] ? _raw_spin_lock+0x22/0x30 Aug 22 21:53:47 juju-e4d256-prod-github-runner-207 kernel: [59401.186393] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:53:47 juju-e4d256-prod-github-runner-207 kernel: [59401.187339] direct_page_fault+0x206/0x310 [kvm] Aug 22 21:53:47 juju-e4d256-prod-github-runner-207 kernel: [59401.188264] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 21:53:47 juju-e4d256-prod-github-runner-207 kernel: [59401.189201] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 21:53:47 juju-e4d256-prod-github-runner-207 kernel: [59401.190154] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 21:53:47 juju-e4d256-prod-github-runner-207 kernel: [59401.191080] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 21:53:47 juju-e4d256-prod-github-runner-207 kernel: [59401.191958] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 21:53:47 juju-e4d256-prod-github-runner-207 kernel: [59401.192888] handle_exit+0x98/0x230 [kvm_amd] Aug 22 21:53:47 juju-e4d256-prod-github-runner-207 kernel: [59401.193743] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 21:53:47 juju-e4d256-prod-github-runner-207 kernel: [59401.194677] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 21:53:47 juju-e4d256-prod-github-runner-207 kernel: [59401.195594] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 21:53:47 juju-e4d256-prod-github-runner-207 kernel: [59401.196522] vcpu_run+0x62/0x2c0 [kvm] Aug 22 21:53:47 juju-e4d256-prod-github-runner-207 kernel: [59401.197353] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 21:53:47 juju-e4d256-prod-github-runner-207 kernel: [59401.198175] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 21:53:47 juju-e4d256-prod-github-runner-207 kernel: [59401.199077] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 21:53:47 juju-e4d256-prod-github-runner-207 kernel: [59401.199929] ? __seccomp_filter+0x4a/0x4a0 Aug 22 21:53:47 juju-e4d256-prod-github-runner-207 kernel: [59401.200756] ? __fget_files+0x86/0xc0 Aug 22 21:53:47 juju-e4d256-prod-github-runner-207 kernel: [59401.201560] __x64_sys_ioctl+0x95/0xd0 Aug 22 21:53:47 juju-e4d256-prod-github-runner-207 kernel: [59401.202331] do_syscall_64+0x5c/0xc0 Aug 22 21:53:47 juju-e4d256-prod-github-runner-207 kernel: [59401.203090] ? do_futex+0x162/0x1f0 Aug 22 21:53:47 juju-e4d256-prod-github-runner-207 kernel: [59401.203839] ? __x64_sys_futex+0x78/0x1e0 Aug 22 21:53:47 juju-e4d256-prod-github-runner-207 kernel: [59401.204722] ? __secure_computing+0xa9/0x120 Aug 22 21:53:47 juju-e4d256-prod-github-runner-207 kernel: [59401.205541] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 21:53:47 juju-e4d256-prod-github-runner-207 kernel: [59401.206338] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:53:47 juju-e4d256-prod-github-runner-207 kernel: [59401.207094] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:53:47 juju-e4d256-prod-github-runner-207 kernel: [59401.207855] ? do_syscall_64+0x69/0xc0 Aug 22 21:53:47 juju-e4d256-prod-github-runner-207 kernel: [59401.208546] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:53:47 juju-e4d256-prod-github-runner-207 kernel: [59401.209324] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:53:47 juju-e4d256-prod-github-runner-207 kernel: [59401.210100] ? do_syscall_64+0x69/0xc0 Aug 22 21:53:47 juju-e4d256-prod-github-runner-207 kernel: [59401.210802] ? do_syscall_64+0x69/0xc0 Aug 22 21:53:47 juju-e4d256-prod-github-runner-207 kernel: [59401.211492] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 21:53:47 juju-e4d256-prod-github-runner-207 kernel: [59401.212269] RIP: 0033:0x7faa5d0edaff Aug 22 21:53:47 juju-e4d256-prod-github-runner-207 kernel: [59401.213011] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 21:53:47 juju-e4d256-prod-github-runner-207 kernel: [59401.215202] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 21:53:47 juju-e4d256-prod-github-runner-207 kernel: [59401.216200] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 21:53:47 juju-e4d256-prod-github-runner-207 kernel: [59401.217146] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 21:53:47 juju-e4d256-prod-github-runner-207 kernel: [59401.218142] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 21:53:47 juju-e4d256-prod-github-runner-207 kernel: [59401.219140] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 21:53:47 juju-e4d256-prod-github-runner-207 kernel: [59401.220074] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 21:53:47 juju-e4d256-prod-github-runner-207 kernel: [59401.220996] Aug 22 21:54:14 juju-e4d256-prod-github-runner-207 kernel: [59428.541981] watchdog: BUG: soft lockup - CPU#1 stuck for 55239s! [qemu-system-x86:6715] Aug 22 21:54:14 juju-e4d256-prod-github-runner-207 kernel: [59428.544018] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 21:54:14 juju-e4d256-prod-github-runner-207 kernel: [59428.544328] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 21:54:14 juju-e4d256-prod-github-runner-207 kernel: [59428.558393] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 21:54:14 juju-e4d256-prod-github-runner-207 kernel: [59428.559719] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 21:54:14 juju-e4d256-prod-github-runner-207 kernel: [59428.560993] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:54:14 juju-e4d256-prod-github-runner-207 kernel: [59428.562128] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 21:54:14 juju-e4d256-prod-github-runner-207 kernel: [59428.564733] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 21:54:14 juju-e4d256-prod-github-runner-207 kernel: [59428.565833] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 21:54:14 juju-e4d256-prod-github-runner-207 kernel: [59428.567053] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 21:54:14 juju-e4d256-prod-github-runner-207 kernel: [59428.568251] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 21:54:14 juju-e4d256-prod-github-runner-207 kernel: [59428.569457] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 21:54:14 juju-e4d256-prod-github-runner-207 kernel: [59428.570711] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 21:54:14 juju-e4d256-prod-github-runner-207 kernel: [59428.572023] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 21:54:14 juju-e4d256-prod-github-runner-207 kernel: [59428.573310] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 21:54:14 juju-e4d256-prod-github-runner-207 kernel: [59428.574429] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 21:54:14 juju-e4d256-prod-github-runner-207 kernel: [59428.575644] Call Trace: Aug 22 21:54:14 juju-e4d256-prod-github-runner-207 kernel: [59428.576567] Aug 22 21:54:14 juju-e4d256-prod-github-runner-207 kernel: [59428.578575] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:54:14 juju-e4d256-prod-github-runner-207 kernel: [59428.579622] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:54:14 juju-e4d256-prod-github-runner-207 kernel: [59428.580683] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:54:14 juju-e4d256-prod-github-runner-207 kernel: [59428.581840] ? show_regs.part.0+0x23/0x29 Aug 22 21:54:14 juju-e4d256-prod-github-runner-207 kernel: [59428.582881] ? show_regs.cold+0x8/0xd Aug 22 21:54:14 juju-e4d256-prod-github-runner-207 kernel: [59428.583896] ? watchdog_timer_fn+0x1be/0x220 Aug 22 21:54:14 juju-e4d256-prod-github-runner-207 kernel: [59428.585068] ? lockup_detector_update_enable+0x60/0x60 Aug 22 21:54:14 juju-e4d256-prod-github-runner-207 kernel: [59428.586179] ? __hrtimer_run_queues+0x107/0x230 Aug 22 21:54:14 juju-e4d256-prod-github-runner-207 kernel: [59428.587417] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 21:54:14 juju-e4d256-prod-github-runner-207 kernel: [59428.588455] ? hrtimer_interrupt+0x101/0x220 Aug 22 21:54:14 juju-e4d256-prod-github-runner-207 kernel: [59428.589506] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 21:54:14 juju-e4d256-prod-github-runner-207 kernel: [59428.590590] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 21:54:14 juju-e4d256-prod-github-runner-207 kernel: [59428.591650] Aug 22 21:54:14 juju-e4d256-prod-github-runner-207 kernel: [59428.592512] Aug 22 21:54:14 juju-e4d256-prod-github-runner-207 kernel: [59428.593412] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 21:54:14 juju-e4d256-prod-github-runner-207 kernel: [59428.594563] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:54:14 juju-e4d256-prod-github-runner-207 kernel: [59428.595873] ? _raw_spin_lock+0x22/0x30 Aug 22 21:54:14 juju-e4d256-prod-github-runner-207 kernel: [59428.596966] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:54:14 juju-e4d256-prod-github-runner-207 kernel: [59428.598018] direct_page_fault+0x206/0x310 [kvm] Aug 22 21:54:14 juju-e4d256-prod-github-runner-207 kernel: [59428.599070] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 21:54:14 juju-e4d256-prod-github-runner-207 kernel: [59428.600092] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 21:54:14 juju-e4d256-prod-github-runner-207 kernel: [59428.601340] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 21:54:14 juju-e4d256-prod-github-runner-207 kernel: [59428.602380] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 21:54:14 juju-e4d256-prod-github-runner-207 kernel: [59428.603459] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 21:54:14 juju-e4d256-prod-github-runner-207 kernel: [59428.604560] handle_exit+0x98/0x230 [kvm_amd] Aug 22 21:54:14 juju-e4d256-prod-github-runner-207 kernel: [59428.605498] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 21:54:14 juju-e4d256-prod-github-runner-207 kernel: [59428.606444] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 21:54:14 juju-e4d256-prod-github-runner-207 kernel: [59428.607391] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 21:54:14 juju-e4d256-prod-github-runner-207 kernel: [59428.608312] vcpu_run+0x62/0x2c0 [kvm] Aug 22 21:54:14 juju-e4d256-prod-github-runner-207 kernel: [59428.609162] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 21:54:14 juju-e4d256-prod-github-runner-207 kernel: [59428.609985] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 21:54:14 juju-e4d256-prod-github-runner-207 kernel: [59428.610854] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 21:54:14 juju-e4d256-prod-github-runner-207 kernel: [59428.611671] ? __seccomp_filter+0x4a/0x4a0 Aug 22 21:54:14 juju-e4d256-prod-github-runner-207 kernel: [59428.612440] ? __fget_files+0x86/0xc0 Aug 22 21:54:14 juju-e4d256-prod-github-runner-207 kernel: [59428.613204] __x64_sys_ioctl+0x95/0xd0 Aug 22 21:54:14 juju-e4d256-prod-github-runner-207 kernel: [59428.613919] do_syscall_64+0x5c/0xc0 Aug 22 21:54:14 juju-e4d256-prod-github-runner-207 kernel: [59428.614599] ? do_futex+0x162/0x1f0 Aug 22 21:54:14 juju-e4d256-prod-github-runner-207 kernel: [59428.615257] ? __x64_sys_futex+0x78/0x1e0 Aug 22 21:54:14 juju-e4d256-prod-github-runner-207 kernel: [59428.615942] ? __secure_computing+0xa9/0x120 Aug 22 21:54:14 juju-e4d256-prod-github-runner-207 kernel: [59428.616642] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 21:54:14 juju-e4d256-prod-github-runner-207 kernel: [59428.617434] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:54:14 juju-e4d256-prod-github-runner-207 kernel: [59428.618173] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:54:14 juju-e4d256-prod-github-runner-207 kernel: [59428.618906] ? do_syscall_64+0x69/0xc0 Aug 22 21:54:14 juju-e4d256-prod-github-runner-207 kernel: [59428.619560] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:54:14 juju-e4d256-prod-github-runner-207 kernel: [59428.620274] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:54:14 juju-e4d256-prod-github-runner-207 kernel: [59428.620997] ? do_syscall_64+0x69/0xc0 Aug 22 21:54:14 juju-e4d256-prod-github-runner-207 kernel: [59428.621634] ? do_syscall_64+0x69/0xc0 Aug 22 21:54:14 juju-e4d256-prod-github-runner-207 kernel: [59428.622265] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 21:54:14 juju-e4d256-prod-github-runner-207 kernel: [59428.622983] RIP: 0033:0x7faa5d0edaff Aug 22 21:54:14 juju-e4d256-prod-github-runner-207 kernel: [59428.623655] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 21:54:14 juju-e4d256-prod-github-runner-207 kernel: [59428.625724] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 21:54:14 juju-e4d256-prod-github-runner-207 kernel: [59428.626655] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 21:54:14 juju-e4d256-prod-github-runner-207 kernel: [59428.627578] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 21:54:14 juju-e4d256-prod-github-runner-207 kernel: [59428.628492] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 21:54:14 juju-e4d256-prod-github-runner-207 kernel: [59428.629420] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 21:54:14 juju-e4d256-prod-github-runner-207 kernel: [59428.630328] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 21:54:14 juju-e4d256-prod-github-runner-207 kernel: [59428.631247] Aug 22 21:54:42 juju-e4d256-prod-github-runner-207 kernel: [59456.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 55265s! [qemu-system-x86:6715] Aug 22 21:54:42 juju-e4d256-prod-github-runner-207 kernel: [59456.543821] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 21:54:42 juju-e4d256-prod-github-runner-207 kernel: [59456.544121] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 21:54:42 juju-e4d256-prod-github-runner-207 kernel: [59456.556256] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 21:54:42 juju-e4d256-prod-github-runner-207 kernel: [59456.557533] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 21:54:42 juju-e4d256-prod-github-runner-207 kernel: [59456.558749] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:54:42 juju-e4d256-prod-github-runner-207 kernel: [59456.559803] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 21:54:42 juju-e4d256-prod-github-runner-207 kernel: [59456.562391] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 21:54:42 juju-e4d256-prod-github-runner-207 kernel: [59456.563448] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 21:54:42 juju-e4d256-prod-github-runner-207 kernel: [59456.564624] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 21:54:42 juju-e4d256-prod-github-runner-207 kernel: [59456.565787] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 21:54:42 juju-e4d256-prod-github-runner-207 kernel: [59456.566955] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 21:54:42 juju-e4d256-prod-github-runner-207 kernel: [59456.568122] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 21:54:42 juju-e4d256-prod-github-runner-207 kernel: [59456.569302] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 21:54:42 juju-e4d256-prod-github-runner-207 kernel: [59456.570540] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 21:54:42 juju-e4d256-prod-github-runner-207 kernel: [59456.571637] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 21:54:42 juju-e4d256-prod-github-runner-207 kernel: [59456.572864] Call Trace: Aug 22 21:54:42 juju-e4d256-prod-github-runner-207 kernel: [59456.573778] Aug 22 21:54:42 juju-e4d256-prod-github-runner-207 kernel: [59456.574692] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:54:42 juju-e4d256-prod-github-runner-207 kernel: [59456.575736] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:54:42 juju-e4d256-prod-github-runner-207 kernel: [59456.576775] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:54:42 juju-e4d256-prod-github-runner-207 kernel: [59456.577875] ? show_regs.part.0+0x23/0x29 Aug 22 21:54:42 juju-e4d256-prod-github-runner-207 kernel: [59456.578869] ? show_regs.cold+0x8/0xd Aug 22 21:54:42 juju-e4d256-prod-github-runner-207 kernel: [59456.579839] ? watchdog_timer_fn+0x1be/0x220 Aug 22 21:54:42 juju-e4d256-prod-github-runner-207 kernel: [59456.580858] ? lockup_detector_update_enable+0x60/0x60 Aug 22 21:54:42 juju-e4d256-prod-github-runner-207 kernel: [59456.581928] ? __hrtimer_run_queues+0x107/0x230 Aug 22 21:54:42 juju-e4d256-prod-github-runner-207 kernel: [59456.582968] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 21:54:42 juju-e4d256-prod-github-runner-207 kernel: [59456.583989] ? hrtimer_interrupt+0x101/0x220 Aug 22 21:54:42 juju-e4d256-prod-github-runner-207 kernel: [59456.585017] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 21:54:42 juju-e4d256-prod-github-runner-207 kernel: [59456.586092] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 21:54:42 juju-e4d256-prod-github-runner-207 kernel: [59456.587139] Aug 22 21:54:42 juju-e4d256-prod-github-runner-207 kernel: [59456.587991] Aug 22 21:54:42 juju-e4d256-prod-github-runner-207 kernel: [59456.588842] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 21:54:42 juju-e4d256-prod-github-runner-207 kernel: [59456.589881] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:54:42 juju-e4d256-prod-github-runner-207 kernel: [59456.590916] ? _raw_spin_lock+0x22/0x30 Aug 22 21:54:42 juju-e4d256-prod-github-runner-207 kernel: [59456.591858] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:54:42 juju-e4d256-prod-github-runner-207 kernel: [59456.592883] direct_page_fault+0x206/0x310 [kvm] Aug 22 21:54:42 juju-e4d256-prod-github-runner-207 kernel: [59456.593905] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 21:54:42 juju-e4d256-prod-github-runner-207 kernel: [59456.594910] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 21:54:42 juju-e4d256-prod-github-runner-207 kernel: [59456.595906] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 21:54:42 juju-e4d256-prod-github-runner-207 kernel: [59456.596925] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 21:54:42 juju-e4d256-prod-github-runner-207 kernel: [59456.597872] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 21:54:42 juju-e4d256-prod-github-runner-207 kernel: [59456.598847] handle_exit+0x98/0x230 [kvm_amd] Aug 22 21:54:42 juju-e4d256-prod-github-runner-207 kernel: [59456.599739] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 21:54:42 juju-e4d256-prod-github-runner-207 kernel: [59456.600733] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 21:54:42 juju-e4d256-prod-github-runner-207 kernel: [59456.601676] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 21:54:42 juju-e4d256-prod-github-runner-207 kernel: [59456.602579] vcpu_run+0x62/0x2c0 [kvm] Aug 22 21:54:42 juju-e4d256-prod-github-runner-207 kernel: [59456.603420] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 21:54:42 juju-e4d256-prod-github-runner-207 kernel: [59456.604763] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 21:54:42 juju-e4d256-prod-github-runner-207 kernel: [59456.605620] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 21:54:42 juju-e4d256-prod-github-runner-207 kernel: [59456.606431] ? __seccomp_filter+0x4a/0x4a0 Aug 22 21:54:42 juju-e4d256-prod-github-runner-207 kernel: [59456.607199] ? __fget_files+0x86/0xc0 Aug 22 21:54:42 juju-e4d256-prod-github-runner-207 kernel: [59456.607918] __x64_sys_ioctl+0x95/0xd0 Aug 22 21:54:42 juju-e4d256-prod-github-runner-207 kernel: [59456.608636] do_syscall_64+0x5c/0xc0 Aug 22 21:54:42 juju-e4d256-prod-github-runner-207 kernel: [59456.609303] ? do_futex+0x162/0x1f0 Aug 22 21:54:42 juju-e4d256-prod-github-runner-207 kernel: [59456.609953] ? __x64_sys_futex+0x78/0x1e0 Aug 22 21:54:42 juju-e4d256-prod-github-runner-207 kernel: [59456.610626] ? __secure_computing+0xa9/0x120 Aug 22 21:54:42 juju-e4d256-prod-github-runner-207 kernel: [59456.611316] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 21:54:42 juju-e4d256-prod-github-runner-207 kernel: [59456.612076] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:54:42 juju-e4d256-prod-github-runner-207 kernel: [59456.612835] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:54:42 juju-e4d256-prod-github-runner-207 kernel: [59456.613565] ? do_syscall_64+0x69/0xc0 Aug 22 21:54:42 juju-e4d256-prod-github-runner-207 kernel: [59456.614225] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:54:42 juju-e4d256-prod-github-runner-207 kernel: [59456.614930] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:54:42 juju-e4d256-prod-github-runner-207 kernel: [59456.615620] ? do_syscall_64+0x69/0xc0 Aug 22 21:54:42 juju-e4d256-prod-github-runner-207 kernel: [59456.616241] ? do_syscall_64+0x69/0xc0 Aug 22 21:54:42 juju-e4d256-prod-github-runner-207 kernel: [59456.616882] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 21:54:42 juju-e4d256-prod-github-runner-207 kernel: [59456.617587] RIP: 0033:0x7faa5d0edaff Aug 22 21:54:42 juju-e4d256-prod-github-runner-207 kernel: [59456.618257] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 21:54:42 juju-e4d256-prod-github-runner-207 kernel: [59456.620258] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 21:54:42 juju-e4d256-prod-github-runner-207 kernel: [59456.621199] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 21:54:42 juju-e4d256-prod-github-runner-207 kernel: [59456.622199] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 21:54:42 juju-e4d256-prod-github-runner-207 kernel: [59456.623194] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 21:54:42 juju-e4d256-prod-github-runner-207 kernel: [59456.624081] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 21:54:42 juju-e4d256-prod-github-runner-207 kernel: [59456.624982] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 21:54:42 juju-e4d256-prod-github-runner-207 kernel: [59456.625881] Aug 22 21:55:10 juju-e4d256-prod-github-runner-207 kernel: [59484.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 55291s! [qemu-system-x86:6715] Aug 22 21:55:10 juju-e4d256-prod-github-runner-207 kernel: [59484.543835] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 21:55:10 juju-e4d256-prod-github-runner-207 kernel: [59484.544131] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 21:55:10 juju-e4d256-prod-github-runner-207 kernel: [59484.559599] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 21:55:10 juju-e4d256-prod-github-runner-207 kernel: [59484.561421] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 21:55:10 juju-e4d256-prod-github-runner-207 kernel: [59484.563138] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:55:10 juju-e4d256-prod-github-runner-207 kernel: [59484.564611] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 21:55:10 juju-e4d256-prod-github-runner-207 kernel: [59484.568190] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 21:55:10 juju-e4d256-prod-github-runner-207 kernel: [59484.569655] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 21:55:10 juju-e4d256-prod-github-runner-207 kernel: [59484.571299] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 21:55:10 juju-e4d256-prod-github-runner-207 kernel: [59484.572952] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 21:55:10 juju-e4d256-prod-github-runner-207 kernel: [59484.574600] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 21:55:10 juju-e4d256-prod-github-runner-207 kernel: [59484.576274] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 21:55:10 juju-e4d256-prod-github-runner-207 kernel: [59484.577913] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 21:55:10 juju-e4d256-prod-github-runner-207 kernel: [59484.579606] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 21:55:10 juju-e4d256-prod-github-runner-207 kernel: [59484.581169] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 21:55:10 juju-e4d256-prod-github-runner-207 kernel: [59484.582796] Call Trace: Aug 22 21:55:10 juju-e4d256-prod-github-runner-207 kernel: [59484.584059] Aug 22 21:55:10 juju-e4d256-prod-github-runner-207 kernel: [59484.585431] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:55:10 juju-e4d256-prod-github-runner-207 kernel: [59484.586813] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:55:10 juju-e4d256-prod-github-runner-207 kernel: [59484.588283] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:55:10 juju-e4d256-prod-github-runner-207 kernel: [59484.589812] ? show_regs.part.0+0x23/0x29 Aug 22 21:55:10 juju-e4d256-prod-github-runner-207 kernel: [59484.591233] ? show_regs.cold+0x8/0xd Aug 22 21:55:10 juju-e4d256-prod-github-runner-207 kernel: [59484.592610] ? watchdog_timer_fn+0x1be/0x220 Aug 22 21:55:10 juju-e4d256-prod-github-runner-207 kernel: [59484.594033] ? lockup_detector_update_enable+0x60/0x60 Aug 22 21:55:10 juju-e4d256-prod-github-runner-207 kernel: [59484.595424] ? __hrtimer_run_queues+0x107/0x230 Aug 22 21:55:10 juju-e4d256-prod-github-runner-207 kernel: [59484.596909] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 21:55:10 juju-e4d256-prod-github-runner-207 kernel: [59484.598257] ? hrtimer_interrupt+0x101/0x220 Aug 22 21:55:10 juju-e4d256-prod-github-runner-207 kernel: [59484.599673] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 21:55:10 juju-e4d256-prod-github-runner-207 kernel: [59484.601132] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 21:55:10 juju-e4d256-prod-github-runner-207 kernel: [59484.602573] Aug 22 21:55:10 juju-e4d256-prod-github-runner-207 kernel: [59484.603748] Aug 22 21:55:10 juju-e4d256-prod-github-runner-207 kernel: [59484.604959] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 21:55:10 juju-e4d256-prod-github-runner-207 kernel: [59484.606406] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:55:10 juju-e4d256-prod-github-runner-207 kernel: [59484.607841] ? _raw_spin_lock+0x22/0x30 Aug 22 21:55:10 juju-e4d256-prod-github-runner-207 kernel: [59484.609201] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:55:10 juju-e4d256-prod-github-runner-207 kernel: [59484.610500] direct_page_fault+0x206/0x310 [kvm] Aug 22 21:55:10 juju-e4d256-prod-github-runner-207 kernel: [59484.611884] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 21:55:10 juju-e4d256-prod-github-runner-207 kernel: [59484.613330] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 21:55:10 juju-e4d256-prod-github-runner-207 kernel: [59484.614772] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 21:55:10 juju-e4d256-prod-github-runner-207 kernel: [59484.616225] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 21:55:10 juju-e4d256-prod-github-runner-207 kernel: [59484.617200] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 21:55:10 juju-e4d256-prod-github-runner-207 kernel: [59484.618181] handle_exit+0x98/0x230 [kvm_amd] Aug 22 21:55:10 juju-e4d256-prod-github-runner-207 kernel: [59484.619076] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 21:55:10 juju-e4d256-prod-github-runner-207 kernel: [59484.619997] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 21:55:10 juju-e4d256-prod-github-runner-207 kernel: [59484.620999] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 21:55:10 juju-e4d256-prod-github-runner-207 kernel: [59484.621911] vcpu_run+0x62/0x2c0 [kvm] Aug 22 21:55:10 juju-e4d256-prod-github-runner-207 kernel: [59484.622753] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 21:55:10 juju-e4d256-prod-github-runner-207 kernel: [59484.623575] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 21:55:10 juju-e4d256-prod-github-runner-207 kernel: [59484.624629] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 21:55:10 juju-e4d256-prod-github-runner-207 kernel: [59484.625568] ? __seccomp_filter+0x4a/0x4a0 Aug 22 21:55:10 juju-e4d256-prod-github-runner-207 kernel: [59484.626335] ? __fget_files+0x86/0xc0 Aug 22 21:55:10 juju-e4d256-prod-github-runner-207 kernel: [59484.627049] __x64_sys_ioctl+0x95/0xd0 Aug 22 21:55:10 juju-e4d256-prod-github-runner-207 kernel: [59484.627749] do_syscall_64+0x5c/0xc0 Aug 22 21:55:10 juju-e4d256-prod-github-runner-207 kernel: [59484.628446] ? do_futex+0x162/0x1f0 Aug 22 21:55:10 juju-e4d256-prod-github-runner-207 kernel: [59484.629103] ? __x64_sys_futex+0x78/0x1e0 Aug 22 21:55:10 juju-e4d256-prod-github-runner-207 kernel: [59484.629795] ? __secure_computing+0xa9/0x120 Aug 22 21:55:10 juju-e4d256-prod-github-runner-207 kernel: [59484.630495] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 21:55:10 juju-e4d256-prod-github-runner-207 kernel: [59484.631281] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:55:10 juju-e4d256-prod-github-runner-207 kernel: [59484.632016] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:55:10 juju-e4d256-prod-github-runner-207 kernel: [59484.632756] ? do_syscall_64+0x69/0xc0 Aug 22 21:55:10 juju-e4d256-prod-github-runner-207 kernel: [59484.633410] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:55:10 juju-e4d256-prod-github-runner-207 kernel: [59484.634118] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:55:10 juju-e4d256-prod-github-runner-207 kernel: [59484.634833] ? do_syscall_64+0x69/0xc0 Aug 22 21:55:10 juju-e4d256-prod-github-runner-207 kernel: [59484.635468] ? do_syscall_64+0x69/0xc0 Aug 22 21:55:10 juju-e4d256-prod-github-runner-207 kernel: [59484.636107] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 21:55:10 juju-e4d256-prod-github-runner-207 kernel: [59484.636834] RIP: 0033:0x7faa5d0edaff Aug 22 21:55:10 juju-e4d256-prod-github-runner-207 kernel: [59484.637533] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 21:55:10 juju-e4d256-prod-github-runner-207 kernel: [59484.639540] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 21:55:10 juju-e4d256-prod-github-runner-207 kernel: [59484.640504] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 21:55:10 juju-e4d256-prod-github-runner-207 kernel: [59484.641438] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 21:55:10 juju-e4d256-prod-github-runner-207 kernel: [59484.642337] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 21:55:10 juju-e4d256-prod-github-runner-207 kernel: [59484.643233] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 21:55:10 juju-e4d256-prod-github-runner-207 kernel: [59484.644143] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 21:55:10 juju-e4d256-prod-github-runner-207 kernel: [59484.645077] Aug 22 21:55:38 juju-e4d256-prod-github-runner-207 kernel: [59512.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 55317s! [qemu-system-x86:6715] Aug 22 21:55:38 juju-e4d256-prod-github-runner-207 kernel: [59512.543137] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 21:55:38 juju-e4d256-prod-github-runner-207 kernel: [59512.543212] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 21:55:38 juju-e4d256-prod-github-runner-207 kernel: [59512.555792] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 21:55:38 juju-e4d256-prod-github-runner-207 kernel: [59512.557132] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 21:55:38 juju-e4d256-prod-github-runner-207 kernel: [59512.558464] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:55:38 juju-e4d256-prod-github-runner-207 kernel: [59512.559682] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 21:55:38 juju-e4d256-prod-github-runner-207 kernel: [59512.562423] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 21:55:38 juju-e4d256-prod-github-runner-207 kernel: [59512.563557] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 21:55:38 juju-e4d256-prod-github-runner-207 kernel: [59512.564879] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 21:55:38 juju-e4d256-prod-github-runner-207 kernel: [59512.566134] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 21:55:38 juju-e4d256-prod-github-runner-207 kernel: [59512.567454] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 21:55:38 juju-e4d256-prod-github-runner-207 kernel: [59512.568732] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 21:55:38 juju-e4d256-prod-github-runner-207 kernel: [59512.570073] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 21:55:38 juju-e4d256-prod-github-runner-207 kernel: [59512.571431] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 21:55:38 juju-e4d256-prod-github-runner-207 kernel: [59512.572675] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 21:55:38 juju-e4d256-prod-github-runner-207 kernel: [59512.574030] Call Trace: Aug 22 21:55:38 juju-e4d256-prod-github-runner-207 kernel: [59512.575062] Aug 22 21:55:38 juju-e4d256-prod-github-runner-207 kernel: [59512.576132] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:55:38 juju-e4d256-prod-github-runner-207 kernel: [59512.577279] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:55:38 juju-e4d256-prod-github-runner-207 kernel: [59512.578436] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:55:38 juju-e4d256-prod-github-runner-207 kernel: [59512.579669] ? show_regs.part.0+0x23/0x29 Aug 22 21:55:38 juju-e4d256-prod-github-runner-207 kernel: [59512.580781] ? show_regs.cold+0x8/0xd Aug 22 21:55:38 juju-e4d256-prod-github-runner-207 kernel: [59512.581872] ? watchdog_timer_fn+0x1be/0x220 Aug 22 21:55:38 juju-e4d256-prod-github-runner-207 kernel: [59512.582997] ? lockup_detector_update_enable+0x60/0x60 Aug 22 21:55:38 juju-e4d256-prod-github-runner-207 kernel: [59512.584258] ? __hrtimer_run_queues+0x107/0x230 Aug 22 21:55:38 juju-e4d256-prod-github-runner-207 kernel: [59512.585441] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 21:55:38 juju-e4d256-prod-github-runner-207 kernel: [59512.586612] ? hrtimer_interrupt+0x101/0x220 Aug 22 21:55:38 juju-e4d256-prod-github-runner-207 kernel: [59512.587769] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 21:55:38 juju-e4d256-prod-github-runner-207 kernel: [59512.589029] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 21:55:38 juju-e4d256-prod-github-runner-207 kernel: [59512.590233] Aug 22 21:55:38 juju-e4d256-prod-github-runner-207 kernel: [59512.591210] Aug 22 21:55:38 juju-e4d256-prod-github-runner-207 kernel: [59512.592186] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 21:55:38 juju-e4d256-prod-github-runner-207 kernel: [59512.593384] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:55:38 juju-e4d256-prod-github-runner-207 kernel: [59512.594738] ? _raw_spin_lock+0x22/0x30 Aug 22 21:55:38 juju-e4d256-prod-github-runner-207 kernel: [59512.596084] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:55:38 juju-e4d256-prod-github-runner-207 kernel: [59512.597270] direct_page_fault+0x206/0x310 [kvm] Aug 22 21:55:38 juju-e4d256-prod-github-runner-207 kernel: [59512.598509] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 21:55:38 juju-e4d256-prod-github-runner-207 kernel: [59512.600022] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 21:55:38 juju-e4d256-prod-github-runner-207 kernel: [59512.601111] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 21:55:38 juju-e4d256-prod-github-runner-207 kernel: [59512.602205] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 21:55:38 juju-e4d256-prod-github-runner-207 kernel: [59512.603295] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 21:55:38 juju-e4d256-prod-github-runner-207 kernel: [59512.604431] handle_exit+0x98/0x230 [kvm_amd] Aug 22 21:55:38 juju-e4d256-prod-github-runner-207 kernel: [59512.605448] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 21:55:38 juju-e4d256-prod-github-runner-207 kernel: [59512.606462] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 21:55:38 juju-e4d256-prod-github-runner-207 kernel: [59512.607418] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 21:55:38 juju-e4d256-prod-github-runner-207 kernel: [59512.608354] vcpu_run+0x62/0x2c0 [kvm] Aug 22 21:55:38 juju-e4d256-prod-github-runner-207 kernel: [59512.609174] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 21:55:38 juju-e4d256-prod-github-runner-207 kernel: [59512.609985] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 21:55:38 juju-e4d256-prod-github-runner-207 kernel: [59512.610850] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 21:55:38 juju-e4d256-prod-github-runner-207 kernel: [59512.611656] ? __seccomp_filter+0x4a/0x4a0 Aug 22 21:55:38 juju-e4d256-prod-github-runner-207 kernel: [59512.612411] ? __fget_files+0x86/0xc0 Aug 22 21:55:38 juju-e4d256-prod-github-runner-207 kernel: [59512.613117] __x64_sys_ioctl+0x95/0xd0 Aug 22 21:55:38 juju-e4d256-prod-github-runner-207 kernel: [59512.613812] do_syscall_64+0x5c/0xc0 Aug 22 21:55:38 juju-e4d256-prod-github-runner-207 kernel: [59512.614480] ? do_futex+0x162/0x1f0 Aug 22 21:55:38 juju-e4d256-prod-github-runner-207 kernel: [59512.615131] ? __x64_sys_futex+0x78/0x1e0 Aug 22 21:55:38 juju-e4d256-prod-github-runner-207 kernel: [59512.615839] ? __secure_computing+0xa9/0x120 Aug 22 21:55:38 juju-e4d256-prod-github-runner-207 kernel: [59512.616538] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 21:55:38 juju-e4d256-prod-github-runner-207 kernel: [59512.617301] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:55:38 juju-e4d256-prod-github-runner-207 kernel: [59512.618030] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:55:38 juju-e4d256-prod-github-runner-207 kernel: [59512.618751] ? do_syscall_64+0x69/0xc0 Aug 22 21:55:38 juju-e4d256-prod-github-runner-207 kernel: [59512.619405] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:55:38 juju-e4d256-prod-github-runner-207 kernel: [59512.620132] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:55:38 juju-e4d256-prod-github-runner-207 kernel: [59512.620836] ? do_syscall_64+0x69/0xc0 Aug 22 21:55:38 juju-e4d256-prod-github-runner-207 kernel: [59512.621462] ? do_syscall_64+0x69/0xc0 Aug 22 21:55:38 juju-e4d256-prod-github-runner-207 kernel: [59512.622089] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 21:55:38 juju-e4d256-prod-github-runner-207 kernel: [59512.622796] RIP: 0033:0x7faa5d0edaff Aug 22 21:55:38 juju-e4d256-prod-github-runner-207 kernel: [59512.623428] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 21:55:38 juju-e4d256-prod-github-runner-207 kernel: [59512.625455] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 21:55:38 juju-e4d256-prod-github-runner-207 kernel: [59512.626376] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 21:55:38 juju-e4d256-prod-github-runner-207 kernel: [59512.627268] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 21:55:38 juju-e4d256-prod-github-runner-207 kernel: [59512.628169] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 21:55:38 juju-e4d256-prod-github-runner-207 kernel: [59512.629065] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 21:55:38 juju-e4d256-prod-github-runner-207 kernel: [59512.629967] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 21:55:38 juju-e4d256-prod-github-runner-207 kernel: [59512.630863] Aug 22 21:56:06 juju-e4d256-prod-github-runner-207 kernel: [59540.541981] watchdog: BUG: soft lockup - CPU#1 stuck for 55343s! [qemu-system-x86:6715] Aug 22 21:56:06 juju-e4d256-prod-github-runner-207 kernel: [59540.543871] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 21:56:06 juju-e4d256-prod-github-runner-207 kernel: [59540.544163] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 21:56:06 juju-e4d256-prod-github-runner-207 kernel: [59540.556472] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 21:56:06 juju-e4d256-prod-github-runner-207 kernel: [59540.557748] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 21:56:06 juju-e4d256-prod-github-runner-207 kernel: [59540.559009] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:56:06 juju-e4d256-prod-github-runner-207 kernel: [59540.560196] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 21:56:06 juju-e4d256-prod-github-runner-207 kernel: [59540.562881] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 21:56:06 juju-e4d256-prod-github-runner-207 kernel: [59540.563953] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 21:56:06 juju-e4d256-prod-github-runner-207 kernel: [59540.565115] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 21:56:06 juju-e4d256-prod-github-runner-207 kernel: [59540.566278] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 21:56:06 juju-e4d256-prod-github-runner-207 kernel: [59540.567437] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 21:56:06 juju-e4d256-prod-github-runner-207 kernel: [59540.568626] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 21:56:06 juju-e4d256-prod-github-runner-207 kernel: [59540.569798] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 21:56:06 juju-e4d256-prod-github-runner-207 kernel: [59540.571028] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 21:56:06 juju-e4d256-prod-github-runner-207 kernel: [59540.572158] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 21:56:06 juju-e4d256-prod-github-runner-207 kernel: [59540.573382] Call Trace: Aug 22 21:56:06 juju-e4d256-prod-github-runner-207 kernel: [59540.574319] Aug 22 21:56:06 juju-e4d256-prod-github-runner-207 kernel: [59540.575262] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:56:06 juju-e4d256-prod-github-runner-207 kernel: [59540.576349] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:56:06 juju-e4d256-prod-github-runner-207 kernel: [59540.577384] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:56:06 juju-e4d256-prod-github-runner-207 kernel: [59540.578504] ? show_regs.part.0+0x23/0x29 Aug 22 21:56:06 juju-e4d256-prod-github-runner-207 kernel: [59540.579552] ? show_regs.cold+0x8/0xd Aug 22 21:56:06 juju-e4d256-prod-github-runner-207 kernel: [59540.580565] ? watchdog_timer_fn+0x1be/0x220 Aug 22 21:56:06 juju-e4d256-prod-github-runner-207 kernel: [59540.581738] ? lockup_detector_update_enable+0x60/0x60 Aug 22 21:56:06 juju-e4d256-prod-github-runner-207 kernel: [59540.582915] ? __hrtimer_run_queues+0x107/0x230 Aug 22 21:56:06 juju-e4d256-prod-github-runner-207 kernel: [59540.584079] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 21:56:06 juju-e4d256-prod-github-runner-207 kernel: [59540.585203] ? hrtimer_interrupt+0x101/0x220 Aug 22 21:56:06 juju-e4d256-prod-github-runner-207 kernel: [59540.586366] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 21:56:06 juju-e4d256-prod-github-runner-207 kernel: [59540.587585] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 21:56:06 juju-e4d256-prod-github-runner-207 kernel: [59540.588728] Aug 22 21:56:06 juju-e4d256-prod-github-runner-207 kernel: [59540.589635] Aug 22 21:56:06 juju-e4d256-prod-github-runner-207 kernel: [59540.590528] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 21:56:06 juju-e4d256-prod-github-runner-207 kernel: [59540.591727] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:56:06 juju-e4d256-prod-github-runner-207 kernel: [59540.592872] ? _raw_spin_lock+0x22/0x30 Aug 22 21:56:06 juju-e4d256-prod-github-runner-207 kernel: [59540.593899] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:56:06 juju-e4d256-prod-github-runner-207 kernel: [59540.595021] direct_page_fault+0x206/0x310 [kvm] Aug 22 21:56:06 juju-e4d256-prod-github-runner-207 kernel: [59540.596223] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 21:56:06 juju-e4d256-prod-github-runner-207 kernel: [59540.597333] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 21:56:06 juju-e4d256-prod-github-runner-207 kernel: [59540.598435] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 21:56:06 juju-e4d256-prod-github-runner-207 kernel: [59540.599582] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 21:56:06 juju-e4d256-prod-github-runner-207 kernel: [59540.600622] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 21:56:06 juju-e4d256-prod-github-runner-207 kernel: [59540.601711] handle_exit+0x98/0x230 [kvm_amd] Aug 22 21:56:06 juju-e4d256-prod-github-runner-207 kernel: [59540.602696] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 21:56:06 juju-e4d256-prod-github-runner-207 kernel: [59540.603727] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 21:56:06 juju-e4d256-prod-github-runner-207 kernel: [59540.604751] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 21:56:06 juju-e4d256-prod-github-runner-207 kernel: [59540.605871] vcpu_run+0x62/0x2c0 [kvm] Aug 22 21:56:06 juju-e4d256-prod-github-runner-207 kernel: [59540.607100] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 21:56:06 juju-e4d256-prod-github-runner-207 kernel: [59540.607957] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 21:56:06 juju-e4d256-prod-github-runner-207 kernel: [59540.608820] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 21:56:06 juju-e4d256-prod-github-runner-207 kernel: [59540.609620] ? __seccomp_filter+0x4a/0x4a0 Aug 22 21:56:06 juju-e4d256-prod-github-runner-207 kernel: [59540.610390] ? __fget_files+0x86/0xc0 Aug 22 21:56:06 juju-e4d256-prod-github-runner-207 kernel: [59540.611116] __x64_sys_ioctl+0x95/0xd0 Aug 22 21:56:06 juju-e4d256-prod-github-runner-207 kernel: [59540.611835] do_syscall_64+0x5c/0xc0 Aug 22 21:56:06 juju-e4d256-prod-github-runner-207 kernel: [59540.612514] ? do_futex+0x162/0x1f0 Aug 22 21:56:06 juju-e4d256-prod-github-runner-207 kernel: [59540.613173] ? __x64_sys_futex+0x78/0x1e0 Aug 22 21:56:06 juju-e4d256-prod-github-runner-207 kernel: [59540.613855] ? __secure_computing+0xa9/0x120 Aug 22 21:56:06 juju-e4d256-prod-github-runner-207 kernel: [59540.614548] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 21:56:06 juju-e4d256-prod-github-runner-207 kernel: [59540.615324] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:56:06 juju-e4d256-prod-github-runner-207 kernel: [59540.616084] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:56:06 juju-e4d256-prod-github-runner-207 kernel: [59540.616804] ? do_syscall_64+0x69/0xc0 Aug 22 21:56:06 juju-e4d256-prod-github-runner-207 kernel: [59540.617451] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:56:06 juju-e4d256-prod-github-runner-207 kernel: [59540.618159] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:56:06 juju-e4d256-prod-github-runner-207 kernel: [59540.618855] ? do_syscall_64+0x69/0xc0 Aug 22 21:56:06 juju-e4d256-prod-github-runner-207 kernel: [59540.619502] ? do_syscall_64+0x69/0xc0 Aug 22 21:56:06 juju-e4d256-prod-github-runner-207 kernel: [59540.620141] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 21:56:06 juju-e4d256-prod-github-runner-207 kernel: [59540.620867] RIP: 0033:0x7faa5d0edaff Aug 22 21:56:06 juju-e4d256-prod-github-runner-207 kernel: [59540.621538] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 21:56:06 juju-e4d256-prod-github-runner-207 kernel: [59540.623565] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 21:56:06 juju-e4d256-prod-github-runner-207 kernel: [59540.624551] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 21:56:06 juju-e4d256-prod-github-runner-207 kernel: [59540.625448] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 21:56:06 juju-e4d256-prod-github-runner-207 kernel: [59540.626351] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 21:56:06 juju-e4d256-prod-github-runner-207 kernel: [59540.627245] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 21:56:06 juju-e4d256-prod-github-runner-207 kernel: [59540.628342] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 21:56:06 juju-e4d256-prod-github-runner-207 kernel: [59540.629271] Aug 22 21:56:34 juju-e4d256-prod-github-runner-207 kernel: [59568.541980] watchdog: BUG: soft lockup - CPU#1 stuck for 55369s! [qemu-system-x86:6715] Aug 22 21:56:34 juju-e4d256-prod-github-runner-207 kernel: [59568.543215] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 21:56:34 juju-e4d256-prod-github-runner-207 kernel: [59568.543290] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 21:56:34 juju-e4d256-prod-github-runner-207 kernel: [59568.555737] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 21:56:34 juju-e4d256-prod-github-runner-207 kernel: [59568.557047] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 21:56:34 juju-e4d256-prod-github-runner-207 kernel: [59568.558311] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:56:34 juju-e4d256-prod-github-runner-207 kernel: [59568.559466] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 21:56:34 juju-e4d256-prod-github-runner-207 kernel: [59568.562082] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 21:56:34 juju-e4d256-prod-github-runner-207 kernel: [59568.563234] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 21:56:34 juju-e4d256-prod-github-runner-207 kernel: [59568.564485] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 21:56:34 juju-e4d256-prod-github-runner-207 kernel: [59568.565833] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 21:56:34 juju-e4d256-prod-github-runner-207 kernel: [59568.567278] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 21:56:34 juju-e4d256-prod-github-runner-207 kernel: [59568.568512] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 21:56:34 juju-e4d256-prod-github-runner-207 kernel: [59568.569689] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 21:56:34 juju-e4d256-prod-github-runner-207 kernel: [59568.570929] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 21:56:34 juju-e4d256-prod-github-runner-207 kernel: [59568.572065] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 21:56:34 juju-e4d256-prod-github-runner-207 kernel: [59568.573292] Call Trace: Aug 22 21:56:34 juju-e4d256-prod-github-runner-207 kernel: [59568.574428] Aug 22 21:56:34 juju-e4d256-prod-github-runner-207 kernel: [59568.575333] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:56:34 juju-e4d256-prod-github-runner-207 kernel: [59568.576368] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:56:34 juju-e4d256-prod-github-runner-207 kernel: [59568.577627] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:56:34 juju-e4d256-prod-github-runner-207 kernel: [59568.579017] ? show_regs.part.0+0x23/0x29 Aug 22 21:56:34 juju-e4d256-prod-github-runner-207 kernel: [59568.580041] ? show_regs.cold+0x8/0xd Aug 22 21:56:34 juju-e4d256-prod-github-runner-207 kernel: [59568.581034] ? watchdog_timer_fn+0x1be/0x220 Aug 22 21:56:34 juju-e4d256-prod-github-runner-207 kernel: [59568.582098] ? lockup_detector_update_enable+0x60/0x60 Aug 22 21:56:34 juju-e4d256-prod-github-runner-207 kernel: [59568.583254] ? __hrtimer_run_queues+0x107/0x230 Aug 22 21:56:34 juju-e4d256-prod-github-runner-207 kernel: [59568.584307] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 21:56:34 juju-e4d256-prod-github-runner-207 kernel: [59568.585351] ? hrtimer_interrupt+0x101/0x220 Aug 22 21:56:34 juju-e4d256-prod-github-runner-207 kernel: [59568.586370] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 21:56:34 juju-e4d256-prod-github-runner-207 kernel: [59568.587486] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 21:56:34 juju-e4d256-prod-github-runner-207 kernel: [59568.588589] Aug 22 21:56:34 juju-e4d256-prod-github-runner-207 kernel: [59568.589455] Aug 22 21:56:34 juju-e4d256-prod-github-runner-207 kernel: [59568.590298] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 21:56:34 juju-e4d256-prod-github-runner-207 kernel: [59568.591362] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:56:34 juju-e4d256-prod-github-runner-207 kernel: [59568.592419] ? _raw_spin_lock+0x22/0x30 Aug 22 21:56:34 juju-e4d256-prod-github-runner-207 kernel: [59568.593381] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:56:34 juju-e4d256-prod-github-runner-207 kernel: [59568.594535] direct_page_fault+0x206/0x310 [kvm] Aug 22 21:56:34 juju-e4d256-prod-github-runner-207 kernel: [59568.595617] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 21:56:34 juju-e4d256-prod-github-runner-207 kernel: [59568.596642] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 21:56:34 juju-e4d256-prod-github-runner-207 kernel: [59568.597792] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 21:56:34 juju-e4d256-prod-github-runner-207 kernel: [59568.598824] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 21:56:34 juju-e4d256-prod-github-runner-207 kernel: [59568.599811] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 21:56:34 juju-e4d256-prod-github-runner-207 kernel: [59568.600793] handle_exit+0x98/0x230 [kvm_amd] Aug 22 21:56:34 juju-e4d256-prod-github-runner-207 kernel: [59568.601694] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 21:56:34 juju-e4d256-prod-github-runner-207 kernel: [59568.602617] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 21:56:34 juju-e4d256-prod-github-runner-207 kernel: [59568.603580] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 21:56:34 juju-e4d256-prod-github-runner-207 kernel: [59568.604520] vcpu_run+0x62/0x2c0 [kvm] Aug 22 21:56:34 juju-e4d256-prod-github-runner-207 kernel: [59568.605350] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 21:56:34 juju-e4d256-prod-github-runner-207 kernel: [59568.606177] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 21:56:34 juju-e4d256-prod-github-runner-207 kernel: [59568.607057] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 21:56:34 juju-e4d256-prod-github-runner-207 kernel: [59568.607969] ? __seccomp_filter+0x4a/0x4a0 Aug 22 21:56:34 juju-e4d256-prod-github-runner-207 kernel: [59568.608796] ? __fget_files+0x86/0xc0 Aug 22 21:56:34 juju-e4d256-prod-github-runner-207 kernel: [59568.609575] __x64_sys_ioctl+0x95/0xd0 Aug 22 21:56:34 juju-e4d256-prod-github-runner-207 kernel: [59568.610300] do_syscall_64+0x5c/0xc0 Aug 22 21:56:34 juju-e4d256-prod-github-runner-207 kernel: [59568.610996] ? do_futex+0x162/0x1f0 Aug 22 21:56:34 juju-e4d256-prod-github-runner-207 kernel: [59568.611680] ? __x64_sys_futex+0x78/0x1e0 Aug 22 21:56:34 juju-e4d256-prod-github-runner-207 kernel: [59568.612413] ? __secure_computing+0xa9/0x120 Aug 22 21:56:34 juju-e4d256-prod-github-runner-207 kernel: [59568.613131] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 21:56:34 juju-e4d256-prod-github-runner-207 kernel: [59568.613913] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:56:34 juju-e4d256-prod-github-runner-207 kernel: [59568.614664] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:56:34 juju-e4d256-prod-github-runner-207 kernel: [59568.615455] ? do_syscall_64+0x69/0xc0 Aug 22 21:56:34 juju-e4d256-prod-github-runner-207 kernel: [59568.616116] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:56:34 juju-e4d256-prod-github-runner-207 kernel: [59568.616829] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:56:34 juju-e4d256-prod-github-runner-207 kernel: [59568.617531] ? do_syscall_64+0x69/0xc0 Aug 22 21:56:34 juju-e4d256-prod-github-runner-207 kernel: [59568.618162] ? do_syscall_64+0x69/0xc0 Aug 22 21:56:34 juju-e4d256-prod-github-runner-207 kernel: [59568.618810] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 21:56:34 juju-e4d256-prod-github-runner-207 kernel: [59568.619563] RIP: 0033:0x7faa5d0edaff Aug 22 21:56:34 juju-e4d256-prod-github-runner-207 kernel: [59568.620227] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 21:56:34 juju-e4d256-prod-github-runner-207 kernel: [59568.622241] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 21:56:34 juju-e4d256-prod-github-runner-207 kernel: [59568.623184] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 21:56:34 juju-e4d256-prod-github-runner-207 kernel: [59568.624161] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 21:56:34 juju-e4d256-prod-github-runner-207 kernel: [59568.625103] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 21:56:34 juju-e4d256-prod-github-runner-207 kernel: [59568.626002] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 21:56:34 juju-e4d256-prod-github-runner-207 kernel: [59568.626892] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 21:56:34 juju-e4d256-prod-github-runner-207 kernel: [59568.627839] Aug 22 21:56:47 juju-e4d256-prod-github-runner-207 kernel: [59581.160706] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 21:56:47 juju-e4d256-prod-github-runner-207 kernel: [59581.161678] rcu: 1-....: (14819188 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=7160522 Aug 22 21:56:47 juju-e4d256-prod-github-runner-207 kernel: [59581.162799] (t=14865990 jiffies g=23269 q=53661) Aug 22 21:56:47 juju-e4d256-prod-github-runner-207 kernel: [59581.163605] NMI backtrace for cpu 1 Aug 22 21:56:47 juju-e4d256-prod-github-runner-207 kernel: [59581.164314] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 21:56:47 juju-e4d256-prod-github-runner-207 kernel: [59581.165426] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 21:56:47 juju-e4d256-prod-github-runner-207 kernel: [59581.166491] Call Trace: Aug 22 21:56:47 juju-e4d256-prod-github-runner-207 kernel: [59581.167198] Aug 22 21:56:47 juju-e4d256-prod-github-runner-207 kernel: [59581.167844] show_stack+0x52/0x5c Aug 22 21:56:47 juju-e4d256-prod-github-runner-207 kernel: [59581.168572] dump_stack_lvl+0x4a/0x63 Aug 22 21:56:47 juju-e4d256-prod-github-runner-207 kernel: [59581.169326] dump_stack+0x10/0x16 Aug 22 21:56:47 juju-e4d256-prod-github-runner-207 kernel: [59581.170042] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 21:56:47 juju-e4d256-prod-github-runner-207 kernel: [59581.170819] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 21:56:47 juju-e4d256-prod-github-runner-207 kernel: [59581.171612] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 21:56:47 juju-e4d256-prod-github-runner-207 kernel: [59581.172525] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 21:56:47 juju-e4d256-prod-github-runner-207 kernel: [59581.173659] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 21:56:47 juju-e4d256-prod-github-runner-207 kernel: [59581.174464] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 21:56:47 juju-e4d256-prod-github-runner-207 kernel: [59581.175275] print_cpu_stall.cold+0x2f/0xe2 Aug 22 21:56:47 juju-e4d256-prod-github-runner-207 kernel: [59581.176041] ? timekeeping_update+0xf7/0x150 Aug 22 21:56:47 juju-e4d256-prod-github-runner-207 kernel: [59581.176814] check_cpu_stall+0x109/0x270 Aug 22 21:56:47 juju-e4d256-prod-github-runner-207 kernel: [59581.177563] rcu_sched_clock_irq+0x9a/0x250 Aug 22 21:56:47 juju-e4d256-prod-github-runner-207 kernel: [59581.178323] update_process_times+0x94/0xd0 Aug 22 21:56:47 juju-e4d256-prod-github-runner-207 kernel: [59581.179092] tick_sched_handle+0x29/0x70 Aug 22 21:56:47 juju-e4d256-prod-github-runner-207 kernel: [59581.179835] tick_sched_timer+0x8c/0xc0 Aug 22 21:56:47 juju-e4d256-prod-github-runner-207 kernel: [59581.180570] ? tick_nohz_handler+0xb0/0xb0 Aug 22 21:56:47 juju-e4d256-prod-github-runner-207 kernel: [59581.181329] __hrtimer_run_queues+0x107/0x230 Aug 22 21:56:47 juju-e4d256-prod-github-runner-207 kernel: [59581.182098] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 21:56:47 juju-e4d256-prod-github-runner-207 kernel: [59581.182872] hrtimer_interrupt+0x101/0x220 Aug 22 21:56:47 juju-e4d256-prod-github-runner-207 kernel: [59581.183643] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 21:56:47 juju-e4d256-prod-github-runner-207 kernel: [59581.184452] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 21:56:47 juju-e4d256-prod-github-runner-207 kernel: [59581.185257] Aug 22 21:56:47 juju-e4d256-prod-github-runner-207 kernel: [59581.185889] Aug 22 21:56:47 juju-e4d256-prod-github-runner-207 kernel: [59581.186515] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 21:56:47 juju-e4d256-prod-github-runner-207 kernel: [59581.187343] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:56:47 juju-e4d256-prod-github-runner-207 kernel: [59581.188223] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 21:56:47 juju-e4d256-prod-github-runner-207 kernel: [59581.190427] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 21:56:47 juju-e4d256-prod-github-runner-207 kernel: [59581.191319] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 21:56:47 juju-e4d256-prod-github-runner-207 kernel: [59581.192310] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 21:56:47 juju-e4d256-prod-github-runner-207 kernel: [59581.193285] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 21:56:47 juju-e4d256-prod-github-runner-207 kernel: [59581.194393] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 21:56:47 juju-e4d256-prod-github-runner-207 kernel: [59581.195451] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 21:56:47 juju-e4d256-prod-github-runner-207 kernel: [59581.196407] ? _raw_spin_lock+0x22/0x30 Aug 22 21:56:47 juju-e4d256-prod-github-runner-207 kernel: [59581.197181] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:56:47 juju-e4d256-prod-github-runner-207 kernel: [59581.198037] direct_page_fault+0x206/0x310 [kvm] Aug 22 21:56:47 juju-e4d256-prod-github-runner-207 kernel: [59581.198889] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 21:56:47 juju-e4d256-prod-github-runner-207 kernel: [59581.199749] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 21:56:47 juju-e4d256-prod-github-runner-207 kernel: [59581.200586] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 21:56:47 juju-e4d256-prod-github-runner-207 kernel: [59581.201392] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 21:56:47 juju-e4d256-prod-github-runner-207 kernel: [59581.202178] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 21:56:47 juju-e4d256-prod-github-runner-207 kernel: [59581.203013] handle_exit+0x98/0x230 [kvm_amd] Aug 22 21:56:47 juju-e4d256-prod-github-runner-207 kernel: [59581.203774] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 21:56:47 juju-e4d256-prod-github-runner-207 kernel: [59581.204557] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 21:56:47 juju-e4d256-prod-github-runner-207 kernel: [59581.205356] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 21:56:47 juju-e4d256-prod-github-runner-207 kernel: [59581.206140] vcpu_run+0x62/0x2c0 [kvm] Aug 22 21:56:47 juju-e4d256-prod-github-runner-207 kernel: [59581.206859] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 21:56:47 juju-e4d256-prod-github-runner-207 kernel: [59581.207609] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 21:56:47 juju-e4d256-prod-github-runner-207 kernel: [59581.208408] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 21:56:47 juju-e4d256-prod-github-runner-207 kernel: [59581.209170] ? __seccomp_filter+0x4a/0x4a0 Aug 22 21:56:47 juju-e4d256-prod-github-runner-207 kernel: [59581.209887] ? __fget_files+0x86/0xc0 Aug 22 21:56:47 juju-e4d256-prod-github-runner-207 kernel: [59581.210584] __x64_sys_ioctl+0x95/0xd0 Aug 22 21:56:47 juju-e4d256-prod-github-runner-207 kernel: [59581.211293] do_syscall_64+0x5c/0xc0 Aug 22 21:56:47 juju-e4d256-prod-github-runner-207 kernel: [59581.211989] ? do_futex+0x162/0x1f0 Aug 22 21:56:47 juju-e4d256-prod-github-runner-207 kernel: [59581.212956] ? __x64_sys_futex+0x78/0x1e0 Aug 22 21:56:47 juju-e4d256-prod-github-runner-207 kernel: [59581.213665] ? __secure_computing+0xa9/0x120 Aug 22 21:56:47 juju-e4d256-prod-github-runner-207 kernel: [59581.214391] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 21:56:47 juju-e4d256-prod-github-runner-207 kernel: [59581.215205] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:56:47 juju-e4d256-prod-github-runner-207 kernel: [59581.215998] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:56:47 juju-e4d256-prod-github-runner-207 kernel: [59581.216874] ? do_syscall_64+0x69/0xc0 Aug 22 21:56:47 juju-e4d256-prod-github-runner-207 kernel: [59581.217617] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:56:47 juju-e4d256-prod-github-runner-207 kernel: [59581.218499] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:56:47 juju-e4d256-prod-github-runner-207 kernel: [59581.219282] ? do_syscall_64+0x69/0xc0 Aug 22 21:56:47 juju-e4d256-prod-github-runner-207 kernel: [59581.220001] ? do_syscall_64+0x69/0xc0 Aug 22 21:56:47 juju-e4d256-prod-github-runner-207 kernel: [59581.220904] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 21:56:47 juju-e4d256-prod-github-runner-207 kernel: [59581.221681] RIP: 0033:0x7faa5d0edaff Aug 22 21:56:47 juju-e4d256-prod-github-runner-207 kernel: [59581.222386] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 21:56:47 juju-e4d256-prod-github-runner-207 kernel: [59581.224497] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 21:56:47 juju-e4d256-prod-github-runner-207 kernel: [59581.225483] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 21:56:47 juju-e4d256-prod-github-runner-207 kernel: [59581.226432] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 21:56:47 juju-e4d256-prod-github-runner-207 kernel: [59581.227382] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 21:56:47 juju-e4d256-prod-github-runner-207 kernel: [59581.228326] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 21:56:47 juju-e4d256-prod-github-runner-207 kernel: [59581.229252] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 21:56:47 juju-e4d256-prod-github-runner-207 kernel: [59581.230165] Aug 22 21:57:14 juju-e4d256-prod-github-runner-207 kernel: [59608.541980] watchdog: BUG: soft lockup - CPU#1 stuck for 55406s! [qemu-system-x86:6715] Aug 22 21:57:14 juju-e4d256-prod-github-runner-207 kernel: [59608.543146] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 21:57:14 juju-e4d256-prod-github-runner-207 kernel: [59608.543218] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 21:57:14 juju-e4d256-prod-github-runner-207 kernel: [59608.555766] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 21:57:14 juju-e4d256-prod-github-runner-207 kernel: [59608.557054] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 21:57:14 juju-e4d256-prod-github-runner-207 kernel: [59608.558500] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:57:14 juju-e4d256-prod-github-runner-207 kernel: [59608.559816] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 21:57:14 juju-e4d256-prod-github-runner-207 kernel: [59608.562468] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 21:57:14 juju-e4d256-prod-github-runner-207 kernel: [59608.563629] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 21:57:14 juju-e4d256-prod-github-runner-207 kernel: [59608.564823] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 21:57:14 juju-e4d256-prod-github-runner-207 kernel: [59608.566004] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 21:57:14 juju-e4d256-prod-github-runner-207 kernel: [59608.567203] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 21:57:14 juju-e4d256-prod-github-runner-207 kernel: [59608.568443] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 21:57:14 juju-e4d256-prod-github-runner-207 kernel: [59608.569654] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 21:57:14 juju-e4d256-prod-github-runner-207 kernel: [59608.571224] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 21:57:14 juju-e4d256-prod-github-runner-207 kernel: [59608.572385] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 21:57:14 juju-e4d256-prod-github-runner-207 kernel: [59608.573631] Call Trace: Aug 22 21:57:14 juju-e4d256-prod-github-runner-207 kernel: [59608.574578] Aug 22 21:57:14 juju-e4d256-prod-github-runner-207 kernel: [59608.575526] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:57:14 juju-e4d256-prod-github-runner-207 kernel: [59608.576751] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:57:14 juju-e4d256-prod-github-runner-207 kernel: [59608.577812] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:57:14 juju-e4d256-prod-github-runner-207 kernel: [59608.578968] ? show_regs.part.0+0x23/0x29 Aug 22 21:57:14 juju-e4d256-prod-github-runner-207 kernel: [59608.580009] ? show_regs.cold+0x8/0xd Aug 22 21:57:14 juju-e4d256-prod-github-runner-207 kernel: [59608.581200] ? watchdog_timer_fn+0x1be/0x220 Aug 22 21:57:14 juju-e4d256-prod-github-runner-207 kernel: [59608.582260] ? lockup_detector_update_enable+0x60/0x60 Aug 22 21:57:14 juju-e4d256-prod-github-runner-207 kernel: [59608.583419] ? __hrtimer_run_queues+0x107/0x230 Aug 22 21:57:14 juju-e4d256-prod-github-runner-207 kernel: [59608.584711] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 21:57:14 juju-e4d256-prod-github-runner-207 kernel: [59608.585779] ? hrtimer_interrupt+0x101/0x220 Aug 22 21:57:14 juju-e4d256-prod-github-runner-207 kernel: [59608.586821] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 21:57:14 juju-e4d256-prod-github-runner-207 kernel: [59608.587906] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 21:57:14 juju-e4d256-prod-github-runner-207 kernel: [59608.588978] Aug 22 21:57:14 juju-e4d256-prod-github-runner-207 kernel: [59608.589872] Aug 22 21:57:14 juju-e4d256-prod-github-runner-207 kernel: [59608.590742] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 21:57:14 juju-e4d256-prod-github-runner-207 kernel: [59608.591804] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:57:14 juju-e4d256-prod-github-runner-207 kernel: [59608.592864] ? _raw_spin_lock+0x22/0x30 Aug 22 21:57:14 juju-e4d256-prod-github-runner-207 kernel: [59608.593858] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:57:14 juju-e4d256-prod-github-runner-207 kernel: [59608.594995] direct_page_fault+0x206/0x310 [kvm] Aug 22 21:57:14 juju-e4d256-prod-github-runner-207 kernel: [59608.596070] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 21:57:14 juju-e4d256-prod-github-runner-207 kernel: [59608.597102] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 21:57:14 juju-e4d256-prod-github-runner-207 kernel: [59608.598176] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 21:57:14 juju-e4d256-prod-github-runner-207 kernel: [59608.599300] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 21:57:14 juju-e4d256-prod-github-runner-207 kernel: [59608.600332] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 21:57:14 juju-e4d256-prod-github-runner-207 kernel: [59608.601483] handle_exit+0x98/0x230 [kvm_amd] Aug 22 21:57:14 juju-e4d256-prod-github-runner-207 kernel: [59608.602544] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 21:57:14 juju-e4d256-prod-github-runner-207 kernel: [59608.603536] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 21:57:14 juju-e4d256-prod-github-runner-207 kernel: [59608.604579] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 21:57:14 juju-e4d256-prod-github-runner-207 kernel: [59608.605560] vcpu_run+0x62/0x2c0 [kvm] Aug 22 21:57:14 juju-e4d256-prod-github-runner-207 kernel: [59608.606439] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 21:57:14 juju-e4d256-prod-github-runner-207 kernel: [59608.607306] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 21:57:14 juju-e4d256-prod-github-runner-207 kernel: [59608.608184] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 21:57:14 juju-e4d256-prod-github-runner-207 kernel: [59608.609031] ? __seccomp_filter+0x4a/0x4a0 Aug 22 21:57:14 juju-e4d256-prod-github-runner-207 kernel: [59608.609793] ? __fget_files+0x86/0xc0 Aug 22 21:57:14 juju-e4d256-prod-github-runner-207 kernel: [59608.610530] __x64_sys_ioctl+0x95/0xd0 Aug 22 21:57:14 juju-e4d256-prod-github-runner-207 kernel: [59608.611274] do_syscall_64+0x5c/0xc0 Aug 22 21:57:14 juju-e4d256-prod-github-runner-207 kernel: [59608.611963] ? do_futex+0x162/0x1f0 Aug 22 21:57:14 juju-e4d256-prod-github-runner-207 kernel: [59608.612636] ? __x64_sys_futex+0x78/0x1e0 Aug 22 21:57:14 juju-e4d256-prod-github-runner-207 kernel: [59608.613330] ? __secure_computing+0xa9/0x120 Aug 22 21:57:14 juju-e4d256-prod-github-runner-207 kernel: [59608.614035] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 21:57:14 juju-e4d256-prod-github-runner-207 kernel: [59608.614838] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:57:14 juju-e4d256-prod-github-runner-207 kernel: [59608.615588] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:57:14 juju-e4d256-prod-github-runner-207 kernel: [59608.616341] ? do_syscall_64+0x69/0xc0 Aug 22 21:57:14 juju-e4d256-prod-github-runner-207 kernel: [59608.617010] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:57:14 juju-e4d256-prod-github-runner-207 kernel: [59608.617736] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:57:14 juju-e4d256-prod-github-runner-207 kernel: [59608.618452] ? do_syscall_64+0x69/0xc0 Aug 22 21:57:14 juju-e4d256-prod-github-runner-207 kernel: [59608.619109] ? do_syscall_64+0x69/0xc0 Aug 22 21:57:14 juju-e4d256-prod-github-runner-207 kernel: [59608.619751] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 21:57:14 juju-e4d256-prod-github-runner-207 kernel: [59608.620480] RIP: 0033:0x7faa5d0edaff Aug 22 21:57:14 juju-e4d256-prod-github-runner-207 kernel: [59608.621119] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 21:57:14 juju-e4d256-prod-github-runner-207 kernel: [59608.623171] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 21:57:14 juju-e4d256-prod-github-runner-207 kernel: [59608.624103] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 21:57:14 juju-e4d256-prod-github-runner-207 kernel: [59608.625030] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 21:57:14 juju-e4d256-prod-github-runner-207 kernel: [59608.625954] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 21:57:14 juju-e4d256-prod-github-runner-207 kernel: [59608.626889] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 21:57:14 juju-e4d256-prod-github-runner-207 kernel: [59608.627807] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 21:57:14 juju-e4d256-prod-github-runner-207 kernel: [59608.628729] Aug 22 21:57:42 juju-e4d256-prod-github-runner-207 kernel: [59636.541980] watchdog: BUG: soft lockup - CPU#1 stuck for 55432s! [qemu-system-x86:6715] Aug 22 21:57:42 juju-e4d256-prod-github-runner-207 kernel: [59636.544005] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 21:57:42 juju-e4d256-prod-github-runner-207 kernel: [59636.544298] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 21:57:42 juju-e4d256-prod-github-runner-207 kernel: [59636.557401] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 21:57:42 juju-e4d256-prod-github-runner-207 kernel: [59636.558846] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 21:57:42 juju-e4d256-prod-github-runner-207 kernel: [59636.560083] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:57:42 juju-e4d256-prod-github-runner-207 kernel: [59636.561175] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 21:57:42 juju-e4d256-prod-github-runner-207 kernel: [59636.563811] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 21:57:42 juju-e4d256-prod-github-runner-207 kernel: [59636.564864] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 21:57:42 juju-e4d256-prod-github-runner-207 kernel: [59636.566034] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 21:57:42 juju-e4d256-prod-github-runner-207 kernel: [59636.567244] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 21:57:42 juju-e4d256-prod-github-runner-207 kernel: [59636.568422] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 21:57:42 juju-e4d256-prod-github-runner-207 kernel: [59636.569588] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 21:57:42 juju-e4d256-prod-github-runner-207 kernel: [59636.570816] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 21:57:42 juju-e4d256-prod-github-runner-207 kernel: [59636.572068] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 21:57:42 juju-e4d256-prod-github-runner-207 kernel: [59636.573181] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 21:57:42 juju-e4d256-prod-github-runner-207 kernel: [59636.574415] Call Trace: Aug 22 21:57:42 juju-e4d256-prod-github-runner-207 kernel: [59636.575332] Aug 22 21:57:42 juju-e4d256-prod-github-runner-207 kernel: [59636.576241] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:57:42 juju-e4d256-prod-github-runner-207 kernel: [59636.577467] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:57:42 juju-e4d256-prod-github-runner-207 kernel: [59636.578549] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:57:42 juju-e4d256-prod-github-runner-207 kernel: [59636.579662] ? show_regs.part.0+0x23/0x29 Aug 22 21:57:42 juju-e4d256-prod-github-runner-207 kernel: [59636.580678] ? show_regs.cold+0x8/0xd Aug 22 21:57:42 juju-e4d256-prod-github-runner-207 kernel: [59636.581671] ? watchdog_timer_fn+0x1be/0x220 Aug 22 21:57:42 juju-e4d256-prod-github-runner-207 kernel: [59636.582707] ? lockup_detector_update_enable+0x60/0x60 Aug 22 21:57:42 juju-e4d256-prod-github-runner-207 kernel: [59636.583826] ? __hrtimer_run_queues+0x107/0x230 Aug 22 21:57:42 juju-e4d256-prod-github-runner-207 kernel: [59636.584882] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 21:57:42 juju-e4d256-prod-github-runner-207 kernel: [59636.585966] ? hrtimer_interrupt+0x101/0x220 Aug 22 21:57:42 juju-e4d256-prod-github-runner-207 kernel: [59636.587037] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 21:57:42 juju-e4d256-prod-github-runner-207 kernel: [59636.588153] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 21:57:42 juju-e4d256-prod-github-runner-207 kernel: [59636.589240] Aug 22 21:57:42 juju-e4d256-prod-github-runner-207 kernel: [59636.590115] Aug 22 21:57:42 juju-e4d256-prod-github-runner-207 kernel: [59636.591045] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 21:57:42 juju-e4d256-prod-github-runner-207 kernel: [59636.592486] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:57:42 juju-e4d256-prod-github-runner-207 kernel: [59636.593671] ? _raw_spin_lock+0x22/0x30 Aug 22 21:57:42 juju-e4d256-prod-github-runner-207 kernel: [59636.594746] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:57:42 juju-e4d256-prod-github-runner-207 kernel: [59636.595854] direct_page_fault+0x206/0x310 [kvm] Aug 22 21:57:42 juju-e4d256-prod-github-runner-207 kernel: [59636.596937] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 21:57:42 juju-e4d256-prod-github-runner-207 kernel: [59636.597958] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 21:57:42 juju-e4d256-prod-github-runner-207 kernel: [59636.598992] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 21:57:42 juju-e4d256-prod-github-runner-207 kernel: [59636.600073] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 21:57:42 juju-e4d256-prod-github-runner-207 kernel: [59636.601041] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 21:57:42 juju-e4d256-prod-github-runner-207 kernel: [59636.602048] handle_exit+0x98/0x230 [kvm_amd] Aug 22 21:57:42 juju-e4d256-prod-github-runner-207 kernel: [59636.603006] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 21:57:42 juju-e4d256-prod-github-runner-207 kernel: [59636.603949] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 21:57:42 juju-e4d256-prod-github-runner-207 kernel: [59636.604891] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 21:57:42 juju-e4d256-prod-github-runner-207 kernel: [59636.605803] vcpu_run+0x62/0x2c0 [kvm] Aug 22 21:57:42 juju-e4d256-prod-github-runner-207 kernel: [59636.606646] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 21:57:42 juju-e4d256-prod-github-runner-207 kernel: [59636.607460] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 21:57:42 juju-e4d256-prod-github-runner-207 kernel: [59636.608325] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 21:57:42 juju-e4d256-prod-github-runner-207 kernel: [59636.609186] ? __seccomp_filter+0x4a/0x4a0 Aug 22 21:57:42 juju-e4d256-prod-github-runner-207 kernel: [59636.609963] ? __fget_files+0x86/0xc0 Aug 22 21:57:42 juju-e4d256-prod-github-runner-207 kernel: [59636.610705] __x64_sys_ioctl+0x95/0xd0 Aug 22 21:57:42 juju-e4d256-prod-github-runner-207 kernel: [59636.611433] do_syscall_64+0x5c/0xc0 Aug 22 21:57:42 juju-e4d256-prod-github-runner-207 kernel: [59636.612112] ? do_futex+0x162/0x1f0 Aug 22 21:57:42 juju-e4d256-prod-github-runner-207 kernel: [59636.612766] ? __x64_sys_futex+0x78/0x1e0 Aug 22 21:57:42 juju-e4d256-prod-github-runner-207 kernel: [59636.613504] ? __secure_computing+0xa9/0x120 Aug 22 21:57:42 juju-e4d256-prod-github-runner-207 kernel: [59636.614217] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 21:57:42 juju-e4d256-prod-github-runner-207 kernel: [59636.615101] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:57:42 juju-e4d256-prod-github-runner-207 kernel: [59636.615936] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:57:42 juju-e4d256-prod-github-runner-207 kernel: [59636.616684] ? do_syscall_64+0x69/0xc0 Aug 22 21:57:42 juju-e4d256-prod-github-runner-207 kernel: [59636.617348] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:57:42 juju-e4d256-prod-github-runner-207 kernel: [59636.618104] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:57:42 juju-e4d256-prod-github-runner-207 kernel: [59636.618849] ? do_syscall_64+0x69/0xc0 Aug 22 21:57:42 juju-e4d256-prod-github-runner-207 kernel: [59636.619477] ? do_syscall_64+0x69/0xc0 Aug 22 21:57:42 juju-e4d256-prod-github-runner-207 kernel: [59636.620111] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 21:57:42 juju-e4d256-prod-github-runner-207 kernel: [59636.620850] RIP: 0033:0x7faa5d0edaff Aug 22 21:57:42 juju-e4d256-prod-github-runner-207 kernel: [59636.621694] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 21:57:42 juju-e4d256-prod-github-runner-207 kernel: [59636.623850] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 21:57:42 juju-e4d256-prod-github-runner-207 kernel: [59636.624773] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 21:57:42 juju-e4d256-prod-github-runner-207 kernel: [59636.625666] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 21:57:42 juju-e4d256-prod-github-runner-207 kernel: [59636.626603] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 21:57:42 juju-e4d256-prod-github-runner-207 kernel: [59636.627595] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 21:57:42 juju-e4d256-prod-github-runner-207 kernel: [59636.628542] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 21:57:42 juju-e4d256-prod-github-runner-207 kernel: [59636.629492] Aug 22 21:58:10 juju-e4d256-prod-github-runner-207 kernel: [59664.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 55458s! [qemu-system-x86:6715] Aug 22 21:58:10 juju-e4d256-prod-github-runner-207 kernel: [59664.543096] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 21:58:10 juju-e4d256-prod-github-runner-207 kernel: [59664.543169] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 21:58:10 juju-e4d256-prod-github-runner-207 kernel: [59664.555518] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 21:58:10 juju-e4d256-prod-github-runner-207 kernel: [59664.556799] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 21:58:10 juju-e4d256-prod-github-runner-207 kernel: [59664.558036] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:58:10 juju-e4d256-prod-github-runner-207 kernel: [59664.559488] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 21:58:10 juju-e4d256-prod-github-runner-207 kernel: [59664.562160] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 21:58:10 juju-e4d256-prod-github-runner-207 kernel: [59664.563220] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 21:58:10 juju-e4d256-prod-github-runner-207 kernel: [59664.564404] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 21:58:10 juju-e4d256-prod-github-runner-207 kernel: [59664.565572] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 21:58:10 juju-e4d256-prod-github-runner-207 kernel: [59664.566755] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 21:58:10 juju-e4d256-prod-github-runner-207 kernel: [59664.567966] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 21:58:10 juju-e4d256-prod-github-runner-207 kernel: [59664.569175] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 21:58:10 juju-e4d256-prod-github-runner-207 kernel: [59664.570447] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 21:58:10 juju-e4d256-prod-github-runner-207 kernel: [59664.571562] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 21:58:10 juju-e4d256-prod-github-runner-207 kernel: [59664.572784] Call Trace: Aug 22 21:58:10 juju-e4d256-prod-github-runner-207 kernel: [59664.573711] Aug 22 21:58:10 juju-e4d256-prod-github-runner-207 kernel: [59664.574633] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:58:10 juju-e4d256-prod-github-runner-207 kernel: [59664.575680] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:58:10 juju-e4d256-prod-github-runner-207 kernel: [59664.576716] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:58:10 juju-e4d256-prod-github-runner-207 kernel: [59664.577831] ? show_regs.part.0+0x23/0x29 Aug 22 21:58:10 juju-e4d256-prod-github-runner-207 kernel: [59664.578861] ? show_regs.cold+0x8/0xd Aug 22 21:58:10 juju-e4d256-prod-github-runner-207 kernel: [59664.579887] ? watchdog_timer_fn+0x1be/0x220 Aug 22 21:58:10 juju-e4d256-prod-github-runner-207 kernel: [59664.580920] ? lockup_detector_update_enable+0x60/0x60 Aug 22 21:58:10 juju-e4d256-prod-github-runner-207 kernel: [59664.582012] ? __hrtimer_run_queues+0x107/0x230 Aug 22 21:58:10 juju-e4d256-prod-github-runner-207 kernel: [59664.583046] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 21:58:10 juju-e4d256-prod-github-runner-207 kernel: [59664.584074] ? hrtimer_interrupt+0x101/0x220 Aug 22 21:58:10 juju-e4d256-prod-github-runner-207 kernel: [59664.585156] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 21:58:10 juju-e4d256-prod-github-runner-207 kernel: [59664.586263] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 21:58:10 juju-e4d256-prod-github-runner-207 kernel: [59664.587317] Aug 22 21:58:10 juju-e4d256-prod-github-runner-207 kernel: [59664.588185] Aug 22 21:58:10 juju-e4d256-prod-github-runner-207 kernel: [59664.589040] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 21:58:10 juju-e4d256-prod-github-runner-207 kernel: [59664.590112] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:58:10 juju-e4d256-prod-github-runner-207 kernel: [59664.591187] ? _raw_spin_lock+0x22/0x30 Aug 22 21:58:10 juju-e4d256-prod-github-runner-207 kernel: [59664.592139] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:58:10 juju-e4d256-prod-github-runner-207 kernel: [59664.593169] direct_page_fault+0x206/0x310 [kvm] Aug 22 21:58:10 juju-e4d256-prod-github-runner-207 kernel: [59664.594245] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 21:58:10 juju-e4d256-prod-github-runner-207 kernel: [59664.595274] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 21:58:10 juju-e4d256-prod-github-runner-207 kernel: [59664.596313] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 21:58:10 juju-e4d256-prod-github-runner-207 kernel: [59664.597300] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 21:58:10 juju-e4d256-prod-github-runner-207 kernel: [59664.598304] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 21:58:10 juju-e4d256-prod-github-runner-207 kernel: [59664.599363] handle_exit+0x98/0x230 [kvm_amd] Aug 22 21:58:10 juju-e4d256-prod-github-runner-207 kernel: [59664.600284] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 21:58:10 juju-e4d256-prod-github-runner-207 kernel: [59664.601237] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 21:58:10 juju-e4d256-prod-github-runner-207 kernel: [59664.602268] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 21:58:10 juju-e4d256-prod-github-runner-207 kernel: [59664.603239] vcpu_run+0x62/0x2c0 [kvm] Aug 22 21:58:10 juju-e4d256-prod-github-runner-207 kernel: [59664.604079] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 21:58:10 juju-e4d256-prod-github-runner-207 kernel: [59664.604891] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 21:58:10 juju-e4d256-prod-github-runner-207 kernel: [59664.605812] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 21:58:10 juju-e4d256-prod-github-runner-207 kernel: [59664.606642] ? __seccomp_filter+0x4a/0x4a0 Aug 22 21:58:10 juju-e4d256-prod-github-runner-207 kernel: [59664.607388] ? __fget_files+0x86/0xc0 Aug 22 21:58:10 juju-e4d256-prod-github-runner-207 kernel: [59664.608100] __x64_sys_ioctl+0x95/0xd0 Aug 22 21:58:10 juju-e4d256-prod-github-runner-207 kernel: [59664.608795] do_syscall_64+0x5c/0xc0 Aug 22 21:58:10 juju-e4d256-prod-github-runner-207 kernel: [59664.609477] ? do_futex+0x162/0x1f0 Aug 22 21:58:10 juju-e4d256-prod-github-runner-207 kernel: [59664.610240] ? __x64_sys_futex+0x78/0x1e0 Aug 22 21:58:10 juju-e4d256-prod-github-runner-207 kernel: [59664.611163] ? __secure_computing+0xa9/0x120 Aug 22 21:58:10 juju-e4d256-prod-github-runner-207 kernel: [59664.612076] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 21:58:10 juju-e4d256-prod-github-runner-207 kernel: [59664.613114] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:58:10 juju-e4d256-prod-github-runner-207 kernel: [59664.614062] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:58:10 juju-e4d256-prod-github-runner-207 kernel: [59664.614816] ? do_syscall_64+0x69/0xc0 Aug 22 21:58:10 juju-e4d256-prod-github-runner-207 kernel: [59664.615480] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:58:10 juju-e4d256-prod-github-runner-207 kernel: [59664.616191] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:58:10 juju-e4d256-prod-github-runner-207 kernel: [59664.616930] ? do_syscall_64+0x69/0xc0 Aug 22 21:58:10 juju-e4d256-prod-github-runner-207 kernel: [59664.617585] ? do_syscall_64+0x69/0xc0 Aug 22 21:58:10 juju-e4d256-prod-github-runner-207 kernel: [59664.618246] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 21:58:10 juju-e4d256-prod-github-runner-207 kernel: [59664.618966] RIP: 0033:0x7faa5d0edaff Aug 22 21:58:10 juju-e4d256-prod-github-runner-207 kernel: [59664.619595] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 21:58:10 juju-e4d256-prod-github-runner-207 kernel: [59664.621615] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 21:58:10 juju-e4d256-prod-github-runner-207 kernel: [59664.622567] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 21:58:10 juju-e4d256-prod-github-runner-207 kernel: [59664.623494] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 21:58:10 juju-e4d256-prod-github-runner-207 kernel: [59664.624464] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 21:58:10 juju-e4d256-prod-github-runner-207 kernel: [59664.625431] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 21:58:10 juju-e4d256-prod-github-runner-207 kernel: [59664.626533] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 21:58:10 juju-e4d256-prod-github-runner-207 kernel: [59664.627464] Aug 22 21:58:38 juju-e4d256-prod-github-runner-207 kernel: [59692.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 55485s! [qemu-system-x86:6715] Aug 22 21:58:38 juju-e4d256-prod-github-runner-207 kernel: [59692.543116] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 21:58:38 juju-e4d256-prod-github-runner-207 kernel: [59692.543192] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 21:58:38 juju-e4d256-prod-github-runner-207 kernel: [59692.555678] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 21:58:38 juju-e4d256-prod-github-runner-207 kernel: [59692.557022] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 21:58:38 juju-e4d256-prod-github-runner-207 kernel: [59692.558291] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:58:38 juju-e4d256-prod-github-runner-207 kernel: [59692.559354] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 21:58:38 juju-e4d256-prod-github-runner-207 kernel: [59692.561975] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 21:58:38 juju-e4d256-prod-github-runner-207 kernel: [59692.563040] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 21:58:38 juju-e4d256-prod-github-runner-207 kernel: [59692.564230] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 21:58:38 juju-e4d256-prod-github-runner-207 kernel: [59692.565440] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 21:58:38 juju-e4d256-prod-github-runner-207 kernel: [59692.566638] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 21:58:38 juju-e4d256-prod-github-runner-207 kernel: [59692.567823] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 21:58:38 juju-e4d256-prod-github-runner-207 kernel: [59692.569014] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 21:58:38 juju-e4d256-prod-github-runner-207 kernel: [59692.570336] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 21:58:38 juju-e4d256-prod-github-runner-207 kernel: [59692.571609] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 21:58:38 juju-e4d256-prod-github-runner-207 kernel: [59692.572820] Call Trace: Aug 22 21:58:38 juju-e4d256-prod-github-runner-207 kernel: [59692.573754] Aug 22 21:58:38 juju-e4d256-prod-github-runner-207 kernel: [59692.574645] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:58:38 juju-e4d256-prod-github-runner-207 kernel: [59692.575720] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:58:38 juju-e4d256-prod-github-runner-207 kernel: [59692.576766] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:58:38 juju-e4d256-prod-github-runner-207 kernel: [59692.577899] ? show_regs.part.0+0x23/0x29 Aug 22 21:58:38 juju-e4d256-prod-github-runner-207 kernel: [59692.578909] ? show_regs.cold+0x8/0xd Aug 22 21:58:38 juju-e4d256-prod-github-runner-207 kernel: [59692.579895] ? watchdog_timer_fn+0x1be/0x220 Aug 22 21:58:38 juju-e4d256-prod-github-runner-207 kernel: [59692.580968] ? lockup_detector_update_enable+0x60/0x60 Aug 22 21:58:38 juju-e4d256-prod-github-runner-207 kernel: [59692.582070] ? __hrtimer_run_queues+0x107/0x230 Aug 22 21:58:38 juju-e4d256-prod-github-runner-207 kernel: [59692.583113] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 21:58:38 juju-e4d256-prod-github-runner-207 kernel: [59692.584153] ? hrtimer_interrupt+0x101/0x220 Aug 22 21:58:38 juju-e4d256-prod-github-runner-207 kernel: [59692.585185] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 21:58:38 juju-e4d256-prod-github-runner-207 kernel: [59692.586307] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 21:58:38 juju-e4d256-prod-github-runner-207 kernel: [59692.587389] Aug 22 21:58:38 juju-e4d256-prod-github-runner-207 kernel: [59692.588248] Aug 22 21:58:38 juju-e4d256-prod-github-runner-207 kernel: [59692.589093] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 21:58:38 juju-e4d256-prod-github-runner-207 kernel: [59692.590181] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:58:38 juju-e4d256-prod-github-runner-207 kernel: [59692.591246] ? _raw_spin_lock+0x22/0x30 Aug 22 21:58:38 juju-e4d256-prod-github-runner-207 kernel: [59692.592205] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:58:38 juju-e4d256-prod-github-runner-207 kernel: [59692.593259] direct_page_fault+0x206/0x310 [kvm] Aug 22 21:58:38 juju-e4d256-prod-github-runner-207 kernel: [59692.594323] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 21:58:38 juju-e4d256-prod-github-runner-207 kernel: [59692.595413] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 21:58:38 juju-e4d256-prod-github-runner-207 kernel: [59692.596448] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 21:58:38 juju-e4d256-prod-github-runner-207 kernel: [59692.597446] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 21:58:38 juju-e4d256-prod-github-runner-207 kernel: [59692.598446] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 21:58:38 juju-e4d256-prod-github-runner-207 kernel: [59692.599448] handle_exit+0x98/0x230 [kvm_amd] Aug 22 21:58:38 juju-e4d256-prod-github-runner-207 kernel: [59692.600375] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 21:58:38 juju-e4d256-prod-github-runner-207 kernel: [59692.601387] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 21:58:38 juju-e4d256-prod-github-runner-207 kernel: [59692.602420] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 21:58:38 juju-e4d256-prod-github-runner-207 kernel: [59692.603345] vcpu_run+0x62/0x2c0 [kvm] Aug 22 21:58:38 juju-e4d256-prod-github-runner-207 kernel: [59692.604180] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 21:58:38 juju-e4d256-prod-github-runner-207 kernel: [59692.605020] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 21:58:38 juju-e4d256-prod-github-runner-207 kernel: [59692.605934] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 21:58:38 juju-e4d256-prod-github-runner-207 kernel: [59692.606750] ? __seccomp_filter+0x4a/0x4a0 Aug 22 21:58:38 juju-e4d256-prod-github-runner-207 kernel: [59692.607506] ? __fget_files+0x86/0xc0 Aug 22 21:58:38 juju-e4d256-prod-github-runner-207 kernel: [59692.608241] __x64_sys_ioctl+0x95/0xd0 Aug 22 21:58:38 juju-e4d256-prod-github-runner-207 kernel: [59692.609003] do_syscall_64+0x5c/0xc0 Aug 22 21:58:38 juju-e4d256-prod-github-runner-207 kernel: [59692.609724] ? do_futex+0x162/0x1f0 Aug 22 21:58:38 juju-e4d256-prod-github-runner-207 kernel: [59692.610434] ? __x64_sys_futex+0x78/0x1e0 Aug 22 21:58:38 juju-e4d256-prod-github-runner-207 kernel: [59692.611151] ? __secure_computing+0xa9/0x120 Aug 22 21:58:38 juju-e4d256-prod-github-runner-207 kernel: [59692.611862] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 21:58:38 juju-e4d256-prod-github-runner-207 kernel: [59692.612682] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:58:38 juju-e4d256-prod-github-runner-207 kernel: [59692.613442] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:58:38 juju-e4d256-prod-github-runner-207 kernel: [59692.614209] ? do_syscall_64+0x69/0xc0 Aug 22 21:58:38 juju-e4d256-prod-github-runner-207 kernel: [59692.614873] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:58:38 juju-e4d256-prod-github-runner-207 kernel: [59692.615597] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:58:38 juju-e4d256-prod-github-runner-207 kernel: [59692.616320] ? do_syscall_64+0x69/0xc0 Aug 22 21:58:38 juju-e4d256-prod-github-runner-207 kernel: [59692.616967] ? do_syscall_64+0x69/0xc0 Aug 22 21:58:38 juju-e4d256-prod-github-runner-207 kernel: [59692.617742] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 21:58:38 juju-e4d256-prod-github-runner-207 kernel: [59692.618494] RIP: 0033:0x7faa5d0edaff Aug 22 21:58:38 juju-e4d256-prod-github-runner-207 kernel: [59692.619140] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 21:58:38 juju-e4d256-prod-github-runner-207 kernel: [59692.621208] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 21:58:38 juju-e4d256-prod-github-runner-207 kernel: [59692.622177] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 21:58:38 juju-e4d256-prod-github-runner-207 kernel: [59692.623099] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 21:58:38 juju-e4d256-prod-github-runner-207 kernel: [59692.624013] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 21:58:38 juju-e4d256-prod-github-runner-207 kernel: [59692.624933] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 21:58:38 juju-e4d256-prod-github-runner-207 kernel: [59692.625872] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 21:58:38 juju-e4d256-prod-github-runner-207 kernel: [59692.626805] Aug 22 21:59:06 juju-e4d256-prod-github-runner-207 kernel: [59720.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 55511s! [qemu-system-x86:6715] Aug 22 21:59:06 juju-e4d256-prod-github-runner-207 kernel: [59720.543208] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 21:59:06 juju-e4d256-prod-github-runner-207 kernel: [59720.543459] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 21:59:06 juju-e4d256-prod-github-runner-207 kernel: [59720.555782] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 21:59:06 juju-e4d256-prod-github-runner-207 kernel: [59720.557062] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 21:59:06 juju-e4d256-prod-github-runner-207 kernel: [59720.558297] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:59:06 juju-e4d256-prod-github-runner-207 kernel: [59720.559353] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 21:59:06 juju-e4d256-prod-github-runner-207 kernel: [59720.561904] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 21:59:06 juju-e4d256-prod-github-runner-207 kernel: [59720.562944] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 21:59:06 juju-e4d256-prod-github-runner-207 kernel: [59720.564103] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 21:59:06 juju-e4d256-prod-github-runner-207 kernel: [59720.565272] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 21:59:06 juju-e4d256-prod-github-runner-207 kernel: [59720.566430] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 21:59:06 juju-e4d256-prod-github-runner-207 kernel: [59720.567590] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 21:59:06 juju-e4d256-prod-github-runner-207 kernel: [59720.568762] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 21:59:06 juju-e4d256-prod-github-runner-207 kernel: [59720.570183] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 21:59:06 juju-e4d256-prod-github-runner-207 kernel: [59720.571386] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 21:59:06 juju-e4d256-prod-github-runner-207 kernel: [59720.572590] Call Trace: Aug 22 21:59:06 juju-e4d256-prod-github-runner-207 kernel: [59720.573565] Aug 22 21:59:06 juju-e4d256-prod-github-runner-207 kernel: [59720.574450] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:59:06 juju-e4d256-prod-github-runner-207 kernel: [59720.575481] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:59:06 juju-e4d256-prod-github-runner-207 kernel: [59720.576502] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:59:06 juju-e4d256-prod-github-runner-207 kernel: [59720.577622] ? show_regs.part.0+0x23/0x29 Aug 22 21:59:06 juju-e4d256-prod-github-runner-207 kernel: [59720.578619] ? show_regs.cold+0x8/0xd Aug 22 21:59:06 juju-e4d256-prod-github-runner-207 kernel: [59720.579590] ? watchdog_timer_fn+0x1be/0x220 Aug 22 21:59:06 juju-e4d256-prod-github-runner-207 kernel: [59720.580599] ? lockup_detector_update_enable+0x60/0x60 Aug 22 21:59:06 juju-e4d256-prod-github-runner-207 kernel: [59720.581677] ? __hrtimer_run_queues+0x107/0x230 Aug 22 21:59:06 juju-e4d256-prod-github-runner-207 kernel: [59720.582746] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 21:59:06 juju-e4d256-prod-github-runner-207 kernel: [59720.583769] ? hrtimer_interrupt+0x101/0x220 Aug 22 21:59:06 juju-e4d256-prod-github-runner-207 kernel: [59720.584783] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 21:59:06 juju-e4d256-prod-github-runner-207 kernel: [59720.585864] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 21:59:06 juju-e4d256-prod-github-runner-207 kernel: [59720.586910] Aug 22 21:59:06 juju-e4d256-prod-github-runner-207 kernel: [59720.587767] Aug 22 21:59:06 juju-e4d256-prod-github-runner-207 kernel: [59720.588604] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 21:59:06 juju-e4d256-prod-github-runner-207 kernel: [59720.589658] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:59:06 juju-e4d256-prod-github-runner-207 kernel: [59720.590701] ? _raw_spin_lock+0x22/0x30 Aug 22 21:59:06 juju-e4d256-prod-github-runner-207 kernel: [59720.591657] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:59:06 juju-e4d256-prod-github-runner-207 kernel: [59720.592675] direct_page_fault+0x206/0x310 [kvm] Aug 22 21:59:06 juju-e4d256-prod-github-runner-207 kernel: [59720.593714] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 21:59:06 juju-e4d256-prod-github-runner-207 kernel: [59720.594733] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 21:59:06 juju-e4d256-prod-github-runner-207 kernel: [59720.595733] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 21:59:06 juju-e4d256-prod-github-runner-207 kernel: [59720.596728] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 21:59:06 juju-e4d256-prod-github-runner-207 kernel: [59720.597682] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 21:59:06 juju-e4d256-prod-github-runner-207 kernel: [59720.598659] handle_exit+0x98/0x230 [kvm_amd] Aug 22 21:59:06 juju-e4d256-prod-github-runner-207 kernel: [59720.599585] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 21:59:06 juju-e4d256-prod-github-runner-207 kernel: [59720.600768] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 21:59:06 juju-e4d256-prod-github-runner-207 kernel: [59720.601923] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 21:59:06 juju-e4d256-prod-github-runner-207 kernel: [59720.602841] vcpu_run+0x62/0x2c0 [kvm] Aug 22 21:59:06 juju-e4d256-prod-github-runner-207 kernel: [59720.603655] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 21:59:06 juju-e4d256-prod-github-runner-207 kernel: [59720.604469] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 21:59:06 juju-e4d256-prod-github-runner-207 kernel: [59720.605339] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 21:59:06 juju-e4d256-prod-github-runner-207 kernel: [59720.606139] ? __seccomp_filter+0x4a/0x4a0 Aug 22 21:59:06 juju-e4d256-prod-github-runner-207 kernel: [59720.606885] ? __fget_files+0x86/0xc0 Aug 22 21:59:06 juju-e4d256-prod-github-runner-207 kernel: [59720.607595] __x64_sys_ioctl+0x95/0xd0 Aug 22 21:59:06 juju-e4d256-prod-github-runner-207 kernel: [59720.608288] do_syscall_64+0x5c/0xc0 Aug 22 21:59:06 juju-e4d256-prod-github-runner-207 kernel: [59720.608954] ? do_futex+0x162/0x1f0 Aug 22 21:59:06 juju-e4d256-prod-github-runner-207 kernel: [59720.609622] ? __x64_sys_futex+0x78/0x1e0 Aug 22 21:59:06 juju-e4d256-prod-github-runner-207 kernel: [59720.610299] ? __secure_computing+0xa9/0x120 Aug 22 21:59:06 juju-e4d256-prod-github-runner-207 kernel: [59720.610991] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 21:59:06 juju-e4d256-prod-github-runner-207 kernel: [59720.611757] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:59:06 juju-e4d256-prod-github-runner-207 kernel: [59720.612584] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:59:06 juju-e4d256-prod-github-runner-207 kernel: [59720.613340] ? do_syscall_64+0x69/0xc0 Aug 22 21:59:06 juju-e4d256-prod-github-runner-207 kernel: [59720.613986] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:59:06 juju-e4d256-prod-github-runner-207 kernel: [59720.614691] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:59:06 juju-e4d256-prod-github-runner-207 kernel: [59720.615383] ? do_syscall_64+0x69/0xc0 Aug 22 21:59:06 juju-e4d256-prod-github-runner-207 kernel: [59720.616007] ? do_syscall_64+0x69/0xc0 Aug 22 21:59:06 juju-e4d256-prod-github-runner-207 kernel: [59720.616635] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 21:59:06 juju-e4d256-prod-github-runner-207 kernel: [59720.617358] RIP: 0033:0x7faa5d0edaff Aug 22 21:59:06 juju-e4d256-prod-github-runner-207 kernel: [59720.618045] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 21:59:06 juju-e4d256-prod-github-runner-207 kernel: [59720.620046] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 21:59:06 juju-e4d256-prod-github-runner-207 kernel: [59720.620962] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 21:59:06 juju-e4d256-prod-github-runner-207 kernel: [59720.621863] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 21:59:06 juju-e4d256-prod-github-runner-207 kernel: [59720.622756] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 21:59:06 juju-e4d256-prod-github-runner-207 kernel: [59720.623643] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 21:59:06 juju-e4d256-prod-github-runner-207 kernel: [59720.624530] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 21:59:06 juju-e4d256-prod-github-runner-207 kernel: [59720.625434] Aug 22 21:59:34 juju-e4d256-prod-github-runner-207 kernel: [59748.542111] watchdog: BUG: soft lockup - CPU#1 stuck for 55537s! [qemu-system-x86:6715] Aug 22 21:59:34 juju-e4d256-prod-github-runner-207 kernel: [59748.543944] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 21:59:34 juju-e4d256-prod-github-runner-207 kernel: [59748.544137] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 21:59:34 juju-e4d256-prod-github-runner-207 kernel: [59748.556397] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 21:59:34 juju-e4d256-prod-github-runner-207 kernel: [59748.557682] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 21:59:34 juju-e4d256-prod-github-runner-207 kernel: [59748.558900] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:59:34 juju-e4d256-prod-github-runner-207 kernel: [59748.559961] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 21:59:34 juju-e4d256-prod-github-runner-207 kernel: [59748.562595] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 21:59:34 juju-e4d256-prod-github-runner-207 kernel: [59748.563664] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 21:59:34 juju-e4d256-prod-github-runner-207 kernel: [59748.564826] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 21:59:34 juju-e4d256-prod-github-runner-207 kernel: [59748.565996] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 21:59:34 juju-e4d256-prod-github-runner-207 kernel: [59748.567159] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 21:59:34 juju-e4d256-prod-github-runner-207 kernel: [59748.568324] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 21:59:34 juju-e4d256-prod-github-runner-207 kernel: [59748.569497] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 21:59:34 juju-e4d256-prod-github-runner-207 kernel: [59748.570730] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 21:59:34 juju-e4d256-prod-github-runner-207 kernel: [59748.571827] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 21:59:34 juju-e4d256-prod-github-runner-207 kernel: [59748.573033] Call Trace: Aug 22 21:59:34 juju-e4d256-prod-github-runner-207 kernel: [59748.573952] Aug 22 21:59:34 juju-e4d256-prod-github-runner-207 kernel: [59748.574849] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:59:34 juju-e4d256-prod-github-runner-207 kernel: [59748.575883] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 21:59:34 juju-e4d256-prod-github-runner-207 kernel: [59748.576916] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:59:34 juju-e4d256-prod-github-runner-207 kernel: [59748.577996] ? show_regs.part.0+0x23/0x29 Aug 22 21:59:34 juju-e4d256-prod-github-runner-207 kernel: [59748.579016] ? show_regs.cold+0x8/0xd Aug 22 21:59:34 juju-e4d256-prod-github-runner-207 kernel: [59748.579987] ? watchdog_timer_fn+0x1be/0x220 Aug 22 21:59:34 juju-e4d256-prod-github-runner-207 kernel: [59748.581049] ? lockup_detector_update_enable+0x60/0x60 Aug 22 21:59:34 juju-e4d256-prod-github-runner-207 kernel: [59748.582143] ? __hrtimer_run_queues+0x107/0x230 Aug 22 21:59:34 juju-e4d256-prod-github-runner-207 kernel: [59748.583180] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 21:59:34 juju-e4d256-prod-github-runner-207 kernel: [59748.584206] ? hrtimer_interrupt+0x101/0x220 Aug 22 21:59:34 juju-e4d256-prod-github-runner-207 kernel: [59748.585243] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 21:59:34 juju-e4d256-prod-github-runner-207 kernel: [59748.586318] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 21:59:34 juju-e4d256-prod-github-runner-207 kernel: [59748.587393] Aug 22 21:59:34 juju-e4d256-prod-github-runner-207 kernel: [59748.588261] Aug 22 21:59:34 juju-e4d256-prod-github-runner-207 kernel: [59748.589116] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 21:59:34 juju-e4d256-prod-github-runner-207 kernel: [59748.590156] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:59:34 juju-e4d256-prod-github-runner-207 kernel: [59748.591197] ? _raw_spin_lock+0x22/0x30 Aug 22 21:59:34 juju-e4d256-prod-github-runner-207 kernel: [59748.592141] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:59:34 juju-e4d256-prod-github-runner-207 kernel: [59748.593174] direct_page_fault+0x206/0x310 [kvm] Aug 22 21:59:34 juju-e4d256-prod-github-runner-207 kernel: [59748.594203] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 21:59:34 juju-e4d256-prod-github-runner-207 kernel: [59748.595217] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 21:59:34 juju-e4d256-prod-github-runner-207 kernel: [59748.596223] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 21:59:34 juju-e4d256-prod-github-runner-207 kernel: [59748.597223] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 21:59:34 juju-e4d256-prod-github-runner-207 kernel: [59748.598220] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 21:59:34 juju-e4d256-prod-github-runner-207 kernel: [59748.599203] handle_exit+0x98/0x230 [kvm_amd] Aug 22 21:59:34 juju-e4d256-prod-github-runner-207 kernel: [59748.600101] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 21:59:34 juju-e4d256-prod-github-runner-207 kernel: [59748.601053] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 21:59:34 juju-e4d256-prod-github-runner-207 kernel: [59748.601984] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 21:59:34 juju-e4d256-prod-github-runner-207 kernel: [59748.602886] vcpu_run+0x62/0x2c0 [kvm] Aug 22 21:59:34 juju-e4d256-prod-github-runner-207 kernel: [59748.603744] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 21:59:34 juju-e4d256-prod-github-runner-207 kernel: [59748.604579] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 21:59:34 juju-e4d256-prod-github-runner-207 kernel: [59748.605447] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 21:59:34 juju-e4d256-prod-github-runner-207 kernel: [59748.606245] ? __seccomp_filter+0x4a/0x4a0 Aug 22 21:59:34 juju-e4d256-prod-github-runner-207 kernel: [59748.606993] ? __fget_files+0x86/0xc0 Aug 22 21:59:34 juju-e4d256-prod-github-runner-207 kernel: [59748.607696] __x64_sys_ioctl+0x95/0xd0 Aug 22 21:59:34 juju-e4d256-prod-github-runner-207 kernel: [59748.608388] do_syscall_64+0x5c/0xc0 Aug 22 21:59:34 juju-e4d256-prod-github-runner-207 kernel: [59748.609061] ? do_futex+0x162/0x1f0 Aug 22 21:59:34 juju-e4d256-prod-github-runner-207 kernel: [59748.609716] ? __x64_sys_futex+0x78/0x1e0 Aug 22 21:59:34 juju-e4d256-prod-github-runner-207 kernel: [59748.610404] ? __secure_computing+0xa9/0x120 Aug 22 21:59:34 juju-e4d256-prod-github-runner-207 kernel: [59748.611099] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 21:59:34 juju-e4d256-prod-github-runner-207 kernel: [59748.611859] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:59:34 juju-e4d256-prod-github-runner-207 kernel: [59748.612579] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:59:34 juju-e4d256-prod-github-runner-207 kernel: [59748.613307] ? do_syscall_64+0x69/0xc0 Aug 22 21:59:34 juju-e4d256-prod-github-runner-207 kernel: [59748.613955] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:59:34 juju-e4d256-prod-github-runner-207 kernel: [59748.614658] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:59:34 juju-e4d256-prod-github-runner-207 kernel: [59748.615353] ? do_syscall_64+0x69/0xc0 Aug 22 21:59:34 juju-e4d256-prod-github-runner-207 kernel: [59748.615982] ? do_syscall_64+0x69/0xc0 Aug 22 21:59:34 juju-e4d256-prod-github-runner-207 kernel: [59748.616604] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 21:59:34 juju-e4d256-prod-github-runner-207 kernel: [59748.617323] RIP: 0033:0x7faa5d0edaff Aug 22 21:59:34 juju-e4d256-prod-github-runner-207 kernel: [59748.617965] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 21:59:34 juju-e4d256-prod-github-runner-207 kernel: [59748.619964] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 21:59:34 juju-e4d256-prod-github-runner-207 kernel: [59748.620892] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 21:59:34 juju-e4d256-prod-github-runner-207 kernel: [59748.621784] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 21:59:34 juju-e4d256-prod-github-runner-207 kernel: [59748.622672] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 21:59:34 juju-e4d256-prod-github-runner-207 kernel: [59748.623564] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 21:59:34 juju-e4d256-prod-github-runner-207 kernel: [59748.624458] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 21:59:34 juju-e4d256-prod-github-runner-207 kernel: [59748.625370] Aug 22 21:59:47 juju-e4d256-prod-github-runner-207 kernel: [59761.172714] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 21:59:47 juju-e4d256-prod-github-runner-207 kernel: [59761.173739] rcu: 1-....: (14864053 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=7181926 Aug 22 21:59:47 juju-e4d256-prod-github-runner-207 kernel: [59761.174870] (t=14910993 jiffies g=23269 q=53785) Aug 22 21:59:47 juju-e4d256-prod-github-runner-207 kernel: [59761.175659] NMI backtrace for cpu 1 Aug 22 21:59:47 juju-e4d256-prod-github-runner-207 kernel: [59761.176372] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 21:59:47 juju-e4d256-prod-github-runner-207 kernel: [59761.177624] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 21:59:47 juju-e4d256-prod-github-runner-207 kernel: [59761.178683] Call Trace: Aug 22 21:59:47 juju-e4d256-prod-github-runner-207 kernel: [59761.179357] Aug 22 21:59:47 juju-e4d256-prod-github-runner-207 kernel: [59761.180001] show_stack+0x52/0x5c Aug 22 21:59:47 juju-e4d256-prod-github-runner-207 kernel: [59761.180733] dump_stack_lvl+0x4a/0x63 Aug 22 21:59:47 juju-e4d256-prod-github-runner-207 kernel: [59761.181492] dump_stack+0x10/0x16 Aug 22 21:59:47 juju-e4d256-prod-github-runner-207 kernel: [59761.182212] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 21:59:47 juju-e4d256-prod-github-runner-207 kernel: [59761.183004] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 21:59:47 juju-e4d256-prod-github-runner-207 kernel: [59761.183783] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 21:59:47 juju-e4d256-prod-github-runner-207 kernel: [59761.184603] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 21:59:47 juju-e4d256-prod-github-runner-207 kernel: [59761.185579] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 21:59:47 juju-e4d256-prod-github-runner-207 kernel: [59761.186541] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 21:59:47 juju-e4d256-prod-github-runner-207 kernel: [59761.187312] print_cpu_stall.cold+0x2f/0xe2 Aug 22 21:59:47 juju-e4d256-prod-github-runner-207 kernel: [59761.188083] ? timekeeping_update+0xf7/0x150 Aug 22 21:59:47 juju-e4d256-prod-github-runner-207 kernel: [59761.188870] check_cpu_stall+0x109/0x270 Aug 22 21:59:47 juju-e4d256-prod-github-runner-207 kernel: [59761.189619] rcu_sched_clock_irq+0x9a/0x250 Aug 22 21:59:47 juju-e4d256-prod-github-runner-207 kernel: [59761.190391] update_process_times+0x94/0xd0 Aug 22 21:59:47 juju-e4d256-prod-github-runner-207 kernel: [59761.191155] tick_sched_handle+0x29/0x70 Aug 22 21:59:47 juju-e4d256-prod-github-runner-207 kernel: [59761.192023] tick_sched_timer+0x8c/0xc0 Aug 22 21:59:47 juju-e4d256-prod-github-runner-207 kernel: [59761.193072] ? tick_nohz_handler+0xb0/0xb0 Aug 22 21:59:47 juju-e4d256-prod-github-runner-207 kernel: [59761.193857] __hrtimer_run_queues+0x107/0x230 Aug 22 21:59:47 juju-e4d256-prod-github-runner-207 kernel: [59761.194643] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 21:59:47 juju-e4d256-prod-github-runner-207 kernel: [59761.195575] hrtimer_interrupt+0x101/0x220 Aug 22 21:59:47 juju-e4d256-prod-github-runner-207 kernel: [59761.196337] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 21:59:47 juju-e4d256-prod-github-runner-207 kernel: [59761.197169] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 21:59:47 juju-e4d256-prod-github-runner-207 kernel: [59761.197971] Aug 22 21:59:47 juju-e4d256-prod-github-runner-207 kernel: [59761.198606] Aug 22 21:59:47 juju-e4d256-prod-github-runner-207 kernel: [59761.199239] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 21:59:47 juju-e4d256-prod-github-runner-207 kernel: [59761.200056] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 21:59:47 juju-e4d256-prod-github-runner-207 kernel: [59761.200952] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 21:59:47 juju-e4d256-prod-github-runner-207 kernel: [59761.203156] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 21:59:47 juju-e4d256-prod-github-runner-207 kernel: [59761.204032] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 21:59:47 juju-e4d256-prod-github-runner-207 kernel: [59761.205052] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 21:59:47 juju-e4d256-prod-github-runner-207 kernel: [59761.206042] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 21:59:47 juju-e4d256-prod-github-runner-207 kernel: [59761.207023] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 21:59:47 juju-e4d256-prod-github-runner-207 kernel: [59761.207979] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 21:59:47 juju-e4d256-prod-github-runner-207 kernel: [59761.208949] ? _raw_spin_lock+0x22/0x30 Aug 22 21:59:47 juju-e4d256-prod-github-runner-207 kernel: [59761.209717] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 21:59:47 juju-e4d256-prod-github-runner-207 kernel: [59761.210593] direct_page_fault+0x206/0x310 [kvm] Aug 22 21:59:47 juju-e4d256-prod-github-runner-207 kernel: [59761.211452] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 21:59:47 juju-e4d256-prod-github-runner-207 kernel: [59761.212293] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 21:59:47 juju-e4d256-prod-github-runner-207 kernel: [59761.213130] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 21:59:47 juju-e4d256-prod-github-runner-207 kernel: [59761.213936] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 21:59:47 juju-e4d256-prod-github-runner-207 kernel: [59761.214723] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 21:59:47 juju-e4d256-prod-github-runner-207 kernel: [59761.215547] handle_exit+0x98/0x230 [kvm_amd] Aug 22 21:59:47 juju-e4d256-prod-github-runner-207 kernel: [59761.216304] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 21:59:47 juju-e4d256-prod-github-runner-207 kernel: [59761.217106] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 21:59:47 juju-e4d256-prod-github-runner-207 kernel: [59761.217909] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 21:59:47 juju-e4d256-prod-github-runner-207 kernel: [59761.218696] vcpu_run+0x62/0x2c0 [kvm] Aug 22 21:59:47 juju-e4d256-prod-github-runner-207 kernel: [59761.219419] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 21:59:47 juju-e4d256-prod-github-runner-207 kernel: [59761.220151] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 21:59:47 juju-e4d256-prod-github-runner-207 kernel: [59761.220969] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 21:59:47 juju-e4d256-prod-github-runner-207 kernel: [59761.221730] ? __seccomp_filter+0x4a/0x4a0 Aug 22 21:59:47 juju-e4d256-prod-github-runner-207 kernel: [59761.222446] ? __fget_files+0x86/0xc0 Aug 22 21:59:47 juju-e4d256-prod-github-runner-207 kernel: [59761.223137] __x64_sys_ioctl+0x95/0xd0 Aug 22 21:59:47 juju-e4d256-prod-github-runner-207 kernel: [59761.223852] do_syscall_64+0x5c/0xc0 Aug 22 21:59:47 juju-e4d256-prod-github-runner-207 kernel: [59761.224541] ? do_futex+0x162/0x1f0 Aug 22 21:59:47 juju-e4d256-prod-github-runner-207 kernel: [59761.225278] ? __x64_sys_futex+0x78/0x1e0 Aug 22 21:59:47 juju-e4d256-prod-github-runner-207 kernel: [59761.225990] ? __secure_computing+0xa9/0x120 Aug 22 21:59:47 juju-e4d256-prod-github-runner-207 kernel: [59761.226708] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 21:59:47 juju-e4d256-prod-github-runner-207 kernel: [59761.227512] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:59:47 juju-e4d256-prod-github-runner-207 kernel: [59761.228262] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:59:47 juju-e4d256-prod-github-runner-207 kernel: [59761.229034] ? do_syscall_64+0x69/0xc0 Aug 22 21:59:47 juju-e4d256-prod-github-runner-207 kernel: [59761.229722] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 21:59:47 juju-e4d256-prod-github-runner-207 kernel: [59761.230474] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 21:59:47 juju-e4d256-prod-github-runner-207 kernel: [59761.231235] ? do_syscall_64+0x69/0xc0 Aug 22 21:59:47 juju-e4d256-prod-github-runner-207 kernel: [59761.231937] ? do_syscall_64+0x69/0xc0 Aug 22 21:59:47 juju-e4d256-prod-github-runner-207 kernel: [59761.232624] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 21:59:47 juju-e4d256-prod-github-runner-207 kernel: [59761.233407] RIP: 0033:0x7faa5d0edaff Aug 22 21:59:47 juju-e4d256-prod-github-runner-207 kernel: [59761.234290] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 21:59:47 juju-e4d256-prod-github-runner-207 kernel: [59761.236415] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 21:59:47 juju-e4d256-prod-github-runner-207 kernel: [59761.237396] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 21:59:47 juju-e4d256-prod-github-runner-207 kernel: [59761.238355] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 21:59:47 juju-e4d256-prod-github-runner-207 kernel: [59761.239313] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 21:59:47 juju-e4d256-prod-github-runner-207 kernel: [59761.240260] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 21:59:47 juju-e4d256-prod-github-runner-207 kernel: [59761.241271] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 21:59:47 juju-e4d256-prod-github-runner-207 kernel: [59761.242203] Aug 22 22:00:14 juju-e4d256-prod-github-runner-207 kernel: [59788.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 55574s! [qemu-system-x86:6715] Aug 22 22:00:14 juju-e4d256-prod-github-runner-207 kernel: [59788.543111] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 22:00:14 juju-e4d256-prod-github-runner-207 kernel: [59788.543185] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 22:00:14 juju-e4d256-prod-github-runner-207 kernel: [59788.555228] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 22:00:14 juju-e4d256-prod-github-runner-207 kernel: [59788.556506] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 22:00:14 juju-e4d256-prod-github-runner-207 kernel: [59788.557723] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:00:14 juju-e4d256-prod-github-runner-207 kernel: [59788.558783] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 22:00:14 juju-e4d256-prod-github-runner-207 kernel: [59788.561343] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 22:00:14 juju-e4d256-prod-github-runner-207 kernel: [59788.562393] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 22:00:14 juju-e4d256-prod-github-runner-207 kernel: [59788.563560] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 22:00:14 juju-e4d256-prod-github-runner-207 kernel: [59788.564736] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 22:00:14 juju-e4d256-prod-github-runner-207 kernel: [59788.565895] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 22:00:14 juju-e4d256-prod-github-runner-207 kernel: [59788.567055] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 22:00:14 juju-e4d256-prod-github-runner-207 kernel: [59788.568225] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 22:00:14 juju-e4d256-prod-github-runner-207 kernel: [59788.569471] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 22:00:14 juju-e4d256-prod-github-runner-207 kernel: [59788.570597] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 22:00:14 juju-e4d256-prod-github-runner-207 kernel: [59788.571809] Call Trace: Aug 22 22:00:14 juju-e4d256-prod-github-runner-207 kernel: [59788.572752] Aug 22 22:00:14 juju-e4d256-prod-github-runner-207 kernel: [59788.573641] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:00:14 juju-e4d256-prod-github-runner-207 kernel: [59788.574668] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:00:14 juju-e4d256-prod-github-runner-207 kernel: [59788.575686] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:00:14 juju-e4d256-prod-github-runner-207 kernel: [59788.576771] ? show_regs.part.0+0x23/0x29 Aug 22 22:00:14 juju-e4d256-prod-github-runner-207 kernel: [59788.577772] ? show_regs.cold+0x8/0xd Aug 22 22:00:14 juju-e4d256-prod-github-runner-207 kernel: [59788.578742] ? watchdog_timer_fn+0x1be/0x220 Aug 22 22:00:14 juju-e4d256-prod-github-runner-207 kernel: [59788.579832] ? lockup_detector_update_enable+0x60/0x60 Aug 22 22:00:14 juju-e4d256-prod-github-runner-207 kernel: [59788.580900] ? __hrtimer_run_queues+0x107/0x230 Aug 22 22:00:14 juju-e4d256-prod-github-runner-207 kernel: [59788.582090] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 22:00:14 juju-e4d256-prod-github-runner-207 kernel: [59788.583127] ? hrtimer_interrupt+0x101/0x220 Aug 22 22:00:14 juju-e4d256-prod-github-runner-207 kernel: [59788.584140] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 22:00:14 juju-e4d256-prod-github-runner-207 kernel: [59788.585231] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 22:00:14 juju-e4d256-prod-github-runner-207 kernel: [59788.586287] Aug 22 22:00:14 juju-e4d256-prod-github-runner-207 kernel: [59788.587143] Aug 22 22:00:14 juju-e4d256-prod-github-runner-207 kernel: [59788.587994] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 22:00:14 juju-e4d256-prod-github-runner-207 kernel: [59788.589042] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:00:14 juju-e4d256-prod-github-runner-207 kernel: [59788.590203] ? _raw_spin_lock+0x22/0x30 Aug 22 22:00:14 juju-e4d256-prod-github-runner-207 kernel: [59788.591147] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:00:14 juju-e4d256-prod-github-runner-207 kernel: [59788.592166] direct_page_fault+0x206/0x310 [kvm] Aug 22 22:00:14 juju-e4d256-prod-github-runner-207 kernel: [59788.593240] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 22:00:14 juju-e4d256-prod-github-runner-207 kernel: [59788.594346] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 22:00:14 juju-e4d256-prod-github-runner-207 kernel: [59788.595369] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 22:00:14 juju-e4d256-prod-github-runner-207 kernel: [59788.596345] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 22:00:14 juju-e4d256-prod-github-runner-207 kernel: [59788.597314] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 22:00:14 juju-e4d256-prod-github-runner-207 kernel: [59788.598299] handle_exit+0x98/0x230 [kvm_amd] Aug 22 22:00:14 juju-e4d256-prod-github-runner-207 kernel: [59788.599250] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 22:00:14 juju-e4d256-prod-github-runner-207 kernel: [59788.600209] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 22:00:14 juju-e4d256-prod-github-runner-207 kernel: [59788.601159] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 22:00:14 juju-e4d256-prod-github-runner-207 kernel: [59788.602071] vcpu_run+0x62/0x2c0 [kvm] Aug 22 22:00:14 juju-e4d256-prod-github-runner-207 kernel: [59788.602881] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 22:00:14 juju-e4d256-prod-github-runner-207 kernel: [59788.603688] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 22:00:14 juju-e4d256-prod-github-runner-207 kernel: [59788.604569] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 22:00:14 juju-e4d256-prod-github-runner-207 kernel: [59788.605368] ? __seccomp_filter+0x4a/0x4a0 Aug 22 22:00:14 juju-e4d256-prod-github-runner-207 kernel: [59788.606110] ? __fget_files+0x86/0xc0 Aug 22 22:00:14 juju-e4d256-prod-github-runner-207 kernel: [59788.606813] __x64_sys_ioctl+0x95/0xd0 Aug 22 22:00:14 juju-e4d256-prod-github-runner-207 kernel: [59788.607505] do_syscall_64+0x5c/0xc0 Aug 22 22:00:14 juju-e4d256-prod-github-runner-207 kernel: [59788.608198] ? do_futex+0x162/0x1f0 Aug 22 22:00:14 juju-e4d256-prod-github-runner-207 kernel: [59788.608873] ? __x64_sys_futex+0x78/0x1e0 Aug 22 22:00:14 juju-e4d256-prod-github-runner-207 kernel: [59788.609547] ? __secure_computing+0xa9/0x120 Aug 22 22:00:14 juju-e4d256-prod-github-runner-207 kernel: [59788.610236] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 22:00:14 juju-e4d256-prod-github-runner-207 kernel: [59788.610996] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:00:14 juju-e4d256-prod-github-runner-207 kernel: [59788.611721] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:00:14 juju-e4d256-prod-github-runner-207 kernel: [59788.612466] ? do_syscall_64+0x69/0xc0 Aug 22 22:00:14 juju-e4d256-prod-github-runner-207 kernel: [59788.613112] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:00:14 juju-e4d256-prod-github-runner-207 kernel: [59788.613814] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:00:14 juju-e4d256-prod-github-runner-207 kernel: [59788.614513] ? do_syscall_64+0x69/0xc0 Aug 22 22:00:14 juju-e4d256-prod-github-runner-207 kernel: [59788.615138] ? do_syscall_64+0x69/0xc0 Aug 22 22:00:14 juju-e4d256-prod-github-runner-207 kernel: [59788.615759] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 22:00:14 juju-e4d256-prod-github-runner-207 kernel: [59788.616477] RIP: 0033:0x7faa5d0edaff Aug 22 22:00:14 juju-e4d256-prod-github-runner-207 kernel: [59788.617102] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 22:00:14 juju-e4d256-prod-github-runner-207 kernel: [59788.619097] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 22:00:14 juju-e4d256-prod-github-runner-207 kernel: [59788.620009] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 22:00:14 juju-e4d256-prod-github-runner-207 kernel: [59788.620914] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 22:00:14 juju-e4d256-prod-github-runner-207 kernel: [59788.621804] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 22:00:14 juju-e4d256-prod-github-runner-207 kernel: [59788.622704] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 22:00:14 juju-e4d256-prod-github-runner-207 kernel: [59788.623597] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 22:00:14 juju-e4d256-prod-github-runner-207 kernel: [59788.624504] Aug 22 22:00:42 juju-e4d256-prod-github-runner-207 kernel: [59816.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 55600s! [qemu-system-x86:6715] Aug 22 22:00:42 juju-e4d256-prod-github-runner-207 kernel: [59816.543825] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 22:00:42 juju-e4d256-prod-github-runner-207 kernel: [59816.544133] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 22:00:42 juju-e4d256-prod-github-runner-207 kernel: [59816.556648] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 22:00:42 juju-e4d256-prod-github-runner-207 kernel: [59816.557919] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 22:00:42 juju-e4d256-prod-github-runner-207 kernel: [59816.559138] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:00:42 juju-e4d256-prod-github-runner-207 kernel: [59816.560222] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 22:00:42 juju-e4d256-prod-github-runner-207 kernel: [59816.562788] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 22:00:42 juju-e4d256-prod-github-runner-207 kernel: [59816.563834] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 22:00:42 juju-e4d256-prod-github-runner-207 kernel: [59816.565014] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 22:00:42 juju-e4d256-prod-github-runner-207 kernel: [59816.566176] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 22:00:42 juju-e4d256-prod-github-runner-207 kernel: [59816.567337] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 22:00:42 juju-e4d256-prod-github-runner-207 kernel: [59816.568514] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 22:00:42 juju-e4d256-prod-github-runner-207 kernel: [59816.569681] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 22:00:42 juju-e4d256-prod-github-runner-207 kernel: [59816.570913] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 22:00:42 juju-e4d256-prod-github-runner-207 kernel: [59816.572026] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 22:00:42 juju-e4d256-prod-github-runner-207 kernel: [59816.573219] Call Trace: Aug 22 22:00:42 juju-e4d256-prod-github-runner-207 kernel: [59816.574131] Aug 22 22:00:42 juju-e4d256-prod-github-runner-207 kernel: [59816.575199] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:00:42 juju-e4d256-prod-github-runner-207 kernel: [59816.576374] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:00:42 juju-e4d256-prod-github-runner-207 kernel: [59816.577508] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:00:42 juju-e4d256-prod-github-runner-207 kernel: [59816.578691] ? show_regs.part.0+0x23/0x29 Aug 22 22:00:42 juju-e4d256-prod-github-runner-207 kernel: [59816.579808] ? show_regs.cold+0x8/0xd Aug 22 22:00:42 juju-e4d256-prod-github-runner-207 kernel: [59816.580884] ? watchdog_timer_fn+0x1be/0x220 Aug 22 22:00:42 juju-e4d256-prod-github-runner-207 kernel: [59816.581985] ? lockup_detector_update_enable+0x60/0x60 Aug 22 22:00:42 juju-e4d256-prod-github-runner-207 kernel: [59816.583151] ? __hrtimer_run_queues+0x107/0x230 Aug 22 22:00:42 juju-e4d256-prod-github-runner-207 kernel: [59816.584275] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 22:00:42 juju-e4d256-prod-github-runner-207 kernel: [59816.585385] ? hrtimer_interrupt+0x101/0x220 Aug 22 22:00:42 juju-e4d256-prod-github-runner-207 kernel: [59816.586483] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 22:00:42 juju-e4d256-prod-github-runner-207 kernel: [59816.587668] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 22:00:42 juju-e4d256-prod-github-runner-207 kernel: [59816.588817] Aug 22 22:00:42 juju-e4d256-prod-github-runner-207 kernel: [59816.589715] Aug 22 22:00:42 juju-e4d256-prod-github-runner-207 kernel: [59816.590597] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 22:00:42 juju-e4d256-prod-github-runner-207 kernel: [59816.591804] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:00:42 juju-e4d256-prod-github-runner-207 kernel: [59816.593022] ? _raw_spin_lock+0x22/0x30 Aug 22 22:00:42 juju-e4d256-prod-github-runner-207 kernel: [59816.594057] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:00:42 juju-e4d256-prod-github-runner-207 kernel: [59816.595163] direct_page_fault+0x206/0x310 [kvm] Aug 22 22:00:42 juju-e4d256-prod-github-runner-207 kernel: [59816.596289] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 22:00:42 juju-e4d256-prod-github-runner-207 kernel: [59816.597387] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 22:00:42 juju-e4d256-prod-github-runner-207 kernel: [59816.598482] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 22:00:42 juju-e4d256-prod-github-runner-207 kernel: [59816.599593] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 22:00:42 juju-e4d256-prod-github-runner-207 kernel: [59816.600645] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 22:00:42 juju-e4d256-prod-github-runner-207 kernel: [59816.601737] handle_exit+0x98/0x230 [kvm_amd] Aug 22 22:00:42 juju-e4d256-prod-github-runner-207 kernel: [59816.602745] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 22:00:42 juju-e4d256-prod-github-runner-207 kernel: [59816.603840] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 22:00:42 juju-e4d256-prod-github-runner-207 kernel: [59816.605111] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 22:00:42 juju-e4d256-prod-github-runner-207 kernel: [59816.606114] vcpu_run+0x62/0x2c0 [kvm] Aug 22 22:00:42 juju-e4d256-prod-github-runner-207 kernel: [59816.607000] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 22:00:42 juju-e4d256-prod-github-runner-207 kernel: [59816.607893] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 22:00:42 juju-e4d256-prod-github-runner-207 kernel: [59816.608868] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 22:00:42 juju-e4d256-prod-github-runner-207 kernel: [59816.609795] ? __seccomp_filter+0x4a/0x4a0 Aug 22 22:00:42 juju-e4d256-prod-github-runner-207 kernel: [59816.610697] ? __fget_files+0x86/0xc0 Aug 22 22:00:42 juju-e4d256-prod-github-runner-207 kernel: [59816.611579] __x64_sys_ioctl+0x95/0xd0 Aug 22 22:00:42 juju-e4d256-prod-github-runner-207 kernel: [59816.612386] do_syscall_64+0x5c/0xc0 Aug 22 22:00:42 juju-e4d256-prod-github-runner-207 kernel: [59816.613296] ? do_futex+0x162/0x1f0 Aug 22 22:00:42 juju-e4d256-prod-github-runner-207 kernel: [59816.614015] ? __x64_sys_futex+0x78/0x1e0 Aug 22 22:00:42 juju-e4d256-prod-github-runner-207 kernel: [59816.614961] ? __secure_computing+0xa9/0x120 Aug 22 22:00:42 juju-e4d256-prod-github-runner-207 kernel: [59816.615749] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 22:00:42 juju-e4d256-prod-github-runner-207 kernel: [59816.616631] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:00:42 juju-e4d256-prod-github-runner-207 kernel: [59816.617443] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:00:42 juju-e4d256-prod-github-runner-207 kernel: [59816.618248] ? do_syscall_64+0x69/0xc0 Aug 22 22:00:42 juju-e4d256-prod-github-runner-207 kernel: [59816.618968] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:00:42 juju-e4d256-prod-github-runner-207 kernel: [59816.619765] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:00:42 juju-e4d256-prod-github-runner-207 kernel: [59816.620561] ? do_syscall_64+0x69/0xc0 Aug 22 22:00:42 juju-e4d256-prod-github-runner-207 kernel: [59816.621261] ? do_syscall_64+0x69/0xc0 Aug 22 22:00:42 juju-e4d256-prod-github-runner-207 kernel: [59816.621961] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 22:00:42 juju-e4d256-prod-github-runner-207 kernel: [59816.622805] RIP: 0033:0x7faa5d0edaff Aug 22 22:00:42 juju-e4d256-prod-github-runner-207 kernel: [59816.623547] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 22:00:42 juju-e4d256-prod-github-runner-207 kernel: [59816.625875] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 22:00:42 juju-e4d256-prod-github-runner-207 kernel: [59816.626930] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 22:00:42 juju-e4d256-prod-github-runner-207 kernel: [59816.627957] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 22:00:42 juju-e4d256-prod-github-runner-207 kernel: [59816.628990] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 22:00:42 juju-e4d256-prod-github-runner-207 kernel: [59816.630024] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 22:00:42 juju-e4d256-prod-github-runner-207 kernel: [59816.631061] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 22:00:42 juju-e4d256-prod-github-runner-207 kernel: [59816.632103] Aug 22 22:01:10 juju-e4d256-prod-github-runner-207 kernel: [59844.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 55626s! [qemu-system-x86:6715] Aug 22 22:01:10 juju-e4d256-prod-github-runner-207 kernel: [59844.543171] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 22:01:10 juju-e4d256-prod-github-runner-207 kernel: [59844.543245] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 22:01:10 juju-e4d256-prod-github-runner-207 kernel: [59844.556534] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 22:01:10 juju-e4d256-prod-github-runner-207 kernel: [59844.557912] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 22:01:10 juju-e4d256-prod-github-runner-207 kernel: [59844.559288] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:01:10 juju-e4d256-prod-github-runner-207 kernel: [59844.560449] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 22:01:10 juju-e4d256-prod-github-runner-207 kernel: [59844.563181] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 22:01:10 juju-e4d256-prod-github-runner-207 kernel: [59844.564395] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 22:01:10 juju-e4d256-prod-github-runner-207 kernel: [59844.565617] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 22:01:10 juju-e4d256-prod-github-runner-207 kernel: [59844.566862] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 22:01:10 juju-e4d256-prod-github-runner-207 kernel: [59844.568210] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 22:01:10 juju-e4d256-prod-github-runner-207 kernel: [59844.569446] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 22:01:10 juju-e4d256-prod-github-runner-207 kernel: [59844.570672] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 22:01:10 juju-e4d256-prod-github-runner-207 kernel: [59844.572351] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 22:01:10 juju-e4d256-prod-github-runner-207 kernel: [59844.573694] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 22:01:10 juju-e4d256-prod-github-runner-207 kernel: [59844.575024] Call Trace: Aug 22 22:01:10 juju-e4d256-prod-github-runner-207 kernel: [59844.576061] Aug 22 22:01:10 juju-e4d256-prod-github-runner-207 kernel: [59844.577021] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:01:10 juju-e4d256-prod-github-runner-207 kernel: [59844.578151] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:01:10 juju-e4d256-prod-github-runner-207 kernel: [59844.579238] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:01:10 juju-e4d256-prod-github-runner-207 kernel: [59844.580435] ? show_regs.part.0+0x23/0x29 Aug 22 22:01:10 juju-e4d256-prod-github-runner-207 kernel: [59844.581531] ? show_regs.cold+0x8/0xd Aug 22 22:01:10 juju-e4d256-prod-github-runner-207 kernel: [59844.582609] ? watchdog_timer_fn+0x1be/0x220 Aug 22 22:01:10 juju-e4d256-prod-github-runner-207 kernel: [59844.583728] ? lockup_detector_update_enable+0x60/0x60 Aug 22 22:01:10 juju-e4d256-prod-github-runner-207 kernel: [59844.584948] ? __hrtimer_run_queues+0x107/0x230 Aug 22 22:01:10 juju-e4d256-prod-github-runner-207 kernel: [59844.586075] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 22:01:10 juju-e4d256-prod-github-runner-207 kernel: [59844.587196] ? hrtimer_interrupt+0x101/0x220 Aug 22 22:01:10 juju-e4d256-prod-github-runner-207 kernel: [59844.588355] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 22:01:10 juju-e4d256-prod-github-runner-207 kernel: [59844.589508] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 22:01:10 juju-e4d256-prod-github-runner-207 kernel: [59844.590642] Aug 22 22:01:10 juju-e4d256-prod-github-runner-207 kernel: [59844.591547] Aug 22 22:01:10 juju-e4d256-prod-github-runner-207 kernel: [59844.592428] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 22:01:10 juju-e4d256-prod-github-runner-207 kernel: [59844.593553] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:01:10 juju-e4d256-prod-github-runner-207 kernel: [59844.594684] ? _raw_spin_lock+0x22/0x30 Aug 22 22:01:10 juju-e4d256-prod-github-runner-207 kernel: [59844.595761] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:01:10 juju-e4d256-prod-github-runner-207 kernel: [59844.596807] direct_page_fault+0x206/0x310 [kvm] Aug 22 22:01:10 juju-e4d256-prod-github-runner-207 kernel: [59844.597910] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 22:01:10 juju-e4d256-prod-github-runner-207 kernel: [59844.599030] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 22:01:10 juju-e4d256-prod-github-runner-207 kernel: [59844.600157] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 22:01:10 juju-e4d256-prod-github-runner-207 kernel: [59844.601230] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 22:01:10 juju-e4d256-prod-github-runner-207 kernel: [59844.602265] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 22:01:10 juju-e4d256-prod-github-runner-207 kernel: [59844.603371] handle_exit+0x98/0x230 [kvm_amd] Aug 22 22:01:10 juju-e4d256-prod-github-runner-207 kernel: [59844.604393] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 22:01:10 juju-e4d256-prod-github-runner-207 kernel: [59844.605414] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 22:01:10 juju-e4d256-prod-github-runner-207 kernel: [59844.606461] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 22:01:10 juju-e4d256-prod-github-runner-207 kernel: [59844.607463] vcpu_run+0x62/0x2c0 [kvm] Aug 22 22:01:10 juju-e4d256-prod-github-runner-207 kernel: [59844.608346] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 22:01:10 juju-e4d256-prod-github-runner-207 kernel: [59844.609190] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 22:01:10 juju-e4d256-prod-github-runner-207 kernel: [59844.610091] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 22:01:10 juju-e4d256-prod-github-runner-207 kernel: [59844.610998] ? __seccomp_filter+0x4a/0x4a0 Aug 22 22:01:10 juju-e4d256-prod-github-runner-207 kernel: [59844.611861] ? __fget_files+0x86/0xc0 Aug 22 22:01:10 juju-e4d256-prod-github-runner-207 kernel: [59844.612667] __x64_sys_ioctl+0x95/0xd0 Aug 22 22:01:10 juju-e4d256-prod-github-runner-207 kernel: [59844.613400] do_syscall_64+0x5c/0xc0 Aug 22 22:01:10 juju-e4d256-prod-github-runner-207 kernel: [59844.614204] ? do_futex+0x162/0x1f0 Aug 22 22:01:10 juju-e4d256-prod-github-runner-207 kernel: [59844.614929] ? __x64_sys_futex+0x78/0x1e0 Aug 22 22:01:10 juju-e4d256-prod-github-runner-207 kernel: [59844.615649] ? __secure_computing+0xa9/0x120 Aug 22 22:01:10 juju-e4d256-prod-github-runner-207 kernel: [59844.616426] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 22:01:10 juju-e4d256-prod-github-runner-207 kernel: [59844.617280] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:01:10 juju-e4d256-prod-github-runner-207 kernel: [59844.618088] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:01:10 juju-e4d256-prod-github-runner-207 kernel: [59844.618887] ? do_syscall_64+0x69/0xc0 Aug 22 22:01:10 juju-e4d256-prod-github-runner-207 kernel: [59844.619576] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:01:10 juju-e4d256-prod-github-runner-207 kernel: [59844.620489] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:01:10 juju-e4d256-prod-github-runner-207 kernel: [59844.621412] ? do_syscall_64+0x69/0xc0 Aug 22 22:01:10 juju-e4d256-prod-github-runner-207 kernel: [59844.622110] ? do_syscall_64+0x69/0xc0 Aug 22 22:01:10 juju-e4d256-prod-github-runner-207 kernel: [59844.622807] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 22:01:10 juju-e4d256-prod-github-runner-207 kernel: [59844.623578] RIP: 0033:0x7faa5d0edaff Aug 22 22:01:10 juju-e4d256-prod-github-runner-207 kernel: [59844.624250] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 22:01:10 juju-e4d256-prod-github-runner-207 kernel: [59844.626389] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 22:01:10 juju-e4d256-prod-github-runner-207 kernel: [59844.627357] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 22:01:10 juju-e4d256-prod-github-runner-207 kernel: [59844.628306] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 22:01:10 juju-e4d256-prod-github-runner-207 kernel: [59844.629416] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 22:01:10 juju-e4d256-prod-github-runner-207 kernel: [59844.630404] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 22:01:10 juju-e4d256-prod-github-runner-207 kernel: [59844.631424] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 22:01:10 juju-e4d256-prod-github-runner-207 kernel: [59844.632443] Aug 22 22:01:38 juju-e4d256-prod-github-runner-207 kernel: [59872.541980] watchdog: BUG: soft lockup - CPU#1 stuck for 55652s! [qemu-system-x86:6715] Aug 22 22:01:38 juju-e4d256-prod-github-runner-207 kernel: [59872.543334] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 22:01:38 juju-e4d256-prod-github-runner-207 kernel: [59872.543412] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 22:01:38 juju-e4d256-prod-github-runner-207 kernel: [59872.555788] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 22:01:38 juju-e4d256-prod-github-runner-207 kernel: [59872.557078] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 22:01:38 juju-e4d256-prod-github-runner-207 kernel: [59872.558323] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:01:38 juju-e4d256-prod-github-runner-207 kernel: [59872.559408] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 22:01:38 juju-e4d256-prod-github-runner-207 kernel: [59872.562021] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 22:01:38 juju-e4d256-prod-github-runner-207 kernel: [59872.563082] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 22:01:38 juju-e4d256-prod-github-runner-207 kernel: [59872.564273] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 22:01:38 juju-e4d256-prod-github-runner-207 kernel: [59872.565455] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 22:01:38 juju-e4d256-prod-github-runner-207 kernel: [59872.566634] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 22:01:38 juju-e4d256-prod-github-runner-207 kernel: [59872.567829] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 22:01:38 juju-e4d256-prod-github-runner-207 kernel: [59872.569019] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 22:01:38 juju-e4d256-prod-github-runner-207 kernel: [59872.570271] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 22:01:38 juju-e4d256-prod-github-runner-207 kernel: [59872.571396] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 22:01:38 juju-e4d256-prod-github-runner-207 kernel: [59872.572612] Call Trace: Aug 22 22:01:38 juju-e4d256-prod-github-runner-207 kernel: [59872.573528] Aug 22 22:01:38 juju-e4d256-prod-github-runner-207 kernel: [59872.574415] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:01:38 juju-e4d256-prod-github-runner-207 kernel: [59872.575483] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:01:38 juju-e4d256-prod-github-runner-207 kernel: [59872.576515] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:01:38 juju-e4d256-prod-github-runner-207 kernel: [59872.577623] ? show_regs.part.0+0x23/0x29 Aug 22 22:01:38 juju-e4d256-prod-github-runner-207 kernel: [59872.578627] ? show_regs.cold+0x8/0xd Aug 22 22:01:38 juju-e4d256-prod-github-runner-207 kernel: [59872.579618] ? watchdog_timer_fn+0x1be/0x220 Aug 22 22:01:38 juju-e4d256-prod-github-runner-207 kernel: [59872.580635] ? lockup_detector_update_enable+0x60/0x60 Aug 22 22:01:38 juju-e4d256-prod-github-runner-207 kernel: [59872.581709] ? __hrtimer_run_queues+0x107/0x230 Aug 22 22:01:38 juju-e4d256-prod-github-runner-207 kernel: [59872.582748] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 22:01:38 juju-e4d256-prod-github-runner-207 kernel: [59872.583799] ? hrtimer_interrupt+0x101/0x220 Aug 22 22:01:38 juju-e4d256-prod-github-runner-207 kernel: [59872.584820] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 22:01:38 juju-e4d256-prod-github-runner-207 kernel: [59872.585891] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 22:01:38 juju-e4d256-prod-github-runner-207 kernel: [59872.586934] Aug 22 22:01:38 juju-e4d256-prod-github-runner-207 kernel: [59872.587798] Aug 22 22:01:38 juju-e4d256-prod-github-runner-207 kernel: [59872.588640] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 22:01:38 juju-e4d256-prod-github-runner-207 kernel: [59872.589672] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:01:38 juju-e4d256-prod-github-runner-207 kernel: [59872.590708] ? _raw_spin_lock+0x22/0x30 Aug 22 22:01:38 juju-e4d256-prod-github-runner-207 kernel: [59872.591668] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:01:38 juju-e4d256-prod-github-runner-207 kernel: [59872.592682] direct_page_fault+0x206/0x310 [kvm] Aug 22 22:01:38 juju-e4d256-prod-github-runner-207 kernel: [59872.593703] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 22:01:38 juju-e4d256-prod-github-runner-207 kernel: [59872.594709] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 22:01:38 juju-e4d256-prod-github-runner-207 kernel: [59872.595719] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 22:01:38 juju-e4d256-prod-github-runner-207 kernel: [59872.596700] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 22:01:38 juju-e4d256-prod-github-runner-207 kernel: [59872.597648] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 22:01:38 juju-e4d256-prod-github-runner-207 kernel: [59872.598633] handle_exit+0x98/0x230 [kvm_amd] Aug 22 22:01:38 juju-e4d256-prod-github-runner-207 kernel: [59872.599542] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 22:01:38 juju-e4d256-prod-github-runner-207 kernel: [59872.600456] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 22:01:38 juju-e4d256-prod-github-runner-207 kernel: [59872.601406] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 22:01:38 juju-e4d256-prod-github-runner-207 kernel: [59872.602311] vcpu_run+0x62/0x2c0 [kvm] Aug 22 22:01:38 juju-e4d256-prod-github-runner-207 kernel: [59872.603121] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 22:01:38 juju-e4d256-prod-github-runner-207 kernel: [59872.603940] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 22:01:38 juju-e4d256-prod-github-runner-207 kernel: [59872.604797] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 22:01:38 juju-e4d256-prod-github-runner-207 kernel: [59872.605596] ? __seccomp_filter+0x4a/0x4a0 Aug 22 22:01:38 juju-e4d256-prod-github-runner-207 kernel: [59872.606340] ? __fget_files+0x86/0xc0 Aug 22 22:01:38 juju-e4d256-prod-github-runner-207 kernel: [59872.607041] __x64_sys_ioctl+0x95/0xd0 Aug 22 22:01:38 juju-e4d256-prod-github-runner-207 kernel: [59872.607756] do_syscall_64+0x5c/0xc0 Aug 22 22:01:38 juju-e4d256-prod-github-runner-207 kernel: [59872.608423] ? do_futex+0x162/0x1f0 Aug 22 22:01:38 juju-e4d256-prod-github-runner-207 kernel: [59872.609068] ? __x64_sys_futex+0x78/0x1e0 Aug 22 22:01:38 juju-e4d256-prod-github-runner-207 kernel: [59872.609740] ? __secure_computing+0xa9/0x120 Aug 22 22:01:38 juju-e4d256-prod-github-runner-207 kernel: [59872.610432] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 22:01:38 juju-e4d256-prod-github-runner-207 kernel: [59872.611191] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:01:38 juju-e4d256-prod-github-runner-207 kernel: [59872.611941] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:01:38 juju-e4d256-prod-github-runner-207 kernel: [59872.612657] ? do_syscall_64+0x69/0xc0 Aug 22 22:01:38 juju-e4d256-prod-github-runner-207 kernel: [59872.613301] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:01:38 juju-e4d256-prod-github-runner-207 kernel: [59872.614002] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:01:38 juju-e4d256-prod-github-runner-207 kernel: [59872.614697] ? do_syscall_64+0x69/0xc0 Aug 22 22:01:38 juju-e4d256-prod-github-runner-207 kernel: [59872.615343] ? do_syscall_64+0x69/0xc0 Aug 22 22:01:38 juju-e4d256-prod-github-runner-207 kernel: [59872.615974] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 22:01:38 juju-e4d256-prod-github-runner-207 kernel: [59872.616679] RIP: 0033:0x7faa5d0edaff Aug 22 22:01:38 juju-e4d256-prod-github-runner-207 kernel: [59872.617303] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 22:01:38 juju-e4d256-prod-github-runner-207 kernel: [59872.619289] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 22:01:38 juju-e4d256-prod-github-runner-207 kernel: [59872.620213] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 22:01:38 juju-e4d256-prod-github-runner-207 kernel: [59872.621101] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 22:01:38 juju-e4d256-prod-github-runner-207 kernel: [59872.621993] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 22:01:38 juju-e4d256-prod-github-runner-207 kernel: [59872.622877] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 22:01:38 juju-e4d256-prod-github-runner-207 kernel: [59872.623790] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 22:01:38 juju-e4d256-prod-github-runner-207 kernel: [59872.624682] Aug 22 22:02:06 juju-e4d256-prod-github-runner-207 kernel: [59900.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 55678s! [qemu-system-x86:6715] Aug 22 22:02:06 juju-e4d256-prod-github-runner-207 kernel: [59900.543919] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 22:02:06 juju-e4d256-prod-github-runner-207 kernel: [59900.544232] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 22:02:06 juju-e4d256-prod-github-runner-207 kernel: [59900.556452] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 22:02:06 juju-e4d256-prod-github-runner-207 kernel: [59900.557715] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 22:02:06 juju-e4d256-prod-github-runner-207 kernel: [59900.559004] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:02:06 juju-e4d256-prod-github-runner-207 kernel: [59900.560103] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 22:02:06 juju-e4d256-prod-github-runner-207 kernel: [59900.562725] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 22:02:06 juju-e4d256-prod-github-runner-207 kernel: [59900.563800] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 22:02:06 juju-e4d256-prod-github-runner-207 kernel: [59900.565007] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 22:02:06 juju-e4d256-prod-github-runner-207 kernel: [59900.566170] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 22:02:06 juju-e4d256-prod-github-runner-207 kernel: [59900.567376] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 22:02:06 juju-e4d256-prod-github-runner-207 kernel: [59900.568543] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 22:02:06 juju-e4d256-prod-github-runner-207 kernel: [59900.569728] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 22:02:06 juju-e4d256-prod-github-runner-207 kernel: [59900.570988] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 22:02:06 juju-e4d256-prod-github-runner-207 kernel: [59900.572088] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 22:02:06 juju-e4d256-prod-github-runner-207 kernel: [59900.573284] Call Trace: Aug 22 22:02:06 juju-e4d256-prod-github-runner-207 kernel: [59900.574222] Aug 22 22:02:06 juju-e4d256-prod-github-runner-207 kernel: [59900.575241] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:02:06 juju-e4d256-prod-github-runner-207 kernel: [59900.576307] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:02:06 juju-e4d256-prod-github-runner-207 kernel: [59900.577344] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:02:06 juju-e4d256-prod-github-runner-207 kernel: [59900.578445] ? show_regs.part.0+0x23/0x29 Aug 22 22:02:06 juju-e4d256-prod-github-runner-207 kernel: [59900.579466] ? show_regs.cold+0x8/0xd Aug 22 22:02:06 juju-e4d256-prod-github-runner-207 kernel: [59900.580441] ? watchdog_timer_fn+0x1be/0x220 Aug 22 22:02:06 juju-e4d256-prod-github-runner-207 kernel: [59900.581495] ? lockup_detector_update_enable+0x60/0x60 Aug 22 22:02:06 juju-e4d256-prod-github-runner-207 kernel: [59900.582595] ? __hrtimer_run_queues+0x107/0x230 Aug 22 22:02:06 juju-e4d256-prod-github-runner-207 kernel: [59900.583726] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 22:02:06 juju-e4d256-prod-github-runner-207 kernel: [59900.584781] ? hrtimer_interrupt+0x101/0x220 Aug 22 22:02:06 juju-e4d256-prod-github-runner-207 kernel: [59900.585797] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 22:02:06 juju-e4d256-prod-github-runner-207 kernel: [59900.586863] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 22:02:06 juju-e4d256-prod-github-runner-207 kernel: [59900.587944] Aug 22 22:02:06 juju-e4d256-prod-github-runner-207 kernel: [59900.588876] Aug 22 22:02:06 juju-e4d256-prod-github-runner-207 kernel: [59900.589728] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 22:02:06 juju-e4d256-prod-github-runner-207 kernel: [59900.590762] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:02:06 juju-e4d256-prod-github-runner-207 kernel: [59900.591844] ? _raw_spin_lock+0x22/0x30 Aug 22 22:02:06 juju-e4d256-prod-github-runner-207 kernel: [59900.592862] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:02:06 juju-e4d256-prod-github-runner-207 kernel: [59900.593892] direct_page_fault+0x206/0x310 [kvm] Aug 22 22:02:06 juju-e4d256-prod-github-runner-207 kernel: [59900.594916] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 22:02:06 juju-e4d256-prod-github-runner-207 kernel: [59900.595977] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 22:02:06 juju-e4d256-prod-github-runner-207 kernel: [59900.597036] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 22:02:06 juju-e4d256-prod-github-runner-207 kernel: [59900.598045] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 22:02:06 juju-e4d256-prod-github-runner-207 kernel: [59900.599016] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 22:02:06 juju-e4d256-prod-github-runner-207 kernel: [59900.600044] handle_exit+0x98/0x230 [kvm_amd] Aug 22 22:02:06 juju-e4d256-prod-github-runner-207 kernel: [59900.600957] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 22:02:06 juju-e4d256-prod-github-runner-207 kernel: [59900.601874] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 22:02:06 juju-e4d256-prod-github-runner-207 kernel: [59900.602816] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 22:02:06 juju-e4d256-prod-github-runner-207 kernel: [59900.603742] vcpu_run+0x62/0x2c0 [kvm] Aug 22 22:02:06 juju-e4d256-prod-github-runner-207 kernel: [59900.604608] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 22:02:06 juju-e4d256-prod-github-runner-207 kernel: [59900.605446] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 22:02:06 juju-e4d256-prod-github-runner-207 kernel: [59900.606303] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 22:02:06 juju-e4d256-prod-github-runner-207 kernel: [59900.607119] ? __seccomp_filter+0x4a/0x4a0 Aug 22 22:02:06 juju-e4d256-prod-github-runner-207 kernel: [59900.607884] ? __fget_files+0x86/0xc0 Aug 22 22:02:06 juju-e4d256-prod-github-runner-207 kernel: [59900.608594] __x64_sys_ioctl+0x95/0xd0 Aug 22 22:02:06 juju-e4d256-prod-github-runner-207 kernel: [59900.609287] do_syscall_64+0x5c/0xc0 Aug 22 22:02:06 juju-e4d256-prod-github-runner-207 kernel: [59900.609953] ? do_futex+0x162/0x1f0 Aug 22 22:02:06 juju-e4d256-prod-github-runner-207 kernel: [59900.610600] ? __x64_sys_futex+0x78/0x1e0 Aug 22 22:02:06 juju-e4d256-prod-github-runner-207 kernel: [59900.611288] ? __secure_computing+0xa9/0x120 Aug 22 22:02:06 juju-e4d256-prod-github-runner-207 kernel: [59900.611981] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 22:02:06 juju-e4d256-prod-github-runner-207 kernel: [59900.612750] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:02:06 juju-e4d256-prod-github-runner-207 kernel: [59900.613471] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:02:06 juju-e4d256-prod-github-runner-207 kernel: [59900.614191] ? do_syscall_64+0x69/0xc0 Aug 22 22:02:06 juju-e4d256-prod-github-runner-207 kernel: [59900.614837] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:02:06 juju-e4d256-prod-github-runner-207 kernel: [59900.615562] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:02:06 juju-e4d256-prod-github-runner-207 kernel: [59900.616257] ? do_syscall_64+0x69/0xc0 Aug 22 22:02:06 juju-e4d256-prod-github-runner-207 kernel: [59900.616884] ? do_syscall_64+0x69/0xc0 Aug 22 22:02:06 juju-e4d256-prod-github-runner-207 kernel: [59900.617511] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 22:02:06 juju-e4d256-prod-github-runner-207 kernel: [59900.618217] RIP: 0033:0x7faa5d0edaff Aug 22 22:02:06 juju-e4d256-prod-github-runner-207 kernel: [59900.618875] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 22:02:06 juju-e4d256-prod-github-runner-207 kernel: [59900.620896] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 22:02:06 juju-e4d256-prod-github-runner-207 kernel: [59900.621811] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 22:02:06 juju-e4d256-prod-github-runner-207 kernel: [59900.622699] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 22:02:06 juju-e4d256-prod-github-runner-207 kernel: [59900.623611] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 22:02:06 juju-e4d256-prod-github-runner-207 kernel: [59900.624525] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 22:02:06 juju-e4d256-prod-github-runner-207 kernel: [59900.625412] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 22:02:06 juju-e4d256-prod-github-runner-207 kernel: [59900.626299] Aug 22 22:02:34 juju-e4d256-prod-github-runner-207 kernel: [59928.541981] watchdog: BUG: soft lockup - CPU#1 stuck for 55704s! [qemu-system-x86:6715] Aug 22 22:02:34 juju-e4d256-prod-github-runner-207 kernel: [59928.543129] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 22:02:34 juju-e4d256-prod-github-runner-207 kernel: [59928.543205] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 22:02:34 juju-e4d256-prod-github-runner-207 kernel: [59928.555629] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 22:02:34 juju-e4d256-prod-github-runner-207 kernel: [59928.556891] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 22:02:34 juju-e4d256-prod-github-runner-207 kernel: [59928.558107] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:02:34 juju-e4d256-prod-github-runner-207 kernel: [59928.559181] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 22:02:34 juju-e4d256-prod-github-runner-207 kernel: [59928.561736] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 22:02:34 juju-e4d256-prod-github-runner-207 kernel: [59928.562802] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 22:02:34 juju-e4d256-prod-github-runner-207 kernel: [59928.563979] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 22:02:34 juju-e4d256-prod-github-runner-207 kernel: [59928.565151] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 22:02:34 juju-e4d256-prod-github-runner-207 kernel: [59928.566313] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 22:02:34 juju-e4d256-prod-github-runner-207 kernel: [59928.567500] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 22:02:34 juju-e4d256-prod-github-runner-207 kernel: [59928.568662] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 22:02:34 juju-e4d256-prod-github-runner-207 kernel: [59928.569890] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 22:02:34 juju-e4d256-prod-github-runner-207 kernel: [59928.571000] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 22:02:34 juju-e4d256-prod-github-runner-207 kernel: [59928.572231] Call Trace: Aug 22 22:02:34 juju-e4d256-prod-github-runner-207 kernel: [59928.573148] Aug 22 22:02:34 juju-e4d256-prod-github-runner-207 kernel: [59928.574031] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:02:34 juju-e4d256-prod-github-runner-207 kernel: [59928.575084] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:02:34 juju-e4d256-prod-github-runner-207 kernel: [59928.576115] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:02:34 juju-e4d256-prod-github-runner-207 kernel: [59928.577202] ? show_regs.part.0+0x23/0x29 Aug 22 22:02:34 juju-e4d256-prod-github-runner-207 kernel: [59928.578217] ? show_regs.cold+0x8/0xd Aug 22 22:02:34 juju-e4d256-prod-github-runner-207 kernel: [59928.579246] ? watchdog_timer_fn+0x1be/0x220 Aug 22 22:02:34 juju-e4d256-prod-github-runner-207 kernel: [59928.580256] ? lockup_detector_update_enable+0x60/0x60 Aug 22 22:02:34 juju-e4d256-prod-github-runner-207 kernel: [59928.581346] ? __hrtimer_run_queues+0x107/0x230 Aug 22 22:02:34 juju-e4d256-prod-github-runner-207 kernel: [59928.582385] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 22:02:34 juju-e4d256-prod-github-runner-207 kernel: [59928.583473] ? hrtimer_interrupt+0x101/0x220 Aug 22 22:02:34 juju-e4d256-prod-github-runner-207 kernel: [59928.584527] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 22:02:34 juju-e4d256-prod-github-runner-207 kernel: [59928.585614] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 22:02:34 juju-e4d256-prod-github-runner-207 kernel: [59928.586684] Aug 22 22:02:34 juju-e4d256-prod-github-runner-207 kernel: [59928.587536] Aug 22 22:02:34 juju-e4d256-prod-github-runner-207 kernel: [59928.588382] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 22:02:34 juju-e4d256-prod-github-runner-207 kernel: [59928.589432] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:02:34 juju-e4d256-prod-github-runner-207 kernel: [59928.590472] ? _raw_spin_lock+0x22/0x30 Aug 22 22:02:34 juju-e4d256-prod-github-runner-207 kernel: [59928.591435] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:02:34 juju-e4d256-prod-github-runner-207 kernel: [59928.592453] direct_page_fault+0x206/0x310 [kvm] Aug 22 22:02:34 juju-e4d256-prod-github-runner-207 kernel: [59928.593485] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 22:02:34 juju-e4d256-prod-github-runner-207 kernel: [59928.594492] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 22:02:34 juju-e4d256-prod-github-runner-207 kernel: [59928.595510] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 22:02:34 juju-e4d256-prod-github-runner-207 kernel: [59928.596479] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 22:02:34 juju-e4d256-prod-github-runner-207 kernel: [59928.597423] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 22:02:34 juju-e4d256-prod-github-runner-207 kernel: [59928.598403] handle_exit+0x98/0x230 [kvm_amd] Aug 22 22:02:34 juju-e4d256-prod-github-runner-207 kernel: [59928.599308] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 22:02:34 juju-e4d256-prod-github-runner-207 kernel: [59928.600224] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 22:02:34 juju-e4d256-prod-github-runner-207 kernel: [59928.601159] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 22:02:34 juju-e4d256-prod-github-runner-207 kernel: [59928.602087] vcpu_run+0x62/0x2c0 [kvm] Aug 22 22:02:34 juju-e4d256-prod-github-runner-207 kernel: [59928.602926] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 22:02:34 juju-e4d256-prod-github-runner-207 kernel: [59928.603740] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 22:02:34 juju-e4d256-prod-github-runner-207 kernel: [59928.604595] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 22:02:34 juju-e4d256-prod-github-runner-207 kernel: [59928.605403] ? __seccomp_filter+0x4a/0x4a0 Aug 22 22:02:34 juju-e4d256-prod-github-runner-207 kernel: [59928.606155] ? __fget_files+0x86/0xc0 Aug 22 22:02:34 juju-e4d256-prod-github-runner-207 kernel: [59928.606897] __x64_sys_ioctl+0x95/0xd0 Aug 22 22:02:34 juju-e4d256-prod-github-runner-207 kernel: [59928.607601] do_syscall_64+0x5c/0xc0 Aug 22 22:02:34 juju-e4d256-prod-github-runner-207 kernel: [59928.608278] ? do_futex+0x162/0x1f0 Aug 22 22:02:34 juju-e4d256-prod-github-runner-207 kernel: [59928.608940] ? __x64_sys_futex+0x78/0x1e0 Aug 22 22:02:34 juju-e4d256-prod-github-runner-207 kernel: [59928.609615] ? __secure_computing+0xa9/0x120 Aug 22 22:02:34 juju-e4d256-prod-github-runner-207 kernel: [59928.610308] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 22:02:34 juju-e4d256-prod-github-runner-207 kernel: [59928.611093] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:02:34 juju-e4d256-prod-github-runner-207 kernel: [59928.611815] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:02:34 juju-e4d256-prod-github-runner-207 kernel: [59928.612532] ? do_syscall_64+0x69/0xc0 Aug 22 22:02:34 juju-e4d256-prod-github-runner-207 kernel: [59928.613182] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:02:34 juju-e4d256-prod-github-runner-207 kernel: [59928.613883] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:02:34 juju-e4d256-prod-github-runner-207 kernel: [59928.614581] ? do_syscall_64+0x69/0xc0 Aug 22 22:02:34 juju-e4d256-prod-github-runner-207 kernel: [59928.615219] ? do_syscall_64+0x69/0xc0 Aug 22 22:02:34 juju-e4d256-prod-github-runner-207 kernel: [59928.615867] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 22:02:34 juju-e4d256-prod-github-runner-207 kernel: [59928.616580] RIP: 0033:0x7faa5d0edaff Aug 22 22:02:34 juju-e4d256-prod-github-runner-207 kernel: [59928.617257] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 22:02:34 juju-e4d256-prod-github-runner-207 kernel: [59928.619415] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 22:02:34 juju-e4d256-prod-github-runner-207 kernel: [59928.620521] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 22:02:34 juju-e4d256-prod-github-runner-207 kernel: [59928.621416] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 22:02:34 juju-e4d256-prod-github-runner-207 kernel: [59928.622307] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 22:02:34 juju-e4d256-prod-github-runner-207 kernel: [59928.623221] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 22:02:34 juju-e4d256-prod-github-runner-207 kernel: [59928.624114] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 22:02:34 juju-e4d256-prod-github-runner-207 kernel: [59928.625017] Aug 22 22:02:47 juju-e4d256-prod-github-runner-207 kernel: [59941.184717] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 22:02:47 juju-e4d256-prod-github-runner-207 kernel: [59941.186059] rcu: 1-....: (14908916 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=7203637 Aug 22 22:02:47 juju-e4d256-prod-github-runner-207 kernel: [59941.187516] (t=14955996 jiffies g=23269 q=53875) Aug 22 22:02:47 juju-e4d256-prod-github-runner-207 kernel: [59941.188523] NMI backtrace for cpu 1 Aug 22 22:02:47 juju-e4d256-prod-github-runner-207 kernel: [59941.189609] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 22:02:47 juju-e4d256-prod-github-runner-207 kernel: [59941.191033] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 22:02:47 juju-e4d256-prod-github-runner-207 kernel: [59941.192215] Call Trace: Aug 22 22:02:47 juju-e4d256-prod-github-runner-207 kernel: [59941.192972] Aug 22 22:02:47 juju-e4d256-prod-github-runner-207 kernel: [59941.193676] show_stack+0x52/0x5c Aug 22 22:02:47 juju-e4d256-prod-github-runner-207 kernel: [59941.194521] dump_stack_lvl+0x4a/0x63 Aug 22 22:02:47 juju-e4d256-prod-github-runner-207 kernel: [59941.195576] dump_stack+0x10/0x16 Aug 22 22:02:47 juju-e4d256-prod-github-runner-207 kernel: [59941.196366] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 22:02:47 juju-e4d256-prod-github-runner-207 kernel: [59941.197246] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 22:02:47 juju-e4d256-prod-github-runner-207 kernel: [59941.198113] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 22:02:47 juju-e4d256-prod-github-runner-207 kernel: [59941.199051] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 22:02:47 juju-e4d256-prod-github-runner-207 kernel: [59941.199978] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 22:02:47 juju-e4d256-prod-github-runner-207 kernel: [59941.200886] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 22:02:47 juju-e4d256-prod-github-runner-207 kernel: [59941.201764] print_cpu_stall.cold+0x2f/0xe2 Aug 22 22:02:47 juju-e4d256-prod-github-runner-207 kernel: [59941.202641] ? timekeeping_update+0xf7/0x150 Aug 22 22:02:47 juju-e4d256-prod-github-runner-207 kernel: [59941.203505] check_cpu_stall+0x109/0x270 Aug 22 22:02:47 juju-e4d256-prod-github-runner-207 kernel: [59941.204338] rcu_sched_clock_irq+0x9a/0x250 Aug 22 22:02:47 juju-e4d256-prod-github-runner-207 kernel: [59941.205194] update_process_times+0x94/0xd0 Aug 22 22:02:47 juju-e4d256-prod-github-runner-207 kernel: [59941.206052] tick_sched_handle+0x29/0x70 Aug 22 22:02:47 juju-e4d256-prod-github-runner-207 kernel: [59941.206929] tick_sched_timer+0x8c/0xc0 Aug 22 22:02:47 juju-e4d256-prod-github-runner-207 kernel: [59941.207756] ? tick_nohz_handler+0xb0/0xb0 Aug 22 22:02:47 juju-e4d256-prod-github-runner-207 kernel: [59941.208596] __hrtimer_run_queues+0x107/0x230 Aug 22 22:02:47 juju-e4d256-prod-github-runner-207 kernel: [59941.209458] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 22:02:47 juju-e4d256-prod-github-runner-207 kernel: [59941.210332] hrtimer_interrupt+0x101/0x220 Aug 22 22:02:47 juju-e4d256-prod-github-runner-207 kernel: [59941.211208] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 22:02:47 juju-e4d256-prod-github-runner-207 kernel: [59941.212123] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 22:02:47 juju-e4d256-prod-github-runner-207 kernel: [59941.213033] Aug 22 22:02:47 juju-e4d256-prod-github-runner-207 kernel: [59941.213772] Aug 22 22:02:47 juju-e4d256-prod-github-runner-207 kernel: [59941.214473] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 22:02:47 juju-e4d256-prod-github-runner-207 kernel: [59941.215401] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:02:47 juju-e4d256-prod-github-runner-207 kernel: [59941.216398] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 22:02:47 juju-e4d256-prod-github-runner-207 kernel: [59941.218976] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 22:02:47 juju-e4d256-prod-github-runner-207 kernel: [59941.219970] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 22:02:47 juju-e4d256-prod-github-runner-207 kernel: [59941.221098] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 22:02:47 juju-e4d256-prod-github-runner-207 kernel: [59941.222209] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 22:02:47 juju-e4d256-prod-github-runner-207 kernel: [59941.223329] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 22:02:47 juju-e4d256-prod-github-runner-207 kernel: [59941.224420] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 22:02:47 juju-e4d256-prod-github-runner-207 kernel: [59941.225509] ? _raw_spin_lock+0x22/0x30 Aug 22 22:02:47 juju-e4d256-prod-github-runner-207 kernel: [59941.226344] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:02:47 juju-e4d256-prod-github-runner-207 kernel: [59941.227289] direct_page_fault+0x206/0x310 [kvm] Aug 22 22:02:47 juju-e4d256-prod-github-runner-207 kernel: [59941.228245] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 22:02:47 juju-e4d256-prod-github-runner-207 kernel: [59941.229166] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 22:02:47 juju-e4d256-prod-github-runner-207 kernel: [59941.230087] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 22:02:47 juju-e4d256-prod-github-runner-207 kernel: [59941.231013] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 22:02:47 juju-e4d256-prod-github-runner-207 kernel: [59941.231900] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 22:02:47 juju-e4d256-prod-github-runner-207 kernel: [59941.232839] handle_exit+0x98/0x230 [kvm_amd] Aug 22 22:02:47 juju-e4d256-prod-github-runner-207 kernel: [59941.233727] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 22:02:47 juju-e4d256-prod-github-runner-207 kernel: [59941.234668] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 22:02:47 juju-e4d256-prod-github-runner-207 kernel: [59941.235569] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 22:02:47 juju-e4d256-prod-github-runner-207 kernel: [59941.236454] vcpu_run+0x62/0x2c0 [kvm] Aug 22 22:02:47 juju-e4d256-prod-github-runner-207 kernel: [59941.237249] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 22:02:47 juju-e4d256-prod-github-runner-207 kernel: [59941.238071] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 22:02:47 juju-e4d256-prod-github-runner-207 kernel: [59941.238993] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 22:02:47 juju-e4d256-prod-github-runner-207 kernel: [59941.239844] ? __seccomp_filter+0x4a/0x4a0 Aug 22 22:02:47 juju-e4d256-prod-github-runner-207 kernel: [59941.240653] ? __fget_files+0x86/0xc0 Aug 22 22:02:47 juju-e4d256-prod-github-runner-207 kernel: [59941.241427] __x64_sys_ioctl+0x95/0xd0 Aug 22 22:02:47 juju-e4d256-prod-github-runner-207 kernel: [59941.242208] do_syscall_64+0x5c/0xc0 Aug 22 22:02:47 juju-e4d256-prod-github-runner-207 kernel: [59941.242998] ? do_futex+0x162/0x1f0 Aug 22 22:02:47 juju-e4d256-prod-github-runner-207 kernel: [59941.243746] ? __x64_sys_futex+0x78/0x1e0 Aug 22 22:02:47 juju-e4d256-prod-github-runner-207 kernel: [59941.244533] ? __secure_computing+0xa9/0x120 Aug 22 22:02:47 juju-e4d256-prod-github-runner-207 kernel: [59941.245346] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 22:02:47 juju-e4d256-prod-github-runner-207 kernel: [59941.246249] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:02:47 juju-e4d256-prod-github-runner-207 kernel: [59941.247144] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:02:47 juju-e4d256-prod-github-runner-207 kernel: [59941.247999] ? do_syscall_64+0x69/0xc0 Aug 22 22:02:47 juju-e4d256-prod-github-runner-207 kernel: [59941.248768] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:02:47 juju-e4d256-prod-github-runner-207 kernel: [59941.249633] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:02:47 juju-e4d256-prod-github-runner-207 kernel: [59941.250518] ? do_syscall_64+0x69/0xc0 Aug 22 22:02:47 juju-e4d256-prod-github-runner-207 kernel: [59941.251293] ? do_syscall_64+0x69/0xc0 Aug 22 22:02:47 juju-e4d256-prod-github-runner-207 kernel: [59941.252066] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 22:02:47 juju-e4d256-prod-github-runner-207 kernel: [59941.252938] RIP: 0033:0x7faa5d0edaff Aug 22 22:02:47 juju-e4d256-prod-github-runner-207 kernel: [59941.253692] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 22:02:47 juju-e4d256-prod-github-runner-207 kernel: [59941.256156] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 22:02:47 juju-e4d256-prod-github-runner-207 kernel: [59941.257265] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 22:02:47 juju-e4d256-prod-github-runner-207 kernel: [59941.258347] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 22:02:47 juju-e4d256-prod-github-runner-207 kernel: [59941.259512] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 22:02:47 juju-e4d256-prod-github-runner-207 kernel: [59941.260593] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 22:02:47 juju-e4d256-prod-github-runner-207 kernel: [59941.261658] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 22:02:47 juju-e4d256-prod-github-runner-207 kernel: [59941.262771] Aug 22 22:03:14 juju-e4d256-prod-github-runner-207 kernel: [59968.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 55742s! [qemu-system-x86:6715] Aug 22 22:03:14 juju-e4d256-prod-github-runner-207 kernel: [59968.543149] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 22:03:14 juju-e4d256-prod-github-runner-207 kernel: [59968.543222] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 22:03:14 juju-e4d256-prod-github-runner-207 kernel: [59968.555472] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 22:03:14 juju-e4d256-prod-github-runner-207 kernel: [59968.556796] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 22:03:14 juju-e4d256-prod-github-runner-207 kernel: [59968.558303] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:03:14 juju-e4d256-prod-github-runner-207 kernel: [59968.559374] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 22:03:14 juju-e4d256-prod-github-runner-207 kernel: [59968.562131] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 22:03:14 juju-e4d256-prod-github-runner-207 kernel: [59968.563200] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 22:03:14 juju-e4d256-prod-github-runner-207 kernel: [59968.564582] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 22:03:14 juju-e4d256-prod-github-runner-207 kernel: [59968.565765] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 22:03:14 juju-e4d256-prod-github-runner-207 kernel: [59968.566959] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 22:03:14 juju-e4d256-prod-github-runner-207 kernel: [59968.568165] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 22:03:14 juju-e4d256-prod-github-runner-207 kernel: [59968.569356] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 22:03:14 juju-e4d256-prod-github-runner-207 kernel: [59968.570753] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 22:03:14 juju-e4d256-prod-github-runner-207 kernel: [59968.571861] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 22:03:14 juju-e4d256-prod-github-runner-207 kernel: [59968.573066] Call Trace: Aug 22 22:03:14 juju-e4d256-prod-github-runner-207 kernel: [59968.573988] Aug 22 22:03:14 juju-e4d256-prod-github-runner-207 kernel: [59968.574896] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:03:14 juju-e4d256-prod-github-runner-207 kernel: [59968.575938] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:03:14 juju-e4d256-prod-github-runner-207 kernel: [59968.576973] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:03:14 juju-e4d256-prod-github-runner-207 kernel: [59968.578056] ? show_regs.part.0+0x23/0x29 Aug 22 22:03:14 juju-e4d256-prod-github-runner-207 kernel: [59968.579095] ? show_regs.cold+0x8/0xd Aug 22 22:03:14 juju-e4d256-prod-github-runner-207 kernel: [59968.580069] ? watchdog_timer_fn+0x1be/0x220 Aug 22 22:03:14 juju-e4d256-prod-github-runner-207 kernel: [59968.581110] ? lockup_detector_update_enable+0x60/0x60 Aug 22 22:03:14 juju-e4d256-prod-github-runner-207 kernel: [59968.582216] ? __hrtimer_run_queues+0x107/0x230 Aug 22 22:03:14 juju-e4d256-prod-github-runner-207 kernel: [59968.583252] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 22:03:14 juju-e4d256-prod-github-runner-207 kernel: [59968.584272] ? hrtimer_interrupt+0x101/0x220 Aug 22 22:03:14 juju-e4d256-prod-github-runner-207 kernel: [59968.585284] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 22:03:14 juju-e4d256-prod-github-runner-207 kernel: [59968.586374] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 22:03:14 juju-e4d256-prod-github-runner-207 kernel: [59968.587608] Aug 22 22:03:14 juju-e4d256-prod-github-runner-207 kernel: [59968.588463] Aug 22 22:03:14 juju-e4d256-prod-github-runner-207 kernel: [59968.589300] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 22:03:14 juju-e4d256-prod-github-runner-207 kernel: [59968.590397] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:03:14 juju-e4d256-prod-github-runner-207 kernel: [59968.591469] ? _raw_spin_lock+0x22/0x30 Aug 22 22:03:14 juju-e4d256-prod-github-runner-207 kernel: [59968.592424] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:03:14 juju-e4d256-prod-github-runner-207 kernel: [59968.593449] direct_page_fault+0x206/0x310 [kvm] Aug 22 22:03:14 juju-e4d256-prod-github-runner-207 kernel: [59968.594490] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 22:03:14 juju-e4d256-prod-github-runner-207 kernel: [59968.595510] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 22:03:14 juju-e4d256-prod-github-runner-207 kernel: [59968.596692] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 22:03:14 juju-e4d256-prod-github-runner-207 kernel: [59968.597685] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 22:03:14 juju-e4d256-prod-github-runner-207 kernel: [59968.598662] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 22:03:14 juju-e4d256-prod-github-runner-207 kernel: [59968.599670] handle_exit+0x98/0x230 [kvm_amd] Aug 22 22:03:14 juju-e4d256-prod-github-runner-207 kernel: [59968.600598] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 22:03:14 juju-e4d256-prod-github-runner-207 kernel: [59968.601579] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 22:03:14 juju-e4d256-prod-github-runner-207 kernel: [59968.602620] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 22:03:14 juju-e4d256-prod-github-runner-207 kernel: [59968.603758] vcpu_run+0x62/0x2c0 [kvm] Aug 22 22:03:14 juju-e4d256-prod-github-runner-207 kernel: [59968.604816] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 22:03:14 juju-e4d256-prod-github-runner-207 kernel: [59968.605717] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 22:03:14 juju-e4d256-prod-github-runner-207 kernel: [59968.606649] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 22:03:14 juju-e4d256-prod-github-runner-207 kernel: [59968.607594] ? __seccomp_filter+0x4a/0x4a0 Aug 22 22:03:14 juju-e4d256-prod-github-runner-207 kernel: [59968.608483] ? __fget_files+0x86/0xc0 Aug 22 22:03:14 juju-e4d256-prod-github-runner-207 kernel: [59968.609226] __x64_sys_ioctl+0x95/0xd0 Aug 22 22:03:14 juju-e4d256-prod-github-runner-207 kernel: [59968.609961] do_syscall_64+0x5c/0xc0 Aug 22 22:03:14 juju-e4d256-prod-github-runner-207 kernel: [59968.610806] ? do_futex+0x162/0x1f0 Aug 22 22:03:14 juju-e4d256-prod-github-runner-207 kernel: [59968.611485] ? __x64_sys_futex+0x78/0x1e0 Aug 22 22:03:14 juju-e4d256-prod-github-runner-207 kernel: [59968.612379] ? __secure_computing+0xa9/0x120 Aug 22 22:03:14 juju-e4d256-prod-github-runner-207 kernel: [59968.613170] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 22:03:14 juju-e4d256-prod-github-runner-207 kernel: [59968.614074] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:03:14 juju-e4d256-prod-github-runner-207 kernel: [59968.614950] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:03:14 juju-e4d256-prod-github-runner-207 kernel: [59968.615758] ? do_syscall_64+0x69/0xc0 Aug 22 22:03:14 juju-e4d256-prod-github-runner-207 kernel: [59968.616539] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:03:14 juju-e4d256-prod-github-runner-207 kernel: [59968.617259] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:03:14 juju-e4d256-prod-github-runner-207 kernel: [59968.618001] ? do_syscall_64+0x69/0xc0 Aug 22 22:03:14 juju-e4d256-prod-github-runner-207 kernel: [59968.618715] ? do_syscall_64+0x69/0xc0 Aug 22 22:03:14 juju-e4d256-prod-github-runner-207 kernel: [59968.619376] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 22:03:14 juju-e4d256-prod-github-runner-207 kernel: [59968.620137] RIP: 0033:0x7faa5d0edaff Aug 22 22:03:14 juju-e4d256-prod-github-runner-207 kernel: [59968.623210] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 22:03:14 juju-e4d256-prod-github-runner-207 kernel: [59968.625228] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 22:03:14 juju-e4d256-prod-github-runner-207 kernel: [59968.626163] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 22:03:14 juju-e4d256-prod-github-runner-207 kernel: [59968.627068] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 22:03:14 juju-e4d256-prod-github-runner-207 kernel: [59968.627963] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 22:03:14 juju-e4d256-prod-github-runner-207 kernel: [59968.628852] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 22:03:14 juju-e4d256-prod-github-runner-207 kernel: [59968.629747] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 22:03:14 juju-e4d256-prod-github-runner-207 kernel: [59968.630669] Aug 22 22:03:42 juju-e4d256-prod-github-runner-207 kernel: [59996.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 55768s! [qemu-system-x86:6715] Aug 22 22:03:42 juju-e4d256-prod-github-runner-207 kernel: [59996.543987] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 22:03:42 juju-e4d256-prod-github-runner-207 kernel: [59996.544312] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 22:03:42 juju-e4d256-prod-github-runner-207 kernel: [59996.556731] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 22:03:42 juju-e4d256-prod-github-runner-207 kernel: [59996.558043] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 22:03:42 juju-e4d256-prod-github-runner-207 kernel: [59996.559632] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:03:42 juju-e4d256-prod-github-runner-207 kernel: [59996.560710] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 22:03:42 juju-e4d256-prod-github-runner-207 kernel: [59996.563327] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 22:03:42 juju-e4d256-prod-github-runner-207 kernel: [59996.564417] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 22:03:42 juju-e4d256-prod-github-runner-207 kernel: [59996.565593] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 22:03:42 juju-e4d256-prod-github-runner-207 kernel: [59996.566775] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 22:03:42 juju-e4d256-prod-github-runner-207 kernel: [59996.567956] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 22:03:42 juju-e4d256-prod-github-runner-207 kernel: [59996.569142] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 22:03:42 juju-e4d256-prod-github-runner-207 kernel: [59996.570337] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 22:03:42 juju-e4d256-prod-github-runner-207 kernel: [59996.571587] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 22:03:42 juju-e4d256-prod-github-runner-207 kernel: [59996.572695] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 22:03:42 juju-e4d256-prod-github-runner-207 kernel: [59996.573926] Call Trace: Aug 22 22:03:42 juju-e4d256-prod-github-runner-207 kernel: [59996.574860] Aug 22 22:03:42 juju-e4d256-prod-github-runner-207 kernel: [59996.575773] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:03:42 juju-e4d256-prod-github-runner-207 kernel: [59996.576815] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:03:42 juju-e4d256-prod-github-runner-207 kernel: [59996.577862] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:03:42 juju-e4d256-prod-github-runner-207 kernel: [59996.578976] ? show_regs.part.0+0x23/0x29 Aug 22 22:03:42 juju-e4d256-prod-github-runner-207 kernel: [59996.579988] ? show_regs.cold+0x8/0xd Aug 22 22:03:42 juju-e4d256-prod-github-runner-207 kernel: [59996.580974] ? watchdog_timer_fn+0x1be/0x220 Aug 22 22:03:42 juju-e4d256-prod-github-runner-207 kernel: [59996.582026] ? lockup_detector_update_enable+0x60/0x60 Aug 22 22:03:42 juju-e4d256-prod-github-runner-207 kernel: [59996.583107] ? __hrtimer_run_queues+0x107/0x230 Aug 22 22:03:42 juju-e4d256-prod-github-runner-207 kernel: [59996.584156] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 22:03:42 juju-e4d256-prod-github-runner-207 kernel: [59996.585195] ? hrtimer_interrupt+0x101/0x220 Aug 22 22:03:42 juju-e4d256-prod-github-runner-207 kernel: [59996.586241] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 22:03:42 juju-e4d256-prod-github-runner-207 kernel: [59996.587322] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 22:03:42 juju-e4d256-prod-github-runner-207 kernel: [59996.588375] Aug 22 22:03:42 juju-e4d256-prod-github-runner-207 kernel: [59996.589242] Aug 22 22:03:42 juju-e4d256-prod-github-runner-207 kernel: [59996.590115] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 22:03:42 juju-e4d256-prod-github-runner-207 kernel: [59996.591156] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:03:42 juju-e4d256-prod-github-runner-207 kernel: [59996.592198] ? _raw_spin_lock+0x22/0x30 Aug 22 22:03:42 juju-e4d256-prod-github-runner-207 kernel: [59996.593159] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:03:42 juju-e4d256-prod-github-runner-207 kernel: [59996.594226] direct_page_fault+0x206/0x310 [kvm] Aug 22 22:03:42 juju-e4d256-prod-github-runner-207 kernel: [59996.595308] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 22:03:42 juju-e4d256-prod-github-runner-207 kernel: [59996.596356] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 22:03:42 juju-e4d256-prod-github-runner-207 kernel: [59996.597377] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 22:03:42 juju-e4d256-prod-github-runner-207 kernel: [59996.598431] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 22:03:42 juju-e4d256-prod-github-runner-207 kernel: [59996.599398] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 22:03:42 juju-e4d256-prod-github-runner-207 kernel: [59996.600395] handle_exit+0x98/0x230 [kvm_amd] Aug 22 22:03:42 juju-e4d256-prod-github-runner-207 kernel: [59996.601296] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 22:03:42 juju-e4d256-prod-github-runner-207 kernel: [59996.602241] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 22:03:42 juju-e4d256-prod-github-runner-207 kernel: [59996.603188] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 22:03:42 juju-e4d256-prod-github-runner-207 kernel: [59996.604161] vcpu_run+0x62/0x2c0 [kvm] Aug 22 22:03:42 juju-e4d256-prod-github-runner-207 kernel: [59996.604987] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 22:03:42 juju-e4d256-prod-github-runner-207 kernel: [59996.605841] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 22:03:42 juju-e4d256-prod-github-runner-207 kernel: [59996.606748] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 22:03:42 juju-e4d256-prod-github-runner-207 kernel: [59996.607568] ? __seccomp_filter+0x4a/0x4a0 Aug 22 22:03:42 juju-e4d256-prod-github-runner-207 kernel: [59996.608399] ? __fget_files+0x86/0xc0 Aug 22 22:03:42 juju-e4d256-prod-github-runner-207 kernel: [59996.609122] __x64_sys_ioctl+0x95/0xd0 Aug 22 22:03:42 juju-e4d256-prod-github-runner-207 kernel: [59996.609859] do_syscall_64+0x5c/0xc0 Aug 22 22:03:42 juju-e4d256-prod-github-runner-207 kernel: [59996.610542] ? do_futex+0x162/0x1f0 Aug 22 22:03:42 juju-e4d256-prod-github-runner-207 kernel: [59996.611202] ? __x64_sys_futex+0x78/0x1e0 Aug 22 22:03:42 juju-e4d256-prod-github-runner-207 kernel: [59996.611906] ? __secure_computing+0xa9/0x120 Aug 22 22:03:42 juju-e4d256-prod-github-runner-207 kernel: [59996.612610] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 22:03:42 juju-e4d256-prod-github-runner-207 kernel: [59996.613402] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:03:42 juju-e4d256-prod-github-runner-207 kernel: [59996.614155] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:03:42 juju-e4d256-prod-github-runner-207 kernel: [59996.614905] ? do_syscall_64+0x69/0xc0 Aug 22 22:03:42 juju-e4d256-prod-github-runner-207 kernel: [59996.615574] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:03:42 juju-e4d256-prod-github-runner-207 kernel: [59996.616289] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:03:42 juju-e4d256-prod-github-runner-207 kernel: [59996.616992] ? do_syscall_64+0x69/0xc0 Aug 22 22:03:42 juju-e4d256-prod-github-runner-207 kernel: [59996.617620] ? do_syscall_64+0x69/0xc0 Aug 22 22:03:42 juju-e4d256-prod-github-runner-207 kernel: [59996.618287] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 22:03:42 juju-e4d256-prod-github-runner-207 kernel: [59996.619001] RIP: 0033:0x7faa5d0edaff Aug 22 22:03:42 juju-e4d256-prod-github-runner-207 kernel: [59996.619699] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 22:03:42 juju-e4d256-prod-github-runner-207 kernel: [59996.622281] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 22:03:42 juju-e4d256-prod-github-runner-207 kernel: [59996.623201] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 22:03:42 juju-e4d256-prod-github-runner-207 kernel: [59996.624120] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 22:03:42 juju-e4d256-prod-github-runner-207 kernel: [59996.625451] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 22:03:42 juju-e4d256-prod-github-runner-207 kernel: [59996.626360] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 22:03:42 juju-e4d256-prod-github-runner-207 kernel: [59996.627447] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 22:03:42 juju-e4d256-prod-github-runner-207 kernel: [59996.628378] Aug 22 22:04:10 juju-e4d256-prod-github-runner-207 kernel: [60024.541981] watchdog: BUG: soft lockup - CPU#1 stuck for 55794s! [qemu-system-x86:6715] Aug 22 22:04:10 juju-e4d256-prod-github-runner-207 kernel: [60024.543342] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 22:04:10 juju-e4d256-prod-github-runner-207 kernel: [60024.543416] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 22:04:10 juju-e4d256-prod-github-runner-207 kernel: [60024.556060] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 22:04:10 juju-e4d256-prod-github-runner-207 kernel: [60024.557665] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 22:04:10 juju-e4d256-prod-github-runner-207 kernel: [60024.558921] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:04:10 juju-e4d256-prod-github-runner-207 kernel: [60024.560071] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 22:04:10 juju-e4d256-prod-github-runner-207 kernel: [60024.562972] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 22:04:10 juju-e4d256-prod-github-runner-207 kernel: [60024.564108] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 22:04:10 juju-e4d256-prod-github-runner-207 kernel: [60024.566258] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 22:04:10 juju-e4d256-prod-github-runner-207 kernel: [60024.567909] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 22:04:10 juju-e4d256-prod-github-runner-207 kernel: [60024.569443] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 22:04:10 juju-e4d256-prod-github-runner-207 kernel: [60024.570912] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 22:04:10 juju-e4d256-prod-github-runner-207 kernel: [60024.572768] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 22:04:10 juju-e4d256-prod-github-runner-207 kernel: [60024.574469] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 22:04:10 juju-e4d256-prod-github-runner-207 kernel: [60024.575903] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 22:04:10 juju-e4d256-prod-github-runner-207 kernel: [60024.577447] Call Trace: Aug 22 22:04:10 juju-e4d256-prod-github-runner-207 kernel: [60024.578474] Aug 22 22:04:10 juju-e4d256-prod-github-runner-207 kernel: [60024.579646] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:04:10 juju-e4d256-prod-github-runner-207 kernel: [60024.581253] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:04:10 juju-e4d256-prod-github-runner-207 kernel: [60024.582674] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:04:10 juju-e4d256-prod-github-runner-207 kernel: [60024.584019] ? show_regs.part.0+0x23/0x29 Aug 22 22:04:10 juju-e4d256-prod-github-runner-207 kernel: [60024.585294] ? show_regs.cold+0x8/0xd Aug 22 22:04:10 juju-e4d256-prod-github-runner-207 kernel: [60024.586686] ? watchdog_timer_fn+0x1be/0x220 Aug 22 22:04:10 juju-e4d256-prod-github-runner-207 kernel: [60024.587939] ? lockup_detector_update_enable+0x60/0x60 Aug 22 22:04:10 juju-e4d256-prod-github-runner-207 kernel: [60024.589612] ? __hrtimer_run_queues+0x107/0x230 Aug 22 22:04:10 juju-e4d256-prod-github-runner-207 kernel: [60024.590891] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 22:04:10 juju-e4d256-prod-github-runner-207 kernel: [60024.592260] ? hrtimer_interrupt+0x101/0x220 Aug 22 22:04:10 juju-e4d256-prod-github-runner-207 kernel: [60024.593832] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 22:04:10 juju-e4d256-prod-github-runner-207 kernel: [60024.595362] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 22:04:10 juju-e4d256-prod-github-runner-207 kernel: [60024.596885] Aug 22 22:04:10 juju-e4d256-prod-github-runner-207 kernel: [60024.597875] Aug 22 22:04:10 juju-e4d256-prod-github-runner-207 kernel: [60024.599083] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 22:04:10 juju-e4d256-prod-github-runner-207 kernel: [60024.600492] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:04:10 juju-e4d256-prod-github-runner-207 kernel: [60024.601796] ? _raw_spin_lock+0x22/0x30 Aug 22 22:04:10 juju-e4d256-prod-github-runner-207 kernel: [60024.603281] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:04:10 juju-e4d256-prod-github-runner-207 kernel: [60024.604673] direct_page_fault+0x206/0x310 [kvm] Aug 22 22:04:10 juju-e4d256-prod-github-runner-207 kernel: [60024.606122] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 22:04:10 juju-e4d256-prod-github-runner-207 kernel: [60024.607345] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 22:04:10 juju-e4d256-prod-github-runner-207 kernel: [60024.608785] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 22:04:10 juju-e4d256-prod-github-runner-207 kernel: [60024.610270] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 22:04:10 juju-e4d256-prod-github-runner-207 kernel: [60024.611338] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 22:04:10 juju-e4d256-prod-github-runner-207 kernel: [60024.612419] handle_exit+0x98/0x230 [kvm_amd] Aug 22 22:04:10 juju-e4d256-prod-github-runner-207 kernel: [60024.613434] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 22:04:10 juju-e4d256-prod-github-runner-207 kernel: [60024.614425] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 22:04:10 juju-e4d256-prod-github-runner-207 kernel: [60024.615408] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 22:04:10 juju-e4d256-prod-github-runner-207 kernel: [60024.616346] vcpu_run+0x62/0x2c0 [kvm] Aug 22 22:04:10 juju-e4d256-prod-github-runner-207 kernel: [60024.617237] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 22:04:10 juju-e4d256-prod-github-runner-207 kernel: [60024.618093] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 22:04:10 juju-e4d256-prod-github-runner-207 kernel: [60024.619009] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 22:04:10 juju-e4d256-prod-github-runner-207 kernel: [60024.619851] ? __seccomp_filter+0x4a/0x4a0 Aug 22 22:04:10 juju-e4d256-prod-github-runner-207 kernel: [60024.620616] ? __fget_files+0x86/0xc0 Aug 22 22:04:10 juju-e4d256-prod-github-runner-207 kernel: [60024.621328] __x64_sys_ioctl+0x95/0xd0 Aug 22 22:04:10 juju-e4d256-prod-github-runner-207 kernel: [60024.622056] do_syscall_64+0x5c/0xc0 Aug 22 22:04:10 juju-e4d256-prod-github-runner-207 kernel: [60024.622728] ? do_futex+0x162/0x1f0 Aug 22 22:04:10 juju-e4d256-prod-github-runner-207 kernel: [60024.623420] ? __x64_sys_futex+0x78/0x1e0 Aug 22 22:04:10 juju-e4d256-prod-github-runner-207 kernel: [60024.624139] ? __secure_computing+0xa9/0x120 Aug 22 22:04:10 juju-e4d256-prod-github-runner-207 kernel: [60024.624862] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 22:04:10 juju-e4d256-prod-github-runner-207 kernel: [60024.625657] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:04:10 juju-e4d256-prod-github-runner-207 kernel: [60024.626389] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:04:10 juju-e4d256-prod-github-runner-207 kernel: [60024.627129] ? do_syscall_64+0x69/0xc0 Aug 22 22:04:10 juju-e4d256-prod-github-runner-207 kernel: [60024.627868] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:04:10 juju-e4d256-prod-github-runner-207 kernel: [60024.628606] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:04:10 juju-e4d256-prod-github-runner-207 kernel: [60024.629322] ? do_syscall_64+0x69/0xc0 Aug 22 22:04:10 juju-e4d256-prod-github-runner-207 kernel: [60024.630016] ? do_syscall_64+0x69/0xc0 Aug 22 22:04:10 juju-e4d256-prod-github-runner-207 kernel: [60024.630651] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 22:04:10 juju-e4d256-prod-github-runner-207 kernel: [60024.631379] RIP: 0033:0x7faa5d0edaff Aug 22 22:04:10 juju-e4d256-prod-github-runner-207 kernel: [60024.632009] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 22:04:10 juju-e4d256-prod-github-runner-207 kernel: [60024.634049] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 22:04:10 juju-e4d256-prod-github-runner-207 kernel: [60024.635029] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 22:04:10 juju-e4d256-prod-github-runner-207 kernel: [60024.635931] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 22:04:10 juju-e4d256-prod-github-runner-207 kernel: [60024.636835] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 22:04:10 juju-e4d256-prod-github-runner-207 kernel: [60024.637762] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 22:04:10 juju-e4d256-prod-github-runner-207 kernel: [60024.638702] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 22:04:10 juju-e4d256-prod-github-runner-207 kernel: [60024.639706] Aug 22 22:04:38 juju-e4d256-prod-github-runner-207 kernel: [60052.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 55820s! [qemu-system-x86:6715] Aug 22 22:04:38 juju-e4d256-prod-github-runner-207 kernel: [60052.543126] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 22:04:38 juju-e4d256-prod-github-runner-207 kernel: [60052.543200] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 22:04:38 juju-e4d256-prod-github-runner-207 kernel: [60052.555766] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 22:04:38 juju-e4d256-prod-github-runner-207 kernel: [60052.557108] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 22:04:38 juju-e4d256-prod-github-runner-207 kernel: [60052.558416] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:04:38 juju-e4d256-prod-github-runner-207 kernel: [60052.559495] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 22:04:38 juju-e4d256-prod-github-runner-207 kernel: [60052.562275] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 22:04:38 juju-e4d256-prod-github-runner-207 kernel: [60052.563340] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 22:04:38 juju-e4d256-prod-github-runner-207 kernel: [60052.564534] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 22:04:38 juju-e4d256-prod-github-runner-207 kernel: [60052.565850] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 22:04:38 juju-e4d256-prod-github-runner-207 kernel: [60052.567054] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 22:04:38 juju-e4d256-prod-github-runner-207 kernel: [60052.568299] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 22:04:38 juju-e4d256-prod-github-runner-207 kernel: [60052.569528] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 22:04:38 juju-e4d256-prod-github-runner-207 kernel: [60052.570789] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 22:04:38 juju-e4d256-prod-github-runner-207 kernel: [60052.571911] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 22:04:38 juju-e4d256-prod-github-runner-207 kernel: [60052.573145] Call Trace: Aug 22 22:04:38 juju-e4d256-prod-github-runner-207 kernel: [60052.574066] Aug 22 22:04:38 juju-e4d256-prod-github-runner-207 kernel: [60052.574980] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:04:38 juju-e4d256-prod-github-runner-207 kernel: [60052.576045] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:04:38 juju-e4d256-prod-github-runner-207 kernel: [60052.577141] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:04:38 juju-e4d256-prod-github-runner-207 kernel: [60052.578250] ? show_regs.part.0+0x23/0x29 Aug 22 22:04:38 juju-e4d256-prod-github-runner-207 kernel: [60052.579265] ? show_regs.cold+0x8/0xd Aug 22 22:04:38 juju-e4d256-prod-github-runner-207 kernel: [60052.580246] ? watchdog_timer_fn+0x1be/0x220 Aug 22 22:04:38 juju-e4d256-prod-github-runner-207 kernel: [60052.581286] ? lockup_detector_update_enable+0x60/0x60 Aug 22 22:04:38 juju-e4d256-prod-github-runner-207 kernel: [60052.582360] ? __hrtimer_run_queues+0x107/0x230 Aug 22 22:04:38 juju-e4d256-prod-github-runner-207 kernel: [60052.583412] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 22:04:38 juju-e4d256-prod-github-runner-207 kernel: [60052.584452] ? hrtimer_interrupt+0x101/0x220 Aug 22 22:04:38 juju-e4d256-prod-github-runner-207 kernel: [60052.585518] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 22:04:38 juju-e4d256-prod-github-runner-207 kernel: [60052.586603] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 22:04:38 juju-e4d256-prod-github-runner-207 kernel: [60052.587661] Aug 22 22:04:38 juju-e4d256-prod-github-runner-207 kernel: [60052.588524] Aug 22 22:04:38 juju-e4d256-prod-github-runner-207 kernel: [60052.589385] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 22:04:38 juju-e4d256-prod-github-runner-207 kernel: [60052.590435] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:04:38 juju-e4d256-prod-github-runner-207 kernel: [60052.591490] ? _raw_spin_lock+0x22/0x30 Aug 22 22:04:38 juju-e4d256-prod-github-runner-207 kernel: [60052.592451] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:04:38 juju-e4d256-prod-github-runner-207 kernel: [60052.593508] direct_page_fault+0x206/0x310 [kvm] Aug 22 22:04:38 juju-e4d256-prod-github-runner-207 kernel: [60052.594559] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 22:04:38 juju-e4d256-prod-github-runner-207 kernel: [60052.595583] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 22:04:38 juju-e4d256-prod-github-runner-207 kernel: [60052.596599] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 22:04:38 juju-e4d256-prod-github-runner-207 kernel: [60052.597603] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 22:04:38 juju-e4d256-prod-github-runner-207 kernel: [60052.598565] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 22:04:38 juju-e4d256-prod-github-runner-207 kernel: [60052.599592] handle_exit+0x98/0x230 [kvm_amd] Aug 22 22:04:38 juju-e4d256-prod-github-runner-207 kernel: [60052.600553] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 22:04:38 juju-e4d256-prod-github-runner-207 kernel: [60052.601524] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 22:04:38 juju-e4d256-prod-github-runner-207 kernel: [60052.602467] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 22:04:38 juju-e4d256-prod-github-runner-207 kernel: [60052.603388] vcpu_run+0x62/0x2c0 [kvm] Aug 22 22:04:38 juju-e4d256-prod-github-runner-207 kernel: [60052.604223] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 22:04:38 juju-e4d256-prod-github-runner-207 kernel: [60052.605099] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 22:04:38 juju-e4d256-prod-github-runner-207 kernel: [60052.605977] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 22:04:38 juju-e4d256-prod-github-runner-207 kernel: [60052.606795] ? __seccomp_filter+0x4a/0x4a0 Aug 22 22:04:38 juju-e4d256-prod-github-runner-207 kernel: [60052.607552] ? __fget_files+0x86/0xc0 Aug 22 22:04:38 juju-e4d256-prod-github-runner-207 kernel: [60052.608268] __x64_sys_ioctl+0x95/0xd0 Aug 22 22:04:38 juju-e4d256-prod-github-runner-207 kernel: [60052.608975] do_syscall_64+0x5c/0xc0 Aug 22 22:04:38 juju-e4d256-prod-github-runner-207 kernel: [60052.609683] ? do_futex+0x162/0x1f0 Aug 22 22:04:38 juju-e4d256-prod-github-runner-207 kernel: [60052.610356] ? __x64_sys_futex+0x78/0x1e0 Aug 22 22:04:38 juju-e4d256-prod-github-runner-207 kernel: [60052.611044] ? __secure_computing+0xa9/0x120 Aug 22 22:04:38 juju-e4d256-prod-github-runner-207 kernel: [60052.611747] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 22:04:38 juju-e4d256-prod-github-runner-207 kernel: [60052.612526] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:04:38 juju-e4d256-prod-github-runner-207 kernel: [60052.613285] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:04:38 juju-e4d256-prod-github-runner-207 kernel: [60052.614022] ? do_syscall_64+0x69/0xc0 Aug 22 22:04:38 juju-e4d256-prod-github-runner-207 kernel: [60052.614683] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:04:38 juju-e4d256-prod-github-runner-207 kernel: [60052.615405] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:04:38 juju-e4d256-prod-github-runner-207 kernel: [60052.616127] ? do_syscall_64+0x69/0xc0 Aug 22 22:04:38 juju-e4d256-prod-github-runner-207 kernel: [60052.616767] ? do_syscall_64+0x69/0xc0 Aug 22 22:04:38 juju-e4d256-prod-github-runner-207 kernel: [60052.617414] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 22:04:38 juju-e4d256-prod-github-runner-207 kernel: [60052.618139] RIP: 0033:0x7faa5d0edaff Aug 22 22:04:38 juju-e4d256-prod-github-runner-207 kernel: [60052.618781] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 22:04:38 juju-e4d256-prod-github-runner-207 kernel: [60052.620840] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 22:04:38 juju-e4d256-prod-github-runner-207 kernel: [60052.621811] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 22:04:38 juju-e4d256-prod-github-runner-207 kernel: [60052.622747] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 22:04:38 juju-e4d256-prod-github-runner-207 kernel: [60052.623665] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 22:04:38 juju-e4d256-prod-github-runner-207 kernel: [60052.624578] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 22:04:38 juju-e4d256-prod-github-runner-207 kernel: [60052.625515] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 22:04:38 juju-e4d256-prod-github-runner-207 kernel: [60052.626437] Aug 22 22:05:06 juju-e4d256-prod-github-runner-207 kernel: [60080.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 55846s! [qemu-system-x86:6715] Aug 22 22:05:06 juju-e4d256-prod-github-runner-207 kernel: [60080.543358] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 22:05:06 juju-e4d256-prod-github-runner-207 kernel: [60080.543518] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 22:05:06 juju-e4d256-prod-github-runner-207 kernel: [60080.555630] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 22:05:06 juju-e4d256-prod-github-runner-207 kernel: [60080.556903] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 22:05:06 juju-e4d256-prod-github-runner-207 kernel: [60080.558123] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:05:06 juju-e4d256-prod-github-runner-207 kernel: [60080.559184] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 22:05:06 juju-e4d256-prod-github-runner-207 kernel: [60080.561930] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 22:05:06 juju-e4d256-prod-github-runner-207 kernel: [60080.562975] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 22:05:06 juju-e4d256-prod-github-runner-207 kernel: [60080.564139] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 22:05:06 juju-e4d256-prod-github-runner-207 kernel: [60080.565337] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 22:05:06 juju-e4d256-prod-github-runner-207 kernel: [60080.566634] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 22:05:06 juju-e4d256-prod-github-runner-207 kernel: [60080.567803] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 22:05:06 juju-e4d256-prod-github-runner-207 kernel: [60080.568998] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 22:05:06 juju-e4d256-prod-github-runner-207 kernel: [60080.570239] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 22:05:06 juju-e4d256-prod-github-runner-207 kernel: [60080.571337] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 22:05:06 juju-e4d256-prod-github-runner-207 kernel: [60080.572539] Call Trace: Aug 22 22:05:06 juju-e4d256-prod-github-runner-207 kernel: [60080.573464] Aug 22 22:05:06 juju-e4d256-prod-github-runner-207 kernel: [60080.574355] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:05:06 juju-e4d256-prod-github-runner-207 kernel: [60080.575391] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:05:06 juju-e4d256-prod-github-runner-207 kernel: [60080.576411] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:05:06 juju-e4d256-prod-github-runner-207 kernel: [60080.577529] ? show_regs.part.0+0x23/0x29 Aug 22 22:05:06 juju-e4d256-prod-github-runner-207 kernel: [60080.578537] ? show_regs.cold+0x8/0xd Aug 22 22:05:06 juju-e4d256-prod-github-runner-207 kernel: [60080.579520] ? watchdog_timer_fn+0x1be/0x220 Aug 22 22:05:06 juju-e4d256-prod-github-runner-207 kernel: [60080.580528] ? lockup_detector_update_enable+0x60/0x60 Aug 22 22:05:06 juju-e4d256-prod-github-runner-207 kernel: [60080.581600] ? __hrtimer_run_queues+0x107/0x230 Aug 22 22:05:06 juju-e4d256-prod-github-runner-207 kernel: [60080.582632] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 22:05:06 juju-e4d256-prod-github-runner-207 kernel: [60080.583656] ? hrtimer_interrupt+0x101/0x220 Aug 22 22:05:06 juju-e4d256-prod-github-runner-207 kernel: [60080.584670] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 22:05:06 juju-e4d256-prod-github-runner-207 kernel: [60080.585749] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 22:05:06 juju-e4d256-prod-github-runner-207 kernel: [60080.586795] Aug 22 22:05:06 juju-e4d256-prod-github-runner-207 kernel: [60080.587650] Aug 22 22:05:06 juju-e4d256-prod-github-runner-207 kernel: [60080.588491] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 22:05:06 juju-e4d256-prod-github-runner-207 kernel: [60080.589528] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:05:06 juju-e4d256-prod-github-runner-207 kernel: [60080.590564] ? _raw_spin_lock+0x22/0x30 Aug 22 22:05:06 juju-e4d256-prod-github-runner-207 kernel: [60080.591507] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:05:06 juju-e4d256-prod-github-runner-207 kernel: [60080.592520] direct_page_fault+0x206/0x310 [kvm] Aug 22 22:05:06 juju-e4d256-prod-github-runner-207 kernel: [60080.593552] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 22:05:06 juju-e4d256-prod-github-runner-207 kernel: [60080.594557] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 22:05:06 juju-e4d256-prod-github-runner-207 kernel: [60080.595554] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 22:05:06 juju-e4d256-prod-github-runner-207 kernel: [60080.596538] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 22:05:06 juju-e4d256-prod-github-runner-207 kernel: [60080.597512] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 22:05:06 juju-e4d256-prod-github-runner-207 kernel: [60080.598507] handle_exit+0x98/0x230 [kvm_amd] Aug 22 22:05:06 juju-e4d256-prod-github-runner-207 kernel: [60080.599398] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 22:05:06 juju-e4d256-prod-github-runner-207 kernel: [60080.600309] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 22:05:06 juju-e4d256-prod-github-runner-207 kernel: [60080.601245] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 22:05:06 juju-e4d256-prod-github-runner-207 kernel: [60080.602148] vcpu_run+0x62/0x2c0 [kvm] Aug 22 22:05:06 juju-e4d256-prod-github-runner-207 kernel: [60080.602956] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 22:05:06 juju-e4d256-prod-github-runner-207 kernel: [60080.603763] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 22:05:06 juju-e4d256-prod-github-runner-207 kernel: [60080.604621] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 22:05:06 juju-e4d256-prod-github-runner-207 kernel: [60080.605424] ? __seccomp_filter+0x4a/0x4a0 Aug 22 22:05:06 juju-e4d256-prod-github-runner-207 kernel: [60080.606166] ? __fget_files+0x86/0xc0 Aug 22 22:05:06 juju-e4d256-prod-github-runner-207 kernel: [60080.606869] __x64_sys_ioctl+0x95/0xd0 Aug 22 22:05:06 juju-e4d256-prod-github-runner-207 kernel: [60080.607562] do_syscall_64+0x5c/0xc0 Aug 22 22:05:06 juju-e4d256-prod-github-runner-207 kernel: [60080.608226] ? do_futex+0x162/0x1f0 Aug 22 22:05:06 juju-e4d256-prod-github-runner-207 kernel: [60080.608916] ? __x64_sys_futex+0x78/0x1e0 Aug 22 22:05:06 juju-e4d256-prod-github-runner-207 kernel: [60080.609590] ? __secure_computing+0xa9/0x120 Aug 22 22:05:06 juju-e4d256-prod-github-runner-207 kernel: [60080.610282] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 22:05:06 juju-e4d256-prod-github-runner-207 kernel: [60080.611036] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:05:06 juju-e4d256-prod-github-runner-207 kernel: [60080.611754] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:05:06 juju-e4d256-prod-github-runner-207 kernel: [60080.612468] ? do_syscall_64+0x69/0xc0 Aug 22 22:05:06 juju-e4d256-prod-github-runner-207 kernel: [60080.613127] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:05:06 juju-e4d256-prod-github-runner-207 kernel: [60080.613826] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:05:06 juju-e4d256-prod-github-runner-207 kernel: [60080.614518] ? do_syscall_64+0x69/0xc0 Aug 22 22:05:06 juju-e4d256-prod-github-runner-207 kernel: [60080.615140] ? do_syscall_64+0x69/0xc0 Aug 22 22:05:06 juju-e4d256-prod-github-runner-207 kernel: [60080.615758] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 22:05:06 juju-e4d256-prod-github-runner-207 kernel: [60080.616459] RIP: 0033:0x7faa5d0edaff Aug 22 22:05:06 juju-e4d256-prod-github-runner-207 kernel: [60080.617092] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 22:05:06 juju-e4d256-prod-github-runner-207 kernel: [60080.619071] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 22:05:06 juju-e4d256-prod-github-runner-207 kernel: [60080.619976] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 22:05:06 juju-e4d256-prod-github-runner-207 kernel: [60080.620866] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 22:05:06 juju-e4d256-prod-github-runner-207 kernel: [60080.621751] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 22:05:06 juju-e4d256-prod-github-runner-207 kernel: [60080.622632] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 22:05:06 juju-e4d256-prod-github-runner-207 kernel: [60080.623525] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 22:05:06 juju-e4d256-prod-github-runner-207 kernel: [60080.624414] Aug 22 22:05:34 juju-e4d256-prod-github-runner-207 kernel: [60108.541983] watchdog: BUG: soft lockup - CPU#1 stuck for 55872s! [qemu-system-x86:6715] Aug 22 22:05:34 juju-e4d256-prod-github-runner-207 kernel: [60108.543909] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 22:05:34 juju-e4d256-prod-github-runner-207 kernel: [60108.544210] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 22:05:34 juju-e4d256-prod-github-runner-207 kernel: [60108.556951] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 22:05:34 juju-e4d256-prod-github-runner-207 kernel: [60108.558293] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 22:05:34 juju-e4d256-prod-github-runner-207 kernel: [60108.559590] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:05:34 juju-e4d256-prod-github-runner-207 kernel: [60108.560709] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 22:05:34 juju-e4d256-prod-github-runner-207 kernel: [60108.563425] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 22:05:34 juju-e4d256-prod-github-runner-207 kernel: [60108.564532] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 22:05:34 juju-e4d256-prod-github-runner-207 kernel: [60108.565918] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 22:05:34 juju-e4d256-prod-github-runner-207 kernel: [60108.567116] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 22:05:34 juju-e4d256-prod-github-runner-207 kernel: [60108.568306] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 22:05:34 juju-e4d256-prod-github-runner-207 kernel: [60108.569515] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 22:05:34 juju-e4d256-prod-github-runner-207 kernel: [60108.570754] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 22:05:34 juju-e4d256-prod-github-runner-207 kernel: [60108.572031] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 22:05:34 juju-e4d256-prod-github-runner-207 kernel: [60108.573170] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 22:05:34 juju-e4d256-prod-github-runner-207 kernel: [60108.574390] Call Trace: Aug 22 22:05:34 juju-e4d256-prod-github-runner-207 kernel: [60108.575313] Aug 22 22:05:34 juju-e4d256-prod-github-runner-207 kernel: [60108.577195] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:05:34 juju-e4d256-prod-github-runner-207 kernel: [60108.578349] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:05:34 juju-e4d256-prod-github-runner-207 kernel: [60108.579422] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:05:34 juju-e4d256-prod-github-runner-207 kernel: [60108.580592] ? show_regs.part.0+0x23/0x29 Aug 22 22:05:34 juju-e4d256-prod-github-runner-207 kernel: [60108.581662] ? show_regs.cold+0x8/0xd Aug 22 22:05:34 juju-e4d256-prod-github-runner-207 kernel: [60108.582715] ? watchdog_timer_fn+0x1be/0x220 Aug 22 22:05:34 juju-e4d256-prod-github-runner-207 kernel: [60108.583749] ? lockup_detector_update_enable+0x60/0x60 Aug 22 22:05:34 juju-e4d256-prod-github-runner-207 kernel: [60108.584906] ? __hrtimer_run_queues+0x107/0x230 Aug 22 22:05:34 juju-e4d256-prod-github-runner-207 kernel: [60108.585990] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 22:05:34 juju-e4d256-prod-github-runner-207 kernel: [60108.587069] ? hrtimer_interrupt+0x101/0x220 Aug 22 22:05:34 juju-e4d256-prod-github-runner-207 kernel: [60108.588183] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 22:05:34 juju-e4d256-prod-github-runner-207 kernel: [60108.589340] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 22:05:34 juju-e4d256-prod-github-runner-207 kernel: [60108.590447] Aug 22 22:05:34 juju-e4d256-prod-github-runner-207 kernel: [60108.591328] Aug 22 22:05:34 juju-e4d256-prod-github-runner-207 kernel: [60108.592239] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 22:05:34 juju-e4d256-prod-github-runner-207 kernel: [60108.593377] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:05:34 juju-e4d256-prod-github-runner-207 kernel: [60108.594477] ? _raw_spin_lock+0x22/0x30 Aug 22 22:05:34 juju-e4d256-prod-github-runner-207 kernel: [60108.595447] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:05:34 juju-e4d256-prod-github-runner-207 kernel: [60108.596556] direct_page_fault+0x206/0x310 [kvm] Aug 22 22:05:34 juju-e4d256-prod-github-runner-207 kernel: [60108.597625] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 22:05:34 juju-e4d256-prod-github-runner-207 kernel: [60108.598661] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 22:05:34 juju-e4d256-prod-github-runner-207 kernel: [60108.599724] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 22:05:34 juju-e4d256-prod-github-runner-207 kernel: [60108.600794] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 22:05:34 juju-e4d256-prod-github-runner-207 kernel: [60108.601789] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 22:05:34 juju-e4d256-prod-github-runner-207 kernel: [60108.602805] handle_exit+0x98/0x230 [kvm_amd] Aug 22 22:05:34 juju-e4d256-prod-github-runner-207 kernel: [60108.603772] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 22:05:34 juju-e4d256-prod-github-runner-207 kernel: [60108.604818] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 22:05:34 juju-e4d256-prod-github-runner-207 kernel: [60108.605807] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 22:05:34 juju-e4d256-prod-github-runner-207 kernel: [60108.606756] vcpu_run+0x62/0x2c0 [kvm] Aug 22 22:05:34 juju-e4d256-prod-github-runner-207 kernel: [60108.607609] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 22:05:34 juju-e4d256-prod-github-runner-207 kernel: [60108.608461] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 22:05:34 juju-e4d256-prod-github-runner-207 kernel: [60108.609334] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 22:05:34 juju-e4d256-prod-github-runner-207 kernel: [60108.610152] ? __seccomp_filter+0x4a/0x4a0 Aug 22 22:05:34 juju-e4d256-prod-github-runner-207 kernel: [60108.611008] ? __fget_files+0x86/0xc0 Aug 22 22:05:34 juju-e4d256-prod-github-runner-207 kernel: [60108.611812] __x64_sys_ioctl+0x95/0xd0 Aug 22 22:05:34 juju-e4d256-prod-github-runner-207 kernel: [60108.612566] do_syscall_64+0x5c/0xc0 Aug 22 22:05:34 juju-e4d256-prod-github-runner-207 kernel: [60108.613264] ? do_futex+0x162/0x1f0 Aug 22 22:05:34 juju-e4d256-prod-github-runner-207 kernel: [60108.613947] ? __x64_sys_futex+0x78/0x1e0 Aug 22 22:05:34 juju-e4d256-prod-github-runner-207 kernel: [60108.614644] ? __secure_computing+0xa9/0x120 Aug 22 22:05:34 juju-e4d256-prod-github-runner-207 kernel: [60108.615407] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 22:05:34 juju-e4d256-prod-github-runner-207 kernel: [60108.616216] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:05:34 juju-e4d256-prod-github-runner-207 kernel: [60108.616988] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:05:34 juju-e4d256-prod-github-runner-207 kernel: [60108.617759] ? do_syscall_64+0x69/0xc0 Aug 22 22:05:34 juju-e4d256-prod-github-runner-207 kernel: [60108.618445] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:05:34 juju-e4d256-prod-github-runner-207 kernel: [60108.619190] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:05:34 juju-e4d256-prod-github-runner-207 kernel: [60108.619930] ? do_syscall_64+0x69/0xc0 Aug 22 22:05:34 juju-e4d256-prod-github-runner-207 kernel: [60108.620605] ? do_syscall_64+0x69/0xc0 Aug 22 22:05:34 juju-e4d256-prod-github-runner-207 kernel: [60108.621250] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 22:05:34 juju-e4d256-prod-github-runner-207 kernel: [60108.621985] RIP: 0033:0x7faa5d0edaff Aug 22 22:05:34 juju-e4d256-prod-github-runner-207 kernel: [60108.622881] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 22:05:34 juju-e4d256-prod-github-runner-207 kernel: [60108.625057] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 22:05:34 juju-e4d256-prod-github-runner-207 kernel: [60108.626009] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 22:05:34 juju-e4d256-prod-github-runner-207 kernel: [60108.626939] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 22:05:34 juju-e4d256-prod-github-runner-207 kernel: [60108.627901] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 22:05:34 juju-e4d256-prod-github-runner-207 kernel: [60108.628843] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 22:05:34 juju-e4d256-prod-github-runner-207 kernel: [60108.629760] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 22:05:34 juju-e4d256-prod-github-runner-207 kernel: [60108.630722] Aug 22 22:05:47 juju-e4d256-prod-github-runner-207 kernel: [60121.196705] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 22:05:47 juju-e4d256-prod-github-runner-207 kernel: [60121.198474] rcu: 1-....: (14953765 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=7224890 Aug 22 22:05:47 juju-e4d256-prod-github-runner-207 kernel: [60121.199597] (t=15000999 jiffies g=23269 q=53999) Aug 22 22:05:47 juju-e4d256-prod-github-runner-207 kernel: [60121.200435] NMI backtrace for cpu 1 Aug 22 22:05:47 juju-e4d256-prod-github-runner-207 kernel: [60121.201296] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 22:05:47 juju-e4d256-prod-github-runner-207 kernel: [60121.202392] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 22:05:47 juju-e4d256-prod-github-runner-207 kernel: [60121.203447] Call Trace: Aug 22 22:05:47 juju-e4d256-prod-github-runner-207 kernel: [60121.204357] Aug 22 22:05:47 juju-e4d256-prod-github-runner-207 kernel: [60121.205019] show_stack+0x52/0x5c Aug 22 22:05:47 juju-e4d256-prod-github-runner-207 kernel: [60121.205741] dump_stack_lvl+0x4a/0x63 Aug 22 22:05:47 juju-e4d256-prod-github-runner-207 kernel: [60121.206484] dump_stack+0x10/0x16 Aug 22 22:05:47 juju-e4d256-prod-github-runner-207 kernel: [60121.207232] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 22:05:47 juju-e4d256-prod-github-runner-207 kernel: [60121.208017] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 22:05:47 juju-e4d256-prod-github-runner-207 kernel: [60121.208838] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 22:05:47 juju-e4d256-prod-github-runner-207 kernel: [60121.209671] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 22:05:47 juju-e4d256-prod-github-runner-207 kernel: [60121.210514] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 22:05:47 juju-e4d256-prod-github-runner-207 kernel: [60121.211424] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 22:05:47 juju-e4d256-prod-github-runner-207 kernel: [60121.212301] print_cpu_stall.cold+0x2f/0xe2 Aug 22 22:05:47 juju-e4d256-prod-github-runner-207 kernel: [60121.213153] ? timekeeping_update+0xf7/0x150 Aug 22 22:05:47 juju-e4d256-prod-github-runner-207 kernel: [60121.214007] check_cpu_stall+0x109/0x270 Aug 22 22:05:47 juju-e4d256-prod-github-runner-207 kernel: [60121.214843] rcu_sched_clock_irq+0x9a/0x250 Aug 22 22:05:47 juju-e4d256-prod-github-runner-207 kernel: [60121.215686] update_process_times+0x94/0xd0 Aug 22 22:05:47 juju-e4d256-prod-github-runner-207 kernel: [60121.216561] tick_sched_handle+0x29/0x70 Aug 22 22:05:47 juju-e4d256-prod-github-runner-207 kernel: [60121.217383] tick_sched_timer+0x8c/0xc0 Aug 22 22:05:47 juju-e4d256-prod-github-runner-207 kernel: [60121.218222] ? tick_nohz_handler+0xb0/0xb0 Aug 22 22:05:47 juju-e4d256-prod-github-runner-207 kernel: [60121.219069] __hrtimer_run_queues+0x107/0x230 Aug 22 22:05:47 juju-e4d256-prod-github-runner-207 kernel: [60121.219933] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 22:05:47 juju-e4d256-prod-github-runner-207 kernel: [60121.220818] hrtimer_interrupt+0x101/0x220 Aug 22 22:05:47 juju-e4d256-prod-github-runner-207 kernel: [60121.221659] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 22:05:47 juju-e4d256-prod-github-runner-207 kernel: [60121.222583] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 22:05:47 juju-e4d256-prod-github-runner-207 kernel: [60121.223489] Aug 22 22:05:47 juju-e4d256-prod-github-runner-207 kernel: [60121.224175] Aug 22 22:05:47 juju-e4d256-prod-github-runner-207 kernel: [60121.224891] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 22:05:47 juju-e4d256-prod-github-runner-207 kernel: [60121.225824] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:05:47 juju-e4d256-prod-github-runner-207 kernel: [60121.226808] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 22:05:47 juju-e4d256-prod-github-runner-207 kernel: [60121.229384] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 22:05:47 juju-e4d256-prod-github-runner-207 kernel: [60121.230354] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 22:05:47 juju-e4d256-prod-github-runner-207 kernel: [60121.231472] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 22:05:47 juju-e4d256-prod-github-runner-207 kernel: [60121.232588] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 22:05:47 juju-e4d256-prod-github-runner-207 kernel: [60121.233684] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 22:05:47 juju-e4d256-prod-github-runner-207 kernel: [60121.234773] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 22:05:47 juju-e4d256-prod-github-runner-207 kernel: [60121.235862] ? _raw_spin_lock+0x22/0x30 Aug 22 22:05:47 juju-e4d256-prod-github-runner-207 kernel: [60121.236736] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:05:47 juju-e4d256-prod-github-runner-207 kernel: [60121.237694] direct_page_fault+0x206/0x310 [kvm] Aug 22 22:05:47 juju-e4d256-prod-github-runner-207 kernel: [60121.238623] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 22:05:47 juju-e4d256-prod-github-runner-207 kernel: [60121.239534] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 22:05:47 juju-e4d256-prod-github-runner-207 kernel: [60121.240478] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 22:05:47 juju-e4d256-prod-github-runner-207 kernel: [60121.241401] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 22:05:47 juju-e4d256-prod-github-runner-207 kernel: [60121.242280] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 22:05:47 juju-e4d256-prod-github-runner-207 kernel: [60121.243204] handle_exit+0x98/0x230 [kvm_amd] Aug 22 22:05:47 juju-e4d256-prod-github-runner-207 kernel: [60121.244061] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 22:05:47 juju-e4d256-prod-github-runner-207 kernel: [60121.245005] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 22:05:47 juju-e4d256-prod-github-runner-207 kernel: [60121.245902] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 22:05:47 juju-e4d256-prod-github-runner-207 kernel: [60121.246778] vcpu_run+0x62/0x2c0 [kvm] Aug 22 22:05:47 juju-e4d256-prod-github-runner-207 kernel: [60121.247570] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 22:05:47 juju-e4d256-prod-github-runner-207 kernel: [60121.248408] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 22:05:47 juju-e4d256-prod-github-runner-207 kernel: [60121.249318] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 22:05:47 juju-e4d256-prod-github-runner-207 kernel: [60121.250178] ? __seccomp_filter+0x4a/0x4a0 Aug 22 22:05:47 juju-e4d256-prod-github-runner-207 kernel: [60121.250995] ? __fget_files+0x86/0xc0 Aug 22 22:05:47 juju-e4d256-prod-github-runner-207 kernel: [60121.251759] __x64_sys_ioctl+0x95/0xd0 Aug 22 22:05:47 juju-e4d256-prod-github-runner-207 kernel: [60121.252561] do_syscall_64+0x5c/0xc0 Aug 22 22:05:47 juju-e4d256-prod-github-runner-207 kernel: [60121.253311] ? do_futex+0x162/0x1f0 Aug 22 22:05:47 juju-e4d256-prod-github-runner-207 kernel: [60121.254054] ? __x64_sys_futex+0x78/0x1e0 Aug 22 22:05:47 juju-e4d256-prod-github-runner-207 kernel: [60121.254832] ? __secure_computing+0xa9/0x120 Aug 22 22:05:47 juju-e4d256-prod-github-runner-207 kernel: [60121.255635] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 22:05:47 juju-e4d256-prod-github-runner-207 kernel: [60121.256564] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:05:47 juju-e4d256-prod-github-runner-207 kernel: [60121.257415] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:05:47 juju-e4d256-prod-github-runner-207 kernel: [60121.258256] ? do_syscall_64+0x69/0xc0 Aug 22 22:05:47 juju-e4d256-prod-github-runner-207 kernel: [60121.259017] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:05:47 juju-e4d256-prod-github-runner-207 kernel: [60121.259871] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:05:47 juju-e4d256-prod-github-runner-207 kernel: [60121.260730] ? do_syscall_64+0x69/0xc0 Aug 22 22:05:47 juju-e4d256-prod-github-runner-207 kernel: [60121.261495] ? do_syscall_64+0x69/0xc0 Aug 22 22:05:47 juju-e4d256-prod-github-runner-207 kernel: [60121.262252] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 22:05:47 juju-e4d256-prod-github-runner-207 kernel: [60121.263114] RIP: 0033:0x7faa5d0edaff Aug 22 22:05:47 juju-e4d256-prod-github-runner-207 kernel: [60121.263911] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 22:05:47 juju-e4d256-prod-github-runner-207 kernel: [60121.266372] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 22:05:47 juju-e4d256-prod-github-runner-207 kernel: [60121.267476] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 22:05:47 juju-e4d256-prod-github-runner-207 kernel: [60121.268561] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 22:05:47 juju-e4d256-prod-github-runner-207 kernel: [60121.269634] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 22:05:47 juju-e4d256-prod-github-runner-207 kernel: [60121.270702] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 22:05:47 juju-e4d256-prod-github-runner-207 kernel: [60121.271752] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 22:05:47 juju-e4d256-prod-github-runner-207 kernel: [60121.272805] Aug 22 22:06:14 juju-e4d256-prod-github-runner-207 kernel: [60148.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 55909s! [qemu-system-x86:6715] Aug 22 22:06:14 juju-e4d256-prod-github-runner-207 kernel: [60148.543944] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 22:06:14 juju-e4d256-prod-github-runner-207 kernel: [60148.544257] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 22:06:14 juju-e4d256-prod-github-runner-207 kernel: [60148.556378] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 22:06:14 juju-e4d256-prod-github-runner-207 kernel: [60148.557636] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 22:06:14 juju-e4d256-prod-github-runner-207 kernel: [60148.558855] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:06:14 juju-e4d256-prod-github-runner-207 kernel: [60148.559918] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 22:06:14 juju-e4d256-prod-github-runner-207 kernel: [60148.562452] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 22:06:14 juju-e4d256-prod-github-runner-207 kernel: [60148.563497] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 22:06:14 juju-e4d256-prod-github-runner-207 kernel: [60148.564668] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 22:06:14 juju-e4d256-prod-github-runner-207 kernel: [60148.565828] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 22:06:14 juju-e4d256-prod-github-runner-207 kernel: [60148.566982] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 22:06:14 juju-e4d256-prod-github-runner-207 kernel: [60148.568157] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 22:06:14 juju-e4d256-prod-github-runner-207 kernel: [60148.569317] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 22:06:14 juju-e4d256-prod-github-runner-207 kernel: [60148.570544] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 22:06:14 juju-e4d256-prod-github-runner-207 kernel: [60148.571642] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 22:06:14 juju-e4d256-prod-github-runner-207 kernel: [60148.572852] Call Trace: Aug 22 22:06:14 juju-e4d256-prod-github-runner-207 kernel: [60148.573776] Aug 22 22:06:14 juju-e4d256-prod-github-runner-207 kernel: [60148.574682] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:06:14 juju-e4d256-prod-github-runner-207 kernel: [60148.575719] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:06:14 juju-e4d256-prod-github-runner-207 kernel: [60148.576750] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:06:14 juju-e4d256-prod-github-runner-207 kernel: [60148.577848] ? show_regs.part.0+0x23/0x29 Aug 22 22:06:14 juju-e4d256-prod-github-runner-207 kernel: [60148.579031] ? show_regs.cold+0x8/0xd Aug 22 22:06:14 juju-e4d256-prod-github-runner-207 kernel: [60148.580022] ? watchdog_timer_fn+0x1be/0x220 Aug 22 22:06:14 juju-e4d256-prod-github-runner-207 kernel: [60148.581034] ? lockup_detector_update_enable+0x60/0x60 Aug 22 22:06:14 juju-e4d256-prod-github-runner-207 kernel: [60148.582201] ? __hrtimer_run_queues+0x107/0x230 Aug 22 22:06:14 juju-e4d256-prod-github-runner-207 kernel: [60148.583256] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 22:06:14 juju-e4d256-prod-github-runner-207 kernel: [60148.584294] ? hrtimer_interrupt+0x101/0x220 Aug 22 22:06:14 juju-e4d256-prod-github-runner-207 kernel: [60148.585307] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 22:06:14 juju-e4d256-prod-github-runner-207 kernel: [60148.586372] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 22:06:14 juju-e4d256-prod-github-runner-207 kernel: [60148.587432] Aug 22 22:06:14 juju-e4d256-prod-github-runner-207 kernel: [60148.588302] Aug 22 22:06:14 juju-e4d256-prod-github-runner-207 kernel: [60148.589139] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 22:06:14 juju-e4d256-prod-github-runner-207 kernel: [60148.590173] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:06:14 juju-e4d256-prod-github-runner-207 kernel: [60148.591208] ? _raw_spin_lock+0x22/0x30 Aug 22 22:06:14 juju-e4d256-prod-github-runner-207 kernel: [60148.592161] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:06:14 juju-e4d256-prod-github-runner-207 kernel: [60148.593175] direct_page_fault+0x206/0x310 [kvm] Aug 22 22:06:14 juju-e4d256-prod-github-runner-207 kernel: [60148.594201] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 22:06:14 juju-e4d256-prod-github-runner-207 kernel: [60148.595208] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 22:06:14 juju-e4d256-prod-github-runner-207 kernel: [60148.596439] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 22:06:14 juju-e4d256-prod-github-runner-207 kernel: [60148.597448] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 22:06:14 juju-e4d256-prod-github-runner-207 kernel: [60148.598393] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 22:06:14 juju-e4d256-prod-github-runner-207 kernel: [60148.599370] handle_exit+0x98/0x230 [kvm_amd] Aug 22 22:06:14 juju-e4d256-prod-github-runner-207 kernel: [60148.600290] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 22:06:14 juju-e4d256-prod-github-runner-207 kernel: [60148.601202] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 22:06:14 juju-e4d256-prod-github-runner-207 kernel: [60148.602132] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 22:06:14 juju-e4d256-prod-github-runner-207 kernel: [60148.603037] vcpu_run+0x62/0x2c0 [kvm] Aug 22 22:06:14 juju-e4d256-prod-github-runner-207 kernel: [60148.603867] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 22:06:14 juju-e4d256-prod-github-runner-207 kernel: [60148.604672] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 22:06:14 juju-e4d256-prod-github-runner-207 kernel: [60148.605534] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 22:06:14 juju-e4d256-prod-github-runner-207 kernel: [60148.606344] ? __seccomp_filter+0x4a/0x4a0 Aug 22 22:06:14 juju-e4d256-prod-github-runner-207 kernel: [60148.607090] ? __fget_files+0x86/0xc0 Aug 22 22:06:14 juju-e4d256-prod-github-runner-207 kernel: [60148.607791] __x64_sys_ioctl+0x95/0xd0 Aug 22 22:06:14 juju-e4d256-prod-github-runner-207 kernel: [60148.608489] do_syscall_64+0x5c/0xc0 Aug 22 22:06:14 juju-e4d256-prod-github-runner-207 kernel: [60148.609153] ? do_futex+0x162/0x1f0 Aug 22 22:06:14 juju-e4d256-prod-github-runner-207 kernel: [60148.609800] ? __x64_sys_futex+0x78/0x1e0 Aug 22 22:06:14 juju-e4d256-prod-github-runner-207 kernel: [60148.610476] ? __secure_computing+0xa9/0x120 Aug 22 22:06:14 juju-e4d256-prod-github-runner-207 kernel: [60148.611168] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 22:06:14 juju-e4d256-prod-github-runner-207 kernel: [60148.611944] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:06:14 juju-e4d256-prod-github-runner-207 kernel: [60148.612664] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:06:14 juju-e4d256-prod-github-runner-207 kernel: [60148.613385] ? do_syscall_64+0x69/0xc0 Aug 22 22:06:14 juju-e4d256-prod-github-runner-207 kernel: [60148.614027] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:06:14 juju-e4d256-prod-github-runner-207 kernel: [60148.614727] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:06:14 juju-e4d256-prod-github-runner-207 kernel: [60148.615420] ? do_syscall_64+0x69/0xc0 Aug 22 22:06:14 juju-e4d256-prod-github-runner-207 kernel: [60148.616057] ? do_syscall_64+0x69/0xc0 Aug 22 22:06:14 juju-e4d256-prod-github-runner-207 kernel: [60148.616677] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 22:06:14 juju-e4d256-prod-github-runner-207 kernel: [60148.617386] RIP: 0033:0x7faa5d0edaff Aug 22 22:06:14 juju-e4d256-prod-github-runner-207 kernel: [60148.618044] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 22:06:14 juju-e4d256-prod-github-runner-207 kernel: [60148.620038] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 22:06:14 juju-e4d256-prod-github-runner-207 kernel: [60148.620952] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 22:06:14 juju-e4d256-prod-github-runner-207 kernel: [60148.621837] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 22:06:14 juju-e4d256-prod-github-runner-207 kernel: [60148.622719] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 22:06:14 juju-e4d256-prod-github-runner-207 kernel: [60148.623601] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 22:06:14 juju-e4d256-prod-github-runner-207 kernel: [60148.624491] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 22:06:14 juju-e4d256-prod-github-runner-207 kernel: [60148.625376] Aug 22 22:06:42 juju-e4d256-prod-github-runner-207 kernel: [60176.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 55935s! [qemu-system-x86:6715] Aug 22 22:06:42 juju-e4d256-prod-github-runner-207 kernel: [60176.543926] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 22:06:42 juju-e4d256-prod-github-runner-207 kernel: [60176.544280] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 22:06:42 juju-e4d256-prod-github-runner-207 kernel: [60176.556614] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 22:06:42 juju-e4d256-prod-github-runner-207 kernel: [60176.557891] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 22:06:42 juju-e4d256-prod-github-runner-207 kernel: [60176.559110] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:06:42 juju-e4d256-prod-github-runner-207 kernel: [60176.560184] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 22:06:42 juju-e4d256-prod-github-runner-207 kernel: [60176.562725] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 22:06:42 juju-e4d256-prod-github-runner-207 kernel: [60176.563794] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 22:06:42 juju-e4d256-prod-github-runner-207 kernel: [60176.565359] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 22:06:42 juju-e4d256-prod-github-runner-207 kernel: [60176.566555] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 22:06:42 juju-e4d256-prod-github-runner-207 kernel: [60176.567767] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 22:06:42 juju-e4d256-prod-github-runner-207 kernel: [60176.568937] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 22:06:42 juju-e4d256-prod-github-runner-207 kernel: [60176.570126] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 22:06:42 juju-e4d256-prod-github-runner-207 kernel: [60176.571428] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 22:06:42 juju-e4d256-prod-github-runner-207 kernel: [60176.572581] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 22:06:42 juju-e4d256-prod-github-runner-207 kernel: [60176.574072] Call Trace: Aug 22 22:06:42 juju-e4d256-prod-github-runner-207 kernel: [60176.575107] Aug 22 22:06:42 juju-e4d256-prod-github-runner-207 kernel: [60176.576125] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:06:42 juju-e4d256-prod-github-runner-207 kernel: [60176.577299] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:06:42 juju-e4d256-prod-github-runner-207 kernel: [60176.578457] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:06:42 juju-e4d256-prod-github-runner-207 kernel: [60176.579701] ? show_regs.part.0+0x23/0x29 Aug 22 22:06:42 juju-e4d256-prod-github-runner-207 kernel: [60176.580821] ? show_regs.cold+0x8/0xd Aug 22 22:06:42 juju-e4d256-prod-github-runner-207 kernel: [60176.581884] ? watchdog_timer_fn+0x1be/0x220 Aug 22 22:06:42 juju-e4d256-prod-github-runner-207 kernel: [60176.583001] ? lockup_detector_update_enable+0x60/0x60 Aug 22 22:06:42 juju-e4d256-prod-github-runner-207 kernel: [60176.584317] ? __hrtimer_run_queues+0x107/0x230 Aug 22 22:06:42 juju-e4d256-prod-github-runner-207 kernel: [60176.585475] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 22:06:42 juju-e4d256-prod-github-runner-207 kernel: [60176.586601] ? hrtimer_interrupt+0x101/0x220 Aug 22 22:06:42 juju-e4d256-prod-github-runner-207 kernel: [60176.587733] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 22:06:42 juju-e4d256-prod-github-runner-207 kernel: [60176.588918] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 22:06:42 juju-e4d256-prod-github-runner-207 kernel: [60176.590078] Aug 22 22:06:42 juju-e4d256-prod-github-runner-207 kernel: [60176.591001] Aug 22 22:06:42 juju-e4d256-prod-github-runner-207 kernel: [60176.591917] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 22:06:42 juju-e4d256-prod-github-runner-207 kernel: [60176.593073] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:06:42 juju-e4d256-prod-github-runner-207 kernel: [60176.594224] ? _raw_spin_lock+0x22/0x30 Aug 22 22:06:42 juju-e4d256-prod-github-runner-207 kernel: [60176.595253] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:06:42 juju-e4d256-prod-github-runner-207 kernel: [60176.596380] direct_page_fault+0x206/0x310 [kvm] Aug 22 22:06:42 juju-e4d256-prod-github-runner-207 kernel: [60176.597504] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 22:06:42 juju-e4d256-prod-github-runner-207 kernel: [60176.598608] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 22:06:42 juju-e4d256-prod-github-runner-207 kernel: [60176.599738] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 22:06:42 juju-e4d256-prod-github-runner-207 kernel: [60176.600845] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 22:06:42 juju-e4d256-prod-github-runner-207 kernel: [60176.601893] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 22:06:42 juju-e4d256-prod-github-runner-207 kernel: [60176.602987] handle_exit+0x98/0x230 [kvm_amd] Aug 22 22:06:42 juju-e4d256-prod-github-runner-207 kernel: [60176.603989] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 22:06:42 juju-e4d256-prod-github-runner-207 kernel: [60176.604997] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 22:06:42 juju-e4d256-prod-github-runner-207 kernel: [60176.606025] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 22:06:42 juju-e4d256-prod-github-runner-207 kernel: [60176.607051] vcpu_run+0x62/0x2c0 [kvm] Aug 22 22:06:42 juju-e4d256-prod-github-runner-207 kernel: [60176.607962] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 22:06:42 juju-e4d256-prod-github-runner-207 kernel: [60176.608871] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 22:06:42 juju-e4d256-prod-github-runner-207 kernel: [60176.609834] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 22:06:42 juju-e4d256-prod-github-runner-207 kernel: [60176.610727] ? __seccomp_filter+0x4a/0x4a0 Aug 22 22:06:42 juju-e4d256-prod-github-runner-207 kernel: [60176.611590] ? __fget_files+0x86/0xc0 Aug 22 22:06:42 juju-e4d256-prod-github-runner-207 kernel: [60176.612474] __x64_sys_ioctl+0x95/0xd0 Aug 22 22:06:42 juju-e4d256-prod-github-runner-207 kernel: [60176.613263] do_syscall_64+0x5c/0xc0 Aug 22 22:06:42 juju-e4d256-prod-github-runner-207 kernel: [60176.614009] ? do_futex+0x162/0x1f0 Aug 22 22:06:42 juju-e4d256-prod-github-runner-207 kernel: [60176.614739] ? __x64_sys_futex+0x78/0x1e0 Aug 22 22:06:42 juju-e4d256-prod-github-runner-207 kernel: [60176.615523] ? __secure_computing+0xa9/0x120 Aug 22 22:06:42 juju-e4d256-prod-github-runner-207 kernel: [60176.616317] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 22:06:42 juju-e4d256-prod-github-runner-207 kernel: [60176.617191] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:06:42 juju-e4d256-prod-github-runner-207 kernel: [60176.618014] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:06:42 juju-e4d256-prod-github-runner-207 kernel: [60176.618840] ? do_syscall_64+0x69/0xc0 Aug 22 22:06:42 juju-e4d256-prod-github-runner-207 kernel: [60176.619581] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:06:42 juju-e4d256-prod-github-runner-207 kernel: [60176.620389] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:06:42 juju-e4d256-prod-github-runner-207 kernel: [60176.621187] ? do_syscall_64+0x69/0xc0 Aug 22 22:06:42 juju-e4d256-prod-github-runner-207 kernel: [60176.621894] ? do_syscall_64+0x69/0xc0 Aug 22 22:06:42 juju-e4d256-prod-github-runner-207 kernel: [60176.622597] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 22:06:42 juju-e4d256-prod-github-runner-207 kernel: [60176.623412] RIP: 0033:0x7faa5d0edaff Aug 22 22:06:42 juju-e4d256-prod-github-runner-207 kernel: [60176.624174] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 22:06:42 juju-e4d256-prod-github-runner-207 kernel: [60176.626514] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 22:06:42 juju-e4d256-prod-github-runner-207 kernel: [60176.627591] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 22:06:42 juju-e4d256-prod-github-runner-207 kernel: [60176.628622] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 22:06:42 juju-e4d256-prod-github-runner-207 kernel: [60176.629649] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 22:06:42 juju-e4d256-prod-github-runner-207 kernel: [60176.630673] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 22:06:42 juju-e4d256-prod-github-runner-207 kernel: [60176.631725] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 22:06:42 juju-e4d256-prod-github-runner-207 kernel: [60176.632759] Aug 22 22:07:10 juju-e4d256-prod-github-runner-207 kernel: [60204.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 55961s! [qemu-system-x86:6715] Aug 22 22:07:10 juju-e4d256-prod-github-runner-207 kernel: [60204.543651] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 22:07:10 juju-e4d256-prod-github-runner-207 kernel: [60204.543759] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 22:07:10 juju-e4d256-prod-github-runner-207 kernel: [60204.556173] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 22:07:10 juju-e4d256-prod-github-runner-207 kernel: [60204.557441] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 22:07:10 juju-e4d256-prod-github-runner-207 kernel: [60204.558666] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:07:10 juju-e4d256-prod-github-runner-207 kernel: [60204.559951] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 22:07:10 juju-e4d256-prod-github-runner-207 kernel: [60204.562558] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 22:07:10 juju-e4d256-prod-github-runner-207 kernel: [60204.563791] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 22:07:10 juju-e4d256-prod-github-runner-207 kernel: [60204.564966] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 22:07:10 juju-e4d256-prod-github-runner-207 kernel: [60204.566126] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 22:07:10 juju-e4d256-prod-github-runner-207 kernel: [60204.567393] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 22:07:10 juju-e4d256-prod-github-runner-207 kernel: [60204.568580] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 22:07:10 juju-e4d256-prod-github-runner-207 kernel: [60204.569756] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 22:07:10 juju-e4d256-prod-github-runner-207 kernel: [60204.570992] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 22:07:10 juju-e4d256-prod-github-runner-207 kernel: [60204.572135] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 22:07:10 juju-e4d256-prod-github-runner-207 kernel: [60204.573342] Call Trace: Aug 22 22:07:10 juju-e4d256-prod-github-runner-207 kernel: [60204.574267] Aug 22 22:07:10 juju-e4d256-prod-github-runner-207 kernel: [60204.575184] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:07:10 juju-e4d256-prod-github-runner-207 kernel: [60204.576221] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:07:10 juju-e4d256-prod-github-runner-207 kernel: [60204.577249] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:07:10 juju-e4d256-prod-github-runner-207 kernel: [60204.578331] ? show_regs.part.0+0x23/0x29 Aug 22 22:07:10 juju-e4d256-prod-github-runner-207 kernel: [60204.579359] ? show_regs.cold+0x8/0xd Aug 22 22:07:10 juju-e4d256-prod-github-runner-207 kernel: [60204.580339] ? watchdog_timer_fn+0x1be/0x220 Aug 22 22:07:10 juju-e4d256-prod-github-runner-207 kernel: [60204.581361] ? lockup_detector_update_enable+0x60/0x60 Aug 22 22:07:10 juju-e4d256-prod-github-runner-207 kernel: [60204.582437] ? __hrtimer_run_queues+0x107/0x230 Aug 22 22:07:10 juju-e4d256-prod-github-runner-207 kernel: [60204.583669] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 22:07:10 juju-e4d256-prod-github-runner-207 kernel: [60204.584740] ? hrtimer_interrupt+0x101/0x220 Aug 22 22:07:10 juju-e4d256-prod-github-runner-207 kernel: [60204.585764] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 22:07:10 juju-e4d256-prod-github-runner-207 kernel: [60204.586856] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 22:07:10 juju-e4d256-prod-github-runner-207 kernel: [60204.587960] Aug 22 22:07:10 juju-e4d256-prod-github-runner-207 kernel: [60204.588835] Aug 22 22:07:10 juju-e4d256-prod-github-runner-207 kernel: [60204.589685] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 22:07:10 juju-e4d256-prod-github-runner-207 kernel: [60204.590749] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:07:10 juju-e4d256-prod-github-runner-207 kernel: [60204.591835] ? _raw_spin_lock+0x22/0x30 Aug 22 22:07:10 juju-e4d256-prod-github-runner-207 kernel: [60204.592818] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:07:10 juju-e4d256-prod-github-runner-207 kernel: [60204.593880] direct_page_fault+0x206/0x310 [kvm] Aug 22 22:07:10 juju-e4d256-prod-github-runner-207 kernel: [60204.594944] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 22:07:10 juju-e4d256-prod-github-runner-207 kernel: [60204.595990] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 22:07:10 juju-e4d256-prod-github-runner-207 kernel: [60204.596997] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 22:07:10 juju-e4d256-prod-github-runner-207 kernel: [60204.597993] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 22:07:10 juju-e4d256-prod-github-runner-207 kernel: [60204.598943] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 22:07:10 juju-e4d256-prod-github-runner-207 kernel: [60204.599943] handle_exit+0x98/0x230 [kvm_amd] Aug 22 22:07:10 juju-e4d256-prod-github-runner-207 kernel: [60204.600840] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 22:07:10 juju-e4d256-prod-github-runner-207 kernel: [60204.601758] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 22:07:10 juju-e4d256-prod-github-runner-207 kernel: [60204.602719] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 22:07:10 juju-e4d256-prod-github-runner-207 kernel: [60204.603644] vcpu_run+0x62/0x2c0 [kvm] Aug 22 22:07:10 juju-e4d256-prod-github-runner-207 kernel: [60204.604485] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 22:07:10 juju-e4d256-prod-github-runner-207 kernel: [60204.605318] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 22:07:10 juju-e4d256-prod-github-runner-207 kernel: [60204.606183] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 22:07:10 juju-e4d256-prod-github-runner-207 kernel: [60204.606988] ? __seccomp_filter+0x4a/0x4a0 Aug 22 22:07:10 juju-e4d256-prod-github-runner-207 kernel: [60204.607754] ? __fget_files+0x86/0xc0 Aug 22 22:07:10 juju-e4d256-prod-github-runner-207 kernel: [60204.608476] __x64_sys_ioctl+0x95/0xd0 Aug 22 22:07:10 juju-e4d256-prod-github-runner-207 kernel: [60204.609180] do_syscall_64+0x5c/0xc0 Aug 22 22:07:10 juju-e4d256-prod-github-runner-207 kernel: [60204.609856] ? do_futex+0x162/0x1f0 Aug 22 22:07:10 juju-e4d256-prod-github-runner-207 kernel: [60204.610504] ? __x64_sys_futex+0x78/0x1e0 Aug 22 22:07:10 juju-e4d256-prod-github-runner-207 kernel: [60204.611212] ? __secure_computing+0xa9/0x120 Aug 22 22:07:10 juju-e4d256-prod-github-runner-207 kernel: [60204.611903] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 22:07:10 juju-e4d256-prod-github-runner-207 kernel: [60204.612672] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:07:10 juju-e4d256-prod-github-runner-207 kernel: [60204.613404] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:07:10 juju-e4d256-prod-github-runner-207 kernel: [60204.614123] ? do_syscall_64+0x69/0xc0 Aug 22 22:07:10 juju-e4d256-prod-github-runner-207 kernel: [60204.614767] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:07:10 juju-e4d256-prod-github-runner-207 kernel: [60204.615490] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:07:10 juju-e4d256-prod-github-runner-207 kernel: [60204.616194] ? do_syscall_64+0x69/0xc0 Aug 22 22:07:10 juju-e4d256-prod-github-runner-207 kernel: [60204.616854] ? do_syscall_64+0x69/0xc0 Aug 22 22:07:10 juju-e4d256-prod-github-runner-207 kernel: [60204.617480] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 22:07:10 juju-e4d256-prod-github-runner-207 kernel: [60204.618199] RIP: 0033:0x7faa5d0edaff Aug 22 22:07:10 juju-e4d256-prod-github-runner-207 kernel: [60204.618855] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 22:07:10 juju-e4d256-prod-github-runner-207 kernel: [60204.621165] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 22:07:10 juju-e4d256-prod-github-runner-207 kernel: [60204.622417] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 22:07:10 juju-e4d256-prod-github-runner-207 kernel: [60204.623515] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 22:07:10 juju-e4d256-prod-github-runner-207 kernel: [60204.624451] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 22:07:10 juju-e4d256-prod-github-runner-207 kernel: [60204.625360] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 22:07:10 juju-e4d256-prod-github-runner-207 kernel: [60204.626268] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 22:07:10 juju-e4d256-prod-github-runner-207 kernel: [60204.627216] Aug 22 22:07:38 juju-e4d256-prod-github-runner-207 kernel: [60232.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 55987s! [qemu-system-x86:6715] Aug 22 22:07:38 juju-e4d256-prod-github-runner-207 kernel: [60232.543797] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 22:07:38 juju-e4d256-prod-github-runner-207 kernel: [60232.544073] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 22:07:38 juju-e4d256-prod-github-runner-207 kernel: [60232.556207] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 22:07:38 juju-e4d256-prod-github-runner-207 kernel: [60232.557482] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 22:07:38 juju-e4d256-prod-github-runner-207 kernel: [60232.558709] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:07:38 juju-e4d256-prod-github-runner-207 kernel: [60232.559786] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 22:07:38 juju-e4d256-prod-github-runner-207 kernel: [60232.562350] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 22:07:38 juju-e4d256-prod-github-runner-207 kernel: [60232.563409] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 22:07:38 juju-e4d256-prod-github-runner-207 kernel: [60232.564571] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 22:07:38 juju-e4d256-prod-github-runner-207 kernel: [60232.565742] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 22:07:38 juju-e4d256-prod-github-runner-207 kernel: [60232.566919] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 22:07:38 juju-e4d256-prod-github-runner-207 kernel: [60232.568094] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 22:07:38 juju-e4d256-prod-github-runner-207 kernel: [60232.569267] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 22:07:38 juju-e4d256-prod-github-runner-207 kernel: [60232.570501] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 22:07:38 juju-e4d256-prod-github-runner-207 kernel: [60232.571616] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 22:07:38 juju-e4d256-prod-github-runner-207 kernel: [60232.572812] Call Trace: Aug 22 22:07:38 juju-e4d256-prod-github-runner-207 kernel: [60232.573721] Aug 22 22:07:38 juju-e4d256-prod-github-runner-207 kernel: [60232.574632] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:07:38 juju-e4d256-prod-github-runner-207 kernel: [60232.575672] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:07:38 juju-e4d256-prod-github-runner-207 kernel: [60232.576690] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:07:38 juju-e4d256-prod-github-runner-207 kernel: [60232.577786] ? show_regs.part.0+0x23/0x29 Aug 22 22:07:38 juju-e4d256-prod-github-runner-207 kernel: [60232.578785] ? show_regs.cold+0x8/0xd Aug 22 22:07:38 juju-e4d256-prod-github-runner-207 kernel: [60232.579760] ? watchdog_timer_fn+0x1be/0x220 Aug 22 22:07:38 juju-e4d256-prod-github-runner-207 kernel: [60232.580764] ? lockup_detector_update_enable+0x60/0x60 Aug 22 22:07:38 juju-e4d256-prod-github-runner-207 kernel: [60232.581828] ? __hrtimer_run_queues+0x107/0x230 Aug 22 22:07:38 juju-e4d256-prod-github-runner-207 kernel: [60232.582857] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 22:07:38 juju-e4d256-prod-github-runner-207 kernel: [60232.583876] ? hrtimer_interrupt+0x101/0x220 Aug 22 22:07:38 juju-e4d256-prod-github-runner-207 kernel: [60232.584919] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 22:07:38 juju-e4d256-prod-github-runner-207 kernel: [60232.585995] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 22:07:38 juju-e4d256-prod-github-runner-207 kernel: [60232.587067] Aug 22 22:07:38 juju-e4d256-prod-github-runner-207 kernel: [60232.587931] Aug 22 22:07:38 juju-e4d256-prod-github-runner-207 kernel: [60232.588776] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 22:07:38 juju-e4d256-prod-github-runner-207 kernel: [60232.589805] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:07:38 juju-e4d256-prod-github-runner-207 kernel: [60232.590863] ? _raw_spin_lock+0x22/0x30 Aug 22 22:07:38 juju-e4d256-prod-github-runner-207 kernel: [60232.591816] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:07:38 juju-e4d256-prod-github-runner-207 kernel: [60232.592829] direct_page_fault+0x206/0x310 [kvm] Aug 22 22:07:38 juju-e4d256-prod-github-runner-207 kernel: [60232.593865] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 22:07:38 juju-e4d256-prod-github-runner-207 kernel: [60232.594900] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 22:07:38 juju-e4d256-prod-github-runner-207 kernel: [60232.595898] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 22:07:38 juju-e4d256-prod-github-runner-207 kernel: [60232.596892] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 22:07:38 juju-e4d256-prod-github-runner-207 kernel: [60232.597858] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 22:07:38 juju-e4d256-prod-github-runner-207 kernel: [60232.598862] handle_exit+0x98/0x230 [kvm_amd] Aug 22 22:07:38 juju-e4d256-prod-github-runner-207 kernel: [60232.599754] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 22:07:38 juju-e4d256-prod-github-runner-207 kernel: [60232.600669] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 22:07:38 juju-e4d256-prod-github-runner-207 kernel: [60232.601596] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 22:07:38 juju-e4d256-prod-github-runner-207 kernel: [60232.602499] vcpu_run+0x62/0x2c0 [kvm] Aug 22 22:07:38 juju-e4d256-prod-github-runner-207 kernel: [60232.603326] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 22:07:38 juju-e4d256-prod-github-runner-207 kernel: [60232.604181] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 22:07:38 juju-e4d256-prod-github-runner-207 kernel: [60232.605107] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 22:07:38 juju-e4d256-prod-github-runner-207 kernel: [60232.605910] ? __seccomp_filter+0x4a/0x4a0 Aug 22 22:07:38 juju-e4d256-prod-github-runner-207 kernel: [60232.606653] ? __fget_files+0x86/0xc0 Aug 22 22:07:38 juju-e4d256-prod-github-runner-207 kernel: [60232.607372] __x64_sys_ioctl+0x95/0xd0 Aug 22 22:07:38 juju-e4d256-prod-github-runner-207 kernel: [60232.608064] do_syscall_64+0x5c/0xc0 Aug 22 22:07:38 juju-e4d256-prod-github-runner-207 kernel: [60232.608729] ? do_futex+0x162/0x1f0 Aug 22 22:07:38 juju-e4d256-prod-github-runner-207 kernel: [60232.609377] ? __x64_sys_futex+0x78/0x1e0 Aug 22 22:07:38 juju-e4d256-prod-github-runner-207 kernel: [60232.610054] ? __secure_computing+0xa9/0x120 Aug 22 22:07:38 juju-e4d256-prod-github-runner-207 kernel: [60232.610745] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 22:07:38 juju-e4d256-prod-github-runner-207 kernel: [60232.611522] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:07:38 juju-e4d256-prod-github-runner-207 kernel: [60232.612247] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:07:38 juju-e4d256-prod-github-runner-207 kernel: [60232.612975] ? do_syscall_64+0x69/0xc0 Aug 22 22:07:38 juju-e4d256-prod-github-runner-207 kernel: [60232.613620] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:07:38 juju-e4d256-prod-github-runner-207 kernel: [60232.614322] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:07:38 juju-e4d256-prod-github-runner-207 kernel: [60232.615054] ? do_syscall_64+0x69/0xc0 Aug 22 22:07:38 juju-e4d256-prod-github-runner-207 kernel: [60232.615686] ? do_syscall_64+0x69/0xc0 Aug 22 22:07:38 juju-e4d256-prod-github-runner-207 kernel: [60232.616309] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 22:07:38 juju-e4d256-prod-github-runner-207 kernel: [60232.617020] RIP: 0033:0x7faa5d0edaff Aug 22 22:07:38 juju-e4d256-prod-github-runner-207 kernel: [60232.617702] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 22:07:38 juju-e4d256-prod-github-runner-207 kernel: [60232.619719] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 22:07:38 juju-e4d256-prod-github-runner-207 kernel: [60232.620630] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 22:07:38 juju-e4d256-prod-github-runner-207 kernel: [60232.621523] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 22:07:38 juju-e4d256-prod-github-runner-207 kernel: [60232.622423] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 22:07:38 juju-e4d256-prod-github-runner-207 kernel: [60232.623321] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 22:07:38 juju-e4d256-prod-github-runner-207 kernel: [60232.624212] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 22:07:38 juju-e4d256-prod-github-runner-207 kernel: [60232.625103] Aug 22 22:08:06 juju-e4d256-prod-github-runner-207 kernel: [60260.541976] watchdog: BUG: soft lockup - CPU#1 stuck for 56014s! [qemu-system-x86:6715] Aug 22 22:08:06 juju-e4d256-prod-github-runner-207 kernel: [60260.543146] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 22:08:06 juju-e4d256-prod-github-runner-207 kernel: [60260.543216] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 22:08:06 juju-e4d256-prod-github-runner-207 kernel: [60260.555666] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 22:08:06 juju-e4d256-prod-github-runner-207 kernel: [60260.556972] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 22:08:06 juju-e4d256-prod-github-runner-207 kernel: [60260.558218] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:08:06 juju-e4d256-prod-github-runner-207 kernel: [60260.559354] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 22:08:06 juju-e4d256-prod-github-runner-207 kernel: [60260.562037] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 22:08:06 juju-e4d256-prod-github-runner-207 kernel: [60260.563122] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 22:08:06 juju-e4d256-prod-github-runner-207 kernel: [60260.564391] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 22:08:06 juju-e4d256-prod-github-runner-207 kernel: [60260.565573] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 22:08:06 juju-e4d256-prod-github-runner-207 kernel: [60260.566777] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 22:08:06 juju-e4d256-prod-github-runner-207 kernel: [60260.567973] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 22:08:06 juju-e4d256-prod-github-runner-207 kernel: [60260.569170] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 22:08:06 juju-e4d256-prod-github-runner-207 kernel: [60260.570432] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 22:08:06 juju-e4d256-prod-github-runner-207 kernel: [60260.571558] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 22:08:06 juju-e4d256-prod-github-runner-207 kernel: [60260.572779] Call Trace: Aug 22 22:08:06 juju-e4d256-prod-github-runner-207 kernel: [60260.573763] Aug 22 22:08:06 juju-e4d256-prod-github-runner-207 kernel: [60260.574730] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:08:06 juju-e4d256-prod-github-runner-207 kernel: [60260.575810] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:08:06 juju-e4d256-prod-github-runner-207 kernel: [60260.576841] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:08:06 juju-e4d256-prod-github-runner-207 kernel: [60260.577941] ? show_regs.part.0+0x23/0x29 Aug 22 22:08:06 juju-e4d256-prod-github-runner-207 kernel: [60260.578957] ? show_regs.cold+0x8/0xd Aug 22 22:08:06 juju-e4d256-prod-github-runner-207 kernel: [60260.579947] ? watchdog_timer_fn+0x1be/0x220 Aug 22 22:08:06 juju-e4d256-prod-github-runner-207 kernel: [60260.580970] ? lockup_detector_update_enable+0x60/0x60 Aug 22 22:08:06 juju-e4d256-prod-github-runner-207 kernel: [60260.582057] ? __hrtimer_run_queues+0x107/0x230 Aug 22 22:08:06 juju-e4d256-prod-github-runner-207 kernel: [60260.583118] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 22:08:06 juju-e4d256-prod-github-runner-207 kernel: [60260.584152] ? hrtimer_interrupt+0x101/0x220 Aug 22 22:08:06 juju-e4d256-prod-github-runner-207 kernel: [60260.585178] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 22:08:06 juju-e4d256-prod-github-runner-207 kernel: [60260.586256] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 22:08:06 juju-e4d256-prod-github-runner-207 kernel: [60260.587334] Aug 22 22:08:06 juju-e4d256-prod-github-runner-207 kernel: [60260.588192] Aug 22 22:08:06 juju-e4d256-prod-github-runner-207 kernel: [60260.589033] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 22:08:06 juju-e4d256-prod-github-runner-207 kernel: [60260.590076] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:08:06 juju-e4d256-prod-github-runner-207 kernel: [60260.591144] ? _raw_spin_lock+0x22/0x30 Aug 22 22:08:06 juju-e4d256-prod-github-runner-207 kernel: [60260.592107] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:08:06 juju-e4d256-prod-github-runner-207 kernel: [60260.593135] direct_page_fault+0x206/0x310 [kvm] Aug 22 22:08:06 juju-e4d256-prod-github-runner-207 kernel: [60260.594175] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 22:08:06 juju-e4d256-prod-github-runner-207 kernel: [60260.595202] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 22:08:06 juju-e4d256-prod-github-runner-207 kernel: [60260.596218] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 22:08:06 juju-e4d256-prod-github-runner-207 kernel: [60260.597199] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 22:08:06 juju-e4d256-prod-github-runner-207 kernel: [60260.598158] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 22:08:06 juju-e4d256-prod-github-runner-207 kernel: [60260.599168] handle_exit+0x98/0x230 [kvm_amd] Aug 22 22:08:06 juju-e4d256-prod-github-runner-207 kernel: [60260.600068] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 22:08:06 juju-e4d256-prod-github-runner-207 kernel: [60260.601025] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 22:08:06 juju-e4d256-prod-github-runner-207 kernel: [60260.601963] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 22:08:06 juju-e4d256-prod-github-runner-207 kernel: [60260.602904] vcpu_run+0x62/0x2c0 [kvm] Aug 22 22:08:06 juju-e4d256-prod-github-runner-207 kernel: [60260.603754] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 22:08:06 juju-e4d256-prod-github-runner-207 kernel: [60260.604576] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 22:08:06 juju-e4d256-prod-github-runner-207 kernel: [60260.605442] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 22:08:06 juju-e4d256-prod-github-runner-207 kernel: [60260.606251] ? __seccomp_filter+0x4a/0x4a0 Aug 22 22:08:06 juju-e4d256-prod-github-runner-207 kernel: [60260.607079] ? __fget_files+0x86/0xc0 Aug 22 22:08:06 juju-e4d256-prod-github-runner-207 kernel: [60260.607819] __x64_sys_ioctl+0x95/0xd0 Aug 22 22:08:06 juju-e4d256-prod-github-runner-207 kernel: [60260.608520] do_syscall_64+0x5c/0xc0 Aug 22 22:08:06 juju-e4d256-prod-github-runner-207 kernel: [60260.609209] ? do_futex+0x162/0x1f0 Aug 22 22:08:06 juju-e4d256-prod-github-runner-207 kernel: [60260.609887] ? __x64_sys_futex+0x78/0x1e0 Aug 22 22:08:06 juju-e4d256-prod-github-runner-207 kernel: [60260.610637] ? __secure_computing+0xa9/0x120 Aug 22 22:08:06 juju-e4d256-prod-github-runner-207 kernel: [60260.611339] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 22:08:06 juju-e4d256-prod-github-runner-207 kernel: [60260.612114] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:08:06 juju-e4d256-prod-github-runner-207 kernel: [60260.612857] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:08:06 juju-e4d256-prod-github-runner-207 kernel: [60260.613590] ? do_syscall_64+0x69/0xc0 Aug 22 22:08:06 juju-e4d256-prod-github-runner-207 kernel: [60260.614264] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:08:06 juju-e4d256-prod-github-runner-207 kernel: [60260.615015] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:08:06 juju-e4d256-prod-github-runner-207 kernel: [60260.615897] ? do_syscall_64+0x69/0xc0 Aug 22 22:08:06 juju-e4d256-prod-github-runner-207 kernel: [60260.616595] ? do_syscall_64+0x69/0xc0 Aug 22 22:08:06 juju-e4d256-prod-github-runner-207 kernel: [60260.617282] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 22:08:06 juju-e4d256-prod-github-runner-207 kernel: [60260.618039] RIP: 0033:0x7faa5d0edaff Aug 22 22:08:06 juju-e4d256-prod-github-runner-207 kernel: [60260.618732] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 22:08:06 juju-e4d256-prod-github-runner-207 kernel: [60260.620880] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 22:08:06 juju-e4d256-prod-github-runner-207 kernel: [60260.622010] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 22:08:06 juju-e4d256-prod-github-runner-207 kernel: [60260.623012] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 22:08:06 juju-e4d256-prod-github-runner-207 kernel: [60260.623949] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 22:08:06 juju-e4d256-prod-github-runner-207 kernel: [60260.624869] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 22:08:06 juju-e4d256-prod-github-runner-207 kernel: [60260.625850] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 22:08:06 juju-e4d256-prod-github-runner-207 kernel: [60260.626845] Aug 22 22:08:34 juju-e4d256-prod-github-runner-207 kernel: [60288.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 56040s! [qemu-system-x86:6715] Aug 22 22:08:34 juju-e4d256-prod-github-runner-207 kernel: [60288.543877] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 22:08:34 juju-e4d256-prod-github-runner-207 kernel: [60288.544176] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 22:08:34 juju-e4d256-prod-github-runner-207 kernel: [60288.556637] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 22:08:34 juju-e4d256-prod-github-runner-207 kernel: [60288.557903] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 22:08:34 juju-e4d256-prod-github-runner-207 kernel: [60288.559149] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:08:34 juju-e4d256-prod-github-runner-207 kernel: [60288.560216] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 22:08:34 juju-e4d256-prod-github-runner-207 kernel: [60288.562825] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 22:08:34 juju-e4d256-prod-github-runner-207 kernel: [60288.563885] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 22:08:34 juju-e4d256-prod-github-runner-207 kernel: [60288.565067] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 22:08:34 juju-e4d256-prod-github-runner-207 kernel: [60288.566241] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 22:08:34 juju-e4d256-prod-github-runner-207 kernel: [60288.567398] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 22:08:34 juju-e4d256-prod-github-runner-207 kernel: [60288.568561] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 22:08:34 juju-e4d256-prod-github-runner-207 kernel: [60288.569734] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 22:08:34 juju-e4d256-prod-github-runner-207 kernel: [60288.570985] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 22:08:34 juju-e4d256-prod-github-runner-207 kernel: [60288.572316] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 22:08:34 juju-e4d256-prod-github-runner-207 kernel: [60288.573614] Call Trace: Aug 22 22:08:34 juju-e4d256-prod-github-runner-207 kernel: [60288.574586] Aug 22 22:08:34 juju-e4d256-prod-github-runner-207 kernel: [60288.575538] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:08:34 juju-e4d256-prod-github-runner-207 kernel: [60288.576583] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:08:34 juju-e4d256-prod-github-runner-207 kernel: [60288.577611] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:08:34 juju-e4d256-prod-github-runner-207 kernel: [60288.578724] ? show_regs.part.0+0x23/0x29 Aug 22 22:08:34 juju-e4d256-prod-github-runner-207 kernel: [60288.579722] ? show_regs.cold+0x8/0xd Aug 22 22:08:34 juju-e4d256-prod-github-runner-207 kernel: [60288.580706] ? watchdog_timer_fn+0x1be/0x220 Aug 22 22:08:34 juju-e4d256-prod-github-runner-207 kernel: [60288.581715] ? lockup_detector_update_enable+0x60/0x60 Aug 22 22:08:34 juju-e4d256-prod-github-runner-207 kernel: [60288.582794] ? __hrtimer_run_queues+0x107/0x230 Aug 22 22:08:34 juju-e4d256-prod-github-runner-207 kernel: [60288.583831] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 22:08:34 juju-e4d256-prod-github-runner-207 kernel: [60288.584864] ? hrtimer_interrupt+0x101/0x220 Aug 22 22:08:34 juju-e4d256-prod-github-runner-207 kernel: [60288.585921] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 22:08:34 juju-e4d256-prod-github-runner-207 kernel: [60288.587051] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 22:08:34 juju-e4d256-prod-github-runner-207 kernel: [60288.588144] Aug 22 22:08:34 juju-e4d256-prod-github-runner-207 kernel: [60288.589013] Aug 22 22:08:34 juju-e4d256-prod-github-runner-207 kernel: [60288.589859] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 22:08:34 juju-e4d256-prod-github-runner-207 kernel: [60288.590997] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:08:34 juju-e4d256-prod-github-runner-207 kernel: [60288.592078] ? _raw_spin_lock+0x22/0x30 Aug 22 22:08:34 juju-e4d256-prod-github-runner-207 kernel: [60288.593025] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:08:34 juju-e4d256-prod-github-runner-207 kernel: [60288.594047] direct_page_fault+0x206/0x310 [kvm] Aug 22 22:08:34 juju-e4d256-prod-github-runner-207 kernel: [60288.595088] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 22:08:34 juju-e4d256-prod-github-runner-207 kernel: [60288.596096] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 22:08:34 juju-e4d256-prod-github-runner-207 kernel: [60288.597099] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 22:08:34 juju-e4d256-prod-github-runner-207 kernel: [60288.598147] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 22:08:34 juju-e4d256-prod-github-runner-207 kernel: [60288.599096] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 22:08:34 juju-e4d256-prod-github-runner-207 kernel: [60288.600085] handle_exit+0x98/0x230 [kvm_amd] Aug 22 22:08:34 juju-e4d256-prod-github-runner-207 kernel: [60288.600994] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 22:08:34 juju-e4d256-prod-github-runner-207 kernel: [60288.601911] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 22:08:34 juju-e4d256-prod-github-runner-207 kernel: [60288.602853] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 22:08:34 juju-e4d256-prod-github-runner-207 kernel: [60288.603754] vcpu_run+0x62/0x2c0 [kvm] Aug 22 22:08:34 juju-e4d256-prod-github-runner-207 kernel: [60288.604608] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 22:08:34 juju-e4d256-prod-github-runner-207 kernel: [60288.605470] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 22:08:34 juju-e4d256-prod-github-runner-207 kernel: [60288.606341] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 22:08:34 juju-e4d256-prod-github-runner-207 kernel: [60288.607143] ? __seccomp_filter+0x4a/0x4a0 Aug 22 22:08:34 juju-e4d256-prod-github-runner-207 kernel: [60288.607890] ? __fget_files+0x86/0xc0 Aug 22 22:08:34 juju-e4d256-prod-github-runner-207 kernel: [60288.608595] __x64_sys_ioctl+0x95/0xd0 Aug 22 22:08:34 juju-e4d256-prod-github-runner-207 kernel: [60288.609290] do_syscall_64+0x5c/0xc0 Aug 22 22:08:34 juju-e4d256-prod-github-runner-207 kernel: [60288.609957] ? do_futex+0x162/0x1f0 Aug 22 22:08:34 juju-e4d256-prod-github-runner-207 kernel: [60288.610624] ? __x64_sys_futex+0x78/0x1e0 Aug 22 22:08:34 juju-e4d256-prod-github-runner-207 kernel: [60288.611309] ? __secure_computing+0xa9/0x120 Aug 22 22:08:34 juju-e4d256-prod-github-runner-207 kernel: [60288.612005] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 22:08:34 juju-e4d256-prod-github-runner-207 kernel: [60288.612767] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:08:34 juju-e4d256-prod-github-runner-207 kernel: [60288.613496] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:08:34 juju-e4d256-prod-github-runner-207 kernel: [60288.614231] ? do_syscall_64+0x69/0xc0 Aug 22 22:08:34 juju-e4d256-prod-github-runner-207 kernel: [60288.614880] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:08:34 juju-e4d256-prod-github-runner-207 kernel: [60288.615588] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:08:34 juju-e4d256-prod-github-runner-207 kernel: [60288.616289] ? do_syscall_64+0x69/0xc0 Aug 22 22:08:34 juju-e4d256-prod-github-runner-207 kernel: [60288.616915] ? do_syscall_64+0x69/0xc0 Aug 22 22:08:34 juju-e4d256-prod-github-runner-207 kernel: [60288.617538] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 22:08:34 juju-e4d256-prod-github-runner-207 kernel: [60288.618259] RIP: 0033:0x7faa5d0edaff Aug 22 22:08:34 juju-e4d256-prod-github-runner-207 kernel: [60288.618931] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 22:08:34 juju-e4d256-prod-github-runner-207 kernel: [60288.620916] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 22:08:34 juju-e4d256-prod-github-runner-207 kernel: [60288.621834] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 22:08:34 juju-e4d256-prod-github-runner-207 kernel: [60288.622741] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 22:08:34 juju-e4d256-prod-github-runner-207 kernel: [60288.623628] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 22:08:34 juju-e4d256-prod-github-runner-207 kernel: [60288.624515] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 22:08:34 juju-e4d256-prod-github-runner-207 kernel: [60288.625402] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 22:08:34 juju-e4d256-prod-github-runner-207 kernel: [60288.626308] Aug 22 22:08:47 juju-e4d256-prod-github-runner-207 kernel: [60301.208707] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 22:08:47 juju-e4d256-prod-github-runner-207 kernel: [60301.209713] rcu: 1-....: (14998622 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=7246488 Aug 22 22:08:47 juju-e4d256-prod-github-runner-207 kernel: [60301.210918] (t=15046002 jiffies g=23269 q=54089) Aug 22 22:08:47 juju-e4d256-prod-github-runner-207 kernel: [60301.211808] NMI backtrace for cpu 1 Aug 22 22:08:47 juju-e4d256-prod-github-runner-207 kernel: [60301.212686] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 22:08:47 juju-e4d256-prod-github-runner-207 kernel: [60301.213804] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 22:08:47 juju-e4d256-prod-github-runner-207 kernel: [60301.214896] Call Trace: Aug 22 22:08:47 juju-e4d256-prod-github-runner-207 kernel: [60301.215593] Aug 22 22:08:47 juju-e4d256-prod-github-runner-207 kernel: [60301.216270] show_stack+0x52/0x5c Aug 22 22:08:47 juju-e4d256-prod-github-runner-207 kernel: [60301.217052] dump_stack_lvl+0x4a/0x63 Aug 22 22:08:47 juju-e4d256-prod-github-runner-207 kernel: [60301.218213] dump_stack+0x10/0x16 Aug 22 22:08:47 juju-e4d256-prod-github-runner-207 kernel: [60301.219000] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 22:08:47 juju-e4d256-prod-github-runner-207 kernel: [60301.219790] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 22:08:47 juju-e4d256-prod-github-runner-207 kernel: [60301.220573] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 22:08:47 juju-e4d256-prod-github-runner-207 kernel: [60301.221424] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 22:08:47 juju-e4d256-prod-github-runner-207 kernel: [60301.222282] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 22:08:47 juju-e4d256-prod-github-runner-207 kernel: [60301.223276] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 22:08:47 juju-e4d256-prod-github-runner-207 kernel: [60301.224113] print_cpu_stall.cold+0x2f/0xe2 Aug 22 22:08:47 juju-e4d256-prod-github-runner-207 kernel: [60301.224891] ? timekeeping_update+0xf7/0x150 Aug 22 22:08:47 juju-e4d256-prod-github-runner-207 kernel: [60301.225711] check_cpu_stall+0x109/0x270 Aug 22 22:08:47 juju-e4d256-prod-github-runner-207 kernel: [60301.226603] rcu_sched_clock_irq+0x9a/0x250 Aug 22 22:08:47 juju-e4d256-prod-github-runner-207 kernel: [60301.227379] update_process_times+0x94/0xd0 Aug 22 22:08:47 juju-e4d256-prod-github-runner-207 kernel: [60301.228171] tick_sched_handle+0x29/0x70 Aug 22 22:08:47 juju-e4d256-prod-github-runner-207 kernel: [60301.229110] tick_sched_timer+0x8c/0xc0 Aug 22 22:08:47 juju-e4d256-prod-github-runner-207 kernel: [60301.231103] ? tick_nohz_handler+0xb0/0xb0 Aug 22 22:08:47 juju-e4d256-prod-github-runner-207 kernel: [60301.231917] __hrtimer_run_queues+0x107/0x230 Aug 22 22:08:47 juju-e4d256-prod-github-runner-207 kernel: [60301.232776] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 22:08:47 juju-e4d256-prod-github-runner-207 kernel: [60301.233641] hrtimer_interrupt+0x101/0x220 Aug 22 22:08:47 juju-e4d256-prod-github-runner-207 kernel: [60301.234424] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 22:08:47 juju-e4d256-prod-github-runner-207 kernel: [60301.235237] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 22:08:47 juju-e4d256-prod-github-runner-207 kernel: [60301.236043] Aug 22 22:08:47 juju-e4d256-prod-github-runner-207 kernel: [60301.236697] Aug 22 22:08:47 juju-e4d256-prod-github-runner-207 kernel: [60301.237417] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 22:08:47 juju-e4d256-prod-github-runner-207 kernel: [60301.238283] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:08:47 juju-e4d256-prod-github-runner-207 kernel: [60301.239334] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 22:08:47 juju-e4d256-prod-github-runner-207 kernel: [60301.241753] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 22:08:47 juju-e4d256-prod-github-runner-207 kernel: [60301.242657] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 22:08:47 juju-e4d256-prod-github-runner-207 kernel: [60301.243690] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 22:08:47 juju-e4d256-prod-github-runner-207 kernel: [60301.244820] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 22:08:47 juju-e4d256-prod-github-runner-207 kernel: [60301.245891] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 22:08:47 juju-e4d256-prod-github-runner-207 kernel: [60301.246937] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 22:08:47 juju-e4d256-prod-github-runner-207 kernel: [60301.247916] ? _raw_spin_lock+0x22/0x30 Aug 22 22:08:47 juju-e4d256-prod-github-runner-207 kernel: [60301.248729] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:08:47 juju-e4d256-prod-github-runner-207 kernel: [60301.249598] direct_page_fault+0x206/0x310 [kvm] Aug 22 22:08:47 juju-e4d256-prod-github-runner-207 kernel: [60301.250498] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 22:08:47 juju-e4d256-prod-github-runner-207 kernel: [60301.251339] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 22:08:47 juju-e4d256-prod-github-runner-207 kernel: [60301.252366] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 22:08:47 juju-e4d256-prod-github-runner-207 kernel: [60301.253191] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 22:08:47 juju-e4d256-prod-github-runner-207 kernel: [60301.254021] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 22:08:47 juju-e4d256-prod-github-runner-207 kernel: [60301.254865] handle_exit+0x98/0x230 [kvm_amd] Aug 22 22:08:47 juju-e4d256-prod-github-runner-207 kernel: [60301.255638] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 22:08:47 juju-e4d256-prod-github-runner-207 kernel: [60301.256451] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 22:08:47 juju-e4d256-prod-github-runner-207 kernel: [60301.257361] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 22:08:47 juju-e4d256-prod-github-runner-207 kernel: [60301.258195] vcpu_run+0x62/0x2c0 [kvm] Aug 22 22:08:47 juju-e4d256-prod-github-runner-207 kernel: [60301.258943] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 22:08:47 juju-e4d256-prod-github-runner-207 kernel: [60301.259674] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 22:08:47 juju-e4d256-prod-github-runner-207 kernel: [60301.260488] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 22:08:47 juju-e4d256-prod-github-runner-207 kernel: [60301.261270] ? __seccomp_filter+0x4a/0x4a0 Aug 22 22:08:47 juju-e4d256-prod-github-runner-207 kernel: [60301.262055] ? __fget_files+0x86/0xc0 Aug 22 22:08:47 juju-e4d256-prod-github-runner-207 kernel: [60301.262765] __x64_sys_ioctl+0x95/0xd0 Aug 22 22:08:47 juju-e4d256-prod-github-runner-207 kernel: [60301.263463] do_syscall_64+0x5c/0xc0 Aug 22 22:08:47 juju-e4d256-prod-github-runner-207 kernel: [60301.264154] ? do_futex+0x162/0x1f0 Aug 22 22:08:47 juju-e4d256-prod-github-runner-207 kernel: [60301.264905] ? __x64_sys_futex+0x78/0x1e0 Aug 22 22:08:47 juju-e4d256-prod-github-runner-207 kernel: [60301.265783] ? __secure_computing+0xa9/0x120 Aug 22 22:08:47 juju-e4d256-prod-github-runner-207 kernel: [60301.266610] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 22:08:47 juju-e4d256-prod-github-runner-207 kernel: [60301.267424] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:08:47 juju-e4d256-prod-github-runner-207 kernel: [60301.268213] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:08:47 juju-e4d256-prod-github-runner-207 kernel: [60301.269093] ? do_syscall_64+0x69/0xc0 Aug 22 22:08:47 juju-e4d256-prod-github-runner-207 kernel: [60301.269791] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:08:47 juju-e4d256-prod-github-runner-207 kernel: [60301.270594] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:08:47 juju-e4d256-prod-github-runner-207 kernel: [60301.271384] ? do_syscall_64+0x69/0xc0 Aug 22 22:08:47 juju-e4d256-prod-github-runner-207 kernel: [60301.272239] ? do_syscall_64+0x69/0xc0 Aug 22 22:08:47 juju-e4d256-prod-github-runner-207 kernel: [60301.273023] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 22:08:47 juju-e4d256-prod-github-runner-207 kernel: [60301.273850] RIP: 0033:0x7faa5d0edaff Aug 22 22:08:47 juju-e4d256-prod-github-runner-207 kernel: [60301.274548] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 22:08:47 juju-e4d256-prod-github-runner-207 kernel: [60301.276651] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 22:08:47 juju-e4d256-prod-github-runner-207 kernel: [60301.277653] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 22:08:47 juju-e4d256-prod-github-runner-207 kernel: [60301.278630] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 22:08:47 juju-e4d256-prod-github-runner-207 kernel: [60301.279606] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 22:08:47 juju-e4d256-prod-github-runner-207 kernel: [60301.280551] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 22:08:47 juju-e4d256-prod-github-runner-207 kernel: [60301.281488] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 22:08:47 juju-e4d256-prod-github-runner-207 kernel: [60301.282431] Aug 22 22:09:14 juju-e4d256-prod-github-runner-207 kernel: [60328.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 56077s! [qemu-system-x86:6715] Aug 22 22:09:14 juju-e4d256-prod-github-runner-207 kernel: [60328.543109] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 22:09:14 juju-e4d256-prod-github-runner-207 kernel: [60328.543181] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 22:09:14 juju-e4d256-prod-github-runner-207 kernel: [60328.555866] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 22:09:14 juju-e4d256-prod-github-runner-207 kernel: [60328.557198] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 22:09:14 juju-e4d256-prod-github-runner-207 kernel: [60328.558534] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:09:14 juju-e4d256-prod-github-runner-207 kernel: [60328.559611] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 22:09:14 juju-e4d256-prod-github-runner-207 kernel: [60328.562228] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 22:09:14 juju-e4d256-prod-github-runner-207 kernel: [60328.563291] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 22:09:14 juju-e4d256-prod-github-runner-207 kernel: [60328.564470] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 22:09:14 juju-e4d256-prod-github-runner-207 kernel: [60328.565665] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 22:09:14 juju-e4d256-prod-github-runner-207 kernel: [60328.566847] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 22:09:14 juju-e4d256-prod-github-runner-207 kernel: [60328.568040] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 22:09:14 juju-e4d256-prod-github-runner-207 kernel: [60328.569219] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 22:09:14 juju-e4d256-prod-github-runner-207 kernel: [60328.570493] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 22:09:14 juju-e4d256-prod-github-runner-207 kernel: [60328.571602] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 22:09:14 juju-e4d256-prod-github-runner-207 kernel: [60328.572826] Call Trace: Aug 22 22:09:14 juju-e4d256-prod-github-runner-207 kernel: [60328.573758] Aug 22 22:09:14 juju-e4d256-prod-github-runner-207 kernel: [60328.574664] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:09:14 juju-e4d256-prod-github-runner-207 kernel: [60328.575702] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:09:14 juju-e4d256-prod-github-runner-207 kernel: [60328.576735] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:09:14 juju-e4d256-prod-github-runner-207 kernel: [60328.577835] ? show_regs.part.0+0x23/0x29 Aug 22 22:09:14 juju-e4d256-prod-github-runner-207 kernel: [60328.578848] ? show_regs.cold+0x8/0xd Aug 22 22:09:14 juju-e4d256-prod-github-runner-207 kernel: [60328.579840] ? watchdog_timer_fn+0x1be/0x220 Aug 22 22:09:14 juju-e4d256-prod-github-runner-207 kernel: [60328.580868] ? lockup_detector_update_enable+0x60/0x60 Aug 22 22:09:14 juju-e4d256-prod-github-runner-207 kernel: [60328.582011] ? __hrtimer_run_queues+0x107/0x230 Aug 22 22:09:14 juju-e4d256-prod-github-runner-207 kernel: [60328.583058] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 22:09:14 juju-e4d256-prod-github-runner-207 kernel: [60328.584097] ? hrtimer_interrupt+0x101/0x220 Aug 22 22:09:14 juju-e4d256-prod-github-runner-207 kernel: [60328.585127] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 22:09:14 juju-e4d256-prod-github-runner-207 kernel: [60328.586223] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 22:09:14 juju-e4d256-prod-github-runner-207 kernel: [60328.587295] Aug 22 22:09:14 juju-e4d256-prod-github-runner-207 kernel: [60328.588160] Aug 22 22:09:14 juju-e4d256-prod-github-runner-207 kernel: [60328.589013] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 22:09:14 juju-e4d256-prod-github-runner-207 kernel: [60328.590083] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:09:14 juju-e4d256-prod-github-runner-207 kernel: [60328.591155] ? _raw_spin_lock+0x22/0x30 Aug 22 22:09:14 juju-e4d256-prod-github-runner-207 kernel: [60328.592134] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:09:14 juju-e4d256-prod-github-runner-207 kernel: [60328.593171] direct_page_fault+0x206/0x310 [kvm] Aug 22 22:09:14 juju-e4d256-prod-github-runner-207 kernel: [60328.594245] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 22:09:14 juju-e4d256-prod-github-runner-207 kernel: [60328.595331] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 22:09:14 juju-e4d256-prod-github-runner-207 kernel: [60328.596350] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 22:09:14 juju-e4d256-prod-github-runner-207 kernel: [60328.597337] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 22:09:14 juju-e4d256-prod-github-runner-207 kernel: [60328.598313] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 22:09:14 juju-e4d256-prod-github-runner-207 kernel: [60328.599359] handle_exit+0x98/0x230 [kvm_amd] Aug 22 22:09:14 juju-e4d256-prod-github-runner-207 kernel: [60328.600299] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 22:09:14 juju-e4d256-prod-github-runner-207 kernel: [60328.601455] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 22:09:14 juju-e4d256-prod-github-runner-207 kernel: [60328.602410] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 22:09:14 juju-e4d256-prod-github-runner-207 kernel: [60328.603323] vcpu_run+0x62/0x2c0 [kvm] Aug 22 22:09:14 juju-e4d256-prod-github-runner-207 kernel: [60328.604142] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 22:09:14 juju-e4d256-prod-github-runner-207 kernel: [60328.604960] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 22:09:14 juju-e4d256-prod-github-runner-207 kernel: [60328.605838] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 22:09:14 juju-e4d256-prod-github-runner-207 kernel: [60328.606650] ? __seccomp_filter+0x4a/0x4a0 Aug 22 22:09:14 juju-e4d256-prod-github-runner-207 kernel: [60328.607401] ? __fget_files+0x86/0xc0 Aug 22 22:09:14 juju-e4d256-prod-github-runner-207 kernel: [60328.608118] __x64_sys_ioctl+0x95/0xd0 Aug 22 22:09:14 juju-e4d256-prod-github-runner-207 kernel: [60328.608820] do_syscall_64+0x5c/0xc0 Aug 22 22:09:14 juju-e4d256-prod-github-runner-207 kernel: [60328.609503] ? do_futex+0x162/0x1f0 Aug 22 22:09:14 juju-e4d256-prod-github-runner-207 kernel: [60328.610192] ? __x64_sys_futex+0x78/0x1e0 Aug 22 22:09:14 juju-e4d256-prod-github-runner-207 kernel: [60328.610884] ? __secure_computing+0xa9/0x120 Aug 22 22:09:14 juju-e4d256-prod-github-runner-207 kernel: [60328.611590] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 22:09:14 juju-e4d256-prod-github-runner-207 kernel: [60328.612359] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:09:14 juju-e4d256-prod-github-runner-207 kernel: [60328.613101] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:09:14 juju-e4d256-prod-github-runner-207 kernel: [60328.613847] ? do_syscall_64+0x69/0xc0 Aug 22 22:09:14 juju-e4d256-prod-github-runner-207 kernel: [60328.614499] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:09:14 juju-e4d256-prod-github-runner-207 kernel: [60328.615212] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:09:14 juju-e4d256-prod-github-runner-207 kernel: [60328.615916] ? do_syscall_64+0x69/0xc0 Aug 22 22:09:14 juju-e4d256-prod-github-runner-207 kernel: [60328.616567] ? do_syscall_64+0x69/0xc0 Aug 22 22:09:14 juju-e4d256-prod-github-runner-207 kernel: [60328.617209] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 22:09:14 juju-e4d256-prod-github-runner-207 kernel: [60328.617955] RIP: 0033:0x7faa5d0edaff Aug 22 22:09:14 juju-e4d256-prod-github-runner-207 kernel: [60328.618595] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 22:09:14 juju-e4d256-prod-github-runner-207 kernel: [60328.620637] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 22:09:14 juju-e4d256-prod-github-runner-207 kernel: [60328.621578] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 22:09:14 juju-e4d256-prod-github-runner-207 kernel: [60328.622516] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 22:09:14 juju-e4d256-prod-github-runner-207 kernel: [60328.623474] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 22:09:14 juju-e4d256-prod-github-runner-207 kernel: [60328.624389] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 22:09:14 juju-e4d256-prod-github-runner-207 kernel: [60328.625299] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 22:09:14 juju-e4d256-prod-github-runner-207 kernel: [60328.626225] Aug 22 22:09:42 juju-e4d256-prod-github-runner-207 kernel: [60356.541980] watchdog: BUG: soft lockup - CPU#1 stuck for 56103s! [qemu-system-x86:6715] Aug 22 22:09:42 juju-e4d256-prod-github-runner-207 kernel: [60356.543156] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 22:09:42 juju-e4d256-prod-github-runner-207 kernel: [60356.543230] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 22:09:42 juju-e4d256-prod-github-runner-207 kernel: [60356.556822] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 22:09:42 juju-e4d256-prod-github-runner-207 kernel: [60356.558480] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 22:09:42 juju-e4d256-prod-github-runner-207 kernel: [60356.559888] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:09:42 juju-e4d256-prod-github-runner-207 kernel: [60356.561123] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 22:09:42 juju-e4d256-prod-github-runner-207 kernel: [60356.563847] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 22:09:42 juju-e4d256-prod-github-runner-207 kernel: [60356.564945] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 22:09:42 juju-e4d256-prod-github-runner-207 kernel: [60356.566371] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 22:09:42 juju-e4d256-prod-github-runner-207 kernel: [60356.567545] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 22:09:42 juju-e4d256-prod-github-runner-207 kernel: [60356.568710] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 22:09:42 juju-e4d256-prod-github-runner-207 kernel: [60356.569888] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 22:09:42 juju-e4d256-prod-github-runner-207 kernel: [60356.571056] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 22:09:42 juju-e4d256-prod-github-runner-207 kernel: [60356.572289] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 22:09:42 juju-e4d256-prod-github-runner-207 kernel: [60356.573441] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 22:09:42 juju-e4d256-prod-github-runner-207 kernel: [60356.574640] Call Trace: Aug 22 22:09:42 juju-e4d256-prod-github-runner-207 kernel: [60356.575559] Aug 22 22:09:42 juju-e4d256-prod-github-runner-207 kernel: [60356.576443] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:09:42 juju-e4d256-prod-github-runner-207 kernel: [60356.577500] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:09:42 juju-e4d256-prod-github-runner-207 kernel: [60356.578528] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:09:42 juju-e4d256-prod-github-runner-207 kernel: [60356.579601] ? show_regs.part.0+0x23/0x29 Aug 22 22:09:42 juju-e4d256-prod-github-runner-207 kernel: [60356.580597] ? show_regs.cold+0x8/0xd Aug 22 22:09:42 juju-e4d256-prod-github-runner-207 kernel: [60356.581588] ? watchdog_timer_fn+0x1be/0x220 Aug 22 22:09:42 juju-e4d256-prod-github-runner-207 kernel: [60356.582600] ? lockup_detector_update_enable+0x60/0x60 Aug 22 22:09:42 juju-e4d256-prod-github-runner-207 kernel: [60356.583676] ? __hrtimer_run_queues+0x107/0x230 Aug 22 22:09:42 juju-e4d256-prod-github-runner-207 kernel: [60356.584703] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 22:09:42 juju-e4d256-prod-github-runner-207 kernel: [60356.585747] ? hrtimer_interrupt+0x101/0x220 Aug 22 22:09:42 juju-e4d256-prod-github-runner-207 kernel: [60356.586766] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 22:09:42 juju-e4d256-prod-github-runner-207 kernel: [60356.587832] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 22:09:42 juju-e4d256-prod-github-runner-207 kernel: [60356.588875] Aug 22 22:09:42 juju-e4d256-prod-github-runner-207 kernel: [60356.589742] Aug 22 22:09:42 juju-e4d256-prod-github-runner-207 kernel: [60356.590587] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 22:09:42 juju-e4d256-prod-github-runner-207 kernel: [60356.591625] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:09:42 juju-e4d256-prod-github-runner-207 kernel: [60356.592665] ? _raw_spin_lock+0x22/0x30 Aug 22 22:09:42 juju-e4d256-prod-github-runner-207 kernel: [60356.593633] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:09:42 juju-e4d256-prod-github-runner-207 kernel: [60356.594685] direct_page_fault+0x206/0x310 [kvm] Aug 22 22:09:42 juju-e4d256-prod-github-runner-207 kernel: [60356.595714] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 22:09:42 juju-e4d256-prod-github-runner-207 kernel: [60356.596722] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 22:09:42 juju-e4d256-prod-github-runner-207 kernel: [60356.597744] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 22:09:42 juju-e4d256-prod-github-runner-207 kernel: [60356.598716] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 22:09:42 juju-e4d256-prod-github-runner-207 kernel: [60356.599662] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 22:09:42 juju-e4d256-prod-github-runner-207 kernel: [60356.600641] handle_exit+0x98/0x230 [kvm_amd] Aug 22 22:09:42 juju-e4d256-prod-github-runner-207 kernel: [60356.601550] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 22:09:42 juju-e4d256-prod-github-runner-207 kernel: [60356.602464] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 22:09:42 juju-e4d256-prod-github-runner-207 kernel: [60356.603389] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 22:09:42 juju-e4d256-prod-github-runner-207 kernel: [60356.604305] vcpu_run+0x62/0x2c0 [kvm] Aug 22 22:09:42 juju-e4d256-prod-github-runner-207 kernel: [60356.605117] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 22:09:42 juju-e4d256-prod-github-runner-207 kernel: [60356.605945] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 22:09:42 juju-e4d256-prod-github-runner-207 kernel: [60356.606798] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 22:09:42 juju-e4d256-prod-github-runner-207 kernel: [60356.607600] ? __seccomp_filter+0x4a/0x4a0 Aug 22 22:09:42 juju-e4d256-prod-github-runner-207 kernel: [60356.608340] ? __fget_files+0x86/0xc0 Aug 22 22:09:42 juju-e4d256-prod-github-runner-207 kernel: [60356.609043] __x64_sys_ioctl+0x95/0xd0 Aug 22 22:09:42 juju-e4d256-prod-github-runner-207 kernel: [60356.609754] do_syscall_64+0x5c/0xc0 Aug 22 22:09:42 juju-e4d256-prod-github-runner-207 kernel: [60356.610423] ? do_futex+0x162/0x1f0 Aug 22 22:09:42 juju-e4d256-prod-github-runner-207 kernel: [60356.611070] ? __x64_sys_futex+0x78/0x1e0 Aug 22 22:09:42 juju-e4d256-prod-github-runner-207 kernel: [60356.611744] ? __secure_computing+0xa9/0x120 Aug 22 22:09:42 juju-e4d256-prod-github-runner-207 kernel: [60356.612431] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 22:09:42 juju-e4d256-prod-github-runner-207 kernel: [60356.613190] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:09:42 juju-e4d256-prod-github-runner-207 kernel: [60356.613920] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:09:42 juju-e4d256-prod-github-runner-207 kernel: [60356.614637] ? do_syscall_64+0x69/0xc0 Aug 22 22:09:42 juju-e4d256-prod-github-runner-207 kernel: [60356.615280] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:09:42 juju-e4d256-prod-github-runner-207 kernel: [60356.615985] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:09:42 juju-e4d256-prod-github-runner-207 kernel: [60356.616711] ? do_syscall_64+0x69/0xc0 Aug 22 22:09:42 juju-e4d256-prod-github-runner-207 kernel: [60356.617352] ? do_syscall_64+0x69/0xc0 Aug 22 22:09:42 juju-e4d256-prod-github-runner-207 kernel: [60356.617973] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 22:09:42 juju-e4d256-prod-github-runner-207 kernel: [60356.618676] RIP: 0033:0x7faa5d0edaff Aug 22 22:09:42 juju-e4d256-prod-github-runner-207 kernel: [60356.619305] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 22:09:42 juju-e4d256-prod-github-runner-207 kernel: [60356.621288] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 22:09:42 juju-e4d256-prod-github-runner-207 kernel: [60356.622214] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 22:09:42 juju-e4d256-prod-github-runner-207 kernel: [60356.623101] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 22:09:42 juju-e4d256-prod-github-runner-207 kernel: [60356.623999] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 22:09:42 juju-e4d256-prod-github-runner-207 kernel: [60356.624885] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 22:09:42 juju-e4d256-prod-github-runner-207 kernel: [60356.625787] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 22:09:42 juju-e4d256-prod-github-runner-207 kernel: [60356.626676] Aug 22 22:10:10 juju-e4d256-prod-github-runner-207 kernel: [60384.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 56129s! [qemu-system-x86:6715] Aug 22 22:10:10 juju-e4d256-prod-github-runner-207 kernel: [60384.543796] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 22:10:10 juju-e4d256-prod-github-runner-207 kernel: [60384.544061] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 22:10:10 juju-e4d256-prod-github-runner-207 kernel: [60384.556302] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 22:10:10 juju-e4d256-prod-github-runner-207 kernel: [60384.557576] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 22:10:10 juju-e4d256-prod-github-runner-207 kernel: [60384.558796] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:10:10 juju-e4d256-prod-github-runner-207 kernel: [60384.559852] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 22:10:10 juju-e4d256-prod-github-runner-207 kernel: [60384.562406] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 22:10:10 juju-e4d256-prod-github-runner-207 kernel: [60384.563448] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 22:10:10 juju-e4d256-prod-github-runner-207 kernel: [60384.564631] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 22:10:10 juju-e4d256-prod-github-runner-207 kernel: [60384.565806] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 22:10:10 juju-e4d256-prod-github-runner-207 kernel: [60384.566963] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 22:10:10 juju-e4d256-prod-github-runner-207 kernel: [60384.568121] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 22:10:10 juju-e4d256-prod-github-runner-207 kernel: [60384.569297] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 22:10:10 juju-e4d256-prod-github-runner-207 kernel: [60384.570544] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 22:10:10 juju-e4d256-prod-github-runner-207 kernel: [60384.571644] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 22:10:10 juju-e4d256-prod-github-runner-207 kernel: [60384.572835] Call Trace: Aug 22 22:10:10 juju-e4d256-prod-github-runner-207 kernel: [60384.573778] Aug 22 22:10:10 juju-e4d256-prod-github-runner-207 kernel: [60384.574675] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:10:10 juju-e4d256-prod-github-runner-207 kernel: [60384.575709] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:10:10 juju-e4d256-prod-github-runner-207 kernel: [60384.576729] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:10:10 juju-e4d256-prod-github-runner-207 kernel: [60384.577829] ? show_regs.part.0+0x23/0x29 Aug 22 22:10:10 juju-e4d256-prod-github-runner-207 kernel: [60384.578827] ? show_regs.cold+0x8/0xd Aug 22 22:10:10 juju-e4d256-prod-github-runner-207 kernel: [60384.579796] ? watchdog_timer_fn+0x1be/0x220 Aug 22 22:10:10 juju-e4d256-prod-github-runner-207 kernel: [60384.580815] ? lockup_detector_update_enable+0x60/0x60 Aug 22 22:10:10 juju-e4d256-prod-github-runner-207 kernel: [60384.581885] ? __hrtimer_run_queues+0x107/0x230 Aug 22 22:10:10 juju-e4d256-prod-github-runner-207 kernel: [60384.582911] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 22:10:10 juju-e4d256-prod-github-runner-207 kernel: [60384.583932] ? hrtimer_interrupt+0x101/0x220 Aug 22 22:10:10 juju-e4d256-prod-github-runner-207 kernel: [60384.584944] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 22:10:10 juju-e4d256-prod-github-runner-207 kernel: [60384.586026] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 22:10:10 juju-e4d256-prod-github-runner-207 kernel: [60384.587070] Aug 22 22:10:10 juju-e4d256-prod-github-runner-207 kernel: [60384.587925] Aug 22 22:10:10 juju-e4d256-prod-github-runner-207 kernel: [60384.588764] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 22:10:10 juju-e4d256-prod-github-runner-207 kernel: [60384.589804] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:10:10 juju-e4d256-prod-github-runner-207 kernel: [60384.590841] ? _raw_spin_lock+0x22/0x30 Aug 22 22:10:10 juju-e4d256-prod-github-runner-207 kernel: [60384.591783] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:10:10 juju-e4d256-prod-github-runner-207 kernel: [60384.592819] direct_page_fault+0x206/0x310 [kvm] Aug 22 22:10:10 juju-e4d256-prod-github-runner-207 kernel: [60384.593854] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 22:10:10 juju-e4d256-prod-github-runner-207 kernel: [60384.594859] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 22:10:10 juju-e4d256-prod-github-runner-207 kernel: [60384.595857] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 22:10:10 juju-e4d256-prod-github-runner-207 kernel: [60384.597045] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 22:10:10 juju-e4d256-prod-github-runner-207 kernel: [60384.598067] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 22:10:10 juju-e4d256-prod-github-runner-207 kernel: [60384.599068] handle_exit+0x98/0x230 [kvm_amd] Aug 22 22:10:10 juju-e4d256-prod-github-runner-207 kernel: [60384.599984] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 22:10:10 juju-e4d256-prod-github-runner-207 kernel: [60384.600904] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 22:10:10 juju-e4d256-prod-github-runner-207 kernel: [60384.601847] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 22:10:10 juju-e4d256-prod-github-runner-207 kernel: [60384.602805] vcpu_run+0x62/0x2c0 [kvm] Aug 22 22:10:10 juju-e4d256-prod-github-runner-207 kernel: [60384.603618] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 22:10:10 juju-e4d256-prod-github-runner-207 kernel: [60384.604428] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 22:10:10 juju-e4d256-prod-github-runner-207 kernel: [60384.605312] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 22:10:10 juju-e4d256-prod-github-runner-207 kernel: [60384.606116] ? __seccomp_filter+0x4a/0x4a0 Aug 22 22:10:10 juju-e4d256-prod-github-runner-207 kernel: [60384.606862] ? __fget_files+0x86/0xc0 Aug 22 22:10:10 juju-e4d256-prod-github-runner-207 kernel: [60384.607562] __x64_sys_ioctl+0x95/0xd0 Aug 22 22:10:10 juju-e4d256-prod-github-runner-207 kernel: [60384.608250] do_syscall_64+0x5c/0xc0 Aug 22 22:10:10 juju-e4d256-prod-github-runner-207 kernel: [60384.608911] ? do_futex+0x162/0x1f0 Aug 22 22:10:10 juju-e4d256-prod-github-runner-207 kernel: [60384.609596] ? __x64_sys_futex+0x78/0x1e0 Aug 22 22:10:10 juju-e4d256-prod-github-runner-207 kernel: [60384.610267] ? __secure_computing+0xa9/0x120 Aug 22 22:10:10 juju-e4d256-prod-github-runner-207 kernel: [60384.610955] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 22:10:10 juju-e4d256-prod-github-runner-207 kernel: [60384.611711] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:10:10 juju-e4d256-prod-github-runner-207 kernel: [60384.612428] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:10:10 juju-e4d256-prod-github-runner-207 kernel: [60384.613159] ? do_syscall_64+0x69/0xc0 Aug 22 22:10:10 juju-e4d256-prod-github-runner-207 kernel: [60384.613801] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:10:10 juju-e4d256-prod-github-runner-207 kernel: [60384.614518] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:10:10 juju-e4d256-prod-github-runner-207 kernel: [60384.615218] ? do_syscall_64+0x69/0xc0 Aug 22 22:10:10 juju-e4d256-prod-github-runner-207 kernel: [60384.615840] ? do_syscall_64+0x69/0xc0 Aug 22 22:10:10 juju-e4d256-prod-github-runner-207 kernel: [60384.616460] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 22:10:10 juju-e4d256-prod-github-runner-207 kernel: [60384.617187] RIP: 0033:0x7faa5d0edaff Aug 22 22:10:10 juju-e4d256-prod-github-runner-207 kernel: [60384.617839] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 22:10:10 juju-e4d256-prod-github-runner-207 kernel: [60384.619822] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 22:10:10 juju-e4d256-prod-github-runner-207 kernel: [60384.620729] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 22:10:10 juju-e4d256-prod-github-runner-207 kernel: [60384.621668] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 22:10:10 juju-e4d256-prod-github-runner-207 kernel: [60384.622557] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 22:10:10 juju-e4d256-prod-github-runner-207 kernel: [60384.623452] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 22:10:10 juju-e4d256-prod-github-runner-207 kernel: [60384.624343] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 22:10:10 juju-e4d256-prod-github-runner-207 kernel: [60384.625249] Aug 22 22:10:38 juju-e4d256-prod-github-runner-207 kernel: [60412.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 56155s! [qemu-system-x86:6715] Aug 22 22:10:38 juju-e4d256-prod-github-runner-207 kernel: [60412.543293] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 22:10:38 juju-e4d256-prod-github-runner-207 kernel: [60412.543367] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 22:10:38 juju-e4d256-prod-github-runner-207 kernel: [60412.555800] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 22:10:38 juju-e4d256-prod-github-runner-207 kernel: [60412.557171] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 22:10:38 juju-e4d256-prod-github-runner-207 kernel: [60412.558617] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:10:38 juju-e4d256-prod-github-runner-207 kernel: [60412.559858] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 22:10:38 juju-e4d256-prod-github-runner-207 kernel: [60412.562834] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 22:10:38 juju-e4d256-prod-github-runner-207 kernel: [60412.563923] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 22:10:38 juju-e4d256-prod-github-runner-207 kernel: [60412.565197] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 22:10:38 juju-e4d256-prod-github-runner-207 kernel: [60412.566419] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 22:10:38 juju-e4d256-prod-github-runner-207 kernel: [60412.567666] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 22:10:38 juju-e4d256-prod-github-runner-207 kernel: [60412.568884] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 22:10:38 juju-e4d256-prod-github-runner-207 kernel: [60412.570101] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 22:10:38 juju-e4d256-prod-github-runner-207 kernel: [60412.571341] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 22:10:38 juju-e4d256-prod-github-runner-207 kernel: [60412.572449] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 22:10:38 juju-e4d256-prod-github-runner-207 kernel: [60412.573692] Call Trace: Aug 22 22:10:38 juju-e4d256-prod-github-runner-207 kernel: [60412.574630] Aug 22 22:10:38 juju-e4d256-prod-github-runner-207 kernel: [60412.575533] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:10:38 juju-e4d256-prod-github-runner-207 kernel: [60412.576584] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:10:38 juju-e4d256-prod-github-runner-207 kernel: [60412.577659] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:10:38 juju-e4d256-prod-github-runner-207 kernel: [60412.578756] ? show_regs.part.0+0x23/0x29 Aug 22 22:10:38 juju-e4d256-prod-github-runner-207 kernel: [60412.579816] ? show_regs.cold+0x8/0xd Aug 22 22:10:38 juju-e4d256-prod-github-runner-207 kernel: [60412.580868] ? watchdog_timer_fn+0x1be/0x220 Aug 22 22:10:38 juju-e4d256-prod-github-runner-207 kernel: [60412.581902] ? lockup_detector_update_enable+0x60/0x60 Aug 22 22:10:38 juju-e4d256-prod-github-runner-207 kernel: [60412.583012] ? __hrtimer_run_queues+0x107/0x230 Aug 22 22:10:38 juju-e4d256-prod-github-runner-207 kernel: [60412.584100] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 22:10:38 juju-e4d256-prod-github-runner-207 kernel: [60412.585157] ? hrtimer_interrupt+0x101/0x220 Aug 22 22:10:38 juju-e4d256-prod-github-runner-207 kernel: [60412.586213] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 22:10:38 juju-e4d256-prod-github-runner-207 kernel: [60412.587301] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 22:10:38 juju-e4d256-prod-github-runner-207 kernel: [60412.588360] Aug 22 22:10:38 juju-e4d256-prod-github-runner-207 kernel: [60412.589286] Aug 22 22:10:38 juju-e4d256-prod-github-runner-207 kernel: [60412.590144] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 22:10:38 juju-e4d256-prod-github-runner-207 kernel: [60412.591214] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:10:38 juju-e4d256-prod-github-runner-207 kernel: [60412.592373] ? _raw_spin_lock+0x22/0x30 Aug 22 22:10:38 juju-e4d256-prod-github-runner-207 kernel: [60412.593371] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:10:38 juju-e4d256-prod-github-runner-207 kernel: [60412.594410] direct_page_fault+0x206/0x310 [kvm] Aug 22 22:10:38 juju-e4d256-prod-github-runner-207 kernel: [60412.595445] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 22:10:38 juju-e4d256-prod-github-runner-207 kernel: [60412.596484] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 22:10:38 juju-e4d256-prod-github-runner-207 kernel: [60412.597521] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 22:10:38 juju-e4d256-prod-github-runner-207 kernel: [60412.598553] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 22:10:38 juju-e4d256-prod-github-runner-207 kernel: [60412.599543] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 22:10:38 juju-e4d256-prod-github-runner-207 kernel: [60412.600539] handle_exit+0x98/0x230 [kvm_amd] Aug 22 22:10:38 juju-e4d256-prod-github-runner-207 kernel: [60412.601463] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 22:10:38 juju-e4d256-prod-github-runner-207 kernel: [60412.602383] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 22:10:38 juju-e4d256-prod-github-runner-207 kernel: [60412.603314] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 22:10:38 juju-e4d256-prod-github-runner-207 kernel: [60412.604222] vcpu_run+0x62/0x2c0 [kvm] Aug 22 22:10:38 juju-e4d256-prod-github-runner-207 kernel: [60412.605063] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 22:10:38 juju-e4d256-prod-github-runner-207 kernel: [60412.605873] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 22:10:38 juju-e4d256-prod-github-runner-207 kernel: [60412.606734] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 22:10:38 juju-e4d256-prod-github-runner-207 kernel: [60412.607533] ? __seccomp_filter+0x4a/0x4a0 Aug 22 22:10:38 juju-e4d256-prod-github-runner-207 kernel: [60412.608343] ? __fget_files+0x86/0xc0 Aug 22 22:10:38 juju-e4d256-prod-github-runner-207 kernel: [60412.609085] __x64_sys_ioctl+0x95/0xd0 Aug 22 22:10:38 juju-e4d256-prod-github-runner-207 kernel: [60412.609783] do_syscall_64+0x5c/0xc0 Aug 22 22:10:38 juju-e4d256-prod-github-runner-207 kernel: [60412.610449] ? do_futex+0x162/0x1f0 Aug 22 22:10:38 juju-e4d256-prod-github-runner-207 kernel: [60412.611097] ? __x64_sys_futex+0x78/0x1e0 Aug 22 22:10:38 juju-e4d256-prod-github-runner-207 kernel: [60412.611771] ? __secure_computing+0xa9/0x120 Aug 22 22:10:38 juju-e4d256-prod-github-runner-207 kernel: [60412.612483] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 22:10:38 juju-e4d256-prod-github-runner-207 kernel: [60412.613270] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:10:38 juju-e4d256-prod-github-runner-207 kernel: [60412.613994] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:10:38 juju-e4d256-prod-github-runner-207 kernel: [60412.614725] ? do_syscall_64+0x69/0xc0 Aug 22 22:10:38 juju-e4d256-prod-github-runner-207 kernel: [60412.615395] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:10:38 juju-e4d256-prod-github-runner-207 kernel: [60412.616119] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:10:38 juju-e4d256-prod-github-runner-207 kernel: [60412.616844] ? do_syscall_64+0x69/0xc0 Aug 22 22:10:38 juju-e4d256-prod-github-runner-207 kernel: [60412.617473] ? do_syscall_64+0x69/0xc0 Aug 22 22:10:38 juju-e4d256-prod-github-runner-207 kernel: [60412.618098] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 22:10:38 juju-e4d256-prod-github-runner-207 kernel: [60412.618822] RIP: 0033:0x7faa5d0edaff Aug 22 22:10:38 juju-e4d256-prod-github-runner-207 kernel: [60412.619451] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 22:10:38 juju-e4d256-prod-github-runner-207 kernel: [60412.621558] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 22:10:38 juju-e4d256-prod-github-runner-207 kernel: [60412.622555] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 22:10:38 juju-e4d256-prod-github-runner-207 kernel: [60412.623517] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 22:10:38 juju-e4d256-prod-github-runner-207 kernel: [60412.624417] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 22:10:38 juju-e4d256-prod-github-runner-207 kernel: [60412.625336] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 22:10:38 juju-e4d256-prod-github-runner-207 kernel: [60412.626251] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 22:10:38 juju-e4d256-prod-github-runner-207 kernel: [60412.627159] Aug 22 22:11:06 juju-e4d256-prod-github-runner-207 kernel: [60440.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 56181s! [qemu-system-x86:6715] Aug 22 22:11:06 juju-e4d256-prod-github-runner-207 kernel: [60440.543085] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 22:11:06 juju-e4d256-prod-github-runner-207 kernel: [60440.543157] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 22:11:06 juju-e4d256-prod-github-runner-207 kernel: [60440.555238] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 22:11:06 juju-e4d256-prod-github-runner-207 kernel: [60440.556536] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 22:11:06 juju-e4d256-prod-github-runner-207 kernel: [60440.557765] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:11:06 juju-e4d256-prod-github-runner-207 kernel: [60440.558824] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 22:11:06 juju-e4d256-prod-github-runner-207 kernel: [60440.561384] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 22:11:06 juju-e4d256-prod-github-runner-207 kernel: [60440.562427] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 22:11:06 juju-e4d256-prod-github-runner-207 kernel: [60440.563589] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 22:11:06 juju-e4d256-prod-github-runner-207 kernel: [60440.564766] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 22:11:06 juju-e4d256-prod-github-runner-207 kernel: [60440.565924] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 22:11:06 juju-e4d256-prod-github-runner-207 kernel: [60440.567125] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 22:11:06 juju-e4d256-prod-github-runner-207 kernel: [60440.568318] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 22:11:06 juju-e4d256-prod-github-runner-207 kernel: [60440.569552] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 22:11:06 juju-e4d256-prod-github-runner-207 kernel: [60440.570665] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 22:11:06 juju-e4d256-prod-github-runner-207 kernel: [60440.571863] Call Trace: Aug 22 22:11:06 juju-e4d256-prod-github-runner-207 kernel: [60440.572792] Aug 22 22:11:06 juju-e4d256-prod-github-runner-207 kernel: [60440.573679] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:11:06 juju-e4d256-prod-github-runner-207 kernel: [60440.574712] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:11:06 juju-e4d256-prod-github-runner-207 kernel: [60440.575735] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:11:06 juju-e4d256-prod-github-runner-207 kernel: [60440.576827] ? show_regs.part.0+0x23/0x29 Aug 22 22:11:06 juju-e4d256-prod-github-runner-207 kernel: [60440.577823] ? show_regs.cold+0x8/0xd Aug 22 22:11:06 juju-e4d256-prod-github-runner-207 kernel: [60440.578831] ? watchdog_timer_fn+0x1be/0x220 Aug 22 22:11:06 juju-e4d256-prod-github-runner-207 kernel: [60440.579843] ? lockup_detector_update_enable+0x60/0x60 Aug 22 22:11:06 juju-e4d256-prod-github-runner-207 kernel: [60440.580942] ? __hrtimer_run_queues+0x107/0x230 Aug 22 22:11:06 juju-e4d256-prod-github-runner-207 kernel: [60440.581969] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 22:11:06 juju-e4d256-prod-github-runner-207 kernel: [60440.583009] ? hrtimer_interrupt+0x101/0x220 Aug 22 22:11:06 juju-e4d256-prod-github-runner-207 kernel: [60440.584023] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 22:11:06 juju-e4d256-prod-github-runner-207 kernel: [60440.585099] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 22:11:06 juju-e4d256-prod-github-runner-207 kernel: [60440.586185] Aug 22 22:11:06 juju-e4d256-prod-github-runner-207 kernel: [60440.587056] Aug 22 22:11:06 juju-e4d256-prod-github-runner-207 kernel: [60440.587920] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 22:11:06 juju-e4d256-prod-github-runner-207 kernel: [60440.589054] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:11:06 juju-e4d256-prod-github-runner-207 kernel: [60440.590130] ? _raw_spin_lock+0x22/0x30 Aug 22 22:11:06 juju-e4d256-prod-github-runner-207 kernel: [60440.591110] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:11:06 juju-e4d256-prod-github-runner-207 kernel: [60440.592166] direct_page_fault+0x206/0x310 [kvm] Aug 22 22:11:06 juju-e4d256-prod-github-runner-207 kernel: [60440.593210] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 22:11:06 juju-e4d256-prod-github-runner-207 kernel: [60440.594224] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 22:11:06 juju-e4d256-prod-github-runner-207 kernel: [60440.595226] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 22:11:06 juju-e4d256-prod-github-runner-207 kernel: [60440.596204] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 22:11:06 juju-e4d256-prod-github-runner-207 kernel: [60440.597181] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 22:11:06 juju-e4d256-prod-github-runner-207 kernel: [60440.598158] handle_exit+0x98/0x230 [kvm_amd] Aug 22 22:11:06 juju-e4d256-prod-github-runner-207 kernel: [60440.599053] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 22:11:06 juju-e4d256-prod-github-runner-207 kernel: [60440.599983] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 22:11:06 juju-e4d256-prod-github-runner-207 kernel: [60440.600923] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 22:11:06 juju-e4d256-prod-github-runner-207 kernel: [60440.601829] vcpu_run+0x62/0x2c0 [kvm] Aug 22 22:11:06 juju-e4d256-prod-github-runner-207 kernel: [60440.602639] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 22:11:06 juju-e4d256-prod-github-runner-207 kernel: [60440.603510] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 22:11:06 juju-e4d256-prod-github-runner-207 kernel: [60440.604404] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 22:11:06 juju-e4d256-prod-github-runner-207 kernel: [60440.605253] ? __seccomp_filter+0x4a/0x4a0 Aug 22 22:11:06 juju-e4d256-prod-github-runner-207 kernel: [60440.606028] ? __fget_files+0x86/0xc0 Aug 22 22:11:06 juju-e4d256-prod-github-runner-207 kernel: [60440.606736] __x64_sys_ioctl+0x95/0xd0 Aug 22 22:11:06 juju-e4d256-prod-github-runner-207 kernel: [60440.607477] do_syscall_64+0x5c/0xc0 Aug 22 22:11:06 juju-e4d256-prod-github-runner-207 kernel: [60440.608172] ? do_futex+0x162/0x1f0 Aug 22 22:11:06 juju-e4d256-prod-github-runner-207 kernel: [60440.608856] ? __x64_sys_futex+0x78/0x1e0 Aug 22 22:11:06 juju-e4d256-prod-github-runner-207 kernel: [60440.609553] ? __secure_computing+0xa9/0x120 Aug 22 22:11:06 juju-e4d256-prod-github-runner-207 kernel: [60440.610273] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 22:11:06 juju-e4d256-prod-github-runner-207 kernel: [60440.611080] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:11:06 juju-e4d256-prod-github-runner-207 kernel: [60440.611837] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:11:06 juju-e4d256-prod-github-runner-207 kernel: [60440.612566] ? do_syscall_64+0x69/0xc0 Aug 22 22:11:06 juju-e4d256-prod-github-runner-207 kernel: [60440.613260] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:11:06 juju-e4d256-prod-github-runner-207 kernel: [60440.613995] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:11:06 juju-e4d256-prod-github-runner-207 kernel: [60440.614688] ? do_syscall_64+0x69/0xc0 Aug 22 22:11:06 juju-e4d256-prod-github-runner-207 kernel: [60440.615310] ? do_syscall_64+0x69/0xc0 Aug 22 22:11:06 juju-e4d256-prod-github-runner-207 kernel: [60440.615981] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 22:11:06 juju-e4d256-prod-github-runner-207 kernel: [60440.616714] RIP: 0033:0x7faa5d0edaff Aug 22 22:11:06 juju-e4d256-prod-github-runner-207 kernel: [60440.617353] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 22:11:06 juju-e4d256-prod-github-runner-207 kernel: [60440.619409] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 22:11:06 juju-e4d256-prod-github-runner-207 kernel: [60440.620406] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 22:11:06 juju-e4d256-prod-github-runner-207 kernel: [60440.621367] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 22:11:06 juju-e4d256-prod-github-runner-207 kernel: [60440.622293] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 22:11:06 juju-e4d256-prod-github-runner-207 kernel: [60440.623231] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 22:11:06 juju-e4d256-prod-github-runner-207 kernel: [60440.624140] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 22:11:06 juju-e4d256-prod-github-runner-207 kernel: [60440.625049] Aug 22 22:11:34 juju-e4d256-prod-github-runner-207 kernel: [60468.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 56207s! [qemu-system-x86:6715] Aug 22 22:11:34 juju-e4d256-prod-github-runner-207 kernel: [60468.543876] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 22:11:34 juju-e4d256-prod-github-runner-207 kernel: [60468.544202] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 22:11:34 juju-e4d256-prod-github-runner-207 kernel: [60468.556735] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 22:11:34 juju-e4d256-prod-github-runner-207 kernel: [60468.558030] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 22:11:34 juju-e4d256-prod-github-runner-207 kernel: [60468.559274] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:11:34 juju-e4d256-prod-github-runner-207 kernel: [60468.560352] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 22:11:34 juju-e4d256-prod-github-runner-207 kernel: [60468.562957] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 22:11:34 juju-e4d256-prod-github-runner-207 kernel: [60468.564032] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 22:11:34 juju-e4d256-prod-github-runner-207 kernel: [60468.565210] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 22:11:34 juju-e4d256-prod-github-runner-207 kernel: [60468.566418] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 22:11:34 juju-e4d256-prod-github-runner-207 kernel: [60468.567617] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 22:11:34 juju-e4d256-prod-github-runner-207 kernel: [60468.568811] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 22:11:34 juju-e4d256-prod-github-runner-207 kernel: [60468.570201] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 22:11:34 juju-e4d256-prod-github-runner-207 kernel: [60468.571444] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 22:11:34 juju-e4d256-prod-github-runner-207 kernel: [60468.572559] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 22:11:34 juju-e4d256-prod-github-runner-207 kernel: [60468.573767] Call Trace: Aug 22 22:11:34 juju-e4d256-prod-github-runner-207 kernel: [60468.574716] Aug 22 22:11:34 juju-e4d256-prod-github-runner-207 kernel: [60468.575625] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:11:34 juju-e4d256-prod-github-runner-207 kernel: [60468.576841] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:11:34 juju-e4d256-prod-github-runner-207 kernel: [60468.577872] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:11:34 juju-e4d256-prod-github-runner-207 kernel: [60468.579032] ? show_regs.part.0+0x23/0x29 Aug 22 22:11:34 juju-e4d256-prod-github-runner-207 kernel: [60468.580067] ? show_regs.cold+0x8/0xd Aug 22 22:11:34 juju-e4d256-prod-github-runner-207 kernel: [60468.581048] ? watchdog_timer_fn+0x1be/0x220 Aug 22 22:11:34 juju-e4d256-prod-github-runner-207 kernel: [60468.582075] ? lockup_detector_update_enable+0x60/0x60 Aug 22 22:11:34 juju-e4d256-prod-github-runner-207 kernel: [60468.583156] ? __hrtimer_run_queues+0x107/0x230 Aug 22 22:11:34 juju-e4d256-prod-github-runner-207 kernel: [60468.584219] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 22:11:34 juju-e4d256-prod-github-runner-207 kernel: [60468.585251] ? hrtimer_interrupt+0x101/0x220 Aug 22 22:11:34 juju-e4d256-prod-github-runner-207 kernel: [60468.586305] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 22:11:34 juju-e4d256-prod-github-runner-207 kernel: [60468.587389] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 22:11:34 juju-e4d256-prod-github-runner-207 kernel: [60468.588470] Aug 22 22:11:34 juju-e4d256-prod-github-runner-207 kernel: [60468.589331] Aug 22 22:11:34 juju-e4d256-prod-github-runner-207 kernel: [60468.590174] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 22:11:34 juju-e4d256-prod-github-runner-207 kernel: [60468.591223] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:11:34 juju-e4d256-prod-github-runner-207 kernel: [60468.592291] ? _raw_spin_lock+0x22/0x30 Aug 22 22:11:34 juju-e4d256-prod-github-runner-207 kernel: [60468.593251] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:11:34 juju-e4d256-prod-github-runner-207 kernel: [60468.594301] direct_page_fault+0x206/0x310 [kvm] Aug 22 22:11:34 juju-e4d256-prod-github-runner-207 kernel: [60468.595377] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 22:11:34 juju-e4d256-prod-github-runner-207 kernel: [60468.596411] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 22:11:34 juju-e4d256-prod-github-runner-207 kernel: [60468.597421] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 22:11:34 juju-e4d256-prod-github-runner-207 kernel: [60468.598446] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 22:11:34 juju-e4d256-prod-github-runner-207 kernel: [60468.599403] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 22:11:34 juju-e4d256-prod-github-runner-207 kernel: [60468.600405] handle_exit+0x98/0x230 [kvm_amd] Aug 22 22:11:34 juju-e4d256-prod-github-runner-207 kernel: [60468.601315] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 22:11:34 juju-e4d256-prod-github-runner-207 kernel: [60468.602238] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 22:11:34 juju-e4d256-prod-github-runner-207 kernel: [60468.603176] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 22:11:34 juju-e4d256-prod-github-runner-207 kernel: [60468.604100] vcpu_run+0x62/0x2c0 [kvm] Aug 22 22:11:34 juju-e4d256-prod-github-runner-207 kernel: [60468.604923] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 22:11:34 juju-e4d256-prod-github-runner-207 kernel: [60468.605743] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 22:11:34 juju-e4d256-prod-github-runner-207 kernel: [60468.606645] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 22:11:34 juju-e4d256-prod-github-runner-207 kernel: [60468.607454] ? __seccomp_filter+0x4a/0x4a0 Aug 22 22:11:34 juju-e4d256-prod-github-runner-207 kernel: [60468.608231] ? __fget_files+0x86/0xc0 Aug 22 22:11:34 juju-e4d256-prod-github-runner-207 kernel: [60468.608946] __x64_sys_ioctl+0x95/0xd0 Aug 22 22:11:34 juju-e4d256-prod-github-runner-207 kernel: [60468.609646] do_syscall_64+0x5c/0xc0 Aug 22 22:11:34 juju-e4d256-prod-github-runner-207 kernel: [60468.610328] ? do_futex+0x162/0x1f0 Aug 22 22:11:34 juju-e4d256-prod-github-runner-207 kernel: [60468.610989] ? __x64_sys_futex+0x78/0x1e0 Aug 22 22:11:34 juju-e4d256-prod-github-runner-207 kernel: [60468.611753] ? __secure_computing+0xa9/0x120 Aug 22 22:11:34 juju-e4d256-prod-github-runner-207 kernel: [60468.612603] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 22:11:34 juju-e4d256-prod-github-runner-207 kernel: [60468.613403] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:11:34 juju-e4d256-prod-github-runner-207 kernel: [60468.614133] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:11:34 juju-e4d256-prod-github-runner-207 kernel: [60468.614850] ? do_syscall_64+0x69/0xc0 Aug 22 22:11:34 juju-e4d256-prod-github-runner-207 kernel: [60468.615494] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:11:34 juju-e4d256-prod-github-runner-207 kernel: [60468.616241] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:11:34 juju-e4d256-prod-github-runner-207 kernel: [60468.616951] ? do_syscall_64+0x69/0xc0 Aug 22 22:11:34 juju-e4d256-prod-github-runner-207 kernel: [60468.617582] ? do_syscall_64+0x69/0xc0 Aug 22 22:11:34 juju-e4d256-prod-github-runner-207 kernel: [60468.618205] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 22:11:34 juju-e4d256-prod-github-runner-207 kernel: [60468.618910] RIP: 0033:0x7faa5d0edaff Aug 22 22:11:34 juju-e4d256-prod-github-runner-207 kernel: [60468.619583] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 22:11:34 juju-e4d256-prod-github-runner-207 kernel: [60468.621620] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 22:11:34 juju-e4d256-prod-github-runner-207 kernel: [60468.622535] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 22:11:34 juju-e4d256-prod-github-runner-207 kernel: [60468.623647] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 22:11:34 juju-e4d256-prod-github-runner-207 kernel: [60468.624702] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 22:11:34 juju-e4d256-prod-github-runner-207 kernel: [60468.625722] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 22:11:34 juju-e4d256-prod-github-runner-207 kernel: [60468.626630] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 22:11:34 juju-e4d256-prod-github-runner-207 kernel: [60468.627519] Aug 22 22:11:47 juju-e4d256-prod-github-runner-207 kernel: [60481.220711] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 22:11:47 juju-e4d256-prod-github-runner-207 kernel: [60481.221677] rcu: 1-....: (15043488 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=7267931 Aug 22 22:11:47 juju-e4d256-prod-github-runner-207 kernel: [60481.222851] (t=15091005 jiffies g=23269 q=54213) Aug 22 22:11:47 juju-e4d256-prod-github-runner-207 kernel: [60481.223770] NMI backtrace for cpu 1 Aug 22 22:11:47 juju-e4d256-prod-github-runner-207 kernel: [60481.224601] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 22:11:47 juju-e4d256-prod-github-runner-207 kernel: [60481.225783] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 22:11:47 juju-e4d256-prod-github-runner-207 kernel: [60481.226864] Call Trace: Aug 22 22:11:47 juju-e4d256-prod-github-runner-207 kernel: [60481.227539] Aug 22 22:11:47 juju-e4d256-prod-github-runner-207 kernel: [60481.228209] show_stack+0x52/0x5c Aug 22 22:11:47 juju-e4d256-prod-github-runner-207 kernel: [60481.228963] dump_stack_lvl+0x4a/0x63 Aug 22 22:11:47 juju-e4d256-prod-github-runner-207 kernel: [60481.229739] dump_stack+0x10/0x16 Aug 22 22:11:47 juju-e4d256-prod-github-runner-207 kernel: [60481.230471] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 22:11:47 juju-e4d256-prod-github-runner-207 kernel: [60481.231286] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 22:11:47 juju-e4d256-prod-github-runner-207 kernel: [60481.232094] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 22:11:47 juju-e4d256-prod-github-runner-207 kernel: [60481.232913] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 22:11:47 juju-e4d256-prod-github-runner-207 kernel: [60481.233728] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 22:11:47 juju-e4d256-prod-github-runner-207 kernel: [60481.234538] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 22:11:47 juju-e4d256-prod-github-runner-207 kernel: [60481.235316] print_cpu_stall.cold+0x2f/0xe2 Aug 22 22:11:47 juju-e4d256-prod-github-runner-207 kernel: [60481.236104] ? timekeeping_update+0xf7/0x150 Aug 22 22:11:47 juju-e4d256-prod-github-runner-207 kernel: [60481.236871] check_cpu_stall+0x109/0x270 Aug 22 22:11:47 juju-e4d256-prod-github-runner-207 kernel: [60481.237636] rcu_sched_clock_irq+0x9a/0x250 Aug 22 22:11:47 juju-e4d256-prod-github-runner-207 kernel: [60481.238396] update_process_times+0x94/0xd0 Aug 22 22:11:47 juju-e4d256-prod-github-runner-207 kernel: [60481.239160] tick_sched_handle+0x29/0x70 Aug 22 22:11:47 juju-e4d256-prod-github-runner-207 kernel: [60481.239929] tick_sched_timer+0x8c/0xc0 Aug 22 22:11:47 juju-e4d256-prod-github-runner-207 kernel: [60481.240665] ? tick_nohz_handler+0xb0/0xb0 Aug 22 22:11:47 juju-e4d256-prod-github-runner-207 kernel: [60481.241479] __hrtimer_run_queues+0x107/0x230 Aug 22 22:11:47 juju-e4d256-prod-github-runner-207 kernel: [60481.242297] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 22:11:47 juju-e4d256-prod-github-runner-207 kernel: [60481.243226] hrtimer_interrupt+0x101/0x220 Aug 22 22:11:47 juju-e4d256-prod-github-runner-207 kernel: [60481.244082] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 22:11:47 juju-e4d256-prod-github-runner-207 kernel: [60481.244901] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 22:11:47 juju-e4d256-prod-github-runner-207 kernel: [60481.245713] Aug 22 22:11:47 juju-e4d256-prod-github-runner-207 kernel: [60481.246347] Aug 22 22:11:47 juju-e4d256-prod-github-runner-207 kernel: [60481.246981] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 22:11:47 juju-e4d256-prod-github-runner-207 kernel: [60481.247818] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:11:47 juju-e4d256-prod-github-runner-207 kernel: [60481.248696] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 22:11:47 juju-e4d256-prod-github-runner-207 kernel: [60481.250903] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 22:11:47 juju-e4d256-prod-github-runner-207 kernel: [60481.251824] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 22:11:47 juju-e4d256-prod-github-runner-207 kernel: [60481.252840] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 22:11:47 juju-e4d256-prod-github-runner-207 kernel: [60481.253845] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 22:11:47 juju-e4d256-prod-github-runner-207 kernel: [60481.254812] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 22:11:47 juju-e4d256-prod-github-runner-207 kernel: [60481.255766] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 22:11:47 juju-e4d256-prod-github-runner-207 kernel: [60481.256736] ? _raw_spin_lock+0x22/0x30 Aug 22 22:11:47 juju-e4d256-prod-github-runner-207 kernel: [60481.257492] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:11:47 juju-e4d256-prod-github-runner-207 kernel: [60481.258329] direct_page_fault+0x206/0x310 [kvm] Aug 22 22:11:47 juju-e4d256-prod-github-runner-207 kernel: [60481.259164] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 22:11:47 juju-e4d256-prod-github-runner-207 kernel: [60481.260063] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 22:11:47 juju-e4d256-prod-github-runner-207 kernel: [60481.260922] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 22:11:47 juju-e4d256-prod-github-runner-207 kernel: [60481.261753] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 22:11:47 juju-e4d256-prod-github-runner-207 kernel: [60481.262540] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 22:11:47 juju-e4d256-prod-github-runner-207 kernel: [60481.263365] handle_exit+0x98/0x230 [kvm_amd] Aug 22 22:11:47 juju-e4d256-prod-github-runner-207 kernel: [60481.264151] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 22:11:47 juju-e4d256-prod-github-runner-207 kernel: [60481.264933] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 22:11:47 juju-e4d256-prod-github-runner-207 kernel: [60481.265729] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 22:11:47 juju-e4d256-prod-github-runner-207 kernel: [60481.266513] vcpu_run+0x62/0x2c0 [kvm] Aug 22 22:11:47 juju-e4d256-prod-github-runner-207 kernel: [60481.267232] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 22:11:47 juju-e4d256-prod-github-runner-207 kernel: [60481.267975] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 22:11:47 juju-e4d256-prod-github-runner-207 kernel: [60481.268776] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 22:11:47 juju-e4d256-prod-github-runner-207 kernel: [60481.269538] ? __seccomp_filter+0x4a/0x4a0 Aug 22 22:11:47 juju-e4d256-prod-github-runner-207 kernel: [60481.270265] ? __fget_files+0x86/0xc0 Aug 22 22:11:47 juju-e4d256-prod-github-runner-207 kernel: [60481.270956] __x64_sys_ioctl+0x95/0xd0 Aug 22 22:11:47 juju-e4d256-prod-github-runner-207 kernel: [60481.271656] do_syscall_64+0x5c/0xc0 Aug 22 22:11:47 juju-e4d256-prod-github-runner-207 kernel: [60481.272349] ? do_futex+0x162/0x1f0 Aug 22 22:11:47 juju-e4d256-prod-github-runner-207 kernel: [60481.273019] ? __x64_sys_futex+0x78/0x1e0 Aug 22 22:11:47 juju-e4d256-prod-github-runner-207 kernel: [60481.273728] ? __secure_computing+0xa9/0x120 Aug 22 22:11:47 juju-e4d256-prod-github-runner-207 kernel: [60481.274442] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 22:11:47 juju-e4d256-prod-github-runner-207 kernel: [60481.275229] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:11:47 juju-e4d256-prod-github-runner-207 kernel: [60481.275996] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:11:47 juju-e4d256-prod-github-runner-207 kernel: [60481.276754] ? do_syscall_64+0x69/0xc0 Aug 22 22:11:47 juju-e4d256-prod-github-runner-207 kernel: [60481.277442] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:11:47 juju-e4d256-prod-github-runner-207 kernel: [60481.278207] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:11:47 juju-e4d256-prod-github-runner-207 kernel: [60481.278970] ? do_syscall_64+0x69/0xc0 Aug 22 22:11:47 juju-e4d256-prod-github-runner-207 kernel: [60481.279667] ? do_syscall_64+0x69/0xc0 Aug 22 22:11:47 juju-e4d256-prod-github-runner-207 kernel: [60481.280371] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 22:11:47 juju-e4d256-prod-github-runner-207 kernel: [60481.281142] RIP: 0033:0x7faa5d0edaff Aug 22 22:11:47 juju-e4d256-prod-github-runner-207 kernel: [60481.281823] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 22:11:47 juju-e4d256-prod-github-runner-207 kernel: [60481.283942] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 22:11:47 juju-e4d256-prod-github-runner-207 kernel: [60481.284905] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 22:11:47 juju-e4d256-prod-github-runner-207 kernel: [60481.285849] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 22:11:47 juju-e4d256-prod-github-runner-207 kernel: [60481.286795] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 22:11:47 juju-e4d256-prod-github-runner-207 kernel: [60481.287732] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 22:11:47 juju-e4d256-prod-github-runner-207 kernel: [60481.288667] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 22:11:47 juju-e4d256-prod-github-runner-207 kernel: [60481.289584] Aug 22 22:12:14 juju-e4d256-prod-github-runner-207 kernel: [60508.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 56244s! [qemu-system-x86:6715] Aug 22 22:12:14 juju-e4d256-prod-github-runner-207 kernel: [60508.543155] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 22:12:14 juju-e4d256-prod-github-runner-207 kernel: [60508.543227] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 22:12:14 juju-e4d256-prod-github-runner-207 kernel: [60508.555553] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 22:12:14 juju-e4d256-prod-github-runner-207 kernel: [60508.556855] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 22:12:14 juju-e4d256-prod-github-runner-207 kernel: [60508.558363] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:12:14 juju-e4d256-prod-github-runner-207 kernel: [60508.559452] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 22:12:14 juju-e4d256-prod-github-runner-207 kernel: [60508.562235] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 22:12:14 juju-e4d256-prod-github-runner-207 kernel: [60508.563313] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 22:12:14 juju-e4d256-prod-github-runner-207 kernel: [60508.564559] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 22:12:14 juju-e4d256-prod-github-runner-207 kernel: [60508.565856] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 22:12:14 juju-e4d256-prod-github-runner-207 kernel: [60508.567046] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 22:12:14 juju-e4d256-prod-github-runner-207 kernel: [60508.568326] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 22:12:14 juju-e4d256-prod-github-runner-207 kernel: [60508.569542] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 22:12:14 juju-e4d256-prod-github-runner-207 kernel: [60508.570800] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 22:12:14 juju-e4d256-prod-github-runner-207 kernel: [60508.572086] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 22:12:14 juju-e4d256-prod-github-runner-207 kernel: [60508.573434] Call Trace: Aug 22 22:12:14 juju-e4d256-prod-github-runner-207 kernel: [60508.574412] Aug 22 22:12:14 juju-e4d256-prod-github-runner-207 kernel: [60508.575491] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:12:14 juju-e4d256-prod-github-runner-207 kernel: [60508.576675] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:12:14 juju-e4d256-prod-github-runner-207 kernel: [60508.577813] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:12:14 juju-e4d256-prod-github-runner-207 kernel: [60508.578997] ? show_regs.part.0+0x23/0x29 Aug 22 22:12:14 juju-e4d256-prod-github-runner-207 kernel: [60508.580155] ? show_regs.cold+0x8/0xd Aug 22 22:12:14 juju-e4d256-prod-github-runner-207 kernel: [60508.581481] ? watchdog_timer_fn+0x1be/0x220 Aug 22 22:12:14 juju-e4d256-prod-github-runner-207 kernel: [60508.582625] ? lockup_detector_update_enable+0x60/0x60 Aug 22 22:12:14 juju-e4d256-prod-github-runner-207 kernel: [60508.583848] ? __hrtimer_run_queues+0x107/0x230 Aug 22 22:12:14 juju-e4d256-prod-github-runner-207 kernel: [60508.585185] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 22:12:14 juju-e4d256-prod-github-runner-207 kernel: [60508.586241] ? hrtimer_interrupt+0x101/0x220 Aug 22 22:12:14 juju-e4d256-prod-github-runner-207 kernel: [60508.587293] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 22:12:14 juju-e4d256-prod-github-runner-207 kernel: [60508.588521] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 22:12:14 juju-e4d256-prod-github-runner-207 kernel: [60508.589588] Aug 22 22:12:14 juju-e4d256-prod-github-runner-207 kernel: [60508.590449] Aug 22 22:12:14 juju-e4d256-prod-github-runner-207 kernel: [60508.591307] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 22:12:14 juju-e4d256-prod-github-runner-207 kernel: [60508.592413] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:12:14 juju-e4d256-prod-github-runner-207 kernel: [60508.593466] ? _raw_spin_lock+0x22/0x30 Aug 22 22:12:14 juju-e4d256-prod-github-runner-207 kernel: [60508.594415] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:12:14 juju-e4d256-prod-github-runner-207 kernel: [60508.595452] direct_page_fault+0x206/0x310 [kvm] Aug 22 22:12:14 juju-e4d256-prod-github-runner-207 kernel: [60508.596508] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 22:12:14 juju-e4d256-prod-github-runner-207 kernel: [60508.597522] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 22:12:14 juju-e4d256-prod-github-runner-207 kernel: [60508.598521] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 22:12:14 juju-e4d256-prod-github-runner-207 kernel: [60508.599512] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 22:12:14 juju-e4d256-prod-github-runner-207 kernel: [60508.600455] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 22:12:14 juju-e4d256-prod-github-runner-207 kernel: [60508.601434] handle_exit+0x98/0x230 [kvm_amd] Aug 22 22:12:14 juju-e4d256-prod-github-runner-207 kernel: [60508.602326] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 22:12:14 juju-e4d256-prod-github-runner-207 kernel: [60508.603246] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 22:12:14 juju-e4d256-prod-github-runner-207 kernel: [60508.604188] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 22:12:14 juju-e4d256-prod-github-runner-207 kernel: [60508.605093] vcpu_run+0x62/0x2c0 [kvm] Aug 22 22:12:14 juju-e4d256-prod-github-runner-207 kernel: [60508.605915] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 22:12:14 juju-e4d256-prod-github-runner-207 kernel: [60508.606723] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 22:12:14 juju-e4d256-prod-github-runner-207 kernel: [60508.607588] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 22:12:14 juju-e4d256-prod-github-runner-207 kernel: [60508.608386] ? __seccomp_filter+0x4a/0x4a0 Aug 22 22:12:14 juju-e4d256-prod-github-runner-207 kernel: [60508.609130] ? __fget_files+0x86/0xc0 Aug 22 22:12:14 juju-e4d256-prod-github-runner-207 kernel: [60508.609859] __x64_sys_ioctl+0x95/0xd0 Aug 22 22:12:14 juju-e4d256-prod-github-runner-207 kernel: [60508.610573] do_syscall_64+0x5c/0xc0 Aug 22 22:12:14 juju-e4d256-prod-github-runner-207 kernel: [60508.611242] ? do_futex+0x162/0x1f0 Aug 22 22:12:14 juju-e4d256-prod-github-runner-207 kernel: [60508.611921] ? __x64_sys_futex+0x78/0x1e0 Aug 22 22:12:14 juju-e4d256-prod-github-runner-207 kernel: [60508.612608] ? __secure_computing+0xa9/0x120 Aug 22 22:12:14 juju-e4d256-prod-github-runner-207 kernel: [60508.613432] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 22:12:14 juju-e4d256-prod-github-runner-207 kernel: [60508.614312] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:12:14 juju-e4d256-prod-github-runner-207 kernel: [60508.615131] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:12:14 juju-e4d256-prod-github-runner-207 kernel: [60508.616000] ? do_syscall_64+0x69/0xc0 Aug 22 22:12:14 juju-e4d256-prod-github-runner-207 kernel: [60508.616734] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:12:14 juju-e4d256-prod-github-runner-207 kernel: [60508.617540] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:12:14 juju-e4d256-prod-github-runner-207 kernel: [60508.618335] ? do_syscall_64+0x69/0xc0 Aug 22 22:12:14 juju-e4d256-prod-github-runner-207 kernel: [60508.619047] ? do_syscall_64+0x69/0xc0 Aug 22 22:12:14 juju-e4d256-prod-github-runner-207 kernel: [60508.619771] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 22:12:14 juju-e4d256-prod-github-runner-207 kernel: [60508.620586] RIP: 0033:0x7faa5d0edaff Aug 22 22:12:14 juju-e4d256-prod-github-runner-207 kernel: [60508.621292] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 22:12:14 juju-e4d256-prod-github-runner-207 kernel: [60508.623664] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 22:12:14 juju-e4d256-prod-github-runner-207 kernel: [60508.624735] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 22:12:14 juju-e4d256-prod-github-runner-207 kernel: [60508.625770] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 22:12:14 juju-e4d256-prod-github-runner-207 kernel: [60508.626798] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 22:12:14 juju-e4d256-prod-github-runner-207 kernel: [60508.627850] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 22:12:14 juju-e4d256-prod-github-runner-207 kernel: [60508.628889] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 22:12:14 juju-e4d256-prod-github-runner-207 kernel: [60508.629926] Aug 22 22:12:42 juju-e4d256-prod-github-runner-207 kernel: [60536.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 56271s! [qemu-system-x86:6715] Aug 22 22:12:42 juju-e4d256-prod-github-runner-207 kernel: [60536.543248] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 22:12:42 juju-e4d256-prod-github-runner-207 kernel: [60536.543550] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 22:12:42 juju-e4d256-prod-github-runner-207 kernel: [60536.555711] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 22:12:42 juju-e4d256-prod-github-runner-207 kernel: [60536.556987] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 22:12:42 juju-e4d256-prod-github-runner-207 kernel: [60536.558252] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:12:42 juju-e4d256-prod-github-runner-207 kernel: [60536.559359] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 22:12:42 juju-e4d256-prod-github-runner-207 kernel: [60536.562009] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 22:12:42 juju-e4d256-prod-github-runner-207 kernel: [60536.563102] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 22:12:42 juju-e4d256-prod-github-runner-207 kernel: [60536.564341] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 22:12:42 juju-e4d256-prod-github-runner-207 kernel: [60536.565714] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 22:12:42 juju-e4d256-prod-github-runner-207 kernel: [60536.567034] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 22:12:42 juju-e4d256-prod-github-runner-207 kernel: [60536.568251] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 22:12:42 juju-e4d256-prod-github-runner-207 kernel: [60536.569474] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 22:12:42 juju-e4d256-prod-github-runner-207 kernel: [60536.570713] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 22:12:42 juju-e4d256-prod-github-runner-207 kernel: [60536.571839] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 22:12:42 juju-e4d256-prod-github-runner-207 kernel: [60536.573115] Call Trace: Aug 22 22:12:42 juju-e4d256-prod-github-runner-207 kernel: [60536.574040] Aug 22 22:12:42 juju-e4d256-prod-github-runner-207 kernel: [60536.574966] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:12:42 juju-e4d256-prod-github-runner-207 kernel: [60536.576024] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:12:42 juju-e4d256-prod-github-runner-207 kernel: [60536.577050] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:12:42 juju-e4d256-prod-github-runner-207 kernel: [60536.578149] ? show_regs.part.0+0x23/0x29 Aug 22 22:12:42 juju-e4d256-prod-github-runner-207 kernel: [60536.579166] ? show_regs.cold+0x8/0xd Aug 22 22:12:42 juju-e4d256-prod-github-runner-207 kernel: [60536.580145] ? watchdog_timer_fn+0x1be/0x220 Aug 22 22:12:42 juju-e4d256-prod-github-runner-207 kernel: [60536.581159] ? lockup_detector_update_enable+0x60/0x60 Aug 22 22:12:42 juju-e4d256-prod-github-runner-207 kernel: [60536.582223] ? __hrtimer_run_queues+0x107/0x230 Aug 22 22:12:42 juju-e4d256-prod-github-runner-207 kernel: [60536.583280] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 22:12:42 juju-e4d256-prod-github-runner-207 kernel: [60536.584309] ? hrtimer_interrupt+0x101/0x220 Aug 22 22:12:42 juju-e4d256-prod-github-runner-207 kernel: [60536.585354] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 22:12:42 juju-e4d256-prod-github-runner-207 kernel: [60536.586433] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 22:12:42 juju-e4d256-prod-github-runner-207 kernel: [60536.587554] Aug 22 22:12:42 juju-e4d256-prod-github-runner-207 kernel: [60536.588416] Aug 22 22:12:42 juju-e4d256-prod-github-runner-207 kernel: [60536.589253] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 22:12:42 juju-e4d256-prod-github-runner-207 kernel: [60536.590291] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:12:42 juju-e4d256-prod-github-runner-207 kernel: [60536.591383] ? _raw_spin_lock+0x22/0x30 Aug 22 22:12:42 juju-e4d256-prod-github-runner-207 kernel: [60536.592347] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:12:42 juju-e4d256-prod-github-runner-207 kernel: [60536.593378] direct_page_fault+0x206/0x310 [kvm] Aug 22 22:12:42 juju-e4d256-prod-github-runner-207 kernel: [60536.594431] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 22:12:42 juju-e4d256-prod-github-runner-207 kernel: [60536.595514] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 22:12:42 juju-e4d256-prod-github-runner-207 kernel: [60536.596610] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 22:12:42 juju-e4d256-prod-github-runner-207 kernel: [60536.597677] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 22:12:42 juju-e4d256-prod-github-runner-207 kernel: [60536.598638] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 22:12:42 juju-e4d256-prod-github-runner-207 kernel: [60536.599693] handle_exit+0x98/0x230 [kvm_amd] Aug 22 22:12:42 juju-e4d256-prod-github-runner-207 kernel: [60536.600626] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 22:12:42 juju-e4d256-prod-github-runner-207 kernel: [60536.601569] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 22:12:42 juju-e4d256-prod-github-runner-207 kernel: [60536.602532] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 22:12:42 juju-e4d256-prod-github-runner-207 kernel: [60536.603490] vcpu_run+0x62/0x2c0 [kvm] Aug 22 22:12:42 juju-e4d256-prod-github-runner-207 kernel: [60536.604337] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 22:12:42 juju-e4d256-prod-github-runner-207 kernel: [60536.605152] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 22:12:42 juju-e4d256-prod-github-runner-207 kernel: [60536.606037] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 22:12:42 juju-e4d256-prod-github-runner-207 kernel: [60536.606856] ? __seccomp_filter+0x4a/0x4a0 Aug 22 22:12:42 juju-e4d256-prod-github-runner-207 kernel: [60536.607642] ? __fget_files+0x86/0xc0 Aug 22 22:12:42 juju-e4d256-prod-github-runner-207 kernel: [60536.608399] __x64_sys_ioctl+0x95/0xd0 Aug 22 22:12:42 juju-e4d256-prod-github-runner-207 kernel: [60536.609098] do_syscall_64+0x5c/0xc0 Aug 22 22:12:42 juju-e4d256-prod-github-runner-207 kernel: [60536.609771] ? do_futex+0x162/0x1f0 Aug 22 22:12:42 juju-e4d256-prod-github-runner-207 kernel: [60536.610464] ? __x64_sys_futex+0x78/0x1e0 Aug 22 22:12:42 juju-e4d256-prod-github-runner-207 kernel: [60536.611165] ? __secure_computing+0xa9/0x120 Aug 22 22:12:42 juju-e4d256-prod-github-runner-207 kernel: [60536.611866] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 22:12:42 juju-e4d256-prod-github-runner-207 kernel: [60536.612628] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:12:42 juju-e4d256-prod-github-runner-207 kernel: [60536.613406] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:12:42 juju-e4d256-prod-github-runner-207 kernel: [60536.614139] ? do_syscall_64+0x69/0xc0 Aug 22 22:12:42 juju-e4d256-prod-github-runner-207 kernel: [60536.614796] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:12:42 juju-e4d256-prod-github-runner-207 kernel: [60536.615537] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:12:42 juju-e4d256-prod-github-runner-207 kernel: [60536.616264] ? do_syscall_64+0x69/0xc0 Aug 22 22:12:42 juju-e4d256-prod-github-runner-207 kernel: [60536.616906] ? do_syscall_64+0x69/0xc0 Aug 22 22:12:42 juju-e4d256-prod-github-runner-207 kernel: [60536.617532] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 22:12:42 juju-e4d256-prod-github-runner-207 kernel: [60536.618247] RIP: 0033:0x7faa5d0edaff Aug 22 22:12:42 juju-e4d256-prod-github-runner-207 kernel: [60536.618958] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 22:12:42 juju-e4d256-prod-github-runner-207 kernel: [60536.621047] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 22:12:42 juju-e4d256-prod-github-runner-207 kernel: [60536.622028] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 22:12:42 juju-e4d256-prod-github-runner-207 kernel: [60536.622919] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 22:12:42 juju-e4d256-prod-github-runner-207 kernel: [60536.623834] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 22:12:42 juju-e4d256-prod-github-runner-207 kernel: [60536.624739] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 22:12:42 juju-e4d256-prod-github-runner-207 kernel: [60536.625652] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 22:12:42 juju-e4d256-prod-github-runner-207 kernel: [60536.626581] Aug 22 22:13:10 juju-e4d256-prod-github-runner-207 kernel: [60564.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 56297s! [qemu-system-x86:6715] Aug 22 22:13:10 juju-e4d256-prod-github-runner-207 kernel: [60564.546053] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 22:13:10 juju-e4d256-prod-github-runner-207 kernel: [60564.546758] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 22:13:10 juju-e4d256-prod-github-runner-207 kernel: [60564.579569] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 22:13:10 juju-e4d256-prod-github-runner-207 kernel: [60564.583390] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 22:13:10 juju-e4d256-prod-github-runner-207 kernel: [60564.587038] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:13:10 juju-e4d256-prod-github-runner-207 kernel: [60564.588139] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 22:13:10 juju-e4d256-prod-github-runner-207 kernel: [60564.593433] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 22:13:10 juju-e4d256-prod-github-runner-207 kernel: [60564.597027] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 22:13:10 juju-e4d256-prod-github-runner-207 kernel: [60564.600711] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 22:13:10 juju-e4d256-prod-github-runner-207 kernel: [60564.603328] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 22:13:10 juju-e4d256-prod-github-runner-207 kernel: [60564.605725] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 22:13:10 juju-e4d256-prod-github-runner-207 kernel: [60564.609299] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 22:13:10 juju-e4d256-prod-github-runner-207 kernel: [60564.613040] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 22:13:10 juju-e4d256-prod-github-runner-207 kernel: [60564.616639] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 22:13:10 juju-e4d256-prod-github-runner-207 kernel: [60564.617831] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 22:13:10 juju-e4d256-prod-github-runner-207 kernel: [60564.621308] Call Trace: Aug 22 22:13:10 juju-e4d256-prod-github-runner-207 kernel: [60564.624747] Aug 22 22:13:10 juju-e4d256-prod-github-runner-207 kernel: [60564.625675] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:13:10 juju-e4d256-prod-github-runner-207 kernel: [60564.629049] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:13:10 juju-e4d256-prod-github-runner-207 kernel: [60564.632495] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:13:10 juju-e4d256-prod-github-runner-207 kernel: [60564.633722] ? show_regs.part.0+0x23/0x29 Aug 22 22:13:10 juju-e4d256-prod-github-runner-207 kernel: [60564.637169] ? show_regs.cold+0x8/0xd Aug 22 22:13:10 juju-e4d256-prod-github-runner-207 kernel: [60564.640494] ? watchdog_timer_fn+0x1be/0x220 Aug 22 22:13:10 juju-e4d256-prod-github-runner-207 kernel: [60564.643291] ? lockup_detector_update_enable+0x60/0x60 Aug 22 22:13:10 juju-e4d256-prod-github-runner-207 kernel: [60564.645001] ? __hrtimer_run_queues+0x107/0x230 Aug 22 22:13:10 juju-e4d256-prod-github-runner-207 kernel: [60564.648169] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 22:13:10 juju-e4d256-prod-github-runner-207 kernel: [60564.651554] ? hrtimer_interrupt+0x101/0x220 Aug 22 22:13:10 juju-e4d256-prod-github-runner-207 kernel: [60564.652593] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 22:13:10 juju-e4d256-prod-github-runner-207 kernel: [60564.655953] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 22:13:10 juju-e4d256-prod-github-runner-207 kernel: [60564.659320] Aug 22 22:13:10 juju-e4d256-prod-github-runner-207 kernel: [60564.662584] Aug 22 22:13:10 juju-e4d256-prod-github-runner-207 kernel: [60564.663473] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 22:13:10 juju-e4d256-prod-github-runner-207 kernel: [60564.666708] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:13:10 juju-e4d256-prod-github-runner-207 kernel: [60564.670219] ? _raw_spin_lock+0x22/0x30 Aug 22 22:13:10 juju-e4d256-prod-github-runner-207 kernel: [60564.671229] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:13:10 juju-e4d256-prod-github-runner-207 kernel: [60564.674701] direct_page_fault+0x206/0x310 [kvm] Aug 22 22:13:10 juju-e4d256-prod-github-runner-207 kernel: [60564.677910] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 22:13:10 juju-e4d256-prod-github-runner-207 kernel: [60564.680786] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 22:13:10 juju-e4d256-prod-github-runner-207 kernel: [60564.682407] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 22:13:10 juju-e4d256-prod-github-runner-207 kernel: [60564.685738] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 22:13:10 juju-e4d256-prod-github-runner-207 kernel: [60564.688947] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 22:13:10 juju-e4d256-prod-github-runner-207 kernel: [60564.690037] handle_exit+0x98/0x230 [kvm_amd] Aug 22 22:13:10 juju-e4d256-prod-github-runner-207 kernel: [60564.693224] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 22:13:10 juju-e4d256-prod-github-runner-207 kernel: [60564.696541] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 22:13:10 juju-e4d256-prod-github-runner-207 kernel: [60564.698236] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 22:13:10 juju-e4d256-prod-github-runner-207 kernel: [60564.700906] vcpu_run+0x62/0x2c0 [kvm] Aug 22 22:13:10 juju-e4d256-prod-github-runner-207 kernel: [60564.701835] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 22:13:10 juju-e4d256-prod-github-runner-207 kernel: [60564.705186] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 22:13:10 juju-e4d256-prod-github-runner-207 kernel: [60564.706152] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 22:13:10 juju-e4d256-prod-github-runner-207 kernel: [60564.709444] ? __seccomp_filter+0x4a/0x4a0 Aug 22 22:13:10 juju-e4d256-prod-github-runner-207 kernel: [60564.710229] ? __fget_files+0x86/0xc0 Aug 22 22:13:10 juju-e4d256-prod-github-runner-207 kernel: [60564.711096] __x64_sys_ioctl+0x95/0xd0 Aug 22 22:13:10 juju-e4d256-prod-github-runner-207 kernel: [60564.711813] do_syscall_64+0x5c/0xc0 Aug 22 22:13:10 juju-e4d256-prod-github-runner-207 kernel: [60564.712510] ? do_futex+0x162/0x1f0 Aug 22 22:13:10 juju-e4d256-prod-github-runner-207 kernel: [60564.713184] ? __x64_sys_futex+0x78/0x1e0 Aug 22 22:13:10 juju-e4d256-prod-github-runner-207 kernel: [60564.713884] ? __secure_computing+0xa9/0x120 Aug 22 22:13:10 juju-e4d256-prod-github-runner-207 kernel: [60564.714596] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 22:13:10 juju-e4d256-prod-github-runner-207 kernel: [60564.715445] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:13:10 juju-e4d256-prod-github-runner-207 kernel: [60564.716200] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:13:10 juju-e4d256-prod-github-runner-207 kernel: [60564.716950] ? do_syscall_64+0x69/0xc0 Aug 22 22:13:10 juju-e4d256-prod-github-runner-207 kernel: [60564.717624] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:13:10 juju-e4d256-prod-github-runner-207 kernel: [60564.718356] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:13:10 juju-e4d256-prod-github-runner-207 kernel: [60564.719145] ? do_syscall_64+0x69/0xc0 Aug 22 22:13:10 juju-e4d256-prod-github-runner-207 kernel: [60564.719793] ? do_syscall_64+0x69/0xc0 Aug 22 22:13:10 juju-e4d256-prod-github-runner-207 kernel: [60564.720438] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 22:13:10 juju-e4d256-prod-github-runner-207 kernel: [60564.721222] RIP: 0033:0x7faa5d0edaff Aug 22 22:13:10 juju-e4d256-prod-github-runner-207 kernel: [60564.721966] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 22:13:10 juju-e4d256-prod-github-runner-207 kernel: [60564.724422] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 22:13:10 juju-e4d256-prod-github-runner-207 kernel: [60564.725444] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 22:13:10 juju-e4d256-prod-github-runner-207 kernel: [60564.726375] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 22:13:10 juju-e4d256-prod-github-runner-207 kernel: [60564.727407] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 22:13:10 juju-e4d256-prod-github-runner-207 kernel: [60564.728347] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 22:13:10 juju-e4d256-prod-github-runner-207 kernel: [60564.729480] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 22:13:10 juju-e4d256-prod-github-runner-207 kernel: [60564.730436] Aug 22 22:13:38 juju-e4d256-prod-github-runner-207 kernel: [60592.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 56323s! [qemu-system-x86:6715] Aug 22 22:13:38 juju-e4d256-prod-github-runner-207 kernel: [60592.543155] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 22:13:38 juju-e4d256-prod-github-runner-207 kernel: [60592.543235] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 22:13:38 juju-e4d256-prod-github-runner-207 kernel: [60592.555925] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 22:13:38 juju-e4d256-prod-github-runner-207 kernel: [60592.557215] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 22:13:38 juju-e4d256-prod-github-runner-207 kernel: [60592.558528] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:13:38 juju-e4d256-prod-github-runner-207 kernel: [60592.559620] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 22:13:38 juju-e4d256-prod-github-runner-207 kernel: [60592.562276] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 22:13:38 juju-e4d256-prod-github-runner-207 kernel: [60592.563438] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 22:13:38 juju-e4d256-prod-github-runner-207 kernel: [60592.564697] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 22:13:38 juju-e4d256-prod-github-runner-207 kernel: [60592.565926] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 22:13:38 juju-e4d256-prod-github-runner-207 kernel: [60592.567158] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 22:13:38 juju-e4d256-prod-github-runner-207 kernel: [60592.568441] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 22:13:38 juju-e4d256-prod-github-runner-207 kernel: [60592.569645] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 22:13:38 juju-e4d256-prod-github-runner-207 kernel: [60592.570970] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 22:13:38 juju-e4d256-prod-github-runner-207 kernel: [60592.572095] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 22:13:38 juju-e4d256-prod-github-runner-207 kernel: [60592.573306] Call Trace: Aug 22 22:13:38 juju-e4d256-prod-github-runner-207 kernel: [60592.574233] Aug 22 22:13:38 juju-e4d256-prod-github-runner-207 kernel: [60592.575211] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:13:38 juju-e4d256-prod-github-runner-207 kernel: [60592.576286] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:13:38 juju-e4d256-prod-github-runner-207 kernel: [60592.577349] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:13:38 juju-e4d256-prod-github-runner-207 kernel: [60592.578470] ? show_regs.part.0+0x23/0x29 Aug 22 22:13:38 juju-e4d256-prod-github-runner-207 kernel: [60592.579478] ? show_regs.cold+0x8/0xd Aug 22 22:13:38 juju-e4d256-prod-github-runner-207 kernel: [60592.580474] ? watchdog_timer_fn+0x1be/0x220 Aug 22 22:13:38 juju-e4d256-prod-github-runner-207 kernel: [60592.581510] ? lockup_detector_update_enable+0x60/0x60 Aug 22 22:13:38 juju-e4d256-prod-github-runner-207 kernel: [60592.582607] ? __hrtimer_run_queues+0x107/0x230 Aug 22 22:13:38 juju-e4d256-prod-github-runner-207 kernel: [60592.583647] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 22:13:38 juju-e4d256-prod-github-runner-207 kernel: [60592.584689] ? hrtimer_interrupt+0x101/0x220 Aug 22 22:13:38 juju-e4d256-prod-github-runner-207 kernel: [60592.585731] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 22:13:38 juju-e4d256-prod-github-runner-207 kernel: [60592.586846] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 22:13:38 juju-e4d256-prod-github-runner-207 kernel: [60592.587910] Aug 22 22:13:38 juju-e4d256-prod-github-runner-207 kernel: [60592.588777] Aug 22 22:13:38 juju-e4d256-prod-github-runner-207 kernel: [60592.589622] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 22:13:38 juju-e4d256-prod-github-runner-207 kernel: [60592.590853] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:13:38 juju-e4d256-prod-github-runner-207 kernel: [60592.591977] ? _raw_spin_lock+0x22/0x30 Aug 22 22:13:38 juju-e4d256-prod-github-runner-207 kernel: [60592.592946] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:13:38 juju-e4d256-prod-github-runner-207 kernel: [60592.594048] direct_page_fault+0x206/0x310 [kvm] Aug 22 22:13:38 juju-e4d256-prod-github-runner-207 kernel: [60592.595163] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 22:13:38 juju-e4d256-prod-github-runner-207 kernel: [60592.596207] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 22:13:38 juju-e4d256-prod-github-runner-207 kernel: [60592.597317] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 22:13:38 juju-e4d256-prod-github-runner-207 kernel: [60592.598344] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 22:13:38 juju-e4d256-prod-github-runner-207 kernel: [60592.599352] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 22:13:38 juju-e4d256-prod-github-runner-207 kernel: [60592.600344] handle_exit+0x98/0x230 [kvm_amd] Aug 22 22:13:38 juju-e4d256-prod-github-runner-207 kernel: [60592.601292] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 22:13:38 juju-e4d256-prod-github-runner-207 kernel: [60592.602234] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 22:13:38 juju-e4d256-prod-github-runner-207 kernel: [60592.603192] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 22:13:38 juju-e4d256-prod-github-runner-207 kernel: [60592.604116] vcpu_run+0x62/0x2c0 [kvm] Aug 22 22:13:38 juju-e4d256-prod-github-runner-207 kernel: [60592.604949] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 22:13:38 juju-e4d256-prod-github-runner-207 kernel: [60592.605774] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 22:13:38 juju-e4d256-prod-github-runner-207 kernel: [60592.606684] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 22:13:38 juju-e4d256-prod-github-runner-207 kernel: [60592.607498] ? __seccomp_filter+0x4a/0x4a0 Aug 22 22:13:38 juju-e4d256-prod-github-runner-207 kernel: [60592.608259] ? __fget_files+0x86/0xc0 Aug 22 22:13:38 juju-e4d256-prod-github-runner-207 kernel: [60592.608974] __x64_sys_ioctl+0x95/0xd0 Aug 22 22:13:38 juju-e4d256-prod-github-runner-207 kernel: [60592.609686] do_syscall_64+0x5c/0xc0 Aug 22 22:13:38 juju-e4d256-prod-github-runner-207 kernel: [60592.610363] ? do_futex+0x162/0x1f0 Aug 22 22:13:38 juju-e4d256-prod-github-runner-207 kernel: [60592.611064] ? __x64_sys_futex+0x78/0x1e0 Aug 22 22:13:38 juju-e4d256-prod-github-runner-207 kernel: [60592.611766] ? __secure_computing+0xa9/0x120 Aug 22 22:13:38 juju-e4d256-prod-github-runner-207 kernel: [60592.612479] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 22:13:38 juju-e4d256-prod-github-runner-207 kernel: [60592.613257] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:13:38 juju-e4d256-prod-github-runner-207 kernel: [60592.614019] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:13:38 juju-e4d256-prod-github-runner-207 kernel: [60592.614783] ? do_syscall_64+0x69/0xc0 Aug 22 22:13:38 juju-e4d256-prod-github-runner-207 kernel: [60592.615450] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:13:38 juju-e4d256-prod-github-runner-207 kernel: [60592.616167] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:13:38 juju-e4d256-prod-github-runner-207 kernel: [60592.616889] ? do_syscall_64+0x69/0xc0 Aug 22 22:13:38 juju-e4d256-prod-github-runner-207 kernel: [60592.617530] ? do_syscall_64+0x69/0xc0 Aug 22 22:13:38 juju-e4d256-prod-github-runner-207 kernel: [60592.618172] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 22:13:38 juju-e4d256-prod-github-runner-207 kernel: [60592.618945] RIP: 0033:0x7faa5d0edaff Aug 22 22:13:38 juju-e4d256-prod-github-runner-207 kernel: [60592.619587] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 22:13:38 juju-e4d256-prod-github-runner-207 kernel: [60592.621628] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 22:13:38 juju-e4d256-prod-github-runner-207 kernel: [60592.622610] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 22:13:38 juju-e4d256-prod-github-runner-207 kernel: [60592.623549] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 22:13:38 juju-e4d256-prod-github-runner-207 kernel: [60592.624459] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 22:13:38 juju-e4d256-prod-github-runner-207 kernel: [60592.625375] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 22:13:38 juju-e4d256-prod-github-runner-207 kernel: [60592.626286] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 22:13:38 juju-e4d256-prod-github-runner-207 kernel: [60592.627238] Aug 22 22:14:06 juju-e4d256-prod-github-runner-207 kernel: [60620.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 56349s! [qemu-system-x86:6715] Aug 22 22:14:06 juju-e4d256-prod-github-runner-207 kernel: [60620.543347] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 22:14:06 juju-e4d256-prod-github-runner-207 kernel: [60620.543422] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 22:14:06 juju-e4d256-prod-github-runner-207 kernel: [60620.557797] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 22:14:06 juju-e4d256-prod-github-runner-207 kernel: [60620.559304] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 22:14:06 juju-e4d256-prod-github-runner-207 kernel: [60620.560712] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:14:06 juju-e4d256-prod-github-runner-207 kernel: [60620.561901] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 22:14:06 juju-e4d256-prod-github-runner-207 kernel: [60620.564851] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 22:14:06 juju-e4d256-prod-github-runner-207 kernel: [60620.566062] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 22:14:06 juju-e4d256-prod-github-runner-207 kernel: [60620.567408] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 22:14:06 juju-e4d256-prod-github-runner-207 kernel: [60620.568717] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 22:14:06 juju-e4d256-prod-github-runner-207 kernel: [60620.570021] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 22:14:06 juju-e4d256-prod-github-runner-207 kernel: [60620.571374] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 22:14:06 juju-e4d256-prod-github-runner-207 kernel: [60620.572699] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 22:14:06 juju-e4d256-prod-github-runner-207 kernel: [60620.574129] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 22:14:06 juju-e4d256-prod-github-runner-207 kernel: [60620.575343] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 22:14:06 juju-e4d256-prod-github-runner-207 kernel: [60620.576679] Call Trace: Aug 22 22:14:06 juju-e4d256-prod-github-runner-207 kernel: [60620.577652] Aug 22 22:14:06 juju-e4d256-prod-github-runner-207 kernel: [60620.578619] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:14:06 juju-e4d256-prod-github-runner-207 kernel: [60620.579764] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:14:06 juju-e4d256-prod-github-runner-207 kernel: [60620.580897] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:14:06 juju-e4d256-prod-github-runner-207 kernel: [60620.582291] ? show_regs.part.0+0x23/0x29 Aug 22 22:14:06 juju-e4d256-prod-github-runner-207 kernel: [60620.583374] ? show_regs.cold+0x8/0xd Aug 22 22:14:06 juju-e4d256-prod-github-runner-207 kernel: [60620.584427] ? watchdog_timer_fn+0x1be/0x220 Aug 22 22:14:06 juju-e4d256-prod-github-runner-207 kernel: [60620.585531] ? lockup_detector_update_enable+0x60/0x60 Aug 22 22:14:06 juju-e4d256-prod-github-runner-207 kernel: [60620.586719] ? __hrtimer_run_queues+0x107/0x230 Aug 22 22:14:06 juju-e4d256-prod-github-runner-207 kernel: [60620.587870] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 22:14:06 juju-e4d256-prod-github-runner-207 kernel: [60620.589007] ? hrtimer_interrupt+0x101/0x220 Aug 22 22:14:06 juju-e4d256-prod-github-runner-207 kernel: [60620.590222] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 22:14:06 juju-e4d256-prod-github-runner-207 kernel: [60620.591410] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 22:14:06 juju-e4d256-prod-github-runner-207 kernel: [60620.592576] Aug 22 22:14:06 juju-e4d256-prod-github-runner-207 kernel: [60620.593494] Aug 22 22:14:06 juju-e4d256-prod-github-runner-207 kernel: [60620.594413] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 22:14:06 juju-e4d256-prod-github-runner-207 kernel: [60620.595572] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:14:06 juju-e4d256-prod-github-runner-207 kernel: [60620.596735] ? _raw_spin_lock+0x22/0x30 Aug 22 22:14:06 juju-e4d256-prod-github-runner-207 kernel: [60620.597772] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:14:06 juju-e4d256-prod-github-runner-207 kernel: [60620.598912] direct_page_fault+0x206/0x310 [kvm] Aug 22 22:14:06 juju-e4d256-prod-github-runner-207 kernel: [60620.600088] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 22:14:06 juju-e4d256-prod-github-runner-207 kernel: [60620.601233] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 22:14:06 juju-e4d256-prod-github-runner-207 kernel: [60620.602393] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 22:14:06 juju-e4d256-prod-github-runner-207 kernel: [60620.603503] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 22:14:06 juju-e4d256-prod-github-runner-207 kernel: [60620.604602] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 22:14:06 juju-e4d256-prod-github-runner-207 kernel: [60620.605747] handle_exit+0x98/0x230 [kvm_amd] Aug 22 22:14:06 juju-e4d256-prod-github-runner-207 kernel: [60620.606853] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 22:14:06 juju-e4d256-prod-github-runner-207 kernel: [60620.607956] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 22:14:06 juju-e4d256-prod-github-runner-207 kernel: [60620.609013] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 22:14:06 juju-e4d256-prod-github-runner-207 kernel: [60620.610135] vcpu_run+0x62/0x2c0 [kvm] Aug 22 22:14:06 juju-e4d256-prod-github-runner-207 kernel: [60620.611054] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 22:14:06 juju-e4d256-prod-github-runner-207 kernel: [60620.611992] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 22:14:06 juju-e4d256-prod-github-runner-207 kernel: [60620.612987] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 22:14:06 juju-e4d256-prod-github-runner-207 kernel: [60620.613907] ? __seccomp_filter+0x4a/0x4a0 Aug 22 22:14:06 juju-e4d256-prod-github-runner-207 kernel: [60620.614764] ? __fget_files+0x86/0xc0 Aug 22 22:14:06 juju-e4d256-prod-github-runner-207 kernel: [60620.615575] __x64_sys_ioctl+0x95/0xd0 Aug 22 22:14:06 juju-e4d256-prod-github-runner-207 kernel: [60620.616373] do_syscall_64+0x5c/0xc0 Aug 22 22:14:06 juju-e4d256-prod-github-runner-207 kernel: [60620.617155] ? do_futex+0x162/0x1f0 Aug 22 22:14:06 juju-e4d256-prod-github-runner-207 kernel: [60620.617860] ? __x64_sys_futex+0x78/0x1e0 Aug 22 22:14:06 juju-e4d256-prod-github-runner-207 kernel: [60620.618593] ? __secure_computing+0xa9/0x120 Aug 22 22:14:06 juju-e4d256-prod-github-runner-207 kernel: [60620.619310] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 22:14:06 juju-e4d256-prod-github-runner-207 kernel: [60620.620307] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:14:06 juju-e4d256-prod-github-runner-207 kernel: [60620.621078] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:14:06 juju-e4d256-prod-github-runner-207 kernel: [60620.621810] ? do_syscall_64+0x69/0xc0 Aug 22 22:14:06 juju-e4d256-prod-github-runner-207 kernel: [60620.622510] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:14:06 juju-e4d256-prod-github-runner-207 kernel: [60620.623232] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:14:06 juju-e4d256-prod-github-runner-207 kernel: [60620.623952] ? do_syscall_64+0x69/0xc0 Aug 22 22:14:06 juju-e4d256-prod-github-runner-207 kernel: [60620.624588] ? do_syscall_64+0x69/0xc0 Aug 22 22:14:06 juju-e4d256-prod-github-runner-207 kernel: [60620.625232] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 22:14:06 juju-e4d256-prod-github-runner-207 kernel: [60620.625944] RIP: 0033:0x7faa5d0edaff Aug 22 22:14:06 juju-e4d256-prod-github-runner-207 kernel: [60620.626603] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 22:14:06 juju-e4d256-prod-github-runner-207 kernel: [60620.628626] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 22:14:06 juju-e4d256-prod-github-runner-207 kernel: [60620.629565] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 22:14:06 juju-e4d256-prod-github-runner-207 kernel: [60620.630498] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 22:14:06 juju-e4d256-prod-github-runner-207 kernel: [60620.631408] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 22:14:06 juju-e4d256-prod-github-runner-207 kernel: [60620.632322] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 22:14:06 juju-e4d256-prod-github-runner-207 kernel: [60620.633296] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 22:14:06 juju-e4d256-prod-github-runner-207 kernel: [60620.634339] Aug 22 22:14:34 juju-e4d256-prod-github-runner-207 kernel: [60648.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 56375s! [qemu-system-x86:6715] Aug 22 22:14:34 juju-e4d256-prod-github-runner-207 kernel: [60648.543847] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 22:14:34 juju-e4d256-prod-github-runner-207 kernel: [60648.544156] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 22:14:34 juju-e4d256-prod-github-runner-207 kernel: [60648.556727] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 22:14:34 juju-e4d256-prod-github-runner-207 kernel: [60648.558059] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 22:14:34 juju-e4d256-prod-github-runner-207 kernel: [60648.559327] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:14:34 juju-e4d256-prod-github-runner-207 kernel: [60648.560421] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 22:14:34 juju-e4d256-prod-github-runner-207 kernel: [60648.563026] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 22:14:34 juju-e4d256-prod-github-runner-207 kernel: [60648.564107] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 22:14:34 juju-e4d256-prod-github-runner-207 kernel: [60648.565317] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 22:14:34 juju-e4d256-prod-github-runner-207 kernel: [60648.566537] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 22:14:34 juju-e4d256-prod-github-runner-207 kernel: [60648.567896] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 22:14:34 juju-e4d256-prod-github-runner-207 kernel: [60648.569101] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 22:14:34 juju-e4d256-prod-github-runner-207 kernel: [60648.570310] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 22:14:34 juju-e4d256-prod-github-runner-207 kernel: [60648.571624] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 22:14:34 juju-e4d256-prod-github-runner-207 kernel: [60648.572773] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 22:14:34 juju-e4d256-prod-github-runner-207 kernel: [60648.574125] Call Trace: Aug 22 22:14:34 juju-e4d256-prod-github-runner-207 kernel: [60648.575247] Aug 22 22:14:34 juju-e4d256-prod-github-runner-207 kernel: [60648.576196] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:14:34 juju-e4d256-prod-github-runner-207 kernel: [60648.577257] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:14:34 juju-e4d256-prod-github-runner-207 kernel: [60648.578373] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:14:34 juju-e4d256-prod-github-runner-207 kernel: [60648.579507] ? show_regs.part.0+0x23/0x29 Aug 22 22:14:34 juju-e4d256-prod-github-runner-207 kernel: [60648.580532] ? show_regs.cold+0x8/0xd Aug 22 22:14:34 juju-e4d256-prod-github-runner-207 kernel: [60648.581519] ? watchdog_timer_fn+0x1be/0x220 Aug 22 22:14:34 juju-e4d256-prod-github-runner-207 kernel: [60648.582581] ? lockup_detector_update_enable+0x60/0x60 Aug 22 22:14:34 juju-e4d256-prod-github-runner-207 kernel: [60648.583694] ? __hrtimer_run_queues+0x107/0x230 Aug 22 22:14:34 juju-e4d256-prod-github-runner-207 kernel: [60648.584753] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 22:14:34 juju-e4d256-prod-github-runner-207 kernel: [60648.585836] ? hrtimer_interrupt+0x101/0x220 Aug 22 22:14:34 juju-e4d256-prod-github-runner-207 kernel: [60648.586877] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 22:14:34 juju-e4d256-prod-github-runner-207 kernel: [60648.588016] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 22:14:34 juju-e4d256-prod-github-runner-207 kernel: [60648.589115] Aug 22 22:14:34 juju-e4d256-prod-github-runner-207 kernel: [60648.590039] Aug 22 22:14:34 juju-e4d256-prod-github-runner-207 kernel: [60648.590910] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 22:14:34 juju-e4d256-prod-github-runner-207 kernel: [60648.592005] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:14:34 juju-e4d256-prod-github-runner-207 kernel: [60648.593125] ? _raw_spin_lock+0x22/0x30 Aug 22 22:14:34 juju-e4d256-prod-github-runner-207 kernel: [60648.594120] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:14:34 juju-e4d256-prod-github-runner-207 kernel: [60648.595212] direct_page_fault+0x206/0x310 [kvm] Aug 22 22:14:34 juju-e4d256-prod-github-runner-207 kernel: [60648.596312] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 22:14:34 juju-e4d256-prod-github-runner-207 kernel: [60648.597347] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 22:14:34 juju-e4d256-prod-github-runner-207 kernel: [60648.598400] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 22:14:34 juju-e4d256-prod-github-runner-207 kernel: [60648.599431] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 22:14:34 juju-e4d256-prod-github-runner-207 kernel: [60648.600417] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 22:14:34 juju-e4d256-prod-github-runner-207 kernel: [60648.601452] handle_exit+0x98/0x230 [kvm_amd] Aug 22 22:14:34 juju-e4d256-prod-github-runner-207 kernel: [60648.602392] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 22:14:34 juju-e4d256-prod-github-runner-207 kernel: [60648.603328] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 22:14:34 juju-e4d256-prod-github-runner-207 kernel: [60648.604297] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 22:14:34 juju-e4d256-prod-github-runner-207 kernel: [60648.605221] vcpu_run+0x62/0x2c0 [kvm] Aug 22 22:14:34 juju-e4d256-prod-github-runner-207 kernel: [60648.606178] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 22:14:34 juju-e4d256-prod-github-runner-207 kernel: [60648.607050] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 22:14:34 juju-e4d256-prod-github-runner-207 kernel: [60648.607950] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 22:14:34 juju-e4d256-prod-github-runner-207 kernel: [60648.608790] ? __seccomp_filter+0x4a/0x4a0 Aug 22 22:14:34 juju-e4d256-prod-github-runner-207 kernel: [60648.609561] ? __fget_files+0x86/0xc0 Aug 22 22:14:34 juju-e4d256-prod-github-runner-207 kernel: [60648.610319] __x64_sys_ioctl+0x95/0xd0 Aug 22 22:14:34 juju-e4d256-prod-github-runner-207 kernel: [60648.611151] do_syscall_64+0x5c/0xc0 Aug 22 22:14:34 juju-e4d256-prod-github-runner-207 kernel: [60648.611843] ? do_futex+0x162/0x1f0 Aug 22 22:14:34 juju-e4d256-prod-github-runner-207 kernel: [60648.612506] ? __x64_sys_futex+0x78/0x1e0 Aug 22 22:14:34 juju-e4d256-prod-github-runner-207 kernel: [60648.613192] ? __secure_computing+0xa9/0x120 Aug 22 22:14:34 juju-e4d256-prod-github-runner-207 kernel: [60648.613929] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 22:14:34 juju-e4d256-prod-github-runner-207 kernel: [60648.614715] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:14:34 juju-e4d256-prod-github-runner-207 kernel: [60648.615461] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:14:34 juju-e4d256-prod-github-runner-207 kernel: [60648.616210] ? do_syscall_64+0x69/0xc0 Aug 22 22:14:34 juju-e4d256-prod-github-runner-207 kernel: [60648.616883] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:14:34 juju-e4d256-prod-github-runner-207 kernel: [60648.617599] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:14:34 juju-e4d256-prod-github-runner-207 kernel: [60648.618323] ? do_syscall_64+0x69/0xc0 Aug 22 22:14:34 juju-e4d256-prod-github-runner-207 kernel: [60648.618956] ? do_syscall_64+0x69/0xc0 Aug 22 22:14:34 juju-e4d256-prod-github-runner-207 kernel: [60648.619603] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 22:14:34 juju-e4d256-prod-github-runner-207 kernel: [60648.620517] RIP: 0033:0x7faa5d0edaff Aug 22 22:14:34 juju-e4d256-prod-github-runner-207 kernel: [60648.621208] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 22:14:34 juju-e4d256-prod-github-runner-207 kernel: [60648.623247] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 22:14:34 juju-e4d256-prod-github-runner-207 kernel: [60648.624214] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 22:14:34 juju-e4d256-prod-github-runner-207 kernel: [60648.625251] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 22:14:34 juju-e4d256-prod-github-runner-207 kernel: [60648.626187] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 22:14:34 juju-e4d256-prod-github-runner-207 kernel: [60648.627285] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 22:14:34 juju-e4d256-prod-github-runner-207 kernel: [60648.628232] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 22:14:34 juju-e4d256-prod-github-runner-207 kernel: [60648.629135] Aug 22 22:14:47 juju-e4d256-prod-github-runner-207 kernel: [60661.232706] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 22:14:47 juju-e4d256-prod-github-runner-207 kernel: [60661.233745] rcu: 1-....: (15088325 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=7289151 Aug 22 22:14:47 juju-e4d256-prod-github-runner-207 kernel: [60661.234876] (t=15136008 jiffies g=23269 q=54313) Aug 22 22:14:47 juju-e4d256-prod-github-runner-207 kernel: [60661.235661] NMI backtrace for cpu 1 Aug 22 22:14:47 juju-e4d256-prod-github-runner-207 kernel: [60661.236368] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 22:14:47 juju-e4d256-prod-github-runner-207 kernel: [60661.237468] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 22:14:47 juju-e4d256-prod-github-runner-207 kernel: [60661.238585] Call Trace: Aug 22 22:14:47 juju-e4d256-prod-github-runner-207 kernel: [60661.239264] Aug 22 22:14:47 juju-e4d256-prod-github-runner-207 kernel: [60661.239914] show_stack+0x52/0x5c Aug 22 22:14:47 juju-e4d256-prod-github-runner-207 kernel: [60661.240637] dump_stack_lvl+0x4a/0x63 Aug 22 22:14:47 juju-e4d256-prod-github-runner-207 kernel: [60661.241430] dump_stack+0x10/0x16 Aug 22 22:14:47 juju-e4d256-prod-github-runner-207 kernel: [60661.242176] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 22:14:47 juju-e4d256-prod-github-runner-207 kernel: [60661.242961] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 22:14:47 juju-e4d256-prod-github-runner-207 kernel: [60661.243735] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 22:14:47 juju-e4d256-prod-github-runner-207 kernel: [60661.244555] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 22:14:47 juju-e4d256-prod-github-runner-207 kernel: [60661.245375] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 22:14:47 juju-e4d256-prod-github-runner-207 kernel: [60661.246196] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 22:14:47 juju-e4d256-prod-github-runner-207 kernel: [60661.246971] print_cpu_stall.cold+0x2f/0xe2 Aug 22 22:14:47 juju-e4d256-prod-github-runner-207 kernel: [60661.247732] ? timekeeping_update+0xf7/0x150 Aug 22 22:14:47 juju-e4d256-prod-github-runner-207 kernel: [60661.248499] check_cpu_stall+0x109/0x270 Aug 22 22:14:47 juju-e4d256-prod-github-runner-207 kernel: [60661.249269] rcu_sched_clock_irq+0x9a/0x250 Aug 22 22:14:47 juju-e4d256-prod-github-runner-207 kernel: [60661.250049] update_process_times+0x94/0xd0 Aug 22 22:14:47 juju-e4d256-prod-github-runner-207 kernel: [60661.250808] tick_sched_handle+0x29/0x70 Aug 22 22:14:47 juju-e4d256-prod-github-runner-207 kernel: [60661.251549] tick_sched_timer+0x8c/0xc0 Aug 22 22:14:47 juju-e4d256-prod-github-runner-207 kernel: [60661.252285] ? tick_nohz_handler+0xb0/0xb0 Aug 22 22:14:47 juju-e4d256-prod-github-runner-207 kernel: [60661.253061] __hrtimer_run_queues+0x107/0x230 Aug 22 22:14:47 juju-e4d256-prod-github-runner-207 kernel: [60661.253860] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 22:14:47 juju-e4d256-prod-github-runner-207 kernel: [60661.254647] hrtimer_interrupt+0x101/0x220 Aug 22 22:14:47 juju-e4d256-prod-github-runner-207 kernel: [60661.255406] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 22:14:47 juju-e4d256-prod-github-runner-207 kernel: [60661.256216] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 22:14:47 juju-e4d256-prod-github-runner-207 kernel: [60661.257121] Aug 22 22:14:47 juju-e4d256-prod-github-runner-207 kernel: [60661.257998] Aug 22 22:14:47 juju-e4d256-prod-github-runner-207 kernel: [60661.258850] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 22:14:47 juju-e4d256-prod-github-runner-207 kernel: [60661.260210] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:14:47 juju-e4d256-prod-github-runner-207 kernel: [60661.261208] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 22:14:47 juju-e4d256-prod-github-runner-207 kernel: [60661.263627] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 22:14:47 juju-e4d256-prod-github-runner-207 kernel: [60661.264515] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 22:14:47 juju-e4d256-prod-github-runner-207 kernel: [60661.265552] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 22:14:47 juju-e4d256-prod-github-runner-207 kernel: [60661.266672] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 22:14:47 juju-e4d256-prod-github-runner-207 kernel: [60661.267724] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 22:14:47 juju-e4d256-prod-github-runner-207 kernel: [60661.268681] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 22:14:47 juju-e4d256-prod-github-runner-207 kernel: [60661.269659] ? _raw_spin_lock+0x22/0x30 Aug 22 22:14:47 juju-e4d256-prod-github-runner-207 kernel: [60661.270689] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:14:47 juju-e4d256-prod-github-runner-207 kernel: [60661.271713] direct_page_fault+0x206/0x310 [kvm] Aug 22 22:14:47 juju-e4d256-prod-github-runner-207 kernel: [60661.272567] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 22:14:47 juju-e4d256-prod-github-runner-207 kernel: [60661.273399] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 22:14:47 juju-e4d256-prod-github-runner-207 kernel: [60661.274244] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 22:14:47 juju-e4d256-prod-github-runner-207 kernel: [60661.275047] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 22:14:47 juju-e4d256-prod-github-runner-207 kernel: [60661.275830] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 22:14:47 juju-e4d256-prod-github-runner-207 kernel: [60661.276667] handle_exit+0x98/0x230 [kvm_amd] Aug 22 22:14:47 juju-e4d256-prod-github-runner-207 kernel: [60661.277422] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 22:14:47 juju-e4d256-prod-github-runner-207 kernel: [60661.278215] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 22:14:47 juju-e4d256-prod-github-runner-207 kernel: [60661.279016] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 22:14:47 juju-e4d256-prod-github-runner-207 kernel: [60661.279802] vcpu_run+0x62/0x2c0 [kvm] Aug 22 22:14:47 juju-e4d256-prod-github-runner-207 kernel: [60661.280526] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 22:14:47 juju-e4d256-prod-github-runner-207 kernel: [60661.281294] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 22:14:47 juju-e4d256-prod-github-runner-207 kernel: [60661.282163] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 22:14:47 juju-e4d256-prod-github-runner-207 kernel: [60661.282943] ? __seccomp_filter+0x4a/0x4a0 Aug 22 22:14:47 juju-e4d256-prod-github-runner-207 kernel: [60661.283665] ? __fget_files+0x86/0xc0 Aug 22 22:14:47 juju-e4d256-prod-github-runner-207 kernel: [60661.284356] __x64_sys_ioctl+0x95/0xd0 Aug 22 22:14:47 juju-e4d256-prod-github-runner-207 kernel: [60661.285101] do_syscall_64+0x5c/0xc0 Aug 22 22:14:47 juju-e4d256-prod-github-runner-207 kernel: [60661.285804] ? do_futex+0x162/0x1f0 Aug 22 22:14:47 juju-e4d256-prod-github-runner-207 kernel: [60661.286501] ? __x64_sys_futex+0x78/0x1e0 Aug 22 22:14:47 juju-e4d256-prod-github-runner-207 kernel: [60661.287206] ? __secure_computing+0xa9/0x120 Aug 22 22:14:47 juju-e4d256-prod-github-runner-207 kernel: [60661.287939] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 22:14:47 juju-e4d256-prod-github-runner-207 kernel: [60661.288732] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:14:47 juju-e4d256-prod-github-runner-207 kernel: [60661.289486] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:14:47 juju-e4d256-prod-github-runner-207 kernel: [60661.290272] ? do_syscall_64+0x69/0xc0 Aug 22 22:14:47 juju-e4d256-prod-github-runner-207 kernel: [60661.290970] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:14:47 juju-e4d256-prod-github-runner-207 kernel: [60661.291736] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:14:47 juju-e4d256-prod-github-runner-207 kernel: [60661.292492] ? do_syscall_64+0x69/0xc0 Aug 22 22:14:47 juju-e4d256-prod-github-runner-207 kernel: [60661.293185] ? do_syscall_64+0x69/0xc0 Aug 22 22:14:47 juju-e4d256-prod-github-runner-207 kernel: [60661.293892] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 22:14:47 juju-e4d256-prod-github-runner-207 kernel: [60661.294670] RIP: 0033:0x7faa5d0edaff Aug 22 22:14:47 juju-e4d256-prod-github-runner-207 kernel: [60661.295355] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 22:14:47 juju-e4d256-prod-github-runner-207 kernel: [60661.297451] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 22:14:47 juju-e4d256-prod-github-runner-207 kernel: [60661.298423] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 22:14:47 juju-e4d256-prod-github-runner-207 kernel: [60661.299421] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 22:14:47 juju-e4d256-prod-github-runner-207 kernel: [60661.300381] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 22:14:47 juju-e4d256-prod-github-runner-207 kernel: [60661.301340] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 22:14:47 juju-e4d256-prod-github-runner-207 kernel: [60661.302300] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 22:14:47 juju-e4d256-prod-github-runner-207 kernel: [60661.303223] Aug 22 22:15:14 juju-e4d256-prod-github-runner-207 kernel: [60688.541985] watchdog: BUG: soft lockup - CPU#1 stuck for 56412s! [qemu-system-x86:6715] Aug 22 22:15:14 juju-e4d256-prod-github-runner-207 kernel: [60688.543255] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 22:15:14 juju-e4d256-prod-github-runner-207 kernel: [60688.543349] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 22:15:14 juju-e4d256-prod-github-runner-207 kernel: [60688.556086] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 22:15:14 juju-e4d256-prod-github-runner-207 kernel: [60688.557473] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 22:15:14 juju-e4d256-prod-github-runner-207 kernel: [60688.558744] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:15:14 juju-e4d256-prod-github-runner-207 kernel: [60688.560018] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 22:15:14 juju-e4d256-prod-github-runner-207 kernel: [60688.563132] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 22:15:14 juju-e4d256-prod-github-runner-207 kernel: [60688.564351] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 22:15:14 juju-e4d256-prod-github-runner-207 kernel: [60688.565705] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 22:15:14 juju-e4d256-prod-github-runner-207 kernel: [60688.567072] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 22:15:14 juju-e4d256-prod-github-runner-207 kernel: [60688.568429] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 22:15:14 juju-e4d256-prod-github-runner-207 kernel: [60688.569833] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 22:15:14 juju-e4d256-prod-github-runner-207 kernel: [60688.571250] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 22:15:14 juju-e4d256-prod-github-runner-207 kernel: [60688.572704] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 22:15:14 juju-e4d256-prod-github-runner-207 kernel: [60688.573974] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 22:15:14 juju-e4d256-prod-github-runner-207 kernel: [60688.575330] Call Trace: Aug 22 22:15:14 juju-e4d256-prod-github-runner-207 kernel: [60688.576314] Aug 22 22:15:14 juju-e4d256-prod-github-runner-207 kernel: [60688.577297] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:15:14 juju-e4d256-prod-github-runner-207 kernel: [60688.578508] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:15:14 juju-e4d256-prod-github-runner-207 kernel: [60688.579651] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:15:14 juju-e4d256-prod-github-runner-207 kernel: [60688.580853] ? show_regs.part.0+0x23/0x29 Aug 22 22:15:14 juju-e4d256-prod-github-runner-207 kernel: [60688.581991] ? show_regs.cold+0x8/0xd Aug 22 22:15:14 juju-e4d256-prod-github-runner-207 kernel: [60688.583117] ? watchdog_timer_fn+0x1be/0x220 Aug 22 22:15:14 juju-e4d256-prod-github-runner-207 kernel: [60688.584248] ? lockup_detector_update_enable+0x60/0x60 Aug 22 22:15:14 juju-e4d256-prod-github-runner-207 kernel: [60688.585455] ? __hrtimer_run_queues+0x107/0x230 Aug 22 22:15:14 juju-e4d256-prod-github-runner-207 kernel: [60688.586590] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 22:15:14 juju-e4d256-prod-github-runner-207 kernel: [60688.587706] ? hrtimer_interrupt+0x101/0x220 Aug 22 22:15:14 juju-e4d256-prod-github-runner-207 kernel: [60688.588817] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 22:15:14 juju-e4d256-prod-github-runner-207 kernel: [60688.590011] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 22:15:14 juju-e4d256-prod-github-runner-207 kernel: [60688.591172] Aug 22 22:15:14 juju-e4d256-prod-github-runner-207 kernel: [60688.592093] Aug 22 22:15:14 juju-e4d256-prod-github-runner-207 kernel: [60688.592995] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 22:15:14 juju-e4d256-prod-github-runner-207 kernel: [60688.594192] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:15:14 juju-e4d256-prod-github-runner-207 kernel: [60688.595560] ? _raw_spin_lock+0x22/0x30 Aug 22 22:15:14 juju-e4d256-prod-github-runner-207 kernel: [60688.596595] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:15:14 juju-e4d256-prod-github-runner-207 kernel: [60688.597943] direct_page_fault+0x206/0x310 [kvm] Aug 22 22:15:14 juju-e4d256-prod-github-runner-207 kernel: [60688.599212] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 22:15:14 juju-e4d256-prod-github-runner-207 kernel: [60688.600338] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 22:15:14 juju-e4d256-prod-github-runner-207 kernel: [60688.601474] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 22:15:14 juju-e4d256-prod-github-runner-207 kernel: [60688.602553] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 22:15:14 juju-e4d256-prod-github-runner-207 kernel: [60688.603645] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 22:15:14 juju-e4d256-prod-github-runner-207 kernel: [60688.604742] handle_exit+0x98/0x230 [kvm_amd] Aug 22 22:15:14 juju-e4d256-prod-github-runner-207 kernel: [60688.605750] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 22:15:14 juju-e4d256-prod-github-runner-207 kernel: [60688.606766] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 22:15:14 juju-e4d256-prod-github-runner-207 kernel: [60688.607803] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 22:15:14 juju-e4d256-prod-github-runner-207 kernel: [60688.608821] vcpu_run+0x62/0x2c0 [kvm] Aug 22 22:15:14 juju-e4d256-prod-github-runner-207 kernel: [60688.609768] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 22:15:14 juju-e4d256-prod-github-runner-207 kernel: [60688.610709] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 22:15:14 juju-e4d256-prod-github-runner-207 kernel: [60688.611677] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 22:15:14 juju-e4d256-prod-github-runner-207 kernel: [60688.612634] ? __seccomp_filter+0x4a/0x4a0 Aug 22 22:15:14 juju-e4d256-prod-github-runner-207 kernel: [60688.613500] ? __fget_files+0x86/0xc0 Aug 22 22:15:14 juju-e4d256-prod-github-runner-207 kernel: [60688.614223] __x64_sys_ioctl+0x95/0xd0 Aug 22 22:15:14 juju-e4d256-prod-github-runner-207 kernel: [60688.614929] do_syscall_64+0x5c/0xc0 Aug 22 22:15:14 juju-e4d256-prod-github-runner-207 kernel: [60688.615615] ? do_futex+0x162/0x1f0 Aug 22 22:15:14 juju-e4d256-prod-github-runner-207 kernel: [60688.616286] ? __x64_sys_futex+0x78/0x1e0 Aug 22 22:15:14 juju-e4d256-prod-github-runner-207 kernel: [60688.616966] ? __secure_computing+0xa9/0x120 Aug 22 22:15:14 juju-e4d256-prod-github-runner-207 kernel: [60688.617694] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 22:15:14 juju-e4d256-prod-github-runner-207 kernel: [60688.618461] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:15:14 juju-e4d256-prod-github-runner-207 kernel: [60688.619189] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:15:14 juju-e4d256-prod-github-runner-207 kernel: [60688.619931] ? do_syscall_64+0x69/0xc0 Aug 22 22:15:14 juju-e4d256-prod-github-runner-207 kernel: [60688.620582] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:15:14 juju-e4d256-prod-github-runner-207 kernel: [60688.621351] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:15:14 juju-e4d256-prod-github-runner-207 kernel: [60688.622057] ? do_syscall_64+0x69/0xc0 Aug 22 22:15:14 juju-e4d256-prod-github-runner-207 kernel: [60688.622730] ? do_syscall_64+0x69/0xc0 Aug 22 22:15:14 juju-e4d256-prod-github-runner-207 kernel: [60688.623406] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 22:15:14 juju-e4d256-prod-github-runner-207 kernel: [60688.624127] RIP: 0033:0x7faa5d0edaff Aug 22 22:15:14 juju-e4d256-prod-github-runner-207 kernel: [60688.624759] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 22:15:14 juju-e4d256-prod-github-runner-207 kernel: [60688.626834] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 22:15:14 juju-e4d256-prod-github-runner-207 kernel: [60688.627772] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 22:15:14 juju-e4d256-prod-github-runner-207 kernel: [60688.628678] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 22:15:14 juju-e4d256-prod-github-runner-207 kernel: [60688.629896] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 22:15:14 juju-e4d256-prod-github-runner-207 kernel: [60688.630846] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 22:15:14 juju-e4d256-prod-github-runner-207 kernel: [60688.631753] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 22:15:14 juju-e4d256-prod-github-runner-207 kernel: [60688.632798] Aug 22 22:15:42 juju-e4d256-prod-github-runner-207 kernel: [60716.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 56438s! [qemu-system-x86:6715] Aug 22 22:15:42 juju-e4d256-prod-github-runner-207 kernel: [60716.543208] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 22:15:42 juju-e4d256-prod-github-runner-207 kernel: [60716.543281] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 22:15:42 juju-e4d256-prod-github-runner-207 kernel: [60716.557403] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 22:15:42 juju-e4d256-prod-github-runner-207 kernel: [60716.558780] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 22:15:42 juju-e4d256-prod-github-runner-207 kernel: [60716.560103] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:15:42 juju-e4d256-prod-github-runner-207 kernel: [60716.561260] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 22:15:42 juju-e4d256-prod-github-runner-207 kernel: [60716.564115] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 22:15:42 juju-e4d256-prod-github-runner-207 kernel: [60716.565251] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 22:15:42 juju-e4d256-prod-github-runner-207 kernel: [60716.566484] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 22:15:42 juju-e4d256-prod-github-runner-207 kernel: [60716.567875] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 22:15:42 juju-e4d256-prod-github-runner-207 kernel: [60716.569194] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 22:15:42 juju-e4d256-prod-github-runner-207 kernel: [60716.570424] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 22:15:42 juju-e4d256-prod-github-runner-207 kernel: [60716.571622] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 22:15:42 juju-e4d256-prod-github-runner-207 kernel: [60716.572907] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 22:15:42 juju-e4d256-prod-github-runner-207 kernel: [60716.574054] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 22:15:42 juju-e4d256-prod-github-runner-207 kernel: [60716.575291] Call Trace: Aug 22 22:15:42 juju-e4d256-prod-github-runner-207 kernel: [60716.576256] Aug 22 22:15:42 juju-e4d256-prod-github-runner-207 kernel: [60716.577215] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:15:42 juju-e4d256-prod-github-runner-207 kernel: [60716.578313] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:15:42 juju-e4d256-prod-github-runner-207 kernel: [60716.579611] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:15:42 juju-e4d256-prod-github-runner-207 kernel: [60716.580728] ? show_regs.part.0+0x23/0x29 Aug 22 22:15:42 juju-e4d256-prod-github-runner-207 kernel: [60716.581977] ? show_regs.cold+0x8/0xd Aug 22 22:15:42 juju-e4d256-prod-github-runner-207 kernel: [60716.582972] ? watchdog_timer_fn+0x1be/0x220 Aug 22 22:15:42 juju-e4d256-prod-github-runner-207 kernel: [60716.584015] ? lockup_detector_update_enable+0x60/0x60 Aug 22 22:15:42 juju-e4d256-prod-github-runner-207 kernel: [60716.585142] ? __hrtimer_run_queues+0x107/0x230 Aug 22 22:15:42 juju-e4d256-prod-github-runner-207 kernel: [60716.586420] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 22:15:42 juju-e4d256-prod-github-runner-207 kernel: [60716.587622] ? hrtimer_interrupt+0x101/0x220 Aug 22 22:15:42 juju-e4d256-prod-github-runner-207 kernel: [60716.588981] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 22:15:42 juju-e4d256-prod-github-runner-207 kernel: [60716.590116] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 22:15:42 juju-e4d256-prod-github-runner-207 kernel: [60716.591186] Aug 22 22:15:42 juju-e4d256-prod-github-runner-207 kernel: [60716.592112] Aug 22 22:15:42 juju-e4d256-prod-github-runner-207 kernel: [60716.593220] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 22:15:42 juju-e4d256-prod-github-runner-207 kernel: [60716.594304] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:15:42 juju-e4d256-prod-github-runner-207 kernel: [60716.595679] ? _raw_spin_lock+0x22/0x30 Aug 22 22:15:42 juju-e4d256-prod-github-runner-207 kernel: [60716.596795] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:15:42 juju-e4d256-prod-github-runner-207 kernel: [60716.598006] direct_page_fault+0x206/0x310 [kvm] Aug 22 22:15:42 juju-e4d256-prod-github-runner-207 kernel: [60716.599176] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 22:15:42 juju-e4d256-prod-github-runner-207 kernel: [60716.600331] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 22:15:42 juju-e4d256-prod-github-runner-207 kernel: [60716.601512] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 22:15:42 juju-e4d256-prod-github-runner-207 kernel: [60716.602672] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 22:15:42 juju-e4d256-prod-github-runner-207 kernel: [60716.603750] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 22:15:42 juju-e4d256-prod-github-runner-207 kernel: [60716.604922] handle_exit+0x98/0x230 [kvm_amd] Aug 22 22:15:42 juju-e4d256-prod-github-runner-207 kernel: [60716.605986] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 22:15:42 juju-e4d256-prod-github-runner-207 kernel: [60716.607071] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 22:15:42 juju-e4d256-prod-github-runner-207 kernel: [60716.608131] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 22:15:42 juju-e4d256-prod-github-runner-207 kernel: [60716.609234] vcpu_run+0x62/0x2c0 [kvm] Aug 22 22:15:42 juju-e4d256-prod-github-runner-207 kernel: [60716.610170] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 22:15:42 juju-e4d256-prod-github-runner-207 kernel: [60716.611111] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 22:15:42 juju-e4d256-prod-github-runner-207 kernel: [60716.612163] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 22:15:42 juju-e4d256-prod-github-runner-207 kernel: [60716.613112] ? __seccomp_filter+0x4a/0x4a0 Aug 22 22:15:42 juju-e4d256-prod-github-runner-207 kernel: [60716.613965] ? __fget_files+0x86/0xc0 Aug 22 22:15:42 juju-e4d256-prod-github-runner-207 kernel: [60716.614768] __x64_sys_ioctl+0x95/0xd0 Aug 22 22:15:42 juju-e4d256-prod-github-runner-207 kernel: [60716.615566] do_syscall_64+0x5c/0xc0 Aug 22 22:15:42 juju-e4d256-prod-github-runner-207 kernel: [60716.616324] ? do_futex+0x162/0x1f0 Aug 22 22:15:42 juju-e4d256-prod-github-runner-207 kernel: [60716.617089] ? __x64_sys_futex+0x78/0x1e0 Aug 22 22:15:42 juju-e4d256-prod-github-runner-207 kernel: [60716.617875] ? __secure_computing+0xa9/0x120 Aug 22 22:15:42 juju-e4d256-prod-github-runner-207 kernel: [60716.618674] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 22:15:42 juju-e4d256-prod-github-runner-207 kernel: [60716.619522] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:15:42 juju-e4d256-prod-github-runner-207 kernel: [60716.620259] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:15:42 juju-e4d256-prod-github-runner-207 kernel: [60716.621004] ? do_syscall_64+0x69/0xc0 Aug 22 22:15:42 juju-e4d256-prod-github-runner-207 kernel: [60716.621745] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:15:42 juju-e4d256-prod-github-runner-207 kernel: [60716.622616] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:15:42 juju-e4d256-prod-github-runner-207 kernel: [60716.623442] ? do_syscall_64+0x69/0xc0 Aug 22 22:15:42 juju-e4d256-prod-github-runner-207 kernel: [60716.624166] ? do_syscall_64+0x69/0xc0 Aug 22 22:15:42 juju-e4d256-prod-github-runner-207 kernel: [60716.624918] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 22:15:42 juju-e4d256-prod-github-runner-207 kernel: [60716.625737] RIP: 0033:0x7faa5d0edaff Aug 22 22:15:42 juju-e4d256-prod-github-runner-207 kernel: [60716.626443] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 22:15:42 juju-e4d256-prod-github-runner-207 kernel: [60716.628810] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 22:15:42 juju-e4d256-prod-github-runner-207 kernel: [60716.629905] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 22:15:42 juju-e4d256-prod-github-runner-207 kernel: [60716.630961] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 22:15:42 juju-e4d256-prod-github-runner-207 kernel: [60716.632005] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 22:15:42 juju-e4d256-prod-github-runner-207 kernel: [60716.633123] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 22:15:42 juju-e4d256-prod-github-runner-207 kernel: [60716.634173] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 22:15:42 juju-e4d256-prod-github-runner-207 kernel: [60716.635236] Aug 22 22:16:10 juju-e4d256-prod-github-runner-207 kernel: [60744.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 56464s! [qemu-system-x86:6715] Aug 22 22:16:10 juju-e4d256-prod-github-runner-207 kernel: [60744.543901] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 22:16:10 juju-e4d256-prod-github-runner-207 kernel: [60744.544171] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 22:16:10 juju-e4d256-prod-github-runner-207 kernel: [60744.557619] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 22:16:10 juju-e4d256-prod-github-runner-207 kernel: [60744.558897] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 22:16:10 juju-e4d256-prod-github-runner-207 kernel: [60744.560128] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:16:10 juju-e4d256-prod-github-runner-207 kernel: [60744.561296] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 22:16:10 juju-e4d256-prod-github-runner-207 kernel: [60744.564390] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 22:16:10 juju-e4d256-prod-github-runner-207 kernel: [60744.565468] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 22:16:10 juju-e4d256-prod-github-runner-207 kernel: [60744.566785] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 22:16:10 juju-e4d256-prod-github-runner-207 kernel: [60744.568024] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 22:16:10 juju-e4d256-prod-github-runner-207 kernel: [60744.569607] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 22:16:10 juju-e4d256-prod-github-runner-207 kernel: [60744.570872] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 22:16:10 juju-e4d256-prod-github-runner-207 kernel: [60744.572085] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 22:16:10 juju-e4d256-prod-github-runner-207 kernel: [60744.573351] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 22:16:10 juju-e4d256-prod-github-runner-207 kernel: [60744.574516] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 22:16:10 juju-e4d256-prod-github-runner-207 kernel: [60744.575917] Call Trace: Aug 22 22:16:10 juju-e4d256-prod-github-runner-207 kernel: [60744.576867] Aug 22 22:16:10 juju-e4d256-prod-github-runner-207 kernel: [60744.577772] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:16:10 juju-e4d256-prod-github-runner-207 kernel: [60744.578842] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:16:10 juju-e4d256-prod-github-runner-207 kernel: [60744.579931] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:16:10 juju-e4d256-prod-github-runner-207 kernel: [60744.581226] ? show_regs.part.0+0x23/0x29 Aug 22 22:16:10 juju-e4d256-prod-github-runner-207 kernel: [60744.582404] ? show_regs.cold+0x8/0xd Aug 22 22:16:10 juju-e4d256-prod-github-runner-207 kernel: [60744.583397] ? watchdog_timer_fn+0x1be/0x220 Aug 22 22:16:10 juju-e4d256-prod-github-runner-207 kernel: [60744.584418] ? lockup_detector_update_enable+0x60/0x60 Aug 22 22:16:10 juju-e4d256-prod-github-runner-207 kernel: [60744.585560] ? __hrtimer_run_queues+0x107/0x230 Aug 22 22:16:10 juju-e4d256-prod-github-runner-207 kernel: [60744.586641] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 22:16:10 juju-e4d256-prod-github-runner-207 kernel: [60744.587760] ? hrtimer_interrupt+0x101/0x220 Aug 22 22:16:10 juju-e4d256-prod-github-runner-207 kernel: [60744.588959] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 22:16:10 juju-e4d256-prod-github-runner-207 kernel: [60744.590032] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 22:16:10 juju-e4d256-prod-github-runner-207 kernel: [60744.591082] Aug 22 22:16:10 juju-e4d256-prod-github-runner-207 kernel: [60744.591969] Aug 22 22:16:10 juju-e4d256-prod-github-runner-207 kernel: [60744.592908] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 22:16:10 juju-e4d256-prod-github-runner-207 kernel: [60744.594164] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:16:10 juju-e4d256-prod-github-runner-207 kernel: [60744.595375] ? _raw_spin_lock+0x22/0x30 Aug 22 22:16:10 juju-e4d256-prod-github-runner-207 kernel: [60744.596337] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:16:10 juju-e4d256-prod-github-runner-207 kernel: [60744.597387] direct_page_fault+0x206/0x310 [kvm] Aug 22 22:16:10 juju-e4d256-prod-github-runner-207 kernel: [60744.598487] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 22:16:10 juju-e4d256-prod-github-runner-207 kernel: [60744.599604] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 22:16:10 juju-e4d256-prod-github-runner-207 kernel: [60744.600743] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 22:16:10 juju-e4d256-prod-github-runner-207 kernel: [60744.601966] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 22:16:10 juju-e4d256-prod-github-runner-207 kernel: [60744.602963] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 22:16:10 juju-e4d256-prod-github-runner-207 kernel: [60744.604074] handle_exit+0x98/0x230 [kvm_amd] Aug 22 22:16:10 juju-e4d256-prod-github-runner-207 kernel: [60744.605056] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 22:16:10 juju-e4d256-prod-github-runner-207 kernel: [60744.606017] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 22:16:10 juju-e4d256-prod-github-runner-207 kernel: [60744.606974] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 22:16:10 juju-e4d256-prod-github-runner-207 kernel: [60744.607951] vcpu_run+0x62/0x2c0 [kvm] Aug 22 22:16:10 juju-e4d256-prod-github-runner-207 kernel: [60744.608976] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 22:16:10 juju-e4d256-prod-github-runner-207 kernel: [60744.609875] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 22:16:10 juju-e4d256-prod-github-runner-207 kernel: [60744.610846] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 22:16:10 juju-e4d256-prod-github-runner-207 kernel: [60744.611709] ? __seccomp_filter+0x4a/0x4a0 Aug 22 22:16:10 juju-e4d256-prod-github-runner-207 kernel: [60744.612540] ? __fget_files+0x86/0xc0 Aug 22 22:16:10 juju-e4d256-prod-github-runner-207 kernel: [60744.613270] __x64_sys_ioctl+0x95/0xd0 Aug 22 22:16:10 juju-e4d256-prod-github-runner-207 kernel: [60744.613975] do_syscall_64+0x5c/0xc0 Aug 22 22:16:10 juju-e4d256-prod-github-runner-207 kernel: [60744.614916] ? do_futex+0x162/0x1f0 Aug 22 22:16:10 juju-e4d256-prod-github-runner-207 kernel: [60744.615607] ? __x64_sys_futex+0x78/0x1e0 Aug 22 22:16:10 juju-e4d256-prod-github-runner-207 kernel: [60744.616438] ? __secure_computing+0xa9/0x120 Aug 22 22:16:10 juju-e4d256-prod-github-runner-207 kernel: [60744.617317] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 22:16:10 juju-e4d256-prod-github-runner-207 kernel: [60744.618183] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:16:10 juju-e4d256-prod-github-runner-207 kernel: [60744.619007] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:16:10 juju-e4d256-prod-github-runner-207 kernel: [60744.619803] ? do_syscall_64+0x69/0xc0 Aug 22 22:16:10 juju-e4d256-prod-github-runner-207 kernel: [60744.620455] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:16:10 juju-e4d256-prod-github-runner-207 kernel: [60744.621209] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:16:10 juju-e4d256-prod-github-runner-207 kernel: [60744.622064] ? do_syscall_64+0x69/0xc0 Aug 22 22:16:10 juju-e4d256-prod-github-runner-207 kernel: [60744.622731] ? do_syscall_64+0x69/0xc0 Aug 22 22:16:10 juju-e4d256-prod-github-runner-207 kernel: [60744.623402] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 22:16:10 juju-e4d256-prod-github-runner-207 kernel: [60744.624149] RIP: 0033:0x7faa5d0edaff Aug 22 22:16:10 juju-e4d256-prod-github-runner-207 kernel: [60744.624860] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 22:16:10 juju-e4d256-prod-github-runner-207 kernel: [60744.626879] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 22:16:10 juju-e4d256-prod-github-runner-207 kernel: [60744.627805] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 22:16:10 juju-e4d256-prod-github-runner-207 kernel: [60744.628730] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 22:16:10 juju-e4d256-prod-github-runner-207 kernel: [60744.629656] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 22:16:10 juju-e4d256-prod-github-runner-207 kernel: [60744.630565] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 22:16:10 juju-e4d256-prod-github-runner-207 kernel: [60744.631483] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 22:16:10 juju-e4d256-prod-github-runner-207 kernel: [60744.632405] Aug 22 22:16:38 juju-e4d256-prod-github-runner-207 kernel: [60772.541980] watchdog: BUG: soft lockup - CPU#1 stuck for 56490s! [qemu-system-x86:6715] Aug 22 22:16:38 juju-e4d256-prod-github-runner-207 kernel: [60772.543134] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 22:16:38 juju-e4d256-prod-github-runner-207 kernel: [60772.543212] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 22:16:38 juju-e4d256-prod-github-runner-207 kernel: [60772.556087] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 22:16:38 juju-e4d256-prod-github-runner-207 kernel: [60772.557446] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 22:16:38 juju-e4d256-prod-github-runner-207 kernel: [60772.558732] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:16:38 juju-e4d256-prod-github-runner-207 kernel: [60772.559826] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 22:16:38 juju-e4d256-prod-github-runner-207 kernel: [60772.562554] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 22:16:38 juju-e4d256-prod-github-runner-207 kernel: [60772.563618] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 22:16:38 juju-e4d256-prod-github-runner-207 kernel: [60772.564860] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 22:16:38 juju-e4d256-prod-github-runner-207 kernel: [60772.566089] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 22:16:38 juju-e4d256-prod-github-runner-207 kernel: [60772.567322] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 22:16:38 juju-e4d256-prod-github-runner-207 kernel: [60772.568531] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 22:16:38 juju-e4d256-prod-github-runner-207 kernel: [60772.569727] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 22:16:38 juju-e4d256-prod-github-runner-207 kernel: [60772.570988] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 22:16:38 juju-e4d256-prod-github-runner-207 kernel: [60772.572114] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 22:16:38 juju-e4d256-prod-github-runner-207 kernel: [60772.573336] Call Trace: Aug 22 22:16:38 juju-e4d256-prod-github-runner-207 kernel: [60772.574255] Aug 22 22:16:38 juju-e4d256-prod-github-runner-207 kernel: [60772.575151] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:16:38 juju-e4d256-prod-github-runner-207 kernel: [60772.576217] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:16:38 juju-e4d256-prod-github-runner-207 kernel: [60772.577254] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:16:38 juju-e4d256-prod-github-runner-207 kernel: [60772.578351] ? show_regs.part.0+0x23/0x29 Aug 22 22:16:38 juju-e4d256-prod-github-runner-207 kernel: [60772.579361] ? show_regs.cold+0x8/0xd Aug 22 22:16:38 juju-e4d256-prod-github-runner-207 kernel: [60772.580359] ? watchdog_timer_fn+0x1be/0x220 Aug 22 22:16:38 juju-e4d256-prod-github-runner-207 kernel: [60772.581382] ? lockup_detector_update_enable+0x60/0x60 Aug 22 22:16:38 juju-e4d256-prod-github-runner-207 kernel: [60772.582465] ? __hrtimer_run_queues+0x107/0x230 Aug 22 22:16:38 juju-e4d256-prod-github-runner-207 kernel: [60772.583509] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 22:16:38 juju-e4d256-prod-github-runner-207 kernel: [60772.584568] ? hrtimer_interrupt+0x101/0x220 Aug 22 22:16:38 juju-e4d256-prod-github-runner-207 kernel: [60772.585605] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 22:16:38 juju-e4d256-prod-github-runner-207 kernel: [60772.586691] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 22:16:38 juju-e4d256-prod-github-runner-207 kernel: [60772.587752] Aug 22 22:16:38 juju-e4d256-prod-github-runner-207 kernel: [60772.588628] Aug 22 22:16:38 juju-e4d256-prod-github-runner-207 kernel: [60772.589476] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 22:16:38 juju-e4d256-prod-github-runner-207 kernel: [60772.590529] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:16:38 juju-e4d256-prod-github-runner-207 kernel: [60772.591587] ? _raw_spin_lock+0x22/0x30 Aug 22 22:16:38 juju-e4d256-prod-github-runner-207 kernel: [60772.592557] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:16:38 juju-e4d256-prod-github-runner-207 kernel: [60772.593591] direct_page_fault+0x206/0x310 [kvm] Aug 22 22:16:38 juju-e4d256-prod-github-runner-207 kernel: [60772.594639] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 22:16:38 juju-e4d256-prod-github-runner-207 kernel: [60772.595664] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 22:16:38 juju-e4d256-prod-github-runner-207 kernel: [60772.596772] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 22:16:38 juju-e4d256-prod-github-runner-207 kernel: [60772.597771] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 22:16:38 juju-e4d256-prod-github-runner-207 kernel: [60772.598734] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 22:16:38 juju-e4d256-prod-github-runner-207 kernel: [60772.599731] handle_exit+0x98/0x230 [kvm_amd] Aug 22 22:16:38 juju-e4d256-prod-github-runner-207 kernel: [60772.600652] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 22:16:38 juju-e4d256-prod-github-runner-207 kernel: [60772.601580] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 22:16:38 juju-e4d256-prod-github-runner-207 kernel: [60772.602521] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 22:16:38 juju-e4d256-prod-github-runner-207 kernel: [60772.603443] vcpu_run+0x62/0x2c0 [kvm] Aug 22 22:16:38 juju-e4d256-prod-github-runner-207 kernel: [60772.604283] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 22:16:38 juju-e4d256-prod-github-runner-207 kernel: [60772.605115] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 22:16:38 juju-e4d256-prod-github-runner-207 kernel: [60772.605988] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 22:16:38 juju-e4d256-prod-github-runner-207 kernel: [60772.606798] ? __seccomp_filter+0x4a/0x4a0 Aug 22 22:16:38 juju-e4d256-prod-github-runner-207 kernel: [60772.607554] ? __fget_files+0x86/0xc0 Aug 22 22:16:38 juju-e4d256-prod-github-runner-207 kernel: [60772.608318] __x64_sys_ioctl+0x95/0xd0 Aug 22 22:16:38 juju-e4d256-prod-github-runner-207 kernel: [60772.609030] do_syscall_64+0x5c/0xc0 Aug 22 22:16:38 juju-e4d256-prod-github-runner-207 kernel: [60772.609707] ? do_futex+0x162/0x1f0 Aug 22 22:16:38 juju-e4d256-prod-github-runner-207 kernel: [60772.610374] ? __x64_sys_futex+0x78/0x1e0 Aug 22 22:16:38 juju-e4d256-prod-github-runner-207 kernel: [60772.611060] ? __secure_computing+0xa9/0x120 Aug 22 22:16:38 juju-e4d256-prod-github-runner-207 kernel: [60772.611762] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 22:16:38 juju-e4d256-prod-github-runner-207 kernel: [60772.612544] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:16:38 juju-e4d256-prod-github-runner-207 kernel: [60772.613290] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:16:38 juju-e4d256-prod-github-runner-207 kernel: [60772.614025] ? do_syscall_64+0x69/0xc0 Aug 22 22:16:38 juju-e4d256-prod-github-runner-207 kernel: [60772.614692] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:16:38 juju-e4d256-prod-github-runner-207 kernel: [60772.615411] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:16:38 juju-e4d256-prod-github-runner-207 kernel: [60772.616196] ? do_syscall_64+0x69/0xc0 Aug 22 22:16:38 juju-e4d256-prod-github-runner-207 kernel: [60772.616838] ? do_syscall_64+0x69/0xc0 Aug 22 22:16:38 juju-e4d256-prod-github-runner-207 kernel: [60772.617475] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 22:16:38 juju-e4d256-prod-github-runner-207 kernel: [60772.618197] RIP: 0033:0x7faa5d0edaff Aug 22 22:16:38 juju-e4d256-prod-github-runner-207 kernel: [60772.618835] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 22:16:38 juju-e4d256-prod-github-runner-207 kernel: [60772.620902] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 22:16:38 juju-e4d256-prod-github-runner-207 kernel: [60772.621841] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 22:16:38 juju-e4d256-prod-github-runner-207 kernel: [60772.622756] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 22:16:38 juju-e4d256-prod-github-runner-207 kernel: [60772.623670] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 22:16:38 juju-e4d256-prod-github-runner-207 kernel: [60772.624591] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 22:16:38 juju-e4d256-prod-github-runner-207 kernel: [60772.625511] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 22:16:38 juju-e4d256-prod-github-runner-207 kernel: [60772.626432] Aug 22 22:17:06 juju-e4d256-prod-github-runner-207 kernel: [60800.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 56516s! [qemu-system-x86:6715] Aug 22 22:17:06 juju-e4d256-prod-github-runner-207 kernel: [60800.543157] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 22:17:06 juju-e4d256-prod-github-runner-207 kernel: [60800.543232] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 22:17:06 juju-e4d256-prod-github-runner-207 kernel: [60800.555338] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 22:17:06 juju-e4d256-prod-github-runner-207 kernel: [60800.556643] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 22:17:06 juju-e4d256-prod-github-runner-207 kernel: [60800.557866] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:17:06 juju-e4d256-prod-github-runner-207 kernel: [60800.558922] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 22:17:06 juju-e4d256-prod-github-runner-207 kernel: [60800.561471] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 22:17:06 juju-e4d256-prod-github-runner-207 kernel: [60800.562518] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 22:17:06 juju-e4d256-prod-github-runner-207 kernel: [60800.563679] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 22:17:06 juju-e4d256-prod-github-runner-207 kernel: [60800.565015] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 22:17:06 juju-e4d256-prod-github-runner-207 kernel: [60800.566173] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 22:17:06 juju-e4d256-prod-github-runner-207 kernel: [60800.567338] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 22:17:06 juju-e4d256-prod-github-runner-207 kernel: [60800.568672] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 22:17:06 juju-e4d256-prod-github-runner-207 kernel: [60800.569909] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 22:17:06 juju-e4d256-prod-github-runner-207 kernel: [60800.571008] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 22:17:06 juju-e4d256-prod-github-runner-207 kernel: [60800.572221] Call Trace: Aug 22 22:17:06 juju-e4d256-prod-github-runner-207 kernel: [60800.573140] Aug 22 22:17:06 juju-e4d256-prod-github-runner-207 kernel: [60800.574029] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:17:06 juju-e4d256-prod-github-runner-207 kernel: [60800.575271] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:17:06 juju-e4d256-prod-github-runner-207 kernel: [60800.576472] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:17:06 juju-e4d256-prod-github-runner-207 kernel: [60800.577569] ? show_regs.part.0+0x23/0x29 Aug 22 22:17:06 juju-e4d256-prod-github-runner-207 kernel: [60800.578573] ? show_regs.cold+0x8/0xd Aug 22 22:17:06 juju-e4d256-prod-github-runner-207 kernel: [60800.579543] ? watchdog_timer_fn+0x1be/0x220 Aug 22 22:17:06 juju-e4d256-prod-github-runner-207 kernel: [60800.580566] ? lockup_detector_update_enable+0x60/0x60 Aug 22 22:17:06 juju-e4d256-prod-github-runner-207 kernel: [60800.581630] ? __hrtimer_run_queues+0x107/0x230 Aug 22 22:17:06 juju-e4d256-prod-github-runner-207 kernel: [60800.582655] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 22:17:06 juju-e4d256-prod-github-runner-207 kernel: [60800.583713] ? hrtimer_interrupt+0x101/0x220 Aug 22 22:17:06 juju-e4d256-prod-github-runner-207 kernel: [60800.584768] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 22:17:06 juju-e4d256-prod-github-runner-207 kernel: [60800.585838] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 22:17:06 juju-e4d256-prod-github-runner-207 kernel: [60800.586882] Aug 22 22:17:06 juju-e4d256-prod-github-runner-207 kernel: [60800.587748] Aug 22 22:17:06 juju-e4d256-prod-github-runner-207 kernel: [60800.588614] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 22:17:06 juju-e4d256-prod-github-runner-207 kernel: [60800.589702] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:17:06 juju-e4d256-prod-github-runner-207 kernel: [60800.590754] ? _raw_spin_lock+0x22/0x30 Aug 22 22:17:06 juju-e4d256-prod-github-runner-207 kernel: [60800.591703] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:17:06 juju-e4d256-prod-github-runner-207 kernel: [60800.592778] direct_page_fault+0x206/0x310 [kvm] Aug 22 22:17:06 juju-e4d256-prod-github-runner-207 kernel: [60800.593846] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 22:17:06 juju-e4d256-prod-github-runner-207 kernel: [60800.594938] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 22:17:06 juju-e4d256-prod-github-runner-207 kernel: [60800.596022] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 22:17:06 juju-e4d256-prod-github-runner-207 kernel: [60800.597041] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 22:17:06 juju-e4d256-prod-github-runner-207 kernel: [60800.598049] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 22:17:06 juju-e4d256-prod-github-runner-207 kernel: [60800.599077] handle_exit+0x98/0x230 [kvm_amd] Aug 22 22:17:06 juju-e4d256-prod-github-runner-207 kernel: [60800.600068] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 22:17:06 juju-e4d256-prod-github-runner-207 kernel: [60800.601034] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 22:17:06 juju-e4d256-prod-github-runner-207 kernel: [60800.601985] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 22:17:06 juju-e4d256-prod-github-runner-207 kernel: [60800.602997] vcpu_run+0x62/0x2c0 [kvm] Aug 22 22:17:06 juju-e4d256-prod-github-runner-207 kernel: [60800.603838] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 22:17:06 juju-e4d256-prod-github-runner-207 kernel: [60800.604650] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 22:17:06 juju-e4d256-prod-github-runner-207 kernel: [60800.605507] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 22:17:06 juju-e4d256-prod-github-runner-207 kernel: [60800.606307] ? __seccomp_filter+0x4a/0x4a0 Aug 22 22:17:06 juju-e4d256-prod-github-runner-207 kernel: [60800.607052] ? __fget_files+0x86/0xc0 Aug 22 22:17:06 juju-e4d256-prod-github-runner-207 kernel: [60800.607757] __x64_sys_ioctl+0x95/0xd0 Aug 22 22:17:06 juju-e4d256-prod-github-runner-207 kernel: [60800.608469] do_syscall_64+0x5c/0xc0 Aug 22 22:17:06 juju-e4d256-prod-github-runner-207 kernel: [60800.609138] ? do_futex+0x162/0x1f0 Aug 22 22:17:06 juju-e4d256-prod-github-runner-207 kernel: [60800.609803] ? __x64_sys_futex+0x78/0x1e0 Aug 22 22:17:06 juju-e4d256-prod-github-runner-207 kernel: [60800.610529] ? __secure_computing+0xa9/0x120 Aug 22 22:17:06 juju-e4d256-prod-github-runner-207 kernel: [60800.611221] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 22:17:06 juju-e4d256-prod-github-runner-207 kernel: [60800.611994] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:17:06 juju-e4d256-prod-github-runner-207 kernel: [60800.612718] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:17:06 juju-e4d256-prod-github-runner-207 kernel: [60800.613438] ? do_syscall_64+0x69/0xc0 Aug 22 22:17:06 juju-e4d256-prod-github-runner-207 kernel: [60800.614107] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:17:06 juju-e4d256-prod-github-runner-207 kernel: [60800.614826] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:17:06 juju-e4d256-prod-github-runner-207 kernel: [60800.615526] ? do_syscall_64+0x69/0xc0 Aug 22 22:17:06 juju-e4d256-prod-github-runner-207 kernel: [60800.616166] ? do_syscall_64+0x69/0xc0 Aug 22 22:17:06 juju-e4d256-prod-github-runner-207 kernel: [60800.616797] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 22:17:06 juju-e4d256-prod-github-runner-207 kernel: [60800.617506] RIP: 0033:0x7faa5d0edaff Aug 22 22:17:06 juju-e4d256-prod-github-runner-207 kernel: [60800.618133] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 22:17:06 juju-e4d256-prod-github-runner-207 kernel: [60800.620157] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 22:17:06 juju-e4d256-prod-github-runner-207 kernel: [60800.621071] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 22:17:06 juju-e4d256-prod-github-runner-207 kernel: [60800.621964] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 22:17:06 juju-e4d256-prod-github-runner-207 kernel: [60800.622855] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 22:17:06 juju-e4d256-prod-github-runner-207 kernel: [60800.623748] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 22:17:06 juju-e4d256-prod-github-runner-207 kernel: [60800.624647] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 22:17:06 juju-e4d256-prod-github-runner-207 kernel: [60800.625547] Aug 22 22:17:34 juju-e4d256-prod-github-runner-207 kernel: [60828.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 56542s! [qemu-system-x86:6715] Aug 22 22:17:34 juju-e4d256-prod-github-runner-207 kernel: [60828.543985] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 22:17:34 juju-e4d256-prod-github-runner-207 kernel: [60828.544321] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 22:17:34 juju-e4d256-prod-github-runner-207 kernel: [60828.557154] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 22:17:34 juju-e4d256-prod-github-runner-207 kernel: [60828.558418] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 22:17:34 juju-e4d256-prod-github-runner-207 kernel: [60828.559670] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:17:34 juju-e4d256-prod-github-runner-207 kernel: [60828.560771] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 22:17:34 juju-e4d256-prod-github-runner-207 kernel: [60828.563306] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 22:17:34 juju-e4d256-prod-github-runner-207 kernel: [60828.564371] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 22:17:34 juju-e4d256-prod-github-runner-207 kernel: [60828.565530] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 22:17:34 juju-e4d256-prod-github-runner-207 kernel: [60828.566687] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 22:17:34 juju-e4d256-prod-github-runner-207 kernel: [60828.567856] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 22:17:34 juju-e4d256-prod-github-runner-207 kernel: [60828.569010] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 22:17:34 juju-e4d256-prod-github-runner-207 kernel: [60828.570170] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 22:17:34 juju-e4d256-prod-github-runner-207 kernel: [60828.571396] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 22:17:34 juju-e4d256-prod-github-runner-207 kernel: [60828.572503] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 22:17:34 juju-e4d256-prod-github-runner-207 kernel: [60828.573691] Call Trace: Aug 22 22:17:34 juju-e4d256-prod-github-runner-207 kernel: [60828.574599] Aug 22 22:17:34 juju-e4d256-prod-github-runner-207 kernel: [60828.575510] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:17:34 juju-e4d256-prod-github-runner-207 kernel: [60828.576534] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:17:34 juju-e4d256-prod-github-runner-207 kernel: [60828.577553] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:17:34 juju-e4d256-prod-github-runner-207 kernel: [60828.578643] ? show_regs.part.0+0x23/0x29 Aug 22 22:17:34 juju-e4d256-prod-github-runner-207 kernel: [60828.579651] ? show_regs.cold+0x8/0xd Aug 22 22:17:34 juju-e4d256-prod-github-runner-207 kernel: [60828.580625] ? watchdog_timer_fn+0x1be/0x220 Aug 22 22:17:34 juju-e4d256-prod-github-runner-207 kernel: [60828.581630] ? lockup_detector_update_enable+0x60/0x60 Aug 22 22:17:34 juju-e4d256-prod-github-runner-207 kernel: [60828.582689] ? __hrtimer_run_queues+0x107/0x230 Aug 22 22:17:34 juju-e4d256-prod-github-runner-207 kernel: [60828.583727] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 22:17:34 juju-e4d256-prod-github-runner-207 kernel: [60828.584755] ? hrtimer_interrupt+0x101/0x220 Aug 22 22:17:34 juju-e4d256-prod-github-runner-207 kernel: [60828.585775] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 22:17:34 juju-e4d256-prod-github-runner-207 kernel: [60828.586844] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 22:17:34 juju-e4d256-prod-github-runner-207 kernel: [60828.587902] Aug 22 22:17:34 juju-e4d256-prod-github-runner-207 kernel: [60828.588753] Aug 22 22:17:34 juju-e4d256-prod-github-runner-207 kernel: [60828.589588] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 22:17:34 juju-e4d256-prod-github-runner-207 kernel: [60828.590622] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:17:34 juju-e4d256-prod-github-runner-207 kernel: [60828.591685] ? _raw_spin_lock+0x22/0x30 Aug 22 22:17:34 juju-e4d256-prod-github-runner-207 kernel: [60828.592634] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:17:34 juju-e4d256-prod-github-runner-207 kernel: [60828.593647] direct_page_fault+0x206/0x310 [kvm] Aug 22 22:17:34 juju-e4d256-prod-github-runner-207 kernel: [60828.594667] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 22:17:34 juju-e4d256-prod-github-runner-207 kernel: [60828.595689] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 22:17:34 juju-e4d256-prod-github-runner-207 kernel: [60828.596689] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 22:17:34 juju-e4d256-prod-github-runner-207 kernel: [60828.597705] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 22:17:34 juju-e4d256-prod-github-runner-207 kernel: [60828.598654] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 22:17:34 juju-e4d256-prod-github-runner-207 kernel: [60828.599650] handle_exit+0x98/0x230 [kvm_amd] Aug 22 22:17:34 juju-e4d256-prod-github-runner-207 kernel: [60828.600540] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 22:17:34 juju-e4d256-prod-github-runner-207 kernel: [60828.601485] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 22:17:34 juju-e4d256-prod-github-runner-207 kernel: [60828.602410] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 22:17:34 juju-e4d256-prod-github-runner-207 kernel: [60828.603332] vcpu_run+0x62/0x2c0 [kvm] Aug 22 22:17:34 juju-e4d256-prod-github-runner-207 kernel: [60828.604160] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 22:17:34 juju-e4d256-prod-github-runner-207 kernel: [60828.604968] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 22:17:34 juju-e4d256-prod-github-runner-207 kernel: [60828.605832] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 22:17:34 juju-e4d256-prod-github-runner-207 kernel: [60828.606662] ? __seccomp_filter+0x4a/0x4a0 Aug 22 22:17:34 juju-e4d256-prod-github-runner-207 kernel: [60828.607567] ? __fget_files+0x86/0xc0 Aug 22 22:17:34 juju-e4d256-prod-github-runner-207 kernel: [60828.608304] __x64_sys_ioctl+0x95/0xd0 Aug 22 22:17:34 juju-e4d256-prod-github-runner-207 kernel: [60828.609001] do_syscall_64+0x5c/0xc0 Aug 22 22:17:34 juju-e4d256-prod-github-runner-207 kernel: [60828.609663] ? do_futex+0x162/0x1f0 Aug 22 22:17:34 juju-e4d256-prod-github-runner-207 kernel: [60828.610309] ? __x64_sys_futex+0x78/0x1e0 Aug 22 22:17:34 juju-e4d256-prod-github-runner-207 kernel: [60828.610980] ? __secure_computing+0xa9/0x120 Aug 22 22:17:34 juju-e4d256-prod-github-runner-207 kernel: [60828.611685] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 22:17:34 juju-e4d256-prod-github-runner-207 kernel: [60828.612444] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:17:34 juju-e4d256-prod-github-runner-207 kernel: [60828.613166] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:17:34 juju-e4d256-prod-github-runner-207 kernel: [60828.613882] ? do_syscall_64+0x69/0xc0 Aug 22 22:17:34 juju-e4d256-prod-github-runner-207 kernel: [60828.614526] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:17:34 juju-e4d256-prod-github-runner-207 kernel: [60828.615230] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:17:34 juju-e4d256-prod-github-runner-207 kernel: [60828.615951] ? do_syscall_64+0x69/0xc0 Aug 22 22:17:34 juju-e4d256-prod-github-runner-207 kernel: [60828.616576] ? do_syscall_64+0x69/0xc0 Aug 22 22:17:34 juju-e4d256-prod-github-runner-207 kernel: [60828.617206] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 22:17:34 juju-e4d256-prod-github-runner-207 kernel: [60828.618060] RIP: 0033:0x7faa5d0edaff Aug 22 22:17:34 juju-e4d256-prod-github-runner-207 kernel: [60828.618730] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 22:17:34 juju-e4d256-prod-github-runner-207 kernel: [60828.620723] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 22:17:34 juju-e4d256-prod-github-runner-207 kernel: [60828.621637] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 22:17:34 juju-e4d256-prod-github-runner-207 kernel: [60828.622527] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 22:17:34 juju-e4d256-prod-github-runner-207 kernel: [60828.623420] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 22:17:34 juju-e4d256-prod-github-runner-207 kernel: [60828.624337] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 22:17:34 juju-e4d256-prod-github-runner-207 kernel: [60828.625234] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 22:17:34 juju-e4d256-prod-github-runner-207 kernel: [60828.626124] Aug 22 22:17:47 juju-e4d256-prod-github-runner-207 kernel: [60841.244709] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 22:17:47 juju-e4d256-prod-github-runner-207 kernel: [60841.246651] rcu: 1-....: (15133183 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=7310513 Aug 22 22:17:47 juju-e4d256-prod-github-runner-207 kernel: [60841.247853] (t=15181011 jiffies g=23269 q=54532) Aug 22 22:17:47 juju-e4d256-prod-github-runner-207 kernel: [60841.248651] NMI backtrace for cpu 1 Aug 22 22:17:47 juju-e4d256-prod-github-runner-207 kernel: [60841.249365] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 22:17:47 juju-e4d256-prod-github-runner-207 kernel: [60841.250491] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 22:17:47 juju-e4d256-prod-github-runner-207 kernel: [60841.251603] Call Trace: Aug 22 22:17:47 juju-e4d256-prod-github-runner-207 kernel: [60841.252291] Aug 22 22:17:47 juju-e4d256-prod-github-runner-207 kernel: [60841.252963] show_stack+0x52/0x5c Aug 22 22:17:47 juju-e4d256-prod-github-runner-207 kernel: [60841.253695] dump_stack_lvl+0x4a/0x63 Aug 22 22:17:47 juju-e4d256-prod-github-runner-207 kernel: [60841.254441] dump_stack+0x10/0x16 Aug 22 22:17:47 juju-e4d256-prod-github-runner-207 kernel: [60841.255174] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 22:17:47 juju-e4d256-prod-github-runner-207 kernel: [60841.255977] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 22:17:47 juju-e4d256-prod-github-runner-207 kernel: [60841.256775] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 22:17:47 juju-e4d256-prod-github-runner-207 kernel: [60841.257606] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 22:17:47 juju-e4d256-prod-github-runner-207 kernel: [60841.258448] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 22:17:47 juju-e4d256-prod-github-runner-207 kernel: [60841.259255] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 22:17:47 juju-e4d256-prod-github-runner-207 kernel: [60841.260053] print_cpu_stall.cold+0x2f/0xe2 Aug 22 22:17:47 juju-e4d256-prod-github-runner-207 kernel: [60841.260829] ? timekeeping_update+0xf7/0x150 Aug 22 22:17:47 juju-e4d256-prod-github-runner-207 kernel: [60841.261603] check_cpu_stall+0x109/0x270 Aug 22 22:17:47 juju-e4d256-prod-github-runner-207 kernel: [60841.262368] rcu_sched_clock_irq+0x9a/0x250 Aug 22 22:17:47 juju-e4d256-prod-github-runner-207 kernel: [60841.263143] update_process_times+0x94/0xd0 Aug 22 22:17:47 juju-e4d256-prod-github-runner-207 kernel: [60841.263934] tick_sched_handle+0x29/0x70 Aug 22 22:17:47 juju-e4d256-prod-github-runner-207 kernel: [60841.264681] tick_sched_timer+0x8c/0xc0 Aug 22 22:17:47 juju-e4d256-prod-github-runner-207 kernel: [60841.265422] ? tick_nohz_handler+0xb0/0xb0 Aug 22 22:17:47 juju-e4d256-prod-github-runner-207 kernel: [60841.266180] __hrtimer_run_queues+0x107/0x230 Aug 22 22:17:47 juju-e4d256-prod-github-runner-207 kernel: [60841.266966] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 22:17:47 juju-e4d256-prod-github-runner-207 kernel: [60841.267775] hrtimer_interrupt+0x101/0x220 Aug 22 22:17:47 juju-e4d256-prod-github-runner-207 kernel: [60841.268545] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 22:17:47 juju-e4d256-prod-github-runner-207 kernel: [60841.269476] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 22:17:47 juju-e4d256-prod-github-runner-207 kernel: [60841.270285] Aug 22 22:17:47 juju-e4d256-prod-github-runner-207 kernel: [60841.270926] Aug 22 22:17:47 juju-e4d256-prod-github-runner-207 kernel: [60841.271583] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 22:17:47 juju-e4d256-prod-github-runner-207 kernel: [60841.272420] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:17:47 juju-e4d256-prod-github-runner-207 kernel: [60841.273324] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 22:17:47 juju-e4d256-prod-github-runner-207 kernel: [60841.275577] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 22:17:47 juju-e4d256-prod-github-runner-207 kernel: [60841.276462] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 22:17:47 juju-e4d256-prod-github-runner-207 kernel: [60841.277483] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 22:17:47 juju-e4d256-prod-github-runner-207 kernel: [60841.278478] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 22:17:47 juju-e4d256-prod-github-runner-207 kernel: [60841.279462] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 22:17:47 juju-e4d256-prod-github-runner-207 kernel: [60841.280431] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 22:17:47 juju-e4d256-prod-github-runner-207 kernel: [60841.281414] ? _raw_spin_lock+0x22/0x30 Aug 22 22:17:47 juju-e4d256-prod-github-runner-207 kernel: [60841.282189] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:17:47 juju-e4d256-prod-github-runner-207 kernel: [60841.283067] direct_page_fault+0x206/0x310 [kvm] Aug 22 22:17:47 juju-e4d256-prod-github-runner-207 kernel: [60841.283956] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 22:17:47 juju-e4d256-prod-github-runner-207 kernel: [60841.284789] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 22:17:47 juju-e4d256-prod-github-runner-207 kernel: [60841.285646] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 22:17:47 juju-e4d256-prod-github-runner-207 kernel: [60841.286488] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 22:17:47 juju-e4d256-prod-github-runner-207 kernel: [60841.287278] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 22:17:47 juju-e4d256-prod-github-runner-207 kernel: [60841.288151] handle_exit+0x98/0x230 [kvm_amd] Aug 22 22:17:47 juju-e4d256-prod-github-runner-207 kernel: [60841.288943] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 22:17:47 juju-e4d256-prod-github-runner-207 kernel: [60841.289743] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 22:17:47 juju-e4d256-prod-github-runner-207 kernel: [60841.290541] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 22:17:47 juju-e4d256-prod-github-runner-207 kernel: [60841.291348] vcpu_run+0x62/0x2c0 [kvm] Aug 22 22:17:47 juju-e4d256-prod-github-runner-207 kernel: [60841.292071] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 22:17:47 juju-e4d256-prod-github-runner-207 kernel: [60841.292821] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 22:17:47 juju-e4d256-prod-github-runner-207 kernel: [60841.293631] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 22:17:47 juju-e4d256-prod-github-runner-207 kernel: [60841.294408] ? __seccomp_filter+0x4a/0x4a0 Aug 22 22:17:47 juju-e4d256-prod-github-runner-207 kernel: [60841.295129] ? __fget_files+0x86/0xc0 Aug 22 22:17:47 juju-e4d256-prod-github-runner-207 kernel: [60841.295845] __x64_sys_ioctl+0x95/0xd0 Aug 22 22:17:47 juju-e4d256-prod-github-runner-207 kernel: [60841.296547] do_syscall_64+0x5c/0xc0 Aug 22 22:17:47 juju-e4d256-prod-github-runner-207 kernel: [60841.297232] ? do_futex+0x162/0x1f0 Aug 22 22:17:47 juju-e4d256-prod-github-runner-207 kernel: [60841.297912] ? __x64_sys_futex+0x78/0x1e0 Aug 22 22:17:47 juju-e4d256-prod-github-runner-207 kernel: [60841.298621] ? __secure_computing+0xa9/0x120 Aug 22 22:17:47 juju-e4d256-prod-github-runner-207 kernel: [60841.299370] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 22:17:47 juju-e4d256-prod-github-runner-207 kernel: [60841.300177] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:17:47 juju-e4d256-prod-github-runner-207 kernel: [60841.300946] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:17:47 juju-e4d256-prod-github-runner-207 kernel: [60841.301705] ? do_syscall_64+0x69/0xc0 Aug 22 22:17:47 juju-e4d256-prod-github-runner-207 kernel: [60841.302403] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:17:47 juju-e4d256-prod-github-runner-207 kernel: [60841.303172] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:17:47 juju-e4d256-prod-github-runner-207 kernel: [60841.303959] ? do_syscall_64+0x69/0xc0 Aug 22 22:17:47 juju-e4d256-prod-github-runner-207 kernel: [60841.304662] ? do_syscall_64+0x69/0xc0 Aug 22 22:17:47 juju-e4d256-prod-github-runner-207 kernel: [60841.305354] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 22:17:47 juju-e4d256-prod-github-runner-207 kernel: [60841.306129] RIP: 0033:0x7faa5d0edaff Aug 22 22:17:47 juju-e4d256-prod-github-runner-207 kernel: [60841.306844] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 22:17:47 juju-e4d256-prod-github-runner-207 kernel: [60841.308976] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 22:17:47 juju-e4d256-prod-github-runner-207 kernel: [60841.309968] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 22:17:47 juju-e4d256-prod-github-runner-207 kernel: [60841.310920] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 22:17:47 juju-e4d256-prod-github-runner-207 kernel: [60841.311886] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 22:17:47 juju-e4d256-prod-github-runner-207 kernel: [60841.312841] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 22:17:47 juju-e4d256-prod-github-runner-207 kernel: [60841.313901] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 22:17:47 juju-e4d256-prod-github-runner-207 kernel: [60841.314947] Aug 22 22:18:14 juju-e4d256-prod-github-runner-207 kernel: [60868.541996] watchdog: BUG: soft lockup - CPU#1 stuck for 56580s! [qemu-system-x86:6715] Aug 22 22:18:14 juju-e4d256-prod-github-runner-207 kernel: [60868.544771] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 22:18:14 juju-e4d256-prod-github-runner-207 kernel: [60868.545120] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 22:18:14 juju-e4d256-prod-github-runner-207 kernel: [60868.561466] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 22:18:14 juju-e4d256-prod-github-runner-207 kernel: [60868.562847] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 22:18:14 juju-e4d256-prod-github-runner-207 kernel: [60868.564102] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:18:14 juju-e4d256-prod-github-runner-207 kernel: [60868.565163] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 22:18:14 juju-e4d256-prod-github-runner-207 kernel: [60868.567716] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 22:18:14 juju-e4d256-prod-github-runner-207 kernel: [60868.568763] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 22:18:14 juju-e4d256-prod-github-runner-207 kernel: [60868.569925] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 22:18:14 juju-e4d256-prod-github-runner-207 kernel: [60868.571099] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 22:18:14 juju-e4d256-prod-github-runner-207 kernel: [60868.572271] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 22:18:14 juju-e4d256-prod-github-runner-207 kernel: [60868.573440] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 22:18:14 juju-e4d256-prod-github-runner-207 kernel: [60868.574612] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 22:18:14 juju-e4d256-prod-github-runner-207 kernel: [60868.575858] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 22:18:14 juju-e4d256-prod-github-runner-207 kernel: [60868.576959] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 22:18:14 juju-e4d256-prod-github-runner-207 kernel: [60868.578159] Call Trace: Aug 22 22:18:14 juju-e4d256-prod-github-runner-207 kernel: [60868.579077] Aug 22 22:18:14 juju-e4d256-prod-github-runner-207 kernel: [60868.579983] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:18:14 juju-e4d256-prod-github-runner-207 kernel: [60868.581023] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:18:14 juju-e4d256-prod-github-runner-207 kernel: [60868.582046] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:18:14 juju-e4d256-prod-github-runner-207 kernel: [60868.583165] ? show_regs.part.0+0x23/0x29 Aug 22 22:18:14 juju-e4d256-prod-github-runner-207 kernel: [60868.584167] ? show_regs.cold+0x8/0xd Aug 22 22:18:14 juju-e4d256-prod-github-runner-207 kernel: [60868.585142] ? watchdog_timer_fn+0x1be/0x220 Aug 22 22:18:14 juju-e4d256-prod-github-runner-207 kernel: [60868.586149] ? lockup_detector_update_enable+0x60/0x60 Aug 22 22:18:14 juju-e4d256-prod-github-runner-207 kernel: [60868.587227] ? __hrtimer_run_queues+0x107/0x230 Aug 22 22:18:14 juju-e4d256-prod-github-runner-207 kernel: [60868.588253] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 22:18:14 juju-e4d256-prod-github-runner-207 kernel: [60868.589275] ? hrtimer_interrupt+0x101/0x220 Aug 22 22:18:14 juju-e4d256-prod-github-runner-207 kernel: [60868.590289] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 22:18:14 juju-e4d256-prod-github-runner-207 kernel: [60868.591394] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 22:18:14 juju-e4d256-prod-github-runner-207 kernel: [60868.592442] Aug 22 22:18:14 juju-e4d256-prod-github-runner-207 kernel: [60868.593295] Aug 22 22:18:14 juju-e4d256-prod-github-runner-207 kernel: [60868.594136] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 22:18:14 juju-e4d256-prod-github-runner-207 kernel: [60868.595178] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:18:14 juju-e4d256-prod-github-runner-207 kernel: [60868.596213] ? _raw_spin_lock+0x22/0x30 Aug 22 22:18:14 juju-e4d256-prod-github-runner-207 kernel: [60868.597162] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:18:14 juju-e4d256-prod-github-runner-207 kernel: [60868.598179] direct_page_fault+0x206/0x310 [kvm] Aug 22 22:18:14 juju-e4d256-prod-github-runner-207 kernel: [60868.599206] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 22:18:14 juju-e4d256-prod-github-runner-207 kernel: [60868.600212] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 22:18:14 juju-e4d256-prod-github-runner-207 kernel: [60868.601221] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 22:18:14 juju-e4d256-prod-github-runner-207 kernel: [60868.602236] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 22:18:14 juju-e4d256-prod-github-runner-207 kernel: [60868.603199] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 22:18:14 juju-e4d256-prod-github-runner-207 kernel: [60868.604180] handle_exit+0x98/0x230 [kvm_amd] Aug 22 22:18:14 juju-e4d256-prod-github-runner-207 kernel: [60868.605113] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 22:18:14 juju-e4d256-prod-github-runner-207 kernel: [60868.606049] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 22:18:14 juju-e4d256-prod-github-runner-207 kernel: [60868.606993] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 22:18:14 juju-e4d256-prod-github-runner-207 kernel: [60868.607901] vcpu_run+0x62/0x2c0 [kvm] Aug 22 22:18:14 juju-e4d256-prod-github-runner-207 kernel: [60868.608713] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 22:18:14 juju-e4d256-prod-github-runner-207 kernel: [60868.609527] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 22:18:14 juju-e4d256-prod-github-runner-207 kernel: [60868.610382] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 22:18:14 juju-e4d256-prod-github-runner-207 kernel: [60868.611192] ? __seccomp_filter+0x4a/0x4a0 Aug 22 22:18:14 juju-e4d256-prod-github-runner-207 kernel: [60868.611940] ? __fget_files+0x86/0xc0 Aug 22 22:18:14 juju-e4d256-prod-github-runner-207 kernel: [60868.612649] __x64_sys_ioctl+0x95/0xd0 Aug 22 22:18:14 juju-e4d256-prod-github-runner-207 kernel: [60868.613343] do_syscall_64+0x5c/0xc0 Aug 22 22:18:14 juju-e4d256-prod-github-runner-207 kernel: [60868.614015] ? do_futex+0x162/0x1f0 Aug 22 22:18:14 juju-e4d256-prod-github-runner-207 kernel: [60868.614666] ? __x64_sys_futex+0x78/0x1e0 Aug 22 22:18:14 juju-e4d256-prod-github-runner-207 kernel: [60868.615353] ? __secure_computing+0xa9/0x120 Aug 22 22:18:14 juju-e4d256-prod-github-runner-207 kernel: [60868.616050] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 22:18:14 juju-e4d256-prod-github-runner-207 kernel: [60868.616811] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:18:14 juju-e4d256-prod-github-runner-207 kernel: [60868.617535] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:18:14 juju-e4d256-prod-github-runner-207 kernel: [60868.618256] ? do_syscall_64+0x69/0xc0 Aug 22 22:18:14 juju-e4d256-prod-github-runner-207 kernel: [60868.618902] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:18:14 juju-e4d256-prod-github-runner-207 kernel: [60868.619621] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:18:14 juju-e4d256-prod-github-runner-207 kernel: [60868.620318] ? do_syscall_64+0x69/0xc0 Aug 22 22:18:14 juju-e4d256-prod-github-runner-207 kernel: [60868.620957] ? do_syscall_64+0x69/0xc0 Aug 22 22:18:14 juju-e4d256-prod-github-runner-207 kernel: [60868.621598] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 22:18:14 juju-e4d256-prod-github-runner-207 kernel: [60868.622314] RIP: 0033:0x7faa5d0edaff Aug 22 22:18:14 juju-e4d256-prod-github-runner-207 kernel: [60868.623002] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 22:18:14 juju-e4d256-prod-github-runner-207 kernel: [60868.625069] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 22:18:14 juju-e4d256-prod-github-runner-207 kernel: [60868.626746] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 22:18:14 juju-e4d256-prod-github-runner-207 kernel: [60868.627663] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 22:18:14 juju-e4d256-prod-github-runner-207 kernel: [60868.628562] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 22:18:14 juju-e4d256-prod-github-runner-207 kernel: [60868.629455] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 22:18:14 juju-e4d256-prod-github-runner-207 kernel: [60868.630353] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 22:18:14 juju-e4d256-prod-github-runner-207 kernel: [60868.631268] Aug 22 22:18:42 juju-e4d256-prod-github-runner-207 kernel: [60896.541982] watchdog: BUG: soft lockup - CPU#1 stuck for 56606s! [qemu-system-x86:6715] Aug 22 22:18:42 juju-e4d256-prod-github-runner-207 kernel: [60896.544164] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 22:18:42 juju-e4d256-prod-github-runner-207 kernel: [60896.544529] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 22:18:42 juju-e4d256-prod-github-runner-207 kernel: [60896.557110] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 22:18:42 juju-e4d256-prod-github-runner-207 kernel: [60896.558388] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 22:18:42 juju-e4d256-prod-github-runner-207 kernel: [60896.559637] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:18:42 juju-e4d256-prod-github-runner-207 kernel: [60896.560703] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 22:18:42 juju-e4d256-prod-github-runner-207 kernel: [60896.563304] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 22:18:42 juju-e4d256-prod-github-runner-207 kernel: [60896.564401] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 22:18:42 juju-e4d256-prod-github-runner-207 kernel: [60896.565587] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 22:18:42 juju-e4d256-prod-github-runner-207 kernel: [60896.566772] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 22:18:42 juju-e4d256-prod-github-runner-207 kernel: [60896.567957] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 22:18:42 juju-e4d256-prod-github-runner-207 kernel: [60896.569128] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 22:18:42 juju-e4d256-prod-github-runner-207 kernel: [60896.570310] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 22:18:42 juju-e4d256-prod-github-runner-207 kernel: [60896.571592] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 22:18:42 juju-e4d256-prod-github-runner-207 kernel: [60896.572712] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 22:18:42 juju-e4d256-prod-github-runner-207 kernel: [60896.573953] Call Trace: Aug 22 22:18:42 juju-e4d256-prod-github-runner-207 kernel: [60896.574911] Aug 22 22:18:42 juju-e4d256-prod-github-runner-207 kernel: [60896.575827] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:18:42 juju-e4d256-prod-github-runner-207 kernel: [60896.577017] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:18:42 juju-e4d256-prod-github-runner-207 kernel: [60896.578221] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:18:42 juju-e4d256-prod-github-runner-207 kernel: [60896.579508] ? show_regs.part.0+0x23/0x29 Aug 22 22:18:42 juju-e4d256-prod-github-runner-207 kernel: [60896.580601] ? show_regs.cold+0x8/0xd Aug 22 22:18:42 juju-e4d256-prod-github-runner-207 kernel: [60896.581658] ? watchdog_timer_fn+0x1be/0x220 Aug 22 22:18:42 juju-e4d256-prod-github-runner-207 kernel: [60896.582802] ? lockup_detector_update_enable+0x60/0x60 Aug 22 22:18:42 juju-e4d256-prod-github-runner-207 kernel: [60896.583972] ? __hrtimer_run_queues+0x107/0x230 Aug 22 22:18:42 juju-e4d256-prod-github-runner-207 kernel: [60896.585097] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 22:18:42 juju-e4d256-prod-github-runner-207 kernel: [60896.586219] ? hrtimer_interrupt+0x101/0x220 Aug 22 22:18:42 juju-e4d256-prod-github-runner-207 kernel: [60896.587345] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 22:18:42 juju-e4d256-prod-github-runner-207 kernel: [60896.588529] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 22:18:42 juju-e4d256-prod-github-runner-207 kernel: [60896.589615] Aug 22 22:18:42 juju-e4d256-prod-github-runner-207 kernel: [60896.590472] Aug 22 22:18:42 juju-e4d256-prod-github-runner-207 kernel: [60896.591337] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 22:18:42 juju-e4d256-prod-github-runner-207 kernel: [60896.592374] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:18:42 juju-e4d256-prod-github-runner-207 kernel: [60896.593413] ? _raw_spin_lock+0x22/0x30 Aug 22 22:18:42 juju-e4d256-prod-github-runner-207 kernel: [60896.594361] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:18:42 juju-e4d256-prod-github-runner-207 kernel: [60896.595415] direct_page_fault+0x206/0x310 [kvm] Aug 22 22:18:42 juju-e4d256-prod-github-runner-207 kernel: [60896.596441] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 22:18:42 juju-e4d256-prod-github-runner-207 kernel: [60896.597452] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 22:18:42 juju-e4d256-prod-github-runner-207 kernel: [60896.598458] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 22:18:42 juju-e4d256-prod-github-runner-207 kernel: [60896.599624] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 22:18:42 juju-e4d256-prod-github-runner-207 kernel: [60896.600673] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 22:18:42 juju-e4d256-prod-github-runner-207 kernel: [60896.601775] handle_exit+0x98/0x230 [kvm_amd] Aug 22 22:18:42 juju-e4d256-prod-github-runner-207 kernel: [60896.602785] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 22:18:42 juju-e4d256-prod-github-runner-207 kernel: [60896.603804] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 22:18:42 juju-e4d256-prod-github-runner-207 kernel: [60896.604851] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 22:18:42 juju-e4d256-prod-github-runner-207 kernel: [60896.605862] vcpu_run+0x62/0x2c0 [kvm] Aug 22 22:18:42 juju-e4d256-prod-github-runner-207 kernel: [60896.606776] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 22:18:42 juju-e4d256-prod-github-runner-207 kernel: [60896.607682] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 22:18:42 juju-e4d256-prod-github-runner-207 kernel: [60896.608642] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 22:18:42 juju-e4d256-prod-github-runner-207 kernel: [60896.609531] ? __seccomp_filter+0x4a/0x4a0 Aug 22 22:18:42 juju-e4d256-prod-github-runner-207 kernel: [60896.610360] ? __fget_files+0x86/0xc0 Aug 22 22:18:42 juju-e4d256-prod-github-runner-207 kernel: [60896.611160] __x64_sys_ioctl+0x95/0xd0 Aug 22 22:18:42 juju-e4d256-prod-github-runner-207 kernel: [60896.611933] do_syscall_64+0x5c/0xc0 Aug 22 22:18:42 juju-e4d256-prod-github-runner-207 kernel: [60896.612684] ? do_futex+0x162/0x1f0 Aug 22 22:18:42 juju-e4d256-prod-github-runner-207 kernel: [60896.613412] ? __x64_sys_futex+0x78/0x1e0 Aug 22 22:18:42 juju-e4d256-prod-github-runner-207 kernel: [60896.614173] ? __secure_computing+0xa9/0x120 Aug 22 22:18:42 juju-e4d256-prod-github-runner-207 kernel: [60896.614969] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 22:18:42 juju-e4d256-prod-github-runner-207 kernel: [60896.615836] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:18:42 juju-e4d256-prod-github-runner-207 kernel: [60896.616669] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:18:42 juju-e4d256-prod-github-runner-207 kernel: [60896.617491] ? do_syscall_64+0x69/0xc0 Aug 22 22:18:42 juju-e4d256-prod-github-runner-207 kernel: [60896.618245] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:18:42 juju-e4d256-prod-github-runner-207 kernel: [60896.619084] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:18:42 juju-e4d256-prod-github-runner-207 kernel: [60896.619879] ? do_syscall_64+0x69/0xc0 Aug 22 22:18:42 juju-e4d256-prod-github-runner-207 kernel: [60896.620586] ? do_syscall_64+0x69/0xc0 Aug 22 22:18:42 juju-e4d256-prod-github-runner-207 kernel: [60896.621292] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 22:18:42 juju-e4d256-prod-github-runner-207 kernel: [60896.622100] RIP: 0033:0x7faa5d0edaff Aug 22 22:18:42 juju-e4d256-prod-github-runner-207 kernel: [60896.622879] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 22:18:42 juju-e4d256-prod-github-runner-207 kernel: [60896.625241] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 22:18:42 juju-e4d256-prod-github-runner-207 kernel: [60896.626307] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 22:18:42 juju-e4d256-prod-github-runner-207 kernel: [60896.627362] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 22:18:42 juju-e4d256-prod-github-runner-207 kernel: [60896.628382] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 22:18:42 juju-e4d256-prod-github-runner-207 kernel: [60896.629556] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 22:18:42 juju-e4d256-prod-github-runner-207 kernel: [60896.630627] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 22:18:42 juju-e4d256-prod-github-runner-207 kernel: [60896.631667] Aug 22 22:19:10 juju-e4d256-prod-github-runner-207 kernel: [60924.541981] watchdog: BUG: soft lockup - CPU#1 stuck for 56632s! [qemu-system-x86:6715] Aug 22 22:19:10 juju-e4d256-prod-github-runner-207 kernel: [60924.544122] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 22:19:10 juju-e4d256-prod-github-runner-207 kernel: [60924.544434] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 22:19:10 juju-e4d256-prod-github-runner-207 kernel: [60924.557437] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 22:19:10 juju-e4d256-prod-github-runner-207 kernel: [60924.558920] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 22:19:10 juju-e4d256-prod-github-runner-207 kernel: [60924.560192] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:19:10 juju-e4d256-prod-github-runner-207 kernel: [60924.561264] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 22:19:10 juju-e4d256-prod-github-runner-207 kernel: [60924.563988] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 22:19:10 juju-e4d256-prod-github-runner-207 kernel: [60924.565254] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 22:19:10 juju-e4d256-prod-github-runner-207 kernel: [60924.566570] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 22:19:10 juju-e4d256-prod-github-runner-207 kernel: [60924.567799] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 22:19:10 juju-e4d256-prod-github-runner-207 kernel: [60924.569018] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 22:19:10 juju-e4d256-prod-github-runner-207 kernel: [60924.570265] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 22:19:10 juju-e4d256-prod-github-runner-207 kernel: [60924.571467] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 22:19:10 juju-e4d256-prod-github-runner-207 kernel: [60924.572724] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 22:19:10 juju-e4d256-prod-github-runner-207 kernel: [60924.573973] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 22:19:10 juju-e4d256-prod-github-runner-207 kernel: [60924.575268] Call Trace: Aug 22 22:19:10 juju-e4d256-prod-github-runner-207 kernel: [60924.576272] Aug 22 22:19:10 juju-e4d256-prod-github-runner-207 kernel: [60924.577235] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:19:10 juju-e4d256-prod-github-runner-207 kernel: [60924.578314] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:19:10 juju-e4d256-prod-github-runner-207 kernel: [60924.579359] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:19:10 juju-e4d256-prod-github-runner-207 kernel: [60924.580478] ? show_regs.part.0+0x23/0x29 Aug 22 22:19:10 juju-e4d256-prod-github-runner-207 kernel: [60924.581495] ? show_regs.cold+0x8/0xd Aug 22 22:19:10 juju-e4d256-prod-github-runner-207 kernel: [60924.582515] ? watchdog_timer_fn+0x1be/0x220 Aug 22 22:19:10 juju-e4d256-prod-github-runner-207 kernel: [60924.583609] ? lockup_detector_update_enable+0x60/0x60 Aug 22 22:19:10 juju-e4d256-prod-github-runner-207 kernel: [60924.584785] ? __hrtimer_run_queues+0x107/0x230 Aug 22 22:19:10 juju-e4d256-prod-github-runner-207 kernel: [60924.585965] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 22:19:10 juju-e4d256-prod-github-runner-207 kernel: [60924.587068] ? hrtimer_interrupt+0x101/0x220 Aug 22 22:19:10 juju-e4d256-prod-github-runner-207 kernel: [60924.588106] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 22:19:10 juju-e4d256-prod-github-runner-207 kernel: [60924.589197] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 22:19:10 juju-e4d256-prod-github-runner-207 kernel: [60924.590388] Aug 22 22:19:10 juju-e4d256-prod-github-runner-207 kernel: [60924.591297] Aug 22 22:19:10 juju-e4d256-prod-github-runner-207 kernel: [60924.592365] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 22:19:10 juju-e4d256-prod-github-runner-207 kernel: [60924.593475] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:19:10 juju-e4d256-prod-github-runner-207 kernel: [60924.594586] ? _raw_spin_lock+0x22/0x30 Aug 22 22:19:10 juju-e4d256-prod-github-runner-207 kernel: [60924.595580] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:19:10 juju-e4d256-prod-github-runner-207 kernel: [60924.596755] direct_page_fault+0x206/0x310 [kvm] Aug 22 22:19:10 juju-e4d256-prod-github-runner-207 kernel: [60924.598093] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 22:19:10 juju-e4d256-prod-github-runner-207 kernel: [60924.599326] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 22:19:10 juju-e4d256-prod-github-runner-207 kernel: [60924.600363] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 22:19:10 juju-e4d256-prod-github-runner-207 kernel: [60924.601402] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 22:19:10 juju-e4d256-prod-github-runner-207 kernel: [60924.602402] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 22:19:10 juju-e4d256-prod-github-runner-207 kernel: [60924.603402] handle_exit+0x98/0x230 [kvm_amd] Aug 22 22:19:10 juju-e4d256-prod-github-runner-207 kernel: [60924.604317] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 22:19:10 juju-e4d256-prod-github-runner-207 kernel: [60924.605246] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 22:19:10 juju-e4d256-prod-github-runner-207 kernel: [60924.606199] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 22:19:10 juju-e4d256-prod-github-runner-207 kernel: [60924.607141] vcpu_run+0x62/0x2c0 [kvm] Aug 22 22:19:10 juju-e4d256-prod-github-runner-207 kernel: [60924.607966] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 22:19:10 juju-e4d256-prod-github-runner-207 kernel: [60924.608818] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 22:19:10 juju-e4d256-prod-github-runner-207 kernel: [60924.609700] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 22:19:10 juju-e4d256-prod-github-runner-207 kernel: [60924.610555] ? __seccomp_filter+0x4a/0x4a0 Aug 22 22:19:10 juju-e4d256-prod-github-runner-207 kernel: [60924.611359] ? __fget_files+0x86/0xc0 Aug 22 22:19:10 juju-e4d256-prod-github-runner-207 kernel: [60924.612082] __x64_sys_ioctl+0x95/0xd0 Aug 22 22:19:10 juju-e4d256-prod-github-runner-207 kernel: [60924.612807] do_syscall_64+0x5c/0xc0 Aug 22 22:19:10 juju-e4d256-prod-github-runner-207 kernel: [60924.613549] ? do_futex+0x162/0x1f0 Aug 22 22:19:10 juju-e4d256-prod-github-runner-207 kernel: [60924.614219] ? __x64_sys_futex+0x78/0x1e0 Aug 22 22:19:10 juju-e4d256-prod-github-runner-207 kernel: [60924.614919] ? __secure_computing+0xa9/0x120 Aug 22 22:19:10 juju-e4d256-prod-github-runner-207 kernel: [60924.615620] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 22:19:10 juju-e4d256-prod-github-runner-207 kernel: [60924.616397] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:19:10 juju-e4d256-prod-github-runner-207 kernel: [60924.617163] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:19:10 juju-e4d256-prod-github-runner-207 kernel: [60924.617899] ? do_syscall_64+0x69/0xc0 Aug 22 22:19:10 juju-e4d256-prod-github-runner-207 kernel: [60924.618650] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:19:10 juju-e4d256-prod-github-runner-207 kernel: [60924.619375] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:19:10 juju-e4d256-prod-github-runner-207 kernel: [60924.620140] ? do_syscall_64+0x69/0xc0 Aug 22 22:19:10 juju-e4d256-prod-github-runner-207 kernel: [60924.620806] ? do_syscall_64+0x69/0xc0 Aug 22 22:19:10 juju-e4d256-prod-github-runner-207 kernel: [60924.621449] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 22:19:10 juju-e4d256-prod-github-runner-207 kernel: [60924.622212] RIP: 0033:0x7faa5d0edaff Aug 22 22:19:10 juju-e4d256-prod-github-runner-207 kernel: [60924.622986] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 22:19:10 juju-e4d256-prod-github-runner-207 kernel: [60924.625111] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 22:19:10 juju-e4d256-prod-github-runner-207 kernel: [60924.626142] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 22:19:10 juju-e4d256-prod-github-runner-207 kernel: [60924.627104] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 22:19:10 juju-e4d256-prod-github-runner-207 kernel: [60924.628015] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 22:19:10 juju-e4d256-prod-github-runner-207 kernel: [60924.628944] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 22:19:10 juju-e4d256-prod-github-runner-207 kernel: [60924.629943] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 22:19:10 juju-e4d256-prod-github-runner-207 kernel: [60924.631021] Aug 22 22:19:38 juju-e4d256-prod-github-runner-207 kernel: [60952.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 56658s! [qemu-system-x86:6715] Aug 22 22:19:38 juju-e4d256-prod-github-runner-207 kernel: [60952.543902] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 22:19:38 juju-e4d256-prod-github-runner-207 kernel: [60952.544211] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 22:19:38 juju-e4d256-prod-github-runner-207 kernel: [60952.556451] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 22:19:38 juju-e4d256-prod-github-runner-207 kernel: [60952.557720] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 22:19:38 juju-e4d256-prod-github-runner-207 kernel: [60952.558965] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:19:38 juju-e4d256-prod-github-runner-207 kernel: [60952.560038] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 22:19:38 juju-e4d256-prod-github-runner-207 kernel: [60952.562624] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 22:19:38 juju-e4d256-prod-github-runner-207 kernel: [60952.563670] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 22:19:38 juju-e4d256-prod-github-runner-207 kernel: [60952.564832] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 22:19:38 juju-e4d256-prod-github-runner-207 kernel: [60952.566008] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 22:19:38 juju-e4d256-prod-github-runner-207 kernel: [60952.567166] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 22:19:38 juju-e4d256-prod-github-runner-207 kernel: [60952.568334] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 22:19:38 juju-e4d256-prod-github-runner-207 kernel: [60952.569505] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 22:19:38 juju-e4d256-prod-github-runner-207 kernel: [60952.570754] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 22:19:38 juju-e4d256-prod-github-runner-207 kernel: [60952.571856] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 22:19:38 juju-e4d256-prod-github-runner-207 kernel: [60952.573046] Call Trace: Aug 22 22:19:38 juju-e4d256-prod-github-runner-207 kernel: [60952.573974] Aug 22 22:19:38 juju-e4d256-prod-github-runner-207 kernel: [60952.574880] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:19:38 juju-e4d256-prod-github-runner-207 kernel: [60952.575936] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:19:38 juju-e4d256-prod-github-runner-207 kernel: [60952.576975] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:19:38 juju-e4d256-prod-github-runner-207 kernel: [60952.578105] ? show_regs.part.0+0x23/0x29 Aug 22 22:19:38 juju-e4d256-prod-github-runner-207 kernel: [60952.579126] ? show_regs.cold+0x8/0xd Aug 22 22:19:38 juju-e4d256-prod-github-runner-207 kernel: [60952.580103] ? watchdog_timer_fn+0x1be/0x220 Aug 22 22:19:38 juju-e4d256-prod-github-runner-207 kernel: [60952.581111] ? lockup_detector_update_enable+0x60/0x60 Aug 22 22:19:38 juju-e4d256-prod-github-runner-207 kernel: [60952.582301] ? __hrtimer_run_queues+0x107/0x230 Aug 22 22:19:38 juju-e4d256-prod-github-runner-207 kernel: [60952.583468] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 22:19:38 juju-e4d256-prod-github-runner-207 kernel: [60952.584493] ? hrtimer_interrupt+0x101/0x220 Aug 22 22:19:38 juju-e4d256-prod-github-runner-207 kernel: [60952.585508] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 22:19:38 juju-e4d256-prod-github-runner-207 kernel: [60952.586593] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 22:19:38 juju-e4d256-prod-github-runner-207 kernel: [60952.587640] Aug 22 22:19:38 juju-e4d256-prod-github-runner-207 kernel: [60952.588533] Aug 22 22:19:38 juju-e4d256-prod-github-runner-207 kernel: [60952.589392] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 22:19:38 juju-e4d256-prod-github-runner-207 kernel: [60952.590462] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:19:38 juju-e4d256-prod-github-runner-207 kernel: [60952.591509] ? _raw_spin_lock+0x22/0x30 Aug 22 22:19:38 juju-e4d256-prod-github-runner-207 kernel: [60952.592452] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:19:38 juju-e4d256-prod-github-runner-207 kernel: [60952.593484] direct_page_fault+0x206/0x310 [kvm] Aug 22 22:19:38 juju-e4d256-prod-github-runner-207 kernel: [60952.594543] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 22:19:38 juju-e4d256-prod-github-runner-207 kernel: [60952.595552] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 22:19:38 juju-e4d256-prod-github-runner-207 kernel: [60952.596551] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 22:19:38 juju-e4d256-prod-github-runner-207 kernel: [60952.597570] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 22:19:38 juju-e4d256-prod-github-runner-207 kernel: [60952.598537] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 22:19:38 juju-e4d256-prod-github-runner-207 kernel: [60952.599517] handle_exit+0x98/0x230 [kvm_amd] Aug 22 22:19:38 juju-e4d256-prod-github-runner-207 kernel: [60952.600409] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 22:19:38 juju-e4d256-prod-github-runner-207 kernel: [60952.601331] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 22:19:38 juju-e4d256-prod-github-runner-207 kernel: [60952.602282] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 22:19:38 juju-e4d256-prod-github-runner-207 kernel: [60952.603197] vcpu_run+0x62/0x2c0 [kvm] Aug 22 22:19:38 juju-e4d256-prod-github-runner-207 kernel: [60952.604278] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 22:19:38 juju-e4d256-prod-github-runner-207 kernel: [60952.605149] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 22:19:38 juju-e4d256-prod-github-runner-207 kernel: [60952.606027] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 22:19:38 juju-e4d256-prod-github-runner-207 kernel: [60952.606837] ? __seccomp_filter+0x4a/0x4a0 Aug 22 22:19:38 juju-e4d256-prod-github-runner-207 kernel: [60952.607579] ? __fget_files+0x86/0xc0 Aug 22 22:19:38 juju-e4d256-prod-github-runner-207 kernel: [60952.608281] __x64_sys_ioctl+0x95/0xd0 Aug 22 22:19:38 juju-e4d256-prod-github-runner-207 kernel: [60952.608971] do_syscall_64+0x5c/0xc0 Aug 22 22:19:38 juju-e4d256-prod-github-runner-207 kernel: [60952.609651] ? do_futex+0x162/0x1f0 Aug 22 22:19:38 juju-e4d256-prod-github-runner-207 kernel: [60952.610337] ? __x64_sys_futex+0x78/0x1e0 Aug 22 22:19:38 juju-e4d256-prod-github-runner-207 kernel: [60952.611008] ? __secure_computing+0xa9/0x120 Aug 22 22:19:38 juju-e4d256-prod-github-runner-207 kernel: [60952.611693] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 22:19:38 juju-e4d256-prod-github-runner-207 kernel: [60952.612449] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:19:38 juju-e4d256-prod-github-runner-207 kernel: [60952.613226] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:19:38 juju-e4d256-prod-github-runner-207 kernel: [60952.613969] ? do_syscall_64+0x69/0xc0 Aug 22 22:19:38 juju-e4d256-prod-github-runner-207 kernel: [60952.614623] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:19:38 juju-e4d256-prod-github-runner-207 kernel: [60952.615323] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:19:38 juju-e4d256-prod-github-runner-207 kernel: [60952.616044] ? do_syscall_64+0x69/0xc0 Aug 22 22:19:38 juju-e4d256-prod-github-runner-207 kernel: [60952.616678] ? do_syscall_64+0x69/0xc0 Aug 22 22:19:38 juju-e4d256-prod-github-runner-207 kernel: [60952.617309] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 22:19:38 juju-e4d256-prod-github-runner-207 kernel: [60952.618036] RIP: 0033:0x7faa5d0edaff Aug 22 22:19:38 juju-e4d256-prod-github-runner-207 kernel: [60952.618729] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 22:19:38 juju-e4d256-prod-github-runner-207 kernel: [60952.620733] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 22:19:38 juju-e4d256-prod-github-runner-207 kernel: [60952.621652] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 22:19:38 juju-e4d256-prod-github-runner-207 kernel: [60952.622559] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 22:19:38 juju-e4d256-prod-github-runner-207 kernel: [60952.623453] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 22:19:38 juju-e4d256-prod-github-runner-207 kernel: [60952.624342] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 22:19:38 juju-e4d256-prod-github-runner-207 kernel: [60952.625229] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 22:19:38 juju-e4d256-prod-github-runner-207 kernel: [60952.626151] Aug 22 22:20:06 juju-e4d256-prod-github-runner-207 kernel: [60980.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 56684s! [qemu-system-x86:6715] Aug 22 22:20:06 juju-e4d256-prod-github-runner-207 kernel: [60980.543877] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 22:20:06 juju-e4d256-prod-github-runner-207 kernel: [60980.544162] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 22:20:06 juju-e4d256-prod-github-runner-207 kernel: [60980.556297] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 22:20:06 juju-e4d256-prod-github-runner-207 kernel: [60980.557581] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 22:20:06 juju-e4d256-prod-github-runner-207 kernel: [60980.558824] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:20:06 juju-e4d256-prod-github-runner-207 kernel: [60980.559885] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 22:20:06 juju-e4d256-prod-github-runner-207 kernel: [60980.562448] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 22:20:06 juju-e4d256-prod-github-runner-207 kernel: [60980.563493] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 22:20:06 juju-e4d256-prod-github-runner-207 kernel: [60980.564656] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 22:20:06 juju-e4d256-prod-github-runner-207 kernel: [60980.565832] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 22:20:06 juju-e4d256-prod-github-runner-207 kernel: [60980.566997] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 22:20:06 juju-e4d256-prod-github-runner-207 kernel: [60980.568163] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 22:20:06 juju-e4d256-prod-github-runner-207 kernel: [60980.569342] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 22:20:06 juju-e4d256-prod-github-runner-207 kernel: [60980.570590] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 22:20:06 juju-e4d256-prod-github-runner-207 kernel: [60980.571688] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 22:20:06 juju-e4d256-prod-github-runner-207 kernel: [60980.572946] Call Trace: Aug 22 22:20:06 juju-e4d256-prod-github-runner-207 kernel: [60980.573885] Aug 22 22:20:06 juju-e4d256-prod-github-runner-207 kernel: [60980.574780] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:20:06 juju-e4d256-prod-github-runner-207 kernel: [60980.575814] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:20:06 juju-e4d256-prod-github-runner-207 kernel: [60980.576832] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:20:06 juju-e4d256-prod-github-runner-207 kernel: [60980.577935] ? show_regs.part.0+0x23/0x29 Aug 22 22:20:06 juju-e4d256-prod-github-runner-207 kernel: [60980.578940] ? show_regs.cold+0x8/0xd Aug 22 22:20:06 juju-e4d256-prod-github-runner-207 kernel: [60980.579911] ? watchdog_timer_fn+0x1be/0x220 Aug 22 22:20:06 juju-e4d256-prod-github-runner-207 kernel: [60980.580924] ? lockup_detector_update_enable+0x60/0x60 Aug 22 22:20:06 juju-e4d256-prod-github-runner-207 kernel: [60980.582284] ? __hrtimer_run_queues+0x107/0x230 Aug 22 22:20:06 juju-e4d256-prod-github-runner-207 kernel: [60980.583321] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 22:20:06 juju-e4d256-prod-github-runner-207 kernel: [60980.584352] ? hrtimer_interrupt+0x101/0x220 Aug 22 22:20:06 juju-e4d256-prod-github-runner-207 kernel: [60980.585373] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 22:20:06 juju-e4d256-prod-github-runner-207 kernel: [60980.586499] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 22:20:06 juju-e4d256-prod-github-runner-207 kernel: [60980.587550] Aug 22 22:20:06 juju-e4d256-prod-github-runner-207 kernel: [60980.588402] Aug 22 22:20:06 juju-e4d256-prod-github-runner-207 kernel: [60980.589243] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 22:20:06 juju-e4d256-prod-github-runner-207 kernel: [60980.590291] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:20:06 juju-e4d256-prod-github-runner-207 kernel: [60980.591335] ? _raw_spin_lock+0x22/0x30 Aug 22 22:20:06 juju-e4d256-prod-github-runner-207 kernel: [60980.592278] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:20:06 juju-e4d256-prod-github-runner-207 kernel: [60980.593308] direct_page_fault+0x206/0x310 [kvm] Aug 22 22:20:06 juju-e4d256-prod-github-runner-207 kernel: [60980.594348] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 22:20:06 juju-e4d256-prod-github-runner-207 kernel: [60980.595356] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 22:20:06 juju-e4d256-prod-github-runner-207 kernel: [60980.596356] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 22:20:06 juju-e4d256-prod-github-runner-207 kernel: [60980.597358] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 22:20:06 juju-e4d256-prod-github-runner-207 kernel: [60980.598317] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 22:20:06 juju-e4d256-prod-github-runner-207 kernel: [60980.599293] handle_exit+0x98/0x230 [kvm_amd] Aug 22 22:20:06 juju-e4d256-prod-github-runner-207 kernel: [60980.600190] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 22:20:06 juju-e4d256-prod-github-runner-207 kernel: [60980.601102] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 22:20:06 juju-e4d256-prod-github-runner-207 kernel: [60980.602040] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 22:20:06 juju-e4d256-prod-github-runner-207 kernel: [60980.602943] vcpu_run+0x62/0x2c0 [kvm] Aug 22 22:20:06 juju-e4d256-prod-github-runner-207 kernel: [60980.603761] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 22:20:06 juju-e4d256-prod-github-runner-207 kernel: [60980.604568] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 22:20:06 juju-e4d256-prod-github-runner-207 kernel: [60980.605456] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 22:20:06 juju-e4d256-prod-github-runner-207 kernel: [60980.606263] ? __seccomp_filter+0x4a/0x4a0 Aug 22 22:20:06 juju-e4d256-prod-github-runner-207 kernel: [60980.607003] ? __fget_files+0x86/0xc0 Aug 22 22:20:06 juju-e4d256-prod-github-runner-207 kernel: [60980.607704] __x64_sys_ioctl+0x95/0xd0 Aug 22 22:20:06 juju-e4d256-prod-github-runner-207 kernel: [60980.608395] do_syscall_64+0x5c/0xc0 Aug 22 22:20:06 juju-e4d256-prod-github-runner-207 kernel: [60980.609065] ? do_futex+0x162/0x1f0 Aug 22 22:20:06 juju-e4d256-prod-github-runner-207 kernel: [60980.609729] ? __x64_sys_futex+0x78/0x1e0 Aug 22 22:20:06 juju-e4d256-prod-github-runner-207 kernel: [60980.610403] ? __secure_computing+0xa9/0x120 Aug 22 22:20:06 juju-e4d256-prod-github-runner-207 kernel: [60980.611093] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 22:20:06 juju-e4d256-prod-github-runner-207 kernel: [60980.611852] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:20:06 juju-e4d256-prod-github-runner-207 kernel: [60980.612570] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:20:06 juju-e4d256-prod-github-runner-207 kernel: [60980.613291] ? do_syscall_64+0x69/0xc0 Aug 22 22:20:06 juju-e4d256-prod-github-runner-207 kernel: [60980.613945] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:20:06 juju-e4d256-prod-github-runner-207 kernel: [60980.614645] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:20:06 juju-e4d256-prod-github-runner-207 kernel: [60980.615340] ? do_syscall_64+0x69/0xc0 Aug 22 22:20:06 juju-e4d256-prod-github-runner-207 kernel: [60980.615959] ? do_syscall_64+0x69/0xc0 Aug 22 22:20:06 juju-e4d256-prod-github-runner-207 kernel: [60980.616577] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 22:20:06 juju-e4d256-prod-github-runner-207 kernel: [60980.617284] RIP: 0033:0x7faa5d0edaff Aug 22 22:20:06 juju-e4d256-prod-github-runner-207 kernel: [60980.617947] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 22:20:06 juju-e4d256-prod-github-runner-207 kernel: [60980.619942] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 22:20:06 juju-e4d256-prod-github-runner-207 kernel: [60980.620847] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 22:20:06 juju-e4d256-prod-github-runner-207 kernel: [60980.621740] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 22:20:06 juju-e4d256-prod-github-runner-207 kernel: [60980.622626] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 22:20:06 juju-e4d256-prod-github-runner-207 kernel: [60980.623511] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 22:20:06 juju-e4d256-prod-github-runner-207 kernel: [60980.624549] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 22:20:06 juju-e4d256-prod-github-runner-207 kernel: [60980.625598] Aug 22 22:20:34 juju-e4d256-prod-github-runner-207 kernel: [61008.541980] watchdog: BUG: soft lockup - CPU#1 stuck for 56710s! [qemu-system-x86:6715] Aug 22 22:20:34 juju-e4d256-prod-github-runner-207 kernel: [61008.543902] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 22:20:34 juju-e4d256-prod-github-runner-207 kernel: [61008.544223] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 22:20:34 juju-e4d256-prod-github-runner-207 kernel: [61008.556923] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 22:20:34 juju-e4d256-prod-github-runner-207 kernel: [61008.558362] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 22:20:34 juju-e4d256-prod-github-runner-207 kernel: [61008.559766] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:20:34 juju-e4d256-prod-github-runner-207 kernel: [61008.560826] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 22:20:34 juju-e4d256-prod-github-runner-207 kernel: [61008.563413] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 22:20:34 juju-e4d256-prod-github-runner-207 kernel: [61008.564455] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 22:20:34 juju-e4d256-prod-github-runner-207 kernel: [61008.565636] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 22:20:34 juju-e4d256-prod-github-runner-207 kernel: [61008.566829] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 22:20:34 juju-e4d256-prod-github-runner-207 kernel: [61008.567996] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 22:20:34 juju-e4d256-prod-github-runner-207 kernel: [61008.569189] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 22:20:34 juju-e4d256-prod-github-runner-207 kernel: [61008.570360] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 22:20:34 juju-e4d256-prod-github-runner-207 kernel: [61008.571603] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 22:20:34 juju-e4d256-prod-github-runner-207 kernel: [61008.572710] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 22:20:34 juju-e4d256-prod-github-runner-207 kernel: [61008.573943] Call Trace: Aug 22 22:20:34 juju-e4d256-prod-github-runner-207 kernel: [61008.574872] Aug 22 22:20:34 juju-e4d256-prod-github-runner-207 kernel: [61008.575789] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:20:34 juju-e4d256-prod-github-runner-207 kernel: [61008.576824] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:20:34 juju-e4d256-prod-github-runner-207 kernel: [61008.577875] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:20:34 juju-e4d256-prod-github-runner-207 kernel: [61008.578991] ? show_regs.part.0+0x23/0x29 Aug 22 22:20:34 juju-e4d256-prod-github-runner-207 kernel: [61008.579990] ? show_regs.cold+0x8/0xd Aug 22 22:20:34 juju-e4d256-prod-github-runner-207 kernel: [61008.580967] ? watchdog_timer_fn+0x1be/0x220 Aug 22 22:20:34 juju-e4d256-prod-github-runner-207 kernel: [61008.582074] ? lockup_detector_update_enable+0x60/0x60 Aug 22 22:20:34 juju-e4d256-prod-github-runner-207 kernel: [61008.583161] ? __hrtimer_run_queues+0x107/0x230 Aug 22 22:20:34 juju-e4d256-prod-github-runner-207 kernel: [61008.584193] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 22:20:34 juju-e4d256-prod-github-runner-207 kernel: [61008.585261] ? hrtimer_interrupt+0x101/0x220 Aug 22 22:20:34 juju-e4d256-prod-github-runner-207 kernel: [61008.586292] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 22:20:34 juju-e4d256-prod-github-runner-207 kernel: [61008.587368] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 22:20:34 juju-e4d256-prod-github-runner-207 kernel: [61008.588441] Aug 22 22:20:34 juju-e4d256-prod-github-runner-207 kernel: [61008.589323] Aug 22 22:20:34 juju-e4d256-prod-github-runner-207 kernel: [61008.590214] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 22:20:34 juju-e4d256-prod-github-runner-207 kernel: [61008.591276] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:20:34 juju-e4d256-prod-github-runner-207 kernel: [61008.592326] ? _raw_spin_lock+0x22/0x30 Aug 22 22:20:34 juju-e4d256-prod-github-runner-207 kernel: [61008.593306] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:20:34 juju-e4d256-prod-github-runner-207 kernel: [61008.594347] direct_page_fault+0x206/0x310 [kvm] Aug 22 22:20:34 juju-e4d256-prod-github-runner-207 kernel: [61008.595390] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 22:20:34 juju-e4d256-prod-github-runner-207 kernel: [61008.596403] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 22:20:34 juju-e4d256-prod-github-runner-207 kernel: [61008.597426] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 22:20:34 juju-e4d256-prod-github-runner-207 kernel: [61008.598463] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 22:20:34 juju-e4d256-prod-github-runner-207 kernel: [61008.599411] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 22:20:34 juju-e4d256-prod-github-runner-207 kernel: [61008.600394] handle_exit+0x98/0x230 [kvm_amd] Aug 22 22:20:34 juju-e4d256-prod-github-runner-207 kernel: [61008.601376] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 22:20:34 juju-e4d256-prod-github-runner-207 kernel: [61008.602302] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 22:20:34 juju-e4d256-prod-github-runner-207 kernel: [61008.603228] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 22:20:34 juju-e4d256-prod-github-runner-207 kernel: [61008.604140] vcpu_run+0x62/0x2c0 [kvm] Aug 22 22:20:34 juju-e4d256-prod-github-runner-207 kernel: [61008.604967] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 22:20:34 juju-e4d256-prod-github-runner-207 kernel: [61008.605822] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 22:20:34 juju-e4d256-prod-github-runner-207 kernel: [61008.606803] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 22:20:34 juju-e4d256-prod-github-runner-207 kernel: [61008.607665] ? __seccomp_filter+0x4a/0x4a0 Aug 22 22:20:34 juju-e4d256-prod-github-runner-207 kernel: [61008.608420] ? __fget_files+0x86/0xc0 Aug 22 22:20:34 juju-e4d256-prod-github-runner-207 kernel: [61008.609154] __x64_sys_ioctl+0x95/0xd0 Aug 22 22:20:34 juju-e4d256-prod-github-runner-207 kernel: [61008.609853] do_syscall_64+0x5c/0xc0 Aug 22 22:20:34 juju-e4d256-prod-github-runner-207 kernel: [61008.610525] ? do_futex+0x162/0x1f0 Aug 22 22:20:34 juju-e4d256-prod-github-runner-207 kernel: [61008.611189] ? __x64_sys_futex+0x78/0x1e0 Aug 22 22:20:34 juju-e4d256-prod-github-runner-207 kernel: [61008.611882] ? __secure_computing+0xa9/0x120 Aug 22 22:20:34 juju-e4d256-prod-github-runner-207 kernel: [61008.612574] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 22:20:34 juju-e4d256-prod-github-runner-207 kernel: [61008.613368] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:20:34 juju-e4d256-prod-github-runner-207 kernel: [61008.614096] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:20:34 juju-e4d256-prod-github-runner-207 kernel: [61008.614814] ? do_syscall_64+0x69/0xc0 Aug 22 22:20:34 juju-e4d256-prod-github-runner-207 kernel: [61008.615459] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:20:34 juju-e4d256-prod-github-runner-207 kernel: [61008.616163] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:20:34 juju-e4d256-prod-github-runner-207 kernel: [61008.616870] ? do_syscall_64+0x69/0xc0 Aug 22 22:20:34 juju-e4d256-prod-github-runner-207 kernel: [61008.617509] ? do_syscall_64+0x69/0xc0 Aug 22 22:20:34 juju-e4d256-prod-github-runner-207 kernel: [61008.618133] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 22:20:34 juju-e4d256-prod-github-runner-207 kernel: [61008.618841] RIP: 0033:0x7faa5d0edaff Aug 22 22:20:34 juju-e4d256-prod-github-runner-207 kernel: [61008.619512] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 22:20:34 juju-e4d256-prod-github-runner-207 kernel: [61008.621531] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 22:20:34 juju-e4d256-prod-github-runner-207 kernel: [61008.622479] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 22:20:34 juju-e4d256-prod-github-runner-207 kernel: [61008.623377] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 22:20:34 juju-e4d256-prod-github-runner-207 kernel: [61008.624279] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 22:20:34 juju-e4d256-prod-github-runner-207 kernel: [61008.625183] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 22:20:34 juju-e4d256-prod-github-runner-207 kernel: [61008.626074] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 22:20:34 juju-e4d256-prod-github-runner-207 kernel: [61008.626980] Aug 22 22:20:47 juju-e4d256-prod-github-runner-207 kernel: [61021.256707] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 22:20:47 juju-e4d256-prod-github-runner-207 kernel: [61021.258492] rcu: 1-....: (15178031 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=7331714 Aug 22 22:20:47 juju-e4d256-prod-github-runner-207 kernel: [61021.259624] (t=15226014 jiffies g=23269 q=54656) Aug 22 22:20:47 juju-e4d256-prod-github-runner-207 kernel: [61021.260412] NMI backtrace for cpu 1 Aug 22 22:20:47 juju-e4d256-prod-github-runner-207 kernel: [61021.261158] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 22:20:47 juju-e4d256-prod-github-runner-207 kernel: [61021.262261] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 22:20:47 juju-e4d256-prod-github-runner-207 kernel: [61021.263329] Call Trace: Aug 22 22:20:47 juju-e4d256-prod-github-runner-207 kernel: [61021.264012] Aug 22 22:20:47 juju-e4d256-prod-github-runner-207 kernel: [61021.264670] show_stack+0x52/0x5c Aug 22 22:20:47 juju-e4d256-prod-github-runner-207 kernel: [61021.265411] dump_stack_lvl+0x4a/0x63 Aug 22 22:20:47 juju-e4d256-prod-github-runner-207 kernel: [61021.266191] dump_stack+0x10/0x16 Aug 22 22:20:47 juju-e4d256-prod-github-runner-207 kernel: [61021.266912] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 22:20:47 juju-e4d256-prod-github-runner-207 kernel: [61021.267692] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 22:20:47 juju-e4d256-prod-github-runner-207 kernel: [61021.268472] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 22:20:47 juju-e4d256-prod-github-runner-207 kernel: [61021.269352] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 22:20:47 juju-e4d256-prod-github-runner-207 kernel: [61021.270173] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 22:20:47 juju-e4d256-prod-github-runner-207 kernel: [61021.271010] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 22:20:47 juju-e4d256-prod-github-runner-207 kernel: [61021.271781] print_cpu_stall.cold+0x2f/0xe2 Aug 22 22:20:47 juju-e4d256-prod-github-runner-207 kernel: [61021.272548] ? timekeeping_update+0xf7/0x150 Aug 22 22:20:47 juju-e4d256-prod-github-runner-207 kernel: [61021.273331] check_cpu_stall+0x109/0x270 Aug 22 22:20:47 juju-e4d256-prod-github-runner-207 kernel: [61021.274078] rcu_sched_clock_irq+0x9a/0x250 Aug 22 22:20:47 juju-e4d256-prod-github-runner-207 kernel: [61021.274853] update_process_times+0x94/0xd0 Aug 22 22:20:47 juju-e4d256-prod-github-runner-207 kernel: [61021.275611] tick_sched_handle+0x29/0x70 Aug 22 22:20:47 juju-e4d256-prod-github-runner-207 kernel: [61021.276355] tick_sched_timer+0x8c/0xc0 Aug 22 22:20:47 juju-e4d256-prod-github-runner-207 kernel: [61021.277111] ? tick_nohz_handler+0xb0/0xb0 Aug 22 22:20:47 juju-e4d256-prod-github-runner-207 kernel: [61021.277865] __hrtimer_run_queues+0x107/0x230 Aug 22 22:20:47 juju-e4d256-prod-github-runner-207 kernel: [61021.278643] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 22:20:47 juju-e4d256-prod-github-runner-207 kernel: [61021.279421] hrtimer_interrupt+0x101/0x220 Aug 22 22:20:47 juju-e4d256-prod-github-runner-207 kernel: [61021.280186] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 22:20:47 juju-e4d256-prod-github-runner-207 kernel: [61021.281015] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 22:20:47 juju-e4d256-prod-github-runner-207 kernel: [61021.281827] Aug 22 22:20:47 juju-e4d256-prod-github-runner-207 kernel: [61021.282464] Aug 22 22:20:47 juju-e4d256-prod-github-runner-207 kernel: [61021.283103] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 22:20:47 juju-e4d256-prod-github-runner-207 kernel: [61021.283924] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:20:47 juju-e4d256-prod-github-runner-207 kernel: [61021.284815] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 22:20:47 juju-e4d256-prod-github-runner-207 kernel: [61021.287070] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 22:20:47 juju-e4d256-prod-github-runner-207 kernel: [61021.287940] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 22:20:47 juju-e4d256-prod-github-runner-207 kernel: [61021.288971] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 22:20:47 juju-e4d256-prod-github-runner-207 kernel: [61021.289977] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 22:20:47 juju-e4d256-prod-github-runner-207 kernel: [61021.290946] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 22:20:47 juju-e4d256-prod-github-runner-207 kernel: [61021.291897] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 22:20:47 juju-e4d256-prod-github-runner-207 kernel: [61021.292854] ? _raw_spin_lock+0x22/0x30 Aug 22 22:20:47 juju-e4d256-prod-github-runner-207 kernel: [61021.293649] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:20:47 juju-e4d256-prod-github-runner-207 kernel: [61021.294508] direct_page_fault+0x206/0x310 [kvm] Aug 22 22:20:47 juju-e4d256-prod-github-runner-207 kernel: [61021.295355] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 22:20:47 juju-e4d256-prod-github-runner-207 kernel: [61021.296230] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 22:20:47 juju-e4d256-prod-github-runner-207 kernel: [61021.297097] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 22:20:47 juju-e4d256-prod-github-runner-207 kernel: [61021.297936] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 22:20:47 juju-e4d256-prod-github-runner-207 kernel: [61021.298724] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 22:20:47 juju-e4d256-prod-github-runner-207 kernel: [61021.299548] handle_exit+0x98/0x230 [kvm_amd] Aug 22 22:20:47 juju-e4d256-prod-github-runner-207 kernel: [61021.300300] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 22:20:47 juju-e4d256-prod-github-runner-207 kernel: [61021.301101] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 22:20:47 juju-e4d256-prod-github-runner-207 kernel: [61021.301899] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 22:20:47 juju-e4d256-prod-github-runner-207 kernel: [61021.302685] vcpu_run+0x62/0x2c0 [kvm] Aug 22 22:20:47 juju-e4d256-prod-github-runner-207 kernel: [61021.303415] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 22:20:47 juju-e4d256-prod-github-runner-207 kernel: [61021.304156] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 22:20:47 juju-e4d256-prod-github-runner-207 kernel: [61021.304982] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 22:20:47 juju-e4d256-prod-github-runner-207 kernel: [61021.305751] ? __seccomp_filter+0x4a/0x4a0 Aug 22 22:20:47 juju-e4d256-prod-github-runner-207 kernel: [61021.306472] ? __fget_files+0x86/0xc0 Aug 22 22:20:47 juju-e4d256-prod-github-runner-207 kernel: [61021.307169] __x64_sys_ioctl+0x95/0xd0 Aug 22 22:20:47 juju-e4d256-prod-github-runner-207 kernel: [61021.307872] do_syscall_64+0x5c/0xc0 Aug 22 22:20:47 juju-e4d256-prod-github-runner-207 kernel: [61021.308557] ? do_futex+0x162/0x1f0 Aug 22 22:20:47 juju-e4d256-prod-github-runner-207 kernel: [61021.309249] ? __x64_sys_futex+0x78/0x1e0 Aug 22 22:20:47 juju-e4d256-prod-github-runner-207 kernel: [61021.309968] ? __secure_computing+0xa9/0x120 Aug 22 22:20:47 juju-e4d256-prod-github-runner-207 kernel: [61021.310688] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 22:20:47 juju-e4d256-prod-github-runner-207 kernel: [61021.311479] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:20:47 juju-e4d256-prod-github-runner-207 kernel: [61021.312239] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:20:47 juju-e4d256-prod-github-runner-207 kernel: [61021.313011] ? do_syscall_64+0x69/0xc0 Aug 22 22:20:47 juju-e4d256-prod-github-runner-207 kernel: [61021.313710] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:20:47 juju-e4d256-prod-github-runner-207 kernel: [61021.314482] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:20:47 juju-e4d256-prod-github-runner-207 kernel: [61021.315246] ? do_syscall_64+0x69/0xc0 Aug 22 22:20:47 juju-e4d256-prod-github-runner-207 kernel: [61021.315941] ? do_syscall_64+0x69/0xc0 Aug 22 22:20:47 juju-e4d256-prod-github-runner-207 kernel: [61021.316636] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 22:20:47 juju-e4d256-prod-github-runner-207 kernel: [61021.317420] RIP: 0033:0x7faa5d0edaff Aug 22 22:20:47 juju-e4d256-prod-github-runner-207 kernel: [61021.318155] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 22:20:47 juju-e4d256-prod-github-runner-207 kernel: [61021.320268] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 22:20:47 juju-e4d256-prod-github-runner-207 kernel: [61021.321250] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 22:20:47 juju-e4d256-prod-github-runner-207 kernel: [61021.322201] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 22:20:47 juju-e4d256-prod-github-runner-207 kernel: [61021.323146] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 22:20:47 juju-e4d256-prod-github-runner-207 kernel: [61021.324090] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 22:20:47 juju-e4d256-prod-github-runner-207 kernel: [61021.325031] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 22:20:47 juju-e4d256-prod-github-runner-207 kernel: [61021.325951] Aug 22 22:21:14 juju-e4d256-prod-github-runner-207 kernel: [61048.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 56747s! [qemu-system-x86:6715] Aug 22 22:21:14 juju-e4d256-prod-github-runner-207 kernel: [61048.543929] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 22:21:14 juju-e4d256-prod-github-runner-207 kernel: [61048.544238] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 22:21:14 juju-e4d256-prod-github-runner-207 kernel: [61048.556698] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 22:21:14 juju-e4d256-prod-github-runner-207 kernel: [61048.557990] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 22:21:14 juju-e4d256-prod-github-runner-207 kernel: [61048.559237] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:21:14 juju-e4d256-prod-github-runner-207 kernel: [61048.560304] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 22:21:14 juju-e4d256-prod-github-runner-207 kernel: [61048.562899] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 22:21:14 juju-e4d256-prod-github-runner-207 kernel: [61048.563953] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 22:21:14 juju-e4d256-prod-github-runner-207 kernel: [61048.565153] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 22:21:14 juju-e4d256-prod-github-runner-207 kernel: [61048.566407] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 22:21:14 juju-e4d256-prod-github-runner-207 kernel: [61048.567900] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 22:21:14 juju-e4d256-prod-github-runner-207 kernel: [61048.569109] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 22:21:14 juju-e4d256-prod-github-runner-207 kernel: [61048.570294] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 22:21:14 juju-e4d256-prod-github-runner-207 kernel: [61048.571570] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 22:21:14 juju-e4d256-prod-github-runner-207 kernel: [61048.572699] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 22:21:14 juju-e4d256-prod-github-runner-207 kernel: [61048.573898] Call Trace: Aug 22 22:21:14 juju-e4d256-prod-github-runner-207 kernel: [61048.574817] Aug 22 22:21:14 juju-e4d256-prod-github-runner-207 kernel: [61048.575713] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:21:14 juju-e4d256-prod-github-runner-207 kernel: [61048.576754] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:21:14 juju-e4d256-prod-github-runner-207 kernel: [61048.577799] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:21:14 juju-e4d256-prod-github-runner-207 kernel: [61048.578900] ? show_regs.part.0+0x23/0x29 Aug 22 22:21:14 juju-e4d256-prod-github-runner-207 kernel: [61048.579894] ? show_regs.cold+0x8/0xd Aug 22 22:21:14 juju-e4d256-prod-github-runner-207 kernel: [61048.580900] ? watchdog_timer_fn+0x1be/0x220 Aug 22 22:21:14 juju-e4d256-prod-github-runner-207 kernel: [61048.581913] ? lockup_detector_update_enable+0x60/0x60 Aug 22 22:21:14 juju-e4d256-prod-github-runner-207 kernel: [61048.582972] ? __hrtimer_run_queues+0x107/0x230 Aug 22 22:21:14 juju-e4d256-prod-github-runner-207 kernel: [61048.583997] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 22:21:14 juju-e4d256-prod-github-runner-207 kernel: [61048.585032] ? hrtimer_interrupt+0x101/0x220 Aug 22 22:21:14 juju-e4d256-prod-github-runner-207 kernel: [61048.586045] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 22:21:14 juju-e4d256-prod-github-runner-207 kernel: [61048.587110] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 22:21:14 juju-e4d256-prod-github-runner-207 kernel: [61048.588166] Aug 22 22:21:14 juju-e4d256-prod-github-runner-207 kernel: [61048.589034] Aug 22 22:21:14 juju-e4d256-prod-github-runner-207 kernel: [61048.589870] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 22:21:14 juju-e4d256-prod-github-runner-207 kernel: [61048.590901] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:21:14 juju-e4d256-prod-github-runner-207 kernel: [61048.591936] ? _raw_spin_lock+0x22/0x30 Aug 22 22:21:14 juju-e4d256-prod-github-runner-207 kernel: [61048.592891] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:21:14 juju-e4d256-prod-github-runner-207 kernel: [61048.593913] direct_page_fault+0x206/0x310 [kvm] Aug 22 22:21:14 juju-e4d256-prod-github-runner-207 kernel: [61048.594941] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 22:21:14 juju-e4d256-prod-github-runner-207 kernel: [61048.595952] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 22:21:14 juju-e4d256-prod-github-runner-207 kernel: [61048.597002] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 22:21:14 juju-e4d256-prod-github-runner-207 kernel: [61048.598020] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 22:21:14 juju-e4d256-prod-github-runner-207 kernel: [61048.598965] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 22:21:14 juju-e4d256-prod-github-runner-207 kernel: [61048.599976] handle_exit+0x98/0x230 [kvm_amd] Aug 22 22:21:14 juju-e4d256-prod-github-runner-207 kernel: [61048.600898] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 22:21:14 juju-e4d256-prod-github-runner-207 kernel: [61048.601821] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 22:21:14 juju-e4d256-prod-github-runner-207 kernel: [61048.602748] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 22:21:14 juju-e4d256-prod-github-runner-207 kernel: [61048.603678] vcpu_run+0x62/0x2c0 [kvm] Aug 22 22:21:14 juju-e4d256-prod-github-runner-207 kernel: [61048.604502] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 22:21:14 juju-e4d256-prod-github-runner-207 kernel: [61048.605349] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 22:21:14 juju-e4d256-prod-github-runner-207 kernel: [61048.606203] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 22:21:14 juju-e4d256-prod-github-runner-207 kernel: [61048.607000] ? __seccomp_filter+0x4a/0x4a0 Aug 22 22:21:14 juju-e4d256-prod-github-runner-207 kernel: [61048.607743] ? __fget_files+0x86/0xc0 Aug 22 22:21:14 juju-e4d256-prod-github-runner-207 kernel: [61048.608446] __x64_sys_ioctl+0x95/0xd0 Aug 22 22:21:14 juju-e4d256-prod-github-runner-207 kernel: [61048.609175] do_syscall_64+0x5c/0xc0 Aug 22 22:21:14 juju-e4d256-prod-github-runner-207 kernel: [61048.609845] ? do_futex+0x162/0x1f0 Aug 22 22:21:14 juju-e4d256-prod-github-runner-207 kernel: [61048.610532] ? __x64_sys_futex+0x78/0x1e0 Aug 22 22:21:14 juju-e4d256-prod-github-runner-207 kernel: [61048.611237] ? __secure_computing+0xa9/0x120 Aug 22 22:21:14 juju-e4d256-prod-github-runner-207 kernel: [61048.611929] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 22:21:14 juju-e4d256-prod-github-runner-207 kernel: [61048.612703] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:21:14 juju-e4d256-prod-github-runner-207 kernel: [61048.613428] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:21:14 juju-e4d256-prod-github-runner-207 kernel: [61048.614152] ? do_syscall_64+0x69/0xc0 Aug 22 22:21:14 juju-e4d256-prod-github-runner-207 kernel: [61048.614824] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:21:14 juju-e4d256-prod-github-runner-207 kernel: [61048.615536] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:21:14 juju-e4d256-prod-github-runner-207 kernel: [61048.616231] ? do_syscall_64+0x69/0xc0 Aug 22 22:21:14 juju-e4d256-prod-github-runner-207 kernel: [61048.616893] ? do_syscall_64+0x69/0xc0 Aug 22 22:21:14 juju-e4d256-prod-github-runner-207 kernel: [61048.617517] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 22:21:14 juju-e4d256-prod-github-runner-207 kernel: [61048.618223] RIP: 0033:0x7faa5d0edaff Aug 22 22:21:14 juju-e4d256-prod-github-runner-207 kernel: [61048.618886] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 22:21:14 juju-e4d256-prod-github-runner-207 kernel: [61048.620900] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 22:21:14 juju-e4d256-prod-github-runner-207 kernel: [61048.621819] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 22:21:14 juju-e4d256-prod-github-runner-207 kernel: [61048.622710] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 22:21:14 juju-e4d256-prod-github-runner-207 kernel: [61048.623618] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 22:21:14 juju-e4d256-prod-github-runner-207 kernel: [61048.624506] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 22:21:14 juju-e4d256-prod-github-runner-207 kernel: [61048.625431] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 22:21:14 juju-e4d256-prod-github-runner-207 kernel: [61048.626369] Aug 22 22:21:42 juju-e4d256-prod-github-runner-207 kernel: [61076.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 56773s! [qemu-system-x86:6715] Aug 22 22:21:42 juju-e4d256-prod-github-runner-207 kernel: [61076.543888] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 22:21:42 juju-e4d256-prod-github-runner-207 kernel: [61076.544179] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 22:21:42 juju-e4d256-prod-github-runner-207 kernel: [61076.556593] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 22:21:42 juju-e4d256-prod-github-runner-207 kernel: [61076.557863] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 22:21:42 juju-e4d256-prod-github-runner-207 kernel: [61076.559105] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:21:42 juju-e4d256-prod-github-runner-207 kernel: [61076.560524] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 22:21:42 juju-e4d256-prod-github-runner-207 kernel: [61076.563160] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 22:21:42 juju-e4d256-prod-github-runner-207 kernel: [61076.564268] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 22:21:42 juju-e4d256-prod-github-runner-207 kernel: [61076.565469] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 22:21:42 juju-e4d256-prod-github-runner-207 kernel: [61076.566644] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 22:21:42 juju-e4d256-prod-github-runner-207 kernel: [61076.567870] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 22:21:42 juju-e4d256-prod-github-runner-207 kernel: [61076.569097] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 22:21:42 juju-e4d256-prod-github-runner-207 kernel: [61076.570331] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 22:21:42 juju-e4d256-prod-github-runner-207 kernel: [61076.571679] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 22:21:42 juju-e4d256-prod-github-runner-207 kernel: [61076.572990] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 22:21:42 juju-e4d256-prod-github-runner-207 kernel: [61076.574236] Call Trace: Aug 22 22:21:42 juju-e4d256-prod-github-runner-207 kernel: [61076.575190] Aug 22 22:21:42 juju-e4d256-prod-github-runner-207 kernel: [61076.576248] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:21:42 juju-e4d256-prod-github-runner-207 kernel: [61076.577412] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:21:42 juju-e4d256-prod-github-runner-207 kernel: [61076.578548] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:21:42 juju-e4d256-prod-github-runner-207 kernel: [61076.579787] ? show_regs.part.0+0x23/0x29 Aug 22 22:21:42 juju-e4d256-prod-github-runner-207 kernel: [61076.580958] ? show_regs.cold+0x8/0xd Aug 22 22:21:42 juju-e4d256-prod-github-runner-207 kernel: [61076.582039] ? watchdog_timer_fn+0x1be/0x220 Aug 22 22:21:42 juju-e4d256-prod-github-runner-207 kernel: [61076.583157] ? lockup_detector_update_enable+0x60/0x60 Aug 22 22:21:42 juju-e4d256-prod-github-runner-207 kernel: [61076.584370] ? __hrtimer_run_queues+0x107/0x230 Aug 22 22:21:42 juju-e4d256-prod-github-runner-207 kernel: [61076.585540] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 22:21:42 juju-e4d256-prod-github-runner-207 kernel: [61076.586716] ? hrtimer_interrupt+0x101/0x220 Aug 22 22:21:42 juju-e4d256-prod-github-runner-207 kernel: [61076.587864] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 22:21:42 juju-e4d256-prod-github-runner-207 kernel: [61076.589088] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 22:21:42 juju-e4d256-prod-github-runner-207 kernel: [61076.590274] Aug 22 22:21:42 juju-e4d256-prod-github-runner-207 kernel: [61076.591384] Aug 22 22:21:42 juju-e4d256-prod-github-runner-207 kernel: [61076.592341] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 22:21:42 juju-e4d256-prod-github-runner-207 kernel: [61076.593530] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:21:42 juju-e4d256-prod-github-runner-207 kernel: [61076.594701] ? _raw_spin_lock+0x22/0x30 Aug 22 22:21:42 juju-e4d256-prod-github-runner-207 kernel: [61076.595752] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:21:42 juju-e4d256-prod-github-runner-207 kernel: [61076.597002] direct_page_fault+0x206/0x310 [kvm] Aug 22 22:21:42 juju-e4d256-prod-github-runner-207 kernel: [61076.598167] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 22:21:42 juju-e4d256-prod-github-runner-207 kernel: [61076.599377] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 22:21:42 juju-e4d256-prod-github-runner-207 kernel: [61076.600520] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 22:21:42 juju-e4d256-prod-github-runner-207 kernel: [61076.601670] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 22:21:42 juju-e4d256-prod-github-runner-207 kernel: [61076.602720] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 22:21:42 juju-e4d256-prod-github-runner-207 kernel: [61076.603811] handle_exit+0x98/0x230 [kvm_amd] Aug 22 22:21:42 juju-e4d256-prod-github-runner-207 kernel: [61076.605032] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 22:21:42 juju-e4d256-prod-github-runner-207 kernel: [61076.606241] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 22:21:42 juju-e4d256-prod-github-runner-207 kernel: [61076.607276] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 22:21:42 juju-e4d256-prod-github-runner-207 kernel: [61076.608303] vcpu_run+0x62/0x2c0 [kvm] Aug 22 22:21:42 juju-e4d256-prod-github-runner-207 kernel: [61076.609213] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 22:21:42 juju-e4d256-prod-github-runner-207 kernel: [61076.610126] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 22:21:42 juju-e4d256-prod-github-runner-207 kernel: [61076.611093] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 22:21:42 juju-e4d256-prod-github-runner-207 kernel: [61076.611988] ? __seccomp_filter+0x4a/0x4a0 Aug 22 22:21:42 juju-e4d256-prod-github-runner-207 kernel: [61076.612856] ? __fget_files+0x86/0xc0 Aug 22 22:21:42 juju-e4d256-prod-github-runner-207 kernel: [61076.613646] __x64_sys_ioctl+0x95/0xd0 Aug 22 22:21:42 juju-e4d256-prod-github-runner-207 kernel: [61076.614428] do_syscall_64+0x5c/0xc0 Aug 22 22:21:42 juju-e4d256-prod-github-runner-207 kernel: [61076.615176] ? do_futex+0x162/0x1f0 Aug 22 22:21:42 juju-e4d256-prod-github-runner-207 kernel: [61076.615901] ? __x64_sys_futex+0x78/0x1e0 Aug 22 22:21:42 juju-e4d256-prod-github-runner-207 kernel: [61076.616732] ? __secure_computing+0xa9/0x120 Aug 22 22:21:42 juju-e4d256-prod-github-runner-207 kernel: [61076.617539] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 22:21:42 juju-e4d256-prod-github-runner-207 kernel: [61076.618453] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:21:42 juju-e4d256-prod-github-runner-207 kernel: [61076.619297] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:21:42 juju-e4d256-prod-github-runner-207 kernel: [61076.620210] ? do_syscall_64+0x69/0xc0 Aug 22 22:21:42 juju-e4d256-prod-github-runner-207 kernel: [61076.621078] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:21:42 juju-e4d256-prod-github-runner-207 kernel: [61076.621824] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:21:42 juju-e4d256-prod-github-runner-207 kernel: [61076.622553] ? do_syscall_64+0x69/0xc0 Aug 22 22:21:42 juju-e4d256-prod-github-runner-207 kernel: [61076.623181] ? do_syscall_64+0x69/0xc0 Aug 22 22:21:42 juju-e4d256-prod-github-runner-207 kernel: [61076.623807] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 22:21:42 juju-e4d256-prod-github-runner-207 kernel: [61076.624546] RIP: 0033:0x7faa5d0edaff Aug 22 22:21:42 juju-e4d256-prod-github-runner-207 kernel: [61076.625238] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 22:21:42 juju-e4d256-prod-github-runner-207 kernel: [61076.627238] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 22:21:42 juju-e4d256-prod-github-runner-207 kernel: [61076.628154] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 22:21:42 juju-e4d256-prod-github-runner-207 kernel: [61076.629070] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 22:21:42 juju-e4d256-prod-github-runner-207 kernel: [61076.629964] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 22:21:42 juju-e4d256-prod-github-runner-207 kernel: [61076.630852] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 22:21:42 juju-e4d256-prod-github-runner-207 kernel: [61076.631748] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 22:21:42 juju-e4d256-prod-github-runner-207 kernel: [61076.632679] Aug 22 22:22:10 juju-e4d256-prod-github-runner-207 kernel: [61104.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 56800s! [qemu-system-x86:6715] Aug 22 22:22:10 juju-e4d256-prod-github-runner-207 kernel: [61104.543144] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 22:22:10 juju-e4d256-prod-github-runner-207 kernel: [61104.543219] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 22:22:10 juju-e4d256-prod-github-runner-207 kernel: [61104.557309] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 22:22:10 juju-e4d256-prod-github-runner-207 kernel: [61104.558766] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 22:22:10 juju-e4d256-prod-github-runner-207 kernel: [61104.560173] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:22:10 juju-e4d256-prod-github-runner-207 kernel: [61104.561352] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 22:22:10 juju-e4d256-prod-github-runner-207 kernel: [61104.564274] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 22:22:10 juju-e4d256-prod-github-runner-207 kernel: [61104.565442] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 22:22:10 juju-e4d256-prod-github-runner-207 kernel: [61104.566625] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 22:22:10 juju-e4d256-prod-github-runner-207 kernel: [61104.567789] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 22:22:10 juju-e4d256-prod-github-runner-207 kernel: [61104.568970] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 22:22:10 juju-e4d256-prod-github-runner-207 kernel: [61104.570158] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 22:22:10 juju-e4d256-prod-github-runner-207 kernel: [61104.571339] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 22:22:10 juju-e4d256-prod-github-runner-207 kernel: [61104.572602] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 22:22:10 juju-e4d256-prod-github-runner-207 kernel: [61104.573709] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 22:22:10 juju-e4d256-prod-github-runner-207 kernel: [61104.574902] Call Trace: Aug 22 22:22:10 juju-e4d256-prod-github-runner-207 kernel: [61104.575815] Aug 22 22:22:10 juju-e4d256-prod-github-runner-207 kernel: [61104.576718] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:22:10 juju-e4d256-prod-github-runner-207 kernel: [61104.577749] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:22:10 juju-e4d256-prod-github-runner-207 kernel: [61104.578774] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:22:10 juju-e4d256-prod-github-runner-207 kernel: [61104.579862] ? show_regs.part.0+0x23/0x29 Aug 22 22:22:10 juju-e4d256-prod-github-runner-207 kernel: [61104.580860] ? show_regs.cold+0x8/0xd Aug 22 22:22:10 juju-e4d256-prod-github-runner-207 kernel: [61104.581866] ? watchdog_timer_fn+0x1be/0x220 Aug 22 22:22:10 juju-e4d256-prod-github-runner-207 kernel: [61104.582900] ? lockup_detector_update_enable+0x60/0x60 Aug 22 22:22:10 juju-e4d256-prod-github-runner-207 kernel: [61104.583990] ? __hrtimer_run_queues+0x107/0x230 Aug 22 22:22:10 juju-e4d256-prod-github-runner-207 kernel: [61104.585024] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 22:22:10 juju-e4d256-prod-github-runner-207 kernel: [61104.586054] ? hrtimer_interrupt+0x101/0x220 Aug 22 22:22:10 juju-e4d256-prod-github-runner-207 kernel: [61104.587103] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 22:22:10 juju-e4d256-prod-github-runner-207 kernel: [61104.588209] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 22:22:10 juju-e4d256-prod-github-runner-207 kernel: [61104.589268] Aug 22 22:22:10 juju-e4d256-prod-github-runner-207 kernel: [61104.590141] Aug 22 22:22:10 juju-e4d256-prod-github-runner-207 kernel: [61104.590989] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 22:22:10 juju-e4d256-prod-github-runner-207 kernel: [61104.592046] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:22:10 juju-e4d256-prod-github-runner-207 kernel: [61104.593091] ? _raw_spin_lock+0x22/0x30 Aug 22 22:22:10 juju-e4d256-prod-github-runner-207 kernel: [61104.594041] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:22:10 juju-e4d256-prod-github-runner-207 kernel: [61104.595076] direct_page_fault+0x206/0x310 [kvm] Aug 22 22:22:10 juju-e4d256-prod-github-runner-207 kernel: [61104.596128] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 22:22:10 juju-e4d256-prod-github-runner-207 kernel: [61104.597144] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 22:22:10 juju-e4d256-prod-github-runner-207 kernel: [61104.598150] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 22:22:10 juju-e4d256-prod-github-runner-207 kernel: [61104.599120] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 22:22:10 juju-e4d256-prod-github-runner-207 kernel: [61104.600100] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 22:22:10 juju-e4d256-prod-github-runner-207 kernel: [61104.601094] handle_exit+0x98/0x230 [kvm_amd] Aug 22 22:22:10 juju-e4d256-prod-github-runner-207 kernel: [61104.602123] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 22:22:10 juju-e4d256-prod-github-runner-207 kernel: [61104.603046] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 22:22:10 juju-e4d256-prod-github-runner-207 kernel: [61104.603991] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 22:22:10 juju-e4d256-prod-github-runner-207 kernel: [61104.604916] vcpu_run+0x62/0x2c0 [kvm] Aug 22 22:22:10 juju-e4d256-prod-github-runner-207 kernel: [61104.605928] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 22:22:10 juju-e4d256-prod-github-runner-207 kernel: [61104.606741] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 22:22:10 juju-e4d256-prod-github-runner-207 kernel: [61104.607747] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 22:22:10 juju-e4d256-prod-github-runner-207 kernel: [61104.608611] ? __seccomp_filter+0x4a/0x4a0 Aug 22 22:22:10 juju-e4d256-prod-github-runner-207 kernel: [61104.609360] ? __fget_files+0x86/0xc0 Aug 22 22:22:10 juju-e4d256-prod-github-runner-207 kernel: [61104.610062] __x64_sys_ioctl+0x95/0xd0 Aug 22 22:22:10 juju-e4d256-prod-github-runner-207 kernel: [61104.610754] do_syscall_64+0x5c/0xc0 Aug 22 22:22:10 juju-e4d256-prod-github-runner-207 kernel: [61104.611421] ? do_futex+0x162/0x1f0 Aug 22 22:22:10 juju-e4d256-prod-github-runner-207 kernel: [61104.612082] ? __x64_sys_futex+0x78/0x1e0 Aug 22 22:22:10 juju-e4d256-prod-github-runner-207 kernel: [61104.612760] ? __secure_computing+0xa9/0x120 Aug 22 22:22:10 juju-e4d256-prod-github-runner-207 kernel: [61104.613449] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 22:22:10 juju-e4d256-prod-github-runner-207 kernel: [61104.614207] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:22:10 juju-e4d256-prod-github-runner-207 kernel: [61104.614939] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:22:10 juju-e4d256-prod-github-runner-207 kernel: [61104.615664] ? do_syscall_64+0x69/0xc0 Aug 22 22:22:10 juju-e4d256-prod-github-runner-207 kernel: [61104.616320] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:22:10 juju-e4d256-prod-github-runner-207 kernel: [61104.617023] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:22:10 juju-e4d256-prod-github-runner-207 kernel: [61104.617720] ? do_syscall_64+0x69/0xc0 Aug 22 22:22:10 juju-e4d256-prod-github-runner-207 kernel: [61104.618351] ? do_syscall_64+0x69/0xc0 Aug 22 22:22:10 juju-e4d256-prod-github-runner-207 kernel: [61104.618976] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 22:22:10 juju-e4d256-prod-github-runner-207 kernel: [61104.619682] RIP: 0033:0x7faa5d0edaff Aug 22 22:22:10 juju-e4d256-prod-github-runner-207 kernel: [61104.620317] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 22:22:10 juju-e4d256-prod-github-runner-207 kernel: [61104.622306] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 22:22:10 juju-e4d256-prod-github-runner-207 kernel: [61104.623222] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 22:22:10 juju-e4d256-prod-github-runner-207 kernel: [61104.624124] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 22:22:10 juju-e4d256-prod-github-runner-207 kernel: [61104.625019] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 22:22:10 juju-e4d256-prod-github-runner-207 kernel: [61104.625909] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 22:22:10 juju-e4d256-prod-github-runner-207 kernel: [61104.626797] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 22:22:10 juju-e4d256-prod-github-runner-207 kernel: [61104.627693] Aug 22 22:22:38 juju-e4d256-prod-github-runner-207 kernel: [61132.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 56826s! [qemu-system-x86:6715] Aug 22 22:22:38 juju-e4d256-prod-github-runner-207 kernel: [61132.543885] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 22:22:38 juju-e4d256-prod-github-runner-207 kernel: [61132.544192] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 22:22:38 juju-e4d256-prod-github-runner-207 kernel: [61132.556434] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 22:22:38 juju-e4d256-prod-github-runner-207 kernel: [61132.557708] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 22:22:38 juju-e4d256-prod-github-runner-207 kernel: [61132.558923] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:22:38 juju-e4d256-prod-github-runner-207 kernel: [61132.559989] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 22:22:38 juju-e4d256-prod-github-runner-207 kernel: [61132.562527] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 22:22:38 juju-e4d256-prod-github-runner-207 kernel: [61132.563578] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 22:22:38 juju-e4d256-prod-github-runner-207 kernel: [61132.564747] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 22:22:38 juju-e4d256-prod-github-runner-207 kernel: [61132.565909] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 22:22:38 juju-e4d256-prod-github-runner-207 kernel: [61132.567072] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 22:22:38 juju-e4d256-prod-github-runner-207 kernel: [61132.568245] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 22:22:38 juju-e4d256-prod-github-runner-207 kernel: [61132.569409] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 22:22:38 juju-e4d256-prod-github-runner-207 kernel: [61132.570671] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 22:22:38 juju-e4d256-prod-github-runner-207 kernel: [61132.571807] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 22:22:38 juju-e4d256-prod-github-runner-207 kernel: [61132.573008] Call Trace: Aug 22 22:22:38 juju-e4d256-prod-github-runner-207 kernel: [61132.573924] Aug 22 22:22:38 juju-e4d256-prod-github-runner-207 kernel: [61132.574854] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:22:38 juju-e4d256-prod-github-runner-207 kernel: [61132.575916] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:22:38 juju-e4d256-prod-github-runner-207 kernel: [61132.576947] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:22:38 juju-e4d256-prod-github-runner-207 kernel: [61132.578242] ? show_regs.part.0+0x23/0x29 Aug 22 22:22:38 juju-e4d256-prod-github-runner-207 kernel: [61132.579550] ? show_regs.cold+0x8/0xd Aug 22 22:22:38 juju-e4d256-prod-github-runner-207 kernel: [61132.580597] ? watchdog_timer_fn+0x1be/0x220 Aug 22 22:22:38 juju-e4d256-prod-github-runner-207 kernel: [61132.581644] ? lockup_detector_update_enable+0x60/0x60 Aug 22 22:22:38 juju-e4d256-prod-github-runner-207 kernel: [61132.582738] ? __hrtimer_run_queues+0x107/0x230 Aug 22 22:22:38 juju-e4d256-prod-github-runner-207 kernel: [61132.583812] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 22:22:38 juju-e4d256-prod-github-runner-207 kernel: [61132.584856] ? hrtimer_interrupt+0x101/0x220 Aug 22 22:22:38 juju-e4d256-prod-github-runner-207 kernel: [61132.585908] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 22:22:38 juju-e4d256-prod-github-runner-207 kernel: [61132.587055] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 22:22:38 juju-e4d256-prod-github-runner-207 kernel: [61132.588146] Aug 22 22:22:38 juju-e4d256-prod-github-runner-207 kernel: [61132.589080] Aug 22 22:22:38 juju-e4d256-prod-github-runner-207 kernel: [61132.589979] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 22:22:38 juju-e4d256-prod-github-runner-207 kernel: [61132.591121] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:22:38 juju-e4d256-prod-github-runner-207 kernel: [61132.592572] ? _raw_spin_lock+0x22/0x30 Aug 22 22:22:38 juju-e4d256-prod-github-runner-207 kernel: [61132.593967] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:22:38 juju-e4d256-prod-github-runner-207 kernel: [61132.595457] direct_page_fault+0x206/0x310 [kvm] Aug 22 22:22:38 juju-e4d256-prod-github-runner-207 kernel: [61132.597009] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 22:22:38 juju-e4d256-prod-github-runner-207 kernel: [61132.598397] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 22:22:38 juju-e4d256-prod-github-runner-207 kernel: [61132.599762] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 22:22:38 juju-e4d256-prod-github-runner-207 kernel: [61132.600884] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 22:22:38 juju-e4d256-prod-github-runner-207 kernel: [61132.601931] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 22:22:38 juju-e4d256-prod-github-runner-207 kernel: [61132.603009] handle_exit+0x98/0x230 [kvm_amd] Aug 22 22:22:38 juju-e4d256-prod-github-runner-207 kernel: [61132.604012] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 22:22:38 juju-e4d256-prod-github-runner-207 kernel: [61132.605018] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 22:22:38 juju-e4d256-prod-github-runner-207 kernel: [61132.606020] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 22:22:38 juju-e4d256-prod-github-runner-207 kernel: [61132.607034] vcpu_run+0x62/0x2c0 [kvm] Aug 22 22:22:38 juju-e4d256-prod-github-runner-207 kernel: [61132.607967] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 22:22:38 juju-e4d256-prod-github-runner-207 kernel: [61132.608882] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 22:22:38 juju-e4d256-prod-github-runner-207 kernel: [61132.609833] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 22:22:38 juju-e4d256-prod-github-runner-207 kernel: [61132.610757] ? __seccomp_filter+0x4a/0x4a0 Aug 22 22:22:38 juju-e4d256-prod-github-runner-207 kernel: [61132.611576] ? __fget_files+0x86/0xc0 Aug 22 22:22:38 juju-e4d256-prod-github-runner-207 kernel: [61132.612329] __x64_sys_ioctl+0x95/0xd0 Aug 22 22:22:38 juju-e4d256-prod-github-runner-207 kernel: [61132.613121] do_syscall_64+0x5c/0xc0 Aug 22 22:22:38 juju-e4d256-prod-github-runner-207 kernel: [61132.613895] ? do_futex+0x162/0x1f0 Aug 22 22:22:38 juju-e4d256-prod-github-runner-207 kernel: [61132.614653] ? __x64_sys_futex+0x78/0x1e0 Aug 22 22:22:38 juju-e4d256-prod-github-runner-207 kernel: [61132.615399] ? __secure_computing+0xa9/0x120 Aug 22 22:22:38 juju-e4d256-prod-github-runner-207 kernel: [61132.616169] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 22:22:38 juju-e4d256-prod-github-runner-207 kernel: [61132.617033] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:22:38 juju-e4d256-prod-github-runner-207 kernel: [61132.617822] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:22:38 juju-e4d256-prod-github-runner-207 kernel: [61132.618624] ? do_syscall_64+0x69/0xc0 Aug 22 22:22:38 juju-e4d256-prod-github-runner-207 kernel: [61132.619331] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:22:38 juju-e4d256-prod-github-runner-207 kernel: [61132.620132] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:22:38 juju-e4d256-prod-github-runner-207 kernel: [61132.620886] ? do_syscall_64+0x69/0xc0 Aug 22 22:22:38 juju-e4d256-prod-github-runner-207 kernel: [61132.621596] ? do_syscall_64+0x69/0xc0 Aug 22 22:22:38 juju-e4d256-prod-github-runner-207 kernel: [61132.622272] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 22:22:38 juju-e4d256-prod-github-runner-207 kernel: [61132.623077] RIP: 0033:0x7faa5d0edaff Aug 22 22:22:38 juju-e4d256-prod-github-runner-207 kernel: [61132.623819] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 22:22:38 juju-e4d256-prod-github-runner-207 kernel: [61132.625852] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 22:22:38 juju-e4d256-prod-github-runner-207 kernel: [61132.626770] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 22:22:38 juju-e4d256-prod-github-runner-207 kernel: [61132.627687] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 22:22:38 juju-e4d256-prod-github-runner-207 kernel: [61132.628578] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 22:22:38 juju-e4d256-prod-github-runner-207 kernel: [61132.629469] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 22:22:38 juju-e4d256-prod-github-runner-207 kernel: [61132.630360] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 22:22:38 juju-e4d256-prod-github-runner-207 kernel: [61132.631259] Aug 22 22:23:06 juju-e4d256-prod-github-runner-207 kernel: [61160.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 56852s! [qemu-system-x86:6715] Aug 22 22:23:06 juju-e4d256-prod-github-runner-207 kernel: [61160.543151] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 22:23:06 juju-e4d256-prod-github-runner-207 kernel: [61160.543235] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 22:23:06 juju-e4d256-prod-github-runner-207 kernel: [61160.555439] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 22:23:06 juju-e4d256-prod-github-runner-207 kernel: [61160.556784] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 22:23:06 juju-e4d256-prod-github-runner-207 kernel: [61160.558003] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:23:06 juju-e4d256-prod-github-runner-207 kernel: [61160.559056] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 22:23:06 juju-e4d256-prod-github-runner-207 kernel: [61160.561615] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 22:23:06 juju-e4d256-prod-github-runner-207 kernel: [61160.562662] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 22:23:06 juju-e4d256-prod-github-runner-207 kernel: [61160.563831] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 22:23:06 juju-e4d256-prod-github-runner-207 kernel: [61160.564988] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 22:23:06 juju-e4d256-prod-github-runner-207 kernel: [61160.566159] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 22:23:06 juju-e4d256-prod-github-runner-207 kernel: [61160.567333] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 22:23:06 juju-e4d256-prod-github-runner-207 kernel: [61160.568500] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 22:23:06 juju-e4d256-prod-github-runner-207 kernel: [61160.569736] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 22:23:06 juju-e4d256-prod-github-runner-207 kernel: [61160.570838] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 22:23:06 juju-e4d256-prod-github-runner-207 kernel: [61160.572052] Call Trace: Aug 22 22:23:06 juju-e4d256-prod-github-runner-207 kernel: [61160.572999] Aug 22 22:23:06 juju-e4d256-prod-github-runner-207 kernel: [61160.573888] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:23:06 juju-e4d256-prod-github-runner-207 kernel: [61160.574929] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:23:06 juju-e4d256-prod-github-runner-207 kernel: [61160.575999] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:23:06 juju-e4d256-prod-github-runner-207 kernel: [61160.577075] ? show_regs.part.0+0x23/0x29 Aug 22 22:23:06 juju-e4d256-prod-github-runner-207 kernel: [61160.578081] ? show_regs.cold+0x8/0xd Aug 22 22:23:06 juju-e4d256-prod-github-runner-207 kernel: [61160.579062] ? watchdog_timer_fn+0x1be/0x220 Aug 22 22:23:06 juju-e4d256-prod-github-runner-207 kernel: [61160.580081] ? lockup_detector_update_enable+0x60/0x60 Aug 22 22:23:06 juju-e4d256-prod-github-runner-207 kernel: [61160.581141] ? __hrtimer_run_queues+0x107/0x230 Aug 22 22:23:06 juju-e4d256-prod-github-runner-207 kernel: [61160.582168] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 22:23:06 juju-e4d256-prod-github-runner-207 kernel: [61160.583202] ? hrtimer_interrupt+0x101/0x220 Aug 22 22:23:06 juju-e4d256-prod-github-runner-207 kernel: [61160.584245] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 22:23:06 juju-e4d256-prod-github-runner-207 kernel: [61160.585339] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 22:23:06 juju-e4d256-prod-github-runner-207 kernel: [61160.586392] Aug 22 22:23:06 juju-e4d256-prod-github-runner-207 kernel: [61160.587257] Aug 22 22:23:06 juju-e4d256-prod-github-runner-207 kernel: [61160.588095] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 22:23:06 juju-e4d256-prod-github-runner-207 kernel: [61160.589158] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:23:06 juju-e4d256-prod-github-runner-207 kernel: [61160.590219] ? _raw_spin_lock+0x22/0x30 Aug 22 22:23:06 juju-e4d256-prod-github-runner-207 kernel: [61160.591333] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:23:06 juju-e4d256-prod-github-runner-207 kernel: [61160.592380] direct_page_fault+0x206/0x310 [kvm] Aug 22 22:23:06 juju-e4d256-prod-github-runner-207 kernel: [61160.593542] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 22:23:06 juju-e4d256-prod-github-runner-207 kernel: [61160.594548] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 22:23:06 juju-e4d256-prod-github-runner-207 kernel: [61160.595685] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 22:23:06 juju-e4d256-prod-github-runner-207 kernel: [61160.596662] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 22:23:06 juju-e4d256-prod-github-runner-207 kernel: [61160.597607] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 22:23:06 juju-e4d256-prod-github-runner-207 kernel: [61160.598584] handle_exit+0x98/0x230 [kvm_amd] Aug 22 22:23:06 juju-e4d256-prod-github-runner-207 kernel: [61160.599483] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 22:23:06 juju-e4d256-prod-github-runner-207 kernel: [61160.600399] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 22:23:06 juju-e4d256-prod-github-runner-207 kernel: [61160.601328] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 22:23:06 juju-e4d256-prod-github-runner-207 kernel: [61160.602229] vcpu_run+0x62/0x2c0 [kvm] Aug 22 22:23:06 juju-e4d256-prod-github-runner-207 kernel: [61160.603047] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 22:23:06 juju-e4d256-prod-github-runner-207 kernel: [61160.603954] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 22:23:06 juju-e4d256-prod-github-runner-207 kernel: [61160.604811] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 22:23:06 juju-e4d256-prod-github-runner-207 kernel: [61160.605613] ? __seccomp_filter+0x4a/0x4a0 Aug 22 22:23:06 juju-e4d256-prod-github-runner-207 kernel: [61160.606355] ? __fget_files+0x86/0xc0 Aug 22 22:23:06 juju-e4d256-prod-github-runner-207 kernel: [61160.607063] __x64_sys_ioctl+0x95/0xd0 Aug 22 22:23:06 juju-e4d256-prod-github-runner-207 kernel: [61160.607766] do_syscall_64+0x5c/0xc0 Aug 22 22:23:06 juju-e4d256-prod-github-runner-207 kernel: [61160.608431] ? do_futex+0x162/0x1f0 Aug 22 22:23:06 juju-e4d256-prod-github-runner-207 kernel: [61160.609079] ? __x64_sys_futex+0x78/0x1e0 Aug 22 22:23:06 juju-e4d256-prod-github-runner-207 kernel: [61160.609773] ? __secure_computing+0xa9/0x120 Aug 22 22:23:06 juju-e4d256-prod-github-runner-207 kernel: [61160.610488] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 22:23:06 juju-e4d256-prod-github-runner-207 kernel: [61160.611295] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:23:06 juju-e4d256-prod-github-runner-207 kernel: [61160.612023] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:23:06 juju-e4d256-prod-github-runner-207 kernel: [61160.612742] ? do_syscall_64+0x69/0xc0 Aug 22 22:23:06 juju-e4d256-prod-github-runner-207 kernel: [61160.613395] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:23:06 juju-e4d256-prod-github-runner-207 kernel: [61160.614099] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:23:06 juju-e4d256-prod-github-runner-207 kernel: [61160.614806] ? do_syscall_64+0x69/0xc0 Aug 22 22:23:06 juju-e4d256-prod-github-runner-207 kernel: [61160.615490] ? do_syscall_64+0x69/0xc0 Aug 22 22:23:06 juju-e4d256-prod-github-runner-207 kernel: [61160.616120] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 22:23:06 juju-e4d256-prod-github-runner-207 kernel: [61160.616847] RIP: 0033:0x7faa5d0edaff Aug 22 22:23:06 juju-e4d256-prod-github-runner-207 kernel: [61160.617491] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 22:23:06 juju-e4d256-prod-github-runner-207 kernel: [61160.619491] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 22:23:06 juju-e4d256-prod-github-runner-207 kernel: [61160.620406] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 22:23:06 juju-e4d256-prod-github-runner-207 kernel: [61160.621298] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 22:23:06 juju-e4d256-prod-github-runner-207 kernel: [61160.622190] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 22:23:06 juju-e4d256-prod-github-runner-207 kernel: [61160.623081] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 22:23:06 juju-e4d256-prod-github-runner-207 kernel: [61160.623983] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 22:23:06 juju-e4d256-prod-github-runner-207 kernel: [61160.624873] Aug 22 22:23:34 juju-e4d256-prod-github-runner-207 kernel: [61188.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 56878s! [qemu-system-x86:6715] Aug 22 22:23:34 juju-e4d256-prod-github-runner-207 kernel: [61188.543207] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 22:23:34 juju-e4d256-prod-github-runner-207 kernel: [61188.543283] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 22:23:34 juju-e4d256-prod-github-runner-207 kernel: [61188.555399] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 22:23:34 juju-e4d256-prod-github-runner-207 kernel: [61188.556672] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 22:23:34 juju-e4d256-prod-github-runner-207 kernel: [61188.557891] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:23:34 juju-e4d256-prod-github-runner-207 kernel: [61188.558966] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 22:23:34 juju-e4d256-prod-github-runner-207 kernel: [61188.561516] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 22:23:34 juju-e4d256-prod-github-runner-207 kernel: [61188.562558] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 22:23:34 juju-e4d256-prod-github-runner-207 kernel: [61188.563739] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 22:23:34 juju-e4d256-prod-github-runner-207 kernel: [61188.564902] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 22:23:34 juju-e4d256-prod-github-runner-207 kernel: [61188.566065] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 22:23:34 juju-e4d256-prod-github-runner-207 kernel: [61188.567253] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 22:23:34 juju-e4d256-prod-github-runner-207 kernel: [61188.568420] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 22:23:34 juju-e4d256-prod-github-runner-207 kernel: [61188.569653] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 22:23:34 juju-e4d256-prod-github-runner-207 kernel: [61188.570806] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 22:23:34 juju-e4d256-prod-github-runner-207 kernel: [61188.572018] Call Trace: Aug 22 22:23:34 juju-e4d256-prod-github-runner-207 kernel: [61188.572944] Aug 22 22:23:34 juju-e4d256-prod-github-runner-207 kernel: [61188.573834] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:23:34 juju-e4d256-prod-github-runner-207 kernel: [61188.574887] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:23:34 juju-e4d256-prod-github-runner-207 kernel: [61188.575910] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:23:34 juju-e4d256-prod-github-runner-207 kernel: [61188.576989] ? show_regs.part.0+0x23/0x29 Aug 22 22:23:34 juju-e4d256-prod-github-runner-207 kernel: [61188.577989] ? show_regs.cold+0x8/0xd Aug 22 22:23:34 juju-e4d256-prod-github-runner-207 kernel: [61188.579001] ? watchdog_timer_fn+0x1be/0x220 Aug 22 22:23:34 juju-e4d256-prod-github-runner-207 kernel: [61188.580011] ? lockup_detector_update_enable+0x60/0x60 Aug 22 22:23:34 juju-e4d256-prod-github-runner-207 kernel: [61188.581076] ? __hrtimer_run_queues+0x107/0x230 Aug 22 22:23:34 juju-e4d256-prod-github-runner-207 kernel: [61188.582099] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 22:23:34 juju-e4d256-prod-github-runner-207 kernel: [61188.583154] ? hrtimer_interrupt+0x101/0x220 Aug 22 22:23:34 juju-e4d256-prod-github-runner-207 kernel: [61188.584175] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 22:23:34 juju-e4d256-prod-github-runner-207 kernel: [61188.585274] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 22:23:34 juju-e4d256-prod-github-runner-207 kernel: [61188.586346] Aug 22 22:23:34 juju-e4d256-prod-github-runner-207 kernel: [61188.587221] Aug 22 22:23:34 juju-e4d256-prod-github-runner-207 kernel: [61188.588057] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 22:23:34 juju-e4d256-prod-github-runner-207 kernel: [61188.589085] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:23:34 juju-e4d256-prod-github-runner-207 kernel: [61188.590246] ? _raw_spin_lock+0x22/0x30 Aug 22 22:23:34 juju-e4d256-prod-github-runner-207 kernel: [61188.591215] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:23:34 juju-e4d256-prod-github-runner-207 kernel: [61188.592236] direct_page_fault+0x206/0x310 [kvm] Aug 22 22:23:34 juju-e4d256-prod-github-runner-207 kernel: [61188.593258] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 22:23:34 juju-e4d256-prod-github-runner-207 kernel: [61188.594288] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 22:23:34 juju-e4d256-prod-github-runner-207 kernel: [61188.595322] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 22:23:34 juju-e4d256-prod-github-runner-207 kernel: [61188.596292] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 22:23:34 juju-e4d256-prod-github-runner-207 kernel: [61188.597238] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 22:23:34 juju-e4d256-prod-github-runner-207 kernel: [61188.598228] handle_exit+0x98/0x230 [kvm_amd] Aug 22 22:23:34 juju-e4d256-prod-github-runner-207 kernel: [61188.599139] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 22:23:34 juju-e4d256-prod-github-runner-207 kernel: [61188.600053] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 22:23:34 juju-e4d256-prod-github-runner-207 kernel: [61188.600978] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 22:23:34 juju-e4d256-prod-github-runner-207 kernel: [61188.601880] vcpu_run+0x62/0x2c0 [kvm] Aug 22 22:23:34 juju-e4d256-prod-github-runner-207 kernel: [61188.602720] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 22:23:34 juju-e4d256-prod-github-runner-207 kernel: [61188.603550] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 22:23:34 juju-e4d256-prod-github-runner-207 kernel: [61188.604402] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 22:23:34 juju-e4d256-prod-github-runner-207 kernel: [61188.605197] ? __seccomp_filter+0x4a/0x4a0 Aug 22 22:23:34 juju-e4d256-prod-github-runner-207 kernel: [61188.605943] ? __fget_files+0x86/0xc0 Aug 22 22:23:34 juju-e4d256-prod-github-runner-207 kernel: [61188.606646] __x64_sys_ioctl+0x95/0xd0 Aug 22 22:23:34 juju-e4d256-prod-github-runner-207 kernel: [61188.607363] do_syscall_64+0x5c/0xc0 Aug 22 22:23:34 juju-e4d256-prod-github-runner-207 kernel: [61188.608026] ? do_futex+0x162/0x1f0 Aug 22 22:23:34 juju-e4d256-prod-github-runner-207 kernel: [61188.608672] ? __x64_sys_futex+0x78/0x1e0 Aug 22 22:23:34 juju-e4d256-prod-github-runner-207 kernel: [61188.609342] ? __secure_computing+0xa9/0x120 Aug 22 22:23:34 juju-e4d256-prod-github-runner-207 kernel: [61188.610144] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 22:23:34 juju-e4d256-prod-github-runner-207 kernel: [61188.610926] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:23:34 juju-e4d256-prod-github-runner-207 kernel: [61188.611650] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:23:34 juju-e4d256-prod-github-runner-207 kernel: [61188.612367] ? do_syscall_64+0x69/0xc0 Aug 22 22:23:34 juju-e4d256-prod-github-runner-207 kernel: [61188.613007] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:23:34 juju-e4d256-prod-github-runner-207 kernel: [61188.613735] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:23:34 juju-e4d256-prod-github-runner-207 kernel: [61188.614442] ? do_syscall_64+0x69/0xc0 Aug 22 22:23:34 juju-e4d256-prod-github-runner-207 kernel: [61188.615112] ? do_syscall_64+0x69/0xc0 Aug 22 22:23:34 juju-e4d256-prod-github-runner-207 kernel: [61188.615757] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 22:23:34 juju-e4d256-prod-github-runner-207 kernel: [61188.616467] RIP: 0033:0x7faa5d0edaff Aug 22 22:23:34 juju-e4d256-prod-github-runner-207 kernel: [61188.617089] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 22:23:34 juju-e4d256-prod-github-runner-207 kernel: [61188.619118] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 22:23:34 juju-e4d256-prod-github-runner-207 kernel: [61188.620075] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 22:23:34 juju-e4d256-prod-github-runner-207 kernel: [61188.620971] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 22:23:34 juju-e4d256-prod-github-runner-207 kernel: [61188.621887] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 22:23:34 juju-e4d256-prod-github-runner-207 kernel: [61188.622796] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 22:23:34 juju-e4d256-prod-github-runner-207 kernel: [61188.623688] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 22:23:34 juju-e4d256-prod-github-runner-207 kernel: [61188.624586] Aug 22 22:23:47 juju-e4d256-prod-github-runner-207 kernel: [61201.268708] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 22:23:47 juju-e4d256-prod-github-runner-207 kernel: [61201.269742] rcu: 1-....: (15222895 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=7353090 Aug 22 22:23:47 juju-e4d256-prod-github-runner-207 kernel: [61201.270922] (t=15271017 jiffies g=23269 q=54746) Aug 22 22:23:47 juju-e4d256-prod-github-runner-207 kernel: [61201.271716] NMI backtrace for cpu 1 Aug 22 22:23:47 juju-e4d256-prod-github-runner-207 kernel: [61201.272454] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 22:23:47 juju-e4d256-prod-github-runner-207 kernel: [61201.273562] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 22:23:47 juju-e4d256-prod-github-runner-207 kernel: [61201.274653] Call Trace: Aug 22 22:23:47 juju-e4d256-prod-github-runner-207 kernel: [61201.275332] Aug 22 22:23:47 juju-e4d256-prod-github-runner-207 kernel: [61201.275990] show_stack+0x52/0x5c Aug 22 22:23:47 juju-e4d256-prod-github-runner-207 kernel: [61201.276731] dump_stack_lvl+0x4a/0x63 Aug 22 22:23:47 juju-e4d256-prod-github-runner-207 kernel: [61201.277490] dump_stack+0x10/0x16 Aug 22 22:23:47 juju-e4d256-prod-github-runner-207 kernel: [61201.278209] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 22:23:47 juju-e4d256-prod-github-runner-207 kernel: [61201.279011] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 22:23:47 juju-e4d256-prod-github-runner-207 kernel: [61201.279791] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 22:23:47 juju-e4d256-prod-github-runner-207 kernel: [61201.280633] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 22:23:47 juju-e4d256-prod-github-runner-207 kernel: [61201.281459] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 22:23:47 juju-e4d256-prod-github-runner-207 kernel: [61201.282267] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 22:23:47 juju-e4d256-prod-github-runner-207 kernel: [61201.283075] print_cpu_stall.cold+0x2f/0xe2 Aug 22 22:23:47 juju-e4d256-prod-github-runner-207 kernel: [61201.283845] ? timekeeping_update+0xf7/0x150 Aug 22 22:23:47 juju-e4d256-prod-github-runner-207 kernel: [61201.284623] check_cpu_stall+0x109/0x270 Aug 22 22:23:47 juju-e4d256-prod-github-runner-207 kernel: [61201.285371] rcu_sched_clock_irq+0x9a/0x250 Aug 22 22:23:47 juju-e4d256-prod-github-runner-207 kernel: [61201.286134] update_process_times+0x94/0xd0 Aug 22 22:23:47 juju-e4d256-prod-github-runner-207 kernel: [61201.286911] tick_sched_handle+0x29/0x70 Aug 22 22:23:47 juju-e4d256-prod-github-runner-207 kernel: [61201.287681] tick_sched_timer+0x8c/0xc0 Aug 22 22:23:47 juju-e4d256-prod-github-runner-207 kernel: [61201.288433] ? tick_nohz_handler+0xb0/0xb0 Aug 22 22:23:47 juju-e4d256-prod-github-runner-207 kernel: [61201.289186] __hrtimer_run_queues+0x107/0x230 Aug 22 22:23:47 juju-e4d256-prod-github-runner-207 kernel: [61201.289955] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 22:23:47 juju-e4d256-prod-github-runner-207 kernel: [61201.290745] hrtimer_interrupt+0x101/0x220 Aug 22 22:23:47 juju-e4d256-prod-github-runner-207 kernel: [61201.291504] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 22:23:47 juju-e4d256-prod-github-runner-207 kernel: [61201.292314] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 22:23:47 juju-e4d256-prod-github-runner-207 kernel: [61201.293114] Aug 22 22:23:47 juju-e4d256-prod-github-runner-207 kernel: [61201.293753] Aug 22 22:23:47 juju-e4d256-prod-github-runner-207 kernel: [61201.294380] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 22:23:47 juju-e4d256-prod-github-runner-207 kernel: [61201.295211] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:23:47 juju-e4d256-prod-github-runner-207 kernel: [61201.296088] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 22:23:47 juju-e4d256-prod-github-runner-207 kernel: [61201.298319] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 22:23:47 juju-e4d256-prod-github-runner-207 kernel: [61201.299228] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 22:23:47 juju-e4d256-prod-github-runner-207 kernel: [61201.300217] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 22:23:47 juju-e4d256-prod-github-runner-207 kernel: [61201.301189] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 22:23:47 juju-e4d256-prod-github-runner-207 kernel: [61201.302148] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 22:23:47 juju-e4d256-prod-github-runner-207 kernel: [61201.303113] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 22:23:47 juju-e4d256-prod-github-runner-207 kernel: [61201.304070] ? _raw_spin_lock+0x22/0x30 Aug 22 22:23:47 juju-e4d256-prod-github-runner-207 kernel: [61201.304837] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:23:47 juju-e4d256-prod-github-runner-207 kernel: [61201.305710] direct_page_fault+0x206/0x310 [kvm] Aug 22 22:23:47 juju-e4d256-prod-github-runner-207 kernel: [61201.306663] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 22:23:47 juju-e4d256-prod-github-runner-207 kernel: [61201.307633] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 22:23:47 juju-e4d256-prod-github-runner-207 kernel: [61201.308511] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 22:23:47 juju-e4d256-prod-github-runner-207 kernel: [61201.309347] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 22:23:47 juju-e4d256-prod-github-runner-207 kernel: [61201.310146] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 22:23:47 juju-e4d256-prod-github-runner-207 kernel: [61201.310999] handle_exit+0x98/0x230 [kvm_amd] Aug 22 22:23:47 juju-e4d256-prod-github-runner-207 kernel: [61201.311756] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 22:23:47 juju-e4d256-prod-github-runner-207 kernel: [61201.312545] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 22:23:47 juju-e4d256-prod-github-runner-207 kernel: [61201.313345] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 22:23:47 juju-e4d256-prod-github-runner-207 kernel: [61201.314132] vcpu_run+0x62/0x2c0 [kvm] Aug 22 22:23:47 juju-e4d256-prod-github-runner-207 kernel: [61201.314882] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 22:23:47 juju-e4d256-prod-github-runner-207 kernel: [61201.315625] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 22:23:47 juju-e4d256-prod-github-runner-207 kernel: [61201.316433] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 22:23:47 juju-e4d256-prod-github-runner-207 kernel: [61201.317217] ? __seccomp_filter+0x4a/0x4a0 Aug 22 22:23:47 juju-e4d256-prod-github-runner-207 kernel: [61201.317969] ? __fget_files+0x86/0xc0 Aug 22 22:23:47 juju-e4d256-prod-github-runner-207 kernel: [61201.318683] __x64_sys_ioctl+0x95/0xd0 Aug 22 22:23:47 juju-e4d256-prod-github-runner-207 kernel: [61201.319387] do_syscall_64+0x5c/0xc0 Aug 22 22:23:47 juju-e4d256-prod-github-runner-207 kernel: [61201.320073] ? do_futex+0x162/0x1f0 Aug 22 22:23:47 juju-e4d256-prod-github-runner-207 kernel: [61201.320755] ? __x64_sys_futex+0x78/0x1e0 Aug 22 22:23:47 juju-e4d256-prod-github-runner-207 kernel: [61201.321457] ? __secure_computing+0xa9/0x120 Aug 22 22:23:47 juju-e4d256-prod-github-runner-207 kernel: [61201.322178] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 22:23:47 juju-e4d256-prod-github-runner-207 kernel: [61201.322988] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:23:47 juju-e4d256-prod-github-runner-207 kernel: [61201.323753] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:23:47 juju-e4d256-prod-github-runner-207 kernel: [61201.324527] ? do_syscall_64+0x69/0xc0 Aug 22 22:23:47 juju-e4d256-prod-github-runner-207 kernel: [61201.325231] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:23:47 juju-e4d256-prod-github-runner-207 kernel: [61201.325990] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:23:47 juju-e4d256-prod-github-runner-207 kernel: [61201.326899] ? do_syscall_64+0x69/0xc0 Aug 22 22:23:47 juju-e4d256-prod-github-runner-207 kernel: [61201.327710] ? do_syscall_64+0x69/0xc0 Aug 22 22:23:47 juju-e4d256-prod-github-runner-207 kernel: [61201.328432] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 22:23:47 juju-e4d256-prod-github-runner-207 kernel: [61201.329209] RIP: 0033:0x7faa5d0edaff Aug 22 22:23:47 juju-e4d256-prod-github-runner-207 kernel: [61201.329891] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 22:23:47 juju-e4d256-prod-github-runner-207 kernel: [61201.332002] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 22:23:47 juju-e4d256-prod-github-runner-207 kernel: [61201.332996] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 22:23:47 juju-e4d256-prod-github-runner-207 kernel: [61201.333997] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 22:23:47 juju-e4d256-prod-github-runner-207 kernel: [61201.334972] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 22:23:47 juju-e4d256-prod-github-runner-207 kernel: [61201.335912] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 22:23:47 juju-e4d256-prod-github-runner-207 kernel: [61201.336837] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 22:23:47 juju-e4d256-prod-github-runner-207 kernel: [61201.337750] Aug 22 22:24:14 juju-e4d256-prod-github-runner-207 kernel: [61228.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 56915s! [qemu-system-x86:6715] Aug 22 22:24:14 juju-e4d256-prod-github-runner-207 kernel: [61228.543988] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 22:24:14 juju-e4d256-prod-github-runner-207 kernel: [61228.544310] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 22:24:14 juju-e4d256-prod-github-runner-207 kernel: [61228.556786] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 22:24:14 juju-e4d256-prod-github-runner-207 kernel: [61228.558064] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 22:24:14 juju-e4d256-prod-github-runner-207 kernel: [61228.559300] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:24:14 juju-e4d256-prod-github-runner-207 kernel: [61228.560359] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 22:24:14 juju-e4d256-prod-github-runner-207 kernel: [61228.563005] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 22:24:14 juju-e4d256-prod-github-runner-207 kernel: [61228.564072] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 22:24:14 juju-e4d256-prod-github-runner-207 kernel: [61228.565251] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 22:24:14 juju-e4d256-prod-github-runner-207 kernel: [61228.566422] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 22:24:14 juju-e4d256-prod-github-runner-207 kernel: [61228.567583] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 22:24:14 juju-e4d256-prod-github-runner-207 kernel: [61228.568751] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 22:24:14 juju-e4d256-prod-github-runner-207 kernel: [61228.569938] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 22:24:14 juju-e4d256-prod-github-runner-207 kernel: [61228.571211] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 22:24:14 juju-e4d256-prod-github-runner-207 kernel: [61228.572346] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 22:24:14 juju-e4d256-prod-github-runner-207 kernel: [61228.573537] Call Trace: Aug 22 22:24:14 juju-e4d256-prod-github-runner-207 kernel: [61228.574463] Aug 22 22:24:14 juju-e4d256-prod-github-runner-207 kernel: [61228.575359] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:24:14 juju-e4d256-prod-github-runner-207 kernel: [61228.576387] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:24:14 juju-e4d256-prod-github-runner-207 kernel: [61228.577439] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:24:14 juju-e4d256-prod-github-runner-207 kernel: [61228.578557] ? show_regs.part.0+0x23/0x29 Aug 22 22:24:14 juju-e4d256-prod-github-runner-207 kernel: [61228.579582] ? show_regs.cold+0x8/0xd Aug 22 22:24:14 juju-e4d256-prod-github-runner-207 kernel: [61228.580569] ? watchdog_timer_fn+0x1be/0x220 Aug 22 22:24:14 juju-e4d256-prod-github-runner-207 kernel: [61228.581584] ? lockup_detector_update_enable+0x60/0x60 Aug 22 22:24:14 juju-e4d256-prod-github-runner-207 kernel: [61228.582660] ? __hrtimer_run_queues+0x107/0x230 Aug 22 22:24:14 juju-e4d256-prod-github-runner-207 kernel: [61228.583688] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 22:24:14 juju-e4d256-prod-github-runner-207 kernel: [61228.584713] ? hrtimer_interrupt+0x101/0x220 Aug 22 22:24:14 juju-e4d256-prod-github-runner-207 kernel: [61228.585725] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 22:24:14 juju-e4d256-prod-github-runner-207 kernel: [61228.586800] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 22:24:14 juju-e4d256-prod-github-runner-207 kernel: [61228.587851] Aug 22 22:24:14 juju-e4d256-prod-github-runner-207 kernel: [61228.588719] Aug 22 22:24:14 juju-e4d256-prod-github-runner-207 kernel: [61228.589556] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 22:24:14 juju-e4d256-prod-github-runner-207 kernel: [61228.590631] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:24:14 juju-e4d256-prod-github-runner-207 kernel: [61228.591674] ? _raw_spin_lock+0x22/0x30 Aug 22 22:24:14 juju-e4d256-prod-github-runner-207 kernel: [61228.592643] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:24:14 juju-e4d256-prod-github-runner-207 kernel: [61228.593743] direct_page_fault+0x206/0x310 [kvm] Aug 22 22:24:14 juju-e4d256-prod-github-runner-207 kernel: [61228.594783] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 22:24:14 juju-e4d256-prod-github-runner-207 kernel: [61228.595792] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 22:24:14 juju-e4d256-prod-github-runner-207 kernel: [61228.596793] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 22:24:14 juju-e4d256-prod-github-runner-207 kernel: [61228.597818] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 22:24:14 juju-e4d256-prod-github-runner-207 kernel: [61228.598784] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 22:24:14 juju-e4d256-prod-github-runner-207 kernel: [61228.599766] handle_exit+0x98/0x230 [kvm_amd] Aug 22 22:24:14 juju-e4d256-prod-github-runner-207 kernel: [61228.600657] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 22:24:14 juju-e4d256-prod-github-runner-207 kernel: [61228.601614] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 22:24:14 juju-e4d256-prod-github-runner-207 kernel: [61228.602570] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 22:24:14 juju-e4d256-prod-github-runner-207 kernel: [61228.603474] vcpu_run+0x62/0x2c0 [kvm] Aug 22 22:24:14 juju-e4d256-prod-github-runner-207 kernel: [61228.604289] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 22:24:14 juju-e4d256-prod-github-runner-207 kernel: [61228.605102] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 22:24:14 juju-e4d256-prod-github-runner-207 kernel: [61228.605976] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 22:24:14 juju-e4d256-prod-github-runner-207 kernel: [61228.606800] ? __seccomp_filter+0x4a/0x4a0 Aug 22 22:24:14 juju-e4d256-prod-github-runner-207 kernel: [61228.607578] ? __fget_files+0x86/0xc0 Aug 22 22:24:14 juju-e4d256-prod-github-runner-207 kernel: [61228.608284] __x64_sys_ioctl+0x95/0xd0 Aug 22 22:24:14 juju-e4d256-prod-github-runner-207 kernel: [61228.608976] do_syscall_64+0x5c/0xc0 Aug 22 22:24:14 juju-e4d256-prod-github-runner-207 kernel: [61228.609645] ? do_futex+0x162/0x1f0 Aug 22 22:24:14 juju-e4d256-prod-github-runner-207 kernel: [61228.610313] ? __x64_sys_futex+0x78/0x1e0 Aug 22 22:24:14 juju-e4d256-prod-github-runner-207 kernel: [61228.611164] ? __secure_computing+0xa9/0x120 Aug 22 22:24:14 juju-e4d256-prod-github-runner-207 kernel: [61228.611972] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 22:24:14 juju-e4d256-prod-github-runner-207 kernel: [61228.612731] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:24:14 juju-e4d256-prod-github-runner-207 kernel: [61228.613451] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:24:14 juju-e4d256-prod-github-runner-207 kernel: [61228.614172] ? do_syscall_64+0x69/0xc0 Aug 22 22:24:14 juju-e4d256-prod-github-runner-207 kernel: [61228.614826] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:24:14 juju-e4d256-prod-github-runner-207 kernel: [61228.615528] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:24:14 juju-e4d256-prod-github-runner-207 kernel: [61228.616225] ? do_syscall_64+0x69/0xc0 Aug 22 22:24:14 juju-e4d256-prod-github-runner-207 kernel: [61228.616905] ? do_syscall_64+0x69/0xc0 Aug 22 22:24:14 juju-e4d256-prod-github-runner-207 kernel: [61228.617529] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 22:24:14 juju-e4d256-prod-github-runner-207 kernel: [61228.618275] RIP: 0033:0x7faa5d0edaff Aug 22 22:24:14 juju-e4d256-prod-github-runner-207 kernel: [61228.618964] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 22:24:14 juju-e4d256-prod-github-runner-207 kernel: [61228.620949] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 22:24:14 juju-e4d256-prod-github-runner-207 kernel: [61228.621870] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 22:24:14 juju-e4d256-prod-github-runner-207 kernel: [61228.622799] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 22:24:14 juju-e4d256-prod-github-runner-207 kernel: [61228.623686] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 22:24:14 juju-e4d256-prod-github-runner-207 kernel: [61228.624571] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 22:24:14 juju-e4d256-prod-github-runner-207 kernel: [61228.625512] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 22:24:14 juju-e4d256-prod-github-runner-207 kernel: [61228.626453] Aug 22 22:24:42 juju-e4d256-prod-github-runner-207 kernel: [61256.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 56941s! [qemu-system-x86:6715] Aug 22 22:24:42 juju-e4d256-prod-github-runner-207 kernel: [61256.543102] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 22:24:42 juju-e4d256-prod-github-runner-207 kernel: [61256.543175] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 22:24:42 juju-e4d256-prod-github-runner-207 kernel: [61256.556006] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 22:24:42 juju-e4d256-prod-github-runner-207 kernel: [61256.557307] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 22:24:42 juju-e4d256-prod-github-runner-207 kernel: [61256.558650] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:24:42 juju-e4d256-prod-github-runner-207 kernel: [61256.559707] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 22:24:42 juju-e4d256-prod-github-runner-207 kernel: [61256.562340] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 22:24:42 juju-e4d256-prod-github-runner-207 kernel: [61256.563425] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 22:24:42 juju-e4d256-prod-github-runner-207 kernel: [61256.564597] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 22:24:42 juju-e4d256-prod-github-runner-207 kernel: [61256.565821] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 22:24:42 juju-e4d256-prod-github-runner-207 kernel: [61256.567254] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 22:24:42 juju-e4d256-prod-github-runner-207 kernel: [61256.568503] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 22:24:42 juju-e4d256-prod-github-runner-207 kernel: [61256.569742] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 22:24:42 juju-e4d256-prod-github-runner-207 kernel: [61256.571054] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 22:24:42 juju-e4d256-prod-github-runner-207 kernel: [61256.572193] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 22:24:42 juju-e4d256-prod-github-runner-207 kernel: [61256.573389] Call Trace: Aug 22 22:24:42 juju-e4d256-prod-github-runner-207 kernel: [61256.574346] Aug 22 22:24:42 juju-e4d256-prod-github-runner-207 kernel: [61256.575262] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:24:42 juju-e4d256-prod-github-runner-207 kernel: [61256.576491] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:24:42 juju-e4d256-prod-github-runner-207 kernel: [61256.577524] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:24:42 juju-e4d256-prod-github-runner-207 kernel: [61256.578650] ? show_regs.part.0+0x23/0x29 Aug 22 22:24:42 juju-e4d256-prod-github-runner-207 kernel: [61256.579663] ? show_regs.cold+0x8/0xd Aug 22 22:24:42 juju-e4d256-prod-github-runner-207 kernel: [61256.580649] ? watchdog_timer_fn+0x1be/0x220 Aug 22 22:24:42 juju-e4d256-prod-github-runner-207 kernel: [61256.581667] ? lockup_detector_update_enable+0x60/0x60 Aug 22 22:24:42 juju-e4d256-prod-github-runner-207 kernel: [61256.582852] ? __hrtimer_run_queues+0x107/0x230 Aug 22 22:24:42 juju-e4d256-prod-github-runner-207 kernel: [61256.583886] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 22:24:42 juju-e4d256-prod-github-runner-207 kernel: [61256.584914] ? hrtimer_interrupt+0x101/0x220 Aug 22 22:24:42 juju-e4d256-prod-github-runner-207 kernel: [61256.585951] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 22:24:42 juju-e4d256-prod-github-runner-207 kernel: [61256.587025] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 22:24:42 juju-e4d256-prod-github-runner-207 kernel: [61256.588080] Aug 22 22:24:42 juju-e4d256-prod-github-runner-207 kernel: [61256.588988] Aug 22 22:24:42 juju-e4d256-prod-github-runner-207 kernel: [61256.590080] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 22:24:42 juju-e4d256-prod-github-runner-207 kernel: [61256.591135] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:24:42 juju-e4d256-prod-github-runner-207 kernel: [61256.592179] ? _raw_spin_lock+0x22/0x30 Aug 22 22:24:42 juju-e4d256-prod-github-runner-207 kernel: [61256.593135] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:24:42 juju-e4d256-prod-github-runner-207 kernel: [61256.594194] direct_page_fault+0x206/0x310 [kvm] Aug 22 22:24:42 juju-e4d256-prod-github-runner-207 kernel: [61256.595223] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 22:24:42 juju-e4d256-prod-github-runner-207 kernel: [61256.596234] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 22:24:42 juju-e4d256-prod-github-runner-207 kernel: [61256.597253] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 22:24:42 juju-e4d256-prod-github-runner-207 kernel: [61256.598275] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 22:24:42 juju-e4d256-prod-github-runner-207 kernel: [61256.599225] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 22:24:42 juju-e4d256-prod-github-runner-207 kernel: [61256.600208] handle_exit+0x98/0x230 [kvm_amd] Aug 22 22:24:42 juju-e4d256-prod-github-runner-207 kernel: [61256.601109] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 22:24:42 juju-e4d256-prod-github-runner-207 kernel: [61256.602361] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 22:24:42 juju-e4d256-prod-github-runner-207 kernel: [61256.603310] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 22:24:42 juju-e4d256-prod-github-runner-207 kernel: [61256.604254] vcpu_run+0x62/0x2c0 [kvm] Aug 22 22:24:42 juju-e4d256-prod-github-runner-207 kernel: [61256.605106] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 22:24:42 juju-e4d256-prod-github-runner-207 kernel: [61256.605939] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 22:24:42 juju-e4d256-prod-github-runner-207 kernel: [61256.606810] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 22:24:42 juju-e4d256-prod-github-runner-207 kernel: [61256.607619] ? __seccomp_filter+0x4a/0x4a0 Aug 22 22:24:42 juju-e4d256-prod-github-runner-207 kernel: [61256.608413] ? __fget_files+0x86/0xc0 Aug 22 22:24:42 juju-e4d256-prod-github-runner-207 kernel: [61256.609129] __x64_sys_ioctl+0x95/0xd0 Aug 22 22:24:42 juju-e4d256-prod-github-runner-207 kernel: [61256.609822] do_syscall_64+0x5c/0xc0 Aug 22 22:24:42 juju-e4d256-prod-github-runner-207 kernel: [61256.610511] ? do_futex+0x162/0x1f0 Aug 22 22:24:42 juju-e4d256-prod-github-runner-207 kernel: [61256.611160] ? __x64_sys_futex+0x78/0x1e0 Aug 22 22:24:42 juju-e4d256-prod-github-runner-207 kernel: [61256.611878] ? __secure_computing+0xa9/0x120 Aug 22 22:24:42 juju-e4d256-prod-github-runner-207 kernel: [61256.612583] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 22:24:42 juju-e4d256-prod-github-runner-207 kernel: [61256.613412] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:24:42 juju-e4d256-prod-github-runner-207 kernel: [61256.614160] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:24:42 juju-e4d256-prod-github-runner-207 kernel: [61256.614883] ? do_syscall_64+0x69/0xc0 Aug 22 22:24:42 juju-e4d256-prod-github-runner-207 kernel: [61256.615528] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:24:42 juju-e4d256-prod-github-runner-207 kernel: [61256.616231] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:24:42 juju-e4d256-prod-github-runner-207 kernel: [61256.616925] ? do_syscall_64+0x69/0xc0 Aug 22 22:24:42 juju-e4d256-prod-github-runner-207 kernel: [61256.617550] ? do_syscall_64+0x69/0xc0 Aug 22 22:24:42 juju-e4d256-prod-github-runner-207 kernel: [61256.618186] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 22:24:42 juju-e4d256-prod-github-runner-207 kernel: [61256.618893] RIP: 0033:0x7faa5d0edaff Aug 22 22:24:42 juju-e4d256-prod-github-runner-207 kernel: [61256.619519] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 22:24:42 juju-e4d256-prod-github-runner-207 kernel: [61256.621505] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 22:24:42 juju-e4d256-prod-github-runner-207 kernel: [61256.622439] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 22:24:42 juju-e4d256-prod-github-runner-207 kernel: [61256.623334] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 22:24:42 juju-e4d256-prod-github-runner-207 kernel: [61256.624221] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 22:24:42 juju-e4d256-prod-github-runner-207 kernel: [61256.625126] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 22:24:42 juju-e4d256-prod-github-runner-207 kernel: [61256.626030] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 22:24:42 juju-e4d256-prod-github-runner-207 kernel: [61256.626925] Aug 22 22:25:10 juju-e4d256-prod-github-runner-207 kernel: [61284.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 56967s! [qemu-system-x86:6715] Aug 22 22:25:10 juju-e4d256-prod-github-runner-207 kernel: [61284.543267] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 22:25:10 juju-e4d256-prod-github-runner-207 kernel: [61284.543340] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 22:25:10 juju-e4d256-prod-github-runner-207 kernel: [61284.555824] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 22:25:10 juju-e4d256-prod-github-runner-207 kernel: [61284.557261] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 22:25:10 juju-e4d256-prod-github-runner-207 kernel: [61284.558547] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:25:10 juju-e4d256-prod-github-runner-207 kernel: [61284.559708] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 22:25:10 juju-e4d256-prod-github-runner-207 kernel: [61284.562471] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 22:25:10 juju-e4d256-prod-github-runner-207 kernel: [61284.563536] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 22:25:10 juju-e4d256-prod-github-runner-207 kernel: [61284.564724] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 22:25:10 juju-e4d256-prod-github-runner-207 kernel: [61284.565959] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 22:25:10 juju-e4d256-prod-github-runner-207 kernel: [61284.567138] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 22:25:10 juju-e4d256-prod-github-runner-207 kernel: [61284.568354] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 22:25:10 juju-e4d256-prod-github-runner-207 kernel: [61284.569610] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 22:25:10 juju-e4d256-prod-github-runner-207 kernel: [61284.570930] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 22:25:10 juju-e4d256-prod-github-runner-207 kernel: [61284.572177] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 22:25:10 juju-e4d256-prod-github-runner-207 kernel: [61284.573495] Call Trace: Aug 22 22:25:10 juju-e4d256-prod-github-runner-207 kernel: [61284.574543] Aug 22 22:25:10 juju-e4d256-prod-github-runner-207 kernel: [61284.575538] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:25:10 juju-e4d256-prod-github-runner-207 kernel: [61284.576603] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:25:10 juju-e4d256-prod-github-runner-207 kernel: [61284.577674] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:25:10 juju-e4d256-prod-github-runner-207 kernel: [61284.578769] ? show_regs.part.0+0x23/0x29 Aug 22 22:25:10 juju-e4d256-prod-github-runner-207 kernel: [61284.579784] ? show_regs.cold+0x8/0xd Aug 22 22:25:10 juju-e4d256-prod-github-runner-207 kernel: [61284.580811] ? watchdog_timer_fn+0x1be/0x220 Aug 22 22:25:10 juju-e4d256-prod-github-runner-207 kernel: [61284.581987] ? lockup_detector_update_enable+0x60/0x60 Aug 22 22:25:10 juju-e4d256-prod-github-runner-207 kernel: [61284.583157] ? __hrtimer_run_queues+0x107/0x230 Aug 22 22:25:10 juju-e4d256-prod-github-runner-207 kernel: [61284.584319] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 22:25:10 juju-e4d256-prod-github-runner-207 kernel: [61284.585477] ? hrtimer_interrupt+0x101/0x220 Aug 22 22:25:10 juju-e4d256-prod-github-runner-207 kernel: [61284.586568] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 22:25:10 juju-e4d256-prod-github-runner-207 kernel: [61284.587657] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 22:25:10 juju-e4d256-prod-github-runner-207 kernel: [61284.588716] Aug 22 22:25:10 juju-e4d256-prod-github-runner-207 kernel: [61284.589609] Aug 22 22:25:10 juju-e4d256-prod-github-runner-207 kernel: [61284.590477] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 22:25:10 juju-e4d256-prod-github-runner-207 kernel: [61284.591541] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:25:10 juju-e4d256-prod-github-runner-207 kernel: [61284.592593] ? _raw_spin_lock+0x22/0x30 Aug 22 22:25:10 juju-e4d256-prod-github-runner-207 kernel: [61284.593563] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:25:10 juju-e4d256-prod-github-runner-207 kernel: [61284.594597] direct_page_fault+0x206/0x310 [kvm] Aug 22 22:25:10 juju-e4d256-prod-github-runner-207 kernel: [61284.595630] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 22:25:10 juju-e4d256-prod-github-runner-207 kernel: [61284.596693] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 22:25:10 juju-e4d256-prod-github-runner-207 kernel: [61284.597740] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 22:25:10 juju-e4d256-prod-github-runner-207 kernel: [61284.598749] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 22:25:10 juju-e4d256-prod-github-runner-207 kernel: [61284.599823] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 22:25:10 juju-e4d256-prod-github-runner-207 kernel: [61284.600927] handle_exit+0x98/0x230 [kvm_amd] Aug 22 22:25:10 juju-e4d256-prod-github-runner-207 kernel: [61284.601867] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 22:25:10 juju-e4d256-prod-github-runner-207 kernel: [61284.602814] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 22:25:10 juju-e4d256-prod-github-runner-207 kernel: [61284.603897] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 22:25:10 juju-e4d256-prod-github-runner-207 kernel: [61284.604875] vcpu_run+0x62/0x2c0 [kvm] Aug 22 22:25:10 juju-e4d256-prod-github-runner-207 kernel: [61284.605793] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 22:25:10 juju-e4d256-prod-github-runner-207 kernel: [61284.606687] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 22:25:10 juju-e4d256-prod-github-runner-207 kernel: [61284.607592] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 22:25:10 juju-e4d256-prod-github-runner-207 kernel: [61284.608401] ? __seccomp_filter+0x4a/0x4a0 Aug 22 22:25:10 juju-e4d256-prod-github-runner-207 kernel: [61284.609158] ? __fget_files+0x86/0xc0 Aug 22 22:25:10 juju-e4d256-prod-github-runner-207 kernel: [61284.609889] __x64_sys_ioctl+0x95/0xd0 Aug 22 22:25:10 juju-e4d256-prod-github-runner-207 kernel: [61284.610603] do_syscall_64+0x5c/0xc0 Aug 22 22:25:10 juju-e4d256-prod-github-runner-207 kernel: [61284.611277] ? do_futex+0x162/0x1f0 Aug 22 22:25:10 juju-e4d256-prod-github-runner-207 kernel: [61284.611935] ? __x64_sys_futex+0x78/0x1e0 Aug 22 22:25:10 juju-e4d256-prod-github-runner-207 kernel: [61284.612643] ? __secure_computing+0xa9/0x120 Aug 22 22:25:10 juju-e4d256-prod-github-runner-207 kernel: [61284.613355] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 22:25:10 juju-e4d256-prod-github-runner-207 kernel: [61284.614191] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:25:10 juju-e4d256-prod-github-runner-207 kernel: [61284.614930] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:25:10 juju-e4d256-prod-github-runner-207 kernel: [61284.615854] ? do_syscall_64+0x69/0xc0 Aug 22 22:25:10 juju-e4d256-prod-github-runner-207 kernel: [61284.616510] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:25:10 juju-e4d256-prod-github-runner-207 kernel: [61284.617228] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:25:10 juju-e4d256-prod-github-runner-207 kernel: [61284.617960] ? do_syscall_64+0x69/0xc0 Aug 22 22:25:10 juju-e4d256-prod-github-runner-207 kernel: [61284.618692] ? do_syscall_64+0x69/0xc0 Aug 22 22:25:10 juju-e4d256-prod-github-runner-207 kernel: [61284.619361] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 22:25:10 juju-e4d256-prod-github-runner-207 kernel: [61284.620109] RIP: 0033:0x7faa5d0edaff Aug 22 22:25:10 juju-e4d256-prod-github-runner-207 kernel: [61284.620803] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 22:25:10 juju-e4d256-prod-github-runner-207 kernel: [61284.622944] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 22:25:10 juju-e4d256-prod-github-runner-207 kernel: [61284.623928] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 22:25:10 juju-e4d256-prod-github-runner-207 kernel: [61284.624921] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 22:25:10 juju-e4d256-prod-github-runner-207 kernel: [61284.625945] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 22:25:10 juju-e4d256-prod-github-runner-207 kernel: [61284.626855] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 22:25:10 juju-e4d256-prod-github-runner-207 kernel: [61284.627752] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 22:25:10 juju-e4d256-prod-github-runner-207 kernel: [61284.628646] Aug 22 22:25:38 juju-e4d256-prod-github-runner-207 kernel: [61312.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 56993s! [qemu-system-x86:6715] Aug 22 22:25:38 juju-e4d256-prod-github-runner-207 kernel: [61312.543864] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 22:25:38 juju-e4d256-prod-github-runner-207 kernel: [61312.544161] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 22:25:38 juju-e4d256-prod-github-runner-207 kernel: [61312.556474] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 22:25:38 juju-e4d256-prod-github-runner-207 kernel: [61312.557769] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 22:25:38 juju-e4d256-prod-github-runner-207 kernel: [61312.559024] RIP: 0010:native_queued_spin_lock_slowpath+0xc/0x40 Aug 22 22:25:38 juju-e4d256-prod-github-runner-207 kernel: [61312.560161] Code: fe ff ff eb af 4c 89 fe 48 c7 c7 20 99 e9 89 e8 ca 69 55 00 e9 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 <8b> 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 eb Aug 22 22:25:38 juju-e4d256-prod-github-runner-207 kernel: [61312.562792] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 22:25:38 juju-e4d256-prod-github-runner-207 kernel: [61312.563844] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 22:25:38 juju-e4d256-prod-github-runner-207 kernel: [61312.565036] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 22:25:38 juju-e4d256-prod-github-runner-207 kernel: [61312.566255] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 22:25:38 juju-e4d256-prod-github-runner-207 kernel: [61312.567462] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 22:25:38 juju-e4d256-prod-github-runner-207 kernel: [61312.568693] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 22:25:38 juju-e4d256-prod-github-runner-207 kernel: [61312.569914] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 22:25:38 juju-e4d256-prod-github-runner-207 kernel: [61312.571217] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 22:25:38 juju-e4d256-prod-github-runner-207 kernel: [61312.572355] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 22:25:38 juju-e4d256-prod-github-runner-207 kernel: [61312.573677] Call Trace: Aug 22 22:25:38 juju-e4d256-prod-github-runner-207 kernel: [61312.574705] Aug 22 22:25:38 juju-e4d256-prod-github-runner-207 kernel: [61312.575630] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:25:38 juju-e4d256-prod-github-runner-207 kernel: [61312.576723] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:25:38 juju-e4d256-prod-github-runner-207 kernel: [61312.577844] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:25:38 juju-e4d256-prod-github-runner-207 kernel: [61312.579066] ? show_regs.part.0+0x23/0x29 Aug 22 22:25:38 juju-e4d256-prod-github-runner-207 kernel: [61312.580100] ? show_regs.cold+0x8/0xd Aug 22 22:25:38 juju-e4d256-prod-github-runner-207 kernel: [61312.581154] ? watchdog_timer_fn+0x1be/0x220 Aug 22 22:25:38 juju-e4d256-prod-github-runner-207 kernel: [61312.582245] ? lockup_detector_update_enable+0x60/0x60 Aug 22 22:25:38 juju-e4d256-prod-github-runner-207 kernel: [61312.583383] ? __hrtimer_run_queues+0x107/0x230 Aug 22 22:25:38 juju-e4d256-prod-github-runner-207 kernel: [61312.584483] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 22:25:38 juju-e4d256-prod-github-runner-207 kernel: [61312.585604] ? hrtimer_interrupt+0x101/0x220 Aug 22 22:25:38 juju-e4d256-prod-github-runner-207 kernel: [61312.586663] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 22:25:38 juju-e4d256-prod-github-runner-207 kernel: [61312.587749] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 22:25:38 juju-e4d256-prod-github-runner-207 kernel: [61312.588956] Aug 22 22:25:38 juju-e4d256-prod-github-runner-207 kernel: [61312.590077] Aug 22 22:25:38 juju-e4d256-prod-github-runner-207 kernel: [61312.590953] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 22:25:38 juju-e4d256-prod-github-runner-207 kernel: [61312.591992] ? native_queued_spin_lock_slowpath+0xc/0x40 Aug 22 22:25:38 juju-e4d256-prod-github-runner-207 kernel: [61312.593047] ? _raw_spin_lock+0x22/0x30 Aug 22 22:25:38 juju-e4d256-prod-github-runner-207 kernel: [61312.594028] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:25:38 juju-e4d256-prod-github-runner-207 kernel: [61312.595069] direct_page_fault+0x206/0x310 [kvm] Aug 22 22:25:38 juju-e4d256-prod-github-runner-207 kernel: [61312.596105] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 22:25:38 juju-e4d256-prod-github-runner-207 kernel: [61312.597216] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 22:25:38 juju-e4d256-prod-github-runner-207 kernel: [61312.598241] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 22:25:38 juju-e4d256-prod-github-runner-207 kernel: [61312.599256] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 22:25:38 juju-e4d256-prod-github-runner-207 kernel: [61312.600271] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 22:25:38 juju-e4d256-prod-github-runner-207 kernel: [61312.601285] handle_exit+0x98/0x230 [kvm_amd] Aug 22 22:25:38 juju-e4d256-prod-github-runner-207 kernel: [61312.602359] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 22:25:38 juju-e4d256-prod-github-runner-207 kernel: [61312.603279] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 22:25:38 juju-e4d256-prod-github-runner-207 kernel: [61312.604202] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 22:25:38 juju-e4d256-prod-github-runner-207 kernel: [61312.605112] vcpu_run+0x62/0x2c0 [kvm] Aug 22 22:25:38 juju-e4d256-prod-github-runner-207 kernel: [61312.605954] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 22:25:38 juju-e4d256-prod-github-runner-207 kernel: [61312.606781] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 22:25:38 juju-e4d256-prod-github-runner-207 kernel: [61312.607664] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 22:25:38 juju-e4d256-prod-github-runner-207 kernel: [61312.608471] ? __seccomp_filter+0x4a/0x4a0 Aug 22 22:25:38 juju-e4d256-prod-github-runner-207 kernel: [61312.609231] ? __fget_files+0x86/0xc0 Aug 22 22:25:38 juju-e4d256-prod-github-runner-207 kernel: [61312.609941] __x64_sys_ioctl+0x95/0xd0 Aug 22 22:25:38 juju-e4d256-prod-github-runner-207 kernel: [61312.610636] do_syscall_64+0x5c/0xc0 Aug 22 22:25:38 juju-e4d256-prod-github-runner-207 kernel: [61312.611301] ? do_futex+0x162/0x1f0 Aug 22 22:25:38 juju-e4d256-prod-github-runner-207 kernel: [61312.611952] ? __x64_sys_futex+0x78/0x1e0 Aug 22 22:25:38 juju-e4d256-prod-github-runner-207 kernel: [61312.612655] ? __secure_computing+0xa9/0x120 Aug 22 22:25:38 juju-e4d256-prod-github-runner-207 kernel: [61312.613400] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 22:25:38 juju-e4d256-prod-github-runner-207 kernel: [61312.614165] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:25:38 juju-e4d256-prod-github-runner-207 kernel: [61312.614911] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:25:38 juju-e4d256-prod-github-runner-207 kernel: [61312.615631] ? do_syscall_64+0x69/0xc0 Aug 22 22:25:38 juju-e4d256-prod-github-runner-207 kernel: [61312.616423] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:25:38 juju-e4d256-prod-github-runner-207 kernel: [61312.617183] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:25:38 juju-e4d256-prod-github-runner-207 kernel: [61312.617926] ? do_syscall_64+0x69/0xc0 Aug 22 22:25:38 juju-e4d256-prod-github-runner-207 kernel: [61312.618616] ? do_syscall_64+0x69/0xc0 Aug 22 22:25:38 juju-e4d256-prod-github-runner-207 kernel: [61312.619257] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 22:25:38 juju-e4d256-prod-github-runner-207 kernel: [61312.619985] RIP: 0033:0x7faa5d0edaff Aug 22 22:25:38 juju-e4d256-prod-github-runner-207 kernel: [61312.620681] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 22:25:38 juju-e4d256-prod-github-runner-207 kernel: [61312.622714] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 22:25:38 juju-e4d256-prod-github-runner-207 kernel: [61312.623630] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 22:25:38 juju-e4d256-prod-github-runner-207 kernel: [61312.624552] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 22:25:38 juju-e4d256-prod-github-runner-207 kernel: [61312.625832] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 22:25:38 juju-e4d256-prod-github-runner-207 kernel: [61312.627043] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 22:25:38 juju-e4d256-prod-github-runner-207 kernel: [61312.628232] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 22:25:38 juju-e4d256-prod-github-runner-207 kernel: [61312.629373] Aug 22 22:26:06 juju-e4d256-prod-github-runner-207 kernel: [61340.541980] watchdog: BUG: soft lockup - CPU#1 stuck for 57019s! [qemu-system-x86:6715] Aug 22 22:26:06 juju-e4d256-prod-github-runner-207 kernel: [61340.543118] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 22:26:06 juju-e4d256-prod-github-runner-207 kernel: [61340.543190] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 22:26:06 juju-e4d256-prod-github-runner-207 kernel: [61340.555782] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 22:26:06 juju-e4d256-prod-github-runner-207 kernel: [61340.557381] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 22:26:06 juju-e4d256-prod-github-runner-207 kernel: [61340.558690] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:26:06 juju-e4d256-prod-github-runner-207 kernel: [61340.559852] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 22:26:06 juju-e4d256-prod-github-runner-207 kernel: [61340.562503] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 22:26:06 juju-e4d256-prod-github-runner-207 kernel: [61340.563564] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 22:26:06 juju-e4d256-prod-github-runner-207 kernel: [61340.564799] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 22:26:06 juju-e4d256-prod-github-runner-207 kernel: [61340.566004] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 22:26:06 juju-e4d256-prod-github-runner-207 kernel: [61340.567244] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 22:26:06 juju-e4d256-prod-github-runner-207 kernel: [61340.568443] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 22:26:06 juju-e4d256-prod-github-runner-207 kernel: [61340.569661] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 22:26:06 juju-e4d256-prod-github-runner-207 kernel: [61340.570937] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 22:26:06 juju-e4d256-prod-github-runner-207 kernel: [61340.572080] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 22:26:06 juju-e4d256-prod-github-runner-207 kernel: [61340.573388] Call Trace: Aug 22 22:26:06 juju-e4d256-prod-github-runner-207 kernel: [61340.574436] Aug 22 22:26:06 juju-e4d256-prod-github-runner-207 kernel: [61340.575386] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:26:06 juju-e4d256-prod-github-runner-207 kernel: [61340.576515] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:26:06 juju-e4d256-prod-github-runner-207 kernel: [61340.577659] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:26:06 juju-e4d256-prod-github-runner-207 kernel: [61340.578858] ? show_regs.part.0+0x23/0x29 Aug 22 22:26:06 juju-e4d256-prod-github-runner-207 kernel: [61340.579958] ? show_regs.cold+0x8/0xd Aug 22 22:26:06 juju-e4d256-prod-github-runner-207 kernel: [61340.581018] ? watchdog_timer_fn+0x1be/0x220 Aug 22 22:26:06 juju-e4d256-prod-github-runner-207 kernel: [61340.582032] ? lockup_detector_update_enable+0x60/0x60 Aug 22 22:26:06 juju-e4d256-prod-github-runner-207 kernel: [61340.583095] ? __hrtimer_run_queues+0x107/0x230 Aug 22 22:26:06 juju-e4d256-prod-github-runner-207 kernel: [61340.584126] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 22:26:06 juju-e4d256-prod-github-runner-207 kernel: [61340.585162] ? hrtimer_interrupt+0x101/0x220 Aug 22 22:26:06 juju-e4d256-prod-github-runner-207 kernel: [61340.586216] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 22:26:06 juju-e4d256-prod-github-runner-207 kernel: [61340.587362] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 22:26:06 juju-e4d256-prod-github-runner-207 kernel: [61340.588422] Aug 22 22:26:06 juju-e4d256-prod-github-runner-207 kernel: [61340.589333] Aug 22 22:26:06 juju-e4d256-prod-github-runner-207 kernel: [61340.590229] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 22:26:06 juju-e4d256-prod-github-runner-207 kernel: [61340.591299] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:26:06 juju-e4d256-prod-github-runner-207 kernel: [61340.592338] ? _raw_spin_lock+0x22/0x30 Aug 22 22:26:06 juju-e4d256-prod-github-runner-207 kernel: [61340.593407] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:26:06 juju-e4d256-prod-github-runner-207 kernel: [61340.594482] direct_page_fault+0x206/0x310 [kvm] Aug 22 22:26:06 juju-e4d256-prod-github-runner-207 kernel: [61340.595570] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 22:26:06 juju-e4d256-prod-github-runner-207 kernel: [61340.596605] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 22:26:06 juju-e4d256-prod-github-runner-207 kernel: [61340.597625] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 22:26:06 juju-e4d256-prod-github-runner-207 kernel: [61340.598647] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 22:26:06 juju-e4d256-prod-github-runner-207 kernel: [61340.599594] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 22:26:06 juju-e4d256-prod-github-runner-207 kernel: [61340.600627] handle_exit+0x98/0x230 [kvm_amd] Aug 22 22:26:06 juju-e4d256-prod-github-runner-207 kernel: [61340.601617] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 22:26:06 juju-e4d256-prod-github-runner-207 kernel: [61340.602566] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 22:26:06 juju-e4d256-prod-github-runner-207 kernel: [61340.603504] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 22:26:06 juju-e4d256-prod-github-runner-207 kernel: [61340.604440] vcpu_run+0x62/0x2c0 [kvm] Aug 22 22:26:06 juju-e4d256-prod-github-runner-207 kernel: [61340.605365] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 22:26:06 juju-e4d256-prod-github-runner-207 kernel: [61340.606286] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 22:26:06 juju-e4d256-prod-github-runner-207 kernel: [61340.607293] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 22:26:06 juju-e4d256-prod-github-runner-207 kernel: [61340.608217] ? __seccomp_filter+0x4a/0x4a0 Aug 22 22:26:06 juju-e4d256-prod-github-runner-207 kernel: [61340.609113] ? __fget_files+0x86/0xc0 Aug 22 22:26:06 juju-e4d256-prod-github-runner-207 kernel: [61340.609926] __x64_sys_ioctl+0x95/0xd0 Aug 22 22:26:06 juju-e4d256-prod-github-runner-207 kernel: [61340.610697] do_syscall_64+0x5c/0xc0 Aug 22 22:26:06 juju-e4d256-prod-github-runner-207 kernel: [61340.611435] ? do_futex+0x162/0x1f0 Aug 22 22:26:06 juju-e4d256-prod-github-runner-207 kernel: [61340.612204] ? __x64_sys_futex+0x78/0x1e0 Aug 22 22:26:06 juju-e4d256-prod-github-runner-207 kernel: [61340.613016] ? __secure_computing+0xa9/0x120 Aug 22 22:26:06 juju-e4d256-prod-github-runner-207 kernel: [61340.613793] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 22:26:06 juju-e4d256-prod-github-runner-207 kernel: [61340.614658] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:26:06 juju-e4d256-prod-github-runner-207 kernel: [61340.615681] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:26:06 juju-e4d256-prod-github-runner-207 kernel: [61340.616539] ? do_syscall_64+0x69/0xc0 Aug 22 22:26:06 juju-e4d256-prod-github-runner-207 kernel: [61340.617505] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:26:06 juju-e4d256-prod-github-runner-207 kernel: [61340.618360] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:26:06 juju-e4d256-prod-github-runner-207 kernel: [61340.619217] ? do_syscall_64+0x69/0xc0 Aug 22 22:26:06 juju-e4d256-prod-github-runner-207 kernel: [61340.619983] ? do_syscall_64+0x69/0xc0 Aug 22 22:26:06 juju-e4d256-prod-github-runner-207 kernel: [61340.620702] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 22:26:06 juju-e4d256-prod-github-runner-207 kernel: [61340.621546] RIP: 0033:0x7faa5d0edaff Aug 22 22:26:06 juju-e4d256-prod-github-runner-207 kernel: [61340.622254] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 22:26:06 juju-e4d256-prod-github-runner-207 kernel: [61340.624697] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 22:26:06 juju-e4d256-prod-github-runner-207 kernel: [61340.625852] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 22:26:06 juju-e4d256-prod-github-runner-207 kernel: [61340.626840] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 22:26:06 juju-e4d256-prod-github-runner-207 kernel: [61340.627740] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 22:26:06 juju-e4d256-prod-github-runner-207 kernel: [61340.628635] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 22:26:06 juju-e4d256-prod-github-runner-207 kernel: [61340.629633] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 22:26:06 juju-e4d256-prod-github-runner-207 kernel: [61340.630562] Aug 22 22:26:34 juju-e4d256-prod-github-runner-207 kernel: [61368.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 57045s! [qemu-system-x86:6715] Aug 22 22:26:34 juju-e4d256-prod-github-runner-207 kernel: [61368.543097] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 22:26:34 juju-e4d256-prod-github-runner-207 kernel: [61368.543371] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 22:26:34 juju-e4d256-prod-github-runner-207 kernel: [61368.555549] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 22:26:34 juju-e4d256-prod-github-runner-207 kernel: [61368.556980] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 22:26:34 juju-e4d256-prod-github-runner-207 kernel: [61368.558236] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:26:34 juju-e4d256-prod-github-runner-207 kernel: [61368.559314] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 22:26:34 juju-e4d256-prod-github-runner-207 kernel: [61368.561926] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 22:26:34 juju-e4d256-prod-github-runner-207 kernel: [61368.563049] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 22:26:34 juju-e4d256-prod-github-runner-207 kernel: [61368.564216] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 22:26:34 juju-e4d256-prod-github-runner-207 kernel: [61368.565395] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 22:26:34 juju-e4d256-prod-github-runner-207 kernel: [61368.566602] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 22:26:34 juju-e4d256-prod-github-runner-207 kernel: [61368.567795] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 22:26:34 juju-e4d256-prod-github-runner-207 kernel: [61368.569019] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 22:26:34 juju-e4d256-prod-github-runner-207 kernel: [61368.570308] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 22:26:34 juju-e4d256-prod-github-runner-207 kernel: [61368.571453] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 22:26:34 juju-e4d256-prod-github-runner-207 kernel: [61368.572894] Call Trace: Aug 22 22:26:34 juju-e4d256-prod-github-runner-207 kernel: [61368.573828] Aug 22 22:26:34 juju-e4d256-prod-github-runner-207 kernel: [61368.574817] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:26:34 juju-e4d256-prod-github-runner-207 kernel: [61368.575884] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:26:34 juju-e4d256-prod-github-runner-207 kernel: [61368.576949] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:26:34 juju-e4d256-prod-github-runner-207 kernel: [61368.578120] ? show_regs.part.0+0x23/0x29 Aug 22 22:26:34 juju-e4d256-prod-github-runner-207 kernel: [61368.579159] ? show_regs.cold+0x8/0xd Aug 22 22:26:34 juju-e4d256-prod-github-runner-207 kernel: [61368.580131] ? watchdog_timer_fn+0x1be/0x220 Aug 22 22:26:34 juju-e4d256-prod-github-runner-207 kernel: [61368.581212] ? lockup_detector_update_enable+0x60/0x60 Aug 22 22:26:34 juju-e4d256-prod-github-runner-207 kernel: [61368.582290] ? __hrtimer_run_queues+0x107/0x230 Aug 22 22:26:34 juju-e4d256-prod-github-runner-207 kernel: [61368.583324] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 22:26:34 juju-e4d256-prod-github-runner-207 kernel: [61368.584357] ? hrtimer_interrupt+0x101/0x220 Aug 22 22:26:34 juju-e4d256-prod-github-runner-207 kernel: [61368.585401] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 22:26:34 juju-e4d256-prod-github-runner-207 kernel: [61368.586527] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 22:26:34 juju-e4d256-prod-github-runner-207 kernel: [61368.587611] Aug 22 22:26:34 juju-e4d256-prod-github-runner-207 kernel: [61368.588476] Aug 22 22:26:34 juju-e4d256-prod-github-runner-207 kernel: [61368.589314] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 22:26:34 juju-e4d256-prod-github-runner-207 kernel: [61368.590385] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:26:34 juju-e4d256-prod-github-runner-207 kernel: [61368.591437] ? _raw_spin_lock+0x22/0x30 Aug 22 22:26:34 juju-e4d256-prod-github-runner-207 kernel: [61368.592388] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:26:34 juju-e4d256-prod-github-runner-207 kernel: [61368.593420] direct_page_fault+0x206/0x310 [kvm] Aug 22 22:26:34 juju-e4d256-prod-github-runner-207 kernel: [61368.594455] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 22:26:34 juju-e4d256-prod-github-runner-207 kernel: [61368.595504] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 22:26:34 juju-e4d256-prod-github-runner-207 kernel: [61368.596541] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 22:26:34 juju-e4d256-prod-github-runner-207 kernel: [61368.597526] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 22:26:34 juju-e4d256-prod-github-runner-207 kernel: [61368.598479] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 22:26:34 juju-e4d256-prod-github-runner-207 kernel: [61368.599462] handle_exit+0x98/0x230 [kvm_amd] Aug 22 22:26:34 juju-e4d256-prod-github-runner-207 kernel: [61368.600412] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 22:26:34 juju-e4d256-prod-github-runner-207 kernel: [61368.601385] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 22:26:34 juju-e4d256-prod-github-runner-207 kernel: [61368.602586] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 22:26:34 juju-e4d256-prod-github-runner-207 kernel: [61368.603513] vcpu_run+0x62/0x2c0 [kvm] Aug 22 22:26:34 juju-e4d256-prod-github-runner-207 kernel: [61368.604336] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 22:26:34 juju-e4d256-prod-github-runner-207 kernel: [61368.605165] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 22:26:34 juju-e4d256-prod-github-runner-207 kernel: [61368.606025] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 22:26:34 juju-e4d256-prod-github-runner-207 kernel: [61368.606826] ? __seccomp_filter+0x4a/0x4a0 Aug 22 22:26:34 juju-e4d256-prod-github-runner-207 kernel: [61368.607605] ? __fget_files+0x86/0xc0 Aug 22 22:26:34 juju-e4d256-prod-github-runner-207 kernel: [61368.608308] __x64_sys_ioctl+0x95/0xd0 Aug 22 22:26:34 juju-e4d256-prod-github-runner-207 kernel: [61368.609049] do_syscall_64+0x5c/0xc0 Aug 22 22:26:34 juju-e4d256-prod-github-runner-207 kernel: [61368.609715] ? do_futex+0x162/0x1f0 Aug 22 22:26:34 juju-e4d256-prod-github-runner-207 kernel: [61368.610408] ? __x64_sys_futex+0x78/0x1e0 Aug 22 22:26:34 juju-e4d256-prod-github-runner-207 kernel: [61368.611106] ? __secure_computing+0xa9/0x120 Aug 22 22:26:34 juju-e4d256-prod-github-runner-207 kernel: [61368.611793] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 22:26:34 juju-e4d256-prod-github-runner-207 kernel: [61368.612581] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:26:34 juju-e4d256-prod-github-runner-207 kernel: [61368.613311] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:26:34 juju-e4d256-prod-github-runner-207 kernel: [61368.614028] ? do_syscall_64+0x69/0xc0 Aug 22 22:26:34 juju-e4d256-prod-github-runner-207 kernel: [61368.614673] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:26:34 juju-e4d256-prod-github-runner-207 kernel: [61368.615383] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:26:34 juju-e4d256-prod-github-runner-207 kernel: [61368.616085] ? do_syscall_64+0x69/0xc0 Aug 22 22:26:34 juju-e4d256-prod-github-runner-207 kernel: [61368.616731] ? do_syscall_64+0x69/0xc0 Aug 22 22:26:34 juju-e4d256-prod-github-runner-207 kernel: [61368.617356] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 22:26:34 juju-e4d256-prod-github-runner-207 kernel: [61368.618065] RIP: 0033:0x7faa5d0edaff Aug 22 22:26:34 juju-e4d256-prod-github-runner-207 kernel: [61368.618687] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 22:26:34 juju-e4d256-prod-github-runner-207 kernel: [61368.620691] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 22:26:34 juju-e4d256-prod-github-runner-207 kernel: [61368.621607] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 22:26:34 juju-e4d256-prod-github-runner-207 kernel: [61368.622494] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 22:26:34 juju-e4d256-prod-github-runner-207 kernel: [61368.623390] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 22:26:34 juju-e4d256-prod-github-runner-207 kernel: [61368.624288] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 22:26:34 juju-e4d256-prod-github-runner-207 kernel: [61368.625191] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 22:26:34 juju-e4d256-prod-github-runner-207 kernel: [61368.626080] Aug 22 22:26:47 juju-e4d256-prod-github-runner-207 kernel: [61381.280707] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 22:26:47 juju-e4d256-prod-github-runner-207 kernel: [61381.281677] rcu: 1-....: (15267759 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=7374262 Aug 22 22:26:47 juju-e4d256-prod-github-runner-207 kernel: [61381.282833] (t=15316020 jiffies g=23269 q=54870) Aug 22 22:26:47 juju-e4d256-prod-github-runner-207 kernel: [61381.283632] NMI backtrace for cpu 1 Aug 22 22:26:47 juju-e4d256-prod-github-runner-207 kernel: [61381.284370] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 22:26:47 juju-e4d256-prod-github-runner-207 kernel: [61381.285501] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 22:26:47 juju-e4d256-prod-github-runner-207 kernel: [61381.286608] Call Trace: Aug 22 22:26:47 juju-e4d256-prod-github-runner-207 kernel: [61381.287288] Aug 22 22:26:47 juju-e4d256-prod-github-runner-207 kernel: [61381.287954] show_stack+0x52/0x5c Aug 22 22:26:47 juju-e4d256-prod-github-runner-207 kernel: [61381.288715] dump_stack_lvl+0x4a/0x63 Aug 22 22:26:47 juju-e4d256-prod-github-runner-207 kernel: [61381.289473] dump_stack+0x10/0x16 Aug 22 22:26:47 juju-e4d256-prod-github-runner-207 kernel: [61381.290196] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 22:26:47 juju-e4d256-prod-github-runner-207 kernel: [61381.290988] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 22:26:47 juju-e4d256-prod-github-runner-207 kernel: [61381.291776] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 22:26:47 juju-e4d256-prod-github-runner-207 kernel: [61381.292628] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 22:26:47 juju-e4d256-prod-github-runner-207 kernel: [61381.293462] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 22:26:47 juju-e4d256-prod-github-runner-207 kernel: [61381.294292] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 22:26:47 juju-e4d256-prod-github-runner-207 kernel: [61381.295072] print_cpu_stall.cold+0x2f/0xe2 Aug 22 22:26:47 juju-e4d256-prod-github-runner-207 kernel: [61381.295851] ? timekeeping_update+0xf7/0x150 Aug 22 22:26:47 juju-e4d256-prod-github-runner-207 kernel: [61381.296658] check_cpu_stall+0x109/0x270 Aug 22 22:26:47 juju-e4d256-prod-github-runner-207 kernel: [61381.297414] rcu_sched_clock_irq+0x9a/0x250 Aug 22 22:26:47 juju-e4d256-prod-github-runner-207 kernel: [61381.298193] update_process_times+0x94/0xd0 Aug 22 22:26:47 juju-e4d256-prod-github-runner-207 kernel: [61381.298965] tick_sched_handle+0x29/0x70 Aug 22 22:26:47 juju-e4d256-prod-github-runner-207 kernel: [61381.299721] tick_sched_timer+0x8c/0xc0 Aug 22 22:26:47 juju-e4d256-prod-github-runner-207 kernel: [61381.300480] ? tick_nohz_handler+0xb0/0xb0 Aug 22 22:26:47 juju-e4d256-prod-github-runner-207 kernel: [61381.301250] __hrtimer_run_queues+0x107/0x230 Aug 22 22:26:47 juju-e4d256-prod-github-runner-207 kernel: [61381.302035] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 22:26:47 juju-e4d256-prod-github-runner-207 kernel: [61381.302827] hrtimer_interrupt+0x101/0x220 Aug 22 22:26:47 juju-e4d256-prod-github-runner-207 kernel: [61381.303595] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 22:26:47 juju-e4d256-prod-github-runner-207 kernel: [61381.304428] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 22:26:47 juju-e4d256-prod-github-runner-207 kernel: [61381.305237] Aug 22 22:26:47 juju-e4d256-prod-github-runner-207 kernel: [61381.305872] Aug 22 22:26:47 juju-e4d256-prod-github-runner-207 kernel: [61381.306515] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 22:26:47 juju-e4d256-prod-github-runner-207 kernel: [61381.307365] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:26:47 juju-e4d256-prod-github-runner-207 kernel: [61381.308411] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 22:26:47 juju-e4d256-prod-github-runner-207 kernel: [61381.311047] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 22:26:47 juju-e4d256-prod-github-runner-207 kernel: [61381.312045] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 22:26:47 juju-e4d256-prod-github-runner-207 kernel: [61381.313192] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 22:26:47 juju-e4d256-prod-github-runner-207 kernel: [61381.314330] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 22:26:47 juju-e4d256-prod-github-runner-207 kernel: [61381.315456] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 22:26:47 juju-e4d256-prod-github-runner-207 kernel: [61381.316578] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 22:26:47 juju-e4d256-prod-github-runner-207 kernel: [61381.317674] ? _raw_spin_lock+0x22/0x30 Aug 22 22:26:47 juju-e4d256-prod-github-runner-207 kernel: [61381.318513] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:26:47 juju-e4d256-prod-github-runner-207 kernel: [61381.319440] direct_page_fault+0x206/0x310 [kvm] Aug 22 22:26:47 juju-e4d256-prod-github-runner-207 kernel: [61381.320387] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 22:26:47 juju-e4d256-prod-github-runner-207 kernel: [61381.321319] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 22:26:47 juju-e4d256-prod-github-runner-207 kernel: [61381.322235] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 22:26:47 juju-e4d256-prod-github-runner-207 kernel: [61381.323141] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 22:26:47 juju-e4d256-prod-github-runner-207 kernel: [61381.324023] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 22:26:47 juju-e4d256-prod-github-runner-207 kernel: [61381.324976] handle_exit+0x98/0x230 [kvm_amd] Aug 22 22:26:47 juju-e4d256-prod-github-runner-207 kernel: [61381.325831] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 22:26:47 juju-e4d256-prod-github-runner-207 kernel: [61381.326705] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 22:26:47 juju-e4d256-prod-github-runner-207 kernel: [61381.327601] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 22:26:47 juju-e4d256-prod-github-runner-207 kernel: [61381.328500] vcpu_run+0x62/0x2c0 [kvm] Aug 22 22:26:47 juju-e4d256-prod-github-runner-207 kernel: [61381.329291] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 22:26:47 juju-e4d256-prod-github-runner-207 kernel: [61381.330124] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 22:26:47 juju-e4d256-prod-github-runner-207 kernel: [61381.331033] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 22:26:47 juju-e4d256-prod-github-runner-207 kernel: [61381.331897] ? __seccomp_filter+0x4a/0x4a0 Aug 22 22:26:47 juju-e4d256-prod-github-runner-207 kernel: [61381.332748] ? __fget_files+0x86/0xc0 Aug 22 22:26:47 juju-e4d256-prod-github-runner-207 kernel: [61381.333525] __x64_sys_ioctl+0x95/0xd0 Aug 22 22:26:47 juju-e4d256-prod-github-runner-207 kernel: [61381.334302] do_syscall_64+0x5c/0xc0 Aug 22 22:26:47 juju-e4d256-prod-github-runner-207 kernel: [61381.335058] ? do_futex+0x162/0x1f0 Aug 22 22:26:47 juju-e4d256-prod-github-runner-207 kernel: [61381.335809] ? __x64_sys_futex+0x78/0x1e0 Aug 22 22:26:47 juju-e4d256-prod-github-runner-207 kernel: [61381.336616] ? __secure_computing+0xa9/0x120 Aug 22 22:26:47 juju-e4d256-prod-github-runner-207 kernel: [61381.337430] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 22:26:47 juju-e4d256-prod-github-runner-207 kernel: [61381.338330] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:26:47 juju-e4d256-prod-github-runner-207 kernel: [61381.339215] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:26:47 juju-e4d256-prod-github-runner-207 kernel: [61381.340069] ? do_syscall_64+0x69/0xc0 Aug 22 22:26:47 juju-e4d256-prod-github-runner-207 kernel: [61381.341043] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:26:47 juju-e4d256-prod-github-runner-207 kernel: [61381.341899] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:26:47 juju-e4d256-prod-github-runner-207 kernel: [61381.342761] ? do_syscall_64+0x69/0xc0 Aug 22 22:26:47 juju-e4d256-prod-github-runner-207 kernel: [61381.343539] ? do_syscall_64+0x69/0xc0 Aug 22 22:26:47 juju-e4d256-prod-github-runner-207 kernel: [61381.344326] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 22:26:47 juju-e4d256-prod-github-runner-207 kernel: [61381.345194] RIP: 0033:0x7faa5d0edaff Aug 22 22:26:47 juju-e4d256-prod-github-runner-207 kernel: [61381.345948] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 22:26:47 juju-e4d256-prod-github-runner-207 kernel: [61381.348728] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 22:26:47 juju-e4d256-prod-github-runner-207 kernel: [61381.349851] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 22:26:47 juju-e4d256-prod-github-runner-207 kernel: [61381.350975] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 22:26:47 juju-e4d256-prod-github-runner-207 kernel: [61381.352071] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 22:26:47 juju-e4d256-prod-github-runner-207 kernel: [61381.353189] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 22:26:47 juju-e4d256-prod-github-runner-207 kernel: [61381.354254] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 22:26:47 juju-e4d256-prod-github-runner-207 kernel: [61381.355312] Aug 22 22:27:14 juju-e4d256-prod-github-runner-207 kernel: [61408.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 57083s! [qemu-system-x86:6715] Aug 22 22:27:14 juju-e4d256-prod-github-runner-207 kernel: [61408.543909] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 22:27:14 juju-e4d256-prod-github-runner-207 kernel: [61408.544256] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 22:27:14 juju-e4d256-prod-github-runner-207 kernel: [61408.557680] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 22:27:14 juju-e4d256-prod-github-runner-207 kernel: [61408.559043] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 22:27:14 juju-e4d256-prod-github-runner-207 kernel: [61408.560395] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:27:14 juju-e4d256-prod-github-runner-207 kernel: [61408.561591] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 22:27:14 juju-e4d256-prod-github-runner-207 kernel: [61408.564521] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 22:27:14 juju-e4d256-prod-github-runner-207 kernel: [61408.565675] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 22:27:14 juju-e4d256-prod-github-runner-207 kernel: [61408.566938] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 22:27:14 juju-e4d256-prod-github-runner-207 kernel: [61408.568340] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 22:27:14 juju-e4d256-prod-github-runner-207 kernel: [61408.569560] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 22:27:14 juju-e4d256-prod-github-runner-207 kernel: [61408.570864] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 22:27:14 juju-e4d256-prod-github-runner-207 kernel: [61408.572331] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 22:27:14 juju-e4d256-prod-github-runner-207 kernel: [61408.573886] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 22:27:14 juju-e4d256-prod-github-runner-207 kernel: [61408.575081] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 22:27:14 juju-e4d256-prod-github-runner-207 kernel: [61408.576483] Call Trace: Aug 22 22:27:14 juju-e4d256-prod-github-runner-207 kernel: [61408.577505] Aug 22 22:27:14 juju-e4d256-prod-github-runner-207 kernel: [61408.578673] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:27:14 juju-e4d256-prod-github-runner-207 kernel: [61408.579748] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:27:14 juju-e4d256-prod-github-runner-207 kernel: [61408.580912] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:27:14 juju-e4d256-prod-github-runner-207 kernel: [61408.582089] ? show_regs.part.0+0x23/0x29 Aug 22 22:27:14 juju-e4d256-prod-github-runner-207 kernel: [61408.583169] ? show_regs.cold+0x8/0xd Aug 22 22:27:14 juju-e4d256-prod-github-runner-207 kernel: [61408.585131] ? watchdog_timer_fn+0x1be/0x220 Aug 22 22:27:14 juju-e4d256-prod-github-runner-207 kernel: [61408.586238] ? lockup_detector_update_enable+0x60/0x60 Aug 22 22:27:14 juju-e4d256-prod-github-runner-207 kernel: [61408.587410] ? __hrtimer_run_queues+0x107/0x230 Aug 22 22:27:14 juju-e4d256-prod-github-runner-207 kernel: [61408.588560] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 22:27:14 juju-e4d256-prod-github-runner-207 kernel: [61408.589675] ? hrtimer_interrupt+0x101/0x220 Aug 22 22:27:14 juju-e4d256-prod-github-runner-207 kernel: [61408.590893] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 22:27:14 juju-e4d256-prod-github-runner-207 kernel: [61408.592056] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 22:27:14 juju-e4d256-prod-github-runner-207 kernel: [61408.593261] Aug 22 22:27:14 juju-e4d256-prod-github-runner-207 kernel: [61408.594157] Aug 22 22:27:14 juju-e4d256-prod-github-runner-207 kernel: [61408.595068] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 22:27:14 juju-e4d256-prod-github-runner-207 kernel: [61408.596228] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:27:14 juju-e4d256-prod-github-runner-207 kernel: [61408.597309] ? _raw_spin_lock+0x22/0x30 Aug 22 22:27:14 juju-e4d256-prod-github-runner-207 kernel: [61408.598331] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:27:14 juju-e4d256-prod-github-runner-207 kernel: [61408.599397] direct_page_fault+0x206/0x310 [kvm] Aug 22 22:27:14 juju-e4d256-prod-github-runner-207 kernel: [61408.600479] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 22:27:14 juju-e4d256-prod-github-runner-207 kernel: [61408.601538] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 22:27:14 juju-e4d256-prod-github-runner-207 kernel: [61408.602629] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 22:27:14 juju-e4d256-prod-github-runner-207 kernel: [61408.603731] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 22:27:14 juju-e4d256-prod-github-runner-207 kernel: [61408.604766] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 22:27:14 juju-e4d256-prod-github-runner-207 kernel: [61408.605803] handle_exit+0x98/0x230 [kvm_amd] Aug 22 22:27:14 juju-e4d256-prod-github-runner-207 kernel: [61408.606769] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 22:27:14 juju-e4d256-prod-github-runner-207 kernel: [61408.607741] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 22:27:14 juju-e4d256-prod-github-runner-207 kernel: [61408.608812] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 22:27:14 juju-e4d256-prod-github-runner-207 kernel: [61408.609767] vcpu_run+0x62/0x2c0 [kvm] Aug 22 22:27:14 juju-e4d256-prod-github-runner-207 kernel: [61408.610659] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 22:27:14 juju-e4d256-prod-github-runner-207 kernel: [61408.611491] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 22:27:14 juju-e4d256-prod-github-runner-207 kernel: [61408.612455] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 22:27:14 juju-e4d256-prod-github-runner-207 kernel: [61408.613290] ? __seccomp_filter+0x4a/0x4a0 Aug 22 22:27:14 juju-e4d256-prod-github-runner-207 kernel: [61408.614086] ? __fget_files+0x86/0xc0 Aug 22 22:27:14 juju-e4d256-prod-github-runner-207 kernel: [61408.614876] __x64_sys_ioctl+0x95/0xd0 Aug 22 22:27:14 juju-e4d256-prod-github-runner-207 kernel: [61408.615606] do_syscall_64+0x5c/0xc0 Aug 22 22:27:14 juju-e4d256-prod-github-runner-207 kernel: [61408.616318] ? do_futex+0x162/0x1f0 Aug 22 22:27:14 juju-e4d256-prod-github-runner-207 kernel: [61408.617050] ? __x64_sys_futex+0x78/0x1e0 Aug 22 22:27:14 juju-e4d256-prod-github-runner-207 kernel: [61408.617772] ? __secure_computing+0xa9/0x120 Aug 22 22:27:14 juju-e4d256-prod-github-runner-207 kernel: [61408.618498] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 22:27:14 juju-e4d256-prod-github-runner-207 kernel: [61408.619317] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:27:14 juju-e4d256-prod-github-runner-207 kernel: [61408.620089] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:27:14 juju-e4d256-prod-github-runner-207 kernel: [61408.620878] ? do_syscall_64+0x69/0xc0 Aug 22 22:27:14 juju-e4d256-prod-github-runner-207 kernel: [61408.621560] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:27:14 juju-e4d256-prod-github-runner-207 kernel: [61408.622337] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:27:14 juju-e4d256-prod-github-runner-207 kernel: [61408.623062] ? do_syscall_64+0x69/0xc0 Aug 22 22:27:14 juju-e4d256-prod-github-runner-207 kernel: [61408.623714] ? do_syscall_64+0x69/0xc0 Aug 22 22:27:14 juju-e4d256-prod-github-runner-207 kernel: [61408.624402] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 22:27:14 juju-e4d256-prod-github-runner-207 kernel: [61408.625133] RIP: 0033:0x7faa5d0edaff Aug 22 22:27:14 juju-e4d256-prod-github-runner-207 kernel: [61408.625811] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 22:27:14 juju-e4d256-prod-github-runner-207 kernel: [61408.627966] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 22:27:14 juju-e4d256-prod-github-runner-207 kernel: [61408.629089] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 22:27:14 juju-e4d256-prod-github-runner-207 kernel: [61408.630038] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 22:27:14 juju-e4d256-prod-github-runner-207 kernel: [61408.631139] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 22:27:14 juju-e4d256-prod-github-runner-207 kernel: [61408.632248] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 22:27:14 juju-e4d256-prod-github-runner-207 kernel: [61408.633310] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 22:27:14 juju-e4d256-prod-github-runner-207 kernel: [61408.634406] Aug 22 22:27:42 juju-e4d256-prod-github-runner-207 kernel: [61436.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 57109s! [qemu-system-x86:6715] Aug 22 22:27:42 juju-e4d256-prod-github-runner-207 kernel: [61436.543227] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 22:27:42 juju-e4d256-prod-github-runner-207 kernel: [61436.543307] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 22:27:42 juju-e4d256-prod-github-runner-207 kernel: [61436.556642] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 22:27:42 juju-e4d256-prod-github-runner-207 kernel: [61436.558059] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 22:27:42 juju-e4d256-prod-github-runner-207 kernel: [61436.559427] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:27:42 juju-e4d256-prod-github-runner-207 kernel: [61436.560661] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 22:27:42 juju-e4d256-prod-github-runner-207 kernel: [61436.563426] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 22:27:42 juju-e4d256-prod-github-runner-207 kernel: [61436.564521] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 22:27:42 juju-e4d256-prod-github-runner-207 kernel: [61436.565770] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 22:27:42 juju-e4d256-prod-github-runner-207 kernel: [61436.567058] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 22:27:42 juju-e4d256-prod-github-runner-207 kernel: [61436.568281] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 22:27:42 juju-e4d256-prod-github-runner-207 kernel: [61436.569485] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 22:27:42 juju-e4d256-prod-github-runner-207 kernel: [61436.570735] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 22:27:42 juju-e4d256-prod-github-runner-207 kernel: [61436.572041] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 22:27:42 juju-e4d256-prod-github-runner-207 kernel: [61436.573188] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 22:27:42 juju-e4d256-prod-github-runner-207 kernel: [61436.574467] Call Trace: Aug 22 22:27:42 juju-e4d256-prod-github-runner-207 kernel: [61436.575442] Aug 22 22:27:42 juju-e4d256-prod-github-runner-207 kernel: [61436.576395] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:27:42 juju-e4d256-prod-github-runner-207 kernel: [61436.577460] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:27:42 juju-e4d256-prod-github-runner-207 kernel: [61436.578500] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:27:42 juju-e4d256-prod-github-runner-207 kernel: [61436.579611] ? show_regs.part.0+0x23/0x29 Aug 22 22:27:42 juju-e4d256-prod-github-runner-207 kernel: [61436.580642] ? show_regs.cold+0x8/0xd Aug 22 22:27:42 juju-e4d256-prod-github-runner-207 kernel: [61436.581674] ? watchdog_timer_fn+0x1be/0x220 Aug 22 22:27:42 juju-e4d256-prod-github-runner-207 kernel: [61436.582725] ? lockup_detector_update_enable+0x60/0x60 Aug 22 22:27:42 juju-e4d256-prod-github-runner-207 kernel: [61436.583831] ? __hrtimer_run_queues+0x107/0x230 Aug 22 22:27:42 juju-e4d256-prod-github-runner-207 kernel: [61436.584884] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 22:27:42 juju-e4d256-prod-github-runner-207 kernel: [61436.586197] ? hrtimer_interrupt+0x101/0x220 Aug 22 22:27:42 juju-e4d256-prod-github-runner-207 kernel: [61436.587426] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 22:27:42 juju-e4d256-prod-github-runner-207 kernel: [61436.588625] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 22:27:42 juju-e4d256-prod-github-runner-207 kernel: [61436.589729] Aug 22 22:27:42 juju-e4d256-prod-github-runner-207 kernel: [61436.590620] Aug 22 22:27:42 juju-e4d256-prod-github-runner-207 kernel: [61436.591485] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 22:27:42 juju-e4d256-prod-github-runner-207 kernel: [61436.592597] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:27:42 juju-e4d256-prod-github-runner-207 kernel: [61436.593654] ? _raw_spin_lock+0x22/0x30 Aug 22 22:27:42 juju-e4d256-prod-github-runner-207 kernel: [61436.594639] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:27:42 juju-e4d256-prod-github-runner-207 kernel: [61436.595746] direct_page_fault+0x206/0x310 [kvm] Aug 22 22:27:42 juju-e4d256-prod-github-runner-207 kernel: [61436.596855] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 22:27:42 juju-e4d256-prod-github-runner-207 kernel: [61436.597891] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 22:27:42 juju-e4d256-prod-github-runner-207 kernel: [61436.598932] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 22:27:42 juju-e4d256-prod-github-runner-207 kernel: [61436.599958] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 22:27:42 juju-e4d256-prod-github-runner-207 kernel: [61436.600972] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 22:27:42 juju-e4d256-prod-github-runner-207 kernel: [61436.602064] handle_exit+0x98/0x230 [kvm_amd] Aug 22 22:27:42 juju-e4d256-prod-github-runner-207 kernel: [61436.602989] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 22:27:42 juju-e4d256-prod-github-runner-207 kernel: [61436.603937] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 22:27:42 juju-e4d256-prod-github-runner-207 kernel: [61436.604912] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 22:27:42 juju-e4d256-prod-github-runner-207 kernel: [61436.605954] vcpu_run+0x62/0x2c0 [kvm] Aug 22 22:27:42 juju-e4d256-prod-github-runner-207 kernel: [61436.606952] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 22:27:42 juju-e4d256-prod-github-runner-207 kernel: [61436.608067] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 22:27:42 juju-e4d256-prod-github-runner-207 kernel: [61436.609062] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 22:27:42 juju-e4d256-prod-github-runner-207 kernel: [61436.609987] ? __seccomp_filter+0x4a/0x4a0 Aug 22 22:27:42 juju-e4d256-prod-github-runner-207 kernel: [61436.610815] ? __fget_files+0x86/0xc0 Aug 22 22:27:42 juju-e4d256-prod-github-runner-207 kernel: [61436.611664] __x64_sys_ioctl+0x95/0xd0 Aug 22 22:27:42 juju-e4d256-prod-github-runner-207 kernel: [61436.612452] do_syscall_64+0x5c/0xc0 Aug 22 22:27:42 juju-e4d256-prod-github-runner-207 kernel: [61436.613185] ? do_futex+0x162/0x1f0 Aug 22 22:27:42 juju-e4d256-prod-github-runner-207 kernel: [61436.613897] ? __x64_sys_futex+0x78/0x1e0 Aug 22 22:27:42 juju-e4d256-prod-github-runner-207 kernel: [61436.614632] ? __secure_computing+0xa9/0x120 Aug 22 22:27:42 juju-e4d256-prod-github-runner-207 kernel: [61436.615404] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 22:27:42 juju-e4d256-prod-github-runner-207 kernel: [61436.616290] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:27:42 juju-e4d256-prod-github-runner-207 kernel: [61436.617158] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:27:42 juju-e4d256-prod-github-runner-207 kernel: [61436.617988] ? do_syscall_64+0x69/0xc0 Aug 22 22:27:42 juju-e4d256-prod-github-runner-207 kernel: [61436.618688] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:27:42 juju-e4d256-prod-github-runner-207 kernel: [61436.619450] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:27:42 juju-e4d256-prod-github-runner-207 kernel: [61436.620222] ? do_syscall_64+0x69/0xc0 Aug 22 22:27:42 juju-e4d256-prod-github-runner-207 kernel: [61436.620896] ? do_syscall_64+0x69/0xc0 Aug 22 22:27:42 juju-e4d256-prod-github-runner-207 kernel: [61436.621576] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 22:27:42 juju-e4d256-prod-github-runner-207 kernel: [61436.622388] RIP: 0033:0x7faa5d0edaff Aug 22 22:27:42 juju-e4d256-prod-github-runner-207 kernel: [61436.623108] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 22:27:42 juju-e4d256-prod-github-runner-207 kernel: [61436.625186] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 22:27:42 juju-e4d256-prod-github-runner-207 kernel: [61436.626113] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 22:27:42 juju-e4d256-prod-github-runner-207 kernel: [61436.627044] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 22:27:42 juju-e4d256-prod-github-runner-207 kernel: [61436.627994] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 22:27:42 juju-e4d256-prod-github-runner-207 kernel: [61436.628898] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 22:27:42 juju-e4d256-prod-github-runner-207 kernel: [61436.629795] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 22:27:42 juju-e4d256-prod-github-runner-207 kernel: [61436.630723] Aug 22 22:28:10 juju-e4d256-prod-github-runner-207 kernel: [61464.541980] watchdog: BUG: soft lockup - CPU#1 stuck for 57135s! [qemu-system-x86:6715] Aug 22 22:28:10 juju-e4d256-prod-github-runner-207 kernel: [61464.543167] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 22:28:10 juju-e4d256-prod-github-runner-207 kernel: [61464.543273] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 22:28:10 juju-e4d256-prod-github-runner-207 kernel: [61464.556557] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 22:28:10 juju-e4d256-prod-github-runner-207 kernel: [61464.557897] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 22:28:10 juju-e4d256-prod-github-runner-207 kernel: [61464.559208] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:28:10 juju-e4d256-prod-github-runner-207 kernel: [61464.560352] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 22:28:10 juju-e4d256-prod-github-runner-207 kernel: [61464.563114] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 22:28:10 juju-e4d256-prod-github-runner-207 kernel: [61464.564236] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 22:28:10 juju-e4d256-prod-github-runner-207 kernel: [61464.565536] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 22:28:10 juju-e4d256-prod-github-runner-207 kernel: [61464.567178] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 22:28:10 juju-e4d256-prod-github-runner-207 kernel: [61464.568859] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 22:28:10 juju-e4d256-prod-github-runner-207 kernel: [61464.570115] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 22:28:10 juju-e4d256-prod-github-runner-207 kernel: [61464.571390] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 22:28:10 juju-e4d256-prod-github-runner-207 kernel: [61464.572745] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 22:28:10 juju-e4d256-prod-github-runner-207 kernel: [61464.574271] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 22:28:10 juju-e4d256-prod-github-runner-207 kernel: [61464.575839] Call Trace: Aug 22 22:28:10 juju-e4d256-prod-github-runner-207 kernel: [61464.576905] Aug 22 22:28:10 juju-e4d256-prod-github-runner-207 kernel: [61464.577901] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:28:10 juju-e4d256-prod-github-runner-207 kernel: [61464.579530] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:28:10 juju-e4d256-prod-github-runner-207 kernel: [61464.580858] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:28:10 juju-e4d256-prod-github-runner-207 kernel: [61464.582112] ? show_regs.part.0+0x23/0x29 Aug 22 22:28:10 juju-e4d256-prod-github-runner-207 kernel: [61464.583323] ? show_regs.cold+0x8/0xd Aug 22 22:28:10 juju-e4d256-prod-github-runner-207 kernel: [61464.584430] ? watchdog_timer_fn+0x1be/0x220 Aug 22 22:28:10 juju-e4d256-prod-github-runner-207 kernel: [61464.585594] ? lockup_detector_update_enable+0x60/0x60 Aug 22 22:28:10 juju-e4d256-prod-github-runner-207 kernel: [61464.586811] ? __hrtimer_run_queues+0x107/0x230 Aug 22 22:28:10 juju-e4d256-prod-github-runner-207 kernel: [61464.588016] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 22:28:10 juju-e4d256-prod-github-runner-207 kernel: [61464.589170] ? hrtimer_interrupt+0x101/0x220 Aug 22 22:28:10 juju-e4d256-prod-github-runner-207 kernel: [61464.590308] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 22:28:10 juju-e4d256-prod-github-runner-207 kernel: [61464.591535] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 22:28:10 juju-e4d256-prod-github-runner-207 kernel: [61464.592712] Aug 22 22:28:10 juju-e4d256-prod-github-runner-207 kernel: [61464.593635] Aug 22 22:28:10 juju-e4d256-prod-github-runner-207 kernel: [61464.594558] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 22:28:10 juju-e4d256-prod-github-runner-207 kernel: [61464.595803] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:28:10 juju-e4d256-prod-github-runner-207 kernel: [61464.596989] ? _raw_spin_lock+0x22/0x30 Aug 22 22:28:10 juju-e4d256-prod-github-runner-207 kernel: [61464.598049] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:28:10 juju-e4d256-prod-github-runner-207 kernel: [61464.599203] direct_page_fault+0x206/0x310 [kvm] Aug 22 22:28:10 juju-e4d256-prod-github-runner-207 kernel: [61464.600380] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 22:28:10 juju-e4d256-prod-github-runner-207 kernel: [61464.601594] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 22:28:10 juju-e4d256-prod-github-runner-207 kernel: [61464.602807] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 22:28:10 juju-e4d256-prod-github-runner-207 kernel: [61464.603992] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 22:28:10 juju-e4d256-prod-github-runner-207 kernel: [61464.605095] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 22:28:10 juju-e4d256-prod-github-runner-207 kernel: [61464.606237] handle_exit+0x98/0x230 [kvm_amd] Aug 22 22:28:10 juju-e4d256-prod-github-runner-207 kernel: [61464.607347] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 22:28:10 juju-e4d256-prod-github-runner-207 kernel: [61464.608444] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 22:28:10 juju-e4d256-prod-github-runner-207 kernel: [61464.609589] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 22:28:10 juju-e4d256-prod-github-runner-207 kernel: [61464.610680] vcpu_run+0x62/0x2c0 [kvm] Aug 22 22:28:10 juju-e4d256-prod-github-runner-207 kernel: [61464.611670] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 22:28:10 juju-e4d256-prod-github-runner-207 kernel: [61464.612626] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 22:28:10 juju-e4d256-prod-github-runner-207 kernel: [61464.613540] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 22:28:10 juju-e4d256-prod-github-runner-207 kernel: [61464.614557] ? __seccomp_filter+0x4a/0x4a0 Aug 22 22:28:10 juju-e4d256-prod-github-runner-207 kernel: [61464.615414] ? __fget_files+0x86/0xc0 Aug 22 22:28:10 juju-e4d256-prod-github-runner-207 kernel: [61464.616244] __x64_sys_ioctl+0x95/0xd0 Aug 22 22:28:10 juju-e4d256-prod-github-runner-207 kernel: [61464.617075] do_syscall_64+0x5c/0xc0 Aug 22 22:28:10 juju-e4d256-prod-github-runner-207 kernel: [61464.617854] ? do_futex+0x162/0x1f0 Aug 22 22:28:10 juju-e4d256-prod-github-runner-207 kernel: [61464.618605] ? __x64_sys_futex+0x78/0x1e0 Aug 22 22:28:10 juju-e4d256-prod-github-runner-207 kernel: [61464.619420] ? __secure_computing+0xa9/0x120 Aug 22 22:28:10 juju-e4d256-prod-github-runner-207 kernel: [61464.620240] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 22:28:10 juju-e4d256-prod-github-runner-207 kernel: [61464.621143] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:28:10 juju-e4d256-prod-github-runner-207 kernel: [61464.621994] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:28:10 juju-e4d256-prod-github-runner-207 kernel: [61464.622852] ? do_syscall_64+0x69/0xc0 Aug 22 22:28:10 juju-e4d256-prod-github-runner-207 kernel: [61464.623631] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:28:10 juju-e4d256-prod-github-runner-207 kernel: [61464.624472] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:28:10 juju-e4d256-prod-github-runner-207 kernel: [61464.625306] ? do_syscall_64+0x69/0xc0 Aug 22 22:28:10 juju-e4d256-prod-github-runner-207 kernel: [61464.626044] ? do_syscall_64+0x69/0xc0 Aug 22 22:28:10 juju-e4d256-prod-github-runner-207 kernel: [61464.626820] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 22:28:10 juju-e4d256-prod-github-runner-207 kernel: [61464.627695] RIP: 0033:0x7faa5d0edaff Aug 22 22:28:10 juju-e4d256-prod-github-runner-207 kernel: [61464.628421] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 22:28:10 juju-e4d256-prod-github-runner-207 kernel: [61464.630848] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 22:28:10 juju-e4d256-prod-github-runner-207 kernel: [61464.632300] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 22:28:10 juju-e4d256-prod-github-runner-207 kernel: [61464.633369] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 22:28:10 juju-e4d256-prod-github-runner-207 kernel: [61464.634429] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 22:28:10 juju-e4d256-prod-github-runner-207 kernel: [61464.635520] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 22:28:10 juju-e4d256-prod-github-runner-207 kernel: [61464.636621] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 22:28:10 juju-e4d256-prod-github-runner-207 kernel: [61464.637707] Aug 22 22:28:38 juju-e4d256-prod-github-runner-207 kernel: [61492.541980] watchdog: BUG: soft lockup - CPU#1 stuck for 57161s! [qemu-system-x86:6715] Aug 22 22:28:38 juju-e4d256-prod-github-runner-207 kernel: [61492.543888] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 22:28:38 juju-e4d256-prod-github-runner-207 kernel: [61492.544199] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 22:28:38 juju-e4d256-prod-github-runner-207 kernel: [61492.556494] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 22:28:38 juju-e4d256-prod-github-runner-207 kernel: [61492.557760] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 22:28:38 juju-e4d256-prod-github-runner-207 kernel: [61492.559007] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:28:38 juju-e4d256-prod-github-runner-207 kernel: [61492.560071] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 22:28:38 juju-e4d256-prod-github-runner-207 kernel: [61492.562647] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 22:28:38 juju-e4d256-prod-github-runner-207 kernel: [61492.563718] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 22:28:38 juju-e4d256-prod-github-runner-207 kernel: [61492.564881] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 22:28:38 juju-e4d256-prod-github-runner-207 kernel: [61492.566207] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 22:28:38 juju-e4d256-prod-github-runner-207 kernel: [61492.567543] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 22:28:38 juju-e4d256-prod-github-runner-207 kernel: [61492.568704] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 22:28:38 juju-e4d256-prod-github-runner-207 kernel: [61492.570011] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 22:28:38 juju-e4d256-prod-github-runner-207 kernel: [61492.571264] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 22:28:38 juju-e4d256-prod-github-runner-207 kernel: [61492.572577] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 22:28:38 juju-e4d256-prod-github-runner-207 kernel: [61492.573777] Call Trace: Aug 22 22:28:38 juju-e4d256-prod-github-runner-207 kernel: [61492.574690] Aug 22 22:28:38 juju-e4d256-prod-github-runner-207 kernel: [61492.575631] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:28:38 juju-e4d256-prod-github-runner-207 kernel: [61492.576697] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:28:38 juju-e4d256-prod-github-runner-207 kernel: [61492.577723] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:28:38 juju-e4d256-prod-github-runner-207 kernel: [61492.578822] ? show_regs.part.0+0x23/0x29 Aug 22 22:28:38 juju-e4d256-prod-github-runner-207 kernel: [61492.579848] ? show_regs.cold+0x8/0xd Aug 22 22:28:38 juju-e4d256-prod-github-runner-207 kernel: [61492.580828] ? watchdog_timer_fn+0x1be/0x220 Aug 22 22:28:38 juju-e4d256-prod-github-runner-207 kernel: [61492.581855] ? lockup_detector_update_enable+0x60/0x60 Aug 22 22:28:38 juju-e4d256-prod-github-runner-207 kernel: [61492.583010] ? __hrtimer_run_queues+0x107/0x230 Aug 22 22:28:38 juju-e4d256-prod-github-runner-207 kernel: [61492.584049] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 22:28:38 juju-e4d256-prod-github-runner-207 kernel: [61492.585079] ? hrtimer_interrupt+0x101/0x220 Aug 22 22:28:38 juju-e4d256-prod-github-runner-207 kernel: [61492.586096] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 22:28:38 juju-e4d256-prod-github-runner-207 kernel: [61492.587178] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 22:28:38 juju-e4d256-prod-github-runner-207 kernel: [61492.588235] Aug 22 22:28:38 juju-e4d256-prod-github-runner-207 kernel: [61492.589089] Aug 22 22:28:38 juju-e4d256-prod-github-runner-207 kernel: [61492.589925] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 22:28:38 juju-e4d256-prod-github-runner-207 kernel: [61492.590973] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:28:38 juju-e4d256-prod-github-runner-207 kernel: [61492.592025] ? _raw_spin_lock+0x22/0x30 Aug 22 22:28:38 juju-e4d256-prod-github-runner-207 kernel: [61492.592973] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:28:38 juju-e4d256-prod-github-runner-207 kernel: [61492.593993] direct_page_fault+0x206/0x310 [kvm] Aug 22 22:28:38 juju-e4d256-prod-github-runner-207 kernel: [61492.595044] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 22:28:38 juju-e4d256-prod-github-runner-207 kernel: [61492.596073] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 22:28:38 juju-e4d256-prod-github-runner-207 kernel: [61492.597090] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 22:28:38 juju-e4d256-prod-github-runner-207 kernel: [61492.598106] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 22:28:38 juju-e4d256-prod-github-runner-207 kernel: [61492.599082] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 22:28:38 juju-e4d256-prod-github-runner-207 kernel: [61492.600128] handle_exit+0x98/0x230 [kvm_amd] Aug 22 22:28:38 juju-e4d256-prod-github-runner-207 kernel: [61492.601040] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 22:28:38 juju-e4d256-prod-github-runner-207 kernel: [61492.601966] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 22:28:38 juju-e4d256-prod-github-runner-207 kernel: [61492.602923] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 22:28:38 juju-e4d256-prod-github-runner-207 kernel: [61492.603845] vcpu_run+0x62/0x2c0 [kvm] Aug 22 22:28:38 juju-e4d256-prod-github-runner-207 kernel: [61492.604668] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 22:28:38 juju-e4d256-prod-github-runner-207 kernel: [61492.605492] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 22:28:38 juju-e4d256-prod-github-runner-207 kernel: [61492.606353] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 22:28:38 juju-e4d256-prod-github-runner-207 kernel: [61492.607172] ? __seccomp_filter+0x4a/0x4a0 Aug 22 22:28:38 juju-e4d256-prod-github-runner-207 kernel: [61492.607926] ? __fget_files+0x86/0xc0 Aug 22 22:28:38 juju-e4d256-prod-github-runner-207 kernel: [61492.608634] __x64_sys_ioctl+0x95/0xd0 Aug 22 22:28:38 juju-e4d256-prod-github-runner-207 kernel: [61492.609329] do_syscall_64+0x5c/0xc0 Aug 22 22:28:38 juju-e4d256-prod-github-runner-207 kernel: [61492.609997] ? do_futex+0x162/0x1f0 Aug 22 22:28:38 juju-e4d256-prod-github-runner-207 kernel: [61492.610714] ? __x64_sys_futex+0x78/0x1e0 Aug 22 22:28:38 juju-e4d256-prod-github-runner-207 kernel: [61492.611420] ? __secure_computing+0xa9/0x120 Aug 22 22:28:38 juju-e4d256-prod-github-runner-207 kernel: [61492.612113] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 22:28:38 juju-e4d256-prod-github-runner-207 kernel: [61492.612889] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:28:38 juju-e4d256-prod-github-runner-207 kernel: [61492.613641] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:28:38 juju-e4d256-prod-github-runner-207 kernel: [61492.614368] ? do_syscall_64+0x69/0xc0 Aug 22 22:28:38 juju-e4d256-prod-github-runner-207 kernel: [61492.615036] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:28:38 juju-e4d256-prod-github-runner-207 kernel: [61492.615742] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:28:38 juju-e4d256-prod-github-runner-207 kernel: [61492.616441] ? do_syscall_64+0x69/0xc0 Aug 22 22:28:38 juju-e4d256-prod-github-runner-207 kernel: [61492.617067] ? do_syscall_64+0x69/0xc0 Aug 22 22:28:38 juju-e4d256-prod-github-runner-207 kernel: [61492.617688] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 22:28:38 juju-e4d256-prod-github-runner-207 kernel: [61492.618398] RIP: 0033:0x7faa5d0edaff Aug 22 22:28:38 juju-e4d256-prod-github-runner-207 kernel: [61492.619072] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 22:28:38 juju-e4d256-prod-github-runner-207 kernel: [61492.621127] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 22:28:38 juju-e4d256-prod-github-runner-207 kernel: [61492.622043] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 22:28:38 juju-e4d256-prod-github-runner-207 kernel: [61492.622945] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 22:28:38 juju-e4d256-prod-github-runner-207 kernel: [61492.623840] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 22:28:38 juju-e4d256-prod-github-runner-207 kernel: [61492.624754] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 22:28:38 juju-e4d256-prod-github-runner-207 kernel: [61492.625658] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 22:28:38 juju-e4d256-prod-github-runner-207 kernel: [61492.626552] Aug 22 22:29:06 juju-e4d256-prod-github-runner-207 kernel: [61520.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 57187s! [qemu-system-x86:6715] Aug 22 22:29:06 juju-e4d256-prod-github-runner-207 kernel: [61520.543152] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 22:29:06 juju-e4d256-prod-github-runner-207 kernel: [61520.543226] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 22:29:06 juju-e4d256-prod-github-runner-207 kernel: [61520.556431] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 22:29:06 juju-e4d256-prod-github-runner-207 kernel: [61520.557746] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 22:29:06 juju-e4d256-prod-github-runner-207 kernel: [61520.559068] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:29:06 juju-e4d256-prod-github-runner-207 kernel: [61520.560217] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 22:29:06 juju-e4d256-prod-github-runner-207 kernel: [61520.562824] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 22:29:06 juju-e4d256-prod-github-runner-207 kernel: [61520.563961] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 22:29:06 juju-e4d256-prod-github-runner-207 kernel: [61520.565211] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 22:29:06 juju-e4d256-prod-github-runner-207 kernel: [61520.566583] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 22:29:06 juju-e4d256-prod-github-runner-207 kernel: [61520.568131] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 22:29:06 juju-e4d256-prod-github-runner-207 kernel: [61520.569393] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 22:29:06 juju-e4d256-prod-github-runner-207 kernel: [61520.570627] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 22:29:06 juju-e4d256-prod-github-runner-207 kernel: [61520.571952] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 22:29:06 juju-e4d256-prod-github-runner-207 kernel: [61520.573115] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 22:29:06 juju-e4d256-prod-github-runner-207 kernel: [61520.574374] Call Trace: Aug 22 22:29:06 juju-e4d256-prod-github-runner-207 kernel: [61520.575353] Aug 22 22:29:06 juju-e4d256-prod-github-runner-207 kernel: [61520.576277] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:29:06 juju-e4d256-prod-github-runner-207 kernel: [61520.577347] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:29:06 juju-e4d256-prod-github-runner-207 kernel: [61520.578482] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:29:06 juju-e4d256-prod-github-runner-207 kernel: [61520.579702] ? show_regs.part.0+0x23/0x29 Aug 22 22:29:06 juju-e4d256-prod-github-runner-207 kernel: [61520.580923] ? show_regs.cold+0x8/0xd Aug 22 22:29:06 juju-e4d256-prod-github-runner-207 kernel: [61520.582004] ? watchdog_timer_fn+0x1be/0x220 Aug 22 22:29:06 juju-e4d256-prod-github-runner-207 kernel: [61520.583097] ? lockup_detector_update_enable+0x60/0x60 Aug 22 22:29:06 juju-e4d256-prod-github-runner-207 kernel: [61520.584288] ? __hrtimer_run_queues+0x107/0x230 Aug 22 22:29:06 juju-e4d256-prod-github-runner-207 kernel: [61520.585474] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 22:29:06 juju-e4d256-prod-github-runner-207 kernel: [61520.586662] ? hrtimer_interrupt+0x101/0x220 Aug 22 22:29:06 juju-e4d256-prod-github-runner-207 kernel: [61520.587706] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 22:29:06 juju-e4d256-prod-github-runner-207 kernel: [61520.588831] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 22:29:06 juju-e4d256-prod-github-runner-207 kernel: [61520.589884] Aug 22 22:29:06 juju-e4d256-prod-github-runner-207 kernel: [61520.590755] Aug 22 22:29:06 juju-e4d256-prod-github-runner-207 kernel: [61520.591596] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 22:29:06 juju-e4d256-prod-github-runner-207 kernel: [61520.592630] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:29:06 juju-e4d256-prod-github-runner-207 kernel: [61520.593671] ? _raw_spin_lock+0x22/0x30 Aug 22 22:29:06 juju-e4d256-prod-github-runner-207 kernel: [61520.594630] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:29:06 juju-e4d256-prod-github-runner-207 kernel: [61520.595675] direct_page_fault+0x206/0x310 [kvm] Aug 22 22:29:06 juju-e4d256-prod-github-runner-207 kernel: [61520.596776] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 22:29:06 juju-e4d256-prod-github-runner-207 kernel: [61520.597840] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 22:29:06 juju-e4d256-prod-github-runner-207 kernel: [61520.598877] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 22:29:06 juju-e4d256-prod-github-runner-207 kernel: [61520.599850] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 22:29:06 juju-e4d256-prod-github-runner-207 kernel: [61520.600796] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 22:29:06 juju-e4d256-prod-github-runner-207 kernel: [61520.601791] handle_exit+0x98/0x230 [kvm_amd] Aug 22 22:29:06 juju-e4d256-prod-github-runner-207 kernel: [61520.602710] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 22:29:06 juju-e4d256-prod-github-runner-207 kernel: [61520.603630] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 22:29:06 juju-e4d256-prod-github-runner-207 kernel: [61520.604557] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 22:29:06 juju-e4d256-prod-github-runner-207 kernel: [61520.605464] vcpu_run+0x62/0x2c0 [kvm] Aug 22 22:29:06 juju-e4d256-prod-github-runner-207 kernel: [61520.606285] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 22:29:06 juju-e4d256-prod-github-runner-207 kernel: [61520.607129] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 22:29:06 juju-e4d256-prod-github-runner-207 kernel: [61520.607987] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 22:29:06 juju-e4d256-prod-github-runner-207 kernel: [61520.608783] ? __seccomp_filter+0x4a/0x4a0 Aug 22 22:29:06 juju-e4d256-prod-github-runner-207 kernel: [61520.609526] ? __fget_files+0x86/0xc0 Aug 22 22:29:06 juju-e4d256-prod-github-runner-207 kernel: [61520.610229] __x64_sys_ioctl+0x95/0xd0 Aug 22 22:29:06 juju-e4d256-prod-github-runner-207 kernel: [61520.611005] do_syscall_64+0x5c/0xc0 Aug 22 22:29:06 juju-e4d256-prod-github-runner-207 kernel: [61520.611730] ? do_futex+0x162/0x1f0 Aug 22 22:29:06 juju-e4d256-prod-github-runner-207 kernel: [61520.612388] ? __x64_sys_futex+0x78/0x1e0 Aug 22 22:29:06 juju-e4d256-prod-github-runner-207 kernel: [61520.613063] ? __secure_computing+0xa9/0x120 Aug 22 22:29:06 juju-e4d256-prod-github-runner-207 kernel: [61520.613821] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 22:29:06 juju-e4d256-prod-github-runner-207 kernel: [61520.614618] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:29:06 juju-e4d256-prod-github-runner-207 kernel: [61520.615352] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:29:06 juju-e4d256-prod-github-runner-207 kernel: [61520.616077] ? do_syscall_64+0x69/0xc0 Aug 22 22:29:06 juju-e4d256-prod-github-runner-207 kernel: [61520.616735] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:29:06 juju-e4d256-prod-github-runner-207 kernel: [61520.617442] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:29:06 juju-e4d256-prod-github-runner-207 kernel: [61520.618141] ? do_syscall_64+0x69/0xc0 Aug 22 22:29:06 juju-e4d256-prod-github-runner-207 kernel: [61520.618967] ? do_syscall_64+0x69/0xc0 Aug 22 22:29:06 juju-e4d256-prod-github-runner-207 kernel: [61520.619773] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 22:29:06 juju-e4d256-prod-github-runner-207 kernel: [61520.620525] RIP: 0033:0x7faa5d0edaff Aug 22 22:29:06 juju-e4d256-prod-github-runner-207 kernel: [61520.621236] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 22:29:06 juju-e4d256-prod-github-runner-207 kernel: [61520.623337] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 22:29:06 juju-e4d256-prod-github-runner-207 kernel: [61520.624257] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 22:29:06 juju-e4d256-prod-github-runner-207 kernel: [61520.625152] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 22:29:06 juju-e4d256-prod-github-runner-207 kernel: [61520.626045] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 22:29:06 juju-e4d256-prod-github-runner-207 kernel: [61520.626960] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 22:29:06 juju-e4d256-prod-github-runner-207 kernel: [61520.627864] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 22:29:06 juju-e4d256-prod-github-runner-207 kernel: [61520.628762] Aug 22 22:29:34 juju-e4d256-prod-github-runner-207 kernel: [61548.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 57213s! [qemu-system-x86:6715] Aug 22 22:29:34 juju-e4d256-prod-github-runner-207 kernel: [61548.543135] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 22:29:34 juju-e4d256-prod-github-runner-207 kernel: [61548.543209] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 22:29:34 juju-e4d256-prod-github-runner-207 kernel: [61548.555660] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 22:29:34 juju-e4d256-prod-github-runner-207 kernel: [61548.556946] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 22:29:34 juju-e4d256-prod-github-runner-207 kernel: [61548.558207] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:29:34 juju-e4d256-prod-github-runner-207 kernel: [61548.559300] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 22:29:34 juju-e4d256-prod-github-runner-207 kernel: [61548.561884] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 22:29:34 juju-e4d256-prod-github-runner-207 kernel: [61548.562955] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 22:29:34 juju-e4d256-prod-github-runner-207 kernel: [61548.564134] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 22:29:34 juju-e4d256-prod-github-runner-207 kernel: [61548.565314] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 22:29:34 juju-e4d256-prod-github-runner-207 kernel: [61548.566524] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 22:29:34 juju-e4d256-prod-github-runner-207 kernel: [61548.568033] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 22:29:34 juju-e4d256-prod-github-runner-207 kernel: [61548.569649] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 22:29:34 juju-e4d256-prod-github-runner-207 kernel: [61548.571390] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 22:29:34 juju-e4d256-prod-github-runner-207 kernel: [61548.572958] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 22:29:34 juju-e4d256-prod-github-runner-207 kernel: [61548.574685] Call Trace: Aug 22 22:29:34 juju-e4d256-prod-github-runner-207 kernel: [61548.576031] Aug 22 22:29:34 juju-e4d256-prod-github-runner-207 kernel: [61548.577331] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:29:34 juju-e4d256-prod-github-runner-207 kernel: [61548.578856] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:29:34 juju-e4d256-prod-github-runner-207 kernel: [61548.580347] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:29:34 juju-e4d256-prod-github-runner-207 kernel: [61548.581920] ? show_regs.part.0+0x23/0x29 Aug 22 22:29:34 juju-e4d256-prod-github-runner-207 kernel: [61548.583265] ? show_regs.cold+0x8/0xd Aug 22 22:29:34 juju-e4d256-prod-github-runner-207 kernel: [61548.584619] ? watchdog_timer_fn+0x1be/0x220 Aug 22 22:29:34 juju-e4d256-prod-github-runner-207 kernel: [61548.585963] ? lockup_detector_update_enable+0x60/0x60 Aug 22 22:29:34 juju-e4d256-prod-github-runner-207 kernel: [61548.587451] ? __hrtimer_run_queues+0x107/0x230 Aug 22 22:29:34 juju-e4d256-prod-github-runner-207 kernel: [61548.588577] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 22:29:34 juju-e4d256-prod-github-runner-207 kernel: [61548.589615] ? hrtimer_interrupt+0x101/0x220 Aug 22 22:29:34 juju-e4d256-prod-github-runner-207 kernel: [61548.590809] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 22:29:34 juju-e4d256-prod-github-runner-207 kernel: [61548.591901] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 22:29:34 juju-e4d256-prod-github-runner-207 kernel: [61548.592970] Aug 22 22:29:34 juju-e4d256-prod-github-runner-207 kernel: [61548.593840] Aug 22 22:29:34 juju-e4d256-prod-github-runner-207 kernel: [61548.594713] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 22:29:34 juju-e4d256-prod-github-runner-207 kernel: [61548.595769] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:29:34 juju-e4d256-prod-github-runner-207 kernel: [61548.596829] ? _raw_spin_lock+0x22/0x30 Aug 22 22:29:34 juju-e4d256-prod-github-runner-207 kernel: [61548.597810] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:29:34 juju-e4d256-prod-github-runner-207 kernel: [61548.598927] direct_page_fault+0x206/0x310 [kvm] Aug 22 22:29:34 juju-e4d256-prod-github-runner-207 kernel: [61548.599973] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 22:29:34 juju-e4d256-prod-github-runner-207 kernel: [61548.601018] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 22:29:34 juju-e4d256-prod-github-runner-207 kernel: [61548.602066] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 22:29:34 juju-e4d256-prod-github-runner-207 kernel: [61548.603102] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 22:29:34 juju-e4d256-prod-github-runner-207 kernel: [61548.604081] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 22:29:34 juju-e4d256-prod-github-runner-207 kernel: [61548.605077] handle_exit+0x98/0x230 [kvm_amd] Aug 22 22:29:34 juju-e4d256-prod-github-runner-207 kernel: [61548.606001] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 22:29:34 juju-e4d256-prod-github-runner-207 kernel: [61548.606957] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 22:29:34 juju-e4d256-prod-github-runner-207 kernel: [61548.607901] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 22:29:34 juju-e4d256-prod-github-runner-207 kernel: [61548.608825] vcpu_run+0x62/0x2c0 [kvm] Aug 22 22:29:34 juju-e4d256-prod-github-runner-207 kernel: [61548.609655] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 22:29:34 juju-e4d256-prod-github-runner-207 kernel: [61548.610594] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 22:29:34 juju-e4d256-prod-github-runner-207 kernel: [61548.611481] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 22:29:34 juju-e4d256-prod-github-runner-207 kernel: [61548.612305] ? __seccomp_filter+0x4a/0x4a0 Aug 22 22:29:34 juju-e4d256-prod-github-runner-207 kernel: [61548.613069] ? __fget_files+0x86/0xc0 Aug 22 22:29:34 juju-e4d256-prod-github-runner-207 kernel: [61548.613792] __x64_sys_ioctl+0x95/0xd0 Aug 22 22:29:34 juju-e4d256-prod-github-runner-207 kernel: [61548.614545] do_syscall_64+0x5c/0xc0 Aug 22 22:29:34 juju-e4d256-prod-github-runner-207 kernel: [61548.615233] ? do_futex+0x162/0x1f0 Aug 22 22:29:34 juju-e4d256-prod-github-runner-207 kernel: [61548.615932] ? __x64_sys_futex+0x78/0x1e0 Aug 22 22:29:34 juju-e4d256-prod-github-runner-207 kernel: [61548.616619] ? __secure_computing+0xa9/0x120 Aug 22 22:29:34 juju-e4d256-prod-github-runner-207 kernel: [61548.617322] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 22:29:34 juju-e4d256-prod-github-runner-207 kernel: [61548.618104] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:29:34 juju-e4d256-prod-github-runner-207 kernel: [61548.618867] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:29:34 juju-e4d256-prod-github-runner-207 kernel: [61548.619612] ? do_syscall_64+0x69/0xc0 Aug 22 22:29:34 juju-e4d256-prod-github-runner-207 kernel: [61548.620275] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:29:34 juju-e4d256-prod-github-runner-207 kernel: [61548.620995] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:29:34 juju-e4d256-prod-github-runner-207 kernel: [61548.621893] ? do_syscall_64+0x69/0xc0 Aug 22 22:29:34 juju-e4d256-prod-github-runner-207 kernel: [61548.622746] ? do_syscall_64+0x69/0xc0 Aug 22 22:29:34 juju-e4d256-prod-github-runner-207 kernel: [61548.623537] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 22:29:34 juju-e4d256-prod-github-runner-207 kernel: [61548.624273] RIP: 0033:0x7faa5d0edaff Aug 22 22:29:34 juju-e4d256-prod-github-runner-207 kernel: [61548.624919] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 22:29:34 juju-e4d256-prod-github-runner-207 kernel: [61548.626967] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 22:29:34 juju-e4d256-prod-github-runner-207 kernel: [61548.627903] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 22:29:34 juju-e4d256-prod-github-runner-207 kernel: [61548.628810] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 22:29:34 juju-e4d256-prod-github-runner-207 kernel: [61548.629720] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 22:29:34 juju-e4d256-prod-github-runner-207 kernel: [61548.630661] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 22:29:34 juju-e4d256-prod-github-runner-207 kernel: [61548.631574] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 22:29:34 juju-e4d256-prod-github-runner-207 kernel: [61548.632483] Aug 22 22:29:47 juju-e4d256-prod-github-runner-207 kernel: [61561.292705] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 22:29:47 juju-e4d256-prod-github-runner-207 kernel: [61561.293694] rcu: 1-....: (15312616 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=7395480 Aug 22 22:29:47 juju-e4d256-prod-github-runner-207 kernel: [61561.294842] (t=15361023 jiffies g=23269 q=54971) Aug 22 22:29:47 juju-e4d256-prod-github-runner-207 kernel: [61561.295633] NMI backtrace for cpu 1 Aug 22 22:29:47 juju-e4d256-prod-github-runner-207 kernel: [61561.296351] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 22:29:47 juju-e4d256-prod-github-runner-207 kernel: [61561.297451] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 22:29:47 juju-e4d256-prod-github-runner-207 kernel: [61561.298521] Call Trace: Aug 22 22:29:47 juju-e4d256-prod-github-runner-207 kernel: [61561.299197] Aug 22 22:29:47 juju-e4d256-prod-github-runner-207 kernel: [61561.299841] show_stack+0x52/0x5c Aug 22 22:29:47 juju-e4d256-prod-github-runner-207 kernel: [61561.300563] dump_stack_lvl+0x4a/0x63 Aug 22 22:29:47 juju-e4d256-prod-github-runner-207 kernel: [61561.301308] dump_stack+0x10/0x16 Aug 22 22:29:47 juju-e4d256-prod-github-runner-207 kernel: [61561.302062] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 22:29:47 juju-e4d256-prod-github-runner-207 kernel: [61561.302938] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 22:29:47 juju-e4d256-prod-github-runner-207 kernel: [61561.303752] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 22:29:47 juju-e4d256-prod-github-runner-207 kernel: [61561.304580] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 22:29:47 juju-e4d256-prod-github-runner-207 kernel: [61561.305433] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 22:29:47 juju-e4d256-prod-github-runner-207 kernel: [61561.306333] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 22:29:47 juju-e4d256-prod-github-runner-207 kernel: [61561.307121] print_cpu_stall.cold+0x2f/0xe2 Aug 22 22:29:47 juju-e4d256-prod-github-runner-207 kernel: [61561.307888] ? timekeeping_update+0xf7/0x150 Aug 22 22:29:47 juju-e4d256-prod-github-runner-207 kernel: [61561.308681] check_cpu_stall+0x109/0x270 Aug 22 22:29:47 juju-e4d256-prod-github-runner-207 kernel: [61561.309456] rcu_sched_clock_irq+0x9a/0x250 Aug 22 22:29:47 juju-e4d256-prod-github-runner-207 kernel: [61561.310278] update_process_times+0x94/0xd0 Aug 22 22:29:47 juju-e4d256-prod-github-runner-207 kernel: [61561.311042] tick_sched_handle+0x29/0x70 Aug 22 22:29:47 juju-e4d256-prod-github-runner-207 kernel: [61561.311787] tick_sched_timer+0x8c/0xc0 Aug 22 22:29:47 juju-e4d256-prod-github-runner-207 kernel: [61561.312528] ? tick_nohz_handler+0xb0/0xb0 Aug 22 22:29:47 juju-e4d256-prod-github-runner-207 kernel: [61561.313293] __hrtimer_run_queues+0x107/0x230 Aug 22 22:29:47 juju-e4d256-prod-github-runner-207 kernel: [61561.314101] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 22:29:47 juju-e4d256-prod-github-runner-207 kernel: [61561.314883] hrtimer_interrupt+0x101/0x220 Aug 22 22:29:47 juju-e4d256-prod-github-runner-207 kernel: [61561.315644] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 22:29:47 juju-e4d256-prod-github-runner-207 kernel: [61561.316464] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 22:29:47 juju-e4d256-prod-github-runner-207 kernel: [61561.317277] Aug 22 22:29:47 juju-e4d256-prod-github-runner-207 kernel: [61561.317919] Aug 22 22:29:47 juju-e4d256-prod-github-runner-207 kernel: [61561.318571] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 22:29:47 juju-e4d256-prod-github-runner-207 kernel: [61561.319513] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:29:47 juju-e4d256-prod-github-runner-207 kernel: [61561.320510] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 22:29:47 juju-e4d256-prod-github-runner-207 kernel: [61561.323066] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 22:29:47 juju-e4d256-prod-github-runner-207 kernel: [61561.324043] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 22:29:47 juju-e4d256-prod-github-runner-207 kernel: [61561.325232] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 22:29:47 juju-e4d256-prod-github-runner-207 kernel: [61561.326390] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 22:29:47 juju-e4d256-prod-github-runner-207 kernel: [61561.327509] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 22:29:47 juju-e4d256-prod-github-runner-207 kernel: [61561.328619] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 22:29:47 juju-e4d256-prod-github-runner-207 kernel: [61561.329730] ? _raw_spin_lock+0x22/0x30 Aug 22 22:29:47 juju-e4d256-prod-github-runner-207 kernel: [61561.330590] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:29:47 juju-e4d256-prod-github-runner-207 kernel: [61561.331541] direct_page_fault+0x206/0x310 [kvm] Aug 22 22:29:47 juju-e4d256-prod-github-runner-207 kernel: [61561.332602] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 22:29:47 juju-e4d256-prod-github-runner-207 kernel: [61561.333480] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 22:29:47 juju-e4d256-prod-github-runner-207 kernel: [61561.334537] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 22:29:47 juju-e4d256-prod-github-runner-207 kernel: [61561.335460] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 22:29:47 juju-e4d256-prod-github-runner-207 kernel: [61561.336350] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 22:29:47 juju-e4d256-prod-github-runner-207 kernel: [61561.337284] handle_exit+0x98/0x230 [kvm_amd] Aug 22 22:29:47 juju-e4d256-prod-github-runner-207 kernel: [61561.338141] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 22:29:47 juju-e4d256-prod-github-runner-207 kernel: [61561.339026] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 22:29:47 juju-e4d256-prod-github-runner-207 kernel: [61561.339928] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 22:29:47 juju-e4d256-prod-github-runner-207 kernel: [61561.340814] vcpu_run+0x62/0x2c0 [kvm] Aug 22 22:29:47 juju-e4d256-prod-github-runner-207 kernel: [61561.341613] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 22:29:47 juju-e4d256-prod-github-runner-207 kernel: [61561.342632] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 22:29:47 juju-e4d256-prod-github-runner-207 kernel: [61561.343532] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 22:29:47 juju-e4d256-prod-github-runner-207 kernel: [61561.344386] ? __seccomp_filter+0x4a/0x4a0 Aug 22 22:29:47 juju-e4d256-prod-github-runner-207 kernel: [61561.345188] ? __fget_files+0x86/0xc0 Aug 22 22:29:47 juju-e4d256-prod-github-runner-207 kernel: [61561.345966] __x64_sys_ioctl+0x95/0xd0 Aug 22 22:29:47 juju-e4d256-prod-github-runner-207 kernel: [61561.346755] do_syscall_64+0x5c/0xc0 Aug 22 22:29:47 juju-e4d256-prod-github-runner-207 kernel: [61561.347504] ? do_futex+0x162/0x1f0 Aug 22 22:29:47 juju-e4d256-prod-github-runner-207 kernel: [61561.348254] ? __x64_sys_futex+0x78/0x1e0 Aug 22 22:29:47 juju-e4d256-prod-github-runner-207 kernel: [61561.349037] ? __secure_computing+0xa9/0x120 Aug 22 22:29:47 juju-e4d256-prod-github-runner-207 kernel: [61561.349842] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 22:29:47 juju-e4d256-prod-github-runner-207 kernel: [61561.350751] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:29:47 juju-e4d256-prod-github-runner-207 kernel: [61561.351601] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:29:47 juju-e4d256-prod-github-runner-207 kernel: [61561.352444] ? do_syscall_64+0x69/0xc0 Aug 22 22:29:47 juju-e4d256-prod-github-runner-207 kernel: [61561.353214] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:29:47 juju-e4d256-prod-github-runner-207 kernel: [61561.354089] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:29:47 juju-e4d256-prod-github-runner-207 kernel: [61561.354939] ? do_syscall_64+0x69/0xc0 Aug 22 22:29:47 juju-e4d256-prod-github-runner-207 kernel: [61561.355711] ? do_syscall_64+0x69/0xc0 Aug 22 22:29:47 juju-e4d256-prod-github-runner-207 kernel: [61561.356473] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 22:29:47 juju-e4d256-prod-github-runner-207 kernel: [61561.357338] RIP: 0033:0x7faa5d0edaff Aug 22 22:29:47 juju-e4d256-prod-github-runner-207 kernel: [61561.358113] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 22:29:47 juju-e4d256-prod-github-runner-207 kernel: [61561.360585] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 22:29:47 juju-e4d256-prod-github-runner-207 kernel: [61561.361707] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 22:29:47 juju-e4d256-prod-github-runner-207 kernel: [61561.362822] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 22:29:47 juju-e4d256-prod-github-runner-207 kernel: [61561.363922] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 22:29:47 juju-e4d256-prod-github-runner-207 kernel: [61561.365003] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 22:29:47 juju-e4d256-prod-github-runner-207 kernel: [61561.366092] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 22:29:47 juju-e4d256-prod-github-runner-207 kernel: [61561.367147] Aug 22 22:30:14 juju-e4d256-prod-github-runner-207 kernel: [61588.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 57250s! [qemu-system-x86:6715] Aug 22 22:30:14 juju-e4d256-prod-github-runner-207 kernel: [61588.543852] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 22:30:14 juju-e4d256-prod-github-runner-207 kernel: [61588.544157] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 22:30:14 juju-e4d256-prod-github-runner-207 kernel: [61588.556249] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 22:30:14 juju-e4d256-prod-github-runner-207 kernel: [61588.557720] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 22:30:14 juju-e4d256-prod-github-runner-207 kernel: [61588.559096] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:30:14 juju-e4d256-prod-github-runner-207 kernel: [61588.560273] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 22:30:14 juju-e4d256-prod-github-runner-207 kernel: [61588.563150] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 22:30:14 juju-e4d256-prod-github-runner-207 kernel: [61588.564289] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 22:30:14 juju-e4d256-prod-github-runner-207 kernel: [61588.565473] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 22:30:14 juju-e4d256-prod-github-runner-207 kernel: [61588.566651] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 22:30:14 juju-e4d256-prod-github-runner-207 kernel: [61588.567809] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 22:30:14 juju-e4d256-prod-github-runner-207 kernel: [61588.568964] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 22:30:14 juju-e4d256-prod-github-runner-207 kernel: [61588.570140] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 22:30:14 juju-e4d256-prod-github-runner-207 kernel: [61588.571370] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 22:30:14 juju-e4d256-prod-github-runner-207 kernel: [61588.572462] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 22:30:14 juju-e4d256-prod-github-runner-207 kernel: [61588.573650] Call Trace: Aug 22 22:30:14 juju-e4d256-prod-github-runner-207 kernel: [61588.574568] Aug 22 22:30:14 juju-e4d256-prod-github-runner-207 kernel: [61588.575463] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:30:14 juju-e4d256-prod-github-runner-207 kernel: [61588.576491] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:30:14 juju-e4d256-prod-github-runner-207 kernel: [61588.577512] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:30:14 juju-e4d256-prod-github-runner-207 kernel: [61588.578690] ? show_regs.part.0+0x23/0x29 Aug 22 22:30:14 juju-e4d256-prod-github-runner-207 kernel: [61588.579685] ? show_regs.cold+0x8/0xd Aug 22 22:30:14 juju-e4d256-prod-github-runner-207 kernel: [61588.580655] ? watchdog_timer_fn+0x1be/0x220 Aug 22 22:30:14 juju-e4d256-prod-github-runner-207 kernel: [61588.581681] ? lockup_detector_update_enable+0x60/0x60 Aug 22 22:30:14 juju-e4d256-prod-github-runner-207 kernel: [61588.582744] ? __hrtimer_run_queues+0x107/0x230 Aug 22 22:30:14 juju-e4d256-prod-github-runner-207 kernel: [61588.583770] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 22:30:14 juju-e4d256-prod-github-runner-207 kernel: [61588.584797] ? hrtimer_interrupt+0x101/0x220 Aug 22 22:30:14 juju-e4d256-prod-github-runner-207 kernel: [61588.585820] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 22:30:14 juju-e4d256-prod-github-runner-207 kernel: [61588.586888] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 22:30:14 juju-e4d256-prod-github-runner-207 kernel: [61588.588081] Aug 22 22:30:14 juju-e4d256-prod-github-runner-207 kernel: [61588.588939] Aug 22 22:30:14 juju-e4d256-prod-github-runner-207 kernel: [61588.589788] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 22:30:14 juju-e4d256-prod-github-runner-207 kernel: [61588.590822] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:30:14 juju-e4d256-prod-github-runner-207 kernel: [61588.592031] ? _raw_spin_lock+0x22/0x30 Aug 22 22:30:14 juju-e4d256-prod-github-runner-207 kernel: [61588.592977] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:30:14 juju-e4d256-prod-github-runner-207 kernel: [61588.594013] direct_page_fault+0x206/0x310 [kvm] Aug 22 22:30:14 juju-e4d256-prod-github-runner-207 kernel: [61588.595059] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 22:30:14 juju-e4d256-prod-github-runner-207 kernel: [61588.596069] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 22:30:14 juju-e4d256-prod-github-runner-207 kernel: [61588.597073] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 22:30:14 juju-e4d256-prod-github-runner-207 kernel: [61588.598104] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 22:30:14 juju-e4d256-prod-github-runner-207 kernel: [61588.599051] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 22:30:14 juju-e4d256-prod-github-runner-207 kernel: [61588.600025] handle_exit+0x98/0x230 [kvm_amd] Aug 22 22:30:14 juju-e4d256-prod-github-runner-207 kernel: [61588.600918] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 22:30:14 juju-e4d256-prod-github-runner-207 kernel: [61588.601849] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 22:30:14 juju-e4d256-prod-github-runner-207 kernel: [61588.602774] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 22:30:14 juju-e4d256-prod-github-runner-207 kernel: [61588.603681] vcpu_run+0x62/0x2c0 [kvm] Aug 22 22:30:14 juju-e4d256-prod-github-runner-207 kernel: [61588.604491] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 22:30:14 juju-e4d256-prod-github-runner-207 kernel: [61588.605298] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 22:30:14 juju-e4d256-prod-github-runner-207 kernel: [61588.606160] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 22:30:14 juju-e4d256-prod-github-runner-207 kernel: [61588.606979] ? __seccomp_filter+0x4a/0x4a0 Aug 22 22:30:14 juju-e4d256-prod-github-runner-207 kernel: [61588.607726] ? __fget_files+0x86/0xc0 Aug 22 22:30:14 juju-e4d256-prod-github-runner-207 kernel: [61588.608494] __x64_sys_ioctl+0x95/0xd0 Aug 22 22:30:14 juju-e4d256-prod-github-runner-207 kernel: [61588.609340] do_syscall_64+0x5c/0xc0 Aug 22 22:30:14 juju-e4d256-prod-github-runner-207 kernel: [61588.610069] ? do_futex+0x162/0x1f0 Aug 22 22:30:14 juju-e4d256-prod-github-runner-207 kernel: [61588.610763] ? __x64_sys_futex+0x78/0x1e0 Aug 22 22:30:14 juju-e4d256-prod-github-runner-207 kernel: [61588.611690] ? __secure_computing+0xa9/0x120 Aug 22 22:30:14 juju-e4d256-prod-github-runner-207 kernel: [61588.612396] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 22:30:14 juju-e4d256-prod-github-runner-207 kernel: [61588.613175] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:30:14 juju-e4d256-prod-github-runner-207 kernel: [61588.613916] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:30:14 juju-e4d256-prod-github-runner-207 kernel: [61588.614634] ? do_syscall_64+0x69/0xc0 Aug 22 22:30:14 juju-e4d256-prod-github-runner-207 kernel: [61588.615277] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:30:14 juju-e4d256-prod-github-runner-207 kernel: [61588.615979] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:30:14 juju-e4d256-prod-github-runner-207 kernel: [61588.616674] ? do_syscall_64+0x69/0xc0 Aug 22 22:30:14 juju-e4d256-prod-github-runner-207 kernel: [61588.617299] ? do_syscall_64+0x69/0xc0 Aug 22 22:30:14 juju-e4d256-prod-github-runner-207 kernel: [61588.617934] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 22:30:14 juju-e4d256-prod-github-runner-207 kernel: [61588.618636] RIP: 0033:0x7faa5d0edaff Aug 22 22:30:14 juju-e4d256-prod-github-runner-207 kernel: [61588.619294] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 22:30:14 juju-e4d256-prod-github-runner-207 kernel: [61588.621278] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 22:30:14 juju-e4d256-prod-github-runner-207 kernel: [61588.622203] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 22:30:14 juju-e4d256-prod-github-runner-207 kernel: [61588.623094] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 22:30:14 juju-e4d256-prod-github-runner-207 kernel: [61588.623981] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 22:30:14 juju-e4d256-prod-github-runner-207 kernel: [61588.624885] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 22:30:14 juju-e4d256-prod-github-runner-207 kernel: [61588.625807] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 22:30:14 juju-e4d256-prod-github-runner-207 kernel: [61588.626697] Aug 22 22:30:42 juju-e4d256-prod-github-runner-207 kernel: [61616.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 57276s! [qemu-system-x86:6715] Aug 22 22:30:42 juju-e4d256-prod-github-runner-207 kernel: [61616.543122] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 22:30:42 juju-e4d256-prod-github-runner-207 kernel: [61616.543196] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 22:30:42 juju-e4d256-prod-github-runner-207 kernel: [61616.555711] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 22:30:42 juju-e4d256-prod-github-runner-207 kernel: [61616.557013] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 22:30:42 juju-e4d256-prod-github-runner-207 kernel: [61616.558291] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:30:42 juju-e4d256-prod-github-runner-207 kernel: [61616.559422] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 22:30:42 juju-e4d256-prod-github-runner-207 kernel: [61616.562048] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 22:30:42 juju-e4d256-prod-github-runner-207 kernel: [61616.563114] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 22:30:42 juju-e4d256-prod-github-runner-207 kernel: [61616.564301] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 22:30:42 juju-e4d256-prod-github-runner-207 kernel: [61616.565500] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 22:30:42 juju-e4d256-prod-github-runner-207 kernel: [61616.566690] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 22:30:42 juju-e4d256-prod-github-runner-207 kernel: [61616.567868] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 22:30:42 juju-e4d256-prod-github-runner-207 kernel: [61616.569056] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 22:30:42 juju-e4d256-prod-github-runner-207 kernel: [61616.570359] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 22:30:42 juju-e4d256-prod-github-runner-207 kernel: [61616.571480] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 22:30:42 juju-e4d256-prod-github-runner-207 kernel: [61616.572700] Call Trace: Aug 22 22:30:42 juju-e4d256-prod-github-runner-207 kernel: [61616.573685] Aug 22 22:30:42 juju-e4d256-prod-github-runner-207 kernel: [61616.574582] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:30:42 juju-e4d256-prod-github-runner-207 kernel: [61616.575626] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:30:42 juju-e4d256-prod-github-runner-207 kernel: [61616.576660] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:30:42 juju-e4d256-prod-github-runner-207 kernel: [61616.577803] ? show_regs.part.0+0x23/0x29 Aug 22 22:30:42 juju-e4d256-prod-github-runner-207 kernel: [61616.578842] ? show_regs.cold+0x8/0xd Aug 22 22:30:42 juju-e4d256-prod-github-runner-207 kernel: [61616.579836] ? watchdog_timer_fn+0x1be/0x220 Aug 22 22:30:42 juju-e4d256-prod-github-runner-207 kernel: [61616.580858] ? lockup_detector_update_enable+0x60/0x60 Aug 22 22:30:42 juju-e4d256-prod-github-runner-207 kernel: [61616.581963] ? __hrtimer_run_queues+0x107/0x230 Aug 22 22:30:42 juju-e4d256-prod-github-runner-207 kernel: [61616.583013] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 22:30:42 juju-e4d256-prod-github-runner-207 kernel: [61616.584050] ? hrtimer_interrupt+0x101/0x220 Aug 22 22:30:42 juju-e4d256-prod-github-runner-207 kernel: [61616.585078] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 22:30:42 juju-e4d256-prod-github-runner-207 kernel: [61616.586184] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 22:30:42 juju-e4d256-prod-github-runner-207 kernel: [61616.587251] Aug 22 22:30:42 juju-e4d256-prod-github-runner-207 kernel: [61616.588117] Aug 22 22:30:42 juju-e4d256-prod-github-runner-207 kernel: [61616.588987] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 22:30:42 juju-e4d256-prod-github-runner-207 kernel: [61616.590107] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:30:42 juju-e4d256-prod-github-runner-207 kernel: [61616.591173] ? _raw_spin_lock+0x22/0x30 Aug 22 22:30:42 juju-e4d256-prod-github-runner-207 kernel: [61616.592132] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:30:42 juju-e4d256-prod-github-runner-207 kernel: [61616.593204] direct_page_fault+0x206/0x310 [kvm] Aug 22 22:30:42 juju-e4d256-prod-github-runner-207 kernel: [61616.594382] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 22:30:42 juju-e4d256-prod-github-runner-207 kernel: [61616.595421] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 22:30:42 juju-e4d256-prod-github-runner-207 kernel: [61616.596454] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 22:30:42 juju-e4d256-prod-github-runner-207 kernel: [61616.597468] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 22:30:42 juju-e4d256-prod-github-runner-207 kernel: [61616.598428] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 22:30:42 juju-e4d256-prod-github-runner-207 kernel: [61616.599447] handle_exit+0x98/0x230 [kvm_amd] Aug 22 22:30:42 juju-e4d256-prod-github-runner-207 kernel: [61616.600367] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 22:30:42 juju-e4d256-prod-github-runner-207 kernel: [61616.601331] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 22:30:42 juju-e4d256-prod-github-runner-207 kernel: [61616.602274] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 22:30:42 juju-e4d256-prod-github-runner-207 kernel: [61616.603196] vcpu_run+0x62/0x2c0 [kvm] Aug 22 22:30:42 juju-e4d256-prod-github-runner-207 kernel: [61616.604042] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 22:30:42 juju-e4d256-prod-github-runner-207 kernel: [61616.604919] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 22:30:42 juju-e4d256-prod-github-runner-207 kernel: [61616.605849] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 22:30:42 juju-e4d256-prod-github-runner-207 kernel: [61616.606672] ? __seccomp_filter+0x4a/0x4a0 Aug 22 22:30:42 juju-e4d256-prod-github-runner-207 kernel: [61616.607428] ? __fget_files+0x86/0xc0 Aug 22 22:30:42 juju-e4d256-prod-github-runner-207 kernel: [61616.608145] __x64_sys_ioctl+0x95/0xd0 Aug 22 22:30:42 juju-e4d256-prod-github-runner-207 kernel: [61616.608891] do_syscall_64+0x5c/0xc0 Aug 22 22:30:42 juju-e4d256-prod-github-runner-207 kernel: [61616.609601] ? do_futex+0x162/0x1f0 Aug 22 22:30:42 juju-e4d256-prod-github-runner-207 kernel: [61616.610264] ? __x64_sys_futex+0x78/0x1e0 Aug 22 22:30:42 juju-e4d256-prod-github-runner-207 kernel: [61616.610953] ? __secure_computing+0xa9/0x120 Aug 22 22:30:42 juju-e4d256-prod-github-runner-207 kernel: [61616.611659] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 22:30:42 juju-e4d256-prod-github-runner-207 kernel: [61616.612438] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:30:42 juju-e4d256-prod-github-runner-207 kernel: [61616.613179] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:30:42 juju-e4d256-prod-github-runner-207 kernel: [61616.613940] ? do_syscall_64+0x69/0xc0 Aug 22 22:30:42 juju-e4d256-prod-github-runner-207 kernel: [61616.614599] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:30:42 juju-e4d256-prod-github-runner-207 kernel: [61616.615322] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:30:42 juju-e4d256-prod-github-runner-207 kernel: [61616.616038] ? do_syscall_64+0x69/0xc0 Aug 22 22:30:42 juju-e4d256-prod-github-runner-207 kernel: [61616.616697] ? do_syscall_64+0x69/0xc0 Aug 22 22:30:42 juju-e4d256-prod-github-runner-207 kernel: [61616.617367] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 22:30:42 juju-e4d256-prod-github-runner-207 kernel: [61616.618094] RIP: 0033:0x7faa5d0edaff Aug 22 22:30:42 juju-e4d256-prod-github-runner-207 kernel: [61616.618775] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 22:30:42 juju-e4d256-prod-github-runner-207 kernel: [61616.620999] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 22:30:42 juju-e4d256-prod-github-runner-207 kernel: [61616.621963] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 22:30:42 juju-e4d256-prod-github-runner-207 kernel: [61616.622883] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 22:30:42 juju-e4d256-prod-github-runner-207 kernel: [61616.624040] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 22:30:42 juju-e4d256-prod-github-runner-207 kernel: [61616.625080] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 22:30:42 juju-e4d256-prod-github-runner-207 kernel: [61616.626047] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 22:30:42 juju-e4d256-prod-github-runner-207 kernel: [61616.626972] Aug 22 22:31:10 juju-e4d256-prod-github-runner-207 kernel: [61644.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 57302s! [qemu-system-x86:6715] Aug 22 22:31:10 juju-e4d256-prod-github-runner-207 kernel: [61644.543116] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 22:31:10 juju-e4d256-prod-github-runner-207 kernel: [61644.543191] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 22:31:10 juju-e4d256-prod-github-runner-207 kernel: [61644.555278] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 22:31:10 juju-e4d256-prod-github-runner-207 kernel: [61644.556551] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 22:31:10 juju-e4d256-prod-github-runner-207 kernel: [61644.557816] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:31:10 juju-e4d256-prod-github-runner-207 kernel: [61644.558873] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 22:31:10 juju-e4d256-prod-github-runner-207 kernel: [61644.561463] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 22:31:10 juju-e4d256-prod-github-runner-207 kernel: [61644.562520] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 22:31:10 juju-e4d256-prod-github-runner-207 kernel: [61644.563695] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 22:31:10 juju-e4d256-prod-github-runner-207 kernel: [61644.565065] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 22:31:10 juju-e4d256-prod-github-runner-207 kernel: [61644.566369] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 22:31:10 juju-e4d256-prod-github-runner-207 kernel: [61644.567662] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 22:31:10 juju-e4d256-prod-github-runner-207 kernel: [61644.569049] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 22:31:10 juju-e4d256-prod-github-runner-207 kernel: [61644.570436] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 22:31:10 juju-e4d256-prod-github-runner-207 kernel: [61644.571677] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 22:31:10 juju-e4d256-prod-github-runner-207 kernel: [61644.573028] Call Trace: Aug 22 22:31:10 juju-e4d256-prod-github-runner-207 kernel: [61644.573996] Aug 22 22:31:10 juju-e4d256-prod-github-runner-207 kernel: [61644.574929] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:31:10 juju-e4d256-prod-github-runner-207 kernel: [61644.576047] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:31:10 juju-e4d256-prod-github-runner-207 kernel: [61644.577179] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:31:10 juju-e4d256-prod-github-runner-207 kernel: [61644.578387] ? show_regs.part.0+0x23/0x29 Aug 22 22:31:10 juju-e4d256-prod-github-runner-207 kernel: [61644.579465] ? show_regs.cold+0x8/0xd Aug 22 22:31:10 juju-e4d256-prod-github-runner-207 kernel: [61644.580505] ? watchdog_timer_fn+0x1be/0x220 Aug 22 22:31:10 juju-e4d256-prod-github-runner-207 kernel: [61644.581618] ? lockup_detector_update_enable+0x60/0x60 Aug 22 22:31:10 juju-e4d256-prod-github-runner-207 kernel: [61644.582796] ? __hrtimer_run_queues+0x107/0x230 Aug 22 22:31:10 juju-e4d256-prod-github-runner-207 kernel: [61644.583908] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 22:31:10 juju-e4d256-prod-github-runner-207 kernel: [61644.585037] ? hrtimer_interrupt+0x101/0x220 Aug 22 22:31:10 juju-e4d256-prod-github-runner-207 kernel: [61644.586132] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 22:31:10 juju-e4d256-prod-github-runner-207 kernel: [61644.587307] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 22:31:10 juju-e4d256-prod-github-runner-207 kernel: [61644.588450] Aug 22 22:31:10 juju-e4d256-prod-github-runner-207 kernel: [61644.589368] Aug 22 22:31:10 juju-e4d256-prod-github-runner-207 kernel: [61644.590255] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 22:31:10 juju-e4d256-prod-github-runner-207 kernel: [61644.591387] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:31:10 juju-e4d256-prod-github-runner-207 kernel: [61644.592524] ? _raw_spin_lock+0x22/0x30 Aug 22 22:31:10 juju-e4d256-prod-github-runner-207 kernel: [61644.593568] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:31:10 juju-e4d256-prod-github-runner-207 kernel: [61644.594688] direct_page_fault+0x206/0x310 [kvm] Aug 22 22:31:10 juju-e4d256-prod-github-runner-207 kernel: [61644.595802] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 22:31:10 juju-e4d256-prod-github-runner-207 kernel: [61644.596902] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 22:31:10 juju-e4d256-prod-github-runner-207 kernel: [61644.598026] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 22:31:10 juju-e4d256-prod-github-runner-207 kernel: [61644.599090] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 22:31:10 juju-e4d256-prod-github-runner-207 kernel: [61644.600145] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 22:31:10 juju-e4d256-prod-github-runner-207 kernel: [61644.601253] handle_exit+0x98/0x230 [kvm_amd] Aug 22 22:31:10 juju-e4d256-prod-github-runner-207 kernel: [61644.602240] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 22:31:10 juju-e4d256-prod-github-runner-207 kernel: [61644.603259] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 22:31:10 juju-e4d256-prod-github-runner-207 kernel: [61644.604281] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 22:31:10 juju-e4d256-prod-github-runner-207 kernel: [61644.605329] vcpu_run+0x62/0x2c0 [kvm] Aug 22 22:31:10 juju-e4d256-prod-github-runner-207 kernel: [61644.606214] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 22:31:10 juju-e4d256-prod-github-runner-207 kernel: [61644.607106] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 22:31:10 juju-e4d256-prod-github-runner-207 kernel: [61644.608054] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 22:31:10 juju-e4d256-prod-github-runner-207 kernel: [61644.608937] ? __seccomp_filter+0x4a/0x4a0 Aug 22 22:31:10 juju-e4d256-prod-github-runner-207 kernel: [61644.609781] ? __fget_files+0x86/0xc0 Aug 22 22:31:10 juju-e4d256-prod-github-runner-207 kernel: [61644.610560] __x64_sys_ioctl+0x95/0xd0 Aug 22 22:31:10 juju-e4d256-prod-github-runner-207 kernel: [61644.611340] do_syscall_64+0x5c/0xc0 Aug 22 22:31:10 juju-e4d256-prod-github-runner-207 kernel: [61644.612099] ? do_futex+0x162/0x1f0 Aug 22 22:31:10 juju-e4d256-prod-github-runner-207 kernel: [61644.612835] ? __x64_sys_futex+0x78/0x1e0 Aug 22 22:31:10 juju-e4d256-prod-github-runner-207 kernel: [61644.613627] ? __secure_computing+0xa9/0x120 Aug 22 22:31:10 juju-e4d256-prod-github-runner-207 kernel: [61644.614413] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 22:31:10 juju-e4d256-prod-github-runner-207 kernel: [61644.615275] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:31:10 juju-e4d256-prod-github-runner-207 kernel: [61644.616093] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:31:10 juju-e4d256-prod-github-runner-207 kernel: [61644.616900] ? do_syscall_64+0x69/0xc0 Aug 22 22:31:10 juju-e4d256-prod-github-runner-207 kernel: [61644.617644] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:31:10 juju-e4d256-prod-github-runner-207 kernel: [61644.618439] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:31:10 juju-e4d256-prod-github-runner-207 kernel: [61644.619228] ? do_syscall_64+0x69/0xc0 Aug 22 22:31:10 juju-e4d256-prod-github-runner-207 kernel: [61644.619926] ? do_syscall_64+0x69/0xc0 Aug 22 22:31:10 juju-e4d256-prod-github-runner-207 kernel: [61644.620627] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 22:31:10 juju-e4d256-prod-github-runner-207 kernel: [61644.621456] RIP: 0033:0x7faa5d0edaff Aug 22 22:31:10 juju-e4d256-prod-github-runner-207 kernel: [61644.622157] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 22:31:10 juju-e4d256-prod-github-runner-207 kernel: [61644.624467] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 22:31:10 juju-e4d256-prod-github-runner-207 kernel: [61644.625548] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 22:31:10 juju-e4d256-prod-github-runner-207 kernel: [61644.626575] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 22:31:10 juju-e4d256-prod-github-runner-207 kernel: [61644.627602] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 22:31:10 juju-e4d256-prod-github-runner-207 kernel: [61644.628636] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 22:31:10 juju-e4d256-prod-github-runner-207 kernel: [61644.629678] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 22:31:10 juju-e4d256-prod-github-runner-207 kernel: [61644.630705] Aug 22 22:31:38 juju-e4d256-prod-github-runner-207 kernel: [61672.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 57329s! [qemu-system-x86:6715] Aug 22 22:31:38 juju-e4d256-prod-github-runner-207 kernel: [61672.543315] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 22:31:38 juju-e4d256-prod-github-runner-207 kernel: [61672.543584] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 22:31:38 juju-e4d256-prod-github-runner-207 kernel: [61672.555922] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 22:31:38 juju-e4d256-prod-github-runner-207 kernel: [61672.557217] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 22:31:38 juju-e4d256-prod-github-runner-207 kernel: [61672.558440] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:31:38 juju-e4d256-prod-github-runner-207 kernel: [61672.559499] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 22:31:38 juju-e4d256-prod-github-runner-207 kernel: [61672.562072] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 22:31:38 juju-e4d256-prod-github-runner-207 kernel: [61672.563118] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 22:31:38 juju-e4d256-prod-github-runner-207 kernel: [61672.564330] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 22:31:38 juju-e4d256-prod-github-runner-207 kernel: [61672.565506] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 22:31:38 juju-e4d256-prod-github-runner-207 kernel: [61672.566667] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 22:31:38 juju-e4d256-prod-github-runner-207 kernel: [61672.567827] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 22:31:38 juju-e4d256-prod-github-runner-207 kernel: [61672.569006] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 22:31:38 juju-e4d256-prod-github-runner-207 kernel: [61672.570274] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 22:31:38 juju-e4d256-prod-github-runner-207 kernel: [61672.571375] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 22:31:38 juju-e4d256-prod-github-runner-207 kernel: [61672.572623] Call Trace: Aug 22 22:31:38 juju-e4d256-prod-github-runner-207 kernel: [61672.573551] Aug 22 22:31:38 juju-e4d256-prod-github-runner-207 kernel: [61672.574454] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:31:38 juju-e4d256-prod-github-runner-207 kernel: [61672.575483] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:31:38 juju-e4d256-prod-github-runner-207 kernel: [61672.576508] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:31:38 juju-e4d256-prod-github-runner-207 kernel: [61672.577701] ? show_regs.part.0+0x23/0x29 Aug 22 22:31:38 juju-e4d256-prod-github-runner-207 kernel: [61672.578701] ? show_regs.cold+0x8/0xd Aug 22 22:31:38 juju-e4d256-prod-github-runner-207 kernel: [61672.579694] ? watchdog_timer_fn+0x1be/0x220 Aug 22 22:31:38 juju-e4d256-prod-github-runner-207 kernel: [61672.580751] ? lockup_detector_update_enable+0x60/0x60 Aug 22 22:31:38 juju-e4d256-prod-github-runner-207 kernel: [61672.581819] ? __hrtimer_run_queues+0x107/0x230 Aug 22 22:31:38 juju-e4d256-prod-github-runner-207 kernel: [61672.582852] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 22:31:38 juju-e4d256-prod-github-runner-207 kernel: [61672.583875] ? hrtimer_interrupt+0x101/0x220 Aug 22 22:31:38 juju-e4d256-prod-github-runner-207 kernel: [61672.584896] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 22:31:38 juju-e4d256-prod-github-runner-207 kernel: [61672.585965] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 22:31:38 juju-e4d256-prod-github-runner-207 kernel: [61672.587015] Aug 22 22:31:38 juju-e4d256-prod-github-runner-207 kernel: [61672.587867] Aug 22 22:31:38 juju-e4d256-prod-github-runner-207 kernel: [61672.588748] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 22:31:38 juju-e4d256-prod-github-runner-207 kernel: [61672.589843] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:31:38 juju-e4d256-prod-github-runner-207 kernel: [61672.590895] ? _raw_spin_lock+0x22/0x30 Aug 22 22:31:38 juju-e4d256-prod-github-runner-207 kernel: [61672.591840] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:31:38 juju-e4d256-prod-github-runner-207 kernel: [61672.592893] direct_page_fault+0x206/0x310 [kvm] Aug 22 22:31:38 juju-e4d256-prod-github-runner-207 kernel: [61672.593926] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 22:31:38 juju-e4d256-prod-github-runner-207 kernel: [61672.594935] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 22:31:38 juju-e4d256-prod-github-runner-207 kernel: [61672.595934] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 22:31:38 juju-e4d256-prod-github-runner-207 kernel: [61672.596947] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 22:31:38 juju-e4d256-prod-github-runner-207 kernel: [61672.597895] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 22:31:38 juju-e4d256-prod-github-runner-207 kernel: [61672.598872] handle_exit+0x98/0x230 [kvm_amd] Aug 22 22:31:38 juju-e4d256-prod-github-runner-207 kernel: [61672.599769] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 22:31:38 juju-e4d256-prod-github-runner-207 kernel: [61672.600690] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 22:31:38 juju-e4d256-prod-github-runner-207 kernel: [61672.601615] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 22:31:38 juju-e4d256-prod-github-runner-207 kernel: [61672.602519] vcpu_run+0x62/0x2c0 [kvm] Aug 22 22:31:38 juju-e4d256-prod-github-runner-207 kernel: [61672.603330] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 22:31:38 juju-e4d256-prod-github-runner-207 kernel: [61672.604196] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 22:31:38 juju-e4d256-prod-github-runner-207 kernel: [61672.605091] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 22:31:38 juju-e4d256-prod-github-runner-207 kernel: [61672.605893] ? __seccomp_filter+0x4a/0x4a0 Aug 22 22:31:38 juju-e4d256-prod-github-runner-207 kernel: [61672.606637] ? __fget_files+0x86/0xc0 Aug 22 22:31:38 juju-e4d256-prod-github-runner-207 kernel: [61672.607345] __x64_sys_ioctl+0x95/0xd0 Aug 22 22:31:38 juju-e4d256-prod-github-runner-207 kernel: [61672.608233] do_syscall_64+0x5c/0xc0 Aug 22 22:31:38 juju-e4d256-prod-github-runner-207 kernel: [61672.608928] ? do_futex+0x162/0x1f0 Aug 22 22:31:38 juju-e4d256-prod-github-runner-207 kernel: [61672.609587] ? __x64_sys_futex+0x78/0x1e0 Aug 22 22:31:38 juju-e4d256-prod-github-runner-207 kernel: [61672.610266] ? __secure_computing+0xa9/0x120 Aug 22 22:31:38 juju-e4d256-prod-github-runner-207 kernel: [61672.610956] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 22:31:38 juju-e4d256-prod-github-runner-207 kernel: [61672.611717] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:31:38 juju-e4d256-prod-github-runner-207 kernel: [61672.612438] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:31:38 juju-e4d256-prod-github-runner-207 kernel: [61672.613174] ? do_syscall_64+0x69/0xc0 Aug 22 22:31:38 juju-e4d256-prod-github-runner-207 kernel: [61672.613819] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:31:38 juju-e4d256-prod-github-runner-207 kernel: [61672.614561] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:31:38 juju-e4d256-prod-github-runner-207 kernel: [61672.615266] ? do_syscall_64+0x69/0xc0 Aug 22 22:31:38 juju-e4d256-prod-github-runner-207 kernel: [61672.615892] ? do_syscall_64+0x69/0xc0 Aug 22 22:31:38 juju-e4d256-prod-github-runner-207 kernel: [61672.616515] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 22:31:38 juju-e4d256-prod-github-runner-207 kernel: [61672.617251] RIP: 0033:0x7faa5d0edaff Aug 22 22:31:38 juju-e4d256-prod-github-runner-207 kernel: [61672.617913] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 22:31:38 juju-e4d256-prod-github-runner-207 kernel: [61672.619946] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 22:31:38 juju-e4d256-prod-github-runner-207 kernel: [61672.620887] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 22:31:38 juju-e4d256-prod-github-runner-207 kernel: [61672.621796] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 22:31:38 juju-e4d256-prod-github-runner-207 kernel: [61672.622688] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 22:31:38 juju-e4d256-prod-github-runner-207 kernel: [61672.623585] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 22:31:38 juju-e4d256-prod-github-runner-207 kernel: [61672.624488] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 22:31:38 juju-e4d256-prod-github-runner-207 kernel: [61672.625398] Aug 22 22:32:06 juju-e4d256-prod-github-runner-207 kernel: [61700.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 57355s! [qemu-system-x86:6715] Aug 22 22:32:06 juju-e4d256-prod-github-runner-207 kernel: [61700.543843] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 22:32:06 juju-e4d256-prod-github-runner-207 kernel: [61700.544043] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 22:32:06 juju-e4d256-prod-github-runner-207 kernel: [61700.556518] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 22:32:06 juju-e4d256-prod-github-runner-207 kernel: [61700.557815] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 22:32:06 juju-e4d256-prod-github-runner-207 kernel: [61700.559039] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:32:06 juju-e4d256-prod-github-runner-207 kernel: [61700.560116] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 22:32:06 juju-e4d256-prod-github-runner-207 kernel: [61700.562828] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 22:32:06 juju-e4d256-prod-github-runner-207 kernel: [61700.563880] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 22:32:06 juju-e4d256-prod-github-runner-207 kernel: [61700.565195] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 22:32:06 juju-e4d256-prod-github-runner-207 kernel: [61700.566403] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 22:32:06 juju-e4d256-prod-github-runner-207 kernel: [61700.567595] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 22:32:06 juju-e4d256-prod-github-runner-207 kernel: [61700.568862] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 22:32:06 juju-e4d256-prod-github-runner-207 kernel: [61700.570224] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 22:32:06 juju-e4d256-prod-github-runner-207 kernel: [61700.571660] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 22:32:06 juju-e4d256-prod-github-runner-207 kernel: [61700.572929] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 22:32:06 juju-e4d256-prod-github-runner-207 kernel: [61700.574294] Call Trace: Aug 22 22:32:06 juju-e4d256-prod-github-runner-207 kernel: [61700.575301] Aug 22 22:32:06 juju-e4d256-prod-github-runner-207 kernel: [61700.576328] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:32:06 juju-e4d256-prod-github-runner-207 kernel: [61700.577461] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:32:06 juju-e4d256-prod-github-runner-207 kernel: [61700.578580] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:32:06 juju-e4d256-prod-github-runner-207 kernel: [61700.579845] ? show_regs.part.0+0x23/0x29 Aug 22 22:32:06 juju-e4d256-prod-github-runner-207 kernel: [61700.581026] ? show_regs.cold+0x8/0xd Aug 22 22:32:06 juju-e4d256-prod-github-runner-207 kernel: [61700.582116] ? watchdog_timer_fn+0x1be/0x220 Aug 22 22:32:06 juju-e4d256-prod-github-runner-207 kernel: [61700.583236] ? lockup_detector_update_enable+0x60/0x60 Aug 22 22:32:06 juju-e4d256-prod-github-runner-207 kernel: [61700.584430] ? __hrtimer_run_queues+0x107/0x230 Aug 22 22:32:06 juju-e4d256-prod-github-runner-207 kernel: [61700.585562] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 22:32:06 juju-e4d256-prod-github-runner-207 kernel: [61700.586721] ? hrtimer_interrupt+0x101/0x220 Aug 22 22:32:06 juju-e4d256-prod-github-runner-207 kernel: [61700.587840] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 22:32:06 juju-e4d256-prod-github-runner-207 kernel: [61700.589196] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 22:32:06 juju-e4d256-prod-github-runner-207 kernel: [61700.590342] Aug 22 22:32:06 juju-e4d256-prod-github-runner-207 kernel: [61700.591390] Aug 22 22:32:06 juju-e4d256-prod-github-runner-207 kernel: [61700.592341] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 22:32:06 juju-e4d256-prod-github-runner-207 kernel: [61700.593494] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:32:06 juju-e4d256-prod-github-runner-207 kernel: [61700.594822] ? _raw_spin_lock+0x22/0x30 Aug 22 22:32:06 juju-e4d256-prod-github-runner-207 kernel: [61700.595851] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:32:06 juju-e4d256-prod-github-runner-207 kernel: [61700.596984] direct_page_fault+0x206/0x310 [kvm] Aug 22 22:32:06 juju-e4d256-prod-github-runner-207 kernel: [61700.598146] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 22:32:06 juju-e4d256-prod-github-runner-207 kernel: [61700.599280] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 22:32:06 juju-e4d256-prod-github-runner-207 kernel: [61700.600398] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 22:32:06 juju-e4d256-prod-github-runner-207 kernel: [61700.601695] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 22:32:06 juju-e4d256-prod-github-runner-207 kernel: [61700.602770] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 22:32:06 juju-e4d256-prod-github-runner-207 kernel: [61700.604053] handle_exit+0x98/0x230 [kvm_amd] Aug 22 22:32:06 juju-e4d256-prod-github-runner-207 kernel: [61700.605055] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 22:32:06 juju-e4d256-prod-github-runner-207 kernel: [61700.606065] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 22:32:06 juju-e4d256-prod-github-runner-207 kernel: [61700.607098] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 22:32:06 juju-e4d256-prod-github-runner-207 kernel: [61700.608104] vcpu_run+0x62/0x2c0 [kvm] Aug 22 22:32:06 juju-e4d256-prod-github-runner-207 kernel: [61700.609029] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 22:32:06 juju-e4d256-prod-github-runner-207 kernel: [61700.609924] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 22:32:06 juju-e4d256-prod-github-runner-207 kernel: [61700.610880] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 22:32:06 juju-e4d256-prod-github-runner-207 kernel: [61700.611776] ? __seccomp_filter+0x4a/0x4a0 Aug 22 22:32:06 juju-e4d256-prod-github-runner-207 kernel: [61700.612632] ? __fget_files+0x86/0xc0 Aug 22 22:32:06 juju-e4d256-prod-github-runner-207 kernel: [61700.613418] __x64_sys_ioctl+0x95/0xd0 Aug 22 22:32:06 juju-e4d256-prod-github-runner-207 kernel: [61700.614214] do_syscall_64+0x5c/0xc0 Aug 22 22:32:06 juju-e4d256-prod-github-runner-207 kernel: [61700.614940] ? do_futex+0x162/0x1f0 Aug 22 22:32:06 juju-e4d256-prod-github-runner-207 kernel: [61700.615594] ? __x64_sys_futex+0x78/0x1e0 Aug 22 22:32:06 juju-e4d256-prod-github-runner-207 kernel: [61700.616298] ? __secure_computing+0xa9/0x120 Aug 22 22:32:06 juju-e4d256-prod-github-runner-207 kernel: [61700.616995] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 22:32:06 juju-e4d256-prod-github-runner-207 kernel: [61700.617763] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:32:06 juju-e4d256-prod-github-runner-207 kernel: [61700.618522] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:32:06 juju-e4d256-prod-github-runner-207 kernel: [61700.619246] ? do_syscall_64+0x69/0xc0 Aug 22 22:32:06 juju-e4d256-prod-github-runner-207 kernel: [61700.619892] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:32:06 juju-e4d256-prod-github-runner-207 kernel: [61700.620613] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:32:06 juju-e4d256-prod-github-runner-207 kernel: [61700.621312] ? do_syscall_64+0x69/0xc0 Aug 22 22:32:06 juju-e4d256-prod-github-runner-207 kernel: [61700.621939] ? do_syscall_64+0x69/0xc0 Aug 22 22:32:06 juju-e4d256-prod-github-runner-207 kernel: [61700.622563] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 22:32:06 juju-e4d256-prod-github-runner-207 kernel: [61700.623280] RIP: 0033:0x7faa5d0edaff Aug 22 22:32:06 juju-e4d256-prod-github-runner-207 kernel: [61700.623918] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 22:32:06 juju-e4d256-prod-github-runner-207 kernel: [61700.625938] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 22:32:06 juju-e4d256-prod-github-runner-207 kernel: [61700.626857] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 22:32:06 juju-e4d256-prod-github-runner-207 kernel: [61700.627843] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 22:32:06 juju-e4d256-prod-github-runner-207 kernel: [61700.628868] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 22:32:06 juju-e4d256-prod-github-runner-207 kernel: [61700.629762] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 22:32:06 juju-e4d256-prod-github-runner-207 kernel: [61700.630659] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 22:32:06 juju-e4d256-prod-github-runner-207 kernel: [61700.631558] Aug 22 22:32:34 juju-e4d256-prod-github-runner-207 kernel: [61728.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 57381s! [qemu-system-x86:6715] Aug 22 22:32:34 juju-e4d256-prod-github-runner-207 kernel: [61728.543140] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 22:32:34 juju-e4d256-prod-github-runner-207 kernel: [61728.543213] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 22:32:34 juju-e4d256-prod-github-runner-207 kernel: [61728.556005] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 22:32:34 juju-e4d256-prod-github-runner-207 kernel: [61728.557355] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 22:32:34 juju-e4d256-prod-github-runner-207 kernel: [61728.558615] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:32:34 juju-e4d256-prod-github-runner-207 kernel: [61728.559680] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 22:32:34 juju-e4d256-prod-github-runner-207 kernel: [61728.562332] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 22:32:34 juju-e4d256-prod-github-runner-207 kernel: [61728.563421] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 22:32:34 juju-e4d256-prod-github-runner-207 kernel: [61728.564618] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 22:32:34 juju-e4d256-prod-github-runner-207 kernel: [61728.565793] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 22:32:34 juju-e4d256-prod-github-runner-207 kernel: [61728.566982] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 22:32:34 juju-e4d256-prod-github-runner-207 kernel: [61728.568180] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 22:32:34 juju-e4d256-prod-github-runner-207 kernel: [61728.569380] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 22:32:34 juju-e4d256-prod-github-runner-207 kernel: [61728.570632] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 22:32:34 juju-e4d256-prod-github-runner-207 kernel: [61728.571740] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 22:32:34 juju-e4d256-prod-github-runner-207 kernel: [61728.573002] Call Trace: Aug 22 22:32:34 juju-e4d256-prod-github-runner-207 kernel: [61728.573959] Aug 22 22:32:34 juju-e4d256-prod-github-runner-207 kernel: [61728.574937] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:32:34 juju-e4d256-prod-github-runner-207 kernel: [61728.576047] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:32:34 juju-e4d256-prod-github-runner-207 kernel: [61728.577085] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:32:34 juju-e4d256-prod-github-runner-207 kernel: [61728.578198] ? show_regs.part.0+0x23/0x29 Aug 22 22:32:34 juju-e4d256-prod-github-runner-207 kernel: [61728.579254] ? show_regs.cold+0x8/0xd Aug 22 22:32:34 juju-e4d256-prod-github-runner-207 kernel: [61728.580259] ? watchdog_timer_fn+0x1be/0x220 Aug 22 22:32:34 juju-e4d256-prod-github-runner-207 kernel: [61728.581279] ? lockup_detector_update_enable+0x60/0x60 Aug 22 22:32:34 juju-e4d256-prod-github-runner-207 kernel: [61728.582371] ? __hrtimer_run_queues+0x107/0x230 Aug 22 22:32:34 juju-e4d256-prod-github-runner-207 kernel: [61728.583495] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 22:32:34 juju-e4d256-prod-github-runner-207 kernel: [61728.584546] ? hrtimer_interrupt+0x101/0x220 Aug 22 22:32:34 juju-e4d256-prod-github-runner-207 kernel: [61728.585574] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 22:32:34 juju-e4d256-prod-github-runner-207 kernel: [61728.586675] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 22:32:34 juju-e4d256-prod-github-runner-207 kernel: [61728.587774] Aug 22 22:32:34 juju-e4d256-prod-github-runner-207 kernel: [61728.588687] Aug 22 22:32:34 juju-e4d256-prod-github-runner-207 kernel: [61728.589610] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 22:32:34 juju-e4d256-prod-github-runner-207 kernel: [61728.590808] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:32:34 juju-e4d256-prod-github-runner-207 kernel: [61728.591947] ? _raw_spin_lock+0x22/0x30 Aug 22 22:32:34 juju-e4d256-prod-github-runner-207 kernel: [61728.592927] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:32:34 juju-e4d256-prod-github-runner-207 kernel: [61728.593988] direct_page_fault+0x206/0x310 [kvm] Aug 22 22:32:34 juju-e4d256-prod-github-runner-207 kernel: [61728.595033] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 22:32:34 juju-e4d256-prod-github-runner-207 kernel: [61728.596072] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 22:32:34 juju-e4d256-prod-github-runner-207 kernel: [61728.597089] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 22:32:34 juju-e4d256-prod-github-runner-207 kernel: [61728.598090] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 22:32:34 juju-e4d256-prod-github-runner-207 kernel: [61728.599073] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 22:32:34 juju-e4d256-prod-github-runner-207 kernel: [61728.600092] handle_exit+0x98/0x230 [kvm_amd] Aug 22 22:32:34 juju-e4d256-prod-github-runner-207 kernel: [61728.601008] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 22:32:34 juju-e4d256-prod-github-runner-207 kernel: [61728.601938] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 22:32:34 juju-e4d256-prod-github-runner-207 kernel: [61728.602898] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 22:32:34 juju-e4d256-prod-github-runner-207 kernel: [61728.603833] vcpu_run+0x62/0x2c0 [kvm] Aug 22 22:32:34 juju-e4d256-prod-github-runner-207 kernel: [61728.604841] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 22:32:34 juju-e4d256-prod-github-runner-207 kernel: [61728.605735] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 22:32:34 juju-e4d256-prod-github-runner-207 kernel: [61728.606605] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 22:32:34 juju-e4d256-prod-github-runner-207 kernel: [61728.607413] ? __seccomp_filter+0x4a/0x4a0 Aug 22 22:32:34 juju-e4d256-prod-github-runner-207 kernel: [61728.608200] ? __fget_files+0x86/0xc0 Aug 22 22:32:34 juju-e4d256-prod-github-runner-207 kernel: [61728.608918] __x64_sys_ioctl+0x95/0xd0 Aug 22 22:32:34 juju-e4d256-prod-github-runner-207 kernel: [61728.609638] do_syscall_64+0x5c/0xc0 Aug 22 22:32:34 juju-e4d256-prod-github-runner-207 kernel: [61728.610329] ? do_futex+0x162/0x1f0 Aug 22 22:32:34 juju-e4d256-prod-github-runner-207 kernel: [61728.611245] ? __x64_sys_futex+0x78/0x1e0 Aug 22 22:32:34 juju-e4d256-prod-github-runner-207 kernel: [61728.611980] ? __secure_computing+0xa9/0x120 Aug 22 22:32:34 juju-e4d256-prod-github-runner-207 kernel: [61728.612685] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 22:32:34 juju-e4d256-prod-github-runner-207 kernel: [61728.613466] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:32:34 juju-e4d256-prod-github-runner-207 kernel: [61728.614219] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:32:34 juju-e4d256-prod-github-runner-207 kernel: [61728.614972] ? do_syscall_64+0x69/0xc0 Aug 22 22:32:34 juju-e4d256-prod-github-runner-207 kernel: [61728.615635] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:32:34 juju-e4d256-prod-github-runner-207 kernel: [61728.616396] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:32:34 juju-e4d256-prod-github-runner-207 kernel: [61728.617128] ? do_syscall_64+0x69/0xc0 Aug 22 22:32:34 juju-e4d256-prod-github-runner-207 kernel: [61728.617762] ? do_syscall_64+0x69/0xc0 Aug 22 22:32:34 juju-e4d256-prod-github-runner-207 kernel: [61728.618421] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 22:32:34 juju-e4d256-prod-github-runner-207 kernel: [61728.619173] RIP: 0033:0x7faa5d0edaff Aug 22 22:32:34 juju-e4d256-prod-github-runner-207 kernel: [61728.619824] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 22:32:34 juju-e4d256-prod-github-runner-207 kernel: [61728.621881] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 22:32:34 juju-e4d256-prod-github-runner-207 kernel: [61728.622815] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 22:32:34 juju-e4d256-prod-github-runner-207 kernel: [61728.623726] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 22:32:34 juju-e4d256-prod-github-runner-207 kernel: [61728.624667] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 22:32:34 juju-e4d256-prod-github-runner-207 kernel: [61728.625616] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 22:32:34 juju-e4d256-prod-github-runner-207 kernel: [61728.626523] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 22:32:34 juju-e4d256-prod-github-runner-207 kernel: [61728.627430] Aug 22 22:32:47 juju-e4d256-prod-github-runner-207 kernel: [61741.304709] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 22:32:47 juju-e4d256-prod-github-runner-207 kernel: [61741.305704] rcu: 1-....: (15357480 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=7416855 Aug 22 22:32:47 juju-e4d256-prod-github-runner-207 kernel: [61741.306833] (t=15406026 jiffies g=23269 q=55087) Aug 22 22:32:47 juju-e4d256-prod-github-runner-207 kernel: [61741.307622] NMI backtrace for cpu 1 Aug 22 22:32:47 juju-e4d256-prod-github-runner-207 kernel: [61741.308364] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 22:32:47 juju-e4d256-prod-github-runner-207 kernel: [61741.309483] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 22:32:47 juju-e4d256-prod-github-runner-207 kernel: [61741.310552] Call Trace: Aug 22 22:32:47 juju-e4d256-prod-github-runner-207 kernel: [61741.311236] Aug 22 22:32:47 juju-e4d256-prod-github-runner-207 kernel: [61741.311911] show_stack+0x52/0x5c Aug 22 22:32:47 juju-e4d256-prod-github-runner-207 kernel: [61741.312643] dump_stack_lvl+0x4a/0x63 Aug 22 22:32:47 juju-e4d256-prod-github-runner-207 kernel: [61741.313419] dump_stack+0x10/0x16 Aug 22 22:32:47 juju-e4d256-prod-github-runner-207 kernel: [61741.314178] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 22:32:47 juju-e4d256-prod-github-runner-207 kernel: [61741.314967] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 22:32:47 juju-e4d256-prod-github-runner-207 kernel: [61741.315777] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 22:32:47 juju-e4d256-prod-github-runner-207 kernel: [61741.316597] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 22:32:47 juju-e4d256-prod-github-runner-207 kernel: [61741.317417] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 22:32:47 juju-e4d256-prod-github-runner-207 kernel: [61741.318229] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 22:32:47 juju-e4d256-prod-github-runner-207 kernel: [61741.319012] print_cpu_stall.cold+0x2f/0xe2 Aug 22 22:32:47 juju-e4d256-prod-github-runner-207 kernel: [61741.319821] ? timekeeping_update+0xf7/0x150 Aug 22 22:32:47 juju-e4d256-prod-github-runner-207 kernel: [61741.320596] check_cpu_stall+0x109/0x270 Aug 22 22:32:47 juju-e4d256-prod-github-runner-207 kernel: [61741.321350] rcu_sched_clock_irq+0x9a/0x250 Aug 22 22:32:47 juju-e4d256-prod-github-runner-207 kernel: [61741.322168] update_process_times+0x94/0xd0 Aug 22 22:32:47 juju-e4d256-prod-github-runner-207 kernel: [61741.322972] tick_sched_handle+0x29/0x70 Aug 22 22:32:47 juju-e4d256-prod-github-runner-207 kernel: [61741.323771] tick_sched_timer+0x8c/0xc0 Aug 22 22:32:47 juju-e4d256-prod-github-runner-207 kernel: [61741.324560] ? tick_nohz_handler+0xb0/0xb0 Aug 22 22:32:47 juju-e4d256-prod-github-runner-207 kernel: [61741.325323] __hrtimer_run_queues+0x107/0x230 Aug 22 22:32:47 juju-e4d256-prod-github-runner-207 kernel: [61741.326099] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 22:32:47 juju-e4d256-prod-github-runner-207 kernel: [61741.326876] hrtimer_interrupt+0x101/0x220 Aug 22 22:32:47 juju-e4d256-prod-github-runner-207 kernel: [61741.327638] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 22:32:47 juju-e4d256-prod-github-runner-207 kernel: [61741.328514] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 22:32:47 juju-e4d256-prod-github-runner-207 kernel: [61741.329366] Aug 22 22:32:47 juju-e4d256-prod-github-runner-207 kernel: [61741.330021] Aug 22 22:32:47 juju-e4d256-prod-github-runner-207 kernel: [61741.330770] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 22:32:47 juju-e4d256-prod-github-runner-207 kernel: [61741.331623] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:32:47 juju-e4d256-prod-github-runner-207 kernel: [61741.332537] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 22:32:47 juju-e4d256-prod-github-runner-207 kernel: [61741.334781] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 22:32:47 juju-e4d256-prod-github-runner-207 kernel: [61741.335666] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 22:32:47 juju-e4d256-prod-github-runner-207 kernel: [61741.336689] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 22:32:47 juju-e4d256-prod-github-runner-207 kernel: [61741.337672] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 22:32:47 juju-e4d256-prod-github-runner-207 kernel: [61741.338645] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 22:32:47 juju-e4d256-prod-github-runner-207 kernel: [61741.339620] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 22:32:47 juju-e4d256-prod-github-runner-207 kernel: [61741.340681] ? _raw_spin_lock+0x22/0x30 Aug 22 22:32:47 juju-e4d256-prod-github-runner-207 kernel: [61741.341466] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:32:47 juju-e4d256-prod-github-runner-207 kernel: [61741.342308] direct_page_fault+0x206/0x310 [kvm] Aug 22 22:32:47 juju-e4d256-prod-github-runner-207 kernel: [61741.343200] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 22:32:47 juju-e4d256-prod-github-runner-207 kernel: [61741.344092] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 22:32:47 juju-e4d256-prod-github-runner-207 kernel: [61741.344952] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 22:32:47 juju-e4d256-prod-github-runner-207 kernel: [61741.345777] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 22:32:47 juju-e4d256-prod-github-runner-207 kernel: [61741.346599] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 22:32:47 juju-e4d256-prod-github-runner-207 kernel: [61741.347530] handle_exit+0x98/0x230 [kvm_amd] Aug 22 22:32:47 juju-e4d256-prod-github-runner-207 kernel: [61741.348334] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 22:32:47 juju-e4d256-prod-github-runner-207 kernel: [61741.349122] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 22:32:47 juju-e4d256-prod-github-runner-207 kernel: [61741.349927] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 22:32:47 juju-e4d256-prod-github-runner-207 kernel: [61741.350736] vcpu_run+0x62/0x2c0 [kvm] Aug 22 22:32:47 juju-e4d256-prod-github-runner-207 kernel: [61741.351451] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 22:32:47 juju-e4d256-prod-github-runner-207 kernel: [61741.352203] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 22:32:47 juju-e4d256-prod-github-runner-207 kernel: [61741.353008] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 22:32:47 juju-e4d256-prod-github-runner-207 kernel: [61741.353771] ? __seccomp_filter+0x4a/0x4a0 Aug 22 22:32:47 juju-e4d256-prod-github-runner-207 kernel: [61741.354491] ? __fget_files+0x86/0xc0 Aug 22 22:32:47 juju-e4d256-prod-github-runner-207 kernel: [61741.355235] __x64_sys_ioctl+0x95/0xd0 Aug 22 22:32:47 juju-e4d256-prod-github-runner-207 kernel: [61741.355976] do_syscall_64+0x5c/0xc0 Aug 22 22:32:47 juju-e4d256-prod-github-runner-207 kernel: [61741.356662] ? do_futex+0x162/0x1f0 Aug 22 22:32:47 juju-e4d256-prod-github-runner-207 kernel: [61741.357338] ? __x64_sys_futex+0x78/0x1e0 Aug 22 22:32:47 juju-e4d256-prod-github-runner-207 kernel: [61741.358048] ? __secure_computing+0xa9/0x120 Aug 22 22:32:47 juju-e4d256-prod-github-runner-207 kernel: [61741.358773] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 22:32:47 juju-e4d256-prod-github-runner-207 kernel: [61741.359595] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:32:47 juju-e4d256-prod-github-runner-207 kernel: [61741.360423] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:32:47 juju-e4d256-prod-github-runner-207 kernel: [61741.361192] ? do_syscall_64+0x69/0xc0 Aug 22 22:32:47 juju-e4d256-prod-github-runner-207 kernel: [61741.361994] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:32:47 juju-e4d256-prod-github-runner-207 kernel: [61741.362775] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:32:47 juju-e4d256-prod-github-runner-207 kernel: [61741.363538] ? do_syscall_64+0x69/0xc0 Aug 22 22:32:47 juju-e4d256-prod-github-runner-207 kernel: [61741.364281] ? do_syscall_64+0x69/0xc0 Aug 22 22:32:47 juju-e4d256-prod-github-runner-207 kernel: [61741.365092] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 22:32:47 juju-e4d256-prod-github-runner-207 kernel: [61741.365927] RIP: 0033:0x7faa5d0edaff Aug 22 22:32:47 juju-e4d256-prod-github-runner-207 kernel: [61741.366620] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 22:32:47 juju-e4d256-prod-github-runner-207 kernel: [61741.368745] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 22:32:47 juju-e4d256-prod-github-runner-207 kernel: [61741.369849] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 22:32:47 juju-e4d256-prod-github-runner-207 kernel: [61741.370826] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 22:32:47 juju-e4d256-prod-github-runner-207 kernel: [61741.371827] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 22:32:47 juju-e4d256-prod-github-runner-207 kernel: [61741.372776] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 22:32:47 juju-e4d256-prod-github-runner-207 kernel: [61741.373713] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 22:32:47 juju-e4d256-prod-github-runner-207 kernel: [61741.374629] Aug 22 22:33:14 juju-e4d256-prod-github-runner-207 kernel: [61768.541980] watchdog: BUG: soft lockup - CPU#1 stuck for 57418s! [qemu-system-x86:6715] Aug 22 22:33:14 juju-e4d256-prod-github-runner-207 kernel: [61768.543852] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 22:33:14 juju-e4d256-prod-github-runner-207 kernel: [61768.544135] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 22:33:14 juju-e4d256-prod-github-runner-207 kernel: [61768.556657] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 22:33:14 juju-e4d256-prod-github-runner-207 kernel: [61768.557946] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 22:33:14 juju-e4d256-prod-github-runner-207 kernel: [61768.559242] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:33:14 juju-e4d256-prod-github-runner-207 kernel: [61768.560400] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 22:33:14 juju-e4d256-prod-github-runner-207 kernel: [61768.563154] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 22:33:14 juju-e4d256-prod-github-runner-207 kernel: [61768.564284] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 22:33:14 juju-e4d256-prod-github-runner-207 kernel: [61768.565456] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 22:33:14 juju-e4d256-prod-github-runner-207 kernel: [61768.566620] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 22:33:14 juju-e4d256-prod-github-runner-207 kernel: [61768.567855] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 22:33:14 juju-e4d256-prod-github-runner-207 kernel: [61768.569202] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 22:33:14 juju-e4d256-prod-github-runner-207 kernel: [61768.570386] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 22:33:14 juju-e4d256-prod-github-runner-207 kernel: [61768.571654] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 22:33:14 juju-e4d256-prod-github-runner-207 kernel: [61768.572775] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 22:33:14 juju-e4d256-prod-github-runner-207 kernel: [61768.573988] Call Trace: Aug 22 22:33:14 juju-e4d256-prod-github-runner-207 kernel: [61768.574930] Aug 22 22:33:14 juju-e4d256-prod-github-runner-207 kernel: [61768.575853] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:33:14 juju-e4d256-prod-github-runner-207 kernel: [61768.576895] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:33:14 juju-e4d256-prod-github-runner-207 kernel: [61768.577932] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:33:14 juju-e4d256-prod-github-runner-207 kernel: [61768.579039] ? show_regs.part.0+0x23/0x29 Aug 22 22:33:14 juju-e4d256-prod-github-runner-207 kernel: [61768.580064] ? show_regs.cold+0x8/0xd Aug 22 22:33:14 juju-e4d256-prod-github-runner-207 kernel: [61768.581055] ? watchdog_timer_fn+0x1be/0x220 Aug 22 22:33:14 juju-e4d256-prod-github-runner-207 kernel: [61768.582109] ? lockup_detector_update_enable+0x60/0x60 Aug 22 22:33:14 juju-e4d256-prod-github-runner-207 kernel: [61768.583200] ? __hrtimer_run_queues+0x107/0x230 Aug 22 22:33:14 juju-e4d256-prod-github-runner-207 kernel: [61768.584375] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 22:33:14 juju-e4d256-prod-github-runner-207 kernel: [61768.585648] ? hrtimer_interrupt+0x101/0x220 Aug 22 22:33:14 juju-e4d256-prod-github-runner-207 kernel: [61768.586671] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 22:33:14 juju-e4d256-prod-github-runner-207 kernel: [61768.587914] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 22:33:14 juju-e4d256-prod-github-runner-207 kernel: [61768.589013] Aug 22 22:33:14 juju-e4d256-prod-github-runner-207 kernel: [61768.589950] Aug 22 22:33:14 juju-e4d256-prod-github-runner-207 kernel: [61768.590801] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 22:33:14 juju-e4d256-prod-github-runner-207 kernel: [61768.591873] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:33:14 juju-e4d256-prod-github-runner-207 kernel: [61768.592925] ? _raw_spin_lock+0x22/0x30 Aug 22 22:33:14 juju-e4d256-prod-github-runner-207 kernel: [61768.593890] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:33:14 juju-e4d256-prod-github-runner-207 kernel: [61768.594918] direct_page_fault+0x206/0x310 [kvm] Aug 22 22:33:14 juju-e4d256-prod-github-runner-207 kernel: [61768.595965] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 22:33:14 juju-e4d256-prod-github-runner-207 kernel: [61768.596983] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 22:33:14 juju-e4d256-prod-github-runner-207 kernel: [61768.597993] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 22:33:14 juju-e4d256-prod-github-runner-207 kernel: [61768.599017] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 22:33:14 juju-e4d256-prod-github-runner-207 kernel: [61768.599986] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 22:33:14 juju-e4d256-prod-github-runner-207 kernel: [61768.600967] handle_exit+0x98/0x230 [kvm_amd] Aug 22 22:33:14 juju-e4d256-prod-github-runner-207 kernel: [61768.601863] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 22:33:14 juju-e4d256-prod-github-runner-207 kernel: [61768.602783] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 22:33:14 juju-e4d256-prod-github-runner-207 kernel: [61768.603763] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 22:33:14 juju-e4d256-prod-github-runner-207 kernel: [61768.604677] vcpu_run+0x62/0x2c0 [kvm] Aug 22 22:33:14 juju-e4d256-prod-github-runner-207 kernel: [61768.605546] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 22:33:14 juju-e4d256-prod-github-runner-207 kernel: [61768.606370] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 22:33:14 juju-e4d256-prod-github-runner-207 kernel: [61768.607238] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 22:33:14 juju-e4d256-prod-github-runner-207 kernel: [61768.608174] ? __seccomp_filter+0x4a/0x4a0 Aug 22 22:33:14 juju-e4d256-prod-github-runner-207 kernel: [61768.609097] ? __fget_files+0x86/0xc0 Aug 22 22:33:14 juju-e4d256-prod-github-runner-207 kernel: [61768.609817] __x64_sys_ioctl+0x95/0xd0 Aug 22 22:33:14 juju-e4d256-prod-github-runner-207 kernel: [61768.610524] do_syscall_64+0x5c/0xc0 Aug 22 22:33:14 juju-e4d256-prod-github-runner-207 kernel: [61768.611225] ? do_futex+0x162/0x1f0 Aug 22 22:33:14 juju-e4d256-prod-github-runner-207 kernel: [61768.611906] ? __x64_sys_futex+0x78/0x1e0 Aug 22 22:33:14 juju-e4d256-prod-github-runner-207 kernel: [61768.612604] ? __secure_computing+0xa9/0x120 Aug 22 22:33:14 juju-e4d256-prod-github-runner-207 kernel: [61768.613303] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 22:33:14 juju-e4d256-prod-github-runner-207 kernel: [61768.614081] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:33:14 juju-e4d256-prod-github-runner-207 kernel: [61768.614817] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:33:14 juju-e4d256-prod-github-runner-207 kernel: [61768.615574] ? do_syscall_64+0x69/0xc0 Aug 22 22:33:14 juju-e4d256-prod-github-runner-207 kernel: [61768.616261] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:33:14 juju-e4d256-prod-github-runner-207 kernel: [61768.616969] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:33:14 juju-e4d256-prod-github-runner-207 kernel: [61768.617666] ? do_syscall_64+0x69/0xc0 Aug 22 22:33:14 juju-e4d256-prod-github-runner-207 kernel: [61768.618296] ? do_syscall_64+0x69/0xc0 Aug 22 22:33:14 juju-e4d256-prod-github-runner-207 kernel: [61768.618934] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 22:33:14 juju-e4d256-prod-github-runner-207 kernel: [61768.619676] RIP: 0033:0x7faa5d0edaff Aug 22 22:33:14 juju-e4d256-prod-github-runner-207 kernel: [61768.620337] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 22:33:14 juju-e4d256-prod-github-runner-207 kernel: [61768.622589] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 22:33:14 juju-e4d256-prod-github-runner-207 kernel: [61768.623775] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 22:33:14 juju-e4d256-prod-github-runner-207 kernel: [61768.624788] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 22:33:14 juju-e4d256-prod-github-runner-207 kernel: [61768.625717] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 22:33:14 juju-e4d256-prod-github-runner-207 kernel: [61768.626607] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 22:33:14 juju-e4d256-prod-github-runner-207 kernel: [61768.627511] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 22:33:14 juju-e4d256-prod-github-runner-207 kernel: [61768.628413] Aug 22 22:33:42 juju-e4d256-prod-github-runner-207 kernel: [61796.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 57444s! [qemu-system-x86:6715] Aug 22 22:33:42 juju-e4d256-prod-github-runner-207 kernel: [61796.543139] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 22:33:42 juju-e4d256-prod-github-runner-207 kernel: [61796.543214] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 22:33:42 juju-e4d256-prod-github-runner-207 kernel: [61796.557473] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 22:33:42 juju-e4d256-prod-github-runner-207 kernel: [61796.558998] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 22:33:42 juju-e4d256-prod-github-runner-207 kernel: [61796.560427] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:33:42 juju-e4d256-prod-github-runner-207 kernel: [61796.561623] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 22:33:42 juju-e4d256-prod-github-runner-207 kernel: [61796.564550] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 22:33:42 juju-e4d256-prod-github-runner-207 kernel: [61796.565693] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 22:33:42 juju-e4d256-prod-github-runner-207 kernel: [61796.567017] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 22:33:42 juju-e4d256-prod-github-runner-207 kernel: [61796.568315] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 22:33:42 juju-e4d256-prod-github-runner-207 kernel: [61796.569639] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 22:33:42 juju-e4d256-prod-github-runner-207 kernel: [61796.570964] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 22:33:42 juju-e4d256-prod-github-runner-207 kernel: [61796.572414] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 22:33:42 juju-e4d256-prod-github-runner-207 kernel: [61796.573922] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 22:33:42 juju-e4d256-prod-github-runner-207 kernel: [61796.575373] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 22:33:42 juju-e4d256-prod-github-runner-207 kernel: [61796.576720] Call Trace: Aug 22 22:33:42 juju-e4d256-prod-github-runner-207 kernel: [61796.577700] Aug 22 22:33:42 juju-e4d256-prod-github-runner-207 kernel: [61796.578637] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:33:42 juju-e4d256-prod-github-runner-207 kernel: [61796.579834] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:33:42 juju-e4d256-prod-github-runner-207 kernel: [61796.581001] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:33:42 juju-e4d256-prod-github-runner-207 kernel: [61796.582199] ? show_regs.part.0+0x23/0x29 Aug 22 22:33:42 juju-e4d256-prod-github-runner-207 kernel: [61796.583381] ? show_regs.cold+0x8/0xd Aug 22 22:33:42 juju-e4d256-prod-github-runner-207 kernel: [61796.584436] ? watchdog_timer_fn+0x1be/0x220 Aug 22 22:33:42 juju-e4d256-prod-github-runner-207 kernel: [61796.585528] ? lockup_detector_update_enable+0x60/0x60 Aug 22 22:33:42 juju-e4d256-prod-github-runner-207 kernel: [61796.586698] ? __hrtimer_run_queues+0x107/0x230 Aug 22 22:33:42 juju-e4d256-prod-github-runner-207 kernel: [61796.587840] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 22:33:42 juju-e4d256-prod-github-runner-207 kernel: [61796.589143] ? hrtimer_interrupt+0x101/0x220 Aug 22 22:33:42 juju-e4d256-prod-github-runner-207 kernel: [61796.590254] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 22:33:42 juju-e4d256-prod-github-runner-207 kernel: [61796.591462] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 22:33:42 juju-e4d256-prod-github-runner-207 kernel: [61796.592652] Aug 22 22:33:42 juju-e4d256-prod-github-runner-207 kernel: [61796.593556] Aug 22 22:33:42 juju-e4d256-prod-github-runner-207 kernel: [61796.594445] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 22:33:42 juju-e4d256-prod-github-runner-207 kernel: [61796.595621] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:33:42 juju-e4d256-prod-github-runner-207 kernel: [61796.596789] ? _raw_spin_lock+0x22/0x30 Aug 22 22:33:42 juju-e4d256-prod-github-runner-207 kernel: [61796.597843] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:33:42 juju-e4d256-prod-github-runner-207 kernel: [61796.599053] direct_page_fault+0x206/0x310 [kvm] Aug 22 22:33:42 juju-e4d256-prod-github-runner-207 kernel: [61796.600190] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 22:33:42 juju-e4d256-prod-github-runner-207 kernel: [61796.601303] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 22:33:42 juju-e4d256-prod-github-runner-207 kernel: [61796.602404] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 22:33:42 juju-e4d256-prod-github-runner-207 kernel: [61796.603507] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 22:33:42 juju-e4d256-prod-github-runner-207 kernel: [61796.604577] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 22:33:42 juju-e4d256-prod-github-runner-207 kernel: [61796.605678] handle_exit+0x98/0x230 [kvm_amd] Aug 22 22:33:42 juju-e4d256-prod-github-runner-207 kernel: [61796.606667] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 22:33:42 juju-e4d256-prod-github-runner-207 kernel: [61796.607712] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 22:33:42 juju-e4d256-prod-github-runner-207 kernel: [61796.608748] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 22:33:42 juju-e4d256-prod-github-runner-207 kernel: [61796.609759] vcpu_run+0x62/0x2c0 [kvm] Aug 22 22:33:42 juju-e4d256-prod-github-runner-207 kernel: [61796.610683] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 22:33:42 juju-e4d256-prod-github-runner-207 kernel: [61796.611630] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 22:33:42 juju-e4d256-prod-github-runner-207 kernel: [61796.612592] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 22:33:42 juju-e4d256-prod-github-runner-207 kernel: [61796.613482] ? __seccomp_filter+0x4a/0x4a0 Aug 22 22:33:42 juju-e4d256-prod-github-runner-207 kernel: [61796.614314] ? __fget_files+0x86/0xc0 Aug 22 22:33:42 juju-e4d256-prod-github-runner-207 kernel: [61796.615117] __x64_sys_ioctl+0x95/0xd0 Aug 22 22:33:42 juju-e4d256-prod-github-runner-207 kernel: [61796.615891] do_syscall_64+0x5c/0xc0 Aug 22 22:33:42 juju-e4d256-prod-github-runner-207 kernel: [61796.616628] ? do_futex+0x162/0x1f0 Aug 22 22:33:42 juju-e4d256-prod-github-runner-207 kernel: [61796.617354] ? __x64_sys_futex+0x78/0x1e0 Aug 22 22:33:42 juju-e4d256-prod-github-runner-207 kernel: [61796.618107] ? __secure_computing+0xa9/0x120 Aug 22 22:33:42 juju-e4d256-prod-github-runner-207 kernel: [61796.618891] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 22:33:42 juju-e4d256-prod-github-runner-207 kernel: [61796.619780] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:33:42 juju-e4d256-prod-github-runner-207 kernel: [61796.620598] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:33:42 juju-e4d256-prod-github-runner-207 kernel: [61796.621415] ? do_syscall_64+0x69/0xc0 Aug 22 22:33:42 juju-e4d256-prod-github-runner-207 kernel: [61796.622142] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:33:42 juju-e4d256-prod-github-runner-207 kernel: [61796.622959] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:33:42 juju-e4d256-prod-github-runner-207 kernel: [61796.623751] ? do_syscall_64+0x69/0xc0 Aug 22 22:33:42 juju-e4d256-prod-github-runner-207 kernel: [61796.624454] ? do_syscall_64+0x69/0xc0 Aug 22 22:33:42 juju-e4d256-prod-github-runner-207 kernel: [61796.625153] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 22:33:42 juju-e4d256-prod-github-runner-207 kernel: [61796.625958] RIP: 0033:0x7faa5d0edaff Aug 22 22:33:42 juju-e4d256-prod-github-runner-207 kernel: [61796.626683] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 22:33:42 juju-e4d256-prod-github-runner-207 kernel: [61796.629031] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 22:33:42 juju-e4d256-prod-github-runner-207 kernel: [61796.630137] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 22:33:42 juju-e4d256-prod-github-runner-207 kernel: [61796.633284] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 22:33:42 juju-e4d256-prod-github-runner-207 kernel: [61796.634306] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 22:33:42 juju-e4d256-prod-github-runner-207 kernel: [61796.635369] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 22:33:42 juju-e4d256-prod-github-runner-207 kernel: [61796.636395] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 22:33:42 juju-e4d256-prod-github-runner-207 kernel: [61796.637441] Aug 22 22:34:10 juju-e4d256-prod-github-runner-207 kernel: [61824.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 57470s! [qemu-system-x86:6715] Aug 22 22:34:10 juju-e4d256-prod-github-runner-207 kernel: [61824.543198] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 22:34:10 juju-e4d256-prod-github-runner-207 kernel: [61824.543273] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 22:34:10 juju-e4d256-prod-github-runner-207 kernel: [61824.555794] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 22:34:10 juju-e4d256-prod-github-runner-207 kernel: [61824.557100] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 22:34:10 juju-e4d256-prod-github-runner-207 kernel: [61824.558446] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:34:10 juju-e4d256-prod-github-runner-207 kernel: [61824.559576] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 22:34:10 juju-e4d256-prod-github-runner-207 kernel: [61824.562191] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 22:34:10 juju-e4d256-prod-github-runner-207 kernel: [61824.563256] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 22:34:10 juju-e4d256-prod-github-runner-207 kernel: [61824.564501] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 22:34:10 juju-e4d256-prod-github-runner-207 kernel: [61824.565708] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 22:34:10 juju-e4d256-prod-github-runner-207 kernel: [61824.566922] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 22:34:10 juju-e4d256-prod-github-runner-207 kernel: [61824.568101] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 22:34:10 juju-e4d256-prod-github-runner-207 kernel: [61824.569283] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 22:34:10 juju-e4d256-prod-github-runner-207 kernel: [61824.570635] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 22:34:10 juju-e4d256-prod-github-runner-207 kernel: [61824.571767] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 22:34:10 juju-e4d256-prod-github-runner-207 kernel: [61824.572988] Call Trace: Aug 22 22:34:10 juju-e4d256-prod-github-runner-207 kernel: [61824.573970] Aug 22 22:34:10 juju-e4d256-prod-github-runner-207 kernel: [61824.574906] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:34:10 juju-e4d256-prod-github-runner-207 kernel: [61824.575987] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:34:10 juju-e4d256-prod-github-runner-207 kernel: [61824.577051] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:34:10 juju-e4d256-prod-github-runner-207 kernel: [61824.578282] ? show_regs.part.0+0x23/0x29 Aug 22 22:34:10 juju-e4d256-prod-github-runner-207 kernel: [61824.579439] ? show_regs.cold+0x8/0xd Aug 22 22:34:10 juju-e4d256-prod-github-runner-207 kernel: [61824.580618] ? watchdog_timer_fn+0x1be/0x220 Aug 22 22:34:10 juju-e4d256-prod-github-runner-207 kernel: [61824.581791] ? lockup_detector_update_enable+0x60/0x60 Aug 22 22:34:10 juju-e4d256-prod-github-runner-207 kernel: [61824.583330] ? __hrtimer_run_queues+0x107/0x230 Aug 22 22:34:10 juju-e4d256-prod-github-runner-207 kernel: [61824.584899] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 22:34:10 juju-e4d256-prod-github-runner-207 kernel: [61824.585970] ? hrtimer_interrupt+0x101/0x220 Aug 22 22:34:10 juju-e4d256-prod-github-runner-207 kernel: [61824.587026] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 22:34:10 juju-e4d256-prod-github-runner-207 kernel: [61824.588120] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 22:34:10 juju-e4d256-prod-github-runner-207 kernel: [61824.589200] Aug 22 22:34:10 juju-e4d256-prod-github-runner-207 kernel: [61824.590069] Aug 22 22:34:10 juju-e4d256-prod-github-runner-207 kernel: [61824.590952] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 22:34:10 juju-e4d256-prod-github-runner-207 kernel: [61824.591996] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:34:10 juju-e4d256-prod-github-runner-207 kernel: [61824.593042] ? _raw_spin_lock+0x22/0x30 Aug 22 22:34:10 juju-e4d256-prod-github-runner-207 kernel: [61824.593998] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:34:10 juju-e4d256-prod-github-runner-207 kernel: [61824.595057] direct_page_fault+0x206/0x310 [kvm] Aug 22 22:34:10 juju-e4d256-prod-github-runner-207 kernel: [61824.596092] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 22:34:10 juju-e4d256-prod-github-runner-207 kernel: [61824.597112] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 22:34:10 juju-e4d256-prod-github-runner-207 kernel: [61824.598148] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 22:34:10 juju-e4d256-prod-github-runner-207 kernel: [61824.599156] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 22:34:10 juju-e4d256-prod-github-runner-207 kernel: [61824.600121] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 22:34:10 juju-e4d256-prod-github-runner-207 kernel: [61824.601128] handle_exit+0x98/0x230 [kvm_amd] Aug 22 22:34:10 juju-e4d256-prod-github-runner-207 kernel: [61824.602114] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 22:34:10 juju-e4d256-prod-github-runner-207 kernel: [61824.603155] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 22:34:10 juju-e4d256-prod-github-runner-207 kernel: [61824.604256] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 22:34:10 juju-e4d256-prod-github-runner-207 kernel: [61824.605254] vcpu_run+0x62/0x2c0 [kvm] Aug 22 22:34:10 juju-e4d256-prod-github-runner-207 kernel: [61824.606203] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 22:34:10 juju-e4d256-prod-github-runner-207 kernel: [61824.607188] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 22:34:10 juju-e4d256-prod-github-runner-207 kernel: [61824.608144] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 22:34:10 juju-e4d256-prod-github-runner-207 kernel: [61824.609019] ? __seccomp_filter+0x4a/0x4a0 Aug 22 22:34:10 juju-e4d256-prod-github-runner-207 kernel: [61824.609850] ? __fget_files+0x86/0xc0 Aug 22 22:34:10 juju-e4d256-prod-github-runner-207 kernel: [61824.610667] __x64_sys_ioctl+0x95/0xd0 Aug 22 22:34:10 juju-e4d256-prod-github-runner-207 kernel: [61824.611442] do_syscall_64+0x5c/0xc0 Aug 22 22:34:10 juju-e4d256-prod-github-runner-207 kernel: [61824.612331] ? do_futex+0x162/0x1f0 Aug 22 22:34:10 juju-e4d256-prod-github-runner-207 kernel: [61824.613382] ? __x64_sys_futex+0x78/0x1e0 Aug 22 22:34:10 juju-e4d256-prod-github-runner-207 kernel: [61824.614149] ? __secure_computing+0xa9/0x120 Aug 22 22:34:10 juju-e4d256-prod-github-runner-207 kernel: [61824.614963] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 22:34:10 juju-e4d256-prod-github-runner-207 kernel: [61824.615842] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:34:10 juju-e4d256-prod-github-runner-207 kernel: [61824.616665] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:34:10 juju-e4d256-prod-github-runner-207 kernel: [61824.617464] ? do_syscall_64+0x69/0xc0 Aug 22 22:34:10 juju-e4d256-prod-github-runner-207 kernel: [61824.618389] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:34:10 juju-e4d256-prod-github-runner-207 kernel: [61824.619607] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:34:10 juju-e4d256-prod-github-runner-207 kernel: [61824.620775] ? do_syscall_64+0x69/0xc0 Aug 22 22:34:10 juju-e4d256-prod-github-runner-207 kernel: [61824.621773] ? do_syscall_64+0x69/0xc0 Aug 22 22:34:10 juju-e4d256-prod-github-runner-207 kernel: [61824.622515] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 22:34:10 juju-e4d256-prod-github-runner-207 kernel: [61824.623325] RIP: 0033:0x7faa5d0edaff Aug 22 22:34:10 juju-e4d256-prod-github-runner-207 kernel: [61824.624012] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 22:34:10 juju-e4d256-prod-github-runner-207 kernel: [61824.626376] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 22:34:10 juju-e4d256-prod-github-runner-207 kernel: [61824.627344] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 22:34:10 juju-e4d256-prod-github-runner-207 kernel: [61824.628288] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 22:34:10 juju-e4d256-prod-github-runner-207 kernel: [61824.629257] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 22:34:10 juju-e4d256-prod-github-runner-207 kernel: [61824.630243] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 22:34:10 juju-e4d256-prod-github-runner-207 kernel: [61824.631258] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 22:34:10 juju-e4d256-prod-github-runner-207 kernel: [61824.632208] Aug 22 22:34:38 juju-e4d256-prod-github-runner-207 kernel: [61852.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 57496s! [qemu-system-x86:6715] Aug 22 22:34:38 juju-e4d256-prod-github-runner-207 kernel: [61852.543852] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 22:34:38 juju-e4d256-prod-github-runner-207 kernel: [61852.544148] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 22:34:38 juju-e4d256-prod-github-runner-207 kernel: [61852.556352] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 22:34:38 juju-e4d256-prod-github-runner-207 kernel: [61852.557620] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 22:34:38 juju-e4d256-prod-github-runner-207 kernel: [61852.558909] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:34:38 juju-e4d256-prod-github-runner-207 kernel: [61852.560126] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 22:34:38 juju-e4d256-prod-github-runner-207 kernel: [61852.563034] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 22:34:38 juju-e4d256-prod-github-runner-207 kernel: [61852.564191] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 22:34:38 juju-e4d256-prod-github-runner-207 kernel: [61852.565492] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 22:34:38 juju-e4d256-prod-github-runner-207 kernel: [61852.566861] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 22:34:38 juju-e4d256-prod-github-runner-207 kernel: [61852.568294] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 22:34:38 juju-e4d256-prod-github-runner-207 kernel: [61852.569676] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 22:34:38 juju-e4d256-prod-github-runner-207 kernel: [61852.571125] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 22:34:38 juju-e4d256-prod-github-runner-207 kernel: [61852.572614] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 22:34:38 juju-e4d256-prod-github-runner-207 kernel: [61852.573889] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 22:34:38 juju-e4d256-prod-github-runner-207 kernel: [61852.575294] Call Trace: Aug 22 22:34:38 juju-e4d256-prod-github-runner-207 kernel: [61852.576276] Aug 22 22:34:38 juju-e4d256-prod-github-runner-207 kernel: [61852.577246] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:34:38 juju-e4d256-prod-github-runner-207 kernel: [61852.578398] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:34:38 juju-e4d256-prod-github-runner-207 kernel: [61852.579518] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:34:38 juju-e4d256-prod-github-runner-207 kernel: [61852.580709] ? show_regs.part.0+0x23/0x29 Aug 22 22:34:38 juju-e4d256-prod-github-runner-207 kernel: [61852.581798] ? show_regs.cold+0x8/0xd Aug 22 22:34:38 juju-e4d256-prod-github-runner-207 kernel: [61852.582862] ? watchdog_timer_fn+0x1be/0x220 Aug 22 22:34:38 juju-e4d256-prod-github-runner-207 kernel: [61852.583965] ? lockup_detector_update_enable+0x60/0x60 Aug 22 22:34:38 juju-e4d256-prod-github-runner-207 kernel: [61852.585130] ? __hrtimer_run_queues+0x107/0x230 Aug 22 22:34:38 juju-e4d256-prod-github-runner-207 kernel: [61852.586264] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 22:34:38 juju-e4d256-prod-github-runner-207 kernel: [61852.587376] ? hrtimer_interrupt+0x101/0x220 Aug 22 22:34:38 juju-e4d256-prod-github-runner-207 kernel: [61852.588496] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 22:34:38 juju-e4d256-prod-github-runner-207 kernel: [61852.589630] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 22:34:38 juju-e4d256-prod-github-runner-207 kernel: [61852.590736] Aug 22 22:34:38 juju-e4d256-prod-github-runner-207 kernel: [61852.591592] Aug 22 22:34:38 juju-e4d256-prod-github-runner-207 kernel: [61852.592436] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 22:34:38 juju-e4d256-prod-github-runner-207 kernel: [61852.593475] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:34:38 juju-e4d256-prod-github-runner-207 kernel: [61852.594557] ? _raw_spin_lock+0x22/0x30 Aug 22 22:34:38 juju-e4d256-prod-github-runner-207 kernel: [61852.595534] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:34:38 juju-e4d256-prod-github-runner-207 kernel: [61852.596553] direct_page_fault+0x206/0x310 [kvm] Aug 22 22:34:38 juju-e4d256-prod-github-runner-207 kernel: [61852.597575] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 22:34:38 juju-e4d256-prod-github-runner-207 kernel: [61852.598618] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 22:34:38 juju-e4d256-prod-github-runner-207 kernel: [61852.599629] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 22:34:38 juju-e4d256-prod-github-runner-207 kernel: [61852.600661] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 22:34:38 juju-e4d256-prod-github-runner-207 kernel: [61852.601671] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 22:34:38 juju-e4d256-prod-github-runner-207 kernel: [61852.602818] handle_exit+0x98/0x230 [kvm_amd] Aug 22 22:34:38 juju-e4d256-prod-github-runner-207 kernel: [61852.603724] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 22:34:38 juju-e4d256-prod-github-runner-207 kernel: [61852.604654] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 22:34:38 juju-e4d256-prod-github-runner-207 kernel: [61852.605601] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 22:34:38 juju-e4d256-prod-github-runner-207 kernel: [61852.606559] vcpu_run+0x62/0x2c0 [kvm] Aug 22 22:34:38 juju-e4d256-prod-github-runner-207 kernel: [61852.607397] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 22:34:38 juju-e4d256-prod-github-runner-207 kernel: [61852.608220] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 22:34:38 juju-e4d256-prod-github-runner-207 kernel: [61852.609250] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 22:34:38 juju-e4d256-prod-github-runner-207 kernel: [61852.610054] ? __seccomp_filter+0x4a/0x4a0 Aug 22 22:34:38 juju-e4d256-prod-github-runner-207 kernel: [61852.610822] ? __fget_files+0x86/0xc0 Aug 22 22:34:38 juju-e4d256-prod-github-runner-207 kernel: [61852.611535] __x64_sys_ioctl+0x95/0xd0 Aug 22 22:34:38 juju-e4d256-prod-github-runner-207 kernel: [61852.612227] do_syscall_64+0x5c/0xc0 Aug 22 22:34:38 juju-e4d256-prod-github-runner-207 kernel: [61852.612891] ? do_futex+0x162/0x1f0 Aug 22 22:34:38 juju-e4d256-prod-github-runner-207 kernel: [61852.613591] ? __x64_sys_futex+0x78/0x1e0 Aug 22 22:34:38 juju-e4d256-prod-github-runner-207 kernel: [61852.614304] ? __secure_computing+0xa9/0x120 Aug 22 22:34:38 juju-e4d256-prod-github-runner-207 kernel: [61852.614995] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 22:34:38 juju-e4d256-prod-github-runner-207 kernel: [61852.615770] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:34:38 juju-e4d256-prod-github-runner-207 kernel: [61852.616492] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:34:38 juju-e4d256-prod-github-runner-207 kernel: [61852.617217] ? do_syscall_64+0x69/0xc0 Aug 22 22:34:38 juju-e4d256-prod-github-runner-207 kernel: [61852.617866] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:34:38 juju-e4d256-prod-github-runner-207 kernel: [61852.618619] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:34:38 juju-e4d256-prod-github-runner-207 kernel: [61852.619316] ? do_syscall_64+0x69/0xc0 Aug 22 22:34:38 juju-e4d256-prod-github-runner-207 kernel: [61852.619945] ? do_syscall_64+0x69/0xc0 Aug 22 22:34:38 juju-e4d256-prod-github-runner-207 kernel: [61852.620564] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 22:34:38 juju-e4d256-prod-github-runner-207 kernel: [61852.621269] RIP: 0033:0x7faa5d0edaff Aug 22 22:34:38 juju-e4d256-prod-github-runner-207 kernel: [61852.621933] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 22:34:38 juju-e4d256-prod-github-runner-207 kernel: [61852.623967] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 22:34:38 juju-e4d256-prod-github-runner-207 kernel: [61852.624890] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 22:34:38 juju-e4d256-prod-github-runner-207 kernel: [61852.625782] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 22:34:38 juju-e4d256-prod-github-runner-207 kernel: [61852.626695] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 22:34:38 juju-e4d256-prod-github-runner-207 kernel: [61852.627692] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 22:34:38 juju-e4d256-prod-github-runner-207 kernel: [61852.628589] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 22:34:38 juju-e4d256-prod-github-runner-207 kernel: [61852.629488] Aug 22 22:35:06 juju-e4d256-prod-github-runner-207 kernel: [61880.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 57522s! [qemu-system-x86:6715] Aug 22 22:35:06 juju-e4d256-prod-github-runner-207 kernel: [61880.543252] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 22:35:06 juju-e4d256-prod-github-runner-207 kernel: [61880.543324] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 22:35:06 juju-e4d256-prod-github-runner-207 kernel: [61880.556302] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 22:35:06 juju-e4d256-prod-github-runner-207 kernel: [61880.557665] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 22:35:06 juju-e4d256-prod-github-runner-207 kernel: [61880.558964] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:35:06 juju-e4d256-prod-github-runner-207 kernel: [61880.560066] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 22:35:06 juju-e4d256-prod-github-runner-207 kernel: [61880.562907] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 22:35:06 juju-e4d256-prod-github-runner-207 kernel: [61880.564019] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 22:35:06 juju-e4d256-prod-github-runner-207 kernel: [61880.565229] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 22:35:06 juju-e4d256-prod-github-runner-207 kernel: [61880.566617] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 22:35:06 juju-e4d256-prod-github-runner-207 kernel: [61880.567975] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 22:35:06 juju-e4d256-prod-github-runner-207 kernel: [61880.569360] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 22:35:06 juju-e4d256-prod-github-runner-207 kernel: [61880.570716] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 22:35:06 juju-e4d256-prod-github-runner-207 kernel: [61880.572205] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 22:35:06 juju-e4d256-prod-github-runner-207 kernel: [61880.573494] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 22:35:06 juju-e4d256-prod-github-runner-207 kernel: [61880.574892] Call Trace: Aug 22 22:35:06 juju-e4d256-prod-github-runner-207 kernel: [61880.575893] Aug 22 22:35:06 juju-e4d256-prod-github-runner-207 kernel: [61880.576894] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:35:06 juju-e4d256-prod-github-runner-207 kernel: [61880.578054] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:35:06 juju-e4d256-prod-github-runner-207 kernel: [61880.579200] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:35:06 juju-e4d256-prod-github-runner-207 kernel: [61880.580418] ? show_regs.part.0+0x23/0x29 Aug 22 22:35:06 juju-e4d256-prod-github-runner-207 kernel: [61880.581560] ? show_regs.cold+0x8/0xd Aug 22 22:35:06 juju-e4d256-prod-github-runner-207 kernel: [61880.582671] ? watchdog_timer_fn+0x1be/0x220 Aug 22 22:35:06 juju-e4d256-prod-github-runner-207 kernel: [61880.583830] ? lockup_detector_update_enable+0x60/0x60 Aug 22 22:35:06 juju-e4d256-prod-github-runner-207 kernel: [61880.585044] ? __hrtimer_run_queues+0x107/0x230 Aug 22 22:35:06 juju-e4d256-prod-github-runner-207 kernel: [61880.586247] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 22:35:06 juju-e4d256-prod-github-runner-207 kernel: [61880.587385] ? hrtimer_interrupt+0x101/0x220 Aug 22 22:35:06 juju-e4d256-prod-github-runner-207 kernel: [61880.588581] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 22:35:06 juju-e4d256-prod-github-runner-207 kernel: [61880.589796] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 22:35:06 juju-e4d256-prod-github-runner-207 kernel: [61880.590995] Aug 22 22:35:06 juju-e4d256-prod-github-runner-207 kernel: [61880.591932] Aug 22 22:35:06 juju-e4d256-prod-github-runner-207 kernel: [61880.592843] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 22:35:06 juju-e4d256-prod-github-runner-207 kernel: [61880.594026] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:35:06 juju-e4d256-prod-github-runner-207 kernel: [61880.595204] ? _raw_spin_lock+0x22/0x30 Aug 22 22:35:06 juju-e4d256-prod-github-runner-207 kernel: [61880.596256] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:35:06 juju-e4d256-prod-github-runner-207 kernel: [61880.597406] direct_page_fault+0x206/0x310 [kvm] Aug 22 22:35:06 juju-e4d256-prod-github-runner-207 kernel: [61880.598564] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 22:35:06 juju-e4d256-prod-github-runner-207 kernel: [61880.599727] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 22:35:06 juju-e4d256-prod-github-runner-207 kernel: [61880.600866] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 22:35:06 juju-e4d256-prod-github-runner-207 kernel: [61880.602006] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 22:35:06 juju-e4d256-prod-github-runner-207 kernel: [61880.603144] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 22:35:06 juju-e4d256-prod-github-runner-207 kernel: [61880.604497] handle_exit+0x98/0x230 [kvm_amd] Aug 22 22:35:06 juju-e4d256-prod-github-runner-207 kernel: [61880.605529] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 22:35:06 juju-e4d256-prod-github-runner-207 kernel: [61880.606578] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 22:35:06 juju-e4d256-prod-github-runner-207 kernel: [61880.607621] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 22:35:06 juju-e4d256-prod-github-runner-207 kernel: [61880.608658] vcpu_run+0x62/0x2c0 [kvm] Aug 22 22:35:06 juju-e4d256-prod-github-runner-207 kernel: [61880.609567] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 22:35:06 juju-e4d256-prod-github-runner-207 kernel: [61880.610526] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 22:35:06 juju-e4d256-prod-github-runner-207 kernel: [61880.611490] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 22:35:06 juju-e4d256-prod-github-runner-207 kernel: [61880.612385] ? __seccomp_filter+0x4a/0x4a0 Aug 22 22:35:06 juju-e4d256-prod-github-runner-207 kernel: [61880.613220] ? __fget_files+0x86/0xc0 Aug 22 22:35:06 juju-e4d256-prod-github-runner-207 kernel: [61880.614048] __x64_sys_ioctl+0x95/0xd0 Aug 22 22:35:06 juju-e4d256-prod-github-runner-207 kernel: [61880.614841] do_syscall_64+0x5c/0xc0 Aug 22 22:35:06 juju-e4d256-prod-github-runner-207 kernel: [61880.615613] ? do_futex+0x162/0x1f0 Aug 22 22:35:06 juju-e4d256-prod-github-runner-207 kernel: [61880.616451] ? __x64_sys_futex+0x78/0x1e0 Aug 22 22:35:06 juju-e4d256-prod-github-runner-207 kernel: [61880.617256] ? __secure_computing+0xa9/0x120 Aug 22 22:35:06 juju-e4d256-prod-github-runner-207 kernel: [61880.618089] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 22:35:06 juju-e4d256-prod-github-runner-207 kernel: [61880.618969] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:35:06 juju-e4d256-prod-github-runner-207 kernel: [61880.619793] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:35:06 juju-e4d256-prod-github-runner-207 kernel: [61880.620617] ? do_syscall_64+0x69/0xc0 Aug 22 22:35:06 juju-e4d256-prod-github-runner-207 kernel: [61880.621355] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:35:06 juju-e4d256-prod-github-runner-207 kernel: [61880.622245] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:35:06 juju-e4d256-prod-github-runner-207 kernel: [61880.623160] ? do_syscall_64+0x69/0xc0 Aug 22 22:35:06 juju-e4d256-prod-github-runner-207 kernel: [61880.623882] ? do_syscall_64+0x69/0xc0 Aug 22 22:35:06 juju-e4d256-prod-github-runner-207 kernel: [61880.624613] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 22:35:06 juju-e4d256-prod-github-runner-207 kernel: [61880.625435] RIP: 0033:0x7faa5d0edaff Aug 22 22:35:06 juju-e4d256-prod-github-runner-207 kernel: [61880.626198] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 22:35:06 juju-e4d256-prod-github-runner-207 kernel: [61880.628545] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 22:35:06 juju-e4d256-prod-github-runner-207 kernel: [61880.629616] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 22:35:06 juju-e4d256-prod-github-runner-207 kernel: [61880.630678] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 22:35:06 juju-e4d256-prod-github-runner-207 kernel: [61880.631715] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 22:35:06 juju-e4d256-prod-github-runner-207 kernel: [61880.632765] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 22:35:06 juju-e4d256-prod-github-runner-207 kernel: [61880.633833] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 22:35:06 juju-e4d256-prod-github-runner-207 kernel: [61880.635083] Aug 22 22:35:34 juju-e4d256-prod-github-runner-207 kernel: [61908.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 57548s! [qemu-system-x86:6715] Aug 22 22:35:34 juju-e4d256-prod-github-runner-207 kernel: [61908.543107] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 22:35:34 juju-e4d256-prod-github-runner-207 kernel: [61908.543179] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 22:35:34 juju-e4d256-prod-github-runner-207 kernel: [61908.555395] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 22:35:34 juju-e4d256-prod-github-runner-207 kernel: [61908.556729] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 22:35:34 juju-e4d256-prod-github-runner-207 kernel: [61908.558634] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:35:34 juju-e4d256-prod-github-runner-207 kernel: [61908.560678] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 22:35:34 juju-e4d256-prod-github-runner-207 kernel: [61908.564878] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 22:35:34 juju-e4d256-prod-github-runner-207 kernel: [61908.566443] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 22:35:34 juju-e4d256-prod-github-runner-207 kernel: [61908.568186] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 22:35:34 juju-e4d256-prod-github-runner-207 kernel: [61908.569914] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 22:35:34 juju-e4d256-prod-github-runner-207 kernel: [61908.571113] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 22:35:34 juju-e4d256-prod-github-runner-207 kernel: [61908.572330] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 22:35:34 juju-e4d256-prod-github-runner-207 kernel: [61908.573538] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 22:35:34 juju-e4d256-prod-github-runner-207 kernel: [61908.574792] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 22:35:34 juju-e4d256-prod-github-runner-207 kernel: [61908.575898] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 22:35:34 juju-e4d256-prod-github-runner-207 kernel: [61908.577120] Call Trace: Aug 22 22:35:34 juju-e4d256-prod-github-runner-207 kernel: [61908.578075] Aug 22 22:35:34 juju-e4d256-prod-github-runner-207 kernel: [61908.578967] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:35:34 juju-e4d256-prod-github-runner-207 kernel: [61908.580010] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:35:34 juju-e4d256-prod-github-runner-207 kernel: [61908.581037] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:35:34 juju-e4d256-prod-github-runner-207 kernel: [61908.582139] ? show_regs.part.0+0x23/0x29 Aug 22 22:35:34 juju-e4d256-prod-github-runner-207 kernel: [61908.583177] ? show_regs.cold+0x8/0xd Aug 22 22:35:34 juju-e4d256-prod-github-runner-207 kernel: [61908.584161] ? watchdog_timer_fn+0x1be/0x220 Aug 22 22:35:34 juju-e4d256-prod-github-runner-207 kernel: [61908.585177] ? lockup_detector_update_enable+0x60/0x60 Aug 22 22:35:34 juju-e4d256-prod-github-runner-207 kernel: [61908.586273] ? __hrtimer_run_queues+0x107/0x230 Aug 22 22:35:34 juju-e4d256-prod-github-runner-207 kernel: [61908.587321] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 22:35:34 juju-e4d256-prod-github-runner-207 kernel: [61908.588354] ? hrtimer_interrupt+0x101/0x220 Aug 22 22:35:34 juju-e4d256-prod-github-runner-207 kernel: [61908.589367] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 22:35:34 juju-e4d256-prod-github-runner-207 kernel: [61908.590446] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 22:35:34 juju-e4d256-prod-github-runner-207 kernel: [61908.591490] Aug 22 22:35:34 juju-e4d256-prod-github-runner-207 kernel: [61908.592344] Aug 22 22:35:34 juju-e4d256-prod-github-runner-207 kernel: [61908.593181] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 22:35:34 juju-e4d256-prod-github-runner-207 kernel: [61908.594440] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:35:34 juju-e4d256-prod-github-runner-207 kernel: [61908.595733] ? _raw_spin_lock+0x22/0x30 Aug 22 22:35:34 juju-e4d256-prod-github-runner-207 kernel: [61908.596836] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:35:34 juju-e4d256-prod-github-runner-207 kernel: [61908.598196] direct_page_fault+0x206/0x310 [kvm] Aug 22 22:35:34 juju-e4d256-prod-github-runner-207 kernel: [61908.599619] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 22:35:34 juju-e4d256-prod-github-runner-207 kernel: [61908.600976] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 22:35:34 juju-e4d256-prod-github-runner-207 kernel: [61908.602033] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 22:35:34 juju-e4d256-prod-github-runner-207 kernel: [61908.603025] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 22:35:34 juju-e4d256-prod-github-runner-207 kernel: [61908.604190] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 22:35:34 juju-e4d256-prod-github-runner-207 kernel: [61908.605387] handle_exit+0x98/0x230 [kvm_amd] Aug 22 22:35:34 juju-e4d256-prod-github-runner-207 kernel: [61908.606428] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 22:35:34 juju-e4d256-prod-github-runner-207 kernel: [61908.607392] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 22:35:34 juju-e4d256-prod-github-runner-207 kernel: [61908.608350] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 22:35:34 juju-e4d256-prod-github-runner-207 kernel: [61908.609319] vcpu_run+0x62/0x2c0 [kvm] Aug 22 22:35:34 juju-e4d256-prod-github-runner-207 kernel: [61908.610199] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 22:35:34 juju-e4d256-prod-github-runner-207 kernel: [61908.611199] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 22:35:34 juju-e4d256-prod-github-runner-207 kernel: [61908.612091] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 22:35:34 juju-e4d256-prod-github-runner-207 kernel: [61908.612902] ? __seccomp_filter+0x4a/0x4a0 Aug 22 22:35:34 juju-e4d256-prod-github-runner-207 kernel: [61908.613671] ? __fget_files+0x86/0xc0 Aug 22 22:35:34 juju-e4d256-prod-github-runner-207 kernel: [61908.614383] __x64_sys_ioctl+0x95/0xd0 Aug 22 22:35:34 juju-e4d256-prod-github-runner-207 kernel: [61908.615083] do_syscall_64+0x5c/0xc0 Aug 22 22:35:34 juju-e4d256-prod-github-runner-207 kernel: [61908.615759] ? do_futex+0x162/0x1f0 Aug 22 22:35:34 juju-e4d256-prod-github-runner-207 kernel: [61908.616432] ? __x64_sys_futex+0x78/0x1e0 Aug 22 22:35:34 juju-e4d256-prod-github-runner-207 kernel: [61908.617124] ? __secure_computing+0xa9/0x120 Aug 22 22:35:34 juju-e4d256-prod-github-runner-207 kernel: [61908.617843] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 22:35:34 juju-e4d256-prod-github-runner-207 kernel: [61908.618620] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:35:34 juju-e4d256-prod-github-runner-207 kernel: [61908.619350] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:35:34 juju-e4d256-prod-github-runner-207 kernel: [61908.620078] ? do_syscall_64+0x69/0xc0 Aug 22 22:35:34 juju-e4d256-prod-github-runner-207 kernel: [61908.620747] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:35:34 juju-e4d256-prod-github-runner-207 kernel: [61908.621460] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:35:34 juju-e4d256-prod-github-runner-207 kernel: [61908.622201] ? do_syscall_64+0x69/0xc0 Aug 22 22:35:34 juju-e4d256-prod-github-runner-207 kernel: [61908.622834] ? do_syscall_64+0x69/0xc0 Aug 22 22:35:34 juju-e4d256-prod-github-runner-207 kernel: [61908.623457] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 22:35:34 juju-e4d256-prod-github-runner-207 kernel: [61908.624167] RIP: 0033:0x7faa5d0edaff Aug 22 22:35:34 juju-e4d256-prod-github-runner-207 kernel: [61908.624803] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 22:35:34 juju-e4d256-prod-github-runner-207 kernel: [61908.626819] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 22:35:34 juju-e4d256-prod-github-runner-207 kernel: [61908.627745] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 22:35:34 juju-e4d256-prod-github-runner-207 kernel: [61908.628643] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 22:35:34 juju-e4d256-prod-github-runner-207 kernel: [61908.629567] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 22:35:34 juju-e4d256-prod-github-runner-207 kernel: [61908.630543] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 22:35:34 juju-e4d256-prod-github-runner-207 kernel: [61908.631450] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 22:35:34 juju-e4d256-prod-github-runner-207 kernel: [61908.632387] Aug 22 22:35:47 juju-e4d256-prod-github-runner-207 kernel: [61921.316705] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 22:35:47 juju-e4d256-prod-github-runner-207 kernel: [61921.317708] rcu: 1-....: (15402336 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=7438036 Aug 22 22:35:47 juju-e4d256-prod-github-runner-207 kernel: [61921.318831] (t=15451029 jiffies g=23269 q=55188) Aug 22 22:35:47 juju-e4d256-prod-github-runner-207 kernel: [61921.319742] NMI backtrace for cpu 1 Aug 22 22:35:47 juju-e4d256-prod-github-runner-207 kernel: [61921.320527] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 22:35:47 juju-e4d256-prod-github-runner-207 kernel: [61921.321820] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 22:35:47 juju-e4d256-prod-github-runner-207 kernel: [61921.323044] Call Trace: Aug 22 22:35:47 juju-e4d256-prod-github-runner-207 kernel: [61921.323769] Aug 22 22:35:47 juju-e4d256-prod-github-runner-207 kernel: [61921.324460] show_stack+0x52/0x5c Aug 22 22:35:47 juju-e4d256-prod-github-runner-207 kernel: [61921.325255] dump_stack_lvl+0x4a/0x63 Aug 22 22:35:47 juju-e4d256-prod-github-runner-207 kernel: [61921.326091] dump_stack+0x10/0x16 Aug 22 22:35:47 juju-e4d256-prod-github-runner-207 kernel: [61921.326890] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 22:35:47 juju-e4d256-prod-github-runner-207 kernel: [61921.327753] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 22:35:47 juju-e4d256-prod-github-runner-207 kernel: [61921.328616] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 22:35:47 juju-e4d256-prod-github-runner-207 kernel: [61921.329565] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 22:35:47 juju-e4d256-prod-github-runner-207 kernel: [61921.330499] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 22:35:47 juju-e4d256-prod-github-runner-207 kernel: [61921.331555] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 22:35:47 juju-e4d256-prod-github-runner-207 kernel: [61921.332368] print_cpu_stall.cold+0x2f/0xe2 Aug 22 22:35:47 juju-e4d256-prod-github-runner-207 kernel: [61921.333141] ? timekeeping_update+0xf7/0x150 Aug 22 22:35:47 juju-e4d256-prod-github-runner-207 kernel: [61921.333935] check_cpu_stall+0x109/0x270 Aug 22 22:35:47 juju-e4d256-prod-github-runner-207 kernel: [61921.334684] rcu_sched_clock_irq+0x9a/0x250 Aug 22 22:35:47 juju-e4d256-prod-github-runner-207 kernel: [61921.335450] update_process_times+0x94/0xd0 Aug 22 22:35:47 juju-e4d256-prod-github-runner-207 kernel: [61921.336213] tick_sched_handle+0x29/0x70 Aug 22 22:35:47 juju-e4d256-prod-github-runner-207 kernel: [61921.336973] tick_sched_timer+0x8c/0xc0 Aug 22 22:35:47 juju-e4d256-prod-github-runner-207 kernel: [61921.337759] ? tick_nohz_handler+0xb0/0xb0 Aug 22 22:35:47 juju-e4d256-prod-github-runner-207 kernel: [61921.338523] __hrtimer_run_queues+0x107/0x230 Aug 22 22:35:47 juju-e4d256-prod-github-runner-207 kernel: [61921.339300] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 22:35:47 juju-e4d256-prod-github-runner-207 kernel: [61921.340079] hrtimer_interrupt+0x101/0x220 Aug 22 22:35:47 juju-e4d256-prod-github-runner-207 kernel: [61921.340858] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 22:35:47 juju-e4d256-prod-github-runner-207 kernel: [61921.341709] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 22:35:47 juju-e4d256-prod-github-runner-207 kernel: [61921.342530] Aug 22 22:35:47 juju-e4d256-prod-github-runner-207 kernel: [61921.343172] Aug 22 22:35:47 juju-e4d256-prod-github-runner-207 kernel: [61921.343806] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 22:35:47 juju-e4d256-prod-github-runner-207 kernel: [61921.344630] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:35:47 juju-e4d256-prod-github-runner-207 kernel: [61921.345552] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 22:35:47 juju-e4d256-prod-github-runner-207 kernel: [61921.347855] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 22:35:47 juju-e4d256-prod-github-runner-207 kernel: [61921.348750] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 22:35:47 juju-e4d256-prod-github-runner-207 kernel: [61921.349775] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 22:35:47 juju-e4d256-prod-github-runner-207 kernel: [61921.350774] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 22:35:47 juju-e4d256-prod-github-runner-207 kernel: [61921.351754] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 22:35:47 juju-e4d256-prod-github-runner-207 kernel: [61921.352892] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 22:35:47 juju-e4d256-prod-github-runner-207 kernel: [61921.354014] ? _raw_spin_lock+0x22/0x30 Aug 22 22:35:47 juju-e4d256-prod-github-runner-207 kernel: [61921.354858] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:35:47 juju-e4d256-prod-github-runner-207 kernel: [61921.355778] direct_page_fault+0x206/0x310 [kvm] Aug 22 22:35:47 juju-e4d256-prod-github-runner-207 kernel: [61921.356722] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 22:35:47 juju-e4d256-prod-github-runner-207 kernel: [61921.357671] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 22:35:47 juju-e4d256-prod-github-runner-207 kernel: [61921.358581] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 22:35:47 juju-e4d256-prod-github-runner-207 kernel: [61921.359471] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 22:35:47 juju-e4d256-prod-github-runner-207 kernel: [61921.360342] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 22:35:47 juju-e4d256-prod-github-runner-207 kernel: [61921.361264] handle_exit+0x98/0x230 [kvm_amd] Aug 22 22:35:47 juju-e4d256-prod-github-runner-207 kernel: [61921.362112] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 22:35:47 juju-e4d256-prod-github-runner-207 kernel: [61921.362979] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 22:35:47 juju-e4d256-prod-github-runner-207 kernel: [61921.363883] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 22:35:47 juju-e4d256-prod-github-runner-207 kernel: [61921.364762] vcpu_run+0x62/0x2c0 [kvm] Aug 22 22:35:47 juju-e4d256-prod-github-runner-207 kernel: [61921.365574] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 22:35:47 juju-e4d256-prod-github-runner-207 kernel: [61921.366394] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 22:35:47 juju-e4d256-prod-github-runner-207 kernel: [61921.367287] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 22:35:47 juju-e4d256-prod-github-runner-207 kernel: [61921.368134] ? __seccomp_filter+0x4a/0x4a0 Aug 22 22:35:47 juju-e4d256-prod-github-runner-207 kernel: [61921.368937] ? __fget_files+0x86/0xc0 Aug 22 22:35:47 juju-e4d256-prod-github-runner-207 kernel: [61921.369726] __x64_sys_ioctl+0x95/0xd0 Aug 22 22:35:47 juju-e4d256-prod-github-runner-207 kernel: [61921.370497] do_syscall_64+0x5c/0xc0 Aug 22 22:35:47 juju-e4d256-prod-github-runner-207 kernel: [61921.371253] ? do_futex+0x162/0x1f0 Aug 22 22:35:47 juju-e4d256-prod-github-runner-207 kernel: [61921.371993] ? __x64_sys_futex+0x78/0x1e0 Aug 22 22:35:47 juju-e4d256-prod-github-runner-207 kernel: [61921.372780] ? __secure_computing+0xa9/0x120 Aug 22 22:35:47 juju-e4d256-prod-github-runner-207 kernel: [61921.373629] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 22:35:47 juju-e4d256-prod-github-runner-207 kernel: [61921.374543] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:35:47 juju-e4d256-prod-github-runner-207 kernel: [61921.375388] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:35:47 juju-e4d256-prod-github-runner-207 kernel: [61921.376228] ? do_syscall_64+0x69/0xc0 Aug 22 22:35:47 juju-e4d256-prod-github-runner-207 kernel: [61921.377006] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:35:47 juju-e4d256-prod-github-runner-207 kernel: [61921.377906] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:35:47 juju-e4d256-prod-github-runner-207 kernel: [61921.378775] ? do_syscall_64+0x69/0xc0 Aug 22 22:35:47 juju-e4d256-prod-github-runner-207 kernel: [61921.379545] ? do_syscall_64+0x69/0xc0 Aug 22 22:35:47 juju-e4d256-prod-github-runner-207 kernel: [61921.380310] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 22:35:47 juju-e4d256-prod-github-runner-207 kernel: [61921.381178] RIP: 0033:0x7faa5d0edaff Aug 22 22:35:47 juju-e4d256-prod-github-runner-207 kernel: [61921.382004] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 22:35:47 juju-e4d256-prod-github-runner-207 kernel: [61921.384371] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 22:35:47 juju-e4d256-prod-github-runner-207 kernel: [61921.385354] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 22:35:47 juju-e4d256-prod-github-runner-207 kernel: [61921.386308] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 22:35:47 juju-e4d256-prod-github-runner-207 kernel: [61921.387255] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 22:35:47 juju-e4d256-prod-github-runner-207 kernel: [61921.388198] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 22:35:47 juju-e4d256-prod-github-runner-207 kernel: [61921.389125] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 22:35:47 juju-e4d256-prod-github-runner-207 kernel: [61921.390050] Aug 22 22:36:14 juju-e4d256-prod-github-runner-207 kernel: [61948.541980] watchdog: BUG: soft lockup - CPU#1 stuck for 57586s! [qemu-system-x86:6715] Aug 22 22:36:14 juju-e4d256-prod-github-runner-207 kernel: [61948.543950] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 22:36:14 juju-e4d256-prod-github-runner-207 kernel: [61948.544263] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 22:36:14 juju-e4d256-prod-github-runner-207 kernel: [61948.556935] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 22:36:14 juju-e4d256-prod-github-runner-207 kernel: [61948.558926] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 22:36:14 juju-e4d256-prod-github-runner-207 kernel: [61948.560356] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:36:14 juju-e4d256-prod-github-runner-207 kernel: [61948.561459] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 22:36:14 juju-e4d256-prod-github-runner-207 kernel: [61948.564052] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 22:36:14 juju-e4d256-prod-github-runner-207 kernel: [61948.565154] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 22:36:14 juju-e4d256-prod-github-runner-207 kernel: [61948.566337] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 22:36:14 juju-e4d256-prod-github-runner-207 kernel: [61948.567498] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 22:36:14 juju-e4d256-prod-github-runner-207 kernel: [61948.568657] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 22:36:14 juju-e4d256-prod-github-runner-207 kernel: [61948.569847] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 22:36:14 juju-e4d256-prod-github-runner-207 kernel: [61948.571075] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 22:36:14 juju-e4d256-prod-github-runner-207 kernel: [61948.572327] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 22:36:14 juju-e4d256-prod-github-runner-207 kernel: [61948.573455] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 22:36:14 juju-e4d256-prod-github-runner-207 kernel: [61948.574662] Call Trace: Aug 22 22:36:14 juju-e4d256-prod-github-runner-207 kernel: [61948.575573] Aug 22 22:36:14 juju-e4d256-prod-github-runner-207 kernel: [61948.576477] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:36:14 juju-e4d256-prod-github-runner-207 kernel: [61948.577518] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:36:14 juju-e4d256-prod-github-runner-207 kernel: [61948.578538] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:36:14 juju-e4d256-prod-github-runner-207 kernel: [61948.579642] ? show_regs.part.0+0x23/0x29 Aug 22 22:36:14 juju-e4d256-prod-github-runner-207 kernel: [61948.580661] ? show_regs.cold+0x8/0xd Aug 22 22:36:14 juju-e4d256-prod-github-runner-207 kernel: [61948.581665] ? watchdog_timer_fn+0x1be/0x220 Aug 22 22:36:14 juju-e4d256-prod-github-runner-207 kernel: [61948.582687] ? lockup_detector_update_enable+0x60/0x60 Aug 22 22:36:14 juju-e4d256-prod-github-runner-207 kernel: [61948.583749] ? __hrtimer_run_queues+0x107/0x230 Aug 22 22:36:14 juju-e4d256-prod-github-runner-207 kernel: [61948.584777] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 22:36:14 juju-e4d256-prod-github-runner-207 kernel: [61948.585819] ? hrtimer_interrupt+0x101/0x220 Aug 22 22:36:14 juju-e4d256-prod-github-runner-207 kernel: [61948.586868] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 22:36:14 juju-e4d256-prod-github-runner-207 kernel: [61948.587934] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 22:36:14 juju-e4d256-prod-github-runner-207 kernel: [61948.588976] Aug 22 22:36:14 juju-e4d256-prod-github-runner-207 kernel: [61948.589846] Aug 22 22:36:14 juju-e4d256-prod-github-runner-207 kernel: [61948.590681] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 22:36:14 juju-e4d256-prod-github-runner-207 kernel: [61948.591720] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:36:14 juju-e4d256-prod-github-runner-207 kernel: [61948.592756] ? _raw_spin_lock+0x22/0x30 Aug 22 22:36:14 juju-e4d256-prod-github-runner-207 kernel: [61948.593706] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:36:14 juju-e4d256-prod-github-runner-207 kernel: [61948.594756] direct_page_fault+0x206/0x310 [kvm] Aug 22 22:36:14 juju-e4d256-prod-github-runner-207 kernel: [61948.595794] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 22:36:14 juju-e4d256-prod-github-runner-207 kernel: [61948.596826] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 22:36:14 juju-e4d256-prod-github-runner-207 kernel: [61948.597856] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 22:36:14 juju-e4d256-prod-github-runner-207 kernel: [61948.598863] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 22:36:14 juju-e4d256-prod-github-runner-207 kernel: [61948.599806] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 22:36:14 juju-e4d256-prod-github-runner-207 kernel: [61948.600788] handle_exit+0x98/0x230 [kvm_amd] Aug 22 22:36:14 juju-e4d256-prod-github-runner-207 kernel: [61948.601700] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 22:36:14 juju-e4d256-prod-github-runner-207 kernel: [61948.602618] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 22:36:14 juju-e4d256-prod-github-runner-207 kernel: [61948.603540] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 22:36:14 juju-e4d256-prod-github-runner-207 kernel: [61948.604473] vcpu_run+0x62/0x2c0 [kvm] Aug 22 22:36:14 juju-e4d256-prod-github-runner-207 kernel: [61948.605322] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 22:36:14 juju-e4d256-prod-github-runner-207 kernel: [61948.606132] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 22:36:14 juju-e4d256-prod-github-runner-207 kernel: [61948.606994] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 22:36:14 juju-e4d256-prod-github-runner-207 kernel: [61948.607817] ? __seccomp_filter+0x4a/0x4a0 Aug 22 22:36:14 juju-e4d256-prod-github-runner-207 kernel: [61948.608589] ? __fget_files+0x86/0xc0 Aug 22 22:36:14 juju-e4d256-prod-github-runner-207 kernel: [61948.609328] __x64_sys_ioctl+0x95/0xd0 Aug 22 22:36:14 juju-e4d256-prod-github-runner-207 kernel: [61948.610023] do_syscall_64+0x5c/0xc0 Aug 22 22:36:14 juju-e4d256-prod-github-runner-207 kernel: [61948.610699] ? do_futex+0x162/0x1f0 Aug 22 22:36:14 juju-e4d256-prod-github-runner-207 kernel: [61948.611352] ? __x64_sys_futex+0x78/0x1e0 Aug 22 22:36:14 juju-e4d256-prod-github-runner-207 kernel: [61948.612027] ? __secure_computing+0xa9/0x120 Aug 22 22:36:14 juju-e4d256-prod-github-runner-207 kernel: [61948.612718] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 22:36:14 juju-e4d256-prod-github-runner-207 kernel: [61948.613496] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:36:14 juju-e4d256-prod-github-runner-207 kernel: [61948.614219] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:36:14 juju-e4d256-prod-github-runner-207 kernel: [61948.614939] ? do_syscall_64+0x69/0xc0 Aug 22 22:36:14 juju-e4d256-prod-github-runner-207 kernel: [61948.615584] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:36:14 juju-e4d256-prod-github-runner-207 kernel: [61948.616295] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:36:14 juju-e4d256-prod-github-runner-207 kernel: [61948.617003] ? do_syscall_64+0x69/0xc0 Aug 22 22:36:14 juju-e4d256-prod-github-runner-207 kernel: [61948.617631] ? do_syscall_64+0x69/0xc0 Aug 22 22:36:14 juju-e4d256-prod-github-runner-207 kernel: [61948.618253] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 22:36:14 juju-e4d256-prod-github-runner-207 kernel: [61948.618959] RIP: 0033:0x7faa5d0edaff Aug 22 22:36:14 juju-e4d256-prod-github-runner-207 kernel: [61948.619620] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 22:36:14 juju-e4d256-prod-github-runner-207 kernel: [61948.621622] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 22:36:14 juju-e4d256-prod-github-runner-207 kernel: [61948.622535] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 22:36:14 juju-e4d256-prod-github-runner-207 kernel: [61948.623426] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 22:36:14 juju-e4d256-prod-github-runner-207 kernel: [61948.624315] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 22:36:14 juju-e4d256-prod-github-runner-207 kernel: [61948.625268] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 22:36:14 juju-e4d256-prod-github-runner-207 kernel: [61948.626170] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 22:36:14 juju-e4d256-prod-github-runner-207 kernel: [61948.627065] Aug 22 22:36:42 juju-e4d256-prod-github-runner-207 kernel: [61976.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 57612s! [qemu-system-x86:6715] Aug 22 22:36:42 juju-e4d256-prod-github-runner-207 kernel: [61976.543123] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 22:36:42 juju-e4d256-prod-github-runner-207 kernel: [61976.543195] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 22:36:42 juju-e4d256-prod-github-runner-207 kernel: [61976.555593] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 22:36:42 juju-e4d256-prod-github-runner-207 kernel: [61976.556900] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 22:36:42 juju-e4d256-prod-github-runner-207 kernel: [61976.558153] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:36:42 juju-e4d256-prod-github-runner-207 kernel: [61976.559256] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 22:36:42 juju-e4d256-prod-github-runner-207 kernel: [61976.561934] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 22:36:42 juju-e4d256-prod-github-runner-207 kernel: [61976.562995] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 22:36:42 juju-e4d256-prod-github-runner-207 kernel: [61976.564165] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 22:36:42 juju-e4d256-prod-github-runner-207 kernel: [61976.565356] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 22:36:42 juju-e4d256-prod-github-runner-207 kernel: [61976.566527] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 22:36:42 juju-e4d256-prod-github-runner-207 kernel: [61976.567698] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 22:36:42 juju-e4d256-prod-github-runner-207 kernel: [61976.569121] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 22:36:42 juju-e4d256-prod-github-runner-207 kernel: [61976.570390] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 22:36:42 juju-e4d256-prod-github-runner-207 kernel: [61976.571549] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 22:36:42 juju-e4d256-prod-github-runner-207 kernel: [61976.572784] Call Trace: Aug 22 22:36:42 juju-e4d256-prod-github-runner-207 kernel: [61976.573725] Aug 22 22:36:42 juju-e4d256-prod-github-runner-207 kernel: [61976.574650] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:36:42 juju-e4d256-prod-github-runner-207 kernel: [61976.575750] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:36:42 juju-e4d256-prod-github-runner-207 kernel: [61976.576858] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:36:42 juju-e4d256-prod-github-runner-207 kernel: [61976.577963] ? show_regs.part.0+0x23/0x29 Aug 22 22:36:42 juju-e4d256-prod-github-runner-207 kernel: [61976.578980] ? show_regs.cold+0x8/0xd Aug 22 22:36:42 juju-e4d256-prod-github-runner-207 kernel: [61976.580027] ? watchdog_timer_fn+0x1be/0x220 Aug 22 22:36:42 juju-e4d256-prod-github-runner-207 kernel: [61976.581109] ? lockup_detector_update_enable+0x60/0x60 Aug 22 22:36:42 juju-e4d256-prod-github-runner-207 kernel: [61976.582196] ? __hrtimer_run_queues+0x107/0x230 Aug 22 22:36:42 juju-e4d256-prod-github-runner-207 kernel: [61976.583230] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 22:36:42 juju-e4d256-prod-github-runner-207 kernel: [61976.584294] ? hrtimer_interrupt+0x101/0x220 Aug 22 22:36:42 juju-e4d256-prod-github-runner-207 kernel: [61976.585378] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 22:36:42 juju-e4d256-prod-github-runner-207 kernel: [61976.586512] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 22:36:42 juju-e4d256-prod-github-runner-207 kernel: [61976.587562] Aug 22 22:36:42 juju-e4d256-prod-github-runner-207 kernel: [61976.588423] Aug 22 22:36:42 juju-e4d256-prod-github-runner-207 kernel: [61976.589301] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 22:36:42 juju-e4d256-prod-github-runner-207 kernel: [61976.590403] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:36:42 juju-e4d256-prod-github-runner-207 kernel: [61976.591530] ? _raw_spin_lock+0x22/0x30 Aug 22 22:36:42 juju-e4d256-prod-github-runner-207 kernel: [61976.592493] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:36:42 juju-e4d256-prod-github-runner-207 kernel: [61976.593563] direct_page_fault+0x206/0x310 [kvm] Aug 22 22:36:42 juju-e4d256-prod-github-runner-207 kernel: [61976.594738] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 22:36:42 juju-e4d256-prod-github-runner-207 kernel: [61976.595879] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 22:36:42 juju-e4d256-prod-github-runner-207 kernel: [61976.597004] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 22:36:42 juju-e4d256-prod-github-runner-207 kernel: [61976.598082] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 22:36:42 juju-e4d256-prod-github-runner-207 kernel: [61976.599126] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 22:36:42 juju-e4d256-prod-github-runner-207 kernel: [61976.600217] handle_exit+0x98/0x230 [kvm_amd] Aug 22 22:36:42 juju-e4d256-prod-github-runner-207 kernel: [61976.601227] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 22:36:42 juju-e4d256-prod-github-runner-207 kernel: [61976.602249] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 22:36:42 juju-e4d256-prod-github-runner-207 kernel: [61976.603274] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 22:36:42 juju-e4d256-prod-github-runner-207 kernel: [61976.604281] vcpu_run+0x62/0x2c0 [kvm] Aug 22 22:36:42 juju-e4d256-prod-github-runner-207 kernel: [61976.605224] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 22:36:42 juju-e4d256-prod-github-runner-207 kernel: [61976.606188] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 22:36:42 juju-e4d256-prod-github-runner-207 kernel: [61976.607172] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 22:36:42 juju-e4d256-prod-github-runner-207 kernel: [61976.608064] ? __seccomp_filter+0x4a/0x4a0 Aug 22 22:36:42 juju-e4d256-prod-github-runner-207 kernel: [61976.608968] ? __fget_files+0x86/0xc0 Aug 22 22:36:42 juju-e4d256-prod-github-runner-207 kernel: [61976.609752] __x64_sys_ioctl+0x95/0xd0 Aug 22 22:36:42 juju-e4d256-prod-github-runner-207 kernel: [61976.610529] do_syscall_64+0x5c/0xc0 Aug 22 22:36:42 juju-e4d256-prod-github-runner-207 kernel: [61976.611310] ? do_futex+0x162/0x1f0 Aug 22 22:36:42 juju-e4d256-prod-github-runner-207 kernel: [61976.612034] ? __x64_sys_futex+0x78/0x1e0 Aug 22 22:36:42 juju-e4d256-prod-github-runner-207 kernel: [61976.612823] ? __secure_computing+0xa9/0x120 Aug 22 22:36:42 juju-e4d256-prod-github-runner-207 kernel: [61976.613627] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 22:36:42 juju-e4d256-prod-github-runner-207 kernel: [61976.614512] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:36:42 juju-e4d256-prod-github-runner-207 kernel: [61976.615330] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:36:42 juju-e4d256-prod-github-runner-207 kernel: [61976.616176] ? do_syscall_64+0x69/0xc0 Aug 22 22:36:42 juju-e4d256-prod-github-runner-207 kernel: [61976.616932] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:36:42 juju-e4d256-prod-github-runner-207 kernel: [61976.617740] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:36:42 juju-e4d256-prod-github-runner-207 kernel: [61976.618538] ? do_syscall_64+0x69/0xc0 Aug 22 22:36:42 juju-e4d256-prod-github-runner-207 kernel: [61976.619238] ? do_syscall_64+0x69/0xc0 Aug 22 22:36:42 juju-e4d256-prod-github-runner-207 kernel: [61976.619934] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 22:36:42 juju-e4d256-prod-github-runner-207 kernel: [61976.620839] RIP: 0033:0x7faa5d0edaff Aug 22 22:36:42 juju-e4d256-prod-github-runner-207 kernel: [61976.621611] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 22:36:42 juju-e4d256-prod-github-runner-207 kernel: [61976.623969] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 22:36:42 juju-e4d256-prod-github-runner-207 kernel: [61976.625167] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 22:36:42 juju-e4d256-prod-github-runner-207 kernel: [61976.626217] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 22:36:42 juju-e4d256-prod-github-runner-207 kernel: [61976.627277] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 22:36:42 juju-e4d256-prod-github-runner-207 kernel: [61976.628331] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 22:36:42 juju-e4d256-prod-github-runner-207 kernel: [61976.629417] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 22:36:42 juju-e4d256-prod-github-runner-207 kernel: [61976.630467] Aug 22 22:37:10 juju-e4d256-prod-github-runner-207 kernel: [62004.541983] watchdog: BUG: soft lockup - CPU#1 stuck for 57638s! [qemu-system-x86:6715] Aug 22 22:37:10 juju-e4d256-prod-github-runner-207 kernel: [62004.543435] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 22:37:10 juju-e4d256-prod-github-runner-207 kernel: [62004.543509] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 22:37:10 juju-e4d256-prod-github-runner-207 kernel: [62004.556403] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 22:37:10 juju-e4d256-prod-github-runner-207 kernel: [62004.557954] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 22:37:10 juju-e4d256-prod-github-runner-207 kernel: [62004.559405] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:37:10 juju-e4d256-prod-github-runner-207 kernel: [62004.560876] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 22:37:10 juju-e4d256-prod-github-runner-207 kernel: [62004.563905] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 22:37:10 juju-e4d256-prod-github-runner-207 kernel: [62004.565107] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 22:37:10 juju-e4d256-prod-github-runner-207 kernel: [62004.566422] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 22:37:10 juju-e4d256-prod-github-runner-207 kernel: [62004.567739] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 22:37:10 juju-e4d256-prod-github-runner-207 kernel: [62004.569074] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 22:37:10 juju-e4d256-prod-github-runner-207 kernel: [62004.570373] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 22:37:10 juju-e4d256-prod-github-runner-207 kernel: [62004.571722] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 22:37:10 juju-e4d256-prod-github-runner-207 kernel: [62004.573213] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 22:37:10 juju-e4d256-prod-github-runner-207 kernel: [62004.574461] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 22:37:10 juju-e4d256-prod-github-runner-207 kernel: [62004.575795] Call Trace: Aug 22 22:37:10 juju-e4d256-prod-github-runner-207 kernel: [62004.576801] Aug 22 22:37:10 juju-e4d256-prod-github-runner-207 kernel: [62004.577748] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:37:10 juju-e4d256-prod-github-runner-207 kernel: [62004.578885] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:37:10 juju-e4d256-prod-github-runner-207 kernel: [62004.580025] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:37:10 juju-e4d256-prod-github-runner-207 kernel: [62004.581248] ? show_regs.part.0+0x23/0x29 Aug 22 22:37:10 juju-e4d256-prod-github-runner-207 kernel: [62004.582441] ? show_regs.cold+0x8/0xd Aug 22 22:37:10 juju-e4d256-prod-github-runner-207 kernel: [62004.583709] ? watchdog_timer_fn+0x1be/0x220 Aug 22 22:37:10 juju-e4d256-prod-github-runner-207 kernel: [62004.584832] ? lockup_detector_update_enable+0x60/0x60 Aug 22 22:37:10 juju-e4d256-prod-github-runner-207 kernel: [62004.586005] ? __hrtimer_run_queues+0x107/0x230 Aug 22 22:37:10 juju-e4d256-prod-github-runner-207 kernel: [62004.587149] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 22:37:10 juju-e4d256-prod-github-runner-207 kernel: [62004.588295] ? hrtimer_interrupt+0x101/0x220 Aug 22 22:37:10 juju-e4d256-prod-github-runner-207 kernel: [62004.589424] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 22:37:10 juju-e4d256-prod-github-runner-207 kernel: [62004.590998] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 22:37:10 juju-e4d256-prod-github-runner-207 kernel: [62004.592153] Aug 22 22:37:10 juju-e4d256-prod-github-runner-207 kernel: [62004.593372] Aug 22 22:37:10 juju-e4d256-prod-github-runner-207 kernel: [62004.594286] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 22:37:10 juju-e4d256-prod-github-runner-207 kernel: [62004.595617] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:37:10 juju-e4d256-prod-github-runner-207 kernel: [62004.596861] ? _raw_spin_lock+0x22/0x30 Aug 22 22:37:10 juju-e4d256-prod-github-runner-207 kernel: [62004.597951] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:37:10 juju-e4d256-prod-github-runner-207 kernel: [62004.599173] direct_page_fault+0x206/0x310 [kvm] Aug 22 22:37:10 juju-e4d256-prod-github-runner-207 kernel: [62004.600362] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 22:37:10 juju-e4d256-prod-github-runner-207 kernel: [62004.601533] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 22:37:10 juju-e4d256-prod-github-runner-207 kernel: [62004.602692] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 22:37:10 juju-e4d256-prod-github-runner-207 kernel: [62004.603871] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 22:37:10 juju-e4d256-prod-github-runner-207 kernel: [62004.604995] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 22:37:10 juju-e4d256-prod-github-runner-207 kernel: [62004.606196] handle_exit+0x98/0x230 [kvm_amd] Aug 22 22:37:10 juju-e4d256-prod-github-runner-207 kernel: [62004.607234] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 22:37:10 juju-e4d256-prod-github-runner-207 kernel: [62004.608325] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 22:37:10 juju-e4d256-prod-github-runner-207 kernel: [62004.609469] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 22:37:10 juju-e4d256-prod-github-runner-207 kernel: [62004.610534] vcpu_run+0x62/0x2c0 [kvm] Aug 22 22:37:10 juju-e4d256-prod-github-runner-207 kernel: [62004.611470] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 22:37:10 juju-e4d256-prod-github-runner-207 kernel: [62004.612443] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 22:37:10 juju-e4d256-prod-github-runner-207 kernel: [62004.613457] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 22:37:10 juju-e4d256-prod-github-runner-207 kernel: [62004.614414] ? __seccomp_filter+0x4a/0x4a0 Aug 22 22:37:10 juju-e4d256-prod-github-runner-207 kernel: [62004.615330] ? __fget_files+0x86/0xc0 Aug 22 22:37:10 juju-e4d256-prod-github-runner-207 kernel: [62004.616169] __x64_sys_ioctl+0x95/0xd0 Aug 22 22:37:10 juju-e4d256-prod-github-runner-207 kernel: [62004.616998] do_syscall_64+0x5c/0xc0 Aug 22 22:37:10 juju-e4d256-prod-github-runner-207 kernel: [62004.617765] ? do_futex+0x162/0x1f0 Aug 22 22:37:10 juju-e4d256-prod-github-runner-207 kernel: [62004.618519] ? __x64_sys_futex+0x78/0x1e0 Aug 22 22:37:10 juju-e4d256-prod-github-runner-207 kernel: [62004.619305] ? __secure_computing+0xa9/0x120 Aug 22 22:37:10 juju-e4d256-prod-github-runner-207 kernel: [62004.620117] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 22:37:10 juju-e4d256-prod-github-runner-207 kernel: [62004.621038] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:37:10 juju-e4d256-prod-github-runner-207 kernel: [62004.621900] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:37:10 juju-e4d256-prod-github-runner-207 kernel: [62004.622770] ? do_syscall_64+0x69/0xc0 Aug 22 22:37:10 juju-e4d256-prod-github-runner-207 kernel: [62004.623527] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:37:10 juju-e4d256-prod-github-runner-207 kernel: [62004.624373] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:37:10 juju-e4d256-prod-github-runner-207 kernel: [62004.625191] ? do_syscall_64+0x69/0xc0 Aug 22 22:37:10 juju-e4d256-prod-github-runner-207 kernel: [62004.625912] ? do_syscall_64+0x69/0xc0 Aug 22 22:37:10 juju-e4d256-prod-github-runner-207 kernel: [62004.626630] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 22:37:10 juju-e4d256-prod-github-runner-207 kernel: [62004.627462] RIP: 0033:0x7faa5d0edaff Aug 22 22:37:10 juju-e4d256-prod-github-runner-207 kernel: [62004.628179] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 22:37:10 juju-e4d256-prod-github-runner-207 kernel: [62004.630611] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 22:37:10 juju-e4d256-prod-github-runner-207 kernel: [62004.631740] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 22:37:10 juju-e4d256-prod-github-runner-207 kernel: [62004.632879] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 22:37:10 juju-e4d256-prod-github-runner-207 kernel: [62004.633968] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 22:37:10 juju-e4d256-prod-github-runner-207 kernel: [62004.635085] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 22:37:10 juju-e4d256-prod-github-runner-207 kernel: [62004.636148] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 22:37:10 juju-e4d256-prod-github-runner-207 kernel: [62004.637273] Aug 22 22:37:38 juju-e4d256-prod-github-runner-207 kernel: [62032.541980] watchdog: BUG: soft lockup - CPU#1 stuck for 57664s! [qemu-system-x86:6715] Aug 22 22:37:38 juju-e4d256-prod-github-runner-207 kernel: [62032.545133] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 22:37:38 juju-e4d256-prod-github-runner-207 kernel: [62032.546186] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 22:37:38 juju-e4d256-prod-github-runner-207 kernel: [62032.559019] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 22:37:38 juju-e4d256-prod-github-runner-207 kernel: [62032.560327] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 22:37:38 juju-e4d256-prod-github-runner-207 kernel: [62032.561595] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:37:38 juju-e4d256-prod-github-runner-207 kernel: [62032.562659] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 22:37:38 juju-e4d256-prod-github-runner-207 kernel: [62032.565284] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 22:37:38 juju-e4d256-prod-github-runner-207 kernel: [62032.566333] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 22:37:38 juju-e4d256-prod-github-runner-207 kernel: [62032.567509] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 22:37:38 juju-e4d256-prod-github-runner-207 kernel: [62032.568744] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 22:37:38 juju-e4d256-prod-github-runner-207 kernel: [62032.569916] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 22:37:38 juju-e4d256-prod-github-runner-207 kernel: [62032.571085] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 22:37:38 juju-e4d256-prod-github-runner-207 kernel: [62032.572324] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 22:37:38 juju-e4d256-prod-github-runner-207 kernel: [62032.573566] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 22:37:38 juju-e4d256-prod-github-runner-207 kernel: [62032.574694] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 22:37:38 juju-e4d256-prod-github-runner-207 kernel: [62032.576166] Call Trace: Aug 22 22:37:38 juju-e4d256-prod-github-runner-207 kernel: [62032.577590] Aug 22 22:37:38 juju-e4d256-prod-github-runner-207 kernel: [62032.578676] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:37:38 juju-e4d256-prod-github-runner-207 kernel: [62032.579837] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:37:38 juju-e4d256-prod-github-runner-207 kernel: [62032.581008] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:37:38 juju-e4d256-prod-github-runner-207 kernel: [62032.582204] ? show_regs.part.0+0x23/0x29 Aug 22 22:37:38 juju-e4d256-prod-github-runner-207 kernel: [62032.583277] ? show_regs.cold+0x8/0xd Aug 22 22:37:38 juju-e4d256-prod-github-runner-207 kernel: [62032.584352] ? watchdog_timer_fn+0x1be/0x220 Aug 22 22:37:38 juju-e4d256-prod-github-runner-207 kernel: [62032.585437] ? lockup_detector_update_enable+0x60/0x60 Aug 22 22:37:38 juju-e4d256-prod-github-runner-207 kernel: [62032.586561] ? __hrtimer_run_queues+0x107/0x230 Aug 22 22:37:38 juju-e4d256-prod-github-runner-207 kernel: [62032.587664] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 22:37:38 juju-e4d256-prod-github-runner-207 kernel: [62032.588761] ? hrtimer_interrupt+0x101/0x220 Aug 22 22:37:38 juju-e4d256-prod-github-runner-207 kernel: [62032.589877] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 22:37:38 juju-e4d256-prod-github-runner-207 kernel: [62032.591031] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 22:37:38 juju-e4d256-prod-github-runner-207 kernel: [62032.592132] Aug 22 22:37:38 juju-e4d256-prod-github-runner-207 kernel: [62032.593002] Aug 22 22:37:38 juju-e4d256-prod-github-runner-207 kernel: [62032.593861] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 22:37:38 juju-e4d256-prod-github-runner-207 kernel: [62032.594953] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:37:38 juju-e4d256-prod-github-runner-207 kernel: [62032.596201] ? _raw_spin_lock+0x22/0x30 Aug 22 22:37:38 juju-e4d256-prod-github-runner-207 kernel: [62032.597235] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:37:38 juju-e4d256-prod-github-runner-207 kernel: [62032.598316] direct_page_fault+0x206/0x310 [kvm] Aug 22 22:37:38 juju-e4d256-prod-github-runner-207 kernel: [62032.599371] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 22:37:38 juju-e4d256-prod-github-runner-207 kernel: [62032.600474] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 22:37:38 juju-e4d256-prod-github-runner-207 kernel: [62032.601510] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 22:37:38 juju-e4d256-prod-github-runner-207 kernel: [62032.602564] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 22:37:38 juju-e4d256-prod-github-runner-207 kernel: [62032.603547] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 22:37:38 juju-e4d256-prod-github-runner-207 kernel: [62032.604575] handle_exit+0x98/0x230 [kvm_amd] Aug 22 22:37:38 juju-e4d256-prod-github-runner-207 kernel: [62032.605514] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 22:37:38 juju-e4d256-prod-github-runner-207 kernel: [62032.606465] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 22:37:38 juju-e4d256-prod-github-runner-207 kernel: [62032.607419] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 22:37:38 juju-e4d256-prod-github-runner-207 kernel: [62032.608427] vcpu_run+0x62/0x2c0 [kvm] Aug 22 22:37:38 juju-e4d256-prod-github-runner-207 kernel: [62032.609292] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 22:37:38 juju-e4d256-prod-github-runner-207 kernel: [62032.610122] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 22:37:38 juju-e4d256-prod-github-runner-207 kernel: [62032.611051] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 22:37:38 juju-e4d256-prod-github-runner-207 kernel: [62032.611900] ? __seccomp_filter+0x4a/0x4a0 Aug 22 22:37:38 juju-e4d256-prod-github-runner-207 kernel: [62032.612750] ? __fget_files+0x86/0xc0 Aug 22 22:37:38 juju-e4d256-prod-github-runner-207 kernel: [62032.613504] __x64_sys_ioctl+0x95/0xd0 Aug 22 22:37:38 juju-e4d256-prod-github-runner-207 kernel: [62032.614219] do_syscall_64+0x5c/0xc0 Aug 22 22:37:38 juju-e4d256-prod-github-runner-207 kernel: [62032.614902] ? do_futex+0x162/0x1f0 Aug 22 22:37:38 juju-e4d256-prod-github-runner-207 kernel: [62032.615575] ? __x64_sys_futex+0x78/0x1e0 Aug 22 22:37:38 juju-e4d256-prod-github-runner-207 kernel: [62032.616281] ? __secure_computing+0xa9/0x120 Aug 22 22:37:38 juju-e4d256-prod-github-runner-207 kernel: [62032.616994] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 22:37:38 juju-e4d256-prod-github-runner-207 kernel: [62032.617780] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:37:38 juju-e4d256-prod-github-runner-207 kernel: [62032.618530] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:37:38 juju-e4d256-prod-github-runner-207 kernel: [62032.619307] ? do_syscall_64+0x69/0xc0 Aug 22 22:37:38 juju-e4d256-prod-github-runner-207 kernel: [62032.619988] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:37:38 juju-e4d256-prod-github-runner-207 kernel: [62032.620720] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:37:38 juju-e4d256-prod-github-runner-207 kernel: [62032.621434] ? do_syscall_64+0x69/0xc0 Aug 22 22:37:38 juju-e4d256-prod-github-runner-207 kernel: [62032.622076] ? do_syscall_64+0x69/0xc0 Aug 22 22:37:38 juju-e4d256-prod-github-runner-207 kernel: [62032.622712] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 22:37:38 juju-e4d256-prod-github-runner-207 kernel: [62032.623440] RIP: 0033:0x7faa5d0edaff Aug 22 22:37:38 juju-e4d256-prod-github-runner-207 kernel: [62032.624305] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 22:37:38 juju-e4d256-prod-github-runner-207 kernel: [62032.626924] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 22:37:38 juju-e4d256-prod-github-runner-207 kernel: [62032.627887] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 22:37:38 juju-e4d256-prod-github-runner-207 kernel: [62032.628847] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 22:37:38 juju-e4d256-prod-github-runner-207 kernel: [62032.629785] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 22:37:38 juju-e4d256-prod-github-runner-207 kernel: [62032.630712] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 22:37:38 juju-e4d256-prod-github-runner-207 kernel: [62032.631719] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 22:37:38 juju-e4d256-prod-github-runner-207 kernel: [62032.632681] Aug 22 22:38:06 juju-e4d256-prod-github-runner-207 kernel: [62060.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 57690s! [qemu-system-x86:6715] Aug 22 22:38:06 juju-e4d256-prod-github-runner-207 kernel: [62060.544296] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 22:38:06 juju-e4d256-prod-github-runner-207 kernel: [62060.545025] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 22:38:06 juju-e4d256-prod-github-runner-207 kernel: [62060.557165] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 22:38:06 juju-e4d256-prod-github-runner-207 kernel: [62060.558454] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 22:38:06 juju-e4d256-prod-github-runner-207 kernel: [62060.559686] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:38:06 juju-e4d256-prod-github-runner-207 kernel: [62060.560727] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 22:38:06 juju-e4d256-prod-github-runner-207 kernel: [62060.563244] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 22:38:06 juju-e4d256-prod-github-runner-207 kernel: [62060.564297] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 22:38:06 juju-e4d256-prod-github-runner-207 kernel: [62060.565433] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 22:38:06 juju-e4d256-prod-github-runner-207 kernel: [62060.566572] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 22:38:06 juju-e4d256-prod-github-runner-207 kernel: [62060.567720] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 22:38:06 juju-e4d256-prod-github-runner-207 kernel: [62060.568869] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 22:38:06 juju-e4d256-prod-github-runner-207 kernel: [62060.570014] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 22:38:06 juju-e4d256-prod-github-runner-207 kernel: [62060.571218] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 22:38:06 juju-e4d256-prod-github-runner-207 kernel: [62060.572317] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 22:38:06 juju-e4d256-prod-github-runner-207 kernel: [62060.573501] Call Trace: Aug 22 22:38:06 juju-e4d256-prod-github-runner-207 kernel: [62060.574434] Aug 22 22:38:06 juju-e4d256-prod-github-runner-207 kernel: [62060.575375] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:38:06 juju-e4d256-prod-github-runner-207 kernel: [62060.576476] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:38:06 juju-e4d256-prod-github-runner-207 kernel: [62060.577492] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:38:06 juju-e4d256-prod-github-runner-207 kernel: [62060.578570] ? show_regs.part.0+0x23/0x29 Aug 22 22:38:06 juju-e4d256-prod-github-runner-207 kernel: [62060.579570] ? show_regs.cold+0x8/0xd Aug 22 22:38:06 juju-e4d256-prod-github-runner-207 kernel: [62060.580529] ? watchdog_timer_fn+0x1be/0x220 Aug 22 22:38:06 juju-e4d256-prod-github-runner-207 kernel: [62060.581523] ? lockup_detector_update_enable+0x60/0x60 Aug 22 22:38:06 juju-e4d256-prod-github-runner-207 kernel: [62060.582565] ? __hrtimer_run_queues+0x107/0x230 Aug 22 22:38:06 juju-e4d256-prod-github-runner-207 kernel: [62060.583604] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 22:38:06 juju-e4d256-prod-github-runner-207 kernel: [62060.584626] ? hrtimer_interrupt+0x101/0x220 Aug 22 22:38:06 juju-e4d256-prod-github-runner-207 kernel: [62060.585626] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 22:38:06 juju-e4d256-prod-github-runner-207 kernel: [62060.586674] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 22:38:06 juju-e4d256-prod-github-runner-207 kernel: [62060.587771] Aug 22 22:38:06 juju-e4d256-prod-github-runner-207 kernel: [62060.588661] Aug 22 22:38:06 juju-e4d256-prod-github-runner-207 kernel: [62060.589517] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 22:38:06 juju-e4d256-prod-github-runner-207 kernel: [62060.590562] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:38:06 juju-e4d256-prod-github-runner-207 kernel: [62060.591603] ? _raw_spin_lock+0x22/0x30 Aug 22 22:38:06 juju-e4d256-prod-github-runner-207 kernel: [62060.592537] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:38:06 juju-e4d256-prod-github-runner-207 kernel: [62060.593566] direct_page_fault+0x206/0x310 [kvm] Aug 22 22:38:06 juju-e4d256-prod-github-runner-207 kernel: [62060.594607] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 22:38:06 juju-e4d256-prod-github-runner-207 kernel: [62060.595622] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 22:38:06 juju-e4d256-prod-github-runner-207 kernel: [62060.596609] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 22:38:06 juju-e4d256-prod-github-runner-207 kernel: [62060.597597] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 22:38:06 juju-e4d256-prod-github-runner-207 kernel: [62060.598526] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 22:38:06 juju-e4d256-prod-github-runner-207 kernel: [62060.599480] handle_exit+0x98/0x230 [kvm_amd] Aug 22 22:38:06 juju-e4d256-prod-github-runner-207 kernel: [62060.602757] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 22:38:06 juju-e4d256-prod-github-runner-207 kernel: [62060.603680] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 22:38:06 juju-e4d256-prod-github-runner-207 kernel: [62060.604587] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 22:38:06 juju-e4d256-prod-github-runner-207 kernel: [62060.605475] vcpu_run+0x62/0x2c0 [kvm] Aug 22 22:38:06 juju-e4d256-prod-github-runner-207 kernel: [62060.606274] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 22:38:06 juju-e4d256-prod-github-runner-207 kernel: [62060.607089] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 22:38:06 juju-e4d256-prod-github-runner-207 kernel: [62060.607963] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 22:38:06 juju-e4d256-prod-github-runner-207 kernel: [62060.608778] ? __seccomp_filter+0x4a/0x4a0 Aug 22 22:38:06 juju-e4d256-prod-github-runner-207 kernel: [62060.609528] ? __fget_files+0x86/0xc0 Aug 22 22:38:06 juju-e4d256-prod-github-runner-207 kernel: [62060.610225] __x64_sys_ioctl+0x95/0xd0 Aug 22 22:38:06 juju-e4d256-prod-github-runner-207 kernel: [62060.610926] do_syscall_64+0x5c/0xc0 Aug 22 22:38:06 juju-e4d256-prod-github-runner-207 kernel: [62060.611610] ? do_futex+0x162/0x1f0 Aug 22 22:38:06 juju-e4d256-prod-github-runner-207 kernel: [62060.612246] ? __x64_sys_futex+0x78/0x1e0 Aug 22 22:38:06 juju-e4d256-prod-github-runner-207 kernel: [62060.612903] ? __secure_computing+0xa9/0x120 Aug 22 22:38:06 juju-e4d256-prod-github-runner-207 kernel: [62060.613577] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 22:38:06 juju-e4d256-prod-github-runner-207 kernel: [62060.614316] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:38:06 juju-e4d256-prod-github-runner-207 kernel: [62060.615023] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:38:06 juju-e4d256-prod-github-runner-207 kernel: [62060.615737] ? do_syscall_64+0x69/0xc0 Aug 22 22:38:06 juju-e4d256-prod-github-runner-207 kernel: [62060.616392] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:38:06 juju-e4d256-prod-github-runner-207 kernel: [62060.617083] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:38:06 juju-e4d256-prod-github-runner-207 kernel: [62060.617762] ? do_syscall_64+0x69/0xc0 Aug 22 22:38:06 juju-e4d256-prod-github-runner-207 kernel: [62060.618377] ? do_syscall_64+0x69/0xc0 Aug 22 22:38:06 juju-e4d256-prod-github-runner-207 kernel: [62060.618984] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 22:38:06 juju-e4d256-prod-github-runner-207 kernel: [62060.619679] RIP: 0033:0x7faa5d0edaff Aug 22 22:38:06 juju-e4d256-prod-github-runner-207 kernel: [62060.620342] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 22:38:06 juju-e4d256-prod-github-runner-207 kernel: [62060.622366] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 22:38:06 juju-e4d256-prod-github-runner-207 kernel: [62060.623308] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 22:38:06 juju-e4d256-prod-github-runner-207 kernel: [62060.624200] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 22:38:06 juju-e4d256-prod-github-runner-207 kernel: [62060.625101] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 22:38:06 juju-e4d256-prod-github-runner-207 kernel: [62060.625974] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 22:38:06 juju-e4d256-prod-github-runner-207 kernel: [62060.626840] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 22:38:06 juju-e4d256-prod-github-runner-207 kernel: [62060.627737] Aug 22 22:38:34 juju-e4d256-prod-github-runner-207 kernel: [62088.541980] watchdog: BUG: soft lockup - CPU#1 stuck for 57716s! [qemu-system-x86:6715] Aug 22 22:38:34 juju-e4d256-prod-github-runner-207 kernel: [62088.543941] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 22:38:34 juju-e4d256-prod-github-runner-207 kernel: [62088.544222] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 22:38:34 juju-e4d256-prod-github-runner-207 kernel: [62088.557259] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 22:38:34 juju-e4d256-prod-github-runner-207 kernel: [62088.558598] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 22:38:34 juju-e4d256-prod-github-runner-207 kernel: [62088.559921] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:38:34 juju-e4d256-prod-github-runner-207 kernel: [62088.561028] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 22:38:34 juju-e4d256-prod-github-runner-207 kernel: [62088.563690] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 22:38:34 juju-e4d256-prod-github-runner-207 kernel: [62088.564762] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 22:38:34 juju-e4d256-prod-github-runner-207 kernel: [62088.565951] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 22:38:34 juju-e4d256-prod-github-runner-207 kernel: [62088.567131] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 22:38:34 juju-e4d256-prod-github-runner-207 kernel: [62088.568369] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 22:38:34 juju-e4d256-prod-github-runner-207 kernel: [62088.569551] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 22:38:34 juju-e4d256-prod-github-runner-207 kernel: [62088.570735] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 22:38:34 juju-e4d256-prod-github-runner-207 kernel: [62088.572062] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 22:38:34 juju-e4d256-prod-github-runner-207 kernel: [62088.573190] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 22:38:34 juju-e4d256-prod-github-runner-207 kernel: [62088.574411] Call Trace: Aug 22 22:38:34 juju-e4d256-prod-github-runner-207 kernel: [62088.575387] Aug 22 22:38:34 juju-e4d256-prod-github-runner-207 kernel: [62088.576316] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:38:34 juju-e4d256-prod-github-runner-207 kernel: [62088.577372] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:38:34 juju-e4d256-prod-github-runner-207 kernel: [62088.578425] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:38:34 juju-e4d256-prod-github-runner-207 kernel: [62088.579632] ? show_regs.part.0+0x23/0x29 Aug 22 22:38:34 juju-e4d256-prod-github-runner-207 kernel: [62088.580653] ? show_regs.cold+0x8/0xd Aug 22 22:38:34 juju-e4d256-prod-github-runner-207 kernel: [62088.581637] ? watchdog_timer_fn+0x1be/0x220 Aug 22 22:38:34 juju-e4d256-prod-github-runner-207 kernel: [62088.582660] ? lockup_detector_update_enable+0x60/0x60 Aug 22 22:38:34 juju-e4d256-prod-github-runner-207 kernel: [62088.583838] ? __hrtimer_run_queues+0x107/0x230 Aug 22 22:38:34 juju-e4d256-prod-github-runner-207 kernel: [62088.584981] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 22:38:34 juju-e4d256-prod-github-runner-207 kernel: [62088.586033] ? hrtimer_interrupt+0x101/0x220 Aug 22 22:38:34 juju-e4d256-prod-github-runner-207 kernel: [62088.587064] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 22:38:34 juju-e4d256-prod-github-runner-207 kernel: [62088.588231] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 22:38:34 juju-e4d256-prod-github-runner-207 kernel: [62088.589656] Aug 22 22:38:34 juju-e4d256-prod-github-runner-207 kernel: [62088.590518] Aug 22 22:38:34 juju-e4d256-prod-github-runner-207 kernel: [62088.591414] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 22:38:34 juju-e4d256-prod-github-runner-207 kernel: [62088.592475] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:38:34 juju-e4d256-prod-github-runner-207 kernel: [62088.593539] ? _raw_spin_lock+0x22/0x30 Aug 22 22:38:34 juju-e4d256-prod-github-runner-207 kernel: [62088.594506] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:38:34 juju-e4d256-prod-github-runner-207 kernel: [62088.595655] direct_page_fault+0x206/0x310 [kvm] Aug 22 22:38:34 juju-e4d256-prod-github-runner-207 kernel: [62088.596711] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 22:38:34 juju-e4d256-prod-github-runner-207 kernel: [62088.597740] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 22:38:34 juju-e4d256-prod-github-runner-207 kernel: [62088.598767] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 22:38:34 juju-e4d256-prod-github-runner-207 kernel: [62088.599872] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 22:38:34 juju-e4d256-prod-github-runner-207 kernel: [62088.600838] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 22:38:34 juju-e4d256-prod-github-runner-207 kernel: [62088.601877] handle_exit+0x98/0x230 [kvm_amd] Aug 22 22:38:34 juju-e4d256-prod-github-runner-207 kernel: [62088.602796] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 22:38:34 juju-e4d256-prod-github-runner-207 kernel: [62088.604267] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 22:38:34 juju-e4d256-prod-github-runner-207 kernel: [62088.605455] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 22:38:34 juju-e4d256-prod-github-runner-207 kernel: [62088.606426] vcpu_run+0x62/0x2c0 [kvm] Aug 22 22:38:34 juju-e4d256-prod-github-runner-207 kernel: [62088.607326] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 22:38:34 juju-e4d256-prod-github-runner-207 kernel: [62088.608180] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 22:38:34 juju-e4d256-prod-github-runner-207 kernel: [62088.609127] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 22:38:34 juju-e4d256-prod-github-runner-207 kernel: [62088.609973] ? __seccomp_filter+0x4a/0x4a0 Aug 22 22:38:34 juju-e4d256-prod-github-runner-207 kernel: [62088.610751] ? __fget_files+0x86/0xc0 Aug 22 22:38:34 juju-e4d256-prod-github-runner-207 kernel: [62088.611518] __x64_sys_ioctl+0x95/0xd0 Aug 22 22:38:34 juju-e4d256-prod-github-runner-207 kernel: [62088.612244] do_syscall_64+0x5c/0xc0 Aug 22 22:38:34 juju-e4d256-prod-github-runner-207 kernel: [62088.612946] ? do_futex+0x162/0x1f0 Aug 22 22:38:34 juju-e4d256-prod-github-runner-207 kernel: [62088.613677] ? __x64_sys_futex+0x78/0x1e0 Aug 22 22:38:34 juju-e4d256-prod-github-runner-207 kernel: [62088.614416] ? __secure_computing+0xa9/0x120 Aug 22 22:38:34 juju-e4d256-prod-github-runner-207 kernel: [62088.615147] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 22:38:34 juju-e4d256-prod-github-runner-207 kernel: [62088.615972] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:38:34 juju-e4d256-prod-github-runner-207 kernel: [62088.616721] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:38:34 juju-e4d256-prod-github-runner-207 kernel: [62088.617485] ? do_syscall_64+0x69/0xc0 Aug 22 22:38:34 juju-e4d256-prod-github-runner-207 kernel: [62088.618169] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:38:34 juju-e4d256-prod-github-runner-207 kernel: [62088.618924] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:38:34 juju-e4d256-prod-github-runner-207 kernel: [62088.619667] ? do_syscall_64+0x69/0xc0 Aug 22 22:38:34 juju-e4d256-prod-github-runner-207 kernel: [62088.620323] ? do_syscall_64+0x69/0xc0 Aug 22 22:38:34 juju-e4d256-prod-github-runner-207 kernel: [62088.620970] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 22:38:34 juju-e4d256-prod-github-runner-207 kernel: [62088.621709] RIP: 0033:0x7faa5d0edaff Aug 22 22:38:34 juju-e4d256-prod-github-runner-207 kernel: [62088.622498] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 22:38:34 juju-e4d256-prod-github-runner-207 kernel: [62088.625101] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 22:38:34 juju-e4d256-prod-github-runner-207 kernel: [62088.626105] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 22:38:34 juju-e4d256-prod-github-runner-207 kernel: [62088.627079] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 22:38:34 juju-e4d256-prod-github-runner-207 kernel: [62088.628079] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 22:38:34 juju-e4d256-prod-github-runner-207 kernel: [62088.629028] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 22:38:34 juju-e4d256-prod-github-runner-207 kernel: [62088.629986] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 22:38:34 juju-e4d256-prod-github-runner-207 kernel: [62088.630943] Aug 22 22:38:47 juju-e4d256-prod-github-runner-207 kernel: [62101.328710] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 22:38:47 juju-e4d256-prod-github-runner-207 kernel: [62101.330766] rcu: 1-....: (15447180 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=7459000 Aug 22 22:38:47 juju-e4d256-prod-github-runner-207 kernel: [62101.332129] (t=15496032 jiffies g=23269 q=55278) Aug 22 22:38:47 juju-e4d256-prod-github-runner-207 kernel: [62101.333064] NMI backtrace for cpu 1 Aug 22 22:38:47 juju-e4d256-prod-github-runner-207 kernel: [62101.333876] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 22:38:47 juju-e4d256-prod-github-runner-207 kernel: [62101.335203] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 22:38:47 juju-e4d256-prod-github-runner-207 kernel: [62101.336443] Call Trace: Aug 22 22:38:47 juju-e4d256-prod-github-runner-207 kernel: [62101.337173] Aug 22 22:38:47 juju-e4d256-prod-github-runner-207 kernel: [62101.337885] show_stack+0x52/0x5c Aug 22 22:38:47 juju-e4d256-prod-github-runner-207 kernel: [62101.338687] dump_stack_lvl+0x4a/0x63 Aug 22 22:38:47 juju-e4d256-prod-github-runner-207 kernel: [62101.339544] dump_stack+0x10/0x16 Aug 22 22:38:47 juju-e4d256-prod-github-runner-207 kernel: [62101.340364] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 22:38:47 juju-e4d256-prod-github-runner-207 kernel: [62101.341246] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 22:38:47 juju-e4d256-prod-github-runner-207 kernel: [62101.342124] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 22:38:47 juju-e4d256-prod-github-runner-207 kernel: [62101.343079] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 22:38:47 juju-e4d256-prod-github-runner-207 kernel: [62101.344008] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 22:38:47 juju-e4d256-prod-github-runner-207 kernel: [62101.344943] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 22:38:47 juju-e4d256-prod-github-runner-207 kernel: [62101.345815] print_cpu_stall.cold+0x2f/0xe2 Aug 22 22:38:47 juju-e4d256-prod-github-runner-207 kernel: [62101.346671] ? timekeeping_update+0xf7/0x150 Aug 22 22:38:47 juju-e4d256-prod-github-runner-207 kernel: [62101.347546] check_cpu_stall+0x109/0x270 Aug 22 22:38:47 juju-e4d256-prod-github-runner-207 kernel: [62101.348382] rcu_sched_clock_irq+0x9a/0x250 Aug 22 22:38:47 juju-e4d256-prod-github-runner-207 kernel: [62101.349248] update_process_times+0x94/0xd0 Aug 22 22:38:47 juju-e4d256-prod-github-runner-207 kernel: [62101.350101] tick_sched_handle+0x29/0x70 Aug 22 22:38:47 juju-e4d256-prod-github-runner-207 kernel: [62101.350932] tick_sched_timer+0x8c/0xc0 Aug 22 22:38:47 juju-e4d256-prod-github-runner-207 kernel: [62101.351779] ? tick_nohz_handler+0xb0/0xb0 Aug 22 22:38:47 juju-e4d256-prod-github-runner-207 kernel: [62101.352566] __hrtimer_run_queues+0x107/0x230 Aug 22 22:38:47 juju-e4d256-prod-github-runner-207 kernel: [62101.353572] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 22:38:47 juju-e4d256-prod-github-runner-207 kernel: [62101.354356] hrtimer_interrupt+0x101/0x220 Aug 22 22:38:47 juju-e4d256-prod-github-runner-207 kernel: [62101.355156] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 22:38:47 juju-e4d256-prod-github-runner-207 kernel: [62101.356087] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 22:38:47 juju-e4d256-prod-github-runner-207 kernel: [62101.357001] Aug 22 22:38:47 juju-e4d256-prod-github-runner-207 kernel: [62101.357691] Aug 22 22:38:47 juju-e4d256-prod-github-runner-207 kernel: [62101.358377] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 22:38:47 juju-e4d256-prod-github-runner-207 kernel: [62101.359383] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:38:47 juju-e4d256-prod-github-runner-207 kernel: [62101.360398] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 22:38:47 juju-e4d256-prod-github-runner-207 kernel: [62101.362959] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 22:38:47 juju-e4d256-prod-github-runner-207 kernel: [62101.363969] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 22:38:47 juju-e4d256-prod-github-runner-207 kernel: [62101.365111] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 22:38:47 juju-e4d256-prod-github-runner-207 kernel: [62101.366232] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 22:38:47 juju-e4d256-prod-github-runner-207 kernel: [62101.367373] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 22:38:47 juju-e4d256-prod-github-runner-207 kernel: [62101.368466] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 22:38:47 juju-e4d256-prod-github-runner-207 kernel: [62101.369740] ? _raw_spin_lock+0x22/0x30 Aug 22 22:38:47 juju-e4d256-prod-github-runner-207 kernel: [62101.370608] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:38:47 juju-e4d256-prod-github-runner-207 kernel: [62101.371593] direct_page_fault+0x206/0x310 [kvm] Aug 22 22:38:47 juju-e4d256-prod-github-runner-207 kernel: [62101.372554] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 22:38:47 juju-e4d256-prod-github-runner-207 kernel: [62101.373487] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 22:38:47 juju-e4d256-prod-github-runner-207 kernel: [62101.374448] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 22:38:47 juju-e4d256-prod-github-runner-207 kernel: [62101.375419] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 22:38:47 juju-e4d256-prod-github-runner-207 kernel: [62101.376312] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 22:38:47 juju-e4d256-prod-github-runner-207 kernel: [62101.377260] handle_exit+0x98/0x230 [kvm_amd] Aug 22 22:38:47 juju-e4d256-prod-github-runner-207 kernel: [62101.378120] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 22:38:47 juju-e4d256-prod-github-runner-207 kernel: [62101.379006] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 22:38:47 juju-e4d256-prod-github-runner-207 kernel: [62101.379938] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 22:38:47 juju-e4d256-prod-github-runner-207 kernel: [62101.380826] vcpu_run+0x62/0x2c0 [kvm] Aug 22 22:38:47 juju-e4d256-prod-github-runner-207 kernel: [62101.381631] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 22:38:47 juju-e4d256-prod-github-runner-207 kernel: [62101.382475] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 22:38:47 juju-e4d256-prod-github-runner-207 kernel: [62101.383416] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 22:38:47 juju-e4d256-prod-github-runner-207 kernel: [62101.384265] ? __seccomp_filter+0x4a/0x4a0 Aug 22 22:38:47 juju-e4d256-prod-github-runner-207 kernel: [62101.385079] ? __fget_files+0x86/0xc0 Aug 22 22:38:47 juju-e4d256-prod-github-runner-207 kernel: [62101.385857] __x64_sys_ioctl+0x95/0xd0 Aug 22 22:38:47 juju-e4d256-prod-github-runner-207 kernel: [62101.386641] do_syscall_64+0x5c/0xc0 Aug 22 22:38:47 juju-e4d256-prod-github-runner-207 kernel: [62101.387433] ? do_futex+0x162/0x1f0 Aug 22 22:38:47 juju-e4d256-prod-github-runner-207 kernel: [62101.388191] ? __x64_sys_futex+0x78/0x1e0 Aug 22 22:38:47 juju-e4d256-prod-github-runner-207 kernel: [62101.388993] ? __secure_computing+0xa9/0x120 Aug 22 22:38:47 juju-e4d256-prod-github-runner-207 kernel: [62101.389801] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 22:38:47 juju-e4d256-prod-github-runner-207 kernel: [62101.390704] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:38:47 juju-e4d256-prod-github-runner-207 kernel: [62101.391583] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:38:47 juju-e4d256-prod-github-runner-207 kernel: [62101.392437] ? do_syscall_64+0x69/0xc0 Aug 22 22:38:47 juju-e4d256-prod-github-runner-207 kernel: [62101.393208] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:38:47 juju-e4d256-prod-github-runner-207 kernel: [62101.394066] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:38:47 juju-e4d256-prod-github-runner-207 kernel: [62101.395133] ? do_syscall_64+0x69/0xc0 Aug 22 22:38:47 juju-e4d256-prod-github-runner-207 kernel: [62101.395909] ? do_syscall_64+0x69/0xc0 Aug 22 22:38:47 juju-e4d256-prod-github-runner-207 kernel: [62101.396846] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 22:38:47 juju-e4d256-prod-github-runner-207 kernel: [62101.397728] RIP: 0033:0x7faa5d0edaff Aug 22 22:38:47 juju-e4d256-prod-github-runner-207 kernel: [62101.398930] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 22:38:47 juju-e4d256-prod-github-runner-207 kernel: [62101.401439] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 22:38:47 juju-e4d256-prod-github-runner-207 kernel: [62101.402567] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 22:38:47 juju-e4d256-prod-github-runner-207 kernel: [62101.403692] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 22:38:47 juju-e4d256-prod-github-runner-207 kernel: [62101.404789] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 22:38:47 juju-e4d256-prod-github-runner-207 kernel: [62101.405888] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 22:38:47 juju-e4d256-prod-github-runner-207 kernel: [62101.406967] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 22:38:47 juju-e4d256-prod-github-runner-207 kernel: [62101.408064] Aug 22 22:39:14 juju-e4d256-prod-github-runner-207 kernel: [62128.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 57753s! [qemu-system-x86:6715] Aug 22 22:39:14 juju-e4d256-prod-github-runner-207 kernel: [62128.544367] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 22:39:14 juju-e4d256-prod-github-runner-207 kernel: [62128.544706] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 22:39:14 juju-e4d256-prod-github-runner-207 kernel: [62128.556905] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 22:39:14 juju-e4d256-prod-github-runner-207 kernel: [62128.558169] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 22:39:14 juju-e4d256-prod-github-runner-207 kernel: [62128.559508] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:39:14 juju-e4d256-prod-github-runner-207 kernel: [62128.560585] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 22:39:14 juju-e4d256-prod-github-runner-207 kernel: [62128.563459] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 22:39:14 juju-e4d256-prod-github-runner-207 kernel: [62128.564501] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 22:39:14 juju-e4d256-prod-github-runner-207 kernel: [62128.565661] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 22:39:14 juju-e4d256-prod-github-runner-207 kernel: [62128.566901] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 22:39:14 juju-e4d256-prod-github-runner-207 kernel: [62128.568246] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 22:39:14 juju-e4d256-prod-github-runner-207 kernel: [62128.569423] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 22:39:14 juju-e4d256-prod-github-runner-207 kernel: [62128.570591] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 22:39:14 juju-e4d256-prod-github-runner-207 kernel: [62128.571854] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 22:39:14 juju-e4d256-prod-github-runner-207 kernel: [62128.572971] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 22:39:14 juju-e4d256-prod-github-runner-207 kernel: [62128.574183] Call Trace: Aug 22 22:39:14 juju-e4d256-prod-github-runner-207 kernel: [62128.575119] Aug 22 22:39:14 juju-e4d256-prod-github-runner-207 kernel: [62128.576032] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:39:14 juju-e4d256-prod-github-runner-207 kernel: [62128.577069] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:39:14 juju-e4d256-prod-github-runner-207 kernel: [62128.578089] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:39:14 juju-e4d256-prod-github-runner-207 kernel: [62128.579216] ? show_regs.part.0+0x23/0x29 Aug 22 22:39:14 juju-e4d256-prod-github-runner-207 kernel: [62128.580215] ? show_regs.cold+0x8/0xd Aug 22 22:39:14 juju-e4d256-prod-github-runner-207 kernel: [62128.581231] ? watchdog_timer_fn+0x1be/0x220 Aug 22 22:39:14 juju-e4d256-prod-github-runner-207 kernel: [62128.582258] ? lockup_detector_update_enable+0x60/0x60 Aug 22 22:39:14 juju-e4d256-prod-github-runner-207 kernel: [62128.583347] ? __hrtimer_run_queues+0x107/0x230 Aug 22 22:39:14 juju-e4d256-prod-github-runner-207 kernel: [62128.584380] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 22:39:14 juju-e4d256-prod-github-runner-207 kernel: [62128.585408] ? hrtimer_interrupt+0x101/0x220 Aug 22 22:39:14 juju-e4d256-prod-github-runner-207 kernel: [62128.586429] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 22:39:14 juju-e4d256-prod-github-runner-207 kernel: [62128.587558] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 22:39:14 juju-e4d256-prod-github-runner-207 kernel: [62128.588628] Aug 22 22:39:14 juju-e4d256-prod-github-runner-207 kernel: [62128.589488] Aug 22 22:39:14 juju-e4d256-prod-github-runner-207 kernel: [62128.590329] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 22:39:14 juju-e4d256-prod-github-runner-207 kernel: [62128.591396] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:39:14 juju-e4d256-prod-github-runner-207 kernel: [62128.592474] ? _raw_spin_lock+0x22/0x30 Aug 22 22:39:14 juju-e4d256-prod-github-runner-207 kernel: [62128.593453] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:39:14 juju-e4d256-prod-github-runner-207 kernel: [62128.594511] direct_page_fault+0x206/0x310 [kvm] Aug 22 22:39:14 juju-e4d256-prod-github-runner-207 kernel: [62128.595584] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 22:39:14 juju-e4d256-prod-github-runner-207 kernel: [62128.596593] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 22:39:14 juju-e4d256-prod-github-runner-207 kernel: [62128.597595] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 22:39:14 juju-e4d256-prod-github-runner-207 kernel: [62128.598648] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 22:39:14 juju-e4d256-prod-github-runner-207 kernel: [62128.599607] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 22:39:14 juju-e4d256-prod-github-runner-207 kernel: [62128.600584] handle_exit+0x98/0x230 [kvm_amd] Aug 22 22:39:14 juju-e4d256-prod-github-runner-207 kernel: [62128.601494] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 22:39:14 juju-e4d256-prod-github-runner-207 kernel: [62128.602410] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 22:39:14 juju-e4d256-prod-github-runner-207 kernel: [62128.603400] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 22:39:14 juju-e4d256-prod-github-runner-207 kernel: [62128.604318] vcpu_run+0x62/0x2c0 [kvm] Aug 22 22:39:14 juju-e4d256-prod-github-runner-207 kernel: [62128.605139] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 22:39:14 juju-e4d256-prod-github-runner-207 kernel: [62128.605953] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 22:39:14 juju-e4d256-prod-github-runner-207 kernel: [62128.606837] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 22:39:14 juju-e4d256-prod-github-runner-207 kernel: [62128.607641] ? __seccomp_filter+0x4a/0x4a0 Aug 22 22:39:14 juju-e4d256-prod-github-runner-207 kernel: [62128.608390] ? __fget_files+0x86/0xc0 Aug 22 22:39:14 juju-e4d256-prod-github-runner-207 kernel: [62128.609099] __x64_sys_ioctl+0x95/0xd0 Aug 22 22:39:14 juju-e4d256-prod-github-runner-207 kernel: [62128.609794] do_syscall_64+0x5c/0xc0 Aug 22 22:39:14 juju-e4d256-prod-github-runner-207 kernel: [62128.610464] ? do_futex+0x162/0x1f0 Aug 22 22:39:14 juju-e4d256-prod-github-runner-207 kernel: [62128.611185] ? __x64_sys_futex+0x78/0x1e0 Aug 22 22:39:14 juju-e4d256-prod-github-runner-207 kernel: [62128.611868] ? __secure_computing+0xa9/0x120 Aug 22 22:39:14 juju-e4d256-prod-github-runner-207 kernel: [62128.612612] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 22:39:14 juju-e4d256-prod-github-runner-207 kernel: [62128.613376] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:39:14 juju-e4d256-prod-github-runner-207 kernel: [62128.614117] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:39:14 juju-e4d256-prod-github-runner-207 kernel: [62128.614870] ? do_syscall_64+0x69/0xc0 Aug 22 22:39:14 juju-e4d256-prod-github-runner-207 kernel: [62128.615552] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:39:14 juju-e4d256-prod-github-runner-207 kernel: [62128.616267] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:39:14 juju-e4d256-prod-github-runner-207 kernel: [62128.616965] ? do_syscall_64+0x69/0xc0 Aug 22 22:39:14 juju-e4d256-prod-github-runner-207 kernel: [62128.617596] ? do_syscall_64+0x69/0xc0 Aug 22 22:39:14 juju-e4d256-prod-github-runner-207 kernel: [62128.618219] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 22:39:14 juju-e4d256-prod-github-runner-207 kernel: [62128.618947] RIP: 0033:0x7faa5d0edaff Aug 22 22:39:14 juju-e4d256-prod-github-runner-207 kernel: [62128.619633] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 22:39:14 juju-e4d256-prod-github-runner-207 kernel: [62128.621658] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 22:39:14 juju-e4d256-prod-github-runner-207 kernel: [62128.622583] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 22:39:14 juju-e4d256-prod-github-runner-207 kernel: [62128.623531] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 22:39:14 juju-e4d256-prod-github-runner-207 kernel: [62128.624452] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 22:39:14 juju-e4d256-prod-github-runner-207 kernel: [62128.625349] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 22:39:14 juju-e4d256-prod-github-runner-207 kernel: [62128.626269] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 22:39:14 juju-e4d256-prod-github-runner-207 kernel: [62128.627226] Aug 22 22:39:42 juju-e4d256-prod-github-runner-207 kernel: [62156.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 57779s! [qemu-system-x86:6715] Aug 22 22:39:42 juju-e4d256-prod-github-runner-207 kernel: [62156.543890] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 22:39:42 juju-e4d256-prod-github-runner-207 kernel: [62156.544217] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 22:39:42 juju-e4d256-prod-github-runner-207 kernel: [62156.556783] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 22:39:42 juju-e4d256-prod-github-runner-207 kernel: [62156.558084] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 22:39:42 juju-e4d256-prod-github-runner-207 kernel: [62156.559340] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:39:42 juju-e4d256-prod-github-runner-207 kernel: [62156.560415] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 22:39:42 juju-e4d256-prod-github-runner-207 kernel: [62156.563024] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 22:39:42 juju-e4d256-prod-github-runner-207 kernel: [62156.564088] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 22:39:42 juju-e4d256-prod-github-runner-207 kernel: [62156.565277] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 22:39:42 juju-e4d256-prod-github-runner-207 kernel: [62156.566489] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 22:39:42 juju-e4d256-prod-github-runner-207 kernel: [62156.567675] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 22:39:42 juju-e4d256-prod-github-runner-207 kernel: [62156.568858] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 22:39:42 juju-e4d256-prod-github-runner-207 kernel: [62156.570067] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 22:39:42 juju-e4d256-prod-github-runner-207 kernel: [62156.571429] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 22:39:42 juju-e4d256-prod-github-runner-207 kernel: [62156.572559] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 22:39:42 juju-e4d256-prod-github-runner-207 kernel: [62156.573782] Call Trace: Aug 22 22:39:42 juju-e4d256-prod-github-runner-207 kernel: [62156.574737] Aug 22 22:39:42 juju-e4d256-prod-github-runner-207 kernel: [62156.575670] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:39:42 juju-e4d256-prod-github-runner-207 kernel: [62156.576739] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:39:42 juju-e4d256-prod-github-runner-207 kernel: [62156.577781] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:39:42 juju-e4d256-prod-github-runner-207 kernel: [62156.578911] ? show_regs.part.0+0x23/0x29 Aug 22 22:39:42 juju-e4d256-prod-github-runner-207 kernel: [62156.579958] ? show_regs.cold+0x8/0xd Aug 22 22:39:42 juju-e4d256-prod-github-runner-207 kernel: [62156.580942] ? watchdog_timer_fn+0x1be/0x220 Aug 22 22:39:42 juju-e4d256-prod-github-runner-207 kernel: [62156.581963] ? lockup_detector_update_enable+0x60/0x60 Aug 22 22:39:42 juju-e4d256-prod-github-runner-207 kernel: [62156.583058] ? __hrtimer_run_queues+0x107/0x230 Aug 22 22:39:42 juju-e4d256-prod-github-runner-207 kernel: [62156.584212] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 22:39:42 juju-e4d256-prod-github-runner-207 kernel: [62156.585278] ? hrtimer_interrupt+0x101/0x220 Aug 22 22:39:42 juju-e4d256-prod-github-runner-207 kernel: [62156.586336] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 22:39:42 juju-e4d256-prod-github-runner-207 kernel: [62156.587433] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 22:39:42 juju-e4d256-prod-github-runner-207 kernel: [62156.588497] Aug 22 22:39:42 juju-e4d256-prod-github-runner-207 kernel: [62156.589361] Aug 22 22:39:42 juju-e4d256-prod-github-runner-207 kernel: [62156.590229] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 22:39:42 juju-e4d256-prod-github-runner-207 kernel: [62156.591314] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:39:42 juju-e4d256-prod-github-runner-207 kernel: [62156.592382] ? _raw_spin_lock+0x22/0x30 Aug 22 22:39:42 juju-e4d256-prod-github-runner-207 kernel: [62156.593341] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:39:42 juju-e4d256-prod-github-runner-207 kernel: [62156.594405] direct_page_fault+0x206/0x310 [kvm] Aug 22 22:39:42 juju-e4d256-prod-github-runner-207 kernel: [62156.595445] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 22:39:42 juju-e4d256-prod-github-runner-207 kernel: [62156.596471] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 22:39:42 juju-e4d256-prod-github-runner-207 kernel: [62156.597517] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 22:39:42 juju-e4d256-prod-github-runner-207 kernel: [62156.598568] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 22:39:42 juju-e4d256-prod-github-runner-207 kernel: [62156.599551] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 22:39:42 juju-e4d256-prod-github-runner-207 kernel: [62156.600764] handle_exit+0x98/0x230 [kvm_amd] Aug 22 22:39:42 juju-e4d256-prod-github-runner-207 kernel: [62156.601865] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 22:39:42 juju-e4d256-prod-github-runner-207 kernel: [62156.602819] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 22:39:42 juju-e4d256-prod-github-runner-207 kernel: [62156.603765] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 22:39:42 juju-e4d256-prod-github-runner-207 kernel: [62156.604687] vcpu_run+0x62/0x2c0 [kvm] Aug 22 22:39:42 juju-e4d256-prod-github-runner-207 kernel: [62156.605516] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 22:39:42 juju-e4d256-prod-github-runner-207 kernel: [62156.606352] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 22:39:42 juju-e4d256-prod-github-runner-207 kernel: [62156.607255] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 22:39:42 juju-e4d256-prod-github-runner-207 kernel: [62156.608084] ? __seccomp_filter+0x4a/0x4a0 Aug 22 22:39:42 juju-e4d256-prod-github-runner-207 kernel: [62156.608846] ? __fget_files+0x86/0xc0 Aug 22 22:39:42 juju-e4d256-prod-github-runner-207 kernel: [62156.609570] __x64_sys_ioctl+0x95/0xd0 Aug 22 22:39:42 juju-e4d256-prod-github-runner-207 kernel: [62156.610278] do_syscall_64+0x5c/0xc0 Aug 22 22:39:42 juju-e4d256-prod-github-runner-207 kernel: [62156.611019] ? do_futex+0x162/0x1f0 Aug 22 22:39:42 juju-e4d256-prod-github-runner-207 kernel: [62156.611709] ? __x64_sys_futex+0x78/0x1e0 Aug 22 22:39:42 juju-e4d256-prod-github-runner-207 kernel: [62156.612391] ? __secure_computing+0xa9/0x120 Aug 22 22:39:42 juju-e4d256-prod-github-runner-207 kernel: [62156.613096] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 22:39:42 juju-e4d256-prod-github-runner-207 kernel: [62156.613868] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:39:42 juju-e4d256-prod-github-runner-207 kernel: [62156.614657] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:39:42 juju-e4d256-prod-github-runner-207 kernel: [62156.615453] ? do_syscall_64+0x69/0xc0 Aug 22 22:39:42 juju-e4d256-prod-github-runner-207 kernel: [62156.616111] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:39:42 juju-e4d256-prod-github-runner-207 kernel: [62156.616815] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:39:42 juju-e4d256-prod-github-runner-207 kernel: [62156.617531] ? do_syscall_64+0x69/0xc0 Aug 22 22:39:42 juju-e4d256-prod-github-runner-207 kernel: [62156.618181] ? do_syscall_64+0x69/0xc0 Aug 22 22:39:42 juju-e4d256-prod-github-runner-207 kernel: [62156.618821] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 22:39:42 juju-e4d256-prod-github-runner-207 kernel: [62156.619529] RIP: 0033:0x7faa5d0edaff Aug 22 22:39:42 juju-e4d256-prod-github-runner-207 kernel: [62156.620204] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 22:39:42 juju-e4d256-prod-github-runner-207 kernel: [62156.622231] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 22:39:42 juju-e4d256-prod-github-runner-207 kernel: [62156.623165] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 22:39:42 juju-e4d256-prod-github-runner-207 kernel: [62156.624059] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 22:39:42 juju-e4d256-prod-github-runner-207 kernel: [62156.624982] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 22:39:42 juju-e4d256-prod-github-runner-207 kernel: [62156.625881] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 22:39:42 juju-e4d256-prod-github-runner-207 kernel: [62156.626802] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 22:39:42 juju-e4d256-prod-github-runner-207 kernel: [62156.627702] Aug 22 22:40:10 juju-e4d256-prod-github-runner-207 kernel: [62184.541981] watchdog: BUG: soft lockup - CPU#1 stuck for 57805s! [qemu-system-x86:6715] Aug 22 22:40:10 juju-e4d256-prod-github-runner-207 kernel: [62184.543972] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 22:40:10 juju-e4d256-prod-github-runner-207 kernel: [62184.544481] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 22:40:10 juju-e4d256-prod-github-runner-207 kernel: [62184.557142] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 22:40:10 juju-e4d256-prod-github-runner-207 kernel: [62184.558467] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 22:40:10 juju-e4d256-prod-github-runner-207 kernel: [62184.559767] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:40:10 juju-e4d256-prod-github-runner-207 kernel: [62184.561164] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 22:40:10 juju-e4d256-prod-github-runner-207 kernel: [62184.564035] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 22:40:10 juju-e4d256-prod-github-runner-207 kernel: [62184.565177] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 22:40:10 juju-e4d256-prod-github-runner-207 kernel: [62184.566395] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 22:40:10 juju-e4d256-prod-github-runner-207 kernel: [62184.567606] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 22:40:10 juju-e4d256-prod-github-runner-207 kernel: [62184.568791] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 22:40:10 juju-e4d256-prod-github-runner-207 kernel: [62184.569973] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 22:40:10 juju-e4d256-prod-github-runner-207 kernel: [62184.571160] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 22:40:10 juju-e4d256-prod-github-runner-207 kernel: [62184.572425] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 22:40:10 juju-e4d256-prod-github-runner-207 kernel: [62184.573525] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 22:40:10 juju-e4d256-prod-github-runner-207 kernel: [62184.574742] Call Trace: Aug 22 22:40:10 juju-e4d256-prod-github-runner-207 kernel: [62184.575657] Aug 22 22:40:10 juju-e4d256-prod-github-runner-207 kernel: [62184.576550] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:40:10 juju-e4d256-prod-github-runner-207 kernel: [62184.577579] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:40:10 juju-e4d256-prod-github-runner-207 kernel: [62184.578623] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:40:10 juju-e4d256-prod-github-runner-207 kernel: [62184.579716] ? show_regs.part.0+0x23/0x29 Aug 22 22:40:10 juju-e4d256-prod-github-runner-207 kernel: [62184.580731] ? show_regs.cold+0x8/0xd Aug 22 22:40:10 juju-e4d256-prod-github-runner-207 kernel: [62184.581709] ? watchdog_timer_fn+0x1be/0x220 Aug 22 22:40:10 juju-e4d256-prod-github-runner-207 kernel: [62184.582740] ? lockup_detector_update_enable+0x60/0x60 Aug 22 22:40:10 juju-e4d256-prod-github-runner-207 kernel: [62184.583835] ? __hrtimer_run_queues+0x107/0x230 Aug 22 22:40:10 juju-e4d256-prod-github-runner-207 kernel: [62184.584860] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 22:40:10 juju-e4d256-prod-github-runner-207 kernel: [62184.585883] ? hrtimer_interrupt+0x101/0x220 Aug 22 22:40:10 juju-e4d256-prod-github-runner-207 kernel: [62184.586923] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 22:40:10 juju-e4d256-prod-github-runner-207 kernel: [62184.587990] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 22:40:10 juju-e4d256-prod-github-runner-207 kernel: [62184.589036] Aug 22 22:40:10 juju-e4d256-prod-github-runner-207 kernel: [62184.589902] Aug 22 22:40:10 juju-e4d256-prod-github-runner-207 kernel: [62184.590763] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 22:40:10 juju-e4d256-prod-github-runner-207 kernel: [62184.591793] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:40:10 juju-e4d256-prod-github-runner-207 kernel: [62184.592836] ? _raw_spin_lock+0x22/0x30 Aug 22 22:40:10 juju-e4d256-prod-github-runner-207 kernel: [62184.593778] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:40:10 juju-e4d256-prod-github-runner-207 kernel: [62184.594814] direct_page_fault+0x206/0x310 [kvm] Aug 22 22:40:10 juju-e4d256-prod-github-runner-207 kernel: [62184.595842] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 22:40:10 juju-e4d256-prod-github-runner-207 kernel: [62184.596853] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 22:40:10 juju-e4d256-prod-github-runner-207 kernel: [62184.597852] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 22:40:10 juju-e4d256-prod-github-runner-207 kernel: [62184.598874] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 22:40:10 juju-e4d256-prod-github-runner-207 kernel: [62184.599821] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 22:40:10 juju-e4d256-prod-github-runner-207 kernel: [62184.600797] handle_exit+0x98/0x230 [kvm_amd] Aug 22 22:40:10 juju-e4d256-prod-github-runner-207 kernel: [62184.601688] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 22:40:10 juju-e4d256-prod-github-runner-207 kernel: [62184.602625] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 22:40:10 juju-e4d256-prod-github-runner-207 kernel: [62184.603550] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 22:40:10 juju-e4d256-prod-github-runner-207 kernel: [62184.604470] vcpu_run+0x62/0x2c0 [kvm] Aug 22 22:40:10 juju-e4d256-prod-github-runner-207 kernel: [62184.605283] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 22:40:10 juju-e4d256-prod-github-runner-207 kernel: [62184.606098] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 22:40:10 juju-e4d256-prod-github-runner-207 kernel: [62184.606956] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 22:40:10 juju-e4d256-prod-github-runner-207 kernel: [62184.607755] ? __seccomp_filter+0x4a/0x4a0 Aug 22 22:40:10 juju-e4d256-prod-github-runner-207 kernel: [62184.608499] ? __fget_files+0x86/0xc0 Aug 22 22:40:10 juju-e4d256-prod-github-runner-207 kernel: [62184.609205] __x64_sys_ioctl+0x95/0xd0 Aug 22 22:40:10 juju-e4d256-prod-github-runner-207 kernel: [62184.609900] do_syscall_64+0x5c/0xc0 Aug 22 22:40:10 juju-e4d256-prod-github-runner-207 kernel: [62184.610576] ? do_futex+0x162/0x1f0 Aug 22 22:40:10 juju-e4d256-prod-github-runner-207 kernel: [62184.611246] ? __x64_sys_futex+0x78/0x1e0 Aug 22 22:40:10 juju-e4d256-prod-github-runner-207 kernel: [62184.611936] ? __secure_computing+0xa9/0x120 Aug 22 22:40:10 juju-e4d256-prod-github-runner-207 kernel: [62184.612634] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 22:40:10 juju-e4d256-prod-github-runner-207 kernel: [62184.613401] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:40:10 juju-e4d256-prod-github-runner-207 kernel: [62184.614144] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:40:10 juju-e4d256-prod-github-runner-207 kernel: [62184.614869] ? do_syscall_64+0x69/0xc0 Aug 22 22:40:10 juju-e4d256-prod-github-runner-207 kernel: [62184.615518] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:40:10 juju-e4d256-prod-github-runner-207 kernel: [62184.616228] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:40:10 juju-e4d256-prod-github-runner-207 kernel: [62184.616921] ? do_syscall_64+0x69/0xc0 Aug 22 22:40:10 juju-e4d256-prod-github-runner-207 kernel: [62184.617544] ? do_syscall_64+0x69/0xc0 Aug 22 22:40:10 juju-e4d256-prod-github-runner-207 kernel: [62184.618183] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 22:40:10 juju-e4d256-prod-github-runner-207 kernel: [62184.618891] RIP: 0033:0x7faa5d0edaff Aug 22 22:40:10 juju-e4d256-prod-github-runner-207 kernel: [62184.619544] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 22:40:10 juju-e4d256-prod-github-runner-207 kernel: [62184.621532] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 22:40:10 juju-e4d256-prod-github-runner-207 kernel: [62184.622475] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 22:40:10 juju-e4d256-prod-github-runner-207 kernel: [62184.623375] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 22:40:10 juju-e4d256-prod-github-runner-207 kernel: [62184.624278] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 22:40:10 juju-e4d256-prod-github-runner-207 kernel: [62184.625169] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 22:40:10 juju-e4d256-prod-github-runner-207 kernel: [62184.626085] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 22:40:10 juju-e4d256-prod-github-runner-207 kernel: [62184.626978] Aug 22 22:40:38 juju-e4d256-prod-github-runner-207 kernel: [62212.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 57831s! [qemu-system-x86:6715] Aug 22 22:40:38 juju-e4d256-prod-github-runner-207 kernel: [62212.543091] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 22:40:38 juju-e4d256-prod-github-runner-207 kernel: [62212.543164] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 22:40:38 juju-e4d256-prod-github-runner-207 kernel: [62212.555633] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 22:40:38 juju-e4d256-prod-github-runner-207 kernel: [62212.556954] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 22:40:38 juju-e4d256-prod-github-runner-207 kernel: [62212.558210] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:40:38 juju-e4d256-prod-github-runner-207 kernel: [62212.559267] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 22:40:38 juju-e4d256-prod-github-runner-207 kernel: [62212.561844] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 22:40:38 juju-e4d256-prod-github-runner-207 kernel: [62212.563055] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 22:40:38 juju-e4d256-prod-github-runner-207 kernel: [62212.564428] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 22:40:38 juju-e4d256-prod-github-runner-207 kernel: [62212.565622] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 22:40:38 juju-e4d256-prod-github-runner-207 kernel: [62212.566846] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 22:40:38 juju-e4d256-prod-github-runner-207 kernel: [62212.568115] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 22:40:38 juju-e4d256-prod-github-runner-207 kernel: [62212.569493] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 22:40:38 juju-e4d256-prod-github-runner-207 kernel: [62212.570873] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 22:40:38 juju-e4d256-prod-github-runner-207 kernel: [62212.571974] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 22:40:38 juju-e4d256-prod-github-runner-207 kernel: [62212.573171] Call Trace: Aug 22 22:40:38 juju-e4d256-prod-github-runner-207 kernel: [62212.574107] Aug 22 22:40:38 juju-e4d256-prod-github-runner-207 kernel: [62212.575114] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:40:38 juju-e4d256-prod-github-runner-207 kernel: [62212.576148] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:40:38 juju-e4d256-prod-github-runner-207 kernel: [62212.577168] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:40:38 juju-e4d256-prod-github-runner-207 kernel: [62212.578263] ? show_regs.part.0+0x23/0x29 Aug 22 22:40:38 juju-e4d256-prod-github-runner-207 kernel: [62212.579259] ? show_regs.cold+0x8/0xd Aug 22 22:40:38 juju-e4d256-prod-github-runner-207 kernel: [62212.580228] ? watchdog_timer_fn+0x1be/0x220 Aug 22 22:40:38 juju-e4d256-prod-github-runner-207 kernel: [62212.581272] ? lockup_detector_update_enable+0x60/0x60 Aug 22 22:40:38 juju-e4d256-prod-github-runner-207 kernel: [62212.582355] ? __hrtimer_run_queues+0x107/0x230 Aug 22 22:40:38 juju-e4d256-prod-github-runner-207 kernel: [62212.583428] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 22:40:38 juju-e4d256-prod-github-runner-207 kernel: [62212.584455] ? hrtimer_interrupt+0x101/0x220 Aug 22 22:40:38 juju-e4d256-prod-github-runner-207 kernel: [62212.585473] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 22:40:38 juju-e4d256-prod-github-runner-207 kernel: [62212.586549] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 22:40:38 juju-e4d256-prod-github-runner-207 kernel: [62212.587604] Aug 22 22:40:38 juju-e4d256-prod-github-runner-207 kernel: [62212.588474] Aug 22 22:40:38 juju-e4d256-prod-github-runner-207 kernel: [62212.589323] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 22:40:38 juju-e4d256-prod-github-runner-207 kernel: [62212.590385] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:40:38 juju-e4d256-prod-github-runner-207 kernel: [62212.591494] ? _raw_spin_lock+0x22/0x30 Aug 22 22:40:38 juju-e4d256-prod-github-runner-207 kernel: [62212.592467] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:40:38 juju-e4d256-prod-github-runner-207 kernel: [62212.593506] direct_page_fault+0x206/0x310 [kvm] Aug 22 22:40:38 juju-e4d256-prod-github-runner-207 kernel: [62212.594548] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 22:40:38 juju-e4d256-prod-github-runner-207 kernel: [62212.595553] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 22:40:38 juju-e4d256-prod-github-runner-207 kernel: [62212.596557] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 22:40:38 juju-e4d256-prod-github-runner-207 kernel: [62212.597527] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 22:40:38 juju-e4d256-prod-github-runner-207 kernel: [62212.598489] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 22:40:38 juju-e4d256-prod-github-runner-207 kernel: [62212.599464] handle_exit+0x98/0x230 [kvm_amd] Aug 22 22:40:38 juju-e4d256-prod-github-runner-207 kernel: [62212.600367] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 22:40:38 juju-e4d256-prod-github-runner-207 kernel: [62212.601295] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 22:40:38 juju-e4d256-prod-github-runner-207 kernel: [62212.602235] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 22:40:38 juju-e4d256-prod-github-runner-207 kernel: [62212.603137] vcpu_run+0x62/0x2c0 [kvm] Aug 22 22:40:38 juju-e4d256-prod-github-runner-207 kernel: [62212.604009] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 22:40:38 juju-e4d256-prod-github-runner-207 kernel: [62212.604821] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 22:40:38 juju-e4d256-prod-github-runner-207 kernel: [62212.605702] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 22:40:38 juju-e4d256-prod-github-runner-207 kernel: [62212.606504] ? __seccomp_filter+0x4a/0x4a0 Aug 22 22:40:38 juju-e4d256-prod-github-runner-207 kernel: [62212.607246] ? __fget_files+0x86/0xc0 Aug 22 22:40:38 juju-e4d256-prod-github-runner-207 kernel: [62212.607955] __x64_sys_ioctl+0x95/0xd0 Aug 22 22:40:38 juju-e4d256-prod-github-runner-207 kernel: [62212.608648] do_syscall_64+0x5c/0xc0 Aug 22 22:40:38 juju-e4d256-prod-github-runner-207 kernel: [62212.609484] ? do_futex+0x162/0x1f0 Aug 22 22:40:38 juju-e4d256-prod-github-runner-207 kernel: [62212.610167] ? __x64_sys_futex+0x78/0x1e0 Aug 22 22:40:38 juju-e4d256-prod-github-runner-207 kernel: [62212.610845] ? __secure_computing+0xa9/0x120 Aug 22 22:40:38 juju-e4d256-prod-github-runner-207 kernel: [62212.611541] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 22:40:38 juju-e4d256-prod-github-runner-207 kernel: [62212.612300] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:40:38 juju-e4d256-prod-github-runner-207 kernel: [62212.613028] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:40:38 juju-e4d256-prod-github-runner-207 kernel: [62212.613771] ? do_syscall_64+0x69/0xc0 Aug 22 22:40:38 juju-e4d256-prod-github-runner-207 kernel: [62212.614417] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:40:38 juju-e4d256-prod-github-runner-207 kernel: [62212.615121] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:40:38 juju-e4d256-prod-github-runner-207 kernel: [62212.615817] ? do_syscall_64+0x69/0xc0 Aug 22 22:40:38 juju-e4d256-prod-github-runner-207 kernel: [62212.616443] ? do_syscall_64+0x69/0xc0 Aug 22 22:40:38 juju-e4d256-prod-github-runner-207 kernel: [62212.617068] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 22:40:38 juju-e4d256-prod-github-runner-207 kernel: [62212.617846] RIP: 0033:0x7faa5d0edaff Aug 22 22:40:38 juju-e4d256-prod-github-runner-207 kernel: [62212.618502] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 22:40:38 juju-e4d256-prod-github-runner-207 kernel: [62212.620485] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 22:40:38 juju-e4d256-prod-github-runner-207 kernel: [62212.621406] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 22:40:38 juju-e4d256-prod-github-runner-207 kernel: [62212.622317] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 22:40:38 juju-e4d256-prod-github-runner-207 kernel: [62212.623213] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 22:40:38 juju-e4d256-prod-github-runner-207 kernel: [62212.624108] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 22:40:38 juju-e4d256-prod-github-runner-207 kernel: [62212.625003] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 22:40:38 juju-e4d256-prod-github-runner-207 kernel: [62212.625923] Aug 22 22:41:06 juju-e4d256-prod-github-runner-207 kernel: [62240.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 57858s! [qemu-system-x86:6715] Aug 22 22:41:06 juju-e4d256-prod-github-runner-207 kernel: [62240.543230] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 22:41:06 juju-e4d256-prod-github-runner-207 kernel: [62240.543495] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 22:41:06 juju-e4d256-prod-github-runner-207 kernel: [62240.555835] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 22:41:06 juju-e4d256-prod-github-runner-207 kernel: [62240.557357] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 22:41:06 juju-e4d256-prod-github-runner-207 kernel: [62240.558744] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:41:06 juju-e4d256-prod-github-runner-207 kernel: [62240.559924] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 22:41:06 juju-e4d256-prod-github-runner-207 kernel: [62240.562820] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 22:41:06 juju-e4d256-prod-github-runner-207 kernel: [62240.563876] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 22:41:06 juju-e4d256-prod-github-runner-207 kernel: [62240.565047] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 22:41:06 juju-e4d256-prod-github-runner-207 kernel: [62240.566239] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 22:41:06 juju-e4d256-prod-github-runner-207 kernel: [62240.567398] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 22:41:06 juju-e4d256-prod-github-runner-207 kernel: [62240.568559] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 22:41:06 juju-e4d256-prod-github-runner-207 kernel: [62240.569911] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 22:41:06 juju-e4d256-prod-github-runner-207 kernel: [62240.571415] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 22:41:06 juju-e4d256-prod-github-runner-207 kernel: [62240.572568] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 22:41:06 juju-e4d256-prod-github-runner-207 kernel: [62240.573841] Call Trace: Aug 22 22:41:06 juju-e4d256-prod-github-runner-207 kernel: [62240.575038] Aug 22 22:41:06 juju-e4d256-prod-github-runner-207 kernel: [62240.575934] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:41:06 juju-e4d256-prod-github-runner-207 kernel: [62240.576968] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:41:06 juju-e4d256-prod-github-runner-207 kernel: [62240.578016] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:41:06 juju-e4d256-prod-github-runner-207 kernel: [62240.579120] ? show_regs.part.0+0x23/0x29 Aug 22 22:41:06 juju-e4d256-prod-github-runner-207 kernel: [62240.580123] ? show_regs.cold+0x8/0xd Aug 22 22:41:06 juju-e4d256-prod-github-runner-207 kernel: [62240.581094] ? watchdog_timer_fn+0x1be/0x220 Aug 22 22:41:06 juju-e4d256-prod-github-runner-207 kernel: [62240.582115] ? lockup_detector_update_enable+0x60/0x60 Aug 22 22:41:06 juju-e4d256-prod-github-runner-207 kernel: [62240.583177] ? __hrtimer_run_queues+0x107/0x230 Aug 22 22:41:06 juju-e4d256-prod-github-runner-207 kernel: [62240.584202] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 22:41:06 juju-e4d256-prod-github-runner-207 kernel: [62240.585224] ? hrtimer_interrupt+0x101/0x220 Aug 22 22:41:06 juju-e4d256-prod-github-runner-207 kernel: [62240.586257] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 22:41:06 juju-e4d256-prod-github-runner-207 kernel: [62240.587324] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 22:41:06 juju-e4d256-prod-github-runner-207 kernel: [62240.588372] Aug 22 22:41:06 juju-e4d256-prod-github-runner-207 kernel: [62240.589244] Aug 22 22:41:06 juju-e4d256-prod-github-runner-207 kernel: [62240.590096] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 22:41:06 juju-e4d256-prod-github-runner-207 kernel: [62240.591141] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:41:06 juju-e4d256-prod-github-runner-207 kernel: [62240.592292] ? _raw_spin_lock+0x22/0x30 Aug 22 22:41:06 juju-e4d256-prod-github-runner-207 kernel: [62240.593294] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:41:06 juju-e4d256-prod-github-runner-207 kernel: [62240.594326] direct_page_fault+0x206/0x310 [kvm] Aug 22 22:41:06 juju-e4d256-prod-github-runner-207 kernel: [62240.595363] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 22:41:06 juju-e4d256-prod-github-runner-207 kernel: [62240.596380] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 22:41:06 juju-e4d256-prod-github-runner-207 kernel: [62240.597446] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 22:41:06 juju-e4d256-prod-github-runner-207 kernel: [62240.598466] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 22:41:06 juju-e4d256-prod-github-runner-207 kernel: [62240.599419] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 22:41:06 juju-e4d256-prod-github-runner-207 kernel: [62240.600416] handle_exit+0x98/0x230 [kvm_amd] Aug 22 22:41:06 juju-e4d256-prod-github-runner-207 kernel: [62240.601450] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 22:41:06 juju-e4d256-prod-github-runner-207 kernel: [62240.602493] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 22:41:06 juju-e4d256-prod-github-runner-207 kernel: [62240.603438] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 22:41:06 juju-e4d256-prod-github-runner-207 kernel: [62240.604360] vcpu_run+0x62/0x2c0 [kvm] Aug 22 22:41:06 juju-e4d256-prod-github-runner-207 kernel: [62240.605176] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 22:41:06 juju-e4d256-prod-github-runner-207 kernel: [62240.606006] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 22:41:06 juju-e4d256-prod-github-runner-207 kernel: [62240.606865] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 22:41:06 juju-e4d256-prod-github-runner-207 kernel: [62240.607664] ? __seccomp_filter+0x4a/0x4a0 Aug 22 22:41:06 juju-e4d256-prod-github-runner-207 kernel: [62240.608487] ? __fget_files+0x86/0xc0 Aug 22 22:41:06 juju-e4d256-prod-github-runner-207 kernel: [62240.609250] __x64_sys_ioctl+0x95/0xd0 Aug 22 22:41:06 juju-e4d256-prod-github-runner-207 kernel: [62240.609954] do_syscall_64+0x5c/0xc0 Aug 22 22:41:06 juju-e4d256-prod-github-runner-207 kernel: [62240.610621] ? do_futex+0x162/0x1f0 Aug 22 22:41:06 juju-e4d256-prod-github-runner-207 kernel: [62240.611272] ? __x64_sys_futex+0x78/0x1e0 Aug 22 22:41:06 juju-e4d256-prod-github-runner-207 kernel: [62240.611964] ? __secure_computing+0xa9/0x120 Aug 22 22:41:06 juju-e4d256-prod-github-runner-207 kernel: [62240.612679] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 22:41:06 juju-e4d256-prod-github-runner-207 kernel: [62240.613482] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:41:06 juju-e4d256-prod-github-runner-207 kernel: [62240.614231] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:41:06 juju-e4d256-prod-github-runner-207 kernel: [62240.614966] ? do_syscall_64+0x69/0xc0 Aug 22 22:41:06 juju-e4d256-prod-github-runner-207 kernel: [62240.615613] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:41:06 juju-e4d256-prod-github-runner-207 kernel: [62240.616329] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:41:06 juju-e4d256-prod-github-runner-207 kernel: [62240.617053] ? do_syscall_64+0x69/0xc0 Aug 22 22:41:06 juju-e4d256-prod-github-runner-207 kernel: [62240.617758] ? do_syscall_64+0x69/0xc0 Aug 22 22:41:06 juju-e4d256-prod-github-runner-207 kernel: [62240.618399] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 22:41:06 juju-e4d256-prod-github-runner-207 kernel: [62240.619132] RIP: 0033:0x7faa5d0edaff Aug 22 22:41:06 juju-e4d256-prod-github-runner-207 kernel: [62240.619800] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 22:41:06 juju-e4d256-prod-github-runner-207 kernel: [62240.621825] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 22:41:06 juju-e4d256-prod-github-runner-207 kernel: [62240.622738] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 22:41:06 juju-e4d256-prod-github-runner-207 kernel: [62240.623626] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 22:41:06 juju-e4d256-prod-github-runner-207 kernel: [62240.624517] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 22:41:06 juju-e4d256-prod-github-runner-207 kernel: [62240.625417] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 22:41:06 juju-e4d256-prod-github-runner-207 kernel: [62240.626312] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 22:41:06 juju-e4d256-prod-github-runner-207 kernel: [62240.627268] Aug 22 22:41:34 juju-e4d256-prod-github-runner-207 kernel: [62268.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 57884s! [qemu-system-x86:6715] Aug 22 22:41:34 juju-e4d256-prod-github-runner-207 kernel: [62268.543774] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 22:41:34 juju-e4d256-prod-github-runner-207 kernel: [62268.543991] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 22:41:34 juju-e4d256-prod-github-runner-207 kernel: [62268.556137] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 22:41:34 juju-e4d256-prod-github-runner-207 kernel: [62268.557424] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 22:41:34 juju-e4d256-prod-github-runner-207 kernel: [62268.558642] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:41:34 juju-e4d256-prod-github-runner-207 kernel: [62268.559701] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 22:41:34 juju-e4d256-prod-github-runner-207 kernel: [62268.562254] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 22:41:34 juju-e4d256-prod-github-runner-207 kernel: [62268.563295] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 22:41:34 juju-e4d256-prod-github-runner-207 kernel: [62268.564458] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 22:41:34 juju-e4d256-prod-github-runner-207 kernel: [62268.565623] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 22:41:34 juju-e4d256-prod-github-runner-207 kernel: [62268.566783] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 22:41:34 juju-e4d256-prod-github-runner-207 kernel: [62268.567944] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 22:41:34 juju-e4d256-prod-github-runner-207 kernel: [62268.569120] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 22:41:34 juju-e4d256-prod-github-runner-207 kernel: [62268.570356] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 22:41:34 juju-e4d256-prod-github-runner-207 kernel: [62268.571450] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 22:41:34 juju-e4d256-prod-github-runner-207 kernel: [62268.572639] Call Trace: Aug 22 22:41:34 juju-e4d256-prod-github-runner-207 kernel: [62268.573559] Aug 22 22:41:34 juju-e4d256-prod-github-runner-207 kernel: [62268.574448] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:41:34 juju-e4d256-prod-github-runner-207 kernel: [62268.575630] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:41:34 juju-e4d256-prod-github-runner-207 kernel: [62268.576647] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:41:34 juju-e4d256-prod-github-runner-207 kernel: [62268.577737] ? show_regs.part.0+0x23/0x29 Aug 22 22:41:34 juju-e4d256-prod-github-runner-207 kernel: [62268.578732] ? show_regs.cold+0x8/0xd Aug 22 22:41:34 juju-e4d256-prod-github-runner-207 kernel: [62268.579772] ? watchdog_timer_fn+0x1be/0x220 Aug 22 22:41:34 juju-e4d256-prod-github-runner-207 kernel: [62268.580793] ? lockup_detector_update_enable+0x60/0x60 Aug 22 22:41:34 juju-e4d256-prod-github-runner-207 kernel: [62268.581885] ? __hrtimer_run_queues+0x107/0x230 Aug 22 22:41:34 juju-e4d256-prod-github-runner-207 kernel: [62268.582939] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 22:41:34 juju-e4d256-prod-github-runner-207 kernel: [62268.583997] ? hrtimer_interrupt+0x101/0x220 Aug 22 22:41:34 juju-e4d256-prod-github-runner-207 kernel: [62268.585047] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 22:41:34 juju-e4d256-prod-github-runner-207 kernel: [62268.586124] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 22:41:34 juju-e4d256-prod-github-runner-207 kernel: [62268.587174] Aug 22 22:41:34 juju-e4d256-prod-github-runner-207 kernel: [62268.588025] Aug 22 22:41:34 juju-e4d256-prod-github-runner-207 kernel: [62268.588861] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 22:41:34 juju-e4d256-prod-github-runner-207 kernel: [62268.589906] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:41:34 juju-e4d256-prod-github-runner-207 kernel: [62268.590956] ? _raw_spin_lock+0x22/0x30 Aug 22 22:41:34 juju-e4d256-prod-github-runner-207 kernel: [62268.591903] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:41:34 juju-e4d256-prod-github-runner-207 kernel: [62268.592930] direct_page_fault+0x206/0x310 [kvm] Aug 22 22:41:34 juju-e4d256-prod-github-runner-207 kernel: [62268.593957] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 22:41:34 juju-e4d256-prod-github-runner-207 kernel: [62268.595002] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 22:41:34 juju-e4d256-prod-github-runner-207 kernel: [62268.596006] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 22:41:34 juju-e4d256-prod-github-runner-207 kernel: [62268.597045] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 22:41:34 juju-e4d256-prod-github-runner-207 kernel: [62268.598004] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 22:41:34 juju-e4d256-prod-github-runner-207 kernel: [62268.598977] handle_exit+0x98/0x230 [kvm_amd] Aug 22 22:41:34 juju-e4d256-prod-github-runner-207 kernel: [62268.599889] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 22:41:34 juju-e4d256-prod-github-runner-207 kernel: [62268.600804] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 22:41:34 juju-e4d256-prod-github-runner-207 kernel: [62268.601754] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 22:41:34 juju-e4d256-prod-github-runner-207 kernel: [62268.602687] vcpu_run+0x62/0x2c0 [kvm] Aug 22 22:41:34 juju-e4d256-prod-github-runner-207 kernel: [62268.603660] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 22:41:34 juju-e4d256-prod-github-runner-207 kernel: [62268.604480] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 22:41:34 juju-e4d256-prod-github-runner-207 kernel: [62268.605364] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 22:41:34 juju-e4d256-prod-github-runner-207 kernel: [62268.606161] ? __seccomp_filter+0x4a/0x4a0 Aug 22 22:41:34 juju-e4d256-prod-github-runner-207 kernel: [62268.606903] ? __fget_files+0x86/0xc0 Aug 22 22:41:34 juju-e4d256-prod-github-runner-207 kernel: [62268.607605] __x64_sys_ioctl+0x95/0xd0 Aug 22 22:41:34 juju-e4d256-prod-github-runner-207 kernel: [62268.608295] do_syscall_64+0x5c/0xc0 Aug 22 22:41:34 juju-e4d256-prod-github-runner-207 kernel: [62268.608982] ? do_futex+0x162/0x1f0 Aug 22 22:41:34 juju-e4d256-prod-github-runner-207 kernel: [62268.609629] ? __x64_sys_futex+0x78/0x1e0 Aug 22 22:41:34 juju-e4d256-prod-github-runner-207 kernel: [62268.610306] ? __secure_computing+0xa9/0x120 Aug 22 22:41:34 juju-e4d256-prod-github-runner-207 kernel: [62268.611000] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 22:41:34 juju-e4d256-prod-github-runner-207 kernel: [62268.611760] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:41:34 juju-e4d256-prod-github-runner-207 kernel: [62268.612485] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:41:34 juju-e4d256-prod-github-runner-207 kernel: [62268.613218] ? do_syscall_64+0x69/0xc0 Aug 22 22:41:34 juju-e4d256-prod-github-runner-207 kernel: [62268.613862] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:41:34 juju-e4d256-prod-github-runner-207 kernel: [62268.614568] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:41:34 juju-e4d256-prod-github-runner-207 kernel: [62268.615262] ? do_syscall_64+0x69/0xc0 Aug 22 22:41:34 juju-e4d256-prod-github-runner-207 kernel: [62268.615885] ? do_syscall_64+0x69/0xc0 Aug 22 22:41:34 juju-e4d256-prod-github-runner-207 kernel: [62268.616511] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 22:41:34 juju-e4d256-prod-github-runner-207 kernel: [62268.617228] RIP: 0033:0x7faa5d0edaff Aug 22 22:41:34 juju-e4d256-prod-github-runner-207 kernel: [62268.617866] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 22:41:34 juju-e4d256-prod-github-runner-207 kernel: [62268.619848] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 22:41:34 juju-e4d256-prod-github-runner-207 kernel: [62268.620769] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 22:41:34 juju-e4d256-prod-github-runner-207 kernel: [62268.621667] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 22:41:34 juju-e4d256-prod-github-runner-207 kernel: [62268.622552] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 22:41:34 juju-e4d256-prod-github-runner-207 kernel: [62268.623446] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 22:41:34 juju-e4d256-prod-github-runner-207 kernel: [62268.624331] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 22:41:34 juju-e4d256-prod-github-runner-207 kernel: [62268.625232] Aug 22 22:41:47 juju-e4d256-prod-github-runner-207 kernel: [62281.340732] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 22:41:47 juju-e4d256-prod-github-runner-207 kernel: [62281.341705] rcu: 1-....: (15492035 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=7480311 Aug 22 22:41:47 juju-e4d256-prod-github-runner-207 kernel: [62281.342836] (t=15541035 jiffies g=23269 q=55402) Aug 22 22:41:47 juju-e4d256-prod-github-runner-207 kernel: [62281.343627] NMI backtrace for cpu 1 Aug 22 22:41:47 juju-e4d256-prod-github-runner-207 kernel: [62281.344338] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 22:41:47 juju-e4d256-prod-github-runner-207 kernel: [62281.345477] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 22:41:47 juju-e4d256-prod-github-runner-207 kernel: [62281.346539] Call Trace: Aug 22 22:41:47 juju-e4d256-prod-github-runner-207 kernel: [62281.347212] Aug 22 22:41:47 juju-e4d256-prod-github-runner-207 kernel: [62281.347857] show_stack+0x52/0x5c Aug 22 22:41:47 juju-e4d256-prod-github-runner-207 kernel: [62281.348587] dump_stack_lvl+0x4a/0x63 Aug 22 22:41:47 juju-e4d256-prod-github-runner-207 kernel: [62281.349338] dump_stack+0x10/0x16 Aug 22 22:41:47 juju-e4d256-prod-github-runner-207 kernel: [62281.350059] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 22:41:47 juju-e4d256-prod-github-runner-207 kernel: [62281.350843] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 22:41:47 juju-e4d256-prod-github-runner-207 kernel: [62281.351620] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 22:41:47 juju-e4d256-prod-github-runner-207 kernel: [62281.352442] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 22:41:47 juju-e4d256-prod-github-runner-207 kernel: [62281.353276] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 22:41:47 juju-e4d256-prod-github-runner-207 kernel: [62281.354083] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 22:41:47 juju-e4d256-prod-github-runner-207 kernel: [62281.354853] print_cpu_stall.cold+0x2f/0xe2 Aug 22 22:41:47 juju-e4d256-prod-github-runner-207 kernel: [62281.355615] ? timekeeping_update+0xf7/0x150 Aug 22 22:41:47 juju-e4d256-prod-github-runner-207 kernel: [62281.356387] check_cpu_stall+0x109/0x270 Aug 22 22:41:47 juju-e4d256-prod-github-runner-207 kernel: [62281.357154] rcu_sched_clock_irq+0x9a/0x250 Aug 22 22:41:47 juju-e4d256-prod-github-runner-207 kernel: [62281.357916] update_process_times+0x94/0xd0 Aug 22 22:41:47 juju-e4d256-prod-github-runner-207 kernel: [62281.358675] tick_sched_handle+0x29/0x70 Aug 22 22:41:47 juju-e4d256-prod-github-runner-207 kernel: [62281.359419] tick_sched_timer+0x8c/0xc0 Aug 22 22:41:47 juju-e4d256-prod-github-runner-207 kernel: [62281.360171] ? tick_nohz_handler+0xb0/0xb0 Aug 22 22:41:47 juju-e4d256-prod-github-runner-207 kernel: [62281.360990] __hrtimer_run_queues+0x107/0x230 Aug 22 22:41:47 juju-e4d256-prod-github-runner-207 kernel: [62281.361781] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 22:41:47 juju-e4d256-prod-github-runner-207 kernel: [62281.362557] hrtimer_interrupt+0x101/0x220 Aug 22 22:41:47 juju-e4d256-prod-github-runner-207 kernel: [62281.363315] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 22:41:47 juju-e4d256-prod-github-runner-207 kernel: [62281.364129] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 22:41:47 juju-e4d256-prod-github-runner-207 kernel: [62281.364939] Aug 22 22:41:47 juju-e4d256-prod-github-runner-207 kernel: [62281.365575] Aug 22 22:41:47 juju-e4d256-prod-github-runner-207 kernel: [62281.366202] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 22:41:47 juju-e4d256-prod-github-runner-207 kernel: [62281.367017] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:41:47 juju-e4d256-prod-github-runner-207 kernel: [62281.367934] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 22:41:47 juju-e4d256-prod-github-runner-207 kernel: [62281.370191] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 22:41:47 juju-e4d256-prod-github-runner-207 kernel: [62281.371135] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 22:41:47 juju-e4d256-prod-github-runner-207 kernel: [62281.372142] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 22:41:47 juju-e4d256-prod-github-runner-207 kernel: [62281.373140] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 22:41:47 juju-e4d256-prod-github-runner-207 kernel: [62281.374540] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 22:41:47 juju-e4d256-prod-github-runner-207 kernel: [62281.375544] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 22:41:47 juju-e4d256-prod-github-runner-207 kernel: [62281.376501] ? _raw_spin_lock+0x22/0x30 Aug 22 22:41:47 juju-e4d256-prod-github-runner-207 kernel: [62281.377289] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:41:47 juju-e4d256-prod-github-runner-207 kernel: [62281.378141] direct_page_fault+0x206/0x310 [kvm] Aug 22 22:41:47 juju-e4d256-prod-github-runner-207 kernel: [62281.378990] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 22:41:47 juju-e4d256-prod-github-runner-207 kernel: [62281.379822] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 22:41:47 juju-e4d256-prod-github-runner-207 kernel: [62281.380657] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 22:41:47 juju-e4d256-prod-github-runner-207 kernel: [62281.381489] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 22:41:47 juju-e4d256-prod-github-runner-207 kernel: [62281.382277] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 22:41:47 juju-e4d256-prod-github-runner-207 kernel: [62281.383099] handle_exit+0x98/0x230 [kvm_amd] Aug 22 22:41:47 juju-e4d256-prod-github-runner-207 kernel: [62281.383860] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 22:41:47 juju-e4d256-prod-github-runner-207 kernel: [62281.384642] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 22:41:47 juju-e4d256-prod-github-runner-207 kernel: [62281.385490] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 22:41:47 juju-e4d256-prod-github-runner-207 kernel: [62281.386455] vcpu_run+0x62/0x2c0 [kvm] Aug 22 22:41:47 juju-e4d256-prod-github-runner-207 kernel: [62281.387171] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 22:41:47 juju-e4d256-prod-github-runner-207 kernel: [62281.387940] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 22:41:47 juju-e4d256-prod-github-runner-207 kernel: [62281.388769] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 22:41:47 juju-e4d256-prod-github-runner-207 kernel: [62281.389532] ? __seccomp_filter+0x4a/0x4a0 Aug 22 22:41:47 juju-e4d256-prod-github-runner-207 kernel: [62281.390251] ? __fget_files+0x86/0xc0 Aug 22 22:41:47 juju-e4d256-prod-github-runner-207 kernel: [62281.390995] __x64_sys_ioctl+0x95/0xd0 Aug 22 22:41:47 juju-e4d256-prod-github-runner-207 kernel: [62281.391778] do_syscall_64+0x5c/0xc0 Aug 22 22:41:47 juju-e4d256-prod-github-runner-207 kernel: [62281.392478] ? do_futex+0x162/0x1f0 Aug 22 22:41:47 juju-e4d256-prod-github-runner-207 kernel: [62281.393178] ? __x64_sys_futex+0x78/0x1e0 Aug 22 22:41:47 juju-e4d256-prod-github-runner-207 kernel: [62281.393879] ? __secure_computing+0xa9/0x120 Aug 22 22:41:47 juju-e4d256-prod-github-runner-207 kernel: [62281.394595] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 22:41:47 juju-e4d256-prod-github-runner-207 kernel: [62281.395385] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:41:47 juju-e4d256-prod-github-runner-207 kernel: [62281.396163] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:41:47 juju-e4d256-prod-github-runner-207 kernel: [62281.396950] ? do_syscall_64+0x69/0xc0 Aug 22 22:41:47 juju-e4d256-prod-github-runner-207 kernel: [62281.397662] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:41:47 juju-e4d256-prod-github-runner-207 kernel: [62281.398416] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:41:47 juju-e4d256-prod-github-runner-207 kernel: [62281.399171] ? do_syscall_64+0x69/0xc0 Aug 22 22:41:47 juju-e4d256-prod-github-runner-207 kernel: [62281.399883] ? do_syscall_64+0x69/0xc0 Aug 22 22:41:47 juju-e4d256-prod-github-runner-207 kernel: [62281.400572] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 22:41:47 juju-e4d256-prod-github-runner-207 kernel: [62281.401360] RIP: 0033:0x7faa5d0edaff Aug 22 22:41:47 juju-e4d256-prod-github-runner-207 kernel: [62281.402042] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 22:41:47 juju-e4d256-prod-github-runner-207 kernel: [62281.404151] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 22:41:47 juju-e4d256-prod-github-runner-207 kernel: [62281.405129] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 22:41:47 juju-e4d256-prod-github-runner-207 kernel: [62281.406087] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 22:41:47 juju-e4d256-prod-github-runner-207 kernel: [62281.407026] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 22:41:47 juju-e4d256-prod-github-runner-207 kernel: [62281.407962] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 22:41:47 juju-e4d256-prod-github-runner-207 kernel: [62281.408910] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 22:41:47 juju-e4d256-prod-github-runner-207 kernel: [62281.409822] Aug 22 22:42:14 juju-e4d256-prod-github-runner-207 kernel: [62308.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 57921s! [qemu-system-x86:6715] Aug 22 22:42:14 juju-e4d256-prod-github-runner-207 kernel: [62308.543120] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 22:42:14 juju-e4d256-prod-github-runner-207 kernel: [62308.543190] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 22:42:14 juju-e4d256-prod-github-runner-207 kernel: [62308.555688] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 22:42:14 juju-e4d256-prod-github-runner-207 kernel: [62308.556994] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 22:42:14 juju-e4d256-prod-github-runner-207 kernel: [62308.558219] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:42:14 juju-e4d256-prod-github-runner-207 kernel: [62308.559285] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 22:42:14 juju-e4d256-prod-github-runner-207 kernel: [62308.561860] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 22:42:14 juju-e4d256-prod-github-runner-207 kernel: [62308.562902] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 22:42:14 juju-e4d256-prod-github-runner-207 kernel: [62308.564063] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 22:42:14 juju-e4d256-prod-github-runner-207 kernel: [62308.565242] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 22:42:14 juju-e4d256-prod-github-runner-207 kernel: [62308.566407] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 22:42:14 juju-e4d256-prod-github-runner-207 kernel: [62308.567567] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 22:42:14 juju-e4d256-prod-github-runner-207 kernel: [62308.568751] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 22:42:14 juju-e4d256-prod-github-runner-207 kernel: [62308.569992] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 22:42:14 juju-e4d256-prod-github-runner-207 kernel: [62308.571089] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 22:42:14 juju-e4d256-prod-github-runner-207 kernel: [62308.572282] Call Trace: Aug 22 22:42:14 juju-e4d256-prod-github-runner-207 kernel: [62308.573204] Aug 22 22:42:14 juju-e4d256-prod-github-runner-207 kernel: [62308.574090] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:42:14 juju-e4d256-prod-github-runner-207 kernel: [62308.575125] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:42:14 juju-e4d256-prod-github-runner-207 kernel: [62308.576162] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:42:14 juju-e4d256-prod-github-runner-207 kernel: [62308.577266] ? show_regs.part.0+0x23/0x29 Aug 22 22:42:14 juju-e4d256-prod-github-runner-207 kernel: [62308.578270] ? show_regs.cold+0x8/0xd Aug 22 22:42:14 juju-e4d256-prod-github-runner-207 kernel: [62308.579242] ? watchdog_timer_fn+0x1be/0x220 Aug 22 22:42:14 juju-e4d256-prod-github-runner-207 kernel: [62308.580306] ? lockup_detector_update_enable+0x60/0x60 Aug 22 22:42:14 juju-e4d256-prod-github-runner-207 kernel: [62308.581393] ? __hrtimer_run_queues+0x107/0x230 Aug 22 22:42:14 juju-e4d256-prod-github-runner-207 kernel: [62308.582428] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 22:42:14 juju-e4d256-prod-github-runner-207 kernel: [62308.583472] ? hrtimer_interrupt+0x101/0x220 Aug 22 22:42:14 juju-e4d256-prod-github-runner-207 kernel: [62308.584530] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 22:42:14 juju-e4d256-prod-github-runner-207 kernel: [62308.585599] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 22:42:14 juju-e4d256-prod-github-runner-207 kernel: [62308.586645] Aug 22 22:42:14 juju-e4d256-prod-github-runner-207 kernel: [62308.587519] Aug 22 22:42:14 juju-e4d256-prod-github-runner-207 kernel: [62308.588376] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 22:42:14 juju-e4d256-prod-github-runner-207 kernel: [62308.589409] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:42:14 juju-e4d256-prod-github-runner-207 kernel: [62308.590490] ? _raw_spin_lock+0x22/0x30 Aug 22 22:42:14 juju-e4d256-prod-github-runner-207 kernel: [62308.591436] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:42:14 juju-e4d256-prod-github-runner-207 kernel: [62308.592460] direct_page_fault+0x206/0x310 [kvm] Aug 22 22:42:14 juju-e4d256-prod-github-runner-207 kernel: [62308.593490] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 22:42:14 juju-e4d256-prod-github-runner-207 kernel: [62308.594496] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 22:42:14 juju-e4d256-prod-github-runner-207 kernel: [62308.595496] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 22:42:14 juju-e4d256-prod-github-runner-207 kernel: [62308.596479] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 22:42:14 juju-e4d256-prod-github-runner-207 kernel: [62308.597430] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 22:42:14 juju-e4d256-prod-github-runner-207 kernel: [62308.598418] handle_exit+0x98/0x230 [kvm_amd] Aug 22 22:42:14 juju-e4d256-prod-github-runner-207 kernel: [62308.599337] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 22:42:14 juju-e4d256-prod-github-runner-207 kernel: [62308.600250] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 22:42:14 juju-e4d256-prod-github-runner-207 kernel: [62308.601190] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 22:42:14 juju-e4d256-prod-github-runner-207 kernel: [62308.602091] vcpu_run+0x62/0x2c0 [kvm] Aug 22 22:42:14 juju-e4d256-prod-github-runner-207 kernel: [62308.602899] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 22:42:14 juju-e4d256-prod-github-runner-207 kernel: [62308.603711] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 22:42:14 juju-e4d256-prod-github-runner-207 kernel: [62308.604573] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 22:42:14 juju-e4d256-prod-github-runner-207 kernel: [62308.605371] ? __seccomp_filter+0x4a/0x4a0 Aug 22 22:42:14 juju-e4d256-prod-github-runner-207 kernel: [62308.606118] ? __fget_files+0x86/0xc0 Aug 22 22:42:14 juju-e4d256-prod-github-runner-207 kernel: [62308.606833] __x64_sys_ioctl+0x95/0xd0 Aug 22 22:42:14 juju-e4d256-prod-github-runner-207 kernel: [62308.607524] do_syscall_64+0x5c/0xc0 Aug 22 22:42:14 juju-e4d256-prod-github-runner-207 kernel: [62308.608192] ? do_futex+0x162/0x1f0 Aug 22 22:42:14 juju-e4d256-prod-github-runner-207 kernel: [62308.608862] ? __x64_sys_futex+0x78/0x1e0 Aug 22 22:42:14 juju-e4d256-prod-github-runner-207 kernel: [62308.609545] ? __secure_computing+0xa9/0x120 Aug 22 22:42:14 juju-e4d256-prod-github-runner-207 kernel: [62308.610248] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 22:42:14 juju-e4d256-prod-github-runner-207 kernel: [62308.611016] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:42:14 juju-e4d256-prod-github-runner-207 kernel: [62308.611749] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:42:14 juju-e4d256-prod-github-runner-207 kernel: [62308.612480] ? do_syscall_64+0x69/0xc0 Aug 22 22:42:14 juju-e4d256-prod-github-runner-207 kernel: [62308.613141] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:42:14 juju-e4d256-prod-github-runner-207 kernel: [62308.613853] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:42:14 juju-e4d256-prod-github-runner-207 kernel: [62308.614593] ? do_syscall_64+0x69/0xc0 Aug 22 22:42:14 juju-e4d256-prod-github-runner-207 kernel: [62308.615235] ? do_syscall_64+0x69/0xc0 Aug 22 22:42:14 juju-e4d256-prod-github-runner-207 kernel: [62308.615864] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 22:42:14 juju-e4d256-prod-github-runner-207 kernel: [62308.616582] RIP: 0033:0x7faa5d0edaff Aug 22 22:42:14 juju-e4d256-prod-github-runner-207 kernel: [62308.617240] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 22:42:14 juju-e4d256-prod-github-runner-207 kernel: [62308.619239] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 22:42:14 juju-e4d256-prod-github-runner-207 kernel: [62308.620161] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 22:42:14 juju-e4d256-prod-github-runner-207 kernel: [62308.621080] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 22:42:14 juju-e4d256-prod-github-runner-207 kernel: [62308.621975] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 22:42:14 juju-e4d256-prod-github-runner-207 kernel: [62308.622867] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 22:42:14 juju-e4d256-prod-github-runner-207 kernel: [62308.623758] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 22:42:14 juju-e4d256-prod-github-runner-207 kernel: [62308.624662] Aug 22 22:42:42 juju-e4d256-prod-github-runner-207 kernel: [62336.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 57947s! [qemu-system-x86:6715] Aug 22 22:42:42 juju-e4d256-prod-github-runner-207 kernel: [62336.543891] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 22:42:42 juju-e4d256-prod-github-runner-207 kernel: [62336.544211] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 22:42:42 juju-e4d256-prod-github-runner-207 kernel: [62336.557023] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 22:42:42 juju-e4d256-prod-github-runner-207 kernel: [62336.558292] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 22:42:42 juju-e4d256-prod-github-runner-207 kernel: [62336.559582] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:42:42 juju-e4d256-prod-github-runner-207 kernel: [62336.560716] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 22:42:42 juju-e4d256-prod-github-runner-207 kernel: [62336.563284] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 22:42:42 juju-e4d256-prod-github-runner-207 kernel: [62336.564371] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 22:42:42 juju-e4d256-prod-github-runner-207 kernel: [62336.565559] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 22:42:42 juju-e4d256-prod-github-runner-207 kernel: [62336.566790] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 22:42:42 juju-e4d256-prod-github-runner-207 kernel: [62336.568012] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 22:42:42 juju-e4d256-prod-github-runner-207 kernel: [62336.569178] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 22:42:42 juju-e4d256-prod-github-runner-207 kernel: [62336.570378] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 22:42:42 juju-e4d256-prod-github-runner-207 kernel: [62336.571633] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 22:42:42 juju-e4d256-prod-github-runner-207 kernel: [62336.572750] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 22:42:42 juju-e4d256-prod-github-runner-207 kernel: [62336.573944] Call Trace: Aug 22 22:42:42 juju-e4d256-prod-github-runner-207 kernel: [62336.574891] Aug 22 22:42:42 juju-e4d256-prod-github-runner-207 kernel: [62336.575822] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:42:42 juju-e4d256-prod-github-runner-207 kernel: [62336.576875] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:42:42 juju-e4d256-prod-github-runner-207 kernel: [62336.577902] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:42:42 juju-e4d256-prod-github-runner-207 kernel: [62336.579000] ? show_regs.part.0+0x23/0x29 Aug 22 22:42:42 juju-e4d256-prod-github-runner-207 kernel: [62336.580053] ? show_regs.cold+0x8/0xd Aug 22 22:42:42 juju-e4d256-prod-github-runner-207 kernel: [62336.581113] ? watchdog_timer_fn+0x1be/0x220 Aug 22 22:42:42 juju-e4d256-prod-github-runner-207 kernel: [62336.582135] ? lockup_detector_update_enable+0x60/0x60 Aug 22 22:42:42 juju-e4d256-prod-github-runner-207 kernel: [62336.583268] ? __hrtimer_run_queues+0x107/0x230 Aug 22 22:42:42 juju-e4d256-prod-github-runner-207 kernel: [62336.584320] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 22:42:42 juju-e4d256-prod-github-runner-207 kernel: [62336.585363] ? hrtimer_interrupt+0x101/0x220 Aug 22 22:42:42 juju-e4d256-prod-github-runner-207 kernel: [62336.586401] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 22:42:42 juju-e4d256-prod-github-runner-207 kernel: [62336.587476] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 22:42:42 juju-e4d256-prod-github-runner-207 kernel: [62336.588551] Aug 22 22:42:42 juju-e4d256-prod-github-runner-207 kernel: [62336.589406] Aug 22 22:42:42 juju-e4d256-prod-github-runner-207 kernel: [62336.590268] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 22:42:42 juju-e4d256-prod-github-runner-207 kernel: [62336.591343] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:42:42 juju-e4d256-prod-github-runner-207 kernel: [62336.592403] ? _raw_spin_lock+0x22/0x30 Aug 22 22:42:42 juju-e4d256-prod-github-runner-207 kernel: [62336.593355] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:42:42 juju-e4d256-prod-github-runner-207 kernel: [62336.594387] direct_page_fault+0x206/0x310 [kvm] Aug 22 22:42:42 juju-e4d256-prod-github-runner-207 kernel: [62336.595424] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 22:42:42 juju-e4d256-prod-github-runner-207 kernel: [62336.596474] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 22:42:42 juju-e4d256-prod-github-runner-207 kernel: [62336.597553] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 22:42:42 juju-e4d256-prod-github-runner-207 kernel: [62336.598577] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 22:42:42 juju-e4d256-prod-github-runner-207 kernel: [62336.599524] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 22:42:42 juju-e4d256-prod-github-runner-207 kernel: [62336.600566] handle_exit+0x98/0x230 [kvm_amd] Aug 22 22:42:42 juju-e4d256-prod-github-runner-207 kernel: [62336.601511] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 22:42:42 juju-e4d256-prod-github-runner-207 kernel: [62336.602435] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 22:42:42 juju-e4d256-prod-github-runner-207 kernel: [62336.603379] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 22:42:42 juju-e4d256-prod-github-runner-207 kernel: [62336.604307] vcpu_run+0x62/0x2c0 [kvm] Aug 22 22:42:42 juju-e4d256-prod-github-runner-207 kernel: [62336.605123] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 22:42:42 juju-e4d256-prod-github-runner-207 kernel: [62336.605950] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 22:42:42 juju-e4d256-prod-github-runner-207 kernel: [62336.606832] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 22:42:42 juju-e4d256-prod-github-runner-207 kernel: [62336.607636] ? __seccomp_filter+0x4a/0x4a0 Aug 22 22:42:42 juju-e4d256-prod-github-runner-207 kernel: [62336.608397] ? __fget_files+0x86/0xc0 Aug 22 22:42:42 juju-e4d256-prod-github-runner-207 kernel: [62336.609105] __x64_sys_ioctl+0x95/0xd0 Aug 22 22:42:42 juju-e4d256-prod-github-runner-207 kernel: [62336.609804] do_syscall_64+0x5c/0xc0 Aug 22 22:42:42 juju-e4d256-prod-github-runner-207 kernel: [62336.610469] ? do_futex+0x162/0x1f0 Aug 22 22:42:42 juju-e4d256-prod-github-runner-207 kernel: [62336.611126] ? __x64_sys_futex+0x78/0x1e0 Aug 22 22:42:42 juju-e4d256-prod-github-runner-207 kernel: [62336.611830] ? __secure_computing+0xa9/0x120 Aug 22 22:42:42 juju-e4d256-prod-github-runner-207 kernel: [62336.612541] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 22:42:42 juju-e4d256-prod-github-runner-207 kernel: [62336.613305] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:42:42 juju-e4d256-prod-github-runner-207 kernel: [62336.614089] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:42:42 juju-e4d256-prod-github-runner-207 kernel: [62336.614877] ? do_syscall_64+0x69/0xc0 Aug 22 22:42:42 juju-e4d256-prod-github-runner-207 kernel: [62336.615525] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:42:42 juju-e4d256-prod-github-runner-207 kernel: [62336.616273] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:42:42 juju-e4d256-prod-github-runner-207 kernel: [62336.616992] ? do_syscall_64+0x69/0xc0 Aug 22 22:42:42 juju-e4d256-prod-github-runner-207 kernel: [62336.617626] ? do_syscall_64+0x69/0xc0 Aug 22 22:42:42 juju-e4d256-prod-github-runner-207 kernel: [62336.618348] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 22:42:42 juju-e4d256-prod-github-runner-207 kernel: [62336.619104] RIP: 0033:0x7faa5d0edaff Aug 22 22:42:42 juju-e4d256-prod-github-runner-207 kernel: [62336.619765] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 22:42:42 juju-e4d256-prod-github-runner-207 kernel: [62336.621893] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 22:42:42 juju-e4d256-prod-github-runner-207 kernel: [62336.622870] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 22:42:42 juju-e4d256-prod-github-runner-207 kernel: [62336.623771] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 22:42:42 juju-e4d256-prod-github-runner-207 kernel: [62336.624679] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 22:42:42 juju-e4d256-prod-github-runner-207 kernel: [62336.625569] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 22:42:42 juju-e4d256-prod-github-runner-207 kernel: [62336.626488] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 22:42:42 juju-e4d256-prod-github-runner-207 kernel: [62336.627435] Aug 22 22:43:10 juju-e4d256-prod-github-runner-207 kernel: [62364.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 57973s! [qemu-system-x86:6715] Aug 22 22:43:10 juju-e4d256-prod-github-runner-207 kernel: [62364.543115] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 22:43:10 juju-e4d256-prod-github-runner-207 kernel: [62364.543191] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 22:43:10 juju-e4d256-prod-github-runner-207 kernel: [62364.555355] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 22:43:10 juju-e4d256-prod-github-runner-207 kernel: [62364.556652] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 22:43:10 juju-e4d256-prod-github-runner-207 kernel: [62364.557922] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:43:10 juju-e4d256-prod-github-runner-207 kernel: [62364.558987] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 22:43:10 juju-e4d256-prod-github-runner-207 kernel: [62364.561758] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 22:43:10 juju-e4d256-prod-github-runner-207 kernel: [62364.562805] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 22:43:10 juju-e4d256-prod-github-runner-207 kernel: [62364.563980] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 22:43:10 juju-e4d256-prod-github-runner-207 kernel: [62364.565142] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 22:43:10 juju-e4d256-prod-github-runner-207 kernel: [62364.566304] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 22:43:10 juju-e4d256-prod-github-runner-207 kernel: [62364.567513] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 22:43:10 juju-e4d256-prod-github-runner-207 kernel: [62364.568701] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 22:43:10 juju-e4d256-prod-github-runner-207 kernel: [62364.569940] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 22:43:10 juju-e4d256-prod-github-runner-207 kernel: [62364.571037] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 22:43:10 juju-e4d256-prod-github-runner-207 kernel: [62364.572244] Call Trace: Aug 22 22:43:10 juju-e4d256-prod-github-runner-207 kernel: [62364.573177] Aug 22 22:43:10 juju-e4d256-prod-github-runner-207 kernel: [62364.574075] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:43:10 juju-e4d256-prod-github-runner-207 kernel: [62364.575106] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:43:10 juju-e4d256-prod-github-runner-207 kernel: [62364.576145] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:43:10 juju-e4d256-prod-github-runner-207 kernel: [62364.577223] ? show_regs.part.0+0x23/0x29 Aug 22 22:43:10 juju-e4d256-prod-github-runner-207 kernel: [62364.578226] ? show_regs.cold+0x8/0xd Aug 22 22:43:10 juju-e4d256-prod-github-runner-207 kernel: [62364.579199] ? watchdog_timer_fn+0x1be/0x220 Aug 22 22:43:10 juju-e4d256-prod-github-runner-207 kernel: [62364.580219] ? lockup_detector_update_enable+0x60/0x60 Aug 22 22:43:10 juju-e4d256-prod-github-runner-207 kernel: [62364.581284] ? __hrtimer_run_queues+0x107/0x230 Aug 22 22:43:10 juju-e4d256-prod-github-runner-207 kernel: [62364.582317] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 22:43:10 juju-e4d256-prod-github-runner-207 kernel: [62364.583343] ? hrtimer_interrupt+0x101/0x220 Aug 22 22:43:10 juju-e4d256-prod-github-runner-207 kernel: [62364.584369] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 22:43:10 juju-e4d256-prod-github-runner-207 kernel: [62364.585439] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 22:43:10 juju-e4d256-prod-github-runner-207 kernel: [62364.586484] Aug 22 22:43:10 juju-e4d256-prod-github-runner-207 kernel: [62364.587337] Aug 22 22:43:10 juju-e4d256-prod-github-runner-207 kernel: [62364.588182] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 22:43:10 juju-e4d256-prod-github-runner-207 kernel: [62364.589218] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:43:10 juju-e4d256-prod-github-runner-207 kernel: [62364.590260] ? _raw_spin_lock+0x22/0x30 Aug 22 22:43:10 juju-e4d256-prod-github-runner-207 kernel: [62364.591209] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:43:10 juju-e4d256-prod-github-runner-207 kernel: [62364.592242] direct_page_fault+0x206/0x310 [kvm] Aug 22 22:43:10 juju-e4d256-prod-github-runner-207 kernel: [62364.593267] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 22:43:10 juju-e4d256-prod-github-runner-207 kernel: [62364.594286] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 22:43:10 juju-e4d256-prod-github-runner-207 kernel: [62364.595298] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 22:43:10 juju-e4d256-prod-github-runner-207 kernel: [62364.596280] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 22:43:10 juju-e4d256-prod-github-runner-207 kernel: [62364.597252] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 22:43:10 juju-e4d256-prod-github-runner-207 kernel: [62364.598324] handle_exit+0x98/0x230 [kvm_amd] Aug 22 22:43:10 juju-e4d256-prod-github-runner-207 kernel: [62364.599245] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 22:43:10 juju-e4d256-prod-github-runner-207 kernel: [62364.600185] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 22:43:10 juju-e4d256-prod-github-runner-207 kernel: [62364.601121] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 22:43:10 juju-e4d256-prod-github-runner-207 kernel: [62364.602027] vcpu_run+0x62/0x2c0 [kvm] Aug 22 22:43:10 juju-e4d256-prod-github-runner-207 kernel: [62364.602848] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 22:43:10 juju-e4d256-prod-github-runner-207 kernel: [62364.603686] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 22:43:10 juju-e4d256-prod-github-runner-207 kernel: [62364.604554] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 22:43:10 juju-e4d256-prod-github-runner-207 kernel: [62364.605355] ? __seccomp_filter+0x4a/0x4a0 Aug 22 22:43:10 juju-e4d256-prod-github-runner-207 kernel: [62364.606101] ? __fget_files+0x86/0xc0 Aug 22 22:43:10 juju-e4d256-prod-github-runner-207 kernel: [62364.606806] __x64_sys_ioctl+0x95/0xd0 Aug 22 22:43:10 juju-e4d256-prod-github-runner-207 kernel: [62364.607499] do_syscall_64+0x5c/0xc0 Aug 22 22:43:10 juju-e4d256-prod-github-runner-207 kernel: [62364.608195] ? do_futex+0x162/0x1f0 Aug 22 22:43:10 juju-e4d256-prod-github-runner-207 kernel: [62364.608849] ? __x64_sys_futex+0x78/0x1e0 Aug 22 22:43:10 juju-e4d256-prod-github-runner-207 kernel: [62364.609525] ? __secure_computing+0xa9/0x120 Aug 22 22:43:10 juju-e4d256-prod-github-runner-207 kernel: [62364.610223] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 22:43:10 juju-e4d256-prod-github-runner-207 kernel: [62364.610992] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:43:10 juju-e4d256-prod-github-runner-207 kernel: [62364.611724] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:43:10 juju-e4d256-prod-github-runner-207 kernel: [62364.612443] ? do_syscall_64+0x69/0xc0 Aug 22 22:43:10 juju-e4d256-prod-github-runner-207 kernel: [62364.613098] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:43:10 juju-e4d256-prod-github-runner-207 kernel: [62364.613809] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:43:10 juju-e4d256-prod-github-runner-207 kernel: [62364.614510] ? do_syscall_64+0x69/0xc0 Aug 22 22:43:10 juju-e4d256-prod-github-runner-207 kernel: [62364.615137] ? do_syscall_64+0x69/0xc0 Aug 22 22:43:10 juju-e4d256-prod-github-runner-207 kernel: [62364.615944] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 22:43:10 juju-e4d256-prod-github-runner-207 kernel: [62364.616769] RIP: 0033:0x7faa5d0edaff Aug 22 22:43:10 juju-e4d256-prod-github-runner-207 kernel: [62364.617473] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 22:43:10 juju-e4d256-prod-github-runner-207 kernel: [62364.619872] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 22:43:10 juju-e4d256-prod-github-runner-207 kernel: [62364.620940] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 22:43:10 juju-e4d256-prod-github-runner-207 kernel: [62364.621993] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 22:43:10 juju-e4d256-prod-github-runner-207 kernel: [62364.623055] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 22:43:10 juju-e4d256-prod-github-runner-207 kernel: [62364.624120] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 22:43:10 juju-e4d256-prod-github-runner-207 kernel: [62364.625156] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 22:43:10 juju-e4d256-prod-github-runner-207 kernel: [62364.626190] Aug 22 22:43:38 juju-e4d256-prod-github-runner-207 kernel: [62392.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 57999s! [qemu-system-x86:6715] Aug 22 22:43:38 juju-e4d256-prod-github-runner-207 kernel: [62392.543129] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 22:43:38 juju-e4d256-prod-github-runner-207 kernel: [62392.543204] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 22:43:38 juju-e4d256-prod-github-runner-207 kernel: [62392.555491] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 22:43:38 juju-e4d256-prod-github-runner-207 kernel: [62392.556763] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 22:43:38 juju-e4d256-prod-github-runner-207 kernel: [62392.558034] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:43:38 juju-e4d256-prod-github-runner-207 kernel: [62392.559100] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 22:43:38 juju-e4d256-prod-github-runner-207 kernel: [62392.561650] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 22:43:38 juju-e4d256-prod-github-runner-207 kernel: [62392.562691] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 22:43:38 juju-e4d256-prod-github-runner-207 kernel: [62392.563860] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 22:43:38 juju-e4d256-prod-github-runner-207 kernel: [62392.565024] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 22:43:38 juju-e4d256-prod-github-runner-207 kernel: [62392.566243] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 22:43:38 juju-e4d256-prod-github-runner-207 kernel: [62392.567430] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 22:43:38 juju-e4d256-prod-github-runner-207 kernel: [62392.568606] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 22:43:38 juju-e4d256-prod-github-runner-207 kernel: [62392.569844] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 22:43:38 juju-e4d256-prod-github-runner-207 kernel: [62392.570953] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 22:43:38 juju-e4d256-prod-github-runner-207 kernel: [62392.572163] Call Trace: Aug 22 22:43:38 juju-e4d256-prod-github-runner-207 kernel: [62392.573133] Aug 22 22:43:38 juju-e4d256-prod-github-runner-207 kernel: [62392.574038] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:43:38 juju-e4d256-prod-github-runner-207 kernel: [62392.575106] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:43:38 juju-e4d256-prod-github-runner-207 kernel: [62392.576167] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:43:38 juju-e4d256-prod-github-runner-207 kernel: [62392.577250] ? show_regs.part.0+0x23/0x29 Aug 22 22:43:38 juju-e4d256-prod-github-runner-207 kernel: [62392.578251] ? show_regs.cold+0x8/0xd Aug 22 22:43:38 juju-e4d256-prod-github-runner-207 kernel: [62392.579235] ? watchdog_timer_fn+0x1be/0x220 Aug 22 22:43:38 juju-e4d256-prod-github-runner-207 kernel: [62392.580258] ? lockup_detector_update_enable+0x60/0x60 Aug 22 22:43:38 juju-e4d256-prod-github-runner-207 kernel: [62392.581344] ? __hrtimer_run_queues+0x107/0x230 Aug 22 22:43:38 juju-e4d256-prod-github-runner-207 kernel: [62392.582551] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 22:43:38 juju-e4d256-prod-github-runner-207 kernel: [62392.583602] ? hrtimer_interrupt+0x101/0x220 Aug 22 22:43:38 juju-e4d256-prod-github-runner-207 kernel: [62392.584617] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 22:43:38 juju-e4d256-prod-github-runner-207 kernel: [62392.585687] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 22:43:38 juju-e4d256-prod-github-runner-207 kernel: [62392.586734] Aug 22 22:43:38 juju-e4d256-prod-github-runner-207 kernel: [62392.587618] Aug 22 22:43:38 juju-e4d256-prod-github-runner-207 kernel: [62392.588456] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 22:43:38 juju-e4d256-prod-github-runner-207 kernel: [62392.589506] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:43:38 juju-e4d256-prod-github-runner-207 kernel: [62392.590543] ? _raw_spin_lock+0x22/0x30 Aug 22 22:43:38 juju-e4d256-prod-github-runner-207 kernel: [62392.591526] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:43:38 juju-e4d256-prod-github-runner-207 kernel: [62392.592559] direct_page_fault+0x206/0x310 [kvm] Aug 22 22:43:38 juju-e4d256-prod-github-runner-207 kernel: [62392.593600] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 22:43:38 juju-e4d256-prod-github-runner-207 kernel: [62392.594631] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 22:43:38 juju-e4d256-prod-github-runner-207 kernel: [62392.595660] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 22:43:38 juju-e4d256-prod-github-runner-207 kernel: [62392.596632] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 22:43:38 juju-e4d256-prod-github-runner-207 kernel: [62392.597578] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 22:43:38 juju-e4d256-prod-github-runner-207 kernel: [62392.598565] handle_exit+0x98/0x230 [kvm_amd] Aug 22 22:43:38 juju-e4d256-prod-github-runner-207 kernel: [62392.599507] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 22:43:38 juju-e4d256-prod-github-runner-207 kernel: [62392.600421] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 22:43:38 juju-e4d256-prod-github-runner-207 kernel: [62392.601353] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 22:43:38 juju-e4d256-prod-github-runner-207 kernel: [62392.602267] vcpu_run+0x62/0x2c0 [kvm] Aug 22 22:43:38 juju-e4d256-prod-github-runner-207 kernel: [62392.603078] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 22:43:38 juju-e4d256-prod-github-runner-207 kernel: [62392.603919] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 22:43:38 juju-e4d256-prod-github-runner-207 kernel: [62392.604772] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 22:43:38 juju-e4d256-prod-github-runner-207 kernel: [62392.605569] ? __seccomp_filter+0x4a/0x4a0 Aug 22 22:43:38 juju-e4d256-prod-github-runner-207 kernel: [62392.606317] ? __fget_files+0x86/0xc0 Aug 22 22:43:38 juju-e4d256-prod-github-runner-207 kernel: [62392.607077] __x64_sys_ioctl+0x95/0xd0 Aug 22 22:43:38 juju-e4d256-prod-github-runner-207 kernel: [62392.607793] do_syscall_64+0x5c/0xc0 Aug 22 22:43:38 juju-e4d256-prod-github-runner-207 kernel: [62392.608486] ? do_futex+0x162/0x1f0 Aug 22 22:43:38 juju-e4d256-prod-github-runner-207 kernel: [62392.609144] ? __x64_sys_futex+0x78/0x1e0 Aug 22 22:43:38 juju-e4d256-prod-github-runner-207 kernel: [62392.609817] ? __secure_computing+0xa9/0x120 Aug 22 22:43:38 juju-e4d256-prod-github-runner-207 kernel: [62392.610504] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 22:43:38 juju-e4d256-prod-github-runner-207 kernel: [62392.611280] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:43:38 juju-e4d256-prod-github-runner-207 kernel: [62392.612003] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:43:38 juju-e4d256-prod-github-runner-207 kernel: [62392.612720] ? do_syscall_64+0x69/0xc0 Aug 22 22:43:38 juju-e4d256-prod-github-runner-207 kernel: [62392.613364] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:43:38 juju-e4d256-prod-github-runner-207 kernel: [62392.614066] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:43:38 juju-e4d256-prod-github-runner-207 kernel: [62392.614769] ? do_syscall_64+0x69/0xc0 Aug 22 22:43:38 juju-e4d256-prod-github-runner-207 kernel: [62392.615402] ? do_syscall_64+0x69/0xc0 Aug 22 22:43:38 juju-e4d256-prod-github-runner-207 kernel: [62392.616025] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 22:43:38 juju-e4d256-prod-github-runner-207 kernel: [62392.616735] RIP: 0033:0x7faa5d0edaff Aug 22 22:43:38 juju-e4d256-prod-github-runner-207 kernel: [62392.617356] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 22:43:38 juju-e4d256-prod-github-runner-207 kernel: [62392.619359] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 22:43:38 juju-e4d256-prod-github-runner-207 kernel: [62392.620282] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 22:43:38 juju-e4d256-prod-github-runner-207 kernel: [62392.621171] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 22:43:38 juju-e4d256-prod-github-runner-207 kernel: [62392.622060] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 22:43:38 juju-e4d256-prod-github-runner-207 kernel: [62392.622946] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 22:43:38 juju-e4d256-prod-github-runner-207 kernel: [62392.623867] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 22:43:38 juju-e4d256-prod-github-runner-207 kernel: [62392.624768] Aug 22 22:44:06 juju-e4d256-prod-github-runner-207 kernel: [62420.541982] watchdog: BUG: soft lockup - CPU#1 stuck for 58025s! [qemu-system-x86:6715] Aug 22 22:44:06 juju-e4d256-prod-github-runner-207 kernel: [62420.543939] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 22:44:06 juju-e4d256-prod-github-runner-207 kernel: [62420.544258] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 22:44:06 juju-e4d256-prod-github-runner-207 kernel: [62420.556591] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 22:44:06 juju-e4d256-prod-github-runner-207 kernel: [62420.557869] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 22:44:06 juju-e4d256-prod-github-runner-207 kernel: [62420.559132] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:44:06 juju-e4d256-prod-github-runner-207 kernel: [62420.560196] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 22:44:06 juju-e4d256-prod-github-runner-207 kernel: [62420.562752] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 22:44:06 juju-e4d256-prod-github-runner-207 kernel: [62420.563815] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 22:44:06 juju-e4d256-prod-github-runner-207 kernel: [62420.564977] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 22:44:06 juju-e4d256-prod-github-runner-207 kernel: [62420.566136] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 22:44:06 juju-e4d256-prod-github-runner-207 kernel: [62420.567309] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 22:44:06 juju-e4d256-prod-github-runner-207 kernel: [62420.568528] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 22:44:06 juju-e4d256-prod-github-runner-207 kernel: [62420.569706] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 22:44:06 juju-e4d256-prod-github-runner-207 kernel: [62420.570976] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 22:44:06 juju-e4d256-prod-github-runner-207 kernel: [62420.572078] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 22:44:06 juju-e4d256-prod-github-runner-207 kernel: [62420.573329] Call Trace: Aug 22 22:44:06 juju-e4d256-prod-github-runner-207 kernel: [62420.574254] Aug 22 22:44:06 juju-e4d256-prod-github-runner-207 kernel: [62420.575169] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:44:06 juju-e4d256-prod-github-runner-207 kernel: [62420.576201] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:44:06 juju-e4d256-prod-github-runner-207 kernel: [62420.577221] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:44:06 juju-e4d256-prod-github-runner-207 kernel: [62420.578327] ? show_regs.part.0+0x23/0x29 Aug 22 22:44:06 juju-e4d256-prod-github-runner-207 kernel: [62420.579353] ? show_regs.cold+0x8/0xd Aug 22 22:44:06 juju-e4d256-prod-github-runner-207 kernel: [62420.580492] ? watchdog_timer_fn+0x1be/0x220 Aug 22 22:44:06 juju-e4d256-prod-github-runner-207 kernel: [62420.581507] ? lockup_detector_update_enable+0x60/0x60 Aug 22 22:44:06 juju-e4d256-prod-github-runner-207 kernel: [62420.582575] ? __hrtimer_run_queues+0x107/0x230 Aug 22 22:44:06 juju-e4d256-prod-github-runner-207 kernel: [62420.583616] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 22:44:06 juju-e4d256-prod-github-runner-207 kernel: [62420.584640] ? hrtimer_interrupt+0x101/0x220 Aug 22 22:44:06 juju-e4d256-prod-github-runner-207 kernel: [62420.585656] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 22:44:06 juju-e4d256-prod-github-runner-207 kernel: [62420.586730] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 22:44:06 juju-e4d256-prod-github-runner-207 kernel: [62420.587783] Aug 22 22:44:06 juju-e4d256-prod-github-runner-207 kernel: [62420.588637] Aug 22 22:44:06 juju-e4d256-prod-github-runner-207 kernel: [62420.589475] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 22:44:06 juju-e4d256-prod-github-runner-207 kernel: [62420.590512] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:44:06 juju-e4d256-prod-github-runner-207 kernel: [62420.591566] ? _raw_spin_lock+0x22/0x30 Aug 22 22:44:06 juju-e4d256-prod-github-runner-207 kernel: [62420.592512] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:44:06 juju-e4d256-prod-github-runner-207 kernel: [62420.593533] direct_page_fault+0x206/0x310 [kvm] Aug 22 22:44:06 juju-e4d256-prod-github-runner-207 kernel: [62420.594570] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 22:44:06 juju-e4d256-prod-github-runner-207 kernel: [62420.595592] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 22:44:06 juju-e4d256-prod-github-runner-207 kernel: [62420.596604] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 22:44:06 juju-e4d256-prod-github-runner-207 kernel: [62420.597624] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 22:44:06 juju-e4d256-prod-github-runner-207 kernel: [62420.598569] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 22:44:06 juju-e4d256-prod-github-runner-207 kernel: [62420.599554] handle_exit+0x98/0x230 [kvm_amd] Aug 22 22:44:06 juju-e4d256-prod-github-runner-207 kernel: [62420.600446] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 22:44:06 juju-e4d256-prod-github-runner-207 kernel: [62420.601363] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 22:44:06 juju-e4d256-prod-github-runner-207 kernel: [62420.602286] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 22:44:06 juju-e4d256-prod-github-runner-207 kernel: [62420.603197] vcpu_run+0x62/0x2c0 [kvm] Aug 22 22:44:06 juju-e4d256-prod-github-runner-207 kernel: [62420.604013] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 22:44:06 juju-e4d256-prod-github-runner-207 kernel: [62420.604824] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 22:44:06 juju-e4d256-prod-github-runner-207 kernel: [62420.605678] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 22:44:06 juju-e4d256-prod-github-runner-207 kernel: [62420.606514] ? __seccomp_filter+0x4a/0x4a0 Aug 22 22:44:06 juju-e4d256-prod-github-runner-207 kernel: [62420.607270] ? __fget_files+0x86/0xc0 Aug 22 22:44:06 juju-e4d256-prod-github-runner-207 kernel: [62420.607988] __x64_sys_ioctl+0x95/0xd0 Aug 22 22:44:06 juju-e4d256-prod-github-runner-207 kernel: [62420.608686] do_syscall_64+0x5c/0xc0 Aug 22 22:44:06 juju-e4d256-prod-github-runner-207 kernel: [62420.609360] ? do_futex+0x162/0x1f0 Aug 22 22:44:06 juju-e4d256-prod-github-runner-207 kernel: [62420.610012] ? __x64_sys_futex+0x78/0x1e0 Aug 22 22:44:06 juju-e4d256-prod-github-runner-207 kernel: [62420.610691] ? __secure_computing+0xa9/0x120 Aug 22 22:44:06 juju-e4d256-prod-github-runner-207 kernel: [62420.611419] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 22:44:06 juju-e4d256-prod-github-runner-207 kernel: [62420.612184] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:44:06 juju-e4d256-prod-github-runner-207 kernel: [62420.612908] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:44:06 juju-e4d256-prod-github-runner-207 kernel: [62420.613639] ? do_syscall_64+0x69/0xc0 Aug 22 22:44:06 juju-e4d256-prod-github-runner-207 kernel: [62420.614291] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:44:06 juju-e4d256-prod-github-runner-207 kernel: [62420.615006] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:44:06 juju-e4d256-prod-github-runner-207 kernel: [62420.615703] ? do_syscall_64+0x69/0xc0 Aug 22 22:44:06 juju-e4d256-prod-github-runner-207 kernel: [62420.616335] ? do_syscall_64+0x69/0xc0 Aug 22 22:44:06 juju-e4d256-prod-github-runner-207 kernel: [62420.616964] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 22:44:06 juju-e4d256-prod-github-runner-207 kernel: [62420.617670] RIP: 0033:0x7faa5d0edaff Aug 22 22:44:06 juju-e4d256-prod-github-runner-207 kernel: [62420.618330] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 22:44:06 juju-e4d256-prod-github-runner-207 kernel: [62420.620340] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 22:44:06 juju-e4d256-prod-github-runner-207 kernel: [62420.621272] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 22:44:06 juju-e4d256-prod-github-runner-207 kernel: [62420.622166] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 22:44:06 juju-e4d256-prod-github-runner-207 kernel: [62420.623067] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 22:44:06 juju-e4d256-prod-github-runner-207 kernel: [62420.623966] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 22:44:06 juju-e4d256-prod-github-runner-207 kernel: [62420.624862] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 22:44:06 juju-e4d256-prod-github-runner-207 kernel: [62420.625754] Aug 22 22:44:34 juju-e4d256-prod-github-runner-207 kernel: [62448.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 58051s! [qemu-system-x86:6715] Aug 22 22:44:34 juju-e4d256-prod-github-runner-207 kernel: [62448.543154] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 22:44:34 juju-e4d256-prod-github-runner-207 kernel: [62448.543229] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 22:44:34 juju-e4d256-prod-github-runner-207 kernel: [62448.555786] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 22:44:34 juju-e4d256-prod-github-runner-207 kernel: [62448.557083] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 22:44:34 juju-e4d256-prod-github-runner-207 kernel: [62448.558348] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:44:34 juju-e4d256-prod-github-runner-207 kernel: [62448.559467] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 22:44:34 juju-e4d256-prod-github-runner-207 kernel: [62448.562035] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 22:44:34 juju-e4d256-prod-github-runner-207 kernel: [62448.563166] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 22:44:34 juju-e4d256-prod-github-runner-207 kernel: [62448.564371] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 22:44:34 juju-e4d256-prod-github-runner-207 kernel: [62448.565583] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 22:44:34 juju-e4d256-prod-github-runner-207 kernel: [62448.566784] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 22:44:34 juju-e4d256-prod-github-runner-207 kernel: [62448.568030] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 22:44:34 juju-e4d256-prod-github-runner-207 kernel: [62448.569234] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 22:44:34 juju-e4d256-prod-github-runner-207 kernel: [62448.570500] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 22:44:34 juju-e4d256-prod-github-runner-207 kernel: [62448.571627] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 22:44:34 juju-e4d256-prod-github-runner-207 kernel: [62448.572846] Call Trace: Aug 22 22:44:34 juju-e4d256-prod-github-runner-207 kernel: [62448.573764] Aug 22 22:44:34 juju-e4d256-prod-github-runner-207 kernel: [62448.574730] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:44:34 juju-e4d256-prod-github-runner-207 kernel: [62448.575901] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:44:34 juju-e4d256-prod-github-runner-207 kernel: [62448.576941] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:44:34 juju-e4d256-prod-github-runner-207 kernel: [62448.578136] ? show_regs.part.0+0x23/0x29 Aug 22 22:44:34 juju-e4d256-prod-github-runner-207 kernel: [62448.579196] ? show_regs.cold+0x8/0xd Aug 22 22:44:34 juju-e4d256-prod-github-runner-207 kernel: [62448.580171] ? watchdog_timer_fn+0x1be/0x220 Aug 22 22:44:34 juju-e4d256-prod-github-runner-207 kernel: [62448.581180] ? lockup_detector_update_enable+0x60/0x60 Aug 22 22:44:34 juju-e4d256-prod-github-runner-207 kernel: [62448.582263] ? __hrtimer_run_queues+0x107/0x230 Aug 22 22:44:34 juju-e4d256-prod-github-runner-207 kernel: [62448.583305] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 22:44:34 juju-e4d256-prod-github-runner-207 kernel: [62448.584341] ? hrtimer_interrupt+0x101/0x220 Aug 22 22:44:34 juju-e4d256-prod-github-runner-207 kernel: [62448.585362] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 22:44:34 juju-e4d256-prod-github-runner-207 kernel: [62448.586432] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 22:44:34 juju-e4d256-prod-github-runner-207 kernel: [62448.587495] Aug 22 22:44:34 juju-e4d256-prod-github-runner-207 kernel: [62448.588350] Aug 22 22:44:34 juju-e4d256-prod-github-runner-207 kernel: [62448.589194] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 22:44:34 juju-e4d256-prod-github-runner-207 kernel: [62448.590228] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:44:34 juju-e4d256-prod-github-runner-207 kernel: [62448.591276] ? _raw_spin_lock+0x22/0x30 Aug 22 22:44:34 juju-e4d256-prod-github-runner-207 kernel: [62448.592230] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:44:34 juju-e4d256-prod-github-runner-207 kernel: [62448.593254] direct_page_fault+0x206/0x310 [kvm] Aug 22 22:44:34 juju-e4d256-prod-github-runner-207 kernel: [62448.594321] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 22:44:34 juju-e4d256-prod-github-runner-207 kernel: [62448.595378] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 22:44:34 juju-e4d256-prod-github-runner-207 kernel: [62448.596387] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 22:44:34 juju-e4d256-prod-github-runner-207 kernel: [62448.597362] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 22:44:34 juju-e4d256-prod-github-runner-207 kernel: [62448.598311] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 22:44:34 juju-e4d256-prod-github-runner-207 kernel: [62448.599311] handle_exit+0x98/0x230 [kvm_amd] Aug 22 22:44:34 juju-e4d256-prod-github-runner-207 kernel: [62448.600214] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 22:44:34 juju-e4d256-prod-github-runner-207 kernel: [62448.601130] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 22:44:34 juju-e4d256-prod-github-runner-207 kernel: [62448.602056] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 22:44:34 juju-e4d256-prod-github-runner-207 kernel: [62448.602972] vcpu_run+0x62/0x2c0 [kvm] Aug 22 22:44:34 juju-e4d256-prod-github-runner-207 kernel: [62448.603785] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 22:44:34 juju-e4d256-prod-github-runner-207 kernel: [62448.604602] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 22:44:34 juju-e4d256-prod-github-runner-207 kernel: [62448.605463] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 22:44:34 juju-e4d256-prod-github-runner-207 kernel: [62448.606261] ? __seccomp_filter+0x4a/0x4a0 Aug 22 22:44:34 juju-e4d256-prod-github-runner-207 kernel: [62448.607014] ? __fget_files+0x86/0xc0 Aug 22 22:44:34 juju-e4d256-prod-github-runner-207 kernel: [62448.607721] __x64_sys_ioctl+0x95/0xd0 Aug 22 22:44:34 juju-e4d256-prod-github-runner-207 kernel: [62448.608423] do_syscall_64+0x5c/0xc0 Aug 22 22:44:34 juju-e4d256-prod-github-runner-207 kernel: [62448.609089] ? do_futex+0x162/0x1f0 Aug 22 22:44:34 juju-e4d256-prod-github-runner-207 kernel: [62448.609739] ? __x64_sys_futex+0x78/0x1e0 Aug 22 22:44:34 juju-e4d256-prod-github-runner-207 kernel: [62448.610412] ? __secure_computing+0xa9/0x120 Aug 22 22:44:34 juju-e4d256-prod-github-runner-207 kernel: [62448.611116] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 22:44:34 juju-e4d256-prod-github-runner-207 kernel: [62448.611875] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:44:34 juju-e4d256-prod-github-runner-207 kernel: [62448.612598] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:44:34 juju-e4d256-prod-github-runner-207 kernel: [62448.613315] ? do_syscall_64+0x69/0xc0 Aug 22 22:44:34 juju-e4d256-prod-github-runner-207 kernel: [62448.613972] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:44:34 juju-e4d256-prod-github-runner-207 kernel: [62448.614700] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:44:34 juju-e4d256-prod-github-runner-207 kernel: [62448.615399] ? do_syscall_64+0x69/0xc0 Aug 22 22:44:34 juju-e4d256-prod-github-runner-207 kernel: [62448.616024] ? do_syscall_64+0x69/0xc0 Aug 22 22:44:34 juju-e4d256-prod-github-runner-207 kernel: [62448.616646] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 22:44:34 juju-e4d256-prod-github-runner-207 kernel: [62448.617393] RIP: 0033:0x7faa5d0edaff Aug 22 22:44:34 juju-e4d256-prod-github-runner-207 kernel: [62448.618088] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 22:44:34 juju-e4d256-prod-github-runner-207 kernel: [62448.620096] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 22:44:34 juju-e4d256-prod-github-runner-207 kernel: [62448.621008] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 22:44:34 juju-e4d256-prod-github-runner-207 kernel: [62448.621909] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 22:44:34 juju-e4d256-prod-github-runner-207 kernel: [62448.622818] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 22:44:34 juju-e4d256-prod-github-runner-207 kernel: [62448.623708] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 22:44:34 juju-e4d256-prod-github-runner-207 kernel: [62448.624598] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 22:44:34 juju-e4d256-prod-github-runner-207 kernel: [62448.625492] Aug 22 22:44:47 juju-e4d256-prod-github-runner-207 kernel: [62461.352710] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 22:44:47 juju-e4d256-prod-github-runner-207 kernel: [62461.353695] rcu: 1-....: (15536902 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=7502000 Aug 22 22:44:47 juju-e4d256-prod-github-runner-207 kernel: [62461.354845] (t=15586038 jiffies g=23269 q=55508) Aug 22 22:44:47 juju-e4d256-prod-github-runner-207 kernel: [62461.355634] NMI backtrace for cpu 1 Aug 22 22:44:47 juju-e4d256-prod-github-runner-207 kernel: [62461.356342] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 22:44:47 juju-e4d256-prod-github-runner-207 kernel: [62461.357455] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 22:44:47 juju-e4d256-prod-github-runner-207 kernel: [62461.358531] Call Trace: Aug 22 22:44:47 juju-e4d256-prod-github-runner-207 kernel: [62461.359215] Aug 22 22:44:47 juju-e4d256-prod-github-runner-207 kernel: [62461.359885] show_stack+0x52/0x5c Aug 22 22:44:47 juju-e4d256-prod-github-runner-207 kernel: [62461.360609] dump_stack_lvl+0x4a/0x63 Aug 22 22:44:47 juju-e4d256-prod-github-runner-207 kernel: [62461.361366] dump_stack+0x10/0x16 Aug 22 22:44:47 juju-e4d256-prod-github-runner-207 kernel: [62461.362091] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 22:44:47 juju-e4d256-prod-github-runner-207 kernel: [62461.362883] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 22:44:47 juju-e4d256-prod-github-runner-207 kernel: [62461.363667] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 22:44:47 juju-e4d256-prod-github-runner-207 kernel: [62461.364488] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 22:44:47 juju-e4d256-prod-github-runner-207 kernel: [62461.365311] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 22:44:47 juju-e4d256-prod-github-runner-207 kernel: [62461.366125] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 22:44:47 juju-e4d256-prod-github-runner-207 kernel: [62461.366977] print_cpu_stall.cold+0x2f/0xe2 Aug 22 22:44:47 juju-e4d256-prod-github-runner-207 kernel: [62461.367772] ? timekeeping_update+0xf7/0x150 Aug 22 22:44:47 juju-e4d256-prod-github-runner-207 kernel: [62461.368540] check_cpu_stall+0x109/0x270 Aug 22 22:44:47 juju-e4d256-prod-github-runner-207 kernel: [62461.369290] rcu_sched_clock_irq+0x9a/0x250 Aug 22 22:44:47 juju-e4d256-prod-github-runner-207 kernel: [62461.370048] update_process_times+0x94/0xd0 Aug 22 22:44:47 juju-e4d256-prod-github-runner-207 kernel: [62461.370817] tick_sched_handle+0x29/0x70 Aug 22 22:44:47 juju-e4d256-prod-github-runner-207 kernel: [62461.371561] tick_sched_timer+0x8c/0xc0 Aug 22 22:44:47 juju-e4d256-prod-github-runner-207 kernel: [62461.372294] ? tick_nohz_handler+0xb0/0xb0 Aug 22 22:44:47 juju-e4d256-prod-github-runner-207 kernel: [62461.373046] __hrtimer_run_queues+0x107/0x230 Aug 22 22:44:47 juju-e4d256-prod-github-runner-207 kernel: [62461.373821] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 22:44:47 juju-e4d256-prod-github-runner-207 kernel: [62461.374608] hrtimer_interrupt+0x101/0x220 Aug 22 22:44:47 juju-e4d256-prod-github-runner-207 kernel: [62461.375366] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 22:44:47 juju-e4d256-prod-github-runner-207 kernel: [62461.376176] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 22:44:47 juju-e4d256-prod-github-runner-207 kernel: [62461.376989] Aug 22 22:44:47 juju-e4d256-prod-github-runner-207 kernel: [62461.377624] Aug 22 22:44:47 juju-e4d256-prod-github-runner-207 kernel: [62461.378252] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 22:44:47 juju-e4d256-prod-github-runner-207 kernel: [62461.379084] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:44:47 juju-e4d256-prod-github-runner-207 kernel: [62461.379960] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 22:44:47 juju-e4d256-prod-github-runner-207 kernel: [62461.382155] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 22:44:47 juju-e4d256-prod-github-runner-207 kernel: [62461.383034] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 22:44:47 juju-e4d256-prod-github-runner-207 kernel: [62461.384026] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 22:44:47 juju-e4d256-prod-github-runner-207 kernel: [62461.385000] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 22:44:47 juju-e4d256-prod-github-runner-207 kernel: [62461.385958] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 22:44:47 juju-e4d256-prod-github-runner-207 kernel: [62461.386913] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 22:44:47 juju-e4d256-prod-github-runner-207 kernel: [62461.387858] ? _raw_spin_lock+0x22/0x30 Aug 22 22:44:47 juju-e4d256-prod-github-runner-207 kernel: [62461.388618] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:44:47 juju-e4d256-prod-github-runner-207 kernel: [62461.389457] direct_page_fault+0x206/0x310 [kvm] Aug 22 22:44:47 juju-e4d256-prod-github-runner-207 kernel: [62461.390307] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 22:44:47 juju-e4d256-prod-github-runner-207 kernel: [62461.391150] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 22:44:47 juju-e4d256-prod-github-runner-207 kernel: [62461.392154] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 22:44:47 juju-e4d256-prod-github-runner-207 kernel: [62461.392954] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 22:44:47 juju-e4d256-prod-github-runner-207 kernel: [62461.393735] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 22:44:47 juju-e4d256-prod-github-runner-207 kernel: [62461.394561] handle_exit+0x98/0x230 [kvm_amd] Aug 22 22:44:47 juju-e4d256-prod-github-runner-207 kernel: [62461.395314] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 22:44:47 juju-e4d256-prod-github-runner-207 kernel: [62461.396251] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 22:44:47 juju-e4d256-prod-github-runner-207 kernel: [62461.397048] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 22:44:47 juju-e4d256-prod-github-runner-207 kernel: [62461.397851] vcpu_run+0x62/0x2c0 [kvm] Aug 22 22:44:47 juju-e4d256-prod-github-runner-207 kernel: [62461.398594] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 22:44:47 juju-e4d256-prod-github-runner-207 kernel: [62461.399336] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 22:44:47 juju-e4d256-prod-github-runner-207 kernel: [62461.400134] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 22:44:47 juju-e4d256-prod-github-runner-207 kernel: [62461.400898] ? __seccomp_filter+0x4a/0x4a0 Aug 22 22:44:47 juju-e4d256-prod-github-runner-207 kernel: [62461.401689] ? __fget_files+0x86/0xc0 Aug 22 22:44:47 juju-e4d256-prod-github-runner-207 kernel: [62461.402410] __x64_sys_ioctl+0x95/0xd0 Aug 22 22:44:47 juju-e4d256-prod-github-runner-207 kernel: [62461.403107] do_syscall_64+0x5c/0xc0 Aug 22 22:44:47 juju-e4d256-prod-github-runner-207 kernel: [62461.403788] ? do_futex+0x162/0x1f0 Aug 22 22:44:47 juju-e4d256-prod-github-runner-207 kernel: [62461.404459] ? __x64_sys_futex+0x78/0x1e0 Aug 22 22:44:47 juju-e4d256-prod-github-runner-207 kernel: [62461.405158] ? __secure_computing+0xa9/0x120 Aug 22 22:44:47 juju-e4d256-prod-github-runner-207 kernel: [62461.405874] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 22:44:47 juju-e4d256-prod-github-runner-207 kernel: [62461.406672] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:44:47 juju-e4d256-prod-github-runner-207 kernel: [62461.407426] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:44:47 juju-e4d256-prod-github-runner-207 kernel: [62461.408181] ? do_syscall_64+0x69/0xc0 Aug 22 22:44:47 juju-e4d256-prod-github-runner-207 kernel: [62461.408869] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:44:47 juju-e4d256-prod-github-runner-207 kernel: [62461.409622] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:44:47 juju-e4d256-prod-github-runner-207 kernel: [62461.410377] ? do_syscall_64+0x69/0xc0 Aug 22 22:44:47 juju-e4d256-prod-github-runner-207 kernel: [62461.411081] ? do_syscall_64+0x69/0xc0 Aug 22 22:44:47 juju-e4d256-prod-github-runner-207 kernel: [62461.411765] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 22:44:47 juju-e4d256-prod-github-runner-207 kernel: [62461.412532] RIP: 0033:0x7faa5d0edaff Aug 22 22:44:47 juju-e4d256-prod-github-runner-207 kernel: [62461.413217] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 22:44:47 juju-e4d256-prod-github-runner-207 kernel: [62461.415310] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 22:44:47 juju-e4d256-prod-github-runner-207 kernel: [62461.416298] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 22:44:47 juju-e4d256-prod-github-runner-207 kernel: [62461.417247] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 22:44:47 juju-e4d256-prod-github-runner-207 kernel: [62461.418196] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 22:44:47 juju-e4d256-prod-github-runner-207 kernel: [62461.419152] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 22:44:47 juju-e4d256-prod-github-runner-207 kernel: [62461.420083] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 22:44:47 juju-e4d256-prod-github-runner-207 kernel: [62461.420998] Aug 22 22:45:14 juju-e4d256-prod-github-runner-207 kernel: [62488.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 58088s! [qemu-system-x86:6715] Aug 22 22:45:14 juju-e4d256-prod-github-runner-207 kernel: [62488.543122] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 22:45:14 juju-e4d256-prod-github-runner-207 kernel: [62488.543197] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 22:45:14 juju-e4d256-prod-github-runner-207 kernel: [62488.555369] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 22:45:14 juju-e4d256-prod-github-runner-207 kernel: [62488.556769] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 22:45:14 juju-e4d256-prod-github-runner-207 kernel: [62488.557991] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:45:14 juju-e4d256-prod-github-runner-207 kernel: [62488.559060] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 22:45:14 juju-e4d256-prod-github-runner-207 kernel: [62488.561609] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 22:45:14 juju-e4d256-prod-github-runner-207 kernel: [62488.562683] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 22:45:14 juju-e4d256-prod-github-runner-207 kernel: [62488.563850] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 22:45:14 juju-e4d256-prod-github-runner-207 kernel: [62488.565051] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 22:45:14 juju-e4d256-prod-github-runner-207 kernel: [62488.566268] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 22:45:14 juju-e4d256-prod-github-runner-207 kernel: [62488.567506] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 22:45:14 juju-e4d256-prod-github-runner-207 kernel: [62488.568674] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 22:45:14 juju-e4d256-prod-github-runner-207 kernel: [62488.569908] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 22:45:14 juju-e4d256-prod-github-runner-207 kernel: [62488.571019] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 22:45:14 juju-e4d256-prod-github-runner-207 kernel: [62488.572210] Call Trace: Aug 22 22:45:14 juju-e4d256-prod-github-runner-207 kernel: [62488.573120] Aug 22 22:45:14 juju-e4d256-prod-github-runner-207 kernel: [62488.574002] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:45:14 juju-e4d256-prod-github-runner-207 kernel: [62488.575038] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:45:14 juju-e4d256-prod-github-runner-207 kernel: [62488.576056] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:45:14 juju-e4d256-prod-github-runner-207 kernel: [62488.577149] ? show_regs.part.0+0x23/0x29 Aug 22 22:45:14 juju-e4d256-prod-github-runner-207 kernel: [62488.578172] ? show_regs.cold+0x8/0xd Aug 22 22:45:14 juju-e4d256-prod-github-runner-207 kernel: [62488.579152] ? watchdog_timer_fn+0x1be/0x220 Aug 22 22:45:14 juju-e4d256-prod-github-runner-207 kernel: [62488.580162] ? lockup_detector_update_enable+0x60/0x60 Aug 22 22:45:14 juju-e4d256-prod-github-runner-207 kernel: [62488.581226] ? __hrtimer_run_queues+0x107/0x230 Aug 22 22:45:14 juju-e4d256-prod-github-runner-207 kernel: [62488.582269] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 22:45:14 juju-e4d256-prod-github-runner-207 kernel: [62488.583314] ? hrtimer_interrupt+0x101/0x220 Aug 22 22:45:14 juju-e4d256-prod-github-runner-207 kernel: [62488.584328] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 22:45:14 juju-e4d256-prod-github-runner-207 kernel: [62488.585395] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 22:45:14 juju-e4d256-prod-github-runner-207 kernel: [62488.586453] Aug 22 22:45:14 juju-e4d256-prod-github-runner-207 kernel: [62488.587305] Aug 22 22:45:14 juju-e4d256-prod-github-runner-207 kernel: [62488.588140] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 22:45:14 juju-e4d256-prod-github-runner-207 kernel: [62488.589169] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:45:14 juju-e4d256-prod-github-runner-207 kernel: [62488.590218] ? _raw_spin_lock+0x22/0x30 Aug 22 22:45:14 juju-e4d256-prod-github-runner-207 kernel: [62488.591163] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:45:14 juju-e4d256-prod-github-runner-207 kernel: [62488.592177] direct_page_fault+0x206/0x310 [kvm] Aug 22 22:45:14 juju-e4d256-prod-github-runner-207 kernel: [62488.593198] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 22:45:14 juju-e4d256-prod-github-runner-207 kernel: [62488.594233] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 22:45:14 juju-e4d256-prod-github-runner-207 kernel: [62488.595241] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 22:45:14 juju-e4d256-prod-github-runner-207 kernel: [62488.596209] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 22:45:14 juju-e4d256-prod-github-runner-207 kernel: [62488.597153] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 22:45:14 juju-e4d256-prod-github-runner-207 kernel: [62488.598138] handle_exit+0x98/0x230 [kvm_amd] Aug 22 22:45:14 juju-e4d256-prod-github-runner-207 kernel: [62488.599034] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 22:45:14 juju-e4d256-prod-github-runner-207 kernel: [62488.599945] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 22:45:14 juju-e4d256-prod-github-runner-207 kernel: [62488.600866] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 22:45:14 juju-e4d256-prod-github-runner-207 kernel: [62488.601785] vcpu_run+0x62/0x2c0 [kvm] Aug 22 22:45:14 juju-e4d256-prod-github-runner-207 kernel: [62488.602625] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 22:45:14 juju-e4d256-prod-github-runner-207 kernel: [62488.603431] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 22:45:14 juju-e4d256-prod-github-runner-207 kernel: [62488.604282] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 22:45:14 juju-e4d256-prod-github-runner-207 kernel: [62488.605078] ? __seccomp_filter+0x4a/0x4a0 Aug 22 22:45:14 juju-e4d256-prod-github-runner-207 kernel: [62488.605819] ? __fget_files+0x86/0xc0 Aug 22 22:45:14 juju-e4d256-prod-github-runner-207 kernel: [62488.606529] __x64_sys_ioctl+0x95/0xd0 Aug 22 22:45:14 juju-e4d256-prod-github-runner-207 kernel: [62488.607220] do_syscall_64+0x5c/0xc0 Aug 22 22:45:14 juju-e4d256-prod-github-runner-207 kernel: [62488.607882] ? do_futex+0x162/0x1f0 Aug 22 22:45:14 juju-e4d256-prod-github-runner-207 kernel: [62488.608535] ? __x64_sys_futex+0x78/0x1e0 Aug 22 22:45:14 juju-e4d256-prod-github-runner-207 kernel: [62488.609207] ? __secure_computing+0xa9/0x120 Aug 22 22:45:14 juju-e4d256-prod-github-runner-207 kernel: [62488.609895] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 22:45:14 juju-e4d256-prod-github-runner-207 kernel: [62488.610660] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:45:14 juju-e4d256-prod-github-runner-207 kernel: [62488.611383] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:45:14 juju-e4d256-prod-github-runner-207 kernel: [62488.612100] ? do_syscall_64+0x69/0xc0 Aug 22 22:45:14 juju-e4d256-prod-github-runner-207 kernel: [62488.612748] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:45:14 juju-e4d256-prod-github-runner-207 kernel: [62488.613450] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:45:14 juju-e4d256-prod-github-runner-207 kernel: [62488.614149] ? do_syscall_64+0x69/0xc0 Aug 22 22:45:14 juju-e4d256-prod-github-runner-207 kernel: [62488.614779] ? do_syscall_64+0x69/0xc0 Aug 22 22:45:14 juju-e4d256-prod-github-runner-207 kernel: [62488.615400] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 22:45:14 juju-e4d256-prod-github-runner-207 kernel: [62488.616105] RIP: 0033:0x7faa5d0edaff Aug 22 22:45:14 juju-e4d256-prod-github-runner-207 kernel: [62488.616731] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 22:45:14 juju-e4d256-prod-github-runner-207 kernel: [62488.618792] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 22:45:14 juju-e4d256-prod-github-runner-207 kernel: [62488.619714] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 22:45:14 juju-e4d256-prod-github-runner-207 kernel: [62488.620602] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 22:45:14 juju-e4d256-prod-github-runner-207 kernel: [62488.621499] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 22:45:14 juju-e4d256-prod-github-runner-207 kernel: [62488.622399] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 22:45:14 juju-e4d256-prod-github-runner-207 kernel: [62488.623285] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 22:45:14 juju-e4d256-prod-github-runner-207 kernel: [62488.624175] Aug 22 22:45:42 juju-e4d256-prod-github-runner-207 kernel: [62516.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 58115s! [qemu-system-x86:6715] Aug 22 22:45:42 juju-e4d256-prod-github-runner-207 kernel: [62516.543872] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 22:45:42 juju-e4d256-prod-github-runner-207 kernel: [62516.544177] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 22:45:42 juju-e4d256-prod-github-runner-207 kernel: [62516.556272] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 22:45:42 juju-e4d256-prod-github-runner-207 kernel: [62516.557532] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 22:45:42 juju-e4d256-prod-github-runner-207 kernel: [62516.558764] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:45:42 juju-e4d256-prod-github-runner-207 kernel: [62516.559817] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 22:45:42 juju-e4d256-prod-github-runner-207 kernel: [62516.562385] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 22:45:42 juju-e4d256-prod-github-runner-207 kernel: [62516.563433] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 22:45:42 juju-e4d256-prod-github-runner-207 kernel: [62516.564591] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 22:45:42 juju-e4d256-prod-github-runner-207 kernel: [62516.565764] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 22:45:42 juju-e4d256-prod-github-runner-207 kernel: [62516.566922] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 22:45:42 juju-e4d256-prod-github-runner-207 kernel: [62516.568082] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 22:45:42 juju-e4d256-prod-github-runner-207 kernel: [62516.569250] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 22:45:42 juju-e4d256-prod-github-runner-207 kernel: [62516.570489] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 22:45:42 juju-e4d256-prod-github-runner-207 kernel: [62516.571589] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 22:45:42 juju-e4d256-prod-github-runner-207 kernel: [62516.572777] Call Trace: Aug 22 22:45:42 juju-e4d256-prod-github-runner-207 kernel: [62516.573723] Aug 22 22:45:42 juju-e4d256-prod-github-runner-207 kernel: [62516.574628] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:45:42 juju-e4d256-prod-github-runner-207 kernel: [62516.575653] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:45:42 juju-e4d256-prod-github-runner-207 kernel: [62516.576670] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:45:42 juju-e4d256-prod-github-runner-207 kernel: [62516.577786] ? show_regs.part.0+0x23/0x29 Aug 22 22:45:42 juju-e4d256-prod-github-runner-207 kernel: [62516.578781] ? show_regs.cold+0x8/0xd Aug 22 22:45:42 juju-e4d256-prod-github-runner-207 kernel: [62516.579749] ? watchdog_timer_fn+0x1be/0x220 Aug 22 22:45:42 juju-e4d256-prod-github-runner-207 kernel: [62516.580760] ? lockup_detector_update_enable+0x60/0x60 Aug 22 22:45:42 juju-e4d256-prod-github-runner-207 kernel: [62516.582035] ? __hrtimer_run_queues+0x107/0x230 Aug 22 22:45:42 juju-e4d256-prod-github-runner-207 kernel: [62516.583118] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 22:45:42 juju-e4d256-prod-github-runner-207 kernel: [62516.584175] ? hrtimer_interrupt+0x101/0x220 Aug 22 22:45:42 juju-e4d256-prod-github-runner-207 kernel: [62516.585194] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 22:45:42 juju-e4d256-prod-github-runner-207 kernel: [62516.586287] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 22:45:42 juju-e4d256-prod-github-runner-207 kernel: [62516.587348] Aug 22 22:45:42 juju-e4d256-prod-github-runner-207 kernel: [62516.588208] Aug 22 22:45:42 juju-e4d256-prod-github-runner-207 kernel: [62516.589047] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 22:45:42 juju-e4d256-prod-github-runner-207 kernel: [62516.590100] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:45:42 juju-e4d256-prod-github-runner-207 kernel: [62516.591164] ? _raw_spin_lock+0x22/0x30 Aug 22 22:45:42 juju-e4d256-prod-github-runner-207 kernel: [62516.592133] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:45:42 juju-e4d256-prod-github-runner-207 kernel: [62516.593170] direct_page_fault+0x206/0x310 [kvm] Aug 22 22:45:42 juju-e4d256-prod-github-runner-207 kernel: [62516.594209] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 22:45:42 juju-e4d256-prod-github-runner-207 kernel: [62516.595223] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 22:45:42 juju-e4d256-prod-github-runner-207 kernel: [62516.596224] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 22:45:42 juju-e4d256-prod-github-runner-207 kernel: [62516.597231] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 22:45:42 juju-e4d256-prod-github-runner-207 kernel: [62516.598197] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 22:45:42 juju-e4d256-prod-github-runner-207 kernel: [62516.599174] handle_exit+0x98/0x230 [kvm_amd] Aug 22 22:45:42 juju-e4d256-prod-github-runner-207 kernel: [62516.600072] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 22:45:42 juju-e4d256-prod-github-runner-207 kernel: [62516.600986] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 22:45:42 juju-e4d256-prod-github-runner-207 kernel: [62516.602067] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 22:45:42 juju-e4d256-prod-github-runner-207 kernel: [62516.602996] vcpu_run+0x62/0x2c0 [kvm] Aug 22 22:45:42 juju-e4d256-prod-github-runner-207 kernel: [62516.603823] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 22:45:42 juju-e4d256-prod-github-runner-207 kernel: [62516.604641] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 22:45:42 juju-e4d256-prod-github-runner-207 kernel: [62516.605499] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 22:45:42 juju-e4d256-prod-github-runner-207 kernel: [62516.606324] ? __seccomp_filter+0x4a/0x4a0 Aug 22 22:45:42 juju-e4d256-prod-github-runner-207 kernel: [62516.607121] ? __fget_files+0x86/0xc0 Aug 22 22:45:42 juju-e4d256-prod-github-runner-207 kernel: [62516.607878] __x64_sys_ioctl+0x95/0xd0 Aug 22 22:45:42 juju-e4d256-prod-github-runner-207 kernel: [62516.608601] do_syscall_64+0x5c/0xc0 Aug 22 22:45:42 juju-e4d256-prod-github-runner-207 kernel: [62516.609323] ? do_futex+0x162/0x1f0 Aug 22 22:45:42 juju-e4d256-prod-github-runner-207 kernel: [62516.609995] ? __x64_sys_futex+0x78/0x1e0 Aug 22 22:45:42 juju-e4d256-prod-github-runner-207 kernel: [62516.610670] ? __secure_computing+0xa9/0x120 Aug 22 22:45:42 juju-e4d256-prod-github-runner-207 kernel: [62516.611360] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 22:45:42 juju-e4d256-prod-github-runner-207 kernel: [62516.612146] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:45:42 juju-e4d256-prod-github-runner-207 kernel: [62516.612903] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:45:42 juju-e4d256-prod-github-runner-207 kernel: [62516.613628] ? do_syscall_64+0x69/0xc0 Aug 22 22:45:42 juju-e4d256-prod-github-runner-207 kernel: [62516.614304] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:45:42 juju-e4d256-prod-github-runner-207 kernel: [62516.615007] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:45:42 juju-e4d256-prod-github-runner-207 kernel: [62516.615724] ? do_syscall_64+0x69/0xc0 Aug 22 22:45:42 juju-e4d256-prod-github-runner-207 kernel: [62516.616425] ? do_syscall_64+0x69/0xc0 Aug 22 22:45:42 juju-e4d256-prod-github-runner-207 kernel: [62516.617189] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 22:45:42 juju-e4d256-prod-github-runner-207 kernel: [62516.617916] RIP: 0033:0x7faa5d0edaff Aug 22 22:45:42 juju-e4d256-prod-github-runner-207 kernel: [62516.618610] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 22:45:42 juju-e4d256-prod-github-runner-207 kernel: [62516.620657] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 22:45:42 juju-e4d256-prod-github-runner-207 kernel: [62516.621818] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 22:45:42 juju-e4d256-prod-github-runner-207 kernel: [62516.622852] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 22:45:42 juju-e4d256-prod-github-runner-207 kernel: [62516.623874] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 22:45:42 juju-e4d256-prod-github-runner-207 kernel: [62516.624897] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 22:45:42 juju-e4d256-prod-github-runner-207 kernel: [62516.625958] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 22:45:42 juju-e4d256-prod-github-runner-207 kernel: [62516.626981] Aug 22 22:46:10 juju-e4d256-prod-github-runner-207 kernel: [62544.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 58141s! [qemu-system-x86:6715] Aug 22 22:46:10 juju-e4d256-prod-github-runner-207 kernel: [62544.543122] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 22:46:10 juju-e4d256-prod-github-runner-207 kernel: [62544.543202] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 22:46:10 juju-e4d256-prod-github-runner-207 kernel: [62544.555439] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 22:46:10 juju-e4d256-prod-github-runner-207 kernel: [62544.556788] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 22:46:10 juju-e4d256-prod-github-runner-207 kernel: [62544.558054] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:46:10 juju-e4d256-prod-github-runner-207 kernel: [62544.559283] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 22:46:10 juju-e4d256-prod-github-runner-207 kernel: [62544.562018] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 22:46:10 juju-e4d256-prod-github-runner-207 kernel: [62544.563141] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 22:46:10 juju-e4d256-prod-github-runner-207 kernel: [62544.564342] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 22:46:10 juju-e4d256-prod-github-runner-207 kernel: [62544.565639] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 22:46:10 juju-e4d256-prod-github-runner-207 kernel: [62544.566931] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 22:46:10 juju-e4d256-prod-github-runner-207 kernel: [62544.568200] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 22:46:10 juju-e4d256-prod-github-runner-207 kernel: [62544.569485] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 22:46:10 juju-e4d256-prod-github-runner-207 kernel: [62544.570831] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 22:46:10 juju-e4d256-prod-github-runner-207 kernel: [62544.571995] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 22:46:10 juju-e4d256-prod-github-runner-207 kernel: [62544.573215] Call Trace: Aug 22 22:46:10 juju-e4d256-prod-github-runner-207 kernel: [62544.574164] Aug 22 22:46:10 juju-e4d256-prod-github-runner-207 kernel: [62544.575059] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:46:10 juju-e4d256-prod-github-runner-207 kernel: [62544.576102] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:46:10 juju-e4d256-prod-github-runner-207 kernel: [62544.577124] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:46:10 juju-e4d256-prod-github-runner-207 kernel: [62544.578261] ? show_regs.part.0+0x23/0x29 Aug 22 22:46:10 juju-e4d256-prod-github-runner-207 kernel: [62544.579290] ? show_regs.cold+0x8/0xd Aug 22 22:46:10 juju-e4d256-prod-github-runner-207 kernel: [62544.580273] ? watchdog_timer_fn+0x1be/0x220 Aug 22 22:46:10 juju-e4d256-prod-github-runner-207 kernel: [62544.581291] ? lockup_detector_update_enable+0x60/0x60 Aug 22 22:46:10 juju-e4d256-prod-github-runner-207 kernel: [62544.582387] ? __hrtimer_run_queues+0x107/0x230 Aug 22 22:46:10 juju-e4d256-prod-github-runner-207 kernel: [62544.583449] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 22:46:10 juju-e4d256-prod-github-runner-207 kernel: [62544.584489] ? hrtimer_interrupt+0x101/0x220 Aug 22 22:46:10 juju-e4d256-prod-github-runner-207 kernel: [62544.585552] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 22:46:10 juju-e4d256-prod-github-runner-207 kernel: [62544.586661] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 22:46:10 juju-e4d256-prod-github-runner-207 kernel: [62544.587730] Aug 22 22:46:10 juju-e4d256-prod-github-runner-207 kernel: [62544.588609] Aug 22 22:46:10 juju-e4d256-prod-github-runner-207 kernel: [62544.589496] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 22:46:10 juju-e4d256-prod-github-runner-207 kernel: [62544.590553] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:46:10 juju-e4d256-prod-github-runner-207 kernel: [62544.591598] ? _raw_spin_lock+0x22/0x30 Aug 22 22:46:10 juju-e4d256-prod-github-runner-207 kernel: [62544.592551] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:46:10 juju-e4d256-prod-github-runner-207 kernel: [62544.593597] direct_page_fault+0x206/0x310 [kvm] Aug 22 22:46:10 juju-e4d256-prod-github-runner-207 kernel: [62544.594646] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 22:46:10 juju-e4d256-prod-github-runner-207 kernel: [62544.595668] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 22:46:10 juju-e4d256-prod-github-runner-207 kernel: [62544.596673] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 22:46:10 juju-e4d256-prod-github-runner-207 kernel: [62544.597662] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 22:46:10 juju-e4d256-prod-github-runner-207 kernel: [62544.598633] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 22:46:10 juju-e4d256-prod-github-runner-207 kernel: [62544.599628] handle_exit+0x98/0x230 [kvm_amd] Aug 22 22:46:10 juju-e4d256-prod-github-runner-207 kernel: [62544.600531] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 22:46:10 juju-e4d256-prod-github-runner-207 kernel: [62544.601460] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 22:46:10 juju-e4d256-prod-github-runner-207 kernel: [62544.602401] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 22:46:10 juju-e4d256-prod-github-runner-207 kernel: [62544.603308] vcpu_run+0x62/0x2c0 [kvm] Aug 22 22:46:10 juju-e4d256-prod-github-runner-207 kernel: [62544.604127] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 22:46:10 juju-e4d256-prod-github-runner-207 kernel: [62544.604976] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 22:46:10 juju-e4d256-prod-github-runner-207 kernel: [62544.605860] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 22:46:10 juju-e4d256-prod-github-runner-207 kernel: [62544.606696] ? __seccomp_filter+0x4a/0x4a0 Aug 22 22:46:10 juju-e4d256-prod-github-runner-207 kernel: [62544.607490] ? __fget_files+0x86/0xc0 Aug 22 22:46:10 juju-e4d256-prod-github-runner-207 kernel: [62544.608206] __x64_sys_ioctl+0x95/0xd0 Aug 22 22:46:10 juju-e4d256-prod-github-runner-207 kernel: [62544.608910] do_syscall_64+0x5c/0xc0 Aug 22 22:46:10 juju-e4d256-prod-github-runner-207 kernel: [62544.609603] ? do_futex+0x162/0x1f0 Aug 22 22:46:10 juju-e4d256-prod-github-runner-207 kernel: [62544.610275] ? __x64_sys_futex+0x78/0x1e0 Aug 22 22:46:10 juju-e4d256-prod-github-runner-207 kernel: [62544.610956] ? __secure_computing+0xa9/0x120 Aug 22 22:46:10 juju-e4d256-prod-github-runner-207 kernel: [62544.611650] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 22:46:10 juju-e4d256-prod-github-runner-207 kernel: [62544.612413] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:46:10 juju-e4d256-prod-github-runner-207 kernel: [62544.613137] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:46:10 juju-e4d256-prod-github-runner-207 kernel: [62544.613890] ? do_syscall_64+0x69/0xc0 Aug 22 22:46:10 juju-e4d256-prod-github-runner-207 kernel: [62544.614542] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:46:10 juju-e4d256-prod-github-runner-207 kernel: [62544.615261] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:46:10 juju-e4d256-prod-github-runner-207 kernel: [62544.615962] ? do_syscall_64+0x69/0xc0 Aug 22 22:46:10 juju-e4d256-prod-github-runner-207 kernel: [62544.616589] ? do_syscall_64+0x69/0xc0 Aug 22 22:46:10 juju-e4d256-prod-github-runner-207 kernel: [62544.617216] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 22:46:10 juju-e4d256-prod-github-runner-207 kernel: [62544.617940] RIP: 0033:0x7faa5d0edaff Aug 22 22:46:10 juju-e4d256-prod-github-runner-207 kernel: [62544.618573] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 22:46:10 juju-e4d256-prod-github-runner-207 kernel: [62544.620582] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 22:46:10 juju-e4d256-prod-github-runner-207 kernel: [62544.621514] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 22:46:10 juju-e4d256-prod-github-runner-207 kernel: [62544.622406] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 22:46:10 juju-e4d256-prod-github-runner-207 kernel: [62544.623295] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 22:46:10 juju-e4d256-prod-github-runner-207 kernel: [62544.624200] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 22:46:10 juju-e4d256-prod-github-runner-207 kernel: [62544.625105] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 22:46:10 juju-e4d256-prod-github-runner-207 kernel: [62544.626009] Aug 22 22:46:38 juju-e4d256-prod-github-runner-207 kernel: [62572.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 58167s! [qemu-system-x86:6715] Aug 22 22:46:38 juju-e4d256-prod-github-runner-207 kernel: [62572.543102] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 22:46:38 juju-e4d256-prod-github-runner-207 kernel: [62572.543177] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 22:46:38 juju-e4d256-prod-github-runner-207 kernel: [62572.555343] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 22:46:38 juju-e4d256-prod-github-runner-207 kernel: [62572.556617] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 22:46:38 juju-e4d256-prod-github-runner-207 kernel: [62572.557877] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:46:38 juju-e4d256-prod-github-runner-207 kernel: [62572.558942] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 22:46:38 juju-e4d256-prod-github-runner-207 kernel: [62572.561516] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 22:46:38 juju-e4d256-prod-github-runner-207 kernel: [62572.562567] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 22:46:38 juju-e4d256-prod-github-runner-207 kernel: [62572.563741] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 22:46:38 juju-e4d256-prod-github-runner-207 kernel: [62572.564905] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 22:46:38 juju-e4d256-prod-github-runner-207 kernel: [62572.566075] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 22:46:38 juju-e4d256-prod-github-runner-207 kernel: [62572.567250] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 22:46:38 juju-e4d256-prod-github-runner-207 kernel: [62572.568420] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 22:46:38 juju-e4d256-prod-github-runner-207 kernel: [62572.569693] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 22:46:38 juju-e4d256-prod-github-runner-207 kernel: [62572.570965] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 22:46:38 juju-e4d256-prod-github-runner-207 kernel: [62572.572176] Call Trace: Aug 22 22:46:38 juju-e4d256-prod-github-runner-207 kernel: [62572.573118] Aug 22 22:46:38 juju-e4d256-prod-github-runner-207 kernel: [62572.574007] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:46:38 juju-e4d256-prod-github-runner-207 kernel: [62572.575047] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:46:38 juju-e4d256-prod-github-runner-207 kernel: [62572.576076] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:46:38 juju-e4d256-prod-github-runner-207 kernel: [62572.577170] ? show_regs.part.0+0x23/0x29 Aug 22 22:46:38 juju-e4d256-prod-github-runner-207 kernel: [62572.578167] ? show_regs.cold+0x8/0xd Aug 22 22:46:38 juju-e4d256-prod-github-runner-207 kernel: [62572.579137] ? watchdog_timer_fn+0x1be/0x220 Aug 22 22:46:38 juju-e4d256-prod-github-runner-207 kernel: [62572.580147] ? lockup_detector_update_enable+0x60/0x60 Aug 22 22:46:38 juju-e4d256-prod-github-runner-207 kernel: [62572.581230] ? __hrtimer_run_queues+0x107/0x230 Aug 22 22:46:38 juju-e4d256-prod-github-runner-207 kernel: [62572.582268] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 22:46:38 juju-e4d256-prod-github-runner-207 kernel: [62572.583296] ? hrtimer_interrupt+0x101/0x220 Aug 22 22:46:38 juju-e4d256-prod-github-runner-207 kernel: [62572.584309] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 22:46:38 juju-e4d256-prod-github-runner-207 kernel: [62572.585415] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 22:46:38 juju-e4d256-prod-github-runner-207 kernel: [62572.586477] Aug 22 22:46:38 juju-e4d256-prod-github-runner-207 kernel: [62572.587341] Aug 22 22:46:38 juju-e4d256-prod-github-runner-207 kernel: [62572.588191] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 22:46:38 juju-e4d256-prod-github-runner-207 kernel: [62572.589242] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:46:38 juju-e4d256-prod-github-runner-207 kernel: [62572.590282] ? _raw_spin_lock+0x22/0x30 Aug 22 22:46:38 juju-e4d256-prod-github-runner-207 kernel: [62572.591232] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:46:38 juju-e4d256-prod-github-runner-207 kernel: [62572.592265] direct_page_fault+0x206/0x310 [kvm] Aug 22 22:46:38 juju-e4d256-prod-github-runner-207 kernel: [62572.593306] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 22:46:38 juju-e4d256-prod-github-runner-207 kernel: [62572.594317] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 22:46:38 juju-e4d256-prod-github-runner-207 kernel: [62572.595322] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 22:46:38 juju-e4d256-prod-github-runner-207 kernel: [62572.596308] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 22:46:38 juju-e4d256-prod-github-runner-207 kernel: [62572.597265] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 22:46:38 juju-e4d256-prod-github-runner-207 kernel: [62572.598253] handle_exit+0x98/0x230 [kvm_amd] Aug 22 22:46:38 juju-e4d256-prod-github-runner-207 kernel: [62572.599147] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 22:46:38 juju-e4d256-prod-github-runner-207 kernel: [62572.600059] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 22:46:38 juju-e4d256-prod-github-runner-207 kernel: [62572.600998] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 22:46:38 juju-e4d256-prod-github-runner-207 kernel: [62572.601905] vcpu_run+0x62/0x2c0 [kvm] Aug 22 22:46:38 juju-e4d256-prod-github-runner-207 kernel: [62572.602832] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 22:46:38 juju-e4d256-prod-github-runner-207 kernel: [62572.603638] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 22:46:38 juju-e4d256-prod-github-runner-207 kernel: [62572.604497] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 22:46:38 juju-e4d256-prod-github-runner-207 kernel: [62572.605300] ? __seccomp_filter+0x4a/0x4a0 Aug 22 22:46:38 juju-e4d256-prod-github-runner-207 kernel: [62572.606042] ? __fget_files+0x86/0xc0 Aug 22 22:46:38 juju-e4d256-prod-github-runner-207 kernel: [62572.606748] __x64_sys_ioctl+0x95/0xd0 Aug 22 22:46:38 juju-e4d256-prod-github-runner-207 kernel: [62572.607437] do_syscall_64+0x5c/0xc0 Aug 22 22:46:38 juju-e4d256-prod-github-runner-207 kernel: [62572.608101] ? do_futex+0x162/0x1f0 Aug 22 22:46:38 juju-e4d256-prod-github-runner-207 kernel: [62572.608749] ? __x64_sys_futex+0x78/0x1e0 Aug 22 22:46:38 juju-e4d256-prod-github-runner-207 kernel: [62572.609435] ? __secure_computing+0xa9/0x120 Aug 22 22:46:38 juju-e4d256-prod-github-runner-207 kernel: [62572.610132] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 22:46:38 juju-e4d256-prod-github-runner-207 kernel: [62572.610897] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:46:38 juju-e4d256-prod-github-runner-207 kernel: [62572.611625] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:46:38 juju-e4d256-prod-github-runner-207 kernel: [62572.612346] ? do_syscall_64+0x69/0xc0 Aug 22 22:46:38 juju-e4d256-prod-github-runner-207 kernel: [62572.613001] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:46:38 juju-e4d256-prod-github-runner-207 kernel: [62572.613706] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:46:38 juju-e4d256-prod-github-runner-207 kernel: [62572.614410] ? do_syscall_64+0x69/0xc0 Aug 22 22:46:38 juju-e4d256-prod-github-runner-207 kernel: [62572.615060] ? do_syscall_64+0x69/0xc0 Aug 22 22:46:38 juju-e4d256-prod-github-runner-207 kernel: [62572.615695] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 22:46:38 juju-e4d256-prod-github-runner-207 kernel: [62572.616559] RIP: 0033:0x7faa5d0edaff Aug 22 22:46:38 juju-e4d256-prod-github-runner-207 kernel: [62572.617211] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 22:46:38 juju-e4d256-prod-github-runner-207 kernel: [62572.619264] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 22:46:38 juju-e4d256-prod-github-runner-207 kernel: [62572.620203] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 22:46:38 juju-e4d256-prod-github-runner-207 kernel: [62572.621123] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 22:46:38 juju-e4d256-prod-github-runner-207 kernel: [62572.622016] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 22:46:38 juju-e4d256-prod-github-runner-207 kernel: [62572.622907] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 22:46:38 juju-e4d256-prod-github-runner-207 kernel: [62572.623800] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 22:46:38 juju-e4d256-prod-github-runner-207 kernel: [62572.624707] Aug 22 22:47:06 juju-e4d256-prod-github-runner-207 kernel: [62600.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 58193s! [qemu-system-x86:6715] Aug 22 22:47:06 juju-e4d256-prod-github-runner-207 kernel: [62600.543934] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 22:47:06 juju-e4d256-prod-github-runner-207 kernel: [62600.544270] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 22:47:06 juju-e4d256-prod-github-runner-207 kernel: [62600.556480] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 22:47:06 juju-e4d256-prod-github-runner-207 kernel: [62600.557766] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 22:47:06 juju-e4d256-prod-github-runner-207 kernel: [62600.558994] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:47:06 juju-e4d256-prod-github-runner-207 kernel: [62600.560350] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 22:47:06 juju-e4d256-prod-github-runner-207 kernel: [62600.562951] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 22:47:06 juju-e4d256-prod-github-runner-207 kernel: [62600.564035] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 22:47:06 juju-e4d256-prod-github-runner-207 kernel: [62600.565254] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 22:47:06 juju-e4d256-prod-github-runner-207 kernel: [62600.566437] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 22:47:06 juju-e4d256-prod-github-runner-207 kernel: [62600.567604] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 22:47:06 juju-e4d256-prod-github-runner-207 kernel: [62600.568778] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 22:47:06 juju-e4d256-prod-github-runner-207 kernel: [62600.569998] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 22:47:06 juju-e4d256-prod-github-runner-207 kernel: [62600.571244] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 22:47:06 juju-e4d256-prod-github-runner-207 kernel: [62600.572410] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 22:47:06 juju-e4d256-prod-github-runner-207 kernel: [62600.573654] Call Trace: Aug 22 22:47:06 juju-e4d256-prod-github-runner-207 kernel: [62600.574568] Aug 22 22:47:06 juju-e4d256-prod-github-runner-207 kernel: [62600.575483] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:47:06 juju-e4d256-prod-github-runner-207 kernel: [62600.576600] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:47:06 juju-e4d256-prod-github-runner-207 kernel: [62600.577660] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:47:06 juju-e4d256-prod-github-runner-207 kernel: [62600.578768] ? show_regs.part.0+0x23/0x29 Aug 22 22:47:06 juju-e4d256-prod-github-runner-207 kernel: [62600.579792] ? show_regs.cold+0x8/0xd Aug 22 22:47:06 juju-e4d256-prod-github-runner-207 kernel: [62600.580804] ? watchdog_timer_fn+0x1be/0x220 Aug 22 22:47:06 juju-e4d256-prod-github-runner-207 kernel: [62600.581815] ? lockup_detector_update_enable+0x60/0x60 Aug 22 22:47:06 juju-e4d256-prod-github-runner-207 kernel: [62600.582885] ? __hrtimer_run_queues+0x107/0x230 Aug 22 22:47:06 juju-e4d256-prod-github-runner-207 kernel: [62600.583924] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 22:47:06 juju-e4d256-prod-github-runner-207 kernel: [62600.584983] ? hrtimer_interrupt+0x101/0x220 Aug 22 22:47:06 juju-e4d256-prod-github-runner-207 kernel: [62600.586008] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 22:47:06 juju-e4d256-prod-github-runner-207 kernel: [62600.587083] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 22:47:06 juju-e4d256-prod-github-runner-207 kernel: [62600.588303] Aug 22 22:47:06 juju-e4d256-prod-github-runner-207 kernel: [62600.589174] Aug 22 22:47:06 juju-e4d256-prod-github-runner-207 kernel: [62600.590015] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 22:47:06 juju-e4d256-prod-github-runner-207 kernel: [62600.591049] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:47:06 juju-e4d256-prod-github-runner-207 kernel: [62600.592090] ? _raw_spin_lock+0x22/0x30 Aug 22 22:47:06 juju-e4d256-prod-github-runner-207 kernel: [62600.593069] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:47:06 juju-e4d256-prod-github-runner-207 kernel: [62600.594095] direct_page_fault+0x206/0x310 [kvm] Aug 22 22:47:06 juju-e4d256-prod-github-runner-207 kernel: [62600.595172] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 22:47:06 juju-e4d256-prod-github-runner-207 kernel: [62600.596396] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 22:47:06 juju-e4d256-prod-github-runner-207 kernel: [62600.597461] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 22:47:06 juju-e4d256-prod-github-runner-207 kernel: [62600.598507] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 22:47:06 juju-e4d256-prod-github-runner-207 kernel: [62600.599499] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 22:47:06 juju-e4d256-prod-github-runner-207 kernel: [62600.600518] handle_exit+0x98/0x230 [kvm_amd] Aug 22 22:47:06 juju-e4d256-prod-github-runner-207 kernel: [62600.601461] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 22:47:06 juju-e4d256-prod-github-runner-207 kernel: [62600.602394] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 22:47:06 juju-e4d256-prod-github-runner-207 kernel: [62600.603358] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 22:47:06 juju-e4d256-prod-github-runner-207 kernel: [62600.604297] vcpu_run+0x62/0x2c0 [kvm] Aug 22 22:47:06 juju-e4d256-prod-github-runner-207 kernel: [62600.605136] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 22:47:06 juju-e4d256-prod-github-runner-207 kernel: [62600.605963] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 22:47:06 juju-e4d256-prod-github-runner-207 kernel: [62600.606830] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 22:47:06 juju-e4d256-prod-github-runner-207 kernel: [62600.607648] ? __seccomp_filter+0x4a/0x4a0 Aug 22 22:47:06 juju-e4d256-prod-github-runner-207 kernel: [62600.608396] ? __fget_files+0x86/0xc0 Aug 22 22:47:06 juju-e4d256-prod-github-runner-207 kernel: [62600.609124] __x64_sys_ioctl+0x95/0xd0 Aug 22 22:47:06 juju-e4d256-prod-github-runner-207 kernel: [62600.609824] do_syscall_64+0x5c/0xc0 Aug 22 22:47:06 juju-e4d256-prod-github-runner-207 kernel: [62600.610492] ? do_futex+0x162/0x1f0 Aug 22 22:47:06 juju-e4d256-prod-github-runner-207 kernel: [62600.611141] ? __x64_sys_futex+0x78/0x1e0 Aug 22 22:47:06 juju-e4d256-prod-github-runner-207 kernel: [62600.611816] ? __secure_computing+0xa9/0x120 Aug 22 22:47:06 juju-e4d256-prod-github-runner-207 kernel: [62600.612510] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 22:47:06 juju-e4d256-prod-github-runner-207 kernel: [62600.613286] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:47:06 juju-e4d256-prod-github-runner-207 kernel: [62600.614010] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:47:06 juju-e4d256-prod-github-runner-207 kernel: [62600.614736] ? do_syscall_64+0x69/0xc0 Aug 22 22:47:06 juju-e4d256-prod-github-runner-207 kernel: [62600.615381] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:47:06 juju-e4d256-prod-github-runner-207 kernel: [62600.616086] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:47:06 juju-e4d256-prod-github-runner-207 kernel: [62600.616790] ? do_syscall_64+0x69/0xc0 Aug 22 22:47:06 juju-e4d256-prod-github-runner-207 kernel: [62600.617422] ? do_syscall_64+0x69/0xc0 Aug 22 22:47:06 juju-e4d256-prod-github-runner-207 kernel: [62600.618176] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 22:47:06 juju-e4d256-prod-github-runner-207 kernel: [62600.618902] RIP: 0033:0x7faa5d0edaff Aug 22 22:47:06 juju-e4d256-prod-github-runner-207 kernel: [62600.619577] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 22:47:06 juju-e4d256-prod-github-runner-207 kernel: [62600.621576] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 22:47:06 juju-e4d256-prod-github-runner-207 kernel: [62600.622558] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 22:47:06 juju-e4d256-prod-github-runner-207 kernel: [62600.623463] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 22:47:06 juju-e4d256-prod-github-runner-207 kernel: [62600.624356] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 22:47:06 juju-e4d256-prod-github-runner-207 kernel: [62600.625260] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 22:47:06 juju-e4d256-prod-github-runner-207 kernel: [62600.626148] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 22:47:06 juju-e4d256-prod-github-runner-207 kernel: [62600.627042] Aug 22 22:47:34 juju-e4d256-prod-github-runner-207 kernel: [62628.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 58219s! [qemu-system-x86:6715] Aug 22 22:47:34 juju-e4d256-prod-github-runner-207 kernel: [62628.544189] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 22:47:34 juju-e4d256-prod-github-runner-207 kernel: [62628.544833] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 22:47:34 juju-e4d256-prod-github-runner-207 kernel: [62628.557506] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 22:47:34 juju-e4d256-prod-github-runner-207 kernel: [62628.558798] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 22:47:34 juju-e4d256-prod-github-runner-207 kernel: [62628.560037] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:47:34 juju-e4d256-prod-github-runner-207 kernel: [62628.561115] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 22:47:34 juju-e4d256-prod-github-runner-207 kernel: [62628.563855] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 22:47:34 juju-e4d256-prod-github-runner-207 kernel: [62628.564955] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 22:47:34 juju-e4d256-prod-github-runner-207 kernel: [62628.566127] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 22:47:34 juju-e4d256-prod-github-runner-207 kernel: [62628.567289] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 22:47:34 juju-e4d256-prod-github-runner-207 kernel: [62628.568465] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 22:47:34 juju-e4d256-prod-github-runner-207 kernel: [62628.569657] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 22:47:34 juju-e4d256-prod-github-runner-207 kernel: [62628.570832] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 22:47:34 juju-e4d256-prod-github-runner-207 kernel: [62628.572064] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 22:47:34 juju-e4d256-prod-github-runner-207 kernel: [62628.573176] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 22:47:34 juju-e4d256-prod-github-runner-207 kernel: [62628.574382] Call Trace: Aug 22 22:47:34 juju-e4d256-prod-github-runner-207 kernel: [62628.575314] Aug 22 22:47:34 juju-e4d256-prod-github-runner-207 kernel: [62628.576222] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:47:34 juju-e4d256-prod-github-runner-207 kernel: [62628.577273] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:47:34 juju-e4d256-prod-github-runner-207 kernel: [62628.578344] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:47:34 juju-e4d256-prod-github-runner-207 kernel: [62628.579476] ? show_regs.part.0+0x23/0x29 Aug 22 22:47:34 juju-e4d256-prod-github-runner-207 kernel: [62628.580509] ? show_regs.cold+0x8/0xd Aug 22 22:47:34 juju-e4d256-prod-github-runner-207 kernel: [62628.581489] ? watchdog_timer_fn+0x1be/0x220 Aug 22 22:47:34 juju-e4d256-prod-github-runner-207 kernel: [62628.582555] ? lockup_detector_update_enable+0x60/0x60 Aug 22 22:47:34 juju-e4d256-prod-github-runner-207 kernel: [62628.583617] ? __hrtimer_run_queues+0x107/0x230 Aug 22 22:47:34 juju-e4d256-prod-github-runner-207 kernel: [62628.584656] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 22:47:34 juju-e4d256-prod-github-runner-207 kernel: [62628.585681] ? hrtimer_interrupt+0x101/0x220 Aug 22 22:47:34 juju-e4d256-prod-github-runner-207 kernel: [62628.586704] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 22:47:34 juju-e4d256-prod-github-runner-207 kernel: [62628.587772] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 22:47:34 juju-e4d256-prod-github-runner-207 kernel: [62628.588827] Aug 22 22:47:34 juju-e4d256-prod-github-runner-207 kernel: [62628.589681] Aug 22 22:47:34 juju-e4d256-prod-github-runner-207 kernel: [62628.590518] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 22:47:34 juju-e4d256-prod-github-runner-207 kernel: [62628.591552] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:47:34 juju-e4d256-prod-github-runner-207 kernel: [62628.592609] ? _raw_spin_lock+0x22/0x30 Aug 22 22:47:34 juju-e4d256-prod-github-runner-207 kernel: [62628.593562] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:47:34 juju-e4d256-prod-github-runner-207 kernel: [62628.594613] direct_page_fault+0x206/0x310 [kvm] Aug 22 22:47:34 juju-e4d256-prod-github-runner-207 kernel: [62628.595640] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 22:47:34 juju-e4d256-prod-github-runner-207 kernel: [62628.596674] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 22:47:34 juju-e4d256-prod-github-runner-207 kernel: [62628.597677] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 22:47:34 juju-e4d256-prod-github-runner-207 kernel: [62628.598684] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 22:47:34 juju-e4d256-prod-github-runner-207 kernel: [62628.599634] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 22:47:34 juju-e4d256-prod-github-runner-207 kernel: [62628.600625] handle_exit+0x98/0x230 [kvm_amd] Aug 22 22:47:34 juju-e4d256-prod-github-runner-207 kernel: [62628.601521] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 22:47:34 juju-e4d256-prod-github-runner-207 kernel: [62628.602436] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 22:47:34 juju-e4d256-prod-github-runner-207 kernel: [62628.603365] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 22:47:34 juju-e4d256-prod-github-runner-207 kernel: [62628.604285] vcpu_run+0x62/0x2c0 [kvm] Aug 22 22:47:34 juju-e4d256-prod-github-runner-207 kernel: [62628.605096] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 22:47:34 juju-e4d256-prod-github-runner-207 kernel: [62628.605911] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 22:47:34 juju-e4d256-prod-github-runner-207 kernel: [62628.606766] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 22:47:34 juju-e4d256-prod-github-runner-207 kernel: [62628.607563] ? __seccomp_filter+0x4a/0x4a0 Aug 22 22:47:34 juju-e4d256-prod-github-runner-207 kernel: [62628.608367] ? __fget_files+0x86/0xc0 Aug 22 22:47:34 juju-e4d256-prod-github-runner-207 kernel: [62628.609108] __x64_sys_ioctl+0x95/0xd0 Aug 22 22:47:34 juju-e4d256-prod-github-runner-207 kernel: [62628.609822] do_syscall_64+0x5c/0xc0 Aug 22 22:47:34 juju-e4d256-prod-github-runner-207 kernel: [62628.610489] ? do_futex+0x162/0x1f0 Aug 22 22:47:34 juju-e4d256-prod-github-runner-207 kernel: [62628.611140] ? __x64_sys_futex+0x78/0x1e0 Aug 22 22:47:34 juju-e4d256-prod-github-runner-207 kernel: [62628.611816] ? __secure_computing+0xa9/0x120 Aug 22 22:47:34 juju-e4d256-prod-github-runner-207 kernel: [62628.612517] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 22:47:34 juju-e4d256-prod-github-runner-207 kernel: [62628.613283] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:47:34 juju-e4d256-prod-github-runner-207 kernel: [62628.614005] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:47:34 juju-e4d256-prod-github-runner-207 kernel: [62628.614724] ? do_syscall_64+0x69/0xc0 Aug 22 22:47:34 juju-e4d256-prod-github-runner-207 kernel: [62628.615370] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:47:34 juju-e4d256-prod-github-runner-207 kernel: [62628.616075] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:47:34 juju-e4d256-prod-github-runner-207 kernel: [62628.616788] ? do_syscall_64+0x69/0xc0 Aug 22 22:47:34 juju-e4d256-prod-github-runner-207 kernel: [62628.617416] ? do_syscall_64+0x69/0xc0 Aug 22 22:47:34 juju-e4d256-prod-github-runner-207 kernel: [62628.618039] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 22:47:34 juju-e4d256-prod-github-runner-207 kernel: [62628.618747] RIP: 0033:0x7faa5d0edaff Aug 22 22:47:34 juju-e4d256-prod-github-runner-207 kernel: [62628.619413] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 22:47:34 juju-e4d256-prod-github-runner-207 kernel: [62628.621427] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 22:47:34 juju-e4d256-prod-github-runner-207 kernel: [62628.622347] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 22:47:34 juju-e4d256-prod-github-runner-207 kernel: [62628.623252] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 22:47:34 juju-e4d256-prod-github-runner-207 kernel: [62628.624142] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 22:47:34 juju-e4d256-prod-github-runner-207 kernel: [62628.625051] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 22:47:34 juju-e4d256-prod-github-runner-207 kernel: [62628.625949] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 22:47:34 juju-e4d256-prod-github-runner-207 kernel: [62628.626846] Aug 22 22:47:47 juju-e4d256-prod-github-runner-207 kernel: [62641.364706] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 22:47:47 juju-e4d256-prod-github-runner-207 kernel: [62641.366755] rcu: 1-....: (15581761 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=7523518 Aug 22 22:47:47 juju-e4d256-prod-github-runner-207 kernel: [62641.367879] (t=15631041 jiffies g=23269 q=55616) Aug 22 22:47:47 juju-e4d256-prod-github-runner-207 kernel: [62641.368682] NMI backtrace for cpu 1 Aug 22 22:47:47 juju-e4d256-prod-github-runner-207 kernel: [62641.369398] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 22:47:47 juju-e4d256-prod-github-runner-207 kernel: [62641.370500] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 22:47:47 juju-e4d256-prod-github-runner-207 kernel: [62641.371572] Call Trace: Aug 22 22:47:47 juju-e4d256-prod-github-runner-207 kernel: [62641.372362] Aug 22 22:47:47 juju-e4d256-prod-github-runner-207 kernel: [62641.373074] show_stack+0x52/0x5c Aug 22 22:47:47 juju-e4d256-prod-github-runner-207 kernel: [62641.373802] dump_stack_lvl+0x4a/0x63 Aug 22 22:47:47 juju-e4d256-prod-github-runner-207 kernel: [62641.374549] dump_stack+0x10/0x16 Aug 22 22:47:47 juju-e4d256-prod-github-runner-207 kernel: [62641.375268] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 22:47:47 juju-e4d256-prod-github-runner-207 kernel: [62641.376051] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 22:47:47 juju-e4d256-prod-github-runner-207 kernel: [62641.377013] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 22:47:47 juju-e4d256-prod-github-runner-207 kernel: [62641.377832] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 22:47:47 juju-e4d256-prod-github-runner-207 kernel: [62641.378651] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 22:47:47 juju-e4d256-prod-github-runner-207 kernel: [62641.379466] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 22:47:47 juju-e4d256-prod-github-runner-207 kernel: [62641.380263] print_cpu_stall.cold+0x2f/0xe2 Aug 22 22:47:47 juju-e4d256-prod-github-runner-207 kernel: [62641.381164] ? timekeeping_update+0xf7/0x150 Aug 22 22:47:47 juju-e4d256-prod-github-runner-207 kernel: [62641.381949] check_cpu_stall+0x109/0x270 Aug 22 22:47:47 juju-e4d256-prod-github-runner-207 kernel: [62641.382697] rcu_sched_clock_irq+0x9a/0x250 Aug 22 22:47:47 juju-e4d256-prod-github-runner-207 kernel: [62641.383460] update_process_times+0x94/0xd0 Aug 22 22:47:47 juju-e4d256-prod-github-runner-207 kernel: [62641.384235] tick_sched_handle+0x29/0x70 Aug 22 22:47:47 juju-e4d256-prod-github-runner-207 kernel: [62641.384989] tick_sched_timer+0x8c/0xc0 Aug 22 22:47:47 juju-e4d256-prod-github-runner-207 kernel: [62641.385727] ? tick_nohz_handler+0xb0/0xb0 Aug 22 22:47:47 juju-e4d256-prod-github-runner-207 kernel: [62641.386484] __hrtimer_run_queues+0x107/0x230 Aug 22 22:47:47 juju-e4d256-prod-github-runner-207 kernel: [62641.387258] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 22:47:47 juju-e4d256-prod-github-runner-207 kernel: [62641.388038] hrtimer_interrupt+0x101/0x220 Aug 22 22:47:47 juju-e4d256-prod-github-runner-207 kernel: [62641.388813] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 22:47:47 juju-e4d256-prod-github-runner-207 kernel: [62641.389624] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 22:47:47 juju-e4d256-prod-github-runner-207 kernel: [62641.390428] Aug 22 22:47:47 juju-e4d256-prod-github-runner-207 kernel: [62641.391067] Aug 22 22:47:47 juju-e4d256-prod-github-runner-207 kernel: [62641.391700] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 22:47:47 juju-e4d256-prod-github-runner-207 kernel: [62641.392530] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:47:47 juju-e4d256-prod-github-runner-207 kernel: [62641.393418] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 22:47:47 juju-e4d256-prod-github-runner-207 kernel: [62641.395620] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 22:47:47 juju-e4d256-prod-github-runner-207 kernel: [62641.396521] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 22:47:47 juju-e4d256-prod-github-runner-207 kernel: [62641.397518] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 22:47:47 juju-e4d256-prod-github-runner-207 kernel: [62641.398501] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 22:47:47 juju-e4d256-prod-github-runner-207 kernel: [62641.399465] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 22:47:47 juju-e4d256-prod-github-runner-207 kernel: [62641.400445] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 22:47:47 juju-e4d256-prod-github-runner-207 kernel: [62641.401408] ? _raw_spin_lock+0x22/0x30 Aug 22 22:47:47 juju-e4d256-prod-github-runner-207 kernel: [62641.402186] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:47:47 juju-e4d256-prod-github-runner-207 kernel: [62641.403042] direct_page_fault+0x206/0x310 [kvm] Aug 22 22:47:47 juju-e4d256-prod-github-runner-207 kernel: [62641.403880] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 22:47:47 juju-e4d256-prod-github-runner-207 kernel: [62641.404717] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 22:47:47 juju-e4d256-prod-github-runner-207 kernel: [62641.405571] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 22:47:47 juju-e4d256-prod-github-runner-207 kernel: [62641.406400] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 22:47:47 juju-e4d256-prod-github-runner-207 kernel: [62641.407327] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 22:47:47 juju-e4d256-prod-github-runner-207 kernel: [62641.408164] handle_exit+0x98/0x230 [kvm_amd] Aug 22 22:47:47 juju-e4d256-prod-github-runner-207 kernel: [62641.409066] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 22:47:47 juju-e4d256-prod-github-runner-207 kernel: [62641.409849] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 22:47:47 juju-e4d256-prod-github-runner-207 kernel: [62641.410646] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 22:47:47 juju-e4d256-prod-github-runner-207 kernel: [62641.411431] vcpu_run+0x62/0x2c0 [kvm] Aug 22 22:47:47 juju-e4d256-prod-github-runner-207 kernel: [62641.412165] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 22:47:47 juju-e4d256-prod-github-runner-207 kernel: [62641.412900] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 22:47:47 juju-e4d256-prod-github-runner-207 kernel: [62641.413703] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 22:47:47 juju-e4d256-prod-github-runner-207 kernel: [62641.414464] ? __seccomp_filter+0x4a/0x4a0 Aug 22 22:47:47 juju-e4d256-prod-github-runner-207 kernel: [62641.415194] ? __fget_files+0x86/0xc0 Aug 22 22:47:47 juju-e4d256-prod-github-runner-207 kernel: [62641.415890] __x64_sys_ioctl+0x95/0xd0 Aug 22 22:47:47 juju-e4d256-prod-github-runner-207 kernel: [62641.416619] do_syscall_64+0x5c/0xc0 Aug 22 22:47:47 juju-e4d256-prod-github-runner-207 kernel: [62641.417324] ? do_futex+0x162/0x1f0 Aug 22 22:47:47 juju-e4d256-prod-github-runner-207 kernel: [62641.418003] ? __x64_sys_futex+0x78/0x1e0 Aug 22 22:47:47 juju-e4d256-prod-github-runner-207 kernel: [62641.418712] ? __secure_computing+0xa9/0x120 Aug 22 22:47:47 juju-e4d256-prod-github-runner-207 kernel: [62641.419433] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 22:47:47 juju-e4d256-prod-github-runner-207 kernel: [62641.420251] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:47:47 juju-e4d256-prod-github-runner-207 kernel: [62641.421015] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:47:47 juju-e4d256-prod-github-runner-207 kernel: [62641.421775] ? do_syscall_64+0x69/0xc0 Aug 22 22:47:47 juju-e4d256-prod-github-runner-207 kernel: [62641.422470] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:47:47 juju-e4d256-prod-github-runner-207 kernel: [62641.423249] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:47:47 juju-e4d256-prod-github-runner-207 kernel: [62641.424008] ? do_syscall_64+0x69/0xc0 Aug 22 22:47:47 juju-e4d256-prod-github-runner-207 kernel: [62641.424727] ? do_syscall_64+0x69/0xc0 Aug 22 22:47:47 juju-e4d256-prod-github-runner-207 kernel: [62641.425414] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 22:47:47 juju-e4d256-prod-github-runner-207 kernel: [62641.426189] RIP: 0033:0x7faa5d0edaff Aug 22 22:47:47 juju-e4d256-prod-github-runner-207 kernel: [62641.426919] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 22:47:47 juju-e4d256-prod-github-runner-207 kernel: [62641.429040] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 22:47:47 juju-e4d256-prod-github-runner-207 kernel: [62641.430002] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 22:47:47 juju-e4d256-prod-github-runner-207 kernel: [62641.430947] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 22:47:47 juju-e4d256-prod-github-runner-207 kernel: [62641.431893] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 22:47:47 juju-e4d256-prod-github-runner-207 kernel: [62641.432840] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 22:47:47 juju-e4d256-prod-github-runner-207 kernel: [62641.433766] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 22:47:47 juju-e4d256-prod-github-runner-207 kernel: [62641.434680] Aug 22 22:48:14 juju-e4d256-prod-github-runner-207 kernel: [62668.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 58256s! [qemu-system-x86:6715] Aug 22 22:48:14 juju-e4d256-prod-github-runner-207 kernel: [62668.543795] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 22:48:14 juju-e4d256-prod-github-runner-207 kernel: [62668.544054] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 22:48:14 juju-e4d256-prod-github-runner-207 kernel: [62668.556264] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 22:48:14 juju-e4d256-prod-github-runner-207 kernel: [62668.557528] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 22:48:14 juju-e4d256-prod-github-runner-207 kernel: [62668.558751] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:48:14 juju-e4d256-prod-github-runner-207 kernel: [62668.559827] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 22:48:14 juju-e4d256-prod-github-runner-207 kernel: [62668.562375] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 22:48:14 juju-e4d256-prod-github-runner-207 kernel: [62668.563455] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 22:48:14 juju-e4d256-prod-github-runner-207 kernel: [62668.564668] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 22:48:14 juju-e4d256-prod-github-runner-207 kernel: [62668.565843] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 22:48:14 juju-e4d256-prod-github-runner-207 kernel: [62668.567001] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 22:48:14 juju-e4d256-prod-github-runner-207 kernel: [62668.568184] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 22:48:14 juju-e4d256-prod-github-runner-207 kernel: [62668.569364] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 22:48:14 juju-e4d256-prod-github-runner-207 kernel: [62668.570605] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 22:48:14 juju-e4d256-prod-github-runner-207 kernel: [62668.571710] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 22:48:14 juju-e4d256-prod-github-runner-207 kernel: [62668.572923] Call Trace: Aug 22 22:48:14 juju-e4d256-prod-github-runner-207 kernel: [62668.573872] Aug 22 22:48:14 juju-e4d256-prod-github-runner-207 kernel: [62668.574797] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:48:14 juju-e4d256-prod-github-runner-207 kernel: [62668.575862] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:48:14 juju-e4d256-prod-github-runner-207 kernel: [62668.576884] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:48:14 juju-e4d256-prod-github-runner-207 kernel: [62668.577981] ? show_regs.part.0+0x23/0x29 Aug 22 22:48:14 juju-e4d256-prod-github-runner-207 kernel: [62668.578979] ? show_regs.cold+0x8/0xd Aug 22 22:48:14 juju-e4d256-prod-github-runner-207 kernel: [62668.579974] ? watchdog_timer_fn+0x1be/0x220 Aug 22 22:48:14 juju-e4d256-prod-github-runner-207 kernel: [62668.580990] ? lockup_detector_update_enable+0x60/0x60 Aug 22 22:48:14 juju-e4d256-prod-github-runner-207 kernel: [62668.582052] ? __hrtimer_run_queues+0x107/0x230 Aug 22 22:48:14 juju-e4d256-prod-github-runner-207 kernel: [62668.583085] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 22:48:14 juju-e4d256-prod-github-runner-207 kernel: [62668.584165] ? hrtimer_interrupt+0x101/0x220 Aug 22 22:48:14 juju-e4d256-prod-github-runner-207 kernel: [62668.585210] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 22:48:14 juju-e4d256-prod-github-runner-207 kernel: [62668.586302] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 22:48:14 juju-e4d256-prod-github-runner-207 kernel: [62668.587349] Aug 22 22:48:14 juju-e4d256-prod-github-runner-207 kernel: [62668.588220] Aug 22 22:48:14 juju-e4d256-prod-github-runner-207 kernel: [62668.589058] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 22:48:14 juju-e4d256-prod-github-runner-207 kernel: [62668.590100] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:48:14 juju-e4d256-prod-github-runner-207 kernel: [62668.591150] ? _raw_spin_lock+0x22/0x30 Aug 22 22:48:14 juju-e4d256-prod-github-runner-207 kernel: [62668.592119] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:48:14 juju-e4d256-prod-github-runner-207 kernel: [62668.593140] direct_page_fault+0x206/0x310 [kvm] Aug 22 22:48:14 juju-e4d256-prod-github-runner-207 kernel: [62668.594217] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 22:48:14 juju-e4d256-prod-github-runner-207 kernel: [62668.595252] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 22:48:14 juju-e4d256-prod-github-runner-207 kernel: [62668.596311] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 22:48:14 juju-e4d256-prod-github-runner-207 kernel: [62668.597307] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 22:48:14 juju-e4d256-prod-github-runner-207 kernel: [62668.598253] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 22:48:14 juju-e4d256-prod-github-runner-207 kernel: [62668.599237] handle_exit+0x98/0x230 [kvm_amd] Aug 22 22:48:14 juju-e4d256-prod-github-runner-207 kernel: [62668.600156] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 22:48:14 juju-e4d256-prod-github-runner-207 kernel: [62668.601083] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 22:48:14 juju-e4d256-prod-github-runner-207 kernel: [62668.602011] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 22:48:14 juju-e4d256-prod-github-runner-207 kernel: [62668.602915] vcpu_run+0x62/0x2c0 [kvm] Aug 22 22:48:14 juju-e4d256-prod-github-runner-207 kernel: [62668.603726] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 22:48:14 juju-e4d256-prod-github-runner-207 kernel: [62668.604581] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 22:48:14 juju-e4d256-prod-github-runner-207 kernel: [62668.605457] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 22:48:14 juju-e4d256-prod-github-runner-207 kernel: [62668.606302] ? __seccomp_filter+0x4a/0x4a0 Aug 22 22:48:14 juju-e4d256-prod-github-runner-207 kernel: [62668.607056] ? __fget_files+0x86/0xc0 Aug 22 22:48:14 juju-e4d256-prod-github-runner-207 kernel: [62668.607776] __x64_sys_ioctl+0x95/0xd0 Aug 22 22:48:14 juju-e4d256-prod-github-runner-207 kernel: [62668.608469] do_syscall_64+0x5c/0xc0 Aug 22 22:48:14 juju-e4d256-prod-github-runner-207 kernel: [62668.609132] ? do_futex+0x162/0x1f0 Aug 22 22:48:14 juju-e4d256-prod-github-runner-207 kernel: [62668.609780] ? __x64_sys_futex+0x78/0x1e0 Aug 22 22:48:14 juju-e4d256-prod-github-runner-207 kernel: [62668.610452] ? __secure_computing+0xa9/0x120 Aug 22 22:48:14 juju-e4d256-prod-github-runner-207 kernel: [62668.611141] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 22:48:14 juju-e4d256-prod-github-runner-207 kernel: [62668.611920] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:48:14 juju-e4d256-prod-github-runner-207 kernel: [62668.612642] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:48:14 juju-e4d256-prod-github-runner-207 kernel: [62668.613365] ? do_syscall_64+0x69/0xc0 Aug 22 22:48:14 juju-e4d256-prod-github-runner-207 kernel: [62668.614013] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:48:14 juju-e4d256-prod-github-runner-207 kernel: [62668.614739] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:48:14 juju-e4d256-prod-github-runner-207 kernel: [62668.615441] ? do_syscall_64+0x69/0xc0 Aug 22 22:48:14 juju-e4d256-prod-github-runner-207 kernel: [62668.616081] ? do_syscall_64+0x69/0xc0 Aug 22 22:48:14 juju-e4d256-prod-github-runner-207 kernel: [62668.616703] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 22:48:14 juju-e4d256-prod-github-runner-207 kernel: [62668.617407] RIP: 0033:0x7faa5d0edaff Aug 22 22:48:14 juju-e4d256-prod-github-runner-207 kernel: [62668.618053] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 22:48:14 juju-e4d256-prod-github-runner-207 kernel: [62668.620060] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 22:48:14 juju-e4d256-prod-github-runner-207 kernel: [62668.620971] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 22:48:14 juju-e4d256-prod-github-runner-207 kernel: [62668.621864] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 22:48:14 juju-e4d256-prod-github-runner-207 kernel: [62668.622752] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 22:48:14 juju-e4d256-prod-github-runner-207 kernel: [62668.623639] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 22:48:14 juju-e4d256-prod-github-runner-207 kernel: [62668.624554] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 22:48:14 juju-e4d256-prod-github-runner-207 kernel: [62668.625457] Aug 22 22:48:42 juju-e4d256-prod-github-runner-207 kernel: [62696.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 58282s! [qemu-system-x86:6715] Aug 22 22:48:42 juju-e4d256-prod-github-runner-207 kernel: [62696.543724] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 22:48:42 juju-e4d256-prod-github-runner-207 kernel: [62696.543970] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 22:48:42 juju-e4d256-prod-github-runner-207 kernel: [62696.556037] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 22:48:42 juju-e4d256-prod-github-runner-207 kernel: [62696.557308] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 22:48:42 juju-e4d256-prod-github-runner-207 kernel: [62696.558530] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:48:42 juju-e4d256-prod-github-runner-207 kernel: [62696.559595] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 22:48:42 juju-e4d256-prod-github-runner-207 kernel: [62696.562142] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 22:48:42 juju-e4d256-prod-github-runner-207 kernel: [62696.563183] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 22:48:42 juju-e4d256-prod-github-runner-207 kernel: [62696.564526] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 22:48:42 juju-e4d256-prod-github-runner-207 kernel: [62696.565686] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 22:48:42 juju-e4d256-prod-github-runner-207 kernel: [62696.566850] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 22:48:42 juju-e4d256-prod-github-runner-207 kernel: [62696.568027] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 22:48:42 juju-e4d256-prod-github-runner-207 kernel: [62696.569197] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 22:48:42 juju-e4d256-prod-github-runner-207 kernel: [62696.570428] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 22:48:42 juju-e4d256-prod-github-runner-207 kernel: [62696.571535] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 22:48:42 juju-e4d256-prod-github-runner-207 kernel: [62696.572732] Call Trace: Aug 22 22:48:42 juju-e4d256-prod-github-runner-207 kernel: [62696.573642] Aug 22 22:48:42 juju-e4d256-prod-github-runner-207 kernel: [62696.574536] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:48:42 juju-e4d256-prod-github-runner-207 kernel: [62696.575590] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:48:42 juju-e4d256-prod-github-runner-207 kernel: [62696.576624] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:48:42 juju-e4d256-prod-github-runner-207 kernel: [62696.577737] ? show_regs.part.0+0x23/0x29 Aug 22 22:48:42 juju-e4d256-prod-github-runner-207 kernel: [62696.578740] ? show_regs.cold+0x8/0xd Aug 22 22:48:42 juju-e4d256-prod-github-runner-207 kernel: [62696.579835] ? watchdog_timer_fn+0x1be/0x220 Aug 22 22:48:42 juju-e4d256-prod-github-runner-207 kernel: [62696.580929] ? lockup_detector_update_enable+0x60/0x60 Aug 22 22:48:42 juju-e4d256-prod-github-runner-207 kernel: [62696.582278] ? __hrtimer_run_queues+0x107/0x230 Aug 22 22:48:42 juju-e4d256-prod-github-runner-207 kernel: [62696.583407] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 22:48:42 juju-e4d256-prod-github-runner-207 kernel: [62696.584528] ? hrtimer_interrupt+0x101/0x220 Aug 22 22:48:42 juju-e4d256-prod-github-runner-207 kernel: [62696.585629] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 22:48:42 juju-e4d256-prod-github-runner-207 kernel: [62696.586792] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 22:48:42 juju-e4d256-prod-github-runner-207 kernel: [62696.587951] Aug 22 22:48:42 juju-e4d256-prod-github-runner-207 kernel: [62696.588855] Aug 22 22:48:42 juju-e4d256-prod-github-runner-207 kernel: [62696.589735] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 22:48:42 juju-e4d256-prod-github-runner-207 kernel: [62696.590865] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:48:42 juju-e4d256-prod-github-runner-207 kernel: [62696.592034] ? _raw_spin_lock+0x22/0x30 Aug 22 22:48:42 juju-e4d256-prod-github-runner-207 kernel: [62696.593057] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:48:42 juju-e4d256-prod-github-runner-207 kernel: [62696.594183] direct_page_fault+0x206/0x310 [kvm] Aug 22 22:48:42 juju-e4d256-prod-github-runner-207 kernel: [62696.595323] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 22:48:42 juju-e4d256-prod-github-runner-207 kernel: [62696.596482] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 22:48:42 juju-e4d256-prod-github-runner-207 kernel: [62696.597599] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 22:48:42 juju-e4d256-prod-github-runner-207 kernel: [62696.598709] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 22:48:42 juju-e4d256-prod-github-runner-207 kernel: [62696.599770] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 22:48:42 juju-e4d256-prod-github-runner-207 kernel: [62696.600853] handle_exit+0x98/0x230 [kvm_amd] Aug 22 22:48:42 juju-e4d256-prod-github-runner-207 kernel: [62696.601838] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 22:48:42 juju-e4d256-prod-github-runner-207 kernel: [62696.602844] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 22:48:42 juju-e4d256-prod-github-runner-207 kernel: [62696.603893] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 22:48:42 juju-e4d256-prod-github-runner-207 kernel: [62696.604929] vcpu_run+0x62/0x2c0 [kvm] Aug 22 22:48:42 juju-e4d256-prod-github-runner-207 kernel: [62696.605826] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 22:48:42 juju-e4d256-prod-github-runner-207 kernel: [62696.606728] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 22:48:42 juju-e4d256-prod-github-runner-207 kernel: [62696.607693] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 22:48:42 juju-e4d256-prod-github-runner-207 kernel: [62696.608574] ? __seccomp_filter+0x4a/0x4a0 Aug 22 22:48:42 juju-e4d256-prod-github-runner-207 kernel: [62696.609401] ? __fget_files+0x86/0xc0 Aug 22 22:48:42 juju-e4d256-prod-github-runner-207 kernel: [62696.610179] __x64_sys_ioctl+0x95/0xd0 Aug 22 22:48:42 juju-e4d256-prod-github-runner-207 kernel: [62696.610955] do_syscall_64+0x5c/0xc0 Aug 22 22:48:42 juju-e4d256-prod-github-runner-207 kernel: [62696.611708] ? do_futex+0x162/0x1f0 Aug 22 22:48:42 juju-e4d256-prod-github-runner-207 kernel: [62696.612435] ? __x64_sys_futex+0x78/0x1e0 Aug 22 22:48:42 juju-e4d256-prod-github-runner-207 kernel: [62696.613194] ? __secure_computing+0xa9/0x120 Aug 22 22:48:42 juju-e4d256-prod-github-runner-207 kernel: [62696.613975] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 22:48:42 juju-e4d256-prod-github-runner-207 kernel: [62696.614838] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:48:42 juju-e4d256-prod-github-runner-207 kernel: [62696.615664] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:48:42 juju-e4d256-prod-github-runner-207 kernel: [62696.616478] ? do_syscall_64+0x69/0xc0 Aug 22 22:48:42 juju-e4d256-prod-github-runner-207 kernel: [62696.617201] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:48:42 juju-e4d256-prod-github-runner-207 kernel: [62696.617994] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:48:42 juju-e4d256-prod-github-runner-207 kernel: [62696.618779] ? do_syscall_64+0x69/0xc0 Aug 22 22:48:42 juju-e4d256-prod-github-runner-207 kernel: [62696.619498] ? do_syscall_64+0x69/0xc0 Aug 22 22:48:42 juju-e4d256-prod-github-runner-207 kernel: [62696.620194] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 22:48:42 juju-e4d256-prod-github-runner-207 kernel: [62696.620998] RIP: 0033:0x7faa5d0edaff Aug 22 22:48:42 juju-e4d256-prod-github-runner-207 kernel: [62696.621743] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 22:48:42 juju-e4d256-prod-github-runner-207 kernel: [62696.624112] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 22:48:42 juju-e4d256-prod-github-runner-207 kernel: [62696.625179] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 22:48:42 juju-e4d256-prod-github-runner-207 kernel: [62696.626205] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 22:48:42 juju-e4d256-prod-github-runner-207 kernel: [62696.627237] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 22:48:42 juju-e4d256-prod-github-runner-207 kernel: [62696.630047] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 22:48:42 juju-e4d256-prod-github-runner-207 kernel: [62696.631096] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 22:48:42 juju-e4d256-prod-github-runner-207 kernel: [62696.632147] Aug 22 22:49:10 juju-e4d256-prod-github-runner-207 kernel: [62724.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 58308s! [qemu-system-x86:6715] Aug 22 22:49:10 juju-e4d256-prod-github-runner-207 kernel: [62724.543721] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 22:49:10 juju-e4d256-prod-github-runner-207 kernel: [62724.543956] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 22:49:10 juju-e4d256-prod-github-runner-207 kernel: [62724.556056] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 22:49:10 juju-e4d256-prod-github-runner-207 kernel: [62724.557325] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 22:49:10 juju-e4d256-prod-github-runner-207 kernel: [62724.558551] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:49:10 juju-e4d256-prod-github-runner-207 kernel: [62724.559624] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 22:49:10 juju-e4d256-prod-github-runner-207 kernel: [62724.562176] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 22:49:10 juju-e4d256-prod-github-runner-207 kernel: [62724.563237] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 22:49:10 juju-e4d256-prod-github-runner-207 kernel: [62724.564399] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 22:49:10 juju-e4d256-prod-github-runner-207 kernel: [62724.565564] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 22:49:10 juju-e4d256-prod-github-runner-207 kernel: [62724.566731] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 22:49:10 juju-e4d256-prod-github-runner-207 kernel: [62724.567947] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 22:49:10 juju-e4d256-prod-github-runner-207 kernel: [62724.569131] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 22:49:10 juju-e4d256-prod-github-runner-207 kernel: [62724.570366] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 22:49:10 juju-e4d256-prod-github-runner-207 kernel: [62724.571479] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 22:49:10 juju-e4d256-prod-github-runner-207 kernel: [62724.572678] Call Trace: Aug 22 22:49:10 juju-e4d256-prod-github-runner-207 kernel: [62724.573596] Aug 22 22:49:10 juju-e4d256-prod-github-runner-207 kernel: [62724.574488] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:49:10 juju-e4d256-prod-github-runner-207 kernel: [62724.575530] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:49:10 juju-e4d256-prod-github-runner-207 kernel: [62724.576555] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:49:10 juju-e4d256-prod-github-runner-207 kernel: [62724.577649] ? show_regs.part.0+0x23/0x29 Aug 22 22:49:10 juju-e4d256-prod-github-runner-207 kernel: [62724.578651] ? show_regs.cold+0x8/0xd Aug 22 22:49:10 juju-e4d256-prod-github-runner-207 kernel: [62724.579639] ? watchdog_timer_fn+0x1be/0x220 Aug 22 22:49:10 juju-e4d256-prod-github-runner-207 kernel: [62724.580651] ? lockup_detector_update_enable+0x60/0x60 Aug 22 22:49:10 juju-e4d256-prod-github-runner-207 kernel: [62724.581718] ? __hrtimer_run_queues+0x107/0x230 Aug 22 22:49:10 juju-e4d256-prod-github-runner-207 kernel: [62724.582751] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 22:49:10 juju-e4d256-prod-github-runner-207 kernel: [62724.583796] ? hrtimer_interrupt+0x101/0x220 Aug 22 22:49:10 juju-e4d256-prod-github-runner-207 kernel: [62724.584810] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 22:49:10 juju-e4d256-prod-github-runner-207 kernel: [62724.585876] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 22:49:10 juju-e4d256-prod-github-runner-207 kernel: [62724.586923] Aug 22 22:49:10 juju-e4d256-prod-github-runner-207 kernel: [62724.587793] Aug 22 22:49:10 juju-e4d256-prod-github-runner-207 kernel: [62724.588630] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 22:49:10 juju-e4d256-prod-github-runner-207 kernel: [62724.589662] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:49:10 juju-e4d256-prod-github-runner-207 kernel: [62724.590698] ? _raw_spin_lock+0x22/0x30 Aug 22 22:49:10 juju-e4d256-prod-github-runner-207 kernel: [62724.591655] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:49:10 juju-e4d256-prod-github-runner-207 kernel: [62724.592669] direct_page_fault+0x206/0x310 [kvm] Aug 22 22:49:10 juju-e4d256-prod-github-runner-207 kernel: [62724.593692] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 22:49:10 juju-e4d256-prod-github-runner-207 kernel: [62724.594698] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 22:49:10 juju-e4d256-prod-github-runner-207 kernel: [62724.595713] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 22:49:10 juju-e4d256-prod-github-runner-207 kernel: [62724.596705] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 22:49:10 juju-e4d256-prod-github-runner-207 kernel: [62724.597653] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 22:49:10 juju-e4d256-prod-github-runner-207 kernel: [62724.598633] handle_exit+0x98/0x230 [kvm_amd] Aug 22 22:49:10 juju-e4d256-prod-github-runner-207 kernel: [62724.599533] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 22:49:10 juju-e4d256-prod-github-runner-207 kernel: [62724.600445] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 22:49:10 juju-e4d256-prod-github-runner-207 kernel: [62724.601369] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 22:49:10 juju-e4d256-prod-github-runner-207 kernel: [62724.602272] vcpu_run+0x62/0x2c0 [kvm] Aug 22 22:49:10 juju-e4d256-prod-github-runner-207 kernel: [62724.603098] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 22:49:10 juju-e4d256-prod-github-runner-207 kernel: [62724.603909] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 22:49:10 juju-e4d256-prod-github-runner-207 kernel: [62724.604767] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 22:49:10 juju-e4d256-prod-github-runner-207 kernel: [62724.605674] ? __seccomp_filter+0x4a/0x4a0 Aug 22 22:49:10 juju-e4d256-prod-github-runner-207 kernel: [62724.606481] ? __fget_files+0x86/0xc0 Aug 22 22:49:10 juju-e4d256-prod-github-runner-207 kernel: [62724.607203] __x64_sys_ioctl+0x95/0xd0 Aug 22 22:49:10 juju-e4d256-prod-github-runner-207 kernel: [62724.607897] do_syscall_64+0x5c/0xc0 Aug 22 22:49:10 juju-e4d256-prod-github-runner-207 kernel: [62724.608563] ? do_futex+0x162/0x1f0 Aug 22 22:49:10 juju-e4d256-prod-github-runner-207 kernel: [62724.609218] ? __x64_sys_futex+0x78/0x1e0 Aug 22 22:49:10 juju-e4d256-prod-github-runner-207 kernel: [62724.609891] ? __secure_computing+0xa9/0x120 Aug 22 22:49:10 juju-e4d256-prod-github-runner-207 kernel: [62724.610580] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 22:49:10 juju-e4d256-prod-github-runner-207 kernel: [62724.611353] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:49:10 juju-e4d256-prod-github-runner-207 kernel: [62724.612075] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:49:10 juju-e4d256-prod-github-runner-207 kernel: [62724.612794] ? do_syscall_64+0x69/0xc0 Aug 22 22:49:10 juju-e4d256-prod-github-runner-207 kernel: [62724.613443] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:49:10 juju-e4d256-prod-github-runner-207 kernel: [62724.614151] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:49:10 juju-e4d256-prod-github-runner-207 kernel: [62724.614850] ? do_syscall_64+0x69/0xc0 Aug 22 22:49:10 juju-e4d256-prod-github-runner-207 kernel: [62724.615502] ? do_syscall_64+0x69/0xc0 Aug 22 22:49:10 juju-e4d256-prod-github-runner-207 kernel: [62724.616211] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 22:49:10 juju-e4d256-prod-github-runner-207 kernel: [62724.616921] RIP: 0033:0x7faa5d0edaff Aug 22 22:49:10 juju-e4d256-prod-github-runner-207 kernel: [62724.617566] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 22:49:10 juju-e4d256-prod-github-runner-207 kernel: [62724.619592] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 22:49:10 juju-e4d256-prod-github-runner-207 kernel: [62724.620504] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 22:49:10 juju-e4d256-prod-github-runner-207 kernel: [62724.621395] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 22:49:10 juju-e4d256-prod-github-runner-207 kernel: [62724.622283] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 22:49:10 juju-e4d256-prod-github-runner-207 kernel: [62724.623185] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 22:49:10 juju-e4d256-prod-github-runner-207 kernel: [62724.624077] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 22:49:10 juju-e4d256-prod-github-runner-207 kernel: [62724.624973] Aug 22 22:49:38 juju-e4d256-prod-github-runner-207 kernel: [62752.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 58334s! [qemu-system-x86:6715] Aug 22 22:49:38 juju-e4d256-prod-github-runner-207 kernel: [62752.543204] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 22:49:38 juju-e4d256-prod-github-runner-207 kernel: [62752.543272] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 22:49:38 juju-e4d256-prod-github-runner-207 kernel: [62752.555545] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 22:49:38 juju-e4d256-prod-github-runner-207 kernel: [62752.556808] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 22:49:38 juju-e4d256-prod-github-runner-207 kernel: [62752.558021] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:49:38 juju-e4d256-prod-github-runner-207 kernel: [62752.559083] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 22:49:38 juju-e4d256-prod-github-runner-207 kernel: [62752.561619] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 22:49:38 juju-e4d256-prod-github-runner-207 kernel: [62752.562660] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 22:49:38 juju-e4d256-prod-github-runner-207 kernel: [62752.563834] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 22:49:38 juju-e4d256-prod-github-runner-207 kernel: [62752.564989] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 22:49:38 juju-e4d256-prod-github-runner-207 kernel: [62752.566151] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 22:49:38 juju-e4d256-prod-github-runner-207 kernel: [62752.567331] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 22:49:38 juju-e4d256-prod-github-runner-207 kernel: [62752.568516] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 22:49:38 juju-e4d256-prod-github-runner-207 kernel: [62752.569747] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 22:49:38 juju-e4d256-prod-github-runner-207 kernel: [62752.570852] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 22:49:38 juju-e4d256-prod-github-runner-207 kernel: [62752.572048] Call Trace: Aug 22 22:49:38 juju-e4d256-prod-github-runner-207 kernel: [62752.572959] Aug 22 22:49:38 juju-e4d256-prod-github-runner-207 kernel: [62752.573840] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:49:38 juju-e4d256-prod-github-runner-207 kernel: [62752.574874] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:49:38 juju-e4d256-prod-github-runner-207 kernel: [62752.575899] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:49:38 juju-e4d256-prod-github-runner-207 kernel: [62752.576970] ? show_regs.part.0+0x23/0x29 Aug 22 22:49:38 juju-e4d256-prod-github-runner-207 kernel: [62752.577964] ? show_regs.cold+0x8/0xd Aug 22 22:49:38 juju-e4d256-prod-github-runner-207 kernel: [62752.578938] ? watchdog_timer_fn+0x1be/0x220 Aug 22 22:49:38 juju-e4d256-prod-github-runner-207 kernel: [62752.579951] ? lockup_detector_update_enable+0x60/0x60 Aug 22 22:49:38 juju-e4d256-prod-github-runner-207 kernel: [62752.581016] ? __hrtimer_run_queues+0x107/0x230 Aug 22 22:49:38 juju-e4d256-prod-github-runner-207 kernel: [62752.582047] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 22:49:38 juju-e4d256-prod-github-runner-207 kernel: [62752.583076] ? hrtimer_interrupt+0x101/0x220 Aug 22 22:49:38 juju-e4d256-prod-github-runner-207 kernel: [62752.584152] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 22:49:38 juju-e4d256-prod-github-runner-207 kernel: [62752.585388] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 22:49:38 juju-e4d256-prod-github-runner-207 kernel: [62752.586554] Aug 22 22:49:38 juju-e4d256-prod-github-runner-207 kernel: [62752.587481] Aug 22 22:49:38 juju-e4d256-prod-github-runner-207 kernel: [62752.588362] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 22:49:38 juju-e4d256-prod-github-runner-207 kernel: [62752.589493] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:49:38 juju-e4d256-prod-github-runner-207 kernel: [62752.590631] ? _raw_spin_lock+0x22/0x30 Aug 22 22:49:38 juju-e4d256-prod-github-runner-207 kernel: [62752.591669] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:49:38 juju-e4d256-prod-github-runner-207 kernel: [62752.592793] direct_page_fault+0x206/0x310 [kvm] Aug 22 22:49:38 juju-e4d256-prod-github-runner-207 kernel: [62752.593906] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 22:49:38 juju-e4d256-prod-github-runner-207 kernel: [62752.595014] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 22:49:38 juju-e4d256-prod-github-runner-207 kernel: [62752.596107] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 22:49:38 juju-e4d256-prod-github-runner-207 kernel: [62752.597178] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 22:49:38 juju-e4d256-prod-github-runner-207 kernel: [62752.598214] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 22:49:38 juju-e4d256-prod-github-runner-207 kernel: [62752.599319] handle_exit+0x98/0x230 [kvm_amd] Aug 22 22:49:38 juju-e4d256-prod-github-runner-207 kernel: [62752.600298] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 22:49:38 juju-e4d256-prod-github-runner-207 kernel: [62752.601297] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 22:49:38 juju-e4d256-prod-github-runner-207 kernel: [62752.602323] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 22:49:38 juju-e4d256-prod-github-runner-207 kernel: [62752.603341] vcpu_run+0x62/0x2c0 [kvm] Aug 22 22:49:38 juju-e4d256-prod-github-runner-207 kernel: [62752.604227] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 22:49:38 juju-e4d256-prod-github-runner-207 kernel: [62752.605124] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 22:49:38 juju-e4d256-prod-github-runner-207 kernel: [62752.606073] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 22:49:38 juju-e4d256-prod-github-runner-207 kernel: [62752.606974] ? __seccomp_filter+0x4a/0x4a0 Aug 22 22:49:38 juju-e4d256-prod-github-runner-207 kernel: [62752.607800] ? __fget_files+0x86/0xc0 Aug 22 22:49:38 juju-e4d256-prod-github-runner-207 kernel: [62752.608573] __x64_sys_ioctl+0x95/0xd0 Aug 22 22:49:38 juju-e4d256-prod-github-runner-207 kernel: [62752.609341] do_syscall_64+0x5c/0xc0 Aug 22 22:49:38 juju-e4d256-prod-github-runner-207 kernel: [62752.610080] ? do_futex+0x162/0x1f0 Aug 22 22:49:38 juju-e4d256-prod-github-runner-207 kernel: [62752.610805] ? __x64_sys_futex+0x78/0x1e0 Aug 22 22:49:38 juju-e4d256-prod-github-runner-207 kernel: [62752.611560] ? __secure_computing+0xa9/0x120 Aug 22 22:49:38 juju-e4d256-prod-github-runner-207 kernel: [62752.612335] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 22:49:38 juju-e4d256-prod-github-runner-207 kernel: [62752.613196] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:49:38 juju-e4d256-prod-github-runner-207 kernel: [62752.614033] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:49:38 juju-e4d256-prod-github-runner-207 kernel: [62752.614882] ? do_syscall_64+0x69/0xc0 Aug 22 22:49:38 juju-e4d256-prod-github-runner-207 kernel: [62752.615604] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:49:38 juju-e4d256-prod-github-runner-207 kernel: [62752.616400] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:49:38 juju-e4d256-prod-github-runner-207 kernel: [62752.617185] ? do_syscall_64+0x69/0xc0 Aug 22 22:49:38 juju-e4d256-prod-github-runner-207 kernel: [62752.617885] ? do_syscall_64+0x69/0xc0 Aug 22 22:49:38 juju-e4d256-prod-github-runner-207 kernel: [62752.618581] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 22:49:38 juju-e4d256-prod-github-runner-207 kernel: [62752.619407] RIP: 0033:0x7faa5d0edaff Aug 22 22:49:38 juju-e4d256-prod-github-runner-207 kernel: [62752.620101] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 22:49:38 juju-e4d256-prod-github-runner-207 kernel: [62752.622414] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 22:49:38 juju-e4d256-prod-github-runner-207 kernel: [62752.623480] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 22:49:38 juju-e4d256-prod-github-runner-207 kernel: [62752.624502] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 22:49:38 juju-e4d256-prod-github-runner-207 kernel: [62752.625522] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 22:49:38 juju-e4d256-prod-github-runner-207 kernel: [62752.626542] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 22:49:38 juju-e4d256-prod-github-runner-207 kernel: [62752.627571] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 22:49:38 juju-e4d256-prod-github-runner-207 kernel: [62752.628594] Aug 22 22:50:06 juju-e4d256-prod-github-runner-207 kernel: [62780.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 58360s! [qemu-system-x86:6715] Aug 22 22:50:06 juju-e4d256-prod-github-runner-207 kernel: [62780.543850] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 22:50:06 juju-e4d256-prod-github-runner-207 kernel: [62780.544129] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 22:50:06 juju-e4d256-prod-github-runner-207 kernel: [62780.556888] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 22:50:06 juju-e4d256-prod-github-runner-207 kernel: [62780.558224] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 22:50:06 juju-e4d256-prod-github-runner-207 kernel: [62780.559469] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:50:06 juju-e4d256-prod-github-runner-207 kernel: [62780.560529] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 22:50:06 juju-e4d256-prod-github-runner-207 kernel: [62780.563096] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 22:50:06 juju-e4d256-prod-github-runner-207 kernel: [62780.564144] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 22:50:06 juju-e4d256-prod-github-runner-207 kernel: [62780.565309] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 22:50:06 juju-e4d256-prod-github-runner-207 kernel: [62780.566489] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 22:50:06 juju-e4d256-prod-github-runner-207 kernel: [62780.567653] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 22:50:06 juju-e4d256-prod-github-runner-207 kernel: [62780.568816] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 22:50:06 juju-e4d256-prod-github-runner-207 kernel: [62780.570071] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 22:50:06 juju-e4d256-prod-github-runner-207 kernel: [62780.571412] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 22:50:06 juju-e4d256-prod-github-runner-207 kernel: [62780.572671] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 22:50:06 juju-e4d256-prod-github-runner-207 kernel: [62780.573975] Call Trace: Aug 22 22:50:06 juju-e4d256-prod-github-runner-207 kernel: [62780.574984] Aug 22 22:50:06 juju-e4d256-prod-github-runner-207 kernel: [62780.575887] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:50:06 juju-e4d256-prod-github-runner-207 kernel: [62780.576950] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:50:06 juju-e4d256-prod-github-runner-207 kernel: [62780.578041] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:50:06 juju-e4d256-prod-github-runner-207 kernel: [62780.579250] ? show_regs.part.0+0x23/0x29 Aug 22 22:50:06 juju-e4d256-prod-github-runner-207 kernel: [62780.580247] ? show_regs.cold+0x8/0xd Aug 22 22:50:06 juju-e4d256-prod-github-runner-207 kernel: [62780.581236] ? watchdog_timer_fn+0x1be/0x220 Aug 22 22:50:06 juju-e4d256-prod-github-runner-207 kernel: [62780.582314] ? lockup_detector_update_enable+0x60/0x60 Aug 22 22:50:06 juju-e4d256-prod-github-runner-207 kernel: [62780.583489] ? __hrtimer_run_queues+0x107/0x230 Aug 22 22:50:06 juju-e4d256-prod-github-runner-207 kernel: [62780.584531] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 22:50:06 juju-e4d256-prod-github-runner-207 kernel: [62780.585556] ? hrtimer_interrupt+0x101/0x220 Aug 22 22:50:06 juju-e4d256-prod-github-runner-207 kernel: [62780.586649] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 22:50:06 juju-e4d256-prod-github-runner-207 kernel: [62780.587724] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 22:50:06 juju-e4d256-prod-github-runner-207 kernel: [62780.588777] Aug 22 22:50:06 juju-e4d256-prod-github-runner-207 kernel: [62780.589790] Aug 22 22:50:06 juju-e4d256-prod-github-runner-207 kernel: [62780.590722] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 22:50:06 juju-e4d256-prod-github-runner-207 kernel: [62780.591894] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:50:06 juju-e4d256-prod-github-runner-207 kernel: [62780.592934] ? _raw_spin_lock+0x22/0x30 Aug 22 22:50:06 juju-e4d256-prod-github-runner-207 kernel: [62780.593885] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:50:06 juju-e4d256-prod-github-runner-207 kernel: [62780.595016] direct_page_fault+0x206/0x310 [kvm] Aug 22 22:50:06 juju-e4d256-prod-github-runner-207 kernel: [62780.596049] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 22:50:06 juju-e4d256-prod-github-runner-207 kernel: [62780.597066] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 22:50:06 juju-e4d256-prod-github-runner-207 kernel: [62780.598068] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 22:50:06 juju-e4d256-prod-github-runner-207 kernel: [62780.599118] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 22:50:06 juju-e4d256-prod-github-runner-207 kernel: [62780.600067] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 22:50:06 juju-e4d256-prod-github-runner-207 kernel: [62780.601115] handle_exit+0x98/0x230 [kvm_amd] Aug 22 22:50:06 juju-e4d256-prod-github-runner-207 kernel: [62780.602268] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 22:50:06 juju-e4d256-prod-github-runner-207 kernel: [62780.603323] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 22:50:06 juju-e4d256-prod-github-runner-207 kernel: [62780.604510] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 22:50:06 juju-e4d256-prod-github-runner-207 kernel: [62780.605452] vcpu_run+0x62/0x2c0 [kvm] Aug 22 22:50:06 juju-e4d256-prod-github-runner-207 kernel: [62780.606357] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 22:50:06 juju-e4d256-prod-github-runner-207 kernel: [62780.607229] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 22:50:06 juju-e4d256-prod-github-runner-207 kernel: [62780.608122] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 22:50:06 juju-e4d256-prod-github-runner-207 kernel: [62780.608988] ? __seccomp_filter+0x4a/0x4a0 Aug 22 22:50:06 juju-e4d256-prod-github-runner-207 kernel: [62780.609837] ? __fget_files+0x86/0xc0 Aug 22 22:50:06 juju-e4d256-prod-github-runner-207 kernel: [62780.610667] __x64_sys_ioctl+0x95/0xd0 Aug 22 22:50:06 juju-e4d256-prod-github-runner-207 kernel: [62780.611371] do_syscall_64+0x5c/0xc0 Aug 22 22:50:06 juju-e4d256-prod-github-runner-207 kernel: [62780.612039] ? do_futex+0x162/0x1f0 Aug 22 22:50:06 juju-e4d256-prod-github-runner-207 kernel: [62780.612689] ? __x64_sys_futex+0x78/0x1e0 Aug 22 22:50:06 juju-e4d256-prod-github-runner-207 kernel: [62780.613365] ? __secure_computing+0xa9/0x120 Aug 22 22:50:06 juju-e4d256-prod-github-runner-207 kernel: [62780.614055] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 22:50:06 juju-e4d256-prod-github-runner-207 kernel: [62780.614883] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:50:06 juju-e4d256-prod-github-runner-207 kernel: [62780.615613] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:50:06 juju-e4d256-prod-github-runner-207 kernel: [62780.616332] ? do_syscall_64+0x69/0xc0 Aug 22 22:50:06 juju-e4d256-prod-github-runner-207 kernel: [62780.616981] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:50:06 juju-e4d256-prod-github-runner-207 kernel: [62780.617687] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:50:06 juju-e4d256-prod-github-runner-207 kernel: [62780.618415] ? do_syscall_64+0x69/0xc0 Aug 22 22:50:06 juju-e4d256-prod-github-runner-207 kernel: [62780.619079] ? do_syscall_64+0x69/0xc0 Aug 22 22:50:06 juju-e4d256-prod-github-runner-207 kernel: [62780.619702] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 22:50:06 juju-e4d256-prod-github-runner-207 kernel: [62780.620414] RIP: 0033:0x7faa5d0edaff Aug 22 22:50:06 juju-e4d256-prod-github-runner-207 kernel: [62780.621069] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 22:50:06 juju-e4d256-prod-github-runner-207 kernel: [62780.623240] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 22:50:06 juju-e4d256-prod-github-runner-207 kernel: [62780.624158] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 22:50:06 juju-e4d256-prod-github-runner-207 kernel: [62780.625050] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 22:50:06 juju-e4d256-prod-github-runner-207 kernel: [62780.625947] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 22:50:06 juju-e4d256-prod-github-runner-207 kernel: [62780.626862] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 22:50:06 juju-e4d256-prod-github-runner-207 kernel: [62780.627760] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 22:50:06 juju-e4d256-prod-github-runner-207 kernel: [62780.628660] Aug 22 22:50:34 juju-e4d256-prod-github-runner-207 kernel: [62808.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 58387s! [qemu-system-x86:6715] Aug 22 22:50:34 juju-e4d256-prod-github-runner-207 kernel: [62808.543105] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 22:50:34 juju-e4d256-prod-github-runner-207 kernel: [62808.543171] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 22:50:34 juju-e4d256-prod-github-runner-207 kernel: [62808.555380] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 22:50:34 juju-e4d256-prod-github-runner-207 kernel: [62808.556660] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 22:50:34 juju-e4d256-prod-github-runner-207 kernel: [62808.557877] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:50:34 juju-e4d256-prod-github-runner-207 kernel: [62808.558955] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 22:50:34 juju-e4d256-prod-github-runner-207 kernel: [62808.561492] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 22:50:34 juju-e4d256-prod-github-runner-207 kernel: [62808.562542] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 22:50:34 juju-e4d256-prod-github-runner-207 kernel: [62808.563701] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 22:50:34 juju-e4d256-prod-github-runner-207 kernel: [62808.565071] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 22:50:34 juju-e4d256-prod-github-runner-207 kernel: [62808.566270] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 22:50:34 juju-e4d256-prod-github-runner-207 kernel: [62808.567439] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 22:50:34 juju-e4d256-prod-github-runner-207 kernel: [62808.568629] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 22:50:34 juju-e4d256-prod-github-runner-207 kernel: [62808.569864] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 22:50:34 juju-e4d256-prod-github-runner-207 kernel: [62808.570979] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 22:50:34 juju-e4d256-prod-github-runner-207 kernel: [62808.572168] Call Trace: Aug 22 22:50:34 juju-e4d256-prod-github-runner-207 kernel: [62808.573077] Aug 22 22:50:34 juju-e4d256-prod-github-runner-207 kernel: [62808.573959] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:50:34 juju-e4d256-prod-github-runner-207 kernel: [62808.575004] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:50:34 juju-e4d256-prod-github-runner-207 kernel: [62808.576023] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:50:34 juju-e4d256-prod-github-runner-207 kernel: [62808.577094] ? show_regs.part.0+0x23/0x29 Aug 22 22:50:34 juju-e4d256-prod-github-runner-207 kernel: [62808.578103] ? show_regs.cold+0x8/0xd Aug 22 22:50:34 juju-e4d256-prod-github-runner-207 kernel: [62808.579102] ? watchdog_timer_fn+0x1be/0x220 Aug 22 22:50:34 juju-e4d256-prod-github-runner-207 kernel: [62808.580124] ? lockup_detector_update_enable+0x60/0x60 Aug 22 22:50:34 juju-e4d256-prod-github-runner-207 kernel: [62808.581187] ? __hrtimer_run_queues+0x107/0x230 Aug 22 22:50:34 juju-e4d256-prod-github-runner-207 kernel: [62808.582255] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 22:50:34 juju-e4d256-prod-github-runner-207 kernel: [62808.583289] ? hrtimer_interrupt+0x101/0x220 Aug 22 22:50:34 juju-e4d256-prod-github-runner-207 kernel: [62808.584302] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 22:50:34 juju-e4d256-prod-github-runner-207 kernel: [62808.585373] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 22:50:34 juju-e4d256-prod-github-runner-207 kernel: [62808.586435] Aug 22 22:50:34 juju-e4d256-prod-github-runner-207 kernel: [62808.587290] Aug 22 22:50:34 juju-e4d256-prod-github-runner-207 kernel: [62808.588131] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 22:50:34 juju-e4d256-prod-github-runner-207 kernel: [62808.589165] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:50:34 juju-e4d256-prod-github-runner-207 kernel: [62808.590215] ? _raw_spin_lock+0x22/0x30 Aug 22 22:50:34 juju-e4d256-prod-github-runner-207 kernel: [62808.591160] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:50:34 juju-e4d256-prod-github-runner-207 kernel: [62808.592184] direct_page_fault+0x206/0x310 [kvm] Aug 22 22:50:34 juju-e4d256-prod-github-runner-207 kernel: [62808.593204] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 22:50:34 juju-e4d256-prod-github-runner-207 kernel: [62808.594223] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 22:50:34 juju-e4d256-prod-github-runner-207 kernel: [62808.595257] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 22:50:34 juju-e4d256-prod-github-runner-207 kernel: [62808.596242] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 22:50:34 juju-e4d256-prod-github-runner-207 kernel: [62808.597187] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 22:50:34 juju-e4d256-prod-github-runner-207 kernel: [62808.598208] handle_exit+0x98/0x230 [kvm_amd] Aug 22 22:50:34 juju-e4d256-prod-github-runner-207 kernel: [62808.599112] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 22:50:34 juju-e4d256-prod-github-runner-207 kernel: [62808.600027] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 22:50:34 juju-e4d256-prod-github-runner-207 kernel: [62808.600953] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 22:50:34 juju-e4d256-prod-github-runner-207 kernel: [62808.601863] vcpu_run+0x62/0x2c0 [kvm] Aug 22 22:50:34 juju-e4d256-prod-github-runner-207 kernel: [62808.602692] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 22:50:34 juju-e4d256-prod-github-runner-207 kernel: [62808.603505] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 22:50:34 juju-e4d256-prod-github-runner-207 kernel: [62808.604361] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 22:50:34 juju-e4d256-prod-github-runner-207 kernel: [62808.605163] ? __seccomp_filter+0x4a/0x4a0 Aug 22 22:50:34 juju-e4d256-prod-github-runner-207 kernel: [62808.605953] ? __fget_files+0x86/0xc0 Aug 22 22:50:34 juju-e4d256-prod-github-runner-207 kernel: [62808.606686] __x64_sys_ioctl+0x95/0xd0 Aug 22 22:50:34 juju-e4d256-prod-github-runner-207 kernel: [62808.607384] do_syscall_64+0x5c/0xc0 Aug 22 22:50:34 juju-e4d256-prod-github-runner-207 kernel: [62808.608053] ? do_futex+0x162/0x1f0 Aug 22 22:50:34 juju-e4d256-prod-github-runner-207 kernel: [62808.608703] ? __x64_sys_futex+0x78/0x1e0 Aug 22 22:50:34 juju-e4d256-prod-github-runner-207 kernel: [62808.609383] ? __secure_computing+0xa9/0x120 Aug 22 22:50:34 juju-e4d256-prod-github-runner-207 kernel: [62808.610089] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 22:50:34 juju-e4d256-prod-github-runner-207 kernel: [62808.610857] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:50:34 juju-e4d256-prod-github-runner-207 kernel: [62808.611602] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:50:34 juju-e4d256-prod-github-runner-207 kernel: [62808.612341] ? do_syscall_64+0x69/0xc0 Aug 22 22:50:34 juju-e4d256-prod-github-runner-207 kernel: [62808.612992] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:50:34 juju-e4d256-prod-github-runner-207 kernel: [62808.613696] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:50:34 juju-e4d256-prod-github-runner-207 kernel: [62808.614577] ? do_syscall_64+0x69/0xc0 Aug 22 22:50:34 juju-e4d256-prod-github-runner-207 kernel: [62808.615296] ? do_syscall_64+0x69/0xc0 Aug 22 22:50:34 juju-e4d256-prod-github-runner-207 kernel: [62808.615997] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 22:50:34 juju-e4d256-prod-github-runner-207 kernel: [62808.616801] RIP: 0033:0x7faa5d0edaff Aug 22 22:50:34 juju-e4d256-prod-github-runner-207 kernel: [62808.617511] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 22:50:34 juju-e4d256-prod-github-runner-207 kernel: [62808.619847] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 22:50:34 juju-e4d256-prod-github-runner-207 kernel: [62808.620914] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 22:50:34 juju-e4d256-prod-github-runner-207 kernel: [62808.621942] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 22:50:34 juju-e4d256-prod-github-runner-207 kernel: [62808.622995] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 22:50:34 juju-e4d256-prod-github-runner-207 kernel: [62808.624189] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 22:50:34 juju-e4d256-prod-github-runner-207 kernel: [62808.625220] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 22:50:34 juju-e4d256-prod-github-runner-207 kernel: [62808.626281] Aug 22 22:50:47 juju-e4d256-prod-github-runner-207 kernel: [62821.376706] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 22:50:47 juju-e4d256-prod-github-runner-207 kernel: [62821.377666] rcu: 1-....: (15626622 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=7545194 Aug 22 22:50:47 juju-e4d256-prod-github-runner-207 kernel: [62821.378789] (t=15676044 jiffies g=23269 q=55740) Aug 22 22:50:47 juju-e4d256-prod-github-runner-207 kernel: [62821.379581] NMI backtrace for cpu 1 Aug 22 22:50:47 juju-e4d256-prod-github-runner-207 kernel: [62821.380287] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 22:50:47 juju-e4d256-prod-github-runner-207 kernel: [62821.381385] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 22:50:47 juju-e4d256-prod-github-runner-207 kernel: [62821.382450] Call Trace: Aug 22 22:50:47 juju-e4d256-prod-github-runner-207 kernel: [62821.383128] Aug 22 22:50:47 juju-e4d256-prod-github-runner-207 kernel: [62821.383775] show_stack+0x52/0x5c Aug 22 22:50:47 juju-e4d256-prod-github-runner-207 kernel: [62821.384496] dump_stack_lvl+0x4a/0x63 Aug 22 22:50:47 juju-e4d256-prod-github-runner-207 kernel: [62821.385238] dump_stack+0x10/0x16 Aug 22 22:50:47 juju-e4d256-prod-github-runner-207 kernel: [62821.385968] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 22:50:47 juju-e4d256-prod-github-runner-207 kernel: [62821.386747] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 22:50:47 juju-e4d256-prod-github-runner-207 kernel: [62821.387523] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 22:50:47 juju-e4d256-prod-github-runner-207 kernel: [62821.388345] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 22:50:47 juju-e4d256-prod-github-runner-207 kernel: [62821.389162] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 22:50:47 juju-e4d256-prod-github-runner-207 kernel: [62821.389978] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 22:50:47 juju-e4d256-prod-github-runner-207 kernel: [62821.390749] print_cpu_stall.cold+0x2f/0xe2 Aug 22 22:50:47 juju-e4d256-prod-github-runner-207 kernel: [62821.391511] ? timekeeping_update+0xf7/0x150 Aug 22 22:50:47 juju-e4d256-prod-github-runner-207 kernel: [62821.392280] check_cpu_stall+0x109/0x270 Aug 22 22:50:47 juju-e4d256-prod-github-runner-207 kernel: [62821.393028] rcu_sched_clock_irq+0x9a/0x250 Aug 22 22:50:47 juju-e4d256-prod-github-runner-207 kernel: [62821.393787] update_process_times+0x94/0xd0 Aug 22 22:50:47 juju-e4d256-prod-github-runner-207 kernel: [62821.394550] tick_sched_handle+0x29/0x70 Aug 22 22:50:47 juju-e4d256-prod-github-runner-207 kernel: [62821.395293] tick_sched_timer+0x8c/0xc0 Aug 22 22:50:47 juju-e4d256-prod-github-runner-207 kernel: [62821.396035] ? tick_nohz_handler+0xb0/0xb0 Aug 22 22:50:47 juju-e4d256-prod-github-runner-207 kernel: [62821.396787] __hrtimer_run_queues+0x107/0x230 Aug 22 22:50:47 juju-e4d256-prod-github-runner-207 kernel: [62821.397558] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 22:50:47 juju-e4d256-prod-github-runner-207 kernel: [62821.398337] hrtimer_interrupt+0x101/0x220 Aug 22 22:50:47 juju-e4d256-prod-github-runner-207 kernel: [62821.399100] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 22:50:47 juju-e4d256-prod-github-runner-207 kernel: [62821.399916] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 22:50:47 juju-e4d256-prod-github-runner-207 kernel: [62821.400718] Aug 22 22:50:47 juju-e4d256-prod-github-runner-207 kernel: [62821.401353] Aug 22 22:50:47 juju-e4d256-prod-github-runner-207 kernel: [62821.401992] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 22:50:47 juju-e4d256-prod-github-runner-207 kernel: [62821.402810] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:50:47 juju-e4d256-prod-github-runner-207 kernel: [62821.403692] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 22:50:47 juju-e4d256-prod-github-runner-207 kernel: [62821.405928] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 22:50:47 juju-e4d256-prod-github-runner-207 kernel: [62821.406804] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 22:50:47 juju-e4d256-prod-github-runner-207 kernel: [62821.407795] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 22:50:47 juju-e4d256-prod-github-runner-207 kernel: [62821.408769] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 22:50:47 juju-e4d256-prod-github-runner-207 kernel: [62821.409877] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 22:50:47 juju-e4d256-prod-github-runner-207 kernel: [62821.410842] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 22:50:47 juju-e4d256-prod-github-runner-207 kernel: [62821.411793] ? _raw_spin_lock+0x22/0x30 Aug 22 22:50:47 juju-e4d256-prod-github-runner-207 kernel: [62821.412555] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:50:47 juju-e4d256-prod-github-runner-207 kernel: [62821.413393] direct_page_fault+0x206/0x310 [kvm] Aug 22 22:50:47 juju-e4d256-prod-github-runner-207 kernel: [62821.414280] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 22:50:47 juju-e4d256-prod-github-runner-207 kernel: [62821.415115] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 22:50:47 juju-e4d256-prod-github-runner-207 kernel: [62821.415938] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 22:50:47 juju-e4d256-prod-github-runner-207 kernel: [62821.416745] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 22:50:47 juju-e4d256-prod-github-runner-207 kernel: [62821.417529] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 22:50:47 juju-e4d256-prod-github-runner-207 kernel: [62821.418359] handle_exit+0x98/0x230 [kvm_amd] Aug 22 22:50:47 juju-e4d256-prod-github-runner-207 kernel: [62821.419124] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 22:50:47 juju-e4d256-prod-github-runner-207 kernel: [62821.419906] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 22:50:47 juju-e4d256-prod-github-runner-207 kernel: [62821.420709] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 22:50:47 juju-e4d256-prod-github-runner-207 kernel: [62821.421492] vcpu_run+0x62/0x2c0 [kvm] Aug 22 22:50:47 juju-e4d256-prod-github-runner-207 kernel: [62821.422221] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 22:50:47 juju-e4d256-prod-github-runner-207 kernel: [62821.422956] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 22:50:47 juju-e4d256-prod-github-runner-207 kernel: [62821.423760] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 22:50:47 juju-e4d256-prod-github-runner-207 kernel: [62821.424521] ? __seccomp_filter+0x4a/0x4a0 Aug 22 22:50:47 juju-e4d256-prod-github-runner-207 kernel: [62821.425240] ? __fget_files+0x86/0xc0 Aug 22 22:50:47 juju-e4d256-prod-github-runner-207 kernel: [62821.425939] __x64_sys_ioctl+0x95/0xd0 Aug 22 22:50:47 juju-e4d256-prod-github-runner-207 kernel: [62821.426749] do_syscall_64+0x5c/0xc0 Aug 22 22:50:47 juju-e4d256-prod-github-runner-207 kernel: [62821.427550] ? do_futex+0x162/0x1f0 Aug 22 22:50:47 juju-e4d256-prod-github-runner-207 kernel: [62821.428270] ? __x64_sys_futex+0x78/0x1e0 Aug 22 22:50:47 juju-e4d256-prod-github-runner-207 kernel: [62821.428976] ? __secure_computing+0xa9/0x120 Aug 22 22:50:47 juju-e4d256-prod-github-runner-207 kernel: [62821.429693] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 22:50:47 juju-e4d256-prod-github-runner-207 kernel: [62821.430493] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:50:47 juju-e4d256-prod-github-runner-207 kernel: [62821.431258] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:50:47 juju-e4d256-prod-github-runner-207 kernel: [62821.432013] ? do_syscall_64+0x69/0xc0 Aug 22 22:50:47 juju-e4d256-prod-github-runner-207 kernel: [62821.432705] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:50:47 juju-e4d256-prod-github-runner-207 kernel: [62821.433460] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:50:47 juju-e4d256-prod-github-runner-207 kernel: [62821.434237] ? do_syscall_64+0x69/0xc0 Aug 22 22:50:47 juju-e4d256-prod-github-runner-207 kernel: [62821.434932] ? do_syscall_64+0x69/0xc0 Aug 22 22:50:47 juju-e4d256-prod-github-runner-207 kernel: [62821.435619] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 22:50:47 juju-e4d256-prod-github-runner-207 kernel: [62821.436390] RIP: 0033:0x7faa5d0edaff Aug 22 22:50:47 juju-e4d256-prod-github-runner-207 kernel: [62821.437080] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 22:50:47 juju-e4d256-prod-github-runner-207 kernel: [62821.439189] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 22:50:47 juju-e4d256-prod-github-runner-207 kernel: [62821.440154] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 22:50:47 juju-e4d256-prod-github-runner-207 kernel: [62821.441104] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 22:50:47 juju-e4d256-prod-github-runner-207 kernel: [62821.442062] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 22:50:47 juju-e4d256-prod-github-runner-207 kernel: [62821.443002] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 22:50:47 juju-e4d256-prod-github-runner-207 kernel: [62821.443925] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 22:50:47 juju-e4d256-prod-github-runner-207 kernel: [62821.444837] Aug 22 22:51:14 juju-e4d256-prod-github-runner-207 kernel: [62848.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 58424s! [qemu-system-x86:6715] Aug 22 22:51:14 juju-e4d256-prod-github-runner-207 kernel: [62848.543143] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 22:51:14 juju-e4d256-prod-github-runner-207 kernel: [62848.543211] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 22:51:14 juju-e4d256-prod-github-runner-207 kernel: [62848.555526] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 22:51:14 juju-e4d256-prod-github-runner-207 kernel: [62848.556805] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 22:51:14 juju-e4d256-prod-github-runner-207 kernel: [62848.558121] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:51:14 juju-e4d256-prod-github-runner-207 kernel: [62848.559191] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 22:51:14 juju-e4d256-prod-github-runner-207 kernel: [62848.561903] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 22:51:14 juju-e4d256-prod-github-runner-207 kernel: [62848.562957] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 22:51:14 juju-e4d256-prod-github-runner-207 kernel: [62848.564123] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 22:51:14 juju-e4d256-prod-github-runner-207 kernel: [62848.565289] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 22:51:14 juju-e4d256-prod-github-runner-207 kernel: [62848.566542] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 22:51:14 juju-e4d256-prod-github-runner-207 kernel: [62848.567708] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 22:51:14 juju-e4d256-prod-github-runner-207 kernel: [62848.568895] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 22:51:14 juju-e4d256-prod-github-runner-207 kernel: [62848.570210] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 22:51:14 juju-e4d256-prod-github-runner-207 kernel: [62848.571307] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 22:51:14 juju-e4d256-prod-github-runner-207 kernel: [62848.572501] Call Trace: Aug 22 22:51:14 juju-e4d256-prod-github-runner-207 kernel: [62848.573416] Aug 22 22:51:14 juju-e4d256-prod-github-runner-207 kernel: [62848.574358] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:51:14 juju-e4d256-prod-github-runner-207 kernel: [62848.575393] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:51:14 juju-e4d256-prod-github-runner-207 kernel: [62848.576415] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:51:14 juju-e4d256-prod-github-runner-207 kernel: [62848.577488] ? show_regs.part.0+0x23/0x29 Aug 22 22:51:14 juju-e4d256-prod-github-runner-207 kernel: [62848.578542] ? show_regs.cold+0x8/0xd Aug 22 22:51:14 juju-e4d256-prod-github-runner-207 kernel: [62848.579513] ? watchdog_timer_fn+0x1be/0x220 Aug 22 22:51:14 juju-e4d256-prod-github-runner-207 kernel: [62848.580520] ? lockup_detector_update_enable+0x60/0x60 Aug 22 22:51:14 juju-e4d256-prod-github-runner-207 kernel: [62848.581604] ? __hrtimer_run_queues+0x107/0x230 Aug 22 22:51:14 juju-e4d256-prod-github-runner-207 kernel: [62848.582688] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 22:51:14 juju-e4d256-prod-github-runner-207 kernel: [62848.583723] ? hrtimer_interrupt+0x101/0x220 Aug 22 22:51:14 juju-e4d256-prod-github-runner-207 kernel: [62848.584813] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 22:51:14 juju-e4d256-prod-github-runner-207 kernel: [62848.586008] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 22:51:14 juju-e4d256-prod-github-runner-207 kernel: [62848.587069] Aug 22 22:51:14 juju-e4d256-prod-github-runner-207 kernel: [62848.587928] Aug 22 22:51:14 juju-e4d256-prod-github-runner-207 kernel: [62848.588777] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 22:51:14 juju-e4d256-prod-github-runner-207 kernel: [62848.590000] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:51:14 juju-e4d256-prod-github-runner-207 kernel: [62848.591100] ? _raw_spin_lock+0x22/0x30 Aug 22 22:51:14 juju-e4d256-prod-github-runner-207 kernel: [62848.592053] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:51:14 juju-e4d256-prod-github-runner-207 kernel: [62848.593084] direct_page_fault+0x206/0x310 [kvm] Aug 22 22:51:14 juju-e4d256-prod-github-runner-207 kernel: [62848.594208] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 22:51:14 juju-e4d256-prod-github-runner-207 kernel: [62848.595233] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 22:51:14 juju-e4d256-prod-github-runner-207 kernel: [62848.596236] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 22:51:14 juju-e4d256-prod-github-runner-207 kernel: [62848.597210] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 22:51:14 juju-e4d256-prod-github-runner-207 kernel: [62848.598268] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 22:51:14 juju-e4d256-prod-github-runner-207 kernel: [62848.599251] handle_exit+0x98/0x230 [kvm_amd] Aug 22 22:51:14 juju-e4d256-prod-github-runner-207 kernel: [62848.600143] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 22:51:14 juju-e4d256-prod-github-runner-207 kernel: [62848.601061] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 22:51:14 juju-e4d256-prod-github-runner-207 kernel: [62848.602065] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 22:51:14 juju-e4d256-prod-github-runner-207 kernel: [62848.602974] vcpu_run+0x62/0x2c0 [kvm] Aug 22 22:51:14 juju-e4d256-prod-github-runner-207 kernel: [62848.603790] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 22:51:14 juju-e4d256-prod-github-runner-207 kernel: [62848.604599] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 22:51:14 juju-e4d256-prod-github-runner-207 kernel: [62848.605457] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 22:51:14 juju-e4d256-prod-github-runner-207 kernel: [62848.606325] ? __seccomp_filter+0x4a/0x4a0 Aug 22 22:51:14 juju-e4d256-prod-github-runner-207 kernel: [62848.607066] ? __fget_files+0x86/0xc0 Aug 22 22:51:14 juju-e4d256-prod-github-runner-207 kernel: [62848.607767] __x64_sys_ioctl+0x95/0xd0 Aug 22 22:51:14 juju-e4d256-prod-github-runner-207 kernel: [62848.608458] do_syscall_64+0x5c/0xc0 Aug 22 22:51:14 juju-e4d256-prod-github-runner-207 kernel: [62848.609120] ? do_futex+0x162/0x1f0 Aug 22 22:51:14 juju-e4d256-prod-github-runner-207 kernel: [62848.609844] ? __x64_sys_futex+0x78/0x1e0 Aug 22 22:51:14 juju-e4d256-prod-github-runner-207 kernel: [62848.610531] ? __secure_computing+0xa9/0x120 Aug 22 22:51:14 juju-e4d256-prod-github-runner-207 kernel: [62848.611224] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 22:51:14 juju-e4d256-prod-github-runner-207 kernel: [62848.611981] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:51:14 juju-e4d256-prod-github-runner-207 kernel: [62848.612727] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:51:14 juju-e4d256-prod-github-runner-207 kernel: [62848.613465] ? do_syscall_64+0x69/0xc0 Aug 22 22:51:14 juju-e4d256-prod-github-runner-207 kernel: [62848.614145] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:51:14 juju-e4d256-prod-github-runner-207 kernel: [62848.614849] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:51:14 juju-e4d256-prod-github-runner-207 kernel: [62848.615583] ? do_syscall_64+0x69/0xc0 Aug 22 22:51:14 juju-e4d256-prod-github-runner-207 kernel: [62848.616214] ? do_syscall_64+0x69/0xc0 Aug 22 22:51:14 juju-e4d256-prod-github-runner-207 kernel: [62848.616834] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 22:51:14 juju-e4d256-prod-github-runner-207 kernel: [62848.617536] RIP: 0033:0x7faa5d0edaff Aug 22 22:51:14 juju-e4d256-prod-github-runner-207 kernel: [62848.618291] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 22:51:14 juju-e4d256-prod-github-runner-207 kernel: [62848.620296] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 22:51:14 juju-e4d256-prod-github-runner-207 kernel: [62848.621202] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 22:51:14 juju-e4d256-prod-github-runner-207 kernel: [62848.622095] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 22:51:14 juju-e4d256-prod-github-runner-207 kernel: [62848.622983] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 22:51:14 juju-e4d256-prod-github-runner-207 kernel: [62848.623864] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 22:51:14 juju-e4d256-prod-github-runner-207 kernel: [62848.624747] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 22:51:14 juju-e4d256-prod-github-runner-207 kernel: [62848.625675] Aug 22 22:51:42 juju-e4d256-prod-github-runner-207 kernel: [62876.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 58450s! [qemu-system-x86:6715] Aug 22 22:51:42 juju-e4d256-prod-github-runner-207 kernel: [62876.543776] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 22:51:42 juju-e4d256-prod-github-runner-207 kernel: [62876.544050] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 22:51:42 juju-e4d256-prod-github-runner-207 kernel: [62876.556405] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 22:51:42 juju-e4d256-prod-github-runner-207 kernel: [62876.557715] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 22:51:42 juju-e4d256-prod-github-runner-207 kernel: [62876.558936] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:51:42 juju-e4d256-prod-github-runner-207 kernel: [62876.559996] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 22:51:42 juju-e4d256-prod-github-runner-207 kernel: [62876.562566] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 22:51:42 juju-e4d256-prod-github-runner-207 kernel: [62876.563606] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 22:51:42 juju-e4d256-prod-github-runner-207 kernel: [62876.564773] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 22:51:42 juju-e4d256-prod-github-runner-207 kernel: [62876.565956] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 22:51:42 juju-e4d256-prod-github-runner-207 kernel: [62876.567123] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 22:51:42 juju-e4d256-prod-github-runner-207 kernel: [62876.568287] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 22:51:42 juju-e4d256-prod-github-runner-207 kernel: [62876.569467] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 22:51:42 juju-e4d256-prod-github-runner-207 kernel: [62876.570932] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 22:51:42 juju-e4d256-prod-github-runner-207 kernel: [62876.572068] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 22:51:42 juju-e4d256-prod-github-runner-207 kernel: [62876.573296] Call Trace: Aug 22 22:51:42 juju-e4d256-prod-github-runner-207 kernel: [62876.574211] Aug 22 22:51:42 juju-e4d256-prod-github-runner-207 kernel: [62876.575116] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:51:42 juju-e4d256-prod-github-runner-207 kernel: [62876.576160] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:51:42 juju-e4d256-prod-github-runner-207 kernel: [62876.577199] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:51:42 juju-e4d256-prod-github-runner-207 kernel: [62876.578372] ? show_regs.part.0+0x23/0x29 Aug 22 22:51:42 juju-e4d256-prod-github-runner-207 kernel: [62876.579383] ? show_regs.cold+0x8/0xd Aug 22 22:51:42 juju-e4d256-prod-github-runner-207 kernel: [62876.580357] ? watchdog_timer_fn+0x1be/0x220 Aug 22 22:51:42 juju-e4d256-prod-github-runner-207 kernel: [62876.581385] ? lockup_detector_update_enable+0x60/0x60 Aug 22 22:51:42 juju-e4d256-prod-github-runner-207 kernel: [62876.582448] ? __hrtimer_run_queues+0x107/0x230 Aug 22 22:51:42 juju-e4d256-prod-github-runner-207 kernel: [62876.583484] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 22:51:42 juju-e4d256-prod-github-runner-207 kernel: [62876.584522] ? hrtimer_interrupt+0x101/0x220 Aug 22 22:51:42 juju-e4d256-prod-github-runner-207 kernel: [62876.585559] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 22:51:42 juju-e4d256-prod-github-runner-207 kernel: [62876.586632] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 22:51:42 juju-e4d256-prod-github-runner-207 kernel: [62876.587679] Aug 22 22:51:42 juju-e4d256-prod-github-runner-207 kernel: [62876.588561] Aug 22 22:51:42 juju-e4d256-prod-github-runner-207 kernel: [62876.589447] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 22:51:42 juju-e4d256-prod-github-runner-207 kernel: [62876.590486] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:51:42 juju-e4d256-prod-github-runner-207 kernel: [62876.591524] ? _raw_spin_lock+0x22/0x30 Aug 22 22:51:42 juju-e4d256-prod-github-runner-207 kernel: [62876.592479] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:51:42 juju-e4d256-prod-github-runner-207 kernel: [62876.593526] direct_page_fault+0x206/0x310 [kvm] Aug 22 22:51:42 juju-e4d256-prod-github-runner-207 kernel: [62876.594595] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 22:51:42 juju-e4d256-prod-github-runner-207 kernel: [62876.595631] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 22:51:42 juju-e4d256-prod-github-runner-207 kernel: [62876.596674] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 22:51:42 juju-e4d256-prod-github-runner-207 kernel: [62876.597723] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 22:51:42 juju-e4d256-prod-github-runner-207 kernel: [62876.598674] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 22:51:42 juju-e4d256-prod-github-runner-207 kernel: [62876.599653] handle_exit+0x98/0x230 [kvm_amd] Aug 22 22:51:42 juju-e4d256-prod-github-runner-207 kernel: [62876.600563] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 22:51:42 juju-e4d256-prod-github-runner-207 kernel: [62876.601796] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 22:51:42 juju-e4d256-prod-github-runner-207 kernel: [62876.602794] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 22:51:42 juju-e4d256-prod-github-runner-207 kernel: [62876.603743] vcpu_run+0x62/0x2c0 [kvm] Aug 22 22:51:42 juju-e4d256-prod-github-runner-207 kernel: [62876.604579] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 22:51:42 juju-e4d256-prod-github-runner-207 kernel: [62876.605438] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 22:51:42 juju-e4d256-prod-github-runner-207 kernel: [62876.606301] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 22:51:42 juju-e4d256-prod-github-runner-207 kernel: [62876.607128] ? __seccomp_filter+0x4a/0x4a0 Aug 22 22:51:42 juju-e4d256-prod-github-runner-207 kernel: [62876.607905] ? __fget_files+0x86/0xc0 Aug 22 22:51:42 juju-e4d256-prod-github-runner-207 kernel: [62876.608648] __x64_sys_ioctl+0x95/0xd0 Aug 22 22:51:42 juju-e4d256-prod-github-runner-207 kernel: [62876.609386] do_syscall_64+0x5c/0xc0 Aug 22 22:51:42 juju-e4d256-prod-github-runner-207 kernel: [62876.610057] ? do_futex+0x162/0x1f0 Aug 22 22:51:42 juju-e4d256-prod-github-runner-207 kernel: [62876.610708] ? __x64_sys_futex+0x78/0x1e0 Aug 22 22:51:42 juju-e4d256-prod-github-runner-207 kernel: [62876.611390] ? __secure_computing+0xa9/0x120 Aug 22 22:51:42 juju-e4d256-prod-github-runner-207 kernel: [62876.612088] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 22:51:42 juju-e4d256-prod-github-runner-207 kernel: [62876.612850] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:51:42 juju-e4d256-prod-github-runner-207 kernel: [62876.613592] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:51:42 juju-e4d256-prod-github-runner-207 kernel: [62876.614315] ? do_syscall_64+0x69/0xc0 Aug 22 22:51:42 juju-e4d256-prod-github-runner-207 kernel: [62876.614962] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:51:42 juju-e4d256-prod-github-runner-207 kernel: [62876.615668] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:51:42 juju-e4d256-prod-github-runner-207 kernel: [62876.616367] ? do_syscall_64+0x69/0xc0 Aug 22 22:51:42 juju-e4d256-prod-github-runner-207 kernel: [62876.617054] ? do_syscall_64+0x69/0xc0 Aug 22 22:51:42 juju-e4d256-prod-github-runner-207 kernel: [62876.617739] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 22:51:42 juju-e4d256-prod-github-runner-207 kernel: [62876.618451] RIP: 0033:0x7faa5d0edaff Aug 22 22:51:42 juju-e4d256-prod-github-runner-207 kernel: [62876.619137] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 22:51:42 juju-e4d256-prod-github-runner-207 kernel: [62876.621153] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 22:51:42 juju-e4d256-prod-github-runner-207 kernel: [62876.622097] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 22:51:42 juju-e4d256-prod-github-runner-207 kernel: [62876.622996] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 22:51:42 juju-e4d256-prod-github-runner-207 kernel: [62876.623891] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 22:51:42 juju-e4d256-prod-github-runner-207 kernel: [62876.624786] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 22:51:42 juju-e4d256-prod-github-runner-207 kernel: [62876.625800] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 22:51:42 juju-e4d256-prod-github-runner-207 kernel: [62876.626709] Aug 22 22:52:10 juju-e4d256-prod-github-runner-207 kernel: [62904.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 58476s! [qemu-system-x86:6715] Aug 22 22:52:10 juju-e4d256-prod-github-runner-207 kernel: [62904.543119] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 22:52:10 juju-e4d256-prod-github-runner-207 kernel: [62904.543188] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 22:52:10 juju-e4d256-prod-github-runner-207 kernel: [62904.555327] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 22:52:10 juju-e4d256-prod-github-runner-207 kernel: [62904.556598] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 22:52:10 juju-e4d256-prod-github-runner-207 kernel: [62904.558202] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:52:10 juju-e4d256-prod-github-runner-207 kernel: [62904.559580] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 22:52:10 juju-e4d256-prod-github-runner-207 kernel: [62904.562762] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 22:52:10 juju-e4d256-prod-github-runner-207 kernel: [62904.564153] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 22:52:10 juju-e4d256-prod-github-runner-207 kernel: [62904.565761] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 22:52:10 juju-e4d256-prod-github-runner-207 kernel: [62904.567384] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 22:52:10 juju-e4d256-prod-github-runner-207 kernel: [62904.568970] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 22:52:10 juju-e4d256-prod-github-runner-207 kernel: [62904.570609] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 22:52:10 juju-e4d256-prod-github-runner-207 kernel: [62904.572244] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 22:52:10 juju-e4d256-prod-github-runner-207 kernel: [62904.573877] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 22:52:10 juju-e4d256-prod-github-runner-207 kernel: [62904.574998] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 22:52:10 juju-e4d256-prod-github-runner-207 kernel: [62904.576199] Call Trace: Aug 22 22:52:10 juju-e4d256-prod-github-runner-207 kernel: [62904.577133] Aug 22 22:52:10 juju-e4d256-prod-github-runner-207 kernel: [62904.578026] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:52:10 juju-e4d256-prod-github-runner-207 kernel: [62904.579060] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:52:10 juju-e4d256-prod-github-runner-207 kernel: [62904.580083] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:52:10 juju-e4d256-prod-github-runner-207 kernel: [62904.581183] ? show_regs.part.0+0x23/0x29 Aug 22 22:52:10 juju-e4d256-prod-github-runner-207 kernel: [62904.582181] ? show_regs.cold+0x8/0xd Aug 22 22:52:10 juju-e4d256-prod-github-runner-207 kernel: [62904.583155] ? watchdog_timer_fn+0x1be/0x220 Aug 22 22:52:10 juju-e4d256-prod-github-runner-207 kernel: [62904.584174] ? lockup_detector_update_enable+0x60/0x60 Aug 22 22:52:10 juju-e4d256-prod-github-runner-207 kernel: [62904.585254] ? __hrtimer_run_queues+0x107/0x230 Aug 22 22:52:10 juju-e4d256-prod-github-runner-207 kernel: [62904.586287] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 22:52:10 juju-e4d256-prod-github-runner-207 kernel: [62904.587322] ? hrtimer_interrupt+0x101/0x220 Aug 22 22:52:10 juju-e4d256-prod-github-runner-207 kernel: [62904.588435] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 22:52:10 juju-e4d256-prod-github-runner-207 kernel: [62904.589801] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 22:52:10 juju-e4d256-prod-github-runner-207 kernel: [62904.590895] Aug 22 22:52:10 juju-e4d256-prod-github-runner-207 kernel: [62904.591754] Aug 22 22:52:10 juju-e4d256-prod-github-runner-207 kernel: [62904.592599] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 22:52:10 juju-e4d256-prod-github-runner-207 kernel: [62904.593666] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:52:10 juju-e4d256-prod-github-runner-207 kernel: [62904.594844] ? _raw_spin_lock+0x22/0x30 Aug 22 22:52:10 juju-e4d256-prod-github-runner-207 kernel: [62904.595878] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:52:10 juju-e4d256-prod-github-runner-207 kernel: [62904.597009] direct_page_fault+0x206/0x310 [kvm] Aug 22 22:52:10 juju-e4d256-prod-github-runner-207 kernel: [62904.598135] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 22:52:10 juju-e4d256-prod-github-runner-207 kernel: [62904.599242] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 22:52:10 juju-e4d256-prod-github-runner-207 kernel: [62904.600338] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 22:52:10 juju-e4d256-prod-github-runner-207 kernel: [62904.601423] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 22:52:10 juju-e4d256-prod-github-runner-207 kernel: [62904.602479] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 22:52:10 juju-e4d256-prod-github-runner-207 kernel: [62904.603570] handle_exit+0x98/0x230 [kvm_amd] Aug 22 22:52:10 juju-e4d256-prod-github-runner-207 kernel: [62904.604556] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 22:52:10 juju-e4d256-prod-github-runner-207 kernel: [62904.605599] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 22:52:10 juju-e4d256-prod-github-runner-207 kernel: [62904.606629] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 22:52:10 juju-e4d256-prod-github-runner-207 kernel: [62904.607633] vcpu_run+0x62/0x2c0 [kvm] Aug 22 22:52:10 juju-e4d256-prod-github-runner-207 kernel: [62904.608528] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 22:52:10 juju-e4d256-prod-github-runner-207 kernel: [62904.609442] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 22:52:10 juju-e4d256-prod-github-runner-207 kernel: [62904.610413] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 22:52:10 juju-e4d256-prod-github-runner-207 kernel: [62904.611302] ? __seccomp_filter+0x4a/0x4a0 Aug 22 22:52:10 juju-e4d256-prod-github-runner-207 kernel: [62904.612137] ? __fget_files+0x86/0xc0 Aug 22 22:52:10 juju-e4d256-prod-github-runner-207 kernel: [62904.612948] __x64_sys_ioctl+0x95/0xd0 Aug 22 22:52:10 juju-e4d256-prod-github-runner-207 kernel: [62904.613714] do_syscall_64+0x5c/0xc0 Aug 22 22:52:10 juju-e4d256-prod-github-runner-207 kernel: [62904.614460] ? do_futex+0x162/0x1f0 Aug 22 22:52:10 juju-e4d256-prod-github-runner-207 kernel: [62904.615183] ? __x64_sys_futex+0x78/0x1e0 Aug 22 22:52:10 juju-e4d256-prod-github-runner-207 kernel: [62904.615945] ? __secure_computing+0xa9/0x120 Aug 22 22:52:10 juju-e4d256-prod-github-runner-207 kernel: [62904.616740] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 22:52:10 juju-e4d256-prod-github-runner-207 kernel: [62904.617647] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:52:10 juju-e4d256-prod-github-runner-207 kernel: [62904.618468] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:52:10 juju-e4d256-prod-github-runner-207 kernel: [62904.619293] ? do_syscall_64+0x69/0xc0 Aug 22 22:52:10 juju-e4d256-prod-github-runner-207 kernel: [62904.620031] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:52:10 juju-e4d256-prod-github-runner-207 kernel: [62904.620834] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:52:10 juju-e4d256-prod-github-runner-207 kernel: [62904.621659] ? do_syscall_64+0x69/0xc0 Aug 22 22:52:10 juju-e4d256-prod-github-runner-207 kernel: [62904.622373] ? do_syscall_64+0x69/0xc0 Aug 22 22:52:10 juju-e4d256-prod-github-runner-207 kernel: [62904.623078] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 22:52:10 juju-e4d256-prod-github-runner-207 kernel: [62904.623888] RIP: 0033:0x7faa5d0edaff Aug 22 22:52:10 juju-e4d256-prod-github-runner-207 kernel: [62904.624594] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 22:52:10 juju-e4d256-prod-github-runner-207 kernel: [62904.626948] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 22:52:10 juju-e4d256-prod-github-runner-207 kernel: [62904.628016] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 22:52:10 juju-e4d256-prod-github-runner-207 kernel: [62904.629063] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 22:52:10 juju-e4d256-prod-github-runner-207 kernel: [62904.630096] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 22:52:10 juju-e4d256-prod-github-runner-207 kernel: [62904.631126] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 22:52:10 juju-e4d256-prod-github-runner-207 kernel: [62904.632154] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 22:52:10 juju-e4d256-prod-github-runner-207 kernel: [62904.633211] Aug 22 22:52:38 juju-e4d256-prod-github-runner-207 kernel: [62932.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 58502s! [qemu-system-x86:6715] Aug 22 22:52:38 juju-e4d256-prod-github-runner-207 kernel: [62932.543110] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 22:52:38 juju-e4d256-prod-github-runner-207 kernel: [62932.543179] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 22:52:38 juju-e4d256-prod-github-runner-207 kernel: [62932.555414] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 22:52:38 juju-e4d256-prod-github-runner-207 kernel: [62932.556741] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 22:52:38 juju-e4d256-prod-github-runner-207 kernel: [62932.557961] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:52:38 juju-e4d256-prod-github-runner-207 kernel: [62932.559014] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 22:52:38 juju-e4d256-prod-github-runner-207 kernel: [62932.561568] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 22:52:38 juju-e4d256-prod-github-runner-207 kernel: [62932.562610] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 22:52:38 juju-e4d256-prod-github-runner-207 kernel: [62932.563805] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 22:52:38 juju-e4d256-prod-github-runner-207 kernel: [62932.564994] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 22:52:38 juju-e4d256-prod-github-runner-207 kernel: [62932.566164] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 22:52:38 juju-e4d256-prod-github-runner-207 kernel: [62932.567327] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 22:52:38 juju-e4d256-prod-github-runner-207 kernel: [62932.568489] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 22:52:38 juju-e4d256-prod-github-runner-207 kernel: [62932.569734] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 22:52:38 juju-e4d256-prod-github-runner-207 kernel: [62932.570842] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 22:52:38 juju-e4d256-prod-github-runner-207 kernel: [62932.572034] Call Trace: Aug 22 22:52:38 juju-e4d256-prod-github-runner-207 kernel: [62932.572955] Aug 22 22:52:38 juju-e4d256-prod-github-runner-207 kernel: [62932.573841] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:52:38 juju-e4d256-prod-github-runner-207 kernel: [62932.574879] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:52:38 juju-e4d256-prod-github-runner-207 kernel: [62932.575910] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:52:38 juju-e4d256-prod-github-runner-207 kernel: [62932.577001] ? show_regs.part.0+0x23/0x29 Aug 22 22:52:38 juju-e4d256-prod-github-runner-207 kernel: [62932.578000] ? show_regs.cold+0x8/0xd Aug 22 22:52:38 juju-e4d256-prod-github-runner-207 kernel: [62932.578968] ? watchdog_timer_fn+0x1be/0x220 Aug 22 22:52:38 juju-e4d256-prod-github-runner-207 kernel: [62932.579988] ? lockup_detector_update_enable+0x60/0x60 Aug 22 22:52:38 juju-e4d256-prod-github-runner-207 kernel: [62932.581065] ? __hrtimer_run_queues+0x107/0x230 Aug 22 22:52:38 juju-e4d256-prod-github-runner-207 kernel: [62932.582097] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 22:52:38 juju-e4d256-prod-github-runner-207 kernel: [62932.583124] ? hrtimer_interrupt+0x101/0x220 Aug 22 22:52:38 juju-e4d256-prod-github-runner-207 kernel: [62932.584142] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 22:52:38 juju-e4d256-prod-github-runner-207 kernel: [62932.585230] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 22:52:38 juju-e4d256-prod-github-runner-207 kernel: [62932.586286] Aug 22 22:52:38 juju-e4d256-prod-github-runner-207 kernel: [62932.587142] Aug 22 22:52:38 juju-e4d256-prod-github-runner-207 kernel: [62932.587981] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 22:52:38 juju-e4d256-prod-github-runner-207 kernel: [62932.589024] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:52:38 juju-e4d256-prod-github-runner-207 kernel: [62932.590062] ? _raw_spin_lock+0x22/0x30 Aug 22 22:52:38 juju-e4d256-prod-github-runner-207 kernel: [62932.591010] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:52:38 juju-e4d256-prod-github-runner-207 kernel: [62932.592024] direct_page_fault+0x206/0x310 [kvm] Aug 22 22:52:38 juju-e4d256-prod-github-runner-207 kernel: [62932.593057] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 22:52:38 juju-e4d256-prod-github-runner-207 kernel: [62932.594069] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 22:52:38 juju-e4d256-prod-github-runner-207 kernel: [62932.595071] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 22:52:38 juju-e4d256-prod-github-runner-207 kernel: [62932.596047] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 22:52:38 juju-e4d256-prod-github-runner-207 kernel: [62932.597002] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 22:52:38 juju-e4d256-prod-github-runner-207 kernel: [62932.597975] handle_exit+0x98/0x230 [kvm_amd] Aug 22 22:52:38 juju-e4d256-prod-github-runner-207 kernel: [62932.598869] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 22:52:38 juju-e4d256-prod-github-runner-207 kernel: [62932.599799] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 22:52:38 juju-e4d256-prod-github-runner-207 kernel: [62932.600730] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 22:52:38 juju-e4d256-prod-github-runner-207 kernel: [62932.601642] vcpu_run+0x62/0x2c0 [kvm] Aug 22 22:52:38 juju-e4d256-prod-github-runner-207 kernel: [62932.602456] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 22:52:38 juju-e4d256-prod-github-runner-207 kernel: [62932.603274] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 22:52:38 juju-e4d256-prod-github-runner-207 kernel: [62932.604133] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 22:52:38 juju-e4d256-prod-github-runner-207 kernel: [62932.604957] ? __seccomp_filter+0x4a/0x4a0 Aug 22 22:52:38 juju-e4d256-prod-github-runner-207 kernel: [62932.605707] ? __fget_files+0x86/0xc0 Aug 22 22:52:38 juju-e4d256-prod-github-runner-207 kernel: [62932.606408] __x64_sys_ioctl+0x95/0xd0 Aug 22 22:52:38 juju-e4d256-prod-github-runner-207 kernel: [62932.607098] do_syscall_64+0x5c/0xc0 Aug 22 22:52:38 juju-e4d256-prod-github-runner-207 kernel: [62932.607762] ? do_futex+0x162/0x1f0 Aug 22 22:52:38 juju-e4d256-prod-github-runner-207 kernel: [62932.608416] ? __x64_sys_futex+0x78/0x1e0 Aug 22 22:52:38 juju-e4d256-prod-github-runner-207 kernel: [62932.609100] ? __secure_computing+0xa9/0x120 Aug 22 22:52:38 juju-e4d256-prod-github-runner-207 kernel: [62932.609798] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 22:52:38 juju-e4d256-prod-github-runner-207 kernel: [62932.610563] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:52:38 juju-e4d256-prod-github-runner-207 kernel: [62932.611282] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:52:38 juju-e4d256-prod-github-runner-207 kernel: [62932.612007] ? do_syscall_64+0x69/0xc0 Aug 22 22:52:38 juju-e4d256-prod-github-runner-207 kernel: [62932.612667] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:52:38 juju-e4d256-prod-github-runner-207 kernel: [62932.613369] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:52:38 juju-e4d256-prod-github-runner-207 kernel: [62932.614062] ? do_syscall_64+0x69/0xc0 Aug 22 22:52:38 juju-e4d256-prod-github-runner-207 kernel: [62932.614684] ? do_syscall_64+0x69/0xc0 Aug 22 22:52:38 juju-e4d256-prod-github-runner-207 kernel: [62932.615305] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 22:52:38 juju-e4d256-prod-github-runner-207 kernel: [62932.616006] RIP: 0033:0x7faa5d0edaff Aug 22 22:52:38 juju-e4d256-prod-github-runner-207 kernel: [62932.616657] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 22:52:38 juju-e4d256-prod-github-runner-207 kernel: [62932.618652] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 22:52:38 juju-e4d256-prod-github-runner-207 kernel: [62932.619559] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 22:52:38 juju-e4d256-prod-github-runner-207 kernel: [62932.620444] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 22:52:38 juju-e4d256-prod-github-runner-207 kernel: [62932.621503] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 22:52:38 juju-e4d256-prod-github-runner-207 kernel: [62932.622399] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 22:52:38 juju-e4d256-prod-github-runner-207 kernel: [62932.623298] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 22:52:38 juju-e4d256-prod-github-runner-207 kernel: [62932.624211] Aug 22 22:53:06 juju-e4d256-prod-github-runner-207 kernel: [62960.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 58528s! [qemu-system-x86:6715] Aug 22 22:53:06 juju-e4d256-prod-github-runner-207 kernel: [62960.543722] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 22:53:06 juju-e4d256-prod-github-runner-207 kernel: [62960.543963] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 22:53:06 juju-e4d256-prod-github-runner-207 kernel: [62960.556198] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 22:53:06 juju-e4d256-prod-github-runner-207 kernel: [62960.557486] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 22:53:06 juju-e4d256-prod-github-runner-207 kernel: [62960.558701] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:53:06 juju-e4d256-prod-github-runner-207 kernel: [62960.559756] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 22:53:06 juju-e4d256-prod-github-runner-207 kernel: [62960.562316] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 22:53:06 juju-e4d256-prod-github-runner-207 kernel: [62960.563356] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 22:53:06 juju-e4d256-prod-github-runner-207 kernel: [62960.564528] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 22:53:06 juju-e4d256-prod-github-runner-207 kernel: [62960.565687] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 22:53:06 juju-e4d256-prod-github-runner-207 kernel: [62960.566844] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 22:53:06 juju-e4d256-prod-github-runner-207 kernel: [62960.568012] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 22:53:06 juju-e4d256-prod-github-runner-207 kernel: [62960.569199] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 22:53:06 juju-e4d256-prod-github-runner-207 kernel: [62960.570437] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 22:53:06 juju-e4d256-prod-github-runner-207 kernel: [62960.571596] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 22:53:06 juju-e4d256-prod-github-runner-207 kernel: [62960.572835] Call Trace: Aug 22 22:53:06 juju-e4d256-prod-github-runner-207 kernel: [62960.573754] Aug 22 22:53:06 juju-e4d256-prod-github-runner-207 kernel: [62960.574658] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:53:06 juju-e4d256-prod-github-runner-207 kernel: [62960.575690] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:53:06 juju-e4d256-prod-github-runner-207 kernel: [62960.576731] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:53:06 juju-e4d256-prod-github-runner-207 kernel: [62960.577835] ? show_regs.part.0+0x23/0x29 Aug 22 22:53:06 juju-e4d256-prod-github-runner-207 kernel: [62960.578945] ? show_regs.cold+0x8/0xd Aug 22 22:53:06 juju-e4d256-prod-github-runner-207 kernel: [62960.579920] ? watchdog_timer_fn+0x1be/0x220 Aug 22 22:53:06 juju-e4d256-prod-github-runner-207 kernel: [62960.580948] ? lockup_detector_update_enable+0x60/0x60 Aug 22 22:53:06 juju-e4d256-prod-github-runner-207 kernel: [62960.582011] ? __hrtimer_run_queues+0x107/0x230 Aug 22 22:53:06 juju-e4d256-prod-github-runner-207 kernel: [62960.583041] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 22:53:06 juju-e4d256-prod-github-runner-207 kernel: [62960.584196] ? hrtimer_interrupt+0x101/0x220 Aug 22 22:53:06 juju-e4d256-prod-github-runner-207 kernel: [62960.585262] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 22:53:06 juju-e4d256-prod-github-runner-207 kernel: [62960.586353] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 22:53:06 juju-e4d256-prod-github-runner-207 kernel: [62960.587400] Aug 22 22:53:06 juju-e4d256-prod-github-runner-207 kernel: [62960.588275] Aug 22 22:53:06 juju-e4d256-prod-github-runner-207 kernel: [62960.589116] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 22:53:06 juju-e4d256-prod-github-runner-207 kernel: [62960.590154] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:53:06 juju-e4d256-prod-github-runner-207 kernel: [62960.591198] ? _raw_spin_lock+0x22/0x30 Aug 22 22:53:06 juju-e4d256-prod-github-runner-207 kernel: [62960.592149] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:53:06 juju-e4d256-prod-github-runner-207 kernel: [62960.593182] direct_page_fault+0x206/0x310 [kvm] Aug 22 22:53:06 juju-e4d256-prod-github-runner-207 kernel: [62960.594208] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 22:53:06 juju-e4d256-prod-github-runner-207 kernel: [62960.595223] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 22:53:06 juju-e4d256-prod-github-runner-207 kernel: [62960.596238] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 22:53:06 juju-e4d256-prod-github-runner-207 kernel: [62960.597280] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 22:53:06 juju-e4d256-prod-github-runner-207 kernel: [62960.598247] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 22:53:06 juju-e4d256-prod-github-runner-207 kernel: [62960.599225] handle_exit+0x98/0x230 [kvm_amd] Aug 22 22:53:06 juju-e4d256-prod-github-runner-207 kernel: [62960.600119] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 22:53:06 juju-e4d256-prod-github-runner-207 kernel: [62960.601049] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 22:53:06 juju-e4d256-prod-github-runner-207 kernel: [62960.601976] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 22:53:06 juju-e4d256-prod-github-runner-207 kernel: [62960.602878] vcpu_run+0x62/0x2c0 [kvm] Aug 22 22:53:06 juju-e4d256-prod-github-runner-207 kernel: [62960.603691] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 22:53:06 juju-e4d256-prod-github-runner-207 kernel: [62960.604520] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 22:53:06 juju-e4d256-prod-github-runner-207 kernel: [62960.605382] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 22:53:06 juju-e4d256-prod-github-runner-207 kernel: [62960.606180] ? __seccomp_filter+0x4a/0x4a0 Aug 22 22:53:06 juju-e4d256-prod-github-runner-207 kernel: [62960.606924] ? __fget_files+0x86/0xc0 Aug 22 22:53:06 juju-e4d256-prod-github-runner-207 kernel: [62960.607630] __x64_sys_ioctl+0x95/0xd0 Aug 22 22:53:06 juju-e4d256-prod-github-runner-207 kernel: [62960.608348] do_syscall_64+0x5c/0xc0 Aug 22 22:53:06 juju-e4d256-prod-github-runner-207 kernel: [62960.609031] ? do_futex+0x162/0x1f0 Aug 22 22:53:06 juju-e4d256-prod-github-runner-207 kernel: [62960.609684] ? __x64_sys_futex+0x78/0x1e0 Aug 22 22:53:06 juju-e4d256-prod-github-runner-207 kernel: [62960.610360] ? __secure_computing+0xa9/0x120 Aug 22 22:53:06 juju-e4d256-prod-github-runner-207 kernel: [62960.611050] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 22:53:06 juju-e4d256-prod-github-runner-207 kernel: [62960.611811] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:53:06 juju-e4d256-prod-github-runner-207 kernel: [62960.612548] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:53:06 juju-e4d256-prod-github-runner-207 kernel: [62960.613268] ? do_syscall_64+0x69/0xc0 Aug 22 22:53:06 juju-e4d256-prod-github-runner-207 kernel: [62960.613917] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:53:06 juju-e4d256-prod-github-runner-207 kernel: [62960.614623] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:53:06 juju-e4d256-prod-github-runner-207 kernel: [62960.615370] ? do_syscall_64+0x69/0xc0 Aug 22 22:53:06 juju-e4d256-prod-github-runner-207 kernel: [62960.616000] ? do_syscall_64+0x69/0xc0 Aug 22 22:53:06 juju-e4d256-prod-github-runner-207 kernel: [62960.616638] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 22:53:06 juju-e4d256-prod-github-runner-207 kernel: [62960.617350] RIP: 0033:0x7faa5d0edaff Aug 22 22:53:06 juju-e4d256-prod-github-runner-207 kernel: [62960.618015] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 22:53:06 juju-e4d256-prod-github-runner-207 kernel: [62960.620009] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 22:53:06 juju-e4d256-prod-github-runner-207 kernel: [62960.620972] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 22:53:06 juju-e4d256-prod-github-runner-207 kernel: [62960.621871] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 22:53:06 juju-e4d256-prod-github-runner-207 kernel: [62960.622759] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 22:53:06 juju-e4d256-prod-github-runner-207 kernel: [62960.623653] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 22:53:06 juju-e4d256-prod-github-runner-207 kernel: [62960.624568] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 22:53:06 juju-e4d256-prod-github-runner-207 kernel: [62960.625468] Aug 22 22:53:34 juju-e4d256-prod-github-runner-207 kernel: [62988.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 58554s! [qemu-system-x86:6715] Aug 22 22:53:34 juju-e4d256-prod-github-runner-207 kernel: [62988.543111] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 22:53:34 juju-e4d256-prod-github-runner-207 kernel: [62988.543184] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 22:53:34 juju-e4d256-prod-github-runner-207 kernel: [62988.555241] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 22:53:34 juju-e4d256-prod-github-runner-207 kernel: [62988.556517] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 22:53:34 juju-e4d256-prod-github-runner-207 kernel: [62988.557737] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:53:34 juju-e4d256-prod-github-runner-207 kernel: [62988.558803] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 22:53:34 juju-e4d256-prod-github-runner-207 kernel: [62988.561359] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 22:53:34 juju-e4d256-prod-github-runner-207 kernel: [62988.562408] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 22:53:34 juju-e4d256-prod-github-runner-207 kernel: [62988.563566] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 22:53:34 juju-e4d256-prod-github-runner-207 kernel: [62988.564737] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 22:53:34 juju-e4d256-prod-github-runner-207 kernel: [62988.565901] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 22:53:34 juju-e4d256-prod-github-runner-207 kernel: [62988.567068] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 22:53:34 juju-e4d256-prod-github-runner-207 kernel: [62988.568259] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 22:53:34 juju-e4d256-prod-github-runner-207 kernel: [62988.569499] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 22:53:34 juju-e4d256-prod-github-runner-207 kernel: [62988.570600] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 22:53:34 juju-e4d256-prod-github-runner-207 kernel: [62988.571793] Call Trace: Aug 22 22:53:34 juju-e4d256-prod-github-runner-207 kernel: [62988.572721] Aug 22 22:53:34 juju-e4d256-prod-github-runner-207 kernel: [62988.573604] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:53:34 juju-e4d256-prod-github-runner-207 kernel: [62988.574633] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:53:34 juju-e4d256-prod-github-runner-207 kernel: [62988.575650] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:53:34 juju-e4d256-prod-github-runner-207 kernel: [62988.576742] ? show_regs.part.0+0x23/0x29 Aug 22 22:53:34 juju-e4d256-prod-github-runner-207 kernel: [62988.577737] ? show_regs.cold+0x8/0xd Aug 22 22:53:34 juju-e4d256-prod-github-runner-207 kernel: [62988.578710] ? watchdog_timer_fn+0x1be/0x220 Aug 22 22:53:34 juju-e4d256-prod-github-runner-207 kernel: [62988.579721] ? lockup_detector_update_enable+0x60/0x60 Aug 22 22:53:34 juju-e4d256-prod-github-runner-207 kernel: [62988.580797] ? __hrtimer_run_queues+0x107/0x230 Aug 22 22:53:34 juju-e4d256-prod-github-runner-207 kernel: [62988.581823] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 22:53:34 juju-e4d256-prod-github-runner-207 kernel: [62988.582849] ? hrtimer_interrupt+0x101/0x220 Aug 22 22:53:34 juju-e4d256-prod-github-runner-207 kernel: [62988.583865] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 22:53:34 juju-e4d256-prod-github-runner-207 kernel: [62988.584945] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 22:53:34 juju-e4d256-prod-github-runner-207 kernel: [62988.586050] Aug 22 22:53:34 juju-e4d256-prod-github-runner-207 kernel: [62988.586902] Aug 22 22:53:34 juju-e4d256-prod-github-runner-207 kernel: [62988.587738] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 22:53:34 juju-e4d256-prod-github-runner-207 kernel: [62988.588785] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:53:34 juju-e4d256-prod-github-runner-207 kernel: [62988.589829] ? _raw_spin_lock+0x22/0x30 Aug 22 22:53:34 juju-e4d256-prod-github-runner-207 kernel: [62988.590772] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:53:34 juju-e4d256-prod-github-runner-207 kernel: [62988.591794] direct_page_fault+0x206/0x310 [kvm] Aug 22 22:53:34 juju-e4d256-prod-github-runner-207 kernel: [62988.592831] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 22:53:34 juju-e4d256-prod-github-runner-207 kernel: [62988.593847] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 22:53:34 juju-e4d256-prod-github-runner-207 kernel: [62988.594848] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 22:53:34 juju-e4d256-prod-github-runner-207 kernel: [62988.595815] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 22:53:34 juju-e4d256-prod-github-runner-207 kernel: [62988.596773] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 22:53:34 juju-e4d256-prod-github-runner-207 kernel: [62988.597751] handle_exit+0x98/0x230 [kvm_amd] Aug 22 22:53:34 juju-e4d256-prod-github-runner-207 kernel: [62988.598643] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 22:53:34 juju-e4d256-prod-github-runner-207 kernel: [62988.599555] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 22:53:34 juju-e4d256-prod-github-runner-207 kernel: [62988.600494] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 22:53:34 juju-e4d256-prod-github-runner-207 kernel: [62988.601403] vcpu_run+0x62/0x2c0 [kvm] Aug 22 22:53:34 juju-e4d256-prod-github-runner-207 kernel: [62988.602214] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 22:53:34 juju-e4d256-prod-github-runner-207 kernel: [62988.603020] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 22:53:34 juju-e4d256-prod-github-runner-207 kernel: [62988.603878] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 22:53:34 juju-e4d256-prod-github-runner-207 kernel: [62988.604687] ? __seccomp_filter+0x4a/0x4a0 Aug 22 22:53:34 juju-e4d256-prod-github-runner-207 kernel: [62988.605429] ? __fget_files+0x86/0xc0 Aug 22 22:53:34 juju-e4d256-prod-github-runner-207 kernel: [62988.606135] __x64_sys_ioctl+0x95/0xd0 Aug 22 22:53:34 juju-e4d256-prod-github-runner-207 kernel: [62988.606828] do_syscall_64+0x5c/0xc0 Aug 22 22:53:34 juju-e4d256-prod-github-runner-207 kernel: [62988.607492] ? do_futex+0x162/0x1f0 Aug 22 22:53:34 juju-e4d256-prod-github-runner-207 kernel: [62988.608153] ? __x64_sys_futex+0x78/0x1e0 Aug 22 22:53:34 juju-e4d256-prod-github-runner-207 kernel: [62988.608827] ? __secure_computing+0xa9/0x120 Aug 22 22:53:34 juju-e4d256-prod-github-runner-207 kernel: [62988.609515] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 22:53:34 juju-e4d256-prod-github-runner-207 kernel: [62988.610281] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:53:34 juju-e4d256-prod-github-runner-207 kernel: [62988.611002] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:53:34 juju-e4d256-prod-github-runner-207 kernel: [62988.611728] ? do_syscall_64+0x69/0xc0 Aug 22 22:53:34 juju-e4d256-prod-github-runner-207 kernel: [62988.612385] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:53:34 juju-e4d256-prod-github-runner-207 kernel: [62988.613090] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:53:34 juju-e4d256-prod-github-runner-207 kernel: [62988.613791] ? do_syscall_64+0x69/0xc0 Aug 22 22:53:34 juju-e4d256-prod-github-runner-207 kernel: [62988.614416] ? do_syscall_64+0x69/0xc0 Aug 22 22:53:34 juju-e4d256-prod-github-runner-207 kernel: [62988.615037] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 22:53:34 juju-e4d256-prod-github-runner-207 kernel: [62988.615741] RIP: 0033:0x7faa5d0edaff Aug 22 22:53:34 juju-e4d256-prod-github-runner-207 kernel: [62988.616384] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 22:53:34 juju-e4d256-prod-github-runner-207 kernel: [62988.618374] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 22:53:34 juju-e4d256-prod-github-runner-207 kernel: [62988.619282] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 22:53:34 juju-e4d256-prod-github-runner-207 kernel: [62988.620196] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 22:53:34 juju-e4d256-prod-github-runner-207 kernel: [62988.621085] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 22:53:34 juju-e4d256-prod-github-runner-207 kernel: [62988.621976] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 22:53:34 juju-e4d256-prod-github-runner-207 kernel: [62988.622875] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 22:53:34 juju-e4d256-prod-github-runner-207 kernel: [62988.623766] Aug 22 22:53:47 juju-e4d256-prod-github-runner-207 kernel: [63001.388706] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 22:53:47 juju-e4d256-prod-github-runner-207 kernel: [63001.389684] rcu: 1-....: (15671488 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=7566972 Aug 22 22:53:47 juju-e4d256-prod-github-runner-207 kernel: [63001.390814] (t=15721047 jiffies g=23269 q=55830) Aug 22 22:53:47 juju-e4d256-prod-github-runner-207 kernel: [63001.391601] NMI backtrace for cpu 1 Aug 22 22:53:47 juju-e4d256-prod-github-runner-207 kernel: [63001.392325] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 22:53:47 juju-e4d256-prod-github-runner-207 kernel: [63001.393439] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 22:53:47 juju-e4d256-prod-github-runner-207 kernel: [63001.394505] Call Trace: Aug 22 22:53:47 juju-e4d256-prod-github-runner-207 kernel: [63001.395183] Aug 22 22:53:47 juju-e4d256-prod-github-runner-207 kernel: [63001.395838] show_stack+0x52/0x5c Aug 22 22:53:47 juju-e4d256-prod-github-runner-207 kernel: [63001.396576] dump_stack_lvl+0x4a/0x63 Aug 22 22:53:47 juju-e4d256-prod-github-runner-207 kernel: [63001.397334] dump_stack+0x10/0x16 Aug 22 22:53:47 juju-e4d256-prod-github-runner-207 kernel: [63001.398094] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 22:53:47 juju-e4d256-prod-github-runner-207 kernel: [63001.398878] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 22:53:47 juju-e4d256-prod-github-runner-207 kernel: [63001.399790] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 22:53:47 juju-e4d256-prod-github-runner-207 kernel: [63001.400652] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 22:53:47 juju-e4d256-prod-github-runner-207 kernel: [63001.401507] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 22:53:47 juju-e4d256-prod-github-runner-207 kernel: [63001.402318] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 22:53:47 juju-e4d256-prod-github-runner-207 kernel: [63001.403095] print_cpu_stall.cold+0x2f/0xe2 Aug 22 22:53:47 juju-e4d256-prod-github-runner-207 kernel: [63001.403876] ? timekeeping_update+0xf7/0x150 Aug 22 22:53:47 juju-e4d256-prod-github-runner-207 kernel: [63001.404649] check_cpu_stall+0x109/0x270 Aug 22 22:53:47 juju-e4d256-prod-github-runner-207 kernel: [63001.405407] rcu_sched_clock_irq+0x9a/0x250 Aug 22 22:53:47 juju-e4d256-prod-github-runner-207 kernel: [63001.406169] update_process_times+0x94/0xd0 Aug 22 22:53:47 juju-e4d256-prod-github-runner-207 kernel: [63001.406929] tick_sched_handle+0x29/0x70 Aug 22 22:53:47 juju-e4d256-prod-github-runner-207 kernel: [63001.407675] tick_sched_timer+0x8c/0xc0 Aug 22 22:53:47 juju-e4d256-prod-github-runner-207 kernel: [63001.408451] ? tick_nohz_handler+0xb0/0xb0 Aug 22 22:53:47 juju-e4d256-prod-github-runner-207 kernel: [63001.409212] __hrtimer_run_queues+0x107/0x230 Aug 22 22:53:47 juju-e4d256-prod-github-runner-207 kernel: [63001.409985] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 22:53:47 juju-e4d256-prod-github-runner-207 kernel: [63001.410778] hrtimer_interrupt+0x101/0x220 Aug 22 22:53:47 juju-e4d256-prod-github-runner-207 kernel: [63001.411548] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 22:53:47 juju-e4d256-prod-github-runner-207 kernel: [63001.412375] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 22:53:47 juju-e4d256-prod-github-runner-207 kernel: [63001.413175] Aug 22 22:53:47 juju-e4d256-prod-github-runner-207 kernel: [63001.413810] Aug 22 22:53:47 juju-e4d256-prod-github-runner-207 kernel: [63001.414443] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 22:53:47 juju-e4d256-prod-github-runner-207 kernel: [63001.415260] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:53:47 juju-e4d256-prod-github-runner-207 kernel: [63001.416156] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 22:53:47 juju-e4d256-prod-github-runner-207 kernel: [63001.418458] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 22:53:47 juju-e4d256-prod-github-runner-207 kernel: [63001.419342] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 22:53:47 juju-e4d256-prod-github-runner-207 kernel: [63001.420373] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 22:53:47 juju-e4d256-prod-github-runner-207 kernel: [63001.421362] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 22:53:47 juju-e4d256-prod-github-runner-207 kernel: [63001.422342] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 22:53:47 juju-e4d256-prod-github-runner-207 kernel: [63001.423336] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 22:53:47 juju-e4d256-prod-github-runner-207 kernel: [63001.424327] ? _raw_spin_lock+0x22/0x30 Aug 22 22:53:47 juju-e4d256-prod-github-runner-207 kernel: [63001.425091] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:53:47 juju-e4d256-prod-github-runner-207 kernel: [63001.425967] direct_page_fault+0x206/0x310 [kvm] Aug 22 22:53:47 juju-e4d256-prod-github-runner-207 kernel: [63001.426805] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 22:53:47 juju-e4d256-prod-github-runner-207 kernel: [63001.427638] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 22:53:47 juju-e4d256-prod-github-runner-207 kernel: [63001.428489] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 22:53:47 juju-e4d256-prod-github-runner-207 kernel: [63001.429318] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 22:53:47 juju-e4d256-prod-github-runner-207 kernel: [63001.430112] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 22:53:47 juju-e4d256-prod-github-runner-207 kernel: [63001.430943] handle_exit+0x98/0x230 [kvm_amd] Aug 22 22:53:47 juju-e4d256-prod-github-runner-207 kernel: [63001.431701] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 22:53:47 juju-e4d256-prod-github-runner-207 kernel: [63001.432505] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 22:53:47 juju-e4d256-prod-github-runner-207 kernel: [63001.433305] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 22:53:47 juju-e4d256-prod-github-runner-207 kernel: [63001.434094] vcpu_run+0x62/0x2c0 [kvm] Aug 22 22:53:47 juju-e4d256-prod-github-runner-207 kernel: [63001.434844] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 22:53:47 juju-e4d256-prod-github-runner-207 kernel: [63001.435579] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 22:53:47 juju-e4d256-prod-github-runner-207 kernel: [63001.436388] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 22:53:47 juju-e4d256-prod-github-runner-207 kernel: [63001.437150] ? __seccomp_filter+0x4a/0x4a0 Aug 22 22:53:47 juju-e4d256-prod-github-runner-207 kernel: [63001.437869] ? __fget_files+0x86/0xc0 Aug 22 22:53:47 juju-e4d256-prod-github-runner-207 kernel: [63001.438559] __x64_sys_ioctl+0x95/0xd0 Aug 22 22:53:47 juju-e4d256-prod-github-runner-207 kernel: [63001.439272] do_syscall_64+0x5c/0xc0 Aug 22 22:53:47 juju-e4d256-prod-github-runner-207 kernel: [63001.439972] ? do_futex+0x162/0x1f0 Aug 22 22:53:47 juju-e4d256-prod-github-runner-207 kernel: [63001.440648] ? __x64_sys_futex+0x78/0x1e0 Aug 22 22:53:47 juju-e4d256-prod-github-runner-207 kernel: [63001.441351] ? __secure_computing+0xa9/0x120 Aug 22 22:53:47 juju-e4d256-prod-github-runner-207 kernel: [63001.442073] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 22:53:47 juju-e4d256-prod-github-runner-207 kernel: [63001.442868] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:53:47 juju-e4d256-prod-github-runner-207 kernel: [63001.443659] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:53:47 juju-e4d256-prod-github-runner-207 kernel: [63001.444429] ? do_syscall_64+0x69/0xc0 Aug 22 22:53:47 juju-e4d256-prod-github-runner-207 kernel: [63001.445116] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:53:47 juju-e4d256-prod-github-runner-207 kernel: [63001.445869] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:53:47 juju-e4d256-prod-github-runner-207 kernel: [63001.446629] ? do_syscall_64+0x69/0xc0 Aug 22 22:53:47 juju-e4d256-prod-github-runner-207 kernel: [63001.447321] ? do_syscall_64+0x69/0xc0 Aug 22 22:53:47 juju-e4d256-prod-github-runner-207 kernel: [63001.448026] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 22:53:47 juju-e4d256-prod-github-runner-207 kernel: [63001.448802] RIP: 0033:0x7faa5d0edaff Aug 22 22:53:47 juju-e4d256-prod-github-runner-207 kernel: [63001.449524] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 22:53:47 juju-e4d256-prod-github-runner-207 kernel: [63001.451636] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 22:53:47 juju-e4d256-prod-github-runner-207 kernel: [63001.452614] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 22:53:47 juju-e4d256-prod-github-runner-207 kernel: [63001.453559] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 22:53:47 juju-e4d256-prod-github-runner-207 kernel: [63001.454501] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 22:53:47 juju-e4d256-prod-github-runner-207 kernel: [63001.455440] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 22:53:47 juju-e4d256-prod-github-runner-207 kernel: [63001.456405] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 22:53:47 juju-e4d256-prod-github-runner-207 kernel: [63001.457333] Aug 22 22:54:14 juju-e4d256-prod-github-runner-207 kernel: [63028.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 58591s! [qemu-system-x86:6715] Aug 22 22:54:14 juju-e4d256-prod-github-runner-207 kernel: [63028.543206] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 22:54:14 juju-e4d256-prod-github-runner-207 kernel: [63028.543407] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 22:54:14 juju-e4d256-prod-github-runner-207 kernel: [63028.555605] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 22:54:14 juju-e4d256-prod-github-runner-207 kernel: [63028.556874] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 22:54:14 juju-e4d256-prod-github-runner-207 kernel: [63028.558099] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:54:14 juju-e4d256-prod-github-runner-207 kernel: [63028.559154] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 22:54:14 juju-e4d256-prod-github-runner-207 kernel: [63028.561855] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 22:54:14 juju-e4d256-prod-github-runner-207 kernel: [63028.562900] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 22:54:14 juju-e4d256-prod-github-runner-207 kernel: [63028.564069] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 22:54:14 juju-e4d256-prod-github-runner-207 kernel: [63028.565243] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 22:54:14 juju-e4d256-prod-github-runner-207 kernel: [63028.566543] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 22:54:14 juju-e4d256-prod-github-runner-207 kernel: [63028.567716] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 22:54:14 juju-e4d256-prod-github-runner-207 kernel: [63028.568881] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 22:54:14 juju-e4d256-prod-github-runner-207 kernel: [63028.570114] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 22:54:14 juju-e4d256-prod-github-runner-207 kernel: [63028.571283] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 22:54:14 juju-e4d256-prod-github-runner-207 kernel: [63028.572496] Call Trace: Aug 22 22:54:14 juju-e4d256-prod-github-runner-207 kernel: [63028.573407] Aug 22 22:54:14 juju-e4d256-prod-github-runner-207 kernel: [63028.574293] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:54:14 juju-e4d256-prod-github-runner-207 kernel: [63028.575324] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:54:14 juju-e4d256-prod-github-runner-207 kernel: [63028.576352] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:54:14 juju-e4d256-prod-github-runner-207 kernel: [63028.577451] ? show_regs.part.0+0x23/0x29 Aug 22 22:54:14 juju-e4d256-prod-github-runner-207 kernel: [63028.578448] ? show_regs.cold+0x8/0xd Aug 22 22:54:14 juju-e4d256-prod-github-runner-207 kernel: [63028.579421] ? watchdog_timer_fn+0x1be/0x220 Aug 22 22:54:14 juju-e4d256-prod-github-runner-207 kernel: [63028.580450] ? lockup_detector_update_enable+0x60/0x60 Aug 22 22:54:14 juju-e4d256-prod-github-runner-207 kernel: [63028.581516] ? __hrtimer_run_queues+0x107/0x230 Aug 22 22:54:14 juju-e4d256-prod-github-runner-207 kernel: [63028.582543] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 22:54:14 juju-e4d256-prod-github-runner-207 kernel: [63028.583583] ? hrtimer_interrupt+0x101/0x220 Aug 22 22:54:14 juju-e4d256-prod-github-runner-207 kernel: [63028.584596] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 22:54:14 juju-e4d256-prod-github-runner-207 kernel: [63028.585665] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 22:54:14 juju-e4d256-prod-github-runner-207 kernel: [63028.586709] Aug 22 22:54:14 juju-e4d256-prod-github-runner-207 kernel: [63028.587574] Aug 22 22:54:14 juju-e4d256-prod-github-runner-207 kernel: [63028.588410] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 22:54:14 juju-e4d256-prod-github-runner-207 kernel: [63028.589445] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:54:14 juju-e4d256-prod-github-runner-207 kernel: [63028.590490] ? _raw_spin_lock+0x22/0x30 Aug 22 22:54:14 juju-e4d256-prod-github-runner-207 kernel: [63028.591433] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:54:14 juju-e4d256-prod-github-runner-207 kernel: [63028.592456] direct_page_fault+0x206/0x310 [kvm] Aug 22 22:54:14 juju-e4d256-prod-github-runner-207 kernel: [63028.593484] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 22:54:14 juju-e4d256-prod-github-runner-207 kernel: [63028.594503] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 22:54:14 juju-e4d256-prod-github-runner-207 kernel: [63028.595541] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 22:54:14 juju-e4d256-prod-github-runner-207 kernel: [63028.596530] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 22:54:14 juju-e4d256-prod-github-runner-207 kernel: [63028.597473] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 22:54:14 juju-e4d256-prod-github-runner-207 kernel: [63028.598448] handle_exit+0x98/0x230 [kvm_amd] Aug 22 22:54:14 juju-e4d256-prod-github-runner-207 kernel: [63028.599338] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 22:54:14 juju-e4d256-prod-github-runner-207 kernel: [63028.600265] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 22:54:14 juju-e4d256-prod-github-runner-207 kernel: [63028.601240] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 22:54:14 juju-e4d256-prod-github-runner-207 kernel: [63028.602183] vcpu_run+0x62/0x2c0 [kvm] Aug 22 22:54:14 juju-e4d256-prod-github-runner-207 kernel: [63028.603138] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 22:54:14 juju-e4d256-prod-github-runner-207 kernel: [63028.604111] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 22:54:14 juju-e4d256-prod-github-runner-207 kernel: [63028.605073] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 22:54:14 juju-e4d256-prod-github-runner-207 kernel: [63028.606021] ? __seccomp_filter+0x4a/0x4a0 Aug 22 22:54:14 juju-e4d256-prod-github-runner-207 kernel: [63028.606893] ? __fget_files+0x86/0xc0 Aug 22 22:54:14 juju-e4d256-prod-github-runner-207 kernel: [63028.607730] __x64_sys_ioctl+0x95/0xd0 Aug 22 22:54:14 juju-e4d256-prod-github-runner-207 kernel: [63028.608556] do_syscall_64+0x5c/0xc0 Aug 22 22:54:14 juju-e4d256-prod-github-runner-207 kernel: [63028.609310] ? do_futex+0x162/0x1f0 Aug 22 22:54:14 juju-e4d256-prod-github-runner-207 kernel: [63028.610044] ? __x64_sys_futex+0x78/0x1e0 Aug 22 22:54:14 juju-e4d256-prod-github-runner-207 kernel: [63028.610726] ? __secure_computing+0xa9/0x120 Aug 22 22:54:14 juju-e4d256-prod-github-runner-207 kernel: [63028.611452] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 22:54:14 juju-e4d256-prod-github-runner-207 kernel: [63028.612249] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:54:14 juju-e4d256-prod-github-runner-207 kernel: [63028.613025] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:54:14 juju-e4d256-prod-github-runner-207 kernel: [63028.613756] ? do_syscall_64+0x69/0xc0 Aug 22 22:54:14 juju-e4d256-prod-github-runner-207 kernel: [63028.614528] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:54:14 juju-e4d256-prod-github-runner-207 kernel: [63028.615372] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:54:14 juju-e4d256-prod-github-runner-207 kernel: [63028.616212] ? do_syscall_64+0x69/0xc0 Aug 22 22:54:14 juju-e4d256-prod-github-runner-207 kernel: [63028.616931] ? do_syscall_64+0x69/0xc0 Aug 22 22:54:14 juju-e4d256-prod-github-runner-207 kernel: [63028.617643] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 22:54:14 juju-e4d256-prod-github-runner-207 kernel: [63028.618469] RIP: 0033:0x7faa5d0edaff Aug 22 22:54:14 juju-e4d256-prod-github-runner-207 kernel: [63028.619220] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 22:54:14 juju-e4d256-prod-github-runner-207 kernel: [63028.621452] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 22:54:14 juju-e4d256-prod-github-runner-207 kernel: [63028.622521] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 22:54:14 juju-e4d256-prod-github-runner-207 kernel: [63028.623601] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 22:54:14 juju-e4d256-prod-github-runner-207 kernel: [63028.624577] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 22:54:14 juju-e4d256-prod-github-runner-207 kernel: [63028.625466] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 22:54:14 juju-e4d256-prod-github-runner-207 kernel: [63028.626364] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 22:54:14 juju-e4d256-prod-github-runner-207 kernel: [63028.627261] Aug 22 22:54:42 juju-e4d256-prod-github-runner-207 kernel: [63056.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 58617s! [qemu-system-x86:6715] Aug 22 22:54:42 juju-e4d256-prod-github-runner-207 kernel: [63056.543667] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 22:54:42 juju-e4d256-prod-github-runner-207 kernel: [63056.543832] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 22:54:42 juju-e4d256-prod-github-runner-207 kernel: [63056.556103] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 22:54:42 juju-e4d256-prod-github-runner-207 kernel: [63056.557403] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 22:54:42 juju-e4d256-prod-github-runner-207 kernel: [63056.558627] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:54:42 juju-e4d256-prod-github-runner-207 kernel: [63056.559706] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 22:54:42 juju-e4d256-prod-github-runner-207 kernel: [63056.562275] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 22:54:42 juju-e4d256-prod-github-runner-207 kernel: [63056.563344] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 22:54:42 juju-e4d256-prod-github-runner-207 kernel: [63056.564519] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 22:54:42 juju-e4d256-prod-github-runner-207 kernel: [63056.565694] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 22:54:42 juju-e4d256-prod-github-runner-207 kernel: [63056.566868] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 22:54:42 juju-e4d256-prod-github-runner-207 kernel: [63056.568045] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 22:54:42 juju-e4d256-prod-github-runner-207 kernel: [63056.569218] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 22:54:42 juju-e4d256-prod-github-runner-207 kernel: [63056.570462] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 22:54:42 juju-e4d256-prod-github-runner-207 kernel: [63056.571587] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 22:54:42 juju-e4d256-prod-github-runner-207 kernel: [63056.572791] Call Trace: Aug 22 22:54:42 juju-e4d256-prod-github-runner-207 kernel: [63056.573716] Aug 22 22:54:42 juju-e4d256-prod-github-runner-207 kernel: [63056.574661] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:54:42 juju-e4d256-prod-github-runner-207 kernel: [63056.575722] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:54:42 juju-e4d256-prod-github-runner-207 kernel: [63056.576751] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:54:42 juju-e4d256-prod-github-runner-207 kernel: [63056.577837] ? show_regs.part.0+0x23/0x29 Aug 22 22:54:42 juju-e4d256-prod-github-runner-207 kernel: [63056.578839] ? show_regs.cold+0x8/0xd Aug 22 22:54:42 juju-e4d256-prod-github-runner-207 kernel: [63056.579844] ? watchdog_timer_fn+0x1be/0x220 Aug 22 22:54:42 juju-e4d256-prod-github-runner-207 kernel: [63056.580872] ? lockup_detector_update_enable+0x60/0x60 Aug 22 22:54:42 juju-e4d256-prod-github-runner-207 kernel: [63056.581941] ? __hrtimer_run_queues+0x107/0x230 Aug 22 22:54:42 juju-e4d256-prod-github-runner-207 kernel: [63056.582979] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 22:54:42 juju-e4d256-prod-github-runner-207 kernel: [63056.584026] ? hrtimer_interrupt+0x101/0x220 Aug 22 22:54:42 juju-e4d256-prod-github-runner-207 kernel: [63056.585054] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 22:54:42 juju-e4d256-prod-github-runner-207 kernel: [63056.586194] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 22:54:42 juju-e4d256-prod-github-runner-207 kernel: [63056.587290] Aug 22 22:54:42 juju-e4d256-prod-github-runner-207 kernel: [63056.588339] Aug 22 22:54:42 juju-e4d256-prod-github-runner-207 kernel: [63056.589323] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 22:54:42 juju-e4d256-prod-github-runner-207 kernel: [63056.590358] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:54:42 juju-e4d256-prod-github-runner-207 kernel: [63056.591419] ? _raw_spin_lock+0x22/0x30 Aug 22 22:54:42 juju-e4d256-prod-github-runner-207 kernel: [63056.592376] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:54:42 juju-e4d256-prod-github-runner-207 kernel: [63056.593403] direct_page_fault+0x206/0x310 [kvm] Aug 22 22:54:42 juju-e4d256-prod-github-runner-207 kernel: [63056.594427] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 22:54:42 juju-e4d256-prod-github-runner-207 kernel: [63056.595596] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 22:54:42 juju-e4d256-prod-github-runner-207 kernel: [63056.596803] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 22:54:42 juju-e4d256-prod-github-runner-207 kernel: [63056.597800] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 22:54:42 juju-e4d256-prod-github-runner-207 kernel: [63056.598746] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 22:54:42 juju-e4d256-prod-github-runner-207 kernel: [63056.599745] handle_exit+0x98/0x230 [kvm_amd] Aug 22 22:54:42 juju-e4d256-prod-github-runner-207 kernel: [63056.600638] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 22:54:42 juju-e4d256-prod-github-runner-207 kernel: [63056.601554] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 22:54:42 juju-e4d256-prod-github-runner-207 kernel: [63056.602485] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 22:54:42 juju-e4d256-prod-github-runner-207 kernel: [63056.603402] vcpu_run+0x62/0x2c0 [kvm] Aug 22 22:54:42 juju-e4d256-prod-github-runner-207 kernel: [63056.604217] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 22:54:42 juju-e4d256-prod-github-runner-207 kernel: [63056.605024] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 22:54:42 juju-e4d256-prod-github-runner-207 kernel: [63056.605883] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 22:54:42 juju-e4d256-prod-github-runner-207 kernel: [63056.606687] ? __seccomp_filter+0x4a/0x4a0 Aug 22 22:54:42 juju-e4d256-prod-github-runner-207 kernel: [63056.607451] ? __fget_files+0x86/0xc0 Aug 22 22:54:42 juju-e4d256-prod-github-runner-207 kernel: [63056.608165] __x64_sys_ioctl+0x95/0xd0 Aug 22 22:54:42 juju-e4d256-prod-github-runner-207 kernel: [63056.608868] do_syscall_64+0x5c/0xc0 Aug 22 22:54:42 juju-e4d256-prod-github-runner-207 kernel: [63056.609540] ? do_futex+0x162/0x1f0 Aug 22 22:54:42 juju-e4d256-prod-github-runner-207 kernel: [63056.610206] ? __x64_sys_futex+0x78/0x1e0 Aug 22 22:54:42 juju-e4d256-prod-github-runner-207 kernel: [63056.610919] ? __secure_computing+0xa9/0x120 Aug 22 22:54:42 juju-e4d256-prod-github-runner-207 kernel: [63056.611642] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 22:54:42 juju-e4d256-prod-github-runner-207 kernel: [63056.612408] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:54:42 juju-e4d256-prod-github-runner-207 kernel: [63056.613150] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:54:42 juju-e4d256-prod-github-runner-207 kernel: [63056.613886] ? do_syscall_64+0x69/0xc0 Aug 22 22:54:42 juju-e4d256-prod-github-runner-207 kernel: [63056.614541] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:54:42 juju-e4d256-prod-github-runner-207 kernel: [63056.615276] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:54:42 juju-e4d256-prod-github-runner-207 kernel: [63056.616017] ? do_syscall_64+0x69/0xc0 Aug 22 22:54:42 juju-e4d256-prod-github-runner-207 kernel: [63056.616667] ? do_syscall_64+0x69/0xc0 Aug 22 22:54:42 juju-e4d256-prod-github-runner-207 kernel: [63056.617306] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 22:54:42 juju-e4d256-prod-github-runner-207 kernel: [63056.618017] RIP: 0033:0x7faa5d0edaff Aug 22 22:54:42 juju-e4d256-prod-github-runner-207 kernel: [63056.618665] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 22:54:42 juju-e4d256-prod-github-runner-207 kernel: [63056.620681] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 22:54:42 juju-e4d256-prod-github-runner-207 kernel: [63056.621623] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 22:54:42 juju-e4d256-prod-github-runner-207 kernel: [63056.622530] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 22:54:42 juju-e4d256-prod-github-runner-207 kernel: [63056.623453] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 22:54:42 juju-e4d256-prod-github-runner-207 kernel: [63056.624352] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 22:54:42 juju-e4d256-prod-github-runner-207 kernel: [63056.625257] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 22:54:42 juju-e4d256-prod-github-runner-207 kernel: [63056.626182] Aug 22 22:55:10 juju-e4d256-prod-github-runner-207 kernel: [63084.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 58644s! [qemu-system-x86:6715] Aug 22 22:55:10 juju-e4d256-prod-github-runner-207 kernel: [63084.543096] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 22:55:10 juju-e4d256-prod-github-runner-207 kernel: [63084.543169] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 22:55:10 juju-e4d256-prod-github-runner-207 kernel: [63084.556794] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 22:55:10 juju-e4d256-prod-github-runner-207 kernel: [63084.558265] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 22:55:10 juju-e4d256-prod-github-runner-207 kernel: [63084.559723] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:55:10 juju-e4d256-prod-github-runner-207 kernel: [63084.560961] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 22:55:10 juju-e4d256-prod-github-runner-207 kernel: [63084.563969] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 22:55:10 juju-e4d256-prod-github-runner-207 kernel: [63084.565205] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 22:55:10 juju-e4d256-prod-github-runner-207 kernel: [63084.566540] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 22:55:10 juju-e4d256-prod-github-runner-207 kernel: [63084.567919] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 22:55:10 juju-e4d256-prod-github-runner-207 kernel: [63084.569258] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 22:55:10 juju-e4d256-prod-github-runner-207 kernel: [63084.570610] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 22:55:10 juju-e4d256-prod-github-runner-207 kernel: [63084.572015] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 22:55:10 juju-e4d256-prod-github-runner-207 kernel: [63084.573430] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 22:55:10 juju-e4d256-prod-github-runner-207 kernel: [63084.574673] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 22:55:10 juju-e4d256-prod-github-runner-207 kernel: [63084.576266] Call Trace: Aug 22 22:55:10 juju-e4d256-prod-github-runner-207 kernel: [63084.577445] Aug 22 22:55:10 juju-e4d256-prod-github-runner-207 kernel: [63084.578478] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:55:10 juju-e4d256-prod-github-runner-207 kernel: [63084.579672] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:55:10 juju-e4d256-prod-github-runner-207 kernel: [63084.580807] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:55:10 juju-e4d256-prod-github-runner-207 kernel: [63084.582009] ? show_regs.part.0+0x23/0x29 Aug 22 22:55:10 juju-e4d256-prod-github-runner-207 kernel: [63084.583192] ? show_regs.cold+0x8/0xd Aug 22 22:55:10 juju-e4d256-prod-github-runner-207 kernel: [63084.584347] ? watchdog_timer_fn+0x1be/0x220 Aug 22 22:55:10 juju-e4d256-prod-github-runner-207 kernel: [63084.585542] ? lockup_detector_update_enable+0x60/0x60 Aug 22 22:55:10 juju-e4d256-prod-github-runner-207 kernel: [63084.586839] ? __hrtimer_run_queues+0x107/0x230 Aug 22 22:55:10 juju-e4d256-prod-github-runner-207 kernel: [63084.588099] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 22:55:10 juju-e4d256-prod-github-runner-207 kernel: [63084.589283] ? hrtimer_interrupt+0x101/0x220 Aug 22 22:55:10 juju-e4d256-prod-github-runner-207 kernel: [63084.590501] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 22:55:10 juju-e4d256-prod-github-runner-207 kernel: [63084.591802] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 22:55:10 juju-e4d256-prod-github-runner-207 kernel: [63084.592985] Aug 22 22:55:10 juju-e4d256-prod-github-runner-207 kernel: [63084.593994] Aug 22 22:55:10 juju-e4d256-prod-github-runner-207 kernel: [63084.594986] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 22:55:10 juju-e4d256-prod-github-runner-207 kernel: [63084.596210] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:55:10 juju-e4d256-prod-github-runner-207 kernel: [63084.597411] ? _raw_spin_lock+0x22/0x30 Aug 22 22:55:10 juju-e4d256-prod-github-runner-207 kernel: [63084.598508] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:55:10 juju-e4d256-prod-github-runner-207 kernel: [63084.599689] direct_page_fault+0x206/0x310 [kvm] Aug 22 22:55:10 juju-e4d256-prod-github-runner-207 kernel: [63084.600912] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 22:55:10 juju-e4d256-prod-github-runner-207 kernel: [63084.602083] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 22:55:10 juju-e4d256-prod-github-runner-207 kernel: [63084.603242] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 22:55:10 juju-e4d256-prod-github-runner-207 kernel: [63084.604378] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 22:55:10 juju-e4d256-prod-github-runner-207 kernel: [63084.605479] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 22:55:10 juju-e4d256-prod-github-runner-207 kernel: [63084.606643] handle_exit+0x98/0x230 [kvm_amd] Aug 22 22:55:10 juju-e4d256-prod-github-runner-207 kernel: [63084.607960] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 22:55:10 juju-e4d256-prod-github-runner-207 kernel: [63084.609183] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 22:55:10 juju-e4d256-prod-github-runner-207 kernel: [63084.610260] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 22:55:10 juju-e4d256-prod-github-runner-207 kernel: [63084.611359] vcpu_run+0x62/0x2c0 [kvm] Aug 22 22:55:10 juju-e4d256-prod-github-runner-207 kernel: [63084.612272] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 22:55:10 juju-e4d256-prod-github-runner-207 kernel: [63084.613207] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 22:55:10 juju-e4d256-prod-github-runner-207 kernel: [63084.614247] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 22:55:10 juju-e4d256-prod-github-runner-207 kernel: [63084.615185] ? __seccomp_filter+0x4a/0x4a0 Aug 22 22:55:10 juju-e4d256-prod-github-runner-207 kernel: [63084.616089] ? __fget_files+0x86/0xc0 Aug 22 22:55:10 juju-e4d256-prod-github-runner-207 kernel: [63084.616951] __x64_sys_ioctl+0x95/0xd0 Aug 22 22:55:10 juju-e4d256-prod-github-runner-207 kernel: [63084.617710] do_syscall_64+0x5c/0xc0 Aug 22 22:55:10 juju-e4d256-prod-github-runner-207 kernel: [63084.618505] ? do_futex+0x162/0x1f0 Aug 22 22:55:10 juju-e4d256-prod-github-runner-207 kernel: [63084.619322] ? __x64_sys_futex+0x78/0x1e0 Aug 22 22:55:10 juju-e4d256-prod-github-runner-207 kernel: [63084.620097] ? __secure_computing+0xa9/0x120 Aug 22 22:55:10 juju-e4d256-prod-github-runner-207 kernel: [63084.620925] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 22:55:10 juju-e4d256-prod-github-runner-207 kernel: [63084.621795] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:55:10 juju-e4d256-prod-github-runner-207 kernel: [63084.622656] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:55:10 juju-e4d256-prod-github-runner-207 kernel: [63084.623543] ? do_syscall_64+0x69/0xc0 Aug 22 22:55:10 juju-e4d256-prod-github-runner-207 kernel: [63084.624260] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:55:10 juju-e4d256-prod-github-runner-207 kernel: [63084.625084] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:55:10 juju-e4d256-prod-github-runner-207 kernel: [63084.625897] ? do_syscall_64+0x69/0xc0 Aug 22 22:55:10 juju-e4d256-prod-github-runner-207 kernel: [63084.626650] ? do_syscall_64+0x69/0xc0 Aug 22 22:55:10 juju-e4d256-prod-github-runner-207 kernel: [63084.627395] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 22:55:10 juju-e4d256-prod-github-runner-207 kernel: [63084.628259] RIP: 0033:0x7faa5d0edaff Aug 22 22:55:10 juju-e4d256-prod-github-runner-207 kernel: [63084.628969] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 22:55:10 juju-e4d256-prod-github-runner-207 kernel: [63084.631316] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 22:55:10 juju-e4d256-prod-github-runner-207 kernel: [63084.632417] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 22:55:10 juju-e4d256-prod-github-runner-207 kernel: [63084.633411] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 22:55:10 juju-e4d256-prod-github-runner-207 kernel: [63084.634415] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 22:55:10 juju-e4d256-prod-github-runner-207 kernel: [63084.635469] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 22:55:10 juju-e4d256-prod-github-runner-207 kernel: [63084.636491] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 22:55:10 juju-e4d256-prod-github-runner-207 kernel: [63084.637560] Aug 22 22:55:38 juju-e4d256-prod-github-runner-207 kernel: [63112.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 58670s! [qemu-system-x86:6715] Aug 22 22:55:38 juju-e4d256-prod-github-runner-207 kernel: [63112.543098] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 22:55:38 juju-e4d256-prod-github-runner-207 kernel: [63112.543164] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 22:55:38 juju-e4d256-prod-github-runner-207 kernel: [63112.555394] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 22:55:38 juju-e4d256-prod-github-runner-207 kernel: [63112.556677] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 22:55:38 juju-e4d256-prod-github-runner-207 kernel: [63112.557903] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:55:38 juju-e4d256-prod-github-runner-207 kernel: [63112.558996] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 22:55:38 juju-e4d256-prod-github-runner-207 kernel: [63112.561602] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 22:55:38 juju-e4d256-prod-github-runner-207 kernel: [63112.562673] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 22:55:38 juju-e4d256-prod-github-runner-207 kernel: [63112.563847] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 22:55:38 juju-e4d256-prod-github-runner-207 kernel: [63112.565016] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 22:55:38 juju-e4d256-prod-github-runner-207 kernel: [63112.566201] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 22:55:38 juju-e4d256-prod-github-runner-207 kernel: [63112.567416] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 22:55:38 juju-e4d256-prod-github-runner-207 kernel: [63112.568584] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 22:55:38 juju-e4d256-prod-github-runner-207 kernel: [63112.569822] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 22:55:38 juju-e4d256-prod-github-runner-207 kernel: [63112.570964] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 22:55:38 juju-e4d256-prod-github-runner-207 kernel: [63112.572215] Call Trace: Aug 22 22:55:38 juju-e4d256-prod-github-runner-207 kernel: [63112.573132] Aug 22 22:55:38 juju-e4d256-prod-github-runner-207 kernel: [63112.574018] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:55:38 juju-e4d256-prod-github-runner-207 kernel: [63112.575086] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:55:38 juju-e4d256-prod-github-runner-207 kernel: [63112.576135] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:55:38 juju-e4d256-prod-github-runner-207 kernel: [63112.577237] ? show_regs.part.0+0x23/0x29 Aug 22 22:55:38 juju-e4d256-prod-github-runner-207 kernel: [63112.578241] ? show_regs.cold+0x8/0xd Aug 22 22:55:38 juju-e4d256-prod-github-runner-207 kernel: [63112.579236] ? watchdog_timer_fn+0x1be/0x220 Aug 22 22:55:38 juju-e4d256-prod-github-runner-207 kernel: [63112.580253] ? lockup_detector_update_enable+0x60/0x60 Aug 22 22:55:38 juju-e4d256-prod-github-runner-207 kernel: [63112.581328] ? __hrtimer_run_queues+0x107/0x230 Aug 22 22:55:38 juju-e4d256-prod-github-runner-207 kernel: [63112.582393] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 22:55:38 juju-e4d256-prod-github-runner-207 kernel: [63112.583445] ? hrtimer_interrupt+0x101/0x220 Aug 22 22:55:38 juju-e4d256-prod-github-runner-207 kernel: [63112.584468] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 22:55:38 juju-e4d256-prod-github-runner-207 kernel: [63112.585540] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 22:55:38 juju-e4d256-prod-github-runner-207 kernel: [63112.586626] Aug 22 22:55:38 juju-e4d256-prod-github-runner-207 kernel: [63112.587494] Aug 22 22:55:38 juju-e4d256-prod-github-runner-207 kernel: [63112.588336] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 22:55:38 juju-e4d256-prod-github-runner-207 kernel: [63112.589372] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:55:38 juju-e4d256-prod-github-runner-207 kernel: [63112.590429] ? _raw_spin_lock+0x22/0x30 Aug 22 22:55:38 juju-e4d256-prod-github-runner-207 kernel: [63112.591408] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:55:38 juju-e4d256-prod-github-runner-207 kernel: [63112.592464] direct_page_fault+0x206/0x310 [kvm] Aug 22 22:55:38 juju-e4d256-prod-github-runner-207 kernel: [63112.593495] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 22:55:38 juju-e4d256-prod-github-runner-207 kernel: [63112.594512] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 22:55:38 juju-e4d256-prod-github-runner-207 kernel: [63112.595531] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 22:55:38 juju-e4d256-prod-github-runner-207 kernel: [63112.596516] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 22:55:38 juju-e4d256-prod-github-runner-207 kernel: [63112.597480] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 22:55:38 juju-e4d256-prod-github-runner-207 kernel: [63112.598475] handle_exit+0x98/0x230 [kvm_amd] Aug 22 22:55:38 juju-e4d256-prod-github-runner-207 kernel: [63112.599385] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 22:55:38 juju-e4d256-prod-github-runner-207 kernel: [63112.600304] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 22:55:38 juju-e4d256-prod-github-runner-207 kernel: [63112.601233] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 22:55:38 juju-e4d256-prod-github-runner-207 kernel: [63112.602163] vcpu_run+0x62/0x2c0 [kvm] Aug 22 22:55:38 juju-e4d256-prod-github-runner-207 kernel: [63112.603014] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 22:55:38 juju-e4d256-prod-github-runner-207 kernel: [63112.603829] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 22:55:38 juju-e4d256-prod-github-runner-207 kernel: [63112.604692] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 22:55:38 juju-e4d256-prod-github-runner-207 kernel: [63112.605491] ? __seccomp_filter+0x4a/0x4a0 Aug 22 22:55:38 juju-e4d256-prod-github-runner-207 kernel: [63112.606237] ? __fget_files+0x86/0xc0 Aug 22 22:55:38 juju-e4d256-prod-github-runner-207 kernel: [63112.606979] __x64_sys_ioctl+0x95/0xd0 Aug 22 22:55:38 juju-e4d256-prod-github-runner-207 kernel: [63112.607689] do_syscall_64+0x5c/0xc0 Aug 22 22:55:38 juju-e4d256-prod-github-runner-207 kernel: [63112.608362] ? do_futex+0x162/0x1f0 Aug 22 22:55:38 juju-e4d256-prod-github-runner-207 kernel: [63112.609014] ? __x64_sys_futex+0x78/0x1e0 Aug 22 22:55:38 juju-e4d256-prod-github-runner-207 kernel: [63112.609693] ? __secure_computing+0xa9/0x120 Aug 22 22:55:38 juju-e4d256-prod-github-runner-207 kernel: [63112.610392] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 22:55:38 juju-e4d256-prod-github-runner-207 kernel: [63112.611178] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:55:38 juju-e4d256-prod-github-runner-207 kernel: [63112.612082] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:55:38 juju-e4d256-prod-github-runner-207 kernel: [63112.612841] ? do_syscall_64+0x69/0xc0 Aug 22 22:55:38 juju-e4d256-prod-github-runner-207 kernel: [63112.613494] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:55:38 juju-e4d256-prod-github-runner-207 kernel: [63112.614204] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:55:38 juju-e4d256-prod-github-runner-207 kernel: [63112.615003] ? do_syscall_64+0x69/0xc0 Aug 22 22:55:38 juju-e4d256-prod-github-runner-207 kernel: [63112.615791] ? do_syscall_64+0x69/0xc0 Aug 22 22:55:38 juju-e4d256-prod-github-runner-207 kernel: [63112.616420] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 22:55:38 juju-e4d256-prod-github-runner-207 kernel: [63112.617142] RIP: 0033:0x7faa5d0edaff Aug 22 22:55:38 juju-e4d256-prod-github-runner-207 kernel: [63112.617788] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 22:55:38 juju-e4d256-prod-github-runner-207 kernel: [63112.619812] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 22:55:38 juju-e4d256-prod-github-runner-207 kernel: [63112.620727] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 22:55:38 juju-e4d256-prod-github-runner-207 kernel: [63112.621623] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 22:55:38 juju-e4d256-prod-github-runner-207 kernel: [63112.622530] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 22:55:38 juju-e4d256-prod-github-runner-207 kernel: [63112.623480] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 22:55:38 juju-e4d256-prod-github-runner-207 kernel: [63112.624374] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 22:55:38 juju-e4d256-prod-github-runner-207 kernel: [63112.625293] Aug 22 22:56:06 juju-e4d256-prod-github-runner-207 kernel: [63140.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 58696s! [qemu-system-x86:6715] Aug 22 22:56:06 juju-e4d256-prod-github-runner-207 kernel: [63140.543764] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 22:56:06 juju-e4d256-prod-github-runner-207 kernel: [63140.544019] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 22:56:06 juju-e4d256-prod-github-runner-207 kernel: [63140.556173] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 22:56:06 juju-e4d256-prod-github-runner-207 kernel: [63140.557438] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 22:56:06 juju-e4d256-prod-github-runner-207 kernel: [63140.558675] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:56:06 juju-e4d256-prod-github-runner-207 kernel: [63140.559731] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 22:56:06 juju-e4d256-prod-github-runner-207 kernel: [63140.562296] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 22:56:06 juju-e4d256-prod-github-runner-207 kernel: [63140.563339] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 22:56:06 juju-e4d256-prod-github-runner-207 kernel: [63140.564508] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 22:56:06 juju-e4d256-prod-github-runner-207 kernel: [63140.565685] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 22:56:06 juju-e4d256-prod-github-runner-207 kernel: [63140.566874] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 22:56:06 juju-e4d256-prod-github-runner-207 kernel: [63140.568033] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 22:56:06 juju-e4d256-prod-github-runner-207 kernel: [63140.569198] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 22:56:06 juju-e4d256-prod-github-runner-207 kernel: [63140.570454] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 22:56:06 juju-e4d256-prod-github-runner-207 kernel: [63140.571561] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 22:56:06 juju-e4d256-prod-github-runner-207 kernel: [63140.572755] Call Trace: Aug 22 22:56:06 juju-e4d256-prod-github-runner-207 kernel: [63140.573668] Aug 22 22:56:06 juju-e4d256-prod-github-runner-207 kernel: [63140.574584] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:56:06 juju-e4d256-prod-github-runner-207 kernel: [63140.575615] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:56:06 juju-e4d256-prod-github-runner-207 kernel: [63140.576637] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:56:06 juju-e4d256-prod-github-runner-207 kernel: [63140.577736] ? show_regs.part.0+0x23/0x29 Aug 22 22:56:06 juju-e4d256-prod-github-runner-207 kernel: [63140.578741] ? show_regs.cold+0x8/0xd Aug 22 22:56:06 juju-e4d256-prod-github-runner-207 kernel: [63140.579713] ? watchdog_timer_fn+0x1be/0x220 Aug 22 22:56:06 juju-e4d256-prod-github-runner-207 kernel: [63140.580728] ? lockup_detector_update_enable+0x60/0x60 Aug 22 22:56:06 juju-e4d256-prod-github-runner-207 kernel: [63140.581796] ? __hrtimer_run_queues+0x107/0x230 Aug 22 22:56:06 juju-e4d256-prod-github-runner-207 kernel: [63140.582830] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 22:56:06 juju-e4d256-prod-github-runner-207 kernel: [63140.583856] ? hrtimer_interrupt+0x101/0x220 Aug 22 22:56:06 juju-e4d256-prod-github-runner-207 kernel: [63140.584875] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 22:56:06 juju-e4d256-prod-github-runner-207 kernel: [63140.585945] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 22:56:06 juju-e4d256-prod-github-runner-207 kernel: [63140.587006] Aug 22 22:56:06 juju-e4d256-prod-github-runner-207 kernel: [63140.587864] Aug 22 22:56:06 juju-e4d256-prod-github-runner-207 kernel: [63140.588701] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 22:56:06 juju-e4d256-prod-github-runner-207 kernel: [63140.589738] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:56:06 juju-e4d256-prod-github-runner-207 kernel: [63140.590783] ? _raw_spin_lock+0x22/0x30 Aug 22 22:56:06 juju-e4d256-prod-github-runner-207 kernel: [63140.591729] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:56:06 juju-e4d256-prod-github-runner-207 kernel: [63140.592743] direct_page_fault+0x206/0x310 [kvm] Aug 22 22:56:06 juju-e4d256-prod-github-runner-207 kernel: [63140.593767] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 22:56:06 juju-e4d256-prod-github-runner-207 kernel: [63140.594788] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 22:56:06 juju-e4d256-prod-github-runner-207 kernel: [63140.595810] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 22:56:06 juju-e4d256-prod-github-runner-207 kernel: [63140.596818] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 22:56:06 juju-e4d256-prod-github-runner-207 kernel: [63140.597774] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 22:56:06 juju-e4d256-prod-github-runner-207 kernel: [63140.598772] handle_exit+0x98/0x230 [kvm_amd] Aug 22 22:56:06 juju-e4d256-prod-github-runner-207 kernel: [63140.599663] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 22:56:06 juju-e4d256-prod-github-runner-207 kernel: [63140.600574] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 22:56:06 juju-e4d256-prod-github-runner-207 kernel: [63140.601533] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 22:56:06 juju-e4d256-prod-github-runner-207 kernel: [63140.602603] vcpu_run+0x62/0x2c0 [kvm] Aug 22 22:56:06 juju-e4d256-prod-github-runner-207 kernel: [63140.603853] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 22:56:06 juju-e4d256-prod-github-runner-207 kernel: [63140.605085] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 22:56:06 juju-e4d256-prod-github-runner-207 kernel: [63140.606422] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 22:56:06 juju-e4d256-prod-github-runner-207 kernel: [63140.607652] ? __seccomp_filter+0x4a/0x4a0 Aug 22 22:56:06 juju-e4d256-prod-github-runner-207 kernel: [63140.608795] ? __fget_files+0x86/0xc0 Aug 22 22:56:06 juju-e4d256-prod-github-runner-207 kernel: [63140.609873] __x64_sys_ioctl+0x95/0xd0 Aug 22 22:56:06 juju-e4d256-prod-github-runner-207 kernel: [63140.610953] do_syscall_64+0x5c/0xc0 Aug 22 22:56:06 juju-e4d256-prod-github-runner-207 kernel: [63140.611977] ? do_futex+0x162/0x1f0 Aug 22 22:56:06 juju-e4d256-prod-github-runner-207 kernel: [63140.612968] ? __x64_sys_futex+0x78/0x1e0 Aug 22 22:56:06 juju-e4d256-prod-github-runner-207 kernel: [63140.613993] ? __secure_computing+0xa9/0x120 Aug 22 22:56:06 juju-e4d256-prod-github-runner-207 kernel: [63140.615056] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 22:56:06 juju-e4d256-prod-github-runner-207 kernel: [63140.616142] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:56:06 juju-e4d256-prod-github-runner-207 kernel: [63140.617309] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:56:06 juju-e4d256-prod-github-runner-207 kernel: [63140.618475] ? do_syscall_64+0x69/0xc0 Aug 22 22:56:06 juju-e4d256-prod-github-runner-207 kernel: [63140.619294] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:56:06 juju-e4d256-prod-github-runner-207 kernel: [63140.620003] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:56:06 juju-e4d256-prod-github-runner-207 kernel: [63140.620701] ? do_syscall_64+0x69/0xc0 Aug 22 22:56:06 juju-e4d256-prod-github-runner-207 kernel: [63140.621339] ? do_syscall_64+0x69/0xc0 Aug 22 22:56:06 juju-e4d256-prod-github-runner-207 kernel: [63140.621963] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 22:56:06 juju-e4d256-prod-github-runner-207 kernel: [63140.622724] RIP: 0033:0x7faa5d0edaff Aug 22 22:56:06 juju-e4d256-prod-github-runner-207 kernel: [63140.623382] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 22:56:06 juju-e4d256-prod-github-runner-207 kernel: [63140.625407] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 22:56:06 juju-e4d256-prod-github-runner-207 kernel: [63140.626359] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 22:56:06 juju-e4d256-prod-github-runner-207 kernel: [63140.627666] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 22:56:06 juju-e4d256-prod-github-runner-207 kernel: [63140.629010] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 22:56:06 juju-e4d256-prod-github-runner-207 kernel: [63140.630354] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 22:56:06 juju-e4d256-prod-github-runner-207 kernel: [63140.631702] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 22:56:06 juju-e4d256-prod-github-runner-207 kernel: [63140.633042] Aug 22 22:56:34 juju-e4d256-prod-github-runner-207 kernel: [63168.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 58722s! [qemu-system-x86:6715] Aug 22 22:56:34 juju-e4d256-prod-github-runner-207 kernel: [63168.543100] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 22:56:34 juju-e4d256-prod-github-runner-207 kernel: [63168.543169] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 22:56:34 juju-e4d256-prod-github-runner-207 kernel: [63168.555300] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 22:56:34 juju-e4d256-prod-github-runner-207 kernel: [63168.556571] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 22:56:34 juju-e4d256-prod-github-runner-207 kernel: [63168.557797] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:56:34 juju-e4d256-prod-github-runner-207 kernel: [63168.558874] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 22:56:34 juju-e4d256-prod-github-runner-207 kernel: [63168.561436] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 22:56:34 juju-e4d256-prod-github-runner-207 kernel: [63168.562496] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 22:56:34 juju-e4d256-prod-github-runner-207 kernel: [63168.563659] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 22:56:34 juju-e4d256-prod-github-runner-207 kernel: [63168.564824] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 22:56:34 juju-e4d256-prod-github-runner-207 kernel: [63168.565998] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 22:56:34 juju-e4d256-prod-github-runner-207 kernel: [63168.567160] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 22:56:34 juju-e4d256-prod-github-runner-207 kernel: [63168.568328] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 22:56:34 juju-e4d256-prod-github-runner-207 kernel: [63168.569575] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 22:56:34 juju-e4d256-prod-github-runner-207 kernel: [63168.570716] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 22:56:34 juju-e4d256-prod-github-runner-207 kernel: [63168.571921] Call Trace: Aug 22 22:56:34 juju-e4d256-prod-github-runner-207 kernel: [63168.572843] Aug 22 22:56:34 juju-e4d256-prod-github-runner-207 kernel: [63168.573740] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:56:34 juju-e4d256-prod-github-runner-207 kernel: [63168.574793] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:56:34 juju-e4d256-prod-github-runner-207 kernel: [63168.575813] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:56:34 juju-e4d256-prod-github-runner-207 kernel: [63168.576898] ? show_regs.part.0+0x23/0x29 Aug 22 22:56:34 juju-e4d256-prod-github-runner-207 kernel: [63168.577898] ? show_regs.cold+0x8/0xd Aug 22 22:56:34 juju-e4d256-prod-github-runner-207 kernel: [63168.578889] ? watchdog_timer_fn+0x1be/0x220 Aug 22 22:56:34 juju-e4d256-prod-github-runner-207 kernel: [63168.579904] ? lockup_detector_update_enable+0x60/0x60 Aug 22 22:56:34 juju-e4d256-prod-github-runner-207 kernel: [63168.580964] ? __hrtimer_run_queues+0x107/0x230 Aug 22 22:56:34 juju-e4d256-prod-github-runner-207 kernel: [63168.582030] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 22:56:34 juju-e4d256-prod-github-runner-207 kernel: [63168.583065] ? hrtimer_interrupt+0x101/0x220 Aug 22 22:56:34 juju-e4d256-prod-github-runner-207 kernel: [63168.584080] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 22:56:34 juju-e4d256-prod-github-runner-207 kernel: [63168.585166] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 22:56:34 juju-e4d256-prod-github-runner-207 kernel: [63168.586234] Aug 22 22:56:34 juju-e4d256-prod-github-runner-207 kernel: [63168.587085] Aug 22 22:56:34 juju-e4d256-prod-github-runner-207 kernel: [63168.587921] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 22:56:34 juju-e4d256-prod-github-runner-207 kernel: [63168.588958] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:56:34 juju-e4d256-prod-github-runner-207 kernel: [63168.590013] ? _raw_spin_lock+0x22/0x30 Aug 22 22:56:34 juju-e4d256-prod-github-runner-207 kernel: [63168.590957] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:56:34 juju-e4d256-prod-github-runner-207 kernel: [63168.591980] direct_page_fault+0x206/0x310 [kvm] Aug 22 22:56:34 juju-e4d256-prod-github-runner-207 kernel: [63168.593001] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 22:56:34 juju-e4d256-prod-github-runner-207 kernel: [63168.594029] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 22:56:34 juju-e4d256-prod-github-runner-207 kernel: [63168.595036] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 22:56:34 juju-e4d256-prod-github-runner-207 kernel: [63168.596006] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 22:56:34 juju-e4d256-prod-github-runner-207 kernel: [63168.596952] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 22:56:34 juju-e4d256-prod-github-runner-207 kernel: [63168.597941] handle_exit+0x98/0x230 [kvm_amd] Aug 22 22:56:34 juju-e4d256-prod-github-runner-207 kernel: [63168.598837] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 22:56:34 juju-e4d256-prod-github-runner-207 kernel: [63168.599752] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 22:56:34 juju-e4d256-prod-github-runner-207 kernel: [63168.600679] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 22:56:34 juju-e4d256-prod-github-runner-207 kernel: [63168.601582] vcpu_run+0x62/0x2c0 [kvm] Aug 22 22:56:34 juju-e4d256-prod-github-runner-207 kernel: [63168.602433] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 22:56:34 juju-e4d256-prod-github-runner-207 kernel: [63168.603281] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 22:56:34 juju-e4d256-prod-github-runner-207 kernel: [63168.604141] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 22:56:34 juju-e4d256-prod-github-runner-207 kernel: [63168.604937] ? __seccomp_filter+0x4a/0x4a0 Aug 22 22:56:34 juju-e4d256-prod-github-runner-207 kernel: [63168.605683] ? __fget_files+0x86/0xc0 Aug 22 22:56:34 juju-e4d256-prod-github-runner-207 kernel: [63168.606403] __x64_sys_ioctl+0x95/0xd0 Aug 22 22:56:34 juju-e4d256-prod-github-runner-207 kernel: [63168.607099] do_syscall_64+0x5c/0xc0 Aug 22 22:56:34 juju-e4d256-prod-github-runner-207 kernel: [63168.607763] ? do_futex+0x162/0x1f0 Aug 22 22:56:34 juju-e4d256-prod-github-runner-207 kernel: [63168.608412] ? __x64_sys_futex+0x78/0x1e0 Aug 22 22:56:34 juju-e4d256-prod-github-runner-207 kernel: [63168.609088] ? __secure_computing+0xa9/0x120 Aug 22 22:56:34 juju-e4d256-prod-github-runner-207 kernel: [63168.609779] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 22:56:34 juju-e4d256-prod-github-runner-207 kernel: [63168.610550] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:56:34 juju-e4d256-prod-github-runner-207 kernel: [63168.611270] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:56:34 juju-e4d256-prod-github-runner-207 kernel: [63168.612017] ? do_syscall_64+0x69/0xc0 Aug 22 22:56:34 juju-e4d256-prod-github-runner-207 kernel: [63168.612664] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:56:34 juju-e4d256-prod-github-runner-207 kernel: [63168.613365] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:56:34 juju-e4d256-prod-github-runner-207 kernel: [63168.614096] ? do_syscall_64+0x69/0xc0 Aug 22 22:56:34 juju-e4d256-prod-github-runner-207 kernel: [63168.614723] ? do_syscall_64+0x69/0xc0 Aug 22 22:56:34 juju-e4d256-prod-github-runner-207 kernel: [63168.615483] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 22:56:34 juju-e4d256-prod-github-runner-207 kernel: [63168.616287] RIP: 0033:0x7faa5d0edaff Aug 22 22:56:34 juju-e4d256-prod-github-runner-207 kernel: [63168.616910] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 22:56:34 juju-e4d256-prod-github-runner-207 kernel: [63168.618903] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 22:56:34 juju-e4d256-prod-github-runner-207 kernel: [63168.619815] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 22:56:34 juju-e4d256-prod-github-runner-207 kernel: [63168.620722] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 22:56:34 juju-e4d256-prod-github-runner-207 kernel: [63168.621605] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 22:56:34 juju-e4d256-prod-github-runner-207 kernel: [63168.622497] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 22:56:34 juju-e4d256-prod-github-runner-207 kernel: [63168.623388] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 22:56:34 juju-e4d256-prod-github-runner-207 kernel: [63168.624278] Aug 22 22:56:47 juju-e4d256-prod-github-runner-207 kernel: [63181.400709] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 22:56:47 juju-e4d256-prod-github-runner-207 kernel: [63181.401659] rcu: 1-....: (15716350 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=7588691 Aug 22 22:56:47 juju-e4d256-prod-github-runner-207 kernel: [63181.402809] (t=15766050 jiffies g=23269 q=55954) Aug 22 22:56:47 juju-e4d256-prod-github-runner-207 kernel: [63181.403598] NMI backtrace for cpu 1 Aug 22 22:56:47 juju-e4d256-prod-github-runner-207 kernel: [63181.404311] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 22:56:47 juju-e4d256-prod-github-runner-207 kernel: [63181.405418] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 22:56:47 juju-e4d256-prod-github-runner-207 kernel: [63181.406493] Call Trace: Aug 22 22:56:47 juju-e4d256-prod-github-runner-207 kernel: [63181.407173] Aug 22 22:56:47 juju-e4d256-prod-github-runner-207 kernel: [63181.407819] show_stack+0x52/0x5c Aug 22 22:56:47 juju-e4d256-prod-github-runner-207 kernel: [63181.408546] dump_stack_lvl+0x4a/0x63 Aug 22 22:56:47 juju-e4d256-prod-github-runner-207 kernel: [63181.409505] dump_stack+0x10/0x16 Aug 22 22:56:47 juju-e4d256-prod-github-runner-207 kernel: [63181.410277] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 22:56:47 juju-e4d256-prod-github-runner-207 kernel: [63181.411094] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 22:56:47 juju-e4d256-prod-github-runner-207 kernel: [63181.411873] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 22:56:47 juju-e4d256-prod-github-runner-207 kernel: [63181.412878] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 22:56:47 juju-e4d256-prod-github-runner-207 kernel: [63181.413706] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 22:56:47 juju-e4d256-prod-github-runner-207 kernel: [63181.414535] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 22:56:47 juju-e4d256-prod-github-runner-207 kernel: [63181.415443] print_cpu_stall.cold+0x2f/0xe2 Aug 22 22:56:47 juju-e4d256-prod-github-runner-207 kernel: [63181.416205] ? timekeeping_update+0xf7/0x150 Aug 22 22:56:47 juju-e4d256-prod-github-runner-207 kernel: [63181.416972] check_cpu_stall+0x109/0x270 Aug 22 22:56:47 juju-e4d256-prod-github-runner-207 kernel: [63181.417721] rcu_sched_clock_irq+0x9a/0x250 Aug 22 22:56:47 juju-e4d256-prod-github-runner-207 kernel: [63181.418502] update_process_times+0x94/0xd0 Aug 22 22:56:47 juju-e4d256-prod-github-runner-207 kernel: [63181.419258] tick_sched_handle+0x29/0x70 Aug 22 22:56:47 juju-e4d256-prod-github-runner-207 kernel: [63181.420043] tick_sched_timer+0x8c/0xc0 Aug 22 22:56:47 juju-e4d256-prod-github-runner-207 kernel: [63181.420792] ? tick_nohz_handler+0xb0/0xb0 Aug 22 22:56:47 juju-e4d256-prod-github-runner-207 kernel: [63181.421546] __hrtimer_run_queues+0x107/0x230 Aug 22 22:56:47 juju-e4d256-prod-github-runner-207 kernel: [63181.422336] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 22:56:47 juju-e4d256-prod-github-runner-207 kernel: [63181.423113] hrtimer_interrupt+0x101/0x220 Aug 22 22:56:47 juju-e4d256-prod-github-runner-207 kernel: [63181.423873] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 22:56:47 juju-e4d256-prod-github-runner-207 kernel: [63181.424682] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 22:56:47 juju-e4d256-prod-github-runner-207 kernel: [63181.425484] Aug 22 22:56:47 juju-e4d256-prod-github-runner-207 kernel: [63181.426137] Aug 22 22:56:47 juju-e4d256-prod-github-runner-207 kernel: [63181.426765] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 22:56:47 juju-e4d256-prod-github-runner-207 kernel: [63181.427581] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:56:47 juju-e4d256-prod-github-runner-207 kernel: [63181.428459] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 22:56:47 juju-e4d256-prod-github-runner-207 kernel: [63181.430728] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 22:56:47 juju-e4d256-prod-github-runner-207 kernel: [63181.431619] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 22:56:47 juju-e4d256-prod-github-runner-207 kernel: [63181.432611] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 22:56:47 juju-e4d256-prod-github-runner-207 kernel: [63181.433585] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 22:56:47 juju-e4d256-prod-github-runner-207 kernel: [63181.434571] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 22:56:47 juju-e4d256-prod-github-runner-207 kernel: [63181.435524] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 22:56:47 juju-e4d256-prod-github-runner-207 kernel: [63181.436477] ? _raw_spin_lock+0x22/0x30 Aug 22 22:56:47 juju-e4d256-prod-github-runner-207 kernel: [63181.437235] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:56:47 juju-e4d256-prod-github-runner-207 kernel: [63181.438086] direct_page_fault+0x206/0x310 [kvm] Aug 22 22:56:47 juju-e4d256-prod-github-runner-207 kernel: [63181.438925] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 22:56:47 juju-e4d256-prod-github-runner-207 kernel: [63181.439753] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 22:56:47 juju-e4d256-prod-github-runner-207 kernel: [63181.440617] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 22:56:47 juju-e4d256-prod-github-runner-207 kernel: [63181.441435] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 22:56:47 juju-e4d256-prod-github-runner-207 kernel: [63181.442241] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 22:56:47 juju-e4d256-prod-github-runner-207 kernel: [63181.443065] handle_exit+0x98/0x230 [kvm_amd] Aug 22 22:56:47 juju-e4d256-prod-github-runner-207 kernel: [63181.443819] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 22:56:47 juju-e4d256-prod-github-runner-207 kernel: [63181.444599] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 22:56:47 juju-e4d256-prod-github-runner-207 kernel: [63181.445398] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 22:56:47 juju-e4d256-prod-github-runner-207 kernel: [63181.446206] vcpu_run+0x62/0x2c0 [kvm] Aug 22 22:56:47 juju-e4d256-prod-github-runner-207 kernel: [63181.446920] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 22:56:47 juju-e4d256-prod-github-runner-207 kernel: [63181.447659] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 22:56:47 juju-e4d256-prod-github-runner-207 kernel: [63181.448457] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 22:56:47 juju-e4d256-prod-github-runner-207 kernel: [63181.449218] ? __seccomp_filter+0x4a/0x4a0 Aug 22 22:56:47 juju-e4d256-prod-github-runner-207 kernel: [63181.449949] ? __fget_files+0x86/0xc0 Aug 22 22:56:47 juju-e4d256-prod-github-runner-207 kernel: [63181.450646] __x64_sys_ioctl+0x95/0xd0 Aug 22 22:56:47 juju-e4d256-prod-github-runner-207 kernel: [63181.451341] do_syscall_64+0x5c/0xc0 Aug 22 22:56:47 juju-e4d256-prod-github-runner-207 kernel: [63181.452021] ? do_futex+0x162/0x1f0 Aug 22 22:56:47 juju-e4d256-prod-github-runner-207 kernel: [63181.452693] ? __x64_sys_futex+0x78/0x1e0 Aug 22 22:56:47 juju-e4d256-prod-github-runner-207 kernel: [63181.453396] ? __secure_computing+0xa9/0x120 Aug 22 22:56:47 juju-e4d256-prod-github-runner-207 kernel: [63181.454128] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 22:56:47 juju-e4d256-prod-github-runner-207 kernel: [63181.454916] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:56:47 juju-e4d256-prod-github-runner-207 kernel: [63181.455671] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:56:47 juju-e4d256-prod-github-runner-207 kernel: [63181.456430] ? do_syscall_64+0x69/0xc0 Aug 22 22:56:47 juju-e4d256-prod-github-runner-207 kernel: [63181.457120] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:56:47 juju-e4d256-prod-github-runner-207 kernel: [63181.457891] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:56:47 juju-e4d256-prod-github-runner-207 kernel: [63181.458657] ? do_syscall_64+0x69/0xc0 Aug 22 22:56:47 juju-e4d256-prod-github-runner-207 kernel: [63181.459379] ? do_syscall_64+0x69/0xc0 Aug 22 22:56:47 juju-e4d256-prod-github-runner-207 kernel: [63181.460076] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 22:56:47 juju-e4d256-prod-github-runner-207 kernel: [63181.460846] RIP: 0033:0x7faa5d0edaff Aug 22 22:56:47 juju-e4d256-prod-github-runner-207 kernel: [63181.461526] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 22:56:47 juju-e4d256-prod-github-runner-207 kernel: [63181.463647] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 22:56:47 juju-e4d256-prod-github-runner-207 kernel: [63181.464610] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 22:56:47 juju-e4d256-prod-github-runner-207 kernel: [63181.465554] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 22:56:47 juju-e4d256-prod-github-runner-207 kernel: [63181.466507] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 22:56:47 juju-e4d256-prod-github-runner-207 kernel: [63181.467446] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 22:56:47 juju-e4d256-prod-github-runner-207 kernel: [63181.468374] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 22:56:47 juju-e4d256-prod-github-runner-207 kernel: [63181.469292] Aug 22 22:57:14 juju-e4d256-prod-github-runner-207 kernel: [63208.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 58759s! [qemu-system-x86:6715] Aug 22 22:57:14 juju-e4d256-prod-github-runner-207 kernel: [63208.543152] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 22:57:14 juju-e4d256-prod-github-runner-207 kernel: [63208.543221] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 22:57:14 juju-e4d256-prod-github-runner-207 kernel: [63208.555402] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 22:57:14 juju-e4d256-prod-github-runner-207 kernel: [63208.556674] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 22:57:14 juju-e4d256-prod-github-runner-207 kernel: [63208.557916] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:57:14 juju-e4d256-prod-github-runner-207 kernel: [63208.558982] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 22:57:14 juju-e4d256-prod-github-runner-207 kernel: [63208.561546] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 22:57:14 juju-e4d256-prod-github-runner-207 kernel: [63208.562588] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 22:57:14 juju-e4d256-prod-github-runner-207 kernel: [63208.563749] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 22:57:14 juju-e4d256-prod-github-runner-207 kernel: [63208.564907] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 22:57:14 juju-e4d256-prod-github-runner-207 kernel: [63208.566095] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 22:57:14 juju-e4d256-prod-github-runner-207 kernel: [63208.567366] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 22:57:14 juju-e4d256-prod-github-runner-207 kernel: [63208.568530] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 22:57:14 juju-e4d256-prod-github-runner-207 kernel: [63208.569784] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 22:57:14 juju-e4d256-prod-github-runner-207 kernel: [63208.570882] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 22:57:14 juju-e4d256-prod-github-runner-207 kernel: [63208.572073] Call Trace: Aug 22 22:57:14 juju-e4d256-prod-github-runner-207 kernel: [63208.572984] Aug 22 22:57:14 juju-e4d256-prod-github-runner-207 kernel: [63208.573913] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:57:14 juju-e4d256-prod-github-runner-207 kernel: [63208.574944] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:57:14 juju-e4d256-prod-github-runner-207 kernel: [63208.575964] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:57:14 juju-e4d256-prod-github-runner-207 kernel: [63208.577052] ? show_regs.part.0+0x23/0x29 Aug 22 22:57:14 juju-e4d256-prod-github-runner-207 kernel: [63208.578062] ? show_regs.cold+0x8/0xd Aug 22 22:57:14 juju-e4d256-prod-github-runner-207 kernel: [63208.579036] ? watchdog_timer_fn+0x1be/0x220 Aug 22 22:57:14 juju-e4d256-prod-github-runner-207 kernel: [63208.580043] ? lockup_detector_update_enable+0x60/0x60 Aug 22 22:57:14 juju-e4d256-prod-github-runner-207 kernel: [63208.581115] ? __hrtimer_run_queues+0x107/0x230 Aug 22 22:57:14 juju-e4d256-prod-github-runner-207 kernel: [63208.582164] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 22:57:14 juju-e4d256-prod-github-runner-207 kernel: [63208.583187] ? hrtimer_interrupt+0x101/0x220 Aug 22 22:57:14 juju-e4d256-prod-github-runner-207 kernel: [63208.584201] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 22:57:14 juju-e4d256-prod-github-runner-207 kernel: [63208.585270] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 22:57:14 juju-e4d256-prod-github-runner-207 kernel: [63208.586415] Aug 22 22:57:14 juju-e4d256-prod-github-runner-207 kernel: [63208.587269] Aug 22 22:57:14 juju-e4d256-prod-github-runner-207 kernel: [63208.588106] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 22:57:14 juju-e4d256-prod-github-runner-207 kernel: [63208.589138] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:57:14 juju-e4d256-prod-github-runner-207 kernel: [63208.590387] ? _raw_spin_lock+0x22/0x30 Aug 22 22:57:14 juju-e4d256-prod-github-runner-207 kernel: [63208.591332] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:57:14 juju-e4d256-prod-github-runner-207 kernel: [63208.592350] direct_page_fault+0x206/0x310 [kvm] Aug 22 22:57:14 juju-e4d256-prod-github-runner-207 kernel: [63208.593373] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 22:57:14 juju-e4d256-prod-github-runner-207 kernel: [63208.594394] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 22:57:14 juju-e4d256-prod-github-runner-207 kernel: [63208.595393] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 22:57:14 juju-e4d256-prod-github-runner-207 kernel: [63208.596360] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 22:57:14 juju-e4d256-prod-github-runner-207 kernel: [63208.597308] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 22:57:14 juju-e4d256-prod-github-runner-207 kernel: [63208.598299] handle_exit+0x98/0x230 [kvm_amd] Aug 22 22:57:14 juju-e4d256-prod-github-runner-207 kernel: [63208.599189] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 22:57:14 juju-e4d256-prod-github-runner-207 kernel: [63208.600103] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 22:57:14 juju-e4d256-prod-github-runner-207 kernel: [63208.601026] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 22:57:14 juju-e4d256-prod-github-runner-207 kernel: [63208.601940] vcpu_run+0x62/0x2c0 [kvm] Aug 22 22:57:14 juju-e4d256-prod-github-runner-207 kernel: [63208.602758] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 22:57:14 juju-e4d256-prod-github-runner-207 kernel: [63208.603567] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 22:57:14 juju-e4d256-prod-github-runner-207 kernel: [63208.604421] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 22:57:14 juju-e4d256-prod-github-runner-207 kernel: [63208.605382] ? __seccomp_filter+0x4a/0x4a0 Aug 22 22:57:14 juju-e4d256-prod-github-runner-207 kernel: [63208.606192] ? __fget_files+0x86/0xc0 Aug 22 22:57:14 juju-e4d256-prod-github-runner-207 kernel: [63208.606901] __x64_sys_ioctl+0x95/0xd0 Aug 22 22:57:14 juju-e4d256-prod-github-runner-207 kernel: [63208.607594] do_syscall_64+0x5c/0xc0 Aug 22 22:57:14 juju-e4d256-prod-github-runner-207 kernel: [63208.608256] ? do_futex+0x162/0x1f0 Aug 22 22:57:14 juju-e4d256-prod-github-runner-207 kernel: [63208.608903] ? __x64_sys_futex+0x78/0x1e0 Aug 22 22:57:14 juju-e4d256-prod-github-runner-207 kernel: [63208.609593] ? __secure_computing+0xa9/0x120 Aug 22 22:57:14 juju-e4d256-prod-github-runner-207 kernel: [63208.610284] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 22:57:14 juju-e4d256-prod-github-runner-207 kernel: [63208.611045] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:57:14 juju-e4d256-prod-github-runner-207 kernel: [63208.611765] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:57:14 juju-e4d256-prod-github-runner-207 kernel: [63208.612485] ? do_syscall_64+0x69/0xc0 Aug 22 22:57:14 juju-e4d256-prod-github-runner-207 kernel: [63208.613133] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:57:14 juju-e4d256-prod-github-runner-207 kernel: [63208.613846] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:57:14 juju-e4d256-prod-github-runner-207 kernel: [63208.614539] ? do_syscall_64+0x69/0xc0 Aug 22 22:57:14 juju-e4d256-prod-github-runner-207 kernel: [63208.615167] ? do_syscall_64+0x69/0xc0 Aug 22 22:57:14 juju-e4d256-prod-github-runner-207 kernel: [63208.615789] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 22:57:14 juju-e4d256-prod-github-runner-207 kernel: [63208.616498] RIP: 0033:0x7faa5d0edaff Aug 22 22:57:14 juju-e4d256-prod-github-runner-207 kernel: [63208.617126] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 22:57:14 juju-e4d256-prod-github-runner-207 kernel: [63208.619128] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 22:57:14 juju-e4d256-prod-github-runner-207 kernel: [63208.620036] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 22:57:14 juju-e4d256-prod-github-runner-207 kernel: [63208.620923] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 22:57:14 juju-e4d256-prod-github-runner-207 kernel: [63208.621846] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 22:57:14 juju-e4d256-prod-github-runner-207 kernel: [63208.622736] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 22:57:14 juju-e4d256-prod-github-runner-207 kernel: [63208.623630] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 22:57:14 juju-e4d256-prod-github-runner-207 kernel: [63208.624525] Aug 22 22:57:42 juju-e4d256-prod-github-runner-207 kernel: [63236.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 58785s! [qemu-system-x86:6715] Aug 22 22:57:42 juju-e4d256-prod-github-runner-207 kernel: [63236.543716] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 22:57:42 juju-e4d256-prod-github-runner-207 kernel: [63236.543975] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 22:57:42 juju-e4d256-prod-github-runner-207 kernel: [63236.556117] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 22:57:42 juju-e4d256-prod-github-runner-207 kernel: [63236.557402] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 22:57:42 juju-e4d256-prod-github-runner-207 kernel: [63236.558640] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:57:42 juju-e4d256-prod-github-runner-207 kernel: [63236.559700] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 22:57:42 juju-e4d256-prod-github-runner-207 kernel: [63236.562340] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 22:57:42 juju-e4d256-prod-github-runner-207 kernel: [63236.563381] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 22:57:42 juju-e4d256-prod-github-runner-207 kernel: [63236.564542] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 22:57:42 juju-e4d256-prod-github-runner-207 kernel: [63236.565736] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 22:57:42 juju-e4d256-prod-github-runner-207 kernel: [63236.566896] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 22:57:42 juju-e4d256-prod-github-runner-207 kernel: [63236.568053] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 22:57:42 juju-e4d256-prod-github-runner-207 kernel: [63236.569237] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 22:57:42 juju-e4d256-prod-github-runner-207 kernel: [63236.570468] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 22:57:42 juju-e4d256-prod-github-runner-207 kernel: [63236.571564] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 22:57:42 juju-e4d256-prod-github-runner-207 kernel: [63236.572760] Call Trace: Aug 22 22:57:42 juju-e4d256-prod-github-runner-207 kernel: [63236.573689] Aug 22 22:57:42 juju-e4d256-prod-github-runner-207 kernel: [63236.574583] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:57:42 juju-e4d256-prod-github-runner-207 kernel: [63236.575618] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:57:42 juju-e4d256-prod-github-runner-207 kernel: [63236.576639] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:57:42 juju-e4d256-prod-github-runner-207 kernel: [63236.577765] ? show_regs.part.0+0x23/0x29 Aug 22 22:57:42 juju-e4d256-prod-github-runner-207 kernel: [63236.578761] ? show_regs.cold+0x8/0xd Aug 22 22:57:42 juju-e4d256-prod-github-runner-207 kernel: [63236.579729] ? watchdog_timer_fn+0x1be/0x220 Aug 22 22:57:42 juju-e4d256-prod-github-runner-207 kernel: [63236.580739] ? lockup_detector_update_enable+0x60/0x60 Aug 22 22:57:42 juju-e4d256-prod-github-runner-207 kernel: [63236.581815] ? __hrtimer_run_queues+0x107/0x230 Aug 22 22:57:42 juju-e4d256-prod-github-runner-207 kernel: [63236.582845] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 22:57:42 juju-e4d256-prod-github-runner-207 kernel: [63236.583865] ? hrtimer_interrupt+0x101/0x220 Aug 22 22:57:42 juju-e4d256-prod-github-runner-207 kernel: [63236.584878] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 22:57:42 juju-e4d256-prod-github-runner-207 kernel: [63236.585962] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 22:57:42 juju-e4d256-prod-github-runner-207 kernel: [63236.587005] Aug 22 22:57:42 juju-e4d256-prod-github-runner-207 kernel: [63236.587855] Aug 22 22:57:42 juju-e4d256-prod-github-runner-207 kernel: [63236.588690] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 22:57:42 juju-e4d256-prod-github-runner-207 kernel: [63236.589739] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:57:42 juju-e4d256-prod-github-runner-207 kernel: [63236.590775] ? _raw_spin_lock+0x22/0x30 Aug 22 22:57:42 juju-e4d256-prod-github-runner-207 kernel: [63236.591717] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:57:42 juju-e4d256-prod-github-runner-207 kernel: [63236.592749] direct_page_fault+0x206/0x310 [kvm] Aug 22 22:57:42 juju-e4d256-prod-github-runner-207 kernel: [63236.593799] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 22:57:42 juju-e4d256-prod-github-runner-207 kernel: [63236.594807] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 22:57:42 juju-e4d256-prod-github-runner-207 kernel: [63236.595806] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 22:57:42 juju-e4d256-prod-github-runner-207 kernel: [63236.596805] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 22:57:42 juju-e4d256-prod-github-runner-207 kernel: [63236.597777] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 22:57:42 juju-e4d256-prod-github-runner-207 kernel: [63236.598756] handle_exit+0x98/0x230 [kvm_amd] Aug 22 22:57:42 juju-e4d256-prod-github-runner-207 kernel: [63236.599648] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 22:57:42 juju-e4d256-prod-github-runner-207 kernel: [63236.600576] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 22:57:42 juju-e4d256-prod-github-runner-207 kernel: [63236.601524] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 22:57:42 juju-e4d256-prod-github-runner-207 kernel: [63236.602435] vcpu_run+0x62/0x2c0 [kvm] Aug 22 22:57:42 juju-e4d256-prod-github-runner-207 kernel: [63236.603247] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 22:57:42 juju-e4d256-prod-github-runner-207 kernel: [63236.604059] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 22:57:42 juju-e4d256-prod-github-runner-207 kernel: [63236.604912] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 22:57:42 juju-e4d256-prod-github-runner-207 kernel: [63236.605720] ? __seccomp_filter+0x4a/0x4a0 Aug 22 22:57:42 juju-e4d256-prod-github-runner-207 kernel: [63236.606464] ? __fget_files+0x86/0xc0 Aug 22 22:57:42 juju-e4d256-prod-github-runner-207 kernel: [63236.607166] __x64_sys_ioctl+0x95/0xd0 Aug 22 22:57:42 juju-e4d256-prod-github-runner-207 kernel: [63236.607857] do_syscall_64+0x5c/0xc0 Aug 22 22:57:42 juju-e4d256-prod-github-runner-207 kernel: [63236.608519] ? do_futex+0x162/0x1f0 Aug 22 22:57:42 juju-e4d256-prod-github-runner-207 kernel: [63236.609178] ? __x64_sys_futex+0x78/0x1e0 Aug 22 22:57:42 juju-e4d256-prod-github-runner-207 kernel: [63236.609854] ? __secure_computing+0xa9/0x120 Aug 22 22:57:42 juju-e4d256-prod-github-runner-207 kernel: [63236.610540] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 22:57:42 juju-e4d256-prod-github-runner-207 kernel: [63236.611298] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:57:42 juju-e4d256-prod-github-runner-207 kernel: [63236.612020] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:57:42 juju-e4d256-prod-github-runner-207 kernel: [63236.612744] ? do_syscall_64+0x69/0xc0 Aug 22 22:57:42 juju-e4d256-prod-github-runner-207 kernel: [63236.613402] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:57:42 juju-e4d256-prod-github-runner-207 kernel: [63236.614108] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:57:42 juju-e4d256-prod-github-runner-207 kernel: [63236.614800] ? do_syscall_64+0x69/0xc0 Aug 22 22:57:42 juju-e4d256-prod-github-runner-207 kernel: [63236.615422] ? do_syscall_64+0x69/0xc0 Aug 22 22:57:42 juju-e4d256-prod-github-runner-207 kernel: [63236.616046] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 22:57:42 juju-e4d256-prod-github-runner-207 kernel: [63236.616749] RIP: 0033:0x7faa5d0edaff Aug 22 22:57:42 juju-e4d256-prod-github-runner-207 kernel: [63236.617410] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 22:57:42 juju-e4d256-prod-github-runner-207 kernel: [63236.619397] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 22:57:42 juju-e4d256-prod-github-runner-207 kernel: [63236.620305] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 22:57:42 juju-e4d256-prod-github-runner-207 kernel: [63236.621211] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 22:57:42 juju-e4d256-prod-github-runner-207 kernel: [63236.622100] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 22:57:42 juju-e4d256-prod-github-runner-207 kernel: [63236.622995] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 22:57:42 juju-e4d256-prod-github-runner-207 kernel: [63236.623887] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 22:57:42 juju-e4d256-prod-github-runner-207 kernel: [63236.624778] Aug 22 22:58:10 juju-e4d256-prod-github-runner-207 kernel: [63264.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 58811s! [qemu-system-x86:6715] Aug 22 22:58:10 juju-e4d256-prod-github-runner-207 kernel: [63264.543139] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 22:58:10 juju-e4d256-prod-github-runner-207 kernel: [63264.543210] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 22:58:10 juju-e4d256-prod-github-runner-207 kernel: [63264.555474] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 22:58:10 juju-e4d256-prod-github-runner-207 kernel: [63264.556742] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 22:58:10 juju-e4d256-prod-github-runner-207 kernel: [63264.557976] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:58:10 juju-e4d256-prod-github-runner-207 kernel: [63264.559037] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 22:58:10 juju-e4d256-prod-github-runner-207 kernel: [63264.561606] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 22:58:10 juju-e4d256-prod-github-runner-207 kernel: [63264.562662] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 22:58:10 juju-e4d256-prod-github-runner-207 kernel: [63264.563827] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 22:58:10 juju-e4d256-prod-github-runner-207 kernel: [63264.565012] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 22:58:10 juju-e4d256-prod-github-runner-207 kernel: [63264.566180] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 22:58:10 juju-e4d256-prod-github-runner-207 kernel: [63264.567343] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 22:58:10 juju-e4d256-prod-github-runner-207 kernel: [63264.568519] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 22:58:10 juju-e4d256-prod-github-runner-207 kernel: [63264.569773] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 22:58:10 juju-e4d256-prod-github-runner-207 kernel: [63264.570873] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 22:58:10 juju-e4d256-prod-github-runner-207 kernel: [63264.572075] Call Trace: Aug 22 22:58:10 juju-e4d256-prod-github-runner-207 kernel: [63264.572993] Aug 22 22:58:10 juju-e4d256-prod-github-runner-207 kernel: [63264.573882] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:58:10 juju-e4d256-prod-github-runner-207 kernel: [63264.574914] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:58:10 juju-e4d256-prod-github-runner-207 kernel: [63264.575964] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:58:10 juju-e4d256-prod-github-runner-207 kernel: [63264.577054] ? show_regs.part.0+0x23/0x29 Aug 22 22:58:10 juju-e4d256-prod-github-runner-207 kernel: [63264.578055] ? show_regs.cold+0x8/0xd Aug 22 22:58:10 juju-e4d256-prod-github-runner-207 kernel: [63264.579030] ? watchdog_timer_fn+0x1be/0x220 Aug 22 22:58:10 juju-e4d256-prod-github-runner-207 kernel: [63264.580078] ? lockup_detector_update_enable+0x60/0x60 Aug 22 22:58:10 juju-e4d256-prod-github-runner-207 kernel: [63264.581158] ? __hrtimer_run_queues+0x107/0x230 Aug 22 22:58:10 juju-e4d256-prod-github-runner-207 kernel: [63264.582188] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 22:58:10 juju-e4d256-prod-github-runner-207 kernel: [63264.583311] ? hrtimer_interrupt+0x101/0x220 Aug 22 22:58:10 juju-e4d256-prod-github-runner-207 kernel: [63264.584327] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 22:58:10 juju-e4d256-prod-github-runner-207 kernel: [63264.585411] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 22:58:10 juju-e4d256-prod-github-runner-207 kernel: [63264.586457] Aug 22 22:58:10 juju-e4d256-prod-github-runner-207 kernel: [63264.587310] Aug 22 22:58:10 juju-e4d256-prod-github-runner-207 kernel: [63264.588164] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 22:58:10 juju-e4d256-prod-github-runner-207 kernel: [63264.589250] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:58:10 juju-e4d256-prod-github-runner-207 kernel: [63264.590291] ? _raw_spin_lock+0x22/0x30 Aug 22 22:58:10 juju-e4d256-prod-github-runner-207 kernel: [63264.591236] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:58:10 juju-e4d256-prod-github-runner-207 kernel: [63264.592307] direct_page_fault+0x206/0x310 [kvm] Aug 22 22:58:10 juju-e4d256-prod-github-runner-207 kernel: [63264.593387] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 22:58:10 juju-e4d256-prod-github-runner-207 kernel: [63264.594420] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 22:58:10 juju-e4d256-prod-github-runner-207 kernel: [63264.595501] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 22:58:10 juju-e4d256-prod-github-runner-207 kernel: [63264.596474] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 22:58:10 juju-e4d256-prod-github-runner-207 kernel: [63264.597434] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 22:58:10 juju-e4d256-prod-github-runner-207 kernel: [63264.598414] handle_exit+0x98/0x230 [kvm_amd] Aug 22 22:58:10 juju-e4d256-prod-github-runner-207 kernel: [63264.599306] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 22:58:10 juju-e4d256-prod-github-runner-207 kernel: [63264.600264] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 22:58:10 juju-e4d256-prod-github-runner-207 kernel: [63264.601209] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 22:58:10 juju-e4d256-prod-github-runner-207 kernel: [63264.602116] vcpu_run+0x62/0x2c0 [kvm] Aug 22 22:58:10 juju-e4d256-prod-github-runner-207 kernel: [63264.602929] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 22:58:10 juju-e4d256-prod-github-runner-207 kernel: [63264.603754] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 22:58:10 juju-e4d256-prod-github-runner-207 kernel: [63264.604695] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 22:58:10 juju-e4d256-prod-github-runner-207 kernel: [63264.605573] ? __seccomp_filter+0x4a/0x4a0 Aug 22 22:58:10 juju-e4d256-prod-github-runner-207 kernel: [63264.606322] ? __fget_files+0x86/0xc0 Aug 22 22:58:10 juju-e4d256-prod-github-runner-207 kernel: [63264.607027] __x64_sys_ioctl+0x95/0xd0 Aug 22 22:58:10 juju-e4d256-prod-github-runner-207 kernel: [63264.607720] do_syscall_64+0x5c/0xc0 Aug 22 22:58:10 juju-e4d256-prod-github-runner-207 kernel: [63264.608388] ? do_futex+0x162/0x1f0 Aug 22 22:58:10 juju-e4d256-prod-github-runner-207 kernel: [63264.609050] ? __x64_sys_futex+0x78/0x1e0 Aug 22 22:58:10 juju-e4d256-prod-github-runner-207 kernel: [63264.609741] ? __secure_computing+0xa9/0x120 Aug 22 22:58:10 juju-e4d256-prod-github-runner-207 kernel: [63264.610432] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 22:58:10 juju-e4d256-prod-github-runner-207 kernel: [63264.611197] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:58:10 juju-e4d256-prod-github-runner-207 kernel: [63264.611921] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:58:10 juju-e4d256-prod-github-runner-207 kernel: [63264.612638] ? do_syscall_64+0x69/0xc0 Aug 22 22:58:10 juju-e4d256-prod-github-runner-207 kernel: [63264.613297] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:58:10 juju-e4d256-prod-github-runner-207 kernel: [63264.613998] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:58:10 juju-e4d256-prod-github-runner-207 kernel: [63264.614692] ? do_syscall_64+0x69/0xc0 Aug 22 22:58:10 juju-e4d256-prod-github-runner-207 kernel: [63264.615314] ? do_syscall_64+0x69/0xc0 Aug 22 22:58:10 juju-e4d256-prod-github-runner-207 kernel: [63264.615936] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 22:58:10 juju-e4d256-prod-github-runner-207 kernel: [63264.616647] RIP: 0033:0x7faa5d0edaff Aug 22 22:58:10 juju-e4d256-prod-github-runner-207 kernel: [63264.617280] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 22:58:10 juju-e4d256-prod-github-runner-207 kernel: [63264.619269] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 22:58:10 juju-e4d256-prod-github-runner-207 kernel: [63264.620183] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 22:58:10 juju-e4d256-prod-github-runner-207 kernel: [63264.621088] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 22:58:10 juju-e4d256-prod-github-runner-207 kernel: [63264.621980] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 22:58:10 juju-e4d256-prod-github-runner-207 kernel: [63264.622869] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 22:58:10 juju-e4d256-prod-github-runner-207 kernel: [63264.623759] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 22:58:10 juju-e4d256-prod-github-runner-207 kernel: [63264.624648] Aug 22 22:58:38 juju-e4d256-prod-github-runner-207 kernel: [63292.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 58837s! [qemu-system-x86:6715] Aug 22 22:58:38 juju-e4d256-prod-github-runner-207 kernel: [63292.543130] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 22:58:38 juju-e4d256-prod-github-runner-207 kernel: [63292.543202] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 22:58:38 juju-e4d256-prod-github-runner-207 kernel: [63292.555322] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 22:58:38 juju-e4d256-prod-github-runner-207 kernel: [63292.556605] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 22:58:38 juju-e4d256-prod-github-runner-207 kernel: [63292.557832] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:58:38 juju-e4d256-prod-github-runner-207 kernel: [63292.558889] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 22:58:38 juju-e4d256-prod-github-runner-207 kernel: [63292.561465] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 22:58:38 juju-e4d256-prod-github-runner-207 kernel: [63292.562510] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 22:58:38 juju-e4d256-prod-github-runner-207 kernel: [63292.563679] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 22:58:38 juju-e4d256-prod-github-runner-207 kernel: [63292.564851] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 22:58:38 juju-e4d256-prod-github-runner-207 kernel: [63292.566013] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 22:58:38 juju-e4d256-prod-github-runner-207 kernel: [63292.567185] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 22:58:38 juju-e4d256-prod-github-runner-207 kernel: [63292.568355] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 22:58:38 juju-e4d256-prod-github-runner-207 kernel: [63292.569611] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 22:58:38 juju-e4d256-prod-github-runner-207 kernel: [63292.570719] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 22:58:38 juju-e4d256-prod-github-runner-207 kernel: [63292.571918] Call Trace: Aug 22 22:58:38 juju-e4d256-prod-github-runner-207 kernel: [63292.572846] Aug 22 22:58:38 juju-e4d256-prod-github-runner-207 kernel: [63292.573731] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:58:38 juju-e4d256-prod-github-runner-207 kernel: [63292.574762] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:58:38 juju-e4d256-prod-github-runner-207 kernel: [63292.575801] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:58:38 juju-e4d256-prod-github-runner-207 kernel: [63292.576899] ? show_regs.part.0+0x23/0x29 Aug 22 22:58:38 juju-e4d256-prod-github-runner-207 kernel: [63292.577902] ? show_regs.cold+0x8/0xd Aug 22 22:58:38 juju-e4d256-prod-github-runner-207 kernel: [63292.578874] ? watchdog_timer_fn+0x1be/0x220 Aug 22 22:58:38 juju-e4d256-prod-github-runner-207 kernel: [63292.579887] ? lockup_detector_update_enable+0x60/0x60 Aug 22 22:58:38 juju-e4d256-prod-github-runner-207 kernel: [63292.580960] ? __hrtimer_run_queues+0x107/0x230 Aug 22 22:58:38 juju-e4d256-prod-github-runner-207 kernel: [63292.581990] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 22:58:38 juju-e4d256-prod-github-runner-207 kernel: [63292.583024] ? hrtimer_interrupt+0x101/0x220 Aug 22 22:58:38 juju-e4d256-prod-github-runner-207 kernel: [63292.584040] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 22:58:38 juju-e4d256-prod-github-runner-207 kernel: [63292.585114] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 22:58:38 juju-e4d256-prod-github-runner-207 kernel: [63292.586161] Aug 22 22:58:38 juju-e4d256-prod-github-runner-207 kernel: [63292.587014] Aug 22 22:58:38 juju-e4d256-prod-github-runner-207 kernel: [63292.587850] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 22:58:38 juju-e4d256-prod-github-runner-207 kernel: [63292.588892] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:58:38 juju-e4d256-prod-github-runner-207 kernel: [63292.589939] ? _raw_spin_lock+0x22/0x30 Aug 22 22:58:38 juju-e4d256-prod-github-runner-207 kernel: [63292.590890] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:58:38 juju-e4d256-prod-github-runner-207 kernel: [63292.591913] direct_page_fault+0x206/0x310 [kvm] Aug 22 22:58:38 juju-e4d256-prod-github-runner-207 kernel: [63292.592952] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 22:58:38 juju-e4d256-prod-github-runner-207 kernel: [63292.593961] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 22:58:38 juju-e4d256-prod-github-runner-207 kernel: [63292.594973] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 22:58:38 juju-e4d256-prod-github-runner-207 kernel: [63292.595947] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 22:58:38 juju-e4d256-prod-github-runner-207 kernel: [63292.596909] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 22:58:38 juju-e4d256-prod-github-runner-207 kernel: [63292.597887] handle_exit+0x98/0x230 [kvm_amd] Aug 22 22:58:38 juju-e4d256-prod-github-runner-207 kernel: [63292.598786] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 22:58:38 juju-e4d256-prod-github-runner-207 kernel: [63292.599701] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 22:58:38 juju-e4d256-prod-github-runner-207 kernel: [63292.600639] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 22:58:38 juju-e4d256-prod-github-runner-207 kernel: [63292.601550] vcpu_run+0x62/0x2c0 [kvm] Aug 22 22:58:38 juju-e4d256-prod-github-runner-207 kernel: [63292.602364] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 22:58:38 juju-e4d256-prod-github-runner-207 kernel: [63292.603173] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 22:58:38 juju-e4d256-prod-github-runner-207 kernel: [63292.604028] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 22:58:38 juju-e4d256-prod-github-runner-207 kernel: [63292.604848] ? __seccomp_filter+0x4a/0x4a0 Aug 22 22:58:38 juju-e4d256-prod-github-runner-207 kernel: [63292.605617] ? __fget_files+0x86/0xc0 Aug 22 22:58:38 juju-e4d256-prod-github-runner-207 kernel: [63292.606329] __x64_sys_ioctl+0x95/0xd0 Aug 22 22:58:38 juju-e4d256-prod-github-runner-207 kernel: [63292.607025] do_syscall_64+0x5c/0xc0 Aug 22 22:58:38 juju-e4d256-prod-github-runner-207 kernel: [63292.607698] ? do_futex+0x162/0x1f0 Aug 22 22:58:38 juju-e4d256-prod-github-runner-207 kernel: [63292.608348] ? __x64_sys_futex+0x78/0x1e0 Aug 22 22:58:38 juju-e4d256-prod-github-runner-207 kernel: [63292.609046] ? __secure_computing+0xa9/0x120 Aug 22 22:58:38 juju-e4d256-prod-github-runner-207 kernel: [63292.609738] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 22:58:38 juju-e4d256-prod-github-runner-207 kernel: [63292.610507] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:58:38 juju-e4d256-prod-github-runner-207 kernel: [63292.611231] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:58:38 juju-e4d256-prod-github-runner-207 kernel: [63292.611949] ? do_syscall_64+0x69/0xc0 Aug 22 22:58:38 juju-e4d256-prod-github-runner-207 kernel: [63292.612606] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:58:38 juju-e4d256-prod-github-runner-207 kernel: [63292.613311] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:58:38 juju-e4d256-prod-github-runner-207 kernel: [63292.614007] ? do_syscall_64+0x69/0xc0 Aug 22 22:58:38 juju-e4d256-prod-github-runner-207 kernel: [63292.614633] ? do_syscall_64+0x69/0xc0 Aug 22 22:58:38 juju-e4d256-prod-github-runner-207 kernel: [63292.615278] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 22:58:38 juju-e4d256-prod-github-runner-207 kernel: [63292.615990] RIP: 0033:0x7faa5d0edaff Aug 22 22:58:38 juju-e4d256-prod-github-runner-207 kernel: [63292.616627] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 22:58:38 juju-e4d256-prod-github-runner-207 kernel: [63292.618627] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 22:58:38 juju-e4d256-prod-github-runner-207 kernel: [63292.619540] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 22:58:38 juju-e4d256-prod-github-runner-207 kernel: [63292.620434] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 22:58:38 juju-e4d256-prod-github-runner-207 kernel: [63292.621343] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 22:58:38 juju-e4d256-prod-github-runner-207 kernel: [63292.622237] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 22:58:38 juju-e4d256-prod-github-runner-207 kernel: [63292.623132] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 22:58:38 juju-e4d256-prod-github-runner-207 kernel: [63292.624033] Aug 22 22:59:06 juju-e4d256-prod-github-runner-207 kernel: [63320.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 58863s! [qemu-system-x86:6715] Aug 22 22:59:06 juju-e4d256-prod-github-runner-207 kernel: [63320.543761] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 22:59:06 juju-e4d256-prod-github-runner-207 kernel: [63320.544018] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 22:59:06 juju-e4d256-prod-github-runner-207 kernel: [63320.556272] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 22:59:06 juju-e4d256-prod-github-runner-207 kernel: [63320.557542] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 22:59:06 juju-e4d256-prod-github-runner-207 kernel: [63320.558775] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:59:06 juju-e4d256-prod-github-runner-207 kernel: [63320.559838] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 22:59:06 juju-e4d256-prod-github-runner-207 kernel: [63320.562396] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 22:59:06 juju-e4d256-prod-github-runner-207 kernel: [63320.563437] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 22:59:06 juju-e4d256-prod-github-runner-207 kernel: [63320.564608] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 22:59:06 juju-e4d256-prod-github-runner-207 kernel: [63320.565770] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 22:59:06 juju-e4d256-prod-github-runner-207 kernel: [63320.566925] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 22:59:06 juju-e4d256-prod-github-runner-207 kernel: [63320.568093] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 22:59:06 juju-e4d256-prod-github-runner-207 kernel: [63320.569278] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 22:59:06 juju-e4d256-prod-github-runner-207 kernel: [63320.570513] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 22:59:06 juju-e4d256-prod-github-runner-207 kernel: [63320.571607] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 22:59:06 juju-e4d256-prod-github-runner-207 kernel: [63320.572814] Call Trace: Aug 22 22:59:06 juju-e4d256-prod-github-runner-207 kernel: [63320.573755] Aug 22 22:59:06 juju-e4d256-prod-github-runner-207 kernel: [63320.574661] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:59:06 juju-e4d256-prod-github-runner-207 kernel: [63320.575697] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:59:06 juju-e4d256-prod-github-runner-207 kernel: [63320.576729] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:59:06 juju-e4d256-prod-github-runner-207 kernel: [63320.577845] ? show_regs.part.0+0x23/0x29 Aug 22 22:59:06 juju-e4d256-prod-github-runner-207 kernel: [63320.578842] ? show_regs.cold+0x8/0xd Aug 22 22:59:06 juju-e4d256-prod-github-runner-207 kernel: [63320.579816] ? watchdog_timer_fn+0x1be/0x220 Aug 22 22:59:06 juju-e4d256-prod-github-runner-207 kernel: [63320.580841] ? lockup_detector_update_enable+0x60/0x60 Aug 22 22:59:06 juju-e4d256-prod-github-runner-207 kernel: [63320.581905] ? __hrtimer_run_queues+0x107/0x230 Aug 22 22:59:06 juju-e4d256-prod-github-runner-207 kernel: [63320.582934] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 22:59:06 juju-e4d256-prod-github-runner-207 kernel: [63320.583957] ? hrtimer_interrupt+0x101/0x220 Aug 22 22:59:06 juju-e4d256-prod-github-runner-207 kernel: [63320.584987] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 22:59:06 juju-e4d256-prod-github-runner-207 kernel: [63320.586056] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 22:59:06 juju-e4d256-prod-github-runner-207 kernel: [63320.587101] Aug 22 22:59:06 juju-e4d256-prod-github-runner-207 kernel: [63320.587976] Aug 22 22:59:06 juju-e4d256-prod-github-runner-207 kernel: [63320.588821] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 22:59:06 juju-e4d256-prod-github-runner-207 kernel: [63320.589874] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:59:06 juju-e4d256-prod-github-runner-207 kernel: [63320.590913] ? _raw_spin_lock+0x22/0x30 Aug 22 22:59:06 juju-e4d256-prod-github-runner-207 kernel: [63320.591858] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:59:06 juju-e4d256-prod-github-runner-207 kernel: [63320.592893] direct_page_fault+0x206/0x310 [kvm] Aug 22 22:59:06 juju-e4d256-prod-github-runner-207 kernel: [63320.593915] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 22:59:06 juju-e4d256-prod-github-runner-207 kernel: [63320.594924] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 22:59:06 juju-e4d256-prod-github-runner-207 kernel: [63320.595924] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 22:59:06 juju-e4d256-prod-github-runner-207 kernel: [63320.596936] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 22:59:06 juju-e4d256-prod-github-runner-207 kernel: [63320.597882] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 22:59:06 juju-e4d256-prod-github-runner-207 kernel: [63320.598857] handle_exit+0x98/0x230 [kvm_amd] Aug 22 22:59:06 juju-e4d256-prod-github-runner-207 kernel: [63320.599753] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 22:59:06 juju-e4d256-prod-github-runner-207 kernel: [63320.600685] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 22:59:06 juju-e4d256-prod-github-runner-207 kernel: [63320.601610] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 22:59:06 juju-e4d256-prod-github-runner-207 kernel: [63320.602516] vcpu_run+0x62/0x2c0 [kvm] Aug 22 22:59:06 juju-e4d256-prod-github-runner-207 kernel: [63320.603329] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 22:59:06 juju-e4d256-prod-github-runner-207 kernel: [63320.604162] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 22:59:06 juju-e4d256-prod-github-runner-207 kernel: [63320.605028] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 22:59:06 juju-e4d256-prod-github-runner-207 kernel: [63320.605836] ? __seccomp_filter+0x4a/0x4a0 Aug 22 22:59:06 juju-e4d256-prod-github-runner-207 kernel: [63320.606584] ? __fget_files+0x86/0xc0 Aug 22 22:59:06 juju-e4d256-prod-github-runner-207 kernel: [63320.607288] __x64_sys_ioctl+0x95/0xd0 Aug 22 22:59:06 juju-e4d256-prod-github-runner-207 kernel: [63320.607979] do_syscall_64+0x5c/0xc0 Aug 22 22:59:06 juju-e4d256-prod-github-runner-207 kernel: [63320.608657] ? do_futex+0x162/0x1f0 Aug 22 22:59:06 juju-e4d256-prod-github-runner-207 kernel: [63320.609307] ? __x64_sys_futex+0x78/0x1e0 Aug 22 22:59:06 juju-e4d256-prod-github-runner-207 kernel: [63320.609981] ? __secure_computing+0xa9/0x120 Aug 22 22:59:06 juju-e4d256-prod-github-runner-207 kernel: [63320.610684] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 22:59:06 juju-e4d256-prod-github-runner-207 kernel: [63320.611448] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:59:06 juju-e4d256-prod-github-runner-207 kernel: [63320.612177] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:59:06 juju-e4d256-prod-github-runner-207 kernel: [63320.612895] ? do_syscall_64+0x69/0xc0 Aug 22 22:59:06 juju-e4d256-prod-github-runner-207 kernel: [63320.613539] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:59:06 juju-e4d256-prod-github-runner-207 kernel: [63320.614241] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:59:06 juju-e4d256-prod-github-runner-207 kernel: [63320.614935] ? do_syscall_64+0x69/0xc0 Aug 22 22:59:06 juju-e4d256-prod-github-runner-207 kernel: [63320.615560] ? do_syscall_64+0x69/0xc0 Aug 22 22:59:06 juju-e4d256-prod-github-runner-207 kernel: [63320.616190] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 22:59:06 juju-e4d256-prod-github-runner-207 kernel: [63320.616896] RIP: 0033:0x7faa5d0edaff Aug 22 22:59:06 juju-e4d256-prod-github-runner-207 kernel: [63320.617545] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 22:59:06 juju-e4d256-prod-github-runner-207 kernel: [63320.619528] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 22:59:06 juju-e4d256-prod-github-runner-207 kernel: [63320.620588] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 22:59:06 juju-e4d256-prod-github-runner-207 kernel: [63320.621508] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 22:59:06 juju-e4d256-prod-github-runner-207 kernel: [63320.622400] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 22:59:06 juju-e4d256-prod-github-runner-207 kernel: [63320.623290] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 22:59:06 juju-e4d256-prod-github-runner-207 kernel: [63320.624198] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 22:59:06 juju-e4d256-prod-github-runner-207 kernel: [63320.625099] Aug 22 22:59:34 juju-e4d256-prod-github-runner-207 kernel: [63348.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 58889s! [qemu-system-x86:6715] Aug 22 22:59:34 juju-e4d256-prod-github-runner-207 kernel: [63348.543091] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 22:59:34 juju-e4d256-prod-github-runner-207 kernel: [63348.543164] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 22:59:34 juju-e4d256-prod-github-runner-207 kernel: [63348.555290] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 22:59:34 juju-e4d256-prod-github-runner-207 kernel: [63348.556572] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 22:59:34 juju-e4d256-prod-github-runner-207 kernel: [63348.557793] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:59:34 juju-e4d256-prod-github-runner-207 kernel: [63348.558856] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 22:59:34 juju-e4d256-prod-github-runner-207 kernel: [63348.561435] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 22:59:34 juju-e4d256-prod-github-runner-207 kernel: [63348.562480] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 22:59:34 juju-e4d256-prod-github-runner-207 kernel: [63348.563642] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 22:59:34 juju-e4d256-prod-github-runner-207 kernel: [63348.564818] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 22:59:34 juju-e4d256-prod-github-runner-207 kernel: [63348.565988] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 22:59:34 juju-e4d256-prod-github-runner-207 kernel: [63348.567154] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 22:59:34 juju-e4d256-prod-github-runner-207 kernel: [63348.568347] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 22:59:34 juju-e4d256-prod-github-runner-207 kernel: [63348.569584] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 22:59:34 juju-e4d256-prod-github-runner-207 kernel: [63348.570687] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 22:59:34 juju-e4d256-prod-github-runner-207 kernel: [63348.571923] Call Trace: Aug 22 22:59:34 juju-e4d256-prod-github-runner-207 kernel: [63348.572837] Aug 22 22:59:34 juju-e4d256-prod-github-runner-207 kernel: [63348.573719] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:59:34 juju-e4d256-prod-github-runner-207 kernel: [63348.574748] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 22:59:34 juju-e4d256-prod-github-runner-207 kernel: [63348.575783] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:59:34 juju-e4d256-prod-github-runner-207 kernel: [63348.576866] ? show_regs.part.0+0x23/0x29 Aug 22 22:59:34 juju-e4d256-prod-github-runner-207 kernel: [63348.577866] ? show_regs.cold+0x8/0xd Aug 22 22:59:34 juju-e4d256-prod-github-runner-207 kernel: [63348.578838] ? watchdog_timer_fn+0x1be/0x220 Aug 22 22:59:34 juju-e4d256-prod-github-runner-207 kernel: [63348.579867] ? lockup_detector_update_enable+0x60/0x60 Aug 22 22:59:34 juju-e4d256-prod-github-runner-207 kernel: [63348.580934] ? __hrtimer_run_queues+0x107/0x230 Aug 22 22:59:34 juju-e4d256-prod-github-runner-207 kernel: [63348.581987] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 22:59:34 juju-e4d256-prod-github-runner-207 kernel: [63348.583017] ? hrtimer_interrupt+0x101/0x220 Aug 22 22:59:34 juju-e4d256-prod-github-runner-207 kernel: [63348.584056] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 22:59:34 juju-e4d256-prod-github-runner-207 kernel: [63348.585124] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 22:59:34 juju-e4d256-prod-github-runner-207 kernel: [63348.586168] Aug 22 22:59:34 juju-e4d256-prod-github-runner-207 kernel: [63348.587019] Aug 22 22:59:34 juju-e4d256-prod-github-runner-207 kernel: [63348.587868] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 22:59:34 juju-e4d256-prod-github-runner-207 kernel: [63348.588905] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:59:34 juju-e4d256-prod-github-runner-207 kernel: [63348.589947] ? _raw_spin_lock+0x22/0x30 Aug 22 22:59:34 juju-e4d256-prod-github-runner-207 kernel: [63348.590897] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:59:34 juju-e4d256-prod-github-runner-207 kernel: [63348.591949] direct_page_fault+0x206/0x310 [kvm] Aug 22 22:59:34 juju-e4d256-prod-github-runner-207 kernel: [63348.592996] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 22:59:34 juju-e4d256-prod-github-runner-207 kernel: [63348.594010] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 22:59:34 juju-e4d256-prod-github-runner-207 kernel: [63348.595009] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 22:59:34 juju-e4d256-prod-github-runner-207 kernel: [63348.595999] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 22:59:34 juju-e4d256-prod-github-runner-207 kernel: [63348.596951] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 22:59:34 juju-e4d256-prod-github-runner-207 kernel: [63348.597932] handle_exit+0x98/0x230 [kvm_amd] Aug 22 22:59:34 juju-e4d256-prod-github-runner-207 kernel: [63348.598828] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 22:59:34 juju-e4d256-prod-github-runner-207 kernel: [63348.599740] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 22:59:34 juju-e4d256-prod-github-runner-207 kernel: [63348.600678] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 22:59:34 juju-e4d256-prod-github-runner-207 kernel: [63348.601585] vcpu_run+0x62/0x2c0 [kvm] Aug 22 22:59:34 juju-e4d256-prod-github-runner-207 kernel: [63348.602420] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 22:59:34 juju-e4d256-prod-github-runner-207 kernel: [63348.603230] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 22:59:34 juju-e4d256-prod-github-runner-207 kernel: [63348.604134] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 22:59:34 juju-e4d256-prod-github-runner-207 kernel: [63348.604942] ? __seccomp_filter+0x4a/0x4a0 Aug 22 22:59:34 juju-e4d256-prod-github-runner-207 kernel: [63348.605685] ? __fget_files+0x86/0xc0 Aug 22 22:59:34 juju-e4d256-prod-github-runner-207 kernel: [63348.606388] __x64_sys_ioctl+0x95/0xd0 Aug 22 22:59:34 juju-e4d256-prod-github-runner-207 kernel: [63348.607082] do_syscall_64+0x5c/0xc0 Aug 22 22:59:34 juju-e4d256-prod-github-runner-207 kernel: [63348.607745] ? do_futex+0x162/0x1f0 Aug 22 22:59:34 juju-e4d256-prod-github-runner-207 kernel: [63348.608408] ? __x64_sys_futex+0x78/0x1e0 Aug 22 22:59:34 juju-e4d256-prod-github-runner-207 kernel: [63348.609108] ? __secure_computing+0xa9/0x120 Aug 22 22:59:34 juju-e4d256-prod-github-runner-207 kernel: [63348.609859] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 22:59:34 juju-e4d256-prod-github-runner-207 kernel: [63348.610622] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:59:34 juju-e4d256-prod-github-runner-207 kernel: [63348.611348] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:59:34 juju-e4d256-prod-github-runner-207 kernel: [63348.612090] ? do_syscall_64+0x69/0xc0 Aug 22 22:59:34 juju-e4d256-prod-github-runner-207 kernel: [63348.612793] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:59:34 juju-e4d256-prod-github-runner-207 kernel: [63348.613515] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:59:34 juju-e4d256-prod-github-runner-207 kernel: [63348.614216] ? do_syscall_64+0x69/0xc0 Aug 22 22:59:34 juju-e4d256-prod-github-runner-207 kernel: [63348.614844] ? do_syscall_64+0x69/0xc0 Aug 22 22:59:34 juju-e4d256-prod-github-runner-207 kernel: [63348.615465] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 22:59:34 juju-e4d256-prod-github-runner-207 kernel: [63348.616219] RIP: 0033:0x7faa5d0edaff Aug 22 22:59:34 juju-e4d256-prod-github-runner-207 kernel: [63348.616901] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 22:59:34 juju-e4d256-prod-github-runner-207 kernel: [63348.618958] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 22:59:34 juju-e4d256-prod-github-runner-207 kernel: [63348.619914] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 22:59:34 juju-e4d256-prod-github-runner-207 kernel: [63348.621140] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 22:59:34 juju-e4d256-prod-github-runner-207 kernel: [63348.622431] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 22:59:34 juju-e4d256-prod-github-runner-207 kernel: [63348.623711] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 22:59:34 juju-e4d256-prod-github-runner-207 kernel: [63348.625010] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 22:59:34 juju-e4d256-prod-github-runner-207 kernel: [63348.626026] Aug 22 22:59:47 juju-e4d256-prod-github-runner-207 kernel: [63361.412706] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 22:59:47 juju-e4d256-prod-github-runner-207 kernel: [63361.413676] rcu: 1-....: (15761218 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=7610470 Aug 22 22:59:47 juju-e4d256-prod-github-runner-207 kernel: [63361.414809] (t=15811053 jiffies g=23269 q=56054) Aug 22 22:59:47 juju-e4d256-prod-github-runner-207 kernel: [63361.415594] NMI backtrace for cpu 1 Aug 22 22:59:47 juju-e4d256-prod-github-runner-207 kernel: [63361.416341] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 22:59:47 juju-e4d256-prod-github-runner-207 kernel: [63361.417545] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 22:59:47 juju-e4d256-prod-github-runner-207 kernel: [63361.418608] Call Trace: Aug 22 22:59:47 juju-e4d256-prod-github-runner-207 kernel: [63361.419282] Aug 22 22:59:47 juju-e4d256-prod-github-runner-207 kernel: [63361.419940] show_stack+0x52/0x5c Aug 22 22:59:47 juju-e4d256-prod-github-runner-207 kernel: [63361.420663] dump_stack_lvl+0x4a/0x63 Aug 22 22:59:47 juju-e4d256-prod-github-runner-207 kernel: [63361.421412] dump_stack+0x10/0x16 Aug 22 22:59:47 juju-e4d256-prod-github-runner-207 kernel: [63361.422127] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 22:59:47 juju-e4d256-prod-github-runner-207 kernel: [63361.422905] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 22:59:47 juju-e4d256-prod-github-runner-207 kernel: [63361.423709] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 22:59:47 juju-e4d256-prod-github-runner-207 kernel: [63361.424534] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 22:59:47 juju-e4d256-prod-github-runner-207 kernel: [63361.425355] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 22:59:47 juju-e4d256-prod-github-runner-207 kernel: [63361.426161] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 22:59:47 juju-e4d256-prod-github-runner-207 kernel: [63361.426930] print_cpu_stall.cold+0x2f/0xe2 Aug 22 22:59:47 juju-e4d256-prod-github-runner-207 kernel: [63361.427699] ? timekeeping_update+0xf7/0x150 Aug 22 22:59:47 juju-e4d256-prod-github-runner-207 kernel: [63361.428467] check_cpu_stall+0x109/0x270 Aug 22 22:59:47 juju-e4d256-prod-github-runner-207 kernel: [63361.429213] rcu_sched_clock_irq+0x9a/0x250 Aug 22 22:59:47 juju-e4d256-prod-github-runner-207 kernel: [63361.429976] update_process_times+0x94/0xd0 Aug 22 22:59:47 juju-e4d256-prod-github-runner-207 kernel: [63361.430734] tick_sched_handle+0x29/0x70 Aug 22 22:59:47 juju-e4d256-prod-github-runner-207 kernel: [63361.431476] tick_sched_timer+0x8c/0xc0 Aug 22 22:59:47 juju-e4d256-prod-github-runner-207 kernel: [63361.432225] ? tick_nohz_handler+0xb0/0xb0 Aug 22 22:59:47 juju-e4d256-prod-github-runner-207 kernel: [63361.432983] __hrtimer_run_queues+0x107/0x230 Aug 22 22:59:47 juju-e4d256-prod-github-runner-207 kernel: [63361.433756] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 22:59:47 juju-e4d256-prod-github-runner-207 kernel: [63361.434527] hrtimer_interrupt+0x101/0x220 Aug 22 22:59:47 juju-e4d256-prod-github-runner-207 kernel: [63361.435310] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 22:59:47 juju-e4d256-prod-github-runner-207 kernel: [63361.436230] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 22:59:47 juju-e4d256-prod-github-runner-207 kernel: [63361.437048] Aug 22 22:59:47 juju-e4d256-prod-github-runner-207 kernel: [63361.437682] Aug 22 22:59:47 juju-e4d256-prod-github-runner-207 kernel: [63361.438308] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 22:59:47 juju-e4d256-prod-github-runner-207 kernel: [63361.439126] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 22:59:47 juju-e4d256-prod-github-runner-207 kernel: [63361.440017] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 22:59:47 juju-e4d256-prod-github-runner-207 kernel: [63361.442213] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 22:59:47 juju-e4d256-prod-github-runner-207 kernel: [63361.443089] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 22:59:47 juju-e4d256-prod-github-runner-207 kernel: [63361.444091] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 22:59:47 juju-e4d256-prod-github-runner-207 kernel: [63361.445067] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 22:59:47 juju-e4d256-prod-github-runner-207 kernel: [63361.446033] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 22:59:47 juju-e4d256-prod-github-runner-207 kernel: [63361.446986] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 22:59:47 juju-e4d256-prod-github-runner-207 kernel: [63361.447945] ? _raw_spin_lock+0x22/0x30 Aug 22 22:59:47 juju-e4d256-prod-github-runner-207 kernel: [63361.448702] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 22:59:47 juju-e4d256-prod-github-runner-207 kernel: [63361.449544] direct_page_fault+0x206/0x310 [kvm] Aug 22 22:59:47 juju-e4d256-prod-github-runner-207 kernel: [63361.450383] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 22:59:47 juju-e4d256-prod-github-runner-207 kernel: [63361.451209] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 22:59:47 juju-e4d256-prod-github-runner-207 kernel: [63361.452048] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 22:59:47 juju-e4d256-prod-github-runner-207 kernel: [63361.452852] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 22:59:47 juju-e4d256-prod-github-runner-207 kernel: [63361.453658] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 22:59:47 juju-e4d256-prod-github-runner-207 kernel: [63361.454483] handle_exit+0x98/0x230 [kvm_amd] Aug 22 22:59:47 juju-e4d256-prod-github-runner-207 kernel: [63361.455238] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 22:59:47 juju-e4d256-prod-github-runner-207 kernel: [63361.456035] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 22:59:47 juju-e4d256-prod-github-runner-207 kernel: [63361.456832] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 22:59:47 juju-e4d256-prod-github-runner-207 kernel: [63361.457615] vcpu_run+0x62/0x2c0 [kvm] Aug 22 22:59:47 juju-e4d256-prod-github-runner-207 kernel: [63361.458367] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 22:59:47 juju-e4d256-prod-github-runner-207 kernel: [63361.459116] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 22:59:47 juju-e4d256-prod-github-runner-207 kernel: [63361.459932] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 22:59:47 juju-e4d256-prod-github-runner-207 kernel: [63361.460693] ? __seccomp_filter+0x4a/0x4a0 Aug 22 22:59:47 juju-e4d256-prod-github-runner-207 kernel: [63361.461414] ? __fget_files+0x86/0xc0 Aug 22 22:59:47 juju-e4d256-prod-github-runner-207 kernel: [63361.462111] __x64_sys_ioctl+0x95/0xd0 Aug 22 22:59:47 juju-e4d256-prod-github-runner-207 kernel: [63361.462805] do_syscall_64+0x5c/0xc0 Aug 22 22:59:47 juju-e4d256-prod-github-runner-207 kernel: [63361.463488] ? do_futex+0x162/0x1f0 Aug 22 22:59:47 juju-e4d256-prod-github-runner-207 kernel: [63361.464172] ? __x64_sys_futex+0x78/0x1e0 Aug 22 22:59:47 juju-e4d256-prod-github-runner-207 kernel: [63361.464874] ? __secure_computing+0xa9/0x120 Aug 22 22:59:47 juju-e4d256-prod-github-runner-207 kernel: [63361.465626] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 22:59:47 juju-e4d256-prod-github-runner-207 kernel: [63361.466516] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:59:47 juju-e4d256-prod-github-runner-207 kernel: [63361.467288] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:59:47 juju-e4d256-prod-github-runner-207 kernel: [63361.468066] ? do_syscall_64+0x69/0xc0 Aug 22 22:59:47 juju-e4d256-prod-github-runner-207 kernel: [63361.468758] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 22:59:47 juju-e4d256-prod-github-runner-207 kernel: [63361.469511] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 22:59:47 juju-e4d256-prod-github-runner-207 kernel: [63361.470266] ? do_syscall_64+0x69/0xc0 Aug 22 22:59:47 juju-e4d256-prod-github-runner-207 kernel: [63361.470958] ? do_syscall_64+0x69/0xc0 Aug 22 22:59:47 juju-e4d256-prod-github-runner-207 kernel: [63361.471660] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 22:59:47 juju-e4d256-prod-github-runner-207 kernel: [63361.472430] RIP: 0033:0x7faa5d0edaff Aug 22 22:59:47 juju-e4d256-prod-github-runner-207 kernel: [63361.473112] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 22:59:47 juju-e4d256-prod-github-runner-207 kernel: [63361.475207] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 22:59:47 juju-e4d256-prod-github-runner-207 kernel: [63361.476195] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 22:59:47 juju-e4d256-prod-github-runner-207 kernel: [63361.477136] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 22:59:47 juju-e4d256-prod-github-runner-207 kernel: [63361.478074] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 22:59:47 juju-e4d256-prod-github-runner-207 kernel: [63361.479010] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 22:59:47 juju-e4d256-prod-github-runner-207 kernel: [63361.479962] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 22:59:47 juju-e4d256-prod-github-runner-207 kernel: [63361.480880] Aug 22 23:00:14 juju-e4d256-prod-github-runner-207 kernel: [63388.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 58927s! [qemu-system-x86:6715] Aug 22 23:00:14 juju-e4d256-prod-github-runner-207 kernel: [63388.543173] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 23:00:14 juju-e4d256-prod-github-runner-207 kernel: [63388.543261] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 23:00:14 juju-e4d256-prod-github-runner-207 kernel: [63388.555935] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 23:00:14 juju-e4d256-prod-github-runner-207 kernel: [63388.557273] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 23:00:14 juju-e4d256-prod-github-runner-207 kernel: [63388.558547] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:00:14 juju-e4d256-prod-github-runner-207 kernel: [63388.559626] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 23:00:14 juju-e4d256-prod-github-runner-207 kernel: [63388.562283] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 23:00:14 juju-e4d256-prod-github-runner-207 kernel: [63388.563346] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 23:00:14 juju-e4d256-prod-github-runner-207 kernel: [63388.564564] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 23:00:14 juju-e4d256-prod-github-runner-207 kernel: [63388.565775] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 23:00:14 juju-e4d256-prod-github-runner-207 kernel: [63388.566997] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 23:00:14 juju-e4d256-prod-github-runner-207 kernel: [63388.568232] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 23:00:14 juju-e4d256-prod-github-runner-207 kernel: [63388.569439] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 23:00:14 juju-e4d256-prod-github-runner-207 kernel: [63388.570707] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 23:00:14 juju-e4d256-prod-github-runner-207 kernel: [63388.571856] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 23:00:14 juju-e4d256-prod-github-runner-207 kernel: [63388.573054] Call Trace: Aug 22 23:00:14 juju-e4d256-prod-github-runner-207 kernel: [63388.574003] Aug 22 23:00:14 juju-e4d256-prod-github-runner-207 kernel: [63388.574893] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:00:14 juju-e4d256-prod-github-runner-207 kernel: [63388.575987] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:00:14 juju-e4d256-prod-github-runner-207 kernel: [63388.577066] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:00:14 juju-e4d256-prod-github-runner-207 kernel: [63388.578203] ? show_regs.part.0+0x23/0x29 Aug 22 23:00:14 juju-e4d256-prod-github-runner-207 kernel: [63388.579271] ? show_regs.cold+0x8/0xd Aug 22 23:00:14 juju-e4d256-prod-github-runner-207 kernel: [63388.580258] ? watchdog_timer_fn+0x1be/0x220 Aug 22 23:00:14 juju-e4d256-prod-github-runner-207 kernel: [63388.581533] ? lockup_detector_update_enable+0x60/0x60 Aug 22 23:00:14 juju-e4d256-prod-github-runner-207 kernel: [63388.582789] ? __hrtimer_run_queues+0x107/0x230 Aug 22 23:00:14 juju-e4d256-prod-github-runner-207 kernel: [63388.583893] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 23:00:14 juju-e4d256-prod-github-runner-207 kernel: [63388.584974] ? hrtimer_interrupt+0x101/0x220 Aug 22 23:00:14 juju-e4d256-prod-github-runner-207 kernel: [63388.586052] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 23:00:14 juju-e4d256-prod-github-runner-207 kernel: [63388.587180] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 23:00:14 juju-e4d256-prod-github-runner-207 kernel: [63388.588247] Aug 22 23:00:14 juju-e4d256-prod-github-runner-207 kernel: [63388.589171] Aug 22 23:00:14 juju-e4d256-prod-github-runner-207 kernel: [63388.590066] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 23:00:14 juju-e4d256-prod-github-runner-207 kernel: [63388.591163] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:00:14 juju-e4d256-prod-github-runner-207 kernel: [63388.592293] ? _raw_spin_lock+0x22/0x30 Aug 22 23:00:14 juju-e4d256-prod-github-runner-207 kernel: [63388.593247] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:00:14 juju-e4d256-prod-github-runner-207 kernel: [63388.594320] direct_page_fault+0x206/0x310 [kvm] Aug 22 23:00:14 juju-e4d256-prod-github-runner-207 kernel: [63388.595405] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 23:00:14 juju-e4d256-prod-github-runner-207 kernel: [63388.596466] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 23:00:14 juju-e4d256-prod-github-runner-207 kernel: [63388.597516] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 23:00:14 juju-e4d256-prod-github-runner-207 kernel: [63388.598498] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 23:00:14 juju-e4d256-prod-github-runner-207 kernel: [63388.599466] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 23:00:14 juju-e4d256-prod-github-runner-207 kernel: [63388.600446] handle_exit+0x98/0x230 [kvm_amd] Aug 22 23:00:14 juju-e4d256-prod-github-runner-207 kernel: [63388.601344] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 23:00:14 juju-e4d256-prod-github-runner-207 kernel: [63388.602261] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 23:00:14 juju-e4d256-prod-github-runner-207 kernel: [63388.603185] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 23:00:14 juju-e4d256-prod-github-runner-207 kernel: [63388.604166] vcpu_run+0x62/0x2c0 [kvm] Aug 22 23:00:14 juju-e4d256-prod-github-runner-207 kernel: [63388.605017] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 23:00:14 juju-e4d256-prod-github-runner-207 kernel: [63388.605849] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 23:00:14 juju-e4d256-prod-github-runner-207 kernel: [63388.606704] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 23:00:14 juju-e4d256-prod-github-runner-207 kernel: [63388.607576] ? __seccomp_filter+0x4a/0x4a0 Aug 22 23:00:14 juju-e4d256-prod-github-runner-207 kernel: [63388.608323] ? __fget_files+0x86/0xc0 Aug 22 23:00:14 juju-e4d256-prod-github-runner-207 kernel: [63388.609026] __x64_sys_ioctl+0x95/0xd0 Aug 22 23:00:14 juju-e4d256-prod-github-runner-207 kernel: [63388.609729] do_syscall_64+0x5c/0xc0 Aug 22 23:00:14 juju-e4d256-prod-github-runner-207 kernel: [63388.610448] ? do_futex+0x162/0x1f0 Aug 22 23:00:14 juju-e4d256-prod-github-runner-207 kernel: [63388.611098] ? __x64_sys_futex+0x78/0x1e0 Aug 22 23:00:14 juju-e4d256-prod-github-runner-207 kernel: [63388.611839] ? __secure_computing+0xa9/0x120 Aug 22 23:00:14 juju-e4d256-prod-github-runner-207 kernel: [63388.612534] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 23:00:14 juju-e4d256-prod-github-runner-207 kernel: [63388.613351] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:00:14 juju-e4d256-prod-github-runner-207 kernel: [63388.614129] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:00:14 juju-e4d256-prod-github-runner-207 kernel: [63388.614906] ? do_syscall_64+0x69/0xc0 Aug 22 23:00:14 juju-e4d256-prod-github-runner-207 kernel: [63388.615581] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:00:14 juju-e4d256-prod-github-runner-207 kernel: [63388.616339] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:00:14 juju-e4d256-prod-github-runner-207 kernel: [63388.617038] ? do_syscall_64+0x69/0xc0 Aug 22 23:00:14 juju-e4d256-prod-github-runner-207 kernel: [63388.617732] ? do_syscall_64+0x69/0xc0 Aug 22 23:00:14 juju-e4d256-prod-github-runner-207 kernel: [63388.618411] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 23:00:14 juju-e4d256-prod-github-runner-207 kernel: [63388.619126] RIP: 0033:0x7faa5d0edaff Aug 22 23:00:14 juju-e4d256-prod-github-runner-207 kernel: [63388.619825] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 23:00:14 juju-e4d256-prod-github-runner-207 kernel: [63388.621929] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 23:00:14 juju-e4d256-prod-github-runner-207 kernel: [63388.622855] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 23:00:14 juju-e4d256-prod-github-runner-207 kernel: [63388.623806] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 23:00:14 juju-e4d256-prod-github-runner-207 kernel: [63388.624712] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 23:00:14 juju-e4d256-prod-github-runner-207 kernel: [63388.625635] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 23:00:14 juju-e4d256-prod-github-runner-207 kernel: [63388.626567] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 23:00:14 juju-e4d256-prod-github-runner-207 kernel: [63388.627520] Aug 22 23:00:42 juju-e4d256-prod-github-runner-207 kernel: [63416.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 58953s! [qemu-system-x86:6715] Aug 22 23:00:42 juju-e4d256-prod-github-runner-207 kernel: [63416.543806] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 23:00:42 juju-e4d256-prod-github-runner-207 kernel: [63416.544086] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 23:00:42 juju-e4d256-prod-github-runner-207 kernel: [63416.556268] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 23:00:42 juju-e4d256-prod-github-runner-207 kernel: [63416.557544] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 23:00:42 juju-e4d256-prod-github-runner-207 kernel: [63416.558772] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:00:42 juju-e4d256-prod-github-runner-207 kernel: [63416.559841] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 23:00:42 juju-e4d256-prod-github-runner-207 kernel: [63416.562383] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 23:00:42 juju-e4d256-prod-github-runner-207 kernel: [63416.563442] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 23:00:42 juju-e4d256-prod-github-runner-207 kernel: [63416.564852] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 23:00:42 juju-e4d256-prod-github-runner-207 kernel: [63416.566394] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 23:00:42 juju-e4d256-prod-github-runner-207 kernel: [63416.567611] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 23:00:42 juju-e4d256-prod-github-runner-207 kernel: [63416.568782] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 23:00:42 juju-e4d256-prod-github-runner-207 kernel: [63416.569978] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 23:00:42 juju-e4d256-prod-github-runner-207 kernel: [63416.571235] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 23:00:42 juju-e4d256-prod-github-runner-207 kernel: [63416.572334] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 23:00:42 juju-e4d256-prod-github-runner-207 kernel: [63416.573544] Call Trace: Aug 22 23:00:42 juju-e4d256-prod-github-runner-207 kernel: [63416.574493] Aug 22 23:00:42 juju-e4d256-prod-github-runner-207 kernel: [63416.575424] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:00:42 juju-e4d256-prod-github-runner-207 kernel: [63416.576459] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:00:42 juju-e4d256-prod-github-runner-207 kernel: [63416.577550] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:00:42 juju-e4d256-prod-github-runner-207 kernel: [63416.578691] ? show_regs.part.0+0x23/0x29 Aug 22 23:00:42 juju-e4d256-prod-github-runner-207 kernel: [63416.579714] ? show_regs.cold+0x8/0xd Aug 22 23:00:42 juju-e4d256-prod-github-runner-207 kernel: [63416.580691] ? watchdog_timer_fn+0x1be/0x220 Aug 22 23:00:42 juju-e4d256-prod-github-runner-207 kernel: [63416.581707] ? lockup_detector_update_enable+0x60/0x60 Aug 22 23:00:42 juju-e4d256-prod-github-runner-207 kernel: [63416.582789] ? __hrtimer_run_queues+0x107/0x230 Aug 22 23:00:42 juju-e4d256-prod-github-runner-207 kernel: [63416.583837] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 23:00:42 juju-e4d256-prod-github-runner-207 kernel: [63416.584867] ? hrtimer_interrupt+0x101/0x220 Aug 22 23:00:42 juju-e4d256-prod-github-runner-207 kernel: [63416.585895] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 23:00:42 juju-e4d256-prod-github-runner-207 kernel: [63416.587011] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 23:00:42 juju-e4d256-prod-github-runner-207 kernel: [63416.588104] Aug 22 23:00:42 juju-e4d256-prod-github-runner-207 kernel: [63416.588968] Aug 22 23:00:42 juju-e4d256-prod-github-runner-207 kernel: [63416.589821] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 23:00:42 juju-e4d256-prod-github-runner-207 kernel: [63416.590873] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:00:42 juju-e4d256-prod-github-runner-207 kernel: [63416.591948] ? _raw_spin_lock+0x22/0x30 Aug 22 23:00:42 juju-e4d256-prod-github-runner-207 kernel: [63416.592919] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:00:42 juju-e4d256-prod-github-runner-207 kernel: [63416.593973] direct_page_fault+0x206/0x310 [kvm] Aug 22 23:00:42 juju-e4d256-prod-github-runner-207 kernel: [63416.595029] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 23:00:42 juju-e4d256-prod-github-runner-207 kernel: [63416.596048] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 23:00:42 juju-e4d256-prod-github-runner-207 kernel: [63416.597074] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 23:00:42 juju-e4d256-prod-github-runner-207 kernel: [63416.598154] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 23:00:42 juju-e4d256-prod-github-runner-207 kernel: [63416.599143] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 23:00:42 juju-e4d256-prod-github-runner-207 kernel: [63416.600130] handle_exit+0x98/0x230 [kvm_amd] Aug 22 23:00:42 juju-e4d256-prod-github-runner-207 kernel: [63416.601031] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 23:00:42 juju-e4d256-prod-github-runner-207 kernel: [63416.601966] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 23:00:42 juju-e4d256-prod-github-runner-207 kernel: [63416.602899] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 23:00:42 juju-e4d256-prod-github-runner-207 kernel: [63416.603831] vcpu_run+0x62/0x2c0 [kvm] Aug 22 23:00:42 juju-e4d256-prod-github-runner-207 kernel: [63416.604838] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 23:00:42 juju-e4d256-prod-github-runner-207 kernel: [63416.605823] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 23:00:42 juju-e4d256-prod-github-runner-207 kernel: [63416.606714] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 23:00:42 juju-e4d256-prod-github-runner-207 kernel: [63416.607553] ? __seccomp_filter+0x4a/0x4a0 Aug 22 23:00:42 juju-e4d256-prod-github-runner-207 kernel: [63416.608349] ? __fget_files+0x86/0xc0 Aug 22 23:00:42 juju-e4d256-prod-github-runner-207 kernel: [63416.609064] __x64_sys_ioctl+0x95/0xd0 Aug 22 23:00:42 juju-e4d256-prod-github-runner-207 kernel: [63416.609776] do_syscall_64+0x5c/0xc0 Aug 22 23:00:42 juju-e4d256-prod-github-runner-207 kernel: [63416.610459] ? do_futex+0x162/0x1f0 Aug 22 23:00:42 juju-e4d256-prod-github-runner-207 kernel: [63416.611148] ? __x64_sys_futex+0x78/0x1e0 Aug 22 23:00:42 juju-e4d256-prod-github-runner-207 kernel: [63416.611831] ? __secure_computing+0xa9/0x120 Aug 22 23:00:42 juju-e4d256-prod-github-runner-207 kernel: [63416.612532] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 23:00:42 juju-e4d256-prod-github-runner-207 kernel: [63416.613297] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:00:42 juju-e4d256-prod-github-runner-207 kernel: [63416.614028] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:00:42 juju-e4d256-prod-github-runner-207 kernel: [63416.614750] ? do_syscall_64+0x69/0xc0 Aug 22 23:00:42 juju-e4d256-prod-github-runner-207 kernel: [63416.615427] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:00:42 juju-e4d256-prod-github-runner-207 kernel: [63416.616135] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:00:42 juju-e4d256-prod-github-runner-207 kernel: [63416.616839] ? do_syscall_64+0x69/0xc0 Aug 22 23:00:42 juju-e4d256-prod-github-runner-207 kernel: [63416.617468] ? do_syscall_64+0x69/0xc0 Aug 22 23:00:42 juju-e4d256-prod-github-runner-207 kernel: [63416.618119] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 23:00:42 juju-e4d256-prod-github-runner-207 kernel: [63416.619025] RIP: 0033:0x7faa5d0edaff Aug 22 23:00:42 juju-e4d256-prod-github-runner-207 kernel: [63416.619706] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 23:00:42 juju-e4d256-prod-github-runner-207 kernel: [63416.621703] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 23:00:42 juju-e4d256-prod-github-runner-207 kernel: [63416.622634] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 23:00:42 juju-e4d256-prod-github-runner-207 kernel: [63416.623543] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 23:00:42 juju-e4d256-prod-github-runner-207 kernel: [63416.624434] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 23:00:42 juju-e4d256-prod-github-runner-207 kernel: [63416.625325] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 23:00:42 juju-e4d256-prod-github-runner-207 kernel: [63416.626241] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 23:00:42 juju-e4d256-prod-github-runner-207 kernel: [63416.627162] Aug 22 23:01:10 juju-e4d256-prod-github-runner-207 kernel: [63444.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 58979s! [qemu-system-x86:6715] Aug 22 23:01:10 juju-e4d256-prod-github-runner-207 kernel: [63444.544328] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 23:01:10 juju-e4d256-prod-github-runner-207 kernel: [63444.544633] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 23:01:10 juju-e4d256-prod-github-runner-207 kernel: [63444.557227] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 23:01:10 juju-e4d256-prod-github-runner-207 kernel: [63444.558493] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 23:01:10 juju-e4d256-prod-github-runner-207 kernel: [63444.559721] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:01:10 juju-e4d256-prod-github-runner-207 kernel: [63444.560780] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 23:01:10 juju-e4d256-prod-github-runner-207 kernel: [63444.563351] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 23:01:10 juju-e4d256-prod-github-runner-207 kernel: [63444.564398] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 23:01:10 juju-e4d256-prod-github-runner-207 kernel: [63444.565566] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 23:01:10 juju-e4d256-prod-github-runner-207 kernel: [63444.566754] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 23:01:10 juju-e4d256-prod-github-runner-207 kernel: [63444.567922] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 23:01:10 juju-e4d256-prod-github-runner-207 kernel: [63444.569087] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 23:01:10 juju-e4d256-prod-github-runner-207 kernel: [63444.570257] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 23:01:10 juju-e4d256-prod-github-runner-207 kernel: [63444.571510] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 23:01:10 juju-e4d256-prod-github-runner-207 kernel: [63444.572609] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 23:01:10 juju-e4d256-prod-github-runner-207 kernel: [63444.573803] Call Trace: Aug 22 23:01:10 juju-e4d256-prod-github-runner-207 kernel: [63444.574738] Aug 22 23:01:10 juju-e4d256-prod-github-runner-207 kernel: [63444.575638] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:01:10 juju-e4d256-prod-github-runner-207 kernel: [63444.576694] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:01:10 juju-e4d256-prod-github-runner-207 kernel: [63444.577753] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:01:10 juju-e4d256-prod-github-runner-207 kernel: [63444.578903] ? show_regs.part.0+0x23/0x29 Aug 22 23:01:10 juju-e4d256-prod-github-runner-207 kernel: [63444.579911] ? show_regs.cold+0x8/0xd Aug 22 23:01:10 juju-e4d256-prod-github-runner-207 kernel: [63444.580886] ? watchdog_timer_fn+0x1be/0x220 Aug 22 23:01:10 juju-e4d256-prod-github-runner-207 kernel: [63444.581891] ? lockup_detector_update_enable+0x60/0x60 Aug 22 23:01:10 juju-e4d256-prod-github-runner-207 kernel: [63444.582990] ? __hrtimer_run_queues+0x107/0x230 Aug 22 23:01:10 juju-e4d256-prod-github-runner-207 kernel: [63444.584025] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 23:01:10 juju-e4d256-prod-github-runner-207 kernel: [63444.585077] ? hrtimer_interrupt+0x101/0x220 Aug 22 23:01:10 juju-e4d256-prod-github-runner-207 kernel: [63444.586097] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 23:01:10 juju-e4d256-prod-github-runner-207 kernel: [63444.587404] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 23:01:10 juju-e4d256-prod-github-runner-207 kernel: [63444.588452] Aug 22 23:01:10 juju-e4d256-prod-github-runner-207 kernel: [63444.589310] Aug 22 23:01:10 juju-e4d256-prod-github-runner-207 kernel: [63444.590153] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 23:01:10 juju-e4d256-prod-github-runner-207 kernel: [63444.591239] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:01:10 juju-e4d256-prod-github-runner-207 kernel: [63444.592290] ? _raw_spin_lock+0x22/0x30 Aug 22 23:01:10 juju-e4d256-prod-github-runner-207 kernel: [63444.593248] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:01:10 juju-e4d256-prod-github-runner-207 kernel: [63444.594280] direct_page_fault+0x206/0x310 [kvm] Aug 22 23:01:10 juju-e4d256-prod-github-runner-207 kernel: [63444.595329] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 23:01:10 juju-e4d256-prod-github-runner-207 kernel: [63444.596341] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 23:01:10 juju-e4d256-prod-github-runner-207 kernel: [63444.597341] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 23:01:10 juju-e4d256-prod-github-runner-207 kernel: [63444.598359] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 23:01:10 juju-e4d256-prod-github-runner-207 kernel: [63444.599313] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 23:01:10 juju-e4d256-prod-github-runner-207 kernel: [63444.600289] handle_exit+0x98/0x230 [kvm_amd] Aug 22 23:01:10 juju-e4d256-prod-github-runner-207 kernel: [63444.601192] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 23:01:10 juju-e4d256-prod-github-runner-207 kernel: [63444.602112] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 23:01:10 juju-e4d256-prod-github-runner-207 kernel: [63444.603057] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 23:01:10 juju-e4d256-prod-github-runner-207 kernel: [63444.603968] vcpu_run+0x62/0x2c0 [kvm] Aug 22 23:01:10 juju-e4d256-prod-github-runner-207 kernel: [63444.604790] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 23:01:10 juju-e4d256-prod-github-runner-207 kernel: [63444.605596] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 23:01:10 juju-e4d256-prod-github-runner-207 kernel: [63444.606460] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 23:01:10 juju-e4d256-prod-github-runner-207 kernel: [63444.607268] ? __seccomp_filter+0x4a/0x4a0 Aug 22 23:01:10 juju-e4d256-prod-github-runner-207 kernel: [63444.608017] ? __fget_files+0x86/0xc0 Aug 22 23:01:10 juju-e4d256-prod-github-runner-207 kernel: [63444.608721] __x64_sys_ioctl+0x95/0xd0 Aug 22 23:01:10 juju-e4d256-prod-github-runner-207 kernel: [63444.609412] do_syscall_64+0x5c/0xc0 Aug 22 23:01:10 juju-e4d256-prod-github-runner-207 kernel: [63444.610078] ? do_futex+0x162/0x1f0 Aug 22 23:01:10 juju-e4d256-prod-github-runner-207 kernel: [63444.610744] ? __x64_sys_futex+0x78/0x1e0 Aug 22 23:01:10 juju-e4d256-prod-github-runner-207 kernel: [63444.611419] ? __secure_computing+0xa9/0x120 Aug 22 23:01:10 juju-e4d256-prod-github-runner-207 kernel: [63444.612110] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 23:01:10 juju-e4d256-prod-github-runner-207 kernel: [63444.612875] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:01:10 juju-e4d256-prod-github-runner-207 kernel: [63444.613598] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:01:10 juju-e4d256-prod-github-runner-207 kernel: [63444.614316] ? do_syscall_64+0x69/0xc0 Aug 22 23:01:10 juju-e4d256-prod-github-runner-207 kernel: [63444.614980] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:01:10 juju-e4d256-prod-github-runner-207 kernel: [63444.615684] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:01:10 juju-e4d256-prod-github-runner-207 kernel: [63444.616382] ? do_syscall_64+0x69/0xc0 Aug 22 23:01:10 juju-e4d256-prod-github-runner-207 kernel: [63444.617023] ? do_syscall_64+0x69/0xc0 Aug 22 23:01:10 juju-e4d256-prod-github-runner-207 kernel: [63444.617648] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 23:01:10 juju-e4d256-prod-github-runner-207 kernel: [63444.618354] RIP: 0033:0x7faa5d0edaff Aug 22 23:01:10 juju-e4d256-prod-github-runner-207 kernel: [63444.619025] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 23:01:10 juju-e4d256-prod-github-runner-207 kernel: [63444.621018] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 23:01:10 juju-e4d256-prod-github-runner-207 kernel: [63444.621942] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 23:01:10 juju-e4d256-prod-github-runner-207 kernel: [63444.622854] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 23:01:10 juju-e4d256-prod-github-runner-207 kernel: [63444.623757] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 23:01:10 juju-e4d256-prod-github-runner-207 kernel: [63444.624644] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 23:01:10 juju-e4d256-prod-github-runner-207 kernel: [63444.625533] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 23:01:10 juju-e4d256-prod-github-runner-207 kernel: [63444.626434] Aug 22 23:01:38 juju-e4d256-prod-github-runner-207 kernel: [63472.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 59005s! [qemu-system-x86:6715] Aug 22 23:01:38 juju-e4d256-prod-github-runner-207 kernel: [63472.544309] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 23:01:38 juju-e4d256-prod-github-runner-207 kernel: [63472.544614] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 23:01:38 juju-e4d256-prod-github-runner-207 kernel: [63472.556766] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 23:01:38 juju-e4d256-prod-github-runner-207 kernel: [63472.558063] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 23:01:38 juju-e4d256-prod-github-runner-207 kernel: [63472.559330] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:01:38 juju-e4d256-prod-github-runner-207 kernel: [63472.560384] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 23:01:38 juju-e4d256-prod-github-runner-207 kernel: [63472.562940] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 23:01:38 juju-e4d256-prod-github-runner-207 kernel: [63472.563997] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 23:01:38 juju-e4d256-prod-github-runner-207 kernel: [63472.565163] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 23:01:38 juju-e4d256-prod-github-runner-207 kernel: [63472.566360] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 23:01:38 juju-e4d256-prod-github-runner-207 kernel: [63472.567523] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 23:01:38 juju-e4d256-prod-github-runner-207 kernel: [63472.568683] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 23:01:38 juju-e4d256-prod-github-runner-207 kernel: [63472.569860] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 23:01:38 juju-e4d256-prod-github-runner-207 kernel: [63472.571117] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 23:01:38 juju-e4d256-prod-github-runner-207 kernel: [63472.572221] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 23:01:38 juju-e4d256-prod-github-runner-207 kernel: [63472.573412] Call Trace: Aug 22 23:01:38 juju-e4d256-prod-github-runner-207 kernel: [63472.574335] Aug 22 23:01:38 juju-e4d256-prod-github-runner-207 kernel: [63472.575266] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:01:38 juju-e4d256-prod-github-runner-207 kernel: [63472.576310] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:01:38 juju-e4d256-prod-github-runner-207 kernel: [63472.577332] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:01:38 juju-e4d256-prod-github-runner-207 kernel: [63472.578457] ? show_regs.part.0+0x23/0x29 Aug 22 23:01:38 juju-e4d256-prod-github-runner-207 kernel: [63472.579459] ? show_regs.cold+0x8/0xd Aug 22 23:01:38 juju-e4d256-prod-github-runner-207 kernel: [63472.580435] ? watchdog_timer_fn+0x1be/0x220 Aug 22 23:01:38 juju-e4d256-prod-github-runner-207 kernel: [63472.581460] ? lockup_detector_update_enable+0x60/0x60 Aug 22 23:01:38 juju-e4d256-prod-github-runner-207 kernel: [63472.582535] ? __hrtimer_run_queues+0x107/0x230 Aug 22 23:01:38 juju-e4d256-prod-github-runner-207 kernel: [63472.583562] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 23:01:38 juju-e4d256-prod-github-runner-207 kernel: [63472.584597] ? hrtimer_interrupt+0x101/0x220 Aug 22 23:01:38 juju-e4d256-prod-github-runner-207 kernel: [63472.585639] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 23:01:38 juju-e4d256-prod-github-runner-207 kernel: [63472.586742] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 23:01:38 juju-e4d256-prod-github-runner-207 kernel: [63472.587816] Aug 22 23:01:38 juju-e4d256-prod-github-runner-207 kernel: [63472.588782] Aug 22 23:01:38 juju-e4d256-prod-github-runner-207 kernel: [63472.589634] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 23:01:38 juju-e4d256-prod-github-runner-207 kernel: [63472.590696] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:01:38 juju-e4d256-prod-github-runner-207 kernel: [63472.591747] ? _raw_spin_lock+0x22/0x30 Aug 22 23:01:38 juju-e4d256-prod-github-runner-207 kernel: [63472.592694] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:01:38 juju-e4d256-prod-github-runner-207 kernel: [63472.593722] direct_page_fault+0x206/0x310 [kvm] Aug 22 23:01:38 juju-e4d256-prod-github-runner-207 kernel: [63472.594772] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 23:01:38 juju-e4d256-prod-github-runner-207 kernel: [63472.595810] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 23:01:38 juju-e4d256-prod-github-runner-207 kernel: [63472.596824] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 23:01:38 juju-e4d256-prod-github-runner-207 kernel: [63472.597951] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 23:01:38 juju-e4d256-prod-github-runner-207 kernel: [63472.598912] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 23:01:38 juju-e4d256-prod-github-runner-207 kernel: [63472.599895] handle_exit+0x98/0x230 [kvm_amd] Aug 22 23:01:38 juju-e4d256-prod-github-runner-207 kernel: [63472.600787] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 23:01:38 juju-e4d256-prod-github-runner-207 kernel: [63472.601750] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 23:01:38 juju-e4d256-prod-github-runner-207 kernel: [63472.602703] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 23:01:38 juju-e4d256-prod-github-runner-207 kernel: [63472.603609] vcpu_run+0x62/0x2c0 [kvm] Aug 22 23:01:38 juju-e4d256-prod-github-runner-207 kernel: [63472.604419] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 23:01:38 juju-e4d256-prod-github-runner-207 kernel: [63472.605226] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 23:01:38 juju-e4d256-prod-github-runner-207 kernel: [63472.606087] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 23:01:38 juju-e4d256-prod-github-runner-207 kernel: [63472.606905] ? __seccomp_filter+0x4a/0x4a0 Aug 22 23:01:38 juju-e4d256-prod-github-runner-207 kernel: [63472.607655] ? __fget_files+0x86/0xc0 Aug 22 23:01:38 juju-e4d256-prod-github-runner-207 kernel: [63472.608366] __x64_sys_ioctl+0x95/0xd0 Aug 22 23:01:38 juju-e4d256-prod-github-runner-207 kernel: [63472.609065] do_syscall_64+0x5c/0xc0 Aug 22 23:01:38 juju-e4d256-prod-github-runner-207 kernel: [63472.609730] ? do_futex+0x162/0x1f0 Aug 22 23:01:38 juju-e4d256-prod-github-runner-207 kernel: [63472.610405] ? __x64_sys_futex+0x78/0x1e0 Aug 22 23:01:38 juju-e4d256-prod-github-runner-207 kernel: [63472.611080] ? __secure_computing+0xa9/0x120 Aug 22 23:01:38 juju-e4d256-prod-github-runner-207 kernel: [63472.611771] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 23:01:38 juju-e4d256-prod-github-runner-207 kernel: [63472.612532] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:01:38 juju-e4d256-prod-github-runner-207 kernel: [63472.613267] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:01:38 juju-e4d256-prod-github-runner-207 kernel: [63472.613985] ? do_syscall_64+0x69/0xc0 Aug 22 23:01:38 juju-e4d256-prod-github-runner-207 kernel: [63472.614660] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:01:38 juju-e4d256-prod-github-runner-207 kernel: [63472.615372] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:01:38 juju-e4d256-prod-github-runner-207 kernel: [63472.616075] ? do_syscall_64+0x69/0xc0 Aug 22 23:01:38 juju-e4d256-prod-github-runner-207 kernel: [63472.616706] ? do_syscall_64+0x69/0xc0 Aug 22 23:01:38 juju-e4d256-prod-github-runner-207 kernel: [63472.617336] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 23:01:38 juju-e4d256-prod-github-runner-207 kernel: [63472.618043] RIP: 0033:0x7faa5d0edaff Aug 22 23:01:38 juju-e4d256-prod-github-runner-207 kernel: [63472.619121] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 23:01:38 juju-e4d256-prod-github-runner-207 kernel: [63472.621161] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 23:01:38 juju-e4d256-prod-github-runner-207 kernel: [63472.622078] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 23:01:38 juju-e4d256-prod-github-runner-207 kernel: [63472.622989] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 23:01:38 juju-e4d256-prod-github-runner-207 kernel: [63472.623875] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 23:01:38 juju-e4d256-prod-github-runner-207 kernel: [63472.624758] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 23:01:38 juju-e4d256-prod-github-runner-207 kernel: [63472.625642] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 23:01:38 juju-e4d256-prod-github-runner-207 kernel: [63472.626553] Aug 22 23:02:06 juju-e4d256-prod-github-runner-207 kernel: [63500.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 59031s! [qemu-system-x86:6715] Aug 22 23:02:06 juju-e4d256-prod-github-runner-207 kernel: [63500.543906] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 23:02:06 juju-e4d256-prod-github-runner-207 kernel: [63500.544219] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 23:02:06 juju-e4d256-prod-github-runner-207 kernel: [63500.556613] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 23:02:06 juju-e4d256-prod-github-runner-207 kernel: [63500.557997] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 23:02:06 juju-e4d256-prod-github-runner-207 kernel: [63500.559233] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:02:06 juju-e4d256-prod-github-runner-207 kernel: [63500.560317] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 23:02:06 juju-e4d256-prod-github-runner-207 kernel: [63500.562930] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 23:02:06 juju-e4d256-prod-github-runner-207 kernel: [63500.563999] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 23:02:06 juju-e4d256-prod-github-runner-207 kernel: [63500.565186] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 23:02:06 juju-e4d256-prod-github-runner-207 kernel: [63500.566407] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 23:02:06 juju-e4d256-prod-github-runner-207 kernel: [63500.567580] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 23:02:06 juju-e4d256-prod-github-runner-207 kernel: [63500.568767] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 23:02:06 juju-e4d256-prod-github-runner-207 kernel: [63500.569975] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 23:02:06 juju-e4d256-prod-github-runner-207 kernel: [63500.571222] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 23:02:06 juju-e4d256-prod-github-runner-207 kernel: [63500.572331] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 23:02:06 juju-e4d256-prod-github-runner-207 kernel: [63500.573527] Call Trace: Aug 22 23:02:06 juju-e4d256-prod-github-runner-207 kernel: [63500.574524] Aug 22 23:02:06 juju-e4d256-prod-github-runner-207 kernel: [63500.575449] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:02:06 juju-e4d256-prod-github-runner-207 kernel: [63500.576491] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:02:06 juju-e4d256-prod-github-runner-207 kernel: [63500.577547] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:02:06 juju-e4d256-prod-github-runner-207 kernel: [63500.578759] ? show_regs.part.0+0x23/0x29 Aug 22 23:02:06 juju-e4d256-prod-github-runner-207 kernel: [63500.579826] ? show_regs.cold+0x8/0xd Aug 22 23:02:06 juju-e4d256-prod-github-runner-207 kernel: [63500.580821] ? watchdog_timer_fn+0x1be/0x220 Aug 22 23:02:06 juju-e4d256-prod-github-runner-207 kernel: [63500.581835] ? lockup_detector_update_enable+0x60/0x60 Aug 22 23:02:06 juju-e4d256-prod-github-runner-207 kernel: [63500.582922] ? __hrtimer_run_queues+0x107/0x230 Aug 22 23:02:06 juju-e4d256-prod-github-runner-207 kernel: [63500.583958] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 23:02:06 juju-e4d256-prod-github-runner-207 kernel: [63500.584997] ? hrtimer_interrupt+0x101/0x220 Aug 22 23:02:06 juju-e4d256-prod-github-runner-207 kernel: [63500.586055] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 23:02:06 juju-e4d256-prod-github-runner-207 kernel: [63500.587130] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 23:02:06 juju-e4d256-prod-github-runner-207 kernel: [63500.588179] Aug 22 23:02:06 juju-e4d256-prod-github-runner-207 kernel: [63500.589034] Aug 22 23:02:06 juju-e4d256-prod-github-runner-207 kernel: [63500.589882] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 23:02:06 juju-e4d256-prod-github-runner-207 kernel: [63500.590949] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:02:06 juju-e4d256-prod-github-runner-207 kernel: [63500.591995] ? _raw_spin_lock+0x22/0x30 Aug 22 23:02:06 juju-e4d256-prod-github-runner-207 kernel: [63500.592950] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:02:06 juju-e4d256-prod-github-runner-207 kernel: [63500.593996] direct_page_fault+0x206/0x310 [kvm] Aug 22 23:02:06 juju-e4d256-prod-github-runner-207 kernel: [63500.595033] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 23:02:06 juju-e4d256-prod-github-runner-207 kernel: [63500.596071] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 23:02:06 juju-e4d256-prod-github-runner-207 kernel: [63500.597085] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 23:02:06 juju-e4d256-prod-github-runner-207 kernel: [63500.598110] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 23:02:06 juju-e4d256-prod-github-runner-207 kernel: [63500.599065] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 23:02:06 juju-e4d256-prod-github-runner-207 kernel: [63500.600054] handle_exit+0x98/0x230 [kvm_amd] Aug 22 23:02:06 juju-e4d256-prod-github-runner-207 kernel: [63500.600951] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 23:02:06 juju-e4d256-prod-github-runner-207 kernel: [63500.601882] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 23:02:06 juju-e4d256-prod-github-runner-207 kernel: [63500.602830] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 23:02:06 juju-e4d256-prod-github-runner-207 kernel: [63500.603735] vcpu_run+0x62/0x2c0 [kvm] Aug 22 23:02:06 juju-e4d256-prod-github-runner-207 kernel: [63500.604554] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 23:02:06 juju-e4d256-prod-github-runner-207 kernel: [63500.605378] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 23:02:06 juju-e4d256-prod-github-runner-207 kernel: [63500.606259] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 23:02:06 juju-e4d256-prod-github-runner-207 kernel: [63500.607075] ? __seccomp_filter+0x4a/0x4a0 Aug 22 23:02:06 juju-e4d256-prod-github-runner-207 kernel: [63500.607821] ? __fget_files+0x86/0xc0 Aug 22 23:02:06 juju-e4d256-prod-github-runner-207 kernel: [63500.608533] __x64_sys_ioctl+0x95/0xd0 Aug 22 23:02:06 juju-e4d256-prod-github-runner-207 kernel: [63500.609230] do_syscall_64+0x5c/0xc0 Aug 22 23:02:06 juju-e4d256-prod-github-runner-207 kernel: [63500.609903] ? do_futex+0x162/0x1f0 Aug 22 23:02:06 juju-e4d256-prod-github-runner-207 kernel: [63500.610583] ? __x64_sys_futex+0x78/0x1e0 Aug 22 23:02:06 juju-e4d256-prod-github-runner-207 kernel: [63500.611262] ? __secure_computing+0xa9/0x120 Aug 22 23:02:06 juju-e4d256-prod-github-runner-207 kernel: [63500.611969] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 23:02:06 juju-e4d256-prod-github-runner-207 kernel: [63500.612732] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:02:06 juju-e4d256-prod-github-runner-207 kernel: [63500.613463] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:02:06 juju-e4d256-prod-github-runner-207 kernel: [63500.614206] ? do_syscall_64+0x69/0xc0 Aug 22 23:02:06 juju-e4d256-prod-github-runner-207 kernel: [63500.614853] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:02:06 juju-e4d256-prod-github-runner-207 kernel: [63500.615573] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:02:06 juju-e4d256-prod-github-runner-207 kernel: [63500.616272] ? do_syscall_64+0x69/0xc0 Aug 22 23:02:06 juju-e4d256-prod-github-runner-207 kernel: [63500.616909] ? do_syscall_64+0x69/0xc0 Aug 22 23:02:06 juju-e4d256-prod-github-runner-207 kernel: [63500.617537] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 23:02:06 juju-e4d256-prod-github-runner-207 kernel: [63500.618260] RIP: 0033:0x7faa5d0edaff Aug 22 23:02:06 juju-e4d256-prod-github-runner-207 kernel: [63500.618908] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 23:02:06 juju-e4d256-prod-github-runner-207 kernel: [63500.620905] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 23:02:06 juju-e4d256-prod-github-runner-207 kernel: [63500.621846] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 23:02:06 juju-e4d256-prod-github-runner-207 kernel: [63500.622761] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 23:02:06 juju-e4d256-prod-github-runner-207 kernel: [63500.623655] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 23:02:06 juju-e4d256-prod-github-runner-207 kernel: [63500.624550] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 23:02:06 juju-e4d256-prod-github-runner-207 kernel: [63500.625446] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 23:02:06 juju-e4d256-prod-github-runner-207 kernel: [63500.626375] Aug 22 23:02:34 juju-e4d256-prod-github-runner-207 kernel: [63528.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 59057s! [qemu-system-x86:6715] Aug 22 23:02:34 juju-e4d256-prod-github-runner-207 kernel: [63528.543883] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 23:02:34 juju-e4d256-prod-github-runner-207 kernel: [63528.544204] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 23:02:34 juju-e4d256-prod-github-runner-207 kernel: [63528.556357] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 23:02:34 juju-e4d256-prod-github-runner-207 kernel: [63528.557639] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 23:02:34 juju-e4d256-prod-github-runner-207 kernel: [63528.558864] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:02:34 juju-e4d256-prod-github-runner-207 kernel: [63528.559941] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 23:02:34 juju-e4d256-prod-github-runner-207 kernel: [63528.562493] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 23:02:34 juju-e4d256-prod-github-runner-207 kernel: [63528.563538] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 23:02:34 juju-e4d256-prod-github-runner-207 kernel: [63528.564726] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 23:02:34 juju-e4d256-prod-github-runner-207 kernel: [63528.565901] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 23:02:34 juju-e4d256-prod-github-runner-207 kernel: [63528.567065] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 23:02:34 juju-e4d256-prod-github-runner-207 kernel: [63528.568228] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 23:02:34 juju-e4d256-prod-github-runner-207 kernel: [63528.569474] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 23:02:34 juju-e4d256-prod-github-runner-207 kernel: [63528.570721] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 23:02:34 juju-e4d256-prod-github-runner-207 kernel: [63528.571818] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 23:02:34 juju-e4d256-prod-github-runner-207 kernel: [63528.573096] Call Trace: Aug 22 23:02:34 juju-e4d256-prod-github-runner-207 kernel: [63528.574019] Aug 22 23:02:34 juju-e4d256-prod-github-runner-207 kernel: [63528.574916] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:02:34 juju-e4d256-prod-github-runner-207 kernel: [63528.575942] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:02:34 juju-e4d256-prod-github-runner-207 kernel: [63528.576960] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:02:34 juju-e4d256-prod-github-runner-207 kernel: [63528.578085] ? show_regs.part.0+0x23/0x29 Aug 22 23:02:34 juju-e4d256-prod-github-runner-207 kernel: [63528.579082] ? show_regs.cold+0x8/0xd Aug 22 23:02:34 juju-e4d256-prod-github-runner-207 kernel: [63528.580051] ? watchdog_timer_fn+0x1be/0x220 Aug 22 23:02:34 juju-e4d256-prod-github-runner-207 kernel: [63528.581063] ? lockup_detector_update_enable+0x60/0x60 Aug 22 23:02:34 juju-e4d256-prod-github-runner-207 kernel: [63528.582154] ? __hrtimer_run_queues+0x107/0x230 Aug 22 23:02:34 juju-e4d256-prod-github-runner-207 kernel: [63528.583185] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 23:02:34 juju-e4d256-prod-github-runner-207 kernel: [63528.584205] ? hrtimer_interrupt+0x101/0x220 Aug 22 23:02:34 juju-e4d256-prod-github-runner-207 kernel: [63528.585221] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 23:02:34 juju-e4d256-prod-github-runner-207 kernel: [63528.586297] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 23:02:34 juju-e4d256-prod-github-runner-207 kernel: [63528.587342] Aug 22 23:02:34 juju-e4d256-prod-github-runner-207 kernel: [63528.588201] Aug 22 23:02:34 juju-e4d256-prod-github-runner-207 kernel: [63528.589048] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 23:02:34 juju-e4d256-prod-github-runner-207 kernel: [63528.590094] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:02:34 juju-e4d256-prod-github-runner-207 kernel: [63528.591128] ? _raw_spin_lock+0x22/0x30 Aug 22 23:02:34 juju-e4d256-prod-github-runner-207 kernel: [63528.592069] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:02:34 juju-e4d256-prod-github-runner-207 kernel: [63528.593085] direct_page_fault+0x206/0x310 [kvm] Aug 22 23:02:34 juju-e4d256-prod-github-runner-207 kernel: [63528.594122] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 23:02:34 juju-e4d256-prod-github-runner-207 kernel: [63528.595147] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 23:02:34 juju-e4d256-prod-github-runner-207 kernel: [63528.596158] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 23:02:34 juju-e4d256-prod-github-runner-207 kernel: [63528.597163] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 23:02:34 juju-e4d256-prod-github-runner-207 kernel: [63528.598132] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 23:02:34 juju-e4d256-prod-github-runner-207 kernel: [63528.599111] handle_exit+0x98/0x230 [kvm_amd] Aug 22 23:02:34 juju-e4d256-prod-github-runner-207 kernel: [63528.600003] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 23:02:34 juju-e4d256-prod-github-runner-207 kernel: [63528.600916] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 23:02:34 juju-e4d256-prod-github-runner-207 kernel: [63528.601851] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 23:02:34 juju-e4d256-prod-github-runner-207 kernel: [63528.602766] vcpu_run+0x62/0x2c0 [kvm] Aug 22 23:02:34 juju-e4d256-prod-github-runner-207 kernel: [63528.603578] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 23:02:34 juju-e4d256-prod-github-runner-207 kernel: [63528.604386] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 23:02:34 juju-e4d256-prod-github-runner-207 kernel: [63528.605241] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 23:02:34 juju-e4d256-prod-github-runner-207 kernel: [63528.606047] ? __seccomp_filter+0x4a/0x4a0 Aug 22 23:02:34 juju-e4d256-prod-github-runner-207 kernel: [63528.606791] ? __fget_files+0x86/0xc0 Aug 22 23:02:34 juju-e4d256-prod-github-runner-207 kernel: [63528.607494] __x64_sys_ioctl+0x95/0xd0 Aug 22 23:02:34 juju-e4d256-prod-github-runner-207 kernel: [63528.608194] do_syscall_64+0x5c/0xc0 Aug 22 23:02:34 juju-e4d256-prod-github-runner-207 kernel: [63528.608859] ? do_futex+0x162/0x1f0 Aug 22 23:02:34 juju-e4d256-prod-github-runner-207 kernel: [63528.609507] ? __x64_sys_futex+0x78/0x1e0 Aug 22 23:02:34 juju-e4d256-prod-github-runner-207 kernel: [63528.610198] ? __secure_computing+0xa9/0x120 Aug 22 23:02:34 juju-e4d256-prod-github-runner-207 kernel: [63528.610890] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 23:02:34 juju-e4d256-prod-github-runner-207 kernel: [63528.611646] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:02:34 juju-e4d256-prod-github-runner-207 kernel: [63528.612366] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:02:34 juju-e4d256-prod-github-runner-207 kernel: [63528.613092] ? do_syscall_64+0x69/0xc0 Aug 22 23:02:34 juju-e4d256-prod-github-runner-207 kernel: [63528.613752] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:02:34 juju-e4d256-prod-github-runner-207 kernel: [63528.614466] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:02:34 juju-e4d256-prod-github-runner-207 kernel: [63528.615165] ? do_syscall_64+0x69/0xc0 Aug 22 23:02:34 juju-e4d256-prod-github-runner-207 kernel: [63528.615792] ? do_syscall_64+0x69/0xc0 Aug 22 23:02:34 juju-e4d256-prod-github-runner-207 kernel: [63528.616410] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 23:02:34 juju-e4d256-prod-github-runner-207 kernel: [63528.617116] RIP: 0033:0x7faa5d0edaff Aug 22 23:02:34 juju-e4d256-prod-github-runner-207 kernel: [63528.617785] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 23:02:34 juju-e4d256-prod-github-runner-207 kernel: [63528.619765] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 23:02:34 juju-e4d256-prod-github-runner-207 kernel: [63528.620670] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 23:02:34 juju-e4d256-prod-github-runner-207 kernel: [63528.621557] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 23:02:34 juju-e4d256-prod-github-runner-207 kernel: [63528.622465] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 23:02:34 juju-e4d256-prod-github-runner-207 kernel: [63528.623350] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 23:02:34 juju-e4d256-prod-github-runner-207 kernel: [63528.624236] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 23:02:34 juju-e4d256-prod-github-runner-207 kernel: [63528.625135] Aug 22 23:02:47 juju-e4d256-prod-github-runner-207 kernel: [63541.424706] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 23:02:47 juju-e4d256-prod-github-runner-207 kernel: [63541.425834] rcu: 1-....: (15806074 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=7631871 Aug 22 23:02:47 juju-e4d256-prod-github-runner-207 kernel: [63541.427003] (t=15856056 jiffies g=23269 q=56144) Aug 22 23:02:47 juju-e4d256-prod-github-runner-207 kernel: [63541.427793] NMI backtrace for cpu 1 Aug 22 23:02:47 juju-e4d256-prod-github-runner-207 kernel: [63541.428503] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 23:02:47 juju-e4d256-prod-github-runner-207 kernel: [63541.429627] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 23:02:47 juju-e4d256-prod-github-runner-207 kernel: [63541.430689] Call Trace: Aug 22 23:02:47 juju-e4d256-prod-github-runner-207 kernel: [63541.431492] Aug 22 23:02:47 juju-e4d256-prod-github-runner-207 kernel: [63541.432137] show_stack+0x52/0x5c Aug 22 23:02:47 juju-e4d256-prod-github-runner-207 kernel: [63541.432861] dump_stack_lvl+0x4a/0x63 Aug 22 23:02:47 juju-e4d256-prod-github-runner-207 kernel: [63541.433619] dump_stack+0x10/0x16 Aug 22 23:02:47 juju-e4d256-prod-github-runner-207 kernel: [63541.434341] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 23:02:47 juju-e4d256-prod-github-runner-207 kernel: [63541.435129] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 23:02:47 juju-e4d256-prod-github-runner-207 kernel: [63541.435910] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 23:02:47 juju-e4d256-prod-github-runner-207 kernel: [63541.436732] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 23:02:47 juju-e4d256-prod-github-runner-207 kernel: [63541.437565] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 23:02:47 juju-e4d256-prod-github-runner-207 kernel: [63541.438377] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 23:02:47 juju-e4d256-prod-github-runner-207 kernel: [63541.439150] print_cpu_stall.cold+0x2f/0xe2 Aug 22 23:02:47 juju-e4d256-prod-github-runner-207 kernel: [63541.439918] ? timekeeping_update+0xf7/0x150 Aug 22 23:02:47 juju-e4d256-prod-github-runner-207 kernel: [63541.440836] check_cpu_stall+0x109/0x270 Aug 22 23:02:47 juju-e4d256-prod-github-runner-207 kernel: [63541.441599] rcu_sched_clock_irq+0x9a/0x250 Aug 22 23:02:47 juju-e4d256-prod-github-runner-207 kernel: [63541.442365] update_process_times+0x94/0xd0 Aug 22 23:02:47 juju-e4d256-prod-github-runner-207 kernel: [63541.443136] tick_sched_handle+0x29/0x70 Aug 22 23:02:47 juju-e4d256-prod-github-runner-207 kernel: [63541.443887] tick_sched_timer+0x8c/0xc0 Aug 22 23:02:47 juju-e4d256-prod-github-runner-207 kernel: [63541.444621] ? tick_nohz_handler+0xb0/0xb0 Aug 22 23:02:47 juju-e4d256-prod-github-runner-207 kernel: [63541.445378] __hrtimer_run_queues+0x107/0x230 Aug 22 23:02:47 juju-e4d256-prod-github-runner-207 kernel: [63541.446202] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 23:02:47 juju-e4d256-prod-github-runner-207 kernel: [63541.447014] hrtimer_interrupt+0x101/0x220 Aug 22 23:02:47 juju-e4d256-prod-github-runner-207 kernel: [63541.447772] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 23:02:47 juju-e4d256-prod-github-runner-207 kernel: [63541.448647] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 23:02:47 juju-e4d256-prod-github-runner-207 kernel: [63541.449504] Aug 22 23:02:47 juju-e4d256-prod-github-runner-207 kernel: [63541.450141] Aug 22 23:02:47 juju-e4d256-prod-github-runner-207 kernel: [63541.450770] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 23:02:47 juju-e4d256-prod-github-runner-207 kernel: [63541.451590] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:02:47 juju-e4d256-prod-github-runner-207 kernel: [63541.452470] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 23:02:47 juju-e4d256-prod-github-runner-207 kernel: [63541.454707] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 23:02:47 juju-e4d256-prod-github-runner-207 kernel: [63541.455582] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 23:02:47 juju-e4d256-prod-github-runner-207 kernel: [63541.456575] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 23:02:47 juju-e4d256-prod-github-runner-207 kernel: [63541.457578] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 23:02:47 juju-e4d256-prod-github-runner-207 kernel: [63541.458563] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 23:02:47 juju-e4d256-prod-github-runner-207 kernel: [63541.459521] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 23:02:47 juju-e4d256-prod-github-runner-207 kernel: [63541.460476] ? _raw_spin_lock+0x22/0x30 Aug 22 23:02:47 juju-e4d256-prod-github-runner-207 kernel: [63541.461235] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:02:47 juju-e4d256-prod-github-runner-207 kernel: [63541.462083] direct_page_fault+0x206/0x310 [kvm] Aug 22 23:02:47 juju-e4d256-prod-github-runner-207 kernel: [63541.462929] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 23:02:47 juju-e4d256-prod-github-runner-207 kernel: [63541.463760] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 23:02:47 juju-e4d256-prod-github-runner-207 kernel: [63541.464618] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 23:02:47 juju-e4d256-prod-github-runner-207 kernel: [63541.465464] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 23:02:47 juju-e4d256-prod-github-runner-207 kernel: [63541.466252] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 23:02:47 juju-e4d256-prod-github-runner-207 kernel: [63541.467080] handle_exit+0x98/0x230 [kvm_amd] Aug 22 23:02:47 juju-e4d256-prod-github-runner-207 kernel: [63541.467834] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 23:02:47 juju-e4d256-prod-github-runner-207 kernel: [63541.468619] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 23:02:47 juju-e4d256-prod-github-runner-207 kernel: [63541.469425] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 23:02:47 juju-e4d256-prod-github-runner-207 kernel: [63541.470244] vcpu_run+0x62/0x2c0 [kvm] Aug 22 23:02:47 juju-e4d256-prod-github-runner-207 kernel: [63541.470979] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 23:02:47 juju-e4d256-prod-github-runner-207 kernel: [63541.471731] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 23:02:47 juju-e4d256-prod-github-runner-207 kernel: [63541.472534] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 23:02:47 juju-e4d256-prod-github-runner-207 kernel: [63541.473299] ? __seccomp_filter+0x4a/0x4a0 Aug 22 23:02:47 juju-e4d256-prod-github-runner-207 kernel: [63541.474028] ? __fget_files+0x86/0xc0 Aug 22 23:02:47 juju-e4d256-prod-github-runner-207 kernel: [63541.474721] __x64_sys_ioctl+0x95/0xd0 Aug 22 23:02:47 juju-e4d256-prod-github-runner-207 kernel: [63541.475416] do_syscall_64+0x5c/0xc0 Aug 22 23:02:47 juju-e4d256-prod-github-runner-207 kernel: [63541.476103] ? do_futex+0x162/0x1f0 Aug 22 23:02:47 juju-e4d256-prod-github-runner-207 kernel: [63541.476775] ? __x64_sys_futex+0x78/0x1e0 Aug 22 23:02:47 juju-e4d256-prod-github-runner-207 kernel: [63541.477501] ? __secure_computing+0xa9/0x120 Aug 22 23:02:47 juju-e4d256-prod-github-runner-207 kernel: [63541.478218] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 23:02:47 juju-e4d256-prod-github-runner-207 kernel: [63541.479018] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:02:47 juju-e4d256-prod-github-runner-207 kernel: [63541.479777] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:02:47 juju-e4d256-prod-github-runner-207 kernel: [63541.480530] ? do_syscall_64+0x69/0xc0 Aug 22 23:02:47 juju-e4d256-prod-github-runner-207 kernel: [63541.481239] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:02:47 juju-e4d256-prod-github-runner-207 kernel: [63541.482031] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:02:47 juju-e4d256-prod-github-runner-207 kernel: [63541.482794] ? do_syscall_64+0x69/0xc0 Aug 22 23:02:47 juju-e4d256-prod-github-runner-207 kernel: [63541.483489] ? do_syscall_64+0x69/0xc0 Aug 22 23:02:47 juju-e4d256-prod-github-runner-207 kernel: [63541.484180] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 23:02:47 juju-e4d256-prod-github-runner-207 kernel: [63541.484967] RIP: 0033:0x7faa5d0edaff Aug 22 23:02:47 juju-e4d256-prod-github-runner-207 kernel: [63541.485665] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 23:02:47 juju-e4d256-prod-github-runner-207 kernel: [63541.487769] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 23:02:47 juju-e4d256-prod-github-runner-207 kernel: [63541.488732] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 23:02:47 juju-e4d256-prod-github-runner-207 kernel: [63541.489687] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 23:02:47 juju-e4d256-prod-github-runner-207 kernel: [63541.490631] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 23:02:47 juju-e4d256-prod-github-runner-207 kernel: [63541.491576] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 23:02:47 juju-e4d256-prod-github-runner-207 kernel: [63541.492501] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 23:02:47 juju-e4d256-prod-github-runner-207 kernel: [63541.493417] Aug 22 23:03:14 juju-e4d256-prod-github-runner-207 kernel: [63568.541976] watchdog: BUG: soft lockup - CPU#1 stuck for 59094s! [qemu-system-x86:6715] Aug 22 23:03:14 juju-e4d256-prod-github-runner-207 kernel: [63568.543210] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 23:03:14 juju-e4d256-prod-github-runner-207 kernel: [63568.543456] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 23:03:14 juju-e4d256-prod-github-runner-207 kernel: [63568.555569] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 23:03:14 juju-e4d256-prod-github-runner-207 kernel: [63568.556830] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 23:03:14 juju-e4d256-prod-github-runner-207 kernel: [63568.558068] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:03:14 juju-e4d256-prod-github-runner-207 kernel: [63568.559123] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 23:03:14 juju-e4d256-prod-github-runner-207 kernel: [63568.561683] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 23:03:14 juju-e4d256-prod-github-runner-207 kernel: [63568.562725] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 23:03:14 juju-e4d256-prod-github-runner-207 kernel: [63568.563886] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 23:03:14 juju-e4d256-prod-github-runner-207 kernel: [63568.565051] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 23:03:14 juju-e4d256-prod-github-runner-207 kernel: [63568.566224] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 23:03:14 juju-e4d256-prod-github-runner-207 kernel: [63568.567383] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 23:03:14 juju-e4d256-prod-github-runner-207 kernel: [63568.568545] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 23:03:14 juju-e4d256-prod-github-runner-207 kernel: [63568.569786] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 23:03:14 juju-e4d256-prod-github-runner-207 kernel: [63568.570885] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 23:03:14 juju-e4d256-prod-github-runner-207 kernel: [63568.572089] Call Trace: Aug 22 23:03:14 juju-e4d256-prod-github-runner-207 kernel: [63568.573001] Aug 22 23:03:14 juju-e4d256-prod-github-runner-207 kernel: [63568.573897] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:03:14 juju-e4d256-prod-github-runner-207 kernel: [63568.574925] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:03:14 juju-e4d256-prod-github-runner-207 kernel: [63568.575945] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:03:14 juju-e4d256-prod-github-runner-207 kernel: [63568.577061] ? show_regs.part.0+0x23/0x29 Aug 22 23:03:14 juju-e4d256-prod-github-runner-207 kernel: [63568.578067] ? show_regs.cold+0x8/0xd Aug 22 23:03:14 juju-e4d256-prod-github-runner-207 kernel: [63568.579038] ? watchdog_timer_fn+0x1be/0x220 Aug 22 23:03:14 juju-e4d256-prod-github-runner-207 kernel: [63568.580044] ? lockup_detector_update_enable+0x60/0x60 Aug 22 23:03:14 juju-e4d256-prod-github-runner-207 kernel: [63568.581106] ? __hrtimer_run_queues+0x107/0x230 Aug 22 23:03:14 juju-e4d256-prod-github-runner-207 kernel: [63568.582143] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 23:03:14 juju-e4d256-prod-github-runner-207 kernel: [63568.583167] ? hrtimer_interrupt+0x101/0x220 Aug 22 23:03:14 juju-e4d256-prod-github-runner-207 kernel: [63568.584210] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 23:03:14 juju-e4d256-prod-github-runner-207 kernel: [63568.585310] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 23:03:14 juju-e4d256-prod-github-runner-207 kernel: [63568.586356] Aug 22 23:03:14 juju-e4d256-prod-github-runner-207 kernel: [63568.587207] Aug 22 23:03:14 juju-e4d256-prod-github-runner-207 kernel: [63568.588042] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 23:03:14 juju-e4d256-prod-github-runner-207 kernel: [63568.589072] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:03:14 juju-e4d256-prod-github-runner-207 kernel: [63568.590120] ? _raw_spin_lock+0x22/0x30 Aug 22 23:03:14 juju-e4d256-prod-github-runner-207 kernel: [63568.591078] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:03:14 juju-e4d256-prod-github-runner-207 kernel: [63568.592093] direct_page_fault+0x206/0x310 [kvm] Aug 22 23:03:14 juju-e4d256-prod-github-runner-207 kernel: [63568.593125] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 23:03:14 juju-e4d256-prod-github-runner-207 kernel: [63568.594134] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 23:03:14 juju-e4d256-prod-github-runner-207 kernel: [63568.595133] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 23:03:14 juju-e4d256-prod-github-runner-207 kernel: [63568.596121] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 23:03:14 juju-e4d256-prod-github-runner-207 kernel: [63568.597070] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 23:03:14 juju-e4d256-prod-github-runner-207 kernel: [63568.598089] handle_exit+0x98/0x230 [kvm_amd] Aug 22 23:03:14 juju-e4d256-prod-github-runner-207 kernel: [63568.598994] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 23:03:14 juju-e4d256-prod-github-runner-207 kernel: [63568.599904] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 23:03:14 juju-e4d256-prod-github-runner-207 kernel: [63568.600825] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 23:03:14 juju-e4d256-prod-github-runner-207 kernel: [63568.601743] vcpu_run+0x62/0x2c0 [kvm] Aug 22 23:03:14 juju-e4d256-prod-github-runner-207 kernel: [63568.602551] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 23:03:14 juju-e4d256-prod-github-runner-207 kernel: [63568.603355] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 23:03:14 juju-e4d256-prod-github-runner-207 kernel: [63568.604204] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 23:03:14 juju-e4d256-prod-github-runner-207 kernel: [63568.604997] ? __seccomp_filter+0x4a/0x4a0 Aug 22 23:03:14 juju-e4d256-prod-github-runner-207 kernel: [63568.605766] ? __fget_files+0x86/0xc0 Aug 22 23:03:14 juju-e4d256-prod-github-runner-207 kernel: [63568.606469] __x64_sys_ioctl+0x95/0xd0 Aug 22 23:03:14 juju-e4d256-prod-github-runner-207 kernel: [63568.607163] do_syscall_64+0x5c/0xc0 Aug 22 23:03:14 juju-e4d256-prod-github-runner-207 kernel: [63568.607825] ? do_futex+0x162/0x1f0 Aug 22 23:03:14 juju-e4d256-prod-github-runner-207 kernel: [63568.608476] ? __x64_sys_futex+0x78/0x1e0 Aug 22 23:03:14 juju-e4d256-prod-github-runner-207 kernel: [63568.609154] ? __secure_computing+0xa9/0x120 Aug 22 23:03:14 juju-e4d256-prod-github-runner-207 kernel: [63568.609841] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 23:03:14 juju-e4d256-prod-github-runner-207 kernel: [63568.610612] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:03:14 juju-e4d256-prod-github-runner-207 kernel: [63568.611349] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:03:14 juju-e4d256-prod-github-runner-207 kernel: [63568.612069] ? do_syscall_64+0x69/0xc0 Aug 22 23:03:14 juju-e4d256-prod-github-runner-207 kernel: [63568.612717] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:03:14 juju-e4d256-prod-github-runner-207 kernel: [63568.613432] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:03:14 juju-e4d256-prod-github-runner-207 kernel: [63568.614131] ? do_syscall_64+0x69/0xc0 Aug 22 23:03:14 juju-e4d256-prod-github-runner-207 kernel: [63568.614755] ? do_syscall_64+0x69/0xc0 Aug 22 23:03:14 juju-e4d256-prod-github-runner-207 kernel: [63568.615380] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 23:03:14 juju-e4d256-prod-github-runner-207 kernel: [63568.616082] RIP: 0033:0x7faa5d0edaff Aug 22 23:03:14 juju-e4d256-prod-github-runner-207 kernel: [63568.616726] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 23:03:14 juju-e4d256-prod-github-runner-207 kernel: [63568.618736] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 23:03:14 juju-e4d256-prod-github-runner-207 kernel: [63568.619693] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 23:03:14 juju-e4d256-prod-github-runner-207 kernel: [63568.620589] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 23:03:14 juju-e4d256-prod-github-runner-207 kernel: [63568.621492] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 23:03:14 juju-e4d256-prod-github-runner-207 kernel: [63568.622380] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 23:03:14 juju-e4d256-prod-github-runner-207 kernel: [63568.623267] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 23:03:14 juju-e4d256-prod-github-runner-207 kernel: [63568.624184] Aug 22 23:03:42 juju-e4d256-prod-github-runner-207 kernel: [63596.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 59120s! [qemu-system-x86:6715] Aug 22 23:03:42 juju-e4d256-prod-github-runner-207 kernel: [63596.543819] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 23:03:42 juju-e4d256-prod-github-runner-207 kernel: [63596.544025] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 23:03:42 juju-e4d256-prod-github-runner-207 kernel: [63596.556145] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 23:03:42 juju-e4d256-prod-github-runner-207 kernel: [63596.557431] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 23:03:42 juju-e4d256-prod-github-runner-207 kernel: [63596.558656] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:03:42 juju-e4d256-prod-github-runner-207 kernel: [63596.559718] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 23:03:42 juju-e4d256-prod-github-runner-207 kernel: [63596.562513] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 23:03:42 juju-e4d256-prod-github-runner-207 kernel: [63596.563612] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 23:03:42 juju-e4d256-prod-github-runner-207 kernel: [63596.564806] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 23:03:42 juju-e4d256-prod-github-runner-207 kernel: [63596.565978] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 23:03:42 juju-e4d256-prod-github-runner-207 kernel: [63596.567144] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 23:03:42 juju-e4d256-prod-github-runner-207 kernel: [63596.568312] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 23:03:42 juju-e4d256-prod-github-runner-207 kernel: [63596.569824] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 23:03:42 juju-e4d256-prod-github-runner-207 kernel: [63596.571221] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 23:03:42 juju-e4d256-prod-github-runner-207 kernel: [63596.572438] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 23:03:42 juju-e4d256-prod-github-runner-207 kernel: [63596.573833] Call Trace: Aug 22 23:03:42 juju-e4d256-prod-github-runner-207 kernel: [63596.574807] Aug 22 23:03:42 juju-e4d256-prod-github-runner-207 kernel: [63596.575754] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:03:42 juju-e4d256-prod-github-runner-207 kernel: [63596.576902] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:03:42 juju-e4d256-prod-github-runner-207 kernel: [63596.578027] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:03:42 juju-e4d256-prod-github-runner-207 kernel: [63596.579251] ? show_regs.part.0+0x23/0x29 Aug 22 23:03:42 juju-e4d256-prod-github-runner-207 kernel: [63596.580329] ? show_regs.cold+0x8/0xd Aug 22 23:03:42 juju-e4d256-prod-github-runner-207 kernel: [63596.581406] ? watchdog_timer_fn+0x1be/0x220 Aug 22 23:03:42 juju-e4d256-prod-github-runner-207 kernel: [63596.582518] ? lockup_detector_update_enable+0x60/0x60 Aug 22 23:03:42 juju-e4d256-prod-github-runner-207 kernel: [63596.583687] ? __hrtimer_run_queues+0x107/0x230 Aug 22 23:03:42 juju-e4d256-prod-github-runner-207 kernel: [63596.584888] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 23:03:42 juju-e4d256-prod-github-runner-207 kernel: [63596.586035] ? hrtimer_interrupt+0x101/0x220 Aug 22 23:03:42 juju-e4d256-prod-github-runner-207 kernel: [63596.587157] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 23:03:42 juju-e4d256-prod-github-runner-207 kernel: [63596.588365] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 23:03:42 juju-e4d256-prod-github-runner-207 kernel: [63596.589547] Aug 22 23:03:42 juju-e4d256-prod-github-runner-207 kernel: [63596.590508] Aug 22 23:03:42 juju-e4d256-prod-github-runner-207 kernel: [63596.591445] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 23:03:42 juju-e4d256-prod-github-runner-207 kernel: [63596.592716] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:03:42 juju-e4d256-prod-github-runner-207 kernel: [63596.593822] ? _raw_spin_lock+0x22/0x30 Aug 22 23:03:42 juju-e4d256-prod-github-runner-207 kernel: [63596.594773] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:03:42 juju-e4d256-prod-github-runner-207 kernel: [63596.595931] direct_page_fault+0x206/0x310 [kvm] Aug 22 23:03:42 juju-e4d256-prod-github-runner-207 kernel: [63596.597295] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 23:03:42 juju-e4d256-prod-github-runner-207 kernel: [63596.598311] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 23:03:42 juju-e4d256-prod-github-runner-207 kernel: [63596.599319] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 23:03:42 juju-e4d256-prod-github-runner-207 kernel: [63596.600321] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 23:03:42 juju-e4d256-prod-github-runner-207 kernel: [63596.601287] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 23:03:42 juju-e4d256-prod-github-runner-207 kernel: [63596.602268] handle_exit+0x98/0x230 [kvm_amd] Aug 22 23:03:42 juju-e4d256-prod-github-runner-207 kernel: [63596.603167] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 23:03:42 juju-e4d256-prod-github-runner-207 kernel: [63596.604093] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 23:03:42 juju-e4d256-prod-github-runner-207 kernel: [63596.605031] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 23:03:42 juju-e4d256-prod-github-runner-207 kernel: [63596.605947] vcpu_run+0x62/0x2c0 [kvm] Aug 22 23:03:42 juju-e4d256-prod-github-runner-207 kernel: [63596.606764] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 23:03:42 juju-e4d256-prod-github-runner-207 kernel: [63596.607577] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 23:03:42 juju-e4d256-prod-github-runner-207 kernel: [63596.608432] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 23:03:42 juju-e4d256-prod-github-runner-207 kernel: [63596.609248] ? __seccomp_filter+0x4a/0x4a0 Aug 22 23:03:42 juju-e4d256-prod-github-runner-207 kernel: [63596.610018] ? __fget_files+0x86/0xc0 Aug 22 23:03:42 juju-e4d256-prod-github-runner-207 kernel: [63596.610771] __x64_sys_ioctl+0x95/0xd0 Aug 22 23:03:42 juju-e4d256-prod-github-runner-207 kernel: [63596.611471] do_syscall_64+0x5c/0xc0 Aug 22 23:03:42 juju-e4d256-prod-github-runner-207 kernel: [63596.612140] ? do_futex+0x162/0x1f0 Aug 22 23:03:42 juju-e4d256-prod-github-runner-207 kernel: [63596.612830] ? __x64_sys_futex+0x78/0x1e0 Aug 22 23:03:42 juju-e4d256-prod-github-runner-207 kernel: [63596.613508] ? __secure_computing+0xa9/0x120 Aug 22 23:03:42 juju-e4d256-prod-github-runner-207 kernel: [63596.614200] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 23:03:42 juju-e4d256-prod-github-runner-207 kernel: [63596.614966] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:03:42 juju-e4d256-prod-github-runner-207 kernel: [63596.615694] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:03:42 juju-e4d256-prod-github-runner-207 kernel: [63596.616448] ? do_syscall_64+0x69/0xc0 Aug 22 23:03:42 juju-e4d256-prod-github-runner-207 kernel: [63596.617112] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:03:42 juju-e4d256-prod-github-runner-207 kernel: [63596.617820] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:03:42 juju-e4d256-prod-github-runner-207 kernel: [63596.618514] ? do_syscall_64+0x69/0xc0 Aug 22 23:03:42 juju-e4d256-prod-github-runner-207 kernel: [63596.619144] ? do_syscall_64+0x69/0xc0 Aug 22 23:03:42 juju-e4d256-prod-github-runner-207 kernel: [63596.619765] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 23:03:42 juju-e4d256-prod-github-runner-207 kernel: [63596.620470] RIP: 0033:0x7faa5d0edaff Aug 22 23:03:42 juju-e4d256-prod-github-runner-207 kernel: [63596.621142] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 23:03:42 juju-e4d256-prod-github-runner-207 kernel: [63596.623350] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 23:03:42 juju-e4d256-prod-github-runner-207 kernel: [63596.624279] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 23:03:42 juju-e4d256-prod-github-runner-207 kernel: [63596.625188] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 23:03:42 juju-e4d256-prod-github-runner-207 kernel: [63596.626078] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 23:03:42 juju-e4d256-prod-github-runner-207 kernel: [63596.626963] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 23:03:42 juju-e4d256-prod-github-runner-207 kernel: [63596.627849] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 23:03:42 juju-e4d256-prod-github-runner-207 kernel: [63596.628744] Aug 22 23:04:10 juju-e4d256-prod-github-runner-207 kernel: [63624.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 59146s! [qemu-system-x86:6715] Aug 22 23:04:10 juju-e4d256-prod-github-runner-207 kernel: [63624.543113] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 23:04:10 juju-e4d256-prod-github-runner-207 kernel: [63624.543187] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 23:04:10 juju-e4d256-prod-github-runner-207 kernel: [63624.555325] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 23:04:10 juju-e4d256-prod-github-runner-207 kernel: [63624.556609] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 23:04:10 juju-e4d256-prod-github-runner-207 kernel: [63624.557830] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:04:10 juju-e4d256-prod-github-runner-207 kernel: [63624.558888] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 23:04:10 juju-e4d256-prod-github-runner-207 kernel: [63624.561484] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 23:04:10 juju-e4d256-prod-github-runner-207 kernel: [63624.562541] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 23:04:10 juju-e4d256-prod-github-runner-207 kernel: [63624.563714] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 23:04:10 juju-e4d256-prod-github-runner-207 kernel: [63624.564944] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 23:04:10 juju-e4d256-prod-github-runner-207 kernel: [63624.566138] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 23:04:10 juju-e4d256-prod-github-runner-207 kernel: [63624.567313] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 23:04:10 juju-e4d256-prod-github-runner-207 kernel: [63624.568549] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 23:04:10 juju-e4d256-prod-github-runner-207 kernel: [63624.569791] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 23:04:10 juju-e4d256-prod-github-runner-207 kernel: [63624.570893] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 23:04:10 juju-e4d256-prod-github-runner-207 kernel: [63624.572113] Call Trace: Aug 22 23:04:10 juju-e4d256-prod-github-runner-207 kernel: [63624.573070] Aug 22 23:04:10 juju-e4d256-prod-github-runner-207 kernel: [63624.574088] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:04:10 juju-e4d256-prod-github-runner-207 kernel: [63624.575129] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:04:10 juju-e4d256-prod-github-runner-207 kernel: [63624.576153] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:04:10 juju-e4d256-prod-github-runner-207 kernel: [63624.577248] ? show_regs.part.0+0x23/0x29 Aug 22 23:04:10 juju-e4d256-prod-github-runner-207 kernel: [63624.578252] ? show_regs.cold+0x8/0xd Aug 22 23:04:10 juju-e4d256-prod-github-runner-207 kernel: [63624.579224] ? watchdog_timer_fn+0x1be/0x220 Aug 22 23:04:10 juju-e4d256-prod-github-runner-207 kernel: [63624.580262] ? lockup_detector_update_enable+0x60/0x60 Aug 22 23:04:10 juju-e4d256-prod-github-runner-207 kernel: [63624.581343] ? __hrtimer_run_queues+0x107/0x230 Aug 22 23:04:10 juju-e4d256-prod-github-runner-207 kernel: [63624.582382] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 23:04:10 juju-e4d256-prod-github-runner-207 kernel: [63624.583424] ? hrtimer_interrupt+0x101/0x220 Aug 22 23:04:10 juju-e4d256-prod-github-runner-207 kernel: [63624.584494] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 23:04:10 juju-e4d256-prod-github-runner-207 kernel: [63624.585580] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 23:04:10 juju-e4d256-prod-github-runner-207 kernel: [63624.586635] Aug 22 23:04:10 juju-e4d256-prod-github-runner-207 kernel: [63624.587499] Aug 22 23:04:10 juju-e4d256-prod-github-runner-207 kernel: [63624.588435] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 23:04:10 juju-e4d256-prod-github-runner-207 kernel: [63624.589479] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:04:10 juju-e4d256-prod-github-runner-207 kernel: [63624.590523] ? _raw_spin_lock+0x22/0x30 Aug 22 23:04:10 juju-e4d256-prod-github-runner-207 kernel: [63624.591468] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:04:10 juju-e4d256-prod-github-runner-207 kernel: [63624.592503] direct_page_fault+0x206/0x310 [kvm] Aug 22 23:04:10 juju-e4d256-prod-github-runner-207 kernel: [63624.593533] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 23:04:10 juju-e4d256-prod-github-runner-207 kernel: [63624.594546] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 23:04:10 juju-e4d256-prod-github-runner-207 kernel: [63624.595548] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 23:04:10 juju-e4d256-prod-github-runner-207 kernel: [63624.596536] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 23:04:10 juju-e4d256-prod-github-runner-207 kernel: [63624.597481] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 23:04:10 juju-e4d256-prod-github-runner-207 kernel: [63624.598464] handle_exit+0x98/0x230 [kvm_amd] Aug 22 23:04:10 juju-e4d256-prod-github-runner-207 kernel: [63624.599357] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 23:04:10 juju-e4d256-prod-github-runner-207 kernel: [63624.600271] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 23:04:10 juju-e4d256-prod-github-runner-207 kernel: [63624.601204] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 23:04:10 juju-e4d256-prod-github-runner-207 kernel: [63624.602106] vcpu_run+0x62/0x2c0 [kvm] Aug 22 23:04:10 juju-e4d256-prod-github-runner-207 kernel: [63624.602916] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 23:04:10 juju-e4d256-prod-github-runner-207 kernel: [63624.603727] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 23:04:10 juju-e4d256-prod-github-runner-207 kernel: [63624.604597] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 23:04:10 juju-e4d256-prod-github-runner-207 kernel: [63624.605395] ? __seccomp_filter+0x4a/0x4a0 Aug 22 23:04:10 juju-e4d256-prod-github-runner-207 kernel: [63624.606139] ? __fget_files+0x86/0xc0 Aug 22 23:04:10 juju-e4d256-prod-github-runner-207 kernel: [63624.606840] __x64_sys_ioctl+0x95/0xd0 Aug 22 23:04:10 juju-e4d256-prod-github-runner-207 kernel: [63624.607534] do_syscall_64+0x5c/0xc0 Aug 22 23:04:10 juju-e4d256-prod-github-runner-207 kernel: [63624.608223] ? do_futex+0x162/0x1f0 Aug 22 23:04:10 juju-e4d256-prod-github-runner-207 kernel: [63624.608892] ? __x64_sys_futex+0x78/0x1e0 Aug 22 23:04:10 juju-e4d256-prod-github-runner-207 kernel: [63624.609571] ? __secure_computing+0xa9/0x120 Aug 22 23:04:10 juju-e4d256-prod-github-runner-207 kernel: [63624.610259] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 23:04:10 juju-e4d256-prod-github-runner-207 kernel: [63624.611040] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:04:10 juju-e4d256-prod-github-runner-207 kernel: [63624.611760] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:04:10 juju-e4d256-prod-github-runner-207 kernel: [63624.612488] ? do_syscall_64+0x69/0xc0 Aug 22 23:04:10 juju-e4d256-prod-github-runner-207 kernel: [63624.613138] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:04:10 juju-e4d256-prod-github-runner-207 kernel: [63624.613852] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:04:10 juju-e4d256-prod-github-runner-207 kernel: [63624.614545] ? do_syscall_64+0x69/0xc0 Aug 22 23:04:10 juju-e4d256-prod-github-runner-207 kernel: [63624.615167] ? do_syscall_64+0x69/0xc0 Aug 22 23:04:10 juju-e4d256-prod-github-runner-207 kernel: [63624.615789] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 23:04:10 juju-e4d256-prod-github-runner-207 kernel: [63624.616500] RIP: 0033:0x7faa5d0edaff Aug 22 23:04:10 juju-e4d256-prod-github-runner-207 kernel: [63624.617124] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 23:04:10 juju-e4d256-prod-github-runner-207 kernel: [63624.619107] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 23:04:10 juju-e4d256-prod-github-runner-207 kernel: [63624.620015] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 23:04:10 juju-e4d256-prod-github-runner-207 kernel: [63624.620915] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 23:04:10 juju-e4d256-prod-github-runner-207 kernel: [63624.621799] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 23:04:10 juju-e4d256-prod-github-runner-207 kernel: [63624.622683] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 23:04:10 juju-e4d256-prod-github-runner-207 kernel: [63624.623572] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 23:04:10 juju-e4d256-prod-github-runner-207 kernel: [63624.624474] Aug 22 23:04:38 juju-e4d256-prod-github-runner-207 kernel: [63652.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 59173s! [qemu-system-x86:6715] Aug 22 23:04:38 juju-e4d256-prod-github-runner-207 kernel: [63652.543901] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 23:04:38 juju-e4d256-prod-github-runner-207 kernel: [63652.544256] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 23:04:38 juju-e4d256-prod-github-runner-207 kernel: [63652.556425] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 23:04:38 juju-e4d256-prod-github-runner-207 kernel: [63652.557693] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 23:04:38 juju-e4d256-prod-github-runner-207 kernel: [63652.558924] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:04:38 juju-e4d256-prod-github-runner-207 kernel: [63652.560032] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 23:04:38 juju-e4d256-prod-github-runner-207 kernel: [63652.562612] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 23:04:38 juju-e4d256-prod-github-runner-207 kernel: [63652.563670] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 23:04:38 juju-e4d256-prod-github-runner-207 kernel: [63652.564856] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 23:04:38 juju-e4d256-prod-github-runner-207 kernel: [63652.566016] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 23:04:38 juju-e4d256-prod-github-runner-207 kernel: [63652.567187] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 23:04:38 juju-e4d256-prod-github-runner-207 kernel: [63652.568387] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 23:04:38 juju-e4d256-prod-github-runner-207 kernel: [63652.569570] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 23:04:38 juju-e4d256-prod-github-runner-207 kernel: [63652.570806] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 23:04:38 juju-e4d256-prod-github-runner-207 kernel: [63652.571905] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 23:04:38 juju-e4d256-prod-github-runner-207 kernel: [63652.573110] Call Trace: Aug 22 23:04:38 juju-e4d256-prod-github-runner-207 kernel: [63652.574020] Aug 22 23:04:38 juju-e4d256-prod-github-runner-207 kernel: [63652.574939] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:04:38 juju-e4d256-prod-github-runner-207 kernel: [63652.576002] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:04:38 juju-e4d256-prod-github-runner-207 kernel: [63652.577058] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:04:38 juju-e4d256-prod-github-runner-207 kernel: [63652.578150] ? show_regs.part.0+0x23/0x29 Aug 22 23:04:38 juju-e4d256-prod-github-runner-207 kernel: [63652.579144] ? show_regs.cold+0x8/0xd Aug 22 23:04:38 juju-e4d256-prod-github-runner-207 kernel: [63652.580122] ? watchdog_timer_fn+0x1be/0x220 Aug 22 23:04:38 juju-e4d256-prod-github-runner-207 kernel: [63652.581127] ? lockup_detector_update_enable+0x60/0x60 Aug 22 23:04:38 juju-e4d256-prod-github-runner-207 kernel: [63652.582187] ? __hrtimer_run_queues+0x107/0x230 Aug 22 23:04:38 juju-e4d256-prod-github-runner-207 kernel: [63652.583211] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 23:04:38 juju-e4d256-prod-github-runner-207 kernel: [63652.584243] ? hrtimer_interrupt+0x101/0x220 Aug 22 23:04:38 juju-e4d256-prod-github-runner-207 kernel: [63652.585255] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 23:04:38 juju-e4d256-prod-github-runner-207 kernel: [63652.586319] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 23:04:38 juju-e4d256-prod-github-runner-207 kernel: [63652.587366] Aug 22 23:04:38 juju-e4d256-prod-github-runner-207 kernel: [63652.588226] Aug 22 23:04:38 juju-e4d256-prod-github-runner-207 kernel: [63652.589061] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 23:04:38 juju-e4d256-prod-github-runner-207 kernel: [63652.590097] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:04:38 juju-e4d256-prod-github-runner-207 kernel: [63652.591133] ? _raw_spin_lock+0x22/0x30 Aug 22 23:04:38 juju-e4d256-prod-github-runner-207 kernel: [63652.592086] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:04:38 juju-e4d256-prod-github-runner-207 kernel: [63652.593258] direct_page_fault+0x206/0x310 [kvm] Aug 22 23:04:38 juju-e4d256-prod-github-runner-207 kernel: [63652.594296] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 23:04:38 juju-e4d256-prod-github-runner-207 kernel: [63652.595307] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 23:04:38 juju-e4d256-prod-github-runner-207 kernel: [63652.596383] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 23:04:38 juju-e4d256-prod-github-runner-207 kernel: [63652.597389] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 23:04:38 juju-e4d256-prod-github-runner-207 kernel: [63652.598333] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 23:04:38 juju-e4d256-prod-github-runner-207 kernel: [63652.599309] handle_exit+0x98/0x230 [kvm_amd] Aug 22 23:04:38 juju-e4d256-prod-github-runner-207 kernel: [63652.600212] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 23:04:38 juju-e4d256-prod-github-runner-207 kernel: [63652.601125] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 23:04:38 juju-e4d256-prod-github-runner-207 kernel: [63652.602049] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 23:04:38 juju-e4d256-prod-github-runner-207 kernel: [63652.602985] vcpu_run+0x62/0x2c0 [kvm] Aug 22 23:04:38 juju-e4d256-prod-github-runner-207 kernel: [63652.603796] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 23:04:38 juju-e4d256-prod-github-runner-207 kernel: [63652.604620] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 23:04:38 juju-e4d256-prod-github-runner-207 kernel: [63652.605477] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 23:04:38 juju-e4d256-prod-github-runner-207 kernel: [63652.606272] ? __seccomp_filter+0x4a/0x4a0 Aug 22 23:04:38 juju-e4d256-prod-github-runner-207 kernel: [63652.607021] ? __fget_files+0x86/0xc0 Aug 22 23:04:38 juju-e4d256-prod-github-runner-207 kernel: [63652.607740] __x64_sys_ioctl+0x95/0xd0 Aug 22 23:04:38 juju-e4d256-prod-github-runner-207 kernel: [63652.608456] do_syscall_64+0x5c/0xc0 Aug 22 23:04:38 juju-e4d256-prod-github-runner-207 kernel: [63652.609131] ? do_futex+0x162/0x1f0 Aug 22 23:04:38 juju-e4d256-prod-github-runner-207 kernel: [63652.609797] ? __x64_sys_futex+0x78/0x1e0 Aug 22 23:04:38 juju-e4d256-prod-github-runner-207 kernel: [63652.610479] ? __secure_computing+0xa9/0x120 Aug 22 23:04:38 juju-e4d256-prod-github-runner-207 kernel: [63652.611168] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 23:04:38 juju-e4d256-prod-github-runner-207 kernel: [63652.611934] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:04:38 juju-e4d256-prod-github-runner-207 kernel: [63652.612683] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:04:38 juju-e4d256-prod-github-runner-207 kernel: [63652.613407] ? do_syscall_64+0x69/0xc0 Aug 22 23:04:38 juju-e4d256-prod-github-runner-207 kernel: [63652.614053] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:04:38 juju-e4d256-prod-github-runner-207 kernel: [63652.614757] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:04:38 juju-e4d256-prod-github-runner-207 kernel: [63652.615458] ? do_syscall_64+0x69/0xc0 Aug 22 23:04:38 juju-e4d256-prod-github-runner-207 kernel: [63652.616099] ? do_syscall_64+0x69/0xc0 Aug 22 23:04:38 juju-e4d256-prod-github-runner-207 kernel: [63652.616722] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 23:04:38 juju-e4d256-prod-github-runner-207 kernel: [63652.617428] RIP: 0033:0x7faa5d0edaff Aug 22 23:04:38 juju-e4d256-prod-github-runner-207 kernel: [63652.618080] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 23:04:38 juju-e4d256-prod-github-runner-207 kernel: [63652.620088] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 23:04:38 juju-e4d256-prod-github-runner-207 kernel: [63652.621001] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 23:04:38 juju-e4d256-prod-github-runner-207 kernel: [63652.621892] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 23:04:38 juju-e4d256-prod-github-runner-207 kernel: [63652.622782] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 23:04:38 juju-e4d256-prod-github-runner-207 kernel: [63652.623669] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 23:04:38 juju-e4d256-prod-github-runner-207 kernel: [63652.624567] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 23:04:38 juju-e4d256-prod-github-runner-207 kernel: [63652.625462] Aug 22 23:05:06 juju-e4d256-prod-github-runner-207 kernel: [63680.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 59199s! [qemu-system-x86:6715] Aug 22 23:05:06 juju-e4d256-prod-github-runner-207 kernel: [63680.543100] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 23:05:06 juju-e4d256-prod-github-runner-207 kernel: [63680.543172] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 23:05:06 juju-e4d256-prod-github-runner-207 kernel: [63680.555572] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 23:05:06 juju-e4d256-prod-github-runner-207 kernel: [63680.556859] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 23:05:06 juju-e4d256-prod-github-runner-207 kernel: [63680.558195] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:05:06 juju-e4d256-prod-github-runner-207 kernel: [63680.559262] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 23:05:06 juju-e4d256-prod-github-runner-207 kernel: [63680.561852] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 23:05:06 juju-e4d256-prod-github-runner-207 kernel: [63680.562909] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 23:05:06 juju-e4d256-prod-github-runner-207 kernel: [63680.564090] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 23:05:06 juju-e4d256-prod-github-runner-207 kernel: [63680.565262] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 23:05:06 juju-e4d256-prod-github-runner-207 kernel: [63680.566433] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 23:05:06 juju-e4d256-prod-github-runner-207 kernel: [63680.567603] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 23:05:06 juju-e4d256-prod-github-runner-207 kernel: [63680.568909] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 23:05:06 juju-e4d256-prod-github-runner-207 kernel: [63680.570275] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 23:05:06 juju-e4d256-prod-github-runner-207 kernel: [63680.571382] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 23:05:06 juju-e4d256-prod-github-runner-207 kernel: [63680.572677] Call Trace: Aug 22 23:05:06 juju-e4d256-prod-github-runner-207 kernel: [63680.573764] Aug 22 23:05:06 juju-e4d256-prod-github-runner-207 kernel: [63680.574664] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:05:06 juju-e4d256-prod-github-runner-207 kernel: [63680.575693] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:05:06 juju-e4d256-prod-github-runner-207 kernel: [63680.576815] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:05:06 juju-e4d256-prod-github-runner-207 kernel: [63680.577947] ? show_regs.part.0+0x23/0x29 Aug 22 23:05:06 juju-e4d256-prod-github-runner-207 kernel: [63680.578984] ? show_regs.cold+0x8/0xd Aug 22 23:05:06 juju-e4d256-prod-github-runner-207 kernel: [63680.580076] ? watchdog_timer_fn+0x1be/0x220 Aug 22 23:05:06 juju-e4d256-prod-github-runner-207 kernel: [63680.581136] ? lockup_detector_update_enable+0x60/0x60 Aug 22 23:05:06 juju-e4d256-prod-github-runner-207 kernel: [63680.582231] ? __hrtimer_run_queues+0x107/0x230 Aug 22 23:05:06 juju-e4d256-prod-github-runner-207 kernel: [63680.583310] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 23:05:06 juju-e4d256-prod-github-runner-207 kernel: [63680.584398] ? hrtimer_interrupt+0x101/0x220 Aug 22 23:05:06 juju-e4d256-prod-github-runner-207 kernel: [63680.585480] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 23:05:06 juju-e4d256-prod-github-runner-207 kernel: [63680.586613] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 23:05:06 juju-e4d256-prod-github-runner-207 kernel: [63680.587741] Aug 22 23:05:06 juju-e4d256-prod-github-runner-207 kernel: [63680.588631] Aug 22 23:05:06 juju-e4d256-prod-github-runner-207 kernel: [63680.589505] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 23:05:06 juju-e4d256-prod-github-runner-207 kernel: [63680.590585] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:05:06 juju-e4d256-prod-github-runner-207 kernel: [63680.591682] ? _raw_spin_lock+0x22/0x30 Aug 22 23:05:06 juju-e4d256-prod-github-runner-207 kernel: [63680.592688] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:05:06 juju-e4d256-prod-github-runner-207 kernel: [63680.593737] direct_page_fault+0x206/0x310 [kvm] Aug 22 23:05:06 juju-e4d256-prod-github-runner-207 kernel: [63680.594800] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 23:05:06 juju-e4d256-prod-github-runner-207 kernel: [63680.595862] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 23:05:06 juju-e4d256-prod-github-runner-207 kernel: [63680.596912] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 23:05:06 juju-e4d256-prod-github-runner-207 kernel: [63680.597921] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 23:05:06 juju-e4d256-prod-github-runner-207 kernel: [63680.598936] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 23:05:06 juju-e4d256-prod-github-runner-207 kernel: [63680.599998] handle_exit+0x98/0x230 [kvm_amd] Aug 22 23:05:06 juju-e4d256-prod-github-runner-207 kernel: [63680.601000] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 23:05:06 juju-e4d256-prod-github-runner-207 kernel: [63680.601965] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 23:05:06 juju-e4d256-prod-github-runner-207 kernel: [63680.602935] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 23:05:06 juju-e4d256-prod-github-runner-207 kernel: [63680.603917] vcpu_run+0x62/0x2c0 [kvm] Aug 22 23:05:06 juju-e4d256-prod-github-runner-207 kernel: [63680.604750] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 23:05:06 juju-e4d256-prod-github-runner-207 kernel: [63680.605637] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 23:05:06 juju-e4d256-prod-github-runner-207 kernel: [63680.606543] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 23:05:06 juju-e4d256-prod-github-runner-207 kernel: [63680.607350] ? __seccomp_filter+0x4a/0x4a0 Aug 22 23:05:06 juju-e4d256-prod-github-runner-207 kernel: [63680.608116] ? __fget_files+0x86/0xc0 Aug 22 23:05:06 juju-e4d256-prod-github-runner-207 kernel: [63680.608824] __x64_sys_ioctl+0x95/0xd0 Aug 22 23:05:06 juju-e4d256-prod-github-runner-207 kernel: [63680.609544] do_syscall_64+0x5c/0xc0 Aug 22 23:05:06 juju-e4d256-prod-github-runner-207 kernel: [63680.610261] ? do_futex+0x162/0x1f0 Aug 22 23:05:06 juju-e4d256-prod-github-runner-207 kernel: [63680.610918] ? __x64_sys_futex+0x78/0x1e0 Aug 22 23:05:06 juju-e4d256-prod-github-runner-207 kernel: [63680.611593] ? __secure_computing+0xa9/0x120 Aug 22 23:05:06 juju-e4d256-prod-github-runner-207 kernel: [63680.612321] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 23:05:06 juju-e4d256-prod-github-runner-207 kernel: [63680.613102] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:05:06 juju-e4d256-prod-github-runner-207 kernel: [63680.613829] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:05:06 juju-e4d256-prod-github-runner-207 kernel: [63680.614551] ? do_syscall_64+0x69/0xc0 Aug 22 23:05:06 juju-e4d256-prod-github-runner-207 kernel: [63680.615201] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:05:06 juju-e4d256-prod-github-runner-207 kernel: [63680.615979] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:05:06 juju-e4d256-prod-github-runner-207 kernel: [63680.616696] ? do_syscall_64+0x69/0xc0 Aug 22 23:05:06 juju-e4d256-prod-github-runner-207 kernel: [63680.617341] ? do_syscall_64+0x69/0xc0 Aug 22 23:05:06 juju-e4d256-prod-github-runner-207 kernel: [63680.617969] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 23:05:06 juju-e4d256-prod-github-runner-207 kernel: [63680.618679] RIP: 0033:0x7faa5d0edaff Aug 22 23:05:06 juju-e4d256-prod-github-runner-207 kernel: [63680.619329] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 23:05:06 juju-e4d256-prod-github-runner-207 kernel: [63680.621384] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 23:05:06 juju-e4d256-prod-github-runner-207 kernel: [63680.622309] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 23:05:06 juju-e4d256-prod-github-runner-207 kernel: [63680.623200] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 23:05:06 juju-e4d256-prod-github-runner-207 kernel: [63680.624115] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 23:05:06 juju-e4d256-prod-github-runner-207 kernel: [63680.625009] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 23:05:06 juju-e4d256-prod-github-runner-207 kernel: [63680.625908] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 23:05:06 juju-e4d256-prod-github-runner-207 kernel: [63680.626834] Aug 22 23:05:34 juju-e4d256-prod-github-runner-207 kernel: [63708.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 59225s! [qemu-system-x86:6715] Aug 22 23:05:34 juju-e4d256-prod-github-runner-207 kernel: [63708.543113] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 23:05:34 juju-e4d256-prod-github-runner-207 kernel: [63708.543188] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 23:05:34 juju-e4d256-prod-github-runner-207 kernel: [63708.555473] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 23:05:34 juju-e4d256-prod-github-runner-207 kernel: [63708.556746] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 23:05:34 juju-e4d256-prod-github-runner-207 kernel: [63708.557980] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:05:34 juju-e4d256-prod-github-runner-207 kernel: [63708.559246] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 23:05:34 juju-e4d256-prod-github-runner-207 kernel: [63708.561814] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 23:05:34 juju-e4d256-prod-github-runner-207 kernel: [63708.562862] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 23:05:34 juju-e4d256-prod-github-runner-207 kernel: [63708.564043] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 23:05:34 juju-e4d256-prod-github-runner-207 kernel: [63708.565228] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 23:05:34 juju-e4d256-prod-github-runner-207 kernel: [63708.566387] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 23:05:34 juju-e4d256-prod-github-runner-207 kernel: [63708.567651] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 23:05:34 juju-e4d256-prod-github-runner-207 kernel: [63708.568890] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 23:05:34 juju-e4d256-prod-github-runner-207 kernel: [63708.570306] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 23:05:34 juju-e4d256-prod-github-runner-207 kernel: [63708.571445] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 23:05:34 juju-e4d256-prod-github-runner-207 kernel: [63708.572857] Call Trace: Aug 22 23:05:34 juju-e4d256-prod-github-runner-207 kernel: [63708.573776] Aug 22 23:05:34 juju-e4d256-prod-github-runner-207 kernel: [63708.574658] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:05:34 juju-e4d256-prod-github-runner-207 kernel: [63708.575708] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:05:34 juju-e4d256-prod-github-runner-207 kernel: [63708.576732] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:05:34 juju-e4d256-prod-github-runner-207 kernel: [63708.577807] ? show_regs.part.0+0x23/0x29 Aug 22 23:05:34 juju-e4d256-prod-github-runner-207 kernel: [63708.578802] ? show_regs.cold+0x8/0xd Aug 22 23:05:34 juju-e4d256-prod-github-runner-207 kernel: [63708.579784] ? watchdog_timer_fn+0x1be/0x220 Aug 22 23:05:34 juju-e4d256-prod-github-runner-207 kernel: [63708.580792] ? lockup_detector_update_enable+0x60/0x60 Aug 22 23:05:34 juju-e4d256-prod-github-runner-207 kernel: [63708.581855] ? __hrtimer_run_queues+0x107/0x230 Aug 22 23:05:34 juju-e4d256-prod-github-runner-207 kernel: [63708.582995] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 23:05:34 juju-e4d256-prod-github-runner-207 kernel: [63708.584058] ? hrtimer_interrupt+0x101/0x220 Aug 22 23:05:34 juju-e4d256-prod-github-runner-207 kernel: [63708.585076] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 23:05:34 juju-e4d256-prod-github-runner-207 kernel: [63708.586206] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 23:05:34 juju-e4d256-prod-github-runner-207 kernel: [63708.587298] Aug 22 23:05:34 juju-e4d256-prod-github-runner-207 kernel: [63708.588199] Aug 22 23:05:34 juju-e4d256-prod-github-runner-207 kernel: [63708.589054] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 23:05:34 juju-e4d256-prod-github-runner-207 kernel: [63708.590087] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:05:34 juju-e4d256-prod-github-runner-207 kernel: [63708.591140] ? _raw_spin_lock+0x22/0x30 Aug 22 23:05:34 juju-e4d256-prod-github-runner-207 kernel: [63708.592199] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:05:34 juju-e4d256-prod-github-runner-207 kernel: [63708.593275] direct_page_fault+0x206/0x310 [kvm] Aug 22 23:05:34 juju-e4d256-prod-github-runner-207 kernel: [63708.594326] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 23:05:34 juju-e4d256-prod-github-runner-207 kernel: [63708.595347] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 23:05:34 juju-e4d256-prod-github-runner-207 kernel: [63708.596397] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 23:05:34 juju-e4d256-prod-github-runner-207 kernel: [63708.597403] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 23:05:34 juju-e4d256-prod-github-runner-207 kernel: [63708.598392] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 23:05:34 juju-e4d256-prod-github-runner-207 kernel: [63708.599418] handle_exit+0x98/0x230 [kvm_amd] Aug 22 23:05:34 juju-e4d256-prod-github-runner-207 kernel: [63708.600321] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 23:05:34 juju-e4d256-prod-github-runner-207 kernel: [63708.601244] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 23:05:34 juju-e4d256-prod-github-runner-207 kernel: [63708.602202] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 23:05:34 juju-e4d256-prod-github-runner-207 kernel: [63708.603150] vcpu_run+0x62/0x2c0 [kvm] Aug 22 23:05:34 juju-e4d256-prod-github-runner-207 kernel: [63708.603997] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 23:05:34 juju-e4d256-prod-github-runner-207 kernel: [63708.604829] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 23:05:34 juju-e4d256-prod-github-runner-207 kernel: [63708.605692] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 23:05:34 juju-e4d256-prod-github-runner-207 kernel: [63708.606509] ? __seccomp_filter+0x4a/0x4a0 Aug 22 23:05:34 juju-e4d256-prod-github-runner-207 kernel: [63708.607267] ? __fget_files+0x86/0xc0 Aug 22 23:05:34 juju-e4d256-prod-github-runner-207 kernel: [63708.608007] __x64_sys_ioctl+0x95/0xd0 Aug 22 23:05:34 juju-e4d256-prod-github-runner-207 kernel: [63708.608732] do_syscall_64+0x5c/0xc0 Aug 22 23:05:34 juju-e4d256-prod-github-runner-207 kernel: [63708.609432] ? do_futex+0x162/0x1f0 Aug 22 23:05:34 juju-e4d256-prod-github-runner-207 kernel: [63708.610181] ? __x64_sys_futex+0x78/0x1e0 Aug 22 23:05:34 juju-e4d256-prod-github-runner-207 kernel: [63708.610927] ? __secure_computing+0xa9/0x120 Aug 22 23:05:34 juju-e4d256-prod-github-runner-207 kernel: [63708.611685] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 23:05:34 juju-e4d256-prod-github-runner-207 kernel: [63708.612648] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:05:34 juju-e4d256-prod-github-runner-207 kernel: [63708.613405] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:05:34 juju-e4d256-prod-github-runner-207 kernel: [63708.614155] ? do_syscall_64+0x69/0xc0 Aug 22 23:05:34 juju-e4d256-prod-github-runner-207 kernel: [63708.614814] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:05:34 juju-e4d256-prod-github-runner-207 kernel: [63708.615586] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:05:34 juju-e4d256-prod-github-runner-207 kernel: [63708.616298] ? do_syscall_64+0x69/0xc0 Aug 22 23:05:34 juju-e4d256-prod-github-runner-207 kernel: [63708.616951] ? do_syscall_64+0x69/0xc0 Aug 22 23:05:34 juju-e4d256-prod-github-runner-207 kernel: [63708.617612] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 23:05:34 juju-e4d256-prod-github-runner-207 kernel: [63708.618344] RIP: 0033:0x7faa5d0edaff Aug 22 23:05:34 juju-e4d256-prod-github-runner-207 kernel: [63708.618998] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 23:05:34 juju-e4d256-prod-github-runner-207 kernel: [63708.621074] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 23:05:34 juju-e4d256-prod-github-runner-207 kernel: [63708.622024] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 23:05:34 juju-e4d256-prod-github-runner-207 kernel: [63708.622983] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 23:05:34 juju-e4d256-prod-github-runner-207 kernel: [63708.623926] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 23:05:34 juju-e4d256-prod-github-runner-207 kernel: [63708.624829] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 23:05:34 juju-e4d256-prod-github-runner-207 kernel: [63708.625726] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 23:05:34 juju-e4d256-prod-github-runner-207 kernel: [63708.626671] Aug 22 23:05:47 juju-e4d256-prod-github-runner-207 kernel: [63721.436707] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 23:05:47 juju-e4d256-prod-github-runner-207 kernel: [63721.437770] rcu: 1-....: (15850940 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=7653413 Aug 22 23:05:47 juju-e4d256-prod-github-runner-207 kernel: [63721.439005] (t=15901059 jiffies g=23269 q=56269) Aug 22 23:05:47 juju-e4d256-prod-github-runner-207 kernel: [63721.439871] NMI backtrace for cpu 1 Aug 22 23:05:47 juju-e4d256-prod-github-runner-207 kernel: [63721.440632] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 23:05:47 juju-e4d256-prod-github-runner-207 kernel: [63721.441804] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 23:05:47 juju-e4d256-prod-github-runner-207 kernel: [63721.442884] Call Trace: Aug 22 23:05:47 juju-e4d256-prod-github-runner-207 kernel: [63721.443584] Aug 22 23:05:47 juju-e4d256-prod-github-runner-207 kernel: [63721.444237] show_stack+0x52/0x5c Aug 22 23:05:47 juju-e4d256-prod-github-runner-207 kernel: [63721.444979] dump_stack_lvl+0x4a/0x63 Aug 22 23:05:47 juju-e4d256-prod-github-runner-207 kernel: [63721.445734] dump_stack+0x10/0x16 Aug 22 23:05:47 juju-e4d256-prod-github-runner-207 kernel: [63721.446467] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 23:05:47 juju-e4d256-prod-github-runner-207 kernel: [63721.447300] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 23:05:47 juju-e4d256-prod-github-runner-207 kernel: [63721.448092] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 23:05:47 juju-e4d256-prod-github-runner-207 kernel: [63721.449012] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 23:05:47 juju-e4d256-prod-github-runner-207 kernel: [63721.449872] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 23:05:47 juju-e4d256-prod-github-runner-207 kernel: [63721.450723] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 23:05:47 juju-e4d256-prod-github-runner-207 kernel: [63721.451623] print_cpu_stall.cold+0x2f/0xe2 Aug 22 23:05:47 juju-e4d256-prod-github-runner-207 kernel: [63721.452398] ? timekeeping_update+0xf7/0x150 Aug 22 23:05:47 juju-e4d256-prod-github-runner-207 kernel: [63721.453200] check_cpu_stall+0x109/0x270 Aug 22 23:05:47 juju-e4d256-prod-github-runner-207 kernel: [63721.454046] rcu_sched_clock_irq+0x9a/0x250 Aug 22 23:05:47 juju-e4d256-prod-github-runner-207 kernel: [63721.455052] update_process_times+0x94/0xd0 Aug 22 23:05:47 juju-e4d256-prod-github-runner-207 kernel: [63721.456118] tick_sched_handle+0x29/0x70 Aug 22 23:05:47 juju-e4d256-prod-github-runner-207 kernel: [63721.457113] tick_sched_timer+0x8c/0xc0 Aug 22 23:05:47 juju-e4d256-prod-github-runner-207 kernel: [63721.457921] ? tick_nohz_handler+0xb0/0xb0 Aug 22 23:05:47 juju-e4d256-prod-github-runner-207 kernel: [63721.458777] __hrtimer_run_queues+0x107/0x230 Aug 22 23:05:47 juju-e4d256-prod-github-runner-207 kernel: [63721.459650] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 23:05:47 juju-e4d256-prod-github-runner-207 kernel: [63721.460489] hrtimer_interrupt+0x101/0x220 Aug 22 23:05:47 juju-e4d256-prod-github-runner-207 kernel: [63721.461303] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 23:05:47 juju-e4d256-prod-github-runner-207 kernel: [63721.462195] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 23:05:47 juju-e4d256-prod-github-runner-207 kernel: [63721.463104] Aug 22 23:05:47 juju-e4d256-prod-github-runner-207 kernel: [63721.463763] Aug 22 23:05:47 juju-e4d256-prod-github-runner-207 kernel: [63721.464401] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 23:05:47 juju-e4d256-prod-github-runner-207 kernel: [63721.465320] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:05:47 juju-e4d256-prod-github-runner-207 kernel: [63721.466308] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 23:05:47 juju-e4d256-prod-github-runner-207 kernel: [63721.468807] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 23:05:47 juju-e4d256-prod-github-runner-207 kernel: [63721.469711] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 23:05:47 juju-e4d256-prod-github-runner-207 kernel: [63721.470827] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 23:05:47 juju-e4d256-prod-github-runner-207 kernel: [63721.471923] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 23:05:47 juju-e4d256-prod-github-runner-207 kernel: [63721.472975] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 23:05:47 juju-e4d256-prod-github-runner-207 kernel: [63721.474084] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 23:05:47 juju-e4d256-prod-github-runner-207 kernel: [63721.475198] ? _raw_spin_lock+0x22/0x30 Aug 22 23:05:47 juju-e4d256-prod-github-runner-207 kernel: [63721.476055] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:05:47 juju-e4d256-prod-github-runner-207 kernel: [63721.476944] direct_page_fault+0x206/0x310 [kvm] Aug 22 23:05:47 juju-e4d256-prod-github-runner-207 kernel: [63721.477806] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 23:05:47 juju-e4d256-prod-github-runner-207 kernel: [63721.478688] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 23:05:47 juju-e4d256-prod-github-runner-207 kernel: [63721.479593] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 23:05:47 juju-e4d256-prod-github-runner-207 kernel: [63721.480621] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 23:05:47 juju-e4d256-prod-github-runner-207 kernel: [63721.481492] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 23:05:47 juju-e4d256-prod-github-runner-207 kernel: [63721.482424] handle_exit+0x98/0x230 [kvm_amd] Aug 22 23:05:47 juju-e4d256-prod-github-runner-207 kernel: [63721.483241] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 23:05:47 juju-e4d256-prod-github-runner-207 kernel: [63721.484082] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 23:05:47 juju-e4d256-prod-github-runner-207 kernel: [63721.484971] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 23:05:47 juju-e4d256-prod-github-runner-207 kernel: [63721.485790] vcpu_run+0x62/0x2c0 [kvm] Aug 22 23:05:47 juju-e4d256-prod-github-runner-207 kernel: [63721.486538] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 23:05:47 juju-e4d256-prod-github-runner-207 kernel: [63721.487312] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 23:05:47 juju-e4d256-prod-github-runner-207 kernel: [63721.488133] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 23:05:47 juju-e4d256-prod-github-runner-207 kernel: [63721.488911] ? __seccomp_filter+0x4a/0x4a0 Aug 22 23:05:47 juju-e4d256-prod-github-runner-207 kernel: [63721.489642] ? __fget_files+0x86/0xc0 Aug 22 23:05:47 juju-e4d256-prod-github-runner-207 kernel: [63721.490347] __x64_sys_ioctl+0x95/0xd0 Aug 22 23:05:47 juju-e4d256-prod-github-runner-207 kernel: [63721.491058] do_syscall_64+0x5c/0xc0 Aug 22 23:05:47 juju-e4d256-prod-github-runner-207 kernel: [63721.491771] ? do_futex+0x162/0x1f0 Aug 22 23:05:47 juju-e4d256-prod-github-runner-207 kernel: [63721.492454] ? __x64_sys_futex+0x78/0x1e0 Aug 22 23:05:47 juju-e4d256-prod-github-runner-207 kernel: [63721.493167] ? __secure_computing+0xa9/0x120 Aug 22 23:05:47 juju-e4d256-prod-github-runner-207 kernel: [63721.493917] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 23:05:47 juju-e4d256-prod-github-runner-207 kernel: [63721.494758] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:05:47 juju-e4d256-prod-github-runner-207 kernel: [63721.495623] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:05:47 juju-e4d256-prod-github-runner-207 kernel: [63721.496495] ? do_syscall_64+0x69/0xc0 Aug 22 23:05:47 juju-e4d256-prod-github-runner-207 kernel: [63721.497273] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:05:47 juju-e4d256-prod-github-runner-207 kernel: [63721.498146] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:05:47 juju-e4d256-prod-github-runner-207 kernel: [63721.499114] ? do_syscall_64+0x69/0xc0 Aug 22 23:05:47 juju-e4d256-prod-github-runner-207 kernel: [63721.499876] ? do_syscall_64+0x69/0xc0 Aug 22 23:05:47 juju-e4d256-prod-github-runner-207 kernel: [63721.500611] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 23:05:47 juju-e4d256-prod-github-runner-207 kernel: [63721.501496] RIP: 0033:0x7faa5d0edaff Aug 22 23:05:47 juju-e4d256-prod-github-runner-207 kernel: [63721.502310] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 23:05:47 juju-e4d256-prod-github-runner-207 kernel: [63721.504533] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 23:05:47 juju-e4d256-prod-github-runner-207 kernel: [63721.505556] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 23:05:47 juju-e4d256-prod-github-runner-207 kernel: [63721.506580] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 23:05:47 juju-e4d256-prod-github-runner-207 kernel: [63721.507679] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 23:05:47 juju-e4d256-prod-github-runner-207 kernel: [63721.508643] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 23:05:47 juju-e4d256-prod-github-runner-207 kernel: [63721.509591] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 23:05:47 juju-e4d256-prod-github-runner-207 kernel: [63721.510529] Aug 22 23:06:14 juju-e4d256-prod-github-runner-207 kernel: [63748.541981] watchdog: BUG: soft lockup - CPU#1 stuck for 59262s! [qemu-system-x86:6715] Aug 22 23:06:14 juju-e4d256-prod-github-runner-207 kernel: [63748.543925] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 23:06:14 juju-e4d256-prod-github-runner-207 kernel: [63748.544247] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 23:06:14 juju-e4d256-prod-github-runner-207 kernel: [63748.556756] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 23:06:14 juju-e4d256-prod-github-runner-207 kernel: [63748.558042] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 23:06:14 juju-e4d256-prod-github-runner-207 kernel: [63748.559277] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:06:14 juju-e4d256-prod-github-runner-207 kernel: [63748.560346] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 23:06:14 juju-e4d256-prod-github-runner-207 kernel: [63748.562936] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 23:06:14 juju-e4d256-prod-github-runner-207 kernel: [63748.564010] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 23:06:14 juju-e4d256-prod-github-runner-207 kernel: [63748.565173] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 23:06:14 juju-e4d256-prod-github-runner-207 kernel: [63748.566334] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 23:06:14 juju-e4d256-prod-github-runner-207 kernel: [63748.567551] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 23:06:14 juju-e4d256-prod-github-runner-207 kernel: [63748.568736] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 23:06:14 juju-e4d256-prod-github-runner-207 kernel: [63748.569920] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 23:06:14 juju-e4d256-prod-github-runner-207 kernel: [63748.571205] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 23:06:14 juju-e4d256-prod-github-runner-207 kernel: [63748.572336] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 23:06:14 juju-e4d256-prod-github-runner-207 kernel: [63748.573550] Call Trace: Aug 22 23:06:14 juju-e4d256-prod-github-runner-207 kernel: [63748.574471] Aug 22 23:06:14 juju-e4d256-prod-github-runner-207 kernel: [63748.575399] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:06:14 juju-e4d256-prod-github-runner-207 kernel: [63748.576436] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:06:14 juju-e4d256-prod-github-runner-207 kernel: [63748.577481] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:06:14 juju-e4d256-prod-github-runner-207 kernel: [63748.578593] ? show_regs.part.0+0x23/0x29 Aug 22 23:06:14 juju-e4d256-prod-github-runner-207 kernel: [63748.579639] ? show_regs.cold+0x8/0xd Aug 22 23:06:14 juju-e4d256-prod-github-runner-207 kernel: [63748.580624] ? watchdog_timer_fn+0x1be/0x220 Aug 22 23:06:14 juju-e4d256-prod-github-runner-207 kernel: [63748.581642] ? lockup_detector_update_enable+0x60/0x60 Aug 22 23:06:14 juju-e4d256-prod-github-runner-207 kernel: [63748.582763] ? __hrtimer_run_queues+0x107/0x230 Aug 22 23:06:14 juju-e4d256-prod-github-runner-207 kernel: [63748.583845] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 23:06:14 juju-e4d256-prod-github-runner-207 kernel: [63748.584877] ? hrtimer_interrupt+0x101/0x220 Aug 22 23:06:14 juju-e4d256-prod-github-runner-207 kernel: [63748.585900] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 23:06:14 juju-e4d256-prod-github-runner-207 kernel: [63748.587006] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 23:06:14 juju-e4d256-prod-github-runner-207 kernel: [63748.588093] Aug 22 23:06:14 juju-e4d256-prod-github-runner-207 kernel: [63748.588962] Aug 22 23:06:14 juju-e4d256-prod-github-runner-207 kernel: [63748.589808] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 23:06:14 juju-e4d256-prod-github-runner-207 kernel: [63748.590859] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:06:14 juju-e4d256-prod-github-runner-207 kernel: [63748.591935] ? _raw_spin_lock+0x22/0x30 Aug 22 23:06:14 juju-e4d256-prod-github-runner-207 kernel: [63748.592912] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:06:14 juju-e4d256-prod-github-runner-207 kernel: [63748.593948] direct_page_fault+0x206/0x310 [kvm] Aug 22 23:06:14 juju-e4d256-prod-github-runner-207 kernel: [63748.595028] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 23:06:14 juju-e4d256-prod-github-runner-207 kernel: [63748.596040] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 23:06:14 juju-e4d256-prod-github-runner-207 kernel: [63748.597050] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 23:06:14 juju-e4d256-prod-github-runner-207 kernel: [63748.598080] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 23:06:14 juju-e4d256-prod-github-runner-207 kernel: [63748.599095] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 23:06:14 juju-e4d256-prod-github-runner-207 kernel: [63748.600138] handle_exit+0x98/0x230 [kvm_amd] Aug 22 23:06:14 juju-e4d256-prod-github-runner-207 kernel: [63748.601044] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 23:06:14 juju-e4d256-prod-github-runner-207 kernel: [63748.601970] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 23:06:14 juju-e4d256-prod-github-runner-207 kernel: [63748.602919] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 23:06:14 juju-e4d256-prod-github-runner-207 kernel: [63748.603853] vcpu_run+0x62/0x2c0 [kvm] Aug 22 23:06:14 juju-e4d256-prod-github-runner-207 kernel: [63748.604670] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 23:06:14 juju-e4d256-prod-github-runner-207 kernel: [63748.605481] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 23:06:14 juju-e4d256-prod-github-runner-207 kernel: [63748.606335] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 23:06:14 juju-e4d256-prod-github-runner-207 kernel: [63748.607192] ? __seccomp_filter+0x4a/0x4a0 Aug 22 23:06:14 juju-e4d256-prod-github-runner-207 kernel: [63748.607938] ? __fget_files+0x86/0xc0 Aug 22 23:06:14 juju-e4d256-prod-github-runner-207 kernel: [63748.608669] __x64_sys_ioctl+0x95/0xd0 Aug 22 23:06:14 juju-e4d256-prod-github-runner-207 kernel: [63748.609369] do_syscall_64+0x5c/0xc0 Aug 22 23:06:14 juju-e4d256-prod-github-runner-207 kernel: [63748.610049] ? do_futex+0x162/0x1f0 Aug 22 23:06:14 juju-e4d256-prod-github-runner-207 kernel: [63748.610697] ? __x64_sys_futex+0x78/0x1e0 Aug 22 23:06:14 juju-e4d256-prod-github-runner-207 kernel: [63748.611390] ? __secure_computing+0xa9/0x120 Aug 22 23:06:14 juju-e4d256-prod-github-runner-207 kernel: [63748.612077] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 23:06:14 juju-e4d256-prod-github-runner-207 kernel: [63748.612838] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:06:14 juju-e4d256-prod-github-runner-207 kernel: [63748.613568] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:06:14 juju-e4d256-prod-github-runner-207 kernel: [63748.614293] ? do_syscall_64+0x69/0xc0 Aug 22 23:06:14 juju-e4d256-prod-github-runner-207 kernel: [63748.614962] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:06:14 juju-e4d256-prod-github-runner-207 kernel: [63748.615671] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:06:14 juju-e4d256-prod-github-runner-207 kernel: [63748.616362] ? do_syscall_64+0x69/0xc0 Aug 22 23:06:14 juju-e4d256-prod-github-runner-207 kernel: [63748.616988] ? do_syscall_64+0x69/0xc0 Aug 22 23:06:14 juju-e4d256-prod-github-runner-207 kernel: [63748.617607] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 23:06:14 juju-e4d256-prod-github-runner-207 kernel: [63748.618310] RIP: 0033:0x7faa5d0edaff Aug 22 23:06:14 juju-e4d256-prod-github-runner-207 kernel: [63748.619007] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 23:06:14 juju-e4d256-prod-github-runner-207 kernel: [63748.621034] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 23:06:14 juju-e4d256-prod-github-runner-207 kernel: [63748.621953] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 23:06:14 juju-e4d256-prod-github-runner-207 kernel: [63748.622843] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 23:06:14 juju-e4d256-prod-github-runner-207 kernel: [63748.623768] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 23:06:14 juju-e4d256-prod-github-runner-207 kernel: [63748.624664] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 23:06:14 juju-e4d256-prod-github-runner-207 kernel: [63748.625550] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 23:06:14 juju-e4d256-prod-github-runner-207 kernel: [63748.626439] Aug 22 23:06:42 juju-e4d256-prod-github-runner-207 kernel: [63776.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 59288s! [qemu-system-x86:6715] Aug 22 23:06:42 juju-e4d256-prod-github-runner-207 kernel: [63776.543170] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 23:06:42 juju-e4d256-prod-github-runner-207 kernel: [63776.543248] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 23:06:42 juju-e4d256-prod-github-runner-207 kernel: [63776.555576] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 23:06:42 juju-e4d256-prod-github-runner-207 kernel: [63776.556875] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 23:06:42 juju-e4d256-prod-github-runner-207 kernel: [63776.558138] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:06:42 juju-e4d256-prod-github-runner-207 kernel: [63776.559270] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 23:06:42 juju-e4d256-prod-github-runner-207 kernel: [63776.561920] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 23:06:42 juju-e4d256-prod-github-runner-207 kernel: [63776.563014] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 23:06:42 juju-e4d256-prod-github-runner-207 kernel: [63776.564204] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 23:06:42 juju-e4d256-prod-github-runner-207 kernel: [63776.565371] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 23:06:42 juju-e4d256-prod-github-runner-207 kernel: [63776.566536] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 23:06:42 juju-e4d256-prod-github-runner-207 kernel: [63776.567710] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 23:06:42 juju-e4d256-prod-github-runner-207 kernel: [63776.568872] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 23:06:42 juju-e4d256-prod-github-runner-207 kernel: [63776.570129] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 23:06:42 juju-e4d256-prod-github-runner-207 kernel: [63776.571247] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 23:06:42 juju-e4d256-prod-github-runner-207 kernel: [63776.572451] Call Trace: Aug 22 23:06:42 juju-e4d256-prod-github-runner-207 kernel: [63776.573372] Aug 22 23:06:42 juju-e4d256-prod-github-runner-207 kernel: [63776.574360] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:06:42 juju-e4d256-prod-github-runner-207 kernel: [63776.575476] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:06:42 juju-e4d256-prod-github-runner-207 kernel: [63776.576503] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:06:42 juju-e4d256-prod-github-runner-207 kernel: [63776.577582] ? show_regs.part.0+0x23/0x29 Aug 22 23:06:42 juju-e4d256-prod-github-runner-207 kernel: [63776.578597] ? show_regs.cold+0x8/0xd Aug 22 23:06:42 juju-e4d256-prod-github-runner-207 kernel: [63776.579601] ? watchdog_timer_fn+0x1be/0x220 Aug 22 23:06:42 juju-e4d256-prod-github-runner-207 kernel: [63776.580629] ? lockup_detector_update_enable+0x60/0x60 Aug 22 23:06:42 juju-e4d256-prod-github-runner-207 kernel: [63776.581756] ? __hrtimer_run_queues+0x107/0x230 Aug 22 23:06:42 juju-e4d256-prod-github-runner-207 kernel: [63776.582797] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 23:06:42 juju-e4d256-prod-github-runner-207 kernel: [63776.583820] ? hrtimer_interrupt+0x101/0x220 Aug 22 23:06:42 juju-e4d256-prod-github-runner-207 kernel: [63776.584844] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 23:06:42 juju-e4d256-prod-github-runner-207 kernel: [63776.585924] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 23:06:42 juju-e4d256-prod-github-runner-207 kernel: [63776.586989] Aug 22 23:06:42 juju-e4d256-prod-github-runner-207 kernel: [63776.587842] Aug 22 23:06:42 juju-e4d256-prod-github-runner-207 kernel: [63776.588678] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 23:06:42 juju-e4d256-prod-github-runner-207 kernel: [63776.589726] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:06:42 juju-e4d256-prod-github-runner-207 kernel: [63776.590820] ? _raw_spin_lock+0x22/0x30 Aug 22 23:06:42 juju-e4d256-prod-github-runner-207 kernel: [63776.591771] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:06:42 juju-e4d256-prod-github-runner-207 kernel: [63776.592793] direct_page_fault+0x206/0x310 [kvm] Aug 22 23:06:42 juju-e4d256-prod-github-runner-207 kernel: [63776.593822] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 23:06:42 juju-e4d256-prod-github-runner-207 kernel: [63776.594841] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 23:06:42 juju-e4d256-prod-github-runner-207 kernel: [63776.595856] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 23:06:42 juju-e4d256-prod-github-runner-207 kernel: [63776.596832] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 23:06:42 juju-e4d256-prod-github-runner-207 kernel: [63776.597777] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 23:06:42 juju-e4d256-prod-github-runner-207 kernel: [63776.598772] handle_exit+0x98/0x230 [kvm_amd] Aug 22 23:06:42 juju-e4d256-prod-github-runner-207 kernel: [63776.599674] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 23:06:42 juju-e4d256-prod-github-runner-207 kernel: [63776.600631] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 23:06:42 juju-e4d256-prod-github-runner-207 kernel: [63776.601572] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 23:06:42 juju-e4d256-prod-github-runner-207 kernel: [63776.602482] vcpu_run+0x62/0x2c0 [kvm] Aug 22 23:06:42 juju-e4d256-prod-github-runner-207 kernel: [63776.603355] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 23:06:42 juju-e4d256-prod-github-runner-207 kernel: [63776.604166] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 23:06:42 juju-e4d256-prod-github-runner-207 kernel: [63776.605022] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 23:06:42 juju-e4d256-prod-github-runner-207 kernel: [63776.606132] ? __seccomp_filter+0x4a/0x4a0 Aug 22 23:06:42 juju-e4d256-prod-github-runner-207 kernel: [63776.606924] ? __fget_files+0x86/0xc0 Aug 22 23:06:42 juju-e4d256-prod-github-runner-207 kernel: [63776.607631] __x64_sys_ioctl+0x95/0xd0 Aug 22 23:06:42 juju-e4d256-prod-github-runner-207 kernel: [63776.608326] do_syscall_64+0x5c/0xc0 Aug 22 23:06:42 juju-e4d256-prod-github-runner-207 kernel: [63776.608993] ? do_futex+0x162/0x1f0 Aug 22 23:06:42 juju-e4d256-prod-github-runner-207 kernel: [63776.609644] ? __x64_sys_futex+0x78/0x1e0 Aug 22 23:06:42 juju-e4d256-prod-github-runner-207 kernel: [63776.610320] ? __secure_computing+0xa9/0x120 Aug 22 23:06:42 juju-e4d256-prod-github-runner-207 kernel: [63776.611081] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 23:06:42 juju-e4d256-prod-github-runner-207 kernel: [63776.612077] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:06:42 juju-e4d256-prod-github-runner-207 kernel: [63776.612802] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:06:42 juju-e4d256-prod-github-runner-207 kernel: [63776.613541] ? do_syscall_64+0x69/0xc0 Aug 22 23:06:42 juju-e4d256-prod-github-runner-207 kernel: [63776.614205] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:06:42 juju-e4d256-prod-github-runner-207 kernel: [63776.614931] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:06:42 juju-e4d256-prod-github-runner-207 kernel: [63776.615669] ? do_syscall_64+0x69/0xc0 Aug 22 23:06:42 juju-e4d256-prod-github-runner-207 kernel: [63776.616346] ? do_syscall_64+0x69/0xc0 Aug 22 23:06:42 juju-e4d256-prod-github-runner-207 kernel: [63776.616981] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 23:06:42 juju-e4d256-prod-github-runner-207 kernel: [63776.617688] RIP: 0033:0x7faa5d0edaff Aug 22 23:06:42 juju-e4d256-prod-github-runner-207 kernel: [63776.618360] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 23:06:42 juju-e4d256-prod-github-runner-207 kernel: [63776.620918] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 23:06:42 juju-e4d256-prod-github-runner-207 kernel: [63776.621907] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 23:06:42 juju-e4d256-prod-github-runner-207 kernel: [63776.622834] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 23:06:42 juju-e4d256-prod-github-runner-207 kernel: [63776.623729] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 23:06:42 juju-e4d256-prod-github-runner-207 kernel: [63776.624623] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 23:06:42 juju-e4d256-prod-github-runner-207 kernel: [63776.625545] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 23:06:42 juju-e4d256-prod-github-runner-207 kernel: [63776.626458] Aug 22 23:07:10 juju-e4d256-prod-github-runner-207 kernel: [63804.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 59314s! [qemu-system-x86:6715] Aug 22 23:07:10 juju-e4d256-prod-github-runner-207 kernel: [63804.543162] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 23:07:10 juju-e4d256-prod-github-runner-207 kernel: [63804.543234] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 23:07:10 juju-e4d256-prod-github-runner-207 kernel: [63804.555438] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 23:07:10 juju-e4d256-prod-github-runner-207 kernel: [63804.556719] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 23:07:10 juju-e4d256-prod-github-runner-207 kernel: [63804.557952] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:07:10 juju-e4d256-prod-github-runner-207 kernel: [63804.559034] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 23:07:10 juju-e4d256-prod-github-runner-207 kernel: [63804.561608] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 23:07:10 juju-e4d256-prod-github-runner-207 kernel: [63804.562690] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 23:07:10 juju-e4d256-prod-github-runner-207 kernel: [63804.563893] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 23:07:10 juju-e4d256-prod-github-runner-207 kernel: [63804.565055] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 23:07:10 juju-e4d256-prod-github-runner-207 kernel: [63804.566233] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 23:07:10 juju-e4d256-prod-github-runner-207 kernel: [63804.567431] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 23:07:10 juju-e4d256-prod-github-runner-207 kernel: [63804.568619] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 23:07:10 juju-e4d256-prod-github-runner-207 kernel: [63804.569865] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 23:07:10 juju-e4d256-prod-github-runner-207 kernel: [63804.571020] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 23:07:10 juju-e4d256-prod-github-runner-207 kernel: [63804.572228] Call Trace: Aug 22 23:07:10 juju-e4d256-prod-github-runner-207 kernel: [63804.573156] Aug 22 23:07:10 juju-e4d256-prod-github-runner-207 kernel: [63804.574058] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:07:10 juju-e4d256-prod-github-runner-207 kernel: [63804.575114] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:07:10 juju-e4d256-prod-github-runner-207 kernel: [63804.576147] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:07:10 juju-e4d256-prod-github-runner-207 kernel: [63804.577234] ? show_regs.part.0+0x23/0x29 Aug 22 23:07:10 juju-e4d256-prod-github-runner-207 kernel: [63804.578288] ? show_regs.cold+0x8/0xd Aug 22 23:07:10 juju-e4d256-prod-github-runner-207 kernel: [63804.579279] ? watchdog_timer_fn+0x1be/0x220 Aug 22 23:07:10 juju-e4d256-prod-github-runner-207 kernel: [63804.580296] ? lockup_detector_update_enable+0x60/0x60 Aug 22 23:07:10 juju-e4d256-prod-github-runner-207 kernel: [63804.581373] ? __hrtimer_run_queues+0x107/0x230 Aug 22 23:07:10 juju-e4d256-prod-github-runner-207 kernel: [63804.582423] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 23:07:10 juju-e4d256-prod-github-runner-207 kernel: [63804.583451] ? hrtimer_interrupt+0x101/0x220 Aug 22 23:07:10 juju-e4d256-prod-github-runner-207 kernel: [63804.584562] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 23:07:10 juju-e4d256-prod-github-runner-207 kernel: [63804.585727] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 23:07:10 juju-e4d256-prod-github-runner-207 kernel: [63804.586880] Aug 22 23:07:10 juju-e4d256-prod-github-runner-207 kernel: [63804.587779] Aug 22 23:07:10 juju-e4d256-prod-github-runner-207 kernel: [63804.588672] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 23:07:10 juju-e4d256-prod-github-runner-207 kernel: [63804.589810] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:07:10 juju-e4d256-prod-github-runner-207 kernel: [63804.590972] ? _raw_spin_lock+0x22/0x30 Aug 22 23:07:10 juju-e4d256-prod-github-runner-207 kernel: [63804.591991] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:07:10 juju-e4d256-prod-github-runner-207 kernel: [63804.593108] direct_page_fault+0x206/0x310 [kvm] Aug 22 23:07:10 juju-e4d256-prod-github-runner-207 kernel: [63804.594256] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 23:07:10 juju-e4d256-prod-github-runner-207 kernel: [63804.595367] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 23:07:10 juju-e4d256-prod-github-runner-207 kernel: [63804.596457] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 23:07:10 juju-e4d256-prod-github-runner-207 kernel: [63804.597532] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 23:07:10 juju-e4d256-prod-github-runner-207 kernel: [63804.598600] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 23:07:10 juju-e4d256-prod-github-runner-207 kernel: [63804.599693] handle_exit+0x98/0x230 [kvm_amd] Aug 22 23:07:10 juju-e4d256-prod-github-runner-207 kernel: [63804.600673] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 23:07:10 juju-e4d256-prod-github-runner-207 kernel: [63804.601694] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 23:07:10 juju-e4d256-prod-github-runner-207 kernel: [63804.602738] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 23:07:10 juju-e4d256-prod-github-runner-207 kernel: [63804.603738] vcpu_run+0x62/0x2c0 [kvm] Aug 22 23:07:10 juju-e4d256-prod-github-runner-207 kernel: [63804.604620] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 23:07:10 juju-e4d256-prod-github-runner-207 kernel: [63804.605524] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 23:07:10 juju-e4d256-prod-github-runner-207 kernel: [63804.606503] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 23:07:10 juju-e4d256-prod-github-runner-207 kernel: [63804.607394] ? __seccomp_filter+0x4a/0x4a0 Aug 22 23:07:10 juju-e4d256-prod-github-runner-207 kernel: [63804.608214] ? __fget_files+0x86/0xc0 Aug 22 23:07:10 juju-e4d256-prod-github-runner-207 kernel: [63804.609009] __x64_sys_ioctl+0x95/0xd0 Aug 22 23:07:10 juju-e4d256-prod-github-runner-207 kernel: [63804.609784] do_syscall_64+0x5c/0xc0 Aug 22 23:07:10 juju-e4d256-prod-github-runner-207 kernel: [63804.610534] ? do_futex+0x162/0x1f0 Aug 22 23:07:10 juju-e4d256-prod-github-runner-207 kernel: [63804.611257] ? __x64_sys_futex+0x78/0x1e0 Aug 22 23:07:10 juju-e4d256-prod-github-runner-207 kernel: [63804.612014] ? __secure_computing+0xa9/0x120 Aug 22 23:07:10 juju-e4d256-prod-github-runner-207 kernel: [63804.612789] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 23:07:10 juju-e4d256-prod-github-runner-207 kernel: [63804.613668] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:07:10 juju-e4d256-prod-github-runner-207 kernel: [63804.614513] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:07:10 juju-e4d256-prod-github-runner-207 kernel: [63804.615322] ? do_syscall_64+0x69/0xc0 Aug 22 23:07:10 juju-e4d256-prod-github-runner-207 kernel: [63804.616045] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:07:10 juju-e4d256-prod-github-runner-207 kernel: [63804.616836] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:07:10 juju-e4d256-prod-github-runner-207 kernel: [63804.617623] ? do_syscall_64+0x69/0xc0 Aug 22 23:07:10 juju-e4d256-prod-github-runner-207 kernel: [63804.618345] ? do_syscall_64+0x69/0xc0 Aug 22 23:07:10 juju-e4d256-prod-github-runner-207 kernel: [63804.619047] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 23:07:10 juju-e4d256-prod-github-runner-207 kernel: [63804.619849] RIP: 0033:0x7faa5d0edaff Aug 22 23:07:10 juju-e4d256-prod-github-runner-207 kernel: [63804.620557] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 23:07:10 juju-e4d256-prod-github-runner-207 kernel: [63804.622887] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 23:07:10 juju-e4d256-prod-github-runner-207 kernel: [63804.623931] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 23:07:10 juju-e4d256-prod-github-runner-207 kernel: [63804.624953] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 23:07:10 juju-e4d256-prod-github-runner-207 kernel: [63804.625976] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 23:07:10 juju-e4d256-prod-github-runner-207 kernel: [63804.627005] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 23:07:10 juju-e4d256-prod-github-runner-207 kernel: [63804.628122] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 23:07:10 juju-e4d256-prod-github-runner-207 kernel: [63804.629138] Aug 22 23:07:38 juju-e4d256-prod-github-runner-207 kernel: [63832.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 59340s! [qemu-system-x86:6715] Aug 22 23:07:38 juju-e4d256-prod-github-runner-207 kernel: [63832.543334] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 23:07:38 juju-e4d256-prod-github-runner-207 kernel: [63832.543409] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 23:07:38 juju-e4d256-prod-github-runner-207 kernel: [63832.557333] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 23:07:38 juju-e4d256-prod-github-runner-207 kernel: [63832.558802] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 23:07:38 juju-e4d256-prod-github-runner-207 kernel: [63832.560184] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:07:38 juju-e4d256-prod-github-runner-207 kernel: [63832.561357] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 23:07:38 juju-e4d256-prod-github-runner-207 kernel: [63832.564247] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 23:07:38 juju-e4d256-prod-github-runner-207 kernel: [63832.565395] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 23:07:38 juju-e4d256-prod-github-runner-207 kernel: [63832.566706] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 23:07:38 juju-e4d256-prod-github-runner-207 kernel: [63832.568019] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 23:07:38 juju-e4d256-prod-github-runner-207 kernel: [63832.569328] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 23:07:38 juju-e4d256-prod-github-runner-207 kernel: [63832.570653] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 23:07:38 juju-e4d256-prod-github-runner-207 kernel: [63832.571967] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 23:07:38 juju-e4d256-prod-github-runner-207 kernel: [63832.573355] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 23:07:38 juju-e4d256-prod-github-runner-207 kernel: [63832.574590] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 23:07:38 juju-e4d256-prod-github-runner-207 kernel: [63832.575970] Call Trace: Aug 22 23:07:38 juju-e4d256-prod-github-runner-207 kernel: [63832.576947] Aug 22 23:07:38 juju-e4d256-prod-github-runner-207 kernel: [63832.577902] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:07:38 juju-e4d256-prod-github-runner-207 kernel: [63832.579021] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:07:38 juju-e4d256-prod-github-runner-207 kernel: [63832.580127] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:07:38 juju-e4d256-prod-github-runner-207 kernel: [63832.581303] ? show_regs.part.0+0x23/0x29 Aug 22 23:07:38 juju-e4d256-prod-github-runner-207 kernel: [63832.582397] ? show_regs.cold+0x8/0xd Aug 22 23:07:38 juju-e4d256-prod-github-runner-207 kernel: [63832.583445] ? watchdog_timer_fn+0x1be/0x220 Aug 22 23:07:38 juju-e4d256-prod-github-runner-207 kernel: [63832.584540] ? lockup_detector_update_enable+0x60/0x60 Aug 22 23:07:38 juju-e4d256-prod-github-runner-207 kernel: [63832.585715] ? __hrtimer_run_queues+0x107/0x230 Aug 22 23:07:38 juju-e4d256-prod-github-runner-207 kernel: [63832.586875] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 23:07:38 juju-e4d256-prod-github-runner-207 kernel: [63832.587991] ? hrtimer_interrupt+0x101/0x220 Aug 22 23:07:38 juju-e4d256-prod-github-runner-207 kernel: [63832.589092] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 23:07:38 juju-e4d256-prod-github-runner-207 kernel: [63832.590271] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 23:07:38 juju-e4d256-prod-github-runner-207 kernel: [63832.591420] Aug 22 23:07:38 juju-e4d256-prod-github-runner-207 kernel: [63832.592423] Aug 22 23:07:38 juju-e4d256-prod-github-runner-207 kernel: [63832.593672] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 23:07:38 juju-e4d256-prod-github-runner-207 kernel: [63832.594718] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:07:38 juju-e4d256-prod-github-runner-207 kernel: [63832.595765] ? _raw_spin_lock+0x22/0x30 Aug 22 23:07:38 juju-e4d256-prod-github-runner-207 kernel: [63832.596726] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:07:38 juju-e4d256-prod-github-runner-207 kernel: [63832.597752] direct_page_fault+0x206/0x310 [kvm] Aug 22 23:07:38 juju-e4d256-prod-github-runner-207 kernel: [63832.598802] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 23:07:38 juju-e4d256-prod-github-runner-207 kernel: [63832.599810] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 23:07:38 juju-e4d256-prod-github-runner-207 kernel: [63832.600807] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 23:07:38 juju-e4d256-prod-github-runner-207 kernel: [63832.601782] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 23:07:38 juju-e4d256-prod-github-runner-207 kernel: [63832.602745] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 23:07:38 juju-e4d256-prod-github-runner-207 kernel: [63832.603724] handle_exit+0x98/0x230 [kvm_amd] Aug 22 23:07:38 juju-e4d256-prod-github-runner-207 kernel: [63832.604616] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 23:07:38 juju-e4d256-prod-github-runner-207 kernel: [63832.605529] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 23:07:38 juju-e4d256-prod-github-runner-207 kernel: [63832.606469] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 23:07:38 juju-e4d256-prod-github-runner-207 kernel: [63832.607371] vcpu_run+0x62/0x2c0 [kvm] Aug 22 23:07:38 juju-e4d256-prod-github-runner-207 kernel: [63832.608181] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 23:07:38 juju-e4d256-prod-github-runner-207 kernel: [63832.608987] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 23:07:38 juju-e4d256-prod-github-runner-207 kernel: [63832.609839] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 23:07:38 juju-e4d256-prod-github-runner-207 kernel: [63832.610639] ? __seccomp_filter+0x4a/0x4a0 Aug 22 23:07:38 juju-e4d256-prod-github-runner-207 kernel: [63832.611382] ? __fget_files+0x86/0xc0 Aug 22 23:07:38 juju-e4d256-prod-github-runner-207 kernel: [63832.612088] __x64_sys_ioctl+0x95/0xd0 Aug 22 23:07:38 juju-e4d256-prod-github-runner-207 kernel: [63832.612780] do_syscall_64+0x5c/0xc0 Aug 22 23:07:38 juju-e4d256-prod-github-runner-207 kernel: [63832.613443] ? do_futex+0x162/0x1f0 Aug 22 23:07:38 juju-e4d256-prod-github-runner-207 kernel: [63832.614172] ? __x64_sys_futex+0x78/0x1e0 Aug 22 23:07:38 juju-e4d256-prod-github-runner-207 kernel: [63832.614856] ? __secure_computing+0xa9/0x120 Aug 22 23:07:38 juju-e4d256-prod-github-runner-207 kernel: [63832.615545] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 23:07:38 juju-e4d256-prod-github-runner-207 kernel: [63832.616310] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:07:38 juju-e4d256-prod-github-runner-207 kernel: [63832.617110] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:07:38 juju-e4d256-prod-github-runner-207 kernel: [63832.617841] ? do_syscall_64+0x69/0xc0 Aug 22 23:07:38 juju-e4d256-prod-github-runner-207 kernel: [63832.618492] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:07:38 juju-e4d256-prod-github-runner-207 kernel: [63832.619207] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:07:38 juju-e4d256-prod-github-runner-207 kernel: [63832.619901] ? do_syscall_64+0x69/0xc0 Aug 22 23:07:38 juju-e4d256-prod-github-runner-207 kernel: [63832.620524] ? do_syscall_64+0x69/0xc0 Aug 22 23:07:38 juju-e4d256-prod-github-runner-207 kernel: [63832.621145] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 23:07:38 juju-e4d256-prod-github-runner-207 kernel: [63832.621915] RIP: 0033:0x7faa5d0edaff Aug 22 23:07:38 juju-e4d256-prod-github-runner-207 kernel: [63832.622539] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 23:07:38 juju-e4d256-prod-github-runner-207 kernel: [63832.624511] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 23:07:38 juju-e4d256-prod-github-runner-207 kernel: [63832.625419] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 23:07:38 juju-e4d256-prod-github-runner-207 kernel: [63832.626319] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 23:07:38 juju-e4d256-prod-github-runner-207 kernel: [63832.627213] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 23:07:38 juju-e4d256-prod-github-runner-207 kernel: [63832.628105] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 23:07:38 juju-e4d256-prod-github-runner-207 kernel: [63832.628991] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 23:07:38 juju-e4d256-prod-github-runner-207 kernel: [63832.629892] Aug 22 23:08:06 juju-e4d256-prod-github-runner-207 kernel: [63860.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 59366s! [qemu-system-x86:6715] Aug 22 23:08:06 juju-e4d256-prod-github-runner-207 kernel: [63860.543888] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 23:08:06 juju-e4d256-prod-github-runner-207 kernel: [63860.544203] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 23:08:06 juju-e4d256-prod-github-runner-207 kernel: [63860.556313] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 23:08:06 juju-e4d256-prod-github-runner-207 kernel: [63860.557603] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 23:08:06 juju-e4d256-prod-github-runner-207 kernel: [63860.558825] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:08:06 juju-e4d256-prod-github-runner-207 kernel: [63860.559875] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 23:08:06 juju-e4d256-prod-github-runner-207 kernel: [63860.562435] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 23:08:06 juju-e4d256-prod-github-runner-207 kernel: [63860.563483] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 23:08:06 juju-e4d256-prod-github-runner-207 kernel: [63860.564648] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 23:08:06 juju-e4d256-prod-github-runner-207 kernel: [63860.565818] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 23:08:06 juju-e4d256-prod-github-runner-207 kernel: [63860.566988] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 23:08:06 juju-e4d256-prod-github-runner-207 kernel: [63860.568148] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 23:08:06 juju-e4d256-prod-github-runner-207 kernel: [63860.569317] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 23:08:06 juju-e4d256-prod-github-runner-207 kernel: [63860.570560] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 23:08:06 juju-e4d256-prod-github-runner-207 kernel: [63860.571658] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 23:08:06 juju-e4d256-prod-github-runner-207 kernel: [63860.572855] Call Trace: Aug 22 23:08:06 juju-e4d256-prod-github-runner-207 kernel: [63860.573932] Aug 22 23:08:06 juju-e4d256-prod-github-runner-207 kernel: [63860.574847] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:08:06 juju-e4d256-prod-github-runner-207 kernel: [63860.575909] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:08:06 juju-e4d256-prod-github-runner-207 kernel: [63860.576935] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:08:06 juju-e4d256-prod-github-runner-207 kernel: [63860.578071] ? show_regs.part.0+0x23/0x29 Aug 22 23:08:06 juju-e4d256-prod-github-runner-207 kernel: [63860.579070] ? show_regs.cold+0x8/0xd Aug 22 23:08:06 juju-e4d256-prod-github-runner-207 kernel: [63860.580047] ? watchdog_timer_fn+0x1be/0x220 Aug 22 23:08:06 juju-e4d256-prod-github-runner-207 kernel: [63860.581058] ? lockup_detector_update_enable+0x60/0x60 Aug 22 23:08:06 juju-e4d256-prod-github-runner-207 kernel: [63860.582129] ? __hrtimer_run_queues+0x107/0x230 Aug 22 23:08:06 juju-e4d256-prod-github-runner-207 kernel: [63860.583167] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 23:08:06 juju-e4d256-prod-github-runner-207 kernel: [63860.584192] ? hrtimer_interrupt+0x101/0x220 Aug 22 23:08:06 juju-e4d256-prod-github-runner-207 kernel: [63860.585207] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 23:08:06 juju-e4d256-prod-github-runner-207 kernel: [63860.586299] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 23:08:06 juju-e4d256-prod-github-runner-207 kernel: [63860.587354] Aug 22 23:08:06 juju-e4d256-prod-github-runner-207 kernel: [63860.588219] Aug 22 23:08:06 juju-e4d256-prod-github-runner-207 kernel: [63860.589054] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 23:08:06 juju-e4d256-prod-github-runner-207 kernel: [63860.590104] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:08:06 juju-e4d256-prod-github-runner-207 kernel: [63860.591144] ? _raw_spin_lock+0x22/0x30 Aug 22 23:08:06 juju-e4d256-prod-github-runner-207 kernel: [63860.592084] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:08:06 juju-e4d256-prod-github-runner-207 kernel: [63860.593113] direct_page_fault+0x206/0x310 [kvm] Aug 22 23:08:06 juju-e4d256-prod-github-runner-207 kernel: [63860.594149] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 23:08:06 juju-e4d256-prod-github-runner-207 kernel: [63860.595155] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 23:08:06 juju-e4d256-prod-github-runner-207 kernel: [63860.596152] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 23:08:06 juju-e4d256-prod-github-runner-207 kernel: [63860.597155] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 23:08:06 juju-e4d256-prod-github-runner-207 kernel: [63860.598119] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 23:08:06 juju-e4d256-prod-github-runner-207 kernel: [63860.599102] handle_exit+0x98/0x230 [kvm_amd] Aug 22 23:08:06 juju-e4d256-prod-github-runner-207 kernel: [63860.600001] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 23:08:06 juju-e4d256-prod-github-runner-207 kernel: [63860.600913] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 23:08:06 juju-e4d256-prod-github-runner-207 kernel: [63860.601847] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 23:08:06 juju-e4d256-prod-github-runner-207 kernel: [63860.602752] vcpu_run+0x62/0x2c0 [kvm] Aug 22 23:08:06 juju-e4d256-prod-github-runner-207 kernel: [63860.603594] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 23:08:06 juju-e4d256-prod-github-runner-207 kernel: [63860.604408] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 23:08:06 juju-e4d256-prod-github-runner-207 kernel: [63860.605267] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 23:08:06 juju-e4d256-prod-github-runner-207 kernel: [63860.606078] ? __seccomp_filter+0x4a/0x4a0 Aug 22 23:08:06 juju-e4d256-prod-github-runner-207 kernel: [63860.606817] ? __fget_files+0x86/0xc0 Aug 22 23:08:06 juju-e4d256-prod-github-runner-207 kernel: [63860.607517] __x64_sys_ioctl+0x95/0xd0 Aug 22 23:08:06 juju-e4d256-prod-github-runner-207 kernel: [63860.608227] do_syscall_64+0x5c/0xc0 Aug 22 23:08:06 juju-e4d256-prod-github-runner-207 kernel: [63860.608904] ? do_futex+0x162/0x1f0 Aug 22 23:08:06 juju-e4d256-prod-github-runner-207 kernel: [63860.609567] ? __x64_sys_futex+0x78/0x1e0 Aug 22 23:08:06 juju-e4d256-prod-github-runner-207 kernel: [63860.610242] ? __secure_computing+0xa9/0x120 Aug 22 23:08:06 juju-e4d256-prod-github-runner-207 kernel: [63860.610932] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 23:08:06 juju-e4d256-prod-github-runner-207 kernel: [63860.611688] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:08:06 juju-e4d256-prod-github-runner-207 kernel: [63860.612411] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:08:06 juju-e4d256-prod-github-runner-207 kernel: [63860.613171] ? do_syscall_64+0x69/0xc0 Aug 22 23:08:06 juju-e4d256-prod-github-runner-207 kernel: [63860.613844] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:08:06 juju-e4d256-prod-github-runner-207 kernel: [63860.614547] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:08:06 juju-e4d256-prod-github-runner-207 kernel: [63860.615241] ? do_syscall_64+0x69/0xc0 Aug 22 23:08:06 juju-e4d256-prod-github-runner-207 kernel: [63860.615924] ? do_syscall_64+0x69/0xc0 Aug 22 23:08:06 juju-e4d256-prod-github-runner-207 kernel: [63860.616548] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 23:08:06 juju-e4d256-prod-github-runner-207 kernel: [63860.617253] RIP: 0033:0x7faa5d0edaff Aug 22 23:08:06 juju-e4d256-prod-github-runner-207 kernel: [63860.617938] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 23:08:06 juju-e4d256-prod-github-runner-207 kernel: [63860.619937] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 23:08:06 juju-e4d256-prod-github-runner-207 kernel: [63860.620861] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 23:08:06 juju-e4d256-prod-github-runner-207 kernel: [63860.621778] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 23:08:06 juju-e4d256-prod-github-runner-207 kernel: [63860.622680] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 23:08:06 juju-e4d256-prod-github-runner-207 kernel: [63860.623599] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 23:08:06 juju-e4d256-prod-github-runner-207 kernel: [63860.624498] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 23:08:06 juju-e4d256-prod-github-runner-207 kernel: [63860.625395] Aug 22 23:08:34 juju-e4d256-prod-github-runner-207 kernel: [63888.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 59392s! [qemu-system-x86:6715] Aug 22 23:08:34 juju-e4d256-prod-github-runner-207 kernel: [63888.543123] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 23:08:34 juju-e4d256-prod-github-runner-207 kernel: [63888.543199] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 23:08:34 juju-e4d256-prod-github-runner-207 kernel: [63888.555731] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 23:08:34 juju-e4d256-prod-github-runner-207 kernel: [63888.557049] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 23:08:34 juju-e4d256-prod-github-runner-207 kernel: [63888.558319] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:08:34 juju-e4d256-prod-github-runner-207 kernel: [63888.559385] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 23:08:34 juju-e4d256-prod-github-runner-207 kernel: [63888.561957] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 23:08:34 juju-e4d256-prod-github-runner-207 kernel: [63888.563026] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 23:08:34 juju-e4d256-prod-github-runner-207 kernel: [63888.564209] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 23:08:34 juju-e4d256-prod-github-runner-207 kernel: [63888.565393] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 23:08:34 juju-e4d256-prod-github-runner-207 kernel: [63888.566559] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 23:08:34 juju-e4d256-prod-github-runner-207 kernel: [63888.567758] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 23:08:34 juju-e4d256-prod-github-runner-207 kernel: [63888.568950] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 23:08:34 juju-e4d256-prod-github-runner-207 kernel: [63888.570224] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 23:08:34 juju-e4d256-prod-github-runner-207 kernel: [63888.571326] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 23:08:34 juju-e4d256-prod-github-runner-207 kernel: [63888.572545] Call Trace: Aug 22 23:08:34 juju-e4d256-prod-github-runner-207 kernel: [63888.573505] Aug 22 23:08:34 juju-e4d256-prod-github-runner-207 kernel: [63888.574415] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:08:34 juju-e4d256-prod-github-runner-207 kernel: [63888.575594] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:08:34 juju-e4d256-prod-github-runner-207 kernel: [63888.576624] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:08:34 juju-e4d256-prod-github-runner-207 kernel: [63888.577742] ? show_regs.part.0+0x23/0x29 Aug 22 23:08:34 juju-e4d256-prod-github-runner-207 kernel: [63888.578762] ? show_regs.cold+0x8/0xd Aug 22 23:08:34 juju-e4d256-prod-github-runner-207 kernel: [63888.579806] ? watchdog_timer_fn+0x1be/0x220 Aug 22 23:08:34 juju-e4d256-prod-github-runner-207 kernel: [63888.581070] ? lockup_detector_update_enable+0x60/0x60 Aug 22 23:08:34 juju-e4d256-prod-github-runner-207 kernel: [63888.582215] ? __hrtimer_run_queues+0x107/0x230 Aug 22 23:08:34 juju-e4d256-prod-github-runner-207 kernel: [63888.583257] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 23:08:34 juju-e4d256-prod-github-runner-207 kernel: [63888.584320] ? hrtimer_interrupt+0x101/0x220 Aug 22 23:08:34 juju-e4d256-prod-github-runner-207 kernel: [63888.585369] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 23:08:34 juju-e4d256-prod-github-runner-207 kernel: [63888.586457] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 23:08:34 juju-e4d256-prod-github-runner-207 kernel: [63888.587524] Aug 22 23:08:34 juju-e4d256-prod-github-runner-207 kernel: [63888.588400] Aug 22 23:08:34 juju-e4d256-prod-github-runner-207 kernel: [63888.589277] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 23:08:34 juju-e4d256-prod-github-runner-207 kernel: [63888.590313] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:08:34 juju-e4d256-prod-github-runner-207 kernel: [63888.591357] ? _raw_spin_lock+0x22/0x30 Aug 22 23:08:34 juju-e4d256-prod-github-runner-207 kernel: [63888.592303] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:08:34 juju-e4d256-prod-github-runner-207 kernel: [63888.593370] direct_page_fault+0x206/0x310 [kvm] Aug 22 23:08:34 juju-e4d256-prod-github-runner-207 kernel: [63888.594445] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 23:08:34 juju-e4d256-prod-github-runner-207 kernel: [63888.595462] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 23:08:34 juju-e4d256-prod-github-runner-207 kernel: [63888.596466] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 23:08:34 juju-e4d256-prod-github-runner-207 kernel: [63888.597463] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 23:08:34 juju-e4d256-prod-github-runner-207 kernel: [63888.598427] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 23:08:34 juju-e4d256-prod-github-runner-207 kernel: [63888.599426] handle_exit+0x98/0x230 [kvm_amd] Aug 22 23:08:34 juju-e4d256-prod-github-runner-207 kernel: [63888.600321] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 23:08:34 juju-e4d256-prod-github-runner-207 kernel: [63888.601261] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 23:08:34 juju-e4d256-prod-github-runner-207 kernel: [63888.602191] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 23:08:34 juju-e4d256-prod-github-runner-207 kernel: [63888.603098] vcpu_run+0x62/0x2c0 [kvm] Aug 22 23:08:34 juju-e4d256-prod-github-runner-207 kernel: [63888.603921] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 23:08:34 juju-e4d256-prod-github-runner-207 kernel: [63888.604776] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 23:08:34 juju-e4d256-prod-github-runner-207 kernel: [63888.605660] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 23:08:34 juju-e4d256-prod-github-runner-207 kernel: [63888.606463] ? __seccomp_filter+0x4a/0x4a0 Aug 22 23:08:34 juju-e4d256-prod-github-runner-207 kernel: [63888.607261] ? __fget_files+0x86/0xc0 Aug 22 23:08:34 juju-e4d256-prod-github-runner-207 kernel: [63888.607971] __x64_sys_ioctl+0x95/0xd0 Aug 22 23:08:34 juju-e4d256-prod-github-runner-207 kernel: [63888.608677] do_syscall_64+0x5c/0xc0 Aug 22 23:08:34 juju-e4d256-prod-github-runner-207 kernel: [63888.609383] ? do_futex+0x162/0x1f0 Aug 22 23:08:34 juju-e4d256-prod-github-runner-207 kernel: [63888.610059] ? __x64_sys_futex+0x78/0x1e0 Aug 22 23:08:34 juju-e4d256-prod-github-runner-207 kernel: [63888.610739] ? __secure_computing+0xa9/0x120 Aug 22 23:08:34 juju-e4d256-prod-github-runner-207 kernel: [63888.611535] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 23:08:34 juju-e4d256-prod-github-runner-207 kernel: [63888.612330] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:08:34 juju-e4d256-prod-github-runner-207 kernel: [63888.613056] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:08:34 juju-e4d256-prod-github-runner-207 kernel: [63888.613828] ? do_syscall_64+0x69/0xc0 Aug 22 23:08:34 juju-e4d256-prod-github-runner-207 kernel: [63888.614499] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:08:34 juju-e4d256-prod-github-runner-207 kernel: [63888.615235] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:08:34 juju-e4d256-prod-github-runner-207 kernel: [63888.615951] ? do_syscall_64+0x69/0xc0 Aug 22 23:08:34 juju-e4d256-prod-github-runner-207 kernel: [63888.616592] ? do_syscall_64+0x69/0xc0 Aug 22 23:08:34 juju-e4d256-prod-github-runner-207 kernel: [63888.617243] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 23:08:34 juju-e4d256-prod-github-runner-207 kernel: [63888.617951] RIP: 0033:0x7faa5d0edaff Aug 22 23:08:34 juju-e4d256-prod-github-runner-207 kernel: [63888.618579] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 23:08:34 juju-e4d256-prod-github-runner-207 kernel: [63888.620637] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 23:08:34 juju-e4d256-prod-github-runner-207 kernel: [63888.621589] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 23:08:34 juju-e4d256-prod-github-runner-207 kernel: [63888.622493] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 23:08:34 juju-e4d256-prod-github-runner-207 kernel: [63888.623384] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 23:08:34 juju-e4d256-prod-github-runner-207 kernel: [63888.624280] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 23:08:34 juju-e4d256-prod-github-runner-207 kernel: [63888.625314] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 23:08:34 juju-e4d256-prod-github-runner-207 kernel: [63888.626227] Aug 22 23:08:47 juju-e4d256-prod-github-runner-207 kernel: [63901.448713] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 23:08:47 juju-e4d256-prod-github-runner-207 kernel: [63901.449697] rcu: 1-....: (15895804 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=7674981 Aug 22 23:08:47 juju-e4d256-prod-github-runner-207 kernel: [63901.450850] (t=15946062 jiffies g=23269 q=56359) Aug 22 23:08:47 juju-e4d256-prod-github-runner-207 kernel: [63901.451660] NMI backtrace for cpu 1 Aug 22 23:08:47 juju-e4d256-prod-github-runner-207 kernel: [63901.452383] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 23:08:47 juju-e4d256-prod-github-runner-207 kernel: [63901.453538] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 23:08:47 juju-e4d256-prod-github-runner-207 kernel: [63901.454655] Call Trace: Aug 22 23:08:47 juju-e4d256-prod-github-runner-207 kernel: [63901.455349] Aug 22 23:08:47 juju-e4d256-prod-github-runner-207 kernel: [63901.456003] show_stack+0x52/0x5c Aug 22 23:08:47 juju-e4d256-prod-github-runner-207 kernel: [63901.456775] dump_stack_lvl+0x4a/0x63 Aug 22 23:08:47 juju-e4d256-prod-github-runner-207 kernel: [63901.457612] dump_stack+0x10/0x16 Aug 22 23:08:47 juju-e4d256-prod-github-runner-207 kernel: [63901.458344] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 23:08:47 juju-e4d256-prod-github-runner-207 kernel: [63901.459140] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 23:08:47 juju-e4d256-prod-github-runner-207 kernel: [63901.459954] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 23:08:47 juju-e4d256-prod-github-runner-207 kernel: [63901.460791] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 23:08:47 juju-e4d256-prod-github-runner-207 kernel: [63901.461653] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 23:08:47 juju-e4d256-prod-github-runner-207 kernel: [63901.462502] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 23:08:47 juju-e4d256-prod-github-runner-207 kernel: [63901.463305] print_cpu_stall.cold+0x2f/0xe2 Aug 22 23:08:47 juju-e4d256-prod-github-runner-207 kernel: [63901.464094] ? timekeeping_update+0xf7/0x150 Aug 22 23:08:47 juju-e4d256-prod-github-runner-207 kernel: [63901.465090] check_cpu_stall+0x109/0x270 Aug 22 23:08:47 juju-e4d256-prod-github-runner-207 kernel: [63901.465858] rcu_sched_clock_irq+0x9a/0x250 Aug 22 23:08:47 juju-e4d256-prod-github-runner-207 kernel: [63901.466656] update_process_times+0x94/0xd0 Aug 22 23:08:47 juju-e4d256-prod-github-runner-207 kernel: [63901.467622] tick_sched_handle+0x29/0x70 Aug 22 23:08:47 juju-e4d256-prod-github-runner-207 kernel: [63901.468591] tick_sched_timer+0x8c/0xc0 Aug 22 23:08:47 juju-e4d256-prod-github-runner-207 kernel: [63901.469466] ? tick_nohz_handler+0xb0/0xb0 Aug 22 23:08:47 juju-e4d256-prod-github-runner-207 kernel: [63901.470276] __hrtimer_run_queues+0x107/0x230 Aug 22 23:08:47 juju-e4d256-prod-github-runner-207 kernel: [63901.471234] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 23:08:47 juju-e4d256-prod-github-runner-207 kernel: [63901.472046] hrtimer_interrupt+0x101/0x220 Aug 22 23:08:47 juju-e4d256-prod-github-runner-207 kernel: [63901.472832] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 23:08:47 juju-e4d256-prod-github-runner-207 kernel: [63901.473714] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 23:08:47 juju-e4d256-prod-github-runner-207 kernel: [63901.474560] Aug 22 23:08:47 juju-e4d256-prod-github-runner-207 kernel: [63901.475215] Aug 22 23:08:47 juju-e4d256-prod-github-runner-207 kernel: [63901.475935] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 23:08:47 juju-e4d256-prod-github-runner-207 kernel: [63901.476883] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:08:47 juju-e4d256-prod-github-runner-207 kernel: [63901.477887] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 23:08:47 juju-e4d256-prod-github-runner-207 kernel: [63901.480201] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 23:08:47 juju-e4d256-prod-github-runner-207 kernel: [63901.481142] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 23:08:47 juju-e4d256-prod-github-runner-207 kernel: [63901.482167] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 23:08:47 juju-e4d256-prod-github-runner-207 kernel: [63901.483172] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 23:08:47 juju-e4d256-prod-github-runner-207 kernel: [63901.484172] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 23:08:47 juju-e4d256-prod-github-runner-207 kernel: [63901.485174] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 23:08:47 juju-e4d256-prod-github-runner-207 kernel: [63901.486160] ? _raw_spin_lock+0x22/0x30 Aug 22 23:08:47 juju-e4d256-prod-github-runner-207 kernel: [63901.486935] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:08:47 juju-e4d256-prod-github-runner-207 kernel: [63901.487790] direct_page_fault+0x206/0x310 [kvm] Aug 22 23:08:47 juju-e4d256-prod-github-runner-207 kernel: [63901.488692] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 23:08:47 juju-e4d256-prod-github-runner-207 kernel: [63901.489556] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 23:08:47 juju-e4d256-prod-github-runner-207 kernel: [63901.490410] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 23:08:47 juju-e4d256-prod-github-runner-207 kernel: [63901.491262] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 23:08:47 juju-e4d256-prod-github-runner-207 kernel: [63901.492063] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 23:08:47 juju-e4d256-prod-github-runner-207 kernel: [63901.492970] handle_exit+0x98/0x230 [kvm_amd] Aug 22 23:08:47 juju-e4d256-prod-github-runner-207 kernel: [63901.493757] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 23:08:47 juju-e4d256-prod-github-runner-207 kernel: [63901.494576] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 23:08:47 juju-e4d256-prod-github-runner-207 kernel: [63901.495406] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 23:08:47 juju-e4d256-prod-github-runner-207 kernel: [63901.496207] vcpu_run+0x62/0x2c0 [kvm] Aug 22 23:08:47 juju-e4d256-prod-github-runner-207 kernel: [63901.496937] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 23:08:47 juju-e4d256-prod-github-runner-207 kernel: [63901.497700] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 23:08:47 juju-e4d256-prod-github-runner-207 kernel: [63901.498566] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 23:08:47 juju-e4d256-prod-github-runner-207 kernel: [63901.499357] ? __seccomp_filter+0x4a/0x4a0 Aug 22 23:08:47 juju-e4d256-prod-github-runner-207 kernel: [63901.500092] ? __fget_files+0x86/0xc0 Aug 22 23:08:47 juju-e4d256-prod-github-runner-207 kernel: [63901.500799] __x64_sys_ioctl+0x95/0xd0 Aug 22 23:08:47 juju-e4d256-prod-github-runner-207 kernel: [63901.501532] do_syscall_64+0x5c/0xc0 Aug 22 23:08:47 juju-e4d256-prod-github-runner-207 kernel: [63901.502231] ? do_futex+0x162/0x1f0 Aug 22 23:08:47 juju-e4d256-prod-github-runner-207 kernel: [63901.502923] ? __x64_sys_futex+0x78/0x1e0 Aug 22 23:08:47 juju-e4d256-prod-github-runner-207 kernel: [63901.503645] ? __secure_computing+0xa9/0x120 Aug 22 23:08:47 juju-e4d256-prod-github-runner-207 kernel: [63901.504380] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 23:08:47 juju-e4d256-prod-github-runner-207 kernel: [63901.505214] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:08:47 juju-e4d256-prod-github-runner-207 kernel: [63901.505988] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:08:47 juju-e4d256-prod-github-runner-207 kernel: [63901.506760] ? do_syscall_64+0x69/0xc0 Aug 22 23:08:47 juju-e4d256-prod-github-runner-207 kernel: [63901.507518] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:08:47 juju-e4d256-prod-github-runner-207 kernel: [63901.508292] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:08:47 juju-e4d256-prod-github-runner-207 kernel: [63901.509130] ? do_syscall_64+0x69/0xc0 Aug 22 23:08:47 juju-e4d256-prod-github-runner-207 kernel: [63901.509845] ? do_syscall_64+0x69/0xc0 Aug 22 23:08:47 juju-e4d256-prod-github-runner-207 kernel: [63901.510546] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 23:08:47 juju-e4d256-prod-github-runner-207 kernel: [63901.511343] RIP: 0033:0x7faa5d0edaff Aug 22 23:08:47 juju-e4d256-prod-github-runner-207 kernel: [63901.512039] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 23:08:47 juju-e4d256-prod-github-runner-207 kernel: [63901.514227] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 23:08:47 juju-e4d256-prod-github-runner-207 kernel: [63901.515218] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 23:08:47 juju-e4d256-prod-github-runner-207 kernel: [63901.516195] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 23:08:47 juju-e4d256-prod-github-runner-207 kernel: [63901.517191] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 23:08:47 juju-e4d256-prod-github-runner-207 kernel: [63901.518167] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 23:08:47 juju-e4d256-prod-github-runner-207 kernel: [63901.519147] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 23:08:47 juju-e4d256-prod-github-runner-207 kernel: [63901.520115] Aug 22 23:09:14 juju-e4d256-prod-github-runner-207 kernel: [63928.541981] watchdog: BUG: soft lockup - CPU#1 stuck for 59430s! [qemu-system-x86:6715] Aug 22 23:09:14 juju-e4d256-prod-github-runner-207 kernel: [63928.543180] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 23:09:14 juju-e4d256-prod-github-runner-207 kernel: [63928.543253] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 23:09:14 juju-e4d256-prod-github-runner-207 kernel: [63928.555519] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 23:09:14 juju-e4d256-prod-github-runner-207 kernel: [63928.556819] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 23:09:14 juju-e4d256-prod-github-runner-207 kernel: [63928.558062] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:09:14 juju-e4d256-prod-github-runner-207 kernel: [63928.559127] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 23:09:14 juju-e4d256-prod-github-runner-207 kernel: [63928.561698] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 23:09:14 juju-e4d256-prod-github-runner-207 kernel: [63928.562754] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 23:09:14 juju-e4d256-prod-github-runner-207 kernel: [63928.563917] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 23:09:14 juju-e4d256-prod-github-runner-207 kernel: [63928.565096] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 23:09:14 juju-e4d256-prod-github-runner-207 kernel: [63928.566278] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 23:09:14 juju-e4d256-prod-github-runner-207 kernel: [63928.567455] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 23:09:14 juju-e4d256-prod-github-runner-207 kernel: [63928.568627] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 23:09:14 juju-e4d256-prod-github-runner-207 kernel: [63928.569892] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 23:09:14 juju-e4d256-prod-github-runner-207 kernel: [63928.571530] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 23:09:14 juju-e4d256-prod-github-runner-207 kernel: [63928.573120] Call Trace: Aug 22 23:09:14 juju-e4d256-prod-github-runner-207 kernel: [63928.574184] Aug 22 23:09:14 juju-e4d256-prod-github-runner-207 kernel: [63928.575087] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:09:14 juju-e4d256-prod-github-runner-207 kernel: [63928.576125] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:09:14 juju-e4d256-prod-github-runner-207 kernel: [63928.577193] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:09:14 juju-e4d256-prod-github-runner-207 kernel: [63928.578289] ? show_regs.part.0+0x23/0x29 Aug 22 23:09:14 juju-e4d256-prod-github-runner-207 kernel: [63928.579350] ? show_regs.cold+0x8/0xd Aug 22 23:09:14 juju-e4d256-prod-github-runner-207 kernel: [63928.580326] ? watchdog_timer_fn+0x1be/0x220 Aug 22 23:09:14 juju-e4d256-prod-github-runner-207 kernel: [63928.581356] ? lockup_detector_update_enable+0x60/0x60 Aug 22 23:09:14 juju-e4d256-prod-github-runner-207 kernel: [63928.582442] ? __hrtimer_run_queues+0x107/0x230 Aug 22 23:09:14 juju-e4d256-prod-github-runner-207 kernel: [63928.583477] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 23:09:14 juju-e4d256-prod-github-runner-207 kernel: [63928.584519] ? hrtimer_interrupt+0x101/0x220 Aug 22 23:09:14 juju-e4d256-prod-github-runner-207 kernel: [63928.585595] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 23:09:14 juju-e4d256-prod-github-runner-207 kernel: [63928.586698] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 23:09:14 juju-e4d256-prod-github-runner-207 kernel: [63928.587808] Aug 22 23:09:14 juju-e4d256-prod-github-runner-207 kernel: [63928.588724] Aug 22 23:09:14 juju-e4d256-prod-github-runner-207 kernel: [63928.589569] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 23:09:14 juju-e4d256-prod-github-runner-207 kernel: [63928.590624] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:09:14 juju-e4d256-prod-github-runner-207 kernel: [63928.591667] ? _raw_spin_lock+0x22/0x30 Aug 22 23:09:14 juju-e4d256-prod-github-runner-207 kernel: [63928.592620] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:09:14 juju-e4d256-prod-github-runner-207 kernel: [63928.593718] direct_page_fault+0x206/0x310 [kvm] Aug 22 23:09:14 juju-e4d256-prod-github-runner-207 kernel: [63928.594777] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 23:09:14 juju-e4d256-prod-github-runner-207 kernel: [63928.595814] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 23:09:14 juju-e4d256-prod-github-runner-207 kernel: [63928.596940] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 23:09:14 juju-e4d256-prod-github-runner-207 kernel: [63928.597946] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 23:09:14 juju-e4d256-prod-github-runner-207 kernel: [63928.598910] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 23:09:14 juju-e4d256-prod-github-runner-207 kernel: [63928.599890] handle_exit+0x98/0x230 [kvm_amd] Aug 22 23:09:14 juju-e4d256-prod-github-runner-207 kernel: [63928.600812] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 23:09:14 juju-e4d256-prod-github-runner-207 kernel: [63928.601743] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 23:09:14 juju-e4d256-prod-github-runner-207 kernel: [63928.602687] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 23:09:14 juju-e4d256-prod-github-runner-207 kernel: [63928.603594] vcpu_run+0x62/0x2c0 [kvm] Aug 22 23:09:14 juju-e4d256-prod-github-runner-207 kernel: [63928.604406] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 23:09:14 juju-e4d256-prod-github-runner-207 kernel: [63928.605234] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 23:09:14 juju-e4d256-prod-github-runner-207 kernel: [63928.606102] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 23:09:14 juju-e4d256-prod-github-runner-207 kernel: [63928.606907] ? __seccomp_filter+0x4a/0x4a0 Aug 22 23:09:14 juju-e4d256-prod-github-runner-207 kernel: [63928.607652] ? __fget_files+0x86/0xc0 Aug 22 23:09:14 juju-e4d256-prod-github-runner-207 kernel: [63928.608358] __x64_sys_ioctl+0x95/0xd0 Aug 22 23:09:14 juju-e4d256-prod-github-runner-207 kernel: [63928.609075] do_syscall_64+0x5c/0xc0 Aug 22 23:09:14 juju-e4d256-prod-github-runner-207 kernel: [63928.609745] ? do_futex+0x162/0x1f0 Aug 22 23:09:14 juju-e4d256-prod-github-runner-207 kernel: [63928.610412] ? __x64_sys_futex+0x78/0x1e0 Aug 22 23:09:14 juju-e4d256-prod-github-runner-207 kernel: [63928.611088] ? __secure_computing+0xa9/0x120 Aug 22 23:09:14 juju-e4d256-prod-github-runner-207 kernel: [63928.611863] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 23:09:14 juju-e4d256-prod-github-runner-207 kernel: [63928.612984] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:09:14 juju-e4d256-prod-github-runner-207 kernel: [63928.613915] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:09:14 juju-e4d256-prod-github-runner-207 kernel: [63928.614727] ? do_syscall_64+0x69/0xc0 Aug 22 23:09:14 juju-e4d256-prod-github-runner-207 kernel: [63928.615469] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:09:14 juju-e4d256-prod-github-runner-207 kernel: [63928.616198] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:09:14 juju-e4d256-prod-github-runner-207 kernel: [63928.616949] ? do_syscall_64+0x69/0xc0 Aug 22 23:09:14 juju-e4d256-prod-github-runner-207 kernel: [63928.617604] ? do_syscall_64+0x69/0xc0 Aug 22 23:09:14 juju-e4d256-prod-github-runner-207 kernel: [63928.618258] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 23:09:14 juju-e4d256-prod-github-runner-207 kernel: [63928.618967] RIP: 0033:0x7faa5d0edaff Aug 22 23:09:14 juju-e4d256-prod-github-runner-207 kernel: [63928.619620] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 23:09:14 juju-e4d256-prod-github-runner-207 kernel: [63928.621662] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 23:09:14 juju-e4d256-prod-github-runner-207 kernel: [63928.622574] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 23:09:14 juju-e4d256-prod-github-runner-207 kernel: [63928.623469] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 23:09:14 juju-e4d256-prod-github-runner-207 kernel: [63928.624359] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 23:09:14 juju-e4d256-prod-github-runner-207 kernel: [63928.625290] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 23:09:14 juju-e4d256-prod-github-runner-207 kernel: [63928.626204] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 23:09:14 juju-e4d256-prod-github-runner-207 kernel: [63928.627141] Aug 22 23:09:42 juju-e4d256-prod-github-runner-207 kernel: [63956.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 59456s! [qemu-system-x86:6715] Aug 22 23:09:42 juju-e4d256-prod-github-runner-207 kernel: [63956.543802] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 23:09:42 juju-e4d256-prod-github-runner-207 kernel: [63956.544100] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 23:09:42 juju-e4d256-prod-github-runner-207 kernel: [63956.556590] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 23:09:42 juju-e4d256-prod-github-runner-207 kernel: [63956.557895] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 23:09:42 juju-e4d256-prod-github-runner-207 kernel: [63956.559179] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:09:42 juju-e4d256-prod-github-runner-207 kernel: [63956.560271] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 23:09:42 juju-e4d256-prod-github-runner-207 kernel: [63956.562908] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 23:09:42 juju-e4d256-prod-github-runner-207 kernel: [63956.563965] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 23:09:42 juju-e4d256-prod-github-runner-207 kernel: [63956.565165] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 23:09:42 juju-e4d256-prod-github-runner-207 kernel: [63956.566348] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 23:09:42 juju-e4d256-prod-github-runner-207 kernel: [63956.567536] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 23:09:42 juju-e4d256-prod-github-runner-207 kernel: [63956.568793] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 23:09:42 juju-e4d256-prod-github-runner-207 kernel: [63956.569988] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 23:09:42 juju-e4d256-prod-github-runner-207 kernel: [63956.571246] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 23:09:42 juju-e4d256-prod-github-runner-207 kernel: [63956.572426] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 23:09:42 juju-e4d256-prod-github-runner-207 kernel: [63956.573707] Call Trace: Aug 22 23:09:42 juju-e4d256-prod-github-runner-207 kernel: [63956.574712] Aug 22 23:09:42 juju-e4d256-prod-github-runner-207 kernel: [63956.575693] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:09:42 juju-e4d256-prod-github-runner-207 kernel: [63956.576764] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:09:42 juju-e4d256-prod-github-runner-207 kernel: [63956.577817] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:09:42 juju-e4d256-prod-github-runner-207 kernel: [63956.579006] ? show_regs.part.0+0x23/0x29 Aug 22 23:09:42 juju-e4d256-prod-github-runner-207 kernel: [63956.580046] ? show_regs.cold+0x8/0xd Aug 22 23:09:42 juju-e4d256-prod-github-runner-207 kernel: [63956.581103] ? watchdog_timer_fn+0x1be/0x220 Aug 22 23:09:42 juju-e4d256-prod-github-runner-207 kernel: [63956.582137] ? lockup_detector_update_enable+0x60/0x60 Aug 22 23:09:42 juju-e4d256-prod-github-runner-207 kernel: [63956.583221] ? __hrtimer_run_queues+0x107/0x230 Aug 22 23:09:42 juju-e4d256-prod-github-runner-207 kernel: [63956.584315] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 23:09:42 juju-e4d256-prod-github-runner-207 kernel: [63956.585606] ? hrtimer_interrupt+0x101/0x220 Aug 22 23:09:42 juju-e4d256-prod-github-runner-207 kernel: [63956.586640] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 23:09:42 juju-e4d256-prod-github-runner-207 kernel: [63956.587754] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 23:09:42 juju-e4d256-prod-github-runner-207 kernel: [63956.588892] Aug 22 23:09:42 juju-e4d256-prod-github-runner-207 kernel: [63956.589875] Aug 22 23:09:42 juju-e4d256-prod-github-runner-207 kernel: [63956.590757] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 23:09:42 juju-e4d256-prod-github-runner-207 kernel: [63956.591809] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:09:42 juju-e4d256-prod-github-runner-207 kernel: [63956.592910] ? _raw_spin_lock+0x22/0x30 Aug 22 23:09:42 juju-e4d256-prod-github-runner-207 kernel: [63956.593905] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:09:42 juju-e4d256-prod-github-runner-207 kernel: [63956.595163] direct_page_fault+0x206/0x310 [kvm] Aug 22 23:09:42 juju-e4d256-prod-github-runner-207 kernel: [63956.596224] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 23:09:42 juju-e4d256-prod-github-runner-207 kernel: [63956.597282] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 23:09:42 juju-e4d256-prod-github-runner-207 kernel: [63956.598306] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 23:09:42 juju-e4d256-prod-github-runner-207 kernel: [63956.599376] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 23:09:42 juju-e4d256-prod-github-runner-207 kernel: [63956.600376] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 23:09:42 juju-e4d256-prod-github-runner-207 kernel: [63956.601377] handle_exit+0x98/0x230 [kvm_amd] Aug 22 23:09:42 juju-e4d256-prod-github-runner-207 kernel: [63956.602284] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 23:09:42 juju-e4d256-prod-github-runner-207 kernel: [63956.603217] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 23:09:42 juju-e4d256-prod-github-runner-207 kernel: [63956.604166] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 23:09:42 juju-e4d256-prod-github-runner-207 kernel: [63956.605118] vcpu_run+0x62/0x2c0 [kvm] Aug 22 23:09:42 juju-e4d256-prod-github-runner-207 kernel: [63956.605954] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 23:09:42 juju-e4d256-prod-github-runner-207 kernel: [63956.606777] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 23:09:42 juju-e4d256-prod-github-runner-207 kernel: [63956.607647] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 23:09:42 juju-e4d256-prod-github-runner-207 kernel: [63956.608504] ? __seccomp_filter+0x4a/0x4a0 Aug 22 23:09:42 juju-e4d256-prod-github-runner-207 kernel: [63956.609302] ? __fget_files+0x86/0xc0 Aug 22 23:09:42 juju-e4d256-prod-github-runner-207 kernel: [63956.610052] __x64_sys_ioctl+0x95/0xd0 Aug 22 23:09:42 juju-e4d256-prod-github-runner-207 kernel: [63956.610766] do_syscall_64+0x5c/0xc0 Aug 22 23:09:42 juju-e4d256-prod-github-runner-207 kernel: [63956.611463] ? do_futex+0x162/0x1f0 Aug 22 23:09:42 juju-e4d256-prod-github-runner-207 kernel: [63956.612137] ? __x64_sys_futex+0x78/0x1e0 Aug 22 23:09:42 juju-e4d256-prod-github-runner-207 kernel: [63956.612846] ? __secure_computing+0xa9/0x120 Aug 22 23:09:42 juju-e4d256-prod-github-runner-207 kernel: [63956.613546] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 23:09:42 juju-e4d256-prod-github-runner-207 kernel: [63956.614318] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:09:42 juju-e4d256-prod-github-runner-207 kernel: [63956.615067] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:09:42 juju-e4d256-prod-github-runner-207 kernel: [63956.615800] ? do_syscall_64+0x69/0xc0 Aug 22 23:09:42 juju-e4d256-prod-github-runner-207 kernel: [63956.616480] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:09:42 juju-e4d256-prod-github-runner-207 kernel: [63956.617197] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:09:42 juju-e4d256-prod-github-runner-207 kernel: [63956.617902] ? do_syscall_64+0x69/0xc0 Aug 22 23:09:42 juju-e4d256-prod-github-runner-207 kernel: [63956.618535] ? do_syscall_64+0x69/0xc0 Aug 22 23:09:42 juju-e4d256-prod-github-runner-207 kernel: [63956.619172] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 23:09:42 juju-e4d256-prod-github-runner-207 kernel: [63956.619901] RIP: 0033:0x7faa5d0edaff Aug 22 23:09:42 juju-e4d256-prod-github-runner-207 kernel: [63956.620600] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 23:09:42 juju-e4d256-prod-github-runner-207 kernel: [63956.622650] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 23:09:42 juju-e4d256-prod-github-runner-207 kernel: [63956.623585] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 23:09:42 juju-e4d256-prod-github-runner-207 kernel: [63956.624514] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 23:09:42 juju-e4d256-prod-github-runner-207 kernel: [63956.625454] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 23:09:42 juju-e4d256-prod-github-runner-207 kernel: [63956.626365] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 23:09:42 juju-e4d256-prod-github-runner-207 kernel: [63956.627276] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 23:09:42 juju-e4d256-prod-github-runner-207 kernel: [63956.628197] Aug 22 23:10:10 juju-e4d256-prod-github-runner-207 kernel: [63984.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 59482s! [qemu-system-x86:6715] Aug 22 23:10:10 juju-e4d256-prod-github-runner-207 kernel: [63984.543112] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 23:10:10 juju-e4d256-prod-github-runner-207 kernel: [63984.543189] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 23:10:10 juju-e4d256-prod-github-runner-207 kernel: [63984.555779] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 23:10:10 juju-e4d256-prod-github-runner-207 kernel: [63984.557072] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 23:10:10 juju-e4d256-prod-github-runner-207 kernel: [63984.558294] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:10:10 juju-e4d256-prod-github-runner-207 kernel: [63984.559358] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 23:10:10 juju-e4d256-prod-github-runner-207 kernel: [63984.562101] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 23:10:10 juju-e4d256-prod-github-runner-207 kernel: [63984.563759] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 23:10:10 juju-e4d256-prod-github-runner-207 kernel: [63984.565032] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 23:10:10 juju-e4d256-prod-github-runner-207 kernel: [63984.566224] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 23:10:10 juju-e4d256-prod-github-runner-207 kernel: [63984.567393] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 23:10:10 juju-e4d256-prod-github-runner-207 kernel: [63984.568661] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 23:10:10 juju-e4d256-prod-github-runner-207 kernel: [63984.569890] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 23:10:10 juju-e4d256-prod-github-runner-207 kernel: [63984.571134] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 23:10:10 juju-e4d256-prod-github-runner-207 kernel: [63984.572259] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 23:10:10 juju-e4d256-prod-github-runner-207 kernel: [63984.573464] Call Trace: Aug 22 23:10:10 juju-e4d256-prod-github-runner-207 kernel: [63984.574396] Aug 22 23:10:10 juju-e4d256-prod-github-runner-207 kernel: [63984.575289] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:10:10 juju-e4d256-prod-github-runner-207 kernel: [63984.576347] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:10:10 juju-e4d256-prod-github-runner-207 kernel: [63984.577450] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:10:10 juju-e4d256-prod-github-runner-207 kernel: [63984.578527] ? show_regs.part.0+0x23/0x29 Aug 22 23:10:10 juju-e4d256-prod-github-runner-207 kernel: [63984.579531] ? show_regs.cold+0x8/0xd Aug 22 23:10:10 juju-e4d256-prod-github-runner-207 kernel: [63984.580526] ? watchdog_timer_fn+0x1be/0x220 Aug 22 23:10:10 juju-e4d256-prod-github-runner-207 kernel: [63984.581563] ? lockup_detector_update_enable+0x60/0x60 Aug 22 23:10:10 juju-e4d256-prod-github-runner-207 kernel: [63984.582630] ? __hrtimer_run_queues+0x107/0x230 Aug 22 23:10:10 juju-e4d256-prod-github-runner-207 kernel: [63984.583657] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 23:10:10 juju-e4d256-prod-github-runner-207 kernel: [63984.584702] ? hrtimer_interrupt+0x101/0x220 Aug 22 23:10:10 juju-e4d256-prod-github-runner-207 kernel: [63984.585738] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 23:10:10 juju-e4d256-prod-github-runner-207 kernel: [63984.586848] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 23:10:10 juju-e4d256-prod-github-runner-207 kernel: [63984.587898] Aug 22 23:10:10 juju-e4d256-prod-github-runner-207 kernel: [63984.588778] Aug 22 23:10:10 juju-e4d256-prod-github-runner-207 kernel: [63984.589618] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 23:10:10 juju-e4d256-prod-github-runner-207 kernel: [63984.590656] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:10:10 juju-e4d256-prod-github-runner-207 kernel: [63984.591706] ? _raw_spin_lock+0x22/0x30 Aug 22 23:10:10 juju-e4d256-prod-github-runner-207 kernel: [63984.592678] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:10:10 juju-e4d256-prod-github-runner-207 kernel: [63984.593800] direct_page_fault+0x206/0x310 [kvm] Aug 22 23:10:10 juju-e4d256-prod-github-runner-207 kernel: [63984.594841] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 23:10:10 juju-e4d256-prod-github-runner-207 kernel: [63984.595910] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 23:10:10 juju-e4d256-prod-github-runner-207 kernel: [63984.597018] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 23:10:10 juju-e4d256-prod-github-runner-207 kernel: [63984.598023] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 23:10:10 juju-e4d256-prod-github-runner-207 kernel: [63984.599099] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 23:10:10 juju-e4d256-prod-github-runner-207 kernel: [63984.600130] handle_exit+0x98/0x230 [kvm_amd] Aug 22 23:10:10 juju-e4d256-prod-github-runner-207 kernel: [63984.601038] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 23:10:10 juju-e4d256-prod-github-runner-207 kernel: [63984.601977] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 23:10:10 juju-e4d256-prod-github-runner-207 kernel: [63984.602936] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 23:10:10 juju-e4d256-prod-github-runner-207 kernel: [63984.603853] vcpu_run+0x62/0x2c0 [kvm] Aug 22 23:10:10 juju-e4d256-prod-github-runner-207 kernel: [63984.604922] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 23:10:10 juju-e4d256-prod-github-runner-207 kernel: [63984.605854] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 23:10:10 juju-e4d256-prod-github-runner-207 kernel: [63984.606786] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 23:10:10 juju-e4d256-prod-github-runner-207 kernel: [63984.607665] ? __seccomp_filter+0x4a/0x4a0 Aug 22 23:10:10 juju-e4d256-prod-github-runner-207 kernel: [63984.608469] ? __fget_files+0x86/0xc0 Aug 22 23:10:10 juju-e4d256-prod-github-runner-207 kernel: [63984.609185] __x64_sys_ioctl+0x95/0xd0 Aug 22 23:10:10 juju-e4d256-prod-github-runner-207 kernel: [63984.609881] do_syscall_64+0x5c/0xc0 Aug 22 23:10:10 juju-e4d256-prod-github-runner-207 kernel: [63984.610549] ? do_futex+0x162/0x1f0 Aug 22 23:10:10 juju-e4d256-prod-github-runner-207 kernel: [63984.611199] ? __x64_sys_futex+0x78/0x1e0 Aug 22 23:10:10 juju-e4d256-prod-github-runner-207 kernel: [63984.611873] ? __secure_computing+0xa9/0x120 Aug 22 23:10:10 juju-e4d256-prod-github-runner-207 kernel: [63984.612629] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 23:10:10 juju-e4d256-prod-github-runner-207 kernel: [63984.613391] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:10:10 juju-e4d256-prod-github-runner-207 kernel: [63984.614119] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:10:10 juju-e4d256-prod-github-runner-207 kernel: [63984.614850] ? do_syscall_64+0x69/0xc0 Aug 22 23:10:10 juju-e4d256-prod-github-runner-207 kernel: [63984.615578] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:10:10 juju-e4d256-prod-github-runner-207 kernel: [63984.616564] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:10:10 juju-e4d256-prod-github-runner-207 kernel: [63984.617518] ? do_syscall_64+0x69/0xc0 Aug 22 23:10:10 juju-e4d256-prod-github-runner-207 kernel: [63984.618354] ? do_syscall_64+0x69/0xc0 Aug 22 23:10:10 juju-e4d256-prod-github-runner-207 kernel: [63984.619187] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 23:10:10 juju-e4d256-prod-github-runner-207 kernel: [63984.620128] RIP: 0033:0x7faa5d0edaff Aug 22 23:10:10 juju-e4d256-prod-github-runner-207 kernel: [63984.620941] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 23:10:10 juju-e4d256-prod-github-runner-207 kernel: [63984.623023] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 23:10:10 juju-e4d256-prod-github-runner-207 kernel: [63984.623943] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 23:10:10 juju-e4d256-prod-github-runner-207 kernel: [63984.624853] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 23:10:10 juju-e4d256-prod-github-runner-207 kernel: [63984.625746] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 23:10:10 juju-e4d256-prod-github-runner-207 kernel: [63984.626680] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 23:10:10 juju-e4d256-prod-github-runner-207 kernel: [63984.627580] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 23:10:10 juju-e4d256-prod-github-runner-207 kernel: [63984.628554] Aug 22 23:10:38 juju-e4d256-prod-github-runner-207 kernel: [64012.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 59508s! [qemu-system-x86:6715] Aug 22 23:10:38 juju-e4d256-prod-github-runner-207 kernel: [64012.543119] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 23:10:38 juju-e4d256-prod-github-runner-207 kernel: [64012.543191] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 23:10:38 juju-e4d256-prod-github-runner-207 kernel: [64012.555385] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 23:10:38 juju-e4d256-prod-github-runner-207 kernel: [64012.556678] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 23:10:38 juju-e4d256-prod-github-runner-207 kernel: [64012.557901] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:10:38 juju-e4d256-prod-github-runner-207 kernel: [64012.558990] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 23:10:38 juju-e4d256-prod-github-runner-207 kernel: [64012.561556] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 23:10:38 juju-e4d256-prod-github-runner-207 kernel: [64012.562614] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 23:10:38 juju-e4d256-prod-github-runner-207 kernel: [64012.563797] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 23:10:38 juju-e4d256-prod-github-runner-207 kernel: [64012.564966] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 23:10:38 juju-e4d256-prod-github-runner-207 kernel: [64012.566130] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 23:10:38 juju-e4d256-prod-github-runner-207 kernel: [64012.567303] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 23:10:38 juju-e4d256-prod-github-runner-207 kernel: [64012.568482] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 23:10:38 juju-e4d256-prod-github-runner-207 kernel: [64012.569721] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 23:10:38 juju-e4d256-prod-github-runner-207 kernel: [64012.570819] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 23:10:38 juju-e4d256-prod-github-runner-207 kernel: [64012.572024] Call Trace: Aug 22 23:10:38 juju-e4d256-prod-github-runner-207 kernel: [64012.572936] Aug 22 23:10:38 juju-e4d256-prod-github-runner-207 kernel: [64012.573838] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:10:38 juju-e4d256-prod-github-runner-207 kernel: [64012.574932] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:10:38 juju-e4d256-prod-github-runner-207 kernel: [64012.575965] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:10:38 juju-e4d256-prod-github-runner-207 kernel: [64012.577039] ? show_regs.part.0+0x23/0x29 Aug 22 23:10:38 juju-e4d256-prod-github-runner-207 kernel: [64012.578035] ? show_regs.cold+0x8/0xd Aug 22 23:10:38 juju-e4d256-prod-github-runner-207 kernel: [64012.579005] ? watchdog_timer_fn+0x1be/0x220 Aug 22 23:10:38 juju-e4d256-prod-github-runner-207 kernel: [64012.580023] ? lockup_detector_update_enable+0x60/0x60 Aug 22 23:10:38 juju-e4d256-prod-github-runner-207 kernel: [64012.581087] ? __hrtimer_run_queues+0x107/0x230 Aug 22 23:10:38 juju-e4d256-prod-github-runner-207 kernel: [64012.582112] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 23:10:38 juju-e4d256-prod-github-runner-207 kernel: [64012.583138] ? hrtimer_interrupt+0x101/0x220 Aug 22 23:10:38 juju-e4d256-prod-github-runner-207 kernel: [64012.584167] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 23:10:38 juju-e4d256-prod-github-runner-207 kernel: [64012.585237] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 23:10:38 juju-e4d256-prod-github-runner-207 kernel: [64012.586468] Aug 22 23:10:38 juju-e4d256-prod-github-runner-207 kernel: [64012.587323] Aug 22 23:10:38 juju-e4d256-prod-github-runner-207 kernel: [64012.588189] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 23:10:38 juju-e4d256-prod-github-runner-207 kernel: [64012.589403] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:10:38 juju-e4d256-prod-github-runner-207 kernel: [64012.590449] ? _raw_spin_lock+0x22/0x30 Aug 22 23:10:38 juju-e4d256-prod-github-runner-207 kernel: [64012.591391] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:10:38 juju-e4d256-prod-github-runner-207 kernel: [64012.592422] direct_page_fault+0x206/0x310 [kvm] Aug 22 23:10:38 juju-e4d256-prod-github-runner-207 kernel: [64012.593448] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 23:10:38 juju-e4d256-prod-github-runner-207 kernel: [64012.594457] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 23:10:38 juju-e4d256-prod-github-runner-207 kernel: [64012.595471] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 23:10:38 juju-e4d256-prod-github-runner-207 kernel: [64012.596461] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 23:10:38 juju-e4d256-prod-github-runner-207 kernel: [64012.597413] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 23:10:38 juju-e4d256-prod-github-runner-207 kernel: [64012.598396] handle_exit+0x98/0x230 [kvm_amd] Aug 22 23:10:38 juju-e4d256-prod-github-runner-207 kernel: [64012.599315] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 23:10:38 juju-e4d256-prod-github-runner-207 kernel: [64012.600246] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 23:10:38 juju-e4d256-prod-github-runner-207 kernel: [64012.601171] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 23:10:38 juju-e4d256-prod-github-runner-207 kernel: [64012.602092] vcpu_run+0x62/0x2c0 [kvm] Aug 22 23:10:38 juju-e4d256-prod-github-runner-207 kernel: [64012.602902] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 23:10:38 juju-e4d256-prod-github-runner-207 kernel: [64012.603730] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 23:10:38 juju-e4d256-prod-github-runner-207 kernel: [64012.604587] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 23:10:38 juju-e4d256-prod-github-runner-207 kernel: [64012.605392] ? __seccomp_filter+0x4a/0x4a0 Aug 22 23:10:38 juju-e4d256-prod-github-runner-207 kernel: [64012.606143] ? __fget_files+0x86/0xc0 Aug 22 23:10:38 juju-e4d256-prod-github-runner-207 kernel: [64012.606865] __x64_sys_ioctl+0x95/0xd0 Aug 22 23:10:38 juju-e4d256-prod-github-runner-207 kernel: [64012.607567] do_syscall_64+0x5c/0xc0 Aug 22 23:10:38 juju-e4d256-prod-github-runner-207 kernel: [64012.608385] ? do_futex+0x162/0x1f0 Aug 22 23:10:38 juju-e4d256-prod-github-runner-207 kernel: [64012.609035] ? __x64_sys_futex+0x78/0x1e0 Aug 22 23:10:38 juju-e4d256-prod-github-runner-207 kernel: [64012.609709] ? __secure_computing+0xa9/0x120 Aug 22 23:10:38 juju-e4d256-prod-github-runner-207 kernel: [64012.610492] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 23:10:38 juju-e4d256-prod-github-runner-207 kernel: [64012.611357] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:10:38 juju-e4d256-prod-github-runner-207 kernel: [64012.612197] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:10:38 juju-e4d256-prod-github-runner-207 kernel: [64012.613010] ? do_syscall_64+0x69/0xc0 Aug 22 23:10:38 juju-e4d256-prod-github-runner-207 kernel: [64012.613732] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:10:38 juju-e4d256-prod-github-runner-207 kernel: [64012.614527] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:10:38 juju-e4d256-prod-github-runner-207 kernel: [64012.615324] ? do_syscall_64+0x69/0xc0 Aug 22 23:10:38 juju-e4d256-prod-github-runner-207 kernel: [64012.616057] ? do_syscall_64+0x69/0xc0 Aug 22 23:10:38 juju-e4d256-prod-github-runner-207 kernel: [64012.616805] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 23:10:38 juju-e4d256-prod-github-runner-207 kernel: [64012.617677] RIP: 0033:0x7faa5d0edaff Aug 22 23:10:38 juju-e4d256-prod-github-runner-207 kernel: [64012.618369] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 23:10:38 juju-e4d256-prod-github-runner-207 kernel: [64012.620751] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 23:10:38 juju-e4d256-prod-github-runner-207 kernel: [64012.621837] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 23:10:38 juju-e4d256-prod-github-runner-207 kernel: [64012.622859] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 23:10:38 juju-e4d256-prod-github-runner-207 kernel: [64012.623920] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 23:10:38 juju-e4d256-prod-github-runner-207 kernel: [64012.624944] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 23:10:38 juju-e4d256-prod-github-runner-207 kernel: [64012.625959] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 23:10:38 juju-e4d256-prod-github-runner-207 kernel: [64012.626992] Aug 22 23:11:06 juju-e4d256-prod-github-runner-207 kernel: [64040.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 59534s! [qemu-system-x86:6715] Aug 22 23:11:06 juju-e4d256-prod-github-runner-207 kernel: [64040.543862] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 23:11:06 juju-e4d256-prod-github-runner-207 kernel: [64040.544149] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 23:11:06 juju-e4d256-prod-github-runner-207 kernel: [64040.556817] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 23:11:06 juju-e4d256-prod-github-runner-207 kernel: [64040.558163] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 23:11:06 juju-e4d256-prod-github-runner-207 kernel: [64040.559613] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:11:06 juju-e4d256-prod-github-runner-207 kernel: [64040.561064] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 23:11:06 juju-e4d256-prod-github-runner-207 kernel: [64040.564933] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 23:11:06 juju-e4d256-prod-github-runner-207 kernel: [64040.566544] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 23:11:06 juju-e4d256-prod-github-runner-207 kernel: [64040.568625] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 23:11:06 juju-e4d256-prod-github-runner-207 kernel: [64040.570345] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 23:11:06 juju-e4d256-prod-github-runner-207 kernel: [64040.572103] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 23:11:06 juju-e4d256-prod-github-runner-207 kernel: [64040.573848] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 23:11:06 juju-e4d256-prod-github-runner-207 kernel: [64040.575594] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 23:11:06 juju-e4d256-prod-github-runner-207 kernel: [64040.577416] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 23:11:06 juju-e4d256-prod-github-runner-207 kernel: [64040.579039] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 23:11:06 juju-e4d256-prod-github-runner-207 kernel: [64040.580839] Call Trace: Aug 22 23:11:06 juju-e4d256-prod-github-runner-207 kernel: [64040.582241] Aug 22 23:11:06 juju-e4d256-prod-github-runner-207 kernel: [64040.583672] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:11:06 juju-e4d256-prod-github-runner-207 kernel: [64040.585238] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:11:06 juju-e4d256-prod-github-runner-207 kernel: [64040.586763] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:11:06 juju-e4d256-prod-github-runner-207 kernel: [64040.588416] ? show_regs.part.0+0x23/0x29 Aug 22 23:11:06 juju-e4d256-prod-github-runner-207 kernel: [64040.589931] ? show_regs.cold+0x8/0xd Aug 22 23:11:06 juju-e4d256-prod-github-runner-207 kernel: [64040.591413] ? watchdog_timer_fn+0x1be/0x220 Aug 22 23:11:06 juju-e4d256-prod-github-runner-207 kernel: [64040.592951] ? lockup_detector_update_enable+0x60/0x60 Aug 22 23:11:06 juju-e4d256-prod-github-runner-207 kernel: [64040.594542] ? __hrtimer_run_queues+0x107/0x230 Aug 22 23:11:06 juju-e4d256-prod-github-runner-207 kernel: [64040.596090] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 23:11:06 juju-e4d256-prod-github-runner-207 kernel: [64040.597643] ? hrtimer_interrupt+0x101/0x220 Aug 22 23:11:06 juju-e4d256-prod-github-runner-207 kernel: [64040.599202] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 23:11:06 juju-e4d256-prod-github-runner-207 kernel: [64040.600826] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 23:11:06 juju-e4d256-prod-github-runner-207 kernel: [64040.602399] Aug 22 23:11:06 juju-e4d256-prod-github-runner-207 kernel: [64040.603741] Aug 22 23:11:06 juju-e4d256-prod-github-runner-207 kernel: [64040.605058] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 23:11:06 juju-e4d256-prod-github-runner-207 kernel: [64040.606607] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:11:06 juju-e4d256-prod-github-runner-207 kernel: [64040.608114] ? _raw_spin_lock+0x22/0x30 Aug 22 23:11:06 juju-e4d256-prod-github-runner-207 kernel: [64040.609282] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:11:06 juju-e4d256-prod-github-runner-207 kernel: [64040.610620] direct_page_fault+0x206/0x310 [kvm] Aug 22 23:11:06 juju-e4d256-prod-github-runner-207 kernel: [64040.611767] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 23:11:06 juju-e4d256-prod-github-runner-207 kernel: [64040.612830] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 23:11:06 juju-e4d256-prod-github-runner-207 kernel: [64040.613859] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 23:11:06 juju-e4d256-prod-github-runner-207 kernel: [64040.614892] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 23:11:06 juju-e4d256-prod-github-runner-207 kernel: [64040.615917] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 23:11:06 juju-e4d256-prod-github-runner-207 kernel: [64040.616912] handle_exit+0x98/0x230 [kvm_amd] Aug 22 23:11:06 juju-e4d256-prod-github-runner-207 kernel: [64040.617812] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 23:11:06 juju-e4d256-prod-github-runner-207 kernel: [64040.618740] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 23:11:06 juju-e4d256-prod-github-runner-207 kernel: [64040.619700] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 23:11:06 juju-e4d256-prod-github-runner-207 kernel: [64040.620619] vcpu_run+0x62/0x2c0 [kvm] Aug 22 23:11:06 juju-e4d256-prod-github-runner-207 kernel: [64040.621438] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 23:11:06 juju-e4d256-prod-github-runner-207 kernel: [64040.622254] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 23:11:06 juju-e4d256-prod-github-runner-207 kernel: [64040.623117] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 23:11:06 juju-e4d256-prod-github-runner-207 kernel: [64040.623983] ? __seccomp_filter+0x4a/0x4a0 Aug 22 23:11:06 juju-e4d256-prod-github-runner-207 kernel: [64040.624738] ? __fget_files+0x86/0xc0 Aug 22 23:11:06 juju-e4d256-prod-github-runner-207 kernel: [64040.625446] __x64_sys_ioctl+0x95/0xd0 Aug 22 23:11:06 juju-e4d256-prod-github-runner-207 kernel: [64040.626149] do_syscall_64+0x5c/0xc0 Aug 22 23:11:06 juju-e4d256-prod-github-runner-207 kernel: [64040.626819] ? do_futex+0x162/0x1f0 Aug 22 23:11:06 juju-e4d256-prod-github-runner-207 kernel: [64040.627503] ? __x64_sys_futex+0x78/0x1e0 Aug 22 23:11:06 juju-e4d256-prod-github-runner-207 kernel: [64040.628185] ? __secure_computing+0xa9/0x120 Aug 22 23:11:06 juju-e4d256-prod-github-runner-207 kernel: [64040.628881] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 23:11:06 juju-e4d256-prod-github-runner-207 kernel: [64040.629648] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:11:06 juju-e4d256-prod-github-runner-207 kernel: [64040.630375] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:11:06 juju-e4d256-prod-github-runner-207 kernel: [64040.631103] ? do_syscall_64+0x69/0xc0 Aug 22 23:11:06 juju-e4d256-prod-github-runner-207 kernel: [64040.631773] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:11:06 juju-e4d256-prod-github-runner-207 kernel: [64040.632482] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:11:06 juju-e4d256-prod-github-runner-207 kernel: [64040.633189] ? do_syscall_64+0x69/0xc0 Aug 22 23:11:06 juju-e4d256-prod-github-runner-207 kernel: [64040.633819] ? do_syscall_64+0x69/0xc0 Aug 22 23:11:06 juju-e4d256-prod-github-runner-207 kernel: [64040.634444] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 23:11:06 juju-e4d256-prod-github-runner-207 kernel: [64040.635158] RIP: 0033:0x7faa5d0edaff Aug 22 23:11:06 juju-e4d256-prod-github-runner-207 kernel: [64040.635859] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 23:11:06 juju-e4d256-prod-github-runner-207 kernel: [64040.638526] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 23:11:06 juju-e4d256-prod-github-runner-207 kernel: [64040.639624] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 23:11:06 juju-e4d256-prod-github-runner-207 kernel: [64040.640844] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 23:11:06 juju-e4d256-prod-github-runner-207 kernel: [64040.641755] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 23:11:06 juju-e4d256-prod-github-runner-207 kernel: [64040.642653] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 23:11:06 juju-e4d256-prod-github-runner-207 kernel: [64040.643582] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 23:11:06 juju-e4d256-prod-github-runner-207 kernel: [64040.644488] Aug 22 23:11:34 juju-e4d256-prod-github-runner-207 kernel: [64068.542546] watchdog: BUG: soft lockup - CPU#1 stuck for 59560s! [qemu-system-x86:6715] Aug 22 23:11:34 juju-e4d256-prod-github-runner-207 kernel: [64068.545527] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 23:11:34 juju-e4d256-prod-github-runner-207 kernel: [64068.545602] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 23:11:34 juju-e4d256-prod-github-runner-207 kernel: [64068.580716] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 23:11:34 juju-e4d256-prod-github-runner-207 kernel: [64068.582235] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 23:11:34 juju-e4d256-prod-github-runner-207 kernel: [64068.585887] RIP: 0010:native_queued_spin_lock_slowpath+0xc/0x40 Aug 22 23:11:34 juju-e4d256-prod-github-runner-207 kernel: [64068.587086] Code: fe ff ff eb af 4c 89 fe 48 c7 c7 20 99 e9 89 e8 ca 69 55 00 e9 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 <8b> 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 eb Aug 22 23:11:34 juju-e4d256-prod-github-runner-207 kernel: [64068.594557] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 23:11:34 juju-e4d256-prod-github-runner-207 kernel: [64068.596304] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 23:11:34 juju-e4d256-prod-github-runner-207 kernel: [64068.599339] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 23:11:34 juju-e4d256-prod-github-runner-207 kernel: [64068.602811] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 23:11:34 juju-e4d256-prod-github-runner-207 kernel: [64068.606401] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 23:11:34 juju-e4d256-prod-github-runner-207 kernel: [64068.608392] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 23:11:34 juju-e4d256-prod-github-runner-207 kernel: [64068.611300] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 23:11:34 juju-e4d256-prod-github-runner-207 kernel: [64068.614932] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 23:11:34 juju-e4d256-prod-github-runner-207 kernel: [64068.616174] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 23:11:34 juju-e4d256-prod-github-runner-207 kernel: [64068.619819] Call Trace: Aug 22 23:11:34 juju-e4d256-prod-github-runner-207 kernel: [64068.623120] Aug 22 23:11:34 juju-e4d256-prod-github-runner-207 kernel: [64068.624082] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:11:34 juju-e4d256-prod-github-runner-207 kernel: [64068.627476] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:11:34 juju-e4d256-prod-github-runner-207 kernel: [64068.630723] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:11:34 juju-e4d256-prod-github-runner-207 kernel: [64068.631890] ? show_regs.part.0+0x23/0x29 Aug 22 23:11:34 juju-e4d256-prod-github-runner-207 kernel: [64068.634637] ? show_regs.cold+0x8/0xd Aug 22 23:11:34 juju-e4d256-prod-github-runner-207 kernel: [64068.636235] ? watchdog_timer_fn+0x1be/0x220 Aug 22 23:11:34 juju-e4d256-prod-github-runner-207 kernel: [64068.639572] ? lockup_detector_update_enable+0x60/0x60 Aug 22 23:11:34 juju-e4d256-prod-github-runner-207 kernel: [64068.640673] ? __hrtimer_run_queues+0x107/0x230 Aug 22 23:11:34 juju-e4d256-prod-github-runner-207 kernel: [64068.643992] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 23:11:34 juju-e4d256-prod-github-runner-207 kernel: [64068.645052] ? hrtimer_interrupt+0x101/0x220 Aug 22 23:11:34 juju-e4d256-prod-github-runner-207 kernel: [64068.648463] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 23:11:34 juju-e4d256-prod-github-runner-207 kernel: [64068.651697] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 23:11:34 juju-e4d256-prod-github-runner-207 kernel: [64068.652763] Aug 22 23:11:34 juju-e4d256-prod-github-runner-207 kernel: [64068.655969] Aug 22 23:11:34 juju-e4d256-prod-github-runner-207 kernel: [64068.657113] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 23:11:34 juju-e4d256-prod-github-runner-207 kernel: [64068.660746] ? native_queued_spin_lock_slowpath+0xc/0x40 Aug 22 23:11:34 juju-e4d256-prod-github-runner-207 kernel: [64068.662234] ? _raw_spin_lock+0x22/0x30 Aug 22 23:11:34 juju-e4d256-prod-github-runner-207 kernel: [64068.665732] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:11:34 juju-e4d256-prod-github-runner-207 kernel: [64068.667362] direct_page_fault+0x206/0x310 [kvm] Aug 22 23:11:34 juju-e4d256-prod-github-runner-207 kernel: [64068.670262] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 23:11:34 juju-e4d256-prod-github-runner-207 kernel: [64068.671317] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 23:11:34 juju-e4d256-prod-github-runner-207 kernel: [64068.674816] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 23:11:34 juju-e4d256-prod-github-runner-207 kernel: [64068.675952] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 23:11:34 juju-e4d256-prod-github-runner-207 kernel: [64068.679382] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 23:11:34 juju-e4d256-prod-github-runner-207 kernel: [64068.680614] handle_exit+0x98/0x230 [kvm_amd] Aug 22 23:11:34 juju-e4d256-prod-github-runner-207 kernel: [64068.681716] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 23:11:34 juju-e4d256-prod-github-runner-207 kernel: [64068.682680] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 23:11:34 juju-e4d256-prod-github-runner-207 kernel: [64068.683674] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 23:11:34 juju-e4d256-prod-github-runner-207 kernel: [64068.684592] vcpu_run+0x62/0x2c0 [kvm] Aug 22 23:11:34 juju-e4d256-prod-github-runner-207 kernel: [64068.685511] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 23:11:34 juju-e4d256-prod-github-runner-207 kernel: [64068.686437] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 23:11:34 juju-e4d256-prod-github-runner-207 kernel: [64068.687567] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 23:11:34 juju-e4d256-prod-github-runner-207 kernel: [64068.688466] ? __seccomp_filter+0x4a/0x4a0 Aug 22 23:11:34 juju-e4d256-prod-github-runner-207 kernel: [64068.689302] ? __fget_files+0x86/0xc0 Aug 22 23:11:34 juju-e4d256-prod-github-runner-207 kernel: [64068.690087] __x64_sys_ioctl+0x95/0xd0 Aug 22 23:11:34 juju-e4d256-prod-github-runner-207 kernel: [64068.690868] do_syscall_64+0x5c/0xc0 Aug 22 23:11:34 juju-e4d256-prod-github-runner-207 kernel: [64068.691663] ? do_futex+0x162/0x1f0 Aug 22 23:11:34 juju-e4d256-prod-github-runner-207 kernel: [64068.692382] ? __x64_sys_futex+0x78/0x1e0 Aug 22 23:11:34 juju-e4d256-prod-github-runner-207 kernel: [64068.693144] ? __secure_computing+0xa9/0x120 Aug 22 23:11:34 juju-e4d256-prod-github-runner-207 kernel: [64068.694002] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 23:11:34 juju-e4d256-prod-github-runner-207 kernel: [64068.695028] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:11:34 juju-e4d256-prod-github-runner-207 kernel: [64068.696004] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:11:34 juju-e4d256-prod-github-runner-207 kernel: [64068.696966] ? do_syscall_64+0x69/0xc0 Aug 22 23:11:34 juju-e4d256-prod-github-runner-207 kernel: [64068.697767] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:11:34 juju-e4d256-prod-github-runner-207 kernel: [64068.698682] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:11:34 juju-e4d256-prod-github-runner-207 kernel: [64068.699613] ? do_syscall_64+0x69/0xc0 Aug 22 23:11:34 juju-e4d256-prod-github-runner-207 kernel: [64068.700437] ? do_syscall_64+0x69/0xc0 Aug 22 23:11:34 juju-e4d256-prod-github-runner-207 kernel: [64068.701262] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 23:11:34 juju-e4d256-prod-github-runner-207 kernel: [64068.702207] RIP: 0033:0x7faa5d0edaff Aug 22 23:11:34 juju-e4d256-prod-github-runner-207 kernel: [64068.703066] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 23:11:34 juju-e4d256-prod-github-runner-207 kernel: [64068.705528] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 23:11:34 juju-e4d256-prod-github-runner-207 kernel: [64068.706481] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 23:11:34 juju-e4d256-prod-github-runner-207 kernel: [64068.707407] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 23:11:34 juju-e4d256-prod-github-runner-207 kernel: [64068.708325] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 23:11:34 juju-e4d256-prod-github-runner-207 kernel: [64068.709326] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 23:11:34 juju-e4d256-prod-github-runner-207 kernel: [64068.710488] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 23:11:34 juju-e4d256-prod-github-runner-207 kernel: [64068.711732] Aug 22 23:11:47 juju-e4d256-prod-github-runner-207 kernel: [64081.460707] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 23:11:47 juju-e4d256-prod-github-runner-207 kernel: [64081.461702] rcu: 1-....: (15940642 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=7696425 Aug 22 23:11:47 juju-e4d256-prod-github-runner-207 kernel: [64081.463375] (t=15991065 jiffies g=23269 q=56483) Aug 22 23:11:47 juju-e4d256-prod-github-runner-207 kernel: [64081.464532] NMI backtrace for cpu 1 Aug 22 23:11:47 juju-e4d256-prod-github-runner-207 kernel: [64081.465424] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 23:11:47 juju-e4d256-prod-github-runner-207 kernel: [64081.466542] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 23:11:47 juju-e4d256-prod-github-runner-207 kernel: [64081.467747] Call Trace: Aug 22 23:11:47 juju-e4d256-prod-github-runner-207 kernel: [64081.468625] Aug 22 23:11:47 juju-e4d256-prod-github-runner-207 kernel: [64081.469474] show_stack+0x52/0x5c Aug 22 23:11:47 juju-e4d256-prod-github-runner-207 kernel: [64081.470422] dump_stack_lvl+0x4a/0x63 Aug 22 23:11:47 juju-e4d256-prod-github-runner-207 kernel: [64081.471426] dump_stack+0x10/0x16 Aug 22 23:11:47 juju-e4d256-prod-github-runner-207 kernel: [64081.472362] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 23:11:47 juju-e4d256-prod-github-runner-207 kernel: [64081.473562] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 23:11:47 juju-e4d256-prod-github-runner-207 kernel: [64081.474510] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 23:11:47 juju-e4d256-prod-github-runner-207 kernel: [64081.475416] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 23:11:47 juju-e4d256-prod-github-runner-207 kernel: [64081.476244] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 23:11:47 juju-e4d256-prod-github-runner-207 kernel: [64081.477063] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 23:11:47 juju-e4d256-prod-github-runner-207 kernel: [64081.477849] print_cpu_stall.cold+0x2f/0xe2 Aug 22 23:11:47 juju-e4d256-prod-github-runner-207 kernel: [64081.478626] ? timekeeping_update+0xf7/0x150 Aug 22 23:11:47 juju-e4d256-prod-github-runner-207 kernel: [64081.479428] check_cpu_stall+0x109/0x270 Aug 22 23:11:47 juju-e4d256-prod-github-runner-207 kernel: [64081.480180] rcu_sched_clock_irq+0x9a/0x250 Aug 22 23:11:47 juju-e4d256-prod-github-runner-207 kernel: [64081.480943] update_process_times+0x94/0xd0 Aug 22 23:11:47 juju-e4d256-prod-github-runner-207 kernel: [64081.481712] tick_sched_handle+0x29/0x70 Aug 22 23:11:47 juju-e4d256-prod-github-runner-207 kernel: [64081.482460] tick_sched_timer+0x8c/0xc0 Aug 22 23:11:47 juju-e4d256-prod-github-runner-207 kernel: [64081.483218] ? tick_nohz_handler+0xb0/0xb0 Aug 22 23:11:47 juju-e4d256-prod-github-runner-207 kernel: [64081.483976] __hrtimer_run_queues+0x107/0x230 Aug 22 23:11:47 juju-e4d256-prod-github-runner-207 kernel: [64081.484756] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 23:11:47 juju-e4d256-prod-github-runner-207 kernel: [64081.485545] hrtimer_interrupt+0x101/0x220 Aug 22 23:11:47 juju-e4d256-prod-github-runner-207 kernel: [64081.486322] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 23:11:47 juju-e4d256-prod-github-runner-207 kernel: [64081.487169] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 23:11:47 juju-e4d256-prod-github-runner-207 kernel: [64081.487973] Aug 22 23:11:47 juju-e4d256-prod-github-runner-207 kernel: [64081.488614] Aug 22 23:11:47 juju-e4d256-prod-github-runner-207 kernel: [64081.489276] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 23:11:47 juju-e4d256-prod-github-runner-207 kernel: [64081.490135] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:11:47 juju-e4d256-prod-github-runner-207 kernel: [64081.491122] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 23:11:47 juju-e4d256-prod-github-runner-207 kernel: [64081.494033] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 23:11:47 juju-e4d256-prod-github-runner-207 kernel: [64081.495240] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 23:11:47 juju-e4d256-prod-github-runner-207 kernel: [64081.496586] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 23:11:47 juju-e4d256-prod-github-runner-207 kernel: [64081.497915] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 23:11:47 juju-e4d256-prod-github-runner-207 kernel: [64081.499007] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 23:11:47 juju-e4d256-prod-github-runner-207 kernel: [64081.499988] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 23:11:47 juju-e4d256-prod-github-runner-207 kernel: [64081.501015] ? _raw_spin_lock+0x22/0x30 Aug 22 23:11:47 juju-e4d256-prod-github-runner-207 kernel: [64081.502053] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:11:47 juju-e4d256-prod-github-runner-207 kernel: [64081.503171] direct_page_fault+0x206/0x310 [kvm] Aug 22 23:11:47 juju-e4d256-prod-github-runner-207 kernel: [64081.504286] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 23:11:47 juju-e4d256-prod-github-runner-207 kernel: [64081.505359] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 23:11:47 juju-e4d256-prod-github-runner-207 kernel: [64081.506336] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 23:11:47 juju-e4d256-prod-github-runner-207 kernel: [64081.507188] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 23:11:47 juju-e4d256-prod-github-runner-207 kernel: [64081.507981] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 23:11:47 juju-e4d256-prod-github-runner-207 kernel: [64081.508806] handle_exit+0x98/0x230 [kvm_amd] Aug 22 23:11:47 juju-e4d256-prod-github-runner-207 kernel: [64081.509570] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 23:11:47 juju-e4d256-prod-github-runner-207 kernel: [64081.510443] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 23:11:47 juju-e4d256-prod-github-runner-207 kernel: [64081.511322] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 23:11:47 juju-e4d256-prod-github-runner-207 kernel: [64081.512564] vcpu_run+0x62/0x2c0 [kvm] Aug 22 23:11:47 juju-e4d256-prod-github-runner-207 kernel: [64081.513499] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 23:11:47 juju-e4d256-prod-github-runner-207 kernel: [64081.514452] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 23:11:47 juju-e4d256-prod-github-runner-207 kernel: [64081.515508] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 23:11:47 juju-e4d256-prod-github-runner-207 kernel: [64081.516272] ? __seccomp_filter+0x4a/0x4a0 Aug 22 23:11:47 juju-e4d256-prod-github-runner-207 kernel: [64081.516992] ? __fget_files+0x86/0xc0 Aug 22 23:11:47 juju-e4d256-prod-github-runner-207 kernel: [64081.517684] __x64_sys_ioctl+0x95/0xd0 Aug 22 23:11:47 juju-e4d256-prod-github-runner-207 kernel: [64081.518378] do_syscall_64+0x5c/0xc0 Aug 22 23:11:47 juju-e4d256-prod-github-runner-207 kernel: [64081.519071] ? do_futex+0x162/0x1f0 Aug 22 23:11:47 juju-e4d256-prod-github-runner-207 kernel: [64081.519796] ? __x64_sys_futex+0x78/0x1e0 Aug 22 23:11:47 juju-e4d256-prod-github-runner-207 kernel: [64081.520503] ? __secure_computing+0xa9/0x120 Aug 22 23:11:47 juju-e4d256-prod-github-runner-207 kernel: [64081.521246] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 23:11:47 juju-e4d256-prod-github-runner-207 kernel: [64081.522094] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:11:47 juju-e4d256-prod-github-runner-207 kernel: [64081.522934] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:11:47 juju-e4d256-prod-github-runner-207 kernel: [64081.523688] ? do_syscall_64+0x69/0xc0 Aug 22 23:11:47 juju-e4d256-prod-github-runner-207 kernel: [64081.524409] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:11:47 juju-e4d256-prod-github-runner-207 kernel: [64081.525180] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:11:47 juju-e4d256-prod-github-runner-207 kernel: [64081.525939] ? do_syscall_64+0x69/0xc0 Aug 22 23:11:47 juju-e4d256-prod-github-runner-207 kernel: [64081.526785] ? do_syscall_64+0x69/0xc0 Aug 22 23:11:47 juju-e4d256-prod-github-runner-207 kernel: [64081.527554] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 23:11:47 juju-e4d256-prod-github-runner-207 kernel: [64081.528324] RIP: 0033:0x7faa5d0edaff Aug 22 23:11:47 juju-e4d256-prod-github-runner-207 kernel: [64081.529012] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 23:11:47 juju-e4d256-prod-github-runner-207 kernel: [64081.531228] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 23:11:47 juju-e4d256-prod-github-runner-207 kernel: [64081.532250] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 23:11:47 juju-e4d256-prod-github-runner-207 kernel: [64081.533272] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 23:11:47 juju-e4d256-prod-github-runner-207 kernel: [64081.534254] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 23:11:47 juju-e4d256-prod-github-runner-207 kernel: [64081.535248] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 23:11:47 juju-e4d256-prod-github-runner-207 kernel: [64081.536187] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 23:11:47 juju-e4d256-prod-github-runner-207 kernel: [64081.537107] Aug 22 23:12:14 juju-e4d256-prod-github-runner-207 kernel: [64108.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 59597s! [qemu-system-x86:6715] Aug 22 23:12:14 juju-e4d256-prod-github-runner-207 kernel: [64108.543889] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 23:12:14 juju-e4d256-prod-github-runner-207 kernel: [64108.544206] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 23:12:14 juju-e4d256-prod-github-runner-207 kernel: [64108.556869] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 23:12:14 juju-e4d256-prod-github-runner-207 kernel: [64108.558237] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 23:12:14 juju-e4d256-prod-github-runner-207 kernel: [64108.559576] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:12:14 juju-e4d256-prod-github-runner-207 kernel: [64108.560694] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 23:12:14 juju-e4d256-prod-github-runner-207 kernel: [64108.563369] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 23:12:14 juju-e4d256-prod-github-runner-207 kernel: [64108.564493] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 23:12:14 juju-e4d256-prod-github-runner-207 kernel: [64108.565729] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 23:12:14 juju-e4d256-prod-github-runner-207 kernel: [64108.566971] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 23:12:14 juju-e4d256-prod-github-runner-207 kernel: [64108.568156] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 23:12:14 juju-e4d256-prod-github-runner-207 kernel: [64108.569346] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 23:12:14 juju-e4d256-prod-github-runner-207 kernel: [64108.570554] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 23:12:14 juju-e4d256-prod-github-runner-207 kernel: [64108.571845] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 23:12:14 juju-e4d256-prod-github-runner-207 kernel: [64108.572972] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 23:12:14 juju-e4d256-prod-github-runner-207 kernel: [64108.574439] Call Trace: Aug 22 23:12:14 juju-e4d256-prod-github-runner-207 kernel: [64108.575591] Aug 22 23:12:14 juju-e4d256-prod-github-runner-207 kernel: [64108.576527] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:12:14 juju-e4d256-prod-github-runner-207 kernel: [64108.577576] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:12:14 juju-e4d256-prod-github-runner-207 kernel: [64108.578651] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:12:14 juju-e4d256-prod-github-runner-207 kernel: [64108.579779] ? show_regs.part.0+0x23/0x29 Aug 22 23:12:14 juju-e4d256-prod-github-runner-207 kernel: [64108.580807] ? show_regs.cold+0x8/0xd Aug 22 23:12:14 juju-e4d256-prod-github-runner-207 kernel: [64108.581807] ? watchdog_timer_fn+0x1be/0x220 Aug 22 23:12:14 juju-e4d256-prod-github-runner-207 kernel: [64108.582857] ? lockup_detector_update_enable+0x60/0x60 Aug 22 23:12:14 juju-e4d256-prod-github-runner-207 kernel: [64108.583979] ? __hrtimer_run_queues+0x107/0x230 Aug 22 23:12:14 juju-e4d256-prod-github-runner-207 kernel: [64108.585026] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 23:12:14 juju-e4d256-prod-github-runner-207 kernel: [64108.586092] ? hrtimer_interrupt+0x101/0x220 Aug 22 23:12:14 juju-e4d256-prod-github-runner-207 kernel: [64108.587147] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 23:12:14 juju-e4d256-prod-github-runner-207 kernel: [64108.588237] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 23:12:14 juju-e4d256-prod-github-runner-207 kernel: [64108.589311] Aug 22 23:12:14 juju-e4d256-prod-github-runner-207 kernel: [64108.590178] Aug 22 23:12:14 juju-e4d256-prod-github-runner-207 kernel: [64108.591046] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 23:12:14 juju-e4d256-prod-github-runner-207 kernel: [64108.592237] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:12:14 juju-e4d256-prod-github-runner-207 kernel: [64108.593305] ? _raw_spin_lock+0x22/0x30 Aug 22 23:12:14 juju-e4d256-prod-github-runner-207 kernel: [64108.594318] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:12:14 juju-e4d256-prod-github-runner-207 kernel: [64108.595382] direct_page_fault+0x206/0x310 [kvm] Aug 22 23:12:14 juju-e4d256-prod-github-runner-207 kernel: [64108.596428] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 23:12:14 juju-e4d256-prod-github-runner-207 kernel: [64108.597463] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 23:12:14 juju-e4d256-prod-github-runner-207 kernel: [64108.598543] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 23:12:14 juju-e4d256-prod-github-runner-207 kernel: [64108.599579] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 23:12:14 juju-e4d256-prod-github-runner-207 kernel: [64108.600542] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 23:12:14 juju-e4d256-prod-github-runner-207 kernel: [64108.601544] handle_exit+0x98/0x230 [kvm_amd] Aug 22 23:12:14 juju-e4d256-prod-github-runner-207 kernel: [64108.602451] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 23:12:14 juju-e4d256-prod-github-runner-207 kernel: [64108.603408] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 23:12:14 juju-e4d256-prod-github-runner-207 kernel: [64108.604353] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 23:12:14 juju-e4d256-prod-github-runner-207 kernel: [64108.605276] vcpu_run+0x62/0x2c0 [kvm] Aug 22 23:12:14 juju-e4d256-prod-github-runner-207 kernel: [64108.606100] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 23:12:14 juju-e4d256-prod-github-runner-207 kernel: [64108.606938] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 23:12:14 juju-e4d256-prod-github-runner-207 kernel: [64108.607820] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 23:12:14 juju-e4d256-prod-github-runner-207 kernel: [64108.608635] ? __seccomp_filter+0x4a/0x4a0 Aug 22 23:12:14 juju-e4d256-prod-github-runner-207 kernel: [64108.609417] ? __fget_files+0x86/0xc0 Aug 22 23:12:14 juju-e4d256-prod-github-runner-207 kernel: [64108.610172] __x64_sys_ioctl+0x95/0xd0 Aug 22 23:12:14 juju-e4d256-prod-github-runner-207 kernel: [64108.610928] do_syscall_64+0x5c/0xc0 Aug 22 23:12:14 juju-e4d256-prod-github-runner-207 kernel: [64108.611620] ? do_futex+0x162/0x1f0 Aug 22 23:12:14 juju-e4d256-prod-github-runner-207 kernel: [64108.612279] ? __x64_sys_futex+0x78/0x1e0 Aug 22 23:12:14 juju-e4d256-prod-github-runner-207 kernel: [64108.612965] ? __secure_computing+0xa9/0x120 Aug 22 23:12:14 juju-e4d256-prod-github-runner-207 kernel: [64108.613683] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 23:12:14 juju-e4d256-prod-github-runner-207 kernel: [64108.614497] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:12:14 juju-e4d256-prod-github-runner-207 kernel: [64108.615275] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:12:14 juju-e4d256-prod-github-runner-207 kernel: [64108.616011] ? do_syscall_64+0x69/0xc0 Aug 22 23:12:14 juju-e4d256-prod-github-runner-207 kernel: [64108.616671] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:12:14 juju-e4d256-prod-github-runner-207 kernel: [64108.617410] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:12:14 juju-e4d256-prod-github-runner-207 kernel: [64108.618176] ? do_syscall_64+0x69/0xc0 Aug 22 23:12:14 juju-e4d256-prod-github-runner-207 kernel: [64108.618860] ? do_syscall_64+0x69/0xc0 Aug 22 23:12:14 juju-e4d256-prod-github-runner-207 kernel: [64108.619520] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 23:12:14 juju-e4d256-prod-github-runner-207 kernel: [64108.622542] RIP: 0033:0x7faa5d0edaff Aug 22 23:12:14 juju-e4d256-prod-github-runner-207 kernel: [64108.623276] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 23:12:14 juju-e4d256-prod-github-runner-207 kernel: [64108.625365] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 23:12:14 juju-e4d256-prod-github-runner-207 kernel: [64108.626309] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 23:12:14 juju-e4d256-prod-github-runner-207 kernel: [64108.627258] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 23:12:14 juju-e4d256-prod-github-runner-207 kernel: [64108.628166] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 23:12:14 juju-e4d256-prod-github-runner-207 kernel: [64108.629071] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 23:12:14 juju-e4d256-prod-github-runner-207 kernel: [64108.629999] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 23:12:14 juju-e4d256-prod-github-runner-207 kernel: [64108.630963] Aug 22 23:12:42 juju-e4d256-prod-github-runner-207 kernel: [64136.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 59623s! [qemu-system-x86:6715] Aug 22 23:12:42 juju-e4d256-prod-github-runner-207 kernel: [64136.543097] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 23:12:42 juju-e4d256-prod-github-runner-207 kernel: [64136.543166] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 23:12:42 juju-e4d256-prod-github-runner-207 kernel: [64136.555776] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 23:12:42 juju-e4d256-prod-github-runner-207 kernel: [64136.557053] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 23:12:42 juju-e4d256-prod-github-runner-207 kernel: [64136.558295] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:12:42 juju-e4d256-prod-github-runner-207 kernel: [64136.559380] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 23:12:42 juju-e4d256-prod-github-runner-207 kernel: [64136.562118] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 23:12:42 juju-e4d256-prod-github-runner-207 kernel: [64136.563366] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 23:12:42 juju-e4d256-prod-github-runner-207 kernel: [64136.564526] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 23:12:42 juju-e4d256-prod-github-runner-207 kernel: [64136.565688] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 23:12:42 juju-e4d256-prod-github-runner-207 kernel: [64136.566883] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 23:12:42 juju-e4d256-prod-github-runner-207 kernel: [64136.568201] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 23:12:42 juju-e4d256-prod-github-runner-207 kernel: [64136.569375] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 23:12:42 juju-e4d256-prod-github-runner-207 kernel: [64136.570635] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 23:12:42 juju-e4d256-prod-github-runner-207 kernel: [64136.571737] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 23:12:42 juju-e4d256-prod-github-runner-207 kernel: [64136.572933] Call Trace: Aug 22 23:12:42 juju-e4d256-prod-github-runner-207 kernel: [64136.573843] Aug 22 23:12:42 juju-e4d256-prod-github-runner-207 kernel: [64136.574739] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:12:42 juju-e4d256-prod-github-runner-207 kernel: [64136.575773] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:12:42 juju-e4d256-prod-github-runner-207 kernel: [64136.576793] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:12:42 juju-e4d256-prod-github-runner-207 kernel: [64136.577864] ? show_regs.part.0+0x23/0x29 Aug 22 23:12:42 juju-e4d256-prod-github-runner-207 kernel: [64136.578960] ? show_regs.cold+0x8/0xd Aug 22 23:12:42 juju-e4d256-prod-github-runner-207 kernel: [64136.579936] ? watchdog_timer_fn+0x1be/0x220 Aug 22 23:12:42 juju-e4d256-prod-github-runner-207 kernel: [64136.580951] ? lockup_detector_update_enable+0x60/0x60 Aug 22 23:12:42 juju-e4d256-prod-github-runner-207 kernel: [64136.582012] ? __hrtimer_run_queues+0x107/0x230 Aug 22 23:12:42 juju-e4d256-prod-github-runner-207 kernel: [64136.583047] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 23:12:42 juju-e4d256-prod-github-runner-207 kernel: [64136.584072] ? hrtimer_interrupt+0x101/0x220 Aug 22 23:12:42 juju-e4d256-prod-github-runner-207 kernel: [64136.585089] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 23:12:42 juju-e4d256-prod-github-runner-207 kernel: [64136.586172] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 23:12:42 juju-e4d256-prod-github-runner-207 kernel: [64136.587214] Aug 22 23:12:42 juju-e4d256-prod-github-runner-207 kernel: [64136.588065] Aug 22 23:12:42 juju-e4d256-prod-github-runner-207 kernel: [64136.588904] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 23:12:42 juju-e4d256-prod-github-runner-207 kernel: [64136.589940] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:12:42 juju-e4d256-prod-github-runner-207 kernel: [64136.590998] ? _raw_spin_lock+0x22/0x30 Aug 22 23:12:42 juju-e4d256-prod-github-runner-207 kernel: [64136.591941] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:12:42 juju-e4d256-prod-github-runner-207 kernel: [64136.592955] direct_page_fault+0x206/0x310 [kvm] Aug 22 23:12:42 juju-e4d256-prod-github-runner-207 kernel: [64136.593987] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 23:12:42 juju-e4d256-prod-github-runner-207 kernel: [64136.595006] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 23:12:42 juju-e4d256-prod-github-runner-207 kernel: [64136.596005] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 23:12:42 juju-e4d256-prod-github-runner-207 kernel: [64136.596983] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 23:12:42 juju-e4d256-prod-github-runner-207 kernel: [64136.597926] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 23:12:42 juju-e4d256-prod-github-runner-207 kernel: [64136.598919] handle_exit+0x98/0x230 [kvm_amd] Aug 22 23:12:42 juju-e4d256-prod-github-runner-207 kernel: [64136.599822] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 23:12:42 juju-e4d256-prod-github-runner-207 kernel: [64136.600739] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 23:12:42 juju-e4d256-prod-github-runner-207 kernel: [64136.601667] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 23:12:42 juju-e4d256-prod-github-runner-207 kernel: [64136.602583] vcpu_run+0x62/0x2c0 [kvm] Aug 22 23:12:42 juju-e4d256-prod-github-runner-207 kernel: [64136.603394] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 23:12:42 juju-e4d256-prod-github-runner-207 kernel: [64136.604208] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 23:12:42 juju-e4d256-prod-github-runner-207 kernel: [64136.605073] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 23:12:42 juju-e4d256-prod-github-runner-207 kernel: [64136.605909] ? __seccomp_filter+0x4a/0x4a0 Aug 22 23:12:42 juju-e4d256-prod-github-runner-207 kernel: [64136.606680] ? __fget_files+0x86/0xc0 Aug 22 23:12:42 juju-e4d256-prod-github-runner-207 kernel: [64136.607391] __x64_sys_ioctl+0x95/0xd0 Aug 22 23:12:42 juju-e4d256-prod-github-runner-207 kernel: [64136.608090] do_syscall_64+0x5c/0xc0 Aug 22 23:12:42 juju-e4d256-prod-github-runner-207 kernel: [64136.608762] ? do_futex+0x162/0x1f0 Aug 22 23:12:42 juju-e4d256-prod-github-runner-207 kernel: [64136.609417] ? __x64_sys_futex+0x78/0x1e0 Aug 22 23:12:42 juju-e4d256-prod-github-runner-207 kernel: [64136.610101] ? __secure_computing+0xa9/0x120 Aug 22 23:12:42 juju-e4d256-prod-github-runner-207 kernel: [64136.610827] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 23:12:42 juju-e4d256-prod-github-runner-207 kernel: [64136.611599] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:12:42 juju-e4d256-prod-github-runner-207 kernel: [64136.612330] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:12:42 juju-e4d256-prod-github-runner-207 kernel: [64136.613062] ? do_syscall_64+0x69/0xc0 Aug 22 23:12:42 juju-e4d256-prod-github-runner-207 kernel: [64136.613713] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:12:42 juju-e4d256-prod-github-runner-207 kernel: [64136.614437] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:12:42 juju-e4d256-prod-github-runner-207 kernel: [64136.615145] ? do_syscall_64+0x69/0xc0 Aug 22 23:12:42 juju-e4d256-prod-github-runner-207 kernel: [64136.615776] ? do_syscall_64+0x69/0xc0 Aug 22 23:12:42 juju-e4d256-prod-github-runner-207 kernel: [64136.616406] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 23:12:42 juju-e4d256-prod-github-runner-207 kernel: [64136.617125] RIP: 0033:0x7faa5d0edaff Aug 22 23:12:42 juju-e4d256-prod-github-runner-207 kernel: [64136.617781] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 23:12:42 juju-e4d256-prod-github-runner-207 kernel: [64136.619806] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 23:12:42 juju-e4d256-prod-github-runner-207 kernel: [64136.620730] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 23:12:42 juju-e4d256-prod-github-runner-207 kernel: [64136.621634] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 23:12:42 juju-e4d256-prod-github-runner-207 kernel: [64136.622615] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 23:12:42 juju-e4d256-prod-github-runner-207 kernel: [64136.623519] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 23:12:42 juju-e4d256-prod-github-runner-207 kernel: [64136.624419] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 23:12:42 juju-e4d256-prod-github-runner-207 kernel: [64136.625327] Aug 22 23:13:10 juju-e4d256-prod-github-runner-207 kernel: [64164.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 59649s! [qemu-system-x86:6715] Aug 22 23:13:10 juju-e4d256-prod-github-runner-207 kernel: [64164.543102] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 23:13:10 juju-e4d256-prod-github-runner-207 kernel: [64164.543185] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 23:13:10 juju-e4d256-prod-github-runner-207 kernel: [64164.555999] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 23:13:10 juju-e4d256-prod-github-runner-207 kernel: [64164.557283] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 23:13:10 juju-e4d256-prod-github-runner-207 kernel: [64164.558526] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:13:10 juju-e4d256-prod-github-runner-207 kernel: [64164.559589] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 23:13:10 juju-e4d256-prod-github-runner-207 kernel: [64164.562541] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 23:13:10 juju-e4d256-prod-github-runner-207 kernel: [64164.563601] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 23:13:10 juju-e4d256-prod-github-runner-207 kernel: [64164.564764] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 23:13:10 juju-e4d256-prod-github-runner-207 kernel: [64164.565967] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 23:13:10 juju-e4d256-prod-github-runner-207 kernel: [64164.567132] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 23:13:10 juju-e4d256-prod-github-runner-207 kernel: [64164.568332] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 23:13:10 juju-e4d256-prod-github-runner-207 kernel: [64164.569556] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 23:13:10 juju-e4d256-prod-github-runner-207 kernel: [64164.571024] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 23:13:10 juju-e4d256-prod-github-runner-207 kernel: [64164.572242] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 23:13:10 juju-e4d256-prod-github-runner-207 kernel: [64164.573584] Call Trace: Aug 22 23:13:10 juju-e4d256-prod-github-runner-207 kernel: [64164.574580] Aug 22 23:13:10 juju-e4d256-prod-github-runner-207 kernel: [64164.575511] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:13:10 juju-e4d256-prod-github-runner-207 kernel: [64164.576635] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:13:10 juju-e4d256-prod-github-runner-207 kernel: [64164.577745] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:13:10 juju-e4d256-prod-github-runner-207 kernel: [64164.578949] ? show_regs.part.0+0x23/0x29 Aug 22 23:13:10 juju-e4d256-prod-github-runner-207 kernel: [64164.580030] ? show_regs.cold+0x8/0xd Aug 22 23:13:10 juju-e4d256-prod-github-runner-207 kernel: [64164.581077] ? watchdog_timer_fn+0x1be/0x220 Aug 22 23:13:10 juju-e4d256-prod-github-runner-207 kernel: [64164.582199] ? lockup_detector_update_enable+0x60/0x60 Aug 22 23:13:10 juju-e4d256-prod-github-runner-207 kernel: [64164.583754] ? __hrtimer_run_queues+0x107/0x230 Aug 22 23:13:10 juju-e4d256-prod-github-runner-207 kernel: [64164.584880] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 23:13:10 juju-e4d256-prod-github-runner-207 kernel: [64164.586020] ? hrtimer_interrupt+0x101/0x220 Aug 22 23:13:10 juju-e4d256-prod-github-runner-207 kernel: [64164.587127] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 23:13:10 juju-e4d256-prod-github-runner-207 kernel: [64164.588309] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 23:13:10 juju-e4d256-prod-github-runner-207 kernel: [64164.589453] Aug 22 23:13:10 juju-e4d256-prod-github-runner-207 kernel: [64164.590410] Aug 22 23:13:10 juju-e4d256-prod-github-runner-207 kernel: [64164.591301] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 23:13:10 juju-e4d256-prod-github-runner-207 kernel: [64164.592448] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:13:10 juju-e4d256-prod-github-runner-207 kernel: [64164.593599] ? _raw_spin_lock+0x22/0x30 Aug 22 23:13:10 juju-e4d256-prod-github-runner-207 kernel: [64164.594649] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:13:10 juju-e4d256-prod-github-runner-207 kernel: [64164.595767] direct_page_fault+0x206/0x310 [kvm] Aug 22 23:13:10 juju-e4d256-prod-github-runner-207 kernel: [64164.596883] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 23:13:10 juju-e4d256-prod-github-runner-207 kernel: [64164.598011] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 23:13:10 juju-e4d256-prod-github-runner-207 kernel: [64164.599121] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 23:13:10 juju-e4d256-prod-github-runner-207 kernel: [64164.600189] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 23:13:10 juju-e4d256-prod-github-runner-207 kernel: [64164.601230] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 23:13:10 juju-e4d256-prod-github-runner-207 kernel: [64164.602343] handle_exit+0x98/0x230 [kvm_amd] Aug 22 23:13:10 juju-e4d256-prod-github-runner-207 kernel: [64164.603336] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 23:13:10 juju-e4d256-prod-github-runner-207 kernel: [64164.604362] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 23:13:10 juju-e4d256-prod-github-runner-207 kernel: [64164.605393] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 23:13:10 juju-e4d256-prod-github-runner-207 kernel: [64164.606425] vcpu_run+0x62/0x2c0 [kvm] Aug 22 23:13:10 juju-e4d256-prod-github-runner-207 kernel: [64164.607316] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 23:13:10 juju-e4d256-prod-github-runner-207 kernel: [64164.608249] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 23:13:10 juju-e4d256-prod-github-runner-207 kernel: [64164.609249] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 23:13:10 juju-e4d256-prod-github-runner-207 kernel: [64164.610166] ? __seccomp_filter+0x4a/0x4a0 Aug 22 23:13:10 juju-e4d256-prod-github-runner-207 kernel: [64164.610991] ? __fget_files+0x86/0xc0 Aug 22 23:13:10 juju-e4d256-prod-github-runner-207 kernel: [64164.611772] __x64_sys_ioctl+0x95/0xd0 Aug 22 23:13:10 juju-e4d256-prod-github-runner-207 kernel: [64164.612558] do_syscall_64+0x5c/0xc0 Aug 22 23:13:10 juju-e4d256-prod-github-runner-207 kernel: [64164.613323] ? do_futex+0x162/0x1f0 Aug 22 23:13:10 juju-e4d256-prod-github-runner-207 kernel: [64164.614078] ? __x64_sys_futex+0x78/0x1e0 Aug 22 23:13:10 juju-e4d256-prod-github-runner-207 kernel: [64164.614836] ? __secure_computing+0xa9/0x120 Aug 22 23:13:10 juju-e4d256-prod-github-runner-207 kernel: [64164.615615] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 23:13:10 juju-e4d256-prod-github-runner-207 kernel: [64164.616483] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:13:10 juju-e4d256-prod-github-runner-207 kernel: [64164.617308] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:13:10 juju-e4d256-prod-github-runner-207 kernel: [64164.618154] ? do_syscall_64+0x69/0xc0 Aug 22 23:13:10 juju-e4d256-prod-github-runner-207 kernel: [64164.618915] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:13:10 juju-e4d256-prod-github-runner-207 kernel: [64164.619729] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:13:10 juju-e4d256-prod-github-runner-207 kernel: [64164.620523] ? do_syscall_64+0x69/0xc0 Aug 22 23:13:10 juju-e4d256-prod-github-runner-207 kernel: [64164.621225] ? do_syscall_64+0x69/0xc0 Aug 22 23:13:10 juju-e4d256-prod-github-runner-207 kernel: [64164.621950] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 23:13:10 juju-e4d256-prod-github-runner-207 kernel: [64164.622759] RIP: 0033:0x7faa5d0edaff Aug 22 23:13:10 juju-e4d256-prod-github-runner-207 kernel: [64164.623470] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 23:13:10 juju-e4d256-prod-github-runner-207 kernel: [64164.625832] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 23:13:10 juju-e4d256-prod-github-runner-207 kernel: [64164.626947] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 23:13:10 juju-e4d256-prod-github-runner-207 kernel: [64164.627984] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 23:13:10 juju-e4d256-prod-github-runner-207 kernel: [64164.629024] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 23:13:10 juju-e4d256-prod-github-runner-207 kernel: [64164.630081] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 23:13:10 juju-e4d256-prod-github-runner-207 kernel: [64164.631114] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 23:13:10 juju-e4d256-prod-github-runner-207 kernel: [64164.632152] Aug 22 23:13:38 juju-e4d256-prod-github-runner-207 kernel: [64192.541980] watchdog: BUG: soft lockup - CPU#1 stuck for 59675s! [qemu-system-x86:6715] Aug 22 23:13:38 juju-e4d256-prod-github-runner-207 kernel: [64192.543103] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 23:13:38 juju-e4d256-prod-github-runner-207 kernel: [64192.543176] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 23:13:38 juju-e4d256-prod-github-runner-207 kernel: [64192.555259] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 23:13:38 juju-e4d256-prod-github-runner-207 kernel: [64192.556524] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 23:13:38 juju-e4d256-prod-github-runner-207 kernel: [64192.557754] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:13:38 juju-e4d256-prod-github-runner-207 kernel: [64192.558810] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 23:13:38 juju-e4d256-prod-github-runner-207 kernel: [64192.561375] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 23:13:38 juju-e4d256-prod-github-runner-207 kernel: [64192.562449] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 23:13:38 juju-e4d256-prod-github-runner-207 kernel: [64192.563703] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 23:13:38 juju-e4d256-prod-github-runner-207 kernel: [64192.564876] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 23:13:38 juju-e4d256-prod-github-runner-207 kernel: [64192.566054] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 23:13:38 juju-e4d256-prod-github-runner-207 kernel: [64192.567222] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 23:13:38 juju-e4d256-prod-github-runner-207 kernel: [64192.568384] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 23:13:38 juju-e4d256-prod-github-runner-207 kernel: [64192.569662] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 23:13:38 juju-e4d256-prod-github-runner-207 kernel: [64192.570759] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 23:13:38 juju-e4d256-prod-github-runner-207 kernel: [64192.571949] Call Trace: Aug 22 23:13:38 juju-e4d256-prod-github-runner-207 kernel: [64192.572859] Aug 22 23:13:38 juju-e4d256-prod-github-runner-207 kernel: [64192.573778] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:13:38 juju-e4d256-prod-github-runner-207 kernel: [64192.574809] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:13:38 juju-e4d256-prod-github-runner-207 kernel: [64192.575828] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:13:38 juju-e4d256-prod-github-runner-207 kernel: [64192.576907] ? show_regs.part.0+0x23/0x29 Aug 22 23:13:38 juju-e4d256-prod-github-runner-207 kernel: [64192.577918] ? show_regs.cold+0x8/0xd Aug 22 23:13:38 juju-e4d256-prod-github-runner-207 kernel: [64192.578889] ? watchdog_timer_fn+0x1be/0x220 Aug 22 23:13:38 juju-e4d256-prod-github-runner-207 kernel: [64192.579909] ? lockup_detector_update_enable+0x60/0x60 Aug 22 23:13:38 juju-e4d256-prod-github-runner-207 kernel: [64192.580977] ? __hrtimer_run_queues+0x107/0x230 Aug 22 23:13:38 juju-e4d256-prod-github-runner-207 kernel: [64192.582023] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 23:13:38 juju-e4d256-prod-github-runner-207 kernel: [64192.583045] ? hrtimer_interrupt+0x101/0x220 Aug 22 23:13:38 juju-e4d256-prod-github-runner-207 kernel: [64192.584064] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 23:13:38 juju-e4d256-prod-github-runner-207 kernel: [64192.585143] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 23:13:38 juju-e4d256-prod-github-runner-207 kernel: [64192.586200] Aug 22 23:13:38 juju-e4d256-prod-github-runner-207 kernel: [64192.587053] Aug 22 23:13:38 juju-e4d256-prod-github-runner-207 kernel: [64192.587891] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 23:13:38 juju-e4d256-prod-github-runner-207 kernel: [64192.588933] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:13:38 juju-e4d256-prod-github-runner-207 kernel: [64192.589996] ? _raw_spin_lock+0x22/0x30 Aug 22 23:13:38 juju-e4d256-prod-github-runner-207 kernel: [64192.590944] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:13:38 juju-e4d256-prod-github-runner-207 kernel: [64192.591964] direct_page_fault+0x206/0x310 [kvm] Aug 22 23:13:38 juju-e4d256-prod-github-runner-207 kernel: [64192.593007] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 23:13:38 juju-e4d256-prod-github-runner-207 kernel: [64192.594065] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 23:13:38 juju-e4d256-prod-github-runner-207 kernel: [64192.595081] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 23:13:38 juju-e4d256-prod-github-runner-207 kernel: [64192.596088] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 23:13:38 juju-e4d256-prod-github-runner-207 kernel: [64192.597039] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 23:13:38 juju-e4d256-prod-github-runner-207 kernel: [64192.598027] handle_exit+0x98/0x230 [kvm_amd] Aug 22 23:13:38 juju-e4d256-prod-github-runner-207 kernel: [64192.598919] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 23:13:38 juju-e4d256-prod-github-runner-207 kernel: [64192.599830] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 23:13:38 juju-e4d256-prod-github-runner-207 kernel: [64192.600759] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 23:13:38 juju-e4d256-prod-github-runner-207 kernel: [64192.601679] vcpu_run+0x62/0x2c0 [kvm] Aug 22 23:13:38 juju-e4d256-prod-github-runner-207 kernel: [64192.602489] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 23:13:38 juju-e4d256-prod-github-runner-207 kernel: [64192.603295] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 23:13:38 juju-e4d256-prod-github-runner-207 kernel: [64192.604183] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 23:13:38 juju-e4d256-prod-github-runner-207 kernel: [64192.604988] ? __seccomp_filter+0x4a/0x4a0 Aug 22 23:13:38 juju-e4d256-prod-github-runner-207 kernel: [64192.605781] ? __fget_files+0x86/0xc0 Aug 22 23:13:38 juju-e4d256-prod-github-runner-207 kernel: [64192.606486] __x64_sys_ioctl+0x95/0xd0 Aug 22 23:13:38 juju-e4d256-prod-github-runner-207 kernel: [64192.607178] do_syscall_64+0x5c/0xc0 Aug 22 23:13:38 juju-e4d256-prod-github-runner-207 kernel: [64192.607841] ? do_futex+0x162/0x1f0 Aug 22 23:13:38 juju-e4d256-prod-github-runner-207 kernel: [64192.608489] ? __x64_sys_futex+0x78/0x1e0 Aug 22 23:13:38 juju-e4d256-prod-github-runner-207 kernel: [64192.609163] ? __secure_computing+0xa9/0x120 Aug 22 23:13:38 juju-e4d256-prod-github-runner-207 kernel: [64192.609867] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 23:13:38 juju-e4d256-prod-github-runner-207 kernel: [64192.610625] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:13:38 juju-e4d256-prod-github-runner-207 kernel: [64192.611354] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:13:38 juju-e4d256-prod-github-runner-207 kernel: [64192.612071] ? do_syscall_64+0x69/0xc0 Aug 22 23:13:38 juju-e4d256-prod-github-runner-207 kernel: [64192.612732] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:13:38 juju-e4d256-prod-github-runner-207 kernel: [64192.613444] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:13:38 juju-e4d256-prod-github-runner-207 kernel: [64192.614140] ? do_syscall_64+0x69/0xc0 Aug 22 23:13:38 juju-e4d256-prod-github-runner-207 kernel: [64192.614768] ? do_syscall_64+0x69/0xc0 Aug 22 23:13:38 juju-e4d256-prod-github-runner-207 kernel: [64192.615394] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 23:13:38 juju-e4d256-prod-github-runner-207 kernel: [64192.616127] RIP: 0033:0x7faa5d0edaff Aug 22 23:13:38 juju-e4d256-prod-github-runner-207 kernel: [64192.616753] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 23:13:38 juju-e4d256-prod-github-runner-207 kernel: [64192.618758] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 23:13:38 juju-e4d256-prod-github-runner-207 kernel: [64192.619675] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 23:13:38 juju-e4d256-prod-github-runner-207 kernel: [64192.620568] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 23:13:38 juju-e4d256-prod-github-runner-207 kernel: [64192.621502] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 23:13:38 juju-e4d256-prod-github-runner-207 kernel: [64192.622389] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 23:13:38 juju-e4d256-prod-github-runner-207 kernel: [64192.623277] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 23:13:38 juju-e4d256-prod-github-runner-207 kernel: [64192.624181] Aug 22 23:14:06 juju-e4d256-prod-github-runner-207 kernel: [64220.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 59702s! [qemu-system-x86:6715] Aug 22 23:14:06 juju-e4d256-prod-github-runner-207 kernel: [64220.543871] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 23:14:06 juju-e4d256-prod-github-runner-207 kernel: [64220.544172] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 23:14:06 juju-e4d256-prod-github-runner-207 kernel: [64220.556257] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 23:14:06 juju-e4d256-prod-github-runner-207 kernel: [64220.557532] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 23:14:06 juju-e4d256-prod-github-runner-207 kernel: [64220.558843] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:14:06 juju-e4d256-prod-github-runner-207 kernel: [64220.560060] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 23:14:06 juju-e4d256-prod-github-runner-207 kernel: [64220.562656] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 23:14:06 juju-e4d256-prod-github-runner-207 kernel: [64220.563700] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 23:14:06 juju-e4d256-prod-github-runner-207 kernel: [64220.564867] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 23:14:06 juju-e4d256-prod-github-runner-207 kernel: [64220.566039] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 23:14:06 juju-e4d256-prod-github-runner-207 kernel: [64220.567197] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 23:14:06 juju-e4d256-prod-github-runner-207 kernel: [64220.568356] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 23:14:06 juju-e4d256-prod-github-runner-207 kernel: [64220.569574] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 23:14:06 juju-e4d256-prod-github-runner-207 kernel: [64220.570850] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 23:14:06 juju-e4d256-prod-github-runner-207 kernel: [64220.571953] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 23:14:06 juju-e4d256-prod-github-runner-207 kernel: [64220.573170] Call Trace: Aug 22 23:14:06 juju-e4d256-prod-github-runner-207 kernel: [64220.574082] Aug 22 23:14:06 juju-e4d256-prod-github-runner-207 kernel: [64220.574979] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:14:06 juju-e4d256-prod-github-runner-207 kernel: [64220.576008] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:14:06 juju-e4d256-prod-github-runner-207 kernel: [64220.577028] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:14:06 juju-e4d256-prod-github-runner-207 kernel: [64220.578129] ? show_regs.part.0+0x23/0x29 Aug 22 23:14:06 juju-e4d256-prod-github-runner-207 kernel: [64220.579125] ? show_regs.cold+0x8/0xd Aug 22 23:14:06 juju-e4d256-prod-github-runner-207 kernel: [64220.580177] ? watchdog_timer_fn+0x1be/0x220 Aug 22 23:14:06 juju-e4d256-prod-github-runner-207 kernel: [64220.581209] ? lockup_detector_update_enable+0x60/0x60 Aug 22 23:14:06 juju-e4d256-prod-github-runner-207 kernel: [64220.582277] ? __hrtimer_run_queues+0x107/0x230 Aug 22 23:14:06 juju-e4d256-prod-github-runner-207 kernel: [64220.583304] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 23:14:06 juju-e4d256-prod-github-runner-207 kernel: [64220.584328] ? hrtimer_interrupt+0x101/0x220 Aug 22 23:14:06 juju-e4d256-prod-github-runner-207 kernel: [64220.585362] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 23:14:06 juju-e4d256-prod-github-runner-207 kernel: [64220.586428] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 23:14:06 juju-e4d256-prod-github-runner-207 kernel: [64220.587472] Aug 22 23:14:06 juju-e4d256-prod-github-runner-207 kernel: [64220.588326] Aug 22 23:14:06 juju-e4d256-prod-github-runner-207 kernel: [64220.589194] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 23:14:06 juju-e4d256-prod-github-runner-207 kernel: [64220.590318] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:14:06 juju-e4d256-prod-github-runner-207 kernel: [64220.591397] ? _raw_spin_lock+0x22/0x30 Aug 22 23:14:06 juju-e4d256-prod-github-runner-207 kernel: [64220.592350] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:14:06 juju-e4d256-prod-github-runner-207 kernel: [64220.593395] direct_page_fault+0x206/0x310 [kvm] Aug 22 23:14:06 juju-e4d256-prod-github-runner-207 kernel: [64220.594421] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 23:14:06 juju-e4d256-prod-github-runner-207 kernel: [64220.595437] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 23:14:06 juju-e4d256-prod-github-runner-207 kernel: [64220.596440] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 23:14:06 juju-e4d256-prod-github-runner-207 kernel: [64220.597455] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 23:14:06 juju-e4d256-prod-github-runner-207 kernel: [64220.598416] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 23:14:06 juju-e4d256-prod-github-runner-207 kernel: [64220.599406] handle_exit+0x98/0x230 [kvm_amd] Aug 22 23:14:06 juju-e4d256-prod-github-runner-207 kernel: [64220.600337] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 23:14:06 juju-e4d256-prod-github-runner-207 kernel: [64220.601270] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 23:14:06 juju-e4d256-prod-github-runner-207 kernel: [64220.602217] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 23:14:06 juju-e4d256-prod-github-runner-207 kernel: [64220.603139] vcpu_run+0x62/0x2c0 [kvm] Aug 22 23:14:06 juju-e4d256-prod-github-runner-207 kernel: [64220.604041] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 23:14:06 juju-e4d256-prod-github-runner-207 kernel: [64220.604874] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 23:14:06 juju-e4d256-prod-github-runner-207 kernel: [64220.605757] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 23:14:06 juju-e4d256-prod-github-runner-207 kernel: [64220.606561] ? __seccomp_filter+0x4a/0x4a0 Aug 22 23:14:06 juju-e4d256-prod-github-runner-207 kernel: [64220.607305] ? __fget_files+0x86/0xc0 Aug 22 23:14:06 juju-e4d256-prod-github-runner-207 kernel: [64220.608056] __x64_sys_ioctl+0x95/0xd0 Aug 22 23:14:06 juju-e4d256-prod-github-runner-207 kernel: [64220.608764] do_syscall_64+0x5c/0xc0 Aug 22 23:14:06 juju-e4d256-prod-github-runner-207 kernel: [64220.609458] ? do_futex+0x162/0x1f0 Aug 22 23:14:06 juju-e4d256-prod-github-runner-207 kernel: [64220.610109] ? __x64_sys_futex+0x78/0x1e0 Aug 22 23:14:06 juju-e4d256-prod-github-runner-207 kernel: [64220.610788] ? __secure_computing+0xa9/0x120 Aug 22 23:14:06 juju-e4d256-prod-github-runner-207 kernel: [64220.611478] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 23:14:06 juju-e4d256-prod-github-runner-207 kernel: [64220.612236] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:14:06 juju-e4d256-prod-github-runner-207 kernel: [64220.612958] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:14:06 juju-e4d256-prod-github-runner-207 kernel: [64220.613717] ? do_syscall_64+0x69/0xc0 Aug 22 23:14:06 juju-e4d256-prod-github-runner-207 kernel: [64220.614361] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:14:06 juju-e4d256-prod-github-runner-207 kernel: [64220.615063] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:14:06 juju-e4d256-prod-github-runner-207 kernel: [64220.615756] ? do_syscall_64+0x69/0xc0 Aug 22 23:14:06 juju-e4d256-prod-github-runner-207 kernel: [64220.616384] ? do_syscall_64+0x69/0xc0 Aug 22 23:14:06 juju-e4d256-prod-github-runner-207 kernel: [64220.617010] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 23:14:06 juju-e4d256-prod-github-runner-207 kernel: [64220.617724] RIP: 0033:0x7faa5d0edaff Aug 22 23:14:06 juju-e4d256-prod-github-runner-207 kernel: [64220.618383] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 23:14:06 juju-e4d256-prod-github-runner-207 kernel: [64220.620366] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 23:14:06 juju-e4d256-prod-github-runner-207 kernel: [64220.621290] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 23:14:06 juju-e4d256-prod-github-runner-207 kernel: [64220.622181] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 23:14:06 juju-e4d256-prod-github-runner-207 kernel: [64220.623080] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 23:14:06 juju-e4d256-prod-github-runner-207 kernel: [64220.623965] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 23:14:06 juju-e4d256-prod-github-runner-207 kernel: [64220.624852] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 23:14:06 juju-e4d256-prod-github-runner-207 kernel: [64220.625790] Aug 22 23:14:34 juju-e4d256-prod-github-runner-207 kernel: [64248.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 59728s! [qemu-system-x86:6715] Aug 22 23:14:34 juju-e4d256-prod-github-runner-207 kernel: [64248.543129] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 23:14:34 juju-e4d256-prod-github-runner-207 kernel: [64248.543205] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 23:14:34 juju-e4d256-prod-github-runner-207 kernel: [64248.555303] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 23:14:34 juju-e4d256-prod-github-runner-207 kernel: [64248.556647] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 23:14:34 juju-e4d256-prod-github-runner-207 kernel: [64248.557969] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:14:34 juju-e4d256-prod-github-runner-207 kernel: [64248.559034] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 23:14:34 juju-e4d256-prod-github-runner-207 kernel: [64248.561593] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 23:14:34 juju-e4d256-prod-github-runner-207 kernel: [64248.562640] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 23:14:34 juju-e4d256-prod-github-runner-207 kernel: [64248.563803] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 23:14:34 juju-e4d256-prod-github-runner-207 kernel: [64248.564980] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 23:14:34 juju-e4d256-prod-github-runner-207 kernel: [64248.566169] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 23:14:34 juju-e4d256-prod-github-runner-207 kernel: [64248.567334] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 23:14:34 juju-e4d256-prod-github-runner-207 kernel: [64248.568506] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 23:14:34 juju-e4d256-prod-github-runner-207 kernel: [64248.569835] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 23:14:34 juju-e4d256-prod-github-runner-207 kernel: [64248.571154] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 23:14:34 juju-e4d256-prod-github-runner-207 kernel: [64248.572661] Call Trace: Aug 22 23:14:34 juju-e4d256-prod-github-runner-207 kernel: [64248.573595] Aug 22 23:14:34 juju-e4d256-prod-github-runner-207 kernel: [64248.574480] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:14:34 juju-e4d256-prod-github-runner-207 kernel: [64248.575510] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:14:34 juju-e4d256-prod-github-runner-207 kernel: [64248.576535] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:14:34 juju-e4d256-prod-github-runner-207 kernel: [64248.577795] ? show_regs.part.0+0x23/0x29 Aug 22 23:14:34 juju-e4d256-prod-github-runner-207 kernel: [64248.578811] ? show_regs.cold+0x8/0xd Aug 22 23:14:34 juju-e4d256-prod-github-runner-207 kernel: [64248.579855] ? watchdog_timer_fn+0x1be/0x220 Aug 22 23:14:34 juju-e4d256-prod-github-runner-207 kernel: [64248.581143] ? lockup_detector_update_enable+0x60/0x60 Aug 22 23:14:34 juju-e4d256-prod-github-runner-207 kernel: [64248.582209] ? __hrtimer_run_queues+0x107/0x230 Aug 22 23:14:34 juju-e4d256-prod-github-runner-207 kernel: [64248.583236] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 23:14:34 juju-e4d256-prod-github-runner-207 kernel: [64248.584281] ? hrtimer_interrupt+0x101/0x220 Aug 22 23:14:34 juju-e4d256-prod-github-runner-207 kernel: [64248.585332] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 23:14:34 juju-e4d256-prod-github-runner-207 kernel: [64248.586409] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 23:14:34 juju-e4d256-prod-github-runner-207 kernel: [64248.587463] Aug 22 23:14:34 juju-e4d256-prod-github-runner-207 kernel: [64248.588316] Aug 22 23:14:34 juju-e4d256-prod-github-runner-207 kernel: [64248.589272] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 23:14:34 juju-e4d256-prod-github-runner-207 kernel: [64248.590306] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:14:34 juju-e4d256-prod-github-runner-207 kernel: [64248.591384] ? _raw_spin_lock+0x22/0x30 Aug 22 23:14:34 juju-e4d256-prod-github-runner-207 kernel: [64248.592345] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:14:34 juju-e4d256-prod-github-runner-207 kernel: [64248.593388] direct_page_fault+0x206/0x310 [kvm] Aug 22 23:14:34 juju-e4d256-prod-github-runner-207 kernel: [64248.594418] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 23:14:34 juju-e4d256-prod-github-runner-207 kernel: [64248.595428] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 23:14:34 juju-e4d256-prod-github-runner-207 kernel: [64248.596467] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 23:14:34 juju-e4d256-prod-github-runner-207 kernel: [64248.597506] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 23:14:34 juju-e4d256-prod-github-runner-207 kernel: [64248.598455] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 23:14:34 juju-e4d256-prod-github-runner-207 kernel: [64248.599587] handle_exit+0x98/0x230 [kvm_amd] Aug 22 23:14:34 juju-e4d256-prod-github-runner-207 kernel: [64248.600600] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 23:14:34 juju-e4d256-prod-github-runner-207 kernel: [64248.601569] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 23:14:34 juju-e4d256-prod-github-runner-207 kernel: [64248.602492] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 23:14:34 juju-e4d256-prod-github-runner-207 kernel: [64248.603407] vcpu_run+0x62/0x2c0 [kvm] Aug 22 23:14:34 juju-e4d256-prod-github-runner-207 kernel: [64248.604223] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 23:14:34 juju-e4d256-prod-github-runner-207 kernel: [64248.605103] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 23:14:34 juju-e4d256-prod-github-runner-207 kernel: [64248.605969] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 23:14:34 juju-e4d256-prod-github-runner-207 kernel: [64248.606772] ? __seccomp_filter+0x4a/0x4a0 Aug 22 23:14:34 juju-e4d256-prod-github-runner-207 kernel: [64248.607519] ? __fget_files+0x86/0xc0 Aug 22 23:14:34 juju-e4d256-prod-github-runner-207 kernel: [64248.608234] __x64_sys_ioctl+0x95/0xd0 Aug 22 23:14:34 juju-e4d256-prod-github-runner-207 kernel: [64248.608948] do_syscall_64+0x5c/0xc0 Aug 22 23:14:34 juju-e4d256-prod-github-runner-207 kernel: [64248.609615] ? do_futex+0x162/0x1f0 Aug 22 23:14:34 juju-e4d256-prod-github-runner-207 kernel: [64248.610267] ? __x64_sys_futex+0x78/0x1e0 Aug 22 23:14:34 juju-e4d256-prod-github-runner-207 kernel: [64248.610940] ? __secure_computing+0xa9/0x120 Aug 22 23:14:34 juju-e4d256-prod-github-runner-207 kernel: [64248.611629] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 23:14:34 juju-e4d256-prod-github-runner-207 kernel: [64248.612391] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:14:34 juju-e4d256-prod-github-runner-207 kernel: [64248.613127] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:14:34 juju-e4d256-prod-github-runner-207 kernel: [64248.613854] ? do_syscall_64+0x69/0xc0 Aug 22 23:14:34 juju-e4d256-prod-github-runner-207 kernel: [64248.614506] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:14:34 juju-e4d256-prod-github-runner-207 kernel: [64248.615212] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:14:34 juju-e4d256-prod-github-runner-207 kernel: [64248.615971] ? do_syscall_64+0x69/0xc0 Aug 22 23:14:34 juju-e4d256-prod-github-runner-207 kernel: [64248.616657] ? do_syscall_64+0x69/0xc0 Aug 22 23:14:34 juju-e4d256-prod-github-runner-207 kernel: [64248.617312] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 23:14:34 juju-e4d256-prod-github-runner-207 kernel: [64248.618023] RIP: 0033:0x7faa5d0edaff Aug 22 23:14:34 juju-e4d256-prod-github-runner-207 kernel: [64248.618649] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 23:14:34 juju-e4d256-prod-github-runner-207 kernel: [64248.620666] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 23:14:34 juju-e4d256-prod-github-runner-207 kernel: [64248.621603] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 23:14:34 juju-e4d256-prod-github-runner-207 kernel: [64248.622499] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 23:14:34 juju-e4d256-prod-github-runner-207 kernel: [64248.623387] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 23:14:34 juju-e4d256-prod-github-runner-207 kernel: [64248.624274] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 23:14:34 juju-e4d256-prod-github-runner-207 kernel: [64248.625183] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 23:14:34 juju-e4d256-prod-github-runner-207 kernel: [64248.626077] Aug 22 23:14:47 juju-e4d256-prod-github-runner-207 kernel: [64261.472706] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 23:14:47 juju-e4d256-prod-github-runner-207 kernel: [64261.473695] rcu: 1-....: (15985504 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=7717767 Aug 22 23:14:47 juju-e4d256-prod-github-runner-207 kernel: [64261.474818] (t=16036068 jiffies g=23269 q=56583) Aug 22 23:14:47 juju-e4d256-prod-github-runner-207 kernel: [64261.475653] NMI backtrace for cpu 1 Aug 22 23:14:47 juju-e4d256-prod-github-runner-207 kernel: [64261.476376] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 23:14:47 juju-e4d256-prod-github-runner-207 kernel: [64261.477496] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 23:14:47 juju-e4d256-prod-github-runner-207 kernel: [64261.478559] Call Trace: Aug 22 23:14:47 juju-e4d256-prod-github-runner-207 kernel: [64261.479247] Aug 22 23:14:47 juju-e4d256-prod-github-runner-207 kernel: [64261.479891] show_stack+0x52/0x5c Aug 22 23:14:47 juju-e4d256-prod-github-runner-207 kernel: [64261.480631] dump_stack_lvl+0x4a/0x63 Aug 22 23:14:47 juju-e4d256-prod-github-runner-207 kernel: [64261.481439] dump_stack+0x10/0x16 Aug 22 23:14:47 juju-e4d256-prod-github-runner-207 kernel: [64261.482186] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 23:14:47 juju-e4d256-prod-github-runner-207 kernel: [64261.482971] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 23:14:47 juju-e4d256-prod-github-runner-207 kernel: [64261.483754] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 23:14:47 juju-e4d256-prod-github-runner-207 kernel: [64261.484633] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 23:14:47 juju-e4d256-prod-github-runner-207 kernel: [64261.485466] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 23:14:47 juju-e4d256-prod-github-runner-207 kernel: [64261.486275] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 23:14:47 juju-e4d256-prod-github-runner-207 kernel: [64261.487091] print_cpu_stall.cold+0x2f/0xe2 Aug 22 23:14:47 juju-e4d256-prod-github-runner-207 kernel: [64261.487857] ? timekeeping_update+0xf7/0x150 Aug 22 23:14:47 juju-e4d256-prod-github-runner-207 kernel: [64261.488643] check_cpu_stall+0x109/0x270 Aug 22 23:14:47 juju-e4d256-prod-github-runner-207 kernel: [64261.489402] rcu_sched_clock_irq+0x9a/0x250 Aug 22 23:14:47 juju-e4d256-prod-github-runner-207 kernel: [64261.490164] update_process_times+0x94/0xd0 Aug 22 23:14:47 juju-e4d256-prod-github-runner-207 kernel: [64261.490931] tick_sched_handle+0x29/0x70 Aug 22 23:14:47 juju-e4d256-prod-github-runner-207 kernel: [64261.491677] tick_sched_timer+0x8c/0xc0 Aug 22 23:14:47 juju-e4d256-prod-github-runner-207 kernel: [64261.492420] ? tick_nohz_handler+0xb0/0xb0 Aug 22 23:14:47 juju-e4d256-prod-github-runner-207 kernel: [64261.493237] __hrtimer_run_queues+0x107/0x230 Aug 22 23:14:47 juju-e4d256-prod-github-runner-207 kernel: [64261.494014] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 23:14:47 juju-e4d256-prod-github-runner-207 kernel: [64261.494790] hrtimer_interrupt+0x101/0x220 Aug 22 23:14:47 juju-e4d256-prod-github-runner-207 kernel: [64261.495584] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 23:14:47 juju-e4d256-prod-github-runner-207 kernel: [64261.496647] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 23:14:47 juju-e4d256-prod-github-runner-207 kernel: [64261.497609] Aug 22 23:14:47 juju-e4d256-prod-github-runner-207 kernel: [64261.498245] Aug 22 23:14:47 juju-e4d256-prod-github-runner-207 kernel: [64261.498874] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 23:14:47 juju-e4d256-prod-github-runner-207 kernel: [64261.499741] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:14:47 juju-e4d256-prod-github-runner-207 kernel: [64261.501038] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 23:14:47 juju-e4d256-prod-github-runner-207 kernel: [64261.504136] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 23:14:47 juju-e4d256-prod-github-runner-207 kernel: [64261.505377] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 23:14:47 juju-e4d256-prod-github-runner-207 kernel: [64261.506715] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 23:14:47 juju-e4d256-prod-github-runner-207 kernel: [64261.508036] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 23:14:47 juju-e4d256-prod-github-runner-207 kernel: [64261.509358] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 23:14:47 juju-e4d256-prod-github-runner-207 kernel: [64261.510675] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 23:14:47 juju-e4d256-prod-github-runner-207 kernel: [64261.512005] ? _raw_spin_lock+0x22/0x30 Aug 22 23:14:47 juju-e4d256-prod-github-runner-207 kernel: [64261.513046] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:14:47 juju-e4d256-prod-github-runner-207 kernel: [64261.514157] direct_page_fault+0x206/0x310 [kvm] Aug 22 23:14:47 juju-e4d256-prod-github-runner-207 kernel: [64261.515286] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 23:14:47 juju-e4d256-prod-github-runner-207 kernel: [64261.516404] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 23:14:47 juju-e4d256-prod-github-runner-207 kernel: [64261.517549] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 23:14:47 juju-e4d256-prod-github-runner-207 kernel: [64261.518634] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 23:14:47 juju-e4d256-prod-github-runner-207 kernel: [64261.519691] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 23:14:47 juju-e4d256-prod-github-runner-207 kernel: [64261.520942] handle_exit+0x98/0x230 [kvm_amd] Aug 22 23:14:47 juju-e4d256-prod-github-runner-207 kernel: [64261.521966] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 23:14:47 juju-e4d256-prod-github-runner-207 kernel: [64261.523112] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 23:14:47 juju-e4d256-prod-github-runner-207 kernel: [64261.524249] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 23:14:47 juju-e4d256-prod-github-runner-207 kernel: [64261.525418] vcpu_run+0x62/0x2c0 [kvm] Aug 22 23:14:47 juju-e4d256-prod-github-runner-207 kernel: [64261.526187] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 23:14:47 juju-e4d256-prod-github-runner-207 kernel: [64261.526951] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 23:14:47 juju-e4d256-prod-github-runner-207 kernel: [64261.527792] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 23:14:47 juju-e4d256-prod-github-runner-207 kernel: [64261.528675] ? __seccomp_filter+0x4a/0x4a0 Aug 22 23:14:47 juju-e4d256-prod-github-runner-207 kernel: [64261.529743] ? __fget_files+0x86/0xc0 Aug 22 23:14:47 juju-e4d256-prod-github-runner-207 kernel: [64261.530738] __x64_sys_ioctl+0x95/0xd0 Aug 22 23:14:47 juju-e4d256-prod-github-runner-207 kernel: [64261.531722] do_syscall_64+0x5c/0xc0 Aug 22 23:14:47 juju-e4d256-prod-github-runner-207 kernel: [64261.532721] ? do_futex+0x162/0x1f0 Aug 22 23:14:47 juju-e4d256-prod-github-runner-207 kernel: [64261.533664] ? __x64_sys_futex+0x78/0x1e0 Aug 22 23:14:47 juju-e4d256-prod-github-runner-207 kernel: [64261.534656] ? __secure_computing+0xa9/0x120 Aug 22 23:14:47 juju-e4d256-prod-github-runner-207 kernel: [64261.535654] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 23:14:47 juju-e4d256-prod-github-runner-207 kernel: [64261.536757] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:14:47 juju-e4d256-prod-github-runner-207 kernel: [64261.537768] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:14:47 juju-e4d256-prod-github-runner-207 kernel: [64261.538761] ? do_syscall_64+0x69/0xc0 Aug 22 23:14:47 juju-e4d256-prod-github-runner-207 kernel: [64261.539691] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:14:47 juju-e4d256-prod-github-runner-207 kernel: [64261.540746] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:14:47 juju-e4d256-prod-github-runner-207 kernel: [64261.541906] ? do_syscall_64+0x69/0xc0 Aug 22 23:14:47 juju-e4d256-prod-github-runner-207 kernel: [64261.542881] ? do_syscall_64+0x69/0xc0 Aug 22 23:14:47 juju-e4d256-prod-github-runner-207 kernel: [64261.543613] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 23:14:47 juju-e4d256-prod-github-runner-207 kernel: [64261.544395] RIP: 0033:0x7faa5d0edaff Aug 22 23:14:47 juju-e4d256-prod-github-runner-207 kernel: [64261.545112] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 23:14:47 juju-e4d256-prod-github-runner-207 kernel: [64261.547209] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 23:14:47 juju-e4d256-prod-github-runner-207 kernel: [64261.548176] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 23:14:47 juju-e4d256-prod-github-runner-207 kernel: [64261.549142] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 23:14:47 juju-e4d256-prod-github-runner-207 kernel: [64261.550296] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 23:14:47 juju-e4d256-prod-github-runner-207 kernel: [64261.551756] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 23:14:47 juju-e4d256-prod-github-runner-207 kernel: [64261.552708] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 23:14:47 juju-e4d256-prod-github-runner-207 kernel: [64261.553713] Aug 22 23:15:14 juju-e4d256-prod-github-runner-207 kernel: [64288.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 59765s! [qemu-system-x86:6715] Aug 22 23:15:14 juju-e4d256-prod-github-runner-207 kernel: [64288.543158] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 23:15:14 juju-e4d256-prod-github-runner-207 kernel: [64288.543232] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 23:15:14 juju-e4d256-prod-github-runner-207 kernel: [64288.555426] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 23:15:14 juju-e4d256-prod-github-runner-207 kernel: [64288.556769] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 23:15:14 juju-e4d256-prod-github-runner-207 kernel: [64288.557998] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:15:14 juju-e4d256-prod-github-runner-207 kernel: [64288.559061] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 23:15:14 juju-e4d256-prod-github-runner-207 kernel: [64288.561622] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 23:15:14 juju-e4d256-prod-github-runner-207 kernel: [64288.562672] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 23:15:14 juju-e4d256-prod-github-runner-207 kernel: [64288.563841] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 23:15:14 juju-e4d256-prod-github-runner-207 kernel: [64288.565011] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 23:15:14 juju-e4d256-prod-github-runner-207 kernel: [64288.566170] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 23:15:14 juju-e4d256-prod-github-runner-207 kernel: [64288.567345] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 23:15:14 juju-e4d256-prod-github-runner-207 kernel: [64288.568529] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 23:15:14 juju-e4d256-prod-github-runner-207 kernel: [64288.569759] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 23:15:14 juju-e4d256-prod-github-runner-207 kernel: [64288.570863] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 23:15:14 juju-e4d256-prod-github-runner-207 kernel: [64288.572055] Call Trace: Aug 22 23:15:14 juju-e4d256-prod-github-runner-207 kernel: [64288.572974] Aug 22 23:15:14 juju-e4d256-prod-github-runner-207 kernel: [64288.573862] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:15:14 juju-e4d256-prod-github-runner-207 kernel: [64288.574892] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:15:14 juju-e4d256-prod-github-runner-207 kernel: [64288.575946] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:15:14 juju-e4d256-prod-github-runner-207 kernel: [64288.577042] ? show_regs.part.0+0x23/0x29 Aug 22 23:15:14 juju-e4d256-prod-github-runner-207 kernel: [64288.578037] ? show_regs.cold+0x8/0xd Aug 22 23:15:14 juju-e4d256-prod-github-runner-207 kernel: [64288.579009] ? watchdog_timer_fn+0x1be/0x220 Aug 22 23:15:14 juju-e4d256-prod-github-runner-207 kernel: [64288.580075] ? lockup_detector_update_enable+0x60/0x60 Aug 22 23:15:14 juju-e4d256-prod-github-runner-207 kernel: [64288.581161] ? __hrtimer_run_queues+0x107/0x230 Aug 22 23:15:14 juju-e4d256-prod-github-runner-207 kernel: [64288.582223] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 23:15:14 juju-e4d256-prod-github-runner-207 kernel: [64288.583248] ? hrtimer_interrupt+0x101/0x220 Aug 22 23:15:14 juju-e4d256-prod-github-runner-207 kernel: [64288.584297] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 23:15:14 juju-e4d256-prod-github-runner-207 kernel: [64288.585365] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 23:15:14 juju-e4d256-prod-github-runner-207 kernel: [64288.586411] Aug 22 23:15:14 juju-e4d256-prod-github-runner-207 kernel: [64288.587263] Aug 22 23:15:14 juju-e4d256-prod-github-runner-207 kernel: [64288.588101] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 23:15:14 juju-e4d256-prod-github-runner-207 kernel: [64288.589146] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:15:14 juju-e4d256-prod-github-runner-207 kernel: [64288.590239] ? _raw_spin_lock+0x22/0x30 Aug 22 23:15:14 juju-e4d256-prod-github-runner-207 kernel: [64288.591212] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:15:14 juju-e4d256-prod-github-runner-207 kernel: [64288.592266] direct_page_fault+0x206/0x310 [kvm] Aug 22 23:15:14 juju-e4d256-prod-github-runner-207 kernel: [64288.593323] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 23:15:14 juju-e4d256-prod-github-runner-207 kernel: [64288.594339] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 23:15:14 juju-e4d256-prod-github-runner-207 kernel: [64288.595368] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 23:15:14 juju-e4d256-prod-github-runner-207 kernel: [64288.596358] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 23:15:14 juju-e4d256-prod-github-runner-207 kernel: [64288.597303] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 23:15:14 juju-e4d256-prod-github-runner-207 kernel: [64288.598284] handle_exit+0x98/0x230 [kvm_amd] Aug 22 23:15:14 juju-e4d256-prod-github-runner-207 kernel: [64288.599187] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 23:15:14 juju-e4d256-prod-github-runner-207 kernel: [64288.600102] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 23:15:14 juju-e4d256-prod-github-runner-207 kernel: [64288.601074] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 23:15:14 juju-e4d256-prod-github-runner-207 kernel: [64288.602012] vcpu_run+0x62/0x2c0 [kvm] Aug 22 23:15:14 juju-e4d256-prod-github-runner-207 kernel: [64288.602832] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 23:15:14 juju-e4d256-prod-github-runner-207 kernel: [64288.603654] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 23:15:14 juju-e4d256-prod-github-runner-207 kernel: [64288.604529] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 23:15:14 juju-e4d256-prod-github-runner-207 kernel: [64288.605354] ? __seccomp_filter+0x4a/0x4a0 Aug 22 23:15:14 juju-e4d256-prod-github-runner-207 kernel: [64288.606097] ? __fget_files+0x86/0xc0 Aug 22 23:15:14 juju-e4d256-prod-github-runner-207 kernel: [64288.606801] __x64_sys_ioctl+0x95/0xd0 Aug 22 23:15:14 juju-e4d256-prod-github-runner-207 kernel: [64288.607492] do_syscall_64+0x5c/0xc0 Aug 22 23:15:14 juju-e4d256-prod-github-runner-207 kernel: [64288.608157] ? do_futex+0x162/0x1f0 Aug 22 23:15:14 juju-e4d256-prod-github-runner-207 kernel: [64288.608815] ? __x64_sys_futex+0x78/0x1e0 Aug 22 23:15:14 juju-e4d256-prod-github-runner-207 kernel: [64288.609492] ? __secure_computing+0xa9/0x120 Aug 22 23:15:14 juju-e4d256-prod-github-runner-207 kernel: [64288.610179] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 23:15:14 juju-e4d256-prod-github-runner-207 kernel: [64288.610939] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:15:14 juju-e4d256-prod-github-runner-207 kernel: [64288.611659] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:15:14 juju-e4d256-prod-github-runner-207 kernel: [64288.612391] ? do_syscall_64+0x69/0xc0 Aug 22 23:15:14 juju-e4d256-prod-github-runner-207 kernel: [64288.613037] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:15:14 juju-e4d256-prod-github-runner-207 kernel: [64288.613763] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:15:14 juju-e4d256-prod-github-runner-207 kernel: [64288.614458] ? do_syscall_64+0x69/0xc0 Aug 22 23:15:14 juju-e4d256-prod-github-runner-207 kernel: [64288.615085] ? do_syscall_64+0x69/0xc0 Aug 22 23:15:14 juju-e4d256-prod-github-runner-207 kernel: [64288.615713] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 23:15:14 juju-e4d256-prod-github-runner-207 kernel: [64288.616430] RIP: 0033:0x7faa5d0edaff Aug 22 23:15:14 juju-e4d256-prod-github-runner-207 kernel: [64288.617057] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 23:15:14 juju-e4d256-prod-github-runner-207 kernel: [64288.619049] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 23:15:14 juju-e4d256-prod-github-runner-207 kernel: [64288.619963] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 23:15:14 juju-e4d256-prod-github-runner-207 kernel: [64288.620867] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 23:15:14 juju-e4d256-prod-github-runner-207 kernel: [64288.621760] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 23:15:14 juju-e4d256-prod-github-runner-207 kernel: [64288.622650] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 23:15:14 juju-e4d256-prod-github-runner-207 kernel: [64288.623539] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 23:15:14 juju-e4d256-prod-github-runner-207 kernel: [64288.624442] Aug 22 23:15:42 juju-e4d256-prod-github-runner-207 kernel: [64316.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 59791s! [qemu-system-x86:6715] Aug 22 23:15:42 juju-e4d256-prod-github-runner-207 kernel: [64316.543888] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 23:15:42 juju-e4d256-prod-github-runner-207 kernel: [64316.544204] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 23:15:42 juju-e4d256-prod-github-runner-207 kernel: [64316.556566] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 23:15:42 juju-e4d256-prod-github-runner-207 kernel: [64316.557842] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 23:15:42 juju-e4d256-prod-github-runner-207 kernel: [64316.559074] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:15:42 juju-e4d256-prod-github-runner-207 kernel: [64316.560153] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 23:15:42 juju-e4d256-prod-github-runner-207 kernel: [64316.562774] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 23:15:42 juju-e4d256-prod-github-runner-207 kernel: [64316.563850] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 23:15:42 juju-e4d256-prod-github-runner-207 kernel: [64316.565044] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 23:15:42 juju-e4d256-prod-github-runner-207 kernel: [64316.566200] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 23:15:42 juju-e4d256-prod-github-runner-207 kernel: [64316.567365] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 23:15:42 juju-e4d256-prod-github-runner-207 kernel: [64316.568550] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 23:15:42 juju-e4d256-prod-github-runner-207 kernel: [64316.569723] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 23:15:42 juju-e4d256-prod-github-runner-207 kernel: [64316.570961] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 23:15:42 juju-e4d256-prod-github-runner-207 kernel: [64316.572076] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 23:15:42 juju-e4d256-prod-github-runner-207 kernel: [64316.573275] Call Trace: Aug 22 23:15:42 juju-e4d256-prod-github-runner-207 kernel: [64316.574218] Aug 22 23:15:42 juju-e4d256-prod-github-runner-207 kernel: [64316.575127] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:15:42 juju-e4d256-prod-github-runner-207 kernel: [64316.576178] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:15:42 juju-e4d256-prod-github-runner-207 kernel: [64316.577208] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:15:42 juju-e4d256-prod-github-runner-207 kernel: [64316.578322] ? show_regs.part.0+0x23/0x29 Aug 22 23:15:42 juju-e4d256-prod-github-runner-207 kernel: [64316.579324] ? show_regs.cold+0x8/0xd Aug 22 23:15:42 juju-e4d256-prod-github-runner-207 kernel: [64316.580320] ? watchdog_timer_fn+0x1be/0x220 Aug 22 23:15:42 juju-e4d256-prod-github-runner-207 kernel: [64316.581329] ? lockup_detector_update_enable+0x60/0x60 Aug 22 23:15:42 juju-e4d256-prod-github-runner-207 kernel: [64316.582392] ? __hrtimer_run_queues+0x107/0x230 Aug 22 23:15:42 juju-e4d256-prod-github-runner-207 kernel: [64316.583429] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 23:15:42 juju-e4d256-prod-github-runner-207 kernel: [64316.584471] ? hrtimer_interrupt+0x101/0x220 Aug 22 23:15:42 juju-e4d256-prod-github-runner-207 kernel: [64316.585490] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 23:15:42 juju-e4d256-prod-github-runner-207 kernel: [64316.586560] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 23:15:42 juju-e4d256-prod-github-runner-207 kernel: [64316.587610] Aug 22 23:15:42 juju-e4d256-prod-github-runner-207 kernel: [64316.588488] Aug 22 23:15:42 juju-e4d256-prod-github-runner-207 kernel: [64316.589326] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 23:15:42 juju-e4d256-prod-github-runner-207 kernel: [64316.590360] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:15:42 juju-e4d256-prod-github-runner-207 kernel: [64316.591402] ? _raw_spin_lock+0x22/0x30 Aug 22 23:15:42 juju-e4d256-prod-github-runner-207 kernel: [64316.592364] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:15:42 juju-e4d256-prod-github-runner-207 kernel: [64316.593388] direct_page_fault+0x206/0x310 [kvm] Aug 22 23:15:42 juju-e4d256-prod-github-runner-207 kernel: [64316.594428] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 23:15:42 juju-e4d256-prod-github-runner-207 kernel: [64316.595442] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 23:15:42 juju-e4d256-prod-github-runner-207 kernel: [64316.596465] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 23:15:42 juju-e4d256-prod-github-runner-207 kernel: [64316.597479] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 23:15:42 juju-e4d256-prod-github-runner-207 kernel: [64316.598430] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 23:15:42 juju-e4d256-prod-github-runner-207 kernel: [64316.599408] handle_exit+0x98/0x230 [kvm_amd] Aug 22 23:15:42 juju-e4d256-prod-github-runner-207 kernel: [64316.600433] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 23:15:42 juju-e4d256-prod-github-runner-207 kernel: [64316.601362] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 23:15:42 juju-e4d256-prod-github-runner-207 kernel: [64316.602304] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 23:15:42 juju-e4d256-prod-github-runner-207 kernel: [64316.603231] vcpu_run+0x62/0x2c0 [kvm] Aug 22 23:15:42 juju-e4d256-prod-github-runner-207 kernel: [64316.604093] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 23:15:42 juju-e4d256-prod-github-runner-207 kernel: [64316.604924] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 23:15:42 juju-e4d256-prod-github-runner-207 kernel: [64316.605807] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 23:15:42 juju-e4d256-prod-github-runner-207 kernel: [64316.606616] ? __seccomp_filter+0x4a/0x4a0 Aug 22 23:15:42 juju-e4d256-prod-github-runner-207 kernel: [64316.607368] ? __fget_files+0x86/0xc0 Aug 22 23:15:42 juju-e4d256-prod-github-runner-207 kernel: [64316.608114] __x64_sys_ioctl+0x95/0xd0 Aug 22 23:15:42 juju-e4d256-prod-github-runner-207 kernel: [64316.608826] do_syscall_64+0x5c/0xc0 Aug 22 23:15:42 juju-e4d256-prod-github-runner-207 kernel: [64316.609497] ? do_futex+0x162/0x1f0 Aug 22 23:15:42 juju-e4d256-prod-github-runner-207 kernel: [64316.610146] ? __x64_sys_futex+0x78/0x1e0 Aug 22 23:15:42 juju-e4d256-prod-github-runner-207 kernel: [64316.610821] ? __secure_computing+0xa9/0x120 Aug 22 23:15:42 juju-e4d256-prod-github-runner-207 kernel: [64316.611516] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 23:15:42 juju-e4d256-prod-github-runner-207 kernel: [64316.612308] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:15:42 juju-e4d256-prod-github-runner-207 kernel: [64316.613036] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:15:42 juju-e4d256-prod-github-runner-207 kernel: [64316.613754] ? do_syscall_64+0x69/0xc0 Aug 22 23:15:42 juju-e4d256-prod-github-runner-207 kernel: [64316.614397] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:15:42 juju-e4d256-prod-github-runner-207 kernel: [64316.615102] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:15:42 juju-e4d256-prod-github-runner-207 kernel: [64316.615976] ? do_syscall_64+0x69/0xc0 Aug 22 23:15:42 juju-e4d256-prod-github-runner-207 kernel: [64316.616701] ? do_syscall_64+0x69/0xc0 Aug 22 23:15:42 juju-e4d256-prod-github-runner-207 kernel: [64316.617408] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 23:15:42 juju-e4d256-prod-github-runner-207 kernel: [64316.618233] RIP: 0033:0x7faa5d0edaff Aug 22 23:15:42 juju-e4d256-prod-github-runner-207 kernel: [64316.618985] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 23:15:42 juju-e4d256-prod-github-runner-207 kernel: [64316.621358] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 23:15:42 juju-e4d256-prod-github-runner-207 kernel: [64316.622424] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 23:15:42 juju-e4d256-prod-github-runner-207 kernel: [64316.623456] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 23:15:42 juju-e4d256-prod-github-runner-207 kernel: [64316.624513] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 23:15:42 juju-e4d256-prod-github-runner-207 kernel: [64316.625542] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 23:15:42 juju-e4d256-prod-github-runner-207 kernel: [64316.626582] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 23:15:42 juju-e4d256-prod-github-runner-207 kernel: [64316.627634] Aug 22 23:16:10 juju-e4d256-prod-github-runner-207 kernel: [64344.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 59817s! [qemu-system-x86:6715] Aug 22 23:16:10 juju-e4d256-prod-github-runner-207 kernel: [64344.543086] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 23:16:10 juju-e4d256-prod-github-runner-207 kernel: [64344.543159] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 23:16:10 juju-e4d256-prod-github-runner-207 kernel: [64344.555410] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 23:16:10 juju-e4d256-prod-github-runner-207 kernel: [64344.556701] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 23:16:10 juju-e4d256-prod-github-runner-207 kernel: [64344.557957] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:16:10 juju-e4d256-prod-github-runner-207 kernel: [64344.559015] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 23:16:10 juju-e4d256-prod-github-runner-207 kernel: [64344.561584] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 23:16:10 juju-e4d256-prod-github-runner-207 kernel: [64344.562625] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 23:16:10 juju-e4d256-prod-github-runner-207 kernel: [64344.563821] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 23:16:10 juju-e4d256-prod-github-runner-207 kernel: [64344.564986] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 23:16:10 juju-e4d256-prod-github-runner-207 kernel: [64344.566150] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 23:16:10 juju-e4d256-prod-github-runner-207 kernel: [64344.567315] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 23:16:10 juju-e4d256-prod-github-runner-207 kernel: [64344.568503] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 23:16:10 juju-e4d256-prod-github-runner-207 kernel: [64344.569740] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 23:16:10 juju-e4d256-prod-github-runner-207 kernel: [64344.570837] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 23:16:10 juju-e4d256-prod-github-runner-207 kernel: [64344.572041] Call Trace: Aug 22 23:16:10 juju-e4d256-prod-github-runner-207 kernel: [64344.572951] Aug 22 23:16:10 juju-e4d256-prod-github-runner-207 kernel: [64344.573839] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:16:10 juju-e4d256-prod-github-runner-207 kernel: [64344.574928] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:16:10 juju-e4d256-prod-github-runner-207 kernel: [64344.576342] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:16:10 juju-e4d256-prod-github-runner-207 kernel: [64344.577828] ? show_regs.part.0+0x23/0x29 Aug 22 23:16:10 juju-e4d256-prod-github-runner-207 kernel: [64344.579210] ? show_regs.cold+0x8/0xd Aug 22 23:16:10 juju-e4d256-prod-github-runner-207 kernel: [64344.580635] ? watchdog_timer_fn+0x1be/0x220 Aug 22 23:16:10 juju-e4d256-prod-github-runner-207 kernel: [64344.582022] ? lockup_detector_update_enable+0x60/0x60 Aug 22 23:16:10 juju-e4d256-prod-github-runner-207 kernel: [64344.583465] ? __hrtimer_run_queues+0x107/0x230 Aug 22 23:16:10 juju-e4d256-prod-github-runner-207 kernel: [64344.584549] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 23:16:10 juju-e4d256-prod-github-runner-207 kernel: [64344.585577] ? hrtimer_interrupt+0x101/0x220 Aug 22 23:16:10 juju-e4d256-prod-github-runner-207 kernel: [64344.586643] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 23:16:10 juju-e4d256-prod-github-runner-207 kernel: [64344.587780] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 23:16:10 juju-e4d256-prod-github-runner-207 kernel: [64344.588826] Aug 22 23:16:10 juju-e4d256-prod-github-runner-207 kernel: [64344.589678] Aug 22 23:16:10 juju-e4d256-prod-github-runner-207 kernel: [64344.590514] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 23:16:10 juju-e4d256-prod-github-runner-207 kernel: [64344.591627] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:16:10 juju-e4d256-prod-github-runner-207 kernel: [64344.592701] ? _raw_spin_lock+0x22/0x30 Aug 22 23:16:10 juju-e4d256-prod-github-runner-207 kernel: [64344.593652] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:16:10 juju-e4d256-prod-github-runner-207 kernel: [64344.594698] direct_page_fault+0x206/0x310 [kvm] Aug 22 23:16:10 juju-e4d256-prod-github-runner-207 kernel: [64344.595759] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 23:16:10 juju-e4d256-prod-github-runner-207 kernel: [64344.596775] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 23:16:10 juju-e4d256-prod-github-runner-207 kernel: [64344.597793] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 23:16:10 juju-e4d256-prod-github-runner-207 kernel: [64344.598781] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 23:16:10 juju-e4d256-prod-github-runner-207 kernel: [64344.599775] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 23:16:10 juju-e4d256-prod-github-runner-207 kernel: [64344.600777] handle_exit+0x98/0x230 [kvm_amd] Aug 22 23:16:10 juju-e4d256-prod-github-runner-207 kernel: [64344.601673] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 23:16:10 juju-e4d256-prod-github-runner-207 kernel: [64344.602589] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 23:16:10 juju-e4d256-prod-github-runner-207 kernel: [64344.603543] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 23:16:10 juju-e4d256-prod-github-runner-207 kernel: [64344.604449] vcpu_run+0x62/0x2c0 [kvm] Aug 22 23:16:10 juju-e4d256-prod-github-runner-207 kernel: [64344.605263] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 23:16:10 juju-e4d256-prod-github-runner-207 kernel: [64344.606075] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 23:16:10 juju-e4d256-prod-github-runner-207 kernel: [64344.606939] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 23:16:10 juju-e4d256-prod-github-runner-207 kernel: [64344.607755] ? __seccomp_filter+0x4a/0x4a0 Aug 22 23:16:10 juju-e4d256-prod-github-runner-207 kernel: [64344.608533] ? __fget_files+0x86/0xc0 Aug 22 23:16:10 juju-e4d256-prod-github-runner-207 kernel: [64344.609265] __x64_sys_ioctl+0x95/0xd0 Aug 22 23:16:10 juju-e4d256-prod-github-runner-207 kernel: [64344.609979] do_syscall_64+0x5c/0xc0 Aug 22 23:16:10 juju-e4d256-prod-github-runner-207 kernel: [64344.610654] ? do_futex+0x162/0x1f0 Aug 22 23:16:10 juju-e4d256-prod-github-runner-207 kernel: [64344.611301] ? __x64_sys_futex+0x78/0x1e0 Aug 22 23:16:10 juju-e4d256-prod-github-runner-207 kernel: [64344.611989] ? __secure_computing+0xa9/0x120 Aug 22 23:16:10 juju-e4d256-prod-github-runner-207 kernel: [64344.612681] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 23:16:10 juju-e4d256-prod-github-runner-207 kernel: [64344.613493] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:16:10 juju-e4d256-prod-github-runner-207 kernel: [64344.614214] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:16:10 juju-e4d256-prod-github-runner-207 kernel: [64344.614935] ? do_syscall_64+0x69/0xc0 Aug 22 23:16:10 juju-e4d256-prod-github-runner-207 kernel: [64344.615610] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:16:10 juju-e4d256-prod-github-runner-207 kernel: [64344.616317] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:16:10 juju-e4d256-prod-github-runner-207 kernel: [64344.617016] ? do_syscall_64+0x69/0xc0 Aug 22 23:16:10 juju-e4d256-prod-github-runner-207 kernel: [64344.617658] ? do_syscall_64+0x69/0xc0 Aug 22 23:16:10 juju-e4d256-prod-github-runner-207 kernel: [64344.618286] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 23:16:10 juju-e4d256-prod-github-runner-207 kernel: [64344.618997] RIP: 0033:0x7faa5d0edaff Aug 22 23:16:10 juju-e4d256-prod-github-runner-207 kernel: [64344.619640] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 23:16:10 juju-e4d256-prod-github-runner-207 kernel: [64344.621653] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 23:16:10 juju-e4d256-prod-github-runner-207 kernel: [64344.622586] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 23:16:10 juju-e4d256-prod-github-runner-207 kernel: [64344.623508] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 23:16:10 juju-e4d256-prod-github-runner-207 kernel: [64344.624426] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 23:16:10 juju-e4d256-prod-github-runner-207 kernel: [64344.625322] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 23:16:10 juju-e4d256-prod-github-runner-207 kernel: [64344.626209] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 23:16:10 juju-e4d256-prod-github-runner-207 kernel: [64344.627099] Aug 22 23:16:38 juju-e4d256-prod-github-runner-207 kernel: [64372.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 59843s! [qemu-system-x86:6715] Aug 22 23:16:38 juju-e4d256-prod-github-runner-207 kernel: [64372.543140] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 23:16:38 juju-e4d256-prod-github-runner-207 kernel: [64372.543229] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 23:16:38 juju-e4d256-prod-github-runner-207 kernel: [64372.555588] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 23:16:38 juju-e4d256-prod-github-runner-207 kernel: [64372.556907] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 23:16:38 juju-e4d256-prod-github-runner-207 kernel: [64372.558149] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:16:38 juju-e4d256-prod-github-runner-207 kernel: [64372.559227] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 23:16:38 juju-e4d256-prod-github-runner-207 kernel: [64372.561794] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 23:16:38 juju-e4d256-prod-github-runner-207 kernel: [64372.562885] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 23:16:38 juju-e4d256-prod-github-runner-207 kernel: [64372.564078] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 23:16:38 juju-e4d256-prod-github-runner-207 kernel: [64372.565242] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 23:16:38 juju-e4d256-prod-github-runner-207 kernel: [64372.566425] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 23:16:38 juju-e4d256-prod-github-runner-207 kernel: [64372.567633] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 23:16:38 juju-e4d256-prod-github-runner-207 kernel: [64372.568816] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 23:16:38 juju-e4d256-prod-github-runner-207 kernel: [64372.570061] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 23:16:38 juju-e4d256-prod-github-runner-207 kernel: [64372.571187] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 23:16:38 juju-e4d256-prod-github-runner-207 kernel: [64372.572525] Call Trace: Aug 22 23:16:38 juju-e4d256-prod-github-runner-207 kernel: [64372.573469] Aug 22 23:16:38 juju-e4d256-prod-github-runner-207 kernel: [64372.574368] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:16:38 juju-e4d256-prod-github-runner-207 kernel: [64372.575423] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:16:38 juju-e4d256-prod-github-runner-207 kernel: [64372.576450] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:16:38 juju-e4d256-prod-github-runner-207 kernel: [64372.577559] ? show_regs.part.0+0x23/0x29 Aug 22 23:16:38 juju-e4d256-prod-github-runner-207 kernel: [64372.578580] ? show_regs.cold+0x8/0xd Aug 22 23:16:38 juju-e4d256-prod-github-runner-207 kernel: [64372.579581] ? watchdog_timer_fn+0x1be/0x220 Aug 22 23:16:38 juju-e4d256-prod-github-runner-207 kernel: [64372.580591] ? lockup_detector_update_enable+0x60/0x60 Aug 22 23:16:38 juju-e4d256-prod-github-runner-207 kernel: [64372.581659] ? __hrtimer_run_queues+0x107/0x230 Aug 22 23:16:38 juju-e4d256-prod-github-runner-207 kernel: [64372.582705] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 23:16:38 juju-e4d256-prod-github-runner-207 kernel: [64372.583776] ? hrtimer_interrupt+0x101/0x220 Aug 22 23:16:38 juju-e4d256-prod-github-runner-207 kernel: [64372.584799] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 23:16:38 juju-e4d256-prod-github-runner-207 kernel: [64372.585868] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 23:16:38 juju-e4d256-prod-github-runner-207 kernel: [64372.586914] Aug 22 23:16:38 juju-e4d256-prod-github-runner-207 kernel: [64372.587797] Aug 22 23:16:38 juju-e4d256-prod-github-runner-207 kernel: [64372.588652] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 23:16:38 juju-e4d256-prod-github-runner-207 kernel: [64372.589694] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:16:38 juju-e4d256-prod-github-runner-207 kernel: [64372.590734] ? _raw_spin_lock+0x22/0x30 Aug 22 23:16:38 juju-e4d256-prod-github-runner-207 kernel: [64372.591701] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:16:38 juju-e4d256-prod-github-runner-207 kernel: [64372.592744] direct_page_fault+0x206/0x310 [kvm] Aug 22 23:16:38 juju-e4d256-prod-github-runner-207 kernel: [64372.593937] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 23:16:38 juju-e4d256-prod-github-runner-207 kernel: [64372.594960] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 23:16:38 juju-e4d256-prod-github-runner-207 kernel: [64372.595985] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 23:16:38 juju-e4d256-prod-github-runner-207 kernel: [64372.596957] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 23:16:38 juju-e4d256-prod-github-runner-207 kernel: [64372.597929] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 23:16:38 juju-e4d256-prod-github-runner-207 kernel: [64372.599093] handle_exit+0x98/0x230 [kvm_amd] Aug 22 23:16:38 juju-e4d256-prod-github-runner-207 kernel: [64372.600017] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 23:16:38 juju-e4d256-prod-github-runner-207 kernel: [64372.600937] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 23:16:38 juju-e4d256-prod-github-runner-207 kernel: [64372.601870] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 23:16:38 juju-e4d256-prod-github-runner-207 kernel: [64372.602799] vcpu_run+0x62/0x2c0 [kvm] Aug 22 23:16:38 juju-e4d256-prod-github-runner-207 kernel: [64372.603686] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 23:16:38 juju-e4d256-prod-github-runner-207 kernel: [64372.604677] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 23:16:38 juju-e4d256-prod-github-runner-207 kernel: [64372.605544] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 23:16:38 juju-e4d256-prod-github-runner-207 kernel: [64372.606388] ? __seccomp_filter+0x4a/0x4a0 Aug 22 23:16:38 juju-e4d256-prod-github-runner-207 kernel: [64372.607148] ? __fget_files+0x86/0xc0 Aug 22 23:16:38 juju-e4d256-prod-github-runner-207 kernel: [64372.607894] __x64_sys_ioctl+0x95/0xd0 Aug 22 23:16:38 juju-e4d256-prod-github-runner-207 kernel: [64372.608600] do_syscall_64+0x5c/0xc0 Aug 22 23:16:38 juju-e4d256-prod-github-runner-207 kernel: [64372.609301] ? do_futex+0x162/0x1f0 Aug 22 23:16:38 juju-e4d256-prod-github-runner-207 kernel: [64372.609955] ? __x64_sys_futex+0x78/0x1e0 Aug 22 23:16:38 juju-e4d256-prod-github-runner-207 kernel: [64372.610633] ? __secure_computing+0xa9/0x120 Aug 22 23:16:38 juju-e4d256-prod-github-runner-207 kernel: [64372.611348] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 23:16:38 juju-e4d256-prod-github-runner-207 kernel: [64372.612115] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:16:38 juju-e4d256-prod-github-runner-207 kernel: [64372.612842] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:16:38 juju-e4d256-prod-github-runner-207 kernel: [64372.613599] ? do_syscall_64+0x69/0xc0 Aug 22 23:16:38 juju-e4d256-prod-github-runner-207 kernel: [64372.614292] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:16:38 juju-e4d256-prod-github-runner-207 kernel: [64372.615011] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:16:38 juju-e4d256-prod-github-runner-207 kernel: [64372.615734] ? do_syscall_64+0x69/0xc0 Aug 22 23:16:38 juju-e4d256-prod-github-runner-207 kernel: [64372.616363] ? do_syscall_64+0x69/0xc0 Aug 22 23:16:38 juju-e4d256-prod-github-runner-207 kernel: [64372.616987] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 23:16:38 juju-e4d256-prod-github-runner-207 kernel: [64372.617699] RIP: 0033:0x7faa5d0edaff Aug 22 23:16:38 juju-e4d256-prod-github-runner-207 kernel: [64372.618336] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 23:16:38 juju-e4d256-prod-github-runner-207 kernel: [64372.620852] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 23:16:38 juju-e4d256-prod-github-runner-207 kernel: [64372.622107] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 23:16:38 juju-e4d256-prod-github-runner-207 kernel: [64372.623334] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 23:16:38 juju-e4d256-prod-github-runner-207 kernel: [64372.624564] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 23:16:38 juju-e4d256-prod-github-runner-207 kernel: [64372.625811] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 23:16:38 juju-e4d256-prod-github-runner-207 kernel: [64372.626957] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 23:16:38 juju-e4d256-prod-github-runner-207 kernel: [64372.628129] Aug 22 23:17:06 juju-e4d256-prod-github-runner-207 kernel: [64400.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 59869s! [qemu-system-x86:6715] Aug 22 23:17:06 juju-e4d256-prod-github-runner-207 kernel: [64400.543884] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 23:17:06 juju-e4d256-prod-github-runner-207 kernel: [64400.544156] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 23:17:06 juju-e4d256-prod-github-runner-207 kernel: [64400.556355] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 23:17:06 juju-e4d256-prod-github-runner-207 kernel: [64400.557616] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 23:17:06 juju-e4d256-prod-github-runner-207 kernel: [64400.558862] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:17:06 juju-e4d256-prod-github-runner-207 kernel: [64400.559917] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 23:17:06 juju-e4d256-prod-github-runner-207 kernel: [64400.562464] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 23:17:06 juju-e4d256-prod-github-runner-207 kernel: [64400.563524] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 23:17:06 juju-e4d256-prod-github-runner-207 kernel: [64400.564692] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 23:17:06 juju-e4d256-prod-github-runner-207 kernel: [64400.565851] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 23:17:06 juju-e4d256-prod-github-runner-207 kernel: [64400.567045] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 23:17:06 juju-e4d256-prod-github-runner-207 kernel: [64400.568213] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 23:17:06 juju-e4d256-prod-github-runner-207 kernel: [64400.569377] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 23:17:06 juju-e4d256-prod-github-runner-207 kernel: [64400.570613] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 23:17:06 juju-e4d256-prod-github-runner-207 kernel: [64400.571731] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 23:17:06 juju-e4d256-prod-github-runner-207 kernel: [64400.572935] Call Trace: Aug 22 23:17:06 juju-e4d256-prod-github-runner-207 kernel: [64400.573854] Aug 22 23:17:06 juju-e4d256-prod-github-runner-207 kernel: [64400.574752] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:17:06 juju-e4d256-prod-github-runner-207 kernel: [64400.576044] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:17:06 juju-e4d256-prod-github-runner-207 kernel: [64400.577072] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:17:06 juju-e4d256-prod-github-runner-207 kernel: [64400.578172] ? show_regs.part.0+0x23/0x29 Aug 22 23:17:06 juju-e4d256-prod-github-runner-207 kernel: [64400.579185] ? show_regs.cold+0x8/0xd Aug 22 23:17:06 juju-e4d256-prod-github-runner-207 kernel: [64400.580163] ? watchdog_timer_fn+0x1be/0x220 Aug 22 23:17:06 juju-e4d256-prod-github-runner-207 kernel: [64400.581235] ? lockup_detector_update_enable+0x60/0x60 Aug 22 23:17:06 juju-e4d256-prod-github-runner-207 kernel: [64400.582300] ? __hrtimer_run_queues+0x107/0x230 Aug 22 23:17:06 juju-e4d256-prod-github-runner-207 kernel: [64400.583355] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 23:17:06 juju-e4d256-prod-github-runner-207 kernel: [64400.584388] ? hrtimer_interrupt+0x101/0x220 Aug 22 23:17:06 juju-e4d256-prod-github-runner-207 kernel: [64400.585407] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 23:17:06 juju-e4d256-prod-github-runner-207 kernel: [64400.586477] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 23:17:06 juju-e4d256-prod-github-runner-207 kernel: [64400.587540] Aug 22 23:17:06 juju-e4d256-prod-github-runner-207 kernel: [64400.588403] Aug 22 23:17:06 juju-e4d256-prod-github-runner-207 kernel: [64400.589239] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 23:17:06 juju-e4d256-prod-github-runner-207 kernel: [64400.590287] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:17:06 juju-e4d256-prod-github-runner-207 kernel: [64400.591338] ? _raw_spin_lock+0x22/0x30 Aug 22 23:17:06 juju-e4d256-prod-github-runner-207 kernel: [64400.592291] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:17:06 juju-e4d256-prod-github-runner-207 kernel: [64400.593311] direct_page_fault+0x206/0x310 [kvm] Aug 22 23:17:06 juju-e4d256-prod-github-runner-207 kernel: [64400.594352] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 23:17:06 juju-e4d256-prod-github-runner-207 kernel: [64400.595385] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 23:17:06 juju-e4d256-prod-github-runner-207 kernel: [64400.596389] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 23:17:06 juju-e4d256-prod-github-runner-207 kernel: [64400.597400] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 23:17:06 juju-e4d256-prod-github-runner-207 kernel: [64400.598349] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 23:17:06 juju-e4d256-prod-github-runner-207 kernel: [64400.599345] handle_exit+0x98/0x230 [kvm_amd] Aug 22 23:17:06 juju-e4d256-prod-github-runner-207 kernel: [64400.600248] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 23:17:06 juju-e4d256-prod-github-runner-207 kernel: [64400.601168] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 23:17:06 juju-e4d256-prod-github-runner-207 kernel: [64400.602178] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 23:17:06 juju-e4d256-prod-github-runner-207 kernel: [64400.603179] vcpu_run+0x62/0x2c0 [kvm] Aug 22 23:17:06 juju-e4d256-prod-github-runner-207 kernel: [64400.604001] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 23:17:06 juju-e4d256-prod-github-runner-207 kernel: [64400.604830] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 23:17:06 juju-e4d256-prod-github-runner-207 kernel: [64400.605777] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 23:17:06 juju-e4d256-prod-github-runner-207 kernel: [64400.606581] ? __seccomp_filter+0x4a/0x4a0 Aug 22 23:17:06 juju-e4d256-prod-github-runner-207 kernel: [64400.607354] ? __fget_files+0x86/0xc0 Aug 22 23:17:06 juju-e4d256-prod-github-runner-207 kernel: [64400.608106] __x64_sys_ioctl+0x95/0xd0 Aug 22 23:17:06 juju-e4d256-prod-github-runner-207 kernel: [64400.608833] do_syscall_64+0x5c/0xc0 Aug 22 23:17:06 juju-e4d256-prod-github-runner-207 kernel: [64400.609511] ? do_futex+0x162/0x1f0 Aug 22 23:17:06 juju-e4d256-prod-github-runner-207 kernel: [64400.610210] ? __x64_sys_futex+0x78/0x1e0 Aug 22 23:17:06 juju-e4d256-prod-github-runner-207 kernel: [64400.610934] ? __secure_computing+0xa9/0x120 Aug 22 23:17:06 juju-e4d256-prod-github-runner-207 kernel: [64400.611635] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 23:17:06 juju-e4d256-prod-github-runner-207 kernel: [64400.612399] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:17:06 juju-e4d256-prod-github-runner-207 kernel: [64400.613173] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:17:06 juju-e4d256-prod-github-runner-207 kernel: [64400.613945] ? do_syscall_64+0x69/0xc0 Aug 22 23:17:06 juju-e4d256-prod-github-runner-207 kernel: [64400.614601] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:17:06 juju-e4d256-prod-github-runner-207 kernel: [64400.615356] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:17:06 juju-e4d256-prod-github-runner-207 kernel: [64400.616081] ? do_syscall_64+0x69/0xc0 Aug 22 23:17:06 juju-e4d256-prod-github-runner-207 kernel: [64400.616719] ? do_syscall_64+0x69/0xc0 Aug 22 23:17:06 juju-e4d256-prod-github-runner-207 kernel: [64400.617343] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 23:17:06 juju-e4d256-prod-github-runner-207 kernel: [64400.618082] RIP: 0033:0x7faa5d0edaff Aug 22 23:17:06 juju-e4d256-prod-github-runner-207 kernel: [64400.618796] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 23:17:06 juju-e4d256-prod-github-runner-207 kernel: [64400.620887] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 23:17:06 juju-e4d256-prod-github-runner-207 kernel: [64400.621803] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 23:17:06 juju-e4d256-prod-github-runner-207 kernel: [64400.622759] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 23:17:06 juju-e4d256-prod-github-runner-207 kernel: [64400.623690] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 23:17:06 juju-e4d256-prod-github-runner-207 kernel: [64400.624595] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 23:17:06 juju-e4d256-prod-github-runner-207 kernel: [64400.625544] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 23:17:06 juju-e4d256-prod-github-runner-207 kernel: [64400.626462] Aug 22 23:17:34 juju-e4d256-prod-github-runner-207 kernel: [64428.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 59895s! [qemu-system-x86:6715] Aug 22 23:17:34 juju-e4d256-prod-github-runner-207 kernel: [64428.543242] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 23:17:34 juju-e4d256-prod-github-runner-207 kernel: [64428.543318] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 23:17:34 juju-e4d256-prod-github-runner-207 kernel: [64428.556034] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 23:17:34 juju-e4d256-prod-github-runner-207 kernel: [64428.557340] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 23:17:34 juju-e4d256-prod-github-runner-207 kernel: [64428.558611] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:17:34 juju-e4d256-prod-github-runner-207 kernel: [64428.559706] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 23:17:34 juju-e4d256-prod-github-runner-207 kernel: [64428.562433] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 23:17:34 juju-e4d256-prod-github-runner-207 kernel: [64428.563527] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 23:17:34 juju-e4d256-prod-github-runner-207 kernel: [64428.564738] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 23:17:34 juju-e4d256-prod-github-runner-207 kernel: [64428.565928] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 23:17:34 juju-e4d256-prod-github-runner-207 kernel: [64428.567137] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 23:17:34 juju-e4d256-prod-github-runner-207 kernel: [64428.568343] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 23:17:34 juju-e4d256-prod-github-runner-207 kernel: [64428.569569] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 23:17:34 juju-e4d256-prod-github-runner-207 kernel: [64428.570976] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 23:17:34 juju-e4d256-prod-github-runner-207 kernel: [64428.572299] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 23:17:34 juju-e4d256-prod-github-runner-207 kernel: [64428.573755] Call Trace: Aug 22 23:17:34 juju-e4d256-prod-github-runner-207 kernel: [64428.575072] Aug 22 23:17:34 juju-e4d256-prod-github-runner-207 kernel: [64428.576542] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:17:34 juju-e4d256-prod-github-runner-207 kernel: [64428.577991] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:17:34 juju-e4d256-prod-github-runner-207 kernel: [64428.579411] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:17:34 juju-e4d256-prod-github-runner-207 kernel: [64428.580770] ? show_regs.part.0+0x23/0x29 Aug 22 23:17:34 juju-e4d256-prod-github-runner-207 kernel: [64428.581785] ? show_regs.cold+0x8/0xd Aug 22 23:17:34 juju-e4d256-prod-github-runner-207 kernel: [64428.582812] ? watchdog_timer_fn+0x1be/0x220 Aug 22 23:17:34 juju-e4d256-prod-github-runner-207 kernel: [64428.583845] ? lockup_detector_update_enable+0x60/0x60 Aug 22 23:17:34 juju-e4d256-prod-github-runner-207 kernel: [64428.584933] ? __hrtimer_run_queues+0x107/0x230 Aug 22 23:17:34 juju-e4d256-prod-github-runner-207 kernel: [64428.585985] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 23:17:34 juju-e4d256-prod-github-runner-207 kernel: [64428.587041] ? hrtimer_interrupt+0x101/0x220 Aug 22 23:17:34 juju-e4d256-prod-github-runner-207 kernel: [64428.588078] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 23:17:34 juju-e4d256-prod-github-runner-207 kernel: [64428.589172] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 23:17:34 juju-e4d256-prod-github-runner-207 kernel: [64428.590602] Aug 22 23:17:34 juju-e4d256-prod-github-runner-207 kernel: [64428.591967] Aug 22 23:17:34 juju-e4d256-prod-github-runner-207 kernel: [64428.593074] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 23:17:34 juju-e4d256-prod-github-runner-207 kernel: [64428.594188] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:17:34 juju-e4d256-prod-github-runner-207 kernel: [64428.595292] ? _raw_spin_lock+0x22/0x30 Aug 22 23:17:34 juju-e4d256-prod-github-runner-207 kernel: [64428.596331] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:17:34 juju-e4d256-prod-github-runner-207 kernel: [64428.597552] direct_page_fault+0x206/0x310 [kvm] Aug 22 23:17:34 juju-e4d256-prod-github-runner-207 kernel: [64428.598887] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 23:17:34 juju-e4d256-prod-github-runner-207 kernel: [64428.600325] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 23:17:34 juju-e4d256-prod-github-runner-207 kernel: [64428.601577] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 23:17:34 juju-e4d256-prod-github-runner-207 kernel: [64428.602623] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 23:17:34 juju-e4d256-prod-github-runner-207 kernel: [64428.603599] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 23:17:34 juju-e4d256-prod-github-runner-207 kernel: [64428.604609] handle_exit+0x98/0x230 [kvm_amd] Aug 22 23:17:34 juju-e4d256-prod-github-runner-207 kernel: [64428.605523] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 23:17:34 juju-e4d256-prod-github-runner-207 kernel: [64428.606501] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 23:17:34 juju-e4d256-prod-github-runner-207 kernel: [64428.607456] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 23:17:34 juju-e4d256-prod-github-runner-207 kernel: [64428.608436] vcpu_run+0x62/0x2c0 [kvm] Aug 22 23:17:34 juju-e4d256-prod-github-runner-207 kernel: [64428.609270] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 23:17:34 juju-e4d256-prod-github-runner-207 kernel: [64428.610105] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 23:17:34 juju-e4d256-prod-github-runner-207 kernel: [64428.610993] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 23:17:34 juju-e4d256-prod-github-runner-207 kernel: [64428.611898] ? __seccomp_filter+0x4a/0x4a0 Aug 22 23:17:34 juju-e4d256-prod-github-runner-207 kernel: [64428.612940] ? __fget_files+0x86/0xc0 Aug 22 23:17:34 juju-e4d256-prod-github-runner-207 kernel: [64428.613952] __x64_sys_ioctl+0x95/0xd0 Aug 22 23:17:34 juju-e4d256-prod-github-runner-207 kernel: [64428.615013] do_syscall_64+0x5c/0xc0 Aug 22 23:17:34 juju-e4d256-prod-github-runner-207 kernel: [64428.615949] ? do_futex+0x162/0x1f0 Aug 22 23:17:34 juju-e4d256-prod-github-runner-207 kernel: [64428.616815] ? __x64_sys_futex+0x78/0x1e0 Aug 22 23:17:34 juju-e4d256-prod-github-runner-207 kernel: [64428.617538] ? __secure_computing+0xa9/0x120 Aug 22 23:17:34 juju-e4d256-prod-github-runner-207 kernel: [64428.618305] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 23:17:34 juju-e4d256-prod-github-runner-207 kernel: [64428.619129] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:17:34 juju-e4d256-prod-github-runner-207 kernel: [64428.619878] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:17:34 juju-e4d256-prod-github-runner-207 kernel: [64428.620617] ? do_syscall_64+0x69/0xc0 Aug 22 23:17:34 juju-e4d256-prod-github-runner-207 kernel: [64428.621279] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:17:34 juju-e4d256-prod-github-runner-207 kernel: [64428.622012] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:17:34 juju-e4d256-prod-github-runner-207 kernel: [64428.622766] ? do_syscall_64+0x69/0xc0 Aug 22 23:17:34 juju-e4d256-prod-github-runner-207 kernel: [64428.623409] ? do_syscall_64+0x69/0xc0 Aug 22 23:17:34 juju-e4d256-prod-github-runner-207 kernel: [64428.624046] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 23:17:34 juju-e4d256-prod-github-runner-207 kernel: [64428.624782] RIP: 0033:0x7faa5d0edaff Aug 22 23:17:34 juju-e4d256-prod-github-runner-207 kernel: [64428.625420] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 23:17:34 juju-e4d256-prod-github-runner-207 kernel: [64428.627519] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 23:17:34 juju-e4d256-prod-github-runner-207 kernel: [64428.628500] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 23:17:34 juju-e4d256-prod-github-runner-207 kernel: [64428.629422] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 23:17:34 juju-e4d256-prod-github-runner-207 kernel: [64428.630527] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 23:17:34 juju-e4d256-prod-github-runner-207 kernel: [64428.631962] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 23:17:34 juju-e4d256-prod-github-runner-207 kernel: [64428.633379] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 23:17:34 juju-e4d256-prod-github-runner-207 kernel: [64428.634763] Aug 22 23:17:47 juju-e4d256-prod-github-runner-207 kernel: [64441.484710] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 23:17:47 juju-e4d256-prod-github-runner-207 kernel: [64441.485704] rcu: 1-....: (16030365 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=7739327 Aug 22 23:17:47 juju-e4d256-prod-github-runner-207 kernel: [64441.486925] (t=16081071 jiffies g=23269 q=56827) Aug 22 23:17:47 juju-e4d256-prod-github-runner-207 kernel: [64441.487741] NMI backtrace for cpu 1 Aug 22 23:17:47 juju-e4d256-prod-github-runner-207 kernel: [64441.488469] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 23:17:47 juju-e4d256-prod-github-runner-207 kernel: [64441.489635] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 23:17:47 juju-e4d256-prod-github-runner-207 kernel: [64441.490739] Call Trace: Aug 22 23:17:47 juju-e4d256-prod-github-runner-207 kernel: [64441.491436] Aug 22 23:17:47 juju-e4d256-prod-github-runner-207 kernel: [64441.492104] show_stack+0x52/0x5c Aug 22 23:17:47 juju-e4d256-prod-github-runner-207 kernel: [64441.492864] dump_stack_lvl+0x4a/0x63 Aug 22 23:17:47 juju-e4d256-prod-github-runner-207 kernel: [64441.493619] dump_stack+0x10/0x16 Aug 22 23:17:47 juju-e4d256-prod-github-runner-207 kernel: [64441.494355] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 23:17:47 juju-e4d256-prod-github-runner-207 kernel: [64441.495145] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 23:17:47 juju-e4d256-prod-github-runner-207 kernel: [64441.495932] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 23:17:47 juju-e4d256-prod-github-runner-207 kernel: [64441.496782] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 23:17:47 juju-e4d256-prod-github-runner-207 kernel: [64441.497633] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 23:17:47 juju-e4d256-prod-github-runner-207 kernel: [64441.498476] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 23:17:47 juju-e4d256-prod-github-runner-207 kernel: [64441.499265] print_cpu_stall.cold+0x2f/0xe2 Aug 22 23:17:47 juju-e4d256-prod-github-runner-207 kernel: [64441.500048] ? timekeeping_update+0xf7/0x150 Aug 22 23:17:47 juju-e4d256-prod-github-runner-207 kernel: [64441.500834] check_cpu_stall+0x109/0x270 Aug 22 23:17:47 juju-e4d256-prod-github-runner-207 kernel: [64441.501603] rcu_sched_clock_irq+0x9a/0x250 Aug 22 23:17:47 juju-e4d256-prod-github-runner-207 kernel: [64441.502396] update_process_times+0x94/0xd0 Aug 22 23:17:47 juju-e4d256-prod-github-runner-207 kernel: [64441.503194] tick_sched_handle+0x29/0x70 Aug 22 23:17:47 juju-e4d256-prod-github-runner-207 kernel: [64441.503950] tick_sched_timer+0x8c/0xc0 Aug 22 23:17:47 juju-e4d256-prod-github-runner-207 kernel: [64441.504699] ? tick_nohz_handler+0xb0/0xb0 Aug 22 23:17:47 juju-e4d256-prod-github-runner-207 kernel: [64441.505484] __hrtimer_run_queues+0x107/0x230 Aug 22 23:17:47 juju-e4d256-prod-github-runner-207 kernel: [64441.506274] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 23:17:47 juju-e4d256-prod-github-runner-207 kernel: [64441.507111] hrtimer_interrupt+0x101/0x220 Aug 22 23:17:47 juju-e4d256-prod-github-runner-207 kernel: [64441.507911] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 23:17:47 juju-e4d256-prod-github-runner-207 kernel: [64441.508749] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 23:17:47 juju-e4d256-prod-github-runner-207 kernel: [64441.509568] Aug 22 23:17:47 juju-e4d256-prod-github-runner-207 kernel: [64441.510209] Aug 22 23:17:47 juju-e4d256-prod-github-runner-207 kernel: [64441.510865] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 23:17:47 juju-e4d256-prod-github-runner-207 kernel: [64441.511705] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:17:47 juju-e4d256-prod-github-runner-207 kernel: [64441.512617] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 23:17:47 juju-e4d256-prod-github-runner-207 kernel: [64441.514924] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 23:17:47 juju-e4d256-prod-github-runner-207 kernel: [64441.515812] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 23:17:47 juju-e4d256-prod-github-runner-207 kernel: [64441.516826] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 23:17:47 juju-e4d256-prod-github-runner-207 kernel: [64441.517878] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 23:17:47 juju-e4d256-prod-github-runner-207 kernel: [64441.518887] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 23:17:47 juju-e4d256-prod-github-runner-207 kernel: [64441.519855] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 23:17:47 juju-e4d256-prod-github-runner-207 kernel: [64441.520878] ? _raw_spin_lock+0x22/0x30 Aug 22 23:17:47 juju-e4d256-prod-github-runner-207 kernel: [64441.521645] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:17:47 juju-e4d256-prod-github-runner-207 kernel: [64441.522515] direct_page_fault+0x206/0x310 [kvm] Aug 22 23:17:47 juju-e4d256-prod-github-runner-207 kernel: [64441.523403] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 23:17:47 juju-e4d256-prod-github-runner-207 kernel: [64441.524485] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 23:17:47 juju-e4d256-prod-github-runner-207 kernel: [64441.525328] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 23:17:47 juju-e4d256-prod-github-runner-207 kernel: [64441.526145] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 23:17:47 juju-e4d256-prod-github-runner-207 kernel: [64441.526968] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 23:17:47 juju-e4d256-prod-github-runner-207 kernel: [64441.527853] handle_exit+0x98/0x230 [kvm_amd] Aug 22 23:17:47 juju-e4d256-prod-github-runner-207 kernel: [64441.528652] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 23:17:47 juju-e4d256-prod-github-runner-207 kernel: [64441.529458] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 23:17:47 juju-e4d256-prod-github-runner-207 kernel: [64441.530308] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 23:17:47 juju-e4d256-prod-github-runner-207 kernel: [64441.531109] vcpu_run+0x62/0x2c0 [kvm] Aug 22 23:17:47 juju-e4d256-prod-github-runner-207 kernel: [64441.531890] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 23:17:47 juju-e4d256-prod-github-runner-207 kernel: [64441.532822] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 23:17:47 juju-e4d256-prod-github-runner-207 kernel: [64441.533687] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 23:17:47 juju-e4d256-prod-github-runner-207 kernel: [64441.534518] ? __seccomp_filter+0x4a/0x4a0 Aug 22 23:17:47 juju-e4d256-prod-github-runner-207 kernel: [64441.535248] ? __fget_files+0x86/0xc0 Aug 22 23:17:47 juju-e4d256-prod-github-runner-207 kernel: [64441.535950] __x64_sys_ioctl+0x95/0xd0 Aug 22 23:17:47 juju-e4d256-prod-github-runner-207 kernel: [64441.536653] do_syscall_64+0x5c/0xc0 Aug 22 23:17:47 juju-e4d256-prod-github-runner-207 kernel: [64441.537347] ? do_futex+0x162/0x1f0 Aug 22 23:17:47 juju-e4d256-prod-github-runner-207 kernel: [64441.538034] ? __x64_sys_futex+0x78/0x1e0 Aug 22 23:17:47 juju-e4d256-prod-github-runner-207 kernel: [64441.538785] ? __secure_computing+0xa9/0x120 Aug 22 23:17:47 juju-e4d256-prod-github-runner-207 kernel: [64441.539522] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 23:17:47 juju-e4d256-prod-github-runner-207 kernel: [64441.540324] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:17:47 juju-e4d256-prod-github-runner-207 kernel: [64441.541262] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:17:47 juju-e4d256-prod-github-runner-207 kernel: [64441.542028] ? do_syscall_64+0x69/0xc0 Aug 22 23:17:47 juju-e4d256-prod-github-runner-207 kernel: [64441.542764] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:17:47 juju-e4d256-prod-github-runner-207 kernel: [64441.543533] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:17:47 juju-e4d256-prod-github-runner-207 kernel: [64441.544308] ? do_syscall_64+0x69/0xc0 Aug 22 23:17:47 juju-e4d256-prod-github-runner-207 kernel: [64441.545041] ? do_syscall_64+0x69/0xc0 Aug 22 23:17:47 juju-e4d256-prod-github-runner-207 kernel: [64441.545740] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 23:17:47 juju-e4d256-prod-github-runner-207 kernel: [64441.546541] RIP: 0033:0x7faa5d0edaff Aug 22 23:17:47 juju-e4d256-prod-github-runner-207 kernel: [64441.547243] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 23:17:47 juju-e4d256-prod-github-runner-207 kernel: [64441.549576] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 23:17:47 juju-e4d256-prod-github-runner-207 kernel: [64441.550599] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 23:17:47 juju-e4d256-prod-github-runner-207 kernel: [64441.551605] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 23:17:47 juju-e4d256-prod-github-runner-207 kernel: [64441.552681] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 23:17:47 juju-e4d256-prod-github-runner-207 kernel: [64441.553726] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 23:17:47 juju-e4d256-prod-github-runner-207 kernel: [64441.554737] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 23:17:47 juju-e4d256-prod-github-runner-207 kernel: [64441.555695] Aug 22 23:18:14 juju-e4d256-prod-github-runner-207 kernel: [64468.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 59933s! [qemu-system-x86:6715] Aug 22 23:18:14 juju-e4d256-prod-github-runner-207 kernel: [64468.543126] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 23:18:14 juju-e4d256-prod-github-runner-207 kernel: [64468.543200] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 23:18:14 juju-e4d256-prod-github-runner-207 kernel: [64468.555339] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 23:18:14 juju-e4d256-prod-github-runner-207 kernel: [64468.556615] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 23:18:14 juju-e4d256-prod-github-runner-207 kernel: [64468.557837] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:18:14 juju-e4d256-prod-github-runner-207 kernel: [64468.558919] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 23:18:14 juju-e4d256-prod-github-runner-207 kernel: [64468.561470] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 23:18:14 juju-e4d256-prod-github-runner-207 kernel: [64468.562537] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 23:18:14 juju-e4d256-prod-github-runner-207 kernel: [64468.563721] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 23:18:14 juju-e4d256-prod-github-runner-207 kernel: [64468.564894] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 23:18:14 juju-e4d256-prod-github-runner-207 kernel: [64468.566066] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 23:18:14 juju-e4d256-prod-github-runner-207 kernel: [64468.567240] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 23:18:14 juju-e4d256-prod-github-runner-207 kernel: [64468.568414] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 23:18:14 juju-e4d256-prod-github-runner-207 kernel: [64468.569645] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 23:18:14 juju-e4d256-prod-github-runner-207 kernel: [64468.571212] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 23:18:14 juju-e4d256-prod-github-runner-207 kernel: [64468.572403] Call Trace: Aug 22 23:18:14 juju-e4d256-prod-github-runner-207 kernel: [64468.573319] Aug 22 23:18:14 juju-e4d256-prod-github-runner-207 kernel: [64468.574230] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:18:14 juju-e4d256-prod-github-runner-207 kernel: [64468.575258] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:18:14 juju-e4d256-prod-github-runner-207 kernel: [64468.576283] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:18:14 juju-e4d256-prod-github-runner-207 kernel: [64468.577362] ? show_regs.part.0+0x23/0x29 Aug 22 23:18:14 juju-e4d256-prod-github-runner-207 kernel: [64468.578403] ? show_regs.cold+0x8/0xd Aug 22 23:18:14 juju-e4d256-prod-github-runner-207 kernel: [64468.579412] ? watchdog_timer_fn+0x1be/0x220 Aug 22 23:18:14 juju-e4d256-prod-github-runner-207 kernel: [64468.580429] ? lockup_detector_update_enable+0x60/0x60 Aug 22 23:18:14 juju-e4d256-prod-github-runner-207 kernel: [64468.581492] ? __hrtimer_run_queues+0x107/0x230 Aug 22 23:18:14 juju-e4d256-prod-github-runner-207 kernel: [64468.582541] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 23:18:14 juju-e4d256-prod-github-runner-207 kernel: [64468.583565] ? hrtimer_interrupt+0x101/0x220 Aug 22 23:18:14 juju-e4d256-prod-github-runner-207 kernel: [64468.584811] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 23:18:14 juju-e4d256-prod-github-runner-207 kernel: [64468.585899] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 23:18:14 juju-e4d256-prod-github-runner-207 kernel: [64468.587000] Aug 22 23:18:14 juju-e4d256-prod-github-runner-207 kernel: [64468.587861] Aug 22 23:18:14 juju-e4d256-prod-github-runner-207 kernel: [64468.588760] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 23:18:14 juju-e4d256-prod-github-runner-207 kernel: [64468.589804] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:18:14 juju-e4d256-prod-github-runner-207 kernel: [64468.590872] ? _raw_spin_lock+0x22/0x30 Aug 22 23:18:14 juju-e4d256-prod-github-runner-207 kernel: [64468.591829] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:18:14 juju-e4d256-prod-github-runner-207 kernel: [64468.592845] direct_page_fault+0x206/0x310 [kvm] Aug 22 23:18:14 juju-e4d256-prod-github-runner-207 kernel: [64468.593870] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 23:18:14 juju-e4d256-prod-github-runner-207 kernel: [64468.594894] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 23:18:14 juju-e4d256-prod-github-runner-207 kernel: [64468.595898] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 23:18:14 juju-e4d256-prod-github-runner-207 kernel: [64468.596891] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 23:18:14 juju-e4d256-prod-github-runner-207 kernel: [64468.597846] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 23:18:14 juju-e4d256-prod-github-runner-207 kernel: [64468.598846] handle_exit+0x98/0x230 [kvm_amd] Aug 22 23:18:14 juju-e4d256-prod-github-runner-207 kernel: [64468.599741] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 23:18:14 juju-e4d256-prod-github-runner-207 kernel: [64468.600666] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 23:18:14 juju-e4d256-prod-github-runner-207 kernel: [64468.601591] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 23:18:14 juju-e4d256-prod-github-runner-207 kernel: [64468.602512] vcpu_run+0x62/0x2c0 [kvm] Aug 22 23:18:14 juju-e4d256-prod-github-runner-207 kernel: [64468.603321] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 23:18:14 juju-e4d256-prod-github-runner-207 kernel: [64468.604131] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 23:18:14 juju-e4d256-prod-github-runner-207 kernel: [64468.604986] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 23:18:14 juju-e4d256-prod-github-runner-207 kernel: [64468.605782] ? __seccomp_filter+0x4a/0x4a0 Aug 22 23:18:14 juju-e4d256-prod-github-runner-207 kernel: [64468.608239] ? __fget_files+0x86/0xc0 Aug 22 23:18:14 juju-e4d256-prod-github-runner-207 kernel: [64468.608943] __x64_sys_ioctl+0x95/0xd0 Aug 22 23:18:14 juju-e4d256-prod-github-runner-207 kernel: [64468.609639] do_syscall_64+0x5c/0xc0 Aug 22 23:18:14 juju-e4d256-prod-github-runner-207 kernel: [64468.610321] ? do_futex+0x162/0x1f0 Aug 22 23:18:14 juju-e4d256-prod-github-runner-207 kernel: [64468.610969] ? __x64_sys_futex+0x78/0x1e0 Aug 22 23:18:14 juju-e4d256-prod-github-runner-207 kernel: [64468.611641] ? __secure_computing+0xa9/0x120 Aug 22 23:18:14 juju-e4d256-prod-github-runner-207 kernel: [64468.612334] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 23:18:14 juju-e4d256-prod-github-runner-207 kernel: [64468.613093] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:18:14 juju-e4d256-prod-github-runner-207 kernel: [64468.613812] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:18:14 juju-e4d256-prod-github-runner-207 kernel: [64468.614548] ? do_syscall_64+0x69/0xc0 Aug 22 23:18:14 juju-e4d256-prod-github-runner-207 kernel: [64468.615190] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:18:14 juju-e4d256-prod-github-runner-207 kernel: [64468.615890] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:18:14 juju-e4d256-prod-github-runner-207 kernel: [64468.616605] ? do_syscall_64+0x69/0xc0 Aug 22 23:18:14 juju-e4d256-prod-github-runner-207 kernel: [64468.617250] ? do_syscall_64+0x69/0xc0 Aug 22 23:18:14 juju-e4d256-prod-github-runner-207 kernel: [64468.617877] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 23:18:14 juju-e4d256-prod-github-runner-207 kernel: [64468.618631] RIP: 0033:0x7faa5d0edaff Aug 22 23:18:14 juju-e4d256-prod-github-runner-207 kernel: [64468.619284] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 23:18:14 juju-e4d256-prod-github-runner-207 kernel: [64468.621393] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 23:18:14 juju-e4d256-prod-github-runner-207 kernel: [64468.622377] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 23:18:14 juju-e4d256-prod-github-runner-207 kernel: [64468.623289] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 23:18:14 juju-e4d256-prod-github-runner-207 kernel: [64468.624205] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 23:18:14 juju-e4d256-prod-github-runner-207 kernel: [64468.625095] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 23:18:14 juju-e4d256-prod-github-runner-207 kernel: [64468.626008] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 23:18:14 juju-e4d256-prod-github-runner-207 kernel: [64468.626924] Aug 22 23:18:42 juju-e4d256-prod-github-runner-207 kernel: [64496.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 59959s! [qemu-system-x86:6715] Aug 22 23:18:42 juju-e4d256-prod-github-runner-207 kernel: [64496.543862] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 23:18:42 juju-e4d256-prod-github-runner-207 kernel: [64496.544163] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 23:18:42 juju-e4d256-prod-github-runner-207 kernel: [64496.556246] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 23:18:42 juju-e4d256-prod-github-runner-207 kernel: [64496.557506] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 23:18:42 juju-e4d256-prod-github-runner-207 kernel: [64496.558734] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:18:42 juju-e4d256-prod-github-runner-207 kernel: [64496.559789] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 23:18:42 juju-e4d256-prod-github-runner-207 kernel: [64496.562338] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 23:18:42 juju-e4d256-prod-github-runner-207 kernel: [64496.563381] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 23:18:42 juju-e4d256-prod-github-runner-207 kernel: [64496.564544] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 23:18:42 juju-e4d256-prod-github-runner-207 kernel: [64496.565745] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 23:18:42 juju-e4d256-prod-github-runner-207 kernel: [64496.566944] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 23:18:42 juju-e4d256-prod-github-runner-207 kernel: [64496.568107] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 23:18:42 juju-e4d256-prod-github-runner-207 kernel: [64496.569283] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 23:18:42 juju-e4d256-prod-github-runner-207 kernel: [64496.570528] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 23:18:42 juju-e4d256-prod-github-runner-207 kernel: [64496.571622] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 23:18:42 juju-e4d256-prod-github-runner-207 kernel: [64496.572827] Call Trace: Aug 22 23:18:42 juju-e4d256-prod-github-runner-207 kernel: [64496.573777] Aug 22 23:18:42 juju-e4d256-prod-github-runner-207 kernel: [64496.574672] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:18:42 juju-e4d256-prod-github-runner-207 kernel: [64496.575722] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:18:42 juju-e4d256-prod-github-runner-207 kernel: [64496.576765] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:18:42 juju-e4d256-prod-github-runner-207 kernel: [64496.577891] ? show_regs.part.0+0x23/0x29 Aug 22 23:18:42 juju-e4d256-prod-github-runner-207 kernel: [64496.578888] ? show_regs.cold+0x8/0xd Aug 22 23:18:42 juju-e4d256-prod-github-runner-207 kernel: [64496.579862] ? watchdog_timer_fn+0x1be/0x220 Aug 22 23:18:42 juju-e4d256-prod-github-runner-207 kernel: [64496.580866] ? lockup_detector_update_enable+0x60/0x60 Aug 22 23:18:42 juju-e4d256-prod-github-runner-207 kernel: [64496.581950] ? __hrtimer_run_queues+0x107/0x230 Aug 22 23:18:42 juju-e4d256-prod-github-runner-207 kernel: [64496.582977] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 23:18:42 juju-e4d256-prod-github-runner-207 kernel: [64496.583998] ? hrtimer_interrupt+0x101/0x220 Aug 22 23:18:42 juju-e4d256-prod-github-runner-207 kernel: [64496.585010] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 23:18:42 juju-e4d256-prod-github-runner-207 kernel: [64496.586090] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 23:18:42 juju-e4d256-prod-github-runner-207 kernel: [64496.587244] Aug 22 23:18:42 juju-e4d256-prod-github-runner-207 kernel: [64496.588094] Aug 22 23:18:42 juju-e4d256-prod-github-runner-207 kernel: [64496.588929] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 23:18:42 juju-e4d256-prod-github-runner-207 kernel: [64496.590157] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:18:42 juju-e4d256-prod-github-runner-207 kernel: [64496.591197] ? _raw_spin_lock+0x22/0x30 Aug 22 23:18:42 juju-e4d256-prod-github-runner-207 kernel: [64496.592163] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:18:42 juju-e4d256-prod-github-runner-207 kernel: [64496.593194] direct_page_fault+0x206/0x310 [kvm] Aug 22 23:18:42 juju-e4d256-prod-github-runner-207 kernel: [64496.594237] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 23:18:42 juju-e4d256-prod-github-runner-207 kernel: [64496.595248] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 23:18:42 juju-e4d256-prod-github-runner-207 kernel: [64496.596252] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 23:18:42 juju-e4d256-prod-github-runner-207 kernel: [64496.597261] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 23:18:42 juju-e4d256-prod-github-runner-207 kernel: [64496.598221] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 23:18:42 juju-e4d256-prod-github-runner-207 kernel: [64496.599200] handle_exit+0x98/0x230 [kvm_amd] Aug 22 23:18:42 juju-e4d256-prod-github-runner-207 kernel: [64496.600092] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 23:18:42 juju-e4d256-prod-github-runner-207 kernel: [64496.601007] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 23:18:42 juju-e4d256-prod-github-runner-207 kernel: [64496.601954] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 23:18:42 juju-e4d256-prod-github-runner-207 kernel: [64496.602868] vcpu_run+0x62/0x2c0 [kvm] Aug 22 23:18:42 juju-e4d256-prod-github-runner-207 kernel: [64496.603705] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 23:18:42 juju-e4d256-prod-github-runner-207 kernel: [64496.604537] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 23:18:42 juju-e4d256-prod-github-runner-207 kernel: [64496.605393] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 23:18:42 juju-e4d256-prod-github-runner-207 kernel: [64496.606202] ? __seccomp_filter+0x4a/0x4a0 Aug 22 23:18:42 juju-e4d256-prod-github-runner-207 kernel: [64496.606945] ? __fget_files+0x86/0xc0 Aug 22 23:18:42 juju-e4d256-prod-github-runner-207 kernel: [64496.607664] __x64_sys_ioctl+0x95/0xd0 Aug 22 23:18:42 juju-e4d256-prod-github-runner-207 kernel: [64496.608363] do_syscall_64+0x5c/0xc0 Aug 22 23:18:42 juju-e4d256-prod-github-runner-207 kernel: [64496.609029] ? do_futex+0x162/0x1f0 Aug 22 23:18:42 juju-e4d256-prod-github-runner-207 kernel: [64496.609698] ? __x64_sys_futex+0x78/0x1e0 Aug 22 23:18:42 juju-e4d256-prod-github-runner-207 kernel: [64496.610387] ? __secure_computing+0xa9/0x120 Aug 22 23:18:42 juju-e4d256-prod-github-runner-207 kernel: [64496.611083] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 23:18:42 juju-e4d256-prod-github-runner-207 kernel: [64496.611840] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:18:42 juju-e4d256-prod-github-runner-207 kernel: [64496.612563] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:18:42 juju-e4d256-prod-github-runner-207 kernel: [64496.613277] ? do_syscall_64+0x69/0xc0 Aug 22 23:18:42 juju-e4d256-prod-github-runner-207 kernel: [64496.613936] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:18:42 juju-e4d256-prod-github-runner-207 kernel: [64496.614642] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:18:42 juju-e4d256-prod-github-runner-207 kernel: [64496.615334] ? do_syscall_64+0x69/0xc0 Aug 22 23:18:42 juju-e4d256-prod-github-runner-207 kernel: [64496.615956] ? do_syscall_64+0x69/0xc0 Aug 22 23:18:42 juju-e4d256-prod-github-runner-207 kernel: [64496.616576] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 23:18:42 juju-e4d256-prod-github-runner-207 kernel: [64496.617278] RIP: 0033:0x7faa5d0edaff Aug 22 23:18:42 juju-e4d256-prod-github-runner-207 kernel: [64496.617951] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 23:18:42 juju-e4d256-prod-github-runner-207 kernel: [64496.620004] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 23:18:42 juju-e4d256-prod-github-runner-207 kernel: [64496.620929] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 23:18:42 juju-e4d256-prod-github-runner-207 kernel: [64496.621840] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 23:18:42 juju-e4d256-prod-github-runner-207 kernel: [64496.622725] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 23:18:42 juju-e4d256-prod-github-runner-207 kernel: [64496.623608] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 23:18:42 juju-e4d256-prod-github-runner-207 kernel: [64496.624492] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 23:18:42 juju-e4d256-prod-github-runner-207 kernel: [64496.625386] Aug 22 23:19:10 juju-e4d256-prod-github-runner-207 kernel: [64524.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 59985s! [qemu-system-x86:6715] Aug 22 23:19:10 juju-e4d256-prod-github-runner-207 kernel: [64524.543105] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 23:19:10 juju-e4d256-prod-github-runner-207 kernel: [64524.543176] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 23:19:10 juju-e4d256-prod-github-runner-207 kernel: [64524.556156] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 23:19:10 juju-e4d256-prod-github-runner-207 kernel: [64524.557575] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 23:19:10 juju-e4d256-prod-github-runner-207 kernel: [64524.558895] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:19:10 juju-e4d256-prod-github-runner-207 kernel: [64524.559961] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 23:19:10 juju-e4d256-prod-github-runner-207 kernel: [64524.562639] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 23:19:10 juju-e4d256-prod-github-runner-207 kernel: [64524.563712] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 23:19:10 juju-e4d256-prod-github-runner-207 kernel: [64524.564878] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 23:19:10 juju-e4d256-prod-github-runner-207 kernel: [64524.566156] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 23:19:10 juju-e4d256-prod-github-runner-207 kernel: [64524.567392] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 23:19:10 juju-e4d256-prod-github-runner-207 kernel: [64524.568556] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 23:19:10 juju-e4d256-prod-github-runner-207 kernel: [64524.569872] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 23:19:10 juju-e4d256-prod-github-runner-207 kernel: [64524.571129] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 23:19:10 juju-e4d256-prod-github-runner-207 kernel: [64524.572249] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 23:19:10 juju-e4d256-prod-github-runner-207 kernel: [64524.573481] Call Trace: Aug 22 23:19:10 juju-e4d256-prod-github-runner-207 kernel: [64524.574414] Aug 22 23:19:10 juju-e4d256-prod-github-runner-207 kernel: [64524.575324] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:19:10 juju-e4d256-prod-github-runner-207 kernel: [64524.576364] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:19:10 juju-e4d256-prod-github-runner-207 kernel: [64524.577487] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:19:10 juju-e4d256-prod-github-runner-207 kernel: [64524.578667] ? show_regs.part.0+0x23/0x29 Aug 22 23:19:10 juju-e4d256-prod-github-runner-207 kernel: [64524.579689] ? show_regs.cold+0x8/0xd Aug 22 23:19:10 juju-e4d256-prod-github-runner-207 kernel: [64524.580683] ? watchdog_timer_fn+0x1be/0x220 Aug 22 23:19:10 juju-e4d256-prod-github-runner-207 kernel: [64524.581768] ? lockup_detector_update_enable+0x60/0x60 Aug 22 23:19:10 juju-e4d256-prod-github-runner-207 kernel: [64524.582918] ? __hrtimer_run_queues+0x107/0x230 Aug 22 23:19:10 juju-e4d256-prod-github-runner-207 kernel: [64524.583993] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 23:19:10 juju-e4d256-prod-github-runner-207 kernel: [64524.585025] ? hrtimer_interrupt+0x101/0x220 Aug 22 23:19:10 juju-e4d256-prod-github-runner-207 kernel: [64524.586064] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 23:19:10 juju-e4d256-prod-github-runner-207 kernel: [64524.587158] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 23:19:10 juju-e4d256-prod-github-runner-207 kernel: [64524.588231] Aug 22 23:19:10 juju-e4d256-prod-github-runner-207 kernel: [64524.589141] Aug 22 23:19:10 juju-e4d256-prod-github-runner-207 kernel: [64524.590050] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 23:19:10 juju-e4d256-prod-github-runner-207 kernel: [64524.591108] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:19:10 juju-e4d256-prod-github-runner-207 kernel: [64524.592154] ? _raw_spin_lock+0x22/0x30 Aug 22 23:19:10 juju-e4d256-prod-github-runner-207 kernel: [64524.593119] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:19:10 juju-e4d256-prod-github-runner-207 kernel: [64524.594157] direct_page_fault+0x206/0x310 [kvm] Aug 22 23:19:10 juju-e4d256-prod-github-runner-207 kernel: [64524.595206] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 23:19:10 juju-e4d256-prod-github-runner-207 kernel: [64524.596263] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 23:19:10 juju-e4d256-prod-github-runner-207 kernel: [64524.597306] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 23:19:10 juju-e4d256-prod-github-runner-207 kernel: [64524.598376] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 23:19:10 juju-e4d256-prod-github-runner-207 kernel: [64524.599398] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 23:19:10 juju-e4d256-prod-github-runner-207 kernel: [64524.600403] handle_exit+0x98/0x230 [kvm_amd] Aug 22 23:19:10 juju-e4d256-prod-github-runner-207 kernel: [64524.601385] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 23:19:10 juju-e4d256-prod-github-runner-207 kernel: [64524.602321] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 23:19:10 juju-e4d256-prod-github-runner-207 kernel: [64524.603308] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 23:19:10 juju-e4d256-prod-github-runner-207 kernel: [64524.604238] vcpu_run+0x62/0x2c0 [kvm] Aug 22 23:19:10 juju-e4d256-prod-github-runner-207 kernel: [64524.605080] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 23:19:10 juju-e4d256-prod-github-runner-207 kernel: [64524.606012] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 23:19:10 juju-e4d256-prod-github-runner-207 kernel: [64524.606920] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 23:19:10 juju-e4d256-prod-github-runner-207 kernel: [64524.607719] ? __seccomp_filter+0x4a/0x4a0 Aug 22 23:19:10 juju-e4d256-prod-github-runner-207 kernel: [64524.608465] ? __fget_files+0x86/0xc0 Aug 22 23:19:10 juju-e4d256-prod-github-runner-207 kernel: [64524.609169] __x64_sys_ioctl+0x95/0xd0 Aug 22 23:19:10 juju-e4d256-prod-github-runner-207 kernel: [64524.609890] do_syscall_64+0x5c/0xc0 Aug 22 23:19:10 juju-e4d256-prod-github-runner-207 kernel: [64524.610621] ? do_futex+0x162/0x1f0 Aug 22 23:19:10 juju-e4d256-prod-github-runner-207 kernel: [64524.611291] ? __x64_sys_futex+0x78/0x1e0 Aug 22 23:19:10 juju-e4d256-prod-github-runner-207 kernel: [64524.611975] ? __secure_computing+0xa9/0x120 Aug 22 23:19:10 juju-e4d256-prod-github-runner-207 kernel: [64524.612670] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 23:19:10 juju-e4d256-prod-github-runner-207 kernel: [64524.613451] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:19:10 juju-e4d256-prod-github-runner-207 kernel: [64524.614181] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:19:10 juju-e4d256-prod-github-runner-207 kernel: [64524.614960] ? do_syscall_64+0x69/0xc0 Aug 22 23:19:10 juju-e4d256-prod-github-runner-207 kernel: [64524.615605] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:19:10 juju-e4d256-prod-github-runner-207 kernel: [64524.616316] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:19:10 juju-e4d256-prod-github-runner-207 kernel: [64524.617023] ? do_syscall_64+0x69/0xc0 Aug 22 23:19:10 juju-e4d256-prod-github-runner-207 kernel: [64524.617731] ? do_syscall_64+0x69/0xc0 Aug 22 23:19:10 juju-e4d256-prod-github-runner-207 kernel: [64524.618367] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 23:19:10 juju-e4d256-prod-github-runner-207 kernel: [64524.619102] RIP: 0033:0x7faa5d0edaff Aug 22 23:19:10 juju-e4d256-prod-github-runner-207 kernel: [64524.619787] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 23:19:10 juju-e4d256-prod-github-runner-207 kernel: [64524.621853] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 23:19:10 juju-e4d256-prod-github-runner-207 kernel: [64524.622767] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 23:19:10 juju-e4d256-prod-github-runner-207 kernel: [64524.623669] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 23:19:10 juju-e4d256-prod-github-runner-207 kernel: [64524.624560] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 23:19:10 juju-e4d256-prod-github-runner-207 kernel: [64524.625475] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 23:19:10 juju-e4d256-prod-github-runner-207 kernel: [64524.626391] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 23:19:10 juju-e4d256-prod-github-runner-207 kernel: [64524.627326] Aug 22 23:19:38 juju-e4d256-prod-github-runner-207 kernel: [64552.541981] watchdog: BUG: soft lockup - CPU#1 stuck for 60011s! [qemu-system-x86:6715] Aug 22 23:19:38 juju-e4d256-prod-github-runner-207 kernel: [64552.543134] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 23:19:38 juju-e4d256-prod-github-runner-207 kernel: [64552.543209] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 23:19:38 juju-e4d256-prod-github-runner-207 kernel: [64552.555693] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 23:19:38 juju-e4d256-prod-github-runner-207 kernel: [64552.556998] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 23:19:38 juju-e4d256-prod-github-runner-207 kernel: [64552.558262] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:19:38 juju-e4d256-prod-github-runner-207 kernel: [64552.559381] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 23:19:38 juju-e4d256-prod-github-runner-207 kernel: [64552.561966] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 23:19:38 juju-e4d256-prod-github-runner-207 kernel: [64552.563024] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 23:19:38 juju-e4d256-prod-github-runner-207 kernel: [64552.564206] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 23:19:38 juju-e4d256-prod-github-runner-207 kernel: [64552.565390] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 23:19:38 juju-e4d256-prod-github-runner-207 kernel: [64552.566556] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 23:19:38 juju-e4d256-prod-github-runner-207 kernel: [64552.567729] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 23:19:38 juju-e4d256-prod-github-runner-207 kernel: [64552.568931] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 23:19:38 juju-e4d256-prod-github-runner-207 kernel: [64552.570179] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 23:19:38 juju-e4d256-prod-github-runner-207 kernel: [64552.571282] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 23:19:38 juju-e4d256-prod-github-runner-207 kernel: [64552.572480] Call Trace: Aug 22 23:19:38 juju-e4d256-prod-github-runner-207 kernel: [64552.573428] Aug 22 23:19:38 juju-e4d256-prod-github-runner-207 kernel: [64552.574331] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:19:38 juju-e4d256-prod-github-runner-207 kernel: [64552.575370] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:19:38 juju-e4d256-prod-github-runner-207 kernel: [64552.576450] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:19:38 juju-e4d256-prod-github-runner-207 kernel: [64552.577563] ? show_regs.part.0+0x23/0x29 Aug 22 23:19:38 juju-e4d256-prod-github-runner-207 kernel: [64552.578582] ? show_regs.cold+0x8/0xd Aug 22 23:19:38 juju-e4d256-prod-github-runner-207 kernel: [64552.579580] ? watchdog_timer_fn+0x1be/0x220 Aug 22 23:19:38 juju-e4d256-prod-github-runner-207 kernel: [64552.580595] ? lockup_detector_update_enable+0x60/0x60 Aug 22 23:19:38 juju-e4d256-prod-github-runner-207 kernel: [64552.581700] ? __hrtimer_run_queues+0x107/0x230 Aug 22 23:19:38 juju-e4d256-prod-github-runner-207 kernel: [64552.582735] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 23:19:38 juju-e4d256-prod-github-runner-207 kernel: [64552.583785] ? hrtimer_interrupt+0x101/0x220 Aug 22 23:19:38 juju-e4d256-prod-github-runner-207 kernel: [64552.584823] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 23:19:38 juju-e4d256-prod-github-runner-207 kernel: [64552.585935] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 23:19:38 juju-e4d256-prod-github-runner-207 kernel: [64552.587109] Aug 22 23:19:38 juju-e4d256-prod-github-runner-207 kernel: [64552.588131] Aug 22 23:19:38 juju-e4d256-prod-github-runner-207 kernel: [64552.589009] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 23:19:38 juju-e4d256-prod-github-runner-207 kernel: [64552.590080] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:19:38 juju-e4d256-prod-github-runner-207 kernel: [64552.591198] ? _raw_spin_lock+0x22/0x30 Aug 22 23:19:38 juju-e4d256-prod-github-runner-207 kernel: [64552.592148] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:19:38 juju-e4d256-prod-github-runner-207 kernel: [64552.593192] direct_page_fault+0x206/0x310 [kvm] Aug 22 23:19:38 juju-e4d256-prod-github-runner-207 kernel: [64552.594245] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 23:19:38 juju-e4d256-prod-github-runner-207 kernel: [64552.595311] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 23:19:38 juju-e4d256-prod-github-runner-207 kernel: [64552.596321] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 23:19:38 juju-e4d256-prod-github-runner-207 kernel: [64552.597308] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 23:19:38 juju-e4d256-prod-github-runner-207 kernel: [64552.598269] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 23:19:38 juju-e4d256-prod-github-runner-207 kernel: [64552.599265] handle_exit+0x98/0x230 [kvm_amd] Aug 22 23:19:38 juju-e4d256-prod-github-runner-207 kernel: [64552.600179] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 23:19:38 juju-e4d256-prod-github-runner-207 kernel: [64552.601125] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 23:19:38 juju-e4d256-prod-github-runner-207 kernel: [64552.602058] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 23:19:38 juju-e4d256-prod-github-runner-207 kernel: [64552.602966] vcpu_run+0x62/0x2c0 [kvm] Aug 22 23:19:38 juju-e4d256-prod-github-runner-207 kernel: [64552.603792] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 23:19:38 juju-e4d256-prod-github-runner-207 kernel: [64552.604610] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 23:19:38 juju-e4d256-prod-github-runner-207 kernel: [64552.605511] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 23:19:38 juju-e4d256-prod-github-runner-207 kernel: [64552.606343] ? __seccomp_filter+0x4a/0x4a0 Aug 22 23:19:38 juju-e4d256-prod-github-runner-207 kernel: [64552.607093] ? __fget_files+0x86/0xc0 Aug 22 23:19:38 juju-e4d256-prod-github-runner-207 kernel: [64552.607799] __x64_sys_ioctl+0x95/0xd0 Aug 22 23:19:38 juju-e4d256-prod-github-runner-207 kernel: [64552.608492] do_syscall_64+0x5c/0xc0 Aug 22 23:19:38 juju-e4d256-prod-github-runner-207 kernel: [64552.609205] ? do_futex+0x162/0x1f0 Aug 22 23:19:38 juju-e4d256-prod-github-runner-207 kernel: [64552.609868] ? __x64_sys_futex+0x78/0x1e0 Aug 22 23:19:38 juju-e4d256-prod-github-runner-207 kernel: [64552.610598] ? __secure_computing+0xa9/0x120 Aug 22 23:19:38 juju-e4d256-prod-github-runner-207 kernel: [64552.611294] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 23:19:38 juju-e4d256-prod-github-runner-207 kernel: [64552.612061] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:19:38 juju-e4d256-prod-github-runner-207 kernel: [64552.612786] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:19:38 juju-e4d256-prod-github-runner-207 kernel: [64552.613518] ? do_syscall_64+0x69/0xc0 Aug 22 23:19:38 juju-e4d256-prod-github-runner-207 kernel: [64552.614179] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:19:38 juju-e4d256-prod-github-runner-207 kernel: [64552.614890] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:19:38 juju-e4d256-prod-github-runner-207 kernel: [64552.615598] ? do_syscall_64+0x69/0xc0 Aug 22 23:19:38 juju-e4d256-prod-github-runner-207 kernel: [64552.616226] ? do_syscall_64+0x69/0xc0 Aug 22 23:19:38 juju-e4d256-prod-github-runner-207 kernel: [64552.616853] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 23:19:38 juju-e4d256-prod-github-runner-207 kernel: [64552.617577] RIP: 0033:0x7faa5d0edaff Aug 22 23:19:38 juju-e4d256-prod-github-runner-207 kernel: [64552.618204] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 23:19:38 juju-e4d256-prod-github-runner-207 kernel: [64552.620202] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 23:19:38 juju-e4d256-prod-github-runner-207 kernel: [64552.621141] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 23:19:38 juju-e4d256-prod-github-runner-207 kernel: [64552.622044] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 23:19:38 juju-e4d256-prod-github-runner-207 kernel: [64552.622933] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 23:19:38 juju-e4d256-prod-github-runner-207 kernel: [64552.623821] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 23:19:38 juju-e4d256-prod-github-runner-207 kernel: [64552.624718] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 23:19:38 juju-e4d256-prod-github-runner-207 kernel: [64552.625656] Aug 22 23:20:06 juju-e4d256-prod-github-runner-207 kernel: [64580.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 60037s! [qemu-system-x86:6715] Aug 22 23:20:06 juju-e4d256-prod-github-runner-207 kernel: [64580.543919] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 23:20:06 juju-e4d256-prod-github-runner-207 kernel: [64580.544239] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 23:20:06 juju-e4d256-prod-github-runner-207 kernel: [64580.557414] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 23:20:06 juju-e4d256-prod-github-runner-207 kernel: [64580.558694] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 23:20:06 juju-e4d256-prod-github-runner-207 kernel: [64580.559913] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:20:06 juju-e4d256-prod-github-runner-207 kernel: [64580.560991] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 23:20:06 juju-e4d256-prod-github-runner-207 kernel: [64580.563560] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 23:20:06 juju-e4d256-prod-github-runner-207 kernel: [64580.564620] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 23:20:06 juju-e4d256-prod-github-runner-207 kernel: [64580.565787] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 23:20:06 juju-e4d256-prod-github-runner-207 kernel: [64580.567067] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 23:20:06 juju-e4d256-prod-github-runner-207 kernel: [64580.568397] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 23:20:06 juju-e4d256-prod-github-runner-207 kernel: [64580.569683] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 23:20:06 juju-e4d256-prod-github-runner-207 kernel: [64580.570902] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 23:20:06 juju-e4d256-prod-github-runner-207 kernel: [64580.572157] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 23:20:06 juju-e4d256-prod-github-runner-207 kernel: [64580.573378] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 23:20:06 juju-e4d256-prod-github-runner-207 kernel: [64580.574742] Call Trace: Aug 22 23:20:06 juju-e4d256-prod-github-runner-207 kernel: [64580.575678] Aug 22 23:20:06 juju-e4d256-prod-github-runner-207 kernel: [64580.576612] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:20:06 juju-e4d256-prod-github-runner-207 kernel: [64580.577644] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:20:06 juju-e4d256-prod-github-runner-207 kernel: [64580.578664] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:20:06 juju-e4d256-prod-github-runner-207 kernel: [64580.579758] ? show_regs.part.0+0x23/0x29 Aug 22 23:20:06 juju-e4d256-prod-github-runner-207 kernel: [64580.580769] ? show_regs.cold+0x8/0xd Aug 22 23:20:06 juju-e4d256-prod-github-runner-207 kernel: [64580.581747] ? watchdog_timer_fn+0x1be/0x220 Aug 22 23:20:06 juju-e4d256-prod-github-runner-207 kernel: [64580.582778] ? lockup_detector_update_enable+0x60/0x60 Aug 22 23:20:06 juju-e4d256-prod-github-runner-207 kernel: [64580.583839] ? __hrtimer_run_queues+0x107/0x230 Aug 22 23:20:06 juju-e4d256-prod-github-runner-207 kernel: [64580.584935] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 23:20:06 juju-e4d256-prod-github-runner-207 kernel: [64580.586284] ? hrtimer_interrupt+0x101/0x220 Aug 22 23:20:06 juju-e4d256-prod-github-runner-207 kernel: [64580.587366] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 23:20:06 juju-e4d256-prod-github-runner-207 kernel: [64580.588444] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 23:20:06 juju-e4d256-prod-github-runner-207 kernel: [64580.589523] Aug 22 23:20:06 juju-e4d256-prod-github-runner-207 kernel: [64580.590381] Aug 22 23:20:06 juju-e4d256-prod-github-runner-207 kernel: [64580.591226] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 23:20:06 juju-e4d256-prod-github-runner-207 kernel: [64580.592269] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:20:06 juju-e4d256-prod-github-runner-207 kernel: [64580.593389] ? _raw_spin_lock+0x22/0x30 Aug 22 23:20:06 juju-e4d256-prod-github-runner-207 kernel: [64580.594346] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:20:06 juju-e4d256-prod-github-runner-207 kernel: [64580.595373] direct_page_fault+0x206/0x310 [kvm] Aug 22 23:20:06 juju-e4d256-prod-github-runner-207 kernel: [64580.596407] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 23:20:06 juju-e4d256-prod-github-runner-207 kernel: [64580.597469] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 23:20:06 juju-e4d256-prod-github-runner-207 kernel: [64580.598495] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 23:20:06 juju-e4d256-prod-github-runner-207 kernel: [64580.599516] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 23:20:06 juju-e4d256-prod-github-runner-207 kernel: [64580.600468] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 23:20:06 juju-e4d256-prod-github-runner-207 kernel: [64580.601499] handle_exit+0x98/0x230 [kvm_amd] Aug 22 23:20:06 juju-e4d256-prod-github-runner-207 kernel: [64580.602422] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 23:20:06 juju-e4d256-prod-github-runner-207 kernel: [64580.603356] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 23:20:06 juju-e4d256-prod-github-runner-207 kernel: [64580.604294] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 23:20:06 juju-e4d256-prod-github-runner-207 kernel: [64580.605214] vcpu_run+0x62/0x2c0 [kvm] Aug 22 23:20:06 juju-e4d256-prod-github-runner-207 kernel: [64580.606032] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 23:20:06 juju-e4d256-prod-github-runner-207 kernel: [64580.606847] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 23:20:06 juju-e4d256-prod-github-runner-207 kernel: [64580.607787] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 23:20:06 juju-e4d256-prod-github-runner-207 kernel: [64580.608705] ? __seccomp_filter+0x4a/0x4a0 Aug 22 23:20:06 juju-e4d256-prod-github-runner-207 kernel: [64580.609527] ? __fget_files+0x86/0xc0 Aug 22 23:20:06 juju-e4d256-prod-github-runner-207 kernel: [64580.610305] __x64_sys_ioctl+0x95/0xd0 Aug 22 23:20:06 juju-e4d256-prod-github-runner-207 kernel: [64580.611013] do_syscall_64+0x5c/0xc0 Aug 22 23:20:06 juju-e4d256-prod-github-runner-207 kernel: [64580.611690] ? do_futex+0x162/0x1f0 Aug 22 23:20:06 juju-e4d256-prod-github-runner-207 kernel: [64580.612375] ? __x64_sys_futex+0x78/0x1e0 Aug 22 23:20:06 juju-e4d256-prod-github-runner-207 kernel: [64580.613107] ? __secure_computing+0xa9/0x120 Aug 22 23:20:06 juju-e4d256-prod-github-runner-207 kernel: [64580.613881] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 23:20:06 juju-e4d256-prod-github-runner-207 kernel: [64580.614663] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:20:06 juju-e4d256-prod-github-runner-207 kernel: [64580.615388] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:20:06 juju-e4d256-prod-github-runner-207 kernel: [64580.616109] ? do_syscall_64+0x69/0xc0 Aug 22 23:20:06 juju-e4d256-prod-github-runner-207 kernel: [64580.616781] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:20:06 juju-e4d256-prod-github-runner-207 kernel: [64580.617511] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:20:06 juju-e4d256-prod-github-runner-207 kernel: [64580.618252] ? do_syscall_64+0x69/0xc0 Aug 22 23:20:06 juju-e4d256-prod-github-runner-207 kernel: [64580.618944] ? do_syscall_64+0x69/0xc0 Aug 22 23:20:06 juju-e4d256-prod-github-runner-207 kernel: [64580.619588] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 23:20:06 juju-e4d256-prod-github-runner-207 kernel: [64580.620300] RIP: 0033:0x7faa5d0edaff Aug 22 23:20:06 juju-e4d256-prod-github-runner-207 kernel: [64580.620980] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 23:20:06 juju-e4d256-prod-github-runner-207 kernel: [64580.623001] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 23:20:06 juju-e4d256-prod-github-runner-207 kernel: [64580.623969] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 23:20:06 juju-e4d256-prod-github-runner-207 kernel: [64580.624944] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 23:20:06 juju-e4d256-prod-github-runner-207 kernel: [64580.625922] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 23:20:06 juju-e4d256-prod-github-runner-207 kernel: [64580.626834] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 23:20:06 juju-e4d256-prod-github-runner-207 kernel: [64580.627760] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 23:20:06 juju-e4d256-prod-github-runner-207 kernel: [64580.628731] Aug 22 23:20:34 juju-e4d256-prod-github-runner-207 kernel: [64608.541980] watchdog: BUG: soft lockup - CPU#1 stuck for 60063s! [qemu-system-x86:6715] Aug 22 23:20:34 juju-e4d256-prod-github-runner-207 kernel: [64608.543114] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 23:20:34 juju-e4d256-prod-github-runner-207 kernel: [64608.543190] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 23:20:34 juju-e4d256-prod-github-runner-207 kernel: [64608.555414] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 23:20:34 juju-e4d256-prod-github-runner-207 kernel: [64608.556737] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 23:20:34 juju-e4d256-prod-github-runner-207 kernel: [64608.557963] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:20:34 juju-e4d256-prod-github-runner-207 kernel: [64608.559066] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 23:20:34 juju-e4d256-prod-github-runner-207 kernel: [64608.561633] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 23:20:34 juju-e4d256-prod-github-runner-207 kernel: [64608.562703] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 23:20:34 juju-e4d256-prod-github-runner-207 kernel: [64608.563872] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 23:20:34 juju-e4d256-prod-github-runner-207 kernel: [64608.565074] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 23:20:34 juju-e4d256-prod-github-runner-207 kernel: [64608.566233] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 23:20:34 juju-e4d256-prod-github-runner-207 kernel: [64608.567418] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 23:20:34 juju-e4d256-prod-github-runner-207 kernel: [64608.568633] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 23:20:34 juju-e4d256-prod-github-runner-207 kernel: [64608.570119] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 23:20:34 juju-e4d256-prod-github-runner-207 kernel: [64608.571354] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 23:20:34 juju-e4d256-prod-github-runner-207 kernel: [64608.572702] Call Trace: Aug 22 23:20:34 juju-e4d256-prod-github-runner-207 kernel: [64608.573664] Aug 22 23:20:34 juju-e4d256-prod-github-runner-207 kernel: [64608.574605] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:20:34 juju-e4d256-prod-github-runner-207 kernel: [64608.575814] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:20:34 juju-e4d256-prod-github-runner-207 kernel: [64608.577184] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:20:34 juju-e4d256-prod-github-runner-207 kernel: [64608.578266] ? show_regs.part.0+0x23/0x29 Aug 22 23:20:34 juju-e4d256-prod-github-runner-207 kernel: [64608.579277] ? show_regs.cold+0x8/0xd Aug 22 23:20:34 juju-e4d256-prod-github-runner-207 kernel: [64608.580277] ? watchdog_timer_fn+0x1be/0x220 Aug 22 23:20:34 juju-e4d256-prod-github-runner-207 kernel: [64608.581332] ? lockup_detector_update_enable+0x60/0x60 Aug 22 23:20:34 juju-e4d256-prod-github-runner-207 kernel: [64608.582394] ? __hrtimer_run_queues+0x107/0x230 Aug 22 23:20:34 juju-e4d256-prod-github-runner-207 kernel: [64608.583419] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 23:20:34 juju-e4d256-prod-github-runner-207 kernel: [64608.584487] ? hrtimer_interrupt+0x101/0x220 Aug 22 23:20:34 juju-e4d256-prod-github-runner-207 kernel: [64608.585597] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 23:20:34 juju-e4d256-prod-github-runner-207 kernel: [64608.586782] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 23:20:34 juju-e4d256-prod-github-runner-207 kernel: [64608.588099] Aug 22 23:20:34 juju-e4d256-prod-github-runner-207 kernel: [64608.589061] Aug 22 23:20:34 juju-e4d256-prod-github-runner-207 kernel: [64608.590004] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 23:20:34 juju-e4d256-prod-github-runner-207 kernel: [64608.591060] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:20:34 juju-e4d256-prod-github-runner-207 kernel: [64608.592107] ? _raw_spin_lock+0x22/0x30 Aug 22 23:20:34 juju-e4d256-prod-github-runner-207 kernel: [64608.593080] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:20:34 juju-e4d256-prod-github-runner-207 kernel: [64608.594105] direct_page_fault+0x206/0x310 [kvm] Aug 22 23:20:34 juju-e4d256-prod-github-runner-207 kernel: [64608.595204] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 23:20:34 juju-e4d256-prod-github-runner-207 kernel: [64608.596227] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 23:20:34 juju-e4d256-prod-github-runner-207 kernel: [64608.597357] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 23:20:34 juju-e4d256-prod-github-runner-207 kernel: [64608.598339] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 23:20:34 juju-e4d256-prod-github-runner-207 kernel: [64608.599285] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 23:20:34 juju-e4d256-prod-github-runner-207 kernel: [64608.600283] handle_exit+0x98/0x230 [kvm_amd] Aug 22 23:20:34 juju-e4d256-prod-github-runner-207 kernel: [64608.601194] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 23:20:34 juju-e4d256-prod-github-runner-207 kernel: [64608.602110] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 23:20:34 juju-e4d256-prod-github-runner-207 kernel: [64608.603042] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 23:20:34 juju-e4d256-prod-github-runner-207 kernel: [64608.603947] vcpu_run+0x62/0x2c0 [kvm] Aug 22 23:20:34 juju-e4d256-prod-github-runner-207 kernel: [64608.604771] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 23:20:34 juju-e4d256-prod-github-runner-207 kernel: [64608.605585] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 23:20:34 juju-e4d256-prod-github-runner-207 kernel: [64608.606465] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 23:20:34 juju-e4d256-prod-github-runner-207 kernel: [64608.607353] ? __seccomp_filter+0x4a/0x4a0 Aug 22 23:20:34 juju-e4d256-prod-github-runner-207 kernel: [64608.608225] ? __fget_files+0x86/0xc0 Aug 22 23:20:34 juju-e4d256-prod-github-runner-207 kernel: [64608.608962] __x64_sys_ioctl+0x95/0xd0 Aug 22 23:20:34 juju-e4d256-prod-github-runner-207 kernel: [64608.609734] do_syscall_64+0x5c/0xc0 Aug 22 23:20:34 juju-e4d256-prod-github-runner-207 kernel: [64608.610422] ? do_futex+0x162/0x1f0 Aug 22 23:20:34 juju-e4d256-prod-github-runner-207 kernel: [64608.611080] ? __x64_sys_futex+0x78/0x1e0 Aug 22 23:20:34 juju-e4d256-prod-github-runner-207 kernel: [64608.611796] ? __secure_computing+0xa9/0x120 Aug 22 23:20:34 juju-e4d256-prod-github-runner-207 kernel: [64608.612512] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 23:20:34 juju-e4d256-prod-github-runner-207 kernel: [64608.613283] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:20:34 juju-e4d256-prod-github-runner-207 kernel: [64608.614010] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:20:34 juju-e4d256-prod-github-runner-207 kernel: [64608.614755] ? do_syscall_64+0x69/0xc0 Aug 22 23:20:34 juju-e4d256-prod-github-runner-207 kernel: [64608.615444] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:20:34 juju-e4d256-prod-github-runner-207 kernel: [64608.616155] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:20:34 juju-e4d256-prod-github-runner-207 kernel: [64608.616883] ? do_syscall_64+0x69/0xc0 Aug 22 23:20:34 juju-e4d256-prod-github-runner-207 kernel: [64608.617512] ? do_syscall_64+0x69/0xc0 Aug 22 23:20:34 juju-e4d256-prod-github-runner-207 kernel: [64608.618134] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 23:20:34 juju-e4d256-prod-github-runner-207 kernel: [64608.618845] RIP: 0033:0x7faa5d0edaff Aug 22 23:20:34 juju-e4d256-prod-github-runner-207 kernel: [64608.619495] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 23:20:34 juju-e4d256-prod-github-runner-207 kernel: [64608.621503] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 23:20:34 juju-e4d256-prod-github-runner-207 kernel: [64608.622447] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 23:20:34 juju-e4d256-prod-github-runner-207 kernel: [64608.623524] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 23:20:34 juju-e4d256-prod-github-runner-207 kernel: [64608.624580] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 23:20:34 juju-e4d256-prod-github-runner-207 kernel: [64608.625607] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 23:20:34 juju-e4d256-prod-github-runner-207 kernel: [64608.626627] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 23:20:34 juju-e4d256-prod-github-runner-207 kernel: [64608.627657] Aug 22 23:20:47 juju-e4d256-prod-github-runner-207 kernel: [64621.496709] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 23:20:47 juju-e4d256-prod-github-runner-207 kernel: [64621.497695] rcu: 1-....: (16075231 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=7760817 Aug 22 23:20:47 juju-e4d256-prod-github-runner-207 kernel: [64621.498845] (t=16126074 jiffies g=23269 q=56927) Aug 22 23:20:47 juju-e4d256-prod-github-runner-207 kernel: [64621.499638] NMI backtrace for cpu 1 Aug 22 23:20:47 juju-e4d256-prod-github-runner-207 kernel: [64621.500372] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 23:20:47 juju-e4d256-prod-github-runner-207 kernel: [64621.501511] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 23:20:47 juju-e4d256-prod-github-runner-207 kernel: [64621.502596] Call Trace: Aug 22 23:20:47 juju-e4d256-prod-github-runner-207 kernel: [64621.503274] Aug 22 23:20:47 juju-e4d256-prod-github-runner-207 kernel: [64621.503927] show_stack+0x52/0x5c Aug 22 23:20:47 juju-e4d256-prod-github-runner-207 kernel: [64621.504691] dump_stack_lvl+0x4a/0x63 Aug 22 23:20:47 juju-e4d256-prod-github-runner-207 kernel: [64621.505450] dump_stack+0x10/0x16 Aug 22 23:20:47 juju-e4d256-prod-github-runner-207 kernel: [64621.506177] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 23:20:47 juju-e4d256-prod-github-runner-207 kernel: [64621.507001] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 23:20:47 juju-e4d256-prod-github-runner-207 kernel: [64621.507801] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 23:20:47 juju-e4d256-prod-github-runner-207 kernel: [64621.508789] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 23:20:47 juju-e4d256-prod-github-runner-207 kernel: [64621.509648] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 23:20:47 juju-e4d256-prod-github-runner-207 kernel: [64621.510675] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 23:20:47 juju-e4d256-prod-github-runner-207 kernel: [64621.511508] print_cpu_stall.cold+0x2f/0xe2 Aug 22 23:20:47 juju-e4d256-prod-github-runner-207 kernel: [64621.512303] ? timekeeping_update+0xf7/0x150 Aug 22 23:20:47 juju-e4d256-prod-github-runner-207 kernel: [64621.513110] check_cpu_stall+0x109/0x270 Aug 22 23:20:47 juju-e4d256-prod-github-runner-207 kernel: [64621.513895] rcu_sched_clock_irq+0x9a/0x250 Aug 22 23:20:47 juju-e4d256-prod-github-runner-207 kernel: [64621.514666] update_process_times+0x94/0xd0 Aug 22 23:20:47 juju-e4d256-prod-github-runner-207 kernel: [64621.515454] tick_sched_handle+0x29/0x70 Aug 22 23:20:47 juju-e4d256-prod-github-runner-207 kernel: [64621.516245] tick_sched_timer+0x8c/0xc0 Aug 22 23:20:47 juju-e4d256-prod-github-runner-207 kernel: [64621.517016] ? tick_nohz_handler+0xb0/0xb0 Aug 22 23:20:47 juju-e4d256-prod-github-runner-207 kernel: [64621.517802] __hrtimer_run_queues+0x107/0x230 Aug 22 23:20:47 juju-e4d256-prod-github-runner-207 kernel: [64621.518604] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 23:20:47 juju-e4d256-prod-github-runner-207 kernel: [64621.519390] hrtimer_interrupt+0x101/0x220 Aug 22 23:20:47 juju-e4d256-prod-github-runner-207 kernel: [64621.520239] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 23:20:47 juju-e4d256-prod-github-runner-207 kernel: [64621.521065] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 23:20:47 juju-e4d256-prod-github-runner-207 kernel: [64621.521889] Aug 22 23:20:47 juju-e4d256-prod-github-runner-207 kernel: [64621.522527] Aug 22 23:20:47 juju-e4d256-prod-github-runner-207 kernel: [64621.523161] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 23:20:47 juju-e4d256-prod-github-runner-207 kernel: [64621.523993] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:20:47 juju-e4d256-prod-github-runner-207 kernel: [64621.524911] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 23:20:47 juju-e4d256-prod-github-runner-207 kernel: [64621.527159] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 23:20:47 juju-e4d256-prod-github-runner-207 kernel: [64621.528060] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 23:20:47 juju-e4d256-prod-github-runner-207 kernel: [64621.529069] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 23:20:47 juju-e4d256-prod-github-runner-207 kernel: [64621.530065] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 23:20:47 juju-e4d256-prod-github-runner-207 kernel: [64621.531047] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 23:20:47 juju-e4d256-prod-github-runner-207 kernel: [64621.532057] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 23:20:47 juju-e4d256-prod-github-runner-207 kernel: [64621.533020] ? _raw_spin_lock+0x22/0x30 Aug 22 23:20:47 juju-e4d256-prod-github-runner-207 kernel: [64621.533793] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:20:47 juju-e4d256-prod-github-runner-207 kernel: [64621.534645] direct_page_fault+0x206/0x310 [kvm] Aug 22 23:20:47 juju-e4d256-prod-github-runner-207 kernel: [64621.535491] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 23:20:47 juju-e4d256-prod-github-runner-207 kernel: [64621.536354] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 23:20:47 juju-e4d256-prod-github-runner-207 kernel: [64621.537229] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 23:20:47 juju-e4d256-prod-github-runner-207 kernel: [64621.538047] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 23:20:47 juju-e4d256-prod-github-runner-207 kernel: [64621.538838] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 23:20:47 juju-e4d256-prod-github-runner-207 kernel: [64621.539672] handle_exit+0x98/0x230 [kvm_amd] Aug 22 23:20:47 juju-e4d256-prod-github-runner-207 kernel: [64621.540455] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 23:20:47 juju-e4d256-prod-github-runner-207 kernel: [64621.541244] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 23:20:47 juju-e4d256-prod-github-runner-207 kernel: [64621.542081] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 23:20:47 juju-e4d256-prod-github-runner-207 kernel: [64621.543241] vcpu_run+0x62/0x2c0 [kvm] Aug 22 23:20:47 juju-e4d256-prod-github-runner-207 kernel: [64621.543965] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 23:20:47 juju-e4d256-prod-github-runner-207 kernel: [64621.544735] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 23:20:47 juju-e4d256-prod-github-runner-207 kernel: [64621.545556] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 23:20:47 juju-e4d256-prod-github-runner-207 kernel: [64621.546325] ? __seccomp_filter+0x4a/0x4a0 Aug 22 23:20:47 juju-e4d256-prod-github-runner-207 kernel: [64621.547051] ? __fget_files+0x86/0xc0 Aug 22 23:20:47 juju-e4d256-prod-github-runner-207 kernel: [64621.547761] __x64_sys_ioctl+0x95/0xd0 Aug 22 23:20:47 juju-e4d256-prod-github-runner-207 kernel: [64621.548486] do_syscall_64+0x5c/0xc0 Aug 22 23:20:47 juju-e4d256-prod-github-runner-207 kernel: [64621.549173] ? do_futex+0x162/0x1f0 Aug 22 23:20:47 juju-e4d256-prod-github-runner-207 kernel: [64621.549850] ? __x64_sys_futex+0x78/0x1e0 Aug 22 23:20:47 juju-e4d256-prod-github-runner-207 kernel: [64621.550555] ? __secure_computing+0xa9/0x120 Aug 22 23:20:47 juju-e4d256-prod-github-runner-207 kernel: [64621.551276] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 23:20:47 juju-e4d256-prod-github-runner-207 kernel: [64621.552089] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:20:47 juju-e4d256-prod-github-runner-207 kernel: [64621.552878] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:20:47 juju-e4d256-prod-github-runner-207 kernel: [64621.553657] ? do_syscall_64+0x69/0xc0 Aug 22 23:20:47 juju-e4d256-prod-github-runner-207 kernel: [64621.554468] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:20:47 juju-e4d256-prod-github-runner-207 kernel: [64621.555240] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:20:47 juju-e4d256-prod-github-runner-207 kernel: [64621.556006] ? do_syscall_64+0x69/0xc0 Aug 22 23:20:47 juju-e4d256-prod-github-runner-207 kernel: [64621.556733] ? do_syscall_64+0x69/0xc0 Aug 22 23:20:47 juju-e4d256-prod-github-runner-207 kernel: [64621.557426] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 23:20:47 juju-e4d256-prod-github-runner-207 kernel: [64621.558215] RIP: 0033:0x7faa5d0edaff Aug 22 23:20:47 juju-e4d256-prod-github-runner-207 kernel: [64621.558903] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 23:20:47 juju-e4d256-prod-github-runner-207 kernel: [64621.561054] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 23:20:47 juju-e4d256-prod-github-runner-207 kernel: [64621.562050] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 23:20:47 juju-e4d256-prod-github-runner-207 kernel: [64621.563007] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 23:20:47 juju-e4d256-prod-github-runner-207 kernel: [64621.563966] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 23:20:47 juju-e4d256-prod-github-runner-207 kernel: [64621.564942] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 23:20:47 juju-e4d256-prod-github-runner-207 kernel: [64621.565912] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 23:20:47 juju-e4d256-prod-github-runner-207 kernel: [64621.567330] Aug 22 23:21:14 juju-e4d256-prod-github-runner-207 kernel: [64648.541976] watchdog: BUG: soft lockup - CPU#1 stuck for 60100s! [qemu-system-x86:6715] Aug 22 23:21:14 juju-e4d256-prod-github-runner-207 kernel: [64648.543094] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 23:21:14 juju-e4d256-prod-github-runner-207 kernel: [64648.543163] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 23:21:14 juju-e4d256-prod-github-runner-207 kernel: [64648.555527] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 23:21:14 juju-e4d256-prod-github-runner-207 kernel: [64648.556826] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 23:21:14 juju-e4d256-prod-github-runner-207 kernel: [64648.558069] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:21:14 juju-e4d256-prod-github-runner-207 kernel: [64648.559135] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 23:21:14 juju-e4d256-prod-github-runner-207 kernel: [64648.561730] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 23:21:14 juju-e4d256-prod-github-runner-207 kernel: [64648.562786] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 23:21:14 juju-e4d256-prod-github-runner-207 kernel: [64648.563996] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 23:21:14 juju-e4d256-prod-github-runner-207 kernel: [64648.565170] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 23:21:14 juju-e4d256-prod-github-runner-207 kernel: [64648.566348] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 23:21:14 juju-e4d256-prod-github-runner-207 kernel: [64648.567534] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 23:21:14 juju-e4d256-prod-github-runner-207 kernel: [64648.568748] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 23:21:14 juju-e4d256-prod-github-runner-207 kernel: [64648.569996] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 23:21:14 juju-e4d256-prod-github-runner-207 kernel: [64648.571134] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 23:21:14 juju-e4d256-prod-github-runner-207 kernel: [64648.572366] Call Trace: Aug 22 23:21:14 juju-e4d256-prod-github-runner-207 kernel: [64648.573289] Aug 22 23:21:14 juju-e4d256-prod-github-runner-207 kernel: [64648.574173] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:21:14 juju-e4d256-prod-github-runner-207 kernel: [64648.575211] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:21:14 juju-e4d256-prod-github-runner-207 kernel: [64648.576407] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:21:14 juju-e4d256-prod-github-runner-207 kernel: [64648.577494] ? show_regs.part.0+0x23/0x29 Aug 22 23:21:14 juju-e4d256-prod-github-runner-207 kernel: [64648.578499] ? show_regs.cold+0x8/0xd Aug 22 23:21:14 juju-e4d256-prod-github-runner-207 kernel: [64648.579479] ? watchdog_timer_fn+0x1be/0x220 Aug 22 23:21:14 juju-e4d256-prod-github-runner-207 kernel: [64648.580508] ? lockup_detector_update_enable+0x60/0x60 Aug 22 23:21:14 juju-e4d256-prod-github-runner-207 kernel: [64648.581582] ? __hrtimer_run_queues+0x107/0x230 Aug 22 23:21:14 juju-e4d256-prod-github-runner-207 kernel: [64648.582635] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 23:21:14 juju-e4d256-prod-github-runner-207 kernel: [64648.583674] ? hrtimer_interrupt+0x101/0x220 Aug 22 23:21:14 juju-e4d256-prod-github-runner-207 kernel: [64648.584719] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 23:21:14 juju-e4d256-prod-github-runner-207 kernel: [64648.585800] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 23:21:14 juju-e4d256-prod-github-runner-207 kernel: [64648.586865] Aug 22 23:21:14 juju-e4d256-prod-github-runner-207 kernel: [64648.587762] Aug 22 23:21:14 juju-e4d256-prod-github-runner-207 kernel: [64648.588825] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 23:21:14 juju-e4d256-prod-github-runner-207 kernel: [64648.590291] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:21:14 juju-e4d256-prod-github-runner-207 kernel: [64648.591517] ? _raw_spin_lock+0x22/0x30 Aug 22 23:21:14 juju-e4d256-prod-github-runner-207 kernel: [64648.592501] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:21:14 juju-e4d256-prod-github-runner-207 kernel: [64648.593530] direct_page_fault+0x206/0x310 [kvm] Aug 22 23:21:14 juju-e4d256-prod-github-runner-207 kernel: [64648.594564] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 23:21:14 juju-e4d256-prod-github-runner-207 kernel: [64648.595590] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 23:21:14 juju-e4d256-prod-github-runner-207 kernel: [64648.596617] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 23:21:14 juju-e4d256-prod-github-runner-207 kernel: [64648.597604] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 23:21:14 juju-e4d256-prod-github-runner-207 kernel: [64648.598560] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 23:21:14 juju-e4d256-prod-github-runner-207 kernel: [64648.599551] handle_exit+0x98/0x230 [kvm_amd] Aug 22 23:21:14 juju-e4d256-prod-github-runner-207 kernel: [64648.600475] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 23:21:14 juju-e4d256-prod-github-runner-207 kernel: [64648.601431] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 23:21:14 juju-e4d256-prod-github-runner-207 kernel: [64648.602365] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 23:21:14 juju-e4d256-prod-github-runner-207 kernel: [64648.603280] vcpu_run+0x62/0x2c0 [kvm] Aug 22 23:21:14 juju-e4d256-prod-github-runner-207 kernel: [64648.604130] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 23:21:14 juju-e4d256-prod-github-runner-207 kernel: [64648.604949] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 23:21:14 juju-e4d256-prod-github-runner-207 kernel: [64648.605815] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 23:21:14 juju-e4d256-prod-github-runner-207 kernel: [64648.606679] ? __seccomp_filter+0x4a/0x4a0 Aug 22 23:21:14 juju-e4d256-prod-github-runner-207 kernel: [64648.607507] ? __fget_files+0x86/0xc0 Aug 22 23:21:14 juju-e4d256-prod-github-runner-207 kernel: [64648.608306] __x64_sys_ioctl+0x95/0xd0 Aug 22 23:21:14 juju-e4d256-prod-github-runner-207 kernel: [64648.609084] do_syscall_64+0x5c/0xc0 Aug 22 23:21:14 juju-e4d256-prod-github-runner-207 kernel: [64648.609850] ? do_futex+0x162/0x1f0 Aug 22 23:21:14 juju-e4d256-prod-github-runner-207 kernel: [64648.610561] ? __x64_sys_futex+0x78/0x1e0 Aug 22 23:21:14 juju-e4d256-prod-github-runner-207 kernel: [64648.611320] ? __secure_computing+0xa9/0x120 Aug 22 23:21:14 juju-e4d256-prod-github-runner-207 kernel: [64648.612091] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 23:21:14 juju-e4d256-prod-github-runner-207 kernel: [64648.612914] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:21:14 juju-e4d256-prod-github-runner-207 kernel: [64648.613693] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:21:14 juju-e4d256-prod-github-runner-207 kernel: [64648.614472] ? do_syscall_64+0x69/0xc0 Aug 22 23:21:14 juju-e4d256-prod-github-runner-207 kernel: [64648.615160] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:21:14 juju-e4d256-prod-github-runner-207 kernel: [64648.615958] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:21:14 juju-e4d256-prod-github-runner-207 kernel: [64648.616688] ? do_syscall_64+0x69/0xc0 Aug 22 23:21:14 juju-e4d256-prod-github-runner-207 kernel: [64648.617370] ? do_syscall_64+0x69/0xc0 Aug 22 23:21:14 juju-e4d256-prod-github-runner-207 kernel: [64648.618043] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 23:21:14 juju-e4d256-prod-github-runner-207 kernel: [64648.618813] RIP: 0033:0x7faa5d0edaff Aug 22 23:21:14 juju-e4d256-prod-github-runner-207 kernel: [64648.619491] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 23:21:14 juju-e4d256-prod-github-runner-207 kernel: [64648.621658] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 23:21:14 juju-e4d256-prod-github-runner-207 kernel: [64648.622644] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 23:21:14 juju-e4d256-prod-github-runner-207 kernel: [64648.623639] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 23:21:14 juju-e4d256-prod-github-runner-207 kernel: [64648.624590] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 23:21:14 juju-e4d256-prod-github-runner-207 kernel: [64648.625526] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 23:21:14 juju-e4d256-prod-github-runner-207 kernel: [64648.626493] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 23:21:14 juju-e4d256-prod-github-runner-207 kernel: [64648.627471] Aug 22 23:21:42 juju-e4d256-prod-github-runner-207 kernel: [64676.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 60126s! [qemu-system-x86:6715] Aug 22 23:21:42 juju-e4d256-prod-github-runner-207 kernel: [64676.543846] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 23:21:42 juju-e4d256-prod-github-runner-207 kernel: [64676.544145] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 23:21:42 juju-e4d256-prod-github-runner-207 kernel: [64676.556424] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 23:21:42 juju-e4d256-prod-github-runner-207 kernel: [64676.557751] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 23:21:42 juju-e4d256-prod-github-runner-207 kernel: [64676.559104] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:21:42 juju-e4d256-prod-github-runner-207 kernel: [64676.560188] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 23:21:42 juju-e4d256-prod-github-runner-207 kernel: [64676.562772] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 23:21:42 juju-e4d256-prod-github-runner-207 kernel: [64676.563835] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 23:21:42 juju-e4d256-prod-github-runner-207 kernel: [64676.564995] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 23:21:42 juju-e4d256-prod-github-runner-207 kernel: [64676.566155] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 23:21:42 juju-e4d256-prod-github-runner-207 kernel: [64676.567434] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 23:21:42 juju-e4d256-prod-github-runner-207 kernel: [64676.568896] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 23:21:42 juju-e4d256-prod-github-runner-207 kernel: [64676.570439] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 23:21:42 juju-e4d256-prod-github-runner-207 kernel: [64676.571939] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 23:21:42 juju-e4d256-prod-github-runner-207 kernel: [64676.573051] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 23:21:42 juju-e4d256-prod-github-runner-207 kernel: [64676.574257] Call Trace: Aug 22 23:21:42 juju-e4d256-prod-github-runner-207 kernel: [64676.575174] Aug 22 23:21:42 juju-e4d256-prod-github-runner-207 kernel: [64676.576125] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:21:42 juju-e4d256-prod-github-runner-207 kernel: [64676.577170] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:21:42 juju-e4d256-prod-github-runner-207 kernel: [64676.578199] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:21:42 juju-e4d256-prod-github-runner-207 kernel: [64676.579301] ? show_regs.part.0+0x23/0x29 Aug 22 23:21:42 juju-e4d256-prod-github-runner-207 kernel: [64676.580310] ? show_regs.cold+0x8/0xd Aug 22 23:21:42 juju-e4d256-prod-github-runner-207 kernel: [64676.581289] ? watchdog_timer_fn+0x1be/0x220 Aug 22 23:21:42 juju-e4d256-prod-github-runner-207 kernel: [64676.582457] ? lockup_detector_update_enable+0x60/0x60 Aug 22 23:21:42 juju-e4d256-prod-github-runner-207 kernel: [64676.583631] ? __hrtimer_run_queues+0x107/0x230 Aug 22 23:21:42 juju-e4d256-prod-github-runner-207 kernel: [64676.584668] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 23:21:42 juju-e4d256-prod-github-runner-207 kernel: [64676.585694] ? hrtimer_interrupt+0x101/0x220 Aug 22 23:21:42 juju-e4d256-prod-github-runner-207 kernel: [64676.586754] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 23:21:42 juju-e4d256-prod-github-runner-207 kernel: [64676.587847] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 23:21:42 juju-e4d256-prod-github-runner-207 kernel: [64676.588895] Aug 22 23:21:42 juju-e4d256-prod-github-runner-207 kernel: [64676.589747] Aug 22 23:21:42 juju-e4d256-prod-github-runner-207 kernel: [64676.590592] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 23:21:42 juju-e4d256-prod-github-runner-207 kernel: [64676.591637] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:21:42 juju-e4d256-prod-github-runner-207 kernel: [64676.592717] ? _raw_spin_lock+0x22/0x30 Aug 22 23:21:42 juju-e4d256-prod-github-runner-207 kernel: [64676.593728] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:21:42 juju-e4d256-prod-github-runner-207 kernel: [64676.594925] direct_page_fault+0x206/0x310 [kvm] Aug 22 23:21:42 juju-e4d256-prod-github-runner-207 kernel: [64676.595961] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 23:21:42 juju-e4d256-prod-github-runner-207 kernel: [64676.596972] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 23:21:42 juju-e4d256-prod-github-runner-207 kernel: [64676.598119] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 23:21:42 juju-e4d256-prod-github-runner-207 kernel: [64676.599448] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 23:21:42 juju-e4d256-prod-github-runner-207 kernel: [64676.600682] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 23:21:42 juju-e4d256-prod-github-runner-207 kernel: [64676.601780] handle_exit+0x98/0x230 [kvm_amd] Aug 22 23:21:42 juju-e4d256-prod-github-runner-207 kernel: [64676.602676] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 23:21:42 juju-e4d256-prod-github-runner-207 kernel: [64676.603624] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 23:21:42 juju-e4d256-prod-github-runner-207 kernel: [64676.604725] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 23:21:42 juju-e4d256-prod-github-runner-207 kernel: [64676.605822] vcpu_run+0x62/0x2c0 [kvm] Aug 22 23:21:42 juju-e4d256-prod-github-runner-207 kernel: [64676.606809] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 23:21:42 juju-e4d256-prod-github-runner-207 kernel: [64676.607648] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 23:21:42 juju-e4d256-prod-github-runner-207 kernel: [64676.608505] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 23:21:42 juju-e4d256-prod-github-runner-207 kernel: [64676.609309] ? __seccomp_filter+0x4a/0x4a0 Aug 22 23:21:42 juju-e4d256-prod-github-runner-207 kernel: [64676.610054] ? __fget_files+0x86/0xc0 Aug 22 23:21:42 juju-e4d256-prod-github-runner-207 kernel: [64676.610958] __x64_sys_ioctl+0x95/0xd0 Aug 22 23:21:42 juju-e4d256-prod-github-runner-207 kernel: [64676.611888] do_syscall_64+0x5c/0xc0 Aug 22 23:21:42 juju-e4d256-prod-github-runner-207 kernel: [64676.612728] ? do_futex+0x162/0x1f0 Aug 22 23:21:42 juju-e4d256-prod-github-runner-207 kernel: [64676.613385] ? __x64_sys_futex+0x78/0x1e0 Aug 22 23:21:42 juju-e4d256-prod-github-runner-207 kernel: [64676.614063] ? __secure_computing+0xa9/0x120 Aug 22 23:21:42 juju-e4d256-prod-github-runner-207 kernel: [64676.614755] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 23:21:42 juju-e4d256-prod-github-runner-207 kernel: [64676.615525] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:21:42 juju-e4d256-prod-github-runner-207 kernel: [64676.616254] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:21:42 juju-e4d256-prod-github-runner-207 kernel: [64676.617045] ? do_syscall_64+0x69/0xc0 Aug 22 23:21:42 juju-e4d256-prod-github-runner-207 kernel: [64676.617759] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:21:42 juju-e4d256-prod-github-runner-207 kernel: [64676.618472] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:21:42 juju-e4d256-prod-github-runner-207 kernel: [64676.619214] ? do_syscall_64+0x69/0xc0 Aug 22 23:21:42 juju-e4d256-prod-github-runner-207 kernel: [64676.619875] ? do_syscall_64+0x69/0xc0 Aug 22 23:21:42 juju-e4d256-prod-github-runner-207 kernel: [64676.620500] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 23:21:42 juju-e4d256-prod-github-runner-207 kernel: [64676.621209] RIP: 0033:0x7faa5d0edaff Aug 22 23:21:42 juju-e4d256-prod-github-runner-207 kernel: [64676.621885] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 23:21:42 juju-e4d256-prod-github-runner-207 kernel: [64676.624282] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 23:21:42 juju-e4d256-prod-github-runner-207 kernel: [64676.625345] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 23:21:42 juju-e4d256-prod-github-runner-207 kernel: [64676.626375] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 23:21:42 juju-e4d256-prod-github-runner-207 kernel: [64676.627434] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 23:21:42 juju-e4d256-prod-github-runner-207 kernel: [64676.628472] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 23:21:42 juju-e4d256-prod-github-runner-207 kernel: [64676.629522] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 23:21:42 juju-e4d256-prod-github-runner-207 kernel: [64676.630575] Aug 22 23:22:10 juju-e4d256-prod-github-runner-207 kernel: [64704.541980] watchdog: BUG: soft lockup - CPU#1 stuck for 60152s! [qemu-system-x86:6715] Aug 22 23:22:10 juju-e4d256-prod-github-runner-207 kernel: [64704.543124] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 23:22:10 juju-e4d256-prod-github-runner-207 kernel: [64704.543203] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 23:22:10 juju-e4d256-prod-github-runner-207 kernel: [64704.555522] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 23:22:10 juju-e4d256-prod-github-runner-207 kernel: [64704.556793] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 23:22:10 juju-e4d256-prod-github-runner-207 kernel: [64704.558014] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:22:10 juju-e4d256-prod-github-runner-207 kernel: [64704.559079] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 23:22:10 juju-e4d256-prod-github-runner-207 kernel: [64704.561627] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 23:22:10 juju-e4d256-prod-github-runner-207 kernel: [64704.562670] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 23:22:10 juju-e4d256-prod-github-runner-207 kernel: [64704.563839] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 23:22:10 juju-e4d256-prod-github-runner-207 kernel: [64704.565014] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 23:22:10 juju-e4d256-prod-github-runner-207 kernel: [64704.566176] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 23:22:10 juju-e4d256-prod-github-runner-207 kernel: [64704.567353] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 23:22:10 juju-e4d256-prod-github-runner-207 kernel: [64704.568527] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 23:22:10 juju-e4d256-prod-github-runner-207 kernel: [64704.569759] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 23:22:10 juju-e4d256-prod-github-runner-207 kernel: [64704.570881] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 23:22:10 juju-e4d256-prod-github-runner-207 kernel: [64704.572098] Call Trace: Aug 22 23:22:10 juju-e4d256-prod-github-runner-207 kernel: [64704.573014] Aug 22 23:22:10 juju-e4d256-prod-github-runner-207 kernel: [64704.573905] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:22:10 juju-e4d256-prod-github-runner-207 kernel: [64704.574941] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:22:10 juju-e4d256-prod-github-runner-207 kernel: [64704.575978] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:22:10 juju-e4d256-prod-github-runner-207 kernel: [64704.577082] ? show_regs.part.0+0x23/0x29 Aug 22 23:22:10 juju-e4d256-prod-github-runner-207 kernel: [64704.578092] ? show_regs.cold+0x8/0xd Aug 22 23:22:10 juju-e4d256-prod-github-runner-207 kernel: [64704.579082] ? watchdog_timer_fn+0x1be/0x220 Aug 22 23:22:10 juju-e4d256-prod-github-runner-207 kernel: [64704.580087] ? lockup_detector_update_enable+0x60/0x60 Aug 22 23:22:10 juju-e4d256-prod-github-runner-207 kernel: [64704.581147] ? __hrtimer_run_queues+0x107/0x230 Aug 22 23:22:10 juju-e4d256-prod-github-runner-207 kernel: [64704.582171] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 23:22:10 juju-e4d256-prod-github-runner-207 kernel: [64704.583203] ? hrtimer_interrupt+0x101/0x220 Aug 22 23:22:10 juju-e4d256-prod-github-runner-207 kernel: [64704.584215] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 23:22:10 juju-e4d256-prod-github-runner-207 kernel: [64704.585279] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 23:22:10 juju-e4d256-prod-github-runner-207 kernel: [64704.586320] Aug 22 23:22:10 juju-e4d256-prod-github-runner-207 kernel: [64704.587179] Aug 22 23:22:10 juju-e4d256-prod-github-runner-207 kernel: [64704.588020] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 23:22:10 juju-e4d256-prod-github-runner-207 kernel: [64704.589048] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:22:10 juju-e4d256-prod-github-runner-207 kernel: [64704.590082] ? _raw_spin_lock+0x22/0x30 Aug 22 23:22:10 juju-e4d256-prod-github-runner-207 kernel: [64704.591033] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:22:10 juju-e4d256-prod-github-runner-207 kernel: [64704.592050] direct_page_fault+0x206/0x310 [kvm] Aug 22 23:22:10 juju-e4d256-prod-github-runner-207 kernel: [64704.593070] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 23:22:10 juju-e4d256-prod-github-runner-207 kernel: [64704.594081] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 23:22:10 juju-e4d256-prod-github-runner-207 kernel: [64704.595087] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 23:22:10 juju-e4d256-prod-github-runner-207 kernel: [64704.596055] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 23:22:10 juju-e4d256-prod-github-runner-207 kernel: [64704.596997] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 23:22:10 juju-e4d256-prod-github-runner-207 kernel: [64704.597970] handle_exit+0x98/0x230 [kvm_amd] Aug 22 23:22:10 juju-e4d256-prod-github-runner-207 kernel: [64704.598927] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 23:22:10 juju-e4d256-prod-github-runner-207 kernel: [64704.599876] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 23:22:10 juju-e4d256-prod-github-runner-207 kernel: [64704.600802] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 23:22:10 juju-e4d256-prod-github-runner-207 kernel: [64704.601718] vcpu_run+0x62/0x2c0 [kvm] Aug 22 23:22:10 juju-e4d256-prod-github-runner-207 kernel: [64704.602537] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 23:22:10 juju-e4d256-prod-github-runner-207 kernel: [64704.603394] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 23:22:10 juju-e4d256-prod-github-runner-207 kernel: [64704.604286] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 23:22:10 juju-e4d256-prod-github-runner-207 kernel: [64704.605090] ? __seccomp_filter+0x4a/0x4a0 Aug 22 23:22:10 juju-e4d256-prod-github-runner-207 kernel: [64704.605833] ? __fget_files+0x86/0xc0 Aug 22 23:22:10 juju-e4d256-prod-github-runner-207 kernel: [64704.606543] __x64_sys_ioctl+0x95/0xd0 Aug 22 23:22:10 juju-e4d256-prod-github-runner-207 kernel: [64704.607245] do_syscall_64+0x5c/0xc0 Aug 22 23:22:10 juju-e4d256-prod-github-runner-207 kernel: [64704.607910] ? do_futex+0x162/0x1f0 Aug 22 23:22:10 juju-e4d256-prod-github-runner-207 kernel: [64704.608558] ? __x64_sys_futex+0x78/0x1e0 Aug 22 23:22:10 juju-e4d256-prod-github-runner-207 kernel: [64704.609231] ? __secure_computing+0xa9/0x120 Aug 22 23:22:10 juju-e4d256-prod-github-runner-207 kernel: [64704.609921] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 23:22:10 juju-e4d256-prod-github-runner-207 kernel: [64704.610690] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:22:10 juju-e4d256-prod-github-runner-207 kernel: [64704.611432] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:22:10 juju-e4d256-prod-github-runner-207 kernel: [64704.612151] ? do_syscall_64+0x69/0xc0 Aug 22 23:22:10 juju-e4d256-prod-github-runner-207 kernel: [64704.612799] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:22:10 juju-e4d256-prod-github-runner-207 kernel: [64704.613503] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:22:10 juju-e4d256-prod-github-runner-207 kernel: [64704.614197] ? do_syscall_64+0x69/0xc0 Aug 22 23:22:10 juju-e4d256-prod-github-runner-207 kernel: [64704.614820] ? do_syscall_64+0x69/0xc0 Aug 22 23:22:10 juju-e4d256-prod-github-runner-207 kernel: [64704.615538] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 23:22:10 juju-e4d256-prod-github-runner-207 kernel: [64704.616245] RIP: 0033:0x7faa5d0edaff Aug 22 23:22:10 juju-e4d256-prod-github-runner-207 kernel: [64704.616867] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 23:22:10 juju-e4d256-prod-github-runner-207 kernel: [64704.618848] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 23:22:10 juju-e4d256-prod-github-runner-207 kernel: [64704.619763] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 23:22:10 juju-e4d256-prod-github-runner-207 kernel: [64704.620653] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 23:22:10 juju-e4d256-prod-github-runner-207 kernel: [64704.621705] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 23:22:10 juju-e4d256-prod-github-runner-207 kernel: [64704.622614] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 23:22:10 juju-e4d256-prod-github-runner-207 kernel: [64704.623520] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 23:22:10 juju-e4d256-prod-github-runner-207 kernel: [64704.624411] Aug 22 23:22:38 juju-e4d256-prod-github-runner-207 kernel: [64732.541981] watchdog: BUG: soft lockup - CPU#1 stuck for 60178s! [qemu-system-x86:6715] Aug 22 23:22:38 juju-e4d256-prod-github-runner-207 kernel: [64732.543155] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 23:22:38 juju-e4d256-prod-github-runner-207 kernel: [64732.543229] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 23:22:38 juju-e4d256-prod-github-runner-207 kernel: [64732.555394] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 23:22:38 juju-e4d256-prod-github-runner-207 kernel: [64732.556683] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 23:22:38 juju-e4d256-prod-github-runner-207 kernel: [64732.557929] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:22:38 juju-e4d256-prod-github-runner-207 kernel: [64732.559020] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 23:22:38 juju-e4d256-prod-github-runner-207 kernel: [64732.561580] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 23:22:38 juju-e4d256-prod-github-runner-207 kernel: [64732.562689] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 23:22:38 juju-e4d256-prod-github-runner-207 kernel: [64732.563899] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 23:22:38 juju-e4d256-prod-github-runner-207 kernel: [64732.565080] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 23:22:38 juju-e4d256-prod-github-runner-207 kernel: [64732.566246] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 23:22:38 juju-e4d256-prod-github-runner-207 kernel: [64732.567427] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 23:22:38 juju-e4d256-prod-github-runner-207 kernel: [64732.568596] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 23:22:38 juju-e4d256-prod-github-runner-207 kernel: [64732.569835] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 23:22:38 juju-e4d256-prod-github-runner-207 kernel: [64732.570950] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 23:22:38 juju-e4d256-prod-github-runner-207 kernel: [64732.572148] Call Trace: Aug 22 23:22:38 juju-e4d256-prod-github-runner-207 kernel: [64732.573083] Aug 22 23:22:38 juju-e4d256-prod-github-runner-207 kernel: [64732.573998] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:22:38 juju-e4d256-prod-github-runner-207 kernel: [64732.575072] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:22:38 juju-e4d256-prod-github-runner-207 kernel: [64732.576108] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:22:38 juju-e4d256-prod-github-runner-207 kernel: [64732.577224] ? show_regs.part.0+0x23/0x29 Aug 22 23:22:38 juju-e4d256-prod-github-runner-207 kernel: [64732.578302] ? show_regs.cold+0x8/0xd Aug 22 23:22:38 juju-e4d256-prod-github-runner-207 kernel: [64732.579325] ? watchdog_timer_fn+0x1be/0x220 Aug 22 23:22:38 juju-e4d256-prod-github-runner-207 kernel: [64732.580347] ? lockup_detector_update_enable+0x60/0x60 Aug 22 23:22:38 juju-e4d256-prod-github-runner-207 kernel: [64732.581417] ? __hrtimer_run_queues+0x107/0x230 Aug 22 23:22:38 juju-e4d256-prod-github-runner-207 kernel: [64732.582449] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 23:22:38 juju-e4d256-prod-github-runner-207 kernel: [64732.583594] ? hrtimer_interrupt+0x101/0x220 Aug 22 23:22:38 juju-e4d256-prod-github-runner-207 kernel: [64732.584635] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 23:22:38 juju-e4d256-prod-github-runner-207 kernel: [64732.585738] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 23:22:38 juju-e4d256-prod-github-runner-207 kernel: [64732.586833] Aug 22 23:22:38 juju-e4d256-prod-github-runner-207 kernel: [64732.587705] Aug 22 23:22:38 juju-e4d256-prod-github-runner-207 kernel: [64732.588576] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 23:22:38 juju-e4d256-prod-github-runner-207 kernel: [64732.589648] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:22:38 juju-e4d256-prod-github-runner-207 kernel: [64732.590794] ? _raw_spin_lock+0x22/0x30 Aug 22 23:22:38 juju-e4d256-prod-github-runner-207 kernel: [64732.591762] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:22:38 juju-e4d256-prod-github-runner-207 kernel: [64732.592790] direct_page_fault+0x206/0x310 [kvm] Aug 22 23:22:38 juju-e4d256-prod-github-runner-207 kernel: [64732.593943] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 23:22:38 juju-e4d256-prod-github-runner-207 kernel: [64732.594982] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 23:22:38 juju-e4d256-prod-github-runner-207 kernel: [64732.596020] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 23:22:38 juju-e4d256-prod-github-runner-207 kernel: [64732.597003] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 23:22:38 juju-e4d256-prod-github-runner-207 kernel: [64732.597953] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 23:22:38 juju-e4d256-prod-github-runner-207 kernel: [64732.598969] handle_exit+0x98/0x230 [kvm_amd] Aug 22 23:22:38 juju-e4d256-prod-github-runner-207 kernel: [64732.599870] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 23:22:38 juju-e4d256-prod-github-runner-207 kernel: [64732.600787] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 23:22:38 juju-e4d256-prod-github-runner-207 kernel: [64732.601715] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 23:22:38 juju-e4d256-prod-github-runner-207 kernel: [64732.602627] vcpu_run+0x62/0x2c0 [kvm] Aug 22 23:22:38 juju-e4d256-prod-github-runner-207 kernel: [64732.603481] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 23:22:38 juju-e4d256-prod-github-runner-207 kernel: [64732.604309] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 23:22:38 juju-e4d256-prod-github-runner-207 kernel: [64732.605169] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 23:22:38 juju-e4d256-prod-github-runner-207 kernel: [64732.605967] ? __seccomp_filter+0x4a/0x4a0 Aug 22 23:22:38 juju-e4d256-prod-github-runner-207 kernel: [64732.606723] ? __fget_files+0x86/0xc0 Aug 22 23:22:38 juju-e4d256-prod-github-runner-207 kernel: [64732.607433] __x64_sys_ioctl+0x95/0xd0 Aug 22 23:22:38 juju-e4d256-prod-github-runner-207 kernel: [64732.608129] do_syscall_64+0x5c/0xc0 Aug 22 23:22:38 juju-e4d256-prod-github-runner-207 kernel: [64732.608797] ? do_futex+0x162/0x1f0 Aug 22 23:22:38 juju-e4d256-prod-github-runner-207 kernel: [64732.609487] ? __x64_sys_futex+0x78/0x1e0 Aug 22 23:22:38 juju-e4d256-prod-github-runner-207 kernel: [64732.610168] ? __secure_computing+0xa9/0x120 Aug 22 23:22:38 juju-e4d256-prod-github-runner-207 kernel: [64732.610882] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 23:22:38 juju-e4d256-prod-github-runner-207 kernel: [64732.611675] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:22:38 juju-e4d256-prod-github-runner-207 kernel: [64732.612401] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:22:38 juju-e4d256-prod-github-runner-207 kernel: [64732.613120] ? do_syscall_64+0x69/0xc0 Aug 22 23:22:38 juju-e4d256-prod-github-runner-207 kernel: [64732.613778] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:22:38 juju-e4d256-prod-github-runner-207 kernel: [64732.614498] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:22:38 juju-e4d256-prod-github-runner-207 kernel: [64732.615220] ? do_syscall_64+0x69/0xc0 Aug 22 23:22:38 juju-e4d256-prod-github-runner-207 kernel: [64732.615847] ? do_syscall_64+0x69/0xc0 Aug 22 23:22:38 juju-e4d256-prod-github-runner-207 kernel: [64732.616468] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 23:22:38 juju-e4d256-prod-github-runner-207 kernel: [64732.617172] RIP: 0033:0x7faa5d0edaff Aug 22 23:22:38 juju-e4d256-prod-github-runner-207 kernel: [64732.617941] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 23:22:38 juju-e4d256-prod-github-runner-207 kernel: [64732.619975] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 23:22:38 juju-e4d256-prod-github-runner-207 kernel: [64732.620886] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 23:22:38 juju-e4d256-prod-github-runner-207 kernel: [64732.621771] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 23:22:38 juju-e4d256-prod-github-runner-207 kernel: [64732.622668] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 23:22:38 juju-e4d256-prod-github-runner-207 kernel: [64732.623560] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 23:22:38 juju-e4d256-prod-github-runner-207 kernel: [64732.624514] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 23:22:38 juju-e4d256-prod-github-runner-207 kernel: [64732.625441] Aug 22 23:23:06 juju-e4d256-prod-github-runner-207 kernel: [64760.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 60204s! [qemu-system-x86:6715] Aug 22 23:23:06 juju-e4d256-prod-github-runner-207 kernel: [64760.543890] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 23:23:06 juju-e4d256-prod-github-runner-207 kernel: [64760.544196] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 23:23:06 juju-e4d256-prod-github-runner-207 kernel: [64760.556299] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 23:23:06 juju-e4d256-prod-github-runner-207 kernel: [64760.557564] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 23:23:06 juju-e4d256-prod-github-runner-207 kernel: [64760.558792] RIP: 0010:native_queued_spin_lock_slowpath+0xc/0x40 Aug 22 23:23:06 juju-e4d256-prod-github-runner-207 kernel: [64760.559844] Code: fe ff ff eb af 4c 89 fe 48 c7 c7 20 99 e9 89 e8 ca 69 55 00 e9 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 <8b> 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 eb Aug 22 23:23:06 juju-e4d256-prod-github-runner-207 kernel: [64760.562397] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 23:23:06 juju-e4d256-prod-github-runner-207 kernel: [64760.563439] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 23:23:06 juju-e4d256-prod-github-runner-207 kernel: [64760.564606] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 23:23:06 juju-e4d256-prod-github-runner-207 kernel: [64760.565768] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 23:23:06 juju-e4d256-prod-github-runner-207 kernel: [64760.566944] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 23:23:06 juju-e4d256-prod-github-runner-207 kernel: [64760.568108] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 23:23:06 juju-e4d256-prod-github-runner-207 kernel: [64760.569370] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 23:23:06 juju-e4d256-prod-github-runner-207 kernel: [64760.570613] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 23:23:06 juju-e4d256-prod-github-runner-207 kernel: [64760.571712] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 23:23:06 juju-e4d256-prod-github-runner-207 kernel: [64760.572903] Call Trace: Aug 22 23:23:06 juju-e4d256-prod-github-runner-207 kernel: [64760.573814] Aug 22 23:23:06 juju-e4d256-prod-github-runner-207 kernel: [64760.574721] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:23:06 juju-e4d256-prod-github-runner-207 kernel: [64760.575751] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:23:06 juju-e4d256-prod-github-runner-207 kernel: [64760.576778] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:23:06 juju-e4d256-prod-github-runner-207 kernel: [64760.577888] ? show_regs.part.0+0x23/0x29 Aug 22 23:23:06 juju-e4d256-prod-github-runner-207 kernel: [64760.578890] ? show_regs.cold+0x8/0xd Aug 22 23:23:06 juju-e4d256-prod-github-runner-207 kernel: [64760.579861] ? watchdog_timer_fn+0x1be/0x220 Aug 22 23:23:06 juju-e4d256-prod-github-runner-207 kernel: [64760.580914] ? lockup_detector_update_enable+0x60/0x60 Aug 22 23:23:06 juju-e4d256-prod-github-runner-207 kernel: [64760.581974] ? __hrtimer_run_queues+0x107/0x230 Aug 22 23:23:06 juju-e4d256-prod-github-runner-207 kernel: [64760.583006] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 23:23:06 juju-e4d256-prod-github-runner-207 kernel: [64760.584036] ? hrtimer_interrupt+0x101/0x220 Aug 22 23:23:06 juju-e4d256-prod-github-runner-207 kernel: [64760.585052] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 23:23:06 juju-e4d256-prod-github-runner-207 kernel: [64760.586123] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 23:23:06 juju-e4d256-prod-github-runner-207 kernel: [64760.587178] Aug 22 23:23:06 juju-e4d256-prod-github-runner-207 kernel: [64760.588029] Aug 22 23:23:06 juju-e4d256-prod-github-runner-207 kernel: [64760.588864] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 23:23:06 juju-e4d256-prod-github-runner-207 kernel: [64760.589903] ? native_queued_spin_lock_slowpath+0xc/0x40 Aug 22 23:23:06 juju-e4d256-prod-github-runner-207 kernel: [64760.590944] ? _raw_spin_lock+0x22/0x30 Aug 22 23:23:06 juju-e4d256-prod-github-runner-207 kernel: [64760.591885] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:23:06 juju-e4d256-prod-github-runner-207 kernel: [64760.592906] direct_page_fault+0x206/0x310 [kvm] Aug 22 23:23:06 juju-e4d256-prod-github-runner-207 kernel: [64760.593927] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 23:23:06 juju-e4d256-prod-github-runner-207 kernel: [64760.594946] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 23:23:06 juju-e4d256-prod-github-runner-207 kernel: [64760.595946] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 23:23:06 juju-e4d256-prod-github-runner-207 kernel: [64760.596948] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 23:23:06 juju-e4d256-prod-github-runner-207 kernel: [64760.597890] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 23:23:06 juju-e4d256-prod-github-runner-207 kernel: [64760.598880] handle_exit+0x98/0x230 [kvm_amd] Aug 22 23:23:06 juju-e4d256-prod-github-runner-207 kernel: [64760.599772] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 23:23:06 juju-e4d256-prod-github-runner-207 kernel: [64760.600682] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 23:23:06 juju-e4d256-prod-github-runner-207 kernel: [64760.601619] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 23:23:06 juju-e4d256-prod-github-runner-207 kernel: [64760.602550] vcpu_run+0x62/0x2c0 [kvm] Aug 22 23:23:06 juju-e4d256-prod-github-runner-207 kernel: [64760.603363] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 23:23:06 juju-e4d256-prod-github-runner-207 kernel: [64760.604172] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 23:23:06 juju-e4d256-prod-github-runner-207 kernel: [64760.605050] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 23:23:06 juju-e4d256-prod-github-runner-207 kernel: [64760.605847] ? __seccomp_filter+0x4a/0x4a0 Aug 22 23:23:06 juju-e4d256-prod-github-runner-207 kernel: [64760.606597] ? __fget_files+0x86/0xc0 Aug 22 23:23:06 juju-e4d256-prod-github-runner-207 kernel: [64760.607370] __x64_sys_ioctl+0x95/0xd0 Aug 22 23:23:06 juju-e4d256-prod-github-runner-207 kernel: [64760.608072] do_syscall_64+0x5c/0xc0 Aug 22 23:23:06 juju-e4d256-prod-github-runner-207 kernel: [64760.608737] ? do_futex+0x162/0x1f0 Aug 22 23:23:06 juju-e4d256-prod-github-runner-207 kernel: [64760.609385] ? __x64_sys_futex+0x78/0x1e0 Aug 22 23:23:06 juju-e4d256-prod-github-runner-207 kernel: [64760.610056] ? __secure_computing+0xa9/0x120 Aug 22 23:23:06 juju-e4d256-prod-github-runner-207 kernel: [64760.610756] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 23:23:06 juju-e4d256-prod-github-runner-207 kernel: [64760.611520] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:23:06 juju-e4d256-prod-github-runner-207 kernel: [64760.612239] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:23:06 juju-e4d256-prod-github-runner-207 kernel: [64760.612960] ? do_syscall_64+0x69/0xc0 Aug 22 23:23:06 juju-e4d256-prod-github-runner-207 kernel: [64760.613603] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:23:06 juju-e4d256-prod-github-runner-207 kernel: [64760.614320] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:23:06 juju-e4d256-prod-github-runner-207 kernel: [64760.615017] ? do_syscall_64+0x69/0xc0 Aug 22 23:23:06 juju-e4d256-prod-github-runner-207 kernel: [64760.615640] ? do_syscall_64+0x69/0xc0 Aug 22 23:23:06 juju-e4d256-prod-github-runner-207 kernel: [64760.616261] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 23:23:06 juju-e4d256-prod-github-runner-207 kernel: [64760.616964] RIP: 0033:0x7faa5d0edaff Aug 22 23:23:06 juju-e4d256-prod-github-runner-207 kernel: [64760.617626] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 23:23:06 juju-e4d256-prod-github-runner-207 kernel: [64760.619646] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 23:23:06 juju-e4d256-prod-github-runner-207 kernel: [64760.620559] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 23:23:06 juju-e4d256-prod-github-runner-207 kernel: [64760.621448] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 23:23:06 juju-e4d256-prod-github-runner-207 kernel: [64760.622350] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 23:23:06 juju-e4d256-prod-github-runner-207 kernel: [64760.623241] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 23:23:06 juju-e4d256-prod-github-runner-207 kernel: [64760.624126] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 23:23:06 juju-e4d256-prod-github-runner-207 kernel: [64760.625020] Aug 22 23:23:34 juju-e4d256-prod-github-runner-207 kernel: [64788.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 60231s! [qemu-system-x86:6715] Aug 22 23:23:34 juju-e4d256-prod-github-runner-207 kernel: [64788.543102] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 23:23:34 juju-e4d256-prod-github-runner-207 kernel: [64788.543174] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 23:23:34 juju-e4d256-prod-github-runner-207 kernel: [64788.555649] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 23:23:34 juju-e4d256-prod-github-runner-207 kernel: [64788.556914] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 23:23:34 juju-e4d256-prod-github-runner-207 kernel: [64788.558152] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:23:34 juju-e4d256-prod-github-runner-207 kernel: [64788.559219] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 23:23:34 juju-e4d256-prod-github-runner-207 kernel: [64788.561778] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 23:23:34 juju-e4d256-prod-github-runner-207 kernel: [64788.562837] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 23:23:34 juju-e4d256-prod-github-runner-207 kernel: [64788.564001] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 23:23:34 juju-e4d256-prod-github-runner-207 kernel: [64788.565169] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 23:23:34 juju-e4d256-prod-github-runner-207 kernel: [64788.566350] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 23:23:34 juju-e4d256-prod-github-runner-207 kernel: [64788.567514] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 23:23:34 juju-e4d256-prod-github-runner-207 kernel: [64788.568682] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 23:23:34 juju-e4d256-prod-github-runner-207 kernel: [64788.569924] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 23:23:34 juju-e4d256-prod-github-runner-207 kernel: [64788.571068] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 23:23:34 juju-e4d256-prod-github-runner-207 kernel: [64788.572265] Call Trace: Aug 22 23:23:34 juju-e4d256-prod-github-runner-207 kernel: [64788.573179] Aug 22 23:23:34 juju-e4d256-prod-github-runner-207 kernel: [64788.574078] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:23:34 juju-e4d256-prod-github-runner-207 kernel: [64788.575112] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:23:34 juju-e4d256-prod-github-runner-207 kernel: [64788.576133] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:23:34 juju-e4d256-prod-github-runner-207 kernel: [64788.577213] ? show_regs.part.0+0x23/0x29 Aug 22 23:23:34 juju-e4d256-prod-github-runner-207 kernel: [64788.578220] ? show_regs.cold+0x8/0xd Aug 22 23:23:34 juju-e4d256-prod-github-runner-207 kernel: [64788.579197] ? watchdog_timer_fn+0x1be/0x220 Aug 22 23:23:34 juju-e4d256-prod-github-runner-207 kernel: [64788.580204] ? lockup_detector_update_enable+0x60/0x60 Aug 22 23:23:34 juju-e4d256-prod-github-runner-207 kernel: [64788.581265] ? __hrtimer_run_queues+0x107/0x230 Aug 22 23:23:34 juju-e4d256-prod-github-runner-207 kernel: [64788.582305] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 23:23:34 juju-e4d256-prod-github-runner-207 kernel: [64788.583333] ? hrtimer_interrupt+0x101/0x220 Aug 22 23:23:34 juju-e4d256-prod-github-runner-207 kernel: [64788.584347] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 23:23:34 juju-e4d256-prod-github-runner-207 kernel: [64788.585416] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 23:23:34 juju-e4d256-prod-github-runner-207 kernel: [64788.586477] Aug 22 23:23:34 juju-e4d256-prod-github-runner-207 kernel: [64788.587346] Aug 22 23:23:34 juju-e4d256-prod-github-runner-207 kernel: [64788.588185] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 23:23:34 juju-e4d256-prod-github-runner-207 kernel: [64788.589221] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:23:34 juju-e4d256-prod-github-runner-207 kernel: [64788.590278] ? _raw_spin_lock+0x22/0x30 Aug 22 23:23:34 juju-e4d256-prod-github-runner-207 kernel: [64788.591229] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:23:34 juju-e4d256-prod-github-runner-207 kernel: [64788.592251] direct_page_fault+0x206/0x310 [kvm] Aug 22 23:23:34 juju-e4d256-prod-github-runner-207 kernel: [64788.593281] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 23:23:34 juju-e4d256-prod-github-runner-207 kernel: [64788.594305] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 23:23:34 juju-e4d256-prod-github-runner-207 kernel: [64788.595323] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 23:23:34 juju-e4d256-prod-github-runner-207 kernel: [64788.596296] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 23:23:34 juju-e4d256-prod-github-runner-207 kernel: [64788.597244] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 23:23:34 juju-e4d256-prod-github-runner-207 kernel: [64788.598236] handle_exit+0x98/0x230 [kvm_amd] Aug 22 23:23:34 juju-e4d256-prod-github-runner-207 kernel: [64788.599131] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 23:23:34 juju-e4d256-prod-github-runner-207 kernel: [64788.600044] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 23:23:34 juju-e4d256-prod-github-runner-207 kernel: [64788.601005] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 23:23:34 juju-e4d256-prod-github-runner-207 kernel: [64788.601916] vcpu_run+0x62/0x2c0 [kvm] Aug 22 23:23:34 juju-e4d256-prod-github-runner-207 kernel: [64788.602736] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 23:23:34 juju-e4d256-prod-github-runner-207 kernel: [64788.603544] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 23:23:34 juju-e4d256-prod-github-runner-207 kernel: [64788.604398] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 23:23:34 juju-e4d256-prod-github-runner-207 kernel: [64788.605195] ? __seccomp_filter+0x4a/0x4a0 Aug 22 23:23:34 juju-e4d256-prod-github-runner-207 kernel: [64788.605936] ? __fget_files+0x86/0xc0 Aug 22 23:23:34 juju-e4d256-prod-github-runner-207 kernel: [64788.606646] __x64_sys_ioctl+0x95/0xd0 Aug 22 23:23:34 juju-e4d256-prod-github-runner-207 kernel: [64788.607339] do_syscall_64+0x5c/0xc0 Aug 22 23:23:34 juju-e4d256-prod-github-runner-207 kernel: [64788.608003] ? do_futex+0x162/0x1f0 Aug 22 23:23:34 juju-e4d256-prod-github-runner-207 kernel: [64788.608656] ? __x64_sys_futex+0x78/0x1e0 Aug 22 23:23:34 juju-e4d256-prod-github-runner-207 kernel: [64788.609368] ? __secure_computing+0xa9/0x120 Aug 22 23:23:34 juju-e4d256-prod-github-runner-207 kernel: [64788.610069] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 23:23:34 juju-e4d256-prod-github-runner-207 kernel: [64788.610838] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:23:34 juju-e4d256-prod-github-runner-207 kernel: [64788.611558] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:23:34 juju-e4d256-prod-github-runner-207 kernel: [64788.612274] ? do_syscall_64+0x69/0xc0 Aug 22 23:23:34 juju-e4d256-prod-github-runner-207 kernel: [64788.612918] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:23:34 juju-e4d256-prod-github-runner-207 kernel: [64788.613626] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:23:34 juju-e4d256-prod-github-runner-207 kernel: [64788.614331] ? do_syscall_64+0x69/0xc0 Aug 22 23:23:34 juju-e4d256-prod-github-runner-207 kernel: [64788.614956] ? do_syscall_64+0x69/0xc0 Aug 22 23:23:34 juju-e4d256-prod-github-runner-207 kernel: [64788.615582] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 23:23:34 juju-e4d256-prod-github-runner-207 kernel: [64788.616286] RIP: 0033:0x7faa5d0edaff Aug 22 23:23:34 juju-e4d256-prod-github-runner-207 kernel: [64788.616931] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 23:23:34 juju-e4d256-prod-github-runner-207 kernel: [64788.618937] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 23:23:34 juju-e4d256-prod-github-runner-207 kernel: [64788.619846] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 23:23:34 juju-e4d256-prod-github-runner-207 kernel: [64788.620734] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 23:23:34 juju-e4d256-prod-github-runner-207 kernel: [64788.621624] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 23:23:34 juju-e4d256-prod-github-runner-207 kernel: [64788.622516] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 23:23:34 juju-e4d256-prod-github-runner-207 kernel: [64788.623408] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 23:23:34 juju-e4d256-prod-github-runner-207 kernel: [64788.624441] Aug 22 23:23:47 juju-e4d256-prod-github-runner-207 kernel: [64801.508709] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 23:23:47 juju-e4d256-prod-github-runner-207 kernel: [64801.509674] rcu: 1-....: (16120097 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=7782361 Aug 22 23:23:47 juju-e4d256-prod-github-runner-207 kernel: [64801.510818] (t=16171077 jiffies g=23269 q=57041) Aug 22 23:23:47 juju-e4d256-prod-github-runner-207 kernel: [64801.511620] NMI backtrace for cpu 1 Aug 22 23:23:47 juju-e4d256-prod-github-runner-207 kernel: [64801.512355] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 23:23:47 juju-e4d256-prod-github-runner-207 kernel: [64801.513464] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 23:23:47 juju-e4d256-prod-github-runner-207 kernel: [64801.514547] Call Trace: Aug 22 23:23:47 juju-e4d256-prod-github-runner-207 kernel: [64801.515222] Aug 22 23:23:47 juju-e4d256-prod-github-runner-207 kernel: [64801.515867] show_stack+0x52/0x5c Aug 22 23:23:47 juju-e4d256-prod-github-runner-207 kernel: [64801.516606] dump_stack_lvl+0x4a/0x63 Aug 22 23:23:47 juju-e4d256-prod-github-runner-207 kernel: [64801.517361] dump_stack+0x10/0x16 Aug 22 23:23:47 juju-e4d256-prod-github-runner-207 kernel: [64801.518124] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 23:23:47 juju-e4d256-prod-github-runner-207 kernel: [64801.518909] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 23:23:47 juju-e4d256-prod-github-runner-207 kernel: [64801.519692] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 23:23:47 juju-e4d256-prod-github-runner-207 kernel: [64801.520510] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 23:23:47 juju-e4d256-prod-github-runner-207 kernel: [64801.521330] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 23:23:47 juju-e4d256-prod-github-runner-207 kernel: [64801.522164] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 23:23:47 juju-e4d256-prod-github-runner-207 kernel: [64801.522952] print_cpu_stall.cold+0x2f/0xe2 Aug 22 23:23:47 juju-e4d256-prod-github-runner-207 kernel: [64801.523720] ? timekeeping_update+0xf7/0x150 Aug 22 23:23:47 juju-e4d256-prod-github-runner-207 kernel: [64801.524489] check_cpu_stall+0x109/0x270 Aug 22 23:23:47 juju-e4d256-prod-github-runner-207 kernel: [64801.525234] rcu_sched_clock_irq+0x9a/0x250 Aug 22 23:23:47 juju-e4d256-prod-github-runner-207 kernel: [64801.526011] update_process_times+0x94/0xd0 Aug 22 23:23:47 juju-e4d256-prod-github-runner-207 kernel: [64801.526781] tick_sched_handle+0x29/0x70 Aug 22 23:23:47 juju-e4d256-prod-github-runner-207 kernel: [64801.527536] tick_sched_timer+0x8c/0xc0 Aug 22 23:23:47 juju-e4d256-prod-github-runner-207 kernel: [64801.528292] ? tick_nohz_handler+0xb0/0xb0 Aug 22 23:23:47 juju-e4d256-prod-github-runner-207 kernel: [64801.529068] __hrtimer_run_queues+0x107/0x230 Aug 22 23:23:47 juju-e4d256-prod-github-runner-207 kernel: [64801.529875] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 23:23:47 juju-e4d256-prod-github-runner-207 kernel: [64801.530650] hrtimer_interrupt+0x101/0x220 Aug 22 23:23:47 juju-e4d256-prod-github-runner-207 kernel: [64801.531407] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 23:23:47 juju-e4d256-prod-github-runner-207 kernel: [64801.532235] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 23:23:47 juju-e4d256-prod-github-runner-207 kernel: [64801.533061] Aug 22 23:23:47 juju-e4d256-prod-github-runner-207 kernel: [64801.533705] Aug 22 23:23:47 juju-e4d256-prod-github-runner-207 kernel: [64801.534371] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 23:23:47 juju-e4d256-prod-github-runner-207 kernel: [64801.535191] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:23:47 juju-e4d256-prod-github-runner-207 kernel: [64801.536071] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 23:23:47 juju-e4d256-prod-github-runner-207 kernel: [64801.538324] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 23:23:47 juju-e4d256-prod-github-runner-207 kernel: [64801.539317] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 23:23:47 juju-e4d256-prod-github-runner-207 kernel: [64801.540318] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 23:23:47 juju-e4d256-prod-github-runner-207 kernel: [64801.541292] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 23:23:47 juju-e4d256-prod-github-runner-207 kernel: [64801.542281] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 23:23:47 juju-e4d256-prod-github-runner-207 kernel: [64801.543251] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 23:23:47 juju-e4d256-prod-github-runner-207 kernel: [64801.544223] ? _raw_spin_lock+0x22/0x30 Aug 22 23:23:47 juju-e4d256-prod-github-runner-207 kernel: [64801.544990] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:23:47 juju-e4d256-prod-github-runner-207 kernel: [64801.545854] direct_page_fault+0x206/0x310 [kvm] Aug 22 23:23:47 juju-e4d256-prod-github-runner-207 kernel: [64801.546694] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 23:23:47 juju-e4d256-prod-github-runner-207 kernel: [64801.547537] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 23:23:47 juju-e4d256-prod-github-runner-207 kernel: [64801.548389] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 23:23:47 juju-e4d256-prod-github-runner-207 kernel: [64801.549217] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 23:23:47 juju-e4d256-prod-github-runner-207 kernel: [64801.550032] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 23:23:47 juju-e4d256-prod-github-runner-207 kernel: [64801.550859] handle_exit+0x98/0x230 [kvm_amd] Aug 22 23:23:47 juju-e4d256-prod-github-runner-207 kernel: [64801.551619] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 23:23:47 juju-e4d256-prod-github-runner-207 kernel: [64801.552400] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 23:23:47 juju-e4d256-prod-github-runner-207 kernel: [64801.553216] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 23:23:47 juju-e4d256-prod-github-runner-207 kernel: [64801.554037] vcpu_run+0x62/0x2c0 [kvm] Aug 22 23:23:47 juju-e4d256-prod-github-runner-207 kernel: [64801.554778] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 23:23:47 juju-e4d256-prod-github-runner-207 kernel: [64801.555512] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 23:23:47 juju-e4d256-prod-github-runner-207 kernel: [64801.556311] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 23:23:47 juju-e4d256-prod-github-runner-207 kernel: [64801.557070] ? __seccomp_filter+0x4a/0x4a0 Aug 22 23:23:47 juju-e4d256-prod-github-runner-207 kernel: [64801.557823] ? __fget_files+0x86/0xc0 Aug 22 23:23:47 juju-e4d256-prod-github-runner-207 kernel: [64801.558566] __x64_sys_ioctl+0x95/0xd0 Aug 22 23:23:47 juju-e4d256-prod-github-runner-207 kernel: [64801.559295] do_syscall_64+0x5c/0xc0 Aug 22 23:23:47 juju-e4d256-prod-github-runner-207 kernel: [64801.559992] ? do_futex+0x162/0x1f0 Aug 22 23:23:47 juju-e4d256-prod-github-runner-207 kernel: [64801.560671] ? __x64_sys_futex+0x78/0x1e0 Aug 22 23:23:47 juju-e4d256-prod-github-runner-207 kernel: [64801.561369] ? __secure_computing+0xa9/0x120 Aug 22 23:23:47 juju-e4d256-prod-github-runner-207 kernel: [64801.562103] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 23:23:47 juju-e4d256-prod-github-runner-207 kernel: [64801.562907] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:23:47 juju-e4d256-prod-github-runner-207 kernel: [64801.563674] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:23:47 juju-e4d256-prod-github-runner-207 kernel: [64801.564442] ? do_syscall_64+0x69/0xc0 Aug 22 23:23:47 juju-e4d256-prod-github-runner-207 kernel: [64801.565148] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:23:47 juju-e4d256-prod-github-runner-207 kernel: [64801.565930] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:23:47 juju-e4d256-prod-github-runner-207 kernel: [64801.566686] ? do_syscall_64+0x69/0xc0 Aug 22 23:23:47 juju-e4d256-prod-github-runner-207 kernel: [64801.567412] ? do_syscall_64+0x69/0xc0 Aug 22 23:23:47 juju-e4d256-prod-github-runner-207 kernel: [64801.568117] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 23:23:47 juju-e4d256-prod-github-runner-207 kernel: [64801.568908] RIP: 0033:0x7faa5d0edaff Aug 22 23:23:47 juju-e4d256-prod-github-runner-207 kernel: [64801.569613] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 23:23:47 juju-e4d256-prod-github-runner-207 kernel: [64801.571748] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 23:23:47 juju-e4d256-prod-github-runner-207 kernel: [64801.572714] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 23:23:47 juju-e4d256-prod-github-runner-207 kernel: [64801.573683] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 23:23:47 juju-e4d256-prod-github-runner-207 kernel: [64801.574651] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 23:23:47 juju-e4d256-prod-github-runner-207 kernel: [64801.575630] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 23:23:47 juju-e4d256-prod-github-runner-207 kernel: [64801.576556] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 23:23:47 juju-e4d256-prod-github-runner-207 kernel: [64801.577468] Aug 22 23:24:14 juju-e4d256-prod-github-runner-207 kernel: [64828.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 60268s! [qemu-system-x86:6715] Aug 22 23:24:14 juju-e4d256-prod-github-runner-207 kernel: [64828.543134] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 23:24:14 juju-e4d256-prod-github-runner-207 kernel: [64828.543208] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 23:24:14 juju-e4d256-prod-github-runner-207 kernel: [64828.555340] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 23:24:14 juju-e4d256-prod-github-runner-207 kernel: [64828.556600] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 23:24:14 juju-e4d256-prod-github-runner-207 kernel: [64828.557833] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:24:14 juju-e4d256-prod-github-runner-207 kernel: [64828.558911] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 23:24:14 juju-e4d256-prod-github-runner-207 kernel: [64828.561469] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 23:24:14 juju-e4d256-prod-github-runner-207 kernel: [64828.562515] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 23:24:14 juju-e4d256-prod-github-runner-207 kernel: [64828.563691] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 23:24:14 juju-e4d256-prod-github-runner-207 kernel: [64828.564859] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 23:24:14 juju-e4d256-prod-github-runner-207 kernel: [64828.566055] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 23:24:14 juju-e4d256-prod-github-runner-207 kernel: [64828.567217] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 23:24:14 juju-e4d256-prod-github-runner-207 kernel: [64828.568402] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 23:24:14 juju-e4d256-prod-github-runner-207 kernel: [64828.569670] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 23:24:14 juju-e4d256-prod-github-runner-207 kernel: [64828.570820] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 23:24:14 juju-e4d256-prod-github-runner-207 kernel: [64828.572144] Call Trace: Aug 22 23:24:14 juju-e4d256-prod-github-runner-207 kernel: [64828.573217] Aug 22 23:24:14 juju-e4d256-prod-github-runner-207 kernel: [64828.574289] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:24:14 juju-e4d256-prod-github-runner-207 kernel: [64828.575325] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:24:14 juju-e4d256-prod-github-runner-207 kernel: [64828.576350] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:24:14 juju-e4d256-prod-github-runner-207 kernel: [64828.577422] ? show_regs.part.0+0x23/0x29 Aug 22 23:24:14 juju-e4d256-prod-github-runner-207 kernel: [64828.578618] ? show_regs.cold+0x8/0xd Aug 22 23:24:14 juju-e4d256-prod-github-runner-207 kernel: [64828.579810] ? watchdog_timer_fn+0x1be/0x220 Aug 22 23:24:14 juju-e4d256-prod-github-runner-207 kernel: [64828.580825] ? lockup_detector_update_enable+0x60/0x60 Aug 22 23:24:14 juju-e4d256-prod-github-runner-207 kernel: [64828.581921] ? __hrtimer_run_queues+0x107/0x230 Aug 22 23:24:14 juju-e4d256-prod-github-runner-207 kernel: [64828.582959] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 23:24:14 juju-e4d256-prod-github-runner-207 kernel: [64828.583982] ? hrtimer_interrupt+0x101/0x220 Aug 22 23:24:14 juju-e4d256-prod-github-runner-207 kernel: [64828.585077] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 23:24:14 juju-e4d256-prod-github-runner-207 kernel: [64828.586185] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 23:24:14 juju-e4d256-prod-github-runner-207 kernel: [64828.587244] Aug 22 23:24:14 juju-e4d256-prod-github-runner-207 kernel: [64828.588105] Aug 22 23:24:14 juju-e4d256-prod-github-runner-207 kernel: [64828.588960] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 23:24:14 juju-e4d256-prod-github-runner-207 kernel: [64828.590038] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:24:14 juju-e4d256-prod-github-runner-207 kernel: [64828.591082] ? _raw_spin_lock+0x22/0x30 Aug 22 23:24:14 juju-e4d256-prod-github-runner-207 kernel: [64828.592065] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:24:14 juju-e4d256-prod-github-runner-207 kernel: [64828.593099] direct_page_fault+0x206/0x310 [kvm] Aug 22 23:24:14 juju-e4d256-prod-github-runner-207 kernel: [64828.594151] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 23:24:14 juju-e4d256-prod-github-runner-207 kernel: [64828.595201] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 23:24:14 juju-e4d256-prod-github-runner-207 kernel: [64828.596541] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 23:24:14 juju-e4d256-prod-github-runner-207 kernel: [64828.597563] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 23:24:14 juju-e4d256-prod-github-runner-207 kernel: [64828.598555] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 23:24:14 juju-e4d256-prod-github-runner-207 kernel: [64828.599586] handle_exit+0x98/0x230 [kvm_amd] Aug 22 23:24:14 juju-e4d256-prod-github-runner-207 kernel: [64828.600516] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 23:24:14 juju-e4d256-prod-github-runner-207 kernel: [64828.601440] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 23:24:14 juju-e4d256-prod-github-runner-207 kernel: [64828.602394] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 23:24:14 juju-e4d256-prod-github-runner-207 kernel: [64828.603302] vcpu_run+0x62/0x2c0 [kvm] Aug 22 23:24:14 juju-e4d256-prod-github-runner-207 kernel: [64828.604118] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 23:24:14 juju-e4d256-prod-github-runner-207 kernel: [64828.604940] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 23:24:14 juju-e4d256-prod-github-runner-207 kernel: [64828.605821] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 23:24:14 juju-e4d256-prod-github-runner-207 kernel: [64828.606623] ? __seccomp_filter+0x4a/0x4a0 Aug 22 23:24:14 juju-e4d256-prod-github-runner-207 kernel: [64828.607382] ? __fget_files+0x86/0xc0 Aug 22 23:24:14 juju-e4d256-prod-github-runner-207 kernel: [64828.608090] __x64_sys_ioctl+0x95/0xd0 Aug 22 23:24:14 juju-e4d256-prod-github-runner-207 kernel: [64828.608793] do_syscall_64+0x5c/0xc0 Aug 22 23:24:14 juju-e4d256-prod-github-runner-207 kernel: [64828.609472] ? do_futex+0x162/0x1f0 Aug 22 23:24:14 juju-e4d256-prod-github-runner-207 kernel: [64828.610152] ? __x64_sys_futex+0x78/0x1e0 Aug 22 23:24:14 juju-e4d256-prod-github-runner-207 kernel: [64828.610847] ? __secure_computing+0xa9/0x120 Aug 22 23:24:14 juju-e4d256-prod-github-runner-207 kernel: [64828.611542] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 23:24:14 juju-e4d256-prod-github-runner-207 kernel: [64828.612308] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:24:14 juju-e4d256-prod-github-runner-207 kernel: [64828.613040] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:24:14 juju-e4d256-prod-github-runner-207 kernel: [64828.613778] ? do_syscall_64+0x69/0xc0 Aug 22 23:24:14 juju-e4d256-prod-github-runner-207 kernel: [64828.614428] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:24:14 juju-e4d256-prod-github-runner-207 kernel: [64828.615136] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:24:14 juju-e4d256-prod-github-runner-207 kernel: [64828.615849] ? do_syscall_64+0x69/0xc0 Aug 22 23:24:14 juju-e4d256-prod-github-runner-207 kernel: [64828.616477] ? do_syscall_64+0x69/0xc0 Aug 22 23:24:14 juju-e4d256-prod-github-runner-207 kernel: [64828.617102] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 23:24:14 juju-e4d256-prod-github-runner-207 kernel: [64828.617855] RIP: 0033:0x7faa5d0edaff Aug 22 23:24:14 juju-e4d256-prod-github-runner-207 kernel: [64828.618579] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 23:24:14 juju-e4d256-prod-github-runner-207 kernel: [64828.620673] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 23:24:14 juju-e4d256-prod-github-runner-207 kernel: [64828.621608] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 23:24:14 juju-e4d256-prod-github-runner-207 kernel: [64828.622505] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 23:24:14 juju-e4d256-prod-github-runner-207 kernel: [64828.623401] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 23:24:14 juju-e4d256-prod-github-runner-207 kernel: [64828.624297] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 23:24:14 juju-e4d256-prod-github-runner-207 kernel: [64828.625191] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 23:24:14 juju-e4d256-prod-github-runner-207 kernel: [64828.626132] Aug 22 23:24:42 juju-e4d256-prod-github-runner-207 kernel: [64856.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 60294s! [qemu-system-x86:6715] Aug 22 23:24:42 juju-e4d256-prod-github-runner-207 kernel: [64856.543891] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 23:24:42 juju-e4d256-prod-github-runner-207 kernel: [64856.544206] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 23:24:42 juju-e4d256-prod-github-runner-207 kernel: [64856.556713] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 23:24:42 juju-e4d256-prod-github-runner-207 kernel: [64856.558027] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 23:24:42 juju-e4d256-prod-github-runner-207 kernel: [64856.559263] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:24:42 juju-e4d256-prod-github-runner-207 kernel: [64856.560322] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 23:24:42 juju-e4d256-prod-github-runner-207 kernel: [64856.562885] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 23:24:42 juju-e4d256-prod-github-runner-207 kernel: [64856.563927] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 23:24:42 juju-e4d256-prod-github-runner-207 kernel: [64856.565088] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 23:24:42 juju-e4d256-prod-github-runner-207 kernel: [64856.566264] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 23:24:42 juju-e4d256-prod-github-runner-207 kernel: [64856.567424] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 23:24:42 juju-e4d256-prod-github-runner-207 kernel: [64856.568598] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 23:24:42 juju-e4d256-prod-github-runner-207 kernel: [64856.569800] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 23:24:42 juju-e4d256-prod-github-runner-207 kernel: [64856.571038] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 23:24:42 juju-e4d256-prod-github-runner-207 kernel: [64856.572138] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 23:24:42 juju-e4d256-prod-github-runner-207 kernel: [64856.573341] Call Trace: Aug 22 23:24:42 juju-e4d256-prod-github-runner-207 kernel: [64856.574254] Aug 22 23:24:42 juju-e4d256-prod-github-runner-207 kernel: [64856.575154] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:24:42 juju-e4d256-prod-github-runner-207 kernel: [64856.576183] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:24:42 juju-e4d256-prod-github-runner-207 kernel: [64856.577218] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:24:42 juju-e4d256-prod-github-runner-207 kernel: [64856.578316] ? show_regs.part.0+0x23/0x29 Aug 22 23:24:42 juju-e4d256-prod-github-runner-207 kernel: [64856.579319] ? show_regs.cold+0x8/0xd Aug 22 23:24:42 juju-e4d256-prod-github-runner-207 kernel: [64856.580415] ? watchdog_timer_fn+0x1be/0x220 Aug 22 23:24:42 juju-e4d256-prod-github-runner-207 kernel: [64856.581437] ? lockup_detector_update_enable+0x60/0x60 Aug 22 23:24:42 juju-e4d256-prod-github-runner-207 kernel: [64856.582500] ? __hrtimer_run_queues+0x107/0x230 Aug 22 23:24:42 juju-e4d256-prod-github-runner-207 kernel: [64856.583533] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 23:24:42 juju-e4d256-prod-github-runner-207 kernel: [64856.584596] ? hrtimer_interrupt+0x101/0x220 Aug 22 23:24:42 juju-e4d256-prod-github-runner-207 kernel: [64856.585772] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 23:24:42 juju-e4d256-prod-github-runner-207 kernel: [64856.586839] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 23:24:42 juju-e4d256-prod-github-runner-207 kernel: [64856.587889] Aug 22 23:24:42 juju-e4d256-prod-github-runner-207 kernel: [64856.589300] Aug 22 23:24:42 juju-e4d256-prod-github-runner-207 kernel: [64856.590365] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 23:24:42 juju-e4d256-prod-github-runner-207 kernel: [64856.591444] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:24:42 juju-e4d256-prod-github-runner-207 kernel: [64856.592481] ? _raw_spin_lock+0x22/0x30 Aug 22 23:24:42 juju-e4d256-prod-github-runner-207 kernel: [64856.593436] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:24:42 juju-e4d256-prod-github-runner-207 kernel: [64856.594455] direct_page_fault+0x206/0x310 [kvm] Aug 22 23:24:42 juju-e4d256-prod-github-runner-207 kernel: [64856.595477] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 23:24:42 juju-e4d256-prod-github-runner-207 kernel: [64856.596482] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 23:24:42 juju-e4d256-prod-github-runner-207 kernel: [64856.597659] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 23:24:42 juju-e4d256-prod-github-runner-207 kernel: [64856.598670] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 23:24:42 juju-e4d256-prod-github-runner-207 kernel: [64856.599965] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 23:24:42 juju-e4d256-prod-github-runner-207 kernel: [64856.601000] handle_exit+0x98/0x230 [kvm_amd] Aug 22 23:24:42 juju-e4d256-prod-github-runner-207 kernel: [64856.601923] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 23:24:42 juju-e4d256-prod-github-runner-207 kernel: [64856.602846] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 23:24:42 juju-e4d256-prod-github-runner-207 kernel: [64856.603769] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 23:24:42 juju-e4d256-prod-github-runner-207 kernel: [64856.604693] vcpu_run+0x62/0x2c0 [kvm] Aug 22 23:24:42 juju-e4d256-prod-github-runner-207 kernel: [64856.605533] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 23:24:42 juju-e4d256-prod-github-runner-207 kernel: [64856.606341] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 23:24:42 juju-e4d256-prod-github-runner-207 kernel: [64856.607193] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 23:24:42 juju-e4d256-prod-github-runner-207 kernel: [64856.607988] ? __seccomp_filter+0x4a/0x4a0 Aug 22 23:24:42 juju-e4d256-prod-github-runner-207 kernel: [64856.608734] ? __fget_files+0x86/0xc0 Aug 22 23:24:42 juju-e4d256-prod-github-runner-207 kernel: [64856.609464] __x64_sys_ioctl+0x95/0xd0 Aug 22 23:24:42 juju-e4d256-prod-github-runner-207 kernel: [64856.610157] do_syscall_64+0x5c/0xc0 Aug 22 23:24:42 juju-e4d256-prod-github-runner-207 kernel: [64856.610820] ? do_futex+0x162/0x1f0 Aug 22 23:24:42 juju-e4d256-prod-github-runner-207 kernel: [64856.611467] ? __x64_sys_futex+0x78/0x1e0 Aug 22 23:24:42 juju-e4d256-prod-github-runner-207 kernel: [64856.612139] ? __secure_computing+0xa9/0x120 Aug 22 23:24:42 juju-e4d256-prod-github-runner-207 kernel: [64856.612827] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 23:24:42 juju-e4d256-prod-github-runner-207 kernel: [64856.613596] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:24:42 juju-e4d256-prod-github-runner-207 kernel: [64856.614321] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:24:42 juju-e4d256-prod-github-runner-207 kernel: [64856.615037] ? do_syscall_64+0x69/0xc0 Aug 22 23:24:42 juju-e4d256-prod-github-runner-207 kernel: [64856.615719] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:24:42 juju-e4d256-prod-github-runner-207 kernel: [64856.616423] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:24:42 juju-e4d256-prod-github-runner-207 kernel: [64856.617129] ? do_syscall_64+0x69/0xc0 Aug 22 23:24:42 juju-e4d256-prod-github-runner-207 kernel: [64856.617754] ? do_syscall_64+0x69/0xc0 Aug 22 23:24:42 juju-e4d256-prod-github-runner-207 kernel: [64856.618375] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 23:24:42 juju-e4d256-prod-github-runner-207 kernel: [64856.619107] RIP: 0033:0x7faa5d0edaff Aug 22 23:24:42 juju-e4d256-prod-github-runner-207 kernel: [64856.619787] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 23:24:42 juju-e4d256-prod-github-runner-207 kernel: [64856.621780] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 23:24:42 juju-e4d256-prod-github-runner-207 kernel: [64856.622692] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 23:24:42 juju-e4d256-prod-github-runner-207 kernel: [64856.623722] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 23:24:42 juju-e4d256-prod-github-runner-207 kernel: [64856.624891] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 23:24:42 juju-e4d256-prod-github-runner-207 kernel: [64856.625842] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 23:24:42 juju-e4d256-prod-github-runner-207 kernel: [64856.626735] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 23:24:42 juju-e4d256-prod-github-runner-207 kernel: [64856.627624] Aug 22 23:25:10 juju-e4d256-prod-github-runner-207 kernel: [64884.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 60320s! [qemu-system-x86:6715] Aug 22 23:25:10 juju-e4d256-prod-github-runner-207 kernel: [64884.543097] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 23:25:10 juju-e4d256-prod-github-runner-207 kernel: [64884.543169] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 23:25:10 juju-e4d256-prod-github-runner-207 kernel: [64884.555495] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 23:25:10 juju-e4d256-prod-github-runner-207 kernel: [64884.556774] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 23:25:10 juju-e4d256-prod-github-runner-207 kernel: [64884.558001] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:25:10 juju-e4d256-prod-github-runner-207 kernel: [64884.559089] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 23:25:10 juju-e4d256-prod-github-runner-207 kernel: [64884.561670] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 23:25:10 juju-e4d256-prod-github-runner-207 kernel: [64884.562739] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 23:25:10 juju-e4d256-prod-github-runner-207 kernel: [64884.563910] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 23:25:10 juju-e4d256-prod-github-runner-207 kernel: [64884.565087] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 23:25:10 juju-e4d256-prod-github-runner-207 kernel: [64884.566254] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 23:25:10 juju-e4d256-prod-github-runner-207 kernel: [64884.567417] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 23:25:10 juju-e4d256-prod-github-runner-207 kernel: [64884.568620] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 23:25:10 juju-e4d256-prod-github-runner-207 kernel: [64884.569895] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 23:25:10 juju-e4d256-prod-github-runner-207 kernel: [64884.571006] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 23:25:10 juju-e4d256-prod-github-runner-207 kernel: [64884.572210] Call Trace: Aug 22 23:25:10 juju-e4d256-prod-github-runner-207 kernel: [64884.573138] Aug 22 23:25:10 juju-e4d256-prod-github-runner-207 kernel: [64884.574035] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:25:10 juju-e4d256-prod-github-runner-207 kernel: [64884.575120] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:25:10 juju-e4d256-prod-github-runner-207 kernel: [64884.576182] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:25:10 juju-e4d256-prod-github-runner-207 kernel: [64884.577308] ? show_regs.part.0+0x23/0x29 Aug 22 23:25:10 juju-e4d256-prod-github-runner-207 kernel: [64884.578308] ? show_regs.cold+0x8/0xd Aug 22 23:25:10 juju-e4d256-prod-github-runner-207 kernel: [64884.579282] ? watchdog_timer_fn+0x1be/0x220 Aug 22 23:25:10 juju-e4d256-prod-github-runner-207 kernel: [64884.580377] ? lockup_detector_update_enable+0x60/0x60 Aug 22 23:25:10 juju-e4d256-prod-github-runner-207 kernel: [64884.581537] ? __hrtimer_run_queues+0x107/0x230 Aug 22 23:25:10 juju-e4d256-prod-github-runner-207 kernel: [64884.582580] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 23:25:10 juju-e4d256-prod-github-runner-207 kernel: [64884.583611] ? hrtimer_interrupt+0x101/0x220 Aug 22 23:25:10 juju-e4d256-prod-github-runner-207 kernel: [64884.584626] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 23:25:10 juju-e4d256-prod-github-runner-207 kernel: [64884.585729] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 23:25:10 juju-e4d256-prod-github-runner-207 kernel: [64884.586782] Aug 22 23:25:10 juju-e4d256-prod-github-runner-207 kernel: [64884.587651] Aug 22 23:25:10 juju-e4d256-prod-github-runner-207 kernel: [64884.588515] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 23:25:10 juju-e4d256-prod-github-runner-207 kernel: [64884.589600] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:25:10 juju-e4d256-prod-github-runner-207 kernel: [64884.590750] ? _raw_spin_lock+0x22/0x30 Aug 22 23:25:10 juju-e4d256-prod-github-runner-207 kernel: [64884.591707] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:25:10 juju-e4d256-prod-github-runner-207 kernel: [64884.592730] direct_page_fault+0x206/0x310 [kvm] Aug 22 23:25:10 juju-e4d256-prod-github-runner-207 kernel: [64884.593793] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 23:25:10 juju-e4d256-prod-github-runner-207 kernel: [64884.594811] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 23:25:10 juju-e4d256-prod-github-runner-207 kernel: [64884.595816] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 23:25:10 juju-e4d256-prod-github-runner-207 kernel: [64884.596819] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 23:25:10 juju-e4d256-prod-github-runner-207 kernel: [64884.597780] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 23:25:10 juju-e4d256-prod-github-runner-207 kernel: [64884.598786] handle_exit+0x98/0x230 [kvm_amd] Aug 22 23:25:10 juju-e4d256-prod-github-runner-207 kernel: [64884.599684] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 23:25:10 juju-e4d256-prod-github-runner-207 kernel: [64884.600607] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 23:25:10 juju-e4d256-prod-github-runner-207 kernel: [64884.601552] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 23:25:10 juju-e4d256-prod-github-runner-207 kernel: [64884.602471] vcpu_run+0x62/0x2c0 [kvm] Aug 22 23:25:10 juju-e4d256-prod-github-runner-207 kernel: [64884.603285] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 23:25:10 juju-e4d256-prod-github-runner-207 kernel: [64884.604093] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 23:25:10 juju-e4d256-prod-github-runner-207 kernel: [64884.604961] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 23:25:10 juju-e4d256-prod-github-runner-207 kernel: [64884.605762] ? __seccomp_filter+0x4a/0x4a0 Aug 22 23:25:10 juju-e4d256-prod-github-runner-207 kernel: [64884.606505] ? __fget_files+0x86/0xc0 Aug 22 23:25:10 juju-e4d256-prod-github-runner-207 kernel: [64884.607210] __x64_sys_ioctl+0x95/0xd0 Aug 22 23:25:10 juju-e4d256-prod-github-runner-207 kernel: [64884.607902] do_syscall_64+0x5c/0xc0 Aug 22 23:25:10 juju-e4d256-prod-github-runner-207 kernel: [64884.608570] ? do_futex+0x162/0x1f0 Aug 22 23:25:10 juju-e4d256-prod-github-runner-207 kernel: [64884.609244] ? __x64_sys_futex+0x78/0x1e0 Aug 22 23:25:10 juju-e4d256-prod-github-runner-207 kernel: [64884.609918] ? __secure_computing+0xa9/0x120 Aug 22 23:25:10 juju-e4d256-prod-github-runner-207 kernel: [64884.610797] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 23:25:10 juju-e4d256-prod-github-runner-207 kernel: [64884.611557] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:25:10 juju-e4d256-prod-github-runner-207 kernel: [64884.612278] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:25:10 juju-e4d256-prod-github-runner-207 kernel: [64884.613006] ? do_syscall_64+0x69/0xc0 Aug 22 23:25:10 juju-e4d256-prod-github-runner-207 kernel: [64884.613652] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:25:10 juju-e4d256-prod-github-runner-207 kernel: [64884.614358] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:25:10 juju-e4d256-prod-github-runner-207 kernel: [64884.615054] ? do_syscall_64+0x69/0xc0 Aug 22 23:25:10 juju-e4d256-prod-github-runner-207 kernel: [64884.615708] ? do_syscall_64+0x69/0xc0 Aug 22 23:25:10 juju-e4d256-prod-github-runner-207 kernel: [64884.616334] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 23:25:10 juju-e4d256-prod-github-runner-207 kernel: [64884.617089] RIP: 0033:0x7faa5d0edaff Aug 22 23:25:10 juju-e4d256-prod-github-runner-207 kernel: [64884.617730] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 23:25:10 juju-e4d256-prod-github-runner-207 kernel: [64884.619798] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 23:25:10 juju-e4d256-prod-github-runner-207 kernel: [64884.620722] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 23:25:10 juju-e4d256-prod-github-runner-207 kernel: [64884.621807] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 23:25:10 juju-e4d256-prod-github-runner-207 kernel: [64884.622725] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 23:25:10 juju-e4d256-prod-github-runner-207 kernel: [64884.623621] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 23:25:10 juju-e4d256-prod-github-runner-207 kernel: [64884.624568] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 23:25:10 juju-e4d256-prod-github-runner-207 kernel: [64884.625496] Aug 22 23:25:38 juju-e4d256-prod-github-runner-207 kernel: [64912.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 60346s! [qemu-system-x86:6715] Aug 22 23:25:38 juju-e4d256-prod-github-runner-207 kernel: [64912.543126] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 23:25:38 juju-e4d256-prod-github-runner-207 kernel: [64912.543202] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 23:25:38 juju-e4d256-prod-github-runner-207 kernel: [64912.555665] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 23:25:38 juju-e4d256-prod-github-runner-207 kernel: [64912.556937] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 23:25:38 juju-e4d256-prod-github-runner-207 kernel: [64912.558163] RIP: 0010:native_queued_spin_lock_slowpath+0xc/0x40 Aug 22 23:25:38 juju-e4d256-prod-github-runner-207 kernel: [64912.559217] Code: fe ff ff eb af 4c 89 fe 48 c7 c7 20 99 e9 89 e8 ca 69 55 00 e9 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 <8b> 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 eb Aug 22 23:25:38 juju-e4d256-prod-github-runner-207 kernel: [64912.561778] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 23:25:38 juju-e4d256-prod-github-runner-207 kernel: [64912.562824] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 23:25:38 juju-e4d256-prod-github-runner-207 kernel: [64912.563986] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 23:25:38 juju-e4d256-prod-github-runner-207 kernel: [64912.565157] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 23:25:38 juju-e4d256-prod-github-runner-207 kernel: [64912.566332] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 23:25:38 juju-e4d256-prod-github-runner-207 kernel: [64912.567504] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 23:25:38 juju-e4d256-prod-github-runner-207 kernel: [64912.568684] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 23:25:38 juju-e4d256-prod-github-runner-207 kernel: [64912.569934] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 23:25:38 juju-e4d256-prod-github-runner-207 kernel: [64912.571035] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 23:25:38 juju-e4d256-prod-github-runner-207 kernel: [64912.572227] Call Trace: Aug 22 23:25:38 juju-e4d256-prod-github-runner-207 kernel: [64912.573156] Aug 22 23:25:38 juju-e4d256-prod-github-runner-207 kernel: [64912.574180] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:25:38 juju-e4d256-prod-github-runner-207 kernel: [64912.575213] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:25:38 juju-e4d256-prod-github-runner-207 kernel: [64912.576237] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:25:38 juju-e4d256-prod-github-runner-207 kernel: [64912.577349] ? show_regs.part.0+0x23/0x29 Aug 22 23:25:38 juju-e4d256-prod-github-runner-207 kernel: [64912.578364] ? show_regs.cold+0x8/0xd Aug 22 23:25:38 juju-e4d256-prod-github-runner-207 kernel: [64912.579337] ? watchdog_timer_fn+0x1be/0x220 Aug 22 23:25:38 juju-e4d256-prod-github-runner-207 kernel: [64912.580355] ? lockup_detector_update_enable+0x60/0x60 Aug 22 23:25:38 juju-e4d256-prod-github-runner-207 kernel: [64912.581446] ? __hrtimer_run_queues+0x107/0x230 Aug 22 23:25:38 juju-e4d256-prod-github-runner-207 kernel: [64912.582481] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 23:25:38 juju-e4d256-prod-github-runner-207 kernel: [64912.583505] ? hrtimer_interrupt+0x101/0x220 Aug 22 23:25:38 juju-e4d256-prod-github-runner-207 kernel: [64912.584534] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 23:25:38 juju-e4d256-prod-github-runner-207 kernel: [64912.585621] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 23:25:38 juju-e4d256-prod-github-runner-207 kernel: [64912.586673] Aug 22 23:25:38 juju-e4d256-prod-github-runner-207 kernel: [64912.587531] Aug 22 23:25:38 juju-e4d256-prod-github-runner-207 kernel: [64912.588380] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 23:25:38 juju-e4d256-prod-github-runner-207 kernel: [64912.589424] ? native_queued_spin_lock_slowpath+0xc/0x40 Aug 22 23:25:38 juju-e4d256-prod-github-runner-207 kernel: [64912.590887] ? _raw_spin_lock+0x22/0x30 Aug 22 23:25:38 juju-e4d256-prod-github-runner-207 kernel: [64912.591867] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:25:38 juju-e4d256-prod-github-runner-207 kernel: [64912.592931] direct_page_fault+0x206/0x310 [kvm] Aug 22 23:25:38 juju-e4d256-prod-github-runner-207 kernel: [64912.594004] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 23:25:38 juju-e4d256-prod-github-runner-207 kernel: [64912.595365] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 23:25:38 juju-e4d256-prod-github-runner-207 kernel: [64912.596384] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 23:25:38 juju-e4d256-prod-github-runner-207 kernel: [64912.597372] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 23:25:38 juju-e4d256-prod-github-runner-207 kernel: [64912.598321] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 23:25:38 juju-e4d256-prod-github-runner-207 kernel: [64912.599305] handle_exit+0x98/0x230 [kvm_amd] Aug 22 23:25:38 juju-e4d256-prod-github-runner-207 kernel: [64912.600199] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 23:25:38 juju-e4d256-prod-github-runner-207 kernel: [64912.601125] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 23:25:38 juju-e4d256-prod-github-runner-207 kernel: [64912.602048] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 23:25:38 juju-e4d256-prod-github-runner-207 kernel: [64912.602950] vcpu_run+0x62/0x2c0 [kvm] Aug 22 23:25:38 juju-e4d256-prod-github-runner-207 kernel: [64912.603759] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 23:25:38 juju-e4d256-prod-github-runner-207 kernel: [64912.604583] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 23:25:38 juju-e4d256-prod-github-runner-207 kernel: [64912.605437] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 23:25:38 juju-e4d256-prod-github-runner-207 kernel: [64912.606233] ? __seccomp_filter+0x4a/0x4a0 Aug 22 23:25:38 juju-e4d256-prod-github-runner-207 kernel: [64912.606980] ? __fget_files+0x86/0xc0 Aug 22 23:25:38 juju-e4d256-prod-github-runner-207 kernel: [64912.607690] __x64_sys_ioctl+0x95/0xd0 Aug 22 23:25:38 juju-e4d256-prod-github-runner-207 kernel: [64912.608381] do_syscall_64+0x5c/0xc0 Aug 22 23:25:38 juju-e4d256-prod-github-runner-207 kernel: [64912.609062] ? do_futex+0x162/0x1f0 Aug 22 23:25:38 juju-e4d256-prod-github-runner-207 kernel: [64912.609711] ? __x64_sys_futex+0x78/0x1e0 Aug 22 23:25:38 juju-e4d256-prod-github-runner-207 kernel: [64912.610381] ? __secure_computing+0xa9/0x120 Aug 22 23:25:38 juju-e4d256-prod-github-runner-207 kernel: [64912.611069] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 23:25:38 juju-e4d256-prod-github-runner-207 kernel: [64912.611845] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:25:38 juju-e4d256-prod-github-runner-207 kernel: [64912.612600] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:25:38 juju-e4d256-prod-github-runner-207 kernel: [64912.613320] ? do_syscall_64+0x69/0xc0 Aug 22 23:25:38 juju-e4d256-prod-github-runner-207 kernel: [64912.613982] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:25:38 juju-e4d256-prod-github-runner-207 kernel: [64912.614687] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:25:38 juju-e4d256-prod-github-runner-207 kernel: [64912.615420] ? do_syscall_64+0x69/0xc0 Aug 22 23:25:38 juju-e4d256-prod-github-runner-207 kernel: [64912.616070] ? do_syscall_64+0x69/0xc0 Aug 22 23:25:38 juju-e4d256-prod-github-runner-207 kernel: [64912.616748] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 23:25:38 juju-e4d256-prod-github-runner-207 kernel: [64912.617484] RIP: 0033:0x7faa5d0edaff Aug 22 23:25:38 juju-e4d256-prod-github-runner-207 kernel: [64912.618165] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 23:25:38 juju-e4d256-prod-github-runner-207 kernel: [64912.620622] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 23:25:38 juju-e4d256-prod-github-runner-207 kernel: [64912.621547] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 23:25:38 juju-e4d256-prod-github-runner-207 kernel: [64912.622435] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 23:25:38 juju-e4d256-prod-github-runner-207 kernel: [64912.623322] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 23:25:38 juju-e4d256-prod-github-runner-207 kernel: [64912.624228] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 23:25:38 juju-e4d256-prod-github-runner-207 kernel: [64912.625135] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 23:25:38 juju-e4d256-prod-github-runner-207 kernel: [64912.626027] Aug 22 23:26:06 juju-e4d256-prod-github-runner-207 kernel: [64940.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 60372s! [qemu-system-x86:6715] Aug 22 23:26:06 juju-e4d256-prod-github-runner-207 kernel: [64940.543861] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 23:26:06 juju-e4d256-prod-github-runner-207 kernel: [64940.544189] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 23:26:06 juju-e4d256-prod-github-runner-207 kernel: [64940.556333] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 23:26:06 juju-e4d256-prod-github-runner-207 kernel: [64940.557604] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 23:26:06 juju-e4d256-prod-github-runner-207 kernel: [64940.558828] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:26:06 juju-e4d256-prod-github-runner-207 kernel: [64940.559889] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 23:26:06 juju-e4d256-prod-github-runner-207 kernel: [64940.562467] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 23:26:06 juju-e4d256-prod-github-runner-207 kernel: [64940.563529] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 23:26:06 juju-e4d256-prod-github-runner-207 kernel: [64940.564695] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 23:26:06 juju-e4d256-prod-github-runner-207 kernel: [64940.565859] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 23:26:06 juju-e4d256-prod-github-runner-207 kernel: [64940.567017] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 23:26:06 juju-e4d256-prod-github-runner-207 kernel: [64940.568200] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 23:26:06 juju-e4d256-prod-github-runner-207 kernel: [64940.569373] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 23:26:06 juju-e4d256-prod-github-runner-207 kernel: [64940.570608] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 23:26:06 juju-e4d256-prod-github-runner-207 kernel: [64940.571751] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 23:26:06 juju-e4d256-prod-github-runner-207 kernel: [64940.572971] Call Trace: Aug 22 23:26:06 juju-e4d256-prod-github-runner-207 kernel: [64940.573881] Aug 22 23:26:06 juju-e4d256-prod-github-runner-207 kernel: [64940.574774] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:26:06 juju-e4d256-prod-github-runner-207 kernel: [64940.575817] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:26:06 juju-e4d256-prod-github-runner-207 kernel: [64940.576847] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:26:06 juju-e4d256-prod-github-runner-207 kernel: [64940.577942] ? show_regs.part.0+0x23/0x29 Aug 22 23:26:06 juju-e4d256-prod-github-runner-207 kernel: [64940.578945] ? show_regs.cold+0x8/0xd Aug 22 23:26:06 juju-e4d256-prod-github-runner-207 kernel: [64940.579918] ? watchdog_timer_fn+0x1be/0x220 Aug 22 23:26:06 juju-e4d256-prod-github-runner-207 kernel: [64940.580936] ? lockup_detector_update_enable+0x60/0x60 Aug 22 23:26:06 juju-e4d256-prod-github-runner-207 kernel: [64940.582003] ? __hrtimer_run_queues+0x107/0x230 Aug 22 23:26:06 juju-e4d256-prod-github-runner-207 kernel: [64940.583030] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 23:26:06 juju-e4d256-prod-github-runner-207 kernel: [64940.584065] ? hrtimer_interrupt+0x101/0x220 Aug 22 23:26:06 juju-e4d256-prod-github-runner-207 kernel: [64940.585085] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 23:26:06 juju-e4d256-prod-github-runner-207 kernel: [64940.586153] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 23:26:06 juju-e4d256-prod-github-runner-207 kernel: [64940.587214] Aug 22 23:26:06 juju-e4d256-prod-github-runner-207 kernel: [64940.588086] Aug 22 23:26:06 juju-e4d256-prod-github-runner-207 kernel: [64940.588921] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 23:26:06 juju-e4d256-prod-github-runner-207 kernel: [64940.589956] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:26:06 juju-e4d256-prod-github-runner-207 kernel: [64940.591091] ? _raw_spin_lock+0x22/0x30 Aug 22 23:26:06 juju-e4d256-prod-github-runner-207 kernel: [64940.592038] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:26:06 juju-e4d256-prod-github-runner-207 kernel: [64940.593073] direct_page_fault+0x206/0x310 [kvm] Aug 22 23:26:06 juju-e4d256-prod-github-runner-207 kernel: [64940.594095] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 23:26:06 juju-e4d256-prod-github-runner-207 kernel: [64940.595109] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 23:26:06 juju-e4d256-prod-github-runner-207 kernel: [64940.596120] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 23:26:06 juju-e4d256-prod-github-runner-207 kernel: [64940.597126] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 23:26:06 juju-e4d256-prod-github-runner-207 kernel: [64940.598074] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 23:26:06 juju-e4d256-prod-github-runner-207 kernel: [64940.599053] handle_exit+0x98/0x230 [kvm_amd] Aug 22 23:26:06 juju-e4d256-prod-github-runner-207 kernel: [64940.599946] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 23:26:06 juju-e4d256-prod-github-runner-207 kernel: [64940.600869] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 23:26:06 juju-e4d256-prod-github-runner-207 kernel: [64940.601818] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 23:26:06 juju-e4d256-prod-github-runner-207 kernel: [64940.602725] vcpu_run+0x62/0x2c0 [kvm] Aug 22 23:26:06 juju-e4d256-prod-github-runner-207 kernel: [64940.603535] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 23:26:06 juju-e4d256-prod-github-runner-207 kernel: [64940.604520] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 23:26:06 juju-e4d256-prod-github-runner-207 kernel: [64940.605376] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 23:26:06 juju-e4d256-prod-github-runner-207 kernel: [64940.606185] ? __seccomp_filter+0x4a/0x4a0 Aug 22 23:26:06 juju-e4d256-prod-github-runner-207 kernel: [64940.606937] ? __fget_files+0x86/0xc0 Aug 22 23:26:06 juju-e4d256-prod-github-runner-207 kernel: [64940.607639] __x64_sys_ioctl+0x95/0xd0 Aug 22 23:26:06 juju-e4d256-prod-github-runner-207 kernel: [64940.608344] do_syscall_64+0x5c/0xc0 Aug 22 23:26:06 juju-e4d256-prod-github-runner-207 kernel: [64940.609014] ? do_futex+0x162/0x1f0 Aug 22 23:26:06 juju-e4d256-prod-github-runner-207 kernel: [64940.609691] ? __x64_sys_futex+0x78/0x1e0 Aug 22 23:26:06 juju-e4d256-prod-github-runner-207 kernel: [64940.610454] ? __secure_computing+0xa9/0x120 Aug 22 23:26:06 juju-e4d256-prod-github-runner-207 kernel: [64940.611152] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 23:26:06 juju-e4d256-prod-github-runner-207 kernel: [64940.611919] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:26:06 juju-e4d256-prod-github-runner-207 kernel: [64940.612661] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:26:06 juju-e4d256-prod-github-runner-207 kernel: [64940.613378] ? do_syscall_64+0x69/0xc0 Aug 22 23:26:06 juju-e4d256-prod-github-runner-207 kernel: [64940.614027] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:26:06 juju-e4d256-prod-github-runner-207 kernel: [64940.614735] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:26:06 juju-e4d256-prod-github-runner-207 kernel: [64940.615429] ? do_syscall_64+0x69/0xc0 Aug 22 23:26:06 juju-e4d256-prod-github-runner-207 kernel: [64940.616053] ? do_syscall_64+0x69/0xc0 Aug 22 23:26:06 juju-e4d256-prod-github-runner-207 kernel: [64940.616703] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 23:26:06 juju-e4d256-prod-github-runner-207 kernel: [64940.617446] RIP: 0033:0x7faa5d0edaff Aug 22 23:26:06 juju-e4d256-prod-github-runner-207 kernel: [64940.618174] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 23:26:06 juju-e4d256-prod-github-runner-207 kernel: [64940.620239] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 23:26:06 juju-e4d256-prod-github-runner-207 kernel: [64940.621179] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 23:26:06 juju-e4d256-prod-github-runner-207 kernel: [64940.622128] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 23:26:06 juju-e4d256-prod-github-runner-207 kernel: [64940.623023] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 23:26:06 juju-e4d256-prod-github-runner-207 kernel: [64940.623913] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 23:26:06 juju-e4d256-prod-github-runner-207 kernel: [64940.624809] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 23:26:06 juju-e4d256-prod-github-runner-207 kernel: [64940.625698] Aug 22 23:26:34 juju-e4d256-prod-github-runner-207 kernel: [64968.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 60398s! [qemu-system-x86:6715] Aug 22 23:26:34 juju-e4d256-prod-github-runner-207 kernel: [64968.543164] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 23:26:34 juju-e4d256-prod-github-runner-207 kernel: [64968.543246] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 23:26:34 juju-e4d256-prod-github-runner-207 kernel: [64968.555330] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 23:26:34 juju-e4d256-prod-github-runner-207 kernel: [64968.556602] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 23:26:34 juju-e4d256-prod-github-runner-207 kernel: [64968.557824] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:26:34 juju-e4d256-prod-github-runner-207 kernel: [64968.558899] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 23:26:34 juju-e4d256-prod-github-runner-207 kernel: [64968.561587] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 23:26:34 juju-e4d256-prod-github-runner-207 kernel: [64968.562673] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 23:26:34 juju-e4d256-prod-github-runner-207 kernel: [64968.563885] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 23:26:34 juju-e4d256-prod-github-runner-207 kernel: [64968.565053] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 23:26:34 juju-e4d256-prod-github-runner-207 kernel: [64968.566216] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 23:26:34 juju-e4d256-prod-github-runner-207 kernel: [64968.567377] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 23:26:34 juju-e4d256-prod-github-runner-207 kernel: [64968.568564] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 23:26:34 juju-e4d256-prod-github-runner-207 kernel: [64968.569796] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 23:26:34 juju-e4d256-prod-github-runner-207 kernel: [64968.570897] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 23:26:34 juju-e4d256-prod-github-runner-207 kernel: [64968.572108] Call Trace: Aug 22 23:26:34 juju-e4d256-prod-github-runner-207 kernel: [64968.573022] Aug 22 23:26:34 juju-e4d256-prod-github-runner-207 kernel: [64968.573908] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:26:34 juju-e4d256-prod-github-runner-207 kernel: [64968.574940] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:26:34 juju-e4d256-prod-github-runner-207 kernel: [64968.575972] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:26:34 juju-e4d256-prod-github-runner-207 kernel: [64968.577053] ? show_regs.part.0+0x23/0x29 Aug 22 23:26:34 juju-e4d256-prod-github-runner-207 kernel: [64968.578060] ? show_regs.cold+0x8/0xd Aug 22 23:26:34 juju-e4d256-prod-github-runner-207 kernel: [64968.579056] ? watchdog_timer_fn+0x1be/0x220 Aug 22 23:26:34 juju-e4d256-prod-github-runner-207 kernel: [64968.580163] ? lockup_detector_update_enable+0x60/0x60 Aug 22 23:26:34 juju-e4d256-prod-github-runner-207 kernel: [64968.581242] ? __hrtimer_run_queues+0x107/0x230 Aug 22 23:26:34 juju-e4d256-prod-github-runner-207 kernel: [64968.582280] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 23:26:34 juju-e4d256-prod-github-runner-207 kernel: [64968.583352] ? hrtimer_interrupt+0x101/0x220 Aug 22 23:26:34 juju-e4d256-prod-github-runner-207 kernel: [64968.584393] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 23:26:34 juju-e4d256-prod-github-runner-207 kernel: [64968.585569] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 23:26:34 juju-e4d256-prod-github-runner-207 kernel: [64968.586660] Aug 22 23:26:34 juju-e4d256-prod-github-runner-207 kernel: [64968.587520] Aug 22 23:26:34 juju-e4d256-prod-github-runner-207 kernel: [64968.588373] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 23:26:34 juju-e4d256-prod-github-runner-207 kernel: [64968.589424] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:26:34 juju-e4d256-prod-github-runner-207 kernel: [64968.590475] ? _raw_spin_lock+0x22/0x30 Aug 22 23:26:34 juju-e4d256-prod-github-runner-207 kernel: [64968.591475] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:26:34 juju-e4d256-prod-github-runner-207 kernel: [64968.592652] direct_page_fault+0x206/0x310 [kvm] Aug 22 23:26:34 juju-e4d256-prod-github-runner-207 kernel: [64968.593782] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 23:26:34 juju-e4d256-prod-github-runner-207 kernel: [64968.594932] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 23:26:34 juju-e4d256-prod-github-runner-207 kernel: [64968.596066] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 23:26:34 juju-e4d256-prod-github-runner-207 kernel: [64968.597130] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 23:26:34 juju-e4d256-prod-github-runner-207 kernel: [64968.598170] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 23:26:34 juju-e4d256-prod-github-runner-207 kernel: [64968.599252] handle_exit+0x98/0x230 [kvm_amd] Aug 22 23:26:34 juju-e4d256-prod-github-runner-207 kernel: [64968.600300] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 23:26:34 juju-e4d256-prod-github-runner-207 kernel: [64968.601327] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 23:26:34 juju-e4d256-prod-github-runner-207 kernel: [64968.602348] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 23:26:34 juju-e4d256-prod-github-runner-207 kernel: [64968.603343] vcpu_run+0x62/0x2c0 [kvm] Aug 22 23:26:34 juju-e4d256-prod-github-runner-207 kernel: [64968.604245] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 23:26:34 juju-e4d256-prod-github-runner-207 kernel: [64968.605136] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 23:26:34 juju-e4d256-prod-github-runner-207 kernel: [64968.606082] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 23:26:34 juju-e4d256-prod-github-runner-207 kernel: [64968.606964] ? __seccomp_filter+0x4a/0x4a0 Aug 22 23:26:34 juju-e4d256-prod-github-runner-207 kernel: [64968.607807] ? __fget_files+0x86/0xc0 Aug 22 23:26:34 juju-e4d256-prod-github-runner-207 kernel: [64968.608585] __x64_sys_ioctl+0x95/0xd0 Aug 22 23:26:34 juju-e4d256-prod-github-runner-207 kernel: [64968.609350] do_syscall_64+0x5c/0xc0 Aug 22 23:26:34 juju-e4d256-prod-github-runner-207 kernel: [64968.610087] ? do_futex+0x162/0x1f0 Aug 22 23:26:34 juju-e4d256-prod-github-runner-207 kernel: [64968.610804] ? __x64_sys_futex+0x78/0x1e0 Aug 22 23:26:34 juju-e4d256-prod-github-runner-207 kernel: [64968.611562] ? __secure_computing+0xa9/0x120 Aug 22 23:26:34 juju-e4d256-prod-github-runner-207 kernel: [64968.612345] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 23:26:34 juju-e4d256-prod-github-runner-207 kernel: [64968.613216] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:26:34 juju-e4d256-prod-github-runner-207 kernel: [64968.614036] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:26:34 juju-e4d256-prod-github-runner-207 kernel: [64968.614846] ? do_syscall_64+0x69/0xc0 Aug 22 23:26:34 juju-e4d256-prod-github-runner-207 kernel: [64968.615563] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:26:34 juju-e4d256-prod-github-runner-207 kernel: [64968.616368] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:26:34 juju-e4d256-prod-github-runner-207 kernel: [64968.617159] ? do_syscall_64+0x69/0xc0 Aug 22 23:26:34 juju-e4d256-prod-github-runner-207 kernel: [64968.617861] ? do_syscall_64+0x69/0xc0 Aug 22 23:26:34 juju-e4d256-prod-github-runner-207 kernel: [64968.618556] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 23:26:34 juju-e4d256-prod-github-runner-207 kernel: [64968.619366] RIP: 0033:0x7faa5d0edaff Aug 22 23:26:34 juju-e4d256-prod-github-runner-207 kernel: [64968.620101] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 23:26:34 juju-e4d256-prod-github-runner-207 kernel: [64968.622413] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 23:26:34 juju-e4d256-prod-github-runner-207 kernel: [64968.623463] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 23:26:34 juju-e4d256-prod-github-runner-207 kernel: [64968.624497] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 23:26:34 juju-e4d256-prod-github-runner-207 kernel: [64968.625663] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 23:26:34 juju-e4d256-prod-github-runner-207 kernel: [64968.626692] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 23:26:34 juju-e4d256-prod-github-runner-207 kernel: [64968.627742] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 23:26:34 juju-e4d256-prod-github-runner-207 kernel: [64968.628769] Aug 22 23:26:47 juju-e4d256-prod-github-runner-207 kernel: [64981.520710] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 23:26:47 juju-e4d256-prod-github-runner-207 kernel: [64981.521682] rcu: 1-....: (16164963 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=7804053 Aug 22 23:26:47 juju-e4d256-prod-github-runner-207 kernel: [64981.522834] (t=16216080 jiffies g=23269 q=57224) Aug 22 23:26:47 juju-e4d256-prod-github-runner-207 kernel: [64981.523697] NMI backtrace for cpu 1 Aug 22 23:26:47 juju-e4d256-prod-github-runner-207 kernel: [64981.524412] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 23:26:47 juju-e4d256-prod-github-runner-207 kernel: [64981.525512] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 23:26:47 juju-e4d256-prod-github-runner-207 kernel: [64981.526571] Call Trace: Aug 22 23:26:47 juju-e4d256-prod-github-runner-207 kernel: [64981.527243] Aug 22 23:26:47 juju-e4d256-prod-github-runner-207 kernel: [64981.527909] show_stack+0x52/0x5c Aug 22 23:26:47 juju-e4d256-prod-github-runner-207 kernel: [64981.528643] dump_stack_lvl+0x4a/0x63 Aug 22 23:26:47 juju-e4d256-prod-github-runner-207 kernel: [64981.529387] dump_stack+0x10/0x16 Aug 22 23:26:47 juju-e4d256-prod-github-runner-207 kernel: [64981.530142] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 23:26:47 juju-e4d256-prod-github-runner-207 kernel: [64981.530932] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 23:26:47 juju-e4d256-prod-github-runner-207 kernel: [64981.531726] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 23:26:47 juju-e4d256-prod-github-runner-207 kernel: [64981.532546] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 23:26:47 juju-e4d256-prod-github-runner-207 kernel: [64981.533426] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 23:26:47 juju-e4d256-prod-github-runner-207 kernel: [64981.534325] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 23:26:47 juju-e4d256-prod-github-runner-207 kernel: [64981.535162] print_cpu_stall.cold+0x2f/0xe2 Aug 22 23:26:47 juju-e4d256-prod-github-runner-207 kernel: [64981.535964] ? timekeeping_update+0xf7/0x150 Aug 22 23:26:47 juju-e4d256-prod-github-runner-207 kernel: [64981.536742] check_cpu_stall+0x109/0x270 Aug 22 23:26:47 juju-e4d256-prod-github-runner-207 kernel: [64981.537492] rcu_sched_clock_irq+0x9a/0x250 Aug 22 23:26:47 juju-e4d256-prod-github-runner-207 kernel: [64981.538275] update_process_times+0x94/0xd0 Aug 22 23:26:47 juju-e4d256-prod-github-runner-207 kernel: [64981.539043] tick_sched_handle+0x29/0x70 Aug 22 23:26:47 juju-e4d256-prod-github-runner-207 kernel: [64981.539839] tick_sched_timer+0x8c/0xc0 Aug 22 23:26:47 juju-e4d256-prod-github-runner-207 kernel: [64981.540610] ? tick_nohz_handler+0xb0/0xb0 Aug 22 23:26:47 juju-e4d256-prod-github-runner-207 kernel: [64981.541375] __hrtimer_run_queues+0x107/0x230 Aug 22 23:26:47 juju-e4d256-prod-github-runner-207 kernel: [64981.542161] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 23:26:47 juju-e4d256-prod-github-runner-207 kernel: [64981.542945] hrtimer_interrupt+0x101/0x220 Aug 22 23:26:47 juju-e4d256-prod-github-runner-207 kernel: [64981.543756] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 23:26:47 juju-e4d256-prod-github-runner-207 kernel: [64981.544627] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 23:26:47 juju-e4d256-prod-github-runner-207 kernel: [64981.545450] Aug 22 23:26:47 juju-e4d256-prod-github-runner-207 kernel: [64981.546090] Aug 22 23:26:47 juju-e4d256-prod-github-runner-207 kernel: [64981.546722] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 23:26:47 juju-e4d256-prod-github-runner-207 kernel: [64981.547569] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:26:47 juju-e4d256-prod-github-runner-207 kernel: [64981.548642] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 23:26:47 juju-e4d256-prod-github-runner-207 kernel: [64981.550897] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 23:26:47 juju-e4d256-prod-github-runner-207 kernel: [64981.551793] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 23:26:47 juju-e4d256-prod-github-runner-207 kernel: [64981.552799] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 23:26:47 juju-e4d256-prod-github-runner-207 kernel: [64981.553820] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 23:26:47 juju-e4d256-prod-github-runner-207 kernel: [64981.554970] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 23:26:47 juju-e4d256-prod-github-runner-207 kernel: [64981.556037] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 23:26:47 juju-e4d256-prod-github-runner-207 kernel: [64981.557002] ? _raw_spin_lock+0x22/0x30 Aug 22 23:26:47 juju-e4d256-prod-github-runner-207 kernel: [64981.557765] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:26:47 juju-e4d256-prod-github-runner-207 kernel: [64981.558601] direct_page_fault+0x206/0x310 [kvm] Aug 22 23:26:47 juju-e4d256-prod-github-runner-207 kernel: [64981.559652] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 23:26:47 juju-e4d256-prod-github-runner-207 kernel: [64981.560504] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 23:26:47 juju-e4d256-prod-github-runner-207 kernel: [64981.561337] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 23:26:47 juju-e4d256-prod-github-runner-207 kernel: [64981.562140] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 23:26:47 juju-e4d256-prod-github-runner-207 kernel: [64981.562926] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 23:26:47 juju-e4d256-prod-github-runner-207 kernel: [64981.563809] handle_exit+0x98/0x230 [kvm_amd] Aug 22 23:26:47 juju-e4d256-prod-github-runner-207 kernel: [64981.564587] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 23:26:47 juju-e4d256-prod-github-runner-207 kernel: [64981.565421] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 23:26:47 juju-e4d256-prod-github-runner-207 kernel: [64981.566232] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 23:26:47 juju-e4d256-prod-github-runner-207 kernel: [64981.567018] vcpu_run+0x62/0x2c0 [kvm] Aug 22 23:26:47 juju-e4d256-prod-github-runner-207 kernel: [64981.567784] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 23:26:47 juju-e4d256-prod-github-runner-207 kernel: [64981.568528] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 23:26:47 juju-e4d256-prod-github-runner-207 kernel: [64981.569329] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 23:26:47 juju-e4d256-prod-github-runner-207 kernel: [64981.570108] ? __seccomp_filter+0x4a/0x4a0 Aug 22 23:26:47 juju-e4d256-prod-github-runner-207 kernel: [64981.570841] ? __fget_files+0x86/0xc0 Aug 22 23:26:47 juju-e4d256-prod-github-runner-207 kernel: [64981.571542] __x64_sys_ioctl+0x95/0xd0 Aug 22 23:26:47 juju-e4d256-prod-github-runner-207 kernel: [64981.572258] do_syscall_64+0x5c/0xc0 Aug 22 23:26:47 juju-e4d256-prod-github-runner-207 kernel: [64981.572939] ? do_futex+0x162/0x1f0 Aug 22 23:26:47 juju-e4d256-prod-github-runner-207 kernel: [64981.573619] ? __x64_sys_futex+0x78/0x1e0 Aug 22 23:26:47 juju-e4d256-prod-github-runner-207 kernel: [64981.574324] ? __secure_computing+0xa9/0x120 Aug 22 23:26:47 juju-e4d256-prod-github-runner-207 kernel: [64981.575050] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 23:26:47 juju-e4d256-prod-github-runner-207 kernel: [64981.575884] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:26:47 juju-e4d256-prod-github-runner-207 kernel: [64981.576644] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:26:47 juju-e4d256-prod-github-runner-207 kernel: [64981.577404] ? do_syscall_64+0x69/0xc0 Aug 22 23:26:47 juju-e4d256-prod-github-runner-207 kernel: [64981.578112] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:26:47 juju-e4d256-prod-github-runner-207 kernel: [64981.578874] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:26:47 juju-e4d256-prod-github-runner-207 kernel: [64981.579667] ? do_syscall_64+0x69/0xc0 Aug 22 23:26:47 juju-e4d256-prod-github-runner-207 kernel: [64981.580371] ? do_syscall_64+0x69/0xc0 Aug 22 23:26:47 juju-e4d256-prod-github-runner-207 kernel: [64981.581071] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 23:26:47 juju-e4d256-prod-github-runner-207 kernel: [64981.581850] RIP: 0033:0x7faa5d0edaff Aug 22 23:26:47 juju-e4d256-prod-github-runner-207 kernel: [64981.582538] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 23:26:47 juju-e4d256-prod-github-runner-207 kernel: [64981.584656] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 23:26:47 juju-e4d256-prod-github-runner-207 kernel: [64981.585635] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 23:26:47 juju-e4d256-prod-github-runner-207 kernel: [64981.586604] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 23:26:47 juju-e4d256-prod-github-runner-207 kernel: [64981.587565] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 23:26:47 juju-e4d256-prod-github-runner-207 kernel: [64981.588506] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 23:26:47 juju-e4d256-prod-github-runner-207 kernel: [64981.589436] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 23:26:47 juju-e4d256-prod-github-runner-207 kernel: [64981.590393] Aug 22 23:27:14 juju-e4d256-prod-github-runner-207 kernel: [65008.541980] watchdog: BUG: soft lockup - CPU#1 stuck for 60435s! [qemu-system-x86:6715] Aug 22 23:27:14 juju-e4d256-prod-github-runner-207 kernel: [65008.543124] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 23:27:14 juju-e4d256-prod-github-runner-207 kernel: [65008.543199] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 23:27:14 juju-e4d256-prod-github-runner-207 kernel: [65008.555831] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 23:27:14 juju-e4d256-prod-github-runner-207 kernel: [65008.557103] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 23:27:14 juju-e4d256-prod-github-runner-207 kernel: [65008.558329] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:27:14 juju-e4d256-prod-github-runner-207 kernel: [65008.559409] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 23:27:14 juju-e4d256-prod-github-runner-207 kernel: [65008.561966] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 23:27:14 juju-e4d256-prod-github-runner-207 kernel: [65008.563008] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 23:27:14 juju-e4d256-prod-github-runner-207 kernel: [65008.564178] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 23:27:14 juju-e4d256-prod-github-runner-207 kernel: [65008.565348] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 23:27:14 juju-e4d256-prod-github-runner-207 kernel: [65008.566514] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 23:27:14 juju-e4d256-prod-github-runner-207 kernel: [65008.567686] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 23:27:14 juju-e4d256-prod-github-runner-207 kernel: [65008.568859] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 23:27:14 juju-e4d256-prod-github-runner-207 kernel: [65008.570095] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 23:27:14 juju-e4d256-prod-github-runner-207 kernel: [65008.571194] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 23:27:14 juju-e4d256-prod-github-runner-207 kernel: [65008.572537] Call Trace: Aug 22 23:27:14 juju-e4d256-prod-github-runner-207 kernel: [65008.573467] Aug 22 23:27:14 juju-e4d256-prod-github-runner-207 kernel: [65008.574352] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:27:14 juju-e4d256-prod-github-runner-207 kernel: [65008.575427] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:27:14 juju-e4d256-prod-github-runner-207 kernel: [65008.576452] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:27:14 juju-e4d256-prod-github-runner-207 kernel: [65008.577529] ? show_regs.part.0+0x23/0x29 Aug 22 23:27:14 juju-e4d256-prod-github-runner-207 kernel: [65008.578562] ? show_regs.cold+0x8/0xd Aug 22 23:27:14 juju-e4d256-prod-github-runner-207 kernel: [65008.579556] ? watchdog_timer_fn+0x1be/0x220 Aug 22 23:27:14 juju-e4d256-prod-github-runner-207 kernel: [65008.580567] ? lockup_detector_update_enable+0x60/0x60 Aug 22 23:27:14 juju-e4d256-prod-github-runner-207 kernel: [65008.581658] ? __hrtimer_run_queues+0x107/0x230 Aug 22 23:27:14 juju-e4d256-prod-github-runner-207 kernel: [65008.582698] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 23:27:14 juju-e4d256-prod-github-runner-207 kernel: [65008.583747] ? hrtimer_interrupt+0x101/0x220 Aug 22 23:27:14 juju-e4d256-prod-github-runner-207 kernel: [65008.584766] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 23:27:14 juju-e4d256-prod-github-runner-207 kernel: [65008.585841] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 23:27:14 juju-e4d256-prod-github-runner-207 kernel: [65008.586931] Aug 22 23:27:14 juju-e4d256-prod-github-runner-207 kernel: [65008.587813] Aug 22 23:27:14 juju-e4d256-prod-github-runner-207 kernel: [65008.588651] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 23:27:14 juju-e4d256-prod-github-runner-207 kernel: [65008.589691] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:27:14 juju-e4d256-prod-github-runner-207 kernel: [65008.590773] ? _raw_spin_lock+0x22/0x30 Aug 22 23:27:14 juju-e4d256-prod-github-runner-207 kernel: [65008.591759] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:27:14 juju-e4d256-prod-github-runner-207 kernel: [65008.592790] direct_page_fault+0x206/0x310 [kvm] Aug 22 23:27:14 juju-e4d256-prod-github-runner-207 kernel: [65008.593815] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 23:27:14 juju-e4d256-prod-github-runner-207 kernel: [65008.594822] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 23:27:14 juju-e4d256-prod-github-runner-207 kernel: [65008.595839] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 23:27:14 juju-e4d256-prod-github-runner-207 kernel: [65008.596812] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 23:27:14 juju-e4d256-prod-github-runner-207 kernel: [65008.597757] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 23:27:14 juju-e4d256-prod-github-runner-207 kernel: [65008.598733] handle_exit+0x98/0x230 [kvm_amd] Aug 22 23:27:14 juju-e4d256-prod-github-runner-207 kernel: [65008.599635] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 23:27:14 juju-e4d256-prod-github-runner-207 kernel: [65008.600547] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 23:27:14 juju-e4d256-prod-github-runner-207 kernel: [65008.601471] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 23:27:14 juju-e4d256-prod-github-runner-207 kernel: [65008.602379] vcpu_run+0x62/0x2c0 [kvm] Aug 22 23:27:14 juju-e4d256-prod-github-runner-207 kernel: [65008.603192] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 23:27:14 juju-e4d256-prod-github-runner-207 kernel: [65008.604025] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 23:27:14 juju-e4d256-prod-github-runner-207 kernel: [65008.604884] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 23:27:14 juju-e4d256-prod-github-runner-207 kernel: [65008.605681] ? __seccomp_filter+0x4a/0x4a0 Aug 22 23:27:14 juju-e4d256-prod-github-runner-207 kernel: [65008.606424] ? __fget_files+0x86/0xc0 Aug 22 23:27:14 juju-e4d256-prod-github-runner-207 kernel: [65008.607128] __x64_sys_ioctl+0x95/0xd0 Aug 22 23:27:14 juju-e4d256-prod-github-runner-207 kernel: [65008.607832] do_syscall_64+0x5c/0xc0 Aug 22 23:27:14 juju-e4d256-prod-github-runner-207 kernel: [65008.608496] ? do_futex+0x162/0x1f0 Aug 22 23:27:14 juju-e4d256-prod-github-runner-207 kernel: [65008.609145] ? __x64_sys_futex+0x78/0x1e0 Aug 22 23:27:14 juju-e4d256-prod-github-runner-207 kernel: [65008.609817] ? __secure_computing+0xa9/0x120 Aug 22 23:27:14 juju-e4d256-prod-github-runner-207 kernel: [65008.610505] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 23:27:14 juju-e4d256-prod-github-runner-207 kernel: [65008.611274] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:27:14 juju-e4d256-prod-github-runner-207 kernel: [65008.611997] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:27:14 juju-e4d256-prod-github-runner-207 kernel: [65008.612716] ? do_syscall_64+0x69/0xc0 Aug 22 23:27:14 juju-e4d256-prod-github-runner-207 kernel: [65008.613371] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:27:14 juju-e4d256-prod-github-runner-207 kernel: [65008.614080] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:27:14 juju-e4d256-prod-github-runner-207 kernel: [65008.614773] ? do_syscall_64+0x69/0xc0 Aug 22 23:27:14 juju-e4d256-prod-github-runner-207 kernel: [65008.615409] ? do_syscall_64+0x69/0xc0 Aug 22 23:27:14 juju-e4d256-prod-github-runner-207 kernel: [65008.616032] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 23:27:14 juju-e4d256-prod-github-runner-207 kernel: [65008.616736] RIP: 0033:0x7faa5d0edaff Aug 22 23:27:14 juju-e4d256-prod-github-runner-207 kernel: [65008.617359] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 23:27:14 juju-e4d256-prod-github-runner-207 kernel: [65008.619367] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 23:27:14 juju-e4d256-prod-github-runner-207 kernel: [65008.620279] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 23:27:14 juju-e4d256-prod-github-runner-207 kernel: [65008.621175] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 23:27:14 juju-e4d256-prod-github-runner-207 kernel: [65008.622070] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 23:27:14 juju-e4d256-prod-github-runner-207 kernel: [65008.622962] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 23:27:14 juju-e4d256-prod-github-runner-207 kernel: [65008.623877] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 23:27:14 juju-e4d256-prod-github-runner-207 kernel: [65008.624767] Aug 22 23:27:42 juju-e4d256-prod-github-runner-207 kernel: [65036.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 60461s! [qemu-system-x86:6715] Aug 22 23:27:42 juju-e4d256-prod-github-runner-207 kernel: [65036.543885] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 23:27:42 juju-e4d256-prod-github-runner-207 kernel: [65036.544185] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 23:27:42 juju-e4d256-prod-github-runner-207 kernel: [65036.556607] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 23:27:42 juju-e4d256-prod-github-runner-207 kernel: [65036.557903] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 23:27:42 juju-e4d256-prod-github-runner-207 kernel: [65036.559158] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:27:42 juju-e4d256-prod-github-runner-207 kernel: [65036.560225] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 23:27:42 juju-e4d256-prod-github-runner-207 kernel: [65036.562811] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 23:27:42 juju-e4d256-prod-github-runner-207 kernel: [65036.563877] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 23:27:42 juju-e4d256-prod-github-runner-207 kernel: [65036.565057] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 23:27:42 juju-e4d256-prod-github-runner-207 kernel: [65036.566247] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 23:27:42 juju-e4d256-prod-github-runner-207 kernel: [65036.567456] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 23:27:42 juju-e4d256-prod-github-runner-207 kernel: [65036.568655] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 23:27:42 juju-e4d256-prod-github-runner-207 kernel: [65036.569867] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 23:27:42 juju-e4d256-prod-github-runner-207 kernel: [65036.571151] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 23:27:42 juju-e4d256-prod-github-runner-207 kernel: [65036.572261] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 23:27:42 juju-e4d256-prod-github-runner-207 kernel: [65036.573572] Call Trace: Aug 22 23:27:42 juju-e4d256-prod-github-runner-207 kernel: [65036.574750] Aug 22 23:27:42 juju-e4d256-prod-github-runner-207 kernel: [65036.575758] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:27:42 juju-e4d256-prod-github-runner-207 kernel: [65036.576911] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:27:42 juju-e4d256-prod-github-runner-207 kernel: [65036.578073] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:27:42 juju-e4d256-prod-github-runner-207 kernel: [65036.579371] ? show_regs.part.0+0x23/0x29 Aug 22 23:27:42 juju-e4d256-prod-github-runner-207 kernel: [65036.580505] ? show_regs.cold+0x8/0xd Aug 22 23:27:42 juju-e4d256-prod-github-runner-207 kernel: [65036.581614] ? watchdog_timer_fn+0x1be/0x220 Aug 22 23:27:42 juju-e4d256-prod-github-runner-207 kernel: [65036.582740] ? lockup_detector_update_enable+0x60/0x60 Aug 22 23:27:42 juju-e4d256-prod-github-runner-207 kernel: [65036.583877] ? __hrtimer_run_queues+0x107/0x230 Aug 22 23:27:42 juju-e4d256-prod-github-runner-207 kernel: [65036.584916] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 23:27:42 juju-e4d256-prod-github-runner-207 kernel: [65036.585949] ? hrtimer_interrupt+0x101/0x220 Aug 22 23:27:42 juju-e4d256-prod-github-runner-207 kernel: [65036.586999] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 23:27:42 juju-e4d256-prod-github-runner-207 kernel: [65036.588080] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 23:27:42 juju-e4d256-prod-github-runner-207 kernel: [65036.589150] Aug 22 23:27:42 juju-e4d256-prod-github-runner-207 kernel: [65036.590015] Aug 22 23:27:42 juju-e4d256-prod-github-runner-207 kernel: [65036.590857] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 23:27:42 juju-e4d256-prod-github-runner-207 kernel: [65036.591930] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:27:42 juju-e4d256-prod-github-runner-207 kernel: [65036.592978] ? _raw_spin_lock+0x22/0x30 Aug 22 23:27:42 juju-e4d256-prod-github-runner-207 kernel: [65036.593930] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:27:42 juju-e4d256-prod-github-runner-207 kernel: [65036.594985] direct_page_fault+0x206/0x310 [kvm] Aug 22 23:27:42 juju-e4d256-prod-github-runner-207 kernel: [65036.596021] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 23:27:42 juju-e4d256-prod-github-runner-207 kernel: [65036.597038] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 23:27:42 juju-e4d256-prod-github-runner-207 kernel: [65036.598048] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 23:27:42 juju-e4d256-prod-github-runner-207 kernel: [65036.599089] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 23:27:42 juju-e4d256-prod-github-runner-207 kernel: [65036.600044] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 23:27:42 juju-e4d256-prod-github-runner-207 kernel: [65036.601042] handle_exit+0x98/0x230 [kvm_amd] Aug 22 23:27:42 juju-e4d256-prod-github-runner-207 kernel: [65036.601951] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 23:27:42 juju-e4d256-prod-github-runner-207 kernel: [65036.603082] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 23:27:42 juju-e4d256-prod-github-runner-207 kernel: [65036.604017] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 23:27:42 juju-e4d256-prod-github-runner-207 kernel: [65036.604933] vcpu_run+0x62/0x2c0 [kvm] Aug 22 23:27:42 juju-e4d256-prod-github-runner-207 kernel: [65036.605758] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 23:27:42 juju-e4d256-prod-github-runner-207 kernel: [65036.606578] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 23:27:42 juju-e4d256-prod-github-runner-207 kernel: [65036.607462] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 23:27:42 juju-e4d256-prod-github-runner-207 kernel: [65036.608275] ? __seccomp_filter+0x4a/0x4a0 Aug 22 23:27:42 juju-e4d256-prod-github-runner-207 kernel: [65036.609026] ? __fget_files+0x86/0xc0 Aug 22 23:27:42 juju-e4d256-prod-github-runner-207 kernel: [65036.609739] __x64_sys_ioctl+0x95/0xd0 Aug 22 23:27:42 juju-e4d256-prod-github-runner-207 kernel: [65036.610455] do_syscall_64+0x5c/0xc0 Aug 22 23:27:42 juju-e4d256-prod-github-runner-207 kernel: [65036.611153] ? do_futex+0x162/0x1f0 Aug 22 23:27:42 juju-e4d256-prod-github-runner-207 kernel: [65036.611809] ? __x64_sys_futex+0x78/0x1e0 Aug 22 23:27:42 juju-e4d256-prod-github-runner-207 kernel: [65036.612489] ? __secure_computing+0xa9/0x120 Aug 22 23:27:42 juju-e4d256-prod-github-runner-207 kernel: [65036.613189] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 23:27:42 juju-e4d256-prod-github-runner-207 kernel: [65036.613960] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:27:42 juju-e4d256-prod-github-runner-207 kernel: [65036.614694] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:27:42 juju-e4d256-prod-github-runner-207 kernel: [65036.615445] ? do_syscall_64+0x69/0xc0 Aug 22 23:27:42 juju-e4d256-prod-github-runner-207 kernel: [65036.616107] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:27:42 juju-e4d256-prod-github-runner-207 kernel: [65036.616824] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:27:42 juju-e4d256-prod-github-runner-207 kernel: [65036.617532] ? do_syscall_64+0x69/0xc0 Aug 22 23:27:42 juju-e4d256-prod-github-runner-207 kernel: [65036.618168] ? do_syscall_64+0x69/0xc0 Aug 22 23:27:42 juju-e4d256-prod-github-runner-207 kernel: [65036.618799] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 23:27:42 juju-e4d256-prod-github-runner-207 kernel: [65036.619603] RIP: 0033:0x7faa5d0edaff Aug 22 23:27:42 juju-e4d256-prod-github-runner-207 kernel: [65036.620267] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 23:27:42 juju-e4d256-prod-github-runner-207 kernel: [65036.622316] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 23:27:42 juju-e4d256-prod-github-runner-207 kernel: [65036.623279] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 23:27:42 juju-e4d256-prod-github-runner-207 kernel: [65036.624193] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 23:27:42 juju-e4d256-prod-github-runner-207 kernel: [65036.625103] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 23:27:42 juju-e4d256-prod-github-runner-207 kernel: [65036.626018] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 23:27:42 juju-e4d256-prod-github-runner-207 kernel: [65036.626958] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 23:27:42 juju-e4d256-prod-github-runner-207 kernel: [65036.627876] Aug 22 23:28:10 juju-e4d256-prod-github-runner-207 kernel: [65064.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 60488s! [qemu-system-x86:6715] Aug 22 23:28:10 juju-e4d256-prod-github-runner-207 kernel: [65064.543145] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 23:28:10 juju-e4d256-prod-github-runner-207 kernel: [65064.543220] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 23:28:10 juju-e4d256-prod-github-runner-207 kernel: [65064.555414] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 23:28:10 juju-e4d256-prod-github-runner-207 kernel: [65064.556688] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 23:28:10 juju-e4d256-prod-github-runner-207 kernel: [65064.557906] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:28:10 juju-e4d256-prod-github-runner-207 kernel: [65064.559178] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 23:28:10 juju-e4d256-prod-github-runner-207 kernel: [65064.561722] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 23:28:10 juju-e4d256-prod-github-runner-207 kernel: [65064.562784] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 23:28:10 juju-e4d256-prod-github-runner-207 kernel: [65064.563948] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 23:28:10 juju-e4d256-prod-github-runner-207 kernel: [65064.565299] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 23:28:10 juju-e4d256-prod-github-runner-207 kernel: [65064.566467] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 23:28:10 juju-e4d256-prod-github-runner-207 kernel: [65064.567655] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 23:28:10 juju-e4d256-prod-github-runner-207 kernel: [65064.568829] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 23:28:10 juju-e4d256-prod-github-runner-207 kernel: [65064.570090] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 23:28:10 juju-e4d256-prod-github-runner-207 kernel: [65064.571237] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 23:28:10 juju-e4d256-prod-github-runner-207 kernel: [65064.572444] Call Trace: Aug 22 23:28:10 juju-e4d256-prod-github-runner-207 kernel: [65064.573360] Aug 22 23:28:10 juju-e4d256-prod-github-runner-207 kernel: [65064.574282] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:28:10 juju-e4d256-prod-github-runner-207 kernel: [65064.575491] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:28:10 juju-e4d256-prod-github-runner-207 kernel: [65064.576653] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:28:10 juju-e4d256-prod-github-runner-207 kernel: [65064.577838] ? show_regs.part.0+0x23/0x29 Aug 22 23:28:10 juju-e4d256-prod-github-runner-207 kernel: [65064.578914] ? show_regs.cold+0x8/0xd Aug 22 23:28:10 juju-e4d256-prod-github-runner-207 kernel: [65064.579894] ? watchdog_timer_fn+0x1be/0x220 Aug 22 23:28:10 juju-e4d256-prod-github-runner-207 kernel: [65064.580904] ? lockup_detector_update_enable+0x60/0x60 Aug 22 23:28:10 juju-e4d256-prod-github-runner-207 kernel: [65064.581971] ? __hrtimer_run_queues+0x107/0x230 Aug 22 23:28:10 juju-e4d256-prod-github-runner-207 kernel: [65064.583022] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 23:28:10 juju-e4d256-prod-github-runner-207 kernel: [65064.584054] ? hrtimer_interrupt+0x101/0x220 Aug 22 23:28:10 juju-e4d256-prod-github-runner-207 kernel: [65064.585078] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 23:28:10 juju-e4d256-prod-github-runner-207 kernel: [65064.586152] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 23:28:10 juju-e4d256-prod-github-runner-207 kernel: [65064.587258] Aug 22 23:28:10 juju-e4d256-prod-github-runner-207 kernel: [65064.588132] Aug 22 23:28:10 juju-e4d256-prod-github-runner-207 kernel: [65064.588995] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 23:28:10 juju-e4d256-prod-github-runner-207 kernel: [65064.590038] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:28:10 juju-e4d256-prod-github-runner-207 kernel: [65064.591155] ? _raw_spin_lock+0x22/0x30 Aug 22 23:28:10 juju-e4d256-prod-github-runner-207 kernel: [65064.592124] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:28:10 juju-e4d256-prod-github-runner-207 kernel: [65064.593294] direct_page_fault+0x206/0x310 [kvm] Aug 22 23:28:10 juju-e4d256-prod-github-runner-207 kernel: [65064.594356] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 23:28:10 juju-e4d256-prod-github-runner-207 kernel: [65064.595408] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 23:28:10 juju-e4d256-prod-github-runner-207 kernel: [65064.596420] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 23:28:10 juju-e4d256-prod-github-runner-207 kernel: [65064.597425] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 23:28:10 juju-e4d256-prod-github-runner-207 kernel: [65064.598381] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 23:28:10 juju-e4d256-prod-github-runner-207 kernel: [65064.599391] handle_exit+0x98/0x230 [kvm_amd] Aug 22 23:28:10 juju-e4d256-prod-github-runner-207 kernel: [65064.600291] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 23:28:10 juju-e4d256-prod-github-runner-207 kernel: [65064.601206] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 23:28:10 juju-e4d256-prod-github-runner-207 kernel: [65064.602131] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 23:28:10 juju-e4d256-prod-github-runner-207 kernel: [65064.603578] vcpu_run+0x62/0x2c0 [kvm] Aug 22 23:28:10 juju-e4d256-prod-github-runner-207 kernel: [65064.604846] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 23:28:10 juju-e4d256-prod-github-runner-207 kernel: [65064.606115] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 23:28:10 juju-e4d256-prod-github-runner-207 kernel: [65064.607456] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 23:28:10 juju-e4d256-prod-github-runner-207 kernel: [65064.608693] ? __seccomp_filter+0x4a/0x4a0 Aug 22 23:28:10 juju-e4d256-prod-github-runner-207 kernel: [65064.609840] ? __fget_files+0x86/0xc0 Aug 22 23:28:10 juju-e4d256-prod-github-runner-207 kernel: [65064.610943] __x64_sys_ioctl+0x95/0xd0 Aug 22 23:28:10 juju-e4d256-prod-github-runner-207 kernel: [65064.612013] do_syscall_64+0x5c/0xc0 Aug 22 23:28:10 juju-e4d256-prod-github-runner-207 kernel: [65064.613038] ? do_futex+0x162/0x1f0 Aug 22 23:28:10 juju-e4d256-prod-github-runner-207 kernel: [65064.614033] ? __x64_sys_futex+0x78/0x1e0 Aug 22 23:28:10 juju-e4d256-prod-github-runner-207 kernel: [65064.615068] ? __secure_computing+0xa9/0x120 Aug 22 23:28:10 juju-e4d256-prod-github-runner-207 kernel: [65064.616111] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 23:28:10 juju-e4d256-prod-github-runner-207 kernel: [65064.617238] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:28:10 juju-e4d256-prod-github-runner-207 kernel: [65064.618409] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:28:10 juju-e4d256-prod-github-runner-207 kernel: [65064.619630] ? do_syscall_64+0x69/0xc0 Aug 22 23:28:10 juju-e4d256-prod-github-runner-207 kernel: [65064.620626] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:28:10 juju-e4d256-prod-github-runner-207 kernel: [65064.621684] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:28:10 juju-e4d256-prod-github-runner-207 kernel: [65064.622751] ? do_syscall_64+0x69/0xc0 Aug 22 23:28:10 juju-e4d256-prod-github-runner-207 kernel: [65064.623706] ? do_syscall_64+0x69/0xc0 Aug 22 23:28:10 juju-e4d256-prod-github-runner-207 kernel: [65064.624659] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 23:28:10 juju-e4d256-prod-github-runner-207 kernel: [65064.625755] RIP: 0033:0x7faa5d0edaff Aug 22 23:28:10 juju-e4d256-prod-github-runner-207 kernel: [65064.626750] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 23:28:10 juju-e4d256-prod-github-runner-207 kernel: [65064.629654] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 23:28:10 juju-e4d256-prod-github-runner-207 kernel: [65064.631013] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 23:28:10 juju-e4d256-prod-github-runner-207 kernel: [65064.632333] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 23:28:10 juju-e4d256-prod-github-runner-207 kernel: [65064.633655] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 23:28:10 juju-e4d256-prod-github-runner-207 kernel: [65064.634870] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 23:28:10 juju-e4d256-prod-github-runner-207 kernel: [65064.635853] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 23:28:10 juju-e4d256-prod-github-runner-207 kernel: [65064.636790] Aug 22 23:28:38 juju-e4d256-prod-github-runner-207 kernel: [65092.541981] watchdog: BUG: soft lockup - CPU#1 stuck for 60514s! [qemu-system-x86:6715] Aug 22 23:28:38 juju-e4d256-prod-github-runner-207 kernel: [65092.543130] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 23:28:38 juju-e4d256-prod-github-runner-207 kernel: [65092.543206] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 23:28:38 juju-e4d256-prod-github-runner-207 kernel: [65092.555419] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 23:28:38 juju-e4d256-prod-github-runner-207 kernel: [65092.556691] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 23:28:38 juju-e4d256-prod-github-runner-207 kernel: [65092.557910] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:28:38 juju-e4d256-prod-github-runner-207 kernel: [65092.559007] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 23:28:38 juju-e4d256-prod-github-runner-207 kernel: [65092.561564] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 23:28:38 juju-e4d256-prod-github-runner-207 kernel: [65092.562685] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 23:28:38 juju-e4d256-prod-github-runner-207 kernel: [65092.563862] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 23:28:38 juju-e4d256-prod-github-runner-207 kernel: [65092.565056] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 23:28:38 juju-e4d256-prod-github-runner-207 kernel: [65092.566249] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 23:28:38 juju-e4d256-prod-github-runner-207 kernel: [65092.567433] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 23:28:38 juju-e4d256-prod-github-runner-207 kernel: [65092.568668] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 23:28:38 juju-e4d256-prod-github-runner-207 kernel: [65092.569920] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 23:28:38 juju-e4d256-prod-github-runner-207 kernel: [65092.571031] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 23:28:38 juju-e4d256-prod-github-runner-207 kernel: [65092.572222] Call Trace: Aug 22 23:28:38 juju-e4d256-prod-github-runner-207 kernel: [65092.573155] Aug 22 23:28:38 juju-e4d256-prod-github-runner-207 kernel: [65092.574042] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:28:38 juju-e4d256-prod-github-runner-207 kernel: [65092.575097] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:28:38 juju-e4d256-prod-github-runner-207 kernel: [65092.576143] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:28:38 juju-e4d256-prod-github-runner-207 kernel: [65092.577269] ? show_regs.part.0+0x23/0x29 Aug 22 23:28:38 juju-e4d256-prod-github-runner-207 kernel: [65092.578289] ? show_regs.cold+0x8/0xd Aug 22 23:28:38 juju-e4d256-prod-github-runner-207 kernel: [65092.579283] ? watchdog_timer_fn+0x1be/0x220 Aug 22 23:28:38 juju-e4d256-prod-github-runner-207 kernel: [65092.580300] ? lockup_detector_update_enable+0x60/0x60 Aug 22 23:28:38 juju-e4d256-prod-github-runner-207 kernel: [65092.581387] ? __hrtimer_run_queues+0x107/0x230 Aug 22 23:28:38 juju-e4d256-prod-github-runner-207 kernel: [65092.582433] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 23:28:38 juju-e4d256-prod-github-runner-207 kernel: [65092.583484] ? hrtimer_interrupt+0x101/0x220 Aug 22 23:28:38 juju-e4d256-prod-github-runner-207 kernel: [65092.584528] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 23:28:38 juju-e4d256-prod-github-runner-207 kernel: [65092.585599] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 23:28:38 juju-e4d256-prod-github-runner-207 kernel: [65092.586655] Aug 22 23:28:38 juju-e4d256-prod-github-runner-207 kernel: [65092.587531] Aug 22 23:28:38 juju-e4d256-prod-github-runner-207 kernel: [65092.588392] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 23:28:38 juju-e4d256-prod-github-runner-207 kernel: [65092.589428] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:28:38 juju-e4d256-prod-github-runner-207 kernel: [65092.590503] ? _raw_spin_lock+0x22/0x30 Aug 22 23:28:38 juju-e4d256-prod-github-runner-207 kernel: [65092.591455] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:28:38 juju-e4d256-prod-github-runner-207 kernel: [65092.592476] direct_page_fault+0x206/0x310 [kvm] Aug 22 23:28:38 juju-e4d256-prod-github-runner-207 kernel: [65092.593521] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 23:28:38 juju-e4d256-prod-github-runner-207 kernel: [65092.594568] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 23:28:38 juju-e4d256-prod-github-runner-207 kernel: [65092.595577] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 23:28:38 juju-e4d256-prod-github-runner-207 kernel: [65092.596572] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 23:28:38 juju-e4d256-prod-github-runner-207 kernel: [65092.597523] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 23:28:38 juju-e4d256-prod-github-runner-207 kernel: [65092.598567] handle_exit+0x98/0x230 [kvm_amd] Aug 22 23:28:38 juju-e4d256-prod-github-runner-207 kernel: [65092.599469] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 23:28:38 juju-e4d256-prod-github-runner-207 kernel: [65092.600420] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 23:28:38 juju-e4d256-prod-github-runner-207 kernel: [65092.601371] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 23:28:38 juju-e4d256-prod-github-runner-207 kernel: [65092.602312] vcpu_run+0x62/0x2c0 [kvm] Aug 22 23:28:38 juju-e4d256-prod-github-runner-207 kernel: [65092.603140] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 23:28:38 juju-e4d256-prod-github-runner-207 kernel: [65092.603952] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 23:28:38 juju-e4d256-prod-github-runner-207 kernel: [65092.604823] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 23:28:38 juju-e4d256-prod-github-runner-207 kernel: [65092.605631] ? __seccomp_filter+0x4a/0x4a0 Aug 22 23:28:38 juju-e4d256-prod-github-runner-207 kernel: [65092.606419] ? __fget_files+0x86/0xc0 Aug 22 23:28:38 juju-e4d256-prod-github-runner-207 kernel: [65092.607162] __x64_sys_ioctl+0x95/0xd0 Aug 22 23:28:38 juju-e4d256-prod-github-runner-207 kernel: [65092.607901] do_syscall_64+0x5c/0xc0 Aug 22 23:28:38 juju-e4d256-prod-github-runner-207 kernel: [65092.608597] ? do_futex+0x162/0x1f0 Aug 22 23:28:38 juju-e4d256-prod-github-runner-207 kernel: [65092.609254] ? __x64_sys_futex+0x78/0x1e0 Aug 22 23:28:38 juju-e4d256-prod-github-runner-207 kernel: [65092.609945] ? __secure_computing+0xa9/0x120 Aug 22 23:28:38 juju-e4d256-prod-github-runner-207 kernel: [65092.610663] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 23:28:38 juju-e4d256-prod-github-runner-207 kernel: [65092.611451] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:28:38 juju-e4d256-prod-github-runner-207 kernel: [65092.612178] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:28:38 juju-e4d256-prod-github-runner-207 kernel: [65092.612901] ? do_syscall_64+0x69/0xc0 Aug 22 23:28:38 juju-e4d256-prod-github-runner-207 kernel: [65092.613547] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:28:38 juju-e4d256-prod-github-runner-207 kernel: [65092.614267] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:28:38 juju-e4d256-prod-github-runner-207 kernel: [65092.614984] ? do_syscall_64+0x69/0xc0 Aug 22 23:28:38 juju-e4d256-prod-github-runner-207 kernel: [65092.615619] ? do_syscall_64+0x69/0xc0 Aug 22 23:28:38 juju-e4d256-prod-github-runner-207 kernel: [65092.616268] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 23:28:38 juju-e4d256-prod-github-runner-207 kernel: [65092.616977] RIP: 0033:0x7faa5d0edaff Aug 22 23:28:38 juju-e4d256-prod-github-runner-207 kernel: [65092.617604] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 23:28:38 juju-e4d256-prod-github-runner-207 kernel: [65092.619626] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 23:28:38 juju-e4d256-prod-github-runner-207 kernel: [65092.620539] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 23:28:38 juju-e4d256-prod-github-runner-207 kernel: [65092.621443] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 23:28:38 juju-e4d256-prod-github-runner-207 kernel: [65092.622372] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 23:28:38 juju-e4d256-prod-github-runner-207 kernel: [65092.623264] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 23:28:38 juju-e4d256-prod-github-runner-207 kernel: [65092.624194] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 23:28:38 juju-e4d256-prod-github-runner-207 kernel: [65092.625128] Aug 22 23:29:06 juju-e4d256-prod-github-runner-207 kernel: [65120.541976] watchdog: BUG: soft lockup - CPU#1 stuck for 60540s! [qemu-system-x86:6715] Aug 22 23:29:06 juju-e4d256-prod-github-runner-207 kernel: [65120.543989] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 23:29:06 juju-e4d256-prod-github-runner-207 kernel: [65120.544361] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 23:29:06 juju-e4d256-prod-github-runner-207 kernel: [65120.557035] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 23:29:06 juju-e4d256-prod-github-runner-207 kernel: [65120.558343] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 23:29:06 juju-e4d256-prod-github-runner-207 kernel: [65120.559665] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:29:06 juju-e4d256-prod-github-runner-207 kernel: [65120.560732] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 23:29:06 juju-e4d256-prod-github-runner-207 kernel: [65120.563386] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 23:29:06 juju-e4d256-prod-github-runner-207 kernel: [65120.564468] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 23:29:06 juju-e4d256-prod-github-runner-207 kernel: [65120.565639] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 23:29:06 juju-e4d256-prod-github-runner-207 kernel: [65120.566858] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 23:29:06 juju-e4d256-prod-github-runner-207 kernel: [65120.568030] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 23:29:06 juju-e4d256-prod-github-runner-207 kernel: [65120.569237] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 23:29:06 juju-e4d256-prod-github-runner-207 kernel: [65120.570445] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 23:29:06 juju-e4d256-prod-github-runner-207 kernel: [65120.571729] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 23:29:06 juju-e4d256-prod-github-runner-207 kernel: [65120.572958] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 23:29:06 juju-e4d256-prod-github-runner-207 kernel: [65120.574352] Call Trace: Aug 22 23:29:06 juju-e4d256-prod-github-runner-207 kernel: [65120.575282] Aug 22 23:29:06 juju-e4d256-prod-github-runner-207 kernel: [65120.576250] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:29:06 juju-e4d256-prod-github-runner-207 kernel: [65120.577290] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:29:06 juju-e4d256-prod-github-runner-207 kernel: [65120.578346] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:29:06 juju-e4d256-prod-github-runner-207 kernel: [65120.579487] ? show_regs.part.0+0x23/0x29 Aug 22 23:29:06 juju-e4d256-prod-github-runner-207 kernel: [65120.580512] ? show_regs.cold+0x8/0xd Aug 22 23:29:06 juju-e4d256-prod-github-runner-207 kernel: [65120.581532] ? watchdog_timer_fn+0x1be/0x220 Aug 22 23:29:06 juju-e4d256-prod-github-runner-207 kernel: [65120.582581] ? lockup_detector_update_enable+0x60/0x60 Aug 22 23:29:06 juju-e4d256-prod-github-runner-207 kernel: [65120.583678] ? __hrtimer_run_queues+0x107/0x230 Aug 22 23:29:06 juju-e4d256-prod-github-runner-207 kernel: [65120.584760] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 23:29:06 juju-e4d256-prod-github-runner-207 kernel: [65120.585802] ? hrtimer_interrupt+0x101/0x220 Aug 22 23:29:06 juju-e4d256-prod-github-runner-207 kernel: [65120.586832] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 23:29:06 juju-e4d256-prod-github-runner-207 kernel: [65120.587897] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 23:29:06 juju-e4d256-prod-github-runner-207 kernel: [65120.589025] Aug 22 23:29:06 juju-e4d256-prod-github-runner-207 kernel: [65120.589949] Aug 22 23:29:06 juju-e4d256-prod-github-runner-207 kernel: [65120.590833] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 23:29:06 juju-e4d256-prod-github-runner-207 kernel: [65120.591881] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:29:06 juju-e4d256-prod-github-runner-207 kernel: [65120.592971] ? _raw_spin_lock+0x22/0x30 Aug 22 23:29:06 juju-e4d256-prod-github-runner-207 kernel: [65120.593943] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:29:06 juju-e4d256-prod-github-runner-207 kernel: [65120.594971] direct_page_fault+0x206/0x310 [kvm] Aug 22 23:29:06 juju-e4d256-prod-github-runner-207 kernel: [65120.596048] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 23:29:06 juju-e4d256-prod-github-runner-207 kernel: [65120.597074] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 23:29:06 juju-e4d256-prod-github-runner-207 kernel: [65120.598121] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 23:29:06 juju-e4d256-prod-github-runner-207 kernel: [65120.599168] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 23:29:06 juju-e4d256-prod-github-runner-207 kernel: [65120.600113] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 23:29:06 juju-e4d256-prod-github-runner-207 kernel: [65120.601159] handle_exit+0x98/0x230 [kvm_amd] Aug 22 23:29:06 juju-e4d256-prod-github-runner-207 kernel: [65120.602094] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 23:29:06 juju-e4d256-prod-github-runner-207 kernel: [65120.603013] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 23:29:06 juju-e4d256-prod-github-runner-207 kernel: [65120.604000] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 23:29:06 juju-e4d256-prod-github-runner-207 kernel: [65120.604926] vcpu_run+0x62/0x2c0 [kvm] Aug 22 23:29:06 juju-e4d256-prod-github-runner-207 kernel: [65120.605784] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 23:29:06 juju-e4d256-prod-github-runner-207 kernel: [65120.606628] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 23:29:06 juju-e4d256-prod-github-runner-207 kernel: [65120.607480] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 23:29:06 juju-e4d256-prod-github-runner-207 kernel: [65120.608280] ? __seccomp_filter+0x4a/0x4a0 Aug 22 23:29:06 juju-e4d256-prod-github-runner-207 kernel: [65120.609031] ? __fget_files+0x86/0xc0 Aug 22 23:29:06 juju-e4d256-prod-github-runner-207 kernel: [65120.609738] __x64_sys_ioctl+0x95/0xd0 Aug 22 23:29:06 juju-e4d256-prod-github-runner-207 kernel: [65120.610442] do_syscall_64+0x5c/0xc0 Aug 22 23:29:06 juju-e4d256-prod-github-runner-207 kernel: [65120.611147] ? do_futex+0x162/0x1f0 Aug 22 23:29:06 juju-e4d256-prod-github-runner-207 kernel: [65120.611796] ? __x64_sys_futex+0x78/0x1e0 Aug 22 23:29:06 juju-e4d256-prod-github-runner-207 kernel: [65120.612468] ? __secure_computing+0xa9/0x120 Aug 22 23:29:06 juju-e4d256-prod-github-runner-207 kernel: [65120.613155] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 23:29:06 juju-e4d256-prod-github-runner-207 kernel: [65120.613928] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:29:06 juju-e4d256-prod-github-runner-207 kernel: [65120.614651] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:29:06 juju-e4d256-prod-github-runner-207 kernel: [65120.615366] ? do_syscall_64+0x69/0xc0 Aug 22 23:29:06 juju-e4d256-prod-github-runner-207 kernel: [65120.616008] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:29:06 juju-e4d256-prod-github-runner-207 kernel: [65120.616714] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:29:06 juju-e4d256-prod-github-runner-207 kernel: [65120.617414] ? do_syscall_64+0x69/0xc0 Aug 22 23:29:06 juju-e4d256-prod-github-runner-207 kernel: [65120.618041] ? do_syscall_64+0x69/0xc0 Aug 22 23:29:06 juju-e4d256-prod-github-runner-207 kernel: [65120.618669] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 23:29:06 juju-e4d256-prod-github-runner-207 kernel: [65120.619372] RIP: 0033:0x7faa5d0edaff Aug 22 23:29:06 juju-e4d256-prod-github-runner-207 kernel: [65120.620024] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 23:29:06 juju-e4d256-prod-github-runner-207 kernel: [65120.622021] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 23:29:06 juju-e4d256-prod-github-runner-207 kernel: [65120.622928] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 23:29:06 juju-e4d256-prod-github-runner-207 kernel: [65120.623824] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 23:29:06 juju-e4d256-prod-github-runner-207 kernel: [65120.624710] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 23:29:06 juju-e4d256-prod-github-runner-207 kernel: [65120.625598] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 23:29:06 juju-e4d256-prod-github-runner-207 kernel: [65120.626497] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 23:29:06 juju-e4d256-prod-github-runner-207 kernel: [65120.627383] Aug 22 23:29:34 juju-e4d256-prod-github-runner-207 kernel: [65148.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 60566s! [qemu-system-x86:6715] Aug 22 23:29:34 juju-e4d256-prod-github-runner-207 kernel: [65148.543177] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 23:29:34 juju-e4d256-prod-github-runner-207 kernel: [65148.543254] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 23:29:34 juju-e4d256-prod-github-runner-207 kernel: [65148.555764] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 23:29:34 juju-e4d256-prod-github-runner-207 kernel: [65148.557286] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 23:29:34 juju-e4d256-prod-github-runner-207 kernel: [65148.558534] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:29:34 juju-e4d256-prod-github-runner-207 kernel: [65148.559591] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 23:29:34 juju-e4d256-prod-github-runner-207 kernel: [65148.562168] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 23:29:34 juju-e4d256-prod-github-runner-207 kernel: [65148.563210] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 23:29:34 juju-e4d256-prod-github-runner-207 kernel: [65148.564376] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 23:29:34 juju-e4d256-prod-github-runner-207 kernel: [65148.565547] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 23:29:34 juju-e4d256-prod-github-runner-207 kernel: [65148.566708] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 23:29:34 juju-e4d256-prod-github-runner-207 kernel: [65148.567882] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 23:29:34 juju-e4d256-prod-github-runner-207 kernel: [65148.569045] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 23:29:34 juju-e4d256-prod-github-runner-207 kernel: [65148.570287] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 23:29:34 juju-e4d256-prod-github-runner-207 kernel: [65148.571400] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 23:29:34 juju-e4d256-prod-github-runner-207 kernel: [65148.572596] Call Trace: Aug 22 23:29:34 juju-e4d256-prod-github-runner-207 kernel: [65148.573530] Aug 22 23:29:34 juju-e4d256-prod-github-runner-207 kernel: [65148.574512] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:29:34 juju-e4d256-prod-github-runner-207 kernel: [65148.576043] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:29:34 juju-e4d256-prod-github-runner-207 kernel: [65148.577172] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:29:34 juju-e4d256-prod-github-runner-207 kernel: [65148.580072] ? show_regs.part.0+0x23/0x29 Aug 22 23:29:34 juju-e4d256-prod-github-runner-207 kernel: [65148.581805] ? show_regs.cold+0x8/0xd Aug 22 23:29:34 juju-e4d256-prod-github-runner-207 kernel: [65148.582799] ? watchdog_timer_fn+0x1be/0x220 Aug 22 23:29:34 juju-e4d256-prod-github-runner-207 kernel: [65148.583914] ? lockup_detector_update_enable+0x60/0x60 Aug 22 23:29:34 juju-e4d256-prod-github-runner-207 kernel: [65148.587382] ? __hrtimer_run_queues+0x107/0x230 Aug 22 23:29:34 juju-e4d256-prod-github-runner-207 kernel: [65148.588530] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 23:29:34 juju-e4d256-prod-github-runner-207 kernel: [65148.589681] ? hrtimer_interrupt+0x101/0x220 Aug 22 23:29:34 juju-e4d256-prod-github-runner-207 kernel: [65148.590789] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 23:29:34 juju-e4d256-prod-github-runner-207 kernel: [65148.594249] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 23:29:34 juju-e4d256-prod-github-runner-207 kernel: [65148.595378] Aug 22 23:29:34 juju-e4d256-prod-github-runner-207 kernel: [65148.596243] Aug 22 23:29:34 juju-e4d256-prod-github-runner-207 kernel: [65148.597083] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 23:29:34 juju-e4d256-prod-github-runner-207 kernel: [65148.598161] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:29:34 juju-e4d256-prod-github-runner-207 kernel: [65148.599211] ? _raw_spin_lock+0x22/0x30 Aug 22 23:29:34 juju-e4d256-prod-github-runner-207 kernel: [65148.600160] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:29:34 juju-e4d256-prod-github-runner-207 kernel: [65148.601195] direct_page_fault+0x206/0x310 [kvm] Aug 22 23:29:34 juju-e4d256-prod-github-runner-207 kernel: [65148.602258] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 23:29:34 juju-e4d256-prod-github-runner-207 kernel: [65148.603275] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 23:29:34 juju-e4d256-prod-github-runner-207 kernel: [65148.604400] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 23:29:34 juju-e4d256-prod-github-runner-207 kernel: [65148.605518] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 23:29:34 juju-e4d256-prod-github-runner-207 kernel: [65148.606573] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 23:29:34 juju-e4d256-prod-github-runner-207 kernel: [65148.607661] handle_exit+0x98/0x230 [kvm_amd] Aug 22 23:29:34 juju-e4d256-prod-github-runner-207 kernel: [65148.608643] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 23:29:34 juju-e4d256-prod-github-runner-207 kernel: [65148.609736] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 23:29:34 juju-e4d256-prod-github-runner-207 kernel: [65148.610770] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 23:29:34 juju-e4d256-prod-github-runner-207 kernel: [65148.611683] vcpu_run+0x62/0x2c0 [kvm] Aug 22 23:29:34 juju-e4d256-prod-github-runner-207 kernel: [65148.612506] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 23:29:34 juju-e4d256-prod-github-runner-207 kernel: [65148.613324] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 23:29:34 juju-e4d256-prod-github-runner-207 kernel: [65148.614207] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 23:29:34 juju-e4d256-prod-github-runner-207 kernel: [65148.615010] ? __seccomp_filter+0x4a/0x4a0 Aug 22 23:29:34 juju-e4d256-prod-github-runner-207 kernel: [65148.615762] ? __fget_files+0x86/0xc0 Aug 22 23:29:34 juju-e4d256-prod-github-runner-207 kernel: [65148.616469] __x64_sys_ioctl+0x95/0xd0 Aug 22 23:29:34 juju-e4d256-prod-github-runner-207 kernel: [65148.617170] do_syscall_64+0x5c/0xc0 Aug 22 23:29:34 juju-e4d256-prod-github-runner-207 kernel: [65148.617878] ? do_futex+0x162/0x1f0 Aug 22 23:29:34 juju-e4d256-prod-github-runner-207 kernel: [65148.618572] ? __x64_sys_futex+0x78/0x1e0 Aug 22 23:29:34 juju-e4d256-prod-github-runner-207 kernel: [65148.619259] ? __secure_computing+0xa9/0x120 Aug 22 23:29:34 juju-e4d256-prod-github-runner-207 kernel: [65148.619956] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 23:29:34 juju-e4d256-prod-github-runner-207 kernel: [65148.620718] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:29:34 juju-e4d256-prod-github-runner-207 kernel: [65148.621449] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:29:34 juju-e4d256-prod-github-runner-207 kernel: [65148.622198] ? do_syscall_64+0x69/0xc0 Aug 22 23:29:34 juju-e4d256-prod-github-runner-207 kernel: [65148.622847] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:29:34 juju-e4d256-prod-github-runner-207 kernel: [65148.623559] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:29:34 juju-e4d256-prod-github-runner-207 kernel: [65148.624262] ? do_syscall_64+0x69/0xc0 Aug 22 23:29:34 juju-e4d256-prod-github-runner-207 kernel: [65148.624889] ? do_syscall_64+0x69/0xc0 Aug 22 23:29:34 juju-e4d256-prod-github-runner-207 kernel: [65148.625529] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 23:29:34 juju-e4d256-prod-github-runner-207 kernel: [65148.626260] RIP: 0033:0x7faa5d0edaff Aug 22 23:29:34 juju-e4d256-prod-github-runner-207 kernel: [65148.626912] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 23:29:34 juju-e4d256-prod-github-runner-207 kernel: [65148.628914] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 23:29:34 juju-e4d256-prod-github-runner-207 kernel: [65148.629947] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 23:29:34 juju-e4d256-prod-github-runner-207 kernel: [65148.630915] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 23:29:34 juju-e4d256-prod-github-runner-207 kernel: [65148.631824] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 23:29:34 juju-e4d256-prod-github-runner-207 kernel: [65148.632738] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 23:29:34 juju-e4d256-prod-github-runner-207 kernel: [65148.633677] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 23:29:34 juju-e4d256-prod-github-runner-207 kernel: [65148.634583] Aug 22 23:29:47 juju-e4d256-prod-github-runner-207 kernel: [65161.532705] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 23:29:47 juju-e4d256-prod-github-runner-207 kernel: [65161.533706] rcu: 1-....: (16209825 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=7825676 Aug 22 23:29:47 juju-e4d256-prod-github-runner-207 kernel: [65161.534835] (t=16261083 jiffies g=23269 q=57348) Aug 22 23:29:47 juju-e4d256-prod-github-runner-207 kernel: [65161.535628] NMI backtrace for cpu 1 Aug 22 23:29:47 juju-e4d256-prod-github-runner-207 kernel: [65161.536385] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 23:29:47 juju-e4d256-prod-github-runner-207 kernel: [65161.537557] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 23:29:47 juju-e4d256-prod-github-runner-207 kernel: [65161.538614] Call Trace: Aug 22 23:29:47 juju-e4d256-prod-github-runner-207 kernel: [65161.539435] Aug 22 23:29:47 juju-e4d256-prod-github-runner-207 kernel: [65161.540084] show_stack+0x52/0x5c Aug 22 23:29:47 juju-e4d256-prod-github-runner-207 kernel: [65161.540836] dump_stack_lvl+0x4a/0x63 Aug 22 23:29:47 juju-e4d256-prod-github-runner-207 kernel: [65161.541629] dump_stack+0x10/0x16 Aug 22 23:29:47 juju-e4d256-prod-github-runner-207 kernel: [65161.542370] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 23:29:47 juju-e4d256-prod-github-runner-207 kernel: [65161.543175] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 23:29:47 juju-e4d256-prod-github-runner-207 kernel: [65161.543978] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 23:29:47 juju-e4d256-prod-github-runner-207 kernel: [65161.544797] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 23:29:47 juju-e4d256-prod-github-runner-207 kernel: [65161.545633] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 23:29:47 juju-e4d256-prod-github-runner-207 kernel: [65161.546448] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 23:29:47 juju-e4d256-prod-github-runner-207 kernel: [65161.547224] print_cpu_stall.cold+0x2f/0xe2 Aug 22 23:29:47 juju-e4d256-prod-github-runner-207 kernel: [65161.547992] ? timekeeping_update+0xf7/0x150 Aug 22 23:29:47 juju-e4d256-prod-github-runner-207 kernel: [65161.548761] check_cpu_stall+0x109/0x270 Aug 22 23:29:47 juju-e4d256-prod-github-runner-207 kernel: [65161.549513] rcu_sched_clock_irq+0x9a/0x250 Aug 22 23:29:47 juju-e4d256-prod-github-runner-207 kernel: [65161.550299] update_process_times+0x94/0xd0 Aug 22 23:29:47 juju-e4d256-prod-github-runner-207 kernel: [65161.551118] tick_sched_handle+0x29/0x70 Aug 22 23:29:47 juju-e4d256-prod-github-runner-207 kernel: [65161.551920] tick_sched_timer+0x8c/0xc0 Aug 22 23:29:47 juju-e4d256-prod-github-runner-207 kernel: [65161.552659] ? tick_nohz_handler+0xb0/0xb0 Aug 22 23:29:47 juju-e4d256-prod-github-runner-207 kernel: [65161.553424] __hrtimer_run_queues+0x107/0x230 Aug 22 23:29:47 juju-e4d256-prod-github-runner-207 kernel: [65161.554197] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 23:29:47 juju-e4d256-prod-github-runner-207 kernel: [65161.554974] hrtimer_interrupt+0x101/0x220 Aug 22 23:29:47 juju-e4d256-prod-github-runner-207 kernel: [65161.555731] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 23:29:47 juju-e4d256-prod-github-runner-207 kernel: [65161.556541] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 23:29:47 juju-e4d256-prod-github-runner-207 kernel: [65161.557355] Aug 22 23:29:47 juju-e4d256-prod-github-runner-207 kernel: [65161.557990] Aug 22 23:29:47 juju-e4d256-prod-github-runner-207 kernel: [65161.558618] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 23:29:47 juju-e4d256-prod-github-runner-207 kernel: [65161.559440] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:29:47 juju-e4d256-prod-github-runner-207 kernel: [65161.560317] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 23:29:47 juju-e4d256-prod-github-runner-207 kernel: [65161.562529] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 23:29:47 juju-e4d256-prod-github-runner-207 kernel: [65161.563402] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 23:29:47 juju-e4d256-prod-github-runner-207 kernel: [65161.564422] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 23:29:47 juju-e4d256-prod-github-runner-207 kernel: [65161.565419] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 23:29:47 juju-e4d256-prod-github-runner-207 kernel: [65161.566380] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 23:29:47 juju-e4d256-prod-github-runner-207 kernel: [65161.567332] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 23:29:47 juju-e4d256-prod-github-runner-207 kernel: [65161.568284] ? _raw_spin_lock+0x22/0x30 Aug 22 23:29:47 juju-e4d256-prod-github-runner-207 kernel: [65161.569041] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:29:47 juju-e4d256-prod-github-runner-207 kernel: [65161.569887] direct_page_fault+0x206/0x310 [kvm] Aug 22 23:29:47 juju-e4d256-prod-github-runner-207 kernel: [65161.570726] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 23:29:47 juju-e4d256-prod-github-runner-207 kernel: [65161.571553] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 23:29:47 juju-e4d256-prod-github-runner-207 kernel: [65161.572376] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 23:29:47 juju-e4d256-prod-github-runner-207 kernel: [65161.573184] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 23:29:47 juju-e4d256-prod-github-runner-207 kernel: [65161.574009] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 23:29:47 juju-e4d256-prod-github-runner-207 kernel: [65161.574854] handle_exit+0x98/0x230 [kvm_amd] Aug 22 23:29:47 juju-e4d256-prod-github-runner-207 kernel: [65161.575641] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 23:29:47 juju-e4d256-prod-github-runner-207 kernel: [65161.576429] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 23:29:47 juju-e4d256-prod-github-runner-207 kernel: [65161.577230] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 23:29:47 juju-e4d256-prod-github-runner-207 kernel: [65161.578036] vcpu_run+0x62/0x2c0 [kvm] Aug 22 23:29:47 juju-e4d256-prod-github-runner-207 kernel: [65161.578752] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 23:29:47 juju-e4d256-prod-github-runner-207 kernel: [65161.579486] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 23:29:47 juju-e4d256-prod-github-runner-207 kernel: [65161.580288] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 23:29:47 juju-e4d256-prod-github-runner-207 kernel: [65161.581054] ? __seccomp_filter+0x4a/0x4a0 Aug 22 23:29:47 juju-e4d256-prod-github-runner-207 kernel: [65161.581792] ? __fget_files+0x86/0xc0 Aug 22 23:29:47 juju-e4d256-prod-github-runner-207 kernel: [65161.582486] __x64_sys_ioctl+0x95/0xd0 Aug 22 23:29:47 juju-e4d256-prod-github-runner-207 kernel: [65161.583184] do_syscall_64+0x5c/0xc0 Aug 22 23:29:47 juju-e4d256-prod-github-runner-207 kernel: [65161.583864] ? do_futex+0x162/0x1f0 Aug 22 23:29:47 juju-e4d256-prod-github-runner-207 kernel: [65161.584542] ? __x64_sys_futex+0x78/0x1e0 Aug 22 23:29:47 juju-e4d256-prod-github-runner-207 kernel: [65161.585243] ? __secure_computing+0xa9/0x120 Aug 22 23:29:47 juju-e4d256-prod-github-runner-207 kernel: [65161.585993] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 23:29:47 juju-e4d256-prod-github-runner-207 kernel: [65161.586782] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:29:47 juju-e4d256-prod-github-runner-207 kernel: [65161.587534] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:29:47 juju-e4d256-prod-github-runner-207 kernel: [65161.588286] ? do_syscall_64+0x69/0xc0 Aug 22 23:29:47 juju-e4d256-prod-github-runner-207 kernel: [65161.588975] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:29:47 juju-e4d256-prod-github-runner-207 kernel: [65161.589736] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:29:47 juju-e4d256-prod-github-runner-207 kernel: [65161.590498] ? do_syscall_64+0x69/0xc0 Aug 22 23:29:47 juju-e4d256-prod-github-runner-207 kernel: [65161.591196] ? do_syscall_64+0x69/0xc0 Aug 22 23:29:47 juju-e4d256-prod-github-runner-207 kernel: [65161.591890] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 23:29:47 juju-e4d256-prod-github-runner-207 kernel: [65161.592659] RIP: 0033:0x7faa5d0edaff Aug 22 23:29:47 juju-e4d256-prod-github-runner-207 kernel: [65161.593393] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 23:29:47 juju-e4d256-prod-github-runner-207 kernel: [65161.595554] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 23:29:47 juju-e4d256-prod-github-runner-207 kernel: [65161.596514] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 23:29:47 juju-e4d256-prod-github-runner-207 kernel: [65161.597472] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 23:29:47 juju-e4d256-prod-github-runner-207 kernel: [65161.598450] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 23:29:47 juju-e4d256-prod-github-runner-207 kernel: [65161.599390] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 23:29:47 juju-e4d256-prod-github-runner-207 kernel: [65161.600401] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 23:29:47 juju-e4d256-prod-github-runner-207 kernel: [65161.601327] Aug 22 23:30:14 juju-e4d256-prod-github-runner-207 kernel: [65188.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 60603s! [qemu-system-x86:6715] Aug 22 23:30:14 juju-e4d256-prod-github-runner-207 kernel: [65188.543129] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 23:30:14 juju-e4d256-prod-github-runner-207 kernel: [65188.543205] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 23:30:14 juju-e4d256-prod-github-runner-207 kernel: [65188.555408] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 23:30:14 juju-e4d256-prod-github-runner-207 kernel: [65188.556689] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 23:30:14 juju-e4d256-prod-github-runner-207 kernel: [65188.557962] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:30:14 juju-e4d256-prod-github-runner-207 kernel: [65188.559047] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 23:30:14 juju-e4d256-prod-github-runner-207 kernel: [65188.561691] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 23:30:14 juju-e4d256-prod-github-runner-207 kernel: [65188.562771] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 23:30:14 juju-e4d256-prod-github-runner-207 kernel: [65188.563942] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 23:30:14 juju-e4d256-prod-github-runner-207 kernel: [65188.565153] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 23:30:14 juju-e4d256-prod-github-runner-207 kernel: [65188.566315] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 23:30:14 juju-e4d256-prod-github-runner-207 kernel: [65188.567488] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 23:30:14 juju-e4d256-prod-github-runner-207 kernel: [65188.568653] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 23:30:14 juju-e4d256-prod-github-runner-207 kernel: [65188.569916] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 23:30:14 juju-e4d256-prod-github-runner-207 kernel: [65188.571011] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 23:30:14 juju-e4d256-prod-github-runner-207 kernel: [65188.572208] Call Trace: Aug 22 23:30:14 juju-e4d256-prod-github-runner-207 kernel: [65188.573135] Aug 22 23:30:14 juju-e4d256-prod-github-runner-207 kernel: [65188.574039] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:30:14 juju-e4d256-prod-github-runner-207 kernel: [65188.575091] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:30:14 juju-e4d256-prod-github-runner-207 kernel: [65188.576119] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:30:14 juju-e4d256-prod-github-runner-207 kernel: [65188.577216] ? show_regs.part.0+0x23/0x29 Aug 22 23:30:14 juju-e4d256-prod-github-runner-207 kernel: [65188.578216] ? show_regs.cold+0x8/0xd Aug 22 23:30:14 juju-e4d256-prod-github-runner-207 kernel: [65188.579244] ? watchdog_timer_fn+0x1be/0x220 Aug 22 23:30:14 juju-e4d256-prod-github-runner-207 kernel: [65188.580268] ? lockup_detector_update_enable+0x60/0x60 Aug 22 23:30:14 juju-e4d256-prod-github-runner-207 kernel: [65188.581348] ? __hrtimer_run_queues+0x107/0x230 Aug 22 23:30:14 juju-e4d256-prod-github-runner-207 kernel: [65188.582376] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 23:30:14 juju-e4d256-prod-github-runner-207 kernel: [65188.583417] ? hrtimer_interrupt+0x101/0x220 Aug 22 23:30:14 juju-e4d256-prod-github-runner-207 kernel: [65188.584438] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 23:30:14 juju-e4d256-prod-github-runner-207 kernel: [65188.585521] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 23:30:14 juju-e4d256-prod-github-runner-207 kernel: [65188.586573] Aug 22 23:30:14 juju-e4d256-prod-github-runner-207 kernel: [65188.587426] Aug 22 23:30:14 juju-e4d256-prod-github-runner-207 kernel: [65188.588328] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 23:30:14 juju-e4d256-prod-github-runner-207 kernel: [65188.589396] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:30:14 juju-e4d256-prod-github-runner-207 kernel: [65188.590452] ? _raw_spin_lock+0x22/0x30 Aug 22 23:30:14 juju-e4d256-prod-github-runner-207 kernel: [65188.591403] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:30:14 juju-e4d256-prod-github-runner-207 kernel: [65188.592444] direct_page_fault+0x206/0x310 [kvm] Aug 22 23:30:14 juju-e4d256-prod-github-runner-207 kernel: [65188.593487] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 23:30:14 juju-e4d256-prod-github-runner-207 kernel: [65188.594496] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 23:30:14 juju-e4d256-prod-github-runner-207 kernel: [65188.595499] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 23:30:14 juju-e4d256-prod-github-runner-207 kernel: [65188.596471] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 23:30:14 juju-e4d256-prod-github-runner-207 kernel: [65188.597430] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 23:30:14 juju-e4d256-prod-github-runner-207 kernel: [65188.598409] handle_exit+0x98/0x230 [kvm_amd] Aug 22 23:30:14 juju-e4d256-prod-github-runner-207 kernel: [65188.599301] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 23:30:14 juju-e4d256-prod-github-runner-207 kernel: [65188.600217] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 23:30:14 juju-e4d256-prod-github-runner-207 kernel: [65188.601168] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 23:30:14 juju-e4d256-prod-github-runner-207 kernel: [65188.602077] vcpu_run+0x62/0x2c0 [kvm] Aug 22 23:30:14 juju-e4d256-prod-github-runner-207 kernel: [65188.602888] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 23:30:14 juju-e4d256-prod-github-runner-207 kernel: [65188.603698] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 23:30:14 juju-e4d256-prod-github-runner-207 kernel: [65188.604551] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 23:30:14 juju-e4d256-prod-github-runner-207 kernel: [65188.605364] ? __seccomp_filter+0x4a/0x4a0 Aug 22 23:30:14 juju-e4d256-prod-github-runner-207 kernel: [65188.606109] ? __fget_files+0x86/0xc0 Aug 22 23:30:14 juju-e4d256-prod-github-runner-207 kernel: [65188.606823] __x64_sys_ioctl+0x95/0xd0 Aug 22 23:30:14 juju-e4d256-prod-github-runner-207 kernel: [65188.607517] do_syscall_64+0x5c/0xc0 Aug 22 23:30:14 juju-e4d256-prod-github-runner-207 kernel: [65188.608184] ? do_futex+0x162/0x1f0 Aug 22 23:30:14 juju-e4d256-prod-github-runner-207 kernel: [65188.608833] ? __x64_sys_futex+0x78/0x1e0 Aug 22 23:30:14 juju-e4d256-prod-github-runner-207 kernel: [65188.609518] ? __secure_computing+0xa9/0x120 Aug 22 23:30:14 juju-e4d256-prod-github-runner-207 kernel: [65188.610207] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 23:30:14 juju-e4d256-prod-github-runner-207 kernel: [65188.610968] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:30:14 juju-e4d256-prod-github-runner-207 kernel: [65188.611691] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:30:14 juju-e4d256-prod-github-runner-207 kernel: [65188.612411] ? do_syscall_64+0x69/0xc0 Aug 22 23:30:14 juju-e4d256-prod-github-runner-207 kernel: [65188.613067] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:30:14 juju-e4d256-prod-github-runner-207 kernel: [65188.613777] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:30:14 juju-e4d256-prod-github-runner-207 kernel: [65188.614478] ? do_syscall_64+0x69/0xc0 Aug 22 23:30:14 juju-e4d256-prod-github-runner-207 kernel: [65188.615103] ? do_syscall_64+0x69/0xc0 Aug 22 23:30:14 juju-e4d256-prod-github-runner-207 kernel: [65188.615743] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 23:30:14 juju-e4d256-prod-github-runner-207 kernel: [65188.616471] RIP: 0033:0x7faa5d0edaff Aug 22 23:30:14 juju-e4d256-prod-github-runner-207 kernel: [65188.617116] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 23:30:14 juju-e4d256-prod-github-runner-207 kernel: [65188.619104] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 23:30:14 juju-e4d256-prod-github-runner-207 kernel: [65188.620017] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 23:30:14 juju-e4d256-prod-github-runner-207 kernel: [65188.620909] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 23:30:14 juju-e4d256-prod-github-runner-207 kernel: [65188.621812] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 23:30:14 juju-e4d256-prod-github-runner-207 kernel: [65188.622702] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 23:30:14 juju-e4d256-prod-github-runner-207 kernel: [65188.623612] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 23:30:14 juju-e4d256-prod-github-runner-207 kernel: [65188.624535] Aug 22 23:30:42 juju-e4d256-prod-github-runner-207 kernel: [65216.541981] watchdog: BUG: soft lockup - CPU#1 stuck for 60629s! [qemu-system-x86:6715] Aug 22 23:30:42 juju-e4d256-prod-github-runner-207 kernel: [65216.543846] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 23:30:42 juju-e4d256-prod-github-runner-207 kernel: [65216.544158] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 23:30:42 juju-e4d256-prod-github-runner-207 kernel: [65216.556627] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 23:30:42 juju-e4d256-prod-github-runner-207 kernel: [65216.558073] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 23:30:42 juju-e4d256-prod-github-runner-207 kernel: [65216.559447] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:30:42 juju-e4d256-prod-github-runner-207 kernel: [65216.560718] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 23:30:42 juju-e4d256-prod-github-runner-207 kernel: [65216.563705] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 23:30:42 juju-e4d256-prod-github-runner-207 kernel: [65216.564826] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 23:30:42 juju-e4d256-prod-github-runner-207 kernel: [65216.566018] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 23:30:42 juju-e4d256-prod-github-runner-207 kernel: [65216.567232] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 23:30:42 juju-e4d256-prod-github-runner-207 kernel: [65216.568417] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 23:30:42 juju-e4d256-prod-github-runner-207 kernel: [65216.569962] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 23:30:42 juju-e4d256-prod-github-runner-207 kernel: [65216.571518] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 23:30:42 juju-e4d256-prod-github-runner-207 kernel: [65216.572813] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 23:30:42 juju-e4d256-prod-github-runner-207 kernel: [65216.574099] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 23:30:42 juju-e4d256-prod-github-runner-207 kernel: [65216.575742] Call Trace: Aug 22 23:30:42 juju-e4d256-prod-github-runner-207 kernel: [65216.576833] Aug 22 23:30:42 juju-e4d256-prod-github-runner-207 kernel: [65216.577835] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:30:42 juju-e4d256-prod-github-runner-207 kernel: [65216.579447] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:30:42 juju-e4d256-prod-github-runner-207 kernel: [65216.580856] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:30:42 juju-e4d256-prod-github-runner-207 kernel: [65216.582078] ? show_regs.part.0+0x23/0x29 Aug 22 23:30:42 juju-e4d256-prod-github-runner-207 kernel: [65216.583605] ? show_regs.cold+0x8/0xd Aug 22 23:30:42 juju-e4d256-prod-github-runner-207 kernel: [65216.584961] ? watchdog_timer_fn+0x1be/0x220 Aug 22 23:30:42 juju-e4d256-prod-github-runner-207 kernel: [65216.586081] ? lockup_detector_update_enable+0x60/0x60 Aug 22 23:30:42 juju-e4d256-prod-github-runner-207 kernel: [65216.587169] ? __hrtimer_run_queues+0x107/0x230 Aug 22 23:30:42 juju-e4d256-prod-github-runner-207 kernel: [65216.588287] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 23:30:42 juju-e4d256-prod-github-runner-207 kernel: [65216.589667] ? hrtimer_interrupt+0x101/0x220 Aug 22 23:30:42 juju-e4d256-prod-github-runner-207 kernel: [65216.591178] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 23:30:42 juju-e4d256-prod-github-runner-207 kernel: [65216.592571] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 23:30:42 juju-e4d256-prod-github-runner-207 kernel: [65216.593786] Aug 22 23:30:42 juju-e4d256-prod-github-runner-207 kernel: [65216.594799] Aug 22 23:30:42 juju-e4d256-prod-github-runner-207 kernel: [65216.595773] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 23:30:42 juju-e4d256-prod-github-runner-207 kernel: [65216.597184] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:30:42 juju-e4d256-prod-github-runner-207 kernel: [65216.598671] ? _raw_spin_lock+0x22/0x30 Aug 22 23:30:42 juju-e4d256-prod-github-runner-207 kernel: [65216.600105] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:30:42 juju-e4d256-prod-github-runner-207 kernel: [65216.601356] direct_page_fault+0x206/0x310 [kvm] Aug 22 23:30:42 juju-e4d256-prod-github-runner-207 kernel: [65216.602569] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 23:30:42 juju-e4d256-prod-github-runner-207 kernel: [65216.604190] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 23:30:42 juju-e4d256-prod-github-runner-207 kernel: [65216.605473] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 23:30:42 juju-e4d256-prod-github-runner-207 kernel: [65216.606876] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 23:30:42 juju-e4d256-prod-github-runner-207 kernel: [65216.608371] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 23:30:42 juju-e4d256-prod-github-runner-207 kernel: [65216.609564] handle_exit+0x98/0x230 [kvm_amd] Aug 22 23:30:42 juju-e4d256-prod-github-runner-207 kernel: [65216.610531] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 23:30:42 juju-e4d256-prod-github-runner-207 kernel: [65216.611462] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 23:30:42 juju-e4d256-prod-github-runner-207 kernel: [65216.612405] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 23:30:42 juju-e4d256-prod-github-runner-207 kernel: [65216.613455] vcpu_run+0x62/0x2c0 [kvm] Aug 22 23:30:42 juju-e4d256-prod-github-runner-207 kernel: [65216.614708] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 23:30:42 juju-e4d256-prod-github-runner-207 kernel: [65216.615963] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 23:30:42 juju-e4d256-prod-github-runner-207 kernel: [65216.617081] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 23:30:42 juju-e4d256-prod-github-runner-207 kernel: [65216.618240] ? __seccomp_filter+0x4a/0x4a0 Aug 22 23:30:42 juju-e4d256-prod-github-runner-207 kernel: [65216.619080] ? __fget_files+0x86/0xc0 Aug 22 23:30:42 juju-e4d256-prod-github-runner-207 kernel: [65216.619868] __x64_sys_ioctl+0x95/0xd0 Aug 22 23:30:42 juju-e4d256-prod-github-runner-207 kernel: [65216.620721] do_syscall_64+0x5c/0xc0 Aug 22 23:30:42 juju-e4d256-prod-github-runner-207 kernel: [65216.621416] ? do_futex+0x162/0x1f0 Aug 22 23:30:42 juju-e4d256-prod-github-runner-207 kernel: [65216.622354] ? __x64_sys_futex+0x78/0x1e0 Aug 22 23:30:42 juju-e4d256-prod-github-runner-207 kernel: [65216.623260] ? __secure_computing+0xa9/0x120 Aug 22 23:30:42 juju-e4d256-prod-github-runner-207 kernel: [65216.623967] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 23:30:42 juju-e4d256-prod-github-runner-207 kernel: [65216.624954] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:30:42 juju-e4d256-prod-github-runner-207 kernel: [65216.626019] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:30:42 juju-e4d256-prod-github-runner-207 kernel: [65216.627093] ? do_syscall_64+0x69/0xc0 Aug 22 23:30:42 juju-e4d256-prod-github-runner-207 kernel: [65216.628056] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:30:42 juju-e4d256-prod-github-runner-207 kernel: [65216.629127] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:30:42 juju-e4d256-prod-github-runner-207 kernel: [65216.630156] ? do_syscall_64+0x69/0xc0 Aug 22 23:30:42 juju-e4d256-prod-github-runner-207 kernel: [65216.631086] ? do_syscall_64+0x69/0xc0 Aug 22 23:30:42 juju-e4d256-prod-github-runner-207 kernel: [65216.632060] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 23:30:42 juju-e4d256-prod-github-runner-207 kernel: [65216.632831] RIP: 0033:0x7faa5d0edaff Aug 22 23:30:42 juju-e4d256-prod-github-runner-207 kernel: [65216.633558] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 23:30:42 juju-e4d256-prod-github-runner-207 kernel: [65216.636175] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 23:30:42 juju-e4d256-prod-github-runner-207 kernel: [65216.637429] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 23:30:42 juju-e4d256-prod-github-runner-207 kernel: [65216.638676] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 23:30:42 juju-e4d256-prod-github-runner-207 kernel: [65216.639996] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 23:30:42 juju-e4d256-prod-github-runner-207 kernel: [65216.641094] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 23:30:42 juju-e4d256-prod-github-runner-207 kernel: [65216.642042] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 23:30:42 juju-e4d256-prod-github-runner-207 kernel: [65216.643097] Aug 22 23:31:10 juju-e4d256-prod-github-runner-207 kernel: [65244.541995] watchdog: BUG: soft lockup - CPU#1 stuck for 60655s! [qemu-system-x86:6715] Aug 22 23:31:10 juju-e4d256-prod-github-runner-207 kernel: [65244.543501] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 23:31:10 juju-e4d256-prod-github-runner-207 kernel: [65244.543579] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 23:31:10 juju-e4d256-prod-github-runner-207 kernel: [65244.556476] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 23:31:10 juju-e4d256-prod-github-runner-207 kernel: [65244.557768] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 23:31:10 juju-e4d256-prod-github-runner-207 kernel: [65244.559032] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:31:10 juju-e4d256-prod-github-runner-207 kernel: [65244.560168] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 23:31:10 juju-e4d256-prod-github-runner-207 kernel: [65244.562873] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 23:31:10 juju-e4d256-prod-github-runner-207 kernel: [65244.564223] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 23:31:10 juju-e4d256-prod-github-runner-207 kernel: [65244.565476] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 23:31:10 juju-e4d256-prod-github-runner-207 kernel: [65244.566691] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 23:31:10 juju-e4d256-prod-github-runner-207 kernel: [65244.567950] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 23:31:10 juju-e4d256-prod-github-runner-207 kernel: [65244.569175] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 23:31:10 juju-e4d256-prod-github-runner-207 kernel: [65244.570396] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 23:31:10 juju-e4d256-prod-github-runner-207 kernel: [65244.571669] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 23:31:10 juju-e4d256-prod-github-runner-207 kernel: [65244.572798] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 23:31:10 juju-e4d256-prod-github-runner-207 kernel: [65244.574009] Call Trace: Aug 22 23:31:10 juju-e4d256-prod-github-runner-207 kernel: [65244.574927] Aug 22 23:31:10 juju-e4d256-prod-github-runner-207 kernel: [65244.575816] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:31:10 juju-e4d256-prod-github-runner-207 kernel: [65244.576862] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:31:10 juju-e4d256-prod-github-runner-207 kernel: [65244.577920] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:31:10 juju-e4d256-prod-github-runner-207 kernel: [65244.579031] ? show_regs.part.0+0x23/0x29 Aug 22 23:31:10 juju-e4d256-prod-github-runner-207 kernel: [65244.580050] ? show_regs.cold+0x8/0xd Aug 22 23:31:10 juju-e4d256-prod-github-runner-207 kernel: [65244.581042] ? watchdog_timer_fn+0x1be/0x220 Aug 22 23:31:10 juju-e4d256-prod-github-runner-207 kernel: [65244.582067] ? lockup_detector_update_enable+0x60/0x60 Aug 22 23:31:10 juju-e4d256-prod-github-runner-207 kernel: [65244.583146] ? __hrtimer_run_queues+0x107/0x230 Aug 22 23:31:10 juju-e4d256-prod-github-runner-207 kernel: [65244.584280] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 23:31:10 juju-e4d256-prod-github-runner-207 kernel: [65244.585377] ? hrtimer_interrupt+0x101/0x220 Aug 22 23:31:10 juju-e4d256-prod-github-runner-207 kernel: [65244.586413] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 23:31:10 juju-e4d256-prod-github-runner-207 kernel: [65244.587498] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 23:31:10 juju-e4d256-prod-github-runner-207 kernel: [65244.588572] Aug 22 23:31:10 juju-e4d256-prod-github-runner-207 kernel: [65244.589454] Aug 22 23:31:10 juju-e4d256-prod-github-runner-207 kernel: [65244.590400] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 23:31:10 juju-e4d256-prod-github-runner-207 kernel: [65244.591444] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:31:10 juju-e4d256-prod-github-runner-207 kernel: [65244.592508] ? _raw_spin_lock+0x22/0x30 Aug 22 23:31:10 juju-e4d256-prod-github-runner-207 kernel: [65244.593465] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:31:10 juju-e4d256-prod-github-runner-207 kernel: [65244.594492] direct_page_fault+0x206/0x310 [kvm] Aug 22 23:31:10 juju-e4d256-prod-github-runner-207 kernel: [65244.595559] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 23:31:10 juju-e4d256-prod-github-runner-207 kernel: [65244.596807] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 23:31:10 juju-e4d256-prod-github-runner-207 kernel: [65244.597903] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 23:31:10 juju-e4d256-prod-github-runner-207 kernel: [65244.598875] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 23:31:10 juju-e4d256-prod-github-runner-207 kernel: [65244.599820] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 23:31:10 juju-e4d256-prod-github-runner-207 kernel: [65244.600817] handle_exit+0x98/0x230 [kvm_amd] Aug 22 23:31:10 juju-e4d256-prod-github-runner-207 kernel: [65244.601717] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 23:31:10 juju-e4d256-prod-github-runner-207 kernel: [65244.602642] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 23:31:10 juju-e4d256-prod-github-runner-207 kernel: [65244.603570] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 23:31:10 juju-e4d256-prod-github-runner-207 kernel: [65244.604517] vcpu_run+0x62/0x2c0 [kvm] Aug 22 23:31:10 juju-e4d256-prod-github-runner-207 kernel: [65244.605342] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 23:31:10 juju-e4d256-prod-github-runner-207 kernel: [65244.606158] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 23:31:10 juju-e4d256-prod-github-runner-207 kernel: [65244.607051] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 23:31:10 juju-e4d256-prod-github-runner-207 kernel: [65244.607881] ? __seccomp_filter+0x4a/0x4a0 Aug 22 23:31:10 juju-e4d256-prod-github-runner-207 kernel: [65244.608664] ? __fget_files+0x86/0xc0 Aug 22 23:31:10 juju-e4d256-prod-github-runner-207 kernel: [65244.609375] __x64_sys_ioctl+0x95/0xd0 Aug 22 23:31:10 juju-e4d256-prod-github-runner-207 kernel: [65244.610070] do_syscall_64+0x5c/0xc0 Aug 22 23:31:10 juju-e4d256-prod-github-runner-207 kernel: [65244.610738] ? do_futex+0x162/0x1f0 Aug 22 23:31:10 juju-e4d256-prod-github-runner-207 kernel: [65244.611389] ? __x64_sys_futex+0x78/0x1e0 Aug 22 23:31:10 juju-e4d256-prod-github-runner-207 kernel: [65244.612062] ? __secure_computing+0xa9/0x120 Aug 22 23:31:10 juju-e4d256-prod-github-runner-207 kernel: [65244.612770] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 23:31:10 juju-e4d256-prod-github-runner-207 kernel: [65244.613529] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:31:10 juju-e4d256-prod-github-runner-207 kernel: [65244.614258] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:31:10 juju-e4d256-prod-github-runner-207 kernel: [65244.614982] ? do_syscall_64+0x69/0xc0 Aug 22 23:31:10 juju-e4d256-prod-github-runner-207 kernel: [65244.615628] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:31:10 juju-e4d256-prod-github-runner-207 kernel: [65244.616347] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:31:10 juju-e4d256-prod-github-runner-207 kernel: [65244.617046] ? do_syscall_64+0x69/0xc0 Aug 22 23:31:10 juju-e4d256-prod-github-runner-207 kernel: [65244.617674] ? do_syscall_64+0x69/0xc0 Aug 22 23:31:10 juju-e4d256-prod-github-runner-207 kernel: [65244.618303] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 23:31:10 juju-e4d256-prod-github-runner-207 kernel: [65244.619020] RIP: 0033:0x7faa5d0edaff Aug 22 23:31:10 juju-e4d256-prod-github-runner-207 kernel: [65244.619745] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 23:31:10 juju-e4d256-prod-github-runner-207 kernel: [65244.621877] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 23:31:10 juju-e4d256-prod-github-runner-207 kernel: [65244.622869] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 23:31:10 juju-e4d256-prod-github-runner-207 kernel: [65244.623774] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 23:31:10 juju-e4d256-prod-github-runner-207 kernel: [65244.624722] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 23:31:10 juju-e4d256-prod-github-runner-207 kernel: [65244.625630] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 23:31:10 juju-e4d256-prod-github-runner-207 kernel: [65244.626560] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 23:31:10 juju-e4d256-prod-github-runner-207 kernel: [65244.627475] Aug 22 23:31:38 juju-e4d256-prod-github-runner-207 kernel: [65272.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 60681s! [qemu-system-x86:6715] Aug 22 23:31:38 juju-e4d256-prod-github-runner-207 kernel: [65272.543174] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 23:31:38 juju-e4d256-prod-github-runner-207 kernel: [65272.543250] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 23:31:38 juju-e4d256-prod-github-runner-207 kernel: [65272.555645] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 23:31:38 juju-e4d256-prod-github-runner-207 kernel: [65272.556949] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 23:31:38 juju-e4d256-prod-github-runner-207 kernel: [65272.558197] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:31:38 juju-e4d256-prod-github-runner-207 kernel: [65272.559265] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 23:31:38 juju-e4d256-prod-github-runner-207 kernel: [65272.561901] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 23:31:38 juju-e4d256-prod-github-runner-207 kernel: [65272.562954] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 23:31:38 juju-e4d256-prod-github-runner-207 kernel: [65272.564159] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 23:31:38 juju-e4d256-prod-github-runner-207 kernel: [65272.565339] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 23:31:38 juju-e4d256-prod-github-runner-207 kernel: [65272.566513] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 23:31:38 juju-e4d256-prod-github-runner-207 kernel: [65272.567711] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 23:31:38 juju-e4d256-prod-github-runner-207 kernel: [65272.568906] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 23:31:38 juju-e4d256-prod-github-runner-207 kernel: [65272.570155] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 23:31:38 juju-e4d256-prod-github-runner-207 kernel: [65272.571258] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 23:31:38 juju-e4d256-prod-github-runner-207 kernel: [65272.572478] Call Trace: Aug 22 23:31:38 juju-e4d256-prod-github-runner-207 kernel: [65272.573394] Aug 22 23:31:38 juju-e4d256-prod-github-runner-207 kernel: [65272.574284] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:31:38 juju-e4d256-prod-github-runner-207 kernel: [65272.575324] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:31:38 juju-e4d256-prod-github-runner-207 kernel: [65272.576368] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:31:38 juju-e4d256-prod-github-runner-207 kernel: [65272.577510] ? show_regs.part.0+0x23/0x29 Aug 22 23:31:38 juju-e4d256-prod-github-runner-207 kernel: [65272.578666] ? show_regs.cold+0x8/0xd Aug 22 23:31:38 juju-e4d256-prod-github-runner-207 kernel: [65272.579663] ? watchdog_timer_fn+0x1be/0x220 Aug 22 23:31:38 juju-e4d256-prod-github-runner-207 kernel: [65272.580715] ? lockup_detector_update_enable+0x60/0x60 Aug 22 23:31:38 juju-e4d256-prod-github-runner-207 kernel: [65272.581797] ? __hrtimer_run_queues+0x107/0x230 Aug 22 23:31:38 juju-e4d256-prod-github-runner-207 kernel: [65272.582843] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 23:31:38 juju-e4d256-prod-github-runner-207 kernel: [65272.583877] ? hrtimer_interrupt+0x101/0x220 Aug 22 23:31:38 juju-e4d256-prod-github-runner-207 kernel: [65272.584916] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 23:31:38 juju-e4d256-prod-github-runner-207 kernel: [65272.585998] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 23:31:38 juju-e4d256-prod-github-runner-207 kernel: [65272.587050] Aug 22 23:31:38 juju-e4d256-prod-github-runner-207 kernel: [65272.587906] Aug 22 23:31:38 juju-e4d256-prod-github-runner-207 kernel: [65272.588772] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 23:31:38 juju-e4d256-prod-github-runner-207 kernel: [65272.589824] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:31:38 juju-e4d256-prod-github-runner-207 kernel: [65272.590873] ? _raw_spin_lock+0x22/0x30 Aug 22 23:31:38 juju-e4d256-prod-github-runner-207 kernel: [65272.591832] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:31:38 juju-e4d256-prod-github-runner-207 kernel: [65272.592883] direct_page_fault+0x206/0x310 [kvm] Aug 22 23:31:38 juju-e4d256-prod-github-runner-207 kernel: [65272.593918] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 23:31:38 juju-e4d256-prod-github-runner-207 kernel: [65272.594936] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 23:31:38 juju-e4d256-prod-github-runner-207 kernel: [65272.595962] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 23:31:38 juju-e4d256-prod-github-runner-207 kernel: [65272.596987] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 23:31:38 juju-e4d256-prod-github-runner-207 kernel: [65272.597950] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 23:31:38 juju-e4d256-prod-github-runner-207 kernel: [65272.598942] handle_exit+0x98/0x230 [kvm_amd] Aug 22 23:31:38 juju-e4d256-prod-github-runner-207 kernel: [65272.599862] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 23:31:38 juju-e4d256-prod-github-runner-207 kernel: [65272.600820] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 23:31:38 juju-e4d256-prod-github-runner-207 kernel: [65272.601918] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 23:31:38 juju-e4d256-prod-github-runner-207 kernel: [65272.602831] vcpu_run+0x62/0x2c0 [kvm] Aug 22 23:31:38 juju-e4d256-prod-github-runner-207 kernel: [65272.603670] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 23:31:38 juju-e4d256-prod-github-runner-207 kernel: [65272.604499] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 23:31:38 juju-e4d256-prod-github-runner-207 kernel: [65272.605364] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 23:31:38 juju-e4d256-prod-github-runner-207 kernel: [65272.606165] ? __seccomp_filter+0x4a/0x4a0 Aug 22 23:31:38 juju-e4d256-prod-github-runner-207 kernel: [65272.606913] ? __fget_files+0x86/0xc0 Aug 22 23:31:38 juju-e4d256-prod-github-runner-207 kernel: [65272.607624] __x64_sys_ioctl+0x95/0xd0 Aug 22 23:31:38 juju-e4d256-prod-github-runner-207 kernel: [65272.608338] do_syscall_64+0x5c/0xc0 Aug 22 23:31:38 juju-e4d256-prod-github-runner-207 kernel: [65272.609017] ? do_futex+0x162/0x1f0 Aug 22 23:31:38 juju-e4d256-prod-github-runner-207 kernel: [65272.609675] ? __x64_sys_futex+0x78/0x1e0 Aug 22 23:31:38 juju-e4d256-prod-github-runner-207 kernel: [65272.610384] ? __secure_computing+0xa9/0x120 Aug 22 23:31:38 juju-e4d256-prod-github-runner-207 kernel: [65272.611090] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 23:31:38 juju-e4d256-prod-github-runner-207 kernel: [65272.611864] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:31:38 juju-e4d256-prod-github-runner-207 kernel: [65272.612607] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:31:38 juju-e4d256-prod-github-runner-207 kernel: [65272.613356] ? do_syscall_64+0x69/0xc0 Aug 22 23:31:38 juju-e4d256-prod-github-runner-207 kernel: [65272.614013] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:31:38 juju-e4d256-prod-github-runner-207 kernel: [65272.614728] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:31:38 juju-e4d256-prod-github-runner-207 kernel: [65272.615431] ? do_syscall_64+0x69/0xc0 Aug 22 23:31:38 juju-e4d256-prod-github-runner-207 kernel: [65272.616082] ? do_syscall_64+0x69/0xc0 Aug 22 23:31:38 juju-e4d256-prod-github-runner-207 kernel: [65272.616717] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 23:31:38 juju-e4d256-prod-github-runner-207 kernel: [65272.617438] RIP: 0033:0x7faa5d0edaff Aug 22 23:31:38 juju-e4d256-prod-github-runner-207 kernel: [65272.618071] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 23:31:38 juju-e4d256-prod-github-runner-207 kernel: [65272.620133] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 23:31:38 juju-e4d256-prod-github-runner-207 kernel: [65272.621067] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 23:31:38 juju-e4d256-prod-github-runner-207 kernel: [65272.621972] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 23:31:38 juju-e4d256-prod-github-runner-207 kernel: [65272.622879] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 23:31:38 juju-e4d256-prod-github-runner-207 kernel: [65272.623784] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 23:31:38 juju-e4d256-prod-github-runner-207 kernel: [65272.624705] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 23:31:38 juju-e4d256-prod-github-runner-207 kernel: [65272.625621] Aug 22 23:32:06 juju-e4d256-prod-github-runner-207 kernel: [65300.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 60707s! [qemu-system-x86:6715] Aug 22 23:32:06 juju-e4d256-prod-github-runner-207 kernel: [65300.543895] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 23:32:06 juju-e4d256-prod-github-runner-207 kernel: [65300.544201] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 23:32:06 juju-e4d256-prod-github-runner-207 kernel: [65300.556513] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 23:32:06 juju-e4d256-prod-github-runner-207 kernel: [65300.557785] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 23:32:06 juju-e4d256-prod-github-runner-207 kernel: [65300.559015] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:32:06 juju-e4d256-prod-github-runner-207 kernel: [65300.560140] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 23:32:06 juju-e4d256-prod-github-runner-207 kernel: [65300.562775] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 23:32:06 juju-e4d256-prod-github-runner-207 kernel: [65300.563916] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 23:32:06 juju-e4d256-prod-github-runner-207 kernel: [65300.565158] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 23:32:06 juju-e4d256-prod-github-runner-207 kernel: [65300.566347] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 23:32:06 juju-e4d256-prod-github-runner-207 kernel: [65300.567530] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 23:32:06 juju-e4d256-prod-github-runner-207 kernel: [65300.568739] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 23:32:06 juju-e4d256-prod-github-runner-207 kernel: [65300.569956] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 23:32:06 juju-e4d256-prod-github-runner-207 kernel: [65300.571214] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 23:32:06 juju-e4d256-prod-github-runner-207 kernel: [65300.572430] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 23:32:06 juju-e4d256-prod-github-runner-207 kernel: [65300.573657] Call Trace: Aug 22 23:32:06 juju-e4d256-prod-github-runner-207 kernel: [65300.574595] Aug 22 23:32:06 juju-e4d256-prod-github-runner-207 kernel: [65300.575680] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:32:06 juju-e4d256-prod-github-runner-207 kernel: [65300.576741] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:32:06 juju-e4d256-prod-github-runner-207 kernel: [65300.577773] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:32:06 juju-e4d256-prod-github-runner-207 kernel: [65300.579147] ? show_regs.part.0+0x23/0x29 Aug 22 23:32:06 juju-e4d256-prod-github-runner-207 kernel: [65300.580486] ? show_regs.cold+0x8/0xd Aug 22 23:32:06 juju-e4d256-prod-github-runner-207 kernel: [65300.581649] ? watchdog_timer_fn+0x1be/0x220 Aug 22 23:32:06 juju-e4d256-prod-github-runner-207 kernel: [65300.582666] ? lockup_detector_update_enable+0x60/0x60 Aug 22 23:32:06 juju-e4d256-prod-github-runner-207 kernel: [65300.583778] ? __hrtimer_run_queues+0x107/0x230 Aug 22 23:32:06 juju-e4d256-prod-github-runner-207 kernel: [65300.584816] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 23:32:06 juju-e4d256-prod-github-runner-207 kernel: [65300.585858] ? hrtimer_interrupt+0x101/0x220 Aug 22 23:32:06 juju-e4d256-prod-github-runner-207 kernel: [65300.586883] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 23:32:06 juju-e4d256-prod-github-runner-207 kernel: [65300.588011] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 23:32:06 juju-e4d256-prod-github-runner-207 kernel: [65300.589076] Aug 22 23:32:06 juju-e4d256-prod-github-runner-207 kernel: [65300.589999] Aug 22 23:32:06 juju-e4d256-prod-github-runner-207 kernel: [65300.590895] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 23:32:06 juju-e4d256-prod-github-runner-207 kernel: [65300.592056] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:32:06 juju-e4d256-prod-github-runner-207 kernel: [65300.593206] ? _raw_spin_lock+0x22/0x30 Aug 22 23:32:06 juju-e4d256-prod-github-runner-207 kernel: [65300.594231] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:32:06 juju-e4d256-prod-github-runner-207 kernel: [65300.595349] direct_page_fault+0x206/0x310 [kvm] Aug 22 23:32:06 juju-e4d256-prod-github-runner-207 kernel: [65300.596485] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 23:32:06 juju-e4d256-prod-github-runner-207 kernel: [65300.597602] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 23:32:06 juju-e4d256-prod-github-runner-207 kernel: [65300.598705] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 23:32:06 juju-e4d256-prod-github-runner-207 kernel: [65300.599802] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 23:32:06 juju-e4d256-prod-github-runner-207 kernel: [65300.600763] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 23:32:06 juju-e4d256-prod-github-runner-207 kernel: [65300.601780] handle_exit+0x98/0x230 [kvm_amd] Aug 22 23:32:06 juju-e4d256-prod-github-runner-207 kernel: [65300.602680] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 23:32:06 juju-e4d256-prod-github-runner-207 kernel: [65300.603614] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 23:32:06 juju-e4d256-prod-github-runner-207 kernel: [65300.604547] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 23:32:06 juju-e4d256-prod-github-runner-207 kernel: [65300.605466] vcpu_run+0x62/0x2c0 [kvm] Aug 22 23:32:06 juju-e4d256-prod-github-runner-207 kernel: [65300.606281] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 23:32:06 juju-e4d256-prod-github-runner-207 kernel: [65300.607236] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 23:32:06 juju-e4d256-prod-github-runner-207 kernel: [65300.608152] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 23:32:06 juju-e4d256-prod-github-runner-207 kernel: [65300.608955] ? __seccomp_filter+0x4a/0x4a0 Aug 22 23:32:06 juju-e4d256-prod-github-runner-207 kernel: [65300.609703] ? __fget_files+0x86/0xc0 Aug 22 23:32:06 juju-e4d256-prod-github-runner-207 kernel: [65300.610416] __x64_sys_ioctl+0x95/0xd0 Aug 22 23:32:06 juju-e4d256-prod-github-runner-207 kernel: [65300.611113] do_syscall_64+0x5c/0xc0 Aug 22 23:32:06 juju-e4d256-prod-github-runner-207 kernel: [65300.611797] ? do_futex+0x162/0x1f0 Aug 22 23:32:06 juju-e4d256-prod-github-runner-207 kernel: [65300.612454] ? __x64_sys_futex+0x78/0x1e0 Aug 22 23:32:06 juju-e4d256-prod-github-runner-207 kernel: [65300.613130] ? __secure_computing+0xa9/0x120 Aug 22 23:32:06 juju-e4d256-prod-github-runner-207 kernel: [65300.613825] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 23:32:06 juju-e4d256-prod-github-runner-207 kernel: [65300.614585] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:32:06 juju-e4d256-prod-github-runner-207 kernel: [65300.615307] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:32:06 juju-e4d256-prod-github-runner-207 kernel: [65300.616041] ? do_syscall_64+0x69/0xc0 Aug 22 23:32:06 juju-e4d256-prod-github-runner-207 kernel: [65300.616707] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:32:06 juju-e4d256-prod-github-runner-207 kernel: [65300.617414] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:32:06 juju-e4d256-prod-github-runner-207 kernel: [65300.618270] ? do_syscall_64+0x69/0xc0 Aug 22 23:32:06 juju-e4d256-prod-github-runner-207 kernel: [65300.618896] ? do_syscall_64+0x69/0xc0 Aug 22 23:32:06 juju-e4d256-prod-github-runner-207 kernel: [65300.619525] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 23:32:06 juju-e4d256-prod-github-runner-207 kernel: [65300.620245] RIP: 0033:0x7faa5d0edaff Aug 22 23:32:06 juju-e4d256-prod-github-runner-207 kernel: [65300.620904] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 23:32:06 juju-e4d256-prod-github-runner-207 kernel: [65300.622903] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 23:32:06 juju-e4d256-prod-github-runner-207 kernel: [65300.623827] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 23:32:06 juju-e4d256-prod-github-runner-207 kernel: [65300.624717] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 23:32:06 juju-e4d256-prod-github-runner-207 kernel: [65300.625617] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 23:32:06 juju-e4d256-prod-github-runner-207 kernel: [65300.626504] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 23:32:06 juju-e4d256-prod-github-runner-207 kernel: [65300.627391] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 23:32:06 juju-e4d256-prod-github-runner-207 kernel: [65300.628313] Aug 22 23:32:34 juju-e4d256-prod-github-runner-207 kernel: [65328.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 60733s! [qemu-system-x86:6715] Aug 22 23:32:34 juju-e4d256-prod-github-runner-207 kernel: [65328.543151] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 23:32:34 juju-e4d256-prod-github-runner-207 kernel: [65328.543247] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 23:32:34 juju-e4d256-prod-github-runner-207 kernel: [65328.555763] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 23:32:34 juju-e4d256-prod-github-runner-207 kernel: [65328.557051] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 23:32:34 juju-e4d256-prod-github-runner-207 kernel: [65328.558285] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:32:34 juju-e4d256-prod-github-runner-207 kernel: [65328.559374] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 23:32:34 juju-e4d256-prod-github-runner-207 kernel: [65328.561963] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 23:32:34 juju-e4d256-prod-github-runner-207 kernel: [65328.563018] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 23:32:34 juju-e4d256-prod-github-runner-207 kernel: [65328.564212] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 23:32:34 juju-e4d256-prod-github-runner-207 kernel: [65328.565382] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 23:32:34 juju-e4d256-prod-github-runner-207 kernel: [65328.566556] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 23:32:34 juju-e4d256-prod-github-runner-207 kernel: [65328.567744] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 23:32:34 juju-e4d256-prod-github-runner-207 kernel: [65328.568927] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 23:32:34 juju-e4d256-prod-github-runner-207 kernel: [65328.570182] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 23:32:34 juju-e4d256-prod-github-runner-207 kernel: [65328.571291] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 23:32:34 juju-e4d256-prod-github-runner-207 kernel: [65328.572499] Call Trace: Aug 22 23:32:34 juju-e4d256-prod-github-runner-207 kernel: [65328.573415] Aug 22 23:32:34 juju-e4d256-prod-github-runner-207 kernel: [65328.574338] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:32:34 juju-e4d256-prod-github-runner-207 kernel: [65328.575437] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:32:34 juju-e4d256-prod-github-runner-207 kernel: [65328.576486] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:32:34 juju-e4d256-prod-github-runner-207 kernel: [65328.577571] ? show_regs.part.0+0x23/0x29 Aug 22 23:32:34 juju-e4d256-prod-github-runner-207 kernel: [65328.578580] ? show_regs.cold+0x8/0xd Aug 22 23:32:34 juju-e4d256-prod-github-runner-207 kernel: [65328.579580] ? watchdog_timer_fn+0x1be/0x220 Aug 22 23:32:34 juju-e4d256-prod-github-runner-207 kernel: [65328.580598] ? lockup_detector_update_enable+0x60/0x60 Aug 22 23:32:34 juju-e4d256-prod-github-runner-207 kernel: [65328.581671] ? __hrtimer_run_queues+0x107/0x230 Aug 22 23:32:34 juju-e4d256-prod-github-runner-207 kernel: [65328.582706] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 23:32:34 juju-e4d256-prod-github-runner-207 kernel: [65328.583751] ? hrtimer_interrupt+0x101/0x220 Aug 22 23:32:34 juju-e4d256-prod-github-runner-207 kernel: [65328.584773] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 23:32:34 juju-e4d256-prod-github-runner-207 kernel: [65328.585995] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 23:32:34 juju-e4d256-prod-github-runner-207 kernel: [65328.587049] Aug 22 23:32:34 juju-e4d256-prod-github-runner-207 kernel: [65328.587919] Aug 22 23:32:34 juju-e4d256-prod-github-runner-207 kernel: [65328.588782] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 23:32:34 juju-e4d256-prod-github-runner-207 kernel: [65328.589829] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:32:34 juju-e4d256-prod-github-runner-207 kernel: [65328.590878] ? _raw_spin_lock+0x22/0x30 Aug 22 23:32:34 juju-e4d256-prod-github-runner-207 kernel: [65328.591854] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:32:34 juju-e4d256-prod-github-runner-207 kernel: [65328.593050] direct_page_fault+0x206/0x310 [kvm] Aug 22 23:32:34 juju-e4d256-prod-github-runner-207 kernel: [65328.594084] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 23:32:34 juju-e4d256-prod-github-runner-207 kernel: [65328.595101] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 23:32:34 juju-e4d256-prod-github-runner-207 kernel: [65328.596126] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 23:32:34 juju-e4d256-prod-github-runner-207 kernel: [65328.597103] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 23:32:34 juju-e4d256-prod-github-runner-207 kernel: [65328.598064] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 23:32:34 juju-e4d256-prod-github-runner-207 kernel: [65328.599069] handle_exit+0x98/0x230 [kvm_amd] Aug 22 23:32:34 juju-e4d256-prod-github-runner-207 kernel: [65328.599995] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 23:32:34 juju-e4d256-prod-github-runner-207 kernel: [65328.600925] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 23:32:34 juju-e4d256-prod-github-runner-207 kernel: [65328.601870] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 23:32:34 juju-e4d256-prod-github-runner-207 kernel: [65328.602804] vcpu_run+0x62/0x2c0 [kvm] Aug 22 23:32:34 juju-e4d256-prod-github-runner-207 kernel: [65328.603652] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 23:32:34 juju-e4d256-prod-github-runner-207 kernel: [65328.604467] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 23:32:34 juju-e4d256-prod-github-runner-207 kernel: [65328.605329] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 23:32:34 juju-e4d256-prod-github-runner-207 kernel: [65328.606134] ? __seccomp_filter+0x4a/0x4a0 Aug 22 23:32:34 juju-e4d256-prod-github-runner-207 kernel: [65328.606885] ? __fget_files+0x86/0xc0 Aug 22 23:32:34 juju-e4d256-prod-github-runner-207 kernel: [65328.607613] __x64_sys_ioctl+0x95/0xd0 Aug 22 23:32:34 juju-e4d256-prod-github-runner-207 kernel: [65328.608312] do_syscall_64+0x5c/0xc0 Aug 22 23:32:34 juju-e4d256-prod-github-runner-207 kernel: [65328.609011] ? do_futex+0x162/0x1f0 Aug 22 23:32:34 juju-e4d256-prod-github-runner-207 kernel: [65328.609773] ? __x64_sys_futex+0x78/0x1e0 Aug 22 23:32:34 juju-e4d256-prod-github-runner-207 kernel: [65328.610522] ? __secure_computing+0xa9/0x120 Aug 22 23:32:34 juju-e4d256-prod-github-runner-207 kernel: [65328.611222] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 23:32:34 juju-e4d256-prod-github-runner-207 kernel: [65328.612019] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:32:34 juju-e4d256-prod-github-runner-207 kernel: [65328.612753] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:32:34 juju-e4d256-prod-github-runner-207 kernel: [65328.613484] ? do_syscall_64+0x69/0xc0 Aug 22 23:32:34 juju-e4d256-prod-github-runner-207 kernel: [65328.614136] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:32:34 juju-e4d256-prod-github-runner-207 kernel: [65328.614853] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:32:34 juju-e4d256-prod-github-runner-207 kernel: [65328.615560] ? do_syscall_64+0x69/0xc0 Aug 22 23:32:34 juju-e4d256-prod-github-runner-207 kernel: [65328.616195] ? do_syscall_64+0x69/0xc0 Aug 22 23:32:34 juju-e4d256-prod-github-runner-207 kernel: [65328.616825] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 23:32:34 juju-e4d256-prod-github-runner-207 kernel: [65328.617539] RIP: 0033:0x7faa5d0edaff Aug 22 23:32:34 juju-e4d256-prod-github-runner-207 kernel: [65328.618225] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 23:32:34 juju-e4d256-prod-github-runner-207 kernel: [65328.620277] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 23:32:34 juju-e4d256-prod-github-runner-207 kernel: [65328.621203] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 23:32:34 juju-e4d256-prod-github-runner-207 kernel: [65328.622114] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 23:32:34 juju-e4d256-prod-github-runner-207 kernel: [65328.623053] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 23:32:34 juju-e4d256-prod-github-runner-207 kernel: [65328.623980] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 23:32:34 juju-e4d256-prod-github-runner-207 kernel: [65328.624878] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 23:32:34 juju-e4d256-prod-github-runner-207 kernel: [65328.625783] Aug 22 23:32:47 juju-e4d256-prod-github-runner-207 kernel: [65341.544705] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 23:32:47 juju-e4d256-prod-github-runner-207 kernel: [65341.545685] rcu: 1-....: (16254687 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=7847366 Aug 22 23:32:47 juju-e4d256-prod-github-runner-207 kernel: [65341.546841] (t=16306086 jiffies g=23269 q=57440) Aug 22 23:32:47 juju-e4d256-prod-github-runner-207 kernel: [65341.547651] NMI backtrace for cpu 1 Aug 22 23:32:47 juju-e4d256-prod-github-runner-207 kernel: [65341.548362] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 23:32:47 juju-e4d256-prod-github-runner-207 kernel: [65341.549478] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 23:32:47 juju-e4d256-prod-github-runner-207 kernel: [65341.550568] Call Trace: Aug 22 23:32:47 juju-e4d256-prod-github-runner-207 kernel: [65341.551276] Aug 22 23:32:47 juju-e4d256-prod-github-runner-207 kernel: [65341.551929] show_stack+0x52/0x5c Aug 22 23:32:47 juju-e4d256-prod-github-runner-207 kernel: [65341.552660] dump_stack_lvl+0x4a/0x63 Aug 22 23:32:47 juju-e4d256-prod-github-runner-207 kernel: [65341.553410] dump_stack+0x10/0x16 Aug 22 23:32:47 juju-e4d256-prod-github-runner-207 kernel: [65341.554131] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 23:32:47 juju-e4d256-prod-github-runner-207 kernel: [65341.554927] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 23:32:47 juju-e4d256-prod-github-runner-207 kernel: [65341.555741] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 23:32:47 juju-e4d256-prod-github-runner-207 kernel: [65341.556580] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 23:32:47 juju-e4d256-prod-github-runner-207 kernel: [65341.557410] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 23:32:47 juju-e4d256-prod-github-runner-207 kernel: [65341.558229] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 23:32:47 juju-e4d256-prod-github-runner-207 kernel: [65341.559008] print_cpu_stall.cold+0x2f/0xe2 Aug 22 23:32:47 juju-e4d256-prod-github-runner-207 kernel: [65341.559793] ? timekeeping_update+0xf7/0x150 Aug 22 23:32:47 juju-e4d256-prod-github-runner-207 kernel: [65341.560582] check_cpu_stall+0x109/0x270 Aug 22 23:32:47 juju-e4d256-prod-github-runner-207 kernel: [65341.561351] rcu_sched_clock_irq+0x9a/0x250 Aug 22 23:32:47 juju-e4d256-prod-github-runner-207 kernel: [65341.562132] update_process_times+0x94/0xd0 Aug 22 23:32:47 juju-e4d256-prod-github-runner-207 kernel: [65341.562910] tick_sched_handle+0x29/0x70 Aug 22 23:32:47 juju-e4d256-prod-github-runner-207 kernel: [65341.563679] tick_sched_timer+0x8c/0xc0 Aug 22 23:32:47 juju-e4d256-prod-github-runner-207 kernel: [65341.564430] ? tick_nohz_handler+0xb0/0xb0 Aug 22 23:32:47 juju-e4d256-prod-github-runner-207 kernel: [65341.565209] __hrtimer_run_queues+0x107/0x230 Aug 22 23:32:47 juju-e4d256-prod-github-runner-207 kernel: [65341.566000] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 23:32:47 juju-e4d256-prod-github-runner-207 kernel: [65341.566800] hrtimer_interrupt+0x101/0x220 Aug 22 23:32:47 juju-e4d256-prod-github-runner-207 kernel: [65341.567589] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 23:32:47 juju-e4d256-prod-github-runner-207 kernel: [65341.568413] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 23:32:47 juju-e4d256-prod-github-runner-207 kernel: [65341.569234] Aug 22 23:32:47 juju-e4d256-prod-github-runner-207 kernel: [65341.569890] Aug 22 23:32:47 juju-e4d256-prod-github-runner-207 kernel: [65341.570559] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 23:32:47 juju-e4d256-prod-github-runner-207 kernel: [65341.571437] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:32:47 juju-e4d256-prod-github-runner-207 kernel: [65341.572348] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 23:32:47 juju-e4d256-prod-github-runner-207 kernel: [65341.574606] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 23:32:47 juju-e4d256-prod-github-runner-207 kernel: [65341.575559] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 23:32:47 juju-e4d256-prod-github-runner-207 kernel: [65341.576585] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 23:32:47 juju-e4d256-prod-github-runner-207 kernel: [65341.577589] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 23:32:47 juju-e4d256-prod-github-runner-207 kernel: [65341.578573] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 23:32:47 juju-e4d256-prod-github-runner-207 kernel: [65341.579564] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 23:32:47 juju-e4d256-prod-github-runner-207 kernel: [65341.580543] ? _raw_spin_lock+0x22/0x30 Aug 22 23:32:47 juju-e4d256-prod-github-runner-207 kernel: [65341.581317] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:32:47 juju-e4d256-prod-github-runner-207 kernel: [65341.582170] direct_page_fault+0x206/0x310 [kvm] Aug 22 23:32:47 juju-e4d256-prod-github-runner-207 kernel: [65341.583029] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 23:32:47 juju-e4d256-prod-github-runner-207 kernel: [65341.583889] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 23:32:47 juju-e4d256-prod-github-runner-207 kernel: [65341.584723] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 23:32:47 juju-e4d256-prod-github-runner-207 kernel: [65341.585550] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 23:32:47 juju-e4d256-prod-github-runner-207 kernel: [65341.586396] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 23:32:47 juju-e4d256-prod-github-runner-207 kernel: [65341.587267] handle_exit+0x98/0x230 [kvm_amd] Aug 22 23:32:47 juju-e4d256-prod-github-runner-207 kernel: [65341.588044] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 23:32:47 juju-e4d256-prod-github-runner-207 kernel: [65341.588860] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 23:32:47 juju-e4d256-prod-github-runner-207 kernel: [65341.589684] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 23:32:47 juju-e4d256-prod-github-runner-207 kernel: [65341.590482] vcpu_run+0x62/0x2c0 [kvm] Aug 22 23:32:47 juju-e4d256-prod-github-runner-207 kernel: [65341.591240] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 23:32:47 juju-e4d256-prod-github-runner-207 kernel: [65341.592014] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 23:32:47 juju-e4d256-prod-github-runner-207 kernel: [65341.592840] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 23:32:47 juju-e4d256-prod-github-runner-207 kernel: [65341.593620] ? __seccomp_filter+0x4a/0x4a0 Aug 22 23:32:47 juju-e4d256-prod-github-runner-207 kernel: [65341.594356] ? __fget_files+0x86/0xc0 Aug 22 23:32:47 juju-e4d256-prod-github-runner-207 kernel: [65341.595060] __x64_sys_ioctl+0x95/0xd0 Aug 22 23:32:47 juju-e4d256-prod-github-runner-207 kernel: [65341.595785] do_syscall_64+0x5c/0xc0 Aug 22 23:32:47 juju-e4d256-prod-github-runner-207 kernel: [65341.596485] ? do_futex+0x162/0x1f0 Aug 22 23:32:47 juju-e4d256-prod-github-runner-207 kernel: [65341.597183] ? __x64_sys_futex+0x78/0x1e0 Aug 22 23:32:47 juju-e4d256-prod-github-runner-207 kernel: [65341.597901] ? __secure_computing+0xa9/0x120 Aug 22 23:32:47 juju-e4d256-prod-github-runner-207 kernel: [65341.598628] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 23:32:47 juju-e4d256-prod-github-runner-207 kernel: [65341.599446] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:32:47 juju-e4d256-prod-github-runner-207 kernel: [65341.600231] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:32:47 juju-e4d256-prod-github-runner-207 kernel: [65341.601009] ? do_syscall_64+0x69/0xc0 Aug 22 23:32:47 juju-e4d256-prod-github-runner-207 kernel: [65341.601729] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:32:47 juju-e4d256-prod-github-runner-207 kernel: [65341.602519] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:32:47 juju-e4d256-prod-github-runner-207 kernel: [65341.603305] ? do_syscall_64+0x69/0xc0 Aug 22 23:32:47 juju-e4d256-prod-github-runner-207 kernel: [65341.604023] ? do_syscall_64+0x69/0xc0 Aug 22 23:32:47 juju-e4d256-prod-github-runner-207 kernel: [65341.604722] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 23:32:47 juju-e4d256-prod-github-runner-207 kernel: [65341.605507] RIP: 0033:0x7faa5d0edaff Aug 22 23:32:47 juju-e4d256-prod-github-runner-207 kernel: [65341.606220] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 23:32:47 juju-e4d256-prod-github-runner-207 kernel: [65341.608391] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 23:32:47 juju-e4d256-prod-github-runner-207 kernel: [65341.609387] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 23:32:47 juju-e4d256-prod-github-runner-207 kernel: [65341.610350] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 23:32:47 juju-e4d256-prod-github-runner-207 kernel: [65341.611344] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 23:32:47 juju-e4d256-prod-github-runner-207 kernel: [65341.612343] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 23:32:47 juju-e4d256-prod-github-runner-207 kernel: [65341.613299] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 23:32:47 juju-e4d256-prod-github-runner-207 kernel: [65341.614233] Aug 22 23:33:14 juju-e4d256-prod-github-runner-207 kernel: [65368.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 60771s! [qemu-system-x86:6715] Aug 22 23:33:14 juju-e4d256-prod-github-runner-207 kernel: [65368.543115] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 23:33:14 juju-e4d256-prod-github-runner-207 kernel: [65368.543188] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 23:33:14 juju-e4d256-prod-github-runner-207 kernel: [65368.555452] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 23:33:14 juju-e4d256-prod-github-runner-207 kernel: [65368.556734] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 23:33:14 juju-e4d256-prod-github-runner-207 kernel: [65368.557971] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:33:14 juju-e4d256-prod-github-runner-207 kernel: [65368.559055] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 23:33:14 juju-e4d256-prod-github-runner-207 kernel: [65368.561662] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 23:33:14 juju-e4d256-prod-github-runner-207 kernel: [65368.562716] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 23:33:14 juju-e4d256-prod-github-runner-207 kernel: [65368.563900] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 23:33:14 juju-e4d256-prod-github-runner-207 kernel: [65368.565074] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 23:33:14 juju-e4d256-prod-github-runner-207 kernel: [65368.566252] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 23:33:14 juju-e4d256-prod-github-runner-207 kernel: [65368.567431] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 23:33:14 juju-e4d256-prod-github-runner-207 kernel: [65368.568607] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 23:33:14 juju-e4d256-prod-github-runner-207 kernel: [65368.569854] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 23:33:14 juju-e4d256-prod-github-runner-207 kernel: [65368.571023] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 23:33:14 juju-e4d256-prod-github-runner-207 kernel: [65368.572393] Call Trace: Aug 22 23:33:14 juju-e4d256-prod-github-runner-207 kernel: [65368.573327] Aug 22 23:33:14 juju-e4d256-prod-github-runner-207 kernel: [65368.574236] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:33:14 juju-e4d256-prod-github-runner-207 kernel: [65368.575302] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:33:14 juju-e4d256-prod-github-runner-207 kernel: [65368.576342] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:33:14 juju-e4d256-prod-github-runner-207 kernel: [65368.577463] ? show_regs.part.0+0x23/0x29 Aug 22 23:33:14 juju-e4d256-prod-github-runner-207 kernel: [65368.578483] ? show_regs.cold+0x8/0xd Aug 22 23:33:14 juju-e4d256-prod-github-runner-207 kernel: [65368.579484] ? watchdog_timer_fn+0x1be/0x220 Aug 22 23:33:14 juju-e4d256-prod-github-runner-207 kernel: [65368.580508] ? lockup_detector_update_enable+0x60/0x60 Aug 22 23:33:14 juju-e4d256-prod-github-runner-207 kernel: [65368.581602] ? __hrtimer_run_queues+0x107/0x230 Aug 22 23:33:14 juju-e4d256-prod-github-runner-207 kernel: [65368.582680] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 23:33:14 juju-e4d256-prod-github-runner-207 kernel: [65368.583787] ? hrtimer_interrupt+0x101/0x220 Aug 22 23:33:14 juju-e4d256-prod-github-runner-207 kernel: [65368.584819] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 23:33:14 juju-e4d256-prod-github-runner-207 kernel: [65368.585910] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 23:33:14 juju-e4d256-prod-github-runner-207 kernel: [65368.587002] Aug 22 23:33:14 juju-e4d256-prod-github-runner-207 kernel: [65368.587862] Aug 22 23:33:14 juju-e4d256-prod-github-runner-207 kernel: [65368.588718] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 23:33:14 juju-e4d256-prod-github-runner-207 kernel: [65368.589765] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:33:14 juju-e4d256-prod-github-runner-207 kernel: [65368.590873] ? _raw_spin_lock+0x22/0x30 Aug 22 23:33:14 juju-e4d256-prod-github-runner-207 kernel: [65368.591875] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:33:14 juju-e4d256-prod-github-runner-207 kernel: [65368.592913] direct_page_fault+0x206/0x310 [kvm] Aug 22 23:33:14 juju-e4d256-prod-github-runner-207 kernel: [65368.593997] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 23:33:14 juju-e4d256-prod-github-runner-207 kernel: [65368.595035] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 23:33:14 juju-e4d256-prod-github-runner-207 kernel: [65368.596058] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 23:33:14 juju-e4d256-prod-github-runner-207 kernel: [65368.597058] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 23:33:14 juju-e4d256-prod-github-runner-207 kernel: [65368.598014] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 23:33:14 juju-e4d256-prod-github-runner-207 kernel: [65368.599021] handle_exit+0x98/0x230 [kvm_amd] Aug 22 23:33:14 juju-e4d256-prod-github-runner-207 kernel: [65368.599929] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 23:33:14 juju-e4d256-prod-github-runner-207 kernel: [65368.600858] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 23:33:14 juju-e4d256-prod-github-runner-207 kernel: [65368.601802] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 23:33:14 juju-e4d256-prod-github-runner-207 kernel: [65368.602727] vcpu_run+0x62/0x2c0 [kvm] Aug 22 23:33:14 juju-e4d256-prod-github-runner-207 kernel: [65368.603563] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 23:33:14 juju-e4d256-prod-github-runner-207 kernel: [65368.604382] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 23:33:14 juju-e4d256-prod-github-runner-207 kernel: [65368.605254] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 23:33:14 juju-e4d256-prod-github-runner-207 kernel: [65368.606066] ? __seccomp_filter+0x4a/0x4a0 Aug 22 23:33:14 juju-e4d256-prod-github-runner-207 kernel: [65368.606868] ? __fget_files+0x86/0xc0 Aug 22 23:33:14 juju-e4d256-prod-github-runner-207 kernel: [65368.607583] __x64_sys_ioctl+0x95/0xd0 Aug 22 23:33:14 juju-e4d256-prod-github-runner-207 kernel: [65368.608399] do_syscall_64+0x5c/0xc0 Aug 22 23:33:14 juju-e4d256-prod-github-runner-207 kernel: [65368.609185] ? do_futex+0x162/0x1f0 Aug 22 23:33:14 juju-e4d256-prod-github-runner-207 kernel: [65368.609879] ? __x64_sys_futex+0x78/0x1e0 Aug 22 23:33:14 juju-e4d256-prod-github-runner-207 kernel: [65368.610572] ? __secure_computing+0xa9/0x120 Aug 22 23:33:14 juju-e4d256-prod-github-runner-207 kernel: [65368.611290] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 23:33:14 juju-e4d256-prod-github-runner-207 kernel: [65368.612068] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:33:14 juju-e4d256-prod-github-runner-207 kernel: [65368.612798] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:33:14 juju-e4d256-prod-github-runner-207 kernel: [65368.613528] ? do_syscall_64+0x69/0xc0 Aug 22 23:33:14 juju-e4d256-prod-github-runner-207 kernel: [65368.614184] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:33:14 juju-e4d256-prod-github-runner-207 kernel: [65368.614964] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:33:14 juju-e4d256-prod-github-runner-207 kernel: [65368.615687] ? do_syscall_64+0x69/0xc0 Aug 22 23:33:14 juju-e4d256-prod-github-runner-207 kernel: [65368.616332] ? do_syscall_64+0x69/0xc0 Aug 22 23:33:14 juju-e4d256-prod-github-runner-207 kernel: [65368.616962] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 23:33:14 juju-e4d256-prod-github-runner-207 kernel: [65368.617677] RIP: 0033:0x7faa5d0edaff Aug 22 23:33:14 juju-e4d256-prod-github-runner-207 kernel: [65368.618308] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 23:33:14 juju-e4d256-prod-github-runner-207 kernel: [65368.620341] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 23:33:14 juju-e4d256-prod-github-runner-207 kernel: [65368.621452] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 23:33:14 juju-e4d256-prod-github-runner-207 kernel: [65368.622562] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 23:33:14 juju-e4d256-prod-github-runner-207 kernel: [65368.623487] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 23:33:14 juju-e4d256-prod-github-runner-207 kernel: [65368.624404] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 23:33:14 juju-e4d256-prod-github-runner-207 kernel: [65368.625601] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 23:33:14 juju-e4d256-prod-github-runner-207 kernel: [65368.626744] Aug 22 23:33:42 juju-e4d256-prod-github-runner-207 kernel: [65396.541981] watchdog: BUG: soft lockup - CPU#1 stuck for 60797s! [qemu-system-x86:6715] Aug 22 23:33:42 juju-e4d256-prod-github-runner-207 kernel: [65396.543925] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 23:33:42 juju-e4d256-prod-github-runner-207 kernel: [65396.544252] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 23:33:42 juju-e4d256-prod-github-runner-207 kernel: [65396.556691] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 23:33:42 juju-e4d256-prod-github-runner-207 kernel: [65396.557976] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 23:33:42 juju-e4d256-prod-github-runner-207 kernel: [65396.559254] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:33:42 juju-e4d256-prod-github-runner-207 kernel: [65396.560357] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 23:33:42 juju-e4d256-prod-github-runner-207 kernel: [65396.562969] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 23:33:42 juju-e4d256-prod-github-runner-207 kernel: [65396.564045] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 23:33:42 juju-e4d256-prod-github-runner-207 kernel: [65396.565224] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 23:33:42 juju-e4d256-prod-github-runner-207 kernel: [65396.566393] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 23:33:42 juju-e4d256-prod-github-runner-207 kernel: [65396.567575] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 23:33:42 juju-e4d256-prod-github-runner-207 kernel: [65396.568741] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 23:33:42 juju-e4d256-prod-github-runner-207 kernel: [65396.569911] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 23:33:42 juju-e4d256-prod-github-runner-207 kernel: [65396.571164] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 23:33:42 juju-e4d256-prod-github-runner-207 kernel: [65396.572267] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 23:33:42 juju-e4d256-prod-github-runner-207 kernel: [65396.573472] Call Trace: Aug 22 23:33:42 juju-e4d256-prod-github-runner-207 kernel: [65396.574393] Aug 22 23:33:42 juju-e4d256-prod-github-runner-207 kernel: [65396.575305] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:33:42 juju-e4d256-prod-github-runner-207 kernel: [65396.576343] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:33:42 juju-e4d256-prod-github-runner-207 kernel: [65396.577375] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:33:42 juju-e4d256-prod-github-runner-207 kernel: [65396.578493] ? show_regs.part.0+0x23/0x29 Aug 22 23:33:42 juju-e4d256-prod-github-runner-207 kernel: [65396.579498] ? show_regs.cold+0x8/0xd Aug 22 23:33:42 juju-e4d256-prod-github-runner-207 kernel: [65396.580491] ? watchdog_timer_fn+0x1be/0x220 Aug 22 23:33:42 juju-e4d256-prod-github-runner-207 kernel: [65396.581542] ? lockup_detector_update_enable+0x60/0x60 Aug 22 23:33:42 juju-e4d256-prod-github-runner-207 kernel: [65396.582658] ? __hrtimer_run_queues+0x107/0x230 Aug 22 23:33:42 juju-e4d256-prod-github-runner-207 kernel: [65396.583708] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 23:33:42 juju-e4d256-prod-github-runner-207 kernel: [65396.584746] ? hrtimer_interrupt+0x101/0x220 Aug 22 23:33:42 juju-e4d256-prod-github-runner-207 kernel: [65396.585769] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 23:33:42 juju-e4d256-prod-github-runner-207 kernel: [65396.586861] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 23:33:42 juju-e4d256-prod-github-runner-207 kernel: [65396.587927] Aug 22 23:33:42 juju-e4d256-prod-github-runner-207 kernel: [65396.588782] Aug 22 23:33:42 juju-e4d256-prod-github-runner-207 kernel: [65396.589627] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 23:33:42 juju-e4d256-prod-github-runner-207 kernel: [65396.590697] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:33:42 juju-e4d256-prod-github-runner-207 kernel: [65396.591762] ? _raw_spin_lock+0x22/0x30 Aug 22 23:33:42 juju-e4d256-prod-github-runner-207 kernel: [65396.592715] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:33:42 juju-e4d256-prod-github-runner-207 kernel: [65396.593762] direct_page_fault+0x206/0x310 [kvm] Aug 22 23:33:42 juju-e4d256-prod-github-runner-207 kernel: [65396.594818] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 23:33:42 juju-e4d256-prod-github-runner-207 kernel: [65396.595838] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 23:33:42 juju-e4d256-prod-github-runner-207 kernel: [65396.596848] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 23:33:42 juju-e4d256-prod-github-runner-207 kernel: [65396.597861] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 23:33:42 juju-e4d256-prod-github-runner-207 kernel: [65396.598828] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 23:33:42 juju-e4d256-prod-github-runner-207 kernel: [65396.599822] handle_exit+0x98/0x230 [kvm_amd] Aug 22 23:33:42 juju-e4d256-prod-github-runner-207 kernel: [65396.600727] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 23:33:42 juju-e4d256-prod-github-runner-207 kernel: [65396.601646] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 23:33:42 juju-e4d256-prod-github-runner-207 kernel: [65396.602600] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 23:33:42 juju-e4d256-prod-github-runner-207 kernel: [65396.603512] vcpu_run+0x62/0x2c0 [kvm] Aug 22 23:33:42 juju-e4d256-prod-github-runner-207 kernel: [65396.604327] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 23:33:42 juju-e4d256-prod-github-runner-207 kernel: [65396.605140] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 23:33:42 juju-e4d256-prod-github-runner-207 kernel: [65396.606001] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 23:33:42 juju-e4d256-prod-github-runner-207 kernel: [65396.606812] ? __seccomp_filter+0x4a/0x4a0 Aug 22 23:33:42 juju-e4d256-prod-github-runner-207 kernel: [65396.607564] ? __fget_files+0x86/0xc0 Aug 22 23:33:42 juju-e4d256-prod-github-runner-207 kernel: [65396.608272] __x64_sys_ioctl+0x95/0xd0 Aug 22 23:33:42 juju-e4d256-prod-github-runner-207 kernel: [65396.609014] do_syscall_64+0x5c/0xc0 Aug 22 23:33:42 juju-e4d256-prod-github-runner-207 kernel: [65396.609702] ? do_futex+0x162/0x1f0 Aug 22 23:33:42 juju-e4d256-prod-github-runner-207 kernel: [65396.610360] ? __x64_sys_futex+0x78/0x1e0 Aug 22 23:33:42 juju-e4d256-prod-github-runner-207 kernel: [65396.611119] ? __secure_computing+0xa9/0x120 Aug 22 23:33:42 juju-e4d256-prod-github-runner-207 kernel: [65396.611816] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 23:33:42 juju-e4d256-prod-github-runner-207 kernel: [65396.612583] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:33:42 juju-e4d256-prod-github-runner-207 kernel: [65396.613334] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:33:42 juju-e4d256-prod-github-runner-207 kernel: [65396.614067] ? do_syscall_64+0x69/0xc0 Aug 22 23:33:42 juju-e4d256-prod-github-runner-207 kernel: [65396.614734] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:33:42 juju-e4d256-prod-github-runner-207 kernel: [65396.615455] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:33:42 juju-e4d256-prod-github-runner-207 kernel: [65396.616163] ? do_syscall_64+0x69/0xc0 Aug 22 23:33:42 juju-e4d256-prod-github-runner-207 kernel: [65396.616803] ? do_syscall_64+0x69/0xc0 Aug 22 23:33:42 juju-e4d256-prod-github-runner-207 kernel: [65396.617468] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 23:33:42 juju-e4d256-prod-github-runner-207 kernel: [65396.618183] RIP: 0033:0x7faa5d0edaff Aug 22 23:33:42 juju-e4d256-prod-github-runner-207 kernel: [65396.618855] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 23:33:42 juju-e4d256-prod-github-runner-207 kernel: [65396.620885] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 23:33:42 juju-e4d256-prod-github-runner-207 kernel: [65396.621825] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 23:33:42 juju-e4d256-prod-github-runner-207 kernel: [65396.622826] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 23:33:42 juju-e4d256-prod-github-runner-207 kernel: [65396.623754] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 23:33:42 juju-e4d256-prod-github-runner-207 kernel: [65396.624689] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 23:33:42 juju-e4d256-prod-github-runner-207 kernel: [65396.625591] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 23:33:42 juju-e4d256-prod-github-runner-207 kernel: [65396.626510] Aug 22 23:34:10 juju-e4d256-prod-github-runner-207 kernel: [65424.541981] watchdog: BUG: soft lockup - CPU#1 stuck for 60823s! [qemu-system-x86:6715] Aug 22 23:34:10 juju-e4d256-prod-github-runner-207 kernel: [65424.543137] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 23:34:10 juju-e4d256-prod-github-runner-207 kernel: [65424.543216] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 23:34:10 juju-e4d256-prod-github-runner-207 kernel: [65424.555580] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 23:34:10 juju-e4d256-prod-github-runner-207 kernel: [65424.556875] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 23:34:10 juju-e4d256-prod-github-runner-207 kernel: [65424.558196] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:34:10 juju-e4d256-prod-github-runner-207 kernel: [65424.559326] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 23:34:10 juju-e4d256-prod-github-runner-207 kernel: [65424.562127] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 23:34:10 juju-e4d256-prod-github-runner-207 kernel: [65424.563276] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 23:34:10 juju-e4d256-prod-github-runner-207 kernel: [65424.564608] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 23:34:10 juju-e4d256-prod-github-runner-207 kernel: [65424.565916] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 23:34:10 juju-e4d256-prod-github-runner-207 kernel: [65424.567301] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 23:34:10 juju-e4d256-prod-github-runner-207 kernel: [65424.568497] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 23:34:10 juju-e4d256-prod-github-runner-207 kernel: [65424.569688] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 23:34:10 juju-e4d256-prod-github-runner-207 kernel: [65424.570976] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 23:34:10 juju-e4d256-prod-github-runner-207 kernel: [65424.572153] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 23:34:10 juju-e4d256-prod-github-runner-207 kernel: [65424.573517] Call Trace: Aug 22 23:34:10 juju-e4d256-prod-github-runner-207 kernel: [65424.574578] Aug 22 23:34:10 juju-e4d256-prod-github-runner-207 kernel: [65424.575583] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:34:10 juju-e4d256-prod-github-runner-207 kernel: [65424.576773] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:34:10 juju-e4d256-prod-github-runner-207 kernel: [65424.577869] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:34:10 juju-e4d256-prod-github-runner-207 kernel: [65424.579066] ? show_regs.part.0+0x23/0x29 Aug 22 23:34:10 juju-e4d256-prod-github-runner-207 kernel: [65424.580102] ? show_regs.cold+0x8/0xd Aug 22 23:34:10 juju-e4d256-prod-github-runner-207 kernel: [65424.581087] ? watchdog_timer_fn+0x1be/0x220 Aug 22 23:34:10 juju-e4d256-prod-github-runner-207 kernel: [65424.582123] ? lockup_detector_update_enable+0x60/0x60 Aug 22 23:34:10 juju-e4d256-prod-github-runner-207 kernel: [65424.583198] ? __hrtimer_run_queues+0x107/0x230 Aug 22 23:34:10 juju-e4d256-prod-github-runner-207 kernel: [65424.584233] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 23:34:10 juju-e4d256-prod-github-runner-207 kernel: [65424.585266] ? hrtimer_interrupt+0x101/0x220 Aug 22 23:34:10 juju-e4d256-prod-github-runner-207 kernel: [65424.586299] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 23:34:10 juju-e4d256-prod-github-runner-207 kernel: [65424.587382] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 23:34:10 juju-e4d256-prod-github-runner-207 kernel: [65424.588441] Aug 22 23:34:10 juju-e4d256-prod-github-runner-207 kernel: [65424.589302] Aug 22 23:34:10 juju-e4d256-prod-github-runner-207 kernel: [65424.590169] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 23:34:10 juju-e4d256-prod-github-runner-207 kernel: [65424.591210] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:34:10 juju-e4d256-prod-github-runner-207 kernel: [65424.592267] ? _raw_spin_lock+0x22/0x30 Aug 22 23:34:10 juju-e4d256-prod-github-runner-207 kernel: [65424.593219] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:34:10 juju-e4d256-prod-github-runner-207 kernel: [65424.594285] direct_page_fault+0x206/0x310 [kvm] Aug 22 23:34:10 juju-e4d256-prod-github-runner-207 kernel: [65424.595326] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 23:34:10 juju-e4d256-prod-github-runner-207 kernel: [65424.596354] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 23:34:10 juju-e4d256-prod-github-runner-207 kernel: [65424.597372] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 23:34:10 juju-e4d256-prod-github-runner-207 kernel: [65424.598380] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 23:34:10 juju-e4d256-prod-github-runner-207 kernel: [65424.599535] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 23:34:10 juju-e4d256-prod-github-runner-207 kernel: [65424.600529] handle_exit+0x98/0x230 [kvm_amd] Aug 22 23:34:10 juju-e4d256-prod-github-runner-207 kernel: [65424.601434] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 23:34:10 juju-e4d256-prod-github-runner-207 kernel: [65424.602405] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 23:34:10 juju-e4d256-prod-github-runner-207 kernel: [65424.603347] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 23:34:10 juju-e4d256-prod-github-runner-207 kernel: [65424.604268] vcpu_run+0x62/0x2c0 [kvm] Aug 22 23:34:10 juju-e4d256-prod-github-runner-207 kernel: [65424.605091] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 23:34:10 juju-e4d256-prod-github-runner-207 kernel: [65424.605913] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 23:34:10 juju-e4d256-prod-github-runner-207 kernel: [65424.606792] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 23:34:10 juju-e4d256-prod-github-runner-207 kernel: [65424.607607] ? __seccomp_filter+0x4a/0x4a0 Aug 22 23:34:10 juju-e4d256-prod-github-runner-207 kernel: [65424.608359] ? __fget_files+0x86/0xc0 Aug 22 23:34:10 juju-e4d256-prod-github-runner-207 kernel: [65424.609080] __x64_sys_ioctl+0x95/0xd0 Aug 22 23:34:10 juju-e4d256-prod-github-runner-207 kernel: [65424.609786] do_syscall_64+0x5c/0xc0 Aug 22 23:34:10 juju-e4d256-prod-github-runner-207 kernel: [65424.610470] ? do_futex+0x162/0x1f0 Aug 22 23:34:10 juju-e4d256-prod-github-runner-207 kernel: [65424.611135] ? __x64_sys_futex+0x78/0x1e0 Aug 22 23:34:10 juju-e4d256-prod-github-runner-207 kernel: [65424.611824] ? __secure_computing+0xa9/0x120 Aug 22 23:34:10 juju-e4d256-prod-github-runner-207 kernel: [65424.612526] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 23:34:10 juju-e4d256-prod-github-runner-207 kernel: [65424.613305] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:34:10 juju-e4d256-prod-github-runner-207 kernel: [65424.614048] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:34:10 juju-e4d256-prod-github-runner-207 kernel: [65424.614784] ? do_syscall_64+0x69/0xc0 Aug 22 23:34:10 juju-e4d256-prod-github-runner-207 kernel: [65424.615438] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:34:10 juju-e4d256-prod-github-runner-207 kernel: [65424.616152] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:34:10 juju-e4d256-prod-github-runner-207 kernel: [65424.616865] ? do_syscall_64+0x69/0xc0 Aug 22 23:34:10 juju-e4d256-prod-github-runner-207 kernel: [65424.617501] ? do_syscall_64+0x69/0xc0 Aug 22 23:34:10 juju-e4d256-prod-github-runner-207 kernel: [65424.618170] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 23:34:10 juju-e4d256-prod-github-runner-207 kernel: [65424.618924] RIP: 0033:0x7faa5d0edaff Aug 22 23:34:10 juju-e4d256-prod-github-runner-207 kernel: [65424.619581] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 23:34:10 juju-e4d256-prod-github-runner-207 kernel: [65424.621619] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 23:34:10 juju-e4d256-prod-github-runner-207 kernel: [65424.622568] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 23:34:10 juju-e4d256-prod-github-runner-207 kernel: [65424.623478] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 23:34:10 juju-e4d256-prod-github-runner-207 kernel: [65424.624388] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 23:34:10 juju-e4d256-prod-github-runner-207 kernel: [65424.625289] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 23:34:10 juju-e4d256-prod-github-runner-207 kernel: [65424.626220] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 23:34:10 juju-e4d256-prod-github-runner-207 kernel: [65424.627171] Aug 22 23:34:38 juju-e4d256-prod-github-runner-207 kernel: [65452.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 60849s! [qemu-system-x86:6715] Aug 22 23:34:38 juju-e4d256-prod-github-runner-207 kernel: [65452.543167] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 23:34:38 juju-e4d256-prod-github-runner-207 kernel: [65452.543242] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 23:34:38 juju-e4d256-prod-github-runner-207 kernel: [65452.555712] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 23:34:38 juju-e4d256-prod-github-runner-207 kernel: [65452.557004] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 23:34:38 juju-e4d256-prod-github-runner-207 kernel: [65452.558254] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:34:38 juju-e4d256-prod-github-runner-207 kernel: [65452.559321] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 23:34:38 juju-e4d256-prod-github-runner-207 kernel: [65452.561920] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 23:34:38 juju-e4d256-prod-github-runner-207 kernel: [65452.562969] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 23:34:38 juju-e4d256-prod-github-runner-207 kernel: [65452.564146] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 23:34:38 juju-e4d256-prod-github-runner-207 kernel: [65452.565329] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 23:34:38 juju-e4d256-prod-github-runner-207 kernel: [65452.566520] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 23:34:38 juju-e4d256-prod-github-runner-207 kernel: [65452.567697] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 23:34:38 juju-e4d256-prod-github-runner-207 kernel: [65452.568887] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 23:34:38 juju-e4d256-prod-github-runner-207 kernel: [65452.570146] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 23:34:38 juju-e4d256-prod-github-runner-207 kernel: [65452.571288] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 23:34:38 juju-e4d256-prod-github-runner-207 kernel: [65452.572540] Call Trace: Aug 22 23:34:38 juju-e4d256-prod-github-runner-207 kernel: [65452.573462] Aug 22 23:34:38 juju-e4d256-prod-github-runner-207 kernel: [65452.574371] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:34:38 juju-e4d256-prod-github-runner-207 kernel: [65452.575416] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:34:38 juju-e4d256-prod-github-runner-207 kernel: [65452.576448] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:34:38 juju-e4d256-prod-github-runner-207 kernel: [65452.577531] ? show_regs.part.0+0x23/0x29 Aug 22 23:34:38 juju-e4d256-prod-github-runner-207 kernel: [65452.578548] ? show_regs.cold+0x8/0xd Aug 22 23:34:38 juju-e4d256-prod-github-runner-207 kernel: [65452.579526] ? watchdog_timer_fn+0x1be/0x220 Aug 22 23:34:38 juju-e4d256-prod-github-runner-207 kernel: [65452.580546] ? lockup_detector_update_enable+0x60/0x60 Aug 22 23:34:38 juju-e4d256-prod-github-runner-207 kernel: [65452.581622] ? __hrtimer_run_queues+0x107/0x230 Aug 22 23:34:38 juju-e4d256-prod-github-runner-207 kernel: [65452.582674] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 23:34:38 juju-e4d256-prod-github-runner-207 kernel: [65452.583706] ? hrtimer_interrupt+0x101/0x220 Aug 22 23:34:38 juju-e4d256-prod-github-runner-207 kernel: [65452.584736] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 23:34:38 juju-e4d256-prod-github-runner-207 kernel: [65452.585830] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 23:34:38 juju-e4d256-prod-github-runner-207 kernel: [65452.586892] Aug 22 23:34:38 juju-e4d256-prod-github-runner-207 kernel: [65452.587750] Aug 22 23:34:38 juju-e4d256-prod-github-runner-207 kernel: [65452.588608] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 23:34:38 juju-e4d256-prod-github-runner-207 kernel: [65452.589703] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:34:38 juju-e4d256-prod-github-runner-207 kernel: [65452.590792] ? _raw_spin_lock+0x22/0x30 Aug 22 23:34:38 juju-e4d256-prod-github-runner-207 kernel: [65452.591766] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:34:38 juju-e4d256-prod-github-runner-207 kernel: [65452.592804] direct_page_fault+0x206/0x310 [kvm] Aug 22 23:34:38 juju-e4d256-prod-github-runner-207 kernel: [65452.593869] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 23:34:38 juju-e4d256-prod-github-runner-207 kernel: [65452.594900] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 23:34:38 juju-e4d256-prod-github-runner-207 kernel: [65452.595930] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 23:34:38 juju-e4d256-prod-github-runner-207 kernel: [65452.597208] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 23:34:38 juju-e4d256-prod-github-runner-207 kernel: [65452.598223] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 23:34:38 juju-e4d256-prod-github-runner-207 kernel: [65452.599260] handle_exit+0x98/0x230 [kvm_amd] Aug 22 23:34:38 juju-e4d256-prod-github-runner-207 kernel: [65452.600175] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 23:34:38 juju-e4d256-prod-github-runner-207 kernel: [65452.601124] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 23:34:38 juju-e4d256-prod-github-runner-207 kernel: [65452.602091] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 23:34:38 juju-e4d256-prod-github-runner-207 kernel: [65452.603047] vcpu_run+0x62/0x2c0 [kvm] Aug 22 23:34:38 juju-e4d256-prod-github-runner-207 kernel: [65452.603875] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 23:34:38 juju-e4d256-prod-github-runner-207 kernel: [65452.604708] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 23:34:38 juju-e4d256-prod-github-runner-207 kernel: [65452.605585] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 23:34:38 juju-e4d256-prod-github-runner-207 kernel: [65452.606414] ? __seccomp_filter+0x4a/0x4a0 Aug 22 23:34:38 juju-e4d256-prod-github-runner-207 kernel: [65452.607166] ? __fget_files+0x86/0xc0 Aug 22 23:34:38 juju-e4d256-prod-github-runner-207 kernel: [65452.607910] __x64_sys_ioctl+0x95/0xd0 Aug 22 23:34:38 juju-e4d256-prod-github-runner-207 kernel: [65452.608621] do_syscall_64+0x5c/0xc0 Aug 22 23:34:38 juju-e4d256-prod-github-runner-207 kernel: [65452.609315] ? do_futex+0x162/0x1f0 Aug 22 23:34:38 juju-e4d256-prod-github-runner-207 kernel: [65452.609994] ? __x64_sys_futex+0x78/0x1e0 Aug 22 23:34:38 juju-e4d256-prod-github-runner-207 kernel: [65452.610677] ? __secure_computing+0xa9/0x120 Aug 22 23:34:38 juju-e4d256-prod-github-runner-207 kernel: [65452.611377] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 23:34:38 juju-e4d256-prod-github-runner-207 kernel: [65452.612152] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:34:38 juju-e4d256-prod-github-runner-207 kernel: [65452.612908] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:34:38 juju-e4d256-prod-github-runner-207 kernel: [65452.613682] ? do_syscall_64+0x69/0xc0 Aug 22 23:34:38 juju-e4d256-prod-github-runner-207 kernel: [65452.614367] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:34:38 juju-e4d256-prod-github-runner-207 kernel: [65452.615097] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:34:38 juju-e4d256-prod-github-runner-207 kernel: [65452.615804] ? do_syscall_64+0x69/0xc0 Aug 22 23:34:38 juju-e4d256-prod-github-runner-207 kernel: [65452.616440] ? do_syscall_64+0x69/0xc0 Aug 22 23:34:38 juju-e4d256-prod-github-runner-207 kernel: [65452.617075] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 23:34:38 juju-e4d256-prod-github-runner-207 kernel: [65452.617851] RIP: 0033:0x7faa5d0edaff Aug 22 23:34:38 juju-e4d256-prod-github-runner-207 kernel: [65452.618495] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 23:34:38 juju-e4d256-prod-github-runner-207 kernel: [65452.620536] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 23:34:38 juju-e4d256-prod-github-runner-207 kernel: [65452.621469] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 23:34:38 juju-e4d256-prod-github-runner-207 kernel: [65452.622395] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 23:34:38 juju-e4d256-prod-github-runner-207 kernel: [65452.623294] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 23:34:38 juju-e4d256-prod-github-runner-207 kernel: [65452.624194] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 23:34:38 juju-e4d256-prod-github-runner-207 kernel: [65452.625207] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 23:34:38 juju-e4d256-prod-github-runner-207 kernel: [65452.626140] Aug 22 23:35:06 juju-e4d256-prod-github-runner-207 kernel: [65480.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 60875s! [qemu-system-x86:6715] Aug 22 23:35:06 juju-e4d256-prod-github-runner-207 kernel: [65480.543197] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 23:35:06 juju-e4d256-prod-github-runner-207 kernel: [65480.543273] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 23:35:06 juju-e4d256-prod-github-runner-207 kernel: [65480.555914] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 23:35:06 juju-e4d256-prod-github-runner-207 kernel: [65480.557207] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 23:35:06 juju-e4d256-prod-github-runner-207 kernel: [65480.558477] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:35:06 juju-e4d256-prod-github-runner-207 kernel: [65480.559555] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 23:35:06 juju-e4d256-prod-github-runner-207 kernel: [65480.562177] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 23:35:06 juju-e4d256-prod-github-runner-207 kernel: [65480.563234] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 23:35:06 juju-e4d256-prod-github-runner-207 kernel: [65480.564636] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 23:35:06 juju-e4d256-prod-github-runner-207 kernel: [65480.566231] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 23:35:06 juju-e4d256-prod-github-runner-207 kernel: [65480.567494] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 23:35:06 juju-e4d256-prod-github-runner-207 kernel: [65480.569049] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 23:35:06 juju-e4d256-prod-github-runner-207 kernel: [65480.570292] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 23:35:06 juju-e4d256-prod-github-runner-207 kernel: [65480.571796] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 23:35:06 juju-e4d256-prod-github-runner-207 kernel: [65480.572908] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 23:35:06 juju-e4d256-prod-github-runner-207 kernel: [65480.574264] Call Trace: Aug 22 23:35:06 juju-e4d256-prod-github-runner-207 kernel: [65480.575601] Aug 22 23:35:06 juju-e4d256-prod-github-runner-207 kernel: [65480.576868] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:35:06 juju-e4d256-prod-github-runner-207 kernel: [65480.577947] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:35:06 juju-e4d256-prod-github-runner-207 kernel: [65480.579166] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:35:06 juju-e4d256-prod-github-runner-207 kernel: [65480.580270] ? show_regs.part.0+0x23/0x29 Aug 22 23:35:06 juju-e4d256-prod-github-runner-207 kernel: [65480.581276] ? show_regs.cold+0x8/0xd Aug 22 23:35:06 juju-e4d256-prod-github-runner-207 kernel: [65480.582271] ? watchdog_timer_fn+0x1be/0x220 Aug 22 23:35:06 juju-e4d256-prod-github-runner-207 kernel: [65480.583294] ? lockup_detector_update_enable+0x60/0x60 Aug 22 23:35:06 juju-e4d256-prod-github-runner-207 kernel: [65480.584381] ? __hrtimer_run_queues+0x107/0x230 Aug 22 23:35:06 juju-e4d256-prod-github-runner-207 kernel: [65480.585454] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 23:35:06 juju-e4d256-prod-github-runner-207 kernel: [65480.586495] ? hrtimer_interrupt+0x101/0x220 Aug 22 23:35:06 juju-e4d256-prod-github-runner-207 kernel: [65480.587537] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 23:35:06 juju-e4d256-prod-github-runner-207 kernel: [65480.588625] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 23:35:06 juju-e4d256-prod-github-runner-207 kernel: [65480.589694] Aug 22 23:35:06 juju-e4d256-prod-github-runner-207 kernel: [65480.590570] Aug 22 23:35:06 juju-e4d256-prod-github-runner-207 kernel: [65480.591418] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 23:35:06 juju-e4d256-prod-github-runner-207 kernel: [65480.592537] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:35:06 juju-e4d256-prod-github-runner-207 kernel: [65480.593615] ? _raw_spin_lock+0x22/0x30 Aug 22 23:35:06 juju-e4d256-prod-github-runner-207 kernel: [65480.594585] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:35:06 juju-e4d256-prod-github-runner-207 kernel: [65480.595633] direct_page_fault+0x206/0x310 [kvm] Aug 22 23:35:06 juju-e4d256-prod-github-runner-207 kernel: [65480.596666] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 23:35:06 juju-e4d256-prod-github-runner-207 kernel: [65480.597728] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 23:35:06 juju-e4d256-prod-github-runner-207 kernel: [65480.598773] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 23:35:06 juju-e4d256-prod-github-runner-207 kernel: [65480.599772] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 23:35:06 juju-e4d256-prod-github-runner-207 kernel: [65480.600731] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 23:35:06 juju-e4d256-prod-github-runner-207 kernel: [65480.601736] handle_exit+0x98/0x230 [kvm_amd] Aug 22 23:35:06 juju-e4d256-prod-github-runner-207 kernel: [65480.602652] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 23:35:06 juju-e4d256-prod-github-runner-207 kernel: [65480.603584] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 23:35:06 juju-e4d256-prod-github-runner-207 kernel: [65480.604527] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 23:35:06 juju-e4d256-prod-github-runner-207 kernel: [65480.605458] vcpu_run+0x62/0x2c0 [kvm] Aug 22 23:35:06 juju-e4d256-prod-github-runner-207 kernel: [65480.606283] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 23:35:06 juju-e4d256-prod-github-runner-207 kernel: [65480.607113] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 23:35:06 juju-e4d256-prod-github-runner-207 kernel: [65480.607983] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 23:35:06 juju-e4d256-prod-github-runner-207 kernel: [65480.608799] ? __seccomp_filter+0x4a/0x4a0 Aug 22 23:35:06 juju-e4d256-prod-github-runner-207 kernel: [65480.609559] ? __fget_files+0x86/0xc0 Aug 22 23:35:06 juju-e4d256-prod-github-runner-207 kernel: [65480.610297] __x64_sys_ioctl+0x95/0xd0 Aug 22 23:35:06 juju-e4d256-prod-github-runner-207 kernel: [65480.611000] do_syscall_64+0x5c/0xc0 Aug 22 23:35:06 juju-e4d256-prod-github-runner-207 kernel: [65480.611683] ? do_futex+0x162/0x1f0 Aug 22 23:35:06 juju-e4d256-prod-github-runner-207 kernel: [65480.612340] ? __x64_sys_futex+0x78/0x1e0 Aug 22 23:35:06 juju-e4d256-prod-github-runner-207 kernel: [65480.613023] ? __secure_computing+0xa9/0x120 Aug 22 23:35:06 juju-e4d256-prod-github-runner-207 kernel: [65480.613745] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 23:35:06 juju-e4d256-prod-github-runner-207 kernel: [65480.614538] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:35:06 juju-e4d256-prod-github-runner-207 kernel: [65480.615277] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:35:06 juju-e4d256-prod-github-runner-207 kernel: [65480.616009] ? do_syscall_64+0x69/0xc0 Aug 22 23:35:06 juju-e4d256-prod-github-runner-207 kernel: [65480.616670] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:35:06 juju-e4d256-prod-github-runner-207 kernel: [65480.617390] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:35:06 juju-e4d256-prod-github-runner-207 kernel: [65480.619442] ? do_syscall_64+0x69/0xc0 Aug 22 23:35:06 juju-e4d256-prod-github-runner-207 kernel: [65480.620101] ? do_syscall_64+0x69/0xc0 Aug 22 23:35:06 juju-e4d256-prod-github-runner-207 kernel: [65480.620735] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 23:35:06 juju-e4d256-prod-github-runner-207 kernel: [65480.621466] RIP: 0033:0x7faa5d0edaff Aug 22 23:35:06 juju-e4d256-prod-github-runner-207 kernel: [65480.622134] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 23:35:06 juju-e4d256-prod-github-runner-207 kernel: [65480.624176] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 23:35:06 juju-e4d256-prod-github-runner-207 kernel: [65480.625109] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 23:35:06 juju-e4d256-prod-github-runner-207 kernel: [65480.626029] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 23:35:06 juju-e4d256-prod-github-runner-207 kernel: [65480.626938] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 23:35:06 juju-e4d256-prod-github-runner-207 kernel: [65480.628014] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 23:35:06 juju-e4d256-prod-github-runner-207 kernel: [65480.629056] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 23:35:06 juju-e4d256-prod-github-runner-207 kernel: [65480.630125] Aug 22 23:35:34 juju-e4d256-prod-github-runner-207 kernel: [65508.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 60901s! [qemu-system-x86:6715] Aug 22 23:35:34 juju-e4d256-prod-github-runner-207 kernel: [65508.543874] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 23:35:34 juju-e4d256-prod-github-runner-207 kernel: [65508.544176] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 23:35:34 juju-e4d256-prod-github-runner-207 kernel: [65508.557229] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 23:35:34 juju-e4d256-prod-github-runner-207 kernel: [65508.558576] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 23:35:34 juju-e4d256-prod-github-runner-207 kernel: [65508.559824] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:35:34 juju-e4d256-prod-github-runner-207 kernel: [65508.560907] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 23:35:34 juju-e4d256-prod-github-runner-207 kernel: [65508.563541] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 23:35:34 juju-e4d256-prod-github-runner-207 kernel: [65508.564602] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 23:35:34 juju-e4d256-prod-github-runner-207 kernel: [65508.565800] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 23:35:34 juju-e4d256-prod-github-runner-207 kernel: [65508.566981] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 23:35:34 juju-e4d256-prod-github-runner-207 kernel: [65508.568166] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 23:35:34 juju-e4d256-prod-github-runner-207 kernel: [65508.569366] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 23:35:34 juju-e4d256-prod-github-runner-207 kernel: [65508.570561] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 23:35:34 juju-e4d256-prod-github-runner-207 kernel: [65508.571826] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 23:35:34 juju-e4d256-prod-github-runner-207 kernel: [65508.572954] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 23:35:34 juju-e4d256-prod-github-runner-207 kernel: [65508.574185] Call Trace: Aug 22 23:35:34 juju-e4d256-prod-github-runner-207 kernel: [65508.575114] Aug 22 23:35:34 juju-e4d256-prod-github-runner-207 kernel: [65508.576028] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:35:34 juju-e4d256-prod-github-runner-207 kernel: [65508.577153] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:35:34 juju-e4d256-prod-github-runner-207 kernel: [65508.578224] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:35:34 juju-e4d256-prod-github-runner-207 kernel: [65508.579377] ? show_regs.part.0+0x23/0x29 Aug 22 23:35:34 juju-e4d256-prod-github-runner-207 kernel: [65508.580599] ? show_regs.cold+0x8/0xd Aug 22 23:35:34 juju-e4d256-prod-github-runner-207 kernel: [65508.581658] ? watchdog_timer_fn+0x1be/0x220 Aug 22 23:35:34 juju-e4d256-prod-github-runner-207 kernel: [65508.582698] ? lockup_detector_update_enable+0x60/0x60 Aug 22 23:35:34 juju-e4d256-prod-github-runner-207 kernel: [65508.583788] ? __hrtimer_run_queues+0x107/0x230 Aug 22 23:35:34 juju-e4d256-prod-github-runner-207 kernel: [65508.584911] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 23:35:34 juju-e4d256-prod-github-runner-207 kernel: [65508.585985] ? hrtimer_interrupt+0x101/0x220 Aug 22 23:35:34 juju-e4d256-prod-github-runner-207 kernel: [65508.587090] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 23:35:34 juju-e4d256-prod-github-runner-207 kernel: [65508.588215] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 23:35:34 juju-e4d256-prod-github-runner-207 kernel: [65508.589530] Aug 22 23:35:34 juju-e4d256-prod-github-runner-207 kernel: [65508.590399] Aug 22 23:35:34 juju-e4d256-prod-github-runner-207 kernel: [65508.591251] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 23:35:34 juju-e4d256-prod-github-runner-207 kernel: [65508.592312] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:35:34 juju-e4d256-prod-github-runner-207 kernel: [65508.593395] ? _raw_spin_lock+0x22/0x30 Aug 22 23:35:34 juju-e4d256-prod-github-runner-207 kernel: [65508.594362] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:35:34 juju-e4d256-prod-github-runner-207 kernel: [65508.595405] direct_page_fault+0x206/0x310 [kvm] Aug 22 23:35:34 juju-e4d256-prod-github-runner-207 kernel: [65508.596452] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 23:35:34 juju-e4d256-prod-github-runner-207 kernel: [65508.597536] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 23:35:34 juju-e4d256-prod-github-runner-207 kernel: [65508.598567] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 23:35:34 juju-e4d256-prod-github-runner-207 kernel: [65508.599686] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 23:35:34 juju-e4d256-prod-github-runner-207 kernel: [65508.600708] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 23:35:34 juju-e4d256-prod-github-runner-207 kernel: [65508.601932] handle_exit+0x98/0x230 [kvm_amd] Aug 22 23:35:34 juju-e4d256-prod-github-runner-207 kernel: [65508.602858] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 23:35:34 juju-e4d256-prod-github-runner-207 kernel: [65508.603826] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 23:35:34 juju-e4d256-prod-github-runner-207 kernel: [65508.604791] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 23:35:34 juju-e4d256-prod-github-runner-207 kernel: [65508.605746] vcpu_run+0x62/0x2c0 [kvm] Aug 22 23:35:34 juju-e4d256-prod-github-runner-207 kernel: [65508.606570] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 23:35:34 juju-e4d256-prod-github-runner-207 kernel: [65508.607396] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 23:35:34 juju-e4d256-prod-github-runner-207 kernel: [65508.608293] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 23:35:34 juju-e4d256-prod-github-runner-207 kernel: [65508.609131] ? __seccomp_filter+0x4a/0x4a0 Aug 22 23:35:34 juju-e4d256-prod-github-runner-207 kernel: [65508.609896] ? __fget_files+0x86/0xc0 Aug 22 23:35:34 juju-e4d256-prod-github-runner-207 kernel: [65508.610670] __x64_sys_ioctl+0x95/0xd0 Aug 22 23:35:34 juju-e4d256-prod-github-runner-207 kernel: [65508.611554] do_syscall_64+0x5c/0xc0 Aug 22 23:35:34 juju-e4d256-prod-github-runner-207 kernel: [65508.612436] ? do_futex+0x162/0x1f0 Aug 22 23:35:34 juju-e4d256-prod-github-runner-207 kernel: [65508.613220] ? __x64_sys_futex+0x78/0x1e0 Aug 22 23:35:34 juju-e4d256-prod-github-runner-207 kernel: [65508.613928] ? __secure_computing+0xa9/0x120 Aug 22 23:35:34 juju-e4d256-prod-github-runner-207 kernel: [65508.614762] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 23:35:34 juju-e4d256-prod-github-runner-207 kernel: [65508.615548] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:35:34 juju-e4d256-prod-github-runner-207 kernel: [65508.616286] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:35:34 juju-e4d256-prod-github-runner-207 kernel: [65508.617025] ? do_syscall_64+0x69/0xc0 Aug 22 23:35:34 juju-e4d256-prod-github-runner-207 kernel: [65508.617713] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:35:34 juju-e4d256-prod-github-runner-207 kernel: [65508.618440] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:35:34 juju-e4d256-prod-github-runner-207 kernel: [65508.619177] ? do_syscall_64+0x69/0xc0 Aug 22 23:35:34 juju-e4d256-prod-github-runner-207 kernel: [65508.619830] ? do_syscall_64+0x69/0xc0 Aug 22 23:35:34 juju-e4d256-prod-github-runner-207 kernel: [65508.620536] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 23:35:34 juju-e4d256-prod-github-runner-207 kernel: [65508.621300] RIP: 0033:0x7faa5d0edaff Aug 22 23:35:34 juju-e4d256-prod-github-runner-207 kernel: [65508.621962] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 23:35:34 juju-e4d256-prod-github-runner-207 kernel: [65508.624039] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 23:35:34 juju-e4d256-prod-github-runner-207 kernel: [65508.624986] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 23:35:34 juju-e4d256-prod-github-runner-207 kernel: [65508.625980] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 23:35:34 juju-e4d256-prod-github-runner-207 kernel: [65508.626916] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 23:35:34 juju-e4d256-prod-github-runner-207 kernel: [65508.627878] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 23:35:34 juju-e4d256-prod-github-runner-207 kernel: [65508.628803] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 23:35:34 juju-e4d256-prod-github-runner-207 kernel: [65508.629784] Aug 22 23:35:47 juju-e4d256-prod-github-runner-207 kernel: [65521.556731] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 23:35:47 juju-e4d256-prod-github-runner-207 kernel: [65521.557721] rcu: 1-....: (16299549 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=7868760 Aug 22 23:35:47 juju-e4d256-prod-github-runner-207 kernel: [65521.558857] (t=16351089 jiffies g=23269 q=57564) Aug 22 23:35:47 juju-e4d256-prod-github-runner-207 kernel: [65521.559653] NMI backtrace for cpu 1 Aug 22 23:35:47 juju-e4d256-prod-github-runner-207 kernel: [65521.560367] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 23:35:47 juju-e4d256-prod-github-runner-207 kernel: [65521.561502] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 23:35:47 juju-e4d256-prod-github-runner-207 kernel: [65521.562583] Call Trace: Aug 22 23:35:47 juju-e4d256-prod-github-runner-207 kernel: [65521.563261] Aug 22 23:35:47 juju-e4d256-prod-github-runner-207 kernel: [65521.563913] show_stack+0x52/0x5c Aug 22 23:35:47 juju-e4d256-prod-github-runner-207 kernel: [65521.564652] dump_stack_lvl+0x4a/0x63 Aug 22 23:35:47 juju-e4d256-prod-github-runner-207 kernel: [65521.565419] dump_stack+0x10/0x16 Aug 22 23:35:47 juju-e4d256-prod-github-runner-207 kernel: [65521.566143] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 23:35:47 juju-e4d256-prod-github-runner-207 kernel: [65521.566929] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 23:35:47 juju-e4d256-prod-github-runner-207 kernel: [65521.567715] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 23:35:47 juju-e4d256-prod-github-runner-207 kernel: [65521.568545] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 23:35:47 juju-e4d256-prod-github-runner-207 kernel: [65521.569390] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 23:35:47 juju-e4d256-prod-github-runner-207 kernel: [65521.570206] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 23:35:47 juju-e4d256-prod-github-runner-207 kernel: [65521.570989] print_cpu_stall.cold+0x2f/0xe2 Aug 22 23:35:47 juju-e4d256-prod-github-runner-207 kernel: [65521.571761] ? timekeeping_update+0xf7/0x150 Aug 22 23:35:47 juju-e4d256-prod-github-runner-207 kernel: [65521.572539] check_cpu_stall+0x109/0x270 Aug 22 23:35:47 juju-e4d256-prod-github-runner-207 kernel: [65521.573310] rcu_sched_clock_irq+0x9a/0x250 Aug 22 23:35:47 juju-e4d256-prod-github-runner-207 kernel: [65521.574083] update_process_times+0x94/0xd0 Aug 22 23:35:47 juju-e4d256-prod-github-runner-207 kernel: [65521.574849] tick_sched_handle+0x29/0x70 Aug 22 23:35:47 juju-e4d256-prod-github-runner-207 kernel: [65521.575609] tick_sched_timer+0x8c/0xc0 Aug 22 23:35:47 juju-e4d256-prod-github-runner-207 kernel: [65521.576361] ? tick_nohz_handler+0xb0/0xb0 Aug 22 23:35:47 juju-e4d256-prod-github-runner-207 kernel: [65521.577143] __hrtimer_run_queues+0x107/0x230 Aug 22 23:35:47 juju-e4d256-prod-github-runner-207 kernel: [65521.577924] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 23:35:47 juju-e4d256-prod-github-runner-207 kernel: [65521.578705] hrtimer_interrupt+0x101/0x220 Aug 22 23:35:47 juju-e4d256-prod-github-runner-207 kernel: [65521.579475] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 23:35:47 juju-e4d256-prod-github-runner-207 kernel: [65521.580298] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 23:35:47 juju-e4d256-prod-github-runner-207 kernel: [65521.581121] Aug 22 23:35:47 juju-e4d256-prod-github-runner-207 kernel: [65521.581759] Aug 22 23:35:47 juju-e4d256-prod-github-runner-207 kernel: [65521.582391] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 23:35:47 juju-e4d256-prod-github-runner-207 kernel: [65521.583214] RIP: 0010:native_queued_spin_lock_slowpath+0xe/0x40 Aug 22 23:35:47 juju-e4d256-prod-github-runner-207 kernel: [65521.584096] Code: ff eb af 4c 89 fe 48 c7 c7 20 99 e9 89 e8 ca 69 55 00 e9 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 <85> c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 eb e9 55 Aug 22 23:35:47 juju-e4d256-prod-github-runner-207 kernel: [65521.586350] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 23:35:47 juju-e4d256-prod-github-runner-207 kernel: [65521.587235] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 23:35:47 juju-e4d256-prod-github-runner-207 kernel: [65521.588243] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 23:35:47 juju-e4d256-prod-github-runner-207 kernel: [65521.589257] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 23:35:47 juju-e4d256-prod-github-runner-207 kernel: [65521.590247] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 23:35:47 juju-e4d256-prod-github-runner-207 kernel: [65521.591218] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 23:35:47 juju-e4d256-prod-github-runner-207 kernel: [65521.592182] ? _raw_spin_lock+0x22/0x30 Aug 22 23:35:47 juju-e4d256-prod-github-runner-207 kernel: [65521.592951] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:35:47 juju-e4d256-prod-github-runner-207 kernel: [65521.593793] direct_page_fault+0x206/0x310 [kvm] Aug 22 23:35:47 juju-e4d256-prod-github-runner-207 kernel: [65521.594634] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 23:35:47 juju-e4d256-prod-github-runner-207 kernel: [65521.595466] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 23:35:47 juju-e4d256-prod-github-runner-207 kernel: [65521.596293] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 23:35:47 juju-e4d256-prod-github-runner-207 kernel: [65521.597123] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 23:35:47 juju-e4d256-prod-github-runner-207 kernel: [65521.597914] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 23:35:47 juju-e4d256-prod-github-runner-207 kernel: [65521.598752] handle_exit+0x98/0x230 [kvm_amd] Aug 22 23:35:47 juju-e4d256-prod-github-runner-207 kernel: [65521.599510] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 23:35:47 juju-e4d256-prod-github-runner-207 kernel: [65521.600300] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 23:35:47 juju-e4d256-prod-github-runner-207 kernel: [65521.601116] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 23:35:47 juju-e4d256-prod-github-runner-207 kernel: [65521.601923] vcpu_run+0x62/0x2c0 [kvm] Aug 22 23:35:47 juju-e4d256-prod-github-runner-207 kernel: [65521.602669] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 23:35:47 juju-e4d256-prod-github-runner-207 kernel: [65521.603415] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 23:35:47 juju-e4d256-prod-github-runner-207 kernel: [65521.604228] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 23:35:47 juju-e4d256-prod-github-runner-207 kernel: [65521.605009] ? __seccomp_filter+0x4a/0x4a0 Aug 22 23:35:47 juju-e4d256-prod-github-runner-207 kernel: [65521.605735] ? __fget_files+0x86/0xc0 Aug 22 23:35:47 juju-e4d256-prod-github-runner-207 kernel: [65521.606431] __x64_sys_ioctl+0x95/0xd0 Aug 22 23:35:47 juju-e4d256-prod-github-runner-207 kernel: [65521.607135] do_syscall_64+0x5c/0xc0 Aug 22 23:35:47 juju-e4d256-prod-github-runner-207 kernel: [65521.607818] ? do_futex+0x162/0x1f0 Aug 22 23:35:47 juju-e4d256-prod-github-runner-207 kernel: [65521.608492] ? __x64_sys_futex+0x78/0x1e0 Aug 22 23:35:47 juju-e4d256-prod-github-runner-207 kernel: [65521.609211] ? __secure_computing+0xa9/0x120 Aug 22 23:35:47 juju-e4d256-prod-github-runner-207 kernel: [65521.609939] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 23:35:47 juju-e4d256-prod-github-runner-207 kernel: [65521.610735] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:35:47 juju-e4d256-prod-github-runner-207 kernel: [65521.611508] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:35:47 juju-e4d256-prod-github-runner-207 kernel: [65521.612270] ? do_syscall_64+0x69/0xc0 Aug 22 23:35:47 juju-e4d256-prod-github-runner-207 kernel: [65521.612986] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:35:47 juju-e4d256-prod-github-runner-207 kernel: [65521.613759] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:35:47 juju-e4d256-prod-github-runner-207 kernel: [65521.614523] ? do_syscall_64+0x69/0xc0 Aug 22 23:35:47 juju-e4d256-prod-github-runner-207 kernel: [65521.615222] ? do_syscall_64+0x69/0xc0 Aug 22 23:35:47 juju-e4d256-prod-github-runner-207 kernel: [65521.615920] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 23:35:47 juju-e4d256-prod-github-runner-207 kernel: [65521.616704] RIP: 0033:0x7faa5d0edaff Aug 22 23:35:47 juju-e4d256-prod-github-runner-207 kernel: [65521.617398] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 23:35:47 juju-e4d256-prod-github-runner-207 kernel: [65521.619539] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 23:35:47 juju-e4d256-prod-github-runner-207 kernel: [65521.620514] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 23:35:47 juju-e4d256-prod-github-runner-207 kernel: [65521.621495] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 23:35:47 juju-e4d256-prod-github-runner-207 kernel: [65521.622456] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 23:35:47 juju-e4d256-prod-github-runner-207 kernel: [65521.623405] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 23:35:47 juju-e4d256-prod-github-runner-207 kernel: [65521.624345] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 23:35:47 juju-e4d256-prod-github-runner-207 kernel: [65521.625292] Aug 22 23:36:14 juju-e4d256-prod-github-runner-207 kernel: [65548.542368] watchdog: BUG: soft lockup - CPU#1 stuck for 60938s! [qemu-system-x86:6715] Aug 22 23:36:14 juju-e4d256-prod-github-runner-207 kernel: [65548.544667] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 23:36:14 juju-e4d256-prod-github-runner-207 kernel: [65548.544746] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 23:36:14 juju-e4d256-prod-github-runner-207 kernel: [65548.570857] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 23:36:14 juju-e4d256-prod-github-runner-207 kernel: [65548.574186] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 23:36:14 juju-e4d256-prod-github-runner-207 kernel: [65548.575423] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:36:14 juju-e4d256-prod-github-runner-207 kernel: [65548.576484] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 23:36:14 juju-e4d256-prod-github-runner-207 kernel: [65548.582967] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 23:36:14 juju-e4d256-prod-github-runner-207 kernel: [65548.584535] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 23:36:14 juju-e4d256-prod-github-runner-207 kernel: [65548.585710] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 23:36:14 juju-e4d256-prod-github-runner-207 kernel: [65548.589057] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 23:36:14 juju-e4d256-prod-github-runner-207 kernel: [65548.590275] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 23:36:14 juju-e4d256-prod-github-runner-207 kernel: [65548.592566] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 23:36:14 juju-e4d256-prod-github-runner-207 kernel: [65548.594867] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 23:36:14 juju-e4d256-prod-github-runner-207 kernel: [65548.598399] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 23:36:14 juju-e4d256-prod-github-runner-207 kernel: [65548.599519] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 23:36:14 juju-e4d256-prod-github-runner-207 kernel: [65548.600741] Call Trace: Aug 22 23:36:14 juju-e4d256-prod-github-runner-207 kernel: [65548.603802] Aug 22 23:36:14 juju-e4d256-prod-github-runner-207 kernel: [65548.604717] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:36:14 juju-e4d256-prod-github-runner-207 kernel: [65548.605753] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:36:14 juju-e4d256-prod-github-runner-207 kernel: [65548.608851] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:36:14 juju-e4d256-prod-github-runner-207 kernel: [65548.609936] ? show_regs.part.0+0x23/0x29 Aug 22 23:36:14 juju-e4d256-prod-github-runner-207 kernel: [65548.613073] ? show_regs.cold+0x8/0xd Aug 22 23:36:14 juju-e4d256-prod-github-runner-207 kernel: [65548.615694] ? watchdog_timer_fn+0x1be/0x220 Aug 22 23:36:14 juju-e4d256-prod-github-runner-207 kernel: [65548.617296] ? lockup_detector_update_enable+0x60/0x60 Aug 22 23:36:14 juju-e4d256-prod-github-runner-207 kernel: [65548.618360] ? __hrtimer_run_queues+0x107/0x230 Aug 22 23:36:14 juju-e4d256-prod-github-runner-207 kernel: [65548.621527] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 23:36:14 juju-e4d256-prod-github-runner-207 kernel: [65548.622575] ? hrtimer_interrupt+0x101/0x220 Aug 22 23:36:14 juju-e4d256-prod-github-runner-207 kernel: [65548.626169] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 23:36:14 juju-e4d256-prod-github-runner-207 kernel: [65548.629894] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 23:36:14 juju-e4d256-prod-github-runner-207 kernel: [65548.630961] Aug 22 23:36:14 juju-e4d256-prod-github-runner-207 kernel: [65548.634078] Aug 22 23:36:14 juju-e4d256-prod-github-runner-207 kernel: [65548.634933] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 23:36:14 juju-e4d256-prod-github-runner-207 kernel: [65548.638215] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:36:14 juju-e4d256-prod-github-runner-207 kernel: [65548.639263] ? _raw_spin_lock+0x22/0x30 Aug 22 23:36:14 juju-e4d256-prod-github-runner-207 kernel: [65548.641844] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:36:14 juju-e4d256-prod-github-runner-207 kernel: [65548.643428] direct_page_fault+0x206/0x310 [kvm] Aug 22 23:36:14 juju-e4d256-prod-github-runner-207 kernel: [65548.644469] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 23:36:14 juju-e4d256-prod-github-runner-207 kernel: [65548.647573] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 23:36:14 juju-e4d256-prod-github-runner-207 kernel: [65548.649713] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 23:36:14 juju-e4d256-prod-github-runner-207 kernel: [65548.651740] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 23:36:14 juju-e4d256-prod-github-runner-207 kernel: [65548.652718] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 23:36:14 juju-e4d256-prod-github-runner-207 kernel: [65548.655812] handle_exit+0x98/0x230 [kvm_amd] Aug 22 23:36:14 juju-e4d256-prod-github-runner-207 kernel: [65548.656750] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 23:36:14 juju-e4d256-prod-github-runner-207 kernel: [65548.659312] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 23:36:14 juju-e4d256-prod-github-runner-207 kernel: [65548.660785] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 23:36:14 juju-e4d256-prod-github-runner-207 kernel: [65548.661691] vcpu_run+0x62/0x2c0 [kvm] Aug 22 23:36:14 juju-e4d256-prod-github-runner-207 kernel: [65548.664550] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 23:36:14 juju-e4d256-prod-github-runner-207 kernel: [65548.665389] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 23:36:14 juju-e4d256-prod-github-runner-207 kernel: [65548.666255] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 23:36:14 juju-e4d256-prod-github-runner-207 kernel: [65548.669160] ? __seccomp_filter+0x4a/0x4a0 Aug 22 23:36:14 juju-e4d256-prod-github-runner-207 kernel: [65548.669917] ? __fget_files+0x86/0xc0 Aug 22 23:36:14 juju-e4d256-prod-github-runner-207 kernel: [65548.670623] __x64_sys_ioctl+0x95/0xd0 Aug 22 23:36:14 juju-e4d256-prod-github-runner-207 kernel: [65548.671332] do_syscall_64+0x5c/0xc0 Aug 22 23:36:14 juju-e4d256-prod-github-runner-207 kernel: [65548.672007] ? do_futex+0x162/0x1f0 Aug 22 23:36:14 juju-e4d256-prod-github-runner-207 kernel: [65548.672673] ? __x64_sys_futex+0x78/0x1e0 Aug 22 23:36:14 juju-e4d256-prod-github-runner-207 kernel: [65548.673351] ? __secure_computing+0xa9/0x120 Aug 22 23:36:14 juju-e4d256-prod-github-runner-207 kernel: [65548.674045] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 23:36:14 juju-e4d256-prod-github-runner-207 kernel: [65548.674877] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:36:14 juju-e4d256-prod-github-runner-207 kernel: [65548.675626] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:36:14 juju-e4d256-prod-github-runner-207 kernel: [65548.676365] ? do_syscall_64+0x69/0xc0 Aug 22 23:36:14 juju-e4d256-prod-github-runner-207 kernel: [65548.677044] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:36:14 juju-e4d256-prod-github-runner-207 kernel: [65548.677755] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:36:14 juju-e4d256-prod-github-runner-207 kernel: [65548.678455] ? do_syscall_64+0x69/0xc0 Aug 22 23:36:14 juju-e4d256-prod-github-runner-207 kernel: [65548.679088] ? do_syscall_64+0x69/0xc0 Aug 22 23:36:14 juju-e4d256-prod-github-runner-207 kernel: [65548.679721] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 23:36:14 juju-e4d256-prod-github-runner-207 kernel: [65548.680440] RIP: 0033:0x7faa5d0edaff Aug 22 23:36:14 juju-e4d256-prod-github-runner-207 kernel: [65548.681117] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 23:36:14 juju-e4d256-prod-github-runner-207 kernel: [65548.683133] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 23:36:14 juju-e4d256-prod-github-runner-207 kernel: [65548.684058] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 23:36:14 juju-e4d256-prod-github-runner-207 kernel: [65548.685043] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 23:36:14 juju-e4d256-prod-github-runner-207 kernel: [65548.685963] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 23:36:14 juju-e4d256-prod-github-runner-207 kernel: [65548.686873] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 23:36:14 juju-e4d256-prod-github-runner-207 kernel: [65548.687779] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 23:36:14 juju-e4d256-prod-github-runner-207 kernel: [65548.688707] Aug 22 23:36:42 juju-e4d256-prod-github-runner-207 kernel: [65576.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 60964s! [qemu-system-x86:6715] Aug 22 23:36:42 juju-e4d256-prod-github-runner-207 kernel: [65576.543864] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 23:36:42 juju-e4d256-prod-github-runner-207 kernel: [65576.544159] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 23:36:42 juju-e4d256-prod-github-runner-207 kernel: [65576.556779] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 23:36:42 juju-e4d256-prod-github-runner-207 kernel: [65576.558155] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 23:36:42 juju-e4d256-prod-github-runner-207 kernel: [65576.559530] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:36:42 juju-e4d256-prod-github-runner-207 kernel: [65576.560679] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 23:36:42 juju-e4d256-prod-github-runner-207 kernel: [65576.563318] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 23:36:42 juju-e4d256-prod-github-runner-207 kernel: [65576.564387] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 23:36:42 juju-e4d256-prod-github-runner-207 kernel: [65576.565577] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 23:36:42 juju-e4d256-prod-github-runner-207 kernel: [65576.566774] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 23:36:42 juju-e4d256-prod-github-runner-207 kernel: [65576.567967] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 23:36:42 juju-e4d256-prod-github-runner-207 kernel: [65576.569156] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 23:36:42 juju-e4d256-prod-github-runner-207 kernel: [65576.570350] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 23:36:42 juju-e4d256-prod-github-runner-207 kernel: [65576.571631] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 23:36:42 juju-e4d256-prod-github-runner-207 kernel: [65576.572785] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 23:36:42 juju-e4d256-prod-github-runner-207 kernel: [65576.574012] Call Trace: Aug 22 23:36:42 juju-e4d256-prod-github-runner-207 kernel: [65576.574943] Aug 22 23:36:42 juju-e4d256-prod-github-runner-207 kernel: [65576.575854] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:36:42 juju-e4d256-prod-github-runner-207 kernel: [65576.576937] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:36:42 juju-e4d256-prod-github-runner-207 kernel: [65576.578003] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:36:42 juju-e4d256-prod-github-runner-207 kernel: [65576.579159] ? show_regs.part.0+0x23/0x29 Aug 22 23:36:42 juju-e4d256-prod-github-runner-207 kernel: [65576.580201] ? show_regs.cold+0x8/0xd Aug 22 23:36:42 juju-e4d256-prod-github-runner-207 kernel: [65576.581216] ? watchdog_timer_fn+0x1be/0x220 Aug 22 23:36:42 juju-e4d256-prod-github-runner-207 kernel: [65576.582257] ? lockup_detector_update_enable+0x60/0x60 Aug 22 23:36:42 juju-e4d256-prod-github-runner-207 kernel: [65576.583360] ? __hrtimer_run_queues+0x107/0x230 Aug 22 23:36:42 juju-e4d256-prod-github-runner-207 kernel: [65576.584554] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 23:36:42 juju-e4d256-prod-github-runner-207 kernel: [65576.585605] ? hrtimer_interrupt+0x101/0x220 Aug 22 23:36:42 juju-e4d256-prod-github-runner-207 kernel: [65576.586734] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 23:36:42 juju-e4d256-prod-github-runner-207 kernel: [65576.587851] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 23:36:42 juju-e4d256-prod-github-runner-207 kernel: [65576.588958] Aug 22 23:36:42 juju-e4d256-prod-github-runner-207 kernel: [65576.589830] Aug 22 23:36:42 juju-e4d256-prod-github-runner-207 kernel: [65576.590709] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 23:36:42 juju-e4d256-prod-github-runner-207 kernel: [65576.591808] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:36:42 juju-e4d256-prod-github-runner-207 kernel: [65576.593093] ? _raw_spin_lock+0x22/0x30 Aug 22 23:36:42 juju-e4d256-prod-github-runner-207 kernel: [65576.594062] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:36:42 juju-e4d256-prod-github-runner-207 kernel: [65576.595113] direct_page_fault+0x206/0x310 [kvm] Aug 22 23:36:42 juju-e4d256-prod-github-runner-207 kernel: [65576.596160] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 23:36:42 juju-e4d256-prod-github-runner-207 kernel: [65576.597205] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 23:36:42 juju-e4d256-prod-github-runner-207 kernel: [65576.598245] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 23:36:42 juju-e4d256-prod-github-runner-207 kernel: [65576.599286] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 23:36:42 juju-e4d256-prod-github-runner-207 kernel: [65576.600280] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 23:36:42 juju-e4d256-prod-github-runner-207 kernel: [65576.601390] handle_exit+0x98/0x230 [kvm_amd] Aug 22 23:36:42 juju-e4d256-prod-github-runner-207 kernel: [65576.602311] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 23:36:42 juju-e4d256-prod-github-runner-207 kernel: [65576.603257] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 23:36:42 juju-e4d256-prod-github-runner-207 kernel: [65576.604360] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 23:36:42 juju-e4d256-prod-github-runner-207 kernel: [65576.605288] vcpu_run+0x62/0x2c0 [kvm] Aug 22 23:36:42 juju-e4d256-prod-github-runner-207 kernel: [65576.606113] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 23:36:42 juju-e4d256-prod-github-runner-207 kernel: [65576.606942] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 23:36:42 juju-e4d256-prod-github-runner-207 kernel: [65576.607827] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 23:36:42 juju-e4d256-prod-github-runner-207 kernel: [65576.608667] ? __seccomp_filter+0x4a/0x4a0 Aug 22 23:36:42 juju-e4d256-prod-github-runner-207 kernel: [65576.609436] ? __fget_files+0x86/0xc0 Aug 22 23:36:42 juju-e4d256-prod-github-runner-207 kernel: [65576.610160] __x64_sys_ioctl+0x95/0xd0 Aug 22 23:36:42 juju-e4d256-prod-github-runner-207 kernel: [65576.610891] do_syscall_64+0x5c/0xc0 Aug 22 23:36:42 juju-e4d256-prod-github-runner-207 kernel: [65576.611579] ? do_futex+0x162/0x1f0 Aug 22 23:36:42 juju-e4d256-prod-github-runner-207 kernel: [65576.612257] ? __x64_sys_futex+0x78/0x1e0 Aug 22 23:36:42 juju-e4d256-prod-github-runner-207 kernel: [65576.612963] ? __secure_computing+0xa9/0x120 Aug 22 23:36:42 juju-e4d256-prod-github-runner-207 kernel: [65576.613671] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 23:36:42 juju-e4d256-prod-github-runner-207 kernel: [65576.614454] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:36:42 juju-e4d256-prod-github-runner-207 kernel: [65576.615207] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:36:42 juju-e4d256-prod-github-runner-207 kernel: [65576.615950] ? do_syscall_64+0x69/0xc0 Aug 22 23:36:42 juju-e4d256-prod-github-runner-207 kernel: [65576.616645] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:36:42 juju-e4d256-prod-github-runner-207 kernel: [65576.617395] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:36:42 juju-e4d256-prod-github-runner-207 kernel: [65576.618113] ? do_syscall_64+0x69/0xc0 Aug 22 23:36:42 juju-e4d256-prod-github-runner-207 kernel: [65576.618774] ? do_syscall_64+0x69/0xc0 Aug 22 23:36:42 juju-e4d256-prod-github-runner-207 kernel: [65576.619412] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 23:36:42 juju-e4d256-prod-github-runner-207 kernel: [65576.620142] RIP: 0033:0x7faa5d0edaff Aug 22 23:36:42 juju-e4d256-prod-github-runner-207 kernel: [65576.621039] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 23:36:42 juju-e4d256-prod-github-runner-207 kernel: [65576.623115] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 23:36:42 juju-e4d256-prod-github-runner-207 kernel: [65576.624063] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 23:36:42 juju-e4d256-prod-github-runner-207 kernel: [65576.624999] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 23:36:42 juju-e4d256-prod-github-runner-207 kernel: [65576.625940] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 23:36:42 juju-e4d256-prod-github-runner-207 kernel: [65576.626862] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 23:36:42 juju-e4d256-prod-github-runner-207 kernel: [65576.627784] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 23:36:42 juju-e4d256-prod-github-runner-207 kernel: [65576.628725] Aug 22 23:37:10 juju-e4d256-prod-github-runner-207 kernel: [65604.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 60990s! [qemu-system-x86:6715] Aug 22 23:37:10 juju-e4d256-prod-github-runner-207 kernel: [65604.543172] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 23:37:10 juju-e4d256-prod-github-runner-207 kernel: [65604.543246] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 23:37:10 juju-e4d256-prod-github-runner-207 kernel: [65604.555592] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 23:37:10 juju-e4d256-prod-github-runner-207 kernel: [65604.556904] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 23:37:10 juju-e4d256-prod-github-runner-207 kernel: [65604.558134] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:37:10 juju-e4d256-prod-github-runner-207 kernel: [65604.559223] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 23:37:10 juju-e4d256-prod-github-runner-207 kernel: [65604.561982] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 23:37:10 juju-e4d256-prod-github-runner-207 kernel: [65604.563057] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 23:37:10 juju-e4d256-prod-github-runner-207 kernel: [65604.564315] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 23:37:10 juju-e4d256-prod-github-runner-207 kernel: [65604.565736] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 23:37:10 juju-e4d256-prod-github-runner-207 kernel: [65604.567061] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 23:37:10 juju-e4d256-prod-github-runner-207 kernel: [65604.568274] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 23:37:10 juju-e4d256-prod-github-runner-207 kernel: [65604.569614] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 23:37:10 juju-e4d256-prod-github-runner-207 kernel: [65604.570955] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 23:37:10 juju-e4d256-prod-github-runner-207 kernel: [65604.572134] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 23:37:10 juju-e4d256-prod-github-runner-207 kernel: [65604.573353] Call Trace: Aug 22 23:37:10 juju-e4d256-prod-github-runner-207 kernel: [65604.574291] Aug 22 23:37:10 juju-e4d256-prod-github-runner-207 kernel: [65604.575175] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:37:10 juju-e4d256-prod-github-runner-207 kernel: [65604.576252] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:37:10 juju-e4d256-prod-github-runner-207 kernel: [65604.577303] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:37:10 juju-e4d256-prod-github-runner-207 kernel: [65604.578400] ? show_regs.part.0+0x23/0x29 Aug 22 23:37:10 juju-e4d256-prod-github-runner-207 kernel: [65604.579422] ? show_regs.cold+0x8/0xd Aug 22 23:37:10 juju-e4d256-prod-github-runner-207 kernel: [65604.580519] ? watchdog_timer_fn+0x1be/0x220 Aug 22 23:37:10 juju-e4d256-prod-github-runner-207 kernel: [65604.581542] ? lockup_detector_update_enable+0x60/0x60 Aug 22 23:37:10 juju-e4d256-prod-github-runner-207 kernel: [65604.582643] ? __hrtimer_run_queues+0x107/0x230 Aug 22 23:37:10 juju-e4d256-prod-github-runner-207 kernel: [65604.583704] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 23:37:10 juju-e4d256-prod-github-runner-207 kernel: [65604.584767] ? hrtimer_interrupt+0x101/0x220 Aug 22 23:37:10 juju-e4d256-prod-github-runner-207 kernel: [65604.585794] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 23:37:10 juju-e4d256-prod-github-runner-207 kernel: [65604.586876] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 23:37:10 juju-e4d256-prod-github-runner-207 kernel: [65604.587961] Aug 22 23:37:10 juju-e4d256-prod-github-runner-207 kernel: [65604.588825] Aug 22 23:37:10 juju-e4d256-prod-github-runner-207 kernel: [65604.589667] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 23:37:10 juju-e4d256-prod-github-runner-207 kernel: [65604.590806] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:37:10 juju-e4d256-prod-github-runner-207 kernel: [65604.591983] ? _raw_spin_lock+0x22/0x30 Aug 22 23:37:10 juju-e4d256-prod-github-runner-207 kernel: [65604.592944] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:37:10 juju-e4d256-prod-github-runner-207 kernel: [65604.593969] direct_page_fault+0x206/0x310 [kvm] Aug 22 23:37:10 juju-e4d256-prod-github-runner-207 kernel: [65604.595048] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 23:37:10 juju-e4d256-prod-github-runner-207 kernel: [65604.596127] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 23:37:10 juju-e4d256-prod-github-runner-207 kernel: [65604.597136] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 23:37:10 juju-e4d256-prod-github-runner-207 kernel: [65604.598110] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 23:37:10 juju-e4d256-prod-github-runner-207 kernel: [65604.599088] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 23:37:10 juju-e4d256-prod-github-runner-207 kernel: [65604.600109] handle_exit+0x98/0x230 [kvm_amd] Aug 22 23:37:10 juju-e4d256-prod-github-runner-207 kernel: [65604.601019] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 23:37:10 juju-e4d256-prod-github-runner-207 kernel: [65604.601944] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 23:37:10 juju-e4d256-prod-github-runner-207 kernel: [65604.603007] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 23:37:10 juju-e4d256-prod-github-runner-207 kernel: [65604.603948] vcpu_run+0x62/0x2c0 [kvm] Aug 22 23:37:10 juju-e4d256-prod-github-runner-207 kernel: [65604.604769] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 23:37:10 juju-e4d256-prod-github-runner-207 kernel: [65604.605587] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 23:37:10 juju-e4d256-prod-github-runner-207 kernel: [65604.606474] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 23:37:10 juju-e4d256-prod-github-runner-207 kernel: [65604.607282] ? __seccomp_filter+0x4a/0x4a0 Aug 22 23:37:10 juju-e4d256-prod-github-runner-207 kernel: [65604.608056] ? __fget_files+0x86/0xc0 Aug 22 23:37:10 juju-e4d256-prod-github-runner-207 kernel: [65604.608771] __x64_sys_ioctl+0x95/0xd0 Aug 22 23:37:10 juju-e4d256-prod-github-runner-207 kernel: [65604.609472] do_syscall_64+0x5c/0xc0 Aug 22 23:37:10 juju-e4d256-prod-github-runner-207 kernel: [65604.610141] ? do_futex+0x162/0x1f0 Aug 22 23:37:10 juju-e4d256-prod-github-runner-207 kernel: [65604.610820] ? __x64_sys_futex+0x78/0x1e0 Aug 22 23:37:10 juju-e4d256-prod-github-runner-207 kernel: [65604.611506] ? __secure_computing+0xa9/0x120 Aug 22 23:37:10 juju-e4d256-prod-github-runner-207 kernel: [65604.612239] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 23:37:10 juju-e4d256-prod-github-runner-207 kernel: [65604.613130] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:37:10 juju-e4d256-prod-github-runner-207 kernel: [65604.613952] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:37:10 juju-e4d256-prod-github-runner-207 kernel: [65604.614784] ? do_syscall_64+0x69/0xc0 Aug 22 23:37:10 juju-e4d256-prod-github-runner-207 kernel: [65604.615533] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:37:10 juju-e4d256-prod-github-runner-207 kernel: [65604.616349] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:37:10 juju-e4d256-prod-github-runner-207 kernel: [65604.617142] ? do_syscall_64+0x69/0xc0 Aug 22 23:37:10 juju-e4d256-prod-github-runner-207 kernel: [65604.617843] ? do_syscall_64+0x69/0xc0 Aug 22 23:37:10 juju-e4d256-prod-github-runner-207 kernel: [65604.618551] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 23:37:10 juju-e4d256-prod-github-runner-207 kernel: [65604.619372] RIP: 0033:0x7faa5d0edaff Aug 22 23:37:10 juju-e4d256-prod-github-runner-207 kernel: [65604.620106] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 23:37:10 juju-e4d256-prod-github-runner-207 kernel: [65604.622497] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 23:37:10 juju-e4d256-prod-github-runner-207 kernel: [65604.623554] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 23:37:10 juju-e4d256-prod-github-runner-207 kernel: [65604.624610] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 23:37:10 juju-e4d256-prod-github-runner-207 kernel: [65604.625659] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 23:37:10 juju-e4d256-prod-github-runner-207 kernel: [65604.626684] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 23:37:10 juju-e4d256-prod-github-runner-207 kernel: [65604.627711] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 23:37:10 juju-e4d256-prod-github-runner-207 kernel: [65604.628758] Aug 22 23:37:38 juju-e4d256-prod-github-runner-207 kernel: [65632.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 61017s! [qemu-system-x86:6715] Aug 22 23:37:38 juju-e4d256-prod-github-runner-207 kernel: [65632.543147] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 23:37:38 juju-e4d256-prod-github-runner-207 kernel: [65632.543223] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 23:37:38 juju-e4d256-prod-github-runner-207 kernel: [65632.556924] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 23:37:38 juju-e4d256-prod-github-runner-207 kernel: [65632.558206] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 23:37:38 juju-e4d256-prod-github-runner-207 kernel: [65632.559466] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:37:38 juju-e4d256-prod-github-runner-207 kernel: [65632.560552] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 23:37:38 juju-e4d256-prod-github-runner-207 kernel: [65632.563155] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 23:37:38 juju-e4d256-prod-github-runner-207 kernel: [65632.564225] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 23:37:38 juju-e4d256-prod-github-runner-207 kernel: [65632.565411] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 23:37:38 juju-e4d256-prod-github-runner-207 kernel: [65632.566585] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 23:37:38 juju-e4d256-prod-github-runner-207 kernel: [65632.567775] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 23:37:38 juju-e4d256-prod-github-runner-207 kernel: [65632.568979] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 23:37:38 juju-e4d256-prod-github-runner-207 kernel: [65632.570198] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 23:37:38 juju-e4d256-prod-github-runner-207 kernel: [65632.571455] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 23:37:38 juju-e4d256-prod-github-runner-207 kernel: [65632.572584] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 23:37:38 juju-e4d256-prod-github-runner-207 kernel: [65632.573879] Call Trace: Aug 22 23:37:38 juju-e4d256-prod-github-runner-207 kernel: [65632.574892] Aug 22 23:37:38 juju-e4d256-prod-github-runner-207 kernel: [65632.575833] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:37:38 juju-e4d256-prod-github-runner-207 kernel: [65632.576900] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:37:38 juju-e4d256-prod-github-runner-207 kernel: [65632.577952] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:37:38 juju-e4d256-prod-github-runner-207 kernel: [65632.579070] ? show_regs.part.0+0x23/0x29 Aug 22 23:37:38 juju-e4d256-prod-github-runner-207 kernel: [65632.580126] ? show_regs.cold+0x8/0xd Aug 22 23:37:38 juju-e4d256-prod-github-runner-207 kernel: [65632.581161] ? watchdog_timer_fn+0x1be/0x220 Aug 22 23:37:38 juju-e4d256-prod-github-runner-207 kernel: [65632.582225] ? lockup_detector_update_enable+0x60/0x60 Aug 22 23:37:38 juju-e4d256-prod-github-runner-207 kernel: [65632.583362] ? __hrtimer_run_queues+0x107/0x230 Aug 22 23:37:38 juju-e4d256-prod-github-runner-207 kernel: [65632.584513] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 23:37:38 juju-e4d256-prod-github-runner-207 kernel: [65632.585631] ? hrtimer_interrupt+0x101/0x220 Aug 22 23:37:38 juju-e4d256-prod-github-runner-207 kernel: [65632.586789] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 23:37:38 juju-e4d256-prod-github-runner-207 kernel: [65632.587966] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 23:37:38 juju-e4d256-prod-github-runner-207 kernel: [65632.589103] Aug 22 23:37:38 juju-e4d256-prod-github-runner-207 kernel: [65632.589994] Aug 22 23:37:38 juju-e4d256-prod-github-runner-207 kernel: [65632.590866] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 23:37:38 juju-e4d256-prod-github-runner-207 kernel: [65632.591965] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:37:38 juju-e4d256-prod-github-runner-207 kernel: [65632.593016] ? _raw_spin_lock+0x22/0x30 Aug 22 23:37:38 juju-e4d256-prod-github-runner-207 kernel: [65632.594000] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:37:38 juju-e4d256-prod-github-runner-207 kernel: [65632.595045] direct_page_fault+0x206/0x310 [kvm] Aug 22 23:37:38 juju-e4d256-prod-github-runner-207 kernel: [65632.596099] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 23:37:38 juju-e4d256-prod-github-runner-207 kernel: [65632.597127] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 23:37:38 juju-e4d256-prod-github-runner-207 kernel: [65632.598142] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 23:37:38 juju-e4d256-prod-github-runner-207 kernel: [65632.599125] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 23:37:38 juju-e4d256-prod-github-runner-207 kernel: [65632.600090] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 23:37:38 juju-e4d256-prod-github-runner-207 kernel: [65632.601079] handle_exit+0x98/0x230 [kvm_amd] Aug 22 23:37:38 juju-e4d256-prod-github-runner-207 kernel: [65632.601981] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 23:37:38 juju-e4d256-prod-github-runner-207 kernel: [65632.602905] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 23:37:38 juju-e4d256-prod-github-runner-207 kernel: [65632.603854] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 23:37:38 juju-e4d256-prod-github-runner-207 kernel: [65632.604771] vcpu_run+0x62/0x2c0 [kvm] Aug 22 23:37:38 juju-e4d256-prod-github-runner-207 kernel: [65632.605590] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 23:37:38 juju-e4d256-prod-github-runner-207 kernel: [65632.606416] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 23:37:38 juju-e4d256-prod-github-runner-207 kernel: [65632.607283] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 23:37:38 juju-e4d256-prod-github-runner-207 kernel: [65632.608101] ? __seccomp_filter+0x4a/0x4a0 Aug 22 23:37:38 juju-e4d256-prod-github-runner-207 kernel: [65632.608854] ? __fget_files+0x86/0xc0 Aug 22 23:37:38 juju-e4d256-prod-github-runner-207 kernel: [65632.609570] __x64_sys_ioctl+0x95/0xd0 Aug 22 23:37:38 juju-e4d256-prod-github-runner-207 kernel: [65632.610279] do_syscall_64+0x5c/0xc0 Aug 22 23:37:38 juju-e4d256-prod-github-runner-207 kernel: [65632.610973] ? do_futex+0x162/0x1f0 Aug 22 23:37:38 juju-e4d256-prod-github-runner-207 kernel: [65632.611646] ? __x64_sys_futex+0x78/0x1e0 Aug 22 23:37:38 juju-e4d256-prod-github-runner-207 kernel: [65632.612325] ? __secure_computing+0xa9/0x120 Aug 22 23:37:38 juju-e4d256-prod-github-runner-207 kernel: [65632.613024] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 23:37:38 juju-e4d256-prod-github-runner-207 kernel: [65632.613801] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:37:38 juju-e4d256-prod-github-runner-207 kernel: [65632.614534] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:37:38 juju-e4d256-prod-github-runner-207 kernel: [65632.615305] ? do_syscall_64+0x69/0xc0 Aug 22 23:37:38 juju-e4d256-prod-github-runner-207 kernel: [65632.615997] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:37:38 juju-e4d256-prod-github-runner-207 kernel: [65632.616714] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:37:38 juju-e4d256-prod-github-runner-207 kernel: [65632.617421] ? do_syscall_64+0x69/0xc0 Aug 22 23:37:38 juju-e4d256-prod-github-runner-207 kernel: [65632.618056] ? do_syscall_64+0x69/0xc0 Aug 22 23:37:38 juju-e4d256-prod-github-runner-207 kernel: [65632.618728] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 23:37:38 juju-e4d256-prod-github-runner-207 kernel: [65632.619443] RIP: 0033:0x7faa5d0edaff Aug 22 23:37:38 juju-e4d256-prod-github-runner-207 kernel: [65632.620251] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 23:37:38 juju-e4d256-prod-github-runner-207 kernel: [65632.622269] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 23:37:38 juju-e4d256-prod-github-runner-207 kernel: [65632.623228] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 23:37:38 juju-e4d256-prod-github-runner-207 kernel: [65632.624150] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 23:37:38 juju-e4d256-prod-github-runner-207 kernel: [65632.625055] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 23:37:38 juju-e4d256-prod-github-runner-207 kernel: [65632.625960] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 23:37:38 juju-e4d256-prod-github-runner-207 kernel: [65632.626865] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 23:37:38 juju-e4d256-prod-github-runner-207 kernel: [65632.627794] Aug 22 23:38:06 juju-e4d256-prod-github-runner-207 kernel: [65660.541981] watchdog: BUG: soft lockup - CPU#1 stuck for 61043s! [qemu-system-x86:6715] Aug 22 23:38:06 juju-e4d256-prod-github-runner-207 kernel: [65660.543271] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 23:38:06 juju-e4d256-prod-github-runner-207 kernel: [65660.543525] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 23:38:06 juju-e4d256-prod-github-runner-207 kernel: [65660.556223] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 23:38:06 juju-e4d256-prod-github-runner-207 kernel: [65660.557536] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 23:38:06 juju-e4d256-prod-github-runner-207 kernel: [65660.558774] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:38:06 juju-e4d256-prod-github-runner-207 kernel: [65660.559909] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 23:38:06 juju-e4d256-prod-github-runner-207 kernel: [65660.562502] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 23:38:06 juju-e4d256-prod-github-runner-207 kernel: [65660.563573] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 23:38:06 juju-e4d256-prod-github-runner-207 kernel: [65660.564786] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 23:38:06 juju-e4d256-prod-github-runner-207 kernel: [65660.566000] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 23:38:06 juju-e4d256-prod-github-runner-207 kernel: [65660.567258] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 23:38:06 juju-e4d256-prod-github-runner-207 kernel: [65660.568452] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 23:38:06 juju-e4d256-prod-github-runner-207 kernel: [65660.569642] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 23:38:06 juju-e4d256-prod-github-runner-207 kernel: [65660.570948] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 23:38:06 juju-e4d256-prod-github-runner-207 kernel: [65660.572153] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 23:38:06 juju-e4d256-prod-github-runner-207 kernel: [65660.573372] Call Trace: Aug 22 23:38:06 juju-e4d256-prod-github-runner-207 kernel: [65660.574448] Aug 22 23:38:06 juju-e4d256-prod-github-runner-207 kernel: [65660.575365] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:38:06 juju-e4d256-prod-github-runner-207 kernel: [65660.576436] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:38:06 juju-e4d256-prod-github-runner-207 kernel: [65660.577498] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:38:06 juju-e4d256-prod-github-runner-207 kernel: [65660.578632] ? show_regs.part.0+0x23/0x29 Aug 22 23:38:06 juju-e4d256-prod-github-runner-207 kernel: [65660.579697] ? show_regs.cold+0x8/0xd Aug 22 23:38:06 juju-e4d256-prod-github-runner-207 kernel: [65660.580705] ? watchdog_timer_fn+0x1be/0x220 Aug 22 23:38:06 juju-e4d256-prod-github-runner-207 kernel: [65660.581782] ? lockup_detector_update_enable+0x60/0x60 Aug 22 23:38:06 juju-e4d256-prod-github-runner-207 kernel: [65660.582904] ? __hrtimer_run_queues+0x107/0x230 Aug 22 23:38:06 juju-e4d256-prod-github-runner-207 kernel: [65660.583976] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 23:38:06 juju-e4d256-prod-github-runner-207 kernel: [65660.585015] ? hrtimer_interrupt+0x101/0x220 Aug 22 23:38:06 juju-e4d256-prod-github-runner-207 kernel: [65660.586046] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 23:38:06 juju-e4d256-prod-github-runner-207 kernel: [65660.587151] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 23:38:06 juju-e4d256-prod-github-runner-207 kernel: [65660.588234] Aug 22 23:38:06 juju-e4d256-prod-github-runner-207 kernel: [65660.589098] Aug 22 23:38:06 juju-e4d256-prod-github-runner-207 kernel: [65660.589942] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 23:38:06 juju-e4d256-prod-github-runner-207 kernel: [65660.590990] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:38:06 juju-e4d256-prod-github-runner-207 kernel: [65660.592060] ? _raw_spin_lock+0x22/0x30 Aug 22 23:38:06 juju-e4d256-prod-github-runner-207 kernel: [65660.593012] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:38:06 juju-e4d256-prod-github-runner-207 kernel: [65660.594045] direct_page_fault+0x206/0x310 [kvm] Aug 22 23:38:06 juju-e4d256-prod-github-runner-207 kernel: [65660.595119] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 23:38:06 juju-e4d256-prod-github-runner-207 kernel: [65660.596161] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 23:38:06 juju-e4d256-prod-github-runner-207 kernel: [65660.597174] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 23:38:06 juju-e4d256-prod-github-runner-207 kernel: [65660.598194] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 23:38:06 juju-e4d256-prod-github-runner-207 kernel: [65660.599149] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 23:38:06 juju-e4d256-prod-github-runner-207 kernel: [65660.600152] handle_exit+0x98/0x230 [kvm_amd] Aug 22 23:38:06 juju-e4d256-prod-github-runner-207 kernel: [65660.601054] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 23:38:06 juju-e4d256-prod-github-runner-207 kernel: [65660.602011] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 23:38:06 juju-e4d256-prod-github-runner-207 kernel: [65660.602954] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 23:38:06 juju-e4d256-prod-github-runner-207 kernel: [65660.603880] vcpu_run+0x62/0x2c0 [kvm] Aug 22 23:38:06 juju-e4d256-prod-github-runner-207 kernel: [65660.604697] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 23:38:06 juju-e4d256-prod-github-runner-207 kernel: [65660.605512] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 23:38:06 juju-e4d256-prod-github-runner-207 kernel: [65660.606385] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 23:38:06 juju-e4d256-prod-github-runner-207 kernel: [65660.607193] ? __seccomp_filter+0x4a/0x4a0 Aug 22 23:38:06 juju-e4d256-prod-github-runner-207 kernel: [65660.607996] ? __fget_files+0x86/0xc0 Aug 22 23:38:06 juju-e4d256-prod-github-runner-207 kernel: [65660.608714] __x64_sys_ioctl+0x95/0xd0 Aug 22 23:38:06 juju-e4d256-prod-github-runner-207 kernel: [65660.609429] do_syscall_64+0x5c/0xc0 Aug 22 23:38:06 juju-e4d256-prod-github-runner-207 kernel: [65660.610105] ? do_futex+0x162/0x1f0 Aug 22 23:38:06 juju-e4d256-prod-github-runner-207 kernel: [65660.610761] ? __x64_sys_futex+0x78/0x1e0 Aug 22 23:38:06 juju-e4d256-prod-github-runner-207 kernel: [65660.611458] ? __secure_computing+0xa9/0x120 Aug 22 23:38:06 juju-e4d256-prod-github-runner-207 kernel: [65660.612159] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 23:38:06 juju-e4d256-prod-github-runner-207 kernel: [65660.612931] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:38:06 juju-e4d256-prod-github-runner-207 kernel: [65660.613735] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:38:06 juju-e4d256-prod-github-runner-207 kernel: [65660.614466] ? do_syscall_64+0x69/0xc0 Aug 22 23:38:06 juju-e4d256-prod-github-runner-207 kernel: [65660.615121] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:38:06 juju-e4d256-prod-github-runner-207 kernel: [65660.615848] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:38:06 juju-e4d256-prod-github-runner-207 kernel: [65660.616551] ? do_syscall_64+0x69/0xc0 Aug 22 23:38:06 juju-e4d256-prod-github-runner-207 kernel: [65660.617182] ? do_syscall_64+0x69/0xc0 Aug 22 23:38:06 juju-e4d256-prod-github-runner-207 kernel: [65660.617813] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 23:38:06 juju-e4d256-prod-github-runner-207 kernel: [65660.618744] RIP: 0033:0x7faa5d0edaff Aug 22 23:38:06 juju-e4d256-prod-github-runner-207 kernel: [65660.619445] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 23:38:06 juju-e4d256-prod-github-runner-207 kernel: [65660.621488] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 23:38:06 juju-e4d256-prod-github-runner-207 kernel: [65660.622416] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 23:38:06 juju-e4d256-prod-github-runner-207 kernel: [65660.623398] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 23:38:06 juju-e4d256-prod-github-runner-207 kernel: [65660.624322] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 23:38:06 juju-e4d256-prod-github-runner-207 kernel: [65660.625280] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 23:38:06 juju-e4d256-prod-github-runner-207 kernel: [65660.626188] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 23:38:06 juju-e4d256-prod-github-runner-207 kernel: [65660.627114] Aug 22 23:38:34 juju-e4d256-prod-github-runner-207 kernel: [65688.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 61069s! [qemu-system-x86:6715] Aug 22 23:38:34 juju-e4d256-prod-github-runner-207 kernel: [65688.543885] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 23:38:34 juju-e4d256-prod-github-runner-207 kernel: [65688.544087] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 23:38:34 juju-e4d256-prod-github-runner-207 kernel: [65688.556821] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 23:38:34 juju-e4d256-prod-github-runner-207 kernel: [65688.558153] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 23:38:34 juju-e4d256-prod-github-runner-207 kernel: [65688.559591] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:38:34 juju-e4d256-prod-github-runner-207 kernel: [65688.560684] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 23:38:34 juju-e4d256-prod-github-runner-207 kernel: [65688.563376] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 23:38:34 juju-e4d256-prod-github-runner-207 kernel: [65688.564462] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 23:38:34 juju-e4d256-prod-github-runner-207 kernel: [65688.565670] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 23:38:34 juju-e4d256-prod-github-runner-207 kernel: [65688.566881] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 23:38:34 juju-e4d256-prod-github-runner-207 kernel: [65688.568080] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 23:38:34 juju-e4d256-prod-github-runner-207 kernel: [65688.569283] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 23:38:34 juju-e4d256-prod-github-runner-207 kernel: [65688.570496] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 23:38:34 juju-e4d256-prod-github-runner-207 kernel: [65688.571800] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 23:38:34 juju-e4d256-prod-github-runner-207 kernel: [65688.572973] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 23:38:34 juju-e4d256-prod-github-runner-207 kernel: [65688.574247] Call Trace: Aug 22 23:38:34 juju-e4d256-prod-github-runner-207 kernel: [65688.575282] Aug 22 23:38:34 juju-e4d256-prod-github-runner-207 kernel: [65688.576203] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:38:34 juju-e4d256-prod-github-runner-207 kernel: [65688.577257] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:38:34 juju-e4d256-prod-github-runner-207 kernel: [65688.578301] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:38:34 juju-e4d256-prod-github-runner-207 kernel: [65688.579424] ? show_regs.part.0+0x23/0x29 Aug 22 23:38:34 juju-e4d256-prod-github-runner-207 kernel: [65688.580463] ? show_regs.cold+0x8/0xd Aug 22 23:38:34 juju-e4d256-prod-github-runner-207 kernel: [65688.581467] ? watchdog_timer_fn+0x1be/0x220 Aug 22 23:38:34 juju-e4d256-prod-github-runner-207 kernel: [65688.582510] ? lockup_detector_update_enable+0x60/0x60 Aug 22 23:38:34 juju-e4d256-prod-github-runner-207 kernel: [65688.583631] ? __hrtimer_run_queues+0x107/0x230 Aug 22 23:38:34 juju-e4d256-prod-github-runner-207 kernel: [65688.584707] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 23:38:34 juju-e4d256-prod-github-runner-207 kernel: [65688.585822] ? hrtimer_interrupt+0x101/0x220 Aug 22 23:38:34 juju-e4d256-prod-github-runner-207 kernel: [65688.587070] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 23:38:34 juju-e4d256-prod-github-runner-207 kernel: [65688.588424] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 23:38:34 juju-e4d256-prod-github-runner-207 kernel: [65688.589503] Aug 22 23:38:34 juju-e4d256-prod-github-runner-207 kernel: [65688.590381] Aug 22 23:38:34 juju-e4d256-prod-github-runner-207 kernel: [65688.591265] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 23:38:34 juju-e4d256-prod-github-runner-207 kernel: [65688.592365] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:38:34 juju-e4d256-prod-github-runner-207 kernel: [65688.593446] ? _raw_spin_lock+0x22/0x30 Aug 22 23:38:34 juju-e4d256-prod-github-runner-207 kernel: [65688.594419] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:38:34 juju-e4d256-prod-github-runner-207 kernel: [65688.595483] direct_page_fault+0x206/0x310 [kvm] Aug 22 23:38:34 juju-e4d256-prod-github-runner-207 kernel: [65688.596535] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 23:38:34 juju-e4d256-prod-github-runner-207 kernel: [65688.597622] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 23:38:34 juju-e4d256-prod-github-runner-207 kernel: [65688.598691] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 23:38:34 juju-e4d256-prod-github-runner-207 kernel: [65688.599739] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 23:38:34 juju-e4d256-prod-github-runner-207 kernel: [65688.600718] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 23:38:34 juju-e4d256-prod-github-runner-207 kernel: [65688.601731] handle_exit+0x98/0x230 [kvm_amd] Aug 22 23:38:34 juju-e4d256-prod-github-runner-207 kernel: [65688.602648] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 23:38:34 juju-e4d256-prod-github-runner-207 kernel: [65688.603767] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 23:38:34 juju-e4d256-prod-github-runner-207 kernel: [65688.604745] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 23:38:34 juju-e4d256-prod-github-runner-207 kernel: [65688.605691] vcpu_run+0x62/0x2c0 [kvm] Aug 22 23:38:34 juju-e4d256-prod-github-runner-207 kernel: [65688.606525] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 23:38:34 juju-e4d256-prod-github-runner-207 kernel: [65688.607440] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 23:38:34 juju-e4d256-prod-github-runner-207 kernel: [65688.608331] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 23:38:34 juju-e4d256-prod-github-runner-207 kernel: [65688.609159] ? __seccomp_filter+0x4a/0x4a0 Aug 22 23:38:34 juju-e4d256-prod-github-runner-207 kernel: [65688.609955] ? __fget_files+0x86/0xc0 Aug 22 23:38:34 juju-e4d256-prod-github-runner-207 kernel: [65688.610686] __x64_sys_ioctl+0x95/0xd0 Aug 22 23:38:34 juju-e4d256-prod-github-runner-207 kernel: [65688.611422] do_syscall_64+0x5c/0xc0 Aug 22 23:38:34 juju-e4d256-prod-github-runner-207 kernel: [65688.612113] ? do_futex+0x162/0x1f0 Aug 22 23:38:34 juju-e4d256-prod-github-runner-207 kernel: [65688.612790] ? __x64_sys_futex+0x78/0x1e0 Aug 22 23:38:34 juju-e4d256-prod-github-runner-207 kernel: [65688.613526] ? __secure_computing+0xa9/0x120 Aug 22 23:38:34 juju-e4d256-prod-github-runner-207 kernel: [65688.614270] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 23:38:34 juju-e4d256-prod-github-runner-207 kernel: [65688.615087] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:38:34 juju-e4d256-prod-github-runner-207 kernel: [65688.615843] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:38:34 juju-e4d256-prod-github-runner-207 kernel: [65688.616655] ? do_syscall_64+0x69/0xc0 Aug 22 23:38:34 juju-e4d256-prod-github-runner-207 kernel: [65688.617444] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:38:34 juju-e4d256-prod-github-runner-207 kernel: [65688.618196] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:38:34 juju-e4d256-prod-github-runner-207 kernel: [65688.619090] ? do_syscall_64+0x69/0xc0 Aug 22 23:38:34 juju-e4d256-prod-github-runner-207 kernel: [65688.619752] ? do_syscall_64+0x69/0xc0 Aug 22 23:38:34 juju-e4d256-prod-github-runner-207 kernel: [65688.620429] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 23:38:34 juju-e4d256-prod-github-runner-207 kernel: [65688.621178] RIP: 0033:0x7faa5d0edaff Aug 22 23:38:34 juju-e4d256-prod-github-runner-207 kernel: [65688.621848] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 23:38:34 juju-e4d256-prod-github-runner-207 kernel: [65688.623981] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 23:38:34 juju-e4d256-prod-github-runner-207 kernel: [65688.625068] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 23:38:34 juju-e4d256-prod-github-runner-207 kernel: [65688.626788] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 23:38:34 juju-e4d256-prod-github-runner-207 kernel: [65688.627921] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 23:38:34 juju-e4d256-prod-github-runner-207 kernel: [65688.628849] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 23:38:34 juju-e4d256-prod-github-runner-207 kernel: [65688.629797] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 23:38:34 juju-e4d256-prod-github-runner-207 kernel: [65688.630812] Aug 22 23:38:47 juju-e4d256-prod-github-runner-207 kernel: [65701.568707] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 23:38:47 juju-e4d256-prod-github-runner-207 kernel: [65701.569712] rcu: 1-....: (16344397 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=7890350 Aug 22 23:38:47 juju-e4d256-prod-github-runner-207 kernel: [65701.570882] (t=16396092 jiffies g=23269 q=57654) Aug 22 23:38:47 juju-e4d256-prod-github-runner-207 kernel: [65701.571689] NMI backtrace for cpu 1 Aug 22 23:38:47 juju-e4d256-prod-github-runner-207 kernel: [65701.572428] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 23:38:47 juju-e4d256-prod-github-runner-207 kernel: [65701.573696] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 23:38:47 juju-e4d256-prod-github-runner-207 kernel: [65701.574835] Call Trace: Aug 22 23:38:47 juju-e4d256-prod-github-runner-207 kernel: [65701.575515] Aug 22 23:38:47 juju-e4d256-prod-github-runner-207 kernel: [65701.576164] show_stack+0x52/0x5c Aug 22 23:38:47 juju-e4d256-prod-github-runner-207 kernel: [65701.576897] dump_stack_lvl+0x4a/0x63 Aug 22 23:38:47 juju-e4d256-prod-github-runner-207 kernel: [65701.577695] dump_stack+0x10/0x16 Aug 22 23:38:47 juju-e4d256-prod-github-runner-207 kernel: [65701.578468] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 23:38:47 juju-e4d256-prod-github-runner-207 kernel: [65701.579294] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 23:38:47 juju-e4d256-prod-github-runner-207 kernel: [65701.580085] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 23:38:47 juju-e4d256-prod-github-runner-207 kernel: [65701.580918] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 23:38:47 juju-e4d256-prod-github-runner-207 kernel: [65701.581749] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 23:38:47 juju-e4d256-prod-github-runner-207 kernel: [65701.582573] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 23:38:47 juju-e4d256-prod-github-runner-207 kernel: [65701.583382] print_cpu_stall.cold+0x2f/0xe2 Aug 22 23:38:47 juju-e4d256-prod-github-runner-207 kernel: [65701.584173] ? timekeeping_update+0xf7/0x150 Aug 22 23:38:47 juju-e4d256-prod-github-runner-207 kernel: [65701.584954] check_cpu_stall+0x109/0x270 Aug 22 23:38:47 juju-e4d256-prod-github-runner-207 kernel: [65701.585717] rcu_sched_clock_irq+0x9a/0x250 Aug 22 23:38:47 juju-e4d256-prod-github-runner-207 kernel: [65701.586490] update_process_times+0x94/0xd0 Aug 22 23:38:47 juju-e4d256-prod-github-runner-207 kernel: [65701.587282] tick_sched_handle+0x29/0x70 Aug 22 23:38:47 juju-e4d256-prod-github-runner-207 kernel: [65701.588039] tick_sched_timer+0x8c/0xc0 Aug 22 23:38:47 juju-e4d256-prod-github-runner-207 kernel: [65701.588820] ? tick_nohz_handler+0xb0/0xb0 Aug 22 23:38:47 juju-e4d256-prod-github-runner-207 kernel: [65701.589593] __hrtimer_run_queues+0x107/0x230 Aug 22 23:38:47 juju-e4d256-prod-github-runner-207 kernel: [65701.590378] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 23:38:47 juju-e4d256-prod-github-runner-207 kernel: [65701.591185] hrtimer_interrupt+0x101/0x220 Aug 22 23:38:47 juju-e4d256-prod-github-runner-207 kernel: [65701.591957] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 23:38:47 juju-e4d256-prod-github-runner-207 kernel: [65701.592782] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 23:38:47 juju-e4d256-prod-github-runner-207 kernel: [65701.593595] Aug 22 23:38:47 juju-e4d256-prod-github-runner-207 kernel: [65701.594243] Aug 22 23:38:47 juju-e4d256-prod-github-runner-207 kernel: [65701.594901] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 23:38:47 juju-e4d256-prod-github-runner-207 kernel: [65701.595734] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:38:47 juju-e4d256-prod-github-runner-207 kernel: [65701.596630] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 23:38:47 juju-e4d256-prod-github-runner-207 kernel: [65701.599021] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 23:38:47 juju-e4d256-prod-github-runner-207 kernel: [65701.599967] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 23:38:47 juju-e4d256-prod-github-runner-207 kernel: [65701.601084] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 23:38:47 juju-e4d256-prod-github-runner-207 kernel: [65701.602098] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 23:38:47 juju-e4d256-prod-github-runner-207 kernel: [65701.603117] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 23:38:47 juju-e4d256-prod-github-runner-207 kernel: [65701.604100] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 23:38:47 juju-e4d256-prod-github-runner-207 kernel: [65701.605094] ? _raw_spin_lock+0x22/0x30 Aug 22 23:38:47 juju-e4d256-prod-github-runner-207 kernel: [65701.605861] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:38:47 juju-e4d256-prod-github-runner-207 kernel: [65701.606735] direct_page_fault+0x206/0x310 [kvm] Aug 22 23:38:47 juju-e4d256-prod-github-runner-207 kernel: [65701.607630] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 23:38:47 juju-e4d256-prod-github-runner-207 kernel: [65701.608483] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 23:38:47 juju-e4d256-prod-github-runner-207 kernel: [65701.609347] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 23:38:47 juju-e4d256-prod-github-runner-207 kernel: [65701.610179] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 23:38:47 juju-e4d256-prod-github-runner-207 kernel: [65701.611004] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 23:38:47 juju-e4d256-prod-github-runner-207 kernel: [65701.611840] handle_exit+0x98/0x230 [kvm_amd] Aug 22 23:38:47 juju-e4d256-prod-github-runner-207 kernel: [65701.612606] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 23:38:47 juju-e4d256-prod-github-runner-207 kernel: [65701.613407] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 23:38:47 juju-e4d256-prod-github-runner-207 kernel: [65701.614217] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 23:38:47 juju-e4d256-prod-github-runner-207 kernel: [65701.615050] vcpu_run+0x62/0x2c0 [kvm] Aug 22 23:38:47 juju-e4d256-prod-github-runner-207 kernel: [65701.615782] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 23:38:47 juju-e4d256-prod-github-runner-207 kernel: [65701.616523] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 23:38:47 juju-e4d256-prod-github-runner-207 kernel: [65701.617383] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 23:38:47 juju-e4d256-prod-github-runner-207 kernel: [65701.618164] ? __seccomp_filter+0x4a/0x4a0 Aug 22 23:38:47 juju-e4d256-prod-github-runner-207 kernel: [65701.618923] ? __fget_files+0x86/0xc0 Aug 22 23:38:47 juju-e4d256-prod-github-runner-207 kernel: [65701.619675] __x64_sys_ioctl+0x95/0xd0 Aug 22 23:38:47 juju-e4d256-prod-github-runner-207 kernel: [65701.620439] do_syscall_64+0x5c/0xc0 Aug 22 23:38:47 juju-e4d256-prod-github-runner-207 kernel: [65701.621138] ? do_futex+0x162/0x1f0 Aug 22 23:38:47 juju-e4d256-prod-github-runner-207 kernel: [65701.621819] ? __x64_sys_futex+0x78/0x1e0 Aug 22 23:38:47 juju-e4d256-prod-github-runner-207 kernel: [65701.622533] ? __secure_computing+0xa9/0x120 Aug 22 23:38:47 juju-e4d256-prod-github-runner-207 kernel: [65701.623286] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 23:38:47 juju-e4d256-prod-github-runner-207 kernel: [65701.624096] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:38:47 juju-e4d256-prod-github-runner-207 kernel: [65701.624866] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:38:47 juju-e4d256-prod-github-runner-207 kernel: [65701.625640] ? do_syscall_64+0x69/0xc0 Aug 22 23:38:47 juju-e4d256-prod-github-runner-207 kernel: [65701.626349] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:38:47 juju-e4d256-prod-github-runner-207 kernel: [65701.627146] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:38:47 juju-e4d256-prod-github-runner-207 kernel: [65701.627927] ? do_syscall_64+0x69/0xc0 Aug 22 23:38:47 juju-e4d256-prod-github-runner-207 kernel: [65701.628630] ? do_syscall_64+0x69/0xc0 Aug 22 23:38:47 juju-e4d256-prod-github-runner-207 kernel: [65701.629332] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 23:38:47 juju-e4d256-prod-github-runner-207 kernel: [65701.630110] RIP: 0033:0x7faa5d0edaff Aug 22 23:38:47 juju-e4d256-prod-github-runner-207 kernel: [65701.630875] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 23:38:47 juju-e4d256-prod-github-runner-207 kernel: [65701.633037] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 23:38:47 juju-e4d256-prod-github-runner-207 kernel: [65701.634025] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 23:38:47 juju-e4d256-prod-github-runner-207 kernel: [65701.635010] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 23:38:47 juju-e4d256-prod-github-runner-207 kernel: [65701.635993] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 23:38:47 juju-e4d256-prod-github-runner-207 kernel: [65701.636961] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 23:38:47 juju-e4d256-prod-github-runner-207 kernel: [65701.637952] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 23:38:47 juju-e4d256-prod-github-runner-207 kernel: [65701.638904] Aug 22 23:39:14 juju-e4d256-prod-github-runner-207 kernel: [65728.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 61106s! [qemu-system-x86:6715] Aug 22 23:39:14 juju-e4d256-prod-github-runner-207 kernel: [65728.543145] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 23:39:14 juju-e4d256-prod-github-runner-207 kernel: [65728.543221] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 23:39:14 juju-e4d256-prod-github-runner-207 kernel: [65728.555595] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 23:39:14 juju-e4d256-prod-github-runner-207 kernel: [65728.556879] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 23:39:14 juju-e4d256-prod-github-runner-207 kernel: [65728.558117] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:39:14 juju-e4d256-prod-github-runner-207 kernel: [65728.559193] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 23:39:14 juju-e4d256-prod-github-runner-207 kernel: [65728.561777] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 23:39:14 juju-e4d256-prod-github-runner-207 kernel: [65728.562837] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 23:39:14 juju-e4d256-prod-github-runner-207 kernel: [65728.564016] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 23:39:14 juju-e4d256-prod-github-runner-207 kernel: [65728.565187] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 23:39:14 juju-e4d256-prod-github-runner-207 kernel: [65728.566365] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 23:39:14 juju-e4d256-prod-github-runner-207 kernel: [65728.567542] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 23:39:14 juju-e4d256-prod-github-runner-207 kernel: [65728.568740] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 23:39:14 juju-e4d256-prod-github-runner-207 kernel: [65728.569989] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 23:39:14 juju-e4d256-prod-github-runner-207 kernel: [65728.571115] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 23:39:14 juju-e4d256-prod-github-runner-207 kernel: [65728.572323] Call Trace: Aug 22 23:39:14 juju-e4d256-prod-github-runner-207 kernel: [65728.573241] Aug 22 23:39:14 juju-e4d256-prod-github-runner-207 kernel: [65728.574137] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:39:14 juju-e4d256-prod-github-runner-207 kernel: [65728.575215] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:39:14 juju-e4d256-prod-github-runner-207 kernel: [65728.576245] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:39:14 juju-e4d256-prod-github-runner-207 kernel: [65728.577352] ? show_regs.part.0+0x23/0x29 Aug 22 23:39:14 juju-e4d256-prod-github-runner-207 kernel: [65728.578360] ? show_regs.cold+0x8/0xd Aug 22 23:39:14 juju-e4d256-prod-github-runner-207 kernel: [65728.579349] ? watchdog_timer_fn+0x1be/0x220 Aug 22 23:39:14 juju-e4d256-prod-github-runner-207 kernel: [65728.580365] ? lockup_detector_update_enable+0x60/0x60 Aug 22 23:39:14 juju-e4d256-prod-github-runner-207 kernel: [65728.581438] ? __hrtimer_run_queues+0x107/0x230 Aug 22 23:39:14 juju-e4d256-prod-github-runner-207 kernel: [65728.582480] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 23:39:14 juju-e4d256-prod-github-runner-207 kernel: [65728.583516] ? hrtimer_interrupt+0x101/0x220 Aug 22 23:39:14 juju-e4d256-prod-github-runner-207 kernel: [65728.584539] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 23:39:14 juju-e4d256-prod-github-runner-207 kernel: [65728.585614] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 23:39:14 juju-e4d256-prod-github-runner-207 kernel: [65728.586676] Aug 22 23:39:14 juju-e4d256-prod-github-runner-207 kernel: [65728.587533] Aug 22 23:39:14 juju-e4d256-prod-github-runner-207 kernel: [65728.588374] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 23:39:14 juju-e4d256-prod-github-runner-207 kernel: [65728.589428] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:39:14 juju-e4d256-prod-github-runner-207 kernel: [65728.590495] ? _raw_spin_lock+0x22/0x30 Aug 22 23:39:14 juju-e4d256-prod-github-runner-207 kernel: [65728.591462] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:39:14 juju-e4d256-prod-github-runner-207 kernel: [65728.592493] direct_page_fault+0x206/0x310 [kvm] Aug 22 23:39:14 juju-e4d256-prod-github-runner-207 kernel: [65728.593533] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 23:39:14 juju-e4d256-prod-github-runner-207 kernel: [65728.594564] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 23:39:14 juju-e4d256-prod-github-runner-207 kernel: [65728.595576] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 23:39:14 juju-e4d256-prod-github-runner-207 kernel: [65728.596557] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 23:39:14 juju-e4d256-prod-github-runner-207 kernel: [65728.597512] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 23:39:14 juju-e4d256-prod-github-runner-207 kernel: [65728.598510] handle_exit+0x98/0x230 [kvm_amd] Aug 22 23:39:14 juju-e4d256-prod-github-runner-207 kernel: [65728.599416] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 23:39:14 juju-e4d256-prod-github-runner-207 kernel: [65728.600337] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 23:39:14 juju-e4d256-prod-github-runner-207 kernel: [65728.601267] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 23:39:14 juju-e4d256-prod-github-runner-207 kernel: [65728.602629] vcpu_run+0x62/0x2c0 [kvm] Aug 22 23:39:14 juju-e4d256-prod-github-runner-207 kernel: [65728.603449] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 23:39:14 juju-e4d256-prod-github-runner-207 kernel: [65728.604263] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 23:39:14 juju-e4d256-prod-github-runner-207 kernel: [65728.605128] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 23:39:14 juju-e4d256-prod-github-runner-207 kernel: [65728.605938] ? __seccomp_filter+0x4a/0x4a0 Aug 22 23:39:14 juju-e4d256-prod-github-runner-207 kernel: [65728.606704] ? __fget_files+0x86/0xc0 Aug 22 23:39:14 juju-e4d256-prod-github-runner-207 kernel: [65728.607416] __x64_sys_ioctl+0x95/0xd0 Aug 22 23:39:14 juju-e4d256-prod-github-runner-207 kernel: [65728.608117] do_syscall_64+0x5c/0xc0 Aug 22 23:39:14 juju-e4d256-prod-github-runner-207 kernel: [65728.608792] ? do_futex+0x162/0x1f0 Aug 22 23:39:14 juju-e4d256-prod-github-runner-207 kernel: [65728.609447] ? __x64_sys_futex+0x78/0x1e0 Aug 22 23:39:14 juju-e4d256-prod-github-runner-207 kernel: [65728.610133] ? __secure_computing+0xa9/0x120 Aug 22 23:39:14 juju-e4d256-prod-github-runner-207 kernel: [65728.610857] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 23:39:14 juju-e4d256-prod-github-runner-207 kernel: [65728.611637] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:39:14 juju-e4d256-prod-github-runner-207 kernel: [65728.612367] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:39:14 juju-e4d256-prod-github-runner-207 kernel: [65728.613094] ? do_syscall_64+0x69/0xc0 Aug 22 23:39:14 juju-e4d256-prod-github-runner-207 kernel: [65728.613751] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:39:14 juju-e4d256-prod-github-runner-207 kernel: [65728.614475] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:39:14 juju-e4d256-prod-github-runner-207 kernel: [65728.615184] ? do_syscall_64+0x69/0xc0 Aug 22 23:39:14 juju-e4d256-prod-github-runner-207 kernel: [65728.615815] ? do_syscall_64+0x69/0xc0 Aug 22 23:39:14 juju-e4d256-prod-github-runner-207 kernel: [65728.616445] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 23:39:14 juju-e4d256-prod-github-runner-207 kernel: [65728.617159] RIP: 0033:0x7faa5d0edaff Aug 22 23:39:14 juju-e4d256-prod-github-runner-207 kernel: [65728.617795] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 23:39:14 juju-e4d256-prod-github-runner-207 kernel: [65728.619898] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 23:39:14 juju-e4d256-prod-github-runner-207 kernel: [65728.620980] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 23:39:14 juju-e4d256-prod-github-runner-207 kernel: [65728.621888] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 23:39:14 juju-e4d256-prod-github-runner-207 kernel: [65728.622839] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 23:39:14 juju-e4d256-prod-github-runner-207 kernel: [65728.623741] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 23:39:14 juju-e4d256-prod-github-runner-207 kernel: [65728.624672] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 23:39:14 juju-e4d256-prod-github-runner-207 kernel: [65728.625584] Aug 22 23:39:42 juju-e4d256-prod-github-runner-207 kernel: [65756.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 61132s! [qemu-system-x86:6715] Aug 22 23:39:42 juju-e4d256-prod-github-runner-207 kernel: [65756.543903] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 23:39:42 juju-e4d256-prod-github-runner-207 kernel: [65756.544218] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 23:39:42 juju-e4d256-prod-github-runner-207 kernel: [65756.556577] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 23:39:42 juju-e4d256-prod-github-runner-207 kernel: [65756.557862] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 23:39:42 juju-e4d256-prod-github-runner-207 kernel: [65756.559154] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:39:42 juju-e4d256-prod-github-runner-207 kernel: [65756.560227] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 23:39:42 juju-e4d256-prod-github-runner-207 kernel: [65756.562854] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 23:39:42 juju-e4d256-prod-github-runner-207 kernel: [65756.563917] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 23:39:42 juju-e4d256-prod-github-runner-207 kernel: [65756.565102] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 23:39:42 juju-e4d256-prod-github-runner-207 kernel: [65756.566296] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 23:39:42 juju-e4d256-prod-github-runner-207 kernel: [65756.567475] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 23:39:42 juju-e4d256-prod-github-runner-207 kernel: [65756.568658] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 23:39:42 juju-e4d256-prod-github-runner-207 kernel: [65756.569851] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 23:39:42 juju-e4d256-prod-github-runner-207 kernel: [65756.571122] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 23:39:42 juju-e4d256-prod-github-runner-207 kernel: [65756.572250] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 23:39:42 juju-e4d256-prod-github-runner-207 kernel: [65756.573468] Call Trace: Aug 22 23:39:42 juju-e4d256-prod-github-runner-207 kernel: [65756.574399] Aug 22 23:39:42 juju-e4d256-prod-github-runner-207 kernel: [65756.575312] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:39:42 juju-e4d256-prod-github-runner-207 kernel: [65756.576371] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:39:42 juju-e4d256-prod-github-runner-207 kernel: [65756.577402] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:39:42 juju-e4d256-prod-github-runner-207 kernel: [65756.578519] ? show_regs.part.0+0x23/0x29 Aug 22 23:39:42 juju-e4d256-prod-github-runner-207 kernel: [65756.579528] ? show_regs.cold+0x8/0xd Aug 22 23:39:42 juju-e4d256-prod-github-runner-207 kernel: [65756.580518] ? watchdog_timer_fn+0x1be/0x220 Aug 22 23:39:42 juju-e4d256-prod-github-runner-207 kernel: [65756.581540] ? lockup_detector_update_enable+0x60/0x60 Aug 22 23:39:42 juju-e4d256-prod-github-runner-207 kernel: [65756.582631] ? __hrtimer_run_queues+0x107/0x230 Aug 22 23:39:42 juju-e4d256-prod-github-runner-207 kernel: [65756.583689] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 23:39:42 juju-e4d256-prod-github-runner-207 kernel: [65756.584744] ? hrtimer_interrupt+0x101/0x220 Aug 22 23:39:42 juju-e4d256-prod-github-runner-207 kernel: [65756.585777] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 23:39:42 juju-e4d256-prod-github-runner-207 kernel: [65756.586874] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 23:39:42 juju-e4d256-prod-github-runner-207 kernel: [65756.587980] Aug 22 23:39:42 juju-e4d256-prod-github-runner-207 kernel: [65756.588843] Aug 22 23:39:42 juju-e4d256-prod-github-runner-207 kernel: [65756.589690] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 23:39:42 juju-e4d256-prod-github-runner-207 kernel: [65756.590748] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:39:42 juju-e4d256-prod-github-runner-207 kernel: [65756.591797] ? _raw_spin_lock+0x22/0x30 Aug 22 23:39:42 juju-e4d256-prod-github-runner-207 kernel: [65756.592750] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:39:42 juju-e4d256-prod-github-runner-207 kernel: [65756.593792] direct_page_fault+0x206/0x310 [kvm] Aug 22 23:39:42 juju-e4d256-prod-github-runner-207 kernel: [65756.594843] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 23:39:42 juju-e4d256-prod-github-runner-207 kernel: [65756.595882] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 23:39:42 juju-e4d256-prod-github-runner-207 kernel: [65756.596905] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 23:39:42 juju-e4d256-prod-github-runner-207 kernel: [65756.597915] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 23:39:42 juju-e4d256-prod-github-runner-207 kernel: [65756.598890] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 23:39:42 juju-e4d256-prod-github-runner-207 kernel: [65756.599885] handle_exit+0x98/0x230 [kvm_amd] Aug 22 23:39:42 juju-e4d256-prod-github-runner-207 kernel: [65756.600792] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 23:39:42 juju-e4d256-prod-github-runner-207 kernel: [65756.601718] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 23:39:42 juju-e4d256-prod-github-runner-207 kernel: [65756.602667] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 23:39:42 juju-e4d256-prod-github-runner-207 kernel: [65756.603588] vcpu_run+0x62/0x2c0 [kvm] Aug 22 23:39:42 juju-e4d256-prod-github-runner-207 kernel: [65756.604419] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 23:39:42 juju-e4d256-prod-github-runner-207 kernel: [65756.605260] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 23:39:42 juju-e4d256-prod-github-runner-207 kernel: [65756.606153] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 23:39:42 juju-e4d256-prod-github-runner-207 kernel: [65756.606967] ? __seccomp_filter+0x4a/0x4a0 Aug 22 23:39:42 juju-e4d256-prod-github-runner-207 kernel: [65756.607720] ? __fget_files+0x86/0xc0 Aug 22 23:39:42 juju-e4d256-prod-github-runner-207 kernel: [65756.608438] __x64_sys_ioctl+0x95/0xd0 Aug 22 23:39:42 juju-e4d256-prod-github-runner-207 kernel: [65756.609142] do_syscall_64+0x5c/0xc0 Aug 22 23:39:42 juju-e4d256-prod-github-runner-207 kernel: [65756.609816] ? do_futex+0x162/0x1f0 Aug 22 23:39:42 juju-e4d256-prod-github-runner-207 kernel: [65756.610481] ? __x64_sys_futex+0x78/0x1e0 Aug 22 23:39:42 juju-e4d256-prod-github-runner-207 kernel: [65756.611166] ? __secure_computing+0xa9/0x120 Aug 22 23:39:42 juju-e4d256-prod-github-runner-207 kernel: [65756.611867] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 23:39:42 juju-e4d256-prod-github-runner-207 kernel: [65756.612638] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:39:42 juju-e4d256-prod-github-runner-207 kernel: [65756.613373] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:39:42 juju-e4d256-prod-github-runner-207 kernel: [65756.614111] ? do_syscall_64+0x69/0xc0 Aug 22 23:39:42 juju-e4d256-prod-github-runner-207 kernel: [65756.614766] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:39:42 juju-e4d256-prod-github-runner-207 kernel: [65756.615486] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:39:42 juju-e4d256-prod-github-runner-207 kernel: [65756.616194] ? do_syscall_64+0x69/0xc0 Aug 22 23:39:42 juju-e4d256-prod-github-runner-207 kernel: [65756.616829] ? do_syscall_64+0x69/0xc0 Aug 22 23:39:42 juju-e4d256-prod-github-runner-207 kernel: [65756.617462] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 23:39:42 juju-e4d256-prod-github-runner-207 kernel: [65756.618190] RIP: 0033:0x7faa5d0edaff Aug 22 23:39:42 juju-e4d256-prod-github-runner-207 kernel: [65756.618840] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 23:39:42 juju-e4d256-prod-github-runner-207 kernel: [65756.620913] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 23:39:42 juju-e4d256-prod-github-runner-207 kernel: [65756.621843] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 23:39:42 juju-e4d256-prod-github-runner-207 kernel: [65756.622760] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 23:39:42 juju-e4d256-prod-github-runner-207 kernel: [65756.623674] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 23:39:42 juju-e4d256-prod-github-runner-207 kernel: [65756.624579] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 23:39:42 juju-e4d256-prod-github-runner-207 kernel: [65756.625489] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 23:39:42 juju-e4d256-prod-github-runner-207 kernel: [65756.626413] Aug 22 23:40:10 juju-e4d256-prod-github-runner-207 kernel: [65784.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 61158s! [qemu-system-x86:6715] Aug 22 23:40:10 juju-e4d256-prod-github-runner-207 kernel: [65784.543127] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 23:40:10 juju-e4d256-prod-github-runner-207 kernel: [65784.543202] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 23:40:10 juju-e4d256-prod-github-runner-207 kernel: [65784.555518] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 23:40:10 juju-e4d256-prod-github-runner-207 kernel: [65784.556805] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 23:40:10 juju-e4d256-prod-github-runner-207 kernel: [65784.558060] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:40:10 juju-e4d256-prod-github-runner-207 kernel: [65784.559129] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 23:40:10 juju-e4d256-prod-github-runner-207 kernel: [65784.561754] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 23:40:10 juju-e4d256-prod-github-runner-207 kernel: [65784.562825] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 23:40:10 juju-e4d256-prod-github-runner-207 kernel: [65784.564000] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 23:40:10 juju-e4d256-prod-github-runner-207 kernel: [65784.565179] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 23:40:10 juju-e4d256-prod-github-runner-207 kernel: [65784.566406] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 23:40:10 juju-e4d256-prod-github-runner-207 kernel: [65784.567584] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 23:40:10 juju-e4d256-prod-github-runner-207 kernel: [65784.568767] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 23:40:10 juju-e4d256-prod-github-runner-207 kernel: [65784.570054] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 23:40:10 juju-e4d256-prod-github-runner-207 kernel: [65784.571205] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 23:40:10 juju-e4d256-prod-github-runner-207 kernel: [65784.572418] Call Trace: Aug 22 23:40:10 juju-e4d256-prod-github-runner-207 kernel: [65784.573335] Aug 22 23:40:10 juju-e4d256-prod-github-runner-207 kernel: [65784.574269] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:40:10 juju-e4d256-prod-github-runner-207 kernel: [65784.575335] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:40:10 juju-e4d256-prod-github-runner-207 kernel: [65784.576450] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:40:10 juju-e4d256-prod-github-runner-207 kernel: [65784.577539] ? show_regs.part.0+0x23/0x29 Aug 22 23:40:10 juju-e4d256-prod-github-runner-207 kernel: [65784.578665] ? show_regs.cold+0x8/0xd Aug 22 23:40:10 juju-e4d256-prod-github-runner-207 kernel: [65784.579674] ? watchdog_timer_fn+0x1be/0x220 Aug 22 23:40:10 juju-e4d256-prod-github-runner-207 kernel: [65784.580710] ? lockup_detector_update_enable+0x60/0x60 Aug 22 23:40:10 juju-e4d256-prod-github-runner-207 kernel: [65784.581819] ? __hrtimer_run_queues+0x107/0x230 Aug 22 23:40:10 juju-e4d256-prod-github-runner-207 kernel: [65784.582861] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 23:40:10 juju-e4d256-prod-github-runner-207 kernel: [65784.583899] ? hrtimer_interrupt+0x101/0x220 Aug 22 23:40:10 juju-e4d256-prod-github-runner-207 kernel: [65784.584934] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 23:40:10 juju-e4d256-prod-github-runner-207 kernel: [65784.586058] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 23:40:10 juju-e4d256-prod-github-runner-207 kernel: [65784.587125] Aug 22 23:40:10 juju-e4d256-prod-github-runner-207 kernel: [65784.587986] Aug 22 23:40:10 juju-e4d256-prod-github-runner-207 kernel: [65784.588832] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 23:40:10 juju-e4d256-prod-github-runner-207 kernel: [65784.590039] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:40:10 juju-e4d256-prod-github-runner-207 kernel: [65784.591577] ? _raw_spin_lock+0x22/0x30 Aug 22 23:40:10 juju-e4d256-prod-github-runner-207 kernel: [65784.592968] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:40:10 juju-e4d256-prod-github-runner-207 kernel: [65784.594232] direct_page_fault+0x206/0x310 [kvm] Aug 22 23:40:10 juju-e4d256-prod-github-runner-207 kernel: [65784.595297] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 23:40:10 juju-e4d256-prod-github-runner-207 kernel: [65784.596326] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 23:40:10 juju-e4d256-prod-github-runner-207 kernel: [65784.597349] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 23:40:10 juju-e4d256-prod-github-runner-207 kernel: [65784.598395] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 23:40:10 juju-e4d256-prod-github-runner-207 kernel: [65784.599388] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 23:40:10 juju-e4d256-prod-github-runner-207 kernel: [65784.600391] handle_exit+0x98/0x230 [kvm_amd] Aug 22 23:40:10 juju-e4d256-prod-github-runner-207 kernel: [65784.601300] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 23:40:10 juju-e4d256-prod-github-runner-207 kernel: [65784.602256] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 23:40:10 juju-e4d256-prod-github-runner-207 kernel: [65784.603208] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 23:40:10 juju-e4d256-prod-github-runner-207 kernel: [65784.604138] vcpu_run+0x62/0x2c0 [kvm] Aug 22 23:40:10 juju-e4d256-prod-github-runner-207 kernel: [65784.604974] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 23:40:10 juju-e4d256-prod-github-runner-207 kernel: [65784.605844] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 23:40:10 juju-e4d256-prod-github-runner-207 kernel: [65784.606779] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 23:40:10 juju-e4d256-prod-github-runner-207 kernel: [65784.607602] ? __seccomp_filter+0x4a/0x4a0 Aug 22 23:40:10 juju-e4d256-prod-github-runner-207 kernel: [65784.608364] ? __fget_files+0x86/0xc0 Aug 22 23:40:10 juju-e4d256-prod-github-runner-207 kernel: [65784.609083] __x64_sys_ioctl+0x95/0xd0 Aug 22 23:40:10 juju-e4d256-prod-github-runner-207 kernel: [65784.609808] do_syscall_64+0x5c/0xc0 Aug 22 23:40:10 juju-e4d256-prod-github-runner-207 kernel: [65784.610495] ? do_futex+0x162/0x1f0 Aug 22 23:40:10 juju-e4d256-prod-github-runner-207 kernel: [65784.611157] ? __x64_sys_futex+0x78/0x1e0 Aug 22 23:40:10 juju-e4d256-prod-github-runner-207 kernel: [65784.611847] ? __secure_computing+0xa9/0x120 Aug 22 23:40:10 juju-e4d256-prod-github-runner-207 kernel: [65784.612556] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 23:40:10 juju-e4d256-prod-github-runner-207 kernel: [65784.613340] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:40:10 juju-e4d256-prod-github-runner-207 kernel: [65784.614119] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:40:10 juju-e4d256-prod-github-runner-207 kernel: [65784.614866] ? do_syscall_64+0x69/0xc0 Aug 22 23:40:10 juju-e4d256-prod-github-runner-207 kernel: [65784.615524] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:40:10 juju-e4d256-prod-github-runner-207 kernel: [65784.616241] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:40:10 juju-e4d256-prod-github-runner-207 kernel: [65784.616981] ? do_syscall_64+0x69/0xc0 Aug 22 23:40:10 juju-e4d256-prod-github-runner-207 kernel: [65784.617624] ? do_syscall_64+0x69/0xc0 Aug 22 23:40:10 juju-e4d256-prod-github-runner-207 kernel: [65784.618272] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 23:40:10 juju-e4d256-prod-github-runner-207 kernel: [65784.618990] RIP: 0033:0x7faa5d0edaff Aug 22 23:40:10 juju-e4d256-prod-github-runner-207 kernel: [65784.619628] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 23:40:10 juju-e4d256-prod-github-runner-207 kernel: [65784.621741] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 23:40:10 juju-e4d256-prod-github-runner-207 kernel: [65784.622680] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 23:40:10 juju-e4d256-prod-github-runner-207 kernel: [65784.623589] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 23:40:10 juju-e4d256-prod-github-runner-207 kernel: [65784.624503] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 23:40:10 juju-e4d256-prod-github-runner-207 kernel: [65784.625415] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 23:40:10 juju-e4d256-prod-github-runner-207 kernel: [65784.626344] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 23:40:10 juju-e4d256-prod-github-runner-207 kernel: [65784.627302] Aug 22 23:40:38 juju-e4d256-prod-github-runner-207 kernel: [65812.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 61184s! [qemu-system-x86:6715] Aug 22 23:40:38 juju-e4d256-prod-github-runner-207 kernel: [65812.543095] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 23:40:38 juju-e4d256-prod-github-runner-207 kernel: [65812.543170] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 23:40:38 juju-e4d256-prod-github-runner-207 kernel: [65812.555316] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 23:40:38 juju-e4d256-prod-github-runner-207 kernel: [65812.556581] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 23:40:38 juju-e4d256-prod-github-runner-207 kernel: [65812.557851] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:40:38 juju-e4d256-prod-github-runner-207 kernel: [65812.558944] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 23:40:38 juju-e4d256-prod-github-runner-207 kernel: [65812.561518] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 23:40:38 juju-e4d256-prod-github-runner-207 kernel: [65812.562590] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 23:40:38 juju-e4d256-prod-github-runner-207 kernel: [65812.563794] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 23:40:38 juju-e4d256-prod-github-runner-207 kernel: [65812.564971] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 23:40:38 juju-e4d256-prod-github-runner-207 kernel: [65812.566171] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 23:40:38 juju-e4d256-prod-github-runner-207 kernel: [65812.567336] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 23:40:38 juju-e4d256-prod-github-runner-207 kernel: [65812.568515] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 23:40:38 juju-e4d256-prod-github-runner-207 kernel: [65812.569756] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 23:40:38 juju-e4d256-prod-github-runner-207 kernel: [65812.570848] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 23:40:38 juju-e4d256-prod-github-runner-207 kernel: [65812.572036] Call Trace: Aug 22 23:40:38 juju-e4d256-prod-github-runner-207 kernel: [65812.572944] Aug 22 23:40:38 juju-e4d256-prod-github-runner-207 kernel: [65812.573861] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:40:38 juju-e4d256-prod-github-runner-207 kernel: [65812.574901] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:40:38 juju-e4d256-prod-github-runner-207 kernel: [65812.575945] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:40:38 juju-e4d256-prod-github-runner-207 kernel: [65812.577017] ? show_regs.part.0+0x23/0x29 Aug 22 23:40:38 juju-e4d256-prod-github-runner-207 kernel: [65812.578030] ? show_regs.cold+0x8/0xd Aug 22 23:40:38 juju-e4d256-prod-github-runner-207 kernel: [65812.579001] ? watchdog_timer_fn+0x1be/0x220 Aug 22 23:40:38 juju-e4d256-prod-github-runner-207 kernel: [65812.580008] ? lockup_detector_update_enable+0x60/0x60 Aug 22 23:40:38 juju-e4d256-prod-github-runner-207 kernel: [65812.581088] ? __hrtimer_run_queues+0x107/0x230 Aug 22 23:40:38 juju-e4d256-prod-github-runner-207 kernel: [65812.582128] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 23:40:38 juju-e4d256-prod-github-runner-207 kernel: [65812.583258] ? hrtimer_interrupt+0x101/0x220 Aug 22 23:40:38 juju-e4d256-prod-github-runner-207 kernel: [65812.584271] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 23:40:38 juju-e4d256-prod-github-runner-207 kernel: [65812.585339] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 23:40:38 juju-e4d256-prod-github-runner-207 kernel: [65812.586395] Aug 22 23:40:38 juju-e4d256-prod-github-runner-207 kernel: [65812.587363] Aug 22 23:40:38 juju-e4d256-prod-github-runner-207 kernel: [65812.588197] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 23:40:38 juju-e4d256-prod-github-runner-207 kernel: [65812.589230] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:40:38 juju-e4d256-prod-github-runner-207 kernel: [65812.590274] ? _raw_spin_lock+0x22/0x30 Aug 22 23:40:38 juju-e4d256-prod-github-runner-207 kernel: [65812.591214] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:40:38 juju-e4d256-prod-github-runner-207 kernel: [65812.592238] direct_page_fault+0x206/0x310 [kvm] Aug 22 23:40:38 juju-e4d256-prod-github-runner-207 kernel: [65812.593262] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 23:40:38 juju-e4d256-prod-github-runner-207 kernel: [65812.594329] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 23:40:38 juju-e4d256-prod-github-runner-207 kernel: [65812.595433] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 23:40:38 juju-e4d256-prod-github-runner-207 kernel: [65812.596438] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 23:40:38 juju-e4d256-prod-github-runner-207 kernel: [65812.597414] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 23:40:38 juju-e4d256-prod-github-runner-207 kernel: [65812.598395] handle_exit+0x98/0x230 [kvm_amd] Aug 22 23:40:38 juju-e4d256-prod-github-runner-207 kernel: [65812.599288] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 23:40:38 juju-e4d256-prod-github-runner-207 kernel: [65812.600204] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 23:40:38 juju-e4d256-prod-github-runner-207 kernel: [65812.601153] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 23:40:38 juju-e4d256-prod-github-runner-207 kernel: [65812.602066] vcpu_run+0x62/0x2c0 [kvm] Aug 22 23:40:38 juju-e4d256-prod-github-runner-207 kernel: [65812.602903] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 23:40:38 juju-e4d256-prod-github-runner-207 kernel: [65812.603727] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 23:40:38 juju-e4d256-prod-github-runner-207 kernel: [65812.604594] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 23:40:38 juju-e4d256-prod-github-runner-207 kernel: [65812.605450] ? __seccomp_filter+0x4a/0x4a0 Aug 22 23:40:38 juju-e4d256-prod-github-runner-207 kernel: [65812.606195] ? __fget_files+0x86/0xc0 Aug 22 23:40:38 juju-e4d256-prod-github-runner-207 kernel: [65812.606906] __x64_sys_ioctl+0x95/0xd0 Aug 22 23:40:38 juju-e4d256-prod-github-runner-207 kernel: [65812.607599] do_syscall_64+0x5c/0xc0 Aug 22 23:40:38 juju-e4d256-prod-github-runner-207 kernel: [65812.608265] ? do_futex+0x162/0x1f0 Aug 22 23:40:38 juju-e4d256-prod-github-runner-207 kernel: [65812.608912] ? __x64_sys_futex+0x78/0x1e0 Aug 22 23:40:38 juju-e4d256-prod-github-runner-207 kernel: [65812.609599] ? __secure_computing+0xa9/0x120 Aug 22 23:40:38 juju-e4d256-prod-github-runner-207 kernel: [65812.610311] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 23:40:38 juju-e4d256-prod-github-runner-207 kernel: [65812.611083] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:40:38 juju-e4d256-prod-github-runner-207 kernel: [65812.611804] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:40:38 juju-e4d256-prod-github-runner-207 kernel: [65812.612558] ? do_syscall_64+0x69/0xc0 Aug 22 23:40:38 juju-e4d256-prod-github-runner-207 kernel: [65812.613204] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:40:38 juju-e4d256-prod-github-runner-207 kernel: [65812.613917] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:40:38 juju-e4d256-prod-github-runner-207 kernel: [65812.614637] ? do_syscall_64+0x69/0xc0 Aug 22 23:40:38 juju-e4d256-prod-github-runner-207 kernel: [65812.615261] ? do_syscall_64+0x69/0xc0 Aug 22 23:40:38 juju-e4d256-prod-github-runner-207 kernel: [65812.615887] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 23:40:38 juju-e4d256-prod-github-runner-207 kernel: [65812.616591] RIP: 0033:0x7faa5d0edaff Aug 22 23:40:38 juju-e4d256-prod-github-runner-207 kernel: [65812.617215] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 23:40:38 juju-e4d256-prod-github-runner-207 kernel: [65812.619208] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 23:40:38 juju-e4d256-prod-github-runner-207 kernel: [65812.620121] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 23:40:38 juju-e4d256-prod-github-runner-207 kernel: [65812.621011] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 23:40:38 juju-e4d256-prod-github-runner-207 kernel: [65812.621942] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 23:40:38 juju-e4d256-prod-github-runner-207 kernel: [65812.622828] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 23:40:38 juju-e4d256-prod-github-runner-207 kernel: [65812.623715] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 23:40:38 juju-e4d256-prod-github-runner-207 kernel: [65812.624625] Aug 22 23:41:06 juju-e4d256-prod-github-runner-207 kernel: [65840.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 61210s! [qemu-system-x86:6715] Aug 22 23:41:06 juju-e4d256-prod-github-runner-207 kernel: [65840.543115] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 23:41:06 juju-e4d256-prod-github-runner-207 kernel: [65840.543188] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 23:41:06 juju-e4d256-prod-github-runner-207 kernel: [65840.555537] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 23:41:06 juju-e4d256-prod-github-runner-207 kernel: [65840.556859] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 23:41:06 juju-e4d256-prod-github-runner-207 kernel: [65840.558112] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:41:06 juju-e4d256-prod-github-runner-207 kernel: [65840.559224] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 23:41:06 juju-e4d256-prod-github-runner-207 kernel: [65840.561859] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 23:41:06 juju-e4d256-prod-github-runner-207 kernel: [65840.562914] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 23:41:06 juju-e4d256-prod-github-runner-207 kernel: [65840.564137] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 23:41:06 juju-e4d256-prod-github-runner-207 kernel: [65840.565442] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 23:41:06 juju-e4d256-prod-github-runner-207 kernel: [65840.566663] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 23:41:06 juju-e4d256-prod-github-runner-207 kernel: [65840.567930] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 23:41:06 juju-e4d256-prod-github-runner-207 kernel: [65840.569141] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 23:41:06 juju-e4d256-prod-github-runner-207 kernel: [65840.570398] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 23:41:06 juju-e4d256-prod-github-runner-207 kernel: [65840.571510] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 23:41:06 juju-e4d256-prod-github-runner-207 kernel: [65840.572712] Call Trace: Aug 22 23:41:06 juju-e4d256-prod-github-runner-207 kernel: [65840.573642] Aug 22 23:41:06 juju-e4d256-prod-github-runner-207 kernel: [65840.574765] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:41:06 juju-e4d256-prod-github-runner-207 kernel: [65840.575846] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:41:06 juju-e4d256-prod-github-runner-207 kernel: [65840.577228] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:41:06 juju-e4d256-prod-github-runner-207 kernel: [65840.578454] ? show_regs.part.0+0x23/0x29 Aug 22 23:41:06 juju-e4d256-prod-github-runner-207 kernel: [65840.579727] ? show_regs.cold+0x8/0xd Aug 22 23:41:06 juju-e4d256-prod-github-runner-207 kernel: [65840.580787] ? watchdog_timer_fn+0x1be/0x220 Aug 22 23:41:06 juju-e4d256-prod-github-runner-207 kernel: [65840.581840] ? lockup_detector_update_enable+0x60/0x60 Aug 22 23:41:06 juju-e4d256-prod-github-runner-207 kernel: [65840.582925] ? __hrtimer_run_queues+0x107/0x230 Aug 22 23:41:06 juju-e4d256-prod-github-runner-207 kernel: [65840.584015] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 23:41:06 juju-e4d256-prod-github-runner-207 kernel: [65840.585082] ? hrtimer_interrupt+0x101/0x220 Aug 22 23:41:06 juju-e4d256-prod-github-runner-207 kernel: [65840.586162] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 23:41:06 juju-e4d256-prod-github-runner-207 kernel: [65840.587267] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 23:41:06 juju-e4d256-prod-github-runner-207 kernel: [65840.588349] Aug 22 23:41:06 juju-e4d256-prod-github-runner-207 kernel: [65840.589218] Aug 22 23:41:06 juju-e4d256-prod-github-runner-207 kernel: [65840.590064] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 23:41:06 juju-e4d256-prod-github-runner-207 kernel: [65840.591115] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:41:06 juju-e4d256-prod-github-runner-207 kernel: [65840.592170] ? _raw_spin_lock+0x22/0x30 Aug 22 23:41:06 juju-e4d256-prod-github-runner-207 kernel: [65840.593158] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:41:06 juju-e4d256-prod-github-runner-207 kernel: [65840.594203] direct_page_fault+0x206/0x310 [kvm] Aug 22 23:41:06 juju-e4d256-prod-github-runner-207 kernel: [65840.595240] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 23:41:06 juju-e4d256-prod-github-runner-207 kernel: [65840.596263] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 23:41:06 juju-e4d256-prod-github-runner-207 kernel: [65840.597292] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 23:41:06 juju-e4d256-prod-github-runner-207 kernel: [65840.598297] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 23:41:06 juju-e4d256-prod-github-runner-207 kernel: [65840.599267] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 23:41:06 juju-e4d256-prod-github-runner-207 kernel: [65840.600274] handle_exit+0x98/0x230 [kvm_amd] Aug 22 23:41:06 juju-e4d256-prod-github-runner-207 kernel: [65840.601203] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 23:41:06 juju-e4d256-prod-github-runner-207 kernel: [65840.602132] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 23:41:06 juju-e4d256-prod-github-runner-207 kernel: [65840.603071] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 23:41:06 juju-e4d256-prod-github-runner-207 kernel: [65840.603996] vcpu_run+0x62/0x2c0 [kvm] Aug 22 23:41:06 juju-e4d256-prod-github-runner-207 kernel: [65840.604822] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 23:41:06 juju-e4d256-prod-github-runner-207 kernel: [65840.605653] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 23:41:06 juju-e4d256-prod-github-runner-207 kernel: [65840.606525] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 23:41:06 juju-e4d256-prod-github-runner-207 kernel: [65840.607337] ? __seccomp_filter+0x4a/0x4a0 Aug 22 23:41:06 juju-e4d256-prod-github-runner-207 kernel: [65840.608100] ? __fget_files+0x86/0xc0 Aug 22 23:41:06 juju-e4d256-prod-github-runner-207 kernel: [65840.608824] __x64_sys_ioctl+0x95/0xd0 Aug 22 23:41:06 juju-e4d256-prod-github-runner-207 kernel: [65840.609536] do_syscall_64+0x5c/0xc0 Aug 22 23:41:06 juju-e4d256-prod-github-runner-207 kernel: [65840.610224] ? do_futex+0x162/0x1f0 Aug 22 23:41:06 juju-e4d256-prod-github-runner-207 kernel: [65840.610886] ? __x64_sys_futex+0x78/0x1e0 Aug 22 23:41:06 juju-e4d256-prod-github-runner-207 kernel: [65840.611570] ? __secure_computing+0xa9/0x120 Aug 22 23:41:06 juju-e4d256-prod-github-runner-207 kernel: [65840.612278] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 23:41:06 juju-e4d256-prod-github-runner-207 kernel: [65840.613076] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:41:06 juju-e4d256-prod-github-runner-207 kernel: [65840.613817] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:41:06 juju-e4d256-prod-github-runner-207 kernel: [65840.614545] ? do_syscall_64+0x69/0xc0 Aug 22 23:41:06 juju-e4d256-prod-github-runner-207 kernel: [65840.615202] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:41:06 juju-e4d256-prod-github-runner-207 kernel: [65840.615923] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:41:06 juju-e4d256-prod-github-runner-207 kernel: [65840.616633] ? do_syscall_64+0x69/0xc0 Aug 22 23:41:06 juju-e4d256-prod-github-runner-207 kernel: [65840.617282] ? do_syscall_64+0x69/0xc0 Aug 22 23:41:06 juju-e4d256-prod-github-runner-207 kernel: [65840.617919] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 23:41:06 juju-e4d256-prod-github-runner-207 kernel: [65840.618660] RIP: 0033:0x7faa5d0edaff Aug 22 23:41:06 juju-e4d256-prod-github-runner-207 kernel: [65840.619319] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 23:41:06 juju-e4d256-prod-github-runner-207 kernel: [65840.621369] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 23:41:06 juju-e4d256-prod-github-runner-207 kernel: [65840.622299] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 23:41:06 juju-e4d256-prod-github-runner-207 kernel: [65840.623366] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 23:41:06 juju-e4d256-prod-github-runner-207 kernel: [65840.624520] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 23:41:06 juju-e4d256-prod-github-runner-207 kernel: [65840.625784] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 23:41:06 juju-e4d256-prod-github-runner-207 kernel: [65840.626771] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 23:41:06 juju-e4d256-prod-github-runner-207 kernel: [65840.627687] Aug 22 23:41:34 juju-e4d256-prod-github-runner-207 kernel: [65868.541980] watchdog: BUG: soft lockup - CPU#1 stuck for 61236s! [qemu-system-x86:6715] Aug 22 23:41:34 juju-e4d256-prod-github-runner-207 kernel: [65868.543854] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 23:41:34 juju-e4d256-prod-github-runner-207 kernel: [65868.544149] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 23:41:34 juju-e4d256-prod-github-runner-207 kernel: [65868.556341] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 23:41:34 juju-e4d256-prod-github-runner-207 kernel: [65868.557621] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 23:41:34 juju-e4d256-prod-github-runner-207 kernel: [65868.558842] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:41:34 juju-e4d256-prod-github-runner-207 kernel: [65868.559899] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 23:41:34 juju-e4d256-prod-github-runner-207 kernel: [65868.562463] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 23:41:34 juju-e4d256-prod-github-runner-207 kernel: [65868.563504] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 23:41:34 juju-e4d256-prod-github-runner-207 kernel: [65868.564682] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 23:41:34 juju-e4d256-prod-github-runner-207 kernel: [65868.565852] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 23:41:34 juju-e4d256-prod-github-runner-207 kernel: [65868.567155] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 23:41:34 juju-e4d256-prod-github-runner-207 kernel: [65868.568328] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 23:41:34 juju-e4d256-prod-github-runner-207 kernel: [65868.571229] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 23:41:34 juju-e4d256-prod-github-runner-207 kernel: [65868.572629] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 23:41:34 juju-e4d256-prod-github-runner-207 kernel: [65868.573747] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 23:41:34 juju-e4d256-prod-github-runner-207 kernel: [65868.574941] Call Trace: Aug 22 23:41:34 juju-e4d256-prod-github-runner-207 kernel: [65868.575851] Aug 22 23:41:34 juju-e4d256-prod-github-runner-207 kernel: [65868.576769] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:41:34 juju-e4d256-prod-github-runner-207 kernel: [65868.577799] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:41:34 juju-e4d256-prod-github-runner-207 kernel: [65868.578817] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:41:34 juju-e4d256-prod-github-runner-207 kernel: [65868.579911] ? show_regs.part.0+0x23/0x29 Aug 22 23:41:34 juju-e4d256-prod-github-runner-207 kernel: [65868.580915] ? show_regs.cold+0x8/0xd Aug 22 23:41:34 juju-e4d256-prod-github-runner-207 kernel: [65868.581885] ? watchdog_timer_fn+0x1be/0x220 Aug 22 23:41:34 juju-e4d256-prod-github-runner-207 kernel: [65868.582891] ? lockup_detector_update_enable+0x60/0x60 Aug 22 23:41:34 juju-e4d256-prod-github-runner-207 kernel: [65868.583984] ? __hrtimer_run_queues+0x107/0x230 Aug 22 23:41:34 juju-e4d256-prod-github-runner-207 kernel: [65868.585350] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 23:41:34 juju-e4d256-prod-github-runner-207 kernel: [65868.586703] ? hrtimer_interrupt+0x101/0x220 Aug 22 23:41:34 juju-e4d256-prod-github-runner-207 kernel: [65868.588024] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 23:41:34 juju-e4d256-prod-github-runner-207 kernel: [65868.589431] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 23:41:34 juju-e4d256-prod-github-runner-207 kernel: [65868.590793] Aug 22 23:41:34 juju-e4d256-prod-github-runner-207 kernel: [65868.591783] Aug 22 23:41:34 juju-e4d256-prod-github-runner-207 kernel: [65868.592627] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 23:41:34 juju-e4d256-prod-github-runner-207 kernel: [65868.593675] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:41:34 juju-e4d256-prod-github-runner-207 kernel: [65868.594962] ? _raw_spin_lock+0x22/0x30 Aug 22 23:41:34 juju-e4d256-prod-github-runner-207 kernel: [65868.595912] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:41:34 juju-e4d256-prod-github-runner-207 kernel: [65868.596953] direct_page_fault+0x206/0x310 [kvm] Aug 22 23:41:34 juju-e4d256-prod-github-runner-207 kernel: [65868.597988] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 23:41:34 juju-e4d256-prod-github-runner-207 kernel: [65868.599004] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 23:41:34 juju-e4d256-prod-github-runner-207 kernel: [65868.600001] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 23:41:34 juju-e4d256-prod-github-runner-207 kernel: [65868.601054] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 23:41:34 juju-e4d256-prod-github-runner-207 kernel: [65868.602031] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 23:41:34 juju-e4d256-prod-github-runner-207 kernel: [65868.603010] handle_exit+0x98/0x230 [kvm_amd] Aug 22 23:41:34 juju-e4d256-prod-github-runner-207 kernel: [65868.603900] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 23:41:34 juju-e4d256-prod-github-runner-207 kernel: [65868.604823] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 23:41:34 juju-e4d256-prod-github-runner-207 kernel: [65868.605760] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 23:41:34 juju-e4d256-prod-github-runner-207 kernel: [65868.606679] vcpu_run+0x62/0x2c0 [kvm] Aug 22 23:41:34 juju-e4d256-prod-github-runner-207 kernel: [65868.607491] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 23:41:34 juju-e4d256-prod-github-runner-207 kernel: [65868.608302] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 23:41:34 juju-e4d256-prod-github-runner-207 kernel: [65868.609193] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 23:41:34 juju-e4d256-prod-github-runner-207 kernel: [65868.610230] ? __seccomp_filter+0x4a/0x4a0 Aug 22 23:41:34 juju-e4d256-prod-github-runner-207 kernel: [65868.611214] ? __fget_files+0x86/0xc0 Aug 22 23:41:34 juju-e4d256-prod-github-runner-207 kernel: [65868.612146] __x64_sys_ioctl+0x95/0xd0 Aug 22 23:41:34 juju-e4d256-prod-github-runner-207 kernel: [65868.613068] do_syscall_64+0x5c/0xc0 Aug 22 23:41:34 juju-e4d256-prod-github-runner-207 kernel: [65868.613939] ? do_futex+0x162/0x1f0 Aug 22 23:41:34 juju-e4d256-prod-github-runner-207 kernel: [65868.614785] ? __x64_sys_futex+0x78/0x1e0 Aug 22 23:41:34 juju-e4d256-prod-github-runner-207 kernel: [65868.615649] ? __secure_computing+0xa9/0x120 Aug 22 23:41:34 juju-e4d256-prod-github-runner-207 kernel: [65868.616365] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 23:41:34 juju-e4d256-prod-github-runner-207 kernel: [65868.617152] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:41:34 juju-e4d256-prod-github-runner-207 kernel: [65868.617873] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:41:34 juju-e4d256-prod-github-runner-207 kernel: [65868.618588] ? do_syscall_64+0x69/0xc0 Aug 22 23:41:34 juju-e4d256-prod-github-runner-207 kernel: [65868.619230] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:41:34 juju-e4d256-prod-github-runner-207 kernel: [65868.619990] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:41:34 juju-e4d256-prod-github-runner-207 kernel: [65868.620727] ? do_syscall_64+0x69/0xc0 Aug 22 23:41:34 juju-e4d256-prod-github-runner-207 kernel: [65868.621358] ? do_syscall_64+0x69/0xc0 Aug 22 23:41:34 juju-e4d256-prod-github-runner-207 kernel: [65868.621990] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 23:41:34 juju-e4d256-prod-github-runner-207 kernel: [65868.622694] RIP: 0033:0x7faa5d0edaff Aug 22 23:41:34 juju-e4d256-prod-github-runner-207 kernel: [65868.623379] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 23:41:34 juju-e4d256-prod-github-runner-207 kernel: [65868.625553] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 23:41:34 juju-e4d256-prod-github-runner-207 kernel: [65868.626486] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 23:41:34 juju-e4d256-prod-github-runner-207 kernel: [65868.627383] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 23:41:34 juju-e4d256-prod-github-runner-207 kernel: [65868.628271] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 23:41:34 juju-e4d256-prod-github-runner-207 kernel: [65868.629168] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 23:41:34 juju-e4d256-prod-github-runner-207 kernel: [65868.630060] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 23:41:34 juju-e4d256-prod-github-runner-207 kernel: [65868.630953] Aug 22 23:41:47 juju-e4d256-prod-github-runner-207 kernel: [65881.580705] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 23:41:47 juju-e4d256-prod-github-runner-207 kernel: [65881.581661] rcu: 1-....: (16389262 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=7911924 Aug 22 23:41:47 juju-e4d256-prod-github-runner-207 kernel: [65881.582786] (t=16441095 jiffies g=23269 q=57778) Aug 22 23:41:47 juju-e4d256-prod-github-runner-207 kernel: [65881.583579] NMI backtrace for cpu 1 Aug 22 23:41:47 juju-e4d256-prod-github-runner-207 kernel: [65881.584405] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 23:41:47 juju-e4d256-prod-github-runner-207 kernel: [65881.585678] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 23:41:47 juju-e4d256-prod-github-runner-207 kernel: [65881.586901] Call Trace: Aug 22 23:41:47 juju-e4d256-prod-github-runner-207 kernel: [65881.587588] Aug 22 23:41:47 juju-e4d256-prod-github-runner-207 kernel: [65881.588248] show_stack+0x52/0x5c Aug 22 23:41:47 juju-e4d256-prod-github-runner-207 kernel: [65881.588981] dump_stack_lvl+0x4a/0x63 Aug 22 23:41:47 juju-e4d256-prod-github-runner-207 kernel: [65881.589738] dump_stack+0x10/0x16 Aug 22 23:41:47 juju-e4d256-prod-github-runner-207 kernel: [65881.590453] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 23:41:47 juju-e4d256-prod-github-runner-207 kernel: [65881.591238] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 23:41:47 juju-e4d256-prod-github-runner-207 kernel: [65881.592014] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 23:41:47 juju-e4d256-prod-github-runner-207 kernel: [65881.592850] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 23:41:47 juju-e4d256-prod-github-runner-207 kernel: [65881.593669] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 23:41:47 juju-e4d256-prod-github-runner-207 kernel: [65881.594507] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 23:41:47 juju-e4d256-prod-github-runner-207 kernel: [65881.595288] print_cpu_stall.cold+0x2f/0xe2 Aug 22 23:41:47 juju-e4d256-prod-github-runner-207 kernel: [65881.596053] ? timekeeping_update+0xf7/0x150 Aug 22 23:41:47 juju-e4d256-prod-github-runner-207 kernel: [65881.596834] check_cpu_stall+0x109/0x270 Aug 22 23:41:47 juju-e4d256-prod-github-runner-207 kernel: [65881.597582] rcu_sched_clock_irq+0x9a/0x250 Aug 22 23:41:47 juju-e4d256-prod-github-runner-207 kernel: [65881.598349] update_process_times+0x94/0xd0 Aug 22 23:41:47 juju-e4d256-prod-github-runner-207 kernel: [65881.599109] tick_sched_handle+0x29/0x70 Aug 22 23:41:47 juju-e4d256-prod-github-runner-207 kernel: [65881.599854] tick_sched_timer+0x8c/0xc0 Aug 22 23:41:47 juju-e4d256-prod-github-runner-207 kernel: [65881.600662] ? tick_nohz_handler+0xb0/0xb0 Aug 22 23:41:47 juju-e4d256-prod-github-runner-207 kernel: [65881.601448] __hrtimer_run_queues+0x107/0x230 Aug 22 23:41:47 juju-e4d256-prod-github-runner-207 kernel: [65881.602225] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 23:41:47 juju-e4d256-prod-github-runner-207 kernel: [65881.603013] hrtimer_interrupt+0x101/0x220 Aug 22 23:41:47 juju-e4d256-prod-github-runner-207 kernel: [65881.603794] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 23:41:47 juju-e4d256-prod-github-runner-207 kernel: [65881.604614] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 23:41:47 juju-e4d256-prod-github-runner-207 kernel: [65881.605427] Aug 22 23:41:47 juju-e4d256-prod-github-runner-207 kernel: [65881.606077] Aug 22 23:41:47 juju-e4d256-prod-github-runner-207 kernel: [65881.606707] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 23:41:47 juju-e4d256-prod-github-runner-207 kernel: [65881.607524] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:41:47 juju-e4d256-prod-github-runner-207 kernel: [65881.608402] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 23:41:47 juju-e4d256-prod-github-runner-207 kernel: [65881.610625] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 23:41:47 juju-e4d256-prod-github-runner-207 kernel: [65881.611512] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 23:41:47 juju-e4d256-prod-github-runner-207 kernel: [65881.612533] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 23:41:47 juju-e4d256-prod-github-runner-207 kernel: [65881.613513] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 23:41:47 juju-e4d256-prod-github-runner-207 kernel: [65881.614474] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 23:41:47 juju-e4d256-prod-github-runner-207 kernel: [65881.615425] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 23:41:47 juju-e4d256-prod-github-runner-207 kernel: [65881.616374] ? _raw_spin_lock+0x22/0x30 Aug 22 23:41:47 juju-e4d256-prod-github-runner-207 kernel: [65881.617139] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:41:47 juju-e4d256-prod-github-runner-207 kernel: [65881.617990] direct_page_fault+0x206/0x310 [kvm] Aug 22 23:41:47 juju-e4d256-prod-github-runner-207 kernel: [65881.618826] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 23:41:47 juju-e4d256-prod-github-runner-207 kernel: [65881.619658] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 23:41:47 juju-e4d256-prod-github-runner-207 kernel: [65881.620480] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 23:41:47 juju-e4d256-prod-github-runner-207 kernel: [65881.621299] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 23:41:47 juju-e4d256-prod-github-runner-207 kernel: [65881.622085] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 23:41:47 juju-e4d256-prod-github-runner-207 kernel: [65881.622905] handle_exit+0x98/0x230 [kvm_amd] Aug 22 23:41:47 juju-e4d256-prod-github-runner-207 kernel: [65881.623657] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 23:41:47 juju-e4d256-prod-github-runner-207 kernel: [65881.624444] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 23:41:47 juju-e4d256-prod-github-runner-207 kernel: [65881.625250] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 23:41:47 juju-e4d256-prod-github-runner-207 kernel: [65881.626038] vcpu_run+0x62/0x2c0 [kvm] Aug 22 23:41:47 juju-e4d256-prod-github-runner-207 kernel: [65881.626760] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 23:41:47 juju-e4d256-prod-github-runner-207 kernel: [65881.627493] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 23:41:47 juju-e4d256-prod-github-runner-207 kernel: [65881.628312] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 23:41:47 juju-e4d256-prod-github-runner-207 kernel: [65881.629085] ? __seccomp_filter+0x4a/0x4a0 Aug 22 23:41:47 juju-e4d256-prod-github-runner-207 kernel: [65881.629804] ? __fget_files+0x86/0xc0 Aug 22 23:41:47 juju-e4d256-prod-github-runner-207 kernel: [65881.630499] __x64_sys_ioctl+0x95/0xd0 Aug 22 23:41:47 juju-e4d256-prod-github-runner-207 kernel: [65881.631195] do_syscall_64+0x5c/0xc0 Aug 22 23:41:47 juju-e4d256-prod-github-runner-207 kernel: [65881.631872] ? do_futex+0x162/0x1f0 Aug 22 23:41:47 juju-e4d256-prod-github-runner-207 kernel: [65881.632552] ? __x64_sys_futex+0x78/0x1e0 Aug 22 23:41:47 juju-e4d256-prod-github-runner-207 kernel: [65881.633258] ? __secure_computing+0xa9/0x120 Aug 22 23:41:47 juju-e4d256-prod-github-runner-207 kernel: [65881.633973] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 23:41:47 juju-e4d256-prod-github-runner-207 kernel: [65881.634761] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:41:47 juju-e4d256-prod-github-runner-207 kernel: [65881.635529] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:41:47 juju-e4d256-prod-github-runner-207 kernel: [65881.636281] ? do_syscall_64+0x69/0xc0 Aug 22 23:41:47 juju-e4d256-prod-github-runner-207 kernel: [65881.636980] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:41:47 juju-e4d256-prod-github-runner-207 kernel: [65881.637736] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:41:47 juju-e4d256-prod-github-runner-207 kernel: [65881.638493] ? do_syscall_64+0x69/0xc0 Aug 22 23:41:47 juju-e4d256-prod-github-runner-207 kernel: [65881.639187] ? do_syscall_64+0x69/0xc0 Aug 22 23:41:47 juju-e4d256-prod-github-runner-207 kernel: [65881.639875] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 23:41:47 juju-e4d256-prod-github-runner-207 kernel: [65881.640660] RIP: 0033:0x7faa5d0edaff Aug 22 23:41:47 juju-e4d256-prod-github-runner-207 kernel: [65881.641344] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 23:41:47 juju-e4d256-prod-github-runner-207 kernel: [65881.643451] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 23:41:47 juju-e4d256-prod-github-runner-207 kernel: [65881.644420] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 23:41:47 juju-e4d256-prod-github-runner-207 kernel: [65881.645394] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 23:41:47 juju-e4d256-prod-github-runner-207 kernel: [65881.646356] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 23:41:47 juju-e4d256-prod-github-runner-207 kernel: [65881.647330] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 23:41:47 juju-e4d256-prod-github-runner-207 kernel: [65881.648257] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 23:41:47 juju-e4d256-prod-github-runner-207 kernel: [65881.649187] Aug 22 23:42:14 juju-e4d256-prod-github-runner-207 kernel: [65908.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 61274s! [qemu-system-x86:6715] Aug 22 23:42:14 juju-e4d256-prod-github-runner-207 kernel: [65908.543141] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 23:42:14 juju-e4d256-prod-github-runner-207 kernel: [65908.543217] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 23:42:14 juju-e4d256-prod-github-runner-207 kernel: [65908.555515] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 23:42:14 juju-e4d256-prod-github-runner-207 kernel: [65908.556808] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 23:42:14 juju-e4d256-prod-github-runner-207 kernel: [65908.558096] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:42:14 juju-e4d256-prod-github-runner-207 kernel: [65908.559163] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 23:42:14 juju-e4d256-prod-github-runner-207 kernel: [65908.561811] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 23:42:14 juju-e4d256-prod-github-runner-207 kernel: [65908.562886] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 23:42:14 juju-e4d256-prod-github-runner-207 kernel: [65908.564054] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 23:42:14 juju-e4d256-prod-github-runner-207 kernel: [65908.565257] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 23:42:14 juju-e4d256-prod-github-runner-207 kernel: [65908.566422] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 23:42:14 juju-e4d256-prod-github-runner-207 kernel: [65908.567581] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 23:42:14 juju-e4d256-prod-github-runner-207 kernel: [65908.568757] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 23:42:14 juju-e4d256-prod-github-runner-207 kernel: [65908.569993] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 23:42:14 juju-e4d256-prod-github-runner-207 kernel: [65908.571099] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 23:42:14 juju-e4d256-prod-github-runner-207 kernel: [65908.572314] Call Trace: Aug 22 23:42:14 juju-e4d256-prod-github-runner-207 kernel: [65908.573234] Aug 22 23:42:14 juju-e4d256-prod-github-runner-207 kernel: [65908.574116] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:42:14 juju-e4d256-prod-github-runner-207 kernel: [65908.575194] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:42:14 juju-e4d256-prod-github-runner-207 kernel: [65908.576347] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:42:14 juju-e4d256-prod-github-runner-207 kernel: [65908.577436] ? show_regs.part.0+0x23/0x29 Aug 22 23:42:14 juju-e4d256-prod-github-runner-207 kernel: [65908.578448] ? show_regs.cold+0x8/0xd Aug 22 23:42:14 juju-e4d256-prod-github-runner-207 kernel: [65908.579424] ? watchdog_timer_fn+0x1be/0x220 Aug 22 23:42:14 juju-e4d256-prod-github-runner-207 kernel: [65908.580450] ? lockup_detector_update_enable+0x60/0x60 Aug 22 23:42:14 juju-e4d256-prod-github-runner-207 kernel: [65908.581551] ? __hrtimer_run_queues+0x107/0x230 Aug 22 23:42:14 juju-e4d256-prod-github-runner-207 kernel: [65908.582642] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 23:42:14 juju-e4d256-prod-github-runner-207 kernel: [65908.583700] ? hrtimer_interrupt+0x101/0x220 Aug 22 23:42:14 juju-e4d256-prod-github-runner-207 kernel: [65908.584739] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 23:42:14 juju-e4d256-prod-github-runner-207 kernel: [65908.585814] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 23:42:14 juju-e4d256-prod-github-runner-207 kernel: [65908.586862] Aug 22 23:42:14 juju-e4d256-prod-github-runner-207 kernel: [65908.587721] Aug 22 23:42:14 juju-e4d256-prod-github-runner-207 kernel: [65908.588576] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 23:42:14 juju-e4d256-prod-github-runner-207 kernel: [65908.589620] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:42:14 juju-e4d256-prod-github-runner-207 kernel: [65908.590660] ? _raw_spin_lock+0x22/0x30 Aug 22 23:42:14 juju-e4d256-prod-github-runner-207 kernel: [65908.591607] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:42:14 juju-e4d256-prod-github-runner-207 kernel: [65908.592654] direct_page_fault+0x206/0x310 [kvm] Aug 22 23:42:14 juju-e4d256-prod-github-runner-207 kernel: [65908.593689] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 23:42:14 juju-e4d256-prod-github-runner-207 kernel: [65908.594702] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 23:42:14 juju-e4d256-prod-github-runner-207 kernel: [65908.595710] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 23:42:14 juju-e4d256-prod-github-runner-207 kernel: [65908.596704] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 23:42:14 juju-e4d256-prod-github-runner-207 kernel: [65908.597653] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 23:42:14 juju-e4d256-prod-github-runner-207 kernel: [65908.598632] handle_exit+0x98/0x230 [kvm_amd] Aug 22 23:42:14 juju-e4d256-prod-github-runner-207 kernel: [65908.599534] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 23:42:14 juju-e4d256-prod-github-runner-207 kernel: [65908.600477] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 23:42:14 juju-e4d256-prod-github-runner-207 kernel: [65908.601470] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 23:42:14 juju-e4d256-prod-github-runner-207 kernel: [65908.602457] vcpu_run+0x62/0x2c0 [kvm] Aug 22 23:42:14 juju-e4d256-prod-github-runner-207 kernel: [65908.603284] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 23:42:14 juju-e4d256-prod-github-runner-207 kernel: [65908.604114] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 23:42:14 juju-e4d256-prod-github-runner-207 kernel: [65908.605014] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 23:42:14 juju-e4d256-prod-github-runner-207 kernel: [65908.605820] ? __seccomp_filter+0x4a/0x4a0 Aug 22 23:42:14 juju-e4d256-prod-github-runner-207 kernel: [65908.606568] ? __fget_files+0x86/0xc0 Aug 22 23:42:14 juju-e4d256-prod-github-runner-207 kernel: [65908.607274] __x64_sys_ioctl+0x95/0xd0 Aug 22 23:42:14 juju-e4d256-prod-github-runner-207 kernel: [65908.607974] do_syscall_64+0x5c/0xc0 Aug 22 23:42:14 juju-e4d256-prod-github-runner-207 kernel: [65908.608651] ? do_futex+0x162/0x1f0 Aug 22 23:42:14 juju-e4d256-prod-github-runner-207 kernel: [65908.609301] ? __x64_sys_futex+0x78/0x1e0 Aug 22 23:42:14 juju-e4d256-prod-github-runner-207 kernel: [65908.609980] ? __secure_computing+0xa9/0x120 Aug 22 23:42:14 juju-e4d256-prod-github-runner-207 kernel: [65908.610689] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 23:42:14 juju-e4d256-prod-github-runner-207 kernel: [65908.611461] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:42:14 juju-e4d256-prod-github-runner-207 kernel: [65908.612189] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:42:14 juju-e4d256-prod-github-runner-207 kernel: [65908.612905] ? do_syscall_64+0x69/0xc0 Aug 22 23:42:14 juju-e4d256-prod-github-runner-207 kernel: [65908.613552] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:42:14 juju-e4d256-prod-github-runner-207 kernel: [65908.614256] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:42:14 juju-e4d256-prod-github-runner-207 kernel: [65908.614957] ? do_syscall_64+0x69/0xc0 Aug 22 23:42:14 juju-e4d256-prod-github-runner-207 kernel: [65908.615602] ? do_syscall_64+0x69/0xc0 Aug 22 23:42:14 juju-e4d256-prod-github-runner-207 kernel: [65908.616272] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 23:42:14 juju-e4d256-prod-github-runner-207 kernel: [65908.616991] RIP: 0033:0x7faa5d0edaff Aug 22 23:42:14 juju-e4d256-prod-github-runner-207 kernel: [65908.617621] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 23:42:14 juju-e4d256-prod-github-runner-207 kernel: [65908.619618] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 23:42:14 juju-e4d256-prod-github-runner-207 kernel: [65908.620554] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 23:42:14 juju-e4d256-prod-github-runner-207 kernel: [65908.621446] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 23:42:14 juju-e4d256-prod-github-runner-207 kernel: [65908.622336] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 23:42:14 juju-e4d256-prod-github-runner-207 kernel: [65908.623224] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 23:42:14 juju-e4d256-prod-github-runner-207 kernel: [65908.624117] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 23:42:14 juju-e4d256-prod-github-runner-207 kernel: [65908.625055] Aug 22 23:42:42 juju-e4d256-prod-github-runner-207 kernel: [65936.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 61300s! [qemu-system-x86:6715] Aug 22 23:42:42 juju-e4d256-prod-github-runner-207 kernel: [65936.543886] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 23:42:42 juju-e4d256-prod-github-runner-207 kernel: [65936.544197] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 23:42:42 juju-e4d256-prod-github-runner-207 kernel: [65936.556741] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 23:42:42 juju-e4d256-prod-github-runner-207 kernel: [65936.558044] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 23:42:42 juju-e4d256-prod-github-runner-207 kernel: [65936.559300] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:42:42 juju-e4d256-prod-github-runner-207 kernel: [65936.560395] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 23:42:42 juju-e4d256-prod-github-runner-207 kernel: [65936.563005] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 23:42:42 juju-e4d256-prod-github-runner-207 kernel: [65936.564074] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 23:42:42 juju-e4d256-prod-github-runner-207 kernel: [65936.565265] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 23:42:42 juju-e4d256-prod-github-runner-207 kernel: [65936.566450] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 23:42:42 juju-e4d256-prod-github-runner-207 kernel: [65936.567631] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 23:42:42 juju-e4d256-prod-github-runner-207 kernel: [65936.568845] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 23:42:42 juju-e4d256-prod-github-runner-207 kernel: [65936.570047] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 23:42:42 juju-e4d256-prod-github-runner-207 kernel: [65936.571311] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 23:42:42 juju-e4d256-prod-github-runner-207 kernel: [65936.572452] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 23:42:42 juju-e4d256-prod-github-runner-207 kernel: [65936.573671] Call Trace: Aug 22 23:42:42 juju-e4d256-prod-github-runner-207 kernel: [65936.574591] Aug 22 23:42:42 juju-e4d256-prod-github-runner-207 kernel: [65936.575501] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:42:42 juju-e4d256-prod-github-runner-207 kernel: [65936.576557] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:42:42 juju-e4d256-prod-github-runner-207 kernel: [65936.577593] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:42:42 juju-e4d256-prod-github-runner-207 kernel: [65936.578701] ? show_regs.part.0+0x23/0x29 Aug 22 23:42:42 juju-e4d256-prod-github-runner-207 kernel: [65936.579709] ? show_regs.cold+0x8/0xd Aug 22 23:42:42 juju-e4d256-prod-github-runner-207 kernel: [65936.580705] ? watchdog_timer_fn+0x1be/0x220 Aug 22 23:42:42 juju-e4d256-prod-github-runner-207 kernel: [65936.581725] ? lockup_detector_update_enable+0x60/0x60 Aug 22 23:42:42 juju-e4d256-prod-github-runner-207 kernel: [65936.582799] ? __hrtimer_run_queues+0x107/0x230 Aug 22 23:42:42 juju-e4d256-prod-github-runner-207 kernel: [65936.583924] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 23:42:42 juju-e4d256-prod-github-runner-207 kernel: [65936.584969] ? hrtimer_interrupt+0x101/0x220 Aug 22 23:42:42 juju-e4d256-prod-github-runner-207 kernel: [65936.586005] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 23:42:42 juju-e4d256-prod-github-runner-207 kernel: [65936.587092] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 23:42:42 juju-e4d256-prod-github-runner-207 kernel: [65936.588184] Aug 22 23:42:42 juju-e4d256-prod-github-runner-207 kernel: [65936.589059] Aug 22 23:42:42 juju-e4d256-prod-github-runner-207 kernel: [65936.589902] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 23:42:42 juju-e4d256-prod-github-runner-207 kernel: [65936.590952] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:42:42 juju-e4d256-prod-github-runner-207 kernel: [65936.592041] ? _raw_spin_lock+0x22/0x30 Aug 22 23:42:42 juju-e4d256-prod-github-runner-207 kernel: [65936.592998] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:42:42 juju-e4d256-prod-github-runner-207 kernel: [65936.594171] direct_page_fault+0x206/0x310 [kvm] Aug 22 23:42:42 juju-e4d256-prod-github-runner-207 kernel: [65936.595206] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 23:42:42 juju-e4d256-prod-github-runner-207 kernel: [65936.596254] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 23:42:42 juju-e4d256-prod-github-runner-207 kernel: [65936.597269] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 23:42:42 juju-e4d256-prod-github-runner-207 kernel: [65936.598297] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 23:42:42 juju-e4d256-prod-github-runner-207 kernel: [65936.599297] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 23:42:42 juju-e4d256-prod-github-runner-207 kernel: [65936.600381] handle_exit+0x98/0x230 [kvm_amd] Aug 22 23:42:42 juju-e4d256-prod-github-runner-207 kernel: [65936.601288] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 23:42:42 juju-e4d256-prod-github-runner-207 kernel: [65936.602212] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 23:42:42 juju-e4d256-prod-github-runner-207 kernel: [65936.603177] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 23:42:42 juju-e4d256-prod-github-runner-207 kernel: [65936.604120] vcpu_run+0x62/0x2c0 [kvm] Aug 22 23:42:42 juju-e4d256-prod-github-runner-207 kernel: [65936.604942] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 23:42:42 juju-e4d256-prod-github-runner-207 kernel: [65936.605761] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 23:42:42 juju-e4d256-prod-github-runner-207 kernel: [65936.606630] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 23:42:42 juju-e4d256-prod-github-runner-207 kernel: [65936.607438] ? __seccomp_filter+0x4a/0x4a0 Aug 22 23:42:42 juju-e4d256-prod-github-runner-207 kernel: [65936.608225] ? __fget_files+0x86/0xc0 Aug 22 23:42:42 juju-e4d256-prod-github-runner-207 kernel: [65936.608948] __x64_sys_ioctl+0x95/0xd0 Aug 22 23:42:42 juju-e4d256-prod-github-runner-207 kernel: [65936.609652] do_syscall_64+0x5c/0xc0 Aug 22 23:42:42 juju-e4d256-prod-github-runner-207 kernel: [65936.610334] ? do_futex+0x162/0x1f0 Aug 22 23:42:42 juju-e4d256-prod-github-runner-207 kernel: [65936.610996] ? __x64_sys_futex+0x78/0x1e0 Aug 22 23:42:42 juju-e4d256-prod-github-runner-207 kernel: [65936.611684] ? __secure_computing+0xa9/0x120 Aug 22 23:42:42 juju-e4d256-prod-github-runner-207 kernel: [65936.612397] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 23:42:42 juju-e4d256-prod-github-runner-207 kernel: [65936.613181] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:42:42 juju-e4d256-prod-github-runner-207 kernel: [65936.613919] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:42:42 juju-e4d256-prod-github-runner-207 kernel: [65936.614648] ? do_syscall_64+0x69/0xc0 Aug 22 23:42:42 juju-e4d256-prod-github-runner-207 kernel: [65936.615300] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:42:42 juju-e4d256-prod-github-runner-207 kernel: [65936.616031] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:42:42 juju-e4d256-prod-github-runner-207 kernel: [65936.616735] ? do_syscall_64+0x69/0xc0 Aug 22 23:42:42 juju-e4d256-prod-github-runner-207 kernel: [65936.617371] ? do_syscall_64+0x69/0xc0 Aug 22 23:42:42 juju-e4d256-prod-github-runner-207 kernel: [65936.617997] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 23:42:42 juju-e4d256-prod-github-runner-207 kernel: [65936.618713] RIP: 0033:0x7faa5d0edaff Aug 22 23:42:42 juju-e4d256-prod-github-runner-207 kernel: [65936.619373] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 23:42:42 juju-e4d256-prod-github-runner-207 kernel: [65936.621445] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 23:42:42 juju-e4d256-prod-github-runner-207 kernel: [65936.622448] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 23:42:42 juju-e4d256-prod-github-runner-207 kernel: [65936.623579] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 23:42:42 juju-e4d256-prod-github-runner-207 kernel: [65936.624538] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 23:42:42 juju-e4d256-prod-github-runner-207 kernel: [65936.625455] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 23:42:42 juju-e4d256-prod-github-runner-207 kernel: [65936.626376] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 23:42:42 juju-e4d256-prod-github-runner-207 kernel: [65936.627304] Aug 22 23:43:10 juju-e4d256-prod-github-runner-207 kernel: [65964.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 61326s! [qemu-system-x86:6715] Aug 22 23:43:10 juju-e4d256-prod-github-runner-207 kernel: [65964.543127] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 23:43:10 juju-e4d256-prod-github-runner-207 kernel: [65964.543203] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 23:43:10 juju-e4d256-prod-github-runner-207 kernel: [65964.555746] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 23:43:10 juju-e4d256-prod-github-runner-207 kernel: [65964.557037] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 23:43:10 juju-e4d256-prod-github-runner-207 kernel: [65964.558261] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:43:10 juju-e4d256-prod-github-runner-207 kernel: [65964.559317] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 23:43:10 juju-e4d256-prod-github-runner-207 kernel: [65964.561885] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 23:43:10 juju-e4d256-prod-github-runner-207 kernel: [65964.562931] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 23:43:10 juju-e4d256-prod-github-runner-207 kernel: [65964.564112] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 23:43:10 juju-e4d256-prod-github-runner-207 kernel: [65964.565276] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 23:43:10 juju-e4d256-prod-github-runner-207 kernel: [65964.566451] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 23:43:10 juju-e4d256-prod-github-runner-207 kernel: [65964.567625] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 23:43:10 juju-e4d256-prod-github-runner-207 kernel: [65964.568793] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 23:43:10 juju-e4d256-prod-github-runner-207 kernel: [65964.570030] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 23:43:10 juju-e4d256-prod-github-runner-207 kernel: [65964.571128] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 23:43:10 juju-e4d256-prod-github-runner-207 kernel: [65964.572340] Call Trace: Aug 22 23:43:10 juju-e4d256-prod-github-runner-207 kernel: [65964.573256] Aug 22 23:43:10 juju-e4d256-prod-github-runner-207 kernel: [65964.574139] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:43:10 juju-e4d256-prod-github-runner-207 kernel: [65964.575168] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:43:10 juju-e4d256-prod-github-runner-207 kernel: [65964.576206] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:43:10 juju-e4d256-prod-github-runner-207 kernel: [65964.577290] ? show_regs.part.0+0x23/0x29 Aug 22 23:43:10 juju-e4d256-prod-github-runner-207 kernel: [65964.578287] ? show_regs.cold+0x8/0xd Aug 22 23:43:10 juju-e4d256-prod-github-runner-207 kernel: [65964.579258] ? watchdog_timer_fn+0x1be/0x220 Aug 22 23:43:10 juju-e4d256-prod-github-runner-207 kernel: [65964.580275] ? lockup_detector_update_enable+0x60/0x60 Aug 22 23:43:10 juju-e4d256-prod-github-runner-207 kernel: [65964.581339] ? __hrtimer_run_queues+0x107/0x230 Aug 22 23:43:10 juju-e4d256-prod-github-runner-207 kernel: [65964.582368] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 23:43:10 juju-e4d256-prod-github-runner-207 kernel: [65964.583398] ? hrtimer_interrupt+0x101/0x220 Aug 22 23:43:10 juju-e4d256-prod-github-runner-207 kernel: [65964.584431] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 23:43:10 juju-e4d256-prod-github-runner-207 kernel: [65964.585504] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 23:43:10 juju-e4d256-prod-github-runner-207 kernel: [65964.586548] Aug 22 23:43:10 juju-e4d256-prod-github-runner-207 kernel: [65964.587400] Aug 22 23:43:10 juju-e4d256-prod-github-runner-207 kernel: [65964.588260] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 23:43:10 juju-e4d256-prod-github-runner-207 kernel: [65964.589293] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:43:10 juju-e4d256-prod-github-runner-207 kernel: [65964.590329] ? _raw_spin_lock+0x22/0x30 Aug 22 23:43:10 juju-e4d256-prod-github-runner-207 kernel: [65964.591273] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:43:10 juju-e4d256-prod-github-runner-207 kernel: [65964.592299] direct_page_fault+0x206/0x310 [kvm] Aug 22 23:43:10 juju-e4d256-prod-github-runner-207 kernel: [65964.593323] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 23:43:10 juju-e4d256-prod-github-runner-207 kernel: [65964.594333] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 23:43:10 juju-e4d256-prod-github-runner-207 kernel: [65964.595333] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 23:43:10 juju-e4d256-prod-github-runner-207 kernel: [65964.596385] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 23:43:10 juju-e4d256-prod-github-runner-207 kernel: [65964.597358] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 23:43:10 juju-e4d256-prod-github-runner-207 kernel: [65964.598339] handle_exit+0x98/0x230 [kvm_amd] Aug 22 23:43:10 juju-e4d256-prod-github-runner-207 kernel: [65964.599229] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 23:43:10 juju-e4d256-prod-github-runner-207 kernel: [65964.600152] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 23:43:10 juju-e4d256-prod-github-runner-207 kernel: [65964.601083] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 23:43:10 juju-e4d256-prod-github-runner-207 kernel: [65964.601985] vcpu_run+0x62/0x2c0 [kvm] Aug 22 23:43:10 juju-e4d256-prod-github-runner-207 kernel: [65964.602793] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 23:43:10 juju-e4d256-prod-github-runner-207 kernel: [65964.603617] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 23:43:10 juju-e4d256-prod-github-runner-207 kernel: [65964.604478] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 23:43:10 juju-e4d256-prod-github-runner-207 kernel: [65964.605274] ? __seccomp_filter+0x4a/0x4a0 Aug 22 23:43:10 juju-e4d256-prod-github-runner-207 kernel: [65964.606017] ? __fget_files+0x86/0xc0 Aug 22 23:43:10 juju-e4d256-prod-github-runner-207 kernel: [65964.606719] __x64_sys_ioctl+0x95/0xd0 Aug 22 23:43:10 juju-e4d256-prod-github-runner-207 kernel: [65964.607415] do_syscall_64+0x5c/0xc0 Aug 22 23:43:10 juju-e4d256-prod-github-runner-207 kernel: [65964.608091] ? do_futex+0x162/0x1f0 Aug 22 23:43:10 juju-e4d256-prod-github-runner-207 kernel: [65964.608738] ? __x64_sys_futex+0x78/0x1e0 Aug 22 23:43:10 juju-e4d256-prod-github-runner-207 kernel: [65964.609411] ? __secure_computing+0xa9/0x120 Aug 22 23:43:10 juju-e4d256-prod-github-runner-207 kernel: [65964.610104] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 23:43:10 juju-e4d256-prod-github-runner-207 kernel: [65964.610906] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:43:10 juju-e4d256-prod-github-runner-207 kernel: [65964.611637] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:43:10 juju-e4d256-prod-github-runner-207 kernel: [65964.612356] ? do_syscall_64+0x69/0xc0 Aug 22 23:43:10 juju-e4d256-prod-github-runner-207 kernel: [65964.613004] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:43:10 juju-e4d256-prod-github-runner-207 kernel: [65964.613705] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:43:10 juju-e4d256-prod-github-runner-207 kernel: [65964.614418] ? do_syscall_64+0x69/0xc0 Aug 22 23:43:10 juju-e4d256-prod-github-runner-207 kernel: [65964.615041] ? do_syscall_64+0x69/0xc0 Aug 22 23:43:10 juju-e4d256-prod-github-runner-207 kernel: [65964.615670] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 23:43:10 juju-e4d256-prod-github-runner-207 kernel: [65964.616377] RIP: 0033:0x7faa5d0edaff Aug 22 23:43:10 juju-e4d256-prod-github-runner-207 kernel: [65964.617002] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 23:43:10 juju-e4d256-prod-github-runner-207 kernel: [65964.618982] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 23:43:10 juju-e4d256-prod-github-runner-207 kernel: [65964.619905] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 23:43:10 juju-e4d256-prod-github-runner-207 kernel: [65964.620795] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 23:43:10 juju-e4d256-prod-github-runner-207 kernel: [65964.621685] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 23:43:10 juju-e4d256-prod-github-runner-207 kernel: [65964.622572] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 23:43:10 juju-e4d256-prod-github-runner-207 kernel: [65964.623480] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 23:43:10 juju-e4d256-prod-github-runner-207 kernel: [65964.624389] Aug 22 23:43:38 juju-e4d256-prod-github-runner-207 kernel: [65992.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 61352s! [qemu-system-x86:6715] Aug 22 23:43:38 juju-e4d256-prod-github-runner-207 kernel: [65992.543118] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 23:43:38 juju-e4d256-prod-github-runner-207 kernel: [65992.543193] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 23:43:38 juju-e4d256-prod-github-runner-207 kernel: [65992.555638] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 23:43:38 juju-e4d256-prod-github-runner-207 kernel: [65992.556922] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 23:43:38 juju-e4d256-prod-github-runner-207 kernel: [65992.558142] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:43:38 juju-e4d256-prod-github-runner-207 kernel: [65992.559198] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 23:43:38 juju-e4d256-prod-github-runner-207 kernel: [65992.561789] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 23:43:38 juju-e4d256-prod-github-runner-207 kernel: [65992.562842] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 23:43:38 juju-e4d256-prod-github-runner-207 kernel: [65992.564033] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 23:43:38 juju-e4d256-prod-github-runner-207 kernel: [65992.565480] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 23:43:38 juju-e4d256-prod-github-runner-207 kernel: [65992.566658] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 23:43:38 juju-e4d256-prod-github-runner-207 kernel: [65992.567874] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 23:43:38 juju-e4d256-prod-github-runner-207 kernel: [65992.569051] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 23:43:38 juju-e4d256-prod-github-runner-207 kernel: [65992.570309] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 23:43:38 juju-e4d256-prod-github-runner-207 kernel: [65992.571433] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 23:43:38 juju-e4d256-prod-github-runner-207 kernel: [65992.572646] Call Trace: Aug 22 23:43:38 juju-e4d256-prod-github-runner-207 kernel: [65992.573573] Aug 22 23:43:38 juju-e4d256-prod-github-runner-207 kernel: [65992.574456] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:43:38 juju-e4d256-prod-github-runner-207 kernel: [65992.575501] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:43:38 juju-e4d256-prod-github-runner-207 kernel: [65992.576526] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:43:38 juju-e4d256-prod-github-runner-207 kernel: [65992.577601] ? show_regs.part.0+0x23/0x29 Aug 22 23:43:38 juju-e4d256-prod-github-runner-207 kernel: [65992.578611] ? show_regs.cold+0x8/0xd Aug 22 23:43:38 juju-e4d256-prod-github-runner-207 kernel: [65992.579606] ? watchdog_timer_fn+0x1be/0x220 Aug 22 23:43:38 juju-e4d256-prod-github-runner-207 kernel: [65992.580614] ? lockup_detector_update_enable+0x60/0x60 Aug 22 23:43:38 juju-e4d256-prod-github-runner-207 kernel: [65992.581680] ? __hrtimer_run_queues+0x107/0x230 Aug 22 23:43:38 juju-e4d256-prod-github-runner-207 kernel: [65992.582775] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 23:43:38 juju-e4d256-prod-github-runner-207 kernel: [65992.584027] ? hrtimer_interrupt+0x101/0x220 Aug 22 23:43:38 juju-e4d256-prod-github-runner-207 kernel: [65992.585105] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 23:43:38 juju-e4d256-prod-github-runner-207 kernel: [65992.586176] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 23:43:38 juju-e4d256-prod-github-runner-207 kernel: [65992.587292] Aug 22 23:43:38 juju-e4d256-prod-github-runner-207 kernel: [65992.588154] Aug 22 23:43:38 juju-e4d256-prod-github-runner-207 kernel: [65992.588992] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 23:43:38 juju-e4d256-prod-github-runner-207 kernel: [65992.590044] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:43:38 juju-e4d256-prod-github-runner-207 kernel: [65992.591083] ? _raw_spin_lock+0x22/0x30 Aug 22 23:43:38 juju-e4d256-prod-github-runner-207 kernel: [65992.592039] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:43:38 juju-e4d256-prod-github-runner-207 kernel: [65992.593078] direct_page_fault+0x206/0x310 [kvm] Aug 22 23:43:38 juju-e4d256-prod-github-runner-207 kernel: [65992.594121] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 23:43:38 juju-e4d256-prod-github-runner-207 kernel: [65992.595356] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 23:43:38 juju-e4d256-prod-github-runner-207 kernel: [65992.596437] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 23:43:38 juju-e4d256-prod-github-runner-207 kernel: [65992.597416] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 23:43:38 juju-e4d256-prod-github-runner-207 kernel: [65992.598359] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 23:43:38 juju-e4d256-prod-github-runner-207 kernel: [65992.599366] handle_exit+0x98/0x230 [kvm_amd] Aug 22 23:43:38 juju-e4d256-prod-github-runner-207 kernel: [65992.600259] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 23:43:38 juju-e4d256-prod-github-runner-207 kernel: [65992.601192] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 23:43:38 juju-e4d256-prod-github-runner-207 kernel: [65992.602134] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 23:43:38 juju-e4d256-prod-github-runner-207 kernel: [65992.603038] vcpu_run+0x62/0x2c0 [kvm] Aug 22 23:43:38 juju-e4d256-prod-github-runner-207 kernel: [65992.603865] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 23:43:38 juju-e4d256-prod-github-runner-207 kernel: [65992.604673] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 23:43:38 juju-e4d256-prod-github-runner-207 kernel: [65992.605527] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 23:43:38 juju-e4d256-prod-github-runner-207 kernel: [65992.606323] ? __seccomp_filter+0x4a/0x4a0 Aug 22 23:43:38 juju-e4d256-prod-github-runner-207 kernel: [65992.607104] ? __fget_files+0x86/0xc0 Aug 22 23:43:38 juju-e4d256-prod-github-runner-207 kernel: [65992.607842] __x64_sys_ioctl+0x95/0xd0 Aug 22 23:43:38 juju-e4d256-prod-github-runner-207 kernel: [65992.608536] do_syscall_64+0x5c/0xc0 Aug 22 23:43:38 juju-e4d256-prod-github-runner-207 kernel: [65992.609200] ? do_futex+0x162/0x1f0 Aug 22 23:43:38 juju-e4d256-prod-github-runner-207 kernel: [65992.609845] ? __x64_sys_futex+0x78/0x1e0 Aug 22 23:43:38 juju-e4d256-prod-github-runner-207 kernel: [65992.610515] ? __secure_computing+0xa9/0x120 Aug 22 23:43:38 juju-e4d256-prod-github-runner-207 kernel: [65992.611202] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 23:43:38 juju-e4d256-prod-github-runner-207 kernel: [65992.611973] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:43:38 juju-e4d256-prod-github-runner-207 kernel: [65992.612696] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:43:38 juju-e4d256-prod-github-runner-207 kernel: [65992.613411] ? do_syscall_64+0x69/0xc0 Aug 22 23:43:38 juju-e4d256-prod-github-runner-207 kernel: [65992.614054] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:43:38 juju-e4d256-prod-github-runner-207 kernel: [65992.614759] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:43:38 juju-e4d256-prod-github-runner-207 kernel: [65992.615466] ? do_syscall_64+0x69/0xc0 Aug 22 23:43:38 juju-e4d256-prod-github-runner-207 kernel: [65992.616107] ? do_syscall_64+0x69/0xc0 Aug 22 23:43:38 juju-e4d256-prod-github-runner-207 kernel: [65992.616729] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 23:43:38 juju-e4d256-prod-github-runner-207 kernel: [65992.617437] RIP: 0033:0x7faa5d0edaff Aug 22 23:43:38 juju-e4d256-prod-github-runner-207 kernel: [65992.618059] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 23:43:38 juju-e4d256-prod-github-runner-207 kernel: [65992.620063] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 23:43:38 juju-e4d256-prod-github-runner-207 kernel: [65992.620972] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 23:43:38 juju-e4d256-prod-github-runner-207 kernel: [65992.621865] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 23:43:38 juju-e4d256-prod-github-runner-207 kernel: [65992.622753] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 23:43:38 juju-e4d256-prod-github-runner-207 kernel: [65992.623654] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 23:43:38 juju-e4d256-prod-github-runner-207 kernel: [65992.624627] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 23:43:38 juju-e4d256-prod-github-runner-207 kernel: [65992.625521] Aug 22 23:44:06 juju-e4d256-prod-github-runner-207 kernel: [66020.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 61378s! [qemu-system-x86:6715] Aug 22 23:44:06 juju-e4d256-prod-github-runner-207 kernel: [66020.543194] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 23:44:06 juju-e4d256-prod-github-runner-207 kernel: [66020.543270] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 23:44:06 juju-e4d256-prod-github-runner-207 kernel: [66020.555663] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 23:44:06 juju-e4d256-prod-github-runner-207 kernel: [66020.556930] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 23:44:06 juju-e4d256-prod-github-runner-207 kernel: [66020.558146] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:44:06 juju-e4d256-prod-github-runner-207 kernel: [66020.559225] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 23:44:06 juju-e4d256-prod-github-runner-207 kernel: [66020.561770] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 23:44:06 juju-e4d256-prod-github-runner-207 kernel: [66020.562817] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 23:44:06 juju-e4d256-prod-github-runner-207 kernel: [66020.563990] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 23:44:06 juju-e4d256-prod-github-runner-207 kernel: [66020.565313] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 23:44:06 juju-e4d256-prod-github-runner-207 kernel: [66020.566566] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 23:44:06 juju-e4d256-prod-github-runner-207 kernel: [66020.567739] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 23:44:06 juju-e4d256-prod-github-runner-207 kernel: [66020.568909] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 23:44:06 juju-e4d256-prod-github-runner-207 kernel: [66020.570151] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 23:44:06 juju-e4d256-prod-github-runner-207 kernel: [66020.571270] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 23:44:06 juju-e4d256-prod-github-runner-207 kernel: [66020.572465] Call Trace: Aug 22 23:44:06 juju-e4d256-prod-github-runner-207 kernel: [66020.573397] Aug 22 23:44:06 juju-e4d256-prod-github-runner-207 kernel: [66020.574307] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:44:06 juju-e4d256-prod-github-runner-207 kernel: [66020.575374] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:44:06 juju-e4d256-prod-github-runner-207 kernel: [66020.576416] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:44:06 juju-e4d256-prod-github-runner-207 kernel: [66020.577493] ? show_regs.part.0+0x23/0x29 Aug 22 23:44:06 juju-e4d256-prod-github-runner-207 kernel: [66020.578494] ? show_regs.cold+0x8/0xd Aug 22 23:44:06 juju-e4d256-prod-github-runner-207 kernel: [66020.579511] ? watchdog_timer_fn+0x1be/0x220 Aug 22 23:44:06 juju-e4d256-prod-github-runner-207 kernel: [66020.580525] ? lockup_detector_update_enable+0x60/0x60 Aug 22 23:44:06 juju-e4d256-prod-github-runner-207 kernel: [66020.581592] ? __hrtimer_run_queues+0x107/0x230 Aug 22 23:44:06 juju-e4d256-prod-github-runner-207 kernel: [66020.582856] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 23:44:06 juju-e4d256-prod-github-runner-207 kernel: [66020.583889] ? hrtimer_interrupt+0x101/0x220 Aug 22 23:44:06 juju-e4d256-prod-github-runner-207 kernel: [66020.584919] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 23:44:06 juju-e4d256-prod-github-runner-207 kernel: [66020.585993] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 23:44:06 juju-e4d256-prod-github-runner-207 kernel: [66020.587053] Aug 22 23:44:06 juju-e4d256-prod-github-runner-207 kernel: [66020.587918] Aug 22 23:44:06 juju-e4d256-prod-github-runner-207 kernel: [66020.588766] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 23:44:06 juju-e4d256-prod-github-runner-207 kernel: [66020.589799] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:44:06 juju-e4d256-prod-github-runner-207 kernel: [66020.590836] ? _raw_spin_lock+0x22/0x30 Aug 22 23:44:06 juju-e4d256-prod-github-runner-207 kernel: [66020.591787] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:44:06 juju-e4d256-prod-github-runner-207 kernel: [66020.592803] direct_page_fault+0x206/0x310 [kvm] Aug 22 23:44:06 juju-e4d256-prod-github-runner-207 kernel: [66020.593826] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 23:44:06 juju-e4d256-prod-github-runner-207 kernel: [66020.594833] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 23:44:06 juju-e4d256-prod-github-runner-207 kernel: [66020.595842] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 23:44:06 juju-e4d256-prod-github-runner-207 kernel: [66020.596810] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 23:44:06 juju-e4d256-prod-github-runner-207 kernel: [66020.597772] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 23:44:06 juju-e4d256-prod-github-runner-207 kernel: [66020.598754] handle_exit+0x98/0x230 [kvm_amd] Aug 22 23:44:06 juju-e4d256-prod-github-runner-207 kernel: [66020.599653] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 23:44:06 juju-e4d256-prod-github-runner-207 kernel: [66020.600570] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 23:44:06 juju-e4d256-prod-github-runner-207 kernel: [66020.601493] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 23:44:06 juju-e4d256-prod-github-runner-207 kernel: [66020.602396] vcpu_run+0x62/0x2c0 [kvm] Aug 22 23:44:06 juju-e4d256-prod-github-runner-207 kernel: [66020.603225] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 23:44:06 juju-e4d256-prod-github-runner-207 kernel: [66020.604037] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 23:44:06 juju-e4d256-prod-github-runner-207 kernel: [66020.604890] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 23:44:06 juju-e4d256-prod-github-runner-207 kernel: [66020.605686] ? __seccomp_filter+0x4a/0x4a0 Aug 22 23:44:06 juju-e4d256-prod-github-runner-207 kernel: [66020.606427] ? __fget_files+0x86/0xc0 Aug 22 23:44:06 juju-e4d256-prod-github-runner-207 kernel: [66020.607137] __x64_sys_ioctl+0x95/0xd0 Aug 22 23:44:06 juju-e4d256-prod-github-runner-207 kernel: [66020.607833] do_syscall_64+0x5c/0xc0 Aug 22 23:44:06 juju-e4d256-prod-github-runner-207 kernel: [66020.608501] ? do_futex+0x162/0x1f0 Aug 22 23:44:06 juju-e4d256-prod-github-runner-207 kernel: [66020.609176] ? __x64_sys_futex+0x78/0x1e0 Aug 22 23:44:06 juju-e4d256-prod-github-runner-207 kernel: [66020.609863] ? __secure_computing+0xa9/0x120 Aug 22 23:44:06 juju-e4d256-prod-github-runner-207 kernel: [66020.610563] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 23:44:06 juju-e4d256-prod-github-runner-207 kernel: [66020.611349] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:44:06 juju-e4d256-prod-github-runner-207 kernel: [66020.612067] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:44:06 juju-e4d256-prod-github-runner-207 kernel: [66020.612785] ? do_syscall_64+0x69/0xc0 Aug 22 23:44:06 juju-e4d256-prod-github-runner-207 kernel: [66020.613427] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:44:06 juju-e4d256-prod-github-runner-207 kernel: [66020.614131] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:44:06 juju-e4d256-prod-github-runner-207 kernel: [66020.614824] ? do_syscall_64+0x69/0xc0 Aug 22 23:44:06 juju-e4d256-prod-github-runner-207 kernel: [66020.615459] ? do_syscall_64+0x69/0xc0 Aug 22 23:44:06 juju-e4d256-prod-github-runner-207 kernel: [66020.616115] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 23:44:06 juju-e4d256-prod-github-runner-207 kernel: [66020.616820] RIP: 0033:0x7faa5d0edaff Aug 22 23:44:06 juju-e4d256-prod-github-runner-207 kernel: [66020.617443] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 23:44:06 juju-e4d256-prod-github-runner-207 kernel: [66020.619426] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 23:44:06 juju-e4d256-prod-github-runner-207 kernel: [66020.620339] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 23:44:06 juju-e4d256-prod-github-runner-207 kernel: [66020.621225] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 23:44:06 juju-e4d256-prod-github-runner-207 kernel: [66020.622109] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 23:44:06 juju-e4d256-prod-github-runner-207 kernel: [66020.623012] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 23:44:06 juju-e4d256-prod-github-runner-207 kernel: [66020.623916] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 23:44:06 juju-e4d256-prod-github-runner-207 kernel: [66020.624805] Aug 22 23:44:34 juju-e4d256-prod-github-runner-207 kernel: [66048.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 61404s! [qemu-system-x86:6715] Aug 22 23:44:34 juju-e4d256-prod-github-runner-207 kernel: [66048.543861] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 23:44:34 juju-e4d256-prod-github-runner-207 kernel: [66048.544162] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 23:44:34 juju-e4d256-prod-github-runner-207 kernel: [66048.556344] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 23:44:34 juju-e4d256-prod-github-runner-207 kernel: [66048.557638] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 23:44:34 juju-e4d256-prod-github-runner-207 kernel: [66048.558901] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:44:34 juju-e4d256-prod-github-runner-207 kernel: [66048.560041] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 23:44:34 juju-e4d256-prod-github-runner-207 kernel: [66048.562614] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 23:44:34 juju-e4d256-prod-github-runner-207 kernel: [66048.563656] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 23:44:34 juju-e4d256-prod-github-runner-207 kernel: [66048.564822] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 23:44:34 juju-e4d256-prod-github-runner-207 kernel: [66048.565984] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 23:44:34 juju-e4d256-prod-github-runner-207 kernel: [66048.567198] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 23:44:34 juju-e4d256-prod-github-runner-207 kernel: [66048.568414] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 23:44:34 juju-e4d256-prod-github-runner-207 kernel: [66048.569586] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 23:44:34 juju-e4d256-prod-github-runner-207 kernel: [66048.570852] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 23:44:34 juju-e4d256-prod-github-runner-207 kernel: [66048.571956] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 23:44:34 juju-e4d256-prod-github-runner-207 kernel: [66048.573161] Call Trace: Aug 22 23:44:34 juju-e4d256-prod-github-runner-207 kernel: [66048.574087] Aug 22 23:44:34 juju-e4d256-prod-github-runner-207 kernel: [66048.575052] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:44:34 juju-e4d256-prod-github-runner-207 kernel: [66048.576149] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:44:34 juju-e4d256-prod-github-runner-207 kernel: [66048.577186] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:44:34 juju-e4d256-prod-github-runner-207 kernel: [66048.578292] ? show_regs.part.0+0x23/0x29 Aug 22 23:44:34 juju-e4d256-prod-github-runner-207 kernel: [66048.579318] ? show_regs.cold+0x8/0xd Aug 22 23:44:34 juju-e4d256-prod-github-runner-207 kernel: [66048.580336] ? watchdog_timer_fn+0x1be/0x220 Aug 22 23:44:34 juju-e4d256-prod-github-runner-207 kernel: [66048.581364] ? lockup_detector_update_enable+0x60/0x60 Aug 22 23:44:34 juju-e4d256-prod-github-runner-207 kernel: [66048.582497] ? __hrtimer_run_queues+0x107/0x230 Aug 22 23:44:34 juju-e4d256-prod-github-runner-207 kernel: [66048.583605] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 23:44:34 juju-e4d256-prod-github-runner-207 kernel: [66048.584655] ? hrtimer_interrupt+0x101/0x220 Aug 22 23:44:34 juju-e4d256-prod-github-runner-207 kernel: [66048.585677] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 23:44:34 juju-e4d256-prod-github-runner-207 kernel: [66048.586768] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 23:44:34 juju-e4d256-prod-github-runner-207 kernel: [66048.587848] Aug 22 23:44:34 juju-e4d256-prod-github-runner-207 kernel: [66048.588709] Aug 22 23:44:34 juju-e4d256-prod-github-runner-207 kernel: [66048.589560] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 23:44:34 juju-e4d256-prod-github-runner-207 kernel: [66048.590610] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:44:34 juju-e4d256-prod-github-runner-207 kernel: [66048.591797] ? _raw_spin_lock+0x22/0x30 Aug 22 23:44:34 juju-e4d256-prod-github-runner-207 kernel: [66048.592757] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:44:34 juju-e4d256-prod-github-runner-207 kernel: [66048.593785] direct_page_fault+0x206/0x310 [kvm] Aug 22 23:44:34 juju-e4d256-prod-github-runner-207 kernel: [66048.594833] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 23:44:34 juju-e4d256-prod-github-runner-207 kernel: [66048.595853] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 23:44:34 juju-e4d256-prod-github-runner-207 kernel: [66048.596887] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 23:44:34 juju-e4d256-prod-github-runner-207 kernel: [66048.598284] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 23:44:34 juju-e4d256-prod-github-runner-207 kernel: [66048.599252] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 23:44:34 juju-e4d256-prod-github-runner-207 kernel: [66048.600255] handle_exit+0x98/0x230 [kvm_amd] Aug 22 23:44:34 juju-e4d256-prod-github-runner-207 kernel: [66048.601157] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 23:44:34 juju-e4d256-prod-github-runner-207 kernel: [66048.602083] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 23:44:34 juju-e4d256-prod-github-runner-207 kernel: [66048.603074] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 23:44:34 juju-e4d256-prod-github-runner-207 kernel: [66048.604053] vcpu_run+0x62/0x2c0 [kvm] Aug 22 23:44:34 juju-e4d256-prod-github-runner-207 kernel: [66048.604890] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 23:44:34 juju-e4d256-prod-github-runner-207 kernel: [66048.605706] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 23:44:34 juju-e4d256-prod-github-runner-207 kernel: [66048.606587] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 23:44:34 juju-e4d256-prod-github-runner-207 kernel: [66048.607391] ? __seccomp_filter+0x4a/0x4a0 Aug 22 23:44:34 juju-e4d256-prod-github-runner-207 kernel: [66048.608236] ? __fget_files+0x86/0xc0 Aug 22 23:44:34 juju-e4d256-prod-github-runner-207 kernel: [66048.609022] __x64_sys_ioctl+0x95/0xd0 Aug 22 23:44:34 juju-e4d256-prod-github-runner-207 kernel: [66048.609803] do_syscall_64+0x5c/0xc0 Aug 22 23:44:34 juju-e4d256-prod-github-runner-207 kernel: [66048.610541] ? do_futex+0x162/0x1f0 Aug 22 23:44:34 juju-e4d256-prod-github-runner-207 kernel: [66048.611282] ? __x64_sys_futex+0x78/0x1e0 Aug 22 23:44:34 juju-e4d256-prod-github-runner-207 kernel: [66048.612040] ? __secure_computing+0xa9/0x120 Aug 22 23:44:34 juju-e4d256-prod-github-runner-207 kernel: [66048.612829] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 23:44:34 juju-e4d256-prod-github-runner-207 kernel: [66048.613691] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:44:34 juju-e4d256-prod-github-runner-207 kernel: [66048.614509] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:44:34 juju-e4d256-prod-github-runner-207 kernel: [66048.615336] ? do_syscall_64+0x69/0xc0 Aug 22 23:44:34 juju-e4d256-prod-github-runner-207 kernel: [66048.616058] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:44:34 juju-e4d256-prod-github-runner-207 kernel: [66048.616867] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:44:34 juju-e4d256-prod-github-runner-207 kernel: [66048.617656] ? do_syscall_64+0x69/0xc0 Aug 22 23:44:34 juju-e4d256-prod-github-runner-207 kernel: [66048.618361] ? do_syscall_64+0x69/0xc0 Aug 22 23:44:34 juju-e4d256-prod-github-runner-207 kernel: [66048.619093] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 23:44:34 juju-e4d256-prod-github-runner-207 kernel: [66048.619931] RIP: 0033:0x7faa5d0edaff Aug 22 23:44:34 juju-e4d256-prod-github-runner-207 kernel: [66048.620684] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 23:44:34 juju-e4d256-prod-github-runner-207 kernel: [66048.623036] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 23:44:34 juju-e4d256-prod-github-runner-207 kernel: [66048.624092] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 23:44:34 juju-e4d256-prod-github-runner-207 kernel: [66048.625115] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 23:44:34 juju-e4d256-prod-github-runner-207 kernel: [66048.626138] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 23:44:34 juju-e4d256-prod-github-runner-207 kernel: [66048.627200] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 23:44:34 juju-e4d256-prod-github-runner-207 kernel: [66048.628248] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 23:44:34 juju-e4d256-prod-github-runner-207 kernel: [66048.629286] Aug 22 23:44:47 juju-e4d256-prod-github-runner-207 kernel: [66061.592706] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 23:44:47 juju-e4d256-prod-github-runner-207 kernel: [66061.593670] rcu: 1-....: (16434128 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=7933694 Aug 22 23:44:47 juju-e4d256-prod-github-runner-207 kernel: [66061.594809] (t=16486098 jiffies g=23269 q=57878) Aug 22 23:44:47 juju-e4d256-prod-github-runner-207 kernel: [66061.595614] NMI backtrace for cpu 1 Aug 22 23:44:47 juju-e4d256-prod-github-runner-207 kernel: [66061.596322] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 23:44:47 juju-e4d256-prod-github-runner-207 kernel: [66061.597424] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 23:44:47 juju-e4d256-prod-github-runner-207 kernel: [66061.598504] Call Trace: Aug 22 23:44:47 juju-e4d256-prod-github-runner-207 kernel: [66061.599183] Aug 22 23:44:47 juju-e4d256-prod-github-runner-207 kernel: [66061.599827] show_stack+0x52/0x5c Aug 22 23:44:47 juju-e4d256-prod-github-runner-207 kernel: [66061.600551] dump_stack_lvl+0x4a/0x63 Aug 22 23:44:47 juju-e4d256-prod-github-runner-207 kernel: [66061.601296] dump_stack+0x10/0x16 Aug 22 23:44:47 juju-e4d256-prod-github-runner-207 kernel: [66061.602018] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 23:44:47 juju-e4d256-prod-github-runner-207 kernel: [66061.602824] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 23:44:47 juju-e4d256-prod-github-runner-207 kernel: [66061.603603] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 23:44:47 juju-e4d256-prod-github-runner-207 kernel: [66061.604421] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 23:44:47 juju-e4d256-prod-github-runner-207 kernel: [66061.605303] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 23:44:47 juju-e4d256-prod-github-runner-207 kernel: [66061.606145] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 23:44:47 juju-e4d256-prod-github-runner-207 kernel: [66061.606946] print_cpu_stall.cold+0x2f/0xe2 Aug 22 23:44:47 juju-e4d256-prod-github-runner-207 kernel: [66061.607761] ? timekeeping_update+0xf7/0x150 Aug 22 23:44:47 juju-e4d256-prod-github-runner-207 kernel: [66061.608574] check_cpu_stall+0x109/0x270 Aug 22 23:44:47 juju-e4d256-prod-github-runner-207 kernel: [66061.609345] rcu_sched_clock_irq+0x9a/0x250 Aug 22 23:44:47 juju-e4d256-prod-github-runner-207 kernel: [66061.610144] update_process_times+0x94/0xd0 Aug 22 23:44:47 juju-e4d256-prod-github-runner-207 kernel: [66061.610930] tick_sched_handle+0x29/0x70 Aug 22 23:44:47 juju-e4d256-prod-github-runner-207 kernel: [66061.611905] tick_sched_timer+0x8c/0xc0 Aug 22 23:44:47 juju-e4d256-prod-github-runner-207 kernel: [66061.612667] ? tick_nohz_handler+0xb0/0xb0 Aug 22 23:44:47 juju-e4d256-prod-github-runner-207 kernel: [66061.613432] __hrtimer_run_queues+0x107/0x230 Aug 22 23:44:47 juju-e4d256-prod-github-runner-207 kernel: [66061.614213] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 23:44:47 juju-e4d256-prod-github-runner-207 kernel: [66061.615001] hrtimer_interrupt+0x101/0x220 Aug 22 23:44:47 juju-e4d256-prod-github-runner-207 kernel: [66061.615759] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 23:44:47 juju-e4d256-prod-github-runner-207 kernel: [66061.616572] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 23:44:47 juju-e4d256-prod-github-runner-207 kernel: [66061.617377] Aug 22 23:44:47 juju-e4d256-prod-github-runner-207 kernel: [66061.618014] Aug 22 23:44:47 juju-e4d256-prod-github-runner-207 kernel: [66061.618657] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 23:44:47 juju-e4d256-prod-github-runner-207 kernel: [66061.619473] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:44:47 juju-e4d256-prod-github-runner-207 kernel: [66061.620356] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 23:44:47 juju-e4d256-prod-github-runner-207 kernel: [66061.622588] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 23:44:47 juju-e4d256-prod-github-runner-207 kernel: [66061.623461] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 23:44:47 juju-e4d256-prod-github-runner-207 kernel: [66061.624448] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 23:44:47 juju-e4d256-prod-github-runner-207 kernel: [66061.625442] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 23:44:47 juju-e4d256-prod-github-runner-207 kernel: [66061.626421] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 23:44:47 juju-e4d256-prod-github-runner-207 kernel: [66061.627395] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 23:44:47 juju-e4d256-prod-github-runner-207 kernel: [66061.628353] ? _raw_spin_lock+0x22/0x30 Aug 22 23:44:47 juju-e4d256-prod-github-runner-207 kernel: [66061.629162] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:44:47 juju-e4d256-prod-github-runner-207 kernel: [66061.630010] direct_page_fault+0x206/0x310 [kvm] Aug 22 23:44:47 juju-e4d256-prod-github-runner-207 kernel: [66061.630869] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 23:44:47 juju-e4d256-prod-github-runner-207 kernel: [66061.631700] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 23:44:47 juju-e4d256-prod-github-runner-207 kernel: [66061.632523] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 23:44:47 juju-e4d256-prod-github-runner-207 kernel: [66061.633334] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 23:44:47 juju-e4d256-prod-github-runner-207 kernel: [66061.634126] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 23:44:47 juju-e4d256-prod-github-runner-207 kernel: [66061.634966] handle_exit+0x98/0x230 [kvm_amd] Aug 22 23:44:47 juju-e4d256-prod-github-runner-207 kernel: [66061.635720] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 23:44:47 juju-e4d256-prod-github-runner-207 kernel: [66061.636503] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 23:44:47 juju-e4d256-prod-github-runner-207 kernel: [66061.637462] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 23:44:47 juju-e4d256-prod-github-runner-207 kernel: [66061.638564] vcpu_run+0x62/0x2c0 [kvm] Aug 22 23:44:47 juju-e4d256-prod-github-runner-207 kernel: [66061.639614] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 23:44:47 juju-e4d256-prod-github-runner-207 kernel: [66061.641542] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 23:44:47 juju-e4d256-prod-github-runner-207 kernel: [66061.646654] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 23:44:47 juju-e4d256-prod-github-runner-207 kernel: [66061.650928] ? __seccomp_filter+0x4a/0x4a0 Aug 22 23:44:47 juju-e4d256-prod-github-runner-207 kernel: [66061.652795] ? __fget_files+0x86/0xc0 Aug 22 23:44:47 juju-e4d256-prod-github-runner-207 kernel: [66061.653791] __x64_sys_ioctl+0x95/0xd0 Aug 22 23:44:47 juju-e4d256-prod-github-runner-207 kernel: [66061.654791] do_syscall_64+0x5c/0xc0 Aug 22 23:44:47 juju-e4d256-prod-github-runner-207 kernel: [66061.655719] ? do_futex+0x162/0x1f0 Aug 22 23:44:47 juju-e4d256-prod-github-runner-207 kernel: [66061.656631] ? __x64_sys_futex+0x78/0x1e0 Aug 22 23:44:47 juju-e4d256-prod-github-runner-207 kernel: [66061.657554] ? __secure_computing+0xa9/0x120 Aug 22 23:44:47 juju-e4d256-prod-github-runner-207 kernel: [66061.658379] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 23:44:47 juju-e4d256-prod-github-runner-207 kernel: [66061.659184] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:44:47 juju-e4d256-prod-github-runner-207 kernel: [66061.659935] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:44:47 juju-e4d256-prod-github-runner-207 kernel: [66061.660685] ? do_syscall_64+0x69/0xc0 Aug 22 23:44:47 juju-e4d256-prod-github-runner-207 kernel: [66061.661373] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:44:47 juju-e4d256-prod-github-runner-207 kernel: [66061.662124] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:44:47 juju-e4d256-prod-github-runner-207 kernel: [66061.662884] ? do_syscall_64+0x69/0xc0 Aug 22 23:44:47 juju-e4d256-prod-github-runner-207 kernel: [66061.663580] ? do_syscall_64+0x69/0xc0 Aug 22 23:44:47 juju-e4d256-prod-github-runner-207 kernel: [66061.664265] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 23:44:47 juju-e4d256-prod-github-runner-207 kernel: [66061.665036] RIP: 0033:0x7faa5d0edaff Aug 22 23:44:47 juju-e4d256-prod-github-runner-207 kernel: [66061.665778] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 23:44:47 juju-e4d256-prod-github-runner-207 kernel: [66061.667982] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 23:44:47 juju-e4d256-prod-github-runner-207 kernel: [66061.668962] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 23:44:47 juju-e4d256-prod-github-runner-207 kernel: [66061.669931] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 23:44:47 juju-e4d256-prod-github-runner-207 kernel: [66061.670906] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 23:44:47 juju-e4d256-prod-github-runner-207 kernel: [66061.671865] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 23:44:47 juju-e4d256-prod-github-runner-207 kernel: [66061.672795] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 23:44:47 juju-e4d256-prod-github-runner-207 kernel: [66061.673734] Aug 22 23:45:14 juju-e4d256-prod-github-runner-207 kernel: [66088.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 61441s! [qemu-system-x86:6715] Aug 22 23:45:14 juju-e4d256-prod-github-runner-207 kernel: [66088.543137] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 23:45:14 juju-e4d256-prod-github-runner-207 kernel: [66088.543215] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 23:45:14 juju-e4d256-prod-github-runner-207 kernel: [66088.555935] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 23:45:14 juju-e4d256-prod-github-runner-207 kernel: [66088.557263] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 23:45:14 juju-e4d256-prod-github-runner-207 kernel: [66088.558539] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:45:14 juju-e4d256-prod-github-runner-207 kernel: [66088.559632] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 23:45:14 juju-e4d256-prod-github-runner-207 kernel: [66088.562258] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 23:45:14 juju-e4d256-prod-github-runner-207 kernel: [66088.563329] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 23:45:14 juju-e4d256-prod-github-runner-207 kernel: [66088.564511] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 23:45:14 juju-e4d256-prod-github-runner-207 kernel: [66088.565696] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 23:45:14 juju-e4d256-prod-github-runner-207 kernel: [66088.566900] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 23:45:14 juju-e4d256-prod-github-runner-207 kernel: [66088.568106] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 23:45:14 juju-e4d256-prod-github-runner-207 kernel: [66088.569290] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 23:45:14 juju-e4d256-prod-github-runner-207 kernel: [66088.570618] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 23:45:14 juju-e4d256-prod-github-runner-207 kernel: [66088.571756] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 23:45:14 juju-e4d256-prod-github-runner-207 kernel: [66088.572976] Call Trace: Aug 22 23:45:14 juju-e4d256-prod-github-runner-207 kernel: [66088.573893] Aug 22 23:45:14 juju-e4d256-prod-github-runner-207 kernel: [66088.574802] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:45:14 juju-e4d256-prod-github-runner-207 kernel: [66088.575873] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:45:14 juju-e4d256-prod-github-runner-207 kernel: [66088.576920] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:45:14 juju-e4d256-prod-github-runner-207 kernel: [66088.578012] ? show_regs.part.0+0x23/0x29 Aug 22 23:45:14 juju-e4d256-prod-github-runner-207 kernel: [66088.579029] ? show_regs.cold+0x8/0xd Aug 22 23:45:14 juju-e4d256-prod-github-runner-207 kernel: [66088.580018] ? watchdog_timer_fn+0x1be/0x220 Aug 22 23:45:14 juju-e4d256-prod-github-runner-207 kernel: [66088.581045] ? lockup_detector_update_enable+0x60/0x60 Aug 22 23:45:14 juju-e4d256-prod-github-runner-207 kernel: [66088.582142] ? __hrtimer_run_queues+0x107/0x230 Aug 22 23:45:14 juju-e4d256-prod-github-runner-207 kernel: [66088.583244] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 23:45:14 juju-e4d256-prod-github-runner-207 kernel: [66088.584288] ? hrtimer_interrupt+0x101/0x220 Aug 22 23:45:14 juju-e4d256-prod-github-runner-207 kernel: [66088.585638] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 23:45:14 juju-e4d256-prod-github-runner-207 kernel: [66088.586881] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 23:45:14 juju-e4d256-prod-github-runner-207 kernel: [66088.587942] Aug 22 23:45:14 juju-e4d256-prod-github-runner-207 kernel: [66088.588800] Aug 22 23:45:14 juju-e4d256-prod-github-runner-207 kernel: [66088.589645] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 23:45:14 juju-e4d256-prod-github-runner-207 kernel: [66088.590714] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:45:14 juju-e4d256-prod-github-runner-207 kernel: [66088.591786] ? _raw_spin_lock+0x22/0x30 Aug 22 23:45:14 juju-e4d256-prod-github-runner-207 kernel: [66088.592761] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:45:14 juju-e4d256-prod-github-runner-207 kernel: [66088.593804] direct_page_fault+0x206/0x310 [kvm] Aug 22 23:45:14 juju-e4d256-prod-github-runner-207 kernel: [66088.594852] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 23:45:14 juju-e4d256-prod-github-runner-207 kernel: [66088.595910] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 23:45:14 juju-e4d256-prod-github-runner-207 kernel: [66088.596936] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 23:45:14 juju-e4d256-prod-github-runner-207 kernel: [66088.597945] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 23:45:14 juju-e4d256-prod-github-runner-207 kernel: [66088.598967] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 23:45:14 juju-e4d256-prod-github-runner-207 kernel: [66088.600084] handle_exit+0x98/0x230 [kvm_amd] Aug 22 23:45:14 juju-e4d256-prod-github-runner-207 kernel: [66088.601071] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 23:45:14 juju-e4d256-prod-github-runner-207 kernel: [66088.602046] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 23:45:14 juju-e4d256-prod-github-runner-207 kernel: [66088.603011] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 23:45:14 juju-e4d256-prod-github-runner-207 kernel: [66088.603929] vcpu_run+0x62/0x2c0 [kvm] Aug 22 23:45:14 juju-e4d256-prod-github-runner-207 kernel: [66088.604749] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 23:45:14 juju-e4d256-prod-github-runner-207 kernel: [66088.605566] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 23:45:14 juju-e4d256-prod-github-runner-207 kernel: [66088.606458] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 23:45:14 juju-e4d256-prod-github-runner-207 kernel: [66088.607269] ? __seccomp_filter+0x4a/0x4a0 Aug 22 23:45:14 juju-e4d256-prod-github-runner-207 kernel: [66088.608039] ? __fget_files+0x86/0xc0 Aug 22 23:45:14 juju-e4d256-prod-github-runner-207 kernel: [66088.608754] __x64_sys_ioctl+0x95/0xd0 Aug 22 23:45:14 juju-e4d256-prod-github-runner-207 kernel: [66088.609459] do_syscall_64+0x5c/0xc0 Aug 22 23:45:14 juju-e4d256-prod-github-runner-207 kernel: [66088.610152] ? do_futex+0x162/0x1f0 Aug 22 23:45:14 juju-e4d256-prod-github-runner-207 kernel: [66088.610812] ? __x64_sys_futex+0x78/0x1e0 Aug 22 23:45:14 juju-e4d256-prod-github-runner-207 kernel: [66088.611497] ? __secure_computing+0xa9/0x120 Aug 22 23:45:14 juju-e4d256-prod-github-runner-207 kernel: [66088.612204] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 23:45:14 juju-e4d256-prod-github-runner-207 kernel: [66088.613052] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:45:14 juju-e4d256-prod-github-runner-207 kernel: [66088.613923] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:45:14 juju-e4d256-prod-github-runner-207 kernel: [66088.614673] ? do_syscall_64+0x69/0xc0 Aug 22 23:45:14 juju-e4d256-prod-github-runner-207 kernel: [66088.615326] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:45:14 juju-e4d256-prod-github-runner-207 kernel: [66088.616038] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:45:14 juju-e4d256-prod-github-runner-207 kernel: [66088.616749] ? do_syscall_64+0x69/0xc0 Aug 22 23:45:14 juju-e4d256-prod-github-runner-207 kernel: [66088.617381] ? do_syscall_64+0x69/0xc0 Aug 22 23:45:14 juju-e4d256-prod-github-runner-207 kernel: [66088.618017] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 23:45:14 juju-e4d256-prod-github-runner-207 kernel: [66088.618748] RIP: 0033:0x7faa5d0edaff Aug 22 23:45:14 juju-e4d256-prod-github-runner-207 kernel: [66088.619387] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 23:45:14 juju-e4d256-prod-github-runner-207 kernel: [66088.621435] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 23:45:14 juju-e4d256-prod-github-runner-207 kernel: [66088.622415] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 23:45:14 juju-e4d256-prod-github-runner-207 kernel: [66088.623339] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 23:45:14 juju-e4d256-prod-github-runner-207 kernel: [66088.624291] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 23:45:14 juju-e4d256-prod-github-runner-207 kernel: [66088.625238] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 23:45:14 juju-e4d256-prod-github-runner-207 kernel: [66088.626158] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 23:45:14 juju-e4d256-prod-github-runner-207 kernel: [66088.627070] Aug 22 23:45:42 juju-e4d256-prod-github-runner-207 kernel: [66116.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 61467s! [qemu-system-x86:6715] Aug 22 23:45:42 juju-e4d256-prod-github-runner-207 kernel: [66116.543217] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 23:45:42 juju-e4d256-prod-github-runner-207 kernel: [66116.543474] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 23:45:42 juju-e4d256-prod-github-runner-207 kernel: [66116.556216] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 23:45:42 juju-e4d256-prod-github-runner-207 kernel: [66116.557510] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 23:45:42 juju-e4d256-prod-github-runner-207 kernel: [66116.558894] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:45:42 juju-e4d256-prod-github-runner-207 kernel: [66116.559960] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 23:45:42 juju-e4d256-prod-github-runner-207 kernel: [66116.562658] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 23:45:42 juju-e4d256-prod-github-runner-207 kernel: [66116.563740] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 23:45:42 juju-e4d256-prod-github-runner-207 kernel: [66116.564944] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 23:45:42 juju-e4d256-prod-github-runner-207 kernel: [66116.566195] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 23:45:42 juju-e4d256-prod-github-runner-207 kernel: [66116.567396] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 23:45:42 juju-e4d256-prod-github-runner-207 kernel: [66116.568571] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 23:45:42 juju-e4d256-prod-github-runner-207 kernel: [66116.569782] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 23:45:42 juju-e4d256-prod-github-runner-207 kernel: [66116.571099] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 23:45:42 juju-e4d256-prod-github-runner-207 kernel: [66116.572253] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 23:45:42 juju-e4d256-prod-github-runner-207 kernel: [66116.573473] Call Trace: Aug 22 23:45:42 juju-e4d256-prod-github-runner-207 kernel: [66116.574471] Aug 22 23:45:42 juju-e4d256-prod-github-runner-207 kernel: [66116.575370] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:45:42 juju-e4d256-prod-github-runner-207 kernel: [66116.576407] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:45:42 juju-e4d256-prod-github-runner-207 kernel: [66116.577496] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:45:42 juju-e4d256-prod-github-runner-207 kernel: [66116.578639] ? show_regs.part.0+0x23/0x29 Aug 22 23:45:42 juju-e4d256-prod-github-runner-207 kernel: [66116.579652] ? show_regs.cold+0x8/0xd Aug 22 23:45:42 juju-e4d256-prod-github-runner-207 kernel: [66116.580714] ? watchdog_timer_fn+0x1be/0x220 Aug 22 23:45:42 juju-e4d256-prod-github-runner-207 kernel: [66116.581788] ? lockup_detector_update_enable+0x60/0x60 Aug 22 23:45:42 juju-e4d256-prod-github-runner-207 kernel: [66116.582877] ? __hrtimer_run_queues+0x107/0x230 Aug 22 23:45:42 juju-e4d256-prod-github-runner-207 kernel: [66116.583925] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 23:45:42 juju-e4d256-prod-github-runner-207 kernel: [66116.585033] ? hrtimer_interrupt+0x101/0x220 Aug 22 23:45:42 juju-e4d256-prod-github-runner-207 kernel: [66116.586120] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 23:45:42 juju-e4d256-prod-github-runner-207 kernel: [66116.587208] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 23:45:42 juju-e4d256-prod-github-runner-207 kernel: [66116.588273] Aug 22 23:45:42 juju-e4d256-prod-github-runner-207 kernel: [66116.589175] Aug 22 23:45:42 juju-e4d256-prod-github-runner-207 kernel: [66116.590036] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 23:45:42 juju-e4d256-prod-github-runner-207 kernel: [66116.591092] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:45:42 juju-e4d256-prod-github-runner-207 kernel: [66116.592147] ? _raw_spin_lock+0x22/0x30 Aug 22 23:45:42 juju-e4d256-prod-github-runner-207 kernel: [66116.593100] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:45:42 juju-e4d256-prod-github-runner-207 kernel: [66116.594135] direct_page_fault+0x206/0x310 [kvm] Aug 22 23:45:42 juju-e4d256-prod-github-runner-207 kernel: [66116.595170] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 23:45:42 juju-e4d256-prod-github-runner-207 kernel: [66116.596179] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 23:45:42 juju-e4d256-prod-github-runner-207 kernel: [66116.597185] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 23:45:42 juju-e4d256-prod-github-runner-207 kernel: [66116.598206] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 23:45:42 juju-e4d256-prod-github-runner-207 kernel: [66116.599155] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 23:45:42 juju-e4d256-prod-github-runner-207 kernel: [66116.600133] handle_exit+0x98/0x230 [kvm_amd] Aug 22 23:45:42 juju-e4d256-prod-github-runner-207 kernel: [66116.601032] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 23:45:42 juju-e4d256-prod-github-runner-207 kernel: [66116.601954] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 23:45:42 juju-e4d256-prod-github-runner-207 kernel: [66116.602881] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 23:45:42 juju-e4d256-prod-github-runner-207 kernel: [66116.603790] vcpu_run+0x62/0x2c0 [kvm] Aug 22 23:45:42 juju-e4d256-prod-github-runner-207 kernel: [66116.604610] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 23:45:42 juju-e4d256-prod-github-runner-207 kernel: [66116.605424] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 23:45:42 juju-e4d256-prod-github-runner-207 kernel: [66116.606288] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 23:45:42 juju-e4d256-prod-github-runner-207 kernel: [66116.607090] ? __seccomp_filter+0x4a/0x4a0 Aug 22 23:45:42 juju-e4d256-prod-github-runner-207 kernel: [66116.607833] ? __fget_files+0x86/0xc0 Aug 22 23:45:42 juju-e4d256-prod-github-runner-207 kernel: [66116.608537] __x64_sys_ioctl+0x95/0xd0 Aug 22 23:45:42 juju-e4d256-prod-github-runner-207 kernel: [66116.609231] do_syscall_64+0x5c/0xc0 Aug 22 23:45:42 juju-e4d256-prod-github-runner-207 kernel: [66116.609910] ? do_futex+0x162/0x1f0 Aug 22 23:45:42 juju-e4d256-prod-github-runner-207 kernel: [66116.610568] ? __x64_sys_futex+0x78/0x1e0 Aug 22 23:45:42 juju-e4d256-prod-github-runner-207 kernel: [66116.611406] ? __secure_computing+0xa9/0x120 Aug 22 23:45:42 juju-e4d256-prod-github-runner-207 kernel: [66116.612140] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 23:45:42 juju-e4d256-prod-github-runner-207 kernel: [66116.612905] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:45:42 juju-e4d256-prod-github-runner-207 kernel: [66116.613626] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:45:42 juju-e4d256-prod-github-runner-207 kernel: [66116.614357] ? do_syscall_64+0x69/0xc0 Aug 22 23:45:42 juju-e4d256-prod-github-runner-207 kernel: [66116.615004] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:45:42 juju-e4d256-prod-github-runner-207 kernel: [66116.615714] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:45:42 juju-e4d256-prod-github-runner-207 kernel: [66116.616409] ? do_syscall_64+0x69/0xc0 Aug 22 23:45:42 juju-e4d256-prod-github-runner-207 kernel: [66116.617033] ? do_syscall_64+0x69/0xc0 Aug 22 23:45:42 juju-e4d256-prod-github-runner-207 kernel: [66116.617654] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 23:45:42 juju-e4d256-prod-github-runner-207 kernel: [66116.618369] RIP: 0033:0x7faa5d0edaff Aug 22 23:45:42 juju-e4d256-prod-github-runner-207 kernel: [66116.619023] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 23:45:42 juju-e4d256-prod-github-runner-207 kernel: [66116.621013] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 23:45:42 juju-e4d256-prod-github-runner-207 kernel: [66116.621929] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 23:45:42 juju-e4d256-prod-github-runner-207 kernel: [66116.622823] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 23:45:42 juju-e4d256-prod-github-runner-207 kernel: [66116.623712] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 23:45:42 juju-e4d256-prod-github-runner-207 kernel: [66116.624600] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 23:45:42 juju-e4d256-prod-github-runner-207 kernel: [66116.625490] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 23:45:42 juju-e4d256-prod-github-runner-207 kernel: [66116.626394] Aug 22 23:46:10 juju-e4d256-prod-github-runner-207 kernel: [66144.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 61493s! [qemu-system-x86:6715] Aug 22 23:46:10 juju-e4d256-prod-github-runner-207 kernel: [66144.543834] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 23:46:10 juju-e4d256-prod-github-runner-207 kernel: [66144.544034] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 23:46:10 juju-e4d256-prod-github-runner-207 kernel: [66144.556400] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 23:46:10 juju-e4d256-prod-github-runner-207 kernel: [66144.557698] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 23:46:10 juju-e4d256-prod-github-runner-207 kernel: [66144.558914] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:46:10 juju-e4d256-prod-github-runner-207 kernel: [66144.559995] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 23:46:10 juju-e4d256-prod-github-runner-207 kernel: [66144.562620] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 23:46:10 juju-e4d256-prod-github-runner-207 kernel: [66144.563668] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 23:46:10 juju-e4d256-prod-github-runner-207 kernel: [66144.564833] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 23:46:10 juju-e4d256-prod-github-runner-207 kernel: [66144.566067] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 23:46:10 juju-e4d256-prod-github-runner-207 kernel: [66144.567244] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 23:46:10 juju-e4d256-prod-github-runner-207 kernel: [66144.568410] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 23:46:10 juju-e4d256-prod-github-runner-207 kernel: [66144.569630] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 23:46:10 juju-e4d256-prod-github-runner-207 kernel: [66144.570861] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 23:46:10 juju-e4d256-prod-github-runner-207 kernel: [66144.571960] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 23:46:10 juju-e4d256-prod-github-runner-207 kernel: [66144.573165] Call Trace: Aug 22 23:46:10 juju-e4d256-prod-github-runner-207 kernel: [66144.574109] Aug 22 23:46:10 juju-e4d256-prod-github-runner-207 kernel: [66144.575003] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:46:10 juju-e4d256-prod-github-runner-207 kernel: [66144.576032] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:46:10 juju-e4d256-prod-github-runner-207 kernel: [66144.577051] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:46:10 juju-e4d256-prod-github-runner-207 kernel: [66144.578144] ? show_regs.part.0+0x23/0x29 Aug 22 23:46:10 juju-e4d256-prod-github-runner-207 kernel: [66144.579141] ? show_regs.cold+0x8/0xd Aug 22 23:46:10 juju-e4d256-prod-github-runner-207 kernel: [66144.580111] ? watchdog_timer_fn+0x1be/0x220 Aug 22 23:46:10 juju-e4d256-prod-github-runner-207 kernel: [66144.581122] ? lockup_detector_update_enable+0x60/0x60 Aug 22 23:46:10 juju-e4d256-prod-github-runner-207 kernel: [66144.582203] ? __hrtimer_run_queues+0x107/0x230 Aug 22 23:46:10 juju-e4d256-prod-github-runner-207 kernel: [66144.583230] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 23:46:10 juju-e4d256-prod-github-runner-207 kernel: [66144.584265] ? hrtimer_interrupt+0x101/0x220 Aug 22 23:46:10 juju-e4d256-prod-github-runner-207 kernel: [66144.585281] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 23:46:10 juju-e4d256-prod-github-runner-207 kernel: [66144.586374] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 23:46:10 juju-e4d256-prod-github-runner-207 kernel: [66144.587419] Aug 22 23:46:10 juju-e4d256-prod-github-runner-207 kernel: [66144.588270] Aug 22 23:46:10 juju-e4d256-prod-github-runner-207 kernel: [66144.589133] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 23:46:10 juju-e4d256-prod-github-runner-207 kernel: [66144.590228] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:46:10 juju-e4d256-prod-github-runner-207 kernel: [66144.591272] ? _raw_spin_lock+0x22/0x30 Aug 22 23:46:10 juju-e4d256-prod-github-runner-207 kernel: [66144.592221] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:46:10 juju-e4d256-prod-github-runner-207 kernel: [66144.593243] direct_page_fault+0x206/0x310 [kvm] Aug 22 23:46:10 juju-e4d256-prod-github-runner-207 kernel: [66144.594292] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 23:46:10 juju-e4d256-prod-github-runner-207 kernel: [66144.595325] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 23:46:10 juju-e4d256-prod-github-runner-207 kernel: [66144.596467] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 23:46:10 juju-e4d256-prod-github-runner-207 kernel: [66144.597494] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 23:46:10 juju-e4d256-prod-github-runner-207 kernel: [66144.598444] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 23:46:10 juju-e4d256-prod-github-runner-207 kernel: [66144.599427] handle_exit+0x98/0x230 [kvm_amd] Aug 22 23:46:10 juju-e4d256-prod-github-runner-207 kernel: [66144.600321] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 23:46:10 juju-e4d256-prod-github-runner-207 kernel: [66144.601236] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 23:46:10 juju-e4d256-prod-github-runner-207 kernel: [66144.602191] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 23:46:10 juju-e4d256-prod-github-runner-207 kernel: [66144.603107] vcpu_run+0x62/0x2c0 [kvm] Aug 22 23:46:10 juju-e4d256-prod-github-runner-207 kernel: [66144.603919] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 23:46:10 juju-e4d256-prod-github-runner-207 kernel: [66144.604728] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 23:46:10 juju-e4d256-prod-github-runner-207 kernel: [66144.605601] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 23:46:10 juju-e4d256-prod-github-runner-207 kernel: [66144.606404] ? __seccomp_filter+0x4a/0x4a0 Aug 22 23:46:10 juju-e4d256-prod-github-runner-207 kernel: [66144.607146] ? __fget_files+0x86/0xc0 Aug 22 23:46:10 juju-e4d256-prod-github-runner-207 kernel: [66144.607889] __x64_sys_ioctl+0x95/0xd0 Aug 22 23:46:10 juju-e4d256-prod-github-runner-207 kernel: [66144.608588] do_syscall_64+0x5c/0xc0 Aug 22 23:46:10 juju-e4d256-prod-github-runner-207 kernel: [66144.609254] ? do_futex+0x162/0x1f0 Aug 22 23:46:10 juju-e4d256-prod-github-runner-207 kernel: [66144.609926] ? __x64_sys_futex+0x78/0x1e0 Aug 22 23:46:10 juju-e4d256-prod-github-runner-207 kernel: [66144.610612] ? __secure_computing+0xa9/0x120 Aug 22 23:46:10 juju-e4d256-prod-github-runner-207 kernel: [66144.611329] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 23:46:10 juju-e4d256-prod-github-runner-207 kernel: [66144.612107] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:46:10 juju-e4d256-prod-github-runner-207 kernel: [66144.612829] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:46:10 juju-e4d256-prod-github-runner-207 kernel: [66144.613569] ? do_syscall_64+0x69/0xc0 Aug 22 23:46:10 juju-e4d256-prod-github-runner-207 kernel: [66144.614214] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:46:10 juju-e4d256-prod-github-runner-207 kernel: [66144.614913] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:46:10 juju-e4d256-prod-github-runner-207 kernel: [66144.615611] ? do_syscall_64+0x69/0xc0 Aug 22 23:46:10 juju-e4d256-prod-github-runner-207 kernel: [66144.616252] ? do_syscall_64+0x69/0xc0 Aug 22 23:46:10 juju-e4d256-prod-github-runner-207 kernel: [66144.616870] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 23:46:10 juju-e4d256-prod-github-runner-207 kernel: [66144.617602] RIP: 0033:0x7faa5d0edaff Aug 22 23:46:10 juju-e4d256-prod-github-runner-207 kernel: [66144.618229] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 23:46:10 juju-e4d256-prod-github-runner-207 kernel: [66144.620204] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 23:46:10 juju-e4d256-prod-github-runner-207 kernel: [66144.621112] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 23:46:10 juju-e4d256-prod-github-runner-207 kernel: [66144.622018] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 23:46:10 juju-e4d256-prod-github-runner-207 kernel: [66144.622905] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 23:46:10 juju-e4d256-prod-github-runner-207 kernel: [66144.623788] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 23:46:10 juju-e4d256-prod-github-runner-207 kernel: [66144.624673] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 23:46:10 juju-e4d256-prod-github-runner-207 kernel: [66144.625632] Aug 22 23:46:38 juju-e4d256-prod-github-runner-207 kernel: [66172.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 61519s! [qemu-system-x86:6715] Aug 22 23:46:38 juju-e4d256-prod-github-runner-207 kernel: [66172.543125] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 23:46:38 juju-e4d256-prod-github-runner-207 kernel: [66172.543202] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 23:46:38 juju-e4d256-prod-github-runner-207 kernel: [66172.555571] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 23:46:38 juju-e4d256-prod-github-runner-207 kernel: [66172.556889] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 23:46:38 juju-e4d256-prod-github-runner-207 kernel: [66172.558160] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:46:38 juju-e4d256-prod-github-runner-207 kernel: [66172.559288] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 23:46:38 juju-e4d256-prod-github-runner-207 kernel: [66172.561912] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 23:46:38 juju-e4d256-prod-github-runner-207 kernel: [66172.562962] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 23:46:38 juju-e4d256-prod-github-runner-207 kernel: [66172.564125] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 23:46:38 juju-e4d256-prod-github-runner-207 kernel: [66172.565309] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 23:46:38 juju-e4d256-prod-github-runner-207 kernel: [66172.566480] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 23:46:38 juju-e4d256-prod-github-runner-207 kernel: [66172.567683] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 23:46:38 juju-e4d256-prod-github-runner-207 kernel: [66172.568866] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 23:46:38 juju-e4d256-prod-github-runner-207 kernel: [66172.570119] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 23:46:38 juju-e4d256-prod-github-runner-207 kernel: [66172.571251] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 23:46:38 juju-e4d256-prod-github-runner-207 kernel: [66172.572465] Call Trace: Aug 22 23:46:38 juju-e4d256-prod-github-runner-207 kernel: [66172.573399] Aug 22 23:46:38 juju-e4d256-prod-github-runner-207 kernel: [66172.574283] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:46:38 juju-e4d256-prod-github-runner-207 kernel: [66172.575318] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:46:38 juju-e4d256-prod-github-runner-207 kernel: [66172.576345] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:46:38 juju-e4d256-prod-github-runner-207 kernel: [66172.577463] ? show_regs.part.0+0x23/0x29 Aug 22 23:46:38 juju-e4d256-prod-github-runner-207 kernel: [66172.578475] ? show_regs.cold+0x8/0xd Aug 22 23:46:38 juju-e4d256-prod-github-runner-207 kernel: [66172.579445] ? watchdog_timer_fn+0x1be/0x220 Aug 22 23:46:38 juju-e4d256-prod-github-runner-207 kernel: [66172.580470] ? lockup_detector_update_enable+0x60/0x60 Aug 22 23:46:38 juju-e4d256-prod-github-runner-207 kernel: [66172.581580] ? __hrtimer_run_queues+0x107/0x230 Aug 22 23:46:38 juju-e4d256-prod-github-runner-207 kernel: [66172.582628] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 23:46:38 juju-e4d256-prod-github-runner-207 kernel: [66172.583681] ? hrtimer_interrupt+0x101/0x220 Aug 22 23:46:38 juju-e4d256-prod-github-runner-207 kernel: [66172.584733] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 23:46:38 juju-e4d256-prod-github-runner-207 kernel: [66172.585986] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 23:46:38 juju-e4d256-prod-github-runner-207 kernel: [66172.587062] Aug 22 23:46:38 juju-e4d256-prod-github-runner-207 kernel: [66172.587963] Aug 22 23:46:38 juju-e4d256-prod-github-runner-207 kernel: [66172.588880] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 23:46:38 juju-e4d256-prod-github-runner-207 kernel: [66172.589955] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:46:38 juju-e4d256-prod-github-runner-207 kernel: [66172.590993] ? _raw_spin_lock+0x22/0x30 Aug 22 23:46:38 juju-e4d256-prod-github-runner-207 kernel: [66172.591955] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:46:38 juju-e4d256-prod-github-runner-207 kernel: [66172.593119] direct_page_fault+0x206/0x310 [kvm] Aug 22 23:46:38 juju-e4d256-prod-github-runner-207 kernel: [66172.594169] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 23:46:38 juju-e4d256-prod-github-runner-207 kernel: [66172.595179] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 23:46:38 juju-e4d256-prod-github-runner-207 kernel: [66172.596179] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 23:46:38 juju-e4d256-prod-github-runner-207 kernel: [66172.597192] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 23:46:38 juju-e4d256-prod-github-runner-207 kernel: [66172.598245] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 23:46:38 juju-e4d256-prod-github-runner-207 kernel: [66172.599256] handle_exit+0x98/0x230 [kvm_amd] Aug 22 23:46:38 juju-e4d256-prod-github-runner-207 kernel: [66172.600148] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 23:46:38 juju-e4d256-prod-github-runner-207 kernel: [66172.601059] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 23:46:38 juju-e4d256-prod-github-runner-207 kernel: [66172.602003] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 23:46:38 juju-e4d256-prod-github-runner-207 kernel: [66172.602928] vcpu_run+0x62/0x2c0 [kvm] Aug 22 23:46:38 juju-e4d256-prod-github-runner-207 kernel: [66172.603795] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 23:46:38 juju-e4d256-prod-github-runner-207 kernel: [66172.604651] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 23:46:38 juju-e4d256-prod-github-runner-207 kernel: [66172.605533] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 23:46:38 juju-e4d256-prod-github-runner-207 kernel: [66172.606333] ? __seccomp_filter+0x4a/0x4a0 Aug 22 23:46:38 juju-e4d256-prod-github-runner-207 kernel: [66172.607095] ? __fget_files+0x86/0xc0 Aug 22 23:46:38 juju-e4d256-prod-github-runner-207 kernel: [66172.607825] __x64_sys_ioctl+0x95/0xd0 Aug 22 23:46:38 juju-e4d256-prod-github-runner-207 kernel: [66172.608562] do_syscall_64+0x5c/0xc0 Aug 22 23:46:38 juju-e4d256-prod-github-runner-207 kernel: [66172.609253] ? do_futex+0x162/0x1f0 Aug 22 23:46:38 juju-e4d256-prod-github-runner-207 kernel: [66172.609901] ? __x64_sys_futex+0x78/0x1e0 Aug 22 23:46:38 juju-e4d256-prod-github-runner-207 kernel: [66172.610571] ? __secure_computing+0xa9/0x120 Aug 22 23:46:38 juju-e4d256-prod-github-runner-207 kernel: [66172.611279] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 23:46:38 juju-e4d256-prod-github-runner-207 kernel: [66172.612055] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:46:38 juju-e4d256-prod-github-runner-207 kernel: [66172.612794] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:46:38 juju-e4d256-prod-github-runner-207 kernel: [66172.613538] ? do_syscall_64+0x69/0xc0 Aug 22 23:46:38 juju-e4d256-prod-github-runner-207 kernel: [66172.614181] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:46:38 juju-e4d256-prod-github-runner-207 kernel: [66172.614891] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:46:38 juju-e4d256-prod-github-runner-207 kernel: [66172.615591] ? do_syscall_64+0x69/0xc0 Aug 22 23:46:38 juju-e4d256-prod-github-runner-207 kernel: [66172.616242] ? do_syscall_64+0x69/0xc0 Aug 22 23:46:38 juju-e4d256-prod-github-runner-207 kernel: [66172.616877] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 23:46:38 juju-e4d256-prod-github-runner-207 kernel: [66172.617603] RIP: 0033:0x7faa5d0edaff Aug 22 23:46:38 juju-e4d256-prod-github-runner-207 kernel: [66172.618227] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 23:46:38 juju-e4d256-prod-github-runner-207 kernel: [66172.620228] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 23:46:38 juju-e4d256-prod-github-runner-207 kernel: [66172.621166] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 23:46:38 juju-e4d256-prod-github-runner-207 kernel: [66172.622052] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 23:46:38 juju-e4d256-prod-github-runner-207 kernel: [66172.622934] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 23:46:38 juju-e4d256-prod-github-runner-207 kernel: [66172.623822] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 23:46:38 juju-e4d256-prod-github-runner-207 kernel: [66172.624712] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 23:46:38 juju-e4d256-prod-github-runner-207 kernel: [66172.625615] Aug 22 23:47:06 juju-e4d256-prod-github-runner-207 kernel: [66200.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 61546s! [qemu-system-x86:6715] Aug 22 23:47:06 juju-e4d256-prod-github-runner-207 kernel: [66200.543130] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 23:47:06 juju-e4d256-prod-github-runner-207 kernel: [66200.543207] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 23:47:06 juju-e4d256-prod-github-runner-207 kernel: [66200.555842] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 23:47:06 juju-e4d256-prod-github-runner-207 kernel: [66200.557178] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 23:47:06 juju-e4d256-prod-github-runner-207 kernel: [66200.558428] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:47:06 juju-e4d256-prod-github-runner-207 kernel: [66200.559530] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 23:47:06 juju-e4d256-prod-github-runner-207 kernel: [66200.562162] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 23:47:06 juju-e4d256-prod-github-runner-207 kernel: [66200.563247] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 23:47:06 juju-e4d256-prod-github-runner-207 kernel: [66200.564435] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 23:47:06 juju-e4d256-prod-github-runner-207 kernel: [66200.565638] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 23:47:06 juju-e4d256-prod-github-runner-207 kernel: [66200.566824] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 23:47:06 juju-e4d256-prod-github-runner-207 kernel: [66200.568097] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 23:47:06 juju-e4d256-prod-github-runner-207 kernel: [66200.569307] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 23:47:06 juju-e4d256-prod-github-runner-207 kernel: [66200.570569] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 23:47:06 juju-e4d256-prod-github-runner-207 kernel: [66200.571712] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 23:47:06 juju-e4d256-prod-github-runner-207 kernel: [66200.572999] Call Trace: Aug 22 23:47:06 juju-e4d256-prod-github-runner-207 kernel: [66200.573939] Aug 22 23:47:06 juju-e4d256-prod-github-runner-207 kernel: [66200.574849] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:47:06 juju-e4d256-prod-github-runner-207 kernel: [66200.575921] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:47:06 juju-e4d256-prod-github-runner-207 kernel: [66200.576993] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:47:06 juju-e4d256-prod-github-runner-207 kernel: [66200.578085] ? show_regs.part.0+0x23/0x29 Aug 22 23:47:06 juju-e4d256-prod-github-runner-207 kernel: [66200.579103] ? show_regs.cold+0x8/0xd Aug 22 23:47:06 juju-e4d256-prod-github-runner-207 kernel: [66200.580088] ? watchdog_timer_fn+0x1be/0x220 Aug 22 23:47:06 juju-e4d256-prod-github-runner-207 kernel: [66200.581137] ? lockup_detector_update_enable+0x60/0x60 Aug 22 23:47:06 juju-e4d256-prod-github-runner-207 kernel: [66200.582223] ? __hrtimer_run_queues+0x107/0x230 Aug 22 23:47:06 juju-e4d256-prod-github-runner-207 kernel: [66200.583307] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 23:47:06 juju-e4d256-prod-github-runner-207 kernel: [66200.584379] ? hrtimer_interrupt+0x101/0x220 Aug 22 23:47:06 juju-e4d256-prod-github-runner-207 kernel: [66200.585434] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 23:47:06 juju-e4d256-prod-github-runner-207 kernel: [66200.586524] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 23:47:06 juju-e4d256-prod-github-runner-207 kernel: [66200.587582] Aug 22 23:47:06 juju-e4d256-prod-github-runner-207 kernel: [66200.588446] Aug 22 23:47:06 juju-e4d256-prod-github-runner-207 kernel: [66200.589308] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 23:47:06 juju-e4d256-prod-github-runner-207 kernel: [66200.590361] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:47:06 juju-e4d256-prod-github-runner-207 kernel: [66200.591420] ? _raw_spin_lock+0x22/0x30 Aug 22 23:47:06 juju-e4d256-prod-github-runner-207 kernel: [66200.592378] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:47:06 juju-e4d256-prod-github-runner-207 kernel: [66200.593503] direct_page_fault+0x206/0x310 [kvm] Aug 22 23:47:06 juju-e4d256-prod-github-runner-207 kernel: [66200.594763] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 23:47:06 juju-e4d256-prod-github-runner-207 kernel: [66200.596005] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 23:47:06 juju-e4d256-prod-github-runner-207 kernel: [66200.597161] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 23:47:06 juju-e4d256-prod-github-runner-207 kernel: [66200.598286] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 23:47:06 juju-e4d256-prod-github-runner-207 kernel: [66200.599253] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 23:47:06 juju-e4d256-prod-github-runner-207 kernel: [66200.600265] handle_exit+0x98/0x230 [kvm_amd] Aug 22 23:47:06 juju-e4d256-prod-github-runner-207 kernel: [66200.601224] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 23:47:06 juju-e4d256-prod-github-runner-207 kernel: [66200.602158] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 23:47:06 juju-e4d256-prod-github-runner-207 kernel: [66200.603107] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 23:47:06 juju-e4d256-prod-github-runner-207 kernel: [66200.604045] vcpu_run+0x62/0x2c0 [kvm] Aug 22 23:47:06 juju-e4d256-prod-github-runner-207 kernel: [66200.604903] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 23:47:06 juju-e4d256-prod-github-runner-207 kernel: [66200.605739] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 23:47:06 juju-e4d256-prod-github-runner-207 kernel: [66200.606617] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 23:47:06 juju-e4d256-prod-github-runner-207 kernel: [66200.607433] ? __seccomp_filter+0x4a/0x4a0 Aug 22 23:47:06 juju-e4d256-prod-github-runner-207 kernel: [66200.608206] ? __fget_files+0x86/0xc0 Aug 22 23:47:06 juju-e4d256-prod-github-runner-207 kernel: [66200.608957] __x64_sys_ioctl+0x95/0xd0 Aug 22 23:47:06 juju-e4d256-prod-github-runner-207 kernel: [66200.609670] do_syscall_64+0x5c/0xc0 Aug 22 23:47:06 juju-e4d256-prod-github-runner-207 kernel: [66200.610353] ? do_futex+0x162/0x1f0 Aug 22 23:47:06 juju-e4d256-prod-github-runner-207 kernel: [66200.611016] ? __x64_sys_futex+0x78/0x1e0 Aug 22 23:47:06 juju-e4d256-prod-github-runner-207 kernel: [66200.611718] ? __secure_computing+0xa9/0x120 Aug 22 23:47:06 juju-e4d256-prod-github-runner-207 kernel: [66200.612429] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 23:47:06 juju-e4d256-prod-github-runner-207 kernel: [66200.613228] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:47:06 juju-e4d256-prod-github-runner-207 kernel: [66200.613971] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:47:06 juju-e4d256-prod-github-runner-207 kernel: [66200.614714] ? do_syscall_64+0x69/0xc0 Aug 22 23:47:06 juju-e4d256-prod-github-runner-207 kernel: [66200.615374] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:47:06 juju-e4d256-prod-github-runner-207 kernel: [66200.616102] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:47:06 juju-e4d256-prod-github-runner-207 kernel: [66200.616832] ? do_syscall_64+0x69/0xc0 Aug 22 23:47:06 juju-e4d256-prod-github-runner-207 kernel: [66200.617474] ? do_syscall_64+0x69/0xc0 Aug 22 23:47:06 juju-e4d256-prod-github-runner-207 kernel: [66200.618113] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 23:47:06 juju-e4d256-prod-github-runner-207 kernel: [66200.618837] RIP: 0033:0x7faa5d0edaff Aug 22 23:47:06 juju-e4d256-prod-github-runner-207 kernel: [66200.619480] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 23:47:06 juju-e4d256-prod-github-runner-207 kernel: [66200.621571] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 23:47:06 juju-e4d256-prod-github-runner-207 kernel: [66200.622508] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 23:47:06 juju-e4d256-prod-github-runner-207 kernel: [66200.623429] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 23:47:06 juju-e4d256-prod-github-runner-207 kernel: [66200.624344] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 23:47:06 juju-e4d256-prod-github-runner-207 kernel: [66200.625276] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 23:47:06 juju-e4d256-prod-github-runner-207 kernel: [66200.626191] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 23:47:06 juju-e4d256-prod-github-runner-207 kernel: [66200.627114] Aug 22 23:47:34 juju-e4d256-prod-github-runner-207 kernel: [66228.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 61572s! [qemu-system-x86:6715] Aug 22 23:47:34 juju-e4d256-prod-github-runner-207 kernel: [66228.543904] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 23:47:34 juju-e4d256-prod-github-runner-207 kernel: [66228.544196] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 23:47:34 juju-e4d256-prod-github-runner-207 kernel: [66228.556898] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 23:47:34 juju-e4d256-prod-github-runner-207 kernel: [66228.558182] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 23:47:34 juju-e4d256-prod-github-runner-207 kernel: [66228.559407] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:47:34 juju-e4d256-prod-github-runner-207 kernel: [66228.560490] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 23:47:34 juju-e4d256-prod-github-runner-207 kernel: [66228.563061] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 23:47:34 juju-e4d256-prod-github-runner-207 kernel: [66228.564142] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 23:47:34 juju-e4d256-prod-github-runner-207 kernel: [66228.565315] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 23:47:34 juju-e4d256-prod-github-runner-207 kernel: [66228.566475] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 23:47:34 juju-e4d256-prod-github-runner-207 kernel: [66228.567642] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 23:47:34 juju-e4d256-prod-github-runner-207 kernel: [66228.568817] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 23:47:34 juju-e4d256-prod-github-runner-207 kernel: [66228.569985] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 23:47:34 juju-e4d256-prod-github-runner-207 kernel: [66228.571398] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 23:47:34 juju-e4d256-prod-github-runner-207 kernel: [66228.572611] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 23:47:34 juju-e4d256-prod-github-runner-207 kernel: [66228.573967] Call Trace: Aug 22 23:47:34 juju-e4d256-prod-github-runner-207 kernel: [66228.574946] Aug 22 23:47:34 juju-e4d256-prod-github-runner-207 kernel: [66228.575894] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:47:34 juju-e4d256-prod-github-runner-207 kernel: [66228.577017] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:47:34 juju-e4d256-prod-github-runner-207 kernel: [66228.578123] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:47:34 juju-e4d256-prod-github-runner-207 kernel: [66228.579324] ? show_regs.part.0+0x23/0x29 Aug 22 23:47:34 juju-e4d256-prod-github-runner-207 kernel: [66228.580405] ? show_regs.cold+0x8/0xd Aug 22 23:47:34 juju-e4d256-prod-github-runner-207 kernel: [66228.581460] ? watchdog_timer_fn+0x1be/0x220 Aug 22 23:47:34 juju-e4d256-prod-github-runner-207 kernel: [66228.582564] ? lockup_detector_update_enable+0x60/0x60 Aug 22 23:47:34 juju-e4d256-prod-github-runner-207 kernel: [66228.583753] ? __hrtimer_run_queues+0x107/0x230 Aug 22 23:47:34 juju-e4d256-prod-github-runner-207 kernel: [66228.584926] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 23:47:34 juju-e4d256-prod-github-runner-207 kernel: [66228.586041] ? hrtimer_interrupt+0x101/0x220 Aug 22 23:47:34 juju-e4d256-prod-github-runner-207 kernel: [66228.587142] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 23:47:34 juju-e4d256-prod-github-runner-207 kernel: [66228.588310] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 23:47:34 juju-e4d256-prod-github-runner-207 kernel: [66228.589460] Aug 22 23:47:34 juju-e4d256-prod-github-runner-207 kernel: [66228.590399] Aug 22 23:47:34 juju-e4d256-prod-github-runner-207 kernel: [66228.591283] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 23:47:34 juju-e4d256-prod-github-runner-207 kernel: [66228.592427] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:47:34 juju-e4d256-prod-github-runner-207 kernel: [66228.593566] ? _raw_spin_lock+0x22/0x30 Aug 22 23:47:34 juju-e4d256-prod-github-runner-207 kernel: [66228.594583] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:47:34 juju-e4d256-prod-github-runner-207 kernel: [66228.595686] direct_page_fault+0x206/0x310 [kvm] Aug 22 23:47:34 juju-e4d256-prod-github-runner-207 kernel: [66228.596814] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 23:47:34 juju-e4d256-prod-github-runner-207 kernel: [66228.597909] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 23:47:34 juju-e4d256-prod-github-runner-207 kernel: [66228.599063] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 23:47:34 juju-e4d256-prod-github-runner-207 kernel: [66228.600230] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 23:47:34 juju-e4d256-prod-github-runner-207 kernel: [66228.601275] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 23:47:34 juju-e4d256-prod-github-runner-207 kernel: [66228.602372] handle_exit+0x98/0x230 [kvm_amd] Aug 22 23:47:34 juju-e4d256-prod-github-runner-207 kernel: [66228.603358] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 23:47:34 juju-e4d256-prod-github-runner-207 kernel: [66228.604362] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 23:47:34 juju-e4d256-prod-github-runner-207 kernel: [66228.605401] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 23:47:34 juju-e4d256-prod-github-runner-207 kernel: [66228.606403] vcpu_run+0x62/0x2c0 [kvm] Aug 22 23:47:34 juju-e4d256-prod-github-runner-207 kernel: [66228.607288] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 23:47:34 juju-e4d256-prod-github-runner-207 kernel: [66228.608187] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 23:47:34 juju-e4d256-prod-github-runner-207 kernel: [66228.609171] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 23:47:34 juju-e4d256-prod-github-runner-207 kernel: [66228.610174] ? __seccomp_filter+0x4a/0x4a0 Aug 22 23:47:34 juju-e4d256-prod-github-runner-207 kernel: [66228.610999] ? __fget_files+0x86/0xc0 Aug 22 23:47:34 juju-e4d256-prod-github-runner-207 kernel: [66228.611778] __x64_sys_ioctl+0x95/0xd0 Aug 22 23:47:34 juju-e4d256-prod-github-runner-207 kernel: [66228.612559] do_syscall_64+0x5c/0xc0 Aug 22 23:47:34 juju-e4d256-prod-github-runner-207 kernel: [66228.613295] ? do_futex+0x162/0x1f0 Aug 22 23:47:34 juju-e4d256-prod-github-runner-207 kernel: [66228.614010] ? __x64_sys_futex+0x78/0x1e0 Aug 22 23:47:34 juju-e4d256-prod-github-runner-207 kernel: [66228.614767] ? __secure_computing+0xa9/0x120 Aug 22 23:47:34 juju-e4d256-prod-github-runner-207 kernel: [66228.615538] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 23:47:34 juju-e4d256-prod-github-runner-207 kernel: [66228.616401] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:47:34 juju-e4d256-prod-github-runner-207 kernel: [66228.617223] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:47:34 juju-e4d256-prod-github-runner-207 kernel: [66228.618033] ? do_syscall_64+0x69/0xc0 Aug 22 23:47:34 juju-e4d256-prod-github-runner-207 kernel: [66228.618749] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:47:34 juju-e4d256-prod-github-runner-207 kernel: [66228.619538] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:47:34 juju-e4d256-prod-github-runner-207 kernel: [66228.620326] ? do_syscall_64+0x69/0xc0 Aug 22 23:47:34 juju-e4d256-prod-github-runner-207 kernel: [66228.621031] ? do_syscall_64+0x69/0xc0 Aug 22 23:47:34 juju-e4d256-prod-github-runner-207 kernel: [66228.621727] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 23:47:34 juju-e4d256-prod-github-runner-207 kernel: [66228.622525] RIP: 0033:0x7faa5d0edaff Aug 22 23:47:34 juju-e4d256-prod-github-runner-207 kernel: [66228.623262] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 23:47:34 juju-e4d256-prod-github-runner-207 kernel: [66228.625539] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 23:47:34 juju-e4d256-prod-github-runner-207 kernel: [66228.626456] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 23:47:34 juju-e4d256-prod-github-runner-207 kernel: [66228.627349] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 23:47:34 juju-e4d256-prod-github-runner-207 kernel: [66228.628248] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 23:47:34 juju-e4d256-prod-github-runner-207 kernel: [66228.629147] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 23:47:34 juju-e4d256-prod-github-runner-207 kernel: [66228.630036] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 23:47:34 juju-e4d256-prod-github-runner-207 kernel: [66228.630929] Aug 22 23:47:47 juju-e4d256-prod-github-runner-207 kernel: [66241.604705] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 23:47:47 juju-e4d256-prod-github-runner-207 kernel: [66241.605689] rcu: 1-....: (16478982 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=7955438 Aug 22 23:47:47 juju-e4d256-prod-github-runner-207 kernel: [66241.606811] (t=16531101 jiffies g=23269 q=57992) Aug 22 23:47:47 juju-e4d256-prod-github-runner-207 kernel: [66241.607598] NMI backtrace for cpu 1 Aug 22 23:47:47 juju-e4d256-prod-github-runner-207 kernel: [66241.608322] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 23:47:47 juju-e4d256-prod-github-runner-207 kernel: [66241.609430] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 23:47:47 juju-e4d256-prod-github-runner-207 kernel: [66241.610487] Call Trace: Aug 22 23:47:47 juju-e4d256-prod-github-runner-207 kernel: [66241.611182] Aug 22 23:47:47 juju-e4d256-prod-github-runner-207 kernel: [66241.611829] show_stack+0x52/0x5c Aug 22 23:47:47 juju-e4d256-prod-github-runner-207 kernel: [66241.612564] dump_stack_lvl+0x4a/0x63 Aug 22 23:47:47 juju-e4d256-prod-github-runner-207 kernel: [66241.613311] dump_stack+0x10/0x16 Aug 22 23:47:47 juju-e4d256-prod-github-runner-207 kernel: [66241.614028] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 23:47:47 juju-e4d256-prod-github-runner-207 kernel: [66241.614806] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 23:47:47 juju-e4d256-prod-github-runner-207 kernel: [66241.615583] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 23:47:47 juju-e4d256-prod-github-runner-207 kernel: [66241.616419] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 23:47:47 juju-e4d256-prod-github-runner-207 kernel: [66241.617237] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 23:47:47 juju-e4d256-prod-github-runner-207 kernel: [66241.618046] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 23:47:47 juju-e4d256-prod-github-runner-207 kernel: [66241.618818] print_cpu_stall.cold+0x2f/0xe2 Aug 22 23:47:47 juju-e4d256-prod-github-runner-207 kernel: [66241.619582] ? timekeeping_update+0xf7/0x150 Aug 22 23:47:47 juju-e4d256-prod-github-runner-207 kernel: [66241.620368] check_cpu_stall+0x109/0x270 Aug 22 23:47:47 juju-e4d256-prod-github-runner-207 kernel: [66241.621396] rcu_sched_clock_irq+0x9a/0x250 Aug 22 23:47:47 juju-e4d256-prod-github-runner-207 kernel: [66241.622378] update_process_times+0x94/0xd0 Aug 22 23:47:47 juju-e4d256-prod-github-runner-207 kernel: [66241.623167] tick_sched_handle+0x29/0x70 Aug 22 23:47:47 juju-e4d256-prod-github-runner-207 kernel: [66241.623919] tick_sched_timer+0x8c/0xc0 Aug 22 23:47:47 juju-e4d256-prod-github-runner-207 kernel: [66241.624672] ? tick_nohz_handler+0xb0/0xb0 Aug 22 23:47:47 juju-e4d256-prod-github-runner-207 kernel: [66241.625433] __hrtimer_run_queues+0x107/0x230 Aug 22 23:47:47 juju-e4d256-prod-github-runner-207 kernel: [66241.626206] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 23:47:47 juju-e4d256-prod-github-runner-207 kernel: [66241.626980] hrtimer_interrupt+0x101/0x220 Aug 22 23:47:47 juju-e4d256-prod-github-runner-207 kernel: [66241.627744] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 23:47:47 juju-e4d256-prod-github-runner-207 kernel: [66241.628570] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 23:47:47 juju-e4d256-prod-github-runner-207 kernel: [66241.629371] Aug 22 23:47:47 juju-e4d256-prod-github-runner-207 kernel: [66241.630006] Aug 22 23:47:47 juju-e4d256-prod-github-runner-207 kernel: [66241.630634] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 23:47:47 juju-e4d256-prod-github-runner-207 kernel: [66241.631457] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:47:47 juju-e4d256-prod-github-runner-207 kernel: [66241.632351] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 23:47:47 juju-e4d256-prod-github-runner-207 kernel: [66241.634559] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 23:47:47 juju-e4d256-prod-github-runner-207 kernel: [66241.635451] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 23:47:47 juju-e4d256-prod-github-runner-207 kernel: [66241.636455] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 23:47:47 juju-e4d256-prod-github-runner-207 kernel: [66241.637469] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 23:47:47 juju-e4d256-prod-github-runner-207 kernel: [66241.638433] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 23:47:47 juju-e4d256-prod-github-runner-207 kernel: [66241.639388] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 23:47:47 juju-e4d256-prod-github-runner-207 kernel: [66241.640373] ? _raw_spin_lock+0x22/0x30 Aug 22 23:47:47 juju-e4d256-prod-github-runner-207 kernel: [66241.641140] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:47:47 juju-e4d256-prod-github-runner-207 kernel: [66241.641981] direct_page_fault+0x206/0x310 [kvm] Aug 22 23:47:47 juju-e4d256-prod-github-runner-207 kernel: [66241.642906] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 23:47:47 juju-e4d256-prod-github-runner-207 kernel: [66241.643767] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 23:47:47 juju-e4d256-prod-github-runner-207 kernel: [66241.644608] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 23:47:47 juju-e4d256-prod-github-runner-207 kernel: [66241.645413] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 23:47:47 juju-e4d256-prod-github-runner-207 kernel: [66241.646198] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 23:47:47 juju-e4d256-prod-github-runner-207 kernel: [66241.647024] handle_exit+0x98/0x230 [kvm_amd] Aug 22 23:47:47 juju-e4d256-prod-github-runner-207 kernel: [66241.647776] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 23:47:47 juju-e4d256-prod-github-runner-207 kernel: [66241.648575] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 23:47:47 juju-e4d256-prod-github-runner-207 kernel: [66241.649374] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 23:47:47 juju-e4d256-prod-github-runner-207 kernel: [66241.650156] vcpu_run+0x62/0x2c0 [kvm] Aug 22 23:47:47 juju-e4d256-prod-github-runner-207 kernel: [66241.650870] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 23:47:47 juju-e4d256-prod-github-runner-207 kernel: [66241.651602] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 23:47:47 juju-e4d256-prod-github-runner-207 kernel: [66241.652436] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 23:47:47 juju-e4d256-prod-github-runner-207 kernel: [66241.653213] ? __seccomp_filter+0x4a/0x4a0 Aug 22 23:47:47 juju-e4d256-prod-github-runner-207 kernel: [66241.653937] ? __fget_files+0x86/0xc0 Aug 22 23:47:47 juju-e4d256-prod-github-runner-207 kernel: [66241.654629] __x64_sys_ioctl+0x95/0xd0 Aug 22 23:47:47 juju-e4d256-prod-github-runner-207 kernel: [66241.655431] do_syscall_64+0x5c/0xc0 Aug 22 23:47:47 juju-e4d256-prod-github-runner-207 kernel: [66241.656115] ? do_futex+0x162/0x1f0 Aug 22 23:47:47 juju-e4d256-prod-github-runner-207 kernel: [66241.656796] ? __x64_sys_futex+0x78/0x1e0 Aug 22 23:47:47 juju-e4d256-prod-github-runner-207 kernel: [66241.657495] ? __secure_computing+0xa9/0x120 Aug 22 23:47:47 juju-e4d256-prod-github-runner-207 kernel: [66241.658208] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 23:47:47 juju-e4d256-prod-github-runner-207 kernel: [66241.659001] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:47:47 juju-e4d256-prod-github-runner-207 kernel: [66241.659752] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:47:47 juju-e4d256-prod-github-runner-207 kernel: [66241.660517] ? do_syscall_64+0x69/0xc0 Aug 22 23:47:47 juju-e4d256-prod-github-runner-207 kernel: [66241.661206] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:47:47 juju-e4d256-prod-github-runner-207 kernel: [66241.661964] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:47:47 juju-e4d256-prod-github-runner-207 kernel: [66241.662719] ? do_syscall_64+0x69/0xc0 Aug 22 23:47:47 juju-e4d256-prod-github-runner-207 kernel: [66241.663411] ? do_syscall_64+0x69/0xc0 Aug 22 23:47:47 juju-e4d256-prod-github-runner-207 kernel: [66241.664097] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 23:47:47 juju-e4d256-prod-github-runner-207 kernel: [66241.664880] RIP: 0033:0x7faa5d0edaff Aug 22 23:47:47 juju-e4d256-prod-github-runner-207 kernel: [66241.665562] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 23:47:47 juju-e4d256-prod-github-runner-207 kernel: [66241.667687] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 23:47:47 juju-e4d256-prod-github-runner-207 kernel: [66241.668671] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 23:47:47 juju-e4d256-prod-github-runner-207 kernel: [66241.669615] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 23:47:47 juju-e4d256-prod-github-runner-207 kernel: [66241.670556] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 23:47:47 juju-e4d256-prod-github-runner-207 kernel: [66241.671497] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 23:47:47 juju-e4d256-prod-github-runner-207 kernel: [66241.672431] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 23:47:47 juju-e4d256-prod-github-runner-207 kernel: [66241.673349] Aug 22 23:48:14 juju-e4d256-prod-github-runner-207 kernel: [66268.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 61609s! [qemu-system-x86:6715] Aug 22 23:48:14 juju-e4d256-prod-github-runner-207 kernel: [66268.543133] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 23:48:14 juju-e4d256-prod-github-runner-207 kernel: [66268.543211] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 23:48:14 juju-e4d256-prod-github-runner-207 kernel: [66268.555712] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 23:48:14 juju-e4d256-prod-github-runner-207 kernel: [66268.557016] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 23:48:14 juju-e4d256-prod-github-runner-207 kernel: [66268.558266] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:48:14 juju-e4d256-prod-github-runner-207 kernel: [66268.559340] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 23:48:14 juju-e4d256-prod-github-runner-207 kernel: [66268.561949] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 23:48:14 juju-e4d256-prod-github-runner-207 kernel: [66268.563009] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 23:48:14 juju-e4d256-prod-github-runner-207 kernel: [66268.564203] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 23:48:14 juju-e4d256-prod-github-runner-207 kernel: [66268.565389] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 23:48:14 juju-e4d256-prod-github-runner-207 kernel: [66268.566592] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 23:48:14 juju-e4d256-prod-github-runner-207 kernel: [66268.567775] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 23:48:14 juju-e4d256-prod-github-runner-207 kernel: [66268.568976] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 23:48:14 juju-e4d256-prod-github-runner-207 kernel: [66268.570251] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 23:48:14 juju-e4d256-prod-github-runner-207 kernel: [66268.571381] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 23:48:14 juju-e4d256-prod-github-runner-207 kernel: [66268.572623] Call Trace: Aug 22 23:48:14 juju-e4d256-prod-github-runner-207 kernel: [66268.573546] Aug 22 23:48:14 juju-e4d256-prod-github-runner-207 kernel: [66268.574435] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:48:14 juju-e4d256-prod-github-runner-207 kernel: [66268.575478] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:48:14 juju-e4d256-prod-github-runner-207 kernel: [66268.576526] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:48:14 juju-e4d256-prod-github-runner-207 kernel: [66268.577626] ? show_regs.part.0+0x23/0x29 Aug 22 23:48:14 juju-e4d256-prod-github-runner-207 kernel: [66268.578657] ? show_regs.cold+0x8/0xd Aug 22 23:48:14 juju-e4d256-prod-github-runner-207 kernel: [66268.579643] ? watchdog_timer_fn+0x1be/0x220 Aug 22 23:48:14 juju-e4d256-prod-github-runner-207 kernel: [66268.580674] ? lockup_detector_update_enable+0x60/0x60 Aug 22 23:48:14 juju-e4d256-prod-github-runner-207 kernel: [66268.581760] ? __hrtimer_run_queues+0x107/0x230 Aug 22 23:48:14 juju-e4d256-prod-github-runner-207 kernel: [66268.582806] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 23:48:14 juju-e4d256-prod-github-runner-207 kernel: [66268.583845] ? hrtimer_interrupt+0x101/0x220 Aug 22 23:48:14 juju-e4d256-prod-github-runner-207 kernel: [66268.584884] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 23:48:14 juju-e4d256-prod-github-runner-207 kernel: [66268.585965] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 23:48:14 juju-e4d256-prod-github-runner-207 kernel: [66268.587031] Aug 22 23:48:14 juju-e4d256-prod-github-runner-207 kernel: [66268.587888] Aug 22 23:48:14 juju-e4d256-prod-github-runner-207 kernel: [66268.588735] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 23:48:14 juju-e4d256-prod-github-runner-207 kernel: [66268.589813] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:48:14 juju-e4d256-prod-github-runner-207 kernel: [66268.590896] ? _raw_spin_lock+0x22/0x30 Aug 22 23:48:14 juju-e4d256-prod-github-runner-207 kernel: [66268.591864] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:48:14 juju-e4d256-prod-github-runner-207 kernel: [66268.592921] direct_page_fault+0x206/0x310 [kvm] Aug 22 23:48:14 juju-e4d256-prod-github-runner-207 kernel: [66268.593964] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 23:48:14 juju-e4d256-prod-github-runner-207 kernel: [66268.594991] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 23:48:14 juju-e4d256-prod-github-runner-207 kernel: [66268.596040] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 23:48:14 juju-e4d256-prod-github-runner-207 kernel: [66268.597041] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 23:48:14 juju-e4d256-prod-github-runner-207 kernel: [66268.598010] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 23:48:14 juju-e4d256-prod-github-runner-207 kernel: [66268.599027] handle_exit+0x98/0x230 [kvm_amd] Aug 22 23:48:14 juju-e4d256-prod-github-runner-207 kernel: [66268.599993] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 23:48:14 juju-e4d256-prod-github-runner-207 kernel: [66268.600923] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 23:48:14 juju-e4d256-prod-github-runner-207 kernel: [66268.601862] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 23:48:14 juju-e4d256-prod-github-runner-207 kernel: [66268.602844] vcpu_run+0x62/0x2c0 [kvm] Aug 22 23:48:14 juju-e4d256-prod-github-runner-207 kernel: [66268.603700] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 23:48:14 juju-e4d256-prod-github-runner-207 kernel: [66268.604538] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 23:48:14 juju-e4d256-prod-github-runner-207 kernel: [66268.605436] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 23:48:14 juju-e4d256-prod-github-runner-207 kernel: [66268.606261] ? __seccomp_filter+0x4a/0x4a0 Aug 22 23:48:14 juju-e4d256-prod-github-runner-207 kernel: [66268.607024] ? __fget_files+0x86/0xc0 Aug 22 23:48:14 juju-e4d256-prod-github-runner-207 kernel: [66268.607739] __x64_sys_ioctl+0x95/0xd0 Aug 22 23:48:14 juju-e4d256-prod-github-runner-207 kernel: [66268.608454] do_syscall_64+0x5c/0xc0 Aug 22 23:48:14 juju-e4d256-prod-github-runner-207 kernel: [66268.609142] ? do_futex+0x162/0x1f0 Aug 22 23:48:14 juju-e4d256-prod-github-runner-207 kernel: [66268.609800] ? __x64_sys_futex+0x78/0x1e0 Aug 22 23:48:14 juju-e4d256-prod-github-runner-207 kernel: [66268.610484] ? __secure_computing+0xa9/0x120 Aug 22 23:48:14 juju-e4d256-prod-github-runner-207 kernel: [66268.611184] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 23:48:14 juju-e4d256-prod-github-runner-207 kernel: [66268.611973] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:48:14 juju-e4d256-prod-github-runner-207 kernel: [66268.612706] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:48:14 juju-e4d256-prod-github-runner-207 kernel: [66268.613437] ? do_syscall_64+0x69/0xc0 Aug 22 23:48:14 juju-e4d256-prod-github-runner-207 kernel: [66268.614090] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:48:14 juju-e4d256-prod-github-runner-207 kernel: [66268.614815] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:48:14 juju-e4d256-prod-github-runner-207 kernel: [66268.615528] ? do_syscall_64+0x69/0xc0 Aug 22 23:48:14 juju-e4d256-prod-github-runner-207 kernel: [66268.616176] ? do_syscall_64+0x69/0xc0 Aug 22 23:48:14 juju-e4d256-prod-github-runner-207 kernel: [66268.616808] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 23:48:14 juju-e4d256-prod-github-runner-207 kernel: [66268.617521] RIP: 0033:0x7faa5d0edaff Aug 22 23:48:14 juju-e4d256-prod-github-runner-207 kernel: [66268.618152] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 23:48:14 juju-e4d256-prod-github-runner-207 kernel: [66268.620195] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 23:48:14 juju-e4d256-prod-github-runner-207 kernel: [66268.621136] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 23:48:14 juju-e4d256-prod-github-runner-207 kernel: [66268.622042] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 23:48:14 juju-e4d256-prod-github-runner-207 kernel: [66268.622954] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 23:48:14 juju-e4d256-prod-github-runner-207 kernel: [66268.623863] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 23:48:14 juju-e4d256-prod-github-runner-207 kernel: [66268.624772] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 23:48:14 juju-e4d256-prod-github-runner-207 kernel: [66268.625686] Aug 22 23:48:42 juju-e4d256-prod-github-runner-207 kernel: [66296.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 61635s! [qemu-system-x86:6715] Aug 22 23:48:42 juju-e4d256-prod-github-runner-207 kernel: [66296.543911] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 23:48:42 juju-e4d256-prod-github-runner-207 kernel: [66296.544247] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 23:48:42 juju-e4d256-prod-github-runner-207 kernel: [66296.556696] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 23:48:42 juju-e4d256-prod-github-runner-207 kernel: [66296.557990] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 23:48:42 juju-e4d256-prod-github-runner-207 kernel: [66296.559230] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:48:42 juju-e4d256-prod-github-runner-207 kernel: [66296.560314] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 23:48:42 juju-e4d256-prod-github-runner-207 kernel: [66296.562922] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 23:48:42 juju-e4d256-prod-github-runner-207 kernel: [66296.563998] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 23:48:42 juju-e4d256-prod-github-runner-207 kernel: [66296.565186] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 23:48:42 juju-e4d256-prod-github-runner-207 kernel: [66296.566395] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 23:48:42 juju-e4d256-prod-github-runner-207 kernel: [66296.567580] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 23:48:42 juju-e4d256-prod-github-runner-207 kernel: [66296.568774] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 23:48:42 juju-e4d256-prod-github-runner-207 kernel: [66296.569964] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 23:48:42 juju-e4d256-prod-github-runner-207 kernel: [66296.571221] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 23:48:42 juju-e4d256-prod-github-runner-207 kernel: [66296.572349] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 23:48:42 juju-e4d256-prod-github-runner-207 kernel: [66296.573569] Call Trace: Aug 22 23:48:42 juju-e4d256-prod-github-runner-207 kernel: [66296.574488] Aug 22 23:48:42 juju-e4d256-prod-github-runner-207 kernel: [66296.575399] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:48:42 juju-e4d256-prod-github-runner-207 kernel: [66296.576471] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:48:42 juju-e4d256-prod-github-runner-207 kernel: [66296.577510] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:48:42 juju-e4d256-prod-github-runner-207 kernel: [66296.578772] ? show_regs.part.0+0x23/0x29 Aug 22 23:48:42 juju-e4d256-prod-github-runner-207 kernel: [66296.579811] ? show_regs.cold+0x8/0xd Aug 22 23:48:42 juju-e4d256-prod-github-runner-207 kernel: [66296.580809] ? watchdog_timer_fn+0x1be/0x220 Aug 22 23:48:42 juju-e4d256-prod-github-runner-207 kernel: [66296.581841] ? lockup_detector_update_enable+0x60/0x60 Aug 22 23:48:42 juju-e4d256-prod-github-runner-207 kernel: [66296.582920] ? __hrtimer_run_queues+0x107/0x230 Aug 22 23:48:42 juju-e4d256-prod-github-runner-207 kernel: [66296.583978] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 23:48:42 juju-e4d256-prod-github-runner-207 kernel: [66296.585014] ? hrtimer_interrupt+0x101/0x220 Aug 22 23:48:42 juju-e4d256-prod-github-runner-207 kernel: [66296.586041] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 23:48:42 juju-e4d256-prod-github-runner-207 kernel: [66296.587123] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 23:48:42 juju-e4d256-prod-github-runner-207 kernel: [66296.588197] Aug 22 23:48:42 juju-e4d256-prod-github-runner-207 kernel: [66296.589058] Aug 22 23:48:42 juju-e4d256-prod-github-runner-207 kernel: [66296.590026] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 23:48:42 juju-e4d256-prod-github-runner-207 kernel: [66296.591073] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:48:42 juju-e4d256-prod-github-runner-207 kernel: [66296.592132] ? _raw_spin_lock+0x22/0x30 Aug 22 23:48:42 juju-e4d256-prod-github-runner-207 kernel: [66296.593089] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:48:42 juju-e4d256-prod-github-runner-207 kernel: [66296.594118] direct_page_fault+0x206/0x310 [kvm] Aug 22 23:48:42 juju-e4d256-prod-github-runner-207 kernel: [66296.595186] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 23:48:42 juju-e4d256-prod-github-runner-207 kernel: [66296.596298] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 23:48:42 juju-e4d256-prod-github-runner-207 kernel: [66296.597338] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 23:48:42 juju-e4d256-prod-github-runner-207 kernel: [66296.598362] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 23:48:42 juju-e4d256-prod-github-runner-207 kernel: [66296.599321] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 23:48:42 juju-e4d256-prod-github-runner-207 kernel: [66296.600358] handle_exit+0x98/0x230 [kvm_amd] Aug 22 23:48:42 juju-e4d256-prod-github-runner-207 kernel: [66296.601266] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 23:48:42 juju-e4d256-prod-github-runner-207 kernel: [66296.602193] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 23:48:42 juju-e4d256-prod-github-runner-207 kernel: [66296.603132] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 23:48:42 juju-e4d256-prod-github-runner-207 kernel: [66296.604063] vcpu_run+0x62/0x2c0 [kvm] Aug 22 23:48:42 juju-e4d256-prod-github-runner-207 kernel: [66296.604890] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 23:48:42 juju-e4d256-prod-github-runner-207 kernel: [66296.605721] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 23:48:42 juju-e4d256-prod-github-runner-207 kernel: [66296.606616] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 23:48:42 juju-e4d256-prod-github-runner-207 kernel: [66296.607424] ? __seccomp_filter+0x4a/0x4a0 Aug 22 23:48:42 juju-e4d256-prod-github-runner-207 kernel: [66296.608253] ? __fget_files+0x86/0xc0 Aug 22 23:48:42 juju-e4d256-prod-github-runner-207 kernel: [66296.608995] __x64_sys_ioctl+0x95/0xd0 Aug 22 23:48:42 juju-e4d256-prod-github-runner-207 kernel: [66296.609699] do_syscall_64+0x5c/0xc0 Aug 22 23:48:42 juju-e4d256-prod-github-runner-207 kernel: [66296.610380] ? do_futex+0x162/0x1f0 Aug 22 23:48:42 juju-e4d256-prod-github-runner-207 kernel: [66296.611040] ? __x64_sys_futex+0x78/0x1e0 Aug 22 23:48:42 juju-e4d256-prod-github-runner-207 kernel: [66296.611747] ? __secure_computing+0xa9/0x120 Aug 22 23:48:42 juju-e4d256-prod-github-runner-207 kernel: [66296.612467] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 23:48:42 juju-e4d256-prod-github-runner-207 kernel: [66296.613245] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:48:42 juju-e4d256-prod-github-runner-207 kernel: [66296.613981] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:48:42 juju-e4d256-prod-github-runner-207 kernel: [66296.614717] ? do_syscall_64+0x69/0xc0 Aug 22 23:48:42 juju-e4d256-prod-github-runner-207 kernel: [66296.615375] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:48:42 juju-e4d256-prod-github-runner-207 kernel: [66296.616126] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:48:42 juju-e4d256-prod-github-runner-207 kernel: [66296.616834] ? do_syscall_64+0x69/0xc0 Aug 22 23:48:42 juju-e4d256-prod-github-runner-207 kernel: [66296.617476] ? do_syscall_64+0x69/0xc0 Aug 22 23:48:42 juju-e4d256-prod-github-runner-207 kernel: [66296.618109] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 23:48:42 juju-e4d256-prod-github-runner-207 kernel: [66296.618830] RIP: 0033:0x7faa5d0edaff Aug 22 23:48:42 juju-e4d256-prod-github-runner-207 kernel: [66296.619495] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 23:48:42 juju-e4d256-prod-github-runner-207 kernel: [66296.621550] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 23:48:42 juju-e4d256-prod-github-runner-207 kernel: [66296.622481] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 23:48:42 juju-e4d256-prod-github-runner-207 kernel: [66296.623406] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 23:48:42 juju-e4d256-prod-github-runner-207 kernel: [66296.624330] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 23:48:42 juju-e4d256-prod-github-runner-207 kernel: [66296.625333] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 23:48:42 juju-e4d256-prod-github-runner-207 kernel: [66296.626288] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 23:48:42 juju-e4d256-prod-github-runner-207 kernel: [66296.627220] Aug 22 23:49:10 juju-e4d256-prod-github-runner-207 kernel: [66324.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 61661s! [qemu-system-x86:6715] Aug 22 23:49:10 juju-e4d256-prod-github-runner-207 kernel: [66324.543086] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 23:49:10 juju-e4d256-prod-github-runner-207 kernel: [66324.543159] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 23:49:10 juju-e4d256-prod-github-runner-207 kernel: [66324.555611] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 23:49:10 juju-e4d256-prod-github-runner-207 kernel: [66324.556991] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 23:49:10 juju-e4d256-prod-github-runner-207 kernel: [66324.558215] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:49:10 juju-e4d256-prod-github-runner-207 kernel: [66324.559272] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 23:49:10 juju-e4d256-prod-github-runner-207 kernel: [66324.561848] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 23:49:10 juju-e4d256-prod-github-runner-207 kernel: [66324.562891] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 23:49:10 juju-e4d256-prod-github-runner-207 kernel: [66324.564078] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 23:49:10 juju-e4d256-prod-github-runner-207 kernel: [66324.565249] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 23:49:10 juju-e4d256-prod-github-runner-207 kernel: [66324.566407] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 23:49:10 juju-e4d256-prod-github-runner-207 kernel: [66324.567595] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 23:49:10 juju-e4d256-prod-github-runner-207 kernel: [66324.568760] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 23:49:10 juju-e4d256-prod-github-runner-207 kernel: [66324.570039] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 23:49:10 juju-e4d256-prod-github-runner-207 kernel: [66324.571141] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 23:49:10 juju-e4d256-prod-github-runner-207 kernel: [66324.572514] Call Trace: Aug 22 23:49:10 juju-e4d256-prod-github-runner-207 kernel: [66324.573610] Aug 22 23:49:10 juju-e4d256-prod-github-runner-207 kernel: [66324.574564] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:49:10 juju-e4d256-prod-github-runner-207 kernel: [66324.575640] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:49:10 juju-e4d256-prod-github-runner-207 kernel: [66324.576844] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:49:10 juju-e4d256-prod-github-runner-207 kernel: [66324.577927] ? show_regs.part.0+0x23/0x29 Aug 22 23:49:10 juju-e4d256-prod-github-runner-207 kernel: [66324.578927] ? show_regs.cold+0x8/0xd Aug 22 23:49:10 juju-e4d256-prod-github-runner-207 kernel: [66324.579944] ? watchdog_timer_fn+0x1be/0x220 Aug 22 23:49:10 juju-e4d256-prod-github-runner-207 kernel: [66324.580989] ? lockup_detector_update_enable+0x60/0x60 Aug 22 23:49:10 juju-e4d256-prod-github-runner-207 kernel: [66324.583345] ? __hrtimer_run_queues+0x107/0x230 Aug 22 23:49:10 juju-e4d256-prod-github-runner-207 kernel: [66324.584376] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 23:49:10 juju-e4d256-prod-github-runner-207 kernel: [66324.585398] ? hrtimer_interrupt+0x101/0x220 Aug 22 23:49:10 juju-e4d256-prod-github-runner-207 kernel: [66324.586418] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 23:49:10 juju-e4d256-prod-github-runner-207 kernel: [66324.587548] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 23:49:10 juju-e4d256-prod-github-runner-207 kernel: [66324.588598] Aug 22 23:49:10 juju-e4d256-prod-github-runner-207 kernel: [66324.589450] Aug 22 23:49:10 juju-e4d256-prod-github-runner-207 kernel: [66324.590312] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 23:49:10 juju-e4d256-prod-github-runner-207 kernel: [66324.591389] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:49:10 juju-e4d256-prod-github-runner-207 kernel: [66324.592432] ? _raw_spin_lock+0x22/0x30 Aug 22 23:49:10 juju-e4d256-prod-github-runner-207 kernel: [66324.593384] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:49:10 juju-e4d256-prod-github-runner-207 kernel: [66324.594421] direct_page_fault+0x206/0x310 [kvm] Aug 22 23:49:10 juju-e4d256-prod-github-runner-207 kernel: [66324.595460] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 23:49:10 juju-e4d256-prod-github-runner-207 kernel: [66324.596485] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 23:49:10 juju-e4d256-prod-github-runner-207 kernel: [66324.597499] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 23:49:10 juju-e4d256-prod-github-runner-207 kernel: [66324.598470] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 23:49:10 juju-e4d256-prod-github-runner-207 kernel: [66324.599470] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 23:49:10 juju-e4d256-prod-github-runner-207 kernel: [66324.600475] handle_exit+0x98/0x230 [kvm_amd] Aug 22 23:49:10 juju-e4d256-prod-github-runner-207 kernel: [66324.601377] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 23:49:10 juju-e4d256-prod-github-runner-207 kernel: [66324.602298] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 23:49:10 juju-e4d256-prod-github-runner-207 kernel: [66324.603230] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 23:49:10 juju-e4d256-prod-github-runner-207 kernel: [66324.604174] vcpu_run+0x62/0x2c0 [kvm] Aug 22 23:49:10 juju-e4d256-prod-github-runner-207 kernel: [66324.604995] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 23:49:10 juju-e4d256-prod-github-runner-207 kernel: [66324.605812] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 23:49:10 juju-e4d256-prod-github-runner-207 kernel: [66324.606675] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 23:49:10 juju-e4d256-prod-github-runner-207 kernel: [66324.607502] ? __seccomp_filter+0x4a/0x4a0 Aug 22 23:49:10 juju-e4d256-prod-github-runner-207 kernel: [66324.608247] ? __fget_files+0x86/0xc0 Aug 22 23:49:10 juju-e4d256-prod-github-runner-207 kernel: [66324.608973] __x64_sys_ioctl+0x95/0xd0 Aug 22 23:49:10 juju-e4d256-prod-github-runner-207 kernel: [66324.609686] do_syscall_64+0x5c/0xc0 Aug 22 23:49:10 juju-e4d256-prod-github-runner-207 kernel: [66324.610354] ? do_futex+0x162/0x1f0 Aug 22 23:49:10 juju-e4d256-prod-github-runner-207 kernel: [66324.611055] ? __x64_sys_futex+0x78/0x1e0 Aug 22 23:49:10 juju-e4d256-prod-github-runner-207 kernel: [66324.611745] ? __secure_computing+0xa9/0x120 Aug 22 23:49:10 juju-e4d256-prod-github-runner-207 kernel: [66324.612442] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 23:49:10 juju-e4d256-prod-github-runner-207 kernel: [66324.613206] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:49:10 juju-e4d256-prod-github-runner-207 kernel: [66324.613948] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:49:10 juju-e4d256-prod-github-runner-207 kernel: [66324.614671] ? do_syscall_64+0x69/0xc0 Aug 22 23:49:10 juju-e4d256-prod-github-runner-207 kernel: [66324.615329] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:49:10 juju-e4d256-prod-github-runner-207 kernel: [66324.616033] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:49:10 juju-e4d256-prod-github-runner-207 kernel: [66324.616752] ? do_syscall_64+0x69/0xc0 Aug 22 23:49:10 juju-e4d256-prod-github-runner-207 kernel: [66324.617383] ? do_syscall_64+0x69/0xc0 Aug 22 23:49:10 juju-e4d256-prod-github-runner-207 kernel: [66324.618010] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 23:49:10 juju-e4d256-prod-github-runner-207 kernel: [66324.618724] RIP: 0033:0x7faa5d0edaff Aug 22 23:49:10 juju-e4d256-prod-github-runner-207 kernel: [66324.619363] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 23:49:10 juju-e4d256-prod-github-runner-207 kernel: [66324.621356] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 23:49:10 juju-e4d256-prod-github-runner-207 kernel: [66324.622268] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 23:49:10 juju-e4d256-prod-github-runner-207 kernel: [66324.623163] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 23:49:10 juju-e4d256-prod-github-runner-207 kernel: [66324.624066] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 23:49:10 juju-e4d256-prod-github-runner-207 kernel: [66324.624953] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 23:49:10 juju-e4d256-prod-github-runner-207 kernel: [66324.625843] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 23:49:10 juju-e4d256-prod-github-runner-207 kernel: [66324.626742] Aug 22 23:49:38 juju-e4d256-prod-github-runner-207 kernel: [66352.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 61687s! [qemu-system-x86:6715] Aug 22 23:49:38 juju-e4d256-prod-github-runner-207 kernel: [66352.543114] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 23:49:38 juju-e4d256-prod-github-runner-207 kernel: [66352.543190] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 23:49:38 juju-e4d256-prod-github-runner-207 kernel: [66352.555366] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 23:49:38 juju-e4d256-prod-github-runner-207 kernel: [66352.556623] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 23:49:38 juju-e4d256-prod-github-runner-207 kernel: [66352.557837] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:49:38 juju-e4d256-prod-github-runner-207 kernel: [66352.558899] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 23:49:38 juju-e4d256-prod-github-runner-207 kernel: [66352.561468] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 23:49:38 juju-e4d256-prod-github-runner-207 kernel: [66352.562535] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 23:49:38 juju-e4d256-prod-github-runner-207 kernel: [66352.563713] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 23:49:38 juju-e4d256-prod-github-runner-207 kernel: [66352.564868] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 23:49:38 juju-e4d256-prod-github-runner-207 kernel: [66352.566022] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 23:49:38 juju-e4d256-prod-github-runner-207 kernel: [66352.567190] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 23:49:38 juju-e4d256-prod-github-runner-207 kernel: [66352.568354] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 23:49:38 juju-e4d256-prod-github-runner-207 kernel: [66352.569581] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 23:49:38 juju-e4d256-prod-github-runner-207 kernel: [66352.570701] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 23:49:38 juju-e4d256-prod-github-runner-207 kernel: [66352.571915] Call Trace: Aug 22 23:49:38 juju-e4d256-prod-github-runner-207 kernel: [66352.572848] Aug 22 23:49:38 juju-e4d256-prod-github-runner-207 kernel: [66352.573744] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:49:38 juju-e4d256-prod-github-runner-207 kernel: [66352.574776] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:49:38 juju-e4d256-prod-github-runner-207 kernel: [66352.575814] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:49:38 juju-e4d256-prod-github-runner-207 kernel: [66352.576891] ? show_regs.part.0+0x23/0x29 Aug 22 23:49:38 juju-e4d256-prod-github-runner-207 kernel: [66352.577888] ? show_regs.cold+0x8/0xd Aug 22 23:49:38 juju-e4d256-prod-github-runner-207 kernel: [66352.578862] ? watchdog_timer_fn+0x1be/0x220 Aug 22 23:49:38 juju-e4d256-prod-github-runner-207 kernel: [66352.579909] ? lockup_detector_update_enable+0x60/0x60 Aug 22 23:49:38 juju-e4d256-prod-github-runner-207 kernel: [66352.581006] ? __hrtimer_run_queues+0x107/0x230 Aug 22 23:49:38 juju-e4d256-prod-github-runner-207 kernel: [66352.582039] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 23:49:38 juju-e4d256-prod-github-runner-207 kernel: [66352.583078] ? hrtimer_interrupt+0x101/0x220 Aug 22 23:49:38 juju-e4d256-prod-github-runner-207 kernel: [66352.584094] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 23:49:38 juju-e4d256-prod-github-runner-207 kernel: [66352.585166] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 23:49:38 juju-e4d256-prod-github-runner-207 kernel: [66352.586214] Aug 22 23:49:38 juju-e4d256-prod-github-runner-207 kernel: [66352.587092] Aug 22 23:49:38 juju-e4d256-prod-github-runner-207 kernel: [66352.587958] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 23:49:38 juju-e4d256-prod-github-runner-207 kernel: [66352.589009] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:49:38 juju-e4d256-prod-github-runner-207 kernel: [66352.590058] ? _raw_spin_lock+0x22/0x30 Aug 22 23:49:38 juju-e4d256-prod-github-runner-207 kernel: [66352.591022] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:49:38 juju-e4d256-prod-github-runner-207 kernel: [66352.592087] direct_page_fault+0x206/0x310 [kvm] Aug 22 23:49:38 juju-e4d256-prod-github-runner-207 kernel: [66352.593244] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 23:49:38 juju-e4d256-prod-github-runner-207 kernel: [66352.594265] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 23:49:38 juju-e4d256-prod-github-runner-207 kernel: [66352.595295] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 23:49:38 juju-e4d256-prod-github-runner-207 kernel: [66352.596275] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 23:49:38 juju-e4d256-prod-github-runner-207 kernel: [66352.597226] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 23:49:38 juju-e4d256-prod-github-runner-207 kernel: [66352.598211] handle_exit+0x98/0x230 [kvm_amd] Aug 22 23:49:38 juju-e4d256-prod-github-runner-207 kernel: [66352.599192] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 23:49:38 juju-e4d256-prod-github-runner-207 kernel: [66352.600112] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 23:49:38 juju-e4d256-prod-github-runner-207 kernel: [66352.601040] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 23:49:38 juju-e4d256-prod-github-runner-207 kernel: [66352.601953] vcpu_run+0x62/0x2c0 [kvm] Aug 22 23:49:38 juju-e4d256-prod-github-runner-207 kernel: [66352.602767] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 23:49:38 juju-e4d256-prod-github-runner-207 kernel: [66352.603597] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 23:49:38 juju-e4d256-prod-github-runner-207 kernel: [66352.604470] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 23:49:38 juju-e4d256-prod-github-runner-207 kernel: [66352.605329] ? __seccomp_filter+0x4a/0x4a0 Aug 22 23:49:38 juju-e4d256-prod-github-runner-207 kernel: [66352.606089] ? __fget_files+0x86/0xc0 Aug 22 23:49:38 juju-e4d256-prod-github-runner-207 kernel: [66352.606795] __x64_sys_ioctl+0x95/0xd0 Aug 22 23:49:38 juju-e4d256-prod-github-runner-207 kernel: [66352.607503] do_syscall_64+0x5c/0xc0 Aug 22 23:49:38 juju-e4d256-prod-github-runner-207 kernel: [66352.608175] ? do_futex+0x162/0x1f0 Aug 22 23:49:38 juju-e4d256-prod-github-runner-207 kernel: [66352.608826] ? __x64_sys_futex+0x78/0x1e0 Aug 22 23:49:38 juju-e4d256-prod-github-runner-207 kernel: [66352.609502] ? __secure_computing+0xa9/0x120 Aug 22 23:49:38 juju-e4d256-prod-github-runner-207 kernel: [66352.610194] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 23:49:38 juju-e4d256-prod-github-runner-207 kernel: [66352.610957] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:49:38 juju-e4d256-prod-github-runner-207 kernel: [66352.611701] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:49:38 juju-e4d256-prod-github-runner-207 kernel: [66352.612421] ? do_syscall_64+0x69/0xc0 Aug 22 23:49:38 juju-e4d256-prod-github-runner-207 kernel: [66352.613069] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:49:38 juju-e4d256-prod-github-runner-207 kernel: [66352.613776] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:49:38 juju-e4d256-prod-github-runner-207 kernel: [66352.614474] ? do_syscall_64+0x69/0xc0 Aug 22 23:49:38 juju-e4d256-prod-github-runner-207 kernel: [66352.615120] ? do_syscall_64+0x69/0xc0 Aug 22 23:49:38 juju-e4d256-prod-github-runner-207 kernel: [66352.615746] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 23:49:38 juju-e4d256-prod-github-runner-207 kernel: [66352.616456] RIP: 0033:0x7faa5d0edaff Aug 22 23:49:38 juju-e4d256-prod-github-runner-207 kernel: [66352.617085] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 23:49:38 juju-e4d256-prod-github-runner-207 kernel: [66352.619089] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 23:49:38 juju-e4d256-prod-github-runner-207 kernel: [66352.620002] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 23:49:38 juju-e4d256-prod-github-runner-207 kernel: [66352.620899] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 23:49:38 juju-e4d256-prod-github-runner-207 kernel: [66352.621813] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 23:49:38 juju-e4d256-prod-github-runner-207 kernel: [66352.622738] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 23:49:38 juju-e4d256-prod-github-runner-207 kernel: [66352.623647] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 23:49:38 juju-e4d256-prod-github-runner-207 kernel: [66352.624550] Aug 22 23:50:06 juju-e4d256-prod-github-runner-207 kernel: [66380.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 61713s! [qemu-system-x86:6715] Aug 22 23:50:06 juju-e4d256-prod-github-runner-207 kernel: [66380.543139] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 23:50:06 juju-e4d256-prod-github-runner-207 kernel: [66380.543213] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 23:50:06 juju-e4d256-prod-github-runner-207 kernel: [66380.555601] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 23:50:06 juju-e4d256-prod-github-runner-207 kernel: [66380.556890] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 23:50:06 juju-e4d256-prod-github-runner-207 kernel: [66380.558190] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:50:06 juju-e4d256-prod-github-runner-207 kernel: [66380.559309] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 23:50:06 juju-e4d256-prod-github-runner-207 kernel: [66380.562026] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 23:50:06 juju-e4d256-prod-github-runner-207 kernel: [66380.563142] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 23:50:06 juju-e4d256-prod-github-runner-207 kernel: [66380.564373] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 23:50:06 juju-e4d256-prod-github-runner-207 kernel: [66380.566065] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 23:50:06 juju-e4d256-prod-github-runner-207 kernel: [66380.568113] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 23:50:06 juju-e4d256-prod-github-runner-207 kernel: [66380.569936] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 23:50:06 juju-e4d256-prod-github-runner-207 kernel: [66380.571934] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 23:50:06 juju-e4d256-prod-github-runner-207 kernel: [66380.573886] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 23:50:06 juju-e4d256-prod-github-runner-207 kernel: [66380.575588] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 23:50:06 juju-e4d256-prod-github-runner-207 kernel: [66380.577438] Call Trace: Aug 22 23:50:06 juju-e4d256-prod-github-runner-207 kernel: [66380.578693] Aug 22 23:50:06 juju-e4d256-prod-github-runner-207 kernel: [66380.579732] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:50:06 juju-e4d256-prod-github-runner-207 kernel: [66380.580782] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:50:06 juju-e4d256-prod-github-runner-207 kernel: [66380.581818] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:50:06 juju-e4d256-prod-github-runner-207 kernel: [66380.582984] ? show_regs.part.0+0x23/0x29 Aug 22 23:50:06 juju-e4d256-prod-github-runner-207 kernel: [66380.584049] ? show_regs.cold+0x8/0xd Aug 22 23:50:06 juju-e4d256-prod-github-runner-207 kernel: [66380.585064] ? watchdog_timer_fn+0x1be/0x220 Aug 22 23:50:06 juju-e4d256-prod-github-runner-207 kernel: [66380.586139] ? lockup_detector_update_enable+0x60/0x60 Aug 22 23:50:06 juju-e4d256-prod-github-runner-207 kernel: [66380.587321] ? __hrtimer_run_queues+0x107/0x230 Aug 22 23:50:06 juju-e4d256-prod-github-runner-207 kernel: [66380.588427] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 23:50:06 juju-e4d256-prod-github-runner-207 kernel: [66380.589509] ? hrtimer_interrupt+0x101/0x220 Aug 22 23:50:06 juju-e4d256-prod-github-runner-207 kernel: [66380.590564] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 23:50:06 juju-e4d256-prod-github-runner-207 kernel: [66380.591702] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 23:50:06 juju-e4d256-prod-github-runner-207 kernel: [66380.592801] Aug 22 23:50:06 juju-e4d256-prod-github-runner-207 kernel: [66380.593712] Aug 22 23:50:06 juju-e4d256-prod-github-runner-207 kernel: [66380.594572] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 23:50:06 juju-e4d256-prod-github-runner-207 kernel: [66380.595666] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:50:06 juju-e4d256-prod-github-runner-207 kernel: [66380.596768] ? _raw_spin_lock+0x22/0x30 Aug 22 23:50:06 juju-e4d256-prod-github-runner-207 kernel: [66380.597775] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:50:06 juju-e4d256-prod-github-runner-207 kernel: [66380.598954] direct_page_fault+0x206/0x310 [kvm] Aug 22 23:50:06 juju-e4d256-prod-github-runner-207 kernel: [66380.600034] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 23:50:06 juju-e4d256-prod-github-runner-207 kernel: [66380.601091] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 23:50:06 juju-e4d256-prod-github-runner-207 kernel: [66380.602149] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 23:50:06 juju-e4d256-prod-github-runner-207 kernel: [66380.603205] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 23:50:06 juju-e4d256-prod-github-runner-207 kernel: [66380.604215] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 23:50:06 juju-e4d256-prod-github-runner-207 kernel: [66380.605259] handle_exit+0x98/0x230 [kvm_amd] Aug 22 23:50:06 juju-e4d256-prod-github-runner-207 kernel: [66380.606192] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 23:50:06 juju-e4d256-prod-github-runner-207 kernel: [66380.607174] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 23:50:06 juju-e4d256-prod-github-runner-207 kernel: [66380.608146] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 23:50:06 juju-e4d256-prod-github-runner-207 kernel: [66380.609120] vcpu_run+0x62/0x2c0 [kvm] Aug 22 23:50:06 juju-e4d256-prod-github-runner-207 kernel: [66380.609967] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 23:50:06 juju-e4d256-prod-github-runner-207 kernel: [66380.610835] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 23:50:06 juju-e4d256-prod-github-runner-207 kernel: [66380.611743] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 23:50:06 juju-e4d256-prod-github-runner-207 kernel: [66380.612579] ? __seccomp_filter+0x4a/0x4a0 Aug 22 23:50:06 juju-e4d256-prod-github-runner-207 kernel: [66380.613377] ? __fget_files+0x86/0xc0 Aug 22 23:50:06 juju-e4d256-prod-github-runner-207 kernel: [66380.614123] __x64_sys_ioctl+0x95/0xd0 Aug 22 23:50:06 juju-e4d256-prod-github-runner-207 kernel: [66380.614881] do_syscall_64+0x5c/0xc0 Aug 22 23:50:06 juju-e4d256-prod-github-runner-207 kernel: [66380.615574] ? do_futex+0x162/0x1f0 Aug 22 23:50:06 juju-e4d256-prod-github-runner-207 kernel: [66380.616304] ? __x64_sys_futex+0x78/0x1e0 Aug 22 23:50:06 juju-e4d256-prod-github-runner-207 kernel: [66380.616999] ? __secure_computing+0xa9/0x120 Aug 22 23:50:06 juju-e4d256-prod-github-runner-207 kernel: [66380.617705] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 23:50:06 juju-e4d256-prod-github-runner-207 kernel: [66380.618505] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:50:06 juju-e4d256-prod-github-runner-207 kernel: [66380.619334] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:50:06 juju-e4d256-prod-github-runner-207 kernel: [66380.620072] ? do_syscall_64+0x69/0xc0 Aug 22 23:50:06 juju-e4d256-prod-github-runner-207 kernel: [66380.620728] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:50:06 juju-e4d256-prod-github-runner-207 kernel: [66380.621456] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:50:06 juju-e4d256-prod-github-runner-207 kernel: [66380.622169] ? do_syscall_64+0x69/0xc0 Aug 22 23:50:06 juju-e4d256-prod-github-runner-207 kernel: [66380.622824] ? do_syscall_64+0x69/0xc0 Aug 22 23:50:06 juju-e4d256-prod-github-runner-207 kernel: [66380.623470] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 23:50:06 juju-e4d256-prod-github-runner-207 kernel: [66380.624250] RIP: 0033:0x7faa5d0edaff Aug 22 23:50:06 juju-e4d256-prod-github-runner-207 kernel: [66380.624933] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 23:50:06 juju-e4d256-prod-github-runner-207 kernel: [66380.627055] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 23:50:06 juju-e4d256-prod-github-runner-207 kernel: [66380.628003] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 23:50:06 juju-e4d256-prod-github-runner-207 kernel: [66380.628932] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 23:50:06 juju-e4d256-prod-github-runner-207 kernel: [66380.629864] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 23:50:06 juju-e4d256-prod-github-runner-207 kernel: [66380.630982] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 23:50:06 juju-e4d256-prod-github-runner-207 kernel: [66380.632219] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 23:50:06 juju-e4d256-prod-github-runner-207 kernel: [66380.633432] Aug 22 23:50:34 juju-e4d256-prod-github-runner-207 kernel: [66408.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 61739s! [qemu-system-x86:6715] Aug 22 23:50:34 juju-e4d256-prod-github-runner-207 kernel: [66408.543892] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 23:50:34 juju-e4d256-prod-github-runner-207 kernel: [66408.544202] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 23:50:34 juju-e4d256-prod-github-runner-207 kernel: [66408.556935] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 23:50:34 juju-e4d256-prod-github-runner-207 kernel: [66408.558215] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 23:50:34 juju-e4d256-prod-github-runner-207 kernel: [66408.559476] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:50:34 juju-e4d256-prod-github-runner-207 kernel: [66408.560561] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 23:50:34 juju-e4d256-prod-github-runner-207 kernel: [66408.563130] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 23:50:34 juju-e4d256-prod-github-runner-207 kernel: [66408.564206] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 23:50:34 juju-e4d256-prod-github-runner-207 kernel: [66408.565399] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 23:50:34 juju-e4d256-prod-github-runner-207 kernel: [66408.566616] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 23:50:34 juju-e4d256-prod-github-runner-207 kernel: [66408.567788] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 23:50:34 juju-e4d256-prod-github-runner-207 kernel: [66408.568997] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 23:50:34 juju-e4d256-prod-github-runner-207 kernel: [66408.570180] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 23:50:34 juju-e4d256-prod-github-runner-207 kernel: [66408.571451] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 23:50:34 juju-e4d256-prod-github-runner-207 kernel: [66408.572556] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 23:50:34 juju-e4d256-prod-github-runner-207 kernel: [66408.573816] Call Trace: Aug 22 23:50:34 juju-e4d256-prod-github-runner-207 kernel: [66408.574752] Aug 22 23:50:34 juju-e4d256-prod-github-runner-207 kernel: [66408.575668] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:50:34 juju-e4d256-prod-github-runner-207 kernel: [66408.576720] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:50:34 juju-e4d256-prod-github-runner-207 kernel: [66408.577747] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:50:34 juju-e4d256-prod-github-runner-207 kernel: [66408.578860] ? show_regs.part.0+0x23/0x29 Aug 22 23:50:34 juju-e4d256-prod-github-runner-207 kernel: [66408.579891] ? show_regs.cold+0x8/0xd Aug 22 23:50:34 juju-e4d256-prod-github-runner-207 kernel: [66408.581051] ? watchdog_timer_fn+0x1be/0x220 Aug 22 23:50:34 juju-e4d256-prod-github-runner-207 kernel: [66408.582128] ? lockup_detector_update_enable+0x60/0x60 Aug 22 23:50:34 juju-e4d256-prod-github-runner-207 kernel: [66408.583260] ? __hrtimer_run_queues+0x107/0x230 Aug 22 23:50:34 juju-e4d256-prod-github-runner-207 kernel: [66408.584296] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 23:50:34 juju-e4d256-prod-github-runner-207 kernel: [66408.585326] ? hrtimer_interrupt+0x101/0x220 Aug 22 23:50:34 juju-e4d256-prod-github-runner-207 kernel: [66408.586370] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 23:50:34 juju-e4d256-prod-github-runner-207 kernel: [66408.587460] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 23:50:34 juju-e4d256-prod-github-runner-207 kernel: [66408.588532] Aug 22 23:50:34 juju-e4d256-prod-github-runner-207 kernel: [66408.589399] Aug 22 23:50:34 juju-e4d256-prod-github-runner-207 kernel: [66408.590238] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 23:50:34 juju-e4d256-prod-github-runner-207 kernel: [66408.591310] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:50:34 juju-e4d256-prod-github-runner-207 kernel: [66408.592377] ? _raw_spin_lock+0x22/0x30 Aug 22 23:50:34 juju-e4d256-prod-github-runner-207 kernel: [66408.593330] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:50:34 juju-e4d256-prod-github-runner-207 kernel: [66408.594379] direct_page_fault+0x206/0x310 [kvm] Aug 22 23:50:34 juju-e4d256-prod-github-runner-207 kernel: [66408.595407] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 23:50:34 juju-e4d256-prod-github-runner-207 kernel: [66408.596437] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 23:50:34 juju-e4d256-prod-github-runner-207 kernel: [66408.597459] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 23:50:34 juju-e4d256-prod-github-runner-207 kernel: [66408.598582] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 23:50:34 juju-e4d256-prod-github-runner-207 kernel: [66408.599537] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 23:50:34 juju-e4d256-prod-github-runner-207 kernel: [66408.600683] handle_exit+0x98/0x230 [kvm_amd] Aug 22 23:50:34 juju-e4d256-prod-github-runner-207 kernel: [66408.601594] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 23:50:34 juju-e4d256-prod-github-runner-207 kernel: [66408.602547] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 23:50:34 juju-e4d256-prod-github-runner-207 kernel: [66408.603482] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 23:50:34 juju-e4d256-prod-github-runner-207 kernel: [66408.604393] vcpu_run+0x62/0x2c0 [kvm] Aug 22 23:50:34 juju-e4d256-prod-github-runner-207 kernel: [66408.605209] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 23:50:34 juju-e4d256-prod-github-runner-207 kernel: [66408.606027] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 23:50:34 juju-e4d256-prod-github-runner-207 kernel: [66408.606916] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 23:50:34 juju-e4d256-prod-github-runner-207 kernel: [66408.607794] ? __seccomp_filter+0x4a/0x4a0 Aug 22 23:50:34 juju-e4d256-prod-github-runner-207 kernel: [66408.608558] ? __fget_files+0x86/0xc0 Aug 22 23:50:34 juju-e4d256-prod-github-runner-207 kernel: [66408.609277] __x64_sys_ioctl+0x95/0xd0 Aug 22 23:50:34 juju-e4d256-prod-github-runner-207 kernel: [66408.610039] do_syscall_64+0x5c/0xc0 Aug 22 23:50:34 juju-e4d256-prod-github-runner-207 kernel: [66408.610891] ? do_futex+0x162/0x1f0 Aug 22 23:50:34 juju-e4d256-prod-github-runner-207 kernel: [66408.611565] ? __x64_sys_futex+0x78/0x1e0 Aug 22 23:50:34 juju-e4d256-prod-github-runner-207 kernel: [66408.612246] ? __secure_computing+0xa9/0x120 Aug 22 23:50:34 juju-e4d256-prod-github-runner-207 kernel: [66408.612950] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 23:50:34 juju-e4d256-prod-github-runner-207 kernel: [66408.613717] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:50:34 juju-e4d256-prod-github-runner-207 kernel: [66408.614467] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:50:34 juju-e4d256-prod-github-runner-207 kernel: [66408.615198] ? do_syscall_64+0x69/0xc0 Aug 22 23:50:34 juju-e4d256-prod-github-runner-207 kernel: [66408.615847] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:50:34 juju-e4d256-prod-github-runner-207 kernel: [66408.616567] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:50:34 juju-e4d256-prod-github-runner-207 kernel: [66408.617275] ? do_syscall_64+0x69/0xc0 Aug 22 23:50:34 juju-e4d256-prod-github-runner-207 kernel: [66408.617917] ? do_syscall_64+0x69/0xc0 Aug 22 23:50:34 juju-e4d256-prod-github-runner-207 kernel: [66408.618554] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 23:50:34 juju-e4d256-prod-github-runner-207 kernel: [66408.619264] RIP: 0033:0x7faa5d0edaff Aug 22 23:50:34 juju-e4d256-prod-github-runner-207 kernel: [66408.619956] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 23:50:34 juju-e4d256-prod-github-runner-207 kernel: [66408.621982] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 23:50:34 juju-e4d256-prod-github-runner-207 kernel: [66408.623795] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 23:50:34 juju-e4d256-prod-github-runner-207 kernel: [66408.624693] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 23:50:34 juju-e4d256-prod-github-runner-207 kernel: [66408.625587] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 23:50:34 juju-e4d256-prod-github-runner-207 kernel: [66408.626493] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 23:50:34 juju-e4d256-prod-github-runner-207 kernel: [66408.627416] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 23:50:34 juju-e4d256-prod-github-runner-207 kernel: [66408.628351] Aug 22 23:50:47 juju-e4d256-prod-github-runner-207 kernel: [66421.616707] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 23:50:47 juju-e4d256-prod-github-runner-207 kernel: [66421.617702] rcu: 1-....: (16523843 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=7977225 Aug 22 23:50:47 juju-e4d256-prod-github-runner-207 kernel: [66421.618880] (t=16576104 jiffies g=23269 q=58092) Aug 22 23:50:47 juju-e4d256-prod-github-runner-207 kernel: [66421.620064] NMI backtrace for cpu 1 Aug 22 23:50:47 juju-e4d256-prod-github-runner-207 kernel: [66421.621297] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 23:50:47 juju-e4d256-prod-github-runner-207 kernel: [66421.622451] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 23:50:47 juju-e4d256-prod-github-runner-207 kernel: [66421.623536] Call Trace: Aug 22 23:50:47 juju-e4d256-prod-github-runner-207 kernel: [66421.624342] Aug 22 23:50:47 juju-e4d256-prod-github-runner-207 kernel: [66421.625258] show_stack+0x52/0x5c Aug 22 23:50:47 juju-e4d256-prod-github-runner-207 kernel: [66421.626085] dump_stack_lvl+0x4a/0x63 Aug 22 23:50:47 juju-e4d256-prod-github-runner-207 kernel: [66421.626880] dump_stack+0x10/0x16 Aug 22 23:50:47 juju-e4d256-prod-github-runner-207 kernel: [66421.627611] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 23:50:47 juju-e4d256-prod-github-runner-207 kernel: [66421.628405] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 23:50:47 juju-e4d256-prod-github-runner-207 kernel: [66421.629258] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 23:50:47 juju-e4d256-prod-github-runner-207 kernel: [66421.630096] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 23:50:47 juju-e4d256-prod-github-runner-207 kernel: [66421.630980] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 23:50:47 juju-e4d256-prod-github-runner-207 kernel: [66421.631825] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 23:50:47 juju-e4d256-prod-github-runner-207 kernel: [66421.632630] print_cpu_stall.cold+0x2f/0xe2 Aug 22 23:50:47 juju-e4d256-prod-github-runner-207 kernel: [66421.633406] ? timekeeping_update+0xf7/0x150 Aug 22 23:50:47 juju-e4d256-prod-github-runner-207 kernel: [66421.634203] check_cpu_stall+0x109/0x270 Aug 22 23:50:47 juju-e4d256-prod-github-runner-207 kernel: [66421.634965] rcu_sched_clock_irq+0x9a/0x250 Aug 22 23:50:47 juju-e4d256-prod-github-runner-207 kernel: [66421.635773] update_process_times+0x94/0xd0 Aug 22 23:50:47 juju-e4d256-prod-github-runner-207 kernel: [66421.636558] tick_sched_handle+0x29/0x70 Aug 22 23:50:47 juju-e4d256-prod-github-runner-207 kernel: [66421.637332] tick_sched_timer+0x8c/0xc0 Aug 22 23:50:47 juju-e4d256-prod-github-runner-207 kernel: [66421.638084] ? tick_nohz_handler+0xb0/0xb0 Aug 22 23:50:47 juju-e4d256-prod-github-runner-207 kernel: [66421.638906] __hrtimer_run_queues+0x107/0x230 Aug 22 23:50:47 juju-e4d256-prod-github-runner-207 kernel: [66421.639705] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 23:50:47 juju-e4d256-prod-github-runner-207 kernel: [66421.640507] hrtimer_interrupt+0x101/0x220 Aug 22 23:50:47 juju-e4d256-prod-github-runner-207 kernel: [66421.641303] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 23:50:47 juju-e4d256-prod-github-runner-207 kernel: [66421.642159] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 23:50:47 juju-e4d256-prod-github-runner-207 kernel: [66421.643024] Aug 22 23:50:47 juju-e4d256-prod-github-runner-207 kernel: [66421.643750] Aug 22 23:50:47 juju-e4d256-prod-github-runner-207 kernel: [66421.644493] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 23:50:47 juju-e4d256-prod-github-runner-207 kernel: [66421.645436] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:50:47 juju-e4d256-prod-github-runner-207 kernel: [66421.646599] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 23:50:47 juju-e4d256-prod-github-runner-207 kernel: [66421.648953] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 23:50:47 juju-e4d256-prod-github-runner-207 kernel: [66421.649844] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 23:50:47 juju-e4d256-prod-github-runner-207 kernel: [66421.650894] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 23:50:47 juju-e4d256-prod-github-runner-207 kernel: [66421.651918] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 23:50:47 juju-e4d256-prod-github-runner-207 kernel: [66421.652910] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 23:50:47 juju-e4d256-prod-github-runner-207 kernel: [66421.653885] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 23:50:47 juju-e4d256-prod-github-runner-207 kernel: [66421.654954] ? _raw_spin_lock+0x22/0x30 Aug 22 23:50:47 juju-e4d256-prod-github-runner-207 kernel: [66421.655727] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:50:47 juju-e4d256-prod-github-runner-207 kernel: [66421.656628] direct_page_fault+0x206/0x310 [kvm] Aug 22 23:50:47 juju-e4d256-prod-github-runner-207 kernel: [66421.657490] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 23:50:47 juju-e4d256-prod-github-runner-207 kernel: [66421.658352] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 23:50:47 juju-e4d256-prod-github-runner-207 kernel: [66421.659207] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 23:50:47 juju-e4d256-prod-github-runner-207 kernel: [66421.660056] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 23:50:47 juju-e4d256-prod-github-runner-207 kernel: [66421.660881] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 23:50:47 juju-e4d256-prod-github-runner-207 kernel: [66421.661722] handle_exit+0x98/0x230 [kvm_amd] Aug 22 23:50:47 juju-e4d256-prod-github-runner-207 kernel: [66421.662505] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 23:50:47 juju-e4d256-prod-github-runner-207 kernel: [66421.663326] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 23:50:47 juju-e4d256-prod-github-runner-207 kernel: [66421.664143] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 23:50:47 juju-e4d256-prod-github-runner-207 kernel: [66421.664943] vcpu_run+0x62/0x2c0 [kvm] Aug 22 23:50:47 juju-e4d256-prod-github-runner-207 kernel: [66421.665674] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 23:50:47 juju-e4d256-prod-github-runner-207 kernel: [66421.666473] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 23:50:47 juju-e4d256-prod-github-runner-207 kernel: [66421.667304] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 23:50:47 juju-e4d256-prod-github-runner-207 kernel: [66421.668076] ? __seccomp_filter+0x4a/0x4a0 Aug 22 23:50:47 juju-e4d256-prod-github-runner-207 kernel: [66421.668820] ? __fget_files+0x86/0xc0 Aug 22 23:50:47 juju-e4d256-prod-github-runner-207 kernel: [66421.669524] __x64_sys_ioctl+0x95/0xd0 Aug 22 23:50:47 juju-e4d256-prod-github-runner-207 kernel: [66421.670274] do_syscall_64+0x5c/0xc0 Aug 22 23:50:47 juju-e4d256-prod-github-runner-207 kernel: [66421.670969] ? do_futex+0x162/0x1f0 Aug 22 23:50:47 juju-e4d256-prod-github-runner-207 kernel: [66421.671652] ? __x64_sys_futex+0x78/0x1e0 Aug 22 23:50:47 juju-e4d256-prod-github-runner-207 kernel: [66421.672378] ? __secure_computing+0xa9/0x120 Aug 22 23:50:47 juju-e4d256-prod-github-runner-207 kernel: [66421.673114] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 23:50:47 juju-e4d256-prod-github-runner-207 kernel: [66421.673931] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:50:47 juju-e4d256-prod-github-runner-207 kernel: [66421.674771] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:50:47 juju-e4d256-prod-github-runner-207 kernel: [66421.675733] ? do_syscall_64+0x69/0xc0 Aug 22 23:50:47 juju-e4d256-prod-github-runner-207 kernel: [66421.676607] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:50:47 juju-e4d256-prod-github-runner-207 kernel: [66421.677381] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:50:47 juju-e4d256-prod-github-runner-207 kernel: [66421.678179] ? do_syscall_64+0x69/0xc0 Aug 22 23:50:47 juju-e4d256-prod-github-runner-207 kernel: [66421.678885] ? do_syscall_64+0x69/0xc0 Aug 22 23:50:47 juju-e4d256-prod-github-runner-207 kernel: [66421.679588] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 23:50:47 juju-e4d256-prod-github-runner-207 kernel: [66421.680376] RIP: 0033:0x7faa5d0edaff Aug 22 23:50:47 juju-e4d256-prod-github-runner-207 kernel: [66421.681074] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 23:50:47 juju-e4d256-prod-github-runner-207 kernel: [66421.683309] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 23:50:47 juju-e4d256-prod-github-runner-207 kernel: [66421.684578] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 23:50:47 juju-e4d256-prod-github-runner-207 kernel: [66421.685572] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 23:50:47 juju-e4d256-prod-github-runner-207 kernel: [66421.686572] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 23:50:47 juju-e4d256-prod-github-runner-207 kernel: [66421.687552] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 23:50:47 juju-e4d256-prod-github-runner-207 kernel: [66421.688532] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 23:50:47 juju-e4d256-prod-github-runner-207 kernel: [66421.689474] Aug 22 23:51:14 juju-e4d256-prod-github-runner-207 kernel: [66448.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 61777s! [qemu-system-x86:6715] Aug 22 23:51:14 juju-e4d256-prod-github-runner-207 kernel: [66448.543130] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 23:51:14 juju-e4d256-prod-github-runner-207 kernel: [66448.543205] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 23:51:14 juju-e4d256-prod-github-runner-207 kernel: [66448.555443] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 23:51:14 juju-e4d256-prod-github-runner-207 kernel: [66448.556827] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 23:51:14 juju-e4d256-prod-github-runner-207 kernel: [66448.558298] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:51:14 juju-e4d256-prod-github-runner-207 kernel: [66448.559368] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 23:51:14 juju-e4d256-prod-github-runner-207 kernel: [66448.561947] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 23:51:14 juju-e4d256-prod-github-runner-207 kernel: [66448.562988] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 23:51:14 juju-e4d256-prod-github-runner-207 kernel: [66448.564162] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 23:51:14 juju-e4d256-prod-github-runner-207 kernel: [66448.565337] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 23:51:14 juju-e4d256-prod-github-runner-207 kernel: [66448.566503] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 23:51:14 juju-e4d256-prod-github-runner-207 kernel: [66448.567685] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 23:51:14 juju-e4d256-prod-github-runner-207 kernel: [66448.568864] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 23:51:14 juju-e4d256-prod-github-runner-207 kernel: [66448.570142] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 23:51:14 juju-e4d256-prod-github-runner-207 kernel: [66448.571264] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 23:51:14 juju-e4d256-prod-github-runner-207 kernel: [66448.572506] Call Trace: Aug 22 23:51:14 juju-e4d256-prod-github-runner-207 kernel: [66448.573434] Aug 22 23:51:14 juju-e4d256-prod-github-runner-207 kernel: [66448.574338] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:51:14 juju-e4d256-prod-github-runner-207 kernel: [66448.575385] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:51:14 juju-e4d256-prod-github-runner-207 kernel: [66448.576411] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:51:14 juju-e4d256-prod-github-runner-207 kernel: [66448.577504] ? show_regs.part.0+0x23/0x29 Aug 22 23:51:14 juju-e4d256-prod-github-runner-207 kernel: [66448.578523] ? show_regs.cold+0x8/0xd Aug 22 23:51:14 juju-e4d256-prod-github-runner-207 kernel: [66448.579498] ? watchdog_timer_fn+0x1be/0x220 Aug 22 23:51:14 juju-e4d256-prod-github-runner-207 kernel: [66448.580537] ? lockup_detector_update_enable+0x60/0x60 Aug 22 23:51:14 juju-e4d256-prod-github-runner-207 kernel: [66448.581619] ? __hrtimer_run_queues+0x107/0x230 Aug 22 23:51:14 juju-e4d256-prod-github-runner-207 kernel: [66448.582683] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 23:51:14 juju-e4d256-prod-github-runner-207 kernel: [66448.583710] ? hrtimer_interrupt+0x101/0x220 Aug 22 23:51:14 juju-e4d256-prod-github-runner-207 kernel: [66448.584728] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 23:51:14 juju-e4d256-prod-github-runner-207 kernel: [66448.585812] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 23:51:14 juju-e4d256-prod-github-runner-207 kernel: [66448.586883] Aug 22 23:51:14 juju-e4d256-prod-github-runner-207 kernel: [66448.587740] Aug 22 23:51:14 juju-e4d256-prod-github-runner-207 kernel: [66448.588598] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 23:51:14 juju-e4d256-prod-github-runner-207 kernel: [66448.589734] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:51:14 juju-e4d256-prod-github-runner-207 kernel: [66448.590862] ? _raw_spin_lock+0x22/0x30 Aug 22 23:51:14 juju-e4d256-prod-github-runner-207 kernel: [66448.591815] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:51:14 juju-e4d256-prod-github-runner-207 kernel: [66448.592851] direct_page_fault+0x206/0x310 [kvm] Aug 22 23:51:14 juju-e4d256-prod-github-runner-207 kernel: [66448.593912] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 23:51:14 juju-e4d256-prod-github-runner-207 kernel: [66448.594968] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 23:51:14 juju-e4d256-prod-github-runner-207 kernel: [66448.595995] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 23:51:14 juju-e4d256-prod-github-runner-207 kernel: [66448.596994] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 23:51:14 juju-e4d256-prod-github-runner-207 kernel: [66448.597983] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 23:51:14 juju-e4d256-prod-github-runner-207 kernel: [66448.599003] handle_exit+0x98/0x230 [kvm_amd] Aug 22 23:51:14 juju-e4d256-prod-github-runner-207 kernel: [66448.600140] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 23:51:14 juju-e4d256-prod-github-runner-207 kernel: [66448.601128] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 23:51:14 juju-e4d256-prod-github-runner-207 kernel: [66448.602098] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 23:51:14 juju-e4d256-prod-github-runner-207 kernel: [66448.603022] vcpu_run+0x62/0x2c0 [kvm] Aug 22 23:51:14 juju-e4d256-prod-github-runner-207 kernel: [66448.603853] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 23:51:14 juju-e4d256-prod-github-runner-207 kernel: [66448.604677] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 23:51:14 juju-e4d256-prod-github-runner-207 kernel: [66448.605592] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 23:51:14 juju-e4d256-prod-github-runner-207 kernel: [66448.606464] ? __seccomp_filter+0x4a/0x4a0 Aug 22 23:51:14 juju-e4d256-prod-github-runner-207 kernel: [66448.607230] ? __fget_files+0x86/0xc0 Aug 22 23:51:14 juju-e4d256-prod-github-runner-207 kernel: [66448.607975] __x64_sys_ioctl+0x95/0xd0 Aug 22 23:51:14 juju-e4d256-prod-github-runner-207 kernel: [66448.608717] do_syscall_64+0x5c/0xc0 Aug 22 23:51:14 juju-e4d256-prod-github-runner-207 kernel: [66448.609406] ? do_futex+0x162/0x1f0 Aug 22 23:51:14 juju-e4d256-prod-github-runner-207 kernel: [66448.610082] ? __x64_sys_futex+0x78/0x1e0 Aug 22 23:51:14 juju-e4d256-prod-github-runner-207 kernel: [66448.610786] ? __secure_computing+0xa9/0x120 Aug 22 23:51:14 juju-e4d256-prod-github-runner-207 kernel: [66448.611497] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 23:51:14 juju-e4d256-prod-github-runner-207 kernel: [66448.612290] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:51:14 juju-e4d256-prod-github-runner-207 kernel: [66448.613046] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:51:14 juju-e4d256-prod-github-runner-207 kernel: [66448.613797] ? do_syscall_64+0x69/0xc0 Aug 22 23:51:14 juju-e4d256-prod-github-runner-207 kernel: [66448.614494] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:51:14 juju-e4d256-prod-github-runner-207 kernel: [66448.615218] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:51:14 juju-e4d256-prod-github-runner-207 kernel: [66448.615975] ? do_syscall_64+0x69/0xc0 Aug 22 23:51:14 juju-e4d256-prod-github-runner-207 kernel: [66448.616613] ? do_syscall_64+0x69/0xc0 Aug 22 23:51:14 juju-e4d256-prod-github-runner-207 kernel: [66448.617255] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 23:51:14 juju-e4d256-prod-github-runner-207 kernel: [66448.618028] RIP: 0033:0x7faa5d0edaff Aug 22 23:51:14 juju-e4d256-prod-github-runner-207 kernel: [66448.618679] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 23:51:14 juju-e4d256-prod-github-runner-207 kernel: [66448.620765] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 23:51:14 juju-e4d256-prod-github-runner-207 kernel: [66448.621731] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 23:51:14 juju-e4d256-prod-github-runner-207 kernel: [66448.622703] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 23:51:14 juju-e4d256-prod-github-runner-207 kernel: [66448.623634] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 23:51:14 juju-e4d256-prod-github-runner-207 kernel: [66448.624561] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 23:51:14 juju-e4d256-prod-github-runner-207 kernel: [66448.625475] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 23:51:14 juju-e4d256-prod-github-runner-207 kernel: [66448.626411] Aug 22 23:51:42 juju-e4d256-prod-github-runner-207 kernel: [66476.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 61803s! [qemu-system-x86:6715] Aug 22 23:51:42 juju-e4d256-prod-github-runner-207 kernel: [66476.543099] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 23:51:42 juju-e4d256-prod-github-runner-207 kernel: [66476.543170] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 23:51:42 juju-e4d256-prod-github-runner-207 kernel: [66476.555378] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 23:51:42 juju-e4d256-prod-github-runner-207 kernel: [66476.556708] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 23:51:42 juju-e4d256-prod-github-runner-207 kernel: [66476.557975] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:51:42 juju-e4d256-prod-github-runner-207 kernel: [66476.559040] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 23:51:42 juju-e4d256-prod-github-runner-207 kernel: [66476.561667] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 23:51:42 juju-e4d256-prod-github-runner-207 kernel: [66476.562728] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 23:51:42 juju-e4d256-prod-github-runner-207 kernel: [66476.563923] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 23:51:42 juju-e4d256-prod-github-runner-207 kernel: [66476.565135] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 23:51:42 juju-e4d256-prod-github-runner-207 kernel: [66476.566330] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 23:51:42 juju-e4d256-prod-github-runner-207 kernel: [66476.567504] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 23:51:42 juju-e4d256-prod-github-runner-207 kernel: [66476.568679] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 23:51:42 juju-e4d256-prod-github-runner-207 kernel: [66476.570078] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 23:51:42 juju-e4d256-prod-github-runner-207 kernel: [66476.571180] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 23:51:42 juju-e4d256-prod-github-runner-207 kernel: [66476.572381] Call Trace: Aug 22 23:51:42 juju-e4d256-prod-github-runner-207 kernel: [66476.573355] Aug 22 23:51:42 juju-e4d256-prod-github-runner-207 kernel: [66476.574352] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:51:42 juju-e4d256-prod-github-runner-207 kernel: [66476.575406] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:51:42 juju-e4d256-prod-github-runner-207 kernel: [66476.576426] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:51:42 juju-e4d256-prod-github-runner-207 kernel: [66476.577513] ? show_regs.part.0+0x23/0x29 Aug 22 23:51:42 juju-e4d256-prod-github-runner-207 kernel: [66476.578532] ? show_regs.cold+0x8/0xd Aug 22 23:51:42 juju-e4d256-prod-github-runner-207 kernel: [66476.579503] ? watchdog_timer_fn+0x1be/0x220 Aug 22 23:51:42 juju-e4d256-prod-github-runner-207 kernel: [66476.580514] ? lockup_detector_update_enable+0x60/0x60 Aug 22 23:51:42 juju-e4d256-prod-github-runner-207 kernel: [66476.581592] ? __hrtimer_run_queues+0x107/0x230 Aug 22 23:51:42 juju-e4d256-prod-github-runner-207 kernel: [66476.582618] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 23:51:42 juju-e4d256-prod-github-runner-207 kernel: [66476.583640] ? hrtimer_interrupt+0x101/0x220 Aug 22 23:51:42 juju-e4d256-prod-github-runner-207 kernel: [66476.584652] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 23:51:42 juju-e4d256-prod-github-runner-207 kernel: [66476.585734] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 23:51:42 juju-e4d256-prod-github-runner-207 kernel: [66476.586778] Aug 22 23:51:42 juju-e4d256-prod-github-runner-207 kernel: [66476.587635] Aug 22 23:51:42 juju-e4d256-prod-github-runner-207 kernel: [66476.588475] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 23:51:42 juju-e4d256-prod-github-runner-207 kernel: [66476.589505] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:51:42 juju-e4d256-prod-github-runner-207 kernel: [66476.590550] ? _raw_spin_lock+0x22/0x30 Aug 22 23:51:42 juju-e4d256-prod-github-runner-207 kernel: [66476.591492] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:51:42 juju-e4d256-prod-github-runner-207 kernel: [66476.592508] direct_page_fault+0x206/0x310 [kvm] Aug 22 23:51:42 juju-e4d256-prod-github-runner-207 kernel: [66476.593530] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 23:51:42 juju-e4d256-prod-github-runner-207 kernel: [66476.594549] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 23:51:42 juju-e4d256-prod-github-runner-207 kernel: [66476.595547] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 23:51:42 juju-e4d256-prod-github-runner-207 kernel: [66476.596512] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 23:51:42 juju-e4d256-prod-github-runner-207 kernel: [66476.597453] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 23:51:42 juju-e4d256-prod-github-runner-207 kernel: [66476.598437] handle_exit+0x98/0x230 [kvm_amd] Aug 22 23:51:42 juju-e4d256-prod-github-runner-207 kernel: [66476.599332] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 23:51:42 juju-e4d256-prod-github-runner-207 kernel: [66476.600248] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 23:51:42 juju-e4d256-prod-github-runner-207 kernel: [66476.601185] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 23:51:42 juju-e4d256-prod-github-runner-207 kernel: [66476.602101] vcpu_run+0x62/0x2c0 [kvm] Aug 22 23:51:42 juju-e4d256-prod-github-runner-207 kernel: [66476.602914] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 23:51:42 juju-e4d256-prod-github-runner-207 kernel: [66476.603717] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 23:51:42 juju-e4d256-prod-github-runner-207 kernel: [66476.604569] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 23:51:42 juju-e4d256-prod-github-runner-207 kernel: [66476.605361] ? __seccomp_filter+0x4a/0x4a0 Aug 22 23:51:42 juju-e4d256-prod-github-runner-207 kernel: [66476.606115] ? __fget_files+0x86/0xc0 Aug 22 23:51:42 juju-e4d256-prod-github-runner-207 kernel: [66476.606817] __x64_sys_ioctl+0x95/0xd0 Aug 22 23:51:42 juju-e4d256-prod-github-runner-207 kernel: [66476.607505] do_syscall_64+0x5c/0xc0 Aug 22 23:51:42 juju-e4d256-prod-github-runner-207 kernel: [66476.608212] ? do_futex+0x162/0x1f0 Aug 22 23:51:42 juju-e4d256-prod-github-runner-207 kernel: [66476.608874] ? __x64_sys_futex+0x78/0x1e0 Aug 22 23:51:42 juju-e4d256-prod-github-runner-207 kernel: [66476.609566] ? __secure_computing+0xa9/0x120 Aug 22 23:51:42 juju-e4d256-prod-github-runner-207 kernel: [66476.610253] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 23:51:42 juju-e4d256-prod-github-runner-207 kernel: [66476.611007] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:51:42 juju-e4d256-prod-github-runner-207 kernel: [66476.611728] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:51:42 juju-e4d256-prod-github-runner-207 kernel: [66476.612444] ? do_syscall_64+0x69/0xc0 Aug 22 23:51:42 juju-e4d256-prod-github-runner-207 kernel: [66476.613087] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:51:42 juju-e4d256-prod-github-runner-207 kernel: [66476.613796] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:51:42 juju-e4d256-prod-github-runner-207 kernel: [66476.614488] ? do_syscall_64+0x69/0xc0 Aug 22 23:51:42 juju-e4d256-prod-github-runner-207 kernel: [66476.615114] ? do_syscall_64+0x69/0xc0 Aug 22 23:51:42 juju-e4d256-prod-github-runner-207 kernel: [66476.615732] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 23:51:42 juju-e4d256-prod-github-runner-207 kernel: [66476.616544] RIP: 0033:0x7faa5d0edaff Aug 22 23:51:42 juju-e4d256-prod-github-runner-207 kernel: [66476.617241] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 23:51:42 juju-e4d256-prod-github-runner-207 kernel: [66476.619573] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 23:51:42 juju-e4d256-prod-github-runner-207 kernel: [66476.620617] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 23:51:42 juju-e4d256-prod-github-runner-207 kernel: [66476.621648] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 23:51:42 juju-e4d256-prod-github-runner-207 kernel: [66476.622668] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 23:51:42 juju-e4d256-prod-github-runner-207 kernel: [66476.623696] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 23:51:42 juju-e4d256-prod-github-runner-207 kernel: [66476.624726] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 23:51:42 juju-e4d256-prod-github-runner-207 kernel: [66476.625773] Aug 22 23:52:10 juju-e4d256-prod-github-runner-207 kernel: [66504.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 61829s! [qemu-system-x86:6715] Aug 22 23:52:10 juju-e4d256-prod-github-runner-207 kernel: [66504.543824] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 23:52:10 juju-e4d256-prod-github-runner-207 kernel: [66504.544105] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 23:52:10 juju-e4d256-prod-github-runner-207 kernel: [66504.556280] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 23:52:10 juju-e4d256-prod-github-runner-207 kernel: [66504.557575] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 23:52:10 juju-e4d256-prod-github-runner-207 kernel: [66504.558811] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:52:10 juju-e4d256-prod-github-runner-207 kernel: [66504.559876] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 23:52:10 juju-e4d256-prod-github-runner-207 kernel: [66504.562454] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 23:52:10 juju-e4d256-prod-github-runner-207 kernel: [66504.563516] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 23:52:10 juju-e4d256-prod-github-runner-207 kernel: [66504.564697] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 23:52:10 juju-e4d256-prod-github-runner-207 kernel: [66504.565880] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 23:52:10 juju-e4d256-prod-github-runner-207 kernel: [66504.567039] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 23:52:10 juju-e4d256-prod-github-runner-207 kernel: [66504.568230] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 23:52:10 juju-e4d256-prod-github-runner-207 kernel: [66504.569422] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 23:52:10 juju-e4d256-prod-github-runner-207 kernel: [66504.570667] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 23:52:10 juju-e4d256-prod-github-runner-207 kernel: [66504.571771] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 23:52:10 juju-e4d256-prod-github-runner-207 kernel: [66504.572962] Call Trace: Aug 22 23:52:10 juju-e4d256-prod-github-runner-207 kernel: [66504.573894] Aug 22 23:52:10 juju-e4d256-prod-github-runner-207 kernel: [66504.574794] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:52:10 juju-e4d256-prod-github-runner-207 kernel: [66504.575823] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:52:10 juju-e4d256-prod-github-runner-207 kernel: [66504.576842] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:52:10 juju-e4d256-prod-github-runner-207 kernel: [66504.577949] ? show_regs.part.0+0x23/0x29 Aug 22 23:52:10 juju-e4d256-prod-github-runner-207 kernel: [66504.578946] ? show_regs.cold+0x8/0xd Aug 22 23:52:10 juju-e4d256-prod-github-runner-207 kernel: [66504.579958] ? watchdog_timer_fn+0x1be/0x220 Aug 22 23:52:10 juju-e4d256-prod-github-runner-207 kernel: [66504.580966] ? lockup_detector_update_enable+0x60/0x60 Aug 22 23:52:10 juju-e4d256-prod-github-runner-207 kernel: [66504.582043] ? __hrtimer_run_queues+0x107/0x230 Aug 22 23:52:10 juju-e4d256-prod-github-runner-207 kernel: [66504.583084] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 23:52:10 juju-e4d256-prod-github-runner-207 kernel: [66504.584139] ? hrtimer_interrupt+0x101/0x220 Aug 22 23:52:10 juju-e4d256-prod-github-runner-207 kernel: [66504.585206] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 23:52:10 juju-e4d256-prod-github-runner-207 kernel: [66504.586336] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 23:52:10 juju-e4d256-prod-github-runner-207 kernel: [66504.587450] Aug 22 23:52:10 juju-e4d256-prod-github-runner-207 kernel: [66504.588312] Aug 22 23:52:10 juju-e4d256-prod-github-runner-207 kernel: [66504.589168] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 23:52:10 juju-e4d256-prod-github-runner-207 kernel: [66504.590300] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:52:10 juju-e4d256-prod-github-runner-207 kernel: [66504.591385] ? _raw_spin_lock+0x22/0x30 Aug 22 23:52:10 juju-e4d256-prod-github-runner-207 kernel: [66504.592392] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:52:10 juju-e4d256-prod-github-runner-207 kernel: [66504.593471] direct_page_fault+0x206/0x310 [kvm] Aug 22 23:52:10 juju-e4d256-prod-github-runner-207 kernel: [66504.594588] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 23:52:10 juju-e4d256-prod-github-runner-207 kernel: [66504.595661] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 23:52:10 juju-e4d256-prod-github-runner-207 kernel: [66504.596830] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 23:52:10 juju-e4d256-prod-github-runner-207 kernel: [66504.597874] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 23:52:10 juju-e4d256-prod-github-runner-207 kernel: [66504.598887] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 23:52:10 juju-e4d256-prod-github-runner-207 kernel: [66504.599884] handle_exit+0x98/0x230 [kvm_amd] Aug 22 23:52:10 juju-e4d256-prod-github-runner-207 kernel: [66504.600812] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 23:52:10 juju-e4d256-prod-github-runner-207 kernel: [66504.601777] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 23:52:10 juju-e4d256-prod-github-runner-207 kernel: [66504.602735] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 23:52:10 juju-e4d256-prod-github-runner-207 kernel: [66504.603685] vcpu_run+0x62/0x2c0 [kvm] Aug 22 23:52:10 juju-e4d256-prod-github-runner-207 kernel: [66504.604507] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 23:52:10 juju-e4d256-prod-github-runner-207 kernel: [66504.605364] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 23:52:10 juju-e4d256-prod-github-runner-207 kernel: [66504.608468] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 23:52:10 juju-e4d256-prod-github-runner-207 kernel: [66504.609338] ? __seccomp_filter+0x4a/0x4a0 Aug 22 23:52:10 juju-e4d256-prod-github-runner-207 kernel: [66504.610132] ? __fget_files+0x86/0xc0 Aug 22 23:52:10 juju-e4d256-prod-github-runner-207 kernel: [66504.610861] __x64_sys_ioctl+0x95/0xd0 Aug 22 23:52:10 juju-e4d256-prod-github-runner-207 kernel: [66504.611618] do_syscall_64+0x5c/0xc0 Aug 22 23:52:10 juju-e4d256-prod-github-runner-207 kernel: [66504.612352] ? do_futex+0x162/0x1f0 Aug 22 23:52:10 juju-e4d256-prod-github-runner-207 kernel: [66504.613153] ? __x64_sys_futex+0x78/0x1e0 Aug 22 23:52:10 juju-e4d256-prod-github-runner-207 kernel: [66504.613960] ? __secure_computing+0xa9/0x120 Aug 22 23:52:10 juju-e4d256-prod-github-runner-207 kernel: [66504.614771] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 23:52:10 juju-e4d256-prod-github-runner-207 kernel: [66504.615794] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:52:10 juju-e4d256-prod-github-runner-207 kernel: [66504.616631] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:52:10 juju-e4d256-prod-github-runner-207 kernel: [66504.617370] ? do_syscall_64+0x69/0xc0 Aug 22 23:52:10 juju-e4d256-prod-github-runner-207 kernel: [66504.618018] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:52:10 juju-e4d256-prod-github-runner-207 kernel: [66504.618726] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:52:10 juju-e4d256-prod-github-runner-207 kernel: [66504.619428] ? do_syscall_64+0x69/0xc0 Aug 22 23:52:10 juju-e4d256-prod-github-runner-207 kernel: [66504.620054] ? do_syscall_64+0x69/0xc0 Aug 22 23:52:10 juju-e4d256-prod-github-runner-207 kernel: [66504.620682] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 23:52:10 juju-e4d256-prod-github-runner-207 kernel: [66504.621411] RIP: 0033:0x7faa5d0edaff Aug 22 23:52:10 juju-e4d256-prod-github-runner-207 kernel: [66504.622109] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 23:52:10 juju-e4d256-prod-github-runner-207 kernel: [66504.624099] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 23:52:10 juju-e4d256-prod-github-runner-207 kernel: [66504.625017] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 23:52:10 juju-e4d256-prod-github-runner-207 kernel: [66504.625929] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 23:52:10 juju-e4d256-prod-github-runner-207 kernel: [66504.626820] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 23:52:10 juju-e4d256-prod-github-runner-207 kernel: [66504.627715] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 23:52:10 juju-e4d256-prod-github-runner-207 kernel: [66504.628605] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 23:52:10 juju-e4d256-prod-github-runner-207 kernel: [66504.629514] Aug 22 23:52:38 juju-e4d256-prod-github-runner-207 kernel: [66532.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 61855s! [qemu-system-x86:6715] Aug 22 23:52:38 juju-e4d256-prod-github-runner-207 kernel: [66532.543109] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 23:52:38 juju-e4d256-prod-github-runner-207 kernel: [66532.543186] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 23:52:38 juju-e4d256-prod-github-runner-207 kernel: [66532.555695] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 23:52:38 juju-e4d256-prod-github-runner-207 kernel: [66532.556966] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 23:52:38 juju-e4d256-prod-github-runner-207 kernel: [66532.558186] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:52:38 juju-e4d256-prod-github-runner-207 kernel: [66532.559248] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 23:52:38 juju-e4d256-prod-github-runner-207 kernel: [66532.561808] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 23:52:38 juju-e4d256-prod-github-runner-207 kernel: [66532.562852] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 23:52:38 juju-e4d256-prod-github-runner-207 kernel: [66532.564018] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 23:52:38 juju-e4d256-prod-github-runner-207 kernel: [66532.565190] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 23:52:38 juju-e4d256-prod-github-runner-207 kernel: [66532.566351] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 23:52:38 juju-e4d256-prod-github-runner-207 kernel: [66532.567510] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 23:52:38 juju-e4d256-prod-github-runner-207 kernel: [66532.568680] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 23:52:38 juju-e4d256-prod-github-runner-207 kernel: [66532.569936] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 23:52:38 juju-e4d256-prod-github-runner-207 kernel: [66532.571033] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 23:52:38 juju-e4d256-prod-github-runner-207 kernel: [66532.572224] Call Trace: Aug 22 23:52:38 juju-e4d256-prod-github-runner-207 kernel: [66532.573152] Aug 22 23:52:38 juju-e4d256-prod-github-runner-207 kernel: [66532.574036] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:52:38 juju-e4d256-prod-github-runner-207 kernel: [66532.575064] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:52:38 juju-e4d256-prod-github-runner-207 kernel: [66532.576083] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:52:38 juju-e4d256-prod-github-runner-207 kernel: [66532.577215] ? show_regs.part.0+0x23/0x29 Aug 22 23:52:38 juju-e4d256-prod-github-runner-207 kernel: [66532.578215] ? show_regs.cold+0x8/0xd Aug 22 23:52:38 juju-e4d256-prod-github-runner-207 kernel: [66532.579185] ? watchdog_timer_fn+0x1be/0x220 Aug 22 23:52:38 juju-e4d256-prod-github-runner-207 kernel: [66532.580191] ? lockup_detector_update_enable+0x60/0x60 Aug 22 23:52:38 juju-e4d256-prod-github-runner-207 kernel: [66532.581269] ? __hrtimer_run_queues+0x107/0x230 Aug 22 23:52:38 juju-e4d256-prod-github-runner-207 kernel: [66532.582295] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 23:52:38 juju-e4d256-prod-github-runner-207 kernel: [66532.583316] ? hrtimer_interrupt+0x101/0x220 Aug 22 23:52:38 juju-e4d256-prod-github-runner-207 kernel: [66532.584329] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 23:52:38 juju-e4d256-prod-github-runner-207 kernel: [66532.585444] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 23:52:38 juju-e4d256-prod-github-runner-207 kernel: [66532.586489] Aug 22 23:52:38 juju-e4d256-prod-github-runner-207 kernel: [66532.587346] Aug 22 23:52:38 juju-e4d256-prod-github-runner-207 kernel: [66532.588181] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 23:52:38 juju-e4d256-prod-github-runner-207 kernel: [66532.589245] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:52:38 juju-e4d256-prod-github-runner-207 kernel: [66532.590286] ? _raw_spin_lock+0x22/0x30 Aug 22 23:52:38 juju-e4d256-prod-github-runner-207 kernel: [66532.591231] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:52:38 juju-e4d256-prod-github-runner-207 kernel: [66532.592264] direct_page_fault+0x206/0x310 [kvm] Aug 22 23:52:38 juju-e4d256-prod-github-runner-207 kernel: [66532.593308] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 23:52:38 juju-e4d256-prod-github-runner-207 kernel: [66532.594316] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 23:52:38 juju-e4d256-prod-github-runner-207 kernel: [66532.595492] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 23:52:38 juju-e4d256-prod-github-runner-207 kernel: [66532.596614] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 23:52:38 juju-e4d256-prod-github-runner-207 kernel: [66532.597580] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 23:52:38 juju-e4d256-prod-github-runner-207 kernel: [66532.598555] handle_exit+0x98/0x230 [kvm_amd] Aug 22 23:52:38 juju-e4d256-prod-github-runner-207 kernel: [66532.599449] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 23:52:38 juju-e4d256-prod-github-runner-207 kernel: [66532.600360] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 23:52:38 juju-e4d256-prod-github-runner-207 kernel: [66532.601296] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 23:52:38 juju-e4d256-prod-github-runner-207 kernel: [66532.602203] vcpu_run+0x62/0x2c0 [kvm] Aug 22 23:52:38 juju-e4d256-prod-github-runner-207 kernel: [66532.603011] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 23:52:38 juju-e4d256-prod-github-runner-207 kernel: [66532.603833] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 23:52:38 juju-e4d256-prod-github-runner-207 kernel: [66532.604692] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 23:52:38 juju-e4d256-prod-github-runner-207 kernel: [66532.605499] ? __seccomp_filter+0x4a/0x4a0 Aug 22 23:52:38 juju-e4d256-prod-github-runner-207 kernel: [66532.606243] ? __fget_files+0x86/0xc0 Aug 22 23:52:38 juju-e4d256-prod-github-runner-207 kernel: [66532.606951] __x64_sys_ioctl+0x95/0xd0 Aug 22 23:52:38 juju-e4d256-prod-github-runner-207 kernel: [66532.607641] do_syscall_64+0x5c/0xc0 Aug 22 23:52:38 juju-e4d256-prod-github-runner-207 kernel: [66532.608302] ? do_futex+0x162/0x1f0 Aug 22 23:52:38 juju-e4d256-prod-github-runner-207 kernel: [66532.608960] ? __x64_sys_futex+0x78/0x1e0 Aug 22 23:52:38 juju-e4d256-prod-github-runner-207 kernel: [66532.609632] ? __secure_computing+0xa9/0x120 Aug 22 23:52:38 juju-e4d256-prod-github-runner-207 kernel: [66532.610317] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 23:52:38 juju-e4d256-prod-github-runner-207 kernel: [66532.611313] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:52:38 juju-e4d256-prod-github-runner-207 kernel: [66532.612036] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:52:38 juju-e4d256-prod-github-runner-207 kernel: [66532.612752] ? do_syscall_64+0x69/0xc0 Aug 22 23:52:38 juju-e4d256-prod-github-runner-207 kernel: [66532.613404] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:52:38 juju-e4d256-prod-github-runner-207 kernel: [66532.614111] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:52:38 juju-e4d256-prod-github-runner-207 kernel: [66532.614812] ? do_syscall_64+0x69/0xc0 Aug 22 23:52:38 juju-e4d256-prod-github-runner-207 kernel: [66532.615435] ? do_syscall_64+0x69/0xc0 Aug 22 23:52:38 juju-e4d256-prod-github-runner-207 kernel: [66532.616056] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 23:52:38 juju-e4d256-prod-github-runner-207 kernel: [66532.616760] RIP: 0033:0x7faa5d0edaff Aug 22 23:52:38 juju-e4d256-prod-github-runner-207 kernel: [66532.617400] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 23:52:38 juju-e4d256-prod-github-runner-207 kernel: [66532.619689] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 23:52:38 juju-e4d256-prod-github-runner-207 kernel: [66532.620599] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 23:52:38 juju-e4d256-prod-github-runner-207 kernel: [66532.621499] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 23:52:38 juju-e4d256-prod-github-runner-207 kernel: [66532.622387] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 23:52:38 juju-e4d256-prod-github-runner-207 kernel: [66532.623274] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 23:52:38 juju-e4d256-prod-github-runner-207 kernel: [66532.624160] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 23:52:38 juju-e4d256-prod-github-runner-207 kernel: [66532.625066] Aug 22 23:53:06 juju-e4d256-prod-github-runner-207 kernel: [66560.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 61881s! [qemu-system-x86:6715] Aug 22 23:53:06 juju-e4d256-prod-github-runner-207 kernel: [66560.543149] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 23:53:06 juju-e4d256-prod-github-runner-207 kernel: [66560.543233] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 23:53:06 juju-e4d256-prod-github-runner-207 kernel: [66560.555877] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 23:53:06 juju-e4d256-prod-github-runner-207 kernel: [66560.557187] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 23:53:06 juju-e4d256-prod-github-runner-207 kernel: [66560.558441] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:53:06 juju-e4d256-prod-github-runner-207 kernel: [66560.559513] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 23:53:06 juju-e4d256-prod-github-runner-207 kernel: [66560.562115] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 23:53:06 juju-e4d256-prod-github-runner-207 kernel: [66560.563168] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 23:53:06 juju-e4d256-prod-github-runner-207 kernel: [66560.564344] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 23:53:06 juju-e4d256-prod-github-runner-207 kernel: [66560.565528] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 23:53:06 juju-e4d256-prod-github-runner-207 kernel: [66560.566708] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 23:53:06 juju-e4d256-prod-github-runner-207 kernel: [66560.567888] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 23:53:06 juju-e4d256-prod-github-runner-207 kernel: [66560.569082] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 23:53:06 juju-e4d256-prod-github-runner-207 kernel: [66560.570345] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 23:53:06 juju-e4d256-prod-github-runner-207 kernel: [66560.571551] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 23:53:06 juju-e4d256-prod-github-runner-207 kernel: [66560.572782] Call Trace: Aug 22 23:53:06 juju-e4d256-prod-github-runner-207 kernel: [66560.573705] Aug 22 23:53:06 juju-e4d256-prod-github-runner-207 kernel: [66560.574592] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:53:06 juju-e4d256-prod-github-runner-207 kernel: [66560.575636] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:53:06 juju-e4d256-prod-github-runner-207 kernel: [66560.576683] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:53:06 juju-e4d256-prod-github-runner-207 kernel: [66560.577784] ? show_regs.part.0+0x23/0x29 Aug 22 23:53:06 juju-e4d256-prod-github-runner-207 kernel: [66560.578800] ? show_regs.cold+0x8/0xd Aug 22 23:53:06 juju-e4d256-prod-github-runner-207 kernel: [66560.579803] ? watchdog_timer_fn+0x1be/0x220 Aug 22 23:53:06 juju-e4d256-prod-github-runner-207 kernel: [66560.580862] ? lockup_detector_update_enable+0x60/0x60 Aug 22 23:53:06 juju-e4d256-prod-github-runner-207 kernel: [66560.581949] ? __hrtimer_run_queues+0x107/0x230 Aug 22 23:53:06 juju-e4d256-prod-github-runner-207 kernel: [66560.582987] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 23:53:06 juju-e4d256-prod-github-runner-207 kernel: [66560.584026] ? hrtimer_interrupt+0x101/0x220 Aug 22 23:53:06 juju-e4d256-prod-github-runner-207 kernel: [66560.585072] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 23:53:06 juju-e4d256-prod-github-runner-207 kernel: [66560.586222] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 23:53:06 juju-e4d256-prod-github-runner-207 kernel: [66560.587296] Aug 22 23:53:06 juju-e4d256-prod-github-runner-207 kernel: [66560.588157] Aug 22 23:53:06 juju-e4d256-prod-github-runner-207 kernel: [66560.589014] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 23:53:06 juju-e4d256-prod-github-runner-207 kernel: [66560.590060] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:53:06 juju-e4d256-prod-github-runner-207 kernel: [66560.591145] ? _raw_spin_lock+0x22/0x30 Aug 22 23:53:06 juju-e4d256-prod-github-runner-207 kernel: [66560.592148] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:53:06 juju-e4d256-prod-github-runner-207 kernel: [66560.593251] direct_page_fault+0x206/0x310 [kvm] Aug 22 23:53:06 juju-e4d256-prod-github-runner-207 kernel: [66560.594294] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 23:53:06 juju-e4d256-prod-github-runner-207 kernel: [66560.595322] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 23:53:06 juju-e4d256-prod-github-runner-207 kernel: [66560.596336] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 23:53:06 juju-e4d256-prod-github-runner-207 kernel: [66560.597338] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 23:53:06 juju-e4d256-prod-github-runner-207 kernel: [66560.598297] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 23:53:06 juju-e4d256-prod-github-runner-207 kernel: [66560.599289] handle_exit+0x98/0x230 [kvm_amd] Aug 22 23:53:06 juju-e4d256-prod-github-runner-207 kernel: [66560.600221] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 23:53:06 juju-e4d256-prod-github-runner-207 kernel: [66560.601164] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 23:53:06 juju-e4d256-prod-github-runner-207 kernel: [66560.602106] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 23:53:06 juju-e4d256-prod-github-runner-207 kernel: [66560.603037] vcpu_run+0x62/0x2c0 [kvm] Aug 22 23:53:06 juju-e4d256-prod-github-runner-207 kernel: [66560.603872] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 23:53:06 juju-e4d256-prod-github-runner-207 kernel: [66560.604705] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 23:53:06 juju-e4d256-prod-github-runner-207 kernel: [66560.605575] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 23:53:06 juju-e4d256-prod-github-runner-207 kernel: [66560.606387] ? __seccomp_filter+0x4a/0x4a0 Aug 22 23:53:06 juju-e4d256-prod-github-runner-207 kernel: [66560.607141] ? __fget_files+0x86/0xc0 Aug 22 23:53:06 juju-e4d256-prod-github-runner-207 kernel: [66560.607853] __x64_sys_ioctl+0x95/0xd0 Aug 22 23:53:06 juju-e4d256-prod-github-runner-207 kernel: [66560.608562] do_syscall_64+0x5c/0xc0 Aug 22 23:53:06 juju-e4d256-prod-github-runner-207 kernel: [66560.609247] ? do_futex+0x162/0x1f0 Aug 22 23:53:06 juju-e4d256-prod-github-runner-207 kernel: [66560.609902] ? __x64_sys_futex+0x78/0x1e0 Aug 22 23:53:06 juju-e4d256-prod-github-runner-207 kernel: [66560.610583] ? __secure_computing+0xa9/0x120 Aug 22 23:53:06 juju-e4d256-prod-github-runner-207 kernel: [66560.611280] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 23:53:06 juju-e4d256-prod-github-runner-207 kernel: [66560.612052] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:53:06 juju-e4d256-prod-github-runner-207 kernel: [66560.612796] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:53:06 juju-e4d256-prod-github-runner-207 kernel: [66560.613525] ? do_syscall_64+0x69/0xc0 Aug 22 23:53:06 juju-e4d256-prod-github-runner-207 kernel: [66560.614208] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:53:06 juju-e4d256-prod-github-runner-207 kernel: [66560.615005] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:53:06 juju-e4d256-prod-github-runner-207 kernel: [66560.615745] ? do_syscall_64+0x69/0xc0 Aug 22 23:53:06 juju-e4d256-prod-github-runner-207 kernel: [66560.616377] ? do_syscall_64+0x69/0xc0 Aug 22 23:53:06 juju-e4d256-prod-github-runner-207 kernel: [66560.617033] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 23:53:06 juju-e4d256-prod-github-runner-207 kernel: [66560.617752] RIP: 0033:0x7faa5d0edaff Aug 22 23:53:06 juju-e4d256-prod-github-runner-207 kernel: [66560.618387] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 23:53:06 juju-e4d256-prod-github-runner-207 kernel: [66560.620419] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 23:53:06 juju-e4d256-prod-github-runner-207 kernel: [66560.621372] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 23:53:06 juju-e4d256-prod-github-runner-207 kernel: [66560.622280] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 23:53:06 juju-e4d256-prod-github-runner-207 kernel: [66560.623190] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 23:53:06 juju-e4d256-prod-github-runner-207 kernel: [66560.624090] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 23:53:06 juju-e4d256-prod-github-runner-207 kernel: [66560.625011] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 23:53:06 juju-e4d256-prod-github-runner-207 kernel: [66560.625929] Aug 22 23:53:34 juju-e4d256-prod-github-runner-207 kernel: [66588.541980] watchdog: BUG: soft lockup - CPU#1 stuck for 61907s! [qemu-system-x86:6715] Aug 22 23:53:34 juju-e4d256-prod-github-runner-207 kernel: [66588.544083] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 23:53:34 juju-e4d256-prod-github-runner-207 kernel: [66588.544414] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 23:53:34 juju-e4d256-prod-github-runner-207 kernel: [66588.558790] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 23:53:34 juju-e4d256-prod-github-runner-207 kernel: [66588.560264] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 23:53:34 juju-e4d256-prod-github-runner-207 kernel: [66588.561644] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:53:34 juju-e4d256-prod-github-runner-207 kernel: [66588.562815] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 23:53:34 juju-e4d256-prod-github-runner-207 kernel: [66588.565722] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 23:53:34 juju-e4d256-prod-github-runner-207 kernel: [66588.566868] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 23:53:34 juju-e4d256-prod-github-runner-207 kernel: [66588.568156] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 23:53:34 juju-e4d256-prod-github-runner-207 kernel: [66588.569455] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 23:53:34 juju-e4d256-prod-github-runner-207 kernel: [66588.570742] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 23:53:34 juju-e4d256-prod-github-runner-207 kernel: [66588.572031] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 23:53:34 juju-e4d256-prod-github-runner-207 kernel: [66588.573368] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 23:53:34 juju-e4d256-prod-github-runner-207 kernel: [66588.574752] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 23:53:34 juju-e4d256-prod-github-runner-207 kernel: [66588.575959] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 23:53:34 juju-e4d256-prod-github-runner-207 kernel: [66588.577293] Call Trace: Aug 22 23:53:34 juju-e4d256-prod-github-runner-207 kernel: [66588.578265] Aug 22 23:53:34 juju-e4d256-prod-github-runner-207 kernel: [66588.579210] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:53:34 juju-e4d256-prod-github-runner-207 kernel: [66588.580350] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:53:34 juju-e4d256-prod-github-runner-207 kernel: [66588.581467] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:53:34 juju-e4d256-prod-github-runner-207 kernel: [66588.582658] ? show_regs.part.0+0x23/0x29 Aug 22 23:53:34 juju-e4d256-prod-github-runner-207 kernel: [66588.583734] ? show_regs.cold+0x8/0xd Aug 22 23:53:34 juju-e4d256-prod-github-runner-207 kernel: [66588.584795] ? watchdog_timer_fn+0x1be/0x220 Aug 22 23:53:34 juju-e4d256-prod-github-runner-207 kernel: [66588.585896] ? lockup_detector_update_enable+0x60/0x60 Aug 22 23:53:34 juju-e4d256-prod-github-runner-207 kernel: [66588.587060] ? __hrtimer_run_queues+0x107/0x230 Aug 22 23:53:34 juju-e4d256-prod-github-runner-207 kernel: [66588.588181] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 23:53:34 juju-e4d256-prod-github-runner-207 kernel: [66588.589338] ? hrtimer_interrupt+0x101/0x220 Aug 22 23:53:34 juju-e4d256-prod-github-runner-207 kernel: [66588.590585] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 23:53:34 juju-e4d256-prod-github-runner-207 kernel: [66588.591771] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 23:53:34 juju-e4d256-prod-github-runner-207 kernel: [66588.592951] Aug 22 23:53:34 juju-e4d256-prod-github-runner-207 kernel: [66588.593909] Aug 22 23:53:34 juju-e4d256-prod-github-runner-207 kernel: [66588.594787] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 23:53:34 juju-e4d256-prod-github-runner-207 kernel: [66588.595826] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:53:34 juju-e4d256-prod-github-runner-207 kernel: [66588.596894] ? _raw_spin_lock+0x22/0x30 Aug 22 23:53:34 juju-e4d256-prod-github-runner-207 kernel: [66588.597846] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:53:34 juju-e4d256-prod-github-runner-207 kernel: [66588.598867] direct_page_fault+0x206/0x310 [kvm] Aug 22 23:53:34 juju-e4d256-prod-github-runner-207 kernel: [66588.599894] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 23:53:34 juju-e4d256-prod-github-runner-207 kernel: [66588.600918] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 23:53:34 juju-e4d256-prod-github-runner-207 kernel: [66588.601921] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 23:53:34 juju-e4d256-prod-github-runner-207 kernel: [66588.602935] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 23:53:34 juju-e4d256-prod-github-runner-207 kernel: [66588.603889] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 23:53:34 juju-e4d256-prod-github-runner-207 kernel: [66588.604887] handle_exit+0x98/0x230 [kvm_amd] Aug 22 23:53:34 juju-e4d256-prod-github-runner-207 kernel: [66588.605850] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 23:53:34 juju-e4d256-prod-github-runner-207 kernel: [66588.606996] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 23:53:34 juju-e4d256-prod-github-runner-207 kernel: [66588.607946] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 23:53:34 juju-e4d256-prod-github-runner-207 kernel: [66588.608877] vcpu_run+0x62/0x2c0 [kvm] Aug 22 23:53:34 juju-e4d256-prod-github-runner-207 kernel: [66588.609873] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 23:53:34 juju-e4d256-prod-github-runner-207 kernel: [66588.610739] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 23:53:34 juju-e4d256-prod-github-runner-207 kernel: [66588.611598] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 23:53:34 juju-e4d256-prod-github-runner-207 kernel: [66588.612525] ? __seccomp_filter+0x4a/0x4a0 Aug 22 23:53:34 juju-e4d256-prod-github-runner-207 kernel: [66588.613372] ? __fget_files+0x86/0xc0 Aug 22 23:53:34 juju-e4d256-prod-github-runner-207 kernel: [66588.614168] __x64_sys_ioctl+0x95/0xd0 Aug 22 23:53:34 juju-e4d256-prod-github-runner-207 kernel: [66588.614935] do_syscall_64+0x5c/0xc0 Aug 22 23:53:34 juju-e4d256-prod-github-runner-207 kernel: [66588.615672] ? do_futex+0x162/0x1f0 Aug 22 23:53:34 juju-e4d256-prod-github-runner-207 kernel: [66588.616441] ? __x64_sys_futex+0x78/0x1e0 Aug 22 23:53:34 juju-e4d256-prod-github-runner-207 kernel: [66588.617206] ? __secure_computing+0xa9/0x120 Aug 22 23:53:34 juju-e4d256-prod-github-runner-207 kernel: [66588.617981] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 23:53:34 juju-e4d256-prod-github-runner-207 kernel: [66588.618841] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:53:34 juju-e4d256-prod-github-runner-207 kernel: [66588.619669] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:53:34 juju-e4d256-prod-github-runner-207 kernel: [66588.620525] ? do_syscall_64+0x69/0xc0 Aug 22 23:53:34 juju-e4d256-prod-github-runner-207 kernel: [66588.621265] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:53:34 juju-e4d256-prod-github-runner-207 kernel: [66588.622056] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:53:34 juju-e4d256-prod-github-runner-207 kernel: [66588.622841] ? do_syscall_64+0x69/0xc0 Aug 22 23:53:34 juju-e4d256-prod-github-runner-207 kernel: [66588.623547] ? do_syscall_64+0x69/0xc0 Aug 22 23:53:34 juju-e4d256-prod-github-runner-207 kernel: [66588.624260] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 23:53:34 juju-e4d256-prod-github-runner-207 kernel: [66588.625064] RIP: 0033:0x7faa5d0edaff Aug 22 23:53:34 juju-e4d256-prod-github-runner-207 kernel: [66588.625807] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 23:53:34 juju-e4d256-prod-github-runner-207 kernel: [66588.628160] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 23:53:34 juju-e4d256-prod-github-runner-207 kernel: [66588.629337] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 23:53:34 juju-e4d256-prod-github-runner-207 kernel: [66588.630394] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 23:53:34 juju-e4d256-prod-github-runner-207 kernel: [66588.631468] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 23:53:34 juju-e4d256-prod-github-runner-207 kernel: [66588.632541] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 23:53:34 juju-e4d256-prod-github-runner-207 kernel: [66588.633563] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 23:53:34 juju-e4d256-prod-github-runner-207 kernel: [66588.634605] Aug 22 23:53:47 juju-e4d256-prod-github-runner-207 kernel: [66601.628707] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 23:53:47 juju-e4d256-prod-github-runner-207 kernel: [66601.629869] rcu: 1-....: (16568705 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=7999033 Aug 22 23:53:47 juju-e4d256-prod-github-runner-207 kernel: [66601.631008] (t=16621107 jiffies g=23269 q=58206) Aug 22 23:53:47 juju-e4d256-prod-github-runner-207 kernel: [66601.631831] NMI backtrace for cpu 1 Aug 22 23:53:47 juju-e4d256-prod-github-runner-207 kernel: [66601.632564] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 23:53:47 juju-e4d256-prod-github-runner-207 kernel: [66601.633678] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 23:53:47 juju-e4d256-prod-github-runner-207 kernel: [66601.634743] Call Trace: Aug 22 23:53:47 juju-e4d256-prod-github-runner-207 kernel: [66601.635423] Aug 22 23:53:47 juju-e4d256-prod-github-runner-207 kernel: [66601.636084] show_stack+0x52/0x5c Aug 22 23:53:47 juju-e4d256-prod-github-runner-207 kernel: [66601.636913] dump_stack_lvl+0x4a/0x63 Aug 22 23:53:47 juju-e4d256-prod-github-runner-207 kernel: [66601.637687] dump_stack+0x10/0x16 Aug 22 23:53:47 juju-e4d256-prod-github-runner-207 kernel: [66601.638403] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 23:53:47 juju-e4d256-prod-github-runner-207 kernel: [66601.639181] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 23:53:47 juju-e4d256-prod-github-runner-207 kernel: [66601.639957] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 23:53:47 juju-e4d256-prod-github-runner-207 kernel: [66601.640814] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 23:53:47 juju-e4d256-prod-github-runner-207 kernel: [66601.641653] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 23:53:47 juju-e4d256-prod-github-runner-207 kernel: [66601.642488] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 23:53:47 juju-e4d256-prod-github-runner-207 kernel: [66601.643260] print_cpu_stall.cold+0x2f/0xe2 Aug 22 23:53:47 juju-e4d256-prod-github-runner-207 kernel: [66601.644024] ? timekeeping_update+0xf7/0x150 Aug 22 23:53:47 juju-e4d256-prod-github-runner-207 kernel: [66601.644812] check_cpu_stall+0x109/0x270 Aug 22 23:53:47 juju-e4d256-prod-github-runner-207 kernel: [66601.645559] rcu_sched_clock_irq+0x9a/0x250 Aug 22 23:53:47 juju-e4d256-prod-github-runner-207 kernel: [66601.646338] update_process_times+0x94/0xd0 Aug 22 23:53:47 juju-e4d256-prod-github-runner-207 kernel: [66601.647115] tick_sched_handle+0x29/0x70 Aug 22 23:53:47 juju-e4d256-prod-github-runner-207 kernel: [66601.647878] tick_sched_timer+0x8c/0xc0 Aug 22 23:53:47 juju-e4d256-prod-github-runner-207 kernel: [66601.648640] ? tick_nohz_handler+0xb0/0xb0 Aug 22 23:53:47 juju-e4d256-prod-github-runner-207 kernel: [66601.649437] __hrtimer_run_queues+0x107/0x230 Aug 22 23:53:47 juju-e4d256-prod-github-runner-207 kernel: [66601.650254] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 23:53:47 juju-e4d256-prod-github-runner-207 kernel: [66601.651051] hrtimer_interrupt+0x101/0x220 Aug 22 23:53:47 juju-e4d256-prod-github-runner-207 kernel: [66601.651837] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 23:53:47 juju-e4d256-prod-github-runner-207 kernel: [66601.652694] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 23:53:47 juju-e4d256-prod-github-runner-207 kernel: [66601.653509] Aug 22 23:53:47 juju-e4d256-prod-github-runner-207 kernel: [66601.654149] Aug 22 23:53:47 juju-e4d256-prod-github-runner-207 kernel: [66601.654781] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 23:53:47 juju-e4d256-prod-github-runner-207 kernel: [66601.655814] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:53:47 juju-e4d256-prod-github-runner-207 kernel: [66601.656740] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 23:53:47 juju-e4d256-prod-github-runner-207 kernel: [66601.659265] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 23:53:47 juju-e4d256-prod-github-runner-207 kernel: [66601.660360] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 23:53:47 juju-e4d256-prod-github-runner-207 kernel: [66601.661406] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 23:53:47 juju-e4d256-prod-github-runner-207 kernel: [66601.662450] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 23:53:47 juju-e4d256-prod-github-runner-207 kernel: [66601.663449] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 23:53:47 juju-e4d256-prod-github-runner-207 kernel: [66601.664436] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 23:53:47 juju-e4d256-prod-github-runner-207 kernel: [66601.665505] ? _raw_spin_lock+0x22/0x30 Aug 22 23:53:47 juju-e4d256-prod-github-runner-207 kernel: [66601.666321] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:53:47 juju-e4d256-prod-github-runner-207 kernel: [66601.667196] direct_page_fault+0x206/0x310 [kvm] Aug 22 23:53:47 juju-e4d256-prod-github-runner-207 kernel: [66601.668063] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 23:53:47 juju-e4d256-prod-github-runner-207 kernel: [66601.668939] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 23:53:47 juju-e4d256-prod-github-runner-207 kernel: [66601.669766] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 23:53:47 juju-e4d256-prod-github-runner-207 kernel: [66601.670573] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 23:53:47 juju-e4d256-prod-github-runner-207 kernel: [66601.671486] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 23:53:47 juju-e4d256-prod-github-runner-207 kernel: [66601.672337] handle_exit+0x98/0x230 [kvm_amd] Aug 22 23:53:47 juju-e4d256-prod-github-runner-207 kernel: [66601.673121] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 23:53:47 juju-e4d256-prod-github-runner-207 kernel: [66601.673916] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 23:53:47 juju-e4d256-prod-github-runner-207 kernel: [66601.674720] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 23:53:47 juju-e4d256-prod-github-runner-207 kernel: [66601.675514] vcpu_run+0x62/0x2c0 [kvm] Aug 22 23:53:47 juju-e4d256-prod-github-runner-207 kernel: [66601.676246] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 23:53:47 juju-e4d256-prod-github-runner-207 kernel: [66601.676997] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 23:53:47 juju-e4d256-prod-github-runner-207 kernel: [66601.677805] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 23:53:47 juju-e4d256-prod-github-runner-207 kernel: [66601.678580] ? __seccomp_filter+0x4a/0x4a0 Aug 22 23:53:47 juju-e4d256-prod-github-runner-207 kernel: [66601.679337] ? __fget_files+0x86/0xc0 Aug 22 23:53:47 juju-e4d256-prod-github-runner-207 kernel: [66601.680085] __x64_sys_ioctl+0x95/0xd0 Aug 22 23:53:47 juju-e4d256-prod-github-runner-207 kernel: [66601.680806] do_syscall_64+0x5c/0xc0 Aug 22 23:53:47 juju-e4d256-prod-github-runner-207 kernel: [66601.681492] ? do_futex+0x162/0x1f0 Aug 22 23:53:47 juju-e4d256-prod-github-runner-207 kernel: [66601.682183] ? __x64_sys_futex+0x78/0x1e0 Aug 22 23:53:47 juju-e4d256-prod-github-runner-207 kernel: [66601.682907] ? __secure_computing+0xa9/0x120 Aug 22 23:53:47 juju-e4d256-prod-github-runner-207 kernel: [66601.683751] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 23:53:47 juju-e4d256-prod-github-runner-207 kernel: [66601.684565] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:53:47 juju-e4d256-prod-github-runner-207 kernel: [66601.685454] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:53:47 juju-e4d256-prod-github-runner-207 kernel: [66601.686291] ? do_syscall_64+0x69/0xc0 Aug 22 23:53:47 juju-e4d256-prod-github-runner-207 kernel: [66601.686985] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:53:47 juju-e4d256-prod-github-runner-207 kernel: [66601.687776] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:53:47 juju-e4d256-prod-github-runner-207 kernel: [66601.688587] ? do_syscall_64+0x69/0xc0 Aug 22 23:53:47 juju-e4d256-prod-github-runner-207 kernel: [66601.689316] ? do_syscall_64+0x69/0xc0 Aug 22 23:53:47 juju-e4d256-prod-github-runner-207 kernel: [66601.690006] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 23:53:47 juju-e4d256-prod-github-runner-207 kernel: [66601.690779] RIP: 0033:0x7faa5d0edaff Aug 22 23:53:47 juju-e4d256-prod-github-runner-207 kernel: [66601.691491] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 23:53:47 juju-e4d256-prod-github-runner-207 kernel: [66601.693643] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 23:53:47 juju-e4d256-prod-github-runner-207 kernel: [66601.694616] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 23:53:47 juju-e4d256-prod-github-runner-207 kernel: [66601.695577] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 23:53:47 juju-e4d256-prod-github-runner-207 kernel: [66601.696547] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 23:53:47 juju-e4d256-prod-github-runner-207 kernel: [66601.697511] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 23:53:47 juju-e4d256-prod-github-runner-207 kernel: [66601.698448] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 23:53:47 juju-e4d256-prod-github-runner-207 kernel: [66601.699375] Aug 22 23:54:14 juju-e4d256-prod-github-runner-207 kernel: [66628.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 61944s! [qemu-system-x86:6715] Aug 22 23:54:14 juju-e4d256-prod-github-runner-207 kernel: [66628.543135] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 23:54:14 juju-e4d256-prod-github-runner-207 kernel: [66628.543211] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 23:54:14 juju-e4d256-prod-github-runner-207 kernel: [66628.555291] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 23:54:14 juju-e4d256-prod-github-runner-207 kernel: [66628.556573] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 23:54:14 juju-e4d256-prod-github-runner-207 kernel: [66628.557795] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:54:14 juju-e4d256-prod-github-runner-207 kernel: [66628.558900] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 23:54:14 juju-e4d256-prod-github-runner-207 kernel: [66628.562192] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 23:54:14 juju-e4d256-prod-github-runner-207 kernel: [66628.563366] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 23:54:14 juju-e4d256-prod-github-runner-207 kernel: [66628.564569] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 23:54:14 juju-e4d256-prod-github-runner-207 kernel: [66628.565756] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 23:54:14 juju-e4d256-prod-github-runner-207 kernel: [66628.566917] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 23:54:14 juju-e4d256-prod-github-runner-207 kernel: [66628.568107] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 23:54:14 juju-e4d256-prod-github-runner-207 kernel: [66628.569277] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 23:54:14 juju-e4d256-prod-github-runner-207 kernel: [66628.570524] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 23:54:14 juju-e4d256-prod-github-runner-207 kernel: [66628.571674] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 23:54:14 juju-e4d256-prod-github-runner-207 kernel: [66628.572925] Call Trace: Aug 22 23:54:14 juju-e4d256-prod-github-runner-207 kernel: [66628.573852] Aug 22 23:54:14 juju-e4d256-prod-github-runner-207 kernel: [66628.574746] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:54:14 juju-e4d256-prod-github-runner-207 kernel: [66628.575775] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:54:14 juju-e4d256-prod-github-runner-207 kernel: [66628.576831] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:54:14 juju-e4d256-prod-github-runner-207 kernel: [66628.577938] ? show_regs.part.0+0x23/0x29 Aug 22 23:54:14 juju-e4d256-prod-github-runner-207 kernel: [66628.578964] ? show_regs.cold+0x8/0xd Aug 22 23:54:14 juju-e4d256-prod-github-runner-207 kernel: [66628.580011] ? watchdog_timer_fn+0x1be/0x220 Aug 22 23:54:14 juju-e4d256-prod-github-runner-207 kernel: [66628.581064] ? lockup_detector_update_enable+0x60/0x60 Aug 22 23:54:14 juju-e4d256-prod-github-runner-207 kernel: [66628.582160] ? __hrtimer_run_queues+0x107/0x230 Aug 22 23:54:14 juju-e4d256-prod-github-runner-207 kernel: [66628.583406] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 23:54:14 juju-e4d256-prod-github-runner-207 kernel: [66628.584452] ? hrtimer_interrupt+0x101/0x220 Aug 22 23:54:14 juju-e4d256-prod-github-runner-207 kernel: [66628.585518] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 23:54:14 juju-e4d256-prod-github-runner-207 kernel: [66628.586673] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 23:54:14 juju-e4d256-prod-github-runner-207 kernel: [66628.587786] Aug 22 23:54:14 juju-e4d256-prod-github-runner-207 kernel: [66628.588656] Aug 22 23:54:14 juju-e4d256-prod-github-runner-207 kernel: [66628.589520] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 23:54:14 juju-e4d256-prod-github-runner-207 kernel: [66628.590564] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:54:14 juju-e4d256-prod-github-runner-207 kernel: [66628.591606] ? _raw_spin_lock+0x22/0x30 Aug 22 23:54:14 juju-e4d256-prod-github-runner-207 kernel: [66628.592621] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:54:14 juju-e4d256-prod-github-runner-207 kernel: [66628.593691] direct_page_fault+0x206/0x310 [kvm] Aug 22 23:54:14 juju-e4d256-prod-github-runner-207 kernel: [66628.594744] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 23:54:14 juju-e4d256-prod-github-runner-207 kernel: [66628.595787] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 23:54:14 juju-e4d256-prod-github-runner-207 kernel: [66628.596850] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 23:54:14 juju-e4d256-prod-github-runner-207 kernel: [66628.597837] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 23:54:14 juju-e4d256-prod-github-runner-207 kernel: [66628.598791] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 23:54:14 juju-e4d256-prod-github-runner-207 kernel: [66628.599786] handle_exit+0x98/0x230 [kvm_amd] Aug 22 23:54:14 juju-e4d256-prod-github-runner-207 kernel: [66628.600955] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 23:54:14 juju-e4d256-prod-github-runner-207 kernel: [66628.602115] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 23:54:14 juju-e4d256-prod-github-runner-207 kernel: [66628.603067] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 23:54:14 juju-e4d256-prod-github-runner-207 kernel: [66628.604193] vcpu_run+0x62/0x2c0 [kvm] Aug 22 23:54:14 juju-e4d256-prod-github-runner-207 kernel: [66628.605012] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 23:54:14 juju-e4d256-prod-github-runner-207 kernel: [66628.605848] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 23:54:14 juju-e4d256-prod-github-runner-207 kernel: [66628.606722] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 23:54:14 juju-e4d256-prod-github-runner-207 kernel: [66628.607682] ? __seccomp_filter+0x4a/0x4a0 Aug 22 23:54:14 juju-e4d256-prod-github-runner-207 kernel: [66628.608471] ? __fget_files+0x86/0xc0 Aug 22 23:54:14 juju-e4d256-prod-github-runner-207 kernel: [66628.609178] __x64_sys_ioctl+0x95/0xd0 Aug 22 23:54:14 juju-e4d256-prod-github-runner-207 kernel: [66628.609872] do_syscall_64+0x5c/0xc0 Aug 22 23:54:14 juju-e4d256-prod-github-runner-207 kernel: [66628.610545] ? do_futex+0x162/0x1f0 Aug 22 23:54:14 juju-e4d256-prod-github-runner-207 kernel: [66628.611196] ? __x64_sys_futex+0x78/0x1e0 Aug 22 23:54:14 juju-e4d256-prod-github-runner-207 kernel: [66628.611907] ? __secure_computing+0xa9/0x120 Aug 22 23:54:14 juju-e4d256-prod-github-runner-207 kernel: [66628.612629] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 23:54:14 juju-e4d256-prod-github-runner-207 kernel: [66628.613393] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:54:14 juju-e4d256-prod-github-runner-207 kernel: [66628.614114] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:54:14 juju-e4d256-prod-github-runner-207 kernel: [66628.614830] ? do_syscall_64+0x69/0xc0 Aug 22 23:54:14 juju-e4d256-prod-github-runner-207 kernel: [66628.615481] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:54:14 juju-e4d256-prod-github-runner-207 kernel: [66628.616202] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:54:14 juju-e4d256-prod-github-runner-207 kernel: [66628.616926] ? do_syscall_64+0x69/0xc0 Aug 22 23:54:14 juju-e4d256-prod-github-runner-207 kernel: [66628.617578] ? do_syscall_64+0x69/0xc0 Aug 22 23:54:14 juju-e4d256-prod-github-runner-207 kernel: [66628.618209] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 23:54:14 juju-e4d256-prod-github-runner-207 kernel: [66628.618916] RIP: 0033:0x7faa5d0edaff Aug 22 23:54:14 juju-e4d256-prod-github-runner-207 kernel: [66628.619543] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 23:54:14 juju-e4d256-prod-github-runner-207 kernel: [66628.622271] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 23:54:14 juju-e4d256-prod-github-runner-207 kernel: [66628.623237] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 23:54:14 juju-e4d256-prod-github-runner-207 kernel: [66628.624163] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 23:54:14 juju-e4d256-prod-github-runner-207 kernel: [66628.625472] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 23:54:14 juju-e4d256-prod-github-runner-207 kernel: [66628.626372] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 23:54:14 juju-e4d256-prod-github-runner-207 kernel: [66628.627266] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 23:54:14 juju-e4d256-prod-github-runner-207 kernel: [66628.628293] Aug 22 23:54:42 juju-e4d256-prod-github-runner-207 kernel: [66656.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 61970s! [qemu-system-x86:6715] Aug 22 23:54:42 juju-e4d256-prod-github-runner-207 kernel: [66656.543148] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 23:54:42 juju-e4d256-prod-github-runner-207 kernel: [66656.543223] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 23:54:42 juju-e4d256-prod-github-runner-207 kernel: [66656.556211] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 23:54:42 juju-e4d256-prod-github-runner-207 kernel: [66656.557507] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 23:54:42 juju-e4d256-prod-github-runner-207 kernel: [66656.558802] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:54:42 juju-e4d256-prod-github-runner-207 kernel: [66656.559934] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 23:54:42 juju-e4d256-prod-github-runner-207 kernel: [66656.562560] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 23:54:42 juju-e4d256-prod-github-runner-207 kernel: [66656.563636] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 23:54:42 juju-e4d256-prod-github-runner-207 kernel: [66656.564829] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 23:54:42 juju-e4d256-prod-github-runner-207 kernel: [66656.566020] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 23:54:42 juju-e4d256-prod-github-runner-207 kernel: [66656.567215] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 23:54:42 juju-e4d256-prod-github-runner-207 kernel: [66656.568421] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 23:54:42 juju-e4d256-prod-github-runner-207 kernel: [66656.569612] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 23:54:42 juju-e4d256-prod-github-runner-207 kernel: [66656.570874] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 23:54:42 juju-e4d256-prod-github-runner-207 kernel: [66656.571997] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 23:54:42 juju-e4d256-prod-github-runner-207 kernel: [66656.573218] Call Trace: Aug 22 23:54:42 juju-e4d256-prod-github-runner-207 kernel: [66656.574147] Aug 22 23:54:42 juju-e4d256-prod-github-runner-207 kernel: [66656.575042] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:54:42 juju-e4d256-prod-github-runner-207 kernel: [66656.576134] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:54:42 juju-e4d256-prod-github-runner-207 kernel: [66656.577193] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:54:42 juju-e4d256-prod-github-runner-207 kernel: [66656.578285] ? show_regs.part.0+0x23/0x29 Aug 22 23:54:42 juju-e4d256-prod-github-runner-207 kernel: [66656.579351] ? show_regs.cold+0x8/0xd Aug 22 23:54:42 juju-e4d256-prod-github-runner-207 kernel: [66656.580362] ? watchdog_timer_fn+0x1be/0x220 Aug 22 23:54:42 juju-e4d256-prod-github-runner-207 kernel: [66656.581387] ? lockup_detector_update_enable+0x60/0x60 Aug 22 23:54:42 juju-e4d256-prod-github-runner-207 kernel: [66656.582469] ? __hrtimer_run_queues+0x107/0x230 Aug 22 23:54:42 juju-e4d256-prod-github-runner-207 kernel: [66656.583522] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 23:54:42 juju-e4d256-prod-github-runner-207 kernel: [66656.584564] ? hrtimer_interrupt+0x101/0x220 Aug 22 23:54:42 juju-e4d256-prod-github-runner-207 kernel: [66656.585597] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 23:54:42 juju-e4d256-prod-github-runner-207 kernel: [66656.586686] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 23:54:42 juju-e4d256-prod-github-runner-207 kernel: [66656.587755] Aug 22 23:54:42 juju-e4d256-prod-github-runner-207 kernel: [66656.588621] Aug 22 23:54:42 juju-e4d256-prod-github-runner-207 kernel: [66656.589472] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 23:54:42 juju-e4d256-prod-github-runner-207 kernel: [66656.590523] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:54:42 juju-e4d256-prod-github-runner-207 kernel: [66656.591586] ? _raw_spin_lock+0x22/0x30 Aug 22 23:54:42 juju-e4d256-prod-github-runner-207 kernel: [66656.592549] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:54:42 juju-e4d256-prod-github-runner-207 kernel: [66656.593580] direct_page_fault+0x206/0x310 [kvm] Aug 22 23:54:42 juju-e4d256-prod-github-runner-207 kernel: [66656.594622] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 23:54:42 juju-e4d256-prod-github-runner-207 kernel: [66656.595658] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 23:54:42 juju-e4d256-prod-github-runner-207 kernel: [66656.596681] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 23:54:42 juju-e4d256-prod-github-runner-207 kernel: [66656.597677] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 23:54:42 juju-e4d256-prod-github-runner-207 kernel: [66656.598643] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 23:54:42 juju-e4d256-prod-github-runner-207 kernel: [66656.599675] handle_exit+0x98/0x230 [kvm_amd] Aug 22 23:54:42 juju-e4d256-prod-github-runner-207 kernel: [66656.600583] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 23:54:42 juju-e4d256-prod-github-runner-207 kernel: [66656.601578] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 23:54:42 juju-e4d256-prod-github-runner-207 kernel: [66656.602533] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 23:54:42 juju-e4d256-prod-github-runner-207 kernel: [66656.603455] vcpu_run+0x62/0x2c0 [kvm] Aug 22 23:54:42 juju-e4d256-prod-github-runner-207 kernel: [66656.604299] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 23:54:42 juju-e4d256-prod-github-runner-207 kernel: [66656.605128] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 23:54:42 juju-e4d256-prod-github-runner-207 kernel: [66656.606022] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 23:54:42 juju-e4d256-prod-github-runner-207 kernel: [66656.606833] ? __seccomp_filter+0x4a/0x4a0 Aug 22 23:54:42 juju-e4d256-prod-github-runner-207 kernel: [66656.607602] ? __fget_files+0x86/0xc0 Aug 22 23:54:42 juju-e4d256-prod-github-runner-207 kernel: [66656.608321] __x64_sys_ioctl+0x95/0xd0 Aug 22 23:54:42 juju-e4d256-prod-github-runner-207 kernel: [66656.609071] do_syscall_64+0x5c/0xc0 Aug 22 23:54:42 juju-e4d256-prod-github-runner-207 kernel: [66656.609759] ? do_futex+0x162/0x1f0 Aug 22 23:54:42 juju-e4d256-prod-github-runner-207 kernel: [66656.610635] ? __x64_sys_futex+0x78/0x1e0 Aug 22 23:54:42 juju-e4d256-prod-github-runner-207 kernel: [66656.611576] ? __secure_computing+0xa9/0x120 Aug 22 23:54:42 juju-e4d256-prod-github-runner-207 kernel: [66656.612507] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 23:54:42 juju-e4d256-prod-github-runner-207 kernel: [66656.613526] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:54:42 juju-e4d256-prod-github-runner-207 kernel: [66656.614690] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:54:42 juju-e4d256-prod-github-runner-207 kernel: [66656.615666] ? do_syscall_64+0x69/0xc0 Aug 22 23:54:42 juju-e4d256-prod-github-runner-207 kernel: [66656.616653] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:54:42 juju-e4d256-prod-github-runner-207 kernel: [66656.617407] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:54:42 juju-e4d256-prod-github-runner-207 kernel: [66656.618319] ? do_syscall_64+0x69/0xc0 Aug 22 23:54:42 juju-e4d256-prod-github-runner-207 kernel: [66656.619142] ? do_syscall_64+0x69/0xc0 Aug 22 23:54:42 juju-e4d256-prod-github-runner-207 kernel: [66656.619989] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 23:54:42 juju-e4d256-prod-github-runner-207 kernel: [66656.620935] RIP: 0033:0x7faa5d0edaff Aug 22 23:54:42 juju-e4d256-prod-github-runner-207 kernel: [66656.621627] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 23:54:42 juju-e4d256-prod-github-runner-207 kernel: [66656.624327] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 23:54:42 juju-e4d256-prod-github-runner-207 kernel: [66656.625470] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 23:54:42 juju-e4d256-prod-github-runner-207 kernel: [66656.626387] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 23:54:42 juju-e4d256-prod-github-runner-207 kernel: [66656.627302] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 23:54:42 juju-e4d256-prod-github-runner-207 kernel: [66656.628229] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 23:54:42 juju-e4d256-prod-github-runner-207 kernel: [66656.629137] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 23:54:42 juju-e4d256-prod-github-runner-207 kernel: [66656.630052] Aug 22 23:55:10 juju-e4d256-prod-github-runner-207 kernel: [66684.541976] watchdog: BUG: soft lockup - CPU#1 stuck for 61996s! [qemu-system-x86:6715] Aug 22 23:55:10 juju-e4d256-prod-github-runner-207 kernel: [66684.543832] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 23:55:10 juju-e4d256-prod-github-runner-207 kernel: [66684.544139] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 23:55:10 juju-e4d256-prod-github-runner-207 kernel: [66684.556256] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 23:55:10 juju-e4d256-prod-github-runner-207 kernel: [66684.557530] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 23:55:10 juju-e4d256-prod-github-runner-207 kernel: [66684.558894] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:55:10 juju-e4d256-prod-github-runner-207 kernel: [66684.560080] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 23:55:10 juju-e4d256-prod-github-runner-207 kernel: [66684.562625] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 23:55:10 juju-e4d256-prod-github-runner-207 kernel: [66684.563679] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 23:55:10 juju-e4d256-prod-github-runner-207 kernel: [66684.564841] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 23:55:10 juju-e4d256-prod-github-runner-207 kernel: [66684.566000] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 23:55:10 juju-e4d256-prod-github-runner-207 kernel: [66684.567174] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 23:55:10 juju-e4d256-prod-github-runner-207 kernel: [66684.568334] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 23:55:10 juju-e4d256-prod-github-runner-207 kernel: [66684.569506] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 23:55:10 juju-e4d256-prod-github-runner-207 kernel: [66684.570750] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 23:55:10 juju-e4d256-prod-github-runner-207 kernel: [66684.571897] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 23:55:10 juju-e4d256-prod-github-runner-207 kernel: [66684.573404] Call Trace: Aug 22 23:55:10 juju-e4d256-prod-github-runner-207 kernel: [66684.574553] Aug 22 23:55:10 juju-e4d256-prod-github-runner-207 kernel: [66684.575465] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:55:10 juju-e4d256-prod-github-runner-207 kernel: [66684.576531] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:55:10 juju-e4d256-prod-github-runner-207 kernel: [66684.577592] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:55:10 juju-e4d256-prod-github-runner-207 kernel: [66684.578686] ? show_regs.part.0+0x23/0x29 Aug 22 23:55:10 juju-e4d256-prod-github-runner-207 kernel: [66684.579705] ? show_regs.cold+0x8/0xd Aug 22 23:55:10 juju-e4d256-prod-github-runner-207 kernel: [66684.580687] ? watchdog_timer_fn+0x1be/0x220 Aug 22 23:55:10 juju-e4d256-prod-github-runner-207 kernel: [66684.581698] ? lockup_detector_update_enable+0x60/0x60 Aug 22 23:55:10 juju-e4d256-prod-github-runner-207 kernel: [66684.582765] ? __hrtimer_run_queues+0x107/0x230 Aug 22 23:55:10 juju-e4d256-prod-github-runner-207 kernel: [66684.583818] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 23:55:10 juju-e4d256-prod-github-runner-207 kernel: [66684.584844] ? hrtimer_interrupt+0x101/0x220 Aug 22 23:55:10 juju-e4d256-prod-github-runner-207 kernel: [66684.585865] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 23:55:10 juju-e4d256-prod-github-runner-207 kernel: [66684.586938] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 23:55:10 juju-e4d256-prod-github-runner-207 kernel: [66684.588001] Aug 22 23:55:10 juju-e4d256-prod-github-runner-207 kernel: [66684.588854] Aug 22 23:55:10 juju-e4d256-prod-github-runner-207 kernel: [66684.589691] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 23:55:10 juju-e4d256-prod-github-runner-207 kernel: [66684.590735] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:55:10 juju-e4d256-prod-github-runner-207 kernel: [66684.591810] ? _raw_spin_lock+0x22/0x30 Aug 22 23:55:10 juju-e4d256-prod-github-runner-207 kernel: [66684.592761] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:55:10 juju-e4d256-prod-github-runner-207 kernel: [66684.593784] direct_page_fault+0x206/0x310 [kvm] Aug 22 23:55:10 juju-e4d256-prod-github-runner-207 kernel: [66684.594809] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 23:55:10 juju-e4d256-prod-github-runner-207 kernel: [66684.595841] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 23:55:10 juju-e4d256-prod-github-runner-207 kernel: [66684.596845] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 23:55:10 juju-e4d256-prod-github-runner-207 kernel: [66684.597845] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 23:55:10 juju-e4d256-prod-github-runner-207 kernel: [66684.598801] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 23:55:10 juju-e4d256-prod-github-runner-207 kernel: [66684.599801] handle_exit+0x98/0x230 [kvm_amd] Aug 22 23:55:10 juju-e4d256-prod-github-runner-207 kernel: [66684.600695] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 23:55:10 juju-e4d256-prod-github-runner-207 kernel: [66684.601614] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 23:55:10 juju-e4d256-prod-github-runner-207 kernel: [66684.602544] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 23:55:10 juju-e4d256-prod-github-runner-207 kernel: [66684.603456] vcpu_run+0x62/0x2c0 [kvm] Aug 22 23:55:10 juju-e4d256-prod-github-runner-207 kernel: [66684.604272] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 23:55:10 juju-e4d256-prod-github-runner-207 kernel: [66684.605086] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 23:55:10 juju-e4d256-prod-github-runner-207 kernel: [66684.605947] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 23:55:10 juju-e4d256-prod-github-runner-207 kernel: [66684.606745] ? __seccomp_filter+0x4a/0x4a0 Aug 22 23:55:10 juju-e4d256-prod-github-runner-207 kernel: [66684.607504] ? __fget_files+0x86/0xc0 Aug 22 23:55:10 juju-e4d256-prod-github-runner-207 kernel: [66684.608213] __x64_sys_ioctl+0x95/0xd0 Aug 22 23:55:10 juju-e4d256-prod-github-runner-207 kernel: [66684.608918] do_syscall_64+0x5c/0xc0 Aug 22 23:55:10 juju-e4d256-prod-github-runner-207 kernel: [66684.609582] ? do_futex+0x162/0x1f0 Aug 22 23:55:10 juju-e4d256-prod-github-runner-207 kernel: [66684.610232] ? __x64_sys_futex+0x78/0x1e0 Aug 22 23:55:10 juju-e4d256-prod-github-runner-207 kernel: [66684.610904] ? __secure_computing+0xa9/0x120 Aug 22 23:55:10 juju-e4d256-prod-github-runner-207 kernel: [66684.611609] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 23:55:10 juju-e4d256-prod-github-runner-207 kernel: [66684.612368] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:55:10 juju-e4d256-prod-github-runner-207 kernel: [66684.613087] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:55:10 juju-e4d256-prod-github-runner-207 kernel: [66684.613814] ? do_syscall_64+0x69/0xc0 Aug 22 23:55:10 juju-e4d256-prod-github-runner-207 kernel: [66684.614467] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:55:10 juju-e4d256-prod-github-runner-207 kernel: [66684.615186] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:55:10 juju-e4d256-prod-github-runner-207 kernel: [66684.615881] ? do_syscall_64+0x69/0xc0 Aug 22 23:55:10 juju-e4d256-prod-github-runner-207 kernel: [66684.616505] ? do_syscall_64+0x69/0xc0 Aug 22 23:55:10 juju-e4d256-prod-github-runner-207 kernel: [66684.617129] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 23:55:10 juju-e4d256-prod-github-runner-207 kernel: [66684.617838] RIP: 0033:0x7faa5d0edaff Aug 22 23:55:10 juju-e4d256-prod-github-runner-207 kernel: [66684.618494] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 23:55:10 juju-e4d256-prod-github-runner-207 kernel: [66684.620498] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 23:55:10 juju-e4d256-prod-github-runner-207 kernel: [66684.621417] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 23:55:10 juju-e4d256-prod-github-runner-207 kernel: [66684.622309] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 23:55:10 juju-e4d256-prod-github-runner-207 kernel: [66684.623210] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 23:55:10 juju-e4d256-prod-github-runner-207 kernel: [66684.624106] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 23:55:10 juju-e4d256-prod-github-runner-207 kernel: [66684.625005] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 23:55:10 juju-e4d256-prod-github-runner-207 kernel: [66684.625900] Aug 22 23:55:38 juju-e4d256-prod-github-runner-207 kernel: [66712.541980] watchdog: BUG: soft lockup - CPU#1 stuck for 62022s! [qemu-system-x86:6715] Aug 22 23:55:38 juju-e4d256-prod-github-runner-207 kernel: [66712.543951] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 23:55:38 juju-e4d256-prod-github-runner-207 kernel: [66712.544249] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 23:55:38 juju-e4d256-prod-github-runner-207 kernel: [66712.556985] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 23:55:38 juju-e4d256-prod-github-runner-207 kernel: [66712.558887] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 23:55:38 juju-e4d256-prod-github-runner-207 kernel: [66712.560311] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:55:38 juju-e4d256-prod-github-runner-207 kernel: [66712.561409] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 23:55:38 juju-e4d256-prod-github-runner-207 kernel: [66712.564059] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 23:55:38 juju-e4d256-prod-github-runner-207 kernel: [66712.565118] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 23:55:38 juju-e4d256-prod-github-runner-207 kernel: [66712.566348] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 23:55:38 juju-e4d256-prod-github-runner-207 kernel: [66712.567553] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 23:55:38 juju-e4d256-prod-github-runner-207 kernel: [66712.568736] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 23:55:38 juju-e4d256-prod-github-runner-207 kernel: [66712.569995] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 23:55:38 juju-e4d256-prod-github-runner-207 kernel: [66712.571390] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 23:55:38 juju-e4d256-prod-github-runner-207 kernel: [66712.572800] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 23:55:38 juju-e4d256-prod-github-runner-207 kernel: [66712.573921] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 23:55:38 juju-e4d256-prod-github-runner-207 kernel: [66712.575140] Call Trace: Aug 22 23:55:38 juju-e4d256-prod-github-runner-207 kernel: [66712.576055] Aug 22 23:55:38 juju-e4d256-prod-github-runner-207 kernel: [66712.576955] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:55:38 juju-e4d256-prod-github-runner-207 kernel: [66712.577993] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:55:38 juju-e4d256-prod-github-runner-207 kernel: [66712.579055] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:55:38 juju-e4d256-prod-github-runner-207 kernel: [66712.580182] ? show_regs.part.0+0x23/0x29 Aug 22 23:55:38 juju-e4d256-prod-github-runner-207 kernel: [66712.581214] ? show_regs.cold+0x8/0xd Aug 22 23:55:38 juju-e4d256-prod-github-runner-207 kernel: [66712.582204] ? watchdog_timer_fn+0x1be/0x220 Aug 22 23:55:38 juju-e4d256-prod-github-runner-207 kernel: [66712.583245] ? lockup_detector_update_enable+0x60/0x60 Aug 22 23:55:38 juju-e4d256-prod-github-runner-207 kernel: [66712.584327] ? __hrtimer_run_queues+0x107/0x230 Aug 22 23:55:38 juju-e4d256-prod-github-runner-207 kernel: [66712.585368] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 23:55:38 juju-e4d256-prod-github-runner-207 kernel: [66712.586403] ? hrtimer_interrupt+0x101/0x220 Aug 22 23:55:38 juju-e4d256-prod-github-runner-207 kernel: [66712.587458] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 23:55:38 juju-e4d256-prod-github-runner-207 kernel: [66712.588541] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 23:55:38 juju-e4d256-prod-github-runner-207 kernel: [66712.589609] Aug 22 23:55:38 juju-e4d256-prod-github-runner-207 kernel: [66712.590467] Aug 22 23:55:38 juju-e4d256-prod-github-runner-207 kernel: [66712.591441] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 23:55:38 juju-e4d256-prod-github-runner-207 kernel: [66712.592901] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:55:38 juju-e4d256-prod-github-runner-207 kernel: [66712.594422] ? _raw_spin_lock+0x22/0x30 Aug 22 23:55:38 juju-e4d256-prod-github-runner-207 kernel: [66712.595796] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:55:38 juju-e4d256-prod-github-runner-207 kernel: [66712.597242] direct_page_fault+0x206/0x310 [kvm] Aug 22 23:55:38 juju-e4d256-prod-github-runner-207 kernel: [66712.598632] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 23:55:38 juju-e4d256-prod-github-runner-207 kernel: [66712.600136] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 23:55:38 juju-e4d256-prod-github-runner-207 kernel: [66712.601722] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 23:55:38 juju-e4d256-prod-github-runner-207 kernel: [66712.603316] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 23:55:38 juju-e4d256-prod-github-runner-207 kernel: [66712.604282] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 23:55:38 juju-e4d256-prod-github-runner-207 kernel: [66712.605279] handle_exit+0x98/0x230 [kvm_amd] Aug 22 23:55:38 juju-e4d256-prod-github-runner-207 kernel: [66712.606187] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 23:55:38 juju-e4d256-prod-github-runner-207 kernel: [66712.607127] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 23:55:38 juju-e4d256-prod-github-runner-207 kernel: [66712.608068] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 23:55:38 juju-e4d256-prod-github-runner-207 kernel: [66712.608984] vcpu_run+0x62/0x2c0 [kvm] Aug 22 23:55:38 juju-e4d256-prod-github-runner-207 kernel: [66712.609806] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 23:55:38 juju-e4d256-prod-github-runner-207 kernel: [66712.610631] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 23:55:38 juju-e4d256-prod-github-runner-207 kernel: [66712.611517] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 23:55:38 juju-e4d256-prod-github-runner-207 kernel: [66712.612328] ? __seccomp_filter+0x4a/0x4a0 Aug 22 23:55:38 juju-e4d256-prod-github-runner-207 kernel: [66712.613082] ? __fget_files+0x86/0xc0 Aug 22 23:55:38 juju-e4d256-prod-github-runner-207 kernel: [66712.613893] __x64_sys_ioctl+0x95/0xd0 Aug 22 23:55:38 juju-e4d256-prod-github-runner-207 kernel: [66712.614613] do_syscall_64+0x5c/0xc0 Aug 22 23:55:38 juju-e4d256-prod-github-runner-207 kernel: [66712.615321] ? do_futex+0x162/0x1f0 Aug 22 23:55:38 juju-e4d256-prod-github-runner-207 kernel: [66712.615983] ? __x64_sys_futex+0x78/0x1e0 Aug 22 23:55:38 juju-e4d256-prod-github-runner-207 kernel: [66712.616667] ? __secure_computing+0xa9/0x120 Aug 22 23:55:38 juju-e4d256-prod-github-runner-207 kernel: [66712.617384] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 23:55:38 juju-e4d256-prod-github-runner-207 kernel: [66712.618170] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:55:38 juju-e4d256-prod-github-runner-207 kernel: [66712.618923] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:55:38 juju-e4d256-prod-github-runner-207 kernel: [66712.619659] ? do_syscall_64+0x69/0xc0 Aug 22 23:55:38 juju-e4d256-prod-github-runner-207 kernel: [66712.620312] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:55:38 juju-e4d256-prod-github-runner-207 kernel: [66712.621030] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:55:38 juju-e4d256-prod-github-runner-207 kernel: [66712.621740] ? do_syscall_64+0x69/0xc0 Aug 22 23:55:38 juju-e4d256-prod-github-runner-207 kernel: [66712.622373] ? do_syscall_64+0x69/0xc0 Aug 22 23:55:38 juju-e4d256-prod-github-runner-207 kernel: [66712.623024] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 23:55:38 juju-e4d256-prod-github-runner-207 kernel: [66712.623745] RIP: 0033:0x7faa5d0edaff Aug 22 23:55:38 juju-e4d256-prod-github-runner-207 kernel: [66712.624430] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 23:55:38 juju-e4d256-prod-github-runner-207 kernel: [66712.626488] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 23:55:38 juju-e4d256-prod-github-runner-207 kernel: [66712.627422] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 23:55:38 juju-e4d256-prod-github-runner-207 kernel: [66712.628330] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 23:55:38 juju-e4d256-prod-github-runner-207 kernel: [66712.629239] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 23:55:38 juju-e4d256-prod-github-runner-207 kernel: [66712.630147] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 23:55:38 juju-e4d256-prod-github-runner-207 kernel: [66712.631063] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 23:55:38 juju-e4d256-prod-github-runner-207 kernel: [66712.631973] Aug 22 23:56:06 juju-e4d256-prod-github-runner-207 kernel: [66740.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 62048s! [qemu-system-x86:6715] Aug 22 23:56:06 juju-e4d256-prod-github-runner-207 kernel: [66740.544061] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 23:56:06 juju-e4d256-prod-github-runner-207 kernel: [66740.544377] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 23:56:06 juju-e4d256-prod-github-runner-207 kernel: [66740.556519] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 23:56:06 juju-e4d256-prod-github-runner-207 kernel: [66740.557825] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 23:56:06 juju-e4d256-prod-github-runner-207 kernel: [66740.559074] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:56:06 juju-e4d256-prod-github-runner-207 kernel: [66740.560137] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 23:56:06 juju-e4d256-prod-github-runner-207 kernel: [66740.562696] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 23:56:06 juju-e4d256-prod-github-runner-207 kernel: [66740.563747] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 23:56:06 juju-e4d256-prod-github-runner-207 kernel: [66740.564922] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 23:56:06 juju-e4d256-prod-github-runner-207 kernel: [66740.566079] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 23:56:06 juju-e4d256-prod-github-runner-207 kernel: [66740.567249] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 23:56:06 juju-e4d256-prod-github-runner-207 kernel: [66740.568413] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 23:56:06 juju-e4d256-prod-github-runner-207 kernel: [66740.569731] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 23:56:06 juju-e4d256-prod-github-runner-207 kernel: [66740.571649] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 23:56:06 juju-e4d256-prod-github-runner-207 kernel: [66740.573014] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 23:56:06 juju-e4d256-prod-github-runner-207 kernel: [66740.574645] Call Trace: Aug 22 23:56:06 juju-e4d256-prod-github-runner-207 kernel: [66740.575877] Aug 22 23:56:06 juju-e4d256-prod-github-runner-207 kernel: [66740.577049] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:56:06 juju-e4d256-prod-github-runner-207 kernel: [66740.578191] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:56:06 juju-e4d256-prod-github-runner-207 kernel: [66740.579249] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:56:06 juju-e4d256-prod-github-runner-207 kernel: [66740.580351] ? show_regs.part.0+0x23/0x29 Aug 22 23:56:06 juju-e4d256-prod-github-runner-207 kernel: [66740.581348] ? show_regs.cold+0x8/0xd Aug 22 23:56:06 juju-e4d256-prod-github-runner-207 kernel: [66740.582330] ? watchdog_timer_fn+0x1be/0x220 Aug 22 23:56:06 juju-e4d256-prod-github-runner-207 kernel: [66740.583353] ? lockup_detector_update_enable+0x60/0x60 Aug 22 23:56:06 juju-e4d256-prod-github-runner-207 kernel: [66740.584491] ? __hrtimer_run_queues+0x107/0x230 Aug 22 23:56:06 juju-e4d256-prod-github-runner-207 kernel: [66740.585875] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 23:56:06 juju-e4d256-prod-github-runner-207 kernel: [66740.587013] ? hrtimer_interrupt+0x101/0x220 Aug 22 23:56:06 juju-e4d256-prod-github-runner-207 kernel: [66740.588030] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 23:56:06 juju-e4d256-prod-github-runner-207 kernel: [66740.589107] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 23:56:06 juju-e4d256-prod-github-runner-207 kernel: [66740.590156] Aug 22 23:56:06 juju-e4d256-prod-github-runner-207 kernel: [66740.591023] Aug 22 23:56:06 juju-e4d256-prod-github-runner-207 kernel: [66740.591859] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 23:56:06 juju-e4d256-prod-github-runner-207 kernel: [66740.592894] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:56:06 juju-e4d256-prod-github-runner-207 kernel: [66740.593935] ? _raw_spin_lock+0x22/0x30 Aug 22 23:56:06 juju-e4d256-prod-github-runner-207 kernel: [66740.594894] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:56:06 juju-e4d256-prod-github-runner-207 kernel: [66740.595918] direct_page_fault+0x206/0x310 [kvm] Aug 22 23:56:06 juju-e4d256-prod-github-runner-207 kernel: [66740.596945] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 23:56:06 juju-e4d256-prod-github-runner-207 kernel: [66740.597970] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 23:56:06 juju-e4d256-prod-github-runner-207 kernel: [66740.598999] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 23:56:06 juju-e4d256-prod-github-runner-207 kernel: [66740.600021] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 23:56:06 juju-e4d256-prod-github-runner-207 kernel: [66740.600968] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 23:56:06 juju-e4d256-prod-github-runner-207 kernel: [66740.601964] handle_exit+0x98/0x230 [kvm_amd] Aug 22 23:56:06 juju-e4d256-prod-github-runner-207 kernel: [66740.602924] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 23:56:06 juju-e4d256-prod-github-runner-207 kernel: [66740.603845] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 23:56:06 juju-e4d256-prod-github-runner-207 kernel: [66740.604775] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 23:56:06 juju-e4d256-prod-github-runner-207 kernel: [66740.605679] vcpu_run+0x62/0x2c0 [kvm] Aug 22 23:56:06 juju-e4d256-prod-github-runner-207 kernel: [66740.606497] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 23:56:06 juju-e4d256-prod-github-runner-207 kernel: [66740.607320] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 23:56:06 juju-e4d256-prod-github-runner-207 kernel: [66740.608180] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 23:56:06 juju-e4d256-prod-github-runner-207 kernel: [66740.608983] ? __seccomp_filter+0x4a/0x4a0 Aug 22 23:56:06 juju-e4d256-prod-github-runner-207 kernel: [66740.609731] ? __fget_files+0x86/0xc0 Aug 22 23:56:06 juju-e4d256-prod-github-runner-207 kernel: [66740.610444] __x64_sys_ioctl+0x95/0xd0 Aug 22 23:56:06 juju-e4d256-prod-github-runner-207 kernel: [66740.611149] do_syscall_64+0x5c/0xc0 Aug 22 23:56:06 juju-e4d256-prod-github-runner-207 kernel: [66740.611820] ? do_futex+0x162/0x1f0 Aug 22 23:56:06 juju-e4d256-prod-github-runner-207 kernel: [66740.612469] ? __x64_sys_futex+0x78/0x1e0 Aug 22 23:56:06 juju-e4d256-prod-github-runner-207 kernel: [66740.613161] ? __secure_computing+0xa9/0x120 Aug 22 23:56:06 juju-e4d256-prod-github-runner-207 kernel: [66740.613869] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 23:56:06 juju-e4d256-prod-github-runner-207 kernel: [66740.614646] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:56:06 juju-e4d256-prod-github-runner-207 kernel: [66740.615413] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:56:06 juju-e4d256-prod-github-runner-207 kernel: [66740.616151] ? do_syscall_64+0x69/0xc0 Aug 22 23:56:06 juju-e4d256-prod-github-runner-207 kernel: [66740.616808] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:56:06 juju-e4d256-prod-github-runner-207 kernel: [66740.617510] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:56:06 juju-e4d256-prod-github-runner-207 kernel: [66740.618208] ? do_syscall_64+0x69/0xc0 Aug 22 23:56:06 juju-e4d256-prod-github-runner-207 kernel: [66740.618864] ? do_syscall_64+0x69/0xc0 Aug 22 23:56:06 juju-e4d256-prod-github-runner-207 kernel: [66740.619490] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 23:56:06 juju-e4d256-prod-github-runner-207 kernel: [66740.620198] RIP: 0033:0x7faa5d0edaff Aug 22 23:56:06 juju-e4d256-prod-github-runner-207 kernel: [66740.620863] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 23:56:06 juju-e4d256-prod-github-runner-207 kernel: [66740.622874] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 23:56:06 juju-e4d256-prod-github-runner-207 kernel: [66740.623794] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 23:56:06 juju-e4d256-prod-github-runner-207 kernel: [66740.624681] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 23:56:06 juju-e4d256-prod-github-runner-207 kernel: [66740.625578] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 23:56:06 juju-e4d256-prod-github-runner-207 kernel: [66740.626482] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 23:56:06 juju-e4d256-prod-github-runner-207 kernel: [66740.627386] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 23:56:06 juju-e4d256-prod-github-runner-207 kernel: [66740.628293] Aug 22 23:56:34 juju-e4d256-prod-github-runner-207 kernel: [66768.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 62075s! [qemu-system-x86:6715] Aug 22 23:56:34 juju-e4d256-prod-github-runner-207 kernel: [66768.543917] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 23:56:34 juju-e4d256-prod-github-runner-207 kernel: [66768.544283] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 23:56:34 juju-e4d256-prod-github-runner-207 kernel: [66768.556812] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 23:56:34 juju-e4d256-prod-github-runner-207 kernel: [66768.558083] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 23:56:34 juju-e4d256-prod-github-runner-207 kernel: [66768.559353] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:56:34 juju-e4d256-prod-github-runner-207 kernel: [66768.560431] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 23:56:34 juju-e4d256-prod-github-runner-207 kernel: [66768.563017] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 23:56:34 juju-e4d256-prod-github-runner-207 kernel: [66768.564088] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 23:56:34 juju-e4d256-prod-github-runner-207 kernel: [66768.565273] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 23:56:34 juju-e4d256-prod-github-runner-207 kernel: [66768.566550] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 23:56:34 juju-e4d256-prod-github-runner-207 kernel: [66768.567711] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 23:56:34 juju-e4d256-prod-github-runner-207 kernel: [66768.568883] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 23:56:34 juju-e4d256-prod-github-runner-207 kernel: [66768.570087] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 23:56:34 juju-e4d256-prod-github-runner-207 kernel: [66768.571348] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 23:56:34 juju-e4d256-prod-github-runner-207 kernel: [66768.572471] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 23:56:34 juju-e4d256-prod-github-runner-207 kernel: [66768.573665] Call Trace: Aug 22 23:56:34 juju-e4d256-prod-github-runner-207 kernel: [66768.574609] Aug 22 23:56:34 juju-e4d256-prod-github-runner-207 kernel: [66768.575539] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:56:34 juju-e4d256-prod-github-runner-207 kernel: [66768.576588] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:56:34 juju-e4d256-prod-github-runner-207 kernel: [66768.577616] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:56:34 juju-e4d256-prod-github-runner-207 kernel: [66768.578733] ? show_regs.part.0+0x23/0x29 Aug 22 23:56:34 juju-e4d256-prod-github-runner-207 kernel: [66768.579748] ? show_regs.cold+0x8/0xd Aug 22 23:56:34 juju-e4d256-prod-github-runner-207 kernel: [66768.580751] ? watchdog_timer_fn+0x1be/0x220 Aug 22 23:56:34 juju-e4d256-prod-github-runner-207 kernel: [66768.581774] ? lockup_detector_update_enable+0x60/0x60 Aug 22 23:56:34 juju-e4d256-prod-github-runner-207 kernel: [66768.582860] ? __hrtimer_run_queues+0x107/0x230 Aug 22 23:56:34 juju-e4d256-prod-github-runner-207 kernel: [66768.583890] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 23:56:34 juju-e4d256-prod-github-runner-207 kernel: [66768.584932] ? hrtimer_interrupt+0x101/0x220 Aug 22 23:56:34 juju-e4d256-prod-github-runner-207 kernel: [66768.585982] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 23:56:34 juju-e4d256-prod-github-runner-207 kernel: [66768.587088] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 23:56:34 juju-e4d256-prod-github-runner-207 kernel: [66768.588138] Aug 22 23:56:34 juju-e4d256-prod-github-runner-207 kernel: [66768.588996] Aug 22 23:56:34 juju-e4d256-prod-github-runner-207 kernel: [66768.589850] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 23:56:34 juju-e4d256-prod-github-runner-207 kernel: [66768.590947] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:56:34 juju-e4d256-prod-github-runner-207 kernel: [66768.592086] ? _raw_spin_lock+0x22/0x30 Aug 22 23:56:34 juju-e4d256-prod-github-runner-207 kernel: [66768.593082] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:56:34 juju-e4d256-prod-github-runner-207 kernel: [66768.594126] direct_page_fault+0x206/0x310 [kvm] Aug 22 23:56:34 juju-e4d256-prod-github-runner-207 kernel: [66768.595182] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 23:56:34 juju-e4d256-prod-github-runner-207 kernel: [66768.596230] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 23:56:34 juju-e4d256-prod-github-runner-207 kernel: [66768.597246] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 23:56:34 juju-e4d256-prod-github-runner-207 kernel: [66768.598271] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 23:56:34 juju-e4d256-prod-github-runner-207 kernel: [66768.599223] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 23:56:34 juju-e4d256-prod-github-runner-207 kernel: [66768.600219] handle_exit+0x98/0x230 [kvm_amd] Aug 22 23:56:34 juju-e4d256-prod-github-runner-207 kernel: [66768.601148] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 23:56:34 juju-e4d256-prod-github-runner-207 kernel: [66768.602087] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 23:56:34 juju-e4d256-prod-github-runner-207 kernel: [66768.603041] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 23:56:34 juju-e4d256-prod-github-runner-207 kernel: [66768.603948] vcpu_run+0x62/0x2c0 [kvm] Aug 22 23:56:34 juju-e4d256-prod-github-runner-207 kernel: [66768.604760] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 23:56:34 juju-e4d256-prod-github-runner-207 kernel: [66768.605587] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 23:56:34 juju-e4d256-prod-github-runner-207 kernel: [66768.606488] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 23:56:34 juju-e4d256-prod-github-runner-207 kernel: [66768.607311] ? __seccomp_filter+0x4a/0x4a0 Aug 22 23:56:34 juju-e4d256-prod-github-runner-207 kernel: [66768.608061] ? __fget_files+0x86/0xc0 Aug 22 23:56:34 juju-e4d256-prod-github-runner-207 kernel: [66768.608767] __x64_sys_ioctl+0x95/0xd0 Aug 22 23:56:34 juju-e4d256-prod-github-runner-207 kernel: [66768.609463] do_syscall_64+0x5c/0xc0 Aug 22 23:56:34 juju-e4d256-prod-github-runner-207 kernel: [66768.610149] ? do_futex+0x162/0x1f0 Aug 22 23:56:34 juju-e4d256-prod-github-runner-207 kernel: [66768.610865] ? __x64_sys_futex+0x78/0x1e0 Aug 22 23:56:34 juju-e4d256-prod-github-runner-207 kernel: [66768.611631] ? __secure_computing+0xa9/0x120 Aug 22 23:56:34 juju-e4d256-prod-github-runner-207 kernel: [66768.612348] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 23:56:34 juju-e4d256-prod-github-runner-207 kernel: [66768.613121] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:56:34 juju-e4d256-prod-github-runner-207 kernel: [66768.613844] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:56:34 juju-e4d256-prod-github-runner-207 kernel: [66768.614575] ? do_syscall_64+0x69/0xc0 Aug 22 23:56:34 juju-e4d256-prod-github-runner-207 kernel: [66768.615233] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:56:34 juju-e4d256-prod-github-runner-207 kernel: [66768.615945] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:56:34 juju-e4d256-prod-github-runner-207 kernel: [66768.616658] ? do_syscall_64+0x69/0xc0 Aug 22 23:56:34 juju-e4d256-prod-github-runner-207 kernel: [66768.617299] ? do_syscall_64+0x69/0xc0 Aug 22 23:56:34 juju-e4d256-prod-github-runner-207 kernel: [66768.617926] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 23:56:34 juju-e4d256-prod-github-runner-207 kernel: [66768.618668] RIP: 0033:0x7faa5d0edaff Aug 22 23:56:34 juju-e4d256-prod-github-runner-207 kernel: [66768.619333] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 23:56:34 juju-e4d256-prod-github-runner-207 kernel: [66768.621399] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 23:56:34 juju-e4d256-prod-github-runner-207 kernel: [66768.622392] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 23:56:34 juju-e4d256-prod-github-runner-207 kernel: [66768.623438] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 23:56:34 juju-e4d256-prod-github-runner-207 kernel: [66768.624551] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 23:56:34 juju-e4d256-prod-github-runner-207 kernel: [66768.625455] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 23:56:34 juju-e4d256-prod-github-runner-207 kernel: [66768.626393] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 23:56:34 juju-e4d256-prod-github-runner-207 kernel: [66768.627306] Aug 22 23:56:47 juju-e4d256-prod-github-runner-207 kernel: [66781.640704] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 23:56:47 juju-e4d256-prod-github-runner-207 kernel: [66781.641674] rcu: 1-....: (16613563 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=8020780 Aug 22 23:56:47 juju-e4d256-prod-github-runner-207 kernel: [66781.642806] (t=16666110 jiffies g=23269 q=58306) Aug 22 23:56:47 juju-e4d256-prod-github-runner-207 kernel: [66781.643596] NMI backtrace for cpu 1 Aug 22 23:56:47 juju-e4d256-prod-github-runner-207 kernel: [66781.644312] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 23:56:47 juju-e4d256-prod-github-runner-207 kernel: [66781.645413] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 23:56:47 juju-e4d256-prod-github-runner-207 kernel: [66781.646476] Call Trace: Aug 22 23:56:47 juju-e4d256-prod-github-runner-207 kernel: [66781.647150] Aug 22 23:56:47 juju-e4d256-prod-github-runner-207 kernel: [66781.647792] show_stack+0x52/0x5c Aug 22 23:56:47 juju-e4d256-prod-github-runner-207 kernel: [66781.648518] dump_stack_lvl+0x4a/0x63 Aug 22 23:56:47 juju-e4d256-prod-github-runner-207 kernel: [66781.649261] dump_stack+0x10/0x16 Aug 22 23:56:47 juju-e4d256-prod-github-runner-207 kernel: [66781.649975] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 23:56:47 juju-e4d256-prod-github-runner-207 kernel: [66781.650761] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 23:56:47 juju-e4d256-prod-github-runner-207 kernel: [66781.651542] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 23:56:47 juju-e4d256-prod-github-runner-207 kernel: [66781.652356] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 23:56:47 juju-e4d256-prod-github-runner-207 kernel: [66781.653170] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 23:56:47 juju-e4d256-prod-github-runner-207 kernel: [66781.653975] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 23:56:47 juju-e4d256-prod-github-runner-207 kernel: [66781.654849] print_cpu_stall.cold+0x2f/0xe2 Aug 22 23:56:47 juju-e4d256-prod-github-runner-207 kernel: [66781.655609] ? timekeeping_update+0xf7/0x150 Aug 22 23:56:47 juju-e4d256-prod-github-runner-207 kernel: [66781.656376] check_cpu_stall+0x109/0x270 Aug 22 23:56:47 juju-e4d256-prod-github-runner-207 kernel: [66781.657125] rcu_sched_clock_irq+0x9a/0x250 Aug 22 23:56:47 juju-e4d256-prod-github-runner-207 kernel: [66781.657883] update_process_times+0x94/0xd0 Aug 22 23:56:47 juju-e4d256-prod-github-runner-207 kernel: [66781.658649] tick_sched_handle+0x29/0x70 Aug 22 23:56:47 juju-e4d256-prod-github-runner-207 kernel: [66781.659392] tick_sched_timer+0x8c/0xc0 Aug 22 23:56:47 juju-e4d256-prod-github-runner-207 kernel: [66781.660133] ? tick_nohz_handler+0xb0/0xb0 Aug 22 23:56:47 juju-e4d256-prod-github-runner-207 kernel: [66781.660885] __hrtimer_run_queues+0x107/0x230 Aug 22 23:56:47 juju-e4d256-prod-github-runner-207 kernel: [66781.661661] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 23:56:47 juju-e4d256-prod-github-runner-207 kernel: [66781.662443] hrtimer_interrupt+0x101/0x220 Aug 22 23:56:47 juju-e4d256-prod-github-runner-207 kernel: [66781.663201] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 23:56:47 juju-e4d256-prod-github-runner-207 kernel: [66781.664010] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 23:56:47 juju-e4d256-prod-github-runner-207 kernel: [66781.664816] Aug 22 23:56:47 juju-e4d256-prod-github-runner-207 kernel: [66781.665448] Aug 22 23:56:47 juju-e4d256-prod-github-runner-207 kernel: [66781.666082] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 23:56:47 juju-e4d256-prod-github-runner-207 kernel: [66781.666899] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:56:47 juju-e4d256-prod-github-runner-207 kernel: [66781.667781] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 23:56:47 juju-e4d256-prod-github-runner-207 kernel: [66781.669978] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 23:56:47 juju-e4d256-prod-github-runner-207 kernel: [66781.670861] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 23:56:47 juju-e4d256-prod-github-runner-207 kernel: [66781.671850] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 23:56:47 juju-e4d256-prod-github-runner-207 kernel: [66781.672824] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 23:56:47 juju-e4d256-prod-github-runner-207 kernel: [66781.673784] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 23:56:47 juju-e4d256-prod-github-runner-207 kernel: [66781.674750] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 23:56:47 juju-e4d256-prod-github-runner-207 kernel: [66781.675698] ? _raw_spin_lock+0x22/0x30 Aug 22 23:56:47 juju-e4d256-prod-github-runner-207 kernel: [66781.676458] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:56:47 juju-e4d256-prod-github-runner-207 kernel: [66781.677304] direct_page_fault+0x206/0x310 [kvm] Aug 22 23:56:47 juju-e4d256-prod-github-runner-207 kernel: [66781.678182] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 23:56:47 juju-e4d256-prod-github-runner-207 kernel: [66781.679009] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 23:56:47 juju-e4d256-prod-github-runner-207 kernel: [66781.679834] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 23:56:47 juju-e4d256-prod-github-runner-207 kernel: [66781.680636] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 23:56:47 juju-e4d256-prod-github-runner-207 kernel: [66781.681434] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 23:56:47 juju-e4d256-prod-github-runner-207 kernel: [66781.682263] handle_exit+0x98/0x230 [kvm_amd] Aug 22 23:56:47 juju-e4d256-prod-github-runner-207 kernel: [66781.683016] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 23:56:47 juju-e4d256-prod-github-runner-207 kernel: [66781.683798] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 23:56:47 juju-e4d256-prod-github-runner-207 kernel: [66781.684595] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 23:56:47 juju-e4d256-prod-github-runner-207 kernel: [66781.685377] vcpu_run+0x62/0x2c0 [kvm] Aug 22 23:56:47 juju-e4d256-prod-github-runner-207 kernel: [66781.686102] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 23:56:47 juju-e4d256-prod-github-runner-207 kernel: [66781.686835] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 23:56:47 juju-e4d256-prod-github-runner-207 kernel: [66781.687665] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 23:56:47 juju-e4d256-prod-github-runner-207 kernel: [66781.688425] ? __seccomp_filter+0x4a/0x4a0 Aug 22 23:56:47 juju-e4d256-prod-github-runner-207 kernel: [66781.689144] ? __fget_files+0x86/0xc0 Aug 22 23:56:47 juju-e4d256-prod-github-runner-207 kernel: [66781.689846] __x64_sys_ioctl+0x95/0xd0 Aug 22 23:56:47 juju-e4d256-prod-github-runner-207 kernel: [66781.690548] do_syscall_64+0x5c/0xc0 Aug 22 23:56:47 juju-e4d256-prod-github-runner-207 kernel: [66781.691225] ? do_futex+0x162/0x1f0 Aug 22 23:56:47 juju-e4d256-prod-github-runner-207 kernel: [66781.691893] ? __x64_sys_futex+0x78/0x1e0 Aug 22 23:56:47 juju-e4d256-prod-github-runner-207 kernel: [66781.692591] ? __secure_computing+0xa9/0x120 Aug 22 23:56:47 juju-e4d256-prod-github-runner-207 kernel: [66781.693304] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 23:56:47 juju-e4d256-prod-github-runner-207 kernel: [66781.694101] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:56:47 juju-e4d256-prod-github-runner-207 kernel: [66781.694853] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:56:47 juju-e4d256-prod-github-runner-207 kernel: [66781.695604] ? do_syscall_64+0x69/0xc0 Aug 22 23:56:47 juju-e4d256-prod-github-runner-207 kernel: [66781.696295] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:56:47 juju-e4d256-prod-github-runner-207 kernel: [66781.697049] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:56:47 juju-e4d256-prod-github-runner-207 kernel: [66781.697804] ? do_syscall_64+0x69/0xc0 Aug 22 23:56:47 juju-e4d256-prod-github-runner-207 kernel: [66781.698507] ? do_syscall_64+0x69/0xc0 Aug 22 23:56:47 juju-e4d256-prod-github-runner-207 kernel: [66781.699193] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 23:56:47 juju-e4d256-prod-github-runner-207 kernel: [66781.699960] RIP: 0033:0x7faa5d0edaff Aug 22 23:56:47 juju-e4d256-prod-github-runner-207 kernel: [66781.700666] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 23:56:47 juju-e4d256-prod-github-runner-207 kernel: [66781.702770] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 23:56:47 juju-e4d256-prod-github-runner-207 kernel: [66781.703768] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 23:56:47 juju-e4d256-prod-github-runner-207 kernel: [66781.704713] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 23:56:47 juju-e4d256-prod-github-runner-207 kernel: [66781.705656] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 23:56:47 juju-e4d256-prod-github-runner-207 kernel: [66781.706610] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 23:56:47 juju-e4d256-prod-github-runner-207 kernel: [66781.707535] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 23:56:47 juju-e4d256-prod-github-runner-207 kernel: [66781.708448] Aug 22 23:57:14 juju-e4d256-prod-github-runner-207 kernel: [66808.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 62112s! [qemu-system-x86:6715] Aug 22 23:57:14 juju-e4d256-prod-github-runner-207 kernel: [66808.543172] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 23:57:14 juju-e4d256-prod-github-runner-207 kernel: [66808.543247] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 23:57:14 juju-e4d256-prod-github-runner-207 kernel: [66808.555678] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 23:57:14 juju-e4d256-prod-github-runner-207 kernel: [66808.556943] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 23:57:14 juju-e4d256-prod-github-runner-207 kernel: [66808.558181] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:57:14 juju-e4d256-prod-github-runner-207 kernel: [66808.559237] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 23:57:14 juju-e4d256-prod-github-runner-207 kernel: [66808.561798] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 23:57:14 juju-e4d256-prod-github-runner-207 kernel: [66808.563051] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 23:57:14 juju-e4d256-prod-github-runner-207 kernel: [66808.564357] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 23:57:14 juju-e4d256-prod-github-runner-207 kernel: [66808.565540] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 23:57:14 juju-e4d256-prod-github-runner-207 kernel: [66808.566743] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 23:57:14 juju-e4d256-prod-github-runner-207 kernel: [66808.567948] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 23:57:14 juju-e4d256-prod-github-runner-207 kernel: [66808.569187] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 23:57:14 juju-e4d256-prod-github-runner-207 kernel: [66808.570578] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 23:57:14 juju-e4d256-prod-github-runner-207 kernel: [66808.572017] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 23:57:14 juju-e4d256-prod-github-runner-207 kernel: [66808.573395] Call Trace: Aug 22 23:57:14 juju-e4d256-prod-github-runner-207 kernel: [66808.574326] Aug 22 23:57:14 juju-e4d256-prod-github-runner-207 kernel: [66808.575211] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:57:14 juju-e4d256-prod-github-runner-207 kernel: [66808.576241] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:57:14 juju-e4d256-prod-github-runner-207 kernel: [66808.577264] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:57:14 juju-e4d256-prod-github-runner-207 kernel: [66808.578358] ? show_regs.part.0+0x23/0x29 Aug 22 23:57:14 juju-e4d256-prod-github-runner-207 kernel: [66808.579357] ? show_regs.cold+0x8/0xd Aug 22 23:57:14 juju-e4d256-prod-github-runner-207 kernel: [66808.580433] ? watchdog_timer_fn+0x1be/0x220 Aug 22 23:57:14 juju-e4d256-prod-github-runner-207 kernel: [66808.581718] ? lockup_detector_update_enable+0x60/0x60 Aug 22 23:57:14 juju-e4d256-prod-github-runner-207 kernel: [66808.582969] ? __hrtimer_run_queues+0x107/0x230 Aug 22 23:57:14 juju-e4d256-prod-github-runner-207 kernel: [66808.584030] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 23:57:14 juju-e4d256-prod-github-runner-207 kernel: [66808.585058] ? hrtimer_interrupt+0x101/0x220 Aug 22 23:57:14 juju-e4d256-prod-github-runner-207 kernel: [66808.586102] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 23:57:14 juju-e4d256-prod-github-runner-207 kernel: [66808.587183] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 23:57:14 juju-e4d256-prod-github-runner-207 kernel: [66808.588238] Aug 22 23:57:14 juju-e4d256-prod-github-runner-207 kernel: [66808.589113] Aug 22 23:57:14 juju-e4d256-prod-github-runner-207 kernel: [66808.590213] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 23:57:14 juju-e4d256-prod-github-runner-207 kernel: [66808.591463] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:57:14 juju-e4d256-prod-github-runner-207 kernel: [66808.592577] ? _raw_spin_lock+0x22/0x30 Aug 22 23:57:14 juju-e4d256-prod-github-runner-207 kernel: [66808.593534] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:57:14 juju-e4d256-prod-github-runner-207 kernel: [66808.594595] direct_page_fault+0x206/0x310 [kvm] Aug 22 23:57:14 juju-e4d256-prod-github-runner-207 kernel: [66808.595633] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 23:57:14 juju-e4d256-prod-github-runner-207 kernel: [66808.596654] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 23:57:14 juju-e4d256-prod-github-runner-207 kernel: [66808.597678] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 23:57:14 juju-e4d256-prod-github-runner-207 kernel: [66808.598667] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 23:57:14 juju-e4d256-prod-github-runner-207 kernel: [66808.599616] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 23:57:14 juju-e4d256-prod-github-runner-207 kernel: [66808.600593] handle_exit+0x98/0x230 [kvm_amd] Aug 22 23:57:14 juju-e4d256-prod-github-runner-207 kernel: [66808.601483] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 23:57:14 juju-e4d256-prod-github-runner-207 kernel: [66808.602414] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 23:57:14 juju-e4d256-prod-github-runner-207 kernel: [66808.603333] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 23:57:14 juju-e4d256-prod-github-runner-207 kernel: [66808.604235] vcpu_run+0x62/0x2c0 [kvm] Aug 22 23:57:14 juju-e4d256-prod-github-runner-207 kernel: [66808.605052] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 23:57:14 juju-e4d256-prod-github-runner-207 kernel: [66808.605912] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 23:57:14 juju-e4d256-prod-github-runner-207 kernel: [66808.606907] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 23:57:14 juju-e4d256-prod-github-runner-207 kernel: [66808.607720] ? __seccomp_filter+0x4a/0x4a0 Aug 22 23:57:14 juju-e4d256-prod-github-runner-207 kernel: [66808.608550] ? __fget_files+0x86/0xc0 Aug 22 23:57:14 juju-e4d256-prod-github-runner-207 kernel: [66808.609379] __x64_sys_ioctl+0x95/0xd0 Aug 22 23:57:14 juju-e4d256-prod-github-runner-207 kernel: [66808.610105] do_syscall_64+0x5c/0xc0 Aug 22 23:57:14 juju-e4d256-prod-github-runner-207 kernel: [66808.610772] ? do_futex+0x162/0x1f0 Aug 22 23:57:14 juju-e4d256-prod-github-runner-207 kernel: [66808.611441] ? __x64_sys_futex+0x78/0x1e0 Aug 22 23:57:14 juju-e4d256-prod-github-runner-207 kernel: [66808.612117] ? __secure_computing+0xa9/0x120 Aug 22 23:57:14 juju-e4d256-prod-github-runner-207 kernel: [66808.612846] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 23:57:14 juju-e4d256-prod-github-runner-207 kernel: [66808.613610] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:57:14 juju-e4d256-prod-github-runner-207 kernel: [66808.614353] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:57:14 juju-e4d256-prod-github-runner-207 kernel: [66808.615070] ? do_syscall_64+0x69/0xc0 Aug 22 23:57:14 juju-e4d256-prod-github-runner-207 kernel: [66808.615714] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:57:14 juju-e4d256-prod-github-runner-207 kernel: [66808.616416] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:57:14 juju-e4d256-prod-github-runner-207 kernel: [66808.617110] ? do_syscall_64+0x69/0xc0 Aug 22 23:57:14 juju-e4d256-prod-github-runner-207 kernel: [66808.617745] ? do_syscall_64+0x69/0xc0 Aug 22 23:57:14 juju-e4d256-prod-github-runner-207 kernel: [66808.618367] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 23:57:14 juju-e4d256-prod-github-runner-207 kernel: [66808.619071] RIP: 0033:0x7faa5d0edaff Aug 22 23:57:14 juju-e4d256-prod-github-runner-207 kernel: [66808.619693] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 23:57:14 juju-e4d256-prod-github-runner-207 kernel: [66808.621677] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 23:57:14 juju-e4d256-prod-github-runner-207 kernel: [66808.622599] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 23:57:14 juju-e4d256-prod-github-runner-207 kernel: [66808.623488] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 23:57:14 juju-e4d256-prod-github-runner-207 kernel: [66808.624376] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 23:57:14 juju-e4d256-prod-github-runner-207 kernel: [66808.625261] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 23:57:14 juju-e4d256-prod-github-runner-207 kernel: [66808.626160] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 23:57:14 juju-e4d256-prod-github-runner-207 kernel: [66808.627051] Aug 22 23:57:42 juju-e4d256-prod-github-runner-207 kernel: [66836.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 62138s! [qemu-system-x86:6715] Aug 22 23:57:42 juju-e4d256-prod-github-runner-207 kernel: [66836.543911] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 23:57:42 juju-e4d256-prod-github-runner-207 kernel: [66836.544228] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 23:57:42 juju-e4d256-prod-github-runner-207 kernel: [66836.556672] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 23:57:42 juju-e4d256-prod-github-runner-207 kernel: [66836.558016] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 23:57:42 juju-e4d256-prod-github-runner-207 kernel: [66836.559255] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:57:42 juju-e4d256-prod-github-runner-207 kernel: [66836.560312] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 23:57:42 juju-e4d256-prod-github-runner-207 kernel: [66836.562898] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 23:57:42 juju-e4d256-prod-github-runner-207 kernel: [66836.563941] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 23:57:42 juju-e4d256-prod-github-runner-207 kernel: [66836.565128] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 23:57:42 juju-e4d256-prod-github-runner-207 kernel: [66836.566306] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 23:57:42 juju-e4d256-prod-github-runner-207 kernel: [66836.567471] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 23:57:42 juju-e4d256-prod-github-runner-207 kernel: [66836.568632] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 23:57:42 juju-e4d256-prod-github-runner-207 kernel: [66836.569817] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 23:57:42 juju-e4d256-prod-github-runner-207 kernel: [66836.571050] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 23:57:42 juju-e4d256-prod-github-runner-207 kernel: [66836.572146] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 23:57:42 juju-e4d256-prod-github-runner-207 kernel: [66836.573338] Call Trace: Aug 22 23:57:42 juju-e4d256-prod-github-runner-207 kernel: [66836.574378] Aug 22 23:57:42 juju-e4d256-prod-github-runner-207 kernel: [66836.575437] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:57:42 juju-e4d256-prod-github-runner-207 kernel: [66836.576483] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:57:42 juju-e4d256-prod-github-runner-207 kernel: [66836.577530] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:57:42 juju-e4d256-prod-github-runner-207 kernel: [66836.578638] ? show_regs.part.0+0x23/0x29 Aug 22 23:57:42 juju-e4d256-prod-github-runner-207 kernel: [66836.579639] ? show_regs.cold+0x8/0xd Aug 22 23:57:42 juju-e4d256-prod-github-runner-207 kernel: [66836.580632] ? watchdog_timer_fn+0x1be/0x220 Aug 22 23:57:42 juju-e4d256-prod-github-runner-207 kernel: [66836.581664] ? lockup_detector_update_enable+0x60/0x60 Aug 22 23:57:42 juju-e4d256-prod-github-runner-207 kernel: [66836.582735] ? __hrtimer_run_queues+0x107/0x230 Aug 22 23:57:42 juju-e4d256-prod-github-runner-207 kernel: [66836.583767] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 23:57:42 juju-e4d256-prod-github-runner-207 kernel: [66836.584794] ? hrtimer_interrupt+0x101/0x220 Aug 22 23:57:42 juju-e4d256-prod-github-runner-207 kernel: [66836.585828] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 23:57:42 juju-e4d256-prod-github-runner-207 kernel: [66836.586906] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 23:57:42 juju-e4d256-prod-github-runner-207 kernel: [66836.587953] Aug 22 23:57:42 juju-e4d256-prod-github-runner-207 kernel: [66836.588809] Aug 22 23:57:42 juju-e4d256-prod-github-runner-207 kernel: [66836.589663] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 23:57:42 juju-e4d256-prod-github-runner-207 kernel: [66836.590707] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:57:42 juju-e4d256-prod-github-runner-207 kernel: [66836.591764] ? _raw_spin_lock+0x22/0x30 Aug 22 23:57:42 juju-e4d256-prod-github-runner-207 kernel: [66836.592718] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:57:42 juju-e4d256-prod-github-runner-207 kernel: [66836.593765] direct_page_fault+0x206/0x310 [kvm] Aug 22 23:57:42 juju-e4d256-prod-github-runner-207 kernel: [66836.594801] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 23:57:42 juju-e4d256-prod-github-runner-207 kernel: [66836.595815] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 23:57:42 juju-e4d256-prod-github-runner-207 kernel: [66836.596822] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 23:57:42 juju-e4d256-prod-github-runner-207 kernel: [66836.597847] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 23:57:42 juju-e4d256-prod-github-runner-207 kernel: [66836.598801] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 23:57:42 juju-e4d256-prod-github-runner-207 kernel: [66836.599784] handle_exit+0x98/0x230 [kvm_amd] Aug 22 23:57:42 juju-e4d256-prod-github-runner-207 kernel: [66836.600681] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 23:57:42 juju-e4d256-prod-github-runner-207 kernel: [66836.601646] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 23:57:42 juju-e4d256-prod-github-runner-207 kernel: [66836.602579] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 23:57:42 juju-e4d256-prod-github-runner-207 kernel: [66836.603504] vcpu_run+0x62/0x2c0 [kvm] Aug 22 23:57:42 juju-e4d256-prod-github-runner-207 kernel: [66836.604342] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 23:57:42 juju-e4d256-prod-github-runner-207 kernel: [66836.605166] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 23:57:42 juju-e4d256-prod-github-runner-207 kernel: [66836.606081] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 23:57:42 juju-e4d256-prod-github-runner-207 kernel: [66836.606888] ? __seccomp_filter+0x4a/0x4a0 Aug 22 23:57:42 juju-e4d256-prod-github-runner-207 kernel: [66836.607634] ? __fget_files+0x86/0xc0 Aug 22 23:57:42 juju-e4d256-prod-github-runner-207 kernel: [66836.608346] __x64_sys_ioctl+0x95/0xd0 Aug 22 23:57:42 juju-e4d256-prod-github-runner-207 kernel: [66836.609048] do_syscall_64+0x5c/0xc0 Aug 22 23:57:42 juju-e4d256-prod-github-runner-207 kernel: [66836.609739] ? do_futex+0x162/0x1f0 Aug 22 23:57:42 juju-e4d256-prod-github-runner-207 kernel: [66836.610392] ? __x64_sys_futex+0x78/0x1e0 Aug 22 23:57:42 juju-e4d256-prod-github-runner-207 kernel: [66836.611070] ? __secure_computing+0xa9/0x120 Aug 22 23:57:42 juju-e4d256-prod-github-runner-207 kernel: [66836.611761] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 23:57:42 juju-e4d256-prod-github-runner-207 kernel: [66836.612546] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:57:42 juju-e4d256-prod-github-runner-207 kernel: [66836.613295] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:57:42 juju-e4d256-prod-github-runner-207 kernel: [66836.614049] ? do_syscall_64+0x69/0xc0 Aug 22 23:57:42 juju-e4d256-prod-github-runner-207 kernel: [66836.614696] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:57:42 juju-e4d256-prod-github-runner-207 kernel: [66836.615399] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:57:42 juju-e4d256-prod-github-runner-207 kernel: [66836.616112] ? do_syscall_64+0x69/0xc0 Aug 22 23:57:42 juju-e4d256-prod-github-runner-207 kernel: [66836.616743] ? do_syscall_64+0x69/0xc0 Aug 22 23:57:42 juju-e4d256-prod-github-runner-207 kernel: [66836.617367] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 23:57:42 juju-e4d256-prod-github-runner-207 kernel: [66836.618116] RIP: 0033:0x7faa5d0edaff Aug 22 23:57:42 juju-e4d256-prod-github-runner-207 kernel: [66836.618789] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 23:57:42 juju-e4d256-prod-github-runner-207 kernel: [66836.620792] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 23:57:42 juju-e4d256-prod-github-runner-207 kernel: [66836.621742] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 23:57:42 juju-e4d256-prod-github-runner-207 kernel: [66836.622635] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 23:57:42 juju-e4d256-prod-github-runner-207 kernel: [66836.623562] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 23:57:42 juju-e4d256-prod-github-runner-207 kernel: [66836.624462] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 23:57:42 juju-e4d256-prod-github-runner-207 kernel: [66836.625357] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 23:57:42 juju-e4d256-prod-github-runner-207 kernel: [66836.626286] Aug 22 23:58:10 juju-e4d256-prod-github-runner-207 kernel: [66864.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 62164s! [qemu-system-x86:6715] Aug 22 23:58:10 juju-e4d256-prod-github-runner-207 kernel: [66864.543109] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 23:58:10 juju-e4d256-prod-github-runner-207 kernel: [66864.543186] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 23:58:10 juju-e4d256-prod-github-runner-207 kernel: [66864.555482] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 23:58:10 juju-e4d256-prod-github-runner-207 kernel: [66864.556747] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 23:58:10 juju-e4d256-prod-github-runner-207 kernel: [66864.557982] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:58:10 juju-e4d256-prod-github-runner-207 kernel: [66864.559038] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 23:58:10 juju-e4d256-prod-github-runner-207 kernel: [66864.561601] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 23:58:10 juju-e4d256-prod-github-runner-207 kernel: [66864.562643] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 23:58:10 juju-e4d256-prod-github-runner-207 kernel: [66864.563805] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 23:58:10 juju-e4d256-prod-github-runner-207 kernel: [66864.564966] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 23:58:10 juju-e4d256-prod-github-runner-207 kernel: [66864.566136] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 23:58:10 juju-e4d256-prod-github-runner-207 kernel: [66864.567300] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 23:58:10 juju-e4d256-prod-github-runner-207 kernel: [66864.568497] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 23:58:10 juju-e4d256-prod-github-runner-207 kernel: [66864.569740] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 23:58:10 juju-e4d256-prod-github-runner-207 kernel: [66864.570860] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 23:58:10 juju-e4d256-prod-github-runner-207 kernel: [66864.572052] Call Trace: Aug 22 23:58:10 juju-e4d256-prod-github-runner-207 kernel: [66864.572963] Aug 22 23:58:10 juju-e4d256-prod-github-runner-207 kernel: [66864.573943] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:58:10 juju-e4d256-prod-github-runner-207 kernel: [66864.575591] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:58:10 juju-e4d256-prod-github-runner-207 kernel: [66864.576705] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:58:10 juju-e4d256-prod-github-runner-207 kernel: [66864.577904] ? show_regs.part.0+0x23/0x29 Aug 22 23:58:10 juju-e4d256-prod-github-runner-207 kernel: [66864.578996] ? show_regs.cold+0x8/0xd Aug 22 23:58:10 juju-e4d256-prod-github-runner-207 kernel: [66864.580037] ? watchdog_timer_fn+0x1be/0x220 Aug 22 23:58:10 juju-e4d256-prod-github-runner-207 kernel: [66864.581168] ? lockup_detector_update_enable+0x60/0x60 Aug 22 23:58:10 juju-e4d256-prod-github-runner-207 kernel: [66864.582351] ? __hrtimer_run_queues+0x107/0x230 Aug 22 23:58:10 juju-e4d256-prod-github-runner-207 kernel: [66864.583464] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 23:58:10 juju-e4d256-prod-github-runner-207 kernel: [66864.584571] ? hrtimer_interrupt+0x101/0x220 Aug 22 23:58:10 juju-e4d256-prod-github-runner-207 kernel: [66864.585687] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 23:58:10 juju-e4d256-prod-github-runner-207 kernel: [66864.586852] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 23:58:10 juju-e4d256-prod-github-runner-207 kernel: [66864.588015] Aug 22 23:58:10 juju-e4d256-prod-github-runner-207 kernel: [66864.588933] Aug 22 23:58:10 juju-e4d256-prod-github-runner-207 kernel: [66864.589850] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 23:58:10 juju-e4d256-prod-github-runner-207 kernel: [66864.590995] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:58:10 juju-e4d256-prod-github-runner-207 kernel: [66864.592133] ? _raw_spin_lock+0x22/0x30 Aug 22 23:58:10 juju-e4d256-prod-github-runner-207 kernel: [66864.593186] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:58:10 juju-e4d256-prod-github-runner-207 kernel: [66864.594303] direct_page_fault+0x206/0x310 [kvm] Aug 22 23:58:10 juju-e4d256-prod-github-runner-207 kernel: [66864.595432] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 23:58:10 juju-e4d256-prod-github-runner-207 kernel: [66864.596537] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 23:58:10 juju-e4d256-prod-github-runner-207 kernel: [66864.597643] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 23:58:10 juju-e4d256-prod-github-runner-207 kernel: [66864.598705] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 23:58:10 juju-e4d256-prod-github-runner-207 kernel: [66864.599756] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 23:58:10 juju-e4d256-prod-github-runner-207 kernel: [66864.600851] handle_exit+0x98/0x230 [kvm_amd] Aug 22 23:58:10 juju-e4d256-prod-github-runner-207 kernel: [66864.601841] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 23:58:10 juju-e4d256-prod-github-runner-207 kernel: [66864.602872] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 23:58:10 juju-e4d256-prod-github-runner-207 kernel: [66864.603898] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 23:58:10 juju-e4d256-prod-github-runner-207 kernel: [66864.604902] vcpu_run+0x62/0x2c0 [kvm] Aug 22 23:58:10 juju-e4d256-prod-github-runner-207 kernel: [66864.605803] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 23:58:10 juju-e4d256-prod-github-runner-207 kernel: [66864.606709] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 23:58:10 juju-e4d256-prod-github-runner-207 kernel: [66864.607676] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 23:58:10 juju-e4d256-prod-github-runner-207 kernel: [66864.608578] ? __seccomp_filter+0x4a/0x4a0 Aug 22 23:58:10 juju-e4d256-prod-github-runner-207 kernel: [66864.609421] ? __fget_files+0x86/0xc0 Aug 22 23:58:10 juju-e4d256-prod-github-runner-207 kernel: [66864.610201] __x64_sys_ioctl+0x95/0xd0 Aug 22 23:58:10 juju-e4d256-prod-github-runner-207 kernel: [66864.610990] do_syscall_64+0x5c/0xc0 Aug 22 23:58:10 juju-e4d256-prod-github-runner-207 kernel: [66864.611781] ? do_futex+0x162/0x1f0 Aug 22 23:58:10 juju-e4d256-prod-github-runner-207 kernel: [66864.612506] ? __x64_sys_futex+0x78/0x1e0 Aug 22 23:58:10 juju-e4d256-prod-github-runner-207 kernel: [66864.613275] ? __secure_computing+0xa9/0x120 Aug 22 23:58:10 juju-e4d256-prod-github-runner-207 kernel: [66864.614046] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 23:58:10 juju-e4d256-prod-github-runner-207 kernel: [66864.614907] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:58:10 juju-e4d256-prod-github-runner-207 kernel: [66864.615719] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:58:10 juju-e4d256-prod-github-runner-207 kernel: [66864.616531] ? do_syscall_64+0x69/0xc0 Aug 22 23:58:10 juju-e4d256-prod-github-runner-207 kernel: [66864.617290] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:58:10 juju-e4d256-prod-github-runner-207 kernel: [66864.618087] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:58:10 juju-e4d256-prod-github-runner-207 kernel: [66864.618875] ? do_syscall_64+0x69/0xc0 Aug 22 23:58:10 juju-e4d256-prod-github-runner-207 kernel: [66864.619576] ? do_syscall_64+0x69/0xc0 Aug 22 23:58:10 juju-e4d256-prod-github-runner-207 kernel: [66864.620279] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 23:58:10 juju-e4d256-prod-github-runner-207 kernel: [66864.621089] RIP: 0033:0x7faa5d0edaff Aug 22 23:58:10 juju-e4d256-prod-github-runner-207 kernel: [66864.621790] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 23:58:10 juju-e4d256-prod-github-runner-207 kernel: [66864.624113] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 23:58:10 juju-e4d256-prod-github-runner-207 kernel: [66864.625235] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 23:58:10 juju-e4d256-prod-github-runner-207 kernel: [66864.626334] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 23:58:10 juju-e4d256-prod-github-runner-207 kernel: [66864.627415] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 23:58:10 juju-e4d256-prod-github-runner-207 kernel: [66864.628348] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 23:58:10 juju-e4d256-prod-github-runner-207 kernel: [66864.629310] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 23:58:10 juju-e4d256-prod-github-runner-207 kernel: [66864.630212] Aug 22 23:58:38 juju-e4d256-prod-github-runner-207 kernel: [66892.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 62190s! [qemu-system-x86:6715] Aug 22 23:58:38 juju-e4d256-prod-github-runner-207 kernel: [66892.543108] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 23:58:38 juju-e4d256-prod-github-runner-207 kernel: [66892.543182] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 23:58:38 juju-e4d256-prod-github-runner-207 kernel: [66892.555347] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 23:58:38 juju-e4d256-prod-github-runner-207 kernel: [66892.556613] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 23:58:38 juju-e4d256-prod-github-runner-207 kernel: [66892.557859] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:58:38 juju-e4d256-prod-github-runner-207 kernel: [66892.558919] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 23:58:38 juju-e4d256-prod-github-runner-207 kernel: [66892.561476] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 23:58:38 juju-e4d256-prod-github-runner-207 kernel: [66892.562524] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 23:58:38 juju-e4d256-prod-github-runner-207 kernel: [66892.563685] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 23:58:38 juju-e4d256-prod-github-runner-207 kernel: [66892.564867] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 23:58:38 juju-e4d256-prod-github-runner-207 kernel: [66892.566030] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 23:58:38 juju-e4d256-prod-github-runner-207 kernel: [66892.567193] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 23:58:38 juju-e4d256-prod-github-runner-207 kernel: [66892.568359] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 23:58:38 juju-e4d256-prod-github-runner-207 kernel: [66892.569609] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 23:58:38 juju-e4d256-prod-github-runner-207 kernel: [66892.570708] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 23:58:38 juju-e4d256-prod-github-runner-207 kernel: [66892.571909] Call Trace: Aug 22 23:58:38 juju-e4d256-prod-github-runner-207 kernel: [66892.572834] Aug 22 23:58:38 juju-e4d256-prod-github-runner-207 kernel: [66892.573719] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:58:38 juju-e4d256-prod-github-runner-207 kernel: [66892.574761] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:58:38 juju-e4d256-prod-github-runner-207 kernel: [66892.575781] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:58:38 juju-e4d256-prod-github-runner-207 kernel: [66892.576876] ? show_regs.part.0+0x23/0x29 Aug 22 23:58:38 juju-e4d256-prod-github-runner-207 kernel: [66892.577904] ? show_regs.cold+0x8/0xd Aug 22 23:58:38 juju-e4d256-prod-github-runner-207 kernel: [66892.578874] ? watchdog_timer_fn+0x1be/0x220 Aug 22 23:58:38 juju-e4d256-prod-github-runner-207 kernel: [66892.579884] ? lockup_detector_update_enable+0x60/0x60 Aug 22 23:58:38 juju-e4d256-prod-github-runner-207 kernel: [66892.580962] ? __hrtimer_run_queues+0x107/0x230 Aug 22 23:58:38 juju-e4d256-prod-github-runner-207 kernel: [66892.581992] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 23:58:38 juju-e4d256-prod-github-runner-207 kernel: [66892.583014] ? hrtimer_interrupt+0x101/0x220 Aug 22 23:58:38 juju-e4d256-prod-github-runner-207 kernel: [66892.584027] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 23:58:38 juju-e4d256-prod-github-runner-207 kernel: [66892.585114] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 23:58:38 juju-e4d256-prod-github-runner-207 kernel: [66892.586170] Aug 22 23:58:38 juju-e4d256-prod-github-runner-207 kernel: [66892.587022] Aug 22 23:58:38 juju-e4d256-prod-github-runner-207 kernel: [66892.587870] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 23:58:38 juju-e4d256-prod-github-runner-207 kernel: [66892.588928] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:58:38 juju-e4d256-prod-github-runner-207 kernel: [66892.589967] ? _raw_spin_lock+0x22/0x30 Aug 22 23:58:38 juju-e4d256-prod-github-runner-207 kernel: [66892.590917] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:58:38 juju-e4d256-prod-github-runner-207 kernel: [66892.591940] direct_page_fault+0x206/0x310 [kvm] Aug 22 23:58:38 juju-e4d256-prod-github-runner-207 kernel: [66892.593180] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 23:58:38 juju-e4d256-prod-github-runner-207 kernel: [66892.594408] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 23:58:38 juju-e4d256-prod-github-runner-207 kernel: [66892.595500] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 23:58:38 juju-e4d256-prod-github-runner-207 kernel: [66892.596562] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 23:58:38 juju-e4d256-prod-github-runner-207 kernel: [66892.597645] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 23:58:38 juju-e4d256-prod-github-runner-207 kernel: [66892.598728] handle_exit+0x98/0x230 [kvm_amd] Aug 22 23:58:38 juju-e4d256-prod-github-runner-207 kernel: [66892.599718] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 23:58:38 juju-e4d256-prod-github-runner-207 kernel: [66892.600715] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 23:58:38 juju-e4d256-prod-github-runner-207 kernel: [66892.601764] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 23:58:38 juju-e4d256-prod-github-runner-207 kernel: [66892.602758] vcpu_run+0x62/0x2c0 [kvm] Aug 22 23:58:38 juju-e4d256-prod-github-runner-207 kernel: [66892.603640] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 23:58:38 juju-e4d256-prod-github-runner-207 kernel: [66892.604529] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 23:58:38 juju-e4d256-prod-github-runner-207 kernel: [66892.605497] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 23:58:38 juju-e4d256-prod-github-runner-207 kernel: [66892.606377] ? __seccomp_filter+0x4a/0x4a0 Aug 22 23:58:38 juju-e4d256-prod-github-runner-207 kernel: [66892.607197] ? __fget_files+0x86/0xc0 Aug 22 23:58:38 juju-e4d256-prod-github-runner-207 kernel: [66892.607966] __x64_sys_ioctl+0x95/0xd0 Aug 22 23:58:38 juju-e4d256-prod-github-runner-207 kernel: [66892.608731] do_syscall_64+0x5c/0xc0 Aug 22 23:58:38 juju-e4d256-prod-github-runner-207 kernel: [66892.609495] ? do_futex+0x162/0x1f0 Aug 22 23:58:38 juju-e4d256-prod-github-runner-207 kernel: [66892.610215] ? __x64_sys_futex+0x78/0x1e0 Aug 22 23:58:38 juju-e4d256-prod-github-runner-207 kernel: [66892.610961] ? __secure_computing+0xa9/0x120 Aug 22 23:58:38 juju-e4d256-prod-github-runner-207 kernel: [66892.611729] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 23:58:38 juju-e4d256-prod-github-runner-207 kernel: [66892.612593] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:58:38 juju-e4d256-prod-github-runner-207 kernel: [66892.613421] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:58:38 juju-e4d256-prod-github-runner-207 kernel: [66892.614234] ? do_syscall_64+0x69/0xc0 Aug 22 23:58:38 juju-e4d256-prod-github-runner-207 kernel: [66892.614951] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:58:38 juju-e4d256-prod-github-runner-207 kernel: [66892.615745] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:58:38 juju-e4d256-prod-github-runner-207 kernel: [66892.616534] ? do_syscall_64+0x69/0xc0 Aug 22 23:58:38 juju-e4d256-prod-github-runner-207 kernel: [66892.617258] ? do_syscall_64+0x69/0xc0 Aug 22 23:58:38 juju-e4d256-prod-github-runner-207 kernel: [66892.617953] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 23:58:38 juju-e4d256-prod-github-runner-207 kernel: [66892.618749] RIP: 0033:0x7faa5d0edaff Aug 22 23:58:38 juju-e4d256-prod-github-runner-207 kernel: [66892.619440] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 23:58:38 juju-e4d256-prod-github-runner-207 kernel: [66892.621771] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 23:58:38 juju-e4d256-prod-github-runner-207 kernel: [66892.622817] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 23:58:38 juju-e4d256-prod-github-runner-207 kernel: [66892.623837] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 23:58:38 juju-e4d256-prod-github-runner-207 kernel: [66892.624869] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 23:58:38 juju-e4d256-prod-github-runner-207 kernel: [66892.625886] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 23:58:38 juju-e4d256-prod-github-runner-207 kernel: [66892.626938] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 23:58:38 juju-e4d256-prod-github-runner-207 kernel: [66892.627958] Aug 22 23:59:06 juju-e4d256-prod-github-runner-207 kernel: [66920.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 62216s! [qemu-system-x86:6715] Aug 22 23:59:06 juju-e4d256-prod-github-runner-207 kernel: [66920.543913] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 23:59:06 juju-e4d256-prod-github-runner-207 kernel: [66920.544217] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 23:59:06 juju-e4d256-prod-github-runner-207 kernel: [66920.556499] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 23:59:06 juju-e4d256-prod-github-runner-207 kernel: [66920.557769] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 23:59:06 juju-e4d256-prod-github-runner-207 kernel: [66920.558987] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:59:06 juju-e4d256-prod-github-runner-207 kernel: [66920.560048] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 23:59:06 juju-e4d256-prod-github-runner-207 kernel: [66920.562599] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 23:59:06 juju-e4d256-prod-github-runner-207 kernel: [66920.563640] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 23:59:06 juju-e4d256-prod-github-runner-207 kernel: [66920.564815] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 23:59:06 juju-e4d256-prod-github-runner-207 kernel: [66920.566015] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 23:59:06 juju-e4d256-prod-github-runner-207 kernel: [66920.567187] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 23:59:06 juju-e4d256-prod-github-runner-207 kernel: [66920.568344] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 23:59:06 juju-e4d256-prod-github-runner-207 kernel: [66920.569559] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 23:59:06 juju-e4d256-prod-github-runner-207 kernel: [66920.570789] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 23:59:06 juju-e4d256-prod-github-runner-207 kernel: [66920.571889] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 23:59:06 juju-e4d256-prod-github-runner-207 kernel: [66920.573094] Call Trace: Aug 22 23:59:06 juju-e4d256-prod-github-runner-207 kernel: [66920.574013] Aug 22 23:59:06 juju-e4d256-prod-github-runner-207 kernel: [66920.574931] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:59:06 juju-e4d256-prod-github-runner-207 kernel: [66920.575989] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:59:06 juju-e4d256-prod-github-runner-207 kernel: [66920.577065] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:59:06 juju-e4d256-prod-github-runner-207 kernel: [66920.578165] ? show_regs.part.0+0x23/0x29 Aug 22 23:59:06 juju-e4d256-prod-github-runner-207 kernel: [66920.579161] ? show_regs.cold+0x8/0xd Aug 22 23:59:06 juju-e4d256-prod-github-runner-207 kernel: [66920.580136] ? watchdog_timer_fn+0x1be/0x220 Aug 22 23:59:06 juju-e4d256-prod-github-runner-207 kernel: [66920.581155] ? lockup_detector_update_enable+0x60/0x60 Aug 22 23:59:06 juju-e4d256-prod-github-runner-207 kernel: [66920.582217] ? __hrtimer_run_queues+0x107/0x230 Aug 22 23:59:06 juju-e4d256-prod-github-runner-207 kernel: [66920.583253] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 23:59:06 juju-e4d256-prod-github-runner-207 kernel: [66920.584314] ? hrtimer_interrupt+0x101/0x220 Aug 22 23:59:06 juju-e4d256-prod-github-runner-207 kernel: [66920.585356] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 23:59:06 juju-e4d256-prod-github-runner-207 kernel: [66920.586423] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 23:59:06 juju-e4d256-prod-github-runner-207 kernel: [66920.587466] Aug 22 23:59:06 juju-e4d256-prod-github-runner-207 kernel: [66920.588339] Aug 22 23:59:06 juju-e4d256-prod-github-runner-207 kernel: [66920.589205] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 23:59:06 juju-e4d256-prod-github-runner-207 kernel: [66920.590236] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:59:06 juju-e4d256-prod-github-runner-207 kernel: [66920.591273] ? _raw_spin_lock+0x22/0x30 Aug 22 23:59:06 juju-e4d256-prod-github-runner-207 kernel: [66920.592222] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:59:06 juju-e4d256-prod-github-runner-207 kernel: [66920.593282] direct_page_fault+0x206/0x310 [kvm] Aug 22 23:59:06 juju-e4d256-prod-github-runner-207 kernel: [66920.594393] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 23:59:06 juju-e4d256-prod-github-runner-207 kernel: [66920.595472] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 23:59:06 juju-e4d256-prod-github-runner-207 kernel: [66920.596564] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 23:59:06 juju-e4d256-prod-github-runner-207 kernel: [66920.597598] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 23:59:06 juju-e4d256-prod-github-runner-207 kernel: [66920.598549] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 23:59:06 juju-e4d256-prod-github-runner-207 kernel: [66920.599535] handle_exit+0x98/0x230 [kvm_amd] Aug 22 23:59:06 juju-e4d256-prod-github-runner-207 kernel: [66920.600428] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 23:59:06 juju-e4d256-prod-github-runner-207 kernel: [66920.601364] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 23:59:06 juju-e4d256-prod-github-runner-207 kernel: [66920.602294] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 23:59:06 juju-e4d256-prod-github-runner-207 kernel: [66920.603198] vcpu_run+0x62/0x2c0 [kvm] Aug 22 23:59:06 juju-e4d256-prod-github-runner-207 kernel: [66920.604009] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 23:59:06 juju-e4d256-prod-github-runner-207 kernel: [66920.604847] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 23:59:06 juju-e4d256-prod-github-runner-207 kernel: [66920.605710] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 23:59:06 juju-e4d256-prod-github-runner-207 kernel: [66920.606514] ? __seccomp_filter+0x4a/0x4a0 Aug 22 23:59:06 juju-e4d256-prod-github-runner-207 kernel: [66920.607268] ? __fget_files+0x86/0xc0 Aug 22 23:59:06 juju-e4d256-prod-github-runner-207 kernel: [66920.607977] __x64_sys_ioctl+0x95/0xd0 Aug 22 23:59:06 juju-e4d256-prod-github-runner-207 kernel: [66920.608682] do_syscall_64+0x5c/0xc0 Aug 22 23:59:06 juju-e4d256-prod-github-runner-207 kernel: [66920.609352] ? do_futex+0x162/0x1f0 Aug 22 23:59:06 juju-e4d256-prod-github-runner-207 kernel: [66920.610001] ? __x64_sys_futex+0x78/0x1e0 Aug 22 23:59:06 juju-e4d256-prod-github-runner-207 kernel: [66920.610683] ? __secure_computing+0xa9/0x120 Aug 22 23:59:06 juju-e4d256-prod-github-runner-207 kernel: [66920.611373] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 23:59:06 juju-e4d256-prod-github-runner-207 kernel: [66920.612144] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:59:06 juju-e4d256-prod-github-runner-207 kernel: [66920.612882] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:59:06 juju-e4d256-prod-github-runner-207 kernel: [66920.613603] ? do_syscall_64+0x69/0xc0 Aug 22 23:59:06 juju-e4d256-prod-github-runner-207 kernel: [66920.614275] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:59:06 juju-e4d256-prod-github-runner-207 kernel: [66920.614992] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:59:06 juju-e4d256-prod-github-runner-207 kernel: [66920.615688] ? do_syscall_64+0x69/0xc0 Aug 22 23:59:06 juju-e4d256-prod-github-runner-207 kernel: [66920.616312] ? do_syscall_64+0x69/0xc0 Aug 22 23:59:06 juju-e4d256-prod-github-runner-207 kernel: [66920.616942] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 23:59:06 juju-e4d256-prod-github-runner-207 kernel: [66920.617645] RIP: 0033:0x7faa5d0edaff Aug 22 23:59:06 juju-e4d256-prod-github-runner-207 kernel: [66920.618299] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 23:59:06 juju-e4d256-prod-github-runner-207 kernel: [66920.620282] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 23:59:06 juju-e4d256-prod-github-runner-207 kernel: [66920.621207] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 23:59:06 juju-e4d256-prod-github-runner-207 kernel: [66920.622102] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 23:59:06 juju-e4d256-prod-github-runner-207 kernel: [66920.622988] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 23:59:06 juju-e4d256-prod-github-runner-207 kernel: [66920.623875] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 23:59:06 juju-e4d256-prod-github-runner-207 kernel: [66920.624797] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 23:59:06 juju-e4d256-prod-github-runner-207 kernel: [66920.625694] Aug 22 23:59:34 juju-e4d256-prod-github-runner-207 kernel: [66948.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 62242s! [qemu-system-x86:6715] Aug 22 23:59:34 juju-e4d256-prod-github-runner-207 kernel: [66948.543136] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 22 23:59:34 juju-e4d256-prod-github-runner-207 kernel: [66948.543213] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 22 23:59:34 juju-e4d256-prod-github-runner-207 kernel: [66948.555620] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 23:59:34 juju-e4d256-prod-github-runner-207 kernel: [66948.556937] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 23:59:34 juju-e4d256-prod-github-runner-207 kernel: [66948.558200] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:59:34 juju-e4d256-prod-github-runner-207 kernel: [66948.559291] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 23:59:34 juju-e4d256-prod-github-runner-207 kernel: [66948.561930] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 23:59:34 juju-e4d256-prod-github-runner-207 kernel: [66948.562997] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 23:59:34 juju-e4d256-prod-github-runner-207 kernel: [66948.564206] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 23:59:34 juju-e4d256-prod-github-runner-207 kernel: [66948.565399] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 23:59:34 juju-e4d256-prod-github-runner-207 kernel: [66948.566588] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 23:59:34 juju-e4d256-prod-github-runner-207 kernel: [66948.567788] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 23:59:34 juju-e4d256-prod-github-runner-207 kernel: [66948.568994] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 22 23:59:34 juju-e4d256-prod-github-runner-207 kernel: [66948.570243] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 22 23:59:34 juju-e4d256-prod-github-runner-207 kernel: [66948.571356] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 22 23:59:34 juju-e4d256-prod-github-runner-207 kernel: [66948.572676] Call Trace: Aug 22 23:59:34 juju-e4d256-prod-github-runner-207 kernel: [66948.573940] Aug 22 23:59:34 juju-e4d256-prod-github-runner-207 kernel: [66948.574881] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:59:34 juju-e4d256-prod-github-runner-207 kernel: [66948.575937] ? show_trace_log_lvl+0x1d6/0x2ea Aug 22 23:59:34 juju-e4d256-prod-github-runner-207 kernel: [66948.576983] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:59:34 juju-e4d256-prod-github-runner-207 kernel: [66948.578076] ? show_regs.part.0+0x23/0x29 Aug 22 23:59:34 juju-e4d256-prod-github-runner-207 kernel: [66948.579088] ? show_regs.cold+0x8/0xd Aug 22 23:59:34 juju-e4d256-prod-github-runner-207 kernel: [66948.580073] ? watchdog_timer_fn+0x1be/0x220 Aug 22 23:59:34 juju-e4d256-prod-github-runner-207 kernel: [66948.581110] ? lockup_detector_update_enable+0x60/0x60 Aug 22 23:59:34 juju-e4d256-prod-github-runner-207 kernel: [66948.582198] ? __hrtimer_run_queues+0x107/0x230 Aug 22 23:59:34 juju-e4d256-prod-github-runner-207 kernel: [66948.583248] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 23:59:34 juju-e4d256-prod-github-runner-207 kernel: [66948.584299] ? hrtimer_interrupt+0x101/0x220 Aug 22 23:59:34 juju-e4d256-prod-github-runner-207 kernel: [66948.585330] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 23:59:34 juju-e4d256-prod-github-runner-207 kernel: [66948.586416] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 23:59:34 juju-e4d256-prod-github-runner-207 kernel: [66948.587616] Aug 22 23:59:34 juju-e4d256-prod-github-runner-207 kernel: [66948.588794] Aug 22 23:59:34 juju-e4d256-prod-github-runner-207 kernel: [66948.589960] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 23:59:34 juju-e4d256-prod-github-runner-207 kernel: [66948.591472] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:59:34 juju-e4d256-prod-github-runner-207 kernel: [66948.593050] ? _raw_spin_lock+0x22/0x30 Aug 22 23:59:34 juju-e4d256-prod-github-runner-207 kernel: [66948.594410] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:59:34 juju-e4d256-prod-github-runner-207 kernel: [66948.595910] direct_page_fault+0x206/0x310 [kvm] Aug 22 23:59:34 juju-e4d256-prod-github-runner-207 kernel: [66948.597367] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 23:59:34 juju-e4d256-prod-github-runner-207 kernel: [66948.598812] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 23:59:34 juju-e4d256-prod-github-runner-207 kernel: [66948.600229] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 23:59:34 juju-e4d256-prod-github-runner-207 kernel: [66948.601220] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 23:59:34 juju-e4d256-prod-github-runner-207 kernel: [66948.602180] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 23:59:34 juju-e4d256-prod-github-runner-207 kernel: [66948.603180] handle_exit+0x98/0x230 [kvm_amd] Aug 22 23:59:34 juju-e4d256-prod-github-runner-207 kernel: [66948.604089] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 23:59:34 juju-e4d256-prod-github-runner-207 kernel: [66948.605033] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 23:59:34 juju-e4d256-prod-github-runner-207 kernel: [66948.605972] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 23:59:34 juju-e4d256-prod-github-runner-207 kernel: [66948.606893] vcpu_run+0x62/0x2c0 [kvm] Aug 22 23:59:34 juju-e4d256-prod-github-runner-207 kernel: [66948.607712] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 23:59:34 juju-e4d256-prod-github-runner-207 kernel: [66948.608549] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 23:59:34 juju-e4d256-prod-github-runner-207 kernel: [66948.609421] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 23:59:34 juju-e4d256-prod-github-runner-207 kernel: [66948.610236] ? __seccomp_filter+0x4a/0x4a0 Aug 22 23:59:34 juju-e4d256-prod-github-runner-207 kernel: [66948.610995] ? __fget_files+0x86/0xc0 Aug 22 23:59:34 juju-e4d256-prod-github-runner-207 kernel: [66948.611709] __x64_sys_ioctl+0x95/0xd0 Aug 22 23:59:34 juju-e4d256-prod-github-runner-207 kernel: [66948.612439] do_syscall_64+0x5c/0xc0 Aug 22 23:59:34 juju-e4d256-prod-github-runner-207 kernel: [66948.613117] ? do_futex+0x162/0x1f0 Aug 22 23:59:34 juju-e4d256-prod-github-runner-207 kernel: [66948.613775] ? __x64_sys_futex+0x78/0x1e0 Aug 22 23:59:34 juju-e4d256-prod-github-runner-207 kernel: [66948.614461] ? __secure_computing+0xa9/0x120 Aug 22 23:59:34 juju-e4d256-prod-github-runner-207 kernel: [66948.615164] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 23:59:34 juju-e4d256-prod-github-runner-207 kernel: [66948.615937] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:59:34 juju-e4d256-prod-github-runner-207 kernel: [66948.616684] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:59:34 juju-e4d256-prod-github-runner-207 kernel: [66948.617419] ? do_syscall_64+0x69/0xc0 Aug 22 23:59:34 juju-e4d256-prod-github-runner-207 kernel: [66948.618076] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:59:34 juju-e4d256-prod-github-runner-207 kernel: [66948.618793] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:59:34 juju-e4d256-prod-github-runner-207 kernel: [66948.619503] ? do_syscall_64+0x69/0xc0 Aug 22 23:59:34 juju-e4d256-prod-github-runner-207 kernel: [66948.620158] ? do_syscall_64+0x69/0xc0 Aug 22 23:59:34 juju-e4d256-prod-github-runner-207 kernel: [66948.620791] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 23:59:34 juju-e4d256-prod-github-runner-207 kernel: [66948.621663] RIP: 0033:0x7faa5d0edaff Aug 22 23:59:34 juju-e4d256-prod-github-runner-207 kernel: [66948.622353] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 23:59:34 juju-e4d256-prod-github-runner-207 kernel: [66948.624424] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 23:59:34 juju-e4d256-prod-github-runner-207 kernel: [66948.625369] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 23:59:34 juju-e4d256-prod-github-runner-207 kernel: [66948.626288] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 23:59:34 juju-e4d256-prod-github-runner-207 kernel: [66948.627202] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 23:59:34 juju-e4d256-prod-github-runner-207 kernel: [66948.628114] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 23:59:34 juju-e4d256-prod-github-runner-207 kernel: [66948.629055] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 23:59:34 juju-e4d256-prod-github-runner-207 kernel: [66948.629988] Aug 22 23:59:47 juju-e4d256-prod-github-runner-207 kernel: [66961.652706] rcu: INFO: rcu_sched self-detected stall on CPU Aug 22 23:59:47 juju-e4d256-prod-github-runner-207 kernel: [66961.653688] rcu: 1-....: (16658428 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=8042550 Aug 22 23:59:47 juju-e4d256-prod-github-runner-207 kernel: [66961.654825] (t=16711113 jiffies g=23269 q=58406) Aug 22 23:59:47 juju-e4d256-prod-github-runner-207 kernel: [66961.655634] NMI backtrace for cpu 1 Aug 22 23:59:47 juju-e4d256-prod-github-runner-207 kernel: [66961.656357] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 22 23:59:47 juju-e4d256-prod-github-runner-207 kernel: [66961.657470] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 22 23:59:47 juju-e4d256-prod-github-runner-207 kernel: [66961.658626] Call Trace: Aug 22 23:59:47 juju-e4d256-prod-github-runner-207 kernel: [66961.659316] Aug 22 23:59:47 juju-e4d256-prod-github-runner-207 kernel: [66961.660003] show_stack+0x52/0x5c Aug 22 23:59:47 juju-e4d256-prod-github-runner-207 kernel: [66961.660741] dump_stack_lvl+0x4a/0x63 Aug 22 23:59:47 juju-e4d256-prod-github-runner-207 kernel: [66961.661513] dump_stack+0x10/0x16 Aug 22 23:59:47 juju-e4d256-prod-github-runner-207 kernel: [66961.662233] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 22 23:59:47 juju-e4d256-prod-github-runner-207 kernel: [66961.663024] ? lapic_can_unplug_cpu+0x90/0x90 Aug 22 23:59:47 juju-e4d256-prod-github-runner-207 kernel: [66961.663812] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 22 23:59:47 juju-e4d256-prod-github-runner-207 kernel: [66961.664672] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 22 23:59:47 juju-e4d256-prod-github-runner-207 kernel: [66961.665540] trigger_single_cpu_backtrace+0x44/0x4f Aug 22 23:59:47 juju-e4d256-prod-github-runner-207 kernel: [66961.666354] rcu_dump_cpu_stacks+0x102/0x149 Aug 22 23:59:47 juju-e4d256-prod-github-runner-207 kernel: [66961.667133] print_cpu_stall.cold+0x2f/0xe2 Aug 22 23:59:47 juju-e4d256-prod-github-runner-207 kernel: [66961.667903] ? timekeeping_update+0xf7/0x150 Aug 22 23:59:47 juju-e4d256-prod-github-runner-207 kernel: [66961.668705] check_cpu_stall+0x109/0x270 Aug 22 23:59:47 juju-e4d256-prod-github-runner-207 kernel: [66961.669475] rcu_sched_clock_irq+0x9a/0x250 Aug 22 23:59:47 juju-e4d256-prod-github-runner-207 kernel: [66961.670237] update_process_times+0x94/0xd0 Aug 22 23:59:47 juju-e4d256-prod-github-runner-207 kernel: [66961.671020] tick_sched_handle+0x29/0x70 Aug 22 23:59:47 juju-e4d256-prod-github-runner-207 kernel: [66961.671794] tick_sched_timer+0x8c/0xc0 Aug 22 23:59:47 juju-e4d256-prod-github-runner-207 kernel: [66961.672545] ? tick_nohz_handler+0xb0/0xb0 Aug 22 23:59:47 juju-e4d256-prod-github-runner-207 kernel: [66961.673324] __hrtimer_run_queues+0x107/0x230 Aug 22 23:59:47 juju-e4d256-prod-github-runner-207 kernel: [66961.674106] ? kvm_clock_get_cycles+0x11/0x20 Aug 22 23:59:47 juju-e4d256-prod-github-runner-207 kernel: [66961.674884] hrtimer_interrupt+0x101/0x220 Aug 22 23:59:47 juju-e4d256-prod-github-runner-207 kernel: [66961.675675] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 22 23:59:47 juju-e4d256-prod-github-runner-207 kernel: [66961.676584] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 22 23:59:47 juju-e4d256-prod-github-runner-207 kernel: [66961.677428] Aug 22 23:59:47 juju-e4d256-prod-github-runner-207 kernel: [66961.678068] Aug 22 23:59:47 juju-e4d256-prod-github-runner-207 kernel: [66961.678699] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 22 23:59:47 juju-e4d256-prod-github-runner-207 kernel: [66961.679631] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 22 23:59:47 juju-e4d256-prod-github-runner-207 kernel: [66961.680527] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 22 23:59:47 juju-e4d256-prod-github-runner-207 kernel: [66961.682751] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 22 23:59:47 juju-e4d256-prod-github-runner-207 kernel: [66961.683637] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 22 23:59:47 juju-e4d256-prod-github-runner-207 kernel: [66961.684670] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 22 23:59:47 juju-e4d256-prod-github-runner-207 kernel: [66961.685664] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 22 23:59:47 juju-e4d256-prod-github-runner-207 kernel: [66961.686632] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 22 23:59:47 juju-e4d256-prod-github-runner-207 kernel: [66961.687678] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 22 23:59:47 juju-e4d256-prod-github-runner-207 kernel: [66961.688654] ? _raw_spin_lock+0x22/0x30 Aug 22 23:59:47 juju-e4d256-prod-github-runner-207 kernel: [66961.689461] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 22 23:59:47 juju-e4d256-prod-github-runner-207 kernel: [66961.690431] direct_page_fault+0x206/0x310 [kvm] Aug 22 23:59:47 juju-e4d256-prod-github-runner-207 kernel: [66961.691294] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 22 23:59:47 juju-e4d256-prod-github-runner-207 kernel: [66961.692139] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 22 23:59:47 juju-e4d256-prod-github-runner-207 kernel: [66961.692968] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 22 23:59:47 juju-e4d256-prod-github-runner-207 kernel: [66961.693773] npf_interception+0x47/0xa0 [kvm_amd] Aug 22 23:59:47 juju-e4d256-prod-github-runner-207 kernel: [66961.694562] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 22 23:59:47 juju-e4d256-prod-github-runner-207 kernel: [66961.695383] handle_exit+0x98/0x230 [kvm_amd] Aug 22 23:59:47 juju-e4d256-prod-github-runner-207 kernel: [66961.696156] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 22 23:59:47 juju-e4d256-prod-github-runner-207 kernel: [66961.696946] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 22 23:59:47 juju-e4d256-prod-github-runner-207 kernel: [66961.697742] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 22 23:59:47 juju-e4d256-prod-github-runner-207 kernel: [66961.698539] vcpu_run+0x62/0x2c0 [kvm] Aug 22 23:59:47 juju-e4d256-prod-github-runner-207 kernel: [66961.699279] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 22 23:59:47 juju-e4d256-prod-github-runner-207 kernel: [66961.700027] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 22 23:59:47 juju-e4d256-prod-github-runner-207 kernel: [66961.700837] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 22 23:59:47 juju-e4d256-prod-github-runner-207 kernel: [66961.701606] ? __seccomp_filter+0x4a/0x4a0 Aug 22 23:59:47 juju-e4d256-prod-github-runner-207 kernel: [66961.702349] ? __fget_files+0x86/0xc0 Aug 22 23:59:47 juju-e4d256-prod-github-runner-207 kernel: [66961.703053] __x64_sys_ioctl+0x95/0xd0 Aug 22 23:59:47 juju-e4d256-prod-github-runner-207 kernel: [66961.703770] do_syscall_64+0x5c/0xc0 Aug 22 23:59:47 juju-e4d256-prod-github-runner-207 kernel: [66961.704506] ? do_futex+0x162/0x1f0 Aug 22 23:59:47 juju-e4d256-prod-github-runner-207 kernel: [66961.705190] ? __x64_sys_futex+0x78/0x1e0 Aug 22 23:59:47 juju-e4d256-prod-github-runner-207 kernel: [66961.705895] ? __secure_computing+0xa9/0x120 Aug 22 23:59:47 juju-e4d256-prod-github-runner-207 kernel: [66961.706637] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 22 23:59:47 juju-e4d256-prod-github-runner-207 kernel: [66961.707436] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:59:47 juju-e4d256-prod-github-runner-207 kernel: [66961.708217] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:59:47 juju-e4d256-prod-github-runner-207 kernel: [66961.708979] ? do_syscall_64+0x69/0xc0 Aug 22 23:59:47 juju-e4d256-prod-github-runner-207 kernel: [66961.709676] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 22 23:59:47 juju-e4d256-prod-github-runner-207 kernel: [66961.710456] ? syscall_exit_to_user_mode+0x27/0x50 Aug 22 23:59:47 juju-e4d256-prod-github-runner-207 kernel: [66961.711228] ? do_syscall_64+0x69/0xc0 Aug 22 23:59:47 juju-e4d256-prod-github-runner-207 kernel: [66961.711925] ? do_syscall_64+0x69/0xc0 Aug 22 23:59:47 juju-e4d256-prod-github-runner-207 kernel: [66961.712638] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 22 23:59:47 juju-e4d256-prod-github-runner-207 kernel: [66961.713444] RIP: 0033:0x7faa5d0edaff Aug 22 23:59:47 juju-e4d256-prod-github-runner-207 kernel: [66961.714140] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 22 23:59:47 juju-e4d256-prod-github-runner-207 kernel: [66961.716267] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 22 23:59:47 juju-e4d256-prod-github-runner-207 kernel: [66961.717254] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 22 23:59:47 juju-e4d256-prod-github-runner-207 kernel: [66961.718204] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 22 23:59:47 juju-e4d256-prod-github-runner-207 kernel: [66961.719145] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 22 23:59:47 juju-e4d256-prod-github-runner-207 kernel: [66961.720108] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 22 23:59:47 juju-e4d256-prod-github-runner-207 kernel: [66961.721043] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 22 23:59:47 juju-e4d256-prod-github-runner-207 kernel: [66961.722109] Aug 23 00:00:14 juju-e4d256-prod-github-runner-207 kernel: [66988.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 62279s! [qemu-system-x86:6715] Aug 23 00:00:14 juju-e4d256-prod-github-runner-207 kernel: [66988.543290] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 00:00:14 juju-e4d256-prod-github-runner-207 kernel: [66988.543362] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 00:00:14 juju-e4d256-prod-github-runner-207 kernel: [66988.557438] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 00:00:14 juju-e4d256-prod-github-runner-207 kernel: [66988.558877] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 00:00:14 juju-e4d256-prod-github-runner-207 kernel: [66988.560290] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:00:14 juju-e4d256-prod-github-runner-207 kernel: [66988.561619] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 00:00:14 juju-e4d256-prod-github-runner-207 kernel: [66988.564264] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 00:00:14 juju-e4d256-prod-github-runner-207 kernel: [66988.565308] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 00:00:14 juju-e4d256-prod-github-runner-207 kernel: [66988.566531] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 00:00:14 juju-e4d256-prod-github-runner-207 kernel: [66988.567944] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 00:00:14 juju-e4d256-prod-github-runner-207 kernel: [66988.569234] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 00:00:14 juju-e4d256-prod-github-runner-207 kernel: [66988.570533] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 00:00:14 juju-e4d256-prod-github-runner-207 kernel: [66988.571850] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 00:00:14 juju-e4d256-prod-github-runner-207 kernel: [66988.573236] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 00:00:14 juju-e4d256-prod-github-runner-207 kernel: [66988.574483] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 00:00:14 juju-e4d256-prod-github-runner-207 kernel: [66988.575866] Call Trace: Aug 23 00:00:14 juju-e4d256-prod-github-runner-207 kernel: [66988.576845] Aug 23 00:00:14 juju-e4d256-prod-github-runner-207 kernel: [66988.577782] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:00:14 juju-e4d256-prod-github-runner-207 kernel: [66988.578905] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:00:14 juju-e4d256-prod-github-runner-207 kernel: [66988.580044] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:00:14 juju-e4d256-prod-github-runner-207 kernel: [66988.581211] ? show_regs.part.0+0x23/0x29 Aug 23 00:00:14 juju-e4d256-prod-github-runner-207 kernel: [66988.582297] ? show_regs.cold+0x8/0xd Aug 23 00:00:14 juju-e4d256-prod-github-runner-207 kernel: [66988.583390] ? watchdog_timer_fn+0x1be/0x220 Aug 23 00:00:14 juju-e4d256-prod-github-runner-207 kernel: [66988.584519] ? lockup_detector_update_enable+0x60/0x60 Aug 23 00:00:14 juju-e4d256-prod-github-runner-207 kernel: [66988.585709] ? __hrtimer_run_queues+0x107/0x230 Aug 23 00:00:14 juju-e4d256-prod-github-runner-207 kernel: [66988.586908] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 00:00:14 juju-e4d256-prod-github-runner-207 kernel: [66988.587970] ? hrtimer_interrupt+0x101/0x220 Aug 23 00:00:14 juju-e4d256-prod-github-runner-207 kernel: [66988.588992] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 00:00:14 juju-e4d256-prod-github-runner-207 kernel: [66988.590148] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 00:00:14 juju-e4d256-prod-github-runner-207 kernel: [66988.591203] Aug 23 00:00:14 juju-e4d256-prod-github-runner-207 kernel: [66988.592108] Aug 23 00:00:14 juju-e4d256-prod-github-runner-207 kernel: [66988.592954] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 00:00:14 juju-e4d256-prod-github-runner-207 kernel: [66988.593989] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:00:14 juju-e4d256-prod-github-runner-207 kernel: [66988.595043] ? _raw_spin_lock+0x22/0x30 Aug 23 00:00:14 juju-e4d256-prod-github-runner-207 kernel: [66988.596226] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:00:14 juju-e4d256-prod-github-runner-207 kernel: [66988.597402] direct_page_fault+0x206/0x310 [kvm] Aug 23 00:00:14 juju-e4d256-prod-github-runner-207 kernel: [66988.598435] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 00:00:14 juju-e4d256-prod-github-runner-207 kernel: [66988.599458] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 00:00:14 juju-e4d256-prod-github-runner-207 kernel: [66988.600484] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 00:00:14 juju-e4d256-prod-github-runner-207 kernel: [66988.601514] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 00:00:14 juju-e4d256-prod-github-runner-207 kernel: [66988.602469] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 00:00:14 juju-e4d256-prod-github-runner-207 kernel: [66988.603454] handle_exit+0x98/0x230 [kvm_amd] Aug 23 00:00:14 juju-e4d256-prod-github-runner-207 kernel: [66988.604364] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 00:00:14 juju-e4d256-prod-github-runner-207 kernel: [66988.605383] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 00:00:14 juju-e4d256-prod-github-runner-207 kernel: [66988.606320] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 00:00:14 juju-e4d256-prod-github-runner-207 kernel: [66988.607245] vcpu_run+0x62/0x2c0 [kvm] Aug 23 00:00:14 juju-e4d256-prod-github-runner-207 kernel: [66988.608109] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 00:00:14 juju-e4d256-prod-github-runner-207 kernel: [66988.608922] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 00:00:14 juju-e4d256-prod-github-runner-207 kernel: [66988.609780] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 00:00:14 juju-e4d256-prod-github-runner-207 kernel: [66988.610579] ? __seccomp_filter+0x4a/0x4a0 Aug 23 00:00:14 juju-e4d256-prod-github-runner-207 kernel: [66988.611322] ? __fget_files+0x86/0xc0 Aug 23 00:00:14 juju-e4d256-prod-github-runner-207 kernel: [66988.612043] __x64_sys_ioctl+0x95/0xd0 Aug 23 00:00:14 juju-e4d256-prod-github-runner-207 kernel: [66988.612738] do_syscall_64+0x5c/0xc0 Aug 23 00:00:14 juju-e4d256-prod-github-runner-207 kernel: [66988.613408] ? do_futex+0x162/0x1f0 Aug 23 00:00:14 juju-e4d256-prod-github-runner-207 kernel: [66988.614057] ? __x64_sys_futex+0x78/0x1e0 Aug 23 00:00:14 juju-e4d256-prod-github-runner-207 kernel: [66988.614734] ? __secure_computing+0xa9/0x120 Aug 23 00:00:14 juju-e4d256-prod-github-runner-207 kernel: [66988.615430] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 00:00:14 juju-e4d256-prod-github-runner-207 kernel: [66988.616206] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:00:14 juju-e4d256-prod-github-runner-207 kernel: [66988.616961] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:00:14 juju-e4d256-prod-github-runner-207 kernel: [66988.617694] ? do_syscall_64+0x69/0xc0 Aug 23 00:00:14 juju-e4d256-prod-github-runner-207 kernel: [66988.618352] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:00:14 juju-e4d256-prod-github-runner-207 kernel: [66988.619058] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:00:14 juju-e4d256-prod-github-runner-207 kernel: [66988.619806] ? do_syscall_64+0x69/0xc0 Aug 23 00:00:14 juju-e4d256-prod-github-runner-207 kernel: [66988.620443] ? do_syscall_64+0x69/0xc0 Aug 23 00:00:14 juju-e4d256-prod-github-runner-207 kernel: [66988.621074] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 00:00:14 juju-e4d256-prod-github-runner-207 kernel: [66988.621782] RIP: 0033:0x7faa5d0edaff Aug 23 00:00:14 juju-e4d256-prod-github-runner-207 kernel: [66988.622409] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 00:00:14 juju-e4d256-prod-github-runner-207 kernel: [66988.624420] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 00:00:14 juju-e4d256-prod-github-runner-207 kernel: [66988.625342] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 00:00:14 juju-e4d256-prod-github-runner-207 kernel: [66988.626260] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 00:00:14 juju-e4d256-prod-github-runner-207 kernel: [66988.627151] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 00:00:14 juju-e4d256-prod-github-runner-207 kernel: [66988.628091] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 00:00:14 juju-e4d256-prod-github-runner-207 kernel: [66988.629006] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 00:00:14 juju-e4d256-prod-github-runner-207 kernel: [66988.629908] Aug 23 00:00:42 juju-e4d256-prod-github-runner-207 kernel: [67016.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 62306s! [qemu-system-x86:6715] Aug 23 00:00:42 juju-e4d256-prod-github-runner-207 kernel: [67016.543886] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 00:00:42 juju-e4d256-prod-github-runner-207 kernel: [67016.544187] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 00:00:42 juju-e4d256-prod-github-runner-207 kernel: [67016.556767] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 00:00:42 juju-e4d256-prod-github-runner-207 kernel: [67016.558050] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 00:00:42 juju-e4d256-prod-github-runner-207 kernel: [67016.559333] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:00:42 juju-e4d256-prod-github-runner-207 kernel: [67016.560474] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 00:00:42 juju-e4d256-prod-github-runner-207 kernel: [67016.563075] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 00:00:42 juju-e4d256-prod-github-runner-207 kernel: [67016.564149] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 00:00:42 juju-e4d256-prod-github-runner-207 kernel: [67016.565381] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 00:00:42 juju-e4d256-prod-github-runner-207 kernel: [67016.566608] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 00:00:42 juju-e4d256-prod-github-runner-207 kernel: [67016.567801] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 00:00:42 juju-e4d256-prod-github-runner-207 kernel: [67016.568982] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 00:00:42 juju-e4d256-prod-github-runner-207 kernel: [67016.570212] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 00:00:42 juju-e4d256-prod-github-runner-207 kernel: [67016.571513] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 00:00:42 juju-e4d256-prod-github-runner-207 kernel: [67016.572650] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 00:00:42 juju-e4d256-prod-github-runner-207 kernel: [67016.573866] Call Trace: Aug 23 00:00:42 juju-e4d256-prod-github-runner-207 kernel: [67016.574797] Aug 23 00:00:42 juju-e4d256-prod-github-runner-207 kernel: [67016.575811] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:00:42 juju-e4d256-prod-github-runner-207 kernel: [67016.576953] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:00:42 juju-e4d256-prod-github-runner-207 kernel: [67016.578028] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:00:42 juju-e4d256-prod-github-runner-207 kernel: [67016.579198] ? show_regs.part.0+0x23/0x29 Aug 23 00:00:42 juju-e4d256-prod-github-runner-207 kernel: [67016.580250] ? show_regs.cold+0x8/0xd Aug 23 00:00:42 juju-e4d256-prod-github-runner-207 kernel: [67016.581286] ? watchdog_timer_fn+0x1be/0x220 Aug 23 00:00:42 juju-e4d256-prod-github-runner-207 kernel: [67016.582321] ? lockup_detector_update_enable+0x60/0x60 Aug 23 00:00:42 juju-e4d256-prod-github-runner-207 kernel: [67016.583423] ? __hrtimer_run_queues+0x107/0x230 Aug 23 00:00:42 juju-e4d256-prod-github-runner-207 kernel: [67016.584473] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 00:00:42 juju-e4d256-prod-github-runner-207 kernel: [67016.585898] ? hrtimer_interrupt+0x101/0x220 Aug 23 00:00:42 juju-e4d256-prod-github-runner-207 kernel: [67016.587025] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 00:00:42 juju-e4d256-prod-github-runner-207 kernel: [67016.588161] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 00:00:42 juju-e4d256-prod-github-runner-207 kernel: [67016.589220] Aug 23 00:00:42 juju-e4d256-prod-github-runner-207 kernel: [67016.590081] Aug 23 00:00:42 juju-e4d256-prod-github-runner-207 kernel: [67016.590948] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 00:00:42 juju-e4d256-prod-github-runner-207 kernel: [67016.592119] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:00:42 juju-e4d256-prod-github-runner-207 kernel: [67016.593187] ? _raw_spin_lock+0x22/0x30 Aug 23 00:00:42 juju-e4d256-prod-github-runner-207 kernel: [67016.594154] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:00:42 juju-e4d256-prod-github-runner-207 kernel: [67016.595232] direct_page_fault+0x206/0x310 [kvm] Aug 23 00:00:42 juju-e4d256-prod-github-runner-207 kernel: [67016.596316] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 00:00:42 juju-e4d256-prod-github-runner-207 kernel: [67016.597403] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 00:00:42 juju-e4d256-prod-github-runner-207 kernel: [67016.598424] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 00:00:42 juju-e4d256-prod-github-runner-207 kernel: [67016.599476] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 00:00:42 juju-e4d256-prod-github-runner-207 kernel: [67016.600439] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 00:00:42 juju-e4d256-prod-github-runner-207 kernel: [67016.601456] handle_exit+0x98/0x230 [kvm_amd] Aug 23 00:00:42 juju-e4d256-prod-github-runner-207 kernel: [67016.602383] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 00:00:42 juju-e4d256-prod-github-runner-207 kernel: [67016.603319] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 00:00:42 juju-e4d256-prod-github-runner-207 kernel: [67016.604281] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 00:00:42 juju-e4d256-prod-github-runner-207 kernel: [67016.605233] vcpu_run+0x62/0x2c0 [kvm] Aug 23 00:00:42 juju-e4d256-prod-github-runner-207 kernel: [67016.606068] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 00:00:42 juju-e4d256-prod-github-runner-207 kernel: [67016.606908] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 00:00:42 juju-e4d256-prod-github-runner-207 kernel: [67016.607797] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 00:00:42 juju-e4d256-prod-github-runner-207 kernel: [67016.608659] ? __seccomp_filter+0x4a/0x4a0 Aug 23 00:00:42 juju-e4d256-prod-github-runner-207 kernel: [67016.609424] ? __fget_files+0x86/0xc0 Aug 23 00:00:42 juju-e4d256-prod-github-runner-207 kernel: [67016.610139] __x64_sys_ioctl+0x95/0xd0 Aug 23 00:00:42 juju-e4d256-prod-github-runner-207 kernel: [67016.610877] do_syscall_64+0x5c/0xc0 Aug 23 00:00:42 juju-e4d256-prod-github-runner-207 kernel: [67016.611579] ? do_futex+0x162/0x1f0 Aug 23 00:00:42 juju-e4d256-prod-github-runner-207 kernel: [67016.612276] ? __x64_sys_futex+0x78/0x1e0 Aug 23 00:00:42 juju-e4d256-prod-github-runner-207 kernel: [67016.612969] ? __secure_computing+0xa9/0x120 Aug 23 00:00:42 juju-e4d256-prod-github-runner-207 kernel: [67016.613672] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 00:00:42 juju-e4d256-prod-github-runner-207 kernel: [67016.614447] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:00:42 juju-e4d256-prod-github-runner-207 kernel: [67016.615183] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:00:42 juju-e4d256-prod-github-runner-207 kernel: [67016.615935] ? do_syscall_64+0x69/0xc0 Aug 23 00:00:42 juju-e4d256-prod-github-runner-207 kernel: [67016.616600] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:00:42 juju-e4d256-prod-github-runner-207 kernel: [67016.617364] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:00:42 juju-e4d256-prod-github-runner-207 kernel: [67016.618088] ? do_syscall_64+0x69/0xc0 Aug 23 00:00:42 juju-e4d256-prod-github-runner-207 kernel: [67016.618731] ? do_syscall_64+0x69/0xc0 Aug 23 00:00:42 juju-e4d256-prod-github-runner-207 kernel: [67016.619386] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 00:00:42 juju-e4d256-prod-github-runner-207 kernel: [67016.620106] RIP: 0033:0x7faa5d0edaff Aug 23 00:00:42 juju-e4d256-prod-github-runner-207 kernel: [67016.620863] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 00:00:42 juju-e4d256-prod-github-runner-207 kernel: [67016.623022] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 00:00:42 juju-e4d256-prod-github-runner-207 kernel: [67016.623977] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 00:00:42 juju-e4d256-prod-github-runner-207 kernel: [67016.624888] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 00:00:42 juju-e4d256-prod-github-runner-207 kernel: [67016.625790] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 00:00:42 juju-e4d256-prod-github-runner-207 kernel: [67016.626714] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 00:00:42 juju-e4d256-prod-github-runner-207 kernel: [67016.627676] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 00:00:42 juju-e4d256-prod-github-runner-207 kernel: [67016.628599] Aug 23 00:01:10 juju-e4d256-prod-github-runner-207 kernel: [67044.541981] watchdog: BUG: soft lockup - CPU#1 stuck for 62332s! [qemu-system-x86:6715] Aug 23 00:01:10 juju-e4d256-prod-github-runner-207 kernel: [67044.543556] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 00:01:10 juju-e4d256-prod-github-runner-207 kernel: [67044.543633] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 00:01:10 juju-e4d256-prod-github-runner-207 kernel: [67044.555766] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 00:01:10 juju-e4d256-prod-github-runner-207 kernel: [67044.557026] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 00:01:10 juju-e4d256-prod-github-runner-207 kernel: [67044.558239] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:01:10 juju-e4d256-prod-github-runner-207 kernel: [67044.559303] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 00:01:10 juju-e4d256-prod-github-runner-207 kernel: [67044.561866] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 00:01:10 juju-e4d256-prod-github-runner-207 kernel: [67044.562920] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 00:01:10 juju-e4d256-prod-github-runner-207 kernel: [67044.564154] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 00:01:10 juju-e4d256-prod-github-runner-207 kernel: [67044.565418] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 00:01:10 juju-e4d256-prod-github-runner-207 kernel: [67044.566597] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 00:01:10 juju-e4d256-prod-github-runner-207 kernel: [67044.567790] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 00:01:10 juju-e4d256-prod-github-runner-207 kernel: [67044.568958] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 00:01:10 juju-e4d256-prod-github-runner-207 kernel: [67044.570187] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 00:01:10 juju-e4d256-prod-github-runner-207 kernel: [67044.571368] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 00:01:10 juju-e4d256-prod-github-runner-207 kernel: [67044.572647] Call Trace: Aug 23 00:01:10 juju-e4d256-prod-github-runner-207 kernel: [67044.573575] Aug 23 00:01:10 juju-e4d256-prod-github-runner-207 kernel: [67044.574459] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:01:10 juju-e4d256-prod-github-runner-207 kernel: [67044.575522] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:01:10 juju-e4d256-prod-github-runner-207 kernel: [67044.576544] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:01:10 juju-e4d256-prod-github-runner-207 kernel: [67044.577617] ? show_regs.part.0+0x23/0x29 Aug 23 00:01:10 juju-e4d256-prod-github-runner-207 kernel: [67044.578616] ? show_regs.cold+0x8/0xd Aug 23 00:01:10 juju-e4d256-prod-github-runner-207 kernel: [67044.579599] ? watchdog_timer_fn+0x1be/0x220 Aug 23 00:01:10 juju-e4d256-prod-github-runner-207 kernel: [67044.580606] ? lockup_detector_update_enable+0x60/0x60 Aug 23 00:01:10 juju-e4d256-prod-github-runner-207 kernel: [67044.581673] ? __hrtimer_run_queues+0x107/0x230 Aug 23 00:01:10 juju-e4d256-prod-github-runner-207 kernel: [67044.582703] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 00:01:10 juju-e4d256-prod-github-runner-207 kernel: [67044.583746] ? hrtimer_interrupt+0x101/0x220 Aug 23 00:01:10 juju-e4d256-prod-github-runner-207 kernel: [67044.584760] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 00:01:10 juju-e4d256-prod-github-runner-207 kernel: [67044.585826] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 00:01:10 juju-e4d256-prod-github-runner-207 kernel: [67044.586869] Aug 23 00:01:10 juju-e4d256-prod-github-runner-207 kernel: [67044.587738] Aug 23 00:01:10 juju-e4d256-prod-github-runner-207 kernel: [67044.588575] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 00:01:10 juju-e4d256-prod-github-runner-207 kernel: [67044.589725] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:01:10 juju-e4d256-prod-github-runner-207 kernel: [67044.591209] ? _raw_spin_lock+0x22/0x30 Aug 23 00:01:10 juju-e4d256-prod-github-runner-207 kernel: [67044.592591] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:01:10 juju-e4d256-prod-github-runner-207 kernel: [67044.593902] direct_page_fault+0x206/0x310 [kvm] Aug 23 00:01:10 juju-e4d256-prod-github-runner-207 kernel: [67044.595073] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 00:01:10 juju-e4d256-prod-github-runner-207 kernel: [67044.596121] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 00:01:10 juju-e4d256-prod-github-runner-207 kernel: [67044.597145] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 00:01:10 juju-e4d256-prod-github-runner-207 kernel: [67044.598115] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 00:01:10 juju-e4d256-prod-github-runner-207 kernel: [67044.599072] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 00:01:10 juju-e4d256-prod-github-runner-207 kernel: [67044.600050] handle_exit+0x98/0x230 [kvm_amd] Aug 23 00:01:10 juju-e4d256-prod-github-runner-207 kernel: [67044.600943] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 00:01:10 juju-e4d256-prod-github-runner-207 kernel: [67044.601858] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 00:01:10 juju-e4d256-prod-github-runner-207 kernel: [67044.602815] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 00:01:10 juju-e4d256-prod-github-runner-207 kernel: [67044.603753] vcpu_run+0x62/0x2c0 [kvm] Aug 23 00:01:10 juju-e4d256-prod-github-runner-207 kernel: [67044.604564] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 00:01:10 juju-e4d256-prod-github-runner-207 kernel: [67044.605407] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 00:01:10 juju-e4d256-prod-github-runner-207 kernel: [67044.606270] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 00:01:10 juju-e4d256-prod-github-runner-207 kernel: [67044.607084] ? __seccomp_filter+0x4a/0x4a0 Aug 23 00:01:10 juju-e4d256-prod-github-runner-207 kernel: [67044.607829] ? __fget_files+0x86/0xc0 Aug 23 00:01:10 juju-e4d256-prod-github-runner-207 kernel: [67044.608538] __x64_sys_ioctl+0x95/0xd0 Aug 23 00:01:10 juju-e4d256-prod-github-runner-207 kernel: [67044.609308] do_syscall_64+0x5c/0xc0 Aug 23 00:01:10 juju-e4d256-prod-github-runner-207 kernel: [67044.610023] ? do_futex+0x162/0x1f0 Aug 23 00:01:10 juju-e4d256-prod-github-runner-207 kernel: [67044.610675] ? __x64_sys_futex+0x78/0x1e0 Aug 23 00:01:10 juju-e4d256-prod-github-runner-207 kernel: [67044.611375] ? __secure_computing+0xa9/0x120 Aug 23 00:01:10 juju-e4d256-prod-github-runner-207 kernel: [67044.612069] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 00:01:10 juju-e4d256-prod-github-runner-207 kernel: [67044.612836] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:01:10 juju-e4d256-prod-github-runner-207 kernel: [67044.613560] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:01:10 juju-e4d256-prod-github-runner-207 kernel: [67044.614293] ? do_syscall_64+0x69/0xc0 Aug 23 00:01:10 juju-e4d256-prod-github-runner-207 kernel: [67044.614950] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:01:10 juju-e4d256-prod-github-runner-207 kernel: [67044.615673] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:01:10 juju-e4d256-prod-github-runner-207 kernel: [67044.616374] ? do_syscall_64+0x69/0xc0 Aug 23 00:01:10 juju-e4d256-prod-github-runner-207 kernel: [67044.617000] ? do_syscall_64+0x69/0xc0 Aug 23 00:01:10 juju-e4d256-prod-github-runner-207 kernel: [67044.617624] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 00:01:10 juju-e4d256-prod-github-runner-207 kernel: [67044.618337] RIP: 0033:0x7faa5d0edaff Aug 23 00:01:10 juju-e4d256-prod-github-runner-207 kernel: [67044.618961] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 00:01:10 juju-e4d256-prod-github-runner-207 kernel: [67044.620961] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 00:01:10 juju-e4d256-prod-github-runner-207 kernel: [67044.621879] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 00:01:10 juju-e4d256-prod-github-runner-207 kernel: [67044.622770] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 00:01:10 juju-e4d256-prod-github-runner-207 kernel: [67044.623666] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 00:01:10 juju-e4d256-prod-github-runner-207 kernel: [67044.624562] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 00:01:10 juju-e4d256-prod-github-runner-207 kernel: [67044.625478] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 00:01:10 juju-e4d256-prod-github-runner-207 kernel: [67044.626375] Aug 23 00:01:38 juju-e4d256-prod-github-runner-207 kernel: [67072.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 62358s! [qemu-system-x86:6715] Aug 23 00:01:38 juju-e4d256-prod-github-runner-207 kernel: [67072.543111] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 00:01:38 juju-e4d256-prod-github-runner-207 kernel: [67072.543185] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 00:01:38 juju-e4d256-prod-github-runner-207 kernel: [67072.555322] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 00:01:38 juju-e4d256-prod-github-runner-207 kernel: [67072.556592] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 00:01:38 juju-e4d256-prod-github-runner-207 kernel: [67072.557842] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:01:38 juju-e4d256-prod-github-runner-207 kernel: [67072.558943] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 00:01:38 juju-e4d256-prod-github-runner-207 kernel: [67072.561498] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 00:01:38 juju-e4d256-prod-github-runner-207 kernel: [67072.562546] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 00:01:38 juju-e4d256-prod-github-runner-207 kernel: [67072.563733] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 00:01:38 juju-e4d256-prod-github-runner-207 kernel: [67072.564887] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 00:01:38 juju-e4d256-prod-github-runner-207 kernel: [67072.566042] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 00:01:38 juju-e4d256-prod-github-runner-207 kernel: [67072.567220] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 00:01:38 juju-e4d256-prod-github-runner-207 kernel: [67072.568393] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 00:01:38 juju-e4d256-prod-github-runner-207 kernel: [67072.569628] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 00:01:38 juju-e4d256-prod-github-runner-207 kernel: [67072.570746] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 00:01:38 juju-e4d256-prod-github-runner-207 kernel: [67072.571951] Call Trace: Aug 23 00:01:38 juju-e4d256-prod-github-runner-207 kernel: [67072.572861] Aug 23 00:01:38 juju-e4d256-prod-github-runner-207 kernel: [67072.573754] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:01:38 juju-e4d256-prod-github-runner-207 kernel: [67072.574797] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:01:38 juju-e4d256-prod-github-runner-207 kernel: [67072.575816] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:01:38 juju-e4d256-prod-github-runner-207 kernel: [67072.576890] ? show_regs.part.0+0x23/0x29 Aug 23 00:01:38 juju-e4d256-prod-github-runner-207 kernel: [67072.577890] ? show_regs.cold+0x8/0xd Aug 23 00:01:38 juju-e4d256-prod-github-runner-207 kernel: [67072.578880] ? watchdog_timer_fn+0x1be/0x220 Aug 23 00:01:38 juju-e4d256-prod-github-runner-207 kernel: [67072.579886] ? lockup_detector_update_enable+0x60/0x60 Aug 23 00:01:38 juju-e4d256-prod-github-runner-207 kernel: [67072.580966] ? __hrtimer_run_queues+0x107/0x230 Aug 23 00:01:38 juju-e4d256-prod-github-runner-207 kernel: [67072.581994] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 00:01:38 juju-e4d256-prod-github-runner-207 kernel: [67072.583051] ? hrtimer_interrupt+0x101/0x220 Aug 23 00:01:38 juju-e4d256-prod-github-runner-207 kernel: [67072.584065] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 00:01:38 juju-e4d256-prod-github-runner-207 kernel: [67072.585131] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 00:01:38 juju-e4d256-prod-github-runner-207 kernel: [67072.586181] Aug 23 00:01:38 juju-e4d256-prod-github-runner-207 kernel: [67072.587054] Aug 23 00:01:38 juju-e4d256-prod-github-runner-207 kernel: [67072.587890] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 00:01:38 juju-e4d256-prod-github-runner-207 kernel: [67072.588922] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:01:38 juju-e4d256-prod-github-runner-207 kernel: [67072.589959] ? _raw_spin_lock+0x22/0x30 Aug 23 00:01:38 juju-e4d256-prod-github-runner-207 kernel: [67072.590920] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:01:38 juju-e4d256-prod-github-runner-207 kernel: [67072.591934] direct_page_fault+0x206/0x310 [kvm] Aug 23 00:01:38 juju-e4d256-prod-github-runner-207 kernel: [67072.592963] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 00:01:38 juju-e4d256-prod-github-runner-207 kernel: [67072.593970] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 00:01:38 juju-e4d256-prod-github-runner-207 kernel: [67072.595014] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 00:01:38 juju-e4d256-prod-github-runner-207 kernel: [67072.595985] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 00:01:38 juju-e4d256-prod-github-runner-207 kernel: [67072.596955] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 00:01:38 juju-e4d256-prod-github-runner-207 kernel: [67072.597929] handle_exit+0x98/0x230 [kvm_amd] Aug 23 00:01:38 juju-e4d256-prod-github-runner-207 kernel: [67072.598863] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 00:01:38 juju-e4d256-prod-github-runner-207 kernel: [67072.599782] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 00:01:38 juju-e4d256-prod-github-runner-207 kernel: [67072.600704] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 00:01:38 juju-e4d256-prod-github-runner-207 kernel: [67072.601609] vcpu_run+0x62/0x2c0 [kvm] Aug 23 00:01:38 juju-e4d256-prod-github-runner-207 kernel: [67072.602452] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 00:01:38 juju-e4d256-prod-github-runner-207 kernel: [67072.603296] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 00:01:38 juju-e4d256-prod-github-runner-207 kernel: [67072.604156] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 00:01:38 juju-e4d256-prod-github-runner-207 kernel: [67072.604977] ? __seccomp_filter+0x4a/0x4a0 Aug 23 00:01:38 juju-e4d256-prod-github-runner-207 kernel: [67072.605720] ? __fget_files+0x86/0xc0 Aug 23 00:01:38 juju-e4d256-prod-github-runner-207 kernel: [67072.606427] __x64_sys_ioctl+0x95/0xd0 Aug 23 00:01:38 juju-e4d256-prod-github-runner-207 kernel: [67072.607159] do_syscall_64+0x5c/0xc0 Aug 23 00:01:38 juju-e4d256-prod-github-runner-207 kernel: [67072.607822] ? do_futex+0x162/0x1f0 Aug 23 00:01:38 juju-e4d256-prod-github-runner-207 kernel: [67072.608604] ? __x64_sys_futex+0x78/0x1e0 Aug 23 00:01:38 juju-e4d256-prod-github-runner-207 kernel: [67072.609276] ? __secure_computing+0xa9/0x120 Aug 23 00:01:38 juju-e4d256-prod-github-runner-207 kernel: [67072.609964] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 00:01:38 juju-e4d256-prod-github-runner-207 kernel: [67072.610734] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:01:38 juju-e4d256-prod-github-runner-207 kernel: [67072.611466] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:01:38 juju-e4d256-prod-github-runner-207 kernel: [67072.612192] ? do_syscall_64+0x69/0xc0 Aug 23 00:01:38 juju-e4d256-prod-github-runner-207 kernel: [67072.612883] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:01:38 juju-e4d256-prod-github-runner-207 kernel: [67072.613588] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:01:38 juju-e4d256-prod-github-runner-207 kernel: [67072.614290] ? do_syscall_64+0x69/0xc0 Aug 23 00:01:38 juju-e4d256-prod-github-runner-207 kernel: [67072.614935] ? do_syscall_64+0x69/0xc0 Aug 23 00:01:38 juju-e4d256-prod-github-runner-207 kernel: [67072.615648] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 00:01:38 juju-e4d256-prod-github-runner-207 kernel: [67072.616350] RIP: 0033:0x7faa5d0edaff Aug 23 00:01:38 juju-e4d256-prod-github-runner-207 kernel: [67072.616974] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 00:01:38 juju-e4d256-prod-github-runner-207 kernel: [67072.618969] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 00:01:38 juju-e4d256-prod-github-runner-207 kernel: [67072.619878] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 00:01:38 juju-e4d256-prod-github-runner-207 kernel: [67072.620767] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 00:01:38 juju-e4d256-prod-github-runner-207 kernel: [67072.621658] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 00:01:38 juju-e4d256-prod-github-runner-207 kernel: [67072.622543] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 00:01:38 juju-e4d256-prod-github-runner-207 kernel: [67072.623456] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 00:01:38 juju-e4d256-prod-github-runner-207 kernel: [67072.624346] Aug 23 00:02:06 juju-e4d256-prod-github-runner-207 kernel: [67100.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 62384s! [qemu-system-x86:6715] Aug 23 00:02:06 juju-e4d256-prod-github-runner-207 kernel: [67100.543994] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 00:02:06 juju-e4d256-prod-github-runner-207 kernel: [67100.544304] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 00:02:06 juju-e4d256-prod-github-runner-207 kernel: [67100.556376] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 00:02:06 juju-e4d256-prod-github-runner-207 kernel: [67100.557637] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 00:02:06 juju-e4d256-prod-github-runner-207 kernel: [67100.558868] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:02:06 juju-e4d256-prod-github-runner-207 kernel: [67100.560108] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 00:02:06 juju-e4d256-prod-github-runner-207 kernel: [67100.562695] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 00:02:06 juju-e4d256-prod-github-runner-207 kernel: [67100.563756] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 00:02:06 juju-e4d256-prod-github-runner-207 kernel: [67100.564923] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 00:02:06 juju-e4d256-prod-github-runner-207 kernel: [67100.566083] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 00:02:06 juju-e4d256-prod-github-runner-207 kernel: [67100.567253] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 00:02:06 juju-e4d256-prod-github-runner-207 kernel: [67100.568421] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 00:02:06 juju-e4d256-prod-github-runner-207 kernel: [67100.569590] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 00:02:06 juju-e4d256-prod-github-runner-207 kernel: [67100.570832] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 00:02:06 juju-e4d256-prod-github-runner-207 kernel: [67100.571950] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 00:02:06 juju-e4d256-prod-github-runner-207 kernel: [67100.573146] Call Trace: Aug 23 00:02:06 juju-e4d256-prod-github-runner-207 kernel: [67100.574063] Aug 23 00:02:06 juju-e4d256-prod-github-runner-207 kernel: [67100.574984] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:02:06 juju-e4d256-prod-github-runner-207 kernel: [67100.576136] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:02:06 juju-e4d256-prod-github-runner-207 kernel: [67100.577156] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:02:06 juju-e4d256-prod-github-runner-207 kernel: [67100.578265] ? show_regs.part.0+0x23/0x29 Aug 23 00:02:06 juju-e4d256-prod-github-runner-207 kernel: [67100.579307] ? show_regs.cold+0x8/0xd Aug 23 00:02:06 juju-e4d256-prod-github-runner-207 kernel: [67100.580278] ? watchdog_timer_fn+0x1be/0x220 Aug 23 00:02:06 juju-e4d256-prod-github-runner-207 kernel: [67100.581283] ? lockup_detector_update_enable+0x60/0x60 Aug 23 00:02:06 juju-e4d256-prod-github-runner-207 kernel: [67100.582346] ? __hrtimer_run_queues+0x107/0x230 Aug 23 00:02:06 juju-e4d256-prod-github-runner-207 kernel: [67100.583387] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 00:02:06 juju-e4d256-prod-github-runner-207 kernel: [67100.584408] ? hrtimer_interrupt+0x101/0x220 Aug 23 00:02:06 juju-e4d256-prod-github-runner-207 kernel: [67100.585422] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 00:02:06 juju-e4d256-prod-github-runner-207 kernel: [67100.586501] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 00:02:06 juju-e4d256-prod-github-runner-207 kernel: [67100.587557] Aug 23 00:02:06 juju-e4d256-prod-github-runner-207 kernel: [67100.588408] Aug 23 00:02:06 juju-e4d256-prod-github-runner-207 kernel: [67100.589320] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 00:02:06 juju-e4d256-prod-github-runner-207 kernel: [67100.590518] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:02:06 juju-e4d256-prod-github-runner-207 kernel: [67100.591708] ? _raw_spin_lock+0x22/0x30 Aug 23 00:02:06 juju-e4d256-prod-github-runner-207 kernel: [67100.592690] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:02:06 juju-e4d256-prod-github-runner-207 kernel: [67100.593722] direct_page_fault+0x206/0x310 [kvm] Aug 23 00:02:06 juju-e4d256-prod-github-runner-207 kernel: [67100.594762] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 00:02:06 juju-e4d256-prod-github-runner-207 kernel: [67100.595774] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 00:02:06 juju-e4d256-prod-github-runner-207 kernel: [67100.596781] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 00:02:06 juju-e4d256-prod-github-runner-207 kernel: [67100.597792] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 00:02:06 juju-e4d256-prod-github-runner-207 kernel: [67100.598746] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 00:02:06 juju-e4d256-prod-github-runner-207 kernel: [67100.599728] handle_exit+0x98/0x230 [kvm_amd] Aug 23 00:02:06 juju-e4d256-prod-github-runner-207 kernel: [67100.600621] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 00:02:06 juju-e4d256-prod-github-runner-207 kernel: [67100.601535] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 00:02:06 juju-e4d256-prod-github-runner-207 kernel: [67100.602481] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 00:02:06 juju-e4d256-prod-github-runner-207 kernel: [67100.603394] vcpu_run+0x62/0x2c0 [kvm] Aug 23 00:02:06 juju-e4d256-prod-github-runner-207 kernel: [67100.604221] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 00:02:06 juju-e4d256-prod-github-runner-207 kernel: [67100.605034] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 00:02:06 juju-e4d256-prod-github-runner-207 kernel: [67100.605887] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 00:02:06 juju-e4d256-prod-github-runner-207 kernel: [67100.606693] ? __seccomp_filter+0x4a/0x4a0 Aug 23 00:02:06 juju-e4d256-prod-github-runner-207 kernel: [67100.607437] ? __fget_files+0x86/0xc0 Aug 23 00:02:06 juju-e4d256-prod-github-runner-207 kernel: [67100.608141] __x64_sys_ioctl+0x95/0xd0 Aug 23 00:02:06 juju-e4d256-prod-github-runner-207 kernel: [67100.608834] do_syscall_64+0x5c/0xc0 Aug 23 00:02:06 juju-e4d256-prod-github-runner-207 kernel: [67100.609499] ? do_futex+0x162/0x1f0 Aug 23 00:02:06 juju-e4d256-prod-github-runner-207 kernel: [67100.610172] ? __x64_sys_futex+0x78/0x1e0 Aug 23 00:02:06 juju-e4d256-prod-github-runner-207 kernel: [67100.610869] ? __secure_computing+0xa9/0x120 Aug 23 00:02:06 juju-e4d256-prod-github-runner-207 kernel: [67100.611557] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 00:02:06 juju-e4d256-prod-github-runner-207 kernel: [67100.612322] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:02:06 juju-e4d256-prod-github-runner-207 kernel: [67100.613042] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:02:06 juju-e4d256-prod-github-runner-207 kernel: [67100.613759] ? do_syscall_64+0x69/0xc0 Aug 23 00:02:06 juju-e4d256-prod-github-runner-207 kernel: [67100.614420] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:02:06 juju-e4d256-prod-github-runner-207 kernel: [67100.615124] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:02:06 juju-e4d256-prod-github-runner-207 kernel: [67100.615823] ? do_syscall_64+0x69/0xc0 Aug 23 00:02:06 juju-e4d256-prod-github-runner-207 kernel: [67100.616449] ? do_syscall_64+0x69/0xc0 Aug 23 00:02:06 juju-e4d256-prod-github-runner-207 kernel: [67100.617072] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 00:02:06 juju-e4d256-prod-github-runner-207 kernel: [67100.617781] RIP: 0033:0x7faa5d0edaff Aug 23 00:02:06 juju-e4d256-prod-github-runner-207 kernel: [67100.618450] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 00:02:06 juju-e4d256-prod-github-runner-207 kernel: [67100.620657] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 00:02:06 juju-e4d256-prod-github-runner-207 kernel: [67100.621580] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 00:02:06 juju-e4d256-prod-github-runner-207 kernel: [67100.622494] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 00:02:06 juju-e4d256-prod-github-runner-207 kernel: [67100.623385] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 00:02:06 juju-e4d256-prod-github-runner-207 kernel: [67100.624289] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 00:02:06 juju-e4d256-prod-github-runner-207 kernel: [67100.625229] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 00:02:06 juju-e4d256-prod-github-runner-207 kernel: [67100.626129] Aug 23 00:02:34 juju-e4d256-prod-github-runner-207 kernel: [67128.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 62410s! [qemu-system-x86:6715] Aug 23 00:02:34 juju-e4d256-prod-github-runner-207 kernel: [67128.543109] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 00:02:34 juju-e4d256-prod-github-runner-207 kernel: [67128.543184] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 00:02:34 juju-e4d256-prod-github-runner-207 kernel: [67128.555491] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 00:02:34 juju-e4d256-prod-github-runner-207 kernel: [67128.556754] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 00:02:34 juju-e4d256-prod-github-runner-207 kernel: [67128.557972] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:02:34 juju-e4d256-prod-github-runner-207 kernel: [67128.559044] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 00:02:34 juju-e4d256-prod-github-runner-207 kernel: [67128.561592] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 00:02:34 juju-e4d256-prod-github-runner-207 kernel: [67128.562642] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 00:02:34 juju-e4d256-prod-github-runner-207 kernel: [67128.563807] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 00:02:34 juju-e4d256-prod-github-runner-207 kernel: [67128.564971] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 00:02:34 juju-e4d256-prod-github-runner-207 kernel: [67128.566163] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 00:02:34 juju-e4d256-prod-github-runner-207 kernel: [67128.567369] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 00:02:34 juju-e4d256-prod-github-runner-207 kernel: [67128.568554] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 00:02:34 juju-e4d256-prod-github-runner-207 kernel: [67128.569793] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 00:02:34 juju-e4d256-prod-github-runner-207 kernel: [67128.570910] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 00:02:34 juju-e4d256-prod-github-runner-207 kernel: [67128.572108] Call Trace: Aug 23 00:02:34 juju-e4d256-prod-github-runner-207 kernel: [67128.573036] Aug 23 00:02:34 juju-e4d256-prod-github-runner-207 kernel: [67128.573920] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:02:34 juju-e4d256-prod-github-runner-207 kernel: [67128.574956] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:02:34 juju-e4d256-prod-github-runner-207 kernel: [67128.575979] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:02:34 juju-e4d256-prod-github-runner-207 kernel: [67128.577196] ? show_regs.part.0+0x23/0x29 Aug 23 00:02:34 juju-e4d256-prod-github-runner-207 kernel: [67128.578204] ? show_regs.cold+0x8/0xd Aug 23 00:02:34 juju-e4d256-prod-github-runner-207 kernel: [67128.579174] ? watchdog_timer_fn+0x1be/0x220 Aug 23 00:02:34 juju-e4d256-prod-github-runner-207 kernel: [67128.580185] ? lockup_detector_update_enable+0x60/0x60 Aug 23 00:02:34 juju-e4d256-prod-github-runner-207 kernel: [67128.581247] ? __hrtimer_run_queues+0x107/0x230 Aug 23 00:02:34 juju-e4d256-prod-github-runner-207 kernel: [67128.582281] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 00:02:34 juju-e4d256-prod-github-runner-207 kernel: [67128.583304] ? hrtimer_interrupt+0x101/0x220 Aug 23 00:02:34 juju-e4d256-prod-github-runner-207 kernel: [67128.584324] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 00:02:34 juju-e4d256-prod-github-runner-207 kernel: [67128.585390] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 00:02:34 juju-e4d256-prod-github-runner-207 kernel: [67128.586453] Aug 23 00:02:34 juju-e4d256-prod-github-runner-207 kernel: [67128.587308] Aug 23 00:02:34 juju-e4d256-prod-github-runner-207 kernel: [67128.588145] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 00:02:34 juju-e4d256-prod-github-runner-207 kernel: [67128.589181] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:02:34 juju-e4d256-prod-github-runner-207 kernel: [67128.590287] ? _raw_spin_lock+0x22/0x30 Aug 23 00:02:34 juju-e4d256-prod-github-runner-207 kernel: [67128.591232] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:02:34 juju-e4d256-prod-github-runner-207 kernel: [67128.592269] direct_page_fault+0x206/0x310 [kvm] Aug 23 00:02:34 juju-e4d256-prod-github-runner-207 kernel: [67128.593294] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 00:02:34 juju-e4d256-prod-github-runner-207 kernel: [67128.594316] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 00:02:34 juju-e4d256-prod-github-runner-207 kernel: [67128.595324] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 00:02:34 juju-e4d256-prod-github-runner-207 kernel: [67128.596299] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 00:02:34 juju-e4d256-prod-github-runner-207 kernel: [67128.597248] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 00:02:34 juju-e4d256-prod-github-runner-207 kernel: [67128.598237] handle_exit+0x98/0x230 [kvm_amd] Aug 23 00:02:34 juju-e4d256-prod-github-runner-207 kernel: [67128.599135] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 00:02:34 juju-e4d256-prod-github-runner-207 kernel: [67128.600049] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 00:02:34 juju-e4d256-prod-github-runner-207 kernel: [67128.600996] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 00:02:34 juju-e4d256-prod-github-runner-207 kernel: [67128.601907] vcpu_run+0x62/0x2c0 [kvm] Aug 23 00:02:34 juju-e4d256-prod-github-runner-207 kernel: [67128.602736] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 00:02:34 juju-e4d256-prod-github-runner-207 kernel: [67128.603546] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 00:02:34 juju-e4d256-prod-github-runner-207 kernel: [67128.604401] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 00:02:34 juju-e4d256-prod-github-runner-207 kernel: [67128.605205] ? __seccomp_filter+0x4a/0x4a0 Aug 23 00:02:34 juju-e4d256-prod-github-runner-207 kernel: [67128.605951] ? __fget_files+0x86/0xc0 Aug 23 00:02:34 juju-e4d256-prod-github-runner-207 kernel: [67128.606667] __x64_sys_ioctl+0x95/0xd0 Aug 23 00:02:34 juju-e4d256-prod-github-runner-207 kernel: [67128.607363] do_syscall_64+0x5c/0xc0 Aug 23 00:02:34 juju-e4d256-prod-github-runner-207 kernel: [67128.608034] ? do_futex+0x162/0x1f0 Aug 23 00:02:34 juju-e4d256-prod-github-runner-207 kernel: [67128.608684] ? __x64_sys_futex+0x78/0x1e0 Aug 23 00:02:34 juju-e4d256-prod-github-runner-207 kernel: [67128.609359] ? __secure_computing+0xa9/0x120 Aug 23 00:02:34 juju-e4d256-prod-github-runner-207 kernel: [67128.610063] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 00:02:34 juju-e4d256-prod-github-runner-207 kernel: [67128.610828] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:02:34 juju-e4d256-prod-github-runner-207 kernel: [67128.611550] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:02:34 juju-e4d256-prod-github-runner-207 kernel: [67128.612274] ? do_syscall_64+0x69/0xc0 Aug 23 00:02:34 juju-e4d256-prod-github-runner-207 kernel: [67128.612941] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:02:34 juju-e4d256-prod-github-runner-207 kernel: [67128.613654] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:02:34 juju-e4d256-prod-github-runner-207 kernel: [67128.614365] ? do_syscall_64+0x69/0xc0 Aug 23 00:02:34 juju-e4d256-prod-github-runner-207 kernel: [67128.614998] ? do_syscall_64+0x69/0xc0 Aug 23 00:02:34 juju-e4d256-prod-github-runner-207 kernel: [67128.615624] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 00:02:34 juju-e4d256-prod-github-runner-207 kernel: [67128.616332] RIP: 0033:0x7faa5d0edaff Aug 23 00:02:34 juju-e4d256-prod-github-runner-207 kernel: [67128.617005] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 00:02:34 juju-e4d256-prod-github-runner-207 kernel: [67128.619027] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 00:02:34 juju-e4d256-prod-github-runner-207 kernel: [67128.619941] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 00:02:34 juju-e4d256-prod-github-runner-207 kernel: [67128.620838] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 00:02:34 juju-e4d256-prod-github-runner-207 kernel: [67128.621729] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 00:02:34 juju-e4d256-prod-github-runner-207 kernel: [67128.622628] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 00:02:34 juju-e4d256-prod-github-runner-207 kernel: [67128.623519] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 00:02:34 juju-e4d256-prod-github-runner-207 kernel: [67128.624415] Aug 23 00:02:47 juju-e4d256-prod-github-runner-207 kernel: [67141.664707] rcu: INFO: rcu_sched self-detected stall on CPU Aug 23 00:02:47 juju-e4d256-prod-github-runner-207 kernel: [67141.665655] rcu: 1-....: (16703291 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=8064068 Aug 23 00:02:47 juju-e4d256-prod-github-runner-207 kernel: [67141.666791] (t=16756116 jiffies g=23269 q=58520) Aug 23 00:02:47 juju-e4d256-prod-github-runner-207 kernel: [67141.667577] NMI backtrace for cpu 1 Aug 23 00:02:47 juju-e4d256-prod-github-runner-207 kernel: [67141.668290] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 00:02:47 juju-e4d256-prod-github-runner-207 kernel: [67141.669394] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 00:02:47 juju-e4d256-prod-github-runner-207 kernel: [67141.670484] Call Trace: Aug 23 00:02:47 juju-e4d256-prod-github-runner-207 kernel: [67141.671159] Aug 23 00:02:47 juju-e4d256-prod-github-runner-207 kernel: [67141.671809] show_stack+0x52/0x5c Aug 23 00:02:47 juju-e4d256-prod-github-runner-207 kernel: [67141.672559] dump_stack_lvl+0x4a/0x63 Aug 23 00:02:47 juju-e4d256-prod-github-runner-207 kernel: [67141.673382] dump_stack+0x10/0x16 Aug 23 00:02:47 juju-e4d256-prod-github-runner-207 kernel: [67141.674194] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 23 00:02:47 juju-e4d256-prod-github-runner-207 kernel: [67141.675081] ? lapic_can_unplug_cpu+0x90/0x90 Aug 23 00:02:47 juju-e4d256-prod-github-runner-207 kernel: [67141.675965] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 23 00:02:47 juju-e4d256-prod-github-runner-207 kernel: [67141.676878] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 23 00:02:47 juju-e4d256-prod-github-runner-207 kernel: [67141.677808] trigger_single_cpu_backtrace+0x44/0x4f Aug 23 00:02:47 juju-e4d256-prod-github-runner-207 kernel: [67141.678739] rcu_dump_cpu_stacks+0x102/0x149 Aug 23 00:02:47 juju-e4d256-prod-github-runner-207 kernel: [67141.679614] print_cpu_stall.cold+0x2f/0xe2 Aug 23 00:02:47 juju-e4d256-prod-github-runner-207 kernel: [67141.680474] ? timekeeping_update+0xf7/0x150 Aug 23 00:02:47 juju-e4d256-prod-github-runner-207 kernel: [67141.681374] check_cpu_stall+0x109/0x270 Aug 23 00:02:47 juju-e4d256-prod-github-runner-207 kernel: [67141.682212] rcu_sched_clock_irq+0x9a/0x250 Aug 23 00:02:47 juju-e4d256-prod-github-runner-207 kernel: [67141.683051] update_process_times+0x94/0xd0 Aug 23 00:02:47 juju-e4d256-prod-github-runner-207 kernel: [67141.683892] tick_sched_handle+0x29/0x70 Aug 23 00:02:47 juju-e4d256-prod-github-runner-207 kernel: [67141.684718] tick_sched_timer+0x8c/0xc0 Aug 23 00:02:47 juju-e4d256-prod-github-runner-207 kernel: [67141.685536] ? tick_nohz_handler+0xb0/0xb0 Aug 23 00:02:47 juju-e4d256-prod-github-runner-207 kernel: [67141.686381] __hrtimer_run_queues+0x107/0x230 Aug 23 00:02:47 juju-e4d256-prod-github-runner-207 kernel: [67141.687240] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 00:02:47 juju-e4d256-prod-github-runner-207 kernel: [67141.688101] hrtimer_interrupt+0x101/0x220 Aug 23 00:02:47 juju-e4d256-prod-github-runner-207 kernel: [67141.688951] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 00:02:47 juju-e4d256-prod-github-runner-207 kernel: [67141.689860] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 00:02:47 juju-e4d256-prod-github-runner-207 kernel: [67141.690779] Aug 23 00:02:47 juju-e4d256-prod-github-runner-207 kernel: [67141.691466] Aug 23 00:02:47 juju-e4d256-prod-github-runner-207 kernel: [67141.692146] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 00:02:47 juju-e4d256-prod-github-runner-207 kernel: [67141.693069] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:02:47 juju-e4d256-prod-github-runner-207 kernel: [67141.694073] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 00:02:47 juju-e4d256-prod-github-runner-207 kernel: [67141.696602] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 00:02:47 juju-e4d256-prod-github-runner-207 kernel: [67141.697574] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 00:02:47 juju-e4d256-prod-github-runner-207 kernel: [67141.698715] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 00:02:47 juju-e4d256-prod-github-runner-207 kernel: [67141.699839] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 00:02:47 juju-e4d256-prod-github-runner-207 kernel: [67141.700941] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 00:02:47 juju-e4d256-prod-github-runner-207 kernel: [67141.702049] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 00:02:47 juju-e4d256-prod-github-runner-207 kernel: [67141.703150] ? _raw_spin_lock+0x22/0x30 Aug 23 00:02:47 juju-e4d256-prod-github-runner-207 kernel: [67141.703987] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:02:47 juju-e4d256-prod-github-runner-207 kernel: [67141.704923] direct_page_fault+0x206/0x310 [kvm] Aug 23 00:02:47 juju-e4d256-prod-github-runner-207 kernel: [67141.705856] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 00:02:47 juju-e4d256-prod-github-runner-207 kernel: [67141.706799] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 00:02:47 juju-e4d256-prod-github-runner-207 kernel: [67141.707719] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 00:02:47 juju-e4d256-prod-github-runner-207 kernel: [67141.708622] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 00:02:47 juju-e4d256-prod-github-runner-207 kernel: [67141.709500] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 00:02:47 juju-e4d256-prod-github-runner-207 kernel: [67141.710446] handle_exit+0x98/0x230 [kvm_amd] Aug 23 00:02:47 juju-e4d256-prod-github-runner-207 kernel: [67141.711287] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 00:02:47 juju-e4d256-prod-github-runner-207 kernel: [67141.712163] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 00:02:47 juju-e4d256-prod-github-runner-207 kernel: [67141.713061] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 00:02:47 juju-e4d256-prod-github-runner-207 kernel: [67141.713967] vcpu_run+0x62/0x2c0 [kvm] Aug 23 00:02:47 juju-e4d256-prod-github-runner-207 kernel: [67141.714758] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 00:02:47 juju-e4d256-prod-github-runner-207 kernel: [67141.715581] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 00:02:47 juju-e4d256-prod-github-runner-207 kernel: [67141.716490] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 00:02:47 juju-e4d256-prod-github-runner-207 kernel: [67141.717340] ? __seccomp_filter+0x4a/0x4a0 Aug 23 00:02:47 juju-e4d256-prod-github-runner-207 kernel: [67141.718155] ? __fget_files+0x86/0xc0 Aug 23 00:02:47 juju-e4d256-prod-github-runner-207 kernel: [67141.718925] __x64_sys_ioctl+0x95/0xd0 Aug 23 00:02:47 juju-e4d256-prod-github-runner-207 kernel: [67141.719695] do_syscall_64+0x5c/0xc0 Aug 23 00:02:47 juju-e4d256-prod-github-runner-207 kernel: [67141.720451] ? do_futex+0x162/0x1f0 Aug 23 00:02:47 juju-e4d256-prod-github-runner-207 kernel: [67141.721197] ? __x64_sys_futex+0x78/0x1e0 Aug 23 00:02:47 juju-e4d256-prod-github-runner-207 kernel: [67141.721999] ? __secure_computing+0xa9/0x120 Aug 23 00:02:47 juju-e4d256-prod-github-runner-207 kernel: [67141.722802] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 00:02:47 juju-e4d256-prod-github-runner-207 kernel: [67141.723696] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:02:47 juju-e4d256-prod-github-runner-207 kernel: [67141.724545] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:02:47 juju-e4d256-prod-github-runner-207 kernel: [67141.725393] ? do_syscall_64+0x69/0xc0 Aug 23 00:02:47 juju-e4d256-prod-github-runner-207 kernel: [67141.726180] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:02:47 juju-e4d256-prod-github-runner-207 kernel: [67141.727024] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:02:47 juju-e4d256-prod-github-runner-207 kernel: [67141.727877] ? do_syscall_64+0x69/0xc0 Aug 23 00:02:47 juju-e4d256-prod-github-runner-207 kernel: [67141.728643] ? do_syscall_64+0x69/0xc0 Aug 23 00:02:47 juju-e4d256-prod-github-runner-207 kernel: [67141.729403] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 00:02:47 juju-e4d256-prod-github-runner-207 kernel: [67141.730280] RIP: 0033:0x7faa5d0edaff Aug 23 00:02:47 juju-e4d256-prod-github-runner-207 kernel: [67141.731033] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 00:02:47 juju-e4d256-prod-github-runner-207 kernel: [67141.733455] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 00:02:47 juju-e4d256-prod-github-runner-207 kernel: [67141.734566] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 00:02:47 juju-e4d256-prod-github-runner-207 kernel: [67141.735722] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 00:02:47 juju-e4d256-prod-github-runner-207 kernel: [67141.736795] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 00:02:47 juju-e4d256-prod-github-runner-207 kernel: [67141.737868] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 00:02:47 juju-e4d256-prod-github-runner-207 kernel: [67141.738941] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 00:02:47 juju-e4d256-prod-github-runner-207 kernel: [67141.739988] Aug 23 00:03:14 juju-e4d256-prod-github-runner-207 kernel: [67168.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 62447s! [qemu-system-x86:6715] Aug 23 00:03:14 juju-e4d256-prod-github-runner-207 kernel: [67168.543134] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 00:03:14 juju-e4d256-prod-github-runner-207 kernel: [67168.543209] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 00:03:14 juju-e4d256-prod-github-runner-207 kernel: [67168.555413] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 00:03:14 juju-e4d256-prod-github-runner-207 kernel: [67168.556682] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 00:03:14 juju-e4d256-prod-github-runner-207 kernel: [67168.557920] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:03:14 juju-e4d256-prod-github-runner-207 kernel: [67168.558976] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 00:03:14 juju-e4d256-prod-github-runner-207 kernel: [67168.561895] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 00:03:14 juju-e4d256-prod-github-runner-207 kernel: [67168.562963] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 00:03:14 juju-e4d256-prod-github-runner-207 kernel: [67168.564192] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 00:03:14 juju-e4d256-prod-github-runner-207 kernel: [67168.565373] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 00:03:14 juju-e4d256-prod-github-runner-207 kernel: [67168.566552] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 00:03:14 juju-e4d256-prod-github-runner-207 kernel: [67168.567711] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 00:03:14 juju-e4d256-prod-github-runner-207 kernel: [67168.568874] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 00:03:14 juju-e4d256-prod-github-runner-207 kernel: [67168.570149] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 00:03:14 juju-e4d256-prod-github-runner-207 kernel: [67168.571263] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 00:03:14 juju-e4d256-prod-github-runner-207 kernel: [67168.572455] Call Trace: Aug 23 00:03:14 juju-e4d256-prod-github-runner-207 kernel: [67168.573367] Aug 23 00:03:14 juju-e4d256-prod-github-runner-207 kernel: [67168.574312] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:03:14 juju-e4d256-prod-github-runner-207 kernel: [67168.575369] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:03:14 juju-e4d256-prod-github-runner-207 kernel: [67168.576403] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:03:14 juju-e4d256-prod-github-runner-207 kernel: [67168.577496] ? show_regs.part.0+0x23/0x29 Aug 23 00:03:14 juju-e4d256-prod-github-runner-207 kernel: [67168.578508] ? show_regs.cold+0x8/0xd Aug 23 00:03:14 juju-e4d256-prod-github-runner-207 kernel: [67168.579481] ? watchdog_timer_fn+0x1be/0x220 Aug 23 00:03:14 juju-e4d256-prod-github-runner-207 kernel: [67168.580593] ? lockup_detector_update_enable+0x60/0x60 Aug 23 00:03:14 juju-e4d256-prod-github-runner-207 kernel: [67168.581677] ? __hrtimer_run_queues+0x107/0x230 Aug 23 00:03:14 juju-e4d256-prod-github-runner-207 kernel: [67168.582733] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 00:03:14 juju-e4d256-prod-github-runner-207 kernel: [67168.583905] ? hrtimer_interrupt+0x101/0x220 Aug 23 00:03:14 juju-e4d256-prod-github-runner-207 kernel: [67168.584926] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 00:03:14 juju-e4d256-prod-github-runner-207 kernel: [67168.586061] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 00:03:14 juju-e4d256-prod-github-runner-207 kernel: [67168.587163] Aug 23 00:03:14 juju-e4d256-prod-github-runner-207 kernel: [67168.588200] Aug 23 00:03:14 juju-e4d256-prod-github-runner-207 kernel: [67168.589142] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 00:03:14 juju-e4d256-prod-github-runner-207 kernel: [67168.590187] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:03:14 juju-e4d256-prod-github-runner-207 kernel: [67168.591255] ? _raw_spin_lock+0x22/0x30 Aug 23 00:03:14 juju-e4d256-prod-github-runner-207 kernel: [67168.592205] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:03:14 juju-e4d256-prod-github-runner-207 kernel: [67168.593253] direct_page_fault+0x206/0x310 [kvm] Aug 23 00:03:14 juju-e4d256-prod-github-runner-207 kernel: [67168.594297] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 00:03:14 juju-e4d256-prod-github-runner-207 kernel: [67168.595309] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 00:03:14 juju-e4d256-prod-github-runner-207 kernel: [67168.596322] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 00:03:14 juju-e4d256-prod-github-runner-207 kernel: [67168.597304] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 00:03:14 juju-e4d256-prod-github-runner-207 kernel: [67168.598310] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 00:03:14 juju-e4d256-prod-github-runner-207 kernel: [67168.599307] handle_exit+0x98/0x230 [kvm_amd] Aug 23 00:03:14 juju-e4d256-prod-github-runner-207 kernel: [67168.600202] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 00:03:14 juju-e4d256-prod-github-runner-207 kernel: [67168.601134] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 00:03:14 juju-e4d256-prod-github-runner-207 kernel: [67168.602086] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 00:03:14 juju-e4d256-prod-github-runner-207 kernel: [67168.602996] vcpu_run+0x62/0x2c0 [kvm] Aug 23 00:03:14 juju-e4d256-prod-github-runner-207 kernel: [67168.603853] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 00:03:14 juju-e4d256-prod-github-runner-207 kernel: [67168.604677] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 00:03:14 juju-e4d256-prod-github-runner-207 kernel: [67168.605572] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 00:03:14 juju-e4d256-prod-github-runner-207 kernel: [67168.606427] ? __seccomp_filter+0x4a/0x4a0 Aug 23 00:03:14 juju-e4d256-prod-github-runner-207 kernel: [67168.607180] ? __fget_files+0x86/0xc0 Aug 23 00:03:14 juju-e4d256-prod-github-runner-207 kernel: [67168.607889] __x64_sys_ioctl+0x95/0xd0 Aug 23 00:03:14 juju-e4d256-prod-github-runner-207 kernel: [67168.608588] do_syscall_64+0x5c/0xc0 Aug 23 00:03:14 juju-e4d256-prod-github-runner-207 kernel: [67168.609254] ? do_futex+0x162/0x1f0 Aug 23 00:03:14 juju-e4d256-prod-github-runner-207 kernel: [67168.609918] ? __x64_sys_futex+0x78/0x1e0 Aug 23 00:03:14 juju-e4d256-prod-github-runner-207 kernel: [67168.610608] ? __secure_computing+0xa9/0x120 Aug 23 00:03:14 juju-e4d256-prod-github-runner-207 kernel: [67168.611309] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 00:03:14 juju-e4d256-prod-github-runner-207 kernel: [67168.612088] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:03:14 juju-e4d256-prod-github-runner-207 kernel: [67168.612832] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:03:14 juju-e4d256-prod-github-runner-207 kernel: [67168.613550] ? do_syscall_64+0x69/0xc0 Aug 23 00:03:14 juju-e4d256-prod-github-runner-207 kernel: [67168.614256] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:03:14 juju-e4d256-prod-github-runner-207 kernel: [67168.614960] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:03:14 juju-e4d256-prod-github-runner-207 kernel: [67168.615654] ? do_syscall_64+0x69/0xc0 Aug 23 00:03:14 juju-e4d256-prod-github-runner-207 kernel: [67168.616277] ? do_syscall_64+0x69/0xc0 Aug 23 00:03:14 juju-e4d256-prod-github-runner-207 kernel: [67168.616910] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 00:03:14 juju-e4d256-prod-github-runner-207 kernel: [67168.617679] RIP: 0033:0x7faa5d0edaff Aug 23 00:03:14 juju-e4d256-prod-github-runner-207 kernel: [67168.618344] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 00:03:14 juju-e4d256-prod-github-runner-207 kernel: [67168.620407] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 00:03:14 juju-e4d256-prod-github-runner-207 kernel: [67168.621320] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 00:03:14 juju-e4d256-prod-github-runner-207 kernel: [67168.622251] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 00:03:14 juju-e4d256-prod-github-runner-207 kernel: [67168.623145] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 00:03:14 juju-e4d256-prod-github-runner-207 kernel: [67168.624035] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 00:03:14 juju-e4d256-prod-github-runner-207 kernel: [67168.624926] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 00:03:14 juju-e4d256-prod-github-runner-207 kernel: [67168.625857] Aug 23 00:03:42 juju-e4d256-prod-github-runner-207 kernel: [67196.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 62473s! [qemu-system-x86:6715] Aug 23 00:03:42 juju-e4d256-prod-github-runner-207 kernel: [67196.544515] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 00:03:42 juju-e4d256-prod-github-runner-207 kernel: [67196.544825] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 00:03:42 juju-e4d256-prod-github-runner-207 kernel: [67196.557150] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 00:03:42 juju-e4d256-prod-github-runner-207 kernel: [67196.558457] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 00:03:42 juju-e4d256-prod-github-runner-207 kernel: [67196.559698] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:03:42 juju-e4d256-prod-github-runner-207 kernel: [67196.560774] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 00:03:42 juju-e4d256-prod-github-runner-207 kernel: [67196.563380] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 00:03:42 juju-e4d256-prod-github-runner-207 kernel: [67196.564430] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 00:03:42 juju-e4d256-prod-github-runner-207 kernel: [67196.565621] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 00:03:42 juju-e4d256-prod-github-runner-207 kernel: [67196.566802] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 00:03:42 juju-e4d256-prod-github-runner-207 kernel: [67196.567984] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 00:03:42 juju-e4d256-prod-github-runner-207 kernel: [67196.569166] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 00:03:42 juju-e4d256-prod-github-runner-207 kernel: [67196.570370] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 00:03:42 juju-e4d256-prod-github-runner-207 kernel: [67196.571618] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 00:03:42 juju-e4d256-prod-github-runner-207 kernel: [67196.572837] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 00:03:42 juju-e4d256-prod-github-runner-207 kernel: [67196.574210] Call Trace: Aug 23 00:03:42 juju-e4d256-prod-github-runner-207 kernel: [67196.575173] Aug 23 00:03:42 juju-e4d256-prod-github-runner-207 kernel: [67196.576081] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:03:42 juju-e4d256-prod-github-runner-207 kernel: [67196.577126] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:03:42 juju-e4d256-prod-github-runner-207 kernel: [67196.578168] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:03:42 juju-e4d256-prod-github-runner-207 kernel: [67196.579273] ? show_regs.part.0+0x23/0x29 Aug 23 00:03:42 juju-e4d256-prod-github-runner-207 kernel: [67196.580290] ? show_regs.cold+0x8/0xd Aug 23 00:03:42 juju-e4d256-prod-github-runner-207 kernel: [67196.581284] ? watchdog_timer_fn+0x1be/0x220 Aug 23 00:03:42 juju-e4d256-prod-github-runner-207 kernel: [67196.582303] ? lockup_detector_update_enable+0x60/0x60 Aug 23 00:03:42 juju-e4d256-prod-github-runner-207 kernel: [67196.583385] ? __hrtimer_run_queues+0x107/0x230 Aug 23 00:03:42 juju-e4d256-prod-github-runner-207 kernel: [67196.584425] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 00:03:42 juju-e4d256-prod-github-runner-207 kernel: [67196.585477] ? hrtimer_interrupt+0x101/0x220 Aug 23 00:03:42 juju-e4d256-prod-github-runner-207 kernel: [67196.586509] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 00:03:42 juju-e4d256-prod-github-runner-207 kernel: [67196.587590] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 00:03:42 juju-e4d256-prod-github-runner-207 kernel: [67196.588669] Aug 23 00:03:42 juju-e4d256-prod-github-runner-207 kernel: [67196.589545] Aug 23 00:03:42 juju-e4d256-prod-github-runner-207 kernel: [67196.590413] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 00:03:42 juju-e4d256-prod-github-runner-207 kernel: [67196.591593] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:03:42 juju-e4d256-prod-github-runner-207 kernel: [67196.592793] ? _raw_spin_lock+0x22/0x30 Aug 23 00:03:42 juju-e4d256-prod-github-runner-207 kernel: [67196.593906] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:03:42 juju-e4d256-prod-github-runner-207 kernel: [67196.594935] direct_page_fault+0x206/0x310 [kvm] Aug 23 00:03:42 juju-e4d256-prod-github-runner-207 kernel: [67196.596233] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 00:03:42 juju-e4d256-prod-github-runner-207 kernel: [67196.597714] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 00:03:42 juju-e4d256-prod-github-runner-207 kernel: [67196.599251] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 00:03:42 juju-e4d256-prod-github-runner-207 kernel: [67196.600823] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 00:03:42 juju-e4d256-prod-github-runner-207 kernel: [67196.602273] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 00:03:42 juju-e4d256-prod-github-runner-207 kernel: [67196.603927] handle_exit+0x98/0x230 [kvm_amd] Aug 23 00:03:42 juju-e4d256-prod-github-runner-207 kernel: [67196.605249] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 00:03:42 juju-e4d256-prod-github-runner-207 kernel: [67196.606671] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 00:03:42 juju-e4d256-prod-github-runner-207 kernel: [67196.608055] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 00:03:42 juju-e4d256-prod-github-runner-207 kernel: [67196.609459] vcpu_run+0x62/0x2c0 [kvm] Aug 23 00:03:42 juju-e4d256-prod-github-runner-207 kernel: [67196.610656] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 00:03:42 juju-e4d256-prod-github-runner-207 kernel: [67196.611523] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 00:03:42 juju-e4d256-prod-github-runner-207 kernel: [67196.612401] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 00:03:42 juju-e4d256-prod-github-runner-207 kernel: [67196.613217] ? __seccomp_filter+0x4a/0x4a0 Aug 23 00:03:42 juju-e4d256-prod-github-runner-207 kernel: [67196.613992] ? __fget_files+0x86/0xc0 Aug 23 00:03:42 juju-e4d256-prod-github-runner-207 kernel: [67196.614712] __x64_sys_ioctl+0x95/0xd0 Aug 23 00:03:42 juju-e4d256-prod-github-runner-207 kernel: [67196.615438] do_syscall_64+0x5c/0xc0 Aug 23 00:03:42 juju-e4d256-prod-github-runner-207 kernel: [67196.616113] ? do_futex+0x162/0x1f0 Aug 23 00:03:42 juju-e4d256-prod-github-runner-207 kernel: [67196.616772] ? __x64_sys_futex+0x78/0x1e0 Aug 23 00:03:42 juju-e4d256-prod-github-runner-207 kernel: [67196.617480] ? __secure_computing+0xa9/0x120 Aug 23 00:03:42 juju-e4d256-prod-github-runner-207 kernel: [67196.618184] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 00:03:42 juju-e4d256-prod-github-runner-207 kernel: [67196.618967] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:03:42 juju-e4d256-prod-github-runner-207 kernel: [67196.619704] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:03:42 juju-e4d256-prod-github-runner-207 kernel: [67196.620436] ? do_syscall_64+0x69/0xc0 Aug 23 00:03:42 juju-e4d256-prod-github-runner-207 kernel: [67196.621093] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:03:42 juju-e4d256-prod-github-runner-207 kernel: [67196.621830] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:03:42 juju-e4d256-prod-github-runner-207 kernel: [67196.622544] ? do_syscall_64+0x69/0xc0 Aug 23 00:03:42 juju-e4d256-prod-github-runner-207 kernel: [67196.623180] ? do_syscall_64+0x69/0xc0 Aug 23 00:03:42 juju-e4d256-prod-github-runner-207 kernel: [67196.623848] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 00:03:42 juju-e4d256-prod-github-runner-207 kernel: [67196.624574] RIP: 0033:0x7faa5d0edaff Aug 23 00:03:42 juju-e4d256-prod-github-runner-207 kernel: [67196.625240] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 00:03:42 juju-e4d256-prod-github-runner-207 kernel: [67196.627297] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 00:03:42 juju-e4d256-prod-github-runner-207 kernel: [67196.628232] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 00:03:42 juju-e4d256-prod-github-runner-207 kernel: [67196.629147] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 00:03:42 juju-e4d256-prod-github-runner-207 kernel: [67196.630070] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 00:03:42 juju-e4d256-prod-github-runner-207 kernel: [67196.630980] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 00:03:42 juju-e4d256-prod-github-runner-207 kernel: [67196.631891] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 00:03:42 juju-e4d256-prod-github-runner-207 kernel: [67196.632801] Aug 23 00:04:10 juju-e4d256-prod-github-runner-207 kernel: [67224.541980] watchdog: BUG: soft lockup - CPU#1 stuck for 62499s! [qemu-system-x86:6715] Aug 23 00:04:10 juju-e4d256-prod-github-runner-207 kernel: [67224.543135] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 00:04:10 juju-e4d256-prod-github-runner-207 kernel: [67224.543212] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 00:04:10 juju-e4d256-prod-github-runner-207 kernel: [67224.555871] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 00:04:10 juju-e4d256-prod-github-runner-207 kernel: [67224.557152] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 00:04:10 juju-e4d256-prod-github-runner-207 kernel: [67224.558370] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:04:10 juju-e4d256-prod-github-runner-207 kernel: [67224.559430] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 00:04:10 juju-e4d256-prod-github-runner-207 kernel: [67224.561988] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 00:04:10 juju-e4d256-prod-github-runner-207 kernel: [67224.563040] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 00:04:10 juju-e4d256-prod-github-runner-207 kernel: [67224.564205] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 00:04:10 juju-e4d256-prod-github-runner-207 kernel: [67224.565380] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 00:04:10 juju-e4d256-prod-github-runner-207 kernel: [67224.566553] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 00:04:10 juju-e4d256-prod-github-runner-207 kernel: [67224.567736] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 00:04:10 juju-e4d256-prod-github-runner-207 kernel: [67224.568916] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 00:04:10 juju-e4d256-prod-github-runner-207 kernel: [67224.570160] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 00:04:10 juju-e4d256-prod-github-runner-207 kernel: [67224.571418] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 00:04:10 juju-e4d256-prod-github-runner-207 kernel: [67224.572627] Call Trace: Aug 23 00:04:10 juju-e4d256-prod-github-runner-207 kernel: [67224.573684] Aug 23 00:04:10 juju-e4d256-prod-github-runner-207 kernel: [67224.574577] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:04:10 juju-e4d256-prod-github-runner-207 kernel: [67224.575613] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:04:10 juju-e4d256-prod-github-runner-207 kernel: [67224.576644] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:04:10 juju-e4d256-prod-github-runner-207 kernel: [67224.577759] ? show_regs.part.0+0x23/0x29 Aug 23 00:04:10 juju-e4d256-prod-github-runner-207 kernel: [67224.578789] ? show_regs.cold+0x8/0xd Aug 23 00:04:10 juju-e4d256-prod-github-runner-207 kernel: [67224.579770] ? watchdog_timer_fn+0x1be/0x220 Aug 23 00:04:10 juju-e4d256-prod-github-runner-207 kernel: [67224.580783] ? lockup_detector_update_enable+0x60/0x60 Aug 23 00:04:10 juju-e4d256-prod-github-runner-207 kernel: [67224.581868] ? __hrtimer_run_queues+0x107/0x230 Aug 23 00:04:10 juju-e4d256-prod-github-runner-207 kernel: [67224.582913] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 00:04:10 juju-e4d256-prod-github-runner-207 kernel: [67224.583942] ? hrtimer_interrupt+0x101/0x220 Aug 23 00:04:10 juju-e4d256-prod-github-runner-207 kernel: [67224.584974] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 00:04:10 juju-e4d256-prod-github-runner-207 kernel: [67224.586046] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 00:04:10 juju-e4d256-prod-github-runner-207 kernel: [67224.587416] Aug 23 00:04:10 juju-e4d256-prod-github-runner-207 kernel: [67224.588585] Aug 23 00:04:10 juju-e4d256-prod-github-runner-207 kernel: [67224.589733] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 00:04:10 juju-e4d256-prod-github-runner-207 kernel: [67224.591198] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:04:10 juju-e4d256-prod-github-runner-207 kernel: [67224.592634] ? _raw_spin_lock+0x22/0x30 Aug 23 00:04:10 juju-e4d256-prod-github-runner-207 kernel: [67224.593926] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:04:10 juju-e4d256-prod-github-runner-207 kernel: [67224.595279] direct_page_fault+0x206/0x310 [kvm] Aug 23 00:04:10 juju-e4d256-prod-github-runner-207 kernel: [67224.596315] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 00:04:10 juju-e4d256-prod-github-runner-207 kernel: [67224.597363] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 00:04:10 juju-e4d256-prod-github-runner-207 kernel: [67224.598409] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 00:04:10 juju-e4d256-prod-github-runner-207 kernel: [67224.599553] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 00:04:10 juju-e4d256-prod-github-runner-207 kernel: [67224.600507] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 00:04:10 juju-e4d256-prod-github-runner-207 kernel: [67224.601522] handle_exit+0x98/0x230 [kvm_amd] Aug 23 00:04:10 juju-e4d256-prod-github-runner-207 kernel: [67224.602436] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 00:04:10 juju-e4d256-prod-github-runner-207 kernel: [67224.603367] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 00:04:10 juju-e4d256-prod-github-runner-207 kernel: [67224.604340] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 00:04:10 juju-e4d256-prod-github-runner-207 kernel: [67224.605272] vcpu_run+0x62/0x2c0 [kvm] Aug 23 00:04:10 juju-e4d256-prod-github-runner-207 kernel: [67224.606092] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 00:04:10 juju-e4d256-prod-github-runner-207 kernel: [67224.606915] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 00:04:10 juju-e4d256-prod-github-runner-207 kernel: [67224.607849] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 00:04:10 juju-e4d256-prod-github-runner-207 kernel: [67224.609034] ? __seccomp_filter+0x4a/0x4a0 Aug 23 00:04:10 juju-e4d256-prod-github-runner-207 kernel: [67224.609907] ? __fget_files+0x86/0xc0 Aug 23 00:04:10 juju-e4d256-prod-github-runner-207 kernel: [67224.610626] __x64_sys_ioctl+0x95/0xd0 Aug 23 00:04:10 juju-e4d256-prod-github-runner-207 kernel: [67224.611328] do_syscall_64+0x5c/0xc0 Aug 23 00:04:10 juju-e4d256-prod-github-runner-207 kernel: [67224.612004] ? do_futex+0x162/0x1f0 Aug 23 00:04:10 juju-e4d256-prod-github-runner-207 kernel: [67224.612665] ? __x64_sys_futex+0x78/0x1e0 Aug 23 00:04:10 juju-e4d256-prod-github-runner-207 kernel: [67224.613357] ? __secure_computing+0xa9/0x120 Aug 23 00:04:10 juju-e4d256-prod-github-runner-207 kernel: [67224.614052] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 00:04:10 juju-e4d256-prod-github-runner-207 kernel: [67224.614881] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:04:10 juju-e4d256-prod-github-runner-207 kernel: [67224.615848] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:04:10 juju-e4d256-prod-github-runner-207 kernel: [67224.616789] ? do_syscall_64+0x69/0xc0 Aug 23 00:04:10 juju-e4d256-prod-github-runner-207 kernel: [67224.617693] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:04:10 juju-e4d256-prod-github-runner-207 kernel: [67224.618620] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:04:10 juju-e4d256-prod-github-runner-207 kernel: [67224.619324] ? do_syscall_64+0x69/0xc0 Aug 23 00:04:10 juju-e4d256-prod-github-runner-207 kernel: [67224.619949] ? do_syscall_64+0x69/0xc0 Aug 23 00:04:10 juju-e4d256-prod-github-runner-207 kernel: [67224.620572] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 00:04:10 juju-e4d256-prod-github-runner-207 kernel: [67224.621300] RIP: 0033:0x7faa5d0edaff Aug 23 00:04:10 juju-e4d256-prod-github-runner-207 kernel: [67224.621926] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 00:04:10 juju-e4d256-prod-github-runner-207 kernel: [67224.623951] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 00:04:10 juju-e4d256-prod-github-runner-207 kernel: [67224.624870] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 00:04:10 juju-e4d256-prod-github-runner-207 kernel: [67224.625845] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 00:04:10 juju-e4d256-prod-github-runner-207 kernel: [67224.626746] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 00:04:10 juju-e4d256-prod-github-runner-207 kernel: [67224.627645] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 00:04:10 juju-e4d256-prod-github-runner-207 kernel: [67224.628568] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 00:04:10 juju-e4d256-prod-github-runner-207 kernel: [67224.629519] Aug 23 00:04:38 juju-e4d256-prod-github-runner-207 kernel: [67252.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 62525s! [qemu-system-x86:6715] Aug 23 00:04:38 juju-e4d256-prod-github-runner-207 kernel: [67252.543305] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 00:04:38 juju-e4d256-prod-github-runner-207 kernel: [67252.543381] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 00:04:38 juju-e4d256-prod-github-runner-207 kernel: [67252.555645] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 00:04:38 juju-e4d256-prod-github-runner-207 kernel: [67252.556967] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 00:04:38 juju-e4d256-prod-github-runner-207 kernel: [67252.558193] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:04:38 juju-e4d256-prod-github-runner-207 kernel: [67252.559248] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 00:04:38 juju-e4d256-prod-github-runner-207 kernel: [67252.561815] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 00:04:38 juju-e4d256-prod-github-runner-207 kernel: [67252.562859] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 00:04:38 juju-e4d256-prod-github-runner-207 kernel: [67252.564024] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 00:04:38 juju-e4d256-prod-github-runner-207 kernel: [67252.565205] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 00:04:38 juju-e4d256-prod-github-runner-207 kernel: [67252.566368] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 00:04:38 juju-e4d256-prod-github-runner-207 kernel: [67252.567531] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 00:04:38 juju-e4d256-prod-github-runner-207 kernel: [67252.568765] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 00:04:38 juju-e4d256-prod-github-runner-207 kernel: [67252.570009] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 00:04:38 juju-e4d256-prod-github-runner-207 kernel: [67252.571123] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 00:04:38 juju-e4d256-prod-github-runner-207 kernel: [67252.572317] Call Trace: Aug 23 00:04:38 juju-e4d256-prod-github-runner-207 kernel: [67252.573244] Aug 23 00:04:38 juju-e4d256-prod-github-runner-207 kernel: [67252.574129] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:04:38 juju-e4d256-prod-github-runner-207 kernel: [67252.575158] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:04:38 juju-e4d256-prod-github-runner-207 kernel: [67252.576185] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:04:38 juju-e4d256-prod-github-runner-207 kernel: [67252.577279] ? show_regs.part.0+0x23/0x29 Aug 23 00:04:38 juju-e4d256-prod-github-runner-207 kernel: [67252.578291] ? show_regs.cold+0x8/0xd Aug 23 00:04:38 juju-e4d256-prod-github-runner-207 kernel: [67252.579269] ? watchdog_timer_fn+0x1be/0x220 Aug 23 00:04:38 juju-e4d256-prod-github-runner-207 kernel: [67252.580287] ? lockup_detector_update_enable+0x60/0x60 Aug 23 00:04:38 juju-e4d256-prod-github-runner-207 kernel: [67252.581377] ? __hrtimer_run_queues+0x107/0x230 Aug 23 00:04:38 juju-e4d256-prod-github-runner-207 kernel: [67252.582405] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 00:04:38 juju-e4d256-prod-github-runner-207 kernel: [67252.583429] ? hrtimer_interrupt+0x101/0x220 Aug 23 00:04:38 juju-e4d256-prod-github-runner-207 kernel: [67252.584461] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 00:04:38 juju-e4d256-prod-github-runner-207 kernel: [67252.585555] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 00:04:38 juju-e4d256-prod-github-runner-207 kernel: [67252.586603] Aug 23 00:04:38 juju-e4d256-prod-github-runner-207 kernel: [67252.587457] Aug 23 00:04:38 juju-e4d256-prod-github-runner-207 kernel: [67252.588295] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 00:04:38 juju-e4d256-prod-github-runner-207 kernel: [67252.589345] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:04:38 juju-e4d256-prod-github-runner-207 kernel: [67252.590385] ? _raw_spin_lock+0x22/0x30 Aug 23 00:04:38 juju-e4d256-prod-github-runner-207 kernel: [67252.591336] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:04:38 juju-e4d256-prod-github-runner-207 kernel: [67252.592371] direct_page_fault+0x206/0x310 [kvm] Aug 23 00:04:38 juju-e4d256-prod-github-runner-207 kernel: [67252.593413] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 00:04:38 juju-e4d256-prod-github-runner-207 kernel: [67252.594422] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 00:04:38 juju-e4d256-prod-github-runner-207 kernel: [67252.595457] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 00:04:38 juju-e4d256-prod-github-runner-207 kernel: [67252.596513] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 00:04:38 juju-e4d256-prod-github-runner-207 kernel: [67252.597483] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 00:04:38 juju-e4d256-prod-github-runner-207 kernel: [67252.598461] handle_exit+0x98/0x230 [kvm_amd] Aug 23 00:04:38 juju-e4d256-prod-github-runner-207 kernel: [67252.599352] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 00:04:38 juju-e4d256-prod-github-runner-207 kernel: [67252.600264] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 00:04:38 juju-e4d256-prod-github-runner-207 kernel: [67252.601203] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 00:04:38 juju-e4d256-prod-github-runner-207 kernel: [67252.602108] vcpu_run+0x62/0x2c0 [kvm] Aug 23 00:04:38 juju-e4d256-prod-github-runner-207 kernel: [67252.602919] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 00:04:38 juju-e4d256-prod-github-runner-207 kernel: [67252.603725] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 00:04:38 juju-e4d256-prod-github-runner-207 kernel: [67252.604584] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 00:04:38 juju-e4d256-prod-github-runner-207 kernel: [67252.605401] ? __seccomp_filter+0x4a/0x4a0 Aug 23 00:04:38 juju-e4d256-prod-github-runner-207 kernel: [67252.606145] ? __fget_files+0x86/0xc0 Aug 23 00:04:38 juju-e4d256-prod-github-runner-207 kernel: [67252.606855] __x64_sys_ioctl+0x95/0xd0 Aug 23 00:04:38 juju-e4d256-prod-github-runner-207 kernel: [67252.607547] do_syscall_64+0x5c/0xc0 Aug 23 00:04:38 juju-e4d256-prod-github-runner-207 kernel: [67252.608213] ? do_futex+0x162/0x1f0 Aug 23 00:04:38 juju-e4d256-prod-github-runner-207 kernel: [67252.608873] ? __x64_sys_futex+0x78/0x1e0 Aug 23 00:04:38 juju-e4d256-prod-github-runner-207 kernel: [67252.609546] ? __secure_computing+0xa9/0x120 Aug 23 00:04:38 juju-e4d256-prod-github-runner-207 kernel: [67252.610235] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 00:04:38 juju-e4d256-prod-github-runner-207 kernel: [67252.610999] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:04:38 juju-e4d256-prod-github-runner-207 kernel: [67252.611721] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:04:38 juju-e4d256-prod-github-runner-207 kernel: [67252.612439] ? do_syscall_64+0x69/0xc0 Aug 23 00:04:38 juju-e4d256-prod-github-runner-207 kernel: [67252.613125] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:04:38 juju-e4d256-prod-github-runner-207 kernel: [67252.613833] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:04:38 juju-e4d256-prod-github-runner-207 kernel: [67252.614528] ? do_syscall_64+0x69/0xc0 Aug 23 00:04:38 juju-e4d256-prod-github-runner-207 kernel: [67252.615158] ? do_syscall_64+0x69/0xc0 Aug 23 00:04:38 juju-e4d256-prod-github-runner-207 kernel: [67252.615780] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 00:04:38 juju-e4d256-prod-github-runner-207 kernel: [67252.616485] RIP: 0033:0x7faa5d0edaff Aug 23 00:04:38 juju-e4d256-prod-github-runner-207 kernel: [67252.617140] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 00:04:38 juju-e4d256-prod-github-runner-207 kernel: [67252.619164] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 00:04:38 juju-e4d256-prod-github-runner-207 kernel: [67252.620085] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 00:04:38 juju-e4d256-prod-github-runner-207 kernel: [67252.621003] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 00:04:38 juju-e4d256-prod-github-runner-207 kernel: [67252.621905] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 00:04:38 juju-e4d256-prod-github-runner-207 kernel: [67252.622806] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 00:04:38 juju-e4d256-prod-github-runner-207 kernel: [67252.623703] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 00:04:38 juju-e4d256-prod-github-runner-207 kernel: [67252.624601] Aug 23 00:05:06 juju-e4d256-prod-github-runner-207 kernel: [67280.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 62551s! [qemu-system-x86:6715] Aug 23 00:05:06 juju-e4d256-prod-github-runner-207 kernel: [67280.543116] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 00:05:06 juju-e4d256-prod-github-runner-207 kernel: [67280.543193] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 00:05:06 juju-e4d256-prod-github-runner-207 kernel: [67280.555421] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 00:05:06 juju-e4d256-prod-github-runner-207 kernel: [67280.556707] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 00:05:06 juju-e4d256-prod-github-runner-207 kernel: [67280.557930] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:05:06 juju-e4d256-prod-github-runner-207 kernel: [67280.558988] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 00:05:06 juju-e4d256-prod-github-runner-207 kernel: [67280.561556] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 00:05:06 juju-e4d256-prod-github-runner-207 kernel: [67280.562638] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 00:05:06 juju-e4d256-prod-github-runner-207 kernel: [67280.563811] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 00:05:06 juju-e4d256-prod-github-runner-207 kernel: [67280.565027] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 00:05:06 juju-e4d256-prod-github-runner-207 kernel: [67280.566209] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 00:05:06 juju-e4d256-prod-github-runner-207 kernel: [67280.567376] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 00:05:06 juju-e4d256-prod-github-runner-207 kernel: [67280.568569] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 00:05:06 juju-e4d256-prod-github-runner-207 kernel: [67280.569801] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 00:05:06 juju-e4d256-prod-github-runner-207 kernel: [67280.570916] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 00:05:06 juju-e4d256-prod-github-runner-207 kernel: [67280.572124] Call Trace: Aug 23 00:05:06 juju-e4d256-prod-github-runner-207 kernel: [67280.573077] Aug 23 00:05:06 juju-e4d256-prod-github-runner-207 kernel: [67280.573963] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:05:06 juju-e4d256-prod-github-runner-207 kernel: [67280.574998] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:05:06 juju-e4d256-prod-github-runner-207 kernel: [67280.576020] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:05:06 juju-e4d256-prod-github-runner-207 kernel: [67280.577124] ? show_regs.part.0+0x23/0x29 Aug 23 00:05:06 juju-e4d256-prod-github-runner-207 kernel: [67280.578121] ? show_regs.cold+0x8/0xd Aug 23 00:05:06 juju-e4d256-prod-github-runner-207 kernel: [67280.579092] ? watchdog_timer_fn+0x1be/0x220 Aug 23 00:05:06 juju-e4d256-prod-github-runner-207 kernel: [67280.580103] ? lockup_detector_update_enable+0x60/0x60 Aug 23 00:05:06 juju-e4d256-prod-github-runner-207 kernel: [67280.581177] ? __hrtimer_run_queues+0x107/0x230 Aug 23 00:05:06 juju-e4d256-prod-github-runner-207 kernel: [67280.582210] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 00:05:06 juju-e4d256-prod-github-runner-207 kernel: [67280.583234] ? hrtimer_interrupt+0x101/0x220 Aug 23 00:05:06 juju-e4d256-prod-github-runner-207 kernel: [67280.584249] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 00:05:06 juju-e4d256-prod-github-runner-207 kernel: [67280.585332] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 00:05:06 juju-e4d256-prod-github-runner-207 kernel: [67280.586397] Aug 23 00:05:06 juju-e4d256-prod-github-runner-207 kernel: [67280.587250] Aug 23 00:05:06 juju-e4d256-prod-github-runner-207 kernel: [67280.588087] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 00:05:06 juju-e4d256-prod-github-runner-207 kernel: [67280.589165] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:05:06 juju-e4d256-prod-github-runner-207 kernel: [67280.590225] ? _raw_spin_lock+0x22/0x30 Aug 23 00:05:06 juju-e4d256-prod-github-runner-207 kernel: [67280.591188] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:05:06 juju-e4d256-prod-github-runner-207 kernel: [67280.592210] direct_page_fault+0x206/0x310 [kvm] Aug 23 00:05:06 juju-e4d256-prod-github-runner-207 kernel: [67280.593254] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 00:05:06 juju-e4d256-prod-github-runner-207 kernel: [67280.594262] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 00:05:06 juju-e4d256-prod-github-runner-207 kernel: [67280.595264] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 00:05:06 juju-e4d256-prod-github-runner-207 kernel: [67280.596258] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 00:05:06 juju-e4d256-prod-github-runner-207 kernel: [67280.597222] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 00:05:06 juju-e4d256-prod-github-runner-207 kernel: [67280.598201] handle_exit+0x98/0x230 [kvm_amd] Aug 23 00:05:06 juju-e4d256-prod-github-runner-207 kernel: [67280.599093] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 00:05:06 juju-e4d256-prod-github-runner-207 kernel: [67280.600007] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 00:05:06 juju-e4d256-prod-github-runner-207 kernel: [67280.600942] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 00:05:06 juju-e4d256-prod-github-runner-207 kernel: [67280.601850] vcpu_run+0x62/0x2c0 [kvm] Aug 23 00:05:06 juju-e4d256-prod-github-runner-207 kernel: [67280.602666] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 00:05:06 juju-e4d256-prod-github-runner-207 kernel: [67280.603477] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 00:05:06 juju-e4d256-prod-github-runner-207 kernel: [67280.604345] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 00:05:06 juju-e4d256-prod-github-runner-207 kernel: [67280.605148] ? __seccomp_filter+0x4a/0x4a0 Aug 23 00:05:06 juju-e4d256-prod-github-runner-207 kernel: [67280.605894] ? __fget_files+0x86/0xc0 Aug 23 00:05:06 juju-e4d256-prod-github-runner-207 kernel: [67280.606597] __x64_sys_ioctl+0x95/0xd0 Aug 23 00:05:06 juju-e4d256-prod-github-runner-207 kernel: [67280.607291] do_syscall_64+0x5c/0xc0 Aug 23 00:05:06 juju-e4d256-prod-github-runner-207 kernel: [67280.607957] ? do_futex+0x162/0x1f0 Aug 23 00:05:06 juju-e4d256-prod-github-runner-207 kernel: [67280.608624] ? __x64_sys_futex+0x78/0x1e0 Aug 23 00:05:06 juju-e4d256-prod-github-runner-207 kernel: [67280.609304] ? __secure_computing+0xa9/0x120 Aug 23 00:05:06 juju-e4d256-prod-github-runner-207 kernel: [67280.609993] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 00:05:06 juju-e4d256-prod-github-runner-207 kernel: [67280.610750] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:05:06 juju-e4d256-prod-github-runner-207 kernel: [67280.611472] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:05:06 juju-e4d256-prod-github-runner-207 kernel: [67280.612202] ? do_syscall_64+0x69/0xc0 Aug 23 00:05:06 juju-e4d256-prod-github-runner-207 kernel: [67280.612852] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:05:06 juju-e4d256-prod-github-runner-207 kernel: [67280.613562] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:05:06 juju-e4d256-prod-github-runner-207 kernel: [67280.614260] ? do_syscall_64+0x69/0xc0 Aug 23 00:05:06 juju-e4d256-prod-github-runner-207 kernel: [67280.614884] ? do_syscall_64+0x69/0xc0 Aug 23 00:05:06 juju-e4d256-prod-github-runner-207 kernel: [67280.615509] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 00:05:06 juju-e4d256-prod-github-runner-207 kernel: [67280.616216] RIP: 0033:0x7faa5d0edaff Aug 23 00:05:06 juju-e4d256-prod-github-runner-207 kernel: [67280.616873] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 00:05:06 juju-e4d256-prod-github-runner-207 kernel: [67280.618857] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 00:05:06 juju-e4d256-prod-github-runner-207 kernel: [67280.619787] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 00:05:06 juju-e4d256-prod-github-runner-207 kernel: [67280.620719] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 00:05:06 juju-e4d256-prod-github-runner-207 kernel: [67280.621615] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 00:05:06 juju-e4d256-prod-github-runner-207 kernel: [67280.622504] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 00:05:06 juju-e4d256-prod-github-runner-207 kernel: [67280.623390] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 00:05:06 juju-e4d256-prod-github-runner-207 kernel: [67280.624313] Aug 23 00:05:34 juju-e4d256-prod-github-runner-207 kernel: [67308.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 62577s! [qemu-system-x86:6715] Aug 23 00:05:34 juju-e4d256-prod-github-runner-207 kernel: [67308.543835] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 00:05:34 juju-e4d256-prod-github-runner-207 kernel: [67308.544164] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 00:05:34 juju-e4d256-prod-github-runner-207 kernel: [67308.556281] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 00:05:34 juju-e4d256-prod-github-runner-207 kernel: [67308.557547] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 00:05:34 juju-e4d256-prod-github-runner-207 kernel: [67308.558762] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:05:34 juju-e4d256-prod-github-runner-207 kernel: [67308.559816] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 00:05:34 juju-e4d256-prod-github-runner-207 kernel: [67308.562371] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 00:05:34 juju-e4d256-prod-github-runner-207 kernel: [67308.563429] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 00:05:34 juju-e4d256-prod-github-runner-207 kernel: [67308.564612] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 00:05:34 juju-e4d256-prod-github-runner-207 kernel: [67308.565769] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 00:05:34 juju-e4d256-prod-github-runner-207 kernel: [67308.566932] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 00:05:34 juju-e4d256-prod-github-runner-207 kernel: [67308.568157] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 00:05:34 juju-e4d256-prod-github-runner-207 kernel: [67308.569338] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 00:05:34 juju-e4d256-prod-github-runner-207 kernel: [67308.570585] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 00:05:34 juju-e4d256-prod-github-runner-207 kernel: [67308.571744] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 00:05:34 juju-e4d256-prod-github-runner-207 kernel: [67308.572950] Call Trace: Aug 23 00:05:34 juju-e4d256-prod-github-runner-207 kernel: [67308.573873] Aug 23 00:05:34 juju-e4d256-prod-github-runner-207 kernel: [67308.574772] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:05:34 juju-e4d256-prod-github-runner-207 kernel: [67308.575802] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:05:34 juju-e4d256-prod-github-runner-207 kernel: [67308.576878] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:05:34 juju-e4d256-prod-github-runner-207 kernel: [67308.578048] ? show_regs.part.0+0x23/0x29 Aug 23 00:05:34 juju-e4d256-prod-github-runner-207 kernel: [67308.579124] ? show_regs.cold+0x8/0xd Aug 23 00:05:34 juju-e4d256-prod-github-runner-207 kernel: [67308.580204] ? watchdog_timer_fn+0x1be/0x220 Aug 23 00:05:34 juju-e4d256-prod-github-runner-207 kernel: [67308.581235] ? lockup_detector_update_enable+0x60/0x60 Aug 23 00:05:34 juju-e4d256-prod-github-runner-207 kernel: [67308.582337] ? __hrtimer_run_queues+0x107/0x230 Aug 23 00:05:34 juju-e4d256-prod-github-runner-207 kernel: [67308.583401] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 00:05:34 juju-e4d256-prod-github-runner-207 kernel: [67308.584457] ? hrtimer_interrupt+0x101/0x220 Aug 23 00:05:34 juju-e4d256-prod-github-runner-207 kernel: [67308.585478] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 00:05:34 juju-e4d256-prod-github-runner-207 kernel: [67308.586766] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 00:05:34 juju-e4d256-prod-github-runner-207 kernel: [67308.587825] Aug 23 00:05:34 juju-e4d256-prod-github-runner-207 kernel: [67308.588690] Aug 23 00:05:34 juju-e4d256-prod-github-runner-207 kernel: [67308.589528] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 00:05:34 juju-e4d256-prod-github-runner-207 kernel: [67308.590557] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:05:34 juju-e4d256-prod-github-runner-207 kernel: [67308.591597] ? _raw_spin_lock+0x22/0x30 Aug 23 00:05:34 juju-e4d256-prod-github-runner-207 kernel: [67308.592609] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:05:34 juju-e4d256-prod-github-runner-207 kernel: [67308.593642] direct_page_fault+0x206/0x310 [kvm] Aug 23 00:05:34 juju-e4d256-prod-github-runner-207 kernel: [67308.594668] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 00:05:34 juju-e4d256-prod-github-runner-207 kernel: [67308.595677] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 00:05:34 juju-e4d256-prod-github-runner-207 kernel: [67308.596697] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 00:05:34 juju-e4d256-prod-github-runner-207 kernel: [67308.597742] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 00:05:34 juju-e4d256-prod-github-runner-207 kernel: [67308.598700] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 00:05:34 juju-e4d256-prod-github-runner-207 kernel: [67308.599684] handle_exit+0x98/0x230 [kvm_amd] Aug 23 00:05:34 juju-e4d256-prod-github-runner-207 kernel: [67308.600602] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 00:05:34 juju-e4d256-prod-github-runner-207 kernel: [67308.601514] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 00:05:34 juju-e4d256-prod-github-runner-207 kernel: [67308.602510] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 00:05:34 juju-e4d256-prod-github-runner-207 kernel: [67308.603447] vcpu_run+0x62/0x2c0 [kvm] Aug 23 00:05:34 juju-e4d256-prod-github-runner-207 kernel: [67308.604332] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 00:05:34 juju-e4d256-prod-github-runner-207 kernel: [67308.605155] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 00:05:34 juju-e4d256-prod-github-runner-207 kernel: [67308.606013] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 00:05:34 juju-e4d256-prod-github-runner-207 kernel: [67308.606817] ? __seccomp_filter+0x4a/0x4a0 Aug 23 00:05:34 juju-e4d256-prod-github-runner-207 kernel: [67308.607563] ? __fget_files+0x86/0xc0 Aug 23 00:05:34 juju-e4d256-prod-github-runner-207 kernel: [67308.608279] __x64_sys_ioctl+0x95/0xd0 Aug 23 00:05:34 juju-e4d256-prod-github-runner-207 kernel: [67308.608975] do_syscall_64+0x5c/0xc0 Aug 23 00:05:34 juju-e4d256-prod-github-runner-207 kernel: [67308.609646] ? do_futex+0x162/0x1f0 Aug 23 00:05:34 juju-e4d256-prod-github-runner-207 kernel: [67308.610297] ? __x64_sys_futex+0x78/0x1e0 Aug 23 00:05:34 juju-e4d256-prod-github-runner-207 kernel: [67308.610979] ? __secure_computing+0xa9/0x120 Aug 23 00:05:34 juju-e4d256-prod-github-runner-207 kernel: [67308.611669] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 00:05:34 juju-e4d256-prod-github-runner-207 kernel: [67308.612453] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:05:34 juju-e4d256-prod-github-runner-207 kernel: [67308.613178] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:05:34 juju-e4d256-prod-github-runner-207 kernel: [67308.613903] ? do_syscall_64+0x69/0xc0 Aug 23 00:05:34 juju-e4d256-prod-github-runner-207 kernel: [67308.614550] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:05:34 juju-e4d256-prod-github-runner-207 kernel: [67308.615254] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:05:34 juju-e4d256-prod-github-runner-207 kernel: [67308.615971] ? do_syscall_64+0x69/0xc0 Aug 23 00:05:34 juju-e4d256-prod-github-runner-207 kernel: [67308.616606] ? do_syscall_64+0x69/0xc0 Aug 23 00:05:34 juju-e4d256-prod-github-runner-207 kernel: [67308.617251] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 00:05:34 juju-e4d256-prod-github-runner-207 kernel: [67308.617969] RIP: 0033:0x7faa5d0edaff Aug 23 00:05:34 juju-e4d256-prod-github-runner-207 kernel: [67308.618642] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 00:05:34 juju-e4d256-prod-github-runner-207 kernel: [67308.620653] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 00:05:34 juju-e4d256-prod-github-runner-207 kernel: [67308.621566] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 00:05:34 juju-e4d256-prod-github-runner-207 kernel: [67308.622466] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 00:05:34 juju-e4d256-prod-github-runner-207 kernel: [67308.623368] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 00:05:34 juju-e4d256-prod-github-runner-207 kernel: [67308.624283] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 00:05:34 juju-e4d256-prod-github-runner-207 kernel: [67308.625171] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 00:05:34 juju-e4d256-prod-github-runner-207 kernel: [67308.626066] Aug 23 00:05:47 juju-e4d256-prod-github-runner-207 kernel: [67321.676704] rcu: INFO: rcu_sched self-detected stall on CPU Aug 23 00:05:47 juju-e4d256-prod-github-runner-207 kernel: [67321.677675] rcu: 1-....: (16748154 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=8085878 Aug 23 00:05:47 juju-e4d256-prod-github-runner-207 kernel: [67321.678806] (t=16801119 jiffies g=23269 q=58620) Aug 23 00:05:47 juju-e4d256-prod-github-runner-207 kernel: [67321.679642] NMI backtrace for cpu 1 Aug 23 00:05:47 juju-e4d256-prod-github-runner-207 kernel: [67321.680367] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 00:05:47 juju-e4d256-prod-github-runner-207 kernel: [67321.681465] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 00:05:47 juju-e4d256-prod-github-runner-207 kernel: [67321.682519] Call Trace: Aug 23 00:05:47 juju-e4d256-prod-github-runner-207 kernel: [67321.683192] Aug 23 00:05:47 juju-e4d256-prod-github-runner-207 kernel: [67321.683861] show_stack+0x52/0x5c Aug 23 00:05:47 juju-e4d256-prod-github-runner-207 kernel: [67321.684585] dump_stack_lvl+0x4a/0x63 Aug 23 00:05:47 juju-e4d256-prod-github-runner-207 kernel: [67321.685343] dump_stack+0x10/0x16 Aug 23 00:05:47 juju-e4d256-prod-github-runner-207 kernel: [67321.686061] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 23 00:05:47 juju-e4d256-prod-github-runner-207 kernel: [67321.686864] ? lapic_can_unplug_cpu+0x90/0x90 Aug 23 00:05:47 juju-e4d256-prod-github-runner-207 kernel: [67321.687682] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 23 00:05:47 juju-e4d256-prod-github-runner-207 kernel: [67321.688555] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 23 00:05:47 juju-e4d256-prod-github-runner-207 kernel: [67321.689378] trigger_single_cpu_backtrace+0x44/0x4f Aug 23 00:05:47 juju-e4d256-prod-github-runner-207 kernel: [67321.690184] rcu_dump_cpu_stacks+0x102/0x149 Aug 23 00:05:47 juju-e4d256-prod-github-runner-207 kernel: [67321.690959] print_cpu_stall.cold+0x2f/0xe2 Aug 23 00:05:47 juju-e4d256-prod-github-runner-207 kernel: [67321.691721] ? timekeeping_update+0xf7/0x150 Aug 23 00:05:47 juju-e4d256-prod-github-runner-207 kernel: [67321.692504] check_cpu_stall+0x109/0x270 Aug 23 00:05:47 juju-e4d256-prod-github-runner-207 kernel: [67321.693252] rcu_sched_clock_irq+0x9a/0x250 Aug 23 00:05:47 juju-e4d256-prod-github-runner-207 kernel: [67321.694020] update_process_times+0x94/0xd0 Aug 23 00:05:47 juju-e4d256-prod-github-runner-207 kernel: [67321.694781] tick_sched_handle+0x29/0x70 Aug 23 00:05:47 juju-e4d256-prod-github-runner-207 kernel: [67321.695570] tick_sched_timer+0x8c/0xc0 Aug 23 00:05:47 juju-e4d256-prod-github-runner-207 kernel: [67321.696353] ? tick_nohz_handler+0xb0/0xb0 Aug 23 00:05:47 juju-e4d256-prod-github-runner-207 kernel: [67321.697109] __hrtimer_run_queues+0x107/0x230 Aug 23 00:05:47 juju-e4d256-prod-github-runner-207 kernel: [67321.697886] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 00:05:47 juju-e4d256-prod-github-runner-207 kernel: [67321.698666] hrtimer_interrupt+0x101/0x220 Aug 23 00:05:47 juju-e4d256-prod-github-runner-207 kernel: [67321.699432] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 00:05:47 juju-e4d256-prod-github-runner-207 kernel: [67321.700267] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 00:05:47 juju-e4d256-prod-github-runner-207 kernel: [67321.701069] Aug 23 00:05:47 juju-e4d256-prod-github-runner-207 kernel: [67321.701703] Aug 23 00:05:47 juju-e4d256-prod-github-runner-207 kernel: [67321.702330] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 00:05:47 juju-e4d256-prod-github-runner-207 kernel: [67321.703148] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:05:47 juju-e4d256-prod-github-runner-207 kernel: [67321.704046] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 00:05:47 juju-e4d256-prod-github-runner-207 kernel: [67321.706337] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 00:05:47 juju-e4d256-prod-github-runner-207 kernel: [67321.707286] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 00:05:47 juju-e4d256-prod-github-runner-207 kernel: [67321.708301] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 00:05:47 juju-e4d256-prod-github-runner-207 kernel: [67321.709594] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 00:05:47 juju-e4d256-prod-github-runner-207 kernel: [67321.710568] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 00:05:47 juju-e4d256-prod-github-runner-207 kernel: [67321.711525] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 00:05:47 juju-e4d256-prod-github-runner-207 kernel: [67321.712505] ? _raw_spin_lock+0x22/0x30 Aug 23 00:05:47 juju-e4d256-prod-github-runner-207 kernel: [67321.713274] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:05:47 juju-e4d256-prod-github-runner-207 kernel: [67321.714108] direct_page_fault+0x206/0x310 [kvm] Aug 23 00:05:47 juju-e4d256-prod-github-runner-207 kernel: [67321.714948] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 00:05:47 juju-e4d256-prod-github-runner-207 kernel: [67321.715774] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 00:05:47 juju-e4d256-prod-github-runner-207 kernel: [67321.716629] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 00:05:47 juju-e4d256-prod-github-runner-207 kernel: [67321.717432] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 00:05:47 juju-e4d256-prod-github-runner-207 kernel: [67321.718223] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 00:05:47 juju-e4d256-prod-github-runner-207 kernel: [67321.719046] handle_exit+0x98/0x230 [kvm_amd] Aug 23 00:05:47 juju-e4d256-prod-github-runner-207 kernel: [67321.719821] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 00:05:47 juju-e4d256-prod-github-runner-207 kernel: [67321.720608] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 00:05:47 juju-e4d256-prod-github-runner-207 kernel: [67321.721407] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 00:05:47 juju-e4d256-prod-github-runner-207 kernel: [67321.722190] vcpu_run+0x62/0x2c0 [kvm] Aug 23 00:05:47 juju-e4d256-prod-github-runner-207 kernel: [67321.722904] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 00:05:47 juju-e4d256-prod-github-runner-207 kernel: [67321.723636] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 00:05:47 juju-e4d256-prod-github-runner-207 kernel: [67321.724466] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 00:05:47 juju-e4d256-prod-github-runner-207 kernel: [67321.725232] ? __seccomp_filter+0x4a/0x4a0 Aug 23 00:05:47 juju-e4d256-prod-github-runner-207 kernel: [67321.725951] ? __fget_files+0x86/0xc0 Aug 23 00:05:47 juju-e4d256-prod-github-runner-207 kernel: [67321.726642] __x64_sys_ioctl+0x95/0xd0 Aug 23 00:05:47 juju-e4d256-prod-github-runner-207 kernel: [67321.727334] do_syscall_64+0x5c/0xc0 Aug 23 00:05:47 juju-e4d256-prod-github-runner-207 kernel: [67321.728232] ? do_futex+0x162/0x1f0 Aug 23 00:05:47 juju-e4d256-prod-github-runner-207 kernel: [67321.728934] ? __x64_sys_futex+0x78/0x1e0 Aug 23 00:05:47 juju-e4d256-prod-github-runner-207 kernel: [67321.729638] ? __secure_computing+0xa9/0x120 Aug 23 00:05:47 juju-e4d256-prod-github-runner-207 kernel: [67321.730352] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 00:05:47 juju-e4d256-prod-github-runner-207 kernel: [67321.731146] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:05:47 juju-e4d256-prod-github-runner-207 kernel: [67321.731920] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:05:47 juju-e4d256-prod-github-runner-207 kernel: [67321.732672] ? do_syscall_64+0x69/0xc0 Aug 23 00:05:47 juju-e4d256-prod-github-runner-207 kernel: [67321.733362] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:05:47 juju-e4d256-prod-github-runner-207 kernel: [67321.734115] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:05:47 juju-e4d256-prod-github-runner-207 kernel: [67321.734869] ? do_syscall_64+0x69/0xc0 Aug 23 00:05:47 juju-e4d256-prod-github-runner-207 kernel: [67321.735560] ? do_syscall_64+0x69/0xc0 Aug 23 00:05:47 juju-e4d256-prod-github-runner-207 kernel: [67321.736260] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 00:05:47 juju-e4d256-prod-github-runner-207 kernel: [67321.737029] RIP: 0033:0x7faa5d0edaff Aug 23 00:05:47 juju-e4d256-prod-github-runner-207 kernel: [67321.737715] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 00:05:47 juju-e4d256-prod-github-runner-207 kernel: [67321.739841] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 00:05:47 juju-e4d256-prod-github-runner-207 kernel: [67321.740829] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 00:05:47 juju-e4d256-prod-github-runner-207 kernel: [67321.741784] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 00:05:47 juju-e4d256-prod-github-runner-207 kernel: [67321.742753] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 00:05:47 juju-e4d256-prod-github-runner-207 kernel: [67321.743690] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 00:05:47 juju-e4d256-prod-github-runner-207 kernel: [67321.744639] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 00:05:47 juju-e4d256-prod-github-runner-207 kernel: [67321.745558] Aug 23 00:06:14 juju-e4d256-prod-github-runner-207 kernel: [67348.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 62615s! [qemu-system-x86:6715] Aug 23 00:06:14 juju-e4d256-prod-github-runner-207 kernel: [67348.543142] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 00:06:14 juju-e4d256-prod-github-runner-207 kernel: [67348.543218] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 00:06:14 juju-e4d256-prod-github-runner-207 kernel: [67348.555417] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 00:06:14 juju-e4d256-prod-github-runner-207 kernel: [67348.556691] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 00:06:14 juju-e4d256-prod-github-runner-207 kernel: [67348.557927] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:06:14 juju-e4d256-prod-github-runner-207 kernel: [67348.558986] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 00:06:14 juju-e4d256-prod-github-runner-207 kernel: [67348.561557] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 00:06:14 juju-e4d256-prod-github-runner-207 kernel: [67348.562605] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 00:06:14 juju-e4d256-prod-github-runner-207 kernel: [67348.563791] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 00:06:14 juju-e4d256-prod-github-runner-207 kernel: [67348.564953] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 00:06:14 juju-e4d256-prod-github-runner-207 kernel: [67348.566115] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 00:06:14 juju-e4d256-prod-github-runner-207 kernel: [67348.567285] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 00:06:14 juju-e4d256-prod-github-runner-207 kernel: [67348.568478] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 00:06:14 juju-e4d256-prod-github-runner-207 kernel: [67348.569715] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 00:06:14 juju-e4d256-prod-github-runner-207 kernel: [67348.570813] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 00:06:14 juju-e4d256-prod-github-runner-207 kernel: [67348.572037] Call Trace: Aug 23 00:06:14 juju-e4d256-prod-github-runner-207 kernel: [67348.572956] Aug 23 00:06:14 juju-e4d256-prod-github-runner-207 kernel: [67348.573839] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:06:14 juju-e4d256-prod-github-runner-207 kernel: [67348.574870] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:06:14 juju-e4d256-prod-github-runner-207 kernel: [67348.575904] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:06:14 juju-e4d256-prod-github-runner-207 kernel: [67348.576984] ? show_regs.part.0+0x23/0x29 Aug 23 00:06:14 juju-e4d256-prod-github-runner-207 kernel: [67348.577986] ? show_regs.cold+0x8/0xd Aug 23 00:06:14 juju-e4d256-prod-github-runner-207 kernel: [67348.578956] ? watchdog_timer_fn+0x1be/0x220 Aug 23 00:06:14 juju-e4d256-prod-github-runner-207 kernel: [67348.579978] ? lockup_detector_update_enable+0x60/0x60 Aug 23 00:06:14 juju-e4d256-prod-github-runner-207 kernel: [67348.581039] ? __hrtimer_run_queues+0x107/0x230 Aug 23 00:06:14 juju-e4d256-prod-github-runner-207 kernel: [67348.582066] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 00:06:14 juju-e4d256-prod-github-runner-207 kernel: [67348.583088] ? hrtimer_interrupt+0x101/0x220 Aug 23 00:06:14 juju-e4d256-prod-github-runner-207 kernel: [67348.584113] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 00:06:14 juju-e4d256-prod-github-runner-207 kernel: [67348.585181] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 00:06:14 juju-e4d256-prod-github-runner-207 kernel: [67348.586227] Aug 23 00:06:14 juju-e4d256-prod-github-runner-207 kernel: [67348.587079] Aug 23 00:06:14 juju-e4d256-prod-github-runner-207 kernel: [67348.587933] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 00:06:14 juju-e4d256-prod-github-runner-207 kernel: [67348.588966] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:06:14 juju-e4d256-prod-github-runner-207 kernel: [67348.590005] ? _raw_spin_lock+0x22/0x30 Aug 23 00:06:14 juju-e4d256-prod-github-runner-207 kernel: [67348.590949] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:06:14 juju-e4d256-prod-github-runner-207 kernel: [67348.591974] direct_page_fault+0x206/0x310 [kvm] Aug 23 00:06:14 juju-e4d256-prod-github-runner-207 kernel: [67348.592996] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 00:06:14 juju-e4d256-prod-github-runner-207 kernel: [67348.594004] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 00:06:14 juju-e4d256-prod-github-runner-207 kernel: [67348.595037] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 00:06:14 juju-e4d256-prod-github-runner-207 kernel: [67348.596049] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 00:06:14 juju-e4d256-prod-github-runner-207 kernel: [67348.597047] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 00:06:14 juju-e4d256-prod-github-runner-207 kernel: [67348.598025] handle_exit+0x98/0x230 [kvm_amd] Aug 23 00:06:14 juju-e4d256-prod-github-runner-207 kernel: [67348.598916] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 00:06:14 juju-e4d256-prod-github-runner-207 kernel: [67348.599851] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 00:06:14 juju-e4d256-prod-github-runner-207 kernel: [67348.600774] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 00:06:14 juju-e4d256-prod-github-runner-207 kernel: [67348.601673] vcpu_run+0x62/0x2c0 [kvm] Aug 23 00:06:14 juju-e4d256-prod-github-runner-207 kernel: [67348.602486] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 00:06:14 juju-e4d256-prod-github-runner-207 kernel: [67348.603291] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 00:06:14 juju-e4d256-prod-github-runner-207 kernel: [67348.604159] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 00:06:14 juju-e4d256-prod-github-runner-207 kernel: [67348.604954] ? __seccomp_filter+0x4a/0x4a0 Aug 23 00:06:14 juju-e4d256-prod-github-runner-207 kernel: [67348.605694] ? __fget_files+0x86/0xc0 Aug 23 00:06:14 juju-e4d256-prod-github-runner-207 kernel: [67348.606402] __x64_sys_ioctl+0x95/0xd0 Aug 23 00:06:14 juju-e4d256-prod-github-runner-207 kernel: [67348.607094] do_syscall_64+0x5c/0xc0 Aug 23 00:06:14 juju-e4d256-prod-github-runner-207 kernel: [67348.607779] ? do_futex+0x162/0x1f0 Aug 23 00:06:14 juju-e4d256-prod-github-runner-207 kernel: [67348.608428] ? __x64_sys_futex+0x78/0x1e0 Aug 23 00:06:14 juju-e4d256-prod-github-runner-207 kernel: [67348.609100] ? __secure_computing+0xa9/0x120 Aug 23 00:06:14 juju-e4d256-prod-github-runner-207 kernel: [67348.609789] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 00:06:14 juju-e4d256-prod-github-runner-207 kernel: [67348.610547] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:06:14 juju-e4d256-prod-github-runner-207 kernel: [67348.611268] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:06:14 juju-e4d256-prod-github-runner-207 kernel: [67348.612004] ? do_syscall_64+0x69/0xc0 Aug 23 00:06:14 juju-e4d256-prod-github-runner-207 kernel: [67348.612647] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:06:14 juju-e4d256-prod-github-runner-207 kernel: [67348.613351] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:06:14 juju-e4d256-prod-github-runner-207 kernel: [67348.614046] ? do_syscall_64+0x69/0xc0 Aug 23 00:06:14 juju-e4d256-prod-github-runner-207 kernel: [67348.614670] ? do_syscall_64+0x69/0xc0 Aug 23 00:06:14 juju-e4d256-prod-github-runner-207 kernel: [67348.615290] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 00:06:14 juju-e4d256-prod-github-runner-207 kernel: [67348.616008] RIP: 0033:0x7faa5d0edaff Aug 23 00:06:14 juju-e4d256-prod-github-runner-207 kernel: [67348.616635] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 00:06:14 juju-e4d256-prod-github-runner-207 kernel: [67348.618657] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 00:06:14 juju-e4d256-prod-github-runner-207 kernel: [67348.619598] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 00:06:14 juju-e4d256-prod-github-runner-207 kernel: [67348.620513] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 00:06:14 juju-e4d256-prod-github-runner-207 kernel: [67348.621406] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 00:06:14 juju-e4d256-prod-github-runner-207 kernel: [67348.622291] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 00:06:14 juju-e4d256-prod-github-runner-207 kernel: [67348.623174] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 00:06:14 juju-e4d256-prod-github-runner-207 kernel: [67348.624082] Aug 23 00:06:42 juju-e4d256-prod-github-runner-207 kernel: [67376.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 62641s! [qemu-system-x86:6715] Aug 23 00:06:42 juju-e4d256-prod-github-runner-207 kernel: [67376.543923] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 00:06:42 juju-e4d256-prod-github-runner-207 kernel: [67376.544232] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 00:06:42 juju-e4d256-prod-github-runner-207 kernel: [67376.556630] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 00:06:42 juju-e4d256-prod-github-runner-207 kernel: [67376.557948] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 00:06:42 juju-e4d256-prod-github-runner-207 kernel: [67376.559210] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:06:42 juju-e4d256-prod-github-runner-207 kernel: [67376.560284] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 00:06:42 juju-e4d256-prod-github-runner-207 kernel: [67376.562878] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 00:06:42 juju-e4d256-prod-github-runner-207 kernel: [67376.563981] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 00:06:42 juju-e4d256-prod-github-runner-207 kernel: [67376.565162] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 00:06:42 juju-e4d256-prod-github-runner-207 kernel: [67376.566345] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 00:06:42 juju-e4d256-prod-github-runner-207 kernel: [67376.567546] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 00:06:42 juju-e4d256-prod-github-runner-207 kernel: [67376.568836] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 00:06:42 juju-e4d256-prod-github-runner-207 kernel: [67376.570070] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 00:06:42 juju-e4d256-prod-github-runner-207 kernel: [67376.571342] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 00:06:42 juju-e4d256-prod-github-runner-207 kernel: [67376.572479] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 00:06:42 juju-e4d256-prod-github-runner-207 kernel: [67376.573698] Call Trace: Aug 23 00:06:42 juju-e4d256-prod-github-runner-207 kernel: [67376.574615] Aug 23 00:06:42 juju-e4d256-prod-github-runner-207 kernel: [67376.575577] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:06:42 juju-e4d256-prod-github-runner-207 kernel: [67376.576629] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:06:42 juju-e4d256-prod-github-runner-207 kernel: [67376.577682] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:06:42 juju-e4d256-prod-github-runner-207 kernel: [67376.578791] ? show_regs.part.0+0x23/0x29 Aug 23 00:06:42 juju-e4d256-prod-github-runner-207 kernel: [67376.579899] ? show_regs.cold+0x8/0xd Aug 23 00:06:42 juju-e4d256-prod-github-runner-207 kernel: [67376.580882] ? watchdog_timer_fn+0x1be/0x220 Aug 23 00:06:42 juju-e4d256-prod-github-runner-207 kernel: [67376.581903] ? lockup_detector_update_enable+0x60/0x60 Aug 23 00:06:42 juju-e4d256-prod-github-runner-207 kernel: [67376.582979] ? __hrtimer_run_queues+0x107/0x230 Aug 23 00:06:42 juju-e4d256-prod-github-runner-207 kernel: [67376.584061] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 00:06:42 juju-e4d256-prod-github-runner-207 kernel: [67376.585102] ? hrtimer_interrupt+0x101/0x220 Aug 23 00:06:42 juju-e4d256-prod-github-runner-207 kernel: [67376.586136] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 00:06:42 juju-e4d256-prod-github-runner-207 kernel: [67376.587233] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 00:06:42 juju-e4d256-prod-github-runner-207 kernel: [67376.588293] Aug 23 00:06:42 juju-e4d256-prod-github-runner-207 kernel: [67376.589150] Aug 23 00:06:42 juju-e4d256-prod-github-runner-207 kernel: [67376.589992] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 00:06:42 juju-e4d256-prod-github-runner-207 kernel: [67376.591043] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:06:42 juju-e4d256-prod-github-runner-207 kernel: [67376.592148] ? _raw_spin_lock+0x22/0x30 Aug 23 00:06:42 juju-e4d256-prod-github-runner-207 kernel: [67376.593103] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:06:42 juju-e4d256-prod-github-runner-207 kernel: [67376.594130] direct_page_fault+0x206/0x310 [kvm] Aug 23 00:06:42 juju-e4d256-prod-github-runner-207 kernel: [67376.595179] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 00:06:42 juju-e4d256-prod-github-runner-207 kernel: [67376.596338] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 00:06:42 juju-e4d256-prod-github-runner-207 kernel: [67376.597348] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 00:06:42 juju-e4d256-prod-github-runner-207 kernel: [67376.598359] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 00:06:42 juju-e4d256-prod-github-runner-207 kernel: [67376.599360] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 00:06:42 juju-e4d256-prod-github-runner-207 kernel: [67376.600354] handle_exit+0x98/0x230 [kvm_amd] Aug 23 00:06:42 juju-e4d256-prod-github-runner-207 kernel: [67376.601259] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 00:06:42 juju-e4d256-prod-github-runner-207 kernel: [67376.602189] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 00:06:42 juju-e4d256-prod-github-runner-207 kernel: [67376.603135] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 00:06:42 juju-e4d256-prod-github-runner-207 kernel: [67376.604051] vcpu_run+0x62/0x2c0 [kvm] Aug 23 00:06:42 juju-e4d256-prod-github-runner-207 kernel: [67376.604870] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 00:06:42 juju-e4d256-prod-github-runner-207 kernel: [67376.605686] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 00:06:42 juju-e4d256-prod-github-runner-207 kernel: [67376.606557] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 00:06:42 juju-e4d256-prod-github-runner-207 kernel: [67376.607431] ? __seccomp_filter+0x4a/0x4a0 Aug 23 00:06:42 juju-e4d256-prod-github-runner-207 kernel: [67376.608200] ? __fget_files+0x86/0xc0 Aug 23 00:06:42 juju-e4d256-prod-github-runner-207 kernel: [67376.608912] __x64_sys_ioctl+0x95/0xd0 Aug 23 00:06:42 juju-e4d256-prod-github-runner-207 kernel: [67376.609611] do_syscall_64+0x5c/0xc0 Aug 23 00:06:42 juju-e4d256-prod-github-runner-207 kernel: [67376.610287] ? do_futex+0x162/0x1f0 Aug 23 00:06:42 juju-e4d256-prod-github-runner-207 kernel: [67376.610942] ? __x64_sys_futex+0x78/0x1e0 Aug 23 00:06:42 juju-e4d256-prod-github-runner-207 kernel: [67376.611638] ? __secure_computing+0xa9/0x120 Aug 23 00:06:42 juju-e4d256-prod-github-runner-207 kernel: [67376.612340] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 00:06:42 juju-e4d256-prod-github-runner-207 kernel: [67376.613106] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:06:42 juju-e4d256-prod-github-runner-207 kernel: [67376.613838] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:06:42 juju-e4d256-prod-github-runner-207 kernel: [67376.614564] ? do_syscall_64+0x69/0xc0 Aug 23 00:06:42 juju-e4d256-prod-github-runner-207 kernel: [67376.615232] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:06:42 juju-e4d256-prod-github-runner-207 kernel: [67376.615946] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:06:42 juju-e4d256-prod-github-runner-207 kernel: [67376.616653] ? do_syscall_64+0x69/0xc0 Aug 23 00:06:42 juju-e4d256-prod-github-runner-207 kernel: [67376.617356] ? do_syscall_64+0x69/0xc0 Aug 23 00:06:42 juju-e4d256-prod-github-runner-207 kernel: [67376.617989] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 00:06:42 juju-e4d256-prod-github-runner-207 kernel: [67376.618706] RIP: 0033:0x7faa5d0edaff Aug 23 00:06:42 juju-e4d256-prod-github-runner-207 kernel: [67376.619448] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 00:06:42 juju-e4d256-prod-github-runner-207 kernel: [67376.621508] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 00:06:42 juju-e4d256-prod-github-runner-207 kernel: [67376.622444] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 00:06:42 juju-e4d256-prod-github-runner-207 kernel: [67376.623393] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 00:06:42 juju-e4d256-prod-github-runner-207 kernel: [67376.624305] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 00:06:42 juju-e4d256-prod-github-runner-207 kernel: [67376.625210] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 00:06:42 juju-e4d256-prod-github-runner-207 kernel: [67376.626113] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 00:06:42 juju-e4d256-prod-github-runner-207 kernel: [67376.627024] Aug 23 00:07:10 juju-e4d256-prod-github-runner-207 kernel: [67404.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 62667s! [qemu-system-x86:6715] Aug 23 00:07:10 juju-e4d256-prod-github-runner-207 kernel: [67404.543123] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 00:07:10 juju-e4d256-prod-github-runner-207 kernel: [67404.543197] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 00:07:10 juju-e4d256-prod-github-runner-207 kernel: [67404.555796] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 00:07:10 juju-e4d256-prod-github-runner-207 kernel: [67404.557107] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 00:07:10 juju-e4d256-prod-github-runner-207 kernel: [67404.558350] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:07:10 juju-e4d256-prod-github-runner-207 kernel: [67404.559436] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 00:07:10 juju-e4d256-prod-github-runner-207 kernel: [67404.562041] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 00:07:10 juju-e4d256-prod-github-runner-207 kernel: [67404.563108] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 00:07:10 juju-e4d256-prod-github-runner-207 kernel: [67404.564364] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 00:07:10 juju-e4d256-prod-github-runner-207 kernel: [67404.565581] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 00:07:10 juju-e4d256-prod-github-runner-207 kernel: [67404.566783] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 00:07:10 juju-e4d256-prod-github-runner-207 kernel: [67404.568004] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 00:07:10 juju-e4d256-prod-github-runner-207 kernel: [67404.569196] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 00:07:10 juju-e4d256-prod-github-runner-207 kernel: [67404.570460] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 00:07:10 juju-e4d256-prod-github-runner-207 kernel: [67404.571603] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 00:07:10 juju-e4d256-prod-github-runner-207 kernel: [67404.572852] Call Trace: Aug 23 00:07:10 juju-e4d256-prod-github-runner-207 kernel: [67404.573772] Aug 23 00:07:10 juju-e4d256-prod-github-runner-207 kernel: [67404.574661] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:07:10 juju-e4d256-prod-github-runner-207 kernel: [67404.575727] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:07:10 juju-e4d256-prod-github-runner-207 kernel: [67404.576760] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:07:10 juju-e4d256-prod-github-runner-207 kernel: [67404.577848] ? show_regs.part.0+0x23/0x29 Aug 23 00:07:10 juju-e4d256-prod-github-runner-207 kernel: [67404.578870] ? show_regs.cold+0x8/0xd Aug 23 00:07:10 juju-e4d256-prod-github-runner-207 kernel: [67404.579853] ? watchdog_timer_fn+0x1be/0x220 Aug 23 00:07:10 juju-e4d256-prod-github-runner-207 kernel: [67404.580878] ? lockup_detector_update_enable+0x60/0x60 Aug 23 00:07:10 juju-e4d256-prod-github-runner-207 kernel: [67404.581960] ? __hrtimer_run_queues+0x107/0x230 Aug 23 00:07:10 juju-e4d256-prod-github-runner-207 kernel: [67404.583008] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 00:07:10 juju-e4d256-prod-github-runner-207 kernel: [67404.584045] ? hrtimer_interrupt+0x101/0x220 Aug 23 00:07:10 juju-e4d256-prod-github-runner-207 kernel: [67404.585069] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 00:07:10 juju-e4d256-prod-github-runner-207 kernel: [67404.586216] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 00:07:10 juju-e4d256-prod-github-runner-207 kernel: [67404.587298] Aug 23 00:07:10 juju-e4d256-prod-github-runner-207 kernel: [67404.588157] Aug 23 00:07:10 juju-e4d256-prod-github-runner-207 kernel: [67404.589003] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 00:07:10 juju-e4d256-prod-github-runner-207 kernel: [67404.590071] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:07:10 juju-e4d256-prod-github-runner-207 kernel: [67404.591154] ? _raw_spin_lock+0x22/0x30 Aug 23 00:07:10 juju-e4d256-prod-github-runner-207 kernel: [67404.592118] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:07:10 juju-e4d256-prod-github-runner-207 kernel: [67404.593154] direct_page_fault+0x206/0x310 [kvm] Aug 23 00:07:10 juju-e4d256-prod-github-runner-207 kernel: [67404.594214] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 00:07:10 juju-e4d256-prod-github-runner-207 kernel: [67404.595388] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 00:07:10 juju-e4d256-prod-github-runner-207 kernel: [67404.596432] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 00:07:10 juju-e4d256-prod-github-runner-207 kernel: [67404.597424] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 00:07:10 juju-e4d256-prod-github-runner-207 kernel: [67404.598390] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 00:07:10 juju-e4d256-prod-github-runner-207 kernel: [67404.599405] handle_exit+0x98/0x230 [kvm_amd] Aug 23 00:07:10 juju-e4d256-prod-github-runner-207 kernel: [67404.600314] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 00:07:10 juju-e4d256-prod-github-runner-207 kernel: [67404.601246] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 00:07:10 juju-e4d256-prod-github-runner-207 kernel: [67404.602196] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 00:07:10 juju-e4d256-prod-github-runner-207 kernel: [67404.603130] vcpu_run+0x62/0x2c0 [kvm] Aug 23 00:07:10 juju-e4d256-prod-github-runner-207 kernel: [67404.603965] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 00:07:10 juju-e4d256-prod-github-runner-207 kernel: [67404.604800] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 00:07:10 juju-e4d256-prod-github-runner-207 kernel: [67404.605704] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 00:07:10 juju-e4d256-prod-github-runner-207 kernel: [67404.606526] ? __seccomp_filter+0x4a/0x4a0 Aug 23 00:07:10 juju-e4d256-prod-github-runner-207 kernel: [67404.607309] ? __fget_files+0x86/0xc0 Aug 23 00:07:10 juju-e4d256-prod-github-runner-207 kernel: [67404.608025] __x64_sys_ioctl+0x95/0xd0 Aug 23 00:07:10 juju-e4d256-prod-github-runner-207 kernel: [67404.608732] do_syscall_64+0x5c/0xc0 Aug 23 00:07:10 juju-e4d256-prod-github-runner-207 kernel: [67404.609416] ? do_futex+0x162/0x1f0 Aug 23 00:07:10 juju-e4d256-prod-github-runner-207 kernel: [67404.610080] ? __x64_sys_futex+0x78/0x1e0 Aug 23 00:07:10 juju-e4d256-prod-github-runner-207 kernel: [67404.610784] ? __secure_computing+0xa9/0x120 Aug 23 00:07:10 juju-e4d256-prod-github-runner-207 kernel: [67404.611492] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 00:07:10 juju-e4d256-prod-github-runner-207 kernel: [67404.612278] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:07:10 juju-e4d256-prod-github-runner-207 kernel: [67404.613026] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:07:10 juju-e4d256-prod-github-runner-207 kernel: [67404.613760] ? do_syscall_64+0x69/0xc0 Aug 23 00:07:10 juju-e4d256-prod-github-runner-207 kernel: [67404.614423] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:07:10 juju-e4d256-prod-github-runner-207 kernel: [67404.615148] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:07:10 juju-e4d256-prod-github-runner-207 kernel: [67404.615870] ? do_syscall_64+0x69/0xc0 Aug 23 00:07:10 juju-e4d256-prod-github-runner-207 kernel: [67404.616571] ? do_syscall_64+0x69/0xc0 Aug 23 00:07:10 juju-e4d256-prod-github-runner-207 kernel: [67404.617214] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 00:07:10 juju-e4d256-prod-github-runner-207 kernel: [67404.617934] RIP: 0033:0x7faa5d0edaff Aug 23 00:07:10 juju-e4d256-prod-github-runner-207 kernel: [67404.618574] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 00:07:10 juju-e4d256-prod-github-runner-207 kernel: [67404.620634] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 00:07:10 juju-e4d256-prod-github-runner-207 kernel: [67404.621572] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 00:07:10 juju-e4d256-prod-github-runner-207 kernel: [67404.622480] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 00:07:10 juju-e4d256-prod-github-runner-207 kernel: [67404.623415] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 00:07:10 juju-e4d256-prod-github-runner-207 kernel: [67404.624515] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 00:07:10 juju-e4d256-prod-github-runner-207 kernel: [67404.625567] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 00:07:10 juju-e4d256-prod-github-runner-207 kernel: [67404.626484] Aug 23 00:07:38 juju-e4d256-prod-github-runner-207 kernel: [67432.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 62693s! [qemu-system-x86:6715] Aug 23 00:07:38 juju-e4d256-prod-github-runner-207 kernel: [67432.543132] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 00:07:38 juju-e4d256-prod-github-runner-207 kernel: [67432.543208] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 00:07:38 juju-e4d256-prod-github-runner-207 kernel: [67432.555717] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 00:07:38 juju-e4d256-prod-github-runner-207 kernel: [67432.557009] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 00:07:38 juju-e4d256-prod-github-runner-207 kernel: [67432.558266] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:07:38 juju-e4d256-prod-github-runner-207 kernel: [67432.559348] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 00:07:38 juju-e4d256-prod-github-runner-207 kernel: [67432.561971] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 00:07:38 juju-e4d256-prod-github-runner-207 kernel: [67432.563043] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 00:07:38 juju-e4d256-prod-github-runner-207 kernel: [67432.564260] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 00:07:38 juju-e4d256-prod-github-runner-207 kernel: [67432.565596] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 00:07:38 juju-e4d256-prod-github-runner-207 kernel: [67432.566798] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 00:07:38 juju-e4d256-prod-github-runner-207 kernel: [67432.567987] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 00:07:38 juju-e4d256-prod-github-runner-207 kernel: [67432.569182] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 00:07:38 juju-e4d256-prod-github-runner-207 kernel: [67432.570463] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 00:07:38 juju-e4d256-prod-github-runner-207 kernel: [67432.571583] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 00:07:38 juju-e4d256-prod-github-runner-207 kernel: [67432.572814] Call Trace: Aug 23 00:07:38 juju-e4d256-prod-github-runner-207 kernel: [67432.573739] Aug 23 00:07:38 juju-e4d256-prod-github-runner-207 kernel: [67432.574643] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:07:38 juju-e4d256-prod-github-runner-207 kernel: [67432.575686] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:07:38 juju-e4d256-prod-github-runner-207 kernel: [67432.576722] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:07:38 juju-e4d256-prod-github-runner-207 kernel: [67432.577819] ? show_regs.part.0+0x23/0x29 Aug 23 00:07:38 juju-e4d256-prod-github-runner-207 kernel: [67432.578864] ? show_regs.cold+0x8/0xd Aug 23 00:07:38 juju-e4d256-prod-github-runner-207 kernel: [67432.579852] ? watchdog_timer_fn+0x1be/0x220 Aug 23 00:07:38 juju-e4d256-prod-github-runner-207 kernel: [67432.580870] ? lockup_detector_update_enable+0x60/0x60 Aug 23 00:07:38 juju-e4d256-prod-github-runner-207 kernel: [67432.581942] ? __hrtimer_run_queues+0x107/0x230 Aug 23 00:07:38 juju-e4d256-prod-github-runner-207 kernel: [67432.583000] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 00:07:38 juju-e4d256-prod-github-runner-207 kernel: [67432.584037] ? hrtimer_interrupt+0x101/0x220 Aug 23 00:07:38 juju-e4d256-prod-github-runner-207 kernel: [67432.585060] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 00:07:38 juju-e4d256-prod-github-runner-207 kernel: [67432.586137] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 00:07:38 juju-e4d256-prod-github-runner-207 kernel: [67432.587201] Aug 23 00:07:38 juju-e4d256-prod-github-runner-207 kernel: [67432.588059] Aug 23 00:07:38 juju-e4d256-prod-github-runner-207 kernel: [67432.588905] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 00:07:38 juju-e4d256-prod-github-runner-207 kernel: [67432.589951] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:07:38 juju-e4d256-prod-github-runner-207 kernel: [67432.591035] ? _raw_spin_lock+0x22/0x30 Aug 23 00:07:38 juju-e4d256-prod-github-runner-207 kernel: [67432.591987] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:07:38 juju-e4d256-prod-github-runner-207 kernel: [67432.593014] direct_page_fault+0x206/0x310 [kvm] Aug 23 00:07:38 juju-e4d256-prod-github-runner-207 kernel: [67432.594048] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 00:07:38 juju-e4d256-prod-github-runner-207 kernel: [67432.595081] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 00:07:38 juju-e4d256-prod-github-runner-207 kernel: [67432.596094] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 00:07:38 juju-e4d256-prod-github-runner-207 kernel: [67432.597072] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 00:07:38 juju-e4d256-prod-github-runner-207 kernel: [67432.598024] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 00:07:38 juju-e4d256-prod-github-runner-207 kernel: [67432.599036] handle_exit+0x98/0x230 [kvm_amd] Aug 23 00:07:38 juju-e4d256-prod-github-runner-207 kernel: [67432.599949] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 00:07:38 juju-e4d256-prod-github-runner-207 kernel: [67432.600870] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 00:07:38 juju-e4d256-prod-github-runner-207 kernel: [67432.601806] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 00:07:38 juju-e4d256-prod-github-runner-207 kernel: [67432.602739] vcpu_run+0x62/0x2c0 [kvm] Aug 23 00:07:38 juju-e4d256-prod-github-runner-207 kernel: [67432.603559] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 00:07:38 juju-e4d256-prod-github-runner-207 kernel: [67432.604377] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 00:07:38 juju-e4d256-prod-github-runner-207 kernel: [67432.605254] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 00:07:38 juju-e4d256-prod-github-runner-207 kernel: [67432.606070] ? __seccomp_filter+0x4a/0x4a0 Aug 23 00:07:38 juju-e4d256-prod-github-runner-207 kernel: [67432.606848] ? __fget_files+0x86/0xc0 Aug 23 00:07:38 juju-e4d256-prod-github-runner-207 kernel: [67432.607560] __x64_sys_ioctl+0x95/0xd0 Aug 23 00:07:38 juju-e4d256-prod-github-runner-207 kernel: [67432.608275] do_syscall_64+0x5c/0xc0 Aug 23 00:07:38 juju-e4d256-prod-github-runner-207 kernel: [67432.608946] ? do_futex+0x162/0x1f0 Aug 23 00:07:38 juju-e4d256-prod-github-runner-207 kernel: [67432.609601] ? __x64_sys_futex+0x78/0x1e0 Aug 23 00:07:38 juju-e4d256-prod-github-runner-207 kernel: [67432.610282] ? __secure_computing+0xa9/0x120 Aug 23 00:07:38 juju-e4d256-prod-github-runner-207 kernel: [67432.611007] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 00:07:38 juju-e4d256-prod-github-runner-207 kernel: [67432.611779] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:07:38 juju-e4d256-prod-github-runner-207 kernel: [67432.612510] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:07:38 juju-e4d256-prod-github-runner-207 kernel: [67432.613242] ? do_syscall_64+0x69/0xc0 Aug 23 00:07:38 juju-e4d256-prod-github-runner-207 kernel: [67432.613910] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:07:38 juju-e4d256-prod-github-runner-207 kernel: [67432.614666] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:07:38 juju-e4d256-prod-github-runner-207 kernel: [67432.615371] ? do_syscall_64+0x69/0xc0 Aug 23 00:07:38 juju-e4d256-prod-github-runner-207 kernel: [67432.616004] ? do_syscall_64+0x69/0xc0 Aug 23 00:07:38 juju-e4d256-prod-github-runner-207 kernel: [67432.616634] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 00:07:38 juju-e4d256-prod-github-runner-207 kernel: [67432.617356] RIP: 0033:0x7faa5d0edaff Aug 23 00:07:38 juju-e4d256-prod-github-runner-207 kernel: [67432.617991] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 00:07:38 juju-e4d256-prod-github-runner-207 kernel: [67432.620063] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 00:07:38 juju-e4d256-prod-github-runner-207 kernel: [67432.620988] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 00:07:38 juju-e4d256-prod-github-runner-207 kernel: [67432.621889] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 00:07:38 juju-e4d256-prod-github-runner-207 kernel: [67432.622811] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 00:07:38 juju-e4d256-prod-github-runner-207 kernel: [67432.623739] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 00:07:38 juju-e4d256-prod-github-runner-207 kernel: [67432.624643] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 00:07:38 juju-e4d256-prod-github-runner-207 kernel: [67432.625553] Aug 23 00:08:06 juju-e4d256-prod-github-runner-207 kernel: [67460.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 62719s! [qemu-system-x86:6715] Aug 23 00:08:06 juju-e4d256-prod-github-runner-207 kernel: [67460.543160] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 00:08:06 juju-e4d256-prod-github-runner-207 kernel: [67460.543231] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 00:08:06 juju-e4d256-prod-github-runner-207 kernel: [67460.555839] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 00:08:06 juju-e4d256-prod-github-runner-207 kernel: [67460.557240] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 00:08:06 juju-e4d256-prod-github-runner-207 kernel: [67460.558501] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:08:06 juju-e4d256-prod-github-runner-207 kernel: [67460.559563] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 00:08:06 juju-e4d256-prod-github-runner-207 kernel: [67460.562175] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 00:08:06 juju-e4d256-prod-github-runner-207 kernel: [67460.563232] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 00:08:06 juju-e4d256-prod-github-runner-207 kernel: [67460.564417] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 00:08:06 juju-e4d256-prod-github-runner-207 kernel: [67460.565581] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 00:08:06 juju-e4d256-prod-github-runner-207 kernel: [67460.566782] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 00:08:06 juju-e4d256-prod-github-runner-207 kernel: [67460.567998] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 00:08:06 juju-e4d256-prod-github-runner-207 kernel: [67460.569165] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 00:08:06 juju-e4d256-prod-github-runner-207 kernel: [67460.570411] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 00:08:06 juju-e4d256-prod-github-runner-207 kernel: [67460.571573] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 00:08:06 juju-e4d256-prod-github-runner-207 kernel: [67460.572824] Call Trace: Aug 23 00:08:06 juju-e4d256-prod-github-runner-207 kernel: [67460.573762] Aug 23 00:08:06 juju-e4d256-prod-github-runner-207 kernel: [67460.574668] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:08:06 juju-e4d256-prod-github-runner-207 kernel: [67460.575706] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:08:06 juju-e4d256-prod-github-runner-207 kernel: [67460.576726] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:08:06 juju-e4d256-prod-github-runner-207 kernel: [67460.577801] ? show_regs.part.0+0x23/0x29 Aug 23 00:08:06 juju-e4d256-prod-github-runner-207 kernel: [67460.578829] ? show_regs.cold+0x8/0xd Aug 23 00:08:06 juju-e4d256-prod-github-runner-207 kernel: [67460.579813] ? watchdog_timer_fn+0x1be/0x220 Aug 23 00:08:06 juju-e4d256-prod-github-runner-207 kernel: [67460.580816] ? lockup_detector_update_enable+0x60/0x60 Aug 23 00:08:06 juju-e4d256-prod-github-runner-207 kernel: [67460.581875] ? __hrtimer_run_queues+0x107/0x230 Aug 23 00:08:06 juju-e4d256-prod-github-runner-207 kernel: [67460.582983] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 00:08:06 juju-e4d256-prod-github-runner-207 kernel: [67460.584032] ? hrtimer_interrupt+0x101/0x220 Aug 23 00:08:06 juju-e4d256-prod-github-runner-207 kernel: [67460.585062] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 00:08:06 juju-e4d256-prod-github-runner-207 kernel: [67460.586156] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 00:08:06 juju-e4d256-prod-github-runner-207 kernel: [67460.587235] Aug 23 00:08:06 juju-e4d256-prod-github-runner-207 kernel: [67460.588106] Aug 23 00:08:06 juju-e4d256-prod-github-runner-207 kernel: [67460.588962] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 00:08:06 juju-e4d256-prod-github-runner-207 kernel: [67460.590001] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:08:06 juju-e4d256-prod-github-runner-207 kernel: [67460.591070] ? _raw_spin_lock+0x22/0x30 Aug 23 00:08:06 juju-e4d256-prod-github-runner-207 kernel: [67460.592016] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:08:06 juju-e4d256-prod-github-runner-207 kernel: [67460.593040] direct_page_fault+0x206/0x310 [kvm] Aug 23 00:08:06 juju-e4d256-prod-github-runner-207 kernel: [67460.594067] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 00:08:06 juju-e4d256-prod-github-runner-207 kernel: [67460.595088] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 00:08:06 juju-e4d256-prod-github-runner-207 kernel: [67460.596091] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 00:08:06 juju-e4d256-prod-github-runner-207 kernel: [67460.597067] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 00:08:06 juju-e4d256-prod-github-runner-207 kernel: [67460.598014] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 00:08:06 juju-e4d256-prod-github-runner-207 kernel: [67460.599036] handle_exit+0x98/0x230 [kvm_amd] Aug 23 00:08:06 juju-e4d256-prod-github-runner-207 kernel: [67460.599931] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 00:08:06 juju-e4d256-prod-github-runner-207 kernel: [67460.600856] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 00:08:06 juju-e4d256-prod-github-runner-207 kernel: [67460.601781] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 00:08:06 juju-e4d256-prod-github-runner-207 kernel: [67460.602706] vcpu_run+0x62/0x2c0 [kvm] Aug 23 00:08:06 juju-e4d256-prod-github-runner-207 kernel: [67460.603521] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 00:08:06 juju-e4d256-prod-github-runner-207 kernel: [67460.604424] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 00:08:06 juju-e4d256-prod-github-runner-207 kernel: [67460.605358] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 00:08:06 juju-e4d256-prod-github-runner-207 kernel: [67460.606186] ? __seccomp_filter+0x4a/0x4a0 Aug 23 00:08:06 juju-e4d256-prod-github-runner-207 kernel: [67460.606930] ? __fget_files+0x86/0xc0 Aug 23 00:08:06 juju-e4d256-prod-github-runner-207 kernel: [67460.607633] __x64_sys_ioctl+0x95/0xd0 Aug 23 00:08:06 juju-e4d256-prod-github-runner-207 kernel: [67460.608374] do_syscall_64+0x5c/0xc0 Aug 23 00:08:06 juju-e4d256-prod-github-runner-207 kernel: [67460.609078] ? do_futex+0x162/0x1f0 Aug 23 00:08:06 juju-e4d256-prod-github-runner-207 kernel: [67460.609749] ? __x64_sys_futex+0x78/0x1e0 Aug 23 00:08:06 juju-e4d256-prod-github-runner-207 kernel: [67460.610446] ? __secure_computing+0xa9/0x120 Aug 23 00:08:06 juju-e4d256-prod-github-runner-207 kernel: [67460.611139] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 00:08:06 juju-e4d256-prod-github-runner-207 kernel: [67460.611908] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:08:06 juju-e4d256-prod-github-runner-207 kernel: [67460.612654] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:08:06 juju-e4d256-prod-github-runner-207 kernel: [67460.613414] ? do_syscall_64+0x69/0xc0 Aug 23 00:08:06 juju-e4d256-prod-github-runner-207 kernel: [67460.614112] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:08:06 juju-e4d256-prod-github-runner-207 kernel: [67460.614839] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:08:06 juju-e4d256-prod-github-runner-207 kernel: [67460.615633] ? do_syscall_64+0x69/0xc0 Aug 23 00:08:06 juju-e4d256-prod-github-runner-207 kernel: [67460.616283] ? do_syscall_64+0x69/0xc0 Aug 23 00:08:06 juju-e4d256-prod-github-runner-207 kernel: [67460.616929] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 00:08:06 juju-e4d256-prod-github-runner-207 kernel: [67460.617642] RIP: 0033:0x7faa5d0edaff Aug 23 00:08:06 juju-e4d256-prod-github-runner-207 kernel: [67460.618283] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 00:08:06 juju-e4d256-prod-github-runner-207 kernel: [67460.620309] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 00:08:06 juju-e4d256-prod-github-runner-207 kernel: [67460.621257] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 00:08:06 juju-e4d256-prod-github-runner-207 kernel: [67460.622164] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 00:08:06 juju-e4d256-prod-github-runner-207 kernel: [67460.623070] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 00:08:06 juju-e4d256-prod-github-runner-207 kernel: [67460.624009] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 00:08:06 juju-e4d256-prod-github-runner-207 kernel: [67460.625000] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 00:08:06 juju-e4d256-prod-github-runner-207 kernel: [67460.625979] Aug 23 00:08:34 juju-e4d256-prod-github-runner-207 kernel: [67488.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 62745s! [qemu-system-x86:6715] Aug 23 00:08:34 juju-e4d256-prod-github-runner-207 kernel: [67488.544102] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 00:08:34 juju-e4d256-prod-github-runner-207 kernel: [67488.544403] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 00:08:34 juju-e4d256-prod-github-runner-207 kernel: [67488.556718] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 00:08:34 juju-e4d256-prod-github-runner-207 kernel: [67488.558006] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 00:08:34 juju-e4d256-prod-github-runner-207 kernel: [67488.559254] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:08:34 juju-e4d256-prod-github-runner-207 kernel: [67488.560316] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 00:08:34 juju-e4d256-prod-github-runner-207 kernel: [67488.562907] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 00:08:34 juju-e4d256-prod-github-runner-207 kernel: [67488.563950] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 00:08:34 juju-e4d256-prod-github-runner-207 kernel: [67488.565113] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 00:08:34 juju-e4d256-prod-github-runner-207 kernel: [67488.566309] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 00:08:34 juju-e4d256-prod-github-runner-207 kernel: [67488.567491] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 00:08:34 juju-e4d256-prod-github-runner-207 kernel: [67488.568663] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 00:08:34 juju-e4d256-prod-github-runner-207 kernel: [67488.569858] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 00:08:34 juju-e4d256-prod-github-runner-207 kernel: [67488.571379] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 00:08:34 juju-e4d256-prod-github-runner-207 kernel: [67488.572478] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 00:08:34 juju-e4d256-prod-github-runner-207 kernel: [67488.573675] Call Trace: Aug 23 00:08:34 juju-e4d256-prod-github-runner-207 kernel: [67488.574610] Aug 23 00:08:34 juju-e4d256-prod-github-runner-207 kernel: [67488.575508] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:08:34 juju-e4d256-prod-github-runner-207 kernel: [67488.576535] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:08:34 juju-e4d256-prod-github-runner-207 kernel: [67488.577559] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:08:34 juju-e4d256-prod-github-runner-207 kernel: [67488.578737] ? show_regs.part.0+0x23/0x29 Aug 23 00:08:34 juju-e4d256-prod-github-runner-207 kernel: [67488.579740] ? show_regs.cold+0x8/0xd Aug 23 00:08:34 juju-e4d256-prod-github-runner-207 kernel: [67488.580709] ? watchdog_timer_fn+0x1be/0x220 Aug 23 00:08:34 juju-e4d256-prod-github-runner-207 kernel: [67488.581729] ? lockup_detector_update_enable+0x60/0x60 Aug 23 00:08:34 juju-e4d256-prod-github-runner-207 kernel: [67488.582819] ? __hrtimer_run_queues+0x107/0x230 Aug 23 00:08:34 juju-e4d256-prod-github-runner-207 kernel: [67488.583847] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 00:08:34 juju-e4d256-prod-github-runner-207 kernel: [67488.584877] ? hrtimer_interrupt+0x101/0x220 Aug 23 00:08:34 juju-e4d256-prod-github-runner-207 kernel: [67488.585911] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 00:08:34 juju-e4d256-prod-github-runner-207 kernel: [67488.586981] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 00:08:34 juju-e4d256-prod-github-runner-207 kernel: [67488.588029] Aug 23 00:08:34 juju-e4d256-prod-github-runner-207 kernel: [67488.588884] Aug 23 00:08:34 juju-e4d256-prod-github-runner-207 kernel: [67488.589724] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 00:08:34 juju-e4d256-prod-github-runner-207 kernel: [67488.590765] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:08:34 juju-e4d256-prod-github-runner-207 kernel: [67488.591824] ? _raw_spin_lock+0x22/0x30 Aug 23 00:08:34 juju-e4d256-prod-github-runner-207 kernel: [67488.592781] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:08:34 juju-e4d256-prod-github-runner-207 kernel: [67488.593817] direct_page_fault+0x206/0x310 [kvm] Aug 23 00:08:34 juju-e4d256-prod-github-runner-207 kernel: [67488.594839] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 00:08:34 juju-e4d256-prod-github-runner-207 kernel: [67488.595899] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 00:08:34 juju-e4d256-prod-github-runner-207 kernel: [67488.596921] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 00:08:34 juju-e4d256-prod-github-runner-207 kernel: [67488.597960] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 00:08:34 juju-e4d256-prod-github-runner-207 kernel: [67488.598921] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 00:08:34 juju-e4d256-prod-github-runner-207 kernel: [67488.599916] handle_exit+0x98/0x230 [kvm_amd] Aug 23 00:08:34 juju-e4d256-prod-github-runner-207 kernel: [67488.600818] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 00:08:34 juju-e4d256-prod-github-runner-207 kernel: [67488.601736] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 00:08:34 juju-e4d256-prod-github-runner-207 kernel: [67488.602683] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 00:08:34 juju-e4d256-prod-github-runner-207 kernel: [67488.603610] vcpu_run+0x62/0x2c0 [kvm] Aug 23 00:08:34 juju-e4d256-prod-github-runner-207 kernel: [67488.604430] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 00:08:34 juju-e4d256-prod-github-runner-207 kernel: [67488.605247] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 00:08:34 juju-e4d256-prod-github-runner-207 kernel: [67488.606128] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 00:08:34 juju-e4d256-prod-github-runner-207 kernel: [67488.606938] ? __seccomp_filter+0x4a/0x4a0 Aug 23 00:08:34 juju-e4d256-prod-github-runner-207 kernel: [67488.607688] ? __fget_files+0x86/0xc0 Aug 23 00:08:34 juju-e4d256-prod-github-runner-207 kernel: [67488.608397] __x64_sys_ioctl+0x95/0xd0 Aug 23 00:08:34 juju-e4d256-prod-github-runner-207 kernel: [67488.609094] do_syscall_64+0x5c/0xc0 Aug 23 00:08:34 juju-e4d256-prod-github-runner-207 kernel: [67488.609784] ? do_futex+0x162/0x1f0 Aug 23 00:08:34 juju-e4d256-prod-github-runner-207 kernel: [67488.610443] ? __x64_sys_futex+0x78/0x1e0 Aug 23 00:08:34 juju-e4d256-prod-github-runner-207 kernel: [67488.611128] ? __secure_computing+0xa9/0x120 Aug 23 00:08:34 juju-e4d256-prod-github-runner-207 kernel: [67488.611818] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 00:08:34 juju-e4d256-prod-github-runner-207 kernel: [67488.612582] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:08:34 juju-e4d256-prod-github-runner-207 kernel: [67488.613310] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:08:34 juju-e4d256-prod-github-runner-207 kernel: [67488.614123] ? do_syscall_64+0x69/0xc0 Aug 23 00:08:34 juju-e4d256-prod-github-runner-207 kernel: [67488.614774] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:08:34 juju-e4d256-prod-github-runner-207 kernel: [67488.615478] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:08:34 juju-e4d256-prod-github-runner-207 kernel: [67488.616176] ? do_syscall_64+0x69/0xc0 Aug 23 00:08:34 juju-e4d256-prod-github-runner-207 kernel: [67488.616814] ? do_syscall_64+0x69/0xc0 Aug 23 00:08:34 juju-e4d256-prod-github-runner-207 kernel: [67488.617444] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 00:08:34 juju-e4d256-prod-github-runner-207 kernel: [67488.618166] RIP: 0033:0x7faa5d0edaff Aug 23 00:08:34 juju-e4d256-prod-github-runner-207 kernel: [67488.618843] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 00:08:34 juju-e4d256-prod-github-runner-207 kernel: [67488.620857] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 00:08:34 juju-e4d256-prod-github-runner-207 kernel: [67488.621792] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 00:08:34 juju-e4d256-prod-github-runner-207 kernel: [67488.622692] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 00:08:34 juju-e4d256-prod-github-runner-207 kernel: [67488.623581] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 00:08:34 juju-e4d256-prod-github-runner-207 kernel: [67488.624475] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 00:08:34 juju-e4d256-prod-github-runner-207 kernel: [67488.625378] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 00:08:34 juju-e4d256-prod-github-runner-207 kernel: [67488.626279] Aug 23 00:08:47 juju-e4d256-prod-github-runner-207 kernel: [67501.688711] rcu: INFO: rcu_sched self-detected stall on CPU Aug 23 00:08:47 juju-e4d256-prod-github-runner-207 kernel: [67501.689714] rcu: 1-....: (16793022 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=8107514 Aug 23 00:08:47 juju-e4d256-prod-github-runner-207 kernel: [67501.690877] (t=16846122 jiffies g=23269 q=58734) Aug 23 00:08:47 juju-e4d256-prod-github-runner-207 kernel: [67501.691689] NMI backtrace for cpu 1 Aug 23 00:08:47 juju-e4d256-prod-github-runner-207 kernel: [67501.692403] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 00:08:47 juju-e4d256-prod-github-runner-207 kernel: [67501.693510] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 00:08:47 juju-e4d256-prod-github-runner-207 kernel: [67501.694652] Call Trace: Aug 23 00:08:47 juju-e4d256-prod-github-runner-207 kernel: [67501.695361] Aug 23 00:08:47 juju-e4d256-prod-github-runner-207 kernel: [67501.696269] show_stack+0x52/0x5c Aug 23 00:08:47 juju-e4d256-prod-github-runner-207 kernel: [67501.697450] dump_stack_lvl+0x4a/0x63 Aug 23 00:08:47 juju-e4d256-prod-github-runner-207 kernel: [67501.698720] dump_stack+0x10/0x16 Aug 23 00:08:47 juju-e4d256-prod-github-runner-207 kernel: [67501.699976] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 23 00:08:47 juju-e4d256-prod-github-runner-207 kernel: [67501.701301] ? lapic_can_unplug_cpu+0x90/0x90 Aug 23 00:08:47 juju-e4d256-prod-github-runner-207 kernel: [67501.702604] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 23 00:08:47 juju-e4d256-prod-github-runner-207 kernel: [67501.703983] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 23 00:08:47 juju-e4d256-prod-github-runner-207 kernel: [67501.705371] trigger_single_cpu_backtrace+0x44/0x4f Aug 23 00:08:47 juju-e4d256-prod-github-runner-207 kernel: [67501.706735] rcu_dump_cpu_stacks+0x102/0x149 Aug 23 00:08:47 juju-e4d256-prod-github-runner-207 kernel: [67501.708022] print_cpu_stall.cold+0x2f/0xe2 Aug 23 00:08:47 juju-e4d256-prod-github-runner-207 kernel: [67501.709301] ? timekeeping_update+0xf7/0x150 Aug 23 00:08:47 juju-e4d256-prod-github-runner-207 kernel: [67501.710589] check_cpu_stall+0x109/0x270 Aug 23 00:08:47 juju-e4d256-prod-github-runner-207 kernel: [67501.711755] rcu_sched_clock_irq+0x9a/0x250 Aug 23 00:08:47 juju-e4d256-prod-github-runner-207 kernel: [67501.712701] update_process_times+0x94/0xd0 Aug 23 00:08:47 juju-e4d256-prod-github-runner-207 kernel: [67501.713485] tick_sched_handle+0x29/0x70 Aug 23 00:08:47 juju-e4d256-prod-github-runner-207 kernel: [67501.714292] tick_sched_timer+0x8c/0xc0 Aug 23 00:08:47 juju-e4d256-prod-github-runner-207 kernel: [67501.715117] ? tick_nohz_handler+0xb0/0xb0 Aug 23 00:08:47 juju-e4d256-prod-github-runner-207 kernel: [67501.715894] __hrtimer_run_queues+0x107/0x230 Aug 23 00:08:47 juju-e4d256-prod-github-runner-207 kernel: [67501.716680] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 00:08:47 juju-e4d256-prod-github-runner-207 kernel: [67501.717487] hrtimer_interrupt+0x101/0x220 Aug 23 00:08:47 juju-e4d256-prod-github-runner-207 kernel: [67501.718275] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 00:08:47 juju-e4d256-prod-github-runner-207 kernel: [67501.719103] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 00:08:47 juju-e4d256-prod-github-runner-207 kernel: [67501.719917] Aug 23 00:08:47 juju-e4d256-prod-github-runner-207 kernel: [67501.720559] Aug 23 00:08:47 juju-e4d256-prod-github-runner-207 kernel: [67501.721190] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 00:08:47 juju-e4d256-prod-github-runner-207 kernel: [67501.722031] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:08:47 juju-e4d256-prod-github-runner-207 kernel: [67501.722929] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 00:08:47 juju-e4d256-prod-github-runner-207 kernel: [67501.725146] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 00:08:47 juju-e4d256-prod-github-runner-207 kernel: [67501.726042] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 00:08:47 juju-e4d256-prod-github-runner-207 kernel: [67501.727041] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 00:08:47 juju-e4d256-prod-github-runner-207 kernel: [67501.728030] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 00:08:47 juju-e4d256-prod-github-runner-207 kernel: [67501.728998] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 00:08:47 juju-e4d256-prod-github-runner-207 kernel: [67501.729995] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 00:08:47 juju-e4d256-prod-github-runner-207 kernel: [67501.730972] ? _raw_spin_lock+0x22/0x30 Aug 23 00:08:47 juju-e4d256-prod-github-runner-207 kernel: [67501.731737] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:08:47 juju-e4d256-prod-github-runner-207 kernel: [67501.732579] direct_page_fault+0x206/0x310 [kvm] Aug 23 00:08:47 juju-e4d256-prod-github-runner-207 kernel: [67501.733429] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 00:08:47 juju-e4d256-prod-github-runner-207 kernel: [67501.734284] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 00:08:47 juju-e4d256-prod-github-runner-207 kernel: [67501.735110] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 00:08:47 juju-e4d256-prod-github-runner-207 kernel: [67501.735920] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 00:08:47 juju-e4d256-prod-github-runner-207 kernel: [67501.736712] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 00:08:47 juju-e4d256-prod-github-runner-207 kernel: [67501.737534] handle_exit+0x98/0x230 [kvm_amd] Aug 23 00:08:47 juju-e4d256-prod-github-runner-207 kernel: [67501.738333] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 00:08:47 juju-e4d256-prod-github-runner-207 kernel: [67501.739126] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 00:08:47 juju-e4d256-prod-github-runner-207 kernel: [67501.739971] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 00:08:47 juju-e4d256-prod-github-runner-207 kernel: [67501.741243] vcpu_run+0x62/0x2c0 [kvm] Aug 23 00:08:47 juju-e4d256-prod-github-runner-207 kernel: [67501.742422] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 00:08:47 juju-e4d256-prod-github-runner-207 kernel: [67501.743632] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 00:08:47 juju-e4d256-prod-github-runner-207 kernel: [67501.745229] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 00:08:47 juju-e4d256-prod-github-runner-207 kernel: [67501.746506] ? __seccomp_filter+0x4a/0x4a0 Aug 23 00:08:47 juju-e4d256-prod-github-runner-207 kernel: [67501.747709] ? __fget_files+0x86/0xc0 Aug 23 00:08:47 juju-e4d256-prod-github-runner-207 kernel: [67501.748837] __x64_sys_ioctl+0x95/0xd0 Aug 23 00:08:47 juju-e4d256-prod-github-runner-207 kernel: [67501.750035] do_syscall_64+0x5c/0xc0 Aug 23 00:08:47 juju-e4d256-prod-github-runner-207 kernel: [67501.751146] ? do_futex+0x162/0x1f0 Aug 23 00:08:47 juju-e4d256-prod-github-runner-207 kernel: [67501.752260] ? __x64_sys_futex+0x78/0x1e0 Aug 23 00:08:47 juju-e4d256-prod-github-runner-207 kernel: [67501.753418] ? __secure_computing+0xa9/0x120 Aug 23 00:08:47 juju-e4d256-prod-github-runner-207 kernel: [67501.754614] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 00:08:47 juju-e4d256-prod-github-runner-207 kernel: [67501.755927] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:08:47 juju-e4d256-prod-github-runner-207 kernel: [67501.757161] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:08:47 juju-e4d256-prod-github-runner-207 kernel: [67501.758281] ? do_syscall_64+0x69/0xc0 Aug 23 00:08:47 juju-e4d256-prod-github-runner-207 kernel: [67501.759050] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:08:47 juju-e4d256-prod-github-runner-207 kernel: [67501.759818] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:08:47 juju-e4d256-prod-github-runner-207 kernel: [67501.760603] ? do_syscall_64+0x69/0xc0 Aug 23 00:08:47 juju-e4d256-prod-github-runner-207 kernel: [67501.761310] ? do_syscall_64+0x69/0xc0 Aug 23 00:08:47 juju-e4d256-prod-github-runner-207 kernel: [67501.762052] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 00:08:47 juju-e4d256-prod-github-runner-207 kernel: [67501.762849] RIP: 0033:0x7faa5d0edaff Aug 23 00:08:47 juju-e4d256-prod-github-runner-207 kernel: [67501.763663] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 00:08:47 juju-e4d256-prod-github-runner-207 kernel: [67501.766116] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 00:08:47 juju-e4d256-prod-github-runner-207 kernel: [67501.767245] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 00:08:47 juju-e4d256-prod-github-runner-207 kernel: [67501.768331] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 00:08:47 juju-e4d256-prod-github-runner-207 kernel: [67501.769409] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 00:08:47 juju-e4d256-prod-github-runner-207 kernel: [67501.770497] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 00:08:47 juju-e4d256-prod-github-runner-207 kernel: [67501.771559] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 00:08:47 juju-e4d256-prod-github-runner-207 kernel: [67501.772611] Aug 23 00:09:14 juju-e4d256-prod-github-runner-207 kernel: [67528.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 62782s! [qemu-system-x86:6715] Aug 23 00:09:14 juju-e4d256-prod-github-runner-207 kernel: [67528.543115] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 00:09:14 juju-e4d256-prod-github-runner-207 kernel: [67528.543188] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 00:09:14 juju-e4d256-prod-github-runner-207 kernel: [67528.555381] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 00:09:14 juju-e4d256-prod-github-runner-207 kernel: [67528.556649] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 00:09:14 juju-e4d256-prod-github-runner-207 kernel: [67528.557935] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:09:14 juju-e4d256-prod-github-runner-207 kernel: [67528.559010] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 00:09:14 juju-e4d256-prod-github-runner-207 kernel: [67528.561569] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 00:09:14 juju-e4d256-prod-github-runner-207 kernel: [67528.562642] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 00:09:14 juju-e4d256-prod-github-runner-207 kernel: [67528.563828] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 00:09:14 juju-e4d256-prod-github-runner-207 kernel: [67528.564998] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 00:09:14 juju-e4d256-prod-github-runner-207 kernel: [67528.566188] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 00:09:14 juju-e4d256-prod-github-runner-207 kernel: [67528.567349] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 00:09:14 juju-e4d256-prod-github-runner-207 kernel: [67528.568578] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 00:09:14 juju-e4d256-prod-github-runner-207 kernel: [67528.569868] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 00:09:14 juju-e4d256-prod-github-runner-207 kernel: [67528.570969] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 00:09:14 juju-e4d256-prod-github-runner-207 kernel: [67528.572263] Call Trace: Aug 23 00:09:14 juju-e4d256-prod-github-runner-207 kernel: [67528.573229] Aug 23 00:09:14 juju-e4d256-prod-github-runner-207 kernel: [67528.574175] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:09:14 juju-e4d256-prod-github-runner-207 kernel: [67528.575217] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:09:14 juju-e4d256-prod-github-runner-207 kernel: [67528.576242] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:09:14 juju-e4d256-prod-github-runner-207 kernel: [67528.577338] ? show_regs.part.0+0x23/0x29 Aug 23 00:09:14 juju-e4d256-prod-github-runner-207 kernel: [67528.578364] ? show_regs.cold+0x8/0xd Aug 23 00:09:14 juju-e4d256-prod-github-runner-207 kernel: [67528.579352] ? watchdog_timer_fn+0x1be/0x220 Aug 23 00:09:14 juju-e4d256-prod-github-runner-207 kernel: [67528.580368] ? lockup_detector_update_enable+0x60/0x60 Aug 23 00:09:14 juju-e4d256-prod-github-runner-207 kernel: [67528.581456] ? __hrtimer_run_queues+0x107/0x230 Aug 23 00:09:14 juju-e4d256-prod-github-runner-207 kernel: [67528.582492] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 00:09:14 juju-e4d256-prod-github-runner-207 kernel: [67528.583528] ? hrtimer_interrupt+0x101/0x220 Aug 23 00:09:14 juju-e4d256-prod-github-runner-207 kernel: [67528.584571] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 00:09:14 juju-e4d256-prod-github-runner-207 kernel: [67528.585664] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 00:09:14 juju-e4d256-prod-github-runner-207 kernel: [67528.586709] Aug 23 00:09:14 juju-e4d256-prod-github-runner-207 kernel: [67528.587564] Aug 23 00:09:14 juju-e4d256-prod-github-runner-207 kernel: [67528.588413] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 00:09:14 juju-e4d256-prod-github-runner-207 kernel: [67528.589478] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:09:14 juju-e4d256-prod-github-runner-207 kernel: [67528.590519] ? _raw_spin_lock+0x22/0x30 Aug 23 00:09:14 juju-e4d256-prod-github-runner-207 kernel: [67528.591507] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:09:14 juju-e4d256-prod-github-runner-207 kernel: [67528.592562] direct_page_fault+0x206/0x310 [kvm] Aug 23 00:09:14 juju-e4d256-prod-github-runner-207 kernel: [67528.593616] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 00:09:14 juju-e4d256-prod-github-runner-207 kernel: [67528.594647] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 00:09:14 juju-e4d256-prod-github-runner-207 kernel: [67528.595652] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 00:09:14 juju-e4d256-prod-github-runner-207 kernel: [67528.596626] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 00:09:14 juju-e4d256-prod-github-runner-207 kernel: [67528.597593] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 00:09:14 juju-e4d256-prod-github-runner-207 kernel: [67528.598588] handle_exit+0x98/0x230 [kvm_amd] Aug 23 00:09:14 juju-e4d256-prod-github-runner-207 kernel: [67528.599484] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 00:09:14 juju-e4d256-prod-github-runner-207 kernel: [67528.600413] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 00:09:14 juju-e4d256-prod-github-runner-207 kernel: [67528.601369] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 00:09:14 juju-e4d256-prod-github-runner-207 kernel: [67528.602474] vcpu_run+0x62/0x2c0 [kvm] Aug 23 00:09:14 juju-e4d256-prod-github-runner-207 kernel: [67528.603285] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 00:09:14 juju-e4d256-prod-github-runner-207 kernel: [67528.604109] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 00:09:14 juju-e4d256-prod-github-runner-207 kernel: [67528.605160] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 00:09:14 juju-e4d256-prod-github-runner-207 kernel: [67528.605999] ? __seccomp_filter+0x4a/0x4a0 Aug 23 00:09:14 juju-e4d256-prod-github-runner-207 kernel: [67528.606745] ? __fget_files+0x86/0xc0 Aug 23 00:09:14 juju-e4d256-prod-github-runner-207 kernel: [67528.607455] __x64_sys_ioctl+0x95/0xd0 Aug 23 00:09:14 juju-e4d256-prod-github-runner-207 kernel: [67528.608153] do_syscall_64+0x5c/0xc0 Aug 23 00:09:14 juju-e4d256-prod-github-runner-207 kernel: [67528.608823] ? do_futex+0x162/0x1f0 Aug 23 00:09:14 juju-e4d256-prod-github-runner-207 kernel: [67528.609507] ? __x64_sys_futex+0x78/0x1e0 Aug 23 00:09:14 juju-e4d256-prod-github-runner-207 kernel: [67528.610213] ? __secure_computing+0xa9/0x120 Aug 23 00:09:14 juju-e4d256-prod-github-runner-207 kernel: [67528.610909] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 00:09:14 juju-e4d256-prod-github-runner-207 kernel: [67528.611676] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:09:14 juju-e4d256-prod-github-runner-207 kernel: [67528.612401] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:09:14 juju-e4d256-prod-github-runner-207 kernel: [67528.613121] ? do_syscall_64+0x69/0xc0 Aug 23 00:09:14 juju-e4d256-prod-github-runner-207 kernel: [67528.613784] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:09:14 juju-e4d256-prod-github-runner-207 kernel: [67528.614508] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:09:14 juju-e4d256-prod-github-runner-207 kernel: [67528.615216] ? do_syscall_64+0x69/0xc0 Aug 23 00:09:14 juju-e4d256-prod-github-runner-207 kernel: [67528.615870] ? do_syscall_64+0x69/0xc0 Aug 23 00:09:14 juju-e4d256-prod-github-runner-207 kernel: [67528.616519] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 00:09:14 juju-e4d256-prod-github-runner-207 kernel: [67528.617242] RIP: 0033:0x7faa5d0edaff Aug 23 00:09:14 juju-e4d256-prod-github-runner-207 kernel: [67528.617902] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 00:09:14 juju-e4d256-prod-github-runner-207 kernel: [67528.619904] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 00:09:14 juju-e4d256-prod-github-runner-207 kernel: [67528.620834] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 00:09:14 juju-e4d256-prod-github-runner-207 kernel: [67528.621744] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 00:09:14 juju-e4d256-prod-github-runner-207 kernel: [67528.622643] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 00:09:14 juju-e4d256-prod-github-runner-207 kernel: [67528.623543] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 00:09:14 juju-e4d256-prod-github-runner-207 kernel: [67528.624440] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 00:09:14 juju-e4d256-prod-github-runner-207 kernel: [67528.625379] Aug 23 00:09:42 juju-e4d256-prod-github-runner-207 kernel: [67556.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 62808s! [qemu-system-x86:6715] Aug 23 00:09:42 juju-e4d256-prod-github-runner-207 kernel: [67556.543893] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 00:09:42 juju-e4d256-prod-github-runner-207 kernel: [67556.544216] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 00:09:42 juju-e4d256-prod-github-runner-207 kernel: [67556.556404] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 00:09:42 juju-e4d256-prod-github-runner-207 kernel: [67556.557682] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 00:09:42 juju-e4d256-prod-github-runner-207 kernel: [67556.558904] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:09:42 juju-e4d256-prod-github-runner-207 kernel: [67556.559957] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 00:09:42 juju-e4d256-prod-github-runner-207 kernel: [67556.562506] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 00:09:42 juju-e4d256-prod-github-runner-207 kernel: [67556.563660] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 00:09:42 juju-e4d256-prod-github-runner-207 kernel: [67556.564962] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 00:09:42 juju-e4d256-prod-github-runner-207 kernel: [67556.566259] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 00:09:42 juju-e4d256-prod-github-runner-207 kernel: [67556.567552] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 00:09:42 juju-e4d256-prod-github-runner-207 kernel: [67556.568846] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 00:09:42 juju-e4d256-prod-github-runner-207 kernel: [67556.570102] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 00:09:42 juju-e4d256-prod-github-runner-207 kernel: [67556.571343] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 00:09:42 juju-e4d256-prod-github-runner-207 kernel: [67556.572454] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 00:09:42 juju-e4d256-prod-github-runner-207 kernel: [67556.573653] Call Trace: Aug 23 00:09:42 juju-e4d256-prod-github-runner-207 kernel: [67556.574569] Aug 23 00:09:42 juju-e4d256-prod-github-runner-207 kernel: [67556.575471] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:09:42 juju-e4d256-prod-github-runner-207 kernel: [67556.576500] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:09:42 juju-e4d256-prod-github-runner-207 kernel: [67556.577543] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:09:42 juju-e4d256-prod-github-runner-207 kernel: [67556.578665] ? show_regs.part.0+0x23/0x29 Aug 23 00:09:42 juju-e4d256-prod-github-runner-207 kernel: [67556.579665] ? show_regs.cold+0x8/0xd Aug 23 00:09:42 juju-e4d256-prod-github-runner-207 kernel: [67556.580637] ? watchdog_timer_fn+0x1be/0x220 Aug 23 00:09:42 juju-e4d256-prod-github-runner-207 kernel: [67556.581664] ? lockup_detector_update_enable+0x60/0x60 Aug 23 00:09:42 juju-e4d256-prod-github-runner-207 kernel: [67556.582866] ? __hrtimer_run_queues+0x107/0x230 Aug 23 00:09:42 juju-e4d256-prod-github-runner-207 kernel: [67556.583895] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 00:09:42 juju-e4d256-prod-github-runner-207 kernel: [67556.585077] ? hrtimer_interrupt+0x101/0x220 Aug 23 00:09:42 juju-e4d256-prod-github-runner-207 kernel: [67556.586129] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 00:09:42 juju-e4d256-prod-github-runner-207 kernel: [67556.587200] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 00:09:42 juju-e4d256-prod-github-runner-207 kernel: [67556.588248] Aug 23 00:09:42 juju-e4d256-prod-github-runner-207 kernel: [67556.589122] Aug 23 00:09:42 juju-e4d256-prod-github-runner-207 kernel: [67556.589984] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 00:09:42 juju-e4d256-prod-github-runner-207 kernel: [67556.591025] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:09:42 juju-e4d256-prod-github-runner-207 kernel: [67556.592070] ? _raw_spin_lock+0x22/0x30 Aug 23 00:09:42 juju-e4d256-prod-github-runner-207 kernel: [67556.593034] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:09:42 juju-e4d256-prod-github-runner-207 kernel: [67556.594057] direct_page_fault+0x206/0x310 [kvm] Aug 23 00:09:42 juju-e4d256-prod-github-runner-207 kernel: [67556.595080] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 00:09:42 juju-e4d256-prod-github-runner-207 kernel: [67556.596094] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 00:09:42 juju-e4d256-prod-github-runner-207 kernel: [67556.597121] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 00:09:42 juju-e4d256-prod-github-runner-207 kernel: [67556.598131] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 00:09:42 juju-e4d256-prod-github-runner-207 kernel: [67556.599083] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 00:09:42 juju-e4d256-prod-github-runner-207 kernel: [67556.600063] handle_exit+0x98/0x230 [kvm_amd] Aug 23 00:09:42 juju-e4d256-prod-github-runner-207 kernel: [67556.600978] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 00:09:42 juju-e4d256-prod-github-runner-207 kernel: [67556.601896] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 00:09:42 juju-e4d256-prod-github-runner-207 kernel: [67556.602829] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 00:09:42 juju-e4d256-prod-github-runner-207 kernel: [67556.603727] vcpu_run+0x62/0x2c0 [kvm] Aug 23 00:09:42 juju-e4d256-prod-github-runner-207 kernel: [67556.604538] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 00:09:42 juju-e4d256-prod-github-runner-207 kernel: [67556.605368] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 00:09:42 juju-e4d256-prod-github-runner-207 kernel: [67556.606220] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 00:09:42 juju-e4d256-prod-github-runner-207 kernel: [67556.607024] ? __seccomp_filter+0x4a/0x4a0 Aug 23 00:09:42 juju-e4d256-prod-github-runner-207 kernel: [67556.607766] ? __fget_files+0x86/0xc0 Aug 23 00:09:42 juju-e4d256-prod-github-runner-207 kernel: [67556.608467] __x64_sys_ioctl+0x95/0xd0 Aug 23 00:09:42 juju-e4d256-prod-github-runner-207 kernel: [67556.609172] do_syscall_64+0x5c/0xc0 Aug 23 00:09:42 juju-e4d256-prod-github-runner-207 kernel: [67556.609836] ? do_futex+0x162/0x1f0 Aug 23 00:09:42 juju-e4d256-prod-github-runner-207 kernel: [67556.610483] ? __x64_sys_futex+0x78/0x1e0 Aug 23 00:09:42 juju-e4d256-prod-github-runner-207 kernel: [67556.611177] ? __secure_computing+0xa9/0x120 Aug 23 00:09:42 juju-e4d256-prod-github-runner-207 kernel: [67556.611931] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 00:09:42 juju-e4d256-prod-github-runner-207 kernel: [67556.612695] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:09:42 juju-e4d256-prod-github-runner-207 kernel: [67556.613444] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:09:42 juju-e4d256-prod-github-runner-207 kernel: [67556.614163] ? do_syscall_64+0x69/0xc0 Aug 23 00:09:42 juju-e4d256-prod-github-runner-207 kernel: [67556.614810] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:09:42 juju-e4d256-prod-github-runner-207 kernel: [67556.615513] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:09:42 juju-e4d256-prod-github-runner-207 kernel: [67556.616219] ? do_syscall_64+0x69/0xc0 Aug 23 00:09:42 juju-e4d256-prod-github-runner-207 kernel: [67556.616850] ? do_syscall_64+0x69/0xc0 Aug 23 00:09:42 juju-e4d256-prod-github-runner-207 kernel: [67556.617488] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 00:09:42 juju-e4d256-prod-github-runner-207 kernel: [67556.618201] RIP: 0033:0x7faa5d0edaff Aug 23 00:09:42 juju-e4d256-prod-github-runner-207 kernel: [67556.618851] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 00:09:42 juju-e4d256-prod-github-runner-207 kernel: [67556.620835] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 00:09:42 juju-e4d256-prod-github-runner-207 kernel: [67556.621759] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 00:09:42 juju-e4d256-prod-github-runner-207 kernel: [67556.622651] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 00:09:42 juju-e4d256-prod-github-runner-207 kernel: [67556.623575] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 00:09:42 juju-e4d256-prod-github-runner-207 kernel: [67556.624466] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 00:09:42 juju-e4d256-prod-github-runner-207 kernel: [67556.625414] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 00:09:42 juju-e4d256-prod-github-runner-207 kernel: [67556.626396] Aug 23 00:10:10 juju-e4d256-prod-github-runner-207 kernel: [67584.541981] watchdog: BUG: soft lockup - CPU#1 stuck for 62835s! [qemu-system-x86:6715] Aug 23 00:10:10 juju-e4d256-prod-github-runner-207 kernel: [67584.543443] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 00:10:10 juju-e4d256-prod-github-runner-207 kernel: [67584.543519] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 00:10:10 juju-e4d256-prod-github-runner-207 kernel: [67584.555999] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 00:10:10 juju-e4d256-prod-github-runner-207 kernel: [67584.557859] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 00:10:10 juju-e4d256-prod-github-runner-207 kernel: [67584.559170] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:10:10 juju-e4d256-prod-github-runner-207 kernel: [67584.560271] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 00:10:10 juju-e4d256-prod-github-runner-207 kernel: [67584.563272] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 00:10:10 juju-e4d256-prod-github-runner-207 kernel: [67584.564328] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 00:10:10 juju-e4d256-prod-github-runner-207 kernel: [67584.565551] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 00:10:10 juju-e4d256-prod-github-runner-207 kernel: [67584.566750] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 00:10:10 juju-e4d256-prod-github-runner-207 kernel: [67584.567910] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 00:10:10 juju-e4d256-prod-github-runner-207 kernel: [67584.569204] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 00:10:10 juju-e4d256-prod-github-runner-207 kernel: [67584.570435] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 00:10:10 juju-e4d256-prod-github-runner-207 kernel: [67584.571702] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 00:10:10 juju-e4d256-prod-github-runner-207 kernel: [67584.572850] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 00:10:10 juju-e4d256-prod-github-runner-207 kernel: [67584.574060] Call Trace: Aug 23 00:10:10 juju-e4d256-prod-github-runner-207 kernel: [67584.574977] Aug 23 00:10:10 juju-e4d256-prod-github-runner-207 kernel: [67584.575972] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:10:10 juju-e4d256-prod-github-runner-207 kernel: [67584.577062] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:10:10 juju-e4d256-prod-github-runner-207 kernel: [67584.578095] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:10:10 juju-e4d256-prod-github-runner-207 kernel: [67584.579182] ? show_regs.part.0+0x23/0x29 Aug 23 00:10:10 juju-e4d256-prod-github-runner-207 kernel: [67584.580192] ? show_regs.cold+0x8/0xd Aug 23 00:10:10 juju-e4d256-prod-github-runner-207 kernel: [67584.581263] ? watchdog_timer_fn+0x1be/0x220 Aug 23 00:10:10 juju-e4d256-prod-github-runner-207 kernel: [67584.582298] ? lockup_detector_update_enable+0x60/0x60 Aug 23 00:10:10 juju-e4d256-prod-github-runner-207 kernel: [67584.583404] ? __hrtimer_run_queues+0x107/0x230 Aug 23 00:10:10 juju-e4d256-prod-github-runner-207 kernel: [67584.584445] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 00:10:10 juju-e4d256-prod-github-runner-207 kernel: [67584.585497] ? hrtimer_interrupt+0x101/0x220 Aug 23 00:10:10 juju-e4d256-prod-github-runner-207 kernel: [67584.586515] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 00:10:10 juju-e4d256-prod-github-runner-207 kernel: [67584.587581] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 00:10:10 juju-e4d256-prod-github-runner-207 kernel: [67584.588639] Aug 23 00:10:10 juju-e4d256-prod-github-runner-207 kernel: [67584.589498] Aug 23 00:10:10 juju-e4d256-prod-github-runner-207 kernel: [67584.590375] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 00:10:10 juju-e4d256-prod-github-runner-207 kernel: [67584.591415] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:10:10 juju-e4d256-prod-github-runner-207 kernel: [67584.592543] ? _raw_spin_lock+0x22/0x30 Aug 23 00:10:10 juju-e4d256-prod-github-runner-207 kernel: [67584.593517] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:10:10 juju-e4d256-prod-github-runner-207 kernel: [67584.594538] direct_page_fault+0x206/0x310 [kvm] Aug 23 00:10:10 juju-e4d256-prod-github-runner-207 kernel: [67584.595565] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 00:10:10 juju-e4d256-prod-github-runner-207 kernel: [67584.596572] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 00:10:10 juju-e4d256-prod-github-runner-207 kernel: [67584.597600] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 00:10:10 juju-e4d256-prod-github-runner-207 kernel: [67584.598588] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 00:10:10 juju-e4d256-prod-github-runner-207 kernel: [67584.599536] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 00:10:10 juju-e4d256-prod-github-runner-207 kernel: [67584.600534] handle_exit+0x98/0x230 [kvm_amd] Aug 23 00:10:10 juju-e4d256-prod-github-runner-207 kernel: [67584.601488] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 00:10:10 juju-e4d256-prod-github-runner-207 kernel: [67584.602459] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 00:10:10 juju-e4d256-prod-github-runner-207 kernel: [67584.603402] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 00:10:10 juju-e4d256-prod-github-runner-207 kernel: [67584.604317] vcpu_run+0x62/0x2c0 [kvm] Aug 23 00:10:10 juju-e4d256-prod-github-runner-207 kernel: [67584.605160] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 00:10:10 juju-e4d256-prod-github-runner-207 kernel: [67584.606005] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 00:10:10 juju-e4d256-prod-github-runner-207 kernel: [67584.606883] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 00:10:10 juju-e4d256-prod-github-runner-207 kernel: [67584.607707] ? __seccomp_filter+0x4a/0x4a0 Aug 23 00:10:10 juju-e4d256-prod-github-runner-207 kernel: [67584.608458] ? __fget_files+0x86/0xc0 Aug 23 00:10:10 juju-e4d256-prod-github-runner-207 kernel: [67584.609182] __x64_sys_ioctl+0x95/0xd0 Aug 23 00:10:10 juju-e4d256-prod-github-runner-207 kernel: [67584.609894] do_syscall_64+0x5c/0xc0 Aug 23 00:10:10 juju-e4d256-prod-github-runner-207 kernel: [67584.610592] ? do_futex+0x162/0x1f0 Aug 23 00:10:10 juju-e4d256-prod-github-runner-207 kernel: [67584.611251] ? __x64_sys_futex+0x78/0x1e0 Aug 23 00:10:10 juju-e4d256-prod-github-runner-207 kernel: [67584.611972] ? __secure_computing+0xa9/0x120 Aug 23 00:10:10 juju-e4d256-prod-github-runner-207 kernel: [67584.612692] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 00:10:10 juju-e4d256-prod-github-runner-207 kernel: [67584.613455] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:10:10 juju-e4d256-prod-github-runner-207 kernel: [67584.614179] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:10:10 juju-e4d256-prod-github-runner-207 kernel: [67584.614904] ? do_syscall_64+0x69/0xc0 Aug 23 00:10:10 juju-e4d256-prod-github-runner-207 kernel: [67584.615577] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:10:10 juju-e4d256-prod-github-runner-207 kernel: [67584.616282] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:10:10 juju-e4d256-prod-github-runner-207 kernel: [67584.617018] ? do_syscall_64+0x69/0xc0 Aug 23 00:10:10 juju-e4d256-prod-github-runner-207 kernel: [67584.617660] ? do_syscall_64+0x69/0xc0 Aug 23 00:10:10 juju-e4d256-prod-github-runner-207 kernel: [67584.618283] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 00:10:10 juju-e4d256-prod-github-runner-207 kernel: [67584.618991] RIP: 0033:0x7faa5d0edaff Aug 23 00:10:10 juju-e4d256-prod-github-runner-207 kernel: [67584.619630] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 00:10:10 juju-e4d256-prod-github-runner-207 kernel: [67584.621676] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 00:10:10 juju-e4d256-prod-github-runner-207 kernel: [67584.622635] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 00:10:10 juju-e4d256-prod-github-runner-207 kernel: [67584.623526] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 00:10:10 juju-e4d256-prod-github-runner-207 kernel: [67584.624418] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 00:10:10 juju-e4d256-prod-github-runner-207 kernel: [67584.625326] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 00:10:10 juju-e4d256-prod-github-runner-207 kernel: [67584.626214] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 00:10:10 juju-e4d256-prod-github-runner-207 kernel: [67584.627107] Aug 23 00:10:38 juju-e4d256-prod-github-runner-207 kernel: [67612.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 62861s! [qemu-system-x86:6715] Aug 23 00:10:38 juju-e4d256-prod-github-runner-207 kernel: [67612.543127] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 00:10:38 juju-e4d256-prod-github-runner-207 kernel: [67612.543201] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 00:10:38 juju-e4d256-prod-github-runner-207 kernel: [67612.556081] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 00:10:38 juju-e4d256-prod-github-runner-207 kernel: [67612.557437] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 00:10:38 juju-e4d256-prod-github-runner-207 kernel: [67612.558777] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:10:38 juju-e4d256-prod-github-runner-207 kernel: [67612.559873] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 00:10:38 juju-e4d256-prod-github-runner-207 kernel: [67612.562538] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 00:10:38 juju-e4d256-prod-github-runner-207 kernel: [67612.563645] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 00:10:38 juju-e4d256-prod-github-runner-207 kernel: [67612.564857] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 00:10:38 juju-e4d256-prod-github-runner-207 kernel: [67612.566085] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 00:10:38 juju-e4d256-prod-github-runner-207 kernel: [67612.567268] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 00:10:38 juju-e4d256-prod-github-runner-207 kernel: [67612.568475] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 00:10:38 juju-e4d256-prod-github-runner-207 kernel: [67612.569665] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 00:10:38 juju-e4d256-prod-github-runner-207 kernel: [67612.570921] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 00:10:38 juju-e4d256-prod-github-runner-207 kernel: [67612.572055] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 00:10:38 juju-e4d256-prod-github-runner-207 kernel: [67612.573277] Call Trace: Aug 23 00:10:38 juju-e4d256-prod-github-runner-207 kernel: [67612.574226] Aug 23 00:10:38 juju-e4d256-prod-github-runner-207 kernel: [67612.575138] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:10:38 juju-e4d256-prod-github-runner-207 kernel: [67612.576282] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:10:38 juju-e4d256-prod-github-runner-207 kernel: [67612.577397] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:10:38 juju-e4d256-prod-github-runner-207 kernel: [67612.578540] ? show_regs.part.0+0x23/0x29 Aug 23 00:10:38 juju-e4d256-prod-github-runner-207 kernel: [67612.579606] ? show_regs.cold+0x8/0xd Aug 23 00:10:38 juju-e4d256-prod-github-runner-207 kernel: [67612.580720] ? watchdog_timer_fn+0x1be/0x220 Aug 23 00:10:38 juju-e4d256-prod-github-runner-207 kernel: [67612.581779] ? lockup_detector_update_enable+0x60/0x60 Aug 23 00:10:38 juju-e4d256-prod-github-runner-207 kernel: [67612.582901] ? __hrtimer_run_queues+0x107/0x230 Aug 23 00:10:38 juju-e4d256-prod-github-runner-207 kernel: [67612.584009] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 00:10:38 juju-e4d256-prod-github-runner-207 kernel: [67612.585125] ? hrtimer_interrupt+0x101/0x220 Aug 23 00:10:38 juju-e4d256-prod-github-runner-207 kernel: [67612.586160] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 00:10:38 juju-e4d256-prod-github-runner-207 kernel: [67612.587252] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 00:10:38 juju-e4d256-prod-github-runner-207 kernel: [67612.588335] Aug 23 00:10:38 juju-e4d256-prod-github-runner-207 kernel: [67612.589291] Aug 23 00:10:38 juju-e4d256-prod-github-runner-207 kernel: [67612.590156] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 00:10:38 juju-e4d256-prod-github-runner-207 kernel: [67612.591272] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:10:38 juju-e4d256-prod-github-runner-207 kernel: [67612.592410] ? _raw_spin_lock+0x22/0x30 Aug 23 00:10:38 juju-e4d256-prod-github-runner-207 kernel: [67612.593400] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:10:38 juju-e4d256-prod-github-runner-207 kernel: [67612.594540] direct_page_fault+0x206/0x310 [kvm] Aug 23 00:10:38 juju-e4d256-prod-github-runner-207 kernel: [67612.595591] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 00:10:38 juju-e4d256-prod-github-runner-207 kernel: [67612.596649] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 00:10:38 juju-e4d256-prod-github-runner-207 kernel: [67612.597666] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 00:10:38 juju-e4d256-prod-github-runner-207 kernel: [67612.598651] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 00:10:38 juju-e4d256-prod-github-runner-207 kernel: [67612.599636] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 00:10:38 juju-e4d256-prod-github-runner-207 kernel: [67612.600661] handle_exit+0x98/0x230 [kvm_amd] Aug 23 00:10:38 juju-e4d256-prod-github-runner-207 kernel: [67612.601603] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 00:10:38 juju-e4d256-prod-github-runner-207 kernel: [67612.602537] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 00:10:38 juju-e4d256-prod-github-runner-207 kernel: [67612.603501] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 00:10:38 juju-e4d256-prod-github-runner-207 kernel: [67612.604435] vcpu_run+0x62/0x2c0 [kvm] Aug 23 00:10:38 juju-e4d256-prod-github-runner-207 kernel: [67612.605259] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 00:10:38 juju-e4d256-prod-github-runner-207 kernel: [67612.606086] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 00:10:38 juju-e4d256-prod-github-runner-207 kernel: [67612.606962] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 00:10:38 juju-e4d256-prod-github-runner-207 kernel: [67612.607786] ? __seccomp_filter+0x4a/0x4a0 Aug 23 00:10:38 juju-e4d256-prod-github-runner-207 kernel: [67612.608565] ? __fget_files+0x86/0xc0 Aug 23 00:10:38 juju-e4d256-prod-github-runner-207 kernel: [67612.609287] __x64_sys_ioctl+0x95/0xd0 Aug 23 00:10:38 juju-e4d256-prod-github-runner-207 kernel: [67612.610018] do_syscall_64+0x5c/0xc0 Aug 23 00:10:38 juju-e4d256-prod-github-runner-207 kernel: [67612.610713] ? do_futex+0x162/0x1f0 Aug 23 00:10:38 juju-e4d256-prod-github-runner-207 kernel: [67612.611448] ? __x64_sys_futex+0x78/0x1e0 Aug 23 00:10:38 juju-e4d256-prod-github-runner-207 kernel: [67612.612181] ? __secure_computing+0xa9/0x120 Aug 23 00:10:38 juju-e4d256-prod-github-runner-207 kernel: [67612.612905] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 00:10:38 juju-e4d256-prod-github-runner-207 kernel: [67612.613687] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:10:38 juju-e4d256-prod-github-runner-207 kernel: [67612.614430] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:10:38 juju-e4d256-prod-github-runner-207 kernel: [67612.615202] ? do_syscall_64+0x69/0xc0 Aug 23 00:10:38 juju-e4d256-prod-github-runner-207 kernel: [67612.615877] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:10:38 juju-e4d256-prod-github-runner-207 kernel: [67612.616640] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:10:38 juju-e4d256-prod-github-runner-207 kernel: [67612.617385] ? do_syscall_64+0x69/0xc0 Aug 23 00:10:38 juju-e4d256-prod-github-runner-207 kernel: [67612.618061] ? do_syscall_64+0x69/0xc0 Aug 23 00:10:38 juju-e4d256-prod-github-runner-207 kernel: [67612.618703] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 00:10:38 juju-e4d256-prod-github-runner-207 kernel: [67612.619427] RIP: 0033:0x7faa5d0edaff Aug 23 00:10:38 juju-e4d256-prod-github-runner-207 kernel: [67612.620066] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 00:10:38 juju-e4d256-prod-github-runner-207 kernel: [67612.622134] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 00:10:38 juju-e4d256-prod-github-runner-207 kernel: [67612.623095] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 00:10:38 juju-e4d256-prod-github-runner-207 kernel: [67612.624096] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 00:10:38 juju-e4d256-prod-github-runner-207 kernel: [67612.625015] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 00:10:38 juju-e4d256-prod-github-runner-207 kernel: [67612.625925] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 00:10:38 juju-e4d256-prod-github-runner-207 kernel: [67612.626837] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 00:10:38 juju-e4d256-prod-github-runner-207 kernel: [67612.627759] Aug 23 00:11:06 juju-e4d256-prod-github-runner-207 kernel: [67640.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 62887s! [qemu-system-x86:6715] Aug 23 00:11:06 juju-e4d256-prod-github-runner-207 kernel: [67640.543138] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 00:11:06 juju-e4d256-prod-github-runner-207 kernel: [67640.543213] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 00:11:06 juju-e4d256-prod-github-runner-207 kernel: [67640.555448] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 00:11:06 juju-e4d256-prod-github-runner-207 kernel: [67640.556776] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 00:11:06 juju-e4d256-prod-github-runner-207 kernel: [67640.558061] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:11:06 juju-e4d256-prod-github-runner-207 kernel: [67640.559435] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 00:11:06 juju-e4d256-prod-github-runner-207 kernel: [67640.562368] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 00:11:06 juju-e4d256-prod-github-runner-207 kernel: [67640.563428] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 00:11:06 juju-e4d256-prod-github-runner-207 kernel: [67640.564628] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 00:11:06 juju-e4d256-prod-github-runner-207 kernel: [67640.565803] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 00:11:06 juju-e4d256-prod-github-runner-207 kernel: [67640.566975] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 00:11:06 juju-e4d256-prod-github-runner-207 kernel: [67640.568166] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 00:11:06 juju-e4d256-prod-github-runner-207 kernel: [67640.569361] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 00:11:06 juju-e4d256-prod-github-runner-207 kernel: [67640.570610] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 00:11:06 juju-e4d256-prod-github-runner-207 kernel: [67640.571715] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 00:11:06 juju-e4d256-prod-github-runner-207 kernel: [67640.572934] Call Trace: Aug 23 00:11:06 juju-e4d256-prod-github-runner-207 kernel: [67640.573879] Aug 23 00:11:06 juju-e4d256-prod-github-runner-207 kernel: [67640.574773] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:11:06 juju-e4d256-prod-github-runner-207 kernel: [67640.575801] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:11:06 juju-e4d256-prod-github-runner-207 kernel: [67640.576869] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:11:06 juju-e4d256-prod-github-runner-207 kernel: [67640.577958] ? show_regs.part.0+0x23/0x29 Aug 23 00:11:06 juju-e4d256-prod-github-runner-207 kernel: [67640.578955] ? show_regs.cold+0x8/0xd Aug 23 00:11:06 juju-e4d256-prod-github-runner-207 kernel: [67640.579956] ? watchdog_timer_fn+0x1be/0x220 Aug 23 00:11:06 juju-e4d256-prod-github-runner-207 kernel: [67640.580964] ? lockup_detector_update_enable+0x60/0x60 Aug 23 00:11:06 juju-e4d256-prod-github-runner-207 kernel: [67640.582062] ? __hrtimer_run_queues+0x107/0x230 Aug 23 00:11:06 juju-e4d256-prod-github-runner-207 kernel: [67640.583170] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 00:11:06 juju-e4d256-prod-github-runner-207 kernel: [67640.584271] ? hrtimer_interrupt+0x101/0x220 Aug 23 00:11:06 juju-e4d256-prod-github-runner-207 kernel: [67640.585306] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 00:11:06 juju-e4d256-prod-github-runner-207 kernel: [67640.586376] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 00:11:06 juju-e4d256-prod-github-runner-207 kernel: [67640.587442] Aug 23 00:11:06 juju-e4d256-prod-github-runner-207 kernel: [67640.588311] Aug 23 00:11:06 juju-e4d256-prod-github-runner-207 kernel: [67640.589212] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 00:11:06 juju-e4d256-prod-github-runner-207 kernel: [67640.590258] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:11:06 juju-e4d256-prod-github-runner-207 kernel: [67640.591318] ? _raw_spin_lock+0x22/0x30 Aug 23 00:11:06 juju-e4d256-prod-github-runner-207 kernel: [67640.592306] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:11:06 juju-e4d256-prod-github-runner-207 kernel: [67640.593364] direct_page_fault+0x206/0x310 [kvm] Aug 23 00:11:06 juju-e4d256-prod-github-runner-207 kernel: [67640.594404] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 00:11:06 juju-e4d256-prod-github-runner-207 kernel: [67640.595424] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 00:11:06 juju-e4d256-prod-github-runner-207 kernel: [67640.596477] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 00:11:06 juju-e4d256-prod-github-runner-207 kernel: [67640.597457] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 00:11:06 juju-e4d256-prod-github-runner-207 kernel: [67640.598443] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 00:11:06 juju-e4d256-prod-github-runner-207 kernel: [67640.599424] handle_exit+0x98/0x230 [kvm_amd] Aug 23 00:11:06 juju-e4d256-prod-github-runner-207 kernel: [67640.600342] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 00:11:06 juju-e4d256-prod-github-runner-207 kernel: [67640.601265] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 00:11:06 juju-e4d256-prod-github-runner-207 kernel: [67640.602190] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 00:11:06 juju-e4d256-prod-github-runner-207 kernel: [67640.603092] vcpu_run+0x62/0x2c0 [kvm] Aug 23 00:11:06 juju-e4d256-prod-github-runner-207 kernel: [67640.603950] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 00:11:06 juju-e4d256-prod-github-runner-207 kernel: [67640.604765] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 00:11:06 juju-e4d256-prod-github-runner-207 kernel: [67640.605676] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 00:11:06 juju-e4d256-prod-github-runner-207 kernel: [67640.606488] ? __seccomp_filter+0x4a/0x4a0 Aug 23 00:11:06 juju-e4d256-prod-github-runner-207 kernel: [67640.607262] ? __fget_files+0x86/0xc0 Aug 23 00:11:06 juju-e4d256-prod-github-runner-207 kernel: [67640.608002] __x64_sys_ioctl+0x95/0xd0 Aug 23 00:11:06 juju-e4d256-prod-github-runner-207 kernel: [67640.608695] do_syscall_64+0x5c/0xc0 Aug 23 00:11:06 juju-e4d256-prod-github-runner-207 kernel: [67640.609363] ? do_futex+0x162/0x1f0 Aug 23 00:11:06 juju-e4d256-prod-github-runner-207 kernel: [67640.610012] ? __x64_sys_futex+0x78/0x1e0 Aug 23 00:11:06 juju-e4d256-prod-github-runner-207 kernel: [67640.610721] ? __secure_computing+0xa9/0x120 Aug 23 00:11:06 juju-e4d256-prod-github-runner-207 kernel: [67640.611416] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 00:11:06 juju-e4d256-prod-github-runner-207 kernel: [67640.612203] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:11:06 juju-e4d256-prod-github-runner-207 kernel: [67640.612969] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:11:06 juju-e4d256-prod-github-runner-207 kernel: [67640.613696] ? do_syscall_64+0x69/0xc0 Aug 23 00:11:06 juju-e4d256-prod-github-runner-207 kernel: [67640.614343] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:11:06 juju-e4d256-prod-github-runner-207 kernel: [67640.615049] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:11:06 juju-e4d256-prod-github-runner-207 kernel: [67640.615754] ? do_syscall_64+0x69/0xc0 Aug 23 00:11:06 juju-e4d256-prod-github-runner-207 kernel: [67640.616391] ? do_syscall_64+0x69/0xc0 Aug 23 00:11:06 juju-e4d256-prod-github-runner-207 kernel: [67640.617026] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 00:11:06 juju-e4d256-prod-github-runner-207 kernel: [67640.617748] RIP: 0033:0x7faa5d0edaff Aug 23 00:11:06 juju-e4d256-prod-github-runner-207 kernel: [67640.618375] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 00:11:06 juju-e4d256-prod-github-runner-207 kernel: [67640.620444] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 00:11:06 juju-e4d256-prod-github-runner-207 kernel: [67640.621369] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 00:11:06 juju-e4d256-prod-github-runner-207 kernel: [67640.622262] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 00:11:06 juju-e4d256-prod-github-runner-207 kernel: [67640.623157] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 00:11:06 juju-e4d256-prod-github-runner-207 kernel: [67640.624067] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 00:11:06 juju-e4d256-prod-github-runner-207 kernel: [67640.624958] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 00:11:06 juju-e4d256-prod-github-runner-207 kernel: [67640.625852] Aug 23 00:11:34 juju-e4d256-prod-github-runner-207 kernel: [67668.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 62913s! [qemu-system-x86:6715] Aug 23 00:11:34 juju-e4d256-prod-github-runner-207 kernel: [67668.543894] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 00:11:34 juju-e4d256-prod-github-runner-207 kernel: [67668.544191] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 00:11:34 juju-e4d256-prod-github-runner-207 kernel: [67668.556714] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 00:11:34 juju-e4d256-prod-github-runner-207 kernel: [67668.558026] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 00:11:34 juju-e4d256-prod-github-runner-207 kernel: [67668.559265] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:11:34 juju-e4d256-prod-github-runner-207 kernel: [67668.560362] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 00:11:34 juju-e4d256-prod-github-runner-207 kernel: [67668.562964] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 00:11:34 juju-e4d256-prod-github-runner-207 kernel: [67668.564039] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 00:11:34 juju-e4d256-prod-github-runner-207 kernel: [67668.565226] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 00:11:34 juju-e4d256-prod-github-runner-207 kernel: [67668.566403] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 00:11:34 juju-e4d256-prod-github-runner-207 kernel: [67668.567601] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 00:11:34 juju-e4d256-prod-github-runner-207 kernel: [67668.568786] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 00:11:34 juju-e4d256-prod-github-runner-207 kernel: [67668.569964] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 00:11:34 juju-e4d256-prod-github-runner-207 kernel: [67668.571226] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 00:11:34 juju-e4d256-prod-github-runner-207 kernel: [67668.572364] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 00:11:34 juju-e4d256-prod-github-runner-207 kernel: [67668.573592] Call Trace: Aug 23 00:11:34 juju-e4d256-prod-github-runner-207 kernel: [67668.574517] Aug 23 00:11:34 juju-e4d256-prod-github-runner-207 kernel: [67668.575429] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:11:34 juju-e4d256-prod-github-runner-207 kernel: [67668.576511] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:11:34 juju-e4d256-prod-github-runner-207 kernel: [67668.577550] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:11:34 juju-e4d256-prod-github-runner-207 kernel: [67668.578657] ? show_regs.part.0+0x23/0x29 Aug 23 00:11:34 juju-e4d256-prod-github-runner-207 kernel: [67668.579682] ? show_regs.cold+0x8/0xd Aug 23 00:11:34 juju-e4d256-prod-github-runner-207 kernel: [67668.580676] ? watchdog_timer_fn+0x1be/0x220 Aug 23 00:11:34 juju-e4d256-prod-github-runner-207 kernel: [67668.581710] ? lockup_detector_update_enable+0x60/0x60 Aug 23 00:11:34 juju-e4d256-prod-github-runner-207 kernel: [67668.582789] ? __hrtimer_run_queues+0x107/0x230 Aug 23 00:11:34 juju-e4d256-prod-github-runner-207 kernel: [67668.583845] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 00:11:34 juju-e4d256-prod-github-runner-207 kernel: [67668.584886] ? hrtimer_interrupt+0x101/0x220 Aug 23 00:11:34 juju-e4d256-prod-github-runner-207 kernel: [67668.585947] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 00:11:34 juju-e4d256-prod-github-runner-207 kernel: [67668.587060] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 00:11:34 juju-e4d256-prod-github-runner-207 kernel: [67668.588144] Aug 23 00:11:34 juju-e4d256-prod-github-runner-207 kernel: [67668.589011] Aug 23 00:11:34 juju-e4d256-prod-github-runner-207 kernel: [67668.589855] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 00:11:34 juju-e4d256-prod-github-runner-207 kernel: [67668.590902] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:11:34 juju-e4d256-prod-github-runner-207 kernel: [67668.591978] ? _raw_spin_lock+0x22/0x30 Aug 23 00:11:34 juju-e4d256-prod-github-runner-207 kernel: [67668.592978] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:11:34 juju-e4d256-prod-github-runner-207 kernel: [67668.594044] direct_page_fault+0x206/0x310 [kvm] Aug 23 00:11:34 juju-e4d256-prod-github-runner-207 kernel: [67668.595094] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 00:11:34 juju-e4d256-prod-github-runner-207 kernel: [67668.596144] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 00:11:34 juju-e4d256-prod-github-runner-207 kernel: [67668.597167] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 00:11:34 juju-e4d256-prod-github-runner-207 kernel: [67668.598179] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 00:11:34 juju-e4d256-prod-github-runner-207 kernel: [67668.599133] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 00:11:34 juju-e4d256-prod-github-runner-207 kernel: [67668.600133] handle_exit+0x98/0x230 [kvm_amd] Aug 23 00:11:34 juju-e4d256-prod-github-runner-207 kernel: [67668.601042] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 00:11:34 juju-e4d256-prod-github-runner-207 kernel: [67668.601998] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 00:11:34 juju-e4d256-prod-github-runner-207 kernel: [67668.602962] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 00:11:34 juju-e4d256-prod-github-runner-207 kernel: [67668.603906] vcpu_run+0x62/0x2c0 [kvm] Aug 23 00:11:34 juju-e4d256-prod-github-runner-207 kernel: [67668.604763] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 00:11:34 juju-e4d256-prod-github-runner-207 kernel: [67668.605581] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 00:11:34 juju-e4d256-prod-github-runner-207 kernel: [67668.606442] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 00:11:34 juju-e4d256-prod-github-runner-207 kernel: [67668.607259] ? __seccomp_filter+0x4a/0x4a0 Aug 23 00:11:34 juju-e4d256-prod-github-runner-207 kernel: [67668.608027] ? __fget_files+0x86/0xc0 Aug 23 00:11:34 juju-e4d256-prod-github-runner-207 kernel: [67668.608733] __x64_sys_ioctl+0x95/0xd0 Aug 23 00:11:34 juju-e4d256-prod-github-runner-207 kernel: [67668.609433] do_syscall_64+0x5c/0xc0 Aug 23 00:11:34 juju-e4d256-prod-github-runner-207 kernel: [67668.610101] ? do_futex+0x162/0x1f0 Aug 23 00:11:34 juju-e4d256-prod-github-runner-207 kernel: [67668.610747] ? __x64_sys_futex+0x78/0x1e0 Aug 23 00:11:34 juju-e4d256-prod-github-runner-207 kernel: [67668.611419] ? __secure_computing+0xa9/0x120 Aug 23 00:11:34 juju-e4d256-prod-github-runner-207 kernel: [67668.612159] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 00:11:34 juju-e4d256-prod-github-runner-207 kernel: [67668.612924] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:11:34 juju-e4d256-prod-github-runner-207 kernel: [67668.613647] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:11:34 juju-e4d256-prod-github-runner-207 kernel: [67668.614361] ? do_syscall_64+0x69/0xc0 Aug 23 00:11:34 juju-e4d256-prod-github-runner-207 kernel: [67668.615003] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:11:34 juju-e4d256-prod-github-runner-207 kernel: [67668.615721] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:11:34 juju-e4d256-prod-github-runner-207 kernel: [67668.616414] ? do_syscall_64+0x69/0xc0 Aug 23 00:11:34 juju-e4d256-prod-github-runner-207 kernel: [67668.617052] ? do_syscall_64+0x69/0xc0 Aug 23 00:11:34 juju-e4d256-prod-github-runner-207 kernel: [67668.617681] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 00:11:34 juju-e4d256-prod-github-runner-207 kernel: [67668.618380] RIP: 0033:0x7faa5d0edaff Aug 23 00:11:34 juju-e4d256-prod-github-runner-207 kernel: [67668.619049] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 00:11:34 juju-e4d256-prod-github-runner-207 kernel: [67668.621120] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 00:11:34 juju-e4d256-prod-github-runner-207 kernel: [67668.622039] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 00:11:34 juju-e4d256-prod-github-runner-207 kernel: [67668.622935] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 00:11:34 juju-e4d256-prod-github-runner-207 kernel: [67668.623845] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 00:11:34 juju-e4d256-prod-github-runner-207 kernel: [67668.624731] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 00:11:34 juju-e4d256-prod-github-runner-207 kernel: [67668.625622] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 00:11:34 juju-e4d256-prod-github-runner-207 kernel: [67668.626518] Aug 23 00:11:47 juju-e4d256-prod-github-runner-207 kernel: [67681.700710] rcu: INFO: rcu_sched self-detected stall on CPU Aug 23 00:11:47 juju-e4d256-prod-github-runner-207 kernel: [67681.701709] rcu: 1-....: (16837885 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=8129230 Aug 23 00:11:47 juju-e4d256-prod-github-runner-207 kernel: [67681.702927] (t=16891125 jiffies g=23269 q=58834) Aug 23 00:11:47 juju-e4d256-prod-github-runner-207 kernel: [67681.703797] NMI backtrace for cpu 1 Aug 23 00:11:47 juju-e4d256-prod-github-runner-207 kernel: [67681.704534] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 00:11:47 juju-e4d256-prod-github-runner-207 kernel: [67681.705682] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 00:11:47 juju-e4d256-prod-github-runner-207 kernel: [67681.706989] Call Trace: Aug 23 00:11:47 juju-e4d256-prod-github-runner-207 kernel: [67681.707721] Aug 23 00:11:47 juju-e4d256-prod-github-runner-207 kernel: [67681.708533] show_stack+0x52/0x5c Aug 23 00:11:47 juju-e4d256-prod-github-runner-207 kernel: [67681.709283] dump_stack_lvl+0x4a/0x63 Aug 23 00:11:47 juju-e4d256-prod-github-runner-207 kernel: [67681.710069] dump_stack+0x10/0x16 Aug 23 00:11:47 juju-e4d256-prod-github-runner-207 kernel: [67681.710802] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 23 00:11:47 juju-e4d256-prod-github-runner-207 kernel: [67681.711623] ? lapic_can_unplug_cpu+0x90/0x90 Aug 23 00:11:47 juju-e4d256-prod-github-runner-207 kernel: [67681.712421] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 23 00:11:47 juju-e4d256-prod-github-runner-207 kernel: [67681.713295] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 23 00:11:47 juju-e4d256-prod-github-runner-207 kernel: [67681.714130] trigger_single_cpu_backtrace+0x44/0x4f Aug 23 00:11:47 juju-e4d256-prod-github-runner-207 kernel: [67681.714977] rcu_dump_cpu_stacks+0x102/0x149 Aug 23 00:11:47 juju-e4d256-prod-github-runner-207 kernel: [67681.715817] print_cpu_stall.cold+0x2f/0xe2 Aug 23 00:11:47 juju-e4d256-prod-github-runner-207 kernel: [67681.716608] ? timekeeping_update+0xf7/0x150 Aug 23 00:11:47 juju-e4d256-prod-github-runner-207 kernel: [67681.717426] check_cpu_stall+0x109/0x270 Aug 23 00:11:47 juju-e4d256-prod-github-runner-207 kernel: [67681.718195] rcu_sched_clock_irq+0x9a/0x250 Aug 23 00:11:47 juju-e4d256-prod-github-runner-207 kernel: [67681.718996] update_process_times+0x94/0xd0 Aug 23 00:11:47 juju-e4d256-prod-github-runner-207 kernel: [67681.719800] tick_sched_handle+0x29/0x70 Aug 23 00:11:47 juju-e4d256-prod-github-runner-207 kernel: [67681.720722] tick_sched_timer+0x8c/0xc0 Aug 23 00:11:47 juju-e4d256-prod-github-runner-207 kernel: [67681.721866] ? tick_nohz_handler+0xb0/0xb0 Aug 23 00:11:47 juju-e4d256-prod-github-runner-207 kernel: [67681.723046] __hrtimer_run_queues+0x107/0x230 Aug 23 00:11:47 juju-e4d256-prod-github-runner-207 kernel: [67681.723935] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 00:11:47 juju-e4d256-prod-github-runner-207 kernel: [67681.724736] hrtimer_interrupt+0x101/0x220 Aug 23 00:11:47 juju-e4d256-prod-github-runner-207 kernel: [67681.725530] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 00:11:47 juju-e4d256-prod-github-runner-207 kernel: [67681.726434] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 00:11:47 juju-e4d256-prod-github-runner-207 kernel: [67681.727287] Aug 23 00:11:47 juju-e4d256-prod-github-runner-207 kernel: [67681.727961] Aug 23 00:11:47 juju-e4d256-prod-github-runner-207 kernel: [67681.728639] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 00:11:47 juju-e4d256-prod-github-runner-207 kernel: [67681.729521] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:11:47 juju-e4d256-prod-github-runner-207 kernel: [67681.730496] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 00:11:47 juju-e4d256-prod-github-runner-207 kernel: [67681.732848] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 00:11:47 juju-e4d256-prod-github-runner-207 kernel: [67681.733738] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 00:11:47 juju-e4d256-prod-github-runner-207 kernel: [67681.734804] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 00:11:47 juju-e4d256-prod-github-runner-207 kernel: [67681.735849] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 00:11:47 juju-e4d256-prod-github-runner-207 kernel: [67681.736832] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 00:11:47 juju-e4d256-prod-github-runner-207 kernel: [67681.737826] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 00:11:47 juju-e4d256-prod-github-runner-207 kernel: [67681.738858] ? _raw_spin_lock+0x22/0x30 Aug 23 00:11:47 juju-e4d256-prod-github-runner-207 kernel: [67681.739638] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:11:47 juju-e4d256-prod-github-runner-207 kernel: [67681.740526] direct_page_fault+0x206/0x310 [kvm] Aug 23 00:11:47 juju-e4d256-prod-github-runner-207 kernel: [67681.741386] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 00:11:47 juju-e4d256-prod-github-runner-207 kernel: [67681.742269] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 00:11:47 juju-e4d256-prod-github-runner-207 kernel: [67681.743116] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 00:11:47 juju-e4d256-prod-github-runner-207 kernel: [67681.743989] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 00:11:47 juju-e4d256-prod-github-runner-207 kernel: [67681.744789] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 00:11:47 juju-e4d256-prod-github-runner-207 kernel: [67681.745643] handle_exit+0x98/0x230 [kvm_amd] Aug 23 00:11:47 juju-e4d256-prod-github-runner-207 kernel: [67681.746418] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 00:11:47 juju-e4d256-prod-github-runner-207 kernel: [67681.747480] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 00:11:47 juju-e4d256-prod-github-runner-207 kernel: [67681.748636] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 00:11:47 juju-e4d256-prod-github-runner-207 kernel: [67681.749447] vcpu_run+0x62/0x2c0 [kvm] Aug 23 00:11:47 juju-e4d256-prod-github-runner-207 kernel: [67681.750263] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 00:11:47 juju-e4d256-prod-github-runner-207 kernel: [67681.751216] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 00:11:47 juju-e4d256-prod-github-runner-207 kernel: [67681.752240] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 00:11:47 juju-e4d256-prod-github-runner-207 kernel: [67681.753042] ? __seccomp_filter+0x4a/0x4a0 Aug 23 00:11:47 juju-e4d256-prod-github-runner-207 kernel: [67681.753798] ? __fget_files+0x86/0xc0 Aug 23 00:11:47 juju-e4d256-prod-github-runner-207 kernel: [67681.754544] __x64_sys_ioctl+0x95/0xd0 Aug 23 00:11:47 juju-e4d256-prod-github-runner-207 kernel: [67681.755287] do_syscall_64+0x5c/0xc0 Aug 23 00:11:47 juju-e4d256-prod-github-runner-207 kernel: [67681.756034] ? do_futex+0x162/0x1f0 Aug 23 00:11:47 juju-e4d256-prod-github-runner-207 kernel: [67681.756718] ? __x64_sys_futex+0x78/0x1e0 Aug 23 00:11:47 juju-e4d256-prod-github-runner-207 kernel: [67681.757441] ? __secure_computing+0xa9/0x120 Aug 23 00:11:47 juju-e4d256-prod-github-runner-207 kernel: [67681.758178] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 00:11:47 juju-e4d256-prod-github-runner-207 kernel: [67681.759024] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:11:47 juju-e4d256-prod-github-runner-207 kernel: [67681.759853] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:11:47 juju-e4d256-prod-github-runner-207 kernel: [67681.760653] ? do_syscall_64+0x69/0xc0 Aug 23 00:11:47 juju-e4d256-prod-github-runner-207 kernel: [67681.761377] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:11:47 juju-e4d256-prod-github-runner-207 kernel: [67681.762169] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:11:47 juju-e4d256-prod-github-runner-207 kernel: [67681.762950] ? do_syscall_64+0x69/0xc0 Aug 23 00:11:47 juju-e4d256-prod-github-runner-207 kernel: [67681.763688] ? do_syscall_64+0x69/0xc0 Aug 23 00:11:47 juju-e4d256-prod-github-runner-207 kernel: [67681.764398] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 00:11:47 juju-e4d256-prod-github-runner-207 kernel: [67681.765240] RIP: 0033:0x7faa5d0edaff Aug 23 00:11:47 juju-e4d256-prod-github-runner-207 kernel: [67681.765949] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 00:11:47 juju-e4d256-prod-github-runner-207 kernel: [67681.768163] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 00:11:47 juju-e4d256-prod-github-runner-207 kernel: [67681.769161] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 00:11:47 juju-e4d256-prod-github-runner-207 kernel: [67681.770158] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 00:11:47 juju-e4d256-prod-github-runner-207 kernel: [67681.771254] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 00:11:47 juju-e4d256-prod-github-runner-207 kernel: [67681.772290] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 00:11:47 juju-e4d256-prod-github-runner-207 kernel: [67681.773240] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 00:11:47 juju-e4d256-prod-github-runner-207 kernel: [67681.774202] Aug 23 00:12:14 juju-e4d256-prod-github-runner-207 kernel: [67708.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 62950s! [qemu-system-x86:6715] Aug 23 00:12:14 juju-e4d256-prod-github-runner-207 kernel: [67708.543124] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 00:12:14 juju-e4d256-prod-github-runner-207 kernel: [67708.543213] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 00:12:14 juju-e4d256-prod-github-runner-207 kernel: [67708.555695] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 00:12:14 juju-e4d256-prod-github-runner-207 kernel: [67708.557165] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 00:12:14 juju-e4d256-prod-github-runner-207 kernel: [67708.558378] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:12:14 juju-e4d256-prod-github-runner-207 kernel: [67708.559458] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 00:12:14 juju-e4d256-prod-github-runner-207 kernel: [67708.562057] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 00:12:14 juju-e4d256-prod-github-runner-207 kernel: [67708.563104] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 00:12:14 juju-e4d256-prod-github-runner-207 kernel: [67708.564298] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 00:12:14 juju-e4d256-prod-github-runner-207 kernel: [67708.565475] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 00:12:14 juju-e4d256-prod-github-runner-207 kernel: [67708.566644] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 00:12:14 juju-e4d256-prod-github-runner-207 kernel: [67708.567854] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 00:12:14 juju-e4d256-prod-github-runner-207 kernel: [67708.569038] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 00:12:14 juju-e4d256-prod-github-runner-207 kernel: [67708.570270] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 00:12:14 juju-e4d256-prod-github-runner-207 kernel: [67708.571380] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 00:12:14 juju-e4d256-prod-github-runner-207 kernel: [67708.572583] Call Trace: Aug 23 00:12:14 juju-e4d256-prod-github-runner-207 kernel: [67708.573507] Aug 23 00:12:14 juju-e4d256-prod-github-runner-207 kernel: [67708.574392] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:12:14 juju-e4d256-prod-github-runner-207 kernel: [67708.575430] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:12:14 juju-e4d256-prod-github-runner-207 kernel: [67708.576452] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:12:14 juju-e4d256-prod-github-runner-207 kernel: [67708.577532] ? show_regs.part.0+0x23/0x29 Aug 23 00:12:14 juju-e4d256-prod-github-runner-207 kernel: [67708.578535] ? show_regs.cold+0x8/0xd Aug 23 00:12:14 juju-e4d256-prod-github-runner-207 kernel: [67708.579529] ? watchdog_timer_fn+0x1be/0x220 Aug 23 00:12:14 juju-e4d256-prod-github-runner-207 kernel: [67708.580560] ? lockup_detector_update_enable+0x60/0x60 Aug 23 00:12:14 juju-e4d256-prod-github-runner-207 kernel: [67708.581631] ? __hrtimer_run_queues+0x107/0x230 Aug 23 00:12:14 juju-e4d256-prod-github-runner-207 kernel: [67708.582705] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 00:12:14 juju-e4d256-prod-github-runner-207 kernel: [67708.583752] ? hrtimer_interrupt+0x101/0x220 Aug 23 00:12:14 juju-e4d256-prod-github-runner-207 kernel: [67708.584765] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 00:12:14 juju-e4d256-prod-github-runner-207 kernel: [67708.585828] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 00:12:14 juju-e4d256-prod-github-runner-207 kernel: [67708.586873] Aug 23 00:12:14 juju-e4d256-prod-github-runner-207 kernel: [67708.587736] Aug 23 00:12:14 juju-e4d256-prod-github-runner-207 kernel: [67708.588575] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 00:12:14 juju-e4d256-prod-github-runner-207 kernel: [67708.589794] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:12:14 juju-e4d256-prod-github-runner-207 kernel: [67708.590835] ? _raw_spin_lock+0x22/0x30 Aug 23 00:12:14 juju-e4d256-prod-github-runner-207 kernel: [67708.591791] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:12:14 juju-e4d256-prod-github-runner-207 kernel: [67708.592812] direct_page_fault+0x206/0x310 [kvm] Aug 23 00:12:14 juju-e4d256-prod-github-runner-207 kernel: [67708.593867] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 00:12:14 juju-e4d256-prod-github-runner-207 kernel: [67708.594891] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 00:12:14 juju-e4d256-prod-github-runner-207 kernel: [67708.595914] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 00:12:14 juju-e4d256-prod-github-runner-207 kernel: [67708.596886] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 00:12:14 juju-e4d256-prod-github-runner-207 kernel: [67708.597868] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 00:12:14 juju-e4d256-prod-github-runner-207 kernel: [67708.598892] handle_exit+0x98/0x230 [kvm_amd] Aug 23 00:12:14 juju-e4d256-prod-github-runner-207 kernel: [67708.599828] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 00:12:14 juju-e4d256-prod-github-runner-207 kernel: [67708.600745] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 00:12:14 juju-e4d256-prod-github-runner-207 kernel: [67708.601678] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 00:12:14 juju-e4d256-prod-github-runner-207 kernel: [67708.602584] vcpu_run+0x62/0x2c0 [kvm] Aug 23 00:12:14 juju-e4d256-prod-github-runner-207 kernel: [67708.603416] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 00:12:14 juju-e4d256-prod-github-runner-207 kernel: [67708.604229] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 00:12:14 juju-e4d256-prod-github-runner-207 kernel: [67708.605091] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 00:12:14 juju-e4d256-prod-github-runner-207 kernel: [67708.605892] ? __seccomp_filter+0x4a/0x4a0 Aug 23 00:12:14 juju-e4d256-prod-github-runner-207 kernel: [67708.606648] ? __fget_files+0x86/0xc0 Aug 23 00:12:14 juju-e4d256-prod-github-runner-207 kernel: [67708.607384] __x64_sys_ioctl+0x95/0xd0 Aug 23 00:12:14 juju-e4d256-prod-github-runner-207 kernel: [67708.608081] do_syscall_64+0x5c/0xc0 Aug 23 00:12:14 juju-e4d256-prod-github-runner-207 kernel: [67708.608751] ? do_futex+0x162/0x1f0 Aug 23 00:12:14 juju-e4d256-prod-github-runner-207 kernel: [67708.609408] ? __x64_sys_futex+0x78/0x1e0 Aug 23 00:12:14 juju-e4d256-prod-github-runner-207 kernel: [67708.610085] ? __secure_computing+0xa9/0x120 Aug 23 00:12:14 juju-e4d256-prod-github-runner-207 kernel: [67708.610783] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 00:12:14 juju-e4d256-prod-github-runner-207 kernel: [67708.611561] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:12:14 juju-e4d256-prod-github-runner-207 kernel: [67708.612345] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:12:14 juju-e4d256-prod-github-runner-207 kernel: [67708.613065] ? do_syscall_64+0x69/0xc0 Aug 23 00:12:14 juju-e4d256-prod-github-runner-207 kernel: [67708.613711] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:12:14 juju-e4d256-prod-github-runner-207 kernel: [67708.614426] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:12:14 juju-e4d256-prod-github-runner-207 kernel: [67708.615122] ? do_syscall_64+0x69/0xc0 Aug 23 00:12:14 juju-e4d256-prod-github-runner-207 kernel: [67708.615760] ? do_syscall_64+0x69/0xc0 Aug 23 00:12:14 juju-e4d256-prod-github-runner-207 kernel: [67708.616384] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 00:12:14 juju-e4d256-prod-github-runner-207 kernel: [67708.617089] RIP: 0033:0x7faa5d0edaff Aug 23 00:12:14 juju-e4d256-prod-github-runner-207 kernel: [67708.617721] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 00:12:14 juju-e4d256-prod-github-runner-207 kernel: [67708.619732] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 00:12:14 juju-e4d256-prod-github-runner-207 kernel: [67708.620740] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 00:12:14 juju-e4d256-prod-github-runner-207 kernel: [67708.621776] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 00:12:14 juju-e4d256-prod-github-runner-207 kernel: [67708.622669] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 00:12:14 juju-e4d256-prod-github-runner-207 kernel: [67708.623566] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 00:12:14 juju-e4d256-prod-github-runner-207 kernel: [67708.624454] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 00:12:14 juju-e4d256-prod-github-runner-207 kernel: [67708.625346] Aug 23 00:12:42 juju-e4d256-prod-github-runner-207 kernel: [67736.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 62976s! [qemu-system-x86:6715] Aug 23 00:12:42 juju-e4d256-prod-github-runner-207 kernel: [67736.545084] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 00:12:42 juju-e4d256-prod-github-runner-207 kernel: [67736.545476] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 00:12:42 juju-e4d256-prod-github-runner-207 kernel: [67736.558386] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 00:12:42 juju-e4d256-prod-github-runner-207 kernel: [67736.559686] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 00:12:42 juju-e4d256-prod-github-runner-207 kernel: [67736.560925] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:12:42 juju-e4d256-prod-github-runner-207 kernel: [67736.561993] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 00:12:42 juju-e4d256-prod-github-runner-207 kernel: [67736.564587] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 00:12:42 juju-e4d256-prod-github-runner-207 kernel: [67736.565640] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 00:12:42 juju-e4d256-prod-github-runner-207 kernel: [67736.566825] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 00:12:42 juju-e4d256-prod-github-runner-207 kernel: [67736.568009] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 00:12:42 juju-e4d256-prod-github-runner-207 kernel: [67736.569186] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 00:12:42 juju-e4d256-prod-github-runner-207 kernel: [67736.570363] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 00:12:42 juju-e4d256-prod-github-runner-207 kernel: [67736.571558] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 00:12:42 juju-e4d256-prod-github-runner-207 kernel: [67736.572808] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 00:12:42 juju-e4d256-prod-github-runner-207 kernel: [67736.573917] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 00:12:42 juju-e4d256-prod-github-runner-207 kernel: [67736.575204] Call Trace: Aug 23 00:12:42 juju-e4d256-prod-github-runner-207 kernel: [67736.576151] Aug 23 00:12:42 juju-e4d256-prod-github-runner-207 kernel: [67736.577104] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:12:42 juju-e4d256-prod-github-runner-207 kernel: [67736.578142] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:12:42 juju-e4d256-prod-github-runner-207 kernel: [67736.579195] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:12:42 juju-e4d256-prod-github-runner-207 kernel: [67736.580301] ? show_regs.part.0+0x23/0x29 Aug 23 00:12:42 juju-e4d256-prod-github-runner-207 kernel: [67736.581569] ? show_regs.cold+0x8/0xd Aug 23 00:12:42 juju-e4d256-prod-github-runner-207 kernel: [67736.582548] ? watchdog_timer_fn+0x1be/0x220 Aug 23 00:12:42 juju-e4d256-prod-github-runner-207 kernel: [67736.583577] ? lockup_detector_update_enable+0x60/0x60 Aug 23 00:12:42 juju-e4d256-prod-github-runner-207 kernel: [67736.584661] ? __hrtimer_run_queues+0x107/0x230 Aug 23 00:12:42 juju-e4d256-prod-github-runner-207 kernel: [67736.585713] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 00:12:42 juju-e4d256-prod-github-runner-207 kernel: [67736.586750] ? hrtimer_interrupt+0x101/0x220 Aug 23 00:12:42 juju-e4d256-prod-github-runner-207 kernel: [67736.587790] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 00:12:42 juju-e4d256-prod-github-runner-207 kernel: [67736.588873] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 00:12:42 juju-e4d256-prod-github-runner-207 kernel: [67736.589926] Aug 23 00:12:42 juju-e4d256-prod-github-runner-207 kernel: [67736.590781] Aug 23 00:12:42 juju-e4d256-prod-github-runner-207 kernel: [67736.591629] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 00:12:42 juju-e4d256-prod-github-runner-207 kernel: [67736.592668] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:12:42 juju-e4d256-prod-github-runner-207 kernel: [67736.593718] ? _raw_spin_lock+0x22/0x30 Aug 23 00:12:42 juju-e4d256-prod-github-runner-207 kernel: [67736.594677] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:12:42 juju-e4d256-prod-github-runner-207 kernel: [67736.595719] direct_page_fault+0x206/0x310 [kvm] Aug 23 00:12:42 juju-e4d256-prod-github-runner-207 kernel: [67736.596756] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 00:12:42 juju-e4d256-prod-github-runner-207 kernel: [67736.597773] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 00:12:42 juju-e4d256-prod-github-runner-207 kernel: [67736.598780] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 00:12:42 juju-e4d256-prod-github-runner-207 kernel: [67736.599843] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 00:12:42 juju-e4d256-prod-github-runner-207 kernel: [67736.600798] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 00:12:42 juju-e4d256-prod-github-runner-207 kernel: [67736.601788] handle_exit+0x98/0x230 [kvm_amd] Aug 23 00:12:42 juju-e4d256-prod-github-runner-207 kernel: [67736.602715] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 00:12:42 juju-e4d256-prod-github-runner-207 kernel: [67736.603661] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 00:12:42 juju-e4d256-prod-github-runner-207 kernel: [67736.604594] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 00:12:42 juju-e4d256-prod-github-runner-207 kernel: [67736.605510] vcpu_run+0x62/0x2c0 [kvm] Aug 23 00:12:42 juju-e4d256-prod-github-runner-207 kernel: [67736.606332] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 00:12:42 juju-e4d256-prod-github-runner-207 kernel: [67736.607160] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 00:12:42 juju-e4d256-prod-github-runner-207 kernel: [67736.608023] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 00:12:42 juju-e4d256-prod-github-runner-207 kernel: [67736.608834] ? __seccomp_filter+0x4a/0x4a0 Aug 23 00:12:42 juju-e4d256-prod-github-runner-207 kernel: [67736.609584] ? __fget_files+0x86/0xc0 Aug 23 00:12:42 juju-e4d256-prod-github-runner-207 kernel: [67736.610293] __x64_sys_ioctl+0x95/0xd0 Aug 23 00:12:42 juju-e4d256-prod-github-runner-207 kernel: [67736.611032] do_syscall_64+0x5c/0xc0 Aug 23 00:12:42 juju-e4d256-prod-github-runner-207 kernel: [67736.611707] ? do_futex+0x162/0x1f0 Aug 23 00:12:42 juju-e4d256-prod-github-runner-207 kernel: [67736.612365] ? __x64_sys_futex+0x78/0x1e0 Aug 23 00:12:42 juju-e4d256-prod-github-runner-207 kernel: [67736.613076] ? __secure_computing+0xa9/0x120 Aug 23 00:12:42 juju-e4d256-prod-github-runner-207 kernel: [67736.613774] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 00:12:42 juju-e4d256-prod-github-runner-207 kernel: [67736.614582] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:12:42 juju-e4d256-prod-github-runner-207 kernel: [67736.615409] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:12:42 juju-e4d256-prod-github-runner-207 kernel: [67736.616163] ? do_syscall_64+0x69/0xc0 Aug 23 00:12:42 juju-e4d256-prod-github-runner-207 kernel: [67736.616814] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:12:42 juju-e4d256-prod-github-runner-207 kernel: [67736.617529] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:12:42 juju-e4d256-prod-github-runner-207 kernel: [67736.618233] ? do_syscall_64+0x69/0xc0 Aug 23 00:12:42 juju-e4d256-prod-github-runner-207 kernel: [67736.618888] ? do_syscall_64+0x69/0xc0 Aug 23 00:12:42 juju-e4d256-prod-github-runner-207 kernel: [67736.619519] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 00:12:42 juju-e4d256-prod-github-runner-207 kernel: [67736.620232] RIP: 0033:0x7faa5d0edaff Aug 23 00:12:42 juju-e4d256-prod-github-runner-207 kernel: [67736.620894] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 00:12:42 juju-e4d256-prod-github-runner-207 kernel: [67736.622942] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 00:12:42 juju-e4d256-prod-github-runner-207 kernel: [67736.623871] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 00:12:42 juju-e4d256-prod-github-runner-207 kernel: [67736.624780] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 00:12:42 juju-e4d256-prod-github-runner-207 kernel: [67736.625689] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 00:12:42 juju-e4d256-prod-github-runner-207 kernel: [67736.626597] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 00:12:42 juju-e4d256-prod-github-runner-207 kernel: [67736.627508] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 00:12:42 juju-e4d256-prod-github-runner-207 kernel: [67736.628418] Aug 23 00:13:10 juju-e4d256-prod-github-runner-207 kernel: [67764.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 63002s! [qemu-system-x86:6715] Aug 23 00:13:10 juju-e4d256-prod-github-runner-207 kernel: [67764.543172] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 00:13:10 juju-e4d256-prod-github-runner-207 kernel: [67764.543248] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 00:13:10 juju-e4d256-prod-github-runner-207 kernel: [67764.555415] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 00:13:10 juju-e4d256-prod-github-runner-207 kernel: [67764.556691] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 00:13:10 juju-e4d256-prod-github-runner-207 kernel: [67764.557923] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:13:10 juju-e4d256-prod-github-runner-207 kernel: [67764.559031] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 00:13:10 juju-e4d256-prod-github-runner-207 kernel: [67764.561615] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 00:13:10 juju-e4d256-prod-github-runner-207 kernel: [67764.562739] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 00:13:10 juju-e4d256-prod-github-runner-207 kernel: [67764.563940] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 00:13:10 juju-e4d256-prod-github-runner-207 kernel: [67764.565110] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 00:13:10 juju-e4d256-prod-github-runner-207 kernel: [67764.566278] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 00:13:10 juju-e4d256-prod-github-runner-207 kernel: [67764.567512] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 00:13:10 juju-e4d256-prod-github-runner-207 kernel: [67764.568705] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 00:13:10 juju-e4d256-prod-github-runner-207 kernel: [67764.569951] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 00:13:10 juju-e4d256-prod-github-runner-207 kernel: [67764.571068] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 00:13:10 juju-e4d256-prod-github-runner-207 kernel: [67764.572272] Call Trace: Aug 23 00:13:10 juju-e4d256-prod-github-runner-207 kernel: [67764.573199] Aug 23 00:13:10 juju-e4d256-prod-github-runner-207 kernel: [67764.574144] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:13:10 juju-e4d256-prod-github-runner-207 kernel: [67764.575201] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:13:10 juju-e4d256-prod-github-runner-207 kernel: [67764.576242] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:13:10 juju-e4d256-prod-github-runner-207 kernel: [67764.577334] ? show_regs.part.0+0x23/0x29 Aug 23 00:13:10 juju-e4d256-prod-github-runner-207 kernel: [67764.578349] ? show_regs.cold+0x8/0xd Aug 23 00:13:10 juju-e4d256-prod-github-runner-207 kernel: [67764.579370] ? watchdog_timer_fn+0x1be/0x220 Aug 23 00:13:10 juju-e4d256-prod-github-runner-207 kernel: [67764.580386] ? lockup_detector_update_enable+0x60/0x60 Aug 23 00:13:10 juju-e4d256-prod-github-runner-207 kernel: [67764.581469] ? __hrtimer_run_queues+0x107/0x230 Aug 23 00:13:10 juju-e4d256-prod-github-runner-207 kernel: [67764.582553] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 00:13:10 juju-e4d256-prod-github-runner-207 kernel: [67764.583603] ? hrtimer_interrupt+0x101/0x220 Aug 23 00:13:10 juju-e4d256-prod-github-runner-207 kernel: [67764.584636] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 00:13:10 juju-e4d256-prod-github-runner-207 kernel: [67764.585719] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 00:13:10 juju-e4d256-prod-github-runner-207 kernel: [67764.586786] Aug 23 00:13:10 juju-e4d256-prod-github-runner-207 kernel: [67764.587675] Aug 23 00:13:10 juju-e4d256-prod-github-runner-207 kernel: [67764.588701] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 00:13:10 juju-e4d256-prod-github-runner-207 kernel: [67764.589859] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:13:10 juju-e4d256-prod-github-runner-207 kernel: [67764.591063] ? _raw_spin_lock+0x22/0x30 Aug 23 00:13:10 juju-e4d256-prod-github-runner-207 kernel: [67764.592143] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:13:10 juju-e4d256-prod-github-runner-207 kernel: [67764.593178] direct_page_fault+0x206/0x310 [kvm] Aug 23 00:13:10 juju-e4d256-prod-github-runner-207 kernel: [67764.594242] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 00:13:10 juju-e4d256-prod-github-runner-207 kernel: [67764.595291] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 00:13:10 juju-e4d256-prod-github-runner-207 kernel: [67764.596355] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 00:13:10 juju-e4d256-prod-github-runner-207 kernel: [67764.597339] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 00:13:10 juju-e4d256-prod-github-runner-207 kernel: [67764.598290] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 00:13:10 juju-e4d256-prod-github-runner-207 kernel: [67764.599299] handle_exit+0x98/0x230 [kvm_amd] Aug 23 00:13:10 juju-e4d256-prod-github-runner-207 kernel: [67764.600196] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 00:13:10 juju-e4d256-prod-github-runner-207 kernel: [67764.601128] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 00:13:10 juju-e4d256-prod-github-runner-207 kernel: [67764.602071] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 00:13:10 juju-e4d256-prod-github-runner-207 kernel: [67764.603007] vcpu_run+0x62/0x2c0 [kvm] Aug 23 00:13:10 juju-e4d256-prod-github-runner-207 kernel: [67764.603825] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 00:13:10 juju-e4d256-prod-github-runner-207 kernel: [67764.604642] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 00:13:10 juju-e4d256-prod-github-runner-207 kernel: [67764.605502] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 00:13:10 juju-e4d256-prod-github-runner-207 kernel: [67764.606305] ? __seccomp_filter+0x4a/0x4a0 Aug 23 00:13:10 juju-e4d256-prod-github-runner-207 kernel: [67764.607072] ? __fget_files+0x86/0xc0 Aug 23 00:13:10 juju-e4d256-prod-github-runner-207 kernel: [67764.607780] __x64_sys_ioctl+0x95/0xd0 Aug 23 00:13:10 juju-e4d256-prod-github-runner-207 kernel: [67764.608477] do_syscall_64+0x5c/0xc0 Aug 23 00:13:10 juju-e4d256-prod-github-runner-207 kernel: [67764.609150] ? do_futex+0x162/0x1f0 Aug 23 00:13:10 juju-e4d256-prod-github-runner-207 kernel: [67764.609837] ? __x64_sys_futex+0x78/0x1e0 Aug 23 00:13:10 juju-e4d256-prod-github-runner-207 kernel: [67764.610554] ? __secure_computing+0xa9/0x120 Aug 23 00:13:10 juju-e4d256-prod-github-runner-207 kernel: [67764.611249] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 00:13:10 juju-e4d256-prod-github-runner-207 kernel: [67764.612014] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:13:10 juju-e4d256-prod-github-runner-207 kernel: [67764.612738] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:13:10 juju-e4d256-prod-github-runner-207 kernel: [67764.613466] ? do_syscall_64+0x69/0xc0 Aug 23 00:13:10 juju-e4d256-prod-github-runner-207 kernel: [67764.614117] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:13:10 juju-e4d256-prod-github-runner-207 kernel: [67764.614852] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:13:10 juju-e4d256-prod-github-runner-207 kernel: [67764.615554] ? do_syscall_64+0x69/0xc0 Aug 23 00:13:10 juju-e4d256-prod-github-runner-207 kernel: [67764.616185] ? do_syscall_64+0x69/0xc0 Aug 23 00:13:10 juju-e4d256-prod-github-runner-207 kernel: [67764.616811] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 00:13:10 juju-e4d256-prod-github-runner-207 kernel: [67764.617526] RIP: 0033:0x7faa5d0edaff Aug 23 00:13:10 juju-e4d256-prod-github-runner-207 kernel: [67764.618162] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 00:13:10 juju-e4d256-prod-github-runner-207 kernel: [67764.620175] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 00:13:10 juju-e4d256-prod-github-runner-207 kernel: [67764.621106] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 00:13:10 juju-e4d256-prod-github-runner-207 kernel: [67764.622004] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 00:13:10 juju-e4d256-prod-github-runner-207 kernel: [67764.622911] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 00:13:10 juju-e4d256-prod-github-runner-207 kernel: [67764.623806] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 00:13:10 juju-e4d256-prod-github-runner-207 kernel: [67764.624700] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 00:13:10 juju-e4d256-prod-github-runner-207 kernel: [67764.625595] Aug 23 00:13:38 juju-e4d256-prod-github-runner-207 kernel: [67792.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 63028s! [qemu-system-x86:6715] Aug 23 00:13:38 juju-e4d256-prod-github-runner-207 kernel: [67792.543150] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 00:13:38 juju-e4d256-prod-github-runner-207 kernel: [67792.543222] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 00:13:38 juju-e4d256-prod-github-runner-207 kernel: [67792.555816] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 00:13:38 juju-e4d256-prod-github-runner-207 kernel: [67792.557111] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 00:13:38 juju-e4d256-prod-github-runner-207 kernel: [67792.558384] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:13:38 juju-e4d256-prod-github-runner-207 kernel: [67792.559459] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 00:13:38 juju-e4d256-prod-github-runner-207 kernel: [67792.562078] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 00:13:38 juju-e4d256-prod-github-runner-207 kernel: [67792.563194] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 00:13:38 juju-e4d256-prod-github-runner-207 kernel: [67792.564402] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 00:13:38 juju-e4d256-prod-github-runner-207 kernel: [67792.565912] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 00:13:38 juju-e4d256-prod-github-runner-207 kernel: [67792.567124] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 00:13:38 juju-e4d256-prod-github-runner-207 kernel: [67792.568406] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 00:13:38 juju-e4d256-prod-github-runner-207 kernel: [67792.569655] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 00:13:38 juju-e4d256-prod-github-runner-207 kernel: [67792.570948] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 00:13:38 juju-e4d256-prod-github-runner-207 kernel: [67792.572055] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 00:13:38 juju-e4d256-prod-github-runner-207 kernel: [67792.573253] Call Trace: Aug 23 00:13:38 juju-e4d256-prod-github-runner-207 kernel: [67792.574166] Aug 23 00:13:38 juju-e4d256-prod-github-runner-207 kernel: [67792.575075] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:13:38 juju-e4d256-prod-github-runner-207 kernel: [67792.576105] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:13:38 juju-e4d256-prod-github-runner-207 kernel: [67792.577257] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:13:38 juju-e4d256-prod-github-runner-207 kernel: [67792.578386] ? show_regs.part.0+0x23/0x29 Aug 23 00:13:38 juju-e4d256-prod-github-runner-207 kernel: [67792.579435] ? show_regs.cold+0x8/0xd Aug 23 00:13:38 juju-e4d256-prod-github-runner-207 kernel: [67792.580415] ? watchdog_timer_fn+0x1be/0x220 Aug 23 00:13:38 juju-e4d256-prod-github-runner-207 kernel: [67792.581427] ? lockup_detector_update_enable+0x60/0x60 Aug 23 00:13:38 juju-e4d256-prod-github-runner-207 kernel: [67792.582511] ? __hrtimer_run_queues+0x107/0x230 Aug 23 00:13:38 juju-e4d256-prod-github-runner-207 kernel: [67792.583557] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 00:13:38 juju-e4d256-prod-github-runner-207 kernel: [67792.584579] ? hrtimer_interrupt+0x101/0x220 Aug 23 00:13:38 juju-e4d256-prod-github-runner-207 kernel: [67792.585599] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 00:13:38 juju-e4d256-prod-github-runner-207 kernel: [67792.586677] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 00:13:38 juju-e4d256-prod-github-runner-207 kernel: [67792.587722] Aug 23 00:13:38 juju-e4d256-prod-github-runner-207 kernel: [67792.588573] Aug 23 00:13:38 juju-e4d256-prod-github-runner-207 kernel: [67792.589408] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 00:13:38 juju-e4d256-prod-github-runner-207 kernel: [67792.590484] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:13:38 juju-e4d256-prod-github-runner-207 kernel: [67792.591590] ? _raw_spin_lock+0x22/0x30 Aug 23 00:13:38 juju-e4d256-prod-github-runner-207 kernel: [67792.592540] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:13:38 juju-e4d256-prod-github-runner-207 kernel: [67792.593564] direct_page_fault+0x206/0x310 [kvm] Aug 23 00:13:38 juju-e4d256-prod-github-runner-207 kernel: [67792.594602] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 00:13:38 juju-e4d256-prod-github-runner-207 kernel: [67792.595617] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 00:13:38 juju-e4d256-prod-github-runner-207 kernel: [67792.596701] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 00:13:38 juju-e4d256-prod-github-runner-207 kernel: [67792.597830] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 00:13:38 juju-e4d256-prod-github-runner-207 kernel: [67792.598964] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 00:13:38 juju-e4d256-prod-github-runner-207 kernel: [67792.600003] handle_exit+0x98/0x230 [kvm_amd] Aug 23 00:13:38 juju-e4d256-prod-github-runner-207 kernel: [67792.600955] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 00:13:38 juju-e4d256-prod-github-runner-207 kernel: [67792.601880] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 00:13:38 juju-e4d256-prod-github-runner-207 kernel: [67792.602831] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 00:13:38 juju-e4d256-prod-github-runner-207 kernel: [67792.603737] vcpu_run+0x62/0x2c0 [kvm] Aug 23 00:13:38 juju-e4d256-prod-github-runner-207 kernel: [67792.604567] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 00:13:38 juju-e4d256-prod-github-runner-207 kernel: [67792.605400] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 00:13:38 juju-e4d256-prod-github-runner-207 kernel: [67792.606289] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 00:13:38 juju-e4d256-prod-github-runner-207 kernel: [67792.607163] ? __seccomp_filter+0x4a/0x4a0 Aug 23 00:13:38 juju-e4d256-prod-github-runner-207 kernel: [67792.608038] ? __fget_files+0x86/0xc0 Aug 23 00:13:38 juju-e4d256-prod-github-runner-207 kernel: [67792.608788] __x64_sys_ioctl+0x95/0xd0 Aug 23 00:13:38 juju-e4d256-prod-github-runner-207 kernel: [67792.609504] do_syscall_64+0x5c/0xc0 Aug 23 00:13:38 juju-e4d256-prod-github-runner-207 kernel: [67792.610235] ? do_futex+0x162/0x1f0 Aug 23 00:13:38 juju-e4d256-prod-github-runner-207 kernel: [67792.610920] ? __x64_sys_futex+0x78/0x1e0 Aug 23 00:13:38 juju-e4d256-prod-github-runner-207 kernel: [67792.611609] ? __secure_computing+0xa9/0x120 Aug 23 00:13:38 juju-e4d256-prod-github-runner-207 kernel: [67792.612306] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 00:13:38 juju-e4d256-prod-github-runner-207 kernel: [67792.613069] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:13:38 juju-e4d256-prod-github-runner-207 kernel: [67792.613795] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:13:38 juju-e4d256-prod-github-runner-207 kernel: [67792.614541] ? do_syscall_64+0x69/0xc0 Aug 23 00:13:38 juju-e4d256-prod-github-runner-207 kernel: [67792.615202] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:13:38 juju-e4d256-prod-github-runner-207 kernel: [67792.615935] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:13:38 juju-e4d256-prod-github-runner-207 kernel: [67792.616643] ? do_syscall_64+0x69/0xc0 Aug 23 00:13:38 juju-e4d256-prod-github-runner-207 kernel: [67792.617272] ? do_syscall_64+0x69/0xc0 Aug 23 00:13:38 juju-e4d256-prod-github-runner-207 kernel: [67792.617971] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 00:13:38 juju-e4d256-prod-github-runner-207 kernel: [67792.618698] RIP: 0033:0x7faa5d0edaff Aug 23 00:13:38 juju-e4d256-prod-github-runner-207 kernel: [67792.619322] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 00:13:38 juju-e4d256-prod-github-runner-207 kernel: [67792.621343] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 00:13:38 juju-e4d256-prod-github-runner-207 kernel: [67792.622272] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 00:13:38 juju-e4d256-prod-github-runner-207 kernel: [67792.623219] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 00:13:38 juju-e4d256-prod-github-runner-207 kernel: [67792.624184] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 00:13:38 juju-e4d256-prod-github-runner-207 kernel: [67792.625097] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 00:13:38 juju-e4d256-prod-github-runner-207 kernel: [67792.625994] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 00:13:38 juju-e4d256-prod-github-runner-207 kernel: [67792.626911] Aug 23 00:14:06 juju-e4d256-prod-github-runner-207 kernel: [67820.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 63054s! [qemu-system-x86:6715] Aug 23 00:14:06 juju-e4d256-prod-github-runner-207 kernel: [67820.543233] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 00:14:06 juju-e4d256-prod-github-runner-207 kernel: [67820.543558] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 00:14:06 juju-e4d256-prod-github-runner-207 kernel: [67820.556058] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 00:14:06 juju-e4d256-prod-github-runner-207 kernel: [67820.557386] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 00:14:06 juju-e4d256-prod-github-runner-207 kernel: [67820.558656] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:14:06 juju-e4d256-prod-github-runner-207 kernel: [67820.559756] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 00:14:06 juju-e4d256-prod-github-runner-207 kernel: [67820.562387] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 00:14:06 juju-e4d256-prod-github-runner-207 kernel: [67820.563446] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 00:14:06 juju-e4d256-prod-github-runner-207 kernel: [67820.564623] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 00:14:06 juju-e4d256-prod-github-runner-207 kernel: [67820.565802] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 00:14:06 juju-e4d256-prod-github-runner-207 kernel: [67820.566997] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 00:14:06 juju-e4d256-prod-github-runner-207 kernel: [67820.568199] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 00:14:06 juju-e4d256-prod-github-runner-207 kernel: [67820.569432] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 00:14:06 juju-e4d256-prod-github-runner-207 kernel: [67820.570719] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 00:14:06 juju-e4d256-prod-github-runner-207 kernel: [67820.571843] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 00:14:06 juju-e4d256-prod-github-runner-207 kernel: [67820.573055] Call Trace: Aug 23 00:14:06 juju-e4d256-prod-github-runner-207 kernel: [67820.573999] Aug 23 00:14:06 juju-e4d256-prod-github-runner-207 kernel: [67820.574900] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:14:06 juju-e4d256-prod-github-runner-207 kernel: [67820.575942] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:14:06 juju-e4d256-prod-github-runner-207 kernel: [67820.576977] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:14:06 juju-e4d256-prod-github-runner-207 kernel: [67820.578118] ? show_regs.part.0+0x23/0x29 Aug 23 00:14:06 juju-e4d256-prod-github-runner-207 kernel: [67820.579131] ? show_regs.cold+0x8/0xd Aug 23 00:14:06 juju-e4d256-prod-github-runner-207 kernel: [67820.580116] ? watchdog_timer_fn+0x1be/0x220 Aug 23 00:14:06 juju-e4d256-prod-github-runner-207 kernel: [67820.581133] ? lockup_detector_update_enable+0x60/0x60 Aug 23 00:14:06 juju-e4d256-prod-github-runner-207 kernel: [67820.582225] ? __hrtimer_run_queues+0x107/0x230 Aug 23 00:14:06 juju-e4d256-prod-github-runner-207 kernel: [67820.583264] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 00:14:06 juju-e4d256-prod-github-runner-207 kernel: [67820.584293] ? hrtimer_interrupt+0x101/0x220 Aug 23 00:14:06 juju-e4d256-prod-github-runner-207 kernel: [67820.585321] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 00:14:06 juju-e4d256-prod-github-runner-207 kernel: [67820.586420] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 00:14:06 juju-e4d256-prod-github-runner-207 kernel: [67820.587477] Aug 23 00:14:06 juju-e4d256-prod-github-runner-207 kernel: [67820.588331] Aug 23 00:14:06 juju-e4d256-prod-github-runner-207 kernel: [67820.589172] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 00:14:06 juju-e4d256-prod-github-runner-207 kernel: [67820.590284] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:14:06 juju-e4d256-prod-github-runner-207 kernel: [67820.591339] ? _raw_spin_lock+0x22/0x30 Aug 23 00:14:06 juju-e4d256-prod-github-runner-207 kernel: [67820.592307] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:14:06 juju-e4d256-prod-github-runner-207 kernel: [67820.593345] direct_page_fault+0x206/0x310 [kvm] Aug 23 00:14:06 juju-e4d256-prod-github-runner-207 kernel: [67820.595223] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 00:14:06 juju-e4d256-prod-github-runner-207 kernel: [67820.596430] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 00:14:06 juju-e4d256-prod-github-runner-207 kernel: [67820.597447] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 00:14:06 juju-e4d256-prod-github-runner-207 kernel: [67820.598512] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 00:14:06 juju-e4d256-prod-github-runner-207 kernel: [67820.600075] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 00:14:06 juju-e4d256-prod-github-runner-207 kernel: [67820.601658] handle_exit+0x98/0x230 [kvm_amd] Aug 23 00:14:06 juju-e4d256-prod-github-runner-207 kernel: [67820.602920] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 00:14:06 juju-e4d256-prod-github-runner-207 kernel: [67820.603924] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 00:14:06 juju-e4d256-prod-github-runner-207 kernel: [67820.604884] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 00:14:06 juju-e4d256-prod-github-runner-207 kernel: [67820.605813] vcpu_run+0x62/0x2c0 [kvm] Aug 23 00:14:06 juju-e4d256-prod-github-runner-207 kernel: [67820.606681] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 00:14:06 juju-e4d256-prod-github-runner-207 kernel: [67820.607518] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 00:14:06 juju-e4d256-prod-github-runner-207 kernel: [67820.608395] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 00:14:06 juju-e4d256-prod-github-runner-207 kernel: [67820.609211] ? __seccomp_filter+0x4a/0x4a0 Aug 23 00:14:06 juju-e4d256-prod-github-runner-207 kernel: [67820.609988] ? __fget_files+0x86/0xc0 Aug 23 00:14:06 juju-e4d256-prod-github-runner-207 kernel: [67820.610707] __x64_sys_ioctl+0x95/0xd0 Aug 23 00:14:06 juju-e4d256-prod-github-runner-207 kernel: [67820.611416] do_syscall_64+0x5c/0xc0 Aug 23 00:14:06 juju-e4d256-prod-github-runner-207 kernel: [67820.612096] ? do_futex+0x162/0x1f0 Aug 23 00:14:06 juju-e4d256-prod-github-runner-207 kernel: [67820.612760] ? __x64_sys_futex+0x78/0x1e0 Aug 23 00:14:06 juju-e4d256-prod-github-runner-207 kernel: [67820.613447] ? __secure_computing+0xa9/0x120 Aug 23 00:14:06 juju-e4d256-prod-github-runner-207 kernel: [67820.614226] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 00:14:06 juju-e4d256-prod-github-runner-207 kernel: [67820.615014] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:14:06 juju-e4d256-prod-github-runner-207 kernel: [67820.615760] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:14:06 juju-e4d256-prod-github-runner-207 kernel: [67820.616498] ? do_syscall_64+0x69/0xc0 Aug 23 00:14:06 juju-e4d256-prod-github-runner-207 kernel: [67820.617161] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:14:06 juju-e4d256-prod-github-runner-207 kernel: [67820.617915] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:14:06 juju-e4d256-prod-github-runner-207 kernel: [67820.618628] ? do_syscall_64+0x69/0xc0 Aug 23 00:14:06 juju-e4d256-prod-github-runner-207 kernel: [67820.619268] ? do_syscall_64+0x69/0xc0 Aug 23 00:14:06 juju-e4d256-prod-github-runner-207 kernel: [67820.619915] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 00:14:06 juju-e4d256-prod-github-runner-207 kernel: [67820.620650] RIP: 0033:0x7faa5d0edaff Aug 23 00:14:06 juju-e4d256-prod-github-runner-207 kernel: [67820.621332] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 00:14:06 juju-e4d256-prod-github-runner-207 kernel: [67820.623398] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 00:14:06 juju-e4d256-prod-github-runner-207 kernel: [67820.624345] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 00:14:06 juju-e4d256-prod-github-runner-207 kernel: [67820.625252] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 00:14:06 juju-e4d256-prod-github-runner-207 kernel: [67820.626165] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 00:14:06 juju-e4d256-prod-github-runner-207 kernel: [67820.627099] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 00:14:06 juju-e4d256-prod-github-runner-207 kernel: [67820.627993] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 00:14:06 juju-e4d256-prod-github-runner-207 kernel: [67820.628982] Aug 23 00:14:34 juju-e4d256-prod-github-runner-207 kernel: [67848.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 63080s! [qemu-system-x86:6715] Aug 23 00:14:34 juju-e4d256-prod-github-runner-207 kernel: [67848.543851] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 00:14:34 juju-e4d256-prod-github-runner-207 kernel: [67848.544044] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 00:14:34 juju-e4d256-prod-github-runner-207 kernel: [67848.556622] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 00:14:34 juju-e4d256-prod-github-runner-207 kernel: [67848.557978] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 00:14:34 juju-e4d256-prod-github-runner-207 kernel: [67848.559289] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:14:34 juju-e4d256-prod-github-runner-207 kernel: [67848.560371] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 00:14:34 juju-e4d256-prod-github-runner-207 kernel: [67848.563015] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 00:14:34 juju-e4d256-prod-github-runner-207 kernel: [67848.564074] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 00:14:34 juju-e4d256-prod-github-runner-207 kernel: [67848.565301] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 00:14:34 juju-e4d256-prod-github-runner-207 kernel: [67848.566524] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 00:14:34 juju-e4d256-prod-github-runner-207 kernel: [67848.567713] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 00:14:34 juju-e4d256-prod-github-runner-207 kernel: [67848.568916] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 00:14:34 juju-e4d256-prod-github-runner-207 kernel: [67848.570130] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 00:14:34 juju-e4d256-prod-github-runner-207 kernel: [67848.571399] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 00:14:34 juju-e4d256-prod-github-runner-207 kernel: [67848.572515] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 00:14:34 juju-e4d256-prod-github-runner-207 kernel: [67848.573736] Call Trace: Aug 23 00:14:34 juju-e4d256-prod-github-runner-207 kernel: [67848.574654] Aug 23 00:14:34 juju-e4d256-prod-github-runner-207 kernel: [67848.575556] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:14:34 juju-e4d256-prod-github-runner-207 kernel: [67848.576599] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:14:34 juju-e4d256-prod-github-runner-207 kernel: [67848.577643] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:14:34 juju-e4d256-prod-github-runner-207 kernel: [67848.578732] ? show_regs.part.0+0x23/0x29 Aug 23 00:14:34 juju-e4d256-prod-github-runner-207 kernel: [67848.579741] ? show_regs.cold+0x8/0xd Aug 23 00:14:34 juju-e4d256-prod-github-runner-207 kernel: [67848.580724] ? watchdog_timer_fn+0x1be/0x220 Aug 23 00:14:34 juju-e4d256-prod-github-runner-207 kernel: [67848.581760] ? lockup_detector_update_enable+0x60/0x60 Aug 23 00:14:34 juju-e4d256-prod-github-runner-207 kernel: [67848.582835] ? __hrtimer_run_queues+0x107/0x230 Aug 23 00:14:34 juju-e4d256-prod-github-runner-207 kernel: [67848.583878] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 00:14:34 juju-e4d256-prod-github-runner-207 kernel: [67848.584912] ? hrtimer_interrupt+0x101/0x220 Aug 23 00:14:34 juju-e4d256-prod-github-runner-207 kernel: [67848.585996] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 00:14:34 juju-e4d256-prod-github-runner-207 kernel: [67848.587075] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 00:14:34 juju-e4d256-prod-github-runner-207 kernel: [67848.588129] Aug 23 00:14:34 juju-e4d256-prod-github-runner-207 kernel: [67848.588986] Aug 23 00:14:34 juju-e4d256-prod-github-runner-207 kernel: [67848.589840] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 00:14:34 juju-e4d256-prod-github-runner-207 kernel: [67848.590888] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:14:34 juju-e4d256-prod-github-runner-207 kernel: [67848.591943] ? _raw_spin_lock+0x22/0x30 Aug 23 00:14:34 juju-e4d256-prod-github-runner-207 kernel: [67848.592905] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:14:34 juju-e4d256-prod-github-runner-207 kernel: [67848.593955] direct_page_fault+0x206/0x310 [kvm] Aug 23 00:14:34 juju-e4d256-prod-github-runner-207 kernel: [67848.594989] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 00:14:34 juju-e4d256-prod-github-runner-207 kernel: [67848.596008] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 00:14:34 juju-e4d256-prod-github-runner-207 kernel: [67848.597016] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 00:14:34 juju-e4d256-prod-github-runner-207 kernel: [67848.598029] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 00:14:34 juju-e4d256-prod-github-runner-207 kernel: [67848.598984] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 00:14:34 juju-e4d256-prod-github-runner-207 kernel: [67848.599970] handle_exit+0x98/0x230 [kvm_amd] Aug 23 00:14:34 juju-e4d256-prod-github-runner-207 kernel: [67848.600869] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 00:14:34 juju-e4d256-prod-github-runner-207 kernel: [67848.601804] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 00:14:34 juju-e4d256-prod-github-runner-207 kernel: [67848.602741] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 00:14:34 juju-e4d256-prod-github-runner-207 kernel: [67848.603653] vcpu_run+0x62/0x2c0 [kvm] Aug 23 00:14:34 juju-e4d256-prod-github-runner-207 kernel: [67848.604479] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 00:14:34 juju-e4d256-prod-github-runner-207 kernel: [67848.605305] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 00:14:34 juju-e4d256-prod-github-runner-207 kernel: [67848.606182] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 00:14:34 juju-e4d256-prod-github-runner-207 kernel: [67848.606988] ? __seccomp_filter+0x4a/0x4a0 Aug 23 00:14:34 juju-e4d256-prod-github-runner-207 kernel: [67848.607758] ? __fget_files+0x86/0xc0 Aug 23 00:14:34 juju-e4d256-prod-github-runner-207 kernel: [67848.608472] __x64_sys_ioctl+0x95/0xd0 Aug 23 00:14:34 juju-e4d256-prod-github-runner-207 kernel: [67848.609178] do_syscall_64+0x5c/0xc0 Aug 23 00:14:34 juju-e4d256-prod-github-runner-207 kernel: [67848.609904] ? do_futex+0x162/0x1f0 Aug 23 00:14:34 juju-e4d256-prod-github-runner-207 kernel: [67848.610573] ? __x64_sys_futex+0x78/0x1e0 Aug 23 00:14:34 juju-e4d256-prod-github-runner-207 kernel: [67848.611266] ? __secure_computing+0xa9/0x120 Aug 23 00:14:34 juju-e4d256-prod-github-runner-207 kernel: [67848.612023] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 00:14:34 juju-e4d256-prod-github-runner-207 kernel: [67848.612821] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:14:34 juju-e4d256-prod-github-runner-207 kernel: [67848.613581] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:14:34 juju-e4d256-prod-github-runner-207 kernel: [67848.614316] ? do_syscall_64+0x69/0xc0 Aug 23 00:14:34 juju-e4d256-prod-github-runner-207 kernel: [67848.615029] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:14:34 juju-e4d256-prod-github-runner-207 kernel: [67848.615785] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:14:34 juju-e4d256-prod-github-runner-207 kernel: [67848.616590] ? do_syscall_64+0x69/0xc0 Aug 23 00:14:34 juju-e4d256-prod-github-runner-207 kernel: [67848.617254] ? do_syscall_64+0x69/0xc0 Aug 23 00:14:34 juju-e4d256-prod-github-runner-207 kernel: [67848.618126] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 00:14:34 juju-e4d256-prod-github-runner-207 kernel: [67848.618864] RIP: 0033:0x7faa5d0edaff Aug 23 00:14:34 juju-e4d256-prod-github-runner-207 kernel: [67848.619544] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 00:14:34 juju-e4d256-prod-github-runner-207 kernel: [67848.621844] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 00:14:34 juju-e4d256-prod-github-runner-207 kernel: [67848.622777] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 00:14:34 juju-e4d256-prod-github-runner-207 kernel: [67848.623697] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 00:14:34 juju-e4d256-prod-github-runner-207 kernel: [67848.624614] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 00:14:34 juju-e4d256-prod-github-runner-207 kernel: [67848.625542] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 00:14:34 juju-e4d256-prod-github-runner-207 kernel: [67848.626455] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 00:14:34 juju-e4d256-prod-github-runner-207 kernel: [67848.627376] Aug 23 00:14:47 juju-e4d256-prod-github-runner-207 kernel: [67861.712706] rcu: INFO: rcu_sched self-detected stall on CPU Aug 23 00:14:47 juju-e4d256-prod-github-runner-207 kernel: [67861.713794] rcu: 1-....: (16882749 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=8150756 Aug 23 00:14:47 juju-e4d256-prod-github-runner-207 kernel: [67861.715058] (t=16936128 jiffies g=23269 q=58958) Aug 23 00:14:47 juju-e4d256-prod-github-runner-207 kernel: [67861.715896] NMI backtrace for cpu 1 Aug 23 00:14:47 juju-e4d256-prod-github-runner-207 kernel: [67861.716636] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 00:14:47 juju-e4d256-prod-github-runner-207 kernel: [67861.717790] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 00:14:47 juju-e4d256-prod-github-runner-207 kernel: [67861.718889] Call Trace: Aug 23 00:14:47 juju-e4d256-prod-github-runner-207 kernel: [67861.719579] Aug 23 00:14:47 juju-e4d256-prod-github-runner-207 kernel: [67861.720228] show_stack+0x52/0x5c Aug 23 00:14:47 juju-e4d256-prod-github-runner-207 kernel: [67861.720969] dump_stack_lvl+0x4a/0x63 Aug 23 00:14:47 juju-e4d256-prod-github-runner-207 kernel: [67861.721752] dump_stack+0x10/0x16 Aug 23 00:14:47 juju-e4d256-prod-github-runner-207 kernel: [67861.722546] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 23 00:14:47 juju-e4d256-prod-github-runner-207 kernel: [67861.723378] ? lapic_can_unplug_cpu+0x90/0x90 Aug 23 00:14:47 juju-e4d256-prod-github-runner-207 kernel: [67861.724180] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 23 00:14:47 juju-e4d256-prod-github-runner-207 kernel: [67861.725033] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 23 00:14:47 juju-e4d256-prod-github-runner-207 kernel: [67861.725886] trigger_single_cpu_backtrace+0x44/0x4f Aug 23 00:14:47 juju-e4d256-prod-github-runner-207 kernel: [67861.726710] rcu_dump_cpu_stacks+0x102/0x149 Aug 23 00:14:47 juju-e4d256-prod-github-runner-207 kernel: [67861.727494] print_cpu_stall.cold+0x2f/0xe2 Aug 23 00:14:47 juju-e4d256-prod-github-runner-207 kernel: [67861.728278] ? timekeeping_update+0xf7/0x150 Aug 23 00:14:47 juju-e4d256-prod-github-runner-207 kernel: [67861.729060] check_cpu_stall+0x109/0x270 Aug 23 00:14:47 juju-e4d256-prod-github-runner-207 kernel: [67861.729844] rcu_sched_clock_irq+0x9a/0x250 Aug 23 00:14:47 juju-e4d256-prod-github-runner-207 kernel: [67861.730613] update_process_times+0x94/0xd0 Aug 23 00:14:47 juju-e4d256-prod-github-runner-207 kernel: [67861.731385] tick_sched_handle+0x29/0x70 Aug 23 00:14:47 juju-e4d256-prod-github-runner-207 kernel: [67861.732139] tick_sched_timer+0x8c/0xc0 Aug 23 00:14:47 juju-e4d256-prod-github-runner-207 kernel: [67861.732895] ? tick_nohz_handler+0xb0/0xb0 Aug 23 00:14:47 juju-e4d256-prod-github-runner-207 kernel: [67861.733794] __hrtimer_run_queues+0x107/0x230 Aug 23 00:14:47 juju-e4d256-prod-github-runner-207 kernel: [67861.734586] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 00:14:47 juju-e4d256-prod-github-runner-207 kernel: [67861.735385] hrtimer_interrupt+0x101/0x220 Aug 23 00:14:47 juju-e4d256-prod-github-runner-207 kernel: [67861.736166] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 00:14:47 juju-e4d256-prod-github-runner-207 kernel: [67861.736997] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 00:14:47 juju-e4d256-prod-github-runner-207 kernel: [67861.737840] Aug 23 00:14:47 juju-e4d256-prod-github-runner-207 kernel: [67861.738485] Aug 23 00:14:47 juju-e4d256-prod-github-runner-207 kernel: [67861.739122] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 00:14:47 juju-e4d256-prod-github-runner-207 kernel: [67861.739956] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:14:47 juju-e4d256-prod-github-runner-207 kernel: [67861.740864] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 00:14:47 juju-e4d256-prod-github-runner-207 kernel: [67861.743152] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 00:14:47 juju-e4d256-prod-github-runner-207 kernel: [67861.744048] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 00:14:47 juju-e4d256-prod-github-runner-207 kernel: [67861.745066] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 00:14:47 juju-e4d256-prod-github-runner-207 kernel: [67861.746078] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 00:14:47 juju-e4d256-prod-github-runner-207 kernel: [67861.747065] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 00:14:47 juju-e4d256-prod-github-runner-207 kernel: [67861.748065] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 00:14:47 juju-e4d256-prod-github-runner-207 kernel: [67861.749041] ? _raw_spin_lock+0x22/0x30 Aug 23 00:14:47 juju-e4d256-prod-github-runner-207 kernel: [67861.749836] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:14:47 juju-e4d256-prod-github-runner-207 kernel: [67861.750688] direct_page_fault+0x206/0x310 [kvm] Aug 23 00:14:47 juju-e4d256-prod-github-runner-207 kernel: [67861.751541] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 00:14:47 juju-e4d256-prod-github-runner-207 kernel: [67861.752400] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 00:14:47 juju-e4d256-prod-github-runner-207 kernel: [67861.753249] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 00:14:47 juju-e4d256-prod-github-runner-207 kernel: [67861.754116] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 00:14:47 juju-e4d256-prod-github-runner-207 kernel: [67861.754929] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 00:14:47 juju-e4d256-prod-github-runner-207 kernel: [67861.755785] handle_exit+0x98/0x230 [kvm_amd] Aug 23 00:14:47 juju-e4d256-prod-github-runner-207 kernel: [67861.756552] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 00:14:47 juju-e4d256-prod-github-runner-207 kernel: [67861.757352] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 00:14:47 juju-e4d256-prod-github-runner-207 kernel: [67861.758183] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 00:14:47 juju-e4d256-prod-github-runner-207 kernel: [67861.758984] vcpu_run+0x62/0x2c0 [kvm] Aug 23 00:14:47 juju-e4d256-prod-github-runner-207 kernel: [67861.759728] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 00:14:47 juju-e4d256-prod-github-runner-207 kernel: [67861.760479] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 00:14:47 juju-e4d256-prod-github-runner-207 kernel: [67861.761293] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 00:14:47 juju-e4d256-prod-github-runner-207 kernel: [67861.762091] ? __seccomp_filter+0x4a/0x4a0 Aug 23 00:14:47 juju-e4d256-prod-github-runner-207 kernel: [67861.762828] ? __fget_files+0x86/0xc0 Aug 23 00:14:47 juju-e4d256-prod-github-runner-207 kernel: [67861.763531] __x64_sys_ioctl+0x95/0xd0 Aug 23 00:14:47 juju-e4d256-prod-github-runner-207 kernel: [67861.764237] do_syscall_64+0x5c/0xc0 Aug 23 00:14:47 juju-e4d256-prod-github-runner-207 kernel: [67861.764927] ? do_futex+0x162/0x1f0 Aug 23 00:14:47 juju-e4d256-prod-github-runner-207 kernel: [67861.765627] ? __x64_sys_futex+0x78/0x1e0 Aug 23 00:14:47 juju-e4d256-prod-github-runner-207 kernel: [67861.766345] ? __secure_computing+0xa9/0x120 Aug 23 00:14:47 juju-e4d256-prod-github-runner-207 kernel: [67861.767076] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 00:14:47 juju-e4d256-prod-github-runner-207 kernel: [67861.767881] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:14:47 juju-e4d256-prod-github-runner-207 kernel: [67861.768650] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:14:47 juju-e4d256-prod-github-runner-207 kernel: [67861.769442] ? do_syscall_64+0x69/0xc0 Aug 23 00:14:47 juju-e4d256-prod-github-runner-207 kernel: [67861.770148] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:14:47 juju-e4d256-prod-github-runner-207 kernel: [67861.770929] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:14:47 juju-e4d256-prod-github-runner-207 kernel: [67861.771703] ? do_syscall_64+0x69/0xc0 Aug 23 00:14:47 juju-e4d256-prod-github-runner-207 kernel: [67861.772421] ? do_syscall_64+0x69/0xc0 Aug 23 00:14:47 juju-e4d256-prod-github-runner-207 kernel: [67861.773119] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 00:14:47 juju-e4d256-prod-github-runner-207 kernel: [67861.773915] RIP: 0033:0x7faa5d0edaff Aug 23 00:14:47 juju-e4d256-prod-github-runner-207 kernel: [67861.774607] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 00:14:47 juju-e4d256-prod-github-runner-207 kernel: [67861.776766] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 00:14:47 juju-e4d256-prod-github-runner-207 kernel: [67861.777779] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 00:14:47 juju-e4d256-prod-github-runner-207 kernel: [67861.778751] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 00:14:47 juju-e4d256-prod-github-runner-207 kernel: [67861.779724] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 00:14:47 juju-e4d256-prod-github-runner-207 kernel: [67861.780683] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 00:14:47 juju-e4d256-prod-github-runner-207 kernel: [67861.781649] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 00:14:47 juju-e4d256-prod-github-runner-207 kernel: [67861.782597] Aug 23 00:15:14 juju-e4d256-prod-github-runner-207 kernel: [67888.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 63118s! [qemu-system-x86:6715] Aug 23 00:15:14 juju-e4d256-prod-github-runner-207 kernel: [67888.543162] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 00:15:14 juju-e4d256-prod-github-runner-207 kernel: [67888.543241] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 00:15:14 juju-e4d256-prod-github-runner-207 kernel: [67888.555604] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 00:15:14 juju-e4d256-prod-github-runner-207 kernel: [67888.557222] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 00:15:14 juju-e4d256-prod-github-runner-207 kernel: [67888.558450] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:15:14 juju-e4d256-prod-github-runner-207 kernel: [67888.559508] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 00:15:14 juju-e4d256-prod-github-runner-207 kernel: [67888.562264] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 00:15:14 juju-e4d256-prod-github-runner-207 kernel: [67888.563357] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 00:15:14 juju-e4d256-prod-github-runner-207 kernel: [67888.564546] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 00:15:14 juju-e4d256-prod-github-runner-207 kernel: [67888.565754] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 00:15:14 juju-e4d256-prod-github-runner-207 kernel: [67888.566924] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 00:15:14 juju-e4d256-prod-github-runner-207 kernel: [67888.568148] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 00:15:14 juju-e4d256-prod-github-runner-207 kernel: [67888.569365] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 00:15:14 juju-e4d256-prod-github-runner-207 kernel: [67888.570680] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 00:15:14 juju-e4d256-prod-github-runner-207 kernel: [67888.571787] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 00:15:14 juju-e4d256-prod-github-runner-207 kernel: [67888.572984] Call Trace: Aug 23 00:15:14 juju-e4d256-prod-github-runner-207 kernel: [67888.573917] Aug 23 00:15:14 juju-e4d256-prod-github-runner-207 kernel: [67888.574800] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:15:14 juju-e4d256-prod-github-runner-207 kernel: [67888.575852] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:15:14 juju-e4d256-prod-github-runner-207 kernel: [67888.576892] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:15:14 juju-e4d256-prod-github-runner-207 kernel: [67888.577985] ? show_regs.part.0+0x23/0x29 Aug 23 00:15:14 juju-e4d256-prod-github-runner-207 kernel: [67888.578980] ? show_regs.cold+0x8/0xd Aug 23 00:15:14 juju-e4d256-prod-github-runner-207 kernel: [67888.579956] ? watchdog_timer_fn+0x1be/0x220 Aug 23 00:15:14 juju-e4d256-prod-github-runner-207 kernel: [67888.580963] ? lockup_detector_update_enable+0x60/0x60 Aug 23 00:15:14 juju-e4d256-prod-github-runner-207 kernel: [67888.582040] ? __hrtimer_run_queues+0x107/0x230 Aug 23 00:15:14 juju-e4d256-prod-github-runner-207 kernel: [67888.583071] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 00:15:14 juju-e4d256-prod-github-runner-207 kernel: [67888.584244] ? hrtimer_interrupt+0x101/0x220 Aug 23 00:15:14 juju-e4d256-prod-github-runner-207 kernel: [67888.585285] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 00:15:14 juju-e4d256-prod-github-runner-207 kernel: [67888.586621] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 00:15:14 juju-e4d256-prod-github-runner-207 kernel: [67888.587710] Aug 23 00:15:14 juju-e4d256-prod-github-runner-207 kernel: [67888.588587] Aug 23 00:15:14 juju-e4d256-prod-github-runner-207 kernel: [67888.589456] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 00:15:14 juju-e4d256-prod-github-runner-207 kernel: [67888.590528] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:15:14 juju-e4d256-prod-github-runner-207 kernel: [67888.591631] ? _raw_spin_lock+0x22/0x30 Aug 23 00:15:14 juju-e4d256-prod-github-runner-207 kernel: [67888.592663] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:15:14 juju-e4d256-prod-github-runner-207 kernel: [67888.593725] direct_page_fault+0x206/0x310 [kvm] Aug 23 00:15:14 juju-e4d256-prod-github-runner-207 kernel: [67888.594774] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 00:15:14 juju-e4d256-prod-github-runner-207 kernel: [67888.595822] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 00:15:14 juju-e4d256-prod-github-runner-207 kernel: [67888.596833] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 00:15:14 juju-e4d256-prod-github-runner-207 kernel: [67888.597867] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 00:15:14 juju-e4d256-prod-github-runner-207 kernel: [67888.598815] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 00:15:14 juju-e4d256-prod-github-runner-207 kernel: [67888.599796] handle_exit+0x98/0x230 [kvm_amd] Aug 23 00:15:14 juju-e4d256-prod-github-runner-207 kernel: [67888.600692] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 00:15:14 juju-e4d256-prod-github-runner-207 kernel: [67888.601621] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 00:15:14 juju-e4d256-prod-github-runner-207 kernel: [67888.602548] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 00:15:14 juju-e4d256-prod-github-runner-207 kernel: [67888.603456] vcpu_run+0x62/0x2c0 [kvm] Aug 23 00:15:14 juju-e4d256-prod-github-runner-207 kernel: [67888.604273] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 00:15:14 juju-e4d256-prod-github-runner-207 kernel: [67888.605104] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 00:15:14 juju-e4d256-prod-github-runner-207 kernel: [67888.605973] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 00:15:14 juju-e4d256-prod-github-runner-207 kernel: [67888.606772] ? __seccomp_filter+0x4a/0x4a0 Aug 23 00:15:14 juju-e4d256-prod-github-runner-207 kernel: [67888.607517] ? __fget_files+0x86/0xc0 Aug 23 00:15:14 juju-e4d256-prod-github-runner-207 kernel: [67888.608239] __x64_sys_ioctl+0x95/0xd0 Aug 23 00:15:14 juju-e4d256-prod-github-runner-207 kernel: [67888.608934] do_syscall_64+0x5c/0xc0 Aug 23 00:15:14 juju-e4d256-prod-github-runner-207 kernel: [67888.609613] ? do_futex+0x162/0x1f0 Aug 23 00:15:14 juju-e4d256-prod-github-runner-207 kernel: [67888.610265] ? __x64_sys_futex+0x78/0x1e0 Aug 23 00:15:14 juju-e4d256-prod-github-runner-207 kernel: [67888.610944] ? __secure_computing+0xa9/0x120 Aug 23 00:15:14 juju-e4d256-prod-github-runner-207 kernel: [67888.611636] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 00:15:14 juju-e4d256-prod-github-runner-207 kernel: [67888.612414] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:15:14 juju-e4d256-prod-github-runner-207 kernel: [67888.613154] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:15:14 juju-e4d256-prod-github-runner-207 kernel: [67888.613906] ? do_syscall_64+0x69/0xc0 Aug 23 00:15:14 juju-e4d256-prod-github-runner-207 kernel: [67888.614568] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:15:14 juju-e4d256-prod-github-runner-207 kernel: [67888.615291] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:15:14 juju-e4d256-prod-github-runner-207 kernel: [67888.616119] ? do_syscall_64+0x69/0xc0 Aug 23 00:15:14 juju-e4d256-prod-github-runner-207 kernel: [67888.616815] ? do_syscall_64+0x69/0xc0 Aug 23 00:15:14 juju-e4d256-prod-github-runner-207 kernel: [67888.617463] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 00:15:14 juju-e4d256-prod-github-runner-207 kernel: [67888.618172] RIP: 0033:0x7faa5d0edaff Aug 23 00:15:14 juju-e4d256-prod-github-runner-207 kernel: [67888.618802] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 00:15:14 juju-e4d256-prod-github-runner-207 kernel: [67888.620804] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 00:15:14 juju-e4d256-prod-github-runner-207 kernel: [67888.621847] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 00:15:14 juju-e4d256-prod-github-runner-207 kernel: [67888.622763] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 00:15:14 juju-e4d256-prod-github-runner-207 kernel: [67888.623664] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 00:15:14 juju-e4d256-prod-github-runner-207 kernel: [67888.624766] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 00:15:14 juju-e4d256-prod-github-runner-207 kernel: [67888.625842] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 00:15:14 juju-e4d256-prod-github-runner-207 kernel: [67888.626922] Aug 23 00:15:42 juju-e4d256-prod-github-runner-207 kernel: [67916.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 63144s! [qemu-system-x86:6715] Aug 23 00:15:42 juju-e4d256-prod-github-runner-207 kernel: [67916.544078] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 00:15:42 juju-e4d256-prod-github-runner-207 kernel: [67916.544403] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 00:15:42 juju-e4d256-prod-github-runner-207 kernel: [67916.556648] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 00:15:42 juju-e4d256-prod-github-runner-207 kernel: [67916.557940] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 00:15:42 juju-e4d256-prod-github-runner-207 kernel: [67916.559163] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:15:42 juju-e4d256-prod-github-runner-207 kernel: [67916.560218] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 00:15:42 juju-e4d256-prod-github-runner-207 kernel: [67916.562766] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 00:15:42 juju-e4d256-prod-github-runner-207 kernel: [67916.563807] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 00:15:42 juju-e4d256-prod-github-runner-207 kernel: [67916.564974] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 00:15:42 juju-e4d256-prod-github-runner-207 kernel: [67916.566154] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 00:15:42 juju-e4d256-prod-github-runner-207 kernel: [67916.567323] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 00:15:42 juju-e4d256-prod-github-runner-207 kernel: [67916.568482] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 00:15:42 juju-e4d256-prod-github-runner-207 kernel: [67916.569668] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 00:15:42 juju-e4d256-prod-github-runner-207 kernel: [67916.570898] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 00:15:42 juju-e4d256-prod-github-runner-207 kernel: [67916.571992] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 00:15:42 juju-e4d256-prod-github-runner-207 kernel: [67916.573198] Call Trace: Aug 23 00:15:42 juju-e4d256-prod-github-runner-207 kernel: [67916.574110] Aug 23 00:15:42 juju-e4d256-prod-github-runner-207 kernel: [67916.575006] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:15:42 juju-e4d256-prod-github-runner-207 kernel: [67916.576047] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:15:42 juju-e4d256-prod-github-runner-207 kernel: [67916.577098] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:15:42 juju-e4d256-prod-github-runner-207 kernel: [67916.578195] ? show_regs.part.0+0x23/0x29 Aug 23 00:15:42 juju-e4d256-prod-github-runner-207 kernel: [67916.579194] ? show_regs.cold+0x8/0xd Aug 23 00:15:42 juju-e4d256-prod-github-runner-207 kernel: [67916.580223] ? watchdog_timer_fn+0x1be/0x220 Aug 23 00:15:42 juju-e4d256-prod-github-runner-207 kernel: [67916.581256] ? lockup_detector_update_enable+0x60/0x60 Aug 23 00:15:42 juju-e4d256-prod-github-runner-207 kernel: [67916.582324] ? __hrtimer_run_queues+0x107/0x230 Aug 23 00:15:42 juju-e4d256-prod-github-runner-207 kernel: [67916.583352] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 00:15:42 juju-e4d256-prod-github-runner-207 kernel: [67916.584374] ? hrtimer_interrupt+0x101/0x220 Aug 23 00:15:42 juju-e4d256-prod-github-runner-207 kernel: [67916.585406] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 00:15:42 juju-e4d256-prod-github-runner-207 kernel: [67916.586494] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 00:15:42 juju-e4d256-prod-github-runner-207 kernel: [67916.587562] Aug 23 00:15:42 juju-e4d256-prod-github-runner-207 kernel: [67916.588413] Aug 23 00:15:42 juju-e4d256-prod-github-runner-207 kernel: [67916.589262] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 00:15:42 juju-e4d256-prod-github-runner-207 kernel: [67916.590292] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:15:42 juju-e4d256-prod-github-runner-207 kernel: [67916.591326] ? _raw_spin_lock+0x22/0x30 Aug 23 00:15:42 juju-e4d256-prod-github-runner-207 kernel: [67916.592268] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:15:42 juju-e4d256-prod-github-runner-207 kernel: [67916.593295] direct_page_fault+0x206/0x310 [kvm] Aug 23 00:15:42 juju-e4d256-prod-github-runner-207 kernel: [67916.594317] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 00:15:42 juju-e4d256-prod-github-runner-207 kernel: [67916.595328] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 00:15:42 juju-e4d256-prod-github-runner-207 kernel: [67916.596327] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 00:15:42 juju-e4d256-prod-github-runner-207 kernel: [67916.597369] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 00:15:42 juju-e4d256-prod-github-runner-207 kernel: [67916.598325] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 00:15:42 juju-e4d256-prod-github-runner-207 kernel: [67916.599302] handle_exit+0x98/0x230 [kvm_amd] Aug 23 00:15:42 juju-e4d256-prod-github-runner-207 kernel: [67916.600192] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 00:15:42 juju-e4d256-prod-github-runner-207 kernel: [67916.601115] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 00:15:42 juju-e4d256-prod-github-runner-207 kernel: [67916.602045] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 00:15:42 juju-e4d256-prod-github-runner-207 kernel: [67916.602949] vcpu_run+0x62/0x2c0 [kvm] Aug 23 00:15:42 juju-e4d256-prod-github-runner-207 kernel: [67916.603805] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 00:15:42 juju-e4d256-prod-github-runner-207 kernel: [67916.604618] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 00:15:42 juju-e4d256-prod-github-runner-207 kernel: [67916.605497] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 00:15:42 juju-e4d256-prod-github-runner-207 kernel: [67916.606335] ? __seccomp_filter+0x4a/0x4a0 Aug 23 00:15:42 juju-e4d256-prod-github-runner-207 kernel: [67916.607103] ? __fget_files+0x86/0xc0 Aug 23 00:15:42 juju-e4d256-prod-github-runner-207 kernel: [67916.607832] __x64_sys_ioctl+0x95/0xd0 Aug 23 00:15:42 juju-e4d256-prod-github-runner-207 kernel: [67916.608559] do_syscall_64+0x5c/0xc0 Aug 23 00:15:42 juju-e4d256-prod-github-runner-207 kernel: [67916.609239] ? do_futex+0x162/0x1f0 Aug 23 00:15:42 juju-e4d256-prod-github-runner-207 kernel: [67916.609895] ? __x64_sys_futex+0x78/0x1e0 Aug 23 00:15:42 juju-e4d256-prod-github-runner-207 kernel: [67916.610572] ? __secure_computing+0xa9/0x120 Aug 23 00:15:42 juju-e4d256-prod-github-runner-207 kernel: [67916.611259] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 00:15:42 juju-e4d256-prod-github-runner-207 kernel: [67916.612019] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:15:42 juju-e4d256-prod-github-runner-207 kernel: [67916.612791] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:15:42 juju-e4d256-prod-github-runner-207 kernel: [67916.613564] ? do_syscall_64+0x69/0xc0 Aug 23 00:15:42 juju-e4d256-prod-github-runner-207 kernel: [67916.614260] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:15:42 juju-e4d256-prod-github-runner-207 kernel: [67916.615141] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:15:42 juju-e4d256-prod-github-runner-207 kernel: [67916.615881] ? do_syscall_64+0x69/0xc0 Aug 23 00:15:42 juju-e4d256-prod-github-runner-207 kernel: [67916.616542] ? do_syscall_64+0x69/0xc0 Aug 23 00:15:42 juju-e4d256-prod-github-runner-207 kernel: [67916.617198] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 00:15:42 juju-e4d256-prod-github-runner-207 kernel: [67916.617940] RIP: 0033:0x7faa5d0edaff Aug 23 00:15:42 juju-e4d256-prod-github-runner-207 kernel: [67916.618614] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 00:15:42 juju-e4d256-prod-github-runner-207 kernel: [67916.620642] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 00:15:42 juju-e4d256-prod-github-runner-207 kernel: [67916.621572] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 00:15:42 juju-e4d256-prod-github-runner-207 kernel: [67916.622463] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 00:15:42 juju-e4d256-prod-github-runner-207 kernel: [67916.623362] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 00:15:42 juju-e4d256-prod-github-runner-207 kernel: [67916.624305] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 00:15:42 juju-e4d256-prod-github-runner-207 kernel: [67916.625318] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 00:15:42 juju-e4d256-prod-github-runner-207 kernel: [67916.626264] Aug 23 00:16:10 juju-e4d256-prod-github-runner-207 kernel: [67944.541981] watchdog: BUG: soft lockup - CPU#1 stuck for 63170s! [qemu-system-x86:6715] Aug 23 00:16:10 juju-e4d256-prod-github-runner-207 kernel: [67944.543113] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 00:16:10 juju-e4d256-prod-github-runner-207 kernel: [67944.543189] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 00:16:10 juju-e4d256-prod-github-runner-207 kernel: [67944.555749] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 00:16:10 juju-e4d256-prod-github-runner-207 kernel: [67944.557080] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 00:16:10 juju-e4d256-prod-github-runner-207 kernel: [67944.558314] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:16:10 juju-e4d256-prod-github-runner-207 kernel: [67944.559394] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 00:16:10 juju-e4d256-prod-github-runner-207 kernel: [67944.561978] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 00:16:10 juju-e4d256-prod-github-runner-207 kernel: [67944.563018] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 00:16:10 juju-e4d256-prod-github-runner-207 kernel: [67944.564199] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 00:16:10 juju-e4d256-prod-github-runner-207 kernel: [67944.565407] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 00:16:10 juju-e4d256-prod-github-runner-207 kernel: [67944.566604] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 00:16:10 juju-e4d256-prod-github-runner-207 kernel: [67944.567777] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 00:16:10 juju-e4d256-prod-github-runner-207 kernel: [67944.569009] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 00:16:10 juju-e4d256-prod-github-runner-207 kernel: [67944.570254] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 00:16:10 juju-e4d256-prod-github-runner-207 kernel: [67944.571352] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 00:16:10 juju-e4d256-prod-github-runner-207 kernel: [67944.572561] Call Trace: Aug 23 00:16:10 juju-e4d256-prod-github-runner-207 kernel: [67944.573472] Aug 23 00:16:10 juju-e4d256-prod-github-runner-207 kernel: [67944.574357] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:16:10 juju-e4d256-prod-github-runner-207 kernel: [67944.575385] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:16:10 juju-e4d256-prod-github-runner-207 kernel: [67944.576416] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:16:10 juju-e4d256-prod-github-runner-207 kernel: [67944.577497] ? show_regs.part.0+0x23/0x29 Aug 23 00:16:10 juju-e4d256-prod-github-runner-207 kernel: [67944.578588] ? show_regs.cold+0x8/0xd Aug 23 00:16:10 juju-e4d256-prod-github-runner-207 kernel: [67944.579713] ? watchdog_timer_fn+0x1be/0x220 Aug 23 00:16:10 juju-e4d256-prod-github-runner-207 kernel: [67944.580750] ? lockup_detector_update_enable+0x60/0x60 Aug 23 00:16:10 juju-e4d256-prod-github-runner-207 kernel: [67944.581814] ? __hrtimer_run_queues+0x107/0x230 Aug 23 00:16:10 juju-e4d256-prod-github-runner-207 kernel: [67944.582841] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 00:16:10 juju-e4d256-prod-github-runner-207 kernel: [67944.583890] ? hrtimer_interrupt+0x101/0x220 Aug 23 00:16:10 juju-e4d256-prod-github-runner-207 kernel: [67944.584925] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 00:16:10 juju-e4d256-prod-github-runner-207 kernel: [67944.586036] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 00:16:10 juju-e4d256-prod-github-runner-207 kernel: [67944.587082] Aug 23 00:16:10 juju-e4d256-prod-github-runner-207 kernel: [67944.587942] Aug 23 00:16:10 juju-e4d256-prod-github-runner-207 kernel: [67944.588794] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 00:16:10 juju-e4d256-prod-github-runner-207 kernel: [67944.589831] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:16:10 juju-e4d256-prod-github-runner-207 kernel: [67944.590869] ? _raw_spin_lock+0x22/0x30 Aug 23 00:16:10 juju-e4d256-prod-github-runner-207 kernel: [67944.591818] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:16:10 juju-e4d256-prod-github-runner-207 kernel: [67944.592850] direct_page_fault+0x206/0x310 [kvm] Aug 23 00:16:10 juju-e4d256-prod-github-runner-207 kernel: [67944.593881] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 00:16:10 juju-e4d256-prod-github-runner-207 kernel: [67944.594945] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 00:16:10 juju-e4d256-prod-github-runner-207 kernel: [67944.595972] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 00:16:10 juju-e4d256-prod-github-runner-207 kernel: [67944.596983] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 00:16:10 juju-e4d256-prod-github-runner-207 kernel: [67944.597953] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 00:16:10 juju-e4d256-prod-github-runner-207 kernel: [67944.598945] handle_exit+0x98/0x230 [kvm_amd] Aug 23 00:16:10 juju-e4d256-prod-github-runner-207 kernel: [67944.599840] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 00:16:10 juju-e4d256-prod-github-runner-207 kernel: [67944.600761] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 00:16:10 juju-e4d256-prod-github-runner-207 kernel: [67944.601682] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 00:16:10 juju-e4d256-prod-github-runner-207 kernel: [67944.602596] vcpu_run+0x62/0x2c0 [kvm] Aug 23 00:16:10 juju-e4d256-prod-github-runner-207 kernel: [67944.603415] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 00:16:10 juju-e4d256-prod-github-runner-207 kernel: [67944.604245] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 00:16:10 juju-e4d256-prod-github-runner-207 kernel: [67944.605193] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 00:16:10 juju-e4d256-prod-github-runner-207 kernel: [67944.606005] ? __seccomp_filter+0x4a/0x4a0 Aug 23 00:16:10 juju-e4d256-prod-github-runner-207 kernel: [67944.606763] ? __fget_files+0x86/0xc0 Aug 23 00:16:10 juju-e4d256-prod-github-runner-207 kernel: [67944.607480] __x64_sys_ioctl+0x95/0xd0 Aug 23 00:16:10 juju-e4d256-prod-github-runner-207 kernel: [67944.608195] do_syscall_64+0x5c/0xc0 Aug 23 00:16:10 juju-e4d256-prod-github-runner-207 kernel: [67944.608911] ? do_futex+0x162/0x1f0 Aug 23 00:16:10 juju-e4d256-prod-github-runner-207 kernel: [67944.609709] ? __x64_sys_futex+0x78/0x1e0 Aug 23 00:16:10 juju-e4d256-prod-github-runner-207 kernel: [67944.610515] ? __secure_computing+0xa9/0x120 Aug 23 00:16:10 juju-e4d256-prod-github-runner-207 kernel: [67944.611220] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 00:16:10 juju-e4d256-prod-github-runner-207 kernel: [67944.611981] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:16:10 juju-e4d256-prod-github-runner-207 kernel: [67944.612738] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:16:10 juju-e4d256-prod-github-runner-207 kernel: [67944.613462] ? do_syscall_64+0x69/0xc0 Aug 23 00:16:10 juju-e4d256-prod-github-runner-207 kernel: [67944.614121] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:16:10 juju-e4d256-prod-github-runner-207 kernel: [67944.614826] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:16:10 juju-e4d256-prod-github-runner-207 kernel: [67944.615525] ? do_syscall_64+0x69/0xc0 Aug 23 00:16:10 juju-e4d256-prod-github-runner-207 kernel: [67944.616150] ? do_syscall_64+0x69/0xc0 Aug 23 00:16:10 juju-e4d256-prod-github-runner-207 kernel: [67944.616789] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 00:16:10 juju-e4d256-prod-github-runner-207 kernel: [67944.617497] RIP: 0033:0x7faa5d0edaff Aug 23 00:16:10 juju-e4d256-prod-github-runner-207 kernel: [67944.618127] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 00:16:10 juju-e4d256-prod-github-runner-207 kernel: [67944.620116] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 00:16:10 juju-e4d256-prod-github-runner-207 kernel: [67944.621041] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 00:16:10 juju-e4d256-prod-github-runner-207 kernel: [67944.621934] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 00:16:10 juju-e4d256-prod-github-runner-207 kernel: [67944.622822] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 00:16:10 juju-e4d256-prod-github-runner-207 kernel: [67944.623707] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 00:16:10 juju-e4d256-prod-github-runner-207 kernel: [67944.624611] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 00:16:10 juju-e4d256-prod-github-runner-207 kernel: [67944.625514] Aug 23 00:16:38 juju-e4d256-prod-github-runner-207 kernel: [67972.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 63196s! [qemu-system-x86:6715] Aug 23 00:16:38 juju-e4d256-prod-github-runner-207 kernel: [67972.543123] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 00:16:38 juju-e4d256-prod-github-runner-207 kernel: [67972.543199] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 00:16:38 juju-e4d256-prod-github-runner-207 kernel: [67972.555467] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 00:16:38 juju-e4d256-prod-github-runner-207 kernel: [67972.556779] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 00:16:38 juju-e4d256-prod-github-runner-207 kernel: [67972.558005] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:16:38 juju-e4d256-prod-github-runner-207 kernel: [67972.559090] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 00:16:38 juju-e4d256-prod-github-runner-207 kernel: [67972.561683] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 00:16:38 juju-e4d256-prod-github-runner-207 kernel: [67972.562749] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 00:16:38 juju-e4d256-prod-github-runner-207 kernel: [67972.563920] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 00:16:38 juju-e4d256-prod-github-runner-207 kernel: [67972.565093] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 00:16:38 juju-e4d256-prod-github-runner-207 kernel: [67972.566278] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 00:16:38 juju-e4d256-prod-github-runner-207 kernel: [67972.567457] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 00:16:38 juju-e4d256-prod-github-runner-207 kernel: [67972.568658] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 00:16:38 juju-e4d256-prod-github-runner-207 kernel: [67972.569900] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 00:16:38 juju-e4d256-prod-github-runner-207 kernel: [67972.571039] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 00:16:38 juju-e4d256-prod-github-runner-207 kernel: [67972.572266] Call Trace: Aug 23 00:16:38 juju-e4d256-prod-github-runner-207 kernel: [67972.573183] Aug 23 00:16:38 juju-e4d256-prod-github-runner-207 kernel: [67972.574071] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:16:38 juju-e4d256-prod-github-runner-207 kernel: [67972.575099] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:16:38 juju-e4d256-prod-github-runner-207 kernel: [67972.576150] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:16:38 juju-e4d256-prod-github-runner-207 kernel: [67972.577262] ? show_regs.part.0+0x23/0x29 Aug 23 00:16:38 juju-e4d256-prod-github-runner-207 kernel: [67972.578264] ? show_regs.cold+0x8/0xd Aug 23 00:16:38 juju-e4d256-prod-github-runner-207 kernel: [67972.579236] ? watchdog_timer_fn+0x1be/0x220 Aug 23 00:16:38 juju-e4d256-prod-github-runner-207 kernel: [67972.580268] ? lockup_detector_update_enable+0x60/0x60 Aug 23 00:16:38 juju-e4d256-prod-github-runner-207 kernel: [67972.581342] ? __hrtimer_run_queues+0x107/0x230 Aug 23 00:16:38 juju-e4d256-prod-github-runner-207 kernel: [67972.582383] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 00:16:38 juju-e4d256-prod-github-runner-207 kernel: [67972.583442] ? hrtimer_interrupt+0x101/0x220 Aug 23 00:16:38 juju-e4d256-prod-github-runner-207 kernel: [67972.584482] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 00:16:38 juju-e4d256-prod-github-runner-207 kernel: [67972.585558] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 00:16:38 juju-e4d256-prod-github-runner-207 kernel: [67972.586623] Aug 23 00:16:38 juju-e4d256-prod-github-runner-207 kernel: [67972.587541] Aug 23 00:16:38 juju-e4d256-prod-github-runner-207 kernel: [67972.588397] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 00:16:38 juju-e4d256-prod-github-runner-207 kernel: [67972.589442] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:16:38 juju-e4d256-prod-github-runner-207 kernel: [67972.590481] ? _raw_spin_lock+0x22/0x30 Aug 23 00:16:38 juju-e4d256-prod-github-runner-207 kernel: [67972.591448] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:16:38 juju-e4d256-prod-github-runner-207 kernel: [67972.592510] direct_page_fault+0x206/0x310 [kvm] Aug 23 00:16:38 juju-e4d256-prod-github-runner-207 kernel: [67972.593544] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 00:16:38 juju-e4d256-prod-github-runner-207 kernel: [67972.594558] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 00:16:38 juju-e4d256-prod-github-runner-207 kernel: [67972.595579] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 00:16:38 juju-e4d256-prod-github-runner-207 kernel: [67972.596611] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 00:16:38 juju-e4d256-prod-github-runner-207 kernel: [67972.597606] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 00:16:38 juju-e4d256-prod-github-runner-207 kernel: [67972.598593] handle_exit+0x98/0x230 [kvm_amd] Aug 23 00:16:38 juju-e4d256-prod-github-runner-207 kernel: [67972.599494] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 00:16:38 juju-e4d256-prod-github-runner-207 kernel: [67972.600418] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 00:16:38 juju-e4d256-prod-github-runner-207 kernel: [67972.601359] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 00:16:38 juju-e4d256-prod-github-runner-207 kernel: [67972.602272] vcpu_run+0x62/0x2c0 [kvm] Aug 23 00:16:38 juju-e4d256-prod-github-runner-207 kernel: [67972.603094] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 00:16:38 juju-e4d256-prod-github-runner-207 kernel: [67972.603903] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 00:16:38 juju-e4d256-prod-github-runner-207 kernel: [67972.604777] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 00:16:38 juju-e4d256-prod-github-runner-207 kernel: [67972.605600] ? __seccomp_filter+0x4a/0x4a0 Aug 23 00:16:38 juju-e4d256-prod-github-runner-207 kernel: [67972.606345] ? __fget_files+0x86/0xc0 Aug 23 00:16:38 juju-e4d256-prod-github-runner-207 kernel: [67972.607058] __x64_sys_ioctl+0x95/0xd0 Aug 23 00:16:38 juju-e4d256-prod-github-runner-207 kernel: [67972.607775] do_syscall_64+0x5c/0xc0 Aug 23 00:16:38 juju-e4d256-prod-github-runner-207 kernel: [67972.608465] ? do_futex+0x162/0x1f0 Aug 23 00:16:38 juju-e4d256-prod-github-runner-207 kernel: [67972.609114] ? __x64_sys_futex+0x78/0x1e0 Aug 23 00:16:38 juju-e4d256-prod-github-runner-207 kernel: [67972.609787] ? __secure_computing+0xa9/0x120 Aug 23 00:16:38 juju-e4d256-prod-github-runner-207 kernel: [67972.610475] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 00:16:38 juju-e4d256-prod-github-runner-207 kernel: [67972.611234] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:16:38 juju-e4d256-prod-github-runner-207 kernel: [67972.611963] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:16:38 juju-e4d256-prod-github-runner-207 kernel: [67972.612691] ? do_syscall_64+0x69/0xc0 Aug 23 00:16:38 juju-e4d256-prod-github-runner-207 kernel: [67972.613346] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:16:38 juju-e4d256-prod-github-runner-207 kernel: [67972.614047] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:16:38 juju-e4d256-prod-github-runner-207 kernel: [67972.614742] ? do_syscall_64+0x69/0xc0 Aug 23 00:16:38 juju-e4d256-prod-github-runner-207 kernel: [67972.615426] ? do_syscall_64+0x69/0xc0 Aug 23 00:16:38 juju-e4d256-prod-github-runner-207 kernel: [67972.616071] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 00:16:38 juju-e4d256-prod-github-runner-207 kernel: [67972.616778] RIP: 0033:0x7faa5d0edaff Aug 23 00:16:38 juju-e4d256-prod-github-runner-207 kernel: [67972.617417] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 00:16:38 juju-e4d256-prod-github-runner-207 kernel: [67972.619428] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 00:16:38 juju-e4d256-prod-github-runner-207 kernel: [67972.620354] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 00:16:38 juju-e4d256-prod-github-runner-207 kernel: [67972.621250] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 00:16:38 juju-e4d256-prod-github-runner-207 kernel: [67972.622155] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 00:16:38 juju-e4d256-prod-github-runner-207 kernel: [67972.623052] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 00:16:38 juju-e4d256-prod-github-runner-207 kernel: [67972.623949] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 00:16:38 juju-e4d256-prod-github-runner-207 kernel: [67972.624875] Aug 23 00:17:06 juju-e4d256-prod-github-runner-207 kernel: [68000.541976] watchdog: BUG: soft lockup - CPU#1 stuck for 63222s! [qemu-system-x86:6715] Aug 23 00:17:06 juju-e4d256-prod-github-runner-207 kernel: [68000.543194] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 00:17:06 juju-e4d256-prod-github-runner-207 kernel: [68000.543426] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 00:17:06 juju-e4d256-prod-github-runner-207 kernel: [68000.555588] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 00:17:06 juju-e4d256-prod-github-runner-207 kernel: [68000.556891] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 00:17:06 juju-e4d256-prod-github-runner-207 kernel: [68000.558116] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:17:06 juju-e4d256-prod-github-runner-207 kernel: [68000.559173] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 00:17:06 juju-e4d256-prod-github-runner-207 kernel: [68000.561745] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 00:17:06 juju-e4d256-prod-github-runner-207 kernel: [68000.562786] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 00:17:06 juju-e4d256-prod-github-runner-207 kernel: [68000.563978] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 00:17:06 juju-e4d256-prod-github-runner-207 kernel: [68000.565143] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 00:17:06 juju-e4d256-prod-github-runner-207 kernel: [68000.566305] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 00:17:06 juju-e4d256-prod-github-runner-207 kernel: [68000.567468] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 00:17:06 juju-e4d256-prod-github-runner-207 kernel: [68000.568651] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 00:17:06 juju-e4d256-prod-github-runner-207 kernel: [68000.569887] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 00:17:06 juju-e4d256-prod-github-runner-207 kernel: [68000.570983] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 00:17:06 juju-e4d256-prod-github-runner-207 kernel: [68000.572204] Call Trace: Aug 23 00:17:06 juju-e4d256-prod-github-runner-207 kernel: [68000.573121] Aug 23 00:17:06 juju-e4d256-prod-github-runner-207 kernel: [68000.574003] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:17:06 juju-e4d256-prod-github-runner-207 kernel: [68000.575032] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:17:06 juju-e4d256-prod-github-runner-207 kernel: [68000.576082] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:17:06 juju-e4d256-prod-github-runner-207 kernel: [68000.577180] ? show_regs.part.0+0x23/0x29 Aug 23 00:17:06 juju-e4d256-prod-github-runner-207 kernel: [68000.578176] ? show_regs.cold+0x8/0xd Aug 23 00:17:06 juju-e4d256-prod-github-runner-207 kernel: [68000.579160] ? watchdog_timer_fn+0x1be/0x220 Aug 23 00:17:06 juju-e4d256-prod-github-runner-207 kernel: [68000.580206] ? lockup_detector_update_enable+0x60/0x60 Aug 23 00:17:06 juju-e4d256-prod-github-runner-207 kernel: [68000.581268] ? __hrtimer_run_queues+0x107/0x230 Aug 23 00:17:06 juju-e4d256-prod-github-runner-207 kernel: [68000.582300] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 00:17:06 juju-e4d256-prod-github-runner-207 kernel: [68000.583327] ? hrtimer_interrupt+0x101/0x220 Aug 23 00:17:06 juju-e4d256-prod-github-runner-207 kernel: [68000.584361] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 00:17:06 juju-e4d256-prod-github-runner-207 kernel: [68000.585437] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 00:17:06 juju-e4d256-prod-github-runner-207 kernel: [68000.586482] Aug 23 00:17:06 juju-e4d256-prod-github-runner-207 kernel: [68000.587338] Aug 23 00:17:06 juju-e4d256-prod-github-runner-207 kernel: [68000.588192] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 00:17:06 juju-e4d256-prod-github-runner-207 kernel: [68000.589231] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:17:06 juju-e4d256-prod-github-runner-207 kernel: [68000.590271] ? _raw_spin_lock+0x22/0x30 Aug 23 00:17:06 juju-e4d256-prod-github-runner-207 kernel: [68000.591216] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:17:06 juju-e4d256-prod-github-runner-207 kernel: [68000.592256] direct_page_fault+0x206/0x310 [kvm] Aug 23 00:17:06 juju-e4d256-prod-github-runner-207 kernel: [68000.593281] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 00:17:06 juju-e4d256-prod-github-runner-207 kernel: [68000.594290] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 00:17:06 juju-e4d256-prod-github-runner-207 kernel: [68000.595296] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 00:17:06 juju-e4d256-prod-github-runner-207 kernel: [68000.596309] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 00:17:06 juju-e4d256-prod-github-runner-207 kernel: [68000.597255] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 00:17:06 juju-e4d256-prod-github-runner-207 kernel: [68000.598236] handle_exit+0x98/0x230 [kvm_amd] Aug 23 00:17:06 juju-e4d256-prod-github-runner-207 kernel: [68000.599134] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 00:17:06 juju-e4d256-prod-github-runner-207 kernel: [68000.600060] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 00:17:06 juju-e4d256-prod-github-runner-207 kernel: [68000.601073] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 00:17:06 juju-e4d256-prod-github-runner-207 kernel: [68000.602049] vcpu_run+0x62/0x2c0 [kvm] Aug 23 00:17:06 juju-e4d256-prod-github-runner-207 kernel: [68000.602862] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 00:17:06 juju-e4d256-prod-github-runner-207 kernel: [68000.603670] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 00:17:06 juju-e4d256-prod-github-runner-207 kernel: [68000.604559] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 00:17:06 juju-e4d256-prod-github-runner-207 kernel: [68000.605374] ? __seccomp_filter+0x4a/0x4a0 Aug 23 00:17:06 juju-e4d256-prod-github-runner-207 kernel: [68000.606117] ? __fget_files+0x86/0xc0 Aug 23 00:17:06 juju-e4d256-prod-github-runner-207 kernel: [68000.606821] __x64_sys_ioctl+0x95/0xd0 Aug 23 00:17:06 juju-e4d256-prod-github-runner-207 kernel: [68000.607518] do_syscall_64+0x5c/0xc0 Aug 23 00:17:06 juju-e4d256-prod-github-runner-207 kernel: [68000.608209] ? do_futex+0x162/0x1f0 Aug 23 00:17:06 juju-e4d256-prod-github-runner-207 kernel: [68000.608867] ? __x64_sys_futex+0x78/0x1e0 Aug 23 00:17:06 juju-e4d256-prod-github-runner-207 kernel: [68000.609541] ? __secure_computing+0xa9/0x120 Aug 23 00:17:06 juju-e4d256-prod-github-runner-207 kernel: [68000.610230] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 00:17:06 juju-e4d256-prod-github-runner-207 kernel: [68000.611008] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:17:06 juju-e4d256-prod-github-runner-207 kernel: [68000.611744] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:17:06 juju-e4d256-prod-github-runner-207 kernel: [68000.612462] ? do_syscall_64+0x69/0xc0 Aug 23 00:17:06 juju-e4d256-prod-github-runner-207 kernel: [68000.613107] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:17:06 juju-e4d256-prod-github-runner-207 kernel: [68000.613812] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:17:06 juju-e4d256-prod-github-runner-207 kernel: [68000.614514] ? do_syscall_64+0x69/0xc0 Aug 23 00:17:06 juju-e4d256-prod-github-runner-207 kernel: [68000.615139] ? do_syscall_64+0x69/0xc0 Aug 23 00:17:06 juju-e4d256-prod-github-runner-207 kernel: [68000.615775] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 00:17:06 juju-e4d256-prod-github-runner-207 kernel: [68000.616486] RIP: 0033:0x7faa5d0edaff Aug 23 00:17:06 juju-e4d256-prod-github-runner-207 kernel: [68000.617146] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 00:17:06 juju-e4d256-prod-github-runner-207 kernel: [68000.619140] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 00:17:06 juju-e4d256-prod-github-runner-207 kernel: [68000.620066] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 00:17:06 juju-e4d256-prod-github-runner-207 kernel: [68000.620963] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 00:17:06 juju-e4d256-prod-github-runner-207 kernel: [68000.621851] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 00:17:06 juju-e4d256-prod-github-runner-207 kernel: [68000.622738] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 00:17:06 juju-e4d256-prod-github-runner-207 kernel: [68000.623637] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 00:17:06 juju-e4d256-prod-github-runner-207 kernel: [68000.624550] Aug 23 00:17:34 juju-e4d256-prod-github-runner-207 kernel: [68028.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 63248s! [qemu-system-x86:6715] Aug 23 00:17:34 juju-e4d256-prod-github-runner-207 kernel: [68028.544044] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 00:17:34 juju-e4d256-prod-github-runner-207 kernel: [68028.544353] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 00:17:34 juju-e4d256-prod-github-runner-207 kernel: [68028.558312] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 00:17:34 juju-e4d256-prod-github-runner-207 kernel: [68028.559784] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 00:17:34 juju-e4d256-prod-github-runner-207 kernel: [68028.561196] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:17:34 juju-e4d256-prod-github-runner-207 kernel: [68028.562388] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 00:17:34 juju-e4d256-prod-github-runner-207 kernel: [68028.565503] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 00:17:34 juju-e4d256-prod-github-runner-207 kernel: [68028.566698] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 00:17:34 juju-e4d256-prod-github-runner-207 kernel: [68028.568079] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 00:17:34 juju-e4d256-prod-github-runner-207 kernel: [68028.569558] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 00:17:34 juju-e4d256-prod-github-runner-207 kernel: [68028.570862] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 00:17:34 juju-e4d256-prod-github-runner-207 kernel: [68028.572185] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 00:17:34 juju-e4d256-prod-github-runner-207 kernel: [68028.573494] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 00:17:34 juju-e4d256-prod-github-runner-207 kernel: [68028.574898] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 00:17:34 juju-e4d256-prod-github-runner-207 kernel: [68028.576173] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 00:17:34 juju-e4d256-prod-github-runner-207 kernel: [68028.577548] Call Trace: Aug 23 00:17:34 juju-e4d256-prod-github-runner-207 kernel: [68028.578521] Aug 23 00:17:34 juju-e4d256-prod-github-runner-207 kernel: [68028.579483] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:17:34 juju-e4d256-prod-github-runner-207 kernel: [68028.580659] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:17:34 juju-e4d256-prod-github-runner-207 kernel: [68028.581881] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:17:34 juju-e4d256-prod-github-runner-207 kernel: [68028.583080] ? show_regs.part.0+0x23/0x29 Aug 23 00:17:34 juju-e4d256-prod-github-runner-207 kernel: [68028.584223] ? show_regs.cold+0x8/0xd Aug 23 00:17:34 juju-e4d256-prod-github-runner-207 kernel: [68028.585274] ? watchdog_timer_fn+0x1be/0x220 Aug 23 00:17:34 juju-e4d256-prod-github-runner-207 kernel: [68028.586406] ? lockup_detector_update_enable+0x60/0x60 Aug 23 00:17:34 juju-e4d256-prod-github-runner-207 kernel: [68028.587594] ? __hrtimer_run_queues+0x107/0x230 Aug 23 00:17:34 juju-e4d256-prod-github-runner-207 kernel: [68028.588714] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 00:17:34 juju-e4d256-prod-github-runner-207 kernel: [68028.589823] ? hrtimer_interrupt+0x101/0x220 Aug 23 00:17:34 juju-e4d256-prod-github-runner-207 kernel: [68028.590926] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 00:17:34 juju-e4d256-prod-github-runner-207 kernel: [68028.592172] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 00:17:34 juju-e4d256-prod-github-runner-207 kernel: [68028.593348] Aug 23 00:17:34 juju-e4d256-prod-github-runner-207 kernel: [68028.594269] Aug 23 00:17:34 juju-e4d256-prod-github-runner-207 kernel: [68028.595173] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 00:17:34 juju-e4d256-prod-github-runner-207 kernel: [68028.596339] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:17:34 juju-e4d256-prod-github-runner-207 kernel: [68028.597489] ? _raw_spin_lock+0x22/0x30 Aug 23 00:17:34 juju-e4d256-prod-github-runner-207 kernel: [68028.598515] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:17:34 juju-e4d256-prod-github-runner-207 kernel: [68028.599637] direct_page_fault+0x206/0x310 [kvm] Aug 23 00:17:34 juju-e4d256-prod-github-runner-207 kernel: [68028.600754] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 00:17:34 juju-e4d256-prod-github-runner-207 kernel: [68028.601869] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 00:17:34 juju-e4d256-prod-github-runner-207 kernel: [68028.602987] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 00:17:34 juju-e4d256-prod-github-runner-207 kernel: [68028.604123] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 00:17:34 juju-e4d256-prod-github-runner-207 kernel: [68028.605239] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 00:17:34 juju-e4d256-prod-github-runner-207 kernel: [68028.606332] handle_exit+0x98/0x230 [kvm_amd] Aug 23 00:17:34 juju-e4d256-prod-github-runner-207 kernel: [68028.607310] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 00:17:34 juju-e4d256-prod-github-runner-207 kernel: [68028.608352] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 00:17:34 juju-e4d256-prod-github-runner-207 kernel: [68028.609371] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 00:17:34 juju-e4d256-prod-github-runner-207 kernel: [68028.610367] vcpu_run+0x62/0x2c0 [kvm] Aug 23 00:17:34 juju-e4d256-prod-github-runner-207 kernel: [68028.611258] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 00:17:34 juju-e4d256-prod-github-runner-207 kernel: [68028.612171] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 00:17:34 juju-e4d256-prod-github-runner-207 kernel: [68028.613123] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 00:17:34 juju-e4d256-prod-github-runner-207 kernel: [68028.614002] ? __seccomp_filter+0x4a/0x4a0 Aug 23 00:17:34 juju-e4d256-prod-github-runner-207 kernel: [68028.614830] ? __fget_files+0x86/0xc0 Aug 23 00:17:34 juju-e4d256-prod-github-runner-207 kernel: [68028.615622] __x64_sys_ioctl+0x95/0xd0 Aug 23 00:17:34 juju-e4d256-prod-github-runner-207 kernel: [68028.616393] do_syscall_64+0x5c/0xc0 Aug 23 00:17:34 juju-e4d256-prod-github-runner-207 kernel: [68028.617142] ? do_futex+0x162/0x1f0 Aug 23 00:17:34 juju-e4d256-prod-github-runner-207 kernel: [68028.617866] ? __x64_sys_futex+0x78/0x1e0 Aug 23 00:17:34 juju-e4d256-prod-github-runner-207 kernel: [68028.618618] ? __secure_computing+0xa9/0x120 Aug 23 00:17:34 juju-e4d256-prod-github-runner-207 kernel: [68028.619405] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 00:17:34 juju-e4d256-prod-github-runner-207 kernel: [68028.620270] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:17:34 juju-e4d256-prod-github-runner-207 kernel: [68028.621089] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:17:34 juju-e4d256-prod-github-runner-207 kernel: [68028.621900] ? do_syscall_64+0x69/0xc0 Aug 23 00:17:34 juju-e4d256-prod-github-runner-207 kernel: [68028.622616] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:17:34 juju-e4d256-prod-github-runner-207 kernel: [68028.623431] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:17:34 juju-e4d256-prod-github-runner-207 kernel: [68028.624221] ? do_syscall_64+0x69/0xc0 Aug 23 00:17:34 juju-e4d256-prod-github-runner-207 kernel: [68028.624923] ? do_syscall_64+0x69/0xc0 Aug 23 00:17:34 juju-e4d256-prod-github-runner-207 kernel: [68028.625629] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 00:17:34 juju-e4d256-prod-github-runner-207 kernel: [68028.626442] RIP: 0033:0x7faa5d0edaff Aug 23 00:17:34 juju-e4d256-prod-github-runner-207 kernel: [68028.627187] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 00:17:34 juju-e4d256-prod-github-runner-207 kernel: [68028.629578] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 00:17:34 juju-e4d256-prod-github-runner-207 kernel: [68028.630639] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 00:17:34 juju-e4d256-prod-github-runner-207 kernel: [68028.631689] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 00:17:34 juju-e4d256-prod-github-runner-207 kernel: [68028.632722] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 00:17:34 juju-e4d256-prod-github-runner-207 kernel: [68028.633746] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 00:17:34 juju-e4d256-prod-github-runner-207 kernel: [68028.634769] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 00:17:34 juju-e4d256-prod-github-runner-207 kernel: [68028.635837] Aug 23 00:17:47 juju-e4d256-prod-github-runner-207 kernel: [68041.724710] rcu: INFO: rcu_sched self-detected stall on CPU Aug 23 00:17:47 juju-e4d256-prod-github-runner-207 kernel: [68041.726460] rcu: 1-....: (16927609 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=8172344 Aug 23 00:17:47 juju-e4d256-prod-github-runner-207 kernel: [68041.727614] (t=16981131 jiffies g=23269 q=59177) Aug 23 00:17:47 juju-e4d256-prod-github-runner-207 kernel: [68041.728403] NMI backtrace for cpu 1 Aug 23 00:17:47 juju-e4d256-prod-github-runner-207 kernel: [68041.729136] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 00:17:47 juju-e4d256-prod-github-runner-207 kernel: [68041.730275] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 00:17:47 juju-e4d256-prod-github-runner-207 kernel: [68041.731501] Call Trace: Aug 23 00:17:47 juju-e4d256-prod-github-runner-207 kernel: [68041.732185] Aug 23 00:17:47 juju-e4d256-prod-github-runner-207 kernel: [68041.732846] show_stack+0x52/0x5c Aug 23 00:17:47 juju-e4d256-prod-github-runner-207 kernel: [68041.733571] dump_stack_lvl+0x4a/0x63 Aug 23 00:17:47 juju-e4d256-prod-github-runner-207 kernel: [68041.734316] dump_stack+0x10/0x16 Aug 23 00:17:47 juju-e4d256-prod-github-runner-207 kernel: [68041.735040] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 23 00:17:47 juju-e4d256-prod-github-runner-207 kernel: [68041.735841] ? lapic_can_unplug_cpu+0x90/0x90 Aug 23 00:17:47 juju-e4d256-prod-github-runner-207 kernel: [68041.736619] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 23 00:17:47 juju-e4d256-prod-github-runner-207 kernel: [68041.737495] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 23 00:17:47 juju-e4d256-prod-github-runner-207 kernel: [68041.738534] trigger_single_cpu_backtrace+0x44/0x4f Aug 23 00:17:47 juju-e4d256-prod-github-runner-207 kernel: [68041.739407] rcu_dump_cpu_stacks+0x102/0x149 Aug 23 00:17:47 juju-e4d256-prod-github-runner-207 kernel: [68041.740184] print_cpu_stall.cold+0x2f/0xe2 Aug 23 00:17:47 juju-e4d256-prod-github-runner-207 kernel: [68041.740949] ? timekeeping_update+0xf7/0x150 Aug 23 00:17:47 juju-e4d256-prod-github-runner-207 kernel: [68041.741718] check_cpu_stall+0x109/0x270 Aug 23 00:17:47 juju-e4d256-prod-github-runner-207 kernel: [68041.742464] rcu_sched_clock_irq+0x9a/0x250 Aug 23 00:17:47 juju-e4d256-prod-github-runner-207 kernel: [68041.743239] update_process_times+0x94/0xd0 Aug 23 00:17:47 juju-e4d256-prod-github-runner-207 kernel: [68041.743999] tick_sched_handle+0x29/0x70 Aug 23 00:17:47 juju-e4d256-prod-github-runner-207 kernel: [68041.744748] tick_sched_timer+0x8c/0xc0 Aug 23 00:17:47 juju-e4d256-prod-github-runner-207 kernel: [68041.745487] ? tick_nohz_handler+0xb0/0xb0 Aug 23 00:17:47 juju-e4d256-prod-github-runner-207 kernel: [68041.746246] __hrtimer_run_queues+0x107/0x230 Aug 23 00:17:47 juju-e4d256-prod-github-runner-207 kernel: [68041.747021] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 00:17:47 juju-e4d256-prod-github-runner-207 kernel: [68041.747815] hrtimer_interrupt+0x101/0x220 Aug 23 00:17:47 juju-e4d256-prod-github-runner-207 kernel: [68041.748573] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 00:17:47 juju-e4d256-prod-github-runner-207 kernel: [68041.749391] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 00:17:47 juju-e4d256-prod-github-runner-207 kernel: [68041.750192] Aug 23 00:17:47 juju-e4d256-prod-github-runner-207 kernel: [68041.750826] Aug 23 00:17:47 juju-e4d256-prod-github-runner-207 kernel: [68041.751477] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 00:17:47 juju-e4d256-prod-github-runner-207 kernel: [68041.752333] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:17:47 juju-e4d256-prod-github-runner-207 kernel: [68041.753258] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 00:17:47 juju-e4d256-prod-github-runner-207 kernel: [68041.755564] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 00:17:47 juju-e4d256-prod-github-runner-207 kernel: [68041.756472] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 00:17:47 juju-e4d256-prod-github-runner-207 kernel: [68041.757472] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 00:17:47 juju-e4d256-prod-github-runner-207 kernel: [68041.758448] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 00:17:47 juju-e4d256-prod-github-runner-207 kernel: [68041.759495] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 00:17:47 juju-e4d256-prod-github-runner-207 kernel: [68041.760453] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 00:17:47 juju-e4d256-prod-github-runner-207 kernel: [68041.761408] ? _raw_spin_lock+0x22/0x30 Aug 23 00:17:47 juju-e4d256-prod-github-runner-207 kernel: [68041.762178] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:17:47 juju-e4d256-prod-github-runner-207 kernel: [68041.763056] direct_page_fault+0x206/0x310 [kvm] Aug 23 00:17:47 juju-e4d256-prod-github-runner-207 kernel: [68041.763939] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 00:17:47 juju-e4d256-prod-github-runner-207 kernel: [68041.764767] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 00:17:47 juju-e4d256-prod-github-runner-207 kernel: [68041.765605] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 00:17:47 juju-e4d256-prod-github-runner-207 kernel: [68041.766443] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 00:17:47 juju-e4d256-prod-github-runner-207 kernel: [68041.767243] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 00:17:47 juju-e4d256-prod-github-runner-207 kernel: [68041.768064] handle_exit+0x98/0x230 [kvm_amd] Aug 23 00:17:47 juju-e4d256-prod-github-runner-207 kernel: [68041.768830] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 00:17:47 juju-e4d256-prod-github-runner-207 kernel: [68041.769612] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 00:17:47 juju-e4d256-prod-github-runner-207 kernel: [68041.770423] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 00:17:47 juju-e4d256-prod-github-runner-207 kernel: [68041.771229] vcpu_run+0x62/0x2c0 [kvm] Aug 23 00:17:47 juju-e4d256-prod-github-runner-207 kernel: [68041.771956] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 00:17:47 juju-e4d256-prod-github-runner-207 kernel: [68041.772690] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 00:17:47 juju-e4d256-prod-github-runner-207 kernel: [68041.773495] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 00:17:47 juju-e4d256-prod-github-runner-207 kernel: [68041.774274] ? __seccomp_filter+0x4a/0x4a0 Aug 23 00:17:47 juju-e4d256-prod-github-runner-207 kernel: [68041.774992] ? __fget_files+0x86/0xc0 Aug 23 00:17:47 juju-e4d256-prod-github-runner-207 kernel: [68041.775705] __x64_sys_ioctl+0x95/0xd0 Aug 23 00:17:47 juju-e4d256-prod-github-runner-207 kernel: [68041.776401] do_syscall_64+0x5c/0xc0 Aug 23 00:17:47 juju-e4d256-prod-github-runner-207 kernel: [68041.777079] ? do_futex+0x162/0x1f0 Aug 23 00:17:47 juju-e4d256-prod-github-runner-207 kernel: [68041.777747] ? __x64_sys_futex+0x78/0x1e0 Aug 23 00:17:47 juju-e4d256-prod-github-runner-207 kernel: [68041.778457] ? __secure_computing+0xa9/0x120 Aug 23 00:17:47 juju-e4d256-prod-github-runner-207 kernel: [68041.779168] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 00:17:47 juju-e4d256-prod-github-runner-207 kernel: [68041.779975] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:17:47 juju-e4d256-prod-github-runner-207 kernel: [68041.780723] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:17:47 juju-e4d256-prod-github-runner-207 kernel: [68041.781487] ? do_syscall_64+0x69/0xc0 Aug 23 00:17:47 juju-e4d256-prod-github-runner-207 kernel: [68041.782181] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:17:47 juju-e4d256-prod-github-runner-207 kernel: [68041.782939] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:17:47 juju-e4d256-prod-github-runner-207 kernel: [68041.783722] ? do_syscall_64+0x69/0xc0 Aug 23 00:17:47 juju-e4d256-prod-github-runner-207 kernel: [68041.784411] ? do_syscall_64+0x69/0xc0 Aug 23 00:17:47 juju-e4d256-prod-github-runner-207 kernel: [68041.785098] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 00:17:47 juju-e4d256-prod-github-runner-207 kernel: [68041.785864] RIP: 0033:0x7faa5d0edaff Aug 23 00:17:47 juju-e4d256-prod-github-runner-207 kernel: [68041.786591] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 00:17:47 juju-e4d256-prod-github-runner-207 kernel: [68041.788709] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 00:17:47 juju-e4d256-prod-github-runner-207 kernel: [68041.789666] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 00:17:47 juju-e4d256-prod-github-runner-207 kernel: [68041.790608] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 00:17:47 juju-e4d256-prod-github-runner-207 kernel: [68041.791625] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 00:17:47 juju-e4d256-prod-github-runner-207 kernel: [68041.792578] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 00:17:47 juju-e4d256-prod-github-runner-207 kernel: [68041.793502] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 00:17:47 juju-e4d256-prod-github-runner-207 kernel: [68041.794413] Aug 23 00:18:14 juju-e4d256-prod-github-runner-207 kernel: [68068.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 63285s! [qemu-system-x86:6715] Aug 23 00:18:14 juju-e4d256-prod-github-runner-207 kernel: [68068.543907] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 00:18:14 juju-e4d256-prod-github-runner-207 kernel: [68068.544218] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 00:18:14 juju-e4d256-prod-github-runner-207 kernel: [68068.556368] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 00:18:14 juju-e4d256-prod-github-runner-207 kernel: [68068.557647] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 00:18:14 juju-e4d256-prod-github-runner-207 kernel: [68068.558881] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:18:14 juju-e4d256-prod-github-runner-207 kernel: [68068.559937] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 00:18:14 juju-e4d256-prod-github-runner-207 kernel: [68068.562485] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 00:18:14 juju-e4d256-prod-github-runner-207 kernel: [68068.563544] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 00:18:14 juju-e4d256-prod-github-runner-207 kernel: [68068.564725] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 00:18:14 juju-e4d256-prod-github-runner-207 kernel: [68068.565891] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 00:18:14 juju-e4d256-prod-github-runner-207 kernel: [68068.567066] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 00:18:14 juju-e4d256-prod-github-runner-207 kernel: [68068.568230] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 00:18:14 juju-e4d256-prod-github-runner-207 kernel: [68068.569399] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 00:18:14 juju-e4d256-prod-github-runner-207 kernel: [68068.570631] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 00:18:14 juju-e4d256-prod-github-runner-207 kernel: [68068.571745] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 00:18:14 juju-e4d256-prod-github-runner-207 kernel: [68068.572940] Call Trace: Aug 23 00:18:14 juju-e4d256-prod-github-runner-207 kernel: [68068.573858] Aug 23 00:18:14 juju-e4d256-prod-github-runner-207 kernel: [68068.574760] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:18:14 juju-e4d256-prod-github-runner-207 kernel: [68068.575813] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:18:14 juju-e4d256-prod-github-runner-207 kernel: [68068.576842] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:18:14 juju-e4d256-prod-github-runner-207 kernel: [68068.577944] ? show_regs.part.0+0x23/0x29 Aug 23 00:18:14 juju-e4d256-prod-github-runner-207 kernel: [68068.578955] ? show_regs.cold+0x8/0xd Aug 23 00:18:14 juju-e4d256-prod-github-runner-207 kernel: [68068.579928] ? watchdog_timer_fn+0x1be/0x220 Aug 23 00:18:14 juju-e4d256-prod-github-runner-207 kernel: [68068.581014] ? lockup_detector_update_enable+0x60/0x60 Aug 23 00:18:14 juju-e4d256-prod-github-runner-207 kernel: [68068.582101] ? __hrtimer_run_queues+0x107/0x230 Aug 23 00:18:14 juju-e4d256-prod-github-runner-207 kernel: [68068.583150] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 00:18:14 juju-e4d256-prod-github-runner-207 kernel: [68068.584176] ? hrtimer_interrupt+0x101/0x220 Aug 23 00:18:14 juju-e4d256-prod-github-runner-207 kernel: [68068.585218] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 00:18:14 juju-e4d256-prod-github-runner-207 kernel: [68068.586301] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 00:18:14 juju-e4d256-prod-github-runner-207 kernel: [68068.587436] Aug 23 00:18:14 juju-e4d256-prod-github-runner-207 kernel: [68068.588297] Aug 23 00:18:14 juju-e4d256-prod-github-runner-207 kernel: [68068.589155] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 00:18:14 juju-e4d256-prod-github-runner-207 kernel: [68068.590198] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:18:14 juju-e4d256-prod-github-runner-207 kernel: [68068.591252] ? _raw_spin_lock+0x22/0x30 Aug 23 00:18:14 juju-e4d256-prod-github-runner-207 kernel: [68068.592207] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:18:14 juju-e4d256-prod-github-runner-207 kernel: [68068.593242] direct_page_fault+0x206/0x310 [kvm] Aug 23 00:18:14 juju-e4d256-prod-github-runner-207 kernel: [68068.594265] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 00:18:14 juju-e4d256-prod-github-runner-207 kernel: [68068.595289] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 00:18:14 juju-e4d256-prod-github-runner-207 kernel: [68068.596299] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 00:18:14 juju-e4d256-prod-github-runner-207 kernel: [68068.597312] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 00:18:14 juju-e4d256-prod-github-runner-207 kernel: [68068.598257] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 00:18:14 juju-e4d256-prod-github-runner-207 kernel: [68068.599255] handle_exit+0x98/0x230 [kvm_amd] Aug 23 00:18:14 juju-e4d256-prod-github-runner-207 kernel: [68068.600147] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 00:18:14 juju-e4d256-prod-github-runner-207 kernel: [68068.601061] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 00:18:14 juju-e4d256-prod-github-runner-207 kernel: [68068.601984] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 00:18:14 juju-e4d256-prod-github-runner-207 kernel: [68068.602895] vcpu_run+0x62/0x2c0 [kvm] Aug 23 00:18:14 juju-e4d256-prod-github-runner-207 kernel: [68068.603719] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 00:18:14 juju-e4d256-prod-github-runner-207 kernel: [68068.604538] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 00:18:14 juju-e4d256-prod-github-runner-207 kernel: [68068.605401] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 00:18:14 juju-e4d256-prod-github-runner-207 kernel: [68068.606206] ? __seccomp_filter+0x4a/0x4a0 Aug 23 00:18:14 juju-e4d256-prod-github-runner-207 kernel: [68068.606963] ? __fget_files+0x86/0xc0 Aug 23 00:18:14 juju-e4d256-prod-github-runner-207 kernel: [68068.607703] __x64_sys_ioctl+0x95/0xd0 Aug 23 00:18:14 juju-e4d256-prod-github-runner-207 kernel: [68068.608419] do_syscall_64+0x5c/0xc0 Aug 23 00:18:14 juju-e4d256-prod-github-runner-207 kernel: [68068.609089] ? do_futex+0x162/0x1f0 Aug 23 00:18:14 juju-e4d256-prod-github-runner-207 kernel: [68068.609740] ? __x64_sys_futex+0x78/0x1e0 Aug 23 00:18:14 juju-e4d256-prod-github-runner-207 kernel: [68068.610420] ? __secure_computing+0xa9/0x120 Aug 23 00:18:14 juju-e4d256-prod-github-runner-207 kernel: [68068.611131] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 00:18:14 juju-e4d256-prod-github-runner-207 kernel: [68068.611893] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:18:14 juju-e4d256-prod-github-runner-207 kernel: [68068.612620] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:18:14 juju-e4d256-prod-github-runner-207 kernel: [68068.613342] ? do_syscall_64+0x69/0xc0 Aug 23 00:18:14 juju-e4d256-prod-github-runner-207 kernel: [68068.613988] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:18:14 juju-e4d256-prod-github-runner-207 kernel: [68068.614692] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:18:14 juju-e4d256-prod-github-runner-207 kernel: [68068.615401] ? do_syscall_64+0x69/0xc0 Aug 23 00:18:14 juju-e4d256-prod-github-runner-207 kernel: [68068.616026] ? do_syscall_64+0x69/0xc0 Aug 23 00:18:14 juju-e4d256-prod-github-runner-207 kernel: [68068.616660] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 00:18:14 juju-e4d256-prod-github-runner-207 kernel: [68068.617371] RIP: 0033:0x7faa5d0edaff Aug 23 00:18:14 juju-e4d256-prod-github-runner-207 kernel: [68068.618033] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 00:18:14 juju-e4d256-prod-github-runner-207 kernel: [68068.620041] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 00:18:14 juju-e4d256-prod-github-runner-207 kernel: [68068.620959] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 00:18:14 juju-e4d256-prod-github-runner-207 kernel: [68068.621850] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 00:18:14 juju-e4d256-prod-github-runner-207 kernel: [68068.622742] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 00:18:14 juju-e4d256-prod-github-runner-207 kernel: [68068.623655] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 00:18:14 juju-e4d256-prod-github-runner-207 kernel: [68068.624570] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 00:18:14 juju-e4d256-prod-github-runner-207 kernel: [68068.625464] Aug 23 00:18:42 juju-e4d256-prod-github-runner-207 kernel: [68096.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 63311s! [qemu-system-x86:6715] Aug 23 00:18:42 juju-e4d256-prod-github-runner-207 kernel: [68096.543869] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 00:18:42 juju-e4d256-prod-github-runner-207 kernel: [68096.544173] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 00:18:42 juju-e4d256-prod-github-runner-207 kernel: [68096.556443] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 00:18:42 juju-e4d256-prod-github-runner-207 kernel: [68096.557714] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 00:18:42 juju-e4d256-prod-github-runner-207 kernel: [68096.558942] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:18:42 juju-e4d256-prod-github-runner-207 kernel: [68096.559999] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 00:18:42 juju-e4d256-prod-github-runner-207 kernel: [68096.562550] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 00:18:42 juju-e4d256-prod-github-runner-207 kernel: [68096.563591] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 00:18:42 juju-e4d256-prod-github-runner-207 kernel: [68096.564756] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 00:18:42 juju-e4d256-prod-github-runner-207 kernel: [68096.565916] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 00:18:42 juju-e4d256-prod-github-runner-207 kernel: [68096.567098] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 00:18:42 juju-e4d256-prod-github-runner-207 kernel: [68096.568264] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 00:18:42 juju-e4d256-prod-github-runner-207 kernel: [68096.569431] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 00:18:42 juju-e4d256-prod-github-runner-207 kernel: [68096.570695] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 00:18:42 juju-e4d256-prod-github-runner-207 kernel: [68096.571803] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 00:18:42 juju-e4d256-prod-github-runner-207 kernel: [68096.573018] Call Trace: Aug 23 00:18:42 juju-e4d256-prod-github-runner-207 kernel: [68096.573944] Aug 23 00:18:42 juju-e4d256-prod-github-runner-207 kernel: [68096.574867] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:18:42 juju-e4d256-prod-github-runner-207 kernel: [68096.575914] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:18:42 juju-e4d256-prod-github-runner-207 kernel: [68096.576956] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:18:42 juju-e4d256-prod-github-runner-207 kernel: [68096.578074] ? show_regs.part.0+0x23/0x29 Aug 23 00:18:42 juju-e4d256-prod-github-runner-207 kernel: [68096.579106] ? show_regs.cold+0x8/0xd Aug 23 00:18:42 juju-e4d256-prod-github-runner-207 kernel: [68096.580087] ? watchdog_timer_fn+0x1be/0x220 Aug 23 00:18:42 juju-e4d256-prod-github-runner-207 kernel: [68096.581116] ? lockup_detector_update_enable+0x60/0x60 Aug 23 00:18:42 juju-e4d256-prod-github-runner-207 kernel: [68096.582213] ? __hrtimer_run_queues+0x107/0x230 Aug 23 00:18:42 juju-e4d256-prod-github-runner-207 kernel: [68096.583267] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 00:18:42 juju-e4d256-prod-github-runner-207 kernel: [68096.584311] ? hrtimer_interrupt+0x101/0x220 Aug 23 00:18:42 juju-e4d256-prod-github-runner-207 kernel: [68096.585342] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 00:18:42 juju-e4d256-prod-github-runner-207 kernel: [68096.586431] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 00:18:42 juju-e4d256-prod-github-runner-207 kernel: [68096.587516] Aug 23 00:18:42 juju-e4d256-prod-github-runner-207 kernel: [68096.588382] Aug 23 00:18:42 juju-e4d256-prod-github-runner-207 kernel: [68096.589227] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 00:18:42 juju-e4d256-prod-github-runner-207 kernel: [68096.590285] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:18:42 juju-e4d256-prod-github-runner-207 kernel: [68096.591355] ? _raw_spin_lock+0x22/0x30 Aug 23 00:18:42 juju-e4d256-prod-github-runner-207 kernel: [68096.592320] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:18:42 juju-e4d256-prod-github-runner-207 kernel: [68096.593355] direct_page_fault+0x206/0x310 [kvm] Aug 23 00:18:42 juju-e4d256-prod-github-runner-207 kernel: [68096.594394] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 00:18:42 juju-e4d256-prod-github-runner-207 kernel: [68096.595423] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 00:18:42 juju-e4d256-prod-github-runner-207 kernel: [68096.596437] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 00:18:42 juju-e4d256-prod-github-runner-207 kernel: [68096.597468] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 00:18:42 juju-e4d256-prod-github-runner-207 kernel: [68096.598431] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 00:18:42 juju-e4d256-prod-github-runner-207 kernel: [68096.599456] handle_exit+0x98/0x230 [kvm_amd] Aug 23 00:18:42 juju-e4d256-prod-github-runner-207 kernel: [68096.600366] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 00:18:42 juju-e4d256-prod-github-runner-207 kernel: [68096.601301] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 00:18:42 juju-e4d256-prod-github-runner-207 kernel: [68096.602252] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 00:18:42 juju-e4d256-prod-github-runner-207 kernel: [68096.603200] vcpu_run+0x62/0x2c0 [kvm] Aug 23 00:18:42 juju-e4d256-prod-github-runner-207 kernel: [68096.604024] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 00:18:42 juju-e4d256-prod-github-runner-207 kernel: [68096.604850] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 00:18:42 juju-e4d256-prod-github-runner-207 kernel: [68096.605719] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 00:18:42 juju-e4d256-prod-github-runner-207 kernel: [68096.606545] ? __seccomp_filter+0x4a/0x4a0 Aug 23 00:18:42 juju-e4d256-prod-github-runner-207 kernel: [68096.607302] ? __fget_files+0x86/0xc0 Aug 23 00:18:42 juju-e4d256-prod-github-runner-207 kernel: [68096.608017] __x64_sys_ioctl+0x95/0xd0 Aug 23 00:18:42 juju-e4d256-prod-github-runner-207 kernel: [68096.608726] do_syscall_64+0x5c/0xc0 Aug 23 00:18:42 juju-e4d256-prod-github-runner-207 kernel: [68096.609404] ? do_futex+0x162/0x1f0 Aug 23 00:18:42 juju-e4d256-prod-github-runner-207 kernel: [68096.610064] ? __x64_sys_futex+0x78/0x1e0 Aug 23 00:18:42 juju-e4d256-prod-github-runner-207 kernel: [68096.611030] ? __secure_computing+0xa9/0x120 Aug 23 00:18:42 juju-e4d256-prod-github-runner-207 kernel: [68096.611937] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 00:18:42 juju-e4d256-prod-github-runner-207 kernel: [68096.612774] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:18:42 juju-e4d256-prod-github-runner-207 kernel: [68096.613518] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:18:42 juju-e4d256-prod-github-runner-207 kernel: [68096.614254] ? do_syscall_64+0x69/0xc0 Aug 23 00:18:42 juju-e4d256-prod-github-runner-207 kernel: [68096.614926] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:18:42 juju-e4d256-prod-github-runner-207 kernel: [68096.615656] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:18:42 juju-e4d256-prod-github-runner-207 kernel: [68096.616368] ? do_syscall_64+0x69/0xc0 Aug 23 00:18:42 juju-e4d256-prod-github-runner-207 kernel: [68096.617009] ? do_syscall_64+0x69/0xc0 Aug 23 00:18:42 juju-e4d256-prod-github-runner-207 kernel: [68096.617692] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 00:18:42 juju-e4d256-prod-github-runner-207 kernel: [68096.618423] RIP: 0033:0x7faa5d0edaff Aug 23 00:18:42 juju-e4d256-prod-github-runner-207 kernel: [68096.619113] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 00:18:42 juju-e4d256-prod-github-runner-207 kernel: [68096.621186] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 00:18:42 juju-e4d256-prod-github-runner-207 kernel: [68096.622125] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 00:18:42 juju-e4d256-prod-github-runner-207 kernel: [68096.623052] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 00:18:42 juju-e4d256-prod-github-runner-207 kernel: [68096.623974] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 00:18:42 juju-e4d256-prod-github-runner-207 kernel: [68096.624921] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 00:18:42 juju-e4d256-prod-github-runner-207 kernel: [68096.625900] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 00:18:42 juju-e4d256-prod-github-runner-207 kernel: [68096.626841] Aug 23 00:19:10 juju-e4d256-prod-github-runner-207 kernel: [68124.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 63337s! [qemu-system-x86:6715] Aug 23 00:19:10 juju-e4d256-prod-github-runner-207 kernel: [68124.543928] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 00:19:10 juju-e4d256-prod-github-runner-207 kernel: [68124.544251] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 00:19:10 juju-e4d256-prod-github-runner-207 kernel: [68124.557066] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 00:19:10 juju-e4d256-prod-github-runner-207 kernel: [68124.558389] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 00:19:10 juju-e4d256-prod-github-runner-207 kernel: [68124.559646] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:19:10 juju-e4d256-prod-github-runner-207 kernel: [68124.560752] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 00:19:10 juju-e4d256-prod-github-runner-207 kernel: [68124.563426] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 00:19:10 juju-e4d256-prod-github-runner-207 kernel: [68124.564502] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 00:19:10 juju-e4d256-prod-github-runner-207 kernel: [68124.565695] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 00:19:10 juju-e4d256-prod-github-runner-207 kernel: [68124.566908] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 00:19:10 juju-e4d256-prod-github-runner-207 kernel: [68124.568104] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 00:19:10 juju-e4d256-prod-github-runner-207 kernel: [68124.569281] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 00:19:10 juju-e4d256-prod-github-runner-207 kernel: [68124.570493] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 00:19:10 juju-e4d256-prod-github-runner-207 kernel: [68124.571758] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 00:19:10 juju-e4d256-prod-github-runner-207 kernel: [68124.572874] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 00:19:10 juju-e4d256-prod-github-runner-207 kernel: [68124.574111] Call Trace: Aug 23 00:19:10 juju-e4d256-prod-github-runner-207 kernel: [68124.575066] Aug 23 00:19:10 juju-e4d256-prod-github-runner-207 kernel: [68124.575979] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:19:10 juju-e4d256-prod-github-runner-207 kernel: [68124.577033] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:19:10 juju-e4d256-prod-github-runner-207 kernel: [68124.578080] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:19:10 juju-e4d256-prod-github-runner-207 kernel: [68124.579253] ? show_regs.part.0+0x23/0x29 Aug 23 00:19:10 juju-e4d256-prod-github-runner-207 kernel: [68124.580285] ? show_regs.cold+0x8/0xd Aug 23 00:19:10 juju-e4d256-prod-github-runner-207 kernel: [68124.581286] ? watchdog_timer_fn+0x1be/0x220 Aug 23 00:19:10 juju-e4d256-prod-github-runner-207 kernel: [68124.582349] ? lockup_detector_update_enable+0x60/0x60 Aug 23 00:19:10 juju-e4d256-prod-github-runner-207 kernel: [68124.583475] ? __hrtimer_run_queues+0x107/0x230 Aug 23 00:19:10 juju-e4d256-prod-github-runner-207 kernel: [68124.584583] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 00:19:10 juju-e4d256-prod-github-runner-207 kernel: [68124.585667] ? hrtimer_interrupt+0x101/0x220 Aug 23 00:19:10 juju-e4d256-prod-github-runner-207 kernel: [68124.586805] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 00:19:10 juju-e4d256-prod-github-runner-207 kernel: [68124.587945] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 00:19:10 juju-e4d256-prod-github-runner-207 kernel: [68124.589024] Aug 23 00:19:10 juju-e4d256-prod-github-runner-207 kernel: [68124.589894] Aug 23 00:19:10 juju-e4d256-prod-github-runner-207 kernel: [68124.590780] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 00:19:10 juju-e4d256-prod-github-runner-207 kernel: [68124.591869] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:19:10 juju-e4d256-prod-github-runner-207 kernel: [68124.592965] ? _raw_spin_lock+0x22/0x30 Aug 23 00:19:10 juju-e4d256-prod-github-runner-207 kernel: [68124.593962] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:19:10 juju-e4d256-prod-github-runner-207 kernel: [68124.595075] direct_page_fault+0x206/0x310 [kvm] Aug 23 00:19:10 juju-e4d256-prod-github-runner-207 kernel: [68124.596176] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 00:19:10 juju-e4d256-prod-github-runner-207 kernel: [68124.597255] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 00:19:10 juju-e4d256-prod-github-runner-207 kernel: [68124.598313] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 00:19:10 juju-e4d256-prod-github-runner-207 kernel: [68124.599359] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 00:19:10 juju-e4d256-prod-github-runner-207 kernel: [68124.600327] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 00:19:10 juju-e4d256-prod-github-runner-207 kernel: [68124.601329] handle_exit+0x98/0x230 [kvm_amd] Aug 23 00:19:10 juju-e4d256-prod-github-runner-207 kernel: [68124.602268] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 00:19:10 juju-e4d256-prod-github-runner-207 kernel: [68124.603212] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 00:19:10 juju-e4d256-prod-github-runner-207 kernel: [68124.604167] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 00:19:10 juju-e4d256-prod-github-runner-207 kernel: [68124.605124] vcpu_run+0x62/0x2c0 [kvm] Aug 23 00:19:10 juju-e4d256-prod-github-runner-207 kernel: [68124.605972] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 00:19:10 juju-e4d256-prod-github-runner-207 kernel: [68124.606828] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 00:19:10 juju-e4d256-prod-github-runner-207 kernel: [68124.607711] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 00:19:10 juju-e4d256-prod-github-runner-207 kernel: [68124.608536] ? __seccomp_filter+0x4a/0x4a0 Aug 23 00:19:10 juju-e4d256-prod-github-runner-207 kernel: [68124.609300] ? __fget_files+0x86/0xc0 Aug 23 00:19:10 juju-e4d256-prod-github-runner-207 kernel: [68124.610024] __x64_sys_ioctl+0x95/0xd0 Aug 23 00:19:10 juju-e4d256-prod-github-runner-207 kernel: [68124.610776] do_syscall_64+0x5c/0xc0 Aug 23 00:19:10 juju-e4d256-prod-github-runner-207 kernel: [68124.611470] ? do_futex+0x162/0x1f0 Aug 23 00:19:10 juju-e4d256-prod-github-runner-207 kernel: [68124.612135] ? __x64_sys_futex+0x78/0x1e0 Aug 23 00:19:10 juju-e4d256-prod-github-runner-207 kernel: [68124.613017] ? __secure_computing+0xa9/0x120 Aug 23 00:19:10 juju-e4d256-prod-github-runner-207 kernel: [68124.613727] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 00:19:10 juju-e4d256-prod-github-runner-207 kernel: [68124.614538] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:19:10 juju-e4d256-prod-github-runner-207 kernel: [68124.615466] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:19:10 juju-e4d256-prod-github-runner-207 kernel: [68124.616266] ? do_syscall_64+0x69/0xc0 Aug 23 00:19:10 juju-e4d256-prod-github-runner-207 kernel: [68124.616947] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:19:10 juju-e4d256-prod-github-runner-207 kernel: [68124.617674] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:19:10 juju-e4d256-prod-github-runner-207 kernel: [68124.619259] ? do_syscall_64+0x69/0xc0 Aug 23 00:19:10 juju-e4d256-prod-github-runner-207 kernel: [68124.619933] ? do_syscall_64+0x69/0xc0 Aug 23 00:19:10 juju-e4d256-prod-github-runner-207 kernel: [68124.620576] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 00:19:10 juju-e4d256-prod-github-runner-207 kernel: [68124.621306] RIP: 0033:0x7faa5d0edaff Aug 23 00:19:10 juju-e4d256-prod-github-runner-207 kernel: [68124.621991] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 00:19:10 juju-e4d256-prod-github-runner-207 kernel: [68124.624103] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 00:19:10 juju-e4d256-prod-github-runner-207 kernel: [68124.625052] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 00:19:10 juju-e4d256-prod-github-runner-207 kernel: [68124.625980] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 00:19:10 juju-e4d256-prod-github-runner-207 kernel: [68124.626919] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 00:19:10 juju-e4d256-prod-github-runner-207 kernel: [68124.627838] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 00:19:10 juju-e4d256-prod-github-runner-207 kernel: [68124.628753] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 00:19:10 juju-e4d256-prod-github-runner-207 kernel: [68124.629685] Aug 23 00:19:38 juju-e4d256-prod-github-runner-207 kernel: [68152.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 63364s! [qemu-system-x86:6715] Aug 23 00:19:38 juju-e4d256-prod-github-runner-207 kernel: [68152.544346] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 00:19:38 juju-e4d256-prod-github-runner-207 kernel: [68152.544682] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 00:19:38 juju-e4d256-prod-github-runner-207 kernel: [68152.556913] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 00:19:38 juju-e4d256-prod-github-runner-207 kernel: [68152.558201] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 00:19:38 juju-e4d256-prod-github-runner-207 kernel: [68152.559413] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:19:38 juju-e4d256-prod-github-runner-207 kernel: [68152.560467] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 00:19:38 juju-e4d256-prod-github-runner-207 kernel: [68152.563015] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 00:19:38 juju-e4d256-prod-github-runner-207 kernel: [68152.564057] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 00:19:38 juju-e4d256-prod-github-runner-207 kernel: [68152.565214] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 00:19:38 juju-e4d256-prod-github-runner-207 kernel: [68152.566376] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 00:19:38 juju-e4d256-prod-github-runner-207 kernel: [68152.567544] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 00:19:38 juju-e4d256-prod-github-runner-207 kernel: [68152.568703] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 00:19:38 juju-e4d256-prod-github-runner-207 kernel: [68152.569919] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 00:19:38 juju-e4d256-prod-github-runner-207 kernel: [68152.571171] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 00:19:38 juju-e4d256-prod-github-runner-207 kernel: [68152.572295] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 00:19:38 juju-e4d256-prod-github-runner-207 kernel: [68152.573504] Call Trace: Aug 23 00:19:38 juju-e4d256-prod-github-runner-207 kernel: [68152.574436] Aug 23 00:19:38 juju-e4d256-prod-github-runner-207 kernel: [68152.575335] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:19:38 juju-e4d256-prod-github-runner-207 kernel: [68152.576364] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:19:38 juju-e4d256-prod-github-runner-207 kernel: [68152.577385] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:19:38 juju-e4d256-prod-github-runner-207 kernel: [68152.578491] ? show_regs.part.0+0x23/0x29 Aug 23 00:19:38 juju-e4d256-prod-github-runner-207 kernel: [68152.579488] ? show_regs.cold+0x8/0xd Aug 23 00:19:38 juju-e4d256-prod-github-runner-207 kernel: [68152.580457] ? watchdog_timer_fn+0x1be/0x220 Aug 23 00:19:38 juju-e4d256-prod-github-runner-207 kernel: [68152.581471] ? lockup_detector_update_enable+0x60/0x60 Aug 23 00:19:38 juju-e4d256-prod-github-runner-207 kernel: [68152.582616] ? __hrtimer_run_queues+0x107/0x230 Aug 23 00:19:38 juju-e4d256-prod-github-runner-207 kernel: [68152.583655] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 00:19:38 juju-e4d256-prod-github-runner-207 kernel: [68152.584683] ? hrtimer_interrupt+0x101/0x220 Aug 23 00:19:38 juju-e4d256-prod-github-runner-207 kernel: [68152.585703] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 00:19:38 juju-e4d256-prod-github-runner-207 kernel: [68152.586809] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 00:19:38 juju-e4d256-prod-github-runner-207 kernel: [68152.587883] Aug 23 00:19:38 juju-e4d256-prod-github-runner-207 kernel: [68152.588781] Aug 23 00:19:38 juju-e4d256-prod-github-runner-207 kernel: [68152.589674] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 00:19:38 juju-e4d256-prod-github-runner-207 kernel: [68152.590724] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:19:38 juju-e4d256-prod-github-runner-207 kernel: [68152.591778] ? _raw_spin_lock+0x22/0x30 Aug 23 00:19:38 juju-e4d256-prod-github-runner-207 kernel: [68152.592728] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:19:38 juju-e4d256-prod-github-runner-207 kernel: [68152.593777] direct_page_fault+0x206/0x310 [kvm] Aug 23 00:19:38 juju-e4d256-prod-github-runner-207 kernel: [68152.594845] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 00:19:38 juju-e4d256-prod-github-runner-207 kernel: [68152.595852] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 00:19:38 juju-e4d256-prod-github-runner-207 kernel: [68152.596857] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 00:19:38 juju-e4d256-prod-github-runner-207 kernel: [68152.597875] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 00:19:38 juju-e4d256-prod-github-runner-207 kernel: [68152.598820] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 00:19:38 juju-e4d256-prod-github-runner-207 kernel: [68152.599848] handle_exit+0x98/0x230 [kvm_amd] Aug 23 00:19:38 juju-e4d256-prod-github-runner-207 kernel: [68152.600804] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 00:19:38 juju-e4d256-prod-github-runner-207 kernel: [68152.601831] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 00:19:38 juju-e4d256-prod-github-runner-207 kernel: [68152.602766] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 00:19:38 juju-e4d256-prod-github-runner-207 kernel: [68152.603673] vcpu_run+0x62/0x2c0 [kvm] Aug 23 00:19:38 juju-e4d256-prod-github-runner-207 kernel: [68152.604509] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 00:19:38 juju-e4d256-prod-github-runner-207 kernel: [68152.605318] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 00:19:38 juju-e4d256-prod-github-runner-207 kernel: [68152.606186] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 00:19:38 juju-e4d256-prod-github-runner-207 kernel: [68152.606989] ? __seccomp_filter+0x4a/0x4a0 Aug 23 00:19:38 juju-e4d256-prod-github-runner-207 kernel: [68152.607731] ? __fget_files+0x86/0xc0 Aug 23 00:19:38 juju-e4d256-prod-github-runner-207 kernel: [68152.608441] __x64_sys_ioctl+0x95/0xd0 Aug 23 00:19:38 juju-e4d256-prod-github-runner-207 kernel: [68152.609136] do_syscall_64+0x5c/0xc0 Aug 23 00:19:38 juju-e4d256-prod-github-runner-207 kernel: [68152.609801] ? do_futex+0x162/0x1f0 Aug 23 00:19:38 juju-e4d256-prod-github-runner-207 kernel: [68152.610484] ? __x64_sys_futex+0x78/0x1e0 Aug 23 00:19:38 juju-e4d256-prod-github-runner-207 kernel: [68152.611159] ? __secure_computing+0xa9/0x120 Aug 23 00:19:38 juju-e4d256-prod-github-runner-207 kernel: [68152.611848] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 00:19:38 juju-e4d256-prod-github-runner-207 kernel: [68152.612611] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:19:38 juju-e4d256-prod-github-runner-207 kernel: [68152.613340] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:19:38 juju-e4d256-prod-github-runner-207 kernel: [68152.614067] ? do_syscall_64+0x69/0xc0 Aug 23 00:19:38 juju-e4d256-prod-github-runner-207 kernel: [68152.614712] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:19:38 juju-e4d256-prod-github-runner-207 kernel: [68152.615413] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:19:38 juju-e4d256-prod-github-runner-207 kernel: [68152.616122] ? do_syscall_64+0x69/0xc0 Aug 23 00:19:38 juju-e4d256-prod-github-runner-207 kernel: [68152.616748] ? do_syscall_64+0x69/0xc0 Aug 23 00:19:38 juju-e4d256-prod-github-runner-207 kernel: [68152.617373] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 00:19:38 juju-e4d256-prod-github-runner-207 kernel: [68152.618086] RIP: 0033:0x7faa5d0edaff Aug 23 00:19:38 juju-e4d256-prod-github-runner-207 kernel: [68152.618746] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 00:19:38 juju-e4d256-prod-github-runner-207 kernel: [68152.620732] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 00:19:38 juju-e4d256-prod-github-runner-207 kernel: [68152.621640] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 00:19:38 juju-e4d256-prod-github-runner-207 kernel: [68152.622551] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 00:19:38 juju-e4d256-prod-github-runner-207 kernel: [68152.623479] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 00:19:38 juju-e4d256-prod-github-runner-207 kernel: [68152.624849] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 00:19:38 juju-e4d256-prod-github-runner-207 kernel: [68152.625783] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 00:19:38 juju-e4d256-prod-github-runner-207 kernel: [68152.626777] Aug 23 00:20:06 juju-e4d256-prod-github-runner-207 kernel: [68180.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 63390s! [qemu-system-x86:6715] Aug 23 00:20:06 juju-e4d256-prod-github-runner-207 kernel: [68180.543765] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 00:20:06 juju-e4d256-prod-github-runner-207 kernel: [68180.544011] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 00:20:06 juju-e4d256-prod-github-runner-207 kernel: [68180.556092] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 00:20:06 juju-e4d256-prod-github-runner-207 kernel: [68180.557373] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 00:20:06 juju-e4d256-prod-github-runner-207 kernel: [68180.558598] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:20:06 juju-e4d256-prod-github-runner-207 kernel: [68180.559678] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 00:20:06 juju-e4d256-prod-github-runner-207 kernel: [68180.562278] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 00:20:06 juju-e4d256-prod-github-runner-207 kernel: [68180.563334] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 00:20:06 juju-e4d256-prod-github-runner-207 kernel: [68180.564492] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 00:20:06 juju-e4d256-prod-github-runner-207 kernel: [68180.565664] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 00:20:06 juju-e4d256-prod-github-runner-207 kernel: [68180.566828] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 00:20:06 juju-e4d256-prod-github-runner-207 kernel: [68180.567985] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 00:20:06 juju-e4d256-prod-github-runner-207 kernel: [68180.569183] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 00:20:06 juju-e4d256-prod-github-runner-207 kernel: [68180.570419] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 00:20:06 juju-e4d256-prod-github-runner-207 kernel: [68180.571512] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 00:20:06 juju-e4d256-prod-github-runner-207 kernel: [68180.572702] Call Trace: Aug 23 00:20:06 juju-e4d256-prod-github-runner-207 kernel: [68180.573621] Aug 23 00:20:06 juju-e4d256-prod-github-runner-207 kernel: [68180.574596] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:20:06 juju-e4d256-prod-github-runner-207 kernel: [68180.575729] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:20:06 juju-e4d256-prod-github-runner-207 kernel: [68180.576837] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:20:06 juju-e4d256-prod-github-runner-207 kernel: [68180.578036] ? show_regs.part.0+0x23/0x29 Aug 23 00:20:06 juju-e4d256-prod-github-runner-207 kernel: [68180.579117] ? show_regs.cold+0x8/0xd Aug 23 00:20:06 juju-e4d256-prod-github-runner-207 kernel: [68180.580164] ? watchdog_timer_fn+0x1be/0x220 Aug 23 00:20:06 juju-e4d256-prod-github-runner-207 kernel: [68180.581260] ? lockup_detector_update_enable+0x60/0x60 Aug 23 00:20:06 juju-e4d256-prod-github-runner-207 kernel: [68180.582434] ? __hrtimer_run_queues+0x107/0x230 Aug 23 00:20:06 juju-e4d256-prod-github-runner-207 kernel: [68180.583543] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 00:20:06 juju-e4d256-prod-github-runner-207 kernel: [68180.584653] ? hrtimer_interrupt+0x101/0x220 Aug 23 00:20:06 juju-e4d256-prod-github-runner-207 kernel: [68180.585767] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 00:20:06 juju-e4d256-prod-github-runner-207 kernel: [68180.586929] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 00:20:06 juju-e4d256-prod-github-runner-207 kernel: [68180.588205] Aug 23 00:20:06 juju-e4d256-prod-github-runner-207 kernel: [68180.589269] Aug 23 00:20:06 juju-e4d256-prod-github-runner-207 kernel: [68180.590175] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 00:20:06 juju-e4d256-prod-github-runner-207 kernel: [68180.591317] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:20:06 juju-e4d256-prod-github-runner-207 kernel: [68180.592455] ? _raw_spin_lock+0x22/0x30 Aug 23 00:20:06 juju-e4d256-prod-github-runner-207 kernel: [68180.593492] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:20:06 juju-e4d256-prod-github-runner-207 kernel: [68180.594603] direct_page_fault+0x206/0x310 [kvm] Aug 23 00:20:06 juju-e4d256-prod-github-runner-207 kernel: [68180.595717] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 00:20:06 juju-e4d256-prod-github-runner-207 kernel: [68180.596816] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 00:20:06 juju-e4d256-prod-github-runner-207 kernel: [68180.597924] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 00:20:06 juju-e4d256-prod-github-runner-207 kernel: [68180.599022] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 00:20:06 juju-e4d256-prod-github-runner-207 kernel: [68180.600057] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 00:20:06 juju-e4d256-prod-github-runner-207 kernel: [68180.601144] handle_exit+0x98/0x230 [kvm_amd] Aug 23 00:20:06 juju-e4d256-prod-github-runner-207 kernel: [68180.602134] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 00:20:06 juju-e4d256-prod-github-runner-207 kernel: [68180.603137] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 00:20:06 juju-e4d256-prod-github-runner-207 kernel: [68180.604165] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 00:20:06 juju-e4d256-prod-github-runner-207 kernel: [68180.605178] vcpu_run+0x62/0x2c0 [kvm] Aug 23 00:20:06 juju-e4d256-prod-github-runner-207 kernel: [68180.606087] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 00:20:06 juju-e4d256-prod-github-runner-207 kernel: [68180.606983] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 00:20:06 juju-e4d256-prod-github-runner-207 kernel: [68180.607932] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 00:20:06 juju-e4d256-prod-github-runner-207 kernel: [68180.608812] ? __seccomp_filter+0x4a/0x4a0 Aug 23 00:20:06 juju-e4d256-prod-github-runner-207 kernel: [68180.609652] ? __fget_files+0x86/0xc0 Aug 23 00:20:06 juju-e4d256-prod-github-runner-207 kernel: [68180.610440] __x64_sys_ioctl+0x95/0xd0 Aug 23 00:20:06 juju-e4d256-prod-github-runner-207 kernel: [68180.611204] do_syscall_64+0x5c/0xc0 Aug 23 00:20:06 juju-e4d256-prod-github-runner-207 kernel: [68180.611936] ? do_futex+0x162/0x1f0 Aug 23 00:20:06 juju-e4d256-prod-github-runner-207 kernel: [68180.612653] ? __x64_sys_futex+0x78/0x1e0 Aug 23 00:20:06 juju-e4d256-prod-github-runner-207 kernel: [68180.613412] ? __secure_computing+0xa9/0x120 Aug 23 00:20:06 juju-e4d256-prod-github-runner-207 kernel: [68180.614200] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 00:20:06 juju-e4d256-prod-github-runner-207 kernel: [68180.615058] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:20:06 juju-e4d256-prod-github-runner-207 kernel: [68180.615868] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:20:06 juju-e4d256-prod-github-runner-207 kernel: [68180.616674] ? do_syscall_64+0x69/0xc0 Aug 23 00:20:06 juju-e4d256-prod-github-runner-207 kernel: [68180.617396] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:20:06 juju-e4d256-prod-github-runner-207 kernel: [68180.618205] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:20:06 juju-e4d256-prod-github-runner-207 kernel: [68180.618997] ? do_syscall_64+0x69/0xc0 Aug 23 00:20:06 juju-e4d256-prod-github-runner-207 kernel: [68180.619701] ? do_syscall_64+0x69/0xc0 Aug 23 00:20:06 juju-e4d256-prod-github-runner-207 kernel: [68180.620399] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 00:20:06 juju-e4d256-prod-github-runner-207 kernel: [68180.621202] RIP: 0033:0x7faa5d0edaff Aug 23 00:20:06 juju-e4d256-prod-github-runner-207 kernel: [68180.621952] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 00:20:06 juju-e4d256-prod-github-runner-207 kernel: [68180.624272] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 00:20:06 juju-e4d256-prod-github-runner-207 kernel: [68180.625326] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 00:20:06 juju-e4d256-prod-github-runner-207 kernel: [68180.626370] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 00:20:06 juju-e4d256-prod-github-runner-207 kernel: [68180.627387] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 00:20:06 juju-e4d256-prod-github-runner-207 kernel: [68180.628403] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 00:20:06 juju-e4d256-prod-github-runner-207 kernel: [68180.629428] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 00:20:06 juju-e4d256-prod-github-runner-207 kernel: [68180.630458] Aug 23 00:20:34 juju-e4d256-prod-github-runner-207 kernel: [68208.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 63416s! [qemu-system-x86:6715] Aug 23 00:20:34 juju-e4d256-prod-github-runner-207 kernel: [68208.544202] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 00:20:34 juju-e4d256-prod-github-runner-207 kernel: [68208.544454] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 00:20:34 juju-e4d256-prod-github-runner-207 kernel: [68208.556538] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 00:20:34 juju-e4d256-prod-github-runner-207 kernel: [68208.557814] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 00:20:34 juju-e4d256-prod-github-runner-207 kernel: [68208.559031] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:20:34 juju-e4d256-prod-github-runner-207 kernel: [68208.560085] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 00:20:34 juju-e4d256-prod-github-runner-207 kernel: [68208.562662] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 00:20:34 juju-e4d256-prod-github-runner-207 kernel: [68208.563707] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 00:20:34 juju-e4d256-prod-github-runner-207 kernel: [68208.564869] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 00:20:34 juju-e4d256-prod-github-runner-207 kernel: [68208.566040] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 00:20:34 juju-e4d256-prod-github-runner-207 kernel: [68208.567202] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 00:20:34 juju-e4d256-prod-github-runner-207 kernel: [68208.568369] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 00:20:34 juju-e4d256-prod-github-runner-207 kernel: [68208.569551] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 00:20:34 juju-e4d256-prod-github-runner-207 kernel: [68208.570788] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 00:20:34 juju-e4d256-prod-github-runner-207 kernel: [68208.571887] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 00:20:34 juju-e4d256-prod-github-runner-207 kernel: [68208.573082] Call Trace: Aug 23 00:20:34 juju-e4d256-prod-github-runner-207 kernel: [68208.574004] Aug 23 00:20:34 juju-e4d256-prod-github-runner-207 kernel: [68208.574900] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:20:34 juju-e4d256-prod-github-runner-207 kernel: [68208.575933] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:20:34 juju-e4d256-prod-github-runner-207 kernel: [68208.576959] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:20:34 juju-e4d256-prod-github-runner-207 kernel: [68208.578065] ? show_regs.part.0+0x23/0x29 Aug 23 00:20:34 juju-e4d256-prod-github-runner-207 kernel: [68208.579062] ? show_regs.cold+0x8/0xd Aug 23 00:20:34 juju-e4d256-prod-github-runner-207 kernel: [68208.580039] ? watchdog_timer_fn+0x1be/0x220 Aug 23 00:20:34 juju-e4d256-prod-github-runner-207 kernel: [68208.581051] ? lockup_detector_update_enable+0x60/0x60 Aug 23 00:20:34 juju-e4d256-prod-github-runner-207 kernel: [68208.582128] ? __hrtimer_run_queues+0x107/0x230 Aug 23 00:20:34 juju-e4d256-prod-github-runner-207 kernel: [68208.583154] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 00:20:34 juju-e4d256-prod-github-runner-207 kernel: [68208.584181] ? hrtimer_interrupt+0x101/0x220 Aug 23 00:20:34 juju-e4d256-prod-github-runner-207 kernel: [68208.585208] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 00:20:34 juju-e4d256-prod-github-runner-207 kernel: [68208.586279] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 00:20:34 juju-e4d256-prod-github-runner-207 kernel: [68208.587325] Aug 23 00:20:34 juju-e4d256-prod-github-runner-207 kernel: [68208.588178] Aug 23 00:20:34 juju-e4d256-prod-github-runner-207 kernel: [68208.589016] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 00:20:34 juju-e4d256-prod-github-runner-207 kernel: [68208.590062] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:20:34 juju-e4d256-prod-github-runner-207 kernel: [68208.591103] ? _raw_spin_lock+0x22/0x30 Aug 23 00:20:34 juju-e4d256-prod-github-runner-207 kernel: [68208.592047] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:20:34 juju-e4d256-prod-github-runner-207 kernel: [68208.593063] direct_page_fault+0x206/0x310 [kvm] Aug 23 00:20:34 juju-e4d256-prod-github-runner-207 kernel: [68208.594096] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 00:20:34 juju-e4d256-prod-github-runner-207 kernel: [68208.595106] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 00:20:34 juju-e4d256-prod-github-runner-207 kernel: [68208.596108] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 00:20:34 juju-e4d256-prod-github-runner-207 kernel: [68208.597111] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 00:20:34 juju-e4d256-prod-github-runner-207 kernel: [68208.598066] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 00:20:34 juju-e4d256-prod-github-runner-207 kernel: [68208.599045] handle_exit+0x98/0x230 [kvm_amd] Aug 23 00:20:34 juju-e4d256-prod-github-runner-207 kernel: [68208.600106] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 00:20:34 juju-e4d256-prod-github-runner-207 kernel: [68208.601023] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 00:20:34 juju-e4d256-prod-github-runner-207 kernel: [68208.601964] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 00:20:34 juju-e4d256-prod-github-runner-207 kernel: [68208.603010] vcpu_run+0x62/0x2c0 [kvm] Aug 23 00:20:34 juju-e4d256-prod-github-runner-207 kernel: [68208.603824] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 00:20:34 juju-e4d256-prod-github-runner-207 kernel: [68208.604636] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 00:20:34 juju-e4d256-prod-github-runner-207 kernel: [68208.605508] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 00:20:34 juju-e4d256-prod-github-runner-207 kernel: [68208.606310] ? __seccomp_filter+0x4a/0x4a0 Aug 23 00:20:34 juju-e4d256-prod-github-runner-207 kernel: [68208.607055] ? __fget_files+0x86/0xc0 Aug 23 00:20:34 juju-e4d256-prod-github-runner-207 kernel: [68208.607760] __x64_sys_ioctl+0x95/0xd0 Aug 23 00:20:34 juju-e4d256-prod-github-runner-207 kernel: [68208.608454] do_syscall_64+0x5c/0xc0 Aug 23 00:20:34 juju-e4d256-prod-github-runner-207 kernel: [68208.609137] ? do_futex+0x162/0x1f0 Aug 23 00:20:34 juju-e4d256-prod-github-runner-207 kernel: [68208.609789] ? __x64_sys_futex+0x78/0x1e0 Aug 23 00:20:34 juju-e4d256-prod-github-runner-207 kernel: [68208.610464] ? __secure_computing+0xa9/0x120 Aug 23 00:20:34 juju-e4d256-prod-github-runner-207 kernel: [68208.611154] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 00:20:34 juju-e4d256-prod-github-runner-207 kernel: [68208.611920] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:20:34 juju-e4d256-prod-github-runner-207 kernel: [68208.612644] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:20:34 juju-e4d256-prod-github-runner-207 kernel: [68208.613381] ? do_syscall_64+0x69/0xc0 Aug 23 00:20:34 juju-e4d256-prod-github-runner-207 kernel: [68208.614029] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:20:34 juju-e4d256-prod-github-runner-207 kernel: [68208.614745] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:20:34 juju-e4d256-prod-github-runner-207 kernel: [68208.615445] ? do_syscall_64+0x69/0xc0 Aug 23 00:20:34 juju-e4d256-prod-github-runner-207 kernel: [68208.616073] ? do_syscall_64+0x69/0xc0 Aug 23 00:20:34 juju-e4d256-prod-github-runner-207 kernel: [68208.616721] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 00:20:34 juju-e4d256-prod-github-runner-207 kernel: [68208.617471] RIP: 0033:0x7faa5d0edaff Aug 23 00:20:34 juju-e4d256-prod-github-runner-207 kernel: [68208.618519] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 00:20:34 juju-e4d256-prod-github-runner-207 kernel: [68208.620514] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 00:20:34 juju-e4d256-prod-github-runner-207 kernel: [68208.621438] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 00:20:34 juju-e4d256-prod-github-runner-207 kernel: [68208.622328] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 00:20:34 juju-e4d256-prod-github-runner-207 kernel: [68208.623217] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 00:20:34 juju-e4d256-prod-github-runner-207 kernel: [68208.624111] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 00:20:34 juju-e4d256-prod-github-runner-207 kernel: [68208.625000] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 00:20:34 juju-e4d256-prod-github-runner-207 kernel: [68208.625904] Aug 23 00:20:47 juju-e4d256-prod-github-runner-207 kernel: [68221.736705] rcu: INFO: rcu_sched self-detected stall on CPU Aug 23 00:20:47 juju-e4d256-prod-github-runner-207 kernel: [68221.737944] rcu: 1-....: (16972457 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=8193763 Aug 23 00:20:47 juju-e4d256-prod-github-runner-207 kernel: [68221.739099] (t=17026134 jiffies g=23269 q=59301) Aug 23 00:20:47 juju-e4d256-prod-github-runner-207 kernel: [68221.739892] NMI backtrace for cpu 1 Aug 23 00:20:47 juju-e4d256-prod-github-runner-207 kernel: [68221.740619] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 00:20:47 juju-e4d256-prod-github-runner-207 kernel: [68221.741730] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 00:20:47 juju-e4d256-prod-github-runner-207 kernel: [68221.742929] Call Trace: Aug 23 00:20:47 juju-e4d256-prod-github-runner-207 kernel: [68221.743602] Aug 23 00:20:47 juju-e4d256-prod-github-runner-207 kernel: [68221.744260] show_stack+0x52/0x5c Aug 23 00:20:47 juju-e4d256-prod-github-runner-207 kernel: [68221.745110] dump_stack_lvl+0x4a/0x63 Aug 23 00:20:47 juju-e4d256-prod-github-runner-207 kernel: [68221.745857] dump_stack+0x10/0x16 Aug 23 00:20:47 juju-e4d256-prod-github-runner-207 kernel: [68221.746571] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 23 00:20:47 juju-e4d256-prod-github-runner-207 kernel: [68221.747348] ? lapic_can_unplug_cpu+0x90/0x90 Aug 23 00:20:47 juju-e4d256-prod-github-runner-207 kernel: [68221.748124] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 23 00:20:47 juju-e4d256-prod-github-runner-207 kernel: [68221.748943] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 23 00:20:47 juju-e4d256-prod-github-runner-207 kernel: [68221.749773] trigger_single_cpu_backtrace+0x44/0x4f Aug 23 00:20:47 juju-e4d256-prod-github-runner-207 kernel: [68221.750578] rcu_dump_cpu_stacks+0x102/0x149 Aug 23 00:20:47 juju-e4d256-prod-github-runner-207 kernel: [68221.751348] print_cpu_stall.cold+0x2f/0xe2 Aug 23 00:20:47 juju-e4d256-prod-github-runner-207 kernel: [68221.752115] ? timekeeping_update+0xf7/0x150 Aug 23 00:20:47 juju-e4d256-prod-github-runner-207 kernel: [68221.752887] check_cpu_stall+0x109/0x270 Aug 23 00:20:47 juju-e4d256-prod-github-runner-207 kernel: [68221.753637] rcu_sched_clock_irq+0x9a/0x250 Aug 23 00:20:47 juju-e4d256-prod-github-runner-207 kernel: [68221.754402] update_process_times+0x94/0xd0 Aug 23 00:20:47 juju-e4d256-prod-github-runner-207 kernel: [68221.755164] tick_sched_handle+0x29/0x70 Aug 23 00:20:47 juju-e4d256-prod-github-runner-207 kernel: [68221.755906] tick_sched_timer+0x8c/0xc0 Aug 23 00:20:47 juju-e4d256-prod-github-runner-207 kernel: [68221.756642] ? tick_nohz_handler+0xb0/0xb0 Aug 23 00:20:47 juju-e4d256-prod-github-runner-207 kernel: [68221.757420] __hrtimer_run_queues+0x107/0x230 Aug 23 00:20:47 juju-e4d256-prod-github-runner-207 kernel: [68221.758214] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 00:20:47 juju-e4d256-prod-github-runner-207 kernel: [68221.759003] hrtimer_interrupt+0x101/0x220 Aug 23 00:20:47 juju-e4d256-prod-github-runner-207 kernel: [68221.759766] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 00:20:47 juju-e4d256-prod-github-runner-207 kernel: [68221.760576] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 00:20:47 juju-e4d256-prod-github-runner-207 kernel: [68221.761407] Aug 23 00:20:47 juju-e4d256-prod-github-runner-207 kernel: [68221.762044] Aug 23 00:20:47 juju-e4d256-prod-github-runner-207 kernel: [68221.762672] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 00:20:47 juju-e4d256-prod-github-runner-207 kernel: [68221.763491] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:20:47 juju-e4d256-prod-github-runner-207 kernel: [68221.764371] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 00:20:47 juju-e4d256-prod-github-runner-207 kernel: [68221.766586] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 00:20:47 juju-e4d256-prod-github-runner-207 kernel: [68221.767458] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 00:20:47 juju-e4d256-prod-github-runner-207 kernel: [68221.768452] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 00:20:47 juju-e4d256-prod-github-runner-207 kernel: [68221.769452] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 00:20:47 juju-e4d256-prod-github-runner-207 kernel: [68221.770415] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 00:20:47 juju-e4d256-prod-github-runner-207 kernel: [68221.771369] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 00:20:47 juju-e4d256-prod-github-runner-207 kernel: [68221.772320] ? _raw_spin_lock+0x22/0x30 Aug 23 00:20:47 juju-e4d256-prod-github-runner-207 kernel: [68221.773091] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:20:47 juju-e4d256-prod-github-runner-207 kernel: [68221.773951] direct_page_fault+0x206/0x310 [kvm] Aug 23 00:20:47 juju-e4d256-prod-github-runner-207 kernel: [68221.774794] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 00:20:47 juju-e4d256-prod-github-runner-207 kernel: [68221.775620] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 00:20:47 juju-e4d256-prod-github-runner-207 kernel: [68221.776466] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 00:20:47 juju-e4d256-prod-github-runner-207 kernel: [68221.777302] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 00:20:47 juju-e4d256-prod-github-runner-207 kernel: [68221.778092] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 00:20:47 juju-e4d256-prod-github-runner-207 kernel: [68221.778912] handle_exit+0x98/0x230 [kvm_amd] Aug 23 00:20:47 juju-e4d256-prod-github-runner-207 kernel: [68221.779670] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 00:20:47 juju-e4d256-prod-github-runner-207 kernel: [68221.780452] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 00:20:47 juju-e4d256-prod-github-runner-207 kernel: [68221.781264] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 00:20:47 juju-e4d256-prod-github-runner-207 kernel: [68221.782049] vcpu_run+0x62/0x2c0 [kvm] Aug 23 00:20:47 juju-e4d256-prod-github-runner-207 kernel: [68221.782764] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 00:20:47 juju-e4d256-prod-github-runner-207 kernel: [68221.783498] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 00:20:47 juju-e4d256-prod-github-runner-207 kernel: [68221.784302] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 00:20:47 juju-e4d256-prod-github-runner-207 kernel: [68221.785074] ? __seccomp_filter+0x4a/0x4a0 Aug 23 00:20:47 juju-e4d256-prod-github-runner-207 kernel: [68221.785795] ? __fget_files+0x86/0xc0 Aug 23 00:20:47 juju-e4d256-prod-github-runner-207 kernel: [68221.786487] __x64_sys_ioctl+0x95/0xd0 Aug 23 00:20:47 juju-e4d256-prod-github-runner-207 kernel: [68221.787186] do_syscall_64+0x5c/0xc0 Aug 23 00:20:47 juju-e4d256-prod-github-runner-207 kernel: [68221.787871] ? do_futex+0x162/0x1f0 Aug 23 00:20:47 juju-e4d256-prod-github-runner-207 kernel: [68221.788543] ? __x64_sys_futex+0x78/0x1e0 Aug 23 00:20:47 juju-e4d256-prod-github-runner-207 kernel: [68221.789253] ? __secure_computing+0xa9/0x120 Aug 23 00:20:47 juju-e4d256-prod-github-runner-207 kernel: [68221.789975] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 00:20:47 juju-e4d256-prod-github-runner-207 kernel: [68221.790770] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:20:47 juju-e4d256-prod-github-runner-207 kernel: [68221.791524] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:20:47 juju-e4d256-prod-github-runner-207 kernel: [68221.792279] ? do_syscall_64+0x69/0xc0 Aug 23 00:20:47 juju-e4d256-prod-github-runner-207 kernel: [68221.792975] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:20:47 juju-e4d256-prod-github-runner-207 kernel: [68221.793731] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:20:47 juju-e4d256-prod-github-runner-207 kernel: [68221.794506] ? do_syscall_64+0x69/0xc0 Aug 23 00:20:47 juju-e4d256-prod-github-runner-207 kernel: [68221.795209] ? do_syscall_64+0x69/0xc0 Aug 23 00:20:47 juju-e4d256-prod-github-runner-207 kernel: [68221.795918] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 00:20:47 juju-e4d256-prod-github-runner-207 kernel: [68221.796698] RIP: 0033:0x7faa5d0edaff Aug 23 00:20:47 juju-e4d256-prod-github-runner-207 kernel: [68221.797416] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 00:20:47 juju-e4d256-prod-github-runner-207 kernel: [68221.799528] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 00:20:47 juju-e4d256-prod-github-runner-207 kernel: [68221.800495] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 00:20:47 juju-e4d256-prod-github-runner-207 kernel: [68221.801462] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 00:20:47 juju-e4d256-prod-github-runner-207 kernel: [68221.802410] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 00:20:47 juju-e4d256-prod-github-runner-207 kernel: [68221.803358] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 00:20:47 juju-e4d256-prod-github-runner-207 kernel: [68221.804286] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 00:20:47 juju-e4d256-prod-github-runner-207 kernel: [68221.805217] Aug 23 00:21:14 juju-e4d256-prod-github-runner-207 kernel: [68248.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 63453s! [qemu-system-x86:6715] Aug 23 00:21:14 juju-e4d256-prod-github-runner-207 kernel: [68248.543742] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 00:21:14 juju-e4d256-prod-github-runner-207 kernel: [68248.543999] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 00:21:14 juju-e4d256-prod-github-runner-207 kernel: [68248.557770] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 00:21:14 juju-e4d256-prod-github-runner-207 kernel: [68248.559041] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 00:21:14 juju-e4d256-prod-github-runner-207 kernel: [68248.560260] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:21:14 juju-e4d256-prod-github-runner-207 kernel: [68248.561347] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 00:21:14 juju-e4d256-prod-github-runner-207 kernel: [68248.563901] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 00:21:14 juju-e4d256-prod-github-runner-207 kernel: [68248.565000] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 00:21:14 juju-e4d256-prod-github-runner-207 kernel: [68248.566256] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 00:21:14 juju-e4d256-prod-github-runner-207 kernel: [68248.567434] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 00:21:14 juju-e4d256-prod-github-runner-207 kernel: [68248.568603] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 00:21:14 juju-e4d256-prod-github-runner-207 kernel: [68248.569790] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 00:21:14 juju-e4d256-prod-github-runner-207 kernel: [68248.570968] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 00:21:14 juju-e4d256-prod-github-runner-207 kernel: [68248.572203] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 00:21:14 juju-e4d256-prod-github-runner-207 kernel: [68248.573320] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 00:21:14 juju-e4d256-prod-github-runner-207 kernel: [68248.574522] Call Trace: Aug 23 00:21:14 juju-e4d256-prod-github-runner-207 kernel: [68248.575441] Aug 23 00:21:14 juju-e4d256-prod-github-runner-207 kernel: [68248.576343] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:21:14 juju-e4d256-prod-github-runner-207 kernel: [68248.577402] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:21:14 juju-e4d256-prod-github-runner-207 kernel: [68248.578445] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:21:14 juju-e4d256-prod-github-runner-207 kernel: [68248.579556] ? show_regs.part.0+0x23/0x29 Aug 23 00:21:14 juju-e4d256-prod-github-runner-207 kernel: [68248.580555] ? show_regs.cold+0x8/0xd Aug 23 00:21:14 juju-e4d256-prod-github-runner-207 kernel: [68248.581556] ? watchdog_timer_fn+0x1be/0x220 Aug 23 00:21:14 juju-e4d256-prod-github-runner-207 kernel: [68248.582573] ? lockup_detector_update_enable+0x60/0x60 Aug 23 00:21:14 juju-e4d256-prod-github-runner-207 kernel: [68248.583642] ? __hrtimer_run_queues+0x107/0x230 Aug 23 00:21:14 juju-e4d256-prod-github-runner-207 kernel: [68248.584698] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 00:21:14 juju-e4d256-prod-github-runner-207 kernel: [68248.585722] ? hrtimer_interrupt+0x101/0x220 Aug 23 00:21:14 juju-e4d256-prod-github-runner-207 kernel: [68248.586737] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 00:21:14 juju-e4d256-prod-github-runner-207 kernel: [68248.587807] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 00:21:14 juju-e4d256-prod-github-runner-207 kernel: [68248.588868] Aug 23 00:21:14 juju-e4d256-prod-github-runner-207 kernel: [68248.589727] Aug 23 00:21:14 juju-e4d256-prod-github-runner-207 kernel: [68248.590570] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 00:21:14 juju-e4d256-prod-github-runner-207 kernel: [68248.591604] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:21:14 juju-e4d256-prod-github-runner-207 kernel: [68248.592661] ? _raw_spin_lock+0x22/0x30 Aug 23 00:21:14 juju-e4d256-prod-github-runner-207 kernel: [68248.593612] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:21:14 juju-e4d256-prod-github-runner-207 kernel: [68248.594630] direct_page_fault+0x206/0x310 [kvm] Aug 23 00:21:14 juju-e4d256-prod-github-runner-207 kernel: [68248.595654] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 00:21:14 juju-e4d256-prod-github-runner-207 kernel: [68248.596697] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 00:21:14 juju-e4d256-prod-github-runner-207 kernel: [68248.597701] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 00:21:14 juju-e4d256-prod-github-runner-207 kernel: [68248.598714] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 00:21:14 juju-e4d256-prod-github-runner-207 kernel: [68248.599662] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 00:21:14 juju-e4d256-prod-github-runner-207 kernel: [68248.600653] handle_exit+0x98/0x230 [kvm_amd] Aug 23 00:21:14 juju-e4d256-prod-github-runner-207 kernel: [68248.601668] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 00:21:14 juju-e4d256-prod-github-runner-207 kernel: [68248.602587] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 00:21:14 juju-e4d256-prod-github-runner-207 kernel: [68248.603512] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 00:21:14 juju-e4d256-prod-github-runner-207 kernel: [68248.604415] vcpu_run+0x62/0x2c0 [kvm] Aug 23 00:21:14 juju-e4d256-prod-github-runner-207 kernel: [68248.605254] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 00:21:14 juju-e4d256-prod-github-runner-207 kernel: [68248.606061] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 00:21:14 juju-e4d256-prod-github-runner-207 kernel: [68248.606915] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 00:21:14 juju-e4d256-prod-github-runner-207 kernel: [68248.607714] ? __seccomp_filter+0x4a/0x4a0 Aug 23 00:21:14 juju-e4d256-prod-github-runner-207 kernel: [68248.608463] ? __fget_files+0x86/0xc0 Aug 23 00:21:14 juju-e4d256-prod-github-runner-207 kernel: [68248.609180] __x64_sys_ioctl+0x95/0xd0 Aug 23 00:21:14 juju-e4d256-prod-github-runner-207 kernel: [68248.609872] do_syscall_64+0x5c/0xc0 Aug 23 00:21:14 juju-e4d256-prod-github-runner-207 kernel: [68248.610537] ? do_futex+0x162/0x1f0 Aug 23 00:21:14 juju-e4d256-prod-github-runner-207 kernel: [68248.611192] ? __x64_sys_futex+0x78/0x1e0 Aug 23 00:21:14 juju-e4d256-prod-github-runner-207 kernel: [68248.611865] ? __secure_computing+0xa9/0x120 Aug 23 00:21:14 juju-e4d256-prod-github-runner-207 kernel: [68248.612555] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 00:21:14 juju-e4d256-prod-github-runner-207 kernel: [68248.613326] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:21:14 juju-e4d256-prod-github-runner-207 kernel: [68248.614049] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:21:14 juju-e4d256-prod-github-runner-207 kernel: [68248.614768] ? do_syscall_64+0x69/0xc0 Aug 23 00:21:14 juju-e4d256-prod-github-runner-207 kernel: [68248.615415] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:21:14 juju-e4d256-prod-github-runner-207 kernel: [68248.616116] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:21:14 juju-e4d256-prod-github-runner-207 kernel: [68248.616827] ? do_syscall_64+0x69/0xc0 Aug 23 00:21:14 juju-e4d256-prod-github-runner-207 kernel: [68248.617454] ? do_syscall_64+0x69/0xc0 Aug 23 00:21:14 juju-e4d256-prod-github-runner-207 kernel: [68248.618079] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 00:21:14 juju-e4d256-prod-github-runner-207 kernel: [68248.618783] RIP: 0033:0x7faa5d0edaff Aug 23 00:21:14 juju-e4d256-prod-github-runner-207 kernel: [68248.619554] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 00:21:14 juju-e4d256-prod-github-runner-207 kernel: [68248.621577] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 00:21:14 juju-e4d256-prod-github-runner-207 kernel: [68248.622493] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 00:21:14 juju-e4d256-prod-github-runner-207 kernel: [68248.623383] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 00:21:14 juju-e4d256-prod-github-runner-207 kernel: [68248.624282] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 00:21:14 juju-e4d256-prod-github-runner-207 kernel: [68248.625196] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 00:21:14 juju-e4d256-prod-github-runner-207 kernel: [68248.626086] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 00:21:14 juju-e4d256-prod-github-runner-207 kernel: [68248.626984] Aug 23 00:21:42 juju-e4d256-prod-github-runner-207 kernel: [68276.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 63479s! [qemu-system-x86:6715] Aug 23 00:21:42 juju-e4d256-prod-github-runner-207 kernel: [68276.543747] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 00:21:42 juju-e4d256-prod-github-runner-207 kernel: [68276.544002] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 00:21:42 juju-e4d256-prod-github-runner-207 kernel: [68276.556038] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 00:21:42 juju-e4d256-prod-github-runner-207 kernel: [68276.557304] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 00:21:42 juju-e4d256-prod-github-runner-207 kernel: [68276.558524] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:21:42 juju-e4d256-prod-github-runner-207 kernel: [68276.559575] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 00:21:42 juju-e4d256-prod-github-runner-207 kernel: [68276.562123] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 00:21:42 juju-e4d256-prod-github-runner-207 kernel: [68276.563189] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 00:21:42 juju-e4d256-prod-github-runner-207 kernel: [68276.564386] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 00:21:42 juju-e4d256-prod-github-runner-207 kernel: [68276.565546] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 00:21:42 juju-e4d256-prod-github-runner-207 kernel: [68276.566705] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 00:21:42 juju-e4d256-prod-github-runner-207 kernel: [68276.567869] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 00:21:42 juju-e4d256-prod-github-runner-207 kernel: [68276.569047] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 00:21:42 juju-e4d256-prod-github-runner-207 kernel: [68276.570284] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 00:21:42 juju-e4d256-prod-github-runner-207 kernel: [68276.571380] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 00:21:42 juju-e4d256-prod-github-runner-207 kernel: [68276.572586] Call Trace: Aug 23 00:21:42 juju-e4d256-prod-github-runner-207 kernel: [68276.573498] Aug 23 00:21:42 juju-e4d256-prod-github-runner-207 kernel: [68276.574392] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:21:42 juju-e4d256-prod-github-runner-207 kernel: [68276.575422] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:21:42 juju-e4d256-prod-github-runner-207 kernel: [68276.576453] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:21:42 juju-e4d256-prod-github-runner-207 kernel: [68276.577548] ? show_regs.part.0+0x23/0x29 Aug 23 00:21:42 juju-e4d256-prod-github-runner-207 kernel: [68276.578543] ? show_regs.cold+0x8/0xd Aug 23 00:21:42 juju-e4d256-prod-github-runner-207 kernel: [68276.579512] ? watchdog_timer_fn+0x1be/0x220 Aug 23 00:21:42 juju-e4d256-prod-github-runner-207 kernel: [68276.580530] ? lockup_detector_update_enable+0x60/0x60 Aug 23 00:21:42 juju-e4d256-prod-github-runner-207 kernel: [68276.581594] ? __hrtimer_run_queues+0x107/0x230 Aug 23 00:21:42 juju-e4d256-prod-github-runner-207 kernel: [68276.582629] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 00:21:42 juju-e4d256-prod-github-runner-207 kernel: [68276.583663] ? hrtimer_interrupt+0x101/0x220 Aug 23 00:21:42 juju-e4d256-prod-github-runner-207 kernel: [68276.584686] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 00:21:42 juju-e4d256-prod-github-runner-207 kernel: [68276.585753] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 00:21:42 juju-e4d256-prod-github-runner-207 kernel: [68276.586803] Aug 23 00:21:42 juju-e4d256-prod-github-runner-207 kernel: [68276.587654] Aug 23 00:21:42 juju-e4d256-prod-github-runner-207 kernel: [68276.588497] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 00:21:42 juju-e4d256-prod-github-runner-207 kernel: [68276.589526] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:21:42 juju-e4d256-prod-github-runner-207 kernel: [68276.590562] ? _raw_spin_lock+0x22/0x30 Aug 23 00:21:42 juju-e4d256-prod-github-runner-207 kernel: [68276.591504] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:21:42 juju-e4d256-prod-github-runner-207 kernel: [68276.592526] direct_page_fault+0x206/0x310 [kvm] Aug 23 00:21:42 juju-e4d256-prod-github-runner-207 kernel: [68276.593560] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 00:21:42 juju-e4d256-prod-github-runner-207 kernel: [68276.594586] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 00:21:42 juju-e4d256-prod-github-runner-207 kernel: [68276.595586] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 00:21:42 juju-e4d256-prod-github-runner-207 kernel: [68276.596597] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 00:21:42 juju-e4d256-prod-github-runner-207 kernel: [68276.597543] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 00:21:42 juju-e4d256-prod-github-runner-207 kernel: [68276.598519] handle_exit+0x98/0x230 [kvm_amd] Aug 23 00:21:42 juju-e4d256-prod-github-runner-207 kernel: [68276.599407] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 00:21:42 juju-e4d256-prod-github-runner-207 kernel: [68276.600350] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 00:21:42 juju-e4d256-prod-github-runner-207 kernel: [68276.601278] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 00:21:42 juju-e4d256-prod-github-runner-207 kernel: [68276.602183] vcpu_run+0x62/0x2c0 [kvm] Aug 23 00:21:42 juju-e4d256-prod-github-runner-207 kernel: [68276.602991] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 00:21:42 juju-e4d256-prod-github-runner-207 kernel: [68276.603796] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 00:21:42 juju-e4d256-prod-github-runner-207 kernel: [68276.604659] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 00:21:42 juju-e4d256-prod-github-runner-207 kernel: [68276.605455] ? __seccomp_filter+0x4a/0x4a0 Aug 23 00:21:42 juju-e4d256-prod-github-runner-207 kernel: [68276.606194] ? __fget_files+0x86/0xc0 Aug 23 00:21:42 juju-e4d256-prod-github-runner-207 kernel: [68276.606905] __x64_sys_ioctl+0x95/0xd0 Aug 23 00:21:42 juju-e4d256-prod-github-runner-207 kernel: [68276.607615] do_syscall_64+0x5c/0xc0 Aug 23 00:21:42 juju-e4d256-prod-github-runner-207 kernel: [68276.608296] ? do_futex+0x162/0x1f0 Aug 23 00:21:42 juju-e4d256-prod-github-runner-207 kernel: [68276.608943] ? __x64_sys_futex+0x78/0x1e0 Aug 23 00:21:42 juju-e4d256-prod-github-runner-207 kernel: [68276.609630] ? __secure_computing+0xa9/0x120 Aug 23 00:21:42 juju-e4d256-prod-github-runner-207 kernel: [68276.610321] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 00:21:42 juju-e4d256-prod-github-runner-207 kernel: [68276.611085] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:21:42 juju-e4d256-prod-github-runner-207 kernel: [68276.611808] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:21:42 juju-e4d256-prod-github-runner-207 kernel: [68276.612534] ? do_syscall_64+0x69/0xc0 Aug 23 00:21:42 juju-e4d256-prod-github-runner-207 kernel: [68276.613179] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:21:42 juju-e4d256-prod-github-runner-207 kernel: [68276.613904] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:21:42 juju-e4d256-prod-github-runner-207 kernel: [68276.614605] ? do_syscall_64+0x69/0xc0 Aug 23 00:21:42 juju-e4d256-prod-github-runner-207 kernel: [68276.615231] ? do_syscall_64+0x69/0xc0 Aug 23 00:21:42 juju-e4d256-prod-github-runner-207 kernel: [68276.615851] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 00:21:42 juju-e4d256-prod-github-runner-207 kernel: [68276.616564] RIP: 0033:0x7faa5d0edaff Aug 23 00:21:42 juju-e4d256-prod-github-runner-207 kernel: [68276.617223] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 00:21:42 juju-e4d256-prod-github-runner-207 kernel: [68276.619211] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 00:21:42 juju-e4d256-prod-github-runner-207 kernel: [68276.620120] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 00:21:42 juju-e4d256-prod-github-runner-207 kernel: [68276.621020] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 00:21:42 juju-e4d256-prod-github-runner-207 kernel: [68276.621914] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 00:21:42 juju-e4d256-prod-github-runner-207 kernel: [68276.622799] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 00:21:42 juju-e4d256-prod-github-runner-207 kernel: [68276.623698] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 00:21:42 juju-e4d256-prod-github-runner-207 kernel: [68276.624606] Aug 23 00:22:10 juju-e4d256-prod-github-runner-207 kernel: [68304.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 63505s! [qemu-system-x86:6715] Aug 23 00:22:10 juju-e4d256-prod-github-runner-207 kernel: [68304.543708] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 00:22:10 juju-e4d256-prod-github-runner-207 kernel: [68304.543964] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 00:22:10 juju-e4d256-prod-github-runner-207 kernel: [68304.556066] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 00:22:10 juju-e4d256-prod-github-runner-207 kernel: [68304.557340] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 00:22:10 juju-e4d256-prod-github-runner-207 kernel: [68304.558561] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:22:10 juju-e4d256-prod-github-runner-207 kernel: [68304.559620] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 00:22:10 juju-e4d256-prod-github-runner-207 kernel: [68304.562183] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 00:22:10 juju-e4d256-prod-github-runner-207 kernel: [68304.563229] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 00:22:10 juju-e4d256-prod-github-runner-207 kernel: [68304.564407] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 00:22:10 juju-e4d256-prod-github-runner-207 kernel: [68304.565571] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 00:22:10 juju-e4d256-prod-github-runner-207 kernel: [68304.566730] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 00:22:10 juju-e4d256-prod-github-runner-207 kernel: [68304.567890] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 00:22:10 juju-e4d256-prod-github-runner-207 kernel: [68304.569089] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 00:22:10 juju-e4d256-prod-github-runner-207 kernel: [68304.570324] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 00:22:10 juju-e4d256-prod-github-runner-207 kernel: [68304.571417] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 00:22:10 juju-e4d256-prod-github-runner-207 kernel: [68304.572634] Call Trace: Aug 23 00:22:10 juju-e4d256-prod-github-runner-207 kernel: [68304.573587] Aug 23 00:22:10 juju-e4d256-prod-github-runner-207 kernel: [68304.574509] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:22:10 juju-e4d256-prod-github-runner-207 kernel: [68304.575545] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:22:10 juju-e4d256-prod-github-runner-207 kernel: [68304.576606] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:22:10 juju-e4d256-prod-github-runner-207 kernel: [68304.577710] ? show_regs.part.0+0x23/0x29 Aug 23 00:22:10 juju-e4d256-prod-github-runner-207 kernel: [68304.578731] ? show_regs.cold+0x8/0xd Aug 23 00:22:10 juju-e4d256-prod-github-runner-207 kernel: [68304.579705] ? watchdog_timer_fn+0x1be/0x220 Aug 23 00:22:10 juju-e4d256-prod-github-runner-207 kernel: [68304.580888] ? lockup_detector_update_enable+0x60/0x60 Aug 23 00:22:10 juju-e4d256-prod-github-runner-207 kernel: [68304.582179] ? __hrtimer_run_queues+0x107/0x230 Aug 23 00:22:10 juju-e4d256-prod-github-runner-207 kernel: [68304.583436] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 00:22:10 juju-e4d256-prod-github-runner-207 kernel: [68304.584693] ? hrtimer_interrupt+0x101/0x220 Aug 23 00:22:10 juju-e4d256-prod-github-runner-207 kernel: [68304.586099] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 00:22:10 juju-e4d256-prod-github-runner-207 kernel: [68304.587221] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 00:22:10 juju-e4d256-prod-github-runner-207 kernel: [68304.588687] Aug 23 00:22:10 juju-e4d256-prod-github-runner-207 kernel: [68304.589545] Aug 23 00:22:10 juju-e4d256-prod-github-runner-207 kernel: [68304.590603] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 00:22:10 juju-e4d256-prod-github-runner-207 kernel: [68304.591834] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:22:10 juju-e4d256-prod-github-runner-207 kernel: [68304.593116] ? _raw_spin_lock+0x22/0x30 Aug 23 00:22:10 juju-e4d256-prod-github-runner-207 kernel: [68304.594070] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:22:10 juju-e4d256-prod-github-runner-207 kernel: [68304.595414] direct_page_fault+0x206/0x310 [kvm] Aug 23 00:22:10 juju-e4d256-prod-github-runner-207 kernel: [68304.596555] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 00:22:10 juju-e4d256-prod-github-runner-207 kernel: [68304.597787] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 00:22:10 juju-e4d256-prod-github-runner-207 kernel: [68304.599013] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 00:22:10 juju-e4d256-prod-github-runner-207 kernel: [68304.600269] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 00:22:10 juju-e4d256-prod-github-runner-207 kernel: [68304.601389] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 00:22:10 juju-e4d256-prod-github-runner-207 kernel: [68304.602387] handle_exit+0x98/0x230 [kvm_amd] Aug 23 00:22:10 juju-e4d256-prod-github-runner-207 kernel: [68304.603284] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 00:22:10 juju-e4d256-prod-github-runner-207 kernel: [68304.604222] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 00:22:10 juju-e4d256-prod-github-runner-207 kernel: [68304.605151] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 00:22:10 juju-e4d256-prod-github-runner-207 kernel: [68304.606061] vcpu_run+0x62/0x2c0 [kvm] Aug 23 00:22:10 juju-e4d256-prod-github-runner-207 kernel: [68304.606880] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 00:22:10 juju-e4d256-prod-github-runner-207 kernel: [68304.607694] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 00:22:10 juju-e4d256-prod-github-runner-207 kernel: [68304.608564] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 00:22:10 juju-e4d256-prod-github-runner-207 kernel: [68304.609370] ? __seccomp_filter+0x4a/0x4a0 Aug 23 00:22:10 juju-e4d256-prod-github-runner-207 kernel: [68304.610117] ? __fget_files+0x86/0xc0 Aug 23 00:22:10 juju-e4d256-prod-github-runner-207 kernel: [68304.610828] __x64_sys_ioctl+0x95/0xd0 Aug 23 00:22:10 juju-e4d256-prod-github-runner-207 kernel: [68304.611527] do_syscall_64+0x5c/0xc0 Aug 23 00:22:10 juju-e4d256-prod-github-runner-207 kernel: [68304.612207] ? do_futex+0x162/0x1f0 Aug 23 00:22:10 juju-e4d256-prod-github-runner-207 kernel: [68304.612859] ? __x64_sys_futex+0x78/0x1e0 Aug 23 00:22:10 juju-e4d256-prod-github-runner-207 kernel: [68304.613539] ? __secure_computing+0xa9/0x120 Aug 23 00:22:10 juju-e4d256-prod-github-runner-207 kernel: [68304.614230] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 00:22:10 juju-e4d256-prod-github-runner-207 kernel: [68304.614993] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:22:10 juju-e4d256-prod-github-runner-207 kernel: [68304.615715] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:22:10 juju-e4d256-prod-github-runner-207 kernel: [68304.616456] ? do_syscall_64+0x69/0xc0 Aug 23 00:22:10 juju-e4d256-prod-github-runner-207 kernel: [68304.617102] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:22:10 juju-e4d256-prod-github-runner-207 kernel: [68304.617806] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:22:10 juju-e4d256-prod-github-runner-207 kernel: [68304.618502] ? do_syscall_64+0x69/0xc0 Aug 23 00:22:10 juju-e4d256-prod-github-runner-207 kernel: [68304.619127] ? do_syscall_64+0x69/0xc0 Aug 23 00:22:10 juju-e4d256-prod-github-runner-207 kernel: [68304.619749] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 00:22:10 juju-e4d256-prod-github-runner-207 kernel: [68304.620467] RIP: 0033:0x7faa5d0edaff Aug 23 00:22:10 juju-e4d256-prod-github-runner-207 kernel: [68304.621116] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 00:22:10 juju-e4d256-prod-github-runner-207 kernel: [68304.623336] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 00:22:10 juju-e4d256-prod-github-runner-207 kernel: [68304.624544] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 00:22:10 juju-e4d256-prod-github-runner-207 kernel: [68304.625681] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 00:22:10 juju-e4d256-prod-github-runner-207 kernel: [68304.626574] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 00:22:10 juju-e4d256-prod-github-runner-207 kernel: [68304.627469] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 00:22:10 juju-e4d256-prod-github-runner-207 kernel: [68304.628367] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 00:22:10 juju-e4d256-prod-github-runner-207 kernel: [68304.629270] Aug 23 00:22:38 juju-e4d256-prod-github-runner-207 kernel: [68332.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 63531s! [qemu-system-x86:6715] Aug 23 00:22:38 juju-e4d256-prod-github-runner-207 kernel: [68332.543101] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 00:22:38 juju-e4d256-prod-github-runner-207 kernel: [68332.543170] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 00:22:38 juju-e4d256-prod-github-runner-207 kernel: [68332.555222] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 00:22:38 juju-e4d256-prod-github-runner-207 kernel: [68332.556504] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 00:22:38 juju-e4d256-prod-github-runner-207 kernel: [68332.557719] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:22:38 juju-e4d256-prod-github-runner-207 kernel: [68332.558772] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 00:22:38 juju-e4d256-prod-github-runner-207 kernel: [68332.561358] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 00:22:38 juju-e4d256-prod-github-runner-207 kernel: [68332.562428] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 00:22:38 juju-e4d256-prod-github-runner-207 kernel: [68332.563598] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 00:22:38 juju-e4d256-prod-github-runner-207 kernel: [68332.564780] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 00:22:38 juju-e4d256-prod-github-runner-207 kernel: [68332.565954] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 00:22:38 juju-e4d256-prod-github-runner-207 kernel: [68332.567116] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 00:22:38 juju-e4d256-prod-github-runner-207 kernel: [68332.568296] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 00:22:38 juju-e4d256-prod-github-runner-207 kernel: [68332.569538] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 00:22:38 juju-e4d256-prod-github-runner-207 kernel: [68332.570667] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 00:22:38 juju-e4d256-prod-github-runner-207 kernel: [68332.571880] Call Trace: Aug 23 00:22:38 juju-e4d256-prod-github-runner-207 kernel: [68332.572796] Aug 23 00:22:38 juju-e4d256-prod-github-runner-207 kernel: [68332.573695] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:22:38 juju-e4d256-prod-github-runner-207 kernel: [68332.574735] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:22:38 juju-e4d256-prod-github-runner-207 kernel: [68332.575763] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:22:38 juju-e4d256-prod-github-runner-207 kernel: [68332.576837] ? show_regs.part.0+0x23/0x29 Aug 23 00:22:38 juju-e4d256-prod-github-runner-207 kernel: [68332.577918] ? show_regs.cold+0x8/0xd Aug 23 00:22:38 juju-e4d256-prod-github-runner-207 kernel: [68332.578931] ? watchdog_timer_fn+0x1be/0x220 Aug 23 00:22:38 juju-e4d256-prod-github-runner-207 kernel: [68332.579963] ? lockup_detector_update_enable+0x60/0x60 Aug 23 00:22:38 juju-e4d256-prod-github-runner-207 kernel: [68332.581099] ? __hrtimer_run_queues+0x107/0x230 Aug 23 00:22:38 juju-e4d256-prod-github-runner-207 kernel: [68332.582124] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 00:22:38 juju-e4d256-prod-github-runner-207 kernel: [68332.583169] ? hrtimer_interrupt+0x101/0x220 Aug 23 00:22:38 juju-e4d256-prod-github-runner-207 kernel: [68332.584225] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 00:22:38 juju-e4d256-prod-github-runner-207 kernel: [68332.585304] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 00:22:38 juju-e4d256-prod-github-runner-207 kernel: [68332.586348] Aug 23 00:22:38 juju-e4d256-prod-github-runner-207 kernel: [68332.587220] Aug 23 00:22:38 juju-e4d256-prod-github-runner-207 kernel: [68332.588080] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 00:22:38 juju-e4d256-prod-github-runner-207 kernel: [68332.589118] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:22:38 juju-e4d256-prod-github-runner-207 kernel: [68332.590159] ? _raw_spin_lock+0x22/0x30 Aug 23 00:22:38 juju-e4d256-prod-github-runner-207 kernel: [68332.591102] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:22:38 juju-e4d256-prod-github-runner-207 kernel: [68332.592135] direct_page_fault+0x206/0x310 [kvm] Aug 23 00:22:38 juju-e4d256-prod-github-runner-207 kernel: [68332.593160] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 00:22:38 juju-e4d256-prod-github-runner-207 kernel: [68332.594167] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 00:22:38 juju-e4d256-prod-github-runner-207 kernel: [68332.595164] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 00:22:38 juju-e4d256-prod-github-runner-207 kernel: [68332.596151] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 00:22:38 juju-e4d256-prod-github-runner-207 kernel: [68332.597094] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 00:22:38 juju-e4d256-prod-github-runner-207 kernel: [68332.598088] handle_exit+0x98/0x230 [kvm_amd] Aug 23 00:22:38 juju-e4d256-prod-github-runner-207 kernel: [68332.598986] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 00:22:38 juju-e4d256-prod-github-runner-207 kernel: [68332.599916] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 00:22:38 juju-e4d256-prod-github-runner-207 kernel: [68332.600838] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 00:22:38 juju-e4d256-prod-github-runner-207 kernel: [68332.601769] vcpu_run+0x62/0x2c0 [kvm] Aug 23 00:22:38 juju-e4d256-prod-github-runner-207 kernel: [68332.602581] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 00:22:38 juju-e4d256-prod-github-runner-207 kernel: [68332.603387] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 00:22:38 juju-e4d256-prod-github-runner-207 kernel: [68332.604257] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 00:22:38 juju-e4d256-prod-github-runner-207 kernel: [68332.605092] ? __seccomp_filter+0x4a/0x4a0 Aug 23 00:22:38 juju-e4d256-prod-github-runner-207 kernel: [68332.605837] ? __fget_files+0x86/0xc0 Aug 23 00:22:38 juju-e4d256-prod-github-runner-207 kernel: [68332.606535] __x64_sys_ioctl+0x95/0xd0 Aug 23 00:22:38 juju-e4d256-prod-github-runner-207 kernel: [68332.607228] do_syscall_64+0x5c/0xc0 Aug 23 00:22:38 juju-e4d256-prod-github-runner-207 kernel: [68332.607906] ? do_futex+0x162/0x1f0 Aug 23 00:22:38 juju-e4d256-prod-github-runner-207 kernel: [68332.608556] ? __x64_sys_futex+0x78/0x1e0 Aug 23 00:22:38 juju-e4d256-prod-github-runner-207 kernel: [68332.609226] ? __secure_computing+0xa9/0x120 Aug 23 00:22:38 juju-e4d256-prod-github-runner-207 kernel: [68332.609939] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 00:22:38 juju-e4d256-prod-github-runner-207 kernel: [68332.610695] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:22:38 juju-e4d256-prod-github-runner-207 kernel: [68332.611409] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:22:38 juju-e4d256-prod-github-runner-207 kernel: [68332.612137] ? do_syscall_64+0x69/0xc0 Aug 23 00:22:38 juju-e4d256-prod-github-runner-207 kernel: [68332.612782] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:22:38 juju-e4d256-prod-github-runner-207 kernel: [68332.613505] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:22:38 juju-e4d256-prod-github-runner-207 kernel: [68332.614209] ? do_syscall_64+0x69/0xc0 Aug 23 00:22:38 juju-e4d256-prod-github-runner-207 kernel: [68332.614835] ? do_syscall_64+0x69/0xc0 Aug 23 00:22:38 juju-e4d256-prod-github-runner-207 kernel: [68332.615453] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 00:22:38 juju-e4d256-prod-github-runner-207 kernel: [68332.616174] RIP: 0033:0x7faa5d0edaff Aug 23 00:22:38 juju-e4d256-prod-github-runner-207 kernel: [68332.616795] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 00:22:38 juju-e4d256-prod-github-runner-207 kernel: [68332.618787] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 00:22:38 juju-e4d256-prod-github-runner-207 kernel: [68332.619709] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 00:22:38 juju-e4d256-prod-github-runner-207 kernel: [68332.620595] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 00:22:38 juju-e4d256-prod-github-runner-207 kernel: [68332.621482] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 00:22:38 juju-e4d256-prod-github-runner-207 kernel: [68332.622365] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 00:22:38 juju-e4d256-prod-github-runner-207 kernel: [68332.623247] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 00:22:38 juju-e4d256-prod-github-runner-207 kernel: [68332.624138] Aug 23 00:23:06 juju-e4d256-prod-github-runner-207 kernel: [68360.541981] watchdog: BUG: soft lockup - CPU#1 stuck for 63557s! [qemu-system-x86:6715] Aug 23 00:23:06 juju-e4d256-prod-github-runner-207 kernel: [68360.543744] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 00:23:06 juju-e4d256-prod-github-runner-207 kernel: [68360.544001] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 00:23:06 juju-e4d256-prod-github-runner-207 kernel: [68360.556087] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 00:23:06 juju-e4d256-prod-github-runner-207 kernel: [68360.557352] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 00:23:06 juju-e4d256-prod-github-runner-207 kernel: [68360.558572] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:23:06 juju-e4d256-prod-github-runner-207 kernel: [68360.559643] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 00:23:06 juju-e4d256-prod-github-runner-207 kernel: [68360.562192] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 00:23:06 juju-e4d256-prod-github-runner-207 kernel: [68360.563251] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 00:23:06 juju-e4d256-prod-github-runner-207 kernel: [68360.564509] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 00:23:06 juju-e4d256-prod-github-runner-207 kernel: [68360.565667] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 00:23:06 juju-e4d256-prod-github-runner-207 kernel: [68360.566831] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 00:23:06 juju-e4d256-prod-github-runner-207 kernel: [68360.568000] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 00:23:06 juju-e4d256-prod-github-runner-207 kernel: [68360.569362] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 00:23:06 juju-e4d256-prod-github-runner-207 kernel: [68360.570994] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 00:23:06 juju-e4d256-prod-github-runner-207 kernel: [68360.572164] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 00:23:06 juju-e4d256-prod-github-runner-207 kernel: [68360.573373] Call Trace: Aug 23 00:23:06 juju-e4d256-prod-github-runner-207 kernel: [68360.574290] Aug 23 00:23:06 juju-e4d256-prod-github-runner-207 kernel: [68360.575202] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:23:06 juju-e4d256-prod-github-runner-207 kernel: [68360.576247] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:23:06 juju-e4d256-prod-github-runner-207 kernel: [68360.577275] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:23:06 juju-e4d256-prod-github-runner-207 kernel: [68360.578370] ? show_regs.part.0+0x23/0x29 Aug 23 00:23:06 juju-e4d256-prod-github-runner-207 kernel: [68360.579381] ? show_regs.cold+0x8/0xd Aug 23 00:23:06 juju-e4d256-prod-github-runner-207 kernel: [68360.580353] ? watchdog_timer_fn+0x1be/0x220 Aug 23 00:23:06 juju-e4d256-prod-github-runner-207 kernel: [68360.581366] ? lockup_detector_update_enable+0x60/0x60 Aug 23 00:23:06 juju-e4d256-prod-github-runner-207 kernel: [68360.582429] ? __hrtimer_run_queues+0x107/0x230 Aug 23 00:23:06 juju-e4d256-prod-github-runner-207 kernel: [68360.583470] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 00:23:06 juju-e4d256-prod-github-runner-207 kernel: [68360.584493] ? hrtimer_interrupt+0x101/0x220 Aug 23 00:23:06 juju-e4d256-prod-github-runner-207 kernel: [68360.585507] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 00:23:06 juju-e4d256-prod-github-runner-207 kernel: [68360.586575] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 00:23:06 juju-e4d256-prod-github-runner-207 kernel: [68360.587670] Aug 23 00:23:06 juju-e4d256-prod-github-runner-207 kernel: [68360.588536] Aug 23 00:23:06 juju-e4d256-prod-github-runner-207 kernel: [68360.589378] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 00:23:06 juju-e4d256-prod-github-runner-207 kernel: [68360.590408] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:23:06 juju-e4d256-prod-github-runner-207 kernel: [68360.591460] ? _raw_spin_lock+0x22/0x30 Aug 23 00:23:06 juju-e4d256-prod-github-runner-207 kernel: [68360.592409] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:23:06 juju-e4d256-prod-github-runner-207 kernel: [68360.593443] direct_page_fault+0x206/0x310 [kvm] Aug 23 00:23:06 juju-e4d256-prod-github-runner-207 kernel: [68360.594476] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 00:23:06 juju-e4d256-prod-github-runner-207 kernel: [68360.595502] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 00:23:06 juju-e4d256-prod-github-runner-207 kernel: [68360.596502] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 00:23:06 juju-e4d256-prod-github-runner-207 kernel: [68360.597509] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 00:23:06 juju-e4d256-prod-github-runner-207 kernel: [68360.598454] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 00:23:06 juju-e4d256-prod-github-runner-207 kernel: [68360.599449] handle_exit+0x98/0x230 [kvm_amd] Aug 23 00:23:06 juju-e4d256-prod-github-runner-207 kernel: [68360.600400] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 00:23:06 juju-e4d256-prod-github-runner-207 kernel: [68360.601479] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 00:23:06 juju-e4d256-prod-github-runner-207 kernel: [68360.602454] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 00:23:06 juju-e4d256-prod-github-runner-207 kernel: [68360.603372] vcpu_run+0x62/0x2c0 [kvm] Aug 23 00:23:06 juju-e4d256-prod-github-runner-207 kernel: [68360.604186] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 00:23:06 juju-e4d256-prod-github-runner-207 kernel: [68360.604992] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 00:23:06 juju-e4d256-prod-github-runner-207 kernel: [68360.605844] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 00:23:06 juju-e4d256-prod-github-runner-207 kernel: [68360.606641] ? __seccomp_filter+0x4a/0x4a0 Aug 23 00:23:06 juju-e4d256-prod-github-runner-207 kernel: [68360.607394] ? __fget_files+0x86/0xc0 Aug 23 00:23:06 juju-e4d256-prod-github-runner-207 kernel: [68360.608103] __x64_sys_ioctl+0x95/0xd0 Aug 23 00:23:06 juju-e4d256-prod-github-runner-207 kernel: [68360.608793] do_syscall_64+0x5c/0xc0 Aug 23 00:23:06 juju-e4d256-prod-github-runner-207 kernel: [68360.609458] ? do_futex+0x162/0x1f0 Aug 23 00:23:06 juju-e4d256-prod-github-runner-207 kernel: [68360.610112] ? __x64_sys_futex+0x78/0x1e0 Aug 23 00:23:06 juju-e4d256-prod-github-runner-207 kernel: [68360.610785] ? __secure_computing+0xa9/0x120 Aug 23 00:23:06 juju-e4d256-prod-github-runner-207 kernel: [68360.611485] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 00:23:06 juju-e4d256-prod-github-runner-207 kernel: [68360.612245] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:23:06 juju-e4d256-prod-github-runner-207 kernel: [68360.612970] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:23:06 juju-e4d256-prod-github-runner-207 kernel: [68360.613685] ? do_syscall_64+0x69/0xc0 Aug 23 00:23:06 juju-e4d256-prod-github-runner-207 kernel: [68360.614331] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:23:06 juju-e4d256-prod-github-runner-207 kernel: [68360.615031] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:23:06 juju-e4d256-prod-github-runner-207 kernel: [68360.615732] ? do_syscall_64+0x69/0xc0 Aug 23 00:23:06 juju-e4d256-prod-github-runner-207 kernel: [68360.616358] ? do_syscall_64+0x69/0xc0 Aug 23 00:23:06 juju-e4d256-prod-github-runner-207 kernel: [68360.616983] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 00:23:06 juju-e4d256-prod-github-runner-207 kernel: [68360.617685] RIP: 0033:0x7faa5d0edaff Aug 23 00:23:06 juju-e4d256-prod-github-runner-207 kernel: [68360.618334] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 00:23:06 juju-e4d256-prod-github-runner-207 kernel: [68360.620330] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 00:23:06 juju-e4d256-prod-github-runner-207 kernel: [68360.621238] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 00:23:06 juju-e4d256-prod-github-runner-207 kernel: [68360.622125] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 00:23:06 juju-e4d256-prod-github-runner-207 kernel: [68360.623021] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 00:23:06 juju-e4d256-prod-github-runner-207 kernel: [68360.623936] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 00:23:06 juju-e4d256-prod-github-runner-207 kernel: [68360.624821] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 00:23:06 juju-e4d256-prod-github-runner-207 kernel: [68360.625707] Aug 23 00:23:34 juju-e4d256-prod-github-runner-207 kernel: [68388.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 63583s! [qemu-system-x86:6715] Aug 23 00:23:34 juju-e4d256-prod-github-runner-207 kernel: [68388.543114] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 00:23:34 juju-e4d256-prod-github-runner-207 kernel: [68388.543183] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 00:23:34 juju-e4d256-prod-github-runner-207 kernel: [68388.555241] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 00:23:34 juju-e4d256-prod-github-runner-207 kernel: [68388.556509] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 00:23:34 juju-e4d256-prod-github-runner-207 kernel: [68388.557730] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:23:34 juju-e4d256-prod-github-runner-207 kernel: [68388.558786] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 00:23:34 juju-e4d256-prod-github-runner-207 kernel: [68388.561340] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 00:23:34 juju-e4d256-prod-github-runner-207 kernel: [68388.562385] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 00:23:34 juju-e4d256-prod-github-runner-207 kernel: [68388.563552] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 00:23:34 juju-e4d256-prod-github-runner-207 kernel: [68388.564709] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 00:23:34 juju-e4d256-prod-github-runner-207 kernel: [68388.565886] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 00:23:34 juju-e4d256-prod-github-runner-207 kernel: [68388.567061] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 00:23:34 juju-e4d256-prod-github-runner-207 kernel: [68388.568226] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 00:23:34 juju-e4d256-prod-github-runner-207 kernel: [68388.569464] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 00:23:34 juju-e4d256-prod-github-runner-207 kernel: [68388.570561] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 00:23:34 juju-e4d256-prod-github-runner-207 kernel: [68388.571759] Call Trace: Aug 23 00:23:34 juju-e4d256-prod-github-runner-207 kernel: [68388.572676] Aug 23 00:23:34 juju-e4d256-prod-github-runner-207 kernel: [68388.573558] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:23:34 juju-e4d256-prod-github-runner-207 kernel: [68388.574592] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:23:34 juju-e4d256-prod-github-runner-207 kernel: [68388.575625] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:23:34 juju-e4d256-prod-github-runner-207 kernel: [68388.576706] ? show_regs.part.0+0x23/0x29 Aug 23 00:23:34 juju-e4d256-prod-github-runner-207 kernel: [68388.577706] ? show_regs.cold+0x8/0xd Aug 23 00:23:34 juju-e4d256-prod-github-runner-207 kernel: [68388.578692] ? watchdog_timer_fn+0x1be/0x220 Aug 23 00:23:34 juju-e4d256-prod-github-runner-207 kernel: [68388.579714] ? lockup_detector_update_enable+0x60/0x60 Aug 23 00:23:34 juju-e4d256-prod-github-runner-207 kernel: [68388.580776] ? __hrtimer_run_queues+0x107/0x230 Aug 23 00:23:34 juju-e4d256-prod-github-runner-207 kernel: [68388.581803] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 00:23:34 juju-e4d256-prod-github-runner-207 kernel: [68388.582824] ? hrtimer_interrupt+0x101/0x220 Aug 23 00:23:34 juju-e4d256-prod-github-runner-207 kernel: [68388.583853] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 00:23:34 juju-e4d256-prod-github-runner-207 kernel: [68388.584920] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 00:23:34 juju-e4d256-prod-github-runner-207 kernel: [68388.585986] Aug 23 00:23:34 juju-e4d256-prod-github-runner-207 kernel: [68388.586843] Aug 23 00:23:34 juju-e4d256-prod-github-runner-207 kernel: [68388.587690] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 00:23:34 juju-e4d256-prod-github-runner-207 kernel: [68388.588725] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:23:34 juju-e4d256-prod-github-runner-207 kernel: [68388.589777] ? _raw_spin_lock+0x22/0x30 Aug 23 00:23:34 juju-e4d256-prod-github-runner-207 kernel: [68388.590728] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:23:34 juju-e4d256-prod-github-runner-207 kernel: [68388.591772] direct_page_fault+0x206/0x310 [kvm] Aug 23 00:23:34 juju-e4d256-prod-github-runner-207 kernel: [68388.592795] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 00:23:34 juju-e4d256-prod-github-runner-207 kernel: [68388.593802] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 00:23:34 juju-e4d256-prod-github-runner-207 kernel: [68388.594802] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 00:23:34 juju-e4d256-prod-github-runner-207 kernel: [68388.595800] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 00:23:34 juju-e4d256-prod-github-runner-207 kernel: [68388.596746] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 00:23:34 juju-e4d256-prod-github-runner-207 kernel: [68388.597725] handle_exit+0x98/0x230 [kvm_amd] Aug 23 00:23:34 juju-e4d256-prod-github-runner-207 kernel: [68388.598667] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 00:23:34 juju-e4d256-prod-github-runner-207 kernel: [68388.599594] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 00:23:34 juju-e4d256-prod-github-runner-207 kernel: [68388.600524] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 00:23:34 juju-e4d256-prod-github-runner-207 kernel: [68388.601426] vcpu_run+0x62/0x2c0 [kvm] Aug 23 00:23:34 juju-e4d256-prod-github-runner-207 kernel: [68388.602242] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 00:23:34 juju-e4d256-prod-github-runner-207 kernel: [68388.603059] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 00:23:34 juju-e4d256-prod-github-runner-207 kernel: [68388.603912] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 00:23:34 juju-e4d256-prod-github-runner-207 kernel: [68388.604713] ? __seccomp_filter+0x4a/0x4a0 Aug 23 00:23:34 juju-e4d256-prod-github-runner-207 kernel: [68388.605453] ? __fget_files+0x86/0xc0 Aug 23 00:23:34 juju-e4d256-prod-github-runner-207 kernel: [68388.606155] __x64_sys_ioctl+0x95/0xd0 Aug 23 00:23:34 juju-e4d256-prod-github-runner-207 kernel: [68388.606846] do_syscall_64+0x5c/0xc0 Aug 23 00:23:34 juju-e4d256-prod-github-runner-207 kernel: [68388.607522] ? do_futex+0x162/0x1f0 Aug 23 00:23:34 juju-e4d256-prod-github-runner-207 kernel: [68388.608170] ? __x64_sys_futex+0x78/0x1e0 Aug 23 00:23:34 juju-e4d256-prod-github-runner-207 kernel: [68388.608841] ? __secure_computing+0xa9/0x120 Aug 23 00:23:34 juju-e4d256-prod-github-runner-207 kernel: [68388.609535] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 00:23:34 juju-e4d256-prod-github-runner-207 kernel: [68388.610299] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:23:34 juju-e4d256-prod-github-runner-207 kernel: [68388.611034] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:23:34 juju-e4d256-prod-github-runner-207 kernel: [68388.611762] ? do_syscall_64+0x69/0xc0 Aug 23 00:23:34 juju-e4d256-prod-github-runner-207 kernel: [68388.612408] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:23:34 juju-e4d256-prod-github-runner-207 kernel: [68388.613111] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:23:34 juju-e4d256-prod-github-runner-207 kernel: [68388.613806] ? do_syscall_64+0x69/0xc0 Aug 23 00:23:34 juju-e4d256-prod-github-runner-207 kernel: [68388.614435] ? do_syscall_64+0x69/0xc0 Aug 23 00:23:34 juju-e4d256-prod-github-runner-207 kernel: [68388.615068] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 00:23:34 juju-e4d256-prod-github-runner-207 kernel: [68388.615777] RIP: 0033:0x7faa5d0edaff Aug 23 00:23:34 juju-e4d256-prod-github-runner-207 kernel: [68388.616431] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 00:23:34 juju-e4d256-prod-github-runner-207 kernel: [68388.618413] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 00:23:34 juju-e4d256-prod-github-runner-207 kernel: [68388.619330] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 00:23:34 juju-e4d256-prod-github-runner-207 kernel: [68388.620220] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 00:23:34 juju-e4d256-prod-github-runner-207 kernel: [68388.621110] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 00:23:34 juju-e4d256-prod-github-runner-207 kernel: [68388.621996] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 00:23:34 juju-e4d256-prod-github-runner-207 kernel: [68388.622883] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 00:23:34 juju-e4d256-prod-github-runner-207 kernel: [68388.623790] Aug 23 00:23:47 juju-e4d256-prod-github-runner-207 kernel: [68401.748705] rcu: INFO: rcu_sched self-detected stall on CPU Aug 23 00:23:47 juju-e4d256-prod-github-runner-207 kernel: [68401.749855] rcu: 1-....: (17017321 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=8215653 Aug 23 00:23:47 juju-e4d256-prod-github-runner-207 kernel: [68401.750989] (t=17071137 jiffies g=23269 q=59391) Aug 23 00:23:47 juju-e4d256-prod-github-runner-207 kernel: [68401.751777] NMI backtrace for cpu 1 Aug 23 00:23:47 juju-e4d256-prod-github-runner-207 kernel: [68401.752492] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 00:23:47 juju-e4d256-prod-github-runner-207 kernel: [68401.753792] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 00:23:47 juju-e4d256-prod-github-runner-207 kernel: [68401.754860] Call Trace: Aug 23 00:23:47 juju-e4d256-prod-github-runner-207 kernel: [68401.755539] Aug 23 00:23:47 juju-e4d256-prod-github-runner-207 kernel: [68401.756182] show_stack+0x52/0x5c Aug 23 00:23:47 juju-e4d256-prod-github-runner-207 kernel: [68401.756906] dump_stack_lvl+0x4a/0x63 Aug 23 00:23:47 juju-e4d256-prod-github-runner-207 kernel: [68401.757649] dump_stack+0x10/0x16 Aug 23 00:23:47 juju-e4d256-prod-github-runner-207 kernel: [68401.758366] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 23 00:23:47 juju-e4d256-prod-github-runner-207 kernel: [68401.759153] ? lapic_can_unplug_cpu+0x90/0x90 Aug 23 00:23:47 juju-e4d256-prod-github-runner-207 kernel: [68401.759931] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 23 00:23:47 juju-e4d256-prod-github-runner-207 kernel: [68401.760749] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 23 00:23:47 juju-e4d256-prod-github-runner-207 kernel: [68401.761570] trigger_single_cpu_backtrace+0x44/0x4f Aug 23 00:23:47 juju-e4d256-prod-github-runner-207 kernel: [68401.762377] rcu_dump_cpu_stacks+0x102/0x149 Aug 23 00:23:47 juju-e4d256-prod-github-runner-207 kernel: [68401.763155] print_cpu_stall.cold+0x2f/0xe2 Aug 23 00:23:47 juju-e4d256-prod-github-runner-207 kernel: [68401.763919] ? timekeeping_update+0xf7/0x150 Aug 23 00:23:47 juju-e4d256-prod-github-runner-207 kernel: [68401.764687] check_cpu_stall+0x109/0x270 Aug 23 00:23:47 juju-e4d256-prod-github-runner-207 kernel: [68401.765439] rcu_sched_clock_irq+0x9a/0x250 Aug 23 00:23:47 juju-e4d256-prod-github-runner-207 kernel: [68401.766200] update_process_times+0x94/0xd0 Aug 23 00:23:47 juju-e4d256-prod-github-runner-207 kernel: [68401.766970] tick_sched_handle+0x29/0x70 Aug 23 00:23:47 juju-e4d256-prod-github-runner-207 kernel: [68401.767716] tick_sched_timer+0x8c/0xc0 Aug 23 00:23:47 juju-e4d256-prod-github-runner-207 kernel: [68401.768453] ? tick_nohz_handler+0xb0/0xb0 Aug 23 00:23:47 juju-e4d256-prod-github-runner-207 kernel: [68401.769207] __hrtimer_run_queues+0x107/0x230 Aug 23 00:23:47 juju-e4d256-prod-github-runner-207 kernel: [68401.769978] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 00:23:47 juju-e4d256-prod-github-runner-207 kernel: [68401.770752] hrtimer_interrupt+0x101/0x220 Aug 23 00:23:47 juju-e4d256-prod-github-runner-207 kernel: [68401.771517] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 00:23:47 juju-e4d256-prod-github-runner-207 kernel: [68401.772328] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 00:23:47 juju-e4d256-prod-github-runner-207 kernel: [68401.773130] Aug 23 00:23:47 juju-e4d256-prod-github-runner-207 kernel: [68401.773764] Aug 23 00:23:47 juju-e4d256-prod-github-runner-207 kernel: [68401.774397] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 00:23:47 juju-e4d256-prod-github-runner-207 kernel: [68401.775220] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:23:47 juju-e4d256-prod-github-runner-207 kernel: [68401.776099] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 00:23:47 juju-e4d256-prod-github-runner-207 kernel: [68401.778303] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 00:23:47 juju-e4d256-prod-github-runner-207 kernel: [68401.779188] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 00:23:47 juju-e4d256-prod-github-runner-207 kernel: [68401.780186] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 00:23:47 juju-e4d256-prod-github-runner-207 kernel: [68401.781167] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 00:23:47 juju-e4d256-prod-github-runner-207 kernel: [68401.782129] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 00:23:47 juju-e4d256-prod-github-runner-207 kernel: [68401.783097] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 00:23:47 juju-e4d256-prod-github-runner-207 kernel: [68401.784049] ? _raw_spin_lock+0x22/0x30 Aug 23 00:23:47 juju-e4d256-prod-github-runner-207 kernel: [68401.784812] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:23:47 juju-e4d256-prod-github-runner-207 kernel: [68401.785648] direct_page_fault+0x206/0x310 [kvm] Aug 23 00:23:47 juju-e4d256-prod-github-runner-207 kernel: [68401.786484] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 00:23:47 juju-e4d256-prod-github-runner-207 kernel: [68401.787326] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 00:23:47 juju-e4d256-prod-github-runner-207 kernel: [68401.788147] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 00:23:47 juju-e4d256-prod-github-runner-207 kernel: [68401.788949] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 00:23:47 juju-e4d256-prod-github-runner-207 kernel: [68401.789733] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 00:23:47 juju-e4d256-prod-github-runner-207 kernel: [68401.790552] handle_exit+0x98/0x230 [kvm_amd] Aug 23 00:23:47 juju-e4d256-prod-github-runner-207 kernel: [68401.791311] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 00:23:47 juju-e4d256-prod-github-runner-207 kernel: [68401.792093] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 00:23:47 juju-e4d256-prod-github-runner-207 kernel: [68401.792890] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 00:23:47 juju-e4d256-prod-github-runner-207 kernel: [68401.793675] vcpu_run+0x62/0x2c0 [kvm] Aug 23 00:23:47 juju-e4d256-prod-github-runner-207 kernel: [68401.794388] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 00:23:47 juju-e4d256-prod-github-runner-207 kernel: [68401.795126] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 00:23:47 juju-e4d256-prod-github-runner-207 kernel: [68401.795926] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 00:23:47 juju-e4d256-prod-github-runner-207 kernel: [68401.796686] ? __seccomp_filter+0x4a/0x4a0 Aug 23 00:23:47 juju-e4d256-prod-github-runner-207 kernel: [68401.797409] ? __fget_files+0x86/0xc0 Aug 23 00:23:47 juju-e4d256-prod-github-runner-207 kernel: [68401.798099] __x64_sys_ioctl+0x95/0xd0 Aug 23 00:23:47 juju-e4d256-prod-github-runner-207 kernel: [68401.798802] do_syscall_64+0x5c/0xc0 Aug 23 00:23:47 juju-e4d256-prod-github-runner-207 kernel: [68401.799481] ? do_futex+0x162/0x1f0 Aug 23 00:23:47 juju-e4d256-prod-github-runner-207 kernel: [68401.800150] ? __x64_sys_futex+0x78/0x1e0 Aug 23 00:23:47 juju-e4d256-prod-github-runner-207 kernel: [68401.800850] ? __secure_computing+0xa9/0x120 Aug 23 00:23:47 juju-e4d256-prod-github-runner-207 kernel: [68401.801570] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 00:23:47 juju-e4d256-prod-github-runner-207 kernel: [68401.802362] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:23:47 juju-e4d256-prod-github-runner-207 kernel: [68401.803119] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:23:47 juju-e4d256-prod-github-runner-207 kernel: [68401.803875] ? do_syscall_64+0x69/0xc0 Aug 23 00:23:47 juju-e4d256-prod-github-runner-207 kernel: [68401.804565] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:23:47 juju-e4d256-prod-github-runner-207 kernel: [68401.805319] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:23:47 juju-e4d256-prod-github-runner-207 kernel: [68401.806111] ? do_syscall_64+0x69/0xc0 Aug 23 00:23:47 juju-e4d256-prod-github-runner-207 kernel: [68401.806817] ? do_syscall_64+0x69/0xc0 Aug 23 00:23:47 juju-e4d256-prod-github-runner-207 kernel: [68401.807503] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 00:23:47 juju-e4d256-prod-github-runner-207 kernel: [68401.808272] RIP: 0033:0x7faa5d0edaff Aug 23 00:23:47 juju-e4d256-prod-github-runner-207 kernel: [68401.808961] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 00:23:47 juju-e4d256-prod-github-runner-207 kernel: [68401.811076] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 00:23:47 juju-e4d256-prod-github-runner-207 kernel: [68401.812035] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 00:23:47 juju-e4d256-prod-github-runner-207 kernel: [68401.812983] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 00:23:47 juju-e4d256-prod-github-runner-207 kernel: [68401.813926] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 00:23:47 juju-e4d256-prod-github-runner-207 kernel: [68401.814873] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 00:23:47 juju-e4d256-prod-github-runner-207 kernel: [68401.815793] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 00:23:47 juju-e4d256-prod-github-runner-207 kernel: [68401.816706] Aug 23 00:24:14 juju-e4d256-prod-github-runner-207 kernel: [68428.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 63621s! [qemu-system-x86:6715] Aug 23 00:24:14 juju-e4d256-prod-github-runner-207 kernel: [68428.543147] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 00:24:14 juju-e4d256-prod-github-runner-207 kernel: [68428.543216] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 00:24:14 juju-e4d256-prod-github-runner-207 kernel: [68428.555357] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 00:24:14 juju-e4d256-prod-github-runner-207 kernel: [68428.556615] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 00:24:14 juju-e4d256-prod-github-runner-207 kernel: [68428.557834] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:24:14 juju-e4d256-prod-github-runner-207 kernel: [68428.558918] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 00:24:14 juju-e4d256-prod-github-runner-207 kernel: [68428.561458] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 00:24:14 juju-e4d256-prod-github-runner-207 kernel: [68428.562532] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 00:24:14 juju-e4d256-prod-github-runner-207 kernel: [68428.563715] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 00:24:14 juju-e4d256-prod-github-runner-207 kernel: [68428.564886] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 00:24:14 juju-e4d256-prod-github-runner-207 kernel: [68428.566048] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 00:24:14 juju-e4d256-prod-github-runner-207 kernel: [68428.567216] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 00:24:14 juju-e4d256-prod-github-runner-207 kernel: [68428.568381] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 00:24:14 juju-e4d256-prod-github-runner-207 kernel: [68428.569618] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 00:24:14 juju-e4d256-prod-github-runner-207 kernel: [68428.570744] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 00:24:14 juju-e4d256-prod-github-runner-207 kernel: [68428.571950] Call Trace: Aug 23 00:24:14 juju-e4d256-prod-github-runner-207 kernel: [68428.572861] Aug 23 00:24:14 juju-e4d256-prod-github-runner-207 kernel: [68428.573755] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:24:14 juju-e4d256-prod-github-runner-207 kernel: [68428.574813] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:24:14 juju-e4d256-prod-github-runner-207 kernel: [68428.575838] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:24:14 juju-e4d256-prod-github-runner-207 kernel: [68428.576914] ? show_regs.part.0+0x23/0x29 Aug 23 00:24:14 juju-e4d256-prod-github-runner-207 kernel: [68428.577913] ? show_regs.cold+0x8/0xd Aug 23 00:24:14 juju-e4d256-prod-github-runner-207 kernel: [68428.578936] ? watchdog_timer_fn+0x1be/0x220 Aug 23 00:24:14 juju-e4d256-prod-github-runner-207 kernel: [68428.579959] ? lockup_detector_update_enable+0x60/0x60 Aug 23 00:24:14 juju-e4d256-prod-github-runner-207 kernel: [68428.581020] ? __hrtimer_run_queues+0x107/0x230 Aug 23 00:24:14 juju-e4d256-prod-github-runner-207 kernel: [68428.582047] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 00:24:14 juju-e4d256-prod-github-runner-207 kernel: [68428.583078] ? hrtimer_interrupt+0x101/0x220 Aug 23 00:24:14 juju-e4d256-prod-github-runner-207 kernel: [68428.584100] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 00:24:14 juju-e4d256-prod-github-runner-207 kernel: [68428.585169] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 00:24:14 juju-e4d256-prod-github-runner-207 kernel: [68428.586212] Aug 23 00:24:14 juju-e4d256-prod-github-runner-207 kernel: [68428.587085] Aug 23 00:24:14 juju-e4d256-prod-github-runner-207 kernel: [68428.587921] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 00:24:14 juju-e4d256-prod-github-runner-207 kernel: [68428.588957] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:24:14 juju-e4d256-prod-github-runner-207 kernel: [68428.590001] ? _raw_spin_lock+0x22/0x30 Aug 23 00:24:14 juju-e4d256-prod-github-runner-207 kernel: [68428.590974] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:24:14 juju-e4d256-prod-github-runner-207 kernel: [68428.592001] direct_page_fault+0x206/0x310 [kvm] Aug 23 00:24:14 juju-e4d256-prod-github-runner-207 kernel: [68428.593042] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 00:24:14 juju-e4d256-prod-github-runner-207 kernel: [68428.594051] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 00:24:14 juju-e4d256-prod-github-runner-207 kernel: [68428.595085] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 00:24:14 juju-e4d256-prod-github-runner-207 kernel: [68428.596063] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 00:24:14 juju-e4d256-prod-github-runner-207 kernel: [68428.597007] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 00:24:14 juju-e4d256-prod-github-runner-207 kernel: [68428.597987] handle_exit+0x98/0x230 [kvm_amd] Aug 23 00:24:14 juju-e4d256-prod-github-runner-207 kernel: [68428.598892] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 00:24:14 juju-e4d256-prod-github-runner-207 kernel: [68428.599997] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 00:24:14 juju-e4d256-prod-github-runner-207 kernel: [68428.600938] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 00:24:14 juju-e4d256-prod-github-runner-207 kernel: [68428.601847] vcpu_run+0x62/0x2c0 [kvm] Aug 23 00:24:14 juju-e4d256-prod-github-runner-207 kernel: [68428.602684] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 00:24:14 juju-e4d256-prod-github-runner-207 kernel: [68428.603502] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 00:24:14 juju-e4d256-prod-github-runner-207 kernel: [68428.604354] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 00:24:14 juju-e4d256-prod-github-runner-207 kernel: [68428.605174] ? __seccomp_filter+0x4a/0x4a0 Aug 23 00:24:14 juju-e4d256-prod-github-runner-207 kernel: [68428.605919] ? __fget_files+0x86/0xc0 Aug 23 00:24:14 juju-e4d256-prod-github-runner-207 kernel: [68428.606644] __x64_sys_ioctl+0x95/0xd0 Aug 23 00:24:14 juju-e4d256-prod-github-runner-207 kernel: [68428.607337] do_syscall_64+0x5c/0xc0 Aug 23 00:24:14 juju-e4d256-prod-github-runner-207 kernel: [68428.608006] ? do_futex+0x162/0x1f0 Aug 23 00:24:14 juju-e4d256-prod-github-runner-207 kernel: [68428.608671] ? __x64_sys_futex+0x78/0x1e0 Aug 23 00:24:14 juju-e4d256-prod-github-runner-207 kernel: [68428.609346] ? __secure_computing+0xa9/0x120 Aug 23 00:24:14 juju-e4d256-prod-github-runner-207 kernel: [68428.610054] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 00:24:14 juju-e4d256-prod-github-runner-207 kernel: [68428.610846] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:24:14 juju-e4d256-prod-github-runner-207 kernel: [68428.611569] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:24:14 juju-e4d256-prod-github-runner-207 kernel: [68428.612291] ? do_syscall_64+0x69/0xc0 Aug 23 00:24:14 juju-e4d256-prod-github-runner-207 kernel: [68428.612934] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:24:14 juju-e4d256-prod-github-runner-207 kernel: [68428.613681] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:24:14 juju-e4d256-prod-github-runner-207 kernel: [68428.614376] ? do_syscall_64+0x69/0xc0 Aug 23 00:24:14 juju-e4d256-prod-github-runner-207 kernel: [68428.615044] ? do_syscall_64+0x69/0xc0 Aug 23 00:24:14 juju-e4d256-prod-github-runner-207 kernel: [68428.615669] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 00:24:14 juju-e4d256-prod-github-runner-207 kernel: [68428.616374] RIP: 0033:0x7faa5d0edaff Aug 23 00:24:14 juju-e4d256-prod-github-runner-207 kernel: [68428.616997] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 00:24:14 juju-e4d256-prod-github-runner-207 kernel: [68428.619005] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 00:24:14 juju-e4d256-prod-github-runner-207 kernel: [68428.619923] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 00:24:14 juju-e4d256-prod-github-runner-207 kernel: [68428.620823] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 00:24:14 juju-e4d256-prod-github-runner-207 kernel: [68428.621712] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 00:24:14 juju-e4d256-prod-github-runner-207 kernel: [68428.622651] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 00:24:14 juju-e4d256-prod-github-runner-207 kernel: [68428.623609] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 00:24:14 juju-e4d256-prod-github-runner-207 kernel: [68428.624502] Aug 23 00:24:42 juju-e4d256-prod-github-runner-207 kernel: [68456.541980] watchdog: BUG: soft lockup - CPU#1 stuck for 63647s! [qemu-system-x86:6715] Aug 23 00:24:42 juju-e4d256-prod-github-runner-207 kernel: [68456.543763] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 00:24:42 juju-e4d256-prod-github-runner-207 kernel: [68456.544019] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 00:24:42 juju-e4d256-prod-github-runner-207 kernel: [68456.556558] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 00:24:42 juju-e4d256-prod-github-runner-207 kernel: [68456.557864] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 00:24:42 juju-e4d256-prod-github-runner-207 kernel: [68456.559162] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:24:42 juju-e4d256-prod-github-runner-207 kernel: [68456.560409] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 00:24:42 juju-e4d256-prod-github-runner-207 kernel: [68456.563013] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 00:24:42 juju-e4d256-prod-github-runner-207 kernel: [68456.564068] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 00:24:42 juju-e4d256-prod-github-runner-207 kernel: [68456.565238] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 00:24:42 juju-e4d256-prod-github-runner-207 kernel: [68456.566461] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 00:24:42 juju-e4d256-prod-github-runner-207 kernel: [68456.567656] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 00:24:42 juju-e4d256-prod-github-runner-207 kernel: [68456.568839] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 00:24:42 juju-e4d256-prod-github-runner-207 kernel: [68456.570049] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 00:24:42 juju-e4d256-prod-github-runner-207 kernel: [68456.571395] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 00:24:42 juju-e4d256-prod-github-runner-207 kernel: [68456.572526] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 00:24:42 juju-e4d256-prod-github-runner-207 kernel: [68456.573735] Call Trace: Aug 23 00:24:42 juju-e4d256-prod-github-runner-207 kernel: [68456.574671] Aug 23 00:24:42 juju-e4d256-prod-github-runner-207 kernel: [68456.575577] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:24:42 juju-e4d256-prod-github-runner-207 kernel: [68456.576645] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:24:42 juju-e4d256-prod-github-runner-207 kernel: [68456.577710] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:24:42 juju-e4d256-prod-github-runner-207 kernel: [68456.578846] ? show_regs.part.0+0x23/0x29 Aug 23 00:24:42 juju-e4d256-prod-github-runner-207 kernel: [68456.579888] ? show_regs.cold+0x8/0xd Aug 23 00:24:42 juju-e4d256-prod-github-runner-207 kernel: [68456.580867] ? watchdog_timer_fn+0x1be/0x220 Aug 23 00:24:42 juju-e4d256-prod-github-runner-207 kernel: [68456.581914] ? lockup_detector_update_enable+0x60/0x60 Aug 23 00:24:42 juju-e4d256-prod-github-runner-207 kernel: [68456.583019] ? __hrtimer_run_queues+0x107/0x230 Aug 23 00:24:42 juju-e4d256-prod-github-runner-207 kernel: [68456.584055] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 00:24:42 juju-e4d256-prod-github-runner-207 kernel: [68456.585094] ? hrtimer_interrupt+0x101/0x220 Aug 23 00:24:42 juju-e4d256-prod-github-runner-207 kernel: [68456.586142] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 00:24:42 juju-e4d256-prod-github-runner-207 kernel: [68456.587261] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 00:24:42 juju-e4d256-prod-github-runner-207 kernel: [68456.588347] Aug 23 00:24:42 juju-e4d256-prod-github-runner-207 kernel: [68456.589209] Aug 23 00:24:42 juju-e4d256-prod-github-runner-207 kernel: [68456.590085] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 00:24:42 juju-e4d256-prod-github-runner-207 kernel: [68456.591163] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:24:42 juju-e4d256-prod-github-runner-207 kernel: [68456.592227] ? _raw_spin_lock+0x22/0x30 Aug 23 00:24:42 juju-e4d256-prod-github-runner-207 kernel: [68456.593204] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:24:42 juju-e4d256-prod-github-runner-207 kernel: [68456.594269] direct_page_fault+0x206/0x310 [kvm] Aug 23 00:24:42 juju-e4d256-prod-github-runner-207 kernel: [68456.595305] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 00:24:42 juju-e4d256-prod-github-runner-207 kernel: [68456.596345] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 00:24:42 juju-e4d256-prod-github-runner-207 kernel: [68456.597391] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 00:24:42 juju-e4d256-prod-github-runner-207 kernel: [68456.598462] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 00:24:42 juju-e4d256-prod-github-runner-207 kernel: [68456.599423] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 00:24:42 juju-e4d256-prod-github-runner-207 kernel: [68456.600481] handle_exit+0x98/0x230 [kvm_amd] Aug 23 00:24:42 juju-e4d256-prod-github-runner-207 kernel: [68456.601431] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 00:24:42 juju-e4d256-prod-github-runner-207 kernel: [68456.602446] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 00:24:42 juju-e4d256-prod-github-runner-207 kernel: [68456.603403] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 00:24:42 juju-e4d256-prod-github-runner-207 kernel: [68456.604319] vcpu_run+0x62/0x2c0 [kvm] Aug 23 00:24:42 juju-e4d256-prod-github-runner-207 kernel: [68456.605142] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 00:24:42 juju-e4d256-prod-github-runner-207 kernel: [68456.605958] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 00:24:42 juju-e4d256-prod-github-runner-207 kernel: [68456.606863] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 00:24:42 juju-e4d256-prod-github-runner-207 kernel: [68456.607691] ? __seccomp_filter+0x4a/0x4a0 Aug 23 00:24:42 juju-e4d256-prod-github-runner-207 kernel: [68456.608455] ? __fget_files+0x86/0xc0 Aug 23 00:24:42 juju-e4d256-prod-github-runner-207 kernel: [68456.609165] __x64_sys_ioctl+0x95/0xd0 Aug 23 00:24:42 juju-e4d256-prod-github-runner-207 kernel: [68456.609864] do_syscall_64+0x5c/0xc0 Aug 23 00:24:42 juju-e4d256-prod-github-runner-207 kernel: [68456.610601] ? do_futex+0x162/0x1f0 Aug 23 00:24:42 juju-e4d256-prod-github-runner-207 kernel: [68456.611270] ? __x64_sys_futex+0x78/0x1e0 Aug 23 00:24:42 juju-e4d256-prod-github-runner-207 kernel: [68456.611950] ? __secure_computing+0xa9/0x120 Aug 23 00:24:42 juju-e4d256-prod-github-runner-207 kernel: [68456.612647] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 00:24:42 juju-e4d256-prod-github-runner-207 kernel: [68456.613415] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:24:42 juju-e4d256-prod-github-runner-207 kernel: [68456.614163] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:24:42 juju-e4d256-prod-github-runner-207 kernel: [68456.614892] ? do_syscall_64+0x69/0xc0 Aug 23 00:24:42 juju-e4d256-prod-github-runner-207 kernel: [68456.615549] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:24:42 juju-e4d256-prod-github-runner-207 kernel: [68456.616264] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:24:42 juju-e4d256-prod-github-runner-207 kernel: [68456.616965] ? do_syscall_64+0x69/0xc0 Aug 23 00:24:42 juju-e4d256-prod-github-runner-207 kernel: [68456.617595] ? do_syscall_64+0x69/0xc0 Aug 23 00:24:42 juju-e4d256-prod-github-runner-207 kernel: [68456.618273] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 00:24:42 juju-e4d256-prod-github-runner-207 kernel: [68456.619001] RIP: 0033:0x7faa5d0edaff Aug 23 00:24:42 juju-e4d256-prod-github-runner-207 kernel: [68456.619695] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 00:24:42 juju-e4d256-prod-github-runner-207 kernel: [68456.621740] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 00:24:42 juju-e4d256-prod-github-runner-207 kernel: [68456.622682] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 00:24:42 juju-e4d256-prod-github-runner-207 kernel: [68456.623587] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 00:24:42 juju-e4d256-prod-github-runner-207 kernel: [68456.624490] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 00:24:42 juju-e4d256-prod-github-runner-207 kernel: [68456.625382] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 00:24:42 juju-e4d256-prod-github-runner-207 kernel: [68456.626304] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 00:24:42 juju-e4d256-prod-github-runner-207 kernel: [68456.627197] Aug 23 00:25:10 juju-e4d256-prod-github-runner-207 kernel: [68484.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 63673s! [qemu-system-x86:6715] Aug 23 00:25:10 juju-e4d256-prod-github-runner-207 kernel: [68484.543094] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 00:25:10 juju-e4d256-prod-github-runner-207 kernel: [68484.543162] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 00:25:10 juju-e4d256-prod-github-runner-207 kernel: [68484.555206] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 00:25:10 juju-e4d256-prod-github-runner-207 kernel: [68484.556470] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 00:25:10 juju-e4d256-prod-github-runner-207 kernel: [68484.557690] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:25:10 juju-e4d256-prod-github-runner-207 kernel: [68484.558826] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 00:25:10 juju-e4d256-prod-github-runner-207 kernel: [68484.561372] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 00:25:10 juju-e4d256-prod-github-runner-207 kernel: [68484.562428] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 00:25:10 juju-e4d256-prod-github-runner-207 kernel: [68484.563589] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 00:25:10 juju-e4d256-prod-github-runner-207 kernel: [68484.564748] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 00:25:10 juju-e4d256-prod-github-runner-207 kernel: [68484.565925] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 00:25:10 juju-e4d256-prod-github-runner-207 kernel: [68484.567091] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 00:25:10 juju-e4d256-prod-github-runner-207 kernel: [68484.568258] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 00:25:10 juju-e4d256-prod-github-runner-207 kernel: [68484.569496] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 00:25:10 juju-e4d256-prod-github-runner-207 kernel: [68484.570606] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 00:25:10 juju-e4d256-prod-github-runner-207 kernel: [68484.571797] Call Trace: Aug 23 00:25:10 juju-e4d256-prod-github-runner-207 kernel: [68484.572715] Aug 23 00:25:10 juju-e4d256-prod-github-runner-207 kernel: [68484.573598] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:25:10 juju-e4d256-prod-github-runner-207 kernel: [68484.574634] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:25:10 juju-e4d256-prod-github-runner-207 kernel: [68484.575658] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:25:10 juju-e4d256-prod-github-runner-207 kernel: [68484.576736] ? show_regs.part.0+0x23/0x29 Aug 23 00:25:10 juju-e4d256-prod-github-runner-207 kernel: [68484.577733] ? show_regs.cold+0x8/0xd Aug 23 00:25:10 juju-e4d256-prod-github-runner-207 kernel: [68484.578713] ? watchdog_timer_fn+0x1be/0x220 Aug 23 00:25:10 juju-e4d256-prod-github-runner-207 kernel: [68484.579719] ? lockup_detector_update_enable+0x60/0x60 Aug 23 00:25:10 juju-e4d256-prod-github-runner-207 kernel: [68484.580782] ? __hrtimer_run_queues+0x107/0x230 Aug 23 00:25:10 juju-e4d256-prod-github-runner-207 kernel: [68484.581826] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 00:25:10 juju-e4d256-prod-github-runner-207 kernel: [68484.582852] ? hrtimer_interrupt+0x101/0x220 Aug 23 00:25:10 juju-e4d256-prod-github-runner-207 kernel: [68484.583867] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 00:25:10 juju-e4d256-prod-github-runner-207 kernel: [68484.584960] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 00:25:10 juju-e4d256-prod-github-runner-207 kernel: [68484.586025] Aug 23 00:25:10 juju-e4d256-prod-github-runner-207 kernel: [68484.586884] Aug 23 00:25:10 juju-e4d256-prod-github-runner-207 kernel: [68484.587737] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 00:25:10 juju-e4d256-prod-github-runner-207 kernel: [68484.588769] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:25:10 juju-e4d256-prod-github-runner-207 kernel: [68484.589830] ? _raw_spin_lock+0x22/0x30 Aug 23 00:25:10 juju-e4d256-prod-github-runner-207 kernel: [68484.590784] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:25:10 juju-e4d256-prod-github-runner-207 kernel: [68484.591806] direct_page_fault+0x206/0x310 [kvm] Aug 23 00:25:10 juju-e4d256-prod-github-runner-207 kernel: [68484.592829] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 00:25:10 juju-e4d256-prod-github-runner-207 kernel: [68484.593852] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 00:25:10 juju-e4d256-prod-github-runner-207 kernel: [68484.594861] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 00:25:10 juju-e4d256-prod-github-runner-207 kernel: [68484.595837] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 00:25:10 juju-e4d256-prod-github-runner-207 kernel: [68484.596783] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 00:25:10 juju-e4d256-prod-github-runner-207 kernel: [68484.597764] handle_exit+0x98/0x230 [kvm_amd] Aug 23 00:25:10 juju-e4d256-prod-github-runner-207 kernel: [68484.598673] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 00:25:10 juju-e4d256-prod-github-runner-207 kernel: [68484.599603] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 00:25:10 juju-e4d256-prod-github-runner-207 kernel: [68484.600527] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 00:25:10 juju-e4d256-prod-github-runner-207 kernel: [68484.601429] vcpu_run+0x62/0x2c0 [kvm] Aug 23 00:25:10 juju-e4d256-prod-github-runner-207 kernel: [68484.602254] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 00:25:10 juju-e4d256-prod-github-runner-207 kernel: [68484.603060] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 00:25:10 juju-e4d256-prod-github-runner-207 kernel: [68484.603914] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 00:25:10 juju-e4d256-prod-github-runner-207 kernel: [68484.604710] ? __seccomp_filter+0x4a/0x4a0 Aug 23 00:25:10 juju-e4d256-prod-github-runner-207 kernel: [68484.605451] ? __fget_files+0x86/0xc0 Aug 23 00:25:10 juju-e4d256-prod-github-runner-207 kernel: [68484.606170] __x64_sys_ioctl+0x95/0xd0 Aug 23 00:25:10 juju-e4d256-prod-github-runner-207 kernel: [68484.606863] do_syscall_64+0x5c/0xc0 Aug 23 00:25:10 juju-e4d256-prod-github-runner-207 kernel: [68484.607527] ? do_futex+0x162/0x1f0 Aug 23 00:25:10 juju-e4d256-prod-github-runner-207 kernel: [68484.608176] ? __x64_sys_futex+0x78/0x1e0 Aug 23 00:25:10 juju-e4d256-prod-github-runner-207 kernel: [68484.608849] ? __secure_computing+0xa9/0x120 Aug 23 00:25:10 juju-e4d256-prod-github-runner-207 kernel: [68484.609538] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 00:25:10 juju-e4d256-prod-github-runner-207 kernel: [68484.610316] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:25:10 juju-e4d256-prod-github-runner-207 kernel: [68484.611038] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:25:10 juju-e4d256-prod-github-runner-207 kernel: [68484.611757] ? do_syscall_64+0x69/0xc0 Aug 23 00:25:10 juju-e4d256-prod-github-runner-207 kernel: [68484.612402] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:25:10 juju-e4d256-prod-github-runner-207 kernel: [68484.613105] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:25:10 juju-e4d256-prod-github-runner-207 kernel: [68484.613806] ? do_syscall_64+0x69/0xc0 Aug 23 00:25:10 juju-e4d256-prod-github-runner-207 kernel: [68484.614434] ? do_syscall_64+0x69/0xc0 Aug 23 00:25:10 juju-e4d256-prod-github-runner-207 kernel: [68484.615059] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 00:25:10 juju-e4d256-prod-github-runner-207 kernel: [68484.615764] RIP: 0033:0x7faa5d0edaff Aug 23 00:25:10 juju-e4d256-prod-github-runner-207 kernel: [68484.616389] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 00:25:10 juju-e4d256-prod-github-runner-207 kernel: [68484.618389] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 00:25:10 juju-e4d256-prod-github-runner-207 kernel: [68484.619305] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 00:25:10 juju-e4d256-prod-github-runner-207 kernel: [68484.620196] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 00:25:10 juju-e4d256-prod-github-runner-207 kernel: [68484.621085] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 00:25:10 juju-e4d256-prod-github-runner-207 kernel: [68484.621983] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 00:25:10 juju-e4d256-prod-github-runner-207 kernel: [68484.622879] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 00:25:10 juju-e4d256-prod-github-runner-207 kernel: [68484.623770] Aug 23 00:25:38 juju-e4d256-prod-github-runner-207 kernel: [68512.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 63699s! [qemu-system-x86:6715] Aug 23 00:25:38 juju-e4d256-prod-github-runner-207 kernel: [68512.543110] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 00:25:38 juju-e4d256-prod-github-runner-207 kernel: [68512.543178] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 00:25:38 juju-e4d256-prod-github-runner-207 kernel: [68512.555654] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 00:25:38 juju-e4d256-prod-github-runner-207 kernel: [68512.556931] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 00:25:38 juju-e4d256-prod-github-runner-207 kernel: [68512.558181] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:25:38 juju-e4d256-prod-github-runner-207 kernel: [68512.559264] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 00:25:38 juju-e4d256-prod-github-runner-207 kernel: [68512.561839] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 00:25:38 juju-e4d256-prod-github-runner-207 kernel: [68512.562883] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 00:25:38 juju-e4d256-prod-github-runner-207 kernel: [68512.564044] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 00:25:38 juju-e4d256-prod-github-runner-207 kernel: [68512.565220] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 00:25:38 juju-e4d256-prod-github-runner-207 kernel: [68512.566399] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 00:25:38 juju-e4d256-prod-github-runner-207 kernel: [68512.567569] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 00:25:38 juju-e4d256-prod-github-runner-207 kernel: [68512.568733] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 00:25:38 juju-e4d256-prod-github-runner-207 kernel: [68512.569982] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 00:25:38 juju-e4d256-prod-github-runner-207 kernel: [68512.571088] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 00:25:38 juju-e4d256-prod-github-runner-207 kernel: [68512.572285] Call Trace: Aug 23 00:25:38 juju-e4d256-prod-github-runner-207 kernel: [68512.573206] Aug 23 00:25:38 juju-e4d256-prod-github-runner-207 kernel: [68512.574111] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:25:38 juju-e4d256-prod-github-runner-207 kernel: [68512.575141] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:25:38 juju-e4d256-prod-github-runner-207 kernel: [68512.576166] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:25:38 juju-e4d256-prod-github-runner-207 kernel: [68512.577240] ? show_regs.part.0+0x23/0x29 Aug 23 00:25:38 juju-e4d256-prod-github-runner-207 kernel: [68512.578256] ? show_regs.cold+0x8/0xd Aug 23 00:25:38 juju-e4d256-prod-github-runner-207 kernel: [68512.579232] ? watchdog_timer_fn+0x1be/0x220 Aug 23 00:25:38 juju-e4d256-prod-github-runner-207 kernel: [68512.580243] ? lockup_detector_update_enable+0x60/0x60 Aug 23 00:25:38 juju-e4d256-prod-github-runner-207 kernel: [68512.581307] ? __hrtimer_run_queues+0x107/0x230 Aug 23 00:25:38 juju-e4d256-prod-github-runner-207 kernel: [68512.582343] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 00:25:38 juju-e4d256-prod-github-runner-207 kernel: [68512.583366] ? hrtimer_interrupt+0x101/0x220 Aug 23 00:25:38 juju-e4d256-prod-github-runner-207 kernel: [68512.584378] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 00:25:38 juju-e4d256-prod-github-runner-207 kernel: [68512.585461] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 00:25:38 juju-e4d256-prod-github-runner-207 kernel: [68512.586515] Aug 23 00:25:38 juju-e4d256-prod-github-runner-207 kernel: [68512.587375] Aug 23 00:25:38 juju-e4d256-prod-github-runner-207 kernel: [68512.588220] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 00:25:38 juju-e4d256-prod-github-runner-207 kernel: [68512.589254] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:25:38 juju-e4d256-prod-github-runner-207 kernel: [68512.590304] ? _raw_spin_lock+0x22/0x30 Aug 23 00:25:38 juju-e4d256-prod-github-runner-207 kernel: [68512.591247] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:25:38 juju-e4d256-prod-github-runner-207 kernel: [68512.592263] direct_page_fault+0x206/0x310 [kvm] Aug 23 00:25:38 juju-e4d256-prod-github-runner-207 kernel: [68512.593285] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 00:25:38 juju-e4d256-prod-github-runner-207 kernel: [68512.594300] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 00:25:38 juju-e4d256-prod-github-runner-207 kernel: [68512.595303] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 00:25:38 juju-e4d256-prod-github-runner-207 kernel: [68512.596275] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 00:25:38 juju-e4d256-prod-github-runner-207 kernel: [68512.597217] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 00:25:38 juju-e4d256-prod-github-runner-207 kernel: [68512.598204] handle_exit+0x98/0x230 [kvm_amd] Aug 23 00:25:38 juju-e4d256-prod-github-runner-207 kernel: [68512.599094] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 00:25:38 juju-e4d256-prod-github-runner-207 kernel: [68512.600005] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 00:25:38 juju-e4d256-prod-github-runner-207 kernel: [68512.600926] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 00:25:38 juju-e4d256-prod-github-runner-207 kernel: [68512.601835] vcpu_run+0x62/0x2c0 [kvm] Aug 23 00:25:38 juju-e4d256-prod-github-runner-207 kernel: [68512.602649] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 00:25:38 juju-e4d256-prod-github-runner-207 kernel: [68512.603462] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 00:25:38 juju-e4d256-prod-github-runner-207 kernel: [68512.604315] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 00:25:38 juju-e4d256-prod-github-runner-207 kernel: [68512.605116] ? __seccomp_filter+0x4a/0x4a0 Aug 23 00:25:38 juju-e4d256-prod-github-runner-207 kernel: [68512.605865] ? __fget_files+0x86/0xc0 Aug 23 00:25:38 juju-e4d256-prod-github-runner-207 kernel: [68512.606570] __x64_sys_ioctl+0x95/0xd0 Aug 23 00:25:38 juju-e4d256-prod-github-runner-207 kernel: [68512.607262] do_syscall_64+0x5c/0xc0 Aug 23 00:25:38 juju-e4d256-prod-github-runner-207 kernel: [68512.607928] ? do_futex+0x162/0x1f0 Aug 23 00:25:38 juju-e4d256-prod-github-runner-207 kernel: [68512.608577] ? __x64_sys_futex+0x78/0x1e0 Aug 23 00:25:38 juju-e4d256-prod-github-runner-207 kernel: [68512.609252] ? __secure_computing+0xa9/0x120 Aug 23 00:25:38 juju-e4d256-prod-github-runner-207 kernel: [68512.609955] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 00:25:38 juju-e4d256-prod-github-runner-207 kernel: [68512.610715] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:25:38 juju-e4d256-prod-github-runner-207 kernel: [68512.611437] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:25:38 juju-e4d256-prod-github-runner-207 kernel: [68512.612160] ? do_syscall_64+0x69/0xc0 Aug 23 00:25:38 juju-e4d256-prod-github-runner-207 kernel: [68512.612807] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:25:38 juju-e4d256-prod-github-runner-207 kernel: [68512.613519] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:25:38 juju-e4d256-prod-github-runner-207 kernel: [68512.614216] ? do_syscall_64+0x69/0xc0 Aug 23 00:25:38 juju-e4d256-prod-github-runner-207 kernel: [68512.614847] ? do_syscall_64+0x69/0xc0 Aug 23 00:25:38 juju-e4d256-prod-github-runner-207 kernel: [68512.615470] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 00:25:38 juju-e4d256-prod-github-runner-207 kernel: [68512.616177] RIP: 0033:0x7faa5d0edaff Aug 23 00:25:38 juju-e4d256-prod-github-runner-207 kernel: [68512.616808] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 00:25:38 juju-e4d256-prod-github-runner-207 kernel: [68512.618814] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 00:25:38 juju-e4d256-prod-github-runner-207 kernel: [68512.619729] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 00:25:38 juju-e4d256-prod-github-runner-207 kernel: [68512.620619] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 00:25:38 juju-e4d256-prod-github-runner-207 kernel: [68512.621518] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 00:25:38 juju-e4d256-prod-github-runner-207 kernel: [68512.622411] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 00:25:38 juju-e4d256-prod-github-runner-207 kernel: [68512.623304] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 00:25:38 juju-e4d256-prod-github-runner-207 kernel: [68512.624231] Aug 23 00:26:06 juju-e4d256-prod-github-runner-207 kernel: [68540.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 63725s! [qemu-system-x86:6715] Aug 23 00:26:06 juju-e4d256-prod-github-runner-207 kernel: [68540.543708] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 00:26:06 juju-e4d256-prod-github-runner-207 kernel: [68540.543956] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 00:26:06 juju-e4d256-prod-github-runner-207 kernel: [68540.556063] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 00:26:06 juju-e4d256-prod-github-runner-207 kernel: [68540.557377] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 00:26:06 juju-e4d256-prod-github-runner-207 kernel: [68540.558603] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:26:06 juju-e4d256-prod-github-runner-207 kernel: [68540.559661] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 00:26:06 juju-e4d256-prod-github-runner-207 kernel: [68540.562255] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 00:26:06 juju-e4d256-prod-github-runner-207 kernel: [68540.563307] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 00:26:06 juju-e4d256-prod-github-runner-207 kernel: [68540.564485] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 00:26:06 juju-e4d256-prod-github-runner-207 kernel: [68540.565657] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 00:26:06 juju-e4d256-prod-github-runner-207 kernel: [68540.566824] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 00:26:06 juju-e4d256-prod-github-runner-207 kernel: [68540.567989] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 00:26:06 juju-e4d256-prod-github-runner-207 kernel: [68540.569173] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 00:26:06 juju-e4d256-prod-github-runner-207 kernel: [68540.570416] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 00:26:06 juju-e4d256-prod-github-runner-207 kernel: [68540.571519] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 00:26:06 juju-e4d256-prod-github-runner-207 kernel: [68540.572713] Call Trace: Aug 23 00:26:06 juju-e4d256-prod-github-runner-207 kernel: [68540.573642] Aug 23 00:26:06 juju-e4d256-prod-github-runner-207 kernel: [68540.574536] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:26:06 juju-e4d256-prod-github-runner-207 kernel: [68540.575570] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:26:06 juju-e4d256-prod-github-runner-207 kernel: [68540.576591] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:26:06 juju-e4d256-prod-github-runner-207 kernel: [68540.577698] ? show_regs.part.0+0x23/0x29 Aug 23 00:26:06 juju-e4d256-prod-github-runner-207 kernel: [68540.578695] ? show_regs.cold+0x8/0xd Aug 23 00:26:06 juju-e4d256-prod-github-runner-207 kernel: [68540.579668] ? watchdog_timer_fn+0x1be/0x220 Aug 23 00:26:06 juju-e4d256-prod-github-runner-207 kernel: [68540.580680] ? lockup_detector_update_enable+0x60/0x60 Aug 23 00:26:06 juju-e4d256-prod-github-runner-207 kernel: [68540.581760] ? __hrtimer_run_queues+0x107/0x230 Aug 23 00:26:06 juju-e4d256-prod-github-runner-207 kernel: [68540.582795] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 00:26:06 juju-e4d256-prod-github-runner-207 kernel: [68540.583821] ? hrtimer_interrupt+0x101/0x220 Aug 23 00:26:06 juju-e4d256-prod-github-runner-207 kernel: [68540.584843] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 00:26:06 juju-e4d256-prod-github-runner-207 kernel: [68540.585924] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 00:26:06 juju-e4d256-prod-github-runner-207 kernel: [68540.586988] Aug 23 00:26:06 juju-e4d256-prod-github-runner-207 kernel: [68540.587849] Aug 23 00:26:06 juju-e4d256-prod-github-runner-207 kernel: [68540.588686] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 00:26:06 juju-e4d256-prod-github-runner-207 kernel: [68540.589741] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:26:06 juju-e4d256-prod-github-runner-207 kernel: [68540.590780] ? _raw_spin_lock+0x22/0x30 Aug 23 00:26:06 juju-e4d256-prod-github-runner-207 kernel: [68540.591730] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:26:06 juju-e4d256-prod-github-runner-207 kernel: [68540.592746] direct_page_fault+0x206/0x310 [kvm] Aug 23 00:26:06 juju-e4d256-prod-github-runner-207 kernel: [68540.593776] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 00:26:06 juju-e4d256-prod-github-runner-207 kernel: [68540.594788] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 00:26:06 juju-e4d256-prod-github-runner-207 kernel: [68540.595787] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 00:26:06 juju-e4d256-prod-github-runner-207 kernel: [68540.596775] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 00:26:06 juju-e4d256-prod-github-runner-207 kernel: [68540.597758] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 00:26:06 juju-e4d256-prod-github-runner-207 kernel: [68540.598748] handle_exit+0x98/0x230 [kvm_amd] Aug 23 00:26:06 juju-e4d256-prod-github-runner-207 kernel: [68540.599639] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 00:26:06 juju-e4d256-prod-github-runner-207 kernel: [68540.600572] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 00:26:06 juju-e4d256-prod-github-runner-207 kernel: [68540.601518] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 00:26:06 juju-e4d256-prod-github-runner-207 kernel: [68540.602426] vcpu_run+0x62/0x2c0 [kvm] Aug 23 00:26:06 juju-e4d256-prod-github-runner-207 kernel: [68540.603236] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 00:26:06 juju-e4d256-prod-github-runner-207 kernel: [68540.604049] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 00:26:06 juju-e4d256-prod-github-runner-207 kernel: [68540.604909] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 00:26:06 juju-e4d256-prod-github-runner-207 kernel: [68540.605726] ? __seccomp_filter+0x4a/0x4a0 Aug 23 00:26:06 juju-e4d256-prod-github-runner-207 kernel: [68540.606470] ? __fget_files+0x86/0xc0 Aug 23 00:26:06 juju-e4d256-prod-github-runner-207 kernel: [68540.607174] __x64_sys_ioctl+0x95/0xd0 Aug 23 00:26:06 juju-e4d256-prod-github-runner-207 kernel: [68540.607865] do_syscall_64+0x5c/0xc0 Aug 23 00:26:06 juju-e4d256-prod-github-runner-207 kernel: [68540.608527] ? do_futex+0x162/0x1f0 Aug 23 00:26:06 juju-e4d256-prod-github-runner-207 kernel: [68540.609198] ? __x64_sys_futex+0x78/0x1e0 Aug 23 00:26:06 juju-e4d256-prod-github-runner-207 kernel: [68540.609869] ? __secure_computing+0xa9/0x120 Aug 23 00:26:06 juju-e4d256-prod-github-runner-207 kernel: [68540.610556] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 00:26:06 juju-e4d256-prod-github-runner-207 kernel: [68540.611318] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:26:06 juju-e4d256-prod-github-runner-207 kernel: [68540.612043] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:26:06 juju-e4d256-prod-github-runner-207 kernel: [68540.612786] ? do_syscall_64+0x69/0xc0 Aug 23 00:26:06 juju-e4d256-prod-github-runner-207 kernel: [68540.613443] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:26:06 juju-e4d256-prod-github-runner-207 kernel: [68540.614144] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:26:06 juju-e4d256-prod-github-runner-207 kernel: [68540.614843] ? do_syscall_64+0x69/0xc0 Aug 23 00:26:06 juju-e4d256-prod-github-runner-207 kernel: [68540.615474] ? do_syscall_64+0x69/0xc0 Aug 23 00:26:06 juju-e4d256-prod-github-runner-207 kernel: [68540.616100] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 00:26:06 juju-e4d256-prod-github-runner-207 kernel: [68540.616831] RIP: 0033:0x7faa5d0edaff Aug 23 00:26:06 juju-e4d256-prod-github-runner-207 kernel: [68540.617497] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 00:26:06 juju-e4d256-prod-github-runner-207 kernel: [68540.619650] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 00:26:06 juju-e4d256-prod-github-runner-207 kernel: [68540.620569] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 00:26:06 juju-e4d256-prod-github-runner-207 kernel: [68540.621472] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 00:26:06 juju-e4d256-prod-github-runner-207 kernel: [68540.622362] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 00:26:06 juju-e4d256-prod-github-runner-207 kernel: [68540.623291] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 00:26:06 juju-e4d256-prod-github-runner-207 kernel: [68540.624180] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 00:26:06 juju-e4d256-prod-github-runner-207 kernel: [68540.625130] Aug 23 00:26:34 juju-e4d256-prod-github-runner-207 kernel: [68568.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 63751s! [qemu-system-x86:6715] Aug 23 00:26:34 juju-e4d256-prod-github-runner-207 kernel: [68568.543096] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 00:26:34 juju-e4d256-prod-github-runner-207 kernel: [68568.543166] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 00:26:34 juju-e4d256-prod-github-runner-207 kernel: [68568.555327] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 00:26:34 juju-e4d256-prod-github-runner-207 kernel: [68568.556590] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 00:26:34 juju-e4d256-prod-github-runner-207 kernel: [68568.557818] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:26:34 juju-e4d256-prod-github-runner-207 kernel: [68568.558876] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 00:26:34 juju-e4d256-prod-github-runner-207 kernel: [68568.561436] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 00:26:34 juju-e4d256-prod-github-runner-207 kernel: [68568.562485] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 00:26:34 juju-e4d256-prod-github-runner-207 kernel: [68568.563648] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 00:26:34 juju-e4d256-prod-github-runner-207 kernel: [68568.564819] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 00:26:34 juju-e4d256-prod-github-runner-207 kernel: [68568.565986] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 00:26:34 juju-e4d256-prod-github-runner-207 kernel: [68568.567147] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 00:26:34 juju-e4d256-prod-github-runner-207 kernel: [68568.568319] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 00:26:34 juju-e4d256-prod-github-runner-207 kernel: [68568.569567] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 00:26:34 juju-e4d256-prod-github-runner-207 kernel: [68568.570665] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 00:26:34 juju-e4d256-prod-github-runner-207 kernel: [68568.571859] Call Trace: Aug 23 00:26:34 juju-e4d256-prod-github-runner-207 kernel: [68568.572788] Aug 23 00:26:34 juju-e4d256-prod-github-runner-207 kernel: [68568.573672] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:26:34 juju-e4d256-prod-github-runner-207 kernel: [68568.574707] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:26:34 juju-e4d256-prod-github-runner-207 kernel: [68568.575727] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:26:34 juju-e4d256-prod-github-runner-207 kernel: [68568.576810] ? show_regs.part.0+0x23/0x29 Aug 23 00:26:34 juju-e4d256-prod-github-runner-207 kernel: [68568.577806] ? show_regs.cold+0x8/0xd Aug 23 00:26:34 juju-e4d256-prod-github-runner-207 kernel: [68568.578781] ? watchdog_timer_fn+0x1be/0x220 Aug 23 00:26:34 juju-e4d256-prod-github-runner-207 kernel: [68568.579790] ? lockup_detector_update_enable+0x60/0x60 Aug 23 00:26:34 juju-e4d256-prod-github-runner-207 kernel: [68568.580861] ? __hrtimer_run_queues+0x107/0x230 Aug 23 00:26:34 juju-e4d256-prod-github-runner-207 kernel: [68568.581894] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 00:26:34 juju-e4d256-prod-github-runner-207 kernel: [68568.582917] ? hrtimer_interrupt+0x101/0x220 Aug 23 00:26:34 juju-e4d256-prod-github-runner-207 kernel: [68568.583932] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 00:26:34 juju-e4d256-prod-github-runner-207 kernel: [68568.585013] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 00:26:34 juju-e4d256-prod-github-runner-207 kernel: [68568.586061] Aug 23 00:26:34 juju-e4d256-prod-github-runner-207 kernel: [68568.586913] Aug 23 00:26:34 juju-e4d256-prod-github-runner-207 kernel: [68568.587759] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 00:26:34 juju-e4d256-prod-github-runner-207 kernel: [68568.588808] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:26:34 juju-e4d256-prod-github-runner-207 kernel: [68568.589854] ? _raw_spin_lock+0x22/0x30 Aug 23 00:26:34 juju-e4d256-prod-github-runner-207 kernel: [68568.590800] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:26:34 juju-e4d256-prod-github-runner-207 kernel: [68568.591819] direct_page_fault+0x206/0x310 [kvm] Aug 23 00:26:34 juju-e4d256-prod-github-runner-207 kernel: [68568.592850] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 00:26:34 juju-e4d256-prod-github-runner-207 kernel: [68568.593858] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 00:26:34 juju-e4d256-prod-github-runner-207 kernel: [68568.594863] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 00:26:34 juju-e4d256-prod-github-runner-207 kernel: [68568.595832] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 00:26:34 juju-e4d256-prod-github-runner-207 kernel: [68568.596794] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 00:26:34 juju-e4d256-prod-github-runner-207 kernel: [68568.597776] handle_exit+0x98/0x230 [kvm_amd] Aug 23 00:26:34 juju-e4d256-prod-github-runner-207 kernel: [68568.598671] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 00:26:34 juju-e4d256-prod-github-runner-207 kernel: [68568.599583] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 00:26:34 juju-e4d256-prod-github-runner-207 kernel: [68568.600510] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 00:26:34 juju-e4d256-prod-github-runner-207 kernel: [68568.601422] vcpu_run+0x62/0x2c0 [kvm] Aug 23 00:26:34 juju-e4d256-prod-github-runner-207 kernel: [68568.602235] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 00:26:34 juju-e4d256-prod-github-runner-207 kernel: [68568.603043] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 00:26:34 juju-e4d256-prod-github-runner-207 kernel: [68568.603895] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 00:26:34 juju-e4d256-prod-github-runner-207 kernel: [68568.604695] ? __seccomp_filter+0x4a/0x4a0 Aug 23 00:26:34 juju-e4d256-prod-github-runner-207 kernel: [68568.605452] ? __fget_files+0x86/0xc0 Aug 23 00:26:34 juju-e4d256-prod-github-runner-207 kernel: [68568.606155] __x64_sys_ioctl+0x95/0xd0 Aug 23 00:26:34 juju-e4d256-prod-github-runner-207 kernel: [68568.606847] do_syscall_64+0x5c/0xc0 Aug 23 00:26:34 juju-e4d256-prod-github-runner-207 kernel: [68568.607515] ? do_futex+0x162/0x1f0 Aug 23 00:26:34 juju-e4d256-prod-github-runner-207 kernel: [68568.608163] ? __x64_sys_futex+0x78/0x1e0 Aug 23 00:26:34 juju-e4d256-prod-github-runner-207 kernel: [68568.608847] ? __secure_computing+0xa9/0x120 Aug 23 00:26:34 juju-e4d256-prod-github-runner-207 kernel: [68568.609542] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 00:26:34 juju-e4d256-prod-github-runner-207 kernel: [68568.610312] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:26:34 juju-e4d256-prod-github-runner-207 kernel: [68568.611043] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:26:34 juju-e4d256-prod-github-runner-207 kernel: [68568.611759] ? do_syscall_64+0x69/0xc0 Aug 23 00:26:34 juju-e4d256-prod-github-runner-207 kernel: [68568.612403] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:26:34 juju-e4d256-prod-github-runner-207 kernel: [68568.613109] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:26:34 juju-e4d256-prod-github-runner-207 kernel: [68568.613804] ? do_syscall_64+0x69/0xc0 Aug 23 00:26:34 juju-e4d256-prod-github-runner-207 kernel: [68568.614431] ? do_syscall_64+0x69/0xc0 Aug 23 00:26:34 juju-e4d256-prod-github-runner-207 kernel: [68568.615052] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 00:26:34 juju-e4d256-prod-github-runner-207 kernel: [68568.615755] RIP: 0033:0x7faa5d0edaff Aug 23 00:26:34 juju-e4d256-prod-github-runner-207 kernel: [68568.616381] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 00:26:34 juju-e4d256-prod-github-runner-207 kernel: [68568.618365] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 00:26:34 juju-e4d256-prod-github-runner-207 kernel: [68568.619272] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 00:26:34 juju-e4d256-prod-github-runner-207 kernel: [68568.620157] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 00:26:34 juju-e4d256-prod-github-runner-207 kernel: [68568.621050] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 00:26:34 juju-e4d256-prod-github-runner-207 kernel: [68568.621935] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 00:26:34 juju-e4d256-prod-github-runner-207 kernel: [68568.622820] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 00:26:34 juju-e4d256-prod-github-runner-207 kernel: [68568.623708] Aug 23 00:26:47 juju-e4d256-prod-github-runner-207 kernel: [68581.760706] rcu: INFO: rcu_sched self-detected stall on CPU Aug 23 00:26:47 juju-e4d256-prod-github-runner-207 kernel: [68581.761672] rcu: 1-....: (17062190 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=8237419 Aug 23 00:26:47 juju-e4d256-prod-github-runner-207 kernel: [68581.762801] (t=17116140 jiffies g=23269 q=59525) Aug 23 00:26:47 juju-e4d256-prod-github-runner-207 kernel: [68581.763591] NMI backtrace for cpu 1 Aug 23 00:26:47 juju-e4d256-prod-github-runner-207 kernel: [68581.764299] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 00:26:47 juju-e4d256-prod-github-runner-207 kernel: [68581.765415] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 00:26:47 juju-e4d256-prod-github-runner-207 kernel: [68581.766476] Call Trace: Aug 23 00:26:47 juju-e4d256-prod-github-runner-207 kernel: [68581.767150] Aug 23 00:26:47 juju-e4d256-prod-github-runner-207 kernel: [68581.767792] show_stack+0x52/0x5c Aug 23 00:26:47 juju-e4d256-prod-github-runner-207 kernel: [68581.768515] dump_stack_lvl+0x4a/0x63 Aug 23 00:26:47 juju-e4d256-prod-github-runner-207 kernel: [68581.769266] dump_stack+0x10/0x16 Aug 23 00:26:47 juju-e4d256-prod-github-runner-207 kernel: [68581.769984] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 23 00:26:47 juju-e4d256-prod-github-runner-207 kernel: [68581.770764] ? lapic_can_unplug_cpu+0x90/0x90 Aug 23 00:26:47 juju-e4d256-prod-github-runner-207 kernel: [68581.771541] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 23 00:26:47 juju-e4d256-prod-github-runner-207 kernel: [68581.772359] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 23 00:26:47 juju-e4d256-prod-github-runner-207 kernel: [68581.773187] trigger_single_cpu_backtrace+0x44/0x4f Aug 23 00:26:47 juju-e4d256-prod-github-runner-207 kernel: [68581.773993] rcu_dump_cpu_stacks+0x102/0x149 Aug 23 00:26:47 juju-e4d256-prod-github-runner-207 kernel: [68581.774763] print_cpu_stall.cold+0x2f/0xe2 Aug 23 00:26:47 juju-e4d256-prod-github-runner-207 kernel: [68581.775526] ? timekeeping_update+0xf7/0x150 Aug 23 00:26:47 juju-e4d256-prod-github-runner-207 kernel: [68581.776294] check_cpu_stall+0x109/0x270 Aug 23 00:26:47 juju-e4d256-prod-github-runner-207 kernel: [68581.777051] rcu_sched_clock_irq+0x9a/0x250 Aug 23 00:26:47 juju-e4d256-prod-github-runner-207 kernel: [68581.777817] update_process_times+0x94/0xd0 Aug 23 00:26:47 juju-e4d256-prod-github-runner-207 kernel: [68581.778581] tick_sched_handle+0x29/0x70 Aug 23 00:26:47 juju-e4d256-prod-github-runner-207 kernel: [68581.779324] tick_sched_timer+0x8c/0xc0 Aug 23 00:26:47 juju-e4d256-prod-github-runner-207 kernel: [68581.780086] ? tick_nohz_handler+0xb0/0xb0 Aug 23 00:26:47 juju-e4d256-prod-github-runner-207 kernel: [68581.780861] __hrtimer_run_queues+0x107/0x230 Aug 23 00:26:47 juju-e4d256-prod-github-runner-207 kernel: [68581.781766] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 00:26:47 juju-e4d256-prod-github-runner-207 kernel: [68581.782544] hrtimer_interrupt+0x101/0x220 Aug 23 00:26:47 juju-e4d256-prod-github-runner-207 kernel: [68581.783301] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 00:26:47 juju-e4d256-prod-github-runner-207 kernel: [68581.784111] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 00:26:47 juju-e4d256-prod-github-runner-207 kernel: [68581.784920] Aug 23 00:26:47 juju-e4d256-prod-github-runner-207 kernel: [68581.785561] Aug 23 00:26:47 juju-e4d256-prod-github-runner-207 kernel: [68581.786188] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 00:26:47 juju-e4d256-prod-github-runner-207 kernel: [68581.787005] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:26:47 juju-e4d256-prod-github-runner-207 kernel: [68581.787880] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 00:26:47 juju-e4d256-prod-github-runner-207 kernel: [68581.790098] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 00:26:47 juju-e4d256-prod-github-runner-207 kernel: [68581.790969] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 00:26:47 juju-e4d256-prod-github-runner-207 kernel: [68581.791977] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 00:26:47 juju-e4d256-prod-github-runner-207 kernel: [68581.792963] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 00:26:47 juju-e4d256-prod-github-runner-207 kernel: [68581.793929] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 00:26:47 juju-e4d256-prod-github-runner-207 kernel: [68581.794888] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 00:26:47 juju-e4d256-prod-github-runner-207 kernel: [68581.795852] ? _raw_spin_lock+0x22/0x30 Aug 23 00:26:47 juju-e4d256-prod-github-runner-207 kernel: [68581.796622] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:26:47 juju-e4d256-prod-github-runner-207 kernel: [68581.797476] direct_page_fault+0x206/0x310 [kvm] Aug 23 00:26:47 juju-e4d256-prod-github-runner-207 kernel: [68581.798314] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 00:26:47 juju-e4d256-prod-github-runner-207 kernel: [68581.799144] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 00:26:47 juju-e4d256-prod-github-runner-207 kernel: [68581.799968] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 00:26:47 juju-e4d256-prod-github-runner-207 kernel: [68581.800787] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 00:26:47 juju-e4d256-prod-github-runner-207 kernel: [68581.801575] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 00:26:47 juju-e4d256-prod-github-runner-207 kernel: [68581.802412] handle_exit+0x98/0x230 [kvm_amd] Aug 23 00:26:47 juju-e4d256-prod-github-runner-207 kernel: [68581.803167] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 00:26:47 juju-e4d256-prod-github-runner-207 kernel: [68581.803963] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 00:26:47 juju-e4d256-prod-github-runner-207 kernel: [68581.804781] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 00:26:47 juju-e4d256-prod-github-runner-207 kernel: [68581.805568] vcpu_run+0x62/0x2c0 [kvm] Aug 23 00:26:47 juju-e4d256-prod-github-runner-207 kernel: [68581.806300] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 00:26:47 juju-e4d256-prod-github-runner-207 kernel: [68581.807034] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 00:26:47 juju-e4d256-prod-github-runner-207 kernel: [68581.807854] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 00:26:47 juju-e4d256-prod-github-runner-207 kernel: [68581.808623] ? __seccomp_filter+0x4a/0x4a0 Aug 23 00:26:47 juju-e4d256-prod-github-runner-207 kernel: [68581.809342] ? __fget_files+0x86/0xc0 Aug 23 00:26:47 juju-e4d256-prod-github-runner-207 kernel: [68581.810033] __x64_sys_ioctl+0x95/0xd0 Aug 23 00:26:47 juju-e4d256-prod-github-runner-207 kernel: [68581.810745] do_syscall_64+0x5c/0xc0 Aug 23 00:26:47 juju-e4d256-prod-github-runner-207 kernel: [68581.811427] ? do_futex+0x162/0x1f0 Aug 23 00:26:47 juju-e4d256-prod-github-runner-207 kernel: [68581.812100] ? __x64_sys_futex+0x78/0x1e0 Aug 23 00:26:47 juju-e4d256-prod-github-runner-207 kernel: [68581.812811] ? __secure_computing+0xa9/0x120 Aug 23 00:26:47 juju-e4d256-prod-github-runner-207 kernel: [68581.813528] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 00:26:47 juju-e4d256-prod-github-runner-207 kernel: [68581.814318] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:26:47 juju-e4d256-prod-github-runner-207 kernel: [68581.815073] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:26:47 juju-e4d256-prod-github-runner-207 kernel: [68581.815829] ? do_syscall_64+0x69/0xc0 Aug 23 00:26:47 juju-e4d256-prod-github-runner-207 kernel: [68581.816520] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:26:47 juju-e4d256-prod-github-runner-207 kernel: [68581.817286] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:26:47 juju-e4d256-prod-github-runner-207 kernel: [68581.818043] ? do_syscall_64+0x69/0xc0 Aug 23 00:26:47 juju-e4d256-prod-github-runner-207 kernel: [68581.818735] ? do_syscall_64+0x69/0xc0 Aug 23 00:26:47 juju-e4d256-prod-github-runner-207 kernel: [68581.819431] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 00:26:47 juju-e4d256-prod-github-runner-207 kernel: [68581.820208] RIP: 0033:0x7faa5d0edaff Aug 23 00:26:47 juju-e4d256-prod-github-runner-207 kernel: [68581.820904] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 00:26:47 juju-e4d256-prod-github-runner-207 kernel: [68581.823019] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 00:26:47 juju-e4d256-prod-github-runner-207 kernel: [68581.823991] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 00:26:47 juju-e4d256-prod-github-runner-207 kernel: [68581.824952] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 00:26:47 juju-e4d256-prod-github-runner-207 kernel: [68581.825925] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 00:26:47 juju-e4d256-prod-github-runner-207 kernel: [68581.826901] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 00:26:47 juju-e4d256-prod-github-runner-207 kernel: [68581.827835] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 00:26:47 juju-e4d256-prod-github-runner-207 kernel: [68581.828774] Aug 23 00:27:14 juju-e4d256-prod-github-runner-207 kernel: [68608.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 63788s! [qemu-system-x86:6715] Aug 23 00:27:14 juju-e4d256-prod-github-runner-207 kernel: [68608.543102] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 00:27:14 juju-e4d256-prod-github-runner-207 kernel: [68608.543169] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 00:27:14 juju-e4d256-prod-github-runner-207 kernel: [68608.555380] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 00:27:14 juju-e4d256-prod-github-runner-207 kernel: [68608.556670] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 00:27:14 juju-e4d256-prod-github-runner-207 kernel: [68608.557892] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:27:14 juju-e4d256-prod-github-runner-207 kernel: [68608.558946] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 00:27:14 juju-e4d256-prod-github-runner-207 kernel: [68608.561488] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 00:27:14 juju-e4d256-prod-github-runner-207 kernel: [68608.562534] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 00:27:14 juju-e4d256-prod-github-runner-207 kernel: [68608.563701] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 00:27:14 juju-e4d256-prod-github-runner-207 kernel: [68608.564882] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 00:27:14 juju-e4d256-prod-github-runner-207 kernel: [68608.566043] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 00:27:14 juju-e4d256-prod-github-runner-207 kernel: [68608.567201] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 00:27:14 juju-e4d256-prod-github-runner-207 kernel: [68608.568394] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 00:27:14 juju-e4d256-prod-github-runner-207 kernel: [68608.569631] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 00:27:14 juju-e4d256-prod-github-runner-207 kernel: [68608.570732] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 00:27:14 juju-e4d256-prod-github-runner-207 kernel: [68608.571928] Call Trace: Aug 23 00:27:14 juju-e4d256-prod-github-runner-207 kernel: [68608.572855] Aug 23 00:27:14 juju-e4d256-prod-github-runner-207 kernel: [68608.573740] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:27:14 juju-e4d256-prod-github-runner-207 kernel: [68608.574773] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:27:14 juju-e4d256-prod-github-runner-207 kernel: [68608.575792] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:27:14 juju-e4d256-prod-github-runner-207 kernel: [68608.576890] ? show_regs.part.0+0x23/0x29 Aug 23 00:27:14 juju-e4d256-prod-github-runner-207 kernel: [68608.577900] ? show_regs.cold+0x8/0xd Aug 23 00:27:14 juju-e4d256-prod-github-runner-207 kernel: [68608.578880] ? watchdog_timer_fn+0x1be/0x220 Aug 23 00:27:14 juju-e4d256-prod-github-runner-207 kernel: [68608.579902] ? lockup_detector_update_enable+0x60/0x60 Aug 23 00:27:14 juju-e4d256-prod-github-runner-207 kernel: [68608.581005] ? __hrtimer_run_queues+0x107/0x230 Aug 23 00:27:14 juju-e4d256-prod-github-runner-207 kernel: [68608.582055] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 00:27:14 juju-e4d256-prod-github-runner-207 kernel: [68608.583080] ? hrtimer_interrupt+0x101/0x220 Aug 23 00:27:14 juju-e4d256-prod-github-runner-207 kernel: [68608.584105] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 00:27:14 juju-e4d256-prod-github-runner-207 kernel: [68608.585196] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 00:27:14 juju-e4d256-prod-github-runner-207 kernel: [68608.586239] Aug 23 00:27:14 juju-e4d256-prod-github-runner-207 kernel: [68608.587099] Aug 23 00:27:14 juju-e4d256-prod-github-runner-207 kernel: [68608.587943] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 00:27:14 juju-e4d256-prod-github-runner-207 kernel: [68608.588983] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:27:14 juju-e4d256-prod-github-runner-207 kernel: [68608.590018] ? _raw_spin_lock+0x22/0x30 Aug 23 00:27:14 juju-e4d256-prod-github-runner-207 kernel: [68608.590958] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:27:14 juju-e4d256-prod-github-runner-207 kernel: [68608.591976] direct_page_fault+0x206/0x310 [kvm] Aug 23 00:27:14 juju-e4d256-prod-github-runner-207 kernel: [68608.593017] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 00:27:14 juju-e4d256-prod-github-runner-207 kernel: [68608.594030] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 00:27:14 juju-e4d256-prod-github-runner-207 kernel: [68608.595029] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 00:27:14 juju-e4d256-prod-github-runner-207 kernel: [68608.595997] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 00:27:14 juju-e4d256-prod-github-runner-207 kernel: [68608.597043] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 00:27:14 juju-e4d256-prod-github-runner-207 kernel: [68608.598021] handle_exit+0x98/0x230 [kvm_amd] Aug 23 00:27:14 juju-e4d256-prod-github-runner-207 kernel: [68608.598913] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 00:27:14 juju-e4d256-prod-github-runner-207 kernel: [68608.599985] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 00:27:14 juju-e4d256-prod-github-runner-207 kernel: [68608.600935] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 00:27:14 juju-e4d256-prod-github-runner-207 kernel: [68608.601839] vcpu_run+0x62/0x2c0 [kvm] Aug 23 00:27:14 juju-e4d256-prod-github-runner-207 kernel: [68608.602654] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 00:27:14 juju-e4d256-prod-github-runner-207 kernel: [68608.603461] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 00:27:14 juju-e4d256-prod-github-runner-207 kernel: [68608.604330] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 00:27:14 juju-e4d256-prod-github-runner-207 kernel: [68608.605132] ? __seccomp_filter+0x4a/0x4a0 Aug 23 00:27:14 juju-e4d256-prod-github-runner-207 kernel: [68608.605875] ? __fget_files+0x86/0xc0 Aug 23 00:27:14 juju-e4d256-prod-github-runner-207 kernel: [68608.606577] __x64_sys_ioctl+0x95/0xd0 Aug 23 00:27:14 juju-e4d256-prod-github-runner-207 kernel: [68608.607273] do_syscall_64+0x5c/0xc0 Aug 23 00:27:14 juju-e4d256-prod-github-runner-207 kernel: [68608.607940] ? do_futex+0x162/0x1f0 Aug 23 00:27:14 juju-e4d256-prod-github-runner-207 kernel: [68608.608607] ? __x64_sys_futex+0x78/0x1e0 Aug 23 00:27:14 juju-e4d256-prod-github-runner-207 kernel: [68608.609299] ? __secure_computing+0xa9/0x120 Aug 23 00:27:14 juju-e4d256-prod-github-runner-207 kernel: [68608.610005] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 00:27:14 juju-e4d256-prod-github-runner-207 kernel: [68608.610765] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:27:14 juju-e4d256-prod-github-runner-207 kernel: [68608.611520] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:27:14 juju-e4d256-prod-github-runner-207 kernel: [68608.612247] ? do_syscall_64+0x69/0xc0 Aug 23 00:27:14 juju-e4d256-prod-github-runner-207 kernel: [68608.612925] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:27:14 juju-e4d256-prod-github-runner-207 kernel: [68608.613627] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:27:14 juju-e4d256-prod-github-runner-207 kernel: [68608.614340] ? do_syscall_64+0x69/0xc0 Aug 23 00:27:14 juju-e4d256-prod-github-runner-207 kernel: [68608.614969] ? do_syscall_64+0x69/0xc0 Aug 23 00:27:14 juju-e4d256-prod-github-runner-207 kernel: [68608.615590] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 00:27:14 juju-e4d256-prod-github-runner-207 kernel: [68608.616292] RIP: 0033:0x7faa5d0edaff Aug 23 00:27:14 juju-e4d256-prod-github-runner-207 kernel: [68608.616942] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 00:27:14 juju-e4d256-prod-github-runner-207 kernel: [68608.618939] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 00:27:14 juju-e4d256-prod-github-runner-207 kernel: [68608.619845] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 00:27:14 juju-e4d256-prod-github-runner-207 kernel: [68608.620793] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 00:27:14 juju-e4d256-prod-github-runner-207 kernel: [68608.621717] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 00:27:14 juju-e4d256-prod-github-runner-207 kernel: [68608.622703] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 00:27:14 juju-e4d256-prod-github-runner-207 kernel: [68608.623599] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 00:27:14 juju-e4d256-prod-github-runner-207 kernel: [68608.624518] Aug 23 00:27:42 juju-e4d256-prod-github-runner-207 kernel: [68636.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 63814s! [qemu-system-x86:6715] Aug 23 00:27:42 juju-e4d256-prod-github-runner-207 kernel: [68636.543765] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 00:27:42 juju-e4d256-prod-github-runner-207 kernel: [68636.544045] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 00:27:42 juju-e4d256-prod-github-runner-207 kernel: [68636.556154] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 00:27:42 juju-e4d256-prod-github-runner-207 kernel: [68636.557419] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 00:27:42 juju-e4d256-prod-github-runner-207 kernel: [68636.558675] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:27:42 juju-e4d256-prod-github-runner-207 kernel: [68636.559736] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 00:27:42 juju-e4d256-prod-github-runner-207 kernel: [68636.562319] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 00:27:42 juju-e4d256-prod-github-runner-207 kernel: [68636.563358] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 00:27:42 juju-e4d256-prod-github-runner-207 kernel: [68636.564536] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 00:27:42 juju-e4d256-prod-github-runner-207 kernel: [68636.565716] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 00:27:42 juju-e4d256-prod-github-runner-207 kernel: [68636.566881] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 00:27:42 juju-e4d256-prod-github-runner-207 kernel: [68636.568055] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 00:27:42 juju-e4d256-prod-github-runner-207 kernel: [68636.569241] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 00:27:42 juju-e4d256-prod-github-runner-207 kernel: [68636.570482] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 00:27:42 juju-e4d256-prod-github-runner-207 kernel: [68636.571580] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 00:27:42 juju-e4d256-prod-github-runner-207 kernel: [68636.572800] Call Trace: Aug 23 00:27:42 juju-e4d256-prod-github-runner-207 kernel: [68636.573745] Aug 23 00:27:42 juju-e4d256-prod-github-runner-207 kernel: [68636.574639] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:27:42 juju-e4d256-prod-github-runner-207 kernel: [68636.575668] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:27:42 juju-e4d256-prod-github-runner-207 kernel: [68636.576724] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:27:42 juju-e4d256-prod-github-runner-207 kernel: [68636.577820] ? show_regs.part.0+0x23/0x29 Aug 23 00:27:42 juju-e4d256-prod-github-runner-207 kernel: [68636.578817] ? show_regs.cold+0x8/0xd Aug 23 00:27:42 juju-e4d256-prod-github-runner-207 kernel: [68636.579822] ? watchdog_timer_fn+0x1be/0x220 Aug 23 00:27:42 juju-e4d256-prod-github-runner-207 kernel: [68636.580875] ? lockup_detector_update_enable+0x60/0x60 Aug 23 00:27:42 juju-e4d256-prod-github-runner-207 kernel: [68636.581948] ? __hrtimer_run_queues+0x107/0x230 Aug 23 00:27:42 juju-e4d256-prod-github-runner-207 kernel: [68636.582981] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 00:27:42 juju-e4d256-prod-github-runner-207 kernel: [68636.584047] ? hrtimer_interrupt+0x101/0x220 Aug 23 00:27:42 juju-e4d256-prod-github-runner-207 kernel: [68636.585077] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 00:27:42 juju-e4d256-prod-github-runner-207 kernel: [68636.586151] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 00:27:42 juju-e4d256-prod-github-runner-207 kernel: [68636.587202] Aug 23 00:27:42 juju-e4d256-prod-github-runner-207 kernel: [68636.588093] Aug 23 00:27:42 juju-e4d256-prod-github-runner-207 kernel: [68636.588942] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 00:27:42 juju-e4d256-prod-github-runner-207 kernel: [68636.589982] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:27:42 juju-e4d256-prod-github-runner-207 kernel: [68636.591024] ? _raw_spin_lock+0x22/0x30 Aug 23 00:27:42 juju-e4d256-prod-github-runner-207 kernel: [68636.591979] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:27:42 juju-e4d256-prod-github-runner-207 kernel: [68636.593031] direct_page_fault+0x206/0x310 [kvm] Aug 23 00:27:42 juju-e4d256-prod-github-runner-207 kernel: [68636.594057] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 00:27:42 juju-e4d256-prod-github-runner-207 kernel: [68636.595064] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 00:27:42 juju-e4d256-prod-github-runner-207 kernel: [68636.596098] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 00:27:42 juju-e4d256-prod-github-runner-207 kernel: [68636.597107] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 00:27:42 juju-e4d256-prod-github-runner-207 kernel: [68636.598056] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 00:27:42 juju-e4d256-prod-github-runner-207 kernel: [68636.599050] handle_exit+0x98/0x230 [kvm_amd] Aug 23 00:27:42 juju-e4d256-prod-github-runner-207 kernel: [68636.599949] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 00:27:42 juju-e4d256-prod-github-runner-207 kernel: [68636.600897] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 00:27:42 juju-e4d256-prod-github-runner-207 kernel: [68636.601820] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 00:27:42 juju-e4d256-prod-github-runner-207 kernel: [68636.602725] vcpu_run+0x62/0x2c0 [kvm] Aug 23 00:27:42 juju-e4d256-prod-github-runner-207 kernel: [68636.603534] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 00:27:42 juju-e4d256-prod-github-runner-207 kernel: [68636.604392] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 00:27:42 juju-e4d256-prod-github-runner-207 kernel: [68636.605259] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 00:27:42 juju-e4d256-prod-github-runner-207 kernel: [68636.606055] ? __seccomp_filter+0x4a/0x4a0 Aug 23 00:27:42 juju-e4d256-prod-github-runner-207 kernel: [68636.606801] ? __fget_files+0x86/0xc0 Aug 23 00:27:42 juju-e4d256-prod-github-runner-207 kernel: [68636.607504] __x64_sys_ioctl+0x95/0xd0 Aug 23 00:27:42 juju-e4d256-prod-github-runner-207 kernel: [68636.608210] do_syscall_64+0x5c/0xc0 Aug 23 00:27:42 juju-e4d256-prod-github-runner-207 kernel: [68636.608880] ? do_futex+0x162/0x1f0 Aug 23 00:27:42 juju-e4d256-prod-github-runner-207 kernel: [68636.609539] ? __x64_sys_futex+0x78/0x1e0 Aug 23 00:27:42 juju-e4d256-prod-github-runner-207 kernel: [68636.610242] ? __secure_computing+0xa9/0x120 Aug 23 00:27:42 juju-e4d256-prod-github-runner-207 kernel: [68636.610930] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 00:27:42 juju-e4d256-prod-github-runner-207 kernel: [68636.611690] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:27:42 juju-e4d256-prod-github-runner-207 kernel: [68636.612427] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:27:42 juju-e4d256-prod-github-runner-207 kernel: [68636.613170] ? do_syscall_64+0x69/0xc0 Aug 23 00:27:42 juju-e4d256-prod-github-runner-207 kernel: [68636.614019] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:27:42 juju-e4d256-prod-github-runner-207 kernel: [68636.614727] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:27:42 juju-e4d256-prod-github-runner-207 kernel: [68636.615606] ? do_syscall_64+0x69/0xc0 Aug 23 00:27:42 juju-e4d256-prod-github-runner-207 kernel: [68636.616248] ? do_syscall_64+0x69/0xc0 Aug 23 00:27:42 juju-e4d256-prod-github-runner-207 kernel: [68636.616882] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 00:27:42 juju-e4d256-prod-github-runner-207 kernel: [68636.617588] RIP: 0033:0x7faa5d0edaff Aug 23 00:27:42 juju-e4d256-prod-github-runner-207 kernel: [68636.618249] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 00:27:42 juju-e4d256-prod-github-runner-207 kernel: [68636.620268] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 00:27:42 juju-e4d256-prod-github-runner-207 kernel: [68636.621179] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 00:27:42 juju-e4d256-prod-github-runner-207 kernel: [68636.622070] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 00:27:42 juju-e4d256-prod-github-runner-207 kernel: [68636.622973] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 00:27:42 juju-e4d256-prod-github-runner-207 kernel: [68636.623866] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 00:27:42 juju-e4d256-prod-github-runner-207 kernel: [68636.624764] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 00:27:42 juju-e4d256-prod-github-runner-207 kernel: [68636.625664] Aug 23 00:28:10 juju-e4d256-prod-github-runner-207 kernel: [68664.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 63840s! [qemu-system-x86:6715] Aug 23 00:28:10 juju-e4d256-prod-github-runner-207 kernel: [68664.543089] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 00:28:10 juju-e4d256-prod-github-runner-207 kernel: [68664.543157] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 00:28:10 juju-e4d256-prod-github-runner-207 kernel: [68664.555161] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 00:28:10 juju-e4d256-prod-github-runner-207 kernel: [68664.556426] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 00:28:10 juju-e4d256-prod-github-runner-207 kernel: [68664.557642] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:28:10 juju-e4d256-prod-github-runner-207 kernel: [68664.558701] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 00:28:10 juju-e4d256-prod-github-runner-207 kernel: [68664.561242] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 00:28:10 juju-e4d256-prod-github-runner-207 kernel: [68664.562287] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 00:28:10 juju-e4d256-prod-github-runner-207 kernel: [68664.563445] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 00:28:10 juju-e4d256-prod-github-runner-207 kernel: [68664.564617] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 00:28:10 juju-e4d256-prod-github-runner-207 kernel: [68664.565773] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 00:28:10 juju-e4d256-prod-github-runner-207 kernel: [68664.566932] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 00:28:10 juju-e4d256-prod-github-runner-207 kernel: [68664.568103] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 00:28:10 juju-e4d256-prod-github-runner-207 kernel: [68664.569333] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 00:28:10 juju-e4d256-prod-github-runner-207 kernel: [68664.570426] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 00:28:10 juju-e4d256-prod-github-runner-207 kernel: [68664.571614] Call Trace: Aug 23 00:28:10 juju-e4d256-prod-github-runner-207 kernel: [68664.572539] Aug 23 00:28:10 juju-e4d256-prod-github-runner-207 kernel: [68664.573423] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:28:10 juju-e4d256-prod-github-runner-207 kernel: [68664.574456] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:28:10 juju-e4d256-prod-github-runner-207 kernel: [68664.575478] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:28:10 juju-e4d256-prod-github-runner-207 kernel: [68664.576567] ? show_regs.part.0+0x23/0x29 Aug 23 00:28:10 juju-e4d256-prod-github-runner-207 kernel: [68664.577577] ? show_regs.cold+0x8/0xd Aug 23 00:28:10 juju-e4d256-prod-github-runner-207 kernel: [68664.578547] ? watchdog_timer_fn+0x1be/0x220 Aug 23 00:28:10 juju-e4d256-prod-github-runner-207 kernel: [68664.579552] ? lockup_detector_update_enable+0x60/0x60 Aug 23 00:28:10 juju-e4d256-prod-github-runner-207 kernel: [68664.580630] ? __hrtimer_run_queues+0x107/0x230 Aug 23 00:28:10 juju-e4d256-prod-github-runner-207 kernel: [68664.581655] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 00:28:10 juju-e4d256-prod-github-runner-207 kernel: [68664.582677] ? hrtimer_interrupt+0x101/0x220 Aug 23 00:28:10 juju-e4d256-prod-github-runner-207 kernel: [68664.583699] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 00:28:10 juju-e4d256-prod-github-runner-207 kernel: [68664.584765] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 00:28:10 juju-e4d256-prod-github-runner-207 kernel: [68664.585811] Aug 23 00:28:10 juju-e4d256-prod-github-runner-207 kernel: [68664.586661] Aug 23 00:28:10 juju-e4d256-prod-github-runner-207 kernel: [68664.587502] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 00:28:10 juju-e4d256-prod-github-runner-207 kernel: [68664.588539] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:28:10 juju-e4d256-prod-github-runner-207 kernel: [68664.589580] ? _raw_spin_lock+0x22/0x30 Aug 23 00:28:10 juju-e4d256-prod-github-runner-207 kernel: [68664.590526] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:28:10 juju-e4d256-prod-github-runner-207 kernel: [68664.591538] direct_page_fault+0x206/0x310 [kvm] Aug 23 00:28:10 juju-e4d256-prod-github-runner-207 kernel: [68664.592570] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 00:28:10 juju-e4d256-prod-github-runner-207 kernel: [68664.593577] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 00:28:10 juju-e4d256-prod-github-runner-207 kernel: [68664.594652] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 00:28:10 juju-e4d256-prod-github-runner-207 kernel: [68664.595654] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 00:28:10 juju-e4d256-prod-github-runner-207 kernel: [68664.596602] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 00:28:10 juju-e4d256-prod-github-runner-207 kernel: [68664.597744] handle_exit+0x98/0x230 [kvm_amd] Aug 23 00:28:10 juju-e4d256-prod-github-runner-207 kernel: [68664.598668] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 00:28:10 juju-e4d256-prod-github-runner-207 kernel: [68664.599598] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 00:28:10 juju-e4d256-prod-github-runner-207 kernel: [68664.600535] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 00:28:10 juju-e4d256-prod-github-runner-207 kernel: [68664.601439] vcpu_run+0x62/0x2c0 [kvm] Aug 23 00:28:10 juju-e4d256-prod-github-runner-207 kernel: [68664.602248] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 00:28:10 juju-e4d256-prod-github-runner-207 kernel: [68664.603057] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 00:28:10 juju-e4d256-prod-github-runner-207 kernel: [68664.603919] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 00:28:10 juju-e4d256-prod-github-runner-207 kernel: [68664.604714] ? __seccomp_filter+0x4a/0x4a0 Aug 23 00:28:10 juju-e4d256-prod-github-runner-207 kernel: [68664.605453] ? __fget_files+0x86/0xc0 Aug 23 00:28:10 juju-e4d256-prod-github-runner-207 kernel: [68664.606159] __x64_sys_ioctl+0x95/0xd0 Aug 23 00:28:10 juju-e4d256-prod-github-runner-207 kernel: [68664.606848] do_syscall_64+0x5c/0xc0 Aug 23 00:28:10 juju-e4d256-prod-github-runner-207 kernel: [68664.607508] ? do_futex+0x162/0x1f0 Aug 23 00:28:10 juju-e4d256-prod-github-runner-207 kernel: [68664.608162] ? __x64_sys_futex+0x78/0x1e0 Aug 23 00:28:10 juju-e4d256-prod-github-runner-207 kernel: [68664.608832] ? __secure_computing+0xa9/0x120 Aug 23 00:28:10 juju-e4d256-prod-github-runner-207 kernel: [68664.609518] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 00:28:10 juju-e4d256-prod-github-runner-207 kernel: [68664.610276] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:28:10 juju-e4d256-prod-github-runner-207 kernel: [68664.610994] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:28:10 juju-e4d256-prod-github-runner-207 kernel: [68664.611718] ? do_syscall_64+0x69/0xc0 Aug 23 00:28:10 juju-e4d256-prod-github-runner-207 kernel: [68664.612365] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:28:10 juju-e4d256-prod-github-runner-207 kernel: [68664.613063] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:28:10 juju-e4d256-prod-github-runner-207 kernel: [68664.613754] ? do_syscall_64+0x69/0xc0 Aug 23 00:28:10 juju-e4d256-prod-github-runner-207 kernel: [68664.614376] ? do_syscall_64+0x69/0xc0 Aug 23 00:28:10 juju-e4d256-prod-github-runner-207 kernel: [68664.614999] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 00:28:10 juju-e4d256-prod-github-runner-207 kernel: [68664.615707] RIP: 0033:0x7faa5d0edaff Aug 23 00:28:10 juju-e4d256-prod-github-runner-207 kernel: [68664.616332] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 00:28:10 juju-e4d256-prod-github-runner-207 kernel: [68664.618310] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 00:28:10 juju-e4d256-prod-github-runner-207 kernel: [68664.619215] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 00:28:10 juju-e4d256-prod-github-runner-207 kernel: [68664.620113] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 00:28:10 juju-e4d256-prod-github-runner-207 kernel: [68664.621001] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 00:28:10 juju-e4d256-prod-github-runner-207 kernel: [68664.621885] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 00:28:10 juju-e4d256-prod-github-runner-207 kernel: [68664.622772] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 00:28:10 juju-e4d256-prod-github-runner-207 kernel: [68664.623668] Aug 23 00:28:38 juju-e4d256-prod-github-runner-207 kernel: [68692.541981] watchdog: BUG: soft lockup - CPU#1 stuck for 63866s! [qemu-system-x86:6715] Aug 23 00:28:38 juju-e4d256-prod-github-runner-207 kernel: [68692.543136] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 00:28:38 juju-e4d256-prod-github-runner-207 kernel: [68692.543213] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 00:28:38 juju-e4d256-prod-github-runner-207 kernel: [68692.557060] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 00:28:38 juju-e4d256-prod-github-runner-207 kernel: [68692.558341] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 00:28:38 juju-e4d256-prod-github-runner-207 kernel: [68692.559581] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:28:38 juju-e4d256-prod-github-runner-207 kernel: [68692.560646] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 00:28:38 juju-e4d256-prod-github-runner-207 kernel: [68692.563365] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 00:28:38 juju-e4d256-prod-github-runner-207 kernel: [68692.564444] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 00:28:38 juju-e4d256-prod-github-runner-207 kernel: [68692.565618] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 00:28:38 juju-e4d256-prod-github-runner-207 kernel: [68692.566784] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 00:28:38 juju-e4d256-prod-github-runner-207 kernel: [68692.567972] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 00:28:38 juju-e4d256-prod-github-runner-207 kernel: [68692.569201] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 00:28:38 juju-e4d256-prod-github-runner-207 kernel: [68692.570474] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 00:28:38 juju-e4d256-prod-github-runner-207 kernel: [68692.571738] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 00:28:38 juju-e4d256-prod-github-runner-207 kernel: [68692.572857] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 00:28:38 juju-e4d256-prod-github-runner-207 kernel: [68692.574049] Call Trace: Aug 23 00:28:38 juju-e4d256-prod-github-runner-207 kernel: [68692.574958] Aug 23 00:28:38 juju-e4d256-prod-github-runner-207 kernel: [68692.575866] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:28:38 juju-e4d256-prod-github-runner-207 kernel: [68692.576898] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:28:38 juju-e4d256-prod-github-runner-207 kernel: [68692.577921] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:28:38 juju-e4d256-prod-github-runner-207 kernel: [68692.578995] ? show_regs.part.0+0x23/0x29 Aug 23 00:28:38 juju-e4d256-prod-github-runner-207 kernel: [68692.580006] ? show_regs.cold+0x8/0xd Aug 23 00:28:38 juju-e4d256-prod-github-runner-207 kernel: [68692.580985] ? watchdog_timer_fn+0x1be/0x220 Aug 23 00:28:38 juju-e4d256-prod-github-runner-207 kernel: [68692.581994] ? lockup_detector_update_enable+0x60/0x60 Aug 23 00:28:38 juju-e4d256-prod-github-runner-207 kernel: [68692.583060] ? __hrtimer_run_queues+0x107/0x230 Aug 23 00:28:38 juju-e4d256-prod-github-runner-207 kernel: [68692.584137] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 00:28:38 juju-e4d256-prod-github-runner-207 kernel: [68692.585166] ? hrtimer_interrupt+0x101/0x220 Aug 23 00:28:38 juju-e4d256-prod-github-runner-207 kernel: [68692.586179] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 00:28:38 juju-e4d256-prod-github-runner-207 kernel: [68692.587246] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 00:28:38 juju-e4d256-prod-github-runner-207 kernel: [68692.588313] Aug 23 00:28:38 juju-e4d256-prod-github-runner-207 kernel: [68692.589179] Aug 23 00:28:38 juju-e4d256-prod-github-runner-207 kernel: [68692.590067] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 00:28:38 juju-e4d256-prod-github-runner-207 kernel: [68692.591133] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:28:38 juju-e4d256-prod-github-runner-207 kernel: [68692.592220] ? _raw_spin_lock+0x22/0x30 Aug 23 00:28:38 juju-e4d256-prod-github-runner-207 kernel: [68692.593168] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:28:38 juju-e4d256-prod-github-runner-207 kernel: [68692.594189] direct_page_fault+0x206/0x310 [kvm] Aug 23 00:28:38 juju-e4d256-prod-github-runner-207 kernel: [68692.595217] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 00:28:38 juju-e4d256-prod-github-runner-207 kernel: [68692.596248] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 00:28:38 juju-e4d256-prod-github-runner-207 kernel: [68692.597285] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 00:28:38 juju-e4d256-prod-github-runner-207 kernel: [68692.598293] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 00:28:38 juju-e4d256-prod-github-runner-207 kernel: [68692.599242] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 00:28:38 juju-e4d256-prod-github-runner-207 kernel: [68692.600243] handle_exit+0x98/0x230 [kvm_amd] Aug 23 00:28:38 juju-e4d256-prod-github-runner-207 kernel: [68692.601138] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 00:28:38 juju-e4d256-prod-github-runner-207 kernel: [68692.602067] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 00:28:38 juju-e4d256-prod-github-runner-207 kernel: [68692.603004] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 00:28:38 juju-e4d256-prod-github-runner-207 kernel: [68692.603922] vcpu_run+0x62/0x2c0 [kvm] Aug 23 00:28:38 juju-e4d256-prod-github-runner-207 kernel: [68692.604733] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 00:28:38 juju-e4d256-prod-github-runner-207 kernel: [68692.605540] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 00:28:38 juju-e4d256-prod-github-runner-207 kernel: [68692.606395] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 00:28:38 juju-e4d256-prod-github-runner-207 kernel: [68692.607192] ? __seccomp_filter+0x4a/0x4a0 Aug 23 00:28:38 juju-e4d256-prod-github-runner-207 kernel: [68692.607954] ? __fget_files+0x86/0xc0 Aug 23 00:28:38 juju-e4d256-prod-github-runner-207 kernel: [68692.608659] __x64_sys_ioctl+0x95/0xd0 Aug 23 00:28:38 juju-e4d256-prod-github-runner-207 kernel: [68692.609358] do_syscall_64+0x5c/0xc0 Aug 23 00:28:38 juju-e4d256-prod-github-runner-207 kernel: [68692.610021] ? do_futex+0x162/0x1f0 Aug 23 00:28:38 juju-e4d256-prod-github-runner-207 kernel: [68692.610675] ? __x64_sys_futex+0x78/0x1e0 Aug 23 00:28:38 juju-e4d256-prod-github-runner-207 kernel: [68692.611367] ? __secure_computing+0xa9/0x120 Aug 23 00:28:38 juju-e4d256-prod-github-runner-207 kernel: [68692.612058] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 00:28:38 juju-e4d256-prod-github-runner-207 kernel: [68692.612818] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:28:38 juju-e4d256-prod-github-runner-207 kernel: [68692.613555] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:28:38 juju-e4d256-prod-github-runner-207 kernel: [68692.614282] ? do_syscall_64+0x69/0xc0 Aug 23 00:28:38 juju-e4d256-prod-github-runner-207 kernel: [68692.614927] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:28:38 juju-e4d256-prod-github-runner-207 kernel: [68692.615699] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:28:38 juju-e4d256-prod-github-runner-207 kernel: [68692.616537] ? do_syscall_64+0x69/0xc0 Aug 23 00:28:38 juju-e4d256-prod-github-runner-207 kernel: [68692.617179] ? do_syscall_64+0x69/0xc0 Aug 23 00:28:38 juju-e4d256-prod-github-runner-207 kernel: [68692.617819] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 00:28:38 juju-e4d256-prod-github-runner-207 kernel: [68692.618566] RIP: 0033:0x7faa5d0edaff Aug 23 00:28:38 juju-e4d256-prod-github-runner-207 kernel: [68692.619197] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 00:28:38 juju-e4d256-prod-github-runner-207 kernel: [68692.621214] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 00:28:38 juju-e4d256-prod-github-runner-207 kernel: [68692.622139] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 00:28:38 juju-e4d256-prod-github-runner-207 kernel: [68692.623076] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 00:28:38 juju-e4d256-prod-github-runner-207 kernel: [68692.624011] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 00:28:38 juju-e4d256-prod-github-runner-207 kernel: [68692.624905] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 00:28:38 juju-e4d256-prod-github-runner-207 kernel: [68692.625799] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 00:28:38 juju-e4d256-prod-github-runner-207 kernel: [68692.626714] Aug 23 00:29:06 juju-e4d256-prod-github-runner-207 kernel: [68720.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 63892s! [qemu-system-x86:6715] Aug 23 00:29:06 juju-e4d256-prod-github-runner-207 kernel: [68720.543684] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 00:29:06 juju-e4d256-prod-github-runner-207 kernel: [68720.543913] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 00:29:06 juju-e4d256-prod-github-runner-207 kernel: [68720.556037] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 00:29:06 juju-e4d256-prod-github-runner-207 kernel: [68720.557305] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 00:29:06 juju-e4d256-prod-github-runner-207 kernel: [68720.558521] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:29:06 juju-e4d256-prod-github-runner-207 kernel: [68720.559591] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 00:29:06 juju-e4d256-prod-github-runner-207 kernel: [68720.562158] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 00:29:06 juju-e4d256-prod-github-runner-207 kernel: [68720.563225] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 00:29:06 juju-e4d256-prod-github-runner-207 kernel: [68720.564391] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 00:29:06 juju-e4d256-prod-github-runner-207 kernel: [68720.565556] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 00:29:06 juju-e4d256-prod-github-runner-207 kernel: [68720.566712] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 00:29:06 juju-e4d256-prod-github-runner-207 kernel: [68720.567885] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 00:29:06 juju-e4d256-prod-github-runner-207 kernel: [68720.569048] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 00:29:06 juju-e4d256-prod-github-runner-207 kernel: [68720.570280] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 00:29:06 juju-e4d256-prod-github-runner-207 kernel: [68720.571402] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 00:29:06 juju-e4d256-prod-github-runner-207 kernel: [68720.572596] Call Trace: Aug 23 00:29:06 juju-e4d256-prod-github-runner-207 kernel: [68720.573507] Aug 23 00:29:06 juju-e4d256-prod-github-runner-207 kernel: [68720.574432] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:29:06 juju-e4d256-prod-github-runner-207 kernel: [68720.575492] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:29:06 juju-e4d256-prod-github-runner-207 kernel: [68720.576518] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:29:06 juju-e4d256-prod-github-runner-207 kernel: [68720.577649] ? show_regs.part.0+0x23/0x29 Aug 23 00:29:06 juju-e4d256-prod-github-runner-207 kernel: [68720.578660] ? show_regs.cold+0x8/0xd Aug 23 00:29:06 juju-e4d256-prod-github-runner-207 kernel: [68720.579653] ? watchdog_timer_fn+0x1be/0x220 Aug 23 00:29:06 juju-e4d256-prod-github-runner-207 kernel: [68720.580662] ? lockup_detector_update_enable+0x60/0x60 Aug 23 00:29:06 juju-e4d256-prod-github-runner-207 kernel: [68720.581743] ? __hrtimer_run_queues+0x107/0x230 Aug 23 00:29:06 juju-e4d256-prod-github-runner-207 kernel: [68720.582847] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 00:29:06 juju-e4d256-prod-github-runner-207 kernel: [68720.583982] ? hrtimer_interrupt+0x101/0x220 Aug 23 00:29:06 juju-e4d256-prod-github-runner-207 kernel: [68720.585064] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 00:29:06 juju-e4d256-prod-github-runner-207 kernel: [68720.586177] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 00:29:06 juju-e4d256-prod-github-runner-207 kernel: [68720.587240] Aug 23 00:29:06 juju-e4d256-prod-github-runner-207 kernel: [68720.588095] Aug 23 00:29:06 juju-e4d256-prod-github-runner-207 kernel: [68720.588938] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 00:29:06 juju-e4d256-prod-github-runner-207 kernel: [68720.589977] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:29:06 juju-e4d256-prod-github-runner-207 kernel: [68720.591042] ? _raw_spin_lock+0x22/0x30 Aug 23 00:29:06 juju-e4d256-prod-github-runner-207 kernel: [68720.592000] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:29:06 juju-e4d256-prod-github-runner-207 kernel: [68720.593028] direct_page_fault+0x206/0x310 [kvm] Aug 23 00:29:06 juju-e4d256-prod-github-runner-207 kernel: [68720.594053] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 00:29:06 juju-e4d256-prod-github-runner-207 kernel: [68720.595075] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 00:29:06 juju-e4d256-prod-github-runner-207 kernel: [68720.596082] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 00:29:06 juju-e4d256-prod-github-runner-207 kernel: [68720.597090] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 00:29:06 juju-e4d256-prod-github-runner-207 kernel: [68720.598040] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 00:29:06 juju-e4d256-prod-github-runner-207 kernel: [68720.599027] handle_exit+0x98/0x230 [kvm_amd] Aug 23 00:29:06 juju-e4d256-prod-github-runner-207 kernel: [68720.599921] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 00:29:06 juju-e4d256-prod-github-runner-207 kernel: [68720.600834] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 00:29:06 juju-e4d256-prod-github-runner-207 kernel: [68720.601760] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 00:29:06 juju-e4d256-prod-github-runner-207 kernel: [68720.602664] vcpu_run+0x62/0x2c0 [kvm] Aug 23 00:29:06 juju-e4d256-prod-github-runner-207 kernel: [68720.603480] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 00:29:06 juju-e4d256-prod-github-runner-207 kernel: [68720.604287] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 00:29:06 juju-e4d256-prod-github-runner-207 kernel: [68720.605141] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 00:29:06 juju-e4d256-prod-github-runner-207 kernel: [68720.605939] ? __seccomp_filter+0x4a/0x4a0 Aug 23 00:29:06 juju-e4d256-prod-github-runner-207 kernel: [68720.606696] ? __fget_files+0x86/0xc0 Aug 23 00:29:06 juju-e4d256-prod-github-runner-207 kernel: [68720.607436] __x64_sys_ioctl+0x95/0xd0 Aug 23 00:29:06 juju-e4d256-prod-github-runner-207 kernel: [68720.608181] do_syscall_64+0x5c/0xc0 Aug 23 00:29:06 juju-e4d256-prod-github-runner-207 kernel: [68720.608849] ? do_futex+0x162/0x1f0 Aug 23 00:29:06 juju-e4d256-prod-github-runner-207 kernel: [68720.609498] ? __x64_sys_futex+0x78/0x1e0 Aug 23 00:29:06 juju-e4d256-prod-github-runner-207 kernel: [68720.610170] ? __secure_computing+0xa9/0x120 Aug 23 00:29:06 juju-e4d256-prod-github-runner-207 kernel: [68720.610859] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 00:29:06 juju-e4d256-prod-github-runner-207 kernel: [68720.611635] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:29:06 juju-e4d256-prod-github-runner-207 kernel: [68720.612358] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:29:06 juju-e4d256-prod-github-runner-207 kernel: [68720.613076] ? do_syscall_64+0x69/0xc0 Aug 23 00:29:06 juju-e4d256-prod-github-runner-207 kernel: [68720.613722] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:29:06 juju-e4d256-prod-github-runner-207 kernel: [68720.614423] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:29:06 juju-e4d256-prod-github-runner-207 kernel: [68720.615126] ? do_syscall_64+0x69/0xc0 Aug 23 00:29:06 juju-e4d256-prod-github-runner-207 kernel: [68720.615752] ? do_syscall_64+0x69/0xc0 Aug 23 00:29:06 juju-e4d256-prod-github-runner-207 kernel: [68720.616374] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 00:29:06 juju-e4d256-prod-github-runner-207 kernel: [68720.617129] RIP: 0033:0x7faa5d0edaff Aug 23 00:29:06 juju-e4d256-prod-github-runner-207 kernel: [68720.617843] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 00:29:06 juju-e4d256-prod-github-runner-207 kernel: [68720.620047] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 00:29:06 juju-e4d256-prod-github-runner-207 kernel: [68720.620961] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 00:29:06 juju-e4d256-prod-github-runner-207 kernel: [68720.621857] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 00:29:06 juju-e4d256-prod-github-runner-207 kernel: [68720.622748] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 00:29:06 juju-e4d256-prod-github-runner-207 kernel: [68720.623646] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 00:29:06 juju-e4d256-prod-github-runner-207 kernel: [68720.624536] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 00:29:06 juju-e4d256-prod-github-runner-207 kernel: [68720.625429] Aug 23 00:29:34 juju-e4d256-prod-github-runner-207 kernel: [68748.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 63919s! [qemu-system-x86:6715] Aug 23 00:29:34 juju-e4d256-prod-github-runner-207 kernel: [68748.543081] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 00:29:34 juju-e4d256-prod-github-runner-207 kernel: [68748.543146] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 00:29:34 juju-e4d256-prod-github-runner-207 kernel: [68748.555456] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 00:29:34 juju-e4d256-prod-github-runner-207 kernel: [68748.556730] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 00:29:34 juju-e4d256-prod-github-runner-207 kernel: [68748.557957] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:29:34 juju-e4d256-prod-github-runner-207 kernel: [68748.559024] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 00:29:34 juju-e4d256-prod-github-runner-207 kernel: [68748.561578] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 00:29:34 juju-e4d256-prod-github-runner-207 kernel: [68748.562628] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 00:29:34 juju-e4d256-prod-github-runner-207 kernel: [68748.563801] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 00:29:34 juju-e4d256-prod-github-runner-207 kernel: [68748.564961] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 00:29:34 juju-e4d256-prod-github-runner-207 kernel: [68748.566120] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 00:29:34 juju-e4d256-prod-github-runner-207 kernel: [68748.567297] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 00:29:34 juju-e4d256-prod-github-runner-207 kernel: [68748.568462] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 00:29:34 juju-e4d256-prod-github-runner-207 kernel: [68748.569702] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 00:29:34 juju-e4d256-prod-github-runner-207 kernel: [68748.570811] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 00:29:34 juju-e4d256-prod-github-runner-207 kernel: [68748.572008] Call Trace: Aug 23 00:29:34 juju-e4d256-prod-github-runner-207 kernel: [68748.572920] Aug 23 00:29:34 juju-e4d256-prod-github-runner-207 kernel: [68748.573804] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:29:34 juju-e4d256-prod-github-runner-207 kernel: [68748.574849] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:29:34 juju-e4d256-prod-github-runner-207 kernel: [68748.575871] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:29:34 juju-e4d256-prod-github-runner-207 kernel: [68748.576949] ? show_regs.part.0+0x23/0x29 Aug 23 00:29:34 juju-e4d256-prod-github-runner-207 kernel: [68748.577952] ? show_regs.cold+0x8/0xd Aug 23 00:29:34 juju-e4d256-prod-github-runner-207 kernel: [68748.578933] ? watchdog_timer_fn+0x1be/0x220 Aug 23 00:29:34 juju-e4d256-prod-github-runner-207 kernel: [68748.579943] ? lockup_detector_update_enable+0x60/0x60 Aug 23 00:29:34 juju-e4d256-prod-github-runner-207 kernel: [68748.581011] ? __hrtimer_run_queues+0x107/0x230 Aug 23 00:29:34 juju-e4d256-prod-github-runner-207 kernel: [68748.582043] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 00:29:34 juju-e4d256-prod-github-runner-207 kernel: [68748.583081] ? hrtimer_interrupt+0x101/0x220 Aug 23 00:29:34 juju-e4d256-prod-github-runner-207 kernel: [68748.584099] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 00:29:34 juju-e4d256-prod-github-runner-207 kernel: [68748.585170] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 00:29:34 juju-e4d256-prod-github-runner-207 kernel: [68748.586217] Aug 23 00:29:34 juju-e4d256-prod-github-runner-207 kernel: [68748.587101] Aug 23 00:29:34 juju-e4d256-prod-github-runner-207 kernel: [68748.587942] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 00:29:34 juju-e4d256-prod-github-runner-207 kernel: [68748.588975] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:29:34 juju-e4d256-prod-github-runner-207 kernel: [68748.590018] ? _raw_spin_lock+0x22/0x30 Aug 23 00:29:34 juju-e4d256-prod-github-runner-207 kernel: [68748.590973] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:29:34 juju-e4d256-prod-github-runner-207 kernel: [68748.591998] direct_page_fault+0x206/0x310 [kvm] Aug 23 00:29:34 juju-e4d256-prod-github-runner-207 kernel: [68748.593025] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 00:29:34 juju-e4d256-prod-github-runner-207 kernel: [68748.594032] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 00:29:34 juju-e4d256-prod-github-runner-207 kernel: [68748.595046] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 00:29:34 juju-e4d256-prod-github-runner-207 kernel: [68748.596016] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 00:29:34 juju-e4d256-prod-github-runner-207 kernel: [68748.596966] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 00:29:34 juju-e4d256-prod-github-runner-207 kernel: [68748.597959] handle_exit+0x98/0x230 [kvm_amd] Aug 23 00:29:34 juju-e4d256-prod-github-runner-207 kernel: [68748.598859] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 00:29:34 juju-e4d256-prod-github-runner-207 kernel: [68748.599774] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 00:29:34 juju-e4d256-prod-github-runner-207 kernel: [68748.600698] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 00:29:34 juju-e4d256-prod-github-runner-207 kernel: [68748.601602] vcpu_run+0x62/0x2c0 [kvm] Aug 23 00:29:34 juju-e4d256-prod-github-runner-207 kernel: [68748.602418] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 00:29:34 juju-e4d256-prod-github-runner-207 kernel: [68748.603245] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 00:29:34 juju-e4d256-prod-github-runner-207 kernel: [68748.604100] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 00:29:34 juju-e4d256-prod-github-runner-207 kernel: [68748.604899] ? __seccomp_filter+0x4a/0x4a0 Aug 23 00:29:34 juju-e4d256-prod-github-runner-207 kernel: [68748.605642] ? __fget_files+0x86/0xc0 Aug 23 00:29:34 juju-e4d256-prod-github-runner-207 kernel: [68748.606346] __x64_sys_ioctl+0x95/0xd0 Aug 23 00:29:34 juju-e4d256-prod-github-runner-207 kernel: [68748.607077] do_syscall_64+0x5c/0xc0 Aug 23 00:29:34 juju-e4d256-prod-github-runner-207 kernel: [68748.607757] ? do_futex+0x162/0x1f0 Aug 23 00:29:34 juju-e4d256-prod-github-runner-207 kernel: [68748.608413] ? __x64_sys_futex+0x78/0x1e0 Aug 23 00:29:34 juju-e4d256-prod-github-runner-207 kernel: [68748.609094] ? __secure_computing+0xa9/0x120 Aug 23 00:29:34 juju-e4d256-prod-github-runner-207 kernel: [68748.609791] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 00:29:34 juju-e4d256-prod-github-runner-207 kernel: [68748.610555] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:29:34 juju-e4d256-prod-github-runner-207 kernel: [68748.611296] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:29:34 juju-e4d256-prod-github-runner-207 kernel: [68748.612014] ? do_syscall_64+0x69/0xc0 Aug 23 00:29:34 juju-e4d256-prod-github-runner-207 kernel: [68748.612664] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:29:34 juju-e4d256-prod-github-runner-207 kernel: [68748.613369] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:29:34 juju-e4d256-prod-github-runner-207 kernel: [68748.614065] ? do_syscall_64+0x69/0xc0 Aug 23 00:29:34 juju-e4d256-prod-github-runner-207 kernel: [68748.614701] ? do_syscall_64+0x69/0xc0 Aug 23 00:29:34 juju-e4d256-prod-github-runner-207 kernel: [68748.615326] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 00:29:34 juju-e4d256-prod-github-runner-207 kernel: [68748.616039] RIP: 0033:0x7faa5d0edaff Aug 23 00:29:34 juju-e4d256-prod-github-runner-207 kernel: [68748.616685] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 00:29:34 juju-e4d256-prod-github-runner-207 kernel: [68748.618688] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 00:29:34 juju-e4d256-prod-github-runner-207 kernel: [68748.619597] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 00:29:34 juju-e4d256-prod-github-runner-207 kernel: [68748.620493] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 00:29:34 juju-e4d256-prod-github-runner-207 kernel: [68748.621384] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 00:29:34 juju-e4d256-prod-github-runner-207 kernel: [68748.622278] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 00:29:34 juju-e4d256-prod-github-runner-207 kernel: [68748.623181] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 00:29:34 juju-e4d256-prod-github-runner-207 kernel: [68748.624074] Aug 23 00:29:47 juju-e4d256-prod-github-runner-207 kernel: [68761.772707] rcu: INFO: rcu_sched self-detected stall on CPU Aug 23 00:29:47 juju-e4d256-prod-github-runner-207 kernel: [68761.773672] rcu: 1-....: (17107059 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=8259383 Aug 23 00:29:47 juju-e4d256-prod-github-runner-207 kernel: [68761.774820] (t=17161143 jiffies g=23269 q=59626) Aug 23 00:29:47 juju-e4d256-prod-github-runner-207 kernel: [68761.775609] NMI backtrace for cpu 1 Aug 23 00:29:47 juju-e4d256-prod-github-runner-207 kernel: [68761.776324] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 00:29:47 juju-e4d256-prod-github-runner-207 kernel: [68761.777427] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 00:29:47 juju-e4d256-prod-github-runner-207 kernel: [68761.778485] Call Trace: Aug 23 00:29:47 juju-e4d256-prod-github-runner-207 kernel: [68761.779177] Aug 23 00:29:47 juju-e4d256-prod-github-runner-207 kernel: [68761.779820] show_stack+0x52/0x5c Aug 23 00:29:47 juju-e4d256-prod-github-runner-207 kernel: [68761.780544] dump_stack_lvl+0x4a/0x63 Aug 23 00:29:47 juju-e4d256-prod-github-runner-207 kernel: [68761.781290] dump_stack+0x10/0x16 Aug 23 00:29:47 juju-e4d256-prod-github-runner-207 kernel: [68761.782008] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 23 00:29:47 juju-e4d256-prod-github-runner-207 kernel: [68761.782800] ? lapic_can_unplug_cpu+0x90/0x90 Aug 23 00:29:47 juju-e4d256-prod-github-runner-207 kernel: [68761.783660] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 23 00:29:47 juju-e4d256-prod-github-runner-207 kernel: [68761.784614] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 23 00:29:47 juju-e4d256-prod-github-runner-207 kernel: [68761.785446] trigger_single_cpu_backtrace+0x44/0x4f Aug 23 00:29:47 juju-e4d256-prod-github-runner-207 kernel: [68761.786264] rcu_dump_cpu_stacks+0x102/0x149 Aug 23 00:29:47 juju-e4d256-prod-github-runner-207 kernel: [68761.787046] print_cpu_stall.cold+0x2f/0xe2 Aug 23 00:29:47 juju-e4d256-prod-github-runner-207 kernel: [68761.787811] ? timekeeping_update+0xf7/0x150 Aug 23 00:29:47 juju-e4d256-prod-github-runner-207 kernel: [68761.788581] check_cpu_stall+0x109/0x270 Aug 23 00:29:47 juju-e4d256-prod-github-runner-207 kernel: [68761.789333] rcu_sched_clock_irq+0x9a/0x250 Aug 23 00:29:47 juju-e4d256-prod-github-runner-207 kernel: [68761.790093] update_process_times+0x94/0xd0 Aug 23 00:29:47 juju-e4d256-prod-github-runner-207 kernel: [68761.790866] tick_sched_handle+0x29/0x70 Aug 23 00:29:47 juju-e4d256-prod-github-runner-207 kernel: [68761.791613] tick_sched_timer+0x8c/0xc0 Aug 23 00:29:47 juju-e4d256-prod-github-runner-207 kernel: [68761.792356] ? tick_nohz_handler+0xb0/0xb0 Aug 23 00:29:47 juju-e4d256-prod-github-runner-207 kernel: [68761.793110] __hrtimer_run_queues+0x107/0x230 Aug 23 00:29:47 juju-e4d256-prod-github-runner-207 kernel: [68761.793883] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 00:29:47 juju-e4d256-prod-github-runner-207 kernel: [68761.794672] hrtimer_interrupt+0x101/0x220 Aug 23 00:29:47 juju-e4d256-prod-github-runner-207 kernel: [68761.795432] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 00:29:47 juju-e4d256-prod-github-runner-207 kernel: [68761.796249] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 00:29:47 juju-e4d256-prod-github-runner-207 kernel: [68761.797049] Aug 23 00:29:47 juju-e4d256-prod-github-runner-207 kernel: [68761.797685] Aug 23 00:29:47 juju-e4d256-prod-github-runner-207 kernel: [68761.798312] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 00:29:47 juju-e4d256-prod-github-runner-207 kernel: [68761.799145] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:29:47 juju-e4d256-prod-github-runner-207 kernel: [68761.800022] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 00:29:47 juju-e4d256-prod-github-runner-207 kernel: [68761.802423] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 00:29:47 juju-e4d256-prod-github-runner-207 kernel: [68761.803334] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 00:29:47 juju-e4d256-prod-github-runner-207 kernel: [68761.804329] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 00:29:47 juju-e4d256-prod-github-runner-207 kernel: [68761.805311] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 00:29:47 juju-e4d256-prod-github-runner-207 kernel: [68761.806275] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 00:29:47 juju-e4d256-prod-github-runner-207 kernel: [68761.807245] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 00:29:47 juju-e4d256-prod-github-runner-207 kernel: [68761.808206] ? _raw_spin_lock+0x22/0x30 Aug 23 00:29:47 juju-e4d256-prod-github-runner-207 kernel: [68761.808972] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:29:47 juju-e4d256-prod-github-runner-207 kernel: [68761.809939] direct_page_fault+0x206/0x310 [kvm] Aug 23 00:29:47 juju-e4d256-prod-github-runner-207 kernel: [68761.810889] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 00:29:47 juju-e4d256-prod-github-runner-207 kernel: [68761.811808] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 00:29:47 juju-e4d256-prod-github-runner-207 kernel: [68761.812720] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 00:29:47 juju-e4d256-prod-github-runner-207 kernel: [68761.813621] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 00:29:47 juju-e4d256-prod-github-runner-207 kernel: [68761.814494] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 00:29:47 juju-e4d256-prod-github-runner-207 kernel: [68761.815499] handle_exit+0x98/0x230 [kvm_amd] Aug 23 00:29:47 juju-e4d256-prod-github-runner-207 kernel: [68761.816341] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 00:29:47 juju-e4d256-prod-github-runner-207 kernel: [68761.817219] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 00:29:47 juju-e4d256-prod-github-runner-207 kernel: [68761.818110] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 00:29:47 juju-e4d256-prod-github-runner-207 kernel: [68761.819025] vcpu_run+0x62/0x2c0 [kvm] Aug 23 00:29:47 juju-e4d256-prod-github-runner-207 kernel: [68761.819816] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 00:29:47 juju-e4d256-prod-github-runner-207 kernel: [68761.820631] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 00:29:47 juju-e4d256-prod-github-runner-207 kernel: [68761.821530] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 00:29:47 juju-e4d256-prod-github-runner-207 kernel: [68761.822375] ? __seccomp_filter+0x4a/0x4a0 Aug 23 00:29:47 juju-e4d256-prod-github-runner-207 kernel: [68761.823209] ? __fget_files+0x86/0xc0 Aug 23 00:29:47 juju-e4d256-prod-github-runner-207 kernel: [68761.823977] __x64_sys_ioctl+0x95/0xd0 Aug 23 00:29:47 juju-e4d256-prod-github-runner-207 kernel: [68761.824745] do_syscall_64+0x5c/0xc0 Aug 23 00:29:47 juju-e4d256-prod-github-runner-207 kernel: [68761.825502] ? do_futex+0x162/0x1f0 Aug 23 00:29:47 juju-e4d256-prod-github-runner-207 kernel: [68761.826244] ? __x64_sys_futex+0x78/0x1e0 Aug 23 00:29:47 juju-e4d256-prod-github-runner-207 kernel: [68761.827038] ? __secure_computing+0xa9/0x120 Aug 23 00:29:47 juju-e4d256-prod-github-runner-207 kernel: [68761.827840] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 00:29:47 juju-e4d256-prod-github-runner-207 kernel: [68761.828734] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:29:47 juju-e4d256-prod-github-runner-207 kernel: [68761.829582] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:29:47 juju-e4d256-prod-github-runner-207 kernel: [68761.830436] ? do_syscall_64+0x69/0xc0 Aug 23 00:29:47 juju-e4d256-prod-github-runner-207 kernel: [68761.831216] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:29:47 juju-e4d256-prod-github-runner-207 kernel: [68761.832069] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:29:47 juju-e4d256-prod-github-runner-207 kernel: [68761.832927] ? do_syscall_64+0x69/0xc0 Aug 23 00:29:47 juju-e4d256-prod-github-runner-207 kernel: [68761.833694] ? do_syscall_64+0x69/0xc0 Aug 23 00:29:47 juju-e4d256-prod-github-runner-207 kernel: [68761.834455] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 00:29:47 juju-e4d256-prod-github-runner-207 kernel: [68761.835362] RIP: 0033:0x7faa5d0edaff Aug 23 00:29:47 juju-e4d256-prod-github-runner-207 kernel: [68761.836144] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 00:29:47 juju-e4d256-prod-github-runner-207 kernel: [68761.838588] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 00:29:47 juju-e4d256-prod-github-runner-207 kernel: [68761.839693] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 00:29:47 juju-e4d256-prod-github-runner-207 kernel: [68761.840772] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 00:29:47 juju-e4d256-prod-github-runner-207 kernel: [68761.841846] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 00:29:47 juju-e4d256-prod-github-runner-207 kernel: [68761.842937] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 00:29:47 juju-e4d256-prod-github-runner-207 kernel: [68761.843995] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 00:29:47 juju-e4d256-prod-github-runner-207 kernel: [68761.845036] Aug 23 00:30:14 juju-e4d256-prod-github-runner-207 kernel: [68788.541980] watchdog: BUG: soft lockup - CPU#1 stuck for 63956s! [qemu-system-x86:6715] Aug 23 00:30:14 juju-e4d256-prod-github-runner-207 kernel: [68788.543113] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 00:30:14 juju-e4d256-prod-github-runner-207 kernel: [68788.543181] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 00:30:14 juju-e4d256-prod-github-runner-207 kernel: [68788.555310] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 00:30:14 juju-e4d256-prod-github-runner-207 kernel: [68788.556578] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 00:30:14 juju-e4d256-prod-github-runner-207 kernel: [68788.557818] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:30:14 juju-e4d256-prod-github-runner-207 kernel: [68788.558891] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 00:30:14 juju-e4d256-prod-github-runner-207 kernel: [68788.561444] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 00:30:14 juju-e4d256-prod-github-runner-207 kernel: [68788.562499] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 00:30:14 juju-e4d256-prod-github-runner-207 kernel: [68788.563657] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 00:30:14 juju-e4d256-prod-github-runner-207 kernel: [68788.564815] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 00:30:14 juju-e4d256-prod-github-runner-207 kernel: [68788.565985] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 00:30:14 juju-e4d256-prod-github-runner-207 kernel: [68788.567172] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 00:30:14 juju-e4d256-prod-github-runner-207 kernel: [68788.568340] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 00:30:14 juju-e4d256-prod-github-runner-207 kernel: [68788.569725] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 00:30:14 juju-e4d256-prod-github-runner-207 kernel: [68788.571111] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 00:30:14 juju-e4d256-prod-github-runner-207 kernel: [68788.572322] Call Trace: Aug 23 00:30:14 juju-e4d256-prod-github-runner-207 kernel: [68788.573234] Aug 23 00:30:14 juju-e4d256-prod-github-runner-207 kernel: [68788.574118] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:30:14 juju-e4d256-prod-github-runner-207 kernel: [68788.575176] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:30:14 juju-e4d256-prod-github-runner-207 kernel: [68788.576205] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:30:14 juju-e4d256-prod-github-runner-207 kernel: [68788.577298] ? show_regs.part.0+0x23/0x29 Aug 23 00:30:14 juju-e4d256-prod-github-runner-207 kernel: [68788.578316] ? show_regs.cold+0x8/0xd Aug 23 00:30:14 juju-e4d256-prod-github-runner-207 kernel: [68788.579298] ? watchdog_timer_fn+0x1be/0x220 Aug 23 00:30:14 juju-e4d256-prod-github-runner-207 kernel: [68788.580312] ? lockup_detector_update_enable+0x60/0x60 Aug 23 00:30:14 juju-e4d256-prod-github-runner-207 kernel: [68788.581379] ? __hrtimer_run_queues+0x107/0x230 Aug 23 00:30:14 juju-e4d256-prod-github-runner-207 kernel: [68788.582418] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 00:30:14 juju-e4d256-prod-github-runner-207 kernel: [68788.583442] ? hrtimer_interrupt+0x101/0x220 Aug 23 00:30:14 juju-e4d256-prod-github-runner-207 kernel: [68788.584464] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 00:30:14 juju-e4d256-prod-github-runner-207 kernel: [68788.585539] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 00:30:14 juju-e4d256-prod-github-runner-207 kernel: [68788.586598] Aug 23 00:30:14 juju-e4d256-prod-github-runner-207 kernel: [68788.587635] Aug 23 00:30:14 juju-e4d256-prod-github-runner-207 kernel: [68788.588657] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 00:30:14 juju-e4d256-prod-github-runner-207 kernel: [68788.589693] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:30:14 juju-e4d256-prod-github-runner-207 kernel: [68788.590752] ? _raw_spin_lock+0x22/0x30 Aug 23 00:30:14 juju-e4d256-prod-github-runner-207 kernel: [68788.591703] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:30:14 juju-e4d256-prod-github-runner-207 kernel: [68788.592719] direct_page_fault+0x206/0x310 [kvm] Aug 23 00:30:14 juju-e4d256-prod-github-runner-207 kernel: [68788.593748] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 00:30:14 juju-e4d256-prod-github-runner-207 kernel: [68788.594777] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 00:30:14 juju-e4d256-prod-github-runner-207 kernel: [68788.595784] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 00:30:14 juju-e4d256-prod-github-runner-207 kernel: [68788.596757] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 00:30:14 juju-e4d256-prod-github-runner-207 kernel: [68788.597702] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 00:30:14 juju-e4d256-prod-github-runner-207 kernel: [68788.598692] handle_exit+0x98/0x230 [kvm_amd] Aug 23 00:30:14 juju-e4d256-prod-github-runner-207 kernel: [68788.599585] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 00:30:14 juju-e4d256-prod-github-runner-207 kernel: [68788.600504] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 00:30:14 juju-e4d256-prod-github-runner-207 kernel: [68788.601481] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 00:30:14 juju-e4d256-prod-github-runner-207 kernel: [68788.602408] vcpu_run+0x62/0x2c0 [kvm] Aug 23 00:30:14 juju-e4d256-prod-github-runner-207 kernel: [68788.603222] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 00:30:14 juju-e4d256-prod-github-runner-207 kernel: [68788.604032] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 00:30:14 juju-e4d256-prod-github-runner-207 kernel: [68788.604896] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 00:30:14 juju-e4d256-prod-github-runner-207 kernel: [68788.605741] ? __seccomp_filter+0x4a/0x4a0 Aug 23 00:30:14 juju-e4d256-prod-github-runner-207 kernel: [68788.606523] ? __fget_files+0x86/0xc0 Aug 23 00:30:14 juju-e4d256-prod-github-runner-207 kernel: [68788.607237] __x64_sys_ioctl+0x95/0xd0 Aug 23 00:30:14 juju-e4d256-prod-github-runner-207 kernel: [68788.607937] do_syscall_64+0x5c/0xc0 Aug 23 00:30:14 juju-e4d256-prod-github-runner-207 kernel: [68788.608605] ? do_futex+0x162/0x1f0 Aug 23 00:30:14 juju-e4d256-prod-github-runner-207 kernel: [68788.609260] ? __x64_sys_futex+0x78/0x1e0 Aug 23 00:30:14 juju-e4d256-prod-github-runner-207 kernel: [68788.609937] ? __secure_computing+0xa9/0x120 Aug 23 00:30:14 juju-e4d256-prod-github-runner-207 kernel: [68788.610652] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 00:30:14 juju-e4d256-prod-github-runner-207 kernel: [68788.611422] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:30:14 juju-e4d256-prod-github-runner-207 kernel: [68788.612147] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:30:14 juju-e4d256-prod-github-runner-207 kernel: [68788.612876] ? do_syscall_64+0x69/0xc0 Aug 23 00:30:14 juju-e4d256-prod-github-runner-207 kernel: [68788.613526] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:30:14 juju-e4d256-prod-github-runner-207 kernel: [68788.614251] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:30:14 juju-e4d256-prod-github-runner-207 kernel: [68788.614951] ? do_syscall_64+0x69/0xc0 Aug 23 00:30:14 juju-e4d256-prod-github-runner-207 kernel: [68788.615586] ? do_syscall_64+0x69/0xc0 Aug 23 00:30:14 juju-e4d256-prod-github-runner-207 kernel: [68788.616248] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 00:30:14 juju-e4d256-prod-github-runner-207 kernel: [68788.616978] RIP: 0033:0x7faa5d0edaff Aug 23 00:30:14 juju-e4d256-prod-github-runner-207 kernel: [68788.617632] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 00:30:14 juju-e4d256-prod-github-runner-207 kernel: [68788.619818] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 00:30:14 juju-e4d256-prod-github-runner-207 kernel: [68788.620736] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 00:30:14 juju-e4d256-prod-github-runner-207 kernel: [68788.621625] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 00:30:14 juju-e4d256-prod-github-runner-207 kernel: [68788.622536] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 00:30:14 juju-e4d256-prod-github-runner-207 kernel: [68788.623431] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 00:30:14 juju-e4d256-prod-github-runner-207 kernel: [68788.624322] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 00:30:14 juju-e4d256-prod-github-runner-207 kernel: [68788.625221] Aug 23 00:30:42 juju-e4d256-prod-github-runner-207 kernel: [68816.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 63982s! [qemu-system-x86:6715] Aug 23 00:30:42 juju-e4d256-prod-github-runner-207 kernel: [68816.543759] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 00:30:42 juju-e4d256-prod-github-runner-207 kernel: [68816.544018] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 00:30:42 juju-e4d256-prod-github-runner-207 kernel: [68816.556297] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 00:30:42 juju-e4d256-prod-github-runner-207 kernel: [68816.557580] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 00:30:42 juju-e4d256-prod-github-runner-207 kernel: [68816.558811] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:30:42 juju-e4d256-prod-github-runner-207 kernel: [68816.559865] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 00:30:42 juju-e4d256-prod-github-runner-207 kernel: [68816.562429] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 00:30:42 juju-e4d256-prod-github-runner-207 kernel: [68816.563473] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 00:30:42 juju-e4d256-prod-github-runner-207 kernel: [68816.564636] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 00:30:42 juju-e4d256-prod-github-runner-207 kernel: [68816.565799] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 00:30:42 juju-e4d256-prod-github-runner-207 kernel: [68816.566971] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 00:30:42 juju-e4d256-prod-github-runner-207 kernel: [68816.568142] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 00:30:42 juju-e4d256-prod-github-runner-207 kernel: [68816.569303] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 00:30:42 juju-e4d256-prod-github-runner-207 kernel: [68816.570549] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 00:30:42 juju-e4d256-prod-github-runner-207 kernel: [68816.571649] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 00:30:42 juju-e4d256-prod-github-runner-207 kernel: [68816.572848] Call Trace: Aug 23 00:30:42 juju-e4d256-prod-github-runner-207 kernel: [68816.573761] Aug 23 00:30:42 juju-e4d256-prod-github-runner-207 kernel: [68816.574666] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:30:42 juju-e4d256-prod-github-runner-207 kernel: [68816.575700] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:30:42 juju-e4d256-prod-github-runner-207 kernel: [68816.576719] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:30:42 juju-e4d256-prod-github-runner-207 kernel: [68816.577818] ? show_regs.part.0+0x23/0x29 Aug 23 00:30:42 juju-e4d256-prod-github-runner-207 kernel: [68816.578831] ? show_regs.cold+0x8/0xd Aug 23 00:30:42 juju-e4d256-prod-github-runner-207 kernel: [68816.579807] ? watchdog_timer_fn+0x1be/0x220 Aug 23 00:30:42 juju-e4d256-prod-github-runner-207 kernel: [68816.580819] ? lockup_detector_update_enable+0x60/0x60 Aug 23 00:30:42 juju-e4d256-prod-github-runner-207 kernel: [68816.581904] ? __hrtimer_run_queues+0x107/0x230 Aug 23 00:30:42 juju-e4d256-prod-github-runner-207 kernel: [68816.582944] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 00:30:42 juju-e4d256-prod-github-runner-207 kernel: [68816.583971] ? hrtimer_interrupt+0x101/0x220 Aug 23 00:30:42 juju-e4d256-prod-github-runner-207 kernel: [68816.584991] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 00:30:42 juju-e4d256-prod-github-runner-207 kernel: [68816.586076] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 00:30:42 juju-e4d256-prod-github-runner-207 kernel: [68816.587121] Aug 23 00:30:42 juju-e4d256-prod-github-runner-207 kernel: [68816.587983] Aug 23 00:30:42 juju-e4d256-prod-github-runner-207 kernel: [68816.588821] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 00:30:42 juju-e4d256-prod-github-runner-207 kernel: [68816.589852] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:30:42 juju-e4d256-prod-github-runner-207 kernel: [68816.590913] ? _raw_spin_lock+0x22/0x30 Aug 23 00:30:42 juju-e4d256-prod-github-runner-207 kernel: [68816.591857] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:30:42 juju-e4d256-prod-github-runner-207 kernel: [68816.592871] direct_page_fault+0x206/0x310 [kvm] Aug 23 00:30:42 juju-e4d256-prod-github-runner-207 kernel: [68816.593923] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 00:30:42 juju-e4d256-prod-github-runner-207 kernel: [68816.594931] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 00:30:42 juju-e4d256-prod-github-runner-207 kernel: [68816.595930] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 00:30:42 juju-e4d256-prod-github-runner-207 kernel: [68816.596925] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 00:30:42 juju-e4d256-prod-github-runner-207 kernel: [68816.597890] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 00:30:42 juju-e4d256-prod-github-runner-207 kernel: [68816.598877] handle_exit+0x98/0x230 [kvm_amd] Aug 23 00:30:42 juju-e4d256-prod-github-runner-207 kernel: [68816.599768] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 00:30:42 juju-e4d256-prod-github-runner-207 kernel: [68816.600682] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 00:30:42 juju-e4d256-prod-github-runner-207 kernel: [68816.601606] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 00:30:42 juju-e4d256-prod-github-runner-207 kernel: [68816.602529] vcpu_run+0x62/0x2c0 [kvm] Aug 23 00:30:42 juju-e4d256-prod-github-runner-207 kernel: [68816.603342] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 00:30:42 juju-e4d256-prod-github-runner-207 kernel: [68816.604153] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 00:30:42 juju-e4d256-prod-github-runner-207 kernel: [68816.605005] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 00:30:42 juju-e4d256-prod-github-runner-207 kernel: [68816.605801] ? __seccomp_filter+0x4a/0x4a0 Aug 23 00:30:42 juju-e4d256-prod-github-runner-207 kernel: [68816.606556] ? __fget_files+0x86/0xc0 Aug 23 00:30:42 juju-e4d256-prod-github-runner-207 kernel: [68816.607258] __x64_sys_ioctl+0x95/0xd0 Aug 23 00:30:42 juju-e4d256-prod-github-runner-207 kernel: [68816.607952] do_syscall_64+0x5c/0xc0 Aug 23 00:30:42 juju-e4d256-prod-github-runner-207 kernel: [68816.608624] ? do_futex+0x162/0x1f0 Aug 23 00:30:42 juju-e4d256-prod-github-runner-207 kernel: [68816.609274] ? __x64_sys_futex+0x78/0x1e0 Aug 23 00:30:42 juju-e4d256-prod-github-runner-207 kernel: [68816.609962] ? __secure_computing+0xa9/0x120 Aug 23 00:30:42 juju-e4d256-prod-github-runner-207 kernel: [68816.610651] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 00:30:42 juju-e4d256-prod-github-runner-207 kernel: [68816.611410] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:30:42 juju-e4d256-prod-github-runner-207 kernel: [68816.612130] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:30:42 juju-e4d256-prod-github-runner-207 kernel: [68816.612846] ? do_syscall_64+0x69/0xc0 Aug 23 00:30:42 juju-e4d256-prod-github-runner-207 kernel: [68816.613490] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:30:42 juju-e4d256-prod-github-runner-207 kernel: [68816.614215] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:30:42 juju-e4d256-prod-github-runner-207 kernel: [68816.614910] ? do_syscall_64+0x69/0xc0 Aug 23 00:30:42 juju-e4d256-prod-github-runner-207 kernel: [68816.615532] ? do_syscall_64+0x69/0xc0 Aug 23 00:30:42 juju-e4d256-prod-github-runner-207 kernel: [68816.616153] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 00:30:42 juju-e4d256-prod-github-runner-207 kernel: [68816.616856] RIP: 0033:0x7faa5d0edaff Aug 23 00:30:42 juju-e4d256-prod-github-runner-207 kernel: [68816.617503] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 00:30:42 juju-e4d256-prod-github-runner-207 kernel: [68816.619505] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 00:30:42 juju-e4d256-prod-github-runner-207 kernel: [68816.620416] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 00:30:42 juju-e4d256-prod-github-runner-207 kernel: [68816.621304] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 00:30:42 juju-e4d256-prod-github-runner-207 kernel: [68816.622207] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 00:30:42 juju-e4d256-prod-github-runner-207 kernel: [68816.623093] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 00:30:42 juju-e4d256-prod-github-runner-207 kernel: [68816.623980] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 00:30:42 juju-e4d256-prod-github-runner-207 kernel: [68816.624886] Aug 23 00:31:10 juju-e4d256-prod-github-runner-207 kernel: [68844.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 64008s! [qemu-system-x86:6715] Aug 23 00:31:10 juju-e4d256-prod-github-runner-207 kernel: [68844.543095] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 00:31:10 juju-e4d256-prod-github-runner-207 kernel: [68844.543162] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 00:31:10 juju-e4d256-prod-github-runner-207 kernel: [68844.555237] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 00:31:10 juju-e4d256-prod-github-runner-207 kernel: [68844.556495] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 00:31:10 juju-e4d256-prod-github-runner-207 kernel: [68844.557725] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:31:10 juju-e4d256-prod-github-runner-207 kernel: [68844.558784] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 00:31:10 juju-e4d256-prod-github-runner-207 kernel: [68844.561315] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 00:31:10 juju-e4d256-prod-github-runner-207 kernel: [68844.562362] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 00:31:10 juju-e4d256-prod-github-runner-207 kernel: [68844.563522] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 00:31:10 juju-e4d256-prod-github-runner-207 kernel: [68844.564677] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 00:31:10 juju-e4d256-prod-github-runner-207 kernel: [68844.565856] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 00:31:10 juju-e4d256-prod-github-runner-207 kernel: [68844.567019] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 00:31:10 juju-e4d256-prod-github-runner-207 kernel: [68844.568391] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 00:31:10 juju-e4d256-prod-github-runner-207 kernel: [68844.569642] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 00:31:10 juju-e4d256-prod-github-runner-207 kernel: [68844.570773] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 00:31:10 juju-e4d256-prod-github-runner-207 kernel: [68844.571980] Call Trace: Aug 23 00:31:10 juju-e4d256-prod-github-runner-207 kernel: [68844.572896] Aug 23 00:31:10 juju-e4d256-prod-github-runner-207 kernel: [68844.573795] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:31:10 juju-e4d256-prod-github-runner-207 kernel: [68844.574823] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:31:10 juju-e4d256-prod-github-runner-207 kernel: [68844.575846] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:31:10 juju-e4d256-prod-github-runner-207 kernel: [68844.576921] ? show_regs.part.0+0x23/0x29 Aug 23 00:31:10 juju-e4d256-prod-github-runner-207 kernel: [68844.577930] ? show_regs.cold+0x8/0xd Aug 23 00:31:10 juju-e4d256-prod-github-runner-207 kernel: [68844.578901] ? watchdog_timer_fn+0x1be/0x220 Aug 23 00:31:10 juju-e4d256-prod-github-runner-207 kernel: [68844.579913] ? lockup_detector_update_enable+0x60/0x60 Aug 23 00:31:10 juju-e4d256-prod-github-runner-207 kernel: [68844.580975] ? __hrtimer_run_queues+0x107/0x230 Aug 23 00:31:10 juju-e4d256-prod-github-runner-207 kernel: [68844.582013] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 00:31:10 juju-e4d256-prod-github-runner-207 kernel: [68844.583036] ? hrtimer_interrupt+0x101/0x220 Aug 23 00:31:10 juju-e4d256-prod-github-runner-207 kernel: [68844.584054] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 00:31:10 juju-e4d256-prod-github-runner-207 kernel: [68844.585126] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 00:31:10 juju-e4d256-prod-github-runner-207 kernel: [68844.586180] Aug 23 00:31:10 juju-e4d256-prod-github-runner-207 kernel: [68844.587032] Aug 23 00:31:10 juju-e4d256-prod-github-runner-207 kernel: [68844.587868] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 00:31:10 juju-e4d256-prod-github-runner-207 kernel: [68844.588898] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:31:10 juju-e4d256-prod-github-runner-207 kernel: [68844.589942] ? _raw_spin_lock+0x22/0x30 Aug 23 00:31:10 juju-e4d256-prod-github-runner-207 kernel: [68844.590883] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:31:10 juju-e4d256-prod-github-runner-207 kernel: [68844.591894] direct_page_fault+0x206/0x310 [kvm] Aug 23 00:31:10 juju-e4d256-prod-github-runner-207 kernel: [68844.592914] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 00:31:10 juju-e4d256-prod-github-runner-207 kernel: [68844.593940] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 00:31:10 juju-e4d256-prod-github-runner-207 kernel: [68844.594956] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 00:31:10 juju-e4d256-prod-github-runner-207 kernel: [68844.595922] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 00:31:10 juju-e4d256-prod-github-runner-207 kernel: [68844.596862] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 00:31:10 juju-e4d256-prod-github-runner-207 kernel: [68844.597899] handle_exit+0x98/0x230 [kvm_amd] Aug 23 00:31:10 juju-e4d256-prod-github-runner-207 kernel: [68844.598812] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 00:31:10 juju-e4d256-prod-github-runner-207 kernel: [68844.599731] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 00:31:10 juju-e4d256-prod-github-runner-207 kernel: [68844.600716] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 00:31:10 juju-e4d256-prod-github-runner-207 kernel: [68844.601645] vcpu_run+0x62/0x2c0 [kvm] Aug 23 00:31:10 juju-e4d256-prod-github-runner-207 kernel: [68844.602456] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 00:31:10 juju-e4d256-prod-github-runner-207 kernel: [68844.603262] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 00:31:10 juju-e4d256-prod-github-runner-207 kernel: [68844.604122] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 00:31:10 juju-e4d256-prod-github-runner-207 kernel: [68844.604919] ? __seccomp_filter+0x4a/0x4a0 Aug 23 00:31:10 juju-e4d256-prod-github-runner-207 kernel: [68844.605673] ? __fget_files+0x86/0xc0 Aug 23 00:31:10 juju-e4d256-prod-github-runner-207 kernel: [68844.606381] __x64_sys_ioctl+0x95/0xd0 Aug 23 00:31:10 juju-e4d256-prod-github-runner-207 kernel: [68844.607072] do_syscall_64+0x5c/0xc0 Aug 23 00:31:10 juju-e4d256-prod-github-runner-207 kernel: [68844.607738] ? do_futex+0x162/0x1f0 Aug 23 00:31:10 juju-e4d256-prod-github-runner-207 kernel: [68844.608387] ? __x64_sys_futex+0x78/0x1e0 Aug 23 00:31:10 juju-e4d256-prod-github-runner-207 kernel: [68844.609062] ? __secure_computing+0xa9/0x120 Aug 23 00:31:10 juju-e4d256-prod-github-runner-207 kernel: [68844.609761] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 00:31:10 juju-e4d256-prod-github-runner-207 kernel: [68844.610519] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:31:10 juju-e4d256-prod-github-runner-207 kernel: [68844.611238] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:31:10 juju-e4d256-prod-github-runner-207 kernel: [68844.611955] ? do_syscall_64+0x69/0xc0 Aug 23 00:31:10 juju-e4d256-prod-github-runner-207 kernel: [68844.612598] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:31:10 juju-e4d256-prod-github-runner-207 kernel: [68844.613299] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:31:10 juju-e4d256-prod-github-runner-207 kernel: [68844.614009] ? do_syscall_64+0x69/0xc0 Aug 23 00:31:10 juju-e4d256-prod-github-runner-207 kernel: [68844.614641] ? do_syscall_64+0x69/0xc0 Aug 23 00:31:10 juju-e4d256-prod-github-runner-207 kernel: [68844.615261] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 00:31:10 juju-e4d256-prod-github-runner-207 kernel: [68844.615960] RIP: 0033:0x7faa5d0edaff Aug 23 00:31:10 juju-e4d256-prod-github-runner-207 kernel: [68844.616579] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 00:31:10 juju-e4d256-prod-github-runner-207 kernel: [68844.618564] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 00:31:10 juju-e4d256-prod-github-runner-207 kernel: [68844.619472] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 00:31:10 juju-e4d256-prod-github-runner-207 kernel: [68844.620360] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 00:31:10 juju-e4d256-prod-github-runner-207 kernel: [68844.621244] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 00:31:10 juju-e4d256-prod-github-runner-207 kernel: [68844.622137] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 00:31:10 juju-e4d256-prod-github-runner-207 kernel: [68844.623020] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 00:31:10 juju-e4d256-prod-github-runner-207 kernel: [68844.623905] Aug 23 00:31:38 juju-e4d256-prod-github-runner-207 kernel: [68872.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 64034s! [qemu-system-x86:6715] Aug 23 00:31:38 juju-e4d256-prod-github-runner-207 kernel: [68872.543119] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 00:31:38 juju-e4d256-prod-github-runner-207 kernel: [68872.543187] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 00:31:38 juju-e4d256-prod-github-runner-207 kernel: [68872.555471] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 00:31:38 juju-e4d256-prod-github-runner-207 kernel: [68872.556742] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 00:31:38 juju-e4d256-prod-github-runner-207 kernel: [68872.557972] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:31:38 juju-e4d256-prod-github-runner-207 kernel: [68872.559036] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 00:31:38 juju-e4d256-prod-github-runner-207 kernel: [68872.561593] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 00:31:38 juju-e4d256-prod-github-runner-207 kernel: [68872.562641] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 00:31:38 juju-e4d256-prod-github-runner-207 kernel: [68872.563801] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 00:31:38 juju-e4d256-prod-github-runner-207 kernel: [68872.564963] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 00:31:38 juju-e4d256-prod-github-runner-207 kernel: [68872.566128] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 00:31:38 juju-e4d256-prod-github-runner-207 kernel: [68872.567289] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 00:31:38 juju-e4d256-prod-github-runner-207 kernel: [68872.568459] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 00:31:38 juju-e4d256-prod-github-runner-207 kernel: [68872.569704] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 00:31:38 juju-e4d256-prod-github-runner-207 kernel: [68872.570806] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 00:31:38 juju-e4d256-prod-github-runner-207 kernel: [68872.572004] Call Trace: Aug 23 00:31:38 juju-e4d256-prod-github-runner-207 kernel: [68872.572915] Aug 23 00:31:38 juju-e4d256-prod-github-runner-207 kernel: [68872.573804] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:31:38 juju-e4d256-prod-github-runner-207 kernel: [68872.574834] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:31:38 juju-e4d256-prod-github-runner-207 kernel: [68872.575852] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:31:38 juju-e4d256-prod-github-runner-207 kernel: [68872.576924] ? show_regs.part.0+0x23/0x29 Aug 23 00:31:38 juju-e4d256-prod-github-runner-207 kernel: [68872.577938] ? show_regs.cold+0x8/0xd Aug 23 00:31:38 juju-e4d256-prod-github-runner-207 kernel: [68872.578923] ? watchdog_timer_fn+0x1be/0x220 Aug 23 00:31:38 juju-e4d256-prod-github-runner-207 kernel: [68872.579930] ? lockup_detector_update_enable+0x60/0x60 Aug 23 00:31:38 juju-e4d256-prod-github-runner-207 kernel: [68872.580991] ? __hrtimer_run_queues+0x107/0x230 Aug 23 00:31:38 juju-e4d256-prod-github-runner-207 kernel: [68872.582027] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 00:31:38 juju-e4d256-prod-github-runner-207 kernel: [68872.583049] ? hrtimer_interrupt+0x101/0x220 Aug 23 00:31:38 juju-e4d256-prod-github-runner-207 kernel: [68872.584068] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 00:31:38 juju-e4d256-prod-github-runner-207 kernel: [68872.585136] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 00:31:38 juju-e4d256-prod-github-runner-207 kernel: [68872.586189] Aug 23 00:31:38 juju-e4d256-prod-github-runner-207 kernel: [68872.587046] Aug 23 00:31:38 juju-e4d256-prod-github-runner-207 kernel: [68872.587881] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 00:31:38 juju-e4d256-prod-github-runner-207 kernel: [68872.588911] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:31:38 juju-e4d256-prod-github-runner-207 kernel: [68872.589958] ? _raw_spin_lock+0x22/0x30 Aug 23 00:31:38 juju-e4d256-prod-github-runner-207 kernel: [68872.590908] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:31:38 juju-e4d256-prod-github-runner-207 kernel: [68872.591926] direct_page_fault+0x206/0x310 [kvm] Aug 23 00:31:38 juju-e4d256-prod-github-runner-207 kernel: [68872.592947] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 00:31:38 juju-e4d256-prod-github-runner-207 kernel: [68872.593965] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 00:31:38 juju-e4d256-prod-github-runner-207 kernel: [68872.594965] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 00:31:38 juju-e4d256-prod-github-runner-207 kernel: [68872.595934] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 00:31:38 juju-e4d256-prod-github-runner-207 kernel: [68872.596882] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 00:31:38 juju-e4d256-prod-github-runner-207 kernel: [68872.597865] handle_exit+0x98/0x230 [kvm_amd] Aug 23 00:31:38 juju-e4d256-prod-github-runner-207 kernel: [68872.598755] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 00:31:38 juju-e4d256-prod-github-runner-207 kernel: [68872.599666] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 00:31:38 juju-e4d256-prod-github-runner-207 kernel: [68872.600598] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 00:31:38 juju-e4d256-prod-github-runner-207 kernel: [68872.601542] vcpu_run+0x62/0x2c0 [kvm] Aug 23 00:31:38 juju-e4d256-prod-github-runner-207 kernel: [68872.602364] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 00:31:38 juju-e4d256-prod-github-runner-207 kernel: [68872.603168] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 00:31:38 juju-e4d256-prod-github-runner-207 kernel: [68872.604018] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 00:31:38 juju-e4d256-prod-github-runner-207 kernel: [68872.604812] ? __seccomp_filter+0x4a/0x4a0 Aug 23 00:31:38 juju-e4d256-prod-github-runner-207 kernel: [68872.605569] ? __fget_files+0x86/0xc0 Aug 23 00:31:38 juju-e4d256-prod-github-runner-207 kernel: [68872.606277] __x64_sys_ioctl+0x95/0xd0 Aug 23 00:31:38 juju-e4d256-prod-github-runner-207 kernel: [68872.606967] do_syscall_64+0x5c/0xc0 Aug 23 00:31:38 juju-e4d256-prod-github-runner-207 kernel: [68872.607630] ? do_futex+0x162/0x1f0 Aug 23 00:31:38 juju-e4d256-prod-github-runner-207 kernel: [68872.608276] ? __x64_sys_futex+0x78/0x1e0 Aug 23 00:31:38 juju-e4d256-prod-github-runner-207 kernel: [68872.608947] ? __secure_computing+0xa9/0x120 Aug 23 00:31:38 juju-e4d256-prod-github-runner-207 kernel: [68872.609648] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 00:31:38 juju-e4d256-prod-github-runner-207 kernel: [68872.610406] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:31:38 juju-e4d256-prod-github-runner-207 kernel: [68872.611124] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:31:38 juju-e4d256-prod-github-runner-207 kernel: [68872.611839] ? do_syscall_64+0x69/0xc0 Aug 23 00:31:38 juju-e4d256-prod-github-runner-207 kernel: [68872.612480] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:31:38 juju-e4d256-prod-github-runner-207 kernel: [68872.613180] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:31:38 juju-e4d256-prod-github-runner-207 kernel: [68872.613879] ? do_syscall_64+0x69/0xc0 Aug 23 00:31:38 juju-e4d256-prod-github-runner-207 kernel: [68872.614501] ? do_syscall_64+0x69/0xc0 Aug 23 00:31:38 juju-e4d256-prod-github-runner-207 kernel: [68872.615121] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 00:31:38 juju-e4d256-prod-github-runner-207 kernel: [68872.615833] RIP: 0033:0x7faa5d0edaff Aug 23 00:31:38 juju-e4d256-prod-github-runner-207 kernel: [68872.616455] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 00:31:38 juju-e4d256-prod-github-runner-207 kernel: [68872.618451] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 00:31:38 juju-e4d256-prod-github-runner-207 kernel: [68872.619366] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 00:31:38 juju-e4d256-prod-github-runner-207 kernel: [68872.620251] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 00:31:38 juju-e4d256-prod-github-runner-207 kernel: [68872.621136] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 00:31:38 juju-e4d256-prod-github-runner-207 kernel: [68872.622029] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 00:31:38 juju-e4d256-prod-github-runner-207 kernel: [68872.622912] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 00:31:38 juju-e4d256-prod-github-runner-207 kernel: [68872.623800] Aug 23 00:32:06 juju-e4d256-prod-github-runner-207 kernel: [68900.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 64060s! [qemu-system-x86:6715] Aug 23 00:32:06 juju-e4d256-prod-github-runner-207 kernel: [68900.543704] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 00:32:06 juju-e4d256-prod-github-runner-207 kernel: [68900.543944] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 00:32:06 juju-e4d256-prod-github-runner-207 kernel: [68900.555967] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 00:32:06 juju-e4d256-prod-github-runner-207 kernel: [68900.557242] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 00:32:06 juju-e4d256-prod-github-runner-207 kernel: [68900.558463] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:32:06 juju-e4d256-prod-github-runner-207 kernel: [68900.559519] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 00:32:06 juju-e4d256-prod-github-runner-207 kernel: [68900.562079] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 00:32:06 juju-e4d256-prod-github-runner-207 kernel: [68900.563121] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 00:32:06 juju-e4d256-prod-github-runner-207 kernel: [68900.564282] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 00:32:06 juju-e4d256-prod-github-runner-207 kernel: [68900.565461] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 00:32:06 juju-e4d256-prod-github-runner-207 kernel: [68900.566621] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 00:32:06 juju-e4d256-prod-github-runner-207 kernel: [68900.567782] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 00:32:06 juju-e4d256-prod-github-runner-207 kernel: [68900.568951] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 00:32:06 juju-e4d256-prod-github-runner-207 kernel: [68900.570203] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 00:32:06 juju-e4d256-prod-github-runner-207 kernel: [68900.571310] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 00:32:06 juju-e4d256-prod-github-runner-207 kernel: [68900.572499] Call Trace: Aug 23 00:32:06 juju-e4d256-prod-github-runner-207 kernel: [68900.573463] Aug 23 00:32:06 juju-e4d256-prod-github-runner-207 kernel: [68900.574633] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:32:06 juju-e4d256-prod-github-runner-207 kernel: [68900.576044] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:32:06 juju-e4d256-prod-github-runner-207 kernel: [68900.577458] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:32:06 juju-e4d256-prod-github-runner-207 kernel: [68900.578951] ? show_regs.part.0+0x23/0x29 Aug 23 00:32:06 juju-e4d256-prod-github-runner-207 kernel: [68900.580319] ? show_regs.cold+0x8/0xd Aug 23 00:32:06 juju-e4d256-prod-github-runner-207 kernel: [68900.581722] ? watchdog_timer_fn+0x1be/0x220 Aug 23 00:32:06 juju-e4d256-prod-github-runner-207 kernel: [68900.583068] ? lockup_detector_update_enable+0x60/0x60 Aug 23 00:32:06 juju-e4d256-prod-github-runner-207 kernel: [68900.584281] ? __hrtimer_run_queues+0x107/0x230 Aug 23 00:32:06 juju-e4d256-prod-github-runner-207 kernel: [68900.585330] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 00:32:06 juju-e4d256-prod-github-runner-207 kernel: [68900.586356] ? hrtimer_interrupt+0x101/0x220 Aug 23 00:32:06 juju-e4d256-prod-github-runner-207 kernel: [68900.587372] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 00:32:06 juju-e4d256-prod-github-runner-207 kernel: [68900.588441] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 00:32:06 juju-e4d256-prod-github-runner-207 kernel: [68900.589505] Aug 23 00:32:06 juju-e4d256-prod-github-runner-207 kernel: [68900.590360] Aug 23 00:32:06 juju-e4d256-prod-github-runner-207 kernel: [68900.591198] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 00:32:06 juju-e4d256-prod-github-runner-207 kernel: [68900.592233] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:32:06 juju-e4d256-prod-github-runner-207 kernel: [68900.593293] ? _raw_spin_lock+0x22/0x30 Aug 23 00:32:06 juju-e4d256-prod-github-runner-207 kernel: [68900.594286] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:32:06 juju-e4d256-prod-github-runner-207 kernel: [68900.595306] direct_page_fault+0x206/0x310 [kvm] Aug 23 00:32:06 juju-e4d256-prod-github-runner-207 kernel: [68900.596339] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 00:32:06 juju-e4d256-prod-github-runner-207 kernel: [68900.597367] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 00:32:06 juju-e4d256-prod-github-runner-207 kernel: [68900.598374] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 00:32:06 juju-e4d256-prod-github-runner-207 kernel: [68900.599377] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 00:32:06 juju-e4d256-prod-github-runner-207 kernel: [68900.600322] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 00:32:06 juju-e4d256-prod-github-runner-207 kernel: [68900.601311] handle_exit+0x98/0x230 [kvm_amd] Aug 23 00:32:06 juju-e4d256-prod-github-runner-207 kernel: [68900.602211] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 00:32:06 juju-e4d256-prod-github-runner-207 kernel: [68900.603125] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 00:32:06 juju-e4d256-prod-github-runner-207 kernel: [68900.604050] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 00:32:06 juju-e4d256-prod-github-runner-207 kernel: [68900.604958] vcpu_run+0x62/0x2c0 [kvm] Aug 23 00:32:06 juju-e4d256-prod-github-runner-207 kernel: [68900.605972] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 00:32:06 juju-e4d256-prod-github-runner-207 kernel: [68900.606785] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 00:32:06 juju-e4d256-prod-github-runner-207 kernel: [68900.607639] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 00:32:06 juju-e4d256-prod-github-runner-207 kernel: [68900.608439] ? __seccomp_filter+0x4a/0x4a0 Aug 23 00:32:06 juju-e4d256-prod-github-runner-207 kernel: [68900.609200] ? __fget_files+0x86/0xc0 Aug 23 00:32:06 juju-e4d256-prod-github-runner-207 kernel: [68900.609910] __x64_sys_ioctl+0x95/0xd0 Aug 23 00:32:06 juju-e4d256-prod-github-runner-207 kernel: [68900.610608] do_syscall_64+0x5c/0xc0 Aug 23 00:32:06 juju-e4d256-prod-github-runner-207 kernel: [68900.611275] ? do_futex+0x162/0x1f0 Aug 23 00:32:06 juju-e4d256-prod-github-runner-207 kernel: [68900.611927] ? __x64_sys_futex+0x78/0x1e0 Aug 23 00:32:06 juju-e4d256-prod-github-runner-207 kernel: [68900.612603] ? __secure_computing+0xa9/0x120 Aug 23 00:32:06 juju-e4d256-prod-github-runner-207 kernel: [68900.613309] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 00:32:06 juju-e4d256-prod-github-runner-207 kernel: [68900.614070] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:32:06 juju-e4d256-prod-github-runner-207 kernel: [68900.614793] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:32:06 juju-e4d256-prod-github-runner-207 kernel: [68900.615509] ? do_syscall_64+0x69/0xc0 Aug 23 00:32:06 juju-e4d256-prod-github-runner-207 kernel: [68900.616321] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:32:06 juju-e4d256-prod-github-runner-207 kernel: [68900.617035] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:32:06 juju-e4d256-prod-github-runner-207 kernel: [68900.617732] ? do_syscall_64+0x69/0xc0 Aug 23 00:32:06 juju-e4d256-prod-github-runner-207 kernel: [68900.618357] ? do_syscall_64+0x69/0xc0 Aug 23 00:32:06 juju-e4d256-prod-github-runner-207 kernel: [68900.618998] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 00:32:06 juju-e4d256-prod-github-runner-207 kernel: [68900.619703] RIP: 0033:0x7faa5d0edaff Aug 23 00:32:06 juju-e4d256-prod-github-runner-207 kernel: [68900.620345] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 00:32:06 juju-e4d256-prod-github-runner-207 kernel: [68900.622403] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 00:32:06 juju-e4d256-prod-github-runner-207 kernel: [68900.623620] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 00:32:06 juju-e4d256-prod-github-runner-207 kernel: [68900.624864] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 00:32:06 juju-e4d256-prod-github-runner-207 kernel: [68900.626125] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 00:32:06 juju-e4d256-prod-github-runner-207 kernel: [68900.627356] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 00:32:06 juju-e4d256-prod-github-runner-207 kernel: [68900.628559] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 00:32:06 juju-e4d256-prod-github-runner-207 kernel: [68900.629543] Aug 23 00:32:34 juju-e4d256-prod-github-runner-207 kernel: [68928.541980] watchdog: BUG: soft lockup - CPU#1 stuck for 64086s! [qemu-system-x86:6715] Aug 23 00:32:34 juju-e4d256-prod-github-runner-207 kernel: [68928.543168] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 00:32:34 juju-e4d256-prod-github-runner-207 kernel: [68928.543250] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 00:32:34 juju-e4d256-prod-github-runner-207 kernel: [68928.559691] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 00:32:34 juju-e4d256-prod-github-runner-207 kernel: [68928.560969] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 00:32:34 juju-e4d256-prod-github-runner-207 kernel: [68928.562187] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:32:34 juju-e4d256-prod-github-runner-207 kernel: [68928.563281] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 00:32:34 juju-e4d256-prod-github-runner-207 kernel: [68928.565867] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 00:32:34 juju-e4d256-prod-github-runner-207 kernel: [68928.566908] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 00:32:34 juju-e4d256-prod-github-runner-207 kernel: [68928.568067] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 00:32:34 juju-e4d256-prod-github-runner-207 kernel: [68928.569234] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 00:32:34 juju-e4d256-prod-github-runner-207 kernel: [68928.570412] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 00:32:34 juju-e4d256-prod-github-runner-207 kernel: [68928.571907] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 00:32:34 juju-e4d256-prod-github-runner-207 kernel: [68928.573096] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 00:32:34 juju-e4d256-prod-github-runner-207 kernel: [68928.574455] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 00:32:34 juju-e4d256-prod-github-runner-207 kernel: [68928.575556] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 00:32:34 juju-e4d256-prod-github-runner-207 kernel: [68928.576757] Call Trace: Aug 23 00:32:34 juju-e4d256-prod-github-runner-207 kernel: [68928.577670] Aug 23 00:32:34 juju-e4d256-prod-github-runner-207 kernel: [68928.578554] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:32:34 juju-e4d256-prod-github-runner-207 kernel: [68928.579586] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:32:34 juju-e4d256-prod-github-runner-207 kernel: [68928.580612] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:32:34 juju-e4d256-prod-github-runner-207 kernel: [68928.581715] ? show_regs.part.0+0x23/0x29 Aug 23 00:32:34 juju-e4d256-prod-github-runner-207 kernel: [68928.582711] ? show_regs.cold+0x8/0xd Aug 23 00:32:34 juju-e4d256-prod-github-runner-207 kernel: [68928.583687] ? watchdog_timer_fn+0x1be/0x220 Aug 23 00:32:34 juju-e4d256-prod-github-runner-207 kernel: [68928.584715] ? lockup_detector_update_enable+0x60/0x60 Aug 23 00:32:34 juju-e4d256-prod-github-runner-207 kernel: [68928.585783] ? __hrtimer_run_queues+0x107/0x230 Aug 23 00:32:34 juju-e4d256-prod-github-runner-207 kernel: [68928.586812] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 00:32:34 juju-e4d256-prod-github-runner-207 kernel: [68928.587840] ? hrtimer_interrupt+0x101/0x220 Aug 23 00:32:34 juju-e4d256-prod-github-runner-207 kernel: [68928.588866] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 00:32:34 juju-e4d256-prod-github-runner-207 kernel: [68928.589936] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 00:32:34 juju-e4d256-prod-github-runner-207 kernel: [68928.590987] Aug 23 00:32:34 juju-e4d256-prod-github-runner-207 kernel: [68928.591840] Aug 23 00:32:34 juju-e4d256-prod-github-runner-207 kernel: [68928.592685] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 00:32:34 juju-e4d256-prod-github-runner-207 kernel: [68928.593719] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:32:34 juju-e4d256-prod-github-runner-207 kernel: [68928.594757] ? _raw_spin_lock+0x22/0x30 Aug 23 00:32:34 juju-e4d256-prod-github-runner-207 kernel: [68928.595701] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:32:34 juju-e4d256-prod-github-runner-207 kernel: [68928.596728] direct_page_fault+0x206/0x310 [kvm] Aug 23 00:32:34 juju-e4d256-prod-github-runner-207 kernel: [68928.597753] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 00:32:34 juju-e4d256-prod-github-runner-207 kernel: [68928.598761] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 00:32:34 juju-e4d256-prod-github-runner-207 kernel: [68928.599762] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 00:32:34 juju-e4d256-prod-github-runner-207 kernel: [68928.600929] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 00:32:34 juju-e4d256-prod-github-runner-207 kernel: [68928.602458] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 00:32:34 juju-e4d256-prod-github-runner-207 kernel: [68928.603670] handle_exit+0x98/0x230 [kvm_amd] Aug 23 00:32:34 juju-e4d256-prod-github-runner-207 kernel: [68928.604808] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 00:32:34 juju-e4d256-prod-github-runner-207 kernel: [68928.605826] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 00:32:34 juju-e4d256-prod-github-runner-207 kernel: [68928.606756] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 00:32:34 juju-e4d256-prod-github-runner-207 kernel: [68928.607660] vcpu_run+0x62/0x2c0 [kvm] Aug 23 00:32:34 juju-e4d256-prod-github-runner-207 kernel: [68928.608471] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 00:32:34 juju-e4d256-prod-github-runner-207 kernel: [68928.609294] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 00:32:34 juju-e4d256-prod-github-runner-207 kernel: [68928.610148] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 00:32:34 juju-e4d256-prod-github-runner-207 kernel: [68928.610946] ? __seccomp_filter+0x4a/0x4a0 Aug 23 00:32:34 juju-e4d256-prod-github-runner-207 kernel: [68928.611689] ? __fget_files+0x86/0xc0 Aug 23 00:32:34 juju-e4d256-prod-github-runner-207 kernel: [68928.612392] __x64_sys_ioctl+0x95/0xd0 Aug 23 00:32:34 juju-e4d256-prod-github-runner-207 kernel: [68928.613091] do_syscall_64+0x5c/0xc0 Aug 23 00:32:34 juju-e4d256-prod-github-runner-207 kernel: [68928.613759] ? do_futex+0x162/0x1f0 Aug 23 00:32:34 juju-e4d256-prod-github-runner-207 kernel: [68928.614408] ? __x64_sys_futex+0x78/0x1e0 Aug 23 00:32:34 juju-e4d256-prod-github-runner-207 kernel: [68928.615088] ? __secure_computing+0xa9/0x120 Aug 23 00:32:34 juju-e4d256-prod-github-runner-207 kernel: [68928.615784] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 00:32:34 juju-e4d256-prod-github-runner-207 kernel: [68928.616548] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:32:34 juju-e4d256-prod-github-runner-207 kernel: [68928.617285] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:32:34 juju-e4d256-prod-github-runner-207 kernel: [68928.618004] ? do_syscall_64+0x69/0xc0 Aug 23 00:32:34 juju-e4d256-prod-github-runner-207 kernel: [68928.618649] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:32:34 juju-e4d256-prod-github-runner-207 kernel: [68928.619352] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:32:34 juju-e4d256-prod-github-runner-207 kernel: [68928.620052] ? do_syscall_64+0x69/0xc0 Aug 23 00:32:34 juju-e4d256-prod-github-runner-207 kernel: [68928.620687] ? do_syscall_64+0x69/0xc0 Aug 23 00:32:34 juju-e4d256-prod-github-runner-207 kernel: [68928.621312] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 00:32:34 juju-e4d256-prod-github-runner-207 kernel: [68928.622020] RIP: 0033:0x7faa5d0edaff Aug 23 00:32:34 juju-e4d256-prod-github-runner-207 kernel: [68928.622673] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 00:32:34 juju-e4d256-prod-github-runner-207 kernel: [68928.624674] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 00:32:34 juju-e4d256-prod-github-runner-207 kernel: [68928.625586] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 00:32:34 juju-e4d256-prod-github-runner-207 kernel: [68928.626482] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 00:32:34 juju-e4d256-prod-github-runner-207 kernel: [68928.627371] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 00:32:34 juju-e4d256-prod-github-runner-207 kernel: [68928.628259] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 00:32:34 juju-e4d256-prod-github-runner-207 kernel: [68928.629157] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 00:32:34 juju-e4d256-prod-github-runner-207 kernel: [68928.630050] Aug 23 00:32:47 juju-e4d256-prod-github-runner-207 kernel: [68941.784706] rcu: INFO: rcu_sched self-detected stall on CPU Aug 23 00:32:47 juju-e4d256-prod-github-runner-207 kernel: [68941.785648] rcu: 1-....: (17151925 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=8281216 Aug 23 00:32:47 juju-e4d256-prod-github-runner-207 kernel: [68941.786798] (t=17206146 jiffies g=23269 q=59740) Aug 23 00:32:47 juju-e4d256-prod-github-runner-207 kernel: [68941.787591] NMI backtrace for cpu 1 Aug 23 00:32:47 juju-e4d256-prod-github-runner-207 kernel: [68941.788318] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 00:32:47 juju-e4d256-prod-github-runner-207 kernel: [68941.789458] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 00:32:47 juju-e4d256-prod-github-runner-207 kernel: [68941.790513] Call Trace: Aug 23 00:32:47 juju-e4d256-prod-github-runner-207 kernel: [68941.791212] Aug 23 00:32:47 juju-e4d256-prod-github-runner-207 kernel: [68941.791880] show_stack+0x52/0x5c Aug 23 00:32:47 juju-e4d256-prod-github-runner-207 kernel: [68941.792620] dump_stack_lvl+0x4a/0x63 Aug 23 00:32:47 juju-e4d256-prod-github-runner-207 kernel: [68941.793369] dump_stack+0x10/0x16 Aug 23 00:32:47 juju-e4d256-prod-github-runner-207 kernel: [68941.794091] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 23 00:32:47 juju-e4d256-prod-github-runner-207 kernel: [68941.794869] ? lapic_can_unplug_cpu+0x90/0x90 Aug 23 00:32:47 juju-e4d256-prod-github-runner-207 kernel: [68941.795643] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 23 00:32:47 juju-e4d256-prod-github-runner-207 kernel: [68941.796466] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 23 00:32:47 juju-e4d256-prod-github-runner-207 kernel: [68941.797318] trigger_single_cpu_backtrace+0x44/0x4f Aug 23 00:32:47 juju-e4d256-prod-github-runner-207 kernel: [68941.798155] rcu_dump_cpu_stacks+0x102/0x149 Aug 23 00:32:47 juju-e4d256-prod-github-runner-207 kernel: [68941.798946] print_cpu_stall.cold+0x2f/0xe2 Aug 23 00:32:47 juju-e4d256-prod-github-runner-207 kernel: [68941.799823] ? timekeeping_update+0xf7/0x150 Aug 23 00:32:47 juju-e4d256-prod-github-runner-207 kernel: [68941.800616] check_cpu_stall+0x109/0x270 Aug 23 00:32:47 juju-e4d256-prod-github-runner-207 kernel: [68941.801388] rcu_sched_clock_irq+0x9a/0x250 Aug 23 00:32:47 juju-e4d256-prod-github-runner-207 kernel: [68941.802160] update_process_times+0x94/0xd0 Aug 23 00:32:47 juju-e4d256-prod-github-runner-207 kernel: [68941.802925] tick_sched_handle+0x29/0x70 Aug 23 00:32:47 juju-e4d256-prod-github-runner-207 kernel: [68941.803670] tick_sched_timer+0x8c/0xc0 Aug 23 00:32:47 juju-e4d256-prod-github-runner-207 kernel: [68941.804422] ? tick_nohz_handler+0xb0/0xb0 Aug 23 00:32:47 juju-e4d256-prod-github-runner-207 kernel: [68941.805200] __hrtimer_run_queues+0x107/0x230 Aug 23 00:32:47 juju-e4d256-prod-github-runner-207 kernel: [68941.805979] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 00:32:47 juju-e4d256-prod-github-runner-207 kernel: [68941.806770] hrtimer_interrupt+0x101/0x220 Aug 23 00:32:47 juju-e4d256-prod-github-runner-207 kernel: [68941.807538] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 00:32:47 juju-e4d256-prod-github-runner-207 kernel: [68941.808361] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 00:32:47 juju-e4d256-prod-github-runner-207 kernel: [68941.809192] Aug 23 00:32:47 juju-e4d256-prod-github-runner-207 kernel: [68941.809836] Aug 23 00:32:47 juju-e4d256-prod-github-runner-207 kernel: [68941.810463] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 00:32:47 juju-e4d256-prod-github-runner-207 kernel: [68941.811281] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:32:47 juju-e4d256-prod-github-runner-207 kernel: [68941.812164] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 00:32:47 juju-e4d256-prod-github-runner-207 kernel: [68941.814393] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 00:32:47 juju-e4d256-prod-github-runner-207 kernel: [68941.815272] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 00:32:47 juju-e4d256-prod-github-runner-207 kernel: [68941.816262] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 00:32:47 juju-e4d256-prod-github-runner-207 kernel: [68941.817264] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 00:32:47 juju-e4d256-prod-github-runner-207 kernel: [68941.818267] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 00:32:47 juju-e4d256-prod-github-runner-207 kernel: [68941.819246] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 00:32:47 juju-e4d256-prod-github-runner-207 kernel: [68941.820205] ? _raw_spin_lock+0x22/0x30 Aug 23 00:32:47 juju-e4d256-prod-github-runner-207 kernel: [68941.820984] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:32:47 juju-e4d256-prod-github-runner-207 kernel: [68941.821825] direct_page_fault+0x206/0x310 [kvm] Aug 23 00:32:47 juju-e4d256-prod-github-runner-207 kernel: [68941.822663] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 00:32:47 juju-e4d256-prod-github-runner-207 kernel: [68941.823494] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 00:32:47 juju-e4d256-prod-github-runner-207 kernel: [68941.824322] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 00:32:47 juju-e4d256-prod-github-runner-207 kernel: [68941.825149] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 00:32:47 juju-e4d256-prod-github-runner-207 kernel: [68941.825935] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 00:32:47 juju-e4d256-prod-github-runner-207 kernel: [68941.826757] handle_exit+0x98/0x230 [kvm_amd] Aug 23 00:32:47 juju-e4d256-prod-github-runner-207 kernel: [68941.827532] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 00:32:47 juju-e4d256-prod-github-runner-207 kernel: [68941.828345] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 00:32:47 juju-e4d256-prod-github-runner-207 kernel: [68941.829163] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 00:32:47 juju-e4d256-prod-github-runner-207 kernel: [68941.829966] vcpu_run+0x62/0x2c0 [kvm] Aug 23 00:32:47 juju-e4d256-prod-github-runner-207 kernel: [68941.830685] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 00:32:47 juju-e4d256-prod-github-runner-207 kernel: [68941.831439] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 00:32:47 juju-e4d256-prod-github-runner-207 kernel: [68941.832249] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 00:32:47 juju-e4d256-prod-github-runner-207 kernel: [68941.833092] ? __seccomp_filter+0x4a/0x4a0 Aug 23 00:32:47 juju-e4d256-prod-github-runner-207 kernel: [68941.833814] ? __fget_files+0x86/0xc0 Aug 23 00:32:47 juju-e4d256-prod-github-runner-207 kernel: [68941.834531] __x64_sys_ioctl+0x95/0xd0 Aug 23 00:32:47 juju-e4d256-prod-github-runner-207 kernel: [68941.835321] do_syscall_64+0x5c/0xc0 Aug 23 00:32:47 juju-e4d256-prod-github-runner-207 kernel: [68941.836006] ? do_futex+0x162/0x1f0 Aug 23 00:32:47 juju-e4d256-prod-github-runner-207 kernel: [68941.836730] ? __x64_sys_futex+0x78/0x1e0 Aug 23 00:32:47 juju-e4d256-prod-github-runner-207 kernel: [68941.837436] ? __secure_computing+0xa9/0x120 Aug 23 00:32:47 juju-e4d256-prod-github-runner-207 kernel: [68941.838165] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 00:32:47 juju-e4d256-prod-github-runner-207 kernel: [68941.838953] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:32:47 juju-e4d256-prod-github-runner-207 kernel: [68941.839708] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:32:47 juju-e4d256-prod-github-runner-207 kernel: [68941.840461] ? do_syscall_64+0x69/0xc0 Aug 23 00:32:47 juju-e4d256-prod-github-runner-207 kernel: [68941.841167] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:32:47 juju-e4d256-prod-github-runner-207 kernel: [68941.841931] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:32:47 juju-e4d256-prod-github-runner-207 kernel: [68941.842696] ? do_syscall_64+0x69/0xc0 Aug 23 00:32:47 juju-e4d256-prod-github-runner-207 kernel: [68941.843404] ? do_syscall_64+0x69/0xc0 Aug 23 00:32:47 juju-e4d256-prod-github-runner-207 kernel: [68941.844097] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 00:32:47 juju-e4d256-prod-github-runner-207 kernel: [68941.844879] RIP: 0033:0x7faa5d0edaff Aug 23 00:32:47 juju-e4d256-prod-github-runner-207 kernel: [68941.845565] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 00:32:47 juju-e4d256-prod-github-runner-207 kernel: [68941.847652] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 00:32:47 juju-e4d256-prod-github-runner-207 kernel: [68941.848626] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 00:32:47 juju-e4d256-prod-github-runner-207 kernel: [68941.849575] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 00:32:47 juju-e4d256-prod-github-runner-207 kernel: [68941.850517] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 00:32:47 juju-e4d256-prod-github-runner-207 kernel: [68941.851455] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 00:32:47 juju-e4d256-prod-github-runner-207 kernel: [68941.852378] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 00:32:47 juju-e4d256-prod-github-runner-207 kernel: [68941.853302] Aug 23 00:33:14 juju-e4d256-prod-github-runner-207 kernel: [68968.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 64123s! [qemu-system-x86:6715] Aug 23 00:33:14 juju-e4d256-prod-github-runner-207 kernel: [68968.543328] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 00:33:14 juju-e4d256-prod-github-runner-207 kernel: [68968.543397] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 00:33:14 juju-e4d256-prod-github-runner-207 kernel: [68968.560242] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 00:33:14 juju-e4d256-prod-github-runner-207 kernel: [68968.562105] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 00:33:14 juju-e4d256-prod-github-runner-207 kernel: [68968.563795] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:33:14 juju-e4d256-prod-github-runner-207 kernel: [68968.564941] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 00:33:14 juju-e4d256-prod-github-runner-207 kernel: [68968.567636] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 00:33:14 juju-e4d256-prod-github-runner-207 kernel: [68968.568689] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 00:33:14 juju-e4d256-prod-github-runner-207 kernel: [68968.569851] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 00:33:14 juju-e4d256-prod-github-runner-207 kernel: [68968.571015] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 00:33:14 juju-e4d256-prod-github-runner-207 kernel: [68968.572173] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 00:33:14 juju-e4d256-prod-github-runner-207 kernel: [68968.573349] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 00:33:14 juju-e4d256-prod-github-runner-207 kernel: [68968.574513] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 00:33:14 juju-e4d256-prod-github-runner-207 kernel: [68968.575744] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 00:33:14 juju-e4d256-prod-github-runner-207 kernel: [68968.576848] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 00:33:14 juju-e4d256-prod-github-runner-207 kernel: [68968.578045] Call Trace: Aug 23 00:33:14 juju-e4d256-prod-github-runner-207 kernel: [68968.578957] Aug 23 00:33:14 juju-e4d256-prod-github-runner-207 kernel: [68968.579843] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:33:14 juju-e4d256-prod-github-runner-207 kernel: [68968.580879] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:33:14 juju-e4d256-prod-github-runner-207 kernel: [68968.581900] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:33:14 juju-e4d256-prod-github-runner-207 kernel: [68968.582975] ? show_regs.part.0+0x23/0x29 Aug 23 00:33:14 juju-e4d256-prod-github-runner-207 kernel: [68968.583973] ? show_regs.cold+0x8/0xd Aug 23 00:33:14 juju-e4d256-prod-github-runner-207 kernel: [68968.584951] ? watchdog_timer_fn+0x1be/0x220 Aug 23 00:33:14 juju-e4d256-prod-github-runner-207 kernel: [68968.585959] ? lockup_detector_update_enable+0x60/0x60 Aug 23 00:33:14 juju-e4d256-prod-github-runner-207 kernel: [68968.587023] ? __hrtimer_run_queues+0x107/0x230 Aug 23 00:33:14 juju-e4d256-prod-github-runner-207 kernel: [68968.588047] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 00:33:14 juju-e4d256-prod-github-runner-207 kernel: [68968.589073] ? hrtimer_interrupt+0x101/0x220 Aug 23 00:33:14 juju-e4d256-prod-github-runner-207 kernel: [68968.590085] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 00:33:14 juju-e4d256-prod-github-runner-207 kernel: [68968.591150] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 00:33:14 juju-e4d256-prod-github-runner-207 kernel: [68968.592193] Aug 23 00:33:14 juju-e4d256-prod-github-runner-207 kernel: [68968.593055] Aug 23 00:33:14 juju-e4d256-prod-github-runner-207 kernel: [68968.593890] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 00:33:14 juju-e4d256-prod-github-runner-207 kernel: [68968.594920] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:33:14 juju-e4d256-prod-github-runner-207 kernel: [68968.595960] ? _raw_spin_lock+0x22/0x30 Aug 23 00:33:14 juju-e4d256-prod-github-runner-207 kernel: [68968.596906] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:33:14 juju-e4d256-prod-github-runner-207 kernel: [68968.597919] direct_page_fault+0x206/0x310 [kvm] Aug 23 00:33:14 juju-e4d256-prod-github-runner-207 kernel: [68968.598939] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 00:33:14 juju-e4d256-prod-github-runner-207 kernel: [68968.599949] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 00:33:14 juju-e4d256-prod-github-runner-207 kernel: [68968.600951] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 00:33:14 juju-e4d256-prod-github-runner-207 kernel: [68968.601921] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 00:33:14 juju-e4d256-prod-github-runner-207 kernel: [68968.602869] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 00:33:14 juju-e4d256-prod-github-runner-207 kernel: [68968.603899] handle_exit+0x98/0x230 [kvm_amd] Aug 23 00:33:14 juju-e4d256-prod-github-runner-207 kernel: [68968.604862] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 00:33:14 juju-e4d256-prod-github-runner-207 kernel: [68968.606035] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 00:33:14 juju-e4d256-prod-github-runner-207 kernel: [68968.607585] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 00:33:14 juju-e4d256-prod-github-runner-207 kernel: [68968.608931] vcpu_run+0x62/0x2c0 [kvm] Aug 23 00:33:14 juju-e4d256-prod-github-runner-207 kernel: [68968.611043] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 00:33:14 juju-e4d256-prod-github-runner-207 kernel: [68968.612271] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 00:33:14 juju-e4d256-prod-github-runner-207 kernel: [68968.617173] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 00:33:14 juju-e4d256-prod-github-runner-207 kernel: [68968.618337] ? __seccomp_filter+0x4a/0x4a0 Aug 23 00:33:14 juju-e4d256-prod-github-runner-207 kernel: [68968.619406] ? __fget_files+0x86/0xc0 Aug 23 00:33:14 juju-e4d256-prod-github-runner-207 kernel: [68968.620467] __x64_sys_ioctl+0x95/0xd0 Aug 23 00:33:14 juju-e4d256-prod-github-runner-207 kernel: [68968.621480] do_syscall_64+0x5c/0xc0 Aug 23 00:33:14 juju-e4d256-prod-github-runner-207 kernel: [68968.622392] ? do_futex+0x162/0x1f0 Aug 23 00:33:14 juju-e4d256-prod-github-runner-207 kernel: [68968.623304] ? __x64_sys_futex+0x78/0x1e0 Aug 23 00:33:14 juju-e4d256-prod-github-runner-207 kernel: [68968.624252] ? __secure_computing+0xa9/0x120 Aug 23 00:33:14 juju-e4d256-prod-github-runner-207 kernel: [68968.625256] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 00:33:14 juju-e4d256-prod-github-runner-207 kernel: [68968.626160] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:33:14 juju-e4d256-prod-github-runner-207 kernel: [68968.626881] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:33:14 juju-e4d256-prod-github-runner-207 kernel: [68968.627605] ? do_syscall_64+0x69/0xc0 Aug 23 00:33:14 juju-e4d256-prod-github-runner-207 kernel: [68968.628267] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:33:14 juju-e4d256-prod-github-runner-207 kernel: [68968.628971] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:33:14 juju-e4d256-prod-github-runner-207 kernel: [68968.629664] ? do_syscall_64+0x69/0xc0 Aug 23 00:33:14 juju-e4d256-prod-github-runner-207 kernel: [68968.630291] ? do_syscall_64+0x69/0xc0 Aug 23 00:33:14 juju-e4d256-prod-github-runner-207 kernel: [68968.630977] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 00:33:14 juju-e4d256-prod-github-runner-207 kernel: [68968.631696] RIP: 0033:0x7faa5d0edaff Aug 23 00:33:14 juju-e4d256-prod-github-runner-207 kernel: [68968.632336] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 00:33:14 juju-e4d256-prod-github-runner-207 kernel: [68968.634321] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 00:33:14 juju-e4d256-prod-github-runner-207 kernel: [68968.635230] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 00:33:14 juju-e4d256-prod-github-runner-207 kernel: [68968.636118] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 00:33:14 juju-e4d256-prod-github-runner-207 kernel: [68968.637018] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 00:33:14 juju-e4d256-prod-github-runner-207 kernel: [68968.637906] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 00:33:14 juju-e4d256-prod-github-runner-207 kernel: [68968.638792] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 00:33:14 juju-e4d256-prod-github-runner-207 kernel: [68968.639689] Aug 23 00:33:42 juju-e4d256-prod-github-runner-207 kernel: [68996.541984] watchdog: BUG: soft lockup - CPU#1 stuck for 64150s! [qemu-system-x86:6715] Aug 23 00:33:42 juju-e4d256-prod-github-runner-207 kernel: [68996.544690] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 00:33:42 juju-e4d256-prod-github-runner-207 kernel: [68996.545050] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 00:33:42 juju-e4d256-prod-github-runner-207 kernel: [68996.562690] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 00:33:42 juju-e4d256-prod-github-runner-207 kernel: [68996.564267] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 00:33:42 juju-e4d256-prod-github-runner-207 kernel: [68996.565500] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:33:42 juju-e4d256-prod-github-runner-207 kernel: [68996.566587] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 00:33:42 juju-e4d256-prod-github-runner-207 kernel: [68996.569248] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 00:33:42 juju-e4d256-prod-github-runner-207 kernel: [68996.570297] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 00:33:42 juju-e4d256-prod-github-runner-207 kernel: [68996.571462] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 00:33:42 juju-e4d256-prod-github-runner-207 kernel: [68996.572671] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 00:33:42 juju-e4d256-prod-github-runner-207 kernel: [68996.573834] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 00:33:42 juju-e4d256-prod-github-runner-207 kernel: [68996.574999] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 00:33:42 juju-e4d256-prod-github-runner-207 kernel: [68996.576172] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 00:33:42 juju-e4d256-prod-github-runner-207 kernel: [68996.577408] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 00:33:42 juju-e4d256-prod-github-runner-207 kernel: [68996.578548] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 00:33:42 juju-e4d256-prod-github-runner-207 kernel: [68996.579788] Call Trace: Aug 23 00:33:42 juju-e4d256-prod-github-runner-207 kernel: [68996.580780] Aug 23 00:33:42 juju-e4d256-prod-github-runner-207 kernel: [68996.581730] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:33:42 juju-e4d256-prod-github-runner-207 kernel: [68996.582790] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:33:42 juju-e4d256-prod-github-runner-207 kernel: [68996.583821] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:33:42 juju-e4d256-prod-github-runner-207 kernel: [68996.584937] ? show_regs.part.0+0x23/0x29 Aug 23 00:33:42 juju-e4d256-prod-github-runner-207 kernel: [68996.585930] ? show_regs.cold+0x8/0xd Aug 23 00:33:42 juju-e4d256-prod-github-runner-207 kernel: [68996.586899] ? watchdog_timer_fn+0x1be/0x220 Aug 23 00:33:42 juju-e4d256-prod-github-runner-207 kernel: [68996.587916] ? lockup_detector_update_enable+0x60/0x60 Aug 23 00:33:42 juju-e4d256-prod-github-runner-207 kernel: [68996.588977] ? __hrtimer_run_queues+0x107/0x230 Aug 23 00:33:42 juju-e4d256-prod-github-runner-207 kernel: [68996.590027] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 00:33:42 juju-e4d256-prod-github-runner-207 kernel: [68996.591131] ? hrtimer_interrupt+0x101/0x220 Aug 23 00:33:42 juju-e4d256-prod-github-runner-207 kernel: [68996.592204] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 00:33:42 juju-e4d256-prod-github-runner-207 kernel: [68996.593295] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 00:33:42 juju-e4d256-prod-github-runner-207 kernel: [68996.594471] Aug 23 00:33:42 juju-e4d256-prod-github-runner-207 kernel: [68996.595649] Aug 23 00:33:42 juju-e4d256-prod-github-runner-207 kernel: [68996.596809] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 00:33:42 juju-e4d256-prod-github-runner-207 kernel: [68996.598249] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:33:42 juju-e4d256-prod-github-runner-207 kernel: [68996.599699] ? _raw_spin_lock+0x22/0x30 Aug 23 00:33:42 juju-e4d256-prod-github-runner-207 kernel: [68996.600997] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:33:42 juju-e4d256-prod-github-runner-207 kernel: [68996.602431] direct_page_fault+0x206/0x310 [kvm] Aug 23 00:33:42 juju-e4d256-prod-github-runner-207 kernel: [68996.603849] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 00:33:42 juju-e4d256-prod-github-runner-207 kernel: [68996.605251] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 00:33:42 juju-e4d256-prod-github-runner-207 kernel: [68996.606611] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 00:33:42 juju-e4d256-prod-github-runner-207 kernel: [68996.608026] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 00:33:42 juju-e4d256-prod-github-runner-207 kernel: [68996.609285] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 00:33:42 juju-e4d256-prod-github-runner-207 kernel: [68996.610326] handle_exit+0x98/0x230 [kvm_amd] Aug 23 00:33:42 juju-e4d256-prod-github-runner-207 kernel: [68996.611261] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 00:33:42 juju-e4d256-prod-github-runner-207 kernel: [68996.612221] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 00:33:42 juju-e4d256-prod-github-runner-207 kernel: [68996.613214] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 00:33:42 juju-e4d256-prod-github-runner-207 kernel: [68996.614163] vcpu_run+0x62/0x2c0 [kvm] Aug 23 00:33:42 juju-e4d256-prod-github-runner-207 kernel: [68996.615021] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 00:33:42 juju-e4d256-prod-github-runner-207 kernel: [68996.615845] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 00:33:42 juju-e4d256-prod-github-runner-207 kernel: [68996.616714] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 00:33:42 juju-e4d256-prod-github-runner-207 kernel: [68996.617722] ? __seccomp_filter+0x4a/0x4a0 Aug 23 00:33:42 juju-e4d256-prod-github-runner-207 kernel: [68996.618471] ? __fget_files+0x86/0xc0 Aug 23 00:33:42 juju-e4d256-prod-github-runner-207 kernel: [68996.619180] __x64_sys_ioctl+0x95/0xd0 Aug 23 00:33:42 juju-e4d256-prod-github-runner-207 kernel: [68996.619905] do_syscall_64+0x5c/0xc0 Aug 23 00:33:42 juju-e4d256-prod-github-runner-207 kernel: [68996.620575] ? do_futex+0x162/0x1f0 Aug 23 00:33:42 juju-e4d256-prod-github-runner-207 kernel: [68996.621230] ? __x64_sys_futex+0x78/0x1e0 Aug 23 00:33:42 juju-e4d256-prod-github-runner-207 kernel: [68996.621908] ? __secure_computing+0xa9/0x120 Aug 23 00:33:42 juju-e4d256-prod-github-runner-207 kernel: [68996.622617] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 00:33:42 juju-e4d256-prod-github-runner-207 kernel: [68996.623429] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:33:42 juju-e4d256-prod-github-runner-207 kernel: [68996.624207] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:33:42 juju-e4d256-prod-github-runner-207 kernel: [68996.624961] ? do_syscall_64+0x69/0xc0 Aug 23 00:33:42 juju-e4d256-prod-github-runner-207 kernel: [68996.625632] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:33:42 juju-e4d256-prod-github-runner-207 kernel: [68996.626341] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:33:42 juju-e4d256-prod-github-runner-207 kernel: [68996.627430] ? do_syscall_64+0x69/0xc0 Aug 23 00:33:42 juju-e4d256-prod-github-runner-207 kernel: [68996.628313] ? do_syscall_64+0x69/0xc0 Aug 23 00:33:42 juju-e4d256-prod-github-runner-207 kernel: [68996.629218] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 00:33:42 juju-e4d256-prod-github-runner-207 kernel: [68996.630263] RIP: 0033:0x7faa5d0edaff Aug 23 00:33:42 juju-e4d256-prod-github-runner-207 kernel: [68996.631212] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 00:33:42 juju-e4d256-prod-github-runner-207 kernel: [68996.634203] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 00:33:42 juju-e4d256-prod-github-runner-207 kernel: [68996.635633] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 00:33:42 juju-e4d256-prod-github-runner-207 kernel: [68996.637005] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 00:33:42 juju-e4d256-prod-github-runner-207 kernel: [68996.638383] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 00:33:42 juju-e4d256-prod-github-runner-207 kernel: [68996.639927] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 00:33:42 juju-e4d256-prod-github-runner-207 kernel: [68996.641294] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 00:33:42 juju-e4d256-prod-github-runner-207 kernel: [68996.642775] Aug 23 00:34:10 juju-e4d256-prod-github-runner-207 kernel: [69024.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 64176s! [qemu-system-x86:6715] Aug 23 00:34:10 juju-e4d256-prod-github-runner-207 kernel: [69024.543283] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 00:34:10 juju-e4d256-prod-github-runner-207 kernel: [69024.543365] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 00:34:10 juju-e4d256-prod-github-runner-207 kernel: [69024.560097] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 00:34:10 juju-e4d256-prod-github-runner-207 kernel: [69024.561583] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 00:34:10 juju-e4d256-prod-github-runner-207 kernel: [69024.562988] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:34:10 juju-e4d256-prod-github-runner-207 kernel: [69024.564281] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 00:34:10 juju-e4d256-prod-github-runner-207 kernel: [69024.567183] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 00:34:10 juju-e4d256-prod-github-runner-207 kernel: [69024.568355] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 00:34:10 juju-e4d256-prod-github-runner-207 kernel: [69024.569701] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 00:34:10 juju-e4d256-prod-github-runner-207 kernel: [69024.571046] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 00:34:10 juju-e4d256-prod-github-runner-207 kernel: [69024.572379] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 00:34:10 juju-e4d256-prod-github-runner-207 kernel: [69024.573675] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 00:34:10 juju-e4d256-prod-github-runner-207 kernel: [69024.574989] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 00:34:10 juju-e4d256-prod-github-runner-207 kernel: [69024.576399] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 00:34:10 juju-e4d256-prod-github-runner-207 kernel: [69024.577611] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 00:34:10 juju-e4d256-prod-github-runner-207 kernel: [69024.578935] Call Trace: Aug 23 00:34:10 juju-e4d256-prod-github-runner-207 kernel: [69024.579945] Aug 23 00:34:10 juju-e4d256-prod-github-runner-207 kernel: [69024.580911] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:34:10 juju-e4d256-prod-github-runner-207 kernel: [69024.582048] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:34:10 juju-e4d256-prod-github-runner-207 kernel: [69024.583162] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:34:10 juju-e4d256-prod-github-runner-207 kernel: [69024.584290] ? show_regs.part.0+0x23/0x29 Aug 23 00:34:10 juju-e4d256-prod-github-runner-207 kernel: [69024.585310] ? show_regs.cold+0x8/0xd Aug 23 00:34:10 juju-e4d256-prod-github-runner-207 kernel: [69024.586305] ? watchdog_timer_fn+0x1be/0x220 Aug 23 00:34:10 juju-e4d256-prod-github-runner-207 kernel: [69024.587327] ? lockup_detector_update_enable+0x60/0x60 Aug 23 00:34:10 juju-e4d256-prod-github-runner-207 kernel: [69024.588411] ? __hrtimer_run_queues+0x107/0x230 Aug 23 00:34:10 juju-e4d256-prod-github-runner-207 kernel: [69024.589443] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 00:34:10 juju-e4d256-prod-github-runner-207 kernel: [69024.590482] ? hrtimer_interrupt+0x101/0x220 Aug 23 00:34:10 juju-e4d256-prod-github-runner-207 kernel: [69024.591517] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 00:34:10 juju-e4d256-prod-github-runner-207 kernel: [69024.592608] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 00:34:10 juju-e4d256-prod-github-runner-207 kernel: [69024.593661] Aug 23 00:34:10 juju-e4d256-prod-github-runner-207 kernel: [69024.594519] Aug 23 00:34:10 juju-e4d256-prod-github-runner-207 kernel: [69024.595484] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 00:34:10 juju-e4d256-prod-github-runner-207 kernel: [69024.596558] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:34:10 juju-e4d256-prod-github-runner-207 kernel: [69024.597611] ? _raw_spin_lock+0x22/0x30 Aug 23 00:34:10 juju-e4d256-prod-github-runner-207 kernel: [69024.598559] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:34:10 juju-e4d256-prod-github-runner-207 kernel: [69024.599600] direct_page_fault+0x206/0x310 [kvm] Aug 23 00:34:10 juju-e4d256-prod-github-runner-207 kernel: [69024.600646] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 00:34:10 juju-e4d256-prod-github-runner-207 kernel: [69024.601679] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 00:34:10 juju-e4d256-prod-github-runner-207 kernel: [69024.602689] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 00:34:10 juju-e4d256-prod-github-runner-207 kernel: [69024.603680] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 00:34:10 juju-e4d256-prod-github-runner-207 kernel: [69024.604632] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 00:34:10 juju-e4d256-prod-github-runner-207 kernel: [69024.605642] handle_exit+0x98/0x230 [kvm_amd] Aug 23 00:34:10 juju-e4d256-prod-github-runner-207 kernel: [69024.606553] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 00:34:10 juju-e4d256-prod-github-runner-207 kernel: [69024.607483] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 00:34:10 juju-e4d256-prod-github-runner-207 kernel: [69024.608434] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 00:34:10 juju-e4d256-prod-github-runner-207 kernel: [69024.609353] vcpu_run+0x62/0x2c0 [kvm] Aug 23 00:34:10 juju-e4d256-prod-github-runner-207 kernel: [69024.610290] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 00:34:10 juju-e4d256-prod-github-runner-207 kernel: [69024.611127] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 00:34:10 juju-e4d256-prod-github-runner-207 kernel: [69024.612028] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 00:34:10 juju-e4d256-prod-github-runner-207 kernel: [69024.612837] ? __seccomp_filter+0x4a/0x4a0 Aug 23 00:34:10 juju-e4d256-prod-github-runner-207 kernel: [69024.613702] ? __fget_files+0x86/0xc0 Aug 23 00:34:10 juju-e4d256-prod-github-runner-207 kernel: [69024.614501] __x64_sys_ioctl+0x95/0xd0 Aug 23 00:34:10 juju-e4d256-prod-github-runner-207 kernel: [69024.615284] do_syscall_64+0x5c/0xc0 Aug 23 00:34:10 juju-e4d256-prod-github-runner-207 kernel: [69024.616095] ? do_futex+0x162/0x1f0 Aug 23 00:34:10 juju-e4d256-prod-github-runner-207 kernel: [69024.616853] ? __x64_sys_futex+0x78/0x1e0 Aug 23 00:34:10 juju-e4d256-prod-github-runner-207 kernel: [69024.617616] ? __secure_computing+0xa9/0x120 Aug 23 00:34:10 juju-e4d256-prod-github-runner-207 kernel: [69024.618392] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 00:34:10 juju-e4d256-prod-github-runner-207 kernel: [69024.619266] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:34:10 juju-e4d256-prod-github-runner-207 kernel: [69024.620103] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:34:10 juju-e4d256-prod-github-runner-207 kernel: [69024.621057] ? do_syscall_64+0x69/0xc0 Aug 23 00:34:10 juju-e4d256-prod-github-runner-207 kernel: [69024.621980] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:34:10 juju-e4d256-prod-github-runner-207 kernel: [69024.622796] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:34:10 juju-e4d256-prod-github-runner-207 kernel: [69024.623806] ? do_syscall_64+0x69/0xc0 Aug 23 00:34:10 juju-e4d256-prod-github-runner-207 kernel: [69024.624553] ? do_syscall_64+0x69/0xc0 Aug 23 00:34:10 juju-e4d256-prod-github-runner-207 kernel: [69024.625374] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 00:34:10 juju-e4d256-prod-github-runner-207 kernel: [69024.626290] RIP: 0033:0x7faa5d0edaff Aug 23 00:34:10 juju-e4d256-prod-github-runner-207 kernel: [69024.627014] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 00:34:10 juju-e4d256-prod-github-runner-207 kernel: [69024.629377] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 00:34:10 juju-e4d256-prod-github-runner-207 kernel: [69024.630453] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 00:34:10 juju-e4d256-prod-github-runner-207 kernel: [69024.631480] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 00:34:10 juju-e4d256-prod-github-runner-207 kernel: [69024.632529] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 00:34:10 juju-e4d256-prod-github-runner-207 kernel: [69024.633554] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 00:34:10 juju-e4d256-prod-github-runner-207 kernel: [69024.634577] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 00:34:10 juju-e4d256-prod-github-runner-207 kernel: [69024.635623] Aug 23 00:34:38 juju-e4d256-prod-github-runner-207 kernel: [69052.541980] watchdog: BUG: soft lockup - CPU#1 stuck for 64202s! [qemu-system-x86:6715] Aug 23 00:34:38 juju-e4d256-prod-github-runner-207 kernel: [69052.543131] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 00:34:38 juju-e4d256-prod-github-runner-207 kernel: [69052.543196] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 00:34:38 juju-e4d256-prod-github-runner-207 kernel: [69052.569918] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 00:34:38 juju-e4d256-prod-github-runner-207 kernel: [69052.573445] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 00:34:38 juju-e4d256-prod-github-runner-207 kernel: [69052.574666] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:34:38 juju-e4d256-prod-github-runner-207 kernel: [69052.577836] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 00:34:38 juju-e4d256-prod-github-runner-207 kernel: [69052.582526] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 00:34:38 juju-e4d256-prod-github-runner-207 kernel: [69052.585723] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 00:34:38 juju-e4d256-prod-github-runner-207 kernel: [69052.586901] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 00:34:38 juju-e4d256-prod-github-runner-207 kernel: [69052.590219] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 00:34:38 juju-e4d256-prod-github-runner-207 kernel: [69052.591416] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 00:34:38 juju-e4d256-prod-github-runner-207 kernel: [69052.594653] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 00:34:38 juju-e4d256-prod-github-runner-207 kernel: [69052.595871] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 00:34:38 juju-e4d256-prod-github-runner-207 kernel: [69052.599280] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 00:34:38 juju-e4d256-prod-github-runner-207 kernel: [69052.602679] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 00:34:38 juju-e4d256-prod-github-runner-207 kernel: [69052.603950] Call Trace: Aug 23 00:34:38 juju-e4d256-prod-github-runner-207 kernel: [69052.606833] Aug 23 00:34:38 juju-e4d256-prod-github-runner-207 kernel: [69052.607808] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:34:38 juju-e4d256-prod-github-runner-207 kernel: [69052.610968] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:34:38 juju-e4d256-prod-github-runner-207 kernel: [69052.613101] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:34:38 juju-e4d256-prod-github-runner-207 kernel: [69052.615358] ? show_regs.part.0+0x23/0x29 Aug 23 00:34:38 juju-e4d256-prod-github-runner-207 kernel: [69052.618352] ? show_regs.cold+0x8/0xd Aug 23 00:34:38 juju-e4d256-prod-github-runner-207 kernel: [69052.619366] ? watchdog_timer_fn+0x1be/0x220 Aug 23 00:34:38 juju-e4d256-prod-github-runner-207 kernel: [69052.622484] ? lockup_detector_update_enable+0x60/0x60 Aug 23 00:34:38 juju-e4d256-prod-github-runner-207 kernel: [69052.623585] ? __hrtimer_run_queues+0x107/0x230 Aug 23 00:34:38 juju-e4d256-prod-github-runner-207 kernel: [69052.624621] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 00:34:38 juju-e4d256-prod-github-runner-207 kernel: [69052.625669] ? hrtimer_interrupt+0x101/0x220 Aug 23 00:34:38 juju-e4d256-prod-github-runner-207 kernel: [69052.626685] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 00:34:38 juju-e4d256-prod-github-runner-207 kernel: [69052.627798] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 00:34:38 juju-e4d256-prod-github-runner-207 kernel: [69052.629117] Aug 23 00:34:38 juju-e4d256-prod-github-runner-207 kernel: [69052.629981] Aug 23 00:34:38 juju-e4d256-prod-github-runner-207 kernel: [69052.630819] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 00:34:38 juju-e4d256-prod-github-runner-207 kernel: [69052.631881] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:34:38 juju-e4d256-prod-github-runner-207 kernel: [69052.632943] ? _raw_spin_lock+0x22/0x30 Aug 23 00:34:38 juju-e4d256-prod-github-runner-207 kernel: [69052.633898] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:34:38 juju-e4d256-prod-github-runner-207 kernel: [69052.635339] direct_page_fault+0x206/0x310 [kvm] Aug 23 00:34:38 juju-e4d256-prod-github-runner-207 kernel: [69052.636368] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 00:34:38 juju-e4d256-prod-github-runner-207 kernel: [69052.637394] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 00:34:38 juju-e4d256-prod-github-runner-207 kernel: [69052.638398] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 00:34:38 juju-e4d256-prod-github-runner-207 kernel: [69052.639393] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 00:34:38 juju-e4d256-prod-github-runner-207 kernel: [69052.640382] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 00:34:38 juju-e4d256-prod-github-runner-207 kernel: [69052.641424] handle_exit+0x98/0x230 [kvm_amd] Aug 23 00:34:38 juju-e4d256-prod-github-runner-207 kernel: [69052.642331] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 00:34:38 juju-e4d256-prod-github-runner-207 kernel: [69052.643271] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 00:34:38 juju-e4d256-prod-github-runner-207 kernel: [69052.644200] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 00:34:38 juju-e4d256-prod-github-runner-207 kernel: [69052.645106] vcpu_run+0x62/0x2c0 [kvm] Aug 23 00:34:38 juju-e4d256-prod-github-runner-207 kernel: [69052.645916] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 00:34:38 juju-e4d256-prod-github-runner-207 kernel: [69052.646724] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 00:34:38 juju-e4d256-prod-github-runner-207 kernel: [69052.647615] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 00:34:38 juju-e4d256-prod-github-runner-207 kernel: [69052.648417] ? __seccomp_filter+0x4a/0x4a0 Aug 23 00:34:38 juju-e4d256-prod-github-runner-207 kernel: [69052.649168] ? __fget_files+0x86/0xc0 Aug 23 00:34:38 juju-e4d256-prod-github-runner-207 kernel: [69052.649871] __x64_sys_ioctl+0x95/0xd0 Aug 23 00:34:38 juju-e4d256-prod-github-runner-207 kernel: [69052.650562] do_syscall_64+0x5c/0xc0 Aug 23 00:34:38 juju-e4d256-prod-github-runner-207 kernel: [69052.651230] ? do_futex+0x162/0x1f0 Aug 23 00:34:38 juju-e4d256-prod-github-runner-207 kernel: [69052.651896] ? __x64_sys_futex+0x78/0x1e0 Aug 23 00:34:38 juju-e4d256-prod-github-runner-207 kernel: [69052.652569] ? __secure_computing+0xa9/0x120 Aug 23 00:34:38 juju-e4d256-prod-github-runner-207 kernel: [69052.653260] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 00:34:38 juju-e4d256-prod-github-runner-207 kernel: [69052.654022] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:34:38 juju-e4d256-prod-github-runner-207 kernel: [69052.654742] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:34:38 juju-e4d256-prod-github-runner-207 kernel: [69052.655490] ? do_syscall_64+0x69/0xc0 Aug 23 00:34:38 juju-e4d256-prod-github-runner-207 kernel: [69052.656133] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:34:38 juju-e4d256-prod-github-runner-207 kernel: [69052.656834] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:34:38 juju-e4d256-prod-github-runner-207 kernel: [69052.657531] ? do_syscall_64+0x69/0xc0 Aug 23 00:34:38 juju-e4d256-prod-github-runner-207 kernel: [69052.658161] ? do_syscall_64+0x69/0xc0 Aug 23 00:34:38 juju-e4d256-prod-github-runner-207 kernel: [69052.658785] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 00:34:38 juju-e4d256-prod-github-runner-207 kernel: [69052.659505] RIP: 0033:0x7faa5d0edaff Aug 23 00:34:38 juju-e4d256-prod-github-runner-207 kernel: [69052.660128] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 00:34:38 juju-e4d256-prod-github-runner-207 kernel: [69052.662115] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 00:34:38 juju-e4d256-prod-github-runner-207 kernel: [69052.663024] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 00:34:38 juju-e4d256-prod-github-runner-207 kernel: [69052.663936] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 00:34:38 juju-e4d256-prod-github-runner-207 kernel: [69052.664825] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 00:34:38 juju-e4d256-prod-github-runner-207 kernel: [69052.665713] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 00:34:38 juju-e4d256-prod-github-runner-207 kernel: [69052.666759] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 00:34:38 juju-e4d256-prod-github-runner-207 kernel: [69052.667819] Aug 23 00:35:06 juju-e4d256-prod-github-runner-207 kernel: [69080.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 64228s! [qemu-system-x86:6715] Aug 23 00:35:06 juju-e4d256-prod-github-runner-207 kernel: [69080.543740] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 00:35:06 juju-e4d256-prod-github-runner-207 kernel: [69080.543987] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 00:35:06 juju-e4d256-prod-github-runner-207 kernel: [69080.556143] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 00:35:06 juju-e4d256-prod-github-runner-207 kernel: [69080.557407] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 00:35:06 juju-e4d256-prod-github-runner-207 kernel: [69080.558624] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:35:06 juju-e4d256-prod-github-runner-207 kernel: [69080.559685] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 00:35:06 juju-e4d256-prod-github-runner-207 kernel: [69080.562235] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 00:35:06 juju-e4d256-prod-github-runner-207 kernel: [69080.563290] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 00:35:06 juju-e4d256-prod-github-runner-207 kernel: [69080.564455] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 00:35:06 juju-e4d256-prod-github-runner-207 kernel: [69080.565613] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 00:35:06 juju-e4d256-prod-github-runner-207 kernel: [69080.566770] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 00:35:06 juju-e4d256-prod-github-runner-207 kernel: [69080.567973] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 00:35:06 juju-e4d256-prod-github-runner-207 kernel: [69080.569210] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 00:35:06 juju-e4d256-prod-github-runner-207 kernel: [69080.570443] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 00:35:06 juju-e4d256-prod-github-runner-207 kernel: [69080.571555] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 00:35:06 juju-e4d256-prod-github-runner-207 kernel: [69080.572742] Call Trace: Aug 23 00:35:06 juju-e4d256-prod-github-runner-207 kernel: [69080.573649] Aug 23 00:35:06 juju-e4d256-prod-github-runner-207 kernel: [69080.574549] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:35:06 juju-e4d256-prod-github-runner-207 kernel: [69080.575591] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:35:06 juju-e4d256-prod-github-runner-207 kernel: [69080.576614] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:35:06 juju-e4d256-prod-github-runner-207 kernel: [69080.577705] ? show_regs.part.0+0x23/0x29 Aug 23 00:35:06 juju-e4d256-prod-github-runner-207 kernel: [69080.578699] ? show_regs.cold+0x8/0xd Aug 23 00:35:06 juju-e4d256-prod-github-runner-207 kernel: [69080.579676] ? watchdog_timer_fn+0x1be/0x220 Aug 23 00:35:06 juju-e4d256-prod-github-runner-207 kernel: [69080.580681] ? lockup_detector_update_enable+0x60/0x60 Aug 23 00:35:06 juju-e4d256-prod-github-runner-207 kernel: [69080.581764] ? __hrtimer_run_queues+0x107/0x230 Aug 23 00:35:06 juju-e4d256-prod-github-runner-207 kernel: [69080.582791] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 00:35:06 juju-e4d256-prod-github-runner-207 kernel: [69080.583830] ? hrtimer_interrupt+0x101/0x220 Aug 23 00:35:06 juju-e4d256-prod-github-runner-207 kernel: [69080.584843] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 00:35:06 juju-e4d256-prod-github-runner-207 kernel: [69080.585909] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 00:35:06 juju-e4d256-prod-github-runner-207 kernel: [69080.586966] Aug 23 00:35:06 juju-e4d256-prod-github-runner-207 kernel: [69080.587824] Aug 23 00:35:06 juju-e4d256-prod-github-runner-207 kernel: [69080.588660] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 00:35:06 juju-e4d256-prod-github-runner-207 kernel: [69080.589691] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:35:06 juju-e4d256-prod-github-runner-207 kernel: [69080.590882] ? _raw_spin_lock+0x22/0x30 Aug 23 00:35:06 juju-e4d256-prod-github-runner-207 kernel: [69080.591926] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:35:06 juju-e4d256-prod-github-runner-207 kernel: [69080.593036] direct_page_fault+0x206/0x310 [kvm] Aug 23 00:35:06 juju-e4d256-prod-github-runner-207 kernel: [69080.594164] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 00:35:06 juju-e4d256-prod-github-runner-207 kernel: [69080.595285] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 00:35:06 juju-e4d256-prod-github-runner-207 kernel: [69080.596398] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 00:35:06 juju-e4d256-prod-github-runner-207 kernel: [69080.597501] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 00:35:06 juju-e4d256-prod-github-runner-207 kernel: [69080.598549] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 00:35:06 juju-e4d256-prod-github-runner-207 kernel: [69080.599667] handle_exit+0x98/0x230 [kvm_amd] Aug 23 00:35:06 juju-e4d256-prod-github-runner-207 kernel: [69080.600654] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 00:35:06 juju-e4d256-prod-github-runner-207 kernel: [69080.601668] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 00:35:06 juju-e4d256-prod-github-runner-207 kernel: [69080.602693] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 00:35:06 juju-e4d256-prod-github-runner-207 kernel: [69080.603720] vcpu_run+0x62/0x2c0 [kvm] Aug 23 00:35:06 juju-e4d256-prod-github-runner-207 kernel: [69080.604610] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 00:35:06 juju-e4d256-prod-github-runner-207 kernel: [69080.605506] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 00:35:06 juju-e4d256-prod-github-runner-207 kernel: [69080.606464] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 00:35:06 juju-e4d256-prod-github-runner-207 kernel: [69080.607359] ? __seccomp_filter+0x4a/0x4a0 Aug 23 00:35:06 juju-e4d256-prod-github-runner-207 kernel: [69080.608189] ? __fget_files+0x86/0xc0 Aug 23 00:35:06 juju-e4d256-prod-github-runner-207 kernel: [69080.608972] __x64_sys_ioctl+0x95/0xd0 Aug 23 00:35:06 juju-e4d256-prod-github-runner-207 kernel: [69080.609742] do_syscall_64+0x5c/0xc0 Aug 23 00:35:06 juju-e4d256-prod-github-runner-207 kernel: [69080.610480] ? do_futex+0x162/0x1f0 Aug 23 00:35:06 juju-e4d256-prod-github-runner-207 kernel: [69080.611227] ? __x64_sys_futex+0x78/0x1e0 Aug 23 00:35:06 juju-e4d256-prod-github-runner-207 kernel: [69080.611986] ? __secure_computing+0xa9/0x120 Aug 23 00:35:06 juju-e4d256-prod-github-runner-207 kernel: [69080.612773] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 00:35:06 juju-e4d256-prod-github-runner-207 kernel: [69080.613639] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:35:06 juju-e4d256-prod-github-runner-207 kernel: [69080.614455] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:35:06 juju-e4d256-prod-github-runner-207 kernel: [69080.615280] ? do_syscall_64+0x69/0xc0 Aug 23 00:35:06 juju-e4d256-prod-github-runner-207 kernel: [69080.616006] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:35:06 juju-e4d256-prod-github-runner-207 kernel: [69080.616803] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:35:06 juju-e4d256-prod-github-runner-207 kernel: [69080.617592] ? do_syscall_64+0x69/0xc0 Aug 23 00:35:06 juju-e4d256-prod-github-runner-207 kernel: [69080.618298] ? do_syscall_64+0x69/0xc0 Aug 23 00:35:06 juju-e4d256-prod-github-runner-207 kernel: [69080.619010] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 00:35:06 juju-e4d256-prod-github-runner-207 kernel: [69080.619819] RIP: 0033:0x7faa5d0edaff Aug 23 00:35:06 juju-e4d256-prod-github-runner-207 kernel: [69080.620546] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 00:35:06 juju-e4d256-prod-github-runner-207 kernel: [69080.622892] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 00:35:06 juju-e4d256-prod-github-runner-207 kernel: [69080.623968] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 00:35:06 juju-e4d256-prod-github-runner-207 kernel: [69080.624995] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 00:35:06 juju-e4d256-prod-github-runner-207 kernel: [69080.626027] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 00:35:06 juju-e4d256-prod-github-runner-207 kernel: [69080.627069] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 00:35:06 juju-e4d256-prod-github-runner-207 kernel: [69080.628097] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 00:35:06 juju-e4d256-prod-github-runner-207 kernel: [69080.629136] Aug 23 00:35:34 juju-e4d256-prod-github-runner-207 kernel: [69108.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 64254s! [qemu-system-x86:6715] Aug 23 00:35:34 juju-e4d256-prod-github-runner-207 kernel: [69108.543082] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 00:35:34 juju-e4d256-prod-github-runner-207 kernel: [69108.543147] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 00:35:34 juju-e4d256-prod-github-runner-207 kernel: [69108.555211] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 00:35:34 juju-e4d256-prod-github-runner-207 kernel: [69108.556481] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 00:35:34 juju-e4d256-prod-github-runner-207 kernel: [69108.557698] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:35:34 juju-e4d256-prod-github-runner-207 kernel: [69108.558767] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 00:35:34 juju-e4d256-prod-github-runner-207 kernel: [69108.561307] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 00:35:34 juju-e4d256-prod-github-runner-207 kernel: [69108.562350] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 00:35:34 juju-e4d256-prod-github-runner-207 kernel: [69108.563533] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 00:35:34 juju-e4d256-prod-github-runner-207 kernel: [69108.564696] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 00:35:34 juju-e4d256-prod-github-runner-207 kernel: [69108.565863] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 00:35:34 juju-e4d256-prod-github-runner-207 kernel: [69108.567038] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 00:35:34 juju-e4d256-prod-github-runner-207 kernel: [69108.568205] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 00:35:34 juju-e4d256-prod-github-runner-207 kernel: [69108.569438] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 00:35:34 juju-e4d256-prod-github-runner-207 kernel: [69108.570535] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 00:35:34 juju-e4d256-prod-github-runner-207 kernel: [69108.571737] Call Trace: Aug 23 00:35:34 juju-e4d256-prod-github-runner-207 kernel: [69108.572648] Aug 23 00:35:34 juju-e4d256-prod-github-runner-207 kernel: [69108.573550] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:35:34 juju-e4d256-prod-github-runner-207 kernel: [69108.574612] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:35:34 juju-e4d256-prod-github-runner-207 kernel: [69108.575631] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:35:34 juju-e4d256-prod-github-runner-207 kernel: [69108.576708] ? show_regs.part.0+0x23/0x29 Aug 23 00:35:34 juju-e4d256-prod-github-runner-207 kernel: [69108.577708] ? show_regs.cold+0x8/0xd Aug 23 00:35:34 juju-e4d256-prod-github-runner-207 kernel: [69108.578734] ? watchdog_timer_fn+0x1be/0x220 Aug 23 00:35:34 juju-e4d256-prod-github-runner-207 kernel: [69108.579753] ? lockup_detector_update_enable+0x60/0x60 Aug 23 00:35:34 juju-e4d256-prod-github-runner-207 kernel: [69108.580820] ? __hrtimer_run_queues+0x107/0x230 Aug 23 00:35:34 juju-e4d256-prod-github-runner-207 kernel: [69108.581845] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 00:35:34 juju-e4d256-prod-github-runner-207 kernel: [69108.582898] ? hrtimer_interrupt+0x101/0x220 Aug 23 00:35:34 juju-e4d256-prod-github-runner-207 kernel: [69108.583913] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 00:35:34 juju-e4d256-prod-github-runner-207 kernel: [69108.584984] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 00:35:34 juju-e4d256-prod-github-runner-207 kernel: [69108.586027] Aug 23 00:35:34 juju-e4d256-prod-github-runner-207 kernel: [69108.586929] Aug 23 00:35:34 juju-e4d256-prod-github-runner-207 kernel: [69108.587773] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 00:35:34 juju-e4d256-prod-github-runner-207 kernel: [69108.588803] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:35:34 juju-e4d256-prod-github-runner-207 kernel: [69108.589841] ? _raw_spin_lock+0x22/0x30 Aug 23 00:35:34 juju-e4d256-prod-github-runner-207 kernel: [69108.590800] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:35:34 juju-e4d256-prod-github-runner-207 kernel: [69108.591818] direct_page_fault+0x206/0x310 [kvm] Aug 23 00:35:34 juju-e4d256-prod-github-runner-207 kernel: [69108.592838] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 00:35:34 juju-e4d256-prod-github-runner-207 kernel: [69108.593844] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 00:35:34 juju-e4d256-prod-github-runner-207 kernel: [69108.594861] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 00:35:34 juju-e4d256-prod-github-runner-207 kernel: [69108.595828] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 00:35:34 juju-e4d256-prod-github-runner-207 kernel: [69108.596770] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 00:35:34 juju-e4d256-prod-github-runner-207 kernel: [69108.597749] handle_exit+0x98/0x230 [kvm_amd] Aug 23 00:35:34 juju-e4d256-prod-github-runner-207 kernel: [69108.598651] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 00:35:34 juju-e4d256-prod-github-runner-207 kernel: [69108.599567] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 00:35:34 juju-e4d256-prod-github-runner-207 kernel: [69108.600492] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 00:35:34 juju-e4d256-prod-github-runner-207 kernel: [69108.601398] vcpu_run+0x62/0x2c0 [kvm] Aug 23 00:35:34 juju-e4d256-prod-github-runner-207 kernel: [69108.602233] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 00:35:34 juju-e4d256-prod-github-runner-207 kernel: [69108.603060] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 00:35:34 juju-e4d256-prod-github-runner-207 kernel: [69108.604141] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 00:35:34 juju-e4d256-prod-github-runner-207 kernel: [69108.605079] ? __seccomp_filter+0x4a/0x4a0 Aug 23 00:35:34 juju-e4d256-prod-github-runner-207 kernel: [69108.605821] ? __fget_files+0x86/0xc0 Aug 23 00:35:34 juju-e4d256-prod-github-runner-207 kernel: [69108.606528] __x64_sys_ioctl+0x95/0xd0 Aug 23 00:35:34 juju-e4d256-prod-github-runner-207 kernel: [69108.607240] do_syscall_64+0x5c/0xc0 Aug 23 00:35:34 juju-e4d256-prod-github-runner-207 kernel: [69108.607904] ? do_futex+0x162/0x1f0 Aug 23 00:35:34 juju-e4d256-prod-github-runner-207 kernel: [69108.608587] ? __x64_sys_futex+0x78/0x1e0 Aug 23 00:35:34 juju-e4d256-prod-github-runner-207 kernel: [69108.609267] ? __secure_computing+0xa9/0x120 Aug 23 00:35:34 juju-e4d256-prod-github-runner-207 kernel: [69108.609959] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 00:35:34 juju-e4d256-prod-github-runner-207 kernel: [69108.610741] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:35:34 juju-e4d256-prod-github-runner-207 kernel: [69108.611464] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:35:34 juju-e4d256-prod-github-runner-207 kernel: [69108.612181] ? do_syscall_64+0x69/0xc0 Aug 23 00:35:34 juju-e4d256-prod-github-runner-207 kernel: [69108.612825] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:35:34 juju-e4d256-prod-github-runner-207 kernel: [69108.613536] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:35:34 juju-e4d256-prod-github-runner-207 kernel: [69108.614231] ? do_syscall_64+0x69/0xc0 Aug 23 00:35:34 juju-e4d256-prod-github-runner-207 kernel: [69108.614869] ? do_syscall_64+0x69/0xc0 Aug 23 00:35:34 juju-e4d256-prod-github-runner-207 kernel: [69108.615492] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 00:35:34 juju-e4d256-prod-github-runner-207 kernel: [69108.616197] RIP: 0033:0x7faa5d0edaff Aug 23 00:35:34 juju-e4d256-prod-github-runner-207 kernel: [69108.616844] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 00:35:34 juju-e4d256-prod-github-runner-207 kernel: [69108.618841] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 00:35:34 juju-e4d256-prod-github-runner-207 kernel: [69108.619756] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 00:35:34 juju-e4d256-prod-github-runner-207 kernel: [69108.620649] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 00:35:34 juju-e4d256-prod-github-runner-207 kernel: [69108.621540] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 00:35:34 juju-e4d256-prod-github-runner-207 kernel: [69108.622427] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 00:35:34 juju-e4d256-prod-github-runner-207 kernel: [69108.623331] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 00:35:34 juju-e4d256-prod-github-runner-207 kernel: [69108.624225] Aug 23 00:35:47 juju-e4d256-prod-github-runner-207 kernel: [69121.796706] rcu: INFO: rcu_sched self-detected stall on CPU Aug 23 00:35:47 juju-e4d256-prod-github-runner-207 kernel: [69121.797669] rcu: 1-....: (17196765 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=8303006 Aug 23 00:35:47 juju-e4d256-prod-github-runner-207 kernel: [69121.798802] (t=17251149 jiffies g=23269 q=59841) Aug 23 00:35:47 juju-e4d256-prod-github-runner-207 kernel: [69121.799592] NMI backtrace for cpu 1 Aug 23 00:35:47 juju-e4d256-prod-github-runner-207 kernel: [69121.800302] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 00:35:47 juju-e4d256-prod-github-runner-207 kernel: [69121.801408] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 00:35:47 juju-e4d256-prod-github-runner-207 kernel: [69121.802489] Call Trace: Aug 23 00:35:47 juju-e4d256-prod-github-runner-207 kernel: [69121.803166] Aug 23 00:35:47 juju-e4d256-prod-github-runner-207 kernel: [69121.803810] show_stack+0x52/0x5c Aug 23 00:35:47 juju-e4d256-prod-github-runner-207 kernel: [69121.804536] dump_stack_lvl+0x4a/0x63 Aug 23 00:35:47 juju-e4d256-prod-github-runner-207 kernel: [69121.805282] dump_stack+0x10/0x16 Aug 23 00:35:47 juju-e4d256-prod-github-runner-207 kernel: [69121.806001] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 23 00:35:47 juju-e4d256-prod-github-runner-207 kernel: [69121.806810] ? lapic_can_unplug_cpu+0x90/0x90 Aug 23 00:35:47 juju-e4d256-prod-github-runner-207 kernel: [69121.807594] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 23 00:35:47 juju-e4d256-prod-github-runner-207 kernel: [69121.808414] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 23 00:35:47 juju-e4d256-prod-github-runner-207 kernel: [69121.809236] trigger_single_cpu_backtrace+0x44/0x4f Aug 23 00:35:47 juju-e4d256-prod-github-runner-207 kernel: [69121.810045] rcu_dump_cpu_stacks+0x102/0x149 Aug 23 00:35:47 juju-e4d256-prod-github-runner-207 kernel: [69121.810833] print_cpu_stall.cold+0x2f/0xe2 Aug 23 00:35:47 juju-e4d256-prod-github-runner-207 kernel: [69121.811599] ? timekeeping_update+0xf7/0x150 Aug 23 00:35:47 juju-e4d256-prod-github-runner-207 kernel: [69121.812378] check_cpu_stall+0x109/0x270 Aug 23 00:35:47 juju-e4d256-prod-github-runner-207 kernel: [69121.813124] rcu_sched_clock_irq+0x9a/0x250 Aug 23 00:35:47 juju-e4d256-prod-github-runner-207 kernel: [69121.814002] update_process_times+0x94/0xd0 Aug 23 00:35:47 juju-e4d256-prod-github-runner-207 kernel: [69121.814818] tick_sched_handle+0x29/0x70 Aug 23 00:35:47 juju-e4d256-prod-github-runner-207 kernel: [69121.815565] tick_sched_timer+0x8c/0xc0 Aug 23 00:35:47 juju-e4d256-prod-github-runner-207 kernel: [69121.816302] ? tick_nohz_handler+0xb0/0xb0 Aug 23 00:35:47 juju-e4d256-prod-github-runner-207 kernel: [69121.817064] __hrtimer_run_queues+0x107/0x230 Aug 23 00:35:47 juju-e4d256-prod-github-runner-207 kernel: [69121.817839] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 00:35:47 juju-e4d256-prod-github-runner-207 kernel: [69121.818634] hrtimer_interrupt+0x101/0x220 Aug 23 00:35:47 juju-e4d256-prod-github-runner-207 kernel: [69121.819393] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 00:35:47 juju-e4d256-prod-github-runner-207 kernel: [69121.820204] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 00:35:47 juju-e4d256-prod-github-runner-207 kernel: [69121.821004] Aug 23 00:35:47 juju-e4d256-prod-github-runner-207 kernel: [69121.821641] Aug 23 00:35:47 juju-e4d256-prod-github-runner-207 kernel: [69121.822276] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 00:35:47 juju-e4d256-prod-github-runner-207 kernel: [69121.823131] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:35:47 juju-e4d256-prod-github-runner-207 kernel: [69121.824025] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 00:35:47 juju-e4d256-prod-github-runner-207 kernel: [69121.826229] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 00:35:47 juju-e4d256-prod-github-runner-207 kernel: [69121.827133] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 00:35:47 juju-e4d256-prod-github-runner-207 kernel: [69121.828154] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 00:35:47 juju-e4d256-prod-github-runner-207 kernel: [69121.829134] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 00:35:47 juju-e4d256-prod-github-runner-207 kernel: [69121.830097] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 00:35:47 juju-e4d256-prod-github-runner-207 kernel: [69121.831069] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 00:35:47 juju-e4d256-prod-github-runner-207 kernel: [69121.832020] ? _raw_spin_lock+0x22/0x30 Aug 23 00:35:47 juju-e4d256-prod-github-runner-207 kernel: [69121.832818] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:35:47 juju-e4d256-prod-github-runner-207 kernel: [69121.833656] direct_page_fault+0x206/0x310 [kvm] Aug 23 00:35:47 juju-e4d256-prod-github-runner-207 kernel: [69121.834506] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 00:35:47 juju-e4d256-prod-github-runner-207 kernel: [69121.835333] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 00:35:47 juju-e4d256-prod-github-runner-207 kernel: [69121.836155] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 00:35:47 juju-e4d256-prod-github-runner-207 kernel: [69121.836961] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 00:35:47 juju-e4d256-prod-github-runner-207 kernel: [69121.837764] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 00:35:47 juju-e4d256-prod-github-runner-207 kernel: [69121.838606] handle_exit+0x98/0x230 [kvm_amd] Aug 23 00:35:47 juju-e4d256-prod-github-runner-207 kernel: [69121.839359] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 00:35:47 juju-e4d256-prod-github-runner-207 kernel: [69121.840146] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 00:35:47 juju-e4d256-prod-github-runner-207 kernel: [69121.840963] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 00:35:47 juju-e4d256-prod-github-runner-207 kernel: [69121.841756] vcpu_run+0x62/0x2c0 [kvm] Aug 23 00:35:47 juju-e4d256-prod-github-runner-207 kernel: [69121.842485] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 00:35:47 juju-e4d256-prod-github-runner-207 kernel: [69121.843245] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 00:35:47 juju-e4d256-prod-github-runner-207 kernel: [69121.844048] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 00:35:47 juju-e4d256-prod-github-runner-207 kernel: [69121.844810] ? __seccomp_filter+0x4a/0x4a0 Aug 23 00:35:47 juju-e4d256-prod-github-runner-207 kernel: [69121.845529] ? __fget_files+0x86/0xc0 Aug 23 00:35:47 juju-e4d256-prod-github-runner-207 kernel: [69121.846220] __x64_sys_ioctl+0x95/0xd0 Aug 23 00:35:47 juju-e4d256-prod-github-runner-207 kernel: [69121.846926] do_syscall_64+0x5c/0xc0 Aug 23 00:35:47 juju-e4d256-prod-github-runner-207 kernel: [69121.847617] ? do_futex+0x162/0x1f0 Aug 23 00:35:47 juju-e4d256-prod-github-runner-207 kernel: [69121.848359] ? __x64_sys_futex+0x78/0x1e0 Aug 23 00:35:47 juju-e4d256-prod-github-runner-207 kernel: [69121.849063] ? __secure_computing+0xa9/0x120 Aug 23 00:35:47 juju-e4d256-prod-github-runner-207 kernel: [69121.849779] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 00:35:47 juju-e4d256-prod-github-runner-207 kernel: [69121.850591] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:35:47 juju-e4d256-prod-github-runner-207 kernel: [69121.851345] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:35:47 juju-e4d256-prod-github-runner-207 kernel: [69121.852097] ? do_syscall_64+0x69/0xc0 Aug 23 00:35:47 juju-e4d256-prod-github-runner-207 kernel: [69121.852791] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:35:47 juju-e4d256-prod-github-runner-207 kernel: [69121.853553] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:35:47 juju-e4d256-prod-github-runner-207 kernel: [69121.854313] ? do_syscall_64+0x69/0xc0 Aug 23 00:35:47 juju-e4d256-prod-github-runner-207 kernel: [69121.855019] ? do_syscall_64+0x69/0xc0 Aug 23 00:35:47 juju-e4d256-prod-github-runner-207 kernel: [69121.855706] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 00:35:47 juju-e4d256-prod-github-runner-207 kernel: [69121.856474] RIP: 0033:0x7faa5d0edaff Aug 23 00:35:47 juju-e4d256-prod-github-runner-207 kernel: [69121.857154] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 00:35:47 juju-e4d256-prod-github-runner-207 kernel: [69121.859263] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 00:35:47 juju-e4d256-prod-github-runner-207 kernel: [69121.860226] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 00:35:47 juju-e4d256-prod-github-runner-207 kernel: [69121.861171] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 00:35:47 juju-e4d256-prod-github-runner-207 kernel: [69121.862115] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 00:35:47 juju-e4d256-prod-github-runner-207 kernel: [69121.863069] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 00:35:47 juju-e4d256-prod-github-runner-207 kernel: [69121.864009] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 00:35:47 juju-e4d256-prod-github-runner-207 kernel: [69121.864931] Aug 23 00:36:14 juju-e4d256-prod-github-runner-207 kernel: [69148.541980] watchdog: BUG: soft lockup - CPU#1 stuck for 64291s! [qemu-system-x86:6715] Aug 23 00:36:14 juju-e4d256-prod-github-runner-207 kernel: [69148.543111] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 00:36:14 juju-e4d256-prod-github-runner-207 kernel: [69148.543180] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 00:36:14 juju-e4d256-prod-github-runner-207 kernel: [69148.555272] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 00:36:14 juju-e4d256-prod-github-runner-207 kernel: [69148.556540] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 00:36:14 juju-e4d256-prod-github-runner-207 kernel: [69148.557760] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:36:14 juju-e4d256-prod-github-runner-207 kernel: [69148.558828] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 00:36:14 juju-e4d256-prod-github-runner-207 kernel: [69148.561367] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 00:36:14 juju-e4d256-prod-github-runner-207 kernel: [69148.562420] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 00:36:14 juju-e4d256-prod-github-runner-207 kernel: [69148.563583] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 00:36:14 juju-e4d256-prod-github-runner-207 kernel: [69148.564743] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 00:36:14 juju-e4d256-prod-github-runner-207 kernel: [69148.565904] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 00:36:14 juju-e4d256-prod-github-runner-207 kernel: [69148.567082] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 00:36:14 juju-e4d256-prod-github-runner-207 kernel: [69148.568250] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 00:36:14 juju-e4d256-prod-github-runner-207 kernel: [69148.569484] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 00:36:14 juju-e4d256-prod-github-runner-207 kernel: [69148.570614] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 00:36:14 juju-e4d256-prod-github-runner-207 kernel: [69148.571830] Call Trace: Aug 23 00:36:14 juju-e4d256-prod-github-runner-207 kernel: [69148.572750] Aug 23 00:36:14 juju-e4d256-prod-github-runner-207 kernel: [69148.573632] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:36:14 juju-e4d256-prod-github-runner-207 kernel: [69148.574677] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:36:14 juju-e4d256-prod-github-runner-207 kernel: [69148.575695] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:36:14 juju-e4d256-prod-github-runner-207 kernel: [69148.576768] ? show_regs.part.0+0x23/0x29 Aug 23 00:36:14 juju-e4d256-prod-github-runner-207 kernel: [69148.577763] ? show_regs.cold+0x8/0xd Aug 23 00:36:14 juju-e4d256-prod-github-runner-207 kernel: [69148.578745] ? watchdog_timer_fn+0x1be/0x220 Aug 23 00:36:14 juju-e4d256-prod-github-runner-207 kernel: [69148.579752] ? lockup_detector_update_enable+0x60/0x60 Aug 23 00:36:14 juju-e4d256-prod-github-runner-207 kernel: [69148.580817] ? __hrtimer_run_queues+0x107/0x230 Aug 23 00:36:14 juju-e4d256-prod-github-runner-207 kernel: [69148.581847] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 00:36:14 juju-e4d256-prod-github-runner-207 kernel: [69148.582879] ? hrtimer_interrupt+0x101/0x220 Aug 23 00:36:14 juju-e4d256-prod-github-runner-207 kernel: [69148.583892] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 00:36:14 juju-e4d256-prod-github-runner-207 kernel: [69148.584959] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 00:36:14 juju-e4d256-prod-github-runner-207 kernel: [69148.586003] Aug 23 00:36:14 juju-e4d256-prod-github-runner-207 kernel: [69148.586871] Aug 23 00:36:14 juju-e4d256-prod-github-runner-207 kernel: [69148.587708] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 00:36:14 juju-e4d256-prod-github-runner-207 kernel: [69148.588740] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:36:14 juju-e4d256-prod-github-runner-207 kernel: [69148.589774] ? _raw_spin_lock+0x22/0x30 Aug 23 00:36:14 juju-e4d256-prod-github-runner-207 kernel: [69148.590735] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:36:14 juju-e4d256-prod-github-runner-207 kernel: [69148.591747] direct_page_fault+0x206/0x310 [kvm] Aug 23 00:36:14 juju-e4d256-prod-github-runner-207 kernel: [69148.592788] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 00:36:14 juju-e4d256-prod-github-runner-207 kernel: [69148.593807] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 00:36:14 juju-e4d256-prod-github-runner-207 kernel: [69148.594821] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 00:36:14 juju-e4d256-prod-github-runner-207 kernel: [69148.595789] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 00:36:14 juju-e4d256-prod-github-runner-207 kernel: [69148.596732] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 00:36:14 juju-e4d256-prod-github-runner-207 kernel: [69148.597708] handle_exit+0x98/0x230 [kvm_amd] Aug 23 00:36:14 juju-e4d256-prod-github-runner-207 kernel: [69148.598613] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 00:36:14 juju-e4d256-prod-github-runner-207 kernel: [69148.599526] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 00:36:14 juju-e4d256-prod-github-runner-207 kernel: [69148.600459] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 00:36:14 juju-e4d256-prod-github-runner-207 kernel: [69148.601362] vcpu_run+0x62/0x2c0 [kvm] Aug 23 00:36:14 juju-e4d256-prod-github-runner-207 kernel: [69148.602213] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 00:36:14 juju-e4d256-prod-github-runner-207 kernel: [69148.603030] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 00:36:14 juju-e4d256-prod-github-runner-207 kernel: [69148.603883] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 00:36:14 juju-e4d256-prod-github-runner-207 kernel: [69148.604677] ? __seccomp_filter+0x4a/0x4a0 Aug 23 00:36:14 juju-e4d256-prod-github-runner-207 kernel: [69148.605418] ? __fget_files+0x86/0xc0 Aug 23 00:36:14 juju-e4d256-prod-github-runner-207 kernel: [69148.606140] __x64_sys_ioctl+0x95/0xd0 Aug 23 00:36:14 juju-e4d256-prod-github-runner-207 kernel: [69148.606830] do_syscall_64+0x5c/0xc0 Aug 23 00:36:14 juju-e4d256-prod-github-runner-207 kernel: [69148.607492] ? do_futex+0x162/0x1f0 Aug 23 00:36:14 juju-e4d256-prod-github-runner-207 kernel: [69148.608140] ? __x64_sys_futex+0x78/0x1e0 Aug 23 00:36:14 juju-e4d256-prod-github-runner-207 kernel: [69148.608813] ? __secure_computing+0xa9/0x120 Aug 23 00:36:14 juju-e4d256-prod-github-runner-207 kernel: [69148.609500] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 00:36:14 juju-e4d256-prod-github-runner-207 kernel: [69148.610278] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:36:14 juju-e4d256-prod-github-runner-207 kernel: [69148.610999] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:36:14 juju-e4d256-prod-github-runner-207 kernel: [69148.611716] ? do_syscall_64+0x69/0xc0 Aug 23 00:36:14 juju-e4d256-prod-github-runner-207 kernel: [69148.612359] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:36:14 juju-e4d256-prod-github-runner-207 kernel: [69148.613061] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:36:14 juju-e4d256-prod-github-runner-207 kernel: [69148.613756] ? do_syscall_64+0x69/0xc0 Aug 23 00:36:14 juju-e4d256-prod-github-runner-207 kernel: [69148.614390] ? do_syscall_64+0x69/0xc0 Aug 23 00:36:14 juju-e4d256-prod-github-runner-207 kernel: [69148.615016] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 00:36:14 juju-e4d256-prod-github-runner-207 kernel: [69148.615719] RIP: 0033:0x7faa5d0edaff Aug 23 00:36:14 juju-e4d256-prod-github-runner-207 kernel: [69148.616340] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 00:36:14 juju-e4d256-prod-github-runner-207 kernel: [69148.618335] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 00:36:14 juju-e4d256-prod-github-runner-207 kernel: [69148.619246] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 00:36:14 juju-e4d256-prod-github-runner-207 kernel: [69148.620132] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 00:36:14 juju-e4d256-prod-github-runner-207 kernel: [69148.621019] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 00:36:14 juju-e4d256-prod-github-runner-207 kernel: [69148.621904] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 00:36:14 juju-e4d256-prod-github-runner-207 kernel: [69148.622803] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 00:36:14 juju-e4d256-prod-github-runner-207 kernel: [69148.623692] Aug 23 00:36:42 juju-e4d256-prod-github-runner-207 kernel: [69176.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 64317s! [qemu-system-x86:6715] Aug 23 00:36:42 juju-e4d256-prod-github-runner-207 kernel: [69176.543710] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 00:36:42 juju-e4d256-prod-github-runner-207 kernel: [69176.543959] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 00:36:42 juju-e4d256-prod-github-runner-207 kernel: [69176.556289] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 00:36:42 juju-e4d256-prod-github-runner-207 kernel: [69176.557573] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 00:36:42 juju-e4d256-prod-github-runner-207 kernel: [69176.558818] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:36:42 juju-e4d256-prod-github-runner-207 kernel: [69176.559875] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 00:36:42 juju-e4d256-prod-github-runner-207 kernel: [69176.562465] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 00:36:42 juju-e4d256-prod-github-runner-207 kernel: [69176.563520] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 00:36:42 juju-e4d256-prod-github-runner-207 kernel: [69176.564684] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 00:36:42 juju-e4d256-prod-github-runner-207 kernel: [69176.565871] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 00:36:42 juju-e4d256-prod-github-runner-207 kernel: [69176.567213] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 00:36:42 juju-e4d256-prod-github-runner-207 kernel: [69176.568384] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 00:36:42 juju-e4d256-prod-github-runner-207 kernel: [69176.569558] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 00:36:42 juju-e4d256-prod-github-runner-207 kernel: [69176.570811] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 00:36:42 juju-e4d256-prod-github-runner-207 kernel: [69176.571927] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 00:36:42 juju-e4d256-prod-github-runner-207 kernel: [69176.573155] Call Trace: Aug 23 00:36:42 juju-e4d256-prod-github-runner-207 kernel: [69176.574085] Aug 23 00:36:42 juju-e4d256-prod-github-runner-207 kernel: [69176.574992] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:36:42 juju-e4d256-prod-github-runner-207 kernel: [69176.576021] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:36:42 juju-e4d256-prod-github-runner-207 kernel: [69176.577058] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:36:42 juju-e4d256-prod-github-runner-207 kernel: [69176.578196] ? show_regs.part.0+0x23/0x29 Aug 23 00:36:42 juju-e4d256-prod-github-runner-207 kernel: [69176.579195] ? show_regs.cold+0x8/0xd Aug 23 00:36:42 juju-e4d256-prod-github-runner-207 kernel: [69176.580172] ? watchdog_timer_fn+0x1be/0x220 Aug 23 00:36:42 juju-e4d256-prod-github-runner-207 kernel: [69176.581184] ? lockup_detector_update_enable+0x60/0x60 Aug 23 00:36:42 juju-e4d256-prod-github-runner-207 kernel: [69176.582301] ? __hrtimer_run_queues+0x107/0x230 Aug 23 00:36:42 juju-e4d256-prod-github-runner-207 kernel: [69176.583344] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 00:36:42 juju-e4d256-prod-github-runner-207 kernel: [69176.584405] ? hrtimer_interrupt+0x101/0x220 Aug 23 00:36:42 juju-e4d256-prod-github-runner-207 kernel: [69176.585425] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 00:36:42 juju-e4d256-prod-github-runner-207 kernel: [69176.586532] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 00:36:42 juju-e4d256-prod-github-runner-207 kernel: [69176.587595] Aug 23 00:36:42 juju-e4d256-prod-github-runner-207 kernel: [69176.588462] Aug 23 00:36:42 juju-e4d256-prod-github-runner-207 kernel: [69176.589307] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 00:36:42 juju-e4d256-prod-github-runner-207 kernel: [69176.590380] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:36:42 juju-e4d256-prod-github-runner-207 kernel: [69176.591465] ? _raw_spin_lock+0x22/0x30 Aug 23 00:36:42 juju-e4d256-prod-github-runner-207 kernel: [69176.592433] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:36:42 juju-e4d256-prod-github-runner-207 kernel: [69176.593525] direct_page_fault+0x206/0x310 [kvm] Aug 23 00:36:42 juju-e4d256-prod-github-runner-207 kernel: [69176.594572] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 00:36:42 juju-e4d256-prod-github-runner-207 kernel: [69176.595591] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 00:36:42 juju-e4d256-prod-github-runner-207 kernel: [69176.596599] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 00:36:42 juju-e4d256-prod-github-runner-207 kernel: [69176.597618] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 00:36:42 juju-e4d256-prod-github-runner-207 kernel: [69176.598595] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 00:36:42 juju-e4d256-prod-github-runner-207 kernel: [69176.599579] handle_exit+0x98/0x230 [kvm_amd] Aug 23 00:36:42 juju-e4d256-prod-github-runner-207 kernel: [69176.600476] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 00:36:42 juju-e4d256-prod-github-runner-207 kernel: [69176.601400] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 00:36:42 juju-e4d256-prod-github-runner-207 kernel: [69176.602369] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 00:36:42 juju-e4d256-prod-github-runner-207 kernel: [69176.603289] vcpu_run+0x62/0x2c0 [kvm] Aug 23 00:36:42 juju-e4d256-prod-github-runner-207 kernel: [69176.604108] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 00:36:42 juju-e4d256-prod-github-runner-207 kernel: [69176.604919] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 00:36:42 juju-e4d256-prod-github-runner-207 kernel: [69176.605975] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 00:36:42 juju-e4d256-prod-github-runner-207 kernel: [69176.606782] ? __seccomp_filter+0x4a/0x4a0 Aug 23 00:36:42 juju-e4d256-prod-github-runner-207 kernel: [69176.607535] ? __fget_files+0x86/0xc0 Aug 23 00:36:42 juju-e4d256-prod-github-runner-207 kernel: [69176.608243] __x64_sys_ioctl+0x95/0xd0 Aug 23 00:36:42 juju-e4d256-prod-github-runner-207 kernel: [69176.608947] do_syscall_64+0x5c/0xc0 Aug 23 00:36:42 juju-e4d256-prod-github-runner-207 kernel: [69176.609616] ? do_futex+0x162/0x1f0 Aug 23 00:36:42 juju-e4d256-prod-github-runner-207 kernel: [69176.610357] ? __x64_sys_futex+0x78/0x1e0 Aug 23 00:36:42 juju-e4d256-prod-github-runner-207 kernel: [69176.611035] ? __secure_computing+0xa9/0x120 Aug 23 00:36:42 juju-e4d256-prod-github-runner-207 kernel: [69176.611733] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 00:36:42 juju-e4d256-prod-github-runner-207 kernel: [69176.612508] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:36:42 juju-e4d256-prod-github-runner-207 kernel: [69176.613238] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:36:42 juju-e4d256-prod-github-runner-207 kernel: [69176.614006] ? do_syscall_64+0x69/0xc0 Aug 23 00:36:42 juju-e4d256-prod-github-runner-207 kernel: [69176.614664] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:36:42 juju-e4d256-prod-github-runner-207 kernel: [69176.615372] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:36:42 juju-e4d256-prod-github-runner-207 kernel: [69176.616071] ? do_syscall_64+0x69/0xc0 Aug 23 00:36:42 juju-e4d256-prod-github-runner-207 kernel: [69176.616721] ? do_syscall_64+0x69/0xc0 Aug 23 00:36:42 juju-e4d256-prod-github-runner-207 kernel: [69176.617620] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 00:36:42 juju-e4d256-prod-github-runner-207 kernel: [69176.618419] RIP: 0033:0x7faa5d0edaff Aug 23 00:36:42 juju-e4d256-prod-github-runner-207 kernel: [69176.619126] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 00:36:42 juju-e4d256-prod-github-runner-207 kernel: [69176.621140] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 00:36:42 juju-e4d256-prod-github-runner-207 kernel: [69176.622095] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 00:36:42 juju-e4d256-prod-github-runner-207 kernel: [69176.623028] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 00:36:42 juju-e4d256-prod-github-runner-207 kernel: [69176.623982] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 00:36:42 juju-e4d256-prod-github-runner-207 kernel: [69176.624907] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 00:36:42 juju-e4d256-prod-github-runner-207 kernel: [69176.625892] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 00:36:42 juju-e4d256-prod-github-runner-207 kernel: [69176.626864] Aug 23 00:37:10 juju-e4d256-prod-github-runner-207 kernel: [69204.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 64343s! [qemu-system-x86:6715] Aug 23 00:37:10 juju-e4d256-prod-github-runner-207 kernel: [69204.543118] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 00:37:10 juju-e4d256-prod-github-runner-207 kernel: [69204.543187] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 00:37:10 juju-e4d256-prod-github-runner-207 kernel: [69204.556115] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 00:37:10 juju-e4d256-prod-github-runner-207 kernel: [69204.557460] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 00:37:10 juju-e4d256-prod-github-runner-207 kernel: [69204.558777] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:37:10 juju-e4d256-prod-github-runner-207 kernel: [69204.559864] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 00:37:10 juju-e4d256-prod-github-runner-207 kernel: [69204.562626] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 00:37:10 juju-e4d256-prod-github-runner-207 kernel: [69204.563678] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 00:37:10 juju-e4d256-prod-github-runner-207 kernel: [69204.564867] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 00:37:10 juju-e4d256-prod-github-runner-207 kernel: [69204.566064] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 00:37:10 juju-e4d256-prod-github-runner-207 kernel: [69204.567229] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 00:37:10 juju-e4d256-prod-github-runner-207 kernel: [69204.568393] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 00:37:10 juju-e4d256-prod-github-runner-207 kernel: [69204.569622] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 00:37:10 juju-e4d256-prod-github-runner-207 kernel: [69204.571034] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 00:37:10 juju-e4d256-prod-github-runner-207 kernel: [69204.572190] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 00:37:10 juju-e4d256-prod-github-runner-207 kernel: [69204.573460] Call Trace: Aug 23 00:37:10 juju-e4d256-prod-github-runner-207 kernel: [69204.574387] Aug 23 00:37:10 juju-e4d256-prod-github-runner-207 kernel: [69204.575273] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:37:10 juju-e4d256-prod-github-runner-207 kernel: [69204.576304] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:37:10 juju-e4d256-prod-github-runner-207 kernel: [69204.577366] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:37:10 juju-e4d256-prod-github-runner-207 kernel: [69204.578474] ? show_regs.part.0+0x23/0x29 Aug 23 00:37:10 juju-e4d256-prod-github-runner-207 kernel: [69204.579517] ? show_regs.cold+0x8/0xd Aug 23 00:37:10 juju-e4d256-prod-github-runner-207 kernel: [69204.580606] ? watchdog_timer_fn+0x1be/0x220 Aug 23 00:37:10 juju-e4d256-prod-github-runner-207 kernel: [69204.581653] ? lockup_detector_update_enable+0x60/0x60 Aug 23 00:37:10 juju-e4d256-prod-github-runner-207 kernel: [69204.582847] ? __hrtimer_run_queues+0x107/0x230 Aug 23 00:37:10 juju-e4d256-prod-github-runner-207 kernel: [69204.584099] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 00:37:10 juju-e4d256-prod-github-runner-207 kernel: [69204.585237] ? hrtimer_interrupt+0x101/0x220 Aug 23 00:37:10 juju-e4d256-prod-github-runner-207 kernel: [69204.586458] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 00:37:10 juju-e4d256-prod-github-runner-207 kernel: [69204.587530] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 00:37:10 juju-e4d256-prod-github-runner-207 kernel: [69204.588690] Aug 23 00:37:10 juju-e4d256-prod-github-runner-207 kernel: [69204.589599] Aug 23 00:37:10 juju-e4d256-prod-github-runner-207 kernel: [69204.590516] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 00:37:10 juju-e4d256-prod-github-runner-207 kernel: [69204.591563] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:37:10 juju-e4d256-prod-github-runner-207 kernel: [69204.592619] ? _raw_spin_lock+0x22/0x30 Aug 23 00:37:10 juju-e4d256-prod-github-runner-207 kernel: [69204.593685] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:37:10 juju-e4d256-prod-github-runner-207 kernel: [69204.594766] direct_page_fault+0x206/0x310 [kvm] Aug 23 00:37:10 juju-e4d256-prod-github-runner-207 kernel: [69204.595806] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 00:37:10 juju-e4d256-prod-github-runner-207 kernel: [69204.596817] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 00:37:10 juju-e4d256-prod-github-runner-207 kernel: [69204.597848] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 00:37:10 juju-e4d256-prod-github-runner-207 kernel: [69204.598861] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 00:37:10 juju-e4d256-prod-github-runner-207 kernel: [69204.599829] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 00:37:10 juju-e4d256-prod-github-runner-207 kernel: [69204.600811] handle_exit+0x98/0x230 [kvm_amd] Aug 23 00:37:10 juju-e4d256-prod-github-runner-207 kernel: [69204.601724] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 00:37:10 juju-e4d256-prod-github-runner-207 kernel: [69204.602648] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 00:37:10 juju-e4d256-prod-github-runner-207 kernel: [69204.603606] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 00:37:10 juju-e4d256-prod-github-runner-207 kernel: [69204.604517] vcpu_run+0x62/0x2c0 [kvm] Aug 23 00:37:10 juju-e4d256-prod-github-runner-207 kernel: [69204.605417] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 00:37:10 juju-e4d256-prod-github-runner-207 kernel: [69204.606296] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 00:37:10 juju-e4d256-prod-github-runner-207 kernel: [69204.607200] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 00:37:10 juju-e4d256-prod-github-runner-207 kernel: [69204.608086] ? __seccomp_filter+0x4a/0x4a0 Aug 23 00:37:10 juju-e4d256-prod-github-runner-207 kernel: [69204.608845] ? __fget_files+0x86/0xc0 Aug 23 00:37:10 juju-e4d256-prod-github-runner-207 kernel: [69204.609716] __x64_sys_ioctl+0x95/0xd0 Aug 23 00:37:10 juju-e4d256-prod-github-runner-207 kernel: [69204.610574] do_syscall_64+0x5c/0xc0 Aug 23 00:37:10 juju-e4d256-prod-github-runner-207 kernel: [69204.611323] ? do_futex+0x162/0x1f0 Aug 23 00:37:10 juju-e4d256-prod-github-runner-207 kernel: [69204.611989] ? __x64_sys_futex+0x78/0x1e0 Aug 23 00:37:10 juju-e4d256-prod-github-runner-207 kernel: [69204.612709] ? __secure_computing+0xa9/0x120 Aug 23 00:37:10 juju-e4d256-prod-github-runner-207 kernel: [69204.613407] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 00:37:10 juju-e4d256-prod-github-runner-207 kernel: [69204.614203] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:37:10 juju-e4d256-prod-github-runner-207 kernel: [69204.614972] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:37:10 juju-e4d256-prod-github-runner-207 kernel: [69204.615694] ? do_syscall_64+0x69/0xc0 Aug 23 00:37:10 juju-e4d256-prod-github-runner-207 kernel: [69204.616343] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:37:10 juju-e4d256-prod-github-runner-207 kernel: [69204.617053] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:37:10 juju-e4d256-prod-github-runner-207 kernel: [69204.617771] ? do_syscall_64+0x69/0xc0 Aug 23 00:37:10 juju-e4d256-prod-github-runner-207 kernel: [69204.618407] ? do_syscall_64+0x69/0xc0 Aug 23 00:37:10 juju-e4d256-prod-github-runner-207 kernel: [69204.619033] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 00:37:10 juju-e4d256-prod-github-runner-207 kernel: [69204.619757] RIP: 0033:0x7faa5d0edaff Aug 23 00:37:10 juju-e4d256-prod-github-runner-207 kernel: [69204.620388] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 00:37:10 juju-e4d256-prod-github-runner-207 kernel: [69204.622480] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 00:37:10 juju-e4d256-prod-github-runner-207 kernel: [69204.623498] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 00:37:10 juju-e4d256-prod-github-runner-207 kernel: [69204.624398] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 00:37:10 juju-e4d256-prod-github-runner-207 kernel: [69204.625295] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 00:37:10 juju-e4d256-prod-github-runner-207 kernel: [69204.626209] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 00:37:10 juju-e4d256-prod-github-runner-207 kernel: [69204.627118] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 00:37:10 juju-e4d256-prod-github-runner-207 kernel: [69204.628070] Aug 23 00:37:38 juju-e4d256-prod-github-runner-207 kernel: [69232.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 64369s! [qemu-system-x86:6715] Aug 23 00:37:38 juju-e4d256-prod-github-runner-207 kernel: [69232.543078] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 00:37:38 juju-e4d256-prod-github-runner-207 kernel: [69232.543145] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 00:37:38 juju-e4d256-prod-github-runner-207 kernel: [69232.555191] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 00:37:38 juju-e4d256-prod-github-runner-207 kernel: [69232.556452] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 00:37:38 juju-e4d256-prod-github-runner-207 kernel: [69232.557672] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:37:38 juju-e4d256-prod-github-runner-207 kernel: [69232.558733] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 00:37:38 juju-e4d256-prod-github-runner-207 kernel: [69232.561278] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 00:37:38 juju-e4d256-prod-github-runner-207 kernel: [69232.562316] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 00:37:38 juju-e4d256-prod-github-runner-207 kernel: [69232.563473] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 00:37:38 juju-e4d256-prod-github-runner-207 kernel: [69232.564629] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 00:37:38 juju-e4d256-prod-github-runner-207 kernel: [69232.565795] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 00:37:38 juju-e4d256-prod-github-runner-207 kernel: [69232.566968] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 00:37:38 juju-e4d256-prod-github-runner-207 kernel: [69232.568137] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 00:37:38 juju-e4d256-prod-github-runner-207 kernel: [69232.569378] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 00:37:38 juju-e4d256-prod-github-runner-207 kernel: [69232.570480] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 00:37:38 juju-e4d256-prod-github-runner-207 kernel: [69232.571699] Call Trace: Aug 23 00:37:38 juju-e4d256-prod-github-runner-207 kernel: [69232.572611] Aug 23 00:37:38 juju-e4d256-prod-github-runner-207 kernel: [69232.573510] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:37:38 juju-e4d256-prod-github-runner-207 kernel: [69232.574543] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:37:38 juju-e4d256-prod-github-runner-207 kernel: [69232.575567] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:37:38 juju-e4d256-prod-github-runner-207 kernel: [69232.576643] ? show_regs.part.0+0x23/0x29 Aug 23 00:37:38 juju-e4d256-prod-github-runner-207 kernel: [69232.577647] ? show_regs.cold+0x8/0xd Aug 23 00:37:38 juju-e4d256-prod-github-runner-207 kernel: [69232.578622] ? watchdog_timer_fn+0x1be/0x220 Aug 23 00:37:38 juju-e4d256-prod-github-runner-207 kernel: [69232.579630] ? lockup_detector_update_enable+0x60/0x60 Aug 23 00:37:38 juju-e4d256-prod-github-runner-207 kernel: [69232.580692] ? __hrtimer_run_queues+0x107/0x230 Aug 23 00:37:38 juju-e4d256-prod-github-runner-207 kernel: [69232.581732] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 00:37:38 juju-e4d256-prod-github-runner-207 kernel: [69232.582771] ? hrtimer_interrupt+0x101/0x220 Aug 23 00:37:38 juju-e4d256-prod-github-runner-207 kernel: [69232.583783] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 00:37:38 juju-e4d256-prod-github-runner-207 kernel: [69232.584857] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 00:37:38 juju-e4d256-prod-github-runner-207 kernel: [69232.585912] Aug 23 00:37:38 juju-e4d256-prod-github-runner-207 kernel: [69232.586762] Aug 23 00:37:38 juju-e4d256-prod-github-runner-207 kernel: [69232.587597] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 00:37:38 juju-e4d256-prod-github-runner-207 kernel: [69232.588635] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:37:38 juju-e4d256-prod-github-runner-207 kernel: [69232.589827] ? _raw_spin_lock+0x22/0x30 Aug 23 00:37:38 juju-e4d256-prod-github-runner-207 kernel: [69232.590861] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:37:38 juju-e4d256-prod-github-runner-207 kernel: [69232.591963] direct_page_fault+0x206/0x310 [kvm] Aug 23 00:37:38 juju-e4d256-prod-github-runner-207 kernel: [69232.593099] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 00:37:38 juju-e4d256-prod-github-runner-207 kernel: [69232.594196] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 00:37:38 juju-e4d256-prod-github-runner-207 kernel: [69232.595291] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 00:37:38 juju-e4d256-prod-github-runner-207 kernel: [69232.596371] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 00:37:38 juju-e4d256-prod-github-runner-207 kernel: [69232.597448] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 00:37:38 juju-e4d256-prod-github-runner-207 kernel: [69232.598560] handle_exit+0x98/0x230 [kvm_amd] Aug 23 00:37:38 juju-e4d256-prod-github-runner-207 kernel: [69232.599557] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 00:37:38 juju-e4d256-prod-github-runner-207 kernel: [69232.600579] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 00:37:38 juju-e4d256-prod-github-runner-207 kernel: [69232.601628] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 00:37:38 juju-e4d256-prod-github-runner-207 kernel: [69232.602659] vcpu_run+0x62/0x2c0 [kvm] Aug 23 00:37:38 juju-e4d256-prod-github-runner-207 kernel: [69232.603572] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 00:37:38 juju-e4d256-prod-github-runner-207 kernel: [69232.604501] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 00:37:38 juju-e4d256-prod-github-runner-207 kernel: [69232.605500] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 00:37:38 juju-e4d256-prod-github-runner-207 kernel: [69232.606595] ? __seccomp_filter+0x4a/0x4a0 Aug 23 00:37:38 juju-e4d256-prod-github-runner-207 kernel: [69232.607422] ? __fget_files+0x86/0xc0 Aug 23 00:37:38 juju-e4d256-prod-github-runner-207 kernel: [69232.608224] __x64_sys_ioctl+0x95/0xd0 Aug 23 00:37:38 juju-e4d256-prod-github-runner-207 kernel: [69232.609013] do_syscall_64+0x5c/0xc0 Aug 23 00:37:38 juju-e4d256-prod-github-runner-207 kernel: [69232.609766] ? do_futex+0x162/0x1f0 Aug 23 00:37:38 juju-e4d256-prod-github-runner-207 kernel: [69232.610489] ? __x64_sys_futex+0x78/0x1e0 Aug 23 00:37:38 juju-e4d256-prod-github-runner-207 kernel: [69232.611248] ? __secure_computing+0xa9/0x120 Aug 23 00:37:38 juju-e4d256-prod-github-runner-207 kernel: [69232.612020] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 00:37:38 juju-e4d256-prod-github-runner-207 kernel: [69232.612883] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:37:38 juju-e4d256-prod-github-runner-207 kernel: [69232.613723] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:37:38 juju-e4d256-prod-github-runner-207 kernel: [69232.614540] ? do_syscall_64+0x69/0xc0 Aug 23 00:37:38 juju-e4d256-prod-github-runner-207 kernel: [69232.615269] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:37:38 juju-e4d256-prod-github-runner-207 kernel: [69232.616075] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:37:38 juju-e4d256-prod-github-runner-207 kernel: [69232.616873] ? do_syscall_64+0x69/0xc0 Aug 23 00:37:38 juju-e4d256-prod-github-runner-207 kernel: [69232.617589] ? do_syscall_64+0x69/0xc0 Aug 23 00:37:38 juju-e4d256-prod-github-runner-207 kernel: [69232.618295] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 00:37:38 juju-e4d256-prod-github-runner-207 kernel: [69232.619104] RIP: 0033:0x7faa5d0edaff Aug 23 00:37:38 juju-e4d256-prod-github-runner-207 kernel: [69232.619802] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 00:37:38 juju-e4d256-prod-github-runner-207 kernel: [69232.622139] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 00:37:38 juju-e4d256-prod-github-runner-207 kernel: [69232.623191] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 00:37:38 juju-e4d256-prod-github-runner-207 kernel: [69232.624215] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 00:37:38 juju-e4d256-prod-github-runner-207 kernel: [69232.625247] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 00:37:38 juju-e4d256-prod-github-runner-207 kernel: [69232.626268] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 00:37:38 juju-e4d256-prod-github-runner-207 kernel: [69232.627292] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 00:37:38 juju-e4d256-prod-github-runner-207 kernel: [69232.628320] Aug 23 00:38:06 juju-e4d256-prod-github-runner-207 kernel: [69260.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 64395s! [qemu-system-x86:6715] Aug 23 00:38:06 juju-e4d256-prod-github-runner-207 kernel: [69260.543368] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 00:38:06 juju-e4d256-prod-github-runner-207 kernel: [69260.543594] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 00:38:06 juju-e4d256-prod-github-runner-207 kernel: [69260.555739] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 00:38:06 juju-e4d256-prod-github-runner-207 kernel: [69260.557017] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 00:38:06 juju-e4d256-prod-github-runner-207 kernel: [69260.558246] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:38:06 juju-e4d256-prod-github-runner-207 kernel: [69260.559347] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 00:38:06 juju-e4d256-prod-github-runner-207 kernel: [69260.561984] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 00:38:06 juju-e4d256-prod-github-runner-207 kernel: [69260.563035] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 00:38:06 juju-e4d256-prod-github-runner-207 kernel: [69260.564197] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 00:38:06 juju-e4d256-prod-github-runner-207 kernel: [69260.565414] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 00:38:06 juju-e4d256-prod-github-runner-207 kernel: [69260.566704] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 00:38:06 juju-e4d256-prod-github-runner-207 kernel: [69260.567867] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 00:38:06 juju-e4d256-prod-github-runner-207 kernel: [69260.569044] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 00:38:06 juju-e4d256-prod-github-runner-207 kernel: [69260.570277] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 00:38:06 juju-e4d256-prod-github-runner-207 kernel: [69260.571378] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 00:38:06 juju-e4d256-prod-github-runner-207 kernel: [69260.572576] Call Trace: Aug 23 00:38:06 juju-e4d256-prod-github-runner-207 kernel: [69260.573499] Aug 23 00:38:06 juju-e4d256-prod-github-runner-207 kernel: [69260.574388] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:38:06 juju-e4d256-prod-github-runner-207 kernel: [69260.575452] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:38:06 juju-e4d256-prod-github-runner-207 kernel: [69260.576510] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:38:06 juju-e4d256-prod-github-runner-207 kernel: [69260.577621] ? show_regs.part.0+0x23/0x29 Aug 23 00:38:06 juju-e4d256-prod-github-runner-207 kernel: [69260.578619] ? show_regs.cold+0x8/0xd Aug 23 00:38:06 juju-e4d256-prod-github-runner-207 kernel: [69260.579628] ? watchdog_timer_fn+0x1be/0x220 Aug 23 00:38:06 juju-e4d256-prod-github-runner-207 kernel: [69260.580642] ? lockup_detector_update_enable+0x60/0x60 Aug 23 00:38:06 juju-e4d256-prod-github-runner-207 kernel: [69260.581728] ? __hrtimer_run_queues+0x107/0x230 Aug 23 00:38:06 juju-e4d256-prod-github-runner-207 kernel: [69260.582755] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 00:38:06 juju-e4d256-prod-github-runner-207 kernel: [69260.583784] ? hrtimer_interrupt+0x101/0x220 Aug 23 00:38:06 juju-e4d256-prod-github-runner-207 kernel: [69260.584853] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 00:38:06 juju-e4d256-prod-github-runner-207 kernel: [69260.585938] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 00:38:06 juju-e4d256-prod-github-runner-207 kernel: [69260.587009] Aug 23 00:38:06 juju-e4d256-prod-github-runner-207 kernel: [69260.587863] Aug 23 00:38:06 juju-e4d256-prod-github-runner-207 kernel: [69260.588699] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 00:38:06 juju-e4d256-prod-github-runner-207 kernel: [69260.589749] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:38:06 juju-e4d256-prod-github-runner-207 kernel: [69260.590791] ? _raw_spin_lock+0x22/0x30 Aug 23 00:38:06 juju-e4d256-prod-github-runner-207 kernel: [69260.591734] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:38:06 juju-e4d256-prod-github-runner-207 kernel: [69260.592757] direct_page_fault+0x206/0x310 [kvm] Aug 23 00:38:06 juju-e4d256-prod-github-runner-207 kernel: [69260.593836] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 00:38:06 juju-e4d256-prod-github-runner-207 kernel: [69260.594882] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 00:38:06 juju-e4d256-prod-github-runner-207 kernel: [69260.595881] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 00:38:06 juju-e4d256-prod-github-runner-207 kernel: [69260.596885] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 00:38:06 juju-e4d256-prod-github-runner-207 kernel: [69260.597864] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 00:38:06 juju-e4d256-prod-github-runner-207 kernel: [69260.598843] handle_exit+0x98/0x230 [kvm_amd] Aug 23 00:38:06 juju-e4d256-prod-github-runner-207 kernel: [69260.599741] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 00:38:06 juju-e4d256-prod-github-runner-207 kernel: [69260.600661] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 00:38:06 juju-e4d256-prod-github-runner-207 kernel: [69260.601605] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 00:38:06 juju-e4d256-prod-github-runner-207 kernel: [69260.602512] vcpu_run+0x62/0x2c0 [kvm] Aug 23 00:38:06 juju-e4d256-prod-github-runner-207 kernel: [69260.603323] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 00:38:06 juju-e4d256-prod-github-runner-207 kernel: [69260.604131] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 00:38:06 juju-e4d256-prod-github-runner-207 kernel: [69260.604999] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 00:38:06 juju-e4d256-prod-github-runner-207 kernel: [69260.605795] ? __seccomp_filter+0x4a/0x4a0 Aug 23 00:38:06 juju-e4d256-prod-github-runner-207 kernel: [69260.606536] ? __fget_files+0x86/0xc0 Aug 23 00:38:06 juju-e4d256-prod-github-runner-207 kernel: [69260.607238] __x64_sys_ioctl+0x95/0xd0 Aug 23 00:38:06 juju-e4d256-prod-github-runner-207 kernel: [69260.607942] do_syscall_64+0x5c/0xc0 Aug 23 00:38:06 juju-e4d256-prod-github-runner-207 kernel: [69260.608624] ? do_futex+0x162/0x1f0 Aug 23 00:38:06 juju-e4d256-prod-github-runner-207 kernel: [69260.609289] ? __x64_sys_futex+0x78/0x1e0 Aug 23 00:38:06 juju-e4d256-prod-github-runner-207 kernel: [69260.609968] ? __secure_computing+0xa9/0x120 Aug 23 00:38:06 juju-e4d256-prod-github-runner-207 kernel: [69260.610656] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 00:38:06 juju-e4d256-prod-github-runner-207 kernel: [69260.611414] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:38:06 juju-e4d256-prod-github-runner-207 kernel: [69260.612139] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:38:06 juju-e4d256-prod-github-runner-207 kernel: [69260.612872] ? do_syscall_64+0x69/0xc0 Aug 23 00:38:06 juju-e4d256-prod-github-runner-207 kernel: [69260.613518] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:38:06 juju-e4d256-prod-github-runner-207 kernel: [69260.614258] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:38:06 juju-e4d256-prod-github-runner-207 kernel: [69260.614957] ? do_syscall_64+0x69/0xc0 Aug 23 00:38:06 juju-e4d256-prod-github-runner-207 kernel: [69260.615582] ? do_syscall_64+0x69/0xc0 Aug 23 00:38:06 juju-e4d256-prod-github-runner-207 kernel: [69260.616211] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 00:38:06 juju-e4d256-prod-github-runner-207 kernel: [69260.616933] RIP: 0033:0x7faa5d0edaff Aug 23 00:38:06 juju-e4d256-prod-github-runner-207 kernel: [69260.617585] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 00:38:06 juju-e4d256-prod-github-runner-207 kernel: [69260.619576] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 00:38:06 juju-e4d256-prod-github-runner-207 kernel: [69260.620494] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 00:38:06 juju-e4d256-prod-github-runner-207 kernel: [69260.621401] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 00:38:06 juju-e4d256-prod-github-runner-207 kernel: [69260.622287] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 00:38:06 juju-e4d256-prod-github-runner-207 kernel: [69260.623174] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 00:38:06 juju-e4d256-prod-github-runner-207 kernel: [69260.624064] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 00:38:06 juju-e4d256-prod-github-runner-207 kernel: [69260.625119] Aug 23 00:38:34 juju-e4d256-prod-github-runner-207 kernel: [69288.541980] watchdog: BUG: soft lockup - CPU#1 stuck for 64421s! [qemu-system-x86:6715] Aug 23 00:38:34 juju-e4d256-prod-github-runner-207 kernel: [69288.543626] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 00:38:34 juju-e4d256-prod-github-runner-207 kernel: [69288.543786] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 00:38:34 juju-e4d256-prod-github-runner-207 kernel: [69288.556518] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 00:38:34 juju-e4d256-prod-github-runner-207 kernel: [69288.557785] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 00:38:34 juju-e4d256-prod-github-runner-207 kernel: [69288.559003] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:38:34 juju-e4d256-prod-github-runner-207 kernel: [69288.560061] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 00:38:34 juju-e4d256-prod-github-runner-207 kernel: [69288.562625] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 00:38:34 juju-e4d256-prod-github-runner-207 kernel: [69288.563668] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 00:38:34 juju-e4d256-prod-github-runner-207 kernel: [69288.564845] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 00:38:34 juju-e4d256-prod-github-runner-207 kernel: [69288.566009] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 00:38:34 juju-e4d256-prod-github-runner-207 kernel: [69288.567170] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 00:38:34 juju-e4d256-prod-github-runner-207 kernel: [69288.568333] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 00:38:34 juju-e4d256-prod-github-runner-207 kernel: [69288.569513] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 00:38:34 juju-e4d256-prod-github-runner-207 kernel: [69288.570751] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 00:38:34 juju-e4d256-prod-github-runner-207 kernel: [69288.571852] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 00:38:34 juju-e4d256-prod-github-runner-207 kernel: [69288.573090] Call Trace: Aug 23 00:38:34 juju-e4d256-prod-github-runner-207 kernel: [69288.574010] Aug 23 00:38:34 juju-e4d256-prod-github-runner-207 kernel: [69288.574900] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:38:34 juju-e4d256-prod-github-runner-207 kernel: [69288.575929] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:38:34 juju-e4d256-prod-github-runner-207 kernel: [69288.576965] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:38:34 juju-e4d256-prod-github-runner-207 kernel: [69288.578039] ? show_regs.part.0+0x23/0x29 Aug 23 00:38:34 juju-e4d256-prod-github-runner-207 kernel: [69288.579039] ? show_regs.cold+0x8/0xd Aug 23 00:38:34 juju-e4d256-prod-github-runner-207 kernel: [69288.580008] ? watchdog_timer_fn+0x1be/0x220 Aug 23 00:38:34 juju-e4d256-prod-github-runner-207 kernel: [69288.581024] ? lockup_detector_update_enable+0x60/0x60 Aug 23 00:38:34 juju-e4d256-prod-github-runner-207 kernel: [69288.582091] ? __hrtimer_run_queues+0x107/0x230 Aug 23 00:38:34 juju-e4d256-prod-github-runner-207 kernel: [69288.583116] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 00:38:34 juju-e4d256-prod-github-runner-207 kernel: [69288.584137] ? hrtimer_interrupt+0x101/0x220 Aug 23 00:38:34 juju-e4d256-prod-github-runner-207 kernel: [69288.585160] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 00:38:34 juju-e4d256-prod-github-runner-207 kernel: [69288.586230] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 00:38:34 juju-e4d256-prod-github-runner-207 kernel: [69288.587276] Aug 23 00:38:34 juju-e4d256-prod-github-runner-207 kernel: [69288.588126] Aug 23 00:38:34 juju-e4d256-prod-github-runner-207 kernel: [69288.588970] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 00:38:34 juju-e4d256-prod-github-runner-207 kernel: [69288.590000] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:38:34 juju-e4d256-prod-github-runner-207 kernel: [69288.591036] ? _raw_spin_lock+0x22/0x30 Aug 23 00:38:34 juju-e4d256-prod-github-runner-207 kernel: [69288.591979] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:38:34 juju-e4d256-prod-github-runner-207 kernel: [69288.593004] direct_page_fault+0x206/0x310 [kvm] Aug 23 00:38:34 juju-e4d256-prod-github-runner-207 kernel: [69288.594027] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 00:38:34 juju-e4d256-prod-github-runner-207 kernel: [69288.595039] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 00:38:34 juju-e4d256-prod-github-runner-207 kernel: [69288.596039] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 00:38:34 juju-e4d256-prod-github-runner-207 kernel: [69288.597024] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 00:38:34 juju-e4d256-prod-github-runner-207 kernel: [69288.597967] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 00:38:34 juju-e4d256-prod-github-runner-207 kernel: [69288.598947] handle_exit+0x98/0x230 [kvm_amd] Aug 23 00:38:34 juju-e4d256-prod-github-runner-207 kernel: [69288.599836] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 00:38:34 juju-e4d256-prod-github-runner-207 kernel: [69288.600753] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 00:38:34 juju-e4d256-prod-github-runner-207 kernel: [69288.601681] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 00:38:34 juju-e4d256-prod-github-runner-207 kernel: [69288.602601] vcpu_run+0x62/0x2c0 [kvm] Aug 23 00:38:34 juju-e4d256-prod-github-runner-207 kernel: [69288.603414] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 00:38:34 juju-e4d256-prod-github-runner-207 kernel: [69288.604217] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 00:38:34 juju-e4d256-prod-github-runner-207 kernel: [69288.605076] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 00:38:34 juju-e4d256-prod-github-runner-207 kernel: [69288.605875] ? __seccomp_filter+0x4a/0x4a0 Aug 23 00:38:34 juju-e4d256-prod-github-runner-207 kernel: [69288.606613] ? __fget_files+0x86/0xc0 Aug 23 00:38:34 juju-e4d256-prod-github-runner-207 kernel: [69288.607313] __x64_sys_ioctl+0x95/0xd0 Aug 23 00:38:34 juju-e4d256-prod-github-runner-207 kernel: [69288.608000] do_syscall_64+0x5c/0xc0 Aug 23 00:38:34 juju-e4d256-prod-github-runner-207 kernel: [69288.608675] ? do_futex+0x162/0x1f0 Aug 23 00:38:34 juju-e4d256-prod-github-runner-207 kernel: [69288.609321] ? __x64_sys_futex+0x78/0x1e0 Aug 23 00:38:34 juju-e4d256-prod-github-runner-207 kernel: [69288.609989] ? __secure_computing+0xa9/0x120 Aug 23 00:38:34 juju-e4d256-prod-github-runner-207 kernel: [69288.610674] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 00:38:34 juju-e4d256-prod-github-runner-207 kernel: [69288.611436] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:38:34 juju-e4d256-prod-github-runner-207 kernel: [69288.612155] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:38:34 juju-e4d256-prod-github-runner-207 kernel: [69288.612875] ? do_syscall_64+0x69/0xc0 Aug 23 00:38:34 juju-e4d256-prod-github-runner-207 kernel: [69288.613539] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:38:34 juju-e4d256-prod-github-runner-207 kernel: [69288.614254] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:38:34 juju-e4d256-prod-github-runner-207 kernel: [69288.614946] ? do_syscall_64+0x69/0xc0 Aug 23 00:38:34 juju-e4d256-prod-github-runner-207 kernel: [69288.615570] ? do_syscall_64+0x69/0xc0 Aug 23 00:38:34 juju-e4d256-prod-github-runner-207 kernel: [69288.616188] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 00:38:34 juju-e4d256-prod-github-runner-207 kernel: [69288.616903] RIP: 0033:0x7faa5d0edaff Aug 23 00:38:34 juju-e4d256-prod-github-runner-207 kernel: [69288.617536] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 00:38:34 juju-e4d256-prod-github-runner-207 kernel: [69288.619512] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 00:38:34 juju-e4d256-prod-github-runner-207 kernel: [69288.620429] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 00:38:34 juju-e4d256-prod-github-runner-207 kernel: [69288.621322] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 00:38:34 juju-e4d256-prod-github-runner-207 kernel: [69288.622211] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 00:38:34 juju-e4d256-prod-github-runner-207 kernel: [69288.623098] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 00:38:34 juju-e4d256-prod-github-runner-207 kernel: [69288.623983] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 00:38:34 juju-e4d256-prod-github-runner-207 kernel: [69288.624875] Aug 23 00:38:47 juju-e4d256-prod-github-runner-207 kernel: [69301.808705] rcu: INFO: rcu_sched self-detected stall on CPU Aug 23 00:38:47 juju-e4d256-prod-github-runner-207 kernel: [69301.809661] rcu: 1-....: (17241630 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=8324864 Aug 23 00:38:47 juju-e4d256-prod-github-runner-207 kernel: [69301.810785] (t=17296152 jiffies g=23269 q=59931) Aug 23 00:38:47 juju-e4d256-prod-github-runner-207 kernel: [69301.811573] NMI backtrace for cpu 1 Aug 23 00:38:47 juju-e4d256-prod-github-runner-207 kernel: [69301.812290] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 00:38:47 juju-e4d256-prod-github-runner-207 kernel: [69301.813404] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 00:38:47 juju-e4d256-prod-github-runner-207 kernel: [69301.814463] Call Trace: Aug 23 00:38:47 juju-e4d256-prod-github-runner-207 kernel: [69301.815138] Aug 23 00:38:47 juju-e4d256-prod-github-runner-207 kernel: [69301.815781] show_stack+0x52/0x5c Aug 23 00:38:47 juju-e4d256-prod-github-runner-207 kernel: [69301.816510] dump_stack_lvl+0x4a/0x63 Aug 23 00:38:47 juju-e4d256-prod-github-runner-207 kernel: [69301.817256] dump_stack+0x10/0x16 Aug 23 00:38:47 juju-e4d256-prod-github-runner-207 kernel: [69301.817973] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 23 00:38:47 juju-e4d256-prod-github-runner-207 kernel: [69301.818757] ? lapic_can_unplug_cpu+0x90/0x90 Aug 23 00:38:47 juju-e4d256-prod-github-runner-207 kernel: [69301.819534] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 23 00:38:47 juju-e4d256-prod-github-runner-207 kernel: [69301.820364] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 23 00:38:47 juju-e4d256-prod-github-runner-207 kernel: [69301.821185] trigger_single_cpu_backtrace+0x44/0x4f Aug 23 00:38:47 juju-e4d256-prod-github-runner-207 kernel: [69301.821996] rcu_dump_cpu_stacks+0x102/0x149 Aug 23 00:38:47 juju-e4d256-prod-github-runner-207 kernel: [69301.822807] print_cpu_stall.cold+0x2f/0xe2 Aug 23 00:38:47 juju-e4d256-prod-github-runner-207 kernel: [69301.823610] ? timekeeping_update+0xf7/0x150 Aug 23 00:38:47 juju-e4d256-prod-github-runner-207 kernel: [69301.824392] check_cpu_stall+0x109/0x270 Aug 23 00:38:47 juju-e4d256-prod-github-runner-207 kernel: [69301.825139] rcu_sched_clock_irq+0x9a/0x250 Aug 23 00:38:47 juju-e4d256-prod-github-runner-207 kernel: [69301.825919] update_process_times+0x94/0xd0 Aug 23 00:38:47 juju-e4d256-prod-github-runner-207 kernel: [69301.826682] tick_sched_handle+0x29/0x70 Aug 23 00:38:47 juju-e4d256-prod-github-runner-207 kernel: [69301.827426] tick_sched_timer+0x8c/0xc0 Aug 23 00:38:47 juju-e4d256-prod-github-runner-207 kernel: [69301.828163] ? tick_nohz_handler+0xb0/0xb0 Aug 23 00:38:47 juju-e4d256-prod-github-runner-207 kernel: [69301.828931] __hrtimer_run_queues+0x107/0x230 Aug 23 00:38:47 juju-e4d256-prod-github-runner-207 kernel: [69301.829703] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 00:38:47 juju-e4d256-prod-github-runner-207 kernel: [69301.830477] hrtimer_interrupt+0x101/0x220 Aug 23 00:38:47 juju-e4d256-prod-github-runner-207 kernel: [69301.831235] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 00:38:47 juju-e4d256-prod-github-runner-207 kernel: [69301.832052] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 00:38:47 juju-e4d256-prod-github-runner-207 kernel: [69301.832859] Aug 23 00:38:47 juju-e4d256-prod-github-runner-207 kernel: [69301.833494] Aug 23 00:38:47 juju-e4d256-prod-github-runner-207 kernel: [69301.834121] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 00:38:47 juju-e4d256-prod-github-runner-207 kernel: [69301.834939] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:38:47 juju-e4d256-prod-github-runner-207 kernel: [69301.835817] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 00:38:47 juju-e4d256-prod-github-runner-207 kernel: [69301.838030] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 00:38:47 juju-e4d256-prod-github-runner-207 kernel: [69301.838901] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 00:38:47 juju-e4d256-prod-github-runner-207 kernel: [69301.839892] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 00:38:47 juju-e4d256-prod-github-runner-207 kernel: [69301.840879] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 00:38:47 juju-e4d256-prod-github-runner-207 kernel: [69301.841847] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 00:38:47 juju-e4d256-prod-github-runner-207 kernel: [69301.842800] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 00:38:47 juju-e4d256-prod-github-runner-207 kernel: [69301.843751] ? _raw_spin_lock+0x22/0x30 Aug 23 00:38:47 juju-e4d256-prod-github-runner-207 kernel: [69301.844513] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:38:47 juju-e4d256-prod-github-runner-207 kernel: [69301.845349] direct_page_fault+0x206/0x310 [kvm] Aug 23 00:38:47 juju-e4d256-prod-github-runner-207 kernel: [69301.846186] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 00:38:47 juju-e4d256-prod-github-runner-207 kernel: [69301.847017] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 00:38:47 juju-e4d256-prod-github-runner-207 kernel: [69301.847842] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 00:38:47 juju-e4d256-prod-github-runner-207 kernel: [69301.848650] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 00:38:47 juju-e4d256-prod-github-runner-207 kernel: [69301.849434] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 00:38:47 juju-e4d256-prod-github-runner-207 kernel: [69301.850407] handle_exit+0x98/0x230 [kvm_amd] Aug 23 00:38:47 juju-e4d256-prod-github-runner-207 kernel: [69301.851161] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 00:38:47 juju-e4d256-prod-github-runner-207 kernel: [69301.851949] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 00:38:47 juju-e4d256-prod-github-runner-207 kernel: [69301.852759] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 00:38:47 juju-e4d256-prod-github-runner-207 kernel: [69301.853549] vcpu_run+0x62/0x2c0 [kvm] Aug 23 00:38:47 juju-e4d256-prod-github-runner-207 kernel: [69301.854261] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 00:38:47 juju-e4d256-prod-github-runner-207 kernel: [69301.854991] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 00:38:47 juju-e4d256-prod-github-runner-207 kernel: [69301.855809] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 00:38:47 juju-e4d256-prod-github-runner-207 kernel: [69301.856588] ? __seccomp_filter+0x4a/0x4a0 Aug 23 00:38:47 juju-e4d256-prod-github-runner-207 kernel: [69301.857308] ? __fget_files+0x86/0xc0 Aug 23 00:38:47 juju-e4d256-prod-github-runner-207 kernel: [69301.857999] __x64_sys_ioctl+0x95/0xd0 Aug 23 00:38:47 juju-e4d256-prod-github-runner-207 kernel: [69301.858695] do_syscall_64+0x5c/0xc0 Aug 23 00:38:47 juju-e4d256-prod-github-runner-207 kernel: [69301.859375] ? do_futex+0x162/0x1f0 Aug 23 00:38:47 juju-e4d256-prod-github-runner-207 kernel: [69301.860046] ? __x64_sys_futex+0x78/0x1e0 Aug 23 00:38:47 juju-e4d256-prod-github-runner-207 kernel: [69301.860753] ? __secure_computing+0xa9/0x120 Aug 23 00:38:47 juju-e4d256-prod-github-runner-207 kernel: [69301.861469] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 00:38:47 juju-e4d256-prod-github-runner-207 kernel: [69301.862257] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:38:47 juju-e4d256-prod-github-runner-207 kernel: [69301.863010] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:38:47 juju-e4d256-prod-github-runner-207 kernel: [69301.863760] ? do_syscall_64+0x69/0xc0 Aug 23 00:38:47 juju-e4d256-prod-github-runner-207 kernel: [69301.864461] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:38:47 juju-e4d256-prod-github-runner-207 kernel: [69301.865215] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:38:47 juju-e4d256-prod-github-runner-207 kernel: [69301.865969] ? do_syscall_64+0x69/0xc0 Aug 23 00:38:47 juju-e4d256-prod-github-runner-207 kernel: [69301.866662] ? do_syscall_64+0x69/0xc0 Aug 23 00:38:47 juju-e4d256-prod-github-runner-207 kernel: [69301.867346] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 00:38:47 juju-e4d256-prod-github-runner-207 kernel: [69301.868117] RIP: 0033:0x7faa5d0edaff Aug 23 00:38:47 juju-e4d256-prod-github-runner-207 kernel: [69301.868805] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 00:38:47 juju-e4d256-prod-github-runner-207 kernel: [69301.870897] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 00:38:47 juju-e4d256-prod-github-runner-207 kernel: [69301.871856] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 00:38:47 juju-e4d256-prod-github-runner-207 kernel: [69301.872809] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 00:38:47 juju-e4d256-prod-github-runner-207 kernel: [69301.873751] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 00:38:47 juju-e4d256-prod-github-runner-207 kernel: [69301.874689] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 00:38:47 juju-e4d256-prod-github-runner-207 kernel: [69301.875612] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 00:38:47 juju-e4d256-prod-github-runner-207 kernel: [69301.876531] Aug 23 00:39:14 juju-e4d256-prod-github-runner-207 kernel: [69328.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 64459s! [qemu-system-x86:6715] Aug 23 00:39:14 juju-e4d256-prod-github-runner-207 kernel: [69328.543125] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 00:39:14 juju-e4d256-prod-github-runner-207 kernel: [69328.543193] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 00:39:14 juju-e4d256-prod-github-runner-207 kernel: [69328.555317] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 00:39:14 juju-e4d256-prod-github-runner-207 kernel: [69328.556590] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 00:39:14 juju-e4d256-prod-github-runner-207 kernel: [69328.557848] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:39:14 juju-e4d256-prod-github-runner-207 kernel: [69328.558903] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 00:39:14 juju-e4d256-prod-github-runner-207 kernel: [69328.561469] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 00:39:14 juju-e4d256-prod-github-runner-207 kernel: [69328.562516] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 00:39:14 juju-e4d256-prod-github-runner-207 kernel: [69328.563729] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 00:39:14 juju-e4d256-prod-github-runner-207 kernel: [69328.564903] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 00:39:14 juju-e4d256-prod-github-runner-207 kernel: [69328.566061] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 00:39:14 juju-e4d256-prod-github-runner-207 kernel: [69328.567225] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 00:39:14 juju-e4d256-prod-github-runner-207 kernel: [69328.568404] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 00:39:14 juju-e4d256-prod-github-runner-207 kernel: [69328.569641] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 00:39:14 juju-e4d256-prod-github-runner-207 kernel: [69328.570736] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 00:39:14 juju-e4d256-prod-github-runner-207 kernel: [69328.571940] Call Trace: Aug 23 00:39:14 juju-e4d256-prod-github-runner-207 kernel: [69328.572860] Aug 23 00:39:14 juju-e4d256-prod-github-runner-207 kernel: [69328.573748] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:39:14 juju-e4d256-prod-github-runner-207 kernel: [69328.574781] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:39:14 juju-e4d256-prod-github-runner-207 kernel: [69328.575801] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:39:14 juju-e4d256-prod-github-runner-207 kernel: [69328.576881] ? show_regs.part.0+0x23/0x29 Aug 23 00:39:14 juju-e4d256-prod-github-runner-207 kernel: [69328.577877] ? show_regs.cold+0x8/0xd Aug 23 00:39:14 juju-e4d256-prod-github-runner-207 kernel: [69328.578846] ? watchdog_timer_fn+0x1be/0x220 Aug 23 00:39:14 juju-e4d256-prod-github-runner-207 kernel: [69328.579853] ? lockup_detector_update_enable+0x60/0x60 Aug 23 00:39:14 juju-e4d256-prod-github-runner-207 kernel: [69328.580922] ? __hrtimer_run_queues+0x107/0x230 Aug 23 00:39:14 juju-e4d256-prod-github-runner-207 kernel: [69328.581954] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 00:39:14 juju-e4d256-prod-github-runner-207 kernel: [69328.582982] ? hrtimer_interrupt+0x101/0x220 Aug 23 00:39:14 juju-e4d256-prod-github-runner-207 kernel: [69328.584297] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 00:39:14 juju-e4d256-prod-github-runner-207 kernel: [69328.585831] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 00:39:14 juju-e4d256-prod-github-runner-207 kernel: [69328.587943] Aug 23 00:39:14 juju-e4d256-prod-github-runner-207 kernel: [69328.589108] Aug 23 00:39:14 juju-e4d256-prod-github-runner-207 kernel: [69328.590216] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 00:39:14 juju-e4d256-prod-github-runner-207 kernel: [69328.591641] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:39:14 juju-e4d256-prod-github-runner-207 kernel: [69328.593072] ? _raw_spin_lock+0x22/0x30 Aug 23 00:39:14 juju-e4d256-prod-github-runner-207 kernel: [69328.594325] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:39:14 juju-e4d256-prod-github-runner-207 kernel: [69328.595346] direct_page_fault+0x206/0x310 [kvm] Aug 23 00:39:14 juju-e4d256-prod-github-runner-207 kernel: [69328.596383] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 00:39:14 juju-e4d256-prod-github-runner-207 kernel: [69328.597390] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 00:39:14 juju-e4d256-prod-github-runner-207 kernel: [69328.598388] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 00:39:14 juju-e4d256-prod-github-runner-207 kernel: [69328.599356] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 00:39:14 juju-e4d256-prod-github-runner-207 kernel: [69328.600318] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 00:39:14 juju-e4d256-prod-github-runner-207 kernel: [69328.601296] handle_exit+0x98/0x230 [kvm_amd] Aug 23 00:39:14 juju-e4d256-prod-github-runner-207 kernel: [69328.602193] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 00:39:14 juju-e4d256-prod-github-runner-207 kernel: [69328.603107] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 00:39:14 juju-e4d256-prod-github-runner-207 kernel: [69328.604042] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 00:39:14 juju-e4d256-prod-github-runner-207 kernel: [69328.604951] vcpu_run+0x62/0x2c0 [kvm] Aug 23 00:39:14 juju-e4d256-prod-github-runner-207 kernel: [69328.605766] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 00:39:14 juju-e4d256-prod-github-runner-207 kernel: [69328.606573] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 00:39:14 juju-e4d256-prod-github-runner-207 kernel: [69328.607425] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 00:39:14 juju-e4d256-prod-github-runner-207 kernel: [69328.608237] ? __seccomp_filter+0x4a/0x4a0 Aug 23 00:39:14 juju-e4d256-prod-github-runner-207 kernel: [69328.608980] ? __fget_files+0x86/0xc0 Aug 23 00:39:14 juju-e4d256-prod-github-runner-207 kernel: [69328.609688] __x64_sys_ioctl+0x95/0xd0 Aug 23 00:39:14 juju-e4d256-prod-github-runner-207 kernel: [69328.610379] do_syscall_64+0x5c/0xc0 Aug 23 00:39:14 juju-e4d256-prod-github-runner-207 kernel: [69328.611048] ? do_futex+0x162/0x1f0 Aug 23 00:39:14 juju-e4d256-prod-github-runner-207 kernel: [69328.611696] ? __x64_sys_futex+0x78/0x1e0 Aug 23 00:39:14 juju-e4d256-prod-github-runner-207 kernel: [69328.612384] ? __secure_computing+0xa9/0x120 Aug 23 00:39:14 juju-e4d256-prod-github-runner-207 kernel: [69328.613275] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 00:39:14 juju-e4d256-prod-github-runner-207 kernel: [69328.614391] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:39:14 juju-e4d256-prod-github-runner-207 kernel: [69328.615448] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:39:14 juju-e4d256-prod-github-runner-207 kernel: [69328.616474] ? do_syscall_64+0x69/0xc0 Aug 23 00:39:14 juju-e4d256-prod-github-runner-207 kernel: [69328.617123] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:39:14 juju-e4d256-prod-github-runner-207 kernel: [69328.617826] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:39:14 juju-e4d256-prod-github-runner-207 kernel: [69328.618521] ? do_syscall_64+0x69/0xc0 Aug 23 00:39:14 juju-e4d256-prod-github-runner-207 kernel: [69328.619147] ? do_syscall_64+0x69/0xc0 Aug 23 00:39:14 juju-e4d256-prod-github-runner-207 kernel: [69328.619769] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 00:39:14 juju-e4d256-prod-github-runner-207 kernel: [69328.620490] RIP: 0033:0x7faa5d0edaff Aug 23 00:39:14 juju-e4d256-prod-github-runner-207 kernel: [69328.621119] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 00:39:14 juju-e4d256-prod-github-runner-207 kernel: [69328.623102] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 00:39:14 juju-e4d256-prod-github-runner-207 kernel: [69328.624039] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 00:39:14 juju-e4d256-prod-github-runner-207 kernel: [69328.624931] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 00:39:14 juju-e4d256-prod-github-runner-207 kernel: [69328.625819] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 00:39:14 juju-e4d256-prod-github-runner-207 kernel: [69328.626706] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 00:39:14 juju-e4d256-prod-github-runner-207 kernel: [69328.627599] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 00:39:14 juju-e4d256-prod-github-runner-207 kernel: [69328.628501] Aug 23 00:39:42 juju-e4d256-prod-github-runner-207 kernel: [69356.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 64485s! [qemu-system-x86:6715] Aug 23 00:39:42 juju-e4d256-prod-github-runner-207 kernel: [69356.543133] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 00:39:42 juju-e4d256-prod-github-runner-207 kernel: [69356.543328] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 00:39:42 juju-e4d256-prod-github-runner-207 kernel: [69356.556111] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 00:39:42 juju-e4d256-prod-github-runner-207 kernel: [69356.557380] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 00:39:42 juju-e4d256-prod-github-runner-207 kernel: [69356.558606] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:39:42 juju-e4d256-prod-github-runner-207 kernel: [69356.559690] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 00:39:42 juju-e4d256-prod-github-runner-207 kernel: [69356.562287] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 00:39:42 juju-e4d256-prod-github-runner-207 kernel: [69356.563331] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 00:39:42 juju-e4d256-prod-github-runner-207 kernel: [69356.564656] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 00:39:42 juju-e4d256-prod-github-runner-207 kernel: [69356.565841] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 00:39:42 juju-e4d256-prod-github-runner-207 kernel: [69356.567021] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 00:39:42 juju-e4d256-prod-github-runner-207 kernel: [69356.568293] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 00:39:42 juju-e4d256-prod-github-runner-207 kernel: [69356.569473] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 00:39:42 juju-e4d256-prod-github-runner-207 kernel: [69356.570710] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 00:39:42 juju-e4d256-prod-github-runner-207 kernel: [69356.571876] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 00:39:42 juju-e4d256-prod-github-runner-207 kernel: [69356.573075] Call Trace: Aug 23 00:39:42 juju-e4d256-prod-github-runner-207 kernel: [69356.573991] Aug 23 00:39:42 juju-e4d256-prod-github-runner-207 kernel: [69356.574874] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:39:42 juju-e4d256-prod-github-runner-207 kernel: [69356.575911] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:39:42 juju-e4d256-prod-github-runner-207 kernel: [69356.576936] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:39:42 juju-e4d256-prod-github-runner-207 kernel: [69356.578048] ? show_regs.part.0+0x23/0x29 Aug 23 00:39:42 juju-e4d256-prod-github-runner-207 kernel: [69356.579044] ? show_regs.cold+0x8/0xd Aug 23 00:39:42 juju-e4d256-prod-github-runner-207 kernel: [69356.580032] ? watchdog_timer_fn+0x1be/0x220 Aug 23 00:39:42 juju-e4d256-prod-github-runner-207 kernel: [69356.581038] ? lockup_detector_update_enable+0x60/0x60 Aug 23 00:39:42 juju-e4d256-prod-github-runner-207 kernel: [69356.582098] ? __hrtimer_run_queues+0x107/0x230 Aug 23 00:39:42 juju-e4d256-prod-github-runner-207 kernel: [69356.583127] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 00:39:42 juju-e4d256-prod-github-runner-207 kernel: [69356.584162] ? hrtimer_interrupt+0x101/0x220 Aug 23 00:39:42 juju-e4d256-prod-github-runner-207 kernel: [69356.585175] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 00:39:42 juju-e4d256-prod-github-runner-207 kernel: [69356.586238] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 00:39:42 juju-e4d256-prod-github-runner-207 kernel: [69356.587280] Aug 23 00:39:42 juju-e4d256-prod-github-runner-207 kernel: [69356.588145] Aug 23 00:39:42 juju-e4d256-prod-github-runner-207 kernel: [69356.588986] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 00:39:42 juju-e4d256-prod-github-runner-207 kernel: [69356.590021] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:39:42 juju-e4d256-prod-github-runner-207 kernel: [69356.591060] ? _raw_spin_lock+0x22/0x30 Aug 23 00:39:42 juju-e4d256-prod-github-runner-207 kernel: [69356.592016] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:39:42 juju-e4d256-prod-github-runner-207 kernel: [69356.593043] direct_page_fault+0x206/0x310 [kvm] Aug 23 00:39:42 juju-e4d256-prod-github-runner-207 kernel: [69356.594065] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 00:39:42 juju-e4d256-prod-github-runner-207 kernel: [69356.595074] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 00:39:42 juju-e4d256-prod-github-runner-207 kernel: [69356.596090] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 00:39:42 juju-e4d256-prod-github-runner-207 kernel: [69356.597082] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 00:39:42 juju-e4d256-prod-github-runner-207 kernel: [69356.598045] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 00:39:42 juju-e4d256-prod-github-runner-207 kernel: [69356.599028] handle_exit+0x98/0x230 [kvm_amd] Aug 23 00:39:42 juju-e4d256-prod-github-runner-207 kernel: [69356.599935] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 00:39:42 juju-e4d256-prod-github-runner-207 kernel: [69356.600845] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 00:39:42 juju-e4d256-prod-github-runner-207 kernel: [69356.601767] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 00:39:42 juju-e4d256-prod-github-runner-207 kernel: [69356.602677] vcpu_run+0x62/0x2c0 [kvm] Aug 23 00:39:42 juju-e4d256-prod-github-runner-207 kernel: [69356.603486] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 00:39:42 juju-e4d256-prod-github-runner-207 kernel: [69356.604312] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 00:39:42 juju-e4d256-prod-github-runner-207 kernel: [69356.605169] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 00:39:42 juju-e4d256-prod-github-runner-207 kernel: [69356.605969] ? __seccomp_filter+0x4a/0x4a0 Aug 23 00:39:42 juju-e4d256-prod-github-runner-207 kernel: [69356.606708] ? __fget_files+0x86/0xc0 Aug 23 00:39:42 juju-e4d256-prod-github-runner-207 kernel: [69356.607409] __x64_sys_ioctl+0x95/0xd0 Aug 23 00:39:42 juju-e4d256-prod-github-runner-207 kernel: [69356.608118] do_syscall_64+0x5c/0xc0 Aug 23 00:39:42 juju-e4d256-prod-github-runner-207 kernel: [69356.608785] ? do_futex+0x162/0x1f0 Aug 23 00:39:42 juju-e4d256-prod-github-runner-207 kernel: [69356.609431] ? __x64_sys_futex+0x78/0x1e0 Aug 23 00:39:42 juju-e4d256-prod-github-runner-207 kernel: [69356.610108] ? __secure_computing+0xa9/0x120 Aug 23 00:39:42 juju-e4d256-prod-github-runner-207 kernel: [69356.610794] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 00:39:42 juju-e4d256-prod-github-runner-207 kernel: [69356.611574] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:39:42 juju-e4d256-prod-github-runner-207 kernel: [69356.612292] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:39:42 juju-e4d256-prod-github-runner-207 kernel: [69356.613010] ? do_syscall_64+0x69/0xc0 Aug 23 00:39:42 juju-e4d256-prod-github-runner-207 kernel: [69356.613653] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:39:42 juju-e4d256-prod-github-runner-207 kernel: [69356.614357] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:39:42 juju-e4d256-prod-github-runner-207 kernel: [69356.615050] ? do_syscall_64+0x69/0xc0 Aug 23 00:39:42 juju-e4d256-prod-github-runner-207 kernel: [69356.615686] ? do_syscall_64+0x69/0xc0 Aug 23 00:39:42 juju-e4d256-prod-github-runner-207 kernel: [69356.616312] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 00:39:42 juju-e4d256-prod-github-runner-207 kernel: [69356.617019] RIP: 0033:0x7faa5d0edaff Aug 23 00:39:42 juju-e4d256-prod-github-runner-207 kernel: [69356.617666] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 00:39:42 juju-e4d256-prod-github-runner-207 kernel: [69356.619667] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 00:39:42 juju-e4d256-prod-github-runner-207 kernel: [69356.620582] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 00:39:42 juju-e4d256-prod-github-runner-207 kernel: [69356.621469] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 00:39:42 juju-e4d256-prod-github-runner-207 kernel: [69356.622355] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 00:39:42 juju-e4d256-prod-github-runner-207 kernel: [69356.623242] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 00:39:42 juju-e4d256-prod-github-runner-207 kernel: [69356.624146] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 00:39:42 juju-e4d256-prod-github-runner-207 kernel: [69356.625037] Aug 23 00:40:10 juju-e4d256-prod-github-runner-207 kernel: [69384.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 64511s! [qemu-system-x86:6715] Aug 23 00:40:10 juju-e4d256-prod-github-runner-207 kernel: [69384.543835] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 00:40:10 juju-e4d256-prod-github-runner-207 kernel: [69384.544006] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 00:40:10 juju-e4d256-prod-github-runner-207 kernel: [69384.556240] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 00:40:10 juju-e4d256-prod-github-runner-207 kernel: [69384.557610] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 00:40:10 juju-e4d256-prod-github-runner-207 kernel: [69384.558866] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:40:10 juju-e4d256-prod-github-runner-207 kernel: [69384.559953] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 00:40:10 juju-e4d256-prod-github-runner-207 kernel: [69384.562516] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 00:40:10 juju-e4d256-prod-github-runner-207 kernel: [69384.563617] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 00:40:10 juju-e4d256-prod-github-runner-207 kernel: [69384.564864] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 00:40:10 juju-e4d256-prod-github-runner-207 kernel: [69384.566040] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 00:40:10 juju-e4d256-prod-github-runner-207 kernel: [69384.567239] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 00:40:10 juju-e4d256-prod-github-runner-207 kernel: [69384.568459] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 00:40:10 juju-e4d256-prod-github-runner-207 kernel: [69384.569637] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 00:40:10 juju-e4d256-prod-github-runner-207 kernel: [69384.570877] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 00:40:10 juju-e4d256-prod-github-runner-207 kernel: [69384.571990] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 00:40:10 juju-e4d256-prod-github-runner-207 kernel: [69384.573268] Call Trace: Aug 23 00:40:10 juju-e4d256-prod-github-runner-207 kernel: [69384.574198] Aug 23 00:40:10 juju-e4d256-prod-github-runner-207 kernel: [69384.575094] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:40:10 juju-e4d256-prod-github-runner-207 kernel: [69384.576154] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:40:10 juju-e4d256-prod-github-runner-207 kernel: [69384.577176] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:40:10 juju-e4d256-prod-github-runner-207 kernel: [69384.578263] ? show_regs.part.0+0x23/0x29 Aug 23 00:40:10 juju-e4d256-prod-github-runner-207 kernel: [69384.579322] ? show_regs.cold+0x8/0xd Aug 23 00:40:10 juju-e4d256-prod-github-runner-207 kernel: [69384.580301] ? watchdog_timer_fn+0x1be/0x220 Aug 23 00:40:10 juju-e4d256-prod-github-runner-207 kernel: [69384.581320] ? lockup_detector_update_enable+0x60/0x60 Aug 23 00:40:10 juju-e4d256-prod-github-runner-207 kernel: [69384.582393] ? __hrtimer_run_queues+0x107/0x230 Aug 23 00:40:10 juju-e4d256-prod-github-runner-207 kernel: [69384.583452] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 00:40:10 juju-e4d256-prod-github-runner-207 kernel: [69384.584487] ? hrtimer_interrupt+0x101/0x220 Aug 23 00:40:10 juju-e4d256-prod-github-runner-207 kernel: [69384.585512] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 00:40:10 juju-e4d256-prod-github-runner-207 kernel: [69384.586583] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 00:40:10 juju-e4d256-prod-github-runner-207 kernel: [69384.587655] Aug 23 00:40:10 juju-e4d256-prod-github-runner-207 kernel: [69384.588514] Aug 23 00:40:10 juju-e4d256-prod-github-runner-207 kernel: [69384.589370] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 00:40:10 juju-e4d256-prod-github-runner-207 kernel: [69384.590407] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:40:10 juju-e4d256-prod-github-runner-207 kernel: [69384.591469] ? _raw_spin_lock+0x22/0x30 Aug 23 00:40:10 juju-e4d256-prod-github-runner-207 kernel: [69384.592418] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:40:10 juju-e4d256-prod-github-runner-207 kernel: [69384.593453] direct_page_fault+0x206/0x310 [kvm] Aug 23 00:40:10 juju-e4d256-prod-github-runner-207 kernel: [69384.594499] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 00:40:10 juju-e4d256-prod-github-runner-207 kernel: [69384.595533] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 00:40:10 juju-e4d256-prod-github-runner-207 kernel: [69384.596537] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 00:40:10 juju-e4d256-prod-github-runner-207 kernel: [69384.597528] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 00:40:10 juju-e4d256-prod-github-runner-207 kernel: [69384.598488] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 00:40:10 juju-e4d256-prod-github-runner-207 kernel: [69384.599494] handle_exit+0x98/0x230 [kvm_amd] Aug 23 00:40:10 juju-e4d256-prod-github-runner-207 kernel: [69384.600396] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 00:40:10 juju-e4d256-prod-github-runner-207 kernel: [69384.601347] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 00:40:10 juju-e4d256-prod-github-runner-207 kernel: [69384.602287] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 00:40:10 juju-e4d256-prod-github-runner-207 kernel: [69384.603255] vcpu_run+0x62/0x2c0 [kvm] Aug 23 00:40:10 juju-e4d256-prod-github-runner-207 kernel: [69384.604088] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 00:40:10 juju-e4d256-prod-github-runner-207 kernel: [69384.604904] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 00:40:10 juju-e4d256-prod-github-runner-207 kernel: [69384.605756] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 00:40:10 juju-e4d256-prod-github-runner-207 kernel: [69384.606549] ? __seccomp_filter+0x4a/0x4a0 Aug 23 00:40:10 juju-e4d256-prod-github-runner-207 kernel: [69384.607305] ? __fget_files+0x86/0xc0 Aug 23 00:40:10 juju-e4d256-prod-github-runner-207 kernel: [69384.608011] __x64_sys_ioctl+0x95/0xd0 Aug 23 00:40:10 juju-e4d256-prod-github-runner-207 kernel: [69384.608760] do_syscall_64+0x5c/0xc0 Aug 23 00:40:10 juju-e4d256-prod-github-runner-207 kernel: [69384.609446] ? do_futex+0x162/0x1f0 Aug 23 00:40:10 juju-e4d256-prod-github-runner-207 kernel: [69384.610096] ? __x64_sys_futex+0x78/0x1e0 Aug 23 00:40:10 juju-e4d256-prod-github-runner-207 kernel: [69384.610775] ? __secure_computing+0xa9/0x120 Aug 23 00:40:10 juju-e4d256-prod-github-runner-207 kernel: [69384.611485] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 00:40:10 juju-e4d256-prod-github-runner-207 kernel: [69384.612245] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:40:10 juju-e4d256-prod-github-runner-207 kernel: [69384.612966] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:40:10 juju-e4d256-prod-github-runner-207 kernel: [69384.613700] ? do_syscall_64+0x69/0xc0 Aug 23 00:40:10 juju-e4d256-prod-github-runner-207 kernel: [69384.614358] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:40:10 juju-e4d256-prod-github-runner-207 kernel: [69384.615068] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:40:10 juju-e4d256-prod-github-runner-207 kernel: [69384.615781] ? do_syscall_64+0x69/0xc0 Aug 23 00:40:10 juju-e4d256-prod-github-runner-207 kernel: [69384.616405] ? do_syscall_64+0x69/0xc0 Aug 23 00:40:10 juju-e4d256-prod-github-runner-207 kernel: [69384.617027] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 00:40:10 juju-e4d256-prod-github-runner-207 kernel: [69384.617733] RIP: 0033:0x7faa5d0edaff Aug 23 00:40:10 juju-e4d256-prod-github-runner-207 kernel: [69384.618362] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 00:40:10 juju-e4d256-prod-github-runner-207 kernel: [69384.620529] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 00:40:10 juju-e4d256-prod-github-runner-207 kernel: [69384.621453] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 00:40:10 juju-e4d256-prod-github-runner-207 kernel: [69384.622346] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 00:40:10 juju-e4d256-prod-github-runner-207 kernel: [69384.623286] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 00:40:10 juju-e4d256-prod-github-runner-207 kernel: [69384.624197] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 00:40:10 juju-e4d256-prod-github-runner-207 kernel: [69384.625100] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 00:40:10 juju-e4d256-prod-github-runner-207 kernel: [69384.626004] Aug 23 00:40:38 juju-e4d256-prod-github-runner-207 kernel: [69412.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 64537s! [qemu-system-x86:6715] Aug 23 00:40:38 juju-e4d256-prod-github-runner-207 kernel: [69412.543089] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 00:40:38 juju-e4d256-prod-github-runner-207 kernel: [69412.543157] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 00:40:38 juju-e4d256-prod-github-runner-207 kernel: [69412.555186] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 00:40:38 juju-e4d256-prod-github-runner-207 kernel: [69412.556453] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 00:40:38 juju-e4d256-prod-github-runner-207 kernel: [69412.557676] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:40:38 juju-e4d256-prod-github-runner-207 kernel: [69412.558747] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 00:40:38 juju-e4d256-prod-github-runner-207 kernel: [69412.561301] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 00:40:38 juju-e4d256-prod-github-runner-207 kernel: [69412.562346] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 00:40:38 juju-e4d256-prod-github-runner-207 kernel: [69412.563521] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 00:40:38 juju-e4d256-prod-github-runner-207 kernel: [69412.564685] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 00:40:38 juju-e4d256-prod-github-runner-207 kernel: [69412.565849] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 00:40:38 juju-e4d256-prod-github-runner-207 kernel: [69412.567021] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 00:40:38 juju-e4d256-prod-github-runner-207 kernel: [69412.568187] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 00:40:38 juju-e4d256-prod-github-runner-207 kernel: [69412.569416] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 00:40:38 juju-e4d256-prod-github-runner-207 kernel: [69412.570521] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 00:40:38 juju-e4d256-prod-github-runner-207 kernel: [69412.571726] Call Trace: Aug 23 00:40:38 juju-e4d256-prod-github-runner-207 kernel: [69412.572637] Aug 23 00:40:38 juju-e4d256-prod-github-runner-207 kernel: [69412.573520] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:40:38 juju-e4d256-prod-github-runner-207 kernel: [69412.574552] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:40:38 juju-e4d256-prod-github-runner-207 kernel: [69412.575586] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:40:38 juju-e4d256-prod-github-runner-207 kernel: [69412.576664] ? show_regs.part.0+0x23/0x29 Aug 23 00:40:38 juju-e4d256-prod-github-runner-207 kernel: [69412.577667] ? show_regs.cold+0x8/0xd Aug 23 00:40:38 juju-e4d256-prod-github-runner-207 kernel: [69412.578644] ? watchdog_timer_fn+0x1be/0x220 Aug 23 00:40:38 juju-e4d256-prod-github-runner-207 kernel: [69412.579662] ? lockup_detector_update_enable+0x60/0x60 Aug 23 00:40:38 juju-e4d256-prod-github-runner-207 kernel: [69412.580725] ? __hrtimer_run_queues+0x107/0x230 Aug 23 00:40:38 juju-e4d256-prod-github-runner-207 kernel: [69412.581759] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 00:40:38 juju-e4d256-prod-github-runner-207 kernel: [69412.582787] ? hrtimer_interrupt+0x101/0x220 Aug 23 00:40:38 juju-e4d256-prod-github-runner-207 kernel: [69412.583809] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 00:40:38 juju-e4d256-prod-github-runner-207 kernel: [69412.584877] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 00:40:38 juju-e4d256-prod-github-runner-207 kernel: [69412.585930] Aug 23 00:40:38 juju-e4d256-prod-github-runner-207 kernel: [69412.586783] Aug 23 00:40:38 juju-e4d256-prod-github-runner-207 kernel: [69412.587635] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 00:40:38 juju-e4d256-prod-github-runner-207 kernel: [69412.588672] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:40:38 juju-e4d256-prod-github-runner-207 kernel: [69412.589715] ? _raw_spin_lock+0x22/0x30 Aug 23 00:40:38 juju-e4d256-prod-github-runner-207 kernel: [69412.590662] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:40:38 juju-e4d256-prod-github-runner-207 kernel: [69412.591683] direct_page_fault+0x206/0x310 [kvm] Aug 23 00:40:38 juju-e4d256-prod-github-runner-207 kernel: [69412.592707] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 00:40:38 juju-e4d256-prod-github-runner-207 kernel: [69412.593716] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 00:40:38 juju-e4d256-prod-github-runner-207 kernel: [69412.594716] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 00:40:38 juju-e4d256-prod-github-runner-207 kernel: [69412.595693] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 00:40:38 juju-e4d256-prod-github-runner-207 kernel: [69412.596752] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 00:40:38 juju-e4d256-prod-github-runner-207 kernel: [69412.597735] handle_exit+0x98/0x230 [kvm_amd] Aug 23 00:40:38 juju-e4d256-prod-github-runner-207 kernel: [69412.598645] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 00:40:38 juju-e4d256-prod-github-runner-207 kernel: [69412.599572] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 00:40:38 juju-e4d256-prod-github-runner-207 kernel: [69412.600499] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 00:40:38 juju-e4d256-prod-github-runner-207 kernel: [69412.601403] vcpu_run+0x62/0x2c0 [kvm] Aug 23 00:40:38 juju-e4d256-prod-github-runner-207 kernel: [69412.602218] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 00:40:38 juju-e4d256-prod-github-runner-207 kernel: [69412.603033] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 00:40:38 juju-e4d256-prod-github-runner-207 kernel: [69412.603887] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 00:40:38 juju-e4d256-prod-github-runner-207 kernel: [69412.604688] ? __seccomp_filter+0x4a/0x4a0 Aug 23 00:40:38 juju-e4d256-prod-github-runner-207 kernel: [69412.605431] ? __fget_files+0x86/0xc0 Aug 23 00:40:38 juju-e4d256-prod-github-runner-207 kernel: [69412.606136] __x64_sys_ioctl+0x95/0xd0 Aug 23 00:40:38 juju-e4d256-prod-github-runner-207 kernel: [69412.606830] do_syscall_64+0x5c/0xc0 Aug 23 00:40:38 juju-e4d256-prod-github-runner-207 kernel: [69412.607509] ? do_futex+0x162/0x1f0 Aug 23 00:40:38 juju-e4d256-prod-github-runner-207 kernel: [69412.608156] ? __x64_sys_futex+0x78/0x1e0 Aug 23 00:40:38 juju-e4d256-prod-github-runner-207 kernel: [69412.608827] ? __secure_computing+0xa9/0x120 Aug 23 00:40:38 juju-e4d256-prod-github-runner-207 kernel: [69412.609520] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 00:40:38 juju-e4d256-prod-github-runner-207 kernel: [69412.610278] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:40:38 juju-e4d256-prod-github-runner-207 kernel: [69412.611009] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:40:38 juju-e4d256-prod-github-runner-207 kernel: [69412.611734] ? do_syscall_64+0x69/0xc0 Aug 23 00:40:38 juju-e4d256-prod-github-runner-207 kernel: [69412.612379] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:40:38 juju-e4d256-prod-github-runner-207 kernel: [69412.613079] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:40:38 juju-e4d256-prod-github-runner-207 kernel: [69412.613773] ? do_syscall_64+0x69/0xc0 Aug 23 00:40:38 juju-e4d256-prod-github-runner-207 kernel: [69412.614398] ? do_syscall_64+0x69/0xc0 Aug 23 00:40:38 juju-e4d256-prod-github-runner-207 kernel: [69412.615025] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 00:40:38 juju-e4d256-prod-github-runner-207 kernel: [69412.615729] RIP: 0033:0x7faa5d0edaff Aug 23 00:40:38 juju-e4d256-prod-github-runner-207 kernel: [69412.616352] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 00:40:38 juju-e4d256-prod-github-runner-207 kernel: [69412.618342] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 00:40:38 juju-e4d256-prod-github-runner-207 kernel: [69412.619257] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 00:40:38 juju-e4d256-prod-github-runner-207 kernel: [69412.620147] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 00:40:38 juju-e4d256-prod-github-runner-207 kernel: [69412.621032] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 00:40:38 juju-e4d256-prod-github-runner-207 kernel: [69412.621918] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 00:40:38 juju-e4d256-prod-github-runner-207 kernel: [69412.622806] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 00:40:38 juju-e4d256-prod-github-runner-207 kernel: [69412.623710] Aug 23 00:41:06 juju-e4d256-prod-github-runner-207 kernel: [69440.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 64563s! [qemu-system-x86:6715] Aug 23 00:41:06 juju-e4d256-prod-github-runner-207 kernel: [69440.543094] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 00:41:06 juju-e4d256-prod-github-runner-207 kernel: [69440.543160] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 00:41:06 juju-e4d256-prod-github-runner-207 kernel: [69440.555256] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 00:41:06 juju-e4d256-prod-github-runner-207 kernel: [69440.556521] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 00:41:06 juju-e4d256-prod-github-runner-207 kernel: [69440.557753] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:41:06 juju-e4d256-prod-github-runner-207 kernel: [69440.558823] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 00:41:06 juju-e4d256-prod-github-runner-207 kernel: [69440.561368] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 00:41:06 juju-e4d256-prod-github-runner-207 kernel: [69440.562408] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 00:41:06 juju-e4d256-prod-github-runner-207 kernel: [69440.563577] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 00:41:06 juju-e4d256-prod-github-runner-207 kernel: [69440.564772] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 00:41:06 juju-e4d256-prod-github-runner-207 kernel: [69440.566297] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 00:41:06 juju-e4d256-prod-github-runner-207 kernel: [69440.567689] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 00:41:06 juju-e4d256-prod-github-runner-207 kernel: [69440.568853] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 00:41:06 juju-e4d256-prod-github-runner-207 kernel: [69440.570086] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 00:41:06 juju-e4d256-prod-github-runner-207 kernel: [69440.571194] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 00:41:06 juju-e4d256-prod-github-runner-207 kernel: [69440.572386] Call Trace: Aug 23 00:41:06 juju-e4d256-prod-github-runner-207 kernel: [69440.573298] Aug 23 00:41:06 juju-e4d256-prod-github-runner-207 kernel: [69440.574181] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:41:06 juju-e4d256-prod-github-runner-207 kernel: [69440.575216] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:41:06 juju-e4d256-prod-github-runner-207 kernel: [69440.576237] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:41:06 juju-e4d256-prod-github-runner-207 kernel: [69440.577309] ? show_regs.part.0+0x23/0x29 Aug 23 00:41:06 juju-e4d256-prod-github-runner-207 kernel: [69440.578306] ? show_regs.cold+0x8/0xd Aug 23 00:41:06 juju-e4d256-prod-github-runner-207 kernel: [69440.579283] ? watchdog_timer_fn+0x1be/0x220 Aug 23 00:41:06 juju-e4d256-prod-github-runner-207 kernel: [69440.580288] ? lockup_detector_update_enable+0x60/0x60 Aug 23 00:41:06 juju-e4d256-prod-github-runner-207 kernel: [69440.581349] ? __hrtimer_run_queues+0x107/0x230 Aug 23 00:41:06 juju-e4d256-prod-github-runner-207 kernel: [69440.582375] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 00:41:06 juju-e4d256-prod-github-runner-207 kernel: [69440.583408] ? hrtimer_interrupt+0x101/0x220 Aug 23 00:41:06 juju-e4d256-prod-github-runner-207 kernel: [69440.584422] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 00:41:06 juju-e4d256-prod-github-runner-207 kernel: [69440.585489] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 00:41:06 juju-e4d256-prod-github-runner-207 kernel: [69440.586543] Aug 23 00:41:06 juju-e4d256-prod-github-runner-207 kernel: [69440.587395] Aug 23 00:41:06 juju-e4d256-prod-github-runner-207 kernel: [69440.588280] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 00:41:06 juju-e4d256-prod-github-runner-207 kernel: [69440.589707] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:41:06 juju-e4d256-prod-github-runner-207 kernel: [69440.591191] ? _raw_spin_lock+0x22/0x30 Aug 23 00:41:06 juju-e4d256-prod-github-runner-207 kernel: [69440.592321] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:41:06 juju-e4d256-prod-github-runner-207 kernel: [69440.593724] direct_page_fault+0x206/0x310 [kvm] Aug 23 00:41:06 juju-e4d256-prod-github-runner-207 kernel: [69440.595165] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 00:41:06 juju-e4d256-prod-github-runner-207 kernel: [69440.596583] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 00:41:06 juju-e4d256-prod-github-runner-207 kernel: [69440.597951] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 00:41:06 juju-e4d256-prod-github-runner-207 kernel: [69440.599335] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 00:41:06 juju-e4d256-prod-github-runner-207 kernel: [69440.600724] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 00:41:06 juju-e4d256-prod-github-runner-207 kernel: [69440.602123] handle_exit+0x98/0x230 [kvm_amd] Aug 23 00:41:06 juju-e4d256-prod-github-runner-207 kernel: [69440.603409] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 00:41:06 juju-e4d256-prod-github-runner-207 kernel: [69440.604706] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 00:41:06 juju-e4d256-prod-github-runner-207 kernel: [69440.606032] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 00:41:06 juju-e4d256-prod-github-runner-207 kernel: [69440.607491] vcpu_run+0x62/0x2c0 [kvm] Aug 23 00:41:06 juju-e4d256-prod-github-runner-207 kernel: [69440.608624] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 00:41:06 juju-e4d256-prod-github-runner-207 kernel: [69440.609804] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 00:41:06 juju-e4d256-prod-github-runner-207 kernel: [69440.611059] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 00:41:06 juju-e4d256-prod-github-runner-207 kernel: [69440.612131] ? __seccomp_filter+0x4a/0x4a0 Aug 23 00:41:06 juju-e4d256-prod-github-runner-207 kernel: [69440.612876] ? __fget_files+0x86/0xc0 Aug 23 00:41:06 juju-e4d256-prod-github-runner-207 kernel: [69440.613580] __x64_sys_ioctl+0x95/0xd0 Aug 23 00:41:06 juju-e4d256-prod-github-runner-207 kernel: [69440.614275] do_syscall_64+0x5c/0xc0 Aug 23 00:41:06 juju-e4d256-prod-github-runner-207 kernel: [69440.614948] ? do_futex+0x162/0x1f0 Aug 23 00:41:06 juju-e4d256-prod-github-runner-207 kernel: [69440.615600] ? __x64_sys_futex+0x78/0x1e0 Aug 23 00:41:06 juju-e4d256-prod-github-runner-207 kernel: [69440.616279] ? __secure_computing+0xa9/0x120 Aug 23 00:41:06 juju-e4d256-prod-github-runner-207 kernel: [69440.616969] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 00:41:06 juju-e4d256-prod-github-runner-207 kernel: [69440.617729] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:41:06 juju-e4d256-prod-github-runner-207 kernel: [69440.618452] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:41:06 juju-e4d256-prod-github-runner-207 kernel: [69440.619179] ? do_syscall_64+0x69/0xc0 Aug 23 00:41:06 juju-e4d256-prod-github-runner-207 kernel: [69440.619826] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:41:06 juju-e4d256-prod-github-runner-207 kernel: [69440.620528] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:41:06 juju-e4d256-prod-github-runner-207 kernel: [69440.621230] ? do_syscall_64+0x69/0xc0 Aug 23 00:41:06 juju-e4d256-prod-github-runner-207 kernel: [69440.621854] ? do_syscall_64+0x69/0xc0 Aug 23 00:41:06 juju-e4d256-prod-github-runner-207 kernel: [69440.622475] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 00:41:06 juju-e4d256-prod-github-runner-207 kernel: [69440.623187] RIP: 0033:0x7faa5d0edaff Aug 23 00:41:06 juju-e4d256-prod-github-runner-207 kernel: [69440.623813] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 00:41:06 juju-e4d256-prod-github-runner-207 kernel: [69440.625801] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 00:41:06 juju-e4d256-prod-github-runner-207 kernel: [69440.626718] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 00:41:06 juju-e4d256-prod-github-runner-207 kernel: [69440.627609] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 00:41:06 juju-e4d256-prod-github-runner-207 kernel: [69440.628503] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 00:41:06 juju-e4d256-prod-github-runner-207 kernel: [69440.629395] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 00:41:06 juju-e4d256-prod-github-runner-207 kernel: [69440.630283] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 00:41:06 juju-e4d256-prod-github-runner-207 kernel: [69440.631187] Aug 23 00:41:34 juju-e4d256-prod-github-runner-207 kernel: [69468.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 64589s! [qemu-system-x86:6715] Aug 23 00:41:34 juju-e4d256-prod-github-runner-207 kernel: [69468.543728] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 00:41:34 juju-e4d256-prod-github-runner-207 kernel: [69468.543975] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 00:41:34 juju-e4d256-prod-github-runner-207 kernel: [69468.556398] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 00:41:34 juju-e4d256-prod-github-runner-207 kernel: [69468.557665] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 00:41:34 juju-e4d256-prod-github-runner-207 kernel: [69468.558893] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:41:34 juju-e4d256-prod-github-runner-207 kernel: [69468.559952] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 00:41:34 juju-e4d256-prod-github-runner-207 kernel: [69468.562520] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 00:41:34 juju-e4d256-prod-github-runner-207 kernel: [69468.563570] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 00:41:34 juju-e4d256-prod-github-runner-207 kernel: [69468.564738] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 00:41:34 juju-e4d256-prod-github-runner-207 kernel: [69468.565899] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 00:41:34 juju-e4d256-prod-github-runner-207 kernel: [69468.567069] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 00:41:34 juju-e4d256-prod-github-runner-207 kernel: [69468.568234] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 00:41:34 juju-e4d256-prod-github-runner-207 kernel: [69468.569399] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 00:41:34 juju-e4d256-prod-github-runner-207 kernel: [69468.570643] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 00:41:34 juju-e4d256-prod-github-runner-207 kernel: [69468.571746] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 00:41:34 juju-e4d256-prod-github-runner-207 kernel: [69468.572944] Call Trace: Aug 23 00:41:34 juju-e4d256-prod-github-runner-207 kernel: [69468.573859] Aug 23 00:41:34 juju-e4d256-prod-github-runner-207 kernel: [69468.574768] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:41:34 juju-e4d256-prod-github-runner-207 kernel: [69468.575803] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:41:34 juju-e4d256-prod-github-runner-207 kernel: [69468.576828] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:41:34 juju-e4d256-prod-github-runner-207 kernel: [69468.577916] ? show_regs.part.0+0x23/0x29 Aug 23 00:41:34 juju-e4d256-prod-github-runner-207 kernel: [69468.578930] ? show_regs.cold+0x8/0xd Aug 23 00:41:34 juju-e4d256-prod-github-runner-207 kernel: [69468.580068] ? watchdog_timer_fn+0x1be/0x220 Aug 23 00:41:34 juju-e4d256-prod-github-runner-207 kernel: [69468.581089] ? lockup_detector_update_enable+0x60/0x60 Aug 23 00:41:34 juju-e4d256-prod-github-runner-207 kernel: [69468.582153] ? __hrtimer_run_queues+0x107/0x230 Aug 23 00:41:34 juju-e4d256-prod-github-runner-207 kernel: [69468.583199] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 00:41:34 juju-e4d256-prod-github-runner-207 kernel: [69468.584229] ? hrtimer_interrupt+0x101/0x220 Aug 23 00:41:34 juju-e4d256-prod-github-runner-207 kernel: [69468.585251] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 00:41:34 juju-e4d256-prod-github-runner-207 kernel: [69468.586337] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 00:41:34 juju-e4d256-prod-github-runner-207 kernel: [69468.587382] Aug 23 00:41:34 juju-e4d256-prod-github-runner-207 kernel: [69468.588233] Aug 23 00:41:34 juju-e4d256-prod-github-runner-207 kernel: [69468.589069] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 00:41:34 juju-e4d256-prod-github-runner-207 kernel: [69468.590106] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:41:34 juju-e4d256-prod-github-runner-207 kernel: [69468.591167] ? _raw_spin_lock+0x22/0x30 Aug 23 00:41:34 juju-e4d256-prod-github-runner-207 kernel: [69468.592113] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:41:34 juju-e4d256-prod-github-runner-207 kernel: [69468.593134] direct_page_fault+0x206/0x310 [kvm] Aug 23 00:41:34 juju-e4d256-prod-github-runner-207 kernel: [69468.594155] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 00:41:34 juju-e4d256-prod-github-runner-207 kernel: [69468.595175] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 00:41:34 juju-e4d256-prod-github-runner-207 kernel: [69468.596180] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 00:41:34 juju-e4d256-prod-github-runner-207 kernel: [69468.597175] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 00:41:34 juju-e4d256-prod-github-runner-207 kernel: [69468.598118] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 00:41:34 juju-e4d256-prod-github-runner-207 kernel: [69468.599104] handle_exit+0x98/0x230 [kvm_amd] Aug 23 00:41:34 juju-e4d256-prod-github-runner-207 kernel: [69468.599993] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 00:41:34 juju-e4d256-prod-github-runner-207 kernel: [69468.600903] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 00:41:34 juju-e4d256-prod-github-runner-207 kernel: [69468.601824] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 00:41:34 juju-e4d256-prod-github-runner-207 kernel: [69468.602736] vcpu_run+0x62/0x2c0 [kvm] Aug 23 00:41:34 juju-e4d256-prod-github-runner-207 kernel: [69468.603549] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 00:41:34 juju-e4d256-prod-github-runner-207 kernel: [69468.604353] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 00:41:34 juju-e4d256-prod-github-runner-207 kernel: [69468.605205] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 00:41:34 juju-e4d256-prod-github-runner-207 kernel: [69468.605999] ? __seccomp_filter+0x4a/0x4a0 Aug 23 00:41:34 juju-e4d256-prod-github-runner-207 kernel: [69468.606751] ? __fget_files+0x86/0xc0 Aug 23 00:41:34 juju-e4d256-prod-github-runner-207 kernel: [69468.607452] __x64_sys_ioctl+0x95/0xd0 Aug 23 00:41:34 juju-e4d256-prod-github-runner-207 kernel: [69468.608142] do_syscall_64+0x5c/0xc0 Aug 23 00:41:34 juju-e4d256-prod-github-runner-207 kernel: [69468.608803] ? do_futex+0x162/0x1f0 Aug 23 00:41:34 juju-e4d256-prod-github-runner-207 kernel: [69468.609454] ? __x64_sys_futex+0x78/0x1e0 Aug 23 00:41:34 juju-e4d256-prod-github-runner-207 kernel: [69468.610124] ? __secure_computing+0xa9/0x120 Aug 23 00:41:34 juju-e4d256-prod-github-runner-207 kernel: [69468.610825] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 00:41:34 juju-e4d256-prod-github-runner-207 kernel: [69468.611586] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:41:34 juju-e4d256-prod-github-runner-207 kernel: [69468.612310] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:41:34 juju-e4d256-prod-github-runner-207 kernel: [69468.613024] ? do_syscall_64+0x69/0xc0 Aug 23 00:41:34 juju-e4d256-prod-github-runner-207 kernel: [69468.613670] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:41:34 juju-e4d256-prod-github-runner-207 kernel: [69468.614383] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:41:34 juju-e4d256-prod-github-runner-207 kernel: [69468.615082] ? do_syscall_64+0x69/0xc0 Aug 23 00:41:34 juju-e4d256-prod-github-runner-207 kernel: [69468.615704] ? do_syscall_64+0x69/0xc0 Aug 23 00:41:34 juju-e4d256-prod-github-runner-207 kernel: [69468.616323] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 00:41:34 juju-e4d256-prod-github-runner-207 kernel: [69468.617029] RIP: 0033:0x7faa5d0edaff Aug 23 00:41:34 juju-e4d256-prod-github-runner-207 kernel: [69468.617674] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 00:41:34 juju-e4d256-prod-github-runner-207 kernel: [69468.619673] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 00:41:34 juju-e4d256-prod-github-runner-207 kernel: [69468.620582] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 00:41:34 juju-e4d256-prod-github-runner-207 kernel: [69468.621472] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 00:41:34 juju-e4d256-prod-github-runner-207 kernel: [69468.622375] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 00:41:34 juju-e4d256-prod-github-runner-207 kernel: [69468.623260] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 00:41:34 juju-e4d256-prod-github-runner-207 kernel: [69468.624145] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 00:41:34 juju-e4d256-prod-github-runner-207 kernel: [69468.625034] Aug 23 00:41:47 juju-e4d256-prod-github-runner-207 kernel: [69481.820708] rcu: INFO: rcu_sched self-detected stall on CPU Aug 23 00:41:47 juju-e4d256-prod-github-runner-207 kernel: [69481.822139] rcu: 1-....: (17286496 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=8346895 Aug 23 00:41:47 juju-e4d256-prod-github-runner-207 kernel: [69481.823883] (t=17341155 jiffies g=23269 q=60055) Aug 23 00:41:47 juju-e4d256-prod-github-runner-207 kernel: [69481.825023] NMI backtrace for cpu 1 Aug 23 00:41:47 juju-e4d256-prod-github-runner-207 kernel: [69481.826069] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 00:41:47 juju-e4d256-prod-github-runner-207 kernel: [69481.827786] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 00:41:47 juju-e4d256-prod-github-runner-207 kernel: [69481.829376] Call Trace: Aug 23 00:41:47 juju-e4d256-prod-github-runner-207 kernel: [69481.830512] Aug 23 00:41:47 juju-e4d256-prod-github-runner-207 kernel: [69481.831313] show_stack+0x52/0x5c Aug 23 00:41:47 juju-e4d256-prod-github-runner-207 kernel: [69481.832039] dump_stack_lvl+0x4a/0x63 Aug 23 00:41:47 juju-e4d256-prod-github-runner-207 kernel: [69481.832784] dump_stack+0x10/0x16 Aug 23 00:41:47 juju-e4d256-prod-github-runner-207 kernel: [69481.833505] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 23 00:41:47 juju-e4d256-prod-github-runner-207 kernel: [69481.834299] ? lapic_can_unplug_cpu+0x90/0x90 Aug 23 00:41:47 juju-e4d256-prod-github-runner-207 kernel: [69481.835077] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 23 00:41:47 juju-e4d256-prod-github-runner-207 kernel: [69481.835899] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 23 00:41:47 juju-e4d256-prod-github-runner-207 kernel: [69481.836726] trigger_single_cpu_backtrace+0x44/0x4f Aug 23 00:41:47 juju-e4d256-prod-github-runner-207 kernel: [69481.837532] rcu_dump_cpu_stacks+0x102/0x149 Aug 23 00:41:47 juju-e4d256-prod-github-runner-207 kernel: [69481.838317] print_cpu_stall.cold+0x2f/0xe2 Aug 23 00:41:47 juju-e4d256-prod-github-runner-207 kernel: [69481.839081] ? timekeeping_update+0xf7/0x150 Aug 23 00:41:47 juju-e4d256-prod-github-runner-207 kernel: [69481.839855] check_cpu_stall+0x109/0x270 Aug 23 00:41:47 juju-e4d256-prod-github-runner-207 kernel: [69481.840602] rcu_sched_clock_irq+0x9a/0x250 Aug 23 00:41:47 juju-e4d256-prod-github-runner-207 kernel: [69481.841362] update_process_times+0x94/0xd0 Aug 23 00:41:47 juju-e4d256-prod-github-runner-207 kernel: [69481.842137] tick_sched_handle+0x29/0x70 Aug 23 00:41:47 juju-e4d256-prod-github-runner-207 kernel: [69481.842882] tick_sched_timer+0x8c/0xc0 Aug 23 00:41:47 juju-e4d256-prod-github-runner-207 kernel: [69481.843643] ? tick_nohz_handler+0xb0/0xb0 Aug 23 00:41:47 juju-e4d256-prod-github-runner-207 kernel: [69481.844397] __hrtimer_run_queues+0x107/0x230 Aug 23 00:41:47 juju-e4d256-prod-github-runner-207 kernel: [69481.845174] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 00:41:47 juju-e4d256-prod-github-runner-207 kernel: [69481.845950] hrtimer_interrupt+0x101/0x220 Aug 23 00:41:47 juju-e4d256-prod-github-runner-207 kernel: [69481.846718] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 00:41:47 juju-e4d256-prod-github-runner-207 kernel: [69481.847528] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 00:41:47 juju-e4d256-prod-github-runner-207 kernel: [69481.848328] Aug 23 00:41:47 juju-e4d256-prod-github-runner-207 kernel: [69481.848962] Aug 23 00:41:47 juju-e4d256-prod-github-runner-207 kernel: [69481.849590] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 00:41:47 juju-e4d256-prod-github-runner-207 kernel: [69481.850420] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:41:47 juju-e4d256-prod-github-runner-207 kernel: [69481.851300] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 00:41:47 juju-e4d256-prod-github-runner-207 kernel: [69481.853518] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 00:41:47 juju-e4d256-prod-github-runner-207 kernel: [69481.854428] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 00:41:47 juju-e4d256-prod-github-runner-207 kernel: [69481.855431] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 00:41:47 juju-e4d256-prod-github-runner-207 kernel: [69481.856409] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 00:41:47 juju-e4d256-prod-github-runner-207 kernel: [69481.857375] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 00:41:47 juju-e4d256-prod-github-runner-207 kernel: [69481.858351] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 00:41:47 juju-e4d256-prod-github-runner-207 kernel: [69481.859307] ? _raw_spin_lock+0x22/0x30 Aug 23 00:41:47 juju-e4d256-prod-github-runner-207 kernel: [69481.860066] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:41:47 juju-e4d256-prod-github-runner-207 kernel: [69481.860901] direct_page_fault+0x206/0x310 [kvm] Aug 23 00:41:47 juju-e4d256-prod-github-runner-207 kernel: [69481.861744] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 00:41:47 juju-e4d256-prod-github-runner-207 kernel: [69481.862587] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 00:41:47 juju-e4d256-prod-github-runner-207 kernel: [69481.863409] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 00:41:47 juju-e4d256-prod-github-runner-207 kernel: [69481.864217] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 00:41:47 juju-e4d256-prod-github-runner-207 kernel: [69481.865000] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 00:41:47 juju-e4d256-prod-github-runner-207 kernel: [69481.865819] handle_exit+0x98/0x230 [kvm_amd] Aug 23 00:41:47 juju-e4d256-prod-github-runner-207 kernel: [69481.866589] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 00:41:47 juju-e4d256-prod-github-runner-207 kernel: [69481.867371] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 00:41:47 juju-e4d256-prod-github-runner-207 kernel: [69481.868168] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 00:41:47 juju-e4d256-prod-github-runner-207 kernel: [69481.868950] vcpu_run+0x62/0x2c0 [kvm] Aug 23 00:41:47 juju-e4d256-prod-github-runner-207 kernel: [69481.869663] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 00:41:47 juju-e4d256-prod-github-runner-207 kernel: [69481.870407] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 00:41:47 juju-e4d256-prod-github-runner-207 kernel: [69481.871208] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 00:41:47 juju-e4d256-prod-github-runner-207 kernel: [69481.871967] ? __seccomp_filter+0x4a/0x4a0 Aug 23 00:41:47 juju-e4d256-prod-github-runner-207 kernel: [69481.872684] ? __fget_files+0x86/0xc0 Aug 23 00:41:47 juju-e4d256-prod-github-runner-207 kernel: [69481.873376] __x64_sys_ioctl+0x95/0xd0 Aug 23 00:41:47 juju-e4d256-prod-github-runner-207 kernel: [69481.874080] do_syscall_64+0x5c/0xc0 Aug 23 00:41:47 juju-e4d256-prod-github-runner-207 kernel: [69481.874766] ? do_futex+0x162/0x1f0 Aug 23 00:41:47 juju-e4d256-prod-github-runner-207 kernel: [69481.875439] ? __x64_sys_futex+0x78/0x1e0 Aug 23 00:41:47 juju-e4d256-prod-github-runner-207 kernel: [69481.876137] ? __secure_computing+0xa9/0x120 Aug 23 00:41:47 juju-e4d256-prod-github-runner-207 kernel: [69481.876869] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 00:41:47 juju-e4d256-prod-github-runner-207 kernel: [69481.877666] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:41:47 juju-e4d256-prod-github-runner-207 kernel: [69481.878429] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:41:47 juju-e4d256-prod-github-runner-207 kernel: [69481.879186] ? do_syscall_64+0x69/0xc0 Aug 23 00:41:47 juju-e4d256-prod-github-runner-207 kernel: [69481.879874] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:41:47 juju-e4d256-prod-github-runner-207 kernel: [69481.880626] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:41:47 juju-e4d256-prod-github-runner-207 kernel: [69481.881382] ? do_syscall_64+0x69/0xc0 Aug 23 00:41:47 juju-e4d256-prod-github-runner-207 kernel: [69481.882094] ? do_syscall_64+0x69/0xc0 Aug 23 00:41:47 juju-e4d256-prod-github-runner-207 kernel: [69481.882780] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 00:41:47 juju-e4d256-prod-github-runner-207 kernel: [69481.883547] RIP: 0033:0x7faa5d0edaff Aug 23 00:41:47 juju-e4d256-prod-github-runner-207 kernel: [69481.884229] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 00:41:47 juju-e4d256-prod-github-runner-207 kernel: [69481.886346] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 00:41:47 juju-e4d256-prod-github-runner-207 kernel: [69481.887310] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 00:41:47 juju-e4d256-prod-github-runner-207 kernel: [69481.888255] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 00:41:47 juju-e4d256-prod-github-runner-207 kernel: [69481.889198] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 00:41:47 juju-e4d256-prod-github-runner-207 kernel: [69481.890216] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 00:41:47 juju-e4d256-prod-github-runner-207 kernel: [69481.891142] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 00:41:47 juju-e4d256-prod-github-runner-207 kernel: [69481.892054] Aug 23 00:42:14 juju-e4d256-prod-github-runner-207 kernel: [69508.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 64626s! [qemu-system-x86:6715] Aug 23 00:42:14 juju-e4d256-prod-github-runner-207 kernel: [69508.543110] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 00:42:14 juju-e4d256-prod-github-runner-207 kernel: [69508.543180] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 00:42:14 juju-e4d256-prod-github-runner-207 kernel: [69508.555391] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 00:42:14 juju-e4d256-prod-github-runner-207 kernel: [69508.556678] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 00:42:14 juju-e4d256-prod-github-runner-207 kernel: [69508.557916] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:42:14 juju-e4d256-prod-github-runner-207 kernel: [69508.558972] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 00:42:14 juju-e4d256-prod-github-runner-207 kernel: [69508.561543] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 00:42:14 juju-e4d256-prod-github-runner-207 kernel: [69508.562714] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 00:42:14 juju-e4d256-prod-github-runner-207 kernel: [69508.563882] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 00:42:14 juju-e4d256-prod-github-runner-207 kernel: [69508.565036] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 00:42:14 juju-e4d256-prod-github-runner-207 kernel: [69508.566250] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 00:42:14 juju-e4d256-prod-github-runner-207 kernel: [69508.567477] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 00:42:14 juju-e4d256-prod-github-runner-207 kernel: [69508.568671] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 00:42:14 juju-e4d256-prod-github-runner-207 kernel: [69508.569926] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 00:42:14 juju-e4d256-prod-github-runner-207 kernel: [69508.571049] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 00:42:14 juju-e4d256-prod-github-runner-207 kernel: [69508.572258] Call Trace: Aug 23 00:42:14 juju-e4d256-prod-github-runner-207 kernel: [69508.573172] Aug 23 00:42:14 juju-e4d256-prod-github-runner-207 kernel: [69508.574090] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:42:14 juju-e4d256-prod-github-runner-207 kernel: [69508.575130] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:42:14 juju-e4d256-prod-github-runner-207 kernel: [69508.576169] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:42:14 juju-e4d256-prod-github-runner-207 kernel: [69508.577295] ? show_regs.part.0+0x23/0x29 Aug 23 00:42:14 juju-e4d256-prod-github-runner-207 kernel: [69508.578333] ? show_regs.cold+0x8/0xd Aug 23 00:42:14 juju-e4d256-prod-github-runner-207 kernel: [69508.579314] ? watchdog_timer_fn+0x1be/0x220 Aug 23 00:42:14 juju-e4d256-prod-github-runner-207 kernel: [69508.580331] ? lockup_detector_update_enable+0x60/0x60 Aug 23 00:42:14 juju-e4d256-prod-github-runner-207 kernel: [69508.581416] ? __hrtimer_run_queues+0x107/0x230 Aug 23 00:42:14 juju-e4d256-prod-github-runner-207 kernel: [69508.582476] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 00:42:14 juju-e4d256-prod-github-runner-207 kernel: [69508.583502] ? hrtimer_interrupt+0x101/0x220 Aug 23 00:42:14 juju-e4d256-prod-github-runner-207 kernel: [69508.584587] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 00:42:14 juju-e4d256-prod-github-runner-207 kernel: [69508.585667] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 00:42:14 juju-e4d256-prod-github-runner-207 kernel: [69508.586746] Aug 23 00:42:14 juju-e4d256-prod-github-runner-207 kernel: [69508.587623] Aug 23 00:42:14 juju-e4d256-prod-github-runner-207 kernel: [69508.588463] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 00:42:14 juju-e4d256-prod-github-runner-207 kernel: [69508.589497] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:42:14 juju-e4d256-prod-github-runner-207 kernel: [69508.590547] ? _raw_spin_lock+0x22/0x30 Aug 23 00:42:14 juju-e4d256-prod-github-runner-207 kernel: [69508.591503] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:42:14 juju-e4d256-prod-github-runner-207 kernel: [69508.592631] direct_page_fault+0x206/0x310 [kvm] Aug 23 00:42:14 juju-e4d256-prod-github-runner-207 kernel: [69508.593665] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 00:42:14 juju-e4d256-prod-github-runner-207 kernel: [69508.594683] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 00:42:14 juju-e4d256-prod-github-runner-207 kernel: [69508.595681] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 00:42:14 juju-e4d256-prod-github-runner-207 kernel: [69508.596649] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 00:42:14 juju-e4d256-prod-github-runner-207 kernel: [69508.597597] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 00:42:14 juju-e4d256-prod-github-runner-207 kernel: [69508.598636] handle_exit+0x98/0x230 [kvm_amd] Aug 23 00:42:14 juju-e4d256-prod-github-runner-207 kernel: [69508.599566] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 00:42:14 juju-e4d256-prod-github-runner-207 kernel: [69508.600487] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 00:42:14 juju-e4d256-prod-github-runner-207 kernel: [69508.601410] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 00:42:14 juju-e4d256-prod-github-runner-207 kernel: [69508.602322] vcpu_run+0x62/0x2c0 [kvm] Aug 23 00:42:14 juju-e4d256-prod-github-runner-207 kernel: [69508.603181] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 00:42:14 juju-e4d256-prod-github-runner-207 kernel: [69508.603991] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 00:42:14 juju-e4d256-prod-github-runner-207 kernel: [69508.604844] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 00:42:14 juju-e4d256-prod-github-runner-207 kernel: [69508.605645] ? __seccomp_filter+0x4a/0x4a0 Aug 23 00:42:14 juju-e4d256-prod-github-runner-207 kernel: [69508.606393] ? __fget_files+0x86/0xc0 Aug 23 00:42:14 juju-e4d256-prod-github-runner-207 kernel: [69508.607098] __x64_sys_ioctl+0x95/0xd0 Aug 23 00:42:14 juju-e4d256-prod-github-runner-207 kernel: [69508.607790] do_syscall_64+0x5c/0xc0 Aug 23 00:42:14 juju-e4d256-prod-github-runner-207 kernel: [69508.608460] ? do_futex+0x162/0x1f0 Aug 23 00:42:14 juju-e4d256-prod-github-runner-207 kernel: [69508.609107] ? __x64_sys_futex+0x78/0x1e0 Aug 23 00:42:14 juju-e4d256-prod-github-runner-207 kernel: [69508.609790] ? __secure_computing+0xa9/0x120 Aug 23 00:42:14 juju-e4d256-prod-github-runner-207 kernel: [69508.610483] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 00:42:14 juju-e4d256-prod-github-runner-207 kernel: [69508.611239] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:42:14 juju-e4d256-prod-github-runner-207 kernel: [69508.611958] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:42:14 juju-e4d256-prod-github-runner-207 kernel: [69508.612673] ? do_syscall_64+0x69/0xc0 Aug 23 00:42:14 juju-e4d256-prod-github-runner-207 kernel: [69508.613316] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:42:14 juju-e4d256-prod-github-runner-207 kernel: [69508.614027] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:42:14 juju-e4d256-prod-github-runner-207 kernel: [69508.614721] ? do_syscall_64+0x69/0xc0 Aug 23 00:42:14 juju-e4d256-prod-github-runner-207 kernel: [69508.615342] ? do_syscall_64+0x69/0xc0 Aug 23 00:42:14 juju-e4d256-prod-github-runner-207 kernel: [69508.615962] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 00:42:14 juju-e4d256-prod-github-runner-207 kernel: [69508.616683] RIP: 0033:0x7faa5d0edaff Aug 23 00:42:14 juju-e4d256-prod-github-runner-207 kernel: [69508.617308] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 00:42:14 juju-e4d256-prod-github-runner-207 kernel: [69508.619302] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 00:42:14 juju-e4d256-prod-github-runner-207 kernel: [69508.620207] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 00:42:14 juju-e4d256-prod-github-runner-207 kernel: [69508.621098] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 00:42:14 juju-e4d256-prod-github-runner-207 kernel: [69508.622078] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 00:42:14 juju-e4d256-prod-github-runner-207 kernel: [69508.622979] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 00:42:14 juju-e4d256-prod-github-runner-207 kernel: [69508.623863] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 00:42:14 juju-e4d256-prod-github-runner-207 kernel: [69508.624772] Aug 23 00:42:42 juju-e4d256-prod-github-runner-207 kernel: [69536.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 64652s! [qemu-system-x86:6715] Aug 23 00:42:42 juju-e4d256-prod-github-runner-207 kernel: [69536.543162] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 00:42:42 juju-e4d256-prod-github-runner-207 kernel: [69536.543364] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 00:42:42 juju-e4d256-prod-github-runner-207 kernel: [69536.555418] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 00:42:42 juju-e4d256-prod-github-runner-207 kernel: [69536.556679] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 00:42:42 juju-e4d256-prod-github-runner-207 kernel: [69536.557909] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:42:42 juju-e4d256-prod-github-runner-207 kernel: [69536.558964] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 00:42:42 juju-e4d256-prod-github-runner-207 kernel: [69536.561517] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 00:42:42 juju-e4d256-prod-github-runner-207 kernel: [69536.562563] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 00:42:42 juju-e4d256-prod-github-runner-207 kernel: [69536.563729] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 00:42:42 juju-e4d256-prod-github-runner-207 kernel: [69536.564886] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 00:42:42 juju-e4d256-prod-github-runner-207 kernel: [69536.566054] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 00:42:42 juju-e4d256-prod-github-runner-207 kernel: [69536.567215] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 00:42:42 juju-e4d256-prod-github-runner-207 kernel: [69536.568380] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 00:42:42 juju-e4d256-prod-github-runner-207 kernel: [69536.569621] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 00:42:42 juju-e4d256-prod-github-runner-207 kernel: [69536.570719] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 00:42:42 juju-e4d256-prod-github-runner-207 kernel: [69536.571910] Call Trace: Aug 23 00:42:42 juju-e4d256-prod-github-runner-207 kernel: [69536.572820] Aug 23 00:42:42 juju-e4d256-prod-github-runner-207 kernel: [69536.573726] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:42:42 juju-e4d256-prod-github-runner-207 kernel: [69536.574794] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:42:42 juju-e4d256-prod-github-runner-207 kernel: [69536.575817] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:42:42 juju-e4d256-prod-github-runner-207 kernel: [69536.576907] ? show_regs.part.0+0x23/0x29 Aug 23 00:42:42 juju-e4d256-prod-github-runner-207 kernel: [69536.577916] ? show_regs.cold+0x8/0xd Aug 23 00:42:42 juju-e4d256-prod-github-runner-207 kernel: [69536.578886] ? watchdog_timer_fn+0x1be/0x220 Aug 23 00:42:42 juju-e4d256-prod-github-runner-207 kernel: [69536.579892] ? lockup_detector_update_enable+0x60/0x60 Aug 23 00:42:42 juju-e4d256-prod-github-runner-207 kernel: [69536.580952] ? __hrtimer_run_queues+0x107/0x230 Aug 23 00:42:42 juju-e4d256-prod-github-runner-207 kernel: [69536.581993] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 00:42:42 juju-e4d256-prod-github-runner-207 kernel: [69536.583014] ? hrtimer_interrupt+0x101/0x220 Aug 23 00:42:42 juju-e4d256-prod-github-runner-207 kernel: [69536.584027] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 00:42:42 juju-e4d256-prod-github-runner-207 kernel: [69536.585092] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 00:42:42 juju-e4d256-prod-github-runner-207 kernel: [69536.586142] Aug 23 00:42:42 juju-e4d256-prod-github-runner-207 kernel: [69536.586992] Aug 23 00:42:42 juju-e4d256-prod-github-runner-207 kernel: [69536.587830] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 00:42:42 juju-e4d256-prod-github-runner-207 kernel: [69536.588859] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:42:42 juju-e4d256-prod-github-runner-207 kernel: [69536.589903] ? _raw_spin_lock+0x22/0x30 Aug 23 00:42:42 juju-e4d256-prod-github-runner-207 kernel: [69536.590850] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:42:42 juju-e4d256-prod-github-runner-207 kernel: [69536.591863] direct_page_fault+0x206/0x310 [kvm] Aug 23 00:42:42 juju-e4d256-prod-github-runner-207 kernel: [69536.592883] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 00:42:42 juju-e4d256-prod-github-runner-207 kernel: [69536.593905] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 00:42:42 juju-e4d256-prod-github-runner-207 kernel: [69536.594904] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 00:42:42 juju-e4d256-prod-github-runner-207 kernel: [69536.595890] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 00:42:42 juju-e4d256-prod-github-runner-207 kernel: [69536.596834] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 00:42:42 juju-e4d256-prod-github-runner-207 kernel: [69536.597825] handle_exit+0x98/0x230 [kvm_amd] Aug 23 00:42:42 juju-e4d256-prod-github-runner-207 kernel: [69536.598721] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 00:42:42 juju-e4d256-prod-github-runner-207 kernel: [69536.599632] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 00:42:42 juju-e4d256-prod-github-runner-207 kernel: [69536.600558] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 00:42:42 juju-e4d256-prod-github-runner-207 kernel: [69536.601477] vcpu_run+0x62/0x2c0 [kvm] Aug 23 00:42:42 juju-e4d256-prod-github-runner-207 kernel: [69536.602286] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 00:42:42 juju-e4d256-prod-github-runner-207 kernel: [69536.603092] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 00:42:42 juju-e4d256-prod-github-runner-207 kernel: [69536.603948] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 00:42:42 juju-e4d256-prod-github-runner-207 kernel: [69536.604741] ? __seccomp_filter+0x4a/0x4a0 Aug 23 00:42:42 juju-e4d256-prod-github-runner-207 kernel: [69536.605493] ? __fget_files+0x86/0xc0 Aug 23 00:42:42 juju-e4d256-prod-github-runner-207 kernel: [69536.606212] __x64_sys_ioctl+0x95/0xd0 Aug 23 00:42:42 juju-e4d256-prod-github-runner-207 kernel: [69536.606905] do_syscall_64+0x5c/0xc0 Aug 23 00:42:42 juju-e4d256-prod-github-runner-207 kernel: [69536.607566] ? do_futex+0x162/0x1f0 Aug 23 00:42:42 juju-e4d256-prod-github-runner-207 kernel: [69536.608212] ? __x64_sys_futex+0x78/0x1e0 Aug 23 00:42:42 juju-e4d256-prod-github-runner-207 kernel: [69536.608882] ? __secure_computing+0xa9/0x120 Aug 23 00:42:42 juju-e4d256-prod-github-runner-207 kernel: [69536.609585] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 00:42:42 juju-e4d256-prod-github-runner-207 kernel: [69536.610350] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:42:42 juju-e4d256-prod-github-runner-207 kernel: [69536.611072] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:42:42 juju-e4d256-prod-github-runner-207 kernel: [69536.611790] ? do_syscall_64+0x69/0xc0 Aug 23 00:42:42 juju-e4d256-prod-github-runner-207 kernel: [69536.612434] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:42:42 juju-e4d256-prod-github-runner-207 kernel: [69536.613135] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:42:42 juju-e4d256-prod-github-runner-207 kernel: [69536.613845] ? do_syscall_64+0x69/0xc0 Aug 23 00:42:42 juju-e4d256-prod-github-runner-207 kernel: [69536.614469] ? do_syscall_64+0x69/0xc0 Aug 23 00:42:42 juju-e4d256-prod-github-runner-207 kernel: [69536.615088] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 00:42:42 juju-e4d256-prod-github-runner-207 kernel: [69536.615796] RIP: 0033:0x7faa5d0edaff Aug 23 00:42:42 juju-e4d256-prod-github-runner-207 kernel: [69536.616435] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 00:42:42 juju-e4d256-prod-github-runner-207 kernel: [69536.618428] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 00:42:42 juju-e4d256-prod-github-runner-207 kernel: [69536.619333] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 00:42:42 juju-e4d256-prod-github-runner-207 kernel: [69536.620217] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 00:42:42 juju-e4d256-prod-github-runner-207 kernel: [69536.621102] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 00:42:42 juju-e4d256-prod-github-runner-207 kernel: [69536.622002] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 00:42:42 juju-e4d256-prod-github-runner-207 kernel: [69536.622893] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 00:42:42 juju-e4d256-prod-github-runner-207 kernel: [69536.623786] Aug 23 00:43:10 juju-e4d256-prod-github-runner-207 kernel: [69564.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 64679s! [qemu-system-x86:6715] Aug 23 00:43:10 juju-e4d256-prod-github-runner-207 kernel: [69564.543681] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 00:43:10 juju-e4d256-prod-github-runner-207 kernel: [69564.543856] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 00:43:10 juju-e4d256-prod-github-runner-207 kernel: [69564.556121] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 00:43:10 juju-e4d256-prod-github-runner-207 kernel: [69564.557574] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 00:43:10 juju-e4d256-prod-github-runner-207 kernel: [69564.558872] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:43:10 juju-e4d256-prod-github-runner-207 kernel: [69564.559934] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 00:43:10 juju-e4d256-prod-github-runner-207 kernel: [69564.562505] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 00:43:10 juju-e4d256-prod-github-runner-207 kernel: [69564.563547] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 00:43:10 juju-e4d256-prod-github-runner-207 kernel: [69564.564710] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 00:43:10 juju-e4d256-prod-github-runner-207 kernel: [69564.565887] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 00:43:10 juju-e4d256-prod-github-runner-207 kernel: [69564.567052] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 00:43:10 juju-e4d256-prod-github-runner-207 kernel: [69564.568213] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 00:43:10 juju-e4d256-prod-github-runner-207 kernel: [69564.569399] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 00:43:10 juju-e4d256-prod-github-runner-207 kernel: [69564.570634] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 00:43:10 juju-e4d256-prod-github-runner-207 kernel: [69564.571732] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 00:43:10 juju-e4d256-prod-github-runner-207 kernel: [69564.572923] Call Trace: Aug 23 00:43:10 juju-e4d256-prod-github-runner-207 kernel: [69564.573847] Aug 23 00:43:10 juju-e4d256-prod-github-runner-207 kernel: [69564.574735] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:43:10 juju-e4d256-prod-github-runner-207 kernel: [69564.575764] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:43:10 juju-e4d256-prod-github-runner-207 kernel: [69564.576786] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:43:10 juju-e4d256-prod-github-runner-207 kernel: [69564.577870] ? show_regs.part.0+0x23/0x29 Aug 23 00:43:10 juju-e4d256-prod-github-runner-207 kernel: [69564.578866] ? show_regs.cold+0x8/0xd Aug 23 00:43:10 juju-e4d256-prod-github-runner-207 kernel: [69564.579839] ? watchdog_timer_fn+0x1be/0x220 Aug 23 00:43:10 juju-e4d256-prod-github-runner-207 kernel: [69564.580848] ? lockup_detector_update_enable+0x60/0x60 Aug 23 00:43:10 juju-e4d256-prod-github-runner-207 kernel: [69564.581922] ? __hrtimer_run_queues+0x107/0x230 Aug 23 00:43:10 juju-e4d256-prod-github-runner-207 kernel: [69564.582949] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 00:43:10 juju-e4d256-prod-github-runner-207 kernel: [69564.583971] ? hrtimer_interrupt+0x101/0x220 Aug 23 00:43:10 juju-e4d256-prod-github-runner-207 kernel: [69564.584989] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 00:43:10 juju-e4d256-prod-github-runner-207 kernel: [69564.586071] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 00:43:10 juju-e4d256-prod-github-runner-207 kernel: [69564.587117] Aug 23 00:43:10 juju-e4d256-prod-github-runner-207 kernel: [69564.587969] Aug 23 00:43:10 juju-e4d256-prod-github-runner-207 kernel: [69564.588805] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 00:43:10 juju-e4d256-prod-github-runner-207 kernel: [69564.589851] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:43:10 juju-e4d256-prod-github-runner-207 kernel: [69564.590889] ? _raw_spin_lock+0x22/0x30 Aug 23 00:43:10 juju-e4d256-prod-github-runner-207 kernel: [69564.591841] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:43:10 juju-e4d256-prod-github-runner-207 kernel: [69564.592854] direct_page_fault+0x206/0x310 [kvm] Aug 23 00:43:10 juju-e4d256-prod-github-runner-207 kernel: [69564.593889] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 00:43:10 juju-e4d256-prod-github-runner-207 kernel: [69564.594895] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 00:43:10 juju-e4d256-prod-github-runner-207 kernel: [69564.595894] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 00:43:10 juju-e4d256-prod-github-runner-207 kernel: [69564.596878] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 00:43:10 juju-e4d256-prod-github-runner-207 kernel: [69564.597835] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 00:43:10 juju-e4d256-prod-github-runner-207 kernel: [69564.598818] handle_exit+0x98/0x230 [kvm_amd] Aug 23 00:43:10 juju-e4d256-prod-github-runner-207 kernel: [69564.599710] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 00:43:10 juju-e4d256-prod-github-runner-207 kernel: [69564.600628] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 00:43:10 juju-e4d256-prod-github-runner-207 kernel: [69564.601567] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 00:43:10 juju-e4d256-prod-github-runner-207 kernel: [69564.602472] vcpu_run+0x62/0x2c0 [kvm] Aug 23 00:43:10 juju-e4d256-prod-github-runner-207 kernel: [69564.603283] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 00:43:10 juju-e4d256-prod-github-runner-207 kernel: [69564.604098] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 00:43:10 juju-e4d256-prod-github-runner-207 kernel: [69564.604953] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 00:43:10 juju-e4d256-prod-github-runner-207 kernel: [69564.605841] ? __seccomp_filter+0x4a/0x4a0 Aug 23 00:43:10 juju-e4d256-prod-github-runner-207 kernel: [69564.606585] ? __fget_files+0x86/0xc0 Aug 23 00:43:10 juju-e4d256-prod-github-runner-207 kernel: [69564.607288] __x64_sys_ioctl+0x95/0xd0 Aug 23 00:43:10 juju-e4d256-prod-github-runner-207 kernel: [69564.607979] do_syscall_64+0x5c/0xc0 Aug 23 00:43:10 juju-e4d256-prod-github-runner-207 kernel: [69564.608641] ? do_futex+0x162/0x1f0 Aug 23 00:43:10 juju-e4d256-prod-github-runner-207 kernel: [69564.609302] ? __x64_sys_futex+0x78/0x1e0 Aug 23 00:43:10 juju-e4d256-prod-github-runner-207 kernel: [69564.609980] ? __secure_computing+0xa9/0x120 Aug 23 00:43:10 juju-e4d256-prod-github-runner-207 kernel: [69564.610668] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 00:43:10 juju-e4d256-prod-github-runner-207 kernel: [69564.611428] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:43:10 juju-e4d256-prod-github-runner-207 kernel: [69564.612149] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:43:10 juju-e4d256-prod-github-runner-207 kernel: [69564.612865] ? do_syscall_64+0x69/0xc0 Aug 23 00:43:10 juju-e4d256-prod-github-runner-207 kernel: [69564.613519] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:43:10 juju-e4d256-prod-github-runner-207 kernel: [69564.614220] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:43:10 juju-e4d256-prod-github-runner-207 kernel: [69564.614913] ? do_syscall_64+0x69/0xc0 Aug 23 00:43:10 juju-e4d256-prod-github-runner-207 kernel: [69564.615535] ? do_syscall_64+0x69/0xc0 Aug 23 00:43:10 juju-e4d256-prod-github-runner-207 kernel: [69564.616155] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 00:43:10 juju-e4d256-prod-github-runner-207 kernel: [69564.616859] RIP: 0033:0x7faa5d0edaff Aug 23 00:43:10 juju-e4d256-prod-github-runner-207 kernel: [69564.617489] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 00:43:10 juju-e4d256-prod-github-runner-207 kernel: [69564.619464] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 00:43:10 juju-e4d256-prod-github-runner-207 kernel: [69564.620371] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 00:43:10 juju-e4d256-prod-github-runner-207 kernel: [69564.621273] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 00:43:10 juju-e4d256-prod-github-runner-207 kernel: [69564.622161] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 00:43:10 juju-e4d256-prod-github-runner-207 kernel: [69564.623049] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 00:43:10 juju-e4d256-prod-github-runner-207 kernel: [69564.623934] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 00:43:10 juju-e4d256-prod-github-runner-207 kernel: [69564.624824] Aug 23 00:43:38 juju-e4d256-prod-github-runner-207 kernel: [69592.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 64705s! [qemu-system-x86:6715] Aug 23 00:43:38 juju-e4d256-prod-github-runner-207 kernel: [69592.543123] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 00:43:38 juju-e4d256-prod-github-runner-207 kernel: [69592.543191] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 00:43:38 juju-e4d256-prod-github-runner-207 kernel: [69592.555468] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 00:43:38 juju-e4d256-prod-github-runner-207 kernel: [69592.556748] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 00:43:38 juju-e4d256-prod-github-runner-207 kernel: [69592.557973] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:43:38 juju-e4d256-prod-github-runner-207 kernel: [69592.559037] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 00:43:38 juju-e4d256-prod-github-runner-207 kernel: [69592.561607] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 00:43:38 juju-e4d256-prod-github-runner-207 kernel: [69592.562651] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 00:43:38 juju-e4d256-prod-github-runner-207 kernel: [69592.563813] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 00:43:38 juju-e4d256-prod-github-runner-207 kernel: [69592.564986] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 00:43:38 juju-e4d256-prod-github-runner-207 kernel: [69592.566152] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 00:43:38 juju-e4d256-prod-github-runner-207 kernel: [69592.567345] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 00:43:38 juju-e4d256-prod-github-runner-207 kernel: [69592.568512] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 00:43:38 juju-e4d256-prod-github-runner-207 kernel: [69592.569798] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 00:43:38 juju-e4d256-prod-github-runner-207 kernel: [69592.571045] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 00:43:38 juju-e4d256-prod-github-runner-207 kernel: [69592.572383] Call Trace: Aug 23 00:43:38 juju-e4d256-prod-github-runner-207 kernel: [69592.573346] Aug 23 00:43:38 juju-e4d256-prod-github-runner-207 kernel: [69592.574230] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:43:38 juju-e4d256-prod-github-runner-207 kernel: [69592.575260] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:43:38 juju-e4d256-prod-github-runner-207 kernel: [69592.576284] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:43:38 juju-e4d256-prod-github-runner-207 kernel: [69592.577386] ? show_regs.part.0+0x23/0x29 Aug 23 00:43:38 juju-e4d256-prod-github-runner-207 kernel: [69592.578383] ? show_regs.cold+0x8/0xd Aug 23 00:43:38 juju-e4d256-prod-github-runner-207 kernel: [69592.579358] ? watchdog_timer_fn+0x1be/0x220 Aug 23 00:43:38 juju-e4d256-prod-github-runner-207 kernel: [69592.580392] ? lockup_detector_update_enable+0x60/0x60 Aug 23 00:43:38 juju-e4d256-prod-github-runner-207 kernel: [69592.581480] ? __hrtimer_run_queues+0x107/0x230 Aug 23 00:43:38 juju-e4d256-prod-github-runner-207 kernel: [69592.582541] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 00:43:38 juju-e4d256-prod-github-runner-207 kernel: [69592.583600] ? hrtimer_interrupt+0x101/0x220 Aug 23 00:43:38 juju-e4d256-prod-github-runner-207 kernel: [69592.584615] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 00:43:38 juju-e4d256-prod-github-runner-207 kernel: [69592.585700] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 00:43:38 juju-e4d256-prod-github-runner-207 kernel: [69592.586744] Aug 23 00:43:38 juju-e4d256-prod-github-runner-207 kernel: [69592.587597] Aug 23 00:43:38 juju-e4d256-prod-github-runner-207 kernel: [69592.588433] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 00:43:38 juju-e4d256-prod-github-runner-207 kernel: [69592.589517] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:43:38 juju-e4d256-prod-github-runner-207 kernel: [69592.590593] ? _raw_spin_lock+0x22/0x30 Aug 23 00:43:38 juju-e4d256-prod-github-runner-207 kernel: [69592.591537] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:43:38 juju-e4d256-prod-github-runner-207 kernel: [69592.592588] direct_page_fault+0x206/0x310 [kvm] Aug 23 00:43:38 juju-e4d256-prod-github-runner-207 kernel: [69592.593622] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 00:43:38 juju-e4d256-prod-github-runner-207 kernel: [69592.594630] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 00:43:38 juju-e4d256-prod-github-runner-207 kernel: [69592.595664] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 00:43:38 juju-e4d256-prod-github-runner-207 kernel: [69592.596632] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 00:43:38 juju-e4d256-prod-github-runner-207 kernel: [69592.597590] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 00:43:38 juju-e4d256-prod-github-runner-207 kernel: [69592.598570] handle_exit+0x98/0x230 [kvm_amd] Aug 23 00:43:38 juju-e4d256-prod-github-runner-207 kernel: [69592.599461] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 00:43:38 juju-e4d256-prod-github-runner-207 kernel: [69592.600373] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 00:43:38 juju-e4d256-prod-github-runner-207 kernel: [69592.601336] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 00:43:38 juju-e4d256-prod-github-runner-207 kernel: [69592.602261] vcpu_run+0x62/0x2c0 [kvm] Aug 23 00:43:38 juju-e4d256-prod-github-runner-207 kernel: [69592.603074] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 00:43:38 juju-e4d256-prod-github-runner-207 kernel: [69592.603882] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 00:43:38 juju-e4d256-prod-github-runner-207 kernel: [69592.604773] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 00:43:38 juju-e4d256-prod-github-runner-207 kernel: [69592.605574] ? __seccomp_filter+0x4a/0x4a0 Aug 23 00:43:38 juju-e4d256-prod-github-runner-207 kernel: [69592.606318] ? __fget_files+0x86/0xc0 Aug 23 00:43:38 juju-e4d256-prod-github-runner-207 kernel: [69592.607022] __x64_sys_ioctl+0x95/0xd0 Aug 23 00:43:38 juju-e4d256-prod-github-runner-207 kernel: [69592.607717] do_syscall_64+0x5c/0xc0 Aug 23 00:43:38 juju-e4d256-prod-github-runner-207 kernel: [69592.608413] ? do_futex+0x162/0x1f0 Aug 23 00:43:38 juju-e4d256-prod-github-runner-207 kernel: [69592.609083] ? __x64_sys_futex+0x78/0x1e0 Aug 23 00:43:38 juju-e4d256-prod-github-runner-207 kernel: [69592.609798] ? __secure_computing+0xa9/0x120 Aug 23 00:43:38 juju-e4d256-prod-github-runner-207 kernel: [69592.610516] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 00:43:38 juju-e4d256-prod-github-runner-207 kernel: [69592.611297] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:43:38 juju-e4d256-prod-github-runner-207 kernel: [69592.612019] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:43:38 juju-e4d256-prod-github-runner-207 kernel: [69592.612755] ? do_syscall_64+0x69/0xc0 Aug 23 00:43:38 juju-e4d256-prod-github-runner-207 kernel: [69592.613438] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:43:38 juju-e4d256-prod-github-runner-207 kernel: [69592.614142] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:43:38 juju-e4d256-prod-github-runner-207 kernel: [69592.614841] ? do_syscall_64+0x69/0xc0 Aug 23 00:43:38 juju-e4d256-prod-github-runner-207 kernel: [69592.615505] ? do_syscall_64+0x69/0xc0 Aug 23 00:43:38 juju-e4d256-prod-github-runner-207 kernel: [69592.616139] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 00:43:38 juju-e4d256-prod-github-runner-207 kernel: [69592.616912] RIP: 0033:0x7faa5d0edaff Aug 23 00:43:38 juju-e4d256-prod-github-runner-207 kernel: [69592.617544] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 00:43:38 juju-e4d256-prod-github-runner-207 kernel: [69592.619517] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 00:43:38 juju-e4d256-prod-github-runner-207 kernel: [69592.620428] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 00:43:38 juju-e4d256-prod-github-runner-207 kernel: [69592.621336] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 00:43:38 juju-e4d256-prod-github-runner-207 kernel: [69592.622228] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 00:43:38 juju-e4d256-prod-github-runner-207 kernel: [69592.623135] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 00:43:38 juju-e4d256-prod-github-runner-207 kernel: [69592.624025] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 00:43:38 juju-e4d256-prod-github-runner-207 kernel: [69592.624930] Aug 23 00:44:06 juju-e4d256-prod-github-runner-207 kernel: [69620.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 64731s! [qemu-system-x86:6715] Aug 23 00:44:06 juju-e4d256-prod-github-runner-207 kernel: [69620.543085] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 00:44:06 juju-e4d256-prod-github-runner-207 kernel: [69620.543153] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 00:44:06 juju-e4d256-prod-github-runner-207 kernel: [69620.555196] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 00:44:06 juju-e4d256-prod-github-runner-207 kernel: [69620.556476] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 00:44:06 juju-e4d256-prod-github-runner-207 kernel: [69620.557701] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:44:06 juju-e4d256-prod-github-runner-207 kernel: [69620.558757] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 00:44:06 juju-e4d256-prod-github-runner-207 kernel: [69620.561316] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 00:44:06 juju-e4d256-prod-github-runner-207 kernel: [69620.562366] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 00:44:06 juju-e4d256-prod-github-runner-207 kernel: [69620.563525] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 00:44:06 juju-e4d256-prod-github-runner-207 kernel: [69620.564700] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 00:44:06 juju-e4d256-prod-github-runner-207 kernel: [69620.565861] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 00:44:06 juju-e4d256-prod-github-runner-207 kernel: [69620.567026] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 00:44:06 juju-e4d256-prod-github-runner-207 kernel: [69620.568195] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 00:44:06 juju-e4d256-prod-github-runner-207 kernel: [69620.569441] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 00:44:06 juju-e4d256-prod-github-runner-207 kernel: [69620.570543] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 00:44:06 juju-e4d256-prod-github-runner-207 kernel: [69620.571745] Call Trace: Aug 23 00:44:06 juju-e4d256-prod-github-runner-207 kernel: [69620.572670] Aug 23 00:44:06 juju-e4d256-prod-github-runner-207 kernel: [69620.573553] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:44:06 juju-e4d256-prod-github-runner-207 kernel: [69620.574581] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:44:06 juju-e4d256-prod-github-runner-207 kernel: [69620.575599] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:44:06 juju-e4d256-prod-github-runner-207 kernel: [69620.576687] ? show_regs.part.0+0x23/0x29 Aug 23 00:44:06 juju-e4d256-prod-github-runner-207 kernel: [69620.577683] ? show_regs.cold+0x8/0xd Aug 23 00:44:06 juju-e4d256-prod-github-runner-207 kernel: [69620.578658] ? watchdog_timer_fn+0x1be/0x220 Aug 23 00:44:06 juju-e4d256-prod-github-runner-207 kernel: [69620.579773] ? lockup_detector_update_enable+0x60/0x60 Aug 23 00:44:06 juju-e4d256-prod-github-runner-207 kernel: [69620.580866] ? __hrtimer_run_queues+0x107/0x230 Aug 23 00:44:06 juju-e4d256-prod-github-runner-207 kernel: [69620.581896] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 00:44:06 juju-e4d256-prod-github-runner-207 kernel: [69620.582921] ? hrtimer_interrupt+0x101/0x220 Aug 23 00:44:06 juju-e4d256-prod-github-runner-207 kernel: [69620.583935] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 00:44:06 juju-e4d256-prod-github-runner-207 kernel: [69620.585035] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 00:44:06 juju-e4d256-prod-github-runner-207 kernel: [69620.586082] Aug 23 00:44:06 juju-e4d256-prod-github-runner-207 kernel: [69620.586935] Aug 23 00:44:06 juju-e4d256-prod-github-runner-207 kernel: [69620.587770] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 00:44:06 juju-e4d256-prod-github-runner-207 kernel: [69620.588814] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:44:06 juju-e4d256-prod-github-runner-207 kernel: [69620.589858] ? _raw_spin_lock+0x22/0x30 Aug 23 00:44:06 juju-e4d256-prod-github-runner-207 kernel: [69620.590803] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:44:06 juju-e4d256-prod-github-runner-207 kernel: [69620.591821] direct_page_fault+0x206/0x310 [kvm] Aug 23 00:44:06 juju-e4d256-prod-github-runner-207 kernel: [69620.592861] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 00:44:06 juju-e4d256-prod-github-runner-207 kernel: [69620.593872] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 00:44:06 juju-e4d256-prod-github-runner-207 kernel: [69620.594872] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 00:44:06 juju-e4d256-prod-github-runner-207 kernel: [69620.595840] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 00:44:06 juju-e4d256-prod-github-runner-207 kernel: [69620.596801] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 00:44:06 juju-e4d256-prod-github-runner-207 kernel: [69620.597786] handle_exit+0x98/0x230 [kvm_amd] Aug 23 00:44:06 juju-e4d256-prod-github-runner-207 kernel: [69620.598683] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 00:44:06 juju-e4d256-prod-github-runner-207 kernel: [69620.599595] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 00:44:06 juju-e4d256-prod-github-runner-207 kernel: [69620.600540] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 00:44:06 juju-e4d256-prod-github-runner-207 kernel: [69620.601443] vcpu_run+0x62/0x2c0 [kvm] Aug 23 00:44:06 juju-e4d256-prod-github-runner-207 kernel: [69620.602252] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 00:44:06 juju-e4d256-prod-github-runner-207 kernel: [69620.603064] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 00:44:06 juju-e4d256-prod-github-runner-207 kernel: [69620.603917] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 00:44:06 juju-e4d256-prod-github-runner-207 kernel: [69620.604729] ? __seccomp_filter+0x4a/0x4a0 Aug 23 00:44:06 juju-e4d256-prod-github-runner-207 kernel: [69620.605477] ? __fget_files+0x86/0xc0 Aug 23 00:44:06 juju-e4d256-prod-github-runner-207 kernel: [69620.606184] __x64_sys_ioctl+0x95/0xd0 Aug 23 00:44:06 juju-e4d256-prod-github-runner-207 kernel: [69620.606876] do_syscall_64+0x5c/0xc0 Aug 23 00:44:06 juju-e4d256-prod-github-runner-207 kernel: [69620.607540] ? do_futex+0x162/0x1f0 Aug 23 00:44:06 juju-e4d256-prod-github-runner-207 kernel: [69620.608188] ? __x64_sys_futex+0x78/0x1e0 Aug 23 00:44:06 juju-e4d256-prod-github-runner-207 kernel: [69620.608876] ? __secure_computing+0xa9/0x120 Aug 23 00:44:06 juju-e4d256-prod-github-runner-207 kernel: [69620.609565] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 00:44:06 juju-e4d256-prod-github-runner-207 kernel: [69620.610328] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:44:06 juju-e4d256-prod-github-runner-207 kernel: [69620.611048] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:44:06 juju-e4d256-prod-github-runner-207 kernel: [69620.611770] ? do_syscall_64+0x69/0xc0 Aug 23 00:44:06 juju-e4d256-prod-github-runner-207 kernel: [69620.612425] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:44:06 juju-e4d256-prod-github-runner-207 kernel: [69620.613130] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:44:06 juju-e4d256-prod-github-runner-207 kernel: [69620.613831] ? do_syscall_64+0x69/0xc0 Aug 23 00:44:06 juju-e4d256-prod-github-runner-207 kernel: [69620.614454] ? do_syscall_64+0x69/0xc0 Aug 23 00:44:06 juju-e4d256-prod-github-runner-207 kernel: [69620.615081] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 00:44:06 juju-e4d256-prod-github-runner-207 kernel: [69620.615788] RIP: 0033:0x7faa5d0edaff Aug 23 00:44:06 juju-e4d256-prod-github-runner-207 kernel: [69620.616427] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 00:44:06 juju-e4d256-prod-github-runner-207 kernel: [69620.618426] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 00:44:06 juju-e4d256-prod-github-runner-207 kernel: [69620.619339] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 00:44:06 juju-e4d256-prod-github-runner-207 kernel: [69620.620231] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 00:44:06 juju-e4d256-prod-github-runner-207 kernel: [69620.621135] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 00:44:06 juju-e4d256-prod-github-runner-207 kernel: [69620.622027] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 00:44:06 juju-e4d256-prod-github-runner-207 kernel: [69620.622915] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 00:44:06 juju-e4d256-prod-github-runner-207 kernel: [69620.623813] Aug 23 00:44:34 juju-e4d256-prod-github-runner-207 kernel: [69648.541976] watchdog: BUG: soft lockup - CPU#1 stuck for 64757s! [qemu-system-x86:6715] Aug 23 00:44:34 juju-e4d256-prod-github-runner-207 kernel: [69648.543671] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 00:44:34 juju-e4d256-prod-github-runner-207 kernel: [69648.543913] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 00:44:34 juju-e4d256-prod-github-runner-207 kernel: [69648.555969] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 00:44:34 juju-e4d256-prod-github-runner-207 kernel: [69648.557241] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 00:44:34 juju-e4d256-prod-github-runner-207 kernel: [69648.558463] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:44:34 juju-e4d256-prod-github-runner-207 kernel: [69648.559519] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 00:44:34 juju-e4d256-prod-github-runner-207 kernel: [69648.562099] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 00:44:34 juju-e4d256-prod-github-runner-207 kernel: [69648.563139] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 00:44:34 juju-e4d256-prod-github-runner-207 kernel: [69648.564313] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 00:44:34 juju-e4d256-prod-github-runner-207 kernel: [69648.565502] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 00:44:34 juju-e4d256-prod-github-runner-207 kernel: [69648.566677] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 00:44:34 juju-e4d256-prod-github-runner-207 kernel: [69648.567844] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 00:44:34 juju-e4d256-prod-github-runner-207 kernel: [69648.569031] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 00:44:34 juju-e4d256-prod-github-runner-207 kernel: [69648.570276] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 00:44:34 juju-e4d256-prod-github-runner-207 kernel: [69648.571385] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 00:44:34 juju-e4d256-prod-github-runner-207 kernel: [69648.572591] Call Trace: Aug 23 00:44:34 juju-e4d256-prod-github-runner-207 kernel: [69648.573511] Aug 23 00:44:34 juju-e4d256-prod-github-runner-207 kernel: [69648.574422] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:44:34 juju-e4d256-prod-github-runner-207 kernel: [69648.575499] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:44:34 juju-e4d256-prod-github-runner-207 kernel: [69648.576726] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:44:34 juju-e4d256-prod-github-runner-207 kernel: [69648.577866] ? show_regs.part.0+0x23/0x29 Aug 23 00:44:34 juju-e4d256-prod-github-runner-207 kernel: [69648.578864] ? show_regs.cold+0x8/0xd Aug 23 00:44:34 juju-e4d256-prod-github-runner-207 kernel: [69648.579854] ? watchdog_timer_fn+0x1be/0x220 Aug 23 00:44:34 juju-e4d256-prod-github-runner-207 kernel: [69648.580908] ? lockup_detector_update_enable+0x60/0x60 Aug 23 00:44:34 juju-e4d256-prod-github-runner-207 kernel: [69648.581975] ? __hrtimer_run_queues+0x107/0x230 Aug 23 00:44:34 juju-e4d256-prod-github-runner-207 kernel: [69648.583009] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 00:44:34 juju-e4d256-prod-github-runner-207 kernel: [69648.584036] ? hrtimer_interrupt+0x101/0x220 Aug 23 00:44:34 juju-e4d256-prod-github-runner-207 kernel: [69648.585241] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 00:44:34 juju-e4d256-prod-github-runner-207 kernel: [69648.586342] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 00:44:34 juju-e4d256-prod-github-runner-207 kernel: [69648.587397] Aug 23 00:44:34 juju-e4d256-prod-github-runner-207 kernel: [69648.588269] Aug 23 00:44:34 juju-e4d256-prod-github-runner-207 kernel: [69648.589118] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 00:44:34 juju-e4d256-prod-github-runner-207 kernel: [69648.590176] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:44:34 juju-e4d256-prod-github-runner-207 kernel: [69648.591238] ? _raw_spin_lock+0x22/0x30 Aug 23 00:44:34 juju-e4d256-prod-github-runner-207 kernel: [69648.592217] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:44:34 juju-e4d256-prod-github-runner-207 kernel: [69648.593315] direct_page_fault+0x206/0x310 [kvm] Aug 23 00:44:34 juju-e4d256-prod-github-runner-207 kernel: [69648.594471] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 00:44:34 juju-e4d256-prod-github-runner-207 kernel: [69648.595506] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 00:44:34 juju-e4d256-prod-github-runner-207 kernel: [69648.596573] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 00:44:34 juju-e4d256-prod-github-runner-207 kernel: [69648.597585] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 00:44:34 juju-e4d256-prod-github-runner-207 kernel: [69648.598533] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 00:44:34 juju-e4d256-prod-github-runner-207 kernel: [69648.599516] handle_exit+0x98/0x230 [kvm_amd] Aug 23 00:44:34 juju-e4d256-prod-github-runner-207 kernel: [69648.600435] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 00:44:34 juju-e4d256-prod-github-runner-207 kernel: [69648.601374] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 00:44:34 juju-e4d256-prod-github-runner-207 kernel: [69648.602312] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 00:44:34 juju-e4d256-prod-github-runner-207 kernel: [69648.603220] vcpu_run+0x62/0x2c0 [kvm] Aug 23 00:44:34 juju-e4d256-prod-github-runner-207 kernel: [69648.604034] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 00:44:34 juju-e4d256-prod-github-runner-207 kernel: [69648.604871] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 00:44:34 juju-e4d256-prod-github-runner-207 kernel: [69648.605742] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 00:44:34 juju-e4d256-prod-github-runner-207 kernel: [69648.606571] ? __seccomp_filter+0x4a/0x4a0 Aug 23 00:44:34 juju-e4d256-prod-github-runner-207 kernel: [69648.607326] ? __fget_files+0x86/0xc0 Aug 23 00:44:34 juju-e4d256-prod-github-runner-207 kernel: [69648.608037] __x64_sys_ioctl+0x95/0xd0 Aug 23 00:44:34 juju-e4d256-prod-github-runner-207 kernel: [69648.608749] do_syscall_64+0x5c/0xc0 Aug 23 00:44:34 juju-e4d256-prod-github-runner-207 kernel: [69648.609423] ? do_futex+0x162/0x1f0 Aug 23 00:44:34 juju-e4d256-prod-github-runner-207 kernel: [69648.610261] ? __x64_sys_futex+0x78/0x1e0 Aug 23 00:44:34 juju-e4d256-prod-github-runner-207 kernel: [69648.610945] ? __secure_computing+0xa9/0x120 Aug 23 00:44:34 juju-e4d256-prod-github-runner-207 kernel: [69648.611646] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 00:44:34 juju-e4d256-prod-github-runner-207 kernel: [69648.612426] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:44:34 juju-e4d256-prod-github-runner-207 kernel: [69648.613156] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:44:34 juju-e4d256-prod-github-runner-207 kernel: [69648.613879] ? do_syscall_64+0x69/0xc0 Aug 23 00:44:34 juju-e4d256-prod-github-runner-207 kernel: [69648.614524] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:44:34 juju-e4d256-prod-github-runner-207 kernel: [69648.615231] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:44:34 juju-e4d256-prod-github-runner-207 kernel: [69648.615934] ? do_syscall_64+0x69/0xc0 Aug 23 00:44:34 juju-e4d256-prod-github-runner-207 kernel: [69648.616817] ? do_syscall_64+0x69/0xc0 Aug 23 00:44:34 juju-e4d256-prod-github-runner-207 kernel: [69648.617444] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 00:44:34 juju-e4d256-prod-github-runner-207 kernel: [69648.618156] RIP: 0033:0x7faa5d0edaff Aug 23 00:44:34 juju-e4d256-prod-github-runner-207 kernel: [69648.618815] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 00:44:34 juju-e4d256-prod-github-runner-207 kernel: [69648.620879] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 00:44:34 juju-e4d256-prod-github-runner-207 kernel: [69648.621815] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 00:44:34 juju-e4d256-prod-github-runner-207 kernel: [69648.622710] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 00:44:34 juju-e4d256-prod-github-runner-207 kernel: [69648.623606] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 00:44:34 juju-e4d256-prod-github-runner-207 kernel: [69648.624508] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 00:44:34 juju-e4d256-prod-github-runner-207 kernel: [69648.625404] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 00:44:34 juju-e4d256-prod-github-runner-207 kernel: [69648.626305] Aug 23 00:44:47 juju-e4d256-prod-github-runner-207 kernel: [69661.832706] rcu: INFO: rcu_sched self-detected stall on CPU Aug 23 00:44:47 juju-e4d256-prod-github-runner-207 kernel: [69661.833686] rcu: 1-....: (17331361 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=8368832 Aug 23 00:44:47 juju-e4d256-prod-github-runner-207 kernel: [69661.834840] (t=17386158 jiffies g=23269 q=60155) Aug 23 00:44:47 juju-e4d256-prod-github-runner-207 kernel: [69661.835644] NMI backtrace for cpu 1 Aug 23 00:44:47 juju-e4d256-prod-github-runner-207 kernel: [69661.836376] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 00:44:47 juju-e4d256-prod-github-runner-207 kernel: [69661.837480] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 00:44:47 juju-e4d256-prod-github-runner-207 kernel: [69661.838540] Call Trace: Aug 23 00:44:47 juju-e4d256-prod-github-runner-207 kernel: [69661.839221] Aug 23 00:44:47 juju-e4d256-prod-github-runner-207 kernel: [69661.839879] show_stack+0x52/0x5c Aug 23 00:44:47 juju-e4d256-prod-github-runner-207 kernel: [69661.840854] dump_stack_lvl+0x4a/0x63 Aug 23 00:44:47 juju-e4d256-prod-github-runner-207 kernel: [69661.841611] dump_stack+0x10/0x16 Aug 23 00:44:47 juju-e4d256-prod-github-runner-207 kernel: [69661.842334] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 23 00:44:47 juju-e4d256-prod-github-runner-207 kernel: [69661.843116] ? lapic_can_unplug_cpu+0x90/0x90 Aug 23 00:44:47 juju-e4d256-prod-github-runner-207 kernel: [69661.843911] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 23 00:44:47 juju-e4d256-prod-github-runner-207 kernel: [69661.844745] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 23 00:44:47 juju-e4d256-prod-github-runner-207 kernel: [69661.845569] trigger_single_cpu_backtrace+0x44/0x4f Aug 23 00:44:47 juju-e4d256-prod-github-runner-207 kernel: [69661.846392] rcu_dump_cpu_stacks+0x102/0x149 Aug 23 00:44:47 juju-e4d256-prod-github-runner-207 kernel: [69661.847166] print_cpu_stall.cold+0x2f/0xe2 Aug 23 00:44:47 juju-e4d256-prod-github-runner-207 kernel: [69661.847990] ? timekeeping_update+0xf7/0x150 Aug 23 00:44:47 juju-e4d256-prod-github-runner-207 kernel: [69661.848766] check_cpu_stall+0x109/0x270 Aug 23 00:44:47 juju-e4d256-prod-github-runner-207 kernel: [69661.849514] rcu_sched_clock_irq+0x9a/0x250 Aug 23 00:44:47 juju-e4d256-prod-github-runner-207 kernel: [69661.850294] update_process_times+0x94/0xd0 Aug 23 00:44:47 juju-e4d256-prod-github-runner-207 kernel: [69661.851090] tick_sched_handle+0x29/0x70 Aug 23 00:44:47 juju-e4d256-prod-github-runner-207 kernel: [69661.851864] tick_sched_timer+0x8c/0xc0 Aug 23 00:44:47 juju-e4d256-prod-github-runner-207 kernel: [69661.852743] ? tick_nohz_handler+0xb0/0xb0 Aug 23 00:44:47 juju-e4d256-prod-github-runner-207 kernel: [69661.853501] __hrtimer_run_queues+0x107/0x230 Aug 23 00:44:47 juju-e4d256-prod-github-runner-207 kernel: [69661.854277] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 00:44:47 juju-e4d256-prod-github-runner-207 kernel: [69661.855075] hrtimer_interrupt+0x101/0x220 Aug 23 00:44:47 juju-e4d256-prod-github-runner-207 kernel: [69661.855850] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 00:44:47 juju-e4d256-prod-github-runner-207 kernel: [69661.856702] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 00:44:47 juju-e4d256-prod-github-runner-207 kernel: [69661.857508] Aug 23 00:44:47 juju-e4d256-prod-github-runner-207 kernel: [69661.858146] Aug 23 00:44:47 juju-e4d256-prod-github-runner-207 kernel: [69661.858778] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 00:44:47 juju-e4d256-prod-github-runner-207 kernel: [69661.859599] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:44:47 juju-e4d256-prod-github-runner-207 kernel: [69661.860503] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 00:44:47 juju-e4d256-prod-github-runner-207 kernel: [69661.862767] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 00:44:47 juju-e4d256-prod-github-runner-207 kernel: [69661.863644] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 00:44:47 juju-e4d256-prod-github-runner-207 kernel: [69661.864659] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 00:44:47 juju-e4d256-prod-github-runner-207 kernel: [69661.865655] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 00:44:47 juju-e4d256-prod-github-runner-207 kernel: [69661.866640] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 00:44:47 juju-e4d256-prod-github-runner-207 kernel: [69661.867602] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 00:44:47 juju-e4d256-prod-github-runner-207 kernel: [69661.868581] ? _raw_spin_lock+0x22/0x30 Aug 23 00:44:47 juju-e4d256-prod-github-runner-207 kernel: [69661.869349] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:44:47 juju-e4d256-prod-github-runner-207 kernel: [69661.870237] direct_page_fault+0x206/0x310 [kvm] Aug 23 00:44:47 juju-e4d256-prod-github-runner-207 kernel: [69661.871109] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 00:44:47 juju-e4d256-prod-github-runner-207 kernel: [69661.871971] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 00:44:47 juju-e4d256-prod-github-runner-207 kernel: [69661.872805] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 00:44:47 juju-e4d256-prod-github-runner-207 kernel: [69661.873616] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 00:44:47 juju-e4d256-prod-github-runner-207 kernel: [69661.874406] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 00:44:47 juju-e4d256-prod-github-runner-207 kernel: [69661.875234] handle_exit+0x98/0x230 [kvm_amd] Aug 23 00:44:47 juju-e4d256-prod-github-runner-207 kernel: [69661.876018] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 00:44:47 juju-e4d256-prod-github-runner-207 kernel: [69661.876823] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 00:44:47 juju-e4d256-prod-github-runner-207 kernel: [69661.877632] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 00:44:47 juju-e4d256-prod-github-runner-207 kernel: [69661.878431] vcpu_run+0x62/0x2c0 [kvm] Aug 23 00:44:47 juju-e4d256-prod-github-runner-207 kernel: [69661.879182] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 00:44:47 juju-e4d256-prod-github-runner-207 kernel: [69661.879945] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 00:44:47 juju-e4d256-prod-github-runner-207 kernel: [69661.880750] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 00:44:47 juju-e4d256-prod-github-runner-207 kernel: [69661.881536] ? __seccomp_filter+0x4a/0x4a0 Aug 23 00:44:47 juju-e4d256-prod-github-runner-207 kernel: [69661.882273] ? __fget_files+0x86/0xc0 Aug 23 00:44:47 juju-e4d256-prod-github-runner-207 kernel: [69661.882973] __x64_sys_ioctl+0x95/0xd0 Aug 23 00:44:47 juju-e4d256-prod-github-runner-207 kernel: [69661.883670] do_syscall_64+0x5c/0xc0 Aug 23 00:44:47 juju-e4d256-prod-github-runner-207 kernel: [69661.884373] ? do_futex+0x162/0x1f0 Aug 23 00:44:47 juju-e4d256-prod-github-runner-207 kernel: [69661.885051] ? __x64_sys_futex+0x78/0x1e0 Aug 23 00:44:47 juju-e4d256-prod-github-runner-207 kernel: [69661.885756] ? __secure_computing+0xa9/0x120 Aug 23 00:44:47 juju-e4d256-prod-github-runner-207 kernel: [69661.886487] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 00:44:47 juju-e4d256-prod-github-runner-207 kernel: [69661.887316] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:44:47 juju-e4d256-prod-github-runner-207 kernel: [69661.888109] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:44:47 juju-e4d256-prod-github-runner-207 kernel: [69661.888867] ? do_syscall_64+0x69/0xc0 Aug 23 00:44:47 juju-e4d256-prod-github-runner-207 kernel: [69661.889560] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:44:47 juju-e4d256-prod-github-runner-207 kernel: [69661.890317] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:44:47 juju-e4d256-prod-github-runner-207 kernel: [69661.891083] ? do_syscall_64+0x69/0xc0 Aug 23 00:44:47 juju-e4d256-prod-github-runner-207 kernel: [69661.891809] ? do_syscall_64+0x69/0xc0 Aug 23 00:44:47 juju-e4d256-prod-github-runner-207 kernel: [69661.892538] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 00:44:47 juju-e4d256-prod-github-runner-207 kernel: [69661.893322] RIP: 0033:0x7faa5d0edaff Aug 23 00:44:47 juju-e4d256-prod-github-runner-207 kernel: [69661.894009] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 00:44:47 juju-e4d256-prod-github-runner-207 kernel: [69661.896143] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 00:44:47 juju-e4d256-prod-github-runner-207 kernel: [69661.897149] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 00:44:47 juju-e4d256-prod-github-runner-207 kernel: [69661.898131] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 00:44:47 juju-e4d256-prod-github-runner-207 kernel: [69661.899081] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 00:44:47 juju-e4d256-prod-github-runner-207 kernel: [69661.900041] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 00:44:47 juju-e4d256-prod-github-runner-207 kernel: [69661.900977] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 00:44:47 juju-e4d256-prod-github-runner-207 kernel: [69661.901925] Aug 23 00:45:14 juju-e4d256-prod-github-runner-207 kernel: [69688.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 64794s! [qemu-system-x86:6715] Aug 23 00:45:14 juju-e4d256-prod-github-runner-207 kernel: [69688.543785] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 00:45:14 juju-e4d256-prod-github-runner-207 kernel: [69688.544056] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 00:45:14 juju-e4d256-prod-github-runner-207 kernel: [69688.556246] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 00:45:14 juju-e4d256-prod-github-runner-207 kernel: [69688.557511] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 00:45:14 juju-e4d256-prod-github-runner-207 kernel: [69688.558734] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:45:14 juju-e4d256-prod-github-runner-207 kernel: [69688.559804] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 00:45:14 juju-e4d256-prod-github-runner-207 kernel: [69688.562345] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 00:45:14 juju-e4d256-prod-github-runner-207 kernel: [69688.563385] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 00:45:14 juju-e4d256-prod-github-runner-207 kernel: [69688.564561] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 00:45:14 juju-e4d256-prod-github-runner-207 kernel: [69688.565726] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 00:45:14 juju-e4d256-prod-github-runner-207 kernel: [69688.566885] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 00:45:14 juju-e4d256-prod-github-runner-207 kernel: [69688.568056] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 00:45:14 juju-e4d256-prod-github-runner-207 kernel: [69688.569236] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 00:45:14 juju-e4d256-prod-github-runner-207 kernel: [69688.570472] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 00:45:14 juju-e4d256-prod-github-runner-207 kernel: [69688.571574] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 00:45:14 juju-e4d256-prod-github-runner-207 kernel: [69688.572783] Call Trace: Aug 23 00:45:14 juju-e4d256-prod-github-runner-207 kernel: [69688.573698] Aug 23 00:45:14 juju-e4d256-prod-github-runner-207 kernel: [69688.574596] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:45:14 juju-e4d256-prod-github-runner-207 kernel: [69688.575636] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:45:14 juju-e4d256-prod-github-runner-207 kernel: [69688.576660] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:45:14 juju-e4d256-prod-github-runner-207 kernel: [69688.577754] ? show_regs.part.0+0x23/0x29 Aug 23 00:45:14 juju-e4d256-prod-github-runner-207 kernel: [69688.578748] ? show_regs.cold+0x8/0xd Aug 23 00:45:14 juju-e4d256-prod-github-runner-207 kernel: [69688.579727] ? watchdog_timer_fn+0x1be/0x220 Aug 23 00:45:14 juju-e4d256-prod-github-runner-207 kernel: [69688.580733] ? lockup_detector_update_enable+0x60/0x60 Aug 23 00:45:14 juju-e4d256-prod-github-runner-207 kernel: [69688.581794] ? __hrtimer_run_queues+0x107/0x230 Aug 23 00:45:14 juju-e4d256-prod-github-runner-207 kernel: [69688.582820] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 00:45:14 juju-e4d256-prod-github-runner-207 kernel: [69688.583854] ? hrtimer_interrupt+0x101/0x220 Aug 23 00:45:14 juju-e4d256-prod-github-runner-207 kernel: [69688.584867] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 00:45:14 juju-e4d256-prod-github-runner-207 kernel: [69688.585934] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 00:45:14 juju-e4d256-prod-github-runner-207 kernel: [69688.586976] Aug 23 00:45:14 juju-e4d256-prod-github-runner-207 kernel: [69688.587848] Aug 23 00:45:14 juju-e4d256-prod-github-runner-207 kernel: [69688.588685] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 00:45:14 juju-e4d256-prod-github-runner-207 kernel: [69688.589717] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:45:14 juju-e4d256-prod-github-runner-207 kernel: [69688.590758] ? _raw_spin_lock+0x22/0x30 Aug 23 00:45:14 juju-e4d256-prod-github-runner-207 kernel: [69688.591713] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:45:14 juju-e4d256-prod-github-runner-207 kernel: [69688.592726] direct_page_fault+0x206/0x310 [kvm] Aug 23 00:45:14 juju-e4d256-prod-github-runner-207 kernel: [69688.593756] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 00:45:14 juju-e4d256-prod-github-runner-207 kernel: [69688.594770] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 00:45:14 juju-e4d256-prod-github-runner-207 kernel: [69688.595792] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 00:45:14 juju-e4d256-prod-github-runner-207 kernel: [69688.596789] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 00:45:14 juju-e4d256-prod-github-runner-207 kernel: [69688.597734] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 00:45:14 juju-e4d256-prod-github-runner-207 kernel: [69688.598710] handle_exit+0x98/0x230 [kvm_amd] Aug 23 00:45:14 juju-e4d256-prod-github-runner-207 kernel: [69688.599628] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 00:45:14 juju-e4d256-prod-github-runner-207 kernel: [69688.600548] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 00:45:14 juju-e4d256-prod-github-runner-207 kernel: [69688.601475] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 00:45:14 juju-e4d256-prod-github-runner-207 kernel: [69688.602378] vcpu_run+0x62/0x2c0 [kvm] Aug 23 00:45:14 juju-e4d256-prod-github-runner-207 kernel: [69688.603188] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 00:45:14 juju-e4d256-prod-github-runner-207 kernel: [69688.604013] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 00:45:14 juju-e4d256-prod-github-runner-207 kernel: [69688.604867] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 00:45:14 juju-e4d256-prod-github-runner-207 kernel: [69688.605661] ? __seccomp_filter+0x4a/0x4a0 Aug 23 00:45:14 juju-e4d256-prod-github-runner-207 kernel: [69688.606406] ? __fget_files+0x86/0xc0 Aug 23 00:45:14 juju-e4d256-prod-github-runner-207 kernel: [69688.607107] __x64_sys_ioctl+0x95/0xd0 Aug 23 00:45:14 juju-e4d256-prod-github-runner-207 kernel: [69688.607819] do_syscall_64+0x5c/0xc0 Aug 23 00:45:14 juju-e4d256-prod-github-runner-207 kernel: [69688.608485] ? do_futex+0x162/0x1f0 Aug 23 00:45:14 juju-e4d256-prod-github-runner-207 kernel: [69688.609131] ? __x64_sys_futex+0x78/0x1e0 Aug 23 00:45:14 juju-e4d256-prod-github-runner-207 kernel: [69688.609804] ? __secure_computing+0xa9/0x120 Aug 23 00:45:14 juju-e4d256-prod-github-runner-207 kernel: [69688.610492] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 00:45:14 juju-e4d256-prod-github-runner-207 kernel: [69688.611248] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:45:14 juju-e4d256-prod-github-runner-207 kernel: [69688.611978] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:45:14 juju-e4d256-prod-github-runner-207 kernel: [69688.612700] ? do_syscall_64+0x69/0xc0 Aug 23 00:45:14 juju-e4d256-prod-github-runner-207 kernel: [69688.613344] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:45:14 juju-e4d256-prod-github-runner-207 kernel: [69688.614044] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:45:14 juju-e4d256-prod-github-runner-207 kernel: [69688.614735] ? do_syscall_64+0x69/0xc0 Aug 23 00:45:14 juju-e4d256-prod-github-runner-207 kernel: [69688.615358] ? do_syscall_64+0x69/0xc0 Aug 23 00:45:14 juju-e4d256-prod-github-runner-207 kernel: [69688.615989] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 00:45:14 juju-e4d256-prod-github-runner-207 kernel: [69688.616698] RIP: 0033:0x7faa5d0edaff Aug 23 00:45:14 juju-e4d256-prod-github-runner-207 kernel: [69688.617351] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 00:45:14 juju-e4d256-prod-github-runner-207 kernel: [69688.619333] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 00:45:14 juju-e4d256-prod-github-runner-207 kernel: [69688.620252] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 00:45:14 juju-e4d256-prod-github-runner-207 kernel: [69688.621140] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 00:45:14 juju-e4d256-prod-github-runner-207 kernel: [69688.622027] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 00:45:14 juju-e4d256-prod-github-runner-207 kernel: [69688.622913] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 00:45:14 juju-e4d256-prod-github-runner-207 kernel: [69688.623816] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 00:45:14 juju-e4d256-prod-github-runner-207 kernel: [69688.624715] Aug 23 00:45:42 juju-e4d256-prod-github-runner-207 kernel: [69716.541981] watchdog: BUG: soft lockup - CPU#1 stuck for 64820s! [qemu-system-x86:6715] Aug 23 00:45:42 juju-e4d256-prod-github-runner-207 kernel: [69716.544308] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 00:45:42 juju-e4d256-prod-github-runner-207 kernel: [69716.544611] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 00:45:42 juju-e4d256-prod-github-runner-207 kernel: [69716.557042] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 00:45:42 juju-e4d256-prod-github-runner-207 kernel: [69716.558338] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 00:45:42 juju-e4d256-prod-github-runner-207 kernel: [69716.559579] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:45:42 juju-e4d256-prod-github-runner-207 kernel: [69716.560642] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 00:45:42 juju-e4d256-prod-github-runner-207 kernel: [69716.563208] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 00:45:42 juju-e4d256-prod-github-runner-207 kernel: [69716.564287] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 00:45:42 juju-e4d256-prod-github-runner-207 kernel: [69716.565461] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 00:45:42 juju-e4d256-prod-github-runner-207 kernel: [69716.566625] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 00:45:42 juju-e4d256-prod-github-runner-207 kernel: [69716.567880] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 00:45:42 juju-e4d256-prod-github-runner-207 kernel: [69716.569057] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 00:45:42 juju-e4d256-prod-github-runner-207 kernel: [69716.570228] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 00:45:42 juju-e4d256-prod-github-runner-207 kernel: [69716.571483] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 00:45:42 juju-e4d256-prod-github-runner-207 kernel: [69716.572603] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 00:45:42 juju-e4d256-prod-github-runner-207 kernel: [69716.573816] Call Trace: Aug 23 00:45:42 juju-e4d256-prod-github-runner-207 kernel: [69716.574745] Aug 23 00:45:42 juju-e4d256-prod-github-runner-207 kernel: [69716.575673] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:45:42 juju-e4d256-prod-github-runner-207 kernel: [69716.576712] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:45:42 juju-e4d256-prod-github-runner-207 kernel: [69716.577761] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:45:42 juju-e4d256-prod-github-runner-207 kernel: [69716.578862] ? show_regs.part.0+0x23/0x29 Aug 23 00:45:42 juju-e4d256-prod-github-runner-207 kernel: [69716.579890] ? show_regs.cold+0x8/0xd Aug 23 00:45:42 juju-e4d256-prod-github-runner-207 kernel: [69716.580873] ? watchdog_timer_fn+0x1be/0x220 Aug 23 00:45:42 juju-e4d256-prod-github-runner-207 kernel: [69716.581900] ? lockup_detector_update_enable+0x60/0x60 Aug 23 00:45:42 juju-e4d256-prod-github-runner-207 kernel: [69716.582975] ? __hrtimer_run_queues+0x107/0x230 Aug 23 00:45:42 juju-e4d256-prod-github-runner-207 kernel: [69716.584035] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 00:45:42 juju-e4d256-prod-github-runner-207 kernel: [69716.585197] ? hrtimer_interrupt+0x101/0x220 Aug 23 00:45:42 juju-e4d256-prod-github-runner-207 kernel: [69716.586220] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 00:45:42 juju-e4d256-prod-github-runner-207 kernel: [69716.587313] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 00:45:42 juju-e4d256-prod-github-runner-207 kernel: [69716.588363] Aug 23 00:45:42 juju-e4d256-prod-github-runner-207 kernel: [69716.589220] Aug 23 00:45:42 juju-e4d256-prod-github-runner-207 kernel: [69716.590061] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 00:45:42 juju-e4d256-prod-github-runner-207 kernel: [69716.591493] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:45:42 juju-e4d256-prod-github-runner-207 kernel: [69716.592805] ? _raw_spin_lock+0x22/0x30 Aug 23 00:45:42 juju-e4d256-prod-github-runner-207 kernel: [69716.594002] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:45:42 juju-e4d256-prod-github-runner-207 kernel: [69716.595426] direct_page_fault+0x206/0x310 [kvm] Aug 23 00:45:42 juju-e4d256-prod-github-runner-207 kernel: [69716.596690] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 00:45:42 juju-e4d256-prod-github-runner-207 kernel: [69716.597779] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 00:45:42 juju-e4d256-prod-github-runner-207 kernel: [69716.598819] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 00:45:42 juju-e4d256-prod-github-runner-207 kernel: [69716.600129] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 00:45:42 juju-e4d256-prod-github-runner-207 kernel: [69716.601394] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 00:45:42 juju-e4d256-prod-github-runner-207 kernel: [69716.602681] handle_exit+0x98/0x230 [kvm_amd] Aug 23 00:45:42 juju-e4d256-prod-github-runner-207 kernel: [69716.604006] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 00:45:42 juju-e4d256-prod-github-runner-207 kernel: [69716.605336] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 00:45:42 juju-e4d256-prod-github-runner-207 kernel: [69716.606676] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 00:45:42 juju-e4d256-prod-github-runner-207 kernel: [69716.608059] vcpu_run+0x62/0x2c0 [kvm] Aug 23 00:45:42 juju-e4d256-prod-github-runner-207 kernel: [69716.609238] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 00:45:42 juju-e4d256-prod-github-runner-207 kernel: [69716.610412] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 00:45:42 juju-e4d256-prod-github-runner-207 kernel: [69716.611653] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 00:45:42 juju-e4d256-prod-github-runner-207 kernel: [69716.612859] ? __seccomp_filter+0x4a/0x4a0 Aug 23 00:45:42 juju-e4d256-prod-github-runner-207 kernel: [69716.613992] ? __fget_files+0x86/0xc0 Aug 23 00:45:42 juju-e4d256-prod-github-runner-207 kernel: [69716.615014] __x64_sys_ioctl+0x95/0xd0 Aug 23 00:45:42 juju-e4d256-prod-github-runner-207 kernel: [69716.616073] do_syscall_64+0x5c/0xc0 Aug 23 00:45:42 juju-e4d256-prod-github-runner-207 kernel: [69716.617052] ? do_futex+0x162/0x1f0 Aug 23 00:45:42 juju-e4d256-prod-github-runner-207 kernel: [69716.617964] ? __x64_sys_futex+0x78/0x1e0 Aug 23 00:45:42 juju-e4d256-prod-github-runner-207 kernel: [69716.618933] ? __secure_computing+0xa9/0x120 Aug 23 00:45:42 juju-e4d256-prod-github-runner-207 kernel: [69716.619942] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 00:45:42 juju-e4d256-prod-github-runner-207 kernel: [69716.621015] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:45:42 juju-e4d256-prod-github-runner-207 kernel: [69716.622022] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:45:42 juju-e4d256-prod-github-runner-207 kernel: [69716.622941] ? do_syscall_64+0x69/0xc0 Aug 23 00:45:42 juju-e4d256-prod-github-runner-207 kernel: [69716.623618] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:45:42 juju-e4d256-prod-github-runner-207 kernel: [69716.624330] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:45:42 juju-e4d256-prod-github-runner-207 kernel: [69716.625033] ? do_syscall_64+0x69/0xc0 Aug 23 00:45:42 juju-e4d256-prod-github-runner-207 kernel: [69716.625672] ? do_syscall_64+0x69/0xc0 Aug 23 00:45:42 juju-e4d256-prod-github-runner-207 kernel: [69716.626301] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 00:45:42 juju-e4d256-prod-github-runner-207 kernel: [69716.627014] RIP: 0033:0x7faa5d0edaff Aug 23 00:45:42 juju-e4d256-prod-github-runner-207 kernel: [69716.627710] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 00:45:42 juju-e4d256-prod-github-runner-207 kernel: [69716.629716] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 00:45:42 juju-e4d256-prod-github-runner-207 kernel: [69716.630636] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 00:45:42 juju-e4d256-prod-github-runner-207 kernel: [69716.631547] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 00:45:42 juju-e4d256-prod-github-runner-207 kernel: [69716.632444] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 00:45:42 juju-e4d256-prod-github-runner-207 kernel: [69716.633341] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 00:45:42 juju-e4d256-prod-github-runner-207 kernel: [69716.634238] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 00:45:42 juju-e4d256-prod-github-runner-207 kernel: [69716.635143] Aug 23 00:46:10 juju-e4d256-prod-github-runner-207 kernel: [69744.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 64846s! [qemu-system-x86:6715] Aug 23 00:46:10 juju-e4d256-prod-github-runner-207 kernel: [69744.543702] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 00:46:10 juju-e4d256-prod-github-runner-207 kernel: [69744.543943] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 00:46:10 juju-e4d256-prod-github-runner-207 kernel: [69744.556083] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 00:46:10 juju-e4d256-prod-github-runner-207 kernel: [69744.557349] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 00:46:10 juju-e4d256-prod-github-runner-207 kernel: [69744.558571] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:46:10 juju-e4d256-prod-github-runner-207 kernel: [69744.559641] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 00:46:10 juju-e4d256-prod-github-runner-207 kernel: [69744.562193] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 00:46:10 juju-e4d256-prod-github-runner-207 kernel: [69744.563258] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 00:46:10 juju-e4d256-prod-github-runner-207 kernel: [69744.564442] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 00:46:10 juju-e4d256-prod-github-runner-207 kernel: [69744.565801] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 00:46:10 juju-e4d256-prod-github-runner-207 kernel: [69744.566999] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 00:46:10 juju-e4d256-prod-github-runner-207 kernel: [69744.568166] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 00:46:10 juju-e4d256-prod-github-runner-207 kernel: [69744.569348] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 00:46:10 juju-e4d256-prod-github-runner-207 kernel: [69744.570587] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 00:46:10 juju-e4d256-prod-github-runner-207 kernel: [69744.571714] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 00:46:10 juju-e4d256-prod-github-runner-207 kernel: [69744.572918] Call Trace: Aug 23 00:46:10 juju-e4d256-prod-github-runner-207 kernel: [69744.573837] Aug 23 00:46:10 juju-e4d256-prod-github-runner-207 kernel: [69744.574738] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:46:10 juju-e4d256-prod-github-runner-207 kernel: [69744.575811] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:46:10 juju-e4d256-prod-github-runner-207 kernel: [69744.576834] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:46:10 juju-e4d256-prod-github-runner-207 kernel: [69744.577928] ? show_regs.part.0+0x23/0x29 Aug 23 00:46:10 juju-e4d256-prod-github-runner-207 kernel: [69744.578958] ? show_regs.cold+0x8/0xd Aug 23 00:46:10 juju-e4d256-prod-github-runner-207 kernel: [69744.579955] ? watchdog_timer_fn+0x1be/0x220 Aug 23 00:46:10 juju-e4d256-prod-github-runner-207 kernel: [69744.580965] ? lockup_detector_update_enable+0x60/0x60 Aug 23 00:46:10 juju-e4d256-prod-github-runner-207 kernel: [69744.582033] ? __hrtimer_run_queues+0x107/0x230 Aug 23 00:46:10 juju-e4d256-prod-github-runner-207 kernel: [69744.583078] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 00:46:10 juju-e4d256-prod-github-runner-207 kernel: [69744.584112] ? hrtimer_interrupt+0x101/0x220 Aug 23 00:46:10 juju-e4d256-prod-github-runner-207 kernel: [69744.585158] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 00:46:10 juju-e4d256-prod-github-runner-207 kernel: [69744.586235] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 00:46:10 juju-e4d256-prod-github-runner-207 kernel: [69744.587302] Aug 23 00:46:10 juju-e4d256-prod-github-runner-207 kernel: [69744.588162] Aug 23 00:46:10 juju-e4d256-prod-github-runner-207 kernel: [69744.589000] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 00:46:10 juju-e4d256-prod-github-runner-207 kernel: [69744.590051] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:46:10 juju-e4d256-prod-github-runner-207 kernel: [69744.591111] ? _raw_spin_lock+0x22/0x30 Aug 23 00:46:10 juju-e4d256-prod-github-runner-207 kernel: [69744.592075] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:46:10 juju-e4d256-prod-github-runner-207 kernel: [69744.593105] direct_page_fault+0x206/0x310 [kvm] Aug 23 00:46:10 juju-e4d256-prod-github-runner-207 kernel: [69744.594134] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 00:46:10 juju-e4d256-prod-github-runner-207 kernel: [69744.595183] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 00:46:10 juju-e4d256-prod-github-runner-207 kernel: [69744.596200] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 00:46:10 juju-e4d256-prod-github-runner-207 kernel: [69744.597205] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 00:46:10 juju-e4d256-prod-github-runner-207 kernel: [69744.598158] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 00:46:10 juju-e4d256-prod-github-runner-207 kernel: [69744.599156] handle_exit+0x98/0x230 [kvm_amd] Aug 23 00:46:10 juju-e4d256-prod-github-runner-207 kernel: [69744.600067] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 00:46:10 juju-e4d256-prod-github-runner-207 kernel: [69744.600982] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 00:46:10 juju-e4d256-prod-github-runner-207 kernel: [69744.601909] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 00:46:10 juju-e4d256-prod-github-runner-207 kernel: [69744.602811] vcpu_run+0x62/0x2c0 [kvm] Aug 23 00:46:10 juju-e4d256-prod-github-runner-207 kernel: [69744.603640] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 00:46:10 juju-e4d256-prod-github-runner-207 kernel: [69744.604452] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 00:46:10 juju-e4d256-prod-github-runner-207 kernel: [69744.605316] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 00:46:10 juju-e4d256-prod-github-runner-207 kernel: [69744.606113] ? __seccomp_filter+0x4a/0x4a0 Aug 23 00:46:10 juju-e4d256-prod-github-runner-207 kernel: [69744.606862] ? __fget_files+0x86/0xc0 Aug 23 00:46:10 juju-e4d256-prod-github-runner-207 kernel: [69744.607577] __x64_sys_ioctl+0x95/0xd0 Aug 23 00:46:10 juju-e4d256-prod-github-runner-207 kernel: [69744.608270] do_syscall_64+0x5c/0xc0 Aug 23 00:46:10 juju-e4d256-prod-github-runner-207 kernel: [69744.608933] ? do_futex+0x162/0x1f0 Aug 23 00:46:10 juju-e4d256-prod-github-runner-207 kernel: [69744.609583] ? __x64_sys_futex+0x78/0x1e0 Aug 23 00:46:10 juju-e4d256-prod-github-runner-207 kernel: [69744.610263] ? __secure_computing+0xa9/0x120 Aug 23 00:46:10 juju-e4d256-prod-github-runner-207 kernel: [69744.610956] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 00:46:10 juju-e4d256-prod-github-runner-207 kernel: [69744.611818] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:46:10 juju-e4d256-prod-github-runner-207 kernel: [69744.612722] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:46:10 juju-e4d256-prod-github-runner-207 kernel: [69744.613440] ? do_syscall_64+0x69/0xc0 Aug 23 00:46:10 juju-e4d256-prod-github-runner-207 kernel: [69744.614084] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:46:10 juju-e4d256-prod-github-runner-207 kernel: [69744.614788] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:46:10 juju-e4d256-prod-github-runner-207 kernel: [69744.615498] ? do_syscall_64+0x69/0xc0 Aug 23 00:46:10 juju-e4d256-prod-github-runner-207 kernel: [69744.616120] ? do_syscall_64+0x69/0xc0 Aug 23 00:46:10 juju-e4d256-prod-github-runner-207 kernel: [69744.616740] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 00:46:10 juju-e4d256-prod-github-runner-207 kernel: [69744.617442] RIP: 0033:0x7faa5d0edaff Aug 23 00:46:10 juju-e4d256-prod-github-runner-207 kernel: [69744.618086] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 00:46:10 juju-e4d256-prod-github-runner-207 kernel: [69744.620086] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 00:46:10 juju-e4d256-prod-github-runner-207 kernel: [69744.620998] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 00:46:10 juju-e4d256-prod-github-runner-207 kernel: [69744.621886] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 00:46:10 juju-e4d256-prod-github-runner-207 kernel: [69744.623144] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 00:46:10 juju-e4d256-prod-github-runner-207 kernel: [69744.624176] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 00:46:10 juju-e4d256-prod-github-runner-207 kernel: [69744.625214] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 00:46:10 juju-e4d256-prod-github-runner-207 kernel: [69744.626257] Aug 23 00:46:38 juju-e4d256-prod-github-runner-207 kernel: [69772.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 64872s! [qemu-system-x86:6715] Aug 23 00:46:38 juju-e4d256-prod-github-runner-207 kernel: [69772.543745] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 00:46:38 juju-e4d256-prod-github-runner-207 kernel: [69772.544001] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 00:46:38 juju-e4d256-prod-github-runner-207 kernel: [69772.556030] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 00:46:38 juju-e4d256-prod-github-runner-207 kernel: [69772.557391] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 00:46:38 juju-e4d256-prod-github-runner-207 kernel: [69772.558640] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:46:38 juju-e4d256-prod-github-runner-207 kernel: [69772.559698] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 00:46:38 juju-e4d256-prod-github-runner-207 kernel: [69772.562280] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 00:46:38 juju-e4d256-prod-github-runner-207 kernel: [69772.563337] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 00:46:38 juju-e4d256-prod-github-runner-207 kernel: [69772.564498] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 00:46:38 juju-e4d256-prod-github-runner-207 kernel: [69772.565664] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 00:46:38 juju-e4d256-prod-github-runner-207 kernel: [69772.566828] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 00:46:38 juju-e4d256-prod-github-runner-207 kernel: [69772.567989] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 00:46:38 juju-e4d256-prod-github-runner-207 kernel: [69772.569158] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 00:46:38 juju-e4d256-prod-github-runner-207 kernel: [69772.570389] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 00:46:38 juju-e4d256-prod-github-runner-207 kernel: [69772.571490] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 00:46:38 juju-e4d256-prod-github-runner-207 kernel: [69772.572713] Call Trace: Aug 23 00:46:38 juju-e4d256-prod-github-runner-207 kernel: [69772.573624] Aug 23 00:46:38 juju-e4d256-prod-github-runner-207 kernel: [69772.574532] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:46:38 juju-e4d256-prod-github-runner-207 kernel: [69772.575641] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:46:38 juju-e4d256-prod-github-runner-207 kernel: [69772.576666] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:46:38 juju-e4d256-prod-github-runner-207 kernel: [69772.577763] ? show_regs.part.0+0x23/0x29 Aug 23 00:46:38 juju-e4d256-prod-github-runner-207 kernel: [69772.578782] ? show_regs.cold+0x8/0xd Aug 23 00:46:38 juju-e4d256-prod-github-runner-207 kernel: [69772.579754] ? watchdog_timer_fn+0x1be/0x220 Aug 23 00:46:38 juju-e4d256-prod-github-runner-207 kernel: [69772.580761] ? lockup_detector_update_enable+0x60/0x60 Aug 23 00:46:38 juju-e4d256-prod-github-runner-207 kernel: [69772.581828] ? __hrtimer_run_queues+0x107/0x230 Aug 23 00:46:38 juju-e4d256-prod-github-runner-207 kernel: [69772.582867] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 00:46:38 juju-e4d256-prod-github-runner-207 kernel: [69772.583927] ? hrtimer_interrupt+0x101/0x220 Aug 23 00:46:38 juju-e4d256-prod-github-runner-207 kernel: [69772.584942] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 00:46:38 juju-e4d256-prod-github-runner-207 kernel: [69772.586011] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 00:46:38 juju-e4d256-prod-github-runner-207 kernel: [69772.587064] Aug 23 00:46:38 juju-e4d256-prod-github-runner-207 kernel: [69772.587974] Aug 23 00:46:38 juju-e4d256-prod-github-runner-207 kernel: [69772.588820] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 00:46:38 juju-e4d256-prod-github-runner-207 kernel: [69772.589851] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:46:38 juju-e4d256-prod-github-runner-207 kernel: [69772.590906] ? _raw_spin_lock+0x22/0x30 Aug 23 00:46:38 juju-e4d256-prod-github-runner-207 kernel: [69772.591851] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:46:38 juju-e4d256-prod-github-runner-207 kernel: [69772.592865] direct_page_fault+0x206/0x310 [kvm] Aug 23 00:46:38 juju-e4d256-prod-github-runner-207 kernel: [69772.593887] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 00:46:38 juju-e4d256-prod-github-runner-207 kernel: [69772.594914] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 00:46:38 juju-e4d256-prod-github-runner-207 kernel: [69772.595915] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 00:46:38 juju-e4d256-prod-github-runner-207 kernel: [69772.596904] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 00:46:38 juju-e4d256-prod-github-runner-207 kernel: [69772.597849] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 00:46:38 juju-e4d256-prod-github-runner-207 kernel: [69772.598845] handle_exit+0x98/0x230 [kvm_amd] Aug 23 00:46:38 juju-e4d256-prod-github-runner-207 kernel: [69772.599739] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 00:46:38 juju-e4d256-prod-github-runner-207 kernel: [69772.600656] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 00:46:38 juju-e4d256-prod-github-runner-207 kernel: [69772.601580] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 00:46:38 juju-e4d256-prod-github-runner-207 kernel: [69772.602487] vcpu_run+0x62/0x2c0 [kvm] Aug 23 00:46:38 juju-e4d256-prod-github-runner-207 kernel: [69772.603307] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 00:46:38 juju-e4d256-prod-github-runner-207 kernel: [69772.604113] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 00:46:38 juju-e4d256-prod-github-runner-207 kernel: [69772.604965] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 00:46:38 juju-e4d256-prod-github-runner-207 kernel: [69772.605761] ? __seccomp_filter+0x4a/0x4a0 Aug 23 00:46:38 juju-e4d256-prod-github-runner-207 kernel: [69772.606501] ? __fget_files+0x86/0xc0 Aug 23 00:46:38 juju-e4d256-prod-github-runner-207 kernel: [69772.607216] __x64_sys_ioctl+0x95/0xd0 Aug 23 00:46:38 juju-e4d256-prod-github-runner-207 kernel: [69772.607906] do_syscall_64+0x5c/0xc0 Aug 23 00:46:38 juju-e4d256-prod-github-runner-207 kernel: [69772.608568] ? do_futex+0x162/0x1f0 Aug 23 00:46:38 juju-e4d256-prod-github-runner-207 kernel: [69772.609221] ? __x64_sys_futex+0x78/0x1e0 Aug 23 00:46:38 juju-e4d256-prod-github-runner-207 kernel: [69772.609892] ? __secure_computing+0xa9/0x120 Aug 23 00:46:38 juju-e4d256-prod-github-runner-207 kernel: [69772.610620] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 00:46:38 juju-e4d256-prod-github-runner-207 kernel: [69772.611427] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:46:38 juju-e4d256-prod-github-runner-207 kernel: [69772.612193] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:46:38 juju-e4d256-prod-github-runner-207 kernel: [69772.612963] ? do_syscall_64+0x69/0xc0 Aug 23 00:46:38 juju-e4d256-prod-github-runner-207 kernel: [69772.613608] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:46:38 juju-e4d256-prod-github-runner-207 kernel: [69772.614314] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:46:38 juju-e4d256-prod-github-runner-207 kernel: [69772.615028] ? do_syscall_64+0x69/0xc0 Aug 23 00:46:38 juju-e4d256-prod-github-runner-207 kernel: [69772.615652] ? do_syscall_64+0x69/0xc0 Aug 23 00:46:38 juju-e4d256-prod-github-runner-207 kernel: [69772.616277] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 00:46:38 juju-e4d256-prod-github-runner-207 kernel: [69772.616978] RIP: 0033:0x7faa5d0edaff Aug 23 00:46:38 juju-e4d256-prod-github-runner-207 kernel: [69772.617621] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 00:46:38 juju-e4d256-prod-github-runner-207 kernel: [69772.619728] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 00:46:38 juju-e4d256-prod-github-runner-207 kernel: [69772.620649] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 00:46:38 juju-e4d256-prod-github-runner-207 kernel: [69772.621541] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 00:46:38 juju-e4d256-prod-github-runner-207 kernel: [69772.622477] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 00:46:38 juju-e4d256-prod-github-runner-207 kernel: [69772.623368] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 00:46:38 juju-e4d256-prod-github-runner-207 kernel: [69772.624250] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 00:46:38 juju-e4d256-prod-github-runner-207 kernel: [69772.626224] Aug 23 00:47:06 juju-e4d256-prod-github-runner-207 kernel: [69800.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 64898s! [qemu-system-x86:6715] Aug 23 00:47:06 juju-e4d256-prod-github-runner-207 kernel: [69800.543726] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 00:47:06 juju-e4d256-prod-github-runner-207 kernel: [69800.543966] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 00:47:06 juju-e4d256-prod-github-runner-207 kernel: [69800.556180] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 00:47:06 juju-e4d256-prod-github-runner-207 kernel: [69800.557444] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 00:47:06 juju-e4d256-prod-github-runner-207 kernel: [69800.558739] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:47:06 juju-e4d256-prod-github-runner-207 kernel: [69800.559805] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 00:47:06 juju-e4d256-prod-github-runner-207 kernel: [69800.562394] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 00:47:06 juju-e4d256-prod-github-runner-207 kernel: [69800.563488] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 00:47:06 juju-e4d256-prod-github-runner-207 kernel: [69800.564653] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 00:47:06 juju-e4d256-prod-github-runner-207 kernel: [69800.565819] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 00:47:06 juju-e4d256-prod-github-runner-207 kernel: [69800.566994] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 00:47:06 juju-e4d256-prod-github-runner-207 kernel: [69800.568161] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 00:47:06 juju-e4d256-prod-github-runner-207 kernel: [69800.569332] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 00:47:06 juju-e4d256-prod-github-runner-207 kernel: [69800.570583] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 00:47:06 juju-e4d256-prod-github-runner-207 kernel: [69800.571687] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 00:47:06 juju-e4d256-prod-github-runner-207 kernel: [69800.572887] Call Trace: Aug 23 00:47:06 juju-e4d256-prod-github-runner-207 kernel: [69800.573798] Aug 23 00:47:06 juju-e4d256-prod-github-runner-207 kernel: [69800.574717] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:47:06 juju-e4d256-prod-github-runner-207 kernel: [69800.575753] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:47:06 juju-e4d256-prod-github-runner-207 kernel: [69800.576774] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:47:06 juju-e4d256-prod-github-runner-207 kernel: [69800.577876] ? show_regs.part.0+0x23/0x29 Aug 23 00:47:06 juju-e4d256-prod-github-runner-207 kernel: [69800.578910] ? show_regs.cold+0x8/0xd Aug 23 00:47:06 juju-e4d256-prod-github-runner-207 kernel: [69800.579883] ? watchdog_timer_fn+0x1be/0x220 Aug 23 00:47:06 juju-e4d256-prod-github-runner-207 kernel: [69800.580892] ? lockup_detector_update_enable+0x60/0x60 Aug 23 00:47:06 juju-e4d256-prod-github-runner-207 kernel: [69800.581954] ? __hrtimer_run_queues+0x107/0x230 Aug 23 00:47:06 juju-e4d256-prod-github-runner-207 kernel: [69800.583030] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 00:47:06 juju-e4d256-prod-github-runner-207 kernel: [69800.584191] ? hrtimer_interrupt+0x101/0x220 Aug 23 00:47:06 juju-e4d256-prod-github-runner-207 kernel: [69800.585205] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 00:47:06 juju-e4d256-prod-github-runner-207 kernel: [69800.586297] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 00:47:06 juju-e4d256-prod-github-runner-207 kernel: [69800.587349] Aug 23 00:47:06 juju-e4d256-prod-github-runner-207 kernel: [69800.588201] Aug 23 00:47:06 juju-e4d256-prod-github-runner-207 kernel: [69800.589039] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 00:47:06 juju-e4d256-prod-github-runner-207 kernel: [69800.590092] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:47:06 juju-e4d256-prod-github-runner-207 kernel: [69800.591151] ? _raw_spin_lock+0x22/0x30 Aug 23 00:47:06 juju-e4d256-prod-github-runner-207 kernel: [69800.592098] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:47:06 juju-e4d256-prod-github-runner-207 kernel: [69800.593113] direct_page_fault+0x206/0x310 [kvm] Aug 23 00:47:06 juju-e4d256-prod-github-runner-207 kernel: [69800.594143] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 00:47:06 juju-e4d256-prod-github-runner-207 kernel: [69800.595163] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 00:47:06 juju-e4d256-prod-github-runner-207 kernel: [69800.596165] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 00:47:06 juju-e4d256-prod-github-runner-207 kernel: [69800.597157] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 00:47:06 juju-e4d256-prod-github-runner-207 kernel: [69800.598102] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 00:47:06 juju-e4d256-prod-github-runner-207 kernel: [69800.599088] handle_exit+0x98/0x230 [kvm_amd] Aug 23 00:47:06 juju-e4d256-prod-github-runner-207 kernel: [69800.599981] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 00:47:06 juju-e4d256-prod-github-runner-207 kernel: [69800.600894] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 00:47:06 juju-e4d256-prod-github-runner-207 kernel: [69800.601819] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 00:47:06 juju-e4d256-prod-github-runner-207 kernel: [69800.602734] vcpu_run+0x62/0x2c0 [kvm] Aug 23 00:47:06 juju-e4d256-prod-github-runner-207 kernel: [69800.603551] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 00:47:06 juju-e4d256-prod-github-runner-207 kernel: [69800.604363] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 00:47:06 juju-e4d256-prod-github-runner-207 kernel: [69800.605217] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 00:47:06 juju-e4d256-prod-github-runner-207 kernel: [69800.606014] ? __seccomp_filter+0x4a/0x4a0 Aug 23 00:47:06 juju-e4d256-prod-github-runner-207 kernel: [69800.606774] ? __fget_files+0x86/0xc0 Aug 23 00:47:06 juju-e4d256-prod-github-runner-207 kernel: [69800.607477] __x64_sys_ioctl+0x95/0xd0 Aug 23 00:47:06 juju-e4d256-prod-github-runner-207 kernel: [69800.608168] do_syscall_64+0x5c/0xc0 Aug 23 00:47:06 juju-e4d256-prod-github-runner-207 kernel: [69800.608831] ? do_futex+0x162/0x1f0 Aug 23 00:47:06 juju-e4d256-prod-github-runner-207 kernel: [69800.609484] ? __x64_sys_futex+0x78/0x1e0 Aug 23 00:47:06 juju-e4d256-prod-github-runner-207 kernel: [69800.610157] ? __secure_computing+0xa9/0x120 Aug 23 00:47:06 juju-e4d256-prod-github-runner-207 kernel: [69800.610859] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 00:47:06 juju-e4d256-prod-github-runner-207 kernel: [69800.611619] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:47:06 juju-e4d256-prod-github-runner-207 kernel: [69800.612347] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:47:06 juju-e4d256-prod-github-runner-207 kernel: [69800.613073] ? do_syscall_64+0x69/0xc0 Aug 23 00:47:06 juju-e4d256-prod-github-runner-207 kernel: [69800.613731] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:47:06 juju-e4d256-prod-github-runner-207 kernel: [69800.614452] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:47:06 juju-e4d256-prod-github-runner-207 kernel: [69800.615148] ? do_syscall_64+0x69/0xc0 Aug 23 00:47:06 juju-e4d256-prod-github-runner-207 kernel: [69800.615779] ? do_syscall_64+0x69/0xc0 Aug 23 00:47:06 juju-e4d256-prod-github-runner-207 kernel: [69800.616402] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 00:47:06 juju-e4d256-prod-github-runner-207 kernel: [69800.617108] RIP: 0033:0x7faa5d0edaff Aug 23 00:47:06 juju-e4d256-prod-github-runner-207 kernel: [69800.617759] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 00:47:06 juju-e4d256-prod-github-runner-207 kernel: [69800.619796] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 00:47:06 juju-e4d256-prod-github-runner-207 kernel: [69800.620710] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 00:47:06 juju-e4d256-prod-github-runner-207 kernel: [69800.621606] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 00:47:06 juju-e4d256-prod-github-runner-207 kernel: [69800.622513] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 00:47:06 juju-e4d256-prod-github-runner-207 kernel: [69800.623402] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 00:47:06 juju-e4d256-prod-github-runner-207 kernel: [69800.624292] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 00:47:06 juju-e4d256-prod-github-runner-207 kernel: [69800.625186] Aug 23 00:47:34 juju-e4d256-prod-github-runner-207 kernel: [69828.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 64924s! [qemu-system-x86:6715] Aug 23 00:47:34 juju-e4d256-prod-github-runner-207 kernel: [69828.543742] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 00:47:34 juju-e4d256-prod-github-runner-207 kernel: [69828.543987] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 00:47:34 juju-e4d256-prod-github-runner-207 kernel: [69828.556178] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 00:47:34 juju-e4d256-prod-github-runner-207 kernel: [69828.557452] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 00:47:34 juju-e4d256-prod-github-runner-207 kernel: [69828.558726] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:47:34 juju-e4d256-prod-github-runner-207 kernel: [69828.559807] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 00:47:34 juju-e4d256-prod-github-runner-207 kernel: [69828.562404] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 00:47:34 juju-e4d256-prod-github-runner-207 kernel: [69828.563451] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 00:47:34 juju-e4d256-prod-github-runner-207 kernel: [69828.564612] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 00:47:34 juju-e4d256-prod-github-runner-207 kernel: [69828.565769] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 00:47:34 juju-e4d256-prod-github-runner-207 kernel: [69828.566938] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 00:47:34 juju-e4d256-prod-github-runner-207 kernel: [69828.568118] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 00:47:34 juju-e4d256-prod-github-runner-207 kernel: [69828.569310] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 00:47:34 juju-e4d256-prod-github-runner-207 kernel: [69828.570562] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 00:47:34 juju-e4d256-prod-github-runner-207 kernel: [69828.571665] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 00:47:34 juju-e4d256-prod-github-runner-207 kernel: [69828.572873] Call Trace: Aug 23 00:47:34 juju-e4d256-prod-github-runner-207 kernel: [69828.573802] Aug 23 00:47:34 juju-e4d256-prod-github-runner-207 kernel: [69828.574721] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:47:34 juju-e4d256-prod-github-runner-207 kernel: [69828.575751] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:47:34 juju-e4d256-prod-github-runner-207 kernel: [69828.576775] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:47:34 juju-e4d256-prod-github-runner-207 kernel: [69828.577864] ? show_regs.part.0+0x23/0x29 Aug 23 00:47:34 juju-e4d256-prod-github-runner-207 kernel: [69828.578930] ? show_regs.cold+0x8/0xd Aug 23 00:47:34 juju-e4d256-prod-github-runner-207 kernel: [69828.579941] ? watchdog_timer_fn+0x1be/0x220 Aug 23 00:47:34 juju-e4d256-prod-github-runner-207 kernel: [69828.580957] ? lockup_detector_update_enable+0x60/0x60 Aug 23 00:47:34 juju-e4d256-prod-github-runner-207 kernel: [69828.582033] ? __hrtimer_run_queues+0x107/0x230 Aug 23 00:47:34 juju-e4d256-prod-github-runner-207 kernel: [69828.583063] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 00:47:34 juju-e4d256-prod-github-runner-207 kernel: [69828.584081] ? hrtimer_interrupt+0x101/0x220 Aug 23 00:47:34 juju-e4d256-prod-github-runner-207 kernel: [69828.585132] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 00:47:34 juju-e4d256-prod-github-runner-207 kernel: [69828.586284] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 00:47:34 juju-e4d256-prod-github-runner-207 kernel: [69828.587339] Aug 23 00:47:34 juju-e4d256-prod-github-runner-207 kernel: [69828.588196] Aug 23 00:47:34 juju-e4d256-prod-github-runner-207 kernel: [69828.589062] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 00:47:34 juju-e4d256-prod-github-runner-207 kernel: [69828.590141] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:47:34 juju-e4d256-prod-github-runner-207 kernel: [69828.591183] ? _raw_spin_lock+0x22/0x30 Aug 23 00:47:34 juju-e4d256-prod-github-runner-207 kernel: [69828.592130] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:47:34 juju-e4d256-prod-github-runner-207 kernel: [69828.593200] direct_page_fault+0x206/0x310 [kvm] Aug 23 00:47:34 juju-e4d256-prod-github-runner-207 kernel: [69828.594242] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 00:47:34 juju-e4d256-prod-github-runner-207 kernel: [69828.595256] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 00:47:34 juju-e4d256-prod-github-runner-207 kernel: [69828.596277] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 00:47:34 juju-e4d256-prod-github-runner-207 kernel: [69828.597285] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 00:47:34 juju-e4d256-prod-github-runner-207 kernel: [69828.598246] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 00:47:34 juju-e4d256-prod-github-runner-207 kernel: [69828.599260] handle_exit+0x98/0x230 [kvm_amd] Aug 23 00:47:34 juju-e4d256-prod-github-runner-207 kernel: [69828.600165] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 00:47:34 juju-e4d256-prod-github-runner-207 kernel: [69828.601081] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 00:47:34 juju-e4d256-prod-github-runner-207 kernel: [69828.602016] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 00:47:34 juju-e4d256-prod-github-runner-207 kernel: [69828.602919] vcpu_run+0x62/0x2c0 [kvm] Aug 23 00:47:34 juju-e4d256-prod-github-runner-207 kernel: [69828.603729] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 00:47:34 juju-e4d256-prod-github-runner-207 kernel: [69828.604535] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 00:47:34 juju-e4d256-prod-github-runner-207 kernel: [69828.605389] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 00:47:34 juju-e4d256-prod-github-runner-207 kernel: [69828.606193] ? __seccomp_filter+0x4a/0x4a0 Aug 23 00:47:34 juju-e4d256-prod-github-runner-207 kernel: [69828.606936] ? __fget_files+0x86/0xc0 Aug 23 00:47:34 juju-e4d256-prod-github-runner-207 kernel: [69828.607640] __x64_sys_ioctl+0x95/0xd0 Aug 23 00:47:34 juju-e4d256-prod-github-runner-207 kernel: [69828.608354] do_syscall_64+0x5c/0xc0 Aug 23 00:47:34 juju-e4d256-prod-github-runner-207 kernel: [69828.609028] ? do_futex+0x162/0x1f0 Aug 23 00:47:34 juju-e4d256-prod-github-runner-207 kernel: [69828.609711] ? __x64_sys_futex+0x78/0x1e0 Aug 23 00:47:34 juju-e4d256-prod-github-runner-207 kernel: [69828.610408] ? __secure_computing+0xa9/0x120 Aug 23 00:47:34 juju-e4d256-prod-github-runner-207 kernel: [69828.611117] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 00:47:34 juju-e4d256-prod-github-runner-207 kernel: [69828.611882] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:47:34 juju-e4d256-prod-github-runner-207 kernel: [69828.612604] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:47:34 juju-e4d256-prod-github-runner-207 kernel: [69828.613323] ? do_syscall_64+0x69/0xc0 Aug 23 00:47:34 juju-e4d256-prod-github-runner-207 kernel: [69828.613982] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:47:34 juju-e4d256-prod-github-runner-207 kernel: [69828.614687] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:47:34 juju-e4d256-prod-github-runner-207 kernel: [69828.615493] ? do_syscall_64+0x69/0xc0 Aug 23 00:47:34 juju-e4d256-prod-github-runner-207 kernel: [69828.616129] ? do_syscall_64+0x69/0xc0 Aug 23 00:47:34 juju-e4d256-prod-github-runner-207 kernel: [69828.616753] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 00:47:34 juju-e4d256-prod-github-runner-207 kernel: [69828.617457] RIP: 0033:0x7faa5d0edaff Aug 23 00:47:34 juju-e4d256-prod-github-runner-207 kernel: [69828.618136] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 00:47:34 juju-e4d256-prod-github-runner-207 kernel: [69828.620165] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 00:47:34 juju-e4d256-prod-github-runner-207 kernel: [69828.621092] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 00:47:34 juju-e4d256-prod-github-runner-207 kernel: [69828.621995] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 00:47:34 juju-e4d256-prod-github-runner-207 kernel: [69828.622889] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 00:47:34 juju-e4d256-prod-github-runner-207 kernel: [69828.623775] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 00:47:34 juju-e4d256-prod-github-runner-207 kernel: [69828.624662] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 00:47:34 juju-e4d256-prod-github-runner-207 kernel: [69828.625588] Aug 23 00:47:47 juju-e4d256-prod-github-runner-207 kernel: [69841.844709] rcu: INFO: rcu_sched self-detected stall on CPU Aug 23 00:47:47 juju-e4d256-prod-github-runner-207 kernel: [69841.845681] rcu: 1-....: (17376215 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=8390686 Aug 23 00:47:47 juju-e4d256-prod-github-runner-207 kernel: [69841.846838] (t=17431161 jiffies g=23269 q=60269) Aug 23 00:47:47 juju-e4d256-prod-github-runner-207 kernel: [69841.847626] NMI backtrace for cpu 1 Aug 23 00:47:47 juju-e4d256-prod-github-runner-207 kernel: [69841.848334] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 00:47:47 juju-e4d256-prod-github-runner-207 kernel: [69841.849507] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 00:47:47 juju-e4d256-prod-github-runner-207 kernel: [69841.850628] Call Trace: Aug 23 00:47:47 juju-e4d256-prod-github-runner-207 kernel: [69841.851305] Aug 23 00:47:47 juju-e4d256-prod-github-runner-207 kernel: [69841.851951] show_stack+0x52/0x5c Aug 23 00:47:47 juju-e4d256-prod-github-runner-207 kernel: [69841.852676] dump_stack_lvl+0x4a/0x63 Aug 23 00:47:47 juju-e4d256-prod-github-runner-207 kernel: [69841.853428] dump_stack+0x10/0x16 Aug 23 00:47:47 juju-e4d256-prod-github-runner-207 kernel: [69841.854166] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 23 00:47:47 juju-e4d256-prod-github-runner-207 kernel: [69841.855050] ? lapic_can_unplug_cpu+0x90/0x90 Aug 23 00:47:47 juju-e4d256-prod-github-runner-207 kernel: [69841.855860] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 23 00:47:47 juju-e4d256-prod-github-runner-207 kernel: [69841.856683] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 23 00:47:47 juju-e4d256-prod-github-runner-207 kernel: [69841.857510] trigger_single_cpu_backtrace+0x44/0x4f Aug 23 00:47:47 juju-e4d256-prod-github-runner-207 kernel: [69841.858339] rcu_dump_cpu_stacks+0x102/0x149 Aug 23 00:47:47 juju-e4d256-prod-github-runner-207 kernel: [69841.859113] print_cpu_stall.cold+0x2f/0xe2 Aug 23 00:47:47 juju-e4d256-prod-github-runner-207 kernel: [69841.859883] ? timekeeping_update+0xf7/0x150 Aug 23 00:47:47 juju-e4d256-prod-github-runner-207 kernel: [69841.860652] check_cpu_stall+0x109/0x270 Aug 23 00:47:47 juju-e4d256-prod-github-runner-207 kernel: [69841.861398] rcu_sched_clock_irq+0x9a/0x250 Aug 23 00:47:47 juju-e4d256-prod-github-runner-207 kernel: [69841.862182] update_process_times+0x94/0xd0 Aug 23 00:47:47 juju-e4d256-prod-github-runner-207 kernel: [69841.862949] tick_sched_handle+0x29/0x70 Aug 23 00:47:47 juju-e4d256-prod-github-runner-207 kernel: [69841.863695] tick_sched_timer+0x8c/0xc0 Aug 23 00:47:47 juju-e4d256-prod-github-runner-207 kernel: [69841.864433] ? tick_nohz_handler+0xb0/0xb0 Aug 23 00:47:47 juju-e4d256-prod-github-runner-207 kernel: [69841.865187] __hrtimer_run_queues+0x107/0x230 Aug 23 00:47:47 juju-e4d256-prod-github-runner-207 kernel: [69841.865981] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 00:47:47 juju-e4d256-prod-github-runner-207 kernel: [69841.866822] hrtimer_interrupt+0x101/0x220 Aug 23 00:47:47 juju-e4d256-prod-github-runner-207 kernel: [69841.867637] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 00:47:47 juju-e4d256-prod-github-runner-207 kernel: [69841.868458] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 00:47:47 juju-e4d256-prod-github-runner-207 kernel: [69841.869286] Aug 23 00:47:47 juju-e4d256-prod-github-runner-207 kernel: [69841.869945] Aug 23 00:47:47 juju-e4d256-prod-github-runner-207 kernel: [69841.870581] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 00:47:47 juju-e4d256-prod-github-runner-207 kernel: [69841.871449] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:47:47 juju-e4d256-prod-github-runner-207 kernel: [69841.872338] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 00:47:47 juju-e4d256-prod-github-runner-207 kernel: [69841.874569] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 00:47:47 juju-e4d256-prod-github-runner-207 kernel: [69841.875448] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 00:47:47 juju-e4d256-prod-github-runner-207 kernel: [69841.876451] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 00:47:47 juju-e4d256-prod-github-runner-207 kernel: [69841.877430] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 00:47:47 juju-e4d256-prod-github-runner-207 kernel: [69841.878441] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 00:47:47 juju-e4d256-prod-github-runner-207 kernel: [69841.879499] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 00:47:47 juju-e4d256-prod-github-runner-207 kernel: [69841.880484] ? _raw_spin_lock+0x22/0x30 Aug 23 00:47:47 juju-e4d256-prod-github-runner-207 kernel: [69841.881249] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:47:47 juju-e4d256-prod-github-runner-207 kernel: [69841.882115] direct_page_fault+0x206/0x310 [kvm] Aug 23 00:47:47 juju-e4d256-prod-github-runner-207 kernel: [69841.882954] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 00:47:47 juju-e4d256-prod-github-runner-207 kernel: [69841.883781] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 00:47:47 juju-e4d256-prod-github-runner-207 kernel: [69841.884602] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 00:47:47 juju-e4d256-prod-github-runner-207 kernel: [69841.885408] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 00:47:47 juju-e4d256-prod-github-runner-207 kernel: [69841.886209] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 00:47:47 juju-e4d256-prod-github-runner-207 kernel: [69841.887031] handle_exit+0x98/0x230 [kvm_amd] Aug 23 00:47:47 juju-e4d256-prod-github-runner-207 kernel: [69841.887784] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 00:47:47 juju-e4d256-prod-github-runner-207 kernel: [69841.888566] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 00:47:47 juju-e4d256-prod-github-runner-207 kernel: [69841.889365] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 00:47:47 juju-e4d256-prod-github-runner-207 kernel: [69841.890188] vcpu_run+0x62/0x2c0 [kvm] Aug 23 00:47:47 juju-e4d256-prod-github-runner-207 kernel: [69841.890977] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 00:47:47 juju-e4d256-prod-github-runner-207 kernel: [69841.891752] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 00:47:47 juju-e4d256-prod-github-runner-207 kernel: [69841.892561] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 00:47:47 juju-e4d256-prod-github-runner-207 kernel: [69841.893328] ? __seccomp_filter+0x4a/0x4a0 Aug 23 00:47:47 juju-e4d256-prod-github-runner-207 kernel: [69841.894068] ? __fget_files+0x86/0xc0 Aug 23 00:47:47 juju-e4d256-prod-github-runner-207 kernel: [69841.894763] __x64_sys_ioctl+0x95/0xd0 Aug 23 00:47:47 juju-e4d256-prod-github-runner-207 kernel: [69841.895459] do_syscall_64+0x5c/0xc0 Aug 23 00:47:47 juju-e4d256-prod-github-runner-207 kernel: [69841.896143] ? do_futex+0x162/0x1f0 Aug 23 00:47:47 juju-e4d256-prod-github-runner-207 kernel: [69841.896816] ? __x64_sys_futex+0x78/0x1e0 Aug 23 00:47:47 juju-e4d256-prod-github-runner-207 kernel: [69841.897519] ? __secure_computing+0xa9/0x120 Aug 23 00:47:47 juju-e4d256-prod-github-runner-207 kernel: [69841.898332] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 00:47:47 juju-e4d256-prod-github-runner-207 kernel: [69841.899346] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:47:47 juju-e4d256-prod-github-runner-207 kernel: [69841.900317] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:47:47 juju-e4d256-prod-github-runner-207 kernel: [69841.901219] ? do_syscall_64+0x69/0xc0 Aug 23 00:47:47 juju-e4d256-prod-github-runner-207 kernel: [69841.902111] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:47:47 juju-e4d256-prod-github-runner-207 kernel: [69841.903089] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:47:47 juju-e4d256-prod-github-runner-207 kernel: [69841.904080] ? do_syscall_64+0x69/0xc0 Aug 23 00:47:47 juju-e4d256-prod-github-runner-207 kernel: [69841.904993] ? do_syscall_64+0x69/0xc0 Aug 23 00:47:47 juju-e4d256-prod-github-runner-207 kernel: [69841.905922] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 00:47:47 juju-e4d256-prod-github-runner-207 kernel: [69841.906893] RIP: 0033:0x7faa5d0edaff Aug 23 00:47:47 juju-e4d256-prod-github-runner-207 kernel: [69841.907745] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 00:47:47 juju-e4d256-prod-github-runner-207 kernel: [69841.909890] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 00:47:47 juju-e4d256-prod-github-runner-207 kernel: [69841.910862] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 00:47:47 juju-e4d256-prod-github-runner-207 kernel: [69841.911816] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 00:47:47 juju-e4d256-prod-github-runner-207 kernel: [69841.912787] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 00:47:47 juju-e4d256-prod-github-runner-207 kernel: [69841.913776] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 00:47:47 juju-e4d256-prod-github-runner-207 kernel: [69841.914723] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 00:47:47 juju-e4d256-prod-github-runner-207 kernel: [69841.915644] Aug 23 00:48:14 juju-e4d256-prod-github-runner-207 kernel: [69868.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 64962s! [qemu-system-x86:6715] Aug 23 00:48:14 juju-e4d256-prod-github-runner-207 kernel: [69868.543217] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 00:48:14 juju-e4d256-prod-github-runner-207 kernel: [69868.543428] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 00:48:14 juju-e4d256-prod-github-runner-207 kernel: [69868.555826] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 00:48:14 juju-e4d256-prod-github-runner-207 kernel: [69868.557116] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 00:48:14 juju-e4d256-prod-github-runner-207 kernel: [69868.558376] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:48:14 juju-e4d256-prod-github-runner-207 kernel: [69868.559442] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 00:48:14 juju-e4d256-prod-github-runner-207 kernel: [69868.562037] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 00:48:14 juju-e4d256-prod-github-runner-207 kernel: [69868.563089] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 00:48:14 juju-e4d256-prod-github-runner-207 kernel: [69868.564261] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 00:48:14 juju-e4d256-prod-github-runner-207 kernel: [69868.565433] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 00:48:14 juju-e4d256-prod-github-runner-207 kernel: [69868.566626] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 00:48:14 juju-e4d256-prod-github-runner-207 kernel: [69868.567806] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 00:48:14 juju-e4d256-prod-github-runner-207 kernel: [69868.569023] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 00:48:14 juju-e4d256-prod-github-runner-207 kernel: [69868.570302] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 00:48:14 juju-e4d256-prod-github-runner-207 kernel: [69868.571424] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 00:48:14 juju-e4d256-prod-github-runner-207 kernel: [69868.572637] Call Trace: Aug 23 00:48:14 juju-e4d256-prod-github-runner-207 kernel: [69868.573577] Aug 23 00:48:14 juju-e4d256-prod-github-runner-207 kernel: [69868.574466] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:48:14 juju-e4d256-prod-github-runner-207 kernel: [69868.575527] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:48:14 juju-e4d256-prod-github-runner-207 kernel: [69868.576570] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:48:14 juju-e4d256-prod-github-runner-207 kernel: [69868.577726] ? show_regs.part.0+0x23/0x29 Aug 23 00:48:14 juju-e4d256-prod-github-runner-207 kernel: [69868.578737] ? show_regs.cold+0x8/0xd Aug 23 00:48:14 juju-e4d256-prod-github-runner-207 kernel: [69868.579727] ? watchdog_timer_fn+0x1be/0x220 Aug 23 00:48:14 juju-e4d256-prod-github-runner-207 kernel: [69868.580752] ? lockup_detector_update_enable+0x60/0x60 Aug 23 00:48:14 juju-e4d256-prod-github-runner-207 kernel: [69868.581853] ? __hrtimer_run_queues+0x107/0x230 Aug 23 00:48:14 juju-e4d256-prod-github-runner-207 kernel: [69868.582893] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 00:48:14 juju-e4d256-prod-github-runner-207 kernel: [69868.583925] ? hrtimer_interrupt+0x101/0x220 Aug 23 00:48:14 juju-e4d256-prod-github-runner-207 kernel: [69868.584950] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 00:48:14 juju-e4d256-prod-github-runner-207 kernel: [69868.586047] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 00:48:14 juju-e4d256-prod-github-runner-207 kernel: [69868.587107] Aug 23 00:48:14 juju-e4d256-prod-github-runner-207 kernel: [69868.587962] Aug 23 00:48:14 juju-e4d256-prod-github-runner-207 kernel: [69868.588803] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 00:48:14 juju-e4d256-prod-github-runner-207 kernel: [69868.589889] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:48:14 juju-e4d256-prod-github-runner-207 kernel: [69868.590951] ? _raw_spin_lock+0x22/0x30 Aug 23 00:48:14 juju-e4d256-prod-github-runner-207 kernel: [69868.591905] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:48:14 juju-e4d256-prod-github-runner-207 kernel: [69868.592937] direct_page_fault+0x206/0x310 [kvm] Aug 23 00:48:14 juju-e4d256-prod-github-runner-207 kernel: [69868.593988] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 00:48:14 juju-e4d256-prod-github-runner-207 kernel: [69868.595013] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 00:48:14 juju-e4d256-prod-github-runner-207 kernel: [69868.596022] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 00:48:14 juju-e4d256-prod-github-runner-207 kernel: [69868.597027] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 00:48:14 juju-e4d256-prod-github-runner-207 kernel: [69868.598012] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 00:48:14 juju-e4d256-prod-github-runner-207 kernel: [69868.599035] handle_exit+0x98/0x230 [kvm_amd] Aug 23 00:48:14 juju-e4d256-prod-github-runner-207 kernel: [69868.599935] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 00:48:14 juju-e4d256-prod-github-runner-207 kernel: [69868.600859] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 00:48:14 juju-e4d256-prod-github-runner-207 kernel: [69868.601811] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 00:48:14 juju-e4d256-prod-github-runner-207 kernel: [69868.602727] vcpu_run+0x62/0x2c0 [kvm] Aug 23 00:48:14 juju-e4d256-prod-github-runner-207 kernel: [69868.603549] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 00:48:14 juju-e4d256-prod-github-runner-207 kernel: [69868.604368] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 00:48:14 juju-e4d256-prod-github-runner-207 kernel: [69868.605235] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 00:48:14 juju-e4d256-prod-github-runner-207 kernel: [69868.606057] ? __seccomp_filter+0x4a/0x4a0 Aug 23 00:48:14 juju-e4d256-prod-github-runner-207 kernel: [69868.606809] ? __fget_files+0x86/0xc0 Aug 23 00:48:14 juju-e4d256-prod-github-runner-207 kernel: [69868.607521] __x64_sys_ioctl+0x95/0xd0 Aug 23 00:48:14 juju-e4d256-prod-github-runner-207 kernel: [69868.608224] do_syscall_64+0x5c/0xc0 Aug 23 00:48:14 juju-e4d256-prod-github-runner-207 kernel: [69868.608897] ? do_futex+0x162/0x1f0 Aug 23 00:48:14 juju-e4d256-prod-github-runner-207 kernel: [69868.609567] ? __x64_sys_futex+0x78/0x1e0 Aug 23 00:48:14 juju-e4d256-prod-github-runner-207 kernel: [69868.610250] ? __secure_computing+0xa9/0x120 Aug 23 00:48:14 juju-e4d256-prod-github-runner-207 kernel: [69868.610953] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 00:48:14 juju-e4d256-prod-github-runner-207 kernel: [69868.611733] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:48:14 juju-e4d256-prod-github-runner-207 kernel: [69868.612541] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:48:14 juju-e4d256-prod-github-runner-207 kernel: [69868.613407] ? do_syscall_64+0x69/0xc0 Aug 23 00:48:14 juju-e4d256-prod-github-runner-207 kernel: [69868.614082] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:48:14 juju-e4d256-prod-github-runner-207 kernel: [69868.614800] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:48:14 juju-e4d256-prod-github-runner-207 kernel: [69868.615508] ? do_syscall_64+0x69/0xc0 Aug 23 00:48:14 juju-e4d256-prod-github-runner-207 kernel: [69868.616140] ? do_syscall_64+0x69/0xc0 Aug 23 00:48:14 juju-e4d256-prod-github-runner-207 kernel: [69868.616772] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 00:48:14 juju-e4d256-prod-github-runner-207 kernel: [69868.617505] RIP: 0033:0x7faa5d0edaff Aug 23 00:48:14 juju-e4d256-prod-github-runner-207 kernel: [69868.618171] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 00:48:14 juju-e4d256-prod-github-runner-207 kernel: [69868.620213] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 00:48:14 juju-e4d256-prod-github-runner-207 kernel: [69868.621139] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 00:48:14 juju-e4d256-prod-github-runner-207 kernel: [69868.622060] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 00:48:14 juju-e4d256-prod-github-runner-207 kernel: [69868.622966] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 00:48:14 juju-e4d256-prod-github-runner-207 kernel: [69868.623873] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 00:48:14 juju-e4d256-prod-github-runner-207 kernel: [69868.624776] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 00:48:14 juju-e4d256-prod-github-runner-207 kernel: [69868.625703] Aug 23 00:48:42 juju-e4d256-prod-github-runner-207 kernel: [69896.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 64988s! [qemu-system-x86:6715] Aug 23 00:48:42 juju-e4d256-prod-github-runner-207 kernel: [69896.543632] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 00:48:42 juju-e4d256-prod-github-runner-207 kernel: [69896.543798] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 00:48:42 juju-e4d256-prod-github-runner-207 kernel: [69896.555873] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 00:48:42 juju-e4d256-prod-github-runner-207 kernel: [69896.557165] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 00:48:42 juju-e4d256-prod-github-runner-207 kernel: [69896.558387] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:48:42 juju-e4d256-prod-github-runner-207 kernel: [69896.559441] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 00:48:42 juju-e4d256-prod-github-runner-207 kernel: [69896.561994] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 00:48:42 juju-e4d256-prod-github-runner-207 kernel: [69896.563033] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 00:48:42 juju-e4d256-prod-github-runner-207 kernel: [69896.564190] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 00:48:42 juju-e4d256-prod-github-runner-207 kernel: [69896.565426] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 00:48:42 juju-e4d256-prod-github-runner-207 kernel: [69896.566597] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 00:48:42 juju-e4d256-prod-github-runner-207 kernel: [69896.567755] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 00:48:42 juju-e4d256-prod-github-runner-207 kernel: [69896.568926] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 00:48:42 juju-e4d256-prod-github-runner-207 kernel: [69896.570186] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 00:48:42 juju-e4d256-prod-github-runner-207 kernel: [69896.571296] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 00:48:42 juju-e4d256-prod-github-runner-207 kernel: [69896.572484] Call Trace: Aug 23 00:48:42 juju-e4d256-prod-github-runner-207 kernel: [69896.573416] Aug 23 00:48:42 juju-e4d256-prod-github-runner-207 kernel: [69896.574311] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:48:42 juju-e4d256-prod-github-runner-207 kernel: [69896.575344] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:48:42 juju-e4d256-prod-github-runner-207 kernel: [69896.576363] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:48:42 juju-e4d256-prod-github-runner-207 kernel: [69896.577459] ? show_regs.part.0+0x23/0x29 Aug 23 00:48:42 juju-e4d256-prod-github-runner-207 kernel: [69896.578454] ? show_regs.cold+0x8/0xd Aug 23 00:48:42 juju-e4d256-prod-github-runner-207 kernel: [69896.579423] ? watchdog_timer_fn+0x1be/0x220 Aug 23 00:48:42 juju-e4d256-prod-github-runner-207 kernel: [69896.580433] ? lockup_detector_update_enable+0x60/0x60 Aug 23 00:48:42 juju-e4d256-prod-github-runner-207 kernel: [69896.581515] ? __hrtimer_run_queues+0x107/0x230 Aug 23 00:48:42 juju-e4d256-prod-github-runner-207 kernel: [69896.582541] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 00:48:42 juju-e4d256-prod-github-runner-207 kernel: [69896.583561] ? hrtimer_interrupt+0x101/0x220 Aug 23 00:48:42 juju-e4d256-prod-github-runner-207 kernel: [69896.584579] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 00:48:42 juju-e4d256-prod-github-runner-207 kernel: [69896.585702] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 00:48:42 juju-e4d256-prod-github-runner-207 kernel: [69896.586751] Aug 23 00:48:42 juju-e4d256-prod-github-runner-207 kernel: [69896.587604] Aug 23 00:48:42 juju-e4d256-prod-github-runner-207 kernel: [69896.588439] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 00:48:42 juju-e4d256-prod-github-runner-207 kernel: [69896.589493] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:48:42 juju-e4d256-prod-github-runner-207 kernel: [69896.590539] ? _raw_spin_lock+0x22/0x30 Aug 23 00:48:42 juju-e4d256-prod-github-runner-207 kernel: [69896.591482] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:48:42 juju-e4d256-prod-github-runner-207 kernel: [69896.592499] direct_page_fault+0x206/0x310 [kvm] Aug 23 00:48:42 juju-e4d256-prod-github-runner-207 kernel: [69896.593546] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 00:48:42 juju-e4d256-prod-github-runner-207 kernel: [69896.594557] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 00:48:42 juju-e4d256-prod-github-runner-207 kernel: [69896.595558] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 00:48:42 juju-e4d256-prod-github-runner-207 kernel: [69896.596543] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 00:48:42 juju-e4d256-prod-github-runner-207 kernel: [69896.597665] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 00:48:42 juju-e4d256-prod-github-runner-207 kernel: [69896.598646] handle_exit+0x98/0x230 [kvm_amd] Aug 23 00:48:42 juju-e4d256-prod-github-runner-207 kernel: [69896.599555] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 00:48:42 juju-e4d256-prod-github-runner-207 kernel: [69896.600478] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 00:48:42 juju-e4d256-prod-github-runner-207 kernel: [69896.601424] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 00:48:42 juju-e4d256-prod-github-runner-207 kernel: [69896.602333] vcpu_run+0x62/0x2c0 [kvm] Aug 23 00:48:42 juju-e4d256-prod-github-runner-207 kernel: [69896.603142] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 00:48:42 juju-e4d256-prod-github-runner-207 kernel: [69896.603949] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 00:48:42 juju-e4d256-prod-github-runner-207 kernel: [69896.604814] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 00:48:42 juju-e4d256-prod-github-runner-207 kernel: [69896.605631] ? __seccomp_filter+0x4a/0x4a0 Aug 23 00:48:42 juju-e4d256-prod-github-runner-207 kernel: [69896.606377] ? __fget_files+0x86/0xc0 Aug 23 00:48:42 juju-e4d256-prod-github-runner-207 kernel: [69896.607079] __x64_sys_ioctl+0x95/0xd0 Aug 23 00:48:42 juju-e4d256-prod-github-runner-207 kernel: [69896.607771] do_syscall_64+0x5c/0xc0 Aug 23 00:48:42 juju-e4d256-prod-github-runner-207 kernel: [69896.608436] ? do_futex+0x162/0x1f0 Aug 23 00:48:42 juju-e4d256-prod-github-runner-207 kernel: [69896.609084] ? __x64_sys_futex+0x78/0x1e0 Aug 23 00:48:42 juju-e4d256-prod-github-runner-207 kernel: [69896.609776] ? __secure_computing+0xa9/0x120 Aug 23 00:48:42 juju-e4d256-prod-github-runner-207 kernel: [69896.610580] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 00:48:42 juju-e4d256-prod-github-runner-207 kernel: [69896.611442] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:48:42 juju-e4d256-prod-github-runner-207 kernel: [69896.612252] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:48:42 juju-e4d256-prod-github-runner-207 kernel: [69896.613082] ? do_syscall_64+0x69/0xc0 Aug 23 00:48:42 juju-e4d256-prod-github-runner-207 kernel: [69896.613835] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:48:42 juju-e4d256-prod-github-runner-207 kernel: [69896.614642] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:48:42 juju-e4d256-prod-github-runner-207 kernel: [69896.615450] ? do_syscall_64+0x69/0xc0 Aug 23 00:48:42 juju-e4d256-prod-github-runner-207 kernel: [69896.616149] ? do_syscall_64+0x69/0xc0 Aug 23 00:48:42 juju-e4d256-prod-github-runner-207 kernel: [69896.616844] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 00:48:42 juju-e4d256-prod-github-runner-207 kernel: [69896.617658] RIP: 0033:0x7faa5d0edaff Aug 23 00:48:42 juju-e4d256-prod-github-runner-207 kernel: [69896.618374] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 00:48:42 juju-e4d256-prod-github-runner-207 kernel: [69896.620682] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 00:48:42 juju-e4d256-prod-github-runner-207 kernel: [69896.621764] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 00:48:42 juju-e4d256-prod-github-runner-207 kernel: [69896.622788] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 00:48:42 juju-e4d256-prod-github-runner-207 kernel: [69896.623806] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 00:48:42 juju-e4d256-prod-github-runner-207 kernel: [69896.624858] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 00:48:42 juju-e4d256-prod-github-runner-207 kernel: [69896.625926] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 00:48:42 juju-e4d256-prod-github-runner-207 kernel: [69896.626950] Aug 23 00:49:10 juju-e4d256-prod-github-runner-207 kernel: [69924.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 65014s! [qemu-system-x86:6715] Aug 23 00:49:10 juju-e4d256-prod-github-runner-207 kernel: [69924.543091] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 00:49:10 juju-e4d256-prod-github-runner-207 kernel: [69924.543156] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 00:49:10 juju-e4d256-prod-github-runner-207 kernel: [69924.555295] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 00:49:10 juju-e4d256-prod-github-runner-207 kernel: [69924.556563] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 00:49:10 juju-e4d256-prod-github-runner-207 kernel: [69924.557790] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:49:10 juju-e4d256-prod-github-runner-207 kernel: [69924.558851] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 00:49:10 juju-e4d256-prod-github-runner-207 kernel: [69924.561401] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 00:49:10 juju-e4d256-prod-github-runner-207 kernel: [69924.562445] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 00:49:10 juju-e4d256-prod-github-runner-207 kernel: [69924.563695] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 00:49:10 juju-e4d256-prod-github-runner-207 kernel: [69924.564878] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 00:49:10 juju-e4d256-prod-github-runner-207 kernel: [69924.566058] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 00:49:10 juju-e4d256-prod-github-runner-207 kernel: [69924.567226] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 00:49:10 juju-e4d256-prod-github-runner-207 kernel: [69924.568587] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 00:49:10 juju-e4d256-prod-github-runner-207 kernel: [69924.569837] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 00:49:10 juju-e4d256-prod-github-runner-207 kernel: [69924.570940] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 00:49:10 juju-e4d256-prod-github-runner-207 kernel: [69924.572171] Call Trace: Aug 23 00:49:10 juju-e4d256-prod-github-runner-207 kernel: [69924.573105] Aug 23 00:49:10 juju-e4d256-prod-github-runner-207 kernel: [69924.574001] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:49:10 juju-e4d256-prod-github-runner-207 kernel: [69924.575099] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:49:10 juju-e4d256-prod-github-runner-207 kernel: [69924.576170] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:49:10 juju-e4d256-prod-github-runner-207 kernel: [69924.577295] ? show_regs.part.0+0x23/0x29 Aug 23 00:49:10 juju-e4d256-prod-github-runner-207 kernel: [69924.578296] ? show_regs.cold+0x8/0xd Aug 23 00:49:10 juju-e4d256-prod-github-runner-207 kernel: [69924.579267] ? watchdog_timer_fn+0x1be/0x220 Aug 23 00:49:10 juju-e4d256-prod-github-runner-207 kernel: [69924.580284] ? lockup_detector_update_enable+0x60/0x60 Aug 23 00:49:10 juju-e4d256-prod-github-runner-207 kernel: [69924.581373] ? __hrtimer_run_queues+0x107/0x230 Aug 23 00:49:10 juju-e4d256-prod-github-runner-207 kernel: [69924.582400] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 00:49:10 juju-e4d256-prod-github-runner-207 kernel: [69924.583610] ? hrtimer_interrupt+0x101/0x220 Aug 23 00:49:10 juju-e4d256-prod-github-runner-207 kernel: [69924.584648] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 00:49:10 juju-e4d256-prod-github-runner-207 kernel: [69924.585751] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 00:49:10 juju-e4d256-prod-github-runner-207 kernel: [69924.586954] Aug 23 00:49:10 juju-e4d256-prod-github-runner-207 kernel: [69924.587806] Aug 23 00:49:10 juju-e4d256-prod-github-runner-207 kernel: [69924.588642] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 00:49:10 juju-e4d256-prod-github-runner-207 kernel: [69924.589687] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:49:10 juju-e4d256-prod-github-runner-207 kernel: [69924.590728] ? _raw_spin_lock+0x22/0x30 Aug 23 00:49:10 juju-e4d256-prod-github-runner-207 kernel: [69924.591675] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:49:10 juju-e4d256-prod-github-runner-207 kernel: [69924.592702] direct_page_fault+0x206/0x310 [kvm] Aug 23 00:49:10 juju-e4d256-prod-github-runner-207 kernel: [69924.593763] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 00:49:10 juju-e4d256-prod-github-runner-207 kernel: [69924.594818] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 00:49:10 juju-e4d256-prod-github-runner-207 kernel: [69924.595828] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 00:49:10 juju-e4d256-prod-github-runner-207 kernel: [69924.596881] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 00:49:10 juju-e4d256-prod-github-runner-207 kernel: [69924.597907] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 00:49:10 juju-e4d256-prod-github-runner-207 kernel: [69924.598943] handle_exit+0x98/0x230 [kvm_amd] Aug 23 00:49:10 juju-e4d256-prod-github-runner-207 kernel: [69924.599878] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 00:49:10 juju-e4d256-prod-github-runner-207 kernel: [69924.600844] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 00:49:10 juju-e4d256-prod-github-runner-207 kernel: [69924.602068] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 00:49:10 juju-e4d256-prod-github-runner-207 kernel: [69924.603023] vcpu_run+0x62/0x2c0 [kvm] Aug 23 00:49:10 juju-e4d256-prod-github-runner-207 kernel: [69924.603840] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 00:49:10 juju-e4d256-prod-github-runner-207 kernel: [69924.604650] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 00:49:10 juju-e4d256-prod-github-runner-207 kernel: [69924.605575] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 00:49:10 juju-e4d256-prod-github-runner-207 kernel: [69924.606385] ? __seccomp_filter+0x4a/0x4a0 Aug 23 00:49:10 juju-e4d256-prod-github-runner-207 kernel: [69924.607143] ? __fget_files+0x86/0xc0 Aug 23 00:49:10 juju-e4d256-prod-github-runner-207 kernel: [69924.607881] __x64_sys_ioctl+0x95/0xd0 Aug 23 00:49:10 juju-e4d256-prod-github-runner-207 kernel: [69924.608578] do_syscall_64+0x5c/0xc0 Aug 23 00:49:10 juju-e4d256-prod-github-runner-207 kernel: [69924.609262] ? do_futex+0x162/0x1f0 Aug 23 00:49:10 juju-e4d256-prod-github-runner-207 kernel: [69924.609918] ? __x64_sys_futex+0x78/0x1e0 Aug 23 00:49:10 juju-e4d256-prod-github-runner-207 kernel: [69924.610602] ? __secure_computing+0xa9/0x120 Aug 23 00:49:10 juju-e4d256-prod-github-runner-207 kernel: [69924.611294] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 00:49:10 juju-e4d256-prod-github-runner-207 kernel: [69924.612063] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:49:10 juju-e4d256-prod-github-runner-207 kernel: [69924.612804] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:49:10 juju-e4d256-prod-github-runner-207 kernel: [69924.613540] ? do_syscall_64+0x69/0xc0 Aug 23 00:49:10 juju-e4d256-prod-github-runner-207 kernel: [69924.614191] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:49:10 juju-e4d256-prod-github-runner-207 kernel: [69924.614903] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:49:10 juju-e4d256-prod-github-runner-207 kernel: [69924.615608] ? do_syscall_64+0x69/0xc0 Aug 23 00:49:10 juju-e4d256-prod-github-runner-207 kernel: [69924.616238] ? do_syscall_64+0x69/0xc0 Aug 23 00:49:10 juju-e4d256-prod-github-runner-207 kernel: [69924.616922] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 00:49:10 juju-e4d256-prod-github-runner-207 kernel: [69924.617665] RIP: 0033:0x7faa5d0edaff Aug 23 00:49:10 juju-e4d256-prod-github-runner-207 kernel: [69924.618310] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 00:49:10 juju-e4d256-prod-github-runner-207 kernel: [69924.620332] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 00:49:10 juju-e4d256-prod-github-runner-207 kernel: [69924.621273] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 00:49:10 juju-e4d256-prod-github-runner-207 kernel: [69924.622191] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 00:49:10 juju-e4d256-prod-github-runner-207 kernel: [69924.623111] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 00:49:10 juju-e4d256-prod-github-runner-207 kernel: [69924.624027] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 00:49:10 juju-e4d256-prod-github-runner-207 kernel: [69924.624953] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 00:49:10 juju-e4d256-prod-github-runner-207 kernel: [69924.625914] Aug 23 00:49:38 juju-e4d256-prod-github-runner-207 kernel: [69952.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 65040s! [qemu-system-x86:6715] Aug 23 00:49:38 juju-e4d256-prod-github-runner-207 kernel: [69952.543094] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 00:49:38 juju-e4d256-prod-github-runner-207 kernel: [69952.543164] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 00:49:38 juju-e4d256-prod-github-runner-207 kernel: [69952.555267] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 00:49:38 juju-e4d256-prod-github-runner-207 kernel: [69952.556545] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 00:49:38 juju-e4d256-prod-github-runner-207 kernel: [69952.557765] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:49:38 juju-e4d256-prod-github-runner-207 kernel: [69952.558826] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 00:49:38 juju-e4d256-prod-github-runner-207 kernel: [69952.561379] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 00:49:38 juju-e4d256-prod-github-runner-207 kernel: [69952.562424] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 00:49:38 juju-e4d256-prod-github-runner-207 kernel: [69952.563590] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 00:49:38 juju-e4d256-prod-github-runner-207 kernel: [69952.564775] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 00:49:38 juju-e4d256-prod-github-runner-207 kernel: [69952.565936] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 00:49:38 juju-e4d256-prod-github-runner-207 kernel: [69952.567102] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 00:49:38 juju-e4d256-prod-github-runner-207 kernel: [69952.568275] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 00:49:38 juju-e4d256-prod-github-runner-207 kernel: [69952.569527] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 00:49:38 juju-e4d256-prod-github-runner-207 kernel: [69952.570628] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 00:49:38 juju-e4d256-prod-github-runner-207 kernel: [69952.571819] Call Trace: Aug 23 00:49:38 juju-e4d256-prod-github-runner-207 kernel: [69952.572742] Aug 23 00:49:38 juju-e4d256-prod-github-runner-207 kernel: [69952.573631] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:49:38 juju-e4d256-prod-github-runner-207 kernel: [69952.574660] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:49:38 juju-e4d256-prod-github-runner-207 kernel: [69952.575677] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:49:38 juju-e4d256-prod-github-runner-207 kernel: [69952.576767] ? show_regs.part.0+0x23/0x29 Aug 23 00:49:38 juju-e4d256-prod-github-runner-207 kernel: [69952.577763] ? show_regs.cold+0x8/0xd Aug 23 00:49:38 juju-e4d256-prod-github-runner-207 kernel: [69952.578734] ? watchdog_timer_fn+0x1be/0x220 Aug 23 00:49:38 juju-e4d256-prod-github-runner-207 kernel: [69952.579741] ? lockup_detector_update_enable+0x60/0x60 Aug 23 00:49:38 juju-e4d256-prod-github-runner-207 kernel: [69952.580815] ? __hrtimer_run_queues+0x107/0x230 Aug 23 00:49:38 juju-e4d256-prod-github-runner-207 kernel: [69952.581840] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 00:49:38 juju-e4d256-prod-github-runner-207 kernel: [69952.582861] ? hrtimer_interrupt+0x101/0x220 Aug 23 00:49:38 juju-e4d256-prod-github-runner-207 kernel: [69952.583874] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 00:49:38 juju-e4d256-prod-github-runner-207 kernel: [69952.584957] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 00:49:38 juju-e4d256-prod-github-runner-207 kernel: [69952.586007] Aug 23 00:49:38 juju-e4d256-prod-github-runner-207 kernel: [69952.586971] Aug 23 00:49:38 juju-e4d256-prod-github-runner-207 kernel: [69952.587806] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 00:49:38 juju-e4d256-prod-github-runner-207 kernel: [69952.588853] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:49:38 juju-e4d256-prod-github-runner-207 kernel: [69952.589891] ? _raw_spin_lock+0x22/0x30 Aug 23 00:49:38 juju-e4d256-prod-github-runner-207 kernel: [69952.590841] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:49:38 juju-e4d256-prod-github-runner-207 kernel: [69952.591860] direct_page_fault+0x206/0x310 [kvm] Aug 23 00:49:38 juju-e4d256-prod-github-runner-207 kernel: [69952.592896] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 00:49:38 juju-e4d256-prod-github-runner-207 kernel: [69952.593904] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 00:49:38 juju-e4d256-prod-github-runner-207 kernel: [69952.594902] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 00:49:38 juju-e4d256-prod-github-runner-207 kernel: [69952.595883] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 00:49:38 juju-e4d256-prod-github-runner-207 kernel: [69952.596836] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 00:49:38 juju-e4d256-prod-github-runner-207 kernel: [69952.597813] handle_exit+0x98/0x230 [kvm_amd] Aug 23 00:49:38 juju-e4d256-prod-github-runner-207 kernel: [69952.598710] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 00:49:38 juju-e4d256-prod-github-runner-207 kernel: [69952.599628] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 00:49:38 juju-e4d256-prod-github-runner-207 kernel: [69952.600563] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 00:49:38 juju-e4d256-prod-github-runner-207 kernel: [69952.601467] vcpu_run+0x62/0x2c0 [kvm] Aug 23 00:49:38 juju-e4d256-prod-github-runner-207 kernel: [69952.602282] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 00:49:38 juju-e4d256-prod-github-runner-207 kernel: [69952.603087] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 00:49:38 juju-e4d256-prod-github-runner-207 kernel: [69952.603940] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 00:49:38 juju-e4d256-prod-github-runner-207 kernel: [69952.604749] ? __seccomp_filter+0x4a/0x4a0 Aug 23 00:49:38 juju-e4d256-prod-github-runner-207 kernel: [69952.605490] ? __fget_files+0x86/0xc0 Aug 23 00:49:38 juju-e4d256-prod-github-runner-207 kernel: [69952.606198] __x64_sys_ioctl+0x95/0xd0 Aug 23 00:49:38 juju-e4d256-prod-github-runner-207 kernel: [69952.606888] do_syscall_64+0x5c/0xc0 Aug 23 00:49:38 juju-e4d256-prod-github-runner-207 kernel: [69952.607551] ? do_futex+0x162/0x1f0 Aug 23 00:49:38 juju-e4d256-prod-github-runner-207 kernel: [69952.608202] ? __x64_sys_futex+0x78/0x1e0 Aug 23 00:49:38 juju-e4d256-prod-github-runner-207 kernel: [69952.608885] ? __secure_computing+0xa9/0x120 Aug 23 00:49:38 juju-e4d256-prod-github-runner-207 kernel: [69952.609573] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 00:49:38 juju-e4d256-prod-github-runner-207 kernel: [69952.610333] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:49:38 juju-e4d256-prod-github-runner-207 kernel: [69952.611055] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:49:38 juju-e4d256-prod-github-runner-207 kernel: [69952.611770] ? do_syscall_64+0x69/0xc0 Aug 23 00:49:38 juju-e4d256-prod-github-runner-207 kernel: [69952.612418] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:49:38 juju-e4d256-prod-github-runner-207 kernel: [69952.613131] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:49:38 juju-e4d256-prod-github-runner-207 kernel: [69952.613829] ? do_syscall_64+0x69/0xc0 Aug 23 00:49:38 juju-e4d256-prod-github-runner-207 kernel: [69952.614452] ? do_syscall_64+0x69/0xc0 Aug 23 00:49:38 juju-e4d256-prod-github-runner-207 kernel: [69952.615072] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 00:49:38 juju-e4d256-prod-github-runner-207 kernel: [69952.615775] RIP: 0033:0x7faa5d0edaff Aug 23 00:49:38 juju-e4d256-prod-github-runner-207 kernel: [69952.616426] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 00:49:38 juju-e4d256-prod-github-runner-207 kernel: [69952.618423] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 00:49:38 juju-e4d256-prod-github-runner-207 kernel: [69952.619329] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 00:49:38 juju-e4d256-prod-github-runner-207 kernel: [69952.620215] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 00:49:38 juju-e4d256-prod-github-runner-207 kernel: [69952.621120] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 00:49:38 juju-e4d256-prod-github-runner-207 kernel: [69952.622004] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 00:49:38 juju-e4d256-prod-github-runner-207 kernel: [69952.622889] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 00:49:38 juju-e4d256-prod-github-runner-207 kernel: [69952.623777] Aug 23 00:50:06 juju-e4d256-prod-github-runner-207 kernel: [69980.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 65066s! [qemu-system-x86:6715] Aug 23 00:50:06 juju-e4d256-prod-github-runner-207 kernel: [69980.543756] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 00:50:06 juju-e4d256-prod-github-runner-207 kernel: [69980.544003] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 00:50:06 juju-e4d256-prod-github-runner-207 kernel: [69980.556138] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 00:50:06 juju-e4d256-prod-github-runner-207 kernel: [69980.557407] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 00:50:06 juju-e4d256-prod-github-runner-207 kernel: [69980.558638] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:50:06 juju-e4d256-prod-github-runner-207 kernel: [69980.559696] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 00:50:06 juju-e4d256-prod-github-runner-207 kernel: [69980.562298] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 00:50:06 juju-e4d256-prod-github-runner-207 kernel: [69980.563382] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 00:50:06 juju-e4d256-prod-github-runner-207 kernel: [69980.564594] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 00:50:06 juju-e4d256-prod-github-runner-207 kernel: [69980.565759] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 00:50:06 juju-e4d256-prod-github-runner-207 kernel: [69980.566993] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 00:50:06 juju-e4d256-prod-github-runner-207 kernel: [69980.568227] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 00:50:06 juju-e4d256-prod-github-runner-207 kernel: [69980.569421] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 00:50:06 juju-e4d256-prod-github-runner-207 kernel: [69980.570733] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 00:50:06 juju-e4d256-prod-github-runner-207 kernel: [69980.571912] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 00:50:06 juju-e4d256-prod-github-runner-207 kernel: [69980.573133] Call Trace: Aug 23 00:50:06 juju-e4d256-prod-github-runner-207 kernel: [69980.574087] Aug 23 00:50:06 juju-e4d256-prod-github-runner-207 kernel: [69980.574998] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:50:06 juju-e4d256-prod-github-runner-207 kernel: [69980.576035] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:50:06 juju-e4d256-prod-github-runner-207 kernel: [69980.577075] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:50:06 juju-e4d256-prod-github-runner-207 kernel: [69980.578179] ? show_regs.part.0+0x23/0x29 Aug 23 00:50:06 juju-e4d256-prod-github-runner-207 kernel: [69980.579185] ? show_regs.cold+0x8/0xd Aug 23 00:50:06 juju-e4d256-prod-github-runner-207 kernel: [69980.580181] ? watchdog_timer_fn+0x1be/0x220 Aug 23 00:50:06 juju-e4d256-prod-github-runner-207 kernel: [69980.581197] ? lockup_detector_update_enable+0x60/0x60 Aug 23 00:50:06 juju-e4d256-prod-github-runner-207 kernel: [69980.582299] ? __hrtimer_run_queues+0x107/0x230 Aug 23 00:50:06 juju-e4d256-prod-github-runner-207 kernel: [69980.583327] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 00:50:06 juju-e4d256-prod-github-runner-207 kernel: [69980.584395] ? hrtimer_interrupt+0x101/0x220 Aug 23 00:50:06 juju-e4d256-prod-github-runner-207 kernel: [69980.585420] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 00:50:06 juju-e4d256-prod-github-runner-207 kernel: [69980.586494] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 00:50:06 juju-e4d256-prod-github-runner-207 kernel: [69980.587540] Aug 23 00:50:06 juju-e4d256-prod-github-runner-207 kernel: [69980.588407] Aug 23 00:50:06 juju-e4d256-prod-github-runner-207 kernel: [69980.589251] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 00:50:06 juju-e4d256-prod-github-runner-207 kernel: [69980.590298] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:50:06 juju-e4d256-prod-github-runner-207 kernel: [69980.591342] ? _raw_spin_lock+0x22/0x30 Aug 23 00:50:06 juju-e4d256-prod-github-runner-207 kernel: [69980.592311] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:50:06 juju-e4d256-prod-github-runner-207 kernel: [69980.593328] direct_page_fault+0x206/0x310 [kvm] Aug 23 00:50:06 juju-e4d256-prod-github-runner-207 kernel: [69980.594366] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 00:50:06 juju-e4d256-prod-github-runner-207 kernel: [69980.595399] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 00:50:06 juju-e4d256-prod-github-runner-207 kernel: [69980.596418] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 00:50:06 juju-e4d256-prod-github-runner-207 kernel: [69980.597540] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 00:50:06 juju-e4d256-prod-github-runner-207 kernel: [69980.598529] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 00:50:06 juju-e4d256-prod-github-runner-207 kernel: [69980.599544] handle_exit+0x98/0x230 [kvm_amd] Aug 23 00:50:06 juju-e4d256-prod-github-runner-207 kernel: [69980.600485] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 00:50:06 juju-e4d256-prod-github-runner-207 kernel: [69980.601408] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 00:50:06 juju-e4d256-prod-github-runner-207 kernel: [69980.602336] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 00:50:06 juju-e4d256-prod-github-runner-207 kernel: [69980.603245] vcpu_run+0x62/0x2c0 [kvm] Aug 23 00:50:06 juju-e4d256-prod-github-runner-207 kernel: [69980.604058] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 00:50:06 juju-e4d256-prod-github-runner-207 kernel: [69980.604925] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 00:50:06 juju-e4d256-prod-github-runner-207 kernel: [69980.605788] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 00:50:06 juju-e4d256-prod-github-runner-207 kernel: [69980.606591] ? __seccomp_filter+0x4a/0x4a0 Aug 23 00:50:06 juju-e4d256-prod-github-runner-207 kernel: [69980.607340] ? __fget_files+0x86/0xc0 Aug 23 00:50:06 juju-e4d256-prod-github-runner-207 kernel: [69980.608044] __x64_sys_ioctl+0x95/0xd0 Aug 23 00:50:06 juju-e4d256-prod-github-runner-207 kernel: [69980.608748] do_syscall_64+0x5c/0xc0 Aug 23 00:50:06 juju-e4d256-prod-github-runner-207 kernel: [69980.609421] ? do_futex+0x162/0x1f0 Aug 23 00:50:06 juju-e4d256-prod-github-runner-207 kernel: [69980.610083] ? __x64_sys_futex+0x78/0x1e0 Aug 23 00:50:06 juju-e4d256-prod-github-runner-207 kernel: [69980.610759] ? __secure_computing+0xa9/0x120 Aug 23 00:50:06 juju-e4d256-prod-github-runner-207 kernel: [69980.611453] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 00:50:06 juju-e4d256-prod-github-runner-207 kernel: [69980.612230] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:50:06 juju-e4d256-prod-github-runner-207 kernel: [69980.612954] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:50:06 juju-e4d256-prod-github-runner-207 kernel: [69980.613678] ? do_syscall_64+0x69/0xc0 Aug 23 00:50:06 juju-e4d256-prod-github-runner-207 kernel: [69980.614331] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:50:06 juju-e4d256-prod-github-runner-207 kernel: [69980.615045] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:50:06 juju-e4d256-prod-github-runner-207 kernel: [69980.615763] ? do_syscall_64+0x69/0xc0 Aug 23 00:50:06 juju-e4d256-prod-github-runner-207 kernel: [69980.616410] ? do_syscall_64+0x69/0xc0 Aug 23 00:50:06 juju-e4d256-prod-github-runner-207 kernel: [69980.617034] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 00:50:06 juju-e4d256-prod-github-runner-207 kernel: [69980.617740] RIP: 0033:0x7faa5d0edaff Aug 23 00:50:06 juju-e4d256-prod-github-runner-207 kernel: [69980.618405] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 00:50:06 juju-e4d256-prod-github-runner-207 kernel: [69980.620467] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 00:50:06 juju-e4d256-prod-github-runner-207 kernel: [69980.621409] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 00:50:06 juju-e4d256-prod-github-runner-207 kernel: [69980.622405] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 00:50:06 juju-e4d256-prod-github-runner-207 kernel: [69980.623297] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 00:50:06 juju-e4d256-prod-github-runner-207 kernel: [69980.624201] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 00:50:06 juju-e4d256-prod-github-runner-207 kernel: [69980.625093] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 00:50:06 juju-e4d256-prod-github-runner-207 kernel: [69980.626022] Aug 23 00:50:34 juju-e4d256-prod-github-runner-207 kernel: [70008.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 65092s! [qemu-system-x86:6715] Aug 23 00:50:34 juju-e4d256-prod-github-runner-207 kernel: [70008.543096] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 00:50:34 juju-e4d256-prod-github-runner-207 kernel: [70008.543167] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 00:50:34 juju-e4d256-prod-github-runner-207 kernel: [70008.555230] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 00:50:34 juju-e4d256-prod-github-runner-207 kernel: [70008.556518] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 00:50:34 juju-e4d256-prod-github-runner-207 kernel: [70008.557743] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:50:34 juju-e4d256-prod-github-runner-207 kernel: [70008.558798] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 00:50:34 juju-e4d256-prod-github-runner-207 kernel: [70008.561349] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 00:50:34 juju-e4d256-prod-github-runner-207 kernel: [70008.562391] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 00:50:34 juju-e4d256-prod-github-runner-207 kernel: [70008.563552] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 00:50:34 juju-e4d256-prod-github-runner-207 kernel: [70008.564723] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 00:50:34 juju-e4d256-prod-github-runner-207 kernel: [70008.565884] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 00:50:34 juju-e4d256-prod-github-runner-207 kernel: [70008.567048] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 00:50:34 juju-e4d256-prod-github-runner-207 kernel: [70008.568224] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 00:50:34 juju-e4d256-prod-github-runner-207 kernel: [70008.569459] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 00:50:34 juju-e4d256-prod-github-runner-207 kernel: [70008.570557] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 00:50:34 juju-e4d256-prod-github-runner-207 kernel: [70008.571768] Call Trace: Aug 23 00:50:34 juju-e4d256-prod-github-runner-207 kernel: [70008.572687] Aug 23 00:50:34 juju-e4d256-prod-github-runner-207 kernel: [70008.573574] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:50:34 juju-e4d256-prod-github-runner-207 kernel: [70008.574608] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:50:34 juju-e4d256-prod-github-runner-207 kernel: [70008.575629] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:50:34 juju-e4d256-prod-github-runner-207 kernel: [70008.576730] ? show_regs.part.0+0x23/0x29 Aug 23 00:50:34 juju-e4d256-prod-github-runner-207 kernel: [70008.577727] ? show_regs.cold+0x8/0xd Aug 23 00:50:34 juju-e4d256-prod-github-runner-207 kernel: [70008.578704] ? watchdog_timer_fn+0x1be/0x220 Aug 23 00:50:34 juju-e4d256-prod-github-runner-207 kernel: [70008.579712] ? lockup_detector_update_enable+0x60/0x60 Aug 23 00:50:34 juju-e4d256-prod-github-runner-207 kernel: [70008.580795] ? __hrtimer_run_queues+0x107/0x230 Aug 23 00:50:34 juju-e4d256-prod-github-runner-207 kernel: [70008.581824] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 00:50:34 juju-e4d256-prod-github-runner-207 kernel: [70008.582848] ? hrtimer_interrupt+0x101/0x220 Aug 23 00:50:34 juju-e4d256-prod-github-runner-207 kernel: [70008.583873] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 00:50:34 juju-e4d256-prod-github-runner-207 kernel: [70008.584947] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 00:50:34 juju-e4d256-prod-github-runner-207 kernel: [70008.585994] Aug 23 00:50:34 juju-e4d256-prod-github-runner-207 kernel: [70008.586847] Aug 23 00:50:34 juju-e4d256-prod-github-runner-207 kernel: [70008.587686] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 00:50:34 juju-e4d256-prod-github-runner-207 kernel: [70008.588732] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:50:34 juju-e4d256-prod-github-runner-207 kernel: [70008.589771] ? _raw_spin_lock+0x22/0x30 Aug 23 00:50:34 juju-e4d256-prod-github-runner-207 kernel: [70008.590715] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:50:34 juju-e4d256-prod-github-runner-207 kernel: [70008.591730] direct_page_fault+0x206/0x310 [kvm] Aug 23 00:50:34 juju-e4d256-prod-github-runner-207 kernel: [70008.592769] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 00:50:34 juju-e4d256-prod-github-runner-207 kernel: [70008.593778] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 00:50:34 juju-e4d256-prod-github-runner-207 kernel: [70008.594777] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 00:50:34 juju-e4d256-prod-github-runner-207 kernel: [70008.595761] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 00:50:34 juju-e4d256-prod-github-runner-207 kernel: [70008.596706] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 00:50:34 juju-e4d256-prod-github-runner-207 kernel: [70008.597684] handle_exit+0x98/0x230 [kvm_amd] Aug 23 00:50:34 juju-e4d256-prod-github-runner-207 kernel: [70008.598577] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 00:50:34 juju-e4d256-prod-github-runner-207 kernel: [70008.599491] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 00:50:34 juju-e4d256-prod-github-runner-207 kernel: [70008.600429] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 00:50:34 juju-e4d256-prod-github-runner-207 kernel: [70008.601333] vcpu_run+0x62/0x2c0 [kvm] Aug 23 00:50:34 juju-e4d256-prod-github-runner-207 kernel: [70008.602152] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 00:50:34 juju-e4d256-prod-github-runner-207 kernel: [70008.602962] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 00:50:34 juju-e4d256-prod-github-runner-207 kernel: [70008.603833] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 00:50:34 juju-e4d256-prod-github-runner-207 kernel: [70008.604628] ? __seccomp_filter+0x4a/0x4a0 Aug 23 00:50:34 juju-e4d256-prod-github-runner-207 kernel: [70008.605373] ? __fget_files+0x86/0xc0 Aug 23 00:50:34 juju-e4d256-prod-github-runner-207 kernel: [70008.606076] __x64_sys_ioctl+0x95/0xd0 Aug 23 00:50:34 juju-e4d256-prod-github-runner-207 kernel: [70008.606770] do_syscall_64+0x5c/0xc0 Aug 23 00:50:34 juju-e4d256-prod-github-runner-207 kernel: [70008.607439] ? do_futex+0x162/0x1f0 Aug 23 00:50:34 juju-e4d256-prod-github-runner-207 kernel: [70008.608101] ? __x64_sys_futex+0x78/0x1e0 Aug 23 00:50:34 juju-e4d256-prod-github-runner-207 kernel: [70008.608774] ? __secure_computing+0xa9/0x120 Aug 23 00:50:34 juju-e4d256-prod-github-runner-207 kernel: [70008.609463] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 00:50:34 juju-e4d256-prod-github-runner-207 kernel: [70008.610220] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:50:34 juju-e4d256-prod-github-runner-207 kernel: [70008.610941] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:50:34 juju-e4d256-prod-github-runner-207 kernel: [70008.611656] ? do_syscall_64+0x69/0xc0 Aug 23 00:50:34 juju-e4d256-prod-github-runner-207 kernel: [70008.612316] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:50:34 juju-e4d256-prod-github-runner-207 kernel: [70008.613025] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:50:34 juju-e4d256-prod-github-runner-207 kernel: [70008.613719] ? do_syscall_64+0x69/0xc0 Aug 23 00:50:34 juju-e4d256-prod-github-runner-207 kernel: [70008.614342] ? do_syscall_64+0x69/0xc0 Aug 23 00:50:34 juju-e4d256-prod-github-runner-207 kernel: [70008.614963] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 00:50:34 juju-e4d256-prod-github-runner-207 kernel: [70008.615668] RIP: 0033:0x7faa5d0edaff Aug 23 00:50:34 juju-e4d256-prod-github-runner-207 kernel: [70008.616306] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 00:50:34 juju-e4d256-prod-github-runner-207 kernel: [70008.618289] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 00:50:34 juju-e4d256-prod-github-runner-207 kernel: [70008.619195] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 00:50:34 juju-e4d256-prod-github-runner-207 kernel: [70008.620092] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 00:50:34 juju-e4d256-prod-github-runner-207 kernel: [70008.620979] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 00:50:34 juju-e4d256-prod-github-runner-207 kernel: [70008.621864] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 00:50:34 juju-e4d256-prod-github-runner-207 kernel: [70008.622751] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 00:50:34 juju-e4d256-prod-github-runner-207 kernel: [70008.623642] Aug 23 00:50:47 juju-e4d256-prod-github-runner-207 kernel: [70021.856706] rcu: INFO: rcu_sched self-detected stall on CPU Aug 23 00:50:47 juju-e4d256-prod-github-runner-207 kernel: [70021.857681] rcu: 1-....: (17421084 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=8412674 Aug 23 00:50:47 juju-e4d256-prod-github-runner-207 kernel: [70021.858806] (t=17476164 jiffies g=23269 q=60369) Aug 23 00:50:47 juju-e4d256-prod-github-runner-207 kernel: [70021.859609] NMI backtrace for cpu 1 Aug 23 00:50:47 juju-e4d256-prod-github-runner-207 kernel: [70021.860319] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 00:50:47 juju-e4d256-prod-github-runner-207 kernel: [70021.861426] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 00:50:47 juju-e4d256-prod-github-runner-207 kernel: [70021.862484] Call Trace: Aug 23 00:50:47 juju-e4d256-prod-github-runner-207 kernel: [70021.863165] Aug 23 00:50:47 juju-e4d256-prod-github-runner-207 kernel: [70021.863819] show_stack+0x52/0x5c Aug 23 00:50:47 juju-e4d256-prod-github-runner-207 kernel: [70021.864545] dump_stack_lvl+0x4a/0x63 Aug 23 00:50:47 juju-e4d256-prod-github-runner-207 kernel: [70021.865291] dump_stack+0x10/0x16 Aug 23 00:50:47 juju-e4d256-prod-github-runner-207 kernel: [70021.866046] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 23 00:50:47 juju-e4d256-prod-github-runner-207 kernel: [70021.866869] ? lapic_can_unplug_cpu+0x90/0x90 Aug 23 00:50:47 juju-e4d256-prod-github-runner-207 kernel: [70021.867791] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 23 00:50:47 juju-e4d256-prod-github-runner-207 kernel: [70021.868637] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 23 00:50:47 juju-e4d256-prod-github-runner-207 kernel: [70021.869456] trigger_single_cpu_backtrace+0x44/0x4f Aug 23 00:50:47 juju-e4d256-prod-github-runner-207 kernel: [70021.870271] rcu_dump_cpu_stacks+0x102/0x149 Aug 23 00:50:47 juju-e4d256-prod-github-runner-207 kernel: [70021.871042] print_cpu_stall.cold+0x2f/0xe2 Aug 23 00:50:47 juju-e4d256-prod-github-runner-207 kernel: [70021.871830] ? timekeeping_update+0xf7/0x150 Aug 23 00:50:47 juju-e4d256-prod-github-runner-207 kernel: [70021.872599] check_cpu_stall+0x109/0x270 Aug 23 00:50:47 juju-e4d256-prod-github-runner-207 kernel: [70021.873350] rcu_sched_clock_irq+0x9a/0x250 Aug 23 00:50:47 juju-e4d256-prod-github-runner-207 kernel: [70021.874109] update_process_times+0x94/0xd0 Aug 23 00:50:47 juju-e4d256-prod-github-runner-207 kernel: [70021.874867] tick_sched_handle+0x29/0x70 Aug 23 00:50:47 juju-e4d256-prod-github-runner-207 kernel: [70021.875620] tick_sched_timer+0x8c/0xc0 Aug 23 00:50:47 juju-e4d256-prod-github-runner-207 kernel: [70021.876358] ? tick_nohz_handler+0xb0/0xb0 Aug 23 00:50:47 juju-e4d256-prod-github-runner-207 kernel: [70021.877111] __hrtimer_run_queues+0x107/0x230 Aug 23 00:50:47 juju-e4d256-prod-github-runner-207 kernel: [70021.877883] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 00:50:47 juju-e4d256-prod-github-runner-207 kernel: [70021.878663] hrtimer_interrupt+0x101/0x220 Aug 23 00:50:47 juju-e4d256-prod-github-runner-207 kernel: [70021.879419] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 00:50:47 juju-e4d256-prod-github-runner-207 kernel: [70021.880237] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 00:50:47 juju-e4d256-prod-github-runner-207 kernel: [70021.881037] Aug 23 00:50:47 juju-e4d256-prod-github-runner-207 kernel: [70021.881677] Aug 23 00:50:47 juju-e4d256-prod-github-runner-207 kernel: [70021.882307] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 00:50:47 juju-e4d256-prod-github-runner-207 kernel: [70021.883152] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:50:47 juju-e4d256-prod-github-runner-207 kernel: [70021.884033] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 00:50:47 juju-e4d256-prod-github-runner-207 kernel: [70021.886275] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 00:50:47 juju-e4d256-prod-github-runner-207 kernel: [70021.887168] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 00:50:47 juju-e4d256-prod-github-runner-207 kernel: [70021.888194] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 00:50:47 juju-e4d256-prod-github-runner-207 kernel: [70021.889173] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 00:50:47 juju-e4d256-prod-github-runner-207 kernel: [70021.890134] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 00:50:47 juju-e4d256-prod-github-runner-207 kernel: [70021.891092] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 00:50:47 juju-e4d256-prod-github-runner-207 kernel: [70021.892056] ? _raw_spin_lock+0x22/0x30 Aug 23 00:50:47 juju-e4d256-prod-github-runner-207 kernel: [70021.892817] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:50:47 juju-e4d256-prod-github-runner-207 kernel: [70021.893651] direct_page_fault+0x206/0x310 [kvm] Aug 23 00:50:47 juju-e4d256-prod-github-runner-207 kernel: [70021.894487] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 00:50:47 juju-e4d256-prod-github-runner-207 kernel: [70021.895316] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 00:50:47 juju-e4d256-prod-github-runner-207 kernel: [70021.896143] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 00:50:47 juju-e4d256-prod-github-runner-207 kernel: [70021.896947] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 00:50:47 juju-e4d256-prod-github-runner-207 kernel: [70021.897735] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 00:50:47 juju-e4d256-prod-github-runner-207 kernel: [70021.898556] handle_exit+0x98/0x230 [kvm_amd] Aug 23 00:50:47 juju-e4d256-prod-github-runner-207 kernel: [70021.899307] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 00:50:47 juju-e4d256-prod-github-runner-207 kernel: [70021.900093] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 00:50:47 juju-e4d256-prod-github-runner-207 kernel: [70021.900895] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 00:50:47 juju-e4d256-prod-github-runner-207 kernel: [70021.901677] vcpu_run+0x62/0x2c0 [kvm] Aug 23 00:50:47 juju-e4d256-prod-github-runner-207 kernel: [70021.902391] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 00:50:47 juju-e4d256-prod-github-runner-207 kernel: [70021.903124] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 00:50:47 juju-e4d256-prod-github-runner-207 kernel: [70021.903938] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 00:50:47 juju-e4d256-prod-github-runner-207 kernel: [70021.904699] ? __seccomp_filter+0x4a/0x4a0 Aug 23 00:50:47 juju-e4d256-prod-github-runner-207 kernel: [70021.905420] ? __fget_files+0x86/0xc0 Aug 23 00:50:47 juju-e4d256-prod-github-runner-207 kernel: [70021.906110] __x64_sys_ioctl+0x95/0xd0 Aug 23 00:50:47 juju-e4d256-prod-github-runner-207 kernel: [70021.906808] do_syscall_64+0x5c/0xc0 Aug 23 00:50:47 juju-e4d256-prod-github-runner-207 kernel: [70021.907488] ? do_futex+0x162/0x1f0 Aug 23 00:50:47 juju-e4d256-prod-github-runner-207 kernel: [70021.908169] ? __x64_sys_futex+0x78/0x1e0 Aug 23 00:50:47 juju-e4d256-prod-github-runner-207 kernel: [70021.908870] ? __secure_computing+0xa9/0x120 Aug 23 00:50:47 juju-e4d256-prod-github-runner-207 kernel: [70021.909584] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 00:50:47 juju-e4d256-prod-github-runner-207 kernel: [70021.910372] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:50:47 juju-e4d256-prod-github-runner-207 kernel: [70021.911124] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:50:47 juju-e4d256-prod-github-runner-207 kernel: [70021.912135] ? do_syscall_64+0x69/0xc0 Aug 23 00:50:47 juju-e4d256-prod-github-runner-207 kernel: [70021.912959] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:50:47 juju-e4d256-prod-github-runner-207 kernel: [70021.913806] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:50:47 juju-e4d256-prod-github-runner-207 kernel: [70021.914651] ? do_syscall_64+0x69/0xc0 Aug 23 00:50:47 juju-e4d256-prod-github-runner-207 kernel: [70021.915415] ? do_syscall_64+0x69/0xc0 Aug 23 00:50:47 juju-e4d256-prod-github-runner-207 kernel: [70021.916188] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 00:50:47 juju-e4d256-prod-github-runner-207 kernel: [70021.917049] RIP: 0033:0x7faa5d0edaff Aug 23 00:50:47 juju-e4d256-prod-github-runner-207 kernel: [70021.917800] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 00:50:47 juju-e4d256-prod-github-runner-207 kernel: [70021.920237] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 00:50:47 juju-e4d256-prod-github-runner-207 kernel: [70021.921336] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 00:50:47 juju-e4d256-prod-github-runner-207 kernel: [70021.922410] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 00:50:47 juju-e4d256-prod-github-runner-207 kernel: [70021.923493] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 00:50:47 juju-e4d256-prod-github-runner-207 kernel: [70021.924586] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 00:50:47 juju-e4d256-prod-github-runner-207 kernel: [70021.925643] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 00:50:47 juju-e4d256-prod-github-runner-207 kernel: [70021.926685] Aug 23 00:51:14 juju-e4d256-prod-github-runner-207 kernel: [70048.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 65129s! [qemu-system-x86:6715] Aug 23 00:51:14 juju-e4d256-prod-github-runner-207 kernel: [70048.543154] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 00:51:14 juju-e4d256-prod-github-runner-207 kernel: [70048.543223] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 00:51:14 juju-e4d256-prod-github-runner-207 kernel: [70048.555364] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 00:51:14 juju-e4d256-prod-github-runner-207 kernel: [70048.556631] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 00:51:14 juju-e4d256-prod-github-runner-207 kernel: [70048.557861] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:51:14 juju-e4d256-prod-github-runner-207 kernel: [70048.558922] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 00:51:14 juju-e4d256-prod-github-runner-207 kernel: [70048.561490] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 00:51:14 juju-e4d256-prod-github-runner-207 kernel: [70048.562616] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 00:51:14 juju-e4d256-prod-github-runner-207 kernel: [70048.563812] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 00:51:14 juju-e4d256-prod-github-runner-207 kernel: [70048.564981] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 00:51:14 juju-e4d256-prod-github-runner-207 kernel: [70048.566138] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 00:51:14 juju-e4d256-prod-github-runner-207 kernel: [70048.567450] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 00:51:14 juju-e4d256-prod-github-runner-207 kernel: [70048.568634] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 00:51:14 juju-e4d256-prod-github-runner-207 kernel: [70048.569876] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 00:51:14 juju-e4d256-prod-github-runner-207 kernel: [70048.571033] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 00:51:14 juju-e4d256-prod-github-runner-207 kernel: [70048.572252] Call Trace: Aug 23 00:51:14 juju-e4d256-prod-github-runner-207 kernel: [70048.573164] Aug 23 00:51:14 juju-e4d256-prod-github-runner-207 kernel: [70048.574077] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:51:14 juju-e4d256-prod-github-runner-207 kernel: [70048.575123] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:51:14 juju-e4d256-prod-github-runner-207 kernel: [70048.576162] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:51:14 juju-e4d256-prod-github-runner-207 kernel: [70048.577237] ? show_regs.part.0+0x23/0x29 Aug 23 00:51:14 juju-e4d256-prod-github-runner-207 kernel: [70048.578234] ? show_regs.cold+0x8/0xd Aug 23 00:51:14 juju-e4d256-prod-github-runner-207 kernel: [70048.579228] ? watchdog_timer_fn+0x1be/0x220 Aug 23 00:51:14 juju-e4d256-prod-github-runner-207 kernel: [70048.580260] ? lockup_detector_update_enable+0x60/0x60 Aug 23 00:51:14 juju-e4d256-prod-github-runner-207 kernel: [70048.581321] ? __hrtimer_run_queues+0x107/0x230 Aug 23 00:51:14 juju-e4d256-prod-github-runner-207 kernel: [70048.582349] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 00:51:14 juju-e4d256-prod-github-runner-207 kernel: [70048.583392] ? hrtimer_interrupt+0x101/0x220 Aug 23 00:51:14 juju-e4d256-prod-github-runner-207 kernel: [70048.584419] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 00:51:14 juju-e4d256-prod-github-runner-207 kernel: [70048.585490] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 00:51:14 juju-e4d256-prod-github-runner-207 kernel: [70048.586540] Aug 23 00:51:14 juju-e4d256-prod-github-runner-207 kernel: [70048.587417] Aug 23 00:51:14 juju-e4d256-prod-github-runner-207 kernel: [70048.588255] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 00:51:14 juju-e4d256-prod-github-runner-207 kernel: [70048.589295] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:51:14 juju-e4d256-prod-github-runner-207 kernel: [70048.590333] ? _raw_spin_lock+0x22/0x30 Aug 23 00:51:14 juju-e4d256-prod-github-runner-207 kernel: [70048.591292] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:51:14 juju-e4d256-prod-github-runner-207 kernel: [70048.592314] direct_page_fault+0x206/0x310 [kvm] Aug 23 00:51:14 juju-e4d256-prod-github-runner-207 kernel: [70048.593337] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 00:51:14 juju-e4d256-prod-github-runner-207 kernel: [70048.594358] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 00:51:14 juju-e4d256-prod-github-runner-207 kernel: [70048.595374] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 00:51:14 juju-e4d256-prod-github-runner-207 kernel: [70048.596342] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 00:51:14 juju-e4d256-prod-github-runner-207 kernel: [70048.597292] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 00:51:14 juju-e4d256-prod-github-runner-207 kernel: [70048.598271] handle_exit+0x98/0x230 [kvm_amd] Aug 23 00:51:14 juju-e4d256-prod-github-runner-207 kernel: [70048.599163] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 00:51:14 juju-e4d256-prod-github-runner-207 kernel: [70048.600099] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 00:51:14 juju-e4d256-prod-github-runner-207 kernel: [70048.601022] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 00:51:14 juju-e4d256-prod-github-runner-207 kernel: [70048.601923] vcpu_run+0x62/0x2c0 [kvm] Aug 23 00:51:14 juju-e4d256-prod-github-runner-207 kernel: [70048.602734] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 00:51:14 juju-e4d256-prod-github-runner-207 kernel: [70048.603560] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 00:51:14 juju-e4d256-prod-github-runner-207 kernel: [70048.604433] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 00:51:14 juju-e4d256-prod-github-runner-207 kernel: [70048.605233] ? __seccomp_filter+0x4a/0x4a0 Aug 23 00:51:14 juju-e4d256-prod-github-runner-207 kernel: [70048.605973] ? __fget_files+0x86/0xc0 Aug 23 00:51:14 juju-e4d256-prod-github-runner-207 kernel: [70048.606678] __x64_sys_ioctl+0x95/0xd0 Aug 23 00:51:14 juju-e4d256-prod-github-runner-207 kernel: [70048.607387] do_syscall_64+0x5c/0xc0 Aug 23 00:51:14 juju-e4d256-prod-github-runner-207 kernel: [70048.608056] ? do_futex+0x162/0x1f0 Aug 23 00:51:14 juju-e4d256-prod-github-runner-207 kernel: [70048.608705] ? __x64_sys_futex+0x78/0x1e0 Aug 23 00:51:14 juju-e4d256-prod-github-runner-207 kernel: [70048.609377] ? __secure_computing+0xa9/0x120 Aug 23 00:51:14 juju-e4d256-prod-github-runner-207 kernel: [70048.610072] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 00:51:14 juju-e4d256-prod-github-runner-207 kernel: [70048.610832] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:51:14 juju-e4d256-prod-github-runner-207 kernel: [70048.611566] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:51:14 juju-e4d256-prod-github-runner-207 kernel: [70048.612283] ? do_syscall_64+0x69/0xc0 Aug 23 00:51:14 juju-e4d256-prod-github-runner-207 kernel: [70048.612931] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:51:14 juju-e4d256-prod-github-runner-207 kernel: [70048.613632] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:51:14 juju-e4d256-prod-github-runner-207 kernel: [70048.614330] ? do_syscall_64+0x69/0xc0 Aug 23 00:51:14 juju-e4d256-prod-github-runner-207 kernel: [70048.614961] ? do_syscall_64+0x69/0xc0 Aug 23 00:51:14 juju-e4d256-prod-github-runner-207 kernel: [70048.615600] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 00:51:14 juju-e4d256-prod-github-runner-207 kernel: [70048.616305] RIP: 0033:0x7faa5d0edaff Aug 23 00:51:14 juju-e4d256-prod-github-runner-207 kernel: [70048.616934] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 00:51:14 juju-e4d256-prod-github-runner-207 kernel: [70048.618917] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 00:51:14 juju-e4d256-prod-github-runner-207 kernel: [70048.619844] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 00:51:14 juju-e4d256-prod-github-runner-207 kernel: [70048.620739] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 00:51:14 juju-e4d256-prod-github-runner-207 kernel: [70048.621625] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 00:51:14 juju-e4d256-prod-github-runner-207 kernel: [70048.622510] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 00:51:14 juju-e4d256-prod-github-runner-207 kernel: [70048.623412] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 00:51:14 juju-e4d256-prod-github-runner-207 kernel: [70048.624304] Aug 23 00:51:42 juju-e4d256-prod-github-runner-207 kernel: [70076.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 65155s! [qemu-system-x86:6715] Aug 23 00:51:42 juju-e4d256-prod-github-runner-207 kernel: [70076.543723] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 00:51:42 juju-e4d256-prod-github-runner-207 kernel: [70076.543981] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 00:51:42 juju-e4d256-prod-github-runner-207 kernel: [70076.556142] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 00:51:42 juju-e4d256-prod-github-runner-207 kernel: [70076.557412] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 00:51:42 juju-e4d256-prod-github-runner-207 kernel: [70076.558632] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:51:42 juju-e4d256-prod-github-runner-207 kernel: [70076.559697] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 00:51:42 juju-e4d256-prod-github-runner-207 kernel: [70076.562239] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 00:51:42 juju-e4d256-prod-github-runner-207 kernel: [70076.563316] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 00:51:42 juju-e4d256-prod-github-runner-207 kernel: [70076.564481] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 00:51:42 juju-e4d256-prod-github-runner-207 kernel: [70076.565638] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 00:51:42 juju-e4d256-prod-github-runner-207 kernel: [70076.566798] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 00:51:42 juju-e4d256-prod-github-runner-207 kernel: [70076.568014] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 00:51:42 juju-e4d256-prod-github-runner-207 kernel: [70076.569195] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 00:51:42 juju-e4d256-prod-github-runner-207 kernel: [70076.570424] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 00:51:42 juju-e4d256-prod-github-runner-207 kernel: [70076.571537] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 00:51:42 juju-e4d256-prod-github-runner-207 kernel: [70076.572731] Call Trace: Aug 23 00:51:42 juju-e4d256-prod-github-runner-207 kernel: [70076.573646] Aug 23 00:51:42 juju-e4d256-prod-github-runner-207 kernel: [70076.574539] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:51:42 juju-e4d256-prod-github-runner-207 kernel: [70076.575580] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:51:42 juju-e4d256-prod-github-runner-207 kernel: [70076.576599] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:51:42 juju-e4d256-prod-github-runner-207 kernel: [70076.577737] ? show_regs.part.0+0x23/0x29 Aug 23 00:51:42 juju-e4d256-prod-github-runner-207 kernel: [70076.578740] ? show_regs.cold+0x8/0xd Aug 23 00:51:42 juju-e4d256-prod-github-runner-207 kernel: [70076.579750] ? watchdog_timer_fn+0x1be/0x220 Aug 23 00:51:42 juju-e4d256-prod-github-runner-207 kernel: [70076.580767] ? lockup_detector_update_enable+0x60/0x60 Aug 23 00:51:42 juju-e4d256-prod-github-runner-207 kernel: [70076.581831] ? __hrtimer_run_queues+0x107/0x230 Aug 23 00:51:42 juju-e4d256-prod-github-runner-207 kernel: [70076.582862] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 00:51:42 juju-e4d256-prod-github-runner-207 kernel: [70076.583893] ? hrtimer_interrupt+0x101/0x220 Aug 23 00:51:42 juju-e4d256-prod-github-runner-207 kernel: [70076.584905] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 00:51:42 juju-e4d256-prod-github-runner-207 kernel: [70076.585982] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 00:51:42 juju-e4d256-prod-github-runner-207 kernel: [70076.587047] Aug 23 00:51:42 juju-e4d256-prod-github-runner-207 kernel: [70076.588042] Aug 23 00:51:42 juju-e4d256-prod-github-runner-207 kernel: [70076.588886] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 00:51:42 juju-e4d256-prod-github-runner-207 kernel: [70076.589926] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:51:42 juju-e4d256-prod-github-runner-207 kernel: [70076.590993] ? _raw_spin_lock+0x22/0x30 Aug 23 00:51:42 juju-e4d256-prod-github-runner-207 kernel: [70076.591953] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:51:42 juju-e4d256-prod-github-runner-207 kernel: [70076.592994] direct_page_fault+0x206/0x310 [kvm] Aug 23 00:51:42 juju-e4d256-prod-github-runner-207 kernel: [70076.594038] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 00:51:42 juju-e4d256-prod-github-runner-207 kernel: [70076.595084] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 00:51:42 juju-e4d256-prod-github-runner-207 kernel: [70076.596092] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 00:51:42 juju-e4d256-prod-github-runner-207 kernel: [70076.597098] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 00:51:42 juju-e4d256-prod-github-runner-207 kernel: [70076.598071] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 00:51:42 juju-e4d256-prod-github-runner-207 kernel: [70076.599074] handle_exit+0x98/0x230 [kvm_amd] Aug 23 00:51:42 juju-e4d256-prod-github-runner-207 kernel: [70076.599969] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 00:51:42 juju-e4d256-prod-github-runner-207 kernel: [70076.600880] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 00:51:42 juju-e4d256-prod-github-runner-207 kernel: [70076.601802] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 00:51:42 juju-e4d256-prod-github-runner-207 kernel: [70076.602703] vcpu_run+0x62/0x2c0 [kvm] Aug 23 00:51:42 juju-e4d256-prod-github-runner-207 kernel: [70076.603524] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 00:51:42 juju-e4d256-prod-github-runner-207 kernel: [70076.604335] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 00:51:42 juju-e4d256-prod-github-runner-207 kernel: [70076.605200] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 00:51:42 juju-e4d256-prod-github-runner-207 kernel: [70076.606009] ? __seccomp_filter+0x4a/0x4a0 Aug 23 00:51:42 juju-e4d256-prod-github-runner-207 kernel: [70076.606767] ? __fget_files+0x86/0xc0 Aug 23 00:51:42 juju-e4d256-prod-github-runner-207 kernel: [70076.607486] __x64_sys_ioctl+0x95/0xd0 Aug 23 00:51:42 juju-e4d256-prod-github-runner-207 kernel: [70076.608190] do_syscall_64+0x5c/0xc0 Aug 23 00:51:42 juju-e4d256-prod-github-runner-207 kernel: [70076.608859] ? do_futex+0x162/0x1f0 Aug 23 00:51:42 juju-e4d256-prod-github-runner-207 kernel: [70076.609681] ? __x64_sys_futex+0x78/0x1e0 Aug 23 00:51:42 juju-e4d256-prod-github-runner-207 kernel: [70076.610371] ? __secure_computing+0xa9/0x120 Aug 23 00:51:42 juju-e4d256-prod-github-runner-207 kernel: [70076.611084] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 00:51:42 juju-e4d256-prod-github-runner-207 kernel: [70076.611847] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:51:42 juju-e4d256-prod-github-runner-207 kernel: [70076.612578] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:51:42 juju-e4d256-prod-github-runner-207 kernel: [70076.613299] ? do_syscall_64+0x69/0xc0 Aug 23 00:51:42 juju-e4d256-prod-github-runner-207 kernel: [70076.613943] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:51:42 juju-e4d256-prod-github-runner-207 kernel: [70076.614643] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:51:42 juju-e4d256-prod-github-runner-207 kernel: [70076.615346] ? do_syscall_64+0x69/0xc0 Aug 23 00:51:42 juju-e4d256-prod-github-runner-207 kernel: [70076.615969] ? do_syscall_64+0x69/0xc0 Aug 23 00:51:42 juju-e4d256-prod-github-runner-207 kernel: [70076.616605] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 00:51:42 juju-e4d256-prod-github-runner-207 kernel: [70076.617317] RIP: 0033:0x7faa5d0edaff Aug 23 00:51:42 juju-e4d256-prod-github-runner-207 kernel: [70076.617974] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 00:51:42 juju-e4d256-prod-github-runner-207 kernel: [70076.620018] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 00:51:42 juju-e4d256-prod-github-runner-207 kernel: [70076.620933] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 00:51:42 juju-e4d256-prod-github-runner-207 kernel: [70076.621825] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 00:51:42 juju-e4d256-prod-github-runner-207 kernel: [70076.622731] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 00:51:42 juju-e4d256-prod-github-runner-207 kernel: [70076.623642] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 00:51:42 juju-e4d256-prod-github-runner-207 kernel: [70076.624527] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 00:51:42 juju-e4d256-prod-github-runner-207 kernel: [70076.625415] Aug 23 00:52:10 juju-e4d256-prod-github-runner-207 kernel: [70104.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 65181s! [qemu-system-x86:6715] Aug 23 00:52:10 juju-e4d256-prod-github-runner-207 kernel: [70104.543115] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 00:52:10 juju-e4d256-prod-github-runner-207 kernel: [70104.543188] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 00:52:10 juju-e4d256-prod-github-runner-207 kernel: [70104.555434] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 00:52:10 juju-e4d256-prod-github-runner-207 kernel: [70104.556703] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 00:52:10 juju-e4d256-prod-github-runner-207 kernel: [70104.557925] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:52:10 juju-e4d256-prod-github-runner-207 kernel: [70104.559022] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 00:52:10 juju-e4d256-prod-github-runner-207 kernel: [70104.561615] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 00:52:10 juju-e4d256-prod-github-runner-207 kernel: [70104.562673] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 00:52:10 juju-e4d256-prod-github-runner-207 kernel: [70104.563836] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 00:52:10 juju-e4d256-prod-github-runner-207 kernel: [70104.565018] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 00:52:10 juju-e4d256-prod-github-runner-207 kernel: [70104.566192] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 00:52:10 juju-e4d256-prod-github-runner-207 kernel: [70104.567379] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 00:52:10 juju-e4d256-prod-github-runner-207 kernel: [70104.568553] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 00:52:10 juju-e4d256-prod-github-runner-207 kernel: [70104.569840] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 00:52:10 juju-e4d256-prod-github-runner-207 kernel: [70104.571025] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 00:52:10 juju-e4d256-prod-github-runner-207 kernel: [70104.572235] Call Trace: Aug 23 00:52:10 juju-e4d256-prod-github-runner-207 kernel: [70104.573147] Aug 23 00:52:10 juju-e4d256-prod-github-runner-207 kernel: [70104.574033] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:52:10 juju-e4d256-prod-github-runner-207 kernel: [70104.575094] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:52:10 juju-e4d256-prod-github-runner-207 kernel: [70104.576142] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:52:10 juju-e4d256-prod-github-runner-207 kernel: [70104.577222] ? show_regs.part.0+0x23/0x29 Aug 23 00:52:10 juju-e4d256-prod-github-runner-207 kernel: [70104.578222] ? show_regs.cold+0x8/0xd Aug 23 00:52:10 juju-e4d256-prod-github-runner-207 kernel: [70104.579215] ? watchdog_timer_fn+0x1be/0x220 Aug 23 00:52:10 juju-e4d256-prod-github-runner-207 kernel: [70104.580260] ? lockup_detector_update_enable+0x60/0x60 Aug 23 00:52:10 juju-e4d256-prod-github-runner-207 kernel: [70104.581393] ? __hrtimer_run_queues+0x107/0x230 Aug 23 00:52:10 juju-e4d256-prod-github-runner-207 kernel: [70104.582432] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 00:52:10 juju-e4d256-prod-github-runner-207 kernel: [70104.583482] ? hrtimer_interrupt+0x101/0x220 Aug 23 00:52:10 juju-e4d256-prod-github-runner-207 kernel: [70104.584502] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 00:52:10 juju-e4d256-prod-github-runner-207 kernel: [70104.585594] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 00:52:10 juju-e4d256-prod-github-runner-207 kernel: [70104.586686] Aug 23 00:52:10 juju-e4d256-prod-github-runner-207 kernel: [70104.587543] Aug 23 00:52:10 juju-e4d256-prod-github-runner-207 kernel: [70104.588381] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 00:52:10 juju-e4d256-prod-github-runner-207 kernel: [70104.589419] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:52:10 juju-e4d256-prod-github-runner-207 kernel: [70104.590475] ? _raw_spin_lock+0x22/0x30 Aug 23 00:52:10 juju-e4d256-prod-github-runner-207 kernel: [70104.591483] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:52:10 juju-e4d256-prod-github-runner-207 kernel: [70104.592520] direct_page_fault+0x206/0x310 [kvm] Aug 23 00:52:10 juju-e4d256-prod-github-runner-207 kernel: [70104.593551] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 00:52:10 juju-e4d256-prod-github-runner-207 kernel: [70104.594563] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 00:52:10 juju-e4d256-prod-github-runner-207 kernel: [70104.595628] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 00:52:10 juju-e4d256-prod-github-runner-207 kernel: [70104.596626] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 00:52:10 juju-e4d256-prod-github-runner-207 kernel: [70104.597580] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 00:52:10 juju-e4d256-prod-github-runner-207 kernel: [70104.598561] handle_exit+0x98/0x230 [kvm_amd] Aug 23 00:52:10 juju-e4d256-prod-github-runner-207 kernel: [70104.599477] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 00:52:10 juju-e4d256-prod-github-runner-207 kernel: [70104.600409] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 00:52:10 juju-e4d256-prod-github-runner-207 kernel: [70104.601368] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 00:52:10 juju-e4d256-prod-github-runner-207 kernel: [70104.602290] vcpu_run+0x62/0x2c0 [kvm] Aug 23 00:52:10 juju-e4d256-prod-github-runner-207 kernel: [70104.603129] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 00:52:10 juju-e4d256-prod-github-runner-207 kernel: [70104.603943] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 00:52:10 juju-e4d256-prod-github-runner-207 kernel: [70104.604800] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 00:52:10 juju-e4d256-prod-github-runner-207 kernel: [70104.605627] ? __seccomp_filter+0x4a/0x4a0 Aug 23 00:52:10 juju-e4d256-prod-github-runner-207 kernel: [70104.606386] ? __fget_files+0x86/0xc0 Aug 23 00:52:10 juju-e4d256-prod-github-runner-207 kernel: [70104.607129] __x64_sys_ioctl+0x95/0xd0 Aug 23 00:52:10 juju-e4d256-prod-github-runner-207 kernel: [70104.607826] do_syscall_64+0x5c/0xc0 Aug 23 00:52:10 juju-e4d256-prod-github-runner-207 kernel: [70104.608499] ? do_futex+0x162/0x1f0 Aug 23 00:52:10 juju-e4d256-prod-github-runner-207 kernel: [70104.609151] ? __x64_sys_futex+0x78/0x1e0 Aug 23 00:52:10 juju-e4d256-prod-github-runner-207 kernel: [70104.609833] ? __secure_computing+0xa9/0x120 Aug 23 00:52:10 juju-e4d256-prod-github-runner-207 kernel: [70104.610527] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 00:52:10 juju-e4d256-prod-github-runner-207 kernel: [70104.611325] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:52:10 juju-e4d256-prod-github-runner-207 kernel: [70104.612085] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:52:10 juju-e4d256-prod-github-runner-207 kernel: [70104.612814] ? do_syscall_64+0x69/0xc0 Aug 23 00:52:10 juju-e4d256-prod-github-runner-207 kernel: [70104.613462] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:52:10 juju-e4d256-prod-github-runner-207 kernel: [70104.614167] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:52:10 juju-e4d256-prod-github-runner-207 kernel: [70104.614888] ? do_syscall_64+0x69/0xc0 Aug 23 00:52:10 juju-e4d256-prod-github-runner-207 kernel: [70104.615523] ? do_syscall_64+0x69/0xc0 Aug 23 00:52:10 juju-e4d256-prod-github-runner-207 kernel: [70104.616160] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 00:52:10 juju-e4d256-prod-github-runner-207 kernel: [70104.616884] RIP: 0033:0x7faa5d0edaff Aug 23 00:52:10 juju-e4d256-prod-github-runner-207 kernel: [70104.617519] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 00:52:10 juju-e4d256-prod-github-runner-207 kernel: [70104.619554] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 00:52:10 juju-e4d256-prod-github-runner-207 kernel: [70104.620516] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 00:52:10 juju-e4d256-prod-github-runner-207 kernel: [70104.621454] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 00:52:10 juju-e4d256-prod-github-runner-207 kernel: [70104.622392] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 00:52:10 juju-e4d256-prod-github-runner-207 kernel: [70104.623317] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 00:52:10 juju-e4d256-prod-github-runner-207 kernel: [70104.624214] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 00:52:10 juju-e4d256-prod-github-runner-207 kernel: [70104.625124] Aug 23 00:52:38 juju-e4d256-prod-github-runner-207 kernel: [70132.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 65208s! [qemu-system-x86:6715] Aug 23 00:52:38 juju-e4d256-prod-github-runner-207 kernel: [70132.543124] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 00:52:38 juju-e4d256-prod-github-runner-207 kernel: [70132.543195] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 00:52:38 juju-e4d256-prod-github-runner-207 kernel: [70132.555418] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 00:52:38 juju-e4d256-prod-github-runner-207 kernel: [70132.556697] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 00:52:38 juju-e4d256-prod-github-runner-207 kernel: [70132.557917] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:52:38 juju-e4d256-prod-github-runner-207 kernel: [70132.558987] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 00:52:38 juju-e4d256-prod-github-runner-207 kernel: [70132.561595] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 00:52:38 juju-e4d256-prod-github-runner-207 kernel: [70132.562658] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 00:52:38 juju-e4d256-prod-github-runner-207 kernel: [70132.563822] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 00:52:38 juju-e4d256-prod-github-runner-207 kernel: [70132.564994] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 00:52:38 juju-e4d256-prod-github-runner-207 kernel: [70132.566152] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 00:52:38 juju-e4d256-prod-github-runner-207 kernel: [70132.567349] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 00:52:38 juju-e4d256-prod-github-runner-207 kernel: [70132.568512] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 00:52:38 juju-e4d256-prod-github-runner-207 kernel: [70132.569754] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 00:52:38 juju-e4d256-prod-github-runner-207 kernel: [70132.570871] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 00:52:38 juju-e4d256-prod-github-runner-207 kernel: [70132.572067] Call Trace: Aug 23 00:52:38 juju-e4d256-prod-github-runner-207 kernel: [70132.572984] Aug 23 00:52:38 juju-e4d256-prod-github-runner-207 kernel: [70132.573872] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:52:38 juju-e4d256-prod-github-runner-207 kernel: [70132.574927] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:52:38 juju-e4d256-prod-github-runner-207 kernel: [70132.575958] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:52:38 juju-e4d256-prod-github-runner-207 kernel: [70132.577036] ? show_regs.part.0+0x23/0x29 Aug 23 00:52:38 juju-e4d256-prod-github-runner-207 kernel: [70132.578033] ? show_regs.cold+0x8/0xd Aug 23 00:52:38 juju-e4d256-prod-github-runner-207 kernel: [70132.579021] ? watchdog_timer_fn+0x1be/0x220 Aug 23 00:52:38 juju-e4d256-prod-github-runner-207 kernel: [70132.580036] ? lockup_detector_update_enable+0x60/0x60 Aug 23 00:52:38 juju-e4d256-prod-github-runner-207 kernel: [70132.581182] ? __hrtimer_run_queues+0x107/0x230 Aug 23 00:52:38 juju-e4d256-prod-github-runner-207 kernel: [70132.582214] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 00:52:38 juju-e4d256-prod-github-runner-207 kernel: [70132.583256] ? hrtimer_interrupt+0x101/0x220 Aug 23 00:52:38 juju-e4d256-prod-github-runner-207 kernel: [70132.584269] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 00:52:38 juju-e4d256-prod-github-runner-207 kernel: [70132.585374] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 00:52:38 juju-e4d256-prod-github-runner-207 kernel: [70132.586443] Aug 23 00:52:38 juju-e4d256-prod-github-runner-207 kernel: [70132.587302] Aug 23 00:52:38 juju-e4d256-prod-github-runner-207 kernel: [70132.588147] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 00:52:38 juju-e4d256-prod-github-runner-207 kernel: [70132.589177] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:52:38 juju-e4d256-prod-github-runner-207 kernel: [70132.590261] ? _raw_spin_lock+0x22/0x30 Aug 23 00:52:38 juju-e4d256-prod-github-runner-207 kernel: [70132.591243] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:52:38 juju-e4d256-prod-github-runner-207 kernel: [70132.592277] direct_page_fault+0x206/0x310 [kvm] Aug 23 00:52:38 juju-e4d256-prod-github-runner-207 kernel: [70132.593335] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 00:52:38 juju-e4d256-prod-github-runner-207 kernel: [70132.594504] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 00:52:38 juju-e4d256-prod-github-runner-207 kernel: [70132.595666] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 00:52:38 juju-e4d256-prod-github-runner-207 kernel: [70132.596665] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 00:52:38 juju-e4d256-prod-github-runner-207 kernel: [70132.597643] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 00:52:38 juju-e4d256-prod-github-runner-207 kernel: [70132.598628] handle_exit+0x98/0x230 [kvm_amd] Aug 23 00:52:38 juju-e4d256-prod-github-runner-207 kernel: [70132.599527] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 00:52:38 juju-e4d256-prod-github-runner-207 kernel: [70132.600450] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 00:52:38 juju-e4d256-prod-github-runner-207 kernel: [70132.601412] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 00:52:38 juju-e4d256-prod-github-runner-207 kernel: [70132.602327] vcpu_run+0x62/0x2c0 [kvm] Aug 23 00:52:38 juju-e4d256-prod-github-runner-207 kernel: [70132.603143] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 00:52:38 juju-e4d256-prod-github-runner-207 kernel: [70132.603955] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 00:52:38 juju-e4d256-prod-github-runner-207 kernel: [70132.604843] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 00:52:38 juju-e4d256-prod-github-runner-207 kernel: [70132.605640] ? __seccomp_filter+0x4a/0x4a0 Aug 23 00:52:38 juju-e4d256-prod-github-runner-207 kernel: [70132.606407] ? __fget_files+0x86/0xc0 Aug 23 00:52:38 juju-e4d256-prod-github-runner-207 kernel: [70132.607114] __x64_sys_ioctl+0x95/0xd0 Aug 23 00:52:38 juju-e4d256-prod-github-runner-207 kernel: [70132.607808] do_syscall_64+0x5c/0xc0 Aug 23 00:52:38 juju-e4d256-prod-github-runner-207 kernel: [70132.608472] ? do_futex+0x162/0x1f0 Aug 23 00:52:38 juju-e4d256-prod-github-runner-207 kernel: [70132.609121] ? __x64_sys_futex+0x78/0x1e0 Aug 23 00:52:38 juju-e4d256-prod-github-runner-207 kernel: [70132.609799] ? __secure_computing+0xa9/0x120 Aug 23 00:52:38 juju-e4d256-prod-github-runner-207 kernel: [70132.610503] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 00:52:38 juju-e4d256-prod-github-runner-207 kernel: [70132.611301] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:52:38 juju-e4d256-prod-github-runner-207 kernel: [70132.612023] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:52:38 juju-e4d256-prod-github-runner-207 kernel: [70132.612780] ? do_syscall_64+0x69/0xc0 Aug 23 00:52:38 juju-e4d256-prod-github-runner-207 kernel: [70132.613425] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:52:38 juju-e4d256-prod-github-runner-207 kernel: [70132.614126] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:52:38 juju-e4d256-prod-github-runner-207 kernel: [70132.614838] ? do_syscall_64+0x69/0xc0 Aug 23 00:52:38 juju-e4d256-prod-github-runner-207 kernel: [70132.615465] ? do_syscall_64+0x69/0xc0 Aug 23 00:52:38 juju-e4d256-prod-github-runner-207 kernel: [70132.616092] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 00:52:38 juju-e4d256-prod-github-runner-207 kernel: [70132.616937] RIP: 0033:0x7faa5d0edaff Aug 23 00:52:38 juju-e4d256-prod-github-runner-207 kernel: [70132.617646] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 00:52:38 juju-e4d256-prod-github-runner-207 kernel: [70132.620022] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 00:52:38 juju-e4d256-prod-github-runner-207 kernel: [70132.621075] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 00:52:38 juju-e4d256-prod-github-runner-207 kernel: [70132.622102] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 00:52:38 juju-e4d256-prod-github-runner-207 kernel: [70132.623144] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 00:52:38 juju-e4d256-prod-github-runner-207 kernel: [70132.624166] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 00:52:38 juju-e4d256-prod-github-runner-207 kernel: [70132.625226] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 00:52:38 juju-e4d256-prod-github-runner-207 kernel: [70132.626278] Aug 23 00:53:06 juju-e4d256-prod-github-runner-207 kernel: [70160.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 65234s! [qemu-system-x86:6715] Aug 23 00:53:06 juju-e4d256-prod-github-runner-207 kernel: [70160.543706] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 00:53:06 juju-e4d256-prod-github-runner-207 kernel: [70160.543936] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 00:53:06 juju-e4d256-prod-github-runner-207 kernel: [70160.556462] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 00:53:06 juju-e4d256-prod-github-runner-207 kernel: [70160.557750] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 00:53:06 juju-e4d256-prod-github-runner-207 kernel: [70160.558977] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:53:06 juju-e4d256-prod-github-runner-207 kernel: [70160.560041] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 00:53:06 juju-e4d256-prod-github-runner-207 kernel: [70160.562760] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 00:53:06 juju-e4d256-prod-github-runner-207 kernel: [70160.563804] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 00:53:06 juju-e4d256-prod-github-runner-207 kernel: [70160.564994] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 00:53:06 juju-e4d256-prod-github-runner-207 kernel: [70160.566212] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 00:53:06 juju-e4d256-prod-github-runner-207 kernel: [70160.567394] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 00:53:06 juju-e4d256-prod-github-runner-207 kernel: [70160.568556] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 00:53:06 juju-e4d256-prod-github-runner-207 kernel: [70160.569736] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 00:53:06 juju-e4d256-prod-github-runner-207 kernel: [70160.571046] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 00:53:06 juju-e4d256-prod-github-runner-207 kernel: [70160.572173] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 00:53:06 juju-e4d256-prod-github-runner-207 kernel: [70160.573387] Call Trace: Aug 23 00:53:06 juju-e4d256-prod-github-runner-207 kernel: [70160.574317] Aug 23 00:53:06 juju-e4d256-prod-github-runner-207 kernel: [70160.575226] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:53:06 juju-e4d256-prod-github-runner-207 kernel: [70160.576282] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:53:06 juju-e4d256-prod-github-runner-207 kernel: [70160.577350] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:53:06 juju-e4d256-prod-github-runner-207 kernel: [70160.578469] ? show_regs.part.0+0x23/0x29 Aug 23 00:53:06 juju-e4d256-prod-github-runner-207 kernel: [70160.579467] ? show_regs.cold+0x8/0xd Aug 23 00:53:06 juju-e4d256-prod-github-runner-207 kernel: [70160.580452] ? watchdog_timer_fn+0x1be/0x220 Aug 23 00:53:06 juju-e4d256-prod-github-runner-207 kernel: [70160.581481] ? lockup_detector_update_enable+0x60/0x60 Aug 23 00:53:06 juju-e4d256-prod-github-runner-207 kernel: [70160.582568] ? __hrtimer_run_queues+0x107/0x230 Aug 23 00:53:06 juju-e4d256-prod-github-runner-207 kernel: [70160.583596] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 00:53:06 juju-e4d256-prod-github-runner-207 kernel: [70160.584617] ? hrtimer_interrupt+0x101/0x220 Aug 23 00:53:06 juju-e4d256-prod-github-runner-207 kernel: [70160.585630] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 00:53:06 juju-e4d256-prod-github-runner-207 kernel: [70160.586730] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 00:53:06 juju-e4d256-prod-github-runner-207 kernel: [70160.587781] Aug 23 00:53:06 juju-e4d256-prod-github-runner-207 kernel: [70160.588633] Aug 23 00:53:06 juju-e4d256-prod-github-runner-207 kernel: [70160.589468] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 00:53:06 juju-e4d256-prod-github-runner-207 kernel: [70160.590518] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:53:06 juju-e4d256-prod-github-runner-207 kernel: [70160.591564] ? _raw_spin_lock+0x22/0x30 Aug 23 00:53:06 juju-e4d256-prod-github-runner-207 kernel: [70160.592519] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:53:06 juju-e4d256-prod-github-runner-207 kernel: [70160.593539] direct_page_fault+0x206/0x310 [kvm] Aug 23 00:53:06 juju-e4d256-prod-github-runner-207 kernel: [70160.594572] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 00:53:06 juju-e4d256-prod-github-runner-207 kernel: [70160.595581] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 00:53:06 juju-e4d256-prod-github-runner-207 kernel: [70160.596587] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 00:53:06 juju-e4d256-prod-github-runner-207 kernel: [70160.597602] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 00:53:06 juju-e4d256-prod-github-runner-207 kernel: [70160.598577] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 00:53:06 juju-e4d256-prod-github-runner-207 kernel: [70160.599560] handle_exit+0x98/0x230 [kvm_amd] Aug 23 00:53:06 juju-e4d256-prod-github-runner-207 kernel: [70160.600452] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 00:53:06 juju-e4d256-prod-github-runner-207 kernel: [70160.601371] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 00:53:06 juju-e4d256-prod-github-runner-207 kernel: [70160.602320] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 00:53:06 juju-e4d256-prod-github-runner-207 kernel: [70160.603231] vcpu_run+0x62/0x2c0 [kvm] Aug 23 00:53:06 juju-e4d256-prod-github-runner-207 kernel: [70160.604049] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 00:53:06 juju-e4d256-prod-github-runner-207 kernel: [70160.604857] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 00:53:06 juju-e4d256-prod-github-runner-207 kernel: [70160.605717] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 00:53:06 juju-e4d256-prod-github-runner-207 kernel: [70160.606539] ? __seccomp_filter+0x4a/0x4a0 Aug 23 00:53:06 juju-e4d256-prod-github-runner-207 kernel: [70160.607293] ? __fget_files+0x86/0xc0 Aug 23 00:53:06 juju-e4d256-prod-github-runner-207 kernel: [70160.608008] __x64_sys_ioctl+0x95/0xd0 Aug 23 00:53:06 juju-e4d256-prod-github-runner-207 kernel: [70160.608703] do_syscall_64+0x5c/0xc0 Aug 23 00:53:06 juju-e4d256-prod-github-runner-207 kernel: [70160.609369] ? do_futex+0x162/0x1f0 Aug 23 00:53:06 juju-e4d256-prod-github-runner-207 kernel: [70160.610032] ? __x64_sys_futex+0x78/0x1e0 Aug 23 00:53:06 juju-e4d256-prod-github-runner-207 kernel: [70160.610707] ? __secure_computing+0xa9/0x120 Aug 23 00:53:06 juju-e4d256-prod-github-runner-207 kernel: [70160.611397] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 00:53:06 juju-e4d256-prod-github-runner-207 kernel: [70160.612163] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:53:06 juju-e4d256-prod-github-runner-207 kernel: [70160.612891] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:53:06 juju-e4d256-prod-github-runner-207 kernel: [70160.613610] ? do_syscall_64+0x69/0xc0 Aug 23 00:53:06 juju-e4d256-prod-github-runner-207 kernel: [70160.614277] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:53:06 juju-e4d256-prod-github-runner-207 kernel: [70160.614981] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:53:06 juju-e4d256-prod-github-runner-207 kernel: [70160.615676] ? do_syscall_64+0x69/0xc0 Aug 23 00:53:06 juju-e4d256-prod-github-runner-207 kernel: [70160.616300] ? do_syscall_64+0x69/0xc0 Aug 23 00:53:06 juju-e4d256-prod-github-runner-207 kernel: [70160.616927] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 00:53:06 juju-e4d256-prod-github-runner-207 kernel: [70160.617634] RIP: 0033:0x7faa5d0edaff Aug 23 00:53:06 juju-e4d256-prod-github-runner-207 kernel: [70160.618327] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 00:53:06 juju-e4d256-prod-github-runner-207 kernel: [70160.620315] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 00:53:06 juju-e4d256-prod-github-runner-207 kernel: [70160.621228] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 00:53:06 juju-e4d256-prod-github-runner-207 kernel: [70160.622134] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 00:53:06 juju-e4d256-prod-github-runner-207 kernel: [70160.623034] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 00:53:06 juju-e4d256-prod-github-runner-207 kernel: [70160.623930] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 00:53:06 juju-e4d256-prod-github-runner-207 kernel: [70160.624818] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 00:53:06 juju-e4d256-prod-github-runner-207 kernel: [70160.625709] Aug 23 00:53:34 juju-e4d256-prod-github-runner-207 kernel: [70188.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 65260s! [qemu-system-x86:6715] Aug 23 00:53:34 juju-e4d256-prod-github-runner-207 kernel: [70188.543102] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 00:53:34 juju-e4d256-prod-github-runner-207 kernel: [70188.543170] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 00:53:34 juju-e4d256-prod-github-runner-207 kernel: [70188.555343] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 00:53:34 juju-e4d256-prod-github-runner-207 kernel: [70188.556619] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 00:53:34 juju-e4d256-prod-github-runner-207 kernel: [70188.557864] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:53:34 juju-e4d256-prod-github-runner-207 kernel: [70188.558929] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 00:53:34 juju-e4d256-prod-github-runner-207 kernel: [70188.561495] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 00:53:34 juju-e4d256-prod-github-runner-207 kernel: [70188.562567] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 00:53:34 juju-e4d256-prod-github-runner-207 kernel: [70188.563744] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 00:53:34 juju-e4d256-prod-github-runner-207 kernel: [70188.564926] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 00:53:34 juju-e4d256-prod-github-runner-207 kernel: [70188.566116] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 00:53:34 juju-e4d256-prod-github-runner-207 kernel: [70188.567297] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 00:53:34 juju-e4d256-prod-github-runner-207 kernel: [70188.568469] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 00:53:34 juju-e4d256-prod-github-runner-207 kernel: [70188.569873] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 00:53:34 juju-e4d256-prod-github-runner-207 kernel: [70188.570983] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 00:53:34 juju-e4d256-prod-github-runner-207 kernel: [70188.572194] Call Trace: Aug 23 00:53:34 juju-e4d256-prod-github-runner-207 kernel: [70188.573115] Aug 23 00:53:34 juju-e4d256-prod-github-runner-207 kernel: [70188.574021] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:53:34 juju-e4d256-prod-github-runner-207 kernel: [70188.575063] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:53:34 juju-e4d256-prod-github-runner-207 kernel: [70188.576124] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:53:34 juju-e4d256-prod-github-runner-207 kernel: [70188.577208] ? show_regs.part.0+0x23/0x29 Aug 23 00:53:34 juju-e4d256-prod-github-runner-207 kernel: [70188.578232] ? show_regs.cold+0x8/0xd Aug 23 00:53:34 juju-e4d256-prod-github-runner-207 kernel: [70188.579208] ? watchdog_timer_fn+0x1be/0x220 Aug 23 00:53:34 juju-e4d256-prod-github-runner-207 kernel: [70188.580228] ? lockup_detector_update_enable+0x60/0x60 Aug 23 00:53:34 juju-e4d256-prod-github-runner-207 kernel: [70188.581306] ? __hrtimer_run_queues+0x107/0x230 Aug 23 00:53:34 juju-e4d256-prod-github-runner-207 kernel: [70188.582351] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 00:53:34 juju-e4d256-prod-github-runner-207 kernel: [70188.583377] ? hrtimer_interrupt+0x101/0x220 Aug 23 00:53:34 juju-e4d256-prod-github-runner-207 kernel: [70188.584399] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 00:53:34 juju-e4d256-prod-github-runner-207 kernel: [70188.585485] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 00:53:34 juju-e4d256-prod-github-runner-207 kernel: [70188.586545] Aug 23 00:53:34 juju-e4d256-prod-github-runner-207 kernel: [70188.587399] Aug 23 00:53:34 juju-e4d256-prod-github-runner-207 kernel: [70188.588242] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 00:53:34 juju-e4d256-prod-github-runner-207 kernel: [70188.589281] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:53:34 juju-e4d256-prod-github-runner-207 kernel: [70188.590357] ? _raw_spin_lock+0x22/0x30 Aug 23 00:53:34 juju-e4d256-prod-github-runner-207 kernel: [70188.591320] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:53:34 juju-e4d256-prod-github-runner-207 kernel: [70188.592351] direct_page_fault+0x206/0x310 [kvm] Aug 23 00:53:34 juju-e4d256-prod-github-runner-207 kernel: [70188.593379] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 00:53:34 juju-e4d256-prod-github-runner-207 kernel: [70188.594417] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 00:53:34 juju-e4d256-prod-github-runner-207 kernel: [70188.595434] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 00:53:34 juju-e4d256-prod-github-runner-207 kernel: [70188.596420] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 00:53:34 juju-e4d256-prod-github-runner-207 kernel: [70188.597372] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 00:53:34 juju-e4d256-prod-github-runner-207 kernel: [70188.598373] handle_exit+0x98/0x230 [kvm_amd] Aug 23 00:53:34 juju-e4d256-prod-github-runner-207 kernel: [70188.599271] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 00:53:34 juju-e4d256-prod-github-runner-207 kernel: [70188.600207] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 00:53:34 juju-e4d256-prod-github-runner-207 kernel: [70188.601152] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 00:53:34 juju-e4d256-prod-github-runner-207 kernel: [70188.602076] vcpu_run+0x62/0x2c0 [kvm] Aug 23 00:53:34 juju-e4d256-prod-github-runner-207 kernel: [70188.602892] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 00:53:34 juju-e4d256-prod-github-runner-207 kernel: [70188.603703] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 00:53:34 juju-e4d256-prod-github-runner-207 kernel: [70188.604563] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 00:53:34 juju-e4d256-prod-github-runner-207 kernel: [70188.605374] ? __seccomp_filter+0x4a/0x4a0 Aug 23 00:53:34 juju-e4d256-prod-github-runner-207 kernel: [70188.606169] ? __fget_files+0x86/0xc0 Aug 23 00:53:34 juju-e4d256-prod-github-runner-207 kernel: [70188.606881] __x64_sys_ioctl+0x95/0xd0 Aug 23 00:53:34 juju-e4d256-prod-github-runner-207 kernel: [70188.607579] do_syscall_64+0x5c/0xc0 Aug 23 00:53:34 juju-e4d256-prod-github-runner-207 kernel: [70188.608253] ? do_futex+0x162/0x1f0 Aug 23 00:53:34 juju-e4d256-prod-github-runner-207 kernel: [70188.608907] ? __x64_sys_futex+0x78/0x1e0 Aug 23 00:53:34 juju-e4d256-prod-github-runner-207 kernel: [70188.609609] ? __secure_computing+0xa9/0x120 Aug 23 00:53:34 juju-e4d256-prod-github-runner-207 kernel: [70188.610327] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 00:53:34 juju-e4d256-prod-github-runner-207 kernel: [70188.611104] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:53:34 juju-e4d256-prod-github-runner-207 kernel: [70188.611850] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:53:34 juju-e4d256-prod-github-runner-207 kernel: [70188.612576] ? do_syscall_64+0x69/0xc0 Aug 23 00:53:34 juju-e4d256-prod-github-runner-207 kernel: [70188.613238] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:53:34 juju-e4d256-prod-github-runner-207 kernel: [70188.613983] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:53:34 juju-e4d256-prod-github-runner-207 kernel: [70188.614693] ? do_syscall_64+0x69/0xc0 Aug 23 00:53:34 juju-e4d256-prod-github-runner-207 kernel: [70188.615335] ? do_syscall_64+0x69/0xc0 Aug 23 00:53:34 juju-e4d256-prod-github-runner-207 kernel: [70188.615973] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 00:53:34 juju-e4d256-prod-github-runner-207 kernel: [70188.616692] RIP: 0033:0x7faa5d0edaff Aug 23 00:53:34 juju-e4d256-prod-github-runner-207 kernel: [70188.617326] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 00:53:34 juju-e4d256-prod-github-runner-207 kernel: [70188.619343] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 00:53:34 juju-e4d256-prod-github-runner-207 kernel: [70188.620258] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 00:53:34 juju-e4d256-prod-github-runner-207 kernel: [70188.621163] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 00:53:34 juju-e4d256-prod-github-runner-207 kernel: [70188.622098] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 00:53:34 juju-e4d256-prod-github-runner-207 kernel: [70188.622994] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 00:53:34 juju-e4d256-prod-github-runner-207 kernel: [70188.623890] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 00:53:34 juju-e4d256-prod-github-runner-207 kernel: [70188.624794] Aug 23 00:53:47 juju-e4d256-prod-github-runner-207 kernel: [70201.868707] rcu: INFO: rcu_sched self-detected stall on CPU Aug 23 00:53:47 juju-e4d256-prod-github-runner-207 kernel: [70201.869688] rcu: 1-....: (17465951 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=8434595 Aug 23 00:53:47 juju-e4d256-prod-github-runner-207 kernel: [70201.870819] (t=17521167 jiffies g=23269 q=60483) Aug 23 00:53:47 juju-e4d256-prod-github-runner-207 kernel: [70201.871607] NMI backtrace for cpu 1 Aug 23 00:53:47 juju-e4d256-prod-github-runner-207 kernel: [70201.872317] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 00:53:47 juju-e4d256-prod-github-runner-207 kernel: [70201.873427] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 00:53:47 juju-e4d256-prod-github-runner-207 kernel: [70201.874485] Call Trace: Aug 23 00:53:47 juju-e4d256-prod-github-runner-207 kernel: [70201.875160] Aug 23 00:53:47 juju-e4d256-prod-github-runner-207 kernel: [70201.875805] show_stack+0x52/0x5c Aug 23 00:53:47 juju-e4d256-prod-github-runner-207 kernel: [70201.876553] dump_stack_lvl+0x4a/0x63 Aug 23 00:53:47 juju-e4d256-prod-github-runner-207 kernel: [70201.877300] dump_stack+0x10/0x16 Aug 23 00:53:47 juju-e4d256-prod-github-runner-207 kernel: [70201.878034] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 23 00:53:47 juju-e4d256-prod-github-runner-207 kernel: [70201.878814] ? lapic_can_unplug_cpu+0x90/0x90 Aug 23 00:53:47 juju-e4d256-prod-github-runner-207 kernel: [70201.879592] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 23 00:53:47 juju-e4d256-prod-github-runner-207 kernel: [70201.880410] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 23 00:53:47 juju-e4d256-prod-github-runner-207 kernel: [70201.881229] trigger_single_cpu_backtrace+0x44/0x4f Aug 23 00:53:47 juju-e4d256-prod-github-runner-207 kernel: [70201.882042] rcu_dump_cpu_stacks+0x102/0x149 Aug 23 00:53:47 juju-e4d256-prod-github-runner-207 kernel: [70201.882814] print_cpu_stall.cold+0x2f/0xe2 Aug 23 00:53:47 juju-e4d256-prod-github-runner-207 kernel: [70201.883576] ? timekeeping_update+0xf7/0x150 Aug 23 00:53:47 juju-e4d256-prod-github-runner-207 kernel: [70201.884345] check_cpu_stall+0x109/0x270 Aug 23 00:53:47 juju-e4d256-prod-github-runner-207 kernel: [70201.885094] rcu_sched_clock_irq+0x9a/0x250 Aug 23 00:53:47 juju-e4d256-prod-github-runner-207 kernel: [70201.886023] update_process_times+0x94/0xd0 Aug 23 00:53:47 juju-e4d256-prod-github-runner-207 kernel: [70201.886916] tick_sched_handle+0x29/0x70 Aug 23 00:53:47 juju-e4d256-prod-github-runner-207 kernel: [70201.887660] tick_sched_timer+0x8c/0xc0 Aug 23 00:53:47 juju-e4d256-prod-github-runner-207 kernel: [70201.888395] ? tick_nohz_handler+0xb0/0xb0 Aug 23 00:53:47 juju-e4d256-prod-github-runner-207 kernel: [70201.889148] __hrtimer_run_queues+0x107/0x230 Aug 23 00:53:47 juju-e4d256-prod-github-runner-207 kernel: [70201.889925] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 00:53:47 juju-e4d256-prod-github-runner-207 kernel: [70201.890699] hrtimer_interrupt+0x101/0x220 Aug 23 00:53:47 juju-e4d256-prod-github-runner-207 kernel: [70201.891474] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 00:53:47 juju-e4d256-prod-github-runner-207 kernel: [70201.892287] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 00:53:47 juju-e4d256-prod-github-runner-207 kernel: [70201.893087] Aug 23 00:53:47 juju-e4d256-prod-github-runner-207 kernel: [70201.893736] Aug 23 00:53:47 juju-e4d256-prod-github-runner-207 kernel: [70201.894373] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 00:53:47 juju-e4d256-prod-github-runner-207 kernel: [70201.895189] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:53:47 juju-e4d256-prod-github-runner-207 kernel: [70201.896070] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 00:53:47 juju-e4d256-prod-github-runner-207 kernel: [70201.898287] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 00:53:47 juju-e4d256-prod-github-runner-207 kernel: [70201.899157] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 00:53:47 juju-e4d256-prod-github-runner-207 kernel: [70201.900145] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 00:53:47 juju-e4d256-prod-github-runner-207 kernel: [70201.901123] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 00:53:47 juju-e4d256-prod-github-runner-207 kernel: [70201.902095] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 00:53:47 juju-e4d256-prod-github-runner-207 kernel: [70201.903047] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 00:53:47 juju-e4d256-prod-github-runner-207 kernel: [70201.903994] ? _raw_spin_lock+0x22/0x30 Aug 23 00:53:47 juju-e4d256-prod-github-runner-207 kernel: [70201.904748] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:53:47 juju-e4d256-prod-github-runner-207 kernel: [70201.905590] direct_page_fault+0x206/0x310 [kvm] Aug 23 00:53:47 juju-e4d256-prod-github-runner-207 kernel: [70201.906425] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 00:53:47 juju-e4d256-prod-github-runner-207 kernel: [70201.907249] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 00:53:47 juju-e4d256-prod-github-runner-207 kernel: [70201.908067] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 00:53:47 juju-e4d256-prod-github-runner-207 kernel: [70201.908866] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 00:53:47 juju-e4d256-prod-github-runner-207 kernel: [70201.909663] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 00:53:47 juju-e4d256-prod-github-runner-207 kernel: [70201.910481] handle_exit+0x98/0x230 [kvm_amd] Aug 23 00:53:47 juju-e4d256-prod-github-runner-207 kernel: [70201.911232] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 00:53:47 juju-e4d256-prod-github-runner-207 kernel: [70201.912014] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 00:53:47 juju-e4d256-prod-github-runner-207 kernel: [70201.912809] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 00:53:47 juju-e4d256-prod-github-runner-207 kernel: [70201.913607] vcpu_run+0x62/0x2c0 [kvm] Aug 23 00:53:47 juju-e4d256-prod-github-runner-207 kernel: [70201.914321] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 00:53:47 juju-e4d256-prod-github-runner-207 kernel: [70201.915052] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 00:53:47 juju-e4d256-prod-github-runner-207 kernel: [70201.915856] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 00:53:47 juju-e4d256-prod-github-runner-207 kernel: [70201.916616] ? __seccomp_filter+0x4a/0x4a0 Aug 23 00:53:47 juju-e4d256-prod-github-runner-207 kernel: [70201.917340] ? __fget_files+0x86/0xc0 Aug 23 00:53:47 juju-e4d256-prod-github-runner-207 kernel: [70201.918040] __x64_sys_ioctl+0x95/0xd0 Aug 23 00:53:47 juju-e4d256-prod-github-runner-207 kernel: [70201.918732] do_syscall_64+0x5c/0xc0 Aug 23 00:53:47 juju-e4d256-prod-github-runner-207 kernel: [70201.919416] ? do_futex+0x162/0x1f0 Aug 23 00:53:47 juju-e4d256-prod-github-runner-207 kernel: [70201.920085] ? __x64_sys_futex+0x78/0x1e0 Aug 23 00:53:47 juju-e4d256-prod-github-runner-207 kernel: [70201.920784] ? __secure_computing+0xa9/0x120 Aug 23 00:53:47 juju-e4d256-prod-github-runner-207 kernel: [70201.921522] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 00:53:47 juju-e4d256-prod-github-runner-207 kernel: [70201.922311] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:53:47 juju-e4d256-prod-github-runner-207 kernel: [70201.923063] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:53:47 juju-e4d256-prod-github-runner-207 kernel: [70201.923818] ? do_syscall_64+0x69/0xc0 Aug 23 00:53:47 juju-e4d256-prod-github-runner-207 kernel: [70201.924507] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:53:47 juju-e4d256-prod-github-runner-207 kernel: [70201.925260] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:53:47 juju-e4d256-prod-github-runner-207 kernel: [70201.926035] ? do_syscall_64+0x69/0xc0 Aug 23 00:53:47 juju-e4d256-prod-github-runner-207 kernel: [70201.926732] ? do_syscall_64+0x69/0xc0 Aug 23 00:53:47 juju-e4d256-prod-github-runner-207 kernel: [70201.927417] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 00:53:47 juju-e4d256-prod-github-runner-207 kernel: [70201.928183] RIP: 0033:0x7faa5d0edaff Aug 23 00:53:47 juju-e4d256-prod-github-runner-207 kernel: [70201.928863] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 00:53:47 juju-e4d256-prod-github-runner-207 kernel: [70201.930959] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 00:53:47 juju-e4d256-prod-github-runner-207 kernel: [70201.931943] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 00:53:47 juju-e4d256-prod-github-runner-207 kernel: [70201.932910] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 00:53:47 juju-e4d256-prod-github-runner-207 kernel: [70201.933883] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 00:53:47 juju-e4d256-prod-github-runner-207 kernel: [70201.934997] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 00:53:47 juju-e4d256-prod-github-runner-207 kernel: [70201.936076] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 00:53:47 juju-e4d256-prod-github-runner-207 kernel: [70201.936990] Aug 23 00:54:14 juju-e4d256-prod-github-runner-207 kernel: [70228.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 65297s! [qemu-system-x86:6715] Aug 23 00:54:14 juju-e4d256-prod-github-runner-207 kernel: [70228.543146] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 00:54:14 juju-e4d256-prod-github-runner-207 kernel: [70228.543214] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 00:54:14 juju-e4d256-prod-github-runner-207 kernel: [70228.555286] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 00:54:14 juju-e4d256-prod-github-runner-207 kernel: [70228.556548] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 00:54:14 juju-e4d256-prod-github-runner-207 kernel: [70228.557793] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:54:14 juju-e4d256-prod-github-runner-207 kernel: [70228.558855] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 00:54:14 juju-e4d256-prod-github-runner-207 kernel: [70228.561551] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 00:54:14 juju-e4d256-prod-github-runner-207 kernel: [70228.562621] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 00:54:14 juju-e4d256-prod-github-runner-207 kernel: [70228.563785] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 00:54:14 juju-e4d256-prod-github-runner-207 kernel: [70228.564944] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 00:54:14 juju-e4d256-prod-github-runner-207 kernel: [70228.566123] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 00:54:14 juju-e4d256-prod-github-runner-207 kernel: [70228.567298] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 00:54:14 juju-e4d256-prod-github-runner-207 kernel: [70228.568459] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 00:54:14 juju-e4d256-prod-github-runner-207 kernel: [70228.569708] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 00:54:14 juju-e4d256-prod-github-runner-207 kernel: [70228.570802] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 00:54:14 juju-e4d256-prod-github-runner-207 kernel: [70228.571993] Call Trace: Aug 23 00:54:14 juju-e4d256-prod-github-runner-207 kernel: [70228.572902] Aug 23 00:54:14 juju-e4d256-prod-github-runner-207 kernel: [70228.573791] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:54:14 juju-e4d256-prod-github-runner-207 kernel: [70228.574820] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:54:14 juju-e4d256-prod-github-runner-207 kernel: [70228.575844] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:54:14 juju-e4d256-prod-github-runner-207 kernel: [70228.576915] ? show_regs.part.0+0x23/0x29 Aug 23 00:54:14 juju-e4d256-prod-github-runner-207 kernel: [70228.577929] ? show_regs.cold+0x8/0xd Aug 23 00:54:14 juju-e4d256-prod-github-runner-207 kernel: [70228.578903] ? watchdog_timer_fn+0x1be/0x220 Aug 23 00:54:14 juju-e4d256-prod-github-runner-207 kernel: [70228.579908] ? lockup_detector_update_enable+0x60/0x60 Aug 23 00:54:14 juju-e4d256-prod-github-runner-207 kernel: [70228.580967] ? __hrtimer_run_queues+0x107/0x230 Aug 23 00:54:14 juju-e4d256-prod-github-runner-207 kernel: [70228.582005] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 00:54:14 juju-e4d256-prod-github-runner-207 kernel: [70228.583057] ? hrtimer_interrupt+0x101/0x220 Aug 23 00:54:14 juju-e4d256-prod-github-runner-207 kernel: [70228.584393] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 00:54:14 juju-e4d256-prod-github-runner-207 kernel: [70228.585497] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 00:54:14 juju-e4d256-prod-github-runner-207 kernel: [70228.586551] Aug 23 00:54:14 juju-e4d256-prod-github-runner-207 kernel: [70228.587406] Aug 23 00:54:14 juju-e4d256-prod-github-runner-207 kernel: [70228.588243] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 00:54:14 juju-e4d256-prod-github-runner-207 kernel: [70228.589298] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:54:14 juju-e4d256-prod-github-runner-207 kernel: [70228.590341] ? _raw_spin_lock+0x22/0x30 Aug 23 00:54:14 juju-e4d256-prod-github-runner-207 kernel: [70228.591289] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:54:14 juju-e4d256-prod-github-runner-207 kernel: [70228.592331] direct_page_fault+0x206/0x310 [kvm] Aug 23 00:54:14 juju-e4d256-prod-github-runner-207 kernel: [70228.593388] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 00:54:14 juju-e4d256-prod-github-runner-207 kernel: [70228.594403] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 00:54:14 juju-e4d256-prod-github-runner-207 kernel: [70228.595419] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 00:54:14 juju-e4d256-prod-github-runner-207 kernel: [70228.596387] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 00:54:14 juju-e4d256-prod-github-runner-207 kernel: [70228.597348] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 00:54:14 juju-e4d256-prod-github-runner-207 kernel: [70228.598332] handle_exit+0x98/0x230 [kvm_amd] Aug 23 00:54:14 juju-e4d256-prod-github-runner-207 kernel: [70228.599222] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 00:54:14 juju-e4d256-prod-github-runner-207 kernel: [70228.600133] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 00:54:14 juju-e4d256-prod-github-runner-207 kernel: [70228.601061] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 00:54:14 juju-e4d256-prod-github-runner-207 kernel: [70228.601981] vcpu_run+0x62/0x2c0 [kvm] Aug 23 00:54:14 juju-e4d256-prod-github-runner-207 kernel: [70228.602790] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 00:54:14 juju-e4d256-prod-github-runner-207 kernel: [70228.603598] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 00:54:14 juju-e4d256-prod-github-runner-207 kernel: [70228.604450] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 00:54:14 juju-e4d256-prod-github-runner-207 kernel: [70228.605264] ? __seccomp_filter+0x4a/0x4a0 Aug 23 00:54:14 juju-e4d256-prod-github-runner-207 kernel: [70228.606017] ? __fget_files+0x86/0xc0 Aug 23 00:54:14 juju-e4d256-prod-github-runner-207 kernel: [70228.606720] __x64_sys_ioctl+0x95/0xd0 Aug 23 00:54:14 juju-e4d256-prod-github-runner-207 kernel: [70228.607412] do_syscall_64+0x5c/0xc0 Aug 23 00:54:14 juju-e4d256-prod-github-runner-207 kernel: [70228.608077] ? do_futex+0x162/0x1f0 Aug 23 00:54:14 juju-e4d256-prod-github-runner-207 kernel: [70228.608725] ? __x64_sys_futex+0x78/0x1e0 Aug 23 00:54:14 juju-e4d256-prod-github-runner-207 kernel: [70228.609413] ? __secure_computing+0xa9/0x120 Aug 23 00:54:14 juju-e4d256-prod-github-runner-207 kernel: [70228.610107] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 00:54:14 juju-e4d256-prod-github-runner-207 kernel: [70228.610867] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:54:14 juju-e4d256-prod-github-runner-207 kernel: [70228.611588] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:54:14 juju-e4d256-prod-github-runner-207 kernel: [70228.612309] ? do_syscall_64+0x69/0xc0 Aug 23 00:54:14 juju-e4d256-prod-github-runner-207 kernel: [70228.612953] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:54:14 juju-e4d256-prod-github-runner-207 kernel: [70228.613664] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:54:14 juju-e4d256-prod-github-runner-207 kernel: [70228.614358] ? do_syscall_64+0x69/0xc0 Aug 23 00:54:14 juju-e4d256-prod-github-runner-207 kernel: [70228.614983] ? do_syscall_64+0x69/0xc0 Aug 23 00:54:14 juju-e4d256-prod-github-runner-207 kernel: [70228.615604] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 00:54:14 juju-e4d256-prod-github-runner-207 kernel: [70228.616375] RIP: 0033:0x7faa5d0edaff Aug 23 00:54:14 juju-e4d256-prod-github-runner-207 kernel: [70228.617000] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 00:54:14 juju-e4d256-prod-github-runner-207 kernel: [70228.618994] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 00:54:14 juju-e4d256-prod-github-runner-207 kernel: [70228.619912] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 00:54:14 juju-e4d256-prod-github-runner-207 kernel: [70228.620802] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 00:54:14 juju-e4d256-prod-github-runner-207 kernel: [70228.621716] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 00:54:14 juju-e4d256-prod-github-runner-207 kernel: [70228.622622] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 00:54:14 juju-e4d256-prod-github-runner-207 kernel: [70228.623511] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 00:54:14 juju-e4d256-prod-github-runner-207 kernel: [70228.624405] Aug 23 00:54:42 juju-e4d256-prod-github-runner-207 kernel: [70256.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 65323s! [qemu-system-x86:6715] Aug 23 00:54:42 juju-e4d256-prod-github-runner-207 kernel: [70256.543665] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 00:54:42 juju-e4d256-prod-github-runner-207 kernel: [70256.543911] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 00:54:42 juju-e4d256-prod-github-runner-207 kernel: [70256.556041] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 00:54:42 juju-e4d256-prod-github-runner-207 kernel: [70256.557322] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 00:54:42 juju-e4d256-prod-github-runner-207 kernel: [70256.558542] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:54:42 juju-e4d256-prod-github-runner-207 kernel: [70256.559604] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 00:54:42 juju-e4d256-prod-github-runner-207 kernel: [70256.562174] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 00:54:42 juju-e4d256-prod-github-runner-207 kernel: [70256.563222] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 00:54:42 juju-e4d256-prod-github-runner-207 kernel: [70256.564383] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 00:54:42 juju-e4d256-prod-github-runner-207 kernel: [70256.565558] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 00:54:42 juju-e4d256-prod-github-runner-207 kernel: [70256.566752] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 00:54:42 juju-e4d256-prod-github-runner-207 kernel: [70256.567930] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 00:54:42 juju-e4d256-prod-github-runner-207 kernel: [70256.569166] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 00:54:42 juju-e4d256-prod-github-runner-207 kernel: [70256.570438] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 00:54:42 juju-e4d256-prod-github-runner-207 kernel: [70256.571548] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 00:54:42 juju-e4d256-prod-github-runner-207 kernel: [70256.572741] Call Trace: Aug 23 00:54:42 juju-e4d256-prod-github-runner-207 kernel: [70256.573671] Aug 23 00:54:42 juju-e4d256-prod-github-runner-207 kernel: [70256.574567] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:54:42 juju-e4d256-prod-github-runner-207 kernel: [70256.575602] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:54:42 juju-e4d256-prod-github-runner-207 kernel: [70256.576626] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:54:42 juju-e4d256-prod-github-runner-207 kernel: [70256.577730] ? show_regs.part.0+0x23/0x29 Aug 23 00:54:42 juju-e4d256-prod-github-runner-207 kernel: [70256.578725] ? show_regs.cold+0x8/0xd Aug 23 00:54:42 juju-e4d256-prod-github-runner-207 kernel: [70256.579694] ? watchdog_timer_fn+0x1be/0x220 Aug 23 00:54:42 juju-e4d256-prod-github-runner-207 kernel: [70256.580703] ? lockup_detector_update_enable+0x60/0x60 Aug 23 00:54:42 juju-e4d256-prod-github-runner-207 kernel: [70256.581781] ? __hrtimer_run_queues+0x107/0x230 Aug 23 00:54:42 juju-e4d256-prod-github-runner-207 kernel: [70256.582806] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 00:54:42 juju-e4d256-prod-github-runner-207 kernel: [70256.583826] ? hrtimer_interrupt+0x101/0x220 Aug 23 00:54:42 juju-e4d256-prod-github-runner-207 kernel: [70256.584862] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 00:54:42 juju-e4d256-prod-github-runner-207 kernel: [70256.585929] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 00:54:42 juju-e4d256-prod-github-runner-207 kernel: [70256.586978] Aug 23 00:54:42 juju-e4d256-prod-github-runner-207 kernel: [70256.587829] Aug 23 00:54:42 juju-e4d256-prod-github-runner-207 kernel: [70256.588670] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 00:54:42 juju-e4d256-prod-github-runner-207 kernel: [70256.589784] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:54:42 juju-e4d256-prod-github-runner-207 kernel: [70256.590827] ? _raw_spin_lock+0x22/0x30 Aug 23 00:54:42 juju-e4d256-prod-github-runner-207 kernel: [70256.591822] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:54:42 juju-e4d256-prod-github-runner-207 kernel: [70256.592866] direct_page_fault+0x206/0x310 [kvm] Aug 23 00:54:42 juju-e4d256-prod-github-runner-207 kernel: [70256.593891] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 00:54:42 juju-e4d256-prod-github-runner-207 kernel: [70256.594899] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 00:54:42 juju-e4d256-prod-github-runner-207 kernel: [70256.595902] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 00:54:42 juju-e4d256-prod-github-runner-207 kernel: [70256.596975] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 00:54:42 juju-e4d256-prod-github-runner-207 kernel: [70256.597919] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 00:54:42 juju-e4d256-prod-github-runner-207 kernel: [70256.598896] handle_exit+0x98/0x230 [kvm_amd] Aug 23 00:54:42 juju-e4d256-prod-github-runner-207 kernel: [70256.599786] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 00:54:42 juju-e4d256-prod-github-runner-207 kernel: [70256.600700] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 00:54:42 juju-e4d256-prod-github-runner-207 kernel: [70256.601637] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 00:54:42 juju-e4d256-prod-github-runner-207 kernel: [70256.602542] vcpu_run+0x62/0x2c0 [kvm] Aug 23 00:54:42 juju-e4d256-prod-github-runner-207 kernel: [70256.603351] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 00:54:42 juju-e4d256-prod-github-runner-207 kernel: [70256.604165] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 00:54:42 juju-e4d256-prod-github-runner-207 kernel: [70256.605182] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 00:54:42 juju-e4d256-prod-github-runner-207 kernel: [70256.605983] ? __seccomp_filter+0x4a/0x4a0 Aug 23 00:54:42 juju-e4d256-prod-github-runner-207 kernel: [70256.606728] ? __fget_files+0x86/0xc0 Aug 23 00:54:42 juju-e4d256-prod-github-runner-207 kernel: [70256.607441] __x64_sys_ioctl+0x95/0xd0 Aug 23 00:54:42 juju-e4d256-prod-github-runner-207 kernel: [70256.608135] do_syscall_64+0x5c/0xc0 Aug 23 00:54:42 juju-e4d256-prod-github-runner-207 kernel: [70256.608819] ? do_futex+0x162/0x1f0 Aug 23 00:54:42 juju-e4d256-prod-github-runner-207 kernel: [70256.609473] ? __x64_sys_futex+0x78/0x1e0 Aug 23 00:54:42 juju-e4d256-prod-github-runner-207 kernel: [70256.610148] ? __secure_computing+0xa9/0x120 Aug 23 00:54:42 juju-e4d256-prod-github-runner-207 kernel: [70256.610839] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 00:54:42 juju-e4d256-prod-github-runner-207 kernel: [70256.611602] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:54:42 juju-e4d256-prod-github-runner-207 kernel: [70256.612335] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:54:42 juju-e4d256-prod-github-runner-207 kernel: [70256.613068] ? do_syscall_64+0x69/0xc0 Aug 23 00:54:42 juju-e4d256-prod-github-runner-207 kernel: [70256.613716] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:54:42 juju-e4d256-prod-github-runner-207 kernel: [70256.614420] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:54:42 juju-e4d256-prod-github-runner-207 kernel: [70256.615118] ? do_syscall_64+0x69/0xc0 Aug 23 00:54:42 juju-e4d256-prod-github-runner-207 kernel: [70256.615743] ? do_syscall_64+0x69/0xc0 Aug 23 00:54:42 juju-e4d256-prod-github-runner-207 kernel: [70256.616379] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 00:54:42 juju-e4d256-prod-github-runner-207 kernel: [70256.617102] RIP: 0033:0x7faa5d0edaff Aug 23 00:54:42 juju-e4d256-prod-github-runner-207 kernel: [70256.617775] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 00:54:42 juju-e4d256-prod-github-runner-207 kernel: [70256.619774] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 00:54:42 juju-e4d256-prod-github-runner-207 kernel: [70256.620689] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 00:54:42 juju-e4d256-prod-github-runner-207 kernel: [70256.621601] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 00:54:42 juju-e4d256-prod-github-runner-207 kernel: [70256.622492] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 00:54:42 juju-e4d256-prod-github-runner-207 kernel: [70256.623388] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 00:54:42 juju-e4d256-prod-github-runner-207 kernel: [70256.624279] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 00:54:42 juju-e4d256-prod-github-runner-207 kernel: [70256.625191] Aug 23 00:55:10 juju-e4d256-prod-github-runner-207 kernel: [70284.541980] watchdog: BUG: soft lockup - CPU#1 stuck for 65349s! [qemu-system-x86:6715] Aug 23 00:55:10 juju-e4d256-prod-github-runner-207 kernel: [70284.543265] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 00:55:10 juju-e4d256-prod-github-runner-207 kernel: [70284.543331] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 00:55:10 juju-e4d256-prod-github-runner-207 kernel: [70284.556402] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 00:55:10 juju-e4d256-prod-github-runner-207 kernel: [70284.558144] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 00:55:10 juju-e4d256-prod-github-runner-207 kernel: [70284.559380] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:55:10 juju-e4d256-prod-github-runner-207 kernel: [70284.560478] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 00:55:10 juju-e4d256-prod-github-runner-207 kernel: [70284.563037] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 00:55:10 juju-e4d256-prod-github-runner-207 kernel: [70284.564085] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 00:55:10 juju-e4d256-prod-github-runner-207 kernel: [70284.565276] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 00:55:10 juju-e4d256-prod-github-runner-207 kernel: [70284.566438] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 00:55:10 juju-e4d256-prod-github-runner-207 kernel: [70284.567600] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 00:55:10 juju-e4d256-prod-github-runner-207 kernel: [70284.568792] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 00:55:10 juju-e4d256-prod-github-runner-207 kernel: [70284.569959] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 00:55:10 juju-e4d256-prod-github-runner-207 kernel: [70284.571194] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 00:55:10 juju-e4d256-prod-github-runner-207 kernel: [70284.572302] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 00:55:10 juju-e4d256-prod-github-runner-207 kernel: [70284.573521] Call Trace: Aug 23 00:55:10 juju-e4d256-prod-github-runner-207 kernel: [70284.574436] Aug 23 00:55:10 juju-e4d256-prod-github-runner-207 kernel: [70284.575321] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:55:10 juju-e4d256-prod-github-runner-207 kernel: [70284.576364] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:55:10 juju-e4d256-prod-github-runner-207 kernel: [70284.577421] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:55:10 juju-e4d256-prod-github-runner-207 kernel: [70284.578527] ? show_regs.part.0+0x23/0x29 Aug 23 00:55:10 juju-e4d256-prod-github-runner-207 kernel: [70284.579527] ? show_regs.cold+0x8/0xd Aug 23 00:55:10 juju-e4d256-prod-github-runner-207 kernel: [70284.580520] ? watchdog_timer_fn+0x1be/0x220 Aug 23 00:55:10 juju-e4d256-prod-github-runner-207 kernel: [70284.581670] ? lockup_detector_update_enable+0x60/0x60 Aug 23 00:55:10 juju-e4d256-prod-github-runner-207 kernel: [70284.582907] ? __hrtimer_run_queues+0x107/0x230 Aug 23 00:55:10 juju-e4d256-prod-github-runner-207 kernel: [70284.583953] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 00:55:10 juju-e4d256-prod-github-runner-207 kernel: [70284.585001] ? hrtimer_interrupt+0x101/0x220 Aug 23 00:55:10 juju-e4d256-prod-github-runner-207 kernel: [70284.586018] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 00:55:10 juju-e4d256-prod-github-runner-207 kernel: [70284.587092] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 00:55:10 juju-e4d256-prod-github-runner-207 kernel: [70284.588145] Aug 23 00:55:10 juju-e4d256-prod-github-runner-207 kernel: [70284.589069] Aug 23 00:55:10 juju-e4d256-prod-github-runner-207 kernel: [70284.590096] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 00:55:10 juju-e4d256-prod-github-runner-207 kernel: [70284.591132] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:55:10 juju-e4d256-prod-github-runner-207 kernel: [70284.592196] ? _raw_spin_lock+0x22/0x30 Aug 23 00:55:10 juju-e4d256-prod-github-runner-207 kernel: [70284.593181] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:55:10 juju-e4d256-prod-github-runner-207 kernel: [70284.594201] direct_page_fault+0x206/0x310 [kvm] Aug 23 00:55:10 juju-e4d256-prod-github-runner-207 kernel: [70284.595222] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 00:55:10 juju-e4d256-prod-github-runner-207 kernel: [70284.596229] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 00:55:10 juju-e4d256-prod-github-runner-207 kernel: [70284.597252] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 00:55:10 juju-e4d256-prod-github-runner-207 kernel: [70284.598220] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 00:55:10 juju-e4d256-prod-github-runner-207 kernel: [70284.599166] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 00:55:10 juju-e4d256-prod-github-runner-207 kernel: [70284.600145] handle_exit+0x98/0x230 [kvm_amd] Aug 23 00:55:10 juju-e4d256-prod-github-runner-207 kernel: [70284.601056] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 00:55:10 juju-e4d256-prod-github-runner-207 kernel: [70284.601973] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 00:55:10 juju-e4d256-prod-github-runner-207 kernel: [70284.602905] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 00:55:10 juju-e4d256-prod-github-runner-207 kernel: [70284.603823] vcpu_run+0x62/0x2c0 [kvm] Aug 23 00:55:10 juju-e4d256-prod-github-runner-207 kernel: [70284.604653] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 00:55:10 juju-e4d256-prod-github-runner-207 kernel: [70284.605628] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 00:55:10 juju-e4d256-prod-github-runner-207 kernel: [70284.606558] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 00:55:10 juju-e4d256-prod-github-runner-207 kernel: [70284.607357] ? __seccomp_filter+0x4a/0x4a0 Aug 23 00:55:10 juju-e4d256-prod-github-runner-207 kernel: [70284.608100] ? __fget_files+0x86/0xc0 Aug 23 00:55:10 juju-e4d256-prod-github-runner-207 kernel: [70284.608838] __x64_sys_ioctl+0x95/0xd0 Aug 23 00:55:10 juju-e4d256-prod-github-runner-207 kernel: [70284.609533] do_syscall_64+0x5c/0xc0 Aug 23 00:55:10 juju-e4d256-prod-github-runner-207 kernel: [70284.610197] ? do_futex+0x162/0x1f0 Aug 23 00:55:10 juju-e4d256-prod-github-runner-207 kernel: [70284.610845] ? __x64_sys_futex+0x78/0x1e0 Aug 23 00:55:10 juju-e4d256-prod-github-runner-207 kernel: [70284.611517] ? __secure_computing+0xa9/0x120 Aug 23 00:55:10 juju-e4d256-prod-github-runner-207 kernel: [70284.612206] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 00:55:10 juju-e4d256-prod-github-runner-207 kernel: [70284.612991] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:55:10 juju-e4d256-prod-github-runner-207 kernel: [70284.613713] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:55:10 juju-e4d256-prod-github-runner-207 kernel: [70284.614434] ? do_syscall_64+0x69/0xc0 Aug 23 00:55:10 juju-e4d256-prod-github-runner-207 kernel: [70284.615080] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:55:10 juju-e4d256-prod-github-runner-207 kernel: [70284.615783] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:55:10 juju-e4d256-prod-github-runner-207 kernel: [70284.616511] ? do_syscall_64+0x69/0xc0 Aug 23 00:55:10 juju-e4d256-prod-github-runner-207 kernel: [70284.617144] ? do_syscall_64+0x69/0xc0 Aug 23 00:55:10 juju-e4d256-prod-github-runner-207 kernel: [70284.617769] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 00:55:10 juju-e4d256-prod-github-runner-207 kernel: [70284.618476] RIP: 0033:0x7faa5d0edaff Aug 23 00:55:10 juju-e4d256-prod-github-runner-207 kernel: [70284.619103] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 00:55:10 juju-e4d256-prod-github-runner-207 kernel: [70284.621108] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 00:55:10 juju-e4d256-prod-github-runner-207 kernel: [70284.622024] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 00:55:10 juju-e4d256-prod-github-runner-207 kernel: [70284.622916] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 00:55:10 juju-e4d256-prod-github-runner-207 kernel: [70284.623807] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 00:55:10 juju-e4d256-prod-github-runner-207 kernel: [70284.624726] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 00:55:10 juju-e4d256-prod-github-runner-207 kernel: [70284.625619] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 00:55:10 juju-e4d256-prod-github-runner-207 kernel: [70284.626512] Aug 23 00:55:38 juju-e4d256-prod-github-runner-207 kernel: [70312.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 65375s! [qemu-system-x86:6715] Aug 23 00:55:38 juju-e4d256-prod-github-runner-207 kernel: [70312.543094] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 00:55:38 juju-e4d256-prod-github-runner-207 kernel: [70312.543162] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 00:55:38 juju-e4d256-prod-github-runner-207 kernel: [70312.555389] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 00:55:38 juju-e4d256-prod-github-runner-207 kernel: [70312.556667] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 00:55:38 juju-e4d256-prod-github-runner-207 kernel: [70312.557891] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:55:38 juju-e4d256-prod-github-runner-207 kernel: [70312.558951] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 00:55:38 juju-e4d256-prod-github-runner-207 kernel: [70312.561513] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 00:55:38 juju-e4d256-prod-github-runner-207 kernel: [70312.562561] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 00:55:38 juju-e4d256-prod-github-runner-207 kernel: [70312.563723] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 00:55:38 juju-e4d256-prod-github-runner-207 kernel: [70312.564910] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 00:55:38 juju-e4d256-prod-github-runner-207 kernel: [70312.566158] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 00:55:38 juju-e4d256-prod-github-runner-207 kernel: [70312.567367] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 00:55:38 juju-e4d256-prod-github-runner-207 kernel: [70312.568625] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 00:55:38 juju-e4d256-prod-github-runner-207 kernel: [70312.569862] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 00:55:38 juju-e4d256-prod-github-runner-207 kernel: [70312.570960] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 00:55:38 juju-e4d256-prod-github-runner-207 kernel: [70312.572166] Call Trace: Aug 23 00:55:38 juju-e4d256-prod-github-runner-207 kernel: [70312.573078] Aug 23 00:55:38 juju-e4d256-prod-github-runner-207 kernel: [70312.573960] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:55:38 juju-e4d256-prod-github-runner-207 kernel: [70312.574988] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:55:38 juju-e4d256-prod-github-runner-207 kernel: [70312.576045] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:55:38 juju-e4d256-prod-github-runner-207 kernel: [70312.577139] ? show_regs.part.0+0x23/0x29 Aug 23 00:55:38 juju-e4d256-prod-github-runner-207 kernel: [70312.578136] ? show_regs.cold+0x8/0xd Aug 23 00:55:38 juju-e4d256-prod-github-runner-207 kernel: [70312.579105] ? watchdog_timer_fn+0x1be/0x220 Aug 23 00:55:38 juju-e4d256-prod-github-runner-207 kernel: [70312.580124] ? lockup_detector_update_enable+0x60/0x60 Aug 23 00:55:38 juju-e4d256-prod-github-runner-207 kernel: [70312.581190] ? __hrtimer_run_queues+0x107/0x230 Aug 23 00:55:38 juju-e4d256-prod-github-runner-207 kernel: [70312.582217] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 00:55:38 juju-e4d256-prod-github-runner-207 kernel: [70312.583240] ? hrtimer_interrupt+0x101/0x220 Aug 23 00:55:38 juju-e4d256-prod-github-runner-207 kernel: [70312.584274] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 00:55:38 juju-e4d256-prod-github-runner-207 kernel: [70312.585341] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 00:55:38 juju-e4d256-prod-github-runner-207 kernel: [70312.586386] Aug 23 00:55:38 juju-e4d256-prod-github-runner-207 kernel: [70312.587238] Aug 23 00:55:38 juju-e4d256-prod-github-runner-207 kernel: [70312.588075] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 00:55:38 juju-e4d256-prod-github-runner-207 kernel: [70312.589120] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:55:38 juju-e4d256-prod-github-runner-207 kernel: [70312.590157] ? _raw_spin_lock+0x22/0x30 Aug 23 00:55:38 juju-e4d256-prod-github-runner-207 kernel: [70312.591101] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:55:38 juju-e4d256-prod-github-runner-207 kernel: [70312.592131] direct_page_fault+0x206/0x310 [kvm] Aug 23 00:55:38 juju-e4d256-prod-github-runner-207 kernel: [70312.593162] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 00:55:38 juju-e4d256-prod-github-runner-207 kernel: [70312.594170] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 00:55:38 juju-e4d256-prod-github-runner-207 kernel: [70312.595169] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 00:55:38 juju-e4d256-prod-github-runner-207 kernel: [70312.596160] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 00:55:38 juju-e4d256-prod-github-runner-207 kernel: [70312.597105] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 00:55:38 juju-e4d256-prod-github-runner-207 kernel: [70312.598167] handle_exit+0x98/0x230 [kvm_amd] Aug 23 00:55:38 juju-e4d256-prod-github-runner-207 kernel: [70312.599073] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 00:55:38 juju-e4d256-prod-github-runner-207 kernel: [70312.599986] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 00:55:38 juju-e4d256-prod-github-runner-207 kernel: [70312.600923] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 00:55:38 juju-e4d256-prod-github-runner-207 kernel: [70312.601827] vcpu_run+0x62/0x2c0 [kvm] Aug 23 00:55:38 juju-e4d256-prod-github-runner-207 kernel: [70312.602640] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 00:55:38 juju-e4d256-prod-github-runner-207 kernel: [70312.603446] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 00:55:38 juju-e4d256-prod-github-runner-207 kernel: [70312.604308] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 00:55:38 juju-e4d256-prod-github-runner-207 kernel: [70312.605111] ? __seccomp_filter+0x4a/0x4a0 Aug 23 00:55:38 juju-e4d256-prod-github-runner-207 kernel: [70312.605853] ? __fget_files+0x86/0xc0 Aug 23 00:55:38 juju-e4d256-prod-github-runner-207 kernel: [70312.606554] __x64_sys_ioctl+0x95/0xd0 Aug 23 00:55:38 juju-e4d256-prod-github-runner-207 kernel: [70312.607244] do_syscall_64+0x5c/0xc0 Aug 23 00:55:38 juju-e4d256-prod-github-runner-207 kernel: [70312.607915] ? do_futex+0x162/0x1f0 Aug 23 00:55:38 juju-e4d256-prod-github-runner-207 kernel: [70312.608576] ? __x64_sys_futex+0x78/0x1e0 Aug 23 00:55:38 juju-e4d256-prod-github-runner-207 kernel: [70312.609250] ? __secure_computing+0xa9/0x120 Aug 23 00:55:38 juju-e4d256-prod-github-runner-207 kernel: [70312.609938] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 00:55:38 juju-e4d256-prod-github-runner-207 kernel: [70312.610700] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:55:38 juju-e4d256-prod-github-runner-207 kernel: [70312.611453] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:55:38 juju-e4d256-prod-github-runner-207 kernel: [70312.612206] ? do_syscall_64+0x69/0xc0 Aug 23 00:55:38 juju-e4d256-prod-github-runner-207 kernel: [70312.612851] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:55:38 juju-e4d256-prod-github-runner-207 kernel: [70312.613553] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:55:38 juju-e4d256-prod-github-runner-207 kernel: [70312.614251] ? do_syscall_64+0x69/0xc0 Aug 23 00:55:38 juju-e4d256-prod-github-runner-207 kernel: [70312.614874] ? do_syscall_64+0x69/0xc0 Aug 23 00:55:38 juju-e4d256-prod-github-runner-207 kernel: [70312.615495] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 00:55:38 juju-e4d256-prod-github-runner-207 kernel: [70312.616219] RIP: 0033:0x7faa5d0edaff Aug 23 00:55:38 juju-e4d256-prod-github-runner-207 kernel: [70312.616844] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 00:55:38 juju-e4d256-prod-github-runner-207 kernel: [70312.618829] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 00:55:38 juju-e4d256-prod-github-runner-207 kernel: [70312.619737] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 00:55:38 juju-e4d256-prod-github-runner-207 kernel: [70312.620639] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 00:55:38 juju-e4d256-prod-github-runner-207 kernel: [70312.621532] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 00:55:38 juju-e4d256-prod-github-runner-207 kernel: [70312.622460] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 00:55:38 juju-e4d256-prod-github-runner-207 kernel: [70312.623364] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 00:55:38 juju-e4d256-prod-github-runner-207 kernel: [70312.624277] Aug 23 00:56:06 juju-e4d256-prod-github-runner-207 kernel: [70340.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 65401s! [qemu-system-x86:6715] Aug 23 00:56:06 juju-e4d256-prod-github-runner-207 kernel: [70340.543721] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 00:56:06 juju-e4d256-prod-github-runner-207 kernel: [70340.543995] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 00:56:06 juju-e4d256-prod-github-runner-207 kernel: [70340.556096] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 00:56:06 juju-e4d256-prod-github-runner-207 kernel: [70340.557364] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 00:56:06 juju-e4d256-prod-github-runner-207 kernel: [70340.558588] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:56:06 juju-e4d256-prod-github-runner-207 kernel: [70340.559650] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 00:56:06 juju-e4d256-prod-github-runner-207 kernel: [70340.562353] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 00:56:06 juju-e4d256-prod-github-runner-207 kernel: [70340.563396] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 00:56:06 juju-e4d256-prod-github-runner-207 kernel: [70340.564576] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 00:56:06 juju-e4d256-prod-github-runner-207 kernel: [70340.565734] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 00:56:06 juju-e4d256-prod-github-runner-207 kernel: [70340.566892] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 00:56:06 juju-e4d256-prod-github-runner-207 kernel: [70340.568066] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 00:56:06 juju-e4d256-prod-github-runner-207 kernel: [70340.569231] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 00:56:06 juju-e4d256-prod-github-runner-207 kernel: [70340.570465] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 00:56:06 juju-e4d256-prod-github-runner-207 kernel: [70340.571568] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 00:56:06 juju-e4d256-prod-github-runner-207 kernel: [70340.572776] Call Trace: Aug 23 00:56:06 juju-e4d256-prod-github-runner-207 kernel: [70340.573699] Aug 23 00:56:06 juju-e4d256-prod-github-runner-207 kernel: [70340.574593] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:56:06 juju-e4d256-prod-github-runner-207 kernel: [70340.575625] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:56:06 juju-e4d256-prod-github-runner-207 kernel: [70340.576665] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:56:06 juju-e4d256-prod-github-runner-207 kernel: [70340.577758] ? show_regs.part.0+0x23/0x29 Aug 23 00:56:06 juju-e4d256-prod-github-runner-207 kernel: [70340.578757] ? show_regs.cold+0x8/0xd Aug 23 00:56:06 juju-e4d256-prod-github-runner-207 kernel: [70340.579735] ? watchdog_timer_fn+0x1be/0x220 Aug 23 00:56:06 juju-e4d256-prod-github-runner-207 kernel: [70340.580757] ? lockup_detector_update_enable+0x60/0x60 Aug 23 00:56:06 juju-e4d256-prod-github-runner-207 kernel: [70340.581819] ? __hrtimer_run_queues+0x107/0x230 Aug 23 00:56:06 juju-e4d256-prod-github-runner-207 kernel: [70340.582851] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 00:56:06 juju-e4d256-prod-github-runner-207 kernel: [70340.583893] ? hrtimer_interrupt+0x101/0x220 Aug 23 00:56:06 juju-e4d256-prod-github-runner-207 kernel: [70340.584909] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 00:56:06 juju-e4d256-prod-github-runner-207 kernel: [70340.585979] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 00:56:06 juju-e4d256-prod-github-runner-207 kernel: [70340.587023] Aug 23 00:56:06 juju-e4d256-prod-github-runner-207 kernel: [70340.587893] Aug 23 00:56:06 juju-e4d256-prod-github-runner-207 kernel: [70340.588736] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 00:56:06 juju-e4d256-prod-github-runner-207 kernel: [70340.589772] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:56:06 juju-e4d256-prod-github-runner-207 kernel: [70340.590811] ? _raw_spin_lock+0x22/0x30 Aug 23 00:56:06 juju-e4d256-prod-github-runner-207 kernel: [70340.591770] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:56:06 juju-e4d256-prod-github-runner-207 kernel: [70340.592787] direct_page_fault+0x206/0x310 [kvm] Aug 23 00:56:06 juju-e4d256-prod-github-runner-207 kernel: [70340.593826] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 00:56:06 juju-e4d256-prod-github-runner-207 kernel: [70340.594835] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 00:56:06 juju-e4d256-prod-github-runner-207 kernel: [70340.595856] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 00:56:06 juju-e4d256-prod-github-runner-207 kernel: [70340.596856] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 00:56:06 juju-e4d256-prod-github-runner-207 kernel: [70340.597800] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 00:56:06 juju-e4d256-prod-github-runner-207 kernel: [70340.598777] handle_exit+0x98/0x230 [kvm_amd] Aug 23 00:56:06 juju-e4d256-prod-github-runner-207 kernel: [70340.599669] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 00:56:06 juju-e4d256-prod-github-runner-207 kernel: [70340.600597] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 00:56:06 juju-e4d256-prod-github-runner-207 kernel: [70340.601521] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 00:56:06 juju-e4d256-prod-github-runner-207 kernel: [70340.602423] vcpu_run+0x62/0x2c0 [kvm] Aug 23 00:56:06 juju-e4d256-prod-github-runner-207 kernel: [70340.603237] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 00:56:06 juju-e4d256-prod-github-runner-207 kernel: [70340.604064] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 00:56:06 juju-e4d256-prod-github-runner-207 kernel: [70340.604918] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 00:56:06 juju-e4d256-prod-github-runner-207 kernel: [70340.605715] ? __seccomp_filter+0x4a/0x4a0 Aug 23 00:56:06 juju-e4d256-prod-github-runner-207 kernel: [70340.606458] ? __fget_files+0x86/0xc0 Aug 23 00:56:06 juju-e4d256-prod-github-runner-207 kernel: [70340.607161] __x64_sys_ioctl+0x95/0xd0 Aug 23 00:56:06 juju-e4d256-prod-github-runner-207 kernel: [70340.607866] do_syscall_64+0x5c/0xc0 Aug 23 00:56:06 juju-e4d256-prod-github-runner-207 kernel: [70340.608532] ? do_futex+0x162/0x1f0 Aug 23 00:56:06 juju-e4d256-prod-github-runner-207 kernel: [70340.609188] ? __x64_sys_futex+0x78/0x1e0 Aug 23 00:56:06 juju-e4d256-prod-github-runner-207 kernel: [70340.609866] ? __secure_computing+0xa9/0x120 Aug 23 00:56:06 juju-e4d256-prod-github-runner-207 kernel: [70340.610559] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 00:56:06 juju-e4d256-prod-github-runner-207 kernel: [70340.611326] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:56:06 juju-e4d256-prod-github-runner-207 kernel: [70340.612061] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:56:06 juju-e4d256-prod-github-runner-207 kernel: [70340.612779] ? do_syscall_64+0x69/0xc0 Aug 23 00:56:06 juju-e4d256-prod-github-runner-207 kernel: [70340.613425] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:56:06 juju-e4d256-prod-github-runner-207 kernel: [70340.614133] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:56:06 juju-e4d256-prod-github-runner-207 kernel: [70340.614835] ? do_syscall_64+0x69/0xc0 Aug 23 00:56:06 juju-e4d256-prod-github-runner-207 kernel: [70340.615462] ? do_syscall_64+0x69/0xc0 Aug 23 00:56:06 juju-e4d256-prod-github-runner-207 kernel: [70340.616097] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 00:56:06 juju-e4d256-prod-github-runner-207 kernel: [70340.616803] RIP: 0033:0x7faa5d0edaff Aug 23 00:56:06 juju-e4d256-prod-github-runner-207 kernel: [70340.617453] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 00:56:06 juju-e4d256-prod-github-runner-207 kernel: [70340.619440] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 00:56:06 juju-e4d256-prod-github-runner-207 kernel: [70340.620377] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 00:56:06 juju-e4d256-prod-github-runner-207 kernel: [70340.621275] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 00:56:06 juju-e4d256-prod-github-runner-207 kernel: [70340.622166] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 00:56:06 juju-e4d256-prod-github-runner-207 kernel: [70340.623055] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 00:56:06 juju-e4d256-prod-github-runner-207 kernel: [70340.623964] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 00:56:06 juju-e4d256-prod-github-runner-207 kernel: [70340.624862] Aug 23 00:56:34 juju-e4d256-prod-github-runner-207 kernel: [70368.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 65427s! [qemu-system-x86:6715] Aug 23 00:56:34 juju-e4d256-prod-github-runner-207 kernel: [70368.543114] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 00:56:34 juju-e4d256-prod-github-runner-207 kernel: [70368.543182] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 00:56:34 juju-e4d256-prod-github-runner-207 kernel: [70368.555356] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 00:56:34 juju-e4d256-prod-github-runner-207 kernel: [70368.556682] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 00:56:34 juju-e4d256-prod-github-runner-207 kernel: [70368.557932] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:56:34 juju-e4d256-prod-github-runner-207 kernel: [70368.558992] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 00:56:34 juju-e4d256-prod-github-runner-207 kernel: [70368.561612] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 00:56:34 juju-e4d256-prod-github-runner-207 kernel: [70368.562672] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 00:56:34 juju-e4d256-prod-github-runner-207 kernel: [70368.563868] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 00:56:34 juju-e4d256-prod-github-runner-207 kernel: [70368.565070] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 00:56:34 juju-e4d256-prod-github-runner-207 kernel: [70368.566304] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 00:56:34 juju-e4d256-prod-github-runner-207 kernel: [70368.567506] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 00:56:34 juju-e4d256-prod-github-runner-207 kernel: [70368.568718] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 00:56:34 juju-e4d256-prod-github-runner-207 kernel: [70368.569965] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 00:56:34 juju-e4d256-prod-github-runner-207 kernel: [70368.571125] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 00:56:34 juju-e4d256-prod-github-runner-207 kernel: [70368.572396] Call Trace: Aug 23 00:56:34 juju-e4d256-prod-github-runner-207 kernel: [70368.573318] Aug 23 00:56:34 juju-e4d256-prod-github-runner-207 kernel: [70368.574203] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:56:34 juju-e4d256-prod-github-runner-207 kernel: [70368.575234] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:56:34 juju-e4d256-prod-github-runner-207 kernel: [70368.576303] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:56:34 juju-e4d256-prod-github-runner-207 kernel: [70368.577402] ? show_regs.part.0+0x23/0x29 Aug 23 00:56:34 juju-e4d256-prod-github-runner-207 kernel: [70368.578410] ? show_regs.cold+0x8/0xd Aug 23 00:56:34 juju-e4d256-prod-github-runner-207 kernel: [70368.579404] ? watchdog_timer_fn+0x1be/0x220 Aug 23 00:56:34 juju-e4d256-prod-github-runner-207 kernel: [70368.580439] ? lockup_detector_update_enable+0x60/0x60 Aug 23 00:56:34 juju-e4d256-prod-github-runner-207 kernel: [70368.581522] ? __hrtimer_run_queues+0x107/0x230 Aug 23 00:56:34 juju-e4d256-prod-github-runner-207 kernel: [70368.582570] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 00:56:34 juju-e4d256-prod-github-runner-207 kernel: [70368.583790] ? hrtimer_interrupt+0x101/0x220 Aug 23 00:56:34 juju-e4d256-prod-github-runner-207 kernel: [70368.584815] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 00:56:34 juju-e4d256-prod-github-runner-207 kernel: [70368.585914] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 00:56:34 juju-e4d256-prod-github-runner-207 kernel: [70368.587023] Aug 23 00:56:34 juju-e4d256-prod-github-runner-207 kernel: [70368.587909] Aug 23 00:56:34 juju-e4d256-prod-github-runner-207 kernel: [70368.588758] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 00:56:34 juju-e4d256-prod-github-runner-207 kernel: [70368.589814] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:56:34 juju-e4d256-prod-github-runner-207 kernel: [70368.590988] ? _raw_spin_lock+0x22/0x30 Aug 23 00:56:34 juju-e4d256-prod-github-runner-207 kernel: [70368.591986] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:56:34 juju-e4d256-prod-github-runner-207 kernel: [70368.593018] direct_page_fault+0x206/0x310 [kvm] Aug 23 00:56:34 juju-e4d256-prod-github-runner-207 kernel: [70368.594048] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 00:56:34 juju-e4d256-prod-github-runner-207 kernel: [70368.595068] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 00:56:34 juju-e4d256-prod-github-runner-207 kernel: [70368.596098] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 00:56:34 juju-e4d256-prod-github-runner-207 kernel: [70368.597111] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 00:56:34 juju-e4d256-prod-github-runner-207 kernel: [70368.598073] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 00:56:34 juju-e4d256-prod-github-runner-207 kernel: [70368.599061] handle_exit+0x98/0x230 [kvm_amd] Aug 23 00:56:34 juju-e4d256-prod-github-runner-207 kernel: [70368.599992] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 00:56:34 juju-e4d256-prod-github-runner-207 kernel: [70368.600915] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 00:56:34 juju-e4d256-prod-github-runner-207 kernel: [70368.601862] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 00:56:34 juju-e4d256-prod-github-runner-207 kernel: [70368.602781] vcpu_run+0x62/0x2c0 [kvm] Aug 23 00:56:34 juju-e4d256-prod-github-runner-207 kernel: [70368.603624] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 00:56:34 juju-e4d256-prod-github-runner-207 kernel: [70368.604467] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 00:56:34 juju-e4d256-prod-github-runner-207 kernel: [70368.605341] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 00:56:34 juju-e4d256-prod-github-runner-207 kernel: [70368.606139] ? __seccomp_filter+0x4a/0x4a0 Aug 23 00:56:34 juju-e4d256-prod-github-runner-207 kernel: [70368.606903] ? __fget_files+0x86/0xc0 Aug 23 00:56:34 juju-e4d256-prod-github-runner-207 kernel: [70368.607663] __x64_sys_ioctl+0x95/0xd0 Aug 23 00:56:34 juju-e4d256-prod-github-runner-207 kernel: [70368.608360] do_syscall_64+0x5c/0xc0 Aug 23 00:56:34 juju-e4d256-prod-github-runner-207 kernel: [70368.609028] ? do_futex+0x162/0x1f0 Aug 23 00:56:34 juju-e4d256-prod-github-runner-207 kernel: [70368.609699] ? __x64_sys_futex+0x78/0x1e0 Aug 23 00:56:34 juju-e4d256-prod-github-runner-207 kernel: [70368.610393] ? __secure_computing+0xa9/0x120 Aug 23 00:56:34 juju-e4d256-prod-github-runner-207 kernel: [70368.611084] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 00:56:34 juju-e4d256-prod-github-runner-207 kernel: [70368.611884] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:56:34 juju-e4d256-prod-github-runner-207 kernel: [70368.612644] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:56:34 juju-e4d256-prod-github-runner-207 kernel: [70368.613370] ? do_syscall_64+0x69/0xc0 Aug 23 00:56:34 juju-e4d256-prod-github-runner-207 kernel: [70368.614020] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:56:34 juju-e4d256-prod-github-runner-207 kernel: [70368.614726] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:56:34 juju-e4d256-prod-github-runner-207 kernel: [70368.615443] ? do_syscall_64+0x69/0xc0 Aug 23 00:56:34 juju-e4d256-prod-github-runner-207 kernel: [70368.616070] ? do_syscall_64+0x69/0xc0 Aug 23 00:56:34 juju-e4d256-prod-github-runner-207 kernel: [70368.616704] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 00:56:34 juju-e4d256-prod-github-runner-207 kernel: [70368.617427] RIP: 0033:0x7faa5d0edaff Aug 23 00:56:34 juju-e4d256-prod-github-runner-207 kernel: [70368.618082] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 00:56:34 juju-e4d256-prod-github-runner-207 kernel: [70368.620113] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 00:56:34 juju-e4d256-prod-github-runner-207 kernel: [70368.621035] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 00:56:34 juju-e4d256-prod-github-runner-207 kernel: [70368.621949] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 00:56:34 juju-e4d256-prod-github-runner-207 kernel: [70368.622854] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 00:56:34 juju-e4d256-prod-github-runner-207 kernel: [70368.623778] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 00:56:34 juju-e4d256-prod-github-runner-207 kernel: [70368.624669] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 00:56:34 juju-e4d256-prod-github-runner-207 kernel: [70368.625566] Aug 23 00:56:47 juju-e4d256-prod-github-runner-207 kernel: [70381.880705] rcu: INFO: rcu_sched self-detected stall on CPU Aug 23 00:56:47 juju-e4d256-prod-github-runner-207 kernel: [70381.881663] rcu: 1-....: (17510818 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=8456534 Aug 23 00:56:47 juju-e4d256-prod-github-runner-207 kernel: [70381.882791] (t=17566170 jiffies g=23269 q=60583) Aug 23 00:56:47 juju-e4d256-prod-github-runner-207 kernel: [70381.883616] NMI backtrace for cpu 1 Aug 23 00:56:47 juju-e4d256-prod-github-runner-207 kernel: [70381.884331] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 00:56:47 juju-e4d256-prod-github-runner-207 kernel: [70381.885441] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 00:56:47 juju-e4d256-prod-github-runner-207 kernel: [70381.886503] Call Trace: Aug 23 00:56:47 juju-e4d256-prod-github-runner-207 kernel: [70381.887197] Aug 23 00:56:47 juju-e4d256-prod-github-runner-207 kernel: [70381.887870] show_stack+0x52/0x5c Aug 23 00:56:47 juju-e4d256-prod-github-runner-207 kernel: [70381.888611] dump_stack_lvl+0x4a/0x63 Aug 23 00:56:47 juju-e4d256-prod-github-runner-207 kernel: [70381.889378] dump_stack+0x10/0x16 Aug 23 00:56:47 juju-e4d256-prod-github-runner-207 kernel: [70381.890103] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 23 00:56:47 juju-e4d256-prod-github-runner-207 kernel: [70381.890884] ? lapic_can_unplug_cpu+0x90/0x90 Aug 23 00:56:47 juju-e4d256-prod-github-runner-207 kernel: [70381.891711] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 23 00:56:47 juju-e4d256-prod-github-runner-207 kernel: [70381.892537] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 23 00:56:47 juju-e4d256-prod-github-runner-207 kernel: [70381.893372] trigger_single_cpu_backtrace+0x44/0x4f Aug 23 00:56:47 juju-e4d256-prod-github-runner-207 kernel: [70381.894185] rcu_dump_cpu_stacks+0x102/0x149 Aug 23 00:56:47 juju-e4d256-prod-github-runner-207 kernel: [70381.894969] print_cpu_stall.cold+0x2f/0xe2 Aug 23 00:56:47 juju-e4d256-prod-github-runner-207 kernel: [70381.895758] ? timekeeping_update+0xf7/0x150 Aug 23 00:56:47 juju-e4d256-prod-github-runner-207 kernel: [70381.896542] check_cpu_stall+0x109/0x270 Aug 23 00:56:47 juju-e4d256-prod-github-runner-207 kernel: [70381.897291] rcu_sched_clock_irq+0x9a/0x250 Aug 23 00:56:47 juju-e4d256-prod-github-runner-207 kernel: [70381.898051] update_process_times+0x94/0xd0 Aug 23 00:56:47 juju-e4d256-prod-github-runner-207 kernel: [70381.898819] tick_sched_handle+0x29/0x70 Aug 23 00:56:47 juju-e4d256-prod-github-runner-207 kernel: [70381.899585] tick_sched_timer+0x8c/0xc0 Aug 23 00:56:47 juju-e4d256-prod-github-runner-207 kernel: [70381.900321] ? tick_nohz_handler+0xb0/0xb0 Aug 23 00:56:47 juju-e4d256-prod-github-runner-207 kernel: [70381.901077] __hrtimer_run_queues+0x107/0x230 Aug 23 00:56:47 juju-e4d256-prod-github-runner-207 kernel: [70381.901849] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 00:56:47 juju-e4d256-prod-github-runner-207 kernel: [70381.902625] hrtimer_interrupt+0x101/0x220 Aug 23 00:56:47 juju-e4d256-prod-github-runner-207 kernel: [70381.903410] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 00:56:47 juju-e4d256-prod-github-runner-207 kernel: [70381.904224] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 00:56:47 juju-e4d256-prod-github-runner-207 kernel: [70381.905024] Aug 23 00:56:47 juju-e4d256-prod-github-runner-207 kernel: [70381.905661] Aug 23 00:56:47 juju-e4d256-prod-github-runner-207 kernel: [70381.906288] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 00:56:47 juju-e4d256-prod-github-runner-207 kernel: [70381.907104] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:56:47 juju-e4d256-prod-github-runner-207 kernel: [70381.907999] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 00:56:47 juju-e4d256-prod-github-runner-207 kernel: [70381.910232] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 00:56:47 juju-e4d256-prod-github-runner-207 kernel: [70381.911113] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 00:56:47 juju-e4d256-prod-github-runner-207 kernel: [70381.912128] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 00:56:47 juju-e4d256-prod-github-runner-207 kernel: [70381.913103] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 00:56:47 juju-e4d256-prod-github-runner-207 kernel: [70381.914068] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 00:56:47 juju-e4d256-prod-github-runner-207 kernel: [70381.915028] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 00:56:47 juju-e4d256-prod-github-runner-207 kernel: [70381.916012] ? _raw_spin_lock+0x22/0x30 Aug 23 00:56:47 juju-e4d256-prod-github-runner-207 kernel: [70381.916777] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:56:47 juju-e4d256-prod-github-runner-207 kernel: [70381.917616] direct_page_fault+0x206/0x310 [kvm] Aug 23 00:56:47 juju-e4d256-prod-github-runner-207 kernel: [70381.918459] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 00:56:47 juju-e4d256-prod-github-runner-207 kernel: [70381.919319] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 00:56:47 juju-e4d256-prod-github-runner-207 kernel: [70381.920146] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 00:56:47 juju-e4d256-prod-github-runner-207 kernel: [70381.920968] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 00:56:47 juju-e4d256-prod-github-runner-207 kernel: [70381.921766] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 00:56:47 juju-e4d256-prod-github-runner-207 kernel: [70381.922599] handle_exit+0x98/0x230 [kvm_amd] Aug 23 00:56:47 juju-e4d256-prod-github-runner-207 kernel: [70381.923386] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 00:56:47 juju-e4d256-prod-github-runner-207 kernel: [70381.924172] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 00:56:47 juju-e4d256-prod-github-runner-207 kernel: [70381.924970] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 00:56:47 juju-e4d256-prod-github-runner-207 kernel: [70381.925766] vcpu_run+0x62/0x2c0 [kvm] Aug 23 00:56:47 juju-e4d256-prod-github-runner-207 kernel: [70381.926479] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 00:56:47 juju-e4d256-prod-github-runner-207 kernel: [70381.927222] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 00:56:47 juju-e4d256-prod-github-runner-207 kernel: [70381.928036] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 00:56:47 juju-e4d256-prod-github-runner-207 kernel: [70381.928818] ? __seccomp_filter+0x4a/0x4a0 Aug 23 00:56:47 juju-e4d256-prod-github-runner-207 kernel: [70381.929541] ? __fget_files+0x86/0xc0 Aug 23 00:56:47 juju-e4d256-prod-github-runner-207 kernel: [70381.930244] __x64_sys_ioctl+0x95/0xd0 Aug 23 00:56:47 juju-e4d256-prod-github-runner-207 kernel: [70381.930952] do_syscall_64+0x5c/0xc0 Aug 23 00:56:47 juju-e4d256-prod-github-runner-207 kernel: [70381.931644] ? do_futex+0x162/0x1f0 Aug 23 00:56:47 juju-e4d256-prod-github-runner-207 kernel: [70381.932315] ? __x64_sys_futex+0x78/0x1e0 Aug 23 00:56:47 juju-e4d256-prod-github-runner-207 kernel: [70381.933026] ? __secure_computing+0xa9/0x120 Aug 23 00:56:47 juju-e4d256-prod-github-runner-207 kernel: [70381.933752] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 00:56:47 juju-e4d256-prod-github-runner-207 kernel: [70381.934551] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:56:47 juju-e4d256-prod-github-runner-207 kernel: [70381.935326] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:56:47 juju-e4d256-prod-github-runner-207 kernel: [70381.936092] ? do_syscall_64+0x69/0xc0 Aug 23 00:56:47 juju-e4d256-prod-github-runner-207 kernel: [70381.936787] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:56:47 juju-e4d256-prod-github-runner-207 kernel: [70381.937540] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:56:47 juju-e4d256-prod-github-runner-207 kernel: [70381.938312] ? do_syscall_64+0x69/0xc0 Aug 23 00:56:47 juju-e4d256-prod-github-runner-207 kernel: [70381.939011] ? do_syscall_64+0x69/0xc0 Aug 23 00:56:47 juju-e4d256-prod-github-runner-207 kernel: [70381.939723] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 00:56:47 juju-e4d256-prod-github-runner-207 kernel: [70381.940514] RIP: 0033:0x7faa5d0edaff Aug 23 00:56:47 juju-e4d256-prod-github-runner-207 kernel: [70381.941197] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 00:56:47 juju-e4d256-prod-github-runner-207 kernel: [70381.943335] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 00:56:47 juju-e4d256-prod-github-runner-207 kernel: [70381.944296] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 00:56:47 juju-e4d256-prod-github-runner-207 kernel: [70381.945272] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 00:56:47 juju-e4d256-prod-github-runner-207 kernel: [70381.946220] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 00:56:47 juju-e4d256-prod-github-runner-207 kernel: [70381.947176] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 00:56:47 juju-e4d256-prod-github-runner-207 kernel: [70381.948116] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 00:56:47 juju-e4d256-prod-github-runner-207 kernel: [70381.949044] Aug 23 00:57:14 juju-e4d256-prod-github-runner-207 kernel: [70408.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 65465s! [qemu-system-x86:6715] Aug 23 00:57:14 juju-e4d256-prod-github-runner-207 kernel: [70408.543123] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 00:57:14 juju-e4d256-prod-github-runner-207 kernel: [70408.543191] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 00:57:14 juju-e4d256-prod-github-runner-207 kernel: [70408.555414] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 00:57:14 juju-e4d256-prod-github-runner-207 kernel: [70408.556692] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 00:57:14 juju-e4d256-prod-github-runner-207 kernel: [70408.557915] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:57:14 juju-e4d256-prod-github-runner-207 kernel: [70408.559001] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 00:57:14 juju-e4d256-prod-github-runner-207 kernel: [70408.561544] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 00:57:14 juju-e4d256-prod-github-runner-207 kernel: [70408.562592] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 00:57:14 juju-e4d256-prod-github-runner-207 kernel: [70408.563785] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 00:57:14 juju-e4d256-prod-github-runner-207 kernel: [70408.564945] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 00:57:14 juju-e4d256-prod-github-runner-207 kernel: [70408.566252] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 00:57:14 juju-e4d256-prod-github-runner-207 kernel: [70408.567437] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 00:57:14 juju-e4d256-prod-github-runner-207 kernel: [70408.568600] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 00:57:14 juju-e4d256-prod-github-runner-207 kernel: [70408.569832] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 00:57:14 juju-e4d256-prod-github-runner-207 kernel: [70408.570932] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 00:57:14 juju-e4d256-prod-github-runner-207 kernel: [70408.572146] Call Trace: Aug 23 00:57:14 juju-e4d256-prod-github-runner-207 kernel: [70408.573064] Aug 23 00:57:14 juju-e4d256-prod-github-runner-207 kernel: [70408.573946] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:57:14 juju-e4d256-prod-github-runner-207 kernel: [70408.574985] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:57:14 juju-e4d256-prod-github-runner-207 kernel: [70408.576005] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:57:14 juju-e4d256-prod-github-runner-207 kernel: [70408.577084] ? show_regs.part.0+0x23/0x29 Aug 23 00:57:14 juju-e4d256-prod-github-runner-207 kernel: [70408.578083] ? show_regs.cold+0x8/0xd Aug 23 00:57:14 juju-e4d256-prod-github-runner-207 kernel: [70408.579137] ? watchdog_timer_fn+0x1be/0x220 Aug 23 00:57:14 juju-e4d256-prod-github-runner-207 kernel: [70408.580186] ? lockup_detector_update_enable+0x60/0x60 Aug 23 00:57:14 juju-e4d256-prod-github-runner-207 kernel: [70408.581339] ? __hrtimer_run_queues+0x107/0x230 Aug 23 00:57:14 juju-e4d256-prod-github-runner-207 kernel: [70408.582377] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 00:57:14 juju-e4d256-prod-github-runner-207 kernel: [70408.583422] ? hrtimer_interrupt+0x101/0x220 Aug 23 00:57:14 juju-e4d256-prod-github-runner-207 kernel: [70408.584440] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 00:57:14 juju-e4d256-prod-github-runner-207 kernel: [70408.585546] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 00:57:14 juju-e4d256-prod-github-runner-207 kernel: [70408.586592] Aug 23 00:57:14 juju-e4d256-prod-github-runner-207 kernel: [70408.587460] Aug 23 00:57:14 juju-e4d256-prod-github-runner-207 kernel: [70408.588296] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 00:57:14 juju-e4d256-prod-github-runner-207 kernel: [70408.589353] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:57:14 juju-e4d256-prod-github-runner-207 kernel: [70408.590407] ? _raw_spin_lock+0x22/0x30 Aug 23 00:57:14 juju-e4d256-prod-github-runner-207 kernel: [70408.591377] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:57:14 juju-e4d256-prod-github-runner-207 kernel: [70408.592403] direct_page_fault+0x206/0x310 [kvm] Aug 23 00:57:14 juju-e4d256-prod-github-runner-207 kernel: [70408.593444] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 00:57:14 juju-e4d256-prod-github-runner-207 kernel: [70408.594460] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 00:57:14 juju-e4d256-prod-github-runner-207 kernel: [70408.595473] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 00:57:14 juju-e4d256-prod-github-runner-207 kernel: [70408.596443] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 00:57:14 juju-e4d256-prod-github-runner-207 kernel: [70408.597387] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 00:57:14 juju-e4d256-prod-github-runner-207 kernel: [70408.598362] handle_exit+0x98/0x230 [kvm_amd] Aug 23 00:57:14 juju-e4d256-prod-github-runner-207 kernel: [70408.599267] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 00:57:14 juju-e4d256-prod-github-runner-207 kernel: [70408.600198] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 00:57:14 juju-e4d256-prod-github-runner-207 kernel: [70408.601146] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 00:57:14 juju-e4d256-prod-github-runner-207 kernel: [70408.602052] vcpu_run+0x62/0x2c0 [kvm] Aug 23 00:57:14 juju-e4d256-prod-github-runner-207 kernel: [70408.602862] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 00:57:14 juju-e4d256-prod-github-runner-207 kernel: [70408.603677] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 00:57:14 juju-e4d256-prod-github-runner-207 kernel: [70408.604529] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 00:57:14 juju-e4d256-prod-github-runner-207 kernel: [70408.605326] ? __seccomp_filter+0x4a/0x4a0 Aug 23 00:57:14 juju-e4d256-prod-github-runner-207 kernel: [70408.606066] ? __fget_files+0x86/0xc0 Aug 23 00:57:14 juju-e4d256-prod-github-runner-207 kernel: [70408.606768] __x64_sys_ioctl+0x95/0xd0 Aug 23 00:57:14 juju-e4d256-prod-github-runner-207 kernel: [70408.607471] do_syscall_64+0x5c/0xc0 Aug 23 00:57:14 juju-e4d256-prod-github-runner-207 kernel: [70408.608135] ? do_futex+0x162/0x1f0 Aug 23 00:57:14 juju-e4d256-prod-github-runner-207 kernel: [70408.608785] ? __x64_sys_futex+0x78/0x1e0 Aug 23 00:57:14 juju-e4d256-prod-github-runner-207 kernel: [70408.609455] ? __secure_computing+0xa9/0x120 Aug 23 00:57:14 juju-e4d256-prod-github-runner-207 kernel: [70408.610143] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 00:57:14 juju-e4d256-prod-github-runner-207 kernel: [70408.610926] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:57:14 juju-e4d256-prod-github-runner-207 kernel: [70408.611667] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:57:14 juju-e4d256-prod-github-runner-207 kernel: [70408.612386] ? do_syscall_64+0x69/0xc0 Aug 23 00:57:14 juju-e4d256-prod-github-runner-207 kernel: [70408.613032] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:57:14 juju-e4d256-prod-github-runner-207 kernel: [70408.613734] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:57:14 juju-e4d256-prod-github-runner-207 kernel: [70408.614430] ? do_syscall_64+0x69/0xc0 Aug 23 00:57:14 juju-e4d256-prod-github-runner-207 kernel: [70408.615100] ? do_syscall_64+0x69/0xc0 Aug 23 00:57:14 juju-e4d256-prod-github-runner-207 kernel: [70408.615725] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 00:57:14 juju-e4d256-prod-github-runner-207 kernel: [70408.616428] RIP: 0033:0x7faa5d0edaff Aug 23 00:57:14 juju-e4d256-prod-github-runner-207 kernel: [70408.617051] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 00:57:14 juju-e4d256-prod-github-runner-207 kernel: [70408.619040] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 00:57:14 juju-e4d256-prod-github-runner-207 kernel: [70408.619949] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 00:57:14 juju-e4d256-prod-github-runner-207 kernel: [70408.620835] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 00:57:14 juju-e4d256-prod-github-runner-207 kernel: [70408.621738] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 00:57:14 juju-e4d256-prod-github-runner-207 kernel: [70408.622642] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 00:57:14 juju-e4d256-prod-github-runner-207 kernel: [70408.623550] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 00:57:14 juju-e4d256-prod-github-runner-207 kernel: [70408.624444] Aug 23 00:57:42 juju-e4d256-prod-github-runner-207 kernel: [70436.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 65491s! [qemu-system-x86:6715] Aug 23 00:57:42 juju-e4d256-prod-github-runner-207 kernel: [70436.543736] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 00:57:42 juju-e4d256-prod-github-runner-207 kernel: [70436.543988] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 00:57:42 juju-e4d256-prod-github-runner-207 kernel: [70436.556303] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 00:57:42 juju-e4d256-prod-github-runner-207 kernel: [70436.557567] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 00:57:42 juju-e4d256-prod-github-runner-207 kernel: [70436.558796] RIP: 0010:native_queued_spin_lock_slowpath+0xc/0x40 Aug 23 00:57:42 juju-e4d256-prod-github-runner-207 kernel: [70436.559846] Code: fe ff ff eb af 4c 89 fe 48 c7 c7 20 99 e9 89 e8 ca 69 55 00 e9 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 <8b> 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 eb Aug 23 00:57:42 juju-e4d256-prod-github-runner-207 kernel: [70436.562410] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 00:57:42 juju-e4d256-prod-github-runner-207 kernel: [70436.563463] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 00:57:42 juju-e4d256-prod-github-runner-207 kernel: [70436.564629] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 00:57:42 juju-e4d256-prod-github-runner-207 kernel: [70436.565798] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 00:57:42 juju-e4d256-prod-github-runner-207 kernel: [70436.566965] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 00:57:42 juju-e4d256-prod-github-runner-207 kernel: [70436.568125] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 00:57:42 juju-e4d256-prod-github-runner-207 kernel: [70436.569293] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 00:57:42 juju-e4d256-prod-github-runner-207 kernel: [70436.570523] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 00:57:42 juju-e4d256-prod-github-runner-207 kernel: [70436.571625] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 00:57:42 juju-e4d256-prod-github-runner-207 kernel: [70436.572852] Call Trace: Aug 23 00:57:42 juju-e4d256-prod-github-runner-207 kernel: [70436.573766] Aug 23 00:57:42 juju-e4d256-prod-github-runner-207 kernel: [70436.574681] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:57:42 juju-e4d256-prod-github-runner-207 kernel: [70436.575711] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:57:42 juju-e4d256-prod-github-runner-207 kernel: [70436.576730] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:57:42 juju-e4d256-prod-github-runner-207 kernel: [70436.577820] ? show_regs.part.0+0x23/0x29 Aug 23 00:57:42 juju-e4d256-prod-github-runner-207 kernel: [70436.578829] ? show_regs.cold+0x8/0xd Aug 23 00:57:42 juju-e4d256-prod-github-runner-207 kernel: [70436.579798] ? watchdog_timer_fn+0x1be/0x220 Aug 23 00:57:42 juju-e4d256-prod-github-runner-207 kernel: [70436.580804] ? lockup_detector_update_enable+0x60/0x60 Aug 23 00:57:42 juju-e4d256-prod-github-runner-207 kernel: [70436.581865] ? __hrtimer_run_queues+0x107/0x230 Aug 23 00:57:42 juju-e4d256-prod-github-runner-207 kernel: [70436.582935] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 00:57:42 juju-e4d256-prod-github-runner-207 kernel: [70436.583980] ? hrtimer_interrupt+0x101/0x220 Aug 23 00:57:42 juju-e4d256-prod-github-runner-207 kernel: [70436.584996] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 00:57:42 juju-e4d256-prod-github-runner-207 kernel: [70436.586061] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 00:57:42 juju-e4d256-prod-github-runner-207 kernel: [70436.587119] Aug 23 00:57:42 juju-e4d256-prod-github-runner-207 kernel: [70436.587976] Aug 23 00:57:42 juju-e4d256-prod-github-runner-207 kernel: [70436.588811] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 00:57:42 juju-e4d256-prod-github-runner-207 kernel: [70436.589842] ? native_queued_spin_lock_slowpath+0xc/0x40 Aug 23 00:57:42 juju-e4d256-prod-github-runner-207 kernel: [70436.590884] ? _raw_spin_lock+0x22/0x30 Aug 23 00:57:42 juju-e4d256-prod-github-runner-207 kernel: [70436.591831] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:57:42 juju-e4d256-prod-github-runner-207 kernel: [70436.592846] direct_page_fault+0x206/0x310 [kvm] Aug 23 00:57:42 juju-e4d256-prod-github-runner-207 kernel: [70436.593891] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 00:57:42 juju-e4d256-prod-github-runner-207 kernel: [70436.594916] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 00:57:42 juju-e4d256-prod-github-runner-207 kernel: [70436.595915] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 00:57:42 juju-e4d256-prod-github-runner-207 kernel: [70436.596907] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 00:57:42 juju-e4d256-prod-github-runner-207 kernel: [70436.597849] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 00:57:42 juju-e4d256-prod-github-runner-207 kernel: [70436.598838] handle_exit+0x98/0x230 [kvm_amd] Aug 23 00:57:42 juju-e4d256-prod-github-runner-207 kernel: [70436.599729] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 00:57:42 juju-e4d256-prod-github-runner-207 kernel: [70436.600640] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 00:57:42 juju-e4d256-prod-github-runner-207 kernel: [70436.601562] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 00:57:42 juju-e4d256-prod-github-runner-207 kernel: [70436.602463] vcpu_run+0x62/0x2c0 [kvm] Aug 23 00:57:42 juju-e4d256-prod-github-runner-207 kernel: [70436.603297] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 00:57:42 juju-e4d256-prod-github-runner-207 kernel: [70436.604122] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 00:57:42 juju-e4d256-prod-github-runner-207 kernel: [70436.604976] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 00:57:42 juju-e4d256-prod-github-runner-207 kernel: [70436.605776] ? __seccomp_filter+0x4a/0x4a0 Aug 23 00:57:42 juju-e4d256-prod-github-runner-207 kernel: [70436.606516] ? __fget_files+0x86/0xc0 Aug 23 00:57:42 juju-e4d256-prod-github-runner-207 kernel: [70436.607233] __x64_sys_ioctl+0x95/0xd0 Aug 23 00:57:42 juju-e4d256-prod-github-runner-207 kernel: [70436.607923] do_syscall_64+0x5c/0xc0 Aug 23 00:57:42 juju-e4d256-prod-github-runner-207 kernel: [70436.608585] ? do_futex+0x162/0x1f0 Aug 23 00:57:42 juju-e4d256-prod-github-runner-207 kernel: [70436.609232] ? __x64_sys_futex+0x78/0x1e0 Aug 23 00:57:42 juju-e4d256-prod-github-runner-207 kernel: [70436.609907] ? __secure_computing+0xa9/0x120 Aug 23 00:57:42 juju-e4d256-prod-github-runner-207 kernel: [70436.610595] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 00:57:42 juju-e4d256-prod-github-runner-207 kernel: [70436.611364] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:57:42 juju-e4d256-prod-github-runner-207 kernel: [70436.612083] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:57:42 juju-e4d256-prod-github-runner-207 kernel: [70436.612799] ? do_syscall_64+0x69/0xc0 Aug 23 00:57:42 juju-e4d256-prod-github-runner-207 kernel: [70436.613441] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:57:42 juju-e4d256-prod-github-runner-207 kernel: [70436.614196] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:57:42 juju-e4d256-prod-github-runner-207 kernel: [70436.614914] ? do_syscall_64+0x69/0xc0 Aug 23 00:57:42 juju-e4d256-prod-github-runner-207 kernel: [70436.615539] ? do_syscall_64+0x69/0xc0 Aug 23 00:57:42 juju-e4d256-prod-github-runner-207 kernel: [70436.616167] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 00:57:42 juju-e4d256-prod-github-runner-207 kernel: [70436.616872] RIP: 0033:0x7faa5d0edaff Aug 23 00:57:42 juju-e4d256-prod-github-runner-207 kernel: [70436.617526] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 00:57:42 juju-e4d256-prod-github-runner-207 kernel: [70436.619536] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 00:57:42 juju-e4d256-prod-github-runner-207 kernel: [70436.620452] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 00:57:42 juju-e4d256-prod-github-runner-207 kernel: [70436.621345] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 00:57:42 juju-e4d256-prod-github-runner-207 kernel: [70436.622240] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 00:57:42 juju-e4d256-prod-github-runner-207 kernel: [70436.623147] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 00:57:42 juju-e4d256-prod-github-runner-207 kernel: [70436.624047] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 00:57:42 juju-e4d256-prod-github-runner-207 kernel: [70436.624965] Aug 23 00:58:10 juju-e4d256-prod-github-runner-207 kernel: [70464.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 65517s! [qemu-system-x86:6715] Aug 23 00:58:10 juju-e4d256-prod-github-runner-207 kernel: [70464.543152] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 00:58:10 juju-e4d256-prod-github-runner-207 kernel: [70464.543221] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 00:58:10 juju-e4d256-prod-github-runner-207 kernel: [70464.555737] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 00:58:10 juju-e4d256-prod-github-runner-207 kernel: [70464.557052] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 00:58:10 juju-e4d256-prod-github-runner-207 kernel: [70464.558523] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:58:10 juju-e4d256-prod-github-runner-207 kernel: [70464.559638] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 00:58:10 juju-e4d256-prod-github-runner-207 kernel: [70464.562272] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 00:58:10 juju-e4d256-prod-github-runner-207 kernel: [70464.563379] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 00:58:10 juju-e4d256-prod-github-runner-207 kernel: [70464.564586] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 00:58:10 juju-e4d256-prod-github-runner-207 kernel: [70464.565800] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 00:58:10 juju-e4d256-prod-github-runner-207 kernel: [70464.567025] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 00:58:10 juju-e4d256-prod-github-runner-207 kernel: [70464.568217] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 00:58:10 juju-e4d256-prod-github-runner-207 kernel: [70464.569408] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 00:58:10 juju-e4d256-prod-github-runner-207 kernel: [70464.570904] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 00:58:10 juju-e4d256-prod-github-runner-207 kernel: [70464.572048] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 00:58:10 juju-e4d256-prod-github-runner-207 kernel: [70464.573296] Call Trace: Aug 23 00:58:10 juju-e4d256-prod-github-runner-207 kernel: [70464.574224] Aug 23 00:58:10 juju-e4d256-prod-github-runner-207 kernel: [70464.575151] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:58:10 juju-e4d256-prod-github-runner-207 kernel: [70464.576224] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:58:10 juju-e4d256-prod-github-runner-207 kernel: [70464.577402] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:58:10 juju-e4d256-prod-github-runner-207 kernel: [70464.578516] ? show_regs.part.0+0x23/0x29 Aug 23 00:58:10 juju-e4d256-prod-github-runner-207 kernel: [70464.579571] ? show_regs.cold+0x8/0xd Aug 23 00:58:10 juju-e4d256-prod-github-runner-207 kernel: [70464.580603] ? watchdog_timer_fn+0x1be/0x220 Aug 23 00:58:10 juju-e4d256-prod-github-runner-207 kernel: [70464.581646] ? lockup_detector_update_enable+0x60/0x60 Aug 23 00:58:10 juju-e4d256-prod-github-runner-207 kernel: [70464.582770] ? __hrtimer_run_queues+0x107/0x230 Aug 23 00:58:10 juju-e4d256-prod-github-runner-207 kernel: [70464.583851] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 00:58:10 juju-e4d256-prod-github-runner-207 kernel: [70464.584925] ? hrtimer_interrupt+0x101/0x220 Aug 23 00:58:10 juju-e4d256-prod-github-runner-207 kernel: [70464.585968] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 00:58:10 juju-e4d256-prod-github-runner-207 kernel: [70464.587094] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 00:58:10 juju-e4d256-prod-github-runner-207 kernel: [70464.588191] Aug 23 00:58:10 juju-e4d256-prod-github-runner-207 kernel: [70464.589064] Aug 23 00:58:10 juju-e4d256-prod-github-runner-207 kernel: [70464.589951] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 00:58:10 juju-e4d256-prod-github-runner-207 kernel: [70464.591064] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:58:10 juju-e4d256-prod-github-runner-207 kernel: [70464.592136] ? _raw_spin_lock+0x22/0x30 Aug 23 00:58:10 juju-e4d256-prod-github-runner-207 kernel: [70464.593118] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:58:10 juju-e4d256-prod-github-runner-207 kernel: [70464.594188] direct_page_fault+0x206/0x310 [kvm] Aug 23 00:58:10 juju-e4d256-prod-github-runner-207 kernel: [70464.595287] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 00:58:10 juju-e4d256-prod-github-runner-207 kernel: [70464.596322] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 00:58:10 juju-e4d256-prod-github-runner-207 kernel: [70464.597373] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 00:58:10 juju-e4d256-prod-github-runner-207 kernel: [70464.598387] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 00:58:10 juju-e4d256-prod-github-runner-207 kernel: [70464.599371] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 00:58:10 juju-e4d256-prod-github-runner-207 kernel: [70464.600398] handle_exit+0x98/0x230 [kvm_amd] Aug 23 00:58:10 juju-e4d256-prod-github-runner-207 kernel: [70464.601322] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 00:58:10 juju-e4d256-prod-github-runner-207 kernel: [70464.602298] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 00:58:10 juju-e4d256-prod-github-runner-207 kernel: [70464.603274] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 00:58:10 juju-e4d256-prod-github-runner-207 kernel: [70464.604200] vcpu_run+0x62/0x2c0 [kvm] Aug 23 00:58:10 juju-e4d256-prod-github-runner-207 kernel: [70464.605061] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 00:58:10 juju-e4d256-prod-github-runner-207 kernel: [70464.605901] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 00:58:10 juju-e4d256-prod-github-runner-207 kernel: [70464.606805] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 00:58:10 juju-e4d256-prod-github-runner-207 kernel: [70464.607664] ? __seccomp_filter+0x4a/0x4a0 Aug 23 00:58:10 juju-e4d256-prod-github-runner-207 kernel: [70464.608416] ? __fget_files+0x86/0xc0 Aug 23 00:58:10 juju-e4d256-prod-github-runner-207 kernel: [70464.609176] __x64_sys_ioctl+0x95/0xd0 Aug 23 00:58:10 juju-e4d256-prod-github-runner-207 kernel: [70464.609879] do_syscall_64+0x5c/0xc0 Aug 23 00:58:10 juju-e4d256-prod-github-runner-207 kernel: [70464.610614] ? do_futex+0x162/0x1f0 Aug 23 00:58:10 juju-e4d256-prod-github-runner-207 kernel: [70464.611277] ? __x64_sys_futex+0x78/0x1e0 Aug 23 00:58:10 juju-e4d256-prod-github-runner-207 kernel: [70464.611989] ? __secure_computing+0xa9/0x120 Aug 23 00:58:10 juju-e4d256-prod-github-runner-207 kernel: [70464.612695] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 00:58:10 juju-e4d256-prod-github-runner-207 kernel: [70464.613518] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:58:10 juju-e4d256-prod-github-runner-207 kernel: [70464.614250] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:58:10 juju-e4d256-prod-github-runner-207 kernel: [70464.615034] ? do_syscall_64+0x69/0xc0 Aug 23 00:58:10 juju-e4d256-prod-github-runner-207 kernel: [70464.615699] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:58:10 juju-e4d256-prod-github-runner-207 kernel: [70464.616438] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:58:10 juju-e4d256-prod-github-runner-207 kernel: [70464.617169] ? do_syscall_64+0x69/0xc0 Aug 23 00:58:10 juju-e4d256-prod-github-runner-207 kernel: [70464.617810] ? do_syscall_64+0x69/0xc0 Aug 23 00:58:10 juju-e4d256-prod-github-runner-207 kernel: [70464.618496] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 00:58:10 juju-e4d256-prod-github-runner-207 kernel: [70464.619221] RIP: 0033:0x7faa5d0edaff Aug 23 00:58:10 juju-e4d256-prod-github-runner-207 kernel: [70464.619894] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 00:58:10 juju-e4d256-prod-github-runner-207 kernel: [70464.621952] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 00:58:10 juju-e4d256-prod-github-runner-207 kernel: [70464.622920] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 00:58:10 juju-e4d256-prod-github-runner-207 kernel: [70464.623817] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 00:58:10 juju-e4d256-prod-github-runner-207 kernel: [70464.624730] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 00:58:10 juju-e4d256-prod-github-runner-207 kernel: [70464.625659] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 00:58:10 juju-e4d256-prod-github-runner-207 kernel: [70464.626595] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 00:58:10 juju-e4d256-prod-github-runner-207 kernel: [70464.627536] Aug 23 00:58:38 juju-e4d256-prod-github-runner-207 kernel: [70492.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 65543s! [qemu-system-x86:6715] Aug 23 00:58:38 juju-e4d256-prod-github-runner-207 kernel: [70492.543100] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 00:58:38 juju-e4d256-prod-github-runner-207 kernel: [70492.543167] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 00:58:38 juju-e4d256-prod-github-runner-207 kernel: [70492.555388] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 00:58:38 juju-e4d256-prod-github-runner-207 kernel: [70492.556650] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 00:58:38 juju-e4d256-prod-github-runner-207 kernel: [70492.557877] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:58:38 juju-e4d256-prod-github-runner-207 kernel: [70492.558950] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 00:58:38 juju-e4d256-prod-github-runner-207 kernel: [70492.561535] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 00:58:38 juju-e4d256-prod-github-runner-207 kernel: [70492.562589] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 00:58:38 juju-e4d256-prod-github-runner-207 kernel: [70492.563748] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 00:58:38 juju-e4d256-prod-github-runner-207 kernel: [70492.564909] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 00:58:38 juju-e4d256-prod-github-runner-207 kernel: [70492.566092] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 00:58:38 juju-e4d256-prod-github-runner-207 kernel: [70492.567252] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 00:58:38 juju-e4d256-prod-github-runner-207 kernel: [70492.568416] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 00:58:38 juju-e4d256-prod-github-runner-207 kernel: [70492.569646] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 00:58:38 juju-e4d256-prod-github-runner-207 kernel: [70492.570759] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 00:58:38 juju-e4d256-prod-github-runner-207 kernel: [70492.571953] Call Trace: Aug 23 00:58:38 juju-e4d256-prod-github-runner-207 kernel: [70492.572864] Aug 23 00:58:38 juju-e4d256-prod-github-runner-207 kernel: [70492.573752] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:58:38 juju-e4d256-prod-github-runner-207 kernel: [70492.574794] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:58:38 juju-e4d256-prod-github-runner-207 kernel: [70492.575813] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:58:38 juju-e4d256-prod-github-runner-207 kernel: [70492.576886] ? show_regs.part.0+0x23/0x29 Aug 23 00:58:38 juju-e4d256-prod-github-runner-207 kernel: [70492.577881] ? show_regs.cold+0x8/0xd Aug 23 00:58:38 juju-e4d256-prod-github-runner-207 kernel: [70492.578861] ? watchdog_timer_fn+0x1be/0x220 Aug 23 00:58:38 juju-e4d256-prod-github-runner-207 kernel: [70492.579870] ? lockup_detector_update_enable+0x60/0x60 Aug 23 00:58:38 juju-e4d256-prod-github-runner-207 kernel: [70492.580928] ? __hrtimer_run_queues+0x107/0x230 Aug 23 00:58:38 juju-e4d256-prod-github-runner-207 kernel: [70492.582039] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 00:58:38 juju-e4d256-prod-github-runner-207 kernel: [70492.583073] ? hrtimer_interrupt+0x101/0x220 Aug 23 00:58:38 juju-e4d256-prod-github-runner-207 kernel: [70492.584088] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 00:58:38 juju-e4d256-prod-github-runner-207 kernel: [70492.585154] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 00:58:38 juju-e4d256-prod-github-runner-207 kernel: [70492.586249] Aug 23 00:58:38 juju-e4d256-prod-github-runner-207 kernel: [70492.587113] Aug 23 00:58:38 juju-e4d256-prod-github-runner-207 kernel: [70492.587949] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 00:58:38 juju-e4d256-prod-github-runner-207 kernel: [70492.588983] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:58:38 juju-e4d256-prod-github-runner-207 kernel: [70492.590063] ? _raw_spin_lock+0x22/0x30 Aug 23 00:58:38 juju-e4d256-prod-github-runner-207 kernel: [70492.591022] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:58:38 juju-e4d256-prod-github-runner-207 kernel: [70492.592051] direct_page_fault+0x206/0x310 [kvm] Aug 23 00:58:38 juju-e4d256-prod-github-runner-207 kernel: [70492.593091] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 00:58:38 juju-e4d256-prod-github-runner-207 kernel: [70492.594130] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 00:58:38 juju-e4d256-prod-github-runner-207 kernel: [70492.595128] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 00:58:38 juju-e4d256-prod-github-runner-207 kernel: [70492.596101] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 00:58:38 juju-e4d256-prod-github-runner-207 kernel: [70492.597042] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 00:58:38 juju-e4d256-prod-github-runner-207 kernel: [70492.598030] handle_exit+0x98/0x230 [kvm_amd] Aug 23 00:58:38 juju-e4d256-prod-github-runner-207 kernel: [70492.598926] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 00:58:38 juju-e4d256-prod-github-runner-207 kernel: [70492.599834] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 00:58:38 juju-e4d256-prod-github-runner-207 kernel: [70492.600869] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 00:58:38 juju-e4d256-prod-github-runner-207 kernel: [70492.601797] vcpu_run+0x62/0x2c0 [kvm] Aug 23 00:58:38 juju-e4d256-prod-github-runner-207 kernel: [70492.602617] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 00:58:38 juju-e4d256-prod-github-runner-207 kernel: [70492.603422] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 00:58:38 juju-e4d256-prod-github-runner-207 kernel: [70492.604277] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 00:58:38 juju-e4d256-prod-github-runner-207 kernel: [70492.605071] ? __seccomp_filter+0x4a/0x4a0 Aug 23 00:58:38 juju-e4d256-prod-github-runner-207 kernel: [70492.605811] ? __fget_files+0x86/0xc0 Aug 23 00:58:38 juju-e4d256-prod-github-runner-207 kernel: [70492.606524] __x64_sys_ioctl+0x95/0xd0 Aug 23 00:58:38 juju-e4d256-prod-github-runner-207 kernel: [70492.607213] do_syscall_64+0x5c/0xc0 Aug 23 00:58:38 juju-e4d256-prod-github-runner-207 kernel: [70492.607876] ? do_futex+0x162/0x1f0 Aug 23 00:58:38 juju-e4d256-prod-github-runner-207 kernel: [70492.608527] ? __x64_sys_futex+0x78/0x1e0 Aug 23 00:58:38 juju-e4d256-prod-github-runner-207 kernel: [70492.609198] ? __secure_computing+0xa9/0x120 Aug 23 00:58:38 juju-e4d256-prod-github-runner-207 kernel: [70492.609885] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 00:58:38 juju-e4d256-prod-github-runner-207 kernel: [70492.610653] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:58:38 juju-e4d256-prod-github-runner-207 kernel: [70492.611439] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:58:38 juju-e4d256-prod-github-runner-207 kernel: [70492.612199] ? do_syscall_64+0x69/0xc0 Aug 23 00:58:38 juju-e4d256-prod-github-runner-207 kernel: [70492.612849] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:58:38 juju-e4d256-prod-github-runner-207 kernel: [70492.613553] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:58:38 juju-e4d256-prod-github-runner-207 kernel: [70492.614277] ? do_syscall_64+0x69/0xc0 Aug 23 00:58:38 juju-e4d256-prod-github-runner-207 kernel: [70492.614912] ? do_syscall_64+0x69/0xc0 Aug 23 00:58:38 juju-e4d256-prod-github-runner-207 kernel: [70492.615535] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 00:58:38 juju-e4d256-prod-github-runner-207 kernel: [70492.616239] RIP: 0033:0x7faa5d0edaff Aug 23 00:58:38 juju-e4d256-prod-github-runner-207 kernel: [70492.616865] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 00:58:38 juju-e4d256-prod-github-runner-207 kernel: [70492.618872] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 00:58:38 juju-e4d256-prod-github-runner-207 kernel: [70492.619816] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 00:58:38 juju-e4d256-prod-github-runner-207 kernel: [70492.620727] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 00:58:38 juju-e4d256-prod-github-runner-207 kernel: [70492.621621] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 00:58:38 juju-e4d256-prod-github-runner-207 kernel: [70492.622533] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 00:58:38 juju-e4d256-prod-github-runner-207 kernel: [70492.623428] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 00:58:38 juju-e4d256-prod-github-runner-207 kernel: [70492.624323] Aug 23 00:59:06 juju-e4d256-prod-github-runner-207 kernel: [70520.541976] watchdog: BUG: soft lockup - CPU#1 stuck for 65569s! [qemu-system-x86:6715] Aug 23 00:59:06 juju-e4d256-prod-github-runner-207 kernel: [70520.543650] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 00:59:06 juju-e4d256-prod-github-runner-207 kernel: [70520.543866] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 00:59:06 juju-e4d256-prod-github-runner-207 kernel: [70520.555926] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 00:59:06 juju-e4d256-prod-github-runner-207 kernel: [70520.557195] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 00:59:06 juju-e4d256-prod-github-runner-207 kernel: [70520.558424] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:59:06 juju-e4d256-prod-github-runner-207 kernel: [70520.559487] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 00:59:06 juju-e4d256-prod-github-runner-207 kernel: [70520.562040] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 00:59:06 juju-e4d256-prod-github-runner-207 kernel: [70520.563087] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 00:59:06 juju-e4d256-prod-github-runner-207 kernel: [70520.564248] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 00:59:06 juju-e4d256-prod-github-runner-207 kernel: [70520.565404] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 00:59:06 juju-e4d256-prod-github-runner-207 kernel: [70520.566580] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 00:59:06 juju-e4d256-prod-github-runner-207 kernel: [70520.567743] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 00:59:06 juju-e4d256-prod-github-runner-207 kernel: [70520.568911] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 00:59:06 juju-e4d256-prod-github-runner-207 kernel: [70520.570147] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 00:59:06 juju-e4d256-prod-github-runner-207 kernel: [70520.571244] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 00:59:06 juju-e4d256-prod-github-runner-207 kernel: [70520.572435] Call Trace: Aug 23 00:59:06 juju-e4d256-prod-github-runner-207 kernel: [70520.573351] Aug 23 00:59:06 juju-e4d256-prod-github-runner-207 kernel: [70520.574255] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:59:06 juju-e4d256-prod-github-runner-207 kernel: [70520.575288] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:59:06 juju-e4d256-prod-github-runner-207 kernel: [70520.576314] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:59:06 juju-e4d256-prod-github-runner-207 kernel: [70520.577400] ? show_regs.part.0+0x23/0x29 Aug 23 00:59:06 juju-e4d256-prod-github-runner-207 kernel: [70520.578405] ? show_regs.cold+0x8/0xd Aug 23 00:59:06 juju-e4d256-prod-github-runner-207 kernel: [70520.579375] ? watchdog_timer_fn+0x1be/0x220 Aug 23 00:59:06 juju-e4d256-prod-github-runner-207 kernel: [70520.580382] ? lockup_detector_update_enable+0x60/0x60 Aug 23 00:59:06 juju-e4d256-prod-github-runner-207 kernel: [70520.581443] ? __hrtimer_run_queues+0x107/0x230 Aug 23 00:59:06 juju-e4d256-prod-github-runner-207 kernel: [70520.582484] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 00:59:06 juju-e4d256-prod-github-runner-207 kernel: [70520.583507] ? hrtimer_interrupt+0x101/0x220 Aug 23 00:59:06 juju-e4d256-prod-github-runner-207 kernel: [70520.584523] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 00:59:06 juju-e4d256-prod-github-runner-207 kernel: [70520.585592] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 00:59:06 juju-e4d256-prod-github-runner-207 kernel: [70520.586648] Aug 23 00:59:06 juju-e4d256-prod-github-runner-207 kernel: [70520.587503] Aug 23 00:59:06 juju-e4d256-prod-github-runner-207 kernel: [70520.588342] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 00:59:06 juju-e4d256-prod-github-runner-207 kernel: [70520.589379] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:59:06 juju-e4d256-prod-github-runner-207 kernel: [70520.590426] ? _raw_spin_lock+0x22/0x30 Aug 23 00:59:06 juju-e4d256-prod-github-runner-207 kernel: [70520.591375] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:59:06 juju-e4d256-prod-github-runner-207 kernel: [70520.592390] direct_page_fault+0x206/0x310 [kvm] Aug 23 00:59:06 juju-e4d256-prod-github-runner-207 kernel: [70520.593413] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 00:59:06 juju-e4d256-prod-github-runner-207 kernel: [70520.594427] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 00:59:06 juju-e4d256-prod-github-runner-207 kernel: [70520.595427] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 00:59:06 juju-e4d256-prod-github-runner-207 kernel: [70520.596418] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 00:59:06 juju-e4d256-prod-github-runner-207 kernel: [70520.597361] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 00:59:06 juju-e4d256-prod-github-runner-207 kernel: [70520.598348] handle_exit+0x98/0x230 [kvm_amd] Aug 23 00:59:06 juju-e4d256-prod-github-runner-207 kernel: [70520.599240] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 00:59:06 juju-e4d256-prod-github-runner-207 kernel: [70520.600150] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 00:59:06 juju-e4d256-prod-github-runner-207 kernel: [70520.601076] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 00:59:06 juju-e4d256-prod-github-runner-207 kernel: [70520.601993] vcpu_run+0x62/0x2c0 [kvm] Aug 23 00:59:06 juju-e4d256-prod-github-runner-207 kernel: [70520.602802] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 00:59:06 juju-e4d256-prod-github-runner-207 kernel: [70520.603641] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 00:59:06 juju-e4d256-prod-github-runner-207 kernel: [70520.604498] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 00:59:06 juju-e4d256-prod-github-runner-207 kernel: [70520.605292] ? __seccomp_filter+0x4a/0x4a0 Aug 23 00:59:06 juju-e4d256-prod-github-runner-207 kernel: [70520.606038] ? __fget_files+0x86/0xc0 Aug 23 00:59:06 juju-e4d256-prod-github-runner-207 kernel: [70520.606745] __x64_sys_ioctl+0x95/0xd0 Aug 23 00:59:06 juju-e4d256-prod-github-runner-207 kernel: [70520.607435] do_syscall_64+0x5c/0xc0 Aug 23 00:59:06 juju-e4d256-prod-github-runner-207 kernel: [70520.608096] ? do_futex+0x162/0x1f0 Aug 23 00:59:06 juju-e4d256-prod-github-runner-207 kernel: [70520.608749] ? __x64_sys_futex+0x78/0x1e0 Aug 23 00:59:06 juju-e4d256-prod-github-runner-207 kernel: [70520.609419] ? __secure_computing+0xa9/0x120 Aug 23 00:59:06 juju-e4d256-prod-github-runner-207 kernel: [70520.610117] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 00:59:06 juju-e4d256-prod-github-runner-207 kernel: [70520.610876] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:59:06 juju-e4d256-prod-github-runner-207 kernel: [70520.611594] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:59:06 juju-e4d256-prod-github-runner-207 kernel: [70520.612308] ? do_syscall_64+0x69/0xc0 Aug 23 00:59:06 juju-e4d256-prod-github-runner-207 kernel: [70520.613010] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:59:06 juju-e4d256-prod-github-runner-207 kernel: [70520.613722] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:59:06 juju-e4d256-prod-github-runner-207 kernel: [70520.614416] ? do_syscall_64+0x69/0xc0 Aug 23 00:59:06 juju-e4d256-prod-github-runner-207 kernel: [70520.615038] ? do_syscall_64+0x69/0xc0 Aug 23 00:59:06 juju-e4d256-prod-github-runner-207 kernel: [70520.615659] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 00:59:06 juju-e4d256-prod-github-runner-207 kernel: [70520.616484] RIP: 0033:0x7faa5d0edaff Aug 23 00:59:06 juju-e4d256-prod-github-runner-207 kernel: [70520.618158] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 00:59:06 juju-e4d256-prod-github-runner-207 kernel: [70520.620258] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 00:59:06 juju-e4d256-prod-github-runner-207 kernel: [70520.621171] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 00:59:06 juju-e4d256-prod-github-runner-207 kernel: [70520.622078] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 00:59:06 juju-e4d256-prod-github-runner-207 kernel: [70520.622972] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 00:59:06 juju-e4d256-prod-github-runner-207 kernel: [70520.623858] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 00:59:06 juju-e4d256-prod-github-runner-207 kernel: [70520.624745] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 00:59:06 juju-e4d256-prod-github-runner-207 kernel: [70520.625654] Aug 23 00:59:34 juju-e4d256-prod-github-runner-207 kernel: [70548.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 65595s! [qemu-system-x86:6715] Aug 23 00:59:34 juju-e4d256-prod-github-runner-207 kernel: [70548.543095] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 00:59:34 juju-e4d256-prod-github-runner-207 kernel: [70548.543163] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 00:59:34 juju-e4d256-prod-github-runner-207 kernel: [70548.555264] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 00:59:34 juju-e4d256-prod-github-runner-207 kernel: [70548.556529] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 00:59:34 juju-e4d256-prod-github-runner-207 kernel: [70548.557770] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:59:34 juju-e4d256-prod-github-runner-207 kernel: [70548.558839] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 00:59:34 juju-e4d256-prod-github-runner-207 kernel: [70548.561407] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 00:59:34 juju-e4d256-prod-github-runner-207 kernel: [70548.562456] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 00:59:34 juju-e4d256-prod-github-runner-207 kernel: [70548.563625] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 00:59:34 juju-e4d256-prod-github-runner-207 kernel: [70548.564794] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 00:59:34 juju-e4d256-prod-github-runner-207 kernel: [70548.565983] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 00:59:34 juju-e4d256-prod-github-runner-207 kernel: [70548.567151] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 00:59:34 juju-e4d256-prod-github-runner-207 kernel: [70548.568328] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 00:59:34 juju-e4d256-prod-github-runner-207 kernel: [70548.569579] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 00:59:34 juju-e4d256-prod-github-runner-207 kernel: [70548.570677] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 00:59:34 juju-e4d256-prod-github-runner-207 kernel: [70548.571869] Call Trace: Aug 23 00:59:34 juju-e4d256-prod-github-runner-207 kernel: [70548.572782] Aug 23 00:59:34 juju-e4d256-prod-github-runner-207 kernel: [70548.573678] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:59:34 juju-e4d256-prod-github-runner-207 kernel: [70548.574709] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 00:59:34 juju-e4d256-prod-github-runner-207 kernel: [70548.575734] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:59:34 juju-e4d256-prod-github-runner-207 kernel: [70548.576821] ? show_regs.part.0+0x23/0x29 Aug 23 00:59:34 juju-e4d256-prod-github-runner-207 kernel: [70548.577847] ? show_regs.cold+0x8/0xd Aug 23 00:59:34 juju-e4d256-prod-github-runner-207 kernel: [70548.578822] ? watchdog_timer_fn+0x1be/0x220 Aug 23 00:59:34 juju-e4d256-prod-github-runner-207 kernel: [70548.579837] ? lockup_detector_update_enable+0x60/0x60 Aug 23 00:59:34 juju-e4d256-prod-github-runner-207 kernel: [70548.580906] ? __hrtimer_run_queues+0x107/0x230 Aug 23 00:59:34 juju-e4d256-prod-github-runner-207 kernel: [70548.581946] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 00:59:34 juju-e4d256-prod-github-runner-207 kernel: [70548.582972] ? hrtimer_interrupt+0x101/0x220 Aug 23 00:59:34 juju-e4d256-prod-github-runner-207 kernel: [70548.583988] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 00:59:34 juju-e4d256-prod-github-runner-207 kernel: [70548.585063] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 00:59:34 juju-e4d256-prod-github-runner-207 kernel: [70548.586122] Aug 23 00:59:34 juju-e4d256-prod-github-runner-207 kernel: [70548.586979] Aug 23 00:59:34 juju-e4d256-prod-github-runner-207 kernel: [70548.587817] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 00:59:34 juju-e4d256-prod-github-runner-207 kernel: [70548.588854] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:59:34 juju-e4d256-prod-github-runner-207 kernel: [70548.589911] ? _raw_spin_lock+0x22/0x30 Aug 23 00:59:34 juju-e4d256-prod-github-runner-207 kernel: [70548.590855] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:59:34 juju-e4d256-prod-github-runner-207 kernel: [70548.591870] direct_page_fault+0x206/0x310 [kvm] Aug 23 00:59:34 juju-e4d256-prod-github-runner-207 kernel: [70548.592899] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 00:59:34 juju-e4d256-prod-github-runner-207 kernel: [70548.593924] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 00:59:34 juju-e4d256-prod-github-runner-207 kernel: [70548.594931] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 00:59:34 juju-e4d256-prod-github-runner-207 kernel: [70548.595901] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 00:59:34 juju-e4d256-prod-github-runner-207 kernel: [70548.596850] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 00:59:34 juju-e4d256-prod-github-runner-207 kernel: [70548.597869] handle_exit+0x98/0x230 [kvm_amd] Aug 23 00:59:34 juju-e4d256-prod-github-runner-207 kernel: [70548.598773] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 00:59:34 juju-e4d256-prod-github-runner-207 kernel: [70548.599693] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 00:59:34 juju-e4d256-prod-github-runner-207 kernel: [70548.600622] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 00:59:34 juju-e4d256-prod-github-runner-207 kernel: [70548.601538] vcpu_run+0x62/0x2c0 [kvm] Aug 23 00:59:34 juju-e4d256-prod-github-runner-207 kernel: [70548.602354] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 00:59:34 juju-e4d256-prod-github-runner-207 kernel: [70548.603168] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 00:59:34 juju-e4d256-prod-github-runner-207 kernel: [70548.604027] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 00:59:34 juju-e4d256-prod-github-runner-207 kernel: [70548.604825] ? __seccomp_filter+0x4a/0x4a0 Aug 23 00:59:34 juju-e4d256-prod-github-runner-207 kernel: [70548.605578] ? __fget_files+0x86/0xc0 Aug 23 00:59:34 juju-e4d256-prod-github-runner-207 kernel: [70548.606283] __x64_sys_ioctl+0x95/0xd0 Aug 23 00:59:34 juju-e4d256-prod-github-runner-207 kernel: [70548.606976] do_syscall_64+0x5c/0xc0 Aug 23 00:59:34 juju-e4d256-prod-github-runner-207 kernel: [70548.607642] ? do_futex+0x162/0x1f0 Aug 23 00:59:34 juju-e4d256-prod-github-runner-207 kernel: [70548.608297] ? __x64_sys_futex+0x78/0x1e0 Aug 23 00:59:34 juju-e4d256-prod-github-runner-207 kernel: [70548.608977] ? __secure_computing+0xa9/0x120 Aug 23 00:59:34 juju-e4d256-prod-github-runner-207 kernel: [70548.609678] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 00:59:34 juju-e4d256-prod-github-runner-207 kernel: [70548.610443] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:59:34 juju-e4d256-prod-github-runner-207 kernel: [70548.611170] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:59:34 juju-e4d256-prod-github-runner-207 kernel: [70548.611892] ? do_syscall_64+0x69/0xc0 Aug 23 00:59:34 juju-e4d256-prod-github-runner-207 kernel: [70548.612536] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:59:34 juju-e4d256-prod-github-runner-207 kernel: [70548.613246] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:59:34 juju-e4d256-prod-github-runner-207 kernel: [70548.613952] ? do_syscall_64+0x69/0xc0 Aug 23 00:59:34 juju-e4d256-prod-github-runner-207 kernel: [70548.614578] ? do_syscall_64+0x69/0xc0 Aug 23 00:59:34 juju-e4d256-prod-github-runner-207 kernel: [70548.615205] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 00:59:34 juju-e4d256-prod-github-runner-207 kernel: [70548.615916] RIP: 0033:0x7faa5d0edaff Aug 23 00:59:34 juju-e4d256-prod-github-runner-207 kernel: [70548.616543] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 00:59:34 juju-e4d256-prod-github-runner-207 kernel: [70548.618551] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 00:59:34 juju-e4d256-prod-github-runner-207 kernel: [70548.619465] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 00:59:34 juju-e4d256-prod-github-runner-207 kernel: [70548.620352] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 00:59:34 juju-e4d256-prod-github-runner-207 kernel: [70548.621246] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 00:59:34 juju-e4d256-prod-github-runner-207 kernel: [70548.622235] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 00:59:34 juju-e4d256-prod-github-runner-207 kernel: [70548.623165] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 00:59:34 juju-e4d256-prod-github-runner-207 kernel: [70548.624091] Aug 23 00:59:47 juju-e4d256-prod-github-runner-207 kernel: [70561.892709] rcu: INFO: rcu_sched self-detected stall on CPU Aug 23 00:59:47 juju-e4d256-prod-github-runner-207 kernel: [70561.893700] rcu: 1-....: (17555685 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=8478368 Aug 23 00:59:47 juju-e4d256-prod-github-runner-207 kernel: [70561.894823] (t=17611173 jiffies g=23269 q=60707) Aug 23 00:59:47 juju-e4d256-prod-github-runner-207 kernel: [70561.895608] NMI backtrace for cpu 1 Aug 23 00:59:47 juju-e4d256-prod-github-runner-207 kernel: [70561.896322] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 00:59:47 juju-e4d256-prod-github-runner-207 kernel: [70561.897439] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 00:59:47 juju-e4d256-prod-github-runner-207 kernel: [70561.898503] Call Trace: Aug 23 00:59:47 juju-e4d256-prod-github-runner-207 kernel: [70561.899177] Aug 23 00:59:47 juju-e4d256-prod-github-runner-207 kernel: [70561.899821] show_stack+0x52/0x5c Aug 23 00:59:47 juju-e4d256-prod-github-runner-207 kernel: [70561.900581] dump_stack_lvl+0x4a/0x63 Aug 23 00:59:47 juju-e4d256-prod-github-runner-207 kernel: [70561.901374] dump_stack+0x10/0x16 Aug 23 00:59:47 juju-e4d256-prod-github-runner-207 kernel: [70561.902092] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 23 00:59:47 juju-e4d256-prod-github-runner-207 kernel: [70561.902889] ? lapic_can_unplug_cpu+0x90/0x90 Aug 23 00:59:47 juju-e4d256-prod-github-runner-207 kernel: [70561.903688] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 23 00:59:47 juju-e4d256-prod-github-runner-207 kernel: [70561.904529] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 23 00:59:47 juju-e4d256-prod-github-runner-207 kernel: [70561.905365] trigger_single_cpu_backtrace+0x44/0x4f Aug 23 00:59:47 juju-e4d256-prod-github-runner-207 kernel: [70561.906177] rcu_dump_cpu_stacks+0x102/0x149 Aug 23 00:59:47 juju-e4d256-prod-github-runner-207 kernel: [70561.906948] print_cpu_stall.cold+0x2f/0xe2 Aug 23 00:59:47 juju-e4d256-prod-github-runner-207 kernel: [70561.907710] ? timekeeping_update+0xf7/0x150 Aug 23 00:59:47 juju-e4d256-prod-github-runner-207 kernel: [70561.908483] check_cpu_stall+0x109/0x270 Aug 23 00:59:47 juju-e4d256-prod-github-runner-207 kernel: [70561.909306] rcu_sched_clock_irq+0x9a/0x250 Aug 23 00:59:47 juju-e4d256-prod-github-runner-207 kernel: [70561.910069] update_process_times+0x94/0xd0 Aug 23 00:59:47 juju-e4d256-prod-github-runner-207 kernel: [70561.910826] tick_sched_handle+0x29/0x70 Aug 23 00:59:47 juju-e4d256-prod-github-runner-207 kernel: [70561.911606] tick_sched_timer+0x8c/0xc0 Aug 23 00:59:47 juju-e4d256-prod-github-runner-207 kernel: [70561.912345] ? tick_nohz_handler+0xb0/0xb0 Aug 23 00:59:47 juju-e4d256-prod-github-runner-207 kernel: [70561.913098] __hrtimer_run_queues+0x107/0x230 Aug 23 00:59:47 juju-e4d256-prod-github-runner-207 kernel: [70561.913897] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 00:59:47 juju-e4d256-prod-github-runner-207 kernel: [70561.914677] hrtimer_interrupt+0x101/0x220 Aug 23 00:59:47 juju-e4d256-prod-github-runner-207 kernel: [70561.915441] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 00:59:47 juju-e4d256-prod-github-runner-207 kernel: [70561.916252] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 00:59:47 juju-e4d256-prod-github-runner-207 kernel: [70561.917054] Aug 23 00:59:47 juju-e4d256-prod-github-runner-207 kernel: [70561.917705] Aug 23 00:59:47 juju-e4d256-prod-github-runner-207 kernel: [70561.918338] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 00:59:47 juju-e4d256-prod-github-runner-207 kernel: [70561.919157] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 00:59:47 juju-e4d256-prod-github-runner-207 kernel: [70561.920035] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 00:59:47 juju-e4d256-prod-github-runner-207 kernel: [70561.922272] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 00:59:47 juju-e4d256-prod-github-runner-207 kernel: [70561.923177] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 00:59:47 juju-e4d256-prod-github-runner-207 kernel: [70561.924180] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 00:59:47 juju-e4d256-prod-github-runner-207 kernel: [70561.925169] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 00:59:47 juju-e4d256-prod-github-runner-207 kernel: [70561.926141] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 00:59:47 juju-e4d256-prod-github-runner-207 kernel: [70561.927101] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 00:59:47 juju-e4d256-prod-github-runner-207 kernel: [70561.928055] ? _raw_spin_lock+0x22/0x30 Aug 23 00:59:47 juju-e4d256-prod-github-runner-207 kernel: [70561.928812] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 00:59:47 juju-e4d256-prod-github-runner-207 kernel: [70561.929668] direct_page_fault+0x206/0x310 [kvm] Aug 23 00:59:47 juju-e4d256-prod-github-runner-207 kernel: [70561.930519] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 00:59:47 juju-e4d256-prod-github-runner-207 kernel: [70561.931346] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 00:59:47 juju-e4d256-prod-github-runner-207 kernel: [70561.932183] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 00:59:47 juju-e4d256-prod-github-runner-207 kernel: [70561.933001] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 00:59:47 juju-e4d256-prod-github-runner-207 kernel: [70561.933800] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 00:59:47 juju-e4d256-prod-github-runner-207 kernel: [70561.934626] handle_exit+0x98/0x230 [kvm_amd] Aug 23 00:59:47 juju-e4d256-prod-github-runner-207 kernel: [70561.935376] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 00:59:47 juju-e4d256-prod-github-runner-207 kernel: [70561.936158] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 00:59:47 juju-e4d256-prod-github-runner-207 kernel: [70561.936959] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 00:59:47 juju-e4d256-prod-github-runner-207 kernel: [70561.937755] vcpu_run+0x62/0x2c0 [kvm] Aug 23 00:59:47 juju-e4d256-prod-github-runner-207 kernel: [70561.938469] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 00:59:47 juju-e4d256-prod-github-runner-207 kernel: [70561.939199] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 00:59:47 juju-e4d256-prod-github-runner-207 kernel: [70561.939997] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 00:59:47 juju-e4d256-prod-github-runner-207 kernel: [70561.940755] ? __seccomp_filter+0x4a/0x4a0 Aug 23 00:59:47 juju-e4d256-prod-github-runner-207 kernel: [70561.941491] ? __fget_files+0x86/0xc0 Aug 23 00:59:47 juju-e4d256-prod-github-runner-207 kernel: [70561.942187] __x64_sys_ioctl+0x95/0xd0 Aug 23 00:59:47 juju-e4d256-prod-github-runner-207 kernel: [70561.942886] do_syscall_64+0x5c/0xc0 Aug 23 00:59:47 juju-e4d256-prod-github-runner-207 kernel: [70561.943570] ? do_futex+0x162/0x1f0 Aug 23 00:59:47 juju-e4d256-prod-github-runner-207 kernel: [70561.944244] ? __x64_sys_futex+0x78/0x1e0 Aug 23 00:59:47 juju-e4d256-prod-github-runner-207 kernel: [70561.944949] ? __secure_computing+0xa9/0x120 Aug 23 00:59:47 juju-e4d256-prod-github-runner-207 kernel: [70561.945681] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 00:59:47 juju-e4d256-prod-github-runner-207 kernel: [70561.946472] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:59:47 juju-e4d256-prod-github-runner-207 kernel: [70561.947228] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:59:47 juju-e4d256-prod-github-runner-207 kernel: [70561.947984] ? do_syscall_64+0x69/0xc0 Aug 23 00:59:47 juju-e4d256-prod-github-runner-207 kernel: [70561.948673] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 00:59:47 juju-e4d256-prod-github-runner-207 kernel: [70561.949459] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 00:59:47 juju-e4d256-prod-github-runner-207 kernel: [70561.950220] ? do_syscall_64+0x69/0xc0 Aug 23 00:59:47 juju-e4d256-prod-github-runner-207 kernel: [70561.950911] ? do_syscall_64+0x69/0xc0 Aug 23 00:59:47 juju-e4d256-prod-github-runner-207 kernel: [70561.951626] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 00:59:47 juju-e4d256-prod-github-runner-207 kernel: [70561.952408] RIP: 0033:0x7faa5d0edaff Aug 23 00:59:47 juju-e4d256-prod-github-runner-207 kernel: [70561.953138] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 00:59:47 juju-e4d256-prod-github-runner-207 kernel: [70561.955237] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 00:59:47 juju-e4d256-prod-github-runner-207 kernel: [70561.956198] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 00:59:47 juju-e4d256-prod-github-runner-207 kernel: [70561.957154] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 00:59:47 juju-e4d256-prod-github-runner-207 kernel: [70561.958104] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 00:59:47 juju-e4d256-prod-github-runner-207 kernel: [70561.959053] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 00:59:47 juju-e4d256-prod-github-runner-207 kernel: [70561.959982] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 00:59:47 juju-e4d256-prod-github-runner-207 kernel: [70561.960901] Aug 23 01:00:14 juju-e4d256-prod-github-runner-207 kernel: [70588.541976] watchdog: BUG: soft lockup - CPU#1 stuck for 65632s! [qemu-system-x86:6715] Aug 23 01:00:14 juju-e4d256-prod-github-runner-207 kernel: [70588.543505] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 01:00:14 juju-e4d256-prod-github-runner-207 kernel: [70588.543582] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 01:00:14 juju-e4d256-prod-github-runner-207 kernel: [70588.557033] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 01:00:14 juju-e4d256-prod-github-runner-207 kernel: [70588.558298] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 01:00:14 juju-e4d256-prod-github-runner-207 kernel: [70588.559521] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:00:14 juju-e4d256-prod-github-runner-207 kernel: [70588.560580] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 01:00:14 juju-e4d256-prod-github-runner-207 kernel: [70588.563148] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 01:00:14 juju-e4d256-prod-github-runner-207 kernel: [70588.564202] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 01:00:14 juju-e4d256-prod-github-runner-207 kernel: [70588.565391] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 01:00:14 juju-e4d256-prod-github-runner-207 kernel: [70588.566560] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 01:00:14 juju-e4d256-prod-github-runner-207 kernel: [70588.567741] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 01:00:14 juju-e4d256-prod-github-runner-207 kernel: [70588.568921] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 01:00:14 juju-e4d256-prod-github-runner-207 kernel: [70588.570090] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 01:00:14 juju-e4d256-prod-github-runner-207 kernel: [70588.571327] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 01:00:14 juju-e4d256-prod-github-runner-207 kernel: [70588.572425] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 01:00:14 juju-e4d256-prod-github-runner-207 kernel: [70588.573642] Call Trace: Aug 23 01:00:14 juju-e4d256-prod-github-runner-207 kernel: [70588.574556] Aug 23 01:00:14 juju-e4d256-prod-github-runner-207 kernel: [70588.575449] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:00:14 juju-e4d256-prod-github-runner-207 kernel: [70588.576487] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:00:14 juju-e4d256-prod-github-runner-207 kernel: [70588.577530] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:00:14 juju-e4d256-prod-github-runner-207 kernel: [70588.578629] ? show_regs.part.0+0x23/0x29 Aug 23 01:00:14 juju-e4d256-prod-github-runner-207 kernel: [70588.579722] ? show_regs.cold+0x8/0xd Aug 23 01:00:14 juju-e4d256-prod-github-runner-207 kernel: [70588.580703] ? watchdog_timer_fn+0x1be/0x220 Aug 23 01:00:14 juju-e4d256-prod-github-runner-207 kernel: [70588.581743] ? lockup_detector_update_enable+0x60/0x60 Aug 23 01:00:14 juju-e4d256-prod-github-runner-207 kernel: [70588.582809] ? __hrtimer_run_queues+0x107/0x230 Aug 23 01:00:14 juju-e4d256-prod-github-runner-207 kernel: [70588.583841] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 01:00:14 juju-e4d256-prod-github-runner-207 kernel: [70588.584897] ? hrtimer_interrupt+0x101/0x220 Aug 23 01:00:14 juju-e4d256-prod-github-runner-207 kernel: [70588.585920] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 01:00:14 juju-e4d256-prod-github-runner-207 kernel: [70588.586993] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 01:00:14 juju-e4d256-prod-github-runner-207 kernel: [70588.588042] Aug 23 01:00:14 juju-e4d256-prod-github-runner-207 kernel: [70588.588915] Aug 23 01:00:14 juju-e4d256-prod-github-runner-207 kernel: [70588.589934] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 01:00:14 juju-e4d256-prod-github-runner-207 kernel: [70588.591264] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:00:14 juju-e4d256-prod-github-runner-207 kernel: [70588.592447] ? _raw_spin_lock+0x22/0x30 Aug 23 01:00:14 juju-e4d256-prod-github-runner-207 kernel: [70588.593598] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:00:14 juju-e4d256-prod-github-runner-207 kernel: [70588.594863] direct_page_fault+0x206/0x310 [kvm] Aug 23 01:00:14 juju-e4d256-prod-github-runner-207 kernel: [70588.596138] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 01:00:14 juju-e4d256-prod-github-runner-207 kernel: [70588.597427] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 01:00:14 juju-e4d256-prod-github-runner-207 kernel: [70588.598675] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 01:00:14 juju-e4d256-prod-github-runner-207 kernel: [70588.599928] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 01:00:14 juju-e4d256-prod-github-runner-207 kernel: [70588.600986] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 01:00:14 juju-e4d256-prod-github-runner-207 kernel: [70588.601974] handle_exit+0x98/0x230 [kvm_amd] Aug 23 01:00:14 juju-e4d256-prod-github-runner-207 kernel: [70588.602872] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 01:00:14 juju-e4d256-prod-github-runner-207 kernel: [70588.603803] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 01:00:14 juju-e4d256-prod-github-runner-207 kernel: [70588.604738] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 01:00:14 juju-e4d256-prod-github-runner-207 kernel: [70588.605663] vcpu_run+0x62/0x2c0 [kvm] Aug 23 01:00:14 juju-e4d256-prod-github-runner-207 kernel: [70588.606483] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 01:00:14 juju-e4d256-prod-github-runner-207 kernel: [70588.607297] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 01:00:14 juju-e4d256-prod-github-runner-207 kernel: [70588.608154] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 01:00:14 juju-e4d256-prod-github-runner-207 kernel: [70588.608975] ? __seccomp_filter+0x4a/0x4a0 Aug 23 01:00:14 juju-e4d256-prod-github-runner-207 kernel: [70588.609727] ? __fget_files+0x86/0xc0 Aug 23 01:00:14 juju-e4d256-prod-github-runner-207 kernel: [70588.610443] __x64_sys_ioctl+0x95/0xd0 Aug 23 01:00:14 juju-e4d256-prod-github-runner-207 kernel: [70588.611141] do_syscall_64+0x5c/0xc0 Aug 23 01:00:14 juju-e4d256-prod-github-runner-207 kernel: [70588.611816] ? do_futex+0x162/0x1f0 Aug 23 01:00:14 juju-e4d256-prod-github-runner-207 kernel: [70588.612471] ? __x64_sys_futex+0x78/0x1e0 Aug 23 01:00:14 juju-e4d256-prod-github-runner-207 kernel: [70588.613166] ? __secure_computing+0xa9/0x120 Aug 23 01:00:14 juju-e4d256-prod-github-runner-207 kernel: [70588.613866] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 01:00:14 juju-e4d256-prod-github-runner-207 kernel: [70588.614629] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:00:14 juju-e4d256-prod-github-runner-207 kernel: [70588.615359] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:00:14 juju-e4d256-prod-github-runner-207 kernel: [70588.616081] ? do_syscall_64+0x69/0xc0 Aug 23 01:00:14 juju-e4d256-prod-github-runner-207 kernel: [70588.616734] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:00:14 juju-e4d256-prod-github-runner-207 kernel: [70588.617454] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:00:14 juju-e4d256-prod-github-runner-207 kernel: [70588.618149] ? do_syscall_64+0x69/0xc0 Aug 23 01:00:14 juju-e4d256-prod-github-runner-207 kernel: [70588.618779] ? do_syscall_64+0x69/0xc0 Aug 23 01:00:14 juju-e4d256-prod-github-runner-207 kernel: [70588.619402] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 01:00:14 juju-e4d256-prod-github-runner-207 kernel: [70588.620108] RIP: 0033:0x7faa5d0edaff Aug 23 01:00:14 juju-e4d256-prod-github-runner-207 kernel: [70588.620737] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 01:00:14 juju-e4d256-prod-github-runner-207 kernel: [70588.622752] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 01:00:14 juju-e4d256-prod-github-runner-207 kernel: [70588.623668] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 01:00:14 juju-e4d256-prod-github-runner-207 kernel: [70588.624559] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 01:00:14 juju-e4d256-prod-github-runner-207 kernel: [70588.625465] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 01:00:14 juju-e4d256-prod-github-runner-207 kernel: [70588.626353] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 01:00:14 juju-e4d256-prod-github-runner-207 kernel: [70588.627244] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 01:00:14 juju-e4d256-prod-github-runner-207 kernel: [70588.628139] Aug 23 01:00:42 juju-e4d256-prod-github-runner-207 kernel: [70616.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 65658s! [qemu-system-x86:6715] Aug 23 01:00:42 juju-e4d256-prod-github-runner-207 kernel: [70616.543727] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 01:00:42 juju-e4d256-prod-github-runner-207 kernel: [70616.543982] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 01:00:42 juju-e4d256-prod-github-runner-207 kernel: [70616.556712] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 01:00:42 juju-e4d256-prod-github-runner-207 kernel: [70616.558015] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 01:00:42 juju-e4d256-prod-github-runner-207 kernel: [70616.559256] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:00:42 juju-e4d256-prod-github-runner-207 kernel: [70616.560354] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 01:00:42 juju-e4d256-prod-github-runner-207 kernel: [70616.562987] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 01:00:42 juju-e4d256-prod-github-runner-207 kernel: [70616.564044] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 01:00:42 juju-e4d256-prod-github-runner-207 kernel: [70616.565239] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 01:00:42 juju-e4d256-prod-github-runner-207 kernel: [70616.566421] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 01:00:42 juju-e4d256-prod-github-runner-207 kernel: [70616.567604] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 01:00:42 juju-e4d256-prod-github-runner-207 kernel: [70616.568802] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 01:00:42 juju-e4d256-prod-github-runner-207 kernel: [70616.569989] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 01:00:42 juju-e4d256-prod-github-runner-207 kernel: [70616.571250] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 01:00:42 juju-e4d256-prod-github-runner-207 kernel: [70616.572370] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 01:00:42 juju-e4d256-prod-github-runner-207 kernel: [70616.573604] Call Trace: Aug 23 01:00:42 juju-e4d256-prod-github-runner-207 kernel: [70616.574525] Aug 23 01:00:42 juju-e4d256-prod-github-runner-207 kernel: [70616.575433] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:00:42 juju-e4d256-prod-github-runner-207 kernel: [70616.576498] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:00:42 juju-e4d256-prod-github-runner-207 kernel: [70616.577564] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:00:42 juju-e4d256-prod-github-runner-207 kernel: [70616.578675] ? show_regs.part.0+0x23/0x29 Aug 23 01:00:42 juju-e4d256-prod-github-runner-207 kernel: [70616.579686] ? show_regs.cold+0x8/0xd Aug 23 01:00:42 juju-e4d256-prod-github-runner-207 kernel: [70616.580688] ? watchdog_timer_fn+0x1be/0x220 Aug 23 01:00:42 juju-e4d256-prod-github-runner-207 kernel: [70616.581712] ? lockup_detector_update_enable+0x60/0x60 Aug 23 01:00:42 juju-e4d256-prod-github-runner-207 kernel: [70616.582794] ? __hrtimer_run_queues+0x107/0x230 Aug 23 01:00:42 juju-e4d256-prod-github-runner-207 kernel: [70616.583844] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 01:00:42 juju-e4d256-prod-github-runner-207 kernel: [70616.584898] ? hrtimer_interrupt+0x101/0x220 Aug 23 01:00:42 juju-e4d256-prod-github-runner-207 kernel: [70616.585947] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 01:00:42 juju-e4d256-prod-github-runner-207 kernel: [70616.587035] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 01:00:42 juju-e4d256-prod-github-runner-207 kernel: [70616.588099] Aug 23 01:00:42 juju-e4d256-prod-github-runner-207 kernel: [70616.588981] Aug 23 01:00:42 juju-e4d256-prod-github-runner-207 kernel: [70616.589829] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 01:00:42 juju-e4d256-prod-github-runner-207 kernel: [70616.590876] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:00:42 juju-e4d256-prod-github-runner-207 kernel: [70616.591930] ? _raw_spin_lock+0x22/0x30 Aug 23 01:00:42 juju-e4d256-prod-github-runner-207 kernel: [70616.592909] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:00:42 juju-e4d256-prod-github-runner-207 kernel: [70616.593940] direct_page_fault+0x206/0x310 [kvm] Aug 23 01:00:42 juju-e4d256-prod-github-runner-207 kernel: [70616.594978] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 01:00:42 juju-e4d256-prod-github-runner-207 kernel: [70616.596003] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 01:00:42 juju-e4d256-prod-github-runner-207 kernel: [70616.597029] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 01:00:42 juju-e4d256-prod-github-runner-207 kernel: [70616.598040] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 01:00:42 juju-e4d256-prod-github-runner-207 kernel: [70616.598998] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 01:00:42 juju-e4d256-prod-github-runner-207 kernel: [70616.599993] handle_exit+0x98/0x230 [kvm_amd] Aug 23 01:00:42 juju-e4d256-prod-github-runner-207 kernel: [70616.600915] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 01:00:42 juju-e4d256-prod-github-runner-207 kernel: [70616.601845] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 01:00:42 juju-e4d256-prod-github-runner-207 kernel: [70616.602790] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 01:00:42 juju-e4d256-prod-github-runner-207 kernel: [70616.603706] vcpu_run+0x62/0x2c0 [kvm] Aug 23 01:00:42 juju-e4d256-prod-github-runner-207 kernel: [70616.604548] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 01:00:42 juju-e4d256-prod-github-runner-207 kernel: [70616.605370] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 01:00:42 juju-e4d256-prod-github-runner-207 kernel: [70616.606241] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 01:00:42 juju-e4d256-prod-github-runner-207 kernel: [70616.607051] ? __seccomp_filter+0x4a/0x4a0 Aug 23 01:00:42 juju-e4d256-prod-github-runner-207 kernel: [70616.607804] ? __fget_files+0x86/0xc0 Aug 23 01:00:42 juju-e4d256-prod-github-runner-207 kernel: [70616.608537] __x64_sys_ioctl+0x95/0xd0 Aug 23 01:00:42 juju-e4d256-prod-github-runner-207 kernel: [70616.609436] do_syscall_64+0x5c/0xc0 Aug 23 01:00:42 juju-e4d256-prod-github-runner-207 kernel: [70616.610290] ? do_futex+0x162/0x1f0 Aug 23 01:00:42 juju-e4d256-prod-github-runner-207 kernel: [70616.610952] ? __x64_sys_futex+0x78/0x1e0 Aug 23 01:00:42 juju-e4d256-prod-github-runner-207 kernel: [70616.611639] ? __secure_computing+0xa9/0x120 Aug 23 01:00:42 juju-e4d256-prod-github-runner-207 kernel: [70616.612338] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 01:00:42 juju-e4d256-prod-github-runner-207 kernel: [70616.613137] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:00:42 juju-e4d256-prod-github-runner-207 kernel: [70616.613874] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:00:42 juju-e4d256-prod-github-runner-207 kernel: [70616.614612] ? do_syscall_64+0x69/0xc0 Aug 23 01:00:42 juju-e4d256-prod-github-runner-207 kernel: [70616.615280] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:00:42 juju-e4d256-prod-github-runner-207 kernel: [70616.615999] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:00:42 juju-e4d256-prod-github-runner-207 kernel: [70616.616727] ? do_syscall_64+0x69/0xc0 Aug 23 01:00:42 juju-e4d256-prod-github-runner-207 kernel: [70616.617365] ? do_syscall_64+0x69/0xc0 Aug 23 01:00:42 juju-e4d256-prod-github-runner-207 kernel: [70616.618000] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 01:00:42 juju-e4d256-prod-github-runner-207 kernel: [70616.618726] RIP: 0033:0x7faa5d0edaff Aug 23 01:00:42 juju-e4d256-prod-github-runner-207 kernel: [70616.619397] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 01:00:42 juju-e4d256-prod-github-runner-207 kernel: [70616.621470] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 01:00:42 juju-e4d256-prod-github-runner-207 kernel: [70616.622442] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 01:00:42 juju-e4d256-prod-github-runner-207 kernel: [70616.623355] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 01:00:42 juju-e4d256-prod-github-runner-207 kernel: [70616.624265] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 01:00:42 juju-e4d256-prod-github-runner-207 kernel: [70616.625189] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 01:00:42 juju-e4d256-prod-github-runner-207 kernel: [70616.626093] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 01:00:42 juju-e4d256-prod-github-runner-207 kernel: [70616.627003] Aug 23 01:01:10 juju-e4d256-prod-github-runner-207 kernel: [70644.541983] watchdog: BUG: soft lockup - CPU#1 stuck for 65684s! [qemu-system-x86:6715] Aug 23 01:01:10 juju-e4d256-prod-github-runner-207 kernel: [70644.543607] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 01:01:10 juju-e4d256-prod-github-runner-207 kernel: [70644.543688] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 01:01:10 juju-e4d256-prod-github-runner-207 kernel: [70644.558364] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 01:01:10 juju-e4d256-prod-github-runner-207 kernel: [70644.559652] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 01:01:10 juju-e4d256-prod-github-runner-207 kernel: [70644.560910] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:01:10 juju-e4d256-prod-github-runner-207 kernel: [70644.562017] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 01:01:10 juju-e4d256-prod-github-runner-207 kernel: [70644.564621] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 01:01:10 juju-e4d256-prod-github-runner-207 kernel: [70644.565694] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 01:01:10 juju-e4d256-prod-github-runner-207 kernel: [70644.566854] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 01:01:10 juju-e4d256-prod-github-runner-207 kernel: [70644.568011] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 01:01:10 juju-e4d256-prod-github-runner-207 kernel: [70644.569193] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 01:01:10 juju-e4d256-prod-github-runner-207 kernel: [70644.570367] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 01:01:10 juju-e4d256-prod-github-runner-207 kernel: [70644.571576] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 01:01:10 juju-e4d256-prod-github-runner-207 kernel: [70644.572845] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 01:01:10 juju-e4d256-prod-github-runner-207 kernel: [70644.573946] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 01:01:10 juju-e4d256-prod-github-runner-207 kernel: [70644.575171] Call Trace: Aug 23 01:01:10 juju-e4d256-prod-github-runner-207 kernel: [70644.576089] Aug 23 01:01:10 juju-e4d256-prod-github-runner-207 kernel: [70644.576991] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:01:10 juju-e4d256-prod-github-runner-207 kernel: [70644.578021] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:01:10 juju-e4d256-prod-github-runner-207 kernel: [70644.579041] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:01:10 juju-e4d256-prod-github-runner-207 kernel: [70644.580190] ? show_regs.part.0+0x23/0x29 Aug 23 01:01:10 juju-e4d256-prod-github-runner-207 kernel: [70644.581238] ? show_regs.cold+0x8/0xd Aug 23 01:01:10 juju-e4d256-prod-github-runner-207 kernel: [70644.582254] ? watchdog_timer_fn+0x1be/0x220 Aug 23 01:01:10 juju-e4d256-prod-github-runner-207 kernel: [70644.583270] ? lockup_detector_update_enable+0x60/0x60 Aug 23 01:01:10 juju-e4d256-prod-github-runner-207 kernel: [70644.584368] ? __hrtimer_run_queues+0x107/0x230 Aug 23 01:01:10 juju-e4d256-prod-github-runner-207 kernel: [70644.585413] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 01:01:10 juju-e4d256-prod-github-runner-207 kernel: [70644.586448] ? hrtimer_interrupt+0x101/0x220 Aug 23 01:01:10 juju-e4d256-prod-github-runner-207 kernel: [70644.587462] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 01:01:10 juju-e4d256-prod-github-runner-207 kernel: [70644.588548] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 01:01:10 juju-e4d256-prod-github-runner-207 kernel: [70644.589631] Aug 23 01:01:10 juju-e4d256-prod-github-runner-207 kernel: [70644.590496] Aug 23 01:01:10 juju-e4d256-prod-github-runner-207 kernel: [70644.591353] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 01:01:10 juju-e4d256-prod-github-runner-207 kernel: [70644.592463] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:01:10 juju-e4d256-prod-github-runner-207 kernel: [70644.593620] ? _raw_spin_lock+0x22/0x30 Aug 23 01:01:10 juju-e4d256-prod-github-runner-207 kernel: [70644.594620] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:01:10 juju-e4d256-prod-github-runner-207 kernel: [70644.595677] direct_page_fault+0x206/0x310 [kvm] Aug 23 01:01:10 juju-e4d256-prod-github-runner-207 kernel: [70644.596739] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 01:01:10 juju-e4d256-prod-github-runner-207 kernel: [70644.597755] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 01:01:10 juju-e4d256-prod-github-runner-207 kernel: [70644.598765] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 01:01:10 juju-e4d256-prod-github-runner-207 kernel: [70644.599754] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 01:01:10 juju-e4d256-prod-github-runner-207 kernel: [70644.600750] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 01:01:10 juju-e4d256-prod-github-runner-207 kernel: [70644.601780] handle_exit+0x98/0x230 [kvm_amd] Aug 23 01:01:10 juju-e4d256-prod-github-runner-207 kernel: [70644.602705] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 01:01:10 juju-e4d256-prod-github-runner-207 kernel: [70644.603667] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 01:01:10 juju-e4d256-prod-github-runner-207 kernel: [70644.604624] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 01:01:10 juju-e4d256-prod-github-runner-207 kernel: [70644.605559] vcpu_run+0x62/0x2c0 [kvm] Aug 23 01:01:10 juju-e4d256-prod-github-runner-207 kernel: [70644.606395] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 01:01:10 juju-e4d256-prod-github-runner-207 kernel: [70644.607211] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 01:01:10 juju-e4d256-prod-github-runner-207 kernel: [70644.608077] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 01:01:10 juju-e4d256-prod-github-runner-207 kernel: [70644.608899] ? __seccomp_filter+0x4a/0x4a0 Aug 23 01:01:10 juju-e4d256-prod-github-runner-207 kernel: [70644.609647] ? __fget_files+0x86/0xc0 Aug 23 01:01:10 juju-e4d256-prod-github-runner-207 kernel: [70644.610437] __x64_sys_ioctl+0x95/0xd0 Aug 23 01:01:10 juju-e4d256-prod-github-runner-207 kernel: [70644.611163] do_syscall_64+0x5c/0xc0 Aug 23 01:01:10 juju-e4d256-prod-github-runner-207 kernel: [70644.611991] ? do_futex+0x162/0x1f0 Aug 23 01:01:10 juju-e4d256-prod-github-runner-207 kernel: [70644.612929] ? __x64_sys_futex+0x78/0x1e0 Aug 23 01:01:10 juju-e4d256-prod-github-runner-207 kernel: [70644.613749] ? __secure_computing+0xa9/0x120 Aug 23 01:01:10 juju-e4d256-prod-github-runner-207 kernel: [70644.614566] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 01:01:10 juju-e4d256-prod-github-runner-207 kernel: [70644.615343] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:01:10 juju-e4d256-prod-github-runner-207 kernel: [70644.616076] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:01:10 juju-e4d256-prod-github-runner-207 kernel: [70644.616828] ? do_syscall_64+0x69/0xc0 Aug 23 01:01:10 juju-e4d256-prod-github-runner-207 kernel: [70644.617472] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:01:10 juju-e4d256-prod-github-runner-207 kernel: [70644.618371] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:01:10 juju-e4d256-prod-github-runner-207 kernel: [70644.619102] ? do_syscall_64+0x69/0xc0 Aug 23 01:01:10 juju-e4d256-prod-github-runner-207 kernel: [70644.619731] ? do_syscall_64+0x69/0xc0 Aug 23 01:01:10 juju-e4d256-prod-github-runner-207 kernel: [70644.620368] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 01:01:10 juju-e4d256-prod-github-runner-207 kernel: [70644.621099] RIP: 0033:0x7faa5d0edaff Aug 23 01:01:10 juju-e4d256-prod-github-runner-207 kernel: [70644.621773] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 01:01:10 juju-e4d256-prod-github-runner-207 kernel: [70644.623787] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 01:01:10 juju-e4d256-prod-github-runner-207 kernel: [70644.624727] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 01:01:10 juju-e4d256-prod-github-runner-207 kernel: [70644.625627] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 01:01:10 juju-e4d256-prod-github-runner-207 kernel: [70644.626526] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 01:01:10 juju-e4d256-prod-github-runner-207 kernel: [70644.627498] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 01:01:10 juju-e4d256-prod-github-runner-207 kernel: [70644.628426] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 01:01:10 juju-e4d256-prod-github-runner-207 kernel: [70644.629339] Aug 23 01:01:38 juju-e4d256-prod-github-runner-207 kernel: [70672.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 65710s! [qemu-system-x86:6715] Aug 23 01:01:38 juju-e4d256-prod-github-runner-207 kernel: [70672.543095] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 01:01:38 juju-e4d256-prod-github-runner-207 kernel: [70672.543163] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 01:01:38 juju-e4d256-prod-github-runner-207 kernel: [70672.555213] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 01:01:38 juju-e4d256-prod-github-runner-207 kernel: [70672.556490] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 01:01:38 juju-e4d256-prod-github-runner-207 kernel: [70672.557736] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:01:38 juju-e4d256-prod-github-runner-207 kernel: [70672.558797] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 01:01:38 juju-e4d256-prod-github-runner-207 kernel: [70672.561361] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 01:01:38 juju-e4d256-prod-github-runner-207 kernel: [70672.562409] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 01:01:38 juju-e4d256-prod-github-runner-207 kernel: [70672.563569] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 01:01:38 juju-e4d256-prod-github-runner-207 kernel: [70672.564739] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 01:01:38 juju-e4d256-prod-github-runner-207 kernel: [70672.565900] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 01:01:38 juju-e4d256-prod-github-runner-207 kernel: [70672.567065] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 01:01:38 juju-e4d256-prod-github-runner-207 kernel: [70672.568253] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 01:01:38 juju-e4d256-prod-github-runner-207 kernel: [70672.569490] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 01:01:38 juju-e4d256-prod-github-runner-207 kernel: [70672.570586] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 01:01:38 juju-e4d256-prod-github-runner-207 kernel: [70672.571781] Call Trace: Aug 23 01:01:38 juju-e4d256-prod-github-runner-207 kernel: [70672.572706] Aug 23 01:01:38 juju-e4d256-prod-github-runner-207 kernel: [70672.573590] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:01:38 juju-e4d256-prod-github-runner-207 kernel: [70672.574655] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:01:38 juju-e4d256-prod-github-runner-207 kernel: [70672.575676] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:01:38 juju-e4d256-prod-github-runner-207 kernel: [70672.576768] ? show_regs.part.0+0x23/0x29 Aug 23 01:01:38 juju-e4d256-prod-github-runner-207 kernel: [70672.577763] ? show_regs.cold+0x8/0xd Aug 23 01:01:38 juju-e4d256-prod-github-runner-207 kernel: [70672.578733] ? watchdog_timer_fn+0x1be/0x220 Aug 23 01:01:38 juju-e4d256-prod-github-runner-207 kernel: [70672.579744] ? lockup_detector_update_enable+0x60/0x60 Aug 23 01:01:38 juju-e4d256-prod-github-runner-207 kernel: [70672.580818] ? __hrtimer_run_queues+0x107/0x230 Aug 23 01:01:38 juju-e4d256-prod-github-runner-207 kernel: [70672.581843] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 01:01:38 juju-e4d256-prod-github-runner-207 kernel: [70672.582871] ? hrtimer_interrupt+0x101/0x220 Aug 23 01:01:38 juju-e4d256-prod-github-runner-207 kernel: [70672.583897] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 01:01:38 juju-e4d256-prod-github-runner-207 kernel: [70672.584970] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 01:01:38 juju-e4d256-prod-github-runner-207 kernel: [70672.586018] Aug 23 01:01:38 juju-e4d256-prod-github-runner-207 kernel: [70672.586870] Aug 23 01:01:38 juju-e4d256-prod-github-runner-207 kernel: [70672.587711] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 01:01:38 juju-e4d256-prod-github-runner-207 kernel: [70672.588753] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:01:38 juju-e4d256-prod-github-runner-207 kernel: [70672.589796] ? _raw_spin_lock+0x22/0x30 Aug 23 01:01:38 juju-e4d256-prod-github-runner-207 kernel: [70672.590741] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:01:38 juju-e4d256-prod-github-runner-207 kernel: [70672.591761] direct_page_fault+0x206/0x310 [kvm] Aug 23 01:01:38 juju-e4d256-prod-github-runner-207 kernel: [70672.592793] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 01:01:38 juju-e4d256-prod-github-runner-207 kernel: [70672.593801] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 01:01:38 juju-e4d256-prod-github-runner-207 kernel: [70672.594808] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 01:01:38 juju-e4d256-prod-github-runner-207 kernel: [70672.595782] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 01:01:38 juju-e4d256-prod-github-runner-207 kernel: [70672.596765] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 01:01:38 juju-e4d256-prod-github-runner-207 kernel: [70672.597742] handle_exit+0x98/0x230 [kvm_amd] Aug 23 01:01:38 juju-e4d256-prod-github-runner-207 kernel: [70672.598633] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 01:01:38 juju-e4d256-prod-github-runner-207 kernel: [70672.599546] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 01:01:38 juju-e4d256-prod-github-runner-207 kernel: [70672.600518] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 01:01:38 juju-e4d256-prod-github-runner-207 kernel: [70672.601428] vcpu_run+0x62/0x2c0 [kvm] Aug 23 01:01:38 juju-e4d256-prod-github-runner-207 kernel: [70672.602237] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 01:01:38 juju-e4d256-prod-github-runner-207 kernel: [70672.603045] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 01:01:38 juju-e4d256-prod-github-runner-207 kernel: [70672.603912] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 01:01:38 juju-e4d256-prod-github-runner-207 kernel: [70672.604710] ? __seccomp_filter+0x4a/0x4a0 Aug 23 01:01:38 juju-e4d256-prod-github-runner-207 kernel: [70672.605459] ? __fget_files+0x86/0xc0 Aug 23 01:01:38 juju-e4d256-prod-github-runner-207 kernel: [70672.606163] __x64_sys_ioctl+0x95/0xd0 Aug 23 01:01:38 juju-e4d256-prod-github-runner-207 kernel: [70672.606856] do_syscall_64+0x5c/0xc0 Aug 23 01:01:38 juju-e4d256-prod-github-runner-207 kernel: [70672.607527] ? do_futex+0x162/0x1f0 Aug 23 01:01:38 juju-e4d256-prod-github-runner-207 kernel: [70672.608227] ? __x64_sys_futex+0x78/0x1e0 Aug 23 01:01:38 juju-e4d256-prod-github-runner-207 kernel: [70672.608901] ? __secure_computing+0xa9/0x120 Aug 23 01:01:38 juju-e4d256-prod-github-runner-207 kernel: [70672.609627] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 01:01:38 juju-e4d256-prod-github-runner-207 kernel: [70672.610427] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:01:38 juju-e4d256-prod-github-runner-207 kernel: [70672.611155] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:01:38 juju-e4d256-prod-github-runner-207 kernel: [70672.611881] ? do_syscall_64+0x69/0xc0 Aug 23 01:01:38 juju-e4d256-prod-github-runner-207 kernel: [70672.612525] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:01:38 juju-e4d256-prod-github-runner-207 kernel: [70672.613233] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:01:38 juju-e4d256-prod-github-runner-207 kernel: [70672.613951] ? do_syscall_64+0x69/0xc0 Aug 23 01:01:38 juju-e4d256-prod-github-runner-207 kernel: [70672.614575] ? do_syscall_64+0x69/0xc0 Aug 23 01:01:38 juju-e4d256-prod-github-runner-207 kernel: [70672.615199] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 01:01:38 juju-e4d256-prod-github-runner-207 kernel: [70672.615915] RIP: 0033:0x7faa5d0edaff Aug 23 01:01:38 juju-e4d256-prod-github-runner-207 kernel: [70672.616548] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 01:01:38 juju-e4d256-prod-github-runner-207 kernel: [70672.618548] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 01:01:38 juju-e4d256-prod-github-runner-207 kernel: [70672.619467] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 01:01:38 juju-e4d256-prod-github-runner-207 kernel: [70672.620371] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 01:01:38 juju-e4d256-prod-github-runner-207 kernel: [70672.621269] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 01:01:38 juju-e4d256-prod-github-runner-207 kernel: [70672.622159] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 01:01:38 juju-e4d256-prod-github-runner-207 kernel: [70672.623054] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 01:01:38 juju-e4d256-prod-github-runner-207 kernel: [70672.623961] Aug 23 01:02:06 juju-e4d256-prod-github-runner-207 kernel: [70700.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 65737s! [qemu-system-x86:6715] Aug 23 01:02:06 juju-e4d256-prod-github-runner-207 kernel: [70700.543744] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 01:02:06 juju-e4d256-prod-github-runner-207 kernel: [70700.543993] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 01:02:06 juju-e4d256-prod-github-runner-207 kernel: [70700.556066] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 01:02:06 juju-e4d256-prod-github-runner-207 kernel: [70700.557338] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 01:02:06 juju-e4d256-prod-github-runner-207 kernel: [70700.558560] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:02:06 juju-e4d256-prod-github-runner-207 kernel: [70700.559631] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 01:02:06 juju-e4d256-prod-github-runner-207 kernel: [70700.562184] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 01:02:06 juju-e4d256-prod-github-runner-207 kernel: [70700.563230] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 01:02:06 juju-e4d256-prod-github-runner-207 kernel: [70700.564402] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 01:02:06 juju-e4d256-prod-github-runner-207 kernel: [70700.565592] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 01:02:06 juju-e4d256-prod-github-runner-207 kernel: [70700.566753] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 01:02:06 juju-e4d256-prod-github-runner-207 kernel: [70700.567930] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 01:02:06 juju-e4d256-prod-github-runner-207 kernel: [70700.569105] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 01:02:06 juju-e4d256-prod-github-runner-207 kernel: [70700.570337] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 01:02:06 juju-e4d256-prod-github-runner-207 kernel: [70700.571434] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 01:02:06 juju-e4d256-prod-github-runner-207 kernel: [70700.572643] Call Trace: Aug 23 01:02:06 juju-e4d256-prod-github-runner-207 kernel: [70700.573555] Aug 23 01:02:06 juju-e4d256-prod-github-runner-207 kernel: [70700.574446] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:02:06 juju-e4d256-prod-github-runner-207 kernel: [70700.575488] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:02:06 juju-e4d256-prod-github-runner-207 kernel: [70700.576511] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:02:06 juju-e4d256-prod-github-runner-207 kernel: [70700.577600] ? show_regs.part.0+0x23/0x29 Aug 23 01:02:06 juju-e4d256-prod-github-runner-207 kernel: [70700.578596] ? show_regs.cold+0x8/0xd Aug 23 01:02:06 juju-e4d256-prod-github-runner-207 kernel: [70700.579588] ? watchdog_timer_fn+0x1be/0x220 Aug 23 01:02:06 juju-e4d256-prod-github-runner-207 kernel: [70700.580677] ? lockup_detector_update_enable+0x60/0x60 Aug 23 01:02:06 juju-e4d256-prod-github-runner-207 kernel: [70700.581746] ? __hrtimer_run_queues+0x107/0x230 Aug 23 01:02:06 juju-e4d256-prod-github-runner-207 kernel: [70700.582774] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 01:02:06 juju-e4d256-prod-github-runner-207 kernel: [70700.583812] ? hrtimer_interrupt+0x101/0x220 Aug 23 01:02:06 juju-e4d256-prod-github-runner-207 kernel: [70700.584834] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 01:02:06 juju-e4d256-prod-github-runner-207 kernel: [70700.585905] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 01:02:06 juju-e4d256-prod-github-runner-207 kernel: [70700.586953] Aug 23 01:02:06 juju-e4d256-prod-github-runner-207 kernel: [70700.587824] Aug 23 01:02:06 juju-e4d256-prod-github-runner-207 kernel: [70700.588662] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 01:02:06 juju-e4d256-prod-github-runner-207 kernel: [70700.589696] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:02:06 juju-e4d256-prod-github-runner-207 kernel: [70700.590740] ? _raw_spin_lock+0x22/0x30 Aug 23 01:02:06 juju-e4d256-prod-github-runner-207 kernel: [70700.591699] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:02:06 juju-e4d256-prod-github-runner-207 kernel: [70700.592715] direct_page_fault+0x206/0x310 [kvm] Aug 23 01:02:06 juju-e4d256-prod-github-runner-207 kernel: [70700.593747] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 01:02:06 juju-e4d256-prod-github-runner-207 kernel: [70700.594756] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 01:02:06 juju-e4d256-prod-github-runner-207 kernel: [70700.595771] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 01:02:06 juju-e4d256-prod-github-runner-207 kernel: [70700.596762] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 01:02:06 juju-e4d256-prod-github-runner-207 kernel: [70700.597711] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 01:02:06 juju-e4d256-prod-github-runner-207 kernel: [70700.598697] handle_exit+0x98/0x230 [kvm_amd] Aug 23 01:02:06 juju-e4d256-prod-github-runner-207 kernel: [70700.599603] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 01:02:06 juju-e4d256-prod-github-runner-207 kernel: [70700.600522] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 01:02:06 juju-e4d256-prod-github-runner-207 kernel: [70700.601551] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 01:02:06 juju-e4d256-prod-github-runner-207 kernel: [70700.602455] vcpu_run+0x62/0x2c0 [kvm] Aug 23 01:02:06 juju-e4d256-prod-github-runner-207 kernel: [70700.603267] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 01:02:06 juju-e4d256-prod-github-runner-207 kernel: [70700.604096] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 01:02:06 juju-e4d256-prod-github-runner-207 kernel: [70700.604951] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 01:02:06 juju-e4d256-prod-github-runner-207 kernel: [70700.605747] ? __seccomp_filter+0x4a/0x4a0 Aug 23 01:02:06 juju-e4d256-prod-github-runner-207 kernel: [70700.606495] ? __fget_files+0x86/0xc0 Aug 23 01:02:06 juju-e4d256-prod-github-runner-207 kernel: [70700.607199] __x64_sys_ioctl+0x95/0xd0 Aug 23 01:02:06 juju-e4d256-prod-github-runner-207 kernel: [70700.607904] do_syscall_64+0x5c/0xc0 Aug 23 01:02:06 juju-e4d256-prod-github-runner-207 kernel: [70700.608574] ? do_futex+0x162/0x1f0 Aug 23 01:02:06 juju-e4d256-prod-github-runner-207 kernel: [70700.609223] ? __x64_sys_futex+0x78/0x1e0 Aug 23 01:02:06 juju-e4d256-prod-github-runner-207 kernel: [70700.609902] ? __secure_computing+0xa9/0x120 Aug 23 01:02:06 juju-e4d256-prod-github-runner-207 kernel: [70700.610591] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 01:02:06 juju-e4d256-prod-github-runner-207 kernel: [70700.611352] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:02:06 juju-e4d256-prod-github-runner-207 kernel: [70700.612089] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:02:06 juju-e4d256-prod-github-runner-207 kernel: [70700.612815] ? do_syscall_64+0x69/0xc0 Aug 23 01:02:06 juju-e4d256-prod-github-runner-207 kernel: [70700.613461] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:02:06 juju-e4d256-prod-github-runner-207 kernel: [70700.614163] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:02:06 juju-e4d256-prod-github-runner-207 kernel: [70700.614858] ? do_syscall_64+0x69/0xc0 Aug 23 01:02:06 juju-e4d256-prod-github-runner-207 kernel: [70700.615500] ? do_syscall_64+0x69/0xc0 Aug 23 01:02:06 juju-e4d256-prod-github-runner-207 kernel: [70700.616123] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 01:02:06 juju-e4d256-prod-github-runner-207 kernel: [70700.616828] RIP: 0033:0x7faa5d0edaff Aug 23 01:02:06 juju-e4d256-prod-github-runner-207 kernel: [70700.617464] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 01:02:06 juju-e4d256-prod-github-runner-207 kernel: [70700.619470] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 01:02:06 juju-e4d256-prod-github-runner-207 kernel: [70700.620379] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 01:02:06 juju-e4d256-prod-github-runner-207 kernel: [70700.621268] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 01:02:06 juju-e4d256-prod-github-runner-207 kernel: [70700.622155] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 01:02:06 juju-e4d256-prod-github-runner-207 kernel: [70700.623048] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 01:02:06 juju-e4d256-prod-github-runner-207 kernel: [70700.623947] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 01:02:06 juju-e4d256-prod-github-runner-207 kernel: [70700.624836] Aug 23 01:02:34 juju-e4d256-prod-github-runner-207 kernel: [70728.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 65763s! [qemu-system-x86:6715] Aug 23 01:02:34 juju-e4d256-prod-github-runner-207 kernel: [70728.543085] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 01:02:34 juju-e4d256-prod-github-runner-207 kernel: [70728.543176] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 01:02:34 juju-e4d256-prod-github-runner-207 kernel: [70728.555242] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 01:02:34 juju-e4d256-prod-github-runner-207 kernel: [70728.556513] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 01:02:34 juju-e4d256-prod-github-runner-207 kernel: [70728.557808] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:02:34 juju-e4d256-prod-github-runner-207 kernel: [70728.558871] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 01:02:34 juju-e4d256-prod-github-runner-207 kernel: [70728.561445] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 01:02:34 juju-e4d256-prod-github-runner-207 kernel: [70728.562497] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 01:02:34 juju-e4d256-prod-github-runner-207 kernel: [70728.563671] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 01:02:34 juju-e4d256-prod-github-runner-207 kernel: [70728.564833] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 01:02:34 juju-e4d256-prod-github-runner-207 kernel: [70728.565992] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 01:02:34 juju-e4d256-prod-github-runner-207 kernel: [70728.567164] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 01:02:34 juju-e4d256-prod-github-runner-207 kernel: [70728.568330] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 01:02:34 juju-e4d256-prod-github-runner-207 kernel: [70728.569563] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 01:02:34 juju-e4d256-prod-github-runner-207 kernel: [70728.570663] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 01:02:34 juju-e4d256-prod-github-runner-207 kernel: [70728.571871] Call Trace: Aug 23 01:02:34 juju-e4d256-prod-github-runner-207 kernel: [70728.572783] Aug 23 01:02:34 juju-e4d256-prod-github-runner-207 kernel: [70728.573665] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:02:34 juju-e4d256-prod-github-runner-207 kernel: [70728.574697] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:02:34 juju-e4d256-prod-github-runner-207 kernel: [70728.575734] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:02:34 juju-e4d256-prod-github-runner-207 kernel: [70728.576808] ? show_regs.part.0+0x23/0x29 Aug 23 01:02:34 juju-e4d256-prod-github-runner-207 kernel: [70728.577808] ? show_regs.cold+0x8/0xd Aug 23 01:02:34 juju-e4d256-prod-github-runner-207 kernel: [70728.578777] ? watchdog_timer_fn+0x1be/0x220 Aug 23 01:02:34 juju-e4d256-prod-github-runner-207 kernel: [70728.579801] ? lockup_detector_update_enable+0x60/0x60 Aug 23 01:02:34 juju-e4d256-prod-github-runner-207 kernel: [70728.580873] ? __hrtimer_run_queues+0x107/0x230 Aug 23 01:02:34 juju-e4d256-prod-github-runner-207 kernel: [70728.581899] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 01:02:34 juju-e4d256-prod-github-runner-207 kernel: [70728.582919] ? hrtimer_interrupt+0x101/0x220 Aug 23 01:02:34 juju-e4d256-prod-github-runner-207 kernel: [70728.583947] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 01:02:34 juju-e4d256-prod-github-runner-207 kernel: [70728.585012] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 01:02:34 juju-e4d256-prod-github-runner-207 kernel: [70728.586054] Aug 23 01:02:34 juju-e4d256-prod-github-runner-207 kernel: [70728.586905] Aug 23 01:02:34 juju-e4d256-prod-github-runner-207 kernel: [70728.587758] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 01:02:34 juju-e4d256-prod-github-runner-207 kernel: [70728.588789] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:02:34 juju-e4d256-prod-github-runner-207 kernel: [70728.589827] ? _raw_spin_lock+0x22/0x30 Aug 23 01:02:34 juju-e4d256-prod-github-runner-207 kernel: [70728.590771] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:02:34 juju-e4d256-prod-github-runner-207 kernel: [70728.591800] direct_page_fault+0x206/0x310 [kvm] Aug 23 01:02:34 juju-e4d256-prod-github-runner-207 kernel: [70728.592825] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 01:02:34 juju-e4d256-prod-github-runner-207 kernel: [70728.593834] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 01:02:34 juju-e4d256-prod-github-runner-207 kernel: [70728.594834] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 01:02:34 juju-e4d256-prod-github-runner-207 kernel: [70728.595812] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 01:02:34 juju-e4d256-prod-github-runner-207 kernel: [70728.596757] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 01:02:34 juju-e4d256-prod-github-runner-207 kernel: [70728.597733] handle_exit+0x98/0x230 [kvm_amd] Aug 23 01:02:34 juju-e4d256-prod-github-runner-207 kernel: [70728.598623] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 01:02:34 juju-e4d256-prod-github-runner-207 kernel: [70728.599547] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 01:02:34 juju-e4d256-prod-github-runner-207 kernel: [70728.600476] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 01:02:34 juju-e4d256-prod-github-runner-207 kernel: [70728.601378] vcpu_run+0x62/0x2c0 [kvm] Aug 23 01:02:34 juju-e4d256-prod-github-runner-207 kernel: [70728.602186] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 01:02:34 juju-e4d256-prod-github-runner-207 kernel: [70728.602997] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 01:02:34 juju-e4d256-prod-github-runner-207 kernel: [70728.603859] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 01:02:34 juju-e4d256-prod-github-runner-207 kernel: [70728.604653] ? __seccomp_filter+0x4a/0x4a0 Aug 23 01:02:34 juju-e4d256-prod-github-runner-207 kernel: [70728.605395] ? __fget_files+0x86/0xc0 Aug 23 01:02:34 juju-e4d256-prod-github-runner-207 kernel: [70728.606101] __x64_sys_ioctl+0x95/0xd0 Aug 23 01:02:34 juju-e4d256-prod-github-runner-207 kernel: [70728.606792] do_syscall_64+0x5c/0xc0 Aug 23 01:02:34 juju-e4d256-prod-github-runner-207 kernel: [70728.607468] ? do_futex+0x162/0x1f0 Aug 23 01:02:34 juju-e4d256-prod-github-runner-207 kernel: [70728.608115] ? __x64_sys_futex+0x78/0x1e0 Aug 23 01:02:34 juju-e4d256-prod-github-runner-207 kernel: [70728.608792] ? __secure_computing+0xa9/0x120 Aug 23 01:02:34 juju-e4d256-prod-github-runner-207 kernel: [70728.609478] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 01:02:34 juju-e4d256-prod-github-runner-207 kernel: [70728.610236] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:02:34 juju-e4d256-prod-github-runner-207 kernel: [70728.610956] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:02:34 juju-e4d256-prod-github-runner-207 kernel: [70728.611683] ? do_syscall_64+0x69/0xc0 Aug 23 01:02:34 juju-e4d256-prod-github-runner-207 kernel: [70728.612326] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:02:34 juju-e4d256-prod-github-runner-207 kernel: [70728.613027] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:02:34 juju-e4d256-prod-github-runner-207 kernel: [70728.613726] ? do_syscall_64+0x69/0xc0 Aug 23 01:02:34 juju-e4d256-prod-github-runner-207 kernel: [70728.614349] ? do_syscall_64+0x69/0xc0 Aug 23 01:02:34 juju-e4d256-prod-github-runner-207 kernel: [70728.614969] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 01:02:34 juju-e4d256-prod-github-runner-207 kernel: [70728.615690] RIP: 0033:0x7faa5d0edaff Aug 23 01:02:34 juju-e4d256-prod-github-runner-207 kernel: [70728.616339] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 01:02:34 juju-e4d256-prod-github-runner-207 kernel: [70728.618329] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 01:02:34 juju-e4d256-prod-github-runner-207 kernel: [70728.619253] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 01:02:34 juju-e4d256-prod-github-runner-207 kernel: [70728.620141] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 01:02:34 juju-e4d256-prod-github-runner-207 kernel: [70728.621033] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 01:02:34 juju-e4d256-prod-github-runner-207 kernel: [70728.621920] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 01:02:34 juju-e4d256-prod-github-runner-207 kernel: [70728.622810] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 01:02:34 juju-e4d256-prod-github-runner-207 kernel: [70728.623712] Aug 23 01:02:48 juju-e4d256-prod-github-runner-207 kernel: [70741.904710] rcu: INFO: rcu_sched self-detected stall on CPU Aug 23 01:02:48 juju-e4d256-prod-github-runner-207 kernel: [70741.905679] rcu: 1-....: (17600551 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=8500333 Aug 23 01:02:48 juju-e4d256-prod-github-runner-207 kernel: [70741.906806] (t=17656176 jiffies g=23269 q=60794) Aug 23 01:02:48 juju-e4d256-prod-github-runner-207 kernel: [70741.907602] NMI backtrace for cpu 1 Aug 23 01:02:48 juju-e4d256-prod-github-runner-207 kernel: [70741.908315] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 01:02:48 juju-e4d256-prod-github-runner-207 kernel: [70741.909483] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 01:02:48 juju-e4d256-prod-github-runner-207 kernel: [70741.910554] Call Trace: Aug 23 01:02:48 juju-e4d256-prod-github-runner-207 kernel: [70741.911274] Aug 23 01:02:48 juju-e4d256-prod-github-runner-207 kernel: [70741.911920] show_stack+0x52/0x5c Aug 23 01:02:48 juju-e4d256-prod-github-runner-207 kernel: [70741.912643] dump_stack_lvl+0x4a/0x63 Aug 23 01:02:48 juju-e4d256-prod-github-runner-207 kernel: [70741.913392] dump_stack+0x10/0x16 Aug 23 01:02:48 juju-e4d256-prod-github-runner-207 kernel: [70741.914119] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 23 01:02:48 juju-e4d256-prod-github-runner-207 kernel: [70741.914976] ? lapic_can_unplug_cpu+0x90/0x90 Aug 23 01:02:48 juju-e4d256-prod-github-runner-207 kernel: [70741.915760] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 23 01:02:48 juju-e4d256-prod-github-runner-207 kernel: [70741.916579] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 23 01:02:48 juju-e4d256-prod-github-runner-207 kernel: [70741.917400] trigger_single_cpu_backtrace+0x44/0x4f Aug 23 01:02:48 juju-e4d256-prod-github-runner-207 kernel: [70741.918215] rcu_dump_cpu_stacks+0x102/0x149 Aug 23 01:02:48 juju-e4d256-prod-github-runner-207 kernel: [70741.919014] print_cpu_stall.cold+0x2f/0xe2 Aug 23 01:02:48 juju-e4d256-prod-github-runner-207 kernel: [70741.919808] ? timekeeping_update+0xf7/0x150 Aug 23 01:02:48 juju-e4d256-prod-github-runner-207 kernel: [70741.920583] check_cpu_stall+0x109/0x270 Aug 23 01:02:48 juju-e4d256-prod-github-runner-207 kernel: [70741.921338] rcu_sched_clock_irq+0x9a/0x250 Aug 23 01:02:48 juju-e4d256-prod-github-runner-207 kernel: [70741.922102] update_process_times+0x94/0xd0 Aug 23 01:02:48 juju-e4d256-prod-github-runner-207 kernel: [70741.922861] tick_sched_handle+0x29/0x70 Aug 23 01:02:48 juju-e4d256-prod-github-runner-207 kernel: [70741.923618] tick_sched_timer+0x8c/0xc0 Aug 23 01:02:48 juju-e4d256-prod-github-runner-207 kernel: [70741.924377] ? tick_nohz_handler+0xb0/0xb0 Aug 23 01:02:48 juju-e4d256-prod-github-runner-207 kernel: [70741.925152] __hrtimer_run_queues+0x107/0x230 Aug 23 01:02:48 juju-e4d256-prod-github-runner-207 kernel: [70741.925933] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 01:02:48 juju-e4d256-prod-github-runner-207 kernel: [70741.926708] hrtimer_interrupt+0x101/0x220 Aug 23 01:02:48 juju-e4d256-prod-github-runner-207 kernel: [70741.927478] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 01:02:48 juju-e4d256-prod-github-runner-207 kernel: [70741.928288] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 01:02:48 juju-e4d256-prod-github-runner-207 kernel: [70741.929101] Aug 23 01:02:48 juju-e4d256-prod-github-runner-207 kernel: [70741.929739] Aug 23 01:02:48 juju-e4d256-prod-github-runner-207 kernel: [70741.930377] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 01:02:48 juju-e4d256-prod-github-runner-207 kernel: [70741.931218] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:02:48 juju-e4d256-prod-github-runner-207 kernel: [70741.932121] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 01:02:48 juju-e4d256-prod-github-runner-207 kernel: [70741.934344] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 01:02:48 juju-e4d256-prod-github-runner-207 kernel: [70741.935259] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 01:02:48 juju-e4d256-prod-github-runner-207 kernel: [70741.936274] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 01:02:48 juju-e4d256-prod-github-runner-207 kernel: [70741.937275] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 01:02:48 juju-e4d256-prod-github-runner-207 kernel: [70741.938249] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 01:02:48 juju-e4d256-prod-github-runner-207 kernel: [70741.939220] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 01:02:48 juju-e4d256-prod-github-runner-207 kernel: [70741.940195] ? _raw_spin_lock+0x22/0x30 Aug 23 01:02:48 juju-e4d256-prod-github-runner-207 kernel: [70741.940965] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:02:48 juju-e4d256-prod-github-runner-207 kernel: [70741.941798] direct_page_fault+0x206/0x310 [kvm] Aug 23 01:02:48 juju-e4d256-prod-github-runner-207 kernel: [70741.942633] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 01:02:48 juju-e4d256-prod-github-runner-207 kernel: [70741.943474] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 01:02:48 juju-e4d256-prod-github-runner-207 kernel: [70741.944300] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 01:02:48 juju-e4d256-prod-github-runner-207 kernel: [70741.945148] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 01:02:48 juju-e4d256-prod-github-runner-207 kernel: [70741.945948] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 01:02:48 juju-e4d256-prod-github-runner-207 kernel: [70741.946771] handle_exit+0x98/0x230 [kvm_amd] Aug 23 01:02:48 juju-e4d256-prod-github-runner-207 kernel: [70741.947536] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 01:02:48 juju-e4d256-prod-github-runner-207 kernel: [70741.948317] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 01:02:48 juju-e4d256-prod-github-runner-207 kernel: [70741.949152] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 01:02:48 juju-e4d256-prod-github-runner-207 kernel: [70741.949944] vcpu_run+0x62/0x2c0 [kvm] Aug 23 01:02:48 juju-e4d256-prod-github-runner-207 kernel: [70741.950663] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 01:02:48 juju-e4d256-prod-github-runner-207 kernel: [70741.951420] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 01:02:48 juju-e4d256-prod-github-runner-207 kernel: [70741.952226] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 01:02:48 juju-e4d256-prod-github-runner-207 kernel: [70741.952991] ? __seccomp_filter+0x4a/0x4a0 Aug 23 01:02:48 juju-e4d256-prod-github-runner-207 kernel: [70741.953708] ? __fget_files+0x86/0xc0 Aug 23 01:02:48 juju-e4d256-prod-github-runner-207 kernel: [70741.954399] __x64_sys_ioctl+0x95/0xd0 Aug 23 01:02:48 juju-e4d256-prod-github-runner-207 kernel: [70741.955125] do_syscall_64+0x5c/0xc0 Aug 23 01:02:48 juju-e4d256-prod-github-runner-207 kernel: [70741.955815] ? do_futex+0x162/0x1f0 Aug 23 01:02:48 juju-e4d256-prod-github-runner-207 kernel: [70741.956496] ? __x64_sys_futex+0x78/0x1e0 Aug 23 01:02:48 juju-e4d256-prod-github-runner-207 kernel: [70741.957202] ? __secure_computing+0xa9/0x120 Aug 23 01:02:48 juju-e4d256-prod-github-runner-207 kernel: [70741.957923] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 01:02:48 juju-e4d256-prod-github-runner-207 kernel: [70741.958711] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:02:48 juju-e4d256-prod-github-runner-207 kernel: [70741.959475] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:02:48 juju-e4d256-prod-github-runner-207 kernel: [70741.960241] ? do_syscall_64+0x69/0xc0 Aug 23 01:02:48 juju-e4d256-prod-github-runner-207 kernel: [70741.960939] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:02:48 juju-e4d256-prod-github-runner-207 kernel: [70741.961731] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:02:48 juju-e4d256-prod-github-runner-207 kernel: [70741.962501] ? do_syscall_64+0x69/0xc0 Aug 23 01:02:48 juju-e4d256-prod-github-runner-207 kernel: [70741.963214] ? do_syscall_64+0x69/0xc0 Aug 23 01:02:48 juju-e4d256-prod-github-runner-207 kernel: [70741.963913] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 01:02:48 juju-e4d256-prod-github-runner-207 kernel: [70741.964697] RIP: 0033:0x7faa5d0edaff Aug 23 01:02:48 juju-e4d256-prod-github-runner-207 kernel: [70741.965585] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 01:02:48 juju-e4d256-prod-github-runner-207 kernel: [70741.967722] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 01:02:48 juju-e4d256-prod-github-runner-207 kernel: [70741.968681] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 01:02:48 juju-e4d256-prod-github-runner-207 kernel: [70741.969630] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 01:02:48 juju-e4d256-prod-github-runner-207 kernel: [70741.970581] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 01:02:48 juju-e4d256-prod-github-runner-207 kernel: [70741.971565] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 01:02:48 juju-e4d256-prod-github-runner-207 kernel: [70741.972500] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 01:02:48 juju-e4d256-prod-github-runner-207 kernel: [70741.973413] Aug 23 01:03:14 juju-e4d256-prod-github-runner-207 kernel: [70768.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 65800s! [qemu-system-x86:6715] Aug 23 01:03:14 juju-e4d256-prod-github-runner-207 kernel: [70768.543130] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 01:03:14 juju-e4d256-prod-github-runner-207 kernel: [70768.543198] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 01:03:14 juju-e4d256-prod-github-runner-207 kernel: [70768.555275] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 01:03:14 juju-e4d256-prod-github-runner-207 kernel: [70768.556536] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 01:03:14 juju-e4d256-prod-github-runner-207 kernel: [70768.557754] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:03:14 juju-e4d256-prod-github-runner-207 kernel: [70768.558825] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 01:03:14 juju-e4d256-prod-github-runner-207 kernel: [70768.561374] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 01:03:14 juju-e4d256-prod-github-runner-207 kernel: [70768.562420] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 01:03:14 juju-e4d256-prod-github-runner-207 kernel: [70768.563593] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 01:03:14 juju-e4d256-prod-github-runner-207 kernel: [70768.564754] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 01:03:14 juju-e4d256-prod-github-runner-207 kernel: [70768.565912] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 01:03:14 juju-e4d256-prod-github-runner-207 kernel: [70768.567081] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 01:03:14 juju-e4d256-prod-github-runner-207 kernel: [70768.568269] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 01:03:14 juju-e4d256-prod-github-runner-207 kernel: [70768.569511] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 01:03:14 juju-e4d256-prod-github-runner-207 kernel: [70768.570607] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 01:03:14 juju-e4d256-prod-github-runner-207 kernel: [70768.571823] Call Trace: Aug 23 01:03:14 juju-e4d256-prod-github-runner-207 kernel: [70768.572735] Aug 23 01:03:14 juju-e4d256-prod-github-runner-207 kernel: [70768.573619] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:03:14 juju-e4d256-prod-github-runner-207 kernel: [70768.574660] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:03:14 juju-e4d256-prod-github-runner-207 kernel: [70768.575685] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:03:14 juju-e4d256-prod-github-runner-207 kernel: [70768.576760] ? show_regs.part.0+0x23/0x29 Aug 23 01:03:14 juju-e4d256-prod-github-runner-207 kernel: [70768.577774] ? show_regs.cold+0x8/0xd Aug 23 01:03:14 juju-e4d256-prod-github-runner-207 kernel: [70768.578773] ? watchdog_timer_fn+0x1be/0x220 Aug 23 01:03:14 juju-e4d256-prod-github-runner-207 kernel: [70768.579780] ? lockup_detector_update_enable+0x60/0x60 Aug 23 01:03:14 juju-e4d256-prod-github-runner-207 kernel: [70768.580842] ? __hrtimer_run_queues+0x107/0x230 Aug 23 01:03:14 juju-e4d256-prod-github-runner-207 kernel: [70768.581868] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 01:03:14 juju-e4d256-prod-github-runner-207 kernel: [70768.582905] ? hrtimer_interrupt+0x101/0x220 Aug 23 01:03:14 juju-e4d256-prod-github-runner-207 kernel: [70768.583924] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 01:03:14 juju-e4d256-prod-github-runner-207 kernel: [70768.584992] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 01:03:14 juju-e4d256-prod-github-runner-207 kernel: [70768.586037] Aug 23 01:03:14 juju-e4d256-prod-github-runner-207 kernel: [70768.586902] Aug 23 01:03:14 juju-e4d256-prod-github-runner-207 kernel: [70768.587739] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 01:03:14 juju-e4d256-prod-github-runner-207 kernel: [70768.588770] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:03:14 juju-e4d256-prod-github-runner-207 kernel: [70768.589806] ? _raw_spin_lock+0x22/0x30 Aug 23 01:03:14 juju-e4d256-prod-github-runner-207 kernel: [70768.590763] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:03:14 juju-e4d256-prod-github-runner-207 kernel: [70768.591784] direct_page_fault+0x206/0x310 [kvm] Aug 23 01:03:14 juju-e4d256-prod-github-runner-207 kernel: [70768.592810] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 01:03:14 juju-e4d256-prod-github-runner-207 kernel: [70768.593817] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 01:03:14 juju-e4d256-prod-github-runner-207 kernel: [70768.594825] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 01:03:14 juju-e4d256-prod-github-runner-207 kernel: [70768.595792] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 01:03:14 juju-e4d256-prod-github-runner-207 kernel: [70768.596736] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 01:03:14 juju-e4d256-prod-github-runner-207 kernel: [70768.597710] handle_exit+0x98/0x230 [kvm_amd] Aug 23 01:03:14 juju-e4d256-prod-github-runner-207 kernel: [70768.598599] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 01:03:14 juju-e4d256-prod-github-runner-207 kernel: [70768.599524] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 01:03:14 juju-e4d256-prod-github-runner-207 kernel: [70768.600444] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 01:03:14 juju-e4d256-prod-github-runner-207 kernel: [70768.601346] vcpu_run+0x62/0x2c0 [kvm] Aug 23 01:03:14 juju-e4d256-prod-github-runner-207 kernel: [70768.602160] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 01:03:14 juju-e4d256-prod-github-runner-207 kernel: [70768.602976] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 01:03:14 juju-e4d256-prod-github-runner-207 kernel: [70768.603827] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 01:03:14 juju-e4d256-prod-github-runner-207 kernel: [70768.604621] ? __seccomp_filter+0x4a/0x4a0 Aug 23 01:03:14 juju-e4d256-prod-github-runner-207 kernel: [70768.605360] ? __fget_files+0x86/0xc0 Aug 23 01:03:14 juju-e4d256-prod-github-runner-207 kernel: [70768.606067] __x64_sys_ioctl+0x95/0xd0 Aug 23 01:03:14 juju-e4d256-prod-github-runner-207 kernel: [70768.606767] do_syscall_64+0x5c/0xc0 Aug 23 01:03:14 juju-e4d256-prod-github-runner-207 kernel: [70768.607437] ? do_futex+0x162/0x1f0 Aug 23 01:03:14 juju-e4d256-prod-github-runner-207 kernel: [70768.608085] ? __x64_sys_futex+0x78/0x1e0 Aug 23 01:03:14 juju-e4d256-prod-github-runner-207 kernel: [70768.608756] ? __secure_computing+0xa9/0x120 Aug 23 01:03:14 juju-e4d256-prod-github-runner-207 kernel: [70768.609442] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 01:03:14 juju-e4d256-prod-github-runner-207 kernel: [70768.610197] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:03:14 juju-e4d256-prod-github-runner-207 kernel: [70768.610934] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:03:14 juju-e4d256-prod-github-runner-207 kernel: [70768.611651] ? do_syscall_64+0x69/0xc0 Aug 23 01:03:14 juju-e4d256-prod-github-runner-207 kernel: [70768.612293] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:03:14 juju-e4d256-prod-github-runner-207 kernel: [70768.612992] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:03:14 juju-e4d256-prod-github-runner-207 kernel: [70768.613684] ? do_syscall_64+0x69/0xc0 Aug 23 01:03:14 juju-e4d256-prod-github-runner-207 kernel: [70768.614303] ? do_syscall_64+0x69/0xc0 Aug 23 01:03:14 juju-e4d256-prod-github-runner-207 kernel: [70768.614934] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 01:03:14 juju-e4d256-prod-github-runner-207 kernel: [70768.615641] RIP: 0033:0x7faa5d0edaff Aug 23 01:03:14 juju-e4d256-prod-github-runner-207 kernel: [70768.616262] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 01:03:14 juju-e4d256-prod-github-runner-207 kernel: [70768.618233] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 01:03:14 juju-e4d256-prod-github-runner-207 kernel: [70768.619149] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 01:03:14 juju-e4d256-prod-github-runner-207 kernel: [70768.620033] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 01:03:14 juju-e4d256-prod-github-runner-207 kernel: [70768.620995] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 01:03:14 juju-e4d256-prod-github-runner-207 kernel: [70768.621887] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 01:03:14 juju-e4d256-prod-github-runner-207 kernel: [70768.622787] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 01:03:14 juju-e4d256-prod-github-runner-207 kernel: [70768.623677] Aug 23 01:03:42 juju-e4d256-prod-github-runner-207 kernel: [70796.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 65826s! [qemu-system-x86:6715] Aug 23 01:03:42 juju-e4d256-prod-github-runner-207 kernel: [70796.543758] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 01:03:42 juju-e4d256-prod-github-runner-207 kernel: [70796.544017] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 01:03:42 juju-e4d256-prod-github-runner-207 kernel: [70796.556271] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 01:03:42 juju-e4d256-prod-github-runner-207 kernel: [70796.557560] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 01:03:42 juju-e4d256-prod-github-runner-207 kernel: [70796.558879] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:03:42 juju-e4d256-prod-github-runner-207 kernel: [70796.559948] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 01:03:42 juju-e4d256-prod-github-runner-207 kernel: [70796.562525] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 01:03:42 juju-e4d256-prod-github-runner-207 kernel: [70796.563571] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 01:03:42 juju-e4d256-prod-github-runner-207 kernel: [70796.564746] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 01:03:42 juju-e4d256-prod-github-runner-207 kernel: [70796.565948] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 01:03:42 juju-e4d256-prod-github-runner-207 kernel: [70796.567204] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 01:03:42 juju-e4d256-prod-github-runner-207 kernel: [70796.568377] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 01:03:42 juju-e4d256-prod-github-runner-207 kernel: [70796.569573] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 01:03:42 juju-e4d256-prod-github-runner-207 kernel: [70796.570824] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 01:03:42 juju-e4d256-prod-github-runner-207 kernel: [70796.571918] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 01:03:42 juju-e4d256-prod-github-runner-207 kernel: [70796.573122] Call Trace: Aug 23 01:03:42 juju-e4d256-prod-github-runner-207 kernel: [70796.574050] Aug 23 01:03:42 juju-e4d256-prod-github-runner-207 kernel: [70796.574976] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:03:42 juju-e4d256-prod-github-runner-207 kernel: [70796.576033] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:03:42 juju-e4d256-prod-github-runner-207 kernel: [70796.577135] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:03:42 juju-e4d256-prod-github-runner-207 kernel: [70796.578246] ? show_regs.part.0+0x23/0x29 Aug 23 01:03:42 juju-e4d256-prod-github-runner-207 kernel: [70796.579311] ? show_regs.cold+0x8/0xd Aug 23 01:03:42 juju-e4d256-prod-github-runner-207 kernel: [70796.580291] ? watchdog_timer_fn+0x1be/0x220 Aug 23 01:03:42 juju-e4d256-prod-github-runner-207 kernel: [70796.581302] ? lockup_detector_update_enable+0x60/0x60 Aug 23 01:03:42 juju-e4d256-prod-github-runner-207 kernel: [70796.582379] ? __hrtimer_run_queues+0x107/0x230 Aug 23 01:03:42 juju-e4d256-prod-github-runner-207 kernel: [70796.583418] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 01:03:42 juju-e4d256-prod-github-runner-207 kernel: [70796.584458] ? hrtimer_interrupt+0x101/0x220 Aug 23 01:03:42 juju-e4d256-prod-github-runner-207 kernel: [70796.585479] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 01:03:42 juju-e4d256-prod-github-runner-207 kernel: [70796.586566] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 01:03:42 juju-e4d256-prod-github-runner-207 kernel: [70796.587613] Aug 23 01:03:42 juju-e4d256-prod-github-runner-207 kernel: [70796.588478] Aug 23 01:03:42 juju-e4d256-prod-github-runner-207 kernel: [70796.589319] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 01:03:42 juju-e4d256-prod-github-runner-207 kernel: [70796.590381] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:03:42 juju-e4d256-prod-github-runner-207 kernel: [70796.591420] ? _raw_spin_lock+0x22/0x30 Aug 23 01:03:42 juju-e4d256-prod-github-runner-207 kernel: [70796.592364] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:03:42 juju-e4d256-prod-github-runner-207 kernel: [70796.593378] direct_page_fault+0x206/0x310 [kvm] Aug 23 01:03:42 juju-e4d256-prod-github-runner-207 kernel: [70796.594425] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 01:03:42 juju-e4d256-prod-github-runner-207 kernel: [70796.595450] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 01:03:42 juju-e4d256-prod-github-runner-207 kernel: [70796.596582] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 01:03:42 juju-e4d256-prod-github-runner-207 kernel: [70796.597596] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 01:03:42 juju-e4d256-prod-github-runner-207 kernel: [70796.598569] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 01:03:42 juju-e4d256-prod-github-runner-207 kernel: [70796.599563] handle_exit+0x98/0x230 [kvm_amd] Aug 23 01:03:42 juju-e4d256-prod-github-runner-207 kernel: [70796.600474] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 01:03:42 juju-e4d256-prod-github-runner-207 kernel: [70796.601393] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 01:03:42 juju-e4d256-prod-github-runner-207 kernel: [70796.602340] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 01:03:42 juju-e4d256-prod-github-runner-207 kernel: [70796.603247] vcpu_run+0x62/0x2c0 [kvm] Aug 23 01:03:42 juju-e4d256-prod-github-runner-207 kernel: [70796.604069] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 01:03:42 juju-e4d256-prod-github-runner-207 kernel: [70796.604899] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 01:03:42 juju-e4d256-prod-github-runner-207 kernel: [70796.605763] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 01:03:42 juju-e4d256-prod-github-runner-207 kernel: [70796.606624] ? __seccomp_filter+0x4a/0x4a0 Aug 23 01:03:42 juju-e4d256-prod-github-runner-207 kernel: [70796.607370] ? __fget_files+0x86/0xc0 Aug 23 01:03:42 juju-e4d256-prod-github-runner-207 kernel: [70796.608073] __x64_sys_ioctl+0x95/0xd0 Aug 23 01:03:42 juju-e4d256-prod-github-runner-207 kernel: [70796.608764] do_syscall_64+0x5c/0xc0 Aug 23 01:03:42 juju-e4d256-prod-github-runner-207 kernel: [70796.609440] ? do_futex+0x162/0x1f0 Aug 23 01:03:42 juju-e4d256-prod-github-runner-207 kernel: [70796.610102] ? __x64_sys_futex+0x78/0x1e0 Aug 23 01:03:42 juju-e4d256-prod-github-runner-207 kernel: [70796.610797] ? __secure_computing+0xa9/0x120 Aug 23 01:03:42 juju-e4d256-prod-github-runner-207 kernel: [70796.611488] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 01:03:42 juju-e4d256-prod-github-runner-207 kernel: [70796.612249] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:03:42 juju-e4d256-prod-github-runner-207 kernel: [70796.612971] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:03:42 juju-e4d256-prod-github-runner-207 kernel: [70796.613689] ? do_syscall_64+0x69/0xc0 Aug 23 01:03:42 juju-e4d256-prod-github-runner-207 kernel: [70796.614360] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:03:42 juju-e4d256-prod-github-runner-207 kernel: [70796.615077] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:03:42 juju-e4d256-prod-github-runner-207 kernel: [70796.615783] ? do_syscall_64+0x69/0xc0 Aug 23 01:03:42 juju-e4d256-prod-github-runner-207 kernel: [70796.616411] ? do_syscall_64+0x69/0xc0 Aug 23 01:03:42 juju-e4d256-prod-github-runner-207 kernel: [70796.617033] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 01:03:42 juju-e4d256-prod-github-runner-207 kernel: [70796.617737] RIP: 0033:0x7faa5d0edaff Aug 23 01:03:42 juju-e4d256-prod-github-runner-207 kernel: [70796.618406] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 01:03:42 juju-e4d256-prod-github-runner-207 kernel: [70796.620415] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 01:03:42 juju-e4d256-prod-github-runner-207 kernel: [70796.621334] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 01:03:42 juju-e4d256-prod-github-runner-207 kernel: [70796.622226] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 01:03:42 juju-e4d256-prod-github-runner-207 kernel: [70796.623143] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 01:03:42 juju-e4d256-prod-github-runner-207 kernel: [70796.624030] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 01:03:42 juju-e4d256-prod-github-runner-207 kernel: [70796.624928] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 01:03:42 juju-e4d256-prod-github-runner-207 kernel: [70796.625863] Aug 23 01:04:10 juju-e4d256-prod-github-runner-207 kernel: [70824.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 65852s! [qemu-system-x86:6715] Aug 23 01:04:10 juju-e4d256-prod-github-runner-207 kernel: [70824.543093] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 01:04:10 juju-e4d256-prod-github-runner-207 kernel: [70824.543161] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 01:04:10 juju-e4d256-prod-github-runner-207 kernel: [70824.555392] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 01:04:10 juju-e4d256-prod-github-runner-207 kernel: [70824.556667] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 01:04:10 juju-e4d256-prod-github-runner-207 kernel: [70824.557891] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:04:10 juju-e4d256-prod-github-runner-207 kernel: [70824.558961] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 01:04:10 juju-e4d256-prod-github-runner-207 kernel: [70824.561536] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 01:04:10 juju-e4d256-prod-github-runner-207 kernel: [70824.562615] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 01:04:10 juju-e4d256-prod-github-runner-207 kernel: [70824.563794] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 01:04:10 juju-e4d256-prod-github-runner-207 kernel: [70824.564973] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 01:04:10 juju-e4d256-prod-github-runner-207 kernel: [70824.566169] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 01:04:10 juju-e4d256-prod-github-runner-207 kernel: [70824.567330] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 01:04:10 juju-e4d256-prod-github-runner-207 kernel: [70824.568500] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 01:04:10 juju-e4d256-prod-github-runner-207 kernel: [70824.569735] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 01:04:10 juju-e4d256-prod-github-runner-207 kernel: [70824.570853] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 01:04:10 juju-e4d256-prod-github-runner-207 kernel: [70824.572046] Call Trace: Aug 23 01:04:10 juju-e4d256-prod-github-runner-207 kernel: [70824.572956] Aug 23 01:04:10 juju-e4d256-prod-github-runner-207 kernel: [70824.573845] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:04:10 juju-e4d256-prod-github-runner-207 kernel: [70824.574898] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:04:10 juju-e4d256-prod-github-runner-207 kernel: [70824.575922] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:04:10 juju-e4d256-prod-github-runner-207 kernel: [70824.577000] ? show_regs.part.0+0x23/0x29 Aug 23 01:04:10 juju-e4d256-prod-github-runner-207 kernel: [70824.578008] ? show_regs.cold+0x8/0xd Aug 23 01:04:10 juju-e4d256-prod-github-runner-207 kernel: [70824.578980] ? watchdog_timer_fn+0x1be/0x220 Aug 23 01:04:10 juju-e4d256-prod-github-runner-207 kernel: [70824.579987] ? lockup_detector_update_enable+0x60/0x60 Aug 23 01:04:10 juju-e4d256-prod-github-runner-207 kernel: [70824.581054] ? __hrtimer_run_queues+0x107/0x230 Aug 23 01:04:10 juju-e4d256-prod-github-runner-207 kernel: [70824.582144] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 01:04:10 juju-e4d256-prod-github-runner-207 kernel: [70824.583175] ? hrtimer_interrupt+0x101/0x220 Aug 23 01:04:10 juju-e4d256-prod-github-runner-207 kernel: [70824.584234] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 01:04:10 juju-e4d256-prod-github-runner-207 kernel: [70824.585379] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 01:04:10 juju-e4d256-prod-github-runner-207 kernel: [70824.586506] Aug 23 01:04:10 juju-e4d256-prod-github-runner-207 kernel: [70824.587369] Aug 23 01:04:10 juju-e4d256-prod-github-runner-207 kernel: [70824.588218] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 01:04:10 juju-e4d256-prod-github-runner-207 kernel: [70824.589256] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:04:10 juju-e4d256-prod-github-runner-207 kernel: [70824.590312] ? _raw_spin_lock+0x22/0x30 Aug 23 01:04:10 juju-e4d256-prod-github-runner-207 kernel: [70824.591257] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:04:10 juju-e4d256-prod-github-runner-207 kernel: [70824.592277] direct_page_fault+0x206/0x310 [kvm] Aug 23 01:04:10 juju-e4d256-prod-github-runner-207 kernel: [70824.593304] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 01:04:10 juju-e4d256-prod-github-runner-207 kernel: [70824.594330] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 01:04:10 juju-e4d256-prod-github-runner-207 kernel: [70824.595337] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 01:04:10 juju-e4d256-prod-github-runner-207 kernel: [70824.596311] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 01:04:10 juju-e4d256-prod-github-runner-207 kernel: [70824.597256] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 01:04:10 juju-e4d256-prod-github-runner-207 kernel: [70824.598249] handle_exit+0x98/0x230 [kvm_amd] Aug 23 01:04:10 juju-e4d256-prod-github-runner-207 kernel: [70824.599149] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 01:04:10 juju-e4d256-prod-github-runner-207 kernel: [70824.600071] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 01:04:10 juju-e4d256-prod-github-runner-207 kernel: [70824.600999] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 01:04:10 juju-e4d256-prod-github-runner-207 kernel: [70824.601901] vcpu_run+0x62/0x2c0 [kvm] Aug 23 01:04:10 juju-e4d256-prod-github-runner-207 kernel: [70824.602740] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 01:04:10 juju-e4d256-prod-github-runner-207 kernel: [70824.603578] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 01:04:10 juju-e4d256-prod-github-runner-207 kernel: [70824.604638] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 01:04:10 juju-e4d256-prod-github-runner-207 kernel: [70824.605654] ? __seccomp_filter+0x4a/0x4a0 Aug 23 01:04:10 juju-e4d256-prod-github-runner-207 kernel: [70824.606410] ? __fget_files+0x86/0xc0 Aug 23 01:04:10 juju-e4d256-prod-github-runner-207 kernel: [70824.607111] __x64_sys_ioctl+0x95/0xd0 Aug 23 01:04:10 juju-e4d256-prod-github-runner-207 kernel: [70824.607801] do_syscall_64+0x5c/0xc0 Aug 23 01:04:10 juju-e4d256-prod-github-runner-207 kernel: [70824.608463] ? do_futex+0x162/0x1f0 Aug 23 01:04:10 juju-e4d256-prod-github-runner-207 kernel: [70824.609121] ? __x64_sys_futex+0x78/0x1e0 Aug 23 01:04:10 juju-e4d256-prod-github-runner-207 kernel: [70824.609796] ? __secure_computing+0xa9/0x120 Aug 23 01:04:10 juju-e4d256-prod-github-runner-207 kernel: [70824.610504] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 01:04:10 juju-e4d256-prod-github-runner-207 kernel: [70824.611264] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:04:10 juju-e4d256-prod-github-runner-207 kernel: [70824.611983] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:04:10 juju-e4d256-prod-github-runner-207 kernel: [70824.612699] ? do_syscall_64+0x69/0xc0 Aug 23 01:04:10 juju-e4d256-prod-github-runner-207 kernel: [70824.613344] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:04:10 juju-e4d256-prod-github-runner-207 kernel: [70824.614057] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:04:10 juju-e4d256-prod-github-runner-207 kernel: [70824.614758] ? do_syscall_64+0x69/0xc0 Aug 23 01:04:10 juju-e4d256-prod-github-runner-207 kernel: [70824.615384] ? do_syscall_64+0x69/0xc0 Aug 23 01:04:10 juju-e4d256-prod-github-runner-207 kernel: [70824.616006] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 01:04:10 juju-e4d256-prod-github-runner-207 kernel: [70824.616709] RIP: 0033:0x7faa5d0edaff Aug 23 01:04:10 juju-e4d256-prod-github-runner-207 kernel: [70824.617332] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 01:04:10 juju-e4d256-prod-github-runner-207 kernel: [70824.619335] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 01:04:10 juju-e4d256-prod-github-runner-207 kernel: [70824.620246] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 01:04:10 juju-e4d256-prod-github-runner-207 kernel: [70824.621141] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 01:04:10 juju-e4d256-prod-github-runner-207 kernel: [70824.622070] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 01:04:10 juju-e4d256-prod-github-runner-207 kernel: [70824.622960] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 01:04:10 juju-e4d256-prod-github-runner-207 kernel: [70824.623842] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 01:04:10 juju-e4d256-prod-github-runner-207 kernel: [70824.624733] Aug 23 01:04:38 juju-e4d256-prod-github-runner-207 kernel: [70852.541976] watchdog: BUG: soft lockup - CPU#1 stuck for 65878s! [qemu-system-x86:6715] Aug 23 01:04:38 juju-e4d256-prod-github-runner-207 kernel: [70852.543114] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 01:04:38 juju-e4d256-prod-github-runner-207 kernel: [70852.543180] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 01:04:38 juju-e4d256-prod-github-runner-207 kernel: [70852.555223] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 01:04:38 juju-e4d256-prod-github-runner-207 kernel: [70852.556487] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 01:04:38 juju-e4d256-prod-github-runner-207 kernel: [70852.557716] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:04:38 juju-e4d256-prod-github-runner-207 kernel: [70852.558780] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 01:04:38 juju-e4d256-prod-github-runner-207 kernel: [70852.561330] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 01:04:38 juju-e4d256-prod-github-runner-207 kernel: [70852.562383] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 01:04:38 juju-e4d256-prod-github-runner-207 kernel: [70852.563543] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 01:04:38 juju-e4d256-prod-github-runner-207 kernel: [70852.564704] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 01:04:38 juju-e4d256-prod-github-runner-207 kernel: [70852.565893] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 01:04:38 juju-e4d256-prod-github-runner-207 kernel: [70852.567059] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 01:04:38 juju-e4d256-prod-github-runner-207 kernel: [70852.568223] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 01:04:38 juju-e4d256-prod-github-runner-207 kernel: [70852.569454] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 01:04:38 juju-e4d256-prod-github-runner-207 kernel: [70852.570565] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 01:04:38 juju-e4d256-prod-github-runner-207 kernel: [70852.571761] Call Trace: Aug 23 01:04:38 juju-e4d256-prod-github-runner-207 kernel: [70852.572671] Aug 23 01:04:38 juju-e4d256-prod-github-runner-207 kernel: [70852.573557] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:04:38 juju-e4d256-prod-github-runner-207 kernel: [70852.574598] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:04:38 juju-e4d256-prod-github-runner-207 kernel: [70852.575617] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:04:38 juju-e4d256-prod-github-runner-207 kernel: [70852.576690] ? show_regs.part.0+0x23/0x29 Aug 23 01:04:38 juju-e4d256-prod-github-runner-207 kernel: [70852.577696] ? show_regs.cold+0x8/0xd Aug 23 01:04:38 juju-e4d256-prod-github-runner-207 kernel: [70852.578667] ? watchdog_timer_fn+0x1be/0x220 Aug 23 01:04:38 juju-e4d256-prod-github-runner-207 kernel: [70852.579674] ? lockup_detector_update_enable+0x60/0x60 Aug 23 01:04:38 juju-e4d256-prod-github-runner-207 kernel: [70852.580740] ? __hrtimer_run_queues+0x107/0x230 Aug 23 01:04:38 juju-e4d256-prod-github-runner-207 kernel: [70852.581780] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 01:04:38 juju-e4d256-prod-github-runner-207 kernel: [70852.582801] ? hrtimer_interrupt+0x101/0x220 Aug 23 01:04:38 juju-e4d256-prod-github-runner-207 kernel: [70852.583813] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 01:04:38 juju-e4d256-prod-github-runner-207 kernel: [70852.584879] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 01:04:38 juju-e4d256-prod-github-runner-207 kernel: [70852.585933] Aug 23 01:04:38 juju-e4d256-prod-github-runner-207 kernel: [70852.586786] Aug 23 01:04:38 juju-e4d256-prod-github-runner-207 kernel: [70852.587625] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 01:04:38 juju-e4d256-prod-github-runner-207 kernel: [70852.588655] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:04:38 juju-e4d256-prod-github-runner-207 kernel: [70852.589698] ? _raw_spin_lock+0x22/0x30 Aug 23 01:04:38 juju-e4d256-prod-github-runner-207 kernel: [70852.590640] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:04:38 juju-e4d256-prod-github-runner-207 kernel: [70852.591657] direct_page_fault+0x206/0x310 [kvm] Aug 23 01:04:38 juju-e4d256-prod-github-runner-207 kernel: [70852.592680] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 01:04:38 juju-e4d256-prod-github-runner-207 kernel: [70852.593695] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 01:04:38 juju-e4d256-prod-github-runner-207 kernel: [70852.594694] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 01:04:38 juju-e4d256-prod-github-runner-207 kernel: [70852.595662] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 01:04:38 juju-e4d256-prod-github-runner-207 kernel: [70852.596609] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 01:04:38 juju-e4d256-prod-github-runner-207 kernel: [70852.597584] handle_exit+0x98/0x230 [kvm_amd] Aug 23 01:04:38 juju-e4d256-prod-github-runner-207 kernel: [70852.598481] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 01:04:38 juju-e4d256-prod-github-runner-207 kernel: [70852.599403] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 01:04:38 juju-e4d256-prod-github-runner-207 kernel: [70852.600324] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 01:04:38 juju-e4d256-prod-github-runner-207 kernel: [70852.601239] vcpu_run+0x62/0x2c0 [kvm] Aug 23 01:04:38 juju-e4d256-prod-github-runner-207 kernel: [70852.602059] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 01:04:38 juju-e4d256-prod-github-runner-207 kernel: [70852.602874] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 01:04:38 juju-e4d256-prod-github-runner-207 kernel: [70852.603723] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 01:04:38 juju-e4d256-prod-github-runner-207 kernel: [70852.604517] ? __seccomp_filter+0x4a/0x4a0 Aug 23 01:04:38 juju-e4d256-prod-github-runner-207 kernel: [70852.605258] ? __fget_files+0x86/0xc0 Aug 23 01:04:38 juju-e4d256-prod-github-runner-207 kernel: [70852.605977] __x64_sys_ioctl+0x95/0xd0 Aug 23 01:04:38 juju-e4d256-prod-github-runner-207 kernel: [70852.606668] do_syscall_64+0x5c/0xc0 Aug 23 01:04:38 juju-e4d256-prod-github-runner-207 kernel: [70852.607330] ? do_futex+0x162/0x1f0 Aug 23 01:04:38 juju-e4d256-prod-github-runner-207 kernel: [70852.607982] ? __x64_sys_futex+0x78/0x1e0 Aug 23 01:04:38 juju-e4d256-prod-github-runner-207 kernel: [70852.608654] ? __secure_computing+0xa9/0x120 Aug 23 01:04:38 juju-e4d256-prod-github-runner-207 kernel: [70852.609341] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 01:04:38 juju-e4d256-prod-github-runner-207 kernel: [70852.610109] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:04:38 juju-e4d256-prod-github-runner-207 kernel: [70852.610855] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:04:38 juju-e4d256-prod-github-runner-207 kernel: [70852.611585] ? do_syscall_64+0x69/0xc0 Aug 23 01:04:38 juju-e4d256-prod-github-runner-207 kernel: [70852.612233] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:04:38 juju-e4d256-prod-github-runner-207 kernel: [70852.612966] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:04:38 juju-e4d256-prod-github-runner-207 kernel: [70852.613670] ? do_syscall_64+0x69/0xc0 Aug 23 01:04:38 juju-e4d256-prod-github-runner-207 kernel: [70852.614293] ? do_syscall_64+0x69/0xc0 Aug 23 01:04:38 juju-e4d256-prod-github-runner-207 kernel: [70852.614917] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 01:04:38 juju-e4d256-prod-github-runner-207 kernel: [70852.615619] RIP: 0033:0x7faa5d0edaff Aug 23 01:04:38 juju-e4d256-prod-github-runner-207 kernel: [70852.616240] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 01:04:38 juju-e4d256-prod-github-runner-207 kernel: [70852.618235] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 01:04:38 juju-e4d256-prod-github-runner-207 kernel: [70852.619142] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 01:04:38 juju-e4d256-prod-github-runner-207 kernel: [70852.620029] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 01:04:38 juju-e4d256-prod-github-runner-207 kernel: [70852.620915] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 01:04:38 juju-e4d256-prod-github-runner-207 kernel: [70852.621809] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 01:04:38 juju-e4d256-prod-github-runner-207 kernel: [70852.622703] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 01:04:38 juju-e4d256-prod-github-runner-207 kernel: [70852.623593] Aug 23 01:05:06 juju-e4d256-prod-github-runner-207 kernel: [70880.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 65904s! [qemu-system-x86:6715] Aug 23 01:05:06 juju-e4d256-prod-github-runner-207 kernel: [70880.543779] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 01:05:06 juju-e4d256-prod-github-runner-207 kernel: [70880.544031] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 01:05:06 juju-e4d256-prod-github-runner-207 kernel: [70880.556124] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 01:05:06 juju-e4d256-prod-github-runner-207 kernel: [70880.557422] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 01:05:06 juju-e4d256-prod-github-runner-207 kernel: [70880.558690] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:05:06 juju-e4d256-prod-github-runner-207 kernel: [70880.559773] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 01:05:06 juju-e4d256-prod-github-runner-207 kernel: [70880.562348] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 01:05:06 juju-e4d256-prod-github-runner-207 kernel: [70880.563403] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 01:05:06 juju-e4d256-prod-github-runner-207 kernel: [70880.564560] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 01:05:06 juju-e4d256-prod-github-runner-207 kernel: [70880.565734] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 01:05:06 juju-e4d256-prod-github-runner-207 kernel: [70880.566895] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 01:05:06 juju-e4d256-prod-github-runner-207 kernel: [70880.568054] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 01:05:06 juju-e4d256-prod-github-runner-207 kernel: [70880.569227] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 01:05:06 juju-e4d256-prod-github-runner-207 kernel: [70880.570469] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 01:05:06 juju-e4d256-prod-github-runner-207 kernel: [70880.571603] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 01:05:06 juju-e4d256-prod-github-runner-207 kernel: [70880.572823] Call Trace: Aug 23 01:05:06 juju-e4d256-prod-github-runner-207 kernel: [70880.573749] Aug 23 01:05:06 juju-e4d256-prod-github-runner-207 kernel: [70880.574690] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:05:06 juju-e4d256-prod-github-runner-207 kernel: [70880.575755] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:05:06 juju-e4d256-prod-github-runner-207 kernel: [70880.576777] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:05:06 juju-e4d256-prod-github-runner-207 kernel: [70880.577885] ? show_regs.part.0+0x23/0x29 Aug 23 01:05:06 juju-e4d256-prod-github-runner-207 kernel: [70880.578895] ? show_regs.cold+0x8/0xd Aug 23 01:05:06 juju-e4d256-prod-github-runner-207 kernel: [70880.579882] ? watchdog_timer_fn+0x1be/0x220 Aug 23 01:05:06 juju-e4d256-prod-github-runner-207 kernel: [70880.580888] ? lockup_detector_update_enable+0x60/0x60 Aug 23 01:05:06 juju-e4d256-prod-github-runner-207 kernel: [70880.581962] ? __hrtimer_run_queues+0x107/0x230 Aug 23 01:05:06 juju-e4d256-prod-github-runner-207 kernel: [70880.582993] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 01:05:06 juju-e4d256-prod-github-runner-207 kernel: [70880.584018] ? hrtimer_interrupt+0x101/0x220 Aug 23 01:05:06 juju-e4d256-prod-github-runner-207 kernel: [70880.585035] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 01:05:06 juju-e4d256-prod-github-runner-207 kernel: [70880.586117] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 01:05:06 juju-e4d256-prod-github-runner-207 kernel: [70880.587169] Aug 23 01:05:06 juju-e4d256-prod-github-runner-207 kernel: [70880.588021] Aug 23 01:05:06 juju-e4d256-prod-github-runner-207 kernel: [70880.588862] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 01:05:06 juju-e4d256-prod-github-runner-207 kernel: [70880.589909] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:05:06 juju-e4d256-prod-github-runner-207 kernel: [70880.591006] ? _raw_spin_lock+0x22/0x30 Aug 23 01:05:06 juju-e4d256-prod-github-runner-207 kernel: [70880.591974] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:05:06 juju-e4d256-prod-github-runner-207 kernel: [70880.592995] direct_page_fault+0x206/0x310 [kvm] Aug 23 01:05:06 juju-e4d256-prod-github-runner-207 kernel: [70880.594030] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 01:05:06 juju-e4d256-prod-github-runner-207 kernel: [70880.595041] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 01:05:06 juju-e4d256-prod-github-runner-207 kernel: [70880.596040] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 01:05:06 juju-e4d256-prod-github-runner-207 kernel: [70880.597066] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 01:05:06 juju-e4d256-prod-github-runner-207 kernel: [70880.598020] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 01:05:06 juju-e4d256-prod-github-runner-207 kernel: [70880.599002] handle_exit+0x98/0x230 [kvm_amd] Aug 23 01:05:06 juju-e4d256-prod-github-runner-207 kernel: [70880.599899] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 01:05:06 juju-e4d256-prod-github-runner-207 kernel: [70880.600810] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 01:05:06 juju-e4d256-prod-github-runner-207 kernel: [70880.601746] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 01:05:06 juju-e4d256-prod-github-runner-207 kernel: [70880.602655] vcpu_run+0x62/0x2c0 [kvm] Aug 23 01:05:06 juju-e4d256-prod-github-runner-207 kernel: [70880.603469] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 01:05:06 juju-e4d256-prod-github-runner-207 kernel: [70880.604276] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 01:05:06 juju-e4d256-prod-github-runner-207 kernel: [70880.605128] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 01:05:06 juju-e4d256-prod-github-runner-207 kernel: [70880.605933] ? __seccomp_filter+0x4a/0x4a0 Aug 23 01:05:06 juju-e4d256-prod-github-runner-207 kernel: [70880.606707] ? __fget_files+0x86/0xc0 Aug 23 01:05:06 juju-e4d256-prod-github-runner-207 kernel: [70880.607453] __x64_sys_ioctl+0x95/0xd0 Aug 23 01:05:06 juju-e4d256-prod-github-runner-207 kernel: [70880.608156] do_syscall_64+0x5c/0xc0 Aug 23 01:05:06 juju-e4d256-prod-github-runner-207 kernel: [70880.608822] ? do_futex+0x162/0x1f0 Aug 23 01:05:06 juju-e4d256-prod-github-runner-207 kernel: [70880.609500] ? __x64_sys_futex+0x78/0x1e0 Aug 23 01:05:06 juju-e4d256-prod-github-runner-207 kernel: [70880.610176] ? __secure_computing+0xa9/0x120 Aug 23 01:05:06 juju-e4d256-prod-github-runner-207 kernel: [70880.610864] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 01:05:06 juju-e4d256-prod-github-runner-207 kernel: [70880.611624] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:05:06 juju-e4d256-prod-github-runner-207 kernel: [70880.612345] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:05:06 juju-e4d256-prod-github-runner-207 kernel: [70880.613061] ? do_syscall_64+0x69/0xc0 Aug 23 01:05:06 juju-e4d256-prod-github-runner-207 kernel: [70880.613714] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:05:06 juju-e4d256-prod-github-runner-207 kernel: [70880.614418] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:05:06 juju-e4d256-prod-github-runner-207 kernel: [70880.615112] ? do_syscall_64+0x69/0xc0 Aug 23 01:05:06 juju-e4d256-prod-github-runner-207 kernel: [70880.615734] ? do_syscall_64+0x69/0xc0 Aug 23 01:05:06 juju-e4d256-prod-github-runner-207 kernel: [70880.616354] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 01:05:06 juju-e4d256-prod-github-runner-207 kernel: [70880.617057] RIP: 0033:0x7faa5d0edaff Aug 23 01:05:06 juju-e4d256-prod-github-runner-207 kernel: [70880.617707] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 01:05:06 juju-e4d256-prod-github-runner-207 kernel: [70880.619696] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 01:05:06 juju-e4d256-prod-github-runner-207 kernel: [70880.620609] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 01:05:06 juju-e4d256-prod-github-runner-207 kernel: [70880.621518] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 01:05:06 juju-e4d256-prod-github-runner-207 kernel: [70880.622413] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 01:05:06 juju-e4d256-prod-github-runner-207 kernel: [70880.623364] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 01:05:06 juju-e4d256-prod-github-runner-207 kernel: [70880.624265] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 01:05:06 juju-e4d256-prod-github-runner-207 kernel: [70880.625163] Aug 23 01:05:34 juju-e4d256-prod-github-runner-207 kernel: [70908.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 65930s! [qemu-system-x86:6715] Aug 23 01:05:34 juju-e4d256-prod-github-runner-207 kernel: [70908.543091] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 01:05:34 juju-e4d256-prod-github-runner-207 kernel: [70908.543159] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 01:05:34 juju-e4d256-prod-github-runner-207 kernel: [70908.555212] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 01:05:34 juju-e4d256-prod-github-runner-207 kernel: [70908.556482] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 01:05:34 juju-e4d256-prod-github-runner-207 kernel: [70908.557715] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:05:34 juju-e4d256-prod-github-runner-207 kernel: [70908.558773] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 01:05:34 juju-e4d256-prod-github-runner-207 kernel: [70908.561330] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 01:05:34 juju-e4d256-prod-github-runner-207 kernel: [70908.562371] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 01:05:34 juju-e4d256-prod-github-runner-207 kernel: [70908.563536] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 01:05:34 juju-e4d256-prod-github-runner-207 kernel: [70908.564692] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 01:05:34 juju-e4d256-prod-github-runner-207 kernel: [70908.565861] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 01:05:34 juju-e4d256-prod-github-runner-207 kernel: [70908.567024] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 01:05:34 juju-e4d256-prod-github-runner-207 kernel: [70908.568188] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 01:05:34 juju-e4d256-prod-github-runner-207 kernel: [70908.569434] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 01:05:34 juju-e4d256-prod-github-runner-207 kernel: [70908.570531] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 01:05:34 juju-e4d256-prod-github-runner-207 kernel: [70908.571721] Call Trace: Aug 23 01:05:34 juju-e4d256-prod-github-runner-207 kernel: [70908.572631] Aug 23 01:05:34 juju-e4d256-prod-github-runner-207 kernel: [70908.573659] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:05:34 juju-e4d256-prod-github-runner-207 kernel: [70908.574689] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:05:34 juju-e4d256-prod-github-runner-207 kernel: [70908.575706] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:05:34 juju-e4d256-prod-github-runner-207 kernel: [70908.576779] ? show_regs.part.0+0x23/0x29 Aug 23 01:05:34 juju-e4d256-prod-github-runner-207 kernel: [70908.577857] ? show_regs.cold+0x8/0xd Aug 23 01:05:34 juju-e4d256-prod-github-runner-207 kernel: [70908.578827] ? watchdog_timer_fn+0x1be/0x220 Aug 23 01:05:34 juju-e4d256-prod-github-runner-207 kernel: [70908.579833] ? lockup_detector_update_enable+0x60/0x60 Aug 23 01:05:34 juju-e4d256-prod-github-runner-207 kernel: [70908.580893] ? __hrtimer_run_queues+0x107/0x230 Aug 23 01:05:34 juju-e4d256-prod-github-runner-207 kernel: [70908.581928] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 01:05:34 juju-e4d256-prod-github-runner-207 kernel: [70908.582954] ? hrtimer_interrupt+0x101/0x220 Aug 23 01:05:34 juju-e4d256-prod-github-runner-207 kernel: [70908.583973] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 01:05:34 juju-e4d256-prod-github-runner-207 kernel: [70908.585053] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 01:05:34 juju-e4d256-prod-github-runner-207 kernel: [70908.586097] Aug 23 01:05:34 juju-e4d256-prod-github-runner-207 kernel: [70908.586949] Aug 23 01:05:34 juju-e4d256-prod-github-runner-207 kernel: [70908.587790] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 01:05:34 juju-e4d256-prod-github-runner-207 kernel: [70908.588822] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:05:34 juju-e4d256-prod-github-runner-207 kernel: [70908.589897] ? _raw_spin_lock+0x22/0x30 Aug 23 01:05:34 juju-e4d256-prod-github-runner-207 kernel: [70908.590847] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:05:34 juju-e4d256-prod-github-runner-207 kernel: [70908.591862] direct_page_fault+0x206/0x310 [kvm] Aug 23 01:05:34 juju-e4d256-prod-github-runner-207 kernel: [70908.592883] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 01:05:34 juju-e4d256-prod-github-runner-207 kernel: [70908.593903] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 01:05:34 juju-e4d256-prod-github-runner-207 kernel: [70908.594901] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 01:05:34 juju-e4d256-prod-github-runner-207 kernel: [70908.595868] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 01:05:34 juju-e4d256-prod-github-runner-207 kernel: [70908.596823] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 01:05:34 juju-e4d256-prod-github-runner-207 kernel: [70908.597806] handle_exit+0x98/0x230 [kvm_amd] Aug 23 01:05:34 juju-e4d256-prod-github-runner-207 kernel: [70908.598695] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 01:05:34 juju-e4d256-prod-github-runner-207 kernel: [70908.599607] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 01:05:34 juju-e4d256-prod-github-runner-207 kernel: [70908.600533] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 01:05:34 juju-e4d256-prod-github-runner-207 kernel: [70908.601449] vcpu_run+0x62/0x2c0 [kvm] Aug 23 01:05:34 juju-e4d256-prod-github-runner-207 kernel: [70908.602260] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 01:05:34 juju-e4d256-prod-github-runner-207 kernel: [70908.603066] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 01:05:34 juju-e4d256-prod-github-runner-207 kernel: [70908.603924] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 01:05:34 juju-e4d256-prod-github-runner-207 kernel: [70908.604725] ? __seccomp_filter+0x4a/0x4a0 Aug 23 01:05:34 juju-e4d256-prod-github-runner-207 kernel: [70908.605480] ? __fget_files+0x86/0xc0 Aug 23 01:05:34 juju-e4d256-prod-github-runner-207 kernel: [70908.606183] __x64_sys_ioctl+0x95/0xd0 Aug 23 01:05:34 juju-e4d256-prod-github-runner-207 kernel: [70908.606874] do_syscall_64+0x5c/0xc0 Aug 23 01:05:34 juju-e4d256-prod-github-runner-207 kernel: [70908.607537] ? do_futex+0x162/0x1f0 Aug 23 01:05:34 juju-e4d256-prod-github-runner-207 kernel: [70908.608184] ? __x64_sys_futex+0x78/0x1e0 Aug 23 01:05:34 juju-e4d256-prod-github-runner-207 kernel: [70908.608860] ? __secure_computing+0xa9/0x120 Aug 23 01:05:34 juju-e4d256-prod-github-runner-207 kernel: [70908.609566] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 01:05:34 juju-e4d256-prod-github-runner-207 kernel: [70908.610324] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:05:34 juju-e4d256-prod-github-runner-207 kernel: [70908.611043] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:05:34 juju-e4d256-prod-github-runner-207 kernel: [70908.611764] ? do_syscall_64+0x69/0xc0 Aug 23 01:05:34 juju-e4d256-prod-github-runner-207 kernel: [70908.612412] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:05:34 juju-e4d256-prod-github-runner-207 kernel: [70908.613120] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:05:34 juju-e4d256-prod-github-runner-207 kernel: [70908.613815] ? do_syscall_64+0x69/0xc0 Aug 23 01:05:34 juju-e4d256-prod-github-runner-207 kernel: [70908.614438] ? do_syscall_64+0x69/0xc0 Aug 23 01:05:34 juju-e4d256-prod-github-runner-207 kernel: [70908.615060] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 01:05:34 juju-e4d256-prod-github-runner-207 kernel: [70908.615770] RIP: 0033:0x7faa5d0edaff Aug 23 01:05:34 juju-e4d256-prod-github-runner-207 kernel: [70908.616419] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 01:05:34 juju-e4d256-prod-github-runner-207 kernel: [70908.618410] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 01:05:34 juju-e4d256-prod-github-runner-207 kernel: [70908.619320] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 01:05:34 juju-e4d256-prod-github-runner-207 kernel: [70908.620213] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 01:05:34 juju-e4d256-prod-github-runner-207 kernel: [70908.621119] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 01:05:34 juju-e4d256-prod-github-runner-207 kernel: [70908.622012] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 01:05:34 juju-e4d256-prod-github-runner-207 kernel: [70908.622899] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 01:05:34 juju-e4d256-prod-github-runner-207 kernel: [70908.623795] Aug 23 01:05:48 juju-e4d256-prod-github-runner-207 kernel: [70921.916707] rcu: INFO: rcu_sched self-detected stall on CPU Aug 23 01:05:48 juju-e4d256-prod-github-runner-207 kernel: [70921.917857] rcu: 1-....: (17645421 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=8522337 Aug 23 01:05:48 juju-e4d256-prod-github-runner-207 kernel: [70921.919000] (t=17701179 jiffies g=23269 q=60918) Aug 23 01:05:48 juju-e4d256-prod-github-runner-207 kernel: [70921.920014] NMI backtrace for cpu 1 Aug 23 01:05:48 juju-e4d256-prod-github-runner-207 kernel: [70921.920723] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 01:05:48 juju-e4d256-prod-github-runner-207 kernel: [70921.921849] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 01:05:48 juju-e4d256-prod-github-runner-207 kernel: [70921.922904] Call Trace: Aug 23 01:05:48 juju-e4d256-prod-github-runner-207 kernel: [70921.923576] Aug 23 01:05:48 juju-e4d256-prod-github-runner-207 kernel: [70921.924220] show_stack+0x52/0x5c Aug 23 01:05:48 juju-e4d256-prod-github-runner-207 kernel: [70921.924951] dump_stack_lvl+0x4a/0x63 Aug 23 01:05:48 juju-e4d256-prod-github-runner-207 kernel: [70921.925696] dump_stack+0x10/0x16 Aug 23 01:05:48 juju-e4d256-prod-github-runner-207 kernel: [70921.926412] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 23 01:05:48 juju-e4d256-prod-github-runner-207 kernel: [70921.927191] ? lapic_can_unplug_cpu+0x90/0x90 Aug 23 01:05:48 juju-e4d256-prod-github-runner-207 kernel: [70921.927969] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 23 01:05:48 juju-e4d256-prod-github-runner-207 kernel: [70921.928786] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 23 01:05:48 juju-e4d256-prod-github-runner-207 kernel: [70921.929618] trigger_single_cpu_backtrace+0x44/0x4f Aug 23 01:05:48 juju-e4d256-prod-github-runner-207 kernel: [70921.930427] rcu_dump_cpu_stacks+0x102/0x149 Aug 23 01:05:48 juju-e4d256-prod-github-runner-207 kernel: [70921.931197] print_cpu_stall.cold+0x2f/0xe2 Aug 23 01:05:48 juju-e4d256-prod-github-runner-207 kernel: [70921.931958] ? timekeeping_update+0xf7/0x150 Aug 23 01:05:48 juju-e4d256-prod-github-runner-207 kernel: [70921.932725] check_cpu_stall+0x109/0x270 Aug 23 01:05:48 juju-e4d256-prod-github-runner-207 kernel: [70921.933483] rcu_sched_clock_irq+0x9a/0x250 Aug 23 01:05:48 juju-e4d256-prod-github-runner-207 kernel: [70921.934244] update_process_times+0x94/0xd0 Aug 23 01:05:48 juju-e4d256-prod-github-runner-207 kernel: [70921.935003] tick_sched_handle+0x29/0x70 Aug 23 01:05:48 juju-e4d256-prod-github-runner-207 kernel: [70921.935751] tick_sched_timer+0x8c/0xc0 Aug 23 01:05:48 juju-e4d256-prod-github-runner-207 kernel: [70921.936485] ? tick_nohz_handler+0xb0/0xb0 Aug 23 01:05:48 juju-e4d256-prod-github-runner-207 kernel: [70921.937258] __hrtimer_run_queues+0x107/0x230 Aug 23 01:05:48 juju-e4d256-prod-github-runner-207 kernel: [70921.938033] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 01:05:48 juju-e4d256-prod-github-runner-207 kernel: [70921.938815] hrtimer_interrupt+0x101/0x220 Aug 23 01:05:48 juju-e4d256-prod-github-runner-207 kernel: [70921.939573] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 01:05:48 juju-e4d256-prod-github-runner-207 kernel: [70921.940385] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 01:05:48 juju-e4d256-prod-github-runner-207 kernel: [70921.941206] Aug 23 01:05:48 juju-e4d256-prod-github-runner-207 kernel: [70921.941847] Aug 23 01:05:48 juju-e4d256-prod-github-runner-207 kernel: [70921.942474] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 01:05:48 juju-e4d256-prod-github-runner-207 kernel: [70921.943291] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:05:48 juju-e4d256-prod-github-runner-207 kernel: [70921.944169] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 01:05:48 juju-e4d256-prod-github-runner-207 kernel: [70921.946381] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 01:05:48 juju-e4d256-prod-github-runner-207 kernel: [70921.947252] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 01:05:48 juju-e4d256-prod-github-runner-207 kernel: [70921.948244] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 01:05:48 juju-e4d256-prod-github-runner-207 kernel: [70921.949233] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 01:05:48 juju-e4d256-prod-github-runner-207 kernel: [70921.950198] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 01:05:48 juju-e4d256-prod-github-runner-207 kernel: [70921.951153] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 01:05:48 juju-e4d256-prod-github-runner-207 kernel: [70921.952111] ? _raw_spin_lock+0x22/0x30 Aug 23 01:05:48 juju-e4d256-prod-github-runner-207 kernel: [70921.952884] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:05:48 juju-e4d256-prod-github-runner-207 kernel: [70921.953741] direct_page_fault+0x206/0x310 [kvm] Aug 23 01:05:48 juju-e4d256-prod-github-runner-207 kernel: [70921.954585] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 01:05:48 juju-e4d256-prod-github-runner-207 kernel: [70921.955410] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 01:05:48 juju-e4d256-prod-github-runner-207 kernel: [70921.956230] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 01:05:48 juju-e4d256-prod-github-runner-207 kernel: [70921.957049] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 01:05:48 juju-e4d256-prod-github-runner-207 kernel: [70921.957831] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 01:05:48 juju-e4d256-prod-github-runner-207 kernel: [70921.958650] handle_exit+0x98/0x230 [kvm_amd] Aug 23 01:05:48 juju-e4d256-prod-github-runner-207 kernel: [70921.959401] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 01:05:48 juju-e4d256-prod-github-runner-207 kernel: [70921.960181] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 01:05:48 juju-e4d256-prod-github-runner-207 kernel: [70921.960991] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 01:05:48 juju-e4d256-prod-github-runner-207 kernel: [70921.961774] vcpu_run+0x62/0x2c0 [kvm] Aug 23 01:05:48 juju-e4d256-prod-github-runner-207 kernel: [70921.962485] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 01:05:48 juju-e4d256-prod-github-runner-207 kernel: [70921.963217] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 01:05:48 juju-e4d256-prod-github-runner-207 kernel: [70921.964014] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 01:05:48 juju-e4d256-prod-github-runner-207 kernel: [70921.964771] ? __seccomp_filter+0x4a/0x4a0 Aug 23 01:05:48 juju-e4d256-prod-github-runner-207 kernel: [70921.965498] ? __fget_files+0x86/0xc0 Aug 23 01:05:48 juju-e4d256-prod-github-runner-207 kernel: [70921.966187] __x64_sys_ioctl+0x95/0xd0 Aug 23 01:05:48 juju-e4d256-prod-github-runner-207 kernel: [70921.966879] do_syscall_64+0x5c/0xc0 Aug 23 01:05:48 juju-e4d256-prod-github-runner-207 kernel: [70921.967560] ? do_futex+0x162/0x1f0 Aug 23 01:05:48 juju-e4d256-prod-github-runner-207 kernel: [70921.968229] ? __x64_sys_futex+0x78/0x1e0 Aug 23 01:05:48 juju-e4d256-prod-github-runner-207 kernel: [70921.968939] ? __secure_computing+0xa9/0x120 Aug 23 01:05:48 juju-e4d256-prod-github-runner-207 kernel: [70921.969653] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 01:05:48 juju-e4d256-prod-github-runner-207 kernel: [70921.970441] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:05:48 juju-e4d256-prod-github-runner-207 kernel: [70921.971193] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:05:48 juju-e4d256-prod-github-runner-207 kernel: [70921.971944] ? do_syscall_64+0x69/0xc0 Aug 23 01:05:48 juju-e4d256-prod-github-runner-207 kernel: [70921.972632] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:05:48 juju-e4d256-prod-github-runner-207 kernel: [70921.973395] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:05:48 juju-e4d256-prod-github-runner-207 kernel: [70921.974148] ? do_syscall_64+0x69/0xc0 Aug 23 01:05:48 juju-e4d256-prod-github-runner-207 kernel: [70921.974840] ? do_syscall_64+0x69/0xc0 Aug 23 01:05:48 juju-e4d256-prod-github-runner-207 kernel: [70921.975525] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 01:05:48 juju-e4d256-prod-github-runner-207 kernel: [70921.976291] RIP: 0033:0x7faa5d0edaff Aug 23 01:05:48 juju-e4d256-prod-github-runner-207 kernel: [70921.976983] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 01:05:48 juju-e4d256-prod-github-runner-207 kernel: [70921.979073] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 01:05:48 juju-e4d256-prod-github-runner-207 kernel: [70921.980032] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 01:05:48 juju-e4d256-prod-github-runner-207 kernel: [70921.980985] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 01:05:48 juju-e4d256-prod-github-runner-207 kernel: [70921.981927] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 01:05:48 juju-e4d256-prod-github-runner-207 kernel: [70921.982861] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 01:05:48 juju-e4d256-prod-github-runner-207 kernel: [70921.983787] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 01:05:48 juju-e4d256-prod-github-runner-207 kernel: [70921.984696] Aug 23 01:06:14 juju-e4d256-prod-github-runner-207 kernel: [70948.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 65967s! [qemu-system-x86:6715] Aug 23 01:06:14 juju-e4d256-prod-github-runner-207 kernel: [70948.543114] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 01:06:14 juju-e4d256-prod-github-runner-207 kernel: [70948.543186] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 01:06:14 juju-e4d256-prod-github-runner-207 kernel: [70948.555349] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 01:06:14 juju-e4d256-prod-github-runner-207 kernel: [70948.556629] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 01:06:14 juju-e4d256-prod-github-runner-207 kernel: [70948.557846] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:06:14 juju-e4d256-prod-github-runner-207 kernel: [70948.558898] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 01:06:14 juju-e4d256-prod-github-runner-207 kernel: [70948.561448] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 01:06:14 juju-e4d256-prod-github-runner-207 kernel: [70948.562489] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 01:06:14 juju-e4d256-prod-github-runner-207 kernel: [70948.563647] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 01:06:14 juju-e4d256-prod-github-runner-207 kernel: [70948.564821] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 01:06:14 juju-e4d256-prod-github-runner-207 kernel: [70948.565977] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 01:06:14 juju-e4d256-prod-github-runner-207 kernel: [70948.567138] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 01:06:14 juju-e4d256-prod-github-runner-207 kernel: [70948.568303] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 01:06:14 juju-e4d256-prod-github-runner-207 kernel: [70948.569551] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 01:06:14 juju-e4d256-prod-github-runner-207 kernel: [70948.570645] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 01:06:14 juju-e4d256-prod-github-runner-207 kernel: [70948.571974] Call Trace: Aug 23 01:06:14 juju-e4d256-prod-github-runner-207 kernel: [70948.572907] Aug 23 01:06:14 juju-e4d256-prod-github-runner-207 kernel: [70948.573792] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:06:14 juju-e4d256-prod-github-runner-207 kernel: [70948.574830] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:06:14 juju-e4d256-prod-github-runner-207 kernel: [70948.575855] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:06:14 juju-e4d256-prod-github-runner-207 kernel: [70948.576944] ? show_regs.part.0+0x23/0x29 Aug 23 01:06:14 juju-e4d256-prod-github-runner-207 kernel: [70948.577946] ? show_regs.cold+0x8/0xd Aug 23 01:06:14 juju-e4d256-prod-github-runner-207 kernel: [70948.578922] ? watchdog_timer_fn+0x1be/0x220 Aug 23 01:06:14 juju-e4d256-prod-github-runner-207 kernel: [70948.579934] ? lockup_detector_update_enable+0x60/0x60 Aug 23 01:06:14 juju-e4d256-prod-github-runner-207 kernel: [70948.581009] ? __hrtimer_run_queues+0x107/0x230 Aug 23 01:06:14 juju-e4d256-prod-github-runner-207 kernel: [70948.582038] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 01:06:14 juju-e4d256-prod-github-runner-207 kernel: [70948.583062] ? hrtimer_interrupt+0x101/0x220 Aug 23 01:06:14 juju-e4d256-prod-github-runner-207 kernel: [70948.584076] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 01:06:14 juju-e4d256-prod-github-runner-207 kernel: [70948.585164] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 01:06:14 juju-e4d256-prod-github-runner-207 kernel: [70948.586211] Aug 23 01:06:14 juju-e4d256-prod-github-runner-207 kernel: [70948.587062] Aug 23 01:06:14 juju-e4d256-prod-github-runner-207 kernel: [70948.587900] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 01:06:14 juju-e4d256-prod-github-runner-207 kernel: [70948.589092] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:06:14 juju-e4d256-prod-github-runner-207 kernel: [70948.590212] ? _raw_spin_lock+0x22/0x30 Aug 23 01:06:14 juju-e4d256-prod-github-runner-207 kernel: [70948.591156] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:06:14 juju-e4d256-prod-github-runner-207 kernel: [70948.592176] direct_page_fault+0x206/0x310 [kvm] Aug 23 01:06:14 juju-e4d256-prod-github-runner-207 kernel: [70948.593211] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 01:06:14 juju-e4d256-prod-github-runner-207 kernel: [70948.594217] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 01:06:14 juju-e4d256-prod-github-runner-207 kernel: [70948.595215] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 01:06:14 juju-e4d256-prod-github-runner-207 kernel: [70948.596188] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 01:06:14 juju-e4d256-prod-github-runner-207 kernel: [70948.597145] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 01:06:14 juju-e4d256-prod-github-runner-207 kernel: [70948.598126] handle_exit+0x98/0x230 [kvm_amd] Aug 23 01:06:14 juju-e4d256-prod-github-runner-207 kernel: [70948.599017] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 01:06:14 juju-e4d256-prod-github-runner-207 kernel: [70948.599928] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 01:06:14 juju-e4d256-prod-github-runner-207 kernel: [70948.600872] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 01:06:14 juju-e4d256-prod-github-runner-207 kernel: [70948.601779] vcpu_run+0x62/0x2c0 [kvm] Aug 23 01:06:14 juju-e4d256-prod-github-runner-207 kernel: [70948.602588] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 01:06:14 juju-e4d256-prod-github-runner-207 kernel: [70948.603514] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 01:06:14 juju-e4d256-prod-github-runner-207 kernel: [70948.604369] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 01:06:14 juju-e4d256-prod-github-runner-207 kernel: [70948.605184] ? __seccomp_filter+0x4a/0x4a0 Aug 23 01:06:14 juju-e4d256-prod-github-runner-207 kernel: [70948.605929] ? __fget_files+0x86/0xc0 Aug 23 01:06:14 juju-e4d256-prod-github-runner-207 kernel: [70948.606631] __x64_sys_ioctl+0x95/0xd0 Aug 23 01:06:14 juju-e4d256-prod-github-runner-207 kernel: [70948.607327] do_syscall_64+0x5c/0xc0 Aug 23 01:06:14 juju-e4d256-prod-github-runner-207 kernel: [70948.607997] ? do_futex+0x162/0x1f0 Aug 23 01:06:14 juju-e4d256-prod-github-runner-207 kernel: [70948.608661] ? __x64_sys_futex+0x78/0x1e0 Aug 23 01:06:14 juju-e4d256-prod-github-runner-207 kernel: [70948.609340] ? __secure_computing+0xa9/0x120 Aug 23 01:06:14 juju-e4d256-prod-github-runner-207 kernel: [70948.610033] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 01:06:14 juju-e4d256-prod-github-runner-207 kernel: [70948.610791] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:06:14 juju-e4d256-prod-github-runner-207 kernel: [70948.611510] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:06:14 juju-e4d256-prod-github-runner-207 kernel: [70948.612226] ? do_syscall_64+0x69/0xc0 Aug 23 01:06:14 juju-e4d256-prod-github-runner-207 kernel: [70948.612888] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:06:14 juju-e4d256-prod-github-runner-207 kernel: [70948.613591] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:06:14 juju-e4d256-prod-github-runner-207 kernel: [70948.614284] ? do_syscall_64+0x69/0xc0 Aug 23 01:06:14 juju-e4d256-prod-github-runner-207 kernel: [70948.614964] ? do_syscall_64+0x69/0xc0 Aug 23 01:06:14 juju-e4d256-prod-github-runner-207 kernel: [70948.615647] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 01:06:14 juju-e4d256-prod-github-runner-207 kernel: [70948.616349] RIP: 0033:0x7faa5d0edaff Aug 23 01:06:14 juju-e4d256-prod-github-runner-207 kernel: [70948.616986] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 01:06:14 juju-e4d256-prod-github-runner-207 kernel: [70948.618969] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 01:06:14 juju-e4d256-prod-github-runner-207 kernel: [70948.619878] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 01:06:14 juju-e4d256-prod-github-runner-207 kernel: [70948.620783] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 01:06:14 juju-e4d256-prod-github-runner-207 kernel: [70948.621671] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 01:06:14 juju-e4d256-prod-github-runner-207 kernel: [70948.622557] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 01:06:14 juju-e4d256-prod-github-runner-207 kernel: [70948.623449] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 01:06:14 juju-e4d256-prod-github-runner-207 kernel: [70948.624343] Aug 23 01:06:42 juju-e4d256-prod-github-runner-207 kernel: [70976.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 65994s! [qemu-system-x86:6715] Aug 23 01:06:42 juju-e4d256-prod-github-runner-207 kernel: [70976.543743] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 01:06:42 juju-e4d256-prod-github-runner-207 kernel: [70976.544001] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 01:06:42 juju-e4d256-prod-github-runner-207 kernel: [70976.556809] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 01:06:42 juju-e4d256-prod-github-runner-207 kernel: [70976.558073] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 01:06:42 juju-e4d256-prod-github-runner-207 kernel: [70976.559289] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:06:42 juju-e4d256-prod-github-runner-207 kernel: [70976.560353] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 01:06:42 juju-e4d256-prod-github-runner-207 kernel: [70976.562898] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 01:06:42 juju-e4d256-prod-github-runner-207 kernel: [70976.563943] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 01:06:42 juju-e4d256-prod-github-runner-207 kernel: [70976.565117] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 01:06:42 juju-e4d256-prod-github-runner-207 kernel: [70976.566274] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 01:06:42 juju-e4d256-prod-github-runner-207 kernel: [70976.567433] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 01:06:42 juju-e4d256-prod-github-runner-207 kernel: [70976.568598] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 01:06:42 juju-e4d256-prod-github-runner-207 kernel: [70976.569764] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 01:06:42 juju-e4d256-prod-github-runner-207 kernel: [70976.570993] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 01:06:42 juju-e4d256-prod-github-runner-207 kernel: [70976.572091] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 01:06:42 juju-e4d256-prod-github-runner-207 kernel: [70976.573295] Call Trace: Aug 23 01:06:42 juju-e4d256-prod-github-runner-207 kernel: [70976.574211] Aug 23 01:06:42 juju-e4d256-prod-github-runner-207 kernel: [70976.575109] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:06:42 juju-e4d256-prod-github-runner-207 kernel: [70976.576137] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:06:42 juju-e4d256-prod-github-runner-207 kernel: [70976.577170] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:06:42 juju-e4d256-prod-github-runner-207 kernel: [70976.578270] ? show_regs.part.0+0x23/0x29 Aug 23 01:06:42 juju-e4d256-prod-github-runner-207 kernel: [70976.579276] ? show_regs.cold+0x8/0xd Aug 23 01:06:42 juju-e4d256-prod-github-runner-207 kernel: [70976.580269] ? watchdog_timer_fn+0x1be/0x220 Aug 23 01:06:42 juju-e4d256-prod-github-runner-207 kernel: [70976.581277] ? lockup_detector_update_enable+0x60/0x60 Aug 23 01:06:42 juju-e4d256-prod-github-runner-207 kernel: [70976.582349] ? __hrtimer_run_queues+0x107/0x230 Aug 23 01:06:42 juju-e4d256-prod-github-runner-207 kernel: [70976.583374] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 01:06:42 juju-e4d256-prod-github-runner-207 kernel: [70976.584405] ? hrtimer_interrupt+0x101/0x220 Aug 23 01:06:42 juju-e4d256-prod-github-runner-207 kernel: [70976.585420] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 01:06:42 juju-e4d256-prod-github-runner-207 kernel: [70976.586504] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 01:06:42 juju-e4d256-prod-github-runner-207 kernel: [70976.587552] Aug 23 01:06:42 juju-e4d256-prod-github-runner-207 kernel: [70976.588443] Aug 23 01:06:42 juju-e4d256-prod-github-runner-207 kernel: [70976.589284] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 01:06:42 juju-e4d256-prod-github-runner-207 kernel: [70976.590323] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:06:42 juju-e4d256-prod-github-runner-207 kernel: [70976.591391] ? _raw_spin_lock+0x22/0x30 Aug 23 01:06:42 juju-e4d256-prod-github-runner-207 kernel: [70976.592365] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:06:42 juju-e4d256-prod-github-runner-207 kernel: [70976.593384] direct_page_fault+0x206/0x310 [kvm] Aug 23 01:06:42 juju-e4d256-prod-github-runner-207 kernel: [70976.594405] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 01:06:42 juju-e4d256-prod-github-runner-207 kernel: [70976.595410] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 01:06:42 juju-e4d256-prod-github-runner-207 kernel: [70976.596421] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 01:06:42 juju-e4d256-prod-github-runner-207 kernel: [70976.597416] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 01:06:42 juju-e4d256-prod-github-runner-207 kernel: [70976.598359] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 01:06:42 juju-e4d256-prod-github-runner-207 kernel: [70976.599342] handle_exit+0x98/0x230 [kvm_amd] Aug 23 01:06:42 juju-e4d256-prod-github-runner-207 kernel: [70976.600249] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 01:06:42 juju-e4d256-prod-github-runner-207 kernel: [70976.601163] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 01:06:42 juju-e4d256-prod-github-runner-207 kernel: [70976.602090] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 01:06:42 juju-e4d256-prod-github-runner-207 kernel: [70976.602991] vcpu_run+0x62/0x2c0 [kvm] Aug 23 01:06:42 juju-e4d256-prod-github-runner-207 kernel: [70976.603800] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 01:06:42 juju-e4d256-prod-github-runner-207 kernel: [70976.604613] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 01:06:42 juju-e4d256-prod-github-runner-207 kernel: [70976.605472] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 01:06:42 juju-e4d256-prod-github-runner-207 kernel: [70976.606273] ? __seccomp_filter+0x4a/0x4a0 Aug 23 01:06:42 juju-e4d256-prod-github-runner-207 kernel: [70976.607014] ? __fget_files+0x86/0xc0 Aug 23 01:06:42 juju-e4d256-prod-github-runner-207 kernel: [70976.607719] __x64_sys_ioctl+0x95/0xd0 Aug 23 01:06:42 juju-e4d256-prod-github-runner-207 kernel: [70976.608450] do_syscall_64+0x5c/0xc0 Aug 23 01:06:42 juju-e4d256-prod-github-runner-207 kernel: [70976.609116] ? do_futex+0x162/0x1f0 Aug 23 01:06:42 juju-e4d256-prod-github-runner-207 kernel: [70976.609765] ? __x64_sys_futex+0x78/0x1e0 Aug 23 01:06:42 juju-e4d256-prod-github-runner-207 kernel: [70976.610436] ? __secure_computing+0xa9/0x120 Aug 23 01:06:42 juju-e4d256-prod-github-runner-207 kernel: [70976.611124] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 01:06:42 juju-e4d256-prod-github-runner-207 kernel: [70976.611882] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:06:42 juju-e4d256-prod-github-runner-207 kernel: [70976.612616] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:06:42 juju-e4d256-prod-github-runner-207 kernel: [70976.613332] ? do_syscall_64+0x69/0xc0 Aug 23 01:06:42 juju-e4d256-prod-github-runner-207 kernel: [70976.613975] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:06:42 juju-e4d256-prod-github-runner-207 kernel: [70976.614677] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:06:42 juju-e4d256-prod-github-runner-207 kernel: [70976.615374] ? do_syscall_64+0x69/0xc0 Aug 23 01:06:42 juju-e4d256-prod-github-runner-207 kernel: [70976.616008] ? do_syscall_64+0x69/0xc0 Aug 23 01:06:42 juju-e4d256-prod-github-runner-207 kernel: [70976.616648] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 01:06:42 juju-e4d256-prod-github-runner-207 kernel: [70976.617354] RIP: 0033:0x7faa5d0edaff Aug 23 01:06:42 juju-e4d256-prod-github-runner-207 kernel: [70976.617995] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 01:06:42 juju-e4d256-prod-github-runner-207 kernel: [70976.619982] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 01:06:42 juju-e4d256-prod-github-runner-207 kernel: [70976.620901] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 01:06:42 juju-e4d256-prod-github-runner-207 kernel: [70976.621790] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 01:06:42 juju-e4d256-prod-github-runner-207 kernel: [70976.622676] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 01:06:42 juju-e4d256-prod-github-runner-207 kernel: [70976.623562] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 01:06:42 juju-e4d256-prod-github-runner-207 kernel: [70976.624461] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 01:06:42 juju-e4d256-prod-github-runner-207 kernel: [70976.625355] Aug 23 01:07:10 juju-e4d256-prod-github-runner-207 kernel: [71004.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 66020s! [qemu-system-x86:6715] Aug 23 01:07:10 juju-e4d256-prod-github-runner-207 kernel: [71004.543086] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 01:07:10 juju-e4d256-prod-github-runner-207 kernel: [71004.543154] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 01:07:10 juju-e4d256-prod-github-runner-207 kernel: [71004.555205] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 01:07:10 juju-e4d256-prod-github-runner-207 kernel: [71004.556493] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 01:07:10 juju-e4d256-prod-github-runner-207 kernel: [71004.557724] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:07:10 juju-e4d256-prod-github-runner-207 kernel: [71004.558789] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 01:07:10 juju-e4d256-prod-github-runner-207 kernel: [71004.561376] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 01:07:10 juju-e4d256-prod-github-runner-207 kernel: [71004.562429] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 01:07:10 juju-e4d256-prod-github-runner-207 kernel: [71004.563603] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 01:07:10 juju-e4d256-prod-github-runner-207 kernel: [71004.564790] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 01:07:10 juju-e4d256-prod-github-runner-207 kernel: [71004.565965] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 01:07:10 juju-e4d256-prod-github-runner-207 kernel: [71004.567143] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 01:07:10 juju-e4d256-prod-github-runner-207 kernel: [71004.568331] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 01:07:10 juju-e4d256-prod-github-runner-207 kernel: [71004.569581] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 01:07:10 juju-e4d256-prod-github-runner-207 kernel: [71004.570697] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 01:07:10 juju-e4d256-prod-github-runner-207 kernel: [71004.571937] Call Trace: Aug 23 01:07:10 juju-e4d256-prod-github-runner-207 kernel: [71004.572863] Aug 23 01:07:10 juju-e4d256-prod-github-runner-207 kernel: [71004.573755] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:07:10 juju-e4d256-prod-github-runner-207 kernel: [71004.574805] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:07:10 juju-e4d256-prod-github-runner-207 kernel: [71004.575849] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:07:10 juju-e4d256-prod-github-runner-207 kernel: [71004.576936] ? show_regs.part.0+0x23/0x29 Aug 23 01:07:10 juju-e4d256-prod-github-runner-207 kernel: [71004.577942] ? show_regs.cold+0x8/0xd Aug 23 01:07:10 juju-e4d256-prod-github-runner-207 kernel: [71004.578921] ? watchdog_timer_fn+0x1be/0x220 Aug 23 01:07:10 juju-e4d256-prod-github-runner-207 kernel: [71004.579949] ? lockup_detector_update_enable+0x60/0x60 Aug 23 01:07:10 juju-e4d256-prod-github-runner-207 kernel: [71004.581022] ? __hrtimer_run_queues+0x107/0x230 Aug 23 01:07:10 juju-e4d256-prod-github-runner-207 kernel: [71004.582057] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 01:07:10 juju-e4d256-prod-github-runner-207 kernel: [71004.583091] ? hrtimer_interrupt+0x101/0x220 Aug 23 01:07:10 juju-e4d256-prod-github-runner-207 kernel: [71004.584126] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 01:07:10 juju-e4d256-prod-github-runner-207 kernel: [71004.585208] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 01:07:10 juju-e4d256-prod-github-runner-207 kernel: [71004.586262] Aug 23 01:07:10 juju-e4d256-prod-github-runner-207 kernel: [71004.587123] Aug 23 01:07:10 juju-e4d256-prod-github-runner-207 kernel: [71004.587985] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 01:07:10 juju-e4d256-prod-github-runner-207 kernel: [71004.589035] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:07:10 juju-e4d256-prod-github-runner-207 kernel: [71004.590082] ? _raw_spin_lock+0x22/0x30 Aug 23 01:07:10 juju-e4d256-prod-github-runner-207 kernel: [71004.591037] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:07:10 juju-e4d256-prod-github-runner-207 kernel: [71004.592085] direct_page_fault+0x206/0x310 [kvm] Aug 23 01:07:10 juju-e4d256-prod-github-runner-207 kernel: [71004.593122] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 01:07:10 juju-e4d256-prod-github-runner-207 kernel: [71004.594144] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 01:07:10 juju-e4d256-prod-github-runner-207 kernel: [71004.595155] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 01:07:10 juju-e4d256-prod-github-runner-207 kernel: [71004.596147] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 01:07:10 juju-e4d256-prod-github-runner-207 kernel: [71004.597102] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 01:07:10 juju-e4d256-prod-github-runner-207 kernel: [71004.598096] handle_exit+0x98/0x230 [kvm_amd] Aug 23 01:07:10 juju-e4d256-prod-github-runner-207 kernel: [71004.599001] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 01:07:10 juju-e4d256-prod-github-runner-207 kernel: [71004.599939] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 01:07:10 juju-e4d256-prod-github-runner-207 kernel: [71004.600875] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 01:07:10 juju-e4d256-prod-github-runner-207 kernel: [71004.601792] vcpu_run+0x62/0x2c0 [kvm] Aug 23 01:07:10 juju-e4d256-prod-github-runner-207 kernel: [71004.602628] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 01:07:10 juju-e4d256-prod-github-runner-207 kernel: [71004.603454] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 01:07:10 juju-e4d256-prod-github-runner-207 kernel: [71004.604331] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 01:07:10 juju-e4d256-prod-github-runner-207 kernel: [71004.605130] ? __seccomp_filter+0x4a/0x4a0 Aug 23 01:07:10 juju-e4d256-prod-github-runner-207 kernel: [71004.605873] ? __fget_files+0x86/0xc0 Aug 23 01:07:10 juju-e4d256-prod-github-runner-207 kernel: [71004.606576] __x64_sys_ioctl+0x95/0xd0 Aug 23 01:07:10 juju-e4d256-prod-github-runner-207 kernel: [71004.607268] do_syscall_64+0x5c/0xc0 Aug 23 01:07:10 juju-e4d256-prod-github-runner-207 kernel: [71004.607942] ? do_futex+0x162/0x1f0 Aug 23 01:07:10 juju-e4d256-prod-github-runner-207 kernel: [71004.608591] ? __x64_sys_futex+0x78/0x1e0 Aug 23 01:07:10 juju-e4d256-prod-github-runner-207 kernel: [71004.609264] ? __secure_computing+0xa9/0x120 Aug 23 01:07:10 juju-e4d256-prod-github-runner-207 kernel: [71004.609954] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 01:07:10 juju-e4d256-prod-github-runner-207 kernel: [71004.610713] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:07:10 juju-e4d256-prod-github-runner-207 kernel: [71004.611438] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:07:10 juju-e4d256-prod-github-runner-207 kernel: [71004.612180] ? do_syscall_64+0x69/0xc0 Aug 23 01:07:10 juju-e4d256-prod-github-runner-207 kernel: [71004.612827] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:07:10 juju-e4d256-prod-github-runner-207 kernel: [71004.613550] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:07:10 juju-e4d256-prod-github-runner-207 kernel: [71004.614247] ? do_syscall_64+0x69/0xc0 Aug 23 01:07:10 juju-e4d256-prod-github-runner-207 kernel: [71004.614871] ? do_syscall_64+0x69/0xc0 Aug 23 01:07:10 juju-e4d256-prod-github-runner-207 kernel: [71004.615495] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 01:07:10 juju-e4d256-prod-github-runner-207 kernel: [71004.616221] RIP: 0033:0x7faa5d0edaff Aug 23 01:07:10 juju-e4d256-prod-github-runner-207 kernel: [71004.616847] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 01:07:10 juju-e4d256-prod-github-runner-207 kernel: [71004.618840] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 01:07:10 juju-e4d256-prod-github-runner-207 kernel: [71004.619753] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 01:07:10 juju-e4d256-prod-github-runner-207 kernel: [71004.620663] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 01:07:10 juju-e4d256-prod-github-runner-207 kernel: [71004.621571] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 01:07:10 juju-e4d256-prod-github-runner-207 kernel: [71004.622459] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 01:07:10 juju-e4d256-prod-github-runner-207 kernel: [71004.623348] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 01:07:10 juju-e4d256-prod-github-runner-207 kernel: [71004.624249] Aug 23 01:07:38 juju-e4d256-prod-github-runner-207 kernel: [71032.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 66046s! [qemu-system-x86:6715] Aug 23 01:07:38 juju-e4d256-prod-github-runner-207 kernel: [71032.543103] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 01:07:38 juju-e4d256-prod-github-runner-207 kernel: [71032.543171] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 01:07:38 juju-e4d256-prod-github-runner-207 kernel: [71032.555274] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 01:07:38 juju-e4d256-prod-github-runner-207 kernel: [71032.556547] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 01:07:38 juju-e4d256-prod-github-runner-207 kernel: [71032.557765] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:07:38 juju-e4d256-prod-github-runner-207 kernel: [71032.558823] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 01:07:38 juju-e4d256-prod-github-runner-207 kernel: [71032.561375] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 01:07:38 juju-e4d256-prod-github-runner-207 kernel: [71032.562421] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 01:07:38 juju-e4d256-prod-github-runner-207 kernel: [71032.563596] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 01:07:38 juju-e4d256-prod-github-runner-207 kernel: [71032.564760] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 01:07:38 juju-e4d256-prod-github-runner-207 kernel: [71032.565917] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 01:07:38 juju-e4d256-prod-github-runner-207 kernel: [71032.567074] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 01:07:38 juju-e4d256-prod-github-runner-207 kernel: [71032.568250] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 01:07:38 juju-e4d256-prod-github-runner-207 kernel: [71032.569479] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 01:07:38 juju-e4d256-prod-github-runner-207 kernel: [71032.570580] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 01:07:38 juju-e4d256-prod-github-runner-207 kernel: [71032.571780] Call Trace: Aug 23 01:07:38 juju-e4d256-prod-github-runner-207 kernel: [71032.572690] Aug 23 01:07:38 juju-e4d256-prod-github-runner-207 kernel: [71032.573573] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:07:38 juju-e4d256-prod-github-runner-207 kernel: [71032.574600] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:07:38 juju-e4d256-prod-github-runner-207 kernel: [71032.575636] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:07:38 juju-e4d256-prod-github-runner-207 kernel: [71032.576710] ? show_regs.part.0+0x23/0x29 Aug 23 01:07:38 juju-e4d256-prod-github-runner-207 kernel: [71032.577706] ? show_regs.cold+0x8/0xd Aug 23 01:07:38 juju-e4d256-prod-github-runner-207 kernel: [71032.578674] ? watchdog_timer_fn+0x1be/0x220 Aug 23 01:07:38 juju-e4d256-prod-github-runner-207 kernel: [71032.579691] ? lockup_detector_update_enable+0x60/0x60 Aug 23 01:07:38 juju-e4d256-prod-github-runner-207 kernel: [71032.580754] ? __hrtimer_run_queues+0x107/0x230 Aug 23 01:07:38 juju-e4d256-prod-github-runner-207 kernel: [71032.581788] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 01:07:38 juju-e4d256-prod-github-runner-207 kernel: [71032.582897] ? hrtimer_interrupt+0x101/0x220 Aug 23 01:07:38 juju-e4d256-prod-github-runner-207 kernel: [71032.583934] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 01:07:38 juju-e4d256-prod-github-runner-207 kernel: [71032.585040] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 01:07:38 juju-e4d256-prod-github-runner-207 kernel: [71032.586118] Aug 23 01:07:38 juju-e4d256-prod-github-runner-207 kernel: [71032.586973] Aug 23 01:07:38 juju-e4d256-prod-github-runner-207 kernel: [71032.587827] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 01:07:38 juju-e4d256-prod-github-runner-207 kernel: [71032.588866] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:07:38 juju-e4d256-prod-github-runner-207 kernel: [71032.590060] ? _raw_spin_lock+0x22/0x30 Aug 23 01:07:38 juju-e4d256-prod-github-runner-207 kernel: [71032.591006] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:07:38 juju-e4d256-prod-github-runner-207 kernel: [71032.592038] direct_page_fault+0x206/0x310 [kvm] Aug 23 01:07:38 juju-e4d256-prod-github-runner-207 kernel: [71032.593242] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 01:07:38 juju-e4d256-prod-github-runner-207 kernel: [71032.594251] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 01:07:38 juju-e4d256-prod-github-runner-207 kernel: [71032.595251] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 01:07:38 juju-e4d256-prod-github-runner-207 kernel: [71032.596233] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 01:07:38 juju-e4d256-prod-github-runner-207 kernel: [71032.597177] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 01:07:38 juju-e4d256-prod-github-runner-207 kernel: [71032.598155] handle_exit+0x98/0x230 [kvm_amd] Aug 23 01:07:38 juju-e4d256-prod-github-runner-207 kernel: [71032.599050] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 01:07:38 juju-e4d256-prod-github-runner-207 kernel: [71032.599978] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 01:07:38 juju-e4d256-prod-github-runner-207 kernel: [71032.600902] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 01:07:38 juju-e4d256-prod-github-runner-207 kernel: [71032.601805] vcpu_run+0x62/0x2c0 [kvm] Aug 23 01:07:38 juju-e4d256-prod-github-runner-207 kernel: [71032.602615] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 01:07:38 juju-e4d256-prod-github-runner-207 kernel: [71032.603422] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 01:07:38 juju-e4d256-prod-github-runner-207 kernel: [71032.604291] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 01:07:38 juju-e4d256-prod-github-runner-207 kernel: [71032.605088] ? __seccomp_filter+0x4a/0x4a0 Aug 23 01:07:38 juju-e4d256-prod-github-runner-207 kernel: [71032.605837] ? __fget_files+0x86/0xc0 Aug 23 01:07:38 juju-e4d256-prod-github-runner-207 kernel: [71032.606541] __x64_sys_ioctl+0x95/0xd0 Aug 23 01:07:38 juju-e4d256-prod-github-runner-207 kernel: [71032.607233] do_syscall_64+0x5c/0xc0 Aug 23 01:07:38 juju-e4d256-prod-github-runner-207 kernel: [71032.607913] ? do_futex+0x162/0x1f0 Aug 23 01:07:38 juju-e4d256-prod-github-runner-207 kernel: [71032.608566] ? __x64_sys_futex+0x78/0x1e0 Aug 23 01:07:38 juju-e4d256-prod-github-runner-207 kernel: [71032.609241] ? __secure_computing+0xa9/0x120 Aug 23 01:07:38 juju-e4d256-prod-github-runner-207 kernel: [71032.609938] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 01:07:38 juju-e4d256-prod-github-runner-207 kernel: [71032.610703] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:07:38 juju-e4d256-prod-github-runner-207 kernel: [71032.611425] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:07:38 juju-e4d256-prod-github-runner-207 kernel: [71032.612154] ? do_syscall_64+0x69/0xc0 Aug 23 01:07:38 juju-e4d256-prod-github-runner-207 kernel: [71032.612800] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:07:38 juju-e4d256-prod-github-runner-207 kernel: [71032.613503] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:07:38 juju-e4d256-prod-github-runner-207 kernel: [71032.614203] ? do_syscall_64+0x69/0xc0 Aug 23 01:07:38 juju-e4d256-prod-github-runner-207 kernel: [71032.614833] ? do_syscall_64+0x69/0xc0 Aug 23 01:07:38 juju-e4d256-prod-github-runner-207 kernel: [71032.615455] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 01:07:38 juju-e4d256-prod-github-runner-207 kernel: [71032.616175] RIP: 0033:0x7faa5d0edaff Aug 23 01:07:38 juju-e4d256-prod-github-runner-207 kernel: [71032.616875] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 01:07:38 juju-e4d256-prod-github-runner-207 kernel: [71032.618866] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 01:07:38 juju-e4d256-prod-github-runner-207 kernel: [71032.619788] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 01:07:38 juju-e4d256-prod-github-runner-207 kernel: [71032.620682] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 01:07:38 juju-e4d256-prod-github-runner-207 kernel: [71032.621571] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 01:07:38 juju-e4d256-prod-github-runner-207 kernel: [71032.622458] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 01:07:38 juju-e4d256-prod-github-runner-207 kernel: [71032.623345] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 01:07:38 juju-e4d256-prod-github-runner-207 kernel: [71032.624246] Aug 23 01:08:06 juju-e4d256-prod-github-runner-207 kernel: [71060.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 66072s! [qemu-system-x86:6715] Aug 23 01:08:06 juju-e4d256-prod-github-runner-207 kernel: [71060.543800] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 01:08:06 juju-e4d256-prod-github-runner-207 kernel: [71060.544071] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 01:08:06 juju-e4d256-prod-github-runner-207 kernel: [71060.556147] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 01:08:06 juju-e4d256-prod-github-runner-207 kernel: [71060.557411] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 01:08:06 juju-e4d256-prod-github-runner-207 kernel: [71060.558661] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:08:06 juju-e4d256-prod-github-runner-207 kernel: [71060.559727] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 01:08:06 juju-e4d256-prod-github-runner-207 kernel: [71060.562268] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 01:08:06 juju-e4d256-prod-github-runner-207 kernel: [71060.563353] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 01:08:06 juju-e4d256-prod-github-runner-207 kernel: [71060.564524] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 01:08:06 juju-e4d256-prod-github-runner-207 kernel: [71060.565713] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 01:08:06 juju-e4d256-prod-github-runner-207 kernel: [71060.566871] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 01:08:06 juju-e4d256-prod-github-runner-207 kernel: [71060.568047] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 01:08:06 juju-e4d256-prod-github-runner-207 kernel: [71060.569210] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 01:08:06 juju-e4d256-prod-github-runner-207 kernel: [71060.570439] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 01:08:06 juju-e4d256-prod-github-runner-207 kernel: [71060.571543] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 01:08:06 juju-e4d256-prod-github-runner-207 kernel: [71060.572741] Call Trace: Aug 23 01:08:06 juju-e4d256-prod-github-runner-207 kernel: [71060.573837] Aug 23 01:08:06 juju-e4d256-prod-github-runner-207 kernel: [71060.574785] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:08:06 juju-e4d256-prod-github-runner-207 kernel: [71060.575868] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:08:06 juju-e4d256-prod-github-runner-207 kernel: [71060.576897] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:08:06 juju-e4d256-prod-github-runner-207 kernel: [71060.577988] ? show_regs.part.0+0x23/0x29 Aug 23 01:08:06 juju-e4d256-prod-github-runner-207 kernel: [71060.578993] ? show_regs.cold+0x8/0xd Aug 23 01:08:06 juju-e4d256-prod-github-runner-207 kernel: [71060.580044] ? watchdog_timer_fn+0x1be/0x220 Aug 23 01:08:06 juju-e4d256-prod-github-runner-207 kernel: [71060.581064] ? lockup_detector_update_enable+0x60/0x60 Aug 23 01:08:06 juju-e4d256-prod-github-runner-207 kernel: [71060.582259] ? __hrtimer_run_queues+0x107/0x230 Aug 23 01:08:06 juju-e4d256-prod-github-runner-207 kernel: [71060.583299] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 01:08:06 juju-e4d256-prod-github-runner-207 kernel: [71060.584351] ? hrtimer_interrupt+0x101/0x220 Aug 23 01:08:06 juju-e4d256-prod-github-runner-207 kernel: [71060.585382] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 01:08:06 juju-e4d256-prod-github-runner-207 kernel: [71060.586453] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 01:08:06 juju-e4d256-prod-github-runner-207 kernel: [71060.587515] Aug 23 01:08:06 juju-e4d256-prod-github-runner-207 kernel: [71060.588370] Aug 23 01:08:06 juju-e4d256-prod-github-runner-207 kernel: [71060.589251] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 01:08:06 juju-e4d256-prod-github-runner-207 kernel: [71060.590312] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:08:06 juju-e4d256-prod-github-runner-207 kernel: [71060.591376] ? _raw_spin_lock+0x22/0x30 Aug 23 01:08:06 juju-e4d256-prod-github-runner-207 kernel: [71060.592369] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:08:06 juju-e4d256-prod-github-runner-207 kernel: [71060.593469] direct_page_fault+0x206/0x310 [kvm] Aug 23 01:08:06 juju-e4d256-prod-github-runner-207 kernel: [71060.594573] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 01:08:06 juju-e4d256-prod-github-runner-207 kernel: [71060.595635] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 01:08:06 juju-e4d256-prod-github-runner-207 kernel: [71060.596643] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 01:08:06 juju-e4d256-prod-github-runner-207 kernel: [71060.597674] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 01:08:06 juju-e4d256-prod-github-runner-207 kernel: [71060.598621] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 01:08:06 juju-e4d256-prod-github-runner-207 kernel: [71060.599621] handle_exit+0x98/0x230 [kvm_amd] Aug 23 01:08:06 juju-e4d256-prod-github-runner-207 kernel: [71060.600556] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 01:08:06 juju-e4d256-prod-github-runner-207 kernel: [71060.601498] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 01:08:06 juju-e4d256-prod-github-runner-207 kernel: [71060.602423] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 01:08:06 juju-e4d256-prod-github-runner-207 kernel: [71060.603350] vcpu_run+0x62/0x2c0 [kvm] Aug 23 01:08:06 juju-e4d256-prod-github-runner-207 kernel: [71060.604166] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 01:08:06 juju-e4d256-prod-github-runner-207 kernel: [71060.604991] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 01:08:06 juju-e4d256-prod-github-runner-207 kernel: [71060.605871] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 01:08:06 juju-e4d256-prod-github-runner-207 kernel: [71060.606677] ? __seccomp_filter+0x4a/0x4a0 Aug 23 01:08:06 juju-e4d256-prod-github-runner-207 kernel: [71060.607442] ? __fget_files+0x86/0xc0 Aug 23 01:08:06 juju-e4d256-prod-github-runner-207 kernel: [71060.608166] __x64_sys_ioctl+0x95/0xd0 Aug 23 01:08:06 juju-e4d256-prod-github-runner-207 kernel: [71060.608934] do_syscall_64+0x5c/0xc0 Aug 23 01:08:06 juju-e4d256-prod-github-runner-207 kernel: [71060.609618] ? do_futex+0x162/0x1f0 Aug 23 01:08:06 juju-e4d256-prod-github-runner-207 kernel: [71060.610298] ? __x64_sys_futex+0x78/0x1e0 Aug 23 01:08:06 juju-e4d256-prod-github-runner-207 kernel: [71060.611032] ? __secure_computing+0xa9/0x120 Aug 23 01:08:06 juju-e4d256-prod-github-runner-207 kernel: [71060.611781] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 01:08:06 juju-e4d256-prod-github-runner-207 kernel: [71060.612545] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:08:06 juju-e4d256-prod-github-runner-207 kernel: [71060.613273] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:08:06 juju-e4d256-prod-github-runner-207 kernel: [71060.613994] ? do_syscall_64+0x69/0xc0 Aug 23 01:08:06 juju-e4d256-prod-github-runner-207 kernel: [71060.614641] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:08:06 juju-e4d256-prod-github-runner-207 kernel: [71060.615365] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:08:06 juju-e4d256-prod-github-runner-207 kernel: [71060.616091] ? do_syscall_64+0x69/0xc0 Aug 23 01:08:06 juju-e4d256-prod-github-runner-207 kernel: [71060.616730] ? do_syscall_64+0x69/0xc0 Aug 23 01:08:06 juju-e4d256-prod-github-runner-207 kernel: [71060.617356] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 01:08:06 juju-e4d256-prod-github-runner-207 kernel: [71060.618064] RIP: 0033:0x7faa5d0edaff Aug 23 01:08:06 juju-e4d256-prod-github-runner-207 kernel: [71060.618723] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 01:08:06 juju-e4d256-prod-github-runner-207 kernel: [71060.620748] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 01:08:06 juju-e4d256-prod-github-runner-207 kernel: [71060.621694] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 01:08:06 juju-e4d256-prod-github-runner-207 kernel: [71060.622654] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 01:08:06 juju-e4d256-prod-github-runner-207 kernel: [71060.623613] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 01:08:06 juju-e4d256-prod-github-runner-207 kernel: [71060.624508] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 01:08:06 juju-e4d256-prod-github-runner-207 kernel: [71060.625431] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 01:08:06 juju-e4d256-prod-github-runner-207 kernel: [71060.626402] Aug 23 01:08:34 juju-e4d256-prod-github-runner-207 kernel: [71088.541976] watchdog: BUG: soft lockup - CPU#1 stuck for 66098s! [qemu-system-x86:6715] Aug 23 01:08:34 juju-e4d256-prod-github-runner-207 kernel: [71088.543114] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 01:08:34 juju-e4d256-prod-github-runner-207 kernel: [71088.543183] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 01:08:34 juju-e4d256-prod-github-runner-207 kernel: [71088.555311] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 01:08:34 juju-e4d256-prod-github-runner-207 kernel: [71088.556579] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 01:08:34 juju-e4d256-prod-github-runner-207 kernel: [71088.557798] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:08:34 juju-e4d256-prod-github-runner-207 kernel: [71088.558868] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 01:08:34 juju-e4d256-prod-github-runner-207 kernel: [71088.561450] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 01:08:34 juju-e4d256-prod-github-runner-207 kernel: [71088.562495] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 01:08:34 juju-e4d256-prod-github-runner-207 kernel: [71088.563667] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 01:08:34 juju-e4d256-prod-github-runner-207 kernel: [71088.564829] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 01:08:34 juju-e4d256-prod-github-runner-207 kernel: [71088.565992] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 01:08:34 juju-e4d256-prod-github-runner-207 kernel: [71088.567180] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 01:08:34 juju-e4d256-prod-github-runner-207 kernel: [71088.568354] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 01:08:34 juju-e4d256-prod-github-runner-207 kernel: [71088.569601] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 01:08:34 juju-e4d256-prod-github-runner-207 kernel: [71088.570700] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 01:08:34 juju-e4d256-prod-github-runner-207 kernel: [71088.571914] Call Trace: Aug 23 01:08:34 juju-e4d256-prod-github-runner-207 kernel: [71088.572830] Aug 23 01:08:34 juju-e4d256-prod-github-runner-207 kernel: [71088.573712] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:08:34 juju-e4d256-prod-github-runner-207 kernel: [71088.574741] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:08:34 juju-e4d256-prod-github-runner-207 kernel: [71088.575790] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:08:34 juju-e4d256-prod-github-runner-207 kernel: [71088.576876] ? show_regs.part.0+0x23/0x29 Aug 23 01:08:34 juju-e4d256-prod-github-runner-207 kernel: [71088.577882] ? show_regs.cold+0x8/0xd Aug 23 01:08:34 juju-e4d256-prod-github-runner-207 kernel: [71088.578896] ? watchdog_timer_fn+0x1be/0x220 Aug 23 01:08:34 juju-e4d256-prod-github-runner-207 kernel: [71088.579923] ? lockup_detector_update_enable+0x60/0x60 Aug 23 01:08:34 juju-e4d256-prod-github-runner-207 kernel: [71088.581012] ? __hrtimer_run_queues+0x107/0x230 Aug 23 01:08:34 juju-e4d256-prod-github-runner-207 kernel: [71088.582044] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 01:08:34 juju-e4d256-prod-github-runner-207 kernel: [71088.583085] ? hrtimer_interrupt+0x101/0x220 Aug 23 01:08:34 juju-e4d256-prod-github-runner-207 kernel: [71088.584110] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 01:08:34 juju-e4d256-prod-github-runner-207 kernel: [71088.585224] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 01:08:34 juju-e4d256-prod-github-runner-207 kernel: [71088.586331] Aug 23 01:08:34 juju-e4d256-prod-github-runner-207 kernel: [71088.587251] Aug 23 01:08:34 juju-e4d256-prod-github-runner-207 kernel: [71088.588089] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 01:08:34 juju-e4d256-prod-github-runner-207 kernel: [71088.589122] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:08:34 juju-e4d256-prod-github-runner-207 kernel: [71088.590172] ? _raw_spin_lock+0x22/0x30 Aug 23 01:08:34 juju-e4d256-prod-github-runner-207 kernel: [71088.591135] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:08:34 juju-e4d256-prod-github-runner-207 kernel: [71088.592156] direct_page_fault+0x206/0x310 [kvm] Aug 23 01:08:34 juju-e4d256-prod-github-runner-207 kernel: [71088.593178] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 01:08:34 juju-e4d256-prod-github-runner-207 kernel: [71088.594200] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 01:08:34 juju-e4d256-prod-github-runner-207 kernel: [71088.595326] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 01:08:34 juju-e4d256-prod-github-runner-207 kernel: [71088.596645] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 01:08:34 juju-e4d256-prod-github-runner-207 kernel: [71088.597602] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 01:08:34 juju-e4d256-prod-github-runner-207 kernel: [71088.598579] handle_exit+0x98/0x230 [kvm_amd] Aug 23 01:08:34 juju-e4d256-prod-github-runner-207 kernel: [71088.599497] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 01:08:34 juju-e4d256-prod-github-runner-207 kernel: [71088.600414] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 01:08:34 juju-e4d256-prod-github-runner-207 kernel: [71088.601378] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 01:08:34 juju-e4d256-prod-github-runner-207 kernel: [71088.602286] vcpu_run+0x62/0x2c0 [kvm] Aug 23 01:08:34 juju-e4d256-prod-github-runner-207 kernel: [71088.603279] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 01:08:34 juju-e4d256-prod-github-runner-207 kernel: [71088.604088] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 01:08:34 juju-e4d256-prod-github-runner-207 kernel: [71088.604942] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 01:08:34 juju-e4d256-prod-github-runner-207 kernel: [71088.605739] ? __seccomp_filter+0x4a/0x4a0 Aug 23 01:08:34 juju-e4d256-prod-github-runner-207 kernel: [71088.606489] ? __fget_files+0x86/0xc0 Aug 23 01:08:34 juju-e4d256-prod-github-runner-207 kernel: [71088.607211] __x64_sys_ioctl+0x95/0xd0 Aug 23 01:08:34 juju-e4d256-prod-github-runner-207 kernel: [71088.607905] do_syscall_64+0x5c/0xc0 Aug 23 01:08:34 juju-e4d256-prod-github-runner-207 kernel: [71088.608570] ? do_futex+0x162/0x1f0 Aug 23 01:08:34 juju-e4d256-prod-github-runner-207 kernel: [71088.609225] ? __x64_sys_futex+0x78/0x1e0 Aug 23 01:08:34 juju-e4d256-prod-github-runner-207 kernel: [71088.609900] ? __secure_computing+0xa9/0x120 Aug 23 01:08:34 juju-e4d256-prod-github-runner-207 kernel: [71088.610589] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 01:08:34 juju-e4d256-prod-github-runner-207 kernel: [71088.611380] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:08:34 juju-e4d256-prod-github-runner-207 kernel: [71088.612103] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:08:34 juju-e4d256-prod-github-runner-207 kernel: [71088.612820] ? do_syscall_64+0x69/0xc0 Aug 23 01:08:34 juju-e4d256-prod-github-runner-207 kernel: [71088.613462] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:08:34 juju-e4d256-prod-github-runner-207 kernel: [71088.614163] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:08:34 juju-e4d256-prod-github-runner-207 kernel: [71088.614866] ? do_syscall_64+0x69/0xc0 Aug 23 01:08:34 juju-e4d256-prod-github-runner-207 kernel: [71088.615490] ? do_syscall_64+0x69/0xc0 Aug 23 01:08:34 juju-e4d256-prod-github-runner-207 kernel: [71088.616110] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 01:08:34 juju-e4d256-prod-github-runner-207 kernel: [71088.616818] RIP: 0033:0x7faa5d0edaff Aug 23 01:08:34 juju-e4d256-prod-github-runner-207 kernel: [71088.617472] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 01:08:34 juju-e4d256-prod-github-runner-207 kernel: [71088.619468] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 01:08:34 juju-e4d256-prod-github-runner-207 kernel: [71088.620379] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 01:08:34 juju-e4d256-prod-github-runner-207 kernel: [71088.621267] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 01:08:34 juju-e4d256-prod-github-runner-207 kernel: [71088.622152] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 01:08:34 juju-e4d256-prod-github-runner-207 kernel: [71088.623061] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 01:08:34 juju-e4d256-prod-github-runner-207 kernel: [71088.623950] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 01:08:34 juju-e4d256-prod-github-runner-207 kernel: [71088.624843] Aug 23 01:08:48 juju-e4d256-prod-github-runner-207 kernel: [71101.928705] rcu: INFO: rcu_sched self-detected stall on CPU Aug 23 01:08:48 juju-e4d256-prod-github-runner-207 kernel: [71101.929662] rcu: 1-....: (17690288 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=8544323 Aug 23 01:08:48 juju-e4d256-prod-github-runner-207 kernel: [71101.930798] (t=17746182 jiffies g=23269 q=61008) Aug 23 01:08:48 juju-e4d256-prod-github-runner-207 kernel: [71101.931589] NMI backtrace for cpu 1 Aug 23 01:08:48 juju-e4d256-prod-github-runner-207 kernel: [71101.932326] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 01:08:48 juju-e4d256-prod-github-runner-207 kernel: [71101.933435] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 01:08:48 juju-e4d256-prod-github-runner-207 kernel: [71101.934504] Call Trace: Aug 23 01:08:48 juju-e4d256-prod-github-runner-207 kernel: [71101.935198] Aug 23 01:08:48 juju-e4d256-prod-github-runner-207 kernel: [71101.935846] show_stack+0x52/0x5c Aug 23 01:08:48 juju-e4d256-prod-github-runner-207 kernel: [71101.936572] dump_stack_lvl+0x4a/0x63 Aug 23 01:08:48 juju-e4d256-prod-github-runner-207 kernel: [71101.937318] dump_stack+0x10/0x16 Aug 23 01:08:48 juju-e4d256-prod-github-runner-207 kernel: [71101.938036] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 23 01:08:48 juju-e4d256-prod-github-runner-207 kernel: [71101.938996] ? lapic_can_unplug_cpu+0x90/0x90 Aug 23 01:08:48 juju-e4d256-prod-github-runner-207 kernel: [71101.939775] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 23 01:08:48 juju-e4d256-prod-github-runner-207 kernel: [71101.940597] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 23 01:08:48 juju-e4d256-prod-github-runner-207 kernel: [71101.941418] trigger_single_cpu_backtrace+0x44/0x4f Aug 23 01:08:48 juju-e4d256-prod-github-runner-207 kernel: [71101.942225] rcu_dump_cpu_stacks+0x102/0x149 Aug 23 01:08:48 juju-e4d256-prod-github-runner-207 kernel: [71101.943005] print_cpu_stall.cold+0x2f/0xe2 Aug 23 01:08:48 juju-e4d256-prod-github-runner-207 kernel: [71101.943779] ? timekeeping_update+0xf7/0x150 Aug 23 01:08:48 juju-e4d256-prod-github-runner-207 kernel: [71101.944550] check_cpu_stall+0x109/0x270 Aug 23 01:08:48 juju-e4d256-prod-github-runner-207 kernel: [71101.945297] rcu_sched_clock_irq+0x9a/0x250 Aug 23 01:08:48 juju-e4d256-prod-github-runner-207 kernel: [71101.946055] update_process_times+0x94/0xd0 Aug 23 01:08:48 juju-e4d256-prod-github-runner-207 kernel: [71101.946829] tick_sched_handle+0x29/0x70 Aug 23 01:08:48 juju-e4d256-prod-github-runner-207 kernel: [71101.947578] tick_sched_timer+0x8c/0xc0 Aug 23 01:08:48 juju-e4d256-prod-github-runner-207 kernel: [71101.948316] ? tick_nohz_handler+0xb0/0xb0 Aug 23 01:08:48 juju-e4d256-prod-github-runner-207 kernel: [71101.949069] __hrtimer_run_queues+0x107/0x230 Aug 23 01:08:48 juju-e4d256-prod-github-runner-207 kernel: [71101.949841] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 01:08:48 juju-e4d256-prod-github-runner-207 kernel: [71101.950615] hrtimer_interrupt+0x101/0x220 Aug 23 01:08:48 juju-e4d256-prod-github-runner-207 kernel: [71101.951389] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 01:08:48 juju-e4d256-prod-github-runner-207 kernel: [71101.952197] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 01:08:48 juju-e4d256-prod-github-runner-207 kernel: [71101.952995] Aug 23 01:08:48 juju-e4d256-prod-github-runner-207 kernel: [71101.953629] Aug 23 01:08:48 juju-e4d256-prod-github-runner-207 kernel: [71101.954256] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 01:08:48 juju-e4d256-prod-github-runner-207 kernel: [71101.955085] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:08:48 juju-e4d256-prod-github-runner-207 kernel: [71101.955964] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 01:08:48 juju-e4d256-prod-github-runner-207 kernel: [71101.958167] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 01:08:48 juju-e4d256-prod-github-runner-207 kernel: [71101.959050] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 01:08:48 juju-e4d256-prod-github-runner-207 kernel: [71101.960046] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 01:08:48 juju-e4d256-prod-github-runner-207 kernel: [71101.961019] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 01:08:48 juju-e4d256-prod-github-runner-207 kernel: [71101.961980] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 01:08:48 juju-e4d256-prod-github-runner-207 kernel: [71101.962939] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 01:08:48 juju-e4d256-prod-github-runner-207 kernel: [71101.963888] ? _raw_spin_lock+0x22/0x30 Aug 23 01:08:48 juju-e4d256-prod-github-runner-207 kernel: [71101.964643] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:08:48 juju-e4d256-prod-github-runner-207 kernel: [71101.965478] direct_page_fault+0x206/0x310 [kvm] Aug 23 01:08:48 juju-e4d256-prod-github-runner-207 kernel: [71101.966316] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 01:08:48 juju-e4d256-prod-github-runner-207 kernel: [71101.967157] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 01:08:48 juju-e4d256-prod-github-runner-207 kernel: [71101.967983] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 01:08:48 juju-e4d256-prod-github-runner-207 kernel: [71101.968784] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 01:08:48 juju-e4d256-prod-github-runner-207 kernel: [71101.969566] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 01:08:48 juju-e4d256-prod-github-runner-207 kernel: [71101.970387] handle_exit+0x98/0x230 [kvm_amd] Aug 23 01:08:48 juju-e4d256-prod-github-runner-207 kernel: [71101.971150] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 01:08:48 juju-e4d256-prod-github-runner-207 kernel: [71101.971931] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 01:08:48 juju-e4d256-prod-github-runner-207 kernel: [71101.972732] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 01:08:48 juju-e4d256-prod-github-runner-207 kernel: [71101.973515] vcpu_run+0x62/0x2c0 [kvm] Aug 23 01:08:48 juju-e4d256-prod-github-runner-207 kernel: [71101.974355] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 01:08:48 juju-e4d256-prod-github-runner-207 kernel: [71101.975092] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 01:08:48 juju-e4d256-prod-github-runner-207 kernel: [71101.975892] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 01:08:48 juju-e4d256-prod-github-runner-207 kernel: [71101.976660] ? __seccomp_filter+0x4a/0x4a0 Aug 23 01:08:48 juju-e4d256-prod-github-runner-207 kernel: [71101.977380] ? __fget_files+0x86/0xc0 Aug 23 01:08:48 juju-e4d256-prod-github-runner-207 kernel: [71101.978070] __x64_sys_ioctl+0x95/0xd0 Aug 23 01:08:48 juju-e4d256-prod-github-runner-207 kernel: [71101.978774] do_syscall_64+0x5c/0xc0 Aug 23 01:08:48 juju-e4d256-prod-github-runner-207 kernel: [71101.979456] ? do_futex+0x162/0x1f0 Aug 23 01:08:48 juju-e4d256-prod-github-runner-207 kernel: [71101.980124] ? __x64_sys_futex+0x78/0x1e0 Aug 23 01:08:48 juju-e4d256-prod-github-runner-207 kernel: [71101.980860] ? __secure_computing+0xa9/0x120 Aug 23 01:08:48 juju-e4d256-prod-github-runner-207 kernel: [71101.981584] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 01:08:48 juju-e4d256-prod-github-runner-207 kernel: [71101.982370] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:08:48 juju-e4d256-prod-github-runner-207 kernel: [71101.983132] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:08:48 juju-e4d256-prod-github-runner-207 kernel: [71101.983882] ? do_syscall_64+0x69/0xc0 Aug 23 01:08:48 juju-e4d256-prod-github-runner-207 kernel: [71101.984568] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:08:48 juju-e4d256-prod-github-runner-207 kernel: [71101.985321] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:08:48 juju-e4d256-prod-github-runner-207 kernel: [71101.986075] ? do_syscall_64+0x69/0xc0 Aug 23 01:08:48 juju-e4d256-prod-github-runner-207 kernel: [71101.986779] ? do_syscall_64+0x69/0xc0 Aug 23 01:08:48 juju-e4d256-prod-github-runner-207 kernel: [71101.987465] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 01:08:48 juju-e4d256-prod-github-runner-207 kernel: [71101.988236] RIP: 0033:0x7faa5d0edaff Aug 23 01:08:48 juju-e4d256-prod-github-runner-207 kernel: [71101.988921] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 01:08:48 juju-e4d256-prod-github-runner-207 kernel: [71101.991026] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 01:08:48 juju-e4d256-prod-github-runner-207 kernel: [71101.991992] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 01:08:48 juju-e4d256-prod-github-runner-207 kernel: [71101.992937] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 01:08:48 juju-e4d256-prod-github-runner-207 kernel: [71101.993936] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 01:08:48 juju-e4d256-prod-github-runner-207 kernel: [71101.994885] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 01:08:48 juju-e4d256-prod-github-runner-207 kernel: [71101.995943] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 01:08:48 juju-e4d256-prod-github-runner-207 kernel: [71101.996862] Aug 23 01:09:14 juju-e4d256-prod-github-runner-207 kernel: [71128.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 66135s! [qemu-system-x86:6715] Aug 23 01:09:14 juju-e4d256-prod-github-runner-207 kernel: [71128.543139] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 01:09:14 juju-e4d256-prod-github-runner-207 kernel: [71128.543207] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 01:09:14 juju-e4d256-prod-github-runner-207 kernel: [71128.555332] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 01:09:14 juju-e4d256-prod-github-runner-207 kernel: [71128.556604] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 01:09:14 juju-e4d256-prod-github-runner-207 kernel: [71128.557822] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:09:14 juju-e4d256-prod-github-runner-207 kernel: [71128.558903] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 01:09:14 juju-e4d256-prod-github-runner-207 kernel: [71128.561504] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 01:09:14 juju-e4d256-prod-github-runner-207 kernel: [71128.562582] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 01:09:14 juju-e4d256-prod-github-runner-207 kernel: [71128.563743] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 01:09:14 juju-e4d256-prod-github-runner-207 kernel: [71128.564901] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 01:09:14 juju-e4d256-prod-github-runner-207 kernel: [71128.566064] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 01:09:14 juju-e4d256-prod-github-runner-207 kernel: [71128.567252] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 01:09:14 juju-e4d256-prod-github-runner-207 kernel: [71128.568426] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 01:09:14 juju-e4d256-prod-github-runner-207 kernel: [71128.569659] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 01:09:14 juju-e4d256-prod-github-runner-207 kernel: [71128.570778] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 01:09:14 juju-e4d256-prod-github-runner-207 kernel: [71128.571998] Call Trace: Aug 23 01:09:14 juju-e4d256-prod-github-runner-207 kernel: [71128.572914] Aug 23 01:09:14 juju-e4d256-prod-github-runner-207 kernel: [71128.573799] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:09:14 juju-e4d256-prod-github-runner-207 kernel: [71128.574877] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:09:14 juju-e4d256-prod-github-runner-207 kernel: [71128.575911] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:09:14 juju-e4d256-prod-github-runner-207 kernel: [71128.576989] ? show_regs.part.0+0x23/0x29 Aug 23 01:09:14 juju-e4d256-prod-github-runner-207 kernel: [71128.577985] ? show_regs.cold+0x8/0xd Aug 23 01:09:14 juju-e4d256-prod-github-runner-207 kernel: [71128.578965] ? watchdog_timer_fn+0x1be/0x220 Aug 23 01:09:14 juju-e4d256-prod-github-runner-207 kernel: [71128.579976] ? lockup_detector_update_enable+0x60/0x60 Aug 23 01:09:14 juju-e4d256-prod-github-runner-207 kernel: [71128.581050] ? __hrtimer_run_queues+0x107/0x230 Aug 23 01:09:14 juju-e4d256-prod-github-runner-207 kernel: [71128.582109] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 01:09:14 juju-e4d256-prod-github-runner-207 kernel: [71128.583152] ? hrtimer_interrupt+0x101/0x220 Aug 23 01:09:14 juju-e4d256-prod-github-runner-207 kernel: [71128.584168] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 01:09:14 juju-e4d256-prod-github-runner-207 kernel: [71128.585237] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 01:09:14 juju-e4d256-prod-github-runner-207 kernel: [71128.586282] Aug 23 01:09:14 juju-e4d256-prod-github-runner-207 kernel: [71128.587143] Aug 23 01:09:14 juju-e4d256-prod-github-runner-207 kernel: [71128.588003] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 01:09:14 juju-e4d256-prod-github-runner-207 kernel: [71128.589056] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:09:14 juju-e4d256-prod-github-runner-207 kernel: [71128.590092] ? _raw_spin_lock+0x22/0x30 Aug 23 01:09:14 juju-e4d256-prod-github-runner-207 kernel: [71128.591058] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:09:14 juju-e4d256-prod-github-runner-207 kernel: [71128.592114] direct_page_fault+0x206/0x310 [kvm] Aug 23 01:09:14 juju-e4d256-prod-github-runner-207 kernel: [71128.593156] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 01:09:14 juju-e4d256-prod-github-runner-207 kernel: [71128.594171] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 01:09:14 juju-e4d256-prod-github-runner-207 kernel: [71128.595291] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 01:09:14 juju-e4d256-prod-github-runner-207 kernel: [71128.596261] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 01:09:14 juju-e4d256-prod-github-runner-207 kernel: [71128.597217] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 01:09:14 juju-e4d256-prod-github-runner-207 kernel: [71128.598229] handle_exit+0x98/0x230 [kvm_amd] Aug 23 01:09:14 juju-e4d256-prod-github-runner-207 kernel: [71128.599144] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 01:09:14 juju-e4d256-prod-github-runner-207 kernel: [71128.600056] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 01:09:14 juju-e4d256-prod-github-runner-207 kernel: [71128.600978] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 01:09:14 juju-e4d256-prod-github-runner-207 kernel: [71128.601881] vcpu_run+0x62/0x2c0 [kvm] Aug 23 01:09:14 juju-e4d256-prod-github-runner-207 kernel: [71128.602734] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 01:09:14 juju-e4d256-prod-github-runner-207 kernel: [71128.603550] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 01:09:14 juju-e4d256-prod-github-runner-207 kernel: [71128.604403] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 01:09:14 juju-e4d256-prod-github-runner-207 kernel: [71128.605204] ? __seccomp_filter+0x4a/0x4a0 Aug 23 01:09:14 juju-e4d256-prod-github-runner-207 kernel: [71128.605951] ? __fget_files+0x86/0xc0 Aug 23 01:09:14 juju-e4d256-prod-github-runner-207 kernel: [71128.606660] __x64_sys_ioctl+0x95/0xd0 Aug 23 01:09:14 juju-e4d256-prod-github-runner-207 kernel: [71128.607352] do_syscall_64+0x5c/0xc0 Aug 23 01:09:14 juju-e4d256-prod-github-runner-207 kernel: [71128.608021] ? do_futex+0x162/0x1f0 Aug 23 01:09:14 juju-e4d256-prod-github-runner-207 kernel: [71128.608688] ? __x64_sys_futex+0x78/0x1e0 Aug 23 01:09:14 juju-e4d256-prod-github-runner-207 kernel: [71128.609371] ? __secure_computing+0xa9/0x120 Aug 23 01:09:14 juju-e4d256-prod-github-runner-207 kernel: [71128.610060] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 01:09:14 juju-e4d256-prod-github-runner-207 kernel: [71128.610837] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:09:14 juju-e4d256-prod-github-runner-207 kernel: [71128.611556] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:09:14 juju-e4d256-prod-github-runner-207 kernel: [71128.612276] ? do_syscall_64+0x69/0xc0 Aug 23 01:09:14 juju-e4d256-prod-github-runner-207 kernel: [71128.612946] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:09:14 juju-e4d256-prod-github-runner-207 kernel: [71128.613657] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:09:14 juju-e4d256-prod-github-runner-207 kernel: [71128.614351] ? do_syscall_64+0x69/0xc0 Aug 23 01:09:14 juju-e4d256-prod-github-runner-207 kernel: [71128.614991] ? do_syscall_64+0x69/0xc0 Aug 23 01:09:14 juju-e4d256-prod-github-runner-207 kernel: [71128.615619] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 01:09:14 juju-e4d256-prod-github-runner-207 kernel: [71128.616342] RIP: 0033:0x7faa5d0edaff Aug 23 01:09:14 juju-e4d256-prod-github-runner-207 kernel: [71128.616971] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 01:09:14 juju-e4d256-prod-github-runner-207 kernel: [71128.618968] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 01:09:14 juju-e4d256-prod-github-runner-207 kernel: [71128.619883] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 01:09:14 juju-e4d256-prod-github-runner-207 kernel: [71128.620769] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 01:09:14 juju-e4d256-prod-github-runner-207 kernel: [71128.621658] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 01:09:14 juju-e4d256-prod-github-runner-207 kernel: [71128.622582] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 01:09:14 juju-e4d256-prod-github-runner-207 kernel: [71128.623513] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 01:09:14 juju-e4d256-prod-github-runner-207 kernel: [71128.624414] Aug 23 01:09:42 juju-e4d256-prod-github-runner-207 kernel: [71156.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 66161s! [qemu-system-x86:6715] Aug 23 01:09:42 juju-e4d256-prod-github-runner-207 kernel: [71156.543753] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 01:09:42 juju-e4d256-prod-github-runner-207 kernel: [71156.544003] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 01:09:42 juju-e4d256-prod-github-runner-207 kernel: [71156.556127] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 01:09:42 juju-e4d256-prod-github-runner-207 kernel: [71156.557403] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 01:09:42 juju-e4d256-prod-github-runner-207 kernel: [71156.558658] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:09:42 juju-e4d256-prod-github-runner-207 kernel: [71156.559726] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 01:09:42 juju-e4d256-prod-github-runner-207 kernel: [71156.562297] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 01:09:42 juju-e4d256-prod-github-runner-207 kernel: [71156.563344] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 01:09:42 juju-e4d256-prod-github-runner-207 kernel: [71156.564519] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 01:09:42 juju-e4d256-prod-github-runner-207 kernel: [71156.565742] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 01:09:42 juju-e4d256-prod-github-runner-207 kernel: [71156.566949] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 01:09:42 juju-e4d256-prod-github-runner-207 kernel: [71156.568117] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 01:09:42 juju-e4d256-prod-github-runner-207 kernel: [71156.569380] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 01:09:42 juju-e4d256-prod-github-runner-207 kernel: [71156.570660] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 01:09:42 juju-e4d256-prod-github-runner-207 kernel: [71156.571812] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 01:09:42 juju-e4d256-prod-github-runner-207 kernel: [71156.573008] Call Trace: Aug 23 01:09:42 juju-e4d256-prod-github-runner-207 kernel: [71156.573926] Aug 23 01:09:42 juju-e4d256-prod-github-runner-207 kernel: [71156.574858] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:09:42 juju-e4d256-prod-github-runner-207 kernel: [71156.575888] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:09:42 juju-e4d256-prod-github-runner-207 kernel: [71156.576915] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:09:42 juju-e4d256-prod-github-runner-207 kernel: [71156.578012] ? show_regs.part.0+0x23/0x29 Aug 23 01:09:42 juju-e4d256-prod-github-runner-207 kernel: [71156.579031] ? show_regs.cold+0x8/0xd Aug 23 01:09:42 juju-e4d256-prod-github-runner-207 kernel: [71156.580004] ? watchdog_timer_fn+0x1be/0x220 Aug 23 01:09:42 juju-e4d256-prod-github-runner-207 kernel: [71156.581016] ? lockup_detector_update_enable+0x60/0x60 Aug 23 01:09:42 juju-e4d256-prod-github-runner-207 kernel: [71156.582092] ? __hrtimer_run_queues+0x107/0x230 Aug 23 01:09:42 juju-e4d256-prod-github-runner-207 kernel: [71156.583123] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 01:09:42 juju-e4d256-prod-github-runner-207 kernel: [71156.584154] ? hrtimer_interrupt+0x101/0x220 Aug 23 01:09:42 juju-e4d256-prod-github-runner-207 kernel: [71156.585173] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 01:09:42 juju-e4d256-prod-github-runner-207 kernel: [71156.586255] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 01:09:42 juju-e4d256-prod-github-runner-207 kernel: [71156.587301] Aug 23 01:09:42 juju-e4d256-prod-github-runner-207 kernel: [71156.588154] Aug 23 01:09:42 juju-e4d256-prod-github-runner-207 kernel: [71156.588991] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 01:09:42 juju-e4d256-prod-github-runner-207 kernel: [71156.590058] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:09:42 juju-e4d256-prod-github-runner-207 kernel: [71156.591100] ? _raw_spin_lock+0x22/0x30 Aug 23 01:09:42 juju-e4d256-prod-github-runner-207 kernel: [71156.592046] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:09:42 juju-e4d256-prod-github-runner-207 kernel: [71156.593072] direct_page_fault+0x206/0x310 [kvm] Aug 23 01:09:42 juju-e4d256-prod-github-runner-207 kernel: [71156.594125] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 01:09:42 juju-e4d256-prod-github-runner-207 kernel: [71156.595138] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 01:09:42 juju-e4d256-prod-github-runner-207 kernel: [71156.596148] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 01:09:42 juju-e4d256-prod-github-runner-207 kernel: [71156.597256] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 01:09:42 juju-e4d256-prod-github-runner-207 kernel: [71156.598232] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 01:09:42 juju-e4d256-prod-github-runner-207 kernel: [71156.599215] handle_exit+0x98/0x230 [kvm_amd] Aug 23 01:09:42 juju-e4d256-prod-github-runner-207 kernel: [71156.600215] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 01:09:42 juju-e4d256-prod-github-runner-207 kernel: [71156.601143] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 01:09:42 juju-e4d256-prod-github-runner-207 kernel: [71156.602095] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 01:09:42 juju-e4d256-prod-github-runner-207 kernel: [71156.603005] vcpu_run+0x62/0x2c0 [kvm] Aug 23 01:09:42 juju-e4d256-prod-github-runner-207 kernel: [71156.603832] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 01:09:42 juju-e4d256-prod-github-runner-207 kernel: [71156.604644] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 01:09:42 juju-e4d256-prod-github-runner-207 kernel: [71156.605517] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 01:09:42 juju-e4d256-prod-github-runner-207 kernel: [71156.606341] ? __seccomp_filter+0x4a/0x4a0 Aug 23 01:09:42 juju-e4d256-prod-github-runner-207 kernel: [71156.607083] ? __fget_files+0x86/0xc0 Aug 23 01:09:42 juju-e4d256-prod-github-runner-207 kernel: [71156.607786] __x64_sys_ioctl+0x95/0xd0 Aug 23 01:09:42 juju-e4d256-prod-github-runner-207 kernel: [71156.608477] do_syscall_64+0x5c/0xc0 Aug 23 01:09:42 juju-e4d256-prod-github-runner-207 kernel: [71156.609146] ? do_futex+0x162/0x1f0 Aug 23 01:09:42 juju-e4d256-prod-github-runner-207 kernel: [71156.609807] ? __x64_sys_futex+0x78/0x1e0 Aug 23 01:09:42 juju-e4d256-prod-github-runner-207 kernel: [71156.610487] ? __secure_computing+0xa9/0x120 Aug 23 01:09:42 juju-e4d256-prod-github-runner-207 kernel: [71156.611174] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 01:09:42 juju-e4d256-prod-github-runner-207 kernel: [71156.611932] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:09:42 juju-e4d256-prod-github-runner-207 kernel: [71156.612652] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:09:42 juju-e4d256-prod-github-runner-207 kernel: [71156.613367] ? do_syscall_64+0x69/0xc0 Aug 23 01:09:42 juju-e4d256-prod-github-runner-207 kernel: [71156.614009] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:09:42 juju-e4d256-prod-github-runner-207 kernel: [71156.614722] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:09:42 juju-e4d256-prod-github-runner-207 kernel: [71156.615418] ? do_syscall_64+0x69/0xc0 Aug 23 01:09:42 juju-e4d256-prod-github-runner-207 kernel: [71156.616041] ? do_syscall_64+0x69/0xc0 Aug 23 01:09:42 juju-e4d256-prod-github-runner-207 kernel: [71156.616660] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 01:09:42 juju-e4d256-prod-github-runner-207 kernel: [71156.617388] RIP: 0033:0x7faa5d0edaff Aug 23 01:09:42 juju-e4d256-prod-github-runner-207 kernel: [71156.618056] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 01:09:42 juju-e4d256-prod-github-runner-207 kernel: [71156.620035] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 01:09:42 juju-e4d256-prod-github-runner-207 kernel: [71156.620944] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 01:09:42 juju-e4d256-prod-github-runner-207 kernel: [71156.621828] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 01:09:42 juju-e4d256-prod-github-runner-207 kernel: [71156.622723] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 01:09:42 juju-e4d256-prod-github-runner-207 kernel: [71156.623606] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 01:09:42 juju-e4d256-prod-github-runner-207 kernel: [71156.624495] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 01:09:42 juju-e4d256-prod-github-runner-207 kernel: [71156.625536] Aug 23 01:10:10 juju-e4d256-prod-github-runner-207 kernel: [71184.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 66187s! [qemu-system-x86:6715] Aug 23 01:10:10 juju-e4d256-prod-github-runner-207 kernel: [71184.543106] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 01:10:10 juju-e4d256-prod-github-runner-207 kernel: [71184.543173] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 01:10:10 juju-e4d256-prod-github-runner-207 kernel: [71184.555227] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 01:10:10 juju-e4d256-prod-github-runner-207 kernel: [71184.556590] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 01:10:10 juju-e4d256-prod-github-runner-207 kernel: [71184.557824] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:10:10 juju-e4d256-prod-github-runner-207 kernel: [71184.558882] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 01:10:10 juju-e4d256-prod-github-runner-207 kernel: [71184.561436] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 01:10:10 juju-e4d256-prod-github-runner-207 kernel: [71184.562488] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 01:10:10 juju-e4d256-prod-github-runner-207 kernel: [71184.563653] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 01:10:10 juju-e4d256-prod-github-runner-207 kernel: [71184.564812] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 01:10:10 juju-e4d256-prod-github-runner-207 kernel: [71184.565981] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 01:10:10 juju-e4d256-prod-github-runner-207 kernel: [71184.567149] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 01:10:10 juju-e4d256-prod-github-runner-207 kernel: [71184.568319] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 01:10:10 juju-e4d256-prod-github-runner-207 kernel: [71184.569556] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 01:10:10 juju-e4d256-prod-github-runner-207 kernel: [71184.570669] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 01:10:10 juju-e4d256-prod-github-runner-207 kernel: [71184.571866] Call Trace: Aug 23 01:10:10 juju-e4d256-prod-github-runner-207 kernel: [71184.572778] Aug 23 01:10:10 juju-e4d256-prod-github-runner-207 kernel: [71184.573667] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:10:10 juju-e4d256-prod-github-runner-207 kernel: [71184.574704] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:10:10 juju-e4d256-prod-github-runner-207 kernel: [71184.575726] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:10:10 juju-e4d256-prod-github-runner-207 kernel: [71184.576802] ? show_regs.part.0+0x23/0x29 Aug 23 01:10:10 juju-e4d256-prod-github-runner-207 kernel: [71184.577814] ? show_regs.cold+0x8/0xd Aug 23 01:10:10 juju-e4d256-prod-github-runner-207 kernel: [71184.578824] ? watchdog_timer_fn+0x1be/0x220 Aug 23 01:10:10 juju-e4d256-prod-github-runner-207 kernel: [71184.580029] ? lockup_detector_update_enable+0x60/0x60 Aug 23 01:10:10 juju-e4d256-prod-github-runner-207 kernel: [71184.581097] ? __hrtimer_run_queues+0x107/0x230 Aug 23 01:10:10 juju-e4d256-prod-github-runner-207 kernel: [71184.582134] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 01:10:10 juju-e4d256-prod-github-runner-207 kernel: [71184.583162] ? hrtimer_interrupt+0x101/0x220 Aug 23 01:10:10 juju-e4d256-prod-github-runner-207 kernel: [71184.584181] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 01:10:10 juju-e4d256-prod-github-runner-207 kernel: [71184.585248] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 01:10:10 juju-e4d256-prod-github-runner-207 kernel: [71184.586303] Aug 23 01:10:10 juju-e4d256-prod-github-runner-207 kernel: [71184.587156] Aug 23 01:10:10 juju-e4d256-prod-github-runner-207 kernel: [71184.587992] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 01:10:10 juju-e4d256-prod-github-runner-207 kernel: [71184.589021] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:10:10 juju-e4d256-prod-github-runner-207 kernel: [71184.590073] ? _raw_spin_lock+0x22/0x30 Aug 23 01:10:10 juju-e4d256-prod-github-runner-207 kernel: [71184.591019] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:10:10 juju-e4d256-prod-github-runner-207 kernel: [71184.592041] direct_page_fault+0x206/0x310 [kvm] Aug 23 01:10:10 juju-e4d256-prod-github-runner-207 kernel: [71184.593071] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 01:10:10 juju-e4d256-prod-github-runner-207 kernel: [71184.594086] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 01:10:10 juju-e4d256-prod-github-runner-207 kernel: [71184.595086] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 01:10:10 juju-e4d256-prod-github-runner-207 kernel: [71184.596060] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 01:10:10 juju-e4d256-prod-github-runner-207 kernel: [71184.597003] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 01:10:10 juju-e4d256-prod-github-runner-207 kernel: [71184.597989] handle_exit+0x98/0x230 [kvm_amd] Aug 23 01:10:10 juju-e4d256-prod-github-runner-207 kernel: [71184.598888] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 01:10:10 juju-e4d256-prod-github-runner-207 kernel: [71184.599804] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 01:10:10 juju-e4d256-prod-github-runner-207 kernel: [71184.600725] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 01:10:10 juju-e4d256-prod-github-runner-207 kernel: [71184.601628] vcpu_run+0x62/0x2c0 [kvm] Aug 23 01:10:10 juju-e4d256-prod-github-runner-207 kernel: [71184.602462] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 01:10:10 juju-e4d256-prod-github-runner-207 kernel: [71184.603269] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 01:10:10 juju-e4d256-prod-github-runner-207 kernel: [71184.604124] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 01:10:10 juju-e4d256-prod-github-runner-207 kernel: [71184.604919] ? __seccomp_filter+0x4a/0x4a0 Aug 23 01:10:10 juju-e4d256-prod-github-runner-207 kernel: [71184.605666] ? __fget_files+0x86/0xc0 Aug 23 01:10:10 juju-e4d256-prod-github-runner-207 kernel: [71184.606378] __x64_sys_ioctl+0x95/0xd0 Aug 23 01:10:10 juju-e4d256-prod-github-runner-207 kernel: [71184.607069] do_syscall_64+0x5c/0xc0 Aug 23 01:10:10 juju-e4d256-prod-github-runner-207 kernel: [71184.607735] ? do_futex+0x162/0x1f0 Aug 23 01:10:10 juju-e4d256-prod-github-runner-207 kernel: [71184.608386] ? __x64_sys_futex+0x78/0x1e0 Aug 23 01:10:10 juju-e4d256-prod-github-runner-207 kernel: [71184.609059] ? __secure_computing+0xa9/0x120 Aug 23 01:10:10 juju-e4d256-prod-github-runner-207 kernel: [71184.609757] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 01:10:10 juju-e4d256-prod-github-runner-207 kernel: [71184.610515] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:10:10 juju-e4d256-prod-github-runner-207 kernel: [71184.611240] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:10:10 juju-e4d256-prod-github-runner-207 kernel: [71184.611956] ? do_syscall_64+0x69/0xc0 Aug 23 01:10:10 juju-e4d256-prod-github-runner-207 kernel: [71184.612601] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:10:10 juju-e4d256-prod-github-runner-207 kernel: [71184.613303] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:10:10 juju-e4d256-prod-github-runner-207 kernel: [71184.614005] ? do_syscall_64+0x69/0xc0 Aug 23 01:10:10 juju-e4d256-prod-github-runner-207 kernel: [71184.614635] ? do_syscall_64+0x69/0xc0 Aug 23 01:10:10 juju-e4d256-prod-github-runner-207 kernel: [71184.615256] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 01:10:10 juju-e4d256-prod-github-runner-207 kernel: [71184.615958] RIP: 0033:0x7faa5d0edaff Aug 23 01:10:10 juju-e4d256-prod-github-runner-207 kernel: [71184.616588] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 01:10:10 juju-e4d256-prod-github-runner-207 kernel: [71184.618580] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 01:10:10 juju-e4d256-prod-github-runner-207 kernel: [71184.619489] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 01:10:10 juju-e4d256-prod-github-runner-207 kernel: [71184.620374] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 01:10:10 juju-e4d256-prod-github-runner-207 kernel: [71184.621265] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 01:10:10 juju-e4d256-prod-github-runner-207 kernel: [71184.622165] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 01:10:10 juju-e4d256-prod-github-runner-207 kernel: [71184.623053] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 01:10:10 juju-e4d256-prod-github-runner-207 kernel: [71184.623941] Aug 23 01:10:38 juju-e4d256-prod-github-runner-207 kernel: [71212.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 66213s! [qemu-system-x86:6715] Aug 23 01:10:38 juju-e4d256-prod-github-runner-207 kernel: [71212.543093] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 01:10:38 juju-e4d256-prod-github-runner-207 kernel: [71212.543161] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 01:10:38 juju-e4d256-prod-github-runner-207 kernel: [71212.555250] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 01:10:38 juju-e4d256-prod-github-runner-207 kernel: [71212.556517] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 01:10:38 juju-e4d256-prod-github-runner-207 kernel: [71212.557764] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:10:38 juju-e4d256-prod-github-runner-207 kernel: [71212.558821] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 01:10:38 juju-e4d256-prod-github-runner-207 kernel: [71212.561387] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 01:10:38 juju-e4d256-prod-github-runner-207 kernel: [71212.562429] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 01:10:38 juju-e4d256-prod-github-runner-207 kernel: [71212.563592] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 01:10:38 juju-e4d256-prod-github-runner-207 kernel: [71212.564750] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 01:10:38 juju-e4d256-prod-github-runner-207 kernel: [71212.565922] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 01:10:38 juju-e4d256-prod-github-runner-207 kernel: [71212.567120] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 01:10:38 juju-e4d256-prod-github-runner-207 kernel: [71212.568283] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 01:10:38 juju-e4d256-prod-github-runner-207 kernel: [71212.569529] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 01:10:38 juju-e4d256-prod-github-runner-207 kernel: [71212.570628] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 01:10:38 juju-e4d256-prod-github-runner-207 kernel: [71212.571819] Call Trace: Aug 23 01:10:38 juju-e4d256-prod-github-runner-207 kernel: [71212.572733] Aug 23 01:10:38 juju-e4d256-prod-github-runner-207 kernel: [71212.573634] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:10:38 juju-e4d256-prod-github-runner-207 kernel: [71212.574662] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:10:38 juju-e4d256-prod-github-runner-207 kernel: [71212.575681] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:10:38 juju-e4d256-prod-github-runner-207 kernel: [71212.576755] ? show_regs.part.0+0x23/0x29 Aug 23 01:10:38 juju-e4d256-prod-github-runner-207 kernel: [71212.577768] ? show_regs.cold+0x8/0xd Aug 23 01:10:38 juju-e4d256-prod-github-runner-207 kernel: [71212.578744] ? watchdog_timer_fn+0x1be/0x220 Aug 23 01:10:38 juju-e4d256-prod-github-runner-207 kernel: [71212.579805] ? lockup_detector_update_enable+0x60/0x60 Aug 23 01:10:38 juju-e4d256-prod-github-runner-207 kernel: [71212.580923] ? __hrtimer_run_queues+0x107/0x230 Aug 23 01:10:38 juju-e4d256-prod-github-runner-207 kernel: [71212.581995] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 01:10:38 juju-e4d256-prod-github-runner-207 kernel: [71212.583023] ? hrtimer_interrupt+0x101/0x220 Aug 23 01:10:38 juju-e4d256-prod-github-runner-207 kernel: [71212.584044] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 01:10:38 juju-e4d256-prod-github-runner-207 kernel: [71212.585117] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 01:10:38 juju-e4d256-prod-github-runner-207 kernel: [71212.586182] Aug 23 01:10:38 juju-e4d256-prod-github-runner-207 kernel: [71212.587035] Aug 23 01:10:38 juju-e4d256-prod-github-runner-207 kernel: [71212.587885] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 01:10:38 juju-e4d256-prod-github-runner-207 kernel: [71212.588931] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:10:38 juju-e4d256-prod-github-runner-207 kernel: [71212.589982] ? _raw_spin_lock+0x22/0x30 Aug 23 01:10:38 juju-e4d256-prod-github-runner-207 kernel: [71212.590929] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:10:38 juju-e4d256-prod-github-runner-207 kernel: [71212.591946] direct_page_fault+0x206/0x310 [kvm] Aug 23 01:10:38 juju-e4d256-prod-github-runner-207 kernel: [71212.592974] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 01:10:38 juju-e4d256-prod-github-runner-207 kernel: [71212.593992] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 01:10:38 juju-e4d256-prod-github-runner-207 kernel: [71212.594991] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 01:10:38 juju-e4d256-prod-github-runner-207 kernel: [71212.595966] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 01:10:38 juju-e4d256-prod-github-runner-207 kernel: [71212.596911] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 01:10:38 juju-e4d256-prod-github-runner-207 kernel: [71212.597905] handle_exit+0x98/0x230 [kvm_amd] Aug 23 01:10:38 juju-e4d256-prod-github-runner-207 kernel: [71212.598796] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 01:10:38 juju-e4d256-prod-github-runner-207 kernel: [71212.599712] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 01:10:38 juju-e4d256-prod-github-runner-207 kernel: [71212.600633] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 01:10:38 juju-e4d256-prod-github-runner-207 kernel: [71212.601550] vcpu_run+0x62/0x2c0 [kvm] Aug 23 01:10:38 juju-e4d256-prod-github-runner-207 kernel: [71212.602360] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 01:10:38 juju-e4d256-prod-github-runner-207 kernel: [71212.603164] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 01:10:38 juju-e4d256-prod-github-runner-207 kernel: [71212.604017] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 01:10:38 juju-e4d256-prod-github-runner-207 kernel: [71212.604823] ? __seccomp_filter+0x4a/0x4a0 Aug 23 01:10:38 juju-e4d256-prod-github-runner-207 kernel: [71212.605578] ? __fget_files+0x86/0xc0 Aug 23 01:10:38 juju-e4d256-prod-github-runner-207 kernel: [71212.606281] __x64_sys_ioctl+0x95/0xd0 Aug 23 01:10:38 juju-e4d256-prod-github-runner-207 kernel: [71212.606975] do_syscall_64+0x5c/0xc0 Aug 23 01:10:38 juju-e4d256-prod-github-runner-207 kernel: [71212.607641] ? do_futex+0x162/0x1f0 Aug 23 01:10:38 juju-e4d256-prod-github-runner-207 kernel: [71212.608287] ? __x64_sys_futex+0x78/0x1e0 Aug 23 01:10:38 juju-e4d256-prod-github-runner-207 kernel: [71212.608958] ? __secure_computing+0xa9/0x120 Aug 23 01:10:38 juju-e4d256-prod-github-runner-207 kernel: [71212.609654] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 01:10:38 juju-e4d256-prod-github-runner-207 kernel: [71212.610412] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:10:38 juju-e4d256-prod-github-runner-207 kernel: [71212.611133] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:10:38 juju-e4d256-prod-github-runner-207 kernel: [71212.611847] ? do_syscall_64+0x69/0xc0 Aug 23 01:10:38 juju-e4d256-prod-github-runner-207 kernel: [71212.612490] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:10:38 juju-e4d256-prod-github-runner-207 kernel: [71212.613191] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:10:38 juju-e4d256-prod-github-runner-207 kernel: [71212.613895] ? do_syscall_64+0x69/0xc0 Aug 23 01:10:38 juju-e4d256-prod-github-runner-207 kernel: [71212.614517] ? do_syscall_64+0x69/0xc0 Aug 23 01:10:38 juju-e4d256-prod-github-runner-207 kernel: [71212.615136] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 01:10:38 juju-e4d256-prod-github-runner-207 kernel: [71212.615838] RIP: 0033:0x7faa5d0edaff Aug 23 01:10:38 juju-e4d256-prod-github-runner-207 kernel: [71212.616459] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 01:10:38 juju-e4d256-prod-github-runner-207 kernel: [71212.618459] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 01:10:38 juju-e4d256-prod-github-runner-207 kernel: [71212.619364] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 01:10:38 juju-e4d256-prod-github-runner-207 kernel: [71212.620249] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 01:10:38 juju-e4d256-prod-github-runner-207 kernel: [71212.621139] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 01:10:38 juju-e4d256-prod-github-runner-207 kernel: [71212.622037] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 01:10:38 juju-e4d256-prod-github-runner-207 kernel: [71212.622920] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 01:10:38 juju-e4d256-prod-github-runner-207 kernel: [71212.623811] Aug 23 01:11:06 juju-e4d256-prod-github-runner-207 kernel: [71240.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 66239s! [qemu-system-x86:6715] Aug 23 01:11:06 juju-e4d256-prod-github-runner-207 kernel: [71240.543181] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 01:11:06 juju-e4d256-prod-github-runner-207 kernel: [71240.543384] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 01:11:06 juju-e4d256-prod-github-runner-207 kernel: [71240.555453] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 01:11:06 juju-e4d256-prod-github-runner-207 kernel: [71240.556723] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 01:11:06 juju-e4d256-prod-github-runner-207 kernel: [71240.557959] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:11:06 juju-e4d256-prod-github-runner-207 kernel: [71240.559019] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 01:11:06 juju-e4d256-prod-github-runner-207 kernel: [71240.561585] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 01:11:06 juju-e4d256-prod-github-runner-207 kernel: [71240.562628] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 01:11:06 juju-e4d256-prod-github-runner-207 kernel: [71240.563796] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 01:11:06 juju-e4d256-prod-github-runner-207 kernel: [71240.564958] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 01:11:06 juju-e4d256-prod-github-runner-207 kernel: [71240.566138] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 01:11:06 juju-e4d256-prod-github-runner-207 kernel: [71240.567305] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 01:11:06 juju-e4d256-prod-github-runner-207 kernel: [71240.568473] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 01:11:06 juju-e4d256-prod-github-runner-207 kernel: [71240.569731] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 01:11:06 juju-e4d256-prod-github-runner-207 kernel: [71240.570831] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 01:11:06 juju-e4d256-prod-github-runner-207 kernel: [71240.572041] Call Trace: Aug 23 01:11:06 juju-e4d256-prod-github-runner-207 kernel: [71240.572953] Aug 23 01:11:06 juju-e4d256-prod-github-runner-207 kernel: [71240.573852] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:11:06 juju-e4d256-prod-github-runner-207 kernel: [71240.574882] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:11:06 juju-e4d256-prod-github-runner-207 kernel: [71240.575902] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:11:06 juju-e4d256-prod-github-runner-207 kernel: [71240.576994] ? show_regs.part.0+0x23/0x29 Aug 23 01:11:06 juju-e4d256-prod-github-runner-207 kernel: [71240.578002] ? show_regs.cold+0x8/0xd Aug 23 01:11:06 juju-e4d256-prod-github-runner-207 kernel: [71240.578972] ? watchdog_timer_fn+0x1be/0x220 Aug 23 01:11:06 juju-e4d256-prod-github-runner-207 kernel: [71240.579979] ? lockup_detector_update_enable+0x60/0x60 Aug 23 01:11:06 juju-e4d256-prod-github-runner-207 kernel: [71240.581039] ? __hrtimer_run_queues+0x107/0x230 Aug 23 01:11:06 juju-e4d256-prod-github-runner-207 kernel: [71240.582075] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 01:11:06 juju-e4d256-prod-github-runner-207 kernel: [71240.583096] ? hrtimer_interrupt+0x101/0x220 Aug 23 01:11:06 juju-e4d256-prod-github-runner-207 kernel: [71240.584109] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 01:11:06 juju-e4d256-prod-github-runner-207 kernel: [71240.585186] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 01:11:06 juju-e4d256-prod-github-runner-207 kernel: [71240.586230] Aug 23 01:11:06 juju-e4d256-prod-github-runner-207 kernel: [71240.587081] Aug 23 01:11:06 juju-e4d256-prod-github-runner-207 kernel: [71240.587916] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 01:11:06 juju-e4d256-prod-github-runner-207 kernel: [71240.588946] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:11:06 juju-e4d256-prod-github-runner-207 kernel: [71240.589998] ? _raw_spin_lock+0x22/0x30 Aug 23 01:11:06 juju-e4d256-prod-github-runner-207 kernel: [71240.590941] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:11:06 juju-e4d256-prod-github-runner-207 kernel: [71240.591954] direct_page_fault+0x206/0x310 [kvm] Aug 23 01:11:06 juju-e4d256-prod-github-runner-207 kernel: [71240.592974] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 01:11:06 juju-e4d256-prod-github-runner-207 kernel: [71240.593996] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 01:11:06 juju-e4d256-prod-github-runner-207 kernel: [71240.595001] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 01:11:06 juju-e4d256-prod-github-runner-207 kernel: [71240.595983] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 01:11:06 juju-e4d256-prod-github-runner-207 kernel: [71240.596925] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 01:11:06 juju-e4d256-prod-github-runner-207 kernel: [71240.597920] handle_exit+0x98/0x230 [kvm_amd] Aug 23 01:11:06 juju-e4d256-prod-github-runner-207 kernel: [71240.598807] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 01:11:06 juju-e4d256-prod-github-runner-207 kernel: [71240.599718] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 01:11:06 juju-e4d256-prod-github-runner-207 kernel: [71240.600637] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 01:11:06 juju-e4d256-prod-github-runner-207 kernel: [71240.601555] vcpu_run+0x62/0x2c0 [kvm] Aug 23 01:11:06 juju-e4d256-prod-github-runner-207 kernel: [71240.602362] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 01:11:06 juju-e4d256-prod-github-runner-207 kernel: [71240.603168] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 01:11:06 juju-e4d256-prod-github-runner-207 kernel: [71240.604018] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 01:11:06 juju-e4d256-prod-github-runner-207 kernel: [71240.604819] ? __seccomp_filter+0x4a/0x4a0 Aug 23 01:11:06 juju-e4d256-prod-github-runner-207 kernel: [71240.605566] ? __fget_files+0x86/0xc0 Aug 23 01:11:06 juju-e4d256-prod-github-runner-207 kernel: [71240.606273] __x64_sys_ioctl+0x95/0xd0 Aug 23 01:11:06 juju-e4d256-prod-github-runner-207 kernel: [71240.606961] do_syscall_64+0x5c/0xc0 Aug 23 01:11:06 juju-e4d256-prod-github-runner-207 kernel: [71240.607621] ? do_futex+0x162/0x1f0 Aug 23 01:11:06 juju-e4d256-prod-github-runner-207 kernel: [71240.608267] ? __x64_sys_futex+0x78/0x1e0 Aug 23 01:11:06 juju-e4d256-prod-github-runner-207 kernel: [71240.608936] ? __secure_computing+0xa9/0x120 Aug 23 01:11:06 juju-e4d256-prod-github-runner-207 kernel: [71240.609633] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 01:11:06 juju-e4d256-prod-github-runner-207 kernel: [71240.610395] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:11:06 juju-e4d256-prod-github-runner-207 kernel: [71240.611112] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:11:06 juju-e4d256-prod-github-runner-207 kernel: [71240.611825] ? do_syscall_64+0x69/0xc0 Aug 23 01:11:06 juju-e4d256-prod-github-runner-207 kernel: [71240.612466] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:11:06 juju-e4d256-prod-github-runner-207 kernel: [71240.613179] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:11:06 juju-e4d256-prod-github-runner-207 kernel: [71240.613872] ? do_syscall_64+0x69/0xc0 Aug 23 01:11:06 juju-e4d256-prod-github-runner-207 kernel: [71240.614494] ? do_syscall_64+0x69/0xc0 Aug 23 01:11:06 juju-e4d256-prod-github-runner-207 kernel: [71240.615114] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 01:11:06 juju-e4d256-prod-github-runner-207 kernel: [71240.615818] RIP: 0033:0x7faa5d0edaff Aug 23 01:11:06 juju-e4d256-prod-github-runner-207 kernel: [71240.616456] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 01:11:06 juju-e4d256-prod-github-runner-207 kernel: [71240.618454] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 01:11:06 juju-e4d256-prod-github-runner-207 kernel: [71240.619360] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 01:11:06 juju-e4d256-prod-github-runner-207 kernel: [71240.620253] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 01:11:06 juju-e4d256-prod-github-runner-207 kernel: [71240.621150] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 01:11:06 juju-e4d256-prod-github-runner-207 kernel: [71240.622035] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 01:11:06 juju-e4d256-prod-github-runner-207 kernel: [71240.622925] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 01:11:06 juju-e4d256-prod-github-runner-207 kernel: [71240.623815] Aug 23 01:11:34 juju-e4d256-prod-github-runner-207 kernel: [71268.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 66266s! [qemu-system-x86:6715] Aug 23 01:11:34 juju-e4d256-prod-github-runner-207 kernel: [71268.543714] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 01:11:34 juju-e4d256-prod-github-runner-207 kernel: [71268.543895] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 01:11:34 juju-e4d256-prod-github-runner-207 kernel: [71268.556187] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 01:11:34 juju-e4d256-prod-github-runner-207 kernel: [71268.557586] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 01:11:34 juju-e4d256-prod-github-runner-207 kernel: [71268.558808] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:11:34 juju-e4d256-prod-github-runner-207 kernel: [71268.559875] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 01:11:34 juju-e4d256-prod-github-runner-207 kernel: [71268.562447] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 01:11:34 juju-e4d256-prod-github-runner-207 kernel: [71268.563490] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 01:11:34 juju-e4d256-prod-github-runner-207 kernel: [71268.564646] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 01:11:34 juju-e4d256-prod-github-runner-207 kernel: [71268.565812] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 01:11:34 juju-e4d256-prod-github-runner-207 kernel: [71268.566972] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 01:11:34 juju-e4d256-prod-github-runner-207 kernel: [71268.568137] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 01:11:34 juju-e4d256-prod-github-runner-207 kernel: [71268.569311] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 01:11:34 juju-e4d256-prod-github-runner-207 kernel: [71268.570543] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 01:11:34 juju-e4d256-prod-github-runner-207 kernel: [71268.571647] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 01:11:34 juju-e4d256-prod-github-runner-207 kernel: [71268.572846] Call Trace: Aug 23 01:11:34 juju-e4d256-prod-github-runner-207 kernel: [71268.573757] Aug 23 01:11:34 juju-e4d256-prod-github-runner-207 kernel: [71268.574649] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:11:34 juju-e4d256-prod-github-runner-207 kernel: [71268.575680] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:11:34 juju-e4d256-prod-github-runner-207 kernel: [71268.576702] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:11:34 juju-e4d256-prod-github-runner-207 kernel: [71268.577809] ? show_regs.part.0+0x23/0x29 Aug 23 01:11:34 juju-e4d256-prod-github-runner-207 kernel: [71268.578811] ? show_regs.cold+0x8/0xd Aug 23 01:11:34 juju-e4d256-prod-github-runner-207 kernel: [71268.579780] ? watchdog_timer_fn+0x1be/0x220 Aug 23 01:11:34 juju-e4d256-prod-github-runner-207 kernel: [71268.580827] ? lockup_detector_update_enable+0x60/0x60 Aug 23 01:11:34 juju-e4d256-prod-github-runner-207 kernel: [71268.581920] ? __hrtimer_run_queues+0x107/0x230 Aug 23 01:11:34 juju-e4d256-prod-github-runner-207 kernel: [71268.582953] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 01:11:34 juju-e4d256-prod-github-runner-207 kernel: [71268.584011] ? hrtimer_interrupt+0x101/0x220 Aug 23 01:11:34 juju-e4d256-prod-github-runner-207 kernel: [71268.585041] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 01:11:34 juju-e4d256-prod-github-runner-207 kernel: [71268.586110] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 01:11:34 juju-e4d256-prod-github-runner-207 kernel: [71268.587160] Aug 23 01:11:34 juju-e4d256-prod-github-runner-207 kernel: [71268.588017] Aug 23 01:11:34 juju-e4d256-prod-github-runner-207 kernel: [71268.588879] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 01:11:34 juju-e4d256-prod-github-runner-207 kernel: [71268.589988] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:11:34 juju-e4d256-prod-github-runner-207 kernel: [71268.591034] ? _raw_spin_lock+0x22/0x30 Aug 23 01:11:34 juju-e4d256-prod-github-runner-207 kernel: [71268.591977] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:11:34 juju-e4d256-prod-github-runner-207 kernel: [71268.593002] direct_page_fault+0x206/0x310 [kvm] Aug 23 01:11:34 juju-e4d256-prod-github-runner-207 kernel: [71268.594032] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 01:11:34 juju-e4d256-prod-github-runner-207 kernel: [71268.595045] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 01:11:34 juju-e4d256-prod-github-runner-207 kernel: [71268.596050] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 01:11:34 juju-e4d256-prod-github-runner-207 kernel: [71268.597053] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 01:11:34 juju-e4d256-prod-github-runner-207 kernel: [71268.597999] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 01:11:34 juju-e4d256-prod-github-runner-207 kernel: [71268.598976] handle_exit+0x98/0x230 [kvm_amd] Aug 23 01:11:34 juju-e4d256-prod-github-runner-207 kernel: [71268.599869] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 01:11:34 juju-e4d256-prod-github-runner-207 kernel: [71268.600796] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 01:11:34 juju-e4d256-prod-github-runner-207 kernel: [71268.601721] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 01:11:34 juju-e4d256-prod-github-runner-207 kernel: [71268.602630] vcpu_run+0x62/0x2c0 [kvm] Aug 23 01:11:34 juju-e4d256-prod-github-runner-207 kernel: [71268.603446] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 01:11:34 juju-e4d256-prod-github-runner-207 kernel: [71268.604253] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 01:11:34 juju-e4d256-prod-github-runner-207 kernel: [71268.605115] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 01:11:34 juju-e4d256-prod-github-runner-207 kernel: [71268.605914] ? __seccomp_filter+0x4a/0x4a0 Aug 23 01:11:34 juju-e4d256-prod-github-runner-207 kernel: [71268.606661] ? __fget_files+0x86/0xc0 Aug 23 01:11:34 juju-e4d256-prod-github-runner-207 kernel: [71268.607367] __x64_sys_ioctl+0x95/0xd0 Aug 23 01:11:34 juju-e4d256-prod-github-runner-207 kernel: [71268.608059] do_syscall_64+0x5c/0xc0 Aug 23 01:11:34 juju-e4d256-prod-github-runner-207 kernel: [71268.608734] ? do_futex+0x162/0x1f0 Aug 23 01:11:34 juju-e4d256-prod-github-runner-207 kernel: [71268.609389] ? __x64_sys_futex+0x78/0x1e0 Aug 23 01:11:34 juju-e4d256-prod-github-runner-207 kernel: [71268.610068] ? __secure_computing+0xa9/0x120 Aug 23 01:11:34 juju-e4d256-prod-github-runner-207 kernel: [71268.610756] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 01:11:34 juju-e4d256-prod-github-runner-207 kernel: [71268.611520] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:11:34 juju-e4d256-prod-github-runner-207 kernel: [71268.612247] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:11:34 juju-e4d256-prod-github-runner-207 kernel: [71268.612977] ? do_syscall_64+0x69/0xc0 Aug 23 01:11:34 juju-e4d256-prod-github-runner-207 kernel: [71268.613625] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:11:34 juju-e4d256-prod-github-runner-207 kernel: [71268.614332] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:11:34 juju-e4d256-prod-github-runner-207 kernel: [71268.615033] ? do_syscall_64+0x69/0xc0 Aug 23 01:11:34 juju-e4d256-prod-github-runner-207 kernel: [71268.615658] ? do_syscall_64+0x69/0xc0 Aug 23 01:11:34 juju-e4d256-prod-github-runner-207 kernel: [71268.616282] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 01:11:34 juju-e4d256-prod-github-runner-207 kernel: [71268.617007] RIP: 0033:0x7faa5d0edaff Aug 23 01:11:34 juju-e4d256-prod-github-runner-207 kernel: [71268.617652] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 01:11:34 juju-e4d256-prod-github-runner-207 kernel: [71268.619642] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 01:11:34 juju-e4d256-prod-github-runner-207 kernel: [71268.620557] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 01:11:34 juju-e4d256-prod-github-runner-207 kernel: [71268.621466] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 01:11:34 juju-e4d256-prod-github-runner-207 kernel: [71268.622358] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 01:11:34 juju-e4d256-prod-github-runner-207 kernel: [71268.623249] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 01:11:34 juju-e4d256-prod-github-runner-207 kernel: [71268.624139] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 01:11:34 juju-e4d256-prod-github-runner-207 kernel: [71268.625039] Aug 23 01:11:48 juju-e4d256-prod-github-runner-207 kernel: [71281.940706] rcu: INFO: rcu_sched self-detected stall on CPU Aug 23 01:11:48 juju-e4d256-prod-github-runner-207 kernel: [71281.941655] rcu: 1-....: (17735158 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=8566289 Aug 23 01:11:48 juju-e4d256-prod-github-runner-207 kernel: [71281.942771] (t=17791185 jiffies g=23269 q=61132) Aug 23 01:11:48 juju-e4d256-prod-github-runner-207 kernel: [71281.943561] NMI backtrace for cpu 1 Aug 23 01:11:48 juju-e4d256-prod-github-runner-207 kernel: [71281.944268] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 01:11:48 juju-e4d256-prod-github-runner-207 kernel: [71281.945386] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 01:11:48 juju-e4d256-prod-github-runner-207 kernel: [71281.946441] Call Trace: Aug 23 01:11:48 juju-e4d256-prod-github-runner-207 kernel: [71281.947117] Aug 23 01:11:48 juju-e4d256-prod-github-runner-207 kernel: [71281.947762] show_stack+0x52/0x5c Aug 23 01:11:48 juju-e4d256-prod-github-runner-207 kernel: [71281.948486] dump_stack_lvl+0x4a/0x63 Aug 23 01:11:48 juju-e4d256-prod-github-runner-207 kernel: [71281.949255] dump_stack+0x10/0x16 Aug 23 01:11:48 juju-e4d256-prod-github-runner-207 kernel: [71281.949974] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 23 01:11:48 juju-e4d256-prod-github-runner-207 kernel: [71281.950757] ? lapic_can_unplug_cpu+0x90/0x90 Aug 23 01:11:48 juju-e4d256-prod-github-runner-207 kernel: [71281.951541] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 23 01:11:48 juju-e4d256-prod-github-runner-207 kernel: [71281.952360] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 23 01:11:48 juju-e4d256-prod-github-runner-207 kernel: [71281.953197] trigger_single_cpu_backtrace+0x44/0x4f Aug 23 01:11:48 juju-e4d256-prod-github-runner-207 kernel: [71281.954004] rcu_dump_cpu_stacks+0x102/0x149 Aug 23 01:11:48 juju-e4d256-prod-github-runner-207 kernel: [71281.954778] print_cpu_stall.cold+0x2f/0xe2 Aug 23 01:11:48 juju-e4d256-prod-github-runner-207 kernel: [71281.955541] ? timekeeping_update+0xf7/0x150 Aug 23 01:11:48 juju-e4d256-prod-github-runner-207 kernel: [71281.956317] check_cpu_stall+0x109/0x270 Aug 23 01:11:48 juju-e4d256-prod-github-runner-207 kernel: [71281.957072] rcu_sched_clock_irq+0x9a/0x250 Aug 23 01:11:48 juju-e4d256-prod-github-runner-207 kernel: [71281.957834] update_process_times+0x94/0xd0 Aug 23 01:11:48 juju-e4d256-prod-github-runner-207 kernel: [71281.958598] tick_sched_handle+0x29/0x70 Aug 23 01:11:48 juju-e4d256-prod-github-runner-207 kernel: [71281.959346] tick_sched_timer+0x8c/0xc0 Aug 23 01:11:48 juju-e4d256-prod-github-runner-207 kernel: [71281.960082] ? tick_nohz_handler+0xb0/0xb0 Aug 23 01:11:48 juju-e4d256-prod-github-runner-207 kernel: [71281.960848] __hrtimer_run_queues+0x107/0x230 Aug 23 01:11:48 juju-e4d256-prod-github-runner-207 kernel: [71281.961626] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 01:11:48 juju-e4d256-prod-github-runner-207 kernel: [71281.962399] hrtimer_interrupt+0x101/0x220 Aug 23 01:11:48 juju-e4d256-prod-github-runner-207 kernel: [71281.963156] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 01:11:48 juju-e4d256-prod-github-runner-207 kernel: [71281.963967] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 01:11:48 juju-e4d256-prod-github-runner-207 kernel: [71281.964780] Aug 23 01:11:48 juju-e4d256-prod-github-runner-207 kernel: [71281.965421] Aug 23 01:11:48 juju-e4d256-prod-github-runner-207 kernel: [71281.966049] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 01:11:48 juju-e4d256-prod-github-runner-207 kernel: [71281.966871] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:11:48 juju-e4d256-prod-github-runner-207 kernel: [71281.967748] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 01:11:48 juju-e4d256-prod-github-runner-207 kernel: [71281.969965] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 01:11:48 juju-e4d256-prod-github-runner-207 kernel: [71281.970841] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 01:11:48 juju-e4d256-prod-github-runner-207 kernel: [71281.971834] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 01:11:48 juju-e4d256-prod-github-runner-207 kernel: [71281.972824] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 01:11:48 juju-e4d256-prod-github-runner-207 kernel: [71281.973786] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 01:11:48 juju-e4d256-prod-github-runner-207 kernel: [71281.974738] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 01:11:48 juju-e4d256-prod-github-runner-207 kernel: [71281.975695] ? _raw_spin_lock+0x22/0x30 Aug 23 01:11:48 juju-e4d256-prod-github-runner-207 kernel: [71281.976453] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:11:48 juju-e4d256-prod-github-runner-207 kernel: [71281.977297] direct_page_fault+0x206/0x310 [kvm] Aug 23 01:11:48 juju-e4d256-prod-github-runner-207 kernel: [71281.978136] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 01:11:48 juju-e4d256-prod-github-runner-207 kernel: [71281.978961] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 01:11:48 juju-e4d256-prod-github-runner-207 kernel: [71281.979782] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 01:11:48 juju-e4d256-prod-github-runner-207 kernel: [71281.980595] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 01:11:48 juju-e4d256-prod-github-runner-207 kernel: [71281.981384] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 01:11:48 juju-e4d256-prod-github-runner-207 kernel: [71281.982205] handle_exit+0x98/0x230 [kvm_amd] Aug 23 01:11:48 juju-e4d256-prod-github-runner-207 kernel: [71281.982957] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 01:11:48 juju-e4d256-prod-github-runner-207 kernel: [71281.983738] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 01:11:48 juju-e4d256-prod-github-runner-207 kernel: [71281.984539] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 01:11:48 juju-e4d256-prod-github-runner-207 kernel: [71281.985339] vcpu_run+0x62/0x2c0 [kvm] Aug 23 01:11:48 juju-e4d256-prod-github-runner-207 kernel: [71281.986054] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 01:11:48 juju-e4d256-prod-github-runner-207 kernel: [71281.986787] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 01:11:48 juju-e4d256-prod-github-runner-207 kernel: [71281.987592] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 01:11:48 juju-e4d256-prod-github-runner-207 kernel: [71281.988352] ? __seccomp_filter+0x4a/0x4a0 Aug 23 01:11:48 juju-e4d256-prod-github-runner-207 kernel: [71281.989084] ? __fget_files+0x86/0xc0 Aug 23 01:11:48 juju-e4d256-prod-github-runner-207 kernel: [71281.989780] __x64_sys_ioctl+0x95/0xd0 Aug 23 01:11:48 juju-e4d256-prod-github-runner-207 kernel: [71281.990473] do_syscall_64+0x5c/0xc0 Aug 23 01:11:48 juju-e4d256-prod-github-runner-207 kernel: [71281.991158] ? do_futex+0x162/0x1f0 Aug 23 01:11:48 juju-e4d256-prod-github-runner-207 kernel: [71281.991827] ? __x64_sys_futex+0x78/0x1e0 Aug 23 01:11:48 juju-e4d256-prod-github-runner-207 kernel: [71281.992527] ? __secure_computing+0xa9/0x120 Aug 23 01:11:48 juju-e4d256-prod-github-runner-207 kernel: [71281.993253] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 01:11:48 juju-e4d256-prod-github-runner-207 kernel: [71281.994040] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:11:48 juju-e4d256-prod-github-runner-207 kernel: [71281.994796] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:11:48 juju-e4d256-prod-github-runner-207 kernel: [71281.995547] ? do_syscall_64+0x69/0xc0 Aug 23 01:11:48 juju-e4d256-prod-github-runner-207 kernel: [71281.996239] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:11:48 juju-e4d256-prod-github-runner-207 kernel: [71281.997004] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:11:48 juju-e4d256-prod-github-runner-207 kernel: [71281.997767] ? do_syscall_64+0x69/0xc0 Aug 23 01:11:48 juju-e4d256-prod-github-runner-207 kernel: [71281.998458] ? do_syscall_64+0x69/0xc0 Aug 23 01:11:48 juju-e4d256-prod-github-runner-207 kernel: [71281.999144] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 01:11:48 juju-e4d256-prod-github-runner-207 kernel: [71281.999911] RIP: 0033:0x7faa5d0edaff Aug 23 01:11:48 juju-e4d256-prod-github-runner-207 kernel: [71282.000607] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 01:11:48 juju-e4d256-prod-github-runner-207 kernel: [71282.002701] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 01:11:48 juju-e4d256-prod-github-runner-207 kernel: [71282.003662] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 01:11:48 juju-e4d256-prod-github-runner-207 kernel: [71282.004617] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 01:11:48 juju-e4d256-prod-github-runner-207 kernel: [71282.005566] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 01:11:48 juju-e4d256-prod-github-runner-207 kernel: [71282.006505] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 01:11:48 juju-e4d256-prod-github-runner-207 kernel: [71282.007429] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 01:11:48 juju-e4d256-prod-github-runner-207 kernel: [71282.008341] Aug 23 01:12:14 juju-e4d256-prod-github-runner-207 kernel: [71308.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 66303s! [qemu-system-x86:6715] Aug 23 01:12:14 juju-e4d256-prod-github-runner-207 kernel: [71308.543117] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 01:12:14 juju-e4d256-prod-github-runner-207 kernel: [71308.543185] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 01:12:14 juju-e4d256-prod-github-runner-207 kernel: [71308.555322] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 01:12:14 juju-e4d256-prod-github-runner-207 kernel: [71308.556597] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 01:12:14 juju-e4d256-prod-github-runner-207 kernel: [71308.557819] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:12:14 juju-e4d256-prod-github-runner-207 kernel: [71308.558872] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 01:12:14 juju-e4d256-prod-github-runner-207 kernel: [71308.561435] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 01:12:14 juju-e4d256-prod-github-runner-207 kernel: [71308.562488] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 01:12:14 juju-e4d256-prod-github-runner-207 kernel: [71308.563649] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 01:12:14 juju-e4d256-prod-github-runner-207 kernel: [71308.564819] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 01:12:14 juju-e4d256-prod-github-runner-207 kernel: [71308.565974] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 01:12:14 juju-e4d256-prod-github-runner-207 kernel: [71308.567134] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 01:12:14 juju-e4d256-prod-github-runner-207 kernel: [71308.568313] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 01:12:14 juju-e4d256-prod-github-runner-207 kernel: [71308.569548] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 01:12:14 juju-e4d256-prod-github-runner-207 kernel: [71308.570641] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 01:12:14 juju-e4d256-prod-github-runner-207 kernel: [71308.571827] Call Trace: Aug 23 01:12:14 juju-e4d256-prod-github-runner-207 kernel: [71308.572745] Aug 23 01:12:14 juju-e4d256-prod-github-runner-207 kernel: [71308.573627] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:12:14 juju-e4d256-prod-github-runner-207 kernel: [71308.574662] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:12:14 juju-e4d256-prod-github-runner-207 kernel: [71308.575684] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:12:14 juju-e4d256-prod-github-runner-207 kernel: [71308.576766] ? show_regs.part.0+0x23/0x29 Aug 23 01:12:14 juju-e4d256-prod-github-runner-207 kernel: [71308.577761] ? show_regs.cold+0x8/0xd Aug 23 01:12:14 juju-e4d256-prod-github-runner-207 kernel: [71308.578736] ? watchdog_timer_fn+0x1be/0x220 Aug 23 01:12:14 juju-e4d256-prod-github-runner-207 kernel: [71308.579748] ? lockup_detector_update_enable+0x60/0x60 Aug 23 01:12:14 juju-e4d256-prod-github-runner-207 kernel: [71308.580818] ? __hrtimer_run_queues+0x107/0x230 Aug 23 01:12:14 juju-e4d256-prod-github-runner-207 kernel: [71308.581847] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 01:12:14 juju-e4d256-prod-github-runner-207 kernel: [71308.582868] ? hrtimer_interrupt+0x101/0x220 Aug 23 01:12:14 juju-e4d256-prod-github-runner-207 kernel: [71308.583884] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 01:12:14 juju-e4d256-prod-github-runner-207 kernel: [71308.584957] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 01:12:14 juju-e4d256-prod-github-runner-207 kernel: [71308.586008] Aug 23 01:12:14 juju-e4d256-prod-github-runner-207 kernel: [71308.586971] Aug 23 01:12:14 juju-e4d256-prod-github-runner-207 kernel: [71308.587808] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 01:12:14 juju-e4d256-prod-github-runner-207 kernel: [71308.588858] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:12:14 juju-e4d256-prod-github-runner-207 kernel: [71308.589901] ? _raw_spin_lock+0x22/0x30 Aug 23 01:12:14 juju-e4d256-prod-github-runner-207 kernel: [71308.590843] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:12:14 juju-e4d256-prod-github-runner-207 kernel: [71308.591876] direct_page_fault+0x206/0x310 [kvm] Aug 23 01:12:14 juju-e4d256-prod-github-runner-207 kernel: [71308.592926] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 01:12:14 juju-e4d256-prod-github-runner-207 kernel: [71308.593932] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 01:12:14 juju-e4d256-prod-github-runner-207 kernel: [71308.594928] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 01:12:14 juju-e4d256-prod-github-runner-207 kernel: [71308.595893] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 01:12:14 juju-e4d256-prod-github-runner-207 kernel: [71308.596846] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 01:12:14 juju-e4d256-prod-github-runner-207 kernel: [71308.597821] handle_exit+0x98/0x230 [kvm_amd] Aug 23 01:12:14 juju-e4d256-prod-github-runner-207 kernel: [71308.598715] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 01:12:14 juju-e4d256-prod-github-runner-207 kernel: [71308.599624] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 01:12:14 juju-e4d256-prod-github-runner-207 kernel: [71308.600552] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 01:12:14 juju-e4d256-prod-github-runner-207 kernel: [71308.601456] vcpu_run+0x62/0x2c0 [kvm] Aug 23 01:12:14 juju-e4d256-prod-github-runner-207 kernel: [71308.602478] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 01:12:14 juju-e4d256-prod-github-runner-207 kernel: [71308.603598] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 01:12:14 juju-e4d256-prod-github-runner-207 kernel: [71308.604772] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 01:12:14 juju-e4d256-prod-github-runner-207 kernel: [71308.605840] ? __seccomp_filter+0x4a/0x4a0 Aug 23 01:12:14 juju-e4d256-prod-github-runner-207 kernel: [71308.606855] ? __fget_files+0x86/0xc0 Aug 23 01:12:14 juju-e4d256-prod-github-runner-207 kernel: [71308.607802] __x64_sys_ioctl+0x95/0xd0 Aug 23 01:12:14 juju-e4d256-prod-github-runner-207 kernel: [71308.608819] do_syscall_64+0x5c/0xc0 Aug 23 01:12:14 juju-e4d256-prod-github-runner-207 kernel: [71308.609749] ? do_futex+0x162/0x1f0 Aug 23 01:12:14 juju-e4d256-prod-github-runner-207 kernel: [71308.610693] ? __x64_sys_futex+0x78/0x1e0 Aug 23 01:12:14 juju-e4d256-prod-github-runner-207 kernel: [71308.611633] ? __secure_computing+0xa9/0x120 Aug 23 01:12:14 juju-e4d256-prod-github-runner-207 kernel: [71308.612395] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 01:12:14 juju-e4d256-prod-github-runner-207 kernel: [71308.613197] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:12:14 juju-e4d256-prod-github-runner-207 kernel: [71308.613928] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:12:14 juju-e4d256-prod-github-runner-207 kernel: [71308.614648] ? do_syscall_64+0x69/0xc0 Aug 23 01:12:14 juju-e4d256-prod-github-runner-207 kernel: [71308.615299] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:12:14 juju-e4d256-prod-github-runner-207 kernel: [71308.616015] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:12:14 juju-e4d256-prod-github-runner-207 kernel: [71308.616731] ? do_syscall_64+0x69/0xc0 Aug 23 01:12:14 juju-e4d256-prod-github-runner-207 kernel: [71308.617367] ? do_syscall_64+0x69/0xc0 Aug 23 01:12:14 juju-e4d256-prod-github-runner-207 kernel: [71308.618003] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 01:12:14 juju-e4d256-prod-github-runner-207 kernel: [71308.618713] RIP: 0033:0x7faa5d0edaff Aug 23 01:12:14 juju-e4d256-prod-github-runner-207 kernel: [71308.619344] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 01:12:14 juju-e4d256-prod-github-runner-207 kernel: [71308.621357] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 01:12:14 juju-e4d256-prod-github-runner-207 kernel: [71308.622291] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 01:12:14 juju-e4d256-prod-github-runner-207 kernel: [71308.623191] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 01:12:14 juju-e4d256-prod-github-runner-207 kernel: [71308.624092] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 01:12:14 juju-e4d256-prod-github-runner-207 kernel: [71308.624999] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 01:12:14 juju-e4d256-prod-github-runner-207 kernel: [71308.625891] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 01:12:14 juju-e4d256-prod-github-runner-207 kernel: [71308.626788] Aug 23 01:12:42 juju-e4d256-prod-github-runner-207 kernel: [71336.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 66329s! [qemu-system-x86:6715] Aug 23 01:12:42 juju-e4d256-prod-github-runner-207 kernel: [71336.543742] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 01:12:42 juju-e4d256-prod-github-runner-207 kernel: [71336.544008] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 01:12:42 juju-e4d256-prod-github-runner-207 kernel: [71336.556090] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 01:12:42 juju-e4d256-prod-github-runner-207 kernel: [71336.557360] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 01:12:42 juju-e4d256-prod-github-runner-207 kernel: [71336.558579] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:12:42 juju-e4d256-prod-github-runner-207 kernel: [71336.559640] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 01:12:42 juju-e4d256-prod-github-runner-207 kernel: [71336.562210] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 01:12:42 juju-e4d256-prod-github-runner-207 kernel: [71336.563256] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 01:12:42 juju-e4d256-prod-github-runner-207 kernel: [71336.564435] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 01:12:42 juju-e4d256-prod-github-runner-207 kernel: [71336.565594] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 01:12:42 juju-e4d256-prod-github-runner-207 kernel: [71336.566757] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 01:12:42 juju-e4d256-prod-github-runner-207 kernel: [71336.567921] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 01:12:42 juju-e4d256-prod-github-runner-207 kernel: [71336.569101] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 01:12:42 juju-e4d256-prod-github-runner-207 kernel: [71336.570333] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 01:12:42 juju-e4d256-prod-github-runner-207 kernel: [71336.571433] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 01:12:42 juju-e4d256-prod-github-runner-207 kernel: [71336.572640] Call Trace: Aug 23 01:12:42 juju-e4d256-prod-github-runner-207 kernel: [71336.573553] Aug 23 01:12:42 juju-e4d256-prod-github-runner-207 kernel: [71336.574449] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:12:42 juju-e4d256-prod-github-runner-207 kernel: [71336.575481] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:12:42 juju-e4d256-prod-github-runner-207 kernel: [71336.576526] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:12:42 juju-e4d256-prod-github-runner-207 kernel: [71336.577621] ? show_regs.part.0+0x23/0x29 Aug 23 01:12:42 juju-e4d256-prod-github-runner-207 kernel: [71336.578621] ? show_regs.cold+0x8/0xd Aug 23 01:12:42 juju-e4d256-prod-github-runner-207 kernel: [71336.579591] ? watchdog_timer_fn+0x1be/0x220 Aug 23 01:12:42 juju-e4d256-prod-github-runner-207 kernel: [71336.580613] ? lockup_detector_update_enable+0x60/0x60 Aug 23 01:12:42 juju-e4d256-prod-github-runner-207 kernel: [71336.581682] ? __hrtimer_run_queues+0x107/0x230 Aug 23 01:12:42 juju-e4d256-prod-github-runner-207 kernel: [71336.582713] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 01:12:42 juju-e4d256-prod-github-runner-207 kernel: [71336.583736] ? hrtimer_interrupt+0x101/0x220 Aug 23 01:12:42 juju-e4d256-prod-github-runner-207 kernel: [71336.584767] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 01:12:42 juju-e4d256-prod-github-runner-207 kernel: [71336.585836] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 01:12:42 juju-e4d256-prod-github-runner-207 kernel: [71336.586887] Aug 23 01:12:42 juju-e4d256-prod-github-runner-207 kernel: [71336.587738] Aug 23 01:12:42 juju-e4d256-prod-github-runner-207 kernel: [71336.588585] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 01:12:42 juju-e4d256-prod-github-runner-207 kernel: [71336.589644] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:12:42 juju-e4d256-prod-github-runner-207 kernel: [71336.590683] ? _raw_spin_lock+0x22/0x30 Aug 23 01:12:42 juju-e4d256-prod-github-runner-207 kernel: [71336.591632] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:12:42 juju-e4d256-prod-github-runner-207 kernel: [71336.592665] direct_page_fault+0x206/0x310 [kvm] Aug 23 01:12:42 juju-e4d256-prod-github-runner-207 kernel: [71336.593692] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 01:12:42 juju-e4d256-prod-github-runner-207 kernel: [71336.594698] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 01:12:42 juju-e4d256-prod-github-runner-207 kernel: [71336.595702] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 01:12:42 juju-e4d256-prod-github-runner-207 kernel: [71336.596702] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 01:12:42 juju-e4d256-prod-github-runner-207 kernel: [71336.597650] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 01:12:42 juju-e4d256-prod-github-runner-207 kernel: [71336.598626] handle_exit+0x98/0x230 [kvm_amd] Aug 23 01:12:42 juju-e4d256-prod-github-runner-207 kernel: [71336.599521] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 01:12:42 juju-e4d256-prod-github-runner-207 kernel: [71336.600455] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 01:12:42 juju-e4d256-prod-github-runner-207 kernel: [71336.601380] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 01:12:42 juju-e4d256-prod-github-runner-207 kernel: [71336.602282] vcpu_run+0x62/0x2c0 [kvm] Aug 23 01:12:42 juju-e4d256-prod-github-runner-207 kernel: [71336.603096] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 01:12:42 juju-e4d256-prod-github-runner-207 kernel: [71336.603901] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 01:12:42 juju-e4d256-prod-github-runner-207 kernel: [71336.604764] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 01:12:42 juju-e4d256-prod-github-runner-207 kernel: [71336.605558] ? __seccomp_filter+0x4a/0x4a0 Aug 23 01:12:42 juju-e4d256-prod-github-runner-207 kernel: [71336.606301] ? __fget_files+0x86/0xc0 Aug 23 01:12:42 juju-e4d256-prod-github-runner-207 kernel: [71336.607004] __x64_sys_ioctl+0x95/0xd0 Aug 23 01:12:42 juju-e4d256-prod-github-runner-207 kernel: [71336.607696] do_syscall_64+0x5c/0xc0 Aug 23 01:12:42 juju-e4d256-prod-github-runner-207 kernel: [71336.608371] ? do_futex+0x162/0x1f0 Aug 23 01:12:42 juju-e4d256-prod-github-runner-207 kernel: [71336.609023] ? __x64_sys_futex+0x78/0x1e0 Aug 23 01:12:42 juju-e4d256-prod-github-runner-207 kernel: [71336.609697] ? __secure_computing+0xa9/0x120 Aug 23 01:12:42 juju-e4d256-prod-github-runner-207 kernel: [71336.610391] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 01:12:42 juju-e4d256-prod-github-runner-207 kernel: [71336.611189] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:12:42 juju-e4d256-prod-github-runner-207 kernel: [71336.611909] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:12:42 juju-e4d256-prod-github-runner-207 kernel: [71336.612637] ? do_syscall_64+0x69/0xc0 Aug 23 01:12:42 juju-e4d256-prod-github-runner-207 kernel: [71336.613287] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:12:42 juju-e4d256-prod-github-runner-207 kernel: [71336.613987] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:12:42 juju-e4d256-prod-github-runner-207 kernel: [71336.614685] ? do_syscall_64+0x69/0xc0 Aug 23 01:12:42 juju-e4d256-prod-github-runner-207 kernel: [71336.615307] ? do_syscall_64+0x69/0xc0 Aug 23 01:12:42 juju-e4d256-prod-github-runner-207 kernel: [71336.615927] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 01:12:42 juju-e4d256-prod-github-runner-207 kernel: [71336.616642] RIP: 0033:0x7faa5d0edaff Aug 23 01:12:42 juju-e4d256-prod-github-runner-207 kernel: [71336.617279] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 01:12:42 juju-e4d256-prod-github-runner-207 kernel: [71336.619269] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 01:12:42 juju-e4d256-prod-github-runner-207 kernel: [71336.620191] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 01:12:42 juju-e4d256-prod-github-runner-207 kernel: [71336.621084] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 01:12:42 juju-e4d256-prod-github-runner-207 kernel: [71336.621973] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 01:12:42 juju-e4d256-prod-github-runner-207 kernel: [71336.622863] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 01:12:42 juju-e4d256-prod-github-runner-207 kernel: [71336.623748] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 01:12:42 juju-e4d256-prod-github-runner-207 kernel: [71336.624651] Aug 23 01:13:10 juju-e4d256-prod-github-runner-207 kernel: [71364.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 66355s! [qemu-system-x86:6715] Aug 23 01:13:10 juju-e4d256-prod-github-runner-207 kernel: [71364.543104] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 01:13:10 juju-e4d256-prod-github-runner-207 kernel: [71364.543181] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 01:13:10 juju-e4d256-prod-github-runner-207 kernel: [71364.555413] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 01:13:10 juju-e4d256-prod-github-runner-207 kernel: [71364.556688] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 01:13:10 juju-e4d256-prod-github-runner-207 kernel: [71364.557906] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:13:10 juju-e4d256-prod-github-runner-207 kernel: [71364.558960] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 01:13:10 juju-e4d256-prod-github-runner-207 kernel: [71364.561512] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 01:13:10 juju-e4d256-prod-github-runner-207 kernel: [71364.562551] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 01:13:10 juju-e4d256-prod-github-runner-207 kernel: [71364.563718] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 01:13:10 juju-e4d256-prod-github-runner-207 kernel: [71364.564878] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 01:13:10 juju-e4d256-prod-github-runner-207 kernel: [71364.566040] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 01:13:10 juju-e4d256-prod-github-runner-207 kernel: [71364.567198] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 01:13:10 juju-e4d256-prod-github-runner-207 kernel: [71364.568366] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 01:13:10 juju-e4d256-prod-github-runner-207 kernel: [71364.569604] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 01:13:10 juju-e4d256-prod-github-runner-207 kernel: [71364.570698] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 01:13:10 juju-e4d256-prod-github-runner-207 kernel: [71364.571896] Call Trace: Aug 23 01:13:10 juju-e4d256-prod-github-runner-207 kernel: [71364.572807] Aug 23 01:13:10 juju-e4d256-prod-github-runner-207 kernel: [71364.573689] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:13:10 juju-e4d256-prod-github-runner-207 kernel: [71364.574723] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:13:10 juju-e4d256-prod-github-runner-207 kernel: [71364.575751] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:13:10 juju-e4d256-prod-github-runner-207 kernel: [71364.576823] ? show_regs.part.0+0x23/0x29 Aug 23 01:13:10 juju-e4d256-prod-github-runner-207 kernel: [71364.577818] ? show_regs.cold+0x8/0xd Aug 23 01:13:10 juju-e4d256-prod-github-runner-207 kernel: [71364.578787] ? watchdog_timer_fn+0x1be/0x220 Aug 23 01:13:10 juju-e4d256-prod-github-runner-207 kernel: [71364.579806] ? lockup_detector_update_enable+0x60/0x60 Aug 23 01:13:10 juju-e4d256-prod-github-runner-207 kernel: [71364.580874] ? __hrtimer_run_queues+0x107/0x230 Aug 23 01:13:10 juju-e4d256-prod-github-runner-207 kernel: [71364.581901] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 01:13:10 juju-e4d256-prod-github-runner-207 kernel: [71364.582939] ? hrtimer_interrupt+0x101/0x220 Aug 23 01:13:10 juju-e4d256-prod-github-runner-207 kernel: [71364.583975] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 01:13:10 juju-e4d256-prod-github-runner-207 kernel: [71364.585045] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 01:13:10 juju-e4d256-prod-github-runner-207 kernel: [71364.586090] Aug 23 01:13:10 juju-e4d256-prod-github-runner-207 kernel: [71364.586941] Aug 23 01:13:10 juju-e4d256-prod-github-runner-207 kernel: [71364.587787] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 01:13:10 juju-e4d256-prod-github-runner-207 kernel: [71364.588818] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:13:10 juju-e4d256-prod-github-runner-207 kernel: [71364.589856] ? _raw_spin_lock+0x22/0x30 Aug 23 01:13:10 juju-e4d256-prod-github-runner-207 kernel: [71364.590800] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:13:10 juju-e4d256-prod-github-runner-207 kernel: [71364.591825] direct_page_fault+0x206/0x310 [kvm] Aug 23 01:13:10 juju-e4d256-prod-github-runner-207 kernel: [71364.592848] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 01:13:10 juju-e4d256-prod-github-runner-207 kernel: [71364.593861] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 01:13:10 juju-e4d256-prod-github-runner-207 kernel: [71364.594860] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 01:13:10 juju-e4d256-prod-github-runner-207 kernel: [71364.595833] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 01:13:10 juju-e4d256-prod-github-runner-207 kernel: [71364.596782] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 01:13:10 juju-e4d256-prod-github-runner-207 kernel: [71364.597760] handle_exit+0x98/0x230 [kvm_amd] Aug 23 01:13:10 juju-e4d256-prod-github-runner-207 kernel: [71364.598650] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 01:13:10 juju-e4d256-prod-github-runner-207 kernel: [71364.599564] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 01:13:10 juju-e4d256-prod-github-runner-207 kernel: [71364.600493] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 01:13:10 juju-e4d256-prod-github-runner-207 kernel: [71364.601397] vcpu_run+0x62/0x2c0 [kvm] Aug 23 01:13:10 juju-e4d256-prod-github-runner-207 kernel: [71364.602206] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 01:13:10 juju-e4d256-prod-github-runner-207 kernel: [71364.603010] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 01:13:10 juju-e4d256-prod-github-runner-207 kernel: [71364.603873] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 01:13:10 juju-e4d256-prod-github-runner-207 kernel: [71364.604669] ? __seccomp_filter+0x4a/0x4a0 Aug 23 01:13:10 juju-e4d256-prod-github-runner-207 kernel: [71364.605411] ? __fget_files+0x86/0xc0 Aug 23 01:13:10 juju-e4d256-prod-github-runner-207 kernel: [71364.606119] __x64_sys_ioctl+0x95/0xd0 Aug 23 01:13:10 juju-e4d256-prod-github-runner-207 kernel: [71364.606809] do_syscall_64+0x5c/0xc0 Aug 23 01:13:10 juju-e4d256-prod-github-runner-207 kernel: [71364.607471] ? do_futex+0x162/0x1f0 Aug 23 01:13:10 juju-e4d256-prod-github-runner-207 kernel: [71364.608123] ? __x64_sys_futex+0x78/0x1e0 Aug 23 01:13:10 juju-e4d256-prod-github-runner-207 kernel: [71364.608795] ? __secure_computing+0xa9/0x120 Aug 23 01:13:10 juju-e4d256-prod-github-runner-207 kernel: [71364.609483] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 01:13:10 juju-e4d256-prod-github-runner-207 kernel: [71364.610242] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:13:10 juju-e4d256-prod-github-runner-207 kernel: [71364.610963] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:13:10 juju-e4d256-prod-github-runner-207 kernel: [71364.611687] ? do_syscall_64+0x69/0xc0 Aug 23 01:13:10 juju-e4d256-prod-github-runner-207 kernel: [71364.612331] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:13:10 juju-e4d256-prod-github-runner-207 kernel: [71364.613032] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:13:10 juju-e4d256-prod-github-runner-207 kernel: [71364.613728] ? do_syscall_64+0x69/0xc0 Aug 23 01:13:10 juju-e4d256-prod-github-runner-207 kernel: [71364.614352] ? do_syscall_64+0x69/0xc0 Aug 23 01:13:10 juju-e4d256-prod-github-runner-207 kernel: [71364.614973] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 01:13:10 juju-e4d256-prod-github-runner-207 kernel: [71364.615686] RIP: 0033:0x7faa5d0edaff Aug 23 01:13:10 juju-e4d256-prod-github-runner-207 kernel: [71364.616309] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 01:13:10 juju-e4d256-prod-github-runner-207 kernel: [71364.618294] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 01:13:10 juju-e4d256-prod-github-runner-207 kernel: [71364.619203] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 01:13:10 juju-e4d256-prod-github-runner-207 kernel: [71364.620098] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 01:13:10 juju-e4d256-prod-github-runner-207 kernel: [71364.620985] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 01:13:10 juju-e4d256-prod-github-runner-207 kernel: [71364.621872] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 01:13:10 juju-e4d256-prod-github-runner-207 kernel: [71364.622763] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 01:13:10 juju-e4d256-prod-github-runner-207 kernel: [71364.623662] Aug 23 01:13:38 juju-e4d256-prod-github-runner-207 kernel: [71392.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 66381s! [qemu-system-x86:6715] Aug 23 01:13:38 juju-e4d256-prod-github-runner-207 kernel: [71392.543118] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 01:13:38 juju-e4d256-prod-github-runner-207 kernel: [71392.543186] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 01:13:38 juju-e4d256-prod-github-runner-207 kernel: [71392.555252] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 01:13:38 juju-e4d256-prod-github-runner-207 kernel: [71392.556530] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 01:13:38 juju-e4d256-prod-github-runner-207 kernel: [71392.557758] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:13:38 juju-e4d256-prod-github-runner-207 kernel: [71392.558815] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 01:13:38 juju-e4d256-prod-github-runner-207 kernel: [71392.561377] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 01:13:38 juju-e4d256-prod-github-runner-207 kernel: [71392.562417] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 01:13:38 juju-e4d256-prod-github-runner-207 kernel: [71392.563594] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 01:13:38 juju-e4d256-prod-github-runner-207 kernel: [71392.564751] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 01:13:38 juju-e4d256-prod-github-runner-207 kernel: [71392.565915] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 01:13:38 juju-e4d256-prod-github-runner-207 kernel: [71392.567076] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 01:13:38 juju-e4d256-prod-github-runner-207 kernel: [71392.568254] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 01:13:38 juju-e4d256-prod-github-runner-207 kernel: [71392.569492] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 01:13:38 juju-e4d256-prod-github-runner-207 kernel: [71392.570589] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 01:13:38 juju-e4d256-prod-github-runner-207 kernel: [71392.571795] Call Trace: Aug 23 01:13:38 juju-e4d256-prod-github-runner-207 kernel: [71392.572708] Aug 23 01:13:38 juju-e4d256-prod-github-runner-207 kernel: [71392.573597] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:13:38 juju-e4d256-prod-github-runner-207 kernel: [71392.574626] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:13:38 juju-e4d256-prod-github-runner-207 kernel: [71392.575659] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:13:38 juju-e4d256-prod-github-runner-207 kernel: [71392.576732] ? show_regs.part.0+0x23/0x29 Aug 23 01:13:38 juju-e4d256-prod-github-runner-207 kernel: [71392.577734] ? show_regs.cold+0x8/0xd Aug 23 01:13:38 juju-e4d256-prod-github-runner-207 kernel: [71392.578706] ? watchdog_timer_fn+0x1be/0x220 Aug 23 01:13:38 juju-e4d256-prod-github-runner-207 kernel: [71392.579729] ? lockup_detector_update_enable+0x60/0x60 Aug 23 01:13:38 juju-e4d256-prod-github-runner-207 kernel: [71392.580791] ? __hrtimer_run_queues+0x107/0x230 Aug 23 01:13:38 juju-e4d256-prod-github-runner-207 kernel: [71392.581820] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 01:13:38 juju-e4d256-prod-github-runner-207 kernel: [71392.582842] ? hrtimer_interrupt+0x101/0x220 Aug 23 01:13:38 juju-e4d256-prod-github-runner-207 kernel: [71392.583873] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 01:13:38 juju-e4d256-prod-github-runner-207 kernel: [71392.584948] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 01:13:38 juju-e4d256-prod-github-runner-207 kernel: [71392.585993] Aug 23 01:13:38 juju-e4d256-prod-github-runner-207 kernel: [71392.586851] Aug 23 01:13:38 juju-e4d256-prod-github-runner-207 kernel: [71392.587714] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 01:13:38 juju-e4d256-prod-github-runner-207 kernel: [71392.588750] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:13:38 juju-e4d256-prod-github-runner-207 kernel: [71392.589789] ? _raw_spin_lock+0x22/0x30 Aug 23 01:13:38 juju-e4d256-prod-github-runner-207 kernel: [71392.590738] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:13:38 juju-e4d256-prod-github-runner-207 kernel: [71392.591769] direct_page_fault+0x206/0x310 [kvm] Aug 23 01:13:38 juju-e4d256-prod-github-runner-207 kernel: [71392.592800] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 01:13:38 juju-e4d256-prod-github-runner-207 kernel: [71392.593816] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 01:13:38 juju-e4d256-prod-github-runner-207 kernel: [71392.594815] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 01:13:38 juju-e4d256-prod-github-runner-207 kernel: [71392.595796] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 01:13:38 juju-e4d256-prod-github-runner-207 kernel: [71392.596748] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 01:13:38 juju-e4d256-prod-github-runner-207 kernel: [71392.597731] handle_exit+0x98/0x230 [kvm_amd] Aug 23 01:13:38 juju-e4d256-prod-github-runner-207 kernel: [71392.598624] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 01:13:38 juju-e4d256-prod-github-runner-207 kernel: [71392.599554] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 01:13:38 juju-e4d256-prod-github-runner-207 kernel: [71392.600477] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 01:13:38 juju-e4d256-prod-github-runner-207 kernel: [71392.601386] vcpu_run+0x62/0x2c0 [kvm] Aug 23 01:13:38 juju-e4d256-prod-github-runner-207 kernel: [71392.602196] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 01:13:38 juju-e4d256-prod-github-runner-207 kernel: [71392.603005] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 01:13:38 juju-e4d256-prod-github-runner-207 kernel: [71392.603875] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 01:13:38 juju-e4d256-prod-github-runner-207 kernel: [71392.604670] ? __seccomp_filter+0x4a/0x4a0 Aug 23 01:13:38 juju-e4d256-prod-github-runner-207 kernel: [71392.605411] ? __fget_files+0x86/0xc0 Aug 23 01:13:38 juju-e4d256-prod-github-runner-207 kernel: [71392.606112] __x64_sys_ioctl+0x95/0xd0 Aug 23 01:13:38 juju-e4d256-prod-github-runner-207 kernel: [71392.606808] do_syscall_64+0x5c/0xc0 Aug 23 01:13:38 juju-e4d256-prod-github-runner-207 kernel: [71392.607483] ? do_futex+0x162/0x1f0 Aug 23 01:13:38 juju-e4d256-prod-github-runner-207 kernel: [71392.608132] ? __x64_sys_futex+0x78/0x1e0 Aug 23 01:13:38 juju-e4d256-prod-github-runner-207 kernel: [71392.608807] ? __secure_computing+0xa9/0x120 Aug 23 01:13:38 juju-e4d256-prod-github-runner-207 kernel: [71392.609501] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 01:13:38 juju-e4d256-prod-github-runner-207 kernel: [71392.610259] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:13:38 juju-e4d256-prod-github-runner-207 kernel: [71392.610980] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:13:38 juju-e4d256-prod-github-runner-207 kernel: [71392.611711] ? do_syscall_64+0x69/0xc0 Aug 23 01:13:38 juju-e4d256-prod-github-runner-207 kernel: [71392.612361] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:13:38 juju-e4d256-prod-github-runner-207 kernel: [71392.613064] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:13:38 juju-e4d256-prod-github-runner-207 kernel: [71392.613758] ? do_syscall_64+0x69/0xc0 Aug 23 01:13:38 juju-e4d256-prod-github-runner-207 kernel: [71392.614382] ? do_syscall_64+0x69/0xc0 Aug 23 01:13:38 juju-e4d256-prod-github-runner-207 kernel: [71392.615136] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 01:13:38 juju-e4d256-prod-github-runner-207 kernel: [71392.615851] RIP: 0033:0x7faa5d0edaff Aug 23 01:13:38 juju-e4d256-prod-github-runner-207 kernel: [71392.616478] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 01:13:38 juju-e4d256-prod-github-runner-207 kernel: [71392.618470] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 01:13:38 juju-e4d256-prod-github-runner-207 kernel: [71392.619391] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 01:13:38 juju-e4d256-prod-github-runner-207 kernel: [71392.620282] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 01:13:38 juju-e4d256-prod-github-runner-207 kernel: [71392.621172] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 01:13:38 juju-e4d256-prod-github-runner-207 kernel: [71392.622063] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 01:13:38 juju-e4d256-prod-github-runner-207 kernel: [71392.622947] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 01:13:38 juju-e4d256-prod-github-runner-207 kernel: [71392.623851] Aug 23 01:14:06 juju-e4d256-prod-github-runner-207 kernel: [71420.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 66407s! [qemu-system-x86:6715] Aug 23 01:14:06 juju-e4d256-prod-github-runner-207 kernel: [71420.543738] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 01:14:06 juju-e4d256-prod-github-runner-207 kernel: [71420.543987] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 01:14:06 juju-e4d256-prod-github-runner-207 kernel: [71420.556315] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 01:14:06 juju-e4d256-prod-github-runner-207 kernel: [71420.557612] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 01:14:06 juju-e4d256-prod-github-runner-207 kernel: [71420.558840] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:14:06 juju-e4d256-prod-github-runner-207 kernel: [71420.560028] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 01:14:06 juju-e4d256-prod-github-runner-207 kernel: [71420.562573] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 01:14:06 juju-e4d256-prod-github-runner-207 kernel: [71420.563622] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 01:14:06 juju-e4d256-prod-github-runner-207 kernel: [71420.564779] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 01:14:06 juju-e4d256-prod-github-runner-207 kernel: [71420.565938] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 01:14:06 juju-e4d256-prod-github-runner-207 kernel: [71420.567099] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 01:14:06 juju-e4d256-prod-github-runner-207 kernel: [71420.568262] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 01:14:06 juju-e4d256-prod-github-runner-207 kernel: [71420.569427] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 01:14:06 juju-e4d256-prod-github-runner-207 kernel: [71420.570656] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 01:14:06 juju-e4d256-prod-github-runner-207 kernel: [71420.571761] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 01:14:06 juju-e4d256-prod-github-runner-207 kernel: [71420.572950] Call Trace: Aug 23 01:14:06 juju-e4d256-prod-github-runner-207 kernel: [71420.573901] Aug 23 01:14:06 juju-e4d256-prod-github-runner-207 kernel: [71420.574826] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:14:06 juju-e4d256-prod-github-runner-207 kernel: [71420.575867] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:14:06 juju-e4d256-prod-github-runner-207 kernel: [71420.576893] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:14:06 juju-e4d256-prod-github-runner-207 kernel: [71420.577980] ? show_regs.part.0+0x23/0x29 Aug 23 01:14:06 juju-e4d256-prod-github-runner-207 kernel: [71420.578990] ? show_regs.cold+0x8/0xd Aug 23 01:14:06 juju-e4d256-prod-github-runner-207 kernel: [71420.579959] ? watchdog_timer_fn+0x1be/0x220 Aug 23 01:14:06 juju-e4d256-prod-github-runner-207 kernel: [71420.580965] ? lockup_detector_update_enable+0x60/0x60 Aug 23 01:14:06 juju-e4d256-prod-github-runner-207 kernel: [71420.582033] ? __hrtimer_run_queues+0x107/0x230 Aug 23 01:14:06 juju-e4d256-prod-github-runner-207 kernel: [71420.583071] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 01:14:06 juju-e4d256-prod-github-runner-207 kernel: [71420.584104] ? hrtimer_interrupt+0x101/0x220 Aug 23 01:14:06 juju-e4d256-prod-github-runner-207 kernel: [71420.585133] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 01:14:06 juju-e4d256-prod-github-runner-207 kernel: [71420.586201] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 01:14:06 juju-e4d256-prod-github-runner-207 kernel: [71420.587262] Aug 23 01:14:06 juju-e4d256-prod-github-runner-207 kernel: [71420.588145] Aug 23 01:14:06 juju-e4d256-prod-github-runner-207 kernel: [71420.588997] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 01:14:06 juju-e4d256-prod-github-runner-207 kernel: [71420.590032] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:14:06 juju-e4d256-prod-github-runner-207 kernel: [71420.591087] ? _raw_spin_lock+0x22/0x30 Aug 23 01:14:06 juju-e4d256-prod-github-runner-207 kernel: [71420.592037] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:14:06 juju-e4d256-prod-github-runner-207 kernel: [71420.593053] direct_page_fault+0x206/0x310 [kvm] Aug 23 01:14:06 juju-e4d256-prod-github-runner-207 kernel: [71420.594083] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 01:14:06 juju-e4d256-prod-github-runner-207 kernel: [71420.595101] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 01:14:06 juju-e4d256-prod-github-runner-207 kernel: [71420.596101] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 01:14:06 juju-e4d256-prod-github-runner-207 kernel: [71420.597090] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 01:14:06 juju-e4d256-prod-github-runner-207 kernel: [71420.598034] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 01:14:06 juju-e4d256-prod-github-runner-207 kernel: [71420.599020] handle_exit+0x98/0x230 [kvm_amd] Aug 23 01:14:06 juju-e4d256-prod-github-runner-207 kernel: [71420.599911] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 01:14:06 juju-e4d256-prod-github-runner-207 kernel: [71420.600827] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 01:14:06 juju-e4d256-prod-github-runner-207 kernel: [71420.601748] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 01:14:06 juju-e4d256-prod-github-runner-207 kernel: [71420.602686] vcpu_run+0x62/0x2c0 [kvm] Aug 23 01:14:06 juju-e4d256-prod-github-runner-207 kernel: [71420.603518] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 01:14:06 juju-e4d256-prod-github-runner-207 kernel: [71420.604344] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 01:14:06 juju-e4d256-prod-github-runner-207 kernel: [71420.605200] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 01:14:06 juju-e4d256-prod-github-runner-207 kernel: [71420.605996] ? __seccomp_filter+0x4a/0x4a0 Aug 23 01:14:06 juju-e4d256-prod-github-runner-207 kernel: [71420.606740] ? __fget_files+0x86/0xc0 Aug 23 01:14:06 juju-e4d256-prod-github-runner-207 kernel: [71420.607450] __x64_sys_ioctl+0x95/0xd0 Aug 23 01:14:06 juju-e4d256-prod-github-runner-207 kernel: [71420.608140] do_syscall_64+0x5c/0xc0 Aug 23 01:14:06 juju-e4d256-prod-github-runner-207 kernel: [71420.608803] ? do_futex+0x162/0x1f0 Aug 23 01:14:06 juju-e4d256-prod-github-runner-207 kernel: [71420.609449] ? __x64_sys_futex+0x78/0x1e0 Aug 23 01:14:06 juju-e4d256-prod-github-runner-207 kernel: [71420.610119] ? __secure_computing+0xa9/0x120 Aug 23 01:14:06 juju-e4d256-prod-github-runner-207 kernel: [71420.610810] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 01:14:06 juju-e4d256-prod-github-runner-207 kernel: [71420.611575] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:14:06 juju-e4d256-prod-github-runner-207 kernel: [71420.612293] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:14:06 juju-e4d256-prod-github-runner-207 kernel: [71420.613011] ? do_syscall_64+0x69/0xc0 Aug 23 01:14:06 juju-e4d256-prod-github-runner-207 kernel: [71420.613664] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:14:06 juju-e4d256-prod-github-runner-207 kernel: [71420.614375] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:14:06 juju-e4d256-prod-github-runner-207 kernel: [71420.615098] ? do_syscall_64+0x69/0xc0 Aug 23 01:14:06 juju-e4d256-prod-github-runner-207 kernel: [71420.615731] ? do_syscall_64+0x69/0xc0 Aug 23 01:14:06 juju-e4d256-prod-github-runner-207 kernel: [71420.616355] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 01:14:06 juju-e4d256-prod-github-runner-207 kernel: [71420.617060] RIP: 0033:0x7faa5d0edaff Aug 23 01:14:06 juju-e4d256-prod-github-runner-207 kernel: [71420.617720] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 01:14:06 juju-e4d256-prod-github-runner-207 kernel: [71420.619734] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 01:14:06 juju-e4d256-prod-github-runner-207 kernel: [71420.620645] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 01:14:06 juju-e4d256-prod-github-runner-207 kernel: [71420.621534] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 01:14:06 juju-e4d256-prod-github-runner-207 kernel: [71420.622419] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 01:14:06 juju-e4d256-prod-github-runner-207 kernel: [71420.623316] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 01:14:06 juju-e4d256-prod-github-runner-207 kernel: [71420.624208] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 01:14:06 juju-e4d256-prod-github-runner-207 kernel: [71420.625097] Aug 23 01:14:34 juju-e4d256-prod-github-runner-207 kernel: [71448.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 66433s! [qemu-system-x86:6715] Aug 23 01:14:34 juju-e4d256-prod-github-runner-207 kernel: [71448.543106] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 01:14:34 juju-e4d256-prod-github-runner-207 kernel: [71448.543173] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 01:14:34 juju-e4d256-prod-github-runner-207 kernel: [71448.555216] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 01:14:34 juju-e4d256-prod-github-runner-207 kernel: [71448.556502] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 01:14:34 juju-e4d256-prod-github-runner-207 kernel: [71448.557732] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:14:34 juju-e4d256-prod-github-runner-207 kernel: [71448.558802] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 01:14:34 juju-e4d256-prod-github-runner-207 kernel: [71448.561347] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 01:14:34 juju-e4d256-prod-github-runner-207 kernel: [71448.562387] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 01:14:34 juju-e4d256-prod-github-runner-207 kernel: [71448.563561] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 01:14:34 juju-e4d256-prod-github-runner-207 kernel: [71448.564716] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 01:14:34 juju-e4d256-prod-github-runner-207 kernel: [71448.565872] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 01:14:34 juju-e4d256-prod-github-runner-207 kernel: [71448.567041] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 01:14:34 juju-e4d256-prod-github-runner-207 kernel: [71448.568209] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 01:14:34 juju-e4d256-prod-github-runner-207 kernel: [71448.569436] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 01:14:34 juju-e4d256-prod-github-runner-207 kernel: [71448.570529] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 01:14:34 juju-e4d256-prod-github-runner-207 kernel: [71448.571728] Call Trace: Aug 23 01:14:34 juju-e4d256-prod-github-runner-207 kernel: [71448.572644] Aug 23 01:14:34 juju-e4d256-prod-github-runner-207 kernel: [71448.573527] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:14:34 juju-e4d256-prod-github-runner-207 kernel: [71448.574555] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:14:34 juju-e4d256-prod-github-runner-207 kernel: [71448.575583] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:14:34 juju-e4d256-prod-github-runner-207 kernel: [71448.576653] ? show_regs.part.0+0x23/0x29 Aug 23 01:14:34 juju-e4d256-prod-github-runner-207 kernel: [71448.577649] ? show_regs.cold+0x8/0xd Aug 23 01:14:34 juju-e4d256-prod-github-runner-207 kernel: [71448.578623] ? watchdog_timer_fn+0x1be/0x220 Aug 23 01:14:34 juju-e4d256-prod-github-runner-207 kernel: [71448.579637] ? lockup_detector_update_enable+0x60/0x60 Aug 23 01:14:34 juju-e4d256-prod-github-runner-207 kernel: [71448.580712] ? __hrtimer_run_queues+0x107/0x230 Aug 23 01:14:34 juju-e4d256-prod-github-runner-207 kernel: [71448.581745] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 01:14:34 juju-e4d256-prod-github-runner-207 kernel: [71448.582776] ? hrtimer_interrupt+0x101/0x220 Aug 23 01:14:34 juju-e4d256-prod-github-runner-207 kernel: [71448.583789] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 01:14:34 juju-e4d256-prod-github-runner-207 kernel: [71448.584853] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 01:14:34 juju-e4d256-prod-github-runner-207 kernel: [71448.585895] Aug 23 01:14:34 juju-e4d256-prod-github-runner-207 kernel: [71448.586757] Aug 23 01:14:34 juju-e4d256-prod-github-runner-207 kernel: [71448.587595] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 01:14:34 juju-e4d256-prod-github-runner-207 kernel: [71448.588629] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:14:34 juju-e4d256-prod-github-runner-207 kernel: [71448.589666] ? _raw_spin_lock+0x22/0x30 Aug 23 01:14:34 juju-e4d256-prod-github-runner-207 kernel: [71448.590613] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:14:34 juju-e4d256-prod-github-runner-207 kernel: [71448.591638] direct_page_fault+0x206/0x310 [kvm] Aug 23 01:14:34 juju-e4d256-prod-github-runner-207 kernel: [71448.592660] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 01:14:34 juju-e4d256-prod-github-runner-207 kernel: [71448.593666] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 01:14:34 juju-e4d256-prod-github-runner-207 kernel: [71448.594676] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 01:14:34 juju-e4d256-prod-github-runner-207 kernel: [71448.595644] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 01:14:34 juju-e4d256-prod-github-runner-207 kernel: [71448.596586] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 01:14:34 juju-e4d256-prod-github-runner-207 kernel: [71448.597567] handle_exit+0x98/0x230 [kvm_amd] Aug 23 01:14:34 juju-e4d256-prod-github-runner-207 kernel: [71448.598457] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 01:14:34 juju-e4d256-prod-github-runner-207 kernel: [71448.599373] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 01:14:34 juju-e4d256-prod-github-runner-207 kernel: [71448.600300] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 01:14:34 juju-e4d256-prod-github-runner-207 kernel: [71448.601201] vcpu_run+0x62/0x2c0 [kvm] Aug 23 01:14:34 juju-e4d256-prod-github-runner-207 kernel: [71448.602011] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 01:14:34 juju-e4d256-prod-github-runner-207 kernel: [71448.602824] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 01:14:34 juju-e4d256-prod-github-runner-207 kernel: [71448.603676] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 01:14:34 juju-e4d256-prod-github-runner-207 kernel: [71448.604471] ? __seccomp_filter+0x4a/0x4a0 Aug 23 01:14:34 juju-e4d256-prod-github-runner-207 kernel: [71448.605212] ? __fget_files+0x86/0xc0 Aug 23 01:14:34 juju-e4d256-prod-github-runner-207 kernel: [71448.605915] __x64_sys_ioctl+0x95/0xd0 Aug 23 01:14:34 juju-e4d256-prod-github-runner-207 kernel: [71448.606605] do_syscall_64+0x5c/0xc0 Aug 23 01:14:34 juju-e4d256-prod-github-runner-207 kernel: [71448.607274] ? do_futex+0x162/0x1f0 Aug 23 01:14:34 juju-e4d256-prod-github-runner-207 kernel: [71448.607923] ? __x64_sys_futex+0x78/0x1e0 Aug 23 01:14:34 juju-e4d256-prod-github-runner-207 kernel: [71448.608595] ? __secure_computing+0xa9/0x120 Aug 23 01:14:34 juju-e4d256-prod-github-runner-207 kernel: [71448.609288] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 01:14:34 juju-e4d256-prod-github-runner-207 kernel: [71448.610047] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:14:34 juju-e4d256-prod-github-runner-207 kernel: [71448.610796] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:14:34 juju-e4d256-prod-github-runner-207 kernel: [71448.611515] ? do_syscall_64+0x69/0xc0 Aug 23 01:14:34 juju-e4d256-prod-github-runner-207 kernel: [71448.612159] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:14:34 juju-e4d256-prod-github-runner-207 kernel: [71448.612873] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:14:34 juju-e4d256-prod-github-runner-207 kernel: [71448.613567] ? do_syscall_64+0x69/0xc0 Aug 23 01:14:34 juju-e4d256-prod-github-runner-207 kernel: [71448.614192] ? do_syscall_64+0x69/0xc0 Aug 23 01:14:34 juju-e4d256-prod-github-runner-207 kernel: [71448.614819] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 01:14:34 juju-e4d256-prod-github-runner-207 kernel: [71448.615523] RIP: 0033:0x7faa5d0edaff Aug 23 01:14:34 juju-e4d256-prod-github-runner-207 kernel: [71448.616181] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 01:14:34 juju-e4d256-prod-github-runner-207 kernel: [71448.618165] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 01:14:34 juju-e4d256-prod-github-runner-207 kernel: [71448.619087] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 01:14:34 juju-e4d256-prod-github-runner-207 kernel: [71448.619978] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 01:14:34 juju-e4d256-prod-github-runner-207 kernel: [71448.620865] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 01:14:34 juju-e4d256-prod-github-runner-207 kernel: [71448.621752] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 01:14:34 juju-e4d256-prod-github-runner-207 kernel: [71448.622655] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 01:14:34 juju-e4d256-prod-github-runner-207 kernel: [71448.623548] Aug 23 01:14:48 juju-e4d256-prod-github-runner-207 kernel: [71461.952706] rcu: INFO: rcu_sched self-detected stall on CPU Aug 23 01:14:48 juju-e4d256-prod-github-runner-207 kernel: [71461.953670] rcu: 1-....: (17780028 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=8588415 Aug 23 01:14:48 juju-e4d256-prod-github-runner-207 kernel: [71461.954804] (t=17836188 jiffies g=23269 q=61232) Aug 23 01:14:48 juju-e4d256-prod-github-runner-207 kernel: [71461.955591] NMI backtrace for cpu 1 Aug 23 01:14:48 juju-e4d256-prod-github-runner-207 kernel: [71461.956304] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 01:14:48 juju-e4d256-prod-github-runner-207 kernel: [71461.957426] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 01:14:48 juju-e4d256-prod-github-runner-207 kernel: [71461.958592] Call Trace: Aug 23 01:14:48 juju-e4d256-prod-github-runner-207 kernel: [71461.959268] Aug 23 01:14:48 juju-e4d256-prod-github-runner-207 kernel: [71461.959931] show_stack+0x52/0x5c Aug 23 01:14:48 juju-e4d256-prod-github-runner-207 kernel: [71461.960669] dump_stack_lvl+0x4a/0x63 Aug 23 01:14:48 juju-e4d256-prod-github-runner-207 kernel: [71461.961421] dump_stack+0x10/0x16 Aug 23 01:14:48 juju-e4d256-prod-github-runner-207 kernel: [71461.962144] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 23 01:14:48 juju-e4d256-prod-github-runner-207 kernel: [71461.962935] ? lapic_can_unplug_cpu+0x90/0x90 Aug 23 01:14:48 juju-e4d256-prod-github-runner-207 kernel: [71461.963715] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 23 01:14:48 juju-e4d256-prod-github-runner-207 kernel: [71461.964533] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 23 01:14:48 juju-e4d256-prod-github-runner-207 kernel: [71461.965353] trigger_single_cpu_backtrace+0x44/0x4f Aug 23 01:14:48 juju-e4d256-prod-github-runner-207 kernel: [71461.966166] rcu_dump_cpu_stacks+0x102/0x149 Aug 23 01:14:48 juju-e4d256-prod-github-runner-207 kernel: [71461.966946] print_cpu_stall.cold+0x2f/0xe2 Aug 23 01:14:48 juju-e4d256-prod-github-runner-207 kernel: [71461.967709] ? timekeeping_update+0xf7/0x150 Aug 23 01:14:48 juju-e4d256-prod-github-runner-207 kernel: [71461.968479] check_cpu_stall+0x109/0x270 Aug 23 01:14:48 juju-e4d256-prod-github-runner-207 kernel: [71461.969233] rcu_sched_clock_irq+0x9a/0x250 Aug 23 01:14:48 juju-e4d256-prod-github-runner-207 kernel: [71461.969992] update_process_times+0x94/0xd0 Aug 23 01:14:48 juju-e4d256-prod-github-runner-207 kernel: [71461.970759] tick_sched_handle+0x29/0x70 Aug 23 01:14:48 juju-e4d256-prod-github-runner-207 kernel: [71461.971505] tick_sched_timer+0x8c/0xc0 Aug 23 01:14:48 juju-e4d256-prod-github-runner-207 kernel: [71461.972247] ? tick_nohz_handler+0xb0/0xb0 Aug 23 01:14:48 juju-e4d256-prod-github-runner-207 kernel: [71461.973000] __hrtimer_run_queues+0x107/0x230 Aug 23 01:14:48 juju-e4d256-prod-github-runner-207 kernel: [71461.973773] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 01:14:48 juju-e4d256-prod-github-runner-207 kernel: [71461.974558] hrtimer_interrupt+0x101/0x220 Aug 23 01:14:48 juju-e4d256-prod-github-runner-207 kernel: [71461.975441] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 01:14:48 juju-e4d256-prod-github-runner-207 kernel: [71461.976253] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 01:14:48 juju-e4d256-prod-github-runner-207 kernel: [71461.977052] Aug 23 01:14:48 juju-e4d256-prod-github-runner-207 kernel: [71461.977687] Aug 23 01:14:48 juju-e4d256-prod-github-runner-207 kernel: [71461.978320] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 01:14:48 juju-e4d256-prod-github-runner-207 kernel: [71461.979145] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:14:48 juju-e4d256-prod-github-runner-207 kernel: [71461.980025] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 01:14:48 juju-e4d256-prod-github-runner-207 kernel: [71461.982227] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 01:14:48 juju-e4d256-prod-github-runner-207 kernel: [71461.983113] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 01:14:48 juju-e4d256-prod-github-runner-207 kernel: [71461.984106] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 01:14:48 juju-e4d256-prod-github-runner-207 kernel: [71461.985085] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 01:14:48 juju-e4d256-prod-github-runner-207 kernel: [71461.986048] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 01:14:48 juju-e4d256-prod-github-runner-207 kernel: [71461.987010] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 01:14:48 juju-e4d256-prod-github-runner-207 kernel: [71461.987964] ? _raw_spin_lock+0x22/0x30 Aug 23 01:14:48 juju-e4d256-prod-github-runner-207 kernel: [71461.988722] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:14:48 juju-e4d256-prod-github-runner-207 kernel: [71461.989561] direct_page_fault+0x206/0x310 [kvm] Aug 23 01:14:48 juju-e4d256-prod-github-runner-207 kernel: [71461.990408] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 01:14:48 juju-e4d256-prod-github-runner-207 kernel: [71461.991255] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 01:14:48 juju-e4d256-prod-github-runner-207 kernel: [71461.992076] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 01:14:48 juju-e4d256-prod-github-runner-207 kernel: [71461.992877] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 01:14:48 juju-e4d256-prod-github-runner-207 kernel: [71461.993663] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 01:14:48 juju-e4d256-prod-github-runner-207 kernel: [71461.994495] handle_exit+0x98/0x230 [kvm_amd] Aug 23 01:14:48 juju-e4d256-prod-github-runner-207 kernel: [71461.995253] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 01:14:48 juju-e4d256-prod-github-runner-207 kernel: [71461.996039] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 01:14:48 juju-e4d256-prod-github-runner-207 kernel: [71461.996836] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 01:14:48 juju-e4d256-prod-github-runner-207 kernel: [71461.997621] vcpu_run+0x62/0x2c0 [kvm] Aug 23 01:14:48 juju-e4d256-prod-github-runner-207 kernel: [71461.998341] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 01:14:48 juju-e4d256-prod-github-runner-207 kernel: [71461.999084] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 01:14:48 juju-e4d256-prod-github-runner-207 kernel: [71461.999884] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 01:14:48 juju-e4d256-prod-github-runner-207 kernel: [71462.000641] ? __seccomp_filter+0x4a/0x4a0 Aug 23 01:14:48 juju-e4d256-prod-github-runner-207 kernel: [71462.001365] ? __fget_files+0x86/0xc0 Aug 23 01:14:48 juju-e4d256-prod-github-runner-207 kernel: [71462.002055] __x64_sys_ioctl+0x95/0xd0 Aug 23 01:14:48 juju-e4d256-prod-github-runner-207 kernel: [71462.002760] do_syscall_64+0x5c/0xc0 Aug 23 01:14:48 juju-e4d256-prod-github-runner-207 kernel: [71462.003441] ? do_futex+0x162/0x1f0 Aug 23 01:14:48 juju-e4d256-prod-github-runner-207 kernel: [71462.004113] ? __x64_sys_futex+0x78/0x1e0 Aug 23 01:14:48 juju-e4d256-prod-github-runner-207 kernel: [71462.004815] ? __secure_computing+0xa9/0x120 Aug 23 01:14:48 juju-e4d256-prod-github-runner-207 kernel: [71462.005531] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 01:14:48 juju-e4d256-prod-github-runner-207 kernel: [71462.006319] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:14:48 juju-e4d256-prod-github-runner-207 kernel: [71462.007089] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:14:48 juju-e4d256-prod-github-runner-207 kernel: [71462.007840] ? do_syscall_64+0x69/0xc0 Aug 23 01:14:48 juju-e4d256-prod-github-runner-207 kernel: [71462.008531] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:14:48 juju-e4d256-prod-github-runner-207 kernel: [71462.009284] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:14:48 juju-e4d256-prod-github-runner-207 kernel: [71462.010045] ? do_syscall_64+0x69/0xc0 Aug 23 01:14:48 juju-e4d256-prod-github-runner-207 kernel: [71462.010746] ? do_syscall_64+0x69/0xc0 Aug 23 01:14:48 juju-e4d256-prod-github-runner-207 kernel: [71462.011433] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 01:14:48 juju-e4d256-prod-github-runner-207 kernel: [71462.012202] RIP: 0033:0x7faa5d0edaff Aug 23 01:14:48 juju-e4d256-prod-github-runner-207 kernel: [71462.012885] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 01:14:48 juju-e4d256-prod-github-runner-207 kernel: [71462.014991] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 01:14:48 juju-e4d256-prod-github-runner-207 kernel: [71462.015953] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 01:14:48 juju-e4d256-prod-github-runner-207 kernel: [71462.016898] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 01:14:48 juju-e4d256-prod-github-runner-207 kernel: [71462.017844] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 01:14:48 juju-e4d256-prod-github-runner-207 kernel: [71462.018792] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 01:14:48 juju-e4d256-prod-github-runner-207 kernel: [71462.019717] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 01:14:48 juju-e4d256-prod-github-runner-207 kernel: [71462.020638] Aug 23 01:15:14 juju-e4d256-prod-github-runner-207 kernel: [71488.541981] watchdog: BUG: soft lockup - CPU#1 stuck for 66470s! [qemu-system-x86:6715] Aug 23 01:15:14 juju-e4d256-prod-github-runner-207 kernel: [71488.543116] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 01:15:14 juju-e4d256-prod-github-runner-207 kernel: [71488.543188] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 01:15:14 juju-e4d256-prod-github-runner-207 kernel: [71488.555261] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 01:15:14 juju-e4d256-prod-github-runner-207 kernel: [71488.556535] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 01:15:14 juju-e4d256-prod-github-runner-207 kernel: [71488.557754] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:15:14 juju-e4d256-prod-github-runner-207 kernel: [71488.558822] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 01:15:14 juju-e4d256-prod-github-runner-207 kernel: [71488.561371] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 01:15:14 juju-e4d256-prod-github-runner-207 kernel: [71488.562442] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 01:15:14 juju-e4d256-prod-github-runner-207 kernel: [71488.563601] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 01:15:14 juju-e4d256-prod-github-runner-207 kernel: [71488.564760] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 01:15:14 juju-e4d256-prod-github-runner-207 kernel: [71488.565924] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 01:15:14 juju-e4d256-prod-github-runner-207 kernel: [71488.567107] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 01:15:14 juju-e4d256-prod-github-runner-207 kernel: [71488.568275] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 01:15:14 juju-e4d256-prod-github-runner-207 kernel: [71488.569505] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 01:15:14 juju-e4d256-prod-github-runner-207 kernel: [71488.570611] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 01:15:14 juju-e4d256-prod-github-runner-207 kernel: [71488.571818] Call Trace: Aug 23 01:15:14 juju-e4d256-prod-github-runner-207 kernel: [71488.572730] Aug 23 01:15:14 juju-e4d256-prod-github-runner-207 kernel: [71488.573613] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:15:14 juju-e4d256-prod-github-runner-207 kernel: [71488.574657] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:15:14 juju-e4d256-prod-github-runner-207 kernel: [71488.575676] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:15:14 juju-e4d256-prod-github-runner-207 kernel: [71488.576769] ? show_regs.part.0+0x23/0x29 Aug 23 01:15:14 juju-e4d256-prod-github-runner-207 kernel: [71488.577766] ? show_regs.cold+0x8/0xd Aug 23 01:15:14 juju-e4d256-prod-github-runner-207 kernel: [71488.578758] ? watchdog_timer_fn+0x1be/0x220 Aug 23 01:15:14 juju-e4d256-prod-github-runner-207 kernel: [71488.579764] ? lockup_detector_update_enable+0x60/0x60 Aug 23 01:15:14 juju-e4d256-prod-github-runner-207 kernel: [71488.580825] ? __hrtimer_run_queues+0x107/0x230 Aug 23 01:15:14 juju-e4d256-prod-github-runner-207 kernel: [71488.581852] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 01:15:14 juju-e4d256-prod-github-runner-207 kernel: [71488.582889] ? hrtimer_interrupt+0x101/0x220 Aug 23 01:15:14 juju-e4d256-prod-github-runner-207 kernel: [71488.583902] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 01:15:14 juju-e4d256-prod-github-runner-207 kernel: [71488.584993] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 01:15:14 juju-e4d256-prod-github-runner-207 kernel: [71488.586048] Aug 23 01:15:14 juju-e4d256-prod-github-runner-207 kernel: [71488.586912] Aug 23 01:15:14 juju-e4d256-prod-github-runner-207 kernel: [71488.587753] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 01:15:14 juju-e4d256-prod-github-runner-207 kernel: [71488.588784] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:15:14 juju-e4d256-prod-github-runner-207 kernel: [71488.589819] ? _raw_spin_lock+0x22/0x30 Aug 23 01:15:14 juju-e4d256-prod-github-runner-207 kernel: [71488.590774] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:15:14 juju-e4d256-prod-github-runner-207 kernel: [71488.591790] direct_page_fault+0x206/0x310 [kvm] Aug 23 01:15:14 juju-e4d256-prod-github-runner-207 kernel: [71488.592813] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 01:15:14 juju-e4d256-prod-github-runner-207 kernel: [71488.593821] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 01:15:14 juju-e4d256-prod-github-runner-207 kernel: [71488.594967] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 01:15:14 juju-e4d256-prod-github-runner-207 kernel: [71488.595940] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 01:15:14 juju-e4d256-prod-github-runner-207 kernel: [71488.596884] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 01:15:14 juju-e4d256-prod-github-runner-207 kernel: [71488.597866] handle_exit+0x98/0x230 [kvm_amd] Aug 23 01:15:14 juju-e4d256-prod-github-runner-207 kernel: [71488.598777] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 01:15:14 juju-e4d256-prod-github-runner-207 kernel: [71488.599696] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 01:15:14 juju-e4d256-prod-github-runner-207 kernel: [71488.600624] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 01:15:14 juju-e4d256-prod-github-runner-207 kernel: [71488.601582] vcpu_run+0x62/0x2c0 [kvm] Aug 23 01:15:14 juju-e4d256-prod-github-runner-207 kernel: [71488.602430] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 01:15:14 juju-e4d256-prod-github-runner-207 kernel: [71488.603243] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 01:15:14 juju-e4d256-prod-github-runner-207 kernel: [71488.604096] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 01:15:14 juju-e4d256-prod-github-runner-207 kernel: [71488.604896] ? __seccomp_filter+0x4a/0x4a0 Aug 23 01:15:14 juju-e4d256-prod-github-runner-207 kernel: [71488.605642] ? __fget_files+0x86/0xc0 Aug 23 01:15:14 juju-e4d256-prod-github-runner-207 kernel: [71488.606362] __x64_sys_ioctl+0x95/0xd0 Aug 23 01:15:14 juju-e4d256-prod-github-runner-207 kernel: [71488.607055] do_syscall_64+0x5c/0xc0 Aug 23 01:15:14 juju-e4d256-prod-github-runner-207 kernel: [71488.607719] ? do_futex+0x162/0x1f0 Aug 23 01:15:14 juju-e4d256-prod-github-runner-207 kernel: [71488.608367] ? __x64_sys_futex+0x78/0x1e0 Aug 23 01:15:14 juju-e4d256-prod-github-runner-207 kernel: [71488.609037] ? __secure_computing+0xa9/0x120 Aug 23 01:15:14 juju-e4d256-prod-github-runner-207 kernel: [71488.609729] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 01:15:14 juju-e4d256-prod-github-runner-207 kernel: [71488.610495] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:15:14 juju-e4d256-prod-github-runner-207 kernel: [71488.611215] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:15:14 juju-e4d256-prod-github-runner-207 kernel: [71488.611929] ? do_syscall_64+0x69/0xc0 Aug 23 01:15:14 juju-e4d256-prod-github-runner-207 kernel: [71488.612578] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:15:14 juju-e4d256-prod-github-runner-207 kernel: [71488.613281] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:15:14 juju-e4d256-prod-github-runner-207 kernel: [71488.613974] ? do_syscall_64+0x69/0xc0 Aug 23 01:15:14 juju-e4d256-prod-github-runner-207 kernel: [71488.614612] ? do_syscall_64+0x69/0xc0 Aug 23 01:15:14 juju-e4d256-prod-github-runner-207 kernel: [71488.615269] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 01:15:14 juju-e4d256-prod-github-runner-207 kernel: [71488.616162] RIP: 0033:0x7faa5d0edaff Aug 23 01:15:14 juju-e4d256-prod-github-runner-207 kernel: [71488.616786] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 01:15:14 juju-e4d256-prod-github-runner-207 kernel: [71488.618794] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 01:15:14 juju-e4d256-prod-github-runner-207 kernel: [71488.619702] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 01:15:14 juju-e4d256-prod-github-runner-207 kernel: [71488.620594] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 01:15:14 juju-e4d256-prod-github-runner-207 kernel: [71488.621481] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 01:15:14 juju-e4d256-prod-github-runner-207 kernel: [71488.622395] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 01:15:14 juju-e4d256-prod-github-runner-207 kernel: [71488.623289] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 01:15:14 juju-e4d256-prod-github-runner-207 kernel: [71488.624181] Aug 23 01:15:42 juju-e4d256-prod-github-runner-207 kernel: [71516.541980] watchdog: BUG: soft lockup - CPU#1 stuck for 66496s! [qemu-system-x86:6715] Aug 23 01:15:42 juju-e4d256-prod-github-runner-207 kernel: [71516.543892] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 01:15:42 juju-e4d256-prod-github-runner-207 kernel: [71516.544155] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 01:15:42 juju-e4d256-prod-github-runner-207 kernel: [71516.556537] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 01:15:42 juju-e4d256-prod-github-runner-207 kernel: [71516.557814] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 01:15:42 juju-e4d256-prod-github-runner-207 kernel: [71516.559049] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:15:42 juju-e4d256-prod-github-runner-207 kernel: [71516.560114] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 01:15:42 juju-e4d256-prod-github-runner-207 kernel: [71516.562702] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 01:15:42 juju-e4d256-prod-github-runner-207 kernel: [71516.563747] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 01:15:42 juju-e4d256-prod-github-runner-207 kernel: [71516.564911] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 01:15:42 juju-e4d256-prod-github-runner-207 kernel: [71516.566097] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 01:15:42 juju-e4d256-prod-github-runner-207 kernel: [71516.567262] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 01:15:42 juju-e4d256-prod-github-runner-207 kernel: [71516.568465] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 01:15:42 juju-e4d256-prod-github-runner-207 kernel: [71516.569770] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 01:15:42 juju-e4d256-prod-github-runner-207 kernel: [71516.571046] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 01:15:42 juju-e4d256-prod-github-runner-207 kernel: [71516.572153] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 01:15:42 juju-e4d256-prod-github-runner-207 kernel: [71516.573357] Call Trace: Aug 23 01:15:42 juju-e4d256-prod-github-runner-207 kernel: [71516.574294] Aug 23 01:15:42 juju-e4d256-prod-github-runner-207 kernel: [71516.575200] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:15:42 juju-e4d256-prod-github-runner-207 kernel: [71516.576241] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:15:42 juju-e4d256-prod-github-runner-207 kernel: [71516.577271] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:15:42 juju-e4d256-prod-github-runner-207 kernel: [71516.578384] ? show_regs.part.0+0x23/0x29 Aug 23 01:15:42 juju-e4d256-prod-github-runner-207 kernel: [71516.579457] ? show_regs.cold+0x8/0xd Aug 23 01:15:42 juju-e4d256-prod-github-runner-207 kernel: [71516.580502] ? watchdog_timer_fn+0x1be/0x220 Aug 23 01:15:42 juju-e4d256-prod-github-runner-207 kernel: [71516.581522] ? lockup_detector_update_enable+0x60/0x60 Aug 23 01:15:42 juju-e4d256-prod-github-runner-207 kernel: [71516.582624] ? __hrtimer_run_queues+0x107/0x230 Aug 23 01:15:42 juju-e4d256-prod-github-runner-207 kernel: [71516.583662] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 01:15:42 juju-e4d256-prod-github-runner-207 kernel: [71516.584690] ? hrtimer_interrupt+0x101/0x220 Aug 23 01:15:42 juju-e4d256-prod-github-runner-207 kernel: [71516.585724] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 01:15:42 juju-e4d256-prod-github-runner-207 kernel: [71516.586808] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 01:15:42 juju-e4d256-prod-github-runner-207 kernel: [71516.588008] Aug 23 01:15:42 juju-e4d256-prod-github-runner-207 kernel: [71516.588876] Aug 23 01:15:42 juju-e4d256-prod-github-runner-207 kernel: [71516.589715] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 01:15:42 juju-e4d256-prod-github-runner-207 kernel: [71516.590845] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:15:42 juju-e4d256-prod-github-runner-207 kernel: [71516.591924] ? _raw_spin_lock+0x22/0x30 Aug 23 01:15:42 juju-e4d256-prod-github-runner-207 kernel: [71516.592870] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:15:42 juju-e4d256-prod-github-runner-207 kernel: [71516.593992] direct_page_fault+0x206/0x310 [kvm] Aug 23 01:15:42 juju-e4d256-prod-github-runner-207 kernel: [71516.595113] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 01:15:42 juju-e4d256-prod-github-runner-207 kernel: [71516.596148] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 01:15:42 juju-e4d256-prod-github-runner-207 kernel: [71516.597150] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 01:15:42 juju-e4d256-prod-github-runner-207 kernel: [71516.598252] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 01:15:42 juju-e4d256-prod-github-runner-207 kernel: [71516.599231] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 01:15:42 juju-e4d256-prod-github-runner-207 kernel: [71516.600268] handle_exit+0x98/0x230 [kvm_amd] Aug 23 01:15:42 juju-e4d256-prod-github-runner-207 kernel: [71516.601169] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 01:15:42 juju-e4d256-prod-github-runner-207 kernel: [71516.602110] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 01:15:42 juju-e4d256-prod-github-runner-207 kernel: [71516.603037] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 01:15:42 juju-e4d256-prod-github-runner-207 kernel: [71516.603947] vcpu_run+0x62/0x2c0 [kvm] Aug 23 01:15:42 juju-e4d256-prod-github-runner-207 kernel: [71516.604758] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 01:15:42 juju-e4d256-prod-github-runner-207 kernel: [71516.605567] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 01:15:42 juju-e4d256-prod-github-runner-207 kernel: [71516.606434] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 01:15:42 juju-e4d256-prod-github-runner-207 kernel: [71516.607246] ? __seccomp_filter+0x4a/0x4a0 Aug 23 01:15:42 juju-e4d256-prod-github-runner-207 kernel: [71516.607997] ? __fget_files+0x86/0xc0 Aug 23 01:15:42 juju-e4d256-prod-github-runner-207 kernel: [71516.608699] __x64_sys_ioctl+0x95/0xd0 Aug 23 01:15:42 juju-e4d256-prod-github-runner-207 kernel: [71516.609466] do_syscall_64+0x5c/0xc0 Aug 23 01:15:42 juju-e4d256-prod-github-runner-207 kernel: [71516.610188] ? do_futex+0x162/0x1f0 Aug 23 01:15:42 juju-e4d256-prod-github-runner-207 kernel: [71516.610840] ? __x64_sys_futex+0x78/0x1e0 Aug 23 01:15:42 juju-e4d256-prod-github-runner-207 kernel: [71516.611513] ? __secure_computing+0xa9/0x120 Aug 23 01:15:42 juju-e4d256-prod-github-runner-207 kernel: [71516.612294] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 01:15:42 juju-e4d256-prod-github-runner-207 kernel: [71516.613069] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:15:42 juju-e4d256-prod-github-runner-207 kernel: [71516.613873] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:15:42 juju-e4d256-prod-github-runner-207 kernel: [71516.614693] ? do_syscall_64+0x69/0xc0 Aug 23 01:15:42 juju-e4d256-prod-github-runner-207 kernel: [71516.615375] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:15:42 juju-e4d256-prod-github-runner-207 kernel: [71516.616212] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:15:42 juju-e4d256-prod-github-runner-207 kernel: [71516.616944] ? do_syscall_64+0x69/0xc0 Aug 23 01:15:42 juju-e4d256-prod-github-runner-207 kernel: [71516.617576] ? do_syscall_64+0x69/0xc0 Aug 23 01:15:42 juju-e4d256-prod-github-runner-207 kernel: [71516.618222] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 01:15:42 juju-e4d256-prod-github-runner-207 kernel: [71516.619084] RIP: 0033:0x7faa5d0edaff Aug 23 01:15:42 juju-e4d256-prod-github-runner-207 kernel: [71516.619916] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 01:15:42 juju-e4d256-prod-github-runner-207 kernel: [71516.622020] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 01:15:42 juju-e4d256-prod-github-runner-207 kernel: [71516.622988] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 01:15:42 juju-e4d256-prod-github-runner-207 kernel: [71516.623919] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 01:15:42 juju-e4d256-prod-github-runner-207 kernel: [71516.624959] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 01:15:42 juju-e4d256-prod-github-runner-207 kernel: [71516.625912] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 01:15:42 juju-e4d256-prod-github-runner-207 kernel: [71516.626829] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 01:15:42 juju-e4d256-prod-github-runner-207 kernel: [71516.627748] Aug 23 01:16:10 juju-e4d256-prod-github-runner-207 kernel: [71544.541976] watchdog: BUG: soft lockup - CPU#1 stuck for 66523s! [qemu-system-x86:6715] Aug 23 01:16:10 juju-e4d256-prod-github-runner-207 kernel: [71544.543089] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 01:16:10 juju-e4d256-prod-github-runner-207 kernel: [71544.543155] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 01:16:10 juju-e4d256-prod-github-runner-207 kernel: [71544.555469] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 01:16:10 juju-e4d256-prod-github-runner-207 kernel: [71544.556738] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 01:16:10 juju-e4d256-prod-github-runner-207 kernel: [71544.557980] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:16:10 juju-e4d256-prod-github-runner-207 kernel: [71544.559038] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 01:16:10 juju-e4d256-prod-github-runner-207 kernel: [71544.561603] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 01:16:10 juju-e4d256-prod-github-runner-207 kernel: [71544.562643] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 01:16:10 juju-e4d256-prod-github-runner-207 kernel: [71544.563803] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 01:16:10 juju-e4d256-prod-github-runner-207 kernel: [71544.564966] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 01:16:10 juju-e4d256-prod-github-runner-207 kernel: [71544.566146] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 01:16:10 juju-e4d256-prod-github-runner-207 kernel: [71544.567307] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 01:16:10 juju-e4d256-prod-github-runner-207 kernel: [71544.568472] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 01:16:10 juju-e4d256-prod-github-runner-207 kernel: [71544.569746] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 01:16:10 juju-e4d256-prod-github-runner-207 kernel: [71544.570856] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 01:16:10 juju-e4d256-prod-github-runner-207 kernel: [71544.572053] Call Trace: Aug 23 01:16:10 juju-e4d256-prod-github-runner-207 kernel: [71544.572968] Aug 23 01:16:10 juju-e4d256-prod-github-runner-207 kernel: [71544.573869] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:16:10 juju-e4d256-prod-github-runner-207 kernel: [71544.574904] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:16:10 juju-e4d256-prod-github-runner-207 kernel: [71544.575935] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:16:10 juju-e4d256-prod-github-runner-207 kernel: [71544.577013] ? show_regs.part.0+0x23/0x29 Aug 23 01:16:10 juju-e4d256-prod-github-runner-207 kernel: [71544.578143] ? show_regs.cold+0x8/0xd Aug 23 01:16:10 juju-e4d256-prod-github-runner-207 kernel: [71544.579188] ? watchdog_timer_fn+0x1be/0x220 Aug 23 01:16:10 juju-e4d256-prod-github-runner-207 kernel: [71544.580280] ? lockup_detector_update_enable+0x60/0x60 Aug 23 01:16:10 juju-e4d256-prod-github-runner-207 kernel: [71544.581447] ? __hrtimer_run_queues+0x107/0x230 Aug 23 01:16:10 juju-e4d256-prod-github-runner-207 kernel: [71544.582579] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 01:16:10 juju-e4d256-prod-github-runner-207 kernel: [71544.583687] ? hrtimer_interrupt+0x101/0x220 Aug 23 01:16:10 juju-e4d256-prod-github-runner-207 kernel: [71544.584811] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 01:16:10 juju-e4d256-prod-github-runner-207 kernel: [71544.586019] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 01:16:10 juju-e4d256-prod-github-runner-207 kernel: [71544.587160] Aug 23 01:16:10 juju-e4d256-prod-github-runner-207 kernel: [71544.588062] Aug 23 01:16:10 juju-e4d256-prod-github-runner-207 kernel: [71544.588955] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 01:16:10 juju-e4d256-prod-github-runner-207 kernel: [71544.590105] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:16:10 juju-e4d256-prod-github-runner-207 kernel: [71544.591251] ? _raw_spin_lock+0x22/0x30 Aug 23 01:16:10 juju-e4d256-prod-github-runner-207 kernel: [71544.592292] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:16:10 juju-e4d256-prod-github-runner-207 kernel: [71544.593402] direct_page_fault+0x206/0x310 [kvm] Aug 23 01:16:10 juju-e4d256-prod-github-runner-207 kernel: [71544.594528] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 01:16:10 juju-e4d256-prod-github-runner-207 kernel: [71544.595633] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 01:16:10 juju-e4d256-prod-github-runner-207 kernel: [71544.596727] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 01:16:10 juju-e4d256-prod-github-runner-207 kernel: [71544.597819] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 01:16:10 juju-e4d256-prod-github-runner-207 kernel: [71544.598854] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 01:16:10 juju-e4d256-prod-github-runner-207 kernel: [71544.599939] handle_exit+0x98/0x230 [kvm_amd] Aug 23 01:16:10 juju-e4d256-prod-github-runner-207 kernel: [71544.600922] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 01:16:10 juju-e4d256-prod-github-runner-207 kernel: [71544.601945] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 01:16:10 juju-e4d256-prod-github-runner-207 kernel: [71544.602962] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 01:16:10 juju-e4d256-prod-github-runner-207 kernel: [71544.603969] vcpu_run+0x62/0x2c0 [kvm] Aug 23 01:16:10 juju-e4d256-prod-github-runner-207 kernel: [71544.604860] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 01:16:10 juju-e4d256-prod-github-runner-207 kernel: [71544.605773] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 01:16:10 juju-e4d256-prod-github-runner-207 kernel: [71544.606725] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 01:16:10 juju-e4d256-prod-github-runner-207 kernel: [71544.607608] ? __seccomp_filter+0x4a/0x4a0 Aug 23 01:16:10 juju-e4d256-prod-github-runner-207 kernel: [71544.608425] ? __fget_files+0x86/0xc0 Aug 23 01:16:10 juju-e4d256-prod-github-runner-207 kernel: [71544.609206] __x64_sys_ioctl+0x95/0xd0 Aug 23 01:16:10 juju-e4d256-prod-github-runner-207 kernel: [71544.609984] do_syscall_64+0x5c/0xc0 Aug 23 01:16:10 juju-e4d256-prod-github-runner-207 kernel: [71544.610717] ? do_futex+0x162/0x1f0 Aug 23 01:16:10 juju-e4d256-prod-github-runner-207 kernel: [71544.611431] ? __x64_sys_futex+0x78/0x1e0 Aug 23 01:16:10 juju-e4d256-prod-github-runner-207 kernel: [71544.612185] ? __secure_computing+0xa9/0x120 Aug 23 01:16:10 juju-e4d256-prod-github-runner-207 kernel: [71544.612968] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 01:16:10 juju-e4d256-prod-github-runner-207 kernel: [71544.613875] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:16:10 juju-e4d256-prod-github-runner-207 kernel: [71544.614686] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:16:10 juju-e4d256-prod-github-runner-207 kernel: [71544.615497] ? do_syscall_64+0x69/0xc0 Aug 23 01:16:10 juju-e4d256-prod-github-runner-207 kernel: [71544.616214] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:16:10 juju-e4d256-prod-github-runner-207 kernel: [71544.617017] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:16:10 juju-e4d256-prod-github-runner-207 kernel: [71544.617820] ? do_syscall_64+0x69/0xc0 Aug 23 01:16:10 juju-e4d256-prod-github-runner-207 kernel: [71544.618519] ? do_syscall_64+0x69/0xc0 Aug 23 01:16:10 juju-e4d256-prod-github-runner-207 kernel: [71544.619214] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 01:16:10 juju-e4d256-prod-github-runner-207 kernel: [71544.620019] RIP: 0033:0x7faa5d0edaff Aug 23 01:16:10 juju-e4d256-prod-github-runner-207 kernel: [71544.620709] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 01:16:10 juju-e4d256-prod-github-runner-207 kernel: [71544.623048] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 01:16:10 juju-e4d256-prod-github-runner-207 kernel: [71544.624095] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 01:16:10 juju-e4d256-prod-github-runner-207 kernel: [71544.625116] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 01:16:10 juju-e4d256-prod-github-runner-207 kernel: [71544.626160] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 01:16:10 juju-e4d256-prod-github-runner-207 kernel: [71544.627191] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 01:16:10 juju-e4d256-prod-github-runner-207 kernel: [71544.628208] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 01:16:10 juju-e4d256-prod-github-runner-207 kernel: [71544.629234] Aug 23 01:16:38 juju-e4d256-prod-github-runner-207 kernel: [71572.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 66549s! [qemu-system-x86:6715] Aug 23 01:16:38 juju-e4d256-prod-github-runner-207 kernel: [71572.543125] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 01:16:38 juju-e4d256-prod-github-runner-207 kernel: [71572.543194] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 01:16:38 juju-e4d256-prod-github-runner-207 kernel: [71572.555498] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 01:16:38 juju-e4d256-prod-github-runner-207 kernel: [71572.556787] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 01:16:38 juju-e4d256-prod-github-runner-207 kernel: [71572.558051] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:16:38 juju-e4d256-prod-github-runner-207 kernel: [71572.559125] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 01:16:38 juju-e4d256-prod-github-runner-207 kernel: [71572.561744] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 01:16:38 juju-e4d256-prod-github-runner-207 kernel: [71572.562804] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 01:16:38 juju-e4d256-prod-github-runner-207 kernel: [71572.563996] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 01:16:38 juju-e4d256-prod-github-runner-207 kernel: [71572.565178] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 01:16:38 juju-e4d256-prod-github-runner-207 kernel: [71572.566370] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 01:16:38 juju-e4d256-prod-github-runner-207 kernel: [71572.567547] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 01:16:38 juju-e4d256-prod-github-runner-207 kernel: [71572.568877] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 01:16:38 juju-e4d256-prod-github-runner-207 kernel: [71572.570146] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 01:16:38 juju-e4d256-prod-github-runner-207 kernel: [71572.571264] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 01:16:38 juju-e4d256-prod-github-runner-207 kernel: [71572.572481] Call Trace: Aug 23 01:16:38 juju-e4d256-prod-github-runner-207 kernel: [71572.573460] Aug 23 01:16:38 juju-e4d256-prod-github-runner-207 kernel: [71572.574357] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:16:38 juju-e4d256-prod-github-runner-207 kernel: [71572.575393] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:16:38 juju-e4d256-prod-github-runner-207 kernel: [71572.576567] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:16:38 juju-e4d256-prod-github-runner-207 kernel: [71572.577674] ? show_regs.part.0+0x23/0x29 Aug 23 01:16:38 juju-e4d256-prod-github-runner-207 kernel: [71572.578688] ? show_regs.cold+0x8/0xd Aug 23 01:16:38 juju-e4d256-prod-github-runner-207 kernel: [71572.579673] ? watchdog_timer_fn+0x1be/0x220 Aug 23 01:16:38 juju-e4d256-prod-github-runner-207 kernel: [71572.580695] ? lockup_detector_update_enable+0x60/0x60 Aug 23 01:16:38 juju-e4d256-prod-github-runner-207 kernel: [71572.581794] ? __hrtimer_run_queues+0x107/0x230 Aug 23 01:16:38 juju-e4d256-prod-github-runner-207 kernel: [71572.582839] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 01:16:38 juju-e4d256-prod-github-runner-207 kernel: [71572.583877] ? hrtimer_interrupt+0x101/0x220 Aug 23 01:16:38 juju-e4d256-prod-github-runner-207 kernel: [71572.584907] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 01:16:38 juju-e4d256-prod-github-runner-207 kernel: [71572.586019] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 01:16:38 juju-e4d256-prod-github-runner-207 kernel: [71572.587085] Aug 23 01:16:38 juju-e4d256-prod-github-runner-207 kernel: [71572.587953] Aug 23 01:16:38 juju-e4d256-prod-github-runner-207 kernel: [71572.588801] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 01:16:38 juju-e4d256-prod-github-runner-207 kernel: [71572.589864] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:16:38 juju-e4d256-prod-github-runner-207 kernel: [71572.590919] ? _raw_spin_lock+0x22/0x30 Aug 23 01:16:38 juju-e4d256-prod-github-runner-207 kernel: [71572.591876] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:16:38 juju-e4d256-prod-github-runner-207 kernel: [71572.592912] direct_page_fault+0x206/0x310 [kvm] Aug 23 01:16:38 juju-e4d256-prod-github-runner-207 kernel: [71572.593967] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 01:16:38 juju-e4d256-prod-github-runner-207 kernel: [71572.595002] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 01:16:38 juju-e4d256-prod-github-runner-207 kernel: [71572.596020] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 01:16:38 juju-e4d256-prod-github-runner-207 kernel: [71572.597026] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 01:16:38 juju-e4d256-prod-github-runner-207 kernel: [71572.598028] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 01:16:38 juju-e4d256-prod-github-runner-207 kernel: [71572.599022] handle_exit+0x98/0x230 [kvm_amd] Aug 23 01:16:38 juju-e4d256-prod-github-runner-207 kernel: [71572.599916] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 01:16:38 juju-e4d256-prod-github-runner-207 kernel: [71572.600840] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 01:16:38 juju-e4d256-prod-github-runner-207 kernel: [71572.601784] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 01:16:38 juju-e4d256-prod-github-runner-207 kernel: [71572.602701] vcpu_run+0x62/0x2c0 [kvm] Aug 23 01:16:38 juju-e4d256-prod-github-runner-207 kernel: [71572.603524] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 01:16:38 juju-e4d256-prod-github-runner-207 kernel: [71572.604342] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 01:16:38 juju-e4d256-prod-github-runner-207 kernel: [71572.605231] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 01:16:38 juju-e4d256-prod-github-runner-207 kernel: [71572.606080] ? __seccomp_filter+0x4a/0x4a0 Aug 23 01:16:38 juju-e4d256-prod-github-runner-207 kernel: [71572.606835] ? __fget_files+0x86/0xc0 Aug 23 01:16:38 juju-e4d256-prod-github-runner-207 kernel: [71572.607574] __x64_sys_ioctl+0x95/0xd0 Aug 23 01:16:38 juju-e4d256-prod-github-runner-207 kernel: [71572.608280] do_syscall_64+0x5c/0xc0 Aug 23 01:16:38 juju-e4d256-prod-github-runner-207 kernel: [71572.608956] ? do_futex+0x162/0x1f0 Aug 23 01:16:38 juju-e4d256-prod-github-runner-207 kernel: [71572.609636] ? __x64_sys_futex+0x78/0x1e0 Aug 23 01:16:38 juju-e4d256-prod-github-runner-207 kernel: [71572.610333] ? __secure_computing+0xa9/0x120 Aug 23 01:16:38 juju-e4d256-prod-github-runner-207 kernel: [71572.611033] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 01:16:38 juju-e4d256-prod-github-runner-207 kernel: [71572.611814] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:16:38 juju-e4d256-prod-github-runner-207 kernel: [71572.612561] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:16:38 juju-e4d256-prod-github-runner-207 kernel: [71572.613301] ? do_syscall_64+0x69/0xc0 Aug 23 01:16:38 juju-e4d256-prod-github-runner-207 kernel: [71572.613966] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:16:38 juju-e4d256-prod-github-runner-207 kernel: [71572.614678] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:16:38 juju-e4d256-prod-github-runner-207 kernel: [71572.615381] ? do_syscall_64+0x69/0xc0 Aug 23 01:16:38 juju-e4d256-prod-github-runner-207 kernel: [71572.616036] ? do_syscall_64+0x69/0xc0 Aug 23 01:16:38 juju-e4d256-prod-github-runner-207 kernel: [71572.616668] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 01:16:38 juju-e4d256-prod-github-runner-207 kernel: [71572.617390] RIP: 0033:0x7faa5d0edaff Aug 23 01:16:38 juju-e4d256-prod-github-runner-207 kernel: [71572.618019] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 01:16:38 juju-e4d256-prod-github-runner-207 kernel: [71572.620027] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 01:16:38 juju-e4d256-prod-github-runner-207 kernel: [71572.620948] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 01:16:38 juju-e4d256-prod-github-runner-207 kernel: [71572.621862] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 01:16:38 juju-e4d256-prod-github-runner-207 kernel: [71572.622760] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 01:16:38 juju-e4d256-prod-github-runner-207 kernel: [71572.623673] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 01:16:38 juju-e4d256-prod-github-runner-207 kernel: [71572.624581] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 01:16:38 juju-e4d256-prod-github-runner-207 kernel: [71572.625502] Aug 23 01:17:06 juju-e4d256-prod-github-runner-207 kernel: [71600.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 66575s! [qemu-system-x86:6715] Aug 23 01:17:06 juju-e4d256-prod-github-runner-207 kernel: [71600.543695] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 01:17:06 juju-e4d256-prod-github-runner-207 kernel: [71600.543927] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 01:17:06 juju-e4d256-prod-github-runner-207 kernel: [71600.556106] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 01:17:06 juju-e4d256-prod-github-runner-207 kernel: [71600.557462] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 01:17:06 juju-e4d256-prod-github-runner-207 kernel: [71600.558704] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:17:06 juju-e4d256-prod-github-runner-207 kernel: [71600.559769] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 01:17:06 juju-e4d256-prod-github-runner-207 kernel: [71600.562394] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 01:17:06 juju-e4d256-prod-github-runner-207 kernel: [71600.563449] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 01:17:06 juju-e4d256-prod-github-runner-207 kernel: [71600.564616] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 01:17:06 juju-e4d256-prod-github-runner-207 kernel: [71600.565791] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 01:17:06 juju-e4d256-prod-github-runner-207 kernel: [71600.566955] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 01:17:06 juju-e4d256-prod-github-runner-207 kernel: [71600.568119] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 01:17:06 juju-e4d256-prod-github-runner-207 kernel: [71600.569348] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 01:17:06 juju-e4d256-prod-github-runner-207 kernel: [71600.570591] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 01:17:06 juju-e4d256-prod-github-runner-207 kernel: [71600.571689] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 01:17:06 juju-e4d256-prod-github-runner-207 kernel: [71600.572897] Call Trace: Aug 23 01:17:06 juju-e4d256-prod-github-runner-207 kernel: [71600.573824] Aug 23 01:17:06 juju-e4d256-prod-github-runner-207 kernel: [71600.574716] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:17:06 juju-e4d256-prod-github-runner-207 kernel: [71600.575751] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:17:06 juju-e4d256-prod-github-runner-207 kernel: [71600.576772] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:17:06 juju-e4d256-prod-github-runner-207 kernel: [71600.577872] ? show_regs.part.0+0x23/0x29 Aug 23 01:17:06 juju-e4d256-prod-github-runner-207 kernel: [71600.578869] ? show_regs.cold+0x8/0xd Aug 23 01:17:06 juju-e4d256-prod-github-runner-207 kernel: [71600.579841] ? watchdog_timer_fn+0x1be/0x220 Aug 23 01:17:06 juju-e4d256-prod-github-runner-207 kernel: [71600.580848] ? lockup_detector_update_enable+0x60/0x60 Aug 23 01:17:06 juju-e4d256-prod-github-runner-207 kernel: [71600.581919] ? __hrtimer_run_queues+0x107/0x230 Aug 23 01:17:06 juju-e4d256-prod-github-runner-207 kernel: [71600.582952] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 01:17:06 juju-e4d256-prod-github-runner-207 kernel: [71600.583976] ? hrtimer_interrupt+0x101/0x220 Aug 23 01:17:06 juju-e4d256-prod-github-runner-207 kernel: [71600.585011] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 01:17:06 juju-e4d256-prod-github-runner-207 kernel: [71600.586085] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 01:17:06 juju-e4d256-prod-github-runner-207 kernel: [71600.587153] Aug 23 01:17:06 juju-e4d256-prod-github-runner-207 kernel: [71600.588032] Aug 23 01:17:06 juju-e4d256-prod-github-runner-207 kernel: [71600.588896] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 01:17:06 juju-e4d256-prod-github-runner-207 kernel: [71600.589931] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:17:06 juju-e4d256-prod-github-runner-207 kernel: [71600.590968] ? _raw_spin_lock+0x22/0x30 Aug 23 01:17:06 juju-e4d256-prod-github-runner-207 kernel: [71600.591955] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:17:06 juju-e4d256-prod-github-runner-207 kernel: [71600.592989] direct_page_fault+0x206/0x310 [kvm] Aug 23 01:17:06 juju-e4d256-prod-github-runner-207 kernel: [71600.594015] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 01:17:06 juju-e4d256-prod-github-runner-207 kernel: [71600.595025] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 01:17:06 juju-e4d256-prod-github-runner-207 kernel: [71600.596049] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 01:17:06 juju-e4d256-prod-github-runner-207 kernel: [71600.597055] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 01:17:06 juju-e4d256-prod-github-runner-207 kernel: [71600.598008] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 01:17:06 juju-e4d256-prod-github-runner-207 kernel: [71600.598985] handle_exit+0x98/0x230 [kvm_amd] Aug 23 01:17:06 juju-e4d256-prod-github-runner-207 kernel: [71600.599878] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 01:17:06 juju-e4d256-prod-github-runner-207 kernel: [71600.600790] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 01:17:06 juju-e4d256-prod-github-runner-207 kernel: [71600.601732] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 01:17:06 juju-e4d256-prod-github-runner-207 kernel: [71600.602635] vcpu_run+0x62/0x2c0 [kvm] Aug 23 01:17:06 juju-e4d256-prod-github-runner-207 kernel: [71600.603445] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 01:17:06 juju-e4d256-prod-github-runner-207 kernel: [71600.604323] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 01:17:06 juju-e4d256-prod-github-runner-207 kernel: [71600.605208] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 01:17:06 juju-e4d256-prod-github-runner-207 kernel: [71600.606014] ? __seccomp_filter+0x4a/0x4a0 Aug 23 01:17:06 juju-e4d256-prod-github-runner-207 kernel: [71600.606755] ? __fget_files+0x86/0xc0 Aug 23 01:17:06 juju-e4d256-prod-github-runner-207 kernel: [71600.607463] __x64_sys_ioctl+0x95/0xd0 Aug 23 01:17:06 juju-e4d256-prod-github-runner-207 kernel: [71600.608356] do_syscall_64+0x5c/0xc0 Aug 23 01:17:06 juju-e4d256-prod-github-runner-207 kernel: [71600.609045] ? do_futex+0x162/0x1f0 Aug 23 01:17:06 juju-e4d256-prod-github-runner-207 kernel: [71600.609705] ? __x64_sys_futex+0x78/0x1e0 Aug 23 01:17:06 juju-e4d256-prod-github-runner-207 kernel: [71600.610385] ? __secure_computing+0xa9/0x120 Aug 23 01:17:06 juju-e4d256-prod-github-runner-207 kernel: [71600.611076] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 01:17:06 juju-e4d256-prod-github-runner-207 kernel: [71600.611836] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:17:06 juju-e4d256-prod-github-runner-207 kernel: [71600.612562] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:17:06 juju-e4d256-prod-github-runner-207 kernel: [71600.613298] ? do_syscall_64+0x69/0xc0 Aug 23 01:17:06 juju-e4d256-prod-github-runner-207 kernel: [71600.613946] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:17:06 juju-e4d256-prod-github-runner-207 kernel: [71600.614711] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:17:06 juju-e4d256-prod-github-runner-207 kernel: [71600.615418] ? do_syscall_64+0x69/0xc0 Aug 23 01:17:06 juju-e4d256-prod-github-runner-207 kernel: [71600.616043] ? do_syscall_64+0x69/0xc0 Aug 23 01:17:06 juju-e4d256-prod-github-runner-207 kernel: [71600.616670] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 01:17:06 juju-e4d256-prod-github-runner-207 kernel: [71600.617457] RIP: 0033:0x7faa5d0edaff Aug 23 01:17:06 juju-e4d256-prod-github-runner-207 kernel: [71600.618106] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 01:17:06 juju-e4d256-prod-github-runner-207 kernel: [71600.620113] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 01:17:06 juju-e4d256-prod-github-runner-207 kernel: [71600.621053] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 01:17:06 juju-e4d256-prod-github-runner-207 kernel: [71600.621946] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 01:17:06 juju-e4d256-prod-github-runner-207 kernel: [71600.622835] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 01:17:06 juju-e4d256-prod-github-runner-207 kernel: [71600.623718] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 01:17:06 juju-e4d256-prod-github-runner-207 kernel: [71600.624607] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 01:17:06 juju-e4d256-prod-github-runner-207 kernel: [71600.625514] Aug 23 01:17:34 juju-e4d256-prod-github-runner-207 kernel: [71628.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 66601s! [qemu-system-x86:6715] Aug 23 01:17:34 juju-e4d256-prod-github-runner-207 kernel: [71628.543081] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 01:17:34 juju-e4d256-prod-github-runner-207 kernel: [71628.543149] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 01:17:34 juju-e4d256-prod-github-runner-207 kernel: [71628.555209] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 01:17:34 juju-e4d256-prod-github-runner-207 kernel: [71628.556473] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 01:17:34 juju-e4d256-prod-github-runner-207 kernel: [71628.557832] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:17:34 juju-e4d256-prod-github-runner-207 kernel: [71628.558897] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 01:17:34 juju-e4d256-prod-github-runner-207 kernel: [71628.561471] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 01:17:34 juju-e4d256-prod-github-runner-207 kernel: [71628.562526] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 01:17:34 juju-e4d256-prod-github-runner-207 kernel: [71628.563686] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 01:17:34 juju-e4d256-prod-github-runner-207 kernel: [71628.564858] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 01:17:34 juju-e4d256-prod-github-runner-207 kernel: [71628.566021] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 01:17:34 juju-e4d256-prod-github-runner-207 kernel: [71628.567179] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 01:17:34 juju-e4d256-prod-github-runner-207 kernel: [71628.568348] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 01:17:34 juju-e4d256-prod-github-runner-207 kernel: [71628.569606] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 01:17:34 juju-e4d256-prod-github-runner-207 kernel: [71628.570699] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 01:17:34 juju-e4d256-prod-github-runner-207 kernel: [71628.571886] Call Trace: Aug 23 01:17:34 juju-e4d256-prod-github-runner-207 kernel: [71628.572866] Aug 23 01:17:34 juju-e4d256-prod-github-runner-207 kernel: [71628.573861] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:17:34 juju-e4d256-prod-github-runner-207 kernel: [71628.574905] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:17:34 juju-e4d256-prod-github-runner-207 kernel: [71628.575929] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:17:34 juju-e4d256-prod-github-runner-207 kernel: [71628.577030] ? show_regs.part.0+0x23/0x29 Aug 23 01:17:34 juju-e4d256-prod-github-runner-207 kernel: [71628.578062] ? show_regs.cold+0x8/0xd Aug 23 01:17:34 juju-e4d256-prod-github-runner-207 kernel: [71628.579088] ? watchdog_timer_fn+0x1be/0x220 Aug 23 01:17:34 juju-e4d256-prod-github-runner-207 kernel: [71628.580099] ? lockup_detector_update_enable+0x60/0x60 Aug 23 01:17:34 juju-e4d256-prod-github-runner-207 kernel: [71628.581183] ? __hrtimer_run_queues+0x107/0x230 Aug 23 01:17:34 juju-e4d256-prod-github-runner-207 kernel: [71628.582211] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 01:17:34 juju-e4d256-prod-github-runner-207 kernel: [71628.583233] ? hrtimer_interrupt+0x101/0x220 Aug 23 01:17:34 juju-e4d256-prod-github-runner-207 kernel: [71628.584249] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 01:17:34 juju-e4d256-prod-github-runner-207 kernel: [71628.585342] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 01:17:34 juju-e4d256-prod-github-runner-207 kernel: [71628.586387] Aug 23 01:17:34 juju-e4d256-prod-github-runner-207 kernel: [71628.587240] Aug 23 01:17:34 juju-e4d256-prod-github-runner-207 kernel: [71628.588082] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 01:17:34 juju-e4d256-prod-github-runner-207 kernel: [71628.589128] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:17:34 juju-e4d256-prod-github-runner-207 kernel: [71628.590169] ? _raw_spin_lock+0x22/0x30 Aug 23 01:17:34 juju-e4d256-prod-github-runner-207 kernel: [71628.591119] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:17:34 juju-e4d256-prod-github-runner-207 kernel: [71628.592164] direct_page_fault+0x206/0x310 [kvm] Aug 23 01:17:34 juju-e4d256-prod-github-runner-207 kernel: [71628.593250] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 01:17:34 juju-e4d256-prod-github-runner-207 kernel: [71628.594266] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 01:17:34 juju-e4d256-prod-github-runner-207 kernel: [71628.595265] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 01:17:34 juju-e4d256-prod-github-runner-207 kernel: [71628.596239] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 01:17:34 juju-e4d256-prod-github-runner-207 kernel: [71628.597199] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 01:17:34 juju-e4d256-prod-github-runner-207 kernel: [71628.598176] handle_exit+0x98/0x230 [kvm_amd] Aug 23 01:17:34 juju-e4d256-prod-github-runner-207 kernel: [71628.599067] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 01:17:34 juju-e4d256-prod-github-runner-207 kernel: [71628.599983] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 01:17:34 juju-e4d256-prod-github-runner-207 kernel: [71628.600925] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 01:17:34 juju-e4d256-prod-github-runner-207 kernel: [71628.601825] vcpu_run+0x62/0x2c0 [kvm] Aug 23 01:17:34 juju-e4d256-prod-github-runner-207 kernel: [71628.602631] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 01:17:34 juju-e4d256-prod-github-runner-207 kernel: [71628.603434] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 01:17:34 juju-e4d256-prod-github-runner-207 kernel: [71628.604285] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 01:17:34 juju-e4d256-prod-github-runner-207 kernel: [71628.605096] ? __seccomp_filter+0x4a/0x4a0 Aug 23 01:17:34 juju-e4d256-prod-github-runner-207 kernel: [71628.605983] ? __fget_files+0x86/0xc0 Aug 23 01:17:34 juju-e4d256-prod-github-runner-207 kernel: [71628.606684] __x64_sys_ioctl+0x95/0xd0 Aug 23 01:17:34 juju-e4d256-prod-github-runner-207 kernel: [71628.607372] do_syscall_64+0x5c/0xc0 Aug 23 01:17:34 juju-e4d256-prod-github-runner-207 kernel: [71628.608032] ? do_futex+0x162/0x1f0 Aug 23 01:17:34 juju-e4d256-prod-github-runner-207 kernel: [71628.608689] ? __x64_sys_futex+0x78/0x1e0 Aug 23 01:17:34 juju-e4d256-prod-github-runner-207 kernel: [71628.609360] ? __secure_computing+0xa9/0x120 Aug 23 01:17:34 juju-e4d256-prod-github-runner-207 kernel: [71628.610049] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 01:17:34 juju-e4d256-prod-github-runner-207 kernel: [71628.610804] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:17:34 juju-e4d256-prod-github-runner-207 kernel: [71628.611521] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:17:34 juju-e4d256-prod-github-runner-207 kernel: [71628.612235] ? do_syscall_64+0x69/0xc0 Aug 23 01:17:34 juju-e4d256-prod-github-runner-207 kernel: [71628.612960] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:17:34 juju-e4d256-prod-github-runner-207 kernel: [71628.613791] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:17:34 juju-e4d256-prod-github-runner-207 kernel: [71628.614793] ? do_syscall_64+0x69/0xc0 Aug 23 01:17:34 juju-e4d256-prod-github-runner-207 kernel: [71628.615438] ? do_syscall_64+0x69/0xc0 Aug 23 01:17:34 juju-e4d256-prod-github-runner-207 kernel: [71628.616068] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 01:17:34 juju-e4d256-prod-github-runner-207 kernel: [71628.616790] RIP: 0033:0x7faa5d0edaff Aug 23 01:17:34 juju-e4d256-prod-github-runner-207 kernel: [71628.617442] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 01:17:34 juju-e4d256-prod-github-runner-207 kernel: [71628.619433] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 01:17:34 juju-e4d256-prod-github-runner-207 kernel: [71628.620352] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 01:17:34 juju-e4d256-prod-github-runner-207 kernel: [71628.621268] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 01:17:34 juju-e4d256-prod-github-runner-207 kernel: [71628.622161] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 01:17:34 juju-e4d256-prod-github-runner-207 kernel: [71628.623057] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 01:17:34 juju-e4d256-prod-github-runner-207 kernel: [71628.623947] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 01:17:34 juju-e4d256-prod-github-runner-207 kernel: [71628.624862] Aug 23 01:17:48 juju-e4d256-prod-github-runner-207 kernel: [71641.964705] rcu: INFO: rcu_sched self-detected stall on CPU Aug 23 01:17:48 juju-e4d256-prod-github-runner-207 kernel: [71641.965662] rcu: 1-....: (17824894 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=8610230 Aug 23 01:17:48 juju-e4d256-prod-github-runner-207 kernel: [71641.966793] (t=17881191 jiffies g=23269 q=61451) Aug 23 01:17:48 juju-e4d256-prod-github-runner-207 kernel: [71641.967582] NMI backtrace for cpu 1 Aug 23 01:17:48 juju-e4d256-prod-github-runner-207 kernel: [71641.968295] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 01:17:48 juju-e4d256-prod-github-runner-207 kernel: [71641.969412] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 01:17:48 juju-e4d256-prod-github-runner-207 kernel: [71641.970474] Call Trace: Aug 23 01:17:48 juju-e4d256-prod-github-runner-207 kernel: [71641.971147] Aug 23 01:17:48 juju-e4d256-prod-github-runner-207 kernel: [71641.971796] show_stack+0x52/0x5c Aug 23 01:17:48 juju-e4d256-prod-github-runner-207 kernel: [71641.972536] dump_stack_lvl+0x4a/0x63 Aug 23 01:17:48 juju-e4d256-prod-github-runner-207 kernel: [71641.973283] dump_stack+0x10/0x16 Aug 23 01:17:48 juju-e4d256-prod-github-runner-207 kernel: [71641.974004] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 23 01:17:48 juju-e4d256-prod-github-runner-207 kernel: [71641.974782] ? lapic_can_unplug_cpu+0x90/0x90 Aug 23 01:17:48 juju-e4d256-prod-github-runner-207 kernel: [71641.975560] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 23 01:17:48 juju-e4d256-prod-github-runner-207 kernel: [71641.976410] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 23 01:17:48 juju-e4d256-prod-github-runner-207 kernel: [71641.977384] trigger_single_cpu_backtrace+0x44/0x4f Aug 23 01:17:48 juju-e4d256-prod-github-runner-207 kernel: [71641.978203] rcu_dump_cpu_stacks+0x102/0x149 Aug 23 01:17:48 juju-e4d256-prod-github-runner-207 kernel: [71641.979011] print_cpu_stall.cold+0x2f/0xe2 Aug 23 01:17:48 juju-e4d256-prod-github-runner-207 kernel: [71641.979804] ? timekeeping_update+0xf7/0x150 Aug 23 01:17:48 juju-e4d256-prod-github-runner-207 kernel: [71641.980595] check_cpu_stall+0x109/0x270 Aug 23 01:17:48 juju-e4d256-prod-github-runner-207 kernel: [71641.981341] rcu_sched_clock_irq+0x9a/0x250 Aug 23 01:17:48 juju-e4d256-prod-github-runner-207 kernel: [71641.982109] update_process_times+0x94/0xd0 Aug 23 01:17:48 juju-e4d256-prod-github-runner-207 kernel: [71641.982869] tick_sched_handle+0x29/0x70 Aug 23 01:17:48 juju-e4d256-prod-github-runner-207 kernel: [71641.983612] tick_sched_timer+0x8c/0xc0 Aug 23 01:17:48 juju-e4d256-prod-github-runner-207 kernel: [71641.984351] ? tick_nohz_handler+0xb0/0xb0 Aug 23 01:17:48 juju-e4d256-prod-github-runner-207 kernel: [71641.985127] __hrtimer_run_queues+0x107/0x230 Aug 23 01:17:48 juju-e4d256-prod-github-runner-207 kernel: [71641.985897] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 01:17:48 juju-e4d256-prod-github-runner-207 kernel: [71641.986670] hrtimer_interrupt+0x101/0x220 Aug 23 01:17:48 juju-e4d256-prod-github-runner-207 kernel: [71641.987481] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 01:17:48 juju-e4d256-prod-github-runner-207 kernel: [71641.988334] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 01:17:48 juju-e4d256-prod-github-runner-207 kernel: [71641.989157] Aug 23 01:17:48 juju-e4d256-prod-github-runner-207 kernel: [71641.989791] Aug 23 01:17:48 juju-e4d256-prod-github-runner-207 kernel: [71641.990420] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 01:17:48 juju-e4d256-prod-github-runner-207 kernel: [71641.991240] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:17:48 juju-e4d256-prod-github-runner-207 kernel: [71641.992132] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 01:17:48 juju-e4d256-prod-github-runner-207 kernel: [71641.994360] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 01:17:48 juju-e4d256-prod-github-runner-207 kernel: [71641.995251] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 01:17:48 juju-e4d256-prod-github-runner-207 kernel: [71641.996251] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 01:17:48 juju-e4d256-prod-github-runner-207 kernel: [71641.997246] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 01:17:48 juju-e4d256-prod-github-runner-207 kernel: [71641.998260] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 01:17:48 juju-e4d256-prod-github-runner-207 kernel: [71641.999224] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 01:17:48 juju-e4d256-prod-github-runner-207 kernel: [71642.000173] ? _raw_spin_lock+0x22/0x30 Aug 23 01:17:48 juju-e4d256-prod-github-runner-207 kernel: [71642.000950] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:17:48 juju-e4d256-prod-github-runner-207 kernel: [71642.001803] direct_page_fault+0x206/0x310 [kvm] Aug 23 01:17:48 juju-e4d256-prod-github-runner-207 kernel: [71642.002665] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 01:17:48 juju-e4d256-prod-github-runner-207 kernel: [71642.003525] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 01:17:48 juju-e4d256-prod-github-runner-207 kernel: [71642.004344] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 01:17:48 juju-e4d256-prod-github-runner-207 kernel: [71642.005166] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 01:17:48 juju-e4d256-prod-github-runner-207 kernel: [71642.005954] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 01:17:48 juju-e4d256-prod-github-runner-207 kernel: [71642.006845] handle_exit+0x98/0x230 [kvm_amd] Aug 23 01:17:48 juju-e4d256-prod-github-runner-207 kernel: [71642.007653] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 01:17:48 juju-e4d256-prod-github-runner-207 kernel: [71642.008462] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 01:17:48 juju-e4d256-prod-github-runner-207 kernel: [71642.009297] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 01:17:48 juju-e4d256-prod-github-runner-207 kernel: [71642.010094] vcpu_run+0x62/0x2c0 [kvm] Aug 23 01:17:48 juju-e4d256-prod-github-runner-207 kernel: [71642.010812] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 01:17:48 juju-e4d256-prod-github-runner-207 kernel: [71642.011549] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 01:17:48 juju-e4d256-prod-github-runner-207 kernel: [71642.012358] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 01:17:48 juju-e4d256-prod-github-runner-207 kernel: [71642.013200] ? __seccomp_filter+0x4a/0x4a0 Aug 23 01:17:48 juju-e4d256-prod-github-runner-207 kernel: [71642.013936] ? __fget_files+0x86/0xc0 Aug 23 01:17:48 juju-e4d256-prod-github-runner-207 kernel: [71642.014634] __x64_sys_ioctl+0x95/0xd0 Aug 23 01:17:48 juju-e4d256-prod-github-runner-207 kernel: [71642.015333] do_syscall_64+0x5c/0xc0 Aug 23 01:17:48 juju-e4d256-prod-github-runner-207 kernel: [71642.016022] ? do_futex+0x162/0x1f0 Aug 23 01:17:48 juju-e4d256-prod-github-runner-207 kernel: [71642.016713] ? __x64_sys_futex+0x78/0x1e0 Aug 23 01:17:48 juju-e4d256-prod-github-runner-207 kernel: [71642.017457] ? __secure_computing+0xa9/0x120 Aug 23 01:17:48 juju-e4d256-prod-github-runner-207 kernel: [71642.018185] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 01:17:48 juju-e4d256-prod-github-runner-207 kernel: [71642.018981] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:17:48 juju-e4d256-prod-github-runner-207 kernel: [71642.019733] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:17:48 juju-e4d256-prod-github-runner-207 kernel: [71642.020569] ? do_syscall_64+0x69/0xc0 Aug 23 01:17:48 juju-e4d256-prod-github-runner-207 kernel: [71642.021260] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:17:48 juju-e4d256-prod-github-runner-207 kernel: [71642.022019] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:17:48 juju-e4d256-prod-github-runner-207 kernel: [71642.022775] ? do_syscall_64+0x69/0xc0 Aug 23 01:17:48 juju-e4d256-prod-github-runner-207 kernel: [71642.023475] ? do_syscall_64+0x69/0xc0 Aug 23 01:17:48 juju-e4d256-prod-github-runner-207 kernel: [71642.024160] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 01:17:48 juju-e4d256-prod-github-runner-207 kernel: [71642.024944] RIP: 0033:0x7faa5d0edaff Aug 23 01:17:48 juju-e4d256-prod-github-runner-207 kernel: [71642.025628] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 01:17:48 juju-e4d256-prod-github-runner-207 kernel: [71642.027722] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 01:17:48 juju-e4d256-prod-github-runner-207 kernel: [71642.028706] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 01:17:48 juju-e4d256-prod-github-runner-207 kernel: [71642.029661] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 01:17:48 juju-e4d256-prod-github-runner-207 kernel: [71642.030606] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 01:17:48 juju-e4d256-prod-github-runner-207 kernel: [71642.031571] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 01:17:48 juju-e4d256-prod-github-runner-207 kernel: [71642.032524] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 01:17:48 juju-e4d256-prod-github-runner-207 kernel: [71642.033447] Aug 23 01:18:14 juju-e4d256-prod-github-runner-207 kernel: [71668.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 66638s! [qemu-system-x86:6715] Aug 23 01:18:14 juju-e4d256-prod-github-runner-207 kernel: [71668.543296] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 01:18:14 juju-e4d256-prod-github-runner-207 kernel: [71668.543365] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 01:18:14 juju-e4d256-prod-github-runner-207 kernel: [71668.557366] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 01:18:14 juju-e4d256-prod-github-runner-207 kernel: [71668.558812] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 01:18:14 juju-e4d256-prod-github-runner-207 kernel: [71668.560213] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:18:14 juju-e4d256-prod-github-runner-207 kernel: [71668.561405] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 01:18:14 juju-e4d256-prod-github-runner-207 kernel: [71668.564313] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 01:18:14 juju-e4d256-prod-github-runner-207 kernel: [71668.565470] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 01:18:14 juju-e4d256-prod-github-runner-207 kernel: [71668.566784] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 01:18:14 juju-e4d256-prod-github-runner-207 kernel: [71668.568097] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 01:18:14 juju-e4d256-prod-github-runner-207 kernel: [71668.569396] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 01:18:14 juju-e4d256-prod-github-runner-207 kernel: [71668.570688] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 01:18:14 juju-e4d256-prod-github-runner-207 kernel: [71668.571998] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 01:18:14 juju-e4d256-prod-github-runner-207 kernel: [71668.573391] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 01:18:14 juju-e4d256-prod-github-runner-207 kernel: [71668.574602] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 01:18:14 juju-e4d256-prod-github-runner-207 kernel: [71668.575931] Call Trace: Aug 23 01:18:14 juju-e4d256-prod-github-runner-207 kernel: [71668.576910] Aug 23 01:18:14 juju-e4d256-prod-github-runner-207 kernel: [71668.577840] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:18:14 juju-e4d256-prod-github-runner-207 kernel: [71668.578958] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:18:14 juju-e4d256-prod-github-runner-207 kernel: [71668.580105] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:18:14 juju-e4d256-prod-github-runner-207 kernel: [71668.581272] ? show_regs.part.0+0x23/0x29 Aug 23 01:18:14 juju-e4d256-prod-github-runner-207 kernel: [71668.582348] ? show_regs.cold+0x8/0xd Aug 23 01:18:14 juju-e4d256-prod-github-runner-207 kernel: [71668.583396] ? watchdog_timer_fn+0x1be/0x220 Aug 23 01:18:14 juju-e4d256-prod-github-runner-207 kernel: [71668.584521] ? lockup_detector_update_enable+0x60/0x60 Aug 23 01:18:14 juju-e4d256-prod-github-runner-207 kernel: [71668.585692] ? __hrtimer_run_queues+0x107/0x230 Aug 23 01:18:14 juju-e4d256-prod-github-runner-207 kernel: [71668.586814] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 01:18:14 juju-e4d256-prod-github-runner-207 kernel: [71668.587941] ? hrtimer_interrupt+0x101/0x220 Aug 23 01:18:14 juju-e4d256-prod-github-runner-207 kernel: [71668.589067] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 01:18:14 juju-e4d256-prod-github-runner-207 kernel: [71668.590234] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 01:18:14 juju-e4d256-prod-github-runner-207 kernel: [71668.591376] Aug 23 01:18:14 juju-e4d256-prod-github-runner-207 kernel: [71668.592294] Aug 23 01:18:14 juju-e4d256-prod-github-runner-207 kernel: [71668.593193] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 01:18:14 juju-e4d256-prod-github-runner-207 kernel: [71668.594335] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:18:14 juju-e4d256-prod-github-runner-207 kernel: [71668.595482] ? _raw_spin_lock+0x22/0x30 Aug 23 01:18:14 juju-e4d256-prod-github-runner-207 kernel: [71668.596543] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:18:14 juju-e4d256-prod-github-runner-207 kernel: [71668.597659] direct_page_fault+0x206/0x310 [kvm] Aug 23 01:18:14 juju-e4d256-prod-github-runner-207 kernel: [71668.598777] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 01:18:14 juju-e4d256-prod-github-runner-207 kernel: [71668.599874] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 01:18:14 juju-e4d256-prod-github-runner-207 kernel: [71668.600982] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 01:18:14 juju-e4d256-prod-github-runner-207 kernel: [71668.602055] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 01:18:14 juju-e4d256-prod-github-runner-207 kernel: [71668.603101] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 01:18:14 juju-e4d256-prod-github-runner-207 kernel: [71668.604212] handle_exit+0x98/0x230 [kvm_amd] Aug 23 01:18:14 juju-e4d256-prod-github-runner-207 kernel: [71668.605204] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 01:18:14 juju-e4d256-prod-github-runner-207 kernel: [71668.606207] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 01:18:14 juju-e4d256-prod-github-runner-207 kernel: [71668.607235] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 01:18:14 juju-e4d256-prod-github-runner-207 kernel: [71668.608256] vcpu_run+0x62/0x2c0 [kvm] Aug 23 01:18:14 juju-e4d256-prod-github-runner-207 kernel: [71668.609162] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 01:18:14 juju-e4d256-prod-github-runner-207 kernel: [71668.610069] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 01:18:14 juju-e4d256-prod-github-runner-207 kernel: [71668.611028] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 01:18:14 juju-e4d256-prod-github-runner-207 kernel: [71668.611919] ? __seccomp_filter+0x4a/0x4a0 Aug 23 01:18:14 juju-e4d256-prod-github-runner-207 kernel: [71668.612775] ? __fget_files+0x86/0xc0 Aug 23 01:18:14 juju-e4d256-prod-github-runner-207 kernel: [71668.613564] __x64_sys_ioctl+0x95/0xd0 Aug 23 01:18:14 juju-e4d256-prod-github-runner-207 kernel: [71668.614338] do_syscall_64+0x5c/0xc0 Aug 23 01:18:14 juju-e4d256-prod-github-runner-207 kernel: [71668.615093] ? do_futex+0x162/0x1f0 Aug 23 01:18:14 juju-e4d256-prod-github-runner-207 kernel: [71668.615815] ? __x64_sys_futex+0x78/0x1e0 Aug 23 01:18:14 juju-e4d256-prod-github-runner-207 kernel: [71668.616577] ? __secure_computing+0xa9/0x120 Aug 23 01:18:14 juju-e4d256-prod-github-runner-207 kernel: [71668.617350] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 01:18:14 juju-e4d256-prod-github-runner-207 kernel: [71668.618215] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:18:14 juju-e4d256-prod-github-runner-207 kernel: [71668.619038] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:18:14 juju-e4d256-prod-github-runner-207 kernel: [71668.619789] ? do_syscall_64+0x69/0xc0 Aug 23 01:18:14 juju-e4d256-prod-github-runner-207 kernel: [71668.620457] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:18:14 juju-e4d256-prod-github-runner-207 kernel: [71668.621165] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:18:14 juju-e4d256-prod-github-runner-207 kernel: [71668.621863] ? do_syscall_64+0x69/0xc0 Aug 23 01:18:14 juju-e4d256-prod-github-runner-207 kernel: [71668.622495] ? do_syscall_64+0x69/0xc0 Aug 23 01:18:14 juju-e4d256-prod-github-runner-207 kernel: [71668.623125] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 01:18:14 juju-e4d256-prod-github-runner-207 kernel: [71668.623834] RIP: 0033:0x7faa5d0edaff Aug 23 01:18:14 juju-e4d256-prod-github-runner-207 kernel: [71668.624476] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 01:18:14 juju-e4d256-prod-github-runner-207 kernel: [71668.626474] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 01:18:14 juju-e4d256-prod-github-runner-207 kernel: [71668.627392] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 01:18:14 juju-e4d256-prod-github-runner-207 kernel: [71668.628298] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 01:18:14 juju-e4d256-prod-github-runner-207 kernel: [71668.629193] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 01:18:14 juju-e4d256-prod-github-runner-207 kernel: [71668.630086] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 01:18:14 juju-e4d256-prod-github-runner-207 kernel: [71668.630979] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 01:18:14 juju-e4d256-prod-github-runner-207 kernel: [71668.631904] Aug 23 01:18:42 juju-e4d256-prod-github-runner-207 kernel: [71696.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 66664s! [qemu-system-x86:6715] Aug 23 01:18:42 juju-e4d256-prod-github-runner-207 kernel: [71696.543780] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 01:18:42 juju-e4d256-prod-github-runner-207 kernel: [71696.544058] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 01:18:42 juju-e4d256-prod-github-runner-207 kernel: [71696.556190] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 01:18:42 juju-e4d256-prod-github-runner-207 kernel: [71696.557453] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 01:18:42 juju-e4d256-prod-github-runner-207 kernel: [71696.558676] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:18:42 juju-e4d256-prod-github-runner-207 kernel: [71696.559731] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 01:18:42 juju-e4d256-prod-github-runner-207 kernel: [71696.562344] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 01:18:42 juju-e4d256-prod-github-runner-207 kernel: [71696.563393] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 01:18:42 juju-e4d256-prod-github-runner-207 kernel: [71696.564579] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 01:18:42 juju-e4d256-prod-github-runner-207 kernel: [71696.565740] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 01:18:42 juju-e4d256-prod-github-runner-207 kernel: [71696.566909] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 01:18:42 juju-e4d256-prod-github-runner-207 kernel: [71696.568092] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 01:18:42 juju-e4d256-prod-github-runner-207 kernel: [71696.569260] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 01:18:42 juju-e4d256-prod-github-runner-207 kernel: [71696.570514] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 01:18:42 juju-e4d256-prod-github-runner-207 kernel: [71696.571615] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 01:18:42 juju-e4d256-prod-github-runner-207 kernel: [71696.572832] Call Trace: Aug 23 01:18:42 juju-e4d256-prod-github-runner-207 kernel: [71696.573761] Aug 23 01:18:42 juju-e4d256-prod-github-runner-207 kernel: [71696.574800] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:18:42 juju-e4d256-prod-github-runner-207 kernel: [71696.575851] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:18:42 juju-e4d256-prod-github-runner-207 kernel: [71696.576932] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:18:42 juju-e4d256-prod-github-runner-207 kernel: [71696.578020] ? show_regs.part.0+0x23/0x29 Aug 23 01:18:42 juju-e4d256-prod-github-runner-207 kernel: [71696.579021] ? show_regs.cold+0x8/0xd Aug 23 01:18:42 juju-e4d256-prod-github-runner-207 kernel: [71696.580022] ? watchdog_timer_fn+0x1be/0x220 Aug 23 01:18:42 juju-e4d256-prod-github-runner-207 kernel: [71696.581048] ? lockup_detector_update_enable+0x60/0x60 Aug 23 01:18:42 juju-e4d256-prod-github-runner-207 kernel: [71696.582143] ? __hrtimer_run_queues+0x107/0x230 Aug 23 01:18:42 juju-e4d256-prod-github-runner-207 kernel: [71696.583203] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 01:18:42 juju-e4d256-prod-github-runner-207 kernel: [71696.584269] ? hrtimer_interrupt+0x101/0x220 Aug 23 01:18:42 juju-e4d256-prod-github-runner-207 kernel: [71696.585324] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 01:18:42 juju-e4d256-prod-github-runner-207 kernel: [71696.586402] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 01:18:42 juju-e4d256-prod-github-runner-207 kernel: [71696.587446] Aug 23 01:18:42 juju-e4d256-prod-github-runner-207 kernel: [71696.588318] Aug 23 01:18:42 juju-e4d256-prod-github-runner-207 kernel: [71696.589153] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 01:18:42 juju-e4d256-prod-github-runner-207 kernel: [71696.590188] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:18:42 juju-e4d256-prod-github-runner-207 kernel: [71696.591245] ? _raw_spin_lock+0x22/0x30 Aug 23 01:18:42 juju-e4d256-prod-github-runner-207 kernel: [71696.592228] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:18:42 juju-e4d256-prod-github-runner-207 kernel: [71696.593246] direct_page_fault+0x206/0x310 [kvm] Aug 23 01:18:42 juju-e4d256-prod-github-runner-207 kernel: [71696.594279] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 01:18:42 juju-e4d256-prod-github-runner-207 kernel: [71696.595288] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 01:18:42 juju-e4d256-prod-github-runner-207 kernel: [71696.596352] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 01:18:42 juju-e4d256-prod-github-runner-207 kernel: [71696.597355] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 01:18:42 juju-e4d256-prod-github-runner-207 kernel: [71696.598300] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 01:18:42 juju-e4d256-prod-github-runner-207 kernel: [71696.599286] handle_exit+0x98/0x230 [kvm_amd] Aug 23 01:18:42 juju-e4d256-prod-github-runner-207 kernel: [71696.600259] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 01:18:42 juju-e4d256-prod-github-runner-207 kernel: [71696.601186] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 01:18:42 juju-e4d256-prod-github-runner-207 kernel: [71696.602185] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 01:18:42 juju-e4d256-prod-github-runner-207 kernel: [71696.603089] vcpu_run+0x62/0x2c0 [kvm] Aug 23 01:18:42 juju-e4d256-prod-github-runner-207 kernel: [71696.603972] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 01:18:42 juju-e4d256-prod-github-runner-207 kernel: [71696.604792] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 01:18:42 juju-e4d256-prod-github-runner-207 kernel: [71696.605651] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 01:18:42 juju-e4d256-prod-github-runner-207 kernel: [71696.606461] ? __seccomp_filter+0x4a/0x4a0 Aug 23 01:18:42 juju-e4d256-prod-github-runner-207 kernel: [71696.607208] ? __fget_files+0x86/0xc0 Aug 23 01:18:42 juju-e4d256-prod-github-runner-207 kernel: [71696.607929] __x64_sys_ioctl+0x95/0xd0 Aug 23 01:18:42 juju-e4d256-prod-github-runner-207 kernel: [71696.608625] do_syscall_64+0x5c/0xc0 Aug 23 01:18:42 juju-e4d256-prod-github-runner-207 kernel: [71696.609302] ? do_futex+0x162/0x1f0 Aug 23 01:18:42 juju-e4d256-prod-github-runner-207 kernel: [71696.609961] ? __x64_sys_futex+0x78/0x1e0 Aug 23 01:18:42 juju-e4d256-prod-github-runner-207 kernel: [71696.610642] ? __secure_computing+0xa9/0x120 Aug 23 01:18:42 juju-e4d256-prod-github-runner-207 kernel: [71696.611384] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 01:18:42 juju-e4d256-prod-github-runner-207 kernel: [71696.612258] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:18:42 juju-e4d256-prod-github-runner-207 kernel: [71696.612992] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:18:42 juju-e4d256-prod-github-runner-207 kernel: [71696.613710] ? do_syscall_64+0x69/0xc0 Aug 23 01:18:42 juju-e4d256-prod-github-runner-207 kernel: [71696.614409] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:18:42 juju-e4d256-prod-github-runner-207 kernel: [71696.615152] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:18:42 juju-e4d256-prod-github-runner-207 kernel: [71696.615903] ? do_syscall_64+0x69/0xc0 Aug 23 01:18:42 juju-e4d256-prod-github-runner-207 kernel: [71696.616575] ? do_syscall_64+0x69/0xc0 Aug 23 01:18:42 juju-e4d256-prod-github-runner-207 kernel: [71696.617209] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 01:18:42 juju-e4d256-prod-github-runner-207 kernel: [71696.617917] RIP: 0033:0x7faa5d0edaff Aug 23 01:18:42 juju-e4d256-prod-github-runner-207 kernel: [71696.618570] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 01:18:42 juju-e4d256-prod-github-runner-207 kernel: [71696.620770] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 01:18:42 juju-e4d256-prod-github-runner-207 kernel: [71696.621853] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 01:18:42 juju-e4d256-prod-github-runner-207 kernel: [71696.622750] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 01:18:42 juju-e4d256-prod-github-runner-207 kernel: [71696.623647] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 01:18:42 juju-e4d256-prod-github-runner-207 kernel: [71696.624591] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 01:18:42 juju-e4d256-prod-github-runner-207 kernel: [71696.625519] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 01:18:42 juju-e4d256-prod-github-runner-207 kernel: [71696.626440] Aug 23 01:19:10 juju-e4d256-prod-github-runner-207 kernel: [71724.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 66690s! [qemu-system-x86:6715] Aug 23 01:19:10 juju-e4d256-prod-github-runner-207 kernel: [71724.543144] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 01:19:10 juju-e4d256-prod-github-runner-207 kernel: [71724.543214] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 01:19:10 juju-e4d256-prod-github-runner-207 kernel: [71724.555230] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 01:19:10 juju-e4d256-prod-github-runner-207 kernel: [71724.556501] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 01:19:10 juju-e4d256-prod-github-runner-207 kernel: [71724.557727] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:19:10 juju-e4d256-prod-github-runner-207 kernel: [71724.558783] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 01:19:10 juju-e4d256-prod-github-runner-207 kernel: [71724.561337] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 01:19:10 juju-e4d256-prod-github-runner-207 kernel: [71724.562386] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 01:19:10 juju-e4d256-prod-github-runner-207 kernel: [71724.563561] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 01:19:10 juju-e4d256-prod-github-runner-207 kernel: [71724.564724] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 01:19:10 juju-e4d256-prod-github-runner-207 kernel: [71724.565892] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 01:19:10 juju-e4d256-prod-github-runner-207 kernel: [71724.567052] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 01:19:10 juju-e4d256-prod-github-runner-207 kernel: [71724.568228] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 01:19:10 juju-e4d256-prod-github-runner-207 kernel: [71724.569460] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 01:19:10 juju-e4d256-prod-github-runner-207 kernel: [71724.570563] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 01:19:10 juju-e4d256-prod-github-runner-207 kernel: [71724.571774] Call Trace: Aug 23 01:19:10 juju-e4d256-prod-github-runner-207 kernel: [71724.572695] Aug 23 01:19:10 juju-e4d256-prod-github-runner-207 kernel: [71724.573583] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:19:10 juju-e4d256-prod-github-runner-207 kernel: [71724.574619] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:19:10 juju-e4d256-prod-github-runner-207 kernel: [71724.575659] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:19:10 juju-e4d256-prod-github-runner-207 kernel: [71724.576737] ? show_regs.part.0+0x23/0x29 Aug 23 01:19:10 juju-e4d256-prod-github-runner-207 kernel: [71724.577739] ? show_regs.cold+0x8/0xd Aug 23 01:19:10 juju-e4d256-prod-github-runner-207 kernel: [71724.578708] ? watchdog_timer_fn+0x1be/0x220 Aug 23 01:19:10 juju-e4d256-prod-github-runner-207 kernel: [71724.579738] ? lockup_detector_update_enable+0x60/0x60 Aug 23 01:19:10 juju-e4d256-prod-github-runner-207 kernel: [71724.580809] ? __hrtimer_run_queues+0x107/0x230 Aug 23 01:19:10 juju-e4d256-prod-github-runner-207 kernel: [71724.581842] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 01:19:10 juju-e4d256-prod-github-runner-207 kernel: [71724.582866] ? hrtimer_interrupt+0x101/0x220 Aug 23 01:19:10 juju-e4d256-prod-github-runner-207 kernel: [71724.583889] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 01:19:10 juju-e4d256-prod-github-runner-207 kernel: [71724.584962] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 01:19:10 juju-e4d256-prod-github-runner-207 kernel: [71724.586010] Aug 23 01:19:10 juju-e4d256-prod-github-runner-207 kernel: [71724.586863] Aug 23 01:19:10 juju-e4d256-prod-github-runner-207 kernel: [71724.587706] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 01:19:10 juju-e4d256-prod-github-runner-207 kernel: [71724.588783] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:19:10 juju-e4d256-prod-github-runner-207 kernel: [71724.589825] ? _raw_spin_lock+0x22/0x30 Aug 23 01:19:10 juju-e4d256-prod-github-runner-207 kernel: [71724.590769] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:19:10 juju-e4d256-prod-github-runner-207 kernel: [71724.591807] direct_page_fault+0x206/0x310 [kvm] Aug 23 01:19:10 juju-e4d256-prod-github-runner-207 kernel: [71724.592840] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 01:19:10 juju-e4d256-prod-github-runner-207 kernel: [71724.593850] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 01:19:10 juju-e4d256-prod-github-runner-207 kernel: [71724.594849] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 01:19:10 juju-e4d256-prod-github-runner-207 kernel: [71724.595830] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 01:19:10 juju-e4d256-prod-github-runner-207 kernel: [71724.596778] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 01:19:10 juju-e4d256-prod-github-runner-207 kernel: [71724.597760] handle_exit+0x98/0x230 [kvm_amd] Aug 23 01:19:10 juju-e4d256-prod-github-runner-207 kernel: [71724.598651] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 01:19:10 juju-e4d256-prod-github-runner-207 kernel: [71724.599578] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 01:19:10 juju-e4d256-prod-github-runner-207 kernel: [71724.600502] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 01:19:10 juju-e4d256-prod-github-runner-207 kernel: [71724.601412] vcpu_run+0x62/0x2c0 [kvm] Aug 23 01:19:10 juju-e4d256-prod-github-runner-207 kernel: [71724.602237] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 01:19:10 juju-e4d256-prod-github-runner-207 kernel: [71724.603056] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 01:19:10 juju-e4d256-prod-github-runner-207 kernel: [71724.603935] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 01:19:10 juju-e4d256-prod-github-runner-207 kernel: [71724.604733] ? __seccomp_filter+0x4a/0x4a0 Aug 23 01:19:10 juju-e4d256-prod-github-runner-207 kernel: [71724.605476] ? __fget_files+0x86/0xc0 Aug 23 01:19:10 juju-e4d256-prod-github-runner-207 kernel: [71724.606179] __x64_sys_ioctl+0x95/0xd0 Aug 23 01:19:10 juju-e4d256-prod-github-runner-207 kernel: [71724.606878] do_syscall_64+0x5c/0xc0 Aug 23 01:19:10 juju-e4d256-prod-github-runner-207 kernel: [71724.607553] ? do_futex+0x162/0x1f0 Aug 23 01:19:10 juju-e4d256-prod-github-runner-207 kernel: [71724.608233] ? __x64_sys_futex+0x78/0x1e0 Aug 23 01:19:10 juju-e4d256-prod-github-runner-207 kernel: [71724.608920] ? __secure_computing+0xa9/0x120 Aug 23 01:19:10 juju-e4d256-prod-github-runner-207 kernel: [71724.609611] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 01:19:10 juju-e4d256-prod-github-runner-207 kernel: [71724.610371] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:19:10 juju-e4d256-prod-github-runner-207 kernel: [71724.611092] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:19:10 juju-e4d256-prod-github-runner-207 kernel: [71724.611840] ? do_syscall_64+0x69/0xc0 Aug 23 01:19:10 juju-e4d256-prod-github-runner-207 kernel: [71724.612489] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:19:10 juju-e4d256-prod-github-runner-207 kernel: [71724.613199] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:19:10 juju-e4d256-prod-github-runner-207 kernel: [71724.613897] ? do_syscall_64+0x69/0xc0 Aug 23 01:19:10 juju-e4d256-prod-github-runner-207 kernel: [71724.614523] ? do_syscall_64+0x69/0xc0 Aug 23 01:19:10 juju-e4d256-prod-github-runner-207 kernel: [71724.615145] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 01:19:10 juju-e4d256-prod-github-runner-207 kernel: [71724.615861] RIP: 0033:0x7faa5d0edaff Aug 23 01:19:10 juju-e4d256-prod-github-runner-207 kernel: [71724.616488] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 01:19:10 juju-e4d256-prod-github-runner-207 kernel: [71724.618478] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 01:19:10 juju-e4d256-prod-github-runner-207 kernel: [71724.619409] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 01:19:10 juju-e4d256-prod-github-runner-207 kernel: [71724.620339] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 01:19:10 juju-e4d256-prod-github-runner-207 kernel: [71724.621235] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 01:19:10 juju-e4d256-prod-github-runner-207 kernel: [71724.622130] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 01:19:10 juju-e4d256-prod-github-runner-207 kernel: [71724.623021] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 01:19:10 juju-e4d256-prod-github-runner-207 kernel: [71724.623933] Aug 23 01:19:38 juju-e4d256-prod-github-runner-207 kernel: [71752.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 66716s! [qemu-system-x86:6715] Aug 23 01:19:38 juju-e4d256-prod-github-runner-207 kernel: [71752.543089] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 01:19:38 juju-e4d256-prod-github-runner-207 kernel: [71752.543174] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 01:19:38 juju-e4d256-prod-github-runner-207 kernel: [71752.555254] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 01:19:38 juju-e4d256-prod-github-runner-207 kernel: [71752.556521] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 01:19:38 juju-e4d256-prod-github-runner-207 kernel: [71752.557742] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:19:38 juju-e4d256-prod-github-runner-207 kernel: [71752.558808] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 01:19:38 juju-e4d256-prod-github-runner-207 kernel: [71752.561383] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 01:19:38 juju-e4d256-prod-github-runner-207 kernel: [71752.562425] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 01:19:38 juju-e4d256-prod-github-runner-207 kernel: [71752.563609] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 01:19:38 juju-e4d256-prod-github-runner-207 kernel: [71752.564776] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 01:19:38 juju-e4d256-prod-github-runner-207 kernel: [71752.565935] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 01:19:38 juju-e4d256-prod-github-runner-207 kernel: [71752.567105] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 01:19:38 juju-e4d256-prod-github-runner-207 kernel: [71752.568281] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 01:19:38 juju-e4d256-prod-github-runner-207 kernel: [71752.569515] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 01:19:38 juju-e4d256-prod-github-runner-207 kernel: [71752.570616] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 01:19:38 juju-e4d256-prod-github-runner-207 kernel: [71752.571827] Call Trace: Aug 23 01:19:38 juju-e4d256-prod-github-runner-207 kernel: [71752.572739] Aug 23 01:19:38 juju-e4d256-prod-github-runner-207 kernel: [71752.573626] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:19:38 juju-e4d256-prod-github-runner-207 kernel: [71752.574658] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:19:38 juju-e4d256-prod-github-runner-207 kernel: [71752.575684] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:19:38 juju-e4d256-prod-github-runner-207 kernel: [71752.576757] ? show_regs.part.0+0x23/0x29 Aug 23 01:19:38 juju-e4d256-prod-github-runner-207 kernel: [71752.577752] ? show_regs.cold+0x8/0xd Aug 23 01:19:38 juju-e4d256-prod-github-runner-207 kernel: [71752.578721] ? watchdog_timer_fn+0x1be/0x220 Aug 23 01:19:38 juju-e4d256-prod-github-runner-207 kernel: [71752.579782] ? lockup_detector_update_enable+0x60/0x60 Aug 23 01:19:38 juju-e4d256-prod-github-runner-207 kernel: [71752.580842] ? __hrtimer_run_queues+0x107/0x230 Aug 23 01:19:38 juju-e4d256-prod-github-runner-207 kernel: [71752.581869] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 01:19:38 juju-e4d256-prod-github-runner-207 kernel: [71752.582889] ? hrtimer_interrupt+0x101/0x220 Aug 23 01:19:38 juju-e4d256-prod-github-runner-207 kernel: [71752.583910] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 01:19:38 juju-e4d256-prod-github-runner-207 kernel: [71752.584975] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 01:19:38 juju-e4d256-prod-github-runner-207 kernel: [71752.586019] Aug 23 01:19:38 juju-e4d256-prod-github-runner-207 kernel: [71752.586870] Aug 23 01:19:38 juju-e4d256-prod-github-runner-207 kernel: [71752.587718] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 01:19:38 juju-e4d256-prod-github-runner-207 kernel: [71752.588749] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:19:38 juju-e4d256-prod-github-runner-207 kernel: [71752.589785] ? _raw_spin_lock+0x22/0x30 Aug 23 01:19:38 juju-e4d256-prod-github-runner-207 kernel: [71752.590726] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:19:38 juju-e4d256-prod-github-runner-207 kernel: [71752.591750] direct_page_fault+0x206/0x310 [kvm] Aug 23 01:19:38 juju-e4d256-prod-github-runner-207 kernel: [71752.592774] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 01:19:38 juju-e4d256-prod-github-runner-207 kernel: [71752.593781] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 01:19:38 juju-e4d256-prod-github-runner-207 kernel: [71752.594777] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 01:19:38 juju-e4d256-prod-github-runner-207 kernel: [71752.595759] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 01:19:38 juju-e4d256-prod-github-runner-207 kernel: [71752.596702] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 01:19:38 juju-e4d256-prod-github-runner-207 kernel: [71752.597679] handle_exit+0x98/0x230 [kvm_amd] Aug 23 01:19:38 juju-e4d256-prod-github-runner-207 kernel: [71752.598569] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 01:19:38 juju-e4d256-prod-github-runner-207 kernel: [71752.599493] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 01:19:38 juju-e4d256-prod-github-runner-207 kernel: [71752.600415] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 01:19:38 juju-e4d256-prod-github-runner-207 kernel: [71752.601317] vcpu_run+0x62/0x2c0 [kvm] Aug 23 01:19:38 juju-e4d256-prod-github-runner-207 kernel: [71752.602126] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 01:19:38 juju-e4d256-prod-github-runner-207 kernel: [71752.602932] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 01:19:38 juju-e4d256-prod-github-runner-207 kernel: [71752.603792] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 01:19:38 juju-e4d256-prod-github-runner-207 kernel: [71752.604587] ? __seccomp_filter+0x4a/0x4a0 Aug 23 01:19:38 juju-e4d256-prod-github-runner-207 kernel: [71752.605338] ? __fget_files+0x86/0xc0 Aug 23 01:19:38 juju-e4d256-prod-github-runner-207 kernel: [71752.606039] __x64_sys_ioctl+0x95/0xd0 Aug 23 01:19:38 juju-e4d256-prod-github-runner-207 kernel: [71752.606728] do_syscall_64+0x5c/0xc0 Aug 23 01:19:38 juju-e4d256-prod-github-runner-207 kernel: [71752.607404] ? do_futex+0x162/0x1f0 Aug 23 01:19:38 juju-e4d256-prod-github-runner-207 kernel: [71752.608056] ? __x64_sys_futex+0x78/0x1e0 Aug 23 01:19:38 juju-e4d256-prod-github-runner-207 kernel: [71752.608726] ? __secure_computing+0xa9/0x120 Aug 23 01:19:38 juju-e4d256-prod-github-runner-207 kernel: [71752.609413] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 01:19:38 juju-e4d256-prod-github-runner-207 kernel: [71752.610170] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:19:38 juju-e4d256-prod-github-runner-207 kernel: [71752.610889] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:19:38 juju-e4d256-prod-github-runner-207 kernel: [71752.611616] ? do_syscall_64+0x69/0xc0 Aug 23 01:19:38 juju-e4d256-prod-github-runner-207 kernel: [71752.612259] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:19:38 juju-e4d256-prod-github-runner-207 kernel: [71752.612958] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:19:38 juju-e4d256-prod-github-runner-207 kernel: [71752.613649] ? do_syscall_64+0x69/0xc0 Aug 23 01:19:38 juju-e4d256-prod-github-runner-207 kernel: [71752.614276] ? do_syscall_64+0x69/0xc0 Aug 23 01:19:38 juju-e4d256-prod-github-runner-207 kernel: [71752.614899] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 01:19:38 juju-e4d256-prod-github-runner-207 kernel: [71752.615616] RIP: 0033:0x7faa5d0edaff Aug 23 01:19:38 juju-e4d256-prod-github-runner-207 kernel: [71752.616237] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 01:19:38 juju-e4d256-prod-github-runner-207 kernel: [71752.618228] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 01:19:38 juju-e4d256-prod-github-runner-207 kernel: [71752.619147] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 01:19:38 juju-e4d256-prod-github-runner-207 kernel: [71752.620040] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 01:19:38 juju-e4d256-prod-github-runner-207 kernel: [71752.620931] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 01:19:38 juju-e4d256-prod-github-runner-207 kernel: [71752.621822] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 01:19:38 juju-e4d256-prod-github-runner-207 kernel: [71752.622708] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 01:19:38 juju-e4d256-prod-github-runner-207 kernel: [71752.623610] Aug 23 01:20:06 juju-e4d256-prod-github-runner-207 kernel: [71780.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 66742s! [qemu-system-x86:6715] Aug 23 01:20:06 juju-e4d256-prod-github-runner-207 kernel: [71780.543168] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 01:20:06 juju-e4d256-prod-github-runner-207 kernel: [71780.543237] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 01:20:06 juju-e4d256-prod-github-runner-207 kernel: [71780.555275] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 01:20:06 juju-e4d256-prod-github-runner-207 kernel: [71780.556548] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 01:20:06 juju-e4d256-prod-github-runner-207 kernel: [71780.557768] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:20:06 juju-e4d256-prod-github-runner-207 kernel: [71780.558841] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 01:20:06 juju-e4d256-prod-github-runner-207 kernel: [71780.561389] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 01:20:06 juju-e4d256-prod-github-runner-207 kernel: [71780.562431] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 01:20:06 juju-e4d256-prod-github-runner-207 kernel: [71780.563608] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 01:20:06 juju-e4d256-prod-github-runner-207 kernel: [71780.564771] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 01:20:06 juju-e4d256-prod-github-runner-207 kernel: [71780.565930] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 01:20:06 juju-e4d256-prod-github-runner-207 kernel: [71780.567111] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 01:20:06 juju-e4d256-prod-github-runner-207 kernel: [71780.568280] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 01:20:06 juju-e4d256-prod-github-runner-207 kernel: [71780.569517] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 01:20:06 juju-e4d256-prod-github-runner-207 kernel: [71780.570613] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 01:20:06 juju-e4d256-prod-github-runner-207 kernel: [71780.571814] Call Trace: Aug 23 01:20:06 juju-e4d256-prod-github-runner-207 kernel: [71780.572733] Aug 23 01:20:06 juju-e4d256-prod-github-runner-207 kernel: [71780.573617] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:20:06 juju-e4d256-prod-github-runner-207 kernel: [71780.574646] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:20:06 juju-e4d256-prod-github-runner-207 kernel: [71780.575710] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:20:06 juju-e4d256-prod-github-runner-207 kernel: [71780.576788] ? show_regs.part.0+0x23/0x29 Aug 23 01:20:06 juju-e4d256-prod-github-runner-207 kernel: [71780.577786] ? show_regs.cold+0x8/0xd Aug 23 01:20:06 juju-e4d256-prod-github-runner-207 kernel: [71780.578758] ? watchdog_timer_fn+0x1be/0x220 Aug 23 01:20:06 juju-e4d256-prod-github-runner-207 kernel: [71780.579782] ? lockup_detector_update_enable+0x60/0x60 Aug 23 01:20:06 juju-e4d256-prod-github-runner-207 kernel: [71780.580845] ? __hrtimer_run_queues+0x107/0x230 Aug 23 01:20:06 juju-e4d256-prod-github-runner-207 kernel: [71780.581872] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 01:20:06 juju-e4d256-prod-github-runner-207 kernel: [71780.582913] ? hrtimer_interrupt+0x101/0x220 Aug 23 01:20:06 juju-e4d256-prod-github-runner-207 kernel: [71780.583929] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 01:20:06 juju-e4d256-prod-github-runner-207 kernel: [71780.584996] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 01:20:06 juju-e4d256-prod-github-runner-207 kernel: [71780.586054] Aug 23 01:20:06 juju-e4d256-prod-github-runner-207 kernel: [71780.586927] Aug 23 01:20:06 juju-e4d256-prod-github-runner-207 kernel: [71780.587768] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 01:20:06 juju-e4d256-prod-github-runner-207 kernel: [71780.588814] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:20:06 juju-e4d256-prod-github-runner-207 kernel: [71780.589854] ? _raw_spin_lock+0x22/0x30 Aug 23 01:20:06 juju-e4d256-prod-github-runner-207 kernel: [71780.590799] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:20:06 juju-e4d256-prod-github-runner-207 kernel: [71780.591832] direct_page_fault+0x206/0x310 [kvm] Aug 23 01:20:06 juju-e4d256-prod-github-runner-207 kernel: [71780.592975] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 01:20:06 juju-e4d256-prod-github-runner-207 kernel: [71780.594103] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 01:20:06 juju-e4d256-prod-github-runner-207 kernel: [71780.595235] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 01:20:06 juju-e4d256-prod-github-runner-207 kernel: [71780.596303] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 01:20:06 juju-e4d256-prod-github-runner-207 kernel: [71780.597345] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 01:20:06 juju-e4d256-prod-github-runner-207 kernel: [71780.598430] handle_exit+0x98/0x230 [kvm_amd] Aug 23 01:20:06 juju-e4d256-prod-github-runner-207 kernel: [71780.599458] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 01:20:06 juju-e4d256-prod-github-runner-207 kernel: [71780.600476] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 01:20:06 juju-e4d256-prod-github-runner-207 kernel: [71780.601498] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 01:20:06 juju-e4d256-prod-github-runner-207 kernel: [71780.602498] vcpu_run+0x62/0x2c0 [kvm] Aug 23 01:20:06 juju-e4d256-prod-github-runner-207 kernel: [71780.603421] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 01:20:06 juju-e4d256-prod-github-runner-207 kernel: [71780.604321] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 01:20:06 juju-e4d256-prod-github-runner-207 kernel: [71780.605272] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 01:20:06 juju-e4d256-prod-github-runner-207 kernel: [71780.606176] ? __seccomp_filter+0x4a/0x4a0 Aug 23 01:20:06 juju-e4d256-prod-github-runner-207 kernel: [71780.607021] ? __fget_files+0x86/0xc0 Aug 23 01:20:06 juju-e4d256-prod-github-runner-207 kernel: [71780.607806] __x64_sys_ioctl+0x95/0xd0 Aug 23 01:20:06 juju-e4d256-prod-github-runner-207 kernel: [71780.608578] do_syscall_64+0x5c/0xc0 Aug 23 01:20:06 juju-e4d256-prod-github-runner-207 kernel: [71780.609333] ? do_futex+0x162/0x1f0 Aug 23 01:20:06 juju-e4d256-prod-github-runner-207 kernel: [71780.610069] ? __x64_sys_futex+0x78/0x1e0 Aug 23 01:20:06 juju-e4d256-prod-github-runner-207 kernel: [71780.610853] ? __secure_computing+0xa9/0x120 Aug 23 01:20:06 juju-e4d256-prod-github-runner-207 kernel: [71780.611625] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 01:20:06 juju-e4d256-prod-github-runner-207 kernel: [71780.612490] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:20:06 juju-e4d256-prod-github-runner-207 kernel: [71780.613309] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:20:06 juju-e4d256-prod-github-runner-207 kernel: [71780.614122] ? do_syscall_64+0x69/0xc0 Aug 23 01:20:06 juju-e4d256-prod-github-runner-207 kernel: [71780.614900] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:20:06 juju-e4d256-prod-github-runner-207 kernel: [71780.615654] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:20:06 juju-e4d256-prod-github-runner-207 kernel: [71780.616349] ? do_syscall_64+0x69/0xc0 Aug 23 01:20:06 juju-e4d256-prod-github-runner-207 kernel: [71780.616974] ? do_syscall_64+0x69/0xc0 Aug 23 01:20:06 juju-e4d256-prod-github-runner-207 kernel: [71780.617595] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 01:20:06 juju-e4d256-prod-github-runner-207 kernel: [71780.618302] RIP: 0033:0x7faa5d0edaff Aug 23 01:20:06 juju-e4d256-prod-github-runner-207 kernel: [71780.618956] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 01:20:06 juju-e4d256-prod-github-runner-207 kernel: [71780.620977] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 01:20:06 juju-e4d256-prod-github-runner-207 kernel: [71780.621903] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 01:20:06 juju-e4d256-prod-github-runner-207 kernel: [71780.622793] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 01:20:06 juju-e4d256-prod-github-runner-207 kernel: [71780.623705] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 01:20:06 juju-e4d256-prod-github-runner-207 kernel: [71780.624593] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 01:20:06 juju-e4d256-prod-github-runner-207 kernel: [71780.625499] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 01:20:06 juju-e4d256-prod-github-runner-207 kernel: [71780.626391] Aug 23 01:20:34 juju-e4d256-prod-github-runner-207 kernel: [71808.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 66768s! [qemu-system-x86:6715] Aug 23 01:20:34 juju-e4d256-prod-github-runner-207 kernel: [71808.543653] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 01:20:34 juju-e4d256-prod-github-runner-207 kernel: [71808.543895] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 01:20:34 juju-e4d256-prod-github-runner-207 kernel: [71808.556142] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 01:20:34 juju-e4d256-prod-github-runner-207 kernel: [71808.557417] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 01:20:34 juju-e4d256-prod-github-runner-207 kernel: [71808.558674] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:20:34 juju-e4d256-prod-github-runner-207 kernel: [71808.559733] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 01:20:34 juju-e4d256-prod-github-runner-207 kernel: [71808.562471] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 01:20:34 juju-e4d256-prod-github-runner-207 kernel: [71808.563560] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 01:20:34 juju-e4d256-prod-github-runner-207 kernel: [71808.564732] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 01:20:34 juju-e4d256-prod-github-runner-207 kernel: [71808.565895] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 01:20:34 juju-e4d256-prod-github-runner-207 kernel: [71808.567080] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 01:20:34 juju-e4d256-prod-github-runner-207 kernel: [71808.568267] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 01:20:34 juju-e4d256-prod-github-runner-207 kernel: [71808.569442] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 01:20:34 juju-e4d256-prod-github-runner-207 kernel: [71808.570689] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 01:20:34 juju-e4d256-prod-github-runner-207 kernel: [71808.571791] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 01:20:34 juju-e4d256-prod-github-runner-207 kernel: [71808.573010] Call Trace: Aug 23 01:20:34 juju-e4d256-prod-github-runner-207 kernel: [71808.573938] Aug 23 01:20:34 juju-e4d256-prod-github-runner-207 kernel: [71808.574853] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:20:34 juju-e4d256-prod-github-runner-207 kernel: [71808.575889] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:20:34 juju-e4d256-prod-github-runner-207 kernel: [71808.576914] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:20:34 juju-e4d256-prod-github-runner-207 kernel: [71808.578028] ? show_regs.part.0+0x23/0x29 Aug 23 01:20:34 juju-e4d256-prod-github-runner-207 kernel: [71808.579068] ? show_regs.cold+0x8/0xd Aug 23 01:20:34 juju-e4d256-prod-github-runner-207 kernel: [71808.580045] ? watchdog_timer_fn+0x1be/0x220 Aug 23 01:20:34 juju-e4d256-prod-github-runner-207 kernel: [71808.581053] ? lockup_detector_update_enable+0x60/0x60 Aug 23 01:20:34 juju-e4d256-prod-github-runner-207 kernel: [71808.582119] ? __hrtimer_run_queues+0x107/0x230 Aug 23 01:20:34 juju-e4d256-prod-github-runner-207 kernel: [71808.583172] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 01:20:34 juju-e4d256-prod-github-runner-207 kernel: [71808.584212] ? hrtimer_interrupt+0x101/0x220 Aug 23 01:20:34 juju-e4d256-prod-github-runner-207 kernel: [71808.585242] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 01:20:34 juju-e4d256-prod-github-runner-207 kernel: [71808.586371] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 01:20:34 juju-e4d256-prod-github-runner-207 kernel: [71808.587913] Aug 23 01:20:34 juju-e4d256-prod-github-runner-207 kernel: [71808.590329] Aug 23 01:20:34 juju-e4d256-prod-github-runner-207 kernel: [71808.591196] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 01:20:34 juju-e4d256-prod-github-runner-207 kernel: [71808.592679] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:20:34 juju-e4d256-prod-github-runner-207 kernel: [71808.593848] ? _raw_spin_lock+0x22/0x30 Aug 23 01:20:34 juju-e4d256-prod-github-runner-207 kernel: [71808.594827] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:20:34 juju-e4d256-prod-github-runner-207 kernel: [71808.595856] direct_page_fault+0x206/0x310 [kvm] Aug 23 01:20:34 juju-e4d256-prod-github-runner-207 kernel: [71808.596895] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 01:20:34 juju-e4d256-prod-github-runner-207 kernel: [71808.597914] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 01:20:34 juju-e4d256-prod-github-runner-207 kernel: [71808.598933] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 01:20:34 juju-e4d256-prod-github-runner-207 kernel: [71808.599930] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 01:20:34 juju-e4d256-prod-github-runner-207 kernel: [71808.600875] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 01:20:34 juju-e4d256-prod-github-runner-207 kernel: [71808.601852] handle_exit+0x98/0x230 [kvm_amd] Aug 23 01:20:34 juju-e4d256-prod-github-runner-207 kernel: [71808.602757] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 01:20:34 juju-e4d256-prod-github-runner-207 kernel: [71808.603672] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 01:20:34 juju-e4d256-prod-github-runner-207 kernel: [71808.604601] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 01:20:34 juju-e4d256-prod-github-runner-207 kernel: [71808.605507] vcpu_run+0x62/0x2c0 [kvm] Aug 23 01:20:34 juju-e4d256-prod-github-runner-207 kernel: [71808.606319] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 01:20:34 juju-e4d256-prod-github-runner-207 kernel: [71808.607131] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 01:20:34 juju-e4d256-prod-github-runner-207 kernel: [71808.607986] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 01:20:34 juju-e4d256-prod-github-runner-207 kernel: [71808.608790] ? __seccomp_filter+0x4a/0x4a0 Aug 23 01:20:34 juju-e4d256-prod-github-runner-207 kernel: [71808.609533] ? __fget_files+0x86/0xc0 Aug 23 01:20:34 juju-e4d256-prod-github-runner-207 kernel: [71808.610237] __x64_sys_ioctl+0x95/0xd0 Aug 23 01:20:34 juju-e4d256-prod-github-runner-207 kernel: [71808.610950] do_syscall_64+0x5c/0xc0 Aug 23 01:20:34 juju-e4d256-prod-github-runner-207 kernel: [71808.611615] ? do_futex+0x162/0x1f0 Aug 23 01:20:34 juju-e4d256-prod-github-runner-207 kernel: [71808.612313] ? __x64_sys_futex+0x78/0x1e0 Aug 23 01:20:34 juju-e4d256-prod-github-runner-207 kernel: [71808.612993] ? __secure_computing+0xa9/0x120 Aug 23 01:20:34 juju-e4d256-prod-github-runner-207 kernel: [71808.613685] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 01:20:34 juju-e4d256-prod-github-runner-207 kernel: [71808.614447] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:20:34 juju-e4d256-prod-github-runner-207 kernel: [71808.616039] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:20:34 juju-e4d256-prod-github-runner-207 kernel: [71808.616762] ? do_syscall_64+0x69/0xc0 Aug 23 01:20:34 juju-e4d256-prod-github-runner-207 kernel: [71808.617409] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:20:34 juju-e4d256-prod-github-runner-207 kernel: [71808.618112] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:20:34 juju-e4d256-prod-github-runner-207 kernel: [71808.618822] ? do_syscall_64+0x69/0xc0 Aug 23 01:20:34 juju-e4d256-prod-github-runner-207 kernel: [71808.619450] ? do_syscall_64+0x69/0xc0 Aug 23 01:20:34 juju-e4d256-prod-github-runner-207 kernel: [71808.620073] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 01:20:34 juju-e4d256-prod-github-runner-207 kernel: [71808.620782] RIP: 0033:0x7faa5d0edaff Aug 23 01:20:34 juju-e4d256-prod-github-runner-207 kernel: [71808.621442] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 01:20:34 juju-e4d256-prod-github-runner-207 kernel: [71808.623496] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 01:20:34 juju-e4d256-prod-github-runner-207 kernel: [71808.624464] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 01:20:34 juju-e4d256-prod-github-runner-207 kernel: [71808.625370] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 01:20:34 juju-e4d256-prod-github-runner-207 kernel: [71808.626264] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 01:20:34 juju-e4d256-prod-github-runner-207 kernel: [71808.627176] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 01:20:34 juju-e4d256-prod-github-runner-207 kernel: [71808.628080] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 01:20:34 juju-e4d256-prod-github-runner-207 kernel: [71808.628979] Aug 23 01:20:48 juju-e4d256-prod-github-runner-207 kernel: [71821.976847] rcu: INFO: rcu_sched self-detected stall on CPU Aug 23 01:20:48 juju-e4d256-prod-github-runner-207 kernel: [71821.977808] rcu: 1-....: (17869761 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=8632107 Aug 23 01:20:48 juju-e4d256-prod-github-runner-207 kernel: [71821.978947] (t=17926194 jiffies g=23269 q=61575) Aug 23 01:20:48 juju-e4d256-prod-github-runner-207 kernel: [71821.979763] NMI backtrace for cpu 1 Aug 23 01:20:48 juju-e4d256-prod-github-runner-207 kernel: [71821.980486] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 01:20:48 juju-e4d256-prod-github-runner-207 kernel: [71821.981597] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 01:20:48 juju-e4d256-prod-github-runner-207 kernel: [71821.982680] Call Trace: Aug 23 01:20:48 juju-e4d256-prod-github-runner-207 kernel: [71821.983357] Aug 23 01:20:48 juju-e4d256-prod-github-runner-207 kernel: [71821.984022] show_stack+0x52/0x5c Aug 23 01:20:48 juju-e4d256-prod-github-runner-207 kernel: [71821.984754] dump_stack_lvl+0x4a/0x63 Aug 23 01:20:48 juju-e4d256-prod-github-runner-207 kernel: [71821.985499] dump_stack+0x10/0x16 Aug 23 01:20:48 juju-e4d256-prod-github-runner-207 kernel: [71821.986233] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 23 01:20:48 juju-e4d256-prod-github-runner-207 kernel: [71821.987034] ? lapic_can_unplug_cpu+0x90/0x90 Aug 23 01:20:48 juju-e4d256-prod-github-runner-207 kernel: [71821.987816] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 23 01:20:48 juju-e4d256-prod-github-runner-207 kernel: [71821.988633] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 23 01:20:48 juju-e4d256-prod-github-runner-207 kernel: [71821.989450] trigger_single_cpu_backtrace+0x44/0x4f Aug 23 01:20:48 juju-e4d256-prod-github-runner-207 kernel: [71821.990277] rcu_dump_cpu_stacks+0x102/0x149 Aug 23 01:20:48 juju-e4d256-prod-github-runner-207 kernel: [71821.991080] print_cpu_stall.cold+0x2f/0xe2 Aug 23 01:20:48 juju-e4d256-prod-github-runner-207 kernel: [71821.991846] ? timekeeping_update+0xf7/0x150 Aug 23 01:20:48 juju-e4d256-prod-github-runner-207 kernel: [71821.992614] check_cpu_stall+0x109/0x270 Aug 23 01:20:48 juju-e4d256-prod-github-runner-207 kernel: [71821.993361] rcu_sched_clock_irq+0x9a/0x250 Aug 23 01:20:48 juju-e4d256-prod-github-runner-207 kernel: [71821.994120] update_process_times+0x94/0xd0 Aug 23 01:20:48 juju-e4d256-prod-github-runner-207 kernel: [71821.994888] tick_sched_handle+0x29/0x70 Aug 23 01:20:48 juju-e4d256-prod-github-runner-207 kernel: [71821.995633] tick_sched_timer+0x8c/0xc0 Aug 23 01:20:48 juju-e4d256-prod-github-runner-207 kernel: [71821.996369] ? tick_nohz_handler+0xb0/0xb0 Aug 23 01:20:48 juju-e4d256-prod-github-runner-207 kernel: [71821.997123] __hrtimer_run_queues+0x107/0x230 Aug 23 01:20:48 juju-e4d256-prod-github-runner-207 kernel: [71821.997895] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 01:20:48 juju-e4d256-prod-github-runner-207 kernel: [71821.998679] hrtimer_interrupt+0x101/0x220 Aug 23 01:20:48 juju-e4d256-prod-github-runner-207 kernel: [71821.999449] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 01:20:48 juju-e4d256-prod-github-runner-207 kernel: [71822.000289] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 01:20:48 juju-e4d256-prod-github-runner-207 kernel: [71822.001095] Aug 23 01:20:48 juju-e4d256-prod-github-runner-207 kernel: [71822.001730] Aug 23 01:20:48 juju-e4d256-prod-github-runner-207 kernel: [71822.002370] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 01:20:48 juju-e4d256-prod-github-runner-207 kernel: [71822.003186] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:20:48 juju-e4d256-prod-github-runner-207 kernel: [71822.004072] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 01:20:48 juju-e4d256-prod-github-runner-207 kernel: [71822.006266] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 01:20:48 juju-e4d256-prod-github-runner-207 kernel: [71822.007150] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 01:20:48 juju-e4d256-prod-github-runner-207 kernel: [71822.008146] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 01:20:48 juju-e4d256-prod-github-runner-207 kernel: [71822.009137] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 01:20:48 juju-e4d256-prod-github-runner-207 kernel: [71822.010114] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 01:20:48 juju-e4d256-prod-github-runner-207 kernel: [71822.011102] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 01:20:48 juju-e4d256-prod-github-runner-207 kernel: [71822.012056] ? _raw_spin_lock+0x22/0x30 Aug 23 01:20:48 juju-e4d256-prod-github-runner-207 kernel: [71822.012817] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:20:48 juju-e4d256-prod-github-runner-207 kernel: [71822.013653] direct_page_fault+0x206/0x310 [kvm] Aug 23 01:20:48 juju-e4d256-prod-github-runner-207 kernel: [71822.014508] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 01:20:48 juju-e4d256-prod-github-runner-207 kernel: [71822.015341] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 01:20:48 juju-e4d256-prod-github-runner-207 kernel: [71822.016181] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 01:20:48 juju-e4d256-prod-github-runner-207 kernel: [71822.016999] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 01:20:48 juju-e4d256-prod-github-runner-207 kernel: [71822.017787] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 01:20:48 juju-e4d256-prod-github-runner-207 kernel: [71822.018622] handle_exit+0x98/0x230 [kvm_amd] Aug 23 01:20:48 juju-e4d256-prod-github-runner-207 kernel: [71822.019382] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 01:20:48 juju-e4d256-prod-github-runner-207 kernel: [71822.020181] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 01:20:48 juju-e4d256-prod-github-runner-207 kernel: [71822.020991] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 01:20:48 juju-e4d256-prod-github-runner-207 kernel: [71822.021775] vcpu_run+0x62/0x2c0 [kvm] Aug 23 01:20:48 juju-e4d256-prod-github-runner-207 kernel: [71822.022504] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 01:20:48 juju-e4d256-prod-github-runner-207 kernel: [71822.023243] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 01:20:48 juju-e4d256-prod-github-runner-207 kernel: [71822.024051] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 01:20:48 juju-e4d256-prod-github-runner-207 kernel: [71822.024815] ? __seccomp_filter+0x4a/0x4a0 Aug 23 01:20:48 juju-e4d256-prod-github-runner-207 kernel: [71822.025538] ? __fget_files+0x86/0xc0 Aug 23 01:20:48 juju-e4d256-prod-github-runner-207 kernel: [71822.026232] __x64_sys_ioctl+0x95/0xd0 Aug 23 01:20:48 juju-e4d256-prod-github-runner-207 kernel: [71822.026940] do_syscall_64+0x5c/0xc0 Aug 23 01:20:48 juju-e4d256-prod-github-runner-207 kernel: [71822.027631] ? do_futex+0x162/0x1f0 Aug 23 01:20:48 juju-e4d256-prod-github-runner-207 kernel: [71822.028309] ? __x64_sys_futex+0x78/0x1e0 Aug 23 01:20:48 juju-e4d256-prod-github-runner-207 kernel: [71822.029019] ? __secure_computing+0xa9/0x120 Aug 23 01:20:48 juju-e4d256-prod-github-runner-207 kernel: [71822.029741] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 01:20:48 juju-e4d256-prod-github-runner-207 kernel: [71822.030565] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:20:48 juju-e4d256-prod-github-runner-207 kernel: [71822.031325] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:20:48 juju-e4d256-prod-github-runner-207 kernel: [71822.032082] ? do_syscall_64+0x69/0xc0 Aug 23 01:20:48 juju-e4d256-prod-github-runner-207 kernel: [71822.032778] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:20:48 juju-e4d256-prod-github-runner-207 kernel: [71822.033540] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:20:48 juju-e4d256-prod-github-runner-207 kernel: [71822.034299] ? do_syscall_64+0x69/0xc0 Aug 23 01:20:48 juju-e4d256-prod-github-runner-207 kernel: [71822.035011] ? do_syscall_64+0x69/0xc0 Aug 23 01:20:48 juju-e4d256-prod-github-runner-207 kernel: [71822.035702] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 01:20:48 juju-e4d256-prod-github-runner-207 kernel: [71822.036473] RIP: 0033:0x7faa5d0edaff Aug 23 01:20:48 juju-e4d256-prod-github-runner-207 kernel: [71822.037159] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 01:20:48 juju-e4d256-prod-github-runner-207 kernel: [71822.039285] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 01:20:48 juju-e4d256-prod-github-runner-207 kernel: [71822.040262] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 01:20:48 juju-e4d256-prod-github-runner-207 kernel: [71822.041211] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 01:20:48 juju-e4d256-prod-github-runner-207 kernel: [71822.042162] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 01:20:48 juju-e4d256-prod-github-runner-207 kernel: [71822.043133] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 01:20:48 juju-e4d256-prod-github-runner-207 kernel: [71822.044063] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 01:20:48 juju-e4d256-prod-github-runner-207 kernel: [71822.044985] Aug 23 01:21:14 juju-e4d256-prod-github-runner-207 kernel: [71848.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 66806s! [qemu-system-x86:6715] Aug 23 01:21:14 juju-e4d256-prod-github-runner-207 kernel: [71848.543100] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 01:21:14 juju-e4d256-prod-github-runner-207 kernel: [71848.543167] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 01:21:14 juju-e4d256-prod-github-runner-207 kernel: [71848.555238] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 01:21:14 juju-e4d256-prod-github-runner-207 kernel: [71848.556502] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 01:21:14 juju-e4d256-prod-github-runner-207 kernel: [71848.557722] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:21:14 juju-e4d256-prod-github-runner-207 kernel: [71848.558792] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 01:21:14 juju-e4d256-prod-github-runner-207 kernel: [71848.561339] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 01:21:14 juju-e4d256-prod-github-runner-207 kernel: [71848.562390] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 01:21:14 juju-e4d256-prod-github-runner-207 kernel: [71848.563557] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 01:21:14 juju-e4d256-prod-github-runner-207 kernel: [71848.564717] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 01:21:14 juju-e4d256-prod-github-runner-207 kernel: [71848.565883] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 01:21:14 juju-e4d256-prod-github-runner-207 kernel: [71848.567059] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 01:21:14 juju-e4d256-prod-github-runner-207 kernel: [71848.568225] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 01:21:14 juju-e4d256-prod-github-runner-207 kernel: [71848.569458] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 01:21:14 juju-e4d256-prod-github-runner-207 kernel: [71848.570826] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 01:21:14 juju-e4d256-prod-github-runner-207 kernel: [71848.572039] Call Trace: Aug 23 01:21:14 juju-e4d256-prod-github-runner-207 kernel: [71848.572955] Aug 23 01:21:14 juju-e4d256-prod-github-runner-207 kernel: [71848.573837] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:21:14 juju-e4d256-prod-github-runner-207 kernel: [71848.574875] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:21:14 juju-e4d256-prod-github-runner-207 kernel: [71848.575918] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:21:14 juju-e4d256-prod-github-runner-207 kernel: [71848.576993] ? show_regs.part.0+0x23/0x29 Aug 23 01:21:14 juju-e4d256-prod-github-runner-207 kernel: [71848.578077] ? show_regs.cold+0x8/0xd Aug 23 01:21:14 juju-e4d256-prod-github-runner-207 kernel: [71848.579169] ? watchdog_timer_fn+0x1be/0x220 Aug 23 01:21:14 juju-e4d256-prod-github-runner-207 kernel: [71848.580202] ? lockup_detector_update_enable+0x60/0x60 Aug 23 01:21:14 juju-e4d256-prod-github-runner-207 kernel: [71848.581357] ? __hrtimer_run_queues+0x107/0x230 Aug 23 01:21:14 juju-e4d256-prod-github-runner-207 kernel: [71848.582414] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 01:21:14 juju-e4d256-prod-github-runner-207 kernel: [71848.583440] ? hrtimer_interrupt+0x101/0x220 Aug 23 01:21:14 juju-e4d256-prod-github-runner-207 kernel: [71848.584454] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 01:21:14 juju-e4d256-prod-github-runner-207 kernel: [71848.585532] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 01:21:14 juju-e4d256-prod-github-runner-207 kernel: [71848.586735] Aug 23 01:21:14 juju-e4d256-prod-github-runner-207 kernel: [71848.587854] Aug 23 01:21:14 juju-e4d256-prod-github-runner-207 kernel: [71848.588966] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 01:21:14 juju-e4d256-prod-github-runner-207 kernel: [71848.590405] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:21:14 juju-e4d256-prod-github-runner-207 kernel: [71848.591825] ? _raw_spin_lock+0x22/0x30 Aug 23 01:21:14 juju-e4d256-prod-github-runner-207 kernel: [71848.593076] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:21:14 juju-e4d256-prod-github-runner-207 kernel: [71848.594368] direct_page_fault+0x206/0x310 [kvm] Aug 23 01:21:14 juju-e4d256-prod-github-runner-207 kernel: [71848.595464] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 01:21:14 juju-e4d256-prod-github-runner-207 kernel: [71848.596478] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 01:21:14 juju-e4d256-prod-github-runner-207 kernel: [71848.597509] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 01:21:14 juju-e4d256-prod-github-runner-207 kernel: [71848.598507] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 01:21:14 juju-e4d256-prod-github-runner-207 kernel: [71848.599505] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 01:21:14 juju-e4d256-prod-github-runner-207 kernel: [71848.600600] handle_exit+0x98/0x230 [kvm_amd] Aug 23 01:21:14 juju-e4d256-prod-github-runner-207 kernel: [71848.601662] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 01:21:14 juju-e4d256-prod-github-runner-207 kernel: [71848.602850] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 01:21:14 juju-e4d256-prod-github-runner-207 kernel: [71848.603798] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 01:21:14 juju-e4d256-prod-github-runner-207 kernel: [71848.604804] vcpu_run+0x62/0x2c0 [kvm] Aug 23 01:21:14 juju-e4d256-prod-github-runner-207 kernel: [71848.605682] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 01:21:14 juju-e4d256-prod-github-runner-207 kernel: [71848.606516] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 01:21:14 juju-e4d256-prod-github-runner-207 kernel: [71848.607377] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 01:21:14 juju-e4d256-prod-github-runner-207 kernel: [71848.608180] ? __seccomp_filter+0x4a/0x4a0 Aug 23 01:21:14 juju-e4d256-prod-github-runner-207 kernel: [71848.608927] ? __fget_files+0x86/0xc0 Aug 23 01:21:14 juju-e4d256-prod-github-runner-207 kernel: [71848.609634] __x64_sys_ioctl+0x95/0xd0 Aug 23 01:21:14 juju-e4d256-prod-github-runner-207 kernel: [71848.610335] do_syscall_64+0x5c/0xc0 Aug 23 01:21:14 juju-e4d256-prod-github-runner-207 kernel: [71848.611047] ? do_futex+0x162/0x1f0 Aug 23 01:21:14 juju-e4d256-prod-github-runner-207 kernel: [71848.611746] ? __x64_sys_futex+0x78/0x1e0 Aug 23 01:21:14 juju-e4d256-prod-github-runner-207 kernel: [71848.612426] ? __secure_computing+0xa9/0x120 Aug 23 01:21:14 juju-e4d256-prod-github-runner-207 kernel: [71848.613180] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 01:21:14 juju-e4d256-prod-github-runner-207 kernel: [71848.614285] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:21:14 juju-e4d256-prod-github-runner-207 kernel: [71848.615055] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:21:14 juju-e4d256-prod-github-runner-207 kernel: [71848.615780] ? do_syscall_64+0x69/0xc0 Aug 23 01:21:14 juju-e4d256-prod-github-runner-207 kernel: [71848.616496] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:21:14 juju-e4d256-prod-github-runner-207 kernel: [71848.617246] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:21:14 juju-e4d256-prod-github-runner-207 kernel: [71848.618006] ? do_syscall_64+0x69/0xc0 Aug 23 01:21:14 juju-e4d256-prod-github-runner-207 kernel: [71848.618811] ? do_syscall_64+0x69/0xc0 Aug 23 01:21:14 juju-e4d256-prod-github-runner-207 kernel: [71848.619443] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 01:21:14 juju-e4d256-prod-github-runner-207 kernel: [71848.620152] RIP: 0033:0x7faa5d0edaff Aug 23 01:21:14 juju-e4d256-prod-github-runner-207 kernel: [71848.620784] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 01:21:14 juju-e4d256-prod-github-runner-207 kernel: [71848.622801] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 01:21:14 juju-e4d256-prod-github-runner-207 kernel: [71848.623717] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 01:21:14 juju-e4d256-prod-github-runner-207 kernel: [71848.624609] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 01:21:14 juju-e4d256-prod-github-runner-207 kernel: [71848.625501] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 01:21:14 juju-e4d256-prod-github-runner-207 kernel: [71848.626397] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 01:21:14 juju-e4d256-prod-github-runner-207 kernel: [71848.627316] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 01:21:14 juju-e4d256-prod-github-runner-207 kernel: [71848.628283] Aug 23 01:21:42 juju-e4d256-prod-github-runner-207 kernel: [71876.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 66832s! [qemu-system-x86:6715] Aug 23 01:21:42 juju-e4d256-prod-github-runner-207 kernel: [71876.543122] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 01:21:42 juju-e4d256-prod-github-runner-207 kernel: [71876.543190] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 01:21:42 juju-e4d256-prod-github-runner-207 kernel: [71876.555297] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 01:21:42 juju-e4d256-prod-github-runner-207 kernel: [71876.556557] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 01:21:42 juju-e4d256-prod-github-runner-207 kernel: [71876.557775] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:21:42 juju-e4d256-prod-github-runner-207 kernel: [71876.558859] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 01:21:42 juju-e4d256-prod-github-runner-207 kernel: [71876.561490] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 01:21:42 juju-e4d256-prod-github-runner-207 kernel: [71876.562576] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 01:21:42 juju-e4d256-prod-github-runner-207 kernel: [71876.563756] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 01:21:42 juju-e4d256-prod-github-runner-207 kernel: [71876.564921] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 01:21:42 juju-e4d256-prod-github-runner-207 kernel: [71876.566113] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 01:21:42 juju-e4d256-prod-github-runner-207 kernel: [71876.567276] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 01:21:42 juju-e4d256-prod-github-runner-207 kernel: [71876.568448] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 01:21:42 juju-e4d256-prod-github-runner-207 kernel: [71876.569752] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 01:21:42 juju-e4d256-prod-github-runner-207 kernel: [71876.570892] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 01:21:42 juju-e4d256-prod-github-runner-207 kernel: [71876.572090] Call Trace: Aug 23 01:21:42 juju-e4d256-prod-github-runner-207 kernel: [71876.573013] Aug 23 01:21:42 juju-e4d256-prod-github-runner-207 kernel: [71876.573925] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:21:42 juju-e4d256-prod-github-runner-207 kernel: [71876.574955] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:21:42 juju-e4d256-prod-github-runner-207 kernel: [71876.575973] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:21:42 juju-e4d256-prod-github-runner-207 kernel: [71876.577049] ? show_regs.part.0+0x23/0x29 Aug 23 01:21:42 juju-e4d256-prod-github-runner-207 kernel: [71876.578068] ? show_regs.cold+0x8/0xd Aug 23 01:21:42 juju-e4d256-prod-github-runner-207 kernel: [71876.579039] ? watchdog_timer_fn+0x1be/0x220 Aug 23 01:21:42 juju-e4d256-prod-github-runner-207 kernel: [71876.580047] ? lockup_detector_update_enable+0x60/0x60 Aug 23 01:21:42 juju-e4d256-prod-github-runner-207 kernel: [71876.581108] ? __hrtimer_run_queues+0x107/0x230 Aug 23 01:21:42 juju-e4d256-prod-github-runner-207 kernel: [71876.582154] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 01:21:42 juju-e4d256-prod-github-runner-207 kernel: [71876.583176] ? hrtimer_interrupt+0x101/0x220 Aug 23 01:21:42 juju-e4d256-prod-github-runner-207 kernel: [71876.584194] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 01:21:42 juju-e4d256-prod-github-runner-207 kernel: [71876.585259] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 01:21:42 juju-e4d256-prod-github-runner-207 kernel: [71876.586325] Aug 23 01:21:42 juju-e4d256-prod-github-runner-207 kernel: [71876.587177] Aug 23 01:21:42 juju-e4d256-prod-github-runner-207 kernel: [71876.588012] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 01:21:42 juju-e4d256-prod-github-runner-207 kernel: [71876.589041] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:21:42 juju-e4d256-prod-github-runner-207 kernel: [71876.590146] ? _raw_spin_lock+0x22/0x30 Aug 23 01:21:42 juju-e4d256-prod-github-runner-207 kernel: [71876.591095] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:21:42 juju-e4d256-prod-github-runner-207 kernel: [71876.592113] direct_page_fault+0x206/0x310 [kvm] Aug 23 01:21:42 juju-e4d256-prod-github-runner-207 kernel: [71876.593147] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 01:21:42 juju-e4d256-prod-github-runner-207 kernel: [71876.594195] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 01:21:42 juju-e4d256-prod-github-runner-207 kernel: [71876.595198] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 01:21:42 juju-e4d256-prod-github-runner-207 kernel: [71876.596166] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 01:21:42 juju-e4d256-prod-github-runner-207 kernel: [71876.597109] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 01:21:42 juju-e4d256-prod-github-runner-207 kernel: [71876.598129] handle_exit+0x98/0x230 [kvm_amd] Aug 23 01:21:42 juju-e4d256-prod-github-runner-207 kernel: [71876.599036] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 01:21:42 juju-e4d256-prod-github-runner-207 kernel: [71876.599955] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 01:21:42 juju-e4d256-prod-github-runner-207 kernel: [71876.600883] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 01:21:42 juju-e4d256-prod-github-runner-207 kernel: [71876.601792] vcpu_run+0x62/0x2c0 [kvm] Aug 23 01:21:42 juju-e4d256-prod-github-runner-207 kernel: [71876.602621] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 01:21:42 juju-e4d256-prod-github-runner-207 kernel: [71876.603429] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 01:21:42 juju-e4d256-prod-github-runner-207 kernel: [71876.604292] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 01:21:42 juju-e4d256-prod-github-runner-207 kernel: [71876.605122] ? __seccomp_filter+0x4a/0x4a0 Aug 23 01:21:42 juju-e4d256-prod-github-runner-207 kernel: [71876.605887] ? __fget_files+0x86/0xc0 Aug 23 01:21:42 juju-e4d256-prod-github-runner-207 kernel: [71876.606591] __x64_sys_ioctl+0x95/0xd0 Aug 23 01:21:42 juju-e4d256-prod-github-runner-207 kernel: [71876.607287] do_syscall_64+0x5c/0xc0 Aug 23 01:21:42 juju-e4d256-prod-github-runner-207 kernel: [71876.607953] ? do_futex+0x162/0x1f0 Aug 23 01:21:42 juju-e4d256-prod-github-runner-207 kernel: [71876.608602] ? __x64_sys_futex+0x78/0x1e0 Aug 23 01:21:42 juju-e4d256-prod-github-runner-207 kernel: [71876.609304] ? __secure_computing+0xa9/0x120 Aug 23 01:21:42 juju-e4d256-prod-github-runner-207 kernel: [71876.610054] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 01:21:42 juju-e4d256-prod-github-runner-207 kernel: [71876.610819] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:21:42 juju-e4d256-prod-github-runner-207 kernel: [71876.611538] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:21:42 juju-e4d256-prod-github-runner-207 kernel: [71876.612486] ? do_syscall_64+0x69/0xc0 Aug 23 01:21:42 juju-e4d256-prod-github-runner-207 kernel: [71876.613195] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:21:42 juju-e4d256-prod-github-runner-207 kernel: [71876.613933] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:21:42 juju-e4d256-prod-github-runner-207 kernel: [71876.614640] ? do_syscall_64+0x69/0xc0 Aug 23 01:21:42 juju-e4d256-prod-github-runner-207 kernel: [71876.615295] ? do_syscall_64+0x69/0xc0 Aug 23 01:21:42 juju-e4d256-prod-github-runner-207 kernel: [71876.616029] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 01:21:42 juju-e4d256-prod-github-runner-207 kernel: [71876.616752] RIP: 0033:0x7faa5d0edaff Aug 23 01:21:42 juju-e4d256-prod-github-runner-207 kernel: [71876.617489] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 01:21:42 juju-e4d256-prod-github-runner-207 kernel: [71876.619575] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 01:21:42 juju-e4d256-prod-github-runner-207 kernel: [71876.620498] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 01:21:42 juju-e4d256-prod-github-runner-207 kernel: [71876.621391] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 01:21:42 juju-e4d256-prod-github-runner-207 kernel: [71876.622306] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 01:21:42 juju-e4d256-prod-github-runner-207 kernel: [71876.623206] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 01:21:42 juju-e4d256-prod-github-runner-207 kernel: [71876.624099] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 01:21:42 juju-e4d256-prod-github-runner-207 kernel: [71876.624993] Aug 23 01:22:10 juju-e4d256-prod-github-runner-207 kernel: [71904.541981] watchdog: BUG: soft lockup - CPU#1 stuck for 66858s! [qemu-system-x86:6715] Aug 23 01:22:10 juju-e4d256-prod-github-runner-207 kernel: [71904.543689] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 01:22:10 juju-e4d256-prod-github-runner-207 kernel: [71904.543919] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 01:22:10 juju-e4d256-prod-github-runner-207 kernel: [71904.555980] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 01:22:10 juju-e4d256-prod-github-runner-207 kernel: [71904.557240] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 01:22:10 juju-e4d256-prod-github-runner-207 kernel: [71904.558474] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:22:10 juju-e4d256-prod-github-runner-207 kernel: [71904.559529] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 01:22:10 juju-e4d256-prod-github-runner-207 kernel: [71904.562125] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 01:22:10 juju-e4d256-prod-github-runner-207 kernel: [71904.563174] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 01:22:10 juju-e4d256-prod-github-runner-207 kernel: [71904.564369] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 01:22:10 juju-e4d256-prod-github-runner-207 kernel: [71904.565553] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 01:22:10 juju-e4d256-prod-github-runner-207 kernel: [71904.566714] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 01:22:10 juju-e4d256-prod-github-runner-207 kernel: [71904.567871] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 01:22:10 juju-e4d256-prod-github-runner-207 kernel: [71904.569037] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 01:22:10 juju-e4d256-prod-github-runner-207 kernel: [71904.570308] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 01:22:10 juju-e4d256-prod-github-runner-207 kernel: [71904.571437] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 01:22:10 juju-e4d256-prod-github-runner-207 kernel: [71904.572646] Call Trace: Aug 23 01:22:10 juju-e4d256-prod-github-runner-207 kernel: [71904.573598] Aug 23 01:22:10 juju-e4d256-prod-github-runner-207 kernel: [71904.574509] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:22:10 juju-e4d256-prod-github-runner-207 kernel: [71904.575548] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:22:10 juju-e4d256-prod-github-runner-207 kernel: [71904.576569] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:22:10 juju-e4d256-prod-github-runner-207 kernel: [71904.577696] ? show_regs.part.0+0x23/0x29 Aug 23 01:22:10 juju-e4d256-prod-github-runner-207 kernel: [71904.578699] ? show_regs.cold+0x8/0xd Aug 23 01:22:10 juju-e4d256-prod-github-runner-207 kernel: [71904.579669] ? watchdog_timer_fn+0x1be/0x220 Aug 23 01:22:10 juju-e4d256-prod-github-runner-207 kernel: [71904.580675] ? lockup_detector_update_enable+0x60/0x60 Aug 23 01:22:10 juju-e4d256-prod-github-runner-207 kernel: [71904.581757] ? __hrtimer_run_queues+0x107/0x230 Aug 23 01:22:10 juju-e4d256-prod-github-runner-207 kernel: [71904.582784] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 01:22:10 juju-e4d256-prod-github-runner-207 kernel: [71904.583805] ? hrtimer_interrupt+0x101/0x220 Aug 23 01:22:10 juju-e4d256-prod-github-runner-207 kernel: [71904.584818] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 01:22:10 juju-e4d256-prod-github-runner-207 kernel: [71904.585899] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 01:22:10 juju-e4d256-prod-github-runner-207 kernel: [71904.586944] Aug 23 01:22:10 juju-e4d256-prod-github-runner-207 kernel: [71904.587795] Aug 23 01:22:10 juju-e4d256-prod-github-runner-207 kernel: [71904.588630] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 01:22:10 juju-e4d256-prod-github-runner-207 kernel: [71904.589836] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:22:10 juju-e4d256-prod-github-runner-207 kernel: [71904.590987] ? _raw_spin_lock+0x22/0x30 Aug 23 01:22:10 juju-e4d256-prod-github-runner-207 kernel: [71904.592011] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:22:10 juju-e4d256-prod-github-runner-207 kernel: [71904.593125] direct_page_fault+0x206/0x310 [kvm] Aug 23 01:22:10 juju-e4d256-prod-github-runner-207 kernel: [71904.594264] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 01:22:10 juju-e4d256-prod-github-runner-207 kernel: [71904.595368] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 01:22:10 juju-e4d256-prod-github-runner-207 kernel: [71904.596464] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 01:22:10 juju-e4d256-prod-github-runner-207 kernel: [71904.597631] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 01:22:10 juju-e4d256-prod-github-runner-207 kernel: [71904.598692] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 01:22:10 juju-e4d256-prod-github-runner-207 kernel: [71904.599780] handle_exit+0x98/0x230 [kvm_amd] Aug 23 01:22:10 juju-e4d256-prod-github-runner-207 kernel: [71904.600771] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 01:22:10 juju-e4d256-prod-github-runner-207 kernel: [71904.601796] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 01:22:10 juju-e4d256-prod-github-runner-207 kernel: [71904.602819] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 01:22:10 juju-e4d256-prod-github-runner-207 kernel: [71904.603818] vcpu_run+0x62/0x2c0 [kvm] Aug 23 01:22:10 juju-e4d256-prod-github-runner-207 kernel: [71904.604701] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 01:22:10 juju-e4d256-prod-github-runner-207 kernel: [71904.605639] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 01:22:10 juju-e4d256-prod-github-runner-207 kernel: [71904.606593] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 01:22:10 juju-e4d256-prod-github-runner-207 kernel: [71904.607478] ? __seccomp_filter+0x4a/0x4a0 Aug 23 01:22:10 juju-e4d256-prod-github-runner-207 kernel: [71904.608307] ? __fget_files+0x86/0xc0 Aug 23 01:22:10 juju-e4d256-prod-github-runner-207 kernel: [71904.609086] __x64_sys_ioctl+0x95/0xd0 Aug 23 01:22:10 juju-e4d256-prod-github-runner-207 kernel: [71904.609872] do_syscall_64+0x5c/0xc0 Aug 23 01:22:10 juju-e4d256-prod-github-runner-207 kernel: [71904.610618] ? do_futex+0x162/0x1f0 Aug 23 01:22:10 juju-e4d256-prod-github-runner-207 kernel: [71904.611347] ? __x64_sys_futex+0x78/0x1e0 Aug 23 01:22:10 juju-e4d256-prod-github-runner-207 kernel: [71904.612119] ? __secure_computing+0xa9/0x120 Aug 23 01:22:10 juju-e4d256-prod-github-runner-207 kernel: [71904.612826] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 01:22:10 juju-e4d256-prod-github-runner-207 kernel: [71904.613608] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:22:10 juju-e4d256-prod-github-runner-207 kernel: [71904.614334] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:22:10 juju-e4d256-prod-github-runner-207 kernel: [71904.615052] ? do_syscall_64+0x69/0xc0 Aug 23 01:22:10 juju-e4d256-prod-github-runner-207 kernel: [71904.615698] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:22:10 juju-e4d256-prod-github-runner-207 kernel: [71904.616401] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:22:10 juju-e4d256-prod-github-runner-207 kernel: [71904.617099] ? do_syscall_64+0x69/0xc0 Aug 23 01:22:10 juju-e4d256-prod-github-runner-207 kernel: [71904.617747] ? do_syscall_64+0x69/0xc0 Aug 23 01:22:10 juju-e4d256-prod-github-runner-207 kernel: [71904.618371] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 01:22:10 juju-e4d256-prod-github-runner-207 kernel: [71904.619080] RIP: 0033:0x7faa5d0edaff Aug 23 01:22:10 juju-e4d256-prod-github-runner-207 kernel: [71904.619733] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 01:22:10 juju-e4d256-prod-github-runner-207 kernel: [71904.621750] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 01:22:10 juju-e4d256-prod-github-runner-207 kernel: [71904.622663] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 01:22:10 juju-e4d256-prod-github-runner-207 kernel: [71904.623557] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 01:22:10 juju-e4d256-prod-github-runner-207 kernel: [71904.624445] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 01:22:10 juju-e4d256-prod-github-runner-207 kernel: [71904.625335] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 01:22:10 juju-e4d256-prod-github-runner-207 kernel: [71904.626236] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 01:22:10 juju-e4d256-prod-github-runner-207 kernel: [71904.627129] Aug 23 01:22:38 juju-e4d256-prod-github-runner-207 kernel: [71932.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 66884s! [qemu-system-x86:6715] Aug 23 01:22:38 juju-e4d256-prod-github-runner-207 kernel: [71932.543120] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 01:22:38 juju-e4d256-prod-github-runner-207 kernel: [71932.543190] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 01:22:38 juju-e4d256-prod-github-runner-207 kernel: [71932.555501] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 01:22:38 juju-e4d256-prod-github-runner-207 kernel: [71932.556780] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 01:22:38 juju-e4d256-prod-github-runner-207 kernel: [71932.558025] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:22:38 juju-e4d256-prod-github-runner-207 kernel: [71932.559080] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 01:22:38 juju-e4d256-prod-github-runner-207 kernel: [71932.561664] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 01:22:38 juju-e4d256-prod-github-runner-207 kernel: [71932.562708] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 01:22:38 juju-e4d256-prod-github-runner-207 kernel: [71932.563867] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 01:22:38 juju-e4d256-prod-github-runner-207 kernel: [71932.565029] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 01:22:38 juju-e4d256-prod-github-runner-207 kernel: [71932.566224] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 01:22:38 juju-e4d256-prod-github-runner-207 kernel: [71932.567381] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 01:22:38 juju-e4d256-prod-github-runner-207 kernel: [71932.568545] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 01:22:38 juju-e4d256-prod-github-runner-207 kernel: [71932.569792] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 01:22:38 juju-e4d256-prod-github-runner-207 kernel: [71932.570897] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 01:22:38 juju-e4d256-prod-github-runner-207 kernel: [71932.572092] Call Trace: Aug 23 01:22:38 juju-e4d256-prod-github-runner-207 kernel: [71932.573007] Aug 23 01:22:38 juju-e4d256-prod-github-runner-207 kernel: [71932.573906] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:22:38 juju-e4d256-prod-github-runner-207 kernel: [71932.574937] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:22:38 juju-e4d256-prod-github-runner-207 kernel: [71932.575964] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:22:38 juju-e4d256-prod-github-runner-207 kernel: [71932.577059] ? show_regs.part.0+0x23/0x29 Aug 23 01:22:38 juju-e4d256-prod-github-runner-207 kernel: [71932.578084] ? show_regs.cold+0x8/0xd Aug 23 01:22:38 juju-e4d256-prod-github-runner-207 kernel: [71932.579057] ? watchdog_timer_fn+0x1be/0x220 Aug 23 01:22:38 juju-e4d256-prod-github-runner-207 kernel: [71932.580063] ? lockup_detector_update_enable+0x60/0x60 Aug 23 01:22:38 juju-e4d256-prod-github-runner-207 kernel: [71932.581136] ? __hrtimer_run_queues+0x107/0x230 Aug 23 01:22:38 juju-e4d256-prod-github-runner-207 kernel: [71932.582203] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 01:22:38 juju-e4d256-prod-github-runner-207 kernel: [71932.583225] ? hrtimer_interrupt+0x101/0x220 Aug 23 01:22:38 juju-e4d256-prod-github-runner-207 kernel: [71932.584239] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 01:22:38 juju-e4d256-prod-github-runner-207 kernel: [71932.585321] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 01:22:38 juju-e4d256-prod-github-runner-207 kernel: [71932.586386] Aug 23 01:22:38 juju-e4d256-prod-github-runner-207 kernel: [71932.587244] Aug 23 01:22:38 juju-e4d256-prod-github-runner-207 kernel: [71932.588080] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 01:22:38 juju-e4d256-prod-github-runner-207 kernel: [71932.589113] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:22:38 juju-e4d256-prod-github-runner-207 kernel: [71932.590171] ? _raw_spin_lock+0x22/0x30 Aug 23 01:22:38 juju-e4d256-prod-github-runner-207 kernel: [71932.591123] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:22:38 juju-e4d256-prod-github-runner-207 kernel: [71932.592146] direct_page_fault+0x206/0x310 [kvm] Aug 23 01:22:38 juju-e4d256-prod-github-runner-207 kernel: [71932.593174] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 01:22:38 juju-e4d256-prod-github-runner-207 kernel: [71932.594335] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 01:22:38 juju-e4d256-prod-github-runner-207 kernel: [71932.595336] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 01:22:38 juju-e4d256-prod-github-runner-207 kernel: [71932.596326] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 01:22:38 juju-e4d256-prod-github-runner-207 kernel: [71932.597298] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 01:22:38 juju-e4d256-prod-github-runner-207 kernel: [71932.598277] handle_exit+0x98/0x230 [kvm_amd] Aug 23 01:22:38 juju-e4d256-prod-github-runner-207 kernel: [71932.599170] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 01:22:38 juju-e4d256-prod-github-runner-207 kernel: [71932.600088] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 01:22:38 juju-e4d256-prod-github-runner-207 kernel: [71932.601012] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 01:22:38 juju-e4d256-prod-github-runner-207 kernel: [71932.601961] vcpu_run+0x62/0x2c0 [kvm] Aug 23 01:22:38 juju-e4d256-prod-github-runner-207 kernel: [71932.602779] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 01:22:38 juju-e4d256-prod-github-runner-207 kernel: [71932.603586] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 01:22:38 juju-e4d256-prod-github-runner-207 kernel: [71932.604440] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 01:22:38 juju-e4d256-prod-github-runner-207 kernel: [71932.605260] ? __seccomp_filter+0x4a/0x4a0 Aug 23 01:22:38 juju-e4d256-prod-github-runner-207 kernel: [71932.606009] ? __fget_files+0x86/0xc0 Aug 23 01:22:38 juju-e4d256-prod-github-runner-207 kernel: [71932.606721] __x64_sys_ioctl+0x95/0xd0 Aug 23 01:22:38 juju-e4d256-prod-github-runner-207 kernel: [71932.607450] do_syscall_64+0x5c/0xc0 Aug 23 01:22:38 juju-e4d256-prod-github-runner-207 kernel: [71932.608119] ? do_futex+0x162/0x1f0 Aug 23 01:22:38 juju-e4d256-prod-github-runner-207 kernel: [71932.608772] ? __x64_sys_futex+0x78/0x1e0 Aug 23 01:22:38 juju-e4d256-prod-github-runner-207 kernel: [71932.609465] ? __secure_computing+0xa9/0x120 Aug 23 01:22:38 juju-e4d256-prod-github-runner-207 kernel: [71932.610164] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 01:22:38 juju-e4d256-prod-github-runner-207 kernel: [71932.610927] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:22:38 juju-e4d256-prod-github-runner-207 kernel: [71932.611654] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:22:38 juju-e4d256-prod-github-runner-207 kernel: [71932.612391] ? do_syscall_64+0x69/0xc0 Aug 23 01:22:38 juju-e4d256-prod-github-runner-207 kernel: [71932.613035] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:22:38 juju-e4d256-prod-github-runner-207 kernel: [71932.613774] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:22:38 juju-e4d256-prod-github-runner-207 kernel: [71932.614470] ? do_syscall_64+0x69/0xc0 Aug 23 01:22:38 juju-e4d256-prod-github-runner-207 kernel: [71932.615100] ? do_syscall_64+0x69/0xc0 Aug 23 01:22:38 juju-e4d256-prod-github-runner-207 kernel: [71932.615726] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 01:22:38 juju-e4d256-prod-github-runner-207 kernel: [71932.616429] RIP: 0033:0x7faa5d0edaff Aug 23 01:22:38 juju-e4d256-prod-github-runner-207 kernel: [71932.617066] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 01:22:38 juju-e4d256-prod-github-runner-207 kernel: [71932.619083] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 01:22:38 juju-e4d256-prod-github-runner-207 kernel: [71932.619996] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 01:22:38 juju-e4d256-prod-github-runner-207 kernel: [71932.620884] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 01:22:38 juju-e4d256-prod-github-runner-207 kernel: [71932.621797] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 01:22:38 juju-e4d256-prod-github-runner-207 kernel: [71932.622705] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 01:22:38 juju-e4d256-prod-github-runner-207 kernel: [71932.623592] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 01:22:38 juju-e4d256-prod-github-runner-207 kernel: [71932.624484] Aug 23 01:23:06 juju-e4d256-prod-github-runner-207 kernel: [71960.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 66910s! [qemu-system-x86:6715] Aug 23 01:23:06 juju-e4d256-prod-github-runner-207 kernel: [71960.543093] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 01:23:06 juju-e4d256-prod-github-runner-207 kernel: [71960.543161] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 01:23:06 juju-e4d256-prod-github-runner-207 kernel: [71960.555323] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 01:23:06 juju-e4d256-prod-github-runner-207 kernel: [71960.556583] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 01:23:06 juju-e4d256-prod-github-runner-207 kernel: [71960.557813] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:23:06 juju-e4d256-prod-github-runner-207 kernel: [71960.558869] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 01:23:06 juju-e4d256-prod-github-runner-207 kernel: [71960.561423] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 01:23:06 juju-e4d256-prod-github-runner-207 kernel: [71960.562465] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 01:23:06 juju-e4d256-prod-github-runner-207 kernel: [71960.563628] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 01:23:06 juju-e4d256-prod-github-runner-207 kernel: [71960.564789] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 01:23:06 juju-e4d256-prod-github-runner-207 kernel: [71960.565954] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 01:23:06 juju-e4d256-prod-github-runner-207 kernel: [71960.567117] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 01:23:06 juju-e4d256-prod-github-runner-207 kernel: [71960.568278] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 01:23:06 juju-e4d256-prod-github-runner-207 kernel: [71960.569520] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 01:23:06 juju-e4d256-prod-github-runner-207 kernel: [71960.570617] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 01:23:06 juju-e4d256-prod-github-runner-207 kernel: [71960.571811] Call Trace: Aug 23 01:23:06 juju-e4d256-prod-github-runner-207 kernel: [71960.572721] Aug 23 01:23:06 juju-e4d256-prod-github-runner-207 kernel: [71960.573618] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:23:06 juju-e4d256-prod-github-runner-207 kernel: [71960.574651] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:23:06 juju-e4d256-prod-github-runner-207 kernel: [71960.575671] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:23:06 juju-e4d256-prod-github-runner-207 kernel: [71960.576744] ? show_regs.part.0+0x23/0x29 Aug 23 01:23:06 juju-e4d256-prod-github-runner-207 kernel: [71960.577760] ? show_regs.cold+0x8/0xd Aug 23 01:23:06 juju-e4d256-prod-github-runner-207 kernel: [71960.578729] ? watchdog_timer_fn+0x1be/0x220 Aug 23 01:23:06 juju-e4d256-prod-github-runner-207 kernel: [71960.579738] ? lockup_detector_update_enable+0x60/0x60 Aug 23 01:23:06 juju-e4d256-prod-github-runner-207 kernel: [71960.580798] ? __hrtimer_run_queues+0x107/0x230 Aug 23 01:23:06 juju-e4d256-prod-github-runner-207 kernel: [71960.581834] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 01:23:06 juju-e4d256-prod-github-runner-207 kernel: [71960.582855] ? hrtimer_interrupt+0x101/0x220 Aug 23 01:23:06 juju-e4d256-prod-github-runner-207 kernel: [71960.583873] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 01:23:06 juju-e4d256-prod-github-runner-207 kernel: [71960.584961] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 01:23:06 juju-e4d256-prod-github-runner-207 kernel: [71960.586012] Aug 23 01:23:06 juju-e4d256-prod-github-runner-207 kernel: [71960.586863] Aug 23 01:23:06 juju-e4d256-prod-github-runner-207 kernel: [71960.587698] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 01:23:06 juju-e4d256-prod-github-runner-207 kernel: [71960.588727] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:23:06 juju-e4d256-prod-github-runner-207 kernel: [71960.589778] ? _raw_spin_lock+0x22/0x30 Aug 23 01:23:06 juju-e4d256-prod-github-runner-207 kernel: [71960.590721] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:23:06 juju-e4d256-prod-github-runner-207 kernel: [71960.591745] direct_page_fault+0x206/0x310 [kvm] Aug 23 01:23:06 juju-e4d256-prod-github-runner-207 kernel: [71960.592772] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 01:23:06 juju-e4d256-prod-github-runner-207 kernel: [71960.593788] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 01:23:06 juju-e4d256-prod-github-runner-207 kernel: [71960.594790] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 01:23:06 juju-e4d256-prod-github-runner-207 kernel: [71960.595764] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 01:23:06 juju-e4d256-prod-github-runner-207 kernel: [71960.596707] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 01:23:06 juju-e4d256-prod-github-runner-207 kernel: [71960.597689] handle_exit+0x98/0x230 [kvm_amd] Aug 23 01:23:06 juju-e4d256-prod-github-runner-207 kernel: [71960.598586] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 01:23:06 juju-e4d256-prod-github-runner-207 kernel: [71960.599496] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 01:23:06 juju-e4d256-prod-github-runner-207 kernel: [71960.600416] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 01:23:06 juju-e4d256-prod-github-runner-207 kernel: [71960.601325] vcpu_run+0x62/0x2c0 [kvm] Aug 23 01:23:06 juju-e4d256-prod-github-runner-207 kernel: [71960.602141] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 01:23:06 juju-e4d256-prod-github-runner-207 kernel: [71960.602947] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 01:23:06 juju-e4d256-prod-github-runner-207 kernel: [71960.603804] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 01:23:06 juju-e4d256-prod-github-runner-207 kernel: [71960.604601] ? __seccomp_filter+0x4a/0x4a0 Aug 23 01:23:06 juju-e4d256-prod-github-runner-207 kernel: [71960.605359] ? __fget_files+0x86/0xc0 Aug 23 01:23:06 juju-e4d256-prod-github-runner-207 kernel: [71960.606064] __x64_sys_ioctl+0x95/0xd0 Aug 23 01:23:06 juju-e4d256-prod-github-runner-207 kernel: [71960.606756] do_syscall_64+0x5c/0xc0 Aug 23 01:23:06 juju-e4d256-prod-github-runner-207 kernel: [71960.607419] ? do_futex+0x162/0x1f0 Aug 23 01:23:06 juju-e4d256-prod-github-runner-207 kernel: [71960.608071] ? __x64_sys_futex+0x78/0x1e0 Aug 23 01:23:06 juju-e4d256-prod-github-runner-207 kernel: [71960.608744] ? __secure_computing+0xa9/0x120 Aug 23 01:23:06 juju-e4d256-prod-github-runner-207 kernel: [71960.609443] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 01:23:06 juju-e4d256-prod-github-runner-207 kernel: [71960.610201] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:23:06 juju-e4d256-prod-github-runner-207 kernel: [71960.610920] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:23:06 juju-e4d256-prod-github-runner-207 kernel: [71960.611635] ? do_syscall_64+0x69/0xc0 Aug 23 01:23:06 juju-e4d256-prod-github-runner-207 kernel: [71960.612283] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:23:06 juju-e4d256-prod-github-runner-207 kernel: [71960.613001] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:23:06 juju-e4d256-prod-github-runner-207 kernel: [71960.613697] ? do_syscall_64+0x69/0xc0 Aug 23 01:23:06 juju-e4d256-prod-github-runner-207 kernel: [71960.614326] ? do_syscall_64+0x69/0xc0 Aug 23 01:23:06 juju-e4d256-prod-github-runner-207 kernel: [71960.614946] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 01:23:06 juju-e4d256-prod-github-runner-207 kernel: [71960.615651] RIP: 0033:0x7faa5d0edaff Aug 23 01:23:06 juju-e4d256-prod-github-runner-207 kernel: [71960.616276] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 01:23:06 juju-e4d256-prod-github-runner-207 kernel: [71960.618276] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 01:23:06 juju-e4d256-prod-github-runner-207 kernel: [71960.619378] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 01:23:06 juju-e4d256-prod-github-runner-207 kernel: [71960.620266] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 01:23:06 juju-e4d256-prod-github-runner-207 kernel: [71960.621167] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 01:23:06 juju-e4d256-prod-github-runner-207 kernel: [71960.622056] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 01:23:06 juju-e4d256-prod-github-runner-207 kernel: [71960.622945] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 01:23:06 juju-e4d256-prod-github-runner-207 kernel: [71960.623837] Aug 23 01:23:34 juju-e4d256-prod-github-runner-207 kernel: [71988.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 66936s! [qemu-system-x86:6715] Aug 23 01:23:34 juju-e4d256-prod-github-runner-207 kernel: [71988.543736] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 01:23:34 juju-e4d256-prod-github-runner-207 kernel: [71988.543992] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 01:23:34 juju-e4d256-prod-github-runner-207 kernel: [71988.558087] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 01:23:34 juju-e4d256-prod-github-runner-207 kernel: [71988.559543] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 01:23:34 juju-e4d256-prod-github-runner-207 kernel: [71988.560948] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:23:34 juju-e4d256-prod-github-runner-207 kernel: [71988.562135] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 01:23:34 juju-e4d256-prod-github-runner-207 kernel: [71988.565052] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 01:23:34 juju-e4d256-prod-github-runner-207 kernel: [71988.566271] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 01:23:34 juju-e4d256-prod-github-runner-207 kernel: [71988.567582] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 01:23:34 juju-e4d256-prod-github-runner-207 kernel: [71988.568767] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 01:23:34 juju-e4d256-prod-github-runner-207 kernel: [71988.569987] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 01:23:34 juju-e4d256-prod-github-runner-207 kernel: [71988.571170] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 01:23:34 juju-e4d256-prod-github-runner-207 kernel: [71988.572337] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 01:23:34 juju-e4d256-prod-github-runner-207 kernel: [71988.573613] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 01:23:34 juju-e4d256-prod-github-runner-207 kernel: [71988.574993] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 01:23:34 juju-e4d256-prod-github-runner-207 kernel: [71988.576336] Call Trace: Aug 23 01:23:34 juju-e4d256-prod-github-runner-207 kernel: [71988.577319] Aug 23 01:23:34 juju-e4d256-prod-github-runner-207 kernel: [71988.578267] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:23:34 juju-e4d256-prod-github-runner-207 kernel: [71988.579386] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:23:34 juju-e4d256-prod-github-runner-207 kernel: [71988.580499] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:23:34 juju-e4d256-prod-github-runner-207 kernel: [71988.581702] ? show_regs.part.0+0x23/0x29 Aug 23 01:23:34 juju-e4d256-prod-github-runner-207 kernel: [71988.582777] ? show_regs.cold+0x8/0xd Aug 23 01:23:34 juju-e4d256-prod-github-runner-207 kernel: [71988.583825] ? watchdog_timer_fn+0x1be/0x220 Aug 23 01:23:34 juju-e4d256-prod-github-runner-207 kernel: [71988.584934] ? lockup_detector_update_enable+0x60/0x60 Aug 23 01:23:34 juju-e4d256-prod-github-runner-207 kernel: [71988.586099] ? __hrtimer_run_queues+0x107/0x230 Aug 23 01:23:34 juju-e4d256-prod-github-runner-207 kernel: [71988.587221] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 01:23:34 juju-e4d256-prod-github-runner-207 kernel: [71988.588335] ? hrtimer_interrupt+0x101/0x220 Aug 23 01:23:34 juju-e4d256-prod-github-runner-207 kernel: [71988.589454] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 01:23:34 juju-e4d256-prod-github-runner-207 kernel: [71988.590628] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 01:23:34 juju-e4d256-prod-github-runner-207 kernel: [71988.591948] Aug 23 01:23:34 juju-e4d256-prod-github-runner-207 kernel: [71988.592866] Aug 23 01:23:34 juju-e4d256-prod-github-runner-207 kernel: [71988.593767] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 01:23:34 juju-e4d256-prod-github-runner-207 kernel: [71988.595060] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:23:34 juju-e4d256-prod-github-runner-207 kernel: [71988.596226] ? _raw_spin_lock+0x22/0x30 Aug 23 01:23:34 juju-e4d256-prod-github-runner-207 kernel: [71988.597287] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:23:34 juju-e4d256-prod-github-runner-207 kernel: [71988.598404] direct_page_fault+0x206/0x310 [kvm] Aug 23 01:23:34 juju-e4d256-prod-github-runner-207 kernel: [71988.599516] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 01:23:34 juju-e4d256-prod-github-runner-207 kernel: [71988.600642] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 01:23:34 juju-e4d256-prod-github-runner-207 kernel: [71988.601739] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 01:23:34 juju-e4d256-prod-github-runner-207 kernel: [71988.602841] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 01:23:34 juju-e4d256-prod-github-runner-207 kernel: [71988.603882] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 01:23:34 juju-e4d256-prod-github-runner-207 kernel: [71988.604975] handle_exit+0x98/0x230 [kvm_amd] Aug 23 01:23:34 juju-e4d256-prod-github-runner-207 kernel: [71988.605955] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 01:23:34 juju-e4d256-prod-github-runner-207 kernel: [71988.606957] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 01:23:34 juju-e4d256-prod-github-runner-207 kernel: [71988.607981] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 01:23:34 juju-e4d256-prod-github-runner-207 kernel: [71988.608995] vcpu_run+0x62/0x2c0 [kvm] Aug 23 01:23:34 juju-e4d256-prod-github-runner-207 kernel: [71988.609890] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 01:23:34 juju-e4d256-prod-github-runner-207 kernel: [71988.610798] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 01:23:34 juju-e4d256-prod-github-runner-207 kernel: [71988.611954] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 01:23:34 juju-e4d256-prod-github-runner-207 kernel: [71988.612897] ? __seccomp_filter+0x4a/0x4a0 Aug 23 01:23:34 juju-e4d256-prod-github-runner-207 kernel: [71988.613892] ? __fget_files+0x86/0xc0 Aug 23 01:23:34 juju-e4d256-prod-github-runner-207 kernel: [71988.614816] __x64_sys_ioctl+0x95/0xd0 Aug 23 01:23:34 juju-e4d256-prod-github-runner-207 kernel: [71988.615739] do_syscall_64+0x5c/0xc0 Aug 23 01:23:34 juju-e4d256-prod-github-runner-207 kernel: [71988.616606] ? do_futex+0x162/0x1f0 Aug 23 01:23:34 juju-e4d256-prod-github-runner-207 kernel: [71988.617413] ? __x64_sys_futex+0x78/0x1e0 Aug 23 01:23:34 juju-e4d256-prod-github-runner-207 kernel: [71988.618183] ? __secure_computing+0xa9/0x120 Aug 23 01:23:34 juju-e4d256-prod-github-runner-207 kernel: [71988.618984] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 01:23:34 juju-e4d256-prod-github-runner-207 kernel: [71988.619903] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:23:34 juju-e4d256-prod-github-runner-207 kernel: [71988.620772] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:23:34 juju-e4d256-prod-github-runner-207 kernel: [71988.621756] ? do_syscall_64+0x69/0xc0 Aug 23 01:23:34 juju-e4d256-prod-github-runner-207 kernel: [71988.622498] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:23:34 juju-e4d256-prod-github-runner-207 kernel: [71988.623293] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:23:34 juju-e4d256-prod-github-runner-207 kernel: [71988.624099] ? do_syscall_64+0x69/0xc0 Aug 23 01:23:34 juju-e4d256-prod-github-runner-207 kernel: [71988.624854] ? do_syscall_64+0x69/0xc0 Aug 23 01:23:34 juju-e4d256-prod-github-runner-207 kernel: [71988.625629] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 01:23:34 juju-e4d256-prod-github-runner-207 kernel: [71988.626484] RIP: 0033:0x7faa5d0edaff Aug 23 01:23:34 juju-e4d256-prod-github-runner-207 kernel: [71988.627231] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 01:23:34 juju-e4d256-prod-github-runner-207 kernel: [71988.635203] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 01:23:34 juju-e4d256-prod-github-runner-207 kernel: [71988.639873] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 01:23:34 juju-e4d256-prod-github-runner-207 kernel: [71988.641158] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 01:23:34 juju-e4d256-prod-github-runner-207 kernel: [71988.642055] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 01:23:34 juju-e4d256-prod-github-runner-207 kernel: [71988.642943] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 01:23:34 juju-e4d256-prod-github-runner-207 kernel: [71988.643831] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 01:23:34 juju-e4d256-prod-github-runner-207 kernel: [71988.644739] Aug 23 01:23:48 juju-e4d256-prod-github-runner-207 kernel: [72001.988707] rcu: INFO: rcu_sched self-detected stall on CPU Aug 23 01:23:48 juju-e4d256-prod-github-runner-207 kernel: [72001.989672] rcu: 1-....: (17914622 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=8653653 Aug 23 01:23:48 juju-e4d256-prod-github-runner-207 kernel: [72001.991033] (t=17971197 jiffies g=23269 q=61665) Aug 23 01:23:48 juju-e4d256-prod-github-runner-207 kernel: [72001.991838] NMI backtrace for cpu 1 Aug 23 01:23:48 juju-e4d256-prod-github-runner-207 kernel: [72001.992580] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 01:23:48 juju-e4d256-prod-github-runner-207 kernel: [72001.993728] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 01:23:48 juju-e4d256-prod-github-runner-207 kernel: [72001.994823] Call Trace: Aug 23 01:23:48 juju-e4d256-prod-github-runner-207 kernel: [72001.995514] Aug 23 01:23:48 juju-e4d256-prod-github-runner-207 kernel: [72001.996162] show_stack+0x52/0x5c Aug 23 01:23:48 juju-e4d256-prod-github-runner-207 kernel: [72001.996916] dump_stack_lvl+0x4a/0x63 Aug 23 01:23:48 juju-e4d256-prod-github-runner-207 kernel: [72001.997669] dump_stack+0x10/0x16 Aug 23 01:23:48 juju-e4d256-prod-github-runner-207 kernel: [72001.998384] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 23 01:23:48 juju-e4d256-prod-github-runner-207 kernel: [72001.999189] ? lapic_can_unplug_cpu+0x90/0x90 Aug 23 01:23:48 juju-e4d256-prod-github-runner-207 kernel: [72001.999985] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 23 01:23:48 juju-e4d256-prod-github-runner-207 kernel: [72002.000831] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 23 01:23:48 juju-e4d256-prod-github-runner-207 kernel: [72002.001656] trigger_single_cpu_backtrace+0x44/0x4f Aug 23 01:23:48 juju-e4d256-prod-github-runner-207 kernel: [72002.002476] rcu_dump_cpu_stacks+0x102/0x149 Aug 23 01:23:48 juju-e4d256-prod-github-runner-207 kernel: [72002.003252] print_cpu_stall.cold+0x2f/0xe2 Aug 23 01:23:48 juju-e4d256-prod-github-runner-207 kernel: [72002.004032] ? timekeeping_update+0xf7/0x150 Aug 23 01:23:48 juju-e4d256-prod-github-runner-207 kernel: [72002.004829] check_cpu_stall+0x109/0x270 Aug 23 01:23:48 juju-e4d256-prod-github-runner-207 kernel: [72002.005678] rcu_sched_clock_irq+0x9a/0x250 Aug 23 01:23:48 juju-e4d256-prod-github-runner-207 kernel: [72002.006532] update_process_times+0x94/0xd0 Aug 23 01:23:48 juju-e4d256-prod-github-runner-207 kernel: [72002.007402] tick_sched_handle+0x29/0x70 Aug 23 01:23:48 juju-e4d256-prod-github-runner-207 kernel: [72002.008228] tick_sched_timer+0x8c/0xc0 Aug 23 01:23:48 juju-e4d256-prod-github-runner-207 kernel: [72002.009094] ? tick_nohz_handler+0xb0/0xb0 Aug 23 01:23:48 juju-e4d256-prod-github-runner-207 kernel: [72002.009962] __hrtimer_run_queues+0x107/0x230 Aug 23 01:23:48 juju-e4d256-prod-github-runner-207 kernel: [72002.010830] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 01:23:48 juju-e4d256-prod-github-runner-207 kernel: [72002.011702] hrtimer_interrupt+0x101/0x220 Aug 23 01:23:48 juju-e4d256-prod-github-runner-207 kernel: [72002.012582] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 01:23:48 juju-e4d256-prod-github-runner-207 kernel: [72002.013495] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 01:23:48 juju-e4d256-prod-github-runner-207 kernel: [72002.014397] Aug 23 01:23:48 juju-e4d256-prod-github-runner-207 kernel: [72002.015080] Aug 23 01:23:48 juju-e4d256-prod-github-runner-207 kernel: [72002.015760] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 01:23:48 juju-e4d256-prod-github-runner-207 kernel: [72002.016701] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:23:48 juju-e4d256-prod-github-runner-207 kernel: [72002.017695] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 01:23:48 juju-e4d256-prod-github-runner-207 kernel: [72002.020242] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 01:23:48 juju-e4d256-prod-github-runner-207 kernel: [72002.021230] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 01:23:48 juju-e4d256-prod-github-runner-207 kernel: [72002.022362] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 01:23:48 juju-e4d256-prod-github-runner-207 kernel: [72002.023475] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 01:23:48 juju-e4d256-prod-github-runner-207 kernel: [72002.024608] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 01:23:48 juju-e4d256-prod-github-runner-207 kernel: [72002.025706] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 01:23:48 juju-e4d256-prod-github-runner-207 kernel: [72002.026807] ? _raw_spin_lock+0x22/0x30 Aug 23 01:23:48 juju-e4d256-prod-github-runner-207 kernel: [72002.027648] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:23:48 juju-e4d256-prod-github-runner-207 kernel: [72002.028593] direct_page_fault+0x206/0x310 [kvm] Aug 23 01:23:48 juju-e4d256-prod-github-runner-207 kernel: [72002.029530] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 01:23:48 juju-e4d256-prod-github-runner-207 kernel: [72002.030446] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 01:23:48 juju-e4d256-prod-github-runner-207 kernel: [72002.031364] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 01:23:48 juju-e4d256-prod-github-runner-207 kernel: [72002.032266] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 01:23:48 juju-e4d256-prod-github-runner-207 kernel: [72002.033170] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 01:23:48 juju-e4d256-prod-github-runner-207 kernel: [72002.034105] handle_exit+0x98/0x230 [kvm_amd] Aug 23 01:23:48 juju-e4d256-prod-github-runner-207 kernel: [72002.034953] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 01:23:48 juju-e4d256-prod-github-runner-207 kernel: [72002.035825] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 01:23:48 juju-e4d256-prod-github-runner-207 kernel: [72002.036738] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 01:23:48 juju-e4d256-prod-github-runner-207 kernel: [72002.037619] vcpu_run+0x62/0x2c0 [kvm] Aug 23 01:23:48 juju-e4d256-prod-github-runner-207 kernel: [72002.038418] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 01:23:48 juju-e4d256-prod-github-runner-207 kernel: [72002.039240] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 01:23:48 juju-e4d256-prod-github-runner-207 kernel: [72002.040139] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 01:23:48 juju-e4d256-prod-github-runner-207 kernel: [72002.041009] ? __seccomp_filter+0x4a/0x4a0 Aug 23 01:23:48 juju-e4d256-prod-github-runner-207 kernel: [72002.041816] ? __fget_files+0x86/0xc0 Aug 23 01:23:48 juju-e4d256-prod-github-runner-207 kernel: [72002.042582] __x64_sys_ioctl+0x95/0xd0 Aug 23 01:23:48 juju-e4d256-prod-github-runner-207 kernel: [72002.043369] do_syscall_64+0x5c/0xc0 Aug 23 01:23:48 juju-e4d256-prod-github-runner-207 kernel: [72002.044066] ? do_futex+0x162/0x1f0 Aug 23 01:23:48 juju-e4d256-prod-github-runner-207 kernel: [72002.044768] ? __x64_sys_futex+0x78/0x1e0 Aug 23 01:23:48 juju-e4d256-prod-github-runner-207 kernel: [72002.045474] ? __secure_computing+0xa9/0x120 Aug 23 01:23:48 juju-e4d256-prod-github-runner-207 kernel: [72002.046204] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 01:23:48 juju-e4d256-prod-github-runner-207 kernel: [72002.047001] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:23:48 juju-e4d256-prod-github-runner-207 kernel: [72002.047773] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:23:48 juju-e4d256-prod-github-runner-207 kernel: [72002.048547] ? do_syscall_64+0x69/0xc0 Aug 23 01:23:48 juju-e4d256-prod-github-runner-207 kernel: [72002.049235] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:23:48 juju-e4d256-prod-github-runner-207 kernel: [72002.049988] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:23:48 juju-e4d256-prod-github-runner-207 kernel: [72002.050747] ? do_syscall_64+0x69/0xc0 Aug 23 01:23:48 juju-e4d256-prod-github-runner-207 kernel: [72002.051440] ? do_syscall_64+0x69/0xc0 Aug 23 01:23:48 juju-e4d256-prod-github-runner-207 kernel: [72002.052127] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 01:23:48 juju-e4d256-prod-github-runner-207 kernel: [72002.052916] RIP: 0033:0x7faa5d0edaff Aug 23 01:23:48 juju-e4d256-prod-github-runner-207 kernel: [72002.053621] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 01:23:48 juju-e4d256-prod-github-runner-207 kernel: [72002.055716] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 01:23:48 juju-e4d256-prod-github-runner-207 kernel: [72002.056696] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 01:23:48 juju-e4d256-prod-github-runner-207 kernel: [72002.057641] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 01:23:48 juju-e4d256-prod-github-runner-207 kernel: [72002.058584] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 01:23:48 juju-e4d256-prod-github-runner-207 kernel: [72002.059521] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 01:23:48 juju-e4d256-prod-github-runner-207 kernel: [72002.060465] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 01:23:48 juju-e4d256-prod-github-runner-207 kernel: [72002.061376] Aug 23 01:24:14 juju-e4d256-prod-github-runner-207 kernel: [72028.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 66973s! [qemu-system-x86:6715] Aug 23 01:24:14 juju-e4d256-prod-github-runner-207 kernel: [72028.543132] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 01:24:14 juju-e4d256-prod-github-runner-207 kernel: [72028.543201] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 01:24:14 juju-e4d256-prod-github-runner-207 kernel: [72028.555633] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 01:24:14 juju-e4d256-prod-github-runner-207 kernel: [72028.556913] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 01:24:14 juju-e4d256-prod-github-runner-207 kernel: [72028.558140] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:24:14 juju-e4d256-prod-github-runner-207 kernel: [72028.559197] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 01:24:14 juju-e4d256-prod-github-runner-207 kernel: [72028.561768] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 01:24:14 juju-e4d256-prod-github-runner-207 kernel: [72028.562816] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 01:24:14 juju-e4d256-prod-github-runner-207 kernel: [72028.563977] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 01:24:14 juju-e4d256-prod-github-runner-207 kernel: [72028.565170] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 01:24:14 juju-e4d256-prod-github-runner-207 kernel: [72028.566327] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 01:24:14 juju-e4d256-prod-github-runner-207 kernel: [72028.567485] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 01:24:14 juju-e4d256-prod-github-runner-207 kernel: [72028.568663] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 01:24:14 juju-e4d256-prod-github-runner-207 kernel: [72028.569889] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 01:24:14 juju-e4d256-prod-github-runner-207 kernel: [72028.570981] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 01:24:14 juju-e4d256-prod-github-runner-207 kernel: [72028.572559] Call Trace: Aug 23 01:24:14 juju-e4d256-prod-github-runner-207 kernel: [72028.573478] Aug 23 01:24:14 juju-e4d256-prod-github-runner-207 kernel: [72028.574509] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:24:14 juju-e4d256-prod-github-runner-207 kernel: [72028.575540] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:24:14 juju-e4d256-prod-github-runner-207 kernel: [72028.576578] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:24:14 juju-e4d256-prod-github-runner-207 kernel: [72028.577657] ? show_regs.part.0+0x23/0x29 Aug 23 01:24:14 juju-e4d256-prod-github-runner-207 kernel: [72028.578724] ? show_regs.cold+0x8/0xd Aug 23 01:24:14 juju-e4d256-prod-github-runner-207 kernel: [72028.579829] ? watchdog_timer_fn+0x1be/0x220 Aug 23 01:24:14 juju-e4d256-prod-github-runner-207 kernel: [72028.580850] ? lockup_detector_update_enable+0x60/0x60 Aug 23 01:24:14 juju-e4d256-prod-github-runner-207 kernel: [72028.581983] ? __hrtimer_run_queues+0x107/0x230 Aug 23 01:24:14 juju-e4d256-prod-github-runner-207 kernel: [72028.583154] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 01:24:14 juju-e4d256-prod-github-runner-207 kernel: [72028.584266] ? hrtimer_interrupt+0x101/0x220 Aug 23 01:24:14 juju-e4d256-prod-github-runner-207 kernel: [72028.585314] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 01:24:14 juju-e4d256-prod-github-runner-207 kernel: [72028.586386] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 01:24:14 juju-e4d256-prod-github-runner-207 kernel: [72028.587430] Aug 23 01:24:14 juju-e4d256-prod-github-runner-207 kernel: [72028.588300] Aug 23 01:24:14 juju-e4d256-prod-github-runner-207 kernel: [72028.589179] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 01:24:14 juju-e4d256-prod-github-runner-207 kernel: [72028.590243] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:24:14 juju-e4d256-prod-github-runner-207 kernel: [72028.591283] ? _raw_spin_lock+0x22/0x30 Aug 23 01:24:14 juju-e4d256-prod-github-runner-207 kernel: [72028.592251] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:24:14 juju-e4d256-prod-github-runner-207 kernel: [72028.593275] direct_page_fault+0x206/0x310 [kvm] Aug 23 01:24:14 juju-e4d256-prod-github-runner-207 kernel: [72028.594298] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 01:24:14 juju-e4d256-prod-github-runner-207 kernel: [72028.595306] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 01:24:14 juju-e4d256-prod-github-runner-207 kernel: [72028.596323] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 01:24:14 juju-e4d256-prod-github-runner-207 kernel: [72028.597294] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 01:24:14 juju-e4d256-prod-github-runner-207 kernel: [72028.598244] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 01:24:14 juju-e4d256-prod-github-runner-207 kernel: [72028.599220] handle_exit+0x98/0x230 [kvm_amd] Aug 23 01:24:14 juju-e4d256-prod-github-runner-207 kernel: [72028.600126] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 01:24:14 juju-e4d256-prod-github-runner-207 kernel: [72028.601048] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 01:24:14 juju-e4d256-prod-github-runner-207 kernel: [72028.601973] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 01:24:14 juju-e4d256-prod-github-runner-207 kernel: [72028.602886] vcpu_run+0x62/0x2c0 [kvm] Aug 23 01:24:14 juju-e4d256-prod-github-runner-207 kernel: [72028.603700] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 01:24:14 juju-e4d256-prod-github-runner-207 kernel: [72028.604515] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 01:24:14 juju-e4d256-prod-github-runner-207 kernel: [72028.605372] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 01:24:14 juju-e4d256-prod-github-runner-207 kernel: [72028.606272] ? __seccomp_filter+0x4a/0x4a0 Aug 23 01:24:14 juju-e4d256-prod-github-runner-207 kernel: [72028.607019] ? __fget_files+0x86/0xc0 Aug 23 01:24:14 juju-e4d256-prod-github-runner-207 kernel: [72028.607723] __x64_sys_ioctl+0x95/0xd0 Aug 23 01:24:14 juju-e4d256-prod-github-runner-207 kernel: [72028.608429] do_syscall_64+0x5c/0xc0 Aug 23 01:24:14 juju-e4d256-prod-github-runner-207 kernel: [72028.609167] ? do_futex+0x162/0x1f0 Aug 23 01:24:14 juju-e4d256-prod-github-runner-207 kernel: [72028.609818] ? __x64_sys_futex+0x78/0x1e0 Aug 23 01:24:14 juju-e4d256-prod-github-runner-207 kernel: [72028.610492] ? __secure_computing+0xa9/0x120 Aug 23 01:24:14 juju-e4d256-prod-github-runner-207 kernel: [72028.611189] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 01:24:14 juju-e4d256-prod-github-runner-207 kernel: [72028.611949] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:24:14 juju-e4d256-prod-github-runner-207 kernel: [72028.612681] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:24:14 juju-e4d256-prod-github-runner-207 kernel: [72028.613403] ? do_syscall_64+0x69/0xc0 Aug 23 01:24:14 juju-e4d256-prod-github-runner-207 kernel: [72028.614146] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:24:14 juju-e4d256-prod-github-runner-207 kernel: [72028.615155] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:24:14 juju-e4d256-prod-github-runner-207 kernel: [72028.616126] ? do_syscall_64+0x69/0xc0 Aug 23 01:24:14 juju-e4d256-prod-github-runner-207 kernel: [72028.616973] ? do_syscall_64+0x69/0xc0 Aug 23 01:24:14 juju-e4d256-prod-github-runner-207 kernel: [72028.617828] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 01:24:14 juju-e4d256-prod-github-runner-207 kernel: [72028.618780] RIP: 0033:0x7faa5d0edaff Aug 23 01:24:14 juju-e4d256-prod-github-runner-207 kernel: [72028.619617] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 01:24:14 juju-e4d256-prod-github-runner-207 kernel: [72028.621849] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 01:24:14 juju-e4d256-prod-github-runner-207 kernel: [72028.622781] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 01:24:14 juju-e4d256-prod-github-runner-207 kernel: [72028.623692] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 01:24:14 juju-e4d256-prod-github-runner-207 kernel: [72028.624600] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 01:24:14 juju-e4d256-prod-github-runner-207 kernel: [72028.625516] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 01:24:14 juju-e4d256-prod-github-runner-207 kernel: [72028.626410] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 01:24:14 juju-e4d256-prod-github-runner-207 kernel: [72028.627306] Aug 23 01:24:42 juju-e4d256-prod-github-runner-207 kernel: [72056.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 66999s! [qemu-system-x86:6715] Aug 23 01:24:42 juju-e4d256-prod-github-runner-207 kernel: [72056.543107] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 01:24:42 juju-e4d256-prod-github-runner-207 kernel: [72056.543176] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 01:24:42 juju-e4d256-prod-github-runner-207 kernel: [72056.555294] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 01:24:42 juju-e4d256-prod-github-runner-207 kernel: [72056.556580] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 01:24:42 juju-e4d256-prod-github-runner-207 kernel: [72056.557800] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:24:42 juju-e4d256-prod-github-runner-207 kernel: [72056.558858] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 01:24:42 juju-e4d256-prod-github-runner-207 kernel: [72056.561424] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 01:24:42 juju-e4d256-prod-github-runner-207 kernel: [72056.562467] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 01:24:42 juju-e4d256-prod-github-runner-207 kernel: [72056.563633] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 01:24:42 juju-e4d256-prod-github-runner-207 kernel: [72056.564807] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 01:24:42 juju-e4d256-prod-github-runner-207 kernel: [72056.565973] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 01:24:42 juju-e4d256-prod-github-runner-207 kernel: [72056.567135] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 01:24:42 juju-e4d256-prod-github-runner-207 kernel: [72056.568315] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 01:24:42 juju-e4d256-prod-github-runner-207 kernel: [72056.569552] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 01:24:42 juju-e4d256-prod-github-runner-207 kernel: [72056.570655] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 01:24:42 juju-e4d256-prod-github-runner-207 kernel: [72056.571859] Call Trace: Aug 23 01:24:42 juju-e4d256-prod-github-runner-207 kernel: [72056.572771] Aug 23 01:24:42 juju-e4d256-prod-github-runner-207 kernel: [72056.573655] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:24:42 juju-e4d256-prod-github-runner-207 kernel: [72056.574692] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:24:42 juju-e4d256-prod-github-runner-207 kernel: [72056.575716] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:24:42 juju-e4d256-prod-github-runner-207 kernel: [72056.576810] ? show_regs.part.0+0x23/0x29 Aug 23 01:24:42 juju-e4d256-prod-github-runner-207 kernel: [72056.577807] ? show_regs.cold+0x8/0xd Aug 23 01:24:42 juju-e4d256-prod-github-runner-207 kernel: [72056.578808] ? watchdog_timer_fn+0x1be/0x220 Aug 23 01:24:42 juju-e4d256-prod-github-runner-207 kernel: [72056.579859] ? lockup_detector_update_enable+0x60/0x60 Aug 23 01:24:42 juju-e4d256-prod-github-runner-207 kernel: [72056.580926] ? __hrtimer_run_queues+0x107/0x230 Aug 23 01:24:42 juju-e4d256-prod-github-runner-207 kernel: [72056.581962] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 01:24:42 juju-e4d256-prod-github-runner-207 kernel: [72056.582985] ? hrtimer_interrupt+0x101/0x220 Aug 23 01:24:42 juju-e4d256-prod-github-runner-207 kernel: [72056.584026] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 01:24:42 juju-e4d256-prod-github-runner-207 kernel: [72056.585096] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 01:24:42 juju-e4d256-prod-github-runner-207 kernel: [72056.586142] Aug 23 01:24:42 juju-e4d256-prod-github-runner-207 kernel: [72056.586995] Aug 23 01:24:42 juju-e4d256-prod-github-runner-207 kernel: [72056.587849] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 01:24:42 juju-e4d256-prod-github-runner-207 kernel: [72056.588882] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:24:42 juju-e4d256-prod-github-runner-207 kernel: [72056.589921] ? _raw_spin_lock+0x22/0x30 Aug 23 01:24:42 juju-e4d256-prod-github-runner-207 kernel: [72056.590870] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:24:42 juju-e4d256-prod-github-runner-207 kernel: [72056.591901] direct_page_fault+0x206/0x310 [kvm] Aug 23 01:24:42 juju-e4d256-prod-github-runner-207 kernel: [72056.592925] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 01:24:42 juju-e4d256-prod-github-runner-207 kernel: [72056.593939] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 01:24:42 juju-e4d256-prod-github-runner-207 kernel: [72056.594940] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 01:24:42 juju-e4d256-prod-github-runner-207 kernel: [72056.595930] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 01:24:42 juju-e4d256-prod-github-runner-207 kernel: [72056.596877] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 01:24:42 juju-e4d256-prod-github-runner-207 kernel: [72056.597859] handle_exit+0x98/0x230 [kvm_amd] Aug 23 01:24:42 juju-e4d256-prod-github-runner-207 kernel: [72056.598753] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 01:24:42 juju-e4d256-prod-github-runner-207 kernel: [72056.599669] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 01:24:42 juju-e4d256-prod-github-runner-207 kernel: [72056.600611] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 01:24:42 juju-e4d256-prod-github-runner-207 kernel: [72056.601521] vcpu_run+0x62/0x2c0 [kvm] Aug 23 01:24:42 juju-e4d256-prod-github-runner-207 kernel: [72056.602331] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 01:24:42 juju-e4d256-prod-github-runner-207 kernel: [72056.603140] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 01:24:42 juju-e4d256-prod-github-runner-207 kernel: [72056.604017] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 01:24:42 juju-e4d256-prod-github-runner-207 kernel: [72056.604816] ? __seccomp_filter+0x4a/0x4a0 Aug 23 01:24:42 juju-e4d256-prod-github-runner-207 kernel: [72056.605564] ? __fget_files+0x86/0xc0 Aug 23 01:24:42 juju-e4d256-prod-github-runner-207 kernel: [72056.606273] __x64_sys_ioctl+0x95/0xd0 Aug 23 01:24:42 juju-e4d256-prod-github-runner-207 kernel: [72056.606973] do_syscall_64+0x5c/0xc0 Aug 23 01:24:42 juju-e4d256-prod-github-runner-207 kernel: [72056.607639] ? do_futex+0x162/0x1f0 Aug 23 01:24:42 juju-e4d256-prod-github-runner-207 kernel: [72056.608301] ? __x64_sys_futex+0x78/0x1e0 Aug 23 01:24:42 juju-e4d256-prod-github-runner-207 kernel: [72056.608978] ? __secure_computing+0xa9/0x120 Aug 23 01:24:42 juju-e4d256-prod-github-runner-207 kernel: [72056.609672] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 01:24:42 juju-e4d256-prod-github-runner-207 kernel: [72056.610438] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:24:42 juju-e4d256-prod-github-runner-207 kernel: [72056.611295] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:24:42 juju-e4d256-prod-github-runner-207 kernel: [72056.612026] ? do_syscall_64+0x69/0xc0 Aug 23 01:24:42 juju-e4d256-prod-github-runner-207 kernel: [72056.612672] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:24:42 juju-e4d256-prod-github-runner-207 kernel: [72056.613377] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:24:42 juju-e4d256-prod-github-runner-207 kernel: [72056.614074] ? do_syscall_64+0x69/0xc0 Aug 23 01:24:42 juju-e4d256-prod-github-runner-207 kernel: [72056.614699] ? do_syscall_64+0x69/0xc0 Aug 23 01:24:42 juju-e4d256-prod-github-runner-207 kernel: [72056.615321] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 01:24:42 juju-e4d256-prod-github-runner-207 kernel: [72056.616035] RIP: 0033:0x7faa5d0edaff Aug 23 01:24:42 juju-e4d256-prod-github-runner-207 kernel: [72056.616659] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 01:24:42 juju-e4d256-prod-github-runner-207 kernel: [72056.618648] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 01:24:42 juju-e4d256-prod-github-runner-207 kernel: [72056.619685] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 01:24:42 juju-e4d256-prod-github-runner-207 kernel: [72056.620591] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 01:24:42 juju-e4d256-prod-github-runner-207 kernel: [72056.621481] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 01:24:42 juju-e4d256-prod-github-runner-207 kernel: [72056.622368] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 01:24:42 juju-e4d256-prod-github-runner-207 kernel: [72056.623261] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 01:24:42 juju-e4d256-prod-github-runner-207 kernel: [72056.624176] Aug 23 01:25:10 juju-e4d256-prod-github-runner-207 kernel: [72084.541980] watchdog: BUG: soft lockup - CPU#1 stuck for 67025s! [qemu-system-x86:6715] Aug 23 01:25:10 juju-e4d256-prod-github-runner-207 kernel: [72084.543953] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 01:25:10 juju-e4d256-prod-github-runner-207 kernel: [72084.544198] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 01:25:10 juju-e4d256-prod-github-runner-207 kernel: [72084.557230] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 01:25:10 juju-e4d256-prod-github-runner-207 kernel: [72084.558498] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 01:25:10 juju-e4d256-prod-github-runner-207 kernel: [72084.559736] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:25:10 juju-e4d256-prod-github-runner-207 kernel: [72084.560825] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 01:25:10 juju-e4d256-prod-github-runner-207 kernel: [72084.563511] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 01:25:10 juju-e4d256-prod-github-runner-207 kernel: [72084.564692] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 01:25:10 juju-e4d256-prod-github-runner-207 kernel: [72084.565937] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 01:25:10 juju-e4d256-prod-github-runner-207 kernel: [72084.567231] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 01:25:10 juju-e4d256-prod-github-runner-207 kernel: [72084.568498] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 01:25:10 juju-e4d256-prod-github-runner-207 kernel: [72084.569773] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 01:25:10 juju-e4d256-prod-github-runner-207 kernel: [72084.571003] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 01:25:10 juju-e4d256-prod-github-runner-207 kernel: [72084.572374] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 01:25:10 juju-e4d256-prod-github-runner-207 kernel: [72084.573571] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 01:25:10 juju-e4d256-prod-github-runner-207 kernel: [72084.574803] Call Trace: Aug 23 01:25:10 juju-e4d256-prod-github-runner-207 kernel: [72084.575850] Aug 23 01:25:10 juju-e4d256-prod-github-runner-207 kernel: [72084.576830] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:25:10 juju-e4d256-prod-github-runner-207 kernel: [72084.577968] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:25:10 juju-e4d256-prod-github-runner-207 kernel: [72084.579080] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:25:10 juju-e4d256-prod-github-runner-207 kernel: [72084.580254] ? show_regs.part.0+0x23/0x29 Aug 23 01:25:10 juju-e4d256-prod-github-runner-207 kernel: [72084.581266] ? show_regs.cold+0x8/0xd Aug 23 01:25:10 juju-e4d256-prod-github-runner-207 kernel: [72084.582258] ? watchdog_timer_fn+0x1be/0x220 Aug 23 01:25:10 juju-e4d256-prod-github-runner-207 kernel: [72084.583267] ? lockup_detector_update_enable+0x60/0x60 Aug 23 01:25:10 juju-e4d256-prod-github-runner-207 kernel: [72084.584418] ? __hrtimer_run_queues+0x107/0x230 Aug 23 01:25:10 juju-e4d256-prod-github-runner-207 kernel: [72084.585461] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 01:25:10 juju-e4d256-prod-github-runner-207 kernel: [72084.586507] ? hrtimer_interrupt+0x101/0x220 Aug 23 01:25:10 juju-e4d256-prod-github-runner-207 kernel: [72084.587584] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 01:25:10 juju-e4d256-prod-github-runner-207 kernel: [72084.588681] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 01:25:10 juju-e4d256-prod-github-runner-207 kernel: [72084.589734] Aug 23 01:25:10 juju-e4d256-prod-github-runner-207 kernel: [72084.590592] Aug 23 01:25:10 juju-e4d256-prod-github-runner-207 kernel: [72084.591459] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 01:25:10 juju-e4d256-prod-github-runner-207 kernel: [72084.592524] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:25:10 juju-e4d256-prod-github-runner-207 kernel: [72084.593577] ? _raw_spin_lock+0x22/0x30 Aug 23 01:25:10 juju-e4d256-prod-github-runner-207 kernel: [72084.594604] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:25:10 juju-e4d256-prod-github-runner-207 kernel: [72084.595670] direct_page_fault+0x206/0x310 [kvm] Aug 23 01:25:10 juju-e4d256-prod-github-runner-207 kernel: [72084.596714] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 01:25:10 juju-e4d256-prod-github-runner-207 kernel: [72084.597737] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 01:25:10 juju-e4d256-prod-github-runner-207 kernel: [72084.598741] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 01:25:10 juju-e4d256-prod-github-runner-207 kernel: [72084.599767] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 01:25:10 juju-e4d256-prod-github-runner-207 kernel: [72084.600715] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 01:25:10 juju-e4d256-prod-github-runner-207 kernel: [72084.601700] handle_exit+0x98/0x230 [kvm_amd] Aug 23 01:25:10 juju-e4d256-prod-github-runner-207 kernel: [72084.602605] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 01:25:10 juju-e4d256-prod-github-runner-207 kernel: [72084.603563] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 01:25:10 juju-e4d256-prod-github-runner-207 kernel: [72084.604517] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 01:25:10 juju-e4d256-prod-github-runner-207 kernel: [72084.605473] vcpu_run+0x62/0x2c0 [kvm] Aug 23 01:25:10 juju-e4d256-prod-github-runner-207 kernel: [72084.606299] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 01:25:10 juju-e4d256-prod-github-runner-207 kernel: [72084.607116] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 01:25:10 juju-e4d256-prod-github-runner-207 kernel: [72084.608029] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 01:25:10 juju-e4d256-prod-github-runner-207 kernel: [72084.608839] ? __seccomp_filter+0x4a/0x4a0 Aug 23 01:25:10 juju-e4d256-prod-github-runner-207 kernel: [72084.609592] ? __fget_files+0x86/0xc0 Aug 23 01:25:10 juju-e4d256-prod-github-runner-207 kernel: [72084.610314] __x64_sys_ioctl+0x95/0xd0 Aug 23 01:25:10 juju-e4d256-prod-github-runner-207 kernel: [72084.611027] do_syscall_64+0x5c/0xc0 Aug 23 01:25:10 juju-e4d256-prod-github-runner-207 kernel: [72084.611718] ? do_futex+0x162/0x1f0 Aug 23 01:25:10 juju-e4d256-prod-github-runner-207 kernel: [72084.612390] ? __x64_sys_futex+0x78/0x1e0 Aug 23 01:25:10 juju-e4d256-prod-github-runner-207 kernel: [72084.613080] ? __secure_computing+0xa9/0x120 Aug 23 01:25:10 juju-e4d256-prod-github-runner-207 kernel: [72084.613796] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 01:25:10 juju-e4d256-prod-github-runner-207 kernel: [72084.614596] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:25:10 juju-e4d256-prod-github-runner-207 kernel: [72084.615393] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:25:10 juju-e4d256-prod-github-runner-207 kernel: [72084.616154] ? do_syscall_64+0x69/0xc0 Aug 23 01:25:10 juju-e4d256-prod-github-runner-207 kernel: [72084.616830] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:25:10 juju-e4d256-prod-github-runner-207 kernel: [72084.617564] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:25:10 juju-e4d256-prod-github-runner-207 kernel: [72084.618280] ? do_syscall_64+0x69/0xc0 Aug 23 01:25:10 juju-e4d256-prod-github-runner-207 kernel: [72084.618913] ? do_syscall_64+0x69/0xc0 Aug 23 01:25:10 juju-e4d256-prod-github-runner-207 kernel: [72084.619564] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 01:25:10 juju-e4d256-prod-github-runner-207 kernel: [72084.620274] RIP: 0033:0x7faa5d0edaff Aug 23 01:25:10 juju-e4d256-prod-github-runner-207 kernel: [72084.620945] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 01:25:10 juju-e4d256-prod-github-runner-207 kernel: [72084.622966] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 01:25:10 juju-e4d256-prod-github-runner-207 kernel: [72084.623920] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 01:25:10 juju-e4d256-prod-github-runner-207 kernel: [72084.624824] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 01:25:10 juju-e4d256-prod-github-runner-207 kernel: [72084.625751] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 01:25:10 juju-e4d256-prod-github-runner-207 kernel: [72084.626657] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 01:25:10 juju-e4d256-prod-github-runner-207 kernel: [72084.627585] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 01:25:10 juju-e4d256-prod-github-runner-207 kernel: [72084.628487] Aug 23 01:25:38 juju-e4d256-prod-github-runner-207 kernel: [72112.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 67052s! [qemu-system-x86:6715] Aug 23 01:25:38 juju-e4d256-prod-github-runner-207 kernel: [72112.543127] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 01:25:38 juju-e4d256-prod-github-runner-207 kernel: [72112.543196] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 01:25:38 juju-e4d256-prod-github-runner-207 kernel: [72112.555483] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 01:25:38 juju-e4d256-prod-github-runner-207 kernel: [72112.556758] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 01:25:38 juju-e4d256-prod-github-runner-207 kernel: [72112.557978] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:25:38 juju-e4d256-prod-github-runner-207 kernel: [72112.559056] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 01:25:38 juju-e4d256-prod-github-runner-207 kernel: [72112.561637] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 01:25:38 juju-e4d256-prod-github-runner-207 kernel: [72112.562690] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 01:25:38 juju-e4d256-prod-github-runner-207 kernel: [72112.563873] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 01:25:38 juju-e4d256-prod-github-runner-207 kernel: [72112.565033] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 01:25:38 juju-e4d256-prod-github-runner-207 kernel: [72112.566191] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 01:25:38 juju-e4d256-prod-github-runner-207 kernel: [72112.567369] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 01:25:38 juju-e4d256-prod-github-runner-207 kernel: [72112.568535] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 01:25:38 juju-e4d256-prod-github-runner-207 kernel: [72112.569768] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 01:25:38 juju-e4d256-prod-github-runner-207 kernel: [72112.570871] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 01:25:38 juju-e4d256-prod-github-runner-207 kernel: [72112.572109] Call Trace: Aug 23 01:25:38 juju-e4d256-prod-github-runner-207 kernel: [72112.573024] Aug 23 01:25:38 juju-e4d256-prod-github-runner-207 kernel: [72112.573933] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:25:38 juju-e4d256-prod-github-runner-207 kernel: [72112.574965] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:25:38 juju-e4d256-prod-github-runner-207 kernel: [72112.575995] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:25:38 juju-e4d256-prod-github-runner-207 kernel: [72112.577072] ? show_regs.part.0+0x23/0x29 Aug 23 01:25:38 juju-e4d256-prod-github-runner-207 kernel: [72112.578074] ? show_regs.cold+0x8/0xd Aug 23 01:25:38 juju-e4d256-prod-github-runner-207 kernel: [72112.579062] ? watchdog_timer_fn+0x1be/0x220 Aug 23 01:25:38 juju-e4d256-prod-github-runner-207 kernel: [72112.580196] ? lockup_detector_update_enable+0x60/0x60 Aug 23 01:25:38 juju-e4d256-prod-github-runner-207 kernel: [72112.581364] ? __hrtimer_run_queues+0x107/0x230 Aug 23 01:25:38 juju-e4d256-prod-github-runner-207 kernel: [72112.582482] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 01:25:38 juju-e4d256-prod-github-runner-207 kernel: [72112.583619] ? hrtimer_interrupt+0x101/0x220 Aug 23 01:25:38 juju-e4d256-prod-github-runner-207 kernel: [72112.584728] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 01:25:38 juju-e4d256-prod-github-runner-207 kernel: [72112.586120] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 01:25:38 juju-e4d256-prod-github-runner-207 kernel: [72112.587296] Aug 23 01:25:38 juju-e4d256-prod-github-runner-207 kernel: [72112.588201] Aug 23 01:25:38 juju-e4d256-prod-github-runner-207 kernel: [72112.589100] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 01:25:38 juju-e4d256-prod-github-runner-207 kernel: [72112.590239] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:25:38 juju-e4d256-prod-github-runner-207 kernel: [72112.591401] ? _raw_spin_lock+0x22/0x30 Aug 23 01:25:38 juju-e4d256-prod-github-runner-207 kernel: [72112.592436] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:25:38 juju-e4d256-prod-github-runner-207 kernel: [72112.593471] direct_page_fault+0x206/0x310 [kvm] Aug 23 01:25:38 juju-e4d256-prod-github-runner-207 kernel: [72112.594500] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 01:25:38 juju-e4d256-prod-github-runner-207 kernel: [72112.595539] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 01:25:38 juju-e4d256-prod-github-runner-207 kernel: [72112.596544] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 01:25:38 juju-e4d256-prod-github-runner-207 kernel: [72112.597518] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 01:25:38 juju-e4d256-prod-github-runner-207 kernel: [72112.598464] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 01:25:38 juju-e4d256-prod-github-runner-207 kernel: [72112.599467] handle_exit+0x98/0x230 [kvm_amd] Aug 23 01:25:38 juju-e4d256-prod-github-runner-207 kernel: [72112.600361] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 01:25:38 juju-e4d256-prod-github-runner-207 kernel: [72112.601277] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 01:25:38 juju-e4d256-prod-github-runner-207 kernel: [72112.602210] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 01:25:38 juju-e4d256-prod-github-runner-207 kernel: [72112.603135] vcpu_run+0x62/0x2c0 [kvm] Aug 23 01:25:38 juju-e4d256-prod-github-runner-207 kernel: [72112.603953] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 01:25:38 juju-e4d256-prod-github-runner-207 kernel: [72112.604838] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 01:25:38 juju-e4d256-prod-github-runner-207 kernel: [72112.605697] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 01:25:38 juju-e4d256-prod-github-runner-207 kernel: [72112.606497] ? __seccomp_filter+0x4a/0x4a0 Aug 23 01:25:38 juju-e4d256-prod-github-runner-207 kernel: [72112.607271] ? __fget_files+0x86/0xc0 Aug 23 01:25:38 juju-e4d256-prod-github-runner-207 kernel: [72112.607987] __x64_sys_ioctl+0x95/0xd0 Aug 23 01:25:38 juju-e4d256-prod-github-runner-207 kernel: [72112.608684] do_syscall_64+0x5c/0xc0 Aug 23 01:25:38 juju-e4d256-prod-github-runner-207 kernel: [72112.609354] ? do_futex+0x162/0x1f0 Aug 23 01:25:38 juju-e4d256-prod-github-runner-207 kernel: [72112.610011] ? __x64_sys_futex+0x78/0x1e0 Aug 23 01:25:38 juju-e4d256-prod-github-runner-207 kernel: [72112.610873] ? __secure_computing+0xa9/0x120 Aug 23 01:25:38 juju-e4d256-prod-github-runner-207 kernel: [72112.611590] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 01:25:38 juju-e4d256-prod-github-runner-207 kernel: [72112.612354] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:25:38 juju-e4d256-prod-github-runner-207 kernel: [72112.613081] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:25:38 juju-e4d256-prod-github-runner-207 kernel: [72112.613804] ? do_syscall_64+0x69/0xc0 Aug 23 01:25:38 juju-e4d256-prod-github-runner-207 kernel: [72112.614452] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:25:38 juju-e4d256-prod-github-runner-207 kernel: [72112.615313] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:25:38 juju-e4d256-prod-github-runner-207 kernel: [72112.616028] ? do_syscall_64+0x69/0xc0 Aug 23 01:25:38 juju-e4d256-prod-github-runner-207 kernel: [72112.616670] ? do_syscall_64+0x69/0xc0 Aug 23 01:25:38 juju-e4d256-prod-github-runner-207 kernel: [72112.617296] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 01:25:38 juju-e4d256-prod-github-runner-207 kernel: [72112.618012] RIP: 0033:0x7faa5d0edaff Aug 23 01:25:38 juju-e4d256-prod-github-runner-207 kernel: [72112.618638] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 01:25:38 juju-e4d256-prod-github-runner-207 kernel: [72112.620656] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 01:25:38 juju-e4d256-prod-github-runner-207 kernel: [72112.621740] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 01:25:38 juju-e4d256-prod-github-runner-207 kernel: [72112.622634] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 01:25:38 juju-e4d256-prod-github-runner-207 kernel: [72112.623540] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 01:25:38 juju-e4d256-prod-github-runner-207 kernel: [72112.624431] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 01:25:38 juju-e4d256-prod-github-runner-207 kernel: [72112.625323] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 01:25:38 juju-e4d256-prod-github-runner-207 kernel: [72112.626218] Aug 23 01:26:06 juju-e4d256-prod-github-runner-207 kernel: [72140.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 67078s! [qemu-system-x86:6715] Aug 23 01:26:06 juju-e4d256-prod-github-runner-207 kernel: [72140.543136] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 01:26:06 juju-e4d256-prod-github-runner-207 kernel: [72140.543201] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 01:26:06 juju-e4d256-prod-github-runner-207 kernel: [72140.555694] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 01:26:06 juju-e4d256-prod-github-runner-207 kernel: [72140.557025] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 01:26:06 juju-e4d256-prod-github-runner-207 kernel: [72140.558273] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:26:06 juju-e4d256-prod-github-runner-207 kernel: [72140.559391] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 01:26:06 juju-e4d256-prod-github-runner-207 kernel: [72140.561969] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 01:26:06 juju-e4d256-prod-github-runner-207 kernel: [72140.563045] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 01:26:06 juju-e4d256-prod-github-runner-207 kernel: [72140.564258] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 01:26:06 juju-e4d256-prod-github-runner-207 kernel: [72140.565440] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 01:26:06 juju-e4d256-prod-github-runner-207 kernel: [72140.566610] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 01:26:06 juju-e4d256-prod-github-runner-207 kernel: [72140.567817] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 01:26:06 juju-e4d256-prod-github-runner-207 kernel: [72140.569023] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 01:26:06 juju-e4d256-prod-github-runner-207 kernel: [72140.570311] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 01:26:06 juju-e4d256-prod-github-runner-207 kernel: [72140.571436] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 01:26:06 juju-e4d256-prod-github-runner-207 kernel: [72140.572639] Call Trace: Aug 23 01:26:06 juju-e4d256-prod-github-runner-207 kernel: [72140.573569] Aug 23 01:26:06 juju-e4d256-prod-github-runner-207 kernel: [72140.574477] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:26:06 juju-e4d256-prod-github-runner-207 kernel: [72140.575546] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:26:06 juju-e4d256-prod-github-runner-207 kernel: [72140.576581] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:26:06 juju-e4d256-prod-github-runner-207 kernel: [72140.577682] ? show_regs.part.0+0x23/0x29 Aug 23 01:26:06 juju-e4d256-prod-github-runner-207 kernel: [72140.578727] ? show_regs.cold+0x8/0xd Aug 23 01:26:06 juju-e4d256-prod-github-runner-207 kernel: [72140.579729] ? watchdog_timer_fn+0x1be/0x220 Aug 23 01:26:06 juju-e4d256-prod-github-runner-207 kernel: [72140.580775] ? lockup_detector_update_enable+0x60/0x60 Aug 23 01:26:06 juju-e4d256-prod-github-runner-207 kernel: [72140.581858] ? __hrtimer_run_queues+0x107/0x230 Aug 23 01:26:06 juju-e4d256-prod-github-runner-207 kernel: [72140.582931] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 01:26:06 juju-e4d256-prod-github-runner-207 kernel: [72140.583970] ? hrtimer_interrupt+0x101/0x220 Aug 23 01:26:06 juju-e4d256-prod-github-runner-207 kernel: [72140.585004] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 01:26:06 juju-e4d256-prod-github-runner-207 kernel: [72140.586109] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 01:26:06 juju-e4d256-prod-github-runner-207 kernel: [72140.587191] Aug 23 01:26:06 juju-e4d256-prod-github-runner-207 kernel: [72140.588069] Aug 23 01:26:06 juju-e4d256-prod-github-runner-207 kernel: [72140.588930] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 01:26:06 juju-e4d256-prod-github-runner-207 kernel: [72140.589984] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:26:06 juju-e4d256-prod-github-runner-207 kernel: [72140.591080] ? _raw_spin_lock+0x22/0x30 Aug 23 01:26:06 juju-e4d256-prod-github-runner-207 kernel: [72140.592032] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:26:06 juju-e4d256-prod-github-runner-207 kernel: [72140.593051] direct_page_fault+0x206/0x310 [kvm] Aug 23 01:26:06 juju-e4d256-prod-github-runner-207 kernel: [72140.594075] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 01:26:06 juju-e4d256-prod-github-runner-207 kernel: [72140.595120] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 01:26:06 juju-e4d256-prod-github-runner-207 kernel: [72140.596150] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 01:26:06 juju-e4d256-prod-github-runner-207 kernel: [72140.597127] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 01:26:06 juju-e4d256-prod-github-runner-207 kernel: [72140.598081] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 01:26:06 juju-e4d256-prod-github-runner-207 kernel: [72140.599167] handle_exit+0x98/0x230 [kvm_amd] Aug 23 01:26:06 juju-e4d256-prod-github-runner-207 kernel: [72140.600111] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 01:26:06 juju-e4d256-prod-github-runner-207 kernel: [72140.601072] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 01:26:06 juju-e4d256-prod-github-runner-207 kernel: [72140.602011] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 01:26:06 juju-e4d256-prod-github-runner-207 kernel: [72140.602937] vcpu_run+0x62/0x2c0 [kvm] Aug 23 01:26:06 juju-e4d256-prod-github-runner-207 kernel: [72140.603760] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 01:26:06 juju-e4d256-prod-github-runner-207 kernel: [72140.604573] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 01:26:06 juju-e4d256-prod-github-runner-207 kernel: [72140.605457] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 01:26:06 juju-e4d256-prod-github-runner-207 kernel: [72140.606274] ? __seccomp_filter+0x4a/0x4a0 Aug 23 01:26:06 juju-e4d256-prod-github-runner-207 kernel: [72140.607049] ? __fget_files+0x86/0xc0 Aug 23 01:26:06 juju-e4d256-prod-github-runner-207 kernel: [72140.607762] __x64_sys_ioctl+0x95/0xd0 Aug 23 01:26:06 juju-e4d256-prod-github-runner-207 kernel: [72140.608460] do_syscall_64+0x5c/0xc0 Aug 23 01:26:06 juju-e4d256-prod-github-runner-207 kernel: [72140.609130] ? do_futex+0x162/0x1f0 Aug 23 01:26:06 juju-e4d256-prod-github-runner-207 kernel: [72140.609783] ? __x64_sys_futex+0x78/0x1e0 Aug 23 01:26:06 juju-e4d256-prod-github-runner-207 kernel: [72140.610479] ? __secure_computing+0xa9/0x120 Aug 23 01:26:06 juju-e4d256-prod-github-runner-207 kernel: [72140.611236] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 01:26:06 juju-e4d256-prod-github-runner-207 kernel: [72140.612012] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:26:06 juju-e4d256-prod-github-runner-207 kernel: [72140.612742] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:26:06 juju-e4d256-prod-github-runner-207 kernel: [72140.613482] ? do_syscall_64+0x69/0xc0 Aug 23 01:26:06 juju-e4d256-prod-github-runner-207 kernel: [72140.614133] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:26:06 juju-e4d256-prod-github-runner-207 kernel: [72140.614856] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:26:06 juju-e4d256-prod-github-runner-207 kernel: [72140.615578] ? do_syscall_64+0x69/0xc0 Aug 23 01:26:06 juju-e4d256-prod-github-runner-207 kernel: [72140.616216] ? do_syscall_64+0x69/0xc0 Aug 23 01:26:06 juju-e4d256-prod-github-runner-207 kernel: [72140.616854] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 01:26:06 juju-e4d256-prod-github-runner-207 kernel: [72140.617568] RIP: 0033:0x7faa5d0edaff Aug 23 01:26:06 juju-e4d256-prod-github-runner-207 kernel: [72140.618216] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 01:26:06 juju-e4d256-prod-github-runner-207 kernel: [72140.620229] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 01:26:06 juju-e4d256-prod-github-runner-207 kernel: [72140.621162] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 01:26:06 juju-e4d256-prod-github-runner-207 kernel: [72140.622088] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 01:26:06 juju-e4d256-prod-github-runner-207 kernel: [72140.623011] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 01:26:06 juju-e4d256-prod-github-runner-207 kernel: [72140.623920] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 01:26:06 juju-e4d256-prod-github-runner-207 kernel: [72140.624812] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 01:26:06 juju-e4d256-prod-github-runner-207 kernel: [72140.625728] Aug 23 01:26:34 juju-e4d256-prod-github-runner-207 kernel: [72168.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 67104s! [qemu-system-x86:6715] Aug 23 01:26:34 juju-e4d256-prod-github-runner-207 kernel: [72168.543684] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 01:26:34 juju-e4d256-prod-github-runner-207 kernel: [72168.543925] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 01:26:34 juju-e4d256-prod-github-runner-207 kernel: [72168.556014] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 01:26:34 juju-e4d256-prod-github-runner-207 kernel: [72168.557280] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 01:26:34 juju-e4d256-prod-github-runner-207 kernel: [72168.558517] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:26:34 juju-e4d256-prod-github-runner-207 kernel: [72168.559576] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 01:26:34 juju-e4d256-prod-github-runner-207 kernel: [72168.562330] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 01:26:34 juju-e4d256-prod-github-runner-207 kernel: [72168.563410] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 01:26:34 juju-e4d256-prod-github-runner-207 kernel: [72168.564578] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 01:26:34 juju-e4d256-prod-github-runner-207 kernel: [72168.565738] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 01:26:34 juju-e4d256-prod-github-runner-207 kernel: [72168.566917] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 01:26:34 juju-e4d256-prod-github-runner-207 kernel: [72168.568083] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 01:26:34 juju-e4d256-prod-github-runner-207 kernel: [72168.569249] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 01:26:34 juju-e4d256-prod-github-runner-207 kernel: [72168.570486] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 01:26:34 juju-e4d256-prod-github-runner-207 kernel: [72168.571590] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 01:26:34 juju-e4d256-prod-github-runner-207 kernel: [72168.572785] Call Trace: Aug 23 01:26:34 juju-e4d256-prod-github-runner-207 kernel: [72168.573696] Aug 23 01:26:34 juju-e4d256-prod-github-runner-207 kernel: [72168.574602] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:26:34 juju-e4d256-prod-github-runner-207 kernel: [72168.575631] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:26:34 juju-e4d256-prod-github-runner-207 kernel: [72168.576651] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:26:34 juju-e4d256-prod-github-runner-207 kernel: [72168.577741] ? show_regs.part.0+0x23/0x29 Aug 23 01:26:34 juju-e4d256-prod-github-runner-207 kernel: [72168.578750] ? show_regs.cold+0x8/0xd Aug 23 01:26:34 juju-e4d256-prod-github-runner-207 kernel: [72168.579722] ? watchdog_timer_fn+0x1be/0x220 Aug 23 01:26:34 juju-e4d256-prod-github-runner-207 kernel: [72168.580734] ? lockup_detector_update_enable+0x60/0x60 Aug 23 01:26:34 juju-e4d256-prod-github-runner-207 kernel: [72168.581805] ? __hrtimer_run_queues+0x107/0x230 Aug 23 01:26:34 juju-e4d256-prod-github-runner-207 kernel: [72168.582840] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 01:26:34 juju-e4d256-prod-github-runner-207 kernel: [72168.583863] ? hrtimer_interrupt+0x101/0x220 Aug 23 01:26:34 juju-e4d256-prod-github-runner-207 kernel: [72168.584876] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 01:26:34 juju-e4d256-prod-github-runner-207 kernel: [72168.585942] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 01:26:34 juju-e4d256-prod-github-runner-207 kernel: [72168.586995] Aug 23 01:26:34 juju-e4d256-prod-github-runner-207 kernel: [72168.587846] Aug 23 01:26:34 juju-e4d256-prod-github-runner-207 kernel: [72168.588681] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 01:26:34 juju-e4d256-prod-github-runner-207 kernel: [72168.589712] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:26:34 juju-e4d256-prod-github-runner-207 kernel: [72168.590762] ? _raw_spin_lock+0x22/0x30 Aug 23 01:26:34 juju-e4d256-prod-github-runner-207 kernel: [72168.591709] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:26:34 juju-e4d256-prod-github-runner-207 kernel: [72168.592722] direct_page_fault+0x206/0x310 [kvm] Aug 23 01:26:34 juju-e4d256-prod-github-runner-207 kernel: [72168.593750] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 01:26:34 juju-e4d256-prod-github-runner-207 kernel: [72168.594765] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 01:26:34 juju-e4d256-prod-github-runner-207 kernel: [72168.595768] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 01:26:34 juju-e4d256-prod-github-runner-207 kernel: [72168.596762] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 01:26:34 juju-e4d256-prod-github-runner-207 kernel: [72168.597706] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 01:26:34 juju-e4d256-prod-github-runner-207 kernel: [72168.598692] handle_exit+0x98/0x230 [kvm_amd] Aug 23 01:26:34 juju-e4d256-prod-github-runner-207 kernel: [72168.599584] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 01:26:34 juju-e4d256-prod-github-runner-207 kernel: [72168.600495] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 01:26:34 juju-e4d256-prod-github-runner-207 kernel: [72168.601418] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 01:26:34 juju-e4d256-prod-github-runner-207 kernel: [72168.602320] vcpu_run+0x62/0x2c0 [kvm] Aug 23 01:26:34 juju-e4d256-prod-github-runner-207 kernel: [72168.603143] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 01:26:34 juju-e4d256-prod-github-runner-207 kernel: [72168.603949] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 01:26:34 juju-e4d256-prod-github-runner-207 kernel: [72168.604801] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 01:26:34 juju-e4d256-prod-github-runner-207 kernel: [72168.605596] ? __seccomp_filter+0x4a/0x4a0 Aug 23 01:26:34 juju-e4d256-prod-github-runner-207 kernel: [72168.606342] ? __fget_files+0x86/0xc0 Aug 23 01:26:34 juju-e4d256-prod-github-runner-207 kernel: [72168.607053] __x64_sys_ioctl+0x95/0xd0 Aug 23 01:26:34 juju-e4d256-prod-github-runner-207 kernel: [72168.607744] do_syscall_64+0x5c/0xc0 Aug 23 01:26:34 juju-e4d256-prod-github-runner-207 kernel: [72168.608407] ? do_futex+0x162/0x1f0 Aug 23 01:26:34 juju-e4d256-prod-github-runner-207 kernel: [72168.609054] ? __x64_sys_futex+0x78/0x1e0 Aug 23 01:26:34 juju-e4d256-prod-github-runner-207 kernel: [72168.609726] ? __secure_computing+0xa9/0x120 Aug 23 01:26:34 juju-e4d256-prod-github-runner-207 kernel: [72168.610460] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 01:26:34 juju-e4d256-prod-github-runner-207 kernel: [72168.611225] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:26:34 juju-e4d256-prod-github-runner-207 kernel: [72168.611949] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:26:34 juju-e4d256-prod-github-runner-207 kernel: [72168.612665] ? do_syscall_64+0x69/0xc0 Aug 23 01:26:34 juju-e4d256-prod-github-runner-207 kernel: [72168.613309] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:26:34 juju-e4d256-prod-github-runner-207 kernel: [72168.614011] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:26:34 juju-e4d256-prod-github-runner-207 kernel: [72168.614717] ? do_syscall_64+0x69/0xc0 Aug 23 01:26:34 juju-e4d256-prod-github-runner-207 kernel: [72168.615341] ? do_syscall_64+0x69/0xc0 Aug 23 01:26:34 juju-e4d256-prod-github-runner-207 kernel: [72168.615967] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 01:26:34 juju-e4d256-prod-github-runner-207 kernel: [72168.616673] RIP: 0033:0x7faa5d0edaff Aug 23 01:26:34 juju-e4d256-prod-github-runner-207 kernel: [72168.617318] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 01:26:34 juju-e4d256-prod-github-runner-207 kernel: [72168.619310] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 01:26:34 juju-e4d256-prod-github-runner-207 kernel: [72168.620219] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 01:26:34 juju-e4d256-prod-github-runner-207 kernel: [72168.621108] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 01:26:34 juju-e4d256-prod-github-runner-207 kernel: [72168.621996] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 01:26:34 juju-e4d256-prod-github-runner-207 kernel: [72168.622891] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 01:26:34 juju-e4d256-prod-github-runner-207 kernel: [72168.623777] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 01:26:34 juju-e4d256-prod-github-runner-207 kernel: [72168.624666] Aug 23 01:26:48 juju-e4d256-prod-github-runner-207 kernel: [72182.000706] rcu: INFO: rcu_sched self-detected stall on CPU Aug 23 01:26:48 juju-e4d256-prod-github-runner-207 kernel: [72182.001647] rcu: 1-....: (17959487 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=8675421 Aug 23 01:26:48 juju-e4d256-prod-github-runner-207 kernel: [72182.002795] (t=18016200 jiffies g=23269 q=61790) Aug 23 01:26:48 juju-e4d256-prod-github-runner-207 kernel: [72182.003590] NMI backtrace for cpu 1 Aug 23 01:26:48 juju-e4d256-prod-github-runner-207 kernel: [72182.004301] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 01:26:48 juju-e4d256-prod-github-runner-207 kernel: [72182.005400] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 01:26:48 juju-e4d256-prod-github-runner-207 kernel: [72182.006473] Call Trace: Aug 23 01:26:48 juju-e4d256-prod-github-runner-207 kernel: [72182.007149] Aug 23 01:26:48 juju-e4d256-prod-github-runner-207 kernel: [72182.007793] show_stack+0x52/0x5c Aug 23 01:26:48 juju-e4d256-prod-github-runner-207 kernel: [72182.008524] dump_stack_lvl+0x4a/0x63 Aug 23 01:26:48 juju-e4d256-prod-github-runner-207 kernel: [72182.009274] dump_stack+0x10/0x16 Aug 23 01:26:48 juju-e4d256-prod-github-runner-207 kernel: [72182.009990] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 23 01:26:48 juju-e4d256-prod-github-runner-207 kernel: [72182.010787] ? lapic_can_unplug_cpu+0x90/0x90 Aug 23 01:26:48 juju-e4d256-prod-github-runner-207 kernel: [72182.011564] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 23 01:26:48 juju-e4d256-prod-github-runner-207 kernel: [72182.012382] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 23 01:26:48 juju-e4d256-prod-github-runner-207 kernel: [72182.013199] trigger_single_cpu_backtrace+0x44/0x4f Aug 23 01:26:48 juju-e4d256-prod-github-runner-207 kernel: [72182.014015] rcu_dump_cpu_stacks+0x102/0x149 Aug 23 01:26:48 juju-e4d256-prod-github-runner-207 kernel: [72182.014798] print_cpu_stall.cold+0x2f/0xe2 Aug 23 01:26:48 juju-e4d256-prod-github-runner-207 kernel: [72182.015560] ? timekeeping_update+0xf7/0x150 Aug 23 01:26:48 juju-e4d256-prod-github-runner-207 kernel: [72182.016327] check_cpu_stall+0x109/0x270 Aug 23 01:26:48 juju-e4d256-prod-github-runner-207 kernel: [72182.017074] rcu_sched_clock_irq+0x9a/0x250 Aug 23 01:26:48 juju-e4d256-prod-github-runner-207 kernel: [72182.017833] update_process_times+0x94/0xd0 Aug 23 01:26:48 juju-e4d256-prod-github-runner-207 kernel: [72182.018610] tick_sched_handle+0x29/0x70 Aug 23 01:26:48 juju-e4d256-prod-github-runner-207 kernel: [72182.019357] tick_sched_timer+0x8c/0xc0 Aug 23 01:26:48 juju-e4d256-prod-github-runner-207 kernel: [72182.020093] ? tick_nohz_handler+0xb0/0xb0 Aug 23 01:26:48 juju-e4d256-prod-github-runner-207 kernel: [72182.020846] __hrtimer_run_queues+0x107/0x230 Aug 23 01:26:48 juju-e4d256-prod-github-runner-207 kernel: [72182.021616] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 01:26:48 juju-e4d256-prod-github-runner-207 kernel: [72182.022404] hrtimer_interrupt+0x101/0x220 Aug 23 01:26:48 juju-e4d256-prod-github-runner-207 kernel: [72182.023162] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 01:26:48 juju-e4d256-prod-github-runner-207 kernel: [72182.023980] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 01:26:48 juju-e4d256-prod-github-runner-207 kernel: [72182.024779] Aug 23 01:26:48 juju-e4d256-prod-github-runner-207 kernel: [72182.025417] Aug 23 01:26:48 juju-e4d256-prod-github-runner-207 kernel: [72182.026044] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 01:26:48 juju-e4d256-prod-github-runner-207 kernel: [72182.026874] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:26:48 juju-e4d256-prod-github-runner-207 kernel: [72182.027760] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 01:26:48 juju-e4d256-prod-github-runner-207 kernel: [72182.030104] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 01:26:48 juju-e4d256-prod-github-runner-207 kernel: [72182.030998] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 01:26:48 juju-e4d256-prod-github-runner-207 kernel: [72182.031991] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 01:26:48 juju-e4d256-prod-github-runner-207 kernel: [72182.032966] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 01:26:48 juju-e4d256-prod-github-runner-207 kernel: [72182.033927] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 01:26:48 juju-e4d256-prod-github-runner-207 kernel: [72182.034912] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 01:26:48 juju-e4d256-prod-github-runner-207 kernel: [72182.035862] ? _raw_spin_lock+0x22/0x30 Aug 23 01:26:48 juju-e4d256-prod-github-runner-207 kernel: [72182.036622] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:26:48 juju-e4d256-prod-github-runner-207 kernel: [72182.037460] direct_page_fault+0x206/0x310 [kvm] Aug 23 01:26:48 juju-e4d256-prod-github-runner-207 kernel: [72182.038306] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 01:26:48 juju-e4d256-prod-github-runner-207 kernel: [72182.039130] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 01:26:48 juju-e4d256-prod-github-runner-207 kernel: [72182.039958] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 01:26:48 juju-e4d256-prod-github-runner-207 kernel: [72182.040764] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 01:26:48 juju-e4d256-prod-github-runner-207 kernel: [72182.041551] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 01:26:48 juju-e4d256-prod-github-runner-207 kernel: [72182.042383] handle_exit+0x98/0x230 [kvm_amd] Aug 23 01:26:48 juju-e4d256-prod-github-runner-207 kernel: [72182.043136] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 01:26:48 juju-e4d256-prod-github-runner-207 kernel: [72182.043916] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 01:26:48 juju-e4d256-prod-github-runner-207 kernel: [72182.044726] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 01:26:48 juju-e4d256-prod-github-runner-207 kernel: [72182.045517] vcpu_run+0x62/0x2c0 [kvm] Aug 23 01:26:48 juju-e4d256-prod-github-runner-207 kernel: [72182.046245] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 01:26:48 juju-e4d256-prod-github-runner-207 kernel: [72182.046977] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 01:26:48 juju-e4d256-prod-github-runner-207 kernel: [72182.047778] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 01:26:48 juju-e4d256-prod-github-runner-207 kernel: [72182.048538] ? __seccomp_filter+0x4a/0x4a0 Aug 23 01:26:48 juju-e4d256-prod-github-runner-207 kernel: [72182.049258] ? __fget_files+0x86/0xc0 Aug 23 01:26:48 juju-e4d256-prod-github-runner-207 kernel: [72182.049956] __x64_sys_ioctl+0x95/0xd0 Aug 23 01:26:48 juju-e4d256-prod-github-runner-207 kernel: [72182.050668] do_syscall_64+0x5c/0xc0 Aug 23 01:26:48 juju-e4d256-prod-github-runner-207 kernel: [72182.051347] ? do_futex+0x162/0x1f0 Aug 23 01:26:48 juju-e4d256-prod-github-runner-207 kernel: [72182.052015] ? __x64_sys_futex+0x78/0x1e0 Aug 23 01:26:48 juju-e4d256-prod-github-runner-207 kernel: [72182.052714] ? __secure_computing+0xa9/0x120 Aug 23 01:26:48 juju-e4d256-prod-github-runner-207 kernel: [72182.053427] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 01:26:48 juju-e4d256-prod-github-runner-207 kernel: [72182.054258] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:26:48 juju-e4d256-prod-github-runner-207 kernel: [72182.055024] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:26:48 juju-e4d256-prod-github-runner-207 kernel: [72182.055783] ? do_syscall_64+0x69/0xc0 Aug 23 01:26:48 juju-e4d256-prod-github-runner-207 kernel: [72182.056472] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:26:48 juju-e4d256-prod-github-runner-207 kernel: [72182.057225] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:26:48 juju-e4d256-prod-github-runner-207 kernel: [72182.057984] ? do_syscall_64+0x69/0xc0 Aug 23 01:26:48 juju-e4d256-prod-github-runner-207 kernel: [72182.058694] ? do_syscall_64+0x69/0xc0 Aug 23 01:26:48 juju-e4d256-prod-github-runner-207 kernel: [72182.059387] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 01:26:48 juju-e4d256-prod-github-runner-207 kernel: [72182.060166] RIP: 0033:0x7faa5d0edaff Aug 23 01:26:48 juju-e4d256-prod-github-runner-207 kernel: [72182.060881] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 01:26:48 juju-e4d256-prod-github-runner-207 kernel: [72182.062990] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 01:26:48 juju-e4d256-prod-github-runner-207 kernel: [72182.063956] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 01:26:48 juju-e4d256-prod-github-runner-207 kernel: [72182.064902] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 01:26:48 juju-e4d256-prod-github-runner-207 kernel: [72182.065854] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 01:26:48 juju-e4d256-prod-github-runner-207 kernel: [72182.066811] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 01:26:48 juju-e4d256-prod-github-runner-207 kernel: [72182.067734] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 01:26:48 juju-e4d256-prod-github-runner-207 kernel: [72182.068647] Aug 23 01:27:14 juju-e4d256-prod-github-runner-207 kernel: [72208.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 67141s! [qemu-system-x86:6715] Aug 23 01:27:14 juju-e4d256-prod-github-runner-207 kernel: [72208.543085] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 01:27:14 juju-e4d256-prod-github-runner-207 kernel: [72208.543151] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 01:27:14 juju-e4d256-prod-github-runner-207 kernel: [72208.555292] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 01:27:14 juju-e4d256-prod-github-runner-207 kernel: [72208.556556] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 01:27:14 juju-e4d256-prod-github-runner-207 kernel: [72208.557773] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:27:14 juju-e4d256-prod-github-runner-207 kernel: [72208.558854] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 01:27:14 juju-e4d256-prod-github-runner-207 kernel: [72208.561399] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 01:27:14 juju-e4d256-prod-github-runner-207 kernel: [72208.562456] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 01:27:14 juju-e4d256-prod-github-runner-207 kernel: [72208.563733] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 01:27:14 juju-e4d256-prod-github-runner-207 kernel: [72208.564896] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 01:27:14 juju-e4d256-prod-github-runner-207 kernel: [72208.566067] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 01:27:14 juju-e4d256-prod-github-runner-207 kernel: [72208.567226] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 01:27:14 juju-e4d256-prod-github-runner-207 kernel: [72208.568412] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 01:27:14 juju-e4d256-prod-github-runner-207 kernel: [72208.569830] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 01:27:14 juju-e4d256-prod-github-runner-207 kernel: [72208.571125] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 01:27:14 juju-e4d256-prod-github-runner-207 kernel: [72208.572475] Call Trace: Aug 23 01:27:14 juju-e4d256-prod-github-runner-207 kernel: [72208.573389] Aug 23 01:27:14 juju-e4d256-prod-github-runner-207 kernel: [72208.574362] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:27:14 juju-e4d256-prod-github-runner-207 kernel: [72208.575396] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:27:14 juju-e4d256-prod-github-runner-207 kernel: [72208.576422] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:27:14 juju-e4d256-prod-github-runner-207 kernel: [72208.577497] ? show_regs.part.0+0x23/0x29 Aug 23 01:27:14 juju-e4d256-prod-github-runner-207 kernel: [72208.578516] ? show_regs.cold+0x8/0xd Aug 23 01:27:14 juju-e4d256-prod-github-runner-207 kernel: [72208.579490] ? watchdog_timer_fn+0x1be/0x220 Aug 23 01:27:14 juju-e4d256-prod-github-runner-207 kernel: [72208.580497] ? lockup_detector_update_enable+0x60/0x60 Aug 23 01:27:14 juju-e4d256-prod-github-runner-207 kernel: [72208.581563] ? __hrtimer_run_queues+0x107/0x230 Aug 23 01:27:14 juju-e4d256-prod-github-runner-207 kernel: [72208.582623] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 01:27:14 juju-e4d256-prod-github-runner-207 kernel: [72208.583660] ? hrtimer_interrupt+0x101/0x220 Aug 23 01:27:14 juju-e4d256-prod-github-runner-207 kernel: [72208.584674] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 01:27:14 juju-e4d256-prod-github-runner-207 kernel: [72208.585740] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 01:27:14 juju-e4d256-prod-github-runner-207 kernel: [72208.586801] Aug 23 01:27:14 juju-e4d256-prod-github-runner-207 kernel: [72208.587652] Aug 23 01:27:14 juju-e4d256-prod-github-runner-207 kernel: [72208.588488] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 01:27:14 juju-e4d256-prod-github-runner-207 kernel: [72208.589521] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:27:14 juju-e4d256-prod-github-runner-207 kernel: [72208.590573] ? _raw_spin_lock+0x22/0x30 Aug 23 01:27:14 juju-e4d256-prod-github-runner-207 kernel: [72208.591517] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:27:14 juju-e4d256-prod-github-runner-207 kernel: [72208.592535] direct_page_fault+0x206/0x310 [kvm] Aug 23 01:27:14 juju-e4d256-prod-github-runner-207 kernel: [72208.593560] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 01:27:14 juju-e4d256-prod-github-runner-207 kernel: [72208.594631] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 01:27:14 juju-e4d256-prod-github-runner-207 kernel: [72208.595644] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 01:27:14 juju-e4d256-prod-github-runner-207 kernel: [72208.596617] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 01:27:14 juju-e4d256-prod-github-runner-207 kernel: [72208.597563] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 01:27:14 juju-e4d256-prod-github-runner-207 kernel: [72208.598564] handle_exit+0x98/0x230 [kvm_amd] Aug 23 01:27:14 juju-e4d256-prod-github-runner-207 kernel: [72208.599461] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 01:27:14 juju-e4d256-prod-github-runner-207 kernel: [72208.600375] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 01:27:14 juju-e4d256-prod-github-runner-207 kernel: [72208.601304] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 01:27:14 juju-e4d256-prod-github-runner-207 kernel: [72208.602223] vcpu_run+0x62/0x2c0 [kvm] Aug 23 01:27:14 juju-e4d256-prod-github-runner-207 kernel: [72208.603034] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 01:27:14 juju-e4d256-prod-github-runner-207 kernel: [72208.603843] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 01:27:14 juju-e4d256-prod-github-runner-207 kernel: [72208.604701] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 01:27:14 juju-e4d256-prod-github-runner-207 kernel: [72208.605500] ? __seccomp_filter+0x4a/0x4a0 Aug 23 01:27:14 juju-e4d256-prod-github-runner-207 kernel: [72208.606265] ? __fget_files+0x86/0xc0 Aug 23 01:27:14 juju-e4d256-prod-github-runner-207 kernel: [72208.606971] __x64_sys_ioctl+0x95/0xd0 Aug 23 01:27:14 juju-e4d256-prod-github-runner-207 kernel: [72208.607664] do_syscall_64+0x5c/0xc0 Aug 23 01:27:14 juju-e4d256-prod-github-runner-207 kernel: [72208.608336] ? do_futex+0x162/0x1f0 Aug 23 01:27:14 juju-e4d256-prod-github-runner-207 kernel: [72208.608988] ? __x64_sys_futex+0x78/0x1e0 Aug 23 01:27:14 juju-e4d256-prod-github-runner-207 kernel: [72208.609669] ? __secure_computing+0xa9/0x120 Aug 23 01:27:14 juju-e4d256-prod-github-runner-207 kernel: [72208.610380] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 01:27:14 juju-e4d256-prod-github-runner-207 kernel: [72208.611140] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:27:14 juju-e4d256-prod-github-runner-207 kernel: [72208.611867] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:27:14 juju-e4d256-prod-github-runner-207 kernel: [72208.612585] ? do_syscall_64+0x69/0xc0 Aug 23 01:27:14 juju-e4d256-prod-github-runner-207 kernel: [72208.613231] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:27:14 juju-e4d256-prod-github-runner-207 kernel: [72208.613978] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:27:14 juju-e4d256-prod-github-runner-207 kernel: [72208.614699] ? do_syscall_64+0x69/0xc0 Aug 23 01:27:14 juju-e4d256-prod-github-runner-207 kernel: [72208.615325] ? do_syscall_64+0x69/0xc0 Aug 23 01:27:14 juju-e4d256-prod-github-runner-207 kernel: [72208.615953] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 01:27:14 juju-e4d256-prod-github-runner-207 kernel: [72208.616658] RIP: 0033:0x7faa5d0edaff Aug 23 01:27:14 juju-e4d256-prod-github-runner-207 kernel: [72208.617282] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 01:27:14 juju-e4d256-prod-github-runner-207 kernel: [72208.619315] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 01:27:14 juju-e4d256-prod-github-runner-207 kernel: [72208.620228] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 01:27:14 juju-e4d256-prod-github-runner-207 kernel: [72208.621117] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 01:27:14 juju-e4d256-prod-github-runner-207 kernel: [72208.622021] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 01:27:14 juju-e4d256-prod-github-runner-207 kernel: [72208.622922] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 01:27:14 juju-e4d256-prod-github-runner-207 kernel: [72208.623821] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 01:27:14 juju-e4d256-prod-github-runner-207 kernel: [72208.624720] Aug 23 01:27:42 juju-e4d256-prod-github-runner-207 kernel: [72236.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 67167s! [qemu-system-x86:6715] Aug 23 01:27:42 juju-e4d256-prod-github-runner-207 kernel: [72236.543107] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 01:27:42 juju-e4d256-prod-github-runner-207 kernel: [72236.543177] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 01:27:42 juju-e4d256-prod-github-runner-207 kernel: [72236.555246] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 01:27:42 juju-e4d256-prod-github-runner-207 kernel: [72236.556522] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 01:27:42 juju-e4d256-prod-github-runner-207 kernel: [72236.557796] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:27:42 juju-e4d256-prod-github-runner-207 kernel: [72236.558858] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 01:27:42 juju-e4d256-prod-github-runner-207 kernel: [72236.561490] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 01:27:42 juju-e4d256-prod-github-runner-207 kernel: [72236.562540] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 01:27:42 juju-e4d256-prod-github-runner-207 kernel: [72236.563705] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 01:27:42 juju-e4d256-prod-github-runner-207 kernel: [72236.564868] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 01:27:42 juju-e4d256-prod-github-runner-207 kernel: [72236.566172] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 01:27:42 juju-e4d256-prod-github-runner-207 kernel: [72236.567338] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 01:27:42 juju-e4d256-prod-github-runner-207 kernel: [72236.568502] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 01:27:42 juju-e4d256-prod-github-runner-207 kernel: [72236.569753] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 01:27:42 juju-e4d256-prod-github-runner-207 kernel: [72236.570851] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 01:27:42 juju-e4d256-prod-github-runner-207 kernel: [72236.572057] Call Trace: Aug 23 01:27:42 juju-e4d256-prod-github-runner-207 kernel: [72236.572970] Aug 23 01:27:42 juju-e4d256-prod-github-runner-207 kernel: [72236.573866] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:27:42 juju-e4d256-prod-github-runner-207 kernel: [72236.574898] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:27:42 juju-e4d256-prod-github-runner-207 kernel: [72236.575916] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:27:42 juju-e4d256-prod-github-runner-207 kernel: [72236.577048] ? show_regs.part.0+0x23/0x29 Aug 23 01:27:42 juju-e4d256-prod-github-runner-207 kernel: [72236.578086] ? show_regs.cold+0x8/0xd Aug 23 01:27:42 juju-e4d256-prod-github-runner-207 kernel: [72236.579059] ? watchdog_timer_fn+0x1be/0x220 Aug 23 01:27:42 juju-e4d256-prod-github-runner-207 kernel: [72236.580066] ? lockup_detector_update_enable+0x60/0x60 Aug 23 01:27:42 juju-e4d256-prod-github-runner-207 kernel: [72236.581135] ? __hrtimer_run_queues+0x107/0x230 Aug 23 01:27:42 juju-e4d256-prod-github-runner-207 kernel: [72236.582186] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 01:27:42 juju-e4d256-prod-github-runner-207 kernel: [72236.583213] ? hrtimer_interrupt+0x101/0x220 Aug 23 01:27:42 juju-e4d256-prod-github-runner-207 kernel: [72236.584227] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 01:27:42 juju-e4d256-prod-github-runner-207 kernel: [72236.585302] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 01:27:42 juju-e4d256-prod-github-runner-207 kernel: [72236.586365] Aug 23 01:27:42 juju-e4d256-prod-github-runner-207 kernel: [72236.587231] Aug 23 01:27:42 juju-e4d256-prod-github-runner-207 kernel: [72236.588069] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 01:27:42 juju-e4d256-prod-github-runner-207 kernel: [72236.589101] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:27:42 juju-e4d256-prod-github-runner-207 kernel: [72236.590163] ? _raw_spin_lock+0x22/0x30 Aug 23 01:27:42 juju-e4d256-prod-github-runner-207 kernel: [72236.591136] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:27:42 juju-e4d256-prod-github-runner-207 kernel: [72236.592169] direct_page_fault+0x206/0x310 [kvm] Aug 23 01:27:42 juju-e4d256-prod-github-runner-207 kernel: [72236.593195] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 01:27:42 juju-e4d256-prod-github-runner-207 kernel: [72236.594221] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 01:27:42 juju-e4d256-prod-github-runner-207 kernel: [72236.595221] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 01:27:42 juju-e4d256-prod-github-runner-207 kernel: [72236.596189] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 01:27:42 juju-e4d256-prod-github-runner-207 kernel: [72236.597134] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 01:27:42 juju-e4d256-prod-github-runner-207 kernel: [72236.598124] handle_exit+0x98/0x230 [kvm_amd] Aug 23 01:27:42 juju-e4d256-prod-github-runner-207 kernel: [72236.599016] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 01:27:42 juju-e4d256-prod-github-runner-207 kernel: [72236.599926] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 01:27:42 juju-e4d256-prod-github-runner-207 kernel: [72236.600848] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 01:27:42 juju-e4d256-prod-github-runner-207 kernel: [72236.601755] vcpu_run+0x62/0x2c0 [kvm] Aug 23 01:27:42 juju-e4d256-prod-github-runner-207 kernel: [72236.602572] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 01:27:42 juju-e4d256-prod-github-runner-207 kernel: [72236.603382] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 01:27:42 juju-e4d256-prod-github-runner-207 kernel: [72236.604241] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 01:27:42 juju-e4d256-prod-github-runner-207 kernel: [72236.605038] ? __seccomp_filter+0x4a/0x4a0 Aug 23 01:27:42 juju-e4d256-prod-github-runner-207 kernel: [72236.605870] ? __fget_files+0x86/0xc0 Aug 23 01:27:42 juju-e4d256-prod-github-runner-207 kernel: [72236.606575] __x64_sys_ioctl+0x95/0xd0 Aug 23 01:27:42 juju-e4d256-prod-github-runner-207 kernel: [72236.607267] do_syscall_64+0x5c/0xc0 Aug 23 01:27:42 juju-e4d256-prod-github-runner-207 kernel: [72236.607939] ? do_futex+0x162/0x1f0 Aug 23 01:27:42 juju-e4d256-prod-github-runner-207 kernel: [72236.608589] ? __x64_sys_futex+0x78/0x1e0 Aug 23 01:27:42 juju-e4d256-prod-github-runner-207 kernel: [72236.609263] ? __secure_computing+0xa9/0x120 Aug 23 01:27:42 juju-e4d256-prod-github-runner-207 kernel: [72236.609964] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 01:27:42 juju-e4d256-prod-github-runner-207 kernel: [72236.610725] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:27:42 juju-e4d256-prod-github-runner-207 kernel: [72236.611445] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:27:42 juju-e4d256-prod-github-runner-207 kernel: [72236.612161] ? do_syscall_64+0x69/0xc0 Aug 23 01:27:42 juju-e4d256-prod-github-runner-207 kernel: [72236.612812] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:27:42 juju-e4d256-prod-github-runner-207 kernel: [72236.613528] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:27:42 juju-e4d256-prod-github-runner-207 kernel: [72236.614223] ? do_syscall_64+0x69/0xc0 Aug 23 01:27:42 juju-e4d256-prod-github-runner-207 kernel: [72236.614847] ? do_syscall_64+0x69/0xc0 Aug 23 01:27:42 juju-e4d256-prod-github-runner-207 kernel: [72236.615469] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 01:27:42 juju-e4d256-prod-github-runner-207 kernel: [72236.616174] RIP: 0033:0x7faa5d0edaff Aug 23 01:27:42 juju-e4d256-prod-github-runner-207 kernel: [72236.616797] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 01:27:42 juju-e4d256-prod-github-runner-207 kernel: [72236.618804] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 01:27:42 juju-e4d256-prod-github-runner-207 kernel: [72236.619714] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 01:27:42 juju-e4d256-prod-github-runner-207 kernel: [72236.620602] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 01:27:42 juju-e4d256-prod-github-runner-207 kernel: [72236.621505] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 01:27:42 juju-e4d256-prod-github-runner-207 kernel: [72236.622404] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 01:27:42 juju-e4d256-prod-github-runner-207 kernel: [72236.623300] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 01:27:42 juju-e4d256-prod-github-runner-207 kernel: [72236.624194] Aug 23 01:28:10 juju-e4d256-prod-github-runner-207 kernel: [72264.541980] watchdog: BUG: soft lockup - CPU#1 stuck for 67193s! [qemu-system-x86:6715] Aug 23 01:28:10 juju-e4d256-prod-github-runner-207 kernel: [72264.543709] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 01:28:10 juju-e4d256-prod-github-runner-207 kernel: [72264.543950] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 01:28:10 juju-e4d256-prod-github-runner-207 kernel: [72264.556128] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 01:28:10 juju-e4d256-prod-github-runner-207 kernel: [72264.557398] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 01:28:10 juju-e4d256-prod-github-runner-207 kernel: [72264.558620] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:28:10 juju-e4d256-prod-github-runner-207 kernel: [72264.559674] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 01:28:10 juju-e4d256-prod-github-runner-207 kernel: [72264.562241] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 01:28:10 juju-e4d256-prod-github-runner-207 kernel: [72264.563285] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 01:28:10 juju-e4d256-prod-github-runner-207 kernel: [72264.564446] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 01:28:10 juju-e4d256-prod-github-runner-207 kernel: [72264.565611] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 01:28:10 juju-e4d256-prod-github-runner-207 kernel: [72264.566769] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 01:28:10 juju-e4d256-prod-github-runner-207 kernel: [72264.567932] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 01:28:10 juju-e4d256-prod-github-runner-207 kernel: [72264.569104] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 01:28:10 juju-e4d256-prod-github-runner-207 kernel: [72264.570334] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 01:28:10 juju-e4d256-prod-github-runner-207 kernel: [72264.571437] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 01:28:10 juju-e4d256-prod-github-runner-207 kernel: [72264.572626] Call Trace: Aug 23 01:28:10 juju-e4d256-prod-github-runner-207 kernel: [72264.573548] Aug 23 01:28:10 juju-e4d256-prod-github-runner-207 kernel: [72264.574437] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:28:10 juju-e4d256-prod-github-runner-207 kernel: [72264.575462] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:28:10 juju-e4d256-prod-github-runner-207 kernel: [72264.576589] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:28:10 juju-e4d256-prod-github-runner-207 kernel: [72264.577708] ? show_regs.part.0+0x23/0x29 Aug 23 01:28:10 juju-e4d256-prod-github-runner-207 kernel: [72264.578710] ? show_regs.cold+0x8/0xd Aug 23 01:28:10 juju-e4d256-prod-github-runner-207 kernel: [72264.579787] ? watchdog_timer_fn+0x1be/0x220 Aug 23 01:28:10 juju-e4d256-prod-github-runner-207 kernel: [72264.580792] ? lockup_detector_update_enable+0x60/0x60 Aug 23 01:28:10 juju-e4d256-prod-github-runner-207 kernel: [72264.581864] ? __hrtimer_run_queues+0x107/0x230 Aug 23 01:28:10 juju-e4d256-prod-github-runner-207 kernel: [72264.582888] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 01:28:10 juju-e4d256-prod-github-runner-207 kernel: [72264.583909] ? hrtimer_interrupt+0x101/0x220 Aug 23 01:28:10 juju-e4d256-prod-github-runner-207 kernel: [72264.584984] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 01:28:10 juju-e4d256-prod-github-runner-207 kernel: [72264.586215] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 01:28:10 juju-e4d256-prod-github-runner-207 kernel: [72264.587265] Aug 23 01:28:10 juju-e4d256-prod-github-runner-207 kernel: [72264.588117] Aug 23 01:28:10 juju-e4d256-prod-github-runner-207 kernel: [72264.588958] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 01:28:10 juju-e4d256-prod-github-runner-207 kernel: [72264.590005] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:28:10 juju-e4d256-prod-github-runner-207 kernel: [72264.591044] ? _raw_spin_lock+0x22/0x30 Aug 23 01:28:10 juju-e4d256-prod-github-runner-207 kernel: [72264.591995] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:28:10 juju-e4d256-prod-github-runner-207 kernel: [72264.593026] direct_page_fault+0x206/0x310 [kvm] Aug 23 01:28:10 juju-e4d256-prod-github-runner-207 kernel: [72264.594061] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 01:28:10 juju-e4d256-prod-github-runner-207 kernel: [72264.595073] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 01:28:10 juju-e4d256-prod-github-runner-207 kernel: [72264.596072] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 01:28:10 juju-e4d256-prod-github-runner-207 kernel: [72264.597071] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 01:28:10 juju-e4d256-prod-github-runner-207 kernel: [72264.598025] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 01:28:10 juju-e4d256-prod-github-runner-207 kernel: [72264.599000] handle_exit+0x98/0x230 [kvm_amd] Aug 23 01:28:10 juju-e4d256-prod-github-runner-207 kernel: [72264.599896] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 01:28:10 juju-e4d256-prod-github-runner-207 kernel: [72264.600813] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 01:28:10 juju-e4d256-prod-github-runner-207 kernel: [72264.601747] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 01:28:10 juju-e4d256-prod-github-runner-207 kernel: [72264.602650] vcpu_run+0x62/0x2c0 [kvm] Aug 23 01:28:10 juju-e4d256-prod-github-runner-207 kernel: [72264.603460] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 01:28:10 juju-e4d256-prod-github-runner-207 kernel: [72264.604268] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 01:28:10 juju-e4d256-prod-github-runner-207 kernel: [72264.605129] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 01:28:10 juju-e4d256-prod-github-runner-207 kernel: [72264.605994] ? __seccomp_filter+0x4a/0x4a0 Aug 23 01:28:10 juju-e4d256-prod-github-runner-207 kernel: [72264.606791] ? __fget_files+0x86/0xc0 Aug 23 01:28:10 juju-e4d256-prod-github-runner-207 kernel: [72264.607496] __x64_sys_ioctl+0x95/0xd0 Aug 23 01:28:10 juju-e4d256-prod-github-runner-207 kernel: [72264.608191] do_syscall_64+0x5c/0xc0 Aug 23 01:28:10 juju-e4d256-prod-github-runner-207 kernel: [72264.608855] ? do_futex+0x162/0x1f0 Aug 23 01:28:10 juju-e4d256-prod-github-runner-207 kernel: [72264.609520] ? __x64_sys_futex+0x78/0x1e0 Aug 23 01:28:10 juju-e4d256-prod-github-runner-207 kernel: [72264.610194] ? __secure_computing+0xa9/0x120 Aug 23 01:28:10 juju-e4d256-prod-github-runner-207 kernel: [72264.610883] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 01:28:10 juju-e4d256-prod-github-runner-207 kernel: [72264.611646] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:28:10 juju-e4d256-prod-github-runner-207 kernel: [72264.612366] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:28:10 juju-e4d256-prod-github-runner-207 kernel: [72264.613117] ? do_syscall_64+0x69/0xc0 Aug 23 01:28:10 juju-e4d256-prod-github-runner-207 kernel: [72264.613769] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:28:10 juju-e4d256-prod-github-runner-207 kernel: [72264.614473] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:28:10 juju-e4d256-prod-github-runner-207 kernel: [72264.615165] ? do_syscall_64+0x69/0xc0 Aug 23 01:28:10 juju-e4d256-prod-github-runner-207 kernel: [72264.615786] ? do_syscall_64+0x69/0xc0 Aug 23 01:28:10 juju-e4d256-prod-github-runner-207 kernel: [72264.616404] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 01:28:10 juju-e4d256-prod-github-runner-207 kernel: [72264.617117] RIP: 0033:0x7faa5d0edaff Aug 23 01:28:10 juju-e4d256-prod-github-runner-207 kernel: [72264.617765] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 01:28:10 juju-e4d256-prod-github-runner-207 kernel: [72264.619742] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 01:28:10 juju-e4d256-prod-github-runner-207 kernel: [72264.620655] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 01:28:10 juju-e4d256-prod-github-runner-207 kernel: [72264.621550] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 01:28:10 juju-e4d256-prod-github-runner-207 kernel: [72264.622438] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 01:28:10 juju-e4d256-prod-github-runner-207 kernel: [72264.623323] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 01:28:10 juju-e4d256-prod-github-runner-207 kernel: [72264.624213] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 01:28:10 juju-e4d256-prod-github-runner-207 kernel: [72264.625125] Aug 23 01:28:38 juju-e4d256-prod-github-runner-207 kernel: [72292.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 67219s! [qemu-system-x86:6715] Aug 23 01:28:38 juju-e4d256-prod-github-runner-207 kernel: [72292.543096] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 01:28:38 juju-e4d256-prod-github-runner-207 kernel: [72292.543163] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 01:28:38 juju-e4d256-prod-github-runner-207 kernel: [72292.555229] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 01:28:38 juju-e4d256-prod-github-runner-207 kernel: [72292.556493] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 01:28:38 juju-e4d256-prod-github-runner-207 kernel: [72292.557731] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:28:38 juju-e4d256-prod-github-runner-207 kernel: [72292.558788] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 01:28:38 juju-e4d256-prod-github-runner-207 kernel: [72292.561366] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 01:28:38 juju-e4d256-prod-github-runner-207 kernel: [72292.562532] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 01:28:38 juju-e4d256-prod-github-runner-207 kernel: [72292.563695] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 01:28:38 juju-e4d256-prod-github-runner-207 kernel: [72292.564870] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 01:28:38 juju-e4d256-prod-github-runner-207 kernel: [72292.566070] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 01:28:38 juju-e4d256-prod-github-runner-207 kernel: [72292.567231] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 01:28:38 juju-e4d256-prod-github-runner-207 kernel: [72292.568405] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 01:28:38 juju-e4d256-prod-github-runner-207 kernel: [72292.569658] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 01:28:38 juju-e4d256-prod-github-runner-207 kernel: [72292.570825] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 01:28:38 juju-e4d256-prod-github-runner-207 kernel: [72292.572023] Call Trace: Aug 23 01:28:38 juju-e4d256-prod-github-runner-207 kernel: [72292.572957] Aug 23 01:28:38 juju-e4d256-prod-github-runner-207 kernel: [72292.573852] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:28:38 juju-e4d256-prod-github-runner-207 kernel: [72292.574882] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:28:38 juju-e4d256-prod-github-runner-207 kernel: [72292.575907] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:28:38 juju-e4d256-prod-github-runner-207 kernel: [72292.576994] ? show_regs.part.0+0x23/0x29 Aug 23 01:28:38 juju-e4d256-prod-github-runner-207 kernel: [72292.577996] ? show_regs.cold+0x8/0xd Aug 23 01:28:38 juju-e4d256-prod-github-runner-207 kernel: [72292.578966] ? watchdog_timer_fn+0x1be/0x220 Aug 23 01:28:38 juju-e4d256-prod-github-runner-207 kernel: [72292.579971] ? lockup_detector_update_enable+0x60/0x60 Aug 23 01:28:38 juju-e4d256-prod-github-runner-207 kernel: [72292.581092] ? __hrtimer_run_queues+0x107/0x230 Aug 23 01:28:38 juju-e4d256-prod-github-runner-207 kernel: [72292.582128] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 01:28:38 juju-e4d256-prod-github-runner-207 kernel: [72292.583151] ? hrtimer_interrupt+0x101/0x220 Aug 23 01:28:38 juju-e4d256-prod-github-runner-207 kernel: [72292.584170] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 01:28:38 juju-e4d256-prod-github-runner-207 kernel: [72292.585259] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 01:28:38 juju-e4d256-prod-github-runner-207 kernel: [72292.586315] Aug 23 01:28:38 juju-e4d256-prod-github-runner-207 kernel: [72292.587166] Aug 23 01:28:38 juju-e4d256-prod-github-runner-207 kernel: [72292.588007] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 01:28:38 juju-e4d256-prod-github-runner-207 kernel: [72292.589049] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:28:38 juju-e4d256-prod-github-runner-207 kernel: [72292.590087] ? _raw_spin_lock+0x22/0x30 Aug 23 01:28:38 juju-e4d256-prod-github-runner-207 kernel: [72292.591030] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:28:38 juju-e4d256-prod-github-runner-207 kernel: [72292.592049] direct_page_fault+0x206/0x310 [kvm] Aug 23 01:28:38 juju-e4d256-prod-github-runner-207 kernel: [72292.593088] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 01:28:38 juju-e4d256-prod-github-runner-207 kernel: [72292.594096] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 01:28:38 juju-e4d256-prod-github-runner-207 kernel: [72292.595099] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 01:28:38 juju-e4d256-prod-github-runner-207 kernel: [72292.596091] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 01:28:38 juju-e4d256-prod-github-runner-207 kernel: [72292.597045] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 01:28:38 juju-e4d256-prod-github-runner-207 kernel: [72292.598027] handle_exit+0x98/0x230 [kvm_amd] Aug 23 01:28:38 juju-e4d256-prod-github-runner-207 kernel: [72292.598918] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 01:28:38 juju-e4d256-prod-github-runner-207 kernel: [72292.599828] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 01:28:38 juju-e4d256-prod-github-runner-207 kernel: [72292.600774] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 01:28:38 juju-e4d256-prod-github-runner-207 kernel: [72292.601682] vcpu_run+0x62/0x2c0 [kvm] Aug 23 01:28:38 juju-e4d256-prod-github-runner-207 kernel: [72292.602500] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 01:28:38 juju-e4d256-prod-github-runner-207 kernel: [72292.603316] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 01:28:38 juju-e4d256-prod-github-runner-207 kernel: [72292.604168] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 01:28:38 juju-e4d256-prod-github-runner-207 kernel: [72292.604986] ? __seccomp_filter+0x4a/0x4a0 Aug 23 01:28:38 juju-e4d256-prod-github-runner-207 kernel: [72292.605733] ? __fget_files+0x86/0xc0 Aug 23 01:28:38 juju-e4d256-prod-github-runner-207 kernel: [72292.606434] __x64_sys_ioctl+0x95/0xd0 Aug 23 01:28:38 juju-e4d256-prod-github-runner-207 kernel: [72292.607124] do_syscall_64+0x5c/0xc0 Aug 23 01:28:38 juju-e4d256-prod-github-runner-207 kernel: [72292.607806] ? do_futex+0x162/0x1f0 Aug 23 01:28:38 juju-e4d256-prod-github-runner-207 kernel: [72292.608468] ? __x64_sys_futex+0x78/0x1e0 Aug 23 01:28:38 juju-e4d256-prod-github-runner-207 kernel: [72292.609147] ? __secure_computing+0xa9/0x120 Aug 23 01:28:38 juju-e4d256-prod-github-runner-207 kernel: [72292.609833] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 01:28:38 juju-e4d256-prod-github-runner-207 kernel: [72292.610938] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:28:38 juju-e4d256-prod-github-runner-207 kernel: [72292.611946] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:28:38 juju-e4d256-prod-github-runner-207 kernel: [72292.612671] ? do_syscall_64+0x69/0xc0 Aug 23 01:28:38 juju-e4d256-prod-github-runner-207 kernel: [72292.613337] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:28:38 juju-e4d256-prod-github-runner-207 kernel: [72292.614038] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:28:38 juju-e4d256-prod-github-runner-207 kernel: [72292.614729] ? do_syscall_64+0x69/0xc0 Aug 23 01:28:38 juju-e4d256-prod-github-runner-207 kernel: [72292.615350] ? do_syscall_64+0x69/0xc0 Aug 23 01:28:38 juju-e4d256-prod-github-runner-207 kernel: [72292.615976] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 01:28:38 juju-e4d256-prod-github-runner-207 kernel: [72292.616701] RIP: 0033:0x7faa5d0edaff Aug 23 01:28:38 juju-e4d256-prod-github-runner-207 kernel: [72292.617378] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 01:28:38 juju-e4d256-prod-github-runner-207 kernel: [72292.619392] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 01:28:38 juju-e4d256-prod-github-runner-207 kernel: [72292.620309] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 01:28:38 juju-e4d256-prod-github-runner-207 kernel: [72292.621223] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 01:28:38 juju-e4d256-prod-github-runner-207 kernel: [72292.622110] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 01:28:38 juju-e4d256-prod-github-runner-207 kernel: [72292.623001] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 01:28:38 juju-e4d256-prod-github-runner-207 kernel: [72292.623895] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 01:28:38 juju-e4d256-prod-github-runner-207 kernel: [72292.624800] Aug 23 01:29:06 juju-e4d256-prod-github-runner-207 kernel: [72320.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 67245s! [qemu-system-x86:6715] Aug 23 01:29:06 juju-e4d256-prod-github-runner-207 kernel: [72320.543094] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 01:29:06 juju-e4d256-prod-github-runner-207 kernel: [72320.543162] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 01:29:06 juju-e4d256-prod-github-runner-207 kernel: [72320.555182] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 01:29:06 juju-e4d256-prod-github-runner-207 kernel: [72320.556458] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 01:29:06 juju-e4d256-prod-github-runner-207 kernel: [72320.557676] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:29:06 juju-e4d256-prod-github-runner-207 kernel: [72320.558732] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 01:29:06 juju-e4d256-prod-github-runner-207 kernel: [72320.561289] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 01:29:06 juju-e4d256-prod-github-runner-207 kernel: [72320.562331] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 01:29:06 juju-e4d256-prod-github-runner-207 kernel: [72320.563498] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 01:29:06 juju-e4d256-prod-github-runner-207 kernel: [72320.564672] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 01:29:06 juju-e4d256-prod-github-runner-207 kernel: [72320.565833] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 01:29:06 juju-e4d256-prod-github-runner-207 kernel: [72320.566997] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 01:29:06 juju-e4d256-prod-github-runner-207 kernel: [72320.568160] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 01:29:06 juju-e4d256-prod-github-runner-207 kernel: [72320.569406] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 01:29:06 juju-e4d256-prod-github-runner-207 kernel: [72320.570506] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 01:29:06 juju-e4d256-prod-github-runner-207 kernel: [72320.571697] Call Trace: Aug 23 01:29:06 juju-e4d256-prod-github-runner-207 kernel: [72320.572618] Aug 23 01:29:06 juju-e4d256-prod-github-runner-207 kernel: [72320.573507] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:29:06 juju-e4d256-prod-github-runner-207 kernel: [72320.574538] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:29:06 juju-e4d256-prod-github-runner-207 kernel: [72320.575558] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:29:06 juju-e4d256-prod-github-runner-207 kernel: [72320.576651] ? show_regs.part.0+0x23/0x29 Aug 23 01:29:06 juju-e4d256-prod-github-runner-207 kernel: [72320.577649] ? show_regs.cold+0x8/0xd Aug 23 01:29:06 juju-e4d256-prod-github-runner-207 kernel: [72320.578619] ? watchdog_timer_fn+0x1be/0x220 Aug 23 01:29:06 juju-e4d256-prod-github-runner-207 kernel: [72320.579627] ? lockup_detector_update_enable+0x60/0x60 Aug 23 01:29:06 juju-e4d256-prod-github-runner-207 kernel: [72320.580701] ? __hrtimer_run_queues+0x107/0x230 Aug 23 01:29:06 juju-e4d256-prod-github-runner-207 kernel: [72320.581729] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 01:29:06 juju-e4d256-prod-github-runner-207 kernel: [72320.582753] ? hrtimer_interrupt+0x101/0x220 Aug 23 01:29:06 juju-e4d256-prod-github-runner-207 kernel: [72320.583768] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 01:29:06 juju-e4d256-prod-github-runner-207 kernel: [72320.584848] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 01:29:06 juju-e4d256-prod-github-runner-207 kernel: [72320.585900] Aug 23 01:29:06 juju-e4d256-prod-github-runner-207 kernel: [72320.586753] Aug 23 01:29:06 juju-e4d256-prod-github-runner-207 kernel: [72320.587590] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 01:29:06 juju-e4d256-prod-github-runner-207 kernel: [72320.588635] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:29:06 juju-e4d256-prod-github-runner-207 kernel: [72320.589674] ? _raw_spin_lock+0x22/0x30 Aug 23 01:29:06 juju-e4d256-prod-github-runner-207 kernel: [72320.590619] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:29:06 juju-e4d256-prod-github-runner-207 kernel: [72320.591640] direct_page_fault+0x206/0x310 [kvm] Aug 23 01:29:06 juju-e4d256-prod-github-runner-207 kernel: [72320.592675] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 01:29:06 juju-e4d256-prod-github-runner-207 kernel: [72320.593684] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 01:29:06 juju-e4d256-prod-github-runner-207 kernel: [72320.594682] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 01:29:06 juju-e4d256-prod-github-runner-207 kernel: [72320.595662] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 01:29:06 juju-e4d256-prod-github-runner-207 kernel: [72320.596619] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 01:29:06 juju-e4d256-prod-github-runner-207 kernel: [72320.597596] handle_exit+0x98/0x230 [kvm_amd] Aug 23 01:29:06 juju-e4d256-prod-github-runner-207 kernel: [72320.598487] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 01:29:06 juju-e4d256-prod-github-runner-207 kernel: [72320.599403] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 01:29:06 juju-e4d256-prod-github-runner-207 kernel: [72320.600325] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 01:29:06 juju-e4d256-prod-github-runner-207 kernel: [72320.601237] vcpu_run+0x62/0x2c0 [kvm] Aug 23 01:29:06 juju-e4d256-prod-github-runner-207 kernel: [72320.602052] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 01:29:06 juju-e4d256-prod-github-runner-207 kernel: [72320.602858] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 01:29:06 juju-e4d256-prod-github-runner-207 kernel: [72320.603711] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 01:29:06 juju-e4d256-prod-github-runner-207 kernel: [72320.604525] ? __seccomp_filter+0x4a/0x4a0 Aug 23 01:29:06 juju-e4d256-prod-github-runner-207 kernel: [72320.605267] ? __fget_files+0x86/0xc0 Aug 23 01:29:06 juju-e4d256-prod-github-runner-207 kernel: [72320.605969] __x64_sys_ioctl+0x95/0xd0 Aug 23 01:29:06 juju-e4d256-prod-github-runner-207 kernel: [72320.606660] do_syscall_64+0x5c/0xc0 Aug 23 01:29:06 juju-e4d256-prod-github-runner-207 kernel: [72320.607438] ? do_futex+0x162/0x1f0 Aug 23 01:29:06 juju-e4d256-prod-github-runner-207 kernel: [72320.608091] ? __x64_sys_futex+0x78/0x1e0 Aug 23 01:29:06 juju-e4d256-prod-github-runner-207 kernel: [72320.608911] ? __secure_computing+0xa9/0x120 Aug 23 01:29:06 juju-e4d256-prod-github-runner-207 kernel: [72320.609599] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 01:29:06 juju-e4d256-prod-github-runner-207 kernel: [72320.610356] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:29:06 juju-e4d256-prod-github-runner-207 kernel: [72320.611260] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:29:06 juju-e4d256-prod-github-runner-207 kernel: [72320.612115] ? do_syscall_64+0x69/0xc0 Aug 23 01:29:06 juju-e4d256-prod-github-runner-207 kernel: [72320.612860] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:29:06 juju-e4d256-prod-github-runner-207 kernel: [72320.613652] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:29:06 juju-e4d256-prod-github-runner-207 kernel: [72320.614450] ? do_syscall_64+0x69/0xc0 Aug 23 01:29:06 juju-e4d256-prod-github-runner-207 kernel: [72320.615154] ? do_syscall_64+0x69/0xc0 Aug 23 01:29:06 juju-e4d256-prod-github-runner-207 kernel: [72320.615884] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 01:29:06 juju-e4d256-prod-github-runner-207 kernel: [72320.616698] RIP: 0033:0x7faa5d0edaff Aug 23 01:29:06 juju-e4d256-prod-github-runner-207 kernel: [72320.617391] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 01:29:06 juju-e4d256-prod-github-runner-207 kernel: [72320.619712] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 01:29:06 juju-e4d256-prod-github-runner-207 kernel: [72320.620815] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 01:29:06 juju-e4d256-prod-github-runner-207 kernel: [72320.621709] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 01:29:06 juju-e4d256-prod-github-runner-207 kernel: [72320.622597] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 01:29:06 juju-e4d256-prod-github-runner-207 kernel: [72320.623484] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 01:29:06 juju-e4d256-prod-github-runner-207 kernel: [72320.624527] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 01:29:06 juju-e4d256-prod-github-runner-207 kernel: [72320.625554] Aug 23 01:29:34 juju-e4d256-prod-github-runner-207 kernel: [72348.541980] watchdog: BUG: soft lockup - CPU#1 stuck for 67271s! [qemu-system-x86:6715] Aug 23 01:29:34 juju-e4d256-prod-github-runner-207 kernel: [72348.543210] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 01:29:34 juju-e4d256-prod-github-runner-207 kernel: [72348.543423] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 01:29:34 juju-e4d256-prod-github-runner-207 kernel: [72348.557394] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 01:29:34 juju-e4d256-prod-github-runner-207 kernel: [72348.558844] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 01:29:34 juju-e4d256-prod-github-runner-207 kernel: [72348.560267] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:29:34 juju-e4d256-prod-github-runner-207 kernel: [72348.561440] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 01:29:34 juju-e4d256-prod-github-runner-207 kernel: [72348.564339] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 01:29:34 juju-e4d256-prod-github-runner-207 kernel: [72348.565489] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 01:29:34 juju-e4d256-prod-github-runner-207 kernel: [72348.566781] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 01:29:34 juju-e4d256-prod-github-runner-207 kernel: [72348.568087] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 01:29:34 juju-e4d256-prod-github-runner-207 kernel: [72348.569378] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 01:29:34 juju-e4d256-prod-github-runner-207 kernel: [72348.570678] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 01:29:34 juju-e4d256-prod-github-runner-207 kernel: [72348.571975] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 01:29:34 juju-e4d256-prod-github-runner-207 kernel: [72348.573366] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 01:29:34 juju-e4d256-prod-github-runner-207 kernel: [72348.574568] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 01:29:34 juju-e4d256-prod-github-runner-207 kernel: [72348.575892] Call Trace: Aug 23 01:29:34 juju-e4d256-prod-github-runner-207 kernel: [72348.576870] Aug 23 01:29:34 juju-e4d256-prod-github-runner-207 kernel: [72348.577838] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:29:34 juju-e4d256-prod-github-runner-207 kernel: [72348.578954] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:29:34 juju-e4d256-prod-github-runner-207 kernel: [72348.579987] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:29:34 juju-e4d256-prod-github-runner-207 kernel: [72348.583047] ? show_regs.part.0+0x23/0x29 Aug 23 01:29:34 juju-e4d256-prod-github-runner-207 kernel: [72348.584069] ? show_regs.cold+0x8/0xd Aug 23 01:29:34 juju-e4d256-prod-github-runner-207 kernel: [72348.585046] ? watchdog_timer_fn+0x1be/0x220 Aug 23 01:29:34 juju-e4d256-prod-github-runner-207 kernel: [72348.586054] ? lockup_detector_update_enable+0x60/0x60 Aug 23 01:29:34 juju-e4d256-prod-github-runner-207 kernel: [72348.587121] ? __hrtimer_run_queues+0x107/0x230 Aug 23 01:29:34 juju-e4d256-prod-github-runner-207 kernel: [72348.588173] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 01:29:34 juju-e4d256-prod-github-runner-207 kernel: [72348.589221] ? hrtimer_interrupt+0x101/0x220 Aug 23 01:29:34 juju-e4d256-prod-github-runner-207 kernel: [72348.590335] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 01:29:34 juju-e4d256-prod-github-runner-207 kernel: [72348.591499] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 01:29:34 juju-e4d256-prod-github-runner-207 kernel: [72348.592659] Aug 23 01:29:34 juju-e4d256-prod-github-runner-207 kernel: [72348.593554] Aug 23 01:29:34 juju-e4d256-prod-github-runner-207 kernel: [72348.594441] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 01:29:34 juju-e4d256-prod-github-runner-207 kernel: [72348.595570] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:29:34 juju-e4d256-prod-github-runner-207 kernel: [72348.596732] ? _raw_spin_lock+0x22/0x30 Aug 23 01:29:34 juju-e4d256-prod-github-runner-207 kernel: [72348.597755] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:29:34 juju-e4d256-prod-github-runner-207 kernel: [72348.598857] direct_page_fault+0x206/0x310 [kvm] Aug 23 01:29:34 juju-e4d256-prod-github-runner-207 kernel: [72348.599965] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 01:29:34 juju-e4d256-prod-github-runner-207 kernel: [72348.601082] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 01:29:34 juju-e4d256-prod-github-runner-207 kernel: [72348.602172] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 01:29:34 juju-e4d256-prod-github-runner-207 kernel: [72348.603266] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 01:29:34 juju-e4d256-prod-github-runner-207 kernel: [72348.604347] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 01:29:34 juju-e4d256-prod-github-runner-207 kernel: [72348.605455] handle_exit+0x98/0x230 [kvm_amd] Aug 23 01:29:34 juju-e4d256-prod-github-runner-207 kernel: [72348.606438] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 01:29:34 juju-e4d256-prod-github-runner-207 kernel: [72348.607439] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 01:29:34 juju-e4d256-prod-github-runner-207 kernel: [72348.608472] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 01:29:34 juju-e4d256-prod-github-runner-207 kernel: [72348.609473] vcpu_run+0x62/0x2c0 [kvm] Aug 23 01:29:34 juju-e4d256-prod-github-runner-207 kernel: [72348.610352] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 01:29:34 juju-e4d256-prod-github-runner-207 kernel: [72348.611245] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 01:29:34 juju-e4d256-prod-github-runner-207 kernel: [72348.612216] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 01:29:34 juju-e4d256-prod-github-runner-207 kernel: [72348.613096] ? __seccomp_filter+0x4a/0x4a0 Aug 23 01:29:34 juju-e4d256-prod-github-runner-207 kernel: [72348.613914] ? __fget_files+0x86/0xc0 Aug 23 01:29:34 juju-e4d256-prod-github-runner-207 kernel: [72348.614687] __x64_sys_ioctl+0x95/0xd0 Aug 23 01:29:34 juju-e4d256-prod-github-runner-207 kernel: [72348.615448] do_syscall_64+0x5c/0xc0 Aug 23 01:29:34 juju-e4d256-prod-github-runner-207 kernel: [72348.616206] ? do_futex+0x162/0x1f0 Aug 23 01:29:34 juju-e4d256-prod-github-runner-207 kernel: [72348.616923] ? __x64_sys_futex+0x78/0x1e0 Aug 23 01:29:34 juju-e4d256-prod-github-runner-207 kernel: [72348.617672] ? __secure_computing+0xa9/0x120 Aug 23 01:29:34 juju-e4d256-prod-github-runner-207 kernel: [72348.618440] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 01:29:34 juju-e4d256-prod-github-runner-207 kernel: [72348.619304] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:29:34 juju-e4d256-prod-github-runner-207 kernel: [72348.620149] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:29:34 juju-e4d256-prod-github-runner-207 kernel: [72348.620963] ? do_syscall_64+0x69/0xc0 Aug 23 01:29:34 juju-e4d256-prod-github-runner-207 kernel: [72348.621683] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:29:34 juju-e4d256-prod-github-runner-207 kernel: [72348.622481] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:29:34 juju-e4d256-prod-github-runner-207 kernel: [72348.623272] ? do_syscall_64+0x69/0xc0 Aug 23 01:29:34 juju-e4d256-prod-github-runner-207 kernel: [72348.623967] ? do_syscall_64+0x69/0xc0 Aug 23 01:29:34 juju-e4d256-prod-github-runner-207 kernel: [72348.624683] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 01:29:34 juju-e4d256-prod-github-runner-207 kernel: [72348.625577] RIP: 0033:0x7faa5d0edaff Aug 23 01:29:34 juju-e4d256-prod-github-runner-207 kernel: [72348.626290] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 01:29:34 juju-e4d256-prod-github-runner-207 kernel: [72348.628629] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 01:29:34 juju-e4d256-prod-github-runner-207 kernel: [72348.629675] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 01:29:34 juju-e4d256-prod-github-runner-207 kernel: [72348.630697] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 01:29:34 juju-e4d256-prod-github-runner-207 kernel: [72348.631714] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 01:29:34 juju-e4d256-prod-github-runner-207 kernel: [72348.632764] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 01:29:34 juju-e4d256-prod-github-runner-207 kernel: [72348.633784] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 01:29:34 juju-e4d256-prod-github-runner-207 kernel: [72348.634808] Aug 23 01:29:48 juju-e4d256-prod-github-runner-207 kernel: [72362.012705] rcu: INFO: rcu_sched self-detected stall on CPU Aug 23 01:29:48 juju-e4d256-prod-github-runner-207 kernel: [72362.013662] rcu: 1-....: (18004352 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=8697344 Aug 23 01:29:48 juju-e4d256-prod-github-runner-207 kernel: [72362.014784] (t=18061203 jiffies g=23269 q=61890) Aug 23 01:29:48 juju-e4d256-prod-github-runner-207 kernel: [72362.015575] NMI backtrace for cpu 1 Aug 23 01:29:48 juju-e4d256-prod-github-runner-207 kernel: [72362.016297] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 01:29:48 juju-e4d256-prod-github-runner-207 kernel: [72362.017400] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 01:29:48 juju-e4d256-prod-github-runner-207 kernel: [72362.018463] Call Trace: Aug 23 01:29:48 juju-e4d256-prod-github-runner-207 kernel: [72362.019139] Aug 23 01:29:48 juju-e4d256-prod-github-runner-207 kernel: [72362.019783] show_stack+0x52/0x5c Aug 23 01:29:48 juju-e4d256-prod-github-runner-207 kernel: [72362.020514] dump_stack_lvl+0x4a/0x63 Aug 23 01:29:48 juju-e4d256-prod-github-runner-207 kernel: [72362.021258] dump_stack+0x10/0x16 Aug 23 01:29:48 juju-e4d256-prod-github-runner-207 kernel: [72362.021972] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 23 01:29:48 juju-e4d256-prod-github-runner-207 kernel: [72362.022749] ? lapic_can_unplug_cpu+0x90/0x90 Aug 23 01:29:48 juju-e4d256-prod-github-runner-207 kernel: [72362.023525] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 23 01:29:48 juju-e4d256-prod-github-runner-207 kernel: [72362.024351] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 23 01:29:48 juju-e4d256-prod-github-runner-207 kernel: [72362.025175] trigger_single_cpu_backtrace+0x44/0x4f Aug 23 01:29:48 juju-e4d256-prod-github-runner-207 kernel: [72362.025980] rcu_dump_cpu_stacks+0x102/0x149 Aug 23 01:29:48 juju-e4d256-prod-github-runner-207 kernel: [72362.026750] print_cpu_stall.cold+0x2f/0xe2 Aug 23 01:29:48 juju-e4d256-prod-github-runner-207 kernel: [72362.027513] ? timekeeping_update+0xf7/0x150 Aug 23 01:29:48 juju-e4d256-prod-github-runner-207 kernel: [72362.028293] check_cpu_stall+0x109/0x270 Aug 23 01:29:48 juju-e4d256-prod-github-runner-207 kernel: [72362.029040] rcu_sched_clock_irq+0x9a/0x250 Aug 23 01:29:48 juju-e4d256-prod-github-runner-207 kernel: [72362.029801] update_process_times+0x94/0xd0 Aug 23 01:29:48 juju-e4d256-prod-github-runner-207 kernel: [72362.030565] tick_sched_handle+0x29/0x70 Aug 23 01:29:48 juju-e4d256-prod-github-runner-207 kernel: [72362.031314] tick_sched_timer+0x8c/0xc0 Aug 23 01:29:48 juju-e4d256-prod-github-runner-207 kernel: [72362.032058] ? tick_nohz_handler+0xb0/0xb0 Aug 23 01:29:48 juju-e4d256-prod-github-runner-207 kernel: [72362.032812] __hrtimer_run_queues+0x107/0x230 Aug 23 01:29:48 juju-e4d256-prod-github-runner-207 kernel: [72362.033584] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 01:29:48 juju-e4d256-prod-github-runner-207 kernel: [72362.034359] hrtimer_interrupt+0x101/0x220 Aug 23 01:29:48 juju-e4d256-prod-github-runner-207 kernel: [72362.035122] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 01:29:48 juju-e4d256-prod-github-runner-207 kernel: [72362.035941] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 01:29:48 juju-e4d256-prod-github-runner-207 kernel: [72362.036742] Aug 23 01:29:48 juju-e4d256-prod-github-runner-207 kernel: [72362.037375] Aug 23 01:29:48 juju-e4d256-prod-github-runner-207 kernel: [72362.038001] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 01:29:48 juju-e4d256-prod-github-runner-207 kernel: [72362.038818] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:29:48 juju-e4d256-prod-github-runner-207 kernel: [72362.039697] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 01:29:48 juju-e4d256-prod-github-runner-207 kernel: [72362.041906] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 01:29:48 juju-e4d256-prod-github-runner-207 kernel: [72362.042777] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 01:29:48 juju-e4d256-prod-github-runner-207 kernel: [72362.043766] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 01:29:48 juju-e4d256-prod-github-runner-207 kernel: [72362.044747] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 01:29:48 juju-e4d256-prod-github-runner-207 kernel: [72362.045707] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 01:29:48 juju-e4d256-prod-github-runner-207 kernel: [72362.046659] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 01:29:48 juju-e4d256-prod-github-runner-207 kernel: [72362.047608] ? _raw_spin_lock+0x22/0x30 Aug 23 01:29:48 juju-e4d256-prod-github-runner-207 kernel: [72362.048374] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:29:48 juju-e4d256-prod-github-runner-207 kernel: [72362.049209] direct_page_fault+0x206/0x310 [kvm] Aug 23 01:29:48 juju-e4d256-prod-github-runner-207 kernel: [72362.050047] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 01:29:48 juju-e4d256-prod-github-runner-207 kernel: [72362.050873] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 01:29:48 juju-e4d256-prod-github-runner-207 kernel: [72362.051694] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 01:29:48 juju-e4d256-prod-github-runner-207 kernel: [72362.052504] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 01:29:48 juju-e4d256-prod-github-runner-207 kernel: [72362.053289] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 01:29:48 juju-e4d256-prod-github-runner-207 kernel: [72362.054109] handle_exit+0x98/0x230 [kvm_amd] Aug 23 01:29:48 juju-e4d256-prod-github-runner-207 kernel: [72362.054861] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 01:29:48 juju-e4d256-prod-github-runner-207 kernel: [72362.055642] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 01:29:48 juju-e4d256-prod-github-runner-207 kernel: [72362.056446] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 01:29:48 juju-e4d256-prod-github-runner-207 kernel: [72362.057231] vcpu_run+0x62/0x2c0 [kvm] Aug 23 01:29:48 juju-e4d256-prod-github-runner-207 kernel: [72362.057943] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 01:29:48 juju-e4d256-prod-github-runner-207 kernel: [72362.058673] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 01:29:48 juju-e4d256-prod-github-runner-207 kernel: [72362.059473] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 01:29:48 juju-e4d256-prod-github-runner-207 kernel: [72362.060243] ? __seccomp_filter+0x4a/0x4a0 Aug 23 01:29:48 juju-e4d256-prod-github-runner-207 kernel: [72362.060967] ? __fget_files+0x86/0xc0 Aug 23 01:29:48 juju-e4d256-prod-github-runner-207 kernel: [72362.061658] __x64_sys_ioctl+0x95/0xd0 Aug 23 01:29:48 juju-e4d256-prod-github-runner-207 kernel: [72362.062354] do_syscall_64+0x5c/0xc0 Aug 23 01:29:48 juju-e4d256-prod-github-runner-207 kernel: [72362.063032] ? do_futex+0x162/0x1f0 Aug 23 01:29:48 juju-e4d256-prod-github-runner-207 kernel: [72362.063701] ? __x64_sys_futex+0x78/0x1e0 Aug 23 01:29:48 juju-e4d256-prod-github-runner-207 kernel: [72362.064407] ? __secure_computing+0xa9/0x120 Aug 23 01:29:48 juju-e4d256-prod-github-runner-207 kernel: [72362.065122] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 01:29:48 juju-e4d256-prod-github-runner-207 kernel: [72362.065910] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:29:48 juju-e4d256-prod-github-runner-207 kernel: [72362.066664] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:29:48 juju-e4d256-prod-github-runner-207 kernel: [72362.067414] ? do_syscall_64+0x69/0xc0 Aug 23 01:29:48 juju-e4d256-prod-github-runner-207 kernel: [72362.068111] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:29:48 juju-e4d256-prod-github-runner-207 kernel: [72362.068865] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:29:48 juju-e4d256-prod-github-runner-207 kernel: [72362.069620] ? do_syscall_64+0x69/0xc0 Aug 23 01:29:48 juju-e4d256-prod-github-runner-207 kernel: [72362.070316] ? do_syscall_64+0x69/0xc0 Aug 23 01:29:48 juju-e4d256-prod-github-runner-207 kernel: [72362.071001] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 01:29:48 juju-e4d256-prod-github-runner-207 kernel: [72362.071768] RIP: 0033:0x7faa5d0edaff Aug 23 01:29:48 juju-e4d256-prod-github-runner-207 kernel: [72362.072482] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 01:29:48 juju-e4d256-prod-github-runner-207 kernel: [72362.074576] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 01:29:48 juju-e4d256-prod-github-runner-207 kernel: [72362.075536] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 01:29:48 juju-e4d256-prod-github-runner-207 kernel: [72362.076498] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 01:29:48 juju-e4d256-prod-github-runner-207 kernel: [72362.077440] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 01:29:48 juju-e4d256-prod-github-runner-207 kernel: [72362.078382] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 01:29:48 juju-e4d256-prod-github-runner-207 kernel: [72362.079305] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 01:29:48 juju-e4d256-prod-github-runner-207 kernel: [72362.080223] Aug 23 01:30:14 juju-e4d256-prod-github-runner-207 kernel: [72388.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 67309s! [qemu-system-x86:6715] Aug 23 01:30:14 juju-e4d256-prod-github-runner-207 kernel: [72388.543108] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 01:30:14 juju-e4d256-prod-github-runner-207 kernel: [72388.543309] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 01:30:14 juju-e4d256-prod-github-runner-207 kernel: [72388.555367] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 01:30:14 juju-e4d256-prod-github-runner-207 kernel: [72388.556647] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 01:30:14 juju-e4d256-prod-github-runner-207 kernel: [72388.557867] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:30:14 juju-e4d256-prod-github-runner-207 kernel: [72388.558921] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 01:30:14 juju-e4d256-prod-github-runner-207 kernel: [72388.561474] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 01:30:14 juju-e4d256-prod-github-runner-207 kernel: [72388.562520] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 01:30:14 juju-e4d256-prod-github-runner-207 kernel: [72388.563690] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 01:30:14 juju-e4d256-prod-github-runner-207 kernel: [72388.564849] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 01:30:14 juju-e4d256-prod-github-runner-207 kernel: [72388.566011] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 01:30:14 juju-e4d256-prod-github-runner-207 kernel: [72388.567171] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 01:30:14 juju-e4d256-prod-github-runner-207 kernel: [72388.568356] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 01:30:14 juju-e4d256-prod-github-runner-207 kernel: [72388.569589] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 01:30:14 juju-e4d256-prod-github-runner-207 kernel: [72388.570684] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 01:30:14 juju-e4d256-prod-github-runner-207 kernel: [72388.571884] Call Trace: Aug 23 01:30:14 juju-e4d256-prod-github-runner-207 kernel: [72388.572794] Aug 23 01:30:14 juju-e4d256-prod-github-runner-207 kernel: [72388.573684] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:30:14 juju-e4d256-prod-github-runner-207 kernel: [72388.574713] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:30:14 juju-e4d256-prod-github-runner-207 kernel: [72388.575741] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:30:14 juju-e4d256-prod-github-runner-207 kernel: [72388.576815] ? show_regs.part.0+0x23/0x29 Aug 23 01:30:14 juju-e4d256-prod-github-runner-207 kernel: [72388.577811] ? show_regs.cold+0x8/0xd Aug 23 01:30:14 juju-e4d256-prod-github-runner-207 kernel: [72388.578782] ? watchdog_timer_fn+0x1be/0x220 Aug 23 01:30:14 juju-e4d256-prod-github-runner-207 kernel: [72388.579797] ? lockup_detector_update_enable+0x60/0x60 Aug 23 01:30:14 juju-e4d256-prod-github-runner-207 kernel: [72388.580860] ? __hrtimer_run_queues+0x107/0x230 Aug 23 01:30:14 juju-e4d256-prod-github-runner-207 kernel: [72388.581893] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 01:30:14 juju-e4d256-prod-github-runner-207 kernel: [72388.582915] ? hrtimer_interrupt+0x101/0x220 Aug 23 01:30:14 juju-e4d256-prod-github-runner-207 kernel: [72388.583936] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 01:30:14 juju-e4d256-prod-github-runner-207 kernel: [72388.585004] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 01:30:14 juju-e4d256-prod-github-runner-207 kernel: [72388.586048] Aug 23 01:30:14 juju-e4d256-prod-github-runner-207 kernel: [72388.586899] Aug 23 01:30:14 juju-e4d256-prod-github-runner-207 kernel: [72388.587750] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 01:30:14 juju-e4d256-prod-github-runner-207 kernel: [72388.588782] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:30:14 juju-e4d256-prod-github-runner-207 kernel: [72388.589820] ? _raw_spin_lock+0x22/0x30 Aug 23 01:30:14 juju-e4d256-prod-github-runner-207 kernel: [72388.590762] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:30:14 juju-e4d256-prod-github-runner-207 kernel: [72388.591786] direct_page_fault+0x206/0x310 [kvm] Aug 23 01:30:14 juju-e4d256-prod-github-runner-207 kernel: [72388.592811] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 01:30:14 juju-e4d256-prod-github-runner-207 kernel: [72388.593817] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 01:30:14 juju-e4d256-prod-github-runner-207 kernel: [72388.594817] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 01:30:14 juju-e4d256-prod-github-runner-207 kernel: [72388.595887] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 01:30:14 juju-e4d256-prod-github-runner-207 kernel: [72388.596834] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 01:30:14 juju-e4d256-prod-github-runner-207 kernel: [72388.597819] handle_exit+0x98/0x230 [kvm_amd] Aug 23 01:30:14 juju-e4d256-prod-github-runner-207 kernel: [72388.598711] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 01:30:14 juju-e4d256-prod-github-runner-207 kernel: [72388.599631] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 01:30:14 juju-e4d256-prod-github-runner-207 kernel: [72388.600557] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 01:30:14 juju-e4d256-prod-github-runner-207 kernel: [72388.601458] vcpu_run+0x62/0x2c0 [kvm] Aug 23 01:30:14 juju-e4d256-prod-github-runner-207 kernel: [72388.602270] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 01:30:14 juju-e4d256-prod-github-runner-207 kernel: [72388.603076] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 01:30:14 juju-e4d256-prod-github-runner-207 kernel: [72388.603951] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 01:30:14 juju-e4d256-prod-github-runner-207 kernel: [72388.604747] ? __seccomp_filter+0x4a/0x4a0 Aug 23 01:30:14 juju-e4d256-prod-github-runner-207 kernel: [72388.605487] ? __fget_files+0x86/0xc0 Aug 23 01:30:14 juju-e4d256-prod-github-runner-207 kernel: [72388.606191] __x64_sys_ioctl+0x95/0xd0 Aug 23 01:30:14 juju-e4d256-prod-github-runner-207 kernel: [72388.606887] do_syscall_64+0x5c/0xc0 Aug 23 01:30:14 juju-e4d256-prod-github-runner-207 kernel: [72388.607564] ? do_futex+0x162/0x1f0 Aug 23 01:30:14 juju-e4d256-prod-github-runner-207 kernel: [72388.608214] ? __x64_sys_futex+0x78/0x1e0 Aug 23 01:30:14 juju-e4d256-prod-github-runner-207 kernel: [72388.608885] ? __secure_computing+0xa9/0x120 Aug 23 01:30:14 juju-e4d256-prod-github-runner-207 kernel: [72388.609580] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 01:30:14 juju-e4d256-prod-github-runner-207 kernel: [72388.610338] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:30:14 juju-e4d256-prod-github-runner-207 kernel: [72388.611059] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:30:14 juju-e4d256-prod-github-runner-207 kernel: [72388.611780] ? do_syscall_64+0x69/0xc0 Aug 23 01:30:14 juju-e4d256-prod-github-runner-207 kernel: [72388.612423] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:30:14 juju-e4d256-prod-github-runner-207 kernel: [72388.613127] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:30:14 juju-e4d256-prod-github-runner-207 kernel: [72388.613822] ? do_syscall_64+0x69/0xc0 Aug 23 01:30:14 juju-e4d256-prod-github-runner-207 kernel: [72388.614449] ? do_syscall_64+0x69/0xc0 Aug 23 01:30:14 juju-e4d256-prod-github-runner-207 kernel: [72388.615071] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 01:30:14 juju-e4d256-prod-github-runner-207 kernel: [72388.615783] RIP: 0033:0x7faa5d0edaff Aug 23 01:30:14 juju-e4d256-prod-github-runner-207 kernel: [72388.616406] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 01:30:14 juju-e4d256-prod-github-runner-207 kernel: [72388.618518] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 01:30:14 juju-e4d256-prod-github-runner-207 kernel: [72388.619435] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 01:30:14 juju-e4d256-prod-github-runner-207 kernel: [72388.620333] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 01:30:14 juju-e4d256-prod-github-runner-207 kernel: [72388.621222] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 01:30:14 juju-e4d256-prod-github-runner-207 kernel: [72388.622106] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 01:30:14 juju-e4d256-prod-github-runner-207 kernel: [72388.622998] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 01:30:14 juju-e4d256-prod-github-runner-207 kernel: [72388.623910] Aug 23 01:30:42 juju-e4d256-prod-github-runner-207 kernel: [72416.541976] watchdog: BUG: soft lockup - CPU#1 stuck for 67335s! [qemu-system-x86:6715] Aug 23 01:30:42 juju-e4d256-prod-github-runner-207 kernel: [72416.543085] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 01:30:42 juju-e4d256-prod-github-runner-207 kernel: [72416.543150] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 01:30:42 juju-e4d256-prod-github-runner-207 kernel: [72416.555273] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 01:30:42 juju-e4d256-prod-github-runner-207 kernel: [72416.556539] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 01:30:42 juju-e4d256-prod-github-runner-207 kernel: [72416.557805] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:30:42 juju-e4d256-prod-github-runner-207 kernel: [72416.558874] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 01:30:42 juju-e4d256-prod-github-runner-207 kernel: [72416.561487] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 01:30:42 juju-e4d256-prod-github-runner-207 kernel: [72416.562559] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 01:30:42 juju-e4d256-prod-github-runner-207 kernel: [72416.563764] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 01:30:42 juju-e4d256-prod-github-runner-207 kernel: [72416.564926] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 01:30:42 juju-e4d256-prod-github-runner-207 kernel: [72416.566127] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 01:30:42 juju-e4d256-prod-github-runner-207 kernel: [72416.567300] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 01:30:42 juju-e4d256-prod-github-runner-207 kernel: [72416.568617] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 01:30:42 juju-e4d256-prod-github-runner-207 kernel: [72416.569858] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 01:30:42 juju-e4d256-prod-github-runner-207 kernel: [72416.570960] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 01:30:42 juju-e4d256-prod-github-runner-207 kernel: [72416.572174] Call Trace: Aug 23 01:30:42 juju-e4d256-prod-github-runner-207 kernel: [72416.573090] Aug 23 01:30:42 juju-e4d256-prod-github-runner-207 kernel: [72416.573977] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:30:42 juju-e4d256-prod-github-runner-207 kernel: [72416.575005] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:30:42 juju-e4d256-prod-github-runner-207 kernel: [72416.576040] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:30:42 juju-e4d256-prod-github-runner-207 kernel: [72416.577118] ? show_regs.part.0+0x23/0x29 Aug 23 01:30:42 juju-e4d256-prod-github-runner-207 kernel: [72416.578118] ? show_regs.cold+0x8/0xd Aug 23 01:30:42 juju-e4d256-prod-github-runner-207 kernel: [72416.579093] ? watchdog_timer_fn+0x1be/0x220 Aug 23 01:30:42 juju-e4d256-prod-github-runner-207 kernel: [72416.580117] ? lockup_detector_update_enable+0x60/0x60 Aug 23 01:30:42 juju-e4d256-prod-github-runner-207 kernel: [72416.581184] ? __hrtimer_run_queues+0x107/0x230 Aug 23 01:30:42 juju-e4d256-prod-github-runner-207 kernel: [72416.582214] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 01:30:42 juju-e4d256-prod-github-runner-207 kernel: [72416.583246] ? hrtimer_interrupt+0x101/0x220 Aug 23 01:30:42 juju-e4d256-prod-github-runner-207 kernel: [72416.584260] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 01:30:42 juju-e4d256-prod-github-runner-207 kernel: [72416.585331] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 01:30:42 juju-e4d256-prod-github-runner-207 kernel: [72416.586375] Aug 23 01:30:42 juju-e4d256-prod-github-runner-207 kernel: [72416.587238] Aug 23 01:30:42 juju-e4d256-prod-github-runner-207 kernel: [72416.588079] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 01:30:42 juju-e4d256-prod-github-runner-207 kernel: [72416.589111] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:30:42 juju-e4d256-prod-github-runner-207 kernel: [72416.590153] ? _raw_spin_lock+0x22/0x30 Aug 23 01:30:42 juju-e4d256-prod-github-runner-207 kernel: [72416.591101] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:30:42 juju-e4d256-prod-github-runner-207 kernel: [72416.592125] direct_page_fault+0x206/0x310 [kvm] Aug 23 01:30:42 juju-e4d256-prod-github-runner-207 kernel: [72416.593146] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 01:30:42 juju-e4d256-prod-github-runner-207 kernel: [72416.594157] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 01:30:42 juju-e4d256-prod-github-runner-207 kernel: [72416.595170] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 01:30:42 juju-e4d256-prod-github-runner-207 kernel: [72416.596138] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 01:30:42 juju-e4d256-prod-github-runner-207 kernel: [72416.597087] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 01:30:42 juju-e4d256-prod-github-runner-207 kernel: [72416.598064] handle_exit+0x98/0x230 [kvm_amd] Aug 23 01:30:42 juju-e4d256-prod-github-runner-207 kernel: [72416.598960] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 01:30:42 juju-e4d256-prod-github-runner-207 kernel: [72416.599888] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 01:30:42 juju-e4d256-prod-github-runner-207 kernel: [72416.600814] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 01:30:42 juju-e4d256-prod-github-runner-207 kernel: [72416.601718] vcpu_run+0x62/0x2c0 [kvm] Aug 23 01:30:42 juju-e4d256-prod-github-runner-207 kernel: [72416.602528] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 01:30:42 juju-e4d256-prod-github-runner-207 kernel: [72416.603345] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 01:30:42 juju-e4d256-prod-github-runner-207 kernel: [72416.604198] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 01:30:42 juju-e4d256-prod-github-runner-207 kernel: [72416.604993] ? __seccomp_filter+0x4a/0x4a0 Aug 23 01:30:42 juju-e4d256-prod-github-runner-207 kernel: [72416.605733] ? __fget_files+0x86/0xc0 Aug 23 01:30:42 juju-e4d256-prod-github-runner-207 kernel: [72416.606434] __x64_sys_ioctl+0x95/0xd0 Aug 23 01:30:42 juju-e4d256-prod-github-runner-207 kernel: [72416.607131] do_syscall_64+0x5c/0xc0 Aug 23 01:30:42 juju-e4d256-prod-github-runner-207 kernel: [72416.607804] ? do_futex+0x162/0x1f0 Aug 23 01:30:42 juju-e4d256-prod-github-runner-207 kernel: [72416.608450] ? __x64_sys_futex+0x78/0x1e0 Aug 23 01:30:42 juju-e4d256-prod-github-runner-207 kernel: [72416.609126] ? __secure_computing+0xa9/0x120 Aug 23 01:30:42 juju-e4d256-prod-github-runner-207 kernel: [72416.609817] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 01:30:42 juju-e4d256-prod-github-runner-207 kernel: [72416.610589] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:30:42 juju-e4d256-prod-github-runner-207 kernel: [72416.611322] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:30:42 juju-e4d256-prod-github-runner-207 kernel: [72416.612044] ? do_syscall_64+0x69/0xc0 Aug 23 01:30:42 juju-e4d256-prod-github-runner-207 kernel: [72416.612693] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:30:42 juju-e4d256-prod-github-runner-207 kernel: [72416.613394] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:30:42 juju-e4d256-prod-github-runner-207 kernel: [72416.614093] ? do_syscall_64+0x69/0xc0 Aug 23 01:30:42 juju-e4d256-prod-github-runner-207 kernel: [72416.614722] ? do_syscall_64+0x69/0xc0 Aug 23 01:30:42 juju-e4d256-prod-github-runner-207 kernel: [72416.615352] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 01:30:42 juju-e4d256-prod-github-runner-207 kernel: [72416.616055] RIP: 0033:0x7faa5d0edaff Aug 23 01:30:42 juju-e4d256-prod-github-runner-207 kernel: [72416.616688] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 01:30:42 juju-e4d256-prod-github-runner-207 kernel: [72416.618669] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 01:30:42 juju-e4d256-prod-github-runner-207 kernel: [72416.619591] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 01:30:42 juju-e4d256-prod-github-runner-207 kernel: [72416.620480] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 01:30:42 juju-e4d256-prod-github-runner-207 kernel: [72416.621375] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 01:30:42 juju-e4d256-prod-github-runner-207 kernel: [72416.622261] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 01:30:42 juju-e4d256-prod-github-runner-207 kernel: [72416.623148] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 01:30:42 juju-e4d256-prod-github-runner-207 kernel: [72416.624051] Aug 23 01:31:10 juju-e4d256-prod-github-runner-207 kernel: [72444.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 67361s! [qemu-system-x86:6715] Aug 23 01:31:10 juju-e4d256-prod-github-runner-207 kernel: [72444.543682] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 01:31:10 juju-e4d256-prod-github-runner-207 kernel: [72444.543917] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 01:31:10 juju-e4d256-prod-github-runner-207 kernel: [72444.555971] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 01:31:10 juju-e4d256-prod-github-runner-207 kernel: [72444.557235] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 01:31:10 juju-e4d256-prod-github-runner-207 kernel: [72444.558454] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:31:10 juju-e4d256-prod-github-runner-207 kernel: [72444.559517] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 01:31:10 juju-e4d256-prod-github-runner-207 kernel: [72444.562068] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 01:31:10 juju-e4d256-prod-github-runner-207 kernel: [72444.563119] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 01:31:10 juju-e4d256-prod-github-runner-207 kernel: [72444.564283] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 01:31:10 juju-e4d256-prod-github-runner-207 kernel: [72444.565443] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 01:31:10 juju-e4d256-prod-github-runner-207 kernel: [72444.566602] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 01:31:10 juju-e4d256-prod-github-runner-207 kernel: [72444.567774] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 01:31:10 juju-e4d256-prod-github-runner-207 kernel: [72444.568945] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 01:31:10 juju-e4d256-prod-github-runner-207 kernel: [72444.570179] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 01:31:10 juju-e4d256-prod-github-runner-207 kernel: [72444.571292] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 01:31:10 juju-e4d256-prod-github-runner-207 kernel: [72444.572486] Call Trace: Aug 23 01:31:10 juju-e4d256-prod-github-runner-207 kernel: [72444.573398] Aug 23 01:31:10 juju-e4d256-prod-github-runner-207 kernel: [72444.574287] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:31:10 juju-e4d256-prod-github-runner-207 kernel: [72444.575325] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:31:10 juju-e4d256-prod-github-runner-207 kernel: [72444.576346] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:31:10 juju-e4d256-prod-github-runner-207 kernel: [72444.577432] ? show_regs.part.0+0x23/0x29 Aug 23 01:31:10 juju-e4d256-prod-github-runner-207 kernel: [72444.578430] ? show_regs.cold+0x8/0xd Aug 23 01:31:10 juju-e4d256-prod-github-runner-207 kernel: [72444.579411] ? watchdog_timer_fn+0x1be/0x220 Aug 23 01:31:10 juju-e4d256-prod-github-runner-207 kernel: [72444.580423] ? lockup_detector_update_enable+0x60/0x60 Aug 23 01:31:10 juju-e4d256-prod-github-runner-207 kernel: [72444.581486] ? __hrtimer_run_queues+0x107/0x230 Aug 23 01:31:10 juju-e4d256-prod-github-runner-207 kernel: [72444.582513] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 01:31:10 juju-e4d256-prod-github-runner-207 kernel: [72444.583548] ? hrtimer_interrupt+0x101/0x220 Aug 23 01:31:10 juju-e4d256-prod-github-runner-207 kernel: [72444.584572] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 01:31:10 juju-e4d256-prod-github-runner-207 kernel: [72444.585640] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 01:31:10 juju-e4d256-prod-github-runner-207 kernel: [72444.586685] Aug 23 01:31:10 juju-e4d256-prod-github-runner-207 kernel: [72444.587545] Aug 23 01:31:10 juju-e4d256-prod-github-runner-207 kernel: [72444.588382] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 01:31:10 juju-e4d256-prod-github-runner-207 kernel: [72444.589415] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:31:10 juju-e4d256-prod-github-runner-207 kernel: [72444.590451] ? _raw_spin_lock+0x22/0x30 Aug 23 01:31:10 juju-e4d256-prod-github-runner-207 kernel: [72444.591401] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:31:10 juju-e4d256-prod-github-runner-207 kernel: [72444.592413] direct_page_fault+0x206/0x310 [kvm] Aug 23 01:31:10 juju-e4d256-prod-github-runner-207 kernel: [72444.593442] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 01:31:10 juju-e4d256-prod-github-runner-207 kernel: [72444.594448] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 01:31:10 juju-e4d256-prod-github-runner-207 kernel: [72444.595450] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 01:31:10 juju-e4d256-prod-github-runner-207 kernel: [72444.596440] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 01:31:10 juju-e4d256-prod-github-runner-207 kernel: [72444.597385] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 01:31:10 juju-e4d256-prod-github-runner-207 kernel: [72444.598363] handle_exit+0x98/0x230 [kvm_amd] Aug 23 01:31:10 juju-e4d256-prod-github-runner-207 kernel: [72444.599267] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 01:31:10 juju-e4d256-prod-github-runner-207 kernel: [72444.600186] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 01:31:10 juju-e4d256-prod-github-runner-207 kernel: [72444.601107] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 01:31:10 juju-e4d256-prod-github-runner-207 kernel: [72444.602013] vcpu_run+0x62/0x2c0 [kvm] Aug 23 01:31:10 juju-e4d256-prod-github-runner-207 kernel: [72444.602868] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 01:31:10 juju-e4d256-prod-github-runner-207 kernel: [72444.603684] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 01:31:10 juju-e4d256-prod-github-runner-207 kernel: [72444.604536] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 01:31:10 juju-e4d256-prod-github-runner-207 kernel: [72444.605332] ? __seccomp_filter+0x4a/0x4a0 Aug 23 01:31:10 juju-e4d256-prod-github-runner-207 kernel: [72444.606077] ? __fget_files+0x86/0xc0 Aug 23 01:31:10 juju-e4d256-prod-github-runner-207 kernel: [72444.606777] __x64_sys_ioctl+0x95/0xd0 Aug 23 01:31:10 juju-e4d256-prod-github-runner-207 kernel: [72444.607493] do_syscall_64+0x5c/0xc0 Aug 23 01:31:10 juju-e4d256-prod-github-runner-207 kernel: [72444.608156] ? do_futex+0x162/0x1f0 Aug 23 01:31:10 juju-e4d256-prod-github-runner-207 kernel: [72444.608804] ? __x64_sys_futex+0x78/0x1e0 Aug 23 01:31:10 juju-e4d256-prod-github-runner-207 kernel: [72444.609474] ? __secure_computing+0xa9/0x120 Aug 23 01:31:10 juju-e4d256-prod-github-runner-207 kernel: [72444.610160] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 01:31:10 juju-e4d256-prod-github-runner-207 kernel: [72444.610928] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:31:10 juju-e4d256-prod-github-runner-207 kernel: [72444.611647] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:31:10 juju-e4d256-prod-github-runner-207 kernel: [72444.612367] ? do_syscall_64+0x69/0xc0 Aug 23 01:31:10 juju-e4d256-prod-github-runner-207 kernel: [72444.613010] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:31:10 juju-e4d256-prod-github-runner-207 kernel: [72444.613711] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:31:10 juju-e4d256-prod-github-runner-207 kernel: [72444.614403] ? do_syscall_64+0x69/0xc0 Aug 23 01:31:10 juju-e4d256-prod-github-runner-207 kernel: [72444.615038] ? do_syscall_64+0x69/0xc0 Aug 23 01:31:10 juju-e4d256-prod-github-runner-207 kernel: [72444.615657] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 01:31:10 juju-e4d256-prod-github-runner-207 kernel: [72444.616362] RIP: 0033:0x7faa5d0edaff Aug 23 01:31:10 juju-e4d256-prod-github-runner-207 kernel: [72444.616999] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 01:31:10 juju-e4d256-prod-github-runner-207 kernel: [72444.618996] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 01:31:10 juju-e4d256-prod-github-runner-207 kernel: [72444.619902] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 01:31:10 juju-e4d256-prod-github-runner-207 kernel: [72444.620791] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 01:31:10 juju-e4d256-prod-github-runner-207 kernel: [72444.621678] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 01:31:10 juju-e4d256-prod-github-runner-207 kernel: [72444.622562] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 01:31:10 juju-e4d256-prod-github-runner-207 kernel: [72444.623459] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 01:31:10 juju-e4d256-prod-github-runner-207 kernel: [72444.624353] Aug 23 01:31:38 juju-e4d256-prod-github-runner-207 kernel: [72472.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 67387s! [qemu-system-x86:6715] Aug 23 01:31:38 juju-e4d256-prod-github-runner-207 kernel: [72472.543107] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 01:31:38 juju-e4d256-prod-github-runner-207 kernel: [72472.543175] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 01:31:38 juju-e4d256-prod-github-runner-207 kernel: [72472.555891] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 01:31:38 juju-e4d256-prod-github-runner-207 kernel: [72472.557164] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 01:31:38 juju-e4d256-prod-github-runner-207 kernel: [72472.558384] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:31:38 juju-e4d256-prod-github-runner-207 kernel: [72472.559459] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 01:31:38 juju-e4d256-prod-github-runner-207 kernel: [72472.562006] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 01:31:38 juju-e4d256-prod-github-runner-207 kernel: [72472.563078] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 01:31:38 juju-e4d256-prod-github-runner-207 kernel: [72472.564266] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 01:31:38 juju-e4d256-prod-github-runner-207 kernel: [72472.565428] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 01:31:38 juju-e4d256-prod-github-runner-207 kernel: [72472.566607] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 01:31:38 juju-e4d256-prod-github-runner-207 kernel: [72472.567769] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 01:31:38 juju-e4d256-prod-github-runner-207 kernel: [72472.568934] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 01:31:38 juju-e4d256-prod-github-runner-207 kernel: [72472.570172] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 01:31:38 juju-e4d256-prod-github-runner-207 kernel: [72472.571282] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 01:31:38 juju-e4d256-prod-github-runner-207 kernel: [72472.572480] Call Trace: Aug 23 01:31:38 juju-e4d256-prod-github-runner-207 kernel: [72472.573394] Aug 23 01:31:38 juju-e4d256-prod-github-runner-207 kernel: [72472.574281] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:31:38 juju-e4d256-prod-github-runner-207 kernel: [72472.575326] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:31:38 juju-e4d256-prod-github-runner-207 kernel: [72472.576347] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:31:38 juju-e4d256-prod-github-runner-207 kernel: [72472.577445] ? show_regs.part.0+0x23/0x29 Aug 23 01:31:38 juju-e4d256-prod-github-runner-207 kernel: [72472.578441] ? show_regs.cold+0x8/0xd Aug 23 01:31:38 juju-e4d256-prod-github-runner-207 kernel: [72472.579441] ? watchdog_timer_fn+0x1be/0x220 Aug 23 01:31:38 juju-e4d256-prod-github-runner-207 kernel: [72472.580451] ? lockup_detector_update_enable+0x60/0x60 Aug 23 01:31:38 juju-e4d256-prod-github-runner-207 kernel: [72472.581515] ? __hrtimer_run_queues+0x107/0x230 Aug 23 01:31:38 juju-e4d256-prod-github-runner-207 kernel: [72472.582565] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 01:31:38 juju-e4d256-prod-github-runner-207 kernel: [72472.583588] ? hrtimer_interrupt+0x101/0x220 Aug 23 01:31:38 juju-e4d256-prod-github-runner-207 kernel: [72472.584601] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 01:31:38 juju-e4d256-prod-github-runner-207 kernel: [72472.585734] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 01:31:38 juju-e4d256-prod-github-runner-207 kernel: [72472.586813] Aug 23 01:31:38 juju-e4d256-prod-github-runner-207 kernel: [72472.587671] Aug 23 01:31:38 juju-e4d256-prod-github-runner-207 kernel: [72472.588508] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 01:31:38 juju-e4d256-prod-github-runner-207 kernel: [72472.589581] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:31:38 juju-e4d256-prod-github-runner-207 kernel: [72472.590642] ? _raw_spin_lock+0x22/0x30 Aug 23 01:31:38 juju-e4d256-prod-github-runner-207 kernel: [72472.591591] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:31:38 juju-e4d256-prod-github-runner-207 kernel: [72472.592607] direct_page_fault+0x206/0x310 [kvm] Aug 23 01:31:38 juju-e4d256-prod-github-runner-207 kernel: [72472.593667] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 01:31:38 juju-e4d256-prod-github-runner-207 kernel: [72472.594702] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 01:31:38 juju-e4d256-prod-github-runner-207 kernel: [72472.595710] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 01:31:38 juju-e4d256-prod-github-runner-207 kernel: [72472.596682] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 01:31:38 juju-e4d256-prod-github-runner-207 kernel: [72472.597629] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 01:31:38 juju-e4d256-prod-github-runner-207 kernel: [72472.598624] handle_exit+0x98/0x230 [kvm_amd] Aug 23 01:31:38 juju-e4d256-prod-github-runner-207 kernel: [72472.599557] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 01:31:38 juju-e4d256-prod-github-runner-207 kernel: [72472.600519] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 01:31:38 juju-e4d256-prod-github-runner-207 kernel: [72472.601452] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 01:31:38 juju-e4d256-prod-github-runner-207 kernel: [72472.602358] vcpu_run+0x62/0x2c0 [kvm] Aug 23 01:31:38 juju-e4d256-prod-github-runner-207 kernel: [72472.603188] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 01:31:38 juju-e4d256-prod-github-runner-207 kernel: [72472.603995] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 01:31:38 juju-e4d256-prod-github-runner-207 kernel: [72472.604873] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 01:31:38 juju-e4d256-prod-github-runner-207 kernel: [72472.605672] ? __seccomp_filter+0x4a/0x4a0 Aug 23 01:31:38 juju-e4d256-prod-github-runner-207 kernel: [72472.606415] ? __fget_files+0x86/0xc0 Aug 23 01:31:38 juju-e4d256-prod-github-runner-207 kernel: [72472.607140] __x64_sys_ioctl+0x95/0xd0 Aug 23 01:31:38 juju-e4d256-prod-github-runner-207 kernel: [72472.607832] do_syscall_64+0x5c/0xc0 Aug 23 01:31:38 juju-e4d256-prod-github-runner-207 kernel: [72472.608497] ? do_futex+0x162/0x1f0 Aug 23 01:31:38 juju-e4d256-prod-github-runner-207 kernel: [72472.609151] ? __x64_sys_futex+0x78/0x1e0 Aug 23 01:31:38 juju-e4d256-prod-github-runner-207 kernel: [72472.609826] ? __secure_computing+0xa9/0x120 Aug 23 01:31:38 juju-e4d256-prod-github-runner-207 kernel: [72472.610535] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 01:31:38 juju-e4d256-prod-github-runner-207 kernel: [72472.611303] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:31:38 juju-e4d256-prod-github-runner-207 kernel: [72472.612026] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:31:38 juju-e4d256-prod-github-runner-207 kernel: [72472.612744] ? do_syscall_64+0x69/0xc0 Aug 23 01:31:38 juju-e4d256-prod-github-runner-207 kernel: [72472.613395] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:31:38 juju-e4d256-prod-github-runner-207 kernel: [72472.614100] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:31:38 juju-e4d256-prod-github-runner-207 kernel: [72472.614809] ? do_syscall_64+0x69/0xc0 Aug 23 01:31:38 juju-e4d256-prod-github-runner-207 kernel: [72472.615437] ? do_syscall_64+0x69/0xc0 Aug 23 01:31:38 juju-e4d256-prod-github-runner-207 kernel: [72472.616070] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 01:31:38 juju-e4d256-prod-github-runner-207 kernel: [72472.616778] RIP: 0033:0x7faa5d0edaff Aug 23 01:31:38 juju-e4d256-prod-github-runner-207 kernel: [72472.617429] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 01:31:38 juju-e4d256-prod-github-runner-207 kernel: [72472.619442] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 01:31:38 juju-e4d256-prod-github-runner-207 kernel: [72472.620354] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 01:31:38 juju-e4d256-prod-github-runner-207 kernel: [72472.621247] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 01:31:38 juju-e4d256-prod-github-runner-207 kernel: [72472.622138] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 01:31:38 juju-e4d256-prod-github-runner-207 kernel: [72472.623059] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 01:31:38 juju-e4d256-prod-github-runner-207 kernel: [72472.623994] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 01:31:38 juju-e4d256-prod-github-runner-207 kernel: [72472.624890] Aug 23 01:32:06 juju-e4d256-prod-github-runner-207 kernel: [72500.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 67413s! [qemu-system-x86:6715] Aug 23 01:32:06 juju-e4d256-prod-github-runner-207 kernel: [72500.543101] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 01:32:06 juju-e4d256-prod-github-runner-207 kernel: [72500.543168] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 01:32:06 juju-e4d256-prod-github-runner-207 kernel: [72500.555365] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 01:32:06 juju-e4d256-prod-github-runner-207 kernel: [72500.556630] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 01:32:06 juju-e4d256-prod-github-runner-207 kernel: [72500.557852] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:32:06 juju-e4d256-prod-github-runner-207 kernel: [72500.558918] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 01:32:06 juju-e4d256-prod-github-runner-207 kernel: [72500.561470] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 01:32:06 juju-e4d256-prod-github-runner-207 kernel: [72500.562528] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 01:32:06 juju-e4d256-prod-github-runner-207 kernel: [72500.563693] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 01:32:06 juju-e4d256-prod-github-runner-207 kernel: [72500.564853] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 01:32:06 juju-e4d256-prod-github-runner-207 kernel: [72500.566022] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 01:32:06 juju-e4d256-prod-github-runner-207 kernel: [72500.567189] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 01:32:06 juju-e4d256-prod-github-runner-207 kernel: [72500.568356] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 01:32:06 juju-e4d256-prod-github-runner-207 kernel: [72500.569598] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 01:32:06 juju-e4d256-prod-github-runner-207 kernel: [72500.570705] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 01:32:06 juju-e4d256-prod-github-runner-207 kernel: [72500.571899] Call Trace: Aug 23 01:32:06 juju-e4d256-prod-github-runner-207 kernel: [72500.572816] Aug 23 01:32:06 juju-e4d256-prod-github-runner-207 kernel: [72500.573700] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:32:06 juju-e4d256-prod-github-runner-207 kernel: [72500.574742] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:32:06 juju-e4d256-prod-github-runner-207 kernel: [72500.575767] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:32:06 juju-e4d256-prod-github-runner-207 kernel: [72500.576841] ? show_regs.part.0+0x23/0x29 Aug 23 01:32:06 juju-e4d256-prod-github-runner-207 kernel: [72500.577839] ? show_regs.cold+0x8/0xd Aug 23 01:32:06 juju-e4d256-prod-github-runner-207 kernel: [72500.578824] ? watchdog_timer_fn+0x1be/0x220 Aug 23 01:32:06 juju-e4d256-prod-github-runner-207 kernel: [72500.579833] ? lockup_detector_update_enable+0x60/0x60 Aug 23 01:32:06 juju-e4d256-prod-github-runner-207 kernel: [72500.580896] ? __hrtimer_run_queues+0x107/0x230 Aug 23 01:32:06 juju-e4d256-prod-github-runner-207 kernel: [72500.581928] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 01:32:06 juju-e4d256-prod-github-runner-207 kernel: [72500.582969] ? hrtimer_interrupt+0x101/0x220 Aug 23 01:32:06 juju-e4d256-prod-github-runner-207 kernel: [72500.583984] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 01:32:06 juju-e4d256-prod-github-runner-207 kernel: [72500.585058] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 01:32:06 juju-e4d256-prod-github-runner-207 kernel: [72500.586110] Aug 23 01:32:06 juju-e4d256-prod-github-runner-207 kernel: [72500.586962] Aug 23 01:32:06 juju-e4d256-prod-github-runner-207 kernel: [72500.587805] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 01:32:06 juju-e4d256-prod-github-runner-207 kernel: [72500.588838] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:32:06 juju-e4d256-prod-github-runner-207 kernel: [72500.589876] ? _raw_spin_lock+0x22/0x30 Aug 23 01:32:06 juju-e4d256-prod-github-runner-207 kernel: [72500.590827] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:32:06 juju-e4d256-prod-github-runner-207 kernel: [72500.591849] direct_page_fault+0x206/0x310 [kvm] Aug 23 01:32:06 juju-e4d256-prod-github-runner-207 kernel: [72500.592873] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 01:32:06 juju-e4d256-prod-github-runner-207 kernel: [72500.593882] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 01:32:06 juju-e4d256-prod-github-runner-207 kernel: [72500.594896] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 01:32:06 juju-e4d256-prod-github-runner-207 kernel: [72500.595864] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 01:32:06 juju-e4d256-prod-github-runner-207 kernel: [72500.596811] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 01:32:06 juju-e4d256-prod-github-runner-207 kernel: [72500.597794] handle_exit+0x98/0x230 [kvm_amd] Aug 23 01:32:06 juju-e4d256-prod-github-runner-207 kernel: [72500.598699] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 01:32:06 juju-e4d256-prod-github-runner-207 kernel: [72500.599614] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 01:32:06 juju-e4d256-prod-github-runner-207 kernel: [72500.600543] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 01:32:06 juju-e4d256-prod-github-runner-207 kernel: [72500.601448] vcpu_run+0x62/0x2c0 [kvm] Aug 23 01:32:06 juju-e4d256-prod-github-runner-207 kernel: [72500.602269] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 01:32:06 juju-e4d256-prod-github-runner-207 kernel: [72500.603077] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 01:32:06 juju-e4d256-prod-github-runner-207 kernel: [72500.603936] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 01:32:06 juju-e4d256-prod-github-runner-207 kernel: [72500.604732] ? __seccomp_filter+0x4a/0x4a0 Aug 23 01:32:06 juju-e4d256-prod-github-runner-207 kernel: [72500.605479] ? __fget_files+0x86/0xc0 Aug 23 01:32:06 juju-e4d256-prod-github-runner-207 kernel: [72500.606188] __x64_sys_ioctl+0x95/0xd0 Aug 23 01:32:06 juju-e4d256-prod-github-runner-207 kernel: [72500.606882] do_syscall_64+0x5c/0xc0 Aug 23 01:32:06 juju-e4d256-prod-github-runner-207 kernel: [72500.607553] ? do_futex+0x162/0x1f0 Aug 23 01:32:06 juju-e4d256-prod-github-runner-207 kernel: [72500.608201] ? __x64_sys_futex+0x78/0x1e0 Aug 23 01:32:06 juju-e4d256-prod-github-runner-207 kernel: [72500.608874] ? __secure_computing+0xa9/0x120 Aug 23 01:32:06 juju-e4d256-prod-github-runner-207 kernel: [72500.609562] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 01:32:06 juju-e4d256-prod-github-runner-207 kernel: [72500.610327] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:32:06 juju-e4d256-prod-github-runner-207 kernel: [72500.611049] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:32:06 juju-e4d256-prod-github-runner-207 kernel: [72500.611767] ? do_syscall_64+0x69/0xc0 Aug 23 01:32:06 juju-e4d256-prod-github-runner-207 kernel: [72500.612413] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:32:06 juju-e4d256-prod-github-runner-207 kernel: [72500.613117] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:32:06 juju-e4d256-prod-github-runner-207 kernel: [72500.613817] ? do_syscall_64+0x69/0xc0 Aug 23 01:32:06 juju-e4d256-prod-github-runner-207 kernel: [72500.614445] ? do_syscall_64+0x69/0xc0 Aug 23 01:32:06 juju-e4d256-prod-github-runner-207 kernel: [72500.615068] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 01:32:06 juju-e4d256-prod-github-runner-207 kernel: [72500.615777] RIP: 0033:0x7faa5d0edaff Aug 23 01:32:06 juju-e4d256-prod-github-runner-207 kernel: [72500.616403] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 01:32:06 juju-e4d256-prod-github-runner-207 kernel: [72500.618407] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 01:32:06 juju-e4d256-prod-github-runner-207 kernel: [72500.619322] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 01:32:06 juju-e4d256-prod-github-runner-207 kernel: [72500.620211] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 01:32:06 juju-e4d256-prod-github-runner-207 kernel: [72500.621097] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 01:32:06 juju-e4d256-prod-github-runner-207 kernel: [72500.621983] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 01:32:06 juju-e4d256-prod-github-runner-207 kernel: [72500.622876] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 01:32:06 juju-e4d256-prod-github-runner-207 kernel: [72500.623770] Aug 23 01:32:34 juju-e4d256-prod-github-runner-207 kernel: [72528.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 67439s! [qemu-system-x86:6715] Aug 23 01:32:34 juju-e4d256-prod-github-runner-207 kernel: [72528.543768] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 01:32:34 juju-e4d256-prod-github-runner-207 kernel: [72528.544031] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 01:32:34 juju-e4d256-prod-github-runner-207 kernel: [72528.556202] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 01:32:34 juju-e4d256-prod-github-runner-207 kernel: [72528.557482] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 01:32:34 juju-e4d256-prod-github-runner-207 kernel: [72528.558748] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:32:34 juju-e4d256-prod-github-runner-207 kernel: [72528.559832] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 01:32:34 juju-e4d256-prod-github-runner-207 kernel: [72528.562405] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 01:32:34 juju-e4d256-prod-github-runner-207 kernel: [72528.563465] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 01:32:34 juju-e4d256-prod-github-runner-207 kernel: [72528.564642] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 01:32:34 juju-e4d256-prod-github-runner-207 kernel: [72528.565900] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 01:32:34 juju-e4d256-prod-github-runner-207 kernel: [72528.567057] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 01:32:34 juju-e4d256-prod-github-runner-207 kernel: [72528.568215] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 01:32:34 juju-e4d256-prod-github-runner-207 kernel: [72528.569390] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 01:32:34 juju-e4d256-prod-github-runner-207 kernel: [72528.570635] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 01:32:34 juju-e4d256-prod-github-runner-207 kernel: [72528.571733] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 01:32:34 juju-e4d256-prod-github-runner-207 kernel: [72528.572922] Call Trace: Aug 23 01:32:34 juju-e4d256-prod-github-runner-207 kernel: [72528.573858] Aug 23 01:32:34 juju-e4d256-prod-github-runner-207 kernel: [72528.574761] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:32:34 juju-e4d256-prod-github-runner-207 kernel: [72528.575795] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:32:34 juju-e4d256-prod-github-runner-207 kernel: [72528.576819] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:32:34 juju-e4d256-prod-github-runner-207 kernel: [72528.577931] ? show_regs.part.0+0x23/0x29 Aug 23 01:32:34 juju-e4d256-prod-github-runner-207 kernel: [72528.578935] ? show_regs.cold+0x8/0xd Aug 23 01:32:34 juju-e4d256-prod-github-runner-207 kernel: [72528.579912] ? watchdog_timer_fn+0x1be/0x220 Aug 23 01:32:34 juju-e4d256-prod-github-runner-207 kernel: [72528.580918] ? lockup_detector_update_enable+0x60/0x60 Aug 23 01:32:34 juju-e4d256-prod-github-runner-207 kernel: [72528.581995] ? __hrtimer_run_queues+0x107/0x230 Aug 23 01:32:34 juju-e4d256-prod-github-runner-207 kernel: [72528.583021] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 01:32:34 juju-e4d256-prod-github-runner-207 kernel: [72528.584099] ? hrtimer_interrupt+0x101/0x220 Aug 23 01:32:34 juju-e4d256-prod-github-runner-207 kernel: [72528.585117] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 01:32:34 juju-e4d256-prod-github-runner-207 kernel: [72528.586226] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 01:32:34 juju-e4d256-prod-github-runner-207 kernel: [72528.587273] Aug 23 01:32:34 juju-e4d256-prod-github-runner-207 kernel: [72528.588130] Aug 23 01:32:34 juju-e4d256-prod-github-runner-207 kernel: [72528.588983] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 01:32:34 juju-e4d256-prod-github-runner-207 kernel: [72528.590037] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:32:34 juju-e4d256-prod-github-runner-207 kernel: [72528.591075] ? _raw_spin_lock+0x22/0x30 Aug 23 01:32:34 juju-e4d256-prod-github-runner-207 kernel: [72528.592017] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:32:34 juju-e4d256-prod-github-runner-207 kernel: [72528.593031] direct_page_fault+0x206/0x310 [kvm] Aug 23 01:32:34 juju-e4d256-prod-github-runner-207 kernel: [72528.594076] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 01:32:34 juju-e4d256-prod-github-runner-207 kernel: [72528.595165] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 01:32:34 juju-e4d256-prod-github-runner-207 kernel: [72528.596165] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 01:32:34 juju-e4d256-prod-github-runner-207 kernel: [72528.597161] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 01:32:34 juju-e4d256-prod-github-runner-207 kernel: [72528.598124] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 01:32:34 juju-e4d256-prod-github-runner-207 kernel: [72528.599102] handle_exit+0x98/0x230 [kvm_amd] Aug 23 01:32:34 juju-e4d256-prod-github-runner-207 kernel: [72528.599998] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 01:32:34 juju-e4d256-prod-github-runner-207 kernel: [72528.600916] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 01:32:34 juju-e4d256-prod-github-runner-207 kernel: [72528.601850] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 01:32:34 juju-e4d256-prod-github-runner-207 kernel: [72528.602751] vcpu_run+0x62/0x2c0 [kvm] Aug 23 01:32:34 juju-e4d256-prod-github-runner-207 kernel: [72528.603560] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 01:32:34 juju-e4d256-prod-github-runner-207 kernel: [72528.604379] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 01:32:34 juju-e4d256-prod-github-runner-207 kernel: [72528.605234] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 01:32:34 juju-e4d256-prod-github-runner-207 kernel: [72528.606053] ? __seccomp_filter+0x4a/0x4a0 Aug 23 01:32:34 juju-e4d256-prod-github-runner-207 kernel: [72528.606795] ? __fget_files+0x86/0xc0 Aug 23 01:32:34 juju-e4d256-prod-github-runner-207 kernel: [72528.607498] __x64_sys_ioctl+0x95/0xd0 Aug 23 01:32:34 juju-e4d256-prod-github-runner-207 kernel: [72528.608189] do_syscall_64+0x5c/0xc0 Aug 23 01:32:34 juju-e4d256-prod-github-runner-207 kernel: [72528.608851] ? do_futex+0x162/0x1f0 Aug 23 01:32:34 juju-e4d256-prod-github-runner-207 kernel: [72528.609507] ? __x64_sys_futex+0x78/0x1e0 Aug 23 01:32:34 juju-e4d256-prod-github-runner-207 kernel: [72528.610196] ? __secure_computing+0xa9/0x120 Aug 23 01:32:34 juju-e4d256-prod-github-runner-207 kernel: [72528.610885] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 01:32:34 juju-e4d256-prod-github-runner-207 kernel: [72528.611644] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:32:34 juju-e4d256-prod-github-runner-207 kernel: [72528.612364] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:32:34 juju-e4d256-prod-github-runner-207 kernel: [72528.613079] ? do_syscall_64+0x69/0xc0 Aug 23 01:32:34 juju-e4d256-prod-github-runner-207 kernel: [72528.613723] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:32:34 juju-e4d256-prod-github-runner-207 kernel: [72528.614444] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:32:34 juju-e4d256-prod-github-runner-207 kernel: [72528.615142] ? do_syscall_64+0x69/0xc0 Aug 23 01:32:34 juju-e4d256-prod-github-runner-207 kernel: [72528.615797] ? do_syscall_64+0x69/0xc0 Aug 23 01:32:34 juju-e4d256-prod-github-runner-207 kernel: [72528.616419] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 01:32:34 juju-e4d256-prod-github-runner-207 kernel: [72528.617123] RIP: 0033:0x7faa5d0edaff Aug 23 01:32:34 juju-e4d256-prod-github-runner-207 kernel: [72528.617787] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 01:32:34 juju-e4d256-prod-github-runner-207 kernel: [72528.619780] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 01:32:34 juju-e4d256-prod-github-runner-207 kernel: [72528.620697] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 01:32:34 juju-e4d256-prod-github-runner-207 kernel: [72528.621583] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 01:32:34 juju-e4d256-prod-github-runner-207 kernel: [72528.622493] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 01:32:34 juju-e4d256-prod-github-runner-207 kernel: [72528.623391] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 01:32:34 juju-e4d256-prod-github-runner-207 kernel: [72528.624274] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 01:32:34 juju-e4d256-prod-github-runner-207 kernel: [72528.625176] Aug 23 01:32:48 juju-e4d256-prod-github-runner-207 kernel: [72542.024706] rcu: INFO: rcu_sched self-detected stall on CPU Aug 23 01:32:48 juju-e4d256-prod-github-runner-207 kernel: [72542.025690] rcu: 1-....: (18049221 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=8719424 Aug 23 01:32:48 juju-e4d256-prod-github-runner-207 kernel: [72542.026813] (t=18106206 jiffies g=23269 q=62007) Aug 23 01:32:48 juju-e4d256-prod-github-runner-207 kernel: [72542.027599] NMI backtrace for cpu 1 Aug 23 01:32:48 juju-e4d256-prod-github-runner-207 kernel: [72542.028308] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 01:32:48 juju-e4d256-prod-github-runner-207 kernel: [72542.029410] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 01:32:48 juju-e4d256-prod-github-runner-207 kernel: [72542.030482] Call Trace: Aug 23 01:32:48 juju-e4d256-prod-github-runner-207 kernel: [72542.031157] Aug 23 01:32:48 juju-e4d256-prod-github-runner-207 kernel: [72542.031810] show_stack+0x52/0x5c Aug 23 01:32:48 juju-e4d256-prod-github-runner-207 kernel: [72542.032542] dump_stack_lvl+0x4a/0x63 Aug 23 01:32:48 juju-e4d256-prod-github-runner-207 kernel: [72542.033286] dump_stack+0x10/0x16 Aug 23 01:32:48 juju-e4d256-prod-github-runner-207 kernel: [72542.034015] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 23 01:32:48 juju-e4d256-prod-github-runner-207 kernel: [72542.034800] ? lapic_can_unplug_cpu+0x90/0x90 Aug 23 01:32:48 juju-e4d256-prod-github-runner-207 kernel: [72542.035576] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 23 01:32:48 juju-e4d256-prod-github-runner-207 kernel: [72542.036393] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 23 01:32:48 juju-e4d256-prod-github-runner-207 kernel: [72542.037215] trigger_single_cpu_backtrace+0x44/0x4f Aug 23 01:32:48 juju-e4d256-prod-github-runner-207 kernel: [72542.038030] rcu_dump_cpu_stacks+0x102/0x149 Aug 23 01:32:48 juju-e4d256-prod-github-runner-207 kernel: [72542.038823] print_cpu_stall.cold+0x2f/0xe2 Aug 23 01:32:48 juju-e4d256-prod-github-runner-207 kernel: [72542.039588] ? timekeeping_update+0xf7/0x150 Aug 23 01:32:48 juju-e4d256-prod-github-runner-207 kernel: [72542.040358] check_cpu_stall+0x109/0x270 Aug 23 01:32:48 juju-e4d256-prod-github-runner-207 kernel: [72542.041104] rcu_sched_clock_irq+0x9a/0x250 Aug 23 01:32:48 juju-e4d256-prod-github-runner-207 kernel: [72542.041884] update_process_times+0x94/0xd0 Aug 23 01:32:48 juju-e4d256-prod-github-runner-207 kernel: [72542.042644] tick_sched_handle+0x29/0x70 Aug 23 01:32:48 juju-e4d256-prod-github-runner-207 kernel: [72542.043386] tick_sched_timer+0x8c/0xc0 Aug 23 01:32:48 juju-e4d256-prod-github-runner-207 kernel: [72542.044124] ? tick_nohz_handler+0xb0/0xb0 Aug 23 01:32:48 juju-e4d256-prod-github-runner-207 kernel: [72542.044877] __hrtimer_run_queues+0x107/0x230 Aug 23 01:32:48 juju-e4d256-prod-github-runner-207 kernel: [72542.045661] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 01:32:48 juju-e4d256-prod-github-runner-207 kernel: [72542.046435] hrtimer_interrupt+0x101/0x220 Aug 23 01:32:48 juju-e4d256-prod-github-runner-207 kernel: [72542.047196] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 01:32:48 juju-e4d256-prod-github-runner-207 kernel: [72542.048006] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 01:32:48 juju-e4d256-prod-github-runner-207 kernel: [72542.048804] Aug 23 01:32:48 juju-e4d256-prod-github-runner-207 kernel: [72542.049437] Aug 23 01:32:48 juju-e4d256-prod-github-runner-207 kernel: [72542.050079] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 01:32:48 juju-e4d256-prod-github-runner-207 kernel: [72542.050897] RIP: 0010:native_queued_spin_lock_slowpath+0xc/0x40 Aug 23 01:32:48 juju-e4d256-prod-github-runner-207 kernel: [72542.051769] Code: fe ff ff eb af 4c 89 fe 48 c7 c7 20 99 e9 89 e8 ca 69 55 00 e9 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 <8b> 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 eb Aug 23 01:32:48 juju-e4d256-prod-github-runner-207 kernel: [72542.053980] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 01:32:48 juju-e4d256-prod-github-runner-207 kernel: [72542.054851] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 01:32:48 juju-e4d256-prod-github-runner-207 kernel: [72542.055847] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 01:32:48 juju-e4d256-prod-github-runner-207 kernel: [72542.056820] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 01:32:48 juju-e4d256-prod-github-runner-207 kernel: [72542.057798] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 01:32:48 juju-e4d256-prod-github-runner-207 kernel: [72542.058936] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 01:32:48 juju-e4d256-prod-github-runner-207 kernel: [72542.059891] ? _raw_spin_lock+0x22/0x30 Aug 23 01:32:48 juju-e4d256-prod-github-runner-207 kernel: [72542.060647] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:32:48 juju-e4d256-prod-github-runner-207 kernel: [72542.061481] direct_page_fault+0x206/0x310 [kvm] Aug 23 01:32:48 juju-e4d256-prod-github-runner-207 kernel: [72542.062327] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 01:32:48 juju-e4d256-prod-github-runner-207 kernel: [72542.063158] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 01:32:48 juju-e4d256-prod-github-runner-207 kernel: [72542.063977] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 01:32:48 juju-e4d256-prod-github-runner-207 kernel: [72542.064781] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 01:32:48 juju-e4d256-prod-github-runner-207 kernel: [72542.065565] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 01:32:48 juju-e4d256-prod-github-runner-207 kernel: [72542.066394] handle_exit+0x98/0x230 [kvm_amd] Aug 23 01:32:48 juju-e4d256-prod-github-runner-207 kernel: [72542.067145] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 01:32:48 juju-e4d256-prod-github-runner-207 kernel: [72542.067930] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 01:32:48 juju-e4d256-prod-github-runner-207 kernel: [72542.068735] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 01:32:48 juju-e4d256-prod-github-runner-207 kernel: [72542.069518] vcpu_run+0x62/0x2c0 [kvm] Aug 23 01:32:48 juju-e4d256-prod-github-runner-207 kernel: [72542.070244] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 01:32:48 juju-e4d256-prod-github-runner-207 kernel: [72542.070977] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 01:32:48 juju-e4d256-prod-github-runner-207 kernel: [72542.071775] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 01:32:48 juju-e4d256-prod-github-runner-207 kernel: [72542.072532] ? __seccomp_filter+0x4a/0x4a0 Aug 23 01:32:48 juju-e4d256-prod-github-runner-207 kernel: [72542.073251] ? __fget_files+0x86/0xc0 Aug 23 01:32:48 juju-e4d256-prod-github-runner-207 kernel: [72542.073954] __x64_sys_ioctl+0x95/0xd0 Aug 23 01:32:48 juju-e4d256-prod-github-runner-207 kernel: [72542.074647] do_syscall_64+0x5c/0xc0 Aug 23 01:32:48 juju-e4d256-prod-github-runner-207 kernel: [72542.075331] ? do_futex+0x162/0x1f0 Aug 23 01:32:48 juju-e4d256-prod-github-runner-207 kernel: [72542.076004] ? __x64_sys_futex+0x78/0x1e0 Aug 23 01:32:48 juju-e4d256-prod-github-runner-207 kernel: [72542.076703] ? __secure_computing+0xa9/0x120 Aug 23 01:32:48 juju-e4d256-prod-github-runner-207 kernel: [72542.077417] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 01:32:48 juju-e4d256-prod-github-runner-207 kernel: [72542.078221] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:32:48 juju-e4d256-prod-github-runner-207 kernel: [72542.078973] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:32:48 juju-e4d256-prod-github-runner-207 kernel: [72542.079728] ? do_syscall_64+0x69/0xc0 Aug 23 01:32:48 juju-e4d256-prod-github-runner-207 kernel: [72542.080416] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:32:48 juju-e4d256-prod-github-runner-207 kernel: [72542.081171] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:32:48 juju-e4d256-prod-github-runner-207 kernel: [72542.081940] ? do_syscall_64+0x69/0xc0 Aug 23 01:32:48 juju-e4d256-prod-github-runner-207 kernel: [72542.082814] ? do_syscall_64+0x69/0xc0 Aug 23 01:32:48 juju-e4d256-prod-github-runner-207 kernel: [72542.083501] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 01:32:48 juju-e4d256-prod-github-runner-207 kernel: [72542.084269] RIP: 0033:0x7faa5d0edaff Aug 23 01:32:48 juju-e4d256-prod-github-runner-207 kernel: [72542.084972] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 01:32:48 juju-e4d256-prod-github-runner-207 kernel: [72542.087080] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 01:32:48 juju-e4d256-prod-github-runner-207 kernel: [72542.088043] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 01:32:48 juju-e4d256-prod-github-runner-207 kernel: [72542.088986] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 01:32:48 juju-e4d256-prod-github-runner-207 kernel: [72542.089942] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 01:32:48 juju-e4d256-prod-github-runner-207 kernel: [72542.090883] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 01:32:48 juju-e4d256-prod-github-runner-207 kernel: [72542.091808] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 01:32:48 juju-e4d256-prod-github-runner-207 kernel: [72542.092721] Aug 23 01:33:14 juju-e4d256-prod-github-runner-207 kernel: [72568.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 67476s! [qemu-system-x86:6715] Aug 23 01:33:14 juju-e4d256-prod-github-runner-207 kernel: [72568.543109] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 01:33:14 juju-e4d256-prod-github-runner-207 kernel: [72568.543178] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 01:33:14 juju-e4d256-prod-github-runner-207 kernel: [72568.555245] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 01:33:14 juju-e4d256-prod-github-runner-207 kernel: [72568.556508] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 01:33:14 juju-e4d256-prod-github-runner-207 kernel: [72568.557740] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:33:14 juju-e4d256-prod-github-runner-207 kernel: [72568.558797] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 01:33:14 juju-e4d256-prod-github-runner-207 kernel: [72568.561373] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 01:33:14 juju-e4d256-prod-github-runner-207 kernel: [72568.562423] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 01:33:14 juju-e4d256-prod-github-runner-207 kernel: [72568.563585] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 01:33:14 juju-e4d256-prod-github-runner-207 kernel: [72568.564743] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 01:33:14 juju-e4d256-prod-github-runner-207 kernel: [72568.565915] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 01:33:14 juju-e4d256-prod-github-runner-207 kernel: [72568.567077] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 01:33:14 juju-e4d256-prod-github-runner-207 kernel: [72568.568245] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 01:33:14 juju-e4d256-prod-github-runner-207 kernel: [72568.569497] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 01:33:14 juju-e4d256-prod-github-runner-207 kernel: [72568.570599] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 01:33:14 juju-e4d256-prod-github-runner-207 kernel: [72568.571790] Call Trace: Aug 23 01:33:14 juju-e4d256-prod-github-runner-207 kernel: [72568.572707] Aug 23 01:33:14 juju-e4d256-prod-github-runner-207 kernel: [72568.573601] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:33:14 juju-e4d256-prod-github-runner-207 kernel: [72568.574630] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:33:14 juju-e4d256-prod-github-runner-207 kernel: [72568.575658] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:33:14 juju-e4d256-prod-github-runner-207 kernel: [72568.576738] ? show_regs.part.0+0x23/0x29 Aug 23 01:33:14 juju-e4d256-prod-github-runner-207 kernel: [72568.577753] ? show_regs.cold+0x8/0xd Aug 23 01:33:14 juju-e4d256-prod-github-runner-207 kernel: [72568.578726] ? watchdog_timer_fn+0x1be/0x220 Aug 23 01:33:14 juju-e4d256-prod-github-runner-207 kernel: [72568.579732] ? lockup_detector_update_enable+0x60/0x60 Aug 23 01:33:14 juju-e4d256-prod-github-runner-207 kernel: [72568.580793] ? __hrtimer_run_queues+0x107/0x230 Aug 23 01:33:14 juju-e4d256-prod-github-runner-207 kernel: [72568.581838] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 01:33:14 juju-e4d256-prod-github-runner-207 kernel: [72568.582873] ? hrtimer_interrupt+0x101/0x220 Aug 23 01:33:14 juju-e4d256-prod-github-runner-207 kernel: [72568.583902] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 01:33:14 juju-e4d256-prod-github-runner-207 kernel: [72568.584977] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 01:33:14 juju-e4d256-prod-github-runner-207 kernel: [72568.586039] Aug 23 01:33:14 juju-e4d256-prod-github-runner-207 kernel: [72568.586893] Aug 23 01:33:14 juju-e4d256-prod-github-runner-207 kernel: [72568.587732] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 01:33:14 juju-e4d256-prod-github-runner-207 kernel: [72568.588763] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:33:14 juju-e4d256-prod-github-runner-207 kernel: [72568.589810] ? _raw_spin_lock+0x22/0x30 Aug 23 01:33:14 juju-e4d256-prod-github-runner-207 kernel: [72568.590775] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:33:14 juju-e4d256-prod-github-runner-207 kernel: [72568.591799] direct_page_fault+0x206/0x310 [kvm] Aug 23 01:33:14 juju-e4d256-prod-github-runner-207 kernel: [72568.592831] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 01:33:14 juju-e4d256-prod-github-runner-207 kernel: [72568.593858] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 01:33:14 juju-e4d256-prod-github-runner-207 kernel: [72568.594866] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 01:33:14 juju-e4d256-prod-github-runner-207 kernel: [72568.595838] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 01:33:14 juju-e4d256-prod-github-runner-207 kernel: [72568.596782] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 01:33:14 juju-e4d256-prod-github-runner-207 kernel: [72568.597774] handle_exit+0x98/0x230 [kvm_amd] Aug 23 01:33:14 juju-e4d256-prod-github-runner-207 kernel: [72568.598672] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 01:33:14 juju-e4d256-prod-github-runner-207 kernel: [72568.599586] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 01:33:14 juju-e4d256-prod-github-runner-207 kernel: [72568.600507] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 01:33:14 juju-e4d256-prod-github-runner-207 kernel: [72568.601424] vcpu_run+0x62/0x2c0 [kvm] Aug 23 01:33:14 juju-e4d256-prod-github-runner-207 kernel: [72568.602286] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 01:33:14 juju-e4d256-prod-github-runner-207 kernel: [72568.603100] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 01:33:14 juju-e4d256-prod-github-runner-207 kernel: [72568.603955] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 01:33:14 juju-e4d256-prod-github-runner-207 kernel: [72568.604753] ? __seccomp_filter+0x4a/0x4a0 Aug 23 01:33:14 juju-e4d256-prod-github-runner-207 kernel: [72568.605510] ? __fget_files+0x86/0xc0 Aug 23 01:33:14 juju-e4d256-prod-github-runner-207 kernel: [72568.606214] __x64_sys_ioctl+0x95/0xd0 Aug 23 01:33:14 juju-e4d256-prod-github-runner-207 kernel: [72568.606904] do_syscall_64+0x5c/0xc0 Aug 23 01:33:14 juju-e4d256-prod-github-runner-207 kernel: [72568.607573] ? do_futex+0x162/0x1f0 Aug 23 01:33:14 juju-e4d256-prod-github-runner-207 kernel: [72568.608223] ? __x64_sys_futex+0x78/0x1e0 Aug 23 01:33:14 juju-e4d256-prod-github-runner-207 kernel: [72568.608895] ? __secure_computing+0xa9/0x120 Aug 23 01:33:14 juju-e4d256-prod-github-runner-207 kernel: [72568.609603] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 01:33:14 juju-e4d256-prod-github-runner-207 kernel: [72568.610363] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:33:14 juju-e4d256-prod-github-runner-207 kernel: [72568.611089] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:33:14 juju-e4d256-prod-github-runner-207 kernel: [72568.611808] ? do_syscall_64+0x69/0xc0 Aug 23 01:33:14 juju-e4d256-prod-github-runner-207 kernel: [72568.612451] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:33:14 juju-e4d256-prod-github-runner-207 kernel: [72568.613155] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:33:14 juju-e4d256-prod-github-runner-207 kernel: [72568.613860] ? do_syscall_64+0x69/0xc0 Aug 23 01:33:14 juju-e4d256-prod-github-runner-207 kernel: [72568.614486] ? do_syscall_64+0x69/0xc0 Aug 23 01:33:14 juju-e4d256-prod-github-runner-207 kernel: [72568.615110] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 01:33:14 juju-e4d256-prod-github-runner-207 kernel: [72568.615812] RIP: 0033:0x7faa5d0edaff Aug 23 01:33:14 juju-e4d256-prod-github-runner-207 kernel: [72568.616435] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 01:33:14 juju-e4d256-prod-github-runner-207 kernel: [72568.618429] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 01:33:14 juju-e4d256-prod-github-runner-207 kernel: [72568.619345] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 01:33:14 juju-e4d256-prod-github-runner-207 kernel: [72568.620240] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 01:33:14 juju-e4d256-prod-github-runner-207 kernel: [72568.621126] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 01:33:14 juju-e4d256-prod-github-runner-207 kernel: [72568.622301] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 01:33:14 juju-e4d256-prod-github-runner-207 kernel: [72568.623192] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 01:33:14 juju-e4d256-prod-github-runner-207 kernel: [72568.624088] Aug 23 01:33:42 juju-e4d256-prod-github-runner-207 kernel: [72596.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 67502s! [qemu-system-x86:6715] Aug 23 01:33:42 juju-e4d256-prod-github-runner-207 kernel: [72596.543079] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 01:33:42 juju-e4d256-prod-github-runner-207 kernel: [72596.543146] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 01:33:42 juju-e4d256-prod-github-runner-207 kernel: [72596.555351] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 01:33:42 juju-e4d256-prod-github-runner-207 kernel: [72596.556828] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 01:33:42 juju-e4d256-prod-github-runner-207 kernel: [72596.558111] RIP: 0010:native_queued_spin_lock_slowpath+0xc/0x40 Aug 23 01:33:42 juju-e4d256-prod-github-runner-207 kernel: [72596.559173] Code: fe ff ff eb af 4c 89 fe 48 c7 c7 20 99 e9 89 e8 ca 69 55 00 e9 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 <8b> 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 eb Aug 23 01:33:42 juju-e4d256-prod-github-runner-207 kernel: [72596.561873] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 01:33:42 juju-e4d256-prod-github-runner-207 kernel: [72596.562942] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 01:33:42 juju-e4d256-prod-github-runner-207 kernel: [72596.564111] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 01:33:42 juju-e4d256-prod-github-runner-207 kernel: [72596.565291] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 01:33:42 juju-e4d256-prod-github-runner-207 kernel: [72596.566464] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 01:33:42 juju-e4d256-prod-github-runner-207 kernel: [72596.567657] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 01:33:42 juju-e4d256-prod-github-runner-207 kernel: [72596.568829] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 01:33:42 juju-e4d256-prod-github-runner-207 kernel: [72596.570084] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 01:33:42 juju-e4d256-prod-github-runner-207 kernel: [72596.571181] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 01:33:42 juju-e4d256-prod-github-runner-207 kernel: [72596.572385] Call Trace: Aug 23 01:33:42 juju-e4d256-prod-github-runner-207 kernel: [72596.573329] Aug 23 01:33:42 juju-e4d256-prod-github-runner-207 kernel: [72596.574215] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:33:42 juju-e4d256-prod-github-runner-207 kernel: [72596.575247] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:33:42 juju-e4d256-prod-github-runner-207 kernel: [72596.576268] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:33:42 juju-e4d256-prod-github-runner-207 kernel: [72596.577372] ? show_regs.part.0+0x23/0x29 Aug 23 01:33:42 juju-e4d256-prod-github-runner-207 kernel: [72596.578405] ? show_regs.cold+0x8/0xd Aug 23 01:33:42 juju-e4d256-prod-github-runner-207 kernel: [72596.579380] ? watchdog_timer_fn+0x1be/0x220 Aug 23 01:33:42 juju-e4d256-prod-github-runner-207 kernel: [72596.580395] ? lockup_detector_update_enable+0x60/0x60 Aug 23 01:33:42 juju-e4d256-prod-github-runner-207 kernel: [72596.581492] ? __hrtimer_run_queues+0x107/0x230 Aug 23 01:33:42 juju-e4d256-prod-github-runner-207 kernel: [72596.582552] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 01:33:42 juju-e4d256-prod-github-runner-207 kernel: [72596.583609] ? hrtimer_interrupt+0x101/0x220 Aug 23 01:33:42 juju-e4d256-prod-github-runner-207 kernel: [72596.584652] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 01:33:42 juju-e4d256-prod-github-runner-207 kernel: [72596.585752] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 01:33:42 juju-e4d256-prod-github-runner-207 kernel: [72596.586799] Aug 23 01:33:42 juju-e4d256-prod-github-runner-207 kernel: [72596.587699] Aug 23 01:33:42 juju-e4d256-prod-github-runner-207 kernel: [72596.588578] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 01:33:42 juju-e4d256-prod-github-runner-207 kernel: [72596.589647] ? native_queued_spin_lock_slowpath+0xc/0x40 Aug 23 01:33:42 juju-e4d256-prod-github-runner-207 kernel: [72596.590688] ? _raw_spin_lock+0x22/0x30 Aug 23 01:33:42 juju-e4d256-prod-github-runner-207 kernel: [72596.591636] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:33:42 juju-e4d256-prod-github-runner-207 kernel: [72596.592672] direct_page_fault+0x206/0x310 [kvm] Aug 23 01:33:42 juju-e4d256-prod-github-runner-207 kernel: [72596.593743] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 01:33:42 juju-e4d256-prod-github-runner-207 kernel: [72596.594765] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 01:33:42 juju-e4d256-prod-github-runner-207 kernel: [72596.595766] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 01:33:42 juju-e4d256-prod-github-runner-207 kernel: [72596.596737] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 01:33:42 juju-e4d256-prod-github-runner-207 kernel: [72596.597726] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 01:33:42 juju-e4d256-prod-github-runner-207 kernel: [72596.598757] handle_exit+0x98/0x230 [kvm_amd] Aug 23 01:33:42 juju-e4d256-prod-github-runner-207 kernel: [72596.599658] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 01:33:42 juju-e4d256-prod-github-runner-207 kernel: [72596.600578] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 01:33:42 juju-e4d256-prod-github-runner-207 kernel: [72596.601530] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 01:33:42 juju-e4d256-prod-github-runner-207 kernel: [72596.602435] vcpu_run+0x62/0x2c0 [kvm] Aug 23 01:33:42 juju-e4d256-prod-github-runner-207 kernel: [72596.603260] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 01:33:42 juju-e4d256-prod-github-runner-207 kernel: [72596.604095] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 01:33:42 juju-e4d256-prod-github-runner-207 kernel: [72596.604974] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 01:33:42 juju-e4d256-prod-github-runner-207 kernel: [72596.605772] ? __seccomp_filter+0x4a/0x4a0 Aug 23 01:33:42 juju-e4d256-prod-github-runner-207 kernel: [72596.606515] ? __fget_files+0x86/0xc0 Aug 23 01:33:42 juju-e4d256-prod-github-runner-207 kernel: [72596.607219] __x64_sys_ioctl+0x95/0xd0 Aug 23 01:33:42 juju-e4d256-prod-github-runner-207 kernel: [72596.607924] do_syscall_64+0x5c/0xc0 Aug 23 01:33:42 juju-e4d256-prod-github-runner-207 kernel: [72596.608615] ? do_futex+0x162/0x1f0 Aug 23 01:33:42 juju-e4d256-prod-github-runner-207 kernel: [72596.609315] ? __x64_sys_futex+0x78/0x1e0 Aug 23 01:33:42 juju-e4d256-prod-github-runner-207 kernel: [72596.609991] ? __secure_computing+0xa9/0x120 Aug 23 01:33:42 juju-e4d256-prod-github-runner-207 kernel: [72596.610685] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 01:33:42 juju-e4d256-prod-github-runner-207 kernel: [72596.611443] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:33:42 juju-e4d256-prod-github-runner-207 kernel: [72596.612168] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:33:42 juju-e4d256-prod-github-runner-207 kernel: [72596.612893] ? do_syscall_64+0x69/0xc0 Aug 23 01:33:42 juju-e4d256-prod-github-runner-207 kernel: [72596.613559] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:33:42 juju-e4d256-prod-github-runner-207 kernel: [72596.614281] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:33:42 juju-e4d256-prod-github-runner-207 kernel: [72596.614980] ? do_syscall_64+0x69/0xc0 Aug 23 01:33:42 juju-e4d256-prod-github-runner-207 kernel: [72596.615604] ? do_syscall_64+0x69/0xc0 Aug 23 01:33:42 juju-e4d256-prod-github-runner-207 kernel: [72596.616225] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 01:33:42 juju-e4d256-prod-github-runner-207 kernel: [72596.616947] RIP: 0033:0x7faa5d0edaff Aug 23 01:33:42 juju-e4d256-prod-github-runner-207 kernel: [72596.617585] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 01:33:42 juju-e4d256-prod-github-runner-207 kernel: [72596.619616] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 01:33:42 juju-e4d256-prod-github-runner-207 kernel: [72596.620536] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 01:33:42 juju-e4d256-prod-github-runner-207 kernel: [72596.621465] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 01:33:42 juju-e4d256-prod-github-runner-207 kernel: [72596.622359] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 01:33:42 juju-e4d256-prod-github-runner-207 kernel: [72596.623255] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 01:33:42 juju-e4d256-prod-github-runner-207 kernel: [72596.624151] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 01:33:42 juju-e4d256-prod-github-runner-207 kernel: [72596.625080] Aug 23 01:34:10 juju-e4d256-prod-github-runner-207 kernel: [72624.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 67528s! [qemu-system-x86:6715] Aug 23 01:34:10 juju-e4d256-prod-github-runner-207 kernel: [72624.543730] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 01:34:10 juju-e4d256-prod-github-runner-207 kernel: [72624.543997] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 01:34:10 juju-e4d256-prod-github-runner-207 kernel: [72624.556278] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 01:34:10 juju-e4d256-prod-github-runner-207 kernel: [72624.557579] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 01:34:10 juju-e4d256-prod-github-runner-207 kernel: [72624.558953] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:34:10 juju-e4d256-prod-github-runner-207 kernel: [72624.560041] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 01:34:10 juju-e4d256-prod-github-runner-207 kernel: [72624.562619] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 01:34:10 juju-e4d256-prod-github-runner-207 kernel: [72624.563662] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 01:34:10 juju-e4d256-prod-github-runner-207 kernel: [72624.564853] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 01:34:10 juju-e4d256-prod-github-runner-207 kernel: [72624.566068] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 01:34:10 juju-e4d256-prod-github-runner-207 kernel: [72624.567236] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 01:34:10 juju-e4d256-prod-github-runner-207 kernel: [72624.568397] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 01:34:10 juju-e4d256-prod-github-runner-207 kernel: [72624.569616] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 01:34:10 juju-e4d256-prod-github-runner-207 kernel: [72624.570870] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 01:34:10 juju-e4d256-prod-github-runner-207 kernel: [72624.571993] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 01:34:10 juju-e4d256-prod-github-runner-207 kernel: [72624.573212] Call Trace: Aug 23 01:34:10 juju-e4d256-prod-github-runner-207 kernel: [72624.574142] Aug 23 01:34:10 juju-e4d256-prod-github-runner-207 kernel: [72624.575081] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:34:10 juju-e4d256-prod-github-runner-207 kernel: [72624.576165] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:34:10 juju-e4d256-prod-github-runner-207 kernel: [72624.577212] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:34:10 juju-e4d256-prod-github-runner-207 kernel: [72624.578309] ? show_regs.part.0+0x23/0x29 Aug 23 01:34:10 juju-e4d256-prod-github-runner-207 kernel: [72624.579307] ? show_regs.cold+0x8/0xd Aug 23 01:34:10 juju-e4d256-prod-github-runner-207 kernel: [72624.580288] ? watchdog_timer_fn+0x1be/0x220 Aug 23 01:34:10 juju-e4d256-prod-github-runner-207 kernel: [72624.581340] ? lockup_detector_update_enable+0x60/0x60 Aug 23 01:34:10 juju-e4d256-prod-github-runner-207 kernel: [72624.582411] ? __hrtimer_run_queues+0x107/0x230 Aug 23 01:34:10 juju-e4d256-prod-github-runner-207 kernel: [72624.583447] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 01:34:10 juju-e4d256-prod-github-runner-207 kernel: [72624.584483] ? hrtimer_interrupt+0x101/0x220 Aug 23 01:34:10 juju-e4d256-prod-github-runner-207 kernel: [72624.585540] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 01:34:10 juju-e4d256-prod-github-runner-207 kernel: [72624.586657] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 01:34:10 juju-e4d256-prod-github-runner-207 kernel: [72624.587727] Aug 23 01:34:10 juju-e4d256-prod-github-runner-207 kernel: [72624.588602] Aug 23 01:34:10 juju-e4d256-prod-github-runner-207 kernel: [72624.589466] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 01:34:10 juju-e4d256-prod-github-runner-207 kernel: [72624.590521] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:34:10 juju-e4d256-prod-github-runner-207 kernel: [72624.591588] ? _raw_spin_lock+0x22/0x30 Aug 23 01:34:10 juju-e4d256-prod-github-runner-207 kernel: [72624.592537] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:34:10 juju-e4d256-prod-github-runner-207 kernel: [72624.593584] direct_page_fault+0x206/0x310 [kvm] Aug 23 01:34:10 juju-e4d256-prod-github-runner-207 kernel: [72624.594620] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 01:34:10 juju-e4d256-prod-github-runner-207 kernel: [72624.595640] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 01:34:10 juju-e4d256-prod-github-runner-207 kernel: [72624.596686] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 01:34:10 juju-e4d256-prod-github-runner-207 kernel: [72624.597701] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 01:34:10 juju-e4d256-prod-github-runner-207 kernel: [72624.598653] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 01:34:10 juju-e4d256-prod-github-runner-207 kernel: [72624.599637] handle_exit+0x98/0x230 [kvm_amd] Aug 23 01:34:10 juju-e4d256-prod-github-runner-207 kernel: [72624.600540] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 01:34:10 juju-e4d256-prod-github-runner-207 kernel: [72624.601547] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 01:34:10 juju-e4d256-prod-github-runner-207 kernel: [72624.602482] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 01:34:10 juju-e4d256-prod-github-runner-207 kernel: [72624.603390] vcpu_run+0x62/0x2c0 [kvm] Aug 23 01:34:10 juju-e4d256-prod-github-runner-207 kernel: [72624.604206] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 01:34:10 juju-e4d256-prod-github-runner-207 kernel: [72624.605048] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 01:34:10 juju-e4d256-prod-github-runner-207 kernel: [72624.605918] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 01:34:10 juju-e4d256-prod-github-runner-207 kernel: [72624.606745] ? __seccomp_filter+0x4a/0x4a0 Aug 23 01:34:10 juju-e4d256-prod-github-runner-207 kernel: [72624.607495] ? __fget_files+0x86/0xc0 Aug 23 01:34:10 juju-e4d256-prod-github-runner-207 kernel: [72624.608206] __x64_sys_ioctl+0x95/0xd0 Aug 23 01:34:10 juju-e4d256-prod-github-runner-207 kernel: [72624.608918] do_syscall_64+0x5c/0xc0 Aug 23 01:34:10 juju-e4d256-prod-github-runner-207 kernel: [72624.609589] ? do_futex+0x162/0x1f0 Aug 23 01:34:10 juju-e4d256-prod-github-runner-207 kernel: [72624.610239] ? __x64_sys_futex+0x78/0x1e0 Aug 23 01:34:10 juju-e4d256-prod-github-runner-207 kernel: [72624.611085] ? __secure_computing+0xa9/0x120 Aug 23 01:34:10 juju-e4d256-prod-github-runner-207 kernel: [72624.611785] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 01:34:10 juju-e4d256-prod-github-runner-207 kernel: [72624.612568] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:34:10 juju-e4d256-prod-github-runner-207 kernel: [72624.613319] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:34:10 juju-e4d256-prod-github-runner-207 kernel: [72624.614045] ? do_syscall_64+0x69/0xc0 Aug 23 01:34:10 juju-e4d256-prod-github-runner-207 kernel: [72624.614694] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:34:10 juju-e4d256-prod-github-runner-207 kernel: [72624.615528] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:34:10 juju-e4d256-prod-github-runner-207 kernel: [72624.616233] ? do_syscall_64+0x69/0xc0 Aug 23 01:34:10 juju-e4d256-prod-github-runner-207 kernel: [72624.616884] ? do_syscall_64+0x69/0xc0 Aug 23 01:34:10 juju-e4d256-prod-github-runner-207 kernel: [72624.617528] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 01:34:10 juju-e4d256-prod-github-runner-207 kernel: [72624.618237] RIP: 0033:0x7faa5d0edaff Aug 23 01:34:10 juju-e4d256-prod-github-runner-207 kernel: [72624.618885] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 01:34:10 juju-e4d256-prod-github-runner-207 kernel: [72624.620903] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 01:34:10 juju-e4d256-prod-github-runner-207 kernel: [72624.621829] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 01:34:10 juju-e4d256-prod-github-runner-207 kernel: [72624.622732] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 01:34:10 juju-e4d256-prod-github-runner-207 kernel: [72624.623627] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 01:34:10 juju-e4d256-prod-github-runner-207 kernel: [72624.624514] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 01:34:10 juju-e4d256-prod-github-runner-207 kernel: [72624.625426] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 01:34:10 juju-e4d256-prod-github-runner-207 kernel: [72624.626327] Aug 23 01:34:38 juju-e4d256-prod-github-runner-207 kernel: [72652.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 67554s! [qemu-system-x86:6715] Aug 23 01:34:38 juju-e4d256-prod-github-runner-207 kernel: [72652.543101] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 01:34:38 juju-e4d256-prod-github-runner-207 kernel: [72652.543172] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 01:34:38 juju-e4d256-prod-github-runner-207 kernel: [72652.555390] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 01:34:38 juju-e4d256-prod-github-runner-207 kernel: [72652.556692] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 01:34:38 juju-e4d256-prod-github-runner-207 kernel: [72652.557925] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:34:38 juju-e4d256-prod-github-runner-207 kernel: [72652.558983] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 01:34:38 juju-e4d256-prod-github-runner-207 kernel: [72652.561544] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 01:34:38 juju-e4d256-prod-github-runner-207 kernel: [72652.562649] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 01:34:38 juju-e4d256-prod-github-runner-207 kernel: [72652.563820] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 01:34:38 juju-e4d256-prod-github-runner-207 kernel: [72652.565008] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 01:34:38 juju-e4d256-prod-github-runner-207 kernel: [72652.566172] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 01:34:38 juju-e4d256-prod-github-runner-207 kernel: [72652.567339] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 01:34:38 juju-e4d256-prod-github-runner-207 kernel: [72652.568527] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 01:34:38 juju-e4d256-prod-github-runner-207 kernel: [72652.569791] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 01:34:38 juju-e4d256-prod-github-runner-207 kernel: [72652.570968] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 01:34:38 juju-e4d256-prod-github-runner-207 kernel: [72652.572175] Call Trace: Aug 23 01:34:38 juju-e4d256-prod-github-runner-207 kernel: [72652.573108] Aug 23 01:34:38 juju-e4d256-prod-github-runner-207 kernel: [72652.573994] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:34:38 juju-e4d256-prod-github-runner-207 kernel: [72652.575024] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:34:38 juju-e4d256-prod-github-runner-207 kernel: [72652.576047] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:34:38 juju-e4d256-prod-github-runner-207 kernel: [72652.577208] ? show_regs.part.0+0x23/0x29 Aug 23 01:34:38 juju-e4d256-prod-github-runner-207 kernel: [72652.578210] ? show_regs.cold+0x8/0xd Aug 23 01:34:38 juju-e4d256-prod-github-runner-207 kernel: [72652.579183] ? watchdog_timer_fn+0x1be/0x220 Aug 23 01:34:38 juju-e4d256-prod-github-runner-207 kernel: [72652.580252] ? lockup_detector_update_enable+0x60/0x60 Aug 23 01:34:38 juju-e4d256-prod-github-runner-207 kernel: [72652.581338] ? __hrtimer_run_queues+0x107/0x230 Aug 23 01:34:38 juju-e4d256-prod-github-runner-207 kernel: [72652.582421] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 01:34:38 juju-e4d256-prod-github-runner-207 kernel: [72652.583459] ? hrtimer_interrupt+0x101/0x220 Aug 23 01:34:38 juju-e4d256-prod-github-runner-207 kernel: [72652.584502] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 01:34:38 juju-e4d256-prod-github-runner-207 kernel: [72652.585606] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 01:34:38 juju-e4d256-prod-github-runner-207 kernel: [72652.586663] Aug 23 01:34:38 juju-e4d256-prod-github-runner-207 kernel: [72652.587517] Aug 23 01:34:38 juju-e4d256-prod-github-runner-207 kernel: [72652.588366] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 01:34:38 juju-e4d256-prod-github-runner-207 kernel: [72652.589399] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:34:38 juju-e4d256-prod-github-runner-207 kernel: [72652.590516] ? _raw_spin_lock+0x22/0x30 Aug 23 01:34:38 juju-e4d256-prod-github-runner-207 kernel: [72652.591473] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:34:38 juju-e4d256-prod-github-runner-207 kernel: [72652.592512] direct_page_fault+0x206/0x310 [kvm] Aug 23 01:34:38 juju-e4d256-prod-github-runner-207 kernel: [72652.593541] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 01:34:38 juju-e4d256-prod-github-runner-207 kernel: [72652.594555] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 01:34:38 juju-e4d256-prod-github-runner-207 kernel: [72652.595557] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 01:34:38 juju-e4d256-prod-github-runner-207 kernel: [72652.596554] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 01:34:38 juju-e4d256-prod-github-runner-207 kernel: [72652.597548] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 01:34:38 juju-e4d256-prod-github-runner-207 kernel: [72652.598535] handle_exit+0x98/0x230 [kvm_amd] Aug 23 01:34:38 juju-e4d256-prod-github-runner-207 kernel: [72652.599437] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 01:34:38 juju-e4d256-prod-github-runner-207 kernel: [72652.600380] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 01:34:38 juju-e4d256-prod-github-runner-207 kernel: [72652.601308] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 01:34:38 juju-e4d256-prod-github-runner-207 kernel: [72652.602219] vcpu_run+0x62/0x2c0 [kvm] Aug 23 01:34:38 juju-e4d256-prod-github-runner-207 kernel: [72652.603032] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 01:34:38 juju-e4d256-prod-github-runner-207 kernel: [72652.603842] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 01:34:38 juju-e4d256-prod-github-runner-207 kernel: [72652.604714] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 01:34:38 juju-e4d256-prod-github-runner-207 kernel: [72652.605520] ? __seccomp_filter+0x4a/0x4a0 Aug 23 01:34:38 juju-e4d256-prod-github-runner-207 kernel: [72652.606311] ? __fget_files+0x86/0xc0 Aug 23 01:34:38 juju-e4d256-prod-github-runner-207 kernel: [72652.607056] __x64_sys_ioctl+0x95/0xd0 Aug 23 01:34:38 juju-e4d256-prod-github-runner-207 kernel: [72652.607757] do_syscall_64+0x5c/0xc0 Aug 23 01:34:38 juju-e4d256-prod-github-runner-207 kernel: [72652.608445] ? do_futex+0x162/0x1f0 Aug 23 01:34:38 juju-e4d256-prod-github-runner-207 kernel: [72652.609096] ? __x64_sys_futex+0x78/0x1e0 Aug 23 01:34:38 juju-e4d256-prod-github-runner-207 kernel: [72652.609773] ? __secure_computing+0xa9/0x120 Aug 23 01:34:38 juju-e4d256-prod-github-runner-207 kernel: [72652.610464] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 01:34:38 juju-e4d256-prod-github-runner-207 kernel: [72652.611226] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:34:38 juju-e4d256-prod-github-runner-207 kernel: [72652.611953] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:34:38 juju-e4d256-prod-github-runner-207 kernel: [72652.612701] ? do_syscall_64+0x69/0xc0 Aug 23 01:34:38 juju-e4d256-prod-github-runner-207 kernel: [72652.613357] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:34:38 juju-e4d256-prod-github-runner-207 kernel: [72652.614069] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:34:38 juju-e4d256-prod-github-runner-207 kernel: [72652.614770] ? do_syscall_64+0x69/0xc0 Aug 23 01:34:38 juju-e4d256-prod-github-runner-207 kernel: [72652.615429] ? do_syscall_64+0x69/0xc0 Aug 23 01:34:38 juju-e4d256-prod-github-runner-207 kernel: [72652.616054] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 01:34:38 juju-e4d256-prod-github-runner-207 kernel: [72652.616773] RIP: 0033:0x7faa5d0edaff Aug 23 01:34:38 juju-e4d256-prod-github-runner-207 kernel: [72652.617414] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 01:34:38 juju-e4d256-prod-github-runner-207 kernel: [72652.619410] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 01:34:38 juju-e4d256-prod-github-runner-207 kernel: [72652.620349] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 01:34:38 juju-e4d256-prod-github-runner-207 kernel: [72652.621259] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 01:34:38 juju-e4d256-prod-github-runner-207 kernel: [72652.622153] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 01:34:38 juju-e4d256-prod-github-runner-207 kernel: [72652.623063] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 01:34:38 juju-e4d256-prod-github-runner-207 kernel: [72652.624032] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 01:34:38 juju-e4d256-prod-github-runner-207 kernel: [72652.624943] Aug 23 01:35:06 juju-e4d256-prod-github-runner-207 kernel: [72680.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 67581s! [qemu-system-x86:6715] Aug 23 01:35:06 juju-e4d256-prod-github-runner-207 kernel: [72680.543105] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 01:35:06 juju-e4d256-prod-github-runner-207 kernel: [72680.543177] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 01:35:06 juju-e4d256-prod-github-runner-207 kernel: [72680.555583] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 01:35:06 juju-e4d256-prod-github-runner-207 kernel: [72680.556865] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 01:35:06 juju-e4d256-prod-github-runner-207 kernel: [72680.558087] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:35:06 juju-e4d256-prod-github-runner-207 kernel: [72680.559145] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 01:35:06 juju-e4d256-prod-github-runner-207 kernel: [72680.561729] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 01:35:06 juju-e4d256-prod-github-runner-207 kernel: [72680.562777] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 01:35:06 juju-e4d256-prod-github-runner-207 kernel: [72680.563937] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 01:35:06 juju-e4d256-prod-github-runner-207 kernel: [72680.565105] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 01:35:06 juju-e4d256-prod-github-runner-207 kernel: [72680.566268] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 01:35:06 juju-e4d256-prod-github-runner-207 kernel: [72680.567434] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 01:35:06 juju-e4d256-prod-github-runner-207 kernel: [72680.568621] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 01:35:06 juju-e4d256-prod-github-runner-207 kernel: [72680.569856] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 01:35:06 juju-e4d256-prod-github-runner-207 kernel: [72680.570974] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 01:35:06 juju-e4d256-prod-github-runner-207 kernel: [72680.572205] Call Trace: Aug 23 01:35:06 juju-e4d256-prod-github-runner-207 kernel: [72680.573121] Aug 23 01:35:06 juju-e4d256-prod-github-runner-207 kernel: [72680.574010] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:35:06 juju-e4d256-prod-github-runner-207 kernel: [72680.575046] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:35:06 juju-e4d256-prod-github-runner-207 kernel: [72680.576088] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:35:06 juju-e4d256-prod-github-runner-207 kernel: [72680.577172] ? show_regs.part.0+0x23/0x29 Aug 23 01:35:06 juju-e4d256-prod-github-runner-207 kernel: [72680.578170] ? show_regs.cold+0x8/0xd Aug 23 01:35:06 juju-e4d256-prod-github-runner-207 kernel: [72680.579142] ? watchdog_timer_fn+0x1be/0x220 Aug 23 01:35:06 juju-e4d256-prod-github-runner-207 kernel: [72680.580167] ? lockup_detector_update_enable+0x60/0x60 Aug 23 01:35:06 juju-e4d256-prod-github-runner-207 kernel: [72680.581333] ? __hrtimer_run_queues+0x107/0x230 Aug 23 01:35:06 juju-e4d256-prod-github-runner-207 kernel: [72680.582376] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 01:35:06 juju-e4d256-prod-github-runner-207 kernel: [72680.583402] ? hrtimer_interrupt+0x101/0x220 Aug 23 01:35:06 juju-e4d256-prod-github-runner-207 kernel: [72680.584442] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 01:35:06 juju-e4d256-prod-github-runner-207 kernel: [72680.585511] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 01:35:06 juju-e4d256-prod-github-runner-207 kernel: [72680.586555] Aug 23 01:35:06 juju-e4d256-prod-github-runner-207 kernel: [72680.587407] Aug 23 01:35:06 juju-e4d256-prod-github-runner-207 kernel: [72680.588257] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 01:35:06 juju-e4d256-prod-github-runner-207 kernel: [72680.589289] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:35:06 juju-e4d256-prod-github-runner-207 kernel: [72680.590331] ? _raw_spin_lock+0x22/0x30 Aug 23 01:35:06 juju-e4d256-prod-github-runner-207 kernel: [72680.591294] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:35:06 juju-e4d256-prod-github-runner-207 kernel: [72680.592333] direct_page_fault+0x206/0x310 [kvm] Aug 23 01:35:06 juju-e4d256-prod-github-runner-207 kernel: [72680.593365] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 01:35:06 juju-e4d256-prod-github-runner-207 kernel: [72680.594375] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 01:35:06 juju-e4d256-prod-github-runner-207 kernel: [72680.595377] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 01:35:06 juju-e4d256-prod-github-runner-207 kernel: [72680.596358] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 01:35:06 juju-e4d256-prod-github-runner-207 kernel: [72680.597311] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 01:35:06 juju-e4d256-prod-github-runner-207 kernel: [72680.598297] handle_exit+0x98/0x230 [kvm_amd] Aug 23 01:35:06 juju-e4d256-prod-github-runner-207 kernel: [72680.599192] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 01:35:06 juju-e4d256-prod-github-runner-207 kernel: [72680.600122] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 01:35:06 juju-e4d256-prod-github-runner-207 kernel: [72680.601048] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 01:35:06 juju-e4d256-prod-github-runner-207 kernel: [72680.601987] vcpu_run+0x62/0x2c0 [kvm] Aug 23 01:35:06 juju-e4d256-prod-github-runner-207 kernel: [72680.602804] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 01:35:06 juju-e4d256-prod-github-runner-207 kernel: [72680.603619] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 01:35:06 juju-e4d256-prod-github-runner-207 kernel: [72680.604549] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 01:35:06 juju-e4d256-prod-github-runner-207 kernel: [72680.605350] ? __seccomp_filter+0x4a/0x4a0 Aug 23 01:35:06 juju-e4d256-prod-github-runner-207 kernel: [72680.606096] ? __fget_files+0x86/0xc0 Aug 23 01:35:06 juju-e4d256-prod-github-runner-207 kernel: [72680.606801] __x64_sys_ioctl+0x95/0xd0 Aug 23 01:35:06 juju-e4d256-prod-github-runner-207 kernel: [72680.607495] do_syscall_64+0x5c/0xc0 Aug 23 01:35:06 juju-e4d256-prod-github-runner-207 kernel: [72680.608183] ? do_futex+0x162/0x1f0 Aug 23 01:35:06 juju-e4d256-prod-github-runner-207 kernel: [72680.608834] ? __x64_sys_futex+0x78/0x1e0 Aug 23 01:35:06 juju-e4d256-prod-github-runner-207 kernel: [72680.609514] ? __secure_computing+0xa9/0x120 Aug 23 01:35:06 juju-e4d256-prod-github-runner-207 kernel: [72680.610206] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 01:35:06 juju-e4d256-prod-github-runner-207 kernel: [72680.610966] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:35:06 juju-e4d256-prod-github-runner-207 kernel: [72680.611701] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:35:06 juju-e4d256-prod-github-runner-207 kernel: [72680.612455] ? do_syscall_64+0x69/0xc0 Aug 23 01:35:06 juju-e4d256-prod-github-runner-207 kernel: [72680.613104] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:35:06 juju-e4d256-prod-github-runner-207 kernel: [72680.613810] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:35:06 juju-e4d256-prod-github-runner-207 kernel: [72680.614504] ? do_syscall_64+0x69/0xc0 Aug 23 01:35:06 juju-e4d256-prod-github-runner-207 kernel: [72680.615131] ? do_syscall_64+0x69/0xc0 Aug 23 01:35:06 juju-e4d256-prod-github-runner-207 kernel: [72680.615752] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 01:35:06 juju-e4d256-prod-github-runner-207 kernel: [72680.616468] RIP: 0033:0x7faa5d0edaff Aug 23 01:35:06 juju-e4d256-prod-github-runner-207 kernel: [72680.617093] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 01:35:06 juju-e4d256-prod-github-runner-207 kernel: [72680.619079] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 01:35:06 juju-e4d256-prod-github-runner-207 kernel: [72680.620005] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 01:35:06 juju-e4d256-prod-github-runner-207 kernel: [72680.620894] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 01:35:06 juju-e4d256-prod-github-runner-207 kernel: [72680.621784] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 01:35:06 juju-e4d256-prod-github-runner-207 kernel: [72680.622692] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 01:35:06 juju-e4d256-prod-github-runner-207 kernel: [72680.623584] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 01:35:06 juju-e4d256-prod-github-runner-207 kernel: [72680.624507] Aug 23 01:35:34 juju-e4d256-prod-github-runner-207 kernel: [72708.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 67607s! [qemu-system-x86:6715] Aug 23 01:35:34 juju-e4d256-prod-github-runner-207 kernel: [72708.543130] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 01:35:34 juju-e4d256-prod-github-runner-207 kernel: [72708.543198] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 01:35:34 juju-e4d256-prod-github-runner-207 kernel: [72708.555317] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 01:35:34 juju-e4d256-prod-github-runner-207 kernel: [72708.556590] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 01:35:34 juju-e4d256-prod-github-runner-207 kernel: [72708.557812] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:35:34 juju-e4d256-prod-github-runner-207 kernel: [72708.558888] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 01:35:34 juju-e4d256-prod-github-runner-207 kernel: [72708.561447] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 01:35:34 juju-e4d256-prod-github-runner-207 kernel: [72708.562488] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 01:35:34 juju-e4d256-prod-github-runner-207 kernel: [72708.563662] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 01:35:34 juju-e4d256-prod-github-runner-207 kernel: [72708.564834] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 01:35:34 juju-e4d256-prod-github-runner-207 kernel: [72708.566001] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 01:35:34 juju-e4d256-prod-github-runner-207 kernel: [72708.567176] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 01:35:34 juju-e4d256-prod-github-runner-207 kernel: [72708.568360] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 01:35:34 juju-e4d256-prod-github-runner-207 kernel: [72708.569604] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 01:35:34 juju-e4d256-prod-github-runner-207 kernel: [72708.570701] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 01:35:34 juju-e4d256-prod-github-runner-207 kernel: [72708.571899] Call Trace: Aug 23 01:35:34 juju-e4d256-prod-github-runner-207 kernel: [72708.572812] Aug 23 01:35:34 juju-e4d256-prod-github-runner-207 kernel: [72708.573696] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:35:34 juju-e4d256-prod-github-runner-207 kernel: [72708.574733] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:35:34 juju-e4d256-prod-github-runner-207 kernel: [72708.575777] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:35:34 juju-e4d256-prod-github-runner-207 kernel: [72708.576854] ? show_regs.part.0+0x23/0x29 Aug 23 01:35:34 juju-e4d256-prod-github-runner-207 kernel: [72708.577852] ? show_regs.cold+0x8/0xd Aug 23 01:35:34 juju-e4d256-prod-github-runner-207 kernel: [72708.578828] ? watchdog_timer_fn+0x1be/0x220 Aug 23 01:35:34 juju-e4d256-prod-github-runner-207 kernel: [72708.579860] ? lockup_detector_update_enable+0x60/0x60 Aug 23 01:35:34 juju-e4d256-prod-github-runner-207 kernel: [72708.580926] ? __hrtimer_run_queues+0x107/0x230 Aug 23 01:35:34 juju-e4d256-prod-github-runner-207 kernel: [72708.581961] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 01:35:34 juju-e4d256-prod-github-runner-207 kernel: [72708.582984] ? hrtimer_interrupt+0x101/0x220 Aug 23 01:35:34 juju-e4d256-prod-github-runner-207 kernel: [72708.584010] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 01:35:34 juju-e4d256-prod-github-runner-207 kernel: [72708.585088] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 01:35:34 juju-e4d256-prod-github-runner-207 kernel: [72708.586141] Aug 23 01:35:34 juju-e4d256-prod-github-runner-207 kernel: [72708.586993] Aug 23 01:35:34 juju-e4d256-prod-github-runner-207 kernel: [72708.587843] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 01:35:34 juju-e4d256-prod-github-runner-207 kernel: [72708.588879] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:35:34 juju-e4d256-prod-github-runner-207 kernel: [72708.589943] ? _raw_spin_lock+0x22/0x30 Aug 23 01:35:34 juju-e4d256-prod-github-runner-207 kernel: [72708.590893] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:35:34 juju-e4d256-prod-github-runner-207 kernel: [72708.591921] direct_page_fault+0x206/0x310 [kvm] Aug 23 01:35:34 juju-e4d256-prod-github-runner-207 kernel: [72708.592952] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 01:35:34 juju-e4d256-prod-github-runner-207 kernel: [72708.593961] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 01:35:34 juju-e4d256-prod-github-runner-207 kernel: [72708.594976] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 01:35:34 juju-e4d256-prod-github-runner-207 kernel: [72708.595967] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 01:35:34 juju-e4d256-prod-github-runner-207 kernel: [72708.596917] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 01:35:34 juju-e4d256-prod-github-runner-207 kernel: [72708.597903] handle_exit+0x98/0x230 [kvm_amd] Aug 23 01:35:34 juju-e4d256-prod-github-runner-207 kernel: [72708.598795] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 01:35:34 juju-e4d256-prod-github-runner-207 kernel: [72708.599729] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 01:35:34 juju-e4d256-prod-github-runner-207 kernel: [72708.600662] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 01:35:34 juju-e4d256-prod-github-runner-207 kernel: [72708.601599] vcpu_run+0x62/0x2c0 [kvm] Aug 23 01:35:34 juju-e4d256-prod-github-runner-207 kernel: [72708.602409] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 01:35:34 juju-e4d256-prod-github-runner-207 kernel: [72708.603218] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 01:35:34 juju-e4d256-prod-github-runner-207 kernel: [72708.604086] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 01:35:34 juju-e4d256-prod-github-runner-207 kernel: [72708.604893] ? __seccomp_filter+0x4a/0x4a0 Aug 23 01:35:34 juju-e4d256-prod-github-runner-207 kernel: [72708.605644] ? __fget_files+0x86/0xc0 Aug 23 01:35:34 juju-e4d256-prod-github-runner-207 kernel: [72708.606349] __x64_sys_ioctl+0x95/0xd0 Aug 23 01:35:34 juju-e4d256-prod-github-runner-207 kernel: [72708.607041] do_syscall_64+0x5c/0xc0 Aug 23 01:35:34 juju-e4d256-prod-github-runner-207 kernel: [72708.607785] ? do_futex+0x162/0x1f0 Aug 23 01:35:34 juju-e4d256-prod-github-runner-207 kernel: [72708.608435] ? __x64_sys_futex+0x78/0x1e0 Aug 23 01:35:34 juju-e4d256-prod-github-runner-207 kernel: [72708.609109] ? __secure_computing+0xa9/0x120 Aug 23 01:35:34 juju-e4d256-prod-github-runner-207 kernel: [72708.609800] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 01:35:34 juju-e4d256-prod-github-runner-207 kernel: [72708.610584] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:35:34 juju-e4d256-prod-github-runner-207 kernel: [72708.611308] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:35:34 juju-e4d256-prod-github-runner-207 kernel: [72708.612035] ? do_syscall_64+0x69/0xc0 Aug 23 01:35:34 juju-e4d256-prod-github-runner-207 kernel: [72708.612681] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:35:34 juju-e4d256-prod-github-runner-207 kernel: [72708.613387] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:35:34 juju-e4d256-prod-github-runner-207 kernel: [72708.614089] ? do_syscall_64+0x69/0xc0 Aug 23 01:35:34 juju-e4d256-prod-github-runner-207 kernel: [72708.614714] ? do_syscall_64+0x69/0xc0 Aug 23 01:35:34 juju-e4d256-prod-github-runner-207 kernel: [72708.615355] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 01:35:34 juju-e4d256-prod-github-runner-207 kernel: [72708.616076] RIP: 0033:0x7faa5d0edaff Aug 23 01:35:34 juju-e4d256-prod-github-runner-207 kernel: [72708.616704] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 01:35:34 juju-e4d256-prod-github-runner-207 kernel: [72708.618688] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 01:35:34 juju-e4d256-prod-github-runner-207 kernel: [72708.619603] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 01:35:34 juju-e4d256-prod-github-runner-207 kernel: [72708.620508] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 01:35:34 juju-e4d256-prod-github-runner-207 kernel: [72708.621403] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 01:35:34 juju-e4d256-prod-github-runner-207 kernel: [72708.622294] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 01:35:34 juju-e4d256-prod-github-runner-207 kernel: [72708.623189] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 01:35:34 juju-e4d256-prod-github-runner-207 kernel: [72708.624090] Aug 23 01:35:48 juju-e4d256-prod-github-runner-207 kernel: [72722.036706] rcu: INFO: rcu_sched self-detected stall on CPU Aug 23 01:35:48 juju-e4d256-prod-github-runner-207 kernel: [72722.038336] rcu: 1-....: (18094090 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=8741363 Aug 23 01:35:48 juju-e4d256-prod-github-runner-207 kernel: [72722.039464] (t=18151209 jiffies g=23269 q=62107) Aug 23 01:35:48 juju-e4d256-prod-github-runner-207 kernel: [72722.040264] NMI backtrace for cpu 1 Aug 23 01:35:48 juju-e4d256-prod-github-runner-207 kernel: [72722.040979] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 01:35:48 juju-e4d256-prod-github-runner-207 kernel: [72722.042080] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 01:35:48 juju-e4d256-prod-github-runner-207 kernel: [72722.043142] Call Trace: Aug 23 01:35:48 juju-e4d256-prod-github-runner-207 kernel: [72722.043826] Aug 23 01:35:48 juju-e4d256-prod-github-runner-207 kernel: [72722.044481] show_stack+0x52/0x5c Aug 23 01:35:48 juju-e4d256-prod-github-runner-207 kernel: [72722.045210] dump_stack_lvl+0x4a/0x63 Aug 23 01:35:48 juju-e4d256-prod-github-runner-207 kernel: [72722.045955] dump_stack+0x10/0x16 Aug 23 01:35:48 juju-e4d256-prod-github-runner-207 kernel: [72722.046670] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 23 01:35:48 juju-e4d256-prod-github-runner-207 kernel: [72722.047450] ? lapic_can_unplug_cpu+0x90/0x90 Aug 23 01:35:48 juju-e4d256-prod-github-runner-207 kernel: [72722.048238] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 23 01:35:48 juju-e4d256-prod-github-runner-207 kernel: [72722.049058] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 23 01:35:48 juju-e4d256-prod-github-runner-207 kernel: [72722.049878] trigger_single_cpu_backtrace+0x44/0x4f Aug 23 01:35:48 juju-e4d256-prod-github-runner-207 kernel: [72722.050685] rcu_dump_cpu_stacks+0x102/0x149 Aug 23 01:35:48 juju-e4d256-prod-github-runner-207 kernel: [72722.051457] print_cpu_stall.cold+0x2f/0xe2 Aug 23 01:35:48 juju-e4d256-prod-github-runner-207 kernel: [72722.052228] ? timekeeping_update+0xf7/0x150 Aug 23 01:35:48 juju-e4d256-prod-github-runner-207 kernel: [72722.052997] check_cpu_stall+0x109/0x270 Aug 23 01:35:48 juju-e4d256-prod-github-runner-207 kernel: [72722.053747] rcu_sched_clock_irq+0x9a/0x250 Aug 23 01:35:48 juju-e4d256-prod-github-runner-207 kernel: [72722.054506] update_process_times+0x94/0xd0 Aug 23 01:35:48 juju-e4d256-prod-github-runner-207 kernel: [72722.055265] tick_sched_handle+0x29/0x70 Aug 23 01:35:48 juju-e4d256-prod-github-runner-207 kernel: [72722.056022] tick_sched_timer+0x8c/0xc0 Aug 23 01:35:48 juju-e4d256-prod-github-runner-207 kernel: [72722.056764] ? tick_nohz_handler+0xb0/0xb0 Aug 23 01:35:48 juju-e4d256-prod-github-runner-207 kernel: [72722.057520] __hrtimer_run_queues+0x107/0x230 Aug 23 01:35:48 juju-e4d256-prod-github-runner-207 kernel: [72722.058292] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 01:35:48 juju-e4d256-prod-github-runner-207 kernel: [72722.059071] hrtimer_interrupt+0x101/0x220 Aug 23 01:35:48 juju-e4d256-prod-github-runner-207 kernel: [72722.059849] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 01:35:48 juju-e4d256-prod-github-runner-207 kernel: [72722.060662] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 01:35:48 juju-e4d256-prod-github-runner-207 kernel: [72722.061465] Aug 23 01:35:48 juju-e4d256-prod-github-runner-207 kernel: [72722.062102] Aug 23 01:35:48 juju-e4d256-prod-github-runner-207 kernel: [72722.062731] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 01:35:48 juju-e4d256-prod-github-runner-207 kernel: [72722.063568] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:35:48 juju-e4d256-prod-github-runner-207 kernel: [72722.064448] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 01:35:48 juju-e4d256-prod-github-runner-207 kernel: [72722.066656] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 01:35:48 juju-e4d256-prod-github-runner-207 kernel: [72722.068443] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 01:35:48 juju-e4d256-prod-github-runner-207 kernel: [72722.069459] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 01:35:48 juju-e4d256-prod-github-runner-207 kernel: [72722.070440] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 01:35:48 juju-e4d256-prod-github-runner-207 kernel: [72722.071405] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 01:35:48 juju-e4d256-prod-github-runner-207 kernel: [72722.072551] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 01:35:48 juju-e4d256-prod-github-runner-207 kernel: [72722.073514] ? _raw_spin_lock+0x22/0x30 Aug 23 01:35:48 juju-e4d256-prod-github-runner-207 kernel: [72722.074311] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:35:48 juju-e4d256-prod-github-runner-207 kernel: [72722.075163] direct_page_fault+0x206/0x310 [kvm] Aug 23 01:35:48 juju-e4d256-prod-github-runner-207 kernel: [72722.076025] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 01:35:48 juju-e4d256-prod-github-runner-207 kernel: [72722.076857] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 01:35:48 juju-e4d256-prod-github-runner-207 kernel: [72722.077697] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 01:35:48 juju-e4d256-prod-github-runner-207 kernel: [72722.078524] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 01:35:48 juju-e4d256-prod-github-runner-207 kernel: [72722.079307] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 01:35:48 juju-e4d256-prod-github-runner-207 kernel: [72722.080143] handle_exit+0x98/0x230 [kvm_amd] Aug 23 01:35:48 juju-e4d256-prod-github-runner-207 kernel: [72722.080895] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 01:35:48 juju-e4d256-prod-github-runner-207 kernel: [72722.081677] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 01:35:48 juju-e4d256-prod-github-runner-207 kernel: [72722.082477] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 01:35:48 juju-e4d256-prod-github-runner-207 kernel: [72722.083262] vcpu_run+0x62/0x2c0 [kvm] Aug 23 01:35:48 juju-e4d256-prod-github-runner-207 kernel: [72722.083986] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 01:35:48 juju-e4d256-prod-github-runner-207 kernel: [72722.084718] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 01:35:48 juju-e4d256-prod-github-runner-207 kernel: [72722.085519] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 01:35:48 juju-e4d256-prod-github-runner-207 kernel: [72722.086280] ? __seccomp_filter+0x4a/0x4a0 Aug 23 01:35:48 juju-e4d256-prod-github-runner-207 kernel: [72722.086999] ? __fget_files+0x86/0xc0 Aug 23 01:35:48 juju-e4d256-prod-github-runner-207 kernel: [72722.087713] __x64_sys_ioctl+0x95/0xd0 Aug 23 01:35:48 juju-e4d256-prod-github-runner-207 kernel: [72722.088419] do_syscall_64+0x5c/0xc0 Aug 23 01:35:48 juju-e4d256-prod-github-runner-207 kernel: [72722.089103] ? do_futex+0x162/0x1f0 Aug 23 01:35:48 juju-e4d256-prod-github-runner-207 kernel: [72722.089775] ? __x64_sys_futex+0x78/0x1e0 Aug 23 01:35:48 juju-e4d256-prod-github-runner-207 kernel: [72722.090474] ? __secure_computing+0xa9/0x120 Aug 23 01:35:48 juju-e4d256-prod-github-runner-207 kernel: [72722.091194] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 01:35:48 juju-e4d256-prod-github-runner-207 kernel: [72722.092008] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:35:48 juju-e4d256-prod-github-runner-207 kernel: [72722.092767] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:35:48 juju-e4d256-prod-github-runner-207 kernel: [72722.093526] ? do_syscall_64+0x69/0xc0 Aug 23 01:35:48 juju-e4d256-prod-github-runner-207 kernel: [72722.094239] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:35:48 juju-e4d256-prod-github-runner-207 kernel: [72722.094991] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:35:48 juju-e4d256-prod-github-runner-207 kernel: [72722.095759] ? do_syscall_64+0x69/0xc0 Aug 23 01:35:48 juju-e4d256-prod-github-runner-207 kernel: [72722.096451] ? do_syscall_64+0x69/0xc0 Aug 23 01:35:48 juju-e4d256-prod-github-runner-207 kernel: [72722.097138] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 01:35:48 juju-e4d256-prod-github-runner-207 kernel: [72722.097907] RIP: 0033:0x7faa5d0edaff Aug 23 01:35:48 juju-e4d256-prod-github-runner-207 kernel: [72722.098611] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 01:35:48 juju-e4d256-prod-github-runner-207 kernel: [72722.100710] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 01:35:48 juju-e4d256-prod-github-runner-207 kernel: [72722.101674] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 01:35:48 juju-e4d256-prod-github-runner-207 kernel: [72722.102622] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 01:35:48 juju-e4d256-prod-github-runner-207 kernel: [72722.103581] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 01:35:48 juju-e4d256-prod-github-runner-207 kernel: [72722.104525] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 01:35:48 juju-e4d256-prod-github-runner-207 kernel: [72722.105451] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 01:35:48 juju-e4d256-prod-github-runner-207 kernel: [72722.106364] Aug 23 01:36:14 juju-e4d256-prod-github-runner-207 kernel: [72748.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 67644s! [qemu-system-x86:6715] Aug 23 01:36:14 juju-e4d256-prod-github-runner-207 kernel: [72748.543123] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 01:36:14 juju-e4d256-prod-github-runner-207 kernel: [72748.543448] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 01:36:14 juju-e4d256-prod-github-runner-207 kernel: [72748.556528] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 01:36:14 juju-e4d256-prod-github-runner-207 kernel: [72748.557798] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 01:36:14 juju-e4d256-prod-github-runner-207 kernel: [72748.559017] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:36:14 juju-e4d256-prod-github-runner-207 kernel: [72748.560082] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 01:36:14 juju-e4d256-prod-github-runner-207 kernel: [72748.562634] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 01:36:14 juju-e4d256-prod-github-runner-207 kernel: [72748.563694] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 01:36:14 juju-e4d256-prod-github-runner-207 kernel: [72748.564860] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 01:36:14 juju-e4d256-prod-github-runner-207 kernel: [72748.566020] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 01:36:14 juju-e4d256-prod-github-runner-207 kernel: [72748.567185] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 01:36:14 juju-e4d256-prod-github-runner-207 kernel: [72748.568358] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 01:36:14 juju-e4d256-prod-github-runner-207 kernel: [72748.569527] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 01:36:14 juju-e4d256-prod-github-runner-207 kernel: [72748.570759] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 01:36:14 juju-e4d256-prod-github-runner-207 kernel: [72748.571875] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 01:36:14 juju-e4d256-prod-github-runner-207 kernel: [72748.573068] Call Trace: Aug 23 01:36:14 juju-e4d256-prod-github-runner-207 kernel: [72748.573980] Aug 23 01:36:14 juju-e4d256-prod-github-runner-207 kernel: [72748.574861] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:36:14 juju-e4d256-prod-github-runner-207 kernel: [72748.575901] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:36:14 juju-e4d256-prod-github-runner-207 kernel: [72748.576926] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:36:14 juju-e4d256-prod-github-runner-207 kernel: [72748.578001] ? show_regs.part.0+0x23/0x29 Aug 23 01:36:14 juju-e4d256-prod-github-runner-207 kernel: [72748.579001] ? show_regs.cold+0x8/0xd Aug 23 01:36:14 juju-e4d256-prod-github-runner-207 kernel: [72748.579982] ? watchdog_timer_fn+0x1be/0x220 Aug 23 01:36:14 juju-e4d256-prod-github-runner-207 kernel: [72748.580993] ? lockup_detector_update_enable+0x60/0x60 Aug 23 01:36:14 juju-e4d256-prod-github-runner-207 kernel: [72748.582061] ? __hrtimer_run_queues+0x107/0x230 Aug 23 01:36:14 juju-e4d256-prod-github-runner-207 kernel: [72748.583086] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 01:36:14 juju-e4d256-prod-github-runner-207 kernel: [72748.584123] ? hrtimer_interrupt+0x101/0x220 Aug 23 01:36:14 juju-e4d256-prod-github-runner-207 kernel: [72748.585137] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 01:36:14 juju-e4d256-prod-github-runner-207 kernel: [72748.586206] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 01:36:14 juju-e4d256-prod-github-runner-207 kernel: [72748.587273] Aug 23 01:36:14 juju-e4d256-prod-github-runner-207 kernel: [72748.588125] Aug 23 01:36:14 juju-e4d256-prod-github-runner-207 kernel: [72748.588965] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 01:36:14 juju-e4d256-prod-github-runner-207 kernel: [72748.589995] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:36:14 juju-e4d256-prod-github-runner-207 kernel: [72748.591033] ? _raw_spin_lock+0x22/0x30 Aug 23 01:36:14 juju-e4d256-prod-github-runner-207 kernel: [72748.591985] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:36:14 juju-e4d256-prod-github-runner-207 kernel: [72748.592999] direct_page_fault+0x206/0x310 [kvm] Aug 23 01:36:14 juju-e4d256-prod-github-runner-207 kernel: [72748.594026] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 01:36:14 juju-e4d256-prod-github-runner-207 kernel: [72748.595032] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 01:36:14 juju-e4d256-prod-github-runner-207 kernel: [72748.596038] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 01:36:14 juju-e4d256-prod-github-runner-207 kernel: [72748.597014] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 01:36:14 juju-e4d256-prod-github-runner-207 kernel: [72748.597963] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 01:36:14 juju-e4d256-prod-github-runner-207 kernel: [72748.598939] handle_exit+0x98/0x230 [kvm_amd] Aug 23 01:36:14 juju-e4d256-prod-github-runner-207 kernel: [72748.599844] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 01:36:14 juju-e4d256-prod-github-runner-207 kernel: [72748.600757] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 01:36:14 juju-e4d256-prod-github-runner-207 kernel: [72748.601680] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 01:36:14 juju-e4d256-prod-github-runner-207 kernel: [72748.602583] vcpu_run+0x62/0x2c0 [kvm] Aug 23 01:36:14 juju-e4d256-prod-github-runner-207 kernel: [72748.603403] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 01:36:14 juju-e4d256-prod-github-runner-207 kernel: [72748.604209] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 01:36:14 juju-e4d256-prod-github-runner-207 kernel: [72748.605063] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 01:36:14 juju-e4d256-prod-github-runner-207 kernel: [72748.605859] ? __seccomp_filter+0x4a/0x4a0 Aug 23 01:36:14 juju-e4d256-prod-github-runner-207 kernel: [72748.606601] ? __fget_files+0x86/0xc0 Aug 23 01:36:14 juju-e4d256-prod-github-runner-207 kernel: [72748.607321] __x64_sys_ioctl+0x95/0xd0 Aug 23 01:36:14 juju-e4d256-prod-github-runner-207 kernel: [72748.608012] do_syscall_64+0x5c/0xc0 Aug 23 01:36:14 juju-e4d256-prod-github-runner-207 kernel: [72748.608675] ? do_futex+0x162/0x1f0 Aug 23 01:36:14 juju-e4d256-prod-github-runner-207 kernel: [72748.609327] ? __x64_sys_futex+0x78/0x1e0 Aug 23 01:36:14 juju-e4d256-prod-github-runner-207 kernel: [72748.609998] ? __secure_computing+0xa9/0x120 Aug 23 01:36:14 juju-e4d256-prod-github-runner-207 kernel: [72748.610685] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 01:36:14 juju-e4d256-prod-github-runner-207 kernel: [72748.611461] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:36:14 juju-e4d256-prod-github-runner-207 kernel: [72748.612188] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:36:14 juju-e4d256-prod-github-runner-207 kernel: [72748.612904] ? do_syscall_64+0x69/0xc0 Aug 23 01:36:14 juju-e4d256-prod-github-runner-207 kernel: [72748.613547] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:36:14 juju-e4d256-prod-github-runner-207 kernel: [72748.614254] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:36:14 juju-e4d256-prod-github-runner-207 kernel: [72748.614947] ? do_syscall_64+0x69/0xc0 Aug 23 01:36:14 juju-e4d256-prod-github-runner-207 kernel: [72748.615579] ? do_syscall_64+0x69/0xc0 Aug 23 01:36:14 juju-e4d256-prod-github-runner-207 kernel: [72748.616201] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 01:36:14 juju-e4d256-prod-github-runner-207 kernel: [72748.616906] RIP: 0033:0x7faa5d0edaff Aug 23 01:36:14 juju-e4d256-prod-github-runner-207 kernel: [72748.617534] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 01:36:14 juju-e4d256-prod-github-runner-207 kernel: [72748.619531] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 01:36:14 juju-e4d256-prod-github-runner-207 kernel: [72748.620451] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 01:36:14 juju-e4d256-prod-github-runner-207 kernel: [72748.621343] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 01:36:14 juju-e4d256-prod-github-runner-207 kernel: [72748.622234] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 01:36:14 juju-e4d256-prod-github-runner-207 kernel: [72748.623125] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 01:36:14 juju-e4d256-prod-github-runner-207 kernel: [72748.624026] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 01:36:14 juju-e4d256-prod-github-runner-207 kernel: [72748.624919] Aug 23 01:36:42 juju-e4d256-prod-github-runner-207 kernel: [72776.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 67670s! [qemu-system-x86:6715] Aug 23 01:36:42 juju-e4d256-prod-github-runner-207 kernel: [72776.543115] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 01:36:42 juju-e4d256-prod-github-runner-207 kernel: [72776.543186] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 01:36:42 juju-e4d256-prod-github-runner-207 kernel: [72776.555276] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 01:36:42 juju-e4d256-prod-github-runner-207 kernel: [72776.556539] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 01:36:42 juju-e4d256-prod-github-runner-207 kernel: [72776.557758] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:36:42 juju-e4d256-prod-github-runner-207 kernel: [72776.558820] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 01:36:42 juju-e4d256-prod-github-runner-207 kernel: [72776.561387] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 01:36:42 juju-e4d256-prod-github-runner-207 kernel: [72776.562429] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 01:36:42 juju-e4d256-prod-github-runner-207 kernel: [72776.563603] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 01:36:42 juju-e4d256-prod-github-runner-207 kernel: [72776.564765] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 01:36:42 juju-e4d256-prod-github-runner-207 kernel: [72776.565928] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 01:36:42 juju-e4d256-prod-github-runner-207 kernel: [72776.567099] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 01:36:42 juju-e4d256-prod-github-runner-207 kernel: [72776.568264] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 01:36:42 juju-e4d256-prod-github-runner-207 kernel: [72776.569495] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 01:36:42 juju-e4d256-prod-github-runner-207 kernel: [72776.570595] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 01:36:42 juju-e4d256-prod-github-runner-207 kernel: [72776.571801] Call Trace: Aug 23 01:36:42 juju-e4d256-prod-github-runner-207 kernel: [72776.572713] Aug 23 01:36:42 juju-e4d256-prod-github-runner-207 kernel: [72776.573597] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:36:42 juju-e4d256-prod-github-runner-207 kernel: [72776.574624] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:36:42 juju-e4d256-prod-github-runner-207 kernel: [72776.575652] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:36:42 juju-e4d256-prod-github-runner-207 kernel: [72776.576732] ? show_regs.part.0+0x23/0x29 Aug 23 01:36:42 juju-e4d256-prod-github-runner-207 kernel: [72776.577728] ? show_regs.cold+0x8/0xd Aug 23 01:36:42 juju-e4d256-prod-github-runner-207 kernel: [72776.578697] ? watchdog_timer_fn+0x1be/0x220 Aug 23 01:36:42 juju-e4d256-prod-github-runner-207 kernel: [72776.579712] ? lockup_detector_update_enable+0x60/0x60 Aug 23 01:36:42 juju-e4d256-prod-github-runner-207 kernel: [72776.580774] ? __hrtimer_run_queues+0x107/0x230 Aug 23 01:36:42 juju-e4d256-prod-github-runner-207 kernel: [72776.581814] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 01:36:42 juju-e4d256-prod-github-runner-207 kernel: [72776.582837] ? hrtimer_interrupt+0x101/0x220 Aug 23 01:36:42 juju-e4d256-prod-github-runner-207 kernel: [72776.583866] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 01:36:42 juju-e4d256-prod-github-runner-207 kernel: [72776.584932] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 01:36:42 juju-e4d256-prod-github-runner-207 kernel: [72776.585982] Aug 23 01:36:42 juju-e4d256-prod-github-runner-207 kernel: [72776.586832] Aug 23 01:36:42 juju-e4d256-prod-github-runner-207 kernel: [72776.587677] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 01:36:42 juju-e4d256-prod-github-runner-207 kernel: [72776.588706] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:36:42 juju-e4d256-prod-github-runner-207 kernel: [72776.589751] ? _raw_spin_lock+0x22/0x30 Aug 23 01:36:42 juju-e4d256-prod-github-runner-207 kernel: [72776.590692] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:36:42 juju-e4d256-prod-github-runner-207 kernel: [72776.591722] direct_page_fault+0x206/0x310 [kvm] Aug 23 01:36:42 juju-e4d256-prod-github-runner-207 kernel: [72776.592749] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 01:36:42 juju-e4d256-prod-github-runner-207 kernel: [72776.593761] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 01:36:42 juju-e4d256-prod-github-runner-207 kernel: [72776.594758] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 01:36:42 juju-e4d256-prod-github-runner-207 kernel: [72776.595740] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 01:36:42 juju-e4d256-prod-github-runner-207 kernel: [72776.596682] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 01:36:42 juju-e4d256-prod-github-runner-207 kernel: [72776.597660] handle_exit+0x98/0x230 [kvm_amd] Aug 23 01:36:42 juju-e4d256-prod-github-runner-207 kernel: [72776.598555] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 01:36:42 juju-e4d256-prod-github-runner-207 kernel: [72776.599483] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 01:36:42 juju-e4d256-prod-github-runner-207 kernel: [72776.600406] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 01:36:42 juju-e4d256-prod-github-runner-207 kernel: [72776.601314] vcpu_run+0x62/0x2c0 [kvm] Aug 23 01:36:42 juju-e4d256-prod-github-runner-207 kernel: [72776.602127] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 01:36:42 juju-e4d256-prod-github-runner-207 kernel: [72776.602951] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 01:36:42 juju-e4d256-prod-github-runner-207 kernel: [72776.603804] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 01:36:42 juju-e4d256-prod-github-runner-207 kernel: [72776.604605] ? __seccomp_filter+0x4a/0x4a0 Aug 23 01:36:42 juju-e4d256-prod-github-runner-207 kernel: [72776.605351] ? __fget_files+0x86/0xc0 Aug 23 01:36:42 juju-e4d256-prod-github-runner-207 kernel: [72776.606054] __x64_sys_ioctl+0x95/0xd0 Aug 23 01:36:42 juju-e4d256-prod-github-runner-207 kernel: [72776.606749] do_syscall_64+0x5c/0xc0 Aug 23 01:36:42 juju-e4d256-prod-github-runner-207 kernel: [72776.607427] ? do_futex+0x162/0x1f0 Aug 23 01:36:42 juju-e4d256-prod-github-runner-207 kernel: [72776.608075] ? __x64_sys_futex+0x78/0x1e0 Aug 23 01:36:42 juju-e4d256-prod-github-runner-207 kernel: [72776.608752] ? __secure_computing+0xa9/0x120 Aug 23 01:36:42 juju-e4d256-prod-github-runner-207 kernel: [72776.609444] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 01:36:42 juju-e4d256-prod-github-runner-207 kernel: [72776.610206] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:36:42 juju-e4d256-prod-github-runner-207 kernel: [72776.610938] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:36:42 juju-e4d256-prod-github-runner-207 kernel: [72776.611659] ? do_syscall_64+0x69/0xc0 Aug 23 01:36:42 juju-e4d256-prod-github-runner-207 kernel: [72776.612304] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:36:42 juju-e4d256-prod-github-runner-207 kernel: [72776.613006] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:36:42 juju-e4d256-prod-github-runner-207 kernel: [72776.613703] ? do_syscall_64+0x69/0xc0 Aug 23 01:36:42 juju-e4d256-prod-github-runner-207 kernel: [72776.614332] ? do_syscall_64+0x69/0xc0 Aug 23 01:36:42 juju-e4d256-prod-github-runner-207 kernel: [72776.614969] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 01:36:42 juju-e4d256-prod-github-runner-207 kernel: [72776.615677] RIP: 0033:0x7faa5d0edaff Aug 23 01:36:42 juju-e4d256-prod-github-runner-207 kernel: [72776.616334] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 01:36:42 juju-e4d256-prod-github-runner-207 kernel: [72776.618316] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 01:36:42 juju-e4d256-prod-github-runner-207 kernel: [72776.619240] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 01:36:42 juju-e4d256-prod-github-runner-207 kernel: [72776.620128] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 01:36:42 juju-e4d256-prod-github-runner-207 kernel: [72776.621018] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 01:36:42 juju-e4d256-prod-github-runner-207 kernel: [72776.621908] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 01:36:42 juju-e4d256-prod-github-runner-207 kernel: [72776.622793] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 01:36:42 juju-e4d256-prod-github-runner-207 kernel: [72776.623699] Aug 23 01:37:10 juju-e4d256-prod-github-runner-207 kernel: [72804.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 67696s! [qemu-system-x86:6715] Aug 23 01:37:10 juju-e4d256-prod-github-runner-207 kernel: [72804.543122] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 01:37:10 juju-e4d256-prod-github-runner-207 kernel: [72804.543189] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 01:37:10 juju-e4d256-prod-github-runner-207 kernel: [72804.555397] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 01:37:10 juju-e4d256-prod-github-runner-207 kernel: [72804.556674] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 01:37:10 juju-e4d256-prod-github-runner-207 kernel: [72804.557903] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:37:10 juju-e4d256-prod-github-runner-207 kernel: [72804.558978] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 01:37:10 juju-e4d256-prod-github-runner-207 kernel: [72804.561550] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 01:37:10 juju-e4d256-prod-github-runner-207 kernel: [72804.562618] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 01:37:10 juju-e4d256-prod-github-runner-207 kernel: [72804.563971] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 01:37:10 juju-e4d256-prod-github-runner-207 kernel: [72804.565310] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 01:37:10 juju-e4d256-prod-github-runner-207 kernel: [72804.566479] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 01:37:10 juju-e4d256-prod-github-runner-207 kernel: [72804.567697] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 01:37:10 juju-e4d256-prod-github-runner-207 kernel: [72804.568944] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 01:37:10 juju-e4d256-prod-github-runner-207 kernel: [72804.570175] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 01:37:10 juju-e4d256-prod-github-runner-207 kernel: [72804.571284] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 01:37:10 juju-e4d256-prod-github-runner-207 kernel: [72804.572479] Call Trace: Aug 23 01:37:10 juju-e4d256-prod-github-runner-207 kernel: [72804.573390] Aug 23 01:37:10 juju-e4d256-prod-github-runner-207 kernel: [72804.574273] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:37:10 juju-e4d256-prod-github-runner-207 kernel: [72804.575319] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:37:10 juju-e4d256-prod-github-runner-207 kernel: [72804.576346] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:37:10 juju-e4d256-prod-github-runner-207 kernel: [72804.577421] ? show_regs.part.0+0x23/0x29 Aug 23 01:37:10 juju-e4d256-prod-github-runner-207 kernel: [72804.578458] ? show_regs.cold+0x8/0xd Aug 23 01:37:10 juju-e4d256-prod-github-runner-207 kernel: [72804.579449] ? watchdog_timer_fn+0x1be/0x220 Aug 23 01:37:10 juju-e4d256-prod-github-runner-207 kernel: [72804.580458] ? lockup_detector_update_enable+0x60/0x60 Aug 23 01:37:10 juju-e4d256-prod-github-runner-207 kernel: [72804.581525] ? __hrtimer_run_queues+0x107/0x230 Aug 23 01:37:10 juju-e4d256-prod-github-runner-207 kernel: [72804.582552] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 01:37:10 juju-e4d256-prod-github-runner-207 kernel: [72804.583584] ? hrtimer_interrupt+0x101/0x220 Aug 23 01:37:10 juju-e4d256-prod-github-runner-207 kernel: [72804.584604] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 01:37:10 juju-e4d256-prod-github-runner-207 kernel: [72804.585670] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 01:37:10 juju-e4d256-prod-github-runner-207 kernel: [72804.586731] Aug 23 01:37:10 juju-e4d256-prod-github-runner-207 kernel: [72804.587592] Aug 23 01:37:10 juju-e4d256-prod-github-runner-207 kernel: [72804.588431] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 01:37:10 juju-e4d256-prod-github-runner-207 kernel: [72804.589467] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:37:10 juju-e4d256-prod-github-runner-207 kernel: [72804.590503] ? _raw_spin_lock+0x22/0x30 Aug 23 01:37:10 juju-e4d256-prod-github-runner-207 kernel: [72804.591459] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:37:10 juju-e4d256-prod-github-runner-207 kernel: [72804.592487] direct_page_fault+0x206/0x310 [kvm] Aug 23 01:37:10 juju-e4d256-prod-github-runner-207 kernel: [72804.593513] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 01:37:10 juju-e4d256-prod-github-runner-207 kernel: [72804.594522] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 01:37:10 juju-e4d256-prod-github-runner-207 kernel: [72804.595540] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 01:37:10 juju-e4d256-prod-github-runner-207 kernel: [72804.596508] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 01:37:10 juju-e4d256-prod-github-runner-207 kernel: [72804.597458] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 01:37:10 juju-e4d256-prod-github-runner-207 kernel: [72804.598533] handle_exit+0x98/0x230 [kvm_amd] Aug 23 01:37:10 juju-e4d256-prod-github-runner-207 kernel: [72804.599441] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 01:37:10 juju-e4d256-prod-github-runner-207 kernel: [72804.600360] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 01:37:10 juju-e4d256-prod-github-runner-207 kernel: [72804.601286] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 01:37:10 juju-e4d256-prod-github-runner-207 kernel: [72804.602190] vcpu_run+0x62/0x2c0 [kvm] Aug 23 01:37:10 juju-e4d256-prod-github-runner-207 kernel: [72804.603023] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 01:37:10 juju-e4d256-prod-github-runner-207 kernel: [72804.603834] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 01:37:10 juju-e4d256-prod-github-runner-207 kernel: [72804.604689] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 01:37:10 juju-e4d256-prod-github-runner-207 kernel: [72804.605492] ? __seccomp_filter+0x4a/0x4a0 Aug 23 01:37:10 juju-e4d256-prod-github-runner-207 kernel: [72804.606236] ? __fget_files+0x86/0xc0 Aug 23 01:37:10 juju-e4d256-prod-github-runner-207 kernel: [72804.606955] __x64_sys_ioctl+0x95/0xd0 Aug 23 01:37:10 juju-e4d256-prod-github-runner-207 kernel: [72804.607649] do_syscall_64+0x5c/0xc0 Aug 23 01:37:10 juju-e4d256-prod-github-runner-207 kernel: [72804.608320] ? do_futex+0x162/0x1f0 Aug 23 01:37:10 juju-e4d256-prod-github-runner-207 kernel: [72804.608976] ? __x64_sys_futex+0x78/0x1e0 Aug 23 01:37:10 juju-e4d256-prod-github-runner-207 kernel: [72804.609651] ? __secure_computing+0xa9/0x120 Aug 23 01:37:10 juju-e4d256-prod-github-runner-207 kernel: [72804.610347] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 01:37:10 juju-e4d256-prod-github-runner-207 kernel: [72804.611121] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:37:10 juju-e4d256-prod-github-runner-207 kernel: [72804.611848] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:37:10 juju-e4d256-prod-github-runner-207 kernel: [72804.612568] ? do_syscall_64+0x69/0xc0 Aug 23 01:37:10 juju-e4d256-prod-github-runner-207 kernel: [72804.613215] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:37:10 juju-e4d256-prod-github-runner-207 kernel: [72804.613920] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:37:10 juju-e4d256-prod-github-runner-207 kernel: [72804.614635] ? do_syscall_64+0x69/0xc0 Aug 23 01:37:10 juju-e4d256-prod-github-runner-207 kernel: [72804.615264] ? do_syscall_64+0x69/0xc0 Aug 23 01:37:10 juju-e4d256-prod-github-runner-207 kernel: [72804.615886] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 01:37:10 juju-e4d256-prod-github-runner-207 kernel: [72804.616598] RIP: 0033:0x7faa5d0edaff Aug 23 01:37:10 juju-e4d256-prod-github-runner-207 kernel: [72804.617225] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 01:37:10 juju-e4d256-prod-github-runner-207 kernel: [72804.619226] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 01:37:10 juju-e4d256-prod-github-runner-207 kernel: [72804.620144] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 01:37:10 juju-e4d256-prod-github-runner-207 kernel: [72804.621038] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 01:37:10 juju-e4d256-prod-github-runner-207 kernel: [72804.621933] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 01:37:10 juju-e4d256-prod-github-runner-207 kernel: [72804.622836] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 01:37:10 juju-e4d256-prod-github-runner-207 kernel: [72804.623726] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 01:37:10 juju-e4d256-prod-github-runner-207 kernel: [72804.624623] Aug 23 01:37:38 juju-e4d256-prod-github-runner-207 kernel: [72832.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 67722s! [qemu-system-x86:6715] Aug 23 01:37:38 juju-e4d256-prod-github-runner-207 kernel: [72832.543735] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 01:37:38 juju-e4d256-prod-github-runner-207 kernel: [72832.543984] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 01:37:38 juju-e4d256-prod-github-runner-207 kernel: [72832.556244] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 01:37:38 juju-e4d256-prod-github-runner-207 kernel: [72832.557566] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 01:37:38 juju-e4d256-prod-github-runner-207 kernel: [72832.558873] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:37:38 juju-e4d256-prod-github-runner-207 kernel: [72832.559949] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 01:37:38 juju-e4d256-prod-github-runner-207 kernel: [72832.562520] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 01:37:38 juju-e4d256-prod-github-runner-207 kernel: [72832.563598] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 01:37:38 juju-e4d256-prod-github-runner-207 kernel: [72832.564777] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 01:37:38 juju-e4d256-prod-github-runner-207 kernel: [72832.565950] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 01:37:38 juju-e4d256-prod-github-runner-207 kernel: [72832.567149] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 01:37:38 juju-e4d256-prod-github-runner-207 kernel: [72832.568317] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 01:37:38 juju-e4d256-prod-github-runner-207 kernel: [72832.569488] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 01:37:38 juju-e4d256-prod-github-runner-207 kernel: [72832.570736] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 01:37:38 juju-e4d256-prod-github-runner-207 kernel: [72832.571892] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 01:37:38 juju-e4d256-prod-github-runner-207 kernel: [72832.573121] Call Trace: Aug 23 01:37:38 juju-e4d256-prod-github-runner-207 kernel: [72832.574048] Aug 23 01:37:38 juju-e4d256-prod-github-runner-207 kernel: [72832.574964] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:37:38 juju-e4d256-prod-github-runner-207 kernel: [72832.576023] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:37:38 juju-e4d256-prod-github-runner-207 kernel: [72832.577057] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:37:38 juju-e4d256-prod-github-runner-207 kernel: [72832.578168] ? show_regs.part.0+0x23/0x29 Aug 23 01:37:38 juju-e4d256-prod-github-runner-207 kernel: [72832.579186] ? show_regs.cold+0x8/0xd Aug 23 01:37:38 juju-e4d256-prod-github-runner-207 kernel: [72832.580156] ? watchdog_timer_fn+0x1be/0x220 Aug 23 01:37:38 juju-e4d256-prod-github-runner-207 kernel: [72832.581169] ? lockup_detector_update_enable+0x60/0x60 Aug 23 01:37:38 juju-e4d256-prod-github-runner-207 kernel: [72832.582236] ? __hrtimer_run_queues+0x107/0x230 Aug 23 01:37:38 juju-e4d256-prod-github-runner-207 kernel: [72832.583293] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 01:37:38 juju-e4d256-prod-github-runner-207 kernel: [72832.584325] ? hrtimer_interrupt+0x101/0x220 Aug 23 01:37:38 juju-e4d256-prod-github-runner-207 kernel: [72832.585369] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 01:37:38 juju-e4d256-prod-github-runner-207 kernel: [72832.586447] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 01:37:38 juju-e4d256-prod-github-runner-207 kernel: [72832.587514] Aug 23 01:37:38 juju-e4d256-prod-github-runner-207 kernel: [72832.588376] Aug 23 01:37:38 juju-e4d256-prod-github-runner-207 kernel: [72832.589214] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 01:37:38 juju-e4d256-prod-github-runner-207 kernel: [72832.590259] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:37:38 juju-e4d256-prod-github-runner-207 kernel: [72832.591325] ? _raw_spin_lock+0x22/0x30 Aug 23 01:37:38 juju-e4d256-prod-github-runner-207 kernel: [72832.592273] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:37:38 juju-e4d256-prod-github-runner-207 kernel: [72832.593302] direct_page_fault+0x206/0x310 [kvm] Aug 23 01:37:38 juju-e4d256-prod-github-runner-207 kernel: [72832.594357] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 01:37:38 juju-e4d256-prod-github-runner-207 kernel: [72832.595367] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 01:37:38 juju-e4d256-prod-github-runner-207 kernel: [72832.596367] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 01:37:38 juju-e4d256-prod-github-runner-207 kernel: [72832.597359] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 01:37:38 juju-e4d256-prod-github-runner-207 kernel: [72832.598349] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 01:37:38 juju-e4d256-prod-github-runner-207 kernel: [72832.599331] handle_exit+0x98/0x230 [kvm_amd] Aug 23 01:37:38 juju-e4d256-prod-github-runner-207 kernel: [72832.600229] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 01:37:38 juju-e4d256-prod-github-runner-207 kernel: [72832.601186] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 01:37:38 juju-e4d256-prod-github-runner-207 kernel: [72832.602183] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 01:37:38 juju-e4d256-prod-github-runner-207 kernel: [72832.603138] vcpu_run+0x62/0x2c0 [kvm] Aug 23 01:37:38 juju-e4d256-prod-github-runner-207 kernel: [72832.603964] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 01:37:38 juju-e4d256-prod-github-runner-207 kernel: [72832.604781] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 01:37:38 juju-e4d256-prod-github-runner-207 kernel: [72832.605689] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 01:37:38 juju-e4d256-prod-github-runner-207 kernel: [72832.606547] ? __seccomp_filter+0x4a/0x4a0 Aug 23 01:37:38 juju-e4d256-prod-github-runner-207 kernel: [72832.607300] ? __fget_files+0x86/0xc0 Aug 23 01:37:38 juju-e4d256-prod-github-runner-207 kernel: [72832.608056] __x64_sys_ioctl+0x95/0xd0 Aug 23 01:37:38 juju-e4d256-prod-github-runner-207 kernel: [72832.608768] do_syscall_64+0x5c/0xc0 Aug 23 01:37:38 juju-e4d256-prod-github-runner-207 kernel: [72832.609436] ? do_futex+0x162/0x1f0 Aug 23 01:37:38 juju-e4d256-prod-github-runner-207 kernel: [72832.610086] ? __x64_sys_futex+0x78/0x1e0 Aug 23 01:37:38 juju-e4d256-prod-github-runner-207 kernel: [72832.610811] ? __secure_computing+0xa9/0x120 Aug 23 01:37:38 juju-e4d256-prod-github-runner-207 kernel: [72832.611504] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 01:37:38 juju-e4d256-prod-github-runner-207 kernel: [72832.612275] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:37:38 juju-e4d256-prod-github-runner-207 kernel: [72832.613004] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:37:38 juju-e4d256-prod-github-runner-207 kernel: [72832.613742] ? do_syscall_64+0x69/0xc0 Aug 23 01:37:38 juju-e4d256-prod-github-runner-207 kernel: [72832.614410] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:37:38 juju-e4d256-prod-github-runner-207 kernel: [72832.615114] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:37:38 juju-e4d256-prod-github-runner-207 kernel: [72832.615816] ? do_syscall_64+0x69/0xc0 Aug 23 01:37:38 juju-e4d256-prod-github-runner-207 kernel: [72832.616443] ? do_syscall_64+0x69/0xc0 Aug 23 01:37:38 juju-e4d256-prod-github-runner-207 kernel: [72832.617071] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 01:37:38 juju-e4d256-prod-github-runner-207 kernel: [72832.617775] RIP: 0033:0x7faa5d0edaff Aug 23 01:37:38 juju-e4d256-prod-github-runner-207 kernel: [72832.618496] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 01:37:38 juju-e4d256-prod-github-runner-207 kernel: [72832.620524] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 01:37:38 juju-e4d256-prod-github-runner-207 kernel: [72832.621445] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 01:37:38 juju-e4d256-prod-github-runner-207 kernel: [72832.622371] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 01:37:38 juju-e4d256-prod-github-runner-207 kernel: [72832.623278] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 01:37:38 juju-e4d256-prod-github-runner-207 kernel: [72832.624184] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 01:37:38 juju-e4d256-prod-github-runner-207 kernel: [72832.625073] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 01:37:38 juju-e4d256-prod-github-runner-207 kernel: [72832.625972] Aug 23 01:38:06 juju-e4d256-prod-github-runner-207 kernel: [72860.541984] watchdog: BUG: soft lockup - CPU#1 stuck for 67748s! [qemu-system-x86:6715] Aug 23 01:38:06 juju-e4d256-prod-github-runner-207 kernel: [72860.543104] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 01:38:06 juju-e4d256-prod-github-runner-207 kernel: [72860.543172] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 01:38:06 juju-e4d256-prod-github-runner-207 kernel: [72860.555212] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 01:38:06 juju-e4d256-prod-github-runner-207 kernel: [72860.556481] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 01:38:06 juju-e4d256-prod-github-runner-207 kernel: [72860.557699] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:38:06 juju-e4d256-prod-github-runner-207 kernel: [72860.558773] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 01:38:06 juju-e4d256-prod-github-runner-207 kernel: [72860.561327] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 01:38:06 juju-e4d256-prod-github-runner-207 kernel: [72860.562388] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 01:38:06 juju-e4d256-prod-github-runner-207 kernel: [72860.563547] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 01:38:06 juju-e4d256-prod-github-runner-207 kernel: [72860.564704] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 01:38:06 juju-e4d256-prod-github-runner-207 kernel: [72860.565868] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 01:38:06 juju-e4d256-prod-github-runner-207 kernel: [72860.567036] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 01:38:06 juju-e4d256-prod-github-runner-207 kernel: [72860.568199] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 01:38:06 juju-e4d256-prod-github-runner-207 kernel: [72860.569431] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 01:38:06 juju-e4d256-prod-github-runner-207 kernel: [72860.570535] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 01:38:06 juju-e4d256-prod-github-runner-207 kernel: [72860.571732] Call Trace: Aug 23 01:38:06 juju-e4d256-prod-github-runner-207 kernel: [72860.572651] Aug 23 01:38:06 juju-e4d256-prod-github-runner-207 kernel: [72860.573535] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:38:06 juju-e4d256-prod-github-runner-207 kernel: [72860.574577] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:38:06 juju-e4d256-prod-github-runner-207 kernel: [72860.575597] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:38:06 juju-e4d256-prod-github-runner-207 kernel: [72860.576676] ? show_regs.part.0+0x23/0x29 Aug 23 01:38:06 juju-e4d256-prod-github-runner-207 kernel: [72860.577672] ? show_regs.cold+0x8/0xd Aug 23 01:38:06 juju-e4d256-prod-github-runner-207 kernel: [72860.578660] ? watchdog_timer_fn+0x1be/0x220 Aug 23 01:38:06 juju-e4d256-prod-github-runner-207 kernel: [72860.579673] ? lockup_detector_update_enable+0x60/0x60 Aug 23 01:38:06 juju-e4d256-prod-github-runner-207 kernel: [72860.580739] ? __hrtimer_run_queues+0x107/0x230 Aug 23 01:38:06 juju-e4d256-prod-github-runner-207 kernel: [72860.581772] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 01:38:06 juju-e4d256-prod-github-runner-207 kernel: [72860.582802] ? hrtimer_interrupt+0x101/0x220 Aug 23 01:38:06 juju-e4d256-prod-github-runner-207 kernel: [72860.583821] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 01:38:06 juju-e4d256-prod-github-runner-207 kernel: [72860.584892] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 01:38:06 juju-e4d256-prod-github-runner-207 kernel: [72860.585935] Aug 23 01:38:06 juju-e4d256-prod-github-runner-207 kernel: [72860.586894] Aug 23 01:38:06 juju-e4d256-prod-github-runner-207 kernel: [72860.587730] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 01:38:06 juju-e4d256-prod-github-runner-207 kernel: [72860.588760] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:38:06 juju-e4d256-prod-github-runner-207 kernel: [72860.589796] ? _raw_spin_lock+0x22/0x30 Aug 23 01:38:06 juju-e4d256-prod-github-runner-207 kernel: [72860.590752] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:38:06 juju-e4d256-prod-github-runner-207 kernel: [72860.591771] direct_page_fault+0x206/0x310 [kvm] Aug 23 01:38:06 juju-e4d256-prod-github-runner-207 kernel: [72860.592797] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 01:38:06 juju-e4d256-prod-github-runner-207 kernel: [72860.593807] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 01:38:06 juju-e4d256-prod-github-runner-207 kernel: [72860.594820] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 01:38:06 juju-e4d256-prod-github-runner-207 kernel: [72860.595789] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 01:38:06 juju-e4d256-prod-github-runner-207 kernel: [72860.596739] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 01:38:06 juju-e4d256-prod-github-runner-207 kernel: [72860.597716] handle_exit+0x98/0x230 [kvm_amd] Aug 23 01:38:06 juju-e4d256-prod-github-runner-207 kernel: [72860.598625] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 01:38:06 juju-e4d256-prod-github-runner-207 kernel: [72860.599655] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 01:38:06 juju-e4d256-prod-github-runner-207 kernel: [72860.600576] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 01:38:06 juju-e4d256-prod-github-runner-207 kernel: [72860.601476] vcpu_run+0x62/0x2c0 [kvm] Aug 23 01:38:06 juju-e4d256-prod-github-runner-207 kernel: [72860.602307] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 01:38:06 juju-e4d256-prod-github-runner-207 kernel: [72860.603114] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 01:38:06 juju-e4d256-prod-github-runner-207 kernel: [72860.603970] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 01:38:06 juju-e4d256-prod-github-runner-207 kernel: [72860.604765] ? __seccomp_filter+0x4a/0x4a0 Aug 23 01:38:06 juju-e4d256-prod-github-runner-207 kernel: [72860.605516] ? __fget_files+0x86/0xc0 Aug 23 01:38:06 juju-e4d256-prod-github-runner-207 kernel: [72860.606268] __x64_sys_ioctl+0x95/0xd0 Aug 23 01:38:06 juju-e4d256-prod-github-runner-207 kernel: [72860.606958] do_syscall_64+0x5c/0xc0 Aug 23 01:38:06 juju-e4d256-prod-github-runner-207 kernel: [72860.607618] ? do_futex+0x162/0x1f0 Aug 23 01:38:06 juju-e4d256-prod-github-runner-207 kernel: [72860.608261] ? __x64_sys_futex+0x78/0x1e0 Aug 23 01:38:06 juju-e4d256-prod-github-runner-207 kernel: [72860.608935] ? __secure_computing+0xa9/0x120 Aug 23 01:38:06 juju-e4d256-prod-github-runner-207 kernel: [72860.609620] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 01:38:06 juju-e4d256-prod-github-runner-207 kernel: [72860.610393] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:38:06 juju-e4d256-prod-github-runner-207 kernel: [72860.611113] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:38:06 juju-e4d256-prod-github-runner-207 kernel: [72860.611826] ? do_syscall_64+0x69/0xc0 Aug 23 01:38:06 juju-e4d256-prod-github-runner-207 kernel: [72860.612467] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:38:06 juju-e4d256-prod-github-runner-207 kernel: [72860.613168] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:38:06 juju-e4d256-prod-github-runner-207 kernel: [72860.613861] ? do_syscall_64+0x69/0xc0 Aug 23 01:38:06 juju-e4d256-prod-github-runner-207 kernel: [72860.614496] ? do_syscall_64+0x69/0xc0 Aug 23 01:38:06 juju-e4d256-prod-github-runner-207 kernel: [72860.615120] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 01:38:06 juju-e4d256-prod-github-runner-207 kernel: [72860.615820] RIP: 0033:0x7faa5d0edaff Aug 23 01:38:06 juju-e4d256-prod-github-runner-207 kernel: [72860.616448] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 01:38:06 juju-e4d256-prod-github-runner-207 kernel: [72860.618438] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 01:38:06 juju-e4d256-prod-github-runner-207 kernel: [72860.619344] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 01:38:06 juju-e4d256-prod-github-runner-207 kernel: [72860.620234] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 01:38:06 juju-e4d256-prod-github-runner-207 kernel: [72860.621118] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 01:38:06 juju-e4d256-prod-github-runner-207 kernel: [72860.622020] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 01:38:06 juju-e4d256-prod-github-runner-207 kernel: [72860.622905] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 01:38:06 juju-e4d256-prod-github-runner-207 kernel: [72860.623793] Aug 23 01:38:34 juju-e4d256-prod-github-runner-207 kernel: [72888.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 67774s! [qemu-system-x86:6715] Aug 23 01:38:34 juju-e4d256-prod-github-runner-207 kernel: [72888.543092] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 01:38:34 juju-e4d256-prod-github-runner-207 kernel: [72888.543159] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 01:38:34 juju-e4d256-prod-github-runner-207 kernel: [72888.555261] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 01:38:34 juju-e4d256-prod-github-runner-207 kernel: [72888.556530] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 01:38:34 juju-e4d256-prod-github-runner-207 kernel: [72888.557761] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:38:34 juju-e4d256-prod-github-runner-207 kernel: [72888.558820] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 01:38:34 juju-e4d256-prod-github-runner-207 kernel: [72888.561367] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 01:38:34 juju-e4d256-prod-github-runner-207 kernel: [72888.562420] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 01:38:34 juju-e4d256-prod-github-runner-207 kernel: [72888.563581] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 01:38:34 juju-e4d256-prod-github-runner-207 kernel: [72888.564739] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 01:38:34 juju-e4d256-prod-github-runner-207 kernel: [72888.565912] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 01:38:34 juju-e4d256-prod-github-runner-207 kernel: [72888.567074] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 01:38:34 juju-e4d256-prod-github-runner-207 kernel: [72888.568241] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 01:38:34 juju-e4d256-prod-github-runner-207 kernel: [72888.569480] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 01:38:34 juju-e4d256-prod-github-runner-207 kernel: [72888.570583] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 01:38:34 juju-e4d256-prod-github-runner-207 kernel: [72888.571776] Call Trace: Aug 23 01:38:34 juju-e4d256-prod-github-runner-207 kernel: [72888.572693] Aug 23 01:38:34 juju-e4d256-prod-github-runner-207 kernel: [72888.573577] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:38:34 juju-e4d256-prod-github-runner-207 kernel: [72888.574618] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:38:34 juju-e4d256-prod-github-runner-207 kernel: [72888.575642] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:38:34 juju-e4d256-prod-github-runner-207 kernel: [72888.576716] ? show_regs.part.0+0x23/0x29 Aug 23 01:38:34 juju-e4d256-prod-github-runner-207 kernel: [72888.577718] ? show_regs.cold+0x8/0xd Aug 23 01:38:34 juju-e4d256-prod-github-runner-207 kernel: [72888.578689] ? watchdog_timer_fn+0x1be/0x220 Aug 23 01:38:34 juju-e4d256-prod-github-runner-207 kernel: [72888.579697] ? lockup_detector_update_enable+0x60/0x60 Aug 23 01:38:34 juju-e4d256-prod-github-runner-207 kernel: [72888.580759] ? __hrtimer_run_queues+0x107/0x230 Aug 23 01:38:34 juju-e4d256-prod-github-runner-207 kernel: [72888.581796] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 01:38:34 juju-e4d256-prod-github-runner-207 kernel: [72888.582821] ? hrtimer_interrupt+0x101/0x220 Aug 23 01:38:34 juju-e4d256-prod-github-runner-207 kernel: [72888.583837] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 01:38:34 juju-e4d256-prod-github-runner-207 kernel: [72888.584905] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 01:38:34 juju-e4d256-prod-github-runner-207 kernel: [72888.585957] Aug 23 01:38:34 juju-e4d256-prod-github-runner-207 kernel: [72888.586811] Aug 23 01:38:34 juju-e4d256-prod-github-runner-207 kernel: [72888.587649] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 01:38:34 juju-e4d256-prod-github-runner-207 kernel: [72888.588689] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:38:34 juju-e4d256-prod-github-runner-207 kernel: [72888.589738] ? _raw_spin_lock+0x22/0x30 Aug 23 01:38:34 juju-e4d256-prod-github-runner-207 kernel: [72888.590686] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:38:34 juju-e4d256-prod-github-runner-207 kernel: [72888.591708] direct_page_fault+0x206/0x310 [kvm] Aug 23 01:38:34 juju-e4d256-prod-github-runner-207 kernel: [72888.592732] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 01:38:34 juju-e4d256-prod-github-runner-207 kernel: [72888.593757] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 01:38:34 juju-e4d256-prod-github-runner-207 kernel: [72888.594759] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 01:38:34 juju-e4d256-prod-github-runner-207 kernel: [72888.595734] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 01:38:34 juju-e4d256-prod-github-runner-207 kernel: [72888.596680] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 01:38:34 juju-e4d256-prod-github-runner-207 kernel: [72888.597672] handle_exit+0x98/0x230 [kvm_amd] Aug 23 01:38:34 juju-e4d256-prod-github-runner-207 kernel: [72888.598568] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 01:38:34 juju-e4d256-prod-github-runner-207 kernel: [72888.599484] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 01:38:34 juju-e4d256-prod-github-runner-207 kernel: [72888.600414] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 01:38:34 juju-e4d256-prod-github-runner-207 kernel: [72888.601466] vcpu_run+0x62/0x2c0 [kvm] Aug 23 01:38:34 juju-e4d256-prod-github-runner-207 kernel: [72888.602286] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 01:38:34 juju-e4d256-prod-github-runner-207 kernel: [72888.603095] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 01:38:34 juju-e4d256-prod-github-runner-207 kernel: [72888.603953] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 01:38:34 juju-e4d256-prod-github-runner-207 kernel: [72888.604749] ? __seccomp_filter+0x4a/0x4a0 Aug 23 01:38:34 juju-e4d256-prod-github-runner-207 kernel: [72888.605574] ? __fget_files+0x86/0xc0 Aug 23 01:38:34 juju-e4d256-prod-github-runner-207 kernel: [72888.606350] __x64_sys_ioctl+0x95/0xd0 Aug 23 01:38:34 juju-e4d256-prod-github-runner-207 kernel: [72888.607046] do_syscall_64+0x5c/0xc0 Aug 23 01:38:34 juju-e4d256-prod-github-runner-207 kernel: [72888.607714] ? do_futex+0x162/0x1f0 Aug 23 01:38:34 juju-e4d256-prod-github-runner-207 kernel: [72888.608365] ? __x64_sys_futex+0x78/0x1e0 Aug 23 01:38:34 juju-e4d256-prod-github-runner-207 kernel: [72888.609036] ? __secure_computing+0xa9/0x120 Aug 23 01:38:34 juju-e4d256-prod-github-runner-207 kernel: [72888.609742] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 01:38:34 juju-e4d256-prod-github-runner-207 kernel: [72888.610509] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:38:34 juju-e4d256-prod-github-runner-207 kernel: [72888.611230] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:38:34 juju-e4d256-prod-github-runner-207 kernel: [72888.611945] ? do_syscall_64+0x69/0xc0 Aug 23 01:38:34 juju-e4d256-prod-github-runner-207 kernel: [72888.612589] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:38:34 juju-e4d256-prod-github-runner-207 kernel: [72888.613298] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:38:34 juju-e4d256-prod-github-runner-207 kernel: [72888.614105] ? do_syscall_64+0x69/0xc0 Aug 23 01:38:34 juju-e4d256-prod-github-runner-207 kernel: [72888.614739] ? do_syscall_64+0x69/0xc0 Aug 23 01:38:34 juju-e4d256-prod-github-runner-207 kernel: [72888.615361] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 01:38:34 juju-e4d256-prod-github-runner-207 kernel: [72888.616065] RIP: 0033:0x7faa5d0edaff Aug 23 01:38:34 juju-e4d256-prod-github-runner-207 kernel: [72888.616686] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 01:38:34 juju-e4d256-prod-github-runner-207 kernel: [72888.618682] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 01:38:34 juju-e4d256-prod-github-runner-207 kernel: [72888.619589] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 01:38:34 juju-e4d256-prod-github-runner-207 kernel: [72888.620478] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 01:38:34 juju-e4d256-prod-github-runner-207 kernel: [72888.621368] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 01:38:34 juju-e4d256-prod-github-runner-207 kernel: [72888.622266] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 01:38:34 juju-e4d256-prod-github-runner-207 kernel: [72888.623154] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 01:38:34 juju-e4d256-prod-github-runner-207 kernel: [72888.624045] Aug 23 01:38:48 juju-e4d256-prod-github-runner-207 kernel: [72902.048706] rcu: INFO: rcu_sched self-detected stall on CPU Aug 23 01:38:48 juju-e4d256-prod-github-runner-207 kernel: [72902.050342] rcu: 1-....: (18138960 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=8763295 Aug 23 01:38:48 juju-e4d256-prod-github-runner-207 kernel: [72902.051478] (t=18196212 jiffies g=23269 q=62221) Aug 23 01:38:48 juju-e4d256-prod-github-runner-207 kernel: [72902.052266] NMI backtrace for cpu 1 Aug 23 01:38:48 juju-e4d256-prod-github-runner-207 kernel: [72902.052981] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 01:38:48 juju-e4d256-prod-github-runner-207 kernel: [72902.054281] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 01:38:48 juju-e4d256-prod-github-runner-207 kernel: [72902.055353] Call Trace: Aug 23 01:38:48 juju-e4d256-prod-github-runner-207 kernel: [72902.056121] Aug 23 01:38:48 juju-e4d256-prod-github-runner-207 kernel: [72902.056774] show_stack+0x52/0x5c Aug 23 01:38:48 juju-e4d256-prod-github-runner-207 kernel: [72902.057533] dump_stack_lvl+0x4a/0x63 Aug 23 01:38:48 juju-e4d256-prod-github-runner-207 kernel: [72902.058288] dump_stack+0x10/0x16 Aug 23 01:38:48 juju-e4d256-prod-github-runner-207 kernel: [72902.059004] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 23 01:38:48 juju-e4d256-prod-github-runner-207 kernel: [72902.059794] ? lapic_can_unplug_cpu+0x90/0x90 Aug 23 01:38:48 juju-e4d256-prod-github-runner-207 kernel: [72902.060572] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 23 01:38:48 juju-e4d256-prod-github-runner-207 kernel: [72902.061397] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 23 01:38:48 juju-e4d256-prod-github-runner-207 kernel: [72902.062227] trigger_single_cpu_backtrace+0x44/0x4f Aug 23 01:38:48 juju-e4d256-prod-github-runner-207 kernel: [72902.063046] rcu_dump_cpu_stacks+0x102/0x149 Aug 23 01:38:48 juju-e4d256-prod-github-runner-207 kernel: [72902.063817] print_cpu_stall.cold+0x2f/0xe2 Aug 23 01:38:48 juju-e4d256-prod-github-runner-207 kernel: [72902.064585] ? timekeeping_update+0xf7/0x150 Aug 23 01:38:48 juju-e4d256-prod-github-runner-207 kernel: [72902.065354] check_cpu_stall+0x109/0x270 Aug 23 01:38:48 juju-e4d256-prod-github-runner-207 kernel: [72902.066116] rcu_sched_clock_irq+0x9a/0x250 Aug 23 01:38:48 juju-e4d256-prod-github-runner-207 kernel: [72902.066877] update_process_times+0x94/0xd0 Aug 23 01:38:48 juju-e4d256-prod-github-runner-207 kernel: [72902.067653] tick_sched_handle+0x29/0x70 Aug 23 01:38:48 juju-e4d256-prod-github-runner-207 kernel: [72902.068406] tick_sched_timer+0x8c/0xc0 Aug 23 01:38:48 juju-e4d256-prod-github-runner-207 kernel: [72902.069150] ? tick_nohz_handler+0xb0/0xb0 Aug 23 01:38:48 juju-e4d256-prod-github-runner-207 kernel: [72902.069935] __hrtimer_run_queues+0x107/0x230 Aug 23 01:38:48 juju-e4d256-prod-github-runner-207 kernel: [72902.070708] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 01:38:48 juju-e4d256-prod-github-runner-207 kernel: [72902.071482] hrtimer_interrupt+0x101/0x220 Aug 23 01:38:48 juju-e4d256-prod-github-runner-207 kernel: [72902.072239] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 01:38:48 juju-e4d256-prod-github-runner-207 kernel: [72902.073053] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 01:38:48 juju-e4d256-prod-github-runner-207 kernel: [72902.073865] Aug 23 01:38:48 juju-e4d256-prod-github-runner-207 kernel: [72902.074499] Aug 23 01:38:48 juju-e4d256-prod-github-runner-207 kernel: [72902.075126] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 01:38:48 juju-e4d256-prod-github-runner-207 kernel: [72902.075944] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:38:48 juju-e4d256-prod-github-runner-207 kernel: [72902.076820] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 01:38:48 juju-e4d256-prod-github-runner-207 kernel: [72902.079040] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 01:38:48 juju-e4d256-prod-github-runner-207 kernel: [72902.079913] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 01:38:48 juju-e4d256-prod-github-runner-207 kernel: [72902.080903] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 01:38:48 juju-e4d256-prod-github-runner-207 kernel: [72902.081896] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 01:38:48 juju-e4d256-prod-github-runner-207 kernel: [72902.082856] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 01:38:48 juju-e4d256-prod-github-runner-207 kernel: [72902.083807] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 01:38:48 juju-e4d256-prod-github-runner-207 kernel: [72902.084757] ? _raw_spin_lock+0x22/0x30 Aug 23 01:38:48 juju-e4d256-prod-github-runner-207 kernel: [72902.085543] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:38:48 juju-e4d256-prod-github-runner-207 kernel: [72902.086394] direct_page_fault+0x206/0x310 [kvm] Aug 23 01:38:48 juju-e4d256-prod-github-runner-207 kernel: [72902.087228] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 01:38:48 juju-e4d256-prod-github-runner-207 kernel: [72902.088072] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 01:38:48 juju-e4d256-prod-github-runner-207 kernel: [72902.088923] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 01:38:48 juju-e4d256-prod-github-runner-207 kernel: [72902.089760] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 01:38:48 juju-e4d256-prod-github-runner-207 kernel: [72902.090551] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 01:38:48 juju-e4d256-prod-github-runner-207 kernel: [72902.091372] handle_exit+0x98/0x230 [kvm_amd] Aug 23 01:38:48 juju-e4d256-prod-github-runner-207 kernel: [72902.092124] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 01:38:48 juju-e4d256-prod-github-runner-207 kernel: [72902.092910] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 01:38:48 juju-e4d256-prod-github-runner-207 kernel: [72902.093717] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 01:38:48 juju-e4d256-prod-github-runner-207 kernel: [72902.094502] vcpu_run+0x62/0x2c0 [kvm] Aug 23 01:38:48 juju-e4d256-prod-github-runner-207 kernel: [72902.095215] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 01:38:48 juju-e4d256-prod-github-runner-207 kernel: [72902.095945] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 01:38:48 juju-e4d256-prod-github-runner-207 kernel: [72902.096745] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 01:38:48 juju-e4d256-prod-github-runner-207 kernel: [72902.097517] ? __seccomp_filter+0x4a/0x4a0 Aug 23 01:38:48 juju-e4d256-prod-github-runner-207 kernel: [72902.098235] ? __fget_files+0x86/0xc0 Aug 23 01:38:48 juju-e4d256-prod-github-runner-207 kernel: [72902.098944] __x64_sys_ioctl+0x95/0xd0 Aug 23 01:38:48 juju-e4d256-prod-github-runner-207 kernel: [72902.099640] do_syscall_64+0x5c/0xc0 Aug 23 01:38:48 juju-e4d256-prod-github-runner-207 kernel: [72902.100320] ? do_futex+0x162/0x1f0 Aug 23 01:38:48 juju-e4d256-prod-github-runner-207 kernel: [72902.100993] ? __x64_sys_futex+0x78/0x1e0 Aug 23 01:38:48 juju-e4d256-prod-github-runner-207 kernel: [72902.101705] ? __secure_computing+0xa9/0x120 Aug 23 01:38:48 juju-e4d256-prod-github-runner-207 kernel: [72902.102420] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 01:38:48 juju-e4d256-prod-github-runner-207 kernel: [72902.103208] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:38:48 juju-e4d256-prod-github-runner-207 kernel: [72902.103959] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:38:48 juju-e4d256-prod-github-runner-207 kernel: [72902.104709] ? do_syscall_64+0x69/0xc0 Aug 23 01:38:48 juju-e4d256-prod-github-runner-207 kernel: [72902.105397] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:38:48 juju-e4d256-prod-github-runner-207 kernel: [72902.106162] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:38:48 juju-e4d256-prod-github-runner-207 kernel: [72902.106923] ? do_syscall_64+0x69/0xc0 Aug 23 01:38:48 juju-e4d256-prod-github-runner-207 kernel: [72902.107615] ? do_syscall_64+0x69/0xc0 Aug 23 01:38:48 juju-e4d256-prod-github-runner-207 kernel: [72902.108301] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 01:38:48 juju-e4d256-prod-github-runner-207 kernel: [72902.109084] RIP: 0033:0x7faa5d0edaff Aug 23 01:38:48 juju-e4d256-prod-github-runner-207 kernel: [72902.109805] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 01:38:48 juju-e4d256-prod-github-runner-207 kernel: [72902.111907] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 01:38:48 juju-e4d256-prod-github-runner-207 kernel: [72902.112867] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 01:38:48 juju-e4d256-prod-github-runner-207 kernel: [72902.113824] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 01:38:48 juju-e4d256-prod-github-runner-207 kernel: [72902.114766] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 01:38:48 juju-e4d256-prod-github-runner-207 kernel: [72902.115703] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 01:38:48 juju-e4d256-prod-github-runner-207 kernel: [72902.116630] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 01:38:48 juju-e4d256-prod-github-runner-207 kernel: [72902.117554] Aug 23 01:39:14 juju-e4d256-prod-github-runner-207 kernel: [72928.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 67811s! [qemu-system-x86:6715] Aug 23 01:39:14 juju-e4d256-prod-github-runner-207 kernel: [72928.543120] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 01:39:14 juju-e4d256-prod-github-runner-207 kernel: [72928.543414] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 01:39:14 juju-e4d256-prod-github-runner-207 kernel: [72928.555493] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 01:39:14 juju-e4d256-prod-github-runner-207 kernel: [72928.556758] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 01:39:14 juju-e4d256-prod-github-runner-207 kernel: [72928.557996] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:39:14 juju-e4d256-prod-github-runner-207 kernel: [72928.559051] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 01:39:14 juju-e4d256-prod-github-runner-207 kernel: [72928.561609] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 01:39:14 juju-e4d256-prod-github-runner-207 kernel: [72928.562653] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 01:39:14 juju-e4d256-prod-github-runner-207 kernel: [72928.563823] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 01:39:14 juju-e4d256-prod-github-runner-207 kernel: [72928.564980] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 01:39:14 juju-e4d256-prod-github-runner-207 kernel: [72928.566147] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 01:39:14 juju-e4d256-prod-github-runner-207 kernel: [72928.567309] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 01:39:14 juju-e4d256-prod-github-runner-207 kernel: [72928.568477] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 01:39:14 juju-e4d256-prod-github-runner-207 kernel: [72928.569728] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 01:39:14 juju-e4d256-prod-github-runner-207 kernel: [72928.570829] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 01:39:14 juju-e4d256-prod-github-runner-207 kernel: [72928.572026] Call Trace: Aug 23 01:39:14 juju-e4d256-prod-github-runner-207 kernel: [72928.572938] Aug 23 01:39:14 juju-e4d256-prod-github-runner-207 kernel: [72928.573835] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:39:14 juju-e4d256-prod-github-runner-207 kernel: [72928.574865] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:39:14 juju-e4d256-prod-github-runner-207 kernel: [72928.575883] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:39:14 juju-e4d256-prod-github-runner-207 kernel: [72928.576957] ? show_regs.part.0+0x23/0x29 Aug 23 01:39:14 juju-e4d256-prod-github-runner-207 kernel: [72928.577965] ? show_regs.cold+0x8/0xd Aug 23 01:39:14 juju-e4d256-prod-github-runner-207 kernel: [72928.578937] ? watchdog_timer_fn+0x1be/0x220 Aug 23 01:39:14 juju-e4d256-prod-github-runner-207 kernel: [72928.579949] ? lockup_detector_update_enable+0x60/0x60 Aug 23 01:39:14 juju-e4d256-prod-github-runner-207 kernel: [72928.581010] ? __hrtimer_run_queues+0x107/0x230 Aug 23 01:39:14 juju-e4d256-prod-github-runner-207 kernel: [72928.582045] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 01:39:14 juju-e4d256-prod-github-runner-207 kernel: [72928.583074] ? hrtimer_interrupt+0x101/0x220 Aug 23 01:39:14 juju-e4d256-prod-github-runner-207 kernel: [72928.584088] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 01:39:14 juju-e4d256-prod-github-runner-207 kernel: [72928.585155] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 01:39:14 juju-e4d256-prod-github-runner-207 kernel: [72928.586206] Aug 23 01:39:14 juju-e4d256-prod-github-runner-207 kernel: [72928.587057] Aug 23 01:39:14 juju-e4d256-prod-github-runner-207 kernel: [72928.587893] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 01:39:14 juju-e4d256-prod-github-runner-207 kernel: [72928.588924] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:39:14 juju-e4d256-prod-github-runner-207 kernel: [72928.589971] ? _raw_spin_lock+0x22/0x30 Aug 23 01:39:14 juju-e4d256-prod-github-runner-207 kernel: [72928.590915] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:39:14 juju-e4d256-prod-github-runner-207 kernel: [72928.591931] direct_page_fault+0x206/0x310 [kvm] Aug 23 01:39:14 juju-e4d256-prod-github-runner-207 kernel: [72928.592956] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 01:39:14 juju-e4d256-prod-github-runner-207 kernel: [72928.593980] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 01:39:14 juju-e4d256-prod-github-runner-207 kernel: [72928.594979] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 01:39:14 juju-e4d256-prod-github-runner-207 kernel: [72928.595953] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 01:39:14 juju-e4d256-prod-github-runner-207 kernel: [72928.596898] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 01:39:14 juju-e4d256-prod-github-runner-207 kernel: [72928.597904] handle_exit+0x98/0x230 [kvm_amd] Aug 23 01:39:14 juju-e4d256-prod-github-runner-207 kernel: [72928.598802] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 01:39:14 juju-e4d256-prod-github-runner-207 kernel: [72928.599718] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 01:39:14 juju-e4d256-prod-github-runner-207 kernel: [72928.600640] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 01:39:14 juju-e4d256-prod-github-runner-207 kernel: [72928.601559] vcpu_run+0x62/0x2c0 [kvm] Aug 23 01:39:14 juju-e4d256-prod-github-runner-207 kernel: [72928.602375] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 01:39:14 juju-e4d256-prod-github-runner-207 kernel: [72928.603182] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 01:39:14 juju-e4d256-prod-github-runner-207 kernel: [72928.604038] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 01:39:14 juju-e4d256-prod-github-runner-207 kernel: [72928.604838] ? __seccomp_filter+0x4a/0x4a0 Aug 23 01:39:14 juju-e4d256-prod-github-runner-207 kernel: [72928.605592] ? __fget_files+0x86/0xc0 Aug 23 01:39:14 juju-e4d256-prod-github-runner-207 kernel: [72928.606299] __x64_sys_ioctl+0x95/0xd0 Aug 23 01:39:14 juju-e4d256-prod-github-runner-207 kernel: [72928.606990] do_syscall_64+0x5c/0xc0 Aug 23 01:39:14 juju-e4d256-prod-github-runner-207 kernel: [72928.607654] ? do_futex+0x162/0x1f0 Aug 23 01:39:14 juju-e4d256-prod-github-runner-207 kernel: [72928.608302] ? __x64_sys_futex+0x78/0x1e0 Aug 23 01:39:14 juju-e4d256-prod-github-runner-207 kernel: [72928.608977] ? __secure_computing+0xa9/0x120 Aug 23 01:39:14 juju-e4d256-prod-github-runner-207 kernel: [72928.609677] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 01:39:14 juju-e4d256-prod-github-runner-207 kernel: [72928.610436] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:39:14 juju-e4d256-prod-github-runner-207 kernel: [72928.611162] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:39:14 juju-e4d256-prod-github-runner-207 kernel: [72928.611878] ? do_syscall_64+0x69/0xc0 Aug 23 01:39:14 juju-e4d256-prod-github-runner-207 kernel: [72928.612521] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:39:14 juju-e4d256-prod-github-runner-207 kernel: [72928.613242] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:39:14 juju-e4d256-prod-github-runner-207 kernel: [72928.613940] ? do_syscall_64+0x69/0xc0 Aug 23 01:39:14 juju-e4d256-prod-github-runner-207 kernel: [72928.614567] ? do_syscall_64+0x69/0xc0 Aug 23 01:39:14 juju-e4d256-prod-github-runner-207 kernel: [72928.615191] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 01:39:14 juju-e4d256-prod-github-runner-207 kernel: [72928.615896] RIP: 0033:0x7faa5d0edaff Aug 23 01:39:14 juju-e4d256-prod-github-runner-207 kernel: [72928.616519] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 01:39:14 juju-e4d256-prod-github-runner-207 kernel: [72928.618514] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 01:39:14 juju-e4d256-prod-github-runner-207 kernel: [72928.619423] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 01:39:14 juju-e4d256-prod-github-runner-207 kernel: [72928.620314] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 01:39:14 juju-e4d256-prod-github-runner-207 kernel: [72928.621216] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 01:39:14 juju-e4d256-prod-github-runner-207 kernel: [72928.622103] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 01:39:14 juju-e4d256-prod-github-runner-207 kernel: [72928.622990] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 01:39:14 juju-e4d256-prod-github-runner-207 kernel: [72928.623881] Aug 23 01:39:42 juju-e4d256-prod-github-runner-207 kernel: [72956.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 67838s! [qemu-system-x86:6715] Aug 23 01:39:42 juju-e4d256-prod-github-runner-207 kernel: [72956.543095] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 01:39:42 juju-e4d256-prod-github-runner-207 kernel: [72956.543165] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 01:39:42 juju-e4d256-prod-github-runner-207 kernel: [72956.555293] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 01:39:42 juju-e4d256-prod-github-runner-207 kernel: [72956.556723] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 01:39:42 juju-e4d256-prod-github-runner-207 kernel: [72956.557952] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:39:42 juju-e4d256-prod-github-runner-207 kernel: [72956.559005] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 01:39:42 juju-e4d256-prod-github-runner-207 kernel: [72956.561552] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 01:39:42 juju-e4d256-prod-github-runner-207 kernel: [72956.562591] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 01:39:42 juju-e4d256-prod-github-runner-207 kernel: [72956.563746] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 01:39:42 juju-e4d256-prod-github-runner-207 kernel: [72956.564921] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 01:39:42 juju-e4d256-prod-github-runner-207 kernel: [72956.566076] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 01:39:42 juju-e4d256-prod-github-runner-207 kernel: [72956.567232] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 01:39:42 juju-e4d256-prod-github-runner-207 kernel: [72956.568395] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 01:39:42 juju-e4d256-prod-github-runner-207 kernel: [72956.569630] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 01:39:42 juju-e4d256-prod-github-runner-207 kernel: [72956.570726] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 01:39:42 juju-e4d256-prod-github-runner-207 kernel: [72956.571921] Call Trace: Aug 23 01:39:42 juju-e4d256-prod-github-runner-207 kernel: [72956.572831] Aug 23 01:39:42 juju-e4d256-prod-github-runner-207 kernel: [72956.573721] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:39:42 juju-e4d256-prod-github-runner-207 kernel: [72956.574755] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:39:42 juju-e4d256-prod-github-runner-207 kernel: [72956.575778] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:39:42 juju-e4d256-prod-github-runner-207 kernel: [72956.577045] ? show_regs.part.0+0x23/0x29 Aug 23 01:39:42 juju-e4d256-prod-github-runner-207 kernel: [72956.578042] ? show_regs.cold+0x8/0xd Aug 23 01:39:42 juju-e4d256-prod-github-runner-207 kernel: [72956.579012] ? watchdog_timer_fn+0x1be/0x220 Aug 23 01:39:42 juju-e4d256-prod-github-runner-207 kernel: [72956.580022] ? lockup_detector_update_enable+0x60/0x60 Aug 23 01:39:42 juju-e4d256-prod-github-runner-207 kernel: [72956.581093] ? __hrtimer_run_queues+0x107/0x230 Aug 23 01:39:42 juju-e4d256-prod-github-runner-207 kernel: [72956.582127] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 01:39:42 juju-e4d256-prod-github-runner-207 kernel: [72956.583149] ? hrtimer_interrupt+0x101/0x220 Aug 23 01:39:42 juju-e4d256-prod-github-runner-207 kernel: [72956.584178] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 01:39:42 juju-e4d256-prod-github-runner-207 kernel: [72956.585253] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 01:39:42 juju-e4d256-prod-github-runner-207 kernel: [72956.586297] Aug 23 01:39:42 juju-e4d256-prod-github-runner-207 kernel: [72956.587152] Aug 23 01:39:42 juju-e4d256-prod-github-runner-207 kernel: [72956.587988] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 01:39:42 juju-e4d256-prod-github-runner-207 kernel: [72956.589056] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:39:42 juju-e4d256-prod-github-runner-207 kernel: [72956.590095] ? _raw_spin_lock+0x22/0x30 Aug 23 01:39:42 juju-e4d256-prod-github-runner-207 kernel: [72956.591038] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:39:42 juju-e4d256-prod-github-runner-207 kernel: [72956.592059] direct_page_fault+0x206/0x310 [kvm] Aug 23 01:39:42 juju-e4d256-prod-github-runner-207 kernel: [72956.593093] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 01:39:42 juju-e4d256-prod-github-runner-207 kernel: [72956.594103] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 01:39:42 juju-e4d256-prod-github-runner-207 kernel: [72956.595102] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 01:39:42 juju-e4d256-prod-github-runner-207 kernel: [72956.596073] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 01:39:42 juju-e4d256-prod-github-runner-207 kernel: [72956.597023] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 01:39:42 juju-e4d256-prod-github-runner-207 kernel: [72956.597999] handle_exit+0x98/0x230 [kvm_amd] Aug 23 01:39:42 juju-e4d256-prod-github-runner-207 kernel: [72956.598889] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 01:39:42 juju-e4d256-prod-github-runner-207 kernel: [72956.599802] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 01:39:42 juju-e4d256-prod-github-runner-207 kernel: [72956.600724] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 01:39:42 juju-e4d256-prod-github-runner-207 kernel: [72956.601633] vcpu_run+0x62/0x2c0 [kvm] Aug 23 01:39:42 juju-e4d256-prod-github-runner-207 kernel: [72956.602445] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 01:39:42 juju-e4d256-prod-github-runner-207 kernel: [72956.603255] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 01:39:42 juju-e4d256-prod-github-runner-207 kernel: [72956.604108] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 01:39:42 juju-e4d256-prod-github-runner-207 kernel: [72956.604933] ? __seccomp_filter+0x4a/0x4a0 Aug 23 01:39:42 juju-e4d256-prod-github-runner-207 kernel: [72956.605679] ? __fget_files+0x86/0xc0 Aug 23 01:39:42 juju-e4d256-prod-github-runner-207 kernel: [72956.606384] __x64_sys_ioctl+0x95/0xd0 Aug 23 01:39:42 juju-e4d256-prod-github-runner-207 kernel: [72956.607076] do_syscall_64+0x5c/0xc0 Aug 23 01:39:42 juju-e4d256-prod-github-runner-207 kernel: [72956.607740] ? do_futex+0x162/0x1f0 Aug 23 01:39:42 juju-e4d256-prod-github-runner-207 kernel: [72956.608392] ? __x64_sys_futex+0x78/0x1e0 Aug 23 01:39:42 juju-e4d256-prod-github-runner-207 kernel: [72956.609106] ? __secure_computing+0xa9/0x120 Aug 23 01:39:42 juju-e4d256-prod-github-runner-207 kernel: [72956.609798] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 01:39:42 juju-e4d256-prod-github-runner-207 kernel: [72956.610557] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:39:42 juju-e4d256-prod-github-runner-207 kernel: [72956.611278] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:39:42 juju-e4d256-prod-github-runner-207 kernel: [72956.612001] ? do_syscall_64+0x69/0xc0 Aug 23 01:39:42 juju-e4d256-prod-github-runner-207 kernel: [72956.612647] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:39:42 juju-e4d256-prod-github-runner-207 kernel: [72956.613356] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:39:42 juju-e4d256-prod-github-runner-207 kernel: [72956.614050] ? do_syscall_64+0x69/0xc0 Aug 23 01:39:42 juju-e4d256-prod-github-runner-207 kernel: [72956.614674] ? do_syscall_64+0x69/0xc0 Aug 23 01:39:42 juju-e4d256-prod-github-runner-207 kernel: [72956.615294] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 01:39:42 juju-e4d256-prod-github-runner-207 kernel: [72956.615998] RIP: 0033:0x7faa5d0edaff Aug 23 01:39:42 juju-e4d256-prod-github-runner-207 kernel: [72956.616623] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 01:39:42 juju-e4d256-prod-github-runner-207 kernel: [72956.618613] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 01:39:42 juju-e4d256-prod-github-runner-207 kernel: [72956.619541] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 01:39:42 juju-e4d256-prod-github-runner-207 kernel: [72956.620437] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 01:39:42 juju-e4d256-prod-github-runner-207 kernel: [72956.621335] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 01:39:42 juju-e4d256-prod-github-runner-207 kernel: [72956.622227] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 01:39:42 juju-e4d256-prod-github-runner-207 kernel: [72956.623116] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 01:39:42 juju-e4d256-prod-github-runner-207 kernel: [72956.624013] Aug 23 01:40:10 juju-e4d256-prod-github-runner-207 kernel: [72984.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 67864s! [qemu-system-x86:6715] Aug 23 01:40:10 juju-e4d256-prod-github-runner-207 kernel: [72984.543108] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 01:40:10 juju-e4d256-prod-github-runner-207 kernel: [72984.543176] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 01:40:10 juju-e4d256-prod-github-runner-207 kernel: [72984.555282] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 01:40:10 juju-e4d256-prod-github-runner-207 kernel: [72984.556559] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 01:40:10 juju-e4d256-prod-github-runner-207 kernel: [72984.557812] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:40:10 juju-e4d256-prod-github-runner-207 kernel: [72984.558873] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 01:40:10 juju-e4d256-prod-github-runner-207 kernel: [72984.561440] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 01:40:10 juju-e4d256-prod-github-runner-207 kernel: [72984.562485] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 01:40:10 juju-e4d256-prod-github-runner-207 kernel: [72984.563647] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 01:40:10 juju-e4d256-prod-github-runner-207 kernel: [72984.564857] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 01:40:10 juju-e4d256-prod-github-runner-207 kernel: [72984.566021] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 01:40:10 juju-e4d256-prod-github-runner-207 kernel: [72984.567184] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 01:40:10 juju-e4d256-prod-github-runner-207 kernel: [72984.568357] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 01:40:10 juju-e4d256-prod-github-runner-207 kernel: [72984.569609] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 01:40:10 juju-e4d256-prod-github-runner-207 kernel: [72984.570708] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 01:40:10 juju-e4d256-prod-github-runner-207 kernel: [72984.571912] Call Trace: Aug 23 01:40:10 juju-e4d256-prod-github-runner-207 kernel: [72984.572876] Aug 23 01:40:10 juju-e4d256-prod-github-runner-207 kernel: [72984.573769] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:40:10 juju-e4d256-prod-github-runner-207 kernel: [72984.574799] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:40:10 juju-e4d256-prod-github-runner-207 kernel: [72984.575820] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:40:10 juju-e4d256-prod-github-runner-207 kernel: [72984.576906] ? show_regs.part.0+0x23/0x29 Aug 23 01:40:10 juju-e4d256-prod-github-runner-207 kernel: [72984.577904] ? show_regs.cold+0x8/0xd Aug 23 01:40:10 juju-e4d256-prod-github-runner-207 kernel: [72984.578875] ? watchdog_timer_fn+0x1be/0x220 Aug 23 01:40:10 juju-e4d256-prod-github-runner-207 kernel: [72984.579884] ? lockup_detector_update_enable+0x60/0x60 Aug 23 01:40:10 juju-e4d256-prod-github-runner-207 kernel: [72984.580982] ? __hrtimer_run_queues+0x107/0x230 Aug 23 01:40:10 juju-e4d256-prod-github-runner-207 kernel: [72984.582025] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 01:40:10 juju-e4d256-prod-github-runner-207 kernel: [72984.583049] ? hrtimer_interrupt+0x101/0x220 Aug 23 01:40:10 juju-e4d256-prod-github-runner-207 kernel: [72984.584070] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 01:40:10 juju-e4d256-prod-github-runner-207 kernel: [72984.585154] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 01:40:10 juju-e4d256-prod-github-runner-207 kernel: [72984.586205] Aug 23 01:40:10 juju-e4d256-prod-github-runner-207 kernel: [72984.587058] Aug 23 01:40:10 juju-e4d256-prod-github-runner-207 kernel: [72984.587903] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 01:40:10 juju-e4d256-prod-github-runner-207 kernel: [72984.588948] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:40:10 juju-e4d256-prod-github-runner-207 kernel: [72984.589991] ? _raw_spin_lock+0x22/0x30 Aug 23 01:40:10 juju-e4d256-prod-github-runner-207 kernel: [72984.590938] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:40:10 juju-e4d256-prod-github-runner-207 kernel: [72984.591954] direct_page_fault+0x206/0x310 [kvm] Aug 23 01:40:10 juju-e4d256-prod-github-runner-207 kernel: [72984.592992] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 01:40:10 juju-e4d256-prod-github-runner-207 kernel: [72984.594000] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 01:40:10 juju-e4d256-prod-github-runner-207 kernel: [72984.595006] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 01:40:10 juju-e4d256-prod-github-runner-207 kernel: [72984.595976] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 01:40:10 juju-e4d256-prod-github-runner-207 kernel: [72984.596984] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 01:40:10 juju-e4d256-prod-github-runner-207 kernel: [72984.598036] handle_exit+0x98/0x230 [kvm_amd] Aug 23 01:40:10 juju-e4d256-prod-github-runner-207 kernel: [72984.598949] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 01:40:10 juju-e4d256-prod-github-runner-207 kernel: [72984.599871] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 01:40:10 juju-e4d256-prod-github-runner-207 kernel: [72984.600820] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 01:40:10 juju-e4d256-prod-github-runner-207 kernel: [72984.601724] vcpu_run+0x62/0x2c0 [kvm] Aug 23 01:40:10 juju-e4d256-prod-github-runner-207 kernel: [72984.602541] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 01:40:10 juju-e4d256-prod-github-runner-207 kernel: [72984.603349] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 01:40:10 juju-e4d256-prod-github-runner-207 kernel: [72984.604201] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 01:40:10 juju-e4d256-prod-github-runner-207 kernel: [72984.605012] ? __seccomp_filter+0x4a/0x4a0 Aug 23 01:40:10 juju-e4d256-prod-github-runner-207 kernel: [72984.605753] ? __fget_files+0x86/0xc0 Aug 23 01:40:10 juju-e4d256-prod-github-runner-207 kernel: [72984.606458] __x64_sys_ioctl+0x95/0xd0 Aug 23 01:40:10 juju-e4d256-prod-github-runner-207 kernel: [72984.607150] do_syscall_64+0x5c/0xc0 Aug 23 01:40:10 juju-e4d256-prod-github-runner-207 kernel: [72984.607813] ? do_futex+0x162/0x1f0 Aug 23 01:40:10 juju-e4d256-prod-github-runner-207 kernel: [72984.608460] ? __x64_sys_futex+0x78/0x1e0 Aug 23 01:40:10 juju-e4d256-prod-github-runner-207 kernel: [72984.609153] ? __secure_computing+0xa9/0x120 Aug 23 01:40:10 juju-e4d256-prod-github-runner-207 kernel: [72984.609841] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 01:40:10 juju-e4d256-prod-github-runner-207 kernel: [72984.610599] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:40:10 juju-e4d256-prod-github-runner-207 kernel: [72984.611320] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:40:10 juju-e4d256-prod-github-runner-207 kernel: [72984.612037] ? do_syscall_64+0x69/0xc0 Aug 23 01:40:10 juju-e4d256-prod-github-runner-207 kernel: [72984.612696] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:40:10 juju-e4d256-prod-github-runner-207 kernel: [72984.613400] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:40:10 juju-e4d256-prod-github-runner-207 kernel: [72984.614093] ? do_syscall_64+0x69/0xc0 Aug 23 01:40:10 juju-e4d256-prod-github-runner-207 kernel: [72984.614716] ? do_syscall_64+0x69/0xc0 Aug 23 01:40:10 juju-e4d256-prod-github-runner-207 kernel: [72984.615338] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 01:40:10 juju-e4d256-prod-github-runner-207 kernel: [72984.616040] RIP: 0033:0x7faa5d0edaff Aug 23 01:40:10 juju-e4d256-prod-github-runner-207 kernel: [72984.616679] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 01:40:10 juju-e4d256-prod-github-runner-207 kernel: [72984.618665] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 01:40:10 juju-e4d256-prod-github-runner-207 kernel: [72984.619578] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 01:40:10 juju-e4d256-prod-github-runner-207 kernel: [72984.620466] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 01:40:10 juju-e4d256-prod-github-runner-207 kernel: [72984.621376] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 01:40:10 juju-e4d256-prod-github-runner-207 kernel: [72984.622262] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 01:40:10 juju-e4d256-prod-github-runner-207 kernel: [72984.623154] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 01:40:10 juju-e4d256-prod-github-runner-207 kernel: [72984.624043] Aug 23 01:40:38 juju-e4d256-prod-github-runner-207 kernel: [73012.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 67890s! [qemu-system-x86:6715] Aug 23 01:40:38 juju-e4d256-prod-github-runner-207 kernel: [73012.543723] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 01:40:38 juju-e4d256-prod-github-runner-207 kernel: [73012.543972] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 01:40:38 juju-e4d256-prod-github-runner-207 kernel: [73012.556093] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 01:40:38 juju-e4d256-prod-github-runner-207 kernel: [73012.557366] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 01:40:38 juju-e4d256-prod-github-runner-207 kernel: [73012.558592] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:40:38 juju-e4d256-prod-github-runner-207 kernel: [73012.559651] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 01:40:38 juju-e4d256-prod-github-runner-207 kernel: [73012.562215] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 01:40:38 juju-e4d256-prod-github-runner-207 kernel: [73012.563257] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 01:40:38 juju-e4d256-prod-github-runner-207 kernel: [73012.564433] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 01:40:38 juju-e4d256-prod-github-runner-207 kernel: [73012.565594] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 01:40:38 juju-e4d256-prod-github-runner-207 kernel: [73012.566753] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 01:40:38 juju-e4d256-prod-github-runner-207 kernel: [73012.567914] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 01:40:38 juju-e4d256-prod-github-runner-207 kernel: [73012.569230] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 01:40:38 juju-e4d256-prod-github-runner-207 kernel: [73012.570555] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 01:40:38 juju-e4d256-prod-github-runner-207 kernel: [73012.571658] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 01:40:38 juju-e4d256-prod-github-runner-207 kernel: [73012.572873] Call Trace: Aug 23 01:40:38 juju-e4d256-prod-github-runner-207 kernel: [73012.573798] Aug 23 01:40:38 juju-e4d256-prod-github-runner-207 kernel: [73012.574709] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:40:38 juju-e4d256-prod-github-runner-207 kernel: [73012.575744] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:40:38 juju-e4d256-prod-github-runner-207 kernel: [73012.576784] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:40:38 juju-e4d256-prod-github-runner-207 kernel: [73012.577883] ? show_regs.part.0+0x23/0x29 Aug 23 01:40:38 juju-e4d256-prod-github-runner-207 kernel: [73012.578880] ? show_regs.cold+0x8/0xd Aug 23 01:40:38 juju-e4d256-prod-github-runner-207 kernel: [73012.579856] ? watchdog_timer_fn+0x1be/0x220 Aug 23 01:40:38 juju-e4d256-prod-github-runner-207 kernel: [73012.580878] ? lockup_detector_update_enable+0x60/0x60 Aug 23 01:40:38 juju-e4d256-prod-github-runner-207 kernel: [73012.581943] ? __hrtimer_run_queues+0x107/0x230 Aug 23 01:40:38 juju-e4d256-prod-github-runner-207 kernel: [73012.582969] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 01:40:38 juju-e4d256-prod-github-runner-207 kernel: [73012.583997] ? hrtimer_interrupt+0x101/0x220 Aug 23 01:40:38 juju-e4d256-prod-github-runner-207 kernel: [73012.585020] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 01:40:38 juju-e4d256-prod-github-runner-207 kernel: [73012.586090] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 01:40:38 juju-e4d256-prod-github-runner-207 kernel: [73012.587136] Aug 23 01:40:38 juju-e4d256-prod-github-runner-207 kernel: [73012.587988] Aug 23 01:40:38 juju-e4d256-prod-github-runner-207 kernel: [73012.588832] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 01:40:38 juju-e4d256-prod-github-runner-207 kernel: [73012.589865] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:40:38 juju-e4d256-prod-github-runner-207 kernel: [73012.590909] ? _raw_spin_lock+0x22/0x30 Aug 23 01:40:38 juju-e4d256-prod-github-runner-207 kernel: [73012.591856] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:40:38 juju-e4d256-prod-github-runner-207 kernel: [73012.592885] direct_page_fault+0x206/0x310 [kvm] Aug 23 01:40:38 juju-e4d256-prod-github-runner-207 kernel: [73012.593909] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 01:40:38 juju-e4d256-prod-github-runner-207 kernel: [73012.594916] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 01:40:38 juju-e4d256-prod-github-runner-207 kernel: [73012.595917] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 01:40:38 juju-e4d256-prod-github-runner-207 kernel: [73012.596930] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 01:40:38 juju-e4d256-prod-github-runner-207 kernel: [73012.597875] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 01:40:38 juju-e4d256-prod-github-runner-207 kernel: [73012.598855] handle_exit+0x98/0x230 [kvm_amd] Aug 23 01:40:38 juju-e4d256-prod-github-runner-207 kernel: [73012.599804] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 01:40:38 juju-e4d256-prod-github-runner-207 kernel: [73012.600909] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 01:40:38 juju-e4d256-prod-github-runner-207 kernel: [73012.601845] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 01:40:38 juju-e4d256-prod-github-runner-207 kernel: [73012.602751] vcpu_run+0x62/0x2c0 [kvm] Aug 23 01:40:38 juju-e4d256-prod-github-runner-207 kernel: [73012.603564] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 01:40:38 juju-e4d256-prod-github-runner-207 kernel: [73012.604389] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 01:40:38 juju-e4d256-prod-github-runner-207 kernel: [73012.605246] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 01:40:38 juju-e4d256-prod-github-runner-207 kernel: [73012.606052] ? __seccomp_filter+0x4a/0x4a0 Aug 23 01:40:38 juju-e4d256-prod-github-runner-207 kernel: [73012.606794] ? __fget_files+0x86/0xc0 Aug 23 01:40:38 juju-e4d256-prod-github-runner-207 kernel: [73012.607505] __x64_sys_ioctl+0x95/0xd0 Aug 23 01:40:38 juju-e4d256-prod-github-runner-207 kernel: [73012.608197] do_syscall_64+0x5c/0xc0 Aug 23 01:40:38 juju-e4d256-prod-github-runner-207 kernel: [73012.608877] ? do_futex+0x162/0x1f0 Aug 23 01:40:38 juju-e4d256-prod-github-runner-207 kernel: [73012.609529] ? __x64_sys_futex+0x78/0x1e0 Aug 23 01:40:38 juju-e4d256-prod-github-runner-207 kernel: [73012.610203] ? __secure_computing+0xa9/0x120 Aug 23 01:40:38 juju-e4d256-prod-github-runner-207 kernel: [73012.610898] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 01:40:38 juju-e4d256-prod-github-runner-207 kernel: [73012.611667] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:40:38 juju-e4d256-prod-github-runner-207 kernel: [73012.612399] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:40:38 juju-e4d256-prod-github-runner-207 kernel: [73012.613117] ? do_syscall_64+0x69/0xc0 Aug 23 01:40:38 juju-e4d256-prod-github-runner-207 kernel: [73012.613763] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:40:38 juju-e4d256-prod-github-runner-207 kernel: [73012.614466] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:40:38 juju-e4d256-prod-github-runner-207 kernel: [73012.615161] ? do_syscall_64+0x69/0xc0 Aug 23 01:40:38 juju-e4d256-prod-github-runner-207 kernel: [73012.615910] ? do_syscall_64+0x69/0xc0 Aug 23 01:40:38 juju-e4d256-prod-github-runner-207 kernel: [73012.616540] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 01:40:38 juju-e4d256-prod-github-runner-207 kernel: [73012.617246] RIP: 0033:0x7faa5d0edaff Aug 23 01:40:38 juju-e4d256-prod-github-runner-207 kernel: [73012.617921] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 01:40:38 juju-e4d256-prod-github-runner-207 kernel: [73012.619904] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 01:40:38 juju-e4d256-prod-github-runner-207 kernel: [73012.620821] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 01:40:38 juju-e4d256-prod-github-runner-207 kernel: [73012.621717] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 01:40:38 juju-e4d256-prod-github-runner-207 kernel: [73012.622607] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 01:40:38 juju-e4d256-prod-github-runner-207 kernel: [73012.623494] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 01:40:38 juju-e4d256-prod-github-runner-207 kernel: [73012.624389] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 01:40:38 juju-e4d256-prod-github-runner-207 kernel: [73012.625283] Aug 23 01:41:06 juju-e4d256-prod-github-runner-207 kernel: [73040.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 67916s! [qemu-system-x86:6715] Aug 23 01:41:06 juju-e4d256-prod-github-runner-207 kernel: [73040.543100] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 01:41:06 juju-e4d256-prod-github-runner-207 kernel: [73040.543167] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 01:41:06 juju-e4d256-prod-github-runner-207 kernel: [73040.555242] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 01:41:06 juju-e4d256-prod-github-runner-207 kernel: [73040.556520] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 01:41:06 juju-e4d256-prod-github-runner-207 kernel: [73040.557746] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:41:06 juju-e4d256-prod-github-runner-207 kernel: [73040.558804] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 01:41:06 juju-e4d256-prod-github-runner-207 kernel: [73040.561377] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 01:41:06 juju-e4d256-prod-github-runner-207 kernel: [73040.562427] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 01:41:06 juju-e4d256-prod-github-runner-207 kernel: [73040.563597] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 01:41:06 juju-e4d256-prod-github-runner-207 kernel: [73040.564771] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 01:41:06 juju-e4d256-prod-github-runner-207 kernel: [73040.565938] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 01:41:06 juju-e4d256-prod-github-runner-207 kernel: [73040.567101] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 01:41:06 juju-e4d256-prod-github-runner-207 kernel: [73040.568281] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 01:41:06 juju-e4d256-prod-github-runner-207 kernel: [73040.569571] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 01:41:06 juju-e4d256-prod-github-runner-207 kernel: [73040.570669] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 01:41:06 juju-e4d256-prod-github-runner-207 kernel: [73040.571865] Call Trace: Aug 23 01:41:06 juju-e4d256-prod-github-runner-207 kernel: [73040.572789] Aug 23 01:41:06 juju-e4d256-prod-github-runner-207 kernel: [73040.573673] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:41:06 juju-e4d256-prod-github-runner-207 kernel: [73040.574707] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:41:06 juju-e4d256-prod-github-runner-207 kernel: [73040.575727] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:41:06 juju-e4d256-prod-github-runner-207 kernel: [73040.576815] ? show_regs.part.0+0x23/0x29 Aug 23 01:41:06 juju-e4d256-prod-github-runner-207 kernel: [73040.577817] ? show_regs.cold+0x8/0xd Aug 23 01:41:06 juju-e4d256-prod-github-runner-207 kernel: [73040.578969] ? watchdog_timer_fn+0x1be/0x220 Aug 23 01:41:06 juju-e4d256-prod-github-runner-207 kernel: [73040.579993] ? lockup_detector_update_enable+0x60/0x60 Aug 23 01:41:06 juju-e4d256-prod-github-runner-207 kernel: [73040.581056] ? __hrtimer_run_queues+0x107/0x230 Aug 23 01:41:06 juju-e4d256-prod-github-runner-207 kernel: [73040.582083] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 01:41:06 juju-e4d256-prod-github-runner-207 kernel: [73040.583106] ? hrtimer_interrupt+0x101/0x220 Aug 23 01:41:06 juju-e4d256-prod-github-runner-207 kernel: [73040.584137] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 01:41:06 juju-e4d256-prod-github-runner-207 kernel: [73040.585207] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 01:41:06 juju-e4d256-prod-github-runner-207 kernel: [73040.586254] Aug 23 01:41:06 juju-e4d256-prod-github-runner-207 kernel: [73040.587104] Aug 23 01:41:06 juju-e4d256-prod-github-runner-207 kernel: [73040.587959] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 01:41:06 juju-e4d256-prod-github-runner-207 kernel: [73040.588991] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:41:06 juju-e4d256-prod-github-runner-207 kernel: [73040.590029] ? _raw_spin_lock+0x22/0x30 Aug 23 01:41:06 juju-e4d256-prod-github-runner-207 kernel: [73040.590975] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:41:06 juju-e4d256-prod-github-runner-207 kernel: [73040.592018] direct_page_fault+0x206/0x310 [kvm] Aug 23 01:41:06 juju-e4d256-prod-github-runner-207 kernel: [73040.593043] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 01:41:06 juju-e4d256-prod-github-runner-207 kernel: [73040.594056] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 01:41:06 juju-e4d256-prod-github-runner-207 kernel: [73040.595055] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 01:41:06 juju-e4d256-prod-github-runner-207 kernel: [73040.596041] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 01:41:06 juju-e4d256-prod-github-runner-207 kernel: [73040.596990] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 01:41:06 juju-e4d256-prod-github-runner-207 kernel: [73040.597966] handle_exit+0x98/0x230 [kvm_amd] Aug 23 01:41:06 juju-e4d256-prod-github-runner-207 kernel: [73040.598857] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 01:41:06 juju-e4d256-prod-github-runner-207 kernel: [73040.599767] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 01:41:06 juju-e4d256-prod-github-runner-207 kernel: [73040.600700] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 01:41:06 juju-e4d256-prod-github-runner-207 kernel: [73040.601599] vcpu_run+0x62/0x2c0 [kvm] Aug 23 01:41:06 juju-e4d256-prod-github-runner-207 kernel: [73040.602408] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 01:41:06 juju-e4d256-prod-github-runner-207 kernel: [73040.603214] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 01:41:06 juju-e4d256-prod-github-runner-207 kernel: [73040.604085] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 01:41:06 juju-e4d256-prod-github-runner-207 kernel: [73040.604881] ? __seccomp_filter+0x4a/0x4a0 Aug 23 01:41:06 juju-e4d256-prod-github-runner-207 kernel: [73040.605621] ? __fget_files+0x86/0xc0 Aug 23 01:41:06 juju-e4d256-prod-github-runner-207 kernel: [73040.606322] __x64_sys_ioctl+0x95/0xd0 Aug 23 01:41:06 juju-e4d256-prod-github-runner-207 kernel: [73040.607018] do_syscall_64+0x5c/0xc0 Aug 23 01:41:06 juju-e4d256-prod-github-runner-207 kernel: [73040.607682] ? do_futex+0x162/0x1f0 Aug 23 01:41:06 juju-e4d256-prod-github-runner-207 kernel: [73040.608344] ? __x64_sys_futex+0x78/0x1e0 Aug 23 01:41:06 juju-e4d256-prod-github-runner-207 kernel: [73040.609015] ? __secure_computing+0xa9/0x120 Aug 23 01:41:06 juju-e4d256-prod-github-runner-207 kernel: [73040.609701] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 01:41:06 juju-e4d256-prod-github-runner-207 kernel: [73040.610458] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:41:06 juju-e4d256-prod-github-runner-207 kernel: [73040.611176] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:41:06 juju-e4d256-prod-github-runner-207 kernel: [73040.611913] ? do_syscall_64+0x69/0xc0 Aug 23 01:41:06 juju-e4d256-prod-github-runner-207 kernel: [73040.612556] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:41:06 juju-e4d256-prod-github-runner-207 kernel: [73040.613263] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:41:06 juju-e4d256-prod-github-runner-207 kernel: [73040.613957] ? do_syscall_64+0x69/0xc0 Aug 23 01:41:06 juju-e4d256-prod-github-runner-207 kernel: [73040.614579] ? do_syscall_64+0x69/0xc0 Aug 23 01:41:06 juju-e4d256-prod-github-runner-207 kernel: [73040.615199] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 01:41:06 juju-e4d256-prod-github-runner-207 kernel: [73040.615918] RIP: 0033:0x7faa5d0edaff Aug 23 01:41:06 juju-e4d256-prod-github-runner-207 kernel: [73040.616540] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 01:41:06 juju-e4d256-prod-github-runner-207 kernel: [73040.618524] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 01:41:06 juju-e4d256-prod-github-runner-207 kernel: [73040.619433] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 01:41:06 juju-e4d256-prod-github-runner-207 kernel: [73040.620337] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 01:41:06 juju-e4d256-prod-github-runner-207 kernel: [73040.621226] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 01:41:06 juju-e4d256-prod-github-runner-207 kernel: [73040.622110] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 01:41:06 juju-e4d256-prod-github-runner-207 kernel: [73040.623004] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 01:41:06 juju-e4d256-prod-github-runner-207 kernel: [73040.623925] Aug 23 01:41:34 juju-e4d256-prod-github-runner-207 kernel: [73068.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 67942s! [qemu-system-x86:6715] Aug 23 01:41:34 juju-e4d256-prod-github-runner-207 kernel: [73068.543091] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 01:41:34 juju-e4d256-prod-github-runner-207 kernel: [73068.543161] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 01:41:34 juju-e4d256-prod-github-runner-207 kernel: [73068.555267] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 01:41:34 juju-e4d256-prod-github-runner-207 kernel: [73068.556557] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 01:41:34 juju-e4d256-prod-github-runner-207 kernel: [73068.557778] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:41:34 juju-e4d256-prod-github-runner-207 kernel: [73068.558831] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 01:41:34 juju-e4d256-prod-github-runner-207 kernel: [73068.561385] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 01:41:34 juju-e4d256-prod-github-runner-207 kernel: [73068.562426] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 01:41:34 juju-e4d256-prod-github-runner-207 kernel: [73068.563603] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 01:41:34 juju-e4d256-prod-github-runner-207 kernel: [73068.564762] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 01:41:34 juju-e4d256-prod-github-runner-207 kernel: [73068.565920] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 01:41:34 juju-e4d256-prod-github-runner-207 kernel: [73068.567079] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 01:41:34 juju-e4d256-prod-github-runner-207 kernel: [73068.568253] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 01:41:34 juju-e4d256-prod-github-runner-207 kernel: [73068.569489] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 01:41:34 juju-e4d256-prod-github-runner-207 kernel: [73068.570585] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 01:41:34 juju-e4d256-prod-github-runner-207 kernel: [73068.571787] Call Trace: Aug 23 01:41:34 juju-e4d256-prod-github-runner-207 kernel: [73068.572699] Aug 23 01:41:34 juju-e4d256-prod-github-runner-207 kernel: [73068.573588] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:41:34 juju-e4d256-prod-github-runner-207 kernel: [73068.574615] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:41:34 juju-e4d256-prod-github-runner-207 kernel: [73068.575649] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:41:34 juju-e4d256-prod-github-runner-207 kernel: [73068.576722] ? show_regs.part.0+0x23/0x29 Aug 23 01:41:34 juju-e4d256-prod-github-runner-207 kernel: [73068.577723] ? show_regs.cold+0x8/0xd Aug 23 01:41:34 juju-e4d256-prod-github-runner-207 kernel: [73068.578692] ? watchdog_timer_fn+0x1be/0x220 Aug 23 01:41:34 juju-e4d256-prod-github-runner-207 kernel: [73068.579720] ? lockup_detector_update_enable+0x60/0x60 Aug 23 01:41:34 juju-e4d256-prod-github-runner-207 kernel: [73068.580782] ? __hrtimer_run_queues+0x107/0x230 Aug 23 01:41:34 juju-e4d256-prod-github-runner-207 kernel: [73068.581807] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 01:41:34 juju-e4d256-prod-github-runner-207 kernel: [73068.582828] ? hrtimer_interrupt+0x101/0x220 Aug 23 01:41:34 juju-e4d256-prod-github-runner-207 kernel: [73068.583853] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 01:41:34 juju-e4d256-prod-github-runner-207 kernel: [73068.584921] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 01:41:34 juju-e4d256-prod-github-runner-207 kernel: [73068.585971] Aug 23 01:41:34 juju-e4d256-prod-github-runner-207 kernel: [73068.586822] Aug 23 01:41:34 juju-e4d256-prod-github-runner-207 kernel: [73068.587671] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 01:41:34 juju-e4d256-prod-github-runner-207 kernel: [73068.588701] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:41:34 juju-e4d256-prod-github-runner-207 kernel: [73068.589742] ? _raw_spin_lock+0x22/0x30 Aug 23 01:41:34 juju-e4d256-prod-github-runner-207 kernel: [73068.590685] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:41:34 juju-e4d256-prod-github-runner-207 kernel: [73068.591711] direct_page_fault+0x206/0x310 [kvm] Aug 23 01:41:34 juju-e4d256-prod-github-runner-207 kernel: [73068.592739] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 01:41:34 juju-e4d256-prod-github-runner-207 kernel: [73068.593746] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 01:41:34 juju-e4d256-prod-github-runner-207 kernel: [73068.594750] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 01:41:34 juju-e4d256-prod-github-runner-207 kernel: [73068.595735] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 01:41:34 juju-e4d256-prod-github-runner-207 kernel: [73068.596680] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 01:41:34 juju-e4d256-prod-github-runner-207 kernel: [73068.597657] handle_exit+0x98/0x230 [kvm_amd] Aug 23 01:41:34 juju-e4d256-prod-github-runner-207 kernel: [73068.598550] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 01:41:34 juju-e4d256-prod-github-runner-207 kernel: [73068.599464] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 01:41:34 juju-e4d256-prod-github-runner-207 kernel: [73068.600398] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 01:41:34 juju-e4d256-prod-github-runner-207 kernel: [73068.601308] vcpu_run+0x62/0x2c0 [kvm] Aug 23 01:41:34 juju-e4d256-prod-github-runner-207 kernel: [73068.602118] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 01:41:34 juju-e4d256-prod-github-runner-207 kernel: [73068.602925] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 01:41:34 juju-e4d256-prod-github-runner-207 kernel: [73068.603788] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 01:41:34 juju-e4d256-prod-github-runner-207 kernel: [73068.604585] ? __seccomp_filter+0x4a/0x4a0 Aug 23 01:41:34 juju-e4d256-prod-github-runner-207 kernel: [73068.605331] ? __fget_files+0x86/0xc0 Aug 23 01:41:34 juju-e4d256-prod-github-runner-207 kernel: [73068.606035] __x64_sys_ioctl+0x95/0xd0 Aug 23 01:41:34 juju-e4d256-prod-github-runner-207 kernel: [73068.606726] do_syscall_64+0x5c/0xc0 Aug 23 01:41:34 juju-e4d256-prod-github-runner-207 kernel: [73068.607389] ? do_futex+0x162/0x1f0 Aug 23 01:41:34 juju-e4d256-prod-github-runner-207 kernel: [73068.608051] ? __x64_sys_futex+0x78/0x1e0 Aug 23 01:41:34 juju-e4d256-prod-github-runner-207 kernel: [73068.608724] ? __secure_computing+0xa9/0x120 Aug 23 01:41:34 juju-e4d256-prod-github-runner-207 kernel: [73068.609412] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 01:41:34 juju-e4d256-prod-github-runner-207 kernel: [73068.610171] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:41:34 juju-e4d256-prod-github-runner-207 kernel: [73068.610894] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:41:34 juju-e4d256-prod-github-runner-207 kernel: [73068.611623] ? do_syscall_64+0x69/0xc0 Aug 23 01:41:34 juju-e4d256-prod-github-runner-207 kernel: [73068.612267] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:41:34 juju-e4d256-prod-github-runner-207 kernel: [73068.612968] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:41:34 juju-e4d256-prod-github-runner-207 kernel: [73068.613661] ? do_syscall_64+0x69/0xc0 Aug 23 01:41:34 juju-e4d256-prod-github-runner-207 kernel: [73068.614289] ? do_syscall_64+0x69/0xc0 Aug 23 01:41:34 juju-e4d256-prod-github-runner-207 kernel: [73068.614910] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 01:41:34 juju-e4d256-prod-github-runner-207 kernel: [73068.615624] RIP: 0033:0x7faa5d0edaff Aug 23 01:41:34 juju-e4d256-prod-github-runner-207 kernel: [73068.616250] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 01:41:34 juju-e4d256-prod-github-runner-207 kernel: [73068.618237] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 01:41:34 juju-e4d256-prod-github-runner-207 kernel: [73068.619147] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 01:41:34 juju-e4d256-prod-github-runner-207 kernel: [73068.620054] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 01:41:34 juju-e4d256-prod-github-runner-207 kernel: [73068.620945] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 01:41:34 juju-e4d256-prod-github-runner-207 kernel: [73068.621832] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 01:41:34 juju-e4d256-prod-github-runner-207 kernel: [73068.622719] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 01:41:34 juju-e4d256-prod-github-runner-207 kernel: [73068.623619] Aug 23 01:41:48 juju-e4d256-prod-github-runner-207 kernel: [73082.060706] rcu: INFO: rcu_sched self-detected stall on CPU Aug 23 01:41:48 juju-e4d256-prod-github-runner-207 kernel: [73082.062356] rcu: 1-....: (18183832 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=8785335 Aug 23 01:41:48 juju-e4d256-prod-github-runner-207 kernel: [73082.063491] (t=18241215 jiffies g=23269 q=62321) Aug 23 01:41:48 juju-e4d256-prod-github-runner-207 kernel: [73082.064280] NMI backtrace for cpu 1 Aug 23 01:41:48 juju-e4d256-prod-github-runner-207 kernel: [73082.064988] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 01:41:48 juju-e4d256-prod-github-runner-207 kernel: [73082.066089] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 01:41:48 juju-e4d256-prod-github-runner-207 kernel: [73082.067151] Call Trace: Aug 23 01:41:48 juju-e4d256-prod-github-runner-207 kernel: [73082.067833] Aug 23 01:41:48 juju-e4d256-prod-github-runner-207 kernel: [73082.068487] show_stack+0x52/0x5c Aug 23 01:41:48 juju-e4d256-prod-github-runner-207 kernel: [73082.069215] dump_stack_lvl+0x4a/0x63 Aug 23 01:41:48 juju-e4d256-prod-github-runner-207 kernel: [73082.069958] dump_stack+0x10/0x16 Aug 23 01:41:48 juju-e4d256-prod-github-runner-207 kernel: [73082.070675] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 23 01:41:48 juju-e4d256-prod-github-runner-207 kernel: [73082.071466] ? lapic_can_unplug_cpu+0x90/0x90 Aug 23 01:41:48 juju-e4d256-prod-github-runner-207 kernel: [73082.072252] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 23 01:41:48 juju-e4d256-prod-github-runner-207 kernel: [73082.073072] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 23 01:41:48 juju-e4d256-prod-github-runner-207 kernel: [73082.073889] trigger_single_cpu_backtrace+0x44/0x4f Aug 23 01:41:48 juju-e4d256-prod-github-runner-207 kernel: [73082.074697] rcu_dump_cpu_stacks+0x102/0x149 Aug 23 01:41:48 juju-e4d256-prod-github-runner-207 kernel: [73082.075481] print_cpu_stall.cold+0x2f/0xe2 Aug 23 01:41:48 juju-e4d256-prod-github-runner-207 kernel: [73082.076247] ? timekeeping_update+0xf7/0x150 Aug 23 01:41:48 juju-e4d256-prod-github-runner-207 kernel: [73082.077015] check_cpu_stall+0x109/0x270 Aug 23 01:41:48 juju-e4d256-prod-github-runner-207 kernel: [73082.077765] rcu_sched_clock_irq+0x9a/0x250 Aug 23 01:41:48 juju-e4d256-prod-github-runner-207 kernel: [73082.078530] update_process_times+0x94/0xd0 Aug 23 01:41:48 juju-e4d256-prod-github-runner-207 kernel: [73082.079287] tick_sched_handle+0x29/0x70 Aug 23 01:41:48 juju-e4d256-prod-github-runner-207 kernel: [73082.080043] tick_sched_timer+0x8c/0xc0 Aug 23 01:41:48 juju-e4d256-prod-github-runner-207 kernel: [73082.080780] ? tick_nohz_handler+0xb0/0xb0 Aug 23 01:41:48 juju-e4d256-prod-github-runner-207 kernel: [73082.081538] __hrtimer_run_queues+0x107/0x230 Aug 23 01:41:48 juju-e4d256-prod-github-runner-207 kernel: [73082.082309] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 01:41:48 juju-e4d256-prod-github-runner-207 kernel: [73082.083082] hrtimer_interrupt+0x101/0x220 Aug 23 01:41:48 juju-e4d256-prod-github-runner-207 kernel: [73082.083844] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 01:41:48 juju-e4d256-prod-github-runner-207 kernel: [73082.084655] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 01:41:48 juju-e4d256-prod-github-runner-207 kernel: [73082.085456] Aug 23 01:41:48 juju-e4d256-prod-github-runner-207 kernel: [73082.086090] Aug 23 01:41:48 juju-e4d256-prod-github-runner-207 kernel: [73082.086716] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 01:41:48 juju-e4d256-prod-github-runner-207 kernel: [73082.087540] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:41:48 juju-e4d256-prod-github-runner-207 kernel: [73082.088417] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 01:41:48 juju-e4d256-prod-github-runner-207 kernel: [73082.090617] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 01:41:48 juju-e4d256-prod-github-runner-207 kernel: [73082.091497] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 01:41:48 juju-e4d256-prod-github-runner-207 kernel: [73082.092489] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 01:41:48 juju-e4d256-prod-github-runner-207 kernel: [73082.093467] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 01:41:48 juju-e4d256-prod-github-runner-207 kernel: [73082.094433] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 01:41:48 juju-e4d256-prod-github-runner-207 kernel: [73082.095407] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 01:41:48 juju-e4d256-prod-github-runner-207 kernel: [73082.096478] ? _raw_spin_lock+0x22/0x30 Aug 23 01:41:48 juju-e4d256-prod-github-runner-207 kernel: [73082.097248] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:41:48 juju-e4d256-prod-github-runner-207 kernel: [73082.098094] direct_page_fault+0x206/0x310 [kvm] Aug 23 01:41:48 juju-e4d256-prod-github-runner-207 kernel: [73082.098929] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 01:41:48 juju-e4d256-prod-github-runner-207 kernel: [73082.099761] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 01:41:48 juju-e4d256-prod-github-runner-207 kernel: [73082.100601] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 01:41:48 juju-e4d256-prod-github-runner-207 kernel: [73082.101525] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 01:41:48 juju-e4d256-prod-github-runner-207 kernel: [73082.102319] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 01:41:48 juju-e4d256-prod-github-runner-207 kernel: [73082.103142] handle_exit+0x98/0x230 [kvm_amd] Aug 23 01:41:48 juju-e4d256-prod-github-runner-207 kernel: [73082.103906] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 01:41:48 juju-e4d256-prod-github-runner-207 kernel: [73082.104692] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 01:41:48 juju-e4d256-prod-github-runner-207 kernel: [73082.105495] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 01:41:48 juju-e4d256-prod-github-runner-207 kernel: [73082.106279] vcpu_run+0x62/0x2c0 [kvm] Aug 23 01:41:48 juju-e4d256-prod-github-runner-207 kernel: [73082.106993] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 01:41:48 juju-e4d256-prod-github-runner-207 kernel: [73082.107745] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 01:41:48 juju-e4d256-prod-github-runner-207 kernel: [73082.108548] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 01:41:48 juju-e4d256-prod-github-runner-207 kernel: [73082.109309] ? __seccomp_filter+0x4a/0x4a0 Aug 23 01:41:48 juju-e4d256-prod-github-runner-207 kernel: [73082.110027] ? __fget_files+0x86/0xc0 Aug 23 01:41:48 juju-e4d256-prod-github-runner-207 kernel: [73082.110719] __x64_sys_ioctl+0x95/0xd0 Aug 23 01:41:48 juju-e4d256-prod-github-runner-207 kernel: [73082.111421] do_syscall_64+0x5c/0xc0 Aug 23 01:41:48 juju-e4d256-prod-github-runner-207 kernel: [73082.112101] ? do_futex+0x162/0x1f0 Aug 23 01:41:48 juju-e4d256-prod-github-runner-207 kernel: [73082.112774] ? __x64_sys_futex+0x78/0x1e0 Aug 23 01:41:48 juju-e4d256-prod-github-runner-207 kernel: [73082.113482] ? __secure_computing+0xa9/0x120 Aug 23 01:41:48 juju-e4d256-prod-github-runner-207 kernel: [73082.114199] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 01:41:48 juju-e4d256-prod-github-runner-207 kernel: [73082.114989] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:41:48 juju-e4d256-prod-github-runner-207 kernel: [73082.115752] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:41:48 juju-e4d256-prod-github-runner-207 kernel: [73082.116509] ? do_syscall_64+0x69/0xc0 Aug 23 01:41:48 juju-e4d256-prod-github-runner-207 kernel: [73082.117204] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:41:48 juju-e4d256-prod-github-runner-207 kernel: [73082.117962] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:41:48 juju-e4d256-prod-github-runner-207 kernel: [73082.118719] ? do_syscall_64+0x69/0xc0 Aug 23 01:41:48 juju-e4d256-prod-github-runner-207 kernel: [73082.119431] ? do_syscall_64+0x69/0xc0 Aug 23 01:41:48 juju-e4d256-prod-github-runner-207 kernel: [73082.120119] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 01:41:48 juju-e4d256-prod-github-runner-207 kernel: [73082.120890] RIP: 0033:0x7faa5d0edaff Aug 23 01:41:48 juju-e4d256-prod-github-runner-207 kernel: [73082.121587] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 01:41:48 juju-e4d256-prod-github-runner-207 kernel: [73082.123703] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 01:41:48 juju-e4d256-prod-github-runner-207 kernel: [73082.124665] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 01:41:48 juju-e4d256-prod-github-runner-207 kernel: [73082.125612] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 01:41:48 juju-e4d256-prod-github-runner-207 kernel: [73082.126564] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 01:41:48 juju-e4d256-prod-github-runner-207 kernel: [73082.127515] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 01:41:48 juju-e4d256-prod-github-runner-207 kernel: [73082.128444] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 01:41:48 juju-e4d256-prod-github-runner-207 kernel: [73082.129367] Aug 23 01:42:14 juju-e4d256-prod-github-runner-207 kernel: [73108.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 67979s! [qemu-system-x86:6715] Aug 23 01:42:14 juju-e4d256-prod-github-runner-207 kernel: [73108.543107] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 01:42:14 juju-e4d256-prod-github-runner-207 kernel: [73108.543403] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 01:42:14 juju-e4d256-prod-github-runner-207 kernel: [73108.555617] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 01:42:14 juju-e4d256-prod-github-runner-207 kernel: [73108.556879] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 01:42:14 juju-e4d256-prod-github-runner-207 kernel: [73108.558102] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:42:14 juju-e4d256-prod-github-runner-207 kernel: [73108.559176] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 01:42:14 juju-e4d256-prod-github-runner-207 kernel: [73108.561720] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 01:42:14 juju-e4d256-prod-github-runner-207 kernel: [73108.562766] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 01:42:14 juju-e4d256-prod-github-runner-207 kernel: [73108.563934] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 01:42:14 juju-e4d256-prod-github-runner-207 kernel: [73108.565096] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 01:42:14 juju-e4d256-prod-github-runner-207 kernel: [73108.566256] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 01:42:14 juju-e4d256-prod-github-runner-207 kernel: [73108.567428] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 01:42:14 juju-e4d256-prod-github-runner-207 kernel: [73108.568593] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 01:42:14 juju-e4d256-prod-github-runner-207 kernel: [73108.569823] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 01:42:14 juju-e4d256-prod-github-runner-207 kernel: [73108.570918] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 01:42:14 juju-e4d256-prod-github-runner-207 kernel: [73108.572122] Call Trace: Aug 23 01:42:14 juju-e4d256-prod-github-runner-207 kernel: [73108.573032] Aug 23 01:42:14 juju-e4d256-prod-github-runner-207 kernel: [73108.573916] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:42:14 juju-e4d256-prod-github-runner-207 kernel: [73108.574948] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:42:14 juju-e4d256-prod-github-runner-207 kernel: [73108.575979] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:42:14 juju-e4d256-prod-github-runner-207 kernel: [73108.577052] ? show_regs.part.0+0x23/0x29 Aug 23 01:42:14 juju-e4d256-prod-github-runner-207 kernel: [73108.578060] ? show_regs.cold+0x8/0xd Aug 23 01:42:14 juju-e4d256-prod-github-runner-207 kernel: [73108.579029] ? watchdog_timer_fn+0x1be/0x220 Aug 23 01:42:14 juju-e4d256-prod-github-runner-207 kernel: [73108.580048] ? lockup_detector_update_enable+0x60/0x60 Aug 23 01:42:14 juju-e4d256-prod-github-runner-207 kernel: [73108.581114] ? __hrtimer_run_queues+0x107/0x230 Aug 23 01:42:14 juju-e4d256-prod-github-runner-207 kernel: [73108.582142] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 01:42:14 juju-e4d256-prod-github-runner-207 kernel: [73108.583171] ? hrtimer_interrupt+0x101/0x220 Aug 23 01:42:14 juju-e4d256-prod-github-runner-207 kernel: [73108.584185] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 01:42:14 juju-e4d256-prod-github-runner-207 kernel: [73108.585252] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 01:42:14 juju-e4d256-prod-github-runner-207 kernel: [73108.586295] Aug 23 01:42:14 juju-e4d256-prod-github-runner-207 kernel: [73108.587155] Aug 23 01:42:14 juju-e4d256-prod-github-runner-207 kernel: [73108.587992] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 01:42:14 juju-e4d256-prod-github-runner-207 kernel: [73108.589022] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:42:14 juju-e4d256-prod-github-runner-207 kernel: [73108.590065] ? _raw_spin_lock+0x22/0x30 Aug 23 01:42:14 juju-e4d256-prod-github-runner-207 kernel: [73108.591012] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:42:14 juju-e4d256-prod-github-runner-207 kernel: [73108.592031] direct_page_fault+0x206/0x310 [kvm] Aug 23 01:42:14 juju-e4d256-prod-github-runner-207 kernel: [73108.593058] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 01:42:14 juju-e4d256-prod-github-runner-207 kernel: [73108.594071] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 01:42:14 juju-e4d256-prod-github-runner-207 kernel: [73108.595071] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 01:42:14 juju-e4d256-prod-github-runner-207 kernel: [73108.596132] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 01:42:14 juju-e4d256-prod-github-runner-207 kernel: [73108.597082] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 01:42:14 juju-e4d256-prod-github-runner-207 kernel: [73108.598058] handle_exit+0x98/0x230 [kvm_amd] Aug 23 01:42:14 juju-e4d256-prod-github-runner-207 kernel: [73108.598952] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 01:42:14 juju-e4d256-prod-github-runner-207 kernel: [73108.599870] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 01:42:14 juju-e4d256-prod-github-runner-207 kernel: [73108.600792] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 01:42:14 juju-e4d256-prod-github-runner-207 kernel: [73108.601698] vcpu_run+0x62/0x2c0 [kvm] Aug 23 01:42:14 juju-e4d256-prod-github-runner-207 kernel: [73108.602511] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 01:42:14 juju-e4d256-prod-github-runner-207 kernel: [73108.603321] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 01:42:14 juju-e4d256-prod-github-runner-207 kernel: [73108.604173] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 01:42:14 juju-e4d256-prod-github-runner-207 kernel: [73108.604965] ? __seccomp_filter+0x4a/0x4a0 Aug 23 01:42:14 juju-e4d256-prod-github-runner-207 kernel: [73108.605704] ? __fget_files+0x86/0xc0 Aug 23 01:42:14 juju-e4d256-prod-github-runner-207 kernel: [73108.606404] __x64_sys_ioctl+0x95/0xd0 Aug 23 01:42:14 juju-e4d256-prod-github-runner-207 kernel: [73108.607106] do_syscall_64+0x5c/0xc0 Aug 23 01:42:14 juju-e4d256-prod-github-runner-207 kernel: [73108.607766] ? do_futex+0x162/0x1f0 Aug 23 01:42:14 juju-e4d256-prod-github-runner-207 kernel: [73108.608411] ? __x64_sys_futex+0x78/0x1e0 Aug 23 01:42:14 juju-e4d256-prod-github-runner-207 kernel: [73108.609081] ? __secure_computing+0xa9/0x120 Aug 23 01:42:14 juju-e4d256-prod-github-runner-207 kernel: [73108.609767] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 01:42:14 juju-e4d256-prod-github-runner-207 kernel: [73108.610522] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:42:14 juju-e4d256-prod-github-runner-207 kernel: [73108.611252] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:42:14 juju-e4d256-prod-github-runner-207 kernel: [73108.611966] ? do_syscall_64+0x69/0xc0 Aug 23 01:42:14 juju-e4d256-prod-github-runner-207 kernel: [73108.612608] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:42:14 juju-e4d256-prod-github-runner-207 kernel: [73108.613309] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:42:14 juju-e4d256-prod-github-runner-207 kernel: [73108.614000] ? do_syscall_64+0x69/0xc0 Aug 23 01:42:14 juju-e4d256-prod-github-runner-207 kernel: [73108.614620] ? do_syscall_64+0x69/0xc0 Aug 23 01:42:14 juju-e4d256-prod-github-runner-207 kernel: [73108.615247] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 01:42:14 juju-e4d256-prod-github-runner-207 kernel: [73108.615950] RIP: 0033:0x7faa5d0edaff Aug 23 01:42:14 juju-e4d256-prod-github-runner-207 kernel: [73108.616576] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 01:42:14 juju-e4d256-prod-github-runner-207 kernel: [73108.618553] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 01:42:14 juju-e4d256-prod-github-runner-207 kernel: [73108.619646] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 01:42:14 juju-e4d256-prod-github-runner-207 kernel: [73108.620534] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 01:42:14 juju-e4d256-prod-github-runner-207 kernel: [73108.621429] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 01:42:14 juju-e4d256-prod-github-runner-207 kernel: [73108.622311] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 01:42:14 juju-e4d256-prod-github-runner-207 kernel: [73108.623201] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 01:42:14 juju-e4d256-prod-github-runner-207 kernel: [73108.624089] Aug 23 01:42:42 juju-e4d256-prod-github-runner-207 kernel: [73136.541980] watchdog: BUG: soft lockup - CPU#1 stuck for 68005s! [qemu-system-x86:6715] Aug 23 01:42:42 juju-e4d256-prod-github-runner-207 kernel: [73136.543090] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 01:42:42 juju-e4d256-prod-github-runner-207 kernel: [73136.543154] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 01:42:42 juju-e4d256-prod-github-runner-207 kernel: [73136.555171] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 01:42:42 juju-e4d256-prod-github-runner-207 kernel: [73136.556441] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 01:42:42 juju-e4d256-prod-github-runner-207 kernel: [73136.557664] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:42:42 juju-e4d256-prod-github-runner-207 kernel: [73136.558720] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 01:42:42 juju-e4d256-prod-github-runner-207 kernel: [73136.561294] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 01:42:42 juju-e4d256-prod-github-runner-207 kernel: [73136.562347] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 01:42:42 juju-e4d256-prod-github-runner-207 kernel: [73136.563513] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 01:42:42 juju-e4d256-prod-github-runner-207 kernel: [73136.564670] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 01:42:42 juju-e4d256-prod-github-runner-207 kernel: [73136.565827] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 01:42:42 juju-e4d256-prod-github-runner-207 kernel: [73136.566999] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 01:42:42 juju-e4d256-prod-github-runner-207 kernel: [73136.568167] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 01:42:42 juju-e4d256-prod-github-runner-207 kernel: [73136.569395] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 01:42:42 juju-e4d256-prod-github-runner-207 kernel: [73136.570488] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 01:42:42 juju-e4d256-prod-github-runner-207 kernel: [73136.571716] Call Trace: Aug 23 01:42:42 juju-e4d256-prod-github-runner-207 kernel: [73136.572639] Aug 23 01:42:42 juju-e4d256-prod-github-runner-207 kernel: [73136.573520] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:42:42 juju-e4d256-prod-github-runner-207 kernel: [73136.574590] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:42:42 juju-e4d256-prod-github-runner-207 kernel: [73136.575643] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:42:42 juju-e4d256-prod-github-runner-207 kernel: [73136.576719] ? show_regs.part.0+0x23/0x29 Aug 23 01:42:42 juju-e4d256-prod-github-runner-207 kernel: [73136.577806] ? show_regs.cold+0x8/0xd Aug 23 01:42:42 juju-e4d256-prod-github-runner-207 kernel: [73136.579110] ? watchdog_timer_fn+0x1be/0x220 Aug 23 01:42:42 juju-e4d256-prod-github-runner-207 kernel: [73136.580432] ? lockup_detector_update_enable+0x60/0x60 Aug 23 01:42:42 juju-e4d256-prod-github-runner-207 kernel: [73136.581597] ? __hrtimer_run_queues+0x107/0x230 Aug 23 01:42:42 juju-e4d256-prod-github-runner-207 kernel: [73136.582625] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 01:42:42 juju-e4d256-prod-github-runner-207 kernel: [73136.583672] ? hrtimer_interrupt+0x101/0x220 Aug 23 01:42:42 juju-e4d256-prod-github-runner-207 kernel: [73136.584685] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 01:42:42 juju-e4d256-prod-github-runner-207 kernel: [73136.585752] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 01:42:42 juju-e4d256-prod-github-runner-207 kernel: [73136.586809] Aug 23 01:42:42 juju-e4d256-prod-github-runner-207 kernel: [73136.587663] Aug 23 01:42:42 juju-e4d256-prod-github-runner-207 kernel: [73136.588499] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 01:42:42 juju-e4d256-prod-github-runner-207 kernel: [73136.589563] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:42:42 juju-e4d256-prod-github-runner-207 kernel: [73136.590657] ? _raw_spin_lock+0x22/0x30 Aug 23 01:42:42 juju-e4d256-prod-github-runner-207 kernel: [73136.591652] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:42:42 juju-e4d256-prod-github-runner-207 kernel: [73136.592708] direct_page_fault+0x206/0x310 [kvm] Aug 23 01:42:42 juju-e4d256-prod-github-runner-207 kernel: [73136.593746] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 01:42:42 juju-e4d256-prod-github-runner-207 kernel: [73136.594763] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 01:42:42 juju-e4d256-prod-github-runner-207 kernel: [73136.595796] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 01:42:42 juju-e4d256-prod-github-runner-207 kernel: [73136.596769] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 01:42:42 juju-e4d256-prod-github-runner-207 kernel: [73136.597713] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 01:42:42 juju-e4d256-prod-github-runner-207 kernel: [73136.598699] handle_exit+0x98/0x230 [kvm_amd] Aug 23 01:42:42 juju-e4d256-prod-github-runner-207 kernel: [73136.599604] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 01:42:42 juju-e4d256-prod-github-runner-207 kernel: [73136.600522] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 01:42:42 juju-e4d256-prod-github-runner-207 kernel: [73136.601459] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 01:42:42 juju-e4d256-prod-github-runner-207 kernel: [73136.602382] vcpu_run+0x62/0x2c0 [kvm] Aug 23 01:42:42 juju-e4d256-prod-github-runner-207 kernel: [73136.603210] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 01:42:42 juju-e4d256-prod-github-runner-207 kernel: [73136.604039] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 01:42:42 juju-e4d256-prod-github-runner-207 kernel: [73136.604903] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 01:42:42 juju-e4d256-prod-github-runner-207 kernel: [73136.605705] ? __seccomp_filter+0x4a/0x4a0 Aug 23 01:42:42 juju-e4d256-prod-github-runner-207 kernel: [73136.606449] ? __fget_files+0x86/0xc0 Aug 23 01:42:42 juju-e4d256-prod-github-runner-207 kernel: [73136.607172] __x64_sys_ioctl+0x95/0xd0 Aug 23 01:42:42 juju-e4d256-prod-github-runner-207 kernel: [73136.607868] do_syscall_64+0x5c/0xc0 Aug 23 01:42:42 juju-e4d256-prod-github-runner-207 kernel: [73136.608534] ? do_futex+0x162/0x1f0 Aug 23 01:42:42 juju-e4d256-prod-github-runner-207 kernel: [73136.609183] ? __x64_sys_futex+0x78/0x1e0 Aug 23 01:42:42 juju-e4d256-prod-github-runner-207 kernel: [73136.609856] ? __secure_computing+0xa9/0x120 Aug 23 01:42:42 juju-e4d256-prod-github-runner-207 kernel: [73136.610549] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 01:42:42 juju-e4d256-prod-github-runner-207 kernel: [73136.611318] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:42:42 juju-e4d256-prod-github-runner-207 kernel: [73136.612045] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:42:42 juju-e4d256-prod-github-runner-207 kernel: [73136.612763] ? do_syscall_64+0x69/0xc0 Aug 23 01:42:42 juju-e4d256-prod-github-runner-207 kernel: [73136.613415] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:42:42 juju-e4d256-prod-github-runner-207 kernel: [73136.614128] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:42:42 juju-e4d256-prod-github-runner-207 kernel: [73136.614864] ? do_syscall_64+0x69/0xc0 Aug 23 01:42:42 juju-e4d256-prod-github-runner-207 kernel: [73136.615509] ? do_syscall_64+0x69/0xc0 Aug 23 01:42:42 juju-e4d256-prod-github-runner-207 kernel: [73136.616151] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 01:42:42 juju-e4d256-prod-github-runner-207 kernel: [73136.616881] RIP: 0033:0x7faa5d0edaff Aug 23 01:42:42 juju-e4d256-prod-github-runner-207 kernel: [73136.617525] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 01:42:42 juju-e4d256-prod-github-runner-207 kernel: [73136.619551] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 01:42:42 juju-e4d256-prod-github-runner-207 kernel: [73136.620477] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 01:42:42 juju-e4d256-prod-github-runner-207 kernel: [73136.621388] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 01:42:42 juju-e4d256-prod-github-runner-207 kernel: [73136.622284] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 01:42:42 juju-e4d256-prod-github-runner-207 kernel: [73136.623191] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 01:42:42 juju-e4d256-prod-github-runner-207 kernel: [73136.624088] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 01:42:42 juju-e4d256-prod-github-runner-207 kernel: [73136.624995] Aug 23 01:43:10 juju-e4d256-prod-github-runner-207 kernel: [73164.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 68031s! [qemu-system-x86:6715] Aug 23 01:43:10 juju-e4d256-prod-github-runner-207 kernel: [73164.543156] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 01:43:10 juju-e4d256-prod-github-runner-207 kernel: [73164.543224] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 01:43:10 juju-e4d256-prod-github-runner-207 kernel: [73164.555549] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 01:43:10 juju-e4d256-prod-github-runner-207 kernel: [73164.556828] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 01:43:10 juju-e4d256-prod-github-runner-207 kernel: [73164.558052] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:43:10 juju-e4d256-prod-github-runner-207 kernel: [73164.559184] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 01:43:10 juju-e4d256-prod-github-runner-207 kernel: [73164.561776] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 01:43:10 juju-e4d256-prod-github-runner-207 kernel: [73164.562937] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 01:43:10 juju-e4d256-prod-github-runner-207 kernel: [73164.564103] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 01:43:10 juju-e4d256-prod-github-runner-207 kernel: [73164.565284] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 01:43:10 juju-e4d256-prod-github-runner-207 kernel: [73164.566473] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 01:43:10 juju-e4d256-prod-github-runner-207 kernel: [73164.567677] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 01:43:10 juju-e4d256-prod-github-runner-207 kernel: [73164.568845] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 01:43:10 juju-e4d256-prod-github-runner-207 kernel: [73164.570273] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 01:43:10 juju-e4d256-prod-github-runner-207 kernel: [73164.571475] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 01:43:10 juju-e4d256-prod-github-runner-207 kernel: [73164.572683] Call Trace: Aug 23 01:43:10 juju-e4d256-prod-github-runner-207 kernel: [73164.573600] Aug 23 01:43:10 juju-e4d256-prod-github-runner-207 kernel: [73164.574520] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:43:10 juju-e4d256-prod-github-runner-207 kernel: [73164.575597] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:43:10 juju-e4d256-prod-github-runner-207 kernel: [73164.576756] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:43:10 juju-e4d256-prod-github-runner-207 kernel: [73164.577885] ? show_regs.part.0+0x23/0x29 Aug 23 01:43:10 juju-e4d256-prod-github-runner-207 kernel: [73164.578959] ? show_regs.cold+0x8/0xd Aug 23 01:43:10 juju-e4d256-prod-github-runner-207 kernel: [73164.579934] ? watchdog_timer_fn+0x1be/0x220 Aug 23 01:43:10 juju-e4d256-prod-github-runner-207 kernel: [73164.580986] ? lockup_detector_update_enable+0x60/0x60 Aug 23 01:43:10 juju-e4d256-prod-github-runner-207 kernel: [73164.582294] ? __hrtimer_run_queues+0x107/0x230 Aug 23 01:43:10 juju-e4d256-prod-github-runner-207 kernel: [73164.583557] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 01:43:10 juju-e4d256-prod-github-runner-207 kernel: [73164.584766] ? hrtimer_interrupt+0x101/0x220 Aug 23 01:43:10 juju-e4d256-prod-github-runner-207 kernel: [73164.586006] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 01:43:10 juju-e4d256-prod-github-runner-207 kernel: [73164.587097] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 01:43:10 juju-e4d256-prod-github-runner-207 kernel: [73164.588144] Aug 23 01:43:10 juju-e4d256-prod-github-runner-207 kernel: [73164.589002] Aug 23 01:43:10 juju-e4d256-prod-github-runner-207 kernel: [73164.589840] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 01:43:10 juju-e4d256-prod-github-runner-207 kernel: [73164.590891] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:43:10 juju-e4d256-prod-github-runner-207 kernel: [73164.591935] ? _raw_spin_lock+0x22/0x30 Aug 23 01:43:10 juju-e4d256-prod-github-runner-207 kernel: [73164.592880] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:43:10 juju-e4d256-prod-github-runner-207 kernel: [73164.593901] direct_page_fault+0x206/0x310 [kvm] Aug 23 01:43:10 juju-e4d256-prod-github-runner-207 kernel: [73164.594955] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 01:43:10 juju-e4d256-prod-github-runner-207 kernel: [73164.595973] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 01:43:10 juju-e4d256-prod-github-runner-207 kernel: [73164.596979] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 01:43:10 juju-e4d256-prod-github-runner-207 kernel: [73164.597952] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 01:43:10 juju-e4d256-prod-github-runner-207 kernel: [73164.598915] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 01:43:10 juju-e4d256-prod-github-runner-207 kernel: [73164.599894] handle_exit+0x98/0x230 [kvm_amd] Aug 23 01:43:10 juju-e4d256-prod-github-runner-207 kernel: [73164.600786] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 01:43:10 juju-e4d256-prod-github-runner-207 kernel: [73164.601708] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 01:43:10 juju-e4d256-prod-github-runner-207 kernel: [73164.602653] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 01:43:10 juju-e4d256-prod-github-runner-207 kernel: [73164.603558] vcpu_run+0x62/0x2c0 [kvm] Aug 23 01:43:10 juju-e4d256-prod-github-runner-207 kernel: [73164.604372] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 01:43:10 juju-e4d256-prod-github-runner-207 kernel: [73164.605179] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 01:43:10 juju-e4d256-prod-github-runner-207 kernel: [73164.606040] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 01:43:10 juju-e4d256-prod-github-runner-207 kernel: [73164.606853] ? __seccomp_filter+0x4a/0x4a0 Aug 23 01:43:10 juju-e4d256-prod-github-runner-207 kernel: [73164.607598] ? __fget_files+0x86/0xc0 Aug 23 01:43:10 juju-e4d256-prod-github-runner-207 kernel: [73164.608306] __x64_sys_ioctl+0x95/0xd0 Aug 23 01:43:10 juju-e4d256-prod-github-runner-207 kernel: [73164.608998] do_syscall_64+0x5c/0xc0 Aug 23 01:43:10 juju-e4d256-prod-github-runner-207 kernel: [73164.609662] ? do_futex+0x162/0x1f0 Aug 23 01:43:10 juju-e4d256-prod-github-runner-207 kernel: [73164.610313] ? __x64_sys_futex+0x78/0x1e0 Aug 23 01:43:10 juju-e4d256-prod-github-runner-207 kernel: [73164.611002] ? __secure_computing+0xa9/0x120 Aug 23 01:43:10 juju-e4d256-prod-github-runner-207 kernel: [73164.611694] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 01:43:10 juju-e4d256-prod-github-runner-207 kernel: [73164.612453] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:43:10 juju-e4d256-prod-github-runner-207 kernel: [73164.613181] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:43:10 juju-e4d256-prod-github-runner-207 kernel: [73164.613897] ? do_syscall_64+0x69/0xc0 Aug 23 01:43:10 juju-e4d256-prod-github-runner-207 kernel: [73164.614572] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:43:10 juju-e4d256-prod-github-runner-207 kernel: [73164.615277] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:43:10 juju-e4d256-prod-github-runner-207 kernel: [73164.615982] ? do_syscall_64+0x69/0xc0 Aug 23 01:43:10 juju-e4d256-prod-github-runner-207 kernel: [73164.616606] ? do_syscall_64+0x69/0xc0 Aug 23 01:43:10 juju-e4d256-prod-github-runner-207 kernel: [73164.617231] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 01:43:10 juju-e4d256-prod-github-runner-207 kernel: [73164.617939] RIP: 0033:0x7faa5d0edaff Aug 23 01:43:10 juju-e4d256-prod-github-runner-207 kernel: [73164.618580] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 01:43:10 juju-e4d256-prod-github-runner-207 kernel: [73164.620573] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 01:43:10 juju-e4d256-prod-github-runner-207 kernel: [73164.621493] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 01:43:10 juju-e4d256-prod-github-runner-207 kernel: [73164.622385] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 01:43:10 juju-e4d256-prod-github-runner-207 kernel: [73164.623300] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 01:43:10 juju-e4d256-prod-github-runner-207 kernel: [73164.624190] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 01:43:10 juju-e4d256-prod-github-runner-207 kernel: [73164.625080] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 01:43:10 juju-e4d256-prod-github-runner-207 kernel: [73164.625980] Aug 23 01:43:38 juju-e4d256-prod-github-runner-207 kernel: [73192.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 68057s! [qemu-system-x86:6715] Aug 23 01:43:38 juju-e4d256-prod-github-runner-207 kernel: [73192.543717] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 01:43:38 juju-e4d256-prod-github-runner-207 kernel: [73192.543973] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 01:43:38 juju-e4d256-prod-github-runner-207 kernel: [73192.556026] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 01:43:38 juju-e4d256-prod-github-runner-207 kernel: [73192.557292] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 01:43:38 juju-e4d256-prod-github-runner-207 kernel: [73192.558517] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:43:38 juju-e4d256-prod-github-runner-207 kernel: [73192.559577] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 01:43:38 juju-e4d256-prod-github-runner-207 kernel: [73192.562182] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 01:43:38 juju-e4d256-prod-github-runner-207 kernel: [73192.563251] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 01:43:38 juju-e4d256-prod-github-runner-207 kernel: [73192.564417] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 01:43:38 juju-e4d256-prod-github-runner-207 kernel: [73192.565573] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 01:43:38 juju-e4d256-prod-github-runner-207 kernel: [73192.566737] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 01:43:38 juju-e4d256-prod-github-runner-207 kernel: [73192.567899] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 01:43:38 juju-e4d256-prod-github-runner-207 kernel: [73192.569068] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 01:43:38 juju-e4d256-prod-github-runner-207 kernel: [73192.570333] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 01:43:38 juju-e4d256-prod-github-runner-207 kernel: [73192.571439] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 01:43:38 juju-e4d256-prod-github-runner-207 kernel: [73192.572635] Call Trace: Aug 23 01:43:38 juju-e4d256-prod-github-runner-207 kernel: [73192.573546] Aug 23 01:43:38 juju-e4d256-prod-github-runner-207 kernel: [73192.574459] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:43:38 juju-e4d256-prod-github-runner-207 kernel: [73192.575537] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:43:38 juju-e4d256-prod-github-runner-207 kernel: [73192.576563] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:43:38 juju-e4d256-prod-github-runner-207 kernel: [73192.577734] ? show_regs.part.0+0x23/0x29 Aug 23 01:43:38 juju-e4d256-prod-github-runner-207 kernel: [73192.578794] ? show_regs.cold+0x8/0xd Aug 23 01:43:38 juju-e4d256-prod-github-runner-207 kernel: [73192.579778] ? watchdog_timer_fn+0x1be/0x220 Aug 23 01:43:38 juju-e4d256-prod-github-runner-207 kernel: [73192.580795] ? lockup_detector_update_enable+0x60/0x60 Aug 23 01:43:38 juju-e4d256-prod-github-runner-207 kernel: [73192.581859] ? __hrtimer_run_queues+0x107/0x230 Aug 23 01:43:38 juju-e4d256-prod-github-runner-207 kernel: [73192.582900] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 01:43:38 juju-e4d256-prod-github-runner-207 kernel: [73192.583948] ? hrtimer_interrupt+0x101/0x220 Aug 23 01:43:38 juju-e4d256-prod-github-runner-207 kernel: [73192.584971] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 01:43:38 juju-e4d256-prod-github-runner-207 kernel: [73192.586036] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 01:43:38 juju-e4d256-prod-github-runner-207 kernel: [73192.587094] Aug 23 01:43:38 juju-e4d256-prod-github-runner-207 kernel: [73192.587953] Aug 23 01:43:38 juju-e4d256-prod-github-runner-207 kernel: [73192.588788] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 01:43:38 juju-e4d256-prod-github-runner-207 kernel: [73192.589819] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:43:38 juju-e4d256-prod-github-runner-207 kernel: [73192.590884] ? _raw_spin_lock+0x22/0x30 Aug 23 01:43:38 juju-e4d256-prod-github-runner-207 kernel: [73192.591842] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:43:38 juju-e4d256-prod-github-runner-207 kernel: [73192.592872] direct_page_fault+0x206/0x310 [kvm] Aug 23 01:43:38 juju-e4d256-prod-github-runner-207 kernel: [73192.593899] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 01:43:38 juju-e4d256-prod-github-runner-207 kernel: [73192.594931] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 01:43:38 juju-e4d256-prod-github-runner-207 kernel: [73192.595931] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 01:43:38 juju-e4d256-prod-github-runner-207 kernel: [73192.596932] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 01:43:38 juju-e4d256-prod-github-runner-207 kernel: [73192.597877] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 01:43:38 juju-e4d256-prod-github-runner-207 kernel: [73192.598857] handle_exit+0x98/0x230 [kvm_amd] Aug 23 01:43:38 juju-e4d256-prod-github-runner-207 kernel: [73192.599745] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 01:43:38 juju-e4d256-prod-github-runner-207 kernel: [73192.600661] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 01:43:38 juju-e4d256-prod-github-runner-207 kernel: [73192.601584] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 01:43:38 juju-e4d256-prod-github-runner-207 kernel: [73192.602496] vcpu_run+0x62/0x2c0 [kvm] Aug 23 01:43:38 juju-e4d256-prod-github-runner-207 kernel: [73192.603312] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 01:43:38 juju-e4d256-prod-github-runner-207 kernel: [73192.604120] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 01:43:38 juju-e4d256-prod-github-runner-207 kernel: [73192.605014] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 01:43:38 juju-e4d256-prod-github-runner-207 kernel: [73192.605826] ? __seccomp_filter+0x4a/0x4a0 Aug 23 01:43:38 juju-e4d256-prod-github-runner-207 kernel: [73192.606587] ? __fget_files+0x86/0xc0 Aug 23 01:43:38 juju-e4d256-prod-github-runner-207 kernel: [73192.607295] __x64_sys_ioctl+0x95/0xd0 Aug 23 01:43:38 juju-e4d256-prod-github-runner-207 kernel: [73192.607988] do_syscall_64+0x5c/0xc0 Aug 23 01:43:38 juju-e4d256-prod-github-runner-207 kernel: [73192.608655] ? do_futex+0x162/0x1f0 Aug 23 01:43:38 juju-e4d256-prod-github-runner-207 kernel: [73192.609306] ? __x64_sys_futex+0x78/0x1e0 Aug 23 01:43:38 juju-e4d256-prod-github-runner-207 kernel: [73192.609980] ? __secure_computing+0xa9/0x120 Aug 23 01:43:38 juju-e4d256-prod-github-runner-207 kernel: [73192.610695] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 01:43:38 juju-e4d256-prod-github-runner-207 kernel: [73192.611457] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:43:38 juju-e4d256-prod-github-runner-207 kernel: [73192.612177] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:43:38 juju-e4d256-prod-github-runner-207 kernel: [73192.612895] ? do_syscall_64+0x69/0xc0 Aug 23 01:43:38 juju-e4d256-prod-github-runner-207 kernel: [73192.613538] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:43:38 juju-e4d256-prod-github-runner-207 kernel: [73192.614248] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:43:38 juju-e4d256-prod-github-runner-207 kernel: [73192.614943] ? do_syscall_64+0x69/0xc0 Aug 23 01:43:38 juju-e4d256-prod-github-runner-207 kernel: [73192.615572] ? do_syscall_64+0x69/0xc0 Aug 23 01:43:38 juju-e4d256-prod-github-runner-207 kernel: [73192.616200] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 01:43:38 juju-e4d256-prod-github-runner-207 kernel: [73192.616904] RIP: 0033:0x7faa5d0edaff Aug 23 01:43:38 juju-e4d256-prod-github-runner-207 kernel: [73192.617571] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 01:43:38 juju-e4d256-prod-github-runner-207 kernel: [73192.619576] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 01:43:38 juju-e4d256-prod-github-runner-207 kernel: [73192.620484] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 01:43:38 juju-e4d256-prod-github-runner-207 kernel: [73192.621374] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 01:43:38 juju-e4d256-prod-github-runner-207 kernel: [73192.622269] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 01:43:38 juju-e4d256-prod-github-runner-207 kernel: [73192.623157] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 01:43:38 juju-e4d256-prod-github-runner-207 kernel: [73192.624058] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 01:43:38 juju-e4d256-prod-github-runner-207 kernel: [73192.624948] Aug 23 01:44:06 juju-e4d256-prod-github-runner-207 kernel: [73220.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 68083s! [qemu-system-x86:6715] Aug 23 01:44:06 juju-e4d256-prod-github-runner-207 kernel: [73220.543093] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 01:44:06 juju-e4d256-prod-github-runner-207 kernel: [73220.543160] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 01:44:06 juju-e4d256-prod-github-runner-207 kernel: [73220.555222] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 01:44:06 juju-e4d256-prod-github-runner-207 kernel: [73220.556489] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 01:44:06 juju-e4d256-prod-github-runner-207 kernel: [73220.557709] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:44:06 juju-e4d256-prod-github-runner-207 kernel: [73220.558781] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 01:44:06 juju-e4d256-prod-github-runner-207 kernel: [73220.561324] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 01:44:06 juju-e4d256-prod-github-runner-207 kernel: [73220.562373] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 01:44:06 juju-e4d256-prod-github-runner-207 kernel: [73220.563539] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 01:44:06 juju-e4d256-prod-github-runner-207 kernel: [73220.564695] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 01:44:06 juju-e4d256-prod-github-runner-207 kernel: [73220.565869] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 01:44:06 juju-e4d256-prod-github-runner-207 kernel: [73220.567028] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 01:44:06 juju-e4d256-prod-github-runner-207 kernel: [73220.568191] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 01:44:06 juju-e4d256-prod-github-runner-207 kernel: [73220.569424] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 01:44:06 juju-e4d256-prod-github-runner-207 kernel: [73220.570531] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 01:44:06 juju-e4d256-prod-github-runner-207 kernel: [73220.571725] Call Trace: Aug 23 01:44:06 juju-e4d256-prod-github-runner-207 kernel: [73220.572642] Aug 23 01:44:06 juju-e4d256-prod-github-runner-207 kernel: [73220.573525] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:44:06 juju-e4d256-prod-github-runner-207 kernel: [73220.574569] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:44:06 juju-e4d256-prod-github-runner-207 kernel: [73220.575591] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:44:06 juju-e4d256-prod-github-runner-207 kernel: [73220.576664] ? show_regs.part.0+0x23/0x29 Aug 23 01:44:06 juju-e4d256-prod-github-runner-207 kernel: [73220.577660] ? show_regs.cold+0x8/0xd Aug 23 01:44:06 juju-e4d256-prod-github-runner-207 kernel: [73220.578643] ? watchdog_timer_fn+0x1be/0x220 Aug 23 01:44:06 juju-e4d256-prod-github-runner-207 kernel: [73220.579651] ? lockup_detector_update_enable+0x60/0x60 Aug 23 01:44:06 juju-e4d256-prod-github-runner-207 kernel: [73220.580715] ? __hrtimer_run_queues+0x107/0x230 Aug 23 01:44:06 juju-e4d256-prod-github-runner-207 kernel: [73220.581741] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 01:44:06 juju-e4d256-prod-github-runner-207 kernel: [73220.582776] ? hrtimer_interrupt+0x101/0x220 Aug 23 01:44:06 juju-e4d256-prod-github-runner-207 kernel: [73220.583788] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 01:44:06 juju-e4d256-prod-github-runner-207 kernel: [73220.584889] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 01:44:06 juju-e4d256-prod-github-runner-207 kernel: [73220.585948] Aug 23 01:44:06 juju-e4d256-prod-github-runner-207 kernel: [73220.586802] Aug 23 01:44:06 juju-e4d256-prod-github-runner-207 kernel: [73220.587637] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 01:44:06 juju-e4d256-prod-github-runner-207 kernel: [73220.588666] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:44:06 juju-e4d256-prod-github-runner-207 kernel: [73220.589857] ? _raw_spin_lock+0x22/0x30 Aug 23 01:44:06 juju-e4d256-prod-github-runner-207 kernel: [73220.590799] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:44:06 juju-e4d256-prod-github-runner-207 kernel: [73220.591815] direct_page_fault+0x206/0x310 [kvm] Aug 23 01:44:06 juju-e4d256-prod-github-runner-207 kernel: [73220.592835] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 01:44:06 juju-e4d256-prod-github-runner-207 kernel: [73220.593857] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 01:44:06 juju-e4d256-prod-github-runner-207 kernel: [73220.594902] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 01:44:06 juju-e4d256-prod-github-runner-207 kernel: [73220.595877] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 01:44:06 juju-e4d256-prod-github-runner-207 kernel: [73220.596823] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 01:44:06 juju-e4d256-prod-github-runner-207 kernel: [73220.597816] handle_exit+0x98/0x230 [kvm_amd] Aug 23 01:44:06 juju-e4d256-prod-github-runner-207 kernel: [73220.598708] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 01:44:06 juju-e4d256-prod-github-runner-207 kernel: [73220.599623] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 01:44:06 juju-e4d256-prod-github-runner-207 kernel: [73220.600547] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 01:44:06 juju-e4d256-prod-github-runner-207 kernel: [73220.601455] vcpu_run+0x62/0x2c0 [kvm] Aug 23 01:44:06 juju-e4d256-prod-github-runner-207 kernel: [73220.602288] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 01:44:06 juju-e4d256-prod-github-runner-207 kernel: [73220.603102] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 01:44:06 juju-e4d256-prod-github-runner-207 kernel: [73220.603962] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 01:44:06 juju-e4d256-prod-github-runner-207 kernel: [73220.604761] ? __seccomp_filter+0x4a/0x4a0 Aug 23 01:44:06 juju-e4d256-prod-github-runner-207 kernel: [73220.605508] ? __fget_files+0x86/0xc0 Aug 23 01:44:06 juju-e4d256-prod-github-runner-207 kernel: [73220.606224] __x64_sys_ioctl+0x95/0xd0 Aug 23 01:44:06 juju-e4d256-prod-github-runner-207 kernel: [73220.606919] do_syscall_64+0x5c/0xc0 Aug 23 01:44:06 juju-e4d256-prod-github-runner-207 kernel: [73220.607583] ? do_futex+0x162/0x1f0 Aug 23 01:44:06 juju-e4d256-prod-github-runner-207 kernel: [73220.608232] ? __x64_sys_futex+0x78/0x1e0 Aug 23 01:44:06 juju-e4d256-prod-github-runner-207 kernel: [73220.608911] ? __secure_computing+0xa9/0x120 Aug 23 01:44:06 juju-e4d256-prod-github-runner-207 kernel: [73220.609602] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 01:44:06 juju-e4d256-prod-github-runner-207 kernel: [73220.610387] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:44:06 juju-e4d256-prod-github-runner-207 kernel: [73220.611111] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:44:06 juju-e4d256-prod-github-runner-207 kernel: [73220.611830] ? do_syscall_64+0x69/0xc0 Aug 23 01:44:06 juju-e4d256-prod-github-runner-207 kernel: [73220.612476] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:44:06 juju-e4d256-prod-github-runner-207 kernel: [73220.613186] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:44:06 juju-e4d256-prod-github-runner-207 kernel: [73220.613893] ? do_syscall_64+0x69/0xc0 Aug 23 01:44:06 juju-e4d256-prod-github-runner-207 kernel: [73220.614520] ? do_syscall_64+0x69/0xc0 Aug 23 01:44:06 juju-e4d256-prod-github-runner-207 kernel: [73220.615142] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 01:44:06 juju-e4d256-prod-github-runner-207 kernel: [73220.615847] RIP: 0033:0x7faa5d0edaff Aug 23 01:44:06 juju-e4d256-prod-github-runner-207 kernel: [73220.616473] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 01:44:06 juju-e4d256-prod-github-runner-207 kernel: [73220.618473] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 01:44:06 juju-e4d256-prod-github-runner-207 kernel: [73220.619384] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 01:44:06 juju-e4d256-prod-github-runner-207 kernel: [73220.620275] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 01:44:06 juju-e4d256-prod-github-runner-207 kernel: [73220.621165] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 01:44:06 juju-e4d256-prod-github-runner-207 kernel: [73220.622070] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 01:44:06 juju-e4d256-prod-github-runner-207 kernel: [73220.622961] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 01:44:06 juju-e4d256-prod-github-runner-207 kernel: [73220.623854] Aug 23 01:44:34 juju-e4d256-prod-github-runner-207 kernel: [73248.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 68110s! [qemu-system-x86:6715] Aug 23 01:44:34 juju-e4d256-prod-github-runner-207 kernel: [73248.543087] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 01:44:34 juju-e4d256-prod-github-runner-207 kernel: [73248.543154] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 01:44:34 juju-e4d256-prod-github-runner-207 kernel: [73248.555191] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 01:44:34 juju-e4d256-prod-github-runner-207 kernel: [73248.556451] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 01:44:34 juju-e4d256-prod-github-runner-207 kernel: [73248.557691] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:44:34 juju-e4d256-prod-github-runner-207 kernel: [73248.558754] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 01:44:34 juju-e4d256-prod-github-runner-207 kernel: [73248.561304] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 01:44:34 juju-e4d256-prod-github-runner-207 kernel: [73248.562359] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 01:44:34 juju-e4d256-prod-github-runner-207 kernel: [73248.563523] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 01:44:34 juju-e4d256-prod-github-runner-207 kernel: [73248.564678] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 01:44:34 juju-e4d256-prod-github-runner-207 kernel: [73248.565852] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 01:44:34 juju-e4d256-prod-github-runner-207 kernel: [73248.567014] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 01:44:34 juju-e4d256-prod-github-runner-207 kernel: [73248.568179] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 01:44:34 juju-e4d256-prod-github-runner-207 kernel: [73248.569414] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 01:44:34 juju-e4d256-prod-github-runner-207 kernel: [73248.570523] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 01:44:34 juju-e4d256-prod-github-runner-207 kernel: [73248.571723] Call Trace: Aug 23 01:44:34 juju-e4d256-prod-github-runner-207 kernel: [73248.572635] Aug 23 01:44:34 juju-e4d256-prod-github-runner-207 kernel: [73248.573532] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:44:34 juju-e4d256-prod-github-runner-207 kernel: [73248.574560] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:44:34 juju-e4d256-prod-github-runner-207 kernel: [73248.575582] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:44:34 juju-e4d256-prod-github-runner-207 kernel: [73248.576682] ? show_regs.part.0+0x23/0x29 Aug 23 01:44:34 juju-e4d256-prod-github-runner-207 kernel: [73248.577690] ? show_regs.cold+0x8/0xd Aug 23 01:44:34 juju-e4d256-prod-github-runner-207 kernel: [73248.578661] ? watchdog_timer_fn+0x1be/0x220 Aug 23 01:44:34 juju-e4d256-prod-github-runner-207 kernel: [73248.579666] ? lockup_detector_update_enable+0x60/0x60 Aug 23 01:44:34 juju-e4d256-prod-github-runner-207 kernel: [73248.580730] ? __hrtimer_run_queues+0x107/0x230 Aug 23 01:44:34 juju-e4d256-prod-github-runner-207 kernel: [73248.583876] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 01:44:34 juju-e4d256-prod-github-runner-207 kernel: [73248.584907] ? hrtimer_interrupt+0x101/0x220 Aug 23 01:44:34 juju-e4d256-prod-github-runner-207 kernel: [73248.585940] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 01:44:34 juju-e4d256-prod-github-runner-207 kernel: [73248.587006] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 01:44:34 juju-e4d256-prod-github-runner-207 kernel: [73248.588054] Aug 23 01:44:34 juju-e4d256-prod-github-runner-207 kernel: [73248.588910] Aug 23 01:44:34 juju-e4d256-prod-github-runner-207 kernel: [73248.589758] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 01:44:34 juju-e4d256-prod-github-runner-207 kernel: [73248.590787] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:44:34 juju-e4d256-prod-github-runner-207 kernel: [73248.591827] ? _raw_spin_lock+0x22/0x30 Aug 23 01:44:34 juju-e4d256-prod-github-runner-207 kernel: [73248.592783] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:44:34 juju-e4d256-prod-github-runner-207 kernel: [73248.593858] direct_page_fault+0x206/0x310 [kvm] Aug 23 01:44:34 juju-e4d256-prod-github-runner-207 kernel: [73248.594891] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 01:44:34 juju-e4d256-prod-github-runner-207 kernel: [73248.595900] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 01:44:34 juju-e4d256-prod-github-runner-207 kernel: [73248.596898] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 01:44:34 juju-e4d256-prod-github-runner-207 kernel: [73248.597883] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 01:44:34 juju-e4d256-prod-github-runner-207 kernel: [73248.598828] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 01:44:34 juju-e4d256-prod-github-runner-207 kernel: [73248.599823] handle_exit+0x98/0x230 [kvm_amd] Aug 23 01:44:34 juju-e4d256-prod-github-runner-207 kernel: [73248.600713] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 01:44:34 juju-e4d256-prod-github-runner-207 kernel: [73248.601634] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 01:44:34 juju-e4d256-prod-github-runner-207 kernel: [73248.602554] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 01:44:34 juju-e4d256-prod-github-runner-207 kernel: [73248.603451] vcpu_run+0x62/0x2c0 [kvm] Aug 23 01:44:34 juju-e4d256-prod-github-runner-207 kernel: [73248.604257] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 01:44:34 juju-e4d256-prod-github-runner-207 kernel: [73248.605065] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 01:44:34 juju-e4d256-prod-github-runner-207 kernel: [73248.605936] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 01:44:34 juju-e4d256-prod-github-runner-207 kernel: [73248.606730] ? __seccomp_filter+0x4a/0x4a0 Aug 23 01:44:34 juju-e4d256-prod-github-runner-207 kernel: [73248.607468] ? __fget_files+0x86/0xc0 Aug 23 01:44:34 juju-e4d256-prod-github-runner-207 kernel: [73248.608182] __x64_sys_ioctl+0x95/0xd0 Aug 23 01:44:34 juju-e4d256-prod-github-runner-207 kernel: [73248.608872] do_syscall_64+0x5c/0xc0 Aug 23 01:44:34 juju-e4d256-prod-github-runner-207 kernel: [73248.609568] ? do_futex+0x162/0x1f0 Aug 23 01:44:34 juju-e4d256-prod-github-runner-207 kernel: [73248.610268] ? __x64_sys_futex+0x78/0x1e0 Aug 23 01:44:34 juju-e4d256-prod-github-runner-207 kernel: [73248.610959] ? __secure_computing+0xa9/0x120 Aug 23 01:44:34 juju-e4d256-prod-github-runner-207 kernel: [73248.611658] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 01:44:34 juju-e4d256-prod-github-runner-207 kernel: [73248.612438] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:44:34 juju-e4d256-prod-github-runner-207 kernel: [73248.613159] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:44:34 juju-e4d256-prod-github-runner-207 kernel: [73248.613888] ? do_syscall_64+0x69/0xc0 Aug 23 01:44:34 juju-e4d256-prod-github-runner-207 kernel: [73248.614531] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:44:34 juju-e4d256-prod-github-runner-207 kernel: [73248.615230] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:44:34 juju-e4d256-prod-github-runner-207 kernel: [73248.615922] ? do_syscall_64+0x69/0xc0 Aug 23 01:44:34 juju-e4d256-prod-github-runner-207 kernel: [73248.616544] ? do_syscall_64+0x69/0xc0 Aug 23 01:44:34 juju-e4d256-prod-github-runner-207 kernel: [73248.617164] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 01:44:34 juju-e4d256-prod-github-runner-207 kernel: [73248.617880] RIP: 0033:0x7faa5d0edaff Aug 23 01:44:34 juju-e4d256-prod-github-runner-207 kernel: [73248.618503] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 01:44:34 juju-e4d256-prod-github-runner-207 kernel: [73248.620483] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 01:44:34 juju-e4d256-prod-github-runner-207 kernel: [73248.621396] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 01:44:34 juju-e4d256-prod-github-runner-207 kernel: [73248.622298] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 01:44:34 juju-e4d256-prod-github-runner-207 kernel: [73248.623184] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 01:44:34 juju-e4d256-prod-github-runner-207 kernel: [73248.624077] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 01:44:34 juju-e4d256-prod-github-runner-207 kernel: [73248.624962] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 01:44:34 juju-e4d256-prod-github-runner-207 kernel: [73248.625868] Aug 23 01:44:48 juju-e4d256-prod-github-runner-207 kernel: [73262.072706] rcu: INFO: rcu_sched self-detected stall on CPU Aug 23 01:44:48 juju-e4d256-prod-github-runner-207 kernel: [73262.075528] rcu: 1-....: (18228701 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=8807294 Aug 23 01:44:48 juju-e4d256-prod-github-runner-207 kernel: [73262.077659] (t=18286218 jiffies g=23269 q=62445) Aug 23 01:44:48 juju-e4d256-prod-github-runner-207 kernel: [73262.078441] NMI backtrace for cpu 1 Aug 23 01:44:48 juju-e4d256-prod-github-runner-207 kernel: [73262.079147] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 01:44:48 juju-e4d256-prod-github-runner-207 kernel: [73262.080250] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 01:44:48 juju-e4d256-prod-github-runner-207 kernel: [73262.081307] Call Trace: Aug 23 01:44:48 juju-e4d256-prod-github-runner-207 kernel: [73262.081999] Aug 23 01:44:48 juju-e4d256-prod-github-runner-207 kernel: [73262.082656] show_stack+0x52/0x5c Aug 23 01:44:48 juju-e4d256-prod-github-runner-207 kernel: [73262.083384] dump_stack_lvl+0x4a/0x63 Aug 23 01:44:48 juju-e4d256-prod-github-runner-207 kernel: [73262.084127] dump_stack+0x10/0x16 Aug 23 01:44:48 juju-e4d256-prod-github-runner-207 kernel: [73262.084841] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 23 01:44:48 juju-e4d256-prod-github-runner-207 kernel: [73262.085644] ? lapic_can_unplug_cpu+0x90/0x90 Aug 23 01:44:48 juju-e4d256-prod-github-runner-207 kernel: [73262.086421] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 23 01:44:48 juju-e4d256-prod-github-runner-207 kernel: [73262.087240] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 23 01:44:48 juju-e4d256-prod-github-runner-207 kernel: [73262.088056] trigger_single_cpu_backtrace+0x44/0x4f Aug 23 01:44:48 juju-e4d256-prod-github-runner-207 kernel: [73262.088861] rcu_dump_cpu_stacks+0x102/0x149 Aug 23 01:44:48 juju-e4d256-prod-github-runner-207 kernel: [73262.089653] print_cpu_stall.cold+0x2f/0xe2 Aug 23 01:44:48 juju-e4d256-prod-github-runner-207 kernel: [73262.090416] ? timekeeping_update+0xf7/0x150 Aug 23 01:44:48 juju-e4d256-prod-github-runner-207 kernel: [73262.091185] check_cpu_stall+0x109/0x270 Aug 23 01:44:48 juju-e4d256-prod-github-runner-207 kernel: [73262.091929] rcu_sched_clock_irq+0x9a/0x250 Aug 23 01:44:48 juju-e4d256-prod-github-runner-207 kernel: [73262.092689] update_process_times+0x94/0xd0 Aug 23 01:44:48 juju-e4d256-prod-github-runner-207 kernel: [73262.093464] tick_sched_handle+0x29/0x70 Aug 23 01:44:48 juju-e4d256-prod-github-runner-207 kernel: [73262.094210] tick_sched_timer+0x8c/0xc0 Aug 23 01:44:48 juju-e4d256-prod-github-runner-207 kernel: [73262.094950] ? tick_nohz_handler+0xb0/0xb0 Aug 23 01:44:48 juju-e4d256-prod-github-runner-207 kernel: [73262.095703] __hrtimer_run_queues+0x107/0x230 Aug 23 01:44:48 juju-e4d256-prod-github-runner-207 kernel: [73262.096473] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 01:44:48 juju-e4d256-prod-github-runner-207 kernel: [73262.097245] hrtimer_interrupt+0x101/0x220 Aug 23 01:44:48 juju-e4d256-prod-github-runner-207 kernel: [73262.098014] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 01:44:48 juju-e4d256-prod-github-runner-207 kernel: [73262.098826] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 01:44:48 juju-e4d256-prod-github-runner-207 kernel: [73262.099627] Aug 23 01:44:48 juju-e4d256-prod-github-runner-207 kernel: [73262.100261] Aug 23 01:44:48 juju-e4d256-prod-github-runner-207 kernel: [73262.100889] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 01:44:48 juju-e4d256-prod-github-runner-207 kernel: [73262.101719] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:44:48 juju-e4d256-prod-github-runner-207 kernel: [73262.102603] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 01:44:48 juju-e4d256-prod-github-runner-207 kernel: [73262.104806] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 01:44:48 juju-e4d256-prod-github-runner-207 kernel: [73262.105707] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 01:44:48 juju-e4d256-prod-github-runner-207 kernel: [73262.106706] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 01:44:48 juju-e4d256-prod-github-runner-207 kernel: [73262.107680] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 01:44:48 juju-e4d256-prod-github-runner-207 kernel: [73262.108644] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 01:44:48 juju-e4d256-prod-github-runner-207 kernel: [73262.109619] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 01:44:48 juju-e4d256-prod-github-runner-207 kernel: [73262.110572] ? _raw_spin_lock+0x22/0x30 Aug 23 01:44:48 juju-e4d256-prod-github-runner-207 kernel: [73262.111342] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:44:48 juju-e4d256-prod-github-runner-207 kernel: [73262.112192] direct_page_fault+0x206/0x310 [kvm] Aug 23 01:44:48 juju-e4d256-prod-github-runner-207 kernel: [73262.113028] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 01:44:48 juju-e4d256-prod-github-runner-207 kernel: [73262.113867] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 01:44:48 juju-e4d256-prod-github-runner-207 kernel: [73262.114707] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 01:44:48 juju-e4d256-prod-github-runner-207 kernel: [73262.115541] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 01:44:48 juju-e4d256-prod-github-runner-207 kernel: [73262.116331] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 01:44:48 juju-e4d256-prod-github-runner-207 kernel: [73262.117152] handle_exit+0x98/0x230 [kvm_amd] Aug 23 01:44:48 juju-e4d256-prod-github-runner-207 kernel: [73262.117918] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 01:44:48 juju-e4d256-prod-github-runner-207 kernel: [73262.118698] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 01:44:48 juju-e4d256-prod-github-runner-207 kernel: [73262.119492] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 01:44:48 juju-e4d256-prod-github-runner-207 kernel: [73262.120275] vcpu_run+0x62/0x2c0 [kvm] Aug 23 01:44:48 juju-e4d256-prod-github-runner-207 kernel: [73262.120987] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 01:44:48 juju-e4d256-prod-github-runner-207 kernel: [73262.121732] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 01:44:48 juju-e4d256-prod-github-runner-207 kernel: [73262.122530] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 01:44:48 juju-e4d256-prod-github-runner-207 kernel: [73262.123289] ? __seccomp_filter+0x4a/0x4a0 Aug 23 01:44:48 juju-e4d256-prod-github-runner-207 kernel: [73262.124013] ? __fget_files+0x86/0xc0 Aug 23 01:44:48 juju-e4d256-prod-github-runner-207 kernel: [73262.124706] __x64_sys_ioctl+0x95/0xd0 Aug 23 01:44:48 juju-e4d256-prod-github-runner-207 kernel: [73262.125413] do_syscall_64+0x5c/0xc0 Aug 23 01:44:48 juju-e4d256-prod-github-runner-207 kernel: [73262.126091] ? do_futex+0x162/0x1f0 Aug 23 01:44:48 juju-e4d256-prod-github-runner-207 kernel: [73262.126763] ? __x64_sys_futex+0x78/0x1e0 Aug 23 01:44:48 juju-e4d256-prod-github-runner-207 kernel: [73262.127466] ? __secure_computing+0xa9/0x120 Aug 23 01:44:48 juju-e4d256-prod-github-runner-207 kernel: [73262.128179] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 01:44:48 juju-e4d256-prod-github-runner-207 kernel: [73262.128965] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:44:48 juju-e4d256-prod-github-runner-207 kernel: [73262.129726] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:44:48 juju-e4d256-prod-github-runner-207 kernel: [73262.130482] ? do_syscall_64+0x69/0xc0 Aug 23 01:44:48 juju-e4d256-prod-github-runner-207 kernel: [73262.131169] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:44:48 juju-e4d256-prod-github-runner-207 kernel: [73262.131920] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:44:48 juju-e4d256-prod-github-runner-207 kernel: [73262.132674] ? do_syscall_64+0x69/0xc0 Aug 23 01:44:48 juju-e4d256-prod-github-runner-207 kernel: [73262.133383] ? do_syscall_64+0x69/0xc0 Aug 23 01:44:48 juju-e4d256-prod-github-runner-207 kernel: [73262.134069] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 01:44:48 juju-e4d256-prod-github-runner-207 kernel: [73262.134839] RIP: 0033:0x7faa5d0edaff Aug 23 01:44:48 juju-e4d256-prod-github-runner-207 kernel: [73262.135550] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 01:44:48 juju-e4d256-prod-github-runner-207 kernel: [73262.137671] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 01:44:48 juju-e4d256-prod-github-runner-207 kernel: [73262.138630] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 01:44:48 juju-e4d256-prod-github-runner-207 kernel: [73262.139574] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 01:44:48 juju-e4d256-prod-github-runner-207 kernel: [73262.140517] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 01:44:48 juju-e4d256-prod-github-runner-207 kernel: [73262.141473] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 01:44:48 juju-e4d256-prod-github-runner-207 kernel: [73262.142396] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 01:44:48 juju-e4d256-prod-github-runner-207 kernel: [73262.143312] Aug 23 01:45:14 juju-e4d256-prod-github-runner-207 kernel: [73288.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 68147s! [qemu-system-x86:6715] Aug 23 01:45:14 juju-e4d256-prod-github-runner-207 kernel: [73288.543113] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 01:45:14 juju-e4d256-prod-github-runner-207 kernel: [73288.543413] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 01:45:14 juju-e4d256-prod-github-runner-207 kernel: [73288.555593] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 01:45:14 juju-e4d256-prod-github-runner-207 kernel: [73288.556859] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 01:45:14 juju-e4d256-prod-github-runner-207 kernel: [73288.558100] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:45:14 juju-e4d256-prod-github-runner-207 kernel: [73288.559180] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 01:45:14 juju-e4d256-prod-github-runner-207 kernel: [73288.561754] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 01:45:14 juju-e4d256-prod-github-runner-207 kernel: [73288.562796] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 01:45:14 juju-e4d256-prod-github-runner-207 kernel: [73288.563957] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 01:45:14 juju-e4d256-prod-github-runner-207 kernel: [73288.565138] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 01:45:14 juju-e4d256-prod-github-runner-207 kernel: [73288.566299] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 01:45:14 juju-e4d256-prod-github-runner-207 kernel: [73288.567463] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 01:45:14 juju-e4d256-prod-github-runner-207 kernel: [73288.568629] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 01:45:14 juju-e4d256-prod-github-runner-207 kernel: [73288.569902] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 01:45:14 juju-e4d256-prod-github-runner-207 kernel: [73288.571010] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 01:45:14 juju-e4d256-prod-github-runner-207 kernel: [73288.572203] Call Trace: Aug 23 01:45:14 juju-e4d256-prod-github-runner-207 kernel: [73288.573132] Aug 23 01:45:14 juju-e4d256-prod-github-runner-207 kernel: [73288.574015] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:45:14 juju-e4d256-prod-github-runner-207 kernel: [73288.575059] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:45:14 juju-e4d256-prod-github-runner-207 kernel: [73288.576079] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:45:14 juju-e4d256-prod-github-runner-207 kernel: [73288.577177] ? show_regs.part.0+0x23/0x29 Aug 23 01:45:14 juju-e4d256-prod-github-runner-207 kernel: [73288.578176] ? show_regs.cold+0x8/0xd Aug 23 01:45:14 juju-e4d256-prod-github-runner-207 kernel: [73288.579151] ? watchdog_timer_fn+0x1be/0x220 Aug 23 01:45:14 juju-e4d256-prod-github-runner-207 kernel: [73288.580182] ? lockup_detector_update_enable+0x60/0x60 Aug 23 01:45:14 juju-e4d256-prod-github-runner-207 kernel: [73288.581265] ? __hrtimer_run_queues+0x107/0x230 Aug 23 01:45:14 juju-e4d256-prod-github-runner-207 kernel: [73288.582297] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 01:45:14 juju-e4d256-prod-github-runner-207 kernel: [73288.583320] ? hrtimer_interrupt+0x101/0x220 Aug 23 01:45:14 juju-e4d256-prod-github-runner-207 kernel: [73288.584335] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 01:45:14 juju-e4d256-prod-github-runner-207 kernel: [73288.585428] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 01:45:14 juju-e4d256-prod-github-runner-207 kernel: [73288.586475] Aug 23 01:45:14 juju-e4d256-prod-github-runner-207 kernel: [73288.587327] Aug 23 01:45:14 juju-e4d256-prod-github-runner-207 kernel: [73288.588164] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 01:45:14 juju-e4d256-prod-github-runner-207 kernel: [73288.589224] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:45:14 juju-e4d256-prod-github-runner-207 kernel: [73288.590276] ? _raw_spin_lock+0x22/0x30 Aug 23 01:45:14 juju-e4d256-prod-github-runner-207 kernel: [73288.591232] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:45:14 juju-e4d256-prod-github-runner-207 kernel: [73288.592245] direct_page_fault+0x206/0x310 [kvm] Aug 23 01:45:14 juju-e4d256-prod-github-runner-207 kernel: [73288.593282] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 01:45:14 juju-e4d256-prod-github-runner-207 kernel: [73288.594292] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 01:45:14 juju-e4d256-prod-github-runner-207 kernel: [73288.595294] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 01:45:14 juju-e4d256-prod-github-runner-207 kernel: [73288.596275] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 01:45:14 juju-e4d256-prod-github-runner-207 kernel: [73288.597245] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 01:45:14 juju-e4d256-prod-github-runner-207 kernel: [73288.598231] handle_exit+0x98/0x230 [kvm_amd] Aug 23 01:45:14 juju-e4d256-prod-github-runner-207 kernel: [73288.599123] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 01:45:14 juju-e4d256-prod-github-runner-207 kernel: [73288.600035] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 01:45:14 juju-e4d256-prod-github-runner-207 kernel: [73288.600992] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 01:45:14 juju-e4d256-prod-github-runner-207 kernel: [73288.601916] vcpu_run+0x62/0x2c0 [kvm] Aug 23 01:45:14 juju-e4d256-prod-github-runner-207 kernel: [73288.602921] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 01:45:14 juju-e4d256-prod-github-runner-207 kernel: [73288.604791] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 01:45:14 juju-e4d256-prod-github-runner-207 kernel: [73288.605668] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 01:45:14 juju-e4d256-prod-github-runner-207 kernel: [73288.606480] ? __seccomp_filter+0x4a/0x4a0 Aug 23 01:45:14 juju-e4d256-prod-github-runner-207 kernel: [73288.607220] ? __fget_files+0x86/0xc0 Aug 23 01:45:14 juju-e4d256-prod-github-runner-207 kernel: [73288.607921] __x64_sys_ioctl+0x95/0xd0 Aug 23 01:45:14 juju-e4d256-prod-github-runner-207 kernel: [73288.608612] do_syscall_64+0x5c/0xc0 Aug 23 01:45:14 juju-e4d256-prod-github-runner-207 kernel: [73288.609300] ? do_futex+0x162/0x1f0 Aug 23 01:45:14 juju-e4d256-prod-github-runner-207 kernel: [73288.609946] ? __x64_sys_futex+0x78/0x1e0 Aug 23 01:45:14 juju-e4d256-prod-github-runner-207 kernel: [73288.610615] ? __secure_computing+0xa9/0x120 Aug 23 01:45:14 juju-e4d256-prod-github-runner-207 kernel: [73288.611332] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 01:45:14 juju-e4d256-prod-github-runner-207 kernel: [73288.612095] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:45:14 juju-e4d256-prod-github-runner-207 kernel: [73288.612813] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:45:14 juju-e4d256-prod-github-runner-207 kernel: [73288.613548] ? do_syscall_64+0x69/0xc0 Aug 23 01:45:14 juju-e4d256-prod-github-runner-207 kernel: [73288.614196] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:45:14 juju-e4d256-prod-github-runner-207 kernel: [73288.614898] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:45:14 juju-e4d256-prod-github-runner-207 kernel: [73288.615590] ? do_syscall_64+0x69/0xc0 Aug 23 01:45:14 juju-e4d256-prod-github-runner-207 kernel: [73288.616213] ? do_syscall_64+0x69/0xc0 Aug 23 01:45:14 juju-e4d256-prod-github-runner-207 kernel: [73288.616839] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 01:45:14 juju-e4d256-prod-github-runner-207 kernel: [73288.617558] RIP: 0033:0x7faa5d0edaff Aug 23 01:45:14 juju-e4d256-prod-github-runner-207 kernel: [73288.618180] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 01:45:14 juju-e4d256-prod-github-runner-207 kernel: [73288.620158] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 01:45:14 juju-e4d256-prod-github-runner-207 kernel: [73288.621099] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 01:45:14 juju-e4d256-prod-github-runner-207 kernel: [73288.622013] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 01:45:14 juju-e4d256-prod-github-runner-207 kernel: [73288.622898] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 01:45:14 juju-e4d256-prod-github-runner-207 kernel: [73288.623786] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 01:45:14 juju-e4d256-prod-github-runner-207 kernel: [73288.624673] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 01:45:14 juju-e4d256-prod-github-runner-207 kernel: [73288.625579] Aug 23 01:45:42 juju-e4d256-prod-github-runner-207 kernel: [73316.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 68173s! [qemu-system-x86:6715] Aug 23 01:45:42 juju-e4d256-prod-github-runner-207 kernel: [73316.543102] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 01:45:42 juju-e4d256-prod-github-runner-207 kernel: [73316.543170] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 01:45:42 juju-e4d256-prod-github-runner-207 kernel: [73316.555330] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 01:45:42 juju-e4d256-prod-github-runner-207 kernel: [73316.556602] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 01:45:42 juju-e4d256-prod-github-runner-207 kernel: [73316.557853] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:45:42 juju-e4d256-prod-github-runner-207 kernel: [73316.558924] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 01:45:42 juju-e4d256-prod-github-runner-207 kernel: [73316.561500] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 01:45:42 juju-e4d256-prod-github-runner-207 kernel: [73316.562557] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 01:45:42 juju-e4d256-prod-github-runner-207 kernel: [73316.563985] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 01:45:42 juju-e4d256-prod-github-runner-207 kernel: [73316.565921] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 01:45:42 juju-e4d256-prod-github-runner-207 kernel: [73316.567084] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 01:45:42 juju-e4d256-prod-github-runner-207 kernel: [73316.568249] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 01:45:42 juju-e4d256-prod-github-runner-207 kernel: [73316.569448] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 01:45:42 juju-e4d256-prod-github-runner-207 kernel: [73316.570691] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 01:45:42 juju-e4d256-prod-github-runner-207 kernel: [73316.571788] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 01:45:42 juju-e4d256-prod-github-runner-207 kernel: [73316.573001] Call Trace: Aug 23 01:45:42 juju-e4d256-prod-github-runner-207 kernel: [73316.573914] Aug 23 01:45:42 juju-e4d256-prod-github-runner-207 kernel: [73316.574795] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:45:42 juju-e4d256-prod-github-runner-207 kernel: [73316.575834] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:45:42 juju-e4d256-prod-github-runner-207 kernel: [73316.576869] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:45:42 juju-e4d256-prod-github-runner-207 kernel: [73316.577943] ? show_regs.part.0+0x23/0x29 Aug 23 01:45:42 juju-e4d256-prod-github-runner-207 kernel: [73316.578943] ? show_regs.cold+0x8/0xd Aug 23 01:45:42 juju-e4d256-prod-github-runner-207 kernel: [73316.579924] ? watchdog_timer_fn+0x1be/0x220 Aug 23 01:45:42 juju-e4d256-prod-github-runner-207 kernel: [73316.580947] ? lockup_detector_update_enable+0x60/0x60 Aug 23 01:45:42 juju-e4d256-prod-github-runner-207 kernel: [73316.582007] ? __hrtimer_run_queues+0x107/0x230 Aug 23 01:45:42 juju-e4d256-prod-github-runner-207 kernel: [73316.583033] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 01:45:42 juju-e4d256-prod-github-runner-207 kernel: [73316.584052] ? hrtimer_interrupt+0x101/0x220 Aug 23 01:45:42 juju-e4d256-prod-github-runner-207 kernel: [73316.585082] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 01:45:42 juju-e4d256-prod-github-runner-207 kernel: [73316.586150] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 01:45:42 juju-e4d256-prod-github-runner-207 kernel: [73316.587192] Aug 23 01:45:42 juju-e4d256-prod-github-runner-207 kernel: [73316.588044] Aug 23 01:45:42 juju-e4d256-prod-github-runner-207 kernel: [73316.588897] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 01:45:42 juju-e4d256-prod-github-runner-207 kernel: [73316.589940] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:45:42 juju-e4d256-prod-github-runner-207 kernel: [73316.590980] ? _raw_spin_lock+0x22/0x30 Aug 23 01:45:42 juju-e4d256-prod-github-runner-207 kernel: [73316.591924] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:45:42 juju-e4d256-prod-github-runner-207 kernel: [73316.592960] direct_page_fault+0x206/0x310 [kvm] Aug 23 01:45:42 juju-e4d256-prod-github-runner-207 kernel: [73316.593987] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 01:45:42 juju-e4d256-prod-github-runner-207 kernel: [73316.594998] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 01:45:42 juju-e4d256-prod-github-runner-207 kernel: [73316.595995] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 01:45:42 juju-e4d256-prod-github-runner-207 kernel: [73316.596979] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 01:45:42 juju-e4d256-prod-github-runner-207 kernel: [73316.597921] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 01:45:42 juju-e4d256-prod-github-runner-207 kernel: [73316.598895] handle_exit+0x98/0x230 [kvm_amd] Aug 23 01:45:42 juju-e4d256-prod-github-runner-207 kernel: [73316.599793] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 01:45:42 juju-e4d256-prod-github-runner-207 kernel: [73316.600724] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 01:45:42 juju-e4d256-prod-github-runner-207 kernel: [73316.601646] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 01:45:42 juju-e4d256-prod-github-runner-207 kernel: [73316.602548] vcpu_run+0x62/0x2c0 [kvm] Aug 23 01:45:42 juju-e4d256-prod-github-runner-207 kernel: [73316.603356] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 01:45:42 juju-e4d256-prod-github-runner-207 kernel: [73316.604160] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 01:45:42 juju-e4d256-prod-github-runner-207 kernel: [73316.605026] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 01:45:42 juju-e4d256-prod-github-runner-207 kernel: [73316.605827] ? __seccomp_filter+0x4a/0x4a0 Aug 23 01:45:42 juju-e4d256-prod-github-runner-207 kernel: [73316.606567] ? __fget_files+0x86/0xc0 Aug 23 01:45:42 juju-e4d256-prod-github-runner-207 kernel: [73316.607267] __x64_sys_ioctl+0x95/0xd0 Aug 23 01:45:42 juju-e4d256-prod-github-runner-207 kernel: [73316.607960] do_syscall_64+0x5c/0xc0 Aug 23 01:45:42 juju-e4d256-prod-github-runner-207 kernel: [73316.608621] ? do_futex+0x162/0x1f0 Aug 23 01:45:42 juju-e4d256-prod-github-runner-207 kernel: [73316.609289] ? __x64_sys_futex+0x78/0x1e0 Aug 23 01:45:42 juju-e4d256-prod-github-runner-207 kernel: [73316.609963] ? __secure_computing+0xa9/0x120 Aug 23 01:45:42 juju-e4d256-prod-github-runner-207 kernel: [73316.610655] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 01:45:42 juju-e4d256-prod-github-runner-207 kernel: [73316.611416] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:45:42 juju-e4d256-prod-github-runner-207 kernel: [73316.612136] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:45:42 juju-e4d256-prod-github-runner-207 kernel: [73316.612868] ? do_syscall_64+0x69/0xc0 Aug 23 01:45:42 juju-e4d256-prod-github-runner-207 kernel: [73316.613515] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:45:42 juju-e4d256-prod-github-runner-207 kernel: [73316.614215] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:45:42 juju-e4d256-prod-github-runner-207 kernel: [73316.614907] ? do_syscall_64+0x69/0xc0 Aug 23 01:45:42 juju-e4d256-prod-github-runner-207 kernel: [73316.615530] ? do_syscall_64+0x69/0xc0 Aug 23 01:45:42 juju-e4d256-prod-github-runner-207 kernel: [73316.616149] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 01:45:42 juju-e4d256-prod-github-runner-207 kernel: [73316.616867] RIP: 0033:0x7faa5d0edaff Aug 23 01:45:42 juju-e4d256-prod-github-runner-207 kernel: [73316.617488] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 01:45:42 juju-e4d256-prod-github-runner-207 kernel: [73316.619489] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 01:45:42 juju-e4d256-prod-github-runner-207 kernel: [73316.620433] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 01:45:42 juju-e4d256-prod-github-runner-207 kernel: [73316.621346] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 01:45:42 juju-e4d256-prod-github-runner-207 kernel: [73316.622235] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 01:45:42 juju-e4d256-prod-github-runner-207 kernel: [73316.623120] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 01:45:42 juju-e4d256-prod-github-runner-207 kernel: [73316.624004] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 01:45:42 juju-e4d256-prod-github-runner-207 kernel: [73316.624946] Aug 23 01:46:10 juju-e4d256-prod-github-runner-207 kernel: [73344.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 68199s! [qemu-system-x86:6715] Aug 23 01:46:10 juju-e4d256-prod-github-runner-207 kernel: [73344.543127] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 01:46:10 juju-e4d256-prod-github-runner-207 kernel: [73344.543194] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 01:46:10 juju-e4d256-prod-github-runner-207 kernel: [73344.555452] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 01:46:10 juju-e4d256-prod-github-runner-207 kernel: [73344.556745] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 01:46:10 juju-e4d256-prod-github-runner-207 kernel: [73344.557973] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:46:10 juju-e4d256-prod-github-runner-207 kernel: [73344.559031] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 01:46:10 juju-e4d256-prod-github-runner-207 kernel: [73344.561608] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 01:46:10 juju-e4d256-prod-github-runner-207 kernel: [73344.562660] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 01:46:10 juju-e4d256-prod-github-runner-207 kernel: [73344.563819] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 01:46:10 juju-e4d256-prod-github-runner-207 kernel: [73344.564998] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 01:46:10 juju-e4d256-prod-github-runner-207 kernel: [73344.566199] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 01:46:10 juju-e4d256-prod-github-runner-207 kernel: [73344.567384] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 01:46:10 juju-e4d256-prod-github-runner-207 kernel: [73344.568573] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 01:46:10 juju-e4d256-prod-github-runner-207 kernel: [73344.569814] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 01:46:10 juju-e4d256-prod-github-runner-207 kernel: [73344.570920] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 01:46:10 juju-e4d256-prod-github-runner-207 kernel: [73344.572127] Call Trace: Aug 23 01:46:10 juju-e4d256-prod-github-runner-207 kernel: [73344.573057] Aug 23 01:46:10 juju-e4d256-prod-github-runner-207 kernel: [73344.573946] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:46:10 juju-e4d256-prod-github-runner-207 kernel: [73344.574975] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:46:10 juju-e4d256-prod-github-runner-207 kernel: [73344.576002] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:46:10 juju-e4d256-prod-github-runner-207 kernel: [73344.577116] ? show_regs.part.0+0x23/0x29 Aug 23 01:46:10 juju-e4d256-prod-github-runner-207 kernel: [73344.578116] ? show_regs.cold+0x8/0xd Aug 23 01:46:10 juju-e4d256-prod-github-runner-207 kernel: [73344.579114] ? watchdog_timer_fn+0x1be/0x220 Aug 23 01:46:10 juju-e4d256-prod-github-runner-207 kernel: [73344.580160] ? lockup_detector_update_enable+0x60/0x60 Aug 23 01:46:10 juju-e4d256-prod-github-runner-207 kernel: [73344.581259] ? __hrtimer_run_queues+0x107/0x230 Aug 23 01:46:10 juju-e4d256-prod-github-runner-207 kernel: [73344.582304] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 01:46:10 juju-e4d256-prod-github-runner-207 kernel: [73344.583351] ? hrtimer_interrupt+0x101/0x220 Aug 23 01:46:10 juju-e4d256-prod-github-runner-207 kernel: [73344.584377] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 01:46:10 juju-e4d256-prod-github-runner-207 kernel: [73344.585462] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 01:46:10 juju-e4d256-prod-github-runner-207 kernel: [73344.586519] Aug 23 01:46:10 juju-e4d256-prod-github-runner-207 kernel: [73344.587379] Aug 23 01:46:10 juju-e4d256-prod-github-runner-207 kernel: [73344.588236] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 01:46:10 juju-e4d256-prod-github-runner-207 kernel: [73344.589289] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:46:10 juju-e4d256-prod-github-runner-207 kernel: [73344.590331] ? _raw_spin_lock+0x22/0x30 Aug 23 01:46:10 juju-e4d256-prod-github-runner-207 kernel: [73344.591277] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:46:10 juju-e4d256-prod-github-runner-207 kernel: [73344.592372] direct_page_fault+0x206/0x310 [kvm] Aug 23 01:46:10 juju-e4d256-prod-github-runner-207 kernel: [73344.593840] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 01:46:10 juju-e4d256-prod-github-runner-207 kernel: [73344.594858] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 01:46:10 juju-e4d256-prod-github-runner-207 kernel: [73344.595862] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 01:46:10 juju-e4d256-prod-github-runner-207 kernel: [73344.596847] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 01:46:10 juju-e4d256-prod-github-runner-207 kernel: [73344.597795] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 01:46:10 juju-e4d256-prod-github-runner-207 kernel: [73344.598843] handle_exit+0x98/0x230 [kvm_amd] Aug 23 01:46:10 juju-e4d256-prod-github-runner-207 kernel: [73344.599746] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 01:46:10 juju-e4d256-prod-github-runner-207 kernel: [73344.600680] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 01:46:10 juju-e4d256-prod-github-runner-207 kernel: [73344.601632] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 01:46:10 juju-e4d256-prod-github-runner-207 kernel: [73344.602550] vcpu_run+0x62/0x2c0 [kvm] Aug 23 01:46:10 juju-e4d256-prod-github-runner-207 kernel: [73344.603364] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 01:46:10 juju-e4d256-prod-github-runner-207 kernel: [73344.604175] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 01:46:10 juju-e4d256-prod-github-runner-207 kernel: [73344.605066] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 01:46:10 juju-e4d256-prod-github-runner-207 kernel: [73344.605872] ? __seccomp_filter+0x4a/0x4a0 Aug 23 01:46:10 juju-e4d256-prod-github-runner-207 kernel: [73344.606618] ? __fget_files+0x86/0xc0 Aug 23 01:46:10 juju-e4d256-prod-github-runner-207 kernel: [73344.607324] __x64_sys_ioctl+0x95/0xd0 Aug 23 01:46:10 juju-e4d256-prod-github-runner-207 kernel: [73344.608017] do_syscall_64+0x5c/0xc0 Aug 23 01:46:10 juju-e4d256-prod-github-runner-207 kernel: [73344.608697] ? do_futex+0x162/0x1f0 Aug 23 01:46:10 juju-e4d256-prod-github-runner-207 kernel: [73344.609366] ? __x64_sys_futex+0x78/0x1e0 Aug 23 01:46:10 juju-e4d256-prod-github-runner-207 kernel: [73344.610061] ? __secure_computing+0xa9/0x120 Aug 23 01:46:10 juju-e4d256-prod-github-runner-207 kernel: [73344.610758] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 01:46:10 juju-e4d256-prod-github-runner-207 kernel: [73344.611518] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:46:10 juju-e4d256-prod-github-runner-207 kernel: [73344.612241] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:46:10 juju-e4d256-prod-github-runner-207 kernel: [73344.612982] ? do_syscall_64+0x69/0xc0 Aug 23 01:46:10 juju-e4d256-prod-github-runner-207 kernel: [73344.613632] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:46:10 juju-e4d256-prod-github-runner-207 kernel: [73344.614341] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:46:10 juju-e4d256-prod-github-runner-207 kernel: [73344.615038] ? do_syscall_64+0x69/0xc0 Aug 23 01:46:10 juju-e4d256-prod-github-runner-207 kernel: [73344.615667] ? do_syscall_64+0x69/0xc0 Aug 23 01:46:10 juju-e4d256-prod-github-runner-207 kernel: [73344.616288] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 01:46:10 juju-e4d256-prod-github-runner-207 kernel: [73344.617013] RIP: 0033:0x7faa5d0edaff Aug 23 01:46:10 juju-e4d256-prod-github-runner-207 kernel: [73344.617643] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 01:46:10 juju-e4d256-prod-github-runner-207 kernel: [73344.619719] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 01:46:10 juju-e4d256-prod-github-runner-207 kernel: [73344.620656] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 01:46:10 juju-e4d256-prod-github-runner-207 kernel: [73344.621562] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 01:46:10 juju-e4d256-prod-github-runner-207 kernel: [73344.622453] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 01:46:10 juju-e4d256-prod-github-runner-207 kernel: [73344.623339] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 01:46:10 juju-e4d256-prod-github-runner-207 kernel: [73344.624240] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 01:46:10 juju-e4d256-prod-github-runner-207 kernel: [73344.625159] Aug 23 01:46:38 juju-e4d256-prod-github-runner-207 kernel: [73372.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 68225s! [qemu-system-x86:6715] Aug 23 01:46:38 juju-e4d256-prod-github-runner-207 kernel: [73372.543705] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 01:46:38 juju-e4d256-prod-github-runner-207 kernel: [73372.543945] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 01:46:38 juju-e4d256-prod-github-runner-207 kernel: [73372.556048] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 01:46:38 juju-e4d256-prod-github-runner-207 kernel: [73372.557319] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 01:46:38 juju-e4d256-prod-github-runner-207 kernel: [73372.558542] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:46:38 juju-e4d256-prod-github-runner-207 kernel: [73372.559601] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 01:46:38 juju-e4d256-prod-github-runner-207 kernel: [73372.562156] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 01:46:38 juju-e4d256-prod-github-runner-207 kernel: [73372.563196] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 01:46:38 juju-e4d256-prod-github-runner-207 kernel: [73372.564371] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 01:46:38 juju-e4d256-prod-github-runner-207 kernel: [73372.565536] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 01:46:38 juju-e4d256-prod-github-runner-207 kernel: [73372.566695] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 01:46:38 juju-e4d256-prod-github-runner-207 kernel: [73372.567860] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 01:46:38 juju-e4d256-prod-github-runner-207 kernel: [73372.569041] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 01:46:38 juju-e4d256-prod-github-runner-207 kernel: [73372.570273] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 01:46:38 juju-e4d256-prod-github-runner-207 kernel: [73372.571368] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 01:46:38 juju-e4d256-prod-github-runner-207 kernel: [73372.572568] Call Trace: Aug 23 01:46:38 juju-e4d256-prod-github-runner-207 kernel: [73372.573481] Aug 23 01:46:38 juju-e4d256-prod-github-runner-207 kernel: [73372.574380] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:46:38 juju-e4d256-prod-github-runner-207 kernel: [73372.575409] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:46:38 juju-e4d256-prod-github-runner-207 kernel: [73372.576434] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:46:38 juju-e4d256-prod-github-runner-207 kernel: [73372.577525] ? show_regs.part.0+0x23/0x29 Aug 23 01:46:38 juju-e4d256-prod-github-runner-207 kernel: [73372.578520] ? show_regs.cold+0x8/0xd Aug 23 01:46:38 juju-e4d256-prod-github-runner-207 kernel: [73372.579496] ? watchdog_timer_fn+0x1be/0x220 Aug 23 01:46:38 juju-e4d256-prod-github-runner-207 kernel: [73372.580517] ? lockup_detector_update_enable+0x60/0x60 Aug 23 01:46:38 juju-e4d256-prod-github-runner-207 kernel: [73372.581585] ? __hrtimer_run_queues+0x107/0x230 Aug 23 01:46:38 juju-e4d256-prod-github-runner-207 kernel: [73372.582611] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 01:46:38 juju-e4d256-prod-github-runner-207 kernel: [73372.583633] ? hrtimer_interrupt+0x101/0x220 Aug 23 01:46:38 juju-e4d256-prod-github-runner-207 kernel: [73372.584658] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 01:46:38 juju-e4d256-prod-github-runner-207 kernel: [73372.585728] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 01:46:38 juju-e4d256-prod-github-runner-207 kernel: [73372.586772] Aug 23 01:46:38 juju-e4d256-prod-github-runner-207 kernel: [73372.587624] Aug 23 01:46:38 juju-e4d256-prod-github-runner-207 kernel: [73372.588474] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 01:46:38 juju-e4d256-prod-github-runner-207 kernel: [73372.589508] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:46:38 juju-e4d256-prod-github-runner-207 kernel: [73372.590551] ? _raw_spin_lock+0x22/0x30 Aug 23 01:46:38 juju-e4d256-prod-github-runner-207 kernel: [73372.591494] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:46:38 juju-e4d256-prod-github-runner-207 kernel: [73372.592523] direct_page_fault+0x206/0x310 [kvm] Aug 23 01:46:38 juju-e4d256-prod-github-runner-207 kernel: [73372.593546] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 01:46:38 juju-e4d256-prod-github-runner-207 kernel: [73372.594553] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 01:46:38 juju-e4d256-prod-github-runner-207 kernel: [73372.595554] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 01:46:38 juju-e4d256-prod-github-runner-207 kernel: [73372.596553] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 01:46:38 juju-e4d256-prod-github-runner-207 kernel: [73372.597498] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 01:46:38 juju-e4d256-prod-github-runner-207 kernel: [73372.598474] handle_exit+0x98/0x230 [kvm_amd] Aug 23 01:46:38 juju-e4d256-prod-github-runner-207 kernel: [73372.599367] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 01:46:38 juju-e4d256-prod-github-runner-207 kernel: [73372.600291] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 01:46:38 juju-e4d256-prod-github-runner-207 kernel: [73372.601219] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 01:46:38 juju-e4d256-prod-github-runner-207 kernel: [73372.602120] vcpu_run+0x62/0x2c0 [kvm] Aug 23 01:46:38 juju-e4d256-prod-github-runner-207 kernel: [73372.602930] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 01:46:38 juju-e4d256-prod-github-runner-207 kernel: [73372.603739] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 01:46:38 juju-e4d256-prod-github-runner-207 kernel: [73372.604601] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 01:46:38 juju-e4d256-prod-github-runner-207 kernel: [73372.605397] ? __seccomp_filter+0x4a/0x4a0 Aug 23 01:46:38 juju-e4d256-prod-github-runner-207 kernel: [73372.606137] ? __fget_files+0x86/0xc0 Aug 23 01:46:38 juju-e4d256-prod-github-runner-207 kernel: [73372.606838] __x64_sys_ioctl+0x95/0xd0 Aug 23 01:46:38 juju-e4d256-prod-github-runner-207 kernel: [73372.607527] do_syscall_64+0x5c/0xc0 Aug 23 01:46:38 juju-e4d256-prod-github-runner-207 kernel: [73372.608205] ? do_futex+0x162/0x1f0 Aug 23 01:46:38 juju-e4d256-prod-github-runner-207 kernel: [73372.608851] ? __x64_sys_futex+0x78/0x1e0 Aug 23 01:46:38 juju-e4d256-prod-github-runner-207 kernel: [73372.609527] ? __secure_computing+0xa9/0x120 Aug 23 01:46:38 juju-e4d256-prod-github-runner-207 kernel: [73372.610214] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 01:46:38 juju-e4d256-prod-github-runner-207 kernel: [73372.610970] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:46:38 juju-e4d256-prod-github-runner-207 kernel: [73372.611689] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:46:38 juju-e4d256-prod-github-runner-207 kernel: [73372.612419] ? do_syscall_64+0x69/0xc0 Aug 23 01:46:38 juju-e4d256-prod-github-runner-207 kernel: [73372.613067] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:46:38 juju-e4d256-prod-github-runner-207 kernel: [73372.613765] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:46:38 juju-e4d256-prod-github-runner-207 kernel: [73372.614457] ? do_syscall_64+0x69/0xc0 Aug 23 01:46:38 juju-e4d256-prod-github-runner-207 kernel: [73372.615079] ? do_syscall_64+0x69/0xc0 Aug 23 01:46:38 juju-e4d256-prod-github-runner-207 kernel: [73372.615700] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 01:46:38 juju-e4d256-prod-github-runner-207 kernel: [73372.616411] RIP: 0033:0x7faa5d0edaff Aug 23 01:46:38 juju-e4d256-prod-github-runner-207 kernel: [73372.617065] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 01:46:38 juju-e4d256-prod-github-runner-207 kernel: [73372.619047] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 01:46:38 juju-e4d256-prod-github-runner-207 kernel: [73372.619954] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 01:46:38 juju-e4d256-prod-github-runner-207 kernel: [73372.620865] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 01:46:38 juju-e4d256-prod-github-runner-207 kernel: [73372.621750] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 01:46:38 juju-e4d256-prod-github-runner-207 kernel: [73372.622638] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 01:46:38 juju-e4d256-prod-github-runner-207 kernel: [73372.623521] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 01:46:38 juju-e4d256-prod-github-runner-207 kernel: [73372.624419] Aug 23 01:47:06 juju-e4d256-prod-github-runner-207 kernel: [73400.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 68251s! [qemu-system-x86:6715] Aug 23 01:47:06 juju-e4d256-prod-github-runner-207 kernel: [73400.543091] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 01:47:06 juju-e4d256-prod-github-runner-207 kernel: [73400.543160] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 01:47:06 juju-e4d256-prod-github-runner-207 kernel: [73400.555261] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 01:47:06 juju-e4d256-prod-github-runner-207 kernel: [73400.556555] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 01:47:06 juju-e4d256-prod-github-runner-207 kernel: [73400.557780] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:47:06 juju-e4d256-prod-github-runner-207 kernel: [73400.558842] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 01:47:06 juju-e4d256-prod-github-runner-207 kernel: [73400.561424] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 01:47:06 juju-e4d256-prod-github-runner-207 kernel: [73400.562467] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 01:47:06 juju-e4d256-prod-github-runner-207 kernel: [73400.563631] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 01:47:06 juju-e4d256-prod-github-runner-207 kernel: [73400.564812] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 01:47:06 juju-e4d256-prod-github-runner-207 kernel: [73400.565983] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 01:47:06 juju-e4d256-prod-github-runner-207 kernel: [73400.567154] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 01:47:06 juju-e4d256-prod-github-runner-207 kernel: [73400.568341] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 01:47:06 juju-e4d256-prod-github-runner-207 kernel: [73400.569582] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 01:47:06 juju-e4d256-prod-github-runner-207 kernel: [73400.570693] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 01:47:06 juju-e4d256-prod-github-runner-207 kernel: [73400.571963] Call Trace: Aug 23 01:47:06 juju-e4d256-prod-github-runner-207 kernel: [73400.572875] Aug 23 01:47:06 juju-e4d256-prod-github-runner-207 kernel: [73400.573759] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:47:06 juju-e4d256-prod-github-runner-207 kernel: [73400.574795] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:47:06 juju-e4d256-prod-github-runner-207 kernel: [73400.575833] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:47:06 juju-e4d256-prod-github-runner-207 kernel: [73400.576919] ? show_regs.part.0+0x23/0x29 Aug 23 01:47:06 juju-e4d256-prod-github-runner-207 kernel: [73400.577974] ? show_regs.cold+0x8/0xd Aug 23 01:47:06 juju-e4d256-prod-github-runner-207 kernel: [73400.578952] ? watchdog_timer_fn+0x1be/0x220 Aug 23 01:47:06 juju-e4d256-prod-github-runner-207 kernel: [73400.579985] ? lockup_detector_update_enable+0x60/0x60 Aug 23 01:47:06 juju-e4d256-prod-github-runner-207 kernel: [73400.581068] ? __hrtimer_run_queues+0x107/0x230 Aug 23 01:47:06 juju-e4d256-prod-github-runner-207 kernel: [73400.582135] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 01:47:06 juju-e4d256-prod-github-runner-207 kernel: [73400.583162] ? hrtimer_interrupt+0x101/0x220 Aug 23 01:47:06 juju-e4d256-prod-github-runner-207 kernel: [73400.584205] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 01:47:06 juju-e4d256-prod-github-runner-207 kernel: [73400.585295] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 01:47:06 juju-e4d256-prod-github-runner-207 kernel: [73400.586374] Aug 23 01:47:06 juju-e4d256-prod-github-runner-207 kernel: [73400.587228] Aug 23 01:47:06 juju-e4d256-prod-github-runner-207 kernel: [73400.588085] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 01:47:06 juju-e4d256-prod-github-runner-207 kernel: [73400.589123] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:47:06 juju-e4d256-prod-github-runner-207 kernel: [73400.590173] ? _raw_spin_lock+0x22/0x30 Aug 23 01:47:06 juju-e4d256-prod-github-runner-207 kernel: [73400.591124] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:47:06 juju-e4d256-prod-github-runner-207 kernel: [73400.592185] direct_page_fault+0x206/0x310 [kvm] Aug 23 01:47:06 juju-e4d256-prod-github-runner-207 kernel: [73400.593211] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 01:47:06 juju-e4d256-prod-github-runner-207 kernel: [73400.594227] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 01:47:06 juju-e4d256-prod-github-runner-207 kernel: [73400.595228] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 01:47:06 juju-e4d256-prod-github-runner-207 kernel: [73400.596210] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 01:47:06 juju-e4d256-prod-github-runner-207 kernel: [73400.597161] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 01:47:06 juju-e4d256-prod-github-runner-207 kernel: [73400.598139] handle_exit+0x98/0x230 [kvm_amd] Aug 23 01:47:06 juju-e4d256-prod-github-runner-207 kernel: [73400.599029] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 01:47:06 juju-e4d256-prod-github-runner-207 kernel: [73400.599964] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 01:47:06 juju-e4d256-prod-github-runner-207 kernel: [73400.600888] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 01:47:06 juju-e4d256-prod-github-runner-207 kernel: [73400.601791] vcpu_run+0x62/0x2c0 [kvm] Aug 23 01:47:06 juju-e4d256-prod-github-runner-207 kernel: [73400.602605] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 01:47:06 juju-e4d256-prod-github-runner-207 kernel: [73400.603417] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 01:47:06 juju-e4d256-prod-github-runner-207 kernel: [73400.604283] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 01:47:06 juju-e4d256-prod-github-runner-207 kernel: [73400.605080] ? __seccomp_filter+0x4a/0x4a0 Aug 23 01:47:06 juju-e4d256-prod-github-runner-207 kernel: [73400.605821] ? __fget_files+0x86/0xc0 Aug 23 01:47:06 juju-e4d256-prod-github-runner-207 kernel: [73400.606530] __x64_sys_ioctl+0x95/0xd0 Aug 23 01:47:06 juju-e4d256-prod-github-runner-207 kernel: [73400.607221] do_syscall_64+0x5c/0xc0 Aug 23 01:47:06 juju-e4d256-prod-github-runner-207 kernel: [73400.607896] ? do_futex+0x162/0x1f0 Aug 23 01:47:06 juju-e4d256-prod-github-runner-207 kernel: [73400.608545] ? __x64_sys_futex+0x78/0x1e0 Aug 23 01:47:06 juju-e4d256-prod-github-runner-207 kernel: [73400.609220] ? __secure_computing+0xa9/0x120 Aug 23 01:47:06 juju-e4d256-prod-github-runner-207 kernel: [73400.610003] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 01:47:06 juju-e4d256-prod-github-runner-207 kernel: [73400.610770] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:47:06 juju-e4d256-prod-github-runner-207 kernel: [73400.611489] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:47:06 juju-e4d256-prod-github-runner-207 kernel: [73400.612221] ? do_syscall_64+0x69/0xc0 Aug 23 01:47:06 juju-e4d256-prod-github-runner-207 kernel: [73400.612869] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:47:06 juju-e4d256-prod-github-runner-207 kernel: [73400.613569] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:47:06 juju-e4d256-prod-github-runner-207 kernel: [73400.614262] ? do_syscall_64+0x69/0xc0 Aug 23 01:47:06 juju-e4d256-prod-github-runner-207 kernel: [73400.614884] ? do_syscall_64+0x69/0xc0 Aug 23 01:47:06 juju-e4d256-prod-github-runner-207 kernel: [73400.615508] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 01:47:06 juju-e4d256-prod-github-runner-207 kernel: [73400.616230] RIP: 0033:0x7faa5d0edaff Aug 23 01:47:06 juju-e4d256-prod-github-runner-207 kernel: [73400.616860] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 01:47:06 juju-e4d256-prod-github-runner-207 kernel: [73400.618845] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 01:47:06 juju-e4d256-prod-github-runner-207 kernel: [73400.619783] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 01:47:06 juju-e4d256-prod-github-runner-207 kernel: [73400.620679] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 01:47:06 juju-e4d256-prod-github-runner-207 kernel: [73400.621577] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 01:47:06 juju-e4d256-prod-github-runner-207 kernel: [73400.622467] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 01:47:06 juju-e4d256-prod-github-runner-207 kernel: [73400.623355] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 01:47:06 juju-e4d256-prod-github-runner-207 kernel: [73400.624261] Aug 23 01:47:34 juju-e4d256-prod-github-runner-207 kernel: [73428.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 68277s! [qemu-system-x86:6715] Aug 23 01:47:34 juju-e4d256-prod-github-runner-207 kernel: [73428.543093] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 01:47:34 juju-e4d256-prod-github-runner-207 kernel: [73428.543160] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 01:47:34 juju-e4d256-prod-github-runner-207 kernel: [73428.555246] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 01:47:34 juju-e4d256-prod-github-runner-207 kernel: [73428.556526] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 01:47:34 juju-e4d256-prod-github-runner-207 kernel: [73428.557758] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:47:34 juju-e4d256-prod-github-runner-207 kernel: [73428.558830] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 01:47:34 juju-e4d256-prod-github-runner-207 kernel: [73428.561430] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 01:47:34 juju-e4d256-prod-github-runner-207 kernel: [73428.562470] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 01:47:34 juju-e4d256-prod-github-runner-207 kernel: [73428.563648] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 01:47:34 juju-e4d256-prod-github-runner-207 kernel: [73428.564814] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 01:47:34 juju-e4d256-prod-github-runner-207 kernel: [73428.565972] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 01:47:34 juju-e4d256-prod-github-runner-207 kernel: [73428.567137] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 01:47:34 juju-e4d256-prod-github-runner-207 kernel: [73428.568320] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 01:47:34 juju-e4d256-prod-github-runner-207 kernel: [73428.569566] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 01:47:34 juju-e4d256-prod-github-runner-207 kernel: [73428.570667] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 01:47:34 juju-e4d256-prod-github-runner-207 kernel: [73428.571877] Call Trace: Aug 23 01:47:34 juju-e4d256-prod-github-runner-207 kernel: [73428.572791] Aug 23 01:47:34 juju-e4d256-prod-github-runner-207 kernel: [73428.573674] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:47:34 juju-e4d256-prod-github-runner-207 kernel: [73428.574704] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:47:34 juju-e4d256-prod-github-runner-207 kernel: [73428.575738] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:47:34 juju-e4d256-prod-github-runner-207 kernel: [73428.576815] ? show_regs.part.0+0x23/0x29 Aug 23 01:47:34 juju-e4d256-prod-github-runner-207 kernel: [73428.577949] ? show_regs.cold+0x8/0xd Aug 23 01:47:34 juju-e4d256-prod-github-runner-207 kernel: [73428.578923] ? watchdog_timer_fn+0x1be/0x220 Aug 23 01:47:34 juju-e4d256-prod-github-runner-207 kernel: [73428.579949] ? lockup_detector_update_enable+0x60/0x60 Aug 23 01:47:34 juju-e4d256-prod-github-runner-207 kernel: [73428.581015] ? __hrtimer_run_queues+0x107/0x230 Aug 23 01:47:34 juju-e4d256-prod-github-runner-207 kernel: [73428.582040] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 01:47:34 juju-e4d256-prod-github-runner-207 kernel: [73428.583066] ? hrtimer_interrupt+0x101/0x220 Aug 23 01:47:34 juju-e4d256-prod-github-runner-207 kernel: [73428.584096] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 01:47:34 juju-e4d256-prod-github-runner-207 kernel: [73428.585167] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 01:47:34 juju-e4d256-prod-github-runner-207 kernel: [73428.586210] Aug 23 01:47:34 juju-e4d256-prod-github-runner-207 kernel: [73428.587066] Aug 23 01:47:34 juju-e4d256-prod-github-runner-207 kernel: [73428.587922] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 01:47:34 juju-e4d256-prod-github-runner-207 kernel: [73428.588970] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:47:34 juju-e4d256-prod-github-runner-207 kernel: [73428.590010] ? _raw_spin_lock+0x22/0x30 Aug 23 01:47:34 juju-e4d256-prod-github-runner-207 kernel: [73428.591052] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:47:34 juju-e4d256-prod-github-runner-207 kernel: [73428.592125] direct_page_fault+0x206/0x310 [kvm] Aug 23 01:47:34 juju-e4d256-prod-github-runner-207 kernel: [73428.593153] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 01:47:34 juju-e4d256-prod-github-runner-207 kernel: [73428.594164] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 01:47:34 juju-e4d256-prod-github-runner-207 kernel: [73428.595162] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 01:47:34 juju-e4d256-prod-github-runner-207 kernel: [73428.596145] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 01:47:34 juju-e4d256-prod-github-runner-207 kernel: [73428.597093] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 01:47:34 juju-e4d256-prod-github-runner-207 kernel: [73428.598069] handle_exit+0x98/0x230 [kvm_amd] Aug 23 01:47:34 juju-e4d256-prod-github-runner-207 kernel: [73428.598995] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 01:47:34 juju-e4d256-prod-github-runner-207 kernel: [73428.599926] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 01:47:34 juju-e4d256-prod-github-runner-207 kernel: [73428.600847] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 01:47:34 juju-e4d256-prod-github-runner-207 kernel: [73428.601748] vcpu_run+0x62/0x2c0 [kvm] Aug 23 01:47:34 juju-e4d256-prod-github-runner-207 kernel: [73428.602557] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 01:47:34 juju-e4d256-prod-github-runner-207 kernel: [73428.603363] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 01:47:34 juju-e4d256-prod-github-runner-207 kernel: [73428.604233] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 01:47:34 juju-e4d256-prod-github-runner-207 kernel: [73428.605034] ? __seccomp_filter+0x4a/0x4a0 Aug 23 01:47:34 juju-e4d256-prod-github-runner-207 kernel: [73428.605780] ? __fget_files+0x86/0xc0 Aug 23 01:47:34 juju-e4d256-prod-github-runner-207 kernel: [73428.606482] __x64_sys_ioctl+0x95/0xd0 Aug 23 01:47:34 juju-e4d256-prod-github-runner-207 kernel: [73428.607171] do_syscall_64+0x5c/0xc0 Aug 23 01:47:34 juju-e4d256-prod-github-runner-207 kernel: [73428.607844] ? do_futex+0x162/0x1f0 Aug 23 01:47:34 juju-e4d256-prod-github-runner-207 kernel: [73428.608491] ? __x64_sys_futex+0x78/0x1e0 Aug 23 01:47:34 juju-e4d256-prod-github-runner-207 kernel: [73428.609167] ? __secure_computing+0xa9/0x120 Aug 23 01:47:34 juju-e4d256-prod-github-runner-207 kernel: [73428.609860] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 01:47:34 juju-e4d256-prod-github-runner-207 kernel: [73428.610621] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:47:34 juju-e4d256-prod-github-runner-207 kernel: [73428.611339] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:47:34 juju-e4d256-prod-github-runner-207 kernel: [73428.612061] ? do_syscall_64+0x69/0xc0 Aug 23 01:47:34 juju-e4d256-prod-github-runner-207 kernel: [73428.612709] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:47:34 juju-e4d256-prod-github-runner-207 kernel: [73428.613409] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:47:34 juju-e4d256-prod-github-runner-207 kernel: [73428.614100] ? do_syscall_64+0x69/0xc0 Aug 23 01:47:34 juju-e4d256-prod-github-runner-207 kernel: [73428.614731] ? do_syscall_64+0x69/0xc0 Aug 23 01:47:34 juju-e4d256-prod-github-runner-207 kernel: [73428.615350] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 01:47:34 juju-e4d256-prod-github-runner-207 kernel: [73428.616094] RIP: 0033:0x7faa5d0edaff Aug 23 01:47:34 juju-e4d256-prod-github-runner-207 kernel: [73428.616720] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 01:47:34 juju-e4d256-prod-github-runner-207 kernel: [73428.618705] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 01:47:34 juju-e4d256-prod-github-runner-207 kernel: [73428.619643] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 01:47:34 juju-e4d256-prod-github-runner-207 kernel: [73428.620531] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 01:47:34 juju-e4d256-prod-github-runner-207 kernel: [73428.621435] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 01:47:34 juju-e4d256-prod-github-runner-207 kernel: [73428.622320] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 01:47:34 juju-e4d256-prod-github-runner-207 kernel: [73428.623209] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 01:47:34 juju-e4d256-prod-github-runner-207 kernel: [73428.624118] Aug 23 01:47:48 juju-e4d256-prod-github-runner-207 kernel: [73442.084709] rcu: INFO: rcu_sched self-detected stall on CPU Aug 23 01:47:48 juju-e4d256-prod-github-runner-207 kernel: [73442.085836] rcu: 1-....: (18273568 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=8829351 Aug 23 01:47:48 juju-e4d256-prod-github-runner-207 kernel: [73442.086980] (t=18331221 jiffies g=23269 q=62535) Aug 23 01:47:48 juju-e4d256-prod-github-runner-207 kernel: [73442.087800] NMI backtrace for cpu 1 Aug 23 01:47:48 juju-e4d256-prod-github-runner-207 kernel: [73442.088513] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 01:47:48 juju-e4d256-prod-github-runner-207 kernel: [73442.089618] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 01:47:48 juju-e4d256-prod-github-runner-207 kernel: [73442.090681] Call Trace: Aug 23 01:47:48 juju-e4d256-prod-github-runner-207 kernel: [73442.091363] Aug 23 01:47:48 juju-e4d256-prod-github-runner-207 kernel: [73442.092072] show_stack+0x52/0x5c Aug 23 01:47:48 juju-e4d256-prod-github-runner-207 kernel: [73442.092801] dump_stack_lvl+0x4a/0x63 Aug 23 01:47:48 juju-e4d256-prod-github-runner-207 kernel: [73442.093561] dump_stack+0x10/0x16 Aug 23 01:47:48 juju-e4d256-prod-github-runner-207 kernel: [73442.094284] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 23 01:47:48 juju-e4d256-prod-github-runner-207 kernel: [73442.095067] ? lapic_can_unplug_cpu+0x90/0x90 Aug 23 01:47:48 juju-e4d256-prod-github-runner-207 kernel: [73442.095899] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 23 01:47:48 juju-e4d256-prod-github-runner-207 kernel: [73442.096723] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 23 01:47:48 juju-e4d256-prod-github-runner-207 kernel: [73442.097557] trigger_single_cpu_backtrace+0x44/0x4f Aug 23 01:47:48 juju-e4d256-prod-github-runner-207 kernel: [73442.098379] rcu_dump_cpu_stacks+0x102/0x149 Aug 23 01:47:48 juju-e4d256-prod-github-runner-207 kernel: [73442.099315] print_cpu_stall.cold+0x2f/0xe2 Aug 23 01:47:48 juju-e4d256-prod-github-runner-207 kernel: [73442.100089] ? timekeeping_update+0xf7/0x150 Aug 23 01:47:48 juju-e4d256-prod-github-runner-207 kernel: [73442.100861] check_cpu_stall+0x109/0x270 Aug 23 01:47:48 juju-e4d256-prod-github-runner-207 kernel: [73442.101610] rcu_sched_clock_irq+0x9a/0x250 Aug 23 01:47:48 juju-e4d256-prod-github-runner-207 kernel: [73442.102384] update_process_times+0x94/0xd0 Aug 23 01:47:48 juju-e4d256-prod-github-runner-207 kernel: [73442.103153] tick_sched_handle+0x29/0x70 Aug 23 01:47:48 juju-e4d256-prod-github-runner-207 kernel: [73442.103919] tick_sched_timer+0x8c/0xc0 Aug 23 01:47:48 juju-e4d256-prod-github-runner-207 kernel: [73442.104658] ? tick_nohz_handler+0xb0/0xb0 Aug 23 01:47:48 juju-e4d256-prod-github-runner-207 kernel: [73442.105414] __hrtimer_run_queues+0x107/0x230 Aug 23 01:47:48 juju-e4d256-prod-github-runner-207 kernel: [73442.106192] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 01:47:48 juju-e4d256-prod-github-runner-207 kernel: [73442.106969] hrtimer_interrupt+0x101/0x220 Aug 23 01:47:48 juju-e4d256-prod-github-runner-207 kernel: [73442.107759] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 01:47:48 juju-e4d256-prod-github-runner-207 kernel: [73442.108588] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 01:47:48 juju-e4d256-prod-github-runner-207 kernel: [73442.109396] Aug 23 01:47:48 juju-e4d256-prod-github-runner-207 kernel: [73442.110032] Aug 23 01:47:48 juju-e4d256-prod-github-runner-207 kernel: [73442.110662] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 01:47:48 juju-e4d256-prod-github-runner-207 kernel: [73442.111494] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:47:48 juju-e4d256-prod-github-runner-207 kernel: [73442.112378] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 01:47:48 juju-e4d256-prod-github-runner-207 kernel: [73442.114625] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 01:47:48 juju-e4d256-prod-github-runner-207 kernel: [73442.115556] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 01:47:48 juju-e4d256-prod-github-runner-207 kernel: [73442.116592] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 01:47:48 juju-e4d256-prod-github-runner-207 kernel: [73442.117591] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 01:47:48 juju-e4d256-prod-github-runner-207 kernel: [73442.118572] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 01:47:48 juju-e4d256-prod-github-runner-207 kernel: [73442.119561] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 01:47:48 juju-e4d256-prod-github-runner-207 kernel: [73442.120519] ? _raw_spin_lock+0x22/0x30 Aug 23 01:47:48 juju-e4d256-prod-github-runner-207 kernel: [73442.121284] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:47:48 juju-e4d256-prod-github-runner-207 kernel: [73442.122147] direct_page_fault+0x206/0x310 [kvm] Aug 23 01:47:48 juju-e4d256-prod-github-runner-207 kernel: [73442.123022] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 01:47:48 juju-e4d256-prod-github-runner-207 kernel: [73442.123871] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 01:47:48 juju-e4d256-prod-github-runner-207 kernel: [73442.124731] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 01:47:48 juju-e4d256-prod-github-runner-207 kernel: [73442.125546] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 01:47:48 juju-e4d256-prod-github-runner-207 kernel: [73442.126328] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 01:47:48 juju-e4d256-prod-github-runner-207 kernel: [73442.127146] handle_exit+0x98/0x230 [kvm_amd] Aug 23 01:47:48 juju-e4d256-prod-github-runner-207 kernel: [73442.127911] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 01:47:48 juju-e4d256-prod-github-runner-207 kernel: [73442.128703] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 01:47:48 juju-e4d256-prod-github-runner-207 kernel: [73442.129514] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 01:47:48 juju-e4d256-prod-github-runner-207 kernel: [73442.130303] vcpu_run+0x62/0x2c0 [kvm] Aug 23 01:47:48 juju-e4d256-prod-github-runner-207 kernel: [73442.131023] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 01:47:48 juju-e4d256-prod-github-runner-207 kernel: [73442.131788] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 01:47:48 juju-e4d256-prod-github-runner-207 kernel: [73442.132589] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 01:47:48 juju-e4d256-prod-github-runner-207 kernel: [73442.133360] ? __seccomp_filter+0x4a/0x4a0 Aug 23 01:47:48 juju-e4d256-prod-github-runner-207 kernel: [73442.134082] ? __fget_files+0x86/0xc0 Aug 23 01:47:48 juju-e4d256-prod-github-runner-207 kernel: [73442.134791] __x64_sys_ioctl+0x95/0xd0 Aug 23 01:47:48 juju-e4d256-prod-github-runner-207 kernel: [73442.135497] do_syscall_64+0x5c/0xc0 Aug 23 01:47:48 juju-e4d256-prod-github-runner-207 kernel: [73442.136203] ? do_futex+0x162/0x1f0 Aug 23 01:47:48 juju-e4d256-prod-github-runner-207 kernel: [73442.136885] ? __x64_sys_futex+0x78/0x1e0 Aug 23 01:47:48 juju-e4d256-prod-github-runner-207 kernel: [73442.137585] ? __secure_computing+0xa9/0x120 Aug 23 01:47:48 juju-e4d256-prod-github-runner-207 kernel: [73442.138305] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 01:47:48 juju-e4d256-prod-github-runner-207 kernel: [73442.139113] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:47:48 juju-e4d256-prod-github-runner-207 kernel: [73442.139905] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:47:48 juju-e4d256-prod-github-runner-207 kernel: [73442.140660] ? do_syscall_64+0x69/0xc0 Aug 23 01:47:48 juju-e4d256-prod-github-runner-207 kernel: [73442.141354] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:47:48 juju-e4d256-prod-github-runner-207 kernel: [73442.142108] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:47:48 juju-e4d256-prod-github-runner-207 kernel: [73442.142864] ? do_syscall_64+0x69/0xc0 Aug 23 01:47:48 juju-e4d256-prod-github-runner-207 kernel: [73442.143581] ? do_syscall_64+0x69/0xc0 Aug 23 01:47:48 juju-e4d256-prod-github-runner-207 kernel: [73442.144290] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 01:47:48 juju-e4d256-prod-github-runner-207 kernel: [73442.145089] RIP: 0033:0x7faa5d0edaff Aug 23 01:47:48 juju-e4d256-prod-github-runner-207 kernel: [73442.145857] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 01:47:48 juju-e4d256-prod-github-runner-207 kernel: [73442.147979] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 01:47:48 juju-e4d256-prod-github-runner-207 kernel: [73442.148963] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 01:47:48 juju-e4d256-prod-github-runner-207 kernel: [73442.149931] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 01:47:48 juju-e4d256-prod-github-runner-207 kernel: [73442.150883] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 01:47:48 juju-e4d256-prod-github-runner-207 kernel: [73442.151845] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 01:47:48 juju-e4d256-prod-github-runner-207 kernel: [73442.152795] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 01:47:48 juju-e4d256-prod-github-runner-207 kernel: [73442.153707] Aug 23 01:48:14 juju-e4d256-prod-github-runner-207 kernel: [73468.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 68314s! [qemu-system-x86:6715] Aug 23 01:48:14 juju-e4d256-prod-github-runner-207 kernel: [73468.543698] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 01:48:14 juju-e4d256-prod-github-runner-207 kernel: [73468.543940] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 01:48:14 juju-e4d256-prod-github-runner-207 kernel: [73468.556111] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 01:48:14 juju-e4d256-prod-github-runner-207 kernel: [73468.557387] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 01:48:14 juju-e4d256-prod-github-runner-207 kernel: [73468.558622] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:48:14 juju-e4d256-prod-github-runner-207 kernel: [73468.559697] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 01:48:14 juju-e4d256-prod-github-runner-207 kernel: [73468.562231] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 01:48:14 juju-e4d256-prod-github-runner-207 kernel: [73468.563282] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 01:48:14 juju-e4d256-prod-github-runner-207 kernel: [73468.564439] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 01:48:14 juju-e4d256-prod-github-runner-207 kernel: [73468.565595] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 01:48:14 juju-e4d256-prod-github-runner-207 kernel: [73468.566787] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 01:48:14 juju-e4d256-prod-github-runner-207 kernel: [73468.567961] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 01:48:14 juju-e4d256-prod-github-runner-207 kernel: [73468.569126] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 01:48:14 juju-e4d256-prod-github-runner-207 kernel: [73468.570364] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 01:48:14 juju-e4d256-prod-github-runner-207 kernel: [73468.571473] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 01:48:14 juju-e4d256-prod-github-runner-207 kernel: [73468.572665] Call Trace: Aug 23 01:48:14 juju-e4d256-prod-github-runner-207 kernel: [73468.573583] Aug 23 01:48:14 juju-e4d256-prod-github-runner-207 kernel: [73468.574466] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:48:14 juju-e4d256-prod-github-runner-207 kernel: [73468.575504] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:48:14 juju-e4d256-prod-github-runner-207 kernel: [73468.576553] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:48:14 juju-e4d256-prod-github-runner-207 kernel: [73468.577635] ? show_regs.part.0+0x23/0x29 Aug 23 01:48:14 juju-e4d256-prod-github-runner-207 kernel: [73468.578633] ? show_regs.cold+0x8/0xd Aug 23 01:48:14 juju-e4d256-prod-github-runner-207 kernel: [73468.579627] ? watchdog_timer_fn+0x1be/0x220 Aug 23 01:48:14 juju-e4d256-prod-github-runner-207 kernel: [73468.580637] ? lockup_detector_update_enable+0x60/0x60 Aug 23 01:48:14 juju-e4d256-prod-github-runner-207 kernel: [73468.581708] ? __hrtimer_run_queues+0x107/0x230 Aug 23 01:48:14 juju-e4d256-prod-github-runner-207 kernel: [73468.582745] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 01:48:14 juju-e4d256-prod-github-runner-207 kernel: [73468.583777] ? hrtimer_interrupt+0x101/0x220 Aug 23 01:48:14 juju-e4d256-prod-github-runner-207 kernel: [73468.584788] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 01:48:14 juju-e4d256-prod-github-runner-207 kernel: [73468.585853] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 01:48:14 juju-e4d256-prod-github-runner-207 kernel: [73468.586929] Aug 23 01:48:14 juju-e4d256-prod-github-runner-207 kernel: [73468.587811] Aug 23 01:48:14 juju-e4d256-prod-github-runner-207 kernel: [73468.588671] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 01:48:14 juju-e4d256-prod-github-runner-207 kernel: [73468.589720] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:48:14 juju-e4d256-prod-github-runner-207 kernel: [73468.590757] ? _raw_spin_lock+0x22/0x30 Aug 23 01:48:14 juju-e4d256-prod-github-runner-207 kernel: [73468.591708] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:48:14 juju-e4d256-prod-github-runner-207 kernel: [73468.592727] direct_page_fault+0x206/0x310 [kvm] Aug 23 01:48:14 juju-e4d256-prod-github-runner-207 kernel: [73468.593748] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 01:48:14 juju-e4d256-prod-github-runner-207 kernel: [73468.594753] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 01:48:14 juju-e4d256-prod-github-runner-207 kernel: [73468.595760] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 01:48:14 juju-e4d256-prod-github-runner-207 kernel: [73468.596765] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 01:48:14 juju-e4d256-prod-github-runner-207 kernel: [73468.597738] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 01:48:14 juju-e4d256-prod-github-runner-207 kernel: [73468.598721] handle_exit+0x98/0x230 [kvm_amd] Aug 23 01:48:14 juju-e4d256-prod-github-runner-207 kernel: [73468.599620] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 01:48:14 juju-e4d256-prod-github-runner-207 kernel: [73468.600534] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 01:48:14 juju-e4d256-prod-github-runner-207 kernel: [73468.601457] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 01:48:14 juju-e4d256-prod-github-runner-207 kernel: [73468.602362] vcpu_run+0x62/0x2c0 [kvm] Aug 23 01:48:14 juju-e4d256-prod-github-runner-207 kernel: [73468.603179] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 01:48:14 juju-e4d256-prod-github-runner-207 kernel: [73468.603987] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 01:48:14 juju-e4d256-prod-github-runner-207 kernel: [73468.605024] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 01:48:14 juju-e4d256-prod-github-runner-207 kernel: [73468.605820] ? __seccomp_filter+0x4a/0x4a0 Aug 23 01:48:14 juju-e4d256-prod-github-runner-207 kernel: [73468.606567] ? __fget_files+0x86/0xc0 Aug 23 01:48:14 juju-e4d256-prod-github-runner-207 kernel: [73468.607299] __x64_sys_ioctl+0x95/0xd0 Aug 23 01:48:14 juju-e4d256-prod-github-runner-207 kernel: [73468.608002] do_syscall_64+0x5c/0xc0 Aug 23 01:48:14 juju-e4d256-prod-github-runner-207 kernel: [73468.608668] ? do_futex+0x162/0x1f0 Aug 23 01:48:14 juju-e4d256-prod-github-runner-207 kernel: [73468.609315] ? __x64_sys_futex+0x78/0x1e0 Aug 23 01:48:14 juju-e4d256-prod-github-runner-207 kernel: [73468.609988] ? __secure_computing+0xa9/0x120 Aug 23 01:48:14 juju-e4d256-prod-github-runner-207 kernel: [73468.610676] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 01:48:14 juju-e4d256-prod-github-runner-207 kernel: [73468.611442] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:48:14 juju-e4d256-prod-github-runner-207 kernel: [73468.612303] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:48:14 juju-e4d256-prod-github-runner-207 kernel: [73468.613021] ? do_syscall_64+0x69/0xc0 Aug 23 01:48:14 juju-e4d256-prod-github-runner-207 kernel: [73468.613665] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:48:14 juju-e4d256-prod-github-runner-207 kernel: [73468.614373] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:48:14 juju-e4d256-prod-github-runner-207 kernel: [73468.615083] ? do_syscall_64+0x69/0xc0 Aug 23 01:48:14 juju-e4d256-prod-github-runner-207 kernel: [73468.615708] ? do_syscall_64+0x69/0xc0 Aug 23 01:48:14 juju-e4d256-prod-github-runner-207 kernel: [73468.616384] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 01:48:14 juju-e4d256-prod-github-runner-207 kernel: [73468.617101] RIP: 0033:0x7faa5d0edaff Aug 23 01:48:14 juju-e4d256-prod-github-runner-207 kernel: [73468.617756] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 01:48:14 juju-e4d256-prod-github-runner-207 kernel: [73468.619779] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 01:48:14 juju-e4d256-prod-github-runner-207 kernel: [73468.620689] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 01:48:14 juju-e4d256-prod-github-runner-207 kernel: [73468.621577] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 01:48:14 juju-e4d256-prod-github-runner-207 kernel: [73468.622462] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 01:48:14 juju-e4d256-prod-github-runner-207 kernel: [73468.623357] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 01:48:14 juju-e4d256-prod-github-runner-207 kernel: [73468.624245] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 01:48:14 juju-e4d256-prod-github-runner-207 kernel: [73468.625134] Aug 23 01:48:42 juju-e4d256-prod-github-runner-207 kernel: [73496.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 68340s! [qemu-system-x86:6715] Aug 23 01:48:42 juju-e4d256-prod-github-runner-207 kernel: [73496.543125] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 01:48:42 juju-e4d256-prod-github-runner-207 kernel: [73496.543193] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 01:48:42 juju-e4d256-prod-github-runner-207 kernel: [73496.555279] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 01:48:42 juju-e4d256-prod-github-runner-207 kernel: [73496.556555] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 01:48:42 juju-e4d256-prod-github-runner-207 kernel: [73496.557784] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:48:42 juju-e4d256-prod-github-runner-207 kernel: [73496.558885] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 01:48:42 juju-e4d256-prod-github-runner-207 kernel: [73496.561454] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 01:48:42 juju-e4d256-prod-github-runner-207 kernel: [73496.562497] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 01:48:42 juju-e4d256-prod-github-runner-207 kernel: [73496.563699] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 01:48:42 juju-e4d256-prod-github-runner-207 kernel: [73496.564876] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 01:48:42 juju-e4d256-prod-github-runner-207 kernel: [73496.566032] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 01:48:42 juju-e4d256-prod-github-runner-207 kernel: [73496.567212] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 01:48:42 juju-e4d256-prod-github-runner-207 kernel: [73496.568388] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 01:48:42 juju-e4d256-prod-github-runner-207 kernel: [73496.569620] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 01:48:42 juju-e4d256-prod-github-runner-207 kernel: [73496.570735] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 01:48:42 juju-e4d256-prod-github-runner-207 kernel: [73496.571933] Call Trace: Aug 23 01:48:42 juju-e4d256-prod-github-runner-207 kernel: [73496.572867] Aug 23 01:48:42 juju-e4d256-prod-github-runner-207 kernel: [73496.573762] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:48:42 juju-e4d256-prod-github-runner-207 kernel: [73496.574807] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:48:42 juju-e4d256-prod-github-runner-207 kernel: [73496.575829] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:48:42 juju-e4d256-prod-github-runner-207 kernel: [73496.576909] ? show_regs.part.0+0x23/0x29 Aug 23 01:48:42 juju-e4d256-prod-github-runner-207 kernel: [73496.577907] ? show_regs.cold+0x8/0xd Aug 23 01:48:42 juju-e4d256-prod-github-runner-207 kernel: [73496.578897] ? watchdog_timer_fn+0x1be/0x220 Aug 23 01:48:42 juju-e4d256-prod-github-runner-207 kernel: [73496.579910] ? lockup_detector_update_enable+0x60/0x60 Aug 23 01:48:42 juju-e4d256-prod-github-runner-207 kernel: [73496.580973] ? __hrtimer_run_queues+0x107/0x230 Aug 23 01:48:42 juju-e4d256-prod-github-runner-207 kernel: [73496.582002] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 01:48:42 juju-e4d256-prod-github-runner-207 kernel: [73496.583044] ? hrtimer_interrupt+0x101/0x220 Aug 23 01:48:42 juju-e4d256-prod-github-runner-207 kernel: [73496.584068] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 01:48:42 juju-e4d256-prod-github-runner-207 kernel: [73496.585153] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 01:48:42 juju-e4d256-prod-github-runner-207 kernel: [73496.586219] Aug 23 01:48:42 juju-e4d256-prod-github-runner-207 kernel: [73496.587090] Aug 23 01:48:42 juju-e4d256-prod-github-runner-207 kernel: [73496.587930] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 01:48:42 juju-e4d256-prod-github-runner-207 kernel: [73496.588961] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:48:42 juju-e4d256-prod-github-runner-207 kernel: [73496.589998] ? _raw_spin_lock+0x22/0x30 Aug 23 01:48:42 juju-e4d256-prod-github-runner-207 kernel: [73496.590963] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:48:42 juju-e4d256-prod-github-runner-207 kernel: [73496.591980] direct_page_fault+0x206/0x310 [kvm] Aug 23 01:48:42 juju-e4d256-prod-github-runner-207 kernel: [73496.593008] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 01:48:42 juju-e4d256-prod-github-runner-207 kernel: [73496.594020] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 01:48:42 juju-e4d256-prod-github-runner-207 kernel: [73496.595041] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 01:48:42 juju-e4d256-prod-github-runner-207 kernel: [73496.596027] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 01:48:42 juju-e4d256-prod-github-runner-207 kernel: [73496.596971] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 01:48:42 juju-e4d256-prod-github-runner-207 kernel: [73496.597947] handle_exit+0x98/0x230 [kvm_amd] Aug 23 01:48:42 juju-e4d256-prod-github-runner-207 kernel: [73496.598862] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 01:48:42 juju-e4d256-prod-github-runner-207 kernel: [73496.599775] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 01:48:42 juju-e4d256-prod-github-runner-207 kernel: [73496.600697] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 01:48:42 juju-e4d256-prod-github-runner-207 kernel: [73496.601598] vcpu_run+0x62/0x2c0 [kvm] Aug 23 01:48:42 juju-e4d256-prod-github-runner-207 kernel: [73496.602411] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 01:48:42 juju-e4d256-prod-github-runner-207 kernel: [73496.603242] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 01:48:42 juju-e4d256-prod-github-runner-207 kernel: [73496.604097] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 01:48:42 juju-e4d256-prod-github-runner-207 kernel: [73496.604893] ? __seccomp_filter+0x4a/0x4a0 Aug 23 01:48:42 juju-e4d256-prod-github-runner-207 kernel: [73496.605635] ? __fget_files+0x86/0xc0 Aug 23 01:48:42 juju-e4d256-prod-github-runner-207 kernel: [73496.606369] __x64_sys_ioctl+0x95/0xd0 Aug 23 01:48:42 juju-e4d256-prod-github-runner-207 kernel: [73496.607098] do_syscall_64+0x5c/0xc0 Aug 23 01:48:42 juju-e4d256-prod-github-runner-207 kernel: [73496.607771] ? do_futex+0x162/0x1f0 Aug 23 01:48:42 juju-e4d256-prod-github-runner-207 kernel: [73496.608428] ? __x64_sys_futex+0x78/0x1e0 Aug 23 01:48:42 juju-e4d256-prod-github-runner-207 kernel: [73496.609100] ? __secure_computing+0xa9/0x120 Aug 23 01:48:42 juju-e4d256-prod-github-runner-207 kernel: [73496.609788] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 01:48:42 juju-e4d256-prod-github-runner-207 kernel: [73496.610546] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:48:42 juju-e4d256-prod-github-runner-207 kernel: [73496.611288] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:48:42 juju-e4d256-prod-github-runner-207 kernel: [73496.612010] ? do_syscall_64+0x69/0xc0 Aug 23 01:48:42 juju-e4d256-prod-github-runner-207 kernel: [73496.612662] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:48:42 juju-e4d256-prod-github-runner-207 kernel: [73496.613367] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:48:42 juju-e4d256-prod-github-runner-207 kernel: [73496.614062] ? do_syscall_64+0x69/0xc0 Aug 23 01:48:42 juju-e4d256-prod-github-runner-207 kernel: [73496.614700] ? do_syscall_64+0x69/0xc0 Aug 23 01:48:42 juju-e4d256-prod-github-runner-207 kernel: [73496.615323] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 01:48:42 juju-e4d256-prod-github-runner-207 kernel: [73496.616025] RIP: 0033:0x7faa5d0edaff Aug 23 01:48:42 juju-e4d256-prod-github-runner-207 kernel: [73496.616646] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 01:48:42 juju-e4d256-prod-github-runner-207 kernel: [73496.618646] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 01:48:42 juju-e4d256-prod-github-runner-207 kernel: [73496.619718] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 01:48:42 juju-e4d256-prod-github-runner-207 kernel: [73496.620612] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 01:48:42 juju-e4d256-prod-github-runner-207 kernel: [73496.621505] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 01:48:42 juju-e4d256-prod-github-runner-207 kernel: [73496.622393] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 01:48:42 juju-e4d256-prod-github-runner-207 kernel: [73496.623295] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 01:48:42 juju-e4d256-prod-github-runner-207 kernel: [73496.624187] Aug 23 01:49:10 juju-e4d256-prod-github-runner-207 kernel: [73524.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 68367s! [qemu-system-x86:6715] Aug 23 01:49:10 juju-e4d256-prod-github-runner-207 kernel: [73524.543134] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 01:49:10 juju-e4d256-prod-github-runner-207 kernel: [73524.543201] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 01:49:10 juju-e4d256-prod-github-runner-207 kernel: [73524.555363] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 01:49:10 juju-e4d256-prod-github-runner-207 kernel: [73524.556644] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 01:49:10 juju-e4d256-prod-github-runner-207 kernel: [73524.558020] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:49:10 juju-e4d256-prod-github-runner-207 kernel: [73524.559142] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 01:49:10 juju-e4d256-prod-github-runner-207 kernel: [73524.561738] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 01:49:10 juju-e4d256-prod-github-runner-207 kernel: [73524.562840] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 01:49:10 juju-e4d256-prod-github-runner-207 kernel: [73524.564080] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 01:49:10 juju-e4d256-prod-github-runner-207 kernel: [73524.565323] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 01:49:10 juju-e4d256-prod-github-runner-207 kernel: [73524.566595] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 01:49:10 juju-e4d256-prod-github-runner-207 kernel: [73524.567764] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 01:49:10 juju-e4d256-prod-github-runner-207 kernel: [73524.569055] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 01:49:10 juju-e4d256-prod-github-runner-207 kernel: [73524.570307] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 01:49:10 juju-e4d256-prod-github-runner-207 kernel: [73524.571444] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 01:49:10 juju-e4d256-prod-github-runner-207 kernel: [73524.572698] Call Trace: Aug 23 01:49:10 juju-e4d256-prod-github-runner-207 kernel: [73524.573614] Aug 23 01:49:10 juju-e4d256-prod-github-runner-207 kernel: [73524.574516] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:49:10 juju-e4d256-prod-github-runner-207 kernel: [73524.575620] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:49:10 juju-e4d256-prod-github-runner-207 kernel: [73524.576709] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:49:10 juju-e4d256-prod-github-runner-207 kernel: [73524.577825] ? show_regs.part.0+0x23/0x29 Aug 23 01:49:10 juju-e4d256-prod-github-runner-207 kernel: [73524.578893] ? show_regs.cold+0x8/0xd Aug 23 01:49:10 juju-e4d256-prod-github-runner-207 kernel: [73524.579949] ? watchdog_timer_fn+0x1be/0x220 Aug 23 01:49:10 juju-e4d256-prod-github-runner-207 kernel: [73524.581018] ? lockup_detector_update_enable+0x60/0x60 Aug 23 01:49:10 juju-e4d256-prod-github-runner-207 kernel: [73524.582138] ? __hrtimer_run_queues+0x107/0x230 Aug 23 01:49:10 juju-e4d256-prod-github-runner-207 kernel: [73524.583195] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 01:49:10 juju-e4d256-prod-github-runner-207 kernel: [73524.584251] ? hrtimer_interrupt+0x101/0x220 Aug 23 01:49:10 juju-e4d256-prod-github-runner-207 kernel: [73524.585289] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 01:49:10 juju-e4d256-prod-github-runner-207 kernel: [73524.586399] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 01:49:10 juju-e4d256-prod-github-runner-207 kernel: [73524.587456] Aug 23 01:49:10 juju-e4d256-prod-github-runner-207 kernel: [73524.588321] Aug 23 01:49:10 juju-e4d256-prod-github-runner-207 kernel: [73524.589222] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 01:49:10 juju-e4d256-prod-github-runner-207 kernel: [73524.590329] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:49:10 juju-e4d256-prod-github-runner-207 kernel: [73524.591370] ? _raw_spin_lock+0x22/0x30 Aug 23 01:49:10 juju-e4d256-prod-github-runner-207 kernel: [73524.592324] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:49:10 juju-e4d256-prod-github-runner-207 kernel: [73524.593347] direct_page_fault+0x206/0x310 [kvm] Aug 23 01:49:10 juju-e4d256-prod-github-runner-207 kernel: [73524.594388] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 01:49:10 juju-e4d256-prod-github-runner-207 kernel: [73524.595401] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 01:49:10 juju-e4d256-prod-github-runner-207 kernel: [73524.596402] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 01:49:10 juju-e4d256-prod-github-runner-207 kernel: [73524.597375] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 01:49:10 juju-e4d256-prod-github-runner-207 kernel: [73524.598332] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 01:49:10 juju-e4d256-prod-github-runner-207 kernel: [73524.599320] handle_exit+0x98/0x230 [kvm_amd] Aug 23 01:49:10 juju-e4d256-prod-github-runner-207 kernel: [73524.600221] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 01:49:10 juju-e4d256-prod-github-runner-207 kernel: [73524.601136] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 01:49:10 juju-e4d256-prod-github-runner-207 kernel: [73524.602103] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 01:49:10 juju-e4d256-prod-github-runner-207 kernel: [73524.603064] vcpu_run+0x62/0x2c0 [kvm] Aug 23 01:49:10 juju-e4d256-prod-github-runner-207 kernel: [73524.603905] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 01:49:10 juju-e4d256-prod-github-runner-207 kernel: [73524.604741] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 01:49:10 juju-e4d256-prod-github-runner-207 kernel: [73524.605725] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 01:49:10 juju-e4d256-prod-github-runner-207 kernel: [73524.606613] ? __seccomp_filter+0x4a/0x4a0 Aug 23 01:49:10 juju-e4d256-prod-github-runner-207 kernel: [73524.607407] ? __fget_files+0x86/0xc0 Aug 23 01:49:10 juju-e4d256-prod-github-runner-207 kernel: [73524.608151] __x64_sys_ioctl+0x95/0xd0 Aug 23 01:49:10 juju-e4d256-prod-github-runner-207 kernel: [73524.608868] do_syscall_64+0x5c/0xc0 Aug 23 01:49:10 juju-e4d256-prod-github-runner-207 kernel: [73524.609585] ? do_futex+0x162/0x1f0 Aug 23 01:49:10 juju-e4d256-prod-github-runner-207 kernel: [73524.610249] ? __x64_sys_futex+0x78/0x1e0 Aug 23 01:49:10 juju-e4d256-prod-github-runner-207 kernel: [73524.610992] ? __secure_computing+0xa9/0x120 Aug 23 01:49:10 juju-e4d256-prod-github-runner-207 kernel: [73524.611692] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 01:49:10 juju-e4d256-prod-github-runner-207 kernel: [73524.612491] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:49:10 juju-e4d256-prod-github-runner-207 kernel: [73524.613286] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:49:10 juju-e4d256-prod-github-runner-207 kernel: [73524.614015] ? do_syscall_64+0x69/0xc0 Aug 23 01:49:10 juju-e4d256-prod-github-runner-207 kernel: [73524.614701] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:49:10 juju-e4d256-prod-github-runner-207 kernel: [73524.615451] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:49:10 juju-e4d256-prod-github-runner-207 kernel: [73524.616158] ? do_syscall_64+0x69/0xc0 Aug 23 01:49:10 juju-e4d256-prod-github-runner-207 kernel: [73524.616784] ? do_syscall_64+0x69/0xc0 Aug 23 01:49:10 juju-e4d256-prod-github-runner-207 kernel: [73524.617417] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 01:49:10 juju-e4d256-prod-github-runner-207 kernel: [73524.618127] RIP: 0033:0x7faa5d0edaff Aug 23 01:49:10 juju-e4d256-prod-github-runner-207 kernel: [73524.618793] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 01:49:10 juju-e4d256-prod-github-runner-207 kernel: [73524.620828] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 01:49:10 juju-e4d256-prod-github-runner-207 kernel: [73524.621763] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 01:49:10 juju-e4d256-prod-github-runner-207 kernel: [73524.622692] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 01:49:10 juju-e4d256-prod-github-runner-207 kernel: [73524.623590] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 01:49:10 juju-e4d256-prod-github-runner-207 kernel: [73524.624477] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 01:49:10 juju-e4d256-prod-github-runner-207 kernel: [73524.625394] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 01:49:10 juju-e4d256-prod-github-runner-207 kernel: [73524.626329] Aug 23 01:49:38 juju-e4d256-prod-github-runner-207 kernel: [73552.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 68393s! [qemu-system-x86:6715] Aug 23 01:49:38 juju-e4d256-prod-github-runner-207 kernel: [73552.543677] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 01:49:38 juju-e4d256-prod-github-runner-207 kernel: [73552.543915] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 01:49:38 juju-e4d256-prod-github-runner-207 kernel: [73552.556147] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 01:49:38 juju-e4d256-prod-github-runner-207 kernel: [73552.557411] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 01:49:38 juju-e4d256-prod-github-runner-207 kernel: [73552.558636] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:49:38 juju-e4d256-prod-github-runner-207 kernel: [73552.559691] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 01:49:38 juju-e4d256-prod-github-runner-207 kernel: [73552.562242] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 01:49:38 juju-e4d256-prod-github-runner-207 kernel: [73552.563282] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 01:49:38 juju-e4d256-prod-github-runner-207 kernel: [73552.564441] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 01:49:38 juju-e4d256-prod-github-runner-207 kernel: [73552.565599] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 01:49:38 juju-e4d256-prod-github-runner-207 kernel: [73552.566767] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 01:49:38 juju-e4d256-prod-github-runner-207 kernel: [73552.567931] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 01:49:38 juju-e4d256-prod-github-runner-207 kernel: [73552.569092] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 01:49:38 juju-e4d256-prod-github-runner-207 kernel: [73552.570339] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 01:49:38 juju-e4d256-prod-github-runner-207 kernel: [73552.571437] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 01:49:38 juju-e4d256-prod-github-runner-207 kernel: [73552.572636] Call Trace: Aug 23 01:49:38 juju-e4d256-prod-github-runner-207 kernel: [73552.573603] Aug 23 01:49:38 juju-e4d256-prod-github-runner-207 kernel: [73552.574507] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:49:38 juju-e4d256-prod-github-runner-207 kernel: [73552.575536] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:49:38 juju-e4d256-prod-github-runner-207 kernel: [73552.576593] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:49:38 juju-e4d256-prod-github-runner-207 kernel: [73552.577681] ? show_regs.part.0+0x23/0x29 Aug 23 01:49:38 juju-e4d256-prod-github-runner-207 kernel: [73552.578686] ? show_regs.cold+0x8/0xd Aug 23 01:49:38 juju-e4d256-prod-github-runner-207 kernel: [73552.579656] ? watchdog_timer_fn+0x1be/0x220 Aug 23 01:49:38 juju-e4d256-prod-github-runner-207 kernel: [73552.580664] ? lockup_detector_update_enable+0x60/0x60 Aug 23 01:49:38 juju-e4d256-prod-github-runner-207 kernel: [73552.581726] ? __hrtimer_run_queues+0x107/0x230 Aug 23 01:49:38 juju-e4d256-prod-github-runner-207 kernel: [73552.582765] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 01:49:38 juju-e4d256-prod-github-runner-207 kernel: [73552.583792] ? hrtimer_interrupt+0x101/0x220 Aug 23 01:49:38 juju-e4d256-prod-github-runner-207 kernel: [73552.584804] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 01:49:38 juju-e4d256-prod-github-runner-207 kernel: [73552.585876] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 01:49:38 juju-e4d256-prod-github-runner-207 kernel: [73552.586977] Aug 23 01:49:38 juju-e4d256-prod-github-runner-207 kernel: [73552.587827] Aug 23 01:49:38 juju-e4d256-prod-github-runner-207 kernel: [73552.588662] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 01:49:38 juju-e4d256-prod-github-runner-207 kernel: [73552.589700] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:49:38 juju-e4d256-prod-github-runner-207 kernel: [73552.590747] ? _raw_spin_lock+0x22/0x30 Aug 23 01:49:38 juju-e4d256-prod-github-runner-207 kernel: [73552.591690] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:49:38 juju-e4d256-prod-github-runner-207 kernel: [73552.592709] direct_page_fault+0x206/0x310 [kvm] Aug 23 01:49:38 juju-e4d256-prod-github-runner-207 kernel: [73552.593733] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 01:49:38 juju-e4d256-prod-github-runner-207 kernel: [73552.594748] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 01:49:38 juju-e4d256-prod-github-runner-207 kernel: [73552.595748] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 01:49:38 juju-e4d256-prod-github-runner-207 kernel: [73552.596737] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 01:49:38 juju-e4d256-prod-github-runner-207 kernel: [73552.597681] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 01:49:38 juju-e4d256-prod-github-runner-207 kernel: [73552.598675] handle_exit+0x98/0x230 [kvm_amd] Aug 23 01:49:38 juju-e4d256-prod-github-runner-207 kernel: [73552.599565] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 01:49:38 juju-e4d256-prod-github-runner-207 kernel: [73552.600513] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 01:49:38 juju-e4d256-prod-github-runner-207 kernel: [73552.601437] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 01:49:38 juju-e4d256-prod-github-runner-207 kernel: [73552.602352] vcpu_run+0x62/0x2c0 [kvm] Aug 23 01:49:38 juju-e4d256-prod-github-runner-207 kernel: [73552.603162] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 01:49:38 juju-e4d256-prod-github-runner-207 kernel: [73552.603966] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 01:49:38 juju-e4d256-prod-github-runner-207 kernel: [73552.604817] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 01:49:38 juju-e4d256-prod-github-runner-207 kernel: [73552.605612] ? __seccomp_filter+0x4a/0x4a0 Aug 23 01:49:38 juju-e4d256-prod-github-runner-207 kernel: [73552.606366] ? __fget_files+0x86/0xc0 Aug 23 01:49:38 juju-e4d256-prod-github-runner-207 kernel: [73552.607069] __x64_sys_ioctl+0x95/0xd0 Aug 23 01:49:38 juju-e4d256-prod-github-runner-207 kernel: [73552.607759] do_syscall_64+0x5c/0xc0 Aug 23 01:49:38 juju-e4d256-prod-github-runner-207 kernel: [73552.608460] ? do_futex+0x162/0x1f0 Aug 23 01:49:38 juju-e4d256-prod-github-runner-207 kernel: [73552.609106] ? __x64_sys_futex+0x78/0x1e0 Aug 23 01:49:38 juju-e4d256-prod-github-runner-207 kernel: [73552.609779] ? __secure_computing+0xa9/0x120 Aug 23 01:49:38 juju-e4d256-prod-github-runner-207 kernel: [73552.610476] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 01:49:38 juju-e4d256-prod-github-runner-207 kernel: [73552.611237] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:49:38 juju-e4d256-prod-github-runner-207 kernel: [73552.611956] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:49:38 juju-e4d256-prod-github-runner-207 kernel: [73552.612671] ? do_syscall_64+0x69/0xc0 Aug 23 01:49:38 juju-e4d256-prod-github-runner-207 kernel: [73552.613316] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:49:38 juju-e4d256-prod-github-runner-207 kernel: [73552.614023] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:49:38 juju-e4d256-prod-github-runner-207 kernel: [73552.614717] ? do_syscall_64+0x69/0xc0 Aug 23 01:49:38 juju-e4d256-prod-github-runner-207 kernel: [73552.615339] ? do_syscall_64+0x69/0xc0 Aug 23 01:49:38 juju-e4d256-prod-github-runner-207 kernel: [73552.615959] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 01:49:38 juju-e4d256-prod-github-runner-207 kernel: [73552.616661] RIP: 0033:0x7faa5d0edaff Aug 23 01:49:38 juju-e4d256-prod-github-runner-207 kernel: [73552.617304] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 01:49:38 juju-e4d256-prod-github-runner-207 kernel: [73552.619291] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 01:49:38 juju-e4d256-prod-github-runner-207 kernel: [73552.620203] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 01:49:38 juju-e4d256-prod-github-runner-207 kernel: [73552.621089] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 01:49:38 juju-e4d256-prod-github-runner-207 kernel: [73552.621985] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 01:49:38 juju-e4d256-prod-github-runner-207 kernel: [73552.622871] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 01:49:38 juju-e4d256-prod-github-runner-207 kernel: [73552.623757] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 01:49:38 juju-e4d256-prod-github-runner-207 kernel: [73552.624651] Aug 23 01:50:06 juju-e4d256-prod-github-runner-207 kernel: [73580.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 68419s! [qemu-system-x86:6715] Aug 23 01:50:06 juju-e4d256-prod-github-runner-207 kernel: [73580.543099] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 01:50:06 juju-e4d256-prod-github-runner-207 kernel: [73580.543167] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 01:50:06 juju-e4d256-prod-github-runner-207 kernel: [73580.555239] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 01:50:06 juju-e4d256-prod-github-runner-207 kernel: [73580.556507] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 01:50:06 juju-e4d256-prod-github-runner-207 kernel: [73580.557738] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:50:06 juju-e4d256-prod-github-runner-207 kernel: [73580.558793] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 01:50:06 juju-e4d256-prod-github-runner-207 kernel: [73580.561342] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 01:50:06 juju-e4d256-prod-github-runner-207 kernel: [73580.562393] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 01:50:06 juju-e4d256-prod-github-runner-207 kernel: [73580.563555] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 01:50:06 juju-e4d256-prod-github-runner-207 kernel: [73580.564718] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 01:50:06 juju-e4d256-prod-github-runner-207 kernel: [73580.565888] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 01:50:06 juju-e4d256-prod-github-runner-207 kernel: [73580.567053] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 01:50:06 juju-e4d256-prod-github-runner-207 kernel: [73580.568217] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 01:50:06 juju-e4d256-prod-github-runner-207 kernel: [73580.569451] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 01:50:06 juju-e4d256-prod-github-runner-207 kernel: [73580.570562] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 01:50:06 juju-e4d256-prod-github-runner-207 kernel: [73580.571817] Call Trace: Aug 23 01:50:06 juju-e4d256-prod-github-runner-207 kernel: [73580.572734] Aug 23 01:50:06 juju-e4d256-prod-github-runner-207 kernel: [73580.573617] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:50:06 juju-e4d256-prod-github-runner-207 kernel: [73580.574653] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:50:06 juju-e4d256-prod-github-runner-207 kernel: [73580.575675] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:50:06 juju-e4d256-prod-github-runner-207 kernel: [73580.576747] ? show_regs.part.0+0x23/0x29 Aug 23 01:50:06 juju-e4d256-prod-github-runner-207 kernel: [73580.577756] ? show_regs.cold+0x8/0xd Aug 23 01:50:06 juju-e4d256-prod-github-runner-207 kernel: [73580.578765] ? watchdog_timer_fn+0x1be/0x220 Aug 23 01:50:06 juju-e4d256-prod-github-runner-207 kernel: [73580.579773] ? lockup_detector_update_enable+0x60/0x60 Aug 23 01:50:06 juju-e4d256-prod-github-runner-207 kernel: [73580.580838] ? __hrtimer_run_queues+0x107/0x230 Aug 23 01:50:06 juju-e4d256-prod-github-runner-207 kernel: [73580.581888] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 01:50:06 juju-e4d256-prod-github-runner-207 kernel: [73580.582922] ? hrtimer_interrupt+0x101/0x220 Aug 23 01:50:06 juju-e4d256-prod-github-runner-207 kernel: [73580.583938] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 01:50:06 juju-e4d256-prod-github-runner-207 kernel: [73580.585003] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 01:50:06 juju-e4d256-prod-github-runner-207 kernel: [73580.586068] Aug 23 01:50:06 juju-e4d256-prod-github-runner-207 kernel: [73580.586925] Aug 23 01:50:06 juju-e4d256-prod-github-runner-207 kernel: [73580.587766] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 01:50:06 juju-e4d256-prod-github-runner-207 kernel: [73580.588803] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:50:06 juju-e4d256-prod-github-runner-207 kernel: [73580.590023] ? _raw_spin_lock+0x22/0x30 Aug 23 01:50:06 juju-e4d256-prod-github-runner-207 kernel: [73580.590969] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:50:06 juju-e4d256-prod-github-runner-207 kernel: [73580.591984] direct_page_fault+0x206/0x310 [kvm] Aug 23 01:50:06 juju-e4d256-prod-github-runner-207 kernel: [73580.593006] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 01:50:06 juju-e4d256-prod-github-runner-207 kernel: [73580.594030] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 01:50:06 juju-e4d256-prod-github-runner-207 kernel: [73580.595031] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 01:50:06 juju-e4d256-prod-github-runner-207 kernel: [73580.596012] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 01:50:06 juju-e4d256-prod-github-runner-207 kernel: [73580.596966] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 01:50:06 juju-e4d256-prod-github-runner-207 kernel: [73580.597956] handle_exit+0x98/0x230 [kvm_amd] Aug 23 01:50:06 juju-e4d256-prod-github-runner-207 kernel: [73580.598847] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 01:50:06 juju-e4d256-prod-github-runner-207 kernel: [73580.599758] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 01:50:06 juju-e4d256-prod-github-runner-207 kernel: [73580.600681] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 01:50:06 juju-e4d256-prod-github-runner-207 kernel: [73580.601579] vcpu_run+0x62/0x2c0 [kvm] Aug 23 01:50:06 juju-e4d256-prod-github-runner-207 kernel: [73580.602406] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 01:50:06 juju-e4d256-prod-github-runner-207 kernel: [73580.603209] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 01:50:06 juju-e4d256-prod-github-runner-207 kernel: [73580.604060] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 01:50:06 juju-e4d256-prod-github-runner-207 kernel: [73580.604853] ? __seccomp_filter+0x4a/0x4a0 Aug 23 01:50:06 juju-e4d256-prod-github-runner-207 kernel: [73580.605591] ? __fget_files+0x86/0xc0 Aug 23 01:50:06 juju-e4d256-prod-github-runner-207 kernel: [73580.606303] __x64_sys_ioctl+0x95/0xd0 Aug 23 01:50:06 juju-e4d256-prod-github-runner-207 kernel: [73580.606991] do_syscall_64+0x5c/0xc0 Aug 23 01:50:06 juju-e4d256-prod-github-runner-207 kernel: [73580.607657] ? do_futex+0x162/0x1f0 Aug 23 01:50:06 juju-e4d256-prod-github-runner-207 kernel: [73580.608303] ? __x64_sys_futex+0x78/0x1e0 Aug 23 01:50:06 juju-e4d256-prod-github-runner-207 kernel: [73580.608973] ? __secure_computing+0xa9/0x120 Aug 23 01:50:06 juju-e4d256-prod-github-runner-207 kernel: [73580.609672] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 01:50:06 juju-e4d256-prod-github-runner-207 kernel: [73580.610476] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:50:06 juju-e4d256-prod-github-runner-207 kernel: [73580.611204] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:50:06 juju-e4d256-prod-github-runner-207 kernel: [73580.611920] ? do_syscall_64+0x69/0xc0 Aug 23 01:50:06 juju-e4d256-prod-github-runner-207 kernel: [73580.612576] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:50:06 juju-e4d256-prod-github-runner-207 kernel: [73580.613295] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:50:06 juju-e4d256-prod-github-runner-207 kernel: [73580.613999] ? do_syscall_64+0x69/0xc0 Aug 23 01:50:06 juju-e4d256-prod-github-runner-207 kernel: [73580.614624] ? do_syscall_64+0x69/0xc0 Aug 23 01:50:06 juju-e4d256-prod-github-runner-207 kernel: [73580.615244] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 01:50:06 juju-e4d256-prod-github-runner-207 kernel: [73580.615946] RIP: 0033:0x7faa5d0edaff Aug 23 01:50:06 juju-e4d256-prod-github-runner-207 kernel: [73580.616573] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 01:50:06 juju-e4d256-prod-github-runner-207 kernel: [73580.618572] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 01:50:06 juju-e4d256-prod-github-runner-207 kernel: [73580.619479] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 01:50:06 juju-e4d256-prod-github-runner-207 kernel: [73580.620372] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 01:50:06 juju-e4d256-prod-github-runner-207 kernel: [73580.621259] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 01:50:06 juju-e4d256-prod-github-runner-207 kernel: [73580.622161] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 01:50:06 juju-e4d256-prod-github-runner-207 kernel: [73580.623055] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 01:50:06 juju-e4d256-prod-github-runner-207 kernel: [73580.623958] Aug 23 01:50:34 juju-e4d256-prod-github-runner-207 kernel: [73608.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 68445s! [qemu-system-x86:6715] Aug 23 01:50:34 juju-e4d256-prod-github-runner-207 kernel: [73608.543105] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 01:50:34 juju-e4d256-prod-github-runner-207 kernel: [73608.543174] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 01:50:34 juju-e4d256-prod-github-runner-207 kernel: [73608.555295] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 01:50:34 juju-e4d256-prod-github-runner-207 kernel: [73608.556568] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 01:50:34 juju-e4d256-prod-github-runner-207 kernel: [73608.557813] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:50:34 juju-e4d256-prod-github-runner-207 kernel: [73608.558879] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 01:50:34 juju-e4d256-prod-github-runner-207 kernel: [73608.561445] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 01:50:34 juju-e4d256-prod-github-runner-207 kernel: [73608.562494] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 01:50:34 juju-e4d256-prod-github-runner-207 kernel: [73608.563653] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 01:50:34 juju-e4d256-prod-github-runner-207 kernel: [73608.564833] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 01:50:34 juju-e4d256-prod-github-runner-207 kernel: [73608.566012] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 01:50:34 juju-e4d256-prod-github-runner-207 kernel: [73608.567174] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 01:50:34 juju-e4d256-prod-github-runner-207 kernel: [73608.568338] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 01:50:34 juju-e4d256-prod-github-runner-207 kernel: [73608.569589] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 01:50:34 juju-e4d256-prod-github-runner-207 kernel: [73608.570686] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 01:50:34 juju-e4d256-prod-github-runner-207 kernel: [73608.571877] Call Trace: Aug 23 01:50:34 juju-e4d256-prod-github-runner-207 kernel: [73608.572791] Aug 23 01:50:34 juju-e4d256-prod-github-runner-207 kernel: [73608.573687] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:50:34 juju-e4d256-prod-github-runner-207 kernel: [73608.574717] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:50:34 juju-e4d256-prod-github-runner-207 kernel: [73608.575741] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:50:34 juju-e4d256-prod-github-runner-207 kernel: [73608.576815] ? show_regs.part.0+0x23/0x29 Aug 23 01:50:34 juju-e4d256-prod-github-runner-207 kernel: [73608.577838] ? show_regs.cold+0x8/0xd Aug 23 01:50:34 juju-e4d256-prod-github-runner-207 kernel: [73608.578816] ? watchdog_timer_fn+0x1be/0x220 Aug 23 01:50:34 juju-e4d256-prod-github-runner-207 kernel: [73608.579829] ? lockup_detector_update_enable+0x60/0x60 Aug 23 01:50:34 juju-e4d256-prod-github-runner-207 kernel: [73608.580892] ? __hrtimer_run_queues+0x107/0x230 Aug 23 01:50:34 juju-e4d256-prod-github-runner-207 kernel: [73608.581936] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 01:50:34 juju-e4d256-prod-github-runner-207 kernel: [73608.582965] ? hrtimer_interrupt+0x101/0x220 Aug 23 01:50:34 juju-e4d256-prod-github-runner-207 kernel: [73608.583985] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 01:50:34 juju-e4d256-prod-github-runner-207 kernel: [73608.585059] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 01:50:34 juju-e4d256-prod-github-runner-207 kernel: [73608.586120] Aug 23 01:50:34 juju-e4d256-prod-github-runner-207 kernel: [73608.586976] Aug 23 01:50:34 juju-e4d256-prod-github-runner-207 kernel: [73608.587818] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 01:50:34 juju-e4d256-prod-github-runner-207 kernel: [73608.588850] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:50:34 juju-e4d256-prod-github-runner-207 kernel: [73608.589899] ? _raw_spin_lock+0x22/0x30 Aug 23 01:50:34 juju-e4d256-prod-github-runner-207 kernel: [73608.590844] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:50:34 juju-e4d256-prod-github-runner-207 kernel: [73608.591864] direct_page_fault+0x206/0x310 [kvm] Aug 23 01:50:34 juju-e4d256-prod-github-runner-207 kernel: [73608.592891] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 01:50:34 juju-e4d256-prod-github-runner-207 kernel: [73608.593910] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 01:50:34 juju-e4d256-prod-github-runner-207 kernel: [73608.594917] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 01:50:34 juju-e4d256-prod-github-runner-207 kernel: [73608.595890] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 01:50:34 juju-e4d256-prod-github-runner-207 kernel: [73608.596843] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 01:50:34 juju-e4d256-prod-github-runner-207 kernel: [73608.597834] handle_exit+0x98/0x230 [kvm_amd] Aug 23 01:50:34 juju-e4d256-prod-github-runner-207 kernel: [73608.598732] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 01:50:34 juju-e4d256-prod-github-runner-207 kernel: [73608.599646] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 01:50:34 juju-e4d256-prod-github-runner-207 kernel: [73608.600569] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 01:50:34 juju-e4d256-prod-github-runner-207 kernel: [73608.601488] vcpu_run+0x62/0x2c0 [kvm] Aug 23 01:50:34 juju-e4d256-prod-github-runner-207 kernel: [73608.602326] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 01:50:34 juju-e4d256-prod-github-runner-207 kernel: [73608.603141] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 01:50:34 juju-e4d256-prod-github-runner-207 kernel: [73608.604007] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 01:50:34 juju-e4d256-prod-github-runner-207 kernel: [73608.604806] ? __seccomp_filter+0x4a/0x4a0 Aug 23 01:50:34 juju-e4d256-prod-github-runner-207 kernel: [73608.605568] ? __fget_files+0x86/0xc0 Aug 23 01:50:34 juju-e4d256-prod-github-runner-207 kernel: [73608.606272] __x64_sys_ioctl+0x95/0xd0 Aug 23 01:50:34 juju-e4d256-prod-github-runner-207 kernel: [73608.606965] do_syscall_64+0x5c/0xc0 Aug 23 01:50:34 juju-e4d256-prod-github-runner-207 kernel: [73608.607634] ? do_futex+0x162/0x1f0 Aug 23 01:50:34 juju-e4d256-prod-github-runner-207 kernel: [73608.608282] ? __x64_sys_futex+0x78/0x1e0 Aug 23 01:50:34 juju-e4d256-prod-github-runner-207 kernel: [73608.608955] ? __secure_computing+0xa9/0x120 Aug 23 01:50:34 juju-e4d256-prod-github-runner-207 kernel: [73608.609656] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 01:50:34 juju-e4d256-prod-github-runner-207 kernel: [73608.610426] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:50:34 juju-e4d256-prod-github-runner-207 kernel: [73608.611147] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:50:34 juju-e4d256-prod-github-runner-207 kernel: [73608.611863] ? do_syscall_64+0x69/0xc0 Aug 23 01:50:34 juju-e4d256-prod-github-runner-207 kernel: [73608.612506] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:50:34 juju-e4d256-prod-github-runner-207 kernel: [73608.613207] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:50:34 juju-e4d256-prod-github-runner-207 kernel: [73608.613915] ? do_syscall_64+0x69/0xc0 Aug 23 01:50:34 juju-e4d256-prod-github-runner-207 kernel: [73608.614546] ? do_syscall_64+0x69/0xc0 Aug 23 01:50:34 juju-e4d256-prod-github-runner-207 kernel: [73608.615167] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 01:50:34 juju-e4d256-prod-github-runner-207 kernel: [73608.615873] RIP: 0033:0x7faa5d0edaff Aug 23 01:50:34 juju-e4d256-prod-github-runner-207 kernel: [73608.616499] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 01:50:34 juju-e4d256-prod-github-runner-207 kernel: [73608.618500] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 01:50:34 juju-e4d256-prod-github-runner-207 kernel: [73608.619427] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 01:50:34 juju-e4d256-prod-github-runner-207 kernel: [73608.620319] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 01:50:34 juju-e4d256-prod-github-runner-207 kernel: [73608.621213] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 01:50:34 juju-e4d256-prod-github-runner-207 kernel: [73608.622122] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 01:50:34 juju-e4d256-prod-github-runner-207 kernel: [73608.623014] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 01:50:34 juju-e4d256-prod-github-runner-207 kernel: [73608.623904] Aug 23 01:50:48 juju-e4d256-prod-github-runner-207 kernel: [73622.096703] rcu: INFO: rcu_sched self-detected stall on CPU Aug 23 01:50:48 juju-e4d256-prod-github-runner-207 kernel: [73622.098315] rcu: 1-....: (18318437 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=8851327 Aug 23 01:50:48 juju-e4d256-prod-github-runner-207 kernel: [73622.099439] (t=18376224 jiffies g=23269 q=62644) Aug 23 01:50:48 juju-e4d256-prod-github-runner-207 kernel: [73622.100233] NMI backtrace for cpu 1 Aug 23 01:50:48 juju-e4d256-prod-github-runner-207 kernel: [73622.100951] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 01:50:48 juju-e4d256-prod-github-runner-207 kernel: [73622.102066] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 01:50:48 juju-e4d256-prod-github-runner-207 kernel: [73622.103119] Call Trace: Aug 23 01:50:48 juju-e4d256-prod-github-runner-207 kernel: [73622.103798] Aug 23 01:50:48 juju-e4d256-prod-github-runner-207 kernel: [73622.104449] show_stack+0x52/0x5c Aug 23 01:50:48 juju-e4d256-prod-github-runner-207 kernel: [73622.105179] dump_stack_lvl+0x4a/0x63 Aug 23 01:50:48 juju-e4d256-prod-github-runner-207 kernel: [73622.105930] dump_stack+0x10/0x16 Aug 23 01:50:48 juju-e4d256-prod-github-runner-207 kernel: [73622.106645] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 23 01:50:48 juju-e4d256-prod-github-runner-207 kernel: [73622.107423] ? lapic_can_unplug_cpu+0x90/0x90 Aug 23 01:50:48 juju-e4d256-prod-github-runner-207 kernel: [73622.108199] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 23 01:50:48 juju-e4d256-prod-github-runner-207 kernel: [73622.109015] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 23 01:50:48 juju-e4d256-prod-github-runner-207 kernel: [73622.109851] trigger_single_cpu_backtrace+0x44/0x4f Aug 23 01:50:48 juju-e4d256-prod-github-runner-207 kernel: [73622.110660] rcu_dump_cpu_stacks+0x102/0x149 Aug 23 01:50:48 juju-e4d256-prod-github-runner-207 kernel: [73622.111429] print_cpu_stall.cold+0x2f/0xe2 Aug 23 01:50:48 juju-e4d256-prod-github-runner-207 kernel: [73622.112196] ? timekeeping_update+0xf7/0x150 Aug 23 01:50:48 juju-e4d256-prod-github-runner-207 kernel: [73622.112969] check_cpu_stall+0x109/0x270 Aug 23 01:50:48 juju-e4d256-prod-github-runner-207 kernel: [73622.113736] rcu_sched_clock_irq+0x9a/0x250 Aug 23 01:50:48 juju-e4d256-prod-github-runner-207 kernel: [73622.114495] update_process_times+0x94/0xd0 Aug 23 01:50:48 juju-e4d256-prod-github-runner-207 kernel: [73622.115252] tick_sched_handle+0x29/0x70 Aug 23 01:50:48 juju-e4d256-prod-github-runner-207 kernel: [73622.116001] tick_sched_timer+0x8c/0xc0 Aug 23 01:50:48 juju-e4d256-prod-github-runner-207 kernel: [73622.116740] ? tick_nohz_handler+0xb0/0xb0 Aug 23 01:50:48 juju-e4d256-prod-github-runner-207 kernel: [73622.117503] __hrtimer_run_queues+0x107/0x230 Aug 23 01:50:48 juju-e4d256-prod-github-runner-207 kernel: [73622.118278] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 01:50:48 juju-e4d256-prod-github-runner-207 kernel: [73622.119053] hrtimer_interrupt+0x101/0x220 Aug 23 01:50:48 juju-e4d256-prod-github-runner-207 kernel: [73622.119810] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 01:50:48 juju-e4d256-prod-github-runner-207 kernel: [73622.120620] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 01:50:48 juju-e4d256-prod-github-runner-207 kernel: [73622.121431] Aug 23 01:50:48 juju-e4d256-prod-github-runner-207 kernel: [73622.122067] Aug 23 01:50:48 juju-e4d256-prod-github-runner-207 kernel: [73622.122701] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 01:50:48 juju-e4d256-prod-github-runner-207 kernel: [73622.123634] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:50:48 juju-e4d256-prod-github-runner-207 kernel: [73622.124511] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 01:50:48 juju-e4d256-prod-github-runner-207 kernel: [73622.126733] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 01:50:48 juju-e4d256-prod-github-runner-207 kernel: [73622.127606] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 01:50:48 juju-e4d256-prod-github-runner-207 kernel: [73622.128596] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 01:50:48 juju-e4d256-prod-github-runner-207 kernel: [73622.129596] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 01:50:48 juju-e4d256-prod-github-runner-207 kernel: [73622.130556] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 01:50:48 juju-e4d256-prod-github-runner-207 kernel: [73622.131508] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 01:50:48 juju-e4d256-prod-github-runner-207 kernel: [73622.132457] ? _raw_spin_lock+0x22/0x30 Aug 23 01:50:48 juju-e4d256-prod-github-runner-207 kernel: [73622.133227] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:50:48 juju-e4d256-prod-github-runner-207 kernel: [73622.134076] direct_page_fault+0x206/0x310 [kvm] Aug 23 01:50:48 juju-e4d256-prod-github-runner-207 kernel: [73622.134912] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 01:50:48 juju-e4d256-prod-github-runner-207 kernel: [73622.135736] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 01:50:48 juju-e4d256-prod-github-runner-207 kernel: [73622.136564] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 01:50:48 juju-e4d256-prod-github-runner-207 kernel: [73622.137390] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 01:50:48 juju-e4d256-prod-github-runner-207 kernel: [73622.138174] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 01:50:48 juju-e4d256-prod-github-runner-207 kernel: [73622.139068] handle_exit+0x98/0x230 [kvm_amd] Aug 23 01:50:48 juju-e4d256-prod-github-runner-207 kernel: [73622.139820] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 01:50:48 juju-e4d256-prod-github-runner-207 kernel: [73622.140601] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 01:50:48 juju-e4d256-prod-github-runner-207 kernel: [73622.141404] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 01:50:48 juju-e4d256-prod-github-runner-207 kernel: [73622.142194] vcpu_run+0x62/0x2c0 [kvm] Aug 23 01:50:48 juju-e4d256-prod-github-runner-207 kernel: [73622.142909] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 01:50:48 juju-e4d256-prod-github-runner-207 kernel: [73622.143640] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 01:50:48 juju-e4d256-prod-github-runner-207 kernel: [73622.144439] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 01:50:48 juju-e4d256-prod-github-runner-207 kernel: [73622.145216] ? __seccomp_filter+0x4a/0x4a0 Aug 23 01:50:48 juju-e4d256-prod-github-runner-207 kernel: [73622.145937] ? __fget_files+0x86/0xc0 Aug 23 01:50:48 juju-e4d256-prod-github-runner-207 kernel: [73622.146634] __x64_sys_ioctl+0x95/0xd0 Aug 23 01:50:48 juju-e4d256-prod-github-runner-207 kernel: [73622.147327] do_syscall_64+0x5c/0xc0 Aug 23 01:50:48 juju-e4d256-prod-github-runner-207 kernel: [73622.148011] ? do_futex+0x162/0x1f0 Aug 23 01:50:48 juju-e4d256-prod-github-runner-207 kernel: [73622.148687] ? __x64_sys_futex+0x78/0x1e0 Aug 23 01:50:48 juju-e4d256-prod-github-runner-207 kernel: [73622.149395] ? __secure_computing+0xa9/0x120 Aug 23 01:50:48 juju-e4d256-prod-github-runner-207 kernel: [73622.150116] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 01:50:48 juju-e4d256-prod-github-runner-207 kernel: [73622.150905] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:50:48 juju-e4d256-prod-github-runner-207 kernel: [73622.151658] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:50:48 juju-e4d256-prod-github-runner-207 kernel: [73622.152411] ? do_syscall_64+0x69/0xc0 Aug 23 01:50:48 juju-e4d256-prod-github-runner-207 kernel: [73622.153099] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:50:48 juju-e4d256-prod-github-runner-207 kernel: [73622.153864] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:50:48 juju-e4d256-prod-github-runner-207 kernel: [73622.154620] ? do_syscall_64+0x69/0xc0 Aug 23 01:50:48 juju-e4d256-prod-github-runner-207 kernel: [73622.155313] ? do_syscall_64+0x69/0xc0 Aug 23 01:50:48 juju-e4d256-prod-github-runner-207 kernel: [73622.156000] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 01:50:48 juju-e4d256-prod-github-runner-207 kernel: [73622.156769] RIP: 0033:0x7faa5d0edaff Aug 23 01:50:48 juju-e4d256-prod-github-runner-207 kernel: [73622.157471] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 01:50:48 juju-e4d256-prod-github-runner-207 kernel: [73622.159579] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 01:50:48 juju-e4d256-prod-github-runner-207 kernel: [73622.160545] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 01:50:48 juju-e4d256-prod-github-runner-207 kernel: [73622.161498] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 01:50:48 juju-e4d256-prod-github-runner-207 kernel: [73622.162444] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 01:50:48 juju-e4d256-prod-github-runner-207 kernel: [73622.163385] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 01:50:48 juju-e4d256-prod-github-runner-207 kernel: [73622.164312] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 01:50:48 juju-e4d256-prod-github-runner-207 kernel: [73622.165241] Aug 23 01:51:14 juju-e4d256-prod-github-runner-207 kernel: [73648.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 68482s! [qemu-system-x86:6715] Aug 23 01:51:14 juju-e4d256-prod-github-runner-207 kernel: [73648.543096] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 01:51:14 juju-e4d256-prod-github-runner-207 kernel: [73648.543394] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 01:51:14 juju-e4d256-prod-github-runner-207 kernel: [73648.555633] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 01:51:14 juju-e4d256-prod-github-runner-207 kernel: [73648.556915] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 01:51:14 juju-e4d256-prod-github-runner-207 kernel: [73648.558138] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:51:14 juju-e4d256-prod-github-runner-207 kernel: [73648.559407] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 01:51:14 juju-e4d256-prod-github-runner-207 kernel: [73648.561976] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 01:51:14 juju-e4d256-prod-github-runner-207 kernel: [73648.563022] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 01:51:14 juju-e4d256-prod-github-runner-207 kernel: [73648.564181] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 01:51:14 juju-e4d256-prod-github-runner-207 kernel: [73648.565353] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 01:51:14 juju-e4d256-prod-github-runner-207 kernel: [73648.566511] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 01:51:14 juju-e4d256-prod-github-runner-207 kernel: [73648.567682] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 01:51:14 juju-e4d256-prod-github-runner-207 kernel: [73648.568854] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 01:51:14 juju-e4d256-prod-github-runner-207 kernel: [73648.570098] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 01:51:14 juju-e4d256-prod-github-runner-207 kernel: [73648.571199] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 01:51:14 juju-e4d256-prod-github-runner-207 kernel: [73648.572421] Call Trace: Aug 23 01:51:14 juju-e4d256-prod-github-runner-207 kernel: [73648.573352] Aug 23 01:51:14 juju-e4d256-prod-github-runner-207 kernel: [73648.574241] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:51:14 juju-e4d256-prod-github-runner-207 kernel: [73648.575275] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:51:14 juju-e4d256-prod-github-runner-207 kernel: [73648.576298] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:51:14 juju-e4d256-prod-github-runner-207 kernel: [73648.577378] ? show_regs.part.0+0x23/0x29 Aug 23 01:51:14 juju-e4d256-prod-github-runner-207 kernel: [73648.578373] ? show_regs.cold+0x8/0xd Aug 23 01:51:14 juju-e4d256-prod-github-runner-207 kernel: [73648.579344] ? watchdog_timer_fn+0x1be/0x220 Aug 23 01:51:14 juju-e4d256-prod-github-runner-207 kernel: [73648.580355] ? lockup_detector_update_enable+0x60/0x60 Aug 23 01:51:14 juju-e4d256-prod-github-runner-207 kernel: [73648.581426] ? __hrtimer_run_queues+0x107/0x230 Aug 23 01:51:14 juju-e4d256-prod-github-runner-207 kernel: [73648.582456] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 01:51:14 juju-e4d256-prod-github-runner-207 kernel: [73648.583479] ? hrtimer_interrupt+0x101/0x220 Aug 23 01:51:14 juju-e4d256-prod-github-runner-207 kernel: [73648.584495] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 01:51:14 juju-e4d256-prod-github-runner-207 kernel: [73648.585601] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 01:51:14 juju-e4d256-prod-github-runner-207 kernel: [73648.586665] Aug 23 01:51:14 juju-e4d256-prod-github-runner-207 kernel: [73648.587516] Aug 23 01:51:14 juju-e4d256-prod-github-runner-207 kernel: [73648.588356] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 01:51:14 juju-e4d256-prod-github-runner-207 kernel: [73648.589413] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:51:14 juju-e4d256-prod-github-runner-207 kernel: [73648.590552] ? _raw_spin_lock+0x22/0x30 Aug 23 01:51:14 juju-e4d256-prod-github-runner-207 kernel: [73648.591504] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:51:14 juju-e4d256-prod-github-runner-207 kernel: [73648.592518] direct_page_fault+0x206/0x310 [kvm] Aug 23 01:51:14 juju-e4d256-prod-github-runner-207 kernel: [73648.593561] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 01:51:14 juju-e4d256-prod-github-runner-207 kernel: [73648.594567] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 01:51:14 juju-e4d256-prod-github-runner-207 kernel: [73648.595569] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 01:51:14 juju-e4d256-prod-github-runner-207 kernel: [73648.596536] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 01:51:14 juju-e4d256-prod-github-runner-207 kernel: [73648.597494] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 01:51:14 juju-e4d256-prod-github-runner-207 kernel: [73648.598473] handle_exit+0x98/0x230 [kvm_amd] Aug 23 01:51:14 juju-e4d256-prod-github-runner-207 kernel: [73648.599367] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 01:51:14 juju-e4d256-prod-github-runner-207 kernel: [73648.600277] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 01:51:14 juju-e4d256-prod-github-runner-207 kernel: [73648.601218] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 01:51:14 juju-e4d256-prod-github-runner-207 kernel: [73648.602124] vcpu_run+0x62/0x2c0 [kvm] Aug 23 01:51:14 juju-e4d256-prod-github-runner-207 kernel: [73648.602937] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 01:51:14 juju-e4d256-prod-github-runner-207 kernel: [73648.603741] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 01:51:14 juju-e4d256-prod-github-runner-207 kernel: [73648.604596] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 01:51:14 juju-e4d256-prod-github-runner-207 kernel: [73648.605410] ? __seccomp_filter+0x4a/0x4a0 Aug 23 01:51:14 juju-e4d256-prod-github-runner-207 kernel: [73648.606165] ? __fget_files+0x86/0xc0 Aug 23 01:51:14 juju-e4d256-prod-github-runner-207 kernel: [73648.606880] __x64_sys_ioctl+0x95/0xd0 Aug 23 01:51:14 juju-e4d256-prod-github-runner-207 kernel: [73648.607576] do_syscall_64+0x5c/0xc0 Aug 23 01:51:14 juju-e4d256-prod-github-runner-207 kernel: [73648.608264] ? do_futex+0x162/0x1f0 Aug 23 01:51:14 juju-e4d256-prod-github-runner-207 kernel: [73648.608944] ? __x64_sys_futex+0x78/0x1e0 Aug 23 01:51:14 juju-e4d256-prod-github-runner-207 kernel: [73648.609620] ? __secure_computing+0xa9/0x120 Aug 23 01:51:14 juju-e4d256-prod-github-runner-207 kernel: [73648.610313] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 01:51:14 juju-e4d256-prod-github-runner-207 kernel: [73648.611088] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:51:14 juju-e4d256-prod-github-runner-207 kernel: [73648.611812] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:51:14 juju-e4d256-prod-github-runner-207 kernel: [73648.612531] ? do_syscall_64+0x69/0xc0 Aug 23 01:51:14 juju-e4d256-prod-github-runner-207 kernel: [73648.613193] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:51:14 juju-e4d256-prod-github-runner-207 kernel: [73648.613895] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:51:14 juju-e4d256-prod-github-runner-207 kernel: [73648.614588] ? do_syscall_64+0x69/0xc0 Aug 23 01:51:14 juju-e4d256-prod-github-runner-207 kernel: [73648.615218] ? do_syscall_64+0x69/0xc0 Aug 23 01:51:14 juju-e4d256-prod-github-runner-207 kernel: [73648.615853] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 01:51:14 juju-e4d256-prod-github-runner-207 kernel: [73648.616560] RIP: 0033:0x7faa5d0edaff Aug 23 01:51:14 juju-e4d256-prod-github-runner-207 kernel: [73648.617252] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 01:51:14 juju-e4d256-prod-github-runner-207 kernel: [73648.619255] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 01:51:14 juju-e4d256-prod-github-runner-207 kernel: [73648.620265] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 01:51:14 juju-e4d256-prod-github-runner-207 kernel: [73648.621200] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 01:51:14 juju-e4d256-prod-github-runner-207 kernel: [73648.622098] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 01:51:14 juju-e4d256-prod-github-runner-207 kernel: [73648.623001] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 01:51:14 juju-e4d256-prod-github-runner-207 kernel: [73648.623893] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 01:51:14 juju-e4d256-prod-github-runner-207 kernel: [73648.624784] Aug 23 01:51:42 juju-e4d256-prod-github-runner-207 kernel: [73676.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 68508s! [qemu-system-x86:6715] Aug 23 01:51:42 juju-e4d256-prod-github-runner-207 kernel: [73676.543092] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 01:51:42 juju-e4d256-prod-github-runner-207 kernel: [73676.543160] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 01:51:42 juju-e4d256-prod-github-runner-207 kernel: [73676.555352] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 01:51:42 juju-e4d256-prod-github-runner-207 kernel: [73676.556642] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 01:51:42 juju-e4d256-prod-github-runner-207 kernel: [73676.557861] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:51:42 juju-e4d256-prod-github-runner-207 kernel: [73676.558928] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 01:51:42 juju-e4d256-prod-github-runner-207 kernel: [73676.561496] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 01:51:42 juju-e4d256-prod-github-runner-207 kernel: [73676.562676] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 01:51:42 juju-e4d256-prod-github-runner-207 kernel: [73676.563839] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 01:51:42 juju-e4d256-prod-github-runner-207 kernel: [73676.565021] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 01:51:42 juju-e4d256-prod-github-runner-207 kernel: [73676.566180] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 01:51:42 juju-e4d256-prod-github-runner-207 kernel: [73676.567513] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 01:51:42 juju-e4d256-prod-github-runner-207 kernel: [73676.568812] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 01:51:42 juju-e4d256-prod-github-runner-207 kernel: [73676.570105] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 01:51:42 juju-e4d256-prod-github-runner-207 kernel: [73676.571216] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 01:51:42 juju-e4d256-prod-github-runner-207 kernel: [73676.572416] Call Trace: Aug 23 01:51:42 juju-e4d256-prod-github-runner-207 kernel: [73676.573359] Aug 23 01:51:42 juju-e4d256-prod-github-runner-207 kernel: [73676.574246] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:51:42 juju-e4d256-prod-github-runner-207 kernel: [73676.575277] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:51:42 juju-e4d256-prod-github-runner-207 kernel: [73676.576294] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:51:42 juju-e4d256-prod-github-runner-207 kernel: [73676.577383] ? show_regs.part.0+0x23/0x29 Aug 23 01:51:42 juju-e4d256-prod-github-runner-207 kernel: [73676.578379] ? show_regs.cold+0x8/0xd Aug 23 01:51:42 juju-e4d256-prod-github-runner-207 kernel: [73676.579348] ? watchdog_timer_fn+0x1be/0x220 Aug 23 01:51:42 juju-e4d256-prod-github-runner-207 kernel: [73676.580353] ? lockup_detector_update_enable+0x60/0x60 Aug 23 01:51:42 juju-e4d256-prod-github-runner-207 kernel: [73676.581431] ? __hrtimer_run_queues+0x107/0x230 Aug 23 01:51:42 juju-e4d256-prod-github-runner-207 kernel: [73676.582457] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 01:51:42 juju-e4d256-prod-github-runner-207 kernel: [73676.583487] ? hrtimer_interrupt+0x101/0x220 Aug 23 01:51:42 juju-e4d256-prod-github-runner-207 kernel: [73676.584501] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 01:51:42 juju-e4d256-prod-github-runner-207 kernel: [73676.585585] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 01:51:42 juju-e4d256-prod-github-runner-207 kernel: [73676.586632] Aug 23 01:51:42 juju-e4d256-prod-github-runner-207 kernel: [73676.587482] Aug 23 01:51:42 juju-e4d256-prod-github-runner-207 kernel: [73676.588317] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 01:51:42 juju-e4d256-prod-github-runner-207 kernel: [73676.589367] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:51:42 juju-e4d256-prod-github-runner-207 kernel: [73676.590407] ? _raw_spin_lock+0x22/0x30 Aug 23 01:51:42 juju-e4d256-prod-github-runner-207 kernel: [73676.591347] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:51:42 juju-e4d256-prod-github-runner-207 kernel: [73676.592363] direct_page_fault+0x206/0x310 [kvm] Aug 23 01:51:42 juju-e4d256-prod-github-runner-207 kernel: [73676.593392] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 01:51:42 juju-e4d256-prod-github-runner-207 kernel: [73676.594398] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 01:51:42 juju-e4d256-prod-github-runner-207 kernel: [73676.595395] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 01:51:42 juju-e4d256-prod-github-runner-207 kernel: [73676.596361] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 01:51:42 juju-e4d256-prod-github-runner-207 kernel: [73676.597316] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 01:51:42 juju-e4d256-prod-github-runner-207 kernel: [73676.598303] handle_exit+0x98/0x230 [kvm_amd] Aug 23 01:51:42 juju-e4d256-prod-github-runner-207 kernel: [73676.599207] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 01:51:42 juju-e4d256-prod-github-runner-207 kernel: [73676.600120] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 01:51:42 juju-e4d256-prod-github-runner-207 kernel: [73676.601061] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 01:51:42 juju-e4d256-prod-github-runner-207 kernel: [73676.601963] vcpu_run+0x62/0x2c0 [kvm] Aug 23 01:51:42 juju-e4d256-prod-github-runner-207 kernel: [73676.602771] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 01:51:42 juju-e4d256-prod-github-runner-207 kernel: [73676.603575] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 01:51:42 juju-e4d256-prod-github-runner-207 kernel: [73676.604426] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 01:51:42 juju-e4d256-prod-github-runner-207 kernel: [73676.605235] ? __seccomp_filter+0x4a/0x4a0 Aug 23 01:51:42 juju-e4d256-prod-github-runner-207 kernel: [73676.605975] ? __fget_files+0x86/0xc0 Aug 23 01:51:42 juju-e4d256-prod-github-runner-207 kernel: [73676.606676] __x64_sys_ioctl+0x95/0xd0 Aug 23 01:51:42 juju-e4d256-prod-github-runner-207 kernel: [73676.607366] do_syscall_64+0x5c/0xc0 Aug 23 01:51:42 juju-e4d256-prod-github-runner-207 kernel: [73676.608029] ? do_futex+0x162/0x1f0 Aug 23 01:51:42 juju-e4d256-prod-github-runner-207 kernel: [73676.608693] ? __x64_sys_futex+0x78/0x1e0 Aug 23 01:51:42 juju-e4d256-prod-github-runner-207 kernel: [73676.609371] ? __secure_computing+0xa9/0x120 Aug 23 01:51:42 juju-e4d256-prod-github-runner-207 kernel: [73676.610057] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 01:51:42 juju-e4d256-prod-github-runner-207 kernel: [73676.610815] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:51:42 juju-e4d256-prod-github-runner-207 kernel: [73676.611540] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:51:42 juju-e4d256-prod-github-runner-207 kernel: [73676.612255] ? do_syscall_64+0x69/0xc0 Aug 23 01:51:42 juju-e4d256-prod-github-runner-207 kernel: [73676.612908] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:51:42 juju-e4d256-prod-github-runner-207 kernel: [73676.613610] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:51:42 juju-e4d256-prod-github-runner-207 kernel: [73676.614305] ? do_syscall_64+0x69/0xc0 Aug 23 01:51:42 juju-e4d256-prod-github-runner-207 kernel: [73676.614929] ? do_syscall_64+0x69/0xc0 Aug 23 01:51:42 juju-e4d256-prod-github-runner-207 kernel: [73676.615550] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 01:51:42 juju-e4d256-prod-github-runner-207 kernel: [73676.616258] RIP: 0033:0x7faa5d0edaff Aug 23 01:51:42 juju-e4d256-prod-github-runner-207 kernel: [73676.616897] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 01:51:42 juju-e4d256-prod-github-runner-207 kernel: [73676.618884] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 01:51:42 juju-e4d256-prod-github-runner-207 kernel: [73676.619841] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 01:51:42 juju-e4d256-prod-github-runner-207 kernel: [73676.620749] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 01:51:42 juju-e4d256-prod-github-runner-207 kernel: [73676.621641] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 01:51:42 juju-e4d256-prod-github-runner-207 kernel: [73676.622525] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 01:51:42 juju-e4d256-prod-github-runner-207 kernel: [73676.623409] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 01:51:42 juju-e4d256-prod-github-runner-207 kernel: [73676.624303] Aug 23 01:52:10 juju-e4d256-prod-github-runner-207 kernel: [73704.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 68534s! [qemu-system-x86:6715] Aug 23 01:52:10 juju-e4d256-prod-github-runner-207 kernel: [73704.543104] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 01:52:10 juju-e4d256-prod-github-runner-207 kernel: [73704.543172] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 01:52:10 juju-e4d256-prod-github-runner-207 kernel: [73704.555259] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 01:52:10 juju-e4d256-prod-github-runner-207 kernel: [73704.556552] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 01:52:10 juju-e4d256-prod-github-runner-207 kernel: [73704.557778] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:52:10 juju-e4d256-prod-github-runner-207 kernel: [73704.558835] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 01:52:10 juju-e4d256-prod-github-runner-207 kernel: [73704.561413] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 01:52:10 juju-e4d256-prod-github-runner-207 kernel: [73704.562456] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 01:52:10 juju-e4d256-prod-github-runner-207 kernel: [73704.563619] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 01:52:10 juju-e4d256-prod-github-runner-207 kernel: [73704.564784] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 01:52:10 juju-e4d256-prod-github-runner-207 kernel: [73704.565952] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 01:52:10 juju-e4d256-prod-github-runner-207 kernel: [73704.567119] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 01:52:10 juju-e4d256-prod-github-runner-207 kernel: [73704.568299] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 01:52:10 juju-e4d256-prod-github-runner-207 kernel: [73704.569539] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 01:52:10 juju-e4d256-prod-github-runner-207 kernel: [73704.570642] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 01:52:10 juju-e4d256-prod-github-runner-207 kernel: [73704.571843] Call Trace: Aug 23 01:52:10 juju-e4d256-prod-github-runner-207 kernel: [73704.572764] Aug 23 01:52:10 juju-e4d256-prod-github-runner-207 kernel: [73704.573653] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:52:10 juju-e4d256-prod-github-runner-207 kernel: [73704.574682] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:52:10 juju-e4d256-prod-github-runner-207 kernel: [73704.575714] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:52:10 juju-e4d256-prod-github-runner-207 kernel: [73704.576811] ? show_regs.part.0+0x23/0x29 Aug 23 01:52:10 juju-e4d256-prod-github-runner-207 kernel: [73704.577807] ? show_regs.cold+0x8/0xd Aug 23 01:52:10 juju-e4d256-prod-github-runner-207 kernel: [73704.578778] ? watchdog_timer_fn+0x1be/0x220 Aug 23 01:52:10 juju-e4d256-prod-github-runner-207 kernel: [73704.579790] ? lockup_detector_update_enable+0x60/0x60 Aug 23 01:52:10 juju-e4d256-prod-github-runner-207 kernel: [73704.580877] ? __hrtimer_run_queues+0x107/0x230 Aug 23 01:52:10 juju-e4d256-prod-github-runner-207 kernel: [73704.581910] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 01:52:10 juju-e4d256-prod-github-runner-207 kernel: [73704.582934] ? hrtimer_interrupt+0x101/0x220 Aug 23 01:52:10 juju-e4d256-prod-github-runner-207 kernel: [73704.583950] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 01:52:10 juju-e4d256-prod-github-runner-207 kernel: [73704.585024] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 01:52:10 juju-e4d256-prod-github-runner-207 kernel: [73704.586076] Aug 23 01:52:10 juju-e4d256-prod-github-runner-207 kernel: [73704.586929] Aug 23 01:52:10 juju-e4d256-prod-github-runner-207 kernel: [73704.587770] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 01:52:10 juju-e4d256-prod-github-runner-207 kernel: [73704.588819] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:52:10 juju-e4d256-prod-github-runner-207 kernel: [73704.589859] ? _raw_spin_lock+0x22/0x30 Aug 23 01:52:10 juju-e4d256-prod-github-runner-207 kernel: [73704.590808] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:52:10 juju-e4d256-prod-github-runner-207 kernel: [73704.591826] direct_page_fault+0x206/0x310 [kvm] Aug 23 01:52:10 juju-e4d256-prod-github-runner-207 kernel: [73704.592932] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 01:52:10 juju-e4d256-prod-github-runner-207 kernel: [73704.593942] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 01:52:10 juju-e4d256-prod-github-runner-207 kernel: [73704.594948] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 01:52:10 juju-e4d256-prod-github-runner-207 kernel: [73704.595922] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 01:52:10 juju-e4d256-prod-github-runner-207 kernel: [73704.596874] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 01:52:10 juju-e4d256-prod-github-runner-207 kernel: [73704.597852] handle_exit+0x98/0x230 [kvm_amd] Aug 23 01:52:10 juju-e4d256-prod-github-runner-207 kernel: [73704.598748] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 01:52:10 juju-e4d256-prod-github-runner-207 kernel: [73704.599665] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 01:52:10 juju-e4d256-prod-github-runner-207 kernel: [73704.600601] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 01:52:10 juju-e4d256-prod-github-runner-207 kernel: [73704.601515] vcpu_run+0x62/0x2c0 [kvm] Aug 23 01:52:10 juju-e4d256-prod-github-runner-207 kernel: [73704.602325] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 01:52:10 juju-e4d256-prod-github-runner-207 kernel: [73704.603130] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 01:52:10 juju-e4d256-prod-github-runner-207 kernel: [73704.603983] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 01:52:10 juju-e4d256-prod-github-runner-207 kernel: [73704.604790] ? __seccomp_filter+0x4a/0x4a0 Aug 23 01:52:10 juju-e4d256-prod-github-runner-207 kernel: [73704.605536] ? __fget_files+0x86/0xc0 Aug 23 01:52:10 juju-e4d256-prod-github-runner-207 kernel: [73704.606252] __x64_sys_ioctl+0x95/0xd0 Aug 23 01:52:10 juju-e4d256-prod-github-runner-207 kernel: [73704.606946] do_syscall_64+0x5c/0xc0 Aug 23 01:52:10 juju-e4d256-prod-github-runner-207 kernel: [73704.607610] ? do_futex+0x162/0x1f0 Aug 23 01:52:10 juju-e4d256-prod-github-runner-207 kernel: [73704.608274] ? __x64_sys_futex+0x78/0x1e0 Aug 23 01:52:10 juju-e4d256-prod-github-runner-207 kernel: [73704.608947] ? __secure_computing+0xa9/0x120 Aug 23 01:52:10 juju-e4d256-prod-github-runner-207 kernel: [73704.609640] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 01:52:10 juju-e4d256-prod-github-runner-207 kernel: [73704.610397] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:52:10 juju-e4d256-prod-github-runner-207 kernel: [73704.611119] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:52:10 juju-e4d256-prod-github-runner-207 kernel: [73704.611843] ? do_syscall_64+0x69/0xc0 Aug 23 01:52:10 juju-e4d256-prod-github-runner-207 kernel: [73704.612515] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:52:10 juju-e4d256-prod-github-runner-207 kernel: [73704.613314] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:52:10 juju-e4d256-prod-github-runner-207 kernel: [73704.614009] ? do_syscall_64+0x69/0xc0 Aug 23 01:52:10 juju-e4d256-prod-github-runner-207 kernel: [73704.614639] ? do_syscall_64+0x69/0xc0 Aug 23 01:52:10 juju-e4d256-prod-github-runner-207 kernel: [73704.615262] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 01:52:10 juju-e4d256-prod-github-runner-207 kernel: [73704.615968] RIP: 0033:0x7faa5d0edaff Aug 23 01:52:10 juju-e4d256-prod-github-runner-207 kernel: [73704.616608] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 01:52:10 juju-e4d256-prod-github-runner-207 kernel: [73704.618606] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 01:52:10 juju-e4d256-prod-github-runner-207 kernel: [73704.619513] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 01:52:10 juju-e4d256-prod-github-runner-207 kernel: [73704.620419] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 01:52:10 juju-e4d256-prod-github-runner-207 kernel: [73704.621310] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 01:52:10 juju-e4d256-prod-github-runner-207 kernel: [73704.622201] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 01:52:10 juju-e4d256-prod-github-runner-207 kernel: [73704.623089] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 01:52:10 juju-e4d256-prod-github-runner-207 kernel: [73704.623978] Aug 23 01:52:38 juju-e4d256-prod-github-runner-207 kernel: [73732.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 68560s! [qemu-system-x86:6715] Aug 23 01:52:38 juju-e4d256-prod-github-runner-207 kernel: [73732.543723] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 01:52:38 juju-e4d256-prod-github-runner-207 kernel: [73732.543984] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 01:52:38 juju-e4d256-prod-github-runner-207 kernel: [73732.556039] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 01:52:38 juju-e4d256-prod-github-runner-207 kernel: [73732.557306] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 01:52:38 juju-e4d256-prod-github-runner-207 kernel: [73732.558528] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:52:38 juju-e4d256-prod-github-runner-207 kernel: [73732.559589] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 01:52:38 juju-e4d256-prod-github-runner-207 kernel: [73732.562149] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 01:52:38 juju-e4d256-prod-github-runner-207 kernel: [73732.563194] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 01:52:38 juju-e4d256-prod-github-runner-207 kernel: [73732.564367] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 01:52:38 juju-e4d256-prod-github-runner-207 kernel: [73732.565536] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 01:52:38 juju-e4d256-prod-github-runner-207 kernel: [73732.566703] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 01:52:38 juju-e4d256-prod-github-runner-207 kernel: [73732.567862] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 01:52:38 juju-e4d256-prod-github-runner-207 kernel: [73732.569038] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 01:52:38 juju-e4d256-prod-github-runner-207 kernel: [73732.570269] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 01:52:38 juju-e4d256-prod-github-runner-207 kernel: [73732.571364] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 01:52:38 juju-e4d256-prod-github-runner-207 kernel: [73732.572562] Call Trace: Aug 23 01:52:38 juju-e4d256-prod-github-runner-207 kernel: [73732.573475] Aug 23 01:52:38 juju-e4d256-prod-github-runner-207 kernel: [73732.574365] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:52:38 juju-e4d256-prod-github-runner-207 kernel: [73732.575391] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:52:38 juju-e4d256-prod-github-runner-207 kernel: [73732.576426] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:52:38 juju-e4d256-prod-github-runner-207 kernel: [73732.577515] ? show_regs.part.0+0x23/0x29 Aug 23 01:52:38 juju-e4d256-prod-github-runner-207 kernel: [73732.578516] ? show_regs.cold+0x8/0xd Aug 23 01:52:38 juju-e4d256-prod-github-runner-207 kernel: [73732.579484] ? watchdog_timer_fn+0x1be/0x220 Aug 23 01:52:38 juju-e4d256-prod-github-runner-207 kernel: [73732.580506] ? lockup_detector_update_enable+0x60/0x60 Aug 23 01:52:38 juju-e4d256-prod-github-runner-207 kernel: [73732.581570] ? __hrtimer_run_queues+0x107/0x230 Aug 23 01:52:38 juju-e4d256-prod-github-runner-207 kernel: [73732.582602] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 01:52:38 juju-e4d256-prod-github-runner-207 kernel: [73732.583630] ? hrtimer_interrupt+0x101/0x220 Aug 23 01:52:38 juju-e4d256-prod-github-runner-207 kernel: [73732.584650] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 01:52:38 juju-e4d256-prod-github-runner-207 kernel: [73732.585722] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 01:52:38 juju-e4d256-prod-github-runner-207 kernel: [73732.586768] Aug 23 01:52:38 juju-e4d256-prod-github-runner-207 kernel: [73732.587626] Aug 23 01:52:38 juju-e4d256-prod-github-runner-207 kernel: [73732.588475] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 01:52:38 juju-e4d256-prod-github-runner-207 kernel: [73732.589515] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:52:38 juju-e4d256-prod-github-runner-207 kernel: [73732.590553] ? _raw_spin_lock+0x22/0x30 Aug 23 01:52:38 juju-e4d256-prod-github-runner-207 kernel: [73732.591503] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:52:38 juju-e4d256-prod-github-runner-207 kernel: [73732.592545] direct_page_fault+0x206/0x310 [kvm] Aug 23 01:52:38 juju-e4d256-prod-github-runner-207 kernel: [73732.593570] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 01:52:38 juju-e4d256-prod-github-runner-207 kernel: [73732.594584] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 01:52:38 juju-e4d256-prod-github-runner-207 kernel: [73732.595582] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 01:52:38 juju-e4d256-prod-github-runner-207 kernel: [73732.596578] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 01:52:38 juju-e4d256-prod-github-runner-207 kernel: [73732.597527] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 01:52:38 juju-e4d256-prod-github-runner-207 kernel: [73732.598504] handle_exit+0x98/0x230 [kvm_amd] Aug 23 01:52:38 juju-e4d256-prod-github-runner-207 kernel: [73732.599395] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 01:52:38 juju-e4d256-prod-github-runner-207 kernel: [73732.600323] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 01:52:38 juju-e4d256-prod-github-runner-207 kernel: [73732.601253] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 01:52:38 juju-e4d256-prod-github-runner-207 kernel: [73732.602156] vcpu_run+0x62/0x2c0 [kvm] Aug 23 01:52:38 juju-e4d256-prod-github-runner-207 kernel: [73732.602966] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 01:52:38 juju-e4d256-prod-github-runner-207 kernel: [73732.603771] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 01:52:38 juju-e4d256-prod-github-runner-207 kernel: [73732.604633] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 01:52:38 juju-e4d256-prod-github-runner-207 kernel: [73732.605429] ? __seccomp_filter+0x4a/0x4a0 Aug 23 01:52:38 juju-e4d256-prod-github-runner-207 kernel: [73732.606170] ? __fget_files+0x86/0xc0 Aug 23 01:52:38 juju-e4d256-prod-github-runner-207 kernel: [73732.606874] __x64_sys_ioctl+0x95/0xd0 Aug 23 01:52:38 juju-e4d256-prod-github-runner-207 kernel: [73732.607566] do_syscall_64+0x5c/0xc0 Aug 23 01:52:38 juju-e4d256-prod-github-runner-207 kernel: [73732.608241] ? do_futex+0x162/0x1f0 Aug 23 01:52:38 juju-e4d256-prod-github-runner-207 kernel: [73732.608889] ? __x64_sys_futex+0x78/0x1e0 Aug 23 01:52:38 juju-e4d256-prod-github-runner-207 kernel: [73732.609561] ? __secure_computing+0xa9/0x120 Aug 23 01:52:38 juju-e4d256-prod-github-runner-207 kernel: [73732.610250] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 01:52:38 juju-e4d256-prod-github-runner-207 kernel: [73732.611015] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:52:38 juju-e4d256-prod-github-runner-207 kernel: [73732.611735] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:52:38 juju-e4d256-prod-github-runner-207 kernel: [73732.612459] ? do_syscall_64+0x69/0xc0 Aug 23 01:52:38 juju-e4d256-prod-github-runner-207 kernel: [73732.613108] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:52:38 juju-e4d256-prod-github-runner-207 kernel: [73732.613809] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:52:38 juju-e4d256-prod-github-runner-207 kernel: [73732.614500] ? do_syscall_64+0x69/0xc0 Aug 23 01:52:38 juju-e4d256-prod-github-runner-207 kernel: [73732.615121] ? do_syscall_64+0x69/0xc0 Aug 23 01:52:38 juju-e4d256-prod-github-runner-207 kernel: [73732.615747] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 01:52:38 juju-e4d256-prod-github-runner-207 kernel: [73732.616454] RIP: 0033:0x7faa5d0edaff Aug 23 01:52:38 juju-e4d256-prod-github-runner-207 kernel: [73732.617093] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 01:52:38 juju-e4d256-prod-github-runner-207 kernel: [73732.619073] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 01:52:38 juju-e4d256-prod-github-runner-207 kernel: [73732.619992] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 01:52:38 juju-e4d256-prod-github-runner-207 kernel: [73732.620879] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 01:52:38 juju-e4d256-prod-github-runner-207 kernel: [73732.621773] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 01:52:38 juju-e4d256-prod-github-runner-207 kernel: [73732.622664] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 01:52:38 juju-e4d256-prod-github-runner-207 kernel: [73732.623553] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 01:52:38 juju-e4d256-prod-github-runner-207 kernel: [73732.624449] Aug 23 01:53:06 juju-e4d256-prod-github-runner-207 kernel: [73760.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 68586s! [qemu-system-x86:6715] Aug 23 01:53:06 juju-e4d256-prod-github-runner-207 kernel: [73760.543105] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 01:53:06 juju-e4d256-prod-github-runner-207 kernel: [73760.543172] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 01:53:06 juju-e4d256-prod-github-runner-207 kernel: [73760.555342] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 01:53:06 juju-e4d256-prod-github-runner-207 kernel: [73760.556639] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 01:53:06 juju-e4d256-prod-github-runner-207 kernel: [73760.557862] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:53:06 juju-e4d256-prod-github-runner-207 kernel: [73760.558931] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 01:53:06 juju-e4d256-prod-github-runner-207 kernel: [73760.561506] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 01:53:06 juju-e4d256-prod-github-runner-207 kernel: [73760.562550] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 01:53:06 juju-e4d256-prod-github-runner-207 kernel: [73760.563760] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 01:53:06 juju-e4d256-prod-github-runner-207 kernel: [73760.564938] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 01:53:06 juju-e4d256-prod-github-runner-207 kernel: [73760.566101] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 01:53:06 juju-e4d256-prod-github-runner-207 kernel: [73760.567263] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 01:53:06 juju-e4d256-prod-github-runner-207 kernel: [73760.568462] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 01:53:06 juju-e4d256-prod-github-runner-207 kernel: [73760.569865] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 01:53:06 juju-e4d256-prod-github-runner-207 kernel: [73760.570974] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 01:53:06 juju-e4d256-prod-github-runner-207 kernel: [73760.572186] Call Trace: Aug 23 01:53:06 juju-e4d256-prod-github-runner-207 kernel: [73760.573099] Aug 23 01:53:06 juju-e4d256-prod-github-runner-207 kernel: [73760.573998] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:53:06 juju-e4d256-prod-github-runner-207 kernel: [73760.575044] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:53:06 juju-e4d256-prod-github-runner-207 kernel: [73760.576091] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:53:06 juju-e4d256-prod-github-runner-207 kernel: [73760.577171] ? show_regs.part.0+0x23/0x29 Aug 23 01:53:06 juju-e4d256-prod-github-runner-207 kernel: [73760.578168] ? show_regs.cold+0x8/0xd Aug 23 01:53:06 juju-e4d256-prod-github-runner-207 kernel: [73760.579150] ? watchdog_timer_fn+0x1be/0x220 Aug 23 01:53:06 juju-e4d256-prod-github-runner-207 kernel: [73760.580189] ? lockup_detector_update_enable+0x60/0x60 Aug 23 01:53:06 juju-e4d256-prod-github-runner-207 kernel: [73760.581263] ? __hrtimer_run_queues+0x107/0x230 Aug 23 01:53:06 juju-e4d256-prod-github-runner-207 kernel: [73760.582292] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 01:53:06 juju-e4d256-prod-github-runner-207 kernel: [73760.583315] ? hrtimer_interrupt+0x101/0x220 Aug 23 01:53:06 juju-e4d256-prod-github-runner-207 kernel: [73760.584358] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 01:53:06 juju-e4d256-prod-github-runner-207 kernel: [73760.585447] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 01:53:06 juju-e4d256-prod-github-runner-207 kernel: [73760.586515] Aug 23 01:53:06 juju-e4d256-prod-github-runner-207 kernel: [73760.587378] Aug 23 01:53:06 juju-e4d256-prod-github-runner-207 kernel: [73760.588231] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 01:53:06 juju-e4d256-prod-github-runner-207 kernel: [73760.589303] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:53:06 juju-e4d256-prod-github-runner-207 kernel: [73760.590544] ? _raw_spin_lock+0x22/0x30 Aug 23 01:53:06 juju-e4d256-prod-github-runner-207 kernel: [73760.591556] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:53:06 juju-e4d256-prod-github-runner-207 kernel: [73760.592619] direct_page_fault+0x206/0x310 [kvm] Aug 23 01:53:06 juju-e4d256-prod-github-runner-207 kernel: [73760.593674] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 01:53:06 juju-e4d256-prod-github-runner-207 kernel: [73760.594747] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 01:53:06 juju-e4d256-prod-github-runner-207 kernel: [73760.595789] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 01:53:06 juju-e4d256-prod-github-runner-207 kernel: [73760.596773] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 01:53:06 juju-e4d256-prod-github-runner-207 kernel: [73760.597723] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 01:53:06 juju-e4d256-prod-github-runner-207 kernel: [73760.598715] handle_exit+0x98/0x230 [kvm_amd] Aug 23 01:53:06 juju-e4d256-prod-github-runner-207 kernel: [73760.599637] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 01:53:06 juju-e4d256-prod-github-runner-207 kernel: [73760.600574] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 01:53:06 juju-e4d256-prod-github-runner-207 kernel: [73760.601507] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 01:53:06 juju-e4d256-prod-github-runner-207 kernel: [73760.602423] vcpu_run+0x62/0x2c0 [kvm] Aug 23 01:53:06 juju-e4d256-prod-github-runner-207 kernel: [73760.603240] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 01:53:06 juju-e4d256-prod-github-runner-207 kernel: [73760.604065] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 01:53:06 juju-e4d256-prod-github-runner-207 kernel: [73760.604938] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 01:53:06 juju-e4d256-prod-github-runner-207 kernel: [73760.605753] ? __seccomp_filter+0x4a/0x4a0 Aug 23 01:53:06 juju-e4d256-prod-github-runner-207 kernel: [73760.606503] ? __fget_files+0x86/0xc0 Aug 23 01:53:06 juju-e4d256-prod-github-runner-207 kernel: [73760.607213] __x64_sys_ioctl+0x95/0xd0 Aug 23 01:53:06 juju-e4d256-prod-github-runner-207 kernel: [73760.607926] do_syscall_64+0x5c/0xc0 Aug 23 01:53:06 juju-e4d256-prod-github-runner-207 kernel: [73760.608596] ? do_futex+0x162/0x1f0 Aug 23 01:53:06 juju-e4d256-prod-github-runner-207 kernel: [73760.609254] ? __x64_sys_futex+0x78/0x1e0 Aug 23 01:53:06 juju-e4d256-prod-github-runner-207 kernel: [73760.609950] ? __secure_computing+0xa9/0x120 Aug 23 01:53:06 juju-e4d256-prod-github-runner-207 kernel: [73760.610646] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 01:53:06 juju-e4d256-prod-github-runner-207 kernel: [73760.611426] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:53:06 juju-e4d256-prod-github-runner-207 kernel: [73760.612176] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:53:06 juju-e4d256-prod-github-runner-207 kernel: [73760.612967] ? do_syscall_64+0x69/0xc0 Aug 23 01:53:06 juju-e4d256-prod-github-runner-207 kernel: [73760.613616] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:53:06 juju-e4d256-prod-github-runner-207 kernel: [73760.614323] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:53:06 juju-e4d256-prod-github-runner-207 kernel: [73760.615036] ? do_syscall_64+0x69/0xc0 Aug 23 01:53:06 juju-e4d256-prod-github-runner-207 kernel: [73760.615678] ? do_syscall_64+0x69/0xc0 Aug 23 01:53:06 juju-e4d256-prod-github-runner-207 kernel: [73760.616320] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 01:53:06 juju-e4d256-prod-github-runner-207 kernel: [73760.617036] RIP: 0033:0x7faa5d0edaff Aug 23 01:53:06 juju-e4d256-prod-github-runner-207 kernel: [73760.617665] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 01:53:06 juju-e4d256-prod-github-runner-207 kernel: [73760.619701] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 01:53:06 juju-e4d256-prod-github-runner-207 kernel: [73760.620627] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 01:53:06 juju-e4d256-prod-github-runner-207 kernel: [73760.621560] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 01:53:06 juju-e4d256-prod-github-runner-207 kernel: [73760.622464] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 01:53:06 juju-e4d256-prod-github-runner-207 kernel: [73760.623386] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 01:53:06 juju-e4d256-prod-github-runner-207 kernel: [73760.624297] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 01:53:06 juju-e4d256-prod-github-runner-207 kernel: [73760.625208] Aug 23 01:53:34 juju-e4d256-prod-github-runner-207 kernel: [73788.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 68612s! [qemu-system-x86:6715] Aug 23 01:53:34 juju-e4d256-prod-github-runner-207 kernel: [73788.543108] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 01:53:34 juju-e4d256-prod-github-runner-207 kernel: [73788.543176] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 01:53:34 juju-e4d256-prod-github-runner-207 kernel: [73788.555286] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 01:53:34 juju-e4d256-prod-github-runner-207 kernel: [73788.556746] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 01:53:34 juju-e4d256-prod-github-runner-207 kernel: [73788.558129] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:53:34 juju-e4d256-prod-github-runner-207 kernel: [73788.559340] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 01:53:34 juju-e4d256-prod-github-runner-207 kernel: [73788.562227] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 01:53:34 juju-e4d256-prod-github-runner-207 kernel: [73788.563400] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 01:53:34 juju-e4d256-prod-github-runner-207 kernel: [73788.564712] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 01:53:34 juju-e4d256-prod-github-runner-207 kernel: [73788.566004] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 01:53:34 juju-e4d256-prod-github-runner-207 kernel: [73788.567312] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 01:53:34 juju-e4d256-prod-github-runner-207 kernel: [73788.568613] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 01:53:34 juju-e4d256-prod-github-runner-207 kernel: [73788.569923] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 01:53:34 juju-e4d256-prod-github-runner-207 kernel: [73788.571322] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 01:53:34 juju-e4d256-prod-github-runner-207 kernel: [73788.572530] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 01:53:34 juju-e4d256-prod-github-runner-207 kernel: [73788.573859] Call Trace: Aug 23 01:53:34 juju-e4d256-prod-github-runner-207 kernel: [73788.574829] Aug 23 01:53:34 juju-e4d256-prod-github-runner-207 kernel: [73788.575789] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:53:34 juju-e4d256-prod-github-runner-207 kernel: [73788.576906] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:53:34 juju-e4d256-prod-github-runner-207 kernel: [73788.578011] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:53:34 juju-e4d256-prod-github-runner-207 kernel: [73788.579181] ? show_regs.part.0+0x23/0x29 Aug 23 01:53:34 juju-e4d256-prod-github-runner-207 kernel: [73788.580274] ? show_regs.cold+0x8/0xd Aug 23 01:53:34 juju-e4d256-prod-github-runner-207 kernel: [73788.581320] ? watchdog_timer_fn+0x1be/0x220 Aug 23 01:53:34 juju-e4d256-prod-github-runner-207 kernel: [73788.582413] ? lockup_detector_update_enable+0x60/0x60 Aug 23 01:53:34 juju-e4d256-prod-github-runner-207 kernel: [73788.583588] ? __hrtimer_run_queues+0x107/0x230 Aug 23 01:53:34 juju-e4d256-prod-github-runner-207 kernel: [73788.584705] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 01:53:34 juju-e4d256-prod-github-runner-207 kernel: [73788.585814] ? hrtimer_interrupt+0x101/0x220 Aug 23 01:53:34 juju-e4d256-prod-github-runner-207 kernel: [73788.586911] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 01:53:34 juju-e4d256-prod-github-runner-207 kernel: [73788.588088] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 01:53:34 juju-e4d256-prod-github-runner-207 kernel: [73788.589227] Aug 23 01:53:34 juju-e4d256-prod-github-runner-207 kernel: [73788.590123] Aug 23 01:53:34 juju-e4d256-prod-github-runner-207 kernel: [73788.591009] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 01:53:34 juju-e4d256-prod-github-runner-207 kernel: [73788.592164] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:53:34 juju-e4d256-prod-github-runner-207 kernel: [73788.593305] ? _raw_spin_lock+0x22/0x30 Aug 23 01:53:34 juju-e4d256-prod-github-runner-207 kernel: [73788.594323] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:53:34 juju-e4d256-prod-github-runner-207 kernel: [73788.595446] direct_page_fault+0x206/0x310 [kvm] Aug 23 01:53:34 juju-e4d256-prod-github-runner-207 kernel: [73788.596561] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 01:53:34 juju-e4d256-prod-github-runner-207 kernel: [73788.597659] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 01:53:34 juju-e4d256-prod-github-runner-207 kernel: [73788.598747] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 01:53:34 juju-e4d256-prod-github-runner-207 kernel: [73788.599822] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 01:53:34 juju-e4d256-prod-github-runner-207 kernel: [73788.600861] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 01:53:34 juju-e4d256-prod-github-runner-207 kernel: [73788.601953] handle_exit+0x98/0x230 [kvm_amd] Aug 23 01:53:34 juju-e4d256-prod-github-runner-207 kernel: [73788.602931] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 01:53:34 juju-e4d256-prod-github-runner-207 kernel: [73788.603945] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 01:53:34 juju-e4d256-prod-github-runner-207 kernel: [73788.604962] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 01:53:34 juju-e4d256-prod-github-runner-207 kernel: [73788.605965] vcpu_run+0x62/0x2c0 [kvm] Aug 23 01:53:34 juju-e4d256-prod-github-runner-207 kernel: [73788.606847] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 01:53:34 juju-e4d256-prod-github-runner-207 kernel: [73788.607764] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 01:53:34 juju-e4d256-prod-github-runner-207 kernel: [73788.608714] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 01:53:34 juju-e4d256-prod-github-runner-207 kernel: [73788.609601] ? __seccomp_filter+0x4a/0x4a0 Aug 23 01:53:34 juju-e4d256-prod-github-runner-207 kernel: [73788.610424] ? __fget_files+0x86/0xc0 Aug 23 01:53:34 juju-e4d256-prod-github-runner-207 kernel: [73788.611205] __x64_sys_ioctl+0x95/0xd0 Aug 23 01:53:34 juju-e4d256-prod-github-runner-207 kernel: [73788.611984] do_syscall_64+0x5c/0xc0 Aug 23 01:53:34 juju-e4d256-prod-github-runner-207 kernel: [73788.612727] ? do_futex+0x162/0x1f0 Aug 23 01:53:34 juju-e4d256-prod-github-runner-207 kernel: [73788.613444] ? __x64_sys_futex+0x78/0x1e0 Aug 23 01:53:34 juju-e4d256-prod-github-runner-207 kernel: [73788.614194] ? __secure_computing+0xa9/0x120 Aug 23 01:53:34 juju-e4d256-prod-github-runner-207 kernel: [73788.614968] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 01:53:34 juju-e4d256-prod-github-runner-207 kernel: [73788.615844] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:53:34 juju-e4d256-prod-github-runner-207 kernel: [73788.616667] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:53:34 juju-e4d256-prod-github-runner-207 kernel: [73788.617610] ? do_syscall_64+0x69/0xc0 Aug 23 01:53:34 juju-e4d256-prod-github-runner-207 kernel: [73788.618335] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:53:34 juju-e4d256-prod-github-runner-207 kernel: [73788.619131] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:53:34 juju-e4d256-prod-github-runner-207 kernel: [73788.619941] ? do_syscall_64+0x69/0xc0 Aug 23 01:53:34 juju-e4d256-prod-github-runner-207 kernel: [73788.620640] ? do_syscall_64+0x69/0xc0 Aug 23 01:53:34 juju-e4d256-prod-github-runner-207 kernel: [73788.621343] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 01:53:34 juju-e4d256-prod-github-runner-207 kernel: [73788.622146] RIP: 0033:0x7faa5d0edaff Aug 23 01:53:34 juju-e4d256-prod-github-runner-207 kernel: [73788.622843] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 01:53:34 juju-e4d256-prod-github-runner-207 kernel: [73788.625172] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 01:53:34 juju-e4d256-prod-github-runner-207 kernel: [73788.626395] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 01:53:34 juju-e4d256-prod-github-runner-207 kernel: [73788.627438] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 01:53:34 juju-e4d256-prod-github-runner-207 kernel: [73788.628460] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 01:53:34 juju-e4d256-prod-github-runner-207 kernel: [73788.629479] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 01:53:34 juju-e4d256-prod-github-runner-207 kernel: [73788.630498] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 01:53:34 juju-e4d256-prod-github-runner-207 kernel: [73788.631537] Aug 23 01:53:48 juju-e4d256-prod-github-runner-207 kernel: [73802.108705] rcu: INFO: rcu_sched self-detected stall on CPU Aug 23 01:53:48 juju-e4d256-prod-github-runner-207 kernel: [73802.109743] rcu: 1-....: (18363304 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=8873367 Aug 23 01:53:48 juju-e4d256-prod-github-runner-207 kernel: [73802.110868] (t=18421227 jiffies g=23269 q=62749) Aug 23 01:53:48 juju-e4d256-prod-github-runner-207 kernel: [73802.111676] NMI backtrace for cpu 1 Aug 23 01:53:48 juju-e4d256-prod-github-runner-207 kernel: [73802.112384] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 01:53:48 juju-e4d256-prod-github-runner-207 kernel: [73802.113486] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 01:53:48 juju-e4d256-prod-github-runner-207 kernel: [73802.114543] Call Trace: Aug 23 01:53:48 juju-e4d256-prod-github-runner-207 kernel: [73802.115232] Aug 23 01:53:48 juju-e4d256-prod-github-runner-207 kernel: [73802.115880] show_stack+0x52/0x5c Aug 23 01:53:48 juju-e4d256-prod-github-runner-207 kernel: [73802.116606] dump_stack_lvl+0x4a/0x63 Aug 23 01:53:48 juju-e4d256-prod-github-runner-207 kernel: [73802.117351] dump_stack+0x10/0x16 Aug 23 01:53:48 juju-e4d256-prod-github-runner-207 kernel: [73802.118069] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 23 01:53:48 juju-e4d256-prod-github-runner-207 kernel: [73802.118854] ? lapic_can_unplug_cpu+0x90/0x90 Aug 23 01:53:48 juju-e4d256-prod-github-runner-207 kernel: [73802.119643] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 23 01:53:48 juju-e4d256-prod-github-runner-207 kernel: [73802.120459] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 23 01:53:48 juju-e4d256-prod-github-runner-207 kernel: [73802.121278] trigger_single_cpu_backtrace+0x44/0x4f Aug 23 01:53:48 juju-e4d256-prod-github-runner-207 kernel: [73802.122085] rcu_dump_cpu_stacks+0x102/0x149 Aug 23 01:53:48 juju-e4d256-prod-github-runner-207 kernel: [73802.122856] print_cpu_stall.cold+0x2f/0xe2 Aug 23 01:53:48 juju-e4d256-prod-github-runner-207 kernel: [73802.123632] ? timekeeping_update+0xf7/0x150 Aug 23 01:53:48 juju-e4d256-prod-github-runner-207 kernel: [73802.124408] check_cpu_stall+0x109/0x270 Aug 23 01:53:48 juju-e4d256-prod-github-runner-207 kernel: [73802.125154] rcu_sched_clock_irq+0x9a/0x250 Aug 23 01:53:48 juju-e4d256-prod-github-runner-207 kernel: [73802.125916] update_process_times+0x94/0xd0 Aug 23 01:53:48 juju-e4d256-prod-github-runner-207 kernel: [73802.126682] tick_sched_handle+0x29/0x70 Aug 23 01:53:48 juju-e4d256-prod-github-runner-207 kernel: [73802.127453] tick_sched_timer+0x8c/0xc0 Aug 23 01:53:48 juju-e4d256-prod-github-runner-207 kernel: [73802.128192] ? tick_nohz_handler+0xb0/0xb0 Aug 23 01:53:48 juju-e4d256-prod-github-runner-207 kernel: [73802.128952] __hrtimer_run_queues+0x107/0x230 Aug 23 01:53:48 juju-e4d256-prod-github-runner-207 kernel: [73802.129725] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 01:53:48 juju-e4d256-prod-github-runner-207 kernel: [73802.130500] hrtimer_interrupt+0x101/0x220 Aug 23 01:53:48 juju-e4d256-prod-github-runner-207 kernel: [73802.131277] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 01:53:48 juju-e4d256-prod-github-runner-207 kernel: [73802.132090] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 01:53:48 juju-e4d256-prod-github-runner-207 kernel: [73802.132897] Aug 23 01:53:48 juju-e4d256-prod-github-runner-207 kernel: [73802.133537] Aug 23 01:53:48 juju-e4d256-prod-github-runner-207 kernel: [73802.134165] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 01:53:48 juju-e4d256-prod-github-runner-207 kernel: [73802.134987] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:53:48 juju-e4d256-prod-github-runner-207 kernel: [73802.135882] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 01:53:48 juju-e4d256-prod-github-runner-207 kernel: [73802.138085] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 01:53:48 juju-e4d256-prod-github-runner-207 kernel: [73802.138957] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 01:53:48 juju-e4d256-prod-github-runner-207 kernel: [73802.139956] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 01:53:48 juju-e4d256-prod-github-runner-207 kernel: [73802.140931] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 01:53:48 juju-e4d256-prod-github-runner-207 kernel: [73802.141899] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 01:53:48 juju-e4d256-prod-github-runner-207 kernel: [73802.142857] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 01:53:48 juju-e4d256-prod-github-runner-207 kernel: [73802.143834] ? _raw_spin_lock+0x22/0x30 Aug 23 01:53:48 juju-e4d256-prod-github-runner-207 kernel: [73802.144596] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:53:48 juju-e4d256-prod-github-runner-207 kernel: [73802.145467] direct_page_fault+0x206/0x310 [kvm] Aug 23 01:53:48 juju-e4d256-prod-github-runner-207 kernel: [73802.146311] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 01:53:48 juju-e4d256-prod-github-runner-207 kernel: [73802.147155] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 01:53:48 juju-e4d256-prod-github-runner-207 kernel: [73802.147989] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 01:53:48 juju-e4d256-prod-github-runner-207 kernel: [73802.148811] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 01:53:48 juju-e4d256-prod-github-runner-207 kernel: [73802.149601] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 01:53:48 juju-e4d256-prod-github-runner-207 kernel: [73802.150425] handle_exit+0x98/0x230 [kvm_amd] Aug 23 01:53:48 juju-e4d256-prod-github-runner-207 kernel: [73802.151187] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 01:53:48 juju-e4d256-prod-github-runner-207 kernel: [73802.151971] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 01:53:48 juju-e4d256-prod-github-runner-207 kernel: [73802.152769] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 01:53:48 juju-e4d256-prod-github-runner-207 kernel: [73802.153556] vcpu_run+0x62/0x2c0 [kvm] Aug 23 01:53:48 juju-e4d256-prod-github-runner-207 kernel: [73802.154269] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 01:53:48 juju-e4d256-prod-github-runner-207 kernel: [73802.154999] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 01:53:48 juju-e4d256-prod-github-runner-207 kernel: [73802.155809] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 01:53:48 juju-e4d256-prod-github-runner-207 kernel: [73802.156569] ? __seccomp_filter+0x4a/0x4a0 Aug 23 01:53:48 juju-e4d256-prod-github-runner-207 kernel: [73802.157287] ? __fget_files+0x86/0xc0 Aug 23 01:53:48 juju-e4d256-prod-github-runner-207 kernel: [73802.157978] __x64_sys_ioctl+0x95/0xd0 Aug 23 01:53:48 juju-e4d256-prod-github-runner-207 kernel: [73802.158669] do_syscall_64+0x5c/0xc0 Aug 23 01:53:48 juju-e4d256-prod-github-runner-207 kernel: [73802.159359] ? do_futex+0x162/0x1f0 Aug 23 01:53:48 juju-e4d256-prod-github-runner-207 kernel: [73802.160028] ? __x64_sys_futex+0x78/0x1e0 Aug 23 01:53:48 juju-e4d256-prod-github-runner-207 kernel: [73802.160725] ? __secure_computing+0xa9/0x120 Aug 23 01:53:48 juju-e4d256-prod-github-runner-207 kernel: [73802.161437] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 01:53:48 juju-e4d256-prod-github-runner-207 kernel: [73802.162223] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:53:48 juju-e4d256-prod-github-runner-207 kernel: [73802.162974] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:53:48 juju-e4d256-prod-github-runner-207 kernel: [73802.163733] ? do_syscall_64+0x69/0xc0 Aug 23 01:53:48 juju-e4d256-prod-github-runner-207 kernel: [73802.164419] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:53:48 juju-e4d256-prod-github-runner-207 kernel: [73802.165170] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:53:48 juju-e4d256-prod-github-runner-207 kernel: [73802.165929] ? do_syscall_64+0x69/0xc0 Aug 23 01:53:48 juju-e4d256-prod-github-runner-207 kernel: [73802.166624] ? do_syscall_64+0x69/0xc0 Aug 23 01:53:48 juju-e4d256-prod-github-runner-207 kernel: [73802.167322] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 01:53:48 juju-e4d256-prod-github-runner-207 kernel: [73802.168088] RIP: 0033:0x7faa5d0edaff Aug 23 01:53:48 juju-e4d256-prod-github-runner-207 kernel: [73802.168765] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 01:53:48 juju-e4d256-prod-github-runner-207 kernel: [73802.170854] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 01:53:48 juju-e4d256-prod-github-runner-207 kernel: [73802.171820] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 01:53:48 juju-e4d256-prod-github-runner-207 kernel: [73802.172824] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 01:53:48 juju-e4d256-prod-github-runner-207 kernel: [73802.173765] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 01:53:48 juju-e4d256-prod-github-runner-207 kernel: [73802.174701] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 01:53:48 juju-e4d256-prod-github-runner-207 kernel: [73802.175640] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 01:53:48 juju-e4d256-prod-github-runner-207 kernel: [73802.176550] Aug 23 01:54:14 juju-e4d256-prod-github-runner-207 kernel: [73828.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 68650s! [qemu-system-x86:6715] Aug 23 01:54:14 juju-e4d256-prod-github-runner-207 kernel: [73828.543740] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 01:54:14 juju-e4d256-prod-github-runner-207 kernel: [73828.543982] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 01:54:14 juju-e4d256-prod-github-runner-207 kernel: [73828.556082] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 01:54:14 juju-e4d256-prod-github-runner-207 kernel: [73828.557359] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 01:54:14 juju-e4d256-prod-github-runner-207 kernel: [73828.558577] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:54:14 juju-e4d256-prod-github-runner-207 kernel: [73828.559650] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 01:54:14 juju-e4d256-prod-github-runner-207 kernel: [73828.562418] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 01:54:14 juju-e4d256-prod-github-runner-207 kernel: [73828.563488] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 01:54:14 juju-e4d256-prod-github-runner-207 kernel: [73828.564655] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 01:54:14 juju-e4d256-prod-github-runner-207 kernel: [73828.565813] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 01:54:14 juju-e4d256-prod-github-runner-207 kernel: [73828.566994] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 01:54:14 juju-e4d256-prod-github-runner-207 kernel: [73828.568156] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 01:54:14 juju-e4d256-prod-github-runner-207 kernel: [73828.569324] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 01:54:14 juju-e4d256-prod-github-runner-207 kernel: [73828.570554] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 01:54:14 juju-e4d256-prod-github-runner-207 kernel: [73828.571666] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 01:54:14 juju-e4d256-prod-github-runner-207 kernel: [73828.572857] Call Trace: Aug 23 01:54:14 juju-e4d256-prod-github-runner-207 kernel: [73828.573774] Aug 23 01:54:14 juju-e4d256-prod-github-runner-207 kernel: [73828.574663] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:54:14 juju-e4d256-prod-github-runner-207 kernel: [73828.575705] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:54:14 juju-e4d256-prod-github-runner-207 kernel: [73828.576729] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:54:14 juju-e4d256-prod-github-runner-207 kernel: [73828.577829] ? show_regs.part.0+0x23/0x29 Aug 23 01:54:14 juju-e4d256-prod-github-runner-207 kernel: [73828.578849] ? show_regs.cold+0x8/0xd Aug 23 01:54:14 juju-e4d256-prod-github-runner-207 kernel: [73828.579819] ? watchdog_timer_fn+0x1be/0x220 Aug 23 01:54:14 juju-e4d256-prod-github-runner-207 kernel: [73828.580825] ? lockup_detector_update_enable+0x60/0x60 Aug 23 01:54:14 juju-e4d256-prod-github-runner-207 kernel: [73828.581889] ? __hrtimer_run_queues+0x107/0x230 Aug 23 01:54:14 juju-e4d256-prod-github-runner-207 kernel: [73828.582935] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 01:54:14 juju-e4d256-prod-github-runner-207 kernel: [73828.583955] ? hrtimer_interrupt+0x101/0x220 Aug 23 01:54:14 juju-e4d256-prod-github-runner-207 kernel: [73828.584971] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 01:54:14 juju-e4d256-prod-github-runner-207 kernel: [73828.586040] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 01:54:14 juju-e4d256-prod-github-runner-207 kernel: [73828.587095] Aug 23 01:54:14 juju-e4d256-prod-github-runner-207 kernel: [73828.587959] Aug 23 01:54:14 juju-e4d256-prod-github-runner-207 kernel: [73828.588795] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 01:54:14 juju-e4d256-prod-github-runner-207 kernel: [73828.589824] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:54:14 juju-e4d256-prod-github-runner-207 kernel: [73828.590870] ? _raw_spin_lock+0x22/0x30 Aug 23 01:54:14 juju-e4d256-prod-github-runner-207 kernel: [73828.591814] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:54:14 juju-e4d256-prod-github-runner-207 kernel: [73828.592827] direct_page_fault+0x206/0x310 [kvm] Aug 23 01:54:14 juju-e4d256-prod-github-runner-207 kernel: [73828.593847] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 01:54:14 juju-e4d256-prod-github-runner-207 kernel: [73828.594868] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 01:54:14 juju-e4d256-prod-github-runner-207 kernel: [73828.595867] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 01:54:14 juju-e4d256-prod-github-runner-207 kernel: [73828.596843] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 01:54:14 juju-e4d256-prod-github-runner-207 kernel: [73828.597793] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 01:54:14 juju-e4d256-prod-github-runner-207 kernel: [73828.598775] handle_exit+0x98/0x230 [kvm_amd] Aug 23 01:54:14 juju-e4d256-prod-github-runner-207 kernel: [73828.599673] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 01:54:14 juju-e4d256-prod-github-runner-207 kernel: [73828.600585] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 01:54:14 juju-e4d256-prod-github-runner-207 kernel: [73828.601506] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 01:54:14 juju-e4d256-prod-github-runner-207 kernel: [73828.602408] vcpu_run+0x62/0x2c0 [kvm] Aug 23 01:54:14 juju-e4d256-prod-github-runner-207 kernel: [73828.603231] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 01:54:14 juju-e4d256-prod-github-runner-207 kernel: [73828.604040] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 01:54:14 juju-e4d256-prod-github-runner-207 kernel: [73828.604891] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 01:54:14 juju-e4d256-prod-github-runner-207 kernel: [73828.605685] ? __seccomp_filter+0x4a/0x4a0 Aug 23 01:54:14 juju-e4d256-prod-github-runner-207 kernel: [73828.606423] ? __fget_files+0x86/0xc0 Aug 23 01:54:14 juju-e4d256-prod-github-runner-207 kernel: [73828.607134] __x64_sys_ioctl+0x95/0xd0 Aug 23 01:54:14 juju-e4d256-prod-github-runner-207 kernel: [73828.607844] do_syscall_64+0x5c/0xc0 Aug 23 01:54:14 juju-e4d256-prod-github-runner-207 kernel: [73828.608524] ? do_futex+0x162/0x1f0 Aug 23 01:54:14 juju-e4d256-prod-github-runner-207 kernel: [73828.609172] ? __x64_sys_futex+0x78/0x1e0 Aug 23 01:54:14 juju-e4d256-prod-github-runner-207 kernel: [73828.609848] ? __secure_computing+0xa9/0x120 Aug 23 01:54:14 juju-e4d256-prod-github-runner-207 kernel: [73828.610533] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 01:54:14 juju-e4d256-prod-github-runner-207 kernel: [73828.611295] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:54:14 juju-e4d256-prod-github-runner-207 kernel: [73828.612013] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:54:14 juju-e4d256-prod-github-runner-207 kernel: [73828.612725] ? do_syscall_64+0x69/0xc0 Aug 23 01:54:14 juju-e4d256-prod-github-runner-207 kernel: [73828.613365] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:54:14 juju-e4d256-prod-github-runner-207 kernel: [73828.614067] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:54:14 juju-e4d256-prod-github-runner-207 kernel: [73828.614757] ? do_syscall_64+0x69/0xc0 Aug 23 01:54:14 juju-e4d256-prod-github-runner-207 kernel: [73828.615383] ? do_syscall_64+0x69/0xc0 Aug 23 01:54:14 juju-e4d256-prod-github-runner-207 kernel: [73828.616003] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 01:54:14 juju-e4d256-prod-github-runner-207 kernel: [73828.616707] RIP: 0033:0x7faa5d0edaff Aug 23 01:54:14 juju-e4d256-prod-github-runner-207 kernel: [73828.617338] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 01:54:14 juju-e4d256-prod-github-runner-207 kernel: [73828.619332] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 01:54:14 juju-e4d256-prod-github-runner-207 kernel: [73828.620247] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 01:54:14 juju-e4d256-prod-github-runner-207 kernel: [73828.621132] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 01:54:14 juju-e4d256-prod-github-runner-207 kernel: [73828.622015] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 01:54:14 juju-e4d256-prod-github-runner-207 kernel: [73828.622911] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 01:54:14 juju-e4d256-prod-github-runner-207 kernel: [73828.623801] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 01:54:14 juju-e4d256-prod-github-runner-207 kernel: [73828.624693] Aug 23 01:54:42 juju-e4d256-prod-github-runner-207 kernel: [73856.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 68676s! [qemu-system-x86:6715] Aug 23 01:54:42 juju-e4d256-prod-github-runner-207 kernel: [73856.543110] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 01:54:42 juju-e4d256-prod-github-runner-207 kernel: [73856.543178] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 01:54:42 juju-e4d256-prod-github-runner-207 kernel: [73856.555254] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 01:54:42 juju-e4d256-prod-github-runner-207 kernel: [73856.556521] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 01:54:42 juju-e4d256-prod-github-runner-207 kernel: [73856.557739] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:54:42 juju-e4d256-prod-github-runner-207 kernel: [73856.558802] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 01:54:42 juju-e4d256-prod-github-runner-207 kernel: [73856.561347] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 01:54:42 juju-e4d256-prod-github-runner-207 kernel: [73856.562393] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 01:54:42 juju-e4d256-prod-github-runner-207 kernel: [73856.563561] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 01:54:42 juju-e4d256-prod-github-runner-207 kernel: [73856.564722] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 01:54:42 juju-e4d256-prod-github-runner-207 kernel: [73856.565879] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 01:54:42 juju-e4d256-prod-github-runner-207 kernel: [73856.567047] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 01:54:42 juju-e4d256-prod-github-runner-207 kernel: [73856.568237] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 01:54:42 juju-e4d256-prod-github-runner-207 kernel: [73856.569477] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 01:54:42 juju-e4d256-prod-github-runner-207 kernel: [73856.570578] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 01:54:42 juju-e4d256-prod-github-runner-207 kernel: [73856.571771] Call Trace: Aug 23 01:54:42 juju-e4d256-prod-github-runner-207 kernel: [73856.572686] Aug 23 01:54:42 juju-e4d256-prod-github-runner-207 kernel: [73856.573569] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:54:42 juju-e4d256-prod-github-runner-207 kernel: [73856.574608] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:54:42 juju-e4d256-prod-github-runner-207 kernel: [73856.575630] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:54:42 juju-e4d256-prod-github-runner-207 kernel: [73856.576722] ? show_regs.part.0+0x23/0x29 Aug 23 01:54:42 juju-e4d256-prod-github-runner-207 kernel: [73856.577794] ? show_regs.cold+0x8/0xd Aug 23 01:54:42 juju-e4d256-prod-github-runner-207 kernel: [73856.578798] ? watchdog_timer_fn+0x1be/0x220 Aug 23 01:54:42 juju-e4d256-prod-github-runner-207 kernel: [73856.579808] ? lockup_detector_update_enable+0x60/0x60 Aug 23 01:54:42 juju-e4d256-prod-github-runner-207 kernel: [73856.580869] ? __hrtimer_run_queues+0x107/0x230 Aug 23 01:54:42 juju-e4d256-prod-github-runner-207 kernel: [73856.581897] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 01:54:42 juju-e4d256-prod-github-runner-207 kernel: [73856.582928] ? hrtimer_interrupt+0x101/0x220 Aug 23 01:54:42 juju-e4d256-prod-github-runner-207 kernel: [73856.583948] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 01:54:42 juju-e4d256-prod-github-runner-207 kernel: [73856.585015] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 01:54:42 juju-e4d256-prod-github-runner-207 kernel: [73856.586059] Aug 23 01:54:42 juju-e4d256-prod-github-runner-207 kernel: [73856.586929] Aug 23 01:54:42 juju-e4d256-prod-github-runner-207 kernel: [73856.587765] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 01:54:42 juju-e4d256-prod-github-runner-207 kernel: [73856.588796] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:54:42 juju-e4d256-prod-github-runner-207 kernel: [73856.589831] ? _raw_spin_lock+0x22/0x30 Aug 23 01:54:42 juju-e4d256-prod-github-runner-207 kernel: [73856.590786] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:54:42 juju-e4d256-prod-github-runner-207 kernel: [73856.591802] direct_page_fault+0x206/0x310 [kvm] Aug 23 01:54:42 juju-e4d256-prod-github-runner-207 kernel: [73856.592823] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 01:54:42 juju-e4d256-prod-github-runner-207 kernel: [73856.593836] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 01:54:42 juju-e4d256-prod-github-runner-207 kernel: [73856.594847] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 01:54:42 juju-e4d256-prod-github-runner-207 kernel: [73856.595816] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 01:54:42 juju-e4d256-prod-github-runner-207 kernel: [73856.596760] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 01:54:42 juju-e4d256-prod-github-runner-207 kernel: [73856.597742] handle_exit+0x98/0x230 [kvm_amd] Aug 23 01:54:42 juju-e4d256-prod-github-runner-207 kernel: [73856.598643] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 01:54:42 juju-e4d256-prod-github-runner-207 kernel: [73856.599557] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 01:54:42 juju-e4d256-prod-github-runner-207 kernel: [73856.600484] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 01:54:42 juju-e4d256-prod-github-runner-207 kernel: [73856.601391] vcpu_run+0x62/0x2c0 [kvm] Aug 23 01:54:42 juju-e4d256-prod-github-runner-207 kernel: [73856.602207] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 01:54:42 juju-e4d256-prod-github-runner-207 kernel: [73856.603029] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 01:54:42 juju-e4d256-prod-github-runner-207 kernel: [73856.603882] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 01:54:42 juju-e4d256-prod-github-runner-207 kernel: [73856.604679] ? __seccomp_filter+0x4a/0x4a0 Aug 23 01:54:42 juju-e4d256-prod-github-runner-207 kernel: [73856.605422] ? __fget_files+0x86/0xc0 Aug 23 01:54:42 juju-e4d256-prod-github-runner-207 kernel: [73856.606154] __x64_sys_ioctl+0x95/0xd0 Aug 23 01:54:42 juju-e4d256-prod-github-runner-207 kernel: [73856.606878] do_syscall_64+0x5c/0xc0 Aug 23 01:54:42 juju-e4d256-prod-github-runner-207 kernel: [73856.607541] ? do_futex+0x162/0x1f0 Aug 23 01:54:42 juju-e4d256-prod-github-runner-207 kernel: [73856.608189] ? __x64_sys_futex+0x78/0x1e0 Aug 23 01:54:42 juju-e4d256-prod-github-runner-207 kernel: [73856.608860] ? __secure_computing+0xa9/0x120 Aug 23 01:54:42 juju-e4d256-prod-github-runner-207 kernel: [73856.609553] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 01:54:42 juju-e4d256-prod-github-runner-207 kernel: [73856.610311] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:54:42 juju-e4d256-prod-github-runner-207 kernel: [73856.611037] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:54:42 juju-e4d256-prod-github-runner-207 kernel: [73856.611752] ? do_syscall_64+0x69/0xc0 Aug 23 01:54:42 juju-e4d256-prod-github-runner-207 kernel: [73856.612402] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:54:42 juju-e4d256-prod-github-runner-207 kernel: [73856.613106] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:54:42 juju-e4d256-prod-github-runner-207 kernel: [73856.613798] ? do_syscall_64+0x69/0xc0 Aug 23 01:54:42 juju-e4d256-prod-github-runner-207 kernel: [73856.614420] ? do_syscall_64+0x69/0xc0 Aug 23 01:54:42 juju-e4d256-prod-github-runner-207 kernel: [73856.615046] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 01:54:42 juju-e4d256-prod-github-runner-207 kernel: [73856.615748] RIP: 0033:0x7faa5d0edaff Aug 23 01:54:42 juju-e4d256-prod-github-runner-207 kernel: [73856.616374] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 01:54:42 juju-e4d256-prod-github-runner-207 kernel: [73856.618349] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 01:54:42 juju-e4d256-prod-github-runner-207 kernel: [73856.619261] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 01:54:42 juju-e4d256-prod-github-runner-207 kernel: [73856.620146] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 01:54:42 juju-e4d256-prod-github-runner-207 kernel: [73856.621030] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 01:54:42 juju-e4d256-prod-github-runner-207 kernel: [73856.621914] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 01:54:42 juju-e4d256-prod-github-runner-207 kernel: [73856.622806] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 01:54:42 juju-e4d256-prod-github-runner-207 kernel: [73856.623699] Aug 23 01:55:10 juju-e4d256-prod-github-runner-207 kernel: [73884.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 68702s! [qemu-system-x86:6715] Aug 23 01:55:10 juju-e4d256-prod-github-runner-207 kernel: [73884.543174] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 01:55:10 juju-e4d256-prod-github-runner-207 kernel: [73884.543243] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 01:55:10 juju-e4d256-prod-github-runner-207 kernel: [73884.555474] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 01:55:10 juju-e4d256-prod-github-runner-207 kernel: [73884.556740] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 01:55:10 juju-e4d256-prod-github-runner-207 kernel: [73884.557956] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:55:10 juju-e4d256-prod-github-runner-207 kernel: [73884.559039] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 01:55:10 juju-e4d256-prod-github-runner-207 kernel: [73884.561582] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 01:55:10 juju-e4d256-prod-github-runner-207 kernel: [73884.562638] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 01:55:10 juju-e4d256-prod-github-runner-207 kernel: [73884.563795] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 01:55:10 juju-e4d256-prod-github-runner-207 kernel: [73884.564956] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 01:55:10 juju-e4d256-prod-github-runner-207 kernel: [73884.566118] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 01:55:10 juju-e4d256-prod-github-runner-207 kernel: [73884.567284] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 01:55:10 juju-e4d256-prod-github-runner-207 kernel: [73884.568452] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 01:55:10 juju-e4d256-prod-github-runner-207 kernel: [73884.569683] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 01:55:10 juju-e4d256-prod-github-runner-207 kernel: [73884.570795] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 01:55:10 juju-e4d256-prod-github-runner-207 kernel: [73884.571995] Call Trace: Aug 23 01:55:10 juju-e4d256-prod-github-runner-207 kernel: [73884.572905] Aug 23 01:55:10 juju-e4d256-prod-github-runner-207 kernel: [73884.573791] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:55:10 juju-e4d256-prod-github-runner-207 kernel: [73884.574831] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:55:10 juju-e4d256-prod-github-runner-207 kernel: [73884.575856] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:55:10 juju-e4d256-prod-github-runner-207 kernel: [73884.576927] ? show_regs.part.0+0x23/0x29 Aug 23 01:55:10 juju-e4d256-prod-github-runner-207 kernel: [73884.577925] ? show_regs.cold+0x8/0xd Aug 23 01:55:10 juju-e4d256-prod-github-runner-207 kernel: [73884.578914] ? watchdog_timer_fn+0x1be/0x220 Aug 23 01:55:10 juju-e4d256-prod-github-runner-207 kernel: [73884.579920] ? lockup_detector_update_enable+0x60/0x60 Aug 23 01:55:10 juju-e4d256-prod-github-runner-207 kernel: [73884.581079] ? __hrtimer_run_queues+0x107/0x230 Aug 23 01:55:10 juju-e4d256-prod-github-runner-207 kernel: [73884.582127] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 01:55:10 juju-e4d256-prod-github-runner-207 kernel: [73884.583179] ? hrtimer_interrupt+0x101/0x220 Aug 23 01:55:10 juju-e4d256-prod-github-runner-207 kernel: [73884.584195] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 01:55:10 juju-e4d256-prod-github-runner-207 kernel: [73884.585264] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 01:55:10 juju-e4d256-prod-github-runner-207 kernel: [73884.586328] Aug 23 01:55:10 juju-e4d256-prod-github-runner-207 kernel: [73884.587183] Aug 23 01:55:10 juju-e4d256-prod-github-runner-207 kernel: [73884.588019] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 01:55:10 juju-e4d256-prod-github-runner-207 kernel: [73884.589054] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:55:10 juju-e4d256-prod-github-runner-207 kernel: [73884.590091] ? _raw_spin_lock+0x22/0x30 Aug 23 01:55:10 juju-e4d256-prod-github-runner-207 kernel: [73884.591059] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:55:10 juju-e4d256-prod-github-runner-207 kernel: [73884.592077] direct_page_fault+0x206/0x310 [kvm] Aug 23 01:55:10 juju-e4d256-prod-github-runner-207 kernel: [73884.593146] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 01:55:10 juju-e4d256-prod-github-runner-207 kernel: [73884.594235] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 01:55:10 juju-e4d256-prod-github-runner-207 kernel: [73884.595286] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 01:55:10 juju-e4d256-prod-github-runner-207 kernel: [73884.596260] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 01:55:10 juju-e4d256-prod-github-runner-207 kernel: [73884.597206] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 01:55:10 juju-e4d256-prod-github-runner-207 kernel: [73884.598204] handle_exit+0x98/0x230 [kvm_amd] Aug 23 01:55:10 juju-e4d256-prod-github-runner-207 kernel: [73884.599097] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 01:55:10 juju-e4d256-prod-github-runner-207 kernel: [73884.600016] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 01:55:10 juju-e4d256-prod-github-runner-207 kernel: [73884.600941] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 01:55:10 juju-e4d256-prod-github-runner-207 kernel: [73884.601845] vcpu_run+0x62/0x2c0 [kvm] Aug 23 01:55:10 juju-e4d256-prod-github-runner-207 kernel: [73884.602681] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 01:55:10 juju-e4d256-prod-github-runner-207 kernel: [73884.603492] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 01:55:10 juju-e4d256-prod-github-runner-207 kernel: [73884.604349] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 01:55:10 juju-e4d256-prod-github-runner-207 kernel: [73884.605152] ? __seccomp_filter+0x4a/0x4a0 Aug 23 01:55:10 juju-e4d256-prod-github-runner-207 kernel: [73884.605911] ? __fget_files+0x86/0xc0 Aug 23 01:55:10 juju-e4d256-prod-github-runner-207 kernel: [73884.606652] __x64_sys_ioctl+0x95/0xd0 Aug 23 01:55:10 juju-e4d256-prod-github-runner-207 kernel: [73884.607343] do_syscall_64+0x5c/0xc0 Aug 23 01:55:10 juju-e4d256-prod-github-runner-207 kernel: [73884.608006] ? do_futex+0x162/0x1f0 Aug 23 01:55:10 juju-e4d256-prod-github-runner-207 kernel: [73884.608658] ? __x64_sys_futex+0x78/0x1e0 Aug 23 01:55:10 juju-e4d256-prod-github-runner-207 kernel: [73884.609335] ? __secure_computing+0xa9/0x120 Aug 23 01:55:10 juju-e4d256-prod-github-runner-207 kernel: [73884.610023] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 01:55:10 juju-e4d256-prod-github-runner-207 kernel: [73884.610801] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:55:10 juju-e4d256-prod-github-runner-207 kernel: [73884.611573] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:55:10 juju-e4d256-prod-github-runner-207 kernel: [73884.612324] ? do_syscall_64+0x69/0xc0 Aug 23 01:55:10 juju-e4d256-prod-github-runner-207 kernel: [73884.612970] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:55:10 juju-e4d256-prod-github-runner-207 kernel: [73884.613672] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:55:10 juju-e4d256-prod-github-runner-207 kernel: [73884.614393] ? do_syscall_64+0x69/0xc0 Aug 23 01:55:10 juju-e4d256-prod-github-runner-207 kernel: [73884.615018] ? do_syscall_64+0x69/0xc0 Aug 23 01:55:10 juju-e4d256-prod-github-runner-207 kernel: [73884.615645] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 01:55:10 juju-e4d256-prod-github-runner-207 kernel: [73884.616355] RIP: 0033:0x7faa5d0edaff Aug 23 01:55:10 juju-e4d256-prod-github-runner-207 kernel: [73884.616981] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 01:55:10 juju-e4d256-prod-github-runner-207 kernel: [73884.618990] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 01:55:10 juju-e4d256-prod-github-runner-207 kernel: [73884.619901] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 01:55:10 juju-e4d256-prod-github-runner-207 kernel: [73884.620792] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 01:55:10 juju-e4d256-prod-github-runner-207 kernel: [73884.621683] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 01:55:10 juju-e4d256-prod-github-runner-207 kernel: [73884.622593] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 01:55:10 juju-e4d256-prod-github-runner-207 kernel: [73884.623489] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 01:55:10 juju-e4d256-prod-github-runner-207 kernel: [73884.624383] Aug 23 01:55:38 juju-e4d256-prod-github-runner-207 kernel: [73912.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 68728s! [qemu-system-x86:6715] Aug 23 01:55:38 juju-e4d256-prod-github-runner-207 kernel: [73912.543703] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 01:55:38 juju-e4d256-prod-github-runner-207 kernel: [73912.543961] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 01:55:38 juju-e4d256-prod-github-runner-207 kernel: [73912.555900] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 01:55:38 juju-e4d256-prod-github-runner-207 kernel: [73912.557153] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 01:55:38 juju-e4d256-prod-github-runner-207 kernel: [73912.558370] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:55:38 juju-e4d256-prod-github-runner-207 kernel: [73912.559434] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 01:55:38 juju-e4d256-prod-github-runner-207 kernel: [73912.561962] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 01:55:38 juju-e4d256-prod-github-runner-207 kernel: [73912.563000] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 01:55:38 juju-e4d256-prod-github-runner-207 kernel: [73912.564153] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 01:55:38 juju-e4d256-prod-github-runner-207 kernel: [73912.565302] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 01:55:38 juju-e4d256-prod-github-runner-207 kernel: [73912.566462] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 01:55:38 juju-e4d256-prod-github-runner-207 kernel: [73912.567612] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 01:55:38 juju-e4d256-prod-github-runner-207 kernel: [73912.568768] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 01:55:38 juju-e4d256-prod-github-runner-207 kernel: [73912.569999] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 01:55:38 juju-e4d256-prod-github-runner-207 kernel: [73912.571086] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 01:55:38 juju-e4d256-prod-github-runner-207 kernel: [73912.572272] Call Trace: Aug 23 01:55:38 juju-e4d256-prod-github-runner-207 kernel: [73912.573184] Aug 23 01:55:38 juju-e4d256-prod-github-runner-207 kernel: [73912.574088] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:55:38 juju-e4d256-prod-github-runner-207 kernel: [73912.575110] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:55:38 juju-e4d256-prod-github-runner-207 kernel: [73912.576127] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:55:38 juju-e4d256-prod-github-runner-207 kernel: [73912.577222] ? show_regs.part.0+0x23/0x29 Aug 23 01:55:38 juju-e4d256-prod-github-runner-207 kernel: [73912.578224] ? show_regs.cold+0x8/0xd Aug 23 01:55:38 juju-e4d256-prod-github-runner-207 kernel: [73912.579196] ? watchdog_timer_fn+0x1be/0x220 Aug 23 01:55:38 juju-e4d256-prod-github-runner-207 kernel: [73912.580203] ? lockup_detector_update_enable+0x60/0x60 Aug 23 01:55:38 juju-e4d256-prod-github-runner-207 kernel: [73912.581259] ? __hrtimer_run_queues+0x107/0x230 Aug 23 01:55:38 juju-e4d256-prod-github-runner-207 kernel: [73912.582299] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 01:55:38 juju-e4d256-prod-github-runner-207 kernel: [73912.583319] ? hrtimer_interrupt+0x101/0x220 Aug 23 01:55:38 juju-e4d256-prod-github-runner-207 kernel: [73912.584325] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 01:55:38 juju-e4d256-prod-github-runner-207 kernel: [73912.585392] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 01:55:38 juju-e4d256-prod-github-runner-207 kernel: [73912.586445] Aug 23 01:55:38 juju-e4d256-prod-github-runner-207 kernel: [73912.587294] Aug 23 01:55:38 juju-e4d256-prod-github-runner-207 kernel: [73912.588126] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 01:55:38 juju-e4d256-prod-github-runner-207 kernel: [73912.589149] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:55:38 juju-e4d256-prod-github-runner-207 kernel: [73912.590193] ? _raw_spin_lock+0x22/0x30 Aug 23 01:55:38 juju-e4d256-prod-github-runner-207 kernel: [73912.591133] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:55:38 juju-e4d256-prod-github-runner-207 kernel: [73912.592140] direct_page_fault+0x206/0x310 [kvm] Aug 23 01:55:38 juju-e4d256-prod-github-runner-207 kernel: [73912.593156] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 01:55:38 juju-e4d256-prod-github-runner-207 kernel: [73912.594163] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 01:55:38 juju-e4d256-prod-github-runner-207 kernel: [73912.595156] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 01:55:38 juju-e4d256-prod-github-runner-207 kernel: [73912.596143] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 01:55:38 juju-e4d256-prod-github-runner-207 kernel: [73912.597080] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 01:55:38 juju-e4d256-prod-github-runner-207 kernel: [73912.598065] handle_exit+0x98/0x230 [kvm_amd] Aug 23 01:55:38 juju-e4d256-prod-github-runner-207 kernel: [73912.598956] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 01:55:38 juju-e4d256-prod-github-runner-207 kernel: [73912.599860] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 01:55:38 juju-e4d256-prod-github-runner-207 kernel: [73912.600790] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 01:55:38 juju-e4d256-prod-github-runner-207 kernel: [73912.601690] vcpu_run+0x62/0x2c0 [kvm] Aug 23 01:55:38 juju-e4d256-prod-github-runner-207 kernel: [73912.602515] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 01:55:38 juju-e4d256-prod-github-runner-207 kernel: [73912.603471] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 01:55:38 juju-e4d256-prod-github-runner-207 kernel: [73912.604320] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 01:55:38 juju-e4d256-prod-github-runner-207 kernel: [73912.605110] ? __seccomp_filter+0x4a/0x4a0 Aug 23 01:55:38 juju-e4d256-prod-github-runner-207 kernel: [73912.605844] ? __fget_files+0x86/0xc0 Aug 23 01:55:38 juju-e4d256-prod-github-runner-207 kernel: [73912.606561] __x64_sys_ioctl+0x95/0xd0 Aug 23 01:55:38 juju-e4d256-prod-github-runner-207 kernel: [73912.607244] do_syscall_64+0x5c/0xc0 Aug 23 01:55:38 juju-e4d256-prod-github-runner-207 kernel: [73912.607909] ? do_futex+0x162/0x1f0 Aug 23 01:55:38 juju-e4d256-prod-github-runner-207 kernel: [73912.608551] ? __x64_sys_futex+0x78/0x1e0 Aug 23 01:55:38 juju-e4d256-prod-github-runner-207 kernel: [73912.609220] ? __secure_computing+0xa9/0x120 Aug 23 01:55:38 juju-e4d256-prod-github-runner-207 kernel: [73912.609915] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 01:55:38 juju-e4d256-prod-github-runner-207 kernel: [73912.610672] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:55:38 juju-e4d256-prod-github-runner-207 kernel: [73912.611383] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:55:38 juju-e4d256-prod-github-runner-207 kernel: [73912.612090] ? do_syscall_64+0x69/0xc0 Aug 23 01:55:38 juju-e4d256-prod-github-runner-207 kernel: [73912.612726] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:55:38 juju-e4d256-prod-github-runner-207 kernel: [73912.613417] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:55:38 juju-e4d256-prod-github-runner-207 kernel: [73912.614114] ? do_syscall_64+0x69/0xc0 Aug 23 01:55:38 juju-e4d256-prod-github-runner-207 kernel: [73912.614734] ? do_syscall_64+0x69/0xc0 Aug 23 01:55:38 juju-e4d256-prod-github-runner-207 kernel: [73912.615350] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 01:55:38 juju-e4d256-prod-github-runner-207 kernel: [73912.616037] RIP: 0033:0x7faa5d0edaff Aug 23 01:55:38 juju-e4d256-prod-github-runner-207 kernel: [73912.616677] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 01:55:38 juju-e4d256-prod-github-runner-207 kernel: [73912.618651] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 01:55:38 juju-e4d256-prod-github-runner-207 kernel: [73912.619551] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 01:55:38 juju-e4d256-prod-github-runner-207 kernel: [73912.620429] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 01:55:38 juju-e4d256-prod-github-runner-207 kernel: [73912.621313] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 01:55:38 juju-e4d256-prod-github-runner-207 kernel: [73912.622208] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 01:55:38 juju-e4d256-prod-github-runner-207 kernel: [73912.623078] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 01:55:38 juju-e4d256-prod-github-runner-207 kernel: [73912.623955] Aug 23 01:56:06 juju-e4d256-prod-github-runner-207 kernel: [73940.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 68754s! [qemu-system-x86:6715] Aug 23 01:56:06 juju-e4d256-prod-github-runner-207 kernel: [73940.543086] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 01:56:06 juju-e4d256-prod-github-runner-207 kernel: [73940.543155] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 01:56:06 juju-e4d256-prod-github-runner-207 kernel: [73940.555199] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 01:56:06 juju-e4d256-prod-github-runner-207 kernel: [73940.556462] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 01:56:06 juju-e4d256-prod-github-runner-207 kernel: [73940.557697] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:56:06 juju-e4d256-prod-github-runner-207 kernel: [73940.558755] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 01:56:06 juju-e4d256-prod-github-runner-207 kernel: [73940.561307] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 01:56:06 juju-e4d256-prod-github-runner-207 kernel: [73940.562359] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 01:56:06 juju-e4d256-prod-github-runner-207 kernel: [73940.563519] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 01:56:06 juju-e4d256-prod-github-runner-207 kernel: [73940.564677] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 01:56:06 juju-e4d256-prod-github-runner-207 kernel: [73940.565858] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 01:56:06 juju-e4d256-prod-github-runner-207 kernel: [73940.567023] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 01:56:06 juju-e4d256-prod-github-runner-207 kernel: [73940.568187] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 01:56:06 juju-e4d256-prod-github-runner-207 kernel: [73940.569419] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 01:56:06 juju-e4d256-prod-github-runner-207 kernel: [73940.570529] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 01:56:06 juju-e4d256-prod-github-runner-207 kernel: [73940.571720] Call Trace: Aug 23 01:56:06 juju-e4d256-prod-github-runner-207 kernel: [73940.572630] Aug 23 01:56:06 juju-e4d256-prod-github-runner-207 kernel: [73940.573512] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:56:06 juju-e4d256-prod-github-runner-207 kernel: [73940.574550] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:56:06 juju-e4d256-prod-github-runner-207 kernel: [73940.575568] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:56:06 juju-e4d256-prod-github-runner-207 kernel: [73940.576646] ? show_regs.part.0+0x23/0x29 Aug 23 01:56:06 juju-e4d256-prod-github-runner-207 kernel: [73940.577652] ? show_regs.cold+0x8/0xd Aug 23 01:56:06 juju-e4d256-prod-github-runner-207 kernel: [73940.578623] ? watchdog_timer_fn+0x1be/0x220 Aug 23 01:56:06 juju-e4d256-prod-github-runner-207 kernel: [73940.579628] ? lockup_detector_update_enable+0x60/0x60 Aug 23 01:56:06 juju-e4d256-prod-github-runner-207 kernel: [73940.580694] ? __hrtimer_run_queues+0x107/0x230 Aug 23 01:56:06 juju-e4d256-prod-github-runner-207 kernel: [73940.581732] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 01:56:06 juju-e4d256-prod-github-runner-207 kernel: [73940.582754] ? hrtimer_interrupt+0x101/0x220 Aug 23 01:56:06 juju-e4d256-prod-github-runner-207 kernel: [73940.583767] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 01:56:06 juju-e4d256-prod-github-runner-207 kernel: [73940.584832] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 01:56:06 juju-e4d256-prod-github-runner-207 kernel: [73940.586018] Aug 23 01:56:06 juju-e4d256-prod-github-runner-207 kernel: [73940.586919] Aug 23 01:56:06 juju-e4d256-prod-github-runner-207 kernel: [73940.587804] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 01:56:06 juju-e4d256-prod-github-runner-207 kernel: [73940.588936] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:56:06 juju-e4d256-prod-github-runner-207 kernel: [73940.590084] ? _raw_spin_lock+0x22/0x30 Aug 23 01:56:06 juju-e4d256-prod-github-runner-207 kernel: [73940.591100] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:56:06 juju-e4d256-prod-github-runner-207 kernel: [73940.592208] direct_page_fault+0x206/0x310 [kvm] Aug 23 01:56:06 juju-e4d256-prod-github-runner-207 kernel: [73940.593316] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 01:56:06 juju-e4d256-prod-github-runner-207 kernel: [73940.594431] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 01:56:06 juju-e4d256-prod-github-runner-207 kernel: [73940.595517] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 01:56:06 juju-e4d256-prod-github-runner-207 kernel: [73940.596582] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 01:56:06 juju-e4d256-prod-github-runner-207 kernel: [73940.597638] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 01:56:06 juju-e4d256-prod-github-runner-207 kernel: [73940.598721] handle_exit+0x98/0x230 [kvm_amd] Aug 23 01:56:06 juju-e4d256-prod-github-runner-207 kernel: [73940.599692] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 01:56:06 juju-e4d256-prod-github-runner-207 kernel: [73940.600691] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 01:56:06 juju-e4d256-prod-github-runner-207 kernel: [73940.601723] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 01:56:06 juju-e4d256-prod-github-runner-207 kernel: [73940.602717] vcpu_run+0x62/0x2c0 [kvm] Aug 23 01:56:06 juju-e4d256-prod-github-runner-207 kernel: [73940.603598] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 01:56:06 juju-e4d256-prod-github-runner-207 kernel: [73940.604492] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 01:56:06 juju-e4d256-prod-github-runner-207 kernel: [73940.605448] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 01:56:06 juju-e4d256-prod-github-runner-207 kernel: [73940.606344] ? __seccomp_filter+0x4a/0x4a0 Aug 23 01:56:06 juju-e4d256-prod-github-runner-207 kernel: [73940.607167] ? __fget_files+0x86/0xc0 Aug 23 01:56:06 juju-e4d256-prod-github-runner-207 kernel: [73940.607942] __x64_sys_ioctl+0x95/0xd0 Aug 23 01:56:06 juju-e4d256-prod-github-runner-207 kernel: [73940.608702] do_syscall_64+0x5c/0xc0 Aug 23 01:56:06 juju-e4d256-prod-github-runner-207 kernel: [73940.609439] ? do_futex+0x162/0x1f0 Aug 23 01:56:06 juju-e4d256-prod-github-runner-207 kernel: [73940.610213] ? __x64_sys_futex+0x78/0x1e0 Aug 23 01:56:06 juju-e4d256-prod-github-runner-207 kernel: [73940.611001] ? __secure_computing+0xa9/0x120 Aug 23 01:56:06 juju-e4d256-prod-github-runner-207 kernel: [73940.611780] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 01:56:06 juju-e4d256-prod-github-runner-207 kernel: [73940.612639] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:56:06 juju-e4d256-prod-github-runner-207 kernel: [73940.613451] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:56:06 juju-e4d256-prod-github-runner-207 kernel: [73940.614281] ? do_syscall_64+0x69/0xc0 Aug 23 01:56:06 juju-e4d256-prod-github-runner-207 kernel: [73940.615132] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:56:06 juju-e4d256-prod-github-runner-207 kernel: [73940.615925] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:56:06 juju-e4d256-prod-github-runner-207 kernel: [73940.616710] ? do_syscall_64+0x69/0xc0 Aug 23 01:56:06 juju-e4d256-prod-github-runner-207 kernel: [73940.617407] ? do_syscall_64+0x69/0xc0 Aug 23 01:56:06 juju-e4d256-prod-github-runner-207 kernel: [73940.618126] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 01:56:06 juju-e4d256-prod-github-runner-207 kernel: [73940.618925] RIP: 0033:0x7faa5d0edaff Aug 23 01:56:06 juju-e4d256-prod-github-runner-207 kernel: [73940.619620] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 01:56:06 juju-e4d256-prod-github-runner-207 kernel: [73940.621957] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 01:56:06 juju-e4d256-prod-github-runner-207 kernel: [73940.623004] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 01:56:06 juju-e4d256-prod-github-runner-207 kernel: [73940.624027] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 01:56:06 juju-e4d256-prod-github-runner-207 kernel: [73940.625042] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 01:56:06 juju-e4d256-prod-github-runner-207 kernel: [73940.626073] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 01:56:06 juju-e4d256-prod-github-runner-207 kernel: [73940.627096] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 01:56:06 juju-e4d256-prod-github-runner-207 kernel: [73940.628116] Aug 23 01:56:34 juju-e4d256-prod-github-runner-207 kernel: [73968.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 68780s! [qemu-system-x86:6715] Aug 23 01:56:34 juju-e4d256-prod-github-runner-207 kernel: [73968.543095] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 01:56:34 juju-e4d256-prod-github-runner-207 kernel: [73968.543163] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 01:56:34 juju-e4d256-prod-github-runner-207 kernel: [73968.555224] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 01:56:34 juju-e4d256-prod-github-runner-207 kernel: [73968.556492] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 01:56:34 juju-e4d256-prod-github-runner-207 kernel: [73968.557723] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:56:34 juju-e4d256-prod-github-runner-207 kernel: [73968.558780] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 01:56:34 juju-e4d256-prod-github-runner-207 kernel: [73968.561346] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 01:56:34 juju-e4d256-prod-github-runner-207 kernel: [73968.562387] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 01:56:34 juju-e4d256-prod-github-runner-207 kernel: [73968.563550] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 01:56:34 juju-e4d256-prod-github-runner-207 kernel: [73968.564708] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 01:56:34 juju-e4d256-prod-github-runner-207 kernel: [73968.565886] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 01:56:34 juju-e4d256-prod-github-runner-207 kernel: [73968.567049] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 01:56:34 juju-e4d256-prod-github-runner-207 kernel: [73968.568231] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 01:56:34 juju-e4d256-prod-github-runner-207 kernel: [73968.569478] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 01:56:34 juju-e4d256-prod-github-runner-207 kernel: [73968.570586] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 01:56:34 juju-e4d256-prod-github-runner-207 kernel: [73968.571788] Call Trace: Aug 23 01:56:34 juju-e4d256-prod-github-runner-207 kernel: [73968.572703] Aug 23 01:56:34 juju-e4d256-prod-github-runner-207 kernel: [73968.573598] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:56:34 juju-e4d256-prod-github-runner-207 kernel: [73968.574627] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:56:34 juju-e4d256-prod-github-runner-207 kernel: [73968.575655] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:56:34 juju-e4d256-prod-github-runner-207 kernel: [73968.576735] ? show_regs.part.0+0x23/0x29 Aug 23 01:56:34 juju-e4d256-prod-github-runner-207 kernel: [73968.577742] ? show_regs.cold+0x8/0xd Aug 23 01:56:34 juju-e4d256-prod-github-runner-207 kernel: [73968.578713] ? watchdog_timer_fn+0x1be/0x220 Aug 23 01:56:34 juju-e4d256-prod-github-runner-207 kernel: [73968.579720] ? lockup_detector_update_enable+0x60/0x60 Aug 23 01:56:34 juju-e4d256-prod-github-runner-207 kernel: [73968.580791] ? __hrtimer_run_queues+0x107/0x230 Aug 23 01:56:34 juju-e4d256-prod-github-runner-207 kernel: [73968.581828] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 01:56:34 juju-e4d256-prod-github-runner-207 kernel: [73968.582851] ? hrtimer_interrupt+0x101/0x220 Aug 23 01:56:34 juju-e4d256-prod-github-runner-207 kernel: [73968.583865] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 01:56:34 juju-e4d256-prod-github-runner-207 kernel: [73968.584931] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 01:56:34 juju-e4d256-prod-github-runner-207 kernel: [73968.585994] Aug 23 01:56:34 juju-e4d256-prod-github-runner-207 kernel: [73968.586848] Aug 23 01:56:34 juju-e4d256-prod-github-runner-207 kernel: [73968.587683] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 01:56:34 juju-e4d256-prod-github-runner-207 kernel: [73968.588715] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:56:34 juju-e4d256-prod-github-runner-207 kernel: [73968.589764] ? _raw_spin_lock+0x22/0x30 Aug 23 01:56:34 juju-e4d256-prod-github-runner-207 kernel: [73968.590709] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:56:34 juju-e4d256-prod-github-runner-207 kernel: [73968.591736] direct_page_fault+0x206/0x310 [kvm] Aug 23 01:56:34 juju-e4d256-prod-github-runner-207 kernel: [73968.592759] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 01:56:34 juju-e4d256-prod-github-runner-207 kernel: [73968.593781] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 01:56:34 juju-e4d256-prod-github-runner-207 kernel: [73968.594942] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 01:56:34 juju-e4d256-prod-github-runner-207 kernel: [73968.595912] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 01:56:34 juju-e4d256-prod-github-runner-207 kernel: [73968.596865] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 01:56:34 juju-e4d256-prod-github-runner-207 kernel: [73968.597871] handle_exit+0x98/0x230 [kvm_amd] Aug 23 01:56:34 juju-e4d256-prod-github-runner-207 kernel: [73968.598769] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 01:56:34 juju-e4d256-prod-github-runner-207 kernel: [73968.599682] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 01:56:34 juju-e4d256-prod-github-runner-207 kernel: [73968.600607] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 01:56:34 juju-e4d256-prod-github-runner-207 kernel: [73968.601537] vcpu_run+0x62/0x2c0 [kvm] Aug 23 01:56:34 juju-e4d256-prod-github-runner-207 kernel: [73968.602349] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 01:56:34 juju-e4d256-prod-github-runner-207 kernel: [73968.603155] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 01:56:34 juju-e4d256-prod-github-runner-207 kernel: [73968.604014] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 01:56:34 juju-e4d256-prod-github-runner-207 kernel: [73968.604809] ? __seccomp_filter+0x4a/0x4a0 Aug 23 01:56:34 juju-e4d256-prod-github-runner-207 kernel: [73968.605564] ? __fget_files+0x86/0xc0 Aug 23 01:56:34 juju-e4d256-prod-github-runner-207 kernel: [73968.606268] __x64_sys_ioctl+0x95/0xd0 Aug 23 01:56:34 juju-e4d256-prod-github-runner-207 kernel: [73968.606965] do_syscall_64+0x5c/0xc0 Aug 23 01:56:34 juju-e4d256-prod-github-runner-207 kernel: [73968.607626] ? do_futex+0x162/0x1f0 Aug 23 01:56:34 juju-e4d256-prod-github-runner-207 kernel: [73968.608271] ? __x64_sys_futex+0x78/0x1e0 Aug 23 01:56:34 juju-e4d256-prod-github-runner-207 kernel: [73968.608941] ? __secure_computing+0xa9/0x120 Aug 23 01:56:34 juju-e4d256-prod-github-runner-207 kernel: [73968.609642] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 01:56:34 juju-e4d256-prod-github-runner-207 kernel: [73968.610405] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:56:34 juju-e4d256-prod-github-runner-207 kernel: [73968.611125] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:56:34 juju-e4d256-prod-github-runner-207 kernel: [73968.611850] ? do_syscall_64+0x69/0xc0 Aug 23 01:56:34 juju-e4d256-prod-github-runner-207 kernel: [73968.612493] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:56:34 juju-e4d256-prod-github-runner-207 kernel: [73968.613200] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:56:34 juju-e4d256-prod-github-runner-207 kernel: [73968.613908] ? do_syscall_64+0x69/0xc0 Aug 23 01:56:34 juju-e4d256-prod-github-runner-207 kernel: [73968.614530] ? do_syscall_64+0x69/0xc0 Aug 23 01:56:34 juju-e4d256-prod-github-runner-207 kernel: [73968.615149] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 01:56:34 juju-e4d256-prod-github-runner-207 kernel: [73968.615853] RIP: 0033:0x7faa5d0edaff Aug 23 01:56:34 juju-e4d256-prod-github-runner-207 kernel: [73968.616479] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 01:56:34 juju-e4d256-prod-github-runner-207 kernel: [73968.618490] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 01:56:34 juju-e4d256-prod-github-runner-207 kernel: [73968.619403] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 01:56:34 juju-e4d256-prod-github-runner-207 kernel: [73968.620290] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 01:56:34 juju-e4d256-prod-github-runner-207 kernel: [73968.621178] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 01:56:34 juju-e4d256-prod-github-runner-207 kernel: [73968.622085] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 01:56:34 juju-e4d256-prod-github-runner-207 kernel: [73968.622975] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 01:56:34 juju-e4d256-prod-github-runner-207 kernel: [73968.623866] Aug 23 01:56:48 juju-e4d256-prod-github-runner-207 kernel: [73982.120706] rcu: INFO: rcu_sched self-detected stall on CPU Aug 23 01:56:48 juju-e4d256-prod-github-runner-207 kernel: [73982.121715] rcu: 1-....: (18408173 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=8895307 Aug 23 01:56:48 juju-e4d256-prod-github-runner-207 kernel: [73982.122844] (t=18466230 jiffies g=23269 q=62873) Aug 23 01:56:48 juju-e4d256-prod-github-runner-207 kernel: [73982.123630] NMI backtrace for cpu 1 Aug 23 01:56:48 juju-e4d256-prod-github-runner-207 kernel: [73982.124338] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 01:56:48 juju-e4d256-prod-github-runner-207 kernel: [73982.125458] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 01:56:48 juju-e4d256-prod-github-runner-207 kernel: [73982.126521] Call Trace: Aug 23 01:56:48 juju-e4d256-prod-github-runner-207 kernel: [73982.127193] Aug 23 01:56:48 juju-e4d256-prod-github-runner-207 kernel: [73982.127836] show_stack+0x52/0x5c Aug 23 01:56:48 juju-e4d256-prod-github-runner-207 kernel: [73982.128568] dump_stack_lvl+0x4a/0x63 Aug 23 01:56:48 juju-e4d256-prod-github-runner-207 kernel: [73982.129332] dump_stack+0x10/0x16 Aug 23 01:56:48 juju-e4d256-prod-github-runner-207 kernel: [73982.130048] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 23 01:56:48 juju-e4d256-prod-github-runner-207 kernel: [73982.130832] ? lapic_can_unplug_cpu+0x90/0x90 Aug 23 01:56:48 juju-e4d256-prod-github-runner-207 kernel: [73982.131614] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 23 01:56:48 juju-e4d256-prod-github-runner-207 kernel: [73982.132437] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 23 01:56:48 juju-e4d256-prod-github-runner-207 kernel: [73982.133277] trigger_single_cpu_backtrace+0x44/0x4f Aug 23 01:56:48 juju-e4d256-prod-github-runner-207 kernel: [73982.134083] rcu_dump_cpu_stacks+0x102/0x149 Aug 23 01:56:48 juju-e4d256-prod-github-runner-207 kernel: [73982.134858] print_cpu_stall.cold+0x2f/0xe2 Aug 23 01:56:48 juju-e4d256-prod-github-runner-207 kernel: [73982.135620] ? timekeeping_update+0xf7/0x150 Aug 23 01:56:48 juju-e4d256-prod-github-runner-207 kernel: [73982.136393] check_cpu_stall+0x109/0x270 Aug 23 01:56:48 juju-e4d256-prod-github-runner-207 kernel: [73982.137152] rcu_sched_clock_irq+0x9a/0x250 Aug 23 01:56:48 juju-e4d256-prod-github-runner-207 kernel: [73982.137913] update_process_times+0x94/0xd0 Aug 23 01:56:48 juju-e4d256-prod-github-runner-207 kernel: [73982.138674] tick_sched_handle+0x29/0x70 Aug 23 01:56:48 juju-e4d256-prod-github-runner-207 kernel: [73982.139422] tick_sched_timer+0x8c/0xc0 Aug 23 01:56:48 juju-e4d256-prod-github-runner-207 kernel: [73982.140163] ? tick_nohz_handler+0xb0/0xb0 Aug 23 01:56:48 juju-e4d256-prod-github-runner-207 kernel: [73982.140917] __hrtimer_run_queues+0x107/0x230 Aug 23 01:56:48 juju-e4d256-prod-github-runner-207 kernel: [73982.141700] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 01:56:48 juju-e4d256-prod-github-runner-207 kernel: [73982.142473] hrtimer_interrupt+0x101/0x220 Aug 23 01:56:48 juju-e4d256-prod-github-runner-207 kernel: [73982.143236] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 01:56:48 juju-e4d256-prod-github-runner-207 kernel: [73982.144046] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 01:56:48 juju-e4d256-prod-github-runner-207 kernel: [73982.144847] Aug 23 01:56:48 juju-e4d256-prod-github-runner-207 kernel: [73982.145495] Aug 23 01:56:48 juju-e4d256-prod-github-runner-207 kernel: [73982.146123] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 01:56:48 juju-e4d256-prod-github-runner-207 kernel: [73982.146939] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:56:48 juju-e4d256-prod-github-runner-207 kernel: [73982.147820] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 01:56:48 juju-e4d256-prod-github-runner-207 kernel: [73982.150040] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 01:56:48 juju-e4d256-prod-github-runner-207 kernel: [73982.150922] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 01:56:48 juju-e4d256-prod-github-runner-207 kernel: [73982.151917] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 01:56:48 juju-e4d256-prod-github-runner-207 kernel: [73982.152895] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 01:56:48 juju-e4d256-prod-github-runner-207 kernel: [73982.153865] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 01:56:48 juju-e4d256-prod-github-runner-207 kernel: [73982.154819] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 01:56:48 juju-e4d256-prod-github-runner-207 kernel: [73982.155768] ? _raw_spin_lock+0x22/0x30 Aug 23 01:56:48 juju-e4d256-prod-github-runner-207 kernel: [73982.156524] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:56:48 juju-e4d256-prod-github-runner-207 kernel: [73982.157368] direct_page_fault+0x206/0x310 [kvm] Aug 23 01:56:48 juju-e4d256-prod-github-runner-207 kernel: [73982.158205] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 01:56:48 juju-e4d256-prod-github-runner-207 kernel: [73982.159034] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 01:56:48 juju-e4d256-prod-github-runner-207 kernel: [73982.159855] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 01:56:48 juju-e4d256-prod-github-runner-207 kernel: [73982.160661] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 01:56:48 juju-e4d256-prod-github-runner-207 kernel: [73982.161460] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 01:56:48 juju-e4d256-prod-github-runner-207 kernel: [73982.162287] handle_exit+0x98/0x230 [kvm_amd] Aug 23 01:56:48 juju-e4d256-prod-github-runner-207 kernel: [73982.163038] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 01:56:48 juju-e4d256-prod-github-runner-207 kernel: [73982.163824] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 01:56:48 juju-e4d256-prod-github-runner-207 kernel: [73982.164626] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 01:56:48 juju-e4d256-prod-github-runner-207 kernel: [73982.165428] vcpu_run+0x62/0x2c0 [kvm] Aug 23 01:56:48 juju-e4d256-prod-github-runner-207 kernel: [73982.166143] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 01:56:48 juju-e4d256-prod-github-runner-207 kernel: [73982.166874] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 01:56:48 juju-e4d256-prod-github-runner-207 kernel: [73982.167673] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 01:56:48 juju-e4d256-prod-github-runner-207 kernel: [73982.168437] ? __seccomp_filter+0x4a/0x4a0 Aug 23 01:56:48 juju-e4d256-prod-github-runner-207 kernel: [73982.169168] ? __fget_files+0x86/0xc0 Aug 23 01:56:48 juju-e4d256-prod-github-runner-207 kernel: [73982.169860] __x64_sys_ioctl+0x95/0xd0 Aug 23 01:56:48 juju-e4d256-prod-github-runner-207 kernel: [73982.170552] do_syscall_64+0x5c/0xc0 Aug 23 01:56:48 juju-e4d256-prod-github-runner-207 kernel: [73982.171230] ? do_futex+0x162/0x1f0 Aug 23 01:56:48 juju-e4d256-prod-github-runner-207 kernel: [73982.171900] ? __x64_sys_futex+0x78/0x1e0 Aug 23 01:56:48 juju-e4d256-prod-github-runner-207 kernel: [73982.172599] ? __secure_computing+0xa9/0x120 Aug 23 01:56:48 juju-e4d256-prod-github-runner-207 kernel: [73982.173330] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 01:56:48 juju-e4d256-prod-github-runner-207 kernel: [73982.174119] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:56:48 juju-e4d256-prod-github-runner-207 kernel: [73982.174878] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:56:48 juju-e4d256-prod-github-runner-207 kernel: [73982.175635] ? do_syscall_64+0x69/0xc0 Aug 23 01:56:48 juju-e4d256-prod-github-runner-207 kernel: [73982.176324] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:56:48 juju-e4d256-prod-github-runner-207 kernel: [73982.177090] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:56:48 juju-e4d256-prod-github-runner-207 kernel: [73982.177848] ? do_syscall_64+0x69/0xc0 Aug 23 01:56:48 juju-e4d256-prod-github-runner-207 kernel: [73982.178540] ? do_syscall_64+0x69/0xc0 Aug 23 01:56:48 juju-e4d256-prod-github-runner-207 kernel: [73982.179231] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 01:56:48 juju-e4d256-prod-github-runner-207 kernel: [73982.180002] RIP: 0033:0x7faa5d0edaff Aug 23 01:56:48 juju-e4d256-prod-github-runner-207 kernel: [73982.180685] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 01:56:48 juju-e4d256-prod-github-runner-207 kernel: [73982.182801] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 01:56:48 juju-e4d256-prod-github-runner-207 kernel: [73982.183766] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 01:56:48 juju-e4d256-prod-github-runner-207 kernel: [73982.184711] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 01:56:48 juju-e4d256-prod-github-runner-207 kernel: [73982.185676] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 01:56:48 juju-e4d256-prod-github-runner-207 kernel: [73982.186620] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 01:56:48 juju-e4d256-prod-github-runner-207 kernel: [73982.187544] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 01:56:48 juju-e4d256-prod-github-runner-207 kernel: [73982.188461] Aug 23 01:57:14 juju-e4d256-prod-github-runner-207 kernel: [74008.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 68817s! [qemu-system-x86:6715] Aug 23 01:57:14 juju-e4d256-prod-github-runner-207 kernel: [74008.543725] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 01:57:14 juju-e4d256-prod-github-runner-207 kernel: [74008.543969] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 01:57:14 juju-e4d256-prod-github-runner-207 kernel: [74008.556105] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 01:57:14 juju-e4d256-prod-github-runner-207 kernel: [74008.557372] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 01:57:14 juju-e4d256-prod-github-runner-207 kernel: [74008.558592] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:57:14 juju-e4d256-prod-github-runner-207 kernel: [74008.559654] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 01:57:14 juju-e4d256-prod-github-runner-207 kernel: [74008.562208] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 01:57:14 juju-e4d256-prod-github-runner-207 kernel: [74008.563250] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 01:57:14 juju-e4d256-prod-github-runner-207 kernel: [74008.564408] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 01:57:14 juju-e4d256-prod-github-runner-207 kernel: [74008.565582] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 01:57:14 juju-e4d256-prod-github-runner-207 kernel: [74008.566740] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 01:57:14 juju-e4d256-prod-github-runner-207 kernel: [74008.567899] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 01:57:14 juju-e4d256-prod-github-runner-207 kernel: [74008.569072] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 01:57:14 juju-e4d256-prod-github-runner-207 kernel: [74008.570307] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 01:57:14 juju-e4d256-prod-github-runner-207 kernel: [74008.571409] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 01:57:14 juju-e4d256-prod-github-runner-207 kernel: [74008.572600] Call Trace: Aug 23 01:57:14 juju-e4d256-prod-github-runner-207 kernel: [74008.573520] Aug 23 01:57:14 juju-e4d256-prod-github-runner-207 kernel: [74008.574411] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:57:14 juju-e4d256-prod-github-runner-207 kernel: [74008.575441] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:57:14 juju-e4d256-prod-github-runner-207 kernel: [74008.576459] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:57:14 juju-e4d256-prod-github-runner-207 kernel: [74008.577559] ? show_regs.part.0+0x23/0x29 Aug 23 01:57:14 juju-e4d256-prod-github-runner-207 kernel: [74008.578562] ? show_regs.cold+0x8/0xd Aug 23 01:57:14 juju-e4d256-prod-github-runner-207 kernel: [74008.579536] ? watchdog_timer_fn+0x1be/0x220 Aug 23 01:57:14 juju-e4d256-prod-github-runner-207 kernel: [74008.580543] ? lockup_detector_update_enable+0x60/0x60 Aug 23 01:57:14 juju-e4d256-prod-github-runner-207 kernel: [74008.581631] ? __hrtimer_run_queues+0x107/0x230 Aug 23 01:57:14 juju-e4d256-prod-github-runner-207 kernel: [74008.582660] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 01:57:14 juju-e4d256-prod-github-runner-207 kernel: [74008.583687] ? hrtimer_interrupt+0x101/0x220 Aug 23 01:57:14 juju-e4d256-prod-github-runner-207 kernel: [74008.584707] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 01:57:14 juju-e4d256-prod-github-runner-207 kernel: [74008.588030] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 01:57:14 juju-e4d256-prod-github-runner-207 kernel: [74008.589082] Aug 23 01:57:14 juju-e4d256-prod-github-runner-207 kernel: [74008.589936] Aug 23 01:57:14 juju-e4d256-prod-github-runner-207 kernel: [74008.590777] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 01:57:14 juju-e4d256-prod-github-runner-207 kernel: [74008.591808] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:57:14 juju-e4d256-prod-github-runner-207 kernel: [74008.592851] ? _raw_spin_lock+0x22/0x30 Aug 23 01:57:14 juju-e4d256-prod-github-runner-207 kernel: [74008.593801] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:57:14 juju-e4d256-prod-github-runner-207 kernel: [74008.594819] direct_page_fault+0x206/0x310 [kvm] Aug 23 01:57:14 juju-e4d256-prod-github-runner-207 kernel: [74008.595841] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 01:57:14 juju-e4d256-prod-github-runner-207 kernel: [74008.596854] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 01:57:14 juju-e4d256-prod-github-runner-207 kernel: [74008.597860] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 01:57:14 juju-e4d256-prod-github-runner-207 kernel: [74008.598858] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 01:57:14 juju-e4d256-prod-github-runner-207 kernel: [74008.599802] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 01:57:14 juju-e4d256-prod-github-runner-207 kernel: [74008.600800] handle_exit+0x98/0x230 [kvm_amd] Aug 23 01:57:14 juju-e4d256-prod-github-runner-207 kernel: [74008.601694] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 01:57:14 juju-e4d256-prod-github-runner-207 kernel: [74008.602606] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 01:57:14 juju-e4d256-prod-github-runner-207 kernel: [74008.603528] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 01:57:14 juju-e4d256-prod-github-runner-207 kernel: [74008.604435] vcpu_run+0x62/0x2c0 [kvm] Aug 23 01:57:14 juju-e4d256-prod-github-runner-207 kernel: [74008.605277] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 01:57:14 juju-e4d256-prod-github-runner-207 kernel: [74008.606083] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 01:57:14 juju-e4d256-prod-github-runner-207 kernel: [74008.606934] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 01:57:14 juju-e4d256-prod-github-runner-207 kernel: [74008.607727] ? __seccomp_filter+0x4a/0x4a0 Aug 23 01:57:14 juju-e4d256-prod-github-runner-207 kernel: [74008.608467] ? __fget_files+0x86/0xc0 Aug 23 01:57:14 juju-e4d256-prod-github-runner-207 kernel: [74008.609178] __x64_sys_ioctl+0x95/0xd0 Aug 23 01:57:14 juju-e4d256-prod-github-runner-207 kernel: [74008.609878] do_syscall_64+0x5c/0xc0 Aug 23 01:57:14 juju-e4d256-prod-github-runner-207 kernel: [74008.610692] ? do_futex+0x162/0x1f0 Aug 23 01:57:14 juju-e4d256-prod-github-runner-207 kernel: [74008.611340] ? __x64_sys_futex+0x78/0x1e0 Aug 23 01:57:14 juju-e4d256-prod-github-runner-207 kernel: [74008.612010] ? __secure_computing+0xa9/0x120 Aug 23 01:57:14 juju-e4d256-prod-github-runner-207 kernel: [74008.612701] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 01:57:14 juju-e4d256-prod-github-runner-207 kernel: [74008.613464] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:57:14 juju-e4d256-prod-github-runner-207 kernel: [74008.614182] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:57:14 juju-e4d256-prod-github-runner-207 kernel: [74008.614896] ? do_syscall_64+0x69/0xc0 Aug 23 01:57:14 juju-e4d256-prod-github-runner-207 kernel: [74008.615538] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:57:14 juju-e4d256-prod-github-runner-207 kernel: [74008.616237] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:57:14 juju-e4d256-prod-github-runner-207 kernel: [74008.616941] ? do_syscall_64+0x69/0xc0 Aug 23 01:57:14 juju-e4d256-prod-github-runner-207 kernel: [74008.617570] ? do_syscall_64+0x69/0xc0 Aug 23 01:57:14 juju-e4d256-prod-github-runner-207 kernel: [74008.618189] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 01:57:14 juju-e4d256-prod-github-runner-207 kernel: [74008.618891] RIP: 0033:0x7faa5d0edaff Aug 23 01:57:14 juju-e4d256-prod-github-runner-207 kernel: [74008.619543] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 01:57:14 juju-e4d256-prod-github-runner-207 kernel: [74008.621540] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 01:57:14 juju-e4d256-prod-github-runner-207 kernel: [74008.622457] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 01:57:14 juju-e4d256-prod-github-runner-207 kernel: [74008.623344] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 01:57:14 juju-e4d256-prod-github-runner-207 kernel: [74008.624228] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 01:57:14 juju-e4d256-prod-github-runner-207 kernel: [74008.625121] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 01:57:14 juju-e4d256-prod-github-runner-207 kernel: [74008.626012] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 01:57:14 juju-e4d256-prod-github-runner-207 kernel: [74008.626906] Aug 23 01:57:42 juju-e4d256-prod-github-runner-207 kernel: [74036.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 68843s! [qemu-system-x86:6715] Aug 23 01:57:42 juju-e4d256-prod-github-runner-207 kernel: [74036.543100] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 01:57:42 juju-e4d256-prod-github-runner-207 kernel: [74036.543167] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 01:57:42 juju-e4d256-prod-github-runner-207 kernel: [74036.569362] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 01:57:42 juju-e4d256-prod-github-runner-207 kernel: [74036.570659] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 01:57:42 juju-e4d256-prod-github-runner-207 kernel: [74036.574045] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:57:42 juju-e4d256-prod-github-runner-207 kernel: [74036.576617] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 01:57:42 juju-e4d256-prod-github-runner-207 kernel: [74036.581755] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 01:57:42 juju-e4d256-prod-github-runner-207 kernel: [74036.583344] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 01:57:42 juju-e4d256-prod-github-runner-207 kernel: [74036.586057] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 01:57:42 juju-e4d256-prod-github-runner-207 kernel: [74036.589329] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 01:57:42 juju-e4d256-prod-github-runner-207 kernel: [74036.590498] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 01:57:42 juju-e4d256-prod-github-runner-207 kernel: [74036.593604] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 01:57:42 juju-e4d256-prod-github-runner-207 kernel: [74036.594775] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 01:57:42 juju-e4d256-prod-github-runner-207 kernel: [74036.598109] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 01:57:42 juju-e4d256-prod-github-runner-207 kernel: [74036.599229] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 01:57:42 juju-e4d256-prod-github-runner-207 kernel: [74036.602540] Call Trace: Aug 23 01:57:42 juju-e4d256-prod-github-runner-207 kernel: [74036.603456] Aug 23 01:57:42 juju-e4d256-prod-github-runner-207 kernel: [74036.606321] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:57:42 juju-e4d256-prod-github-runner-207 kernel: [74036.607362] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:57:42 juju-e4d256-prod-github-runner-207 kernel: [74036.610613] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:57:42 juju-e4d256-prod-github-runner-207 kernel: [74036.611698] ? show_regs.part.0+0x23/0x29 Aug 23 01:57:42 juju-e4d256-prod-github-runner-207 kernel: [74036.614265] ? show_regs.cold+0x8/0xd Aug 23 01:57:42 juju-e4d256-prod-github-runner-207 kernel: [74036.615769] ? watchdog_timer_fn+0x1be/0x220 Aug 23 01:57:42 juju-e4d256-prod-github-runner-207 kernel: [74036.618841] ? lockup_detector_update_enable+0x60/0x60 Aug 23 01:57:42 juju-e4d256-prod-github-runner-207 kernel: [74036.619930] ? __hrtimer_run_queues+0x107/0x230 Aug 23 01:57:42 juju-e4d256-prod-github-runner-207 kernel: [74036.621455] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 01:57:42 juju-e4d256-prod-github-runner-207 kernel: [74036.623989] ? hrtimer_interrupt+0x101/0x220 Aug 23 01:57:42 juju-e4d256-prod-github-runner-207 kernel: [74036.626066] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 01:57:42 juju-e4d256-prod-github-runner-207 kernel: [74036.628231] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 01:57:42 juju-e4d256-prod-github-runner-207 kernel: [74036.631440] Aug 23 01:57:42 juju-e4d256-prod-github-runner-207 kernel: [74036.632299] Aug 23 01:57:42 juju-e4d256-prod-github-runner-207 kernel: [74036.635214] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 01:57:42 juju-e4d256-prod-github-runner-207 kernel: [74036.636255] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:57:42 juju-e4d256-prod-github-runner-207 kernel: [74036.639478] ? _raw_spin_lock+0x22/0x30 Aug 23 01:57:42 juju-e4d256-prod-github-runner-207 kernel: [74036.640431] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:57:42 juju-e4d256-prod-github-runner-207 kernel: [74036.643480] direct_page_fault+0x206/0x310 [kvm] Aug 23 01:57:42 juju-e4d256-prod-github-runner-207 kernel: [74036.644540] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 01:57:42 juju-e4d256-prod-github-runner-207 kernel: [74036.647558] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 01:57:42 juju-e4d256-prod-github-runner-207 kernel: [74036.648580] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 01:57:42 juju-e4d256-prod-github-runner-207 kernel: [74036.651709] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 01:57:42 juju-e4d256-prod-github-runner-207 kernel: [74036.653183] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 01:57:42 juju-e4d256-prod-github-runner-207 kernel: [74036.655815] handle_exit+0x98/0x230 [kvm_amd] Aug 23 01:57:42 juju-e4d256-prod-github-runner-207 kernel: [74036.656725] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 01:57:42 juju-e4d256-prod-github-runner-207 kernel: [74036.659723] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 01:57:42 juju-e4d256-prod-github-runner-207 kernel: [74036.660678] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 01:57:42 juju-e4d256-prod-github-runner-207 kernel: [74036.663572] vcpu_run+0x62/0x2c0 [kvm] Aug 23 01:57:42 juju-e4d256-prod-github-runner-207 kernel: [74036.664390] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 01:57:42 juju-e4d256-prod-github-runner-207 kernel: [74036.666255] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 01:57:42 juju-e4d256-prod-github-runner-207 kernel: [74036.668254] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 01:57:42 juju-e4d256-prod-github-runner-207 kernel: [74036.670207] ? __seccomp_filter+0x4a/0x4a0 Aug 23 01:57:42 juju-e4d256-prod-github-runner-207 kernel: [74036.671990] ? __fget_files+0x86/0xc0 Aug 23 01:57:42 juju-e4d256-prod-github-runner-207 kernel: [74036.672788] __x64_sys_ioctl+0x95/0xd0 Aug 23 01:57:42 juju-e4d256-prod-github-runner-207 kernel: [74036.674089] do_syscall_64+0x5c/0xc0 Aug 23 01:57:42 juju-e4d256-prod-github-runner-207 kernel: [74036.676293] ? do_futex+0x162/0x1f0 Aug 23 01:57:42 juju-e4d256-prod-github-runner-207 kernel: [74036.677044] ? __x64_sys_futex+0x78/0x1e0 Aug 23 01:57:42 juju-e4d256-prod-github-runner-207 kernel: [74036.679236] ? __secure_computing+0xa9/0x120 Aug 23 01:57:42 juju-e4d256-prod-github-runner-207 kernel: [74036.680597] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 01:57:42 juju-e4d256-prod-github-runner-207 kernel: [74036.682911] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:57:42 juju-e4d256-prod-github-runner-207 kernel: [74036.684335] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:57:42 juju-e4d256-prod-github-runner-207 kernel: [74036.685165] ? do_syscall_64+0x69/0xc0 Aug 23 01:57:42 juju-e4d256-prod-github-runner-207 kernel: [74036.685882] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:57:42 juju-e4d256-prod-github-runner-207 kernel: [74036.686678] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:57:42 juju-e4d256-prod-github-runner-207 kernel: [74036.687466] ? do_syscall_64+0x69/0xc0 Aug 23 01:57:42 juju-e4d256-prod-github-runner-207 kernel: [74036.688174] ? do_syscall_64+0x69/0xc0 Aug 23 01:57:42 juju-e4d256-prod-github-runner-207 kernel: [74036.688889] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 01:57:42 juju-e4d256-prod-github-runner-207 kernel: [74036.689693] RIP: 0033:0x7faa5d0edaff Aug 23 01:57:42 juju-e4d256-prod-github-runner-207 kernel: [74036.690389] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 01:57:42 juju-e4d256-prod-github-runner-207 kernel: [74036.692740] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 01:57:42 juju-e4d256-prod-github-runner-207 kernel: [74036.693797] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 01:57:42 juju-e4d256-prod-github-runner-207 kernel: [74036.694827] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 01:57:42 juju-e4d256-prod-github-runner-207 kernel: [74036.695853] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 01:57:42 juju-e4d256-prod-github-runner-207 kernel: [74036.696893] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 01:57:42 juju-e4d256-prod-github-runner-207 kernel: [74036.697918] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 01:57:42 juju-e4d256-prod-github-runner-207 kernel: [74036.698950] Aug 23 01:58:10 juju-e4d256-prod-github-runner-207 kernel: [74064.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 68869s! [qemu-system-x86:6715] Aug 23 01:58:10 juju-e4d256-prod-github-runner-207 kernel: [74064.543084] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 01:58:10 juju-e4d256-prod-github-runner-207 kernel: [74064.543151] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 01:58:10 juju-e4d256-prod-github-runner-207 kernel: [74064.555202] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 01:58:10 juju-e4d256-prod-github-runner-207 kernel: [74064.556473] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 01:58:10 juju-e4d256-prod-github-runner-207 kernel: [74064.557692] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:58:10 juju-e4d256-prod-github-runner-207 kernel: [74064.558750] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 01:58:10 juju-e4d256-prod-github-runner-207 kernel: [74064.561312] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 01:58:10 juju-e4d256-prod-github-runner-207 kernel: [74064.562357] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 01:58:10 juju-e4d256-prod-github-runner-207 kernel: [74064.563517] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 01:58:10 juju-e4d256-prod-github-runner-207 kernel: [74064.564685] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 01:58:10 juju-e4d256-prod-github-runner-207 kernel: [74064.565852] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 01:58:10 juju-e4d256-prod-github-runner-207 kernel: [74064.567019] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 01:58:10 juju-e4d256-prod-github-runner-207 kernel: [74064.568197] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 01:58:10 juju-e4d256-prod-github-runner-207 kernel: [74064.569434] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 01:58:10 juju-e4d256-prod-github-runner-207 kernel: [74064.570531] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 01:58:10 juju-e4d256-prod-github-runner-207 kernel: [74064.571725] Call Trace: Aug 23 01:58:10 juju-e4d256-prod-github-runner-207 kernel: [74064.572650] Aug 23 01:58:10 juju-e4d256-prod-github-runner-207 kernel: [74064.573537] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:58:10 juju-e4d256-prod-github-runner-207 kernel: [74064.574571] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:58:10 juju-e4d256-prod-github-runner-207 kernel: [74064.575587] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:58:10 juju-e4d256-prod-github-runner-207 kernel: [74064.576675] ? show_regs.part.0+0x23/0x29 Aug 23 01:58:10 juju-e4d256-prod-github-runner-207 kernel: [74064.577674] ? show_regs.cold+0x8/0xd Aug 23 01:58:10 juju-e4d256-prod-github-runner-207 kernel: [74064.578643] ? watchdog_timer_fn+0x1be/0x220 Aug 23 01:58:10 juju-e4d256-prod-github-runner-207 kernel: [74064.579650] ? lockup_detector_update_enable+0x60/0x60 Aug 23 01:58:10 juju-e4d256-prod-github-runner-207 kernel: [74064.580731] ? __hrtimer_run_queues+0x107/0x230 Aug 23 01:58:10 juju-e4d256-prod-github-runner-207 kernel: [74064.581760] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 01:58:10 juju-e4d256-prod-github-runner-207 kernel: [74064.582902] ? hrtimer_interrupt+0x101/0x220 Aug 23 01:58:10 juju-e4d256-prod-github-runner-207 kernel: [74064.583999] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 01:58:10 juju-e4d256-prod-github-runner-207 kernel: [74064.585186] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 01:58:10 juju-e4d256-prod-github-runner-207 kernel: [74064.586349] Aug 23 01:58:10 juju-e4d256-prod-github-runner-207 kernel: [74064.587263] Aug 23 01:58:10 juju-e4d256-prod-github-runner-207 kernel: [74064.588172] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 01:58:10 juju-e4d256-prod-github-runner-207 kernel: [74064.589316] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:58:10 juju-e4d256-prod-github-runner-207 kernel: [74064.590483] ? _raw_spin_lock+0x22/0x30 Aug 23 01:58:10 juju-e4d256-prod-github-runner-207 kernel: [74064.591455] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:58:10 juju-e4d256-prod-github-runner-207 kernel: [74064.592496] direct_page_fault+0x206/0x310 [kvm] Aug 23 01:58:10 juju-e4d256-prod-github-runner-207 kernel: [74064.593531] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 01:58:10 juju-e4d256-prod-github-runner-207 kernel: [74064.594639] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 01:58:10 juju-e4d256-prod-github-runner-207 kernel: [74064.595734] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 01:58:10 juju-e4d256-prod-github-runner-207 kernel: [74064.596846] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 01:58:10 juju-e4d256-prod-github-runner-207 kernel: [74064.597893] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 01:58:10 juju-e4d256-prod-github-runner-207 kernel: [74064.599190] handle_exit+0x98/0x230 [kvm_amd] Aug 23 01:58:10 juju-e4d256-prod-github-runner-207 kernel: [74064.600188] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 01:58:10 juju-e4d256-prod-github-runner-207 kernel: [74064.601193] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 01:58:10 juju-e4d256-prod-github-runner-207 kernel: [74064.602224] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 01:58:10 juju-e4d256-prod-github-runner-207 kernel: [74064.603230] vcpu_run+0x62/0x2c0 [kvm] Aug 23 01:58:10 juju-e4d256-prod-github-runner-207 kernel: [74064.604145] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 01:58:10 juju-e4d256-prod-github-runner-207 kernel: [74064.605038] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 01:58:10 juju-e4d256-prod-github-runner-207 kernel: [74064.605996] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 01:58:10 juju-e4d256-prod-github-runner-207 kernel: [74064.606888] ? __seccomp_filter+0x4a/0x4a0 Aug 23 01:58:10 juju-e4d256-prod-github-runner-207 kernel: [74064.607715] ? __fget_files+0x86/0xc0 Aug 23 01:58:10 juju-e4d256-prod-github-runner-207 kernel: [74064.608513] __x64_sys_ioctl+0x95/0xd0 Aug 23 01:58:10 juju-e4d256-prod-github-runner-207 kernel: [74064.609287] do_syscall_64+0x5c/0xc0 Aug 23 01:58:10 juju-e4d256-prod-github-runner-207 kernel: [74064.610026] ? do_futex+0x162/0x1f0 Aug 23 01:58:10 juju-e4d256-prod-github-runner-207 kernel: [74064.610742] ? __x64_sys_futex+0x78/0x1e0 Aug 23 01:58:10 juju-e4d256-prod-github-runner-207 kernel: [74064.611492] ? __secure_computing+0xa9/0x120 Aug 23 01:58:10 juju-e4d256-prod-github-runner-207 kernel: [74064.612392] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 01:58:10 juju-e4d256-prod-github-runner-207 kernel: [74064.613257] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:58:10 juju-e4d256-prod-github-runner-207 kernel: [74064.614071] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:58:10 juju-e4d256-prod-github-runner-207 kernel: [74064.614881] ? do_syscall_64+0x69/0xc0 Aug 23 01:58:10 juju-e4d256-prod-github-runner-207 kernel: [74064.615598] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:58:10 juju-e4d256-prod-github-runner-207 kernel: [74064.616413] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:58:10 juju-e4d256-prod-github-runner-207 kernel: [74064.617204] ? do_syscall_64+0x69/0xc0 Aug 23 01:58:10 juju-e4d256-prod-github-runner-207 kernel: [74064.617901] ? do_syscall_64+0x69/0xc0 Aug 23 01:58:10 juju-e4d256-prod-github-runner-207 kernel: [74064.618609] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 01:58:10 juju-e4d256-prod-github-runner-207 kernel: [74064.619410] RIP: 0033:0x7faa5d0edaff Aug 23 01:58:10 juju-e4d256-prod-github-runner-207 kernel: [74064.620104] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 01:58:10 juju-e4d256-prod-github-runner-207 kernel: [74064.622524] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 01:58:10 juju-e4d256-prod-github-runner-207 kernel: [74064.623569] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 01:58:10 juju-e4d256-prod-github-runner-207 kernel: [74064.624604] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 01:58:10 juju-e4d256-prod-github-runner-207 kernel: [74064.625630] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 01:58:10 juju-e4d256-prod-github-runner-207 kernel: [74064.626648] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 01:58:10 juju-e4d256-prod-github-runner-207 kernel: [74064.627673] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 01:58:10 juju-e4d256-prod-github-runner-207 kernel: [74064.628722] Aug 23 01:58:38 juju-e4d256-prod-github-runner-207 kernel: [74092.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 68896s! [qemu-system-x86:6715] Aug 23 01:58:38 juju-e4d256-prod-github-runner-207 kernel: [74092.543757] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 01:58:38 juju-e4d256-prod-github-runner-207 kernel: [74092.544064] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 01:58:38 juju-e4d256-prod-github-runner-207 kernel: [74092.556374] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 01:58:38 juju-e4d256-prod-github-runner-207 kernel: [74092.557650] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 01:58:38 juju-e4d256-prod-github-runner-207 kernel: [74092.558873] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:58:38 juju-e4d256-prod-github-runner-207 kernel: [74092.560025] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 01:58:38 juju-e4d256-prod-github-runner-207 kernel: [74092.562592] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 01:58:38 juju-e4d256-prod-github-runner-207 kernel: [74092.563643] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 01:58:38 juju-e4d256-prod-github-runner-207 kernel: [74092.564815] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 01:58:38 juju-e4d256-prod-github-runner-207 kernel: [74092.565975] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 01:58:38 juju-e4d256-prod-github-runner-207 kernel: [74092.567141] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 01:58:38 juju-e4d256-prod-github-runner-207 kernel: [74092.568320] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 01:58:38 juju-e4d256-prod-github-runner-207 kernel: [74092.569497] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 01:58:38 juju-e4d256-prod-github-runner-207 kernel: [74092.570732] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 01:58:38 juju-e4d256-prod-github-runner-207 kernel: [74092.571843] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 01:58:38 juju-e4d256-prod-github-runner-207 kernel: [74092.573040] Call Trace: Aug 23 01:58:38 juju-e4d256-prod-github-runner-207 kernel: [74092.573959] Aug 23 01:58:38 juju-e4d256-prod-github-runner-207 kernel: [74092.574850] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:58:38 juju-e4d256-prod-github-runner-207 kernel: [74092.575896] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:58:38 juju-e4d256-prod-github-runner-207 kernel: [74092.576918] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:58:38 juju-e4d256-prod-github-runner-207 kernel: [74092.578008] ? show_regs.part.0+0x23/0x29 Aug 23 01:58:38 juju-e4d256-prod-github-runner-207 kernel: [74092.579007] ? show_regs.cold+0x8/0xd Aug 23 01:58:38 juju-e4d256-prod-github-runner-207 kernel: [74092.579996] ? watchdog_timer_fn+0x1be/0x220 Aug 23 01:58:38 juju-e4d256-prod-github-runner-207 kernel: [74092.581004] ? lockup_detector_update_enable+0x60/0x60 Aug 23 01:58:38 juju-e4d256-prod-github-runner-207 kernel: [74092.582067] ? __hrtimer_run_queues+0x107/0x230 Aug 23 01:58:38 juju-e4d256-prod-github-runner-207 kernel: [74092.583100] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 01:58:38 juju-e4d256-prod-github-runner-207 kernel: [74092.584138] ? hrtimer_interrupt+0x101/0x220 Aug 23 01:58:38 juju-e4d256-prod-github-runner-207 kernel: [74092.585154] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 01:58:38 juju-e4d256-prod-github-runner-207 kernel: [74092.586222] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 01:58:38 juju-e4d256-prod-github-runner-207 kernel: [74092.587268] Aug 23 01:58:38 juju-e4d256-prod-github-runner-207 kernel: [74092.588129] Aug 23 01:58:38 juju-e4d256-prod-github-runner-207 kernel: [74092.588966] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 01:58:38 juju-e4d256-prod-github-runner-207 kernel: [74092.590001] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:58:38 juju-e4d256-prod-github-runner-207 kernel: [74092.591040] ? _raw_spin_lock+0x22/0x30 Aug 23 01:58:38 juju-e4d256-prod-github-runner-207 kernel: [74092.591999] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:58:38 juju-e4d256-prod-github-runner-207 kernel: [74092.593018] direct_page_fault+0x206/0x310 [kvm] Aug 23 01:58:38 juju-e4d256-prod-github-runner-207 kernel: [74092.594042] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 01:58:38 juju-e4d256-prod-github-runner-207 kernel: [74092.595053] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 01:58:38 juju-e4d256-prod-github-runner-207 kernel: [74092.596074] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 01:58:38 juju-e4d256-prod-github-runner-207 kernel: [74092.597061] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 01:58:38 juju-e4d256-prod-github-runner-207 kernel: [74092.598007] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 01:58:38 juju-e4d256-prod-github-runner-207 kernel: [74092.598984] handle_exit+0x98/0x230 [kvm_amd] Aug 23 01:58:38 juju-e4d256-prod-github-runner-207 kernel: [74092.599886] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 01:58:38 juju-e4d256-prod-github-runner-207 kernel: [74092.600798] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 01:58:38 juju-e4d256-prod-github-runner-207 kernel: [74092.601725] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 01:58:38 juju-e4d256-prod-github-runner-207 kernel: [74092.602625] vcpu_run+0x62/0x2c0 [kvm] Aug 23 01:58:38 juju-e4d256-prod-github-runner-207 kernel: [74092.603434] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 01:58:38 juju-e4d256-prod-github-runner-207 kernel: [74092.604248] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 01:58:38 juju-e4d256-prod-github-runner-207 kernel: [74092.605102] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 01:58:38 juju-e4d256-prod-github-runner-207 kernel: [74092.605901] ? __seccomp_filter+0x4a/0x4a0 Aug 23 01:58:38 juju-e4d256-prod-github-runner-207 kernel: [74092.606642] ? __fget_files+0x86/0xc0 Aug 23 01:58:38 juju-e4d256-prod-github-runner-207 kernel: [74092.607348] __x64_sys_ioctl+0x95/0xd0 Aug 23 01:58:38 juju-e4d256-prod-github-runner-207 kernel: [74092.608048] do_syscall_64+0x5c/0xc0 Aug 23 01:58:38 juju-e4d256-prod-github-runner-207 kernel: [74092.608717] ? do_futex+0x162/0x1f0 Aug 23 01:58:38 juju-e4d256-prod-github-runner-207 kernel: [74092.609366] ? __x64_sys_futex+0x78/0x1e0 Aug 23 01:58:38 juju-e4d256-prod-github-runner-207 kernel: [74092.610037] ? __secure_computing+0xa9/0x120 Aug 23 01:58:38 juju-e4d256-prod-github-runner-207 kernel: [74092.610724] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 01:58:38 juju-e4d256-prod-github-runner-207 kernel: [74092.611481] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:58:38 juju-e4d256-prod-github-runner-207 kernel: [74092.612210] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:58:38 juju-e4d256-prod-github-runner-207 kernel: [74092.612927] ? do_syscall_64+0x69/0xc0 Aug 23 01:58:38 juju-e4d256-prod-github-runner-207 kernel: [74092.613570] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:58:38 juju-e4d256-prod-github-runner-207 kernel: [74092.614271] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:58:38 juju-e4d256-prod-github-runner-207 kernel: [74092.614966] ? do_syscall_64+0x69/0xc0 Aug 23 01:58:38 juju-e4d256-prod-github-runner-207 kernel: [74092.615600] ? do_syscall_64+0x69/0xc0 Aug 23 01:58:38 juju-e4d256-prod-github-runner-207 kernel: [74092.616240] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 01:58:38 juju-e4d256-prod-github-runner-207 kernel: [74092.616940] RIP: 0033:0x7faa5d0edaff Aug 23 01:58:38 juju-e4d256-prod-github-runner-207 kernel: [74092.617572] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 01:58:38 juju-e4d256-prod-github-runner-207 kernel: [74092.619546] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 01:58:38 juju-e4d256-prod-github-runner-207 kernel: [74092.620469] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 01:58:38 juju-e4d256-prod-github-runner-207 kernel: [74092.621352] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 01:58:38 juju-e4d256-prod-github-runner-207 kernel: [74092.622234] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 01:58:38 juju-e4d256-prod-github-runner-207 kernel: [74092.623116] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 01:58:38 juju-e4d256-prod-github-runner-207 kernel: [74092.624010] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 01:58:38 juju-e4d256-prod-github-runner-207 kernel: [74092.624903] Aug 23 01:59:06 juju-e4d256-prod-github-runner-207 kernel: [74120.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 68922s! [qemu-system-x86:6715] Aug 23 01:59:06 juju-e4d256-prod-github-runner-207 kernel: [74120.543095] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 01:59:06 juju-e4d256-prod-github-runner-207 kernel: [74120.543163] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 01:59:06 juju-e4d256-prod-github-runner-207 kernel: [74120.555584] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 01:59:06 juju-e4d256-prod-github-runner-207 kernel: [74120.556849] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 01:59:06 juju-e4d256-prod-github-runner-207 kernel: [74120.558066] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:59:06 juju-e4d256-prod-github-runner-207 kernel: [74120.559122] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 01:59:06 juju-e4d256-prod-github-runner-207 kernel: [74120.561679] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 01:59:06 juju-e4d256-prod-github-runner-207 kernel: [74120.562722] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 01:59:06 juju-e4d256-prod-github-runner-207 kernel: [74120.563967] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 01:59:06 juju-e4d256-prod-github-runner-207 kernel: [74120.565220] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 01:59:06 juju-e4d256-prod-github-runner-207 kernel: [74120.566522] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 01:59:06 juju-e4d256-prod-github-runner-207 kernel: [74120.567726] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 01:59:06 juju-e4d256-prod-github-runner-207 kernel: [74120.568898] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 01:59:06 juju-e4d256-prod-github-runner-207 kernel: [74120.570133] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 01:59:06 juju-e4d256-prod-github-runner-207 kernel: [74120.571236] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 01:59:06 juju-e4d256-prod-github-runner-207 kernel: [74120.572443] Call Trace: Aug 23 01:59:06 juju-e4d256-prod-github-runner-207 kernel: [74120.573355] Aug 23 01:59:06 juju-e4d256-prod-github-runner-207 kernel: [74120.574244] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:59:06 juju-e4d256-prod-github-runner-207 kernel: [74120.575277] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:59:06 juju-e4d256-prod-github-runner-207 kernel: [74120.576314] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:59:06 juju-e4d256-prod-github-runner-207 kernel: [74120.577393] ? show_regs.part.0+0x23/0x29 Aug 23 01:59:06 juju-e4d256-prod-github-runner-207 kernel: [74120.578389] ? show_regs.cold+0x8/0xd Aug 23 01:59:06 juju-e4d256-prod-github-runner-207 kernel: [74120.579360] ? watchdog_timer_fn+0x1be/0x220 Aug 23 01:59:06 juju-e4d256-prod-github-runner-207 kernel: [74120.580374] ? lockup_detector_update_enable+0x60/0x60 Aug 23 01:59:06 juju-e4d256-prod-github-runner-207 kernel: [74120.581525] ? __hrtimer_run_queues+0x107/0x230 Aug 23 01:59:06 juju-e4d256-prod-github-runner-207 kernel: [74120.582783] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 01:59:06 juju-e4d256-prod-github-runner-207 kernel: [74120.583842] ? hrtimer_interrupt+0x101/0x220 Aug 23 01:59:06 juju-e4d256-prod-github-runner-207 kernel: [74120.584870] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 01:59:06 juju-e4d256-prod-github-runner-207 kernel: [74120.586013] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 01:59:06 juju-e4d256-prod-github-runner-207 kernel: [74120.587275] Aug 23 01:59:06 juju-e4d256-prod-github-runner-207 kernel: [74120.588173] Aug 23 01:59:06 juju-e4d256-prod-github-runner-207 kernel: [74120.589127] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 01:59:06 juju-e4d256-prod-github-runner-207 kernel: [74120.590179] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:59:06 juju-e4d256-prod-github-runner-207 kernel: [74120.591278] ? _raw_spin_lock+0x22/0x30 Aug 23 01:59:06 juju-e4d256-prod-github-runner-207 kernel: [74120.592249] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:59:06 juju-e4d256-prod-github-runner-207 kernel: [74120.593284] direct_page_fault+0x206/0x310 [kvm] Aug 23 01:59:06 juju-e4d256-prod-github-runner-207 kernel: [74120.594310] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 01:59:06 juju-e4d256-prod-github-runner-207 kernel: [74120.595328] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 01:59:06 juju-e4d256-prod-github-runner-207 kernel: [74120.596363] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 01:59:06 juju-e4d256-prod-github-runner-207 kernel: [74120.597410] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 01:59:06 juju-e4d256-prod-github-runner-207 kernel: [74120.598406] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 01:59:06 juju-e4d256-prod-github-runner-207 kernel: [74120.599522] handle_exit+0x98/0x230 [kvm_amd] Aug 23 01:59:06 juju-e4d256-prod-github-runner-207 kernel: [74120.600492] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 01:59:06 juju-e4d256-prod-github-runner-207 kernel: [74120.601421] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 01:59:06 juju-e4d256-prod-github-runner-207 kernel: [74120.602352] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 01:59:06 juju-e4d256-prod-github-runner-207 kernel: [74120.603264] vcpu_run+0x62/0x2c0 [kvm] Aug 23 01:59:06 juju-e4d256-prod-github-runner-207 kernel: [74120.604105] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 01:59:06 juju-e4d256-prod-github-runner-207 kernel: [74120.604986] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 01:59:06 juju-e4d256-prod-github-runner-207 kernel: [74120.605923] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 01:59:06 juju-e4d256-prod-github-runner-207 kernel: [74120.606811] ? __seccomp_filter+0x4a/0x4a0 Aug 23 01:59:06 juju-e4d256-prod-github-runner-207 kernel: [74120.607592] ? __fget_files+0x86/0xc0 Aug 23 01:59:06 juju-e4d256-prod-github-runner-207 kernel: [74120.608302] __x64_sys_ioctl+0x95/0xd0 Aug 23 01:59:06 juju-e4d256-prod-github-runner-207 kernel: [74120.608995] do_syscall_64+0x5c/0xc0 Aug 23 01:59:06 juju-e4d256-prod-github-runner-207 kernel: [74120.609661] ? do_futex+0x162/0x1f0 Aug 23 01:59:06 juju-e4d256-prod-github-runner-207 kernel: [74120.610310] ? __x64_sys_futex+0x78/0x1e0 Aug 23 01:59:06 juju-e4d256-prod-github-runner-207 kernel: [74120.610985] ? __secure_computing+0xa9/0x120 Aug 23 01:59:06 juju-e4d256-prod-github-runner-207 kernel: [74120.611700] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 01:59:06 juju-e4d256-prod-github-runner-207 kernel: [74120.612463] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:59:06 juju-e4d256-prod-github-runner-207 kernel: [74120.613248] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:59:06 juju-e4d256-prod-github-runner-207 kernel: [74120.614013] ? do_syscall_64+0x69/0xc0 Aug 23 01:59:06 juju-e4d256-prod-github-runner-207 kernel: [74120.614707] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:59:06 juju-e4d256-prod-github-runner-207 kernel: [74120.615546] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:59:06 juju-e4d256-prod-github-runner-207 kernel: [74120.616252] ? do_syscall_64+0x69/0xc0 Aug 23 01:59:06 juju-e4d256-prod-github-runner-207 kernel: [74120.616879] ? do_syscall_64+0x69/0xc0 Aug 23 01:59:06 juju-e4d256-prod-github-runner-207 kernel: [74120.617510] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 01:59:06 juju-e4d256-prod-github-runner-207 kernel: [74120.618218] RIP: 0033:0x7faa5d0edaff Aug 23 01:59:06 juju-e4d256-prod-github-runner-207 kernel: [74120.618862] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 01:59:06 juju-e4d256-prod-github-runner-207 kernel: [74120.620865] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 01:59:06 juju-e4d256-prod-github-runner-207 kernel: [74120.621785] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 01:59:06 juju-e4d256-prod-github-runner-207 kernel: [74120.622750] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 01:59:06 juju-e4d256-prod-github-runner-207 kernel: [74120.623667] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 01:59:06 juju-e4d256-prod-github-runner-207 kernel: [74120.624618] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 01:59:06 juju-e4d256-prod-github-runner-207 kernel: [74120.625515] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 01:59:06 juju-e4d256-prod-github-runner-207 kernel: [74120.626425] Aug 23 01:59:34 juju-e4d256-prod-github-runner-207 kernel: [74148.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 68948s! [qemu-system-x86:6715] Aug 23 01:59:34 juju-e4d256-prod-github-runner-207 kernel: [74148.543094] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 01:59:34 juju-e4d256-prod-github-runner-207 kernel: [74148.543175] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 01:59:34 juju-e4d256-prod-github-runner-207 kernel: [74148.555185] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 01:59:34 juju-e4d256-prod-github-runner-207 kernel: [74148.556451] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 01:59:34 juju-e4d256-prod-github-runner-207 kernel: [74148.557674] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:59:34 juju-e4d256-prod-github-runner-207 kernel: [74148.558735] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 01:59:34 juju-e4d256-prod-github-runner-207 kernel: [74148.561286] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 01:59:34 juju-e4d256-prod-github-runner-207 kernel: [74148.562327] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 01:59:34 juju-e4d256-prod-github-runner-207 kernel: [74148.563499] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 01:59:34 juju-e4d256-prod-github-runner-207 kernel: [74148.564656] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 01:59:34 juju-e4d256-prod-github-runner-207 kernel: [74148.565826] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 01:59:34 juju-e4d256-prod-github-runner-207 kernel: [74148.566985] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 01:59:34 juju-e4d256-prod-github-runner-207 kernel: [74148.568162] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 01:59:34 juju-e4d256-prod-github-runner-207 kernel: [74148.569393] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 01:59:34 juju-e4d256-prod-github-runner-207 kernel: [74148.570491] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 01:59:34 juju-e4d256-prod-github-runner-207 kernel: [74148.571692] Call Trace: Aug 23 01:59:34 juju-e4d256-prod-github-runner-207 kernel: [74148.572605] Aug 23 01:59:34 juju-e4d256-prod-github-runner-207 kernel: [74148.573557] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:59:34 juju-e4d256-prod-github-runner-207 kernel: [74148.574586] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 01:59:34 juju-e4d256-prod-github-runner-207 kernel: [74148.575636] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:59:34 juju-e4d256-prod-github-runner-207 kernel: [74148.576710] ? show_regs.part.0+0x23/0x29 Aug 23 01:59:34 juju-e4d256-prod-github-runner-207 kernel: [74148.577852] ? show_regs.cold+0x8/0xd Aug 23 01:59:34 juju-e4d256-prod-github-runner-207 kernel: [74148.578952] ? watchdog_timer_fn+0x1be/0x220 Aug 23 01:59:34 juju-e4d256-prod-github-runner-207 kernel: [74148.579978] ? lockup_detector_update_enable+0x60/0x60 Aug 23 01:59:34 juju-e4d256-prod-github-runner-207 kernel: [74148.581039] ? __hrtimer_run_queues+0x107/0x230 Aug 23 01:59:34 juju-e4d256-prod-github-runner-207 kernel: [74148.582065] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 01:59:34 juju-e4d256-prod-github-runner-207 kernel: [74148.583131] ? hrtimer_interrupt+0x101/0x220 Aug 23 01:59:34 juju-e4d256-prod-github-runner-207 kernel: [74148.584231] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 01:59:34 juju-e4d256-prod-github-runner-207 kernel: [74148.585296] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 01:59:34 juju-e4d256-prod-github-runner-207 kernel: [74148.586338] Aug 23 01:59:34 juju-e4d256-prod-github-runner-207 kernel: [74148.587201] Aug 23 01:59:34 juju-e4d256-prod-github-runner-207 kernel: [74148.588037] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 01:59:34 juju-e4d256-prod-github-runner-207 kernel: [74148.589086] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:59:34 juju-e4d256-prod-github-runner-207 kernel: [74148.590125] ? _raw_spin_lock+0x22/0x30 Aug 23 01:59:34 juju-e4d256-prod-github-runner-207 kernel: [74148.591245] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:59:34 juju-e4d256-prod-github-runner-207 kernel: [74148.592275] direct_page_fault+0x206/0x310 [kvm] Aug 23 01:59:34 juju-e4d256-prod-github-runner-207 kernel: [74148.593303] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 01:59:34 juju-e4d256-prod-github-runner-207 kernel: [74148.594311] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 01:59:34 juju-e4d256-prod-github-runner-207 kernel: [74148.595330] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 01:59:34 juju-e4d256-prod-github-runner-207 kernel: [74148.596299] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 01:59:34 juju-e4d256-prod-github-runner-207 kernel: [74148.597244] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 01:59:34 juju-e4d256-prod-github-runner-207 kernel: [74148.598220] handle_exit+0x98/0x230 [kvm_amd] Aug 23 01:59:34 juju-e4d256-prod-github-runner-207 kernel: [74148.599115] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 01:59:34 juju-e4d256-prod-github-runner-207 kernel: [74148.600035] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 01:59:34 juju-e4d256-prod-github-runner-207 kernel: [74148.600956] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 01:59:34 juju-e4d256-prod-github-runner-207 kernel: [74148.601858] vcpu_run+0x62/0x2c0 [kvm] Aug 23 01:59:34 juju-e4d256-prod-github-runner-207 kernel: [74148.602668] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 01:59:34 juju-e4d256-prod-github-runner-207 kernel: [74148.603487] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 01:59:34 juju-e4d256-prod-github-runner-207 kernel: [74148.604341] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 01:59:34 juju-e4d256-prod-github-runner-207 kernel: [74148.605137] ? __seccomp_filter+0x4a/0x4a0 Aug 23 01:59:34 juju-e4d256-prod-github-runner-207 kernel: [74148.605879] ? __fget_files+0x86/0xc0 Aug 23 01:59:34 juju-e4d256-prod-github-runner-207 kernel: [74148.606582] __x64_sys_ioctl+0x95/0xd0 Aug 23 01:59:34 juju-e4d256-prod-github-runner-207 kernel: [74148.607290] do_syscall_64+0x5c/0xc0 Aug 23 01:59:34 juju-e4d256-prod-github-runner-207 kernel: [74148.607956] ? do_futex+0x162/0x1f0 Aug 23 01:59:34 juju-e4d256-prod-github-runner-207 kernel: [74148.608606] ? __x64_sys_futex+0x78/0x1e0 Aug 23 01:59:34 juju-e4d256-prod-github-runner-207 kernel: [74148.609280] ? __secure_computing+0xa9/0x120 Aug 23 01:59:34 juju-e4d256-prod-github-runner-207 kernel: [74148.609974] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 01:59:34 juju-e4d256-prod-github-runner-207 kernel: [74148.610731] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:59:34 juju-e4d256-prod-github-runner-207 kernel: [74148.611458] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:59:34 juju-e4d256-prod-github-runner-207 kernel: [74148.612176] ? do_syscall_64+0x69/0xc0 Aug 23 01:59:34 juju-e4d256-prod-github-runner-207 kernel: [74148.612819] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:59:34 juju-e4d256-prod-github-runner-207 kernel: [74148.613521] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:59:34 juju-e4d256-prod-github-runner-207 kernel: [74148.614215] ? do_syscall_64+0x69/0xc0 Aug 23 01:59:34 juju-e4d256-prod-github-runner-207 kernel: [74148.614839] ? do_syscall_64+0x69/0xc0 Aug 23 01:59:34 juju-e4d256-prod-github-runner-207 kernel: [74148.615470] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 01:59:34 juju-e4d256-prod-github-runner-207 kernel: [74148.616175] RIP: 0033:0x7faa5d0edaff Aug 23 01:59:34 juju-e4d256-prod-github-runner-207 kernel: [74148.616799] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 01:59:34 juju-e4d256-prod-github-runner-207 kernel: [74148.618777] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 01:59:34 juju-e4d256-prod-github-runner-207 kernel: [74148.619695] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 01:59:34 juju-e4d256-prod-github-runner-207 kernel: [74148.620585] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 01:59:34 juju-e4d256-prod-github-runner-207 kernel: [74148.621475] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 01:59:34 juju-e4d256-prod-github-runner-207 kernel: [74148.622361] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 01:59:34 juju-e4d256-prod-github-runner-207 kernel: [74148.623262] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 01:59:34 juju-e4d256-prod-github-runner-207 kernel: [74148.624155] Aug 23 01:59:48 juju-e4d256-prod-github-runner-207 kernel: [74162.132706] rcu: INFO: rcu_sched self-detected stall on CPU Aug 23 01:59:48 juju-e4d256-prod-github-runner-207 kernel: [74162.133687] rcu: 1-....: (18453020 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=8917286 Aug 23 01:59:48 juju-e4d256-prod-github-runner-207 kernel: [74162.134805] (t=18511233 jiffies g=23269 q=62973) Aug 23 01:59:48 juju-e4d256-prod-github-runner-207 kernel: [74162.135603] NMI backtrace for cpu 1 Aug 23 01:59:48 juju-e4d256-prod-github-runner-207 kernel: [74162.136312] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 01:59:48 juju-e4d256-prod-github-runner-207 kernel: [74162.137413] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 01:59:48 juju-e4d256-prod-github-runner-207 kernel: [74162.138471] Call Trace: Aug 23 01:59:48 juju-e4d256-prod-github-runner-207 kernel: [74162.139156] Aug 23 01:59:48 juju-e4d256-prod-github-runner-207 kernel: [74162.139799] show_stack+0x52/0x5c Aug 23 01:59:48 juju-e4d256-prod-github-runner-207 kernel: [74162.140528] dump_stack_lvl+0x4a/0x63 Aug 23 01:59:48 juju-e4d256-prod-github-runner-207 kernel: [74162.141276] dump_stack+0x10/0x16 Aug 23 01:59:48 juju-e4d256-prod-github-runner-207 kernel: [74162.141995] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 23 01:59:48 juju-e4d256-prod-github-runner-207 kernel: [74162.142773] ? lapic_can_unplug_cpu+0x90/0x90 Aug 23 01:59:48 juju-e4d256-prod-github-runner-207 kernel: [74162.143558] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 23 01:59:48 juju-e4d256-prod-github-runner-207 kernel: [74162.144376] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 23 01:59:48 juju-e4d256-prod-github-runner-207 kernel: [74162.145199] trigger_single_cpu_backtrace+0x44/0x4f Aug 23 01:59:48 juju-e4d256-prod-github-runner-207 kernel: [74162.146009] rcu_dump_cpu_stacks+0x102/0x149 Aug 23 01:59:48 juju-e4d256-prod-github-runner-207 kernel: [74162.146780] print_cpu_stall.cold+0x2f/0xe2 Aug 23 01:59:48 juju-e4d256-prod-github-runner-207 kernel: [74162.147552] ? timekeeping_update+0xf7/0x150 Aug 23 01:59:48 juju-e4d256-prod-github-runner-207 kernel: [74162.148320] check_cpu_stall+0x109/0x270 Aug 23 01:59:48 juju-e4d256-prod-github-runner-207 kernel: [74162.149064] rcu_sched_clock_irq+0x9a/0x250 Aug 23 01:59:48 juju-e4d256-prod-github-runner-207 kernel: [74162.149824] update_process_times+0x94/0xd0 Aug 23 01:59:48 juju-e4d256-prod-github-runner-207 kernel: [74162.150582] tick_sched_handle+0x29/0x70 Aug 23 01:59:48 juju-e4d256-prod-github-runner-207 kernel: [74162.151355] tick_sched_timer+0x8c/0xc0 Aug 23 01:59:48 juju-e4d256-prod-github-runner-207 kernel: [74162.152099] ? tick_nohz_handler+0xb0/0xb0 Aug 23 01:59:48 juju-e4d256-prod-github-runner-207 kernel: [74162.152853] __hrtimer_run_queues+0x107/0x230 Aug 23 01:59:48 juju-e4d256-prod-github-runner-207 kernel: [74162.153625] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 01:59:48 juju-e4d256-prod-github-runner-207 kernel: [74162.154400] hrtimer_interrupt+0x101/0x220 Aug 23 01:59:48 juju-e4d256-prod-github-runner-207 kernel: [74162.155173] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 01:59:48 juju-e4d256-prod-github-runner-207 kernel: [74162.155985] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 01:59:48 juju-e4d256-prod-github-runner-207 kernel: [74162.156787] Aug 23 01:59:48 juju-e4d256-prod-github-runner-207 kernel: [74162.157420] Aug 23 01:59:48 juju-e4d256-prod-github-runner-207 kernel: [74162.158049] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 01:59:48 juju-e4d256-prod-github-runner-207 kernel: [74162.158867] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 01:59:48 juju-e4d256-prod-github-runner-207 kernel: [74162.159753] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 01:59:48 juju-e4d256-prod-github-runner-207 kernel: [74162.161953] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 01:59:48 juju-e4d256-prod-github-runner-207 kernel: [74162.162826] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 01:59:48 juju-e4d256-prod-github-runner-207 kernel: [74162.163827] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 01:59:48 juju-e4d256-prod-github-runner-207 kernel: [74162.164804] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 01:59:48 juju-e4d256-prod-github-runner-207 kernel: [74162.165770] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 01:59:48 juju-e4d256-prod-github-runner-207 kernel: [74162.166722] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 01:59:48 juju-e4d256-prod-github-runner-207 kernel: [74162.167685] ? _raw_spin_lock+0x22/0x30 Aug 23 01:59:48 juju-e4d256-prod-github-runner-207 kernel: [74162.168444] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 01:59:48 juju-e4d256-prod-github-runner-207 kernel: [74162.169281] direct_page_fault+0x206/0x310 [kvm] Aug 23 01:59:48 juju-e4d256-prod-github-runner-207 kernel: [74162.170119] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 01:59:48 juju-e4d256-prod-github-runner-207 kernel: [74162.170950] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 01:59:48 juju-e4d256-prod-github-runner-207 kernel: [74162.171779] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 01:59:48 juju-e4d256-prod-github-runner-207 kernel: [74162.172587] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 01:59:48 juju-e4d256-prod-github-runner-207 kernel: [74162.173377] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 01:59:48 juju-e4d256-prod-github-runner-207 kernel: [74162.174202] handle_exit+0x98/0x230 [kvm_amd] Aug 23 01:59:48 juju-e4d256-prod-github-runner-207 kernel: [74162.174954] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 01:59:48 juju-e4d256-prod-github-runner-207 kernel: [74162.175741] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 01:59:48 juju-e4d256-prod-github-runner-207 kernel: [74162.176538] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 01:59:48 juju-e4d256-prod-github-runner-207 kernel: [74162.177324] vcpu_run+0x62/0x2c0 [kvm] Aug 23 01:59:48 juju-e4d256-prod-github-runner-207 kernel: [74162.178038] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 01:59:48 juju-e4d256-prod-github-runner-207 kernel: [74162.178771] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 01:59:48 juju-e4d256-prod-github-runner-207 kernel: [74162.179581] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 01:59:48 juju-e4d256-prod-github-runner-207 kernel: [74162.180346] ? __seccomp_filter+0x4a/0x4a0 Aug 23 01:59:48 juju-e4d256-prod-github-runner-207 kernel: [74162.181066] ? __fget_files+0x86/0xc0 Aug 23 01:59:48 juju-e4d256-prod-github-runner-207 kernel: [74162.181757] __x64_sys_ioctl+0x95/0xd0 Aug 23 01:59:48 juju-e4d256-prod-github-runner-207 kernel: [74162.182451] do_syscall_64+0x5c/0xc0 Aug 23 01:59:48 juju-e4d256-prod-github-runner-207 kernel: [74162.183139] ? do_futex+0x162/0x1f0 Aug 23 01:59:48 juju-e4d256-prod-github-runner-207 kernel: [74162.183811] ? __x64_sys_futex+0x78/0x1e0 Aug 23 01:59:48 juju-e4d256-prod-github-runner-207 kernel: [74162.184512] ? __secure_computing+0xa9/0x120 Aug 23 01:59:48 juju-e4d256-prod-github-runner-207 kernel: [74162.185227] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 01:59:48 juju-e4d256-prod-github-runner-207 kernel: [74162.186016] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:59:48 juju-e4d256-prod-github-runner-207 kernel: [74162.186767] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:59:48 juju-e4d256-prod-github-runner-207 kernel: [74162.187528] ? do_syscall_64+0x69/0xc0 Aug 23 01:59:48 juju-e4d256-prod-github-runner-207 kernel: [74162.188216] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 01:59:48 juju-e4d256-prod-github-runner-207 kernel: [74162.188970] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 01:59:48 juju-e4d256-prod-github-runner-207 kernel: [74162.189728] ? do_syscall_64+0x69/0xc0 Aug 23 01:59:48 juju-e4d256-prod-github-runner-207 kernel: [74162.190420] ? do_syscall_64+0x69/0xc0 Aug 23 01:59:48 juju-e4d256-prod-github-runner-207 kernel: [74162.191114] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 01:59:48 juju-e4d256-prod-github-runner-207 kernel: [74162.191884] RIP: 0033:0x7faa5d0edaff Aug 23 01:59:48 juju-e4d256-prod-github-runner-207 kernel: [74162.192567] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 01:59:48 juju-e4d256-prod-github-runner-207 kernel: [74162.194673] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 01:59:48 juju-e4d256-prod-github-runner-207 kernel: [74162.195641] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 01:59:48 juju-e4d256-prod-github-runner-207 kernel: [74162.196589] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 01:59:48 juju-e4d256-prod-github-runner-207 kernel: [74162.197534] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 01:59:48 juju-e4d256-prod-github-runner-207 kernel: [74162.198474] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 01:59:48 juju-e4d256-prod-github-runner-207 kernel: [74162.199405] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 01:59:48 juju-e4d256-prod-github-runner-207 kernel: [74162.200322] Aug 23 02:00:14 juju-e4d256-prod-github-runner-207 kernel: [74188.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 68985s! [qemu-system-x86:6715] Aug 23 02:00:14 juju-e4d256-prod-github-runner-207 kernel: [74188.543761] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 02:00:14 juju-e4d256-prod-github-runner-207 kernel: [74188.544010] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 02:00:14 juju-e4d256-prod-github-runner-207 kernel: [74188.556112] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 02:00:14 juju-e4d256-prod-github-runner-207 kernel: [74188.557376] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 02:00:14 juju-e4d256-prod-github-runner-207 kernel: [74188.558594] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:00:14 juju-e4d256-prod-github-runner-207 kernel: [74188.559662] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 02:00:14 juju-e4d256-prod-github-runner-207 kernel: [74188.562212] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 02:00:14 juju-e4d256-prod-github-runner-207 kernel: [74188.563268] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 02:00:14 juju-e4d256-prod-github-runner-207 kernel: [74188.564435] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 02:00:14 juju-e4d256-prod-github-runner-207 kernel: [74188.565596] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 02:00:14 juju-e4d256-prod-github-runner-207 kernel: [74188.566766] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 02:00:14 juju-e4d256-prod-github-runner-207 kernel: [74188.567934] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 02:00:14 juju-e4d256-prod-github-runner-207 kernel: [74188.569100] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 02:00:14 juju-e4d256-prod-github-runner-207 kernel: [74188.570338] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 02:00:14 juju-e4d256-prod-github-runner-207 kernel: [74188.571445] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 02:00:14 juju-e4d256-prod-github-runner-207 kernel: [74188.572640] Call Trace: Aug 23 02:00:14 juju-e4d256-prod-github-runner-207 kernel: [74188.573558] Aug 23 02:00:14 juju-e4d256-prod-github-runner-207 kernel: [74188.574452] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:00:14 juju-e4d256-prod-github-runner-207 kernel: [74188.575500] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:00:14 juju-e4d256-prod-github-runner-207 kernel: [74188.576525] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:00:14 juju-e4d256-prod-github-runner-207 kernel: [74188.577613] ? show_regs.part.0+0x23/0x29 Aug 23 02:00:14 juju-e4d256-prod-github-runner-207 kernel: [74188.578614] ? show_regs.cold+0x8/0xd Aug 23 02:00:14 juju-e4d256-prod-github-runner-207 kernel: [74188.579598] ? watchdog_timer_fn+0x1be/0x220 Aug 23 02:00:14 juju-e4d256-prod-github-runner-207 kernel: [74188.580604] ? lockup_detector_update_enable+0x60/0x60 Aug 23 02:00:14 juju-e4d256-prod-github-runner-207 kernel: [74188.581673] ? __hrtimer_run_queues+0x107/0x230 Aug 23 02:00:14 juju-e4d256-prod-github-runner-207 kernel: [74188.582719] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 02:00:14 juju-e4d256-prod-github-runner-207 kernel: [74188.583741] ? hrtimer_interrupt+0x101/0x220 Aug 23 02:00:14 juju-e4d256-prod-github-runner-207 kernel: [74188.584759] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 02:00:14 juju-e4d256-prod-github-runner-207 kernel: [74188.585832] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 02:00:14 juju-e4d256-prod-github-runner-207 kernel: [74188.586899] Aug 23 02:00:14 juju-e4d256-prod-github-runner-207 kernel: [74188.587752] Aug 23 02:00:14 juju-e4d256-prod-github-runner-207 kernel: [74188.588589] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 02:00:14 juju-e4d256-prod-github-runner-207 kernel: [74188.589622] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:00:14 juju-e4d256-prod-github-runner-207 kernel: [74188.590660] ? _raw_spin_lock+0x22/0x30 Aug 23 02:00:14 juju-e4d256-prod-github-runner-207 kernel: [74188.591617] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:00:14 juju-e4d256-prod-github-runner-207 kernel: [74188.592635] direct_page_fault+0x206/0x310 [kvm] Aug 23 02:00:14 juju-e4d256-prod-github-runner-207 kernel: [74188.593663] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 02:00:14 juju-e4d256-prod-github-runner-207 kernel: [74188.594671] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 02:00:14 juju-e4d256-prod-github-runner-207 kernel: [74188.595682] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 02:00:14 juju-e4d256-prod-github-runner-207 kernel: [74188.596668] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 02:00:14 juju-e4d256-prod-github-runner-207 kernel: [74188.597615] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 02:00:14 juju-e4d256-prod-github-runner-207 kernel: [74188.598598] handle_exit+0x98/0x230 [kvm_amd] Aug 23 02:00:14 juju-e4d256-prod-github-runner-207 kernel: [74188.599499] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 02:00:14 juju-e4d256-prod-github-runner-207 kernel: [74188.600411] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 02:00:14 juju-e4d256-prod-github-runner-207 kernel: [74188.601334] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 02:00:14 juju-e4d256-prod-github-runner-207 kernel: [74188.602235] vcpu_run+0x62/0x2c0 [kvm] Aug 23 02:00:14 juju-e4d256-prod-github-runner-207 kernel: [74188.603058] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 02:00:14 juju-e4d256-prod-github-runner-207 kernel: [74188.603871] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 02:00:14 juju-e4d256-prod-github-runner-207 kernel: [74188.604728] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 02:00:14 juju-e4d256-prod-github-runner-207 kernel: [74188.605528] ? __seccomp_filter+0x4a/0x4a0 Aug 23 02:00:14 juju-e4d256-prod-github-runner-207 kernel: [74188.606268] ? __fget_files+0x86/0xc0 Aug 23 02:00:14 juju-e4d256-prod-github-runner-207 kernel: [74188.606979] __x64_sys_ioctl+0x95/0xd0 Aug 23 02:00:14 juju-e4d256-prod-github-runner-207 kernel: [74188.607815] do_syscall_64+0x5c/0xc0 Aug 23 02:00:14 juju-e4d256-prod-github-runner-207 kernel: [74188.608483] ? do_futex+0x162/0x1f0 Aug 23 02:00:14 juju-e4d256-prod-github-runner-207 kernel: [74188.609128] ? __x64_sys_futex+0x78/0x1e0 Aug 23 02:00:14 juju-e4d256-prod-github-runner-207 kernel: [74188.609799] ? __secure_computing+0xa9/0x120 Aug 23 02:00:14 juju-e4d256-prod-github-runner-207 kernel: [74188.610485] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 02:00:14 juju-e4d256-prod-github-runner-207 kernel: [74188.611261] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:00:14 juju-e4d256-prod-github-runner-207 kernel: [74188.611980] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:00:14 juju-e4d256-prod-github-runner-207 kernel: [74188.612694] ? do_syscall_64+0x69/0xc0 Aug 23 02:00:14 juju-e4d256-prod-github-runner-207 kernel: [74188.613338] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:00:14 juju-e4d256-prod-github-runner-207 kernel: [74188.614038] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:00:14 juju-e4d256-prod-github-runner-207 kernel: [74188.614747] ? do_syscall_64+0x69/0xc0 Aug 23 02:00:14 juju-e4d256-prod-github-runner-207 kernel: [74188.615369] ? do_syscall_64+0x69/0xc0 Aug 23 02:00:14 juju-e4d256-prod-github-runner-207 kernel: [74188.615988] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 02:00:14 juju-e4d256-prod-github-runner-207 kernel: [74188.616690] RIP: 0033:0x7faa5d0edaff Aug 23 02:00:14 juju-e4d256-prod-github-runner-207 kernel: [74188.617327] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 02:00:14 juju-e4d256-prod-github-runner-207 kernel: [74188.619314] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 02:00:14 juju-e4d256-prod-github-runner-207 kernel: [74188.620220] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 02:00:14 juju-e4d256-prod-github-runner-207 kernel: [74188.621104] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 02:00:14 juju-e4d256-prod-github-runner-207 kernel: [74188.621994] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 02:00:14 juju-e4d256-prod-github-runner-207 kernel: [74188.622891] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 02:00:14 juju-e4d256-prod-github-runner-207 kernel: [74188.623783] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 02:00:14 juju-e4d256-prod-github-runner-207 kernel: [74188.624673] Aug 23 02:00:42 juju-e4d256-prod-github-runner-207 kernel: [74216.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 69011s! [qemu-system-x86:6715] Aug 23 02:00:42 juju-e4d256-prod-github-runner-207 kernel: [74216.543109] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 02:00:42 juju-e4d256-prod-github-runner-207 kernel: [74216.543176] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 02:00:42 juju-e4d256-prod-github-runner-207 kernel: [74216.555223] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 02:00:42 juju-e4d256-prod-github-runner-207 kernel: [74216.556490] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 02:00:42 juju-e4d256-prod-github-runner-207 kernel: [74216.557703] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:00:42 juju-e4d256-prod-github-runner-207 kernel: [74216.558772] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 02:00:42 juju-e4d256-prod-github-runner-207 kernel: [74216.561309] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 02:00:42 juju-e4d256-prod-github-runner-207 kernel: [74216.562353] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 02:00:42 juju-e4d256-prod-github-runner-207 kernel: [74216.563515] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 02:00:42 juju-e4d256-prod-github-runner-207 kernel: [74216.564675] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 02:00:42 juju-e4d256-prod-github-runner-207 kernel: [74216.565830] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 02:00:42 juju-e4d256-prod-github-runner-207 kernel: [74216.567000] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 02:00:42 juju-e4d256-prod-github-runner-207 kernel: [74216.568168] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 02:00:42 juju-e4d256-prod-github-runner-207 kernel: [74216.569395] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 02:00:42 juju-e4d256-prod-github-runner-207 kernel: [74216.570498] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 02:00:42 juju-e4d256-prod-github-runner-207 kernel: [74216.571688] Call Trace: Aug 23 02:00:42 juju-e4d256-prod-github-runner-207 kernel: [74216.572775] Aug 23 02:00:42 juju-e4d256-prod-github-runner-207 kernel: [74216.573656] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:00:42 juju-e4d256-prod-github-runner-207 kernel: [74216.574693] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:00:42 juju-e4d256-prod-github-runner-207 kernel: [74216.575711] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:00:42 juju-e4d256-prod-github-runner-207 kernel: [74216.576782] ? show_regs.part.0+0x23/0x29 Aug 23 02:00:42 juju-e4d256-prod-github-runner-207 kernel: [74216.577776] ? show_regs.cold+0x8/0xd Aug 23 02:00:42 juju-e4d256-prod-github-runner-207 kernel: [74216.578756] ? watchdog_timer_fn+0x1be/0x220 Aug 23 02:00:42 juju-e4d256-prod-github-runner-207 kernel: [74216.579761] ? lockup_detector_update_enable+0x60/0x60 Aug 23 02:00:42 juju-e4d256-prod-github-runner-207 kernel: [74216.580928] ? __hrtimer_run_queues+0x107/0x230 Aug 23 02:00:42 juju-e4d256-prod-github-runner-207 kernel: [74216.581952] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 02:00:42 juju-e4d256-prod-github-runner-207 kernel: [74216.583008] ? hrtimer_interrupt+0x101/0x220 Aug 23 02:00:42 juju-e4d256-prod-github-runner-207 kernel: [74216.584032] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 02:00:42 juju-e4d256-prod-github-runner-207 kernel: [74216.585101] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 02:00:42 juju-e4d256-prod-github-runner-207 kernel: [74216.586145] Aug 23 02:00:42 juju-e4d256-prod-github-runner-207 kernel: [74216.587012] Aug 23 02:00:42 juju-e4d256-prod-github-runner-207 kernel: [74216.587865] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 02:00:42 juju-e4d256-prod-github-runner-207 kernel: [74216.588903] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:00:42 juju-e4d256-prod-github-runner-207 kernel: [74216.589942] ? _raw_spin_lock+0x22/0x30 Aug 23 02:00:42 juju-e4d256-prod-github-runner-207 kernel: [74216.590898] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:00:42 juju-e4d256-prod-github-runner-207 kernel: [74216.591914] direct_page_fault+0x206/0x310 [kvm] Aug 23 02:00:42 juju-e4d256-prod-github-runner-207 kernel: [74216.592937] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 02:00:42 juju-e4d256-prod-github-runner-207 kernel: [74216.593941] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 02:00:42 juju-e4d256-prod-github-runner-207 kernel: [74216.594949] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 02:00:42 juju-e4d256-prod-github-runner-207 kernel: [74216.595915] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 02:00:42 juju-e4d256-prod-github-runner-207 kernel: [74216.596855] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 02:00:42 juju-e4d256-prod-github-runner-207 kernel: [74216.597827] handle_exit+0x98/0x230 [kvm_amd] Aug 23 02:00:42 juju-e4d256-prod-github-runner-207 kernel: [74216.598724] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 02:00:42 juju-e4d256-prod-github-runner-207 kernel: [74216.599634] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 02:00:42 juju-e4d256-prod-github-runner-207 kernel: [74216.600557] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 02:00:42 juju-e4d256-prod-github-runner-207 kernel: [74216.601454] vcpu_run+0x62/0x2c0 [kvm] Aug 23 02:00:42 juju-e4d256-prod-github-runner-207 kernel: [74216.602261] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 02:00:42 juju-e4d256-prod-github-runner-207 kernel: [74216.603082] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 02:00:42 juju-e4d256-prod-github-runner-207 kernel: [74216.603932] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 02:00:42 juju-e4d256-prod-github-runner-207 kernel: [74216.604726] ? __seccomp_filter+0x4a/0x4a0 Aug 23 02:00:42 juju-e4d256-prod-github-runner-207 kernel: [74216.605465] ? __fget_files+0x86/0xc0 Aug 23 02:00:42 juju-e4d256-prod-github-runner-207 kernel: [74216.606165] __x64_sys_ioctl+0x95/0xd0 Aug 23 02:00:42 juju-e4d256-prod-github-runner-207 kernel: [74216.606864] do_syscall_64+0x5c/0xc0 Aug 23 02:00:42 juju-e4d256-prod-github-runner-207 kernel: [74216.607525] ? do_futex+0x162/0x1f0 Aug 23 02:00:42 juju-e4d256-prod-github-runner-207 kernel: [74216.608172] ? __x64_sys_futex+0x78/0x1e0 Aug 23 02:00:42 juju-e4d256-prod-github-runner-207 kernel: [74216.608842] ? __secure_computing+0xa9/0x120 Aug 23 02:00:42 juju-e4d256-prod-github-runner-207 kernel: [74216.609530] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 02:00:42 juju-e4d256-prod-github-runner-207 kernel: [74216.610284] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:00:42 juju-e4d256-prod-github-runner-207 kernel: [74216.611012] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:00:42 juju-e4d256-prod-github-runner-207 kernel: [74216.611730] ? do_syscall_64+0x69/0xc0 Aug 23 02:00:42 juju-e4d256-prod-github-runner-207 kernel: [74216.612370] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:00:42 juju-e4d256-prod-github-runner-207 kernel: [74216.613092] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:00:42 juju-e4d256-prod-github-runner-207 kernel: [74216.613797] ? do_syscall_64+0x69/0xc0 Aug 23 02:00:42 juju-e4d256-prod-github-runner-207 kernel: [74216.614430] ? do_syscall_64+0x69/0xc0 Aug 23 02:00:42 juju-e4d256-prod-github-runner-207 kernel: [74216.615055] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 02:00:42 juju-e4d256-prod-github-runner-207 kernel: [74216.615759] RIP: 0033:0x7faa5d0edaff Aug 23 02:00:42 juju-e4d256-prod-github-runner-207 kernel: [74216.616401] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 02:00:42 juju-e4d256-prod-github-runner-207 kernel: [74216.618386] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 02:00:42 juju-e4d256-prod-github-runner-207 kernel: [74216.619299] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 02:00:42 juju-e4d256-prod-github-runner-207 kernel: [74216.620185] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 02:00:42 juju-e4d256-prod-github-runner-207 kernel: [74216.621070] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 02:00:42 juju-e4d256-prod-github-runner-207 kernel: [74216.621959] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 02:00:42 juju-e4d256-prod-github-runner-207 kernel: [74216.622861] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 02:00:42 juju-e4d256-prod-github-runner-207 kernel: [74216.623753] Aug 23 02:01:10 juju-e4d256-prod-github-runner-207 kernel: [74244.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 69037s! [qemu-system-x86:6715] Aug 23 02:01:10 juju-e4d256-prod-github-runner-207 kernel: [74244.543112] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 02:01:10 juju-e4d256-prod-github-runner-207 kernel: [74244.543181] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 02:01:10 juju-e4d256-prod-github-runner-207 kernel: [74244.555311] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 02:01:10 juju-e4d256-prod-github-runner-207 kernel: [74244.556626] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 02:01:10 juju-e4d256-prod-github-runner-207 kernel: [74244.557838] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:01:10 juju-e4d256-prod-github-runner-207 kernel: [74244.558910] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 02:01:10 juju-e4d256-prod-github-runner-207 kernel: [74244.561439] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 02:01:10 juju-e4d256-prod-github-runner-207 kernel: [74244.562492] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 02:01:10 juju-e4d256-prod-github-runner-207 kernel: [74244.563654] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 02:01:10 juju-e4d256-prod-github-runner-207 kernel: [74244.564812] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 02:01:10 juju-e4d256-prod-github-runner-207 kernel: [74244.565968] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 02:01:10 juju-e4d256-prod-github-runner-207 kernel: [74244.567133] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 02:01:10 juju-e4d256-prod-github-runner-207 kernel: [74244.568291] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 02:01:10 juju-e4d256-prod-github-runner-207 kernel: [74244.569522] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 02:01:10 juju-e4d256-prod-github-runner-207 kernel: [74244.570628] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 02:01:10 juju-e4d256-prod-github-runner-207 kernel: [74244.571816] Call Trace: Aug 23 02:01:10 juju-e4d256-prod-github-runner-207 kernel: [74244.572727] Aug 23 02:01:10 juju-e4d256-prod-github-runner-207 kernel: [74244.573609] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:01:10 juju-e4d256-prod-github-runner-207 kernel: [74244.574651] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:01:10 juju-e4d256-prod-github-runner-207 kernel: [74244.575674] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:01:10 juju-e4d256-prod-github-runner-207 kernel: [74244.576743] ? show_regs.part.0+0x23/0x29 Aug 23 02:01:10 juju-e4d256-prod-github-runner-207 kernel: [74244.577738] ? show_regs.cold+0x8/0xd Aug 23 02:01:10 juju-e4d256-prod-github-runner-207 kernel: [74244.578720] ? watchdog_timer_fn+0x1be/0x220 Aug 23 02:01:10 juju-e4d256-prod-github-runner-207 kernel: [74244.579726] ? lockup_detector_update_enable+0x60/0x60 Aug 23 02:01:10 juju-e4d256-prod-github-runner-207 kernel: [74244.580785] ? __hrtimer_run_queues+0x107/0x230 Aug 23 02:01:10 juju-e4d256-prod-github-runner-207 kernel: [74244.581847] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 02:01:10 juju-e4d256-prod-github-runner-207 kernel: [74244.582926] ? hrtimer_interrupt+0x101/0x220 Aug 23 02:01:10 juju-e4d256-prod-github-runner-207 kernel: [74244.583953] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 02:01:10 juju-e4d256-prod-github-runner-207 kernel: [74244.585021] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 02:01:10 juju-e4d256-prod-github-runner-207 kernel: [74244.586085] Aug 23 02:01:10 juju-e4d256-prod-github-runner-207 kernel: [74244.586942] Aug 23 02:01:10 juju-e4d256-prod-github-runner-207 kernel: [74244.587779] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 02:01:10 juju-e4d256-prod-github-runner-207 kernel: [74244.588818] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:01:10 juju-e4d256-prod-github-runner-207 kernel: [74244.589896] ? _raw_spin_lock+0x22/0x30 Aug 23 02:01:10 juju-e4d256-prod-github-runner-207 kernel: [74244.590879] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:01:10 juju-e4d256-prod-github-runner-207 kernel: [74244.591895] direct_page_fault+0x206/0x310 [kvm] Aug 23 02:01:10 juju-e4d256-prod-github-runner-207 kernel: [74244.592916] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 02:01:10 juju-e4d256-prod-github-runner-207 kernel: [74244.593923] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 02:01:10 juju-e4d256-prod-github-runner-207 kernel: [74244.594939] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 02:01:10 juju-e4d256-prod-github-runner-207 kernel: [74244.595908] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 02:01:10 juju-e4d256-prod-github-runner-207 kernel: [74244.596852] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 02:01:10 juju-e4d256-prod-github-runner-207 kernel: [74244.597829] handle_exit+0x98/0x230 [kvm_amd] Aug 23 02:01:10 juju-e4d256-prod-github-runner-207 kernel: [74244.598731] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 02:01:10 juju-e4d256-prod-github-runner-207 kernel: [74244.599646] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 02:01:10 juju-e4d256-prod-github-runner-207 kernel: [74244.600572] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 02:01:10 juju-e4d256-prod-github-runner-207 kernel: [74244.601472] vcpu_run+0x62/0x2c0 [kvm] Aug 23 02:01:10 juju-e4d256-prod-github-runner-207 kernel: [74244.602295] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 02:01:10 juju-e4d256-prod-github-runner-207 kernel: [74244.603109] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 02:01:10 juju-e4d256-prod-github-runner-207 kernel: [74244.603964] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 02:01:10 juju-e4d256-prod-github-runner-207 kernel: [74244.604760] ? __seccomp_filter+0x4a/0x4a0 Aug 23 02:01:10 juju-e4d256-prod-github-runner-207 kernel: [74244.605500] ? __fget_files+0x86/0xc0 Aug 23 02:01:10 juju-e4d256-prod-github-runner-207 kernel: [74244.606215] __x64_sys_ioctl+0x95/0xd0 Aug 23 02:01:10 juju-e4d256-prod-github-runner-207 kernel: [74244.606905] do_syscall_64+0x5c/0xc0 Aug 23 02:01:10 juju-e4d256-prod-github-runner-207 kernel: [74244.607567] ? do_futex+0x162/0x1f0 Aug 23 02:01:10 juju-e4d256-prod-github-runner-207 kernel: [74244.608214] ? __x64_sys_futex+0x78/0x1e0 Aug 23 02:01:10 juju-e4d256-prod-github-runner-207 kernel: [74244.608885] ? __secure_computing+0xa9/0x120 Aug 23 02:01:10 juju-e4d256-prod-github-runner-207 kernel: [74244.609572] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 02:01:10 juju-e4d256-prod-github-runner-207 kernel: [74244.610345] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:01:10 juju-e4d256-prod-github-runner-207 kernel: [74244.611064] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:01:10 juju-e4d256-prod-github-runner-207 kernel: [74244.611812] ? do_syscall_64+0x69/0xc0 Aug 23 02:01:10 juju-e4d256-prod-github-runner-207 kernel: [74244.612466] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:01:10 juju-e4d256-prod-github-runner-207 kernel: [74244.613199] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:01:10 juju-e4d256-prod-github-runner-207 kernel: [74244.613894] ? do_syscall_64+0x69/0xc0 Aug 23 02:01:10 juju-e4d256-prod-github-runner-207 kernel: [74244.614530] ? do_syscall_64+0x69/0xc0 Aug 23 02:01:10 juju-e4d256-prod-github-runner-207 kernel: [74244.615150] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 02:01:10 juju-e4d256-prod-github-runner-207 kernel: [74244.615852] RIP: 0033:0x7faa5d0edaff Aug 23 02:01:10 juju-e4d256-prod-github-runner-207 kernel: [74244.616472] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 02:01:10 juju-e4d256-prod-github-runner-207 kernel: [74244.618466] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 02:01:10 juju-e4d256-prod-github-runner-207 kernel: [74244.619372] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 02:01:10 juju-e4d256-prod-github-runner-207 kernel: [74244.620256] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 02:01:10 juju-e4d256-prod-github-runner-207 kernel: [74244.621156] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 02:01:10 juju-e4d256-prod-github-runner-207 kernel: [74244.622040] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 02:01:10 juju-e4d256-prod-github-runner-207 kernel: [74244.623022] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 02:01:10 juju-e4d256-prod-github-runner-207 kernel: [74244.623963] Aug 23 02:01:38 juju-e4d256-prod-github-runner-207 kernel: [74272.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 69063s! [qemu-system-x86:6715] Aug 23 02:01:38 juju-e4d256-prod-github-runner-207 kernel: [74272.543780] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 02:01:38 juju-e4d256-prod-github-runner-207 kernel: [74272.544035] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 02:01:38 juju-e4d256-prod-github-runner-207 kernel: [74272.556125] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 02:01:38 juju-e4d256-prod-github-runner-207 kernel: [74272.557394] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 02:01:38 juju-e4d256-prod-github-runner-207 kernel: [74272.558626] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:01:38 juju-e4d256-prod-github-runner-207 kernel: [74272.559682] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 02:01:38 juju-e4d256-prod-github-runner-207 kernel: [74272.562245] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 02:01:38 juju-e4d256-prod-github-runner-207 kernel: [74272.563287] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 02:01:38 juju-e4d256-prod-github-runner-207 kernel: [74272.564454] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 02:01:38 juju-e4d256-prod-github-runner-207 kernel: [74272.565613] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 02:01:38 juju-e4d256-prod-github-runner-207 kernel: [74272.566781] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 02:01:38 juju-e4d256-prod-github-runner-207 kernel: [74272.567943] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 02:01:38 juju-e4d256-prod-github-runner-207 kernel: [74272.569118] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 02:01:38 juju-e4d256-prod-github-runner-207 kernel: [74272.570621] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 02:01:38 juju-e4d256-prod-github-runner-207 kernel: [74272.572086] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 02:01:38 juju-e4d256-prod-github-runner-207 kernel: [74272.573639] Call Trace: Aug 23 02:01:38 juju-e4d256-prod-github-runner-207 kernel: [74272.574875] Aug 23 02:01:38 juju-e4d256-prod-github-runner-207 kernel: [74272.576065] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:01:38 juju-e4d256-prod-github-runner-207 kernel: [74272.577389] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:01:38 juju-e4d256-prod-github-runner-207 kernel: [74272.578532] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:01:38 juju-e4d256-prod-github-runner-207 kernel: [74272.579629] ? show_regs.part.0+0x23/0x29 Aug 23 02:01:38 juju-e4d256-prod-github-runner-207 kernel: [74272.580632] ? show_regs.cold+0x8/0xd Aug 23 02:01:38 juju-e4d256-prod-github-runner-207 kernel: [74272.581606] ? watchdog_timer_fn+0x1be/0x220 Aug 23 02:01:38 juju-e4d256-prod-github-runner-207 kernel: [74272.582647] ? lockup_detector_update_enable+0x60/0x60 Aug 23 02:01:38 juju-e4d256-prod-github-runner-207 kernel: [74272.583710] ? __hrtimer_run_queues+0x107/0x230 Aug 23 02:01:38 juju-e4d256-prod-github-runner-207 kernel: [74272.584738] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 02:01:38 juju-e4d256-prod-github-runner-207 kernel: [74272.585774] ? hrtimer_interrupt+0x101/0x220 Aug 23 02:01:38 juju-e4d256-prod-github-runner-207 kernel: [74272.586794] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 02:01:38 juju-e4d256-prod-github-runner-207 kernel: [74272.587867] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 02:01:38 juju-e4d256-prod-github-runner-207 kernel: [74272.588915] Aug 23 02:01:38 juju-e4d256-prod-github-runner-207 kernel: [74272.589787] Aug 23 02:01:38 juju-e4d256-prod-github-runner-207 kernel: [74272.590753] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 02:01:38 juju-e4d256-prod-github-runner-207 kernel: [74272.591796] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:01:38 juju-e4d256-prod-github-runner-207 kernel: [74272.592836] ? _raw_spin_lock+0x22/0x30 Aug 23 02:01:38 juju-e4d256-prod-github-runner-207 kernel: [74272.593802] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:01:38 juju-e4d256-prod-github-runner-207 kernel: [74272.594821] direct_page_fault+0x206/0x310 [kvm] Aug 23 02:01:38 juju-e4d256-prod-github-runner-207 kernel: [74272.595846] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 02:01:38 juju-e4d256-prod-github-runner-207 kernel: [74272.596969] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 02:01:38 juju-e4d256-prod-github-runner-207 kernel: [74272.597987] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 02:01:38 juju-e4d256-prod-github-runner-207 kernel: [74272.598996] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 02:01:38 juju-e4d256-prod-github-runner-207 kernel: [74272.599943] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 02:01:38 juju-e4d256-prod-github-runner-207 kernel: [74272.600923] handle_exit+0x98/0x230 [kvm_amd] Aug 23 02:01:38 juju-e4d256-prod-github-runner-207 kernel: [74272.601837] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 02:01:38 juju-e4d256-prod-github-runner-207 kernel: [74272.602758] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 02:01:38 juju-e4d256-prod-github-runner-207 kernel: [74272.603685] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 02:01:38 juju-e4d256-prod-github-runner-207 kernel: [74272.604589] vcpu_run+0x62/0x2c0 [kvm] Aug 23 02:01:38 juju-e4d256-prod-github-runner-207 kernel: [74272.605402] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 02:01:38 juju-e4d256-prod-github-runner-207 kernel: [74272.606234] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 02:01:38 juju-e4d256-prod-github-runner-207 kernel: [74272.607090] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 02:01:38 juju-e4d256-prod-github-runner-207 kernel: [74272.607888] ? __seccomp_filter+0x4a/0x4a0 Aug 23 02:01:38 juju-e4d256-prod-github-runner-207 kernel: [74272.608631] ? __fget_files+0x86/0xc0 Aug 23 02:01:38 juju-e4d256-prod-github-runner-207 kernel: [74272.609336] __x64_sys_ioctl+0x95/0xd0 Aug 23 02:01:38 juju-e4d256-prod-github-runner-207 kernel: [74272.610046] do_syscall_64+0x5c/0xc0 Aug 23 02:01:38 juju-e4d256-prod-github-runner-207 kernel: [74272.610711] ? do_futex+0x162/0x1f0 Aug 23 02:01:38 juju-e4d256-prod-github-runner-207 kernel: [74272.611359] ? __x64_sys_futex+0x78/0x1e0 Aug 23 02:01:38 juju-e4d256-prod-github-runner-207 kernel: [74272.612039] ? __secure_computing+0xa9/0x120 Aug 23 02:01:38 juju-e4d256-prod-github-runner-207 kernel: [74272.612727] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 02:01:38 juju-e4d256-prod-github-runner-207 kernel: [74272.613491] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:01:38 juju-e4d256-prod-github-runner-207 kernel: [74272.614230] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:01:38 juju-e4d256-prod-github-runner-207 kernel: [74272.614948] ? do_syscall_64+0x69/0xc0 Aug 23 02:01:38 juju-e4d256-prod-github-runner-207 kernel: [74272.615594] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:01:38 juju-e4d256-prod-github-runner-207 kernel: [74272.616301] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:01:38 juju-e4d256-prod-github-runner-207 kernel: [74272.616996] ? do_syscall_64+0x69/0xc0 Aug 23 02:01:38 juju-e4d256-prod-github-runner-207 kernel: [74272.617658] ? do_syscall_64+0x69/0xc0 Aug 23 02:01:38 juju-e4d256-prod-github-runner-207 kernel: [74272.618306] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 02:01:38 juju-e4d256-prod-github-runner-207 kernel: [74272.619209] RIP: 0033:0x7faa5d0edaff Aug 23 02:01:38 juju-e4d256-prod-github-runner-207 kernel: [74272.620043] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 02:01:38 juju-e4d256-prod-github-runner-207 kernel: [74272.622575] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 02:01:38 juju-e4d256-prod-github-runner-207 kernel: [74272.623745] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 02:01:38 juju-e4d256-prod-github-runner-207 kernel: [74272.624871] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 02:01:38 juju-e4d256-prod-github-runner-207 kernel: [74272.626019] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 02:01:38 juju-e4d256-prod-github-runner-207 kernel: [74272.627116] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 02:01:38 juju-e4d256-prod-github-runner-207 kernel: [74272.628030] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 02:01:38 juju-e4d256-prod-github-runner-207 kernel: [74272.628927] Aug 23 02:02:06 juju-e4d256-prod-github-runner-207 kernel: [74300.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 69089s! [qemu-system-x86:6715] Aug 23 02:02:06 juju-e4d256-prod-github-runner-207 kernel: [74300.543098] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 02:02:06 juju-e4d256-prod-github-runner-207 kernel: [74300.543167] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 02:02:06 juju-e4d256-prod-github-runner-207 kernel: [74300.555242] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 02:02:06 juju-e4d256-prod-github-runner-207 kernel: [74300.556513] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 02:02:06 juju-e4d256-prod-github-runner-207 kernel: [74300.557748] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:02:06 juju-e4d256-prod-github-runner-207 kernel: [74300.558805] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 02:02:06 juju-e4d256-prod-github-runner-207 kernel: [74300.561366] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 02:02:06 juju-e4d256-prod-github-runner-207 kernel: [74300.562421] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 02:02:06 juju-e4d256-prod-github-runner-207 kernel: [74300.563588] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 02:02:06 juju-e4d256-prod-github-runner-207 kernel: [74300.564769] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 02:02:06 juju-e4d256-prod-github-runner-207 kernel: [74300.565939] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 02:02:06 juju-e4d256-prod-github-runner-207 kernel: [74300.567096] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 02:02:06 juju-e4d256-prod-github-runner-207 kernel: [74300.568260] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 02:02:06 juju-e4d256-prod-github-runner-207 kernel: [74300.569508] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 02:02:06 juju-e4d256-prod-github-runner-207 kernel: [74300.570636] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 02:02:06 juju-e4d256-prod-github-runner-207 kernel: [74300.571836] Call Trace: Aug 23 02:02:06 juju-e4d256-prod-github-runner-207 kernel: [74300.572746] Aug 23 02:02:06 juju-e4d256-prod-github-runner-207 kernel: [74300.573657] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:02:06 juju-e4d256-prod-github-runner-207 kernel: [74300.574687] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:02:06 juju-e4d256-prod-github-runner-207 kernel: [74300.575705] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:02:06 juju-e4d256-prod-github-runner-207 kernel: [74300.576892] ? show_regs.part.0+0x23/0x29 Aug 23 02:02:06 juju-e4d256-prod-github-runner-207 kernel: [74300.577930] ? show_regs.cold+0x8/0xd Aug 23 02:02:06 juju-e4d256-prod-github-runner-207 kernel: [74300.578910] ? watchdog_timer_fn+0x1be/0x220 Aug 23 02:02:06 juju-e4d256-prod-github-runner-207 kernel: [74300.579924] ? lockup_detector_update_enable+0x60/0x60 Aug 23 02:02:06 juju-e4d256-prod-github-runner-207 kernel: [74300.580986] ? __hrtimer_run_queues+0x107/0x230 Aug 23 02:02:06 juju-e4d256-prod-github-runner-207 kernel: [74300.582046] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 02:02:06 juju-e4d256-prod-github-runner-207 kernel: [74300.583089] ? hrtimer_interrupt+0x101/0x220 Aug 23 02:02:06 juju-e4d256-prod-github-runner-207 kernel: [74300.584111] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 02:02:06 juju-e4d256-prod-github-runner-207 kernel: [74300.585177] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 02:02:06 juju-e4d256-prod-github-runner-207 kernel: [74300.586234] Aug 23 02:02:06 juju-e4d256-prod-github-runner-207 kernel: [74300.587085] Aug 23 02:02:06 juju-e4d256-prod-github-runner-207 kernel: [74300.587928] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 02:02:06 juju-e4d256-prod-github-runner-207 kernel: [74300.588958] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:02:06 juju-e4d256-prod-github-runner-207 kernel: [74300.590012] ? _raw_spin_lock+0x22/0x30 Aug 23 02:02:06 juju-e4d256-prod-github-runner-207 kernel: [74300.590954] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:02:06 juju-e4d256-prod-github-runner-207 kernel: [74300.591968] direct_page_fault+0x206/0x310 [kvm] Aug 23 02:02:06 juju-e4d256-prod-github-runner-207 kernel: [74300.592991] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 02:02:06 juju-e4d256-prod-github-runner-207 kernel: [74300.594019] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 02:02:06 juju-e4d256-prod-github-runner-207 kernel: [74300.595038] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 02:02:06 juju-e4d256-prod-github-runner-207 kernel: [74300.596032] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 02:02:06 juju-e4d256-prod-github-runner-207 kernel: [74300.596977] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 02:02:06 juju-e4d256-prod-github-runner-207 kernel: [74300.597984] handle_exit+0x98/0x230 [kvm_amd] Aug 23 02:02:06 juju-e4d256-prod-github-runner-207 kernel: [74300.598902] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 02:02:06 juju-e4d256-prod-github-runner-207 kernel: [74300.599816] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 02:02:06 juju-e4d256-prod-github-runner-207 kernel: [74300.600737] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 02:02:06 juju-e4d256-prod-github-runner-207 kernel: [74300.601650] vcpu_run+0x62/0x2c0 [kvm] Aug 23 02:02:06 juju-e4d256-prod-github-runner-207 kernel: [74300.602471] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 02:02:06 juju-e4d256-prod-github-runner-207 kernel: [74300.603298] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 02:02:06 juju-e4d256-prod-github-runner-207 kernel: [74300.604164] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 02:02:06 juju-e4d256-prod-github-runner-207 kernel: [74300.604966] ? __seccomp_filter+0x4a/0x4a0 Aug 23 02:02:06 juju-e4d256-prod-github-runner-207 kernel: [74300.605728] ? __fget_files+0x86/0xc0 Aug 23 02:02:06 juju-e4d256-prod-github-runner-207 kernel: [74300.606433] __x64_sys_ioctl+0x95/0xd0 Aug 23 02:02:06 juju-e4d256-prod-github-runner-207 kernel: [74300.607125] do_syscall_64+0x5c/0xc0 Aug 23 02:02:06 juju-e4d256-prod-github-runner-207 kernel: [74300.607788] ? do_futex+0x162/0x1f0 Aug 23 02:02:06 juju-e4d256-prod-github-runner-207 kernel: [74300.608443] ? __x64_sys_futex+0x78/0x1e0 Aug 23 02:02:06 juju-e4d256-prod-github-runner-207 kernel: [74300.609116] ? __secure_computing+0xa9/0x120 Aug 23 02:02:06 juju-e4d256-prod-github-runner-207 kernel: [74300.609825] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 02:02:06 juju-e4d256-prod-github-runner-207 kernel: [74300.610589] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:02:06 juju-e4d256-prod-github-runner-207 kernel: [74300.611311] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:02:06 juju-e4d256-prod-github-runner-207 kernel: [74300.612027] ? do_syscall_64+0x69/0xc0 Aug 23 02:02:06 juju-e4d256-prod-github-runner-207 kernel: [74300.612669] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:02:06 juju-e4d256-prod-github-runner-207 kernel: [74300.613372] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:02:06 juju-e4d256-prod-github-runner-207 kernel: [74300.614081] ? do_syscall_64+0x69/0xc0 Aug 23 02:02:06 juju-e4d256-prod-github-runner-207 kernel: [74300.614706] ? do_syscall_64+0x69/0xc0 Aug 23 02:02:06 juju-e4d256-prod-github-runner-207 kernel: [74300.615330] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 02:02:06 juju-e4d256-prod-github-runner-207 kernel: [74300.616032] RIP: 0033:0x7faa5d0edaff Aug 23 02:02:06 juju-e4d256-prod-github-runner-207 kernel: [74300.616660] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 02:02:06 juju-e4d256-prod-github-runner-207 kernel: [74300.618677] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 02:02:06 juju-e4d256-prod-github-runner-207 kernel: [74300.619591] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 02:02:06 juju-e4d256-prod-github-runner-207 kernel: [74300.620476] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 02:02:06 juju-e4d256-prod-github-runner-207 kernel: [74300.621365] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 02:02:06 juju-e4d256-prod-github-runner-207 kernel: [74300.622262] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 02:02:06 juju-e4d256-prod-github-runner-207 kernel: [74300.623147] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 02:02:06 juju-e4d256-prod-github-runner-207 kernel: [74300.624056] Aug 23 02:02:34 juju-e4d256-prod-github-runner-207 kernel: [74328.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 69115s! [qemu-system-x86:6715] Aug 23 02:02:34 juju-e4d256-prod-github-runner-207 kernel: [74328.543084] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 02:02:34 juju-e4d256-prod-github-runner-207 kernel: [74328.543151] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 02:02:34 juju-e4d256-prod-github-runner-207 kernel: [74328.555282] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 02:02:34 juju-e4d256-prod-github-runner-207 kernel: [74328.556550] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 02:02:34 juju-e4d256-prod-github-runner-207 kernel: [74328.557790] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:02:34 juju-e4d256-prod-github-runner-207 kernel: [74328.558849] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 02:02:34 juju-e4d256-prod-github-runner-207 kernel: [74328.561430] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 02:02:34 juju-e4d256-prod-github-runner-207 kernel: [74328.562479] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 02:02:34 juju-e4d256-prod-github-runner-207 kernel: [74328.563646] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 02:02:34 juju-e4d256-prod-github-runner-207 kernel: [74328.564814] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 02:02:34 juju-e4d256-prod-github-runner-207 kernel: [74328.566039] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 02:02:34 juju-e4d256-prod-github-runner-207 kernel: [74328.567203] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 02:02:34 juju-e4d256-prod-github-runner-207 kernel: [74328.568369] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 02:02:34 juju-e4d256-prod-github-runner-207 kernel: [74328.569625] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 02:02:34 juju-e4d256-prod-github-runner-207 kernel: [74328.570765] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 02:02:34 juju-e4d256-prod-github-runner-207 kernel: [74328.571965] Call Trace: Aug 23 02:02:34 juju-e4d256-prod-github-runner-207 kernel: [74328.572877] Aug 23 02:02:34 juju-e4d256-prod-github-runner-207 kernel: [74328.573772] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:02:34 juju-e4d256-prod-github-runner-207 kernel: [74328.574813] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:02:34 juju-e4d256-prod-github-runner-207 kernel: [74328.575861] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:02:34 juju-e4d256-prod-github-runner-207 kernel: [74328.576942] ? show_regs.part.0+0x23/0x29 Aug 23 02:02:34 juju-e4d256-prod-github-runner-207 kernel: [74328.577955] ? show_regs.cold+0x8/0xd Aug 23 02:02:34 juju-e4d256-prod-github-runner-207 kernel: [74328.578926] ? watchdog_timer_fn+0x1be/0x220 Aug 23 02:02:34 juju-e4d256-prod-github-runner-207 kernel: [74328.579954] ? lockup_detector_update_enable+0x60/0x60 Aug 23 02:02:34 juju-e4d256-prod-github-runner-207 kernel: [74328.581030] ? __hrtimer_run_queues+0x107/0x230 Aug 23 02:02:34 juju-e4d256-prod-github-runner-207 kernel: [74328.582073] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 02:02:34 juju-e4d256-prod-github-runner-207 kernel: [74328.583094] ? hrtimer_interrupt+0x101/0x220 Aug 23 02:02:34 juju-e4d256-prod-github-runner-207 kernel: [74328.584108] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 02:02:34 juju-e4d256-prod-github-runner-207 kernel: [74328.585199] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 02:02:34 juju-e4d256-prod-github-runner-207 kernel: [74328.586272] Aug 23 02:02:34 juju-e4d256-prod-github-runner-207 kernel: [74328.587127] Aug 23 02:02:34 juju-e4d256-prod-github-runner-207 kernel: [74328.587965] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 02:02:34 juju-e4d256-prod-github-runner-207 kernel: [74328.589004] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:02:34 juju-e4d256-prod-github-runner-207 kernel: [74328.590066] ? _raw_spin_lock+0x22/0x30 Aug 23 02:02:34 juju-e4d256-prod-github-runner-207 kernel: [74328.591023] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:02:34 juju-e4d256-prod-github-runner-207 kernel: [74328.592042] direct_page_fault+0x206/0x310 [kvm] Aug 23 02:02:34 juju-e4d256-prod-github-runner-207 kernel: [74328.593071] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 02:02:34 juju-e4d256-prod-github-runner-207 kernel: [74328.594093] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 02:02:34 juju-e4d256-prod-github-runner-207 kernel: [74328.595107] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 02:02:34 juju-e4d256-prod-github-runner-207 kernel: [74328.596103] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 02:02:34 juju-e4d256-prod-github-runner-207 kernel: [74328.597056] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 02:02:34 juju-e4d256-prod-github-runner-207 kernel: [74328.598050] handle_exit+0x98/0x230 [kvm_amd] Aug 23 02:02:34 juju-e4d256-prod-github-runner-207 kernel: [74328.598946] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 02:02:34 juju-e4d256-prod-github-runner-207 kernel: [74328.599858] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 02:02:34 juju-e4d256-prod-github-runner-207 kernel: [74328.600805] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 02:02:34 juju-e4d256-prod-github-runner-207 kernel: [74328.601741] vcpu_run+0x62/0x2c0 [kvm] Aug 23 02:02:34 juju-e4d256-prod-github-runner-207 kernel: [74328.602553] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 02:02:34 juju-e4d256-prod-github-runner-207 kernel: [74328.603359] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 02:02:34 juju-e4d256-prod-github-runner-207 kernel: [74328.604211] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 02:02:34 juju-e4d256-prod-github-runner-207 kernel: [74328.605016] ? __seccomp_filter+0x4a/0x4a0 Aug 23 02:02:34 juju-e4d256-prod-github-runner-207 kernel: [74328.605777] ? __fget_files+0x86/0xc0 Aug 23 02:02:34 juju-e4d256-prod-github-runner-207 kernel: [74328.606504] __x64_sys_ioctl+0x95/0xd0 Aug 23 02:02:34 juju-e4d256-prod-github-runner-207 kernel: [74328.607201] do_syscall_64+0x5c/0xc0 Aug 23 02:02:34 juju-e4d256-prod-github-runner-207 kernel: [74328.607864] ? do_futex+0x162/0x1f0 Aug 23 02:02:34 juju-e4d256-prod-github-runner-207 kernel: [74328.608511] ? __x64_sys_futex+0x78/0x1e0 Aug 23 02:02:34 juju-e4d256-prod-github-runner-207 kernel: [74328.609201] ? __secure_computing+0xa9/0x120 Aug 23 02:02:34 juju-e4d256-prod-github-runner-207 kernel: [74328.609890] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 02:02:34 juju-e4d256-prod-github-runner-207 kernel: [74328.610665] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:02:34 juju-e4d256-prod-github-runner-207 kernel: [74328.611389] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:02:34 juju-e4d256-prod-github-runner-207 kernel: [74328.612116] ? do_syscall_64+0x69/0xc0 Aug 23 02:02:34 juju-e4d256-prod-github-runner-207 kernel: [74328.612758] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:02:34 juju-e4d256-prod-github-runner-207 kernel: [74328.613477] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:02:34 juju-e4d256-prod-github-runner-207 kernel: [74328.614173] ? do_syscall_64+0x69/0xc0 Aug 23 02:02:34 juju-e4d256-prod-github-runner-207 kernel: [74328.614799] ? do_syscall_64+0x69/0xc0 Aug 23 02:02:34 juju-e4d256-prod-github-runner-207 kernel: [74328.615421] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 02:02:34 juju-e4d256-prod-github-runner-207 kernel: [74328.616136] RIP: 0033:0x7faa5d0edaff Aug 23 02:02:34 juju-e4d256-prod-github-runner-207 kernel: [74328.616794] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 02:02:34 juju-e4d256-prod-github-runner-207 kernel: [74328.618811] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 02:02:34 juju-e4d256-prod-github-runner-207 kernel: [74328.619721] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 02:02:34 juju-e4d256-prod-github-runner-207 kernel: [74328.620617] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 02:02:34 juju-e4d256-prod-github-runner-207 kernel: [74328.621528] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 02:02:34 juju-e4d256-prod-github-runner-207 kernel: [74328.622428] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 02:02:34 juju-e4d256-prod-github-runner-207 kernel: [74328.623315] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 02:02:34 juju-e4d256-prod-github-runner-207 kernel: [74328.624205] Aug 23 02:02:48 juju-e4d256-prod-github-runner-207 kernel: [74342.144706] rcu: INFO: rcu_sched self-detected stall on CPU Aug 23 02:02:48 juju-e4d256-prod-github-runner-207 kernel: [74342.145689] rcu: 1-....: (18497889 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=8939241 Aug 23 02:02:48 juju-e4d256-prod-github-runner-207 kernel: [74342.146850] (t=18556236 jiffies g=23269 q=63087) Aug 23 02:02:48 juju-e4d256-prod-github-runner-207 kernel: [74342.147639] NMI backtrace for cpu 1 Aug 23 02:02:48 juju-e4d256-prod-github-runner-207 kernel: [74342.148355] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 02:02:48 juju-e4d256-prod-github-runner-207 kernel: [74342.149506] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 02:02:48 juju-e4d256-prod-github-runner-207 kernel: [74342.150582] Call Trace: Aug 23 02:02:48 juju-e4d256-prod-github-runner-207 kernel: [74342.151259] Aug 23 02:02:48 juju-e4d256-prod-github-runner-207 kernel: [74342.151909] show_stack+0x52/0x5c Aug 23 02:02:48 juju-e4d256-prod-github-runner-207 kernel: [74342.152632] dump_stack_lvl+0x4a/0x63 Aug 23 02:02:48 juju-e4d256-prod-github-runner-207 kernel: [74342.153393] dump_stack+0x10/0x16 Aug 23 02:02:48 juju-e4d256-prod-github-runner-207 kernel: [74342.154116] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 23 02:02:48 juju-e4d256-prod-github-runner-207 kernel: [74342.154904] ? lapic_can_unplug_cpu+0x90/0x90 Aug 23 02:02:48 juju-e4d256-prod-github-runner-207 kernel: [74342.155685] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 23 02:02:48 juju-e4d256-prod-github-runner-207 kernel: [74342.156513] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 23 02:02:48 juju-e4d256-prod-github-runner-207 kernel: [74342.157356] trigger_single_cpu_backtrace+0x44/0x4f Aug 23 02:02:48 juju-e4d256-prod-github-runner-207 kernel: [74342.158169] rcu_dump_cpu_stacks+0x102/0x149 Aug 23 02:02:48 juju-e4d256-prod-github-runner-207 kernel: [74342.158945] print_cpu_stall.cold+0x2f/0xe2 Aug 23 02:02:48 juju-e4d256-prod-github-runner-207 kernel: [74342.159717] ? timekeeping_update+0xf7/0x150 Aug 23 02:02:48 juju-e4d256-prod-github-runner-207 kernel: [74342.160496] check_cpu_stall+0x109/0x270 Aug 23 02:02:48 juju-e4d256-prod-github-runner-207 kernel: [74342.161263] rcu_sched_clock_irq+0x9a/0x250 Aug 23 02:02:48 juju-e4d256-prod-github-runner-207 kernel: [74342.162025] update_process_times+0x94/0xd0 Aug 23 02:02:48 juju-e4d256-prod-github-runner-207 kernel: [74342.162789] tick_sched_handle+0x29/0x70 Aug 23 02:02:48 juju-e4d256-prod-github-runner-207 kernel: [74342.163534] tick_sched_timer+0x8c/0xc0 Aug 23 02:02:48 juju-e4d256-prod-github-runner-207 kernel: [74342.164272] ? tick_nohz_handler+0xb0/0xb0 Aug 23 02:02:48 juju-e4d256-prod-github-runner-207 kernel: [74342.165064] __hrtimer_run_queues+0x107/0x230 Aug 23 02:02:48 juju-e4d256-prod-github-runner-207 kernel: [74342.165842] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 02:02:48 juju-e4d256-prod-github-runner-207 kernel: [74342.166620] hrtimer_interrupt+0x101/0x220 Aug 23 02:02:48 juju-e4d256-prod-github-runner-207 kernel: [74342.167386] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 02:02:48 juju-e4d256-prod-github-runner-207 kernel: [74342.168199] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 02:02:48 juju-e4d256-prod-github-runner-207 kernel: [74342.169041] Aug 23 02:02:48 juju-e4d256-prod-github-runner-207 kernel: [74342.169679] Aug 23 02:02:48 juju-e4d256-prod-github-runner-207 kernel: [74342.170319] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 02:02:48 juju-e4d256-prod-github-runner-207 kernel: [74342.171144] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:02:48 juju-e4d256-prod-github-runner-207 kernel: [74342.172028] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 02:02:48 juju-e4d256-prod-github-runner-207 kernel: [74342.174254] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 02:02:48 juju-e4d256-prod-github-runner-207 kernel: [74342.175131] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 02:02:48 juju-e4d256-prod-github-runner-207 kernel: [74342.176128] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 02:02:48 juju-e4d256-prod-github-runner-207 kernel: [74342.177127] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 02:02:48 juju-e4d256-prod-github-runner-207 kernel: [74342.178098] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 02:02:48 juju-e4d256-prod-github-runner-207 kernel: [74342.179068] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 02:02:48 juju-e4d256-prod-github-runner-207 kernel: [74342.180028] ? _raw_spin_lock+0x22/0x30 Aug 23 02:02:48 juju-e4d256-prod-github-runner-207 kernel: [74342.180797] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:02:48 juju-e4d256-prod-github-runner-207 kernel: [74342.181649] direct_page_fault+0x206/0x310 [kvm] Aug 23 02:02:48 juju-e4d256-prod-github-runner-207 kernel: [74342.182496] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 02:02:48 juju-e4d256-prod-github-runner-207 kernel: [74342.183343] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 02:02:48 juju-e4d256-prod-github-runner-207 kernel: [74342.184165] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 02:02:48 juju-e4d256-prod-github-runner-207 kernel: [74342.185002] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 02:02:48 juju-e4d256-prod-github-runner-207 kernel: [74342.185811] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 02:02:48 juju-e4d256-prod-github-runner-207 kernel: [74342.186652] handle_exit+0x98/0x230 [kvm_amd] Aug 23 02:02:48 juju-e4d256-prod-github-runner-207 kernel: [74342.187415] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 02:02:48 juju-e4d256-prod-github-runner-207 kernel: [74342.188199] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 02:02:48 juju-e4d256-prod-github-runner-207 kernel: [74342.189014] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 02:02:48 juju-e4d256-prod-github-runner-207 kernel: [74342.189805] vcpu_run+0x62/0x2c0 [kvm] Aug 23 02:02:48 juju-e4d256-prod-github-runner-207 kernel: [74342.190520] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 02:02:48 juju-e4d256-prod-github-runner-207 kernel: [74342.191262] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 02:02:48 juju-e4d256-prod-github-runner-207 kernel: [74342.192067] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 02:02:48 juju-e4d256-prod-github-runner-207 kernel: [74342.192835] ? __seccomp_filter+0x4a/0x4a0 Aug 23 02:02:48 juju-e4d256-prod-github-runner-207 kernel: [74342.193574] ? __fget_files+0x86/0xc0 Aug 23 02:02:48 juju-e4d256-prod-github-runner-207 kernel: [74342.194273] __x64_sys_ioctl+0x95/0xd0 Aug 23 02:02:48 juju-e4d256-prod-github-runner-207 kernel: [74342.194972] do_syscall_64+0x5c/0xc0 Aug 23 02:02:48 juju-e4d256-prod-github-runner-207 kernel: [74342.195650] ? do_futex+0x162/0x1f0 Aug 23 02:02:48 juju-e4d256-prod-github-runner-207 kernel: [74342.196335] ? __x64_sys_futex+0x78/0x1e0 Aug 23 02:02:48 juju-e4d256-prod-github-runner-207 kernel: [74342.197055] ? __secure_computing+0xa9/0x120 Aug 23 02:02:48 juju-e4d256-prod-github-runner-207 kernel: [74342.197772] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 02:02:48 juju-e4d256-prod-github-runner-207 kernel: [74342.198561] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:02:48 juju-e4d256-prod-github-runner-207 kernel: [74342.199319] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:02:48 juju-e4d256-prod-github-runner-207 kernel: [74342.200075] ? do_syscall_64+0x69/0xc0 Aug 23 02:02:48 juju-e4d256-prod-github-runner-207 kernel: [74342.200763] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:02:48 juju-e4d256-prod-github-runner-207 kernel: [74342.201538] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:02:48 juju-e4d256-prod-github-runner-207 kernel: [74342.202297] ? do_syscall_64+0x69/0xc0 Aug 23 02:02:48 juju-e4d256-prod-github-runner-207 kernel: [74342.202996] ? do_syscall_64+0x69/0xc0 Aug 23 02:02:48 juju-e4d256-prod-github-runner-207 kernel: [74342.203683] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 02:02:48 juju-e4d256-prod-github-runner-207 kernel: [74342.204453] RIP: 0033:0x7faa5d0edaff Aug 23 02:02:48 juju-e4d256-prod-github-runner-207 kernel: [74342.205159] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 02:02:48 juju-e4d256-prod-github-runner-207 kernel: [74342.207279] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 02:02:48 juju-e4d256-prod-github-runner-207 kernel: [74342.208243] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 02:02:48 juju-e4d256-prod-github-runner-207 kernel: [74342.209212] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 02:02:48 juju-e4d256-prod-github-runner-207 kernel: [74342.210162] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 02:02:48 juju-e4d256-prod-github-runner-207 kernel: [74342.211101] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 02:02:48 juju-e4d256-prod-github-runner-207 kernel: [74342.212033] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 02:02:48 juju-e4d256-prod-github-runner-207 kernel: [74342.212964] Aug 23 02:03:14 juju-e4d256-prod-github-runner-207 kernel: [74368.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 69153s! [qemu-system-x86:6715] Aug 23 02:03:14 juju-e4d256-prod-github-runner-207 kernel: [74368.543747] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 02:03:14 juju-e4d256-prod-github-runner-207 kernel: [74368.544011] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 02:03:14 juju-e4d256-prod-github-runner-207 kernel: [74368.556200] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 02:03:14 juju-e4d256-prod-github-runner-207 kernel: [74368.557485] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 02:03:14 juju-e4d256-prod-github-runner-207 kernel: [74368.558711] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:03:14 juju-e4d256-prod-github-runner-207 kernel: [74368.559774] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 02:03:14 juju-e4d256-prod-github-runner-207 kernel: [74368.562339] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 02:03:14 juju-e4d256-prod-github-runner-207 kernel: [74368.563388] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 02:03:14 juju-e4d256-prod-github-runner-207 kernel: [74368.564549] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 02:03:14 juju-e4d256-prod-github-runner-207 kernel: [74368.565722] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 02:03:14 juju-e4d256-prod-github-runner-207 kernel: [74368.566882] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 02:03:14 juju-e4d256-prod-github-runner-207 kernel: [74368.568043] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 02:03:14 juju-e4d256-prod-github-runner-207 kernel: [74368.569220] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 02:03:14 juju-e4d256-prod-github-runner-207 kernel: [74368.570463] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 02:03:14 juju-e4d256-prod-github-runner-207 kernel: [74368.571565] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 02:03:14 juju-e4d256-prod-github-runner-207 kernel: [74368.572768] Call Trace: Aug 23 02:03:14 juju-e4d256-prod-github-runner-207 kernel: [74368.573687] Aug 23 02:03:14 juju-e4d256-prod-github-runner-207 kernel: [74368.574582] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:03:14 juju-e4d256-prod-github-runner-207 kernel: [74368.575614] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:03:14 juju-e4d256-prod-github-runner-207 kernel: [74368.576652] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:03:14 juju-e4d256-prod-github-runner-207 kernel: [74368.577756] ? show_regs.part.0+0x23/0x29 Aug 23 02:03:14 juju-e4d256-prod-github-runner-207 kernel: [74368.578754] ? show_regs.cold+0x8/0xd Aug 23 02:03:14 juju-e4d256-prod-github-runner-207 kernel: [74368.579729] ? watchdog_timer_fn+0x1be/0x220 Aug 23 02:03:14 juju-e4d256-prod-github-runner-207 kernel: [74368.580748] ? lockup_detector_update_enable+0x60/0x60 Aug 23 02:03:14 juju-e4d256-prod-github-runner-207 kernel: [74368.581811] ? __hrtimer_run_queues+0x107/0x230 Aug 23 02:03:14 juju-e4d256-prod-github-runner-207 kernel: [74368.582843] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 02:03:14 juju-e4d256-prod-github-runner-207 kernel: [74368.583867] ? hrtimer_interrupt+0x101/0x220 Aug 23 02:03:14 juju-e4d256-prod-github-runner-207 kernel: [74368.584888] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 02:03:14 juju-e4d256-prod-github-runner-207 kernel: [74368.585956] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 02:03:14 juju-e4d256-prod-github-runner-207 kernel: [74368.587001] Aug 23 02:03:14 juju-e4d256-prod-github-runner-207 kernel: [74368.587852] Aug 23 02:03:14 juju-e4d256-prod-github-runner-207 kernel: [74368.588698] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 02:03:14 juju-e4d256-prod-github-runner-207 kernel: [74368.589737] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:03:14 juju-e4d256-prod-github-runner-207 kernel: [74368.590777] ? _raw_spin_lock+0x22/0x30 Aug 23 02:03:14 juju-e4d256-prod-github-runner-207 kernel: [74368.591722] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:03:14 juju-e4d256-prod-github-runner-207 kernel: [74368.592752] direct_page_fault+0x206/0x310 [kvm] Aug 23 02:03:14 juju-e4d256-prod-github-runner-207 kernel: [74368.593776] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 02:03:14 juju-e4d256-prod-github-runner-207 kernel: [74368.594786] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 02:03:14 juju-e4d256-prod-github-runner-207 kernel: [74368.595786] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 02:03:14 juju-e4d256-prod-github-runner-207 kernel: [74368.596796] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 02:03:14 juju-e4d256-prod-github-runner-207 kernel: [74368.597741] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 02:03:14 juju-e4d256-prod-github-runner-207 kernel: [74368.598723] handle_exit+0x98/0x230 [kvm_amd] Aug 23 02:03:14 juju-e4d256-prod-github-runner-207 kernel: [74368.599620] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 02:03:14 juju-e4d256-prod-github-runner-207 kernel: [74368.600535] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 02:03:14 juju-e4d256-prod-github-runner-207 kernel: [74368.601477] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 02:03:14 juju-e4d256-prod-github-runner-207 kernel: [74368.602380] vcpu_run+0x62/0x2c0 [kvm] Aug 23 02:03:14 juju-e4d256-prod-github-runner-207 kernel: [74368.603195] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 02:03:14 juju-e4d256-prod-github-runner-207 kernel: [74368.604008] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 02:03:14 juju-e4d256-prod-github-runner-207 kernel: [74368.604874] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 02:03:14 juju-e4d256-prod-github-runner-207 kernel: [74368.605678] ? __seccomp_filter+0x4a/0x4a0 Aug 23 02:03:14 juju-e4d256-prod-github-runner-207 kernel: [74368.606420] ? __fget_files+0x86/0xc0 Aug 23 02:03:14 juju-e4d256-prod-github-runner-207 kernel: [74368.607129] __x64_sys_ioctl+0x95/0xd0 Aug 23 02:03:14 juju-e4d256-prod-github-runner-207 kernel: [74368.607820] do_syscall_64+0x5c/0xc0 Aug 23 02:03:14 juju-e4d256-prod-github-runner-207 kernel: [74368.608485] ? do_futex+0x162/0x1f0 Aug 23 02:03:14 juju-e4d256-prod-github-runner-207 kernel: [74368.609145] ? __x64_sys_futex+0x78/0x1e0 Aug 23 02:03:14 juju-e4d256-prod-github-runner-207 kernel: [74368.609820] ? __secure_computing+0xa9/0x120 Aug 23 02:03:14 juju-e4d256-prod-github-runner-207 kernel: [74368.610508] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 02:03:14 juju-e4d256-prod-github-runner-207 kernel: [74368.611268] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:03:14 juju-e4d256-prod-github-runner-207 kernel: [74368.611989] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:03:14 juju-e4d256-prod-github-runner-207 kernel: [74368.612714] ? do_syscall_64+0x69/0xc0 Aug 23 02:03:14 juju-e4d256-prod-github-runner-207 kernel: [74368.613360] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:03:14 juju-e4d256-prod-github-runner-207 kernel: [74368.614071] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:03:14 juju-e4d256-prod-github-runner-207 kernel: [74368.614768] ? do_syscall_64+0x69/0xc0 Aug 23 02:03:14 juju-e4d256-prod-github-runner-207 kernel: [74368.615394] ? do_syscall_64+0x69/0xc0 Aug 23 02:03:14 juju-e4d256-prod-github-runner-207 kernel: [74368.616017] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 02:03:14 juju-e4d256-prod-github-runner-207 kernel: [74368.616731] RIP: 0033:0x7faa5d0edaff Aug 23 02:03:14 juju-e4d256-prod-github-runner-207 kernel: [74368.617385] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 02:03:14 juju-e4d256-prod-github-runner-207 kernel: [74368.619373] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 02:03:14 juju-e4d256-prod-github-runner-207 kernel: [74368.620290] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 02:03:14 juju-e4d256-prod-github-runner-207 kernel: [74368.621193] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 02:03:14 juju-e4d256-prod-github-runner-207 kernel: [74368.622082] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 02:03:14 juju-e4d256-prod-github-runner-207 kernel: [74368.622972] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 02:03:14 juju-e4d256-prod-github-runner-207 kernel: [74368.623861] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 02:03:14 juju-e4d256-prod-github-runner-207 kernel: [74368.624765] Aug 23 02:03:42 juju-e4d256-prod-github-runner-207 kernel: [74396.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 69179s! [qemu-system-x86:6715] Aug 23 02:03:42 juju-e4d256-prod-github-runner-207 kernel: [74396.543092] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 02:03:42 juju-e4d256-prod-github-runner-207 kernel: [74396.543160] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 02:03:42 juju-e4d256-prod-github-runner-207 kernel: [74396.555181] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 02:03:42 juju-e4d256-prod-github-runner-207 kernel: [74396.556459] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 02:03:42 juju-e4d256-prod-github-runner-207 kernel: [74396.557681] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:03:42 juju-e4d256-prod-github-runner-207 kernel: [74396.558738] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 02:03:42 juju-e4d256-prod-github-runner-207 kernel: [74396.561283] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 02:03:42 juju-e4d256-prod-github-runner-207 kernel: [74396.562325] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 02:03:42 juju-e4d256-prod-github-runner-207 kernel: [74396.563485] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 02:03:42 juju-e4d256-prod-github-runner-207 kernel: [74396.564648] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 02:03:42 juju-e4d256-prod-github-runner-207 kernel: [74396.565812] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 02:03:42 juju-e4d256-prod-github-runner-207 kernel: [74396.566973] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 02:03:42 juju-e4d256-prod-github-runner-207 kernel: [74396.568137] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 02:03:42 juju-e4d256-prod-github-runner-207 kernel: [74396.569383] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 02:03:42 juju-e4d256-prod-github-runner-207 kernel: [74396.570485] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 02:03:42 juju-e4d256-prod-github-runner-207 kernel: [74396.571679] Call Trace: Aug 23 02:03:42 juju-e4d256-prod-github-runner-207 kernel: [74396.572598] Aug 23 02:03:42 juju-e4d256-prod-github-runner-207 kernel: [74396.573483] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:03:42 juju-e4d256-prod-github-runner-207 kernel: [74396.574511] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:03:42 juju-e4d256-prod-github-runner-207 kernel: [74396.575533] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:03:42 juju-e4d256-prod-github-runner-207 kernel: [74396.576624] ? show_regs.part.0+0x23/0x29 Aug 23 02:03:42 juju-e4d256-prod-github-runner-207 kernel: [74396.577622] ? show_regs.cold+0x8/0xd Aug 23 02:03:42 juju-e4d256-prod-github-runner-207 kernel: [74396.578598] ? watchdog_timer_fn+0x1be/0x220 Aug 23 02:03:42 juju-e4d256-prod-github-runner-207 kernel: [74396.579605] ? lockup_detector_update_enable+0x60/0x60 Aug 23 02:03:42 juju-e4d256-prod-github-runner-207 kernel: [74396.580673] ? __hrtimer_run_queues+0x107/0x230 Aug 23 02:03:42 juju-e4d256-prod-github-runner-207 kernel: [74396.581702] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 02:03:42 juju-e4d256-prod-github-runner-207 kernel: [74396.582725] ? hrtimer_interrupt+0x101/0x220 Aug 23 02:03:42 juju-e4d256-prod-github-runner-207 kernel: [74396.583739] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 02:03:42 juju-e4d256-prod-github-runner-207 kernel: [74396.584819] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 02:03:42 juju-e4d256-prod-github-runner-207 kernel: [74396.585866] Aug 23 02:03:42 juju-e4d256-prod-github-runner-207 kernel: [74396.586719] Aug 23 02:03:42 juju-e4d256-prod-github-runner-207 kernel: [74396.587560] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 02:03:42 juju-e4d256-prod-github-runner-207 kernel: [74396.588598] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:03:42 juju-e4d256-prod-github-runner-207 kernel: [74396.589637] ? _raw_spin_lock+0x22/0x30 Aug 23 02:03:42 juju-e4d256-prod-github-runner-207 kernel: [74396.590580] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:03:42 juju-e4d256-prod-github-runner-207 kernel: [74396.591595] direct_page_fault+0x206/0x310 [kvm] Aug 23 02:03:42 juju-e4d256-prod-github-runner-207 kernel: [74396.592628] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 02:03:42 juju-e4d256-prod-github-runner-207 kernel: [74396.593636] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 02:03:42 juju-e4d256-prod-github-runner-207 kernel: [74396.594633] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 02:03:42 juju-e4d256-prod-github-runner-207 kernel: [74396.595607] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 02:03:42 juju-e4d256-prod-github-runner-207 kernel: [74396.596559] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 02:03:42 juju-e4d256-prod-github-runner-207 kernel: [74396.597543] handle_exit+0x98/0x230 [kvm_amd] Aug 23 02:03:42 juju-e4d256-prod-github-runner-207 kernel: [74396.598434] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 02:03:42 juju-e4d256-prod-github-runner-207 kernel: [74396.599346] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 02:03:42 juju-e4d256-prod-github-runner-207 kernel: [74396.600268] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 02:03:42 juju-e4d256-prod-github-runner-207 kernel: [74396.601185] vcpu_run+0x62/0x2c0 [kvm] Aug 23 02:03:42 juju-e4d256-prod-github-runner-207 kernel: [74396.601995] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 02:03:42 juju-e4d256-prod-github-runner-207 kernel: [74396.602801] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 02:03:42 juju-e4d256-prod-github-runner-207 kernel: [74396.603654] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 02:03:42 juju-e4d256-prod-github-runner-207 kernel: [74396.604464] ? __seccomp_filter+0x4a/0x4a0 Aug 23 02:03:42 juju-e4d256-prod-github-runner-207 kernel: [74396.605207] ? __fget_files+0x86/0xc0 Aug 23 02:03:42 juju-e4d256-prod-github-runner-207 kernel: [74396.606023] __x64_sys_ioctl+0x95/0xd0 Aug 23 02:03:42 juju-e4d256-prod-github-runner-207 kernel: [74396.606745] do_syscall_64+0x5c/0xc0 Aug 23 02:03:42 juju-e4d256-prod-github-runner-207 kernel: [74396.607417] ? do_futex+0x162/0x1f0 Aug 23 02:03:42 juju-e4d256-prod-github-runner-207 kernel: [74396.608065] ? __x64_sys_futex+0x78/0x1e0 Aug 23 02:03:42 juju-e4d256-prod-github-runner-207 kernel: [74396.608754] ? __secure_computing+0xa9/0x120 Aug 23 02:03:42 juju-e4d256-prod-github-runner-207 kernel: [74396.609442] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 02:03:42 juju-e4d256-prod-github-runner-207 kernel: [74396.610203] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:03:42 juju-e4d256-prod-github-runner-207 kernel: [74396.610928] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:03:42 juju-e4d256-prod-github-runner-207 kernel: [74396.611645] ? do_syscall_64+0x69/0xc0 Aug 23 02:03:42 juju-e4d256-prod-github-runner-207 kernel: [74396.612289] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:03:42 juju-e4d256-prod-github-runner-207 kernel: [74396.612999] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:03:42 juju-e4d256-prod-github-runner-207 kernel: [74396.613692] ? do_syscall_64+0x69/0xc0 Aug 23 02:03:42 juju-e4d256-prod-github-runner-207 kernel: [74396.614314] ? do_syscall_64+0x69/0xc0 Aug 23 02:03:42 juju-e4d256-prod-github-runner-207 kernel: [74396.614934] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 02:03:42 juju-e4d256-prod-github-runner-207 kernel: [74396.615636] RIP: 0033:0x7faa5d0edaff Aug 23 02:03:42 juju-e4d256-prod-github-runner-207 kernel: [74396.616282] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 02:03:42 juju-e4d256-prod-github-runner-207 kernel: [74396.618266] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 02:03:42 juju-e4d256-prod-github-runner-207 kernel: [74396.619171] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 02:03:42 juju-e4d256-prod-github-runner-207 kernel: [74396.620056] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 02:03:42 juju-e4d256-prod-github-runner-207 kernel: [74396.620954] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 02:03:42 juju-e4d256-prod-github-runner-207 kernel: [74396.621840] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 02:03:42 juju-e4d256-prod-github-runner-207 kernel: [74396.622725] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 02:03:42 juju-e4d256-prod-github-runner-207 kernel: [74396.623613] Aug 23 02:04:10 juju-e4d256-prod-github-runner-207 kernel: [74424.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 69205s! [qemu-system-x86:6715] Aug 23 02:04:10 juju-e4d256-prod-github-runner-207 kernel: [74424.543121] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 02:04:10 juju-e4d256-prod-github-runner-207 kernel: [74424.543188] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 02:04:10 juju-e4d256-prod-github-runner-207 kernel: [74424.555327] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 02:04:10 juju-e4d256-prod-github-runner-207 kernel: [74424.556634] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 02:04:10 juju-e4d256-prod-github-runner-207 kernel: [74424.557856] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:04:10 juju-e4d256-prod-github-runner-207 kernel: [74424.558913] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 02:04:10 juju-e4d256-prod-github-runner-207 kernel: [74424.561479] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 02:04:10 juju-e4d256-prod-github-runner-207 kernel: [74424.562519] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 02:04:10 juju-e4d256-prod-github-runner-207 kernel: [74424.563682] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 02:04:10 juju-e4d256-prod-github-runner-207 kernel: [74424.564850] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 02:04:10 juju-e4d256-prod-github-runner-207 kernel: [74424.566012] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 02:04:10 juju-e4d256-prod-github-runner-207 kernel: [74424.567195] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 02:04:10 juju-e4d256-prod-github-runner-207 kernel: [74424.568411] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 02:04:10 juju-e4d256-prod-github-runner-207 kernel: [74424.569684] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 02:04:10 juju-e4d256-prod-github-runner-207 kernel: [74424.570828] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 02:04:10 juju-e4d256-prod-github-runner-207 kernel: [74424.572061] Call Trace: Aug 23 02:04:10 juju-e4d256-prod-github-runner-207 kernel: [74424.572989] Aug 23 02:04:10 juju-e4d256-prod-github-runner-207 kernel: [74424.573888] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:04:10 juju-e4d256-prod-github-runner-207 kernel: [74424.574917] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:04:10 juju-e4d256-prod-github-runner-207 kernel: [74424.575943] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:04:10 juju-e4d256-prod-github-runner-207 kernel: [74424.577054] ? show_regs.part.0+0x23/0x29 Aug 23 02:04:10 juju-e4d256-prod-github-runner-207 kernel: [74424.578064] ? show_regs.cold+0x8/0xd Aug 23 02:04:10 juju-e4d256-prod-github-runner-207 kernel: [74424.579037] ? watchdog_timer_fn+0x1be/0x220 Aug 23 02:04:10 juju-e4d256-prod-github-runner-207 kernel: [74424.580057] ? lockup_detector_update_enable+0x60/0x60 Aug 23 02:04:10 juju-e4d256-prod-github-runner-207 kernel: [74424.581122] ? __hrtimer_run_queues+0x107/0x230 Aug 23 02:04:10 juju-e4d256-prod-github-runner-207 kernel: [74424.582164] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 02:04:10 juju-e4d256-prod-github-runner-207 kernel: [74424.583187] ? hrtimer_interrupt+0x101/0x220 Aug 23 02:04:10 juju-e4d256-prod-github-runner-207 kernel: [74424.584208] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 02:04:10 juju-e4d256-prod-github-runner-207 kernel: [74424.585281] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 02:04:10 juju-e4d256-prod-github-runner-207 kernel: [74424.586325] Aug 23 02:04:10 juju-e4d256-prod-github-runner-207 kernel: [74424.587177] Aug 23 02:04:10 juju-e4d256-prod-github-runner-207 kernel: [74424.588024] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 02:04:10 juju-e4d256-prod-github-runner-207 kernel: [74424.589066] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:04:10 juju-e4d256-prod-github-runner-207 kernel: [74424.590116] ? _raw_spin_lock+0x22/0x30 Aug 23 02:04:10 juju-e4d256-prod-github-runner-207 kernel: [74424.591068] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:04:10 juju-e4d256-prod-github-runner-207 kernel: [74424.592118] direct_page_fault+0x206/0x310 [kvm] Aug 23 02:04:10 juju-e4d256-prod-github-runner-207 kernel: [74424.593152] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 02:04:10 juju-e4d256-prod-github-runner-207 kernel: [74424.594160] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 02:04:10 juju-e4d256-prod-github-runner-207 kernel: [74424.595162] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 02:04:10 juju-e4d256-prod-github-runner-207 kernel: [74424.596135] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 02:04:10 juju-e4d256-prod-github-runner-207 kernel: [74424.597079] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 02:04:10 juju-e4d256-prod-github-runner-207 kernel: [74424.598053] handle_exit+0x98/0x230 [kvm_amd] Aug 23 02:04:10 juju-e4d256-prod-github-runner-207 kernel: [74424.598941] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 02:04:10 juju-e4d256-prod-github-runner-207 kernel: [74424.599851] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 02:04:10 juju-e4d256-prod-github-runner-207 kernel: [74424.600784] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 02:04:10 juju-e4d256-prod-github-runner-207 kernel: [74424.601682] vcpu_run+0x62/0x2c0 [kvm] Aug 23 02:04:10 juju-e4d256-prod-github-runner-207 kernel: [74424.602497] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 02:04:10 juju-e4d256-prod-github-runner-207 kernel: [74424.603312] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 02:04:10 juju-e4d256-prod-github-runner-207 kernel: [74424.604179] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 02:04:10 juju-e4d256-prod-github-runner-207 kernel: [74424.604973] ? __seccomp_filter+0x4a/0x4a0 Aug 23 02:04:10 juju-e4d256-prod-github-runner-207 kernel: [74424.605732] ? __fget_files+0x86/0xc0 Aug 23 02:04:10 juju-e4d256-prod-github-runner-207 kernel: [74424.606436] __x64_sys_ioctl+0x95/0xd0 Aug 23 02:04:10 juju-e4d256-prod-github-runner-207 kernel: [74424.607141] do_syscall_64+0x5c/0xc0 Aug 23 02:04:10 juju-e4d256-prod-github-runner-207 kernel: [74424.607822] ? do_futex+0x162/0x1f0 Aug 23 02:04:10 juju-e4d256-prod-github-runner-207 kernel: [74424.608501] ? __x64_sys_futex+0x78/0x1e0 Aug 23 02:04:10 juju-e4d256-prod-github-runner-207 kernel: [74424.609195] ? __secure_computing+0xa9/0x120 Aug 23 02:04:10 juju-e4d256-prod-github-runner-207 kernel: [74424.609906] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 02:04:10 juju-e4d256-prod-github-runner-207 kernel: [74424.610692] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:04:10 juju-e4d256-prod-github-runner-207 kernel: [74424.611425] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:04:10 juju-e4d256-prod-github-runner-207 kernel: [74424.612176] ? do_syscall_64+0x69/0xc0 Aug 23 02:04:10 juju-e4d256-prod-github-runner-207 kernel: [74424.612831] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:04:10 juju-e4d256-prod-github-runner-207 kernel: [74424.613535] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:04:10 juju-e4d256-prod-github-runner-207 kernel: [74424.614228] ? do_syscall_64+0x69/0xc0 Aug 23 02:04:10 juju-e4d256-prod-github-runner-207 kernel: [74424.614851] ? do_syscall_64+0x69/0xc0 Aug 23 02:04:10 juju-e4d256-prod-github-runner-207 kernel: [74424.615469] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 02:04:10 juju-e4d256-prod-github-runner-207 kernel: [74424.616187] RIP: 0033:0x7faa5d0edaff Aug 23 02:04:10 juju-e4d256-prod-github-runner-207 kernel: [74424.616818] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 02:04:10 juju-e4d256-prod-github-runner-207 kernel: [74424.618822] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 02:04:10 juju-e4d256-prod-github-runner-207 kernel: [74424.619731] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 02:04:10 juju-e4d256-prod-github-runner-207 kernel: [74424.620634] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 02:04:10 juju-e4d256-prod-github-runner-207 kernel: [74424.621521] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 02:04:10 juju-e4d256-prod-github-runner-207 kernel: [74424.622407] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 02:04:10 juju-e4d256-prod-github-runner-207 kernel: [74424.623296] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 02:04:10 juju-e4d256-prod-github-runner-207 kernel: [74424.624193] Aug 23 02:04:38 juju-e4d256-prod-github-runner-207 kernel: [74452.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 69231s! [qemu-system-x86:6715] Aug 23 02:04:38 juju-e4d256-prod-github-runner-207 kernel: [74452.543774] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 02:04:38 juju-e4d256-prod-github-runner-207 kernel: [74452.544042] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 02:04:38 juju-e4d256-prod-github-runner-207 kernel: [74452.556268] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 02:04:38 juju-e4d256-prod-github-runner-207 kernel: [74452.557543] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 02:04:38 juju-e4d256-prod-github-runner-207 kernel: [74452.558765] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:04:38 juju-e4d256-prod-github-runner-207 kernel: [74452.559853] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 02:04:38 juju-e4d256-prod-github-runner-207 kernel: [74452.562421] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 02:04:38 juju-e4d256-prod-github-runner-207 kernel: [74452.563466] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 02:04:38 juju-e4d256-prod-github-runner-207 kernel: [74452.564659] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 02:04:38 juju-e4d256-prod-github-runner-207 kernel: [74452.565822] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 02:04:38 juju-e4d256-prod-github-runner-207 kernel: [74452.566992] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 02:04:38 juju-e4d256-prod-github-runner-207 kernel: [74452.568185] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 02:04:38 juju-e4d256-prod-github-runner-207 kernel: [74452.569534] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 02:04:38 juju-e4d256-prod-github-runner-207 kernel: [74452.570768] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 02:04:38 juju-e4d256-prod-github-runner-207 kernel: [74452.571876] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 02:04:38 juju-e4d256-prod-github-runner-207 kernel: [74452.573079] Call Trace: Aug 23 02:04:38 juju-e4d256-prod-github-runner-207 kernel: [74452.573996] Aug 23 02:04:38 juju-e4d256-prod-github-runner-207 kernel: [74452.574888] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:04:38 juju-e4d256-prod-github-runner-207 kernel: [74452.575932] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:04:38 juju-e4d256-prod-github-runner-207 kernel: [74452.576957] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:04:38 juju-e4d256-prod-github-runner-207 kernel: [74452.578044] ? show_regs.part.0+0x23/0x29 Aug 23 02:04:38 juju-e4d256-prod-github-runner-207 kernel: [74452.579043] ? show_regs.cold+0x8/0xd Aug 23 02:04:38 juju-e4d256-prod-github-runner-207 kernel: [74452.580031] ? watchdog_timer_fn+0x1be/0x220 Aug 23 02:04:38 juju-e4d256-prod-github-runner-207 kernel: [74452.581041] ? lockup_detector_update_enable+0x60/0x60 Aug 23 02:04:38 juju-e4d256-prod-github-runner-207 kernel: [74452.582105] ? __hrtimer_run_queues+0x107/0x230 Aug 23 02:04:38 juju-e4d256-prod-github-runner-207 kernel: [74452.583137] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 02:04:38 juju-e4d256-prod-github-runner-207 kernel: [74452.584179] ? hrtimer_interrupt+0x101/0x220 Aug 23 02:04:38 juju-e4d256-prod-github-runner-207 kernel: [74452.585196] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 02:04:38 juju-e4d256-prod-github-runner-207 kernel: [74452.586265] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 02:04:38 juju-e4d256-prod-github-runner-207 kernel: [74452.587315] Aug 23 02:04:38 juju-e4d256-prod-github-runner-207 kernel: [74452.588179] Aug 23 02:04:38 juju-e4d256-prod-github-runner-207 kernel: [74452.589017] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 02:04:38 juju-e4d256-prod-github-runner-207 kernel: [74452.590052] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:04:38 juju-e4d256-prod-github-runner-207 kernel: [74452.591089] ? _raw_spin_lock+0x22/0x30 Aug 23 02:04:38 juju-e4d256-prod-github-runner-207 kernel: [74452.592049] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:04:38 juju-e4d256-prod-github-runner-207 kernel: [74452.593069] direct_page_fault+0x206/0x310 [kvm] Aug 23 02:04:38 juju-e4d256-prod-github-runner-207 kernel: [74452.594099] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 02:04:38 juju-e4d256-prod-github-runner-207 kernel: [74452.595115] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 02:04:38 juju-e4d256-prod-github-runner-207 kernel: [74452.596137] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 02:04:38 juju-e4d256-prod-github-runner-207 kernel: [74452.597127] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 02:04:38 juju-e4d256-prod-github-runner-207 kernel: [74452.598077] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 02:04:38 juju-e4d256-prod-github-runner-207 kernel: [74452.599057] handle_exit+0x98/0x230 [kvm_amd] Aug 23 02:04:38 juju-e4d256-prod-github-runner-207 kernel: [74452.599966] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 02:04:38 juju-e4d256-prod-github-runner-207 kernel: [74452.600878] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 02:04:38 juju-e4d256-prod-github-runner-207 kernel: [74452.601798] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 02:04:38 juju-e4d256-prod-github-runner-207 kernel: [74452.602704] vcpu_run+0x62/0x2c0 [kvm] Aug 23 02:04:38 juju-e4d256-prod-github-runner-207 kernel: [74452.603511] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 02:04:38 juju-e4d256-prod-github-runner-207 kernel: [74452.604331] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 02:04:38 juju-e4d256-prod-github-runner-207 kernel: [74452.605189] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 02:04:38 juju-e4d256-prod-github-runner-207 kernel: [74452.605984] ? __seccomp_filter+0x4a/0x4a0 Aug 23 02:04:38 juju-e4d256-prod-github-runner-207 kernel: [74452.606723] ? __fget_files+0x86/0xc0 Aug 23 02:04:38 juju-e4d256-prod-github-runner-207 kernel: [74452.607429] __x64_sys_ioctl+0x95/0xd0 Aug 23 02:04:38 juju-e4d256-prod-github-runner-207 kernel: [74452.608135] do_syscall_64+0x5c/0xc0 Aug 23 02:04:38 juju-e4d256-prod-github-runner-207 kernel: [74452.608797] ? do_futex+0x162/0x1f0 Aug 23 02:04:38 juju-e4d256-prod-github-runner-207 kernel: [74452.609448] ? __x64_sys_futex+0x78/0x1e0 Aug 23 02:04:38 juju-e4d256-prod-github-runner-207 kernel: [74452.610118] ? __secure_computing+0xa9/0x120 Aug 23 02:04:38 juju-e4d256-prod-github-runner-207 kernel: [74452.610874] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 02:04:38 juju-e4d256-prod-github-runner-207 kernel: [74452.611631] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:04:38 juju-e4d256-prod-github-runner-207 kernel: [74452.612364] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:04:38 juju-e4d256-prod-github-runner-207 kernel: [74452.613079] ? do_syscall_64+0x69/0xc0 Aug 23 02:04:38 juju-e4d256-prod-github-runner-207 kernel: [74452.613722] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:04:38 juju-e4d256-prod-github-runner-207 kernel: [74452.614422] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:04:38 juju-e4d256-prod-github-runner-207 kernel: [74452.615121] ? do_syscall_64+0x69/0xc0 Aug 23 02:04:38 juju-e4d256-prod-github-runner-207 kernel: [74452.615753] ? do_syscall_64+0x69/0xc0 Aug 23 02:04:38 juju-e4d256-prod-github-runner-207 kernel: [74452.616372] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 02:04:38 juju-e4d256-prod-github-runner-207 kernel: [74452.617073] RIP: 0033:0x7faa5d0edaff Aug 23 02:04:38 juju-e4d256-prod-github-runner-207 kernel: [74452.617705] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 02:04:38 juju-e4d256-prod-github-runner-207 kernel: [74452.619697] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 02:04:38 juju-e4d256-prod-github-runner-207 kernel: [74452.620607] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 02:04:38 juju-e4d256-prod-github-runner-207 kernel: [74452.621494] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 02:04:38 juju-e4d256-prod-github-runner-207 kernel: [74452.622378] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 02:04:38 juju-e4d256-prod-github-runner-207 kernel: [74452.623262] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 02:04:38 juju-e4d256-prod-github-runner-207 kernel: [74452.624163] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 02:04:38 juju-e4d256-prod-github-runner-207 kernel: [74452.625051] Aug 23 02:05:06 juju-e4d256-prod-github-runner-207 kernel: [74480.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 69257s! [qemu-system-x86:6715] Aug 23 02:05:06 juju-e4d256-prod-github-runner-207 kernel: [74480.543125] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 02:05:06 juju-e4d256-prod-github-runner-207 kernel: [74480.543192] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 02:05:06 juju-e4d256-prod-github-runner-207 kernel: [74480.555334] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 02:05:06 juju-e4d256-prod-github-runner-207 kernel: [74480.556614] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 02:05:06 juju-e4d256-prod-github-runner-207 kernel: [74480.557844] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:05:06 juju-e4d256-prod-github-runner-207 kernel: [74480.558917] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 02:05:06 juju-e4d256-prod-github-runner-207 kernel: [74480.561486] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 02:05:06 juju-e4d256-prod-github-runner-207 kernel: [74480.562536] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 02:05:06 juju-e4d256-prod-github-runner-207 kernel: [74480.563725] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 02:05:06 juju-e4d256-prod-github-runner-207 kernel: [74480.564890] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 02:05:06 juju-e4d256-prod-github-runner-207 kernel: [74480.566050] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 02:05:06 juju-e4d256-prod-github-runner-207 kernel: [74480.567211] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 02:05:06 juju-e4d256-prod-github-runner-207 kernel: [74480.568402] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 02:05:06 juju-e4d256-prod-github-runner-207 kernel: [74480.569645] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 02:05:06 juju-e4d256-prod-github-runner-207 kernel: [74480.570742] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 02:05:06 juju-e4d256-prod-github-runner-207 kernel: [74480.571945] Call Trace: Aug 23 02:05:06 juju-e4d256-prod-github-runner-207 kernel: [74480.572866] Aug 23 02:05:06 juju-e4d256-prod-github-runner-207 kernel: [74480.573768] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:05:06 juju-e4d256-prod-github-runner-207 kernel: [74480.574803] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:05:06 juju-e4d256-prod-github-runner-207 kernel: [74480.575841] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:05:06 juju-e4d256-prod-github-runner-207 kernel: [74480.576916] ? show_regs.part.0+0x23/0x29 Aug 23 02:05:06 juju-e4d256-prod-github-runner-207 kernel: [74480.577926] ? show_regs.cold+0x8/0xd Aug 23 02:05:06 juju-e4d256-prod-github-runner-207 kernel: [74480.578914] ? watchdog_timer_fn+0x1be/0x220 Aug 23 02:05:06 juju-e4d256-prod-github-runner-207 kernel: [74480.579939] ? lockup_detector_update_enable+0x60/0x60 Aug 23 02:05:06 juju-e4d256-prod-github-runner-207 kernel: [74480.581008] ? __hrtimer_run_queues+0x107/0x230 Aug 23 02:05:06 juju-e4d256-prod-github-runner-207 kernel: [74480.582041] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 02:05:06 juju-e4d256-prod-github-runner-207 kernel: [74480.583071] ? hrtimer_interrupt+0x101/0x220 Aug 23 02:05:06 juju-e4d256-prod-github-runner-207 kernel: [74480.584111] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 02:05:06 juju-e4d256-prod-github-runner-207 kernel: [74480.585184] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 02:05:06 juju-e4d256-prod-github-runner-207 kernel: [74480.586231] Aug 23 02:05:06 juju-e4d256-prod-github-runner-207 kernel: [74480.587082] Aug 23 02:05:06 juju-e4d256-prod-github-runner-207 kernel: [74480.587932] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 02:05:06 juju-e4d256-prod-github-runner-207 kernel: [74480.588974] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:05:06 juju-e4d256-prod-github-runner-207 kernel: [74480.590022] ? _raw_spin_lock+0x22/0x30 Aug 23 02:05:06 juju-e4d256-prod-github-runner-207 kernel: [74480.590970] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:05:06 juju-e4d256-prod-github-runner-207 kernel: [74480.592001] direct_page_fault+0x206/0x310 [kvm] Aug 23 02:05:06 juju-e4d256-prod-github-runner-207 kernel: [74480.593023] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 02:05:06 juju-e4d256-prod-github-runner-207 kernel: [74480.594047] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 02:05:06 juju-e4d256-prod-github-runner-207 kernel: [74480.595056] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 02:05:06 juju-e4d256-prod-github-runner-207 kernel: [74480.596043] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 02:05:06 juju-e4d256-prod-github-runner-207 kernel: [74480.596988] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 02:05:06 juju-e4d256-prod-github-runner-207 kernel: [74480.597962] handle_exit+0x98/0x230 [kvm_amd] Aug 23 02:05:06 juju-e4d256-prod-github-runner-207 kernel: [74480.598862] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 02:05:06 juju-e4d256-prod-github-runner-207 kernel: [74480.599807] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 02:05:06 juju-e4d256-prod-github-runner-207 kernel: [74480.600737] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 02:05:06 juju-e4d256-prod-github-runner-207 kernel: [74480.601637] vcpu_run+0x62/0x2c0 [kvm] Aug 23 02:05:06 juju-e4d256-prod-github-runner-207 kernel: [74480.602446] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 02:05:06 juju-e4d256-prod-github-runner-207 kernel: [74480.603258] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 02:05:06 juju-e4d256-prod-github-runner-207 kernel: [74480.604141] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 02:05:06 juju-e4d256-prod-github-runner-207 kernel: [74480.604949] ? __seccomp_filter+0x4a/0x4a0 Aug 23 02:05:06 juju-e4d256-prod-github-runner-207 kernel: [74480.605699] ? __fget_files+0x86/0xc0 Aug 23 02:05:06 juju-e4d256-prod-github-runner-207 kernel: [74480.606402] __x64_sys_ioctl+0x95/0xd0 Aug 23 02:05:06 juju-e4d256-prod-github-runner-207 kernel: [74480.607094] do_syscall_64+0x5c/0xc0 Aug 23 02:05:06 juju-e4d256-prod-github-runner-207 kernel: [74480.607770] ? do_futex+0x162/0x1f0 Aug 23 02:05:06 juju-e4d256-prod-github-runner-207 kernel: [74480.608418] ? __x64_sys_futex+0x78/0x1e0 Aug 23 02:05:06 juju-e4d256-prod-github-runner-207 kernel: [74480.609101] ? __secure_computing+0xa9/0x120 Aug 23 02:05:06 juju-e4d256-prod-github-runner-207 kernel: [74480.609802] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 02:05:06 juju-e4d256-prod-github-runner-207 kernel: [74480.610568] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:05:06 juju-e4d256-prod-github-runner-207 kernel: [74480.611295] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:05:06 juju-e4d256-prod-github-runner-207 kernel: [74480.612025] ? do_syscall_64+0x69/0xc0 Aug 23 02:05:06 juju-e4d256-prod-github-runner-207 kernel: [74480.612674] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:05:06 juju-e4d256-prod-github-runner-207 kernel: [74480.613377] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:05:06 juju-e4d256-prod-github-runner-207 kernel: [74480.614079] ? do_syscall_64+0x69/0xc0 Aug 23 02:05:06 juju-e4d256-prod-github-runner-207 kernel: [74480.614708] ? do_syscall_64+0x69/0xc0 Aug 23 02:05:06 juju-e4d256-prod-github-runner-207 kernel: [74480.615347] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 02:05:06 juju-e4d256-prod-github-runner-207 kernel: [74480.616085] RIP: 0033:0x7faa5d0edaff Aug 23 02:05:06 juju-e4d256-prod-github-runner-207 kernel: [74480.616739] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 02:05:06 juju-e4d256-prod-github-runner-207 kernel: [74480.618728] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 02:05:06 juju-e4d256-prod-github-runner-207 kernel: [74480.619670] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 02:05:06 juju-e4d256-prod-github-runner-207 kernel: [74480.620573] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 02:05:06 juju-e4d256-prod-github-runner-207 kernel: [74480.621465] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 02:05:06 juju-e4d256-prod-github-runner-207 kernel: [74480.622358] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 02:05:06 juju-e4d256-prod-github-runner-207 kernel: [74480.623251] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 02:05:06 juju-e4d256-prod-github-runner-207 kernel: [74480.624160] Aug 23 02:05:34 juju-e4d256-prod-github-runner-207 kernel: [74508.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 69283s! [qemu-system-x86:6715] Aug 23 02:05:34 juju-e4d256-prod-github-runner-207 kernel: [74508.543099] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 02:05:34 juju-e4d256-prod-github-runner-207 kernel: [74508.543166] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 02:05:34 juju-e4d256-prod-github-runner-207 kernel: [74508.555282] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 02:05:34 juju-e4d256-prod-github-runner-207 kernel: [74508.556551] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 02:05:34 juju-e4d256-prod-github-runner-207 kernel: [74508.557771] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:05:34 juju-e4d256-prod-github-runner-207 kernel: [74508.558832] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 02:05:34 juju-e4d256-prod-github-runner-207 kernel: [74508.561432] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 02:05:34 juju-e4d256-prod-github-runner-207 kernel: [74508.562473] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 02:05:34 juju-e4d256-prod-github-runner-207 kernel: [74508.563651] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 02:05:34 juju-e4d256-prod-github-runner-207 kernel: [74508.564817] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 02:05:34 juju-e4d256-prod-github-runner-207 kernel: [74508.565980] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 02:05:34 juju-e4d256-prod-github-runner-207 kernel: [74508.567196] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 02:05:34 juju-e4d256-prod-github-runner-207 kernel: [74508.568371] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 02:05:34 juju-e4d256-prod-github-runner-207 kernel: [74508.569622] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 02:05:34 juju-e4d256-prod-github-runner-207 kernel: [74508.570749] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 02:05:34 juju-e4d256-prod-github-runner-207 kernel: [74508.571954] Call Trace: Aug 23 02:05:34 juju-e4d256-prod-github-runner-207 kernel: [74508.572870] Aug 23 02:05:34 juju-e4d256-prod-github-runner-207 kernel: [74508.573764] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:05:34 juju-e4d256-prod-github-runner-207 kernel: [74508.574801] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:05:34 juju-e4d256-prod-github-runner-207 kernel: [74508.575874] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:05:34 juju-e4d256-prod-github-runner-207 kernel: [74508.576963] ? show_regs.part.0+0x23/0x29 Aug 23 02:05:34 juju-e4d256-prod-github-runner-207 kernel: [74508.577958] ? show_regs.cold+0x8/0xd Aug 23 02:05:34 juju-e4d256-prod-github-runner-207 kernel: [74508.578926] ? watchdog_timer_fn+0x1be/0x220 Aug 23 02:05:34 juju-e4d256-prod-github-runner-207 kernel: [74508.579994] ? lockup_detector_update_enable+0x60/0x60 Aug 23 02:05:34 juju-e4d256-prod-github-runner-207 kernel: [74508.581080] ? __hrtimer_run_queues+0x107/0x230 Aug 23 02:05:34 juju-e4d256-prod-github-runner-207 kernel: [74508.582107] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 02:05:34 juju-e4d256-prod-github-runner-207 kernel: [74508.583140] ? hrtimer_interrupt+0x101/0x220 Aug 23 02:05:34 juju-e4d256-prod-github-runner-207 kernel: [74508.584155] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 02:05:34 juju-e4d256-prod-github-runner-207 kernel: [74508.585222] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 02:05:34 juju-e4d256-prod-github-runner-207 kernel: [74508.586309] Aug 23 02:05:34 juju-e4d256-prod-github-runner-207 kernel: [74508.587195] Aug 23 02:05:34 juju-e4d256-prod-github-runner-207 kernel: [74508.588075] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 02:05:34 juju-e4d256-prod-github-runner-207 kernel: [74508.589120] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:05:34 juju-e4d256-prod-github-runner-207 kernel: [74508.590159] ? _raw_spin_lock+0x22/0x30 Aug 23 02:05:34 juju-e4d256-prod-github-runner-207 kernel: [74508.591155] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:05:34 juju-e4d256-prod-github-runner-207 kernel: [74508.592179] direct_page_fault+0x206/0x310 [kvm] Aug 23 02:05:34 juju-e4d256-prod-github-runner-207 kernel: [74508.593202] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 02:05:34 juju-e4d256-prod-github-runner-207 kernel: [74508.594209] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 02:05:34 juju-e4d256-prod-github-runner-207 kernel: [74508.595217] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 02:05:34 juju-e4d256-prod-github-runner-207 kernel: [74508.596196] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 02:05:34 juju-e4d256-prod-github-runner-207 kernel: [74508.597197] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 02:05:34 juju-e4d256-prod-github-runner-207 kernel: [74508.598187] handle_exit+0x98/0x230 [kvm_amd] Aug 23 02:05:34 juju-e4d256-prod-github-runner-207 kernel: [74508.599097] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 02:05:34 juju-e4d256-prod-github-runner-207 kernel: [74508.600014] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 02:05:34 juju-e4d256-prod-github-runner-207 kernel: [74508.600973] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 02:05:34 juju-e4d256-prod-github-runner-207 kernel: [74508.601890] vcpu_run+0x62/0x2c0 [kvm] Aug 23 02:05:34 juju-e4d256-prod-github-runner-207 kernel: [74508.602701] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 02:05:34 juju-e4d256-prod-github-runner-207 kernel: [74508.603523] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 02:05:34 juju-e4d256-prod-github-runner-207 kernel: [74508.604379] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 02:05:34 juju-e4d256-prod-github-runner-207 kernel: [74508.605176] ? __seccomp_filter+0x4a/0x4a0 Aug 23 02:05:34 juju-e4d256-prod-github-runner-207 kernel: [74508.605917] ? __fget_files+0x86/0xc0 Aug 23 02:05:34 juju-e4d256-prod-github-runner-207 kernel: [74508.606629] __x64_sys_ioctl+0x95/0xd0 Aug 23 02:05:34 juju-e4d256-prod-github-runner-207 kernel: [74508.607342] do_syscall_64+0x5c/0xc0 Aug 23 02:05:34 juju-e4d256-prod-github-runner-207 kernel: [74508.608006] ? do_futex+0x162/0x1f0 Aug 23 02:05:34 juju-e4d256-prod-github-runner-207 kernel: [74508.608746] ? __x64_sys_futex+0x78/0x1e0 Aug 23 02:05:34 juju-e4d256-prod-github-runner-207 kernel: [74508.609418] ? __secure_computing+0xa9/0x120 Aug 23 02:05:34 juju-e4d256-prod-github-runner-207 kernel: [74508.610107] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 02:05:34 juju-e4d256-prod-github-runner-207 kernel: [74508.610874] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:05:34 juju-e4d256-prod-github-runner-207 kernel: [74508.611634] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:05:34 juju-e4d256-prod-github-runner-207 kernel: [74508.612353] ? do_syscall_64+0x69/0xc0 Aug 23 02:05:34 juju-e4d256-prod-github-runner-207 kernel: [74508.612994] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:05:34 juju-e4d256-prod-github-runner-207 kernel: [74508.613698] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:05:34 juju-e4d256-prod-github-runner-207 kernel: [74508.614389] ? do_syscall_64+0x69/0xc0 Aug 23 02:05:34 juju-e4d256-prod-github-runner-207 kernel: [74508.615012] ? do_syscall_64+0x69/0xc0 Aug 23 02:05:34 juju-e4d256-prod-github-runner-207 kernel: [74508.615638] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 02:05:34 juju-e4d256-prod-github-runner-207 kernel: [74508.616351] RIP: 0033:0x7faa5d0edaff Aug 23 02:05:34 juju-e4d256-prod-github-runner-207 kernel: [74508.616977] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 02:05:34 juju-e4d256-prod-github-runner-207 kernel: [74508.618963] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 02:05:34 juju-e4d256-prod-github-runner-207 kernel: [74508.619887] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 02:05:34 juju-e4d256-prod-github-runner-207 kernel: [74508.620774] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 02:05:34 juju-e4d256-prod-github-runner-207 kernel: [74508.621692] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 02:05:34 juju-e4d256-prod-github-runner-207 kernel: [74508.622582] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 02:05:34 juju-e4d256-prod-github-runner-207 kernel: [74508.623485] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 02:05:34 juju-e4d256-prod-github-runner-207 kernel: [74508.624376] Aug 23 02:05:48 juju-e4d256-prod-github-runner-207 kernel: [74522.156705] rcu: INFO: rcu_sched self-detected stall on CPU Aug 23 02:05:48 juju-e4d256-prod-github-runner-207 kernel: [74522.157662] rcu: 1-....: (18542757 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=8961313 Aug 23 02:05:48 juju-e4d256-prod-github-runner-207 kernel: [74522.158783] (t=18601239 jiffies g=23269 q=63187) Aug 23 02:05:48 juju-e4d256-prod-github-runner-207 kernel: [74522.159577] NMI backtrace for cpu 1 Aug 23 02:05:48 juju-e4d256-prod-github-runner-207 kernel: [74522.160284] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 02:05:48 juju-e4d256-prod-github-runner-207 kernel: [74522.161385] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 02:05:48 juju-e4d256-prod-github-runner-207 kernel: [74522.162443] Call Trace: Aug 23 02:05:48 juju-e4d256-prod-github-runner-207 kernel: [74522.163125] Aug 23 02:05:48 juju-e4d256-prod-github-runner-207 kernel: [74522.163769] show_stack+0x52/0x5c Aug 23 02:05:48 juju-e4d256-prod-github-runner-207 kernel: [74522.164492] dump_stack_lvl+0x4a/0x63 Aug 23 02:05:48 juju-e4d256-prod-github-runner-207 kernel: [74522.165237] dump_stack+0x10/0x16 Aug 23 02:05:48 juju-e4d256-prod-github-runner-207 kernel: [74522.165951] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 23 02:05:48 juju-e4d256-prod-github-runner-207 kernel: [74522.166728] ? lapic_can_unplug_cpu+0x90/0x90 Aug 23 02:05:48 juju-e4d256-prod-github-runner-207 kernel: [74522.167514] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 23 02:05:48 juju-e4d256-prod-github-runner-207 kernel: [74522.168337] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 23 02:05:48 juju-e4d256-prod-github-runner-207 kernel: [74522.169161] trigger_single_cpu_backtrace+0x44/0x4f Aug 23 02:05:48 juju-e4d256-prod-github-runner-207 kernel: [74522.169971] rcu_dump_cpu_stacks+0x102/0x149 Aug 23 02:05:48 juju-e4d256-prod-github-runner-207 kernel: [74522.170742] print_cpu_stall.cold+0x2f/0xe2 Aug 23 02:05:48 juju-e4d256-prod-github-runner-207 kernel: [74522.171516] ? timekeeping_update+0xf7/0x150 Aug 23 02:05:48 juju-e4d256-prod-github-runner-207 kernel: [74522.172288] check_cpu_stall+0x109/0x270 Aug 23 02:05:48 juju-e4d256-prod-github-runner-207 kernel: [74522.173039] rcu_sched_clock_irq+0x9a/0x250 Aug 23 02:05:48 juju-e4d256-prod-github-runner-207 kernel: [74522.173803] update_process_times+0x94/0xd0 Aug 23 02:05:48 juju-e4d256-prod-github-runner-207 kernel: [74522.174563] tick_sched_handle+0x29/0x70 Aug 23 02:05:48 juju-e4d256-prod-github-runner-207 kernel: [74522.175318] tick_sched_timer+0x8c/0xc0 Aug 23 02:05:48 juju-e4d256-prod-github-runner-207 kernel: [74522.176054] ? tick_nohz_handler+0xb0/0xb0 Aug 23 02:05:48 juju-e4d256-prod-github-runner-207 kernel: [74522.176806] __hrtimer_run_queues+0x107/0x230 Aug 23 02:05:48 juju-e4d256-prod-github-runner-207 kernel: [74522.177583] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 02:05:48 juju-e4d256-prod-github-runner-207 kernel: [74522.178368] hrtimer_interrupt+0x101/0x220 Aug 23 02:05:48 juju-e4d256-prod-github-runner-207 kernel: [74522.179157] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 02:05:48 juju-e4d256-prod-github-runner-207 kernel: [74522.179971] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 02:05:48 juju-e4d256-prod-github-runner-207 kernel: [74522.180771] Aug 23 02:05:48 juju-e4d256-prod-github-runner-207 kernel: [74522.181406] Aug 23 02:05:48 juju-e4d256-prod-github-runner-207 kernel: [74522.182034] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 02:05:48 juju-e4d256-prod-github-runner-207 kernel: [74522.182852] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:05:48 juju-e4d256-prod-github-runner-207 kernel: [74522.183748] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 02:05:48 juju-e4d256-prod-github-runner-207 kernel: [74522.185944] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 02:05:48 juju-e4d256-prod-github-runner-207 kernel: [74522.186815] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 02:05:48 juju-e4d256-prod-github-runner-207 kernel: [74522.187822] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 02:05:48 juju-e4d256-prod-github-runner-207 kernel: [74522.188794] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 02:05:48 juju-e4d256-prod-github-runner-207 kernel: [74522.189753] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 02:05:48 juju-e4d256-prod-github-runner-207 kernel: [74522.190710] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 02:05:48 juju-e4d256-prod-github-runner-207 kernel: [74522.191668] ? _raw_spin_lock+0x22/0x30 Aug 23 02:05:48 juju-e4d256-prod-github-runner-207 kernel: [74522.192425] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:05:48 juju-e4d256-prod-github-runner-207 kernel: [74522.193266] direct_page_fault+0x206/0x310 [kvm] Aug 23 02:05:48 juju-e4d256-prod-github-runner-207 kernel: [74522.194110] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 02:05:48 juju-e4d256-prod-github-runner-207 kernel: [74522.194947] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 02:05:48 juju-e4d256-prod-github-runner-207 kernel: [74522.195767] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 02:05:48 juju-e4d256-prod-github-runner-207 kernel: [74522.196569] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 02:05:48 juju-e4d256-prod-github-runner-207 kernel: [74522.197353] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 02:05:48 juju-e4d256-prod-github-runner-207 kernel: [74522.198183] handle_exit+0x98/0x230 [kvm_amd] Aug 23 02:05:48 juju-e4d256-prod-github-runner-207 kernel: [74522.198949] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 02:05:48 juju-e4d256-prod-github-runner-207 kernel: [74522.199734] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 02:05:48 juju-e4d256-prod-github-runner-207 kernel: [74522.200531] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 02:05:48 juju-e4d256-prod-github-runner-207 kernel: [74522.201316] vcpu_run+0x62/0x2c0 [kvm] Aug 23 02:05:48 juju-e4d256-prod-github-runner-207 kernel: [74522.202030] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 02:05:48 juju-e4d256-prod-github-runner-207 kernel: [74522.202764] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 02:05:48 juju-e4d256-prod-github-runner-207 kernel: [74522.203600] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 02:05:48 juju-e4d256-prod-github-runner-207 kernel: [74522.204384] ? __seccomp_filter+0x4a/0x4a0 Aug 23 02:05:48 juju-e4d256-prod-github-runner-207 kernel: [74522.205105] ? __fget_files+0x86/0xc0 Aug 23 02:05:48 juju-e4d256-prod-github-runner-207 kernel: [74522.205802] __x64_sys_ioctl+0x95/0xd0 Aug 23 02:05:48 juju-e4d256-prod-github-runner-207 kernel: [74522.206495] do_syscall_64+0x5c/0xc0 Aug 23 02:05:48 juju-e4d256-prod-github-runner-207 kernel: [74522.207189] ? do_futex+0x162/0x1f0 Aug 23 02:05:48 juju-e4d256-prod-github-runner-207 kernel: [74522.207861] ? __x64_sys_futex+0x78/0x1e0 Aug 23 02:05:48 juju-e4d256-prod-github-runner-207 kernel: [74522.208561] ? __secure_computing+0xa9/0x120 Aug 23 02:05:48 juju-e4d256-prod-github-runner-207 kernel: [74522.209275] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 02:05:48 juju-e4d256-prod-github-runner-207 kernel: [74522.210067] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:05:48 juju-e4d256-prod-github-runner-207 kernel: [74522.210818] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:05:48 juju-e4d256-prod-github-runner-207 kernel: [74522.211579] ? do_syscall_64+0x69/0xc0 Aug 23 02:05:48 juju-e4d256-prod-github-runner-207 kernel: [74522.212266] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:05:48 juju-e4d256-prod-github-runner-207 kernel: [74522.213024] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:05:48 juju-e4d256-prod-github-runner-207 kernel: [74522.213778] ? do_syscall_64+0x69/0xc0 Aug 23 02:05:48 juju-e4d256-prod-github-runner-207 kernel: [74522.214469] ? do_syscall_64+0x69/0xc0 Aug 23 02:05:48 juju-e4d256-prod-github-runner-207 kernel: [74522.215160] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 02:05:48 juju-e4d256-prod-github-runner-207 kernel: [74522.215934] RIP: 0033:0x7faa5d0edaff Aug 23 02:05:48 juju-e4d256-prod-github-runner-207 kernel: [74522.216613] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 02:05:48 juju-e4d256-prod-github-runner-207 kernel: [74522.218701] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 02:05:48 juju-e4d256-prod-github-runner-207 kernel: [74522.219672] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 02:05:48 juju-e4d256-prod-github-runner-207 kernel: [74522.220616] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 02:05:48 juju-e4d256-prod-github-runner-207 kernel: [74522.221558] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 02:05:48 juju-e4d256-prod-github-runner-207 kernel: [74522.222495] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 02:05:48 juju-e4d256-prod-github-runner-207 kernel: [74522.223423] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 02:05:48 juju-e4d256-prod-github-runner-207 kernel: [74522.224333] Aug 23 02:06:14 juju-e4d256-prod-github-runner-207 kernel: [74548.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 69320s! [qemu-system-x86:6715] Aug 23 02:06:14 juju-e4d256-prod-github-runner-207 kernel: [74548.543769] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 02:06:14 juju-e4d256-prod-github-runner-207 kernel: [74548.544027] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 02:06:14 juju-e4d256-prod-github-runner-207 kernel: [74548.556279] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 02:06:14 juju-e4d256-prod-github-runner-207 kernel: [74548.557563] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 02:06:14 juju-e4d256-prod-github-runner-207 kernel: [74548.558826] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:06:14 juju-e4d256-prod-github-runner-207 kernel: [74548.559909] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 02:06:14 juju-e4d256-prod-github-runner-207 kernel: [74548.562478] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 02:06:14 juju-e4d256-prod-github-runner-207 kernel: [74548.563536] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 02:06:14 juju-e4d256-prod-github-runner-207 kernel: [74548.564694] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 02:06:14 juju-e4d256-prod-github-runner-207 kernel: [74548.565866] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 02:06:14 juju-e4d256-prod-github-runner-207 kernel: [74548.567040] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 02:06:14 juju-e4d256-prod-github-runner-207 kernel: [74548.568203] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 02:06:14 juju-e4d256-prod-github-runner-207 kernel: [74548.569369] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 02:06:14 juju-e4d256-prod-github-runner-207 kernel: [74548.570614] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 02:06:14 juju-e4d256-prod-github-runner-207 kernel: [74548.571713] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 02:06:14 juju-e4d256-prod-github-runner-207 kernel: [74548.572922] Call Trace: Aug 23 02:06:14 juju-e4d256-prod-github-runner-207 kernel: [74548.573840] Aug 23 02:06:14 juju-e4d256-prod-github-runner-207 kernel: [74548.574744] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:06:14 juju-e4d256-prod-github-runner-207 kernel: [74548.575774] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:06:14 juju-e4d256-prod-github-runner-207 kernel: [74548.576800] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:06:14 juju-e4d256-prod-github-runner-207 kernel: [74548.577901] ? show_regs.part.0+0x23/0x29 Aug 23 02:06:14 juju-e4d256-prod-github-runner-207 kernel: [74548.578927] ? show_regs.cold+0x8/0xd Aug 23 02:06:14 juju-e4d256-prod-github-runner-207 kernel: [74548.579909] ? watchdog_timer_fn+0x1be/0x220 Aug 23 02:06:14 juju-e4d256-prod-github-runner-207 kernel: [74548.580918] ? lockup_detector_update_enable+0x60/0x60 Aug 23 02:06:14 juju-e4d256-prod-github-runner-207 kernel: [74548.581983] ? __hrtimer_run_queues+0x107/0x230 Aug 23 02:06:14 juju-e4d256-prod-github-runner-207 kernel: [74548.583018] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 02:06:14 juju-e4d256-prod-github-runner-207 kernel: [74548.584041] ? hrtimer_interrupt+0x101/0x220 Aug 23 02:06:14 juju-e4d256-prod-github-runner-207 kernel: [74548.585055] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 02:06:14 juju-e4d256-prod-github-runner-207 kernel: [74548.586168] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 02:06:14 juju-e4d256-prod-github-runner-207 kernel: [74548.587559] Aug 23 02:06:14 juju-e4d256-prod-github-runner-207 kernel: [74548.588430] Aug 23 02:06:14 juju-e4d256-prod-github-runner-207 kernel: [74548.589268] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 02:06:14 juju-e4d256-prod-github-runner-207 kernel: [74548.590304] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:06:14 juju-e4d256-prod-github-runner-207 kernel: [74548.591356] ? _raw_spin_lock+0x22/0x30 Aug 23 02:06:14 juju-e4d256-prod-github-runner-207 kernel: [74548.592356] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:06:14 juju-e4d256-prod-github-runner-207 kernel: [74548.593396] direct_page_fault+0x206/0x310 [kvm] Aug 23 02:06:14 juju-e4d256-prod-github-runner-207 kernel: [74548.594423] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 02:06:14 juju-e4d256-prod-github-runner-207 kernel: [74548.595446] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 02:06:14 juju-e4d256-prod-github-runner-207 kernel: [74548.596448] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 02:06:14 juju-e4d256-prod-github-runner-207 kernel: [74548.597452] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 02:06:14 juju-e4d256-prod-github-runner-207 kernel: [74548.598403] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 02:06:14 juju-e4d256-prod-github-runner-207 kernel: [74548.599414] handle_exit+0x98/0x230 [kvm_amd] Aug 23 02:06:14 juju-e4d256-prod-github-runner-207 kernel: [74548.600315] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 02:06:14 juju-e4d256-prod-github-runner-207 kernel: [74548.601233] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 02:06:14 juju-e4d256-prod-github-runner-207 kernel: [74548.602160] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 02:06:14 juju-e4d256-prod-github-runner-207 kernel: [74548.603085] vcpu_run+0x62/0x2c0 [kvm] Aug 23 02:06:14 juju-e4d256-prod-github-runner-207 kernel: [74548.603905] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 02:06:14 juju-e4d256-prod-github-runner-207 kernel: [74548.604719] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 02:06:14 juju-e4d256-prod-github-runner-207 kernel: [74548.605595] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 02:06:14 juju-e4d256-prod-github-runner-207 kernel: [74548.606413] ? __seccomp_filter+0x4a/0x4a0 Aug 23 02:06:14 juju-e4d256-prod-github-runner-207 kernel: [74548.607186] ? __fget_files+0x86/0xc0 Aug 23 02:06:14 juju-e4d256-prod-github-runner-207 kernel: [74548.607912] __x64_sys_ioctl+0x95/0xd0 Aug 23 02:06:14 juju-e4d256-prod-github-runner-207 kernel: [74548.608612] do_syscall_64+0x5c/0xc0 Aug 23 02:06:14 juju-e4d256-prod-github-runner-207 kernel: [74548.609285] ? do_futex+0x162/0x1f0 Aug 23 02:06:14 juju-e4d256-prod-github-runner-207 kernel: [74548.609934] ? __x64_sys_futex+0x78/0x1e0 Aug 23 02:06:14 juju-e4d256-prod-github-runner-207 kernel: [74548.610622] ? __secure_computing+0xa9/0x120 Aug 23 02:06:14 juju-e4d256-prod-github-runner-207 kernel: [74548.611315] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 02:06:14 juju-e4d256-prod-github-runner-207 kernel: [74548.612086] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:06:14 juju-e4d256-prod-github-runner-207 kernel: [74548.612820] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:06:14 juju-e4d256-prod-github-runner-207 kernel: [74548.613542] ? do_syscall_64+0x69/0xc0 Aug 23 02:06:14 juju-e4d256-prod-github-runner-207 kernel: [74548.614187] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:06:14 juju-e4d256-prod-github-runner-207 kernel: [74548.614904] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:06:14 juju-e4d256-prod-github-runner-207 kernel: [74548.615600] ? do_syscall_64+0x69/0xc0 Aug 23 02:06:14 juju-e4d256-prod-github-runner-207 kernel: [74548.616226] ? do_syscall_64+0x69/0xc0 Aug 23 02:06:14 juju-e4d256-prod-github-runner-207 kernel: [74548.616849] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 02:06:14 juju-e4d256-prod-github-runner-207 kernel: [74548.617567] RIP: 0033:0x7faa5d0edaff Aug 23 02:06:14 juju-e4d256-prod-github-runner-207 kernel: [74548.618236] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 02:06:14 juju-e4d256-prod-github-runner-207 kernel: [74548.620249] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 02:06:14 juju-e4d256-prod-github-runner-207 kernel: [74548.621168] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 02:06:14 juju-e4d256-prod-github-runner-207 kernel: [74548.622060] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 02:06:14 juju-e4d256-prod-github-runner-207 kernel: [74548.622959] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 02:06:14 juju-e4d256-prod-github-runner-207 kernel: [74548.623861] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 02:06:14 juju-e4d256-prod-github-runner-207 kernel: [74548.624750] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 02:06:14 juju-e4d256-prod-github-runner-207 kernel: [74548.625648] Aug 23 02:06:42 juju-e4d256-prod-github-runner-207 kernel: [74576.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 69346s! [qemu-system-x86:6715] Aug 23 02:06:42 juju-e4d256-prod-github-runner-207 kernel: [74576.543110] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 02:06:42 juju-e4d256-prod-github-runner-207 kernel: [74576.543178] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 02:06:42 juju-e4d256-prod-github-runner-207 kernel: [74576.555245] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 02:06:42 juju-e4d256-prod-github-runner-207 kernel: [74576.556509] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 02:06:42 juju-e4d256-prod-github-runner-207 kernel: [74576.557738] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:06:42 juju-e4d256-prod-github-runner-207 kernel: [74576.558813] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 02:06:42 juju-e4d256-prod-github-runner-207 kernel: [74576.561407] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 02:06:42 juju-e4d256-prod-github-runner-207 kernel: [74576.562478] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 02:06:42 juju-e4d256-prod-github-runner-207 kernel: [74576.563644] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 02:06:42 juju-e4d256-prod-github-runner-207 kernel: [74576.564800] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 02:06:42 juju-e4d256-prod-github-runner-207 kernel: [74576.565956] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 02:06:42 juju-e4d256-prod-github-runner-207 kernel: [74576.567126] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 02:06:42 juju-e4d256-prod-github-runner-207 kernel: [74576.568317] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 02:06:42 juju-e4d256-prod-github-runner-207 kernel: [74576.569587] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 02:06:42 juju-e4d256-prod-github-runner-207 kernel: [74576.570705] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 02:06:42 juju-e4d256-prod-github-runner-207 kernel: [74576.571894] Call Trace: Aug 23 02:06:42 juju-e4d256-prod-github-runner-207 kernel: [74576.572801] Aug 23 02:06:42 juju-e4d256-prod-github-runner-207 kernel: [74576.573683] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:06:42 juju-e4d256-prod-github-runner-207 kernel: [74576.574722] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:06:42 juju-e4d256-prod-github-runner-207 kernel: [74576.575739] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:06:42 juju-e4d256-prod-github-runner-207 kernel: [74576.576817] ? show_regs.part.0+0x23/0x29 Aug 23 02:06:42 juju-e4d256-prod-github-runner-207 kernel: [74576.577811] ? show_regs.cold+0x8/0xd Aug 23 02:06:42 juju-e4d256-prod-github-runner-207 kernel: [74576.578794] ? watchdog_timer_fn+0x1be/0x220 Aug 23 02:06:42 juju-e4d256-prod-github-runner-207 kernel: [74576.579801] ? lockup_detector_update_enable+0x60/0x60 Aug 23 02:06:42 juju-e4d256-prod-github-runner-207 kernel: [74576.580859] ? __hrtimer_run_queues+0x107/0x230 Aug 23 02:06:42 juju-e4d256-prod-github-runner-207 kernel: [74576.581886] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 02:06:42 juju-e4d256-prod-github-runner-207 kernel: [74576.582932] ? hrtimer_interrupt+0x101/0x220 Aug 23 02:06:42 juju-e4d256-prod-github-runner-207 kernel: [74576.583945] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 02:06:42 juju-e4d256-prod-github-runner-207 kernel: [74576.585012] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 02:06:42 juju-e4d256-prod-github-runner-207 kernel: [74576.586054] Aug 23 02:06:42 juju-e4d256-prod-github-runner-207 kernel: [74576.586918] Aug 23 02:06:42 juju-e4d256-prod-github-runner-207 kernel: [74576.587754] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 02:06:42 juju-e4d256-prod-github-runner-207 kernel: [74576.588786] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:06:42 juju-e4d256-prod-github-runner-207 kernel: [74576.589822] ? _raw_spin_lock+0x22/0x30 Aug 23 02:06:42 juju-e4d256-prod-github-runner-207 kernel: [74576.590779] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:06:42 juju-e4d256-prod-github-runner-207 kernel: [74576.591839] direct_page_fault+0x206/0x310 [kvm] Aug 23 02:06:42 juju-e4d256-prod-github-runner-207 kernel: [74576.592862] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 02:06:42 juju-e4d256-prod-github-runner-207 kernel: [74576.593871] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 02:06:42 juju-e4d256-prod-github-runner-207 kernel: [74576.594887] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 02:06:42 juju-e4d256-prod-github-runner-207 kernel: [74576.595859] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 02:06:42 juju-e4d256-prod-github-runner-207 kernel: [74576.596832] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 02:06:42 juju-e4d256-prod-github-runner-207 kernel: [74576.597812] handle_exit+0x98/0x230 [kvm_amd] Aug 23 02:06:42 juju-e4d256-prod-github-runner-207 kernel: [74576.598718] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 02:06:42 juju-e4d256-prod-github-runner-207 kernel: [74576.599635] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 02:06:42 juju-e4d256-prod-github-runner-207 kernel: [74576.600555] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 02:06:42 juju-e4d256-prod-github-runner-207 kernel: [74576.601457] vcpu_run+0x62/0x2c0 [kvm] Aug 23 02:06:42 juju-e4d256-prod-github-runner-207 kernel: [74576.602294] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 02:06:42 juju-e4d256-prod-github-runner-207 kernel: [74576.603099] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 02:06:42 juju-e4d256-prod-github-runner-207 kernel: [74576.603951] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 02:06:42 juju-e4d256-prod-github-runner-207 kernel: [74576.604751] ? __seccomp_filter+0x4a/0x4a0 Aug 23 02:06:42 juju-e4d256-prod-github-runner-207 kernel: [74576.605490] ? __fget_files+0x86/0xc0 Aug 23 02:06:42 juju-e4d256-prod-github-runner-207 kernel: [74576.606190] __x64_sys_ioctl+0x95/0xd0 Aug 23 02:06:42 juju-e4d256-prod-github-runner-207 kernel: [74576.606889] do_syscall_64+0x5c/0xc0 Aug 23 02:06:42 juju-e4d256-prod-github-runner-207 kernel: [74576.607556] ? do_futex+0x162/0x1f0 Aug 23 02:06:42 juju-e4d256-prod-github-runner-207 kernel: [74576.608202] ? __x64_sys_futex+0x78/0x1e0 Aug 23 02:06:42 juju-e4d256-prod-github-runner-207 kernel: [74576.608872] ? __secure_computing+0xa9/0x120 Aug 23 02:06:42 juju-e4d256-prod-github-runner-207 kernel: [74576.609558] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 02:06:42 juju-e4d256-prod-github-runner-207 kernel: [74576.610330] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:06:42 juju-e4d256-prod-github-runner-207 kernel: [74576.611051] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:06:42 juju-e4d256-prod-github-runner-207 kernel: [74576.611766] ? do_syscall_64+0x69/0xc0 Aug 23 02:06:42 juju-e4d256-prod-github-runner-207 kernel: [74576.612412] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:06:42 juju-e4d256-prod-github-runner-207 kernel: [74576.613112] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:06:42 juju-e4d256-prod-github-runner-207 kernel: [74576.613806] ? do_syscall_64+0x69/0xc0 Aug 23 02:06:42 juju-e4d256-prod-github-runner-207 kernel: [74576.614447] ? do_syscall_64+0x69/0xc0 Aug 23 02:06:42 juju-e4d256-prod-github-runner-207 kernel: [74576.615069] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 02:06:42 juju-e4d256-prod-github-runner-207 kernel: [74576.615773] RIP: 0033:0x7faa5d0edaff Aug 23 02:06:42 juju-e4d256-prod-github-runner-207 kernel: [74576.616423] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 02:06:42 juju-e4d256-prod-github-runner-207 kernel: [74576.618412] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 02:06:42 juju-e4d256-prod-github-runner-207 kernel: [74576.619322] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 02:06:42 juju-e4d256-prod-github-runner-207 kernel: [74576.620209] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 02:06:42 juju-e4d256-prod-github-runner-207 kernel: [74576.621101] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 02:06:42 juju-e4d256-prod-github-runner-207 kernel: [74576.621986] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 02:06:42 juju-e4d256-prod-github-runner-207 kernel: [74576.622883] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 02:06:42 juju-e4d256-prod-github-runner-207 kernel: [74576.623793] Aug 23 02:07:10 juju-e4d256-prod-github-runner-207 kernel: [74604.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 69372s! [qemu-system-x86:6715] Aug 23 02:07:10 juju-e4d256-prod-github-runner-207 kernel: [74604.543115] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 02:07:10 juju-e4d256-prod-github-runner-207 kernel: [74604.543194] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 02:07:10 juju-e4d256-prod-github-runner-207 kernel: [74604.555672] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 02:07:10 juju-e4d256-prod-github-runner-207 kernel: [74604.556936] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 02:07:10 juju-e4d256-prod-github-runner-207 kernel: [74604.558167] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:07:10 juju-e4d256-prod-github-runner-207 kernel: [74604.559232] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 02:07:10 juju-e4d256-prod-github-runner-207 kernel: [74604.561782] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 02:07:10 juju-e4d256-prod-github-runner-207 kernel: [74604.562840] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 02:07:10 juju-e4d256-prod-github-runner-207 kernel: [74604.563993] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 02:07:10 juju-e4d256-prod-github-runner-207 kernel: [74604.565145] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 02:07:10 juju-e4d256-prod-github-runner-207 kernel: [74604.566309] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 02:07:10 juju-e4d256-prod-github-runner-207 kernel: [74604.567464] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 02:07:10 juju-e4d256-prod-github-runner-207 kernel: [74604.568627] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 02:07:10 juju-e4d256-prod-github-runner-207 kernel: [74604.569856] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 02:07:10 juju-e4d256-prod-github-runner-207 kernel: [74604.570960] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 02:07:10 juju-e4d256-prod-github-runner-207 kernel: [74604.572147] Call Trace: Aug 23 02:07:10 juju-e4d256-prod-github-runner-207 kernel: [74604.573061] Aug 23 02:07:10 juju-e4d256-prod-github-runner-207 kernel: [74604.573955] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:07:10 juju-e4d256-prod-github-runner-207 kernel: [74604.574985] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:07:10 juju-e4d256-prod-github-runner-207 kernel: [74604.576009] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:07:10 juju-e4d256-prod-github-runner-207 kernel: [74604.577079] ? show_regs.part.0+0x23/0x29 Aug 23 02:07:10 juju-e4d256-prod-github-runner-207 kernel: [74604.578083] ? show_regs.cold+0x8/0xd Aug 23 02:07:10 juju-e4d256-prod-github-runner-207 kernel: [74604.579199] ? watchdog_timer_fn+0x1be/0x220 Aug 23 02:07:10 juju-e4d256-prod-github-runner-207 kernel: [74604.580232] ? lockup_detector_update_enable+0x60/0x60 Aug 23 02:07:10 juju-e4d256-prod-github-runner-207 kernel: [74604.581303] ? __hrtimer_run_queues+0x107/0x230 Aug 23 02:07:10 juju-e4d256-prod-github-runner-207 kernel: [74604.582356] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 02:07:10 juju-e4d256-prod-github-runner-207 kernel: [74604.583381] ? hrtimer_interrupt+0x101/0x220 Aug 23 02:07:10 juju-e4d256-prod-github-runner-207 kernel: [74604.584396] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 02:07:10 juju-e4d256-prod-github-runner-207 kernel: [74604.585472] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 02:07:10 juju-e4d256-prod-github-runner-207 kernel: [74604.586531] Aug 23 02:07:10 juju-e4d256-prod-github-runner-207 kernel: [74604.587385] Aug 23 02:07:10 juju-e4d256-prod-github-runner-207 kernel: [74604.588222] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 02:07:10 juju-e4d256-prod-github-runner-207 kernel: [74604.589259] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:07:10 juju-e4d256-prod-github-runner-207 kernel: [74604.590310] ? _raw_spin_lock+0x22/0x30 Aug 23 02:07:10 juju-e4d256-prod-github-runner-207 kernel: [74604.591256] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:07:10 juju-e4d256-prod-github-runner-207 kernel: [74604.592283] direct_page_fault+0x206/0x310 [kvm] Aug 23 02:07:10 juju-e4d256-prod-github-runner-207 kernel: [74604.593310] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 02:07:10 juju-e4d256-prod-github-runner-207 kernel: [74604.594334] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 02:07:10 juju-e4d256-prod-github-runner-207 kernel: [74604.595339] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 02:07:10 juju-e4d256-prod-github-runner-207 kernel: [74604.596310] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 02:07:10 juju-e4d256-prod-github-runner-207 kernel: [74604.597261] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 02:07:10 juju-e4d256-prod-github-runner-207 kernel: [74604.598261] handle_exit+0x98/0x230 [kvm_amd] Aug 23 02:07:10 juju-e4d256-prod-github-runner-207 kernel: [74604.599155] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 02:07:10 juju-e4d256-prod-github-runner-207 kernel: [74604.600075] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 02:07:10 juju-e4d256-prod-github-runner-207 kernel: [74604.601004] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 02:07:10 juju-e4d256-prod-github-runner-207 kernel: [74604.601914] vcpu_run+0x62/0x2c0 [kvm] Aug 23 02:07:10 juju-e4d256-prod-github-runner-207 kernel: [74604.602745] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 02:07:10 juju-e4d256-prod-github-runner-207 kernel: [74604.603554] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 02:07:10 juju-e4d256-prod-github-runner-207 kernel: [74604.604415] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 02:07:10 juju-e4d256-prod-github-runner-207 kernel: [74604.605211] ? __seccomp_filter+0x4a/0x4a0 Aug 23 02:07:10 juju-e4d256-prod-github-runner-207 kernel: [74604.605966] ? __fget_files+0x86/0xc0 Aug 23 02:07:10 juju-e4d256-prod-github-runner-207 kernel: [74604.606669] __x64_sys_ioctl+0x95/0xd0 Aug 23 02:07:10 juju-e4d256-prod-github-runner-207 kernel: [74604.607362] do_syscall_64+0x5c/0xc0 Aug 23 02:07:10 juju-e4d256-prod-github-runner-207 kernel: [74604.608027] ? do_futex+0x162/0x1f0 Aug 23 02:07:10 juju-e4d256-prod-github-runner-207 kernel: [74604.608785] ? __x64_sys_futex+0x78/0x1e0 Aug 23 02:07:10 juju-e4d256-prod-github-runner-207 kernel: [74604.609518] ? __secure_computing+0xa9/0x120 Aug 23 02:07:10 juju-e4d256-prod-github-runner-207 kernel: [74604.610232] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 02:07:10 juju-e4d256-prod-github-runner-207 kernel: [74604.610994] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:07:10 juju-e4d256-prod-github-runner-207 kernel: [74604.611715] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:07:10 juju-e4d256-prod-github-runner-207 kernel: [74604.612434] ? do_syscall_64+0x69/0xc0 Aug 23 02:07:10 juju-e4d256-prod-github-runner-207 kernel: [74604.613078] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:07:10 juju-e4d256-prod-github-runner-207 kernel: [74604.613785] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:07:10 juju-e4d256-prod-github-runner-207 kernel: [74604.614491] ? do_syscall_64+0x69/0xc0 Aug 23 02:07:10 juju-e4d256-prod-github-runner-207 kernel: [74604.615124] ? do_syscall_64+0x69/0xc0 Aug 23 02:07:10 juju-e4d256-prod-github-runner-207 kernel: [74604.615756] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 02:07:10 juju-e4d256-prod-github-runner-207 kernel: [74604.616465] RIP: 0033:0x7faa5d0edaff Aug 23 02:07:10 juju-e4d256-prod-github-runner-207 kernel: [74604.617091] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 02:07:10 juju-e4d256-prod-github-runner-207 kernel: [74604.619087] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 02:07:10 juju-e4d256-prod-github-runner-207 kernel: [74604.620000] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 02:07:10 juju-e4d256-prod-github-runner-207 kernel: [74604.620885] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 02:07:10 juju-e4d256-prod-github-runner-207 kernel: [74604.621769] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 02:07:10 juju-e4d256-prod-github-runner-207 kernel: [74604.622671] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 02:07:10 juju-e4d256-prod-github-runner-207 kernel: [74604.623560] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 02:07:10 juju-e4d256-prod-github-runner-207 kernel: [74604.624453] Aug 23 02:07:38 juju-e4d256-prod-github-runner-207 kernel: [74632.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 69398s! [qemu-system-x86:6715] Aug 23 02:07:38 juju-e4d256-prod-github-runner-207 kernel: [74632.543180] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 02:07:38 juju-e4d256-prod-github-runner-207 kernel: [74632.543379] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 02:07:38 juju-e4d256-prod-github-runner-207 kernel: [74632.555516] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 02:07:38 juju-e4d256-prod-github-runner-207 kernel: [74632.556799] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 02:07:38 juju-e4d256-prod-github-runner-207 kernel: [74632.558042] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:07:38 juju-e4d256-prod-github-runner-207 kernel: [74632.559097] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 02:07:38 juju-e4d256-prod-github-runner-207 kernel: [74632.561657] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 02:07:38 juju-e4d256-prod-github-runner-207 kernel: [74632.562700] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 02:07:38 juju-e4d256-prod-github-runner-207 kernel: [74632.563874] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 02:07:38 juju-e4d256-prod-github-runner-207 kernel: [74632.565037] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 02:07:38 juju-e4d256-prod-github-runner-207 kernel: [74632.566216] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 02:07:38 juju-e4d256-prod-github-runner-207 kernel: [74632.567402] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 02:07:38 juju-e4d256-prod-github-runner-207 kernel: [74632.568570] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 02:07:38 juju-e4d256-prod-github-runner-207 kernel: [74632.569828] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 02:07:38 juju-e4d256-prod-github-runner-207 kernel: [74632.570926] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 02:07:38 juju-e4d256-prod-github-runner-207 kernel: [74632.572174] Call Trace: Aug 23 02:07:38 juju-e4d256-prod-github-runner-207 kernel: [74632.573123] Aug 23 02:07:38 juju-e4d256-prod-github-runner-207 kernel: [74632.574048] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:07:38 juju-e4d256-prod-github-runner-207 kernel: [74632.575076] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:07:38 juju-e4d256-prod-github-runner-207 kernel: [74632.576093] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:07:38 juju-e4d256-prod-github-runner-207 kernel: [74632.577227] ? show_regs.part.0+0x23/0x29 Aug 23 02:07:38 juju-e4d256-prod-github-runner-207 kernel: [74632.578246] ? show_regs.cold+0x8/0xd Aug 23 02:07:38 juju-e4d256-prod-github-runner-207 kernel: [74632.579219] ? watchdog_timer_fn+0x1be/0x220 Aug 23 02:07:38 juju-e4d256-prod-github-runner-207 kernel: [74632.580264] ? lockup_detector_update_enable+0x60/0x60 Aug 23 02:07:38 juju-e4d256-prod-github-runner-207 kernel: [74632.581326] ? __hrtimer_run_queues+0x107/0x230 Aug 23 02:07:38 juju-e4d256-prod-github-runner-207 kernel: [74632.582361] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 02:07:38 juju-e4d256-prod-github-runner-207 kernel: [74632.583392] ? hrtimer_interrupt+0x101/0x220 Aug 23 02:07:38 juju-e4d256-prod-github-runner-207 kernel: [74632.584440] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 02:07:38 juju-e4d256-prod-github-runner-207 kernel: [74632.585539] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 02:07:38 juju-e4d256-prod-github-runner-207 kernel: [74632.586618] Aug 23 02:07:38 juju-e4d256-prod-github-runner-207 kernel: [74632.587496] Aug 23 02:07:38 juju-e4d256-prod-github-runner-207 kernel: [74632.588344] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 02:07:38 juju-e4d256-prod-github-runner-207 kernel: [74632.589378] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:07:38 juju-e4d256-prod-github-runner-207 kernel: [74632.590435] ? _raw_spin_lock+0x22/0x30 Aug 23 02:07:38 juju-e4d256-prod-github-runner-207 kernel: [74632.591437] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:07:38 juju-e4d256-prod-github-runner-207 kernel: [74632.592464] direct_page_fault+0x206/0x310 [kvm] Aug 23 02:07:38 juju-e4d256-prod-github-runner-207 kernel: [74632.593490] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 02:07:38 juju-e4d256-prod-github-runner-207 kernel: [74632.594517] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 02:07:38 juju-e4d256-prod-github-runner-207 kernel: [74632.595520] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 02:07:38 juju-e4d256-prod-github-runner-207 kernel: [74632.596518] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 02:07:38 juju-e4d256-prod-github-runner-207 kernel: [74632.597480] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 02:07:38 juju-e4d256-prod-github-runner-207 kernel: [74632.598495] handle_exit+0x98/0x230 [kvm_amd] Aug 23 02:07:38 juju-e4d256-prod-github-runner-207 kernel: [74632.599391] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 02:07:38 juju-e4d256-prod-github-runner-207 kernel: [74632.600322] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 02:07:38 juju-e4d256-prod-github-runner-207 kernel: [74632.601250] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 02:07:38 juju-e4d256-prod-github-runner-207 kernel: [74632.602173] vcpu_run+0x62/0x2c0 [kvm] Aug 23 02:07:38 juju-e4d256-prod-github-runner-207 kernel: [74632.602985] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 02:07:38 juju-e4d256-prod-github-runner-207 kernel: [74632.603793] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 02:07:38 juju-e4d256-prod-github-runner-207 kernel: [74632.604649] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 02:07:38 juju-e4d256-prod-github-runner-207 kernel: [74632.605447] ? __seccomp_filter+0x4a/0x4a0 Aug 23 02:07:38 juju-e4d256-prod-github-runner-207 kernel: [74632.606205] ? __fget_files+0x86/0xc0 Aug 23 02:07:38 juju-e4d256-prod-github-runner-207 kernel: [74632.606917] __x64_sys_ioctl+0x95/0xd0 Aug 23 02:07:38 juju-e4d256-prod-github-runner-207 kernel: [74632.607612] do_syscall_64+0x5c/0xc0 Aug 23 02:07:38 juju-e4d256-prod-github-runner-207 kernel: [74632.608301] ? do_futex+0x162/0x1f0 Aug 23 02:07:38 juju-e4d256-prod-github-runner-207 kernel: [74632.608953] ? __x64_sys_futex+0x78/0x1e0 Aug 23 02:07:38 juju-e4d256-prod-github-runner-207 kernel: [74632.609641] ? __secure_computing+0xa9/0x120 Aug 23 02:07:38 juju-e4d256-prod-github-runner-207 kernel: [74632.610330] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 02:07:38 juju-e4d256-prod-github-runner-207 kernel: [74632.611090] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:07:38 juju-e4d256-prod-github-runner-207 kernel: [74632.611812] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:07:38 juju-e4d256-prod-github-runner-207 kernel: [74632.612529] ? do_syscall_64+0x69/0xc0 Aug 23 02:07:38 juju-e4d256-prod-github-runner-207 kernel: [74632.613184] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:07:38 juju-e4d256-prod-github-runner-207 kernel: [74632.613911] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:07:38 juju-e4d256-prod-github-runner-207 kernel: [74632.614606] ? do_syscall_64+0x69/0xc0 Aug 23 02:07:38 juju-e4d256-prod-github-runner-207 kernel: [74632.615228] ? do_syscall_64+0x69/0xc0 Aug 23 02:07:38 juju-e4d256-prod-github-runner-207 kernel: [74632.615849] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 02:07:38 juju-e4d256-prod-github-runner-207 kernel: [74632.616553] RIP: 0033:0x7faa5d0edaff Aug 23 02:07:38 juju-e4d256-prod-github-runner-207 kernel: [74632.617196] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 02:07:38 juju-e4d256-prod-github-runner-207 kernel: [74632.619246] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 02:07:38 juju-e4d256-prod-github-runner-207 kernel: [74632.620154] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 02:07:38 juju-e4d256-prod-github-runner-207 kernel: [74632.621039] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 02:07:38 juju-e4d256-prod-github-runner-207 kernel: [74632.621940] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 02:07:38 juju-e4d256-prod-github-runner-207 kernel: [74632.622825] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 02:07:38 juju-e4d256-prod-github-runner-207 kernel: [74632.623710] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 02:07:38 juju-e4d256-prod-github-runner-207 kernel: [74632.624599] Aug 23 02:08:06 juju-e4d256-prod-github-runner-207 kernel: [74660.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 69425s! [qemu-system-x86:6715] Aug 23 02:08:06 juju-e4d256-prod-github-runner-207 kernel: [74660.543672] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 02:08:06 juju-e4d256-prod-github-runner-207 kernel: [74660.543844] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 02:08:06 juju-e4d256-prod-github-runner-207 kernel: [74660.555928] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 02:08:06 juju-e4d256-prod-github-runner-207 kernel: [74660.557196] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 02:08:06 juju-e4d256-prod-github-runner-207 kernel: [74660.558441] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:08:06 juju-e4d256-prod-github-runner-207 kernel: [74660.559496] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 02:08:06 juju-e4d256-prod-github-runner-207 kernel: [74660.562052] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 02:08:06 juju-e4d256-prod-github-runner-207 kernel: [74660.563100] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 02:08:06 juju-e4d256-prod-github-runner-207 kernel: [74660.564262] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 02:08:06 juju-e4d256-prod-github-runner-207 kernel: [74660.565437] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 02:08:06 juju-e4d256-prod-github-runner-207 kernel: [74660.566598] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 02:08:06 juju-e4d256-prod-github-runner-207 kernel: [74660.567766] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 02:08:06 juju-e4d256-prod-github-runner-207 kernel: [74660.568930] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 02:08:06 juju-e4d256-prod-github-runner-207 kernel: [74660.570181] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 02:08:06 juju-e4d256-prod-github-runner-207 kernel: [74660.571276] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 02:08:06 juju-e4d256-prod-github-runner-207 kernel: [74660.572468] Call Trace: Aug 23 02:08:06 juju-e4d256-prod-github-runner-207 kernel: [74660.573400] Aug 23 02:08:06 juju-e4d256-prod-github-runner-207 kernel: [74660.574293] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:08:06 juju-e4d256-prod-github-runner-207 kernel: [74660.575328] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:08:06 juju-e4d256-prod-github-runner-207 kernel: [74660.576355] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:08:06 juju-e4d256-prod-github-runner-207 kernel: [74660.577451] ? show_regs.part.0+0x23/0x29 Aug 23 02:08:06 juju-e4d256-prod-github-runner-207 kernel: [74660.578450] ? show_regs.cold+0x8/0xd Aug 23 02:08:06 juju-e4d256-prod-github-runner-207 kernel: [74660.579421] ? watchdog_timer_fn+0x1be/0x220 Aug 23 02:08:06 juju-e4d256-prod-github-runner-207 kernel: [74660.580429] ? lockup_detector_update_enable+0x60/0x60 Aug 23 02:08:06 juju-e4d256-prod-github-runner-207 kernel: [74660.581509] ? __hrtimer_run_queues+0x107/0x230 Aug 23 02:08:06 juju-e4d256-prod-github-runner-207 kernel: [74660.582542] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 02:08:06 juju-e4d256-prod-github-runner-207 kernel: [74660.583566] ? hrtimer_interrupt+0x101/0x220 Aug 23 02:08:06 juju-e4d256-prod-github-runner-207 kernel: [74660.584581] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 02:08:06 juju-e4d256-prod-github-runner-207 kernel: [74660.585665] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 02:08:06 juju-e4d256-prod-github-runner-207 kernel: [74660.586718] Aug 23 02:08:06 juju-e4d256-prod-github-runner-207 kernel: [74660.587570] Aug 23 02:08:06 juju-e4d256-prod-github-runner-207 kernel: [74660.588408] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 02:08:06 juju-e4d256-prod-github-runner-207 kernel: [74660.589461] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:08:06 juju-e4d256-prod-github-runner-207 kernel: [74660.590501] ? _raw_spin_lock+0x22/0x30 Aug 23 02:08:06 juju-e4d256-prod-github-runner-207 kernel: [74660.591445] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:08:06 juju-e4d256-prod-github-runner-207 kernel: [74660.592461] direct_page_fault+0x206/0x310 [kvm] Aug 23 02:08:06 juju-e4d256-prod-github-runner-207 kernel: [74660.593506] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 02:08:06 juju-e4d256-prod-github-runner-207 kernel: [74660.594514] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 02:08:06 juju-e4d256-prod-github-runner-207 kernel: [74660.595519] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 02:08:06 juju-e4d256-prod-github-runner-207 kernel: [74660.596495] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 02:08:06 juju-e4d256-prod-github-runner-207 kernel: [74660.597456] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 02:08:06 juju-e4d256-prod-github-runner-207 kernel: [74660.598441] handle_exit+0x98/0x230 [kvm_amd] Aug 23 02:08:06 juju-e4d256-prod-github-runner-207 kernel: [74660.599332] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 02:08:06 juju-e4d256-prod-github-runner-207 kernel: [74660.600244] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 02:08:06 juju-e4d256-prod-github-runner-207 kernel: [74660.601168] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 02:08:06 juju-e4d256-prod-github-runner-207 kernel: [74660.602080] vcpu_run+0x62/0x2c0 [kvm] Aug 23 02:08:06 juju-e4d256-prod-github-runner-207 kernel: [74660.602890] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 02:08:06 juju-e4d256-prod-github-runner-207 kernel: [74660.603696] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 02:08:06 juju-e4d256-prod-github-runner-207 kernel: [74660.604548] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 02:08:06 juju-e4d256-prod-github-runner-207 kernel: [74660.605357] ? __seccomp_filter+0x4a/0x4a0 Aug 23 02:08:06 juju-e4d256-prod-github-runner-207 kernel: [74660.606099] ? __fget_files+0x86/0xc0 Aug 23 02:08:06 juju-e4d256-prod-github-runner-207 kernel: [74660.606801] __x64_sys_ioctl+0x95/0xd0 Aug 23 02:08:06 juju-e4d256-prod-github-runner-207 kernel: [74660.607491] do_syscall_64+0x5c/0xc0 Aug 23 02:08:06 juju-e4d256-prod-github-runner-207 kernel: [74660.608155] ? do_futex+0x162/0x1f0 Aug 23 02:08:06 juju-e4d256-prod-github-runner-207 kernel: [74660.608803] ? __x64_sys_futex+0x78/0x1e0 Aug 23 02:08:06 juju-e4d256-prod-github-runner-207 kernel: [74660.609488] ? __secure_computing+0xa9/0x120 Aug 23 02:08:06 juju-e4d256-prod-github-runner-207 kernel: [74660.610177] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 02:08:06 juju-e4d256-prod-github-runner-207 kernel: [74660.610940] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:08:06 juju-e4d256-prod-github-runner-207 kernel: [74660.611660] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:08:06 juju-e4d256-prod-github-runner-207 kernel: [74660.612376] ? do_syscall_64+0x69/0xc0 Aug 23 02:08:06 juju-e4d256-prod-github-runner-207 kernel: [74660.613025] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:08:06 juju-e4d256-prod-github-runner-207 kernel: [74660.613741] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:08:06 juju-e4d256-prod-github-runner-207 kernel: [74660.614442] ? do_syscall_64+0x69/0xc0 Aug 23 02:08:06 juju-e4d256-prod-github-runner-207 kernel: [74660.615066] ? do_syscall_64+0x69/0xc0 Aug 23 02:08:06 juju-e4d256-prod-github-runner-207 kernel: [74660.615687] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 02:08:06 juju-e4d256-prod-github-runner-207 kernel: [74660.616392] RIP: 0033:0x7faa5d0edaff Aug 23 02:08:06 juju-e4d256-prod-github-runner-207 kernel: [74660.617015] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 02:08:06 juju-e4d256-prod-github-runner-207 kernel: [74660.619077] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 02:08:06 juju-e4d256-prod-github-runner-207 kernel: [74660.619985] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 02:08:06 juju-e4d256-prod-github-runner-207 kernel: [74660.620873] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 02:08:06 juju-e4d256-prod-github-runner-207 kernel: [74660.621772] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 02:08:06 juju-e4d256-prod-github-runner-207 kernel: [74660.622660] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 02:08:06 juju-e4d256-prod-github-runner-207 kernel: [74660.623549] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 02:08:06 juju-e4d256-prod-github-runner-207 kernel: [74660.624440] Aug 23 02:08:34 juju-e4d256-prod-github-runner-207 kernel: [74688.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 69451s! [qemu-system-x86:6715] Aug 23 02:08:34 juju-e4d256-prod-github-runner-207 kernel: [74688.543107] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 02:08:34 juju-e4d256-prod-github-runner-207 kernel: [74688.543183] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 02:08:34 juju-e4d256-prod-github-runner-207 kernel: [74688.555282] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 02:08:34 juju-e4d256-prod-github-runner-207 kernel: [74688.556547] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 02:08:34 juju-e4d256-prod-github-runner-207 kernel: [74688.557774] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:08:34 juju-e4d256-prod-github-runner-207 kernel: [74688.558832] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 02:08:34 juju-e4d256-prod-github-runner-207 kernel: [74688.561390] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 02:08:34 juju-e4d256-prod-github-runner-207 kernel: [74688.562429] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 02:08:34 juju-e4d256-prod-github-runner-207 kernel: [74688.563588] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 02:08:34 juju-e4d256-prod-github-runner-207 kernel: [74688.564742] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 02:08:34 juju-e4d256-prod-github-runner-207 kernel: [74688.565917] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 02:08:34 juju-e4d256-prod-github-runner-207 kernel: [74688.567078] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 02:08:34 juju-e4d256-prod-github-runner-207 kernel: [74688.568243] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 02:08:34 juju-e4d256-prod-github-runner-207 kernel: [74688.569488] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 02:08:34 juju-e4d256-prod-github-runner-207 kernel: [74688.570588] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 02:08:34 juju-e4d256-prod-github-runner-207 kernel: [74688.571781] Call Trace: Aug 23 02:08:34 juju-e4d256-prod-github-runner-207 kernel: [74688.572700] Aug 23 02:08:34 juju-e4d256-prod-github-runner-207 kernel: [74688.573624] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:08:34 juju-e4d256-prod-github-runner-207 kernel: [74688.574652] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:08:34 juju-e4d256-prod-github-runner-207 kernel: [74688.575791] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:08:34 juju-e4d256-prod-github-runner-207 kernel: [74688.576863] ? show_regs.part.0+0x23/0x29 Aug 23 02:08:34 juju-e4d256-prod-github-runner-207 kernel: [74688.577874] ? show_regs.cold+0x8/0xd Aug 23 02:08:34 juju-e4d256-prod-github-runner-207 kernel: [74688.578880] ? watchdog_timer_fn+0x1be/0x220 Aug 23 02:08:34 juju-e4d256-prod-github-runner-207 kernel: [74688.579897] ? lockup_detector_update_enable+0x60/0x60 Aug 23 02:08:34 juju-e4d256-prod-github-runner-207 kernel: [74688.580965] ? __hrtimer_run_queues+0x107/0x230 Aug 23 02:08:34 juju-e4d256-prod-github-runner-207 kernel: [74688.582019] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 02:08:34 juju-e4d256-prod-github-runner-207 kernel: [74688.583042] ? hrtimer_interrupt+0x101/0x220 Aug 23 02:08:34 juju-e4d256-prod-github-runner-207 kernel: [74688.584072] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 02:08:34 juju-e4d256-prod-github-runner-207 kernel: [74688.585168] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 02:08:34 juju-e4d256-prod-github-runner-207 kernel: [74688.586219] Aug 23 02:08:34 juju-e4d256-prod-github-runner-207 kernel: [74688.587069] Aug 23 02:08:34 juju-e4d256-prod-github-runner-207 kernel: [74688.587907] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 02:08:34 juju-e4d256-prod-github-runner-207 kernel: [74688.588937] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:08:34 juju-e4d256-prod-github-runner-207 kernel: [74688.589998] ? _raw_spin_lock+0x22/0x30 Aug 23 02:08:34 juju-e4d256-prod-github-runner-207 kernel: [74688.590955] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:08:34 juju-e4d256-prod-github-runner-207 kernel: [74688.591975] direct_page_fault+0x206/0x310 [kvm] Aug 23 02:08:34 juju-e4d256-prod-github-runner-207 kernel: [74688.593019] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 02:08:34 juju-e4d256-prod-github-runner-207 kernel: [74688.594026] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 02:08:34 juju-e4d256-prod-github-runner-207 kernel: [74688.595023] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 02:08:34 juju-e4d256-prod-github-runner-207 kernel: [74688.595988] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 02:08:34 juju-e4d256-prod-github-runner-207 kernel: [74688.596931] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 02:08:34 juju-e4d256-prod-github-runner-207 kernel: [74688.597922] handle_exit+0x98/0x230 [kvm_amd] Aug 23 02:08:34 juju-e4d256-prod-github-runner-207 kernel: [74688.598834] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 02:08:34 juju-e4d256-prod-github-runner-207 kernel: [74688.599754] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 02:08:34 juju-e4d256-prod-github-runner-207 kernel: [74688.600673] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 02:08:34 juju-e4d256-prod-github-runner-207 kernel: [74688.601596] vcpu_run+0x62/0x2c0 [kvm] Aug 23 02:08:34 juju-e4d256-prod-github-runner-207 kernel: [74688.602404] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 02:08:34 juju-e4d256-prod-github-runner-207 kernel: [74688.603212] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 02:08:34 juju-e4d256-prod-github-runner-207 kernel: [74688.604062] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 02:08:34 juju-e4d256-prod-github-runner-207 kernel: [74688.604856] ? __seccomp_filter+0x4a/0x4a0 Aug 23 02:08:34 juju-e4d256-prod-github-runner-207 kernel: [74688.605608] ? __fget_files+0x86/0xc0 Aug 23 02:08:34 juju-e4d256-prod-github-runner-207 kernel: [74688.606314] __x64_sys_ioctl+0x95/0xd0 Aug 23 02:08:34 juju-e4d256-prod-github-runner-207 kernel: [74688.607004] do_syscall_64+0x5c/0xc0 Aug 23 02:08:34 juju-e4d256-prod-github-runner-207 kernel: [74688.607665] ? do_futex+0x162/0x1f0 Aug 23 02:08:34 juju-e4d256-prod-github-runner-207 kernel: [74688.608317] ? __x64_sys_futex+0x78/0x1e0 Aug 23 02:08:34 juju-e4d256-prod-github-runner-207 kernel: [74688.608997] ? __secure_computing+0xa9/0x120 Aug 23 02:08:34 juju-e4d256-prod-github-runner-207 kernel: [74688.609683] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 02:08:34 juju-e4d256-prod-github-runner-207 kernel: [74688.610444] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:08:34 juju-e4d256-prod-github-runner-207 kernel: [74688.611163] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:08:34 juju-e4d256-prod-github-runner-207 kernel: [74688.611878] ? do_syscall_64+0x69/0xc0 Aug 23 02:08:34 juju-e4d256-prod-github-runner-207 kernel: [74688.612519] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:08:34 juju-e4d256-prod-github-runner-207 kernel: [74688.613236] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:08:34 juju-e4d256-prod-github-runner-207 kernel: [74688.613943] ? do_syscall_64+0x69/0xc0 Aug 23 02:08:34 juju-e4d256-prod-github-runner-207 kernel: [74688.614567] ? do_syscall_64+0x69/0xc0 Aug 23 02:08:34 juju-e4d256-prod-github-runner-207 kernel: [74688.615183] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 02:08:34 juju-e4d256-prod-github-runner-207 kernel: [74688.615883] RIP: 0033:0x7faa5d0edaff Aug 23 02:08:34 juju-e4d256-prod-github-runner-207 kernel: [74688.616502] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 02:08:34 juju-e4d256-prod-github-runner-207 kernel: [74688.618489] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 02:08:34 juju-e4d256-prod-github-runner-207 kernel: [74688.619398] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 02:08:34 juju-e4d256-prod-github-runner-207 kernel: [74688.620285] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 02:08:34 juju-e4d256-prod-github-runner-207 kernel: [74688.621181] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 02:08:34 juju-e4d256-prod-github-runner-207 kernel: [74688.622066] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 02:08:34 juju-e4d256-prod-github-runner-207 kernel: [74688.622952] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 02:08:34 juju-e4d256-prod-github-runner-207 kernel: [74688.623838] Aug 23 02:08:48 juju-e4d256-prod-github-runner-207 kernel: [74702.168708] rcu: INFO: rcu_sched self-detected stall on CPU Aug 23 02:08:48 juju-e4d256-prod-github-runner-207 kernel: [74702.169710] rcu: 1-....: (18587626 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=8983174 Aug 23 02:08:48 juju-e4d256-prod-github-runner-207 kernel: [74702.170832] (t=18646242 jiffies g=23269 q=63277) Aug 23 02:08:48 juju-e4d256-prod-github-runner-207 kernel: [74702.171618] NMI backtrace for cpu 1 Aug 23 02:08:48 juju-e4d256-prod-github-runner-207 kernel: [74702.172327] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 02:08:48 juju-e4d256-prod-github-runner-207 kernel: [74702.173453] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 02:08:48 juju-e4d256-prod-github-runner-207 kernel: [74702.174516] Call Trace: Aug 23 02:08:48 juju-e4d256-prod-github-runner-207 kernel: [74702.175201] Aug 23 02:08:48 juju-e4d256-prod-github-runner-207 kernel: [74702.175851] show_stack+0x52/0x5c Aug 23 02:08:48 juju-e4d256-prod-github-runner-207 kernel: [74702.176738] dump_stack_lvl+0x4a/0x63 Aug 23 02:08:48 juju-e4d256-prod-github-runner-207 kernel: [74702.177665] dump_stack+0x10/0x16 Aug 23 02:08:48 juju-e4d256-prod-github-runner-207 kernel: [74702.178420] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 23 02:08:48 juju-e4d256-prod-github-runner-207 kernel: [74702.179209] ? lapic_can_unplug_cpu+0x90/0x90 Aug 23 02:08:48 juju-e4d256-prod-github-runner-207 kernel: [74702.179990] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 23 02:08:48 juju-e4d256-prod-github-runner-207 kernel: [74702.180805] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 23 02:08:48 juju-e4d256-prod-github-runner-207 kernel: [74702.181637] trigger_single_cpu_backtrace+0x44/0x4f Aug 23 02:08:48 juju-e4d256-prod-github-runner-207 kernel: [74702.182447] rcu_dump_cpu_stacks+0x102/0x149 Aug 23 02:08:48 juju-e4d256-prod-github-runner-207 kernel: [74702.183217] print_cpu_stall.cold+0x2f/0xe2 Aug 23 02:08:48 juju-e4d256-prod-github-runner-207 kernel: [74702.183982] ? timekeeping_update+0xf7/0x150 Aug 23 02:08:48 juju-e4d256-prod-github-runner-207 kernel: [74702.184768] check_cpu_stall+0x109/0x270 Aug 23 02:08:48 juju-e4d256-prod-github-runner-207 kernel: [74702.185539] rcu_sched_clock_irq+0x9a/0x250 Aug 23 02:08:48 juju-e4d256-prod-github-runner-207 kernel: [74702.186319] update_process_times+0x94/0xd0 Aug 23 02:08:48 juju-e4d256-prod-github-runner-207 kernel: [74702.187105] tick_sched_handle+0x29/0x70 Aug 23 02:08:48 juju-e4d256-prod-github-runner-207 kernel: [74702.187856] tick_sched_timer+0x8c/0xc0 Aug 23 02:08:48 juju-e4d256-prod-github-runner-207 kernel: [74702.188610] ? tick_nohz_handler+0xb0/0xb0 Aug 23 02:08:48 juju-e4d256-prod-github-runner-207 kernel: [74702.189386] __hrtimer_run_queues+0x107/0x230 Aug 23 02:08:48 juju-e4d256-prod-github-runner-207 kernel: [74702.190189] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 02:08:48 juju-e4d256-prod-github-runner-207 kernel: [74702.190965] hrtimer_interrupt+0x101/0x220 Aug 23 02:08:48 juju-e4d256-prod-github-runner-207 kernel: [74702.191731] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 02:08:48 juju-e4d256-prod-github-runner-207 kernel: [74702.192548] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 02:08:48 juju-e4d256-prod-github-runner-207 kernel: [74702.193388] Aug 23 02:08:48 juju-e4d256-prod-github-runner-207 kernel: [74702.194025] Aug 23 02:08:48 juju-e4d256-prod-github-runner-207 kernel: [74702.194652] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 02:08:48 juju-e4d256-prod-github-runner-207 kernel: [74702.195490] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:08:48 juju-e4d256-prod-github-runner-207 kernel: [74702.196366] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 02:08:48 juju-e4d256-prod-github-runner-207 kernel: [74702.198597] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 02:08:48 juju-e4d256-prod-github-runner-207 kernel: [74702.199568] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 02:08:48 juju-e4d256-prod-github-runner-207 kernel: [74702.200567] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 02:08:48 juju-e4d256-prod-github-runner-207 kernel: [74702.201586] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 02:08:48 juju-e4d256-prod-github-runner-207 kernel: [74702.202590] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 02:08:48 juju-e4d256-prod-github-runner-207 kernel: [74702.203549] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 02:08:48 juju-e4d256-prod-github-runner-207 kernel: [74702.204507] ? _raw_spin_lock+0x22/0x30 Aug 23 02:08:48 juju-e4d256-prod-github-runner-207 kernel: [74702.205298] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:08:48 juju-e4d256-prod-github-runner-207 kernel: [74702.206160] direct_page_fault+0x206/0x310 [kvm] Aug 23 02:08:48 juju-e4d256-prod-github-runner-207 kernel: [74702.207032] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 02:08:48 juju-e4d256-prod-github-runner-207 kernel: [74702.207861] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 02:08:48 juju-e4d256-prod-github-runner-207 kernel: [74702.208683] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 02:08:48 juju-e4d256-prod-github-runner-207 kernel: [74702.209553] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 02:08:48 juju-e4d256-prod-github-runner-207 kernel: [74702.210371] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 02:08:48 juju-e4d256-prod-github-runner-207 kernel: [74702.211195] handle_exit+0x98/0x230 [kvm_amd] Aug 23 02:08:48 juju-e4d256-prod-github-runner-207 kernel: [74702.211949] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 02:08:48 juju-e4d256-prod-github-runner-207 kernel: [74702.212746] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 02:08:48 juju-e4d256-prod-github-runner-207 kernel: [74702.213566] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 02:08:48 juju-e4d256-prod-github-runner-207 kernel: [74702.214356] vcpu_run+0x62/0x2c0 [kvm] Aug 23 02:08:48 juju-e4d256-prod-github-runner-207 kernel: [74702.215069] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 02:08:48 juju-e4d256-prod-github-runner-207 kernel: [74702.215800] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 02:08:48 juju-e4d256-prod-github-runner-207 kernel: [74702.216599] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 02:08:48 juju-e4d256-prod-github-runner-207 kernel: [74702.217372] ? __seccomp_filter+0x4a/0x4a0 Aug 23 02:08:48 juju-e4d256-prod-github-runner-207 kernel: [74702.218108] ? __fget_files+0x86/0xc0 Aug 23 02:08:48 juju-e4d256-prod-github-runner-207 kernel: [74702.218800] __x64_sys_ioctl+0x95/0xd0 Aug 23 02:08:48 juju-e4d256-prod-github-runner-207 kernel: [74702.219494] do_syscall_64+0x5c/0xc0 Aug 23 02:08:48 juju-e4d256-prod-github-runner-207 kernel: [74702.220173] ? do_futex+0x162/0x1f0 Aug 23 02:08:48 juju-e4d256-prod-github-runner-207 kernel: [74702.220852] ? __x64_sys_futex+0x78/0x1e0 Aug 23 02:08:48 juju-e4d256-prod-github-runner-207 kernel: [74702.221553] ? __secure_computing+0xa9/0x120 Aug 23 02:08:48 juju-e4d256-prod-github-runner-207 kernel: [74702.222267] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 02:08:48 juju-e4d256-prod-github-runner-207 kernel: [74702.223057] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:08:48 juju-e4d256-prod-github-runner-207 kernel: [74702.223819] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:08:48 juju-e4d256-prod-github-runner-207 kernel: [74702.224571] ? do_syscall_64+0x69/0xc0 Aug 23 02:08:48 juju-e4d256-prod-github-runner-207 kernel: [74702.225272] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:08:48 juju-e4d256-prod-github-runner-207 kernel: [74702.226035] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:08:48 juju-e4d256-prod-github-runner-207 kernel: [74702.226812] ? do_syscall_64+0x69/0xc0 Aug 23 02:08:48 juju-e4d256-prod-github-runner-207 kernel: [74702.227536] ? do_syscall_64+0x69/0xc0 Aug 23 02:08:48 juju-e4d256-prod-github-runner-207 kernel: [74702.228225] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 02:08:48 juju-e4d256-prod-github-runner-207 kernel: [74702.229018] RIP: 0033:0x7faa5d0edaff Aug 23 02:08:48 juju-e4d256-prod-github-runner-207 kernel: [74702.229701] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 02:08:48 juju-e4d256-prod-github-runner-207 kernel: [74702.231812] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 02:08:48 juju-e4d256-prod-github-runner-207 kernel: [74702.232778] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 02:08:48 juju-e4d256-prod-github-runner-207 kernel: [74702.233737] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 02:08:48 juju-e4d256-prod-github-runner-207 kernel: [74702.234691] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 02:08:48 juju-e4d256-prod-github-runner-207 kernel: [74702.235643] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 02:08:48 juju-e4d256-prod-github-runner-207 kernel: [74702.236572] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 02:08:48 juju-e4d256-prod-github-runner-207 kernel: [74702.237501] Aug 23 02:09:14 juju-e4d256-prod-github-runner-207 kernel: [74728.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 69488s! [qemu-system-x86:6715] Aug 23 02:09:14 juju-e4d256-prod-github-runner-207 kernel: [74728.543772] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 02:09:14 juju-e4d256-prod-github-runner-207 kernel: [74728.544044] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 02:09:14 juju-e4d256-prod-github-runner-207 kernel: [74728.556221] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 02:09:14 juju-e4d256-prod-github-runner-207 kernel: [74728.557500] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 02:09:14 juju-e4d256-prod-github-runner-207 kernel: [74728.558731] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:09:14 juju-e4d256-prod-github-runner-207 kernel: [74728.559798] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 02:09:14 juju-e4d256-prod-github-runner-207 kernel: [74728.562357] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 02:09:14 juju-e4d256-prod-github-runner-207 kernel: [74728.563398] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 02:09:14 juju-e4d256-prod-github-runner-207 kernel: [74728.564595] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 02:09:14 juju-e4d256-prod-github-runner-207 kernel: [74728.565769] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 02:09:14 juju-e4d256-prod-github-runner-207 kernel: [74728.566932] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 02:09:14 juju-e4d256-prod-github-runner-207 kernel: [74728.568089] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 02:09:14 juju-e4d256-prod-github-runner-207 kernel: [74728.569280] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 02:09:14 juju-e4d256-prod-github-runner-207 kernel: [74728.570524] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 02:09:14 juju-e4d256-prod-github-runner-207 kernel: [74728.571629] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 02:09:14 juju-e4d256-prod-github-runner-207 kernel: [74728.572836] Call Trace: Aug 23 02:09:14 juju-e4d256-prod-github-runner-207 kernel: [74728.573749] Aug 23 02:09:14 juju-e4d256-prod-github-runner-207 kernel: [74728.574666] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:09:14 juju-e4d256-prod-github-runner-207 kernel: [74728.575708] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:09:14 juju-e4d256-prod-github-runner-207 kernel: [74728.576747] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:09:14 juju-e4d256-prod-github-runner-207 kernel: [74728.577860] ? show_regs.part.0+0x23/0x29 Aug 23 02:09:14 juju-e4d256-prod-github-runner-207 kernel: [74728.578855] ? show_regs.cold+0x8/0xd Aug 23 02:09:14 juju-e4d256-prod-github-runner-207 kernel: [74728.579845] ? watchdog_timer_fn+0x1be/0x220 Aug 23 02:09:14 juju-e4d256-prod-github-runner-207 kernel: [74728.580880] ? lockup_detector_update_enable+0x60/0x60 Aug 23 02:09:14 juju-e4d256-prod-github-runner-207 kernel: [74728.581944] ? __hrtimer_run_queues+0x107/0x230 Aug 23 02:09:14 juju-e4d256-prod-github-runner-207 kernel: [74728.582969] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 02:09:14 juju-e4d256-prod-github-runner-207 kernel: [74728.583990] ? hrtimer_interrupt+0x101/0x220 Aug 23 02:09:14 juju-e4d256-prod-github-runner-207 kernel: [74728.585026] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 02:09:14 juju-e4d256-prod-github-runner-207 kernel: [74728.586105] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 02:09:14 juju-e4d256-prod-github-runner-207 kernel: [74728.587151] Aug 23 02:09:14 juju-e4d256-prod-github-runner-207 kernel: [74728.588004] Aug 23 02:09:14 juju-e4d256-prod-github-runner-207 kernel: [74728.588860] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 02:09:14 juju-e4d256-prod-github-runner-207 kernel: [74728.589917] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:09:14 juju-e4d256-prod-github-runner-207 kernel: [74728.590967] ? _raw_spin_lock+0x22/0x30 Aug 23 02:09:14 juju-e4d256-prod-github-runner-207 kernel: [74728.591913] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:09:14 juju-e4d256-prod-github-runner-207 kernel: [74728.592942] direct_page_fault+0x206/0x310 [kvm] Aug 23 02:09:14 juju-e4d256-prod-github-runner-207 kernel: [74728.593966] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 02:09:14 juju-e4d256-prod-github-runner-207 kernel: [74728.594983] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 02:09:14 juju-e4d256-prod-github-runner-207 kernel: [74728.596003] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 02:09:14 juju-e4d256-prod-github-runner-207 kernel: [74728.597010] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 02:09:14 juju-e4d256-prod-github-runner-207 kernel: [74728.597957] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 02:09:14 juju-e4d256-prod-github-runner-207 kernel: [74728.598934] handle_exit+0x98/0x230 [kvm_amd] Aug 23 02:09:14 juju-e4d256-prod-github-runner-207 kernel: [74728.599825] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 02:09:14 juju-e4d256-prod-github-runner-207 kernel: [74728.600760] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 02:09:14 juju-e4d256-prod-github-runner-207 kernel: [74728.601696] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 02:09:14 juju-e4d256-prod-github-runner-207 kernel: [74728.602597] vcpu_run+0x62/0x2c0 [kvm] Aug 23 02:09:14 juju-e4d256-prod-github-runner-207 kernel: [74728.603406] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 02:09:14 juju-e4d256-prod-github-runner-207 kernel: [74728.604212] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 02:09:14 juju-e4d256-prod-github-runner-207 kernel: [74728.605090] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 02:09:14 juju-e4d256-prod-github-runner-207 kernel: [74728.605890] ? __seccomp_filter+0x4a/0x4a0 Aug 23 02:09:14 juju-e4d256-prod-github-runner-207 kernel: [74728.606640] ? __fget_files+0x86/0xc0 Aug 23 02:09:14 juju-e4d256-prod-github-runner-207 kernel: [74728.607341] __x64_sys_ioctl+0x95/0xd0 Aug 23 02:09:14 juju-e4d256-prod-github-runner-207 kernel: [74728.608030] do_syscall_64+0x5c/0xc0 Aug 23 02:09:14 juju-e4d256-prod-github-runner-207 kernel: [74728.608711] ? do_futex+0x162/0x1f0 Aug 23 02:09:14 juju-e4d256-prod-github-runner-207 kernel: [74728.609361] ? __x64_sys_futex+0x78/0x1e0 Aug 23 02:09:14 juju-e4d256-prod-github-runner-207 kernel: [74728.610033] ? __secure_computing+0xa9/0x120 Aug 23 02:09:14 juju-e4d256-prod-github-runner-207 kernel: [74728.610734] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 02:09:14 juju-e4d256-prod-github-runner-207 kernel: [74728.611505] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:09:14 juju-e4d256-prod-github-runner-207 kernel: [74728.612227] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:09:14 juju-e4d256-prod-github-runner-207 kernel: [74728.612957] ? do_syscall_64+0x69/0xc0 Aug 23 02:09:14 juju-e4d256-prod-github-runner-207 kernel: [74728.613601] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:09:14 juju-e4d256-prod-github-runner-207 kernel: [74728.614302] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:09:14 juju-e4d256-prod-github-runner-207 kernel: [74728.615000] ? do_syscall_64+0x69/0xc0 Aug 23 02:09:14 juju-e4d256-prod-github-runner-207 kernel: [74728.615631] ? do_syscall_64+0x69/0xc0 Aug 23 02:09:14 juju-e4d256-prod-github-runner-207 kernel: [74728.616254] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 02:09:14 juju-e4d256-prod-github-runner-207 kernel: [74728.616976] RIP: 0033:0x7faa5d0edaff Aug 23 02:09:14 juju-e4d256-prod-github-runner-207 kernel: [74728.617619] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 02:09:14 juju-e4d256-prod-github-runner-207 kernel: [74728.619599] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 02:09:14 juju-e4d256-prod-github-runner-207 kernel: [74728.620541] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 02:09:14 juju-e4d256-prod-github-runner-207 kernel: [74728.621437] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 02:09:14 juju-e4d256-prod-github-runner-207 kernel: [74728.622336] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 02:09:14 juju-e4d256-prod-github-runner-207 kernel: [74728.623221] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 02:09:14 juju-e4d256-prod-github-runner-207 kernel: [74728.624108] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 02:09:14 juju-e4d256-prod-github-runner-207 kernel: [74728.625015] Aug 23 02:09:42 juju-e4d256-prod-github-runner-207 kernel: [74756.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 69514s! [qemu-system-x86:6715] Aug 23 02:09:42 juju-e4d256-prod-github-runner-207 kernel: [74756.543101] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 02:09:42 juju-e4d256-prod-github-runner-207 kernel: [74756.543168] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 02:09:42 juju-e4d256-prod-github-runner-207 kernel: [74756.555297] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 02:09:42 juju-e4d256-prod-github-runner-207 kernel: [74756.556570] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 02:09:42 juju-e4d256-prod-github-runner-207 kernel: [74756.557790] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:09:42 juju-e4d256-prod-github-runner-207 kernel: [74756.558853] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 02:09:42 juju-e4d256-prod-github-runner-207 kernel: [74756.561419] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 02:09:42 juju-e4d256-prod-github-runner-207 kernel: [74756.562466] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 02:09:42 juju-e4d256-prod-github-runner-207 kernel: [74756.563629] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 02:09:42 juju-e4d256-prod-github-runner-207 kernel: [74756.564806] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 02:09:42 juju-e4d256-prod-github-runner-207 kernel: [74756.565965] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 02:09:42 juju-e4d256-prod-github-runner-207 kernel: [74756.567129] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 02:09:42 juju-e4d256-prod-github-runner-207 kernel: [74756.568313] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 02:09:42 juju-e4d256-prod-github-runner-207 kernel: [74756.569551] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 02:09:42 juju-e4d256-prod-github-runner-207 kernel: [74756.570648] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 02:09:42 juju-e4d256-prod-github-runner-207 kernel: [74756.571838] Call Trace: Aug 23 02:09:42 juju-e4d256-prod-github-runner-207 kernel: [74756.572764] Aug 23 02:09:42 juju-e4d256-prod-github-runner-207 kernel: [74756.573646] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:09:42 juju-e4d256-prod-github-runner-207 kernel: [74756.574673] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:09:42 juju-e4d256-prod-github-runner-207 kernel: [74756.575696] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:09:42 juju-e4d256-prod-github-runner-207 kernel: [74756.576882] ? show_regs.part.0+0x23/0x29 Aug 23 02:09:42 juju-e4d256-prod-github-runner-207 kernel: [74756.577886] ? show_regs.cold+0x8/0xd Aug 23 02:09:42 juju-e4d256-prod-github-runner-207 kernel: [74756.578859] ? watchdog_timer_fn+0x1be/0x220 Aug 23 02:09:42 juju-e4d256-prod-github-runner-207 kernel: [74756.579867] ? lockup_detector_update_enable+0x60/0x60 Aug 23 02:09:42 juju-e4d256-prod-github-runner-207 kernel: [74756.580939] ? __hrtimer_run_queues+0x107/0x230 Aug 23 02:09:42 juju-e4d256-prod-github-runner-207 kernel: [74756.581970] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 02:09:42 juju-e4d256-prod-github-runner-207 kernel: [74756.582992] ? hrtimer_interrupt+0x101/0x220 Aug 23 02:09:42 juju-e4d256-prod-github-runner-207 kernel: [74756.584007] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 02:09:42 juju-e4d256-prod-github-runner-207 kernel: [74756.585095] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 02:09:42 juju-e4d256-prod-github-runner-207 kernel: [74756.586144] Aug 23 02:09:42 juju-e4d256-prod-github-runner-207 kernel: [74756.586996] Aug 23 02:09:42 juju-e4d256-prod-github-runner-207 kernel: [74756.587836] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 02:09:42 juju-e4d256-prod-github-runner-207 kernel: [74756.588877] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:09:42 juju-e4d256-prod-github-runner-207 kernel: [74756.589929] ? _raw_spin_lock+0x22/0x30 Aug 23 02:09:42 juju-e4d256-prod-github-runner-207 kernel: [74756.590890] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:09:42 juju-e4d256-prod-github-runner-207 kernel: [74756.591906] direct_page_fault+0x206/0x310 [kvm] Aug 23 02:09:42 juju-e4d256-prod-github-runner-207 kernel: [74756.592936] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 02:09:42 juju-e4d256-prod-github-runner-207 kernel: [74756.593947] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 02:09:42 juju-e4d256-prod-github-runner-207 kernel: [74756.594946] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 02:09:42 juju-e4d256-prod-github-runner-207 kernel: [74756.595913] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 02:09:42 juju-e4d256-prod-github-runner-207 kernel: [74756.596870] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 02:09:42 juju-e4d256-prod-github-runner-207 kernel: [74756.597847] handle_exit+0x98/0x230 [kvm_amd] Aug 23 02:09:42 juju-e4d256-prod-github-runner-207 kernel: [74756.598736] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 02:09:42 juju-e4d256-prod-github-runner-207 kernel: [74756.599653] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 02:09:42 juju-e4d256-prod-github-runner-207 kernel: [74756.600583] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 02:09:42 juju-e4d256-prod-github-runner-207 kernel: [74756.601485] vcpu_run+0x62/0x2c0 [kvm] Aug 23 02:09:42 juju-e4d256-prod-github-runner-207 kernel: [74756.602294] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 02:09:42 juju-e4d256-prod-github-runner-207 kernel: [74756.603162] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 02:09:42 juju-e4d256-prod-github-runner-207 kernel: [74756.604014] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 02:09:42 juju-e4d256-prod-github-runner-207 kernel: [74756.604817] ? __seccomp_filter+0x4a/0x4a0 Aug 23 02:09:42 juju-e4d256-prod-github-runner-207 kernel: [74756.605557] ? __fget_files+0x86/0xc0 Aug 23 02:09:42 juju-e4d256-prod-github-runner-207 kernel: [74756.606259] __x64_sys_ioctl+0x95/0xd0 Aug 23 02:09:42 juju-e4d256-prod-github-runner-207 kernel: [74756.606953] do_syscall_64+0x5c/0xc0 Aug 23 02:09:42 juju-e4d256-prod-github-runner-207 kernel: [74756.607616] ? do_futex+0x162/0x1f0 Aug 23 02:09:42 juju-e4d256-prod-github-runner-207 kernel: [74756.608276] ? __x64_sys_futex+0x78/0x1e0 Aug 23 02:09:42 juju-e4d256-prod-github-runner-207 kernel: [74756.608947] ? __secure_computing+0xa9/0x120 Aug 23 02:09:42 juju-e4d256-prod-github-runner-207 kernel: [74756.609636] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 02:09:42 juju-e4d256-prod-github-runner-207 kernel: [74756.610399] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:09:42 juju-e4d256-prod-github-runner-207 kernel: [74756.611124] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:09:42 juju-e4d256-prod-github-runner-207 kernel: [74756.611838] ? do_syscall_64+0x69/0xc0 Aug 23 02:09:42 juju-e4d256-prod-github-runner-207 kernel: [74756.612494] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:09:42 juju-e4d256-prod-github-runner-207 kernel: [74756.613196] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:09:42 juju-e4d256-prod-github-runner-207 kernel: [74756.613889] ? do_syscall_64+0x69/0xc0 Aug 23 02:09:42 juju-e4d256-prod-github-runner-207 kernel: [74756.614512] ? do_syscall_64+0x69/0xc0 Aug 23 02:09:42 juju-e4d256-prod-github-runner-207 kernel: [74756.615133] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 02:09:42 juju-e4d256-prod-github-runner-207 kernel: [74756.615861] RIP: 0033:0x7faa5d0edaff Aug 23 02:09:42 juju-e4d256-prod-github-runner-207 kernel: [74756.616516] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 02:09:42 juju-e4d256-prod-github-runner-207 kernel: [74756.618497] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 02:09:42 juju-e4d256-prod-github-runner-207 kernel: [74756.619416] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 02:09:42 juju-e4d256-prod-github-runner-207 kernel: [74756.620387] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 02:09:42 juju-e4d256-prod-github-runner-207 kernel: [74756.621279] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 02:09:42 juju-e4d256-prod-github-runner-207 kernel: [74756.622171] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 02:09:42 juju-e4d256-prod-github-runner-207 kernel: [74756.623061] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 02:09:42 juju-e4d256-prod-github-runner-207 kernel: [74756.623952] Aug 23 02:10:10 juju-e4d256-prod-github-runner-207 kernel: [74784.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 69540s! [qemu-system-x86:6715] Aug 23 02:10:10 juju-e4d256-prod-github-runner-207 kernel: [74784.543098] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 02:10:10 juju-e4d256-prod-github-runner-207 kernel: [74784.543165] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 02:10:10 juju-e4d256-prod-github-runner-207 kernel: [74784.555529] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 02:10:10 juju-e4d256-prod-github-runner-207 kernel: [74784.556813] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 02:10:10 juju-e4d256-prod-github-runner-207 kernel: [74784.558034] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:10:10 juju-e4d256-prod-github-runner-207 kernel: [74784.559091] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 02:10:10 juju-e4d256-prod-github-runner-207 kernel: [74784.561658] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 02:10:10 juju-e4d256-prod-github-runner-207 kernel: [74784.562705] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 02:10:10 juju-e4d256-prod-github-runner-207 kernel: [74784.563867] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 02:10:10 juju-e4d256-prod-github-runner-207 kernel: [74784.565043] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 02:10:10 juju-e4d256-prod-github-runner-207 kernel: [74784.566206] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 02:10:10 juju-e4d256-prod-github-runner-207 kernel: [74784.567365] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 02:10:10 juju-e4d256-prod-github-runner-207 kernel: [74784.568546] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 02:10:10 juju-e4d256-prod-github-runner-207 kernel: [74784.569793] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 02:10:10 juju-e4d256-prod-github-runner-207 kernel: [74784.570889] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 02:10:10 juju-e4d256-prod-github-runner-207 kernel: [74784.572100] Call Trace: Aug 23 02:10:10 juju-e4d256-prod-github-runner-207 kernel: [74784.573026] Aug 23 02:10:10 juju-e4d256-prod-github-runner-207 kernel: [74784.573956] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:10:10 juju-e4d256-prod-github-runner-207 kernel: [74784.574990] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:10:10 juju-e4d256-prod-github-runner-207 kernel: [74784.576034] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:10:10 juju-e4d256-prod-github-runner-207 kernel: [74784.577114] ? show_regs.part.0+0x23/0x29 Aug 23 02:10:10 juju-e4d256-prod-github-runner-207 kernel: [74784.578118] ? show_regs.cold+0x8/0xd Aug 23 02:10:10 juju-e4d256-prod-github-runner-207 kernel: [74784.579099] ? watchdog_timer_fn+0x1be/0x220 Aug 23 02:10:10 juju-e4d256-prod-github-runner-207 kernel: [74784.580129] ? lockup_detector_update_enable+0x60/0x60 Aug 23 02:10:10 juju-e4d256-prod-github-runner-207 kernel: [74784.581205] ? __hrtimer_run_queues+0x107/0x230 Aug 23 02:10:10 juju-e4d256-prod-github-runner-207 kernel: [74784.582250] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 02:10:10 juju-e4d256-prod-github-runner-207 kernel: [74784.583281] ? hrtimer_interrupt+0x101/0x220 Aug 23 02:10:10 juju-e4d256-prod-github-runner-207 kernel: [74784.584322] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 02:10:10 juju-e4d256-prod-github-runner-207 kernel: [74784.585401] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 02:10:10 juju-e4d256-prod-github-runner-207 kernel: [74784.586487] Aug 23 02:10:10 juju-e4d256-prod-github-runner-207 kernel: [74784.587341] Aug 23 02:10:10 juju-e4d256-prod-github-runner-207 kernel: [74784.588200] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 02:10:10 juju-e4d256-prod-github-runner-207 kernel: [74784.589249] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:10:10 juju-e4d256-prod-github-runner-207 kernel: [74784.590297] ? _raw_spin_lock+0x22/0x30 Aug 23 02:10:10 juju-e4d256-prod-github-runner-207 kernel: [74784.591240] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:10:10 juju-e4d256-prod-github-runner-207 kernel: [74784.592298] direct_page_fault+0x206/0x310 [kvm] Aug 23 02:10:10 juju-e4d256-prod-github-runner-207 kernel: [74784.593323] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 02:10:10 juju-e4d256-prod-github-runner-207 kernel: [74784.594333] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 02:10:10 juju-e4d256-prod-github-runner-207 kernel: [74784.595345] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 02:10:10 juju-e4d256-prod-github-runner-207 kernel: [74784.596331] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 02:10:10 juju-e4d256-prod-github-runner-207 kernel: [74784.597280] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 02:10:10 juju-e4d256-prod-github-runner-207 kernel: [74784.598257] handle_exit+0x98/0x230 [kvm_amd] Aug 23 02:10:10 juju-e4d256-prod-github-runner-207 kernel: [74784.599162] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 02:10:10 juju-e4d256-prod-github-runner-207 kernel: [74784.600091] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 02:10:10 juju-e4d256-prod-github-runner-207 kernel: [74784.601027] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 02:10:10 juju-e4d256-prod-github-runner-207 kernel: [74784.601926] vcpu_run+0x62/0x2c0 [kvm] Aug 23 02:10:10 juju-e4d256-prod-github-runner-207 kernel: [74784.602733] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 02:10:10 juju-e4d256-prod-github-runner-207 kernel: [74784.603544] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 02:10:10 juju-e4d256-prod-github-runner-207 kernel: [74784.604408] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 02:10:10 juju-e4d256-prod-github-runner-207 kernel: [74784.605208] ? __seccomp_filter+0x4a/0x4a0 Aug 23 02:10:10 juju-e4d256-prod-github-runner-207 kernel: [74784.605948] ? __fget_files+0x86/0xc0 Aug 23 02:10:10 juju-e4d256-prod-github-runner-207 kernel: [74784.606649] __x64_sys_ioctl+0x95/0xd0 Aug 23 02:10:10 juju-e4d256-prod-github-runner-207 kernel: [74784.607342] do_syscall_64+0x5c/0xc0 Aug 23 02:10:10 juju-e4d256-prod-github-runner-207 kernel: [74784.608014] ? do_futex+0x162/0x1f0 Aug 23 02:10:10 juju-e4d256-prod-github-runner-207 kernel: [74784.608661] ? __x64_sys_futex+0x78/0x1e0 Aug 23 02:10:10 juju-e4d256-prod-github-runner-207 kernel: [74784.609332] ? __secure_computing+0xa9/0x120 Aug 23 02:10:10 juju-e4d256-prod-github-runner-207 kernel: [74784.610018] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 02:10:10 juju-e4d256-prod-github-runner-207 kernel: [74784.610778] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:10:10 juju-e4d256-prod-github-runner-207 kernel: [74784.611498] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:10:10 juju-e4d256-prod-github-runner-207 kernel: [74784.612220] ? do_syscall_64+0x69/0xc0 Aug 23 02:10:10 juju-e4d256-prod-github-runner-207 kernel: [74784.612862] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:10:10 juju-e4d256-prod-github-runner-207 kernel: [74784.613567] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:10:10 juju-e4d256-prod-github-runner-207 kernel: [74784.614262] ? do_syscall_64+0x69/0xc0 Aug 23 02:10:10 juju-e4d256-prod-github-runner-207 kernel: [74784.614883] ? do_syscall_64+0x69/0xc0 Aug 23 02:10:10 juju-e4d256-prod-github-runner-207 kernel: [74784.615506] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 02:10:10 juju-e4d256-prod-github-runner-207 kernel: [74784.616217] RIP: 0033:0x7faa5d0edaff Aug 23 02:10:10 juju-e4d256-prod-github-runner-207 kernel: [74784.616840] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 02:10:10 juju-e4d256-prod-github-runner-207 kernel: [74784.618824] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 02:10:10 juju-e4d256-prod-github-runner-207 kernel: [74784.619755] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 02:10:10 juju-e4d256-prod-github-runner-207 kernel: [74784.620729] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 02:10:10 juju-e4d256-prod-github-runner-207 kernel: [74784.621611] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 02:10:10 juju-e4d256-prod-github-runner-207 kernel: [74784.622492] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 02:10:10 juju-e4d256-prod-github-runner-207 kernel: [74784.623379] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 02:10:10 juju-e4d256-prod-github-runner-207 kernel: [74784.624274] Aug 23 02:10:38 juju-e4d256-prod-github-runner-207 kernel: [74812.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 69566s! [qemu-system-x86:6715] Aug 23 02:10:38 juju-e4d256-prod-github-runner-207 kernel: [74812.543806] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 02:10:38 juju-e4d256-prod-github-runner-207 kernel: [74812.544070] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 02:10:38 juju-e4d256-prod-github-runner-207 kernel: [74812.556209] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 02:10:38 juju-e4d256-prod-github-runner-207 kernel: [74812.557482] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 02:10:38 juju-e4d256-prod-github-runner-207 kernel: [74812.558756] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:10:38 juju-e4d256-prod-github-runner-207 kernel: [74812.559852] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 02:10:38 juju-e4d256-prod-github-runner-207 kernel: [74812.562400] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 02:10:38 juju-e4d256-prod-github-runner-207 kernel: [74812.563447] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 02:10:38 juju-e4d256-prod-github-runner-207 kernel: [74812.564627] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 02:10:38 juju-e4d256-prod-github-runner-207 kernel: [74812.565790] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 02:10:38 juju-e4d256-prod-github-runner-207 kernel: [74812.566944] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 02:10:38 juju-e4d256-prod-github-runner-207 kernel: [74812.568138] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 02:10:38 juju-e4d256-prod-github-runner-207 kernel: [74812.569315] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 02:10:38 juju-e4d256-prod-github-runner-207 kernel: [74812.570547] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 02:10:38 juju-e4d256-prod-github-runner-207 kernel: [74812.571650] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 02:10:38 juju-e4d256-prod-github-runner-207 kernel: [74812.572845] Call Trace: Aug 23 02:10:38 juju-e4d256-prod-github-runner-207 kernel: [74812.573757] Aug 23 02:10:38 juju-e4d256-prod-github-runner-207 kernel: [74812.574652] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:10:38 juju-e4d256-prod-github-runner-207 kernel: [74812.575764] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:10:38 juju-e4d256-prod-github-runner-207 kernel: [74812.576800] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:10:38 juju-e4d256-prod-github-runner-207 kernel: [74812.577908] ? show_regs.part.0+0x23/0x29 Aug 23 02:10:38 juju-e4d256-prod-github-runner-207 kernel: [74812.578910] ? show_regs.cold+0x8/0xd Aug 23 02:10:38 juju-e4d256-prod-github-runner-207 kernel: [74812.579903] ? watchdog_timer_fn+0x1be/0x220 Aug 23 02:10:38 juju-e4d256-prod-github-runner-207 kernel: [74812.580913] ? lockup_detector_update_enable+0x60/0x60 Aug 23 02:10:38 juju-e4d256-prod-github-runner-207 kernel: [74812.581979] ? __hrtimer_run_queues+0x107/0x230 Aug 23 02:10:38 juju-e4d256-prod-github-runner-207 kernel: [74812.583014] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 02:10:38 juju-e4d256-prod-github-runner-207 kernel: [74812.584063] ? hrtimer_interrupt+0x101/0x220 Aug 23 02:10:38 juju-e4d256-prod-github-runner-207 kernel: [74812.585080] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 02:10:38 juju-e4d256-prod-github-runner-207 kernel: [74812.586155] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 02:10:38 juju-e4d256-prod-github-runner-207 kernel: [74812.587203] Aug 23 02:10:38 juju-e4d256-prod-github-runner-207 kernel: [74812.588084] Aug 23 02:10:38 juju-e4d256-prod-github-runner-207 kernel: [74812.588922] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 02:10:38 juju-e4d256-prod-github-runner-207 kernel: [74812.589960] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:10:38 juju-e4d256-prod-github-runner-207 kernel: [74812.590997] ? _raw_spin_lock+0x22/0x30 Aug 23 02:10:38 juju-e4d256-prod-github-runner-207 kernel: [74812.591958] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:10:38 juju-e4d256-prod-github-runner-207 kernel: [74812.592981] direct_page_fault+0x206/0x310 [kvm] Aug 23 02:10:38 juju-e4d256-prod-github-runner-207 kernel: [74812.594009] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 02:10:38 juju-e4d256-prod-github-runner-207 kernel: [74812.595015] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 02:10:38 juju-e4d256-prod-github-runner-207 kernel: [74812.596026] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 02:10:38 juju-e4d256-prod-github-runner-207 kernel: [74812.597029] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 02:10:38 juju-e4d256-prod-github-runner-207 kernel: [74812.597979] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 02:10:38 juju-e4d256-prod-github-runner-207 kernel: [74812.598954] handle_exit+0x98/0x230 [kvm_amd] Aug 23 02:10:38 juju-e4d256-prod-github-runner-207 kernel: [74812.599856] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 02:10:38 juju-e4d256-prod-github-runner-207 kernel: [74812.600772] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 02:10:38 juju-e4d256-prod-github-runner-207 kernel: [74812.601696] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 02:10:38 juju-e4d256-prod-github-runner-207 kernel: [74812.602608] vcpu_run+0x62/0x2c0 [kvm] Aug 23 02:10:38 juju-e4d256-prod-github-runner-207 kernel: [74812.603422] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 02:10:38 juju-e4d256-prod-github-runner-207 kernel: [74812.604594] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 02:10:38 juju-e4d256-prod-github-runner-207 kernel: [74812.605577] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 02:10:38 juju-e4d256-prod-github-runner-207 kernel: [74812.606399] ? __seccomp_filter+0x4a/0x4a0 Aug 23 02:10:38 juju-e4d256-prod-github-runner-207 kernel: [74812.607158] ? __fget_files+0x86/0xc0 Aug 23 02:10:38 juju-e4d256-prod-github-runner-207 kernel: [74812.607903] __x64_sys_ioctl+0x95/0xd0 Aug 23 02:10:38 juju-e4d256-prod-github-runner-207 kernel: [74812.608615] do_syscall_64+0x5c/0xc0 Aug 23 02:10:38 juju-e4d256-prod-github-runner-207 kernel: [74812.609285] ? do_futex+0x162/0x1f0 Aug 23 02:10:38 juju-e4d256-prod-github-runner-207 kernel: [74812.609945] ? __x64_sys_futex+0x78/0x1e0 Aug 23 02:10:38 juju-e4d256-prod-github-runner-207 kernel: [74812.610629] ? __secure_computing+0xa9/0x120 Aug 23 02:10:38 juju-e4d256-prod-github-runner-207 kernel: [74812.611321] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 02:10:38 juju-e4d256-prod-github-runner-207 kernel: [74812.612103] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:10:38 juju-e4d256-prod-github-runner-207 kernel: [74812.612829] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:10:38 juju-e4d256-prod-github-runner-207 kernel: [74812.613548] ? do_syscall_64+0x69/0xc0 Aug 23 02:10:38 juju-e4d256-prod-github-runner-207 kernel: [74812.614198] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:10:38 juju-e4d256-prod-github-runner-207 kernel: [74812.614899] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:10:38 juju-e4d256-prod-github-runner-207 kernel: [74812.615602] ? do_syscall_64+0x69/0xc0 Aug 23 02:10:38 juju-e4d256-prod-github-runner-207 kernel: [74812.616227] ? do_syscall_64+0x69/0xc0 Aug 23 02:10:38 juju-e4d256-prod-github-runner-207 kernel: [74812.616856] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 02:10:38 juju-e4d256-prod-github-runner-207 kernel: [74812.617569] RIP: 0033:0x7faa5d0edaff Aug 23 02:10:38 juju-e4d256-prod-github-runner-207 kernel: [74812.618225] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 02:10:38 juju-e4d256-prod-github-runner-207 kernel: [74812.620241] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 02:10:38 juju-e4d256-prod-github-runner-207 kernel: [74812.621193] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 02:10:38 juju-e4d256-prod-github-runner-207 kernel: [74812.622098] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 02:10:38 juju-e4d256-prod-github-runner-207 kernel: [74812.623003] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 02:10:38 juju-e4d256-prod-github-runner-207 kernel: [74812.624003] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 02:10:38 juju-e4d256-prod-github-runner-207 kernel: [74812.624985] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 02:10:38 juju-e4d256-prod-github-runner-207 kernel: [74812.625885] Aug 23 02:11:06 juju-e4d256-prod-github-runner-207 kernel: [74840.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 69592s! [qemu-system-x86:6715] Aug 23 02:11:06 juju-e4d256-prod-github-runner-207 kernel: [74840.543146] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 02:11:06 juju-e4d256-prod-github-runner-207 kernel: [74840.543215] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 02:11:06 juju-e4d256-prod-github-runner-207 kernel: [74840.555611] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 02:11:06 juju-e4d256-prod-github-runner-207 kernel: [74840.556870] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 02:11:06 juju-e4d256-prod-github-runner-207 kernel: [74840.558088] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:11:06 juju-e4d256-prod-github-runner-207 kernel: [74840.559140] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 02:11:06 juju-e4d256-prod-github-runner-207 kernel: [74840.561695] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 02:11:06 juju-e4d256-prod-github-runner-207 kernel: [74840.562733] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 02:11:06 juju-e4d256-prod-github-runner-207 kernel: [74840.563911] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 02:11:06 juju-e4d256-prod-github-runner-207 kernel: [74840.565073] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 02:11:06 juju-e4d256-prod-github-runner-207 kernel: [74840.566234] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 02:11:06 juju-e4d256-prod-github-runner-207 kernel: [74840.567413] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 02:11:06 juju-e4d256-prod-github-runner-207 kernel: [74840.568573] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 02:11:06 juju-e4d256-prod-github-runner-207 kernel: [74840.569800] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 02:11:06 juju-e4d256-prod-github-runner-207 kernel: [74840.570902] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 02:11:06 juju-e4d256-prod-github-runner-207 kernel: [74840.572106] Call Trace: Aug 23 02:11:06 juju-e4d256-prod-github-runner-207 kernel: [74840.573020] Aug 23 02:11:06 juju-e4d256-prod-github-runner-207 kernel: [74840.573901] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:11:06 juju-e4d256-prod-github-runner-207 kernel: [74840.574931] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:11:06 juju-e4d256-prod-github-runner-207 kernel: [74840.575968] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:11:06 juju-e4d256-prod-github-runner-207 kernel: [74840.577041] ? show_regs.part.0+0x23/0x29 Aug 23 02:11:06 juju-e4d256-prod-github-runner-207 kernel: [74840.578034] ? show_regs.cold+0x8/0xd Aug 23 02:11:06 juju-e4d256-prod-github-runner-207 kernel: [74840.579001] ? watchdog_timer_fn+0x1be/0x220 Aug 23 02:11:06 juju-e4d256-prod-github-runner-207 kernel: [74840.580021] ? lockup_detector_update_enable+0x60/0x60 Aug 23 02:11:06 juju-e4d256-prod-github-runner-207 kernel: [74840.581086] ? __hrtimer_run_queues+0x107/0x230 Aug 23 02:11:06 juju-e4d256-prod-github-runner-207 kernel: [74840.582114] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 02:11:06 juju-e4d256-prod-github-runner-207 kernel: [74840.583137] ? hrtimer_interrupt+0x101/0x220 Aug 23 02:11:06 juju-e4d256-prod-github-runner-207 kernel: [74840.584159] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 02:11:06 juju-e4d256-prod-github-runner-207 kernel: [74840.585227] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 02:11:06 juju-e4d256-prod-github-runner-207 kernel: [74840.586267] Aug 23 02:11:06 juju-e4d256-prod-github-runner-207 kernel: [74840.587121] Aug 23 02:11:06 juju-e4d256-prod-github-runner-207 kernel: [74840.587968] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 02:11:06 juju-e4d256-prod-github-runner-207 kernel: [74840.588995] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:11:06 juju-e4d256-prod-github-runner-207 kernel: [74840.590035] ? _raw_spin_lock+0x22/0x30 Aug 23 02:11:06 juju-e4d256-prod-github-runner-207 kernel: [74840.590975] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:11:06 juju-e4d256-prod-github-runner-207 kernel: [74840.592001] direct_page_fault+0x206/0x310 [kvm] Aug 23 02:11:06 juju-e4d256-prod-github-runner-207 kernel: [74840.593025] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 02:11:06 juju-e4d256-prod-github-runner-207 kernel: [74840.594031] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 02:11:06 juju-e4d256-prod-github-runner-207 kernel: [74840.595028] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 02:11:06 juju-e4d256-prod-github-runner-207 kernel: [74840.596016] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 02:11:06 juju-e4d256-prod-github-runner-207 kernel: [74840.596963] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 02:11:06 juju-e4d256-prod-github-runner-207 kernel: [74840.597941] handle_exit+0x98/0x230 [kvm_amd] Aug 23 02:11:06 juju-e4d256-prod-github-runner-207 kernel: [74840.598829] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 02:11:06 juju-e4d256-prod-github-runner-207 kernel: [74840.599755] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 02:11:06 juju-e4d256-prod-github-runner-207 kernel: [74840.600676] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 02:11:06 juju-e4d256-prod-github-runner-207 kernel: [74840.601576] vcpu_run+0x62/0x2c0 [kvm] Aug 23 02:11:06 juju-e4d256-prod-github-runner-207 kernel: [74840.602382] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 02:11:06 juju-e4d256-prod-github-runner-207 kernel: [74840.603185] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 02:11:06 juju-e4d256-prod-github-runner-207 kernel: [74840.604047] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 02:11:06 juju-e4d256-prod-github-runner-207 kernel: [74840.604840] ? __seccomp_filter+0x4a/0x4a0 Aug 23 02:11:06 juju-e4d256-prod-github-runner-207 kernel: [74840.605576] ? __fget_files+0x86/0xc0 Aug 23 02:11:06 juju-e4d256-prod-github-runner-207 kernel: [74840.606283] __x64_sys_ioctl+0x95/0xd0 Aug 23 02:11:06 juju-e4d256-prod-github-runner-207 kernel: [74840.606979] do_syscall_64+0x5c/0xc0 Aug 23 02:11:06 juju-e4d256-prod-github-runner-207 kernel: [74840.607651] ? do_futex+0x162/0x1f0 Aug 23 02:11:06 juju-e4d256-prod-github-runner-207 kernel: [74840.608297] ? __x64_sys_futex+0x78/0x1e0 Aug 23 02:11:06 juju-e4d256-prod-github-runner-207 kernel: [74840.608973] ? __secure_computing+0xa9/0x120 Aug 23 02:11:06 juju-e4d256-prod-github-runner-207 kernel: [74840.609659] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 02:11:06 juju-e4d256-prod-github-runner-207 kernel: [74840.610420] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:11:06 juju-e4d256-prod-github-runner-207 kernel: [74840.611142] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:11:06 juju-e4d256-prod-github-runner-207 kernel: [74840.611882] ? do_syscall_64+0x69/0xc0 Aug 23 02:11:06 juju-e4d256-prod-github-runner-207 kernel: [74840.612522] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:11:06 juju-e4d256-prod-github-runner-207 kernel: [74840.613226] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:11:06 juju-e4d256-prod-github-runner-207 kernel: [74840.613916] ? do_syscall_64+0x69/0xc0 Aug 23 02:11:06 juju-e4d256-prod-github-runner-207 kernel: [74840.614537] ? do_syscall_64+0x69/0xc0 Aug 23 02:11:06 juju-e4d256-prod-github-runner-207 kernel: [74840.615160] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 02:11:06 juju-e4d256-prod-github-runner-207 kernel: [74840.615887] RIP: 0033:0x7faa5d0edaff Aug 23 02:11:06 juju-e4d256-prod-github-runner-207 kernel: [74840.616527] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 02:11:06 juju-e4d256-prod-github-runner-207 kernel: [74840.618508] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 02:11:06 juju-e4d256-prod-github-runner-207 kernel: [74840.619426] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 02:11:06 juju-e4d256-prod-github-runner-207 kernel: [74840.620312] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 02:11:06 juju-e4d256-prod-github-runner-207 kernel: [74840.621203] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 02:11:06 juju-e4d256-prod-github-runner-207 kernel: [74840.622086] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 02:11:06 juju-e4d256-prod-github-runner-207 kernel: [74840.622970] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 02:11:06 juju-e4d256-prod-github-runner-207 kernel: [74840.623869] Aug 23 02:11:34 juju-e4d256-prod-github-runner-207 kernel: [74868.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 69618s! [qemu-system-x86:6715] Aug 23 02:11:34 juju-e4d256-prod-github-runner-207 kernel: [74868.543139] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 02:11:34 juju-e4d256-prod-github-runner-207 kernel: [74868.543207] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 02:11:34 juju-e4d256-prod-github-runner-207 kernel: [74868.555278] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 02:11:34 juju-e4d256-prod-github-runner-207 kernel: [74868.556554] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 02:11:34 juju-e4d256-prod-github-runner-207 kernel: [74868.557775] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:11:34 juju-e4d256-prod-github-runner-207 kernel: [74868.558831] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 02:11:34 juju-e4d256-prod-github-runner-207 kernel: [74868.561387] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 02:11:34 juju-e4d256-prod-github-runner-207 kernel: [74868.562426] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 02:11:34 juju-e4d256-prod-github-runner-207 kernel: [74868.563609] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 02:11:34 juju-e4d256-prod-github-runner-207 kernel: [74868.564767] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 02:11:34 juju-e4d256-prod-github-runner-207 kernel: [74868.565924] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 02:11:34 juju-e4d256-prod-github-runner-207 kernel: [74868.567103] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 02:11:34 juju-e4d256-prod-github-runner-207 kernel: [74868.568272] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 02:11:34 juju-e4d256-prod-github-runner-207 kernel: [74868.569503] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 02:11:34 juju-e4d256-prod-github-runner-207 kernel: [74868.570598] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 02:11:34 juju-e4d256-prod-github-runner-207 kernel: [74868.571805] Call Trace: Aug 23 02:11:34 juju-e4d256-prod-github-runner-207 kernel: [74868.572722] Aug 23 02:11:34 juju-e4d256-prod-github-runner-207 kernel: [74868.573605] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:11:34 juju-e4d256-prod-github-runner-207 kernel: [74868.574634] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:11:34 juju-e4d256-prod-github-runner-207 kernel: [74868.575664] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:11:34 juju-e4d256-prod-github-runner-207 kernel: [74868.576752] ? show_regs.part.0+0x23/0x29 Aug 23 02:11:34 juju-e4d256-prod-github-runner-207 kernel: [74868.577753] ? show_regs.cold+0x8/0xd Aug 23 02:11:34 juju-e4d256-prod-github-runner-207 kernel: [74868.578722] ? watchdog_timer_fn+0x1be/0x220 Aug 23 02:11:34 juju-e4d256-prod-github-runner-207 kernel: [74868.579746] ? lockup_detector_update_enable+0x60/0x60 Aug 23 02:11:34 juju-e4d256-prod-github-runner-207 kernel: [74868.580806] ? __hrtimer_run_queues+0x107/0x230 Aug 23 02:11:34 juju-e4d256-prod-github-runner-207 kernel: [74868.581833] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 02:11:34 juju-e4d256-prod-github-runner-207 kernel: [74868.582859] ? hrtimer_interrupt+0x101/0x220 Aug 23 02:11:34 juju-e4d256-prod-github-runner-207 kernel: [74868.583884] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 02:11:34 juju-e4d256-prod-github-runner-207 kernel: [74868.584951] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 02:11:34 juju-e4d256-prod-github-runner-207 kernel: [74868.585999] Aug 23 02:11:34 juju-e4d256-prod-github-runner-207 kernel: [74868.586853] Aug 23 02:11:34 juju-e4d256-prod-github-runner-207 kernel: [74868.587705] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 02:11:34 juju-e4d256-prod-github-runner-207 kernel: [74868.588737] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:11:34 juju-e4d256-prod-github-runner-207 kernel: [74868.589779] ? _raw_spin_lock+0x22/0x30 Aug 23 02:11:34 juju-e4d256-prod-github-runner-207 kernel: [74868.590722] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:11:34 juju-e4d256-prod-github-runner-207 kernel: [74868.591753] direct_page_fault+0x206/0x310 [kvm] Aug 23 02:11:34 juju-e4d256-prod-github-runner-207 kernel: [74868.592776] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 02:11:34 juju-e4d256-prod-github-runner-207 kernel: [74868.593782] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 02:11:34 juju-e4d256-prod-github-runner-207 kernel: [74868.594780] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 02:11:34 juju-e4d256-prod-github-runner-207 kernel: [74868.595773] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 02:11:34 juju-e4d256-prod-github-runner-207 kernel: [74868.596742] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 02:11:34 juju-e4d256-prod-github-runner-207 kernel: [74868.597740] handle_exit+0x98/0x230 [kvm_amd] Aug 23 02:11:34 juju-e4d256-prod-github-runner-207 kernel: [74868.598634] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 02:11:34 juju-e4d256-prod-github-runner-207 kernel: [74868.599573] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 02:11:34 juju-e4d256-prod-github-runner-207 kernel: [74868.600499] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 02:11:34 juju-e4d256-prod-github-runner-207 kernel: [74868.601407] vcpu_run+0x62/0x2c0 [kvm] Aug 23 02:11:34 juju-e4d256-prod-github-runner-207 kernel: [74868.602217] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 02:11:34 juju-e4d256-prod-github-runner-207 kernel: [74868.603034] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 02:11:34 juju-e4d256-prod-github-runner-207 kernel: [74868.603886] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 02:11:34 juju-e4d256-prod-github-runner-207 kernel: [74868.604688] ? __seccomp_filter+0x4a/0x4a0 Aug 23 02:11:34 juju-e4d256-prod-github-runner-207 kernel: [74868.605429] ? __fget_files+0x86/0xc0 Aug 23 02:11:34 juju-e4d256-prod-github-runner-207 kernel: [74868.606135] __x64_sys_ioctl+0x95/0xd0 Aug 23 02:11:34 juju-e4d256-prod-github-runner-207 kernel: [74868.606832] do_syscall_64+0x5c/0xc0 Aug 23 02:11:34 juju-e4d256-prod-github-runner-207 kernel: [74868.607515] ? do_futex+0x162/0x1f0 Aug 23 02:11:34 juju-e4d256-prod-github-runner-207 kernel: [74868.608162] ? __x64_sys_futex+0x78/0x1e0 Aug 23 02:11:34 juju-e4d256-prod-github-runner-207 kernel: [74868.608836] ? __secure_computing+0xa9/0x120 Aug 23 02:11:34 juju-e4d256-prod-github-runner-207 kernel: [74868.609523] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 02:11:34 juju-e4d256-prod-github-runner-207 kernel: [74868.610282] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:11:34 juju-e4d256-prod-github-runner-207 kernel: [74868.611037] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:11:34 juju-e4d256-prod-github-runner-207 kernel: [74868.611758] ? do_syscall_64+0x69/0xc0 Aug 23 02:11:34 juju-e4d256-prod-github-runner-207 kernel: [74868.612404] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:11:34 juju-e4d256-prod-github-runner-207 kernel: [74868.613107] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:11:34 juju-e4d256-prod-github-runner-207 kernel: [74868.613801] ? do_syscall_64+0x69/0xc0 Aug 23 02:11:34 juju-e4d256-prod-github-runner-207 kernel: [74868.614424] ? do_syscall_64+0x69/0xc0 Aug 23 02:11:34 juju-e4d256-prod-github-runner-207 kernel: [74868.615056] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 02:11:34 juju-e4d256-prod-github-runner-207 kernel: [74868.615760] RIP: 0033:0x7faa5d0edaff Aug 23 02:11:34 juju-e4d256-prod-github-runner-207 kernel: [74868.616388] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 02:11:34 juju-e4d256-prod-github-runner-207 kernel: [74868.618397] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 02:11:34 juju-e4d256-prod-github-runner-207 kernel: [74868.619326] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 02:11:34 juju-e4d256-prod-github-runner-207 kernel: [74868.620214] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 02:11:34 juju-e4d256-prod-github-runner-207 kernel: [74868.621112] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 02:11:34 juju-e4d256-prod-github-runner-207 kernel: [74868.622002] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 02:11:34 juju-e4d256-prod-github-runner-207 kernel: [74868.622892] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 02:11:34 juju-e4d256-prod-github-runner-207 kernel: [74868.623802] Aug 23 02:11:48 juju-e4d256-prod-github-runner-207 kernel: [74882.180707] rcu: INFO: rcu_sched self-detected stall on CPU Aug 23 02:11:48 juju-e4d256-prod-github-runner-207 kernel: [74882.181687] rcu: 1-....: (18632496 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=9005218 Aug 23 02:11:48 juju-e4d256-prod-github-runner-207 kernel: [74882.182867] (t=18691245 jiffies g=23269 q=63401) Aug 23 02:11:48 juju-e4d256-prod-github-runner-207 kernel: [74882.183713] NMI backtrace for cpu 1 Aug 23 02:11:48 juju-e4d256-prod-github-runner-207 kernel: [74882.184458] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 02:11:48 juju-e4d256-prod-github-runner-207 kernel: [74882.185646] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 02:11:48 juju-e4d256-prod-github-runner-207 kernel: [74882.186748] Call Trace: Aug 23 02:11:48 juju-e4d256-prod-github-runner-207 kernel: [74882.187453] Aug 23 02:11:48 juju-e4d256-prod-github-runner-207 kernel: [74882.188104] show_stack+0x52/0x5c Aug 23 02:11:48 juju-e4d256-prod-github-runner-207 kernel: [74882.188853] dump_stack_lvl+0x4a/0x63 Aug 23 02:11:48 juju-e4d256-prod-github-runner-207 kernel: [74882.189658] dump_stack+0x10/0x16 Aug 23 02:11:48 juju-e4d256-prod-github-runner-207 kernel: [74882.190405] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 23 02:11:48 juju-e4d256-prod-github-runner-207 kernel: [74882.191265] ? lapic_can_unplug_cpu+0x90/0x90 Aug 23 02:11:48 juju-e4d256-prod-github-runner-207 kernel: [74882.192080] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 23 02:11:48 juju-e4d256-prod-github-runner-207 kernel: [74882.192958] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 23 02:11:48 juju-e4d256-prod-github-runner-207 kernel: [74882.193808] trigger_single_cpu_backtrace+0x44/0x4f Aug 23 02:11:48 juju-e4d256-prod-github-runner-207 kernel: [74882.194647] rcu_dump_cpu_stacks+0x102/0x149 Aug 23 02:11:48 juju-e4d256-prod-github-runner-207 kernel: [74882.195476] print_cpu_stall.cold+0x2f/0xe2 Aug 23 02:11:48 juju-e4d256-prod-github-runner-207 kernel: [74882.196293] ? timekeeping_update+0xf7/0x150 Aug 23 02:11:48 juju-e4d256-prod-github-runner-207 kernel: [74882.197100] check_cpu_stall+0x109/0x270 Aug 23 02:11:48 juju-e4d256-prod-github-runner-207 kernel: [74882.197869] rcu_sched_clock_irq+0x9a/0x250 Aug 23 02:11:48 juju-e4d256-prod-github-runner-207 kernel: [74882.198642] update_process_times+0x94/0xd0 Aug 23 02:11:48 juju-e4d256-prod-github-runner-207 kernel: [74882.199446] tick_sched_handle+0x29/0x70 Aug 23 02:11:48 juju-e4d256-prod-github-runner-207 kernel: [74882.200210] tick_sched_timer+0x8c/0xc0 Aug 23 02:11:48 juju-e4d256-prod-github-runner-207 kernel: [74882.200974] ? tick_nohz_handler+0xb0/0xb0 Aug 23 02:11:48 juju-e4d256-prod-github-runner-207 kernel: [74882.201744] __hrtimer_run_queues+0x107/0x230 Aug 23 02:11:48 juju-e4d256-prod-github-runner-207 kernel: [74882.202582] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 02:11:48 juju-e4d256-prod-github-runner-207 kernel: [74882.203447] hrtimer_interrupt+0x101/0x220 Aug 23 02:11:48 juju-e4d256-prod-github-runner-207 kernel: [74882.204220] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 02:11:48 juju-e4d256-prod-github-runner-207 kernel: [74882.205069] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 02:11:48 juju-e4d256-prod-github-runner-207 kernel: [74882.205923] Aug 23 02:11:48 juju-e4d256-prod-github-runner-207 kernel: [74882.206605] Aug 23 02:11:48 juju-e4d256-prod-github-runner-207 kernel: [74882.207261] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 02:11:48 juju-e4d256-prod-github-runner-207 kernel: [74882.208099] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:11:48 juju-e4d256-prod-github-runner-207 kernel: [74882.209005] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 02:11:48 juju-e4d256-prod-github-runner-207 kernel: [74882.211418] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 02:11:48 juju-e4d256-prod-github-runner-207 kernel: [74882.212321] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 02:11:48 juju-e4d256-prod-github-runner-207 kernel: [74882.213365] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 02:11:48 juju-e4d256-prod-github-runner-207 kernel: [74882.214395] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 02:11:48 juju-e4d256-prod-github-runner-207 kernel: [74882.215441] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 02:11:48 juju-e4d256-prod-github-runner-207 kernel: [74882.216473] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 02:11:48 juju-e4d256-prod-github-runner-207 kernel: [74882.217484] ? _raw_spin_lock+0x22/0x30 Aug 23 02:11:48 juju-e4d256-prod-github-runner-207 kernel: [74882.218257] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:11:48 juju-e4d256-prod-github-runner-207 kernel: [74882.219132] direct_page_fault+0x206/0x310 [kvm] Aug 23 02:11:48 juju-e4d256-prod-github-runner-207 kernel: [74882.219995] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 02:11:48 juju-e4d256-prod-github-runner-207 kernel: [74882.220851] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 02:11:48 juju-e4d256-prod-github-runner-207 kernel: [74882.221699] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 02:11:48 juju-e4d256-prod-github-runner-207 kernel: [74882.222526] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 02:11:48 juju-e4d256-prod-github-runner-207 kernel: [74882.223351] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 02:11:48 juju-e4d256-prod-github-runner-207 kernel: [74882.224192] handle_exit+0x98/0x230 [kvm_amd] Aug 23 02:11:48 juju-e4d256-prod-github-runner-207 kernel: [74882.224977] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 02:11:48 juju-e4d256-prod-github-runner-207 kernel: [74882.225792] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 02:11:48 juju-e4d256-prod-github-runner-207 kernel: [74882.226625] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 02:11:48 juju-e4d256-prod-github-runner-207 kernel: [74882.227464] vcpu_run+0x62/0x2c0 [kvm] Aug 23 02:11:48 juju-e4d256-prod-github-runner-207 kernel: [74882.228193] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 02:11:48 juju-e4d256-prod-github-runner-207 kernel: [74882.228947] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 02:11:48 juju-e4d256-prod-github-runner-207 kernel: [74882.229765] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 02:11:48 juju-e4d256-prod-github-runner-207 kernel: [74882.230536] ? __seccomp_filter+0x4a/0x4a0 Aug 23 02:11:48 juju-e4d256-prod-github-runner-207 kernel: [74882.231285] ? __fget_files+0x86/0xc0 Aug 23 02:11:48 juju-e4d256-prod-github-runner-207 kernel: [74882.231984] __x64_sys_ioctl+0x95/0xd0 Aug 23 02:11:48 juju-e4d256-prod-github-runner-207 kernel: [74882.232766] do_syscall_64+0x5c/0xc0 Aug 23 02:11:48 juju-e4d256-prod-github-runner-207 kernel: [74882.233462] ? do_futex+0x162/0x1f0 Aug 23 02:11:48 juju-e4d256-prod-github-runner-207 kernel: [74882.234142] ? __x64_sys_futex+0x78/0x1e0 Aug 23 02:11:48 juju-e4d256-prod-github-runner-207 kernel: [74882.234865] ? __secure_computing+0xa9/0x120 Aug 23 02:11:48 juju-e4d256-prod-github-runner-207 kernel: [74882.235595] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 02:11:48 juju-e4d256-prod-github-runner-207 kernel: [74882.236438] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:11:48 juju-e4d256-prod-github-runner-207 kernel: [74882.237234] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:11:48 juju-e4d256-prod-github-runner-207 kernel: [74882.237999] ? do_syscall_64+0x69/0xc0 Aug 23 02:11:48 juju-e4d256-prod-github-runner-207 kernel: [74882.238693] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:11:48 juju-e4d256-prod-github-runner-207 kernel: [74882.239465] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:11:48 juju-e4d256-prod-github-runner-207 kernel: [74882.240222] ? do_syscall_64+0x69/0xc0 Aug 23 02:11:48 juju-e4d256-prod-github-runner-207 kernel: [74882.240948] ? do_syscall_64+0x69/0xc0 Aug 23 02:11:48 juju-e4d256-prod-github-runner-207 kernel: [74882.241683] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 02:11:48 juju-e4d256-prod-github-runner-207 kernel: [74882.242485] RIP: 0033:0x7faa5d0edaff Aug 23 02:11:48 juju-e4d256-prod-github-runner-207 kernel: [74882.243432] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 02:11:48 juju-e4d256-prod-github-runner-207 kernel: [74882.245594] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 02:11:48 juju-e4d256-prod-github-runner-207 kernel: [74882.246596] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 02:11:48 juju-e4d256-prod-github-runner-207 kernel: [74882.247599] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 02:11:48 juju-e4d256-prod-github-runner-207 kernel: [74882.248561] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 02:11:48 juju-e4d256-prod-github-runner-207 kernel: [74882.249514] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 02:11:48 juju-e4d256-prod-github-runner-207 kernel: [74882.250452] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 02:11:48 juju-e4d256-prod-github-runner-207 kernel: [74882.251395] Aug 23 02:12:14 juju-e4d256-prod-github-runner-207 kernel: [74908.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 69656s! [qemu-system-x86:6715] Aug 23 02:12:14 juju-e4d256-prod-github-runner-207 kernel: [74908.543818] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 02:12:14 juju-e4d256-prod-github-runner-207 kernel: [74908.544069] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 02:12:14 juju-e4d256-prod-github-runner-207 kernel: [74908.556188] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 02:12:14 juju-e4d256-prod-github-runner-207 kernel: [74908.557451] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 02:12:14 juju-e4d256-prod-github-runner-207 kernel: [74908.558686] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:12:14 juju-e4d256-prod-github-runner-207 kernel: [74908.559745] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 02:12:14 juju-e4d256-prod-github-runner-207 kernel: [74908.562288] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 02:12:14 juju-e4d256-prod-github-runner-207 kernel: [74908.563345] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 02:12:14 juju-e4d256-prod-github-runner-207 kernel: [74908.564506] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 02:12:14 juju-e4d256-prod-github-runner-207 kernel: [74908.565666] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 02:12:14 juju-e4d256-prod-github-runner-207 kernel: [74908.566834] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 02:12:14 juju-e4d256-prod-github-runner-207 kernel: [74908.567995] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 02:12:14 juju-e4d256-prod-github-runner-207 kernel: [74908.569163] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 02:12:14 juju-e4d256-prod-github-runner-207 kernel: [74908.570393] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 02:12:14 juju-e4d256-prod-github-runner-207 kernel: [74908.571500] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 02:12:14 juju-e4d256-prod-github-runner-207 kernel: [74908.572698] Call Trace: Aug 23 02:12:14 juju-e4d256-prod-github-runner-207 kernel: [74908.573610] Aug 23 02:12:14 juju-e4d256-prod-github-runner-207 kernel: [74908.574508] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:12:14 juju-e4d256-prod-github-runner-207 kernel: [74908.575537] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:12:14 juju-e4d256-prod-github-runner-207 kernel: [74908.576556] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:12:14 juju-e4d256-prod-github-runner-207 kernel: [74908.577642] ? show_regs.part.0+0x23/0x29 Aug 23 02:12:14 juju-e4d256-prod-github-runner-207 kernel: [74908.578644] ? show_regs.cold+0x8/0xd Aug 23 02:12:14 juju-e4d256-prod-github-runner-207 kernel: [74908.579617] ? watchdog_timer_fn+0x1be/0x220 Aug 23 02:12:14 juju-e4d256-prod-github-runner-207 kernel: [74908.580624] ? lockup_detector_update_enable+0x60/0x60 Aug 23 02:12:14 juju-e4d256-prod-github-runner-207 kernel: [74908.581693] ? __hrtimer_run_queues+0x107/0x230 Aug 23 02:12:14 juju-e4d256-prod-github-runner-207 kernel: [74908.582727] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 02:12:14 juju-e4d256-prod-github-runner-207 kernel: [74908.583751] ? hrtimer_interrupt+0x101/0x220 Aug 23 02:12:14 juju-e4d256-prod-github-runner-207 kernel: [74908.584763] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 02:12:14 juju-e4d256-prod-github-runner-207 kernel: [74908.585833] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 02:12:14 juju-e4d256-prod-github-runner-207 kernel: [74908.586886] Aug 23 02:12:14 juju-e4d256-prod-github-runner-207 kernel: [74908.587739] Aug 23 02:12:14 juju-e4d256-prod-github-runner-207 kernel: [74908.588579] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 02:12:14 juju-e4d256-prod-github-runner-207 kernel: [74908.589619] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:12:14 juju-e4d256-prod-github-runner-207 kernel: [74908.590668] ? _raw_spin_lock+0x22/0x30 Aug 23 02:12:14 juju-e4d256-prod-github-runner-207 kernel: [74908.591619] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:12:14 juju-e4d256-prod-github-runner-207 kernel: [74908.592631] direct_page_fault+0x206/0x310 [kvm] Aug 23 02:12:14 juju-e4d256-prod-github-runner-207 kernel: [74908.593654] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 02:12:14 juju-e4d256-prod-github-runner-207 kernel: [74908.594676] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 02:12:14 juju-e4d256-prod-github-runner-207 kernel: [74908.595677] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 02:12:14 juju-e4d256-prod-github-runner-207 kernel: [74908.596662] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 02:12:14 juju-e4d256-prod-github-runner-207 kernel: [74908.597611] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 02:12:14 juju-e4d256-prod-github-runner-207 kernel: [74908.598678] handle_exit+0x98/0x230 [kvm_amd] Aug 23 02:12:14 juju-e4d256-prod-github-runner-207 kernel: [74908.599569] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 02:12:14 juju-e4d256-prod-github-runner-207 kernel: [74908.600487] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 02:12:14 juju-e4d256-prod-github-runner-207 kernel: [74908.601418] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 02:12:14 juju-e4d256-prod-github-runner-207 kernel: [74908.602320] vcpu_run+0x62/0x2c0 [kvm] Aug 23 02:12:14 juju-e4d256-prod-github-runner-207 kernel: [74908.603145] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 02:12:14 juju-e4d256-prod-github-runner-207 kernel: [74908.603955] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 02:12:14 juju-e4d256-prod-github-runner-207 kernel: [74908.604811] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 02:12:14 juju-e4d256-prod-github-runner-207 kernel: [74908.605607] ? __seccomp_filter+0x4a/0x4a0 Aug 23 02:12:14 juju-e4d256-prod-github-runner-207 kernel: [74908.606350] ? __fget_files+0x86/0xc0 Aug 23 02:12:14 juju-e4d256-prod-github-runner-207 kernel: [74908.607066] __x64_sys_ioctl+0x95/0xd0 Aug 23 02:12:14 juju-e4d256-prod-github-runner-207 kernel: [74908.607757] do_syscall_64+0x5c/0xc0 Aug 23 02:12:14 juju-e4d256-prod-github-runner-207 kernel: [74908.608418] ? do_futex+0x162/0x1f0 Aug 23 02:12:14 juju-e4d256-prod-github-runner-207 kernel: [74908.609063] ? __x64_sys_futex+0x78/0x1e0 Aug 23 02:12:14 juju-e4d256-prod-github-runner-207 kernel: [74908.609735] ? __secure_computing+0xa9/0x120 Aug 23 02:12:14 juju-e4d256-prod-github-runner-207 kernel: [74908.610427] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 02:12:14 juju-e4d256-prod-github-runner-207 kernel: [74908.611192] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:12:14 juju-e4d256-prod-github-runner-207 kernel: [74908.611911] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:12:14 juju-e4d256-prod-github-runner-207 kernel: [74908.612625] ? do_syscall_64+0x69/0xc0 Aug 23 02:12:14 juju-e4d256-prod-github-runner-207 kernel: [74908.613269] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:12:14 juju-e4d256-prod-github-runner-207 kernel: [74908.613976] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:12:14 juju-e4d256-prod-github-runner-207 kernel: [74908.614684] ? do_syscall_64+0x69/0xc0 Aug 23 02:12:14 juju-e4d256-prod-github-runner-207 kernel: [74908.615308] ? do_syscall_64+0x69/0xc0 Aug 23 02:12:14 juju-e4d256-prod-github-runner-207 kernel: [74908.615934] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 02:12:14 juju-e4d256-prod-github-runner-207 kernel: [74908.616643] RIP: 0033:0x7faa5d0edaff Aug 23 02:12:14 juju-e4d256-prod-github-runner-207 kernel: [74908.617279] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 02:12:14 juju-e4d256-prod-github-runner-207 kernel: [74908.619278] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 02:12:14 juju-e4d256-prod-github-runner-207 kernel: [74908.620194] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 02:12:14 juju-e4d256-prod-github-runner-207 kernel: [74908.621080] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 02:12:14 juju-e4d256-prod-github-runner-207 kernel: [74908.621967] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 02:12:14 juju-e4d256-prod-github-runner-207 kernel: [74908.622863] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 02:12:14 juju-e4d256-prod-github-runner-207 kernel: [74908.623754] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 02:12:14 juju-e4d256-prod-github-runner-207 kernel: [74908.624643] Aug 23 02:12:42 juju-e4d256-prod-github-runner-207 kernel: [74936.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 69682s! [qemu-system-x86:6715] Aug 23 02:12:42 juju-e4d256-prod-github-runner-207 kernel: [74936.543105] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 02:12:42 juju-e4d256-prod-github-runner-207 kernel: [74936.543172] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 02:12:42 juju-e4d256-prod-github-runner-207 kernel: [74936.555256] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 02:12:42 juju-e4d256-prod-github-runner-207 kernel: [74936.556524] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 02:12:42 juju-e4d256-prod-github-runner-207 kernel: [74936.557766] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:12:42 juju-e4d256-prod-github-runner-207 kernel: [74936.558842] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 02:12:42 juju-e4d256-prod-github-runner-207 kernel: [74936.561395] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 02:12:42 juju-e4d256-prod-github-runner-207 kernel: [74936.562457] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 02:12:42 juju-e4d256-prod-github-runner-207 kernel: [74936.563624] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 02:12:42 juju-e4d256-prod-github-runner-207 kernel: [74936.564789] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 02:12:42 juju-e4d256-prod-github-runner-207 kernel: [74936.565951] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 02:12:42 juju-e4d256-prod-github-runner-207 kernel: [74936.567147] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 02:12:42 juju-e4d256-prod-github-runner-207 kernel: [74936.568316] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 02:12:42 juju-e4d256-prod-github-runner-207 kernel: [74936.569554] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 02:12:42 juju-e4d256-prod-github-runner-207 kernel: [74936.570670] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 02:12:42 juju-e4d256-prod-github-runner-207 kernel: [74936.571863] Call Trace: Aug 23 02:12:42 juju-e4d256-prod-github-runner-207 kernel: [74936.572775] Aug 23 02:12:42 juju-e4d256-prod-github-runner-207 kernel: [74936.573664] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:12:42 juju-e4d256-prod-github-runner-207 kernel: [74936.574704] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:12:42 juju-e4d256-prod-github-runner-207 kernel: [74936.575725] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:12:42 juju-e4d256-prod-github-runner-207 kernel: [74936.576804] ? show_regs.part.0+0x23/0x29 Aug 23 02:12:42 juju-e4d256-prod-github-runner-207 kernel: [74936.577811] ? show_regs.cold+0x8/0xd Aug 23 02:12:42 juju-e4d256-prod-github-runner-207 kernel: [74936.578801] ? watchdog_timer_fn+0x1be/0x220 Aug 23 02:12:42 juju-e4d256-prod-github-runner-207 kernel: [74936.579809] ? lockup_detector_update_enable+0x60/0x60 Aug 23 02:12:42 juju-e4d256-prod-github-runner-207 kernel: [74936.580870] ? __hrtimer_run_queues+0x107/0x230 Aug 23 02:12:42 juju-e4d256-prod-github-runner-207 kernel: [74936.581897] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 02:12:42 juju-e4d256-prod-github-runner-207 kernel: [74936.582939] ? hrtimer_interrupt+0x101/0x220 Aug 23 02:12:42 juju-e4d256-prod-github-runner-207 kernel: [74936.583952] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 02:12:42 juju-e4d256-prod-github-runner-207 kernel: [74936.585017] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 02:12:42 juju-e4d256-prod-github-runner-207 kernel: [74936.586066] Aug 23 02:12:42 juju-e4d256-prod-github-runner-207 kernel: [74936.586930] Aug 23 02:12:42 juju-e4d256-prod-github-runner-207 kernel: [74936.587778] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 02:12:42 juju-e4d256-prod-github-runner-207 kernel: [74936.588816] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:12:42 juju-e4d256-prod-github-runner-207 kernel: [74936.589855] ? _raw_spin_lock+0x22/0x30 Aug 23 02:12:42 juju-e4d256-prod-github-runner-207 kernel: [74936.590817] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:12:42 juju-e4d256-prod-github-runner-207 kernel: [74936.591833] direct_page_fault+0x206/0x310 [kvm] Aug 23 02:12:42 juju-e4d256-prod-github-runner-207 kernel: [74936.592856] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 02:12:42 juju-e4d256-prod-github-runner-207 kernel: [74936.593865] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 02:12:42 juju-e4d256-prod-github-runner-207 kernel: [74936.594875] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 02:12:42 juju-e4d256-prod-github-runner-207 kernel: [74936.595849] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 02:12:42 juju-e4d256-prod-github-runner-207 kernel: [74936.596793] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 02:12:42 juju-e4d256-prod-github-runner-207 kernel: [74936.597783] handle_exit+0x98/0x230 [kvm_amd] Aug 23 02:12:42 juju-e4d256-prod-github-runner-207 kernel: [74936.598690] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 02:12:42 juju-e4d256-prod-github-runner-207 kernel: [74936.599603] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 02:12:42 juju-e4d256-prod-github-runner-207 kernel: [74936.600526] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 02:12:42 juju-e4d256-prod-github-runner-207 kernel: [74936.601429] vcpu_run+0x62/0x2c0 [kvm] Aug 23 02:12:42 juju-e4d256-prod-github-runner-207 kernel: [74936.602253] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 02:12:42 juju-e4d256-prod-github-runner-207 kernel: [74936.603062] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 02:12:42 juju-e4d256-prod-github-runner-207 kernel: [74936.603921] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 02:12:42 juju-e4d256-prod-github-runner-207 kernel: [74936.604717] ? __seccomp_filter+0x4a/0x4a0 Aug 23 02:12:42 juju-e4d256-prod-github-runner-207 kernel: [74936.605459] ? __fget_files+0x86/0xc0 Aug 23 02:12:42 juju-e4d256-prod-github-runner-207 kernel: [74936.606180] __x64_sys_ioctl+0x95/0xd0 Aug 23 02:12:42 juju-e4d256-prod-github-runner-207 kernel: [74936.606872] do_syscall_64+0x5c/0xc0 Aug 23 02:12:42 juju-e4d256-prod-github-runner-207 kernel: [74936.607546] ? do_futex+0x162/0x1f0 Aug 23 02:12:42 juju-e4d256-prod-github-runner-207 kernel: [74936.608205] ? __x64_sys_futex+0x78/0x1e0 Aug 23 02:12:42 juju-e4d256-prod-github-runner-207 kernel: [74936.608885] ? __secure_computing+0xa9/0x120 Aug 23 02:12:42 juju-e4d256-prod-github-runner-207 kernel: [74936.609575] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 02:12:42 juju-e4d256-prod-github-runner-207 kernel: [74936.610350] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:12:42 juju-e4d256-prod-github-runner-207 kernel: [74936.611079] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:12:42 juju-e4d256-prod-github-runner-207 kernel: [74936.611795] ? do_syscall_64+0x69/0xc0 Aug 23 02:12:42 juju-e4d256-prod-github-runner-207 kernel: [74936.612440] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:12:42 juju-e4d256-prod-github-runner-207 kernel: [74936.613150] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:12:42 juju-e4d256-prod-github-runner-207 kernel: [74936.613848] ? do_syscall_64+0x69/0xc0 Aug 23 02:12:42 juju-e4d256-prod-github-runner-207 kernel: [74936.614483] ? do_syscall_64+0x69/0xc0 Aug 23 02:12:42 juju-e4d256-prod-github-runner-207 kernel: [74936.615110] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 02:12:42 juju-e4d256-prod-github-runner-207 kernel: [74936.615932] RIP: 0033:0x7faa5d0edaff Aug 23 02:12:42 juju-e4d256-prod-github-runner-207 kernel: [74936.616575] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 02:12:42 juju-e4d256-prod-github-runner-207 kernel: [74936.618605] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 02:12:42 juju-e4d256-prod-github-runner-207 kernel: [74936.619513] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 02:12:42 juju-e4d256-prod-github-runner-207 kernel: [74936.620403] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 02:12:42 juju-e4d256-prod-github-runner-207 kernel: [74936.621294] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 02:12:42 juju-e4d256-prod-github-runner-207 kernel: [74936.622191] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 02:12:42 juju-e4d256-prod-github-runner-207 kernel: [74936.623083] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 02:12:42 juju-e4d256-prod-github-runner-207 kernel: [74936.623971] Aug 23 02:13:10 juju-e4d256-prod-github-runner-207 kernel: [74964.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 69708s! [qemu-system-x86:6715] Aug 23 02:13:10 juju-e4d256-prod-github-runner-207 kernel: [74964.543092] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 02:13:10 juju-e4d256-prod-github-runner-207 kernel: [74964.543161] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 02:13:10 juju-e4d256-prod-github-runner-207 kernel: [74964.555220] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 02:13:10 juju-e4d256-prod-github-runner-207 kernel: [74964.556503] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 02:13:10 juju-e4d256-prod-github-runner-207 kernel: [74964.557753] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:13:10 juju-e4d256-prod-github-runner-207 kernel: [74964.558828] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 02:13:10 juju-e4d256-prod-github-runner-207 kernel: [74964.561383] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 02:13:10 juju-e4d256-prod-github-runner-207 kernel: [74964.562441] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 02:13:10 juju-e4d256-prod-github-runner-207 kernel: [74964.563602] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 02:13:10 juju-e4d256-prod-github-runner-207 kernel: [74964.564766] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 02:13:10 juju-e4d256-prod-github-runner-207 kernel: [74964.565941] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 02:13:10 juju-e4d256-prod-github-runner-207 kernel: [74964.567101] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 02:13:10 juju-e4d256-prod-github-runner-207 kernel: [74964.568268] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 02:13:10 juju-e4d256-prod-github-runner-207 kernel: [74964.569511] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 02:13:10 juju-e4d256-prod-github-runner-207 kernel: [74964.570631] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 02:13:10 juju-e4d256-prod-github-runner-207 kernel: [74964.571821] Call Trace: Aug 23 02:13:10 juju-e4d256-prod-github-runner-207 kernel: [74964.572731] Aug 23 02:13:10 juju-e4d256-prod-github-runner-207 kernel: [74964.573615] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:13:10 juju-e4d256-prod-github-runner-207 kernel: [74964.574657] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:13:10 juju-e4d256-prod-github-runner-207 kernel: [74964.575735] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:13:10 juju-e4d256-prod-github-runner-207 kernel: [74964.576991] ? show_regs.part.0+0x23/0x29 Aug 23 02:13:10 juju-e4d256-prod-github-runner-207 kernel: [74964.578288] ? show_regs.cold+0x8/0xd Aug 23 02:13:10 juju-e4d256-prod-github-runner-207 kernel: [74964.579259] ? watchdog_timer_fn+0x1be/0x220 Aug 23 02:13:10 juju-e4d256-prod-github-runner-207 kernel: [74964.580287] ? lockup_detector_update_enable+0x60/0x60 Aug 23 02:13:10 juju-e4d256-prod-github-runner-207 kernel: [74964.581349] ? __hrtimer_run_queues+0x107/0x230 Aug 23 02:13:10 juju-e4d256-prod-github-runner-207 kernel: [74964.582387] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 02:13:10 juju-e4d256-prod-github-runner-207 kernel: [74964.583416] ? hrtimer_interrupt+0x101/0x220 Aug 23 02:13:10 juju-e4d256-prod-github-runner-207 kernel: [74964.584429] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 02:13:10 juju-e4d256-prod-github-runner-207 kernel: [74964.585503] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 02:13:10 juju-e4d256-prod-github-runner-207 kernel: [74964.586684] Aug 23 02:13:10 juju-e4d256-prod-github-runner-207 kernel: [74964.587541] Aug 23 02:13:10 juju-e4d256-prod-github-runner-207 kernel: [74964.588383] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 02:13:10 juju-e4d256-prod-github-runner-207 kernel: [74964.589414] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:13:10 juju-e4d256-prod-github-runner-207 kernel: [74964.590532] ? _raw_spin_lock+0x22/0x30 Aug 23 02:13:10 juju-e4d256-prod-github-runner-207 kernel: [74964.591488] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:13:10 juju-e4d256-prod-github-runner-207 kernel: [74964.592508] direct_page_fault+0x206/0x310 [kvm] Aug 23 02:13:10 juju-e4d256-prod-github-runner-207 kernel: [74964.593537] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 02:13:10 juju-e4d256-prod-github-runner-207 kernel: [74964.594603] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 02:13:10 juju-e4d256-prod-github-runner-207 kernel: [74964.595608] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 02:13:10 juju-e4d256-prod-github-runner-207 kernel: [74964.596579] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 02:13:10 juju-e4d256-prod-github-runner-207 kernel: [74964.597526] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 02:13:10 juju-e4d256-prod-github-runner-207 kernel: [74964.598517] handle_exit+0x98/0x230 [kvm_amd] Aug 23 02:13:10 juju-e4d256-prod-github-runner-207 kernel: [74964.599419] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 02:13:10 juju-e4d256-prod-github-runner-207 kernel: [74964.600333] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 02:13:10 juju-e4d256-prod-github-runner-207 kernel: [74964.601261] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 02:13:10 juju-e4d256-prod-github-runner-207 kernel: [74964.602182] vcpu_run+0x62/0x2c0 [kvm] Aug 23 02:13:10 juju-e4d256-prod-github-runner-207 kernel: [74964.602995] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 02:13:10 juju-e4d256-prod-github-runner-207 kernel: [74964.603803] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 02:13:10 juju-e4d256-prod-github-runner-207 kernel: [74964.604656] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 02:13:10 juju-e4d256-prod-github-runner-207 kernel: [74964.605454] ? __seccomp_filter+0x4a/0x4a0 Aug 23 02:13:10 juju-e4d256-prod-github-runner-207 kernel: [74964.606213] ? __fget_files+0x86/0xc0 Aug 23 02:13:10 juju-e4d256-prod-github-runner-207 kernel: [74964.606917] __x64_sys_ioctl+0x95/0xd0 Aug 23 02:13:10 juju-e4d256-prod-github-runner-207 kernel: [74964.607608] do_syscall_64+0x5c/0xc0 Aug 23 02:13:10 juju-e4d256-prod-github-runner-207 kernel: [74964.608271] ? do_futex+0x162/0x1f0 Aug 23 02:13:10 juju-e4d256-prod-github-runner-207 kernel: [74964.608919] ? __x64_sys_futex+0x78/0x1e0 Aug 23 02:13:10 juju-e4d256-prod-github-runner-207 kernel: [74964.609593] ? __secure_computing+0xa9/0x120 Aug 23 02:13:10 juju-e4d256-prod-github-runner-207 kernel: [74964.610303] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 02:13:10 juju-e4d256-prod-github-runner-207 kernel: [74964.611076] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:13:10 juju-e4d256-prod-github-runner-207 kernel: [74964.611798] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:13:10 juju-e4d256-prod-github-runner-207 kernel: [74964.612517] ? do_syscall_64+0x69/0xc0 Aug 23 02:13:10 juju-e4d256-prod-github-runner-207 kernel: [74964.613167] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:13:10 juju-e4d256-prod-github-runner-207 kernel: [74964.613893] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:13:10 juju-e4d256-prod-github-runner-207 kernel: [74964.614589] ? do_syscall_64+0x69/0xc0 Aug 23 02:13:10 juju-e4d256-prod-github-runner-207 kernel: [74964.615215] ? do_syscall_64+0x69/0xc0 Aug 23 02:13:10 juju-e4d256-prod-github-runner-207 kernel: [74964.615838] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 02:13:10 juju-e4d256-prod-github-runner-207 kernel: [74964.616551] RIP: 0033:0x7faa5d0edaff Aug 23 02:13:10 juju-e4d256-prod-github-runner-207 kernel: [74964.617210] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 02:13:10 juju-e4d256-prod-github-runner-207 kernel: [74964.619594] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 02:13:10 juju-e4d256-prod-github-runner-207 kernel: [74964.620667] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 02:13:10 juju-e4d256-prod-github-runner-207 kernel: [74964.621689] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 02:13:10 juju-e4d256-prod-github-runner-207 kernel: [74964.622726] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 02:13:10 juju-e4d256-prod-github-runner-207 kernel: [74964.623747] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 02:13:10 juju-e4d256-prod-github-runner-207 kernel: [74964.624764] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 02:13:10 juju-e4d256-prod-github-runner-207 kernel: [74964.625678] Aug 23 02:13:38 juju-e4d256-prod-github-runner-207 kernel: [74992.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 69734s! [qemu-system-x86:6715] Aug 23 02:13:38 juju-e4d256-prod-github-runner-207 kernel: [74992.543229] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 02:13:38 juju-e4d256-prod-github-runner-207 kernel: [74992.543430] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 02:13:38 juju-e4d256-prod-github-runner-207 kernel: [74992.555535] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 02:13:38 juju-e4d256-prod-github-runner-207 kernel: [74992.556799] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 02:13:38 juju-e4d256-prod-github-runner-207 kernel: [74992.558027] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:13:38 juju-e4d256-prod-github-runner-207 kernel: [74992.559084] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 02:13:38 juju-e4d256-prod-github-runner-207 kernel: [74992.561627] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 02:13:38 juju-e4d256-prod-github-runner-207 kernel: [74992.562671] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 02:13:38 juju-e4d256-prod-github-runner-207 kernel: [74992.563827] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 02:13:38 juju-e4d256-prod-github-runner-207 kernel: [74992.564981] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 02:13:38 juju-e4d256-prod-github-runner-207 kernel: [74992.566149] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 02:13:38 juju-e4d256-prod-github-runner-207 kernel: [74992.567347] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 02:13:38 juju-e4d256-prod-github-runner-207 kernel: [74992.568515] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 02:13:38 juju-e4d256-prod-github-runner-207 kernel: [74992.569751] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 02:13:38 juju-e4d256-prod-github-runner-207 kernel: [74992.570846] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 02:13:38 juju-e4d256-prod-github-runner-207 kernel: [74992.572038] Call Trace: Aug 23 02:13:38 juju-e4d256-prod-github-runner-207 kernel: [74992.572947] Aug 23 02:13:38 juju-e4d256-prod-github-runner-207 kernel: [74992.573838] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:13:38 juju-e4d256-prod-github-runner-207 kernel: [74992.574865] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:13:38 juju-e4d256-prod-github-runner-207 kernel: [74992.575884] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:13:38 juju-e4d256-prod-github-runner-207 kernel: [74992.576972] ? show_regs.part.0+0x23/0x29 Aug 23 02:13:38 juju-e4d256-prod-github-runner-207 kernel: [74992.577976] ? show_regs.cold+0x8/0xd Aug 23 02:13:38 juju-e4d256-prod-github-runner-207 kernel: [74992.578945] ? watchdog_timer_fn+0x1be/0x220 Aug 23 02:13:38 juju-e4d256-prod-github-runner-207 kernel: [74992.580000] ? lockup_detector_update_enable+0x60/0x60 Aug 23 02:13:38 juju-e4d256-prod-github-runner-207 kernel: [74992.581070] ? __hrtimer_run_queues+0x107/0x230 Aug 23 02:13:38 juju-e4d256-prod-github-runner-207 kernel: [74992.582110] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 02:13:38 juju-e4d256-prod-github-runner-207 kernel: [74992.583131] ? hrtimer_interrupt+0x101/0x220 Aug 23 02:13:38 juju-e4d256-prod-github-runner-207 kernel: [74992.584143] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 02:13:38 juju-e4d256-prod-github-runner-207 kernel: [74992.585210] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 02:13:38 juju-e4d256-prod-github-runner-207 kernel: [74992.586258] Aug 23 02:13:38 juju-e4d256-prod-github-runner-207 kernel: [74992.587109] Aug 23 02:13:38 juju-e4d256-prod-github-runner-207 kernel: [74992.587944] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 02:13:38 juju-e4d256-prod-github-runner-207 kernel: [74992.588971] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:13:38 juju-e4d256-prod-github-runner-207 kernel: [74992.590010] ? _raw_spin_lock+0x22/0x30 Aug 23 02:13:38 juju-e4d256-prod-github-runner-207 kernel: [74992.590956] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:13:38 juju-e4d256-prod-github-runner-207 kernel: [74992.591967] direct_page_fault+0x206/0x310 [kvm] Aug 23 02:13:38 juju-e4d256-prod-github-runner-207 kernel: [74992.592988] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 02:13:38 juju-e4d256-prod-github-runner-207 kernel: [74992.594005] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 02:13:38 juju-e4d256-prod-github-runner-207 kernel: [74992.595002] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 02:13:38 juju-e4d256-prod-github-runner-207 kernel: [74992.595983] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 02:13:38 juju-e4d256-prod-github-runner-207 kernel: [74992.596926] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 02:13:38 juju-e4d256-prod-github-runner-207 kernel: [74992.597914] handle_exit+0x98/0x230 [kvm_amd] Aug 23 02:13:38 juju-e4d256-prod-github-runner-207 kernel: [74992.598842] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 02:13:38 juju-e4d256-prod-github-runner-207 kernel: [74992.599751] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 02:13:38 juju-e4d256-prod-github-runner-207 kernel: [74992.600674] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 02:13:38 juju-e4d256-prod-github-runner-207 kernel: [74992.601583] vcpu_run+0x62/0x2c0 [kvm] Aug 23 02:13:38 juju-e4d256-prod-github-runner-207 kernel: [74992.602391] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 02:13:38 juju-e4d256-prod-github-runner-207 kernel: [74992.603195] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 02:13:38 juju-e4d256-prod-github-runner-207 kernel: [74992.604049] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 02:13:38 juju-e4d256-prod-github-runner-207 kernel: [74992.604842] ? __seccomp_filter+0x4a/0x4a0 Aug 23 02:13:38 juju-e4d256-prod-github-runner-207 kernel: [74992.605589] ? __fget_files+0x86/0xc0 Aug 23 02:13:38 juju-e4d256-prod-github-runner-207 kernel: [74992.606299] __x64_sys_ioctl+0x95/0xd0 Aug 23 02:13:38 juju-e4d256-prod-github-runner-207 kernel: [74992.606989] do_syscall_64+0x5c/0xc0 Aug 23 02:13:38 juju-e4d256-prod-github-runner-207 kernel: [74992.607656] ? do_futex+0x162/0x1f0 Aug 23 02:13:38 juju-e4d256-prod-github-runner-207 kernel: [74992.608300] ? __x64_sys_futex+0x78/0x1e0 Aug 23 02:13:38 juju-e4d256-prod-github-runner-207 kernel: [74992.608970] ? __secure_computing+0xa9/0x120 Aug 23 02:13:38 juju-e4d256-prod-github-runner-207 kernel: [74992.609662] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 02:13:38 juju-e4d256-prod-github-runner-207 kernel: [74992.610418] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:13:38 juju-e4d256-prod-github-runner-207 kernel: [74992.611135] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:13:38 juju-e4d256-prod-github-runner-207 kernel: [74992.611850] ? do_syscall_64+0x69/0xc0 Aug 23 02:13:38 juju-e4d256-prod-github-runner-207 kernel: [74992.612495] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:13:38 juju-e4d256-prod-github-runner-207 kernel: [74992.613196] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:13:38 juju-e4d256-prod-github-runner-207 kernel: [74992.613898] ? do_syscall_64+0x69/0xc0 Aug 23 02:13:38 juju-e4d256-prod-github-runner-207 kernel: [74992.614519] ? do_syscall_64+0x69/0xc0 Aug 23 02:13:38 juju-e4d256-prod-github-runner-207 kernel: [74992.615143] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 02:13:38 juju-e4d256-prod-github-runner-207 kernel: [74992.615848] RIP: 0033:0x7faa5d0edaff Aug 23 02:13:38 juju-e4d256-prod-github-runner-207 kernel: [74992.616485] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 02:13:38 juju-e4d256-prod-github-runner-207 kernel: [74992.618473] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 02:13:38 juju-e4d256-prod-github-runner-207 kernel: [74992.619385] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 02:13:38 juju-e4d256-prod-github-runner-207 kernel: [74992.620269] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 02:13:38 juju-e4d256-prod-github-runner-207 kernel: [74992.621152] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 02:13:38 juju-e4d256-prod-github-runner-207 kernel: [74992.622050] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 02:13:38 juju-e4d256-prod-github-runner-207 kernel: [74992.622935] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 02:13:38 juju-e4d256-prod-github-runner-207 kernel: [74992.623822] Aug 23 02:14:06 juju-e4d256-prod-github-runner-207 kernel: [75020.541976] watchdog: BUG: soft lockup - CPU#1 stuck for 69760s! [qemu-system-x86:6715] Aug 23 02:14:06 juju-e4d256-prod-github-runner-207 kernel: [75020.543686] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 02:14:06 juju-e4d256-prod-github-runner-207 kernel: [75020.543853] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 02:14:06 juju-e4d256-prod-github-runner-207 kernel: [75020.555911] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 02:14:06 juju-e4d256-prod-github-runner-207 kernel: [75020.557186] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 02:14:06 juju-e4d256-prod-github-runner-207 kernel: [75020.558409] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:14:06 juju-e4d256-prod-github-runner-207 kernel: [75020.559468] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 02:14:06 juju-e4d256-prod-github-runner-207 kernel: [75020.562024] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 02:14:06 juju-e4d256-prod-github-runner-207 kernel: [75020.563071] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 02:14:06 juju-e4d256-prod-github-runner-207 kernel: [75020.564369] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 02:14:06 juju-e4d256-prod-github-runner-207 kernel: [75020.565660] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 02:14:06 juju-e4d256-prod-github-runner-207 kernel: [75020.566858] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 02:14:06 juju-e4d256-prod-github-runner-207 kernel: [75020.568095] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 02:14:06 juju-e4d256-prod-github-runner-207 kernel: [75020.569415] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 02:14:06 juju-e4d256-prod-github-runner-207 kernel: [75020.570763] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 02:14:06 juju-e4d256-prod-github-runner-207 kernel: [75020.571938] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 02:14:06 juju-e4d256-prod-github-runner-207 kernel: [75020.573187] Call Trace: Aug 23 02:14:06 juju-e4d256-prod-github-runner-207 kernel: [75020.574107] Aug 23 02:14:06 juju-e4d256-prod-github-runner-207 kernel: [75020.575000] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:14:06 juju-e4d256-prod-github-runner-207 kernel: [75020.576031] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:14:06 juju-e4d256-prod-github-runner-207 kernel: [75020.577052] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:14:06 juju-e4d256-prod-github-runner-207 kernel: [75020.578141] ? show_regs.part.0+0x23/0x29 Aug 23 02:14:06 juju-e4d256-prod-github-runner-207 kernel: [75020.579137] ? show_regs.cold+0x8/0xd Aug 23 02:14:06 juju-e4d256-prod-github-runner-207 kernel: [75020.580109] ? watchdog_timer_fn+0x1be/0x220 Aug 23 02:14:06 juju-e4d256-prod-github-runner-207 kernel: [75020.581121] ? lockup_detector_update_enable+0x60/0x60 Aug 23 02:14:06 juju-e4d256-prod-github-runner-207 kernel: [75020.582193] ? __hrtimer_run_queues+0x107/0x230 Aug 23 02:14:06 juju-e4d256-prod-github-runner-207 kernel: [75020.583220] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 02:14:06 juju-e4d256-prod-github-runner-207 kernel: [75020.584245] ? hrtimer_interrupt+0x101/0x220 Aug 23 02:14:06 juju-e4d256-prod-github-runner-207 kernel: [75020.585269] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 02:14:06 juju-e4d256-prod-github-runner-207 kernel: [75020.586339] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 02:14:06 juju-e4d256-prod-github-runner-207 kernel: [75020.587384] Aug 23 02:14:06 juju-e4d256-prod-github-runner-207 kernel: [75020.588235] Aug 23 02:14:06 juju-e4d256-prod-github-runner-207 kernel: [75020.589072] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 02:14:06 juju-e4d256-prod-github-runner-207 kernel: [75020.590116] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:14:06 juju-e4d256-prod-github-runner-207 kernel: [75020.591158] ? _raw_spin_lock+0x22/0x30 Aug 23 02:14:06 juju-e4d256-prod-github-runner-207 kernel: [75020.592103] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:14:06 juju-e4d256-prod-github-runner-207 kernel: [75020.593116] direct_page_fault+0x206/0x310 [kvm] Aug 23 02:14:06 juju-e4d256-prod-github-runner-207 kernel: [75020.594154] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 02:14:06 juju-e4d256-prod-github-runner-207 kernel: [75020.595162] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 02:14:06 juju-e4d256-prod-github-runner-207 kernel: [75020.596161] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 02:14:06 juju-e4d256-prod-github-runner-207 kernel: [75020.597136] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 02:14:06 juju-e4d256-prod-github-runner-207 kernel: [75020.598094] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 02:14:06 juju-e4d256-prod-github-runner-207 kernel: [75020.599071] handle_exit+0x98/0x230 [kvm_amd] Aug 23 02:14:06 juju-e4d256-prod-github-runner-207 kernel: [75020.599978] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 02:14:06 juju-e4d256-prod-github-runner-207 kernel: [75020.600891] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 02:14:06 juju-e4d256-prod-github-runner-207 kernel: [75020.601821] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 02:14:06 juju-e4d256-prod-github-runner-207 kernel: [75020.602723] vcpu_run+0x62/0x2c0 [kvm] Aug 23 02:14:06 juju-e4d256-prod-github-runner-207 kernel: [75020.603529] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 02:14:06 juju-e4d256-prod-github-runner-207 kernel: [75020.604332] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 02:14:06 juju-e4d256-prod-github-runner-207 kernel: [75020.605189] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 02:14:06 juju-e4d256-prod-github-runner-207 kernel: [75020.605982] ? __seccomp_filter+0x4a/0x4a0 Aug 23 02:14:06 juju-e4d256-prod-github-runner-207 kernel: [75020.606718] ? __fget_files+0x86/0xc0 Aug 23 02:14:06 juju-e4d256-prod-github-runner-207 kernel: [75020.607417] __x64_sys_ioctl+0x95/0xd0 Aug 23 02:14:06 juju-e4d256-prod-github-runner-207 kernel: [75020.608104] do_syscall_64+0x5c/0xc0 Aug 23 02:14:06 juju-e4d256-prod-github-runner-207 kernel: [75020.608763] ? do_futex+0x162/0x1f0 Aug 23 02:14:06 juju-e4d256-prod-github-runner-207 kernel: [75020.609423] ? __x64_sys_futex+0x78/0x1e0 Aug 23 02:14:06 juju-e4d256-prod-github-runner-207 kernel: [75020.610097] ? __secure_computing+0xa9/0x120 Aug 23 02:14:06 juju-e4d256-prod-github-runner-207 kernel: [75020.610781] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 02:14:06 juju-e4d256-prod-github-runner-207 kernel: [75020.611535] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:14:06 juju-e4d256-prod-github-runner-207 kernel: [75020.612249] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:14:06 juju-e4d256-prod-github-runner-207 kernel: [75020.612960] ? do_syscall_64+0x69/0xc0 Aug 23 02:14:06 juju-e4d256-prod-github-runner-207 kernel: [75020.613610] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:14:06 juju-e4d256-prod-github-runner-207 kernel: [75020.614307] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:14:06 juju-e4d256-prod-github-runner-207 kernel: [75020.614995] ? do_syscall_64+0x69/0xc0 Aug 23 02:14:06 juju-e4d256-prod-github-runner-207 kernel: [75020.615619] ? do_syscall_64+0x69/0xc0 Aug 23 02:14:06 juju-e4d256-prod-github-runner-207 kernel: [75020.616236] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 02:14:06 juju-e4d256-prod-github-runner-207 kernel: [75020.616934] RIP: 0033:0x7faa5d0edaff Aug 23 02:14:06 juju-e4d256-prod-github-runner-207 kernel: [75020.617566] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 02:14:06 juju-e4d256-prod-github-runner-207 kernel: [75020.619535] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 02:14:06 juju-e4d256-prod-github-runner-207 kernel: [75020.620439] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 02:14:06 juju-e4d256-prod-github-runner-207 kernel: [75020.621336] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 02:14:06 juju-e4d256-prod-github-runner-207 kernel: [75020.622220] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 02:14:06 juju-e4d256-prod-github-runner-207 kernel: [75020.623103] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 02:14:06 juju-e4d256-prod-github-runner-207 kernel: [75020.623985] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 02:14:06 juju-e4d256-prod-github-runner-207 kernel: [75020.624870] Aug 23 02:14:34 juju-e4d256-prod-github-runner-207 kernel: [75048.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 69786s! [qemu-system-x86:6715] Aug 23 02:14:34 juju-e4d256-prod-github-runner-207 kernel: [75048.543091] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 02:14:34 juju-e4d256-prod-github-runner-207 kernel: [75048.543159] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 02:14:34 juju-e4d256-prod-github-runner-207 kernel: [75048.555217] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 02:14:34 juju-e4d256-prod-github-runner-207 kernel: [75048.556502] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 02:14:34 juju-e4d256-prod-github-runner-207 kernel: [75048.557735] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:14:34 juju-e4d256-prod-github-runner-207 kernel: [75048.558802] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 02:14:34 juju-e4d256-prod-github-runner-207 kernel: [75048.561358] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 02:14:34 juju-e4d256-prod-github-runner-207 kernel: [75048.562407] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 02:14:34 juju-e4d256-prod-github-runner-207 kernel: [75048.563572] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 02:14:34 juju-e4d256-prod-github-runner-207 kernel: [75048.564734] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 02:14:34 juju-e4d256-prod-github-runner-207 kernel: [75048.565912] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 02:14:34 juju-e4d256-prod-github-runner-207 kernel: [75048.567071] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 02:14:34 juju-e4d256-prod-github-runner-207 kernel: [75048.568243] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 02:14:34 juju-e4d256-prod-github-runner-207 kernel: [75048.569511] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 02:14:34 juju-e4d256-prod-github-runner-207 kernel: [75048.570610] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 02:14:34 juju-e4d256-prod-github-runner-207 kernel: [75048.571811] Call Trace: Aug 23 02:14:34 juju-e4d256-prod-github-runner-207 kernel: [75048.572722] Aug 23 02:14:34 juju-e4d256-prod-github-runner-207 kernel: [75048.573616] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:14:34 juju-e4d256-prod-github-runner-207 kernel: [75048.574651] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:14:34 juju-e4d256-prod-github-runner-207 kernel: [75048.575675] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:14:34 juju-e4d256-prod-github-runner-207 kernel: [75048.576753] ? show_regs.part.0+0x23/0x29 Aug 23 02:14:34 juju-e4d256-prod-github-runner-207 kernel: [75048.577767] ? show_regs.cold+0x8/0xd Aug 23 02:14:34 juju-e4d256-prod-github-runner-207 kernel: [75048.578743] ? watchdog_timer_fn+0x1be/0x220 Aug 23 02:14:34 juju-e4d256-prod-github-runner-207 kernel: [75048.579757] ? lockup_detector_update_enable+0x60/0x60 Aug 23 02:14:34 juju-e4d256-prod-github-runner-207 kernel: [75048.580827] ? __hrtimer_run_queues+0x107/0x230 Aug 23 02:14:34 juju-e4d256-prod-github-runner-207 kernel: [75048.581871] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 02:14:34 juju-e4d256-prod-github-runner-207 kernel: [75048.582894] ? hrtimer_interrupt+0x101/0x220 Aug 23 02:14:34 juju-e4d256-prod-github-runner-207 kernel: [75048.583913] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 02:14:34 juju-e4d256-prod-github-runner-207 kernel: [75048.584996] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 02:14:34 juju-e4d256-prod-github-runner-207 kernel: [75048.586042] Aug 23 02:14:34 juju-e4d256-prod-github-runner-207 kernel: [75048.586899] Aug 23 02:14:34 juju-e4d256-prod-github-runner-207 kernel: [75048.587737] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 02:14:34 juju-e4d256-prod-github-runner-207 kernel: [75048.588777] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:14:34 juju-e4d256-prod-github-runner-207 kernel: [75048.589843] ? _raw_spin_lock+0x22/0x30 Aug 23 02:14:34 juju-e4d256-prod-github-runner-207 kernel: [75048.590800] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:14:34 juju-e4d256-prod-github-runner-207 kernel: [75048.591831] direct_page_fault+0x206/0x310 [kvm] Aug 23 02:14:34 juju-e4d256-prod-github-runner-207 kernel: [75048.592875] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 02:14:34 juju-e4d256-prod-github-runner-207 kernel: [75048.593892] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 02:14:34 juju-e4d256-prod-github-runner-207 kernel: [75048.594896] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 02:14:34 juju-e4d256-prod-github-runner-207 kernel: [75048.595872] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 02:14:34 juju-e4d256-prod-github-runner-207 kernel: [75048.596817] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 02:14:34 juju-e4d256-prod-github-runner-207 kernel: [75048.597806] handle_exit+0x98/0x230 [kvm_amd] Aug 23 02:14:34 juju-e4d256-prod-github-runner-207 kernel: [75048.598698] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 02:14:34 juju-e4d256-prod-github-runner-207 kernel: [75048.599611] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 02:14:34 juju-e4d256-prod-github-runner-207 kernel: [75048.600642] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 02:14:34 juju-e4d256-prod-github-runner-207 kernel: [75048.601558] vcpu_run+0x62/0x2c0 [kvm] Aug 23 02:14:34 juju-e4d256-prod-github-runner-207 kernel: [75048.602375] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 02:14:34 juju-e4d256-prod-github-runner-207 kernel: [75048.603189] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 02:14:34 juju-e4d256-prod-github-runner-207 kernel: [75048.604042] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 02:14:34 juju-e4d256-prod-github-runner-207 kernel: [75048.604840] ? __seccomp_filter+0x4a/0x4a0 Aug 23 02:14:34 juju-e4d256-prod-github-runner-207 kernel: [75048.605591] ? __fget_files+0x86/0xc0 Aug 23 02:14:34 juju-e4d256-prod-github-runner-207 kernel: [75048.606298] __x64_sys_ioctl+0x95/0xd0 Aug 23 02:14:34 juju-e4d256-prod-github-runner-207 kernel: [75048.606988] do_syscall_64+0x5c/0xc0 Aug 23 02:14:34 juju-e4d256-prod-github-runner-207 kernel: [75048.607650] ? do_futex+0x162/0x1f0 Aug 23 02:14:34 juju-e4d256-prod-github-runner-207 kernel: [75048.608303] ? __x64_sys_futex+0x78/0x1e0 Aug 23 02:14:34 juju-e4d256-prod-github-runner-207 kernel: [75048.608992] ? __secure_computing+0xa9/0x120 Aug 23 02:14:34 juju-e4d256-prod-github-runner-207 kernel: [75048.609680] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 02:14:34 juju-e4d256-prod-github-runner-207 kernel: [75048.610443] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:14:34 juju-e4d256-prod-github-runner-207 kernel: [75048.611167] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:14:34 juju-e4d256-prod-github-runner-207 kernel: [75048.611888] ? do_syscall_64+0x69/0xc0 Aug 23 02:14:34 juju-e4d256-prod-github-runner-207 kernel: [75048.612534] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:14:34 juju-e4d256-prod-github-runner-207 kernel: [75048.613252] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:14:34 juju-e4d256-prod-github-runner-207 kernel: [75048.613952] ? do_syscall_64+0x69/0xc0 Aug 23 02:14:34 juju-e4d256-prod-github-runner-207 kernel: [75048.614576] ? do_syscall_64+0x69/0xc0 Aug 23 02:14:34 juju-e4d256-prod-github-runner-207 kernel: [75048.615196] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 02:14:34 juju-e4d256-prod-github-runner-207 kernel: [75048.615904] RIP: 0033:0x7faa5d0edaff Aug 23 02:14:34 juju-e4d256-prod-github-runner-207 kernel: [75048.616525] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 02:14:34 juju-e4d256-prod-github-runner-207 kernel: [75048.618569] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 02:14:34 juju-e4d256-prod-github-runner-207 kernel: [75048.619485] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 02:14:34 juju-e4d256-prod-github-runner-207 kernel: [75048.620379] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 02:14:34 juju-e4d256-prod-github-runner-207 kernel: [75048.621278] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 02:14:34 juju-e4d256-prod-github-runner-207 kernel: [75048.622170] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 02:14:34 juju-e4d256-prod-github-runner-207 kernel: [75048.623059] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 02:14:34 juju-e4d256-prod-github-runner-207 kernel: [75048.623949] Aug 23 02:14:48 juju-e4d256-prod-github-runner-207 kernel: [75062.192706] rcu: INFO: rcu_sched self-detected stall on CPU Aug 23 02:14:48 juju-e4d256-prod-github-runner-207 kernel: [75062.193686] rcu: 1-....: (18677366 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=9027282 Aug 23 02:14:48 juju-e4d256-prod-github-runner-207 kernel: [75062.194828] (t=18736248 jiffies g=23269 q=63501) Aug 23 02:14:48 juju-e4d256-prod-github-runner-207 kernel: [75062.195619] NMI backtrace for cpu 1 Aug 23 02:14:48 juju-e4d256-prod-github-runner-207 kernel: [75062.196327] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 02:14:48 juju-e4d256-prod-github-runner-207 kernel: [75062.197480] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 02:14:48 juju-e4d256-prod-github-runner-207 kernel: [75062.198532] Call Trace: Aug 23 02:14:48 juju-e4d256-prod-github-runner-207 kernel: [75062.199230] Aug 23 02:14:48 juju-e4d256-prod-github-runner-207 kernel: [75062.199878] show_stack+0x52/0x5c Aug 23 02:14:48 juju-e4d256-prod-github-runner-207 kernel: [75062.200601] dump_stack_lvl+0x4a/0x63 Aug 23 02:14:48 juju-e4d256-prod-github-runner-207 kernel: [75062.201354] dump_stack+0x10/0x16 Aug 23 02:14:48 juju-e4d256-prod-github-runner-207 kernel: [75062.202075] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 23 02:14:48 juju-e4d256-prod-github-runner-207 kernel: [75062.202855] ? lapic_can_unplug_cpu+0x90/0x90 Aug 23 02:14:48 juju-e4d256-prod-github-runner-207 kernel: [75062.203630] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 23 02:14:48 juju-e4d256-prod-github-runner-207 kernel: [75062.204458] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 23 02:14:48 juju-e4d256-prod-github-runner-207 kernel: [75062.205313] trigger_single_cpu_backtrace+0x44/0x4f Aug 23 02:14:48 juju-e4d256-prod-github-runner-207 kernel: [75062.206123] rcu_dump_cpu_stacks+0x102/0x149 Aug 23 02:14:48 juju-e4d256-prod-github-runner-207 kernel: [75062.206892] print_cpu_stall.cold+0x2f/0xe2 Aug 23 02:14:48 juju-e4d256-prod-github-runner-207 kernel: [75062.207653] ? timekeeping_update+0xf7/0x150 Aug 23 02:14:48 juju-e4d256-prod-github-runner-207 kernel: [75062.208424] check_cpu_stall+0x109/0x270 Aug 23 02:14:48 juju-e4d256-prod-github-runner-207 kernel: [75062.209178] rcu_sched_clock_irq+0x9a/0x250 Aug 23 02:14:48 juju-e4d256-prod-github-runner-207 kernel: [75062.209967] update_process_times+0x94/0xd0 Aug 23 02:14:48 juju-e4d256-prod-github-runner-207 kernel: [75062.210725] tick_sched_handle+0x29/0x70 Aug 23 02:14:48 juju-e4d256-prod-github-runner-207 kernel: [75062.211468] tick_sched_timer+0x8c/0xc0 Aug 23 02:14:48 juju-e4d256-prod-github-runner-207 kernel: [75062.212206] ? tick_nohz_handler+0xb0/0xb0 Aug 23 02:14:48 juju-e4d256-prod-github-runner-207 kernel: [75062.212967] __hrtimer_run_queues+0x107/0x230 Aug 23 02:14:48 juju-e4d256-prod-github-runner-207 kernel: [75062.213736] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 02:14:48 juju-e4d256-prod-github-runner-207 kernel: [75062.214558] hrtimer_interrupt+0x101/0x220 Aug 23 02:14:48 juju-e4d256-prod-github-runner-207 kernel: [75062.215357] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 02:14:48 juju-e4d256-prod-github-runner-207 kernel: [75062.216167] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 02:14:48 juju-e4d256-prod-github-runner-207 kernel: [75062.216975] Aug 23 02:14:48 juju-e4d256-prod-github-runner-207 kernel: [75062.217610] Aug 23 02:14:48 juju-e4d256-prod-github-runner-207 kernel: [75062.218241] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 02:14:48 juju-e4d256-prod-github-runner-207 kernel: [75062.219055] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:14:48 juju-e4d256-prod-github-runner-207 kernel: [75062.219944] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 02:14:48 juju-e4d256-prod-github-runner-207 kernel: [75062.222162] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 02:14:48 juju-e4d256-prod-github-runner-207 kernel: [75062.223033] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 02:14:48 juju-e4d256-prod-github-runner-207 kernel: [75062.224026] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 02:14:48 juju-e4d256-prod-github-runner-207 kernel: [75062.225016] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 02:14:48 juju-e4d256-prod-github-runner-207 kernel: [75062.225981] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 02:14:48 juju-e4d256-prod-github-runner-207 kernel: [75062.226934] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 02:14:48 juju-e4d256-prod-github-runner-207 kernel: [75062.227884] ? _raw_spin_lock+0x22/0x30 Aug 23 02:14:48 juju-e4d256-prod-github-runner-207 kernel: [75062.228638] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:14:48 juju-e4d256-prod-github-runner-207 kernel: [75062.229491] direct_page_fault+0x206/0x310 [kvm] Aug 23 02:14:48 juju-e4d256-prod-github-runner-207 kernel: [75062.230336] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 02:14:48 juju-e4d256-prod-github-runner-207 kernel: [75062.231170] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 02:14:48 juju-e4d256-prod-github-runner-207 kernel: [75062.231995] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 02:14:48 juju-e4d256-prod-github-runner-207 kernel: [75062.232806] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 02:14:48 juju-e4d256-prod-github-runner-207 kernel: [75062.233589] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 02:14:48 juju-e4d256-prod-github-runner-207 kernel: [75062.234413] handle_exit+0x98/0x230 [kvm_amd] Aug 23 02:14:48 juju-e4d256-prod-github-runner-207 kernel: [75062.235173] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 02:14:48 juju-e4d256-prod-github-runner-207 kernel: [75062.235961] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 02:14:48 juju-e4d256-prod-github-runner-207 kernel: [75062.236765] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 02:14:48 juju-e4d256-prod-github-runner-207 kernel: [75062.237548] vcpu_run+0x62/0x2c0 [kvm] Aug 23 02:14:48 juju-e4d256-prod-github-runner-207 kernel: [75062.238261] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 02:14:48 juju-e4d256-prod-github-runner-207 kernel: [75062.238990] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 02:14:48 juju-e4d256-prod-github-runner-207 kernel: [75062.239787] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 02:14:48 juju-e4d256-prod-github-runner-207 kernel: [75062.240554] ? __seccomp_filter+0x4a/0x4a0 Aug 23 02:14:48 juju-e4d256-prod-github-runner-207 kernel: [75062.241293] ? __fget_files+0x86/0xc0 Aug 23 02:14:48 juju-e4d256-prod-github-runner-207 kernel: [75062.241983] __x64_sys_ioctl+0x95/0xd0 Aug 23 02:14:48 juju-e4d256-prod-github-runner-207 kernel: [75062.242675] do_syscall_64+0x5c/0xc0 Aug 23 02:14:48 juju-e4d256-prod-github-runner-207 kernel: [75062.243398] ? do_futex+0x162/0x1f0 Aug 23 02:14:48 juju-e4d256-prod-github-runner-207 kernel: [75062.244066] ? __x64_sys_futex+0x78/0x1e0 Aug 23 02:14:48 juju-e4d256-prod-github-runner-207 kernel: [75062.244774] ? __secure_computing+0xa9/0x120 Aug 23 02:14:48 juju-e4d256-prod-github-runner-207 kernel: [75062.245500] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 02:14:48 juju-e4d256-prod-github-runner-207 kernel: [75062.246292] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:14:48 juju-e4d256-prod-github-runner-207 kernel: [75062.247043] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:14:48 juju-e4d256-prod-github-runner-207 kernel: [75062.247792] ? do_syscall_64+0x69/0xc0 Aug 23 02:14:48 juju-e4d256-prod-github-runner-207 kernel: [75062.248478] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:14:48 juju-e4d256-prod-github-runner-207 kernel: [75062.249243] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:14:48 juju-e4d256-prod-github-runner-207 kernel: [75062.250000] ? do_syscall_64+0x69/0xc0 Aug 23 02:14:48 juju-e4d256-prod-github-runner-207 kernel: [75062.250713] ? do_syscall_64+0x69/0xc0 Aug 23 02:14:48 juju-e4d256-prod-github-runner-207 kernel: [75062.251409] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 02:14:48 juju-e4d256-prod-github-runner-207 kernel: [75062.252184] RIP: 0033:0x7faa5d0edaff Aug 23 02:14:48 juju-e4d256-prod-github-runner-207 kernel: [75062.252875] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 02:14:48 juju-e4d256-prod-github-runner-207 kernel: [75062.254980] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 02:14:48 juju-e4d256-prod-github-runner-207 kernel: [75062.255951] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 02:14:48 juju-e4d256-prod-github-runner-207 kernel: [75062.256907] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 02:14:48 juju-e4d256-prod-github-runner-207 kernel: [75062.257852] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 02:14:48 juju-e4d256-prod-github-runner-207 kernel: [75062.258791] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 02:14:48 juju-e4d256-prod-github-runner-207 kernel: [75062.259716] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 02:14:48 juju-e4d256-prod-github-runner-207 kernel: [75062.260629] Aug 23 02:15:14 juju-e4d256-prod-github-runner-207 kernel: [75088.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 69823s! [qemu-system-x86:6715] Aug 23 02:15:14 juju-e4d256-prod-github-runner-207 kernel: [75088.543987] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 02:15:14 juju-e4d256-prod-github-runner-207 kernel: [75088.544276] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 02:15:14 juju-e4d256-prod-github-runner-207 kernel: [75088.556474] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 02:15:14 juju-e4d256-prod-github-runner-207 kernel: [75088.557739] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 02:15:14 juju-e4d256-prod-github-runner-207 kernel: [75088.558961] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:15:14 juju-e4d256-prod-github-runner-207 kernel: [75088.560019] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 02:15:14 juju-e4d256-prod-github-runner-207 kernel: [75088.562580] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 02:15:14 juju-e4d256-prod-github-runner-207 kernel: [75088.563630] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 02:15:14 juju-e4d256-prod-github-runner-207 kernel: [75088.564805] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 02:15:14 juju-e4d256-prod-github-runner-207 kernel: [75088.565965] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 02:15:14 juju-e4d256-prod-github-runner-207 kernel: [75088.567282] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 02:15:14 juju-e4d256-prod-github-runner-207 kernel: [75088.568585] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 02:15:14 juju-e4d256-prod-github-runner-207 kernel: [75088.569924] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 02:15:14 juju-e4d256-prod-github-runner-207 kernel: [75088.571308] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 02:15:14 juju-e4d256-prod-github-runner-207 kernel: [75088.572523] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 02:15:14 juju-e4d256-prod-github-runner-207 kernel: [75088.573859] Call Trace: Aug 23 02:15:14 juju-e4d256-prod-github-runner-207 kernel: [75088.574827] Aug 23 02:15:14 juju-e4d256-prod-github-runner-207 kernel: [75088.575780] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:15:14 juju-e4d256-prod-github-runner-207 kernel: [75088.576926] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:15:14 juju-e4d256-prod-github-runner-207 kernel: [75088.578040] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:15:14 juju-e4d256-prod-github-runner-207 kernel: [75088.579226] ? show_regs.part.0+0x23/0x29 Aug 23 02:15:14 juju-e4d256-prod-github-runner-207 kernel: [75088.580298] ? show_regs.cold+0x8/0xd Aug 23 02:15:14 juju-e4d256-prod-github-runner-207 kernel: [75088.581364] ? watchdog_timer_fn+0x1be/0x220 Aug 23 02:15:14 juju-e4d256-prod-github-runner-207 kernel: [75088.582466] ? lockup_detector_update_enable+0x60/0x60 Aug 23 02:15:14 juju-e4d256-prod-github-runner-207 kernel: [75088.583636] ? __hrtimer_run_queues+0x107/0x230 Aug 23 02:15:14 juju-e4d256-prod-github-runner-207 kernel: [75088.584931] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 02:15:14 juju-e4d256-prod-github-runner-207 kernel: [75088.586039] ? hrtimer_interrupt+0x101/0x220 Aug 23 02:15:14 juju-e4d256-prod-github-runner-207 kernel: [75088.587145] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 02:15:14 juju-e4d256-prod-github-runner-207 kernel: [75088.588394] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 02:15:14 juju-e4d256-prod-github-runner-207 kernel: [75088.589549] Aug 23 02:15:14 juju-e4d256-prod-github-runner-207 kernel: [75088.590454] Aug 23 02:15:14 juju-e4d256-prod-github-runner-207 kernel: [75088.591344] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 02:15:14 juju-e4d256-prod-github-runner-207 kernel: [75088.592492] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:15:14 juju-e4d256-prod-github-runner-207 kernel: [75088.593639] ? _raw_spin_lock+0x22/0x30 Aug 23 02:15:14 juju-e4d256-prod-github-runner-207 kernel: [75088.594664] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:15:14 juju-e4d256-prod-github-runner-207 kernel: [75088.595773] direct_page_fault+0x206/0x310 [kvm] Aug 23 02:15:14 juju-e4d256-prod-github-runner-207 kernel: [75088.596896] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 02:15:14 juju-e4d256-prod-github-runner-207 kernel: [75088.597990] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 02:15:14 juju-e4d256-prod-github-runner-207 kernel: [75088.599085] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 02:15:14 juju-e4d256-prod-github-runner-207 kernel: [75088.600172] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 02:15:14 juju-e4d256-prod-github-runner-207 kernel: [75088.601229] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 02:15:14 juju-e4d256-prod-github-runner-207 kernel: [75088.602327] handle_exit+0x98/0x230 [kvm_amd] Aug 23 02:15:14 juju-e4d256-prod-github-runner-207 kernel: [75088.603307] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 02:15:14 juju-e4d256-prod-github-runner-207 kernel: [75088.604362] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 02:15:14 juju-e4d256-prod-github-runner-207 kernel: [75088.605542] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 02:15:14 juju-e4d256-prod-github-runner-207 kernel: [75088.606470] vcpu_run+0x62/0x2c0 [kvm] Aug 23 02:15:14 juju-e4d256-prod-github-runner-207 kernel: [75088.607285] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 02:15:14 juju-e4d256-prod-github-runner-207 kernel: [75088.608096] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 02:15:14 juju-e4d256-prod-github-runner-207 kernel: [75088.608982] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 02:15:14 juju-e4d256-prod-github-runner-207 kernel: [75088.609785] ? __seccomp_filter+0x4a/0x4a0 Aug 23 02:15:14 juju-e4d256-prod-github-runner-207 kernel: [75088.610531] ? __fget_files+0x86/0xc0 Aug 23 02:15:14 juju-e4d256-prod-github-runner-207 kernel: [75088.611236] __x64_sys_ioctl+0x95/0xd0 Aug 23 02:15:14 juju-e4d256-prod-github-runner-207 kernel: [75088.611929] do_syscall_64+0x5c/0xc0 Aug 23 02:15:14 juju-e4d256-prod-github-runner-207 kernel: [75088.612611] ? do_futex+0x162/0x1f0 Aug 23 02:15:14 juju-e4d256-prod-github-runner-207 kernel: [75088.613270] ? __x64_sys_futex+0x78/0x1e0 Aug 23 02:15:14 juju-e4d256-prod-github-runner-207 kernel: [75088.613946] ? __secure_computing+0xa9/0x120 Aug 23 02:15:14 juju-e4d256-prod-github-runner-207 kernel: [75088.614642] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 02:15:14 juju-e4d256-prod-github-runner-207 kernel: [75088.615404] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:15:14 juju-e4d256-prod-github-runner-207 kernel: [75088.616127] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:15:14 juju-e4d256-prod-github-runner-207 kernel: [75088.616855] ? do_syscall_64+0x69/0xc0 Aug 23 02:15:14 juju-e4d256-prod-github-runner-207 kernel: [75088.617508] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:15:14 juju-e4d256-prod-github-runner-207 kernel: [75088.618213] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:15:14 juju-e4d256-prod-github-runner-207 kernel: [75088.618912] ? do_syscall_64+0x69/0xc0 Aug 23 02:15:14 juju-e4d256-prod-github-runner-207 kernel: [75088.619538] ? do_syscall_64+0x69/0xc0 Aug 23 02:15:14 juju-e4d256-prod-github-runner-207 kernel: [75088.620161] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 02:15:14 juju-e4d256-prod-github-runner-207 kernel: [75088.620883] RIP: 0033:0x7faa5d0edaff Aug 23 02:15:14 juju-e4d256-prod-github-runner-207 kernel: [75088.621546] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 02:15:14 juju-e4d256-prod-github-runner-207 kernel: [75088.623554] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 02:15:14 juju-e4d256-prod-github-runner-207 kernel: [75088.624481] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 02:15:14 juju-e4d256-prod-github-runner-207 kernel: [75088.625378] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 02:15:14 juju-e4d256-prod-github-runner-207 kernel: [75088.626277] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 02:15:14 juju-e4d256-prod-github-runner-207 kernel: [75088.627169] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 02:15:14 juju-e4d256-prod-github-runner-207 kernel: [75088.628060] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 02:15:14 juju-e4d256-prod-github-runner-207 kernel: [75088.628963] Aug 23 02:15:42 juju-e4d256-prod-github-runner-207 kernel: [75116.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 69849s! [qemu-system-x86:6715] Aug 23 02:15:42 juju-e4d256-prod-github-runner-207 kernel: [75116.543096] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 02:15:42 juju-e4d256-prod-github-runner-207 kernel: [75116.543164] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 02:15:42 juju-e4d256-prod-github-runner-207 kernel: [75116.555227] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 02:15:42 juju-e4d256-prod-github-runner-207 kernel: [75116.556512] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 02:15:42 juju-e4d256-prod-github-runner-207 kernel: [75116.557731] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:15:42 juju-e4d256-prod-github-runner-207 kernel: [75116.558786] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 02:15:42 juju-e4d256-prod-github-runner-207 kernel: [75116.561342] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 02:15:42 juju-e4d256-prod-github-runner-207 kernel: [75116.562385] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 02:15:42 juju-e4d256-prod-github-runner-207 kernel: [75116.563551] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 02:15:42 juju-e4d256-prod-github-runner-207 kernel: [75116.564719] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 02:15:42 juju-e4d256-prod-github-runner-207 kernel: [75116.565885] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 02:15:42 juju-e4d256-prod-github-runner-207 kernel: [75116.567044] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 02:15:42 juju-e4d256-prod-github-runner-207 kernel: [75116.568269] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 02:15:42 juju-e4d256-prod-github-runner-207 kernel: [75116.569549] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 02:15:42 juju-e4d256-prod-github-runner-207 kernel: [75116.570645] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 02:15:42 juju-e4d256-prod-github-runner-207 kernel: [75116.571836] Call Trace: Aug 23 02:15:42 juju-e4d256-prod-github-runner-207 kernel: [75116.572764] Aug 23 02:15:42 juju-e4d256-prod-github-runner-207 kernel: [75116.573650] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:15:42 juju-e4d256-prod-github-runner-207 kernel: [75116.574680] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:15:42 juju-e4d256-prod-github-runner-207 kernel: [75116.575700] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:15:42 juju-e4d256-prod-github-runner-207 kernel: [75116.576791] ? show_regs.part.0+0x23/0x29 Aug 23 02:15:42 juju-e4d256-prod-github-runner-207 kernel: [75116.577792] ? show_regs.cold+0x8/0xd Aug 23 02:15:42 juju-e4d256-prod-github-runner-207 kernel: [75116.578768] ? watchdog_timer_fn+0x1be/0x220 Aug 23 02:15:42 juju-e4d256-prod-github-runner-207 kernel: [75116.579783] ? lockup_detector_update_enable+0x60/0x60 Aug 23 02:15:42 juju-e4d256-prod-github-runner-207 kernel: [75116.580850] ? __hrtimer_run_queues+0x107/0x230 Aug 23 02:15:42 juju-e4d256-prod-github-runner-207 kernel: [75116.581877] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 02:15:42 juju-e4d256-prod-github-runner-207 kernel: [75116.582903] ? hrtimer_interrupt+0x101/0x220 Aug 23 02:15:42 juju-e4d256-prod-github-runner-207 kernel: [75116.583922] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 02:15:42 juju-e4d256-prod-github-runner-207 kernel: [75116.584999] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 02:15:42 juju-e4d256-prod-github-runner-207 kernel: [75116.586044] Aug 23 02:15:42 juju-e4d256-prod-github-runner-207 kernel: [75116.586896] Aug 23 02:15:42 juju-e4d256-prod-github-runner-207 kernel: [75116.587732] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 02:15:42 juju-e4d256-prod-github-runner-207 kernel: [75116.588777] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:15:42 juju-e4d256-prod-github-runner-207 kernel: [75116.589815] ? _raw_spin_lock+0x22/0x30 Aug 23 02:15:42 juju-e4d256-prod-github-runner-207 kernel: [75116.590763] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:15:42 juju-e4d256-prod-github-runner-207 kernel: [75116.591782] direct_page_fault+0x206/0x310 [kvm] Aug 23 02:15:42 juju-e4d256-prod-github-runner-207 kernel: [75116.592816] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 02:15:42 juju-e4d256-prod-github-runner-207 kernel: [75116.593824] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 02:15:42 juju-e4d256-prod-github-runner-207 kernel: [75116.594828] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 02:15:42 juju-e4d256-prod-github-runner-207 kernel: [75116.595806] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 02:15:42 juju-e4d256-prod-github-runner-207 kernel: [75116.596766] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 02:15:42 juju-e4d256-prod-github-runner-207 kernel: [75116.597747] handle_exit+0x98/0x230 [kvm_amd] Aug 23 02:15:42 juju-e4d256-prod-github-runner-207 kernel: [75116.598638] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 02:15:42 juju-e4d256-prod-github-runner-207 kernel: [75116.599557] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 02:15:42 juju-e4d256-prod-github-runner-207 kernel: [75116.600491] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 02:15:42 juju-e4d256-prod-github-runner-207 kernel: [75116.601393] vcpu_run+0x62/0x2c0 [kvm] Aug 23 02:15:42 juju-e4d256-prod-github-runner-207 kernel: [75116.602203] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 02:15:42 juju-e4d256-prod-github-runner-207 kernel: [75116.603016] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 02:15:42 juju-e4d256-prod-github-runner-207 kernel: [75116.603872] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 02:15:42 juju-e4d256-prod-github-runner-207 kernel: [75116.604701] ? __seccomp_filter+0x4a/0x4a0 Aug 23 02:15:42 juju-e4d256-prod-github-runner-207 kernel: [75116.605441] ? __fget_files+0x86/0xc0 Aug 23 02:15:42 juju-e4d256-prod-github-runner-207 kernel: [75116.606141] __x64_sys_ioctl+0x95/0xd0 Aug 23 02:15:42 juju-e4d256-prod-github-runner-207 kernel: [75116.606836] do_syscall_64+0x5c/0xc0 Aug 23 02:15:42 juju-e4d256-prod-github-runner-207 kernel: [75116.607501] ? do_futex+0x162/0x1f0 Aug 23 02:15:42 juju-e4d256-prod-github-runner-207 kernel: [75116.608160] ? __x64_sys_futex+0x78/0x1e0 Aug 23 02:15:42 juju-e4d256-prod-github-runner-207 kernel: [75116.608831] ? __secure_computing+0xa9/0x120 Aug 23 02:15:42 juju-e4d256-prod-github-runner-207 kernel: [75116.609518] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 02:15:42 juju-e4d256-prod-github-runner-207 kernel: [75116.610276] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:15:42 juju-e4d256-prod-github-runner-207 kernel: [75116.611003] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:15:42 juju-e4d256-prod-github-runner-207 kernel: [75116.611722] ? do_syscall_64+0x69/0xc0 Aug 23 02:15:42 juju-e4d256-prod-github-runner-207 kernel: [75116.612373] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:15:42 juju-e4d256-prod-github-runner-207 kernel: [75116.613073] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:15:42 juju-e4d256-prod-github-runner-207 kernel: [75116.613767] ? do_syscall_64+0x69/0xc0 Aug 23 02:15:42 juju-e4d256-prod-github-runner-207 kernel: [75116.614388] ? do_syscall_64+0x69/0xc0 Aug 23 02:15:42 juju-e4d256-prod-github-runner-207 kernel: [75116.615013] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 02:15:42 juju-e4d256-prod-github-runner-207 kernel: [75116.615720] RIP: 0033:0x7faa5d0edaff Aug 23 02:15:42 juju-e4d256-prod-github-runner-207 kernel: [75116.616371] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 02:15:42 juju-e4d256-prod-github-runner-207 kernel: [75116.618353] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 02:15:42 juju-e4d256-prod-github-runner-207 kernel: [75116.619266] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 02:15:42 juju-e4d256-prod-github-runner-207 kernel: [75116.620176] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 02:15:42 juju-e4d256-prod-github-runner-207 kernel: [75116.621065] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 02:15:42 juju-e4d256-prod-github-runner-207 kernel: [75116.621952] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 02:15:42 juju-e4d256-prod-github-runner-207 kernel: [75116.622843] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 02:15:42 juju-e4d256-prod-github-runner-207 kernel: [75116.623739] Aug 23 02:16:10 juju-e4d256-prod-github-runner-207 kernel: [75144.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 69875s! [qemu-system-x86:6715] Aug 23 02:16:10 juju-e4d256-prod-github-runner-207 kernel: [75144.543130] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 02:16:10 juju-e4d256-prod-github-runner-207 kernel: [75144.543198] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 02:16:10 juju-e4d256-prod-github-runner-207 kernel: [75144.555257] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 02:16:10 juju-e4d256-prod-github-runner-207 kernel: [75144.556548] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 02:16:10 juju-e4d256-prod-github-runner-207 kernel: [75144.557787] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:16:10 juju-e4d256-prod-github-runner-207 kernel: [75144.558859] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 02:16:10 juju-e4d256-prod-github-runner-207 kernel: [75144.561457] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 02:16:10 juju-e4d256-prod-github-runner-207 kernel: [75144.562512] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 02:16:10 juju-e4d256-prod-github-runner-207 kernel: [75144.563676] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 02:16:10 juju-e4d256-prod-github-runner-207 kernel: [75144.564853] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 02:16:10 juju-e4d256-prod-github-runner-207 kernel: [75144.566016] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 02:16:10 juju-e4d256-prod-github-runner-207 kernel: [75144.567183] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 02:16:10 juju-e4d256-prod-github-runner-207 kernel: [75144.568373] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 02:16:10 juju-e4d256-prod-github-runner-207 kernel: [75144.569610] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 02:16:10 juju-e4d256-prod-github-runner-207 kernel: [75144.570711] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 02:16:10 juju-e4d256-prod-github-runner-207 kernel: [75144.571923] Call Trace: Aug 23 02:16:10 juju-e4d256-prod-github-runner-207 kernel: [75144.572877] Aug 23 02:16:10 juju-e4d256-prod-github-runner-207 kernel: [75144.573771] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:16:10 juju-e4d256-prod-github-runner-207 kernel: [75144.574811] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:16:10 juju-e4d256-prod-github-runner-207 kernel: [75144.575844] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:16:10 juju-e4d256-prod-github-runner-207 kernel: [75144.576928] ? show_regs.part.0+0x23/0x29 Aug 23 02:16:10 juju-e4d256-prod-github-runner-207 kernel: [75144.577928] ? show_regs.cold+0x8/0xd Aug 23 02:16:10 juju-e4d256-prod-github-runner-207 kernel: [75144.578924] ? watchdog_timer_fn+0x1be/0x220 Aug 23 02:16:10 juju-e4d256-prod-github-runner-207 kernel: [75144.579948] ? lockup_detector_update_enable+0x60/0x60 Aug 23 02:16:10 juju-e4d256-prod-github-runner-207 kernel: [75144.581020] ? __hrtimer_run_queues+0x107/0x230 Aug 23 02:16:10 juju-e4d256-prod-github-runner-207 kernel: [75144.582048] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 02:16:10 juju-e4d256-prod-github-runner-207 kernel: [75144.583072] ? hrtimer_interrupt+0x101/0x220 Aug 23 02:16:10 juju-e4d256-prod-github-runner-207 kernel: [75144.584105] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 02:16:10 juju-e4d256-prod-github-runner-207 kernel: [75144.585180] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 02:16:10 juju-e4d256-prod-github-runner-207 kernel: [75144.586293] Aug 23 02:16:10 juju-e4d256-prod-github-runner-207 kernel: [75144.587160] Aug 23 02:16:10 juju-e4d256-prod-github-runner-207 kernel: [75144.588010] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 02:16:10 juju-e4d256-prod-github-runner-207 kernel: [75144.589044] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:16:10 juju-e4d256-prod-github-runner-207 kernel: [75144.590088] ? _raw_spin_lock+0x22/0x30 Aug 23 02:16:10 juju-e4d256-prod-github-runner-207 kernel: [75144.591033] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:16:10 juju-e4d256-prod-github-runner-207 kernel: [75144.592058] direct_page_fault+0x206/0x310 [kvm] Aug 23 02:16:10 juju-e4d256-prod-github-runner-207 kernel: [75144.593087] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 02:16:10 juju-e4d256-prod-github-runner-207 kernel: [75144.594093] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 02:16:10 juju-e4d256-prod-github-runner-207 kernel: [75144.595092] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 02:16:10 juju-e4d256-prod-github-runner-207 kernel: [75144.596069] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 02:16:10 juju-e4d256-prod-github-runner-207 kernel: [75144.597013] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 02:16:10 juju-e4d256-prod-github-runner-207 kernel: [75144.597995] handle_exit+0x98/0x230 [kvm_amd] Aug 23 02:16:10 juju-e4d256-prod-github-runner-207 kernel: [75144.598888] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 02:16:10 juju-e4d256-prod-github-runner-207 kernel: [75144.599816] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 02:16:10 juju-e4d256-prod-github-runner-207 kernel: [75144.600740] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 02:16:10 juju-e4d256-prod-github-runner-207 kernel: [75144.601645] vcpu_run+0x62/0x2c0 [kvm] Aug 23 02:16:10 juju-e4d256-prod-github-runner-207 kernel: [75144.602477] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 02:16:10 juju-e4d256-prod-github-runner-207 kernel: [75144.603287] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 02:16:10 juju-e4d256-prod-github-runner-207 kernel: [75144.604211] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 02:16:10 juju-e4d256-prod-github-runner-207 kernel: [75144.605009] ? __seccomp_filter+0x4a/0x4a0 Aug 23 02:16:10 juju-e4d256-prod-github-runner-207 kernel: [75144.605757] ? __fget_files+0x86/0xc0 Aug 23 02:16:10 juju-e4d256-prod-github-runner-207 kernel: [75144.606495] __x64_sys_ioctl+0x95/0xd0 Aug 23 02:16:10 juju-e4d256-prod-github-runner-207 kernel: [75144.607188] do_syscall_64+0x5c/0xc0 Aug 23 02:16:10 juju-e4d256-prod-github-runner-207 kernel: [75144.607860] ? do_futex+0x162/0x1f0 Aug 23 02:16:10 juju-e4d256-prod-github-runner-207 kernel: [75144.608507] ? __x64_sys_futex+0x78/0x1e0 Aug 23 02:16:10 juju-e4d256-prod-github-runner-207 kernel: [75144.609186] ? __secure_computing+0xa9/0x120 Aug 23 02:16:10 juju-e4d256-prod-github-runner-207 kernel: [75144.609876] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 02:16:10 juju-e4d256-prod-github-runner-207 kernel: [75144.610631] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:16:10 juju-e4d256-prod-github-runner-207 kernel: [75144.611350] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:16:10 juju-e4d256-prod-github-runner-207 kernel: [75144.612077] ? do_syscall_64+0x69/0xc0 Aug 23 02:16:10 juju-e4d256-prod-github-runner-207 kernel: [75144.612745] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:16:10 juju-e4d256-prod-github-runner-207 kernel: [75144.613465] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:16:10 juju-e4d256-prod-github-runner-207 kernel: [75144.614166] ? do_syscall_64+0x69/0xc0 Aug 23 02:16:10 juju-e4d256-prod-github-runner-207 kernel: [75144.614814] ? do_syscall_64+0x69/0xc0 Aug 23 02:16:10 juju-e4d256-prod-github-runner-207 kernel: [75144.615434] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 02:16:10 juju-e4d256-prod-github-runner-207 kernel: [75144.616151] RIP: 0033:0x7faa5d0edaff Aug 23 02:16:10 juju-e4d256-prod-github-runner-207 kernel: [75144.616774] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 02:16:10 juju-e4d256-prod-github-runner-207 kernel: [75144.618789] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 02:16:10 juju-e4d256-prod-github-runner-207 kernel: [75144.619702] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 02:16:10 juju-e4d256-prod-github-runner-207 kernel: [75144.620597] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 02:16:10 juju-e4d256-prod-github-runner-207 kernel: [75144.621484] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 02:16:10 juju-e4d256-prod-github-runner-207 kernel: [75144.622372] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 02:16:10 juju-e4d256-prod-github-runner-207 kernel: [75144.623283] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 02:16:10 juju-e4d256-prod-github-runner-207 kernel: [75144.624191] Aug 23 02:16:38 juju-e4d256-prod-github-runner-207 kernel: [75172.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 69901s! [qemu-system-x86:6715] Aug 23 02:16:38 juju-e4d256-prod-github-runner-207 kernel: [75172.543185] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 02:16:38 juju-e4d256-prod-github-runner-207 kernel: [75172.543410] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 02:16:38 juju-e4d256-prod-github-runner-207 kernel: [75172.555484] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 02:16:38 juju-e4d256-prod-github-runner-207 kernel: [75172.556747] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 02:16:38 juju-e4d256-prod-github-runner-207 kernel: [75172.557963] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:16:38 juju-e4d256-prod-github-runner-207 kernel: [75172.559024] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 02:16:38 juju-e4d256-prod-github-runner-207 kernel: [75172.561578] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 02:16:38 juju-e4d256-prod-github-runner-207 kernel: [75172.562763] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 02:16:38 juju-e4d256-prod-github-runner-207 kernel: [75172.563934] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 02:16:38 juju-e4d256-prod-github-runner-207 kernel: [75172.565098] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 02:16:38 juju-e4d256-prod-github-runner-207 kernel: [75172.566256] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 02:16:38 juju-e4d256-prod-github-runner-207 kernel: [75172.567415] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 02:16:38 juju-e4d256-prod-github-runner-207 kernel: [75172.568602] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 02:16:38 juju-e4d256-prod-github-runner-207 kernel: [75172.569833] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 02:16:38 juju-e4d256-prod-github-runner-207 kernel: [75172.570933] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 02:16:38 juju-e4d256-prod-github-runner-207 kernel: [75172.572140] Call Trace: Aug 23 02:16:38 juju-e4d256-prod-github-runner-207 kernel: [75172.573055] Aug 23 02:16:38 juju-e4d256-prod-github-runner-207 kernel: [75172.573947] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:16:38 juju-e4d256-prod-github-runner-207 kernel: [75172.574972] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:16:38 juju-e4d256-prod-github-runner-207 kernel: [75172.576006] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:16:38 juju-e4d256-prod-github-runner-207 kernel: [75172.577100] ? show_regs.part.0+0x23/0x29 Aug 23 02:16:38 juju-e4d256-prod-github-runner-207 kernel: [75172.578095] ? show_regs.cold+0x8/0xd Aug 23 02:16:38 juju-e4d256-prod-github-runner-207 kernel: [75172.579064] ? watchdog_timer_fn+0x1be/0x220 Aug 23 02:16:38 juju-e4d256-prod-github-runner-207 kernel: [75172.580081] ? lockup_detector_update_enable+0x60/0x60 Aug 23 02:16:38 juju-e4d256-prod-github-runner-207 kernel: [75172.581143] ? __hrtimer_run_queues+0x107/0x230 Aug 23 02:16:38 juju-e4d256-prod-github-runner-207 kernel: [75172.582168] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 02:16:38 juju-e4d256-prod-github-runner-207 kernel: [75172.583189] ? hrtimer_interrupt+0x101/0x220 Aug 23 02:16:38 juju-e4d256-prod-github-runner-207 kernel: [75172.584213] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 02:16:38 juju-e4d256-prod-github-runner-207 kernel: [75172.585281] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 02:16:38 juju-e4d256-prod-github-runner-207 kernel: [75172.586325] Aug 23 02:16:38 juju-e4d256-prod-github-runner-207 kernel: [75172.587176] Aug 23 02:16:38 juju-e4d256-prod-github-runner-207 kernel: [75172.588024] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 02:16:38 juju-e4d256-prod-github-runner-207 kernel: [75172.589062] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:16:38 juju-e4d256-prod-github-runner-207 kernel: [75172.590099] ? _raw_spin_lock+0x22/0x30 Aug 23 02:16:38 juju-e4d256-prod-github-runner-207 kernel: [75172.591042] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:16:38 juju-e4d256-prod-github-runner-207 kernel: [75172.592073] direct_page_fault+0x206/0x310 [kvm] Aug 23 02:16:38 juju-e4d256-prod-github-runner-207 kernel: [75172.593094] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 02:16:38 juju-e4d256-prod-github-runner-207 kernel: [75172.594106] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 02:16:38 juju-e4d256-prod-github-runner-207 kernel: [75172.595105] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 02:16:38 juju-e4d256-prod-github-runner-207 kernel: [75172.596100] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 02:16:38 juju-e4d256-prod-github-runner-207 kernel: [75172.597043] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 02:16:38 juju-e4d256-prod-github-runner-207 kernel: [75172.598018] handle_exit+0x98/0x230 [kvm_amd] Aug 23 02:16:38 juju-e4d256-prod-github-runner-207 kernel: [75172.598908] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 02:16:38 juju-e4d256-prod-github-runner-207 kernel: [75172.599837] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 02:16:38 juju-e4d256-prod-github-runner-207 kernel: [75172.600759] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 02:16:38 juju-e4d256-prod-github-runner-207 kernel: [75172.601661] vcpu_run+0x62/0x2c0 [kvm] Aug 23 02:16:38 juju-e4d256-prod-github-runner-207 kernel: [75172.602470] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 02:16:38 juju-e4d256-prod-github-runner-207 kernel: [75172.603287] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 02:16:38 juju-e4d256-prod-github-runner-207 kernel: [75172.604165] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 02:16:38 juju-e4d256-prod-github-runner-207 kernel: [75172.604958] ? __seccomp_filter+0x4a/0x4a0 Aug 23 02:16:38 juju-e4d256-prod-github-runner-207 kernel: [75172.605696] ? __fget_files+0x86/0xc0 Aug 23 02:16:38 juju-e4d256-prod-github-runner-207 kernel: [75172.606402] __x64_sys_ioctl+0x95/0xd0 Aug 23 02:16:38 juju-e4d256-prod-github-runner-207 kernel: [75172.607095] do_syscall_64+0x5c/0xc0 Aug 23 02:16:38 juju-e4d256-prod-github-runner-207 kernel: [75172.607798] ? do_futex+0x162/0x1f0 Aug 23 02:16:38 juju-e4d256-prod-github-runner-207 kernel: [75172.608452] ? __x64_sys_futex+0x78/0x1e0 Aug 23 02:16:38 juju-e4d256-prod-github-runner-207 kernel: [75172.609122] ? __secure_computing+0xa9/0x120 Aug 23 02:16:38 juju-e4d256-prod-github-runner-207 kernel: [75172.609808] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 02:16:38 juju-e4d256-prod-github-runner-207 kernel: [75172.610564] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:16:38 juju-e4d256-prod-github-runner-207 kernel: [75172.611290] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:16:38 juju-e4d256-prod-github-runner-207 kernel: [75172.612018] ? do_syscall_64+0x69/0xc0 Aug 23 02:16:38 juju-e4d256-prod-github-runner-207 kernel: [75172.612661] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:16:38 juju-e4d256-prod-github-runner-207 kernel: [75172.613368] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:16:38 juju-e4d256-prod-github-runner-207 kernel: [75172.614067] ? do_syscall_64+0x69/0xc0 Aug 23 02:16:38 juju-e4d256-prod-github-runner-207 kernel: [75172.614690] ? do_syscall_64+0x69/0xc0 Aug 23 02:16:38 juju-e4d256-prod-github-runner-207 kernel: [75172.615316] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 02:16:38 juju-e4d256-prod-github-runner-207 kernel: [75172.616032] RIP: 0033:0x7faa5d0edaff Aug 23 02:16:38 juju-e4d256-prod-github-runner-207 kernel: [75172.616674] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 02:16:38 juju-e4d256-prod-github-runner-207 kernel: [75172.618661] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 02:16:38 juju-e4d256-prod-github-runner-207 kernel: [75172.619582] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 02:16:38 juju-e4d256-prod-github-runner-207 kernel: [75172.620470] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 02:16:38 juju-e4d256-prod-github-runner-207 kernel: [75172.621364] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 02:16:38 juju-e4d256-prod-github-runner-207 kernel: [75172.622249] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 02:16:38 juju-e4d256-prod-github-runner-207 kernel: [75172.623135] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 02:16:38 juju-e4d256-prod-github-runner-207 kernel: [75172.624048] Aug 23 02:17:06 juju-e4d256-prod-github-runner-207 kernel: [75200.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 69927s! [qemu-system-x86:6715] Aug 23 02:17:06 juju-e4d256-prod-github-runner-207 kernel: [75200.543674] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 02:17:06 juju-e4d256-prod-github-runner-207 kernel: [75200.543817] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 02:17:06 juju-e4d256-prod-github-runner-207 kernel: [75200.556119] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 02:17:06 juju-e4d256-prod-github-runner-207 kernel: [75200.557460] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 02:17:06 juju-e4d256-prod-github-runner-207 kernel: [75200.558685] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:17:06 juju-e4d256-prod-github-runner-207 kernel: [75200.559754] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 02:17:06 juju-e4d256-prod-github-runner-207 kernel: [75200.562331] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 02:17:06 juju-e4d256-prod-github-runner-207 kernel: [75200.563384] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 02:17:06 juju-e4d256-prod-github-runner-207 kernel: [75200.564552] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 02:17:06 juju-e4d256-prod-github-runner-207 kernel: [75200.565713] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 02:17:06 juju-e4d256-prod-github-runner-207 kernel: [75200.566917] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 02:17:06 juju-e4d256-prod-github-runner-207 kernel: [75200.568131] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 02:17:06 juju-e4d256-prod-github-runner-207 kernel: [75200.569293] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 02:17:06 juju-e4d256-prod-github-runner-207 kernel: [75200.570556] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 02:17:06 juju-e4d256-prod-github-runner-207 kernel: [75200.571668] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 02:17:06 juju-e4d256-prod-github-runner-207 kernel: [75200.572858] Call Trace: Aug 23 02:17:06 juju-e4d256-prod-github-runner-207 kernel: [75200.573770] Aug 23 02:17:06 juju-e4d256-prod-github-runner-207 kernel: [75200.574652] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:17:06 juju-e4d256-prod-github-runner-207 kernel: [75200.575700] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:17:06 juju-e4d256-prod-github-runner-207 kernel: [75200.576721] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:17:06 juju-e4d256-prod-github-runner-207 kernel: [75200.577801] ? show_regs.part.0+0x23/0x29 Aug 23 02:17:06 juju-e4d256-prod-github-runner-207 kernel: [75200.578798] ? show_regs.cold+0x8/0xd Aug 23 02:17:06 juju-e4d256-prod-github-runner-207 kernel: [75200.579785] ? watchdog_timer_fn+0x1be/0x220 Aug 23 02:17:06 juju-e4d256-prod-github-runner-207 kernel: [75200.580795] ? lockup_detector_update_enable+0x60/0x60 Aug 23 02:17:06 juju-e4d256-prod-github-runner-207 kernel: [75200.582001] ? __hrtimer_run_queues+0x107/0x230 Aug 23 02:17:06 juju-e4d256-prod-github-runner-207 kernel: [75200.583029] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 02:17:06 juju-e4d256-prod-github-runner-207 kernel: [75200.584068] ? hrtimer_interrupt+0x101/0x220 Aug 23 02:17:06 juju-e4d256-prod-github-runner-207 kernel: [75200.585083] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 02:17:06 juju-e4d256-prod-github-runner-207 kernel: [75200.586152] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 02:17:06 juju-e4d256-prod-github-runner-207 kernel: [75200.587213] Aug 23 02:17:06 juju-e4d256-prod-github-runner-207 kernel: [75200.588067] Aug 23 02:17:06 juju-e4d256-prod-github-runner-207 kernel: [75200.588905] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 02:17:06 juju-e4d256-prod-github-runner-207 kernel: [75200.589939] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:17:06 juju-e4d256-prod-github-runner-207 kernel: [75200.590983] ? _raw_spin_lock+0x22/0x30 Aug 23 02:17:06 juju-e4d256-prod-github-runner-207 kernel: [75200.591937] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:17:06 juju-e4d256-prod-github-runner-207 kernel: [75200.592951] direct_page_fault+0x206/0x310 [kvm] Aug 23 02:17:06 juju-e4d256-prod-github-runner-207 kernel: [75200.593974] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 02:17:06 juju-e4d256-prod-github-runner-207 kernel: [75200.595020] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 02:17:06 juju-e4d256-prod-github-runner-207 kernel: [75200.596038] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 02:17:06 juju-e4d256-prod-github-runner-207 kernel: [75200.597015] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 02:17:06 juju-e4d256-prod-github-runner-207 kernel: [75200.597959] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 02:17:06 juju-e4d256-prod-github-runner-207 kernel: [75200.598935] handle_exit+0x98/0x230 [kvm_amd] Aug 23 02:17:06 juju-e4d256-prod-github-runner-207 kernel: [75200.599836] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 02:17:06 juju-e4d256-prod-github-runner-207 kernel: [75200.600749] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 02:17:06 juju-e4d256-prod-github-runner-207 kernel: [75200.601672] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 02:17:06 juju-e4d256-prod-github-runner-207 kernel: [75200.602579] vcpu_run+0x62/0x2c0 [kvm] Aug 23 02:17:06 juju-e4d256-prod-github-runner-207 kernel: [75200.603402] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 02:17:06 juju-e4d256-prod-github-runner-207 kernel: [75200.604211] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 02:17:06 juju-e4d256-prod-github-runner-207 kernel: [75200.605064] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 02:17:06 juju-e4d256-prod-github-runner-207 kernel: [75200.605866] ? __seccomp_filter+0x4a/0x4a0 Aug 23 02:17:06 juju-e4d256-prod-github-runner-207 kernel: [75200.606608] ? __fget_files+0x86/0xc0 Aug 23 02:17:06 juju-e4d256-prod-github-runner-207 kernel: [75200.607321] __x64_sys_ioctl+0x95/0xd0 Aug 23 02:17:06 juju-e4d256-prod-github-runner-207 kernel: [75200.608014] do_syscall_64+0x5c/0xc0 Aug 23 02:17:06 juju-e4d256-prod-github-runner-207 kernel: [75200.608677] ? do_futex+0x162/0x1f0 Aug 23 02:17:06 juju-e4d256-prod-github-runner-207 kernel: [75200.609328] ? __x64_sys_futex+0x78/0x1e0 Aug 23 02:17:06 juju-e4d256-prod-github-runner-207 kernel: [75200.610002] ? __secure_computing+0xa9/0x120 Aug 23 02:17:06 juju-e4d256-prod-github-runner-207 kernel: [75200.610692] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 02:17:06 juju-e4d256-prod-github-runner-207 kernel: [75200.611465] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:17:06 juju-e4d256-prod-github-runner-207 kernel: [75200.612188] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:17:06 juju-e4d256-prod-github-runner-207 kernel: [75200.612904] ? do_syscall_64+0x69/0xc0 Aug 23 02:17:06 juju-e4d256-prod-github-runner-207 kernel: [75200.613551] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:17:06 juju-e4d256-prod-github-runner-207 kernel: [75200.614254] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:17:06 juju-e4d256-prod-github-runner-207 kernel: [75200.614948] ? do_syscall_64+0x69/0xc0 Aug 23 02:17:06 juju-e4d256-prod-github-runner-207 kernel: [75200.615588] ? do_syscall_64+0x69/0xc0 Aug 23 02:17:06 juju-e4d256-prod-github-runner-207 kernel: [75200.616216] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 02:17:06 juju-e4d256-prod-github-runner-207 kernel: [75200.616919] RIP: 0033:0x7faa5d0edaff Aug 23 02:17:06 juju-e4d256-prod-github-runner-207 kernel: [75200.617549] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 02:17:06 juju-e4d256-prod-github-runner-207 kernel: [75200.619545] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 02:17:06 juju-e4d256-prod-github-runner-207 kernel: [75200.620460] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 02:17:06 juju-e4d256-prod-github-runner-207 kernel: [75200.621352] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 02:17:06 juju-e4d256-prod-github-runner-207 kernel: [75200.622237] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 02:17:06 juju-e4d256-prod-github-runner-207 kernel: [75200.623130] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 02:17:06 juju-e4d256-prod-github-runner-207 kernel: [75200.624019] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 02:17:06 juju-e4d256-prod-github-runner-207 kernel: [75200.624907] Aug 23 02:17:34 juju-e4d256-prod-github-runner-207 kernel: [75228.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 69954s! [qemu-system-x86:6715] Aug 23 02:17:34 juju-e4d256-prod-github-runner-207 kernel: [75228.543112] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 02:17:34 juju-e4d256-prod-github-runner-207 kernel: [75228.543179] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 02:17:34 juju-e4d256-prod-github-runner-207 kernel: [75228.555315] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 02:17:34 juju-e4d256-prod-github-runner-207 kernel: [75228.556580] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 02:17:34 juju-e4d256-prod-github-runner-207 kernel: [75228.557799] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:17:34 juju-e4d256-prod-github-runner-207 kernel: [75228.558880] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 02:17:34 juju-e4d256-prod-github-runner-207 kernel: [75228.561434] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 02:17:34 juju-e4d256-prod-github-runner-207 kernel: [75228.562479] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 02:17:34 juju-e4d256-prod-github-runner-207 kernel: [75228.563671] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 02:17:34 juju-e4d256-prod-github-runner-207 kernel: [75228.564835] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 02:17:34 juju-e4d256-prod-github-runner-207 kernel: [75228.565994] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 02:17:34 juju-e4d256-prod-github-runner-207 kernel: [75228.567172] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 02:17:34 juju-e4d256-prod-github-runner-207 kernel: [75228.568340] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 02:17:34 juju-e4d256-prod-github-runner-207 kernel: [75228.569580] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 02:17:34 juju-e4d256-prod-github-runner-207 kernel: [75228.570705] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 02:17:34 juju-e4d256-prod-github-runner-207 kernel: [75228.571933] Call Trace: Aug 23 02:17:34 juju-e4d256-prod-github-runner-207 kernel: [75228.572844] Aug 23 02:17:34 juju-e4d256-prod-github-runner-207 kernel: [75228.573729] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:17:34 juju-e4d256-prod-github-runner-207 kernel: [75228.574760] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:17:34 juju-e4d256-prod-github-runner-207 kernel: [75228.575803] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:17:34 juju-e4d256-prod-github-runner-207 kernel: [75228.576879] ? show_regs.part.0+0x23/0x29 Aug 23 02:17:34 juju-e4d256-prod-github-runner-207 kernel: [75228.577903] ? show_regs.cold+0x8/0xd Aug 23 02:17:34 juju-e4d256-prod-github-runner-207 kernel: [75228.578891] ? watchdog_timer_fn+0x1be/0x220 Aug 23 02:17:34 juju-e4d256-prod-github-runner-207 kernel: [75228.579904] ? lockup_detector_update_enable+0x60/0x60 Aug 23 02:17:34 juju-e4d256-prod-github-runner-207 kernel: [75228.581081] ? __hrtimer_run_queues+0x107/0x230 Aug 23 02:17:34 juju-e4d256-prod-github-runner-207 kernel: [75228.582125] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 02:17:34 juju-e4d256-prod-github-runner-207 kernel: [75228.583213] ? hrtimer_interrupt+0x101/0x220 Aug 23 02:17:34 juju-e4d256-prod-github-runner-207 kernel: [75228.584319] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 02:17:34 juju-e4d256-prod-github-runner-207 kernel: [75228.585402] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 02:17:34 juju-e4d256-prod-github-runner-207 kernel: [75228.586488] Aug 23 02:17:34 juju-e4d256-prod-github-runner-207 kernel: [75228.587382] Aug 23 02:17:34 juju-e4d256-prod-github-runner-207 kernel: [75228.588225] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 02:17:34 juju-e4d256-prod-github-runner-207 kernel: [75228.589293] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:17:34 juju-e4d256-prod-github-runner-207 kernel: [75228.590395] ? _raw_spin_lock+0x22/0x30 Aug 23 02:17:34 juju-e4d256-prod-github-runner-207 kernel: [75228.591381] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:17:34 juju-e4d256-prod-github-runner-207 kernel: [75228.592478] direct_page_fault+0x206/0x310 [kvm] Aug 23 02:17:34 juju-e4d256-prod-github-runner-207 kernel: [75228.593518] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 02:17:34 juju-e4d256-prod-github-runner-207 kernel: [75228.594590] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 02:17:34 juju-e4d256-prod-github-runner-207 kernel: [75228.595655] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 02:17:34 juju-e4d256-prod-github-runner-207 kernel: [75228.596640] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 02:17:34 juju-e4d256-prod-github-runner-207 kernel: [75228.597594] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 02:17:34 juju-e4d256-prod-github-runner-207 kernel: [75228.598608] handle_exit+0x98/0x230 [kvm_amd] Aug 23 02:17:34 juju-e4d256-prod-github-runner-207 kernel: [75228.599566] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 02:17:34 juju-e4d256-prod-github-runner-207 kernel: [75228.600536] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 02:17:34 juju-e4d256-prod-github-runner-207 kernel: [75228.601466] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 02:17:34 juju-e4d256-prod-github-runner-207 kernel: [75228.602371] vcpu_run+0x62/0x2c0 [kvm] Aug 23 02:17:34 juju-e4d256-prod-github-runner-207 kernel: [75228.603228] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 02:17:34 juju-e4d256-prod-github-runner-207 kernel: [75228.604054] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 02:17:34 juju-e4d256-prod-github-runner-207 kernel: [75228.604953] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 02:17:34 juju-e4d256-prod-github-runner-207 kernel: [75228.605762] ? __seccomp_filter+0x4a/0x4a0 Aug 23 02:17:34 juju-e4d256-prod-github-runner-207 kernel: [75228.606518] ? __fget_files+0x86/0xc0 Aug 23 02:17:34 juju-e4d256-prod-github-runner-207 kernel: [75228.607277] __x64_sys_ioctl+0x95/0xd0 Aug 23 02:17:34 juju-e4d256-prod-github-runner-207 kernel: [75228.607989] do_syscall_64+0x5c/0xc0 Aug 23 02:17:34 juju-e4d256-prod-github-runner-207 kernel: [75228.608670] ? do_futex+0x162/0x1f0 Aug 23 02:17:34 juju-e4d256-prod-github-runner-207 kernel: [75228.609350] ? __x64_sys_futex+0x78/0x1e0 Aug 23 02:17:34 juju-e4d256-prod-github-runner-207 kernel: [75228.610033] ? __secure_computing+0xa9/0x120 Aug 23 02:17:34 juju-e4d256-prod-github-runner-207 kernel: [75228.610747] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 02:17:34 juju-e4d256-prod-github-runner-207 kernel: [75228.611536] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:17:34 juju-e4d256-prod-github-runner-207 kernel: [75228.612274] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:17:34 juju-e4d256-prod-github-runner-207 kernel: [75228.613011] ? do_syscall_64+0x69/0xc0 Aug 23 02:17:34 juju-e4d256-prod-github-runner-207 kernel: [75228.613658] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:17:34 juju-e4d256-prod-github-runner-207 kernel: [75228.614383] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:17:34 juju-e4d256-prod-github-runner-207 kernel: [75228.615135] ? do_syscall_64+0x69/0xc0 Aug 23 02:17:34 juju-e4d256-prod-github-runner-207 kernel: [75228.615778] ? do_syscall_64+0x69/0xc0 Aug 23 02:17:34 juju-e4d256-prod-github-runner-207 kernel: [75228.616440] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 02:17:34 juju-e4d256-prod-github-runner-207 kernel: [75228.617196] RIP: 0033:0x7faa5d0edaff Aug 23 02:17:34 juju-e4d256-prod-github-runner-207 kernel: [75228.617852] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 02:17:34 juju-e4d256-prod-github-runner-207 kernel: [75228.619953] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 02:17:34 juju-e4d256-prod-github-runner-207 kernel: [75228.620925] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 02:17:34 juju-e4d256-prod-github-runner-207 kernel: [75228.621847] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 02:17:34 juju-e4d256-prod-github-runner-207 kernel: [75228.622760] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 02:17:34 juju-e4d256-prod-github-runner-207 kernel: [75228.623690] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 02:17:34 juju-e4d256-prod-github-runner-207 kernel: [75228.624619] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 02:17:34 juju-e4d256-prod-github-runner-207 kernel: [75228.625540] Aug 23 02:17:48 juju-e4d256-prod-github-runner-207 kernel: [75242.204708] rcu: INFO: rcu_sched self-detected stall on CPU Aug 23 02:17:48 juju-e4d256-prod-github-runner-207 kernel: [75242.205712] rcu: 1-....: (18722234 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=9049290 Aug 23 02:17:48 juju-e4d256-prod-github-runner-207 kernel: [75242.206848] (t=18781251 jiffies g=23269 q=63744) Aug 23 02:17:48 juju-e4d256-prod-github-runner-207 kernel: [75242.207636] NMI backtrace for cpu 1 Aug 23 02:17:48 juju-e4d256-prod-github-runner-207 kernel: [75242.208350] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 02:17:48 juju-e4d256-prod-github-runner-207 kernel: [75242.209450] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 02:17:48 juju-e4d256-prod-github-runner-207 kernel: [75242.210507] Call Trace: Aug 23 02:17:48 juju-e4d256-prod-github-runner-207 kernel: [75242.211324] Aug 23 02:17:48 juju-e4d256-prod-github-runner-207 kernel: [75242.211974] show_stack+0x52/0x5c Aug 23 02:17:48 juju-e4d256-prod-github-runner-207 kernel: [75242.212699] dump_stack_lvl+0x4a/0x63 Aug 23 02:17:48 juju-e4d256-prod-github-runner-207 kernel: [75242.213444] dump_stack+0x10/0x16 Aug 23 02:17:48 juju-e4d256-prod-github-runner-207 kernel: [75242.214166] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 23 02:17:48 juju-e4d256-prod-github-runner-207 kernel: [75242.215102] ? lapic_can_unplug_cpu+0x90/0x90 Aug 23 02:17:48 juju-e4d256-prod-github-runner-207 kernel: [75242.215944] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 23 02:17:48 juju-e4d256-prod-github-runner-207 kernel: [75242.216766] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 23 02:17:48 juju-e4d256-prod-github-runner-207 kernel: [75242.217588] trigger_single_cpu_backtrace+0x44/0x4f Aug 23 02:17:48 juju-e4d256-prod-github-runner-207 kernel: [75242.218419] rcu_dump_cpu_stacks+0x102/0x149 Aug 23 02:17:48 juju-e4d256-prod-github-runner-207 kernel: [75242.219215] print_cpu_stall.cold+0x2f/0xe2 Aug 23 02:17:48 juju-e4d256-prod-github-runner-207 kernel: [75242.219986] ? timekeeping_update+0xf7/0x150 Aug 23 02:17:48 juju-e4d256-prod-github-runner-207 kernel: [75242.220755] check_cpu_stall+0x109/0x270 Aug 23 02:17:48 juju-e4d256-prod-github-runner-207 kernel: [75242.221499] rcu_sched_clock_irq+0x9a/0x250 Aug 23 02:17:48 juju-e4d256-prod-github-runner-207 kernel: [75242.222258] update_process_times+0x94/0xd0 Aug 23 02:17:48 juju-e4d256-prod-github-runner-207 kernel: [75242.223046] tick_sched_handle+0x29/0x70 Aug 23 02:17:48 juju-e4d256-prod-github-runner-207 kernel: [75242.223801] tick_sched_timer+0x8c/0xc0 Aug 23 02:17:48 juju-e4d256-prod-github-runner-207 kernel: [75242.224537] ? tick_nohz_handler+0xb0/0xb0 Aug 23 02:17:48 juju-e4d256-prod-github-runner-207 kernel: [75242.225291] __hrtimer_run_queues+0x107/0x230 Aug 23 02:17:48 juju-e4d256-prod-github-runner-207 kernel: [75242.226066] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 02:17:48 juju-e4d256-prod-github-runner-207 kernel: [75242.226852] hrtimer_interrupt+0x101/0x220 Aug 23 02:17:48 juju-e4d256-prod-github-runner-207 kernel: [75242.227609] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 02:17:48 juju-e4d256-prod-github-runner-207 kernel: [75242.228423] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 02:17:48 juju-e4d256-prod-github-runner-207 kernel: [75242.229227] Aug 23 02:17:48 juju-e4d256-prod-github-runner-207 kernel: [75242.229869] Aug 23 02:17:48 juju-e4d256-prod-github-runner-207 kernel: [75242.230497] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 02:17:48 juju-e4d256-prod-github-runner-207 kernel: [75242.231323] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:17:48 juju-e4d256-prod-github-runner-207 kernel: [75242.232200] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 02:17:48 juju-e4d256-prod-github-runner-207 kernel: [75242.234419] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 02:17:48 juju-e4d256-prod-github-runner-207 kernel: [75242.235311] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 02:17:48 juju-e4d256-prod-github-runner-207 kernel: [75242.236309] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 02:17:48 juju-e4d256-prod-github-runner-207 kernel: [75242.237286] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 02:17:48 juju-e4d256-prod-github-runner-207 kernel: [75242.238249] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 02:17:48 juju-e4d256-prod-github-runner-207 kernel: [75242.239217] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 02:17:48 juju-e4d256-prod-github-runner-207 kernel: [75242.240169] ? _raw_spin_lock+0x22/0x30 Aug 23 02:17:48 juju-e4d256-prod-github-runner-207 kernel: [75242.240928] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:17:48 juju-e4d256-prod-github-runner-207 kernel: [75242.241772] direct_page_fault+0x206/0x310 [kvm] Aug 23 02:17:48 juju-e4d256-prod-github-runner-207 kernel: [75242.242607] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 02:17:48 juju-e4d256-prod-github-runner-207 kernel: [75242.243443] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 02:17:48 juju-e4d256-prod-github-runner-207 kernel: [75242.244266] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 02:17:48 juju-e4d256-prod-github-runner-207 kernel: [75242.245100] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 02:17:48 juju-e4d256-prod-github-runner-207 kernel: [75242.245890] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 02:17:48 juju-e4d256-prod-github-runner-207 kernel: [75242.246742] handle_exit+0x98/0x230 [kvm_amd] Aug 23 02:17:48 juju-e4d256-prod-github-runner-207 kernel: [75242.247499] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 02:17:48 juju-e4d256-prod-github-runner-207 kernel: [75242.248282] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 02:17:48 juju-e4d256-prod-github-runner-207 kernel: [75242.249087] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 02:17:48 juju-e4d256-prod-github-runner-207 kernel: [75242.249873] vcpu_run+0x62/0x2c0 [kvm] Aug 23 02:17:48 juju-e4d256-prod-github-runner-207 kernel: [75242.250645] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 02:17:48 juju-e4d256-prod-github-runner-207 kernel: [75242.251382] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 02:17:48 juju-e4d256-prod-github-runner-207 kernel: [75242.252191] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 02:17:48 juju-e4d256-prod-github-runner-207 kernel: [75242.252951] ? __seccomp_filter+0x4a/0x4a0 Aug 23 02:17:48 juju-e4d256-prod-github-runner-207 kernel: [75242.253669] ? __fget_files+0x86/0xc0 Aug 23 02:17:48 juju-e4d256-prod-github-runner-207 kernel: [75242.254361] __x64_sys_ioctl+0x95/0xd0 Aug 23 02:17:48 juju-e4d256-prod-github-runner-207 kernel: [75242.255072] do_syscall_64+0x5c/0xc0 Aug 23 02:17:48 juju-e4d256-prod-github-runner-207 kernel: [75242.255753] ? do_futex+0x162/0x1f0 Aug 23 02:17:48 juju-e4d256-prod-github-runner-207 kernel: [75242.256422] ? __x64_sys_futex+0x78/0x1e0 Aug 23 02:17:48 juju-e4d256-prod-github-runner-207 kernel: [75242.257120] ? __secure_computing+0xa9/0x120 Aug 23 02:17:48 juju-e4d256-prod-github-runner-207 kernel: [75242.257835] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 02:17:48 juju-e4d256-prod-github-runner-207 kernel: [75242.258633] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:17:48 juju-e4d256-prod-github-runner-207 kernel: [75242.259388] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:17:48 juju-e4d256-prod-github-runner-207 kernel: [75242.260142] ? do_syscall_64+0x69/0xc0 Aug 23 02:17:48 juju-e4d256-prod-github-runner-207 kernel: [75242.260831] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:17:48 juju-e4d256-prod-github-runner-207 kernel: [75242.261584] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:17:48 juju-e4d256-prod-github-runner-207 kernel: [75242.262339] ? do_syscall_64+0x69/0xc0 Aug 23 02:17:48 juju-e4d256-prod-github-runner-207 kernel: [75242.263038] ? do_syscall_64+0x69/0xc0 Aug 23 02:17:48 juju-e4d256-prod-github-runner-207 kernel: [75242.263749] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 02:17:48 juju-e4d256-prod-github-runner-207 kernel: [75242.264531] RIP: 0033:0x7faa5d0edaff Aug 23 02:17:48 juju-e4d256-prod-github-runner-207 kernel: [75242.265219] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 02:17:48 juju-e4d256-prod-github-runner-207 kernel: [75242.267351] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 02:17:48 juju-e4d256-prod-github-runner-207 kernel: [75242.268308] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 02:17:48 juju-e4d256-prod-github-runner-207 kernel: [75242.269251] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 02:17:48 juju-e4d256-prod-github-runner-207 kernel: [75242.270191] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 02:17:48 juju-e4d256-prod-github-runner-207 kernel: [75242.271140] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 02:17:48 juju-e4d256-prod-github-runner-207 kernel: [75242.272062] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 02:17:48 juju-e4d256-prod-github-runner-207 kernel: [75242.272972] Aug 23 02:18:14 juju-e4d256-prod-github-runner-207 kernel: [75268.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 69991s! [qemu-system-x86:6715] Aug 23 02:18:14 juju-e4d256-prod-github-runner-207 kernel: [75268.543199] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 02:18:14 juju-e4d256-prod-github-runner-207 kernel: [75268.543386] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 02:18:14 juju-e4d256-prod-github-runner-207 kernel: [75268.555554] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 02:18:14 juju-e4d256-prod-github-runner-207 kernel: [75268.556826] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 02:18:14 juju-e4d256-prod-github-runner-207 kernel: [75268.558054] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:18:14 juju-e4d256-prod-github-runner-207 kernel: [75268.559125] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 02:18:14 juju-e4d256-prod-github-runner-207 kernel: [75268.561680] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 02:18:14 juju-e4d256-prod-github-runner-207 kernel: [75268.562735] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 02:18:14 juju-e4d256-prod-github-runner-207 kernel: [75268.563919] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 02:18:14 juju-e4d256-prod-github-runner-207 kernel: [75268.565078] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 02:18:14 juju-e4d256-prod-github-runner-207 kernel: [75268.566331] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 02:18:14 juju-e4d256-prod-github-runner-207 kernel: [75268.567502] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 02:18:14 juju-e4d256-prod-github-runner-207 kernel: [75268.568709] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 02:18:14 juju-e4d256-prod-github-runner-207 kernel: [75268.569947] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 02:18:14 juju-e4d256-prod-github-runner-207 kernel: [75268.571058] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 02:18:14 juju-e4d256-prod-github-runner-207 kernel: [75268.572259] Call Trace: Aug 23 02:18:14 juju-e4d256-prod-github-runner-207 kernel: [75268.573170] Aug 23 02:18:14 juju-e4d256-prod-github-runner-207 kernel: [75268.574053] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:18:14 juju-e4d256-prod-github-runner-207 kernel: [75268.575101] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:18:14 juju-e4d256-prod-github-runner-207 kernel: [75268.576125] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:18:14 juju-e4d256-prod-github-runner-207 kernel: [75268.577221] ? show_regs.part.0+0x23/0x29 Aug 23 02:18:14 juju-e4d256-prod-github-runner-207 kernel: [75268.578217] ? show_regs.cold+0x8/0xd Aug 23 02:18:14 juju-e4d256-prod-github-runner-207 kernel: [75268.579203] ? watchdog_timer_fn+0x1be/0x220 Aug 23 02:18:14 juju-e4d256-prod-github-runner-207 kernel: [75268.580214] ? lockup_detector_update_enable+0x60/0x60 Aug 23 02:18:14 juju-e4d256-prod-github-runner-207 kernel: [75268.581275] ? __hrtimer_run_queues+0x107/0x230 Aug 23 02:18:14 juju-e4d256-prod-github-runner-207 kernel: [75268.582300] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 02:18:14 juju-e4d256-prod-github-runner-207 kernel: [75268.583332] ? hrtimer_interrupt+0x101/0x220 Aug 23 02:18:14 juju-e4d256-prod-github-runner-207 kernel: [75268.584350] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 02:18:14 juju-e4d256-prod-github-runner-207 kernel: [75268.585423] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 02:18:14 juju-e4d256-prod-github-runner-207 kernel: [75268.586492] Aug 23 02:18:14 juju-e4d256-prod-github-runner-207 kernel: [75268.587345] Aug 23 02:18:14 juju-e4d256-prod-github-runner-207 kernel: [75268.588189] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 02:18:14 juju-e4d256-prod-github-runner-207 kernel: [75268.589226] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:18:14 juju-e4d256-prod-github-runner-207 kernel: [75268.590264] ? _raw_spin_lock+0x22/0x30 Aug 23 02:18:14 juju-e4d256-prod-github-runner-207 kernel: [75268.591224] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:18:14 juju-e4d256-prod-github-runner-207 kernel: [75268.592245] direct_page_fault+0x206/0x310 [kvm] Aug 23 02:18:14 juju-e4d256-prod-github-runner-207 kernel: [75268.593275] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 02:18:14 juju-e4d256-prod-github-runner-207 kernel: [75268.594283] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 02:18:14 juju-e4d256-prod-github-runner-207 kernel: [75268.595298] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 02:18:14 juju-e4d256-prod-github-runner-207 kernel: [75268.596286] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 02:18:14 juju-e4d256-prod-github-runner-207 kernel: [75268.597236] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 02:18:14 juju-e4d256-prod-github-runner-207 kernel: [75268.598220] handle_exit+0x98/0x230 [kvm_amd] Aug 23 02:18:14 juju-e4d256-prod-github-runner-207 kernel: [75268.599126] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 02:18:14 juju-e4d256-prod-github-runner-207 kernel: [75268.600041] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 02:18:14 juju-e4d256-prod-github-runner-207 kernel: [75268.600967] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 02:18:14 juju-e4d256-prod-github-runner-207 kernel: [75268.601874] vcpu_run+0x62/0x2c0 [kvm] Aug 23 02:18:14 juju-e4d256-prod-github-runner-207 kernel: [75268.602702] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 02:18:14 juju-e4d256-prod-github-runner-207 kernel: [75268.603544] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 02:18:14 juju-e4d256-prod-github-runner-207 kernel: [75268.604402] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 02:18:14 juju-e4d256-prod-github-runner-207 kernel: [75268.605203] ? __seccomp_filter+0x4a/0x4a0 Aug 23 02:18:14 juju-e4d256-prod-github-runner-207 kernel: [75268.605946] ? __fget_files+0x86/0xc0 Aug 23 02:18:14 juju-e4d256-prod-github-runner-207 kernel: [75268.606662] __x64_sys_ioctl+0x95/0xd0 Aug 23 02:18:14 juju-e4d256-prod-github-runner-207 kernel: [75268.607385] do_syscall_64+0x5c/0xc0 Aug 23 02:18:14 juju-e4d256-prod-github-runner-207 kernel: [75268.608055] ? do_futex+0x162/0x1f0 Aug 23 02:18:14 juju-e4d256-prod-github-runner-207 kernel: [75268.608702] ? __x64_sys_futex+0x78/0x1e0 Aug 23 02:18:14 juju-e4d256-prod-github-runner-207 kernel: [75268.609381] ? __secure_computing+0xa9/0x120 Aug 23 02:18:14 juju-e4d256-prod-github-runner-207 kernel: [75268.610100] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 02:18:14 juju-e4d256-prod-github-runner-207 kernel: [75268.610875] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:18:14 juju-e4d256-prod-github-runner-207 kernel: [75268.611639] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:18:14 juju-e4d256-prod-github-runner-207 kernel: [75268.612355] ? do_syscall_64+0x69/0xc0 Aug 23 02:18:14 juju-e4d256-prod-github-runner-207 kernel: [75268.613004] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:18:14 juju-e4d256-prod-github-runner-207 kernel: [75268.613714] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:18:14 juju-e4d256-prod-github-runner-207 kernel: [75268.614424] ? do_syscall_64+0x69/0xc0 Aug 23 02:18:14 juju-e4d256-prod-github-runner-207 kernel: [75268.615048] ? do_syscall_64+0x69/0xc0 Aug 23 02:18:14 juju-e4d256-prod-github-runner-207 kernel: [75268.615670] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 02:18:14 juju-e4d256-prod-github-runner-207 kernel: [75268.616379] RIP: 0033:0x7faa5d0edaff Aug 23 02:18:14 juju-e4d256-prod-github-runner-207 kernel: [75268.617025] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 02:18:14 juju-e4d256-prod-github-runner-207 kernel: [75268.619022] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 02:18:14 juju-e4d256-prod-github-runner-207 kernel: [75268.619933] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 02:18:14 juju-e4d256-prod-github-runner-207 kernel: [75268.620860] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 02:18:14 juju-e4d256-prod-github-runner-207 kernel: [75268.621754] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 02:18:14 juju-e4d256-prod-github-runner-207 kernel: [75268.622656] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 02:18:14 juju-e4d256-prod-github-runner-207 kernel: [75268.623550] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 02:18:14 juju-e4d256-prod-github-runner-207 kernel: [75268.624440] Aug 23 02:18:42 juju-e4d256-prod-github-runner-207 kernel: [75296.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 70017s! [qemu-system-x86:6715] Aug 23 02:18:42 juju-e4d256-prod-github-runner-207 kernel: [75296.543769] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 02:18:42 juju-e4d256-prod-github-runner-207 kernel: [75296.543942] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 02:18:42 juju-e4d256-prod-github-runner-207 kernel: [75296.556204] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 02:18:42 juju-e4d256-prod-github-runner-207 kernel: [75296.557481] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 02:18:42 juju-e4d256-prod-github-runner-207 kernel: [75296.558782] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:18:42 juju-e4d256-prod-github-runner-207 kernel: [75296.559849] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 02:18:42 juju-e4d256-prod-github-runner-207 kernel: [75296.562486] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 02:18:42 juju-e4d256-prod-github-runner-207 kernel: [75296.563531] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 02:18:42 juju-e4d256-prod-github-runner-207 kernel: [75296.564697] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 02:18:42 juju-e4d256-prod-github-runner-207 kernel: [75296.565882] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 02:18:42 juju-e4d256-prod-github-runner-207 kernel: [75296.567123] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 02:18:42 juju-e4d256-prod-github-runner-207 kernel: [75296.568307] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 02:18:42 juju-e4d256-prod-github-runner-207 kernel: [75296.569481] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 02:18:42 juju-e4d256-prod-github-runner-207 kernel: [75296.570896] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 02:18:42 juju-e4d256-prod-github-runner-207 kernel: [75296.571996] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 02:18:42 juju-e4d256-prod-github-runner-207 kernel: [75296.573192] Call Trace: Aug 23 02:18:42 juju-e4d256-prod-github-runner-207 kernel: [75296.574146] Aug 23 02:18:42 juju-e4d256-prod-github-runner-207 kernel: [75296.575104] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:18:42 juju-e4d256-prod-github-runner-207 kernel: [75296.576135] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:18:42 juju-e4d256-prod-github-runner-207 kernel: [75296.577156] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:18:42 juju-e4d256-prod-github-runner-207 kernel: [75296.578313] ? show_regs.part.0+0x23/0x29 Aug 23 02:18:42 juju-e4d256-prod-github-runner-207 kernel: [75296.579335] ? show_regs.cold+0x8/0xd Aug 23 02:18:42 juju-e4d256-prod-github-runner-207 kernel: [75296.580312] ? watchdog_timer_fn+0x1be/0x220 Aug 23 02:18:42 juju-e4d256-prod-github-runner-207 kernel: [75296.581326] ? lockup_detector_update_enable+0x60/0x60 Aug 23 02:18:42 juju-e4d256-prod-github-runner-207 kernel: [75296.582484] ? __hrtimer_run_queues+0x107/0x230 Aug 23 02:18:42 juju-e4d256-prod-github-runner-207 kernel: [75296.583520] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 02:18:42 juju-e4d256-prod-github-runner-207 kernel: [75296.584548] ? hrtimer_interrupt+0x101/0x220 Aug 23 02:18:42 juju-e4d256-prod-github-runner-207 kernel: [75296.585564] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 02:18:42 juju-e4d256-prod-github-runner-207 kernel: [75296.586740] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 02:18:42 juju-e4d256-prod-github-runner-207 kernel: [75296.587795] Aug 23 02:18:42 juju-e4d256-prod-github-runner-207 kernel: [75296.588654] Aug 23 02:18:42 juju-e4d256-prod-github-runner-207 kernel: [75296.589494] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 02:18:42 juju-e4d256-prod-github-runner-207 kernel: [75296.590726] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:18:42 juju-e4d256-prod-github-runner-207 kernel: [75296.591789] ? _raw_spin_lock+0x22/0x30 Aug 23 02:18:42 juju-e4d256-prod-github-runner-207 kernel: [75296.592738] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:18:42 juju-e4d256-prod-github-runner-207 kernel: [75296.593766] direct_page_fault+0x206/0x310 [kvm] Aug 23 02:18:42 juju-e4d256-prod-github-runner-207 kernel: [75296.594977] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 02:18:42 juju-e4d256-prod-github-runner-207 kernel: [75296.596007] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 02:18:42 juju-e4d256-prod-github-runner-207 kernel: [75296.597201] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 02:18:42 juju-e4d256-prod-github-runner-207 kernel: [75296.598317] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 02:18:42 juju-e4d256-prod-github-runner-207 kernel: [75296.599352] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 02:18:42 juju-e4d256-prod-github-runner-207 kernel: [75296.600336] handle_exit+0x98/0x230 [kvm_amd] Aug 23 02:18:42 juju-e4d256-prod-github-runner-207 kernel: [75296.601229] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 02:18:42 juju-e4d256-prod-github-runner-207 kernel: [75296.602198] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 02:18:42 juju-e4d256-prod-github-runner-207 kernel: [75296.603173] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 02:18:42 juju-e4d256-prod-github-runner-207 kernel: [75296.604082] vcpu_run+0x62/0x2c0 [kvm] Aug 23 02:18:42 juju-e4d256-prod-github-runner-207 kernel: [75296.604897] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 02:18:42 juju-e4d256-prod-github-runner-207 kernel: [75296.605707] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 02:18:42 juju-e4d256-prod-github-runner-207 kernel: [75296.606646] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 02:18:42 juju-e4d256-prod-github-runner-207 kernel: [75296.607447] ? __seccomp_filter+0x4a/0x4a0 Aug 23 02:18:42 juju-e4d256-prod-github-runner-207 kernel: [75296.608190] ? __fget_files+0x86/0xc0 Aug 23 02:18:42 juju-e4d256-prod-github-runner-207 kernel: [75296.608894] __x64_sys_ioctl+0x95/0xd0 Aug 23 02:18:42 juju-e4d256-prod-github-runner-207 kernel: [75296.609588] do_syscall_64+0x5c/0xc0 Aug 23 02:18:42 juju-e4d256-prod-github-runner-207 kernel: [75296.610345] ? do_futex+0x162/0x1f0 Aug 23 02:18:42 juju-e4d256-prod-github-runner-207 kernel: [75296.611000] ? __x64_sys_futex+0x78/0x1e0 Aug 23 02:18:42 juju-e4d256-prod-github-runner-207 kernel: [75296.611679] ? __secure_computing+0xa9/0x120 Aug 23 02:18:42 juju-e4d256-prod-github-runner-207 kernel: [75296.612369] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 02:18:42 juju-e4d256-prod-github-runner-207 kernel: [75296.613168] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:18:42 juju-e4d256-prod-github-runner-207 kernel: [75296.613927] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:18:42 juju-e4d256-prod-github-runner-207 kernel: [75296.614707] ? do_syscall_64+0x69/0xc0 Aug 23 02:18:42 juju-e4d256-prod-github-runner-207 kernel: [75296.615353] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:18:42 juju-e4d256-prod-github-runner-207 kernel: [75296.616059] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:18:42 juju-e4d256-prod-github-runner-207 kernel: [75296.616764] ? do_syscall_64+0x69/0xc0 Aug 23 02:18:42 juju-e4d256-prod-github-runner-207 kernel: [75296.617391] ? do_syscall_64+0x69/0xc0 Aug 23 02:18:42 juju-e4d256-prod-github-runner-207 kernel: [75296.618032] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 02:18:42 juju-e4d256-prod-github-runner-207 kernel: [75296.618820] RIP: 0033:0x7faa5d0edaff Aug 23 02:18:42 juju-e4d256-prod-github-runner-207 kernel: [75296.619468] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 02:18:42 juju-e4d256-prod-github-runner-207 kernel: [75296.621462] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 02:18:42 juju-e4d256-prod-github-runner-207 kernel: [75296.622458] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 02:18:42 juju-e4d256-prod-github-runner-207 kernel: [75296.623354] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 02:18:42 juju-e4d256-prod-github-runner-207 kernel: [75296.624245] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 02:18:42 juju-e4d256-prod-github-runner-207 kernel: [75296.625134] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 02:18:42 juju-e4d256-prod-github-runner-207 kernel: [75296.626069] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 02:18:42 juju-e4d256-prod-github-runner-207 kernel: [75296.627042] Aug 23 02:19:10 juju-e4d256-prod-github-runner-207 kernel: [75324.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 70043s! [qemu-system-x86:6715] Aug 23 02:19:10 juju-e4d256-prod-github-runner-207 kernel: [75324.543109] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 02:19:10 juju-e4d256-prod-github-runner-207 kernel: [75324.543177] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 02:19:10 juju-e4d256-prod-github-runner-207 kernel: [75324.555252] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 02:19:10 juju-e4d256-prod-github-runner-207 kernel: [75324.556520] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 02:19:10 juju-e4d256-prod-github-runner-207 kernel: [75324.557747] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:19:10 juju-e4d256-prod-github-runner-207 kernel: [75324.558800] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 02:19:10 juju-e4d256-prod-github-runner-207 kernel: [75324.561337] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 02:19:10 juju-e4d256-prod-github-runner-207 kernel: [75324.562392] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 02:19:10 juju-e4d256-prod-github-runner-207 kernel: [75324.563557] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 02:19:10 juju-e4d256-prod-github-runner-207 kernel: [75324.564716] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 02:19:10 juju-e4d256-prod-github-runner-207 kernel: [75324.565882] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 02:19:10 juju-e4d256-prod-github-runner-207 kernel: [75324.567048] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 02:19:10 juju-e4d256-prod-github-runner-207 kernel: [75324.568216] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 02:19:10 juju-e4d256-prod-github-runner-207 kernel: [75324.569449] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 02:19:10 juju-e4d256-prod-github-runner-207 kernel: [75324.570556] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 02:19:10 juju-e4d256-prod-github-runner-207 kernel: [75324.571748] Call Trace: Aug 23 02:19:10 juju-e4d256-prod-github-runner-207 kernel: [75324.572835] Aug 23 02:19:10 juju-e4d256-prod-github-runner-207 kernel: [75324.573731] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:19:10 juju-e4d256-prod-github-runner-207 kernel: [75324.574761] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:19:10 juju-e4d256-prod-github-runner-207 kernel: [75324.575916] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:19:10 juju-e4d256-prod-github-runner-207 kernel: [75324.576992] ? show_regs.part.0+0x23/0x29 Aug 23 02:19:10 juju-e4d256-prod-github-runner-207 kernel: [75324.577998] ? show_regs.cold+0x8/0xd Aug 23 02:19:10 juju-e4d256-prod-github-runner-207 kernel: [75324.578972] ? watchdog_timer_fn+0x1be/0x220 Aug 23 02:19:10 juju-e4d256-prod-github-runner-207 kernel: [75324.579978] ? lockup_detector_update_enable+0x60/0x60 Aug 23 02:19:10 juju-e4d256-prod-github-runner-207 kernel: [75324.581040] ? __hrtimer_run_queues+0x107/0x230 Aug 23 02:19:10 juju-e4d256-prod-github-runner-207 kernel: [75324.582078] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 02:19:10 juju-e4d256-prod-github-runner-207 kernel: [75324.583115] ? hrtimer_interrupt+0x101/0x220 Aug 23 02:19:10 juju-e4d256-prod-github-runner-207 kernel: [75324.584139] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 02:19:10 juju-e4d256-prod-github-runner-207 kernel: [75324.585208] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 02:19:10 juju-e4d256-prod-github-runner-207 kernel: [75324.586266] Aug 23 02:19:10 juju-e4d256-prod-github-runner-207 kernel: [75324.587118] Aug 23 02:19:10 juju-e4d256-prod-github-runner-207 kernel: [75324.587960] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 02:19:10 juju-e4d256-prod-github-runner-207 kernel: [75324.588993] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:19:10 juju-e4d256-prod-github-runner-207 kernel: [75324.590038] ? _raw_spin_lock+0x22/0x30 Aug 23 02:19:10 juju-e4d256-prod-github-runner-207 kernel: [75324.590983] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:19:10 juju-e4d256-prod-github-runner-207 kernel: [75324.592000] direct_page_fault+0x206/0x310 [kvm] Aug 23 02:19:10 juju-e4d256-prod-github-runner-207 kernel: [75324.593027] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 02:19:10 juju-e4d256-prod-github-runner-207 kernel: [75324.594043] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 02:19:10 juju-e4d256-prod-github-runner-207 kernel: [75324.595046] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 02:19:10 juju-e4d256-prod-github-runner-207 kernel: [75324.596018] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 02:19:10 juju-e4d256-prod-github-runner-207 kernel: [75324.596968] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 02:19:10 juju-e4d256-prod-github-runner-207 kernel: [75324.597961] handle_exit+0x98/0x230 [kvm_amd] Aug 23 02:19:10 juju-e4d256-prod-github-runner-207 kernel: [75324.598853] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 02:19:10 juju-e4d256-prod-github-runner-207 kernel: [75324.599766] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 02:19:10 juju-e4d256-prod-github-runner-207 kernel: [75324.600687] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 02:19:10 juju-e4d256-prod-github-runner-207 kernel: [75324.601588] vcpu_run+0x62/0x2c0 [kvm] Aug 23 02:19:10 juju-e4d256-prod-github-runner-207 kernel: [75324.602406] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 02:19:10 juju-e4d256-prod-github-runner-207 kernel: [75324.603219] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 02:19:10 juju-e4d256-prod-github-runner-207 kernel: [75324.604071] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 02:19:10 juju-e4d256-prod-github-runner-207 kernel: [75324.604865] ? __seccomp_filter+0x4a/0x4a0 Aug 23 02:19:10 juju-e4d256-prod-github-runner-207 kernel: [75324.605608] ? __fget_files+0x86/0xc0 Aug 23 02:19:10 juju-e4d256-prod-github-runner-207 kernel: [75324.606318] __x64_sys_ioctl+0x95/0xd0 Aug 23 02:19:10 juju-e4d256-prod-github-runner-207 kernel: [75324.607009] do_syscall_64+0x5c/0xc0 Aug 23 02:19:10 juju-e4d256-prod-github-runner-207 kernel: [75324.607671] ? do_futex+0x162/0x1f0 Aug 23 02:19:10 juju-e4d256-prod-github-runner-207 kernel: [75324.608318] ? __x64_sys_futex+0x78/0x1e0 Aug 23 02:19:10 juju-e4d256-prod-github-runner-207 kernel: [75324.608991] ? __secure_computing+0xa9/0x120 Aug 23 02:19:10 juju-e4d256-prod-github-runner-207 kernel: [75324.609724] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 02:19:10 juju-e4d256-prod-github-runner-207 kernel: [75324.610485] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:19:10 juju-e4d256-prod-github-runner-207 kernel: [75324.611206] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:19:10 juju-e4d256-prod-github-runner-207 kernel: [75324.611922] ? do_syscall_64+0x69/0xc0 Aug 23 02:19:10 juju-e4d256-prod-github-runner-207 kernel: [75324.612567] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:19:10 juju-e4d256-prod-github-runner-207 kernel: [75324.613270] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:19:10 juju-e4d256-prod-github-runner-207 kernel: [75324.613972] ? do_syscall_64+0x69/0xc0 Aug 23 02:19:10 juju-e4d256-prod-github-runner-207 kernel: [75324.614600] ? do_syscall_64+0x69/0xc0 Aug 23 02:19:10 juju-e4d256-prod-github-runner-207 kernel: [75324.615221] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 02:19:10 juju-e4d256-prod-github-runner-207 kernel: [75324.615930] RIP: 0033:0x7faa5d0edaff Aug 23 02:19:10 juju-e4d256-prod-github-runner-207 kernel: [75324.616558] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 02:19:10 juju-e4d256-prod-github-runner-207 kernel: [75324.618557] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 02:19:10 juju-e4d256-prod-github-runner-207 kernel: [75324.619469] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 02:19:10 juju-e4d256-prod-github-runner-207 kernel: [75324.620360] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 02:19:10 juju-e4d256-prod-github-runner-207 kernel: [75324.621257] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 02:19:10 juju-e4d256-prod-github-runner-207 kernel: [75324.622161] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 02:19:10 juju-e4d256-prod-github-runner-207 kernel: [75324.623056] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 02:19:10 juju-e4d256-prod-github-runner-207 kernel: [75324.623954] Aug 23 02:19:38 juju-e4d256-prod-github-runner-207 kernel: [75352.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 70069s! [qemu-system-x86:6715] Aug 23 02:19:38 juju-e4d256-prod-github-runner-207 kernel: [75352.543087] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 02:19:38 juju-e4d256-prod-github-runner-207 kernel: [75352.543157] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 02:19:38 juju-e4d256-prod-github-runner-207 kernel: [75352.555372] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 02:19:38 juju-e4d256-prod-github-runner-207 kernel: [75352.556639] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 02:19:38 juju-e4d256-prod-github-runner-207 kernel: [75352.557874] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:19:38 juju-e4d256-prod-github-runner-207 kernel: [75352.558933] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 02:19:38 juju-e4d256-prod-github-runner-207 kernel: [75352.561495] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 02:19:38 juju-e4d256-prod-github-runner-207 kernel: [75352.562537] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 02:19:38 juju-e4d256-prod-github-runner-207 kernel: [75352.563696] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 02:19:38 juju-e4d256-prod-github-runner-207 kernel: [75352.564861] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 02:19:38 juju-e4d256-prod-github-runner-207 kernel: [75352.566034] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 02:19:38 juju-e4d256-prod-github-runner-207 kernel: [75352.567196] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 02:19:38 juju-e4d256-prod-github-runner-207 kernel: [75352.568363] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 02:19:38 juju-e4d256-prod-github-runner-207 kernel: [75352.569610] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 02:19:38 juju-e4d256-prod-github-runner-207 kernel: [75352.570709] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 02:19:38 juju-e4d256-prod-github-runner-207 kernel: [75352.571901] Call Trace: Aug 23 02:19:38 juju-e4d256-prod-github-runner-207 kernel: [75352.572815] Aug 23 02:19:38 juju-e4d256-prod-github-runner-207 kernel: [75352.573711] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:19:38 juju-e4d256-prod-github-runner-207 kernel: [75352.574935] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:19:38 juju-e4d256-prod-github-runner-207 kernel: [75352.575955] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:19:38 juju-e4d256-prod-github-runner-207 kernel: [75352.577035] ? show_regs.part.0+0x23/0x29 Aug 23 02:19:38 juju-e4d256-prod-github-runner-207 kernel: [75352.578042] ? show_regs.cold+0x8/0xd Aug 23 02:19:38 juju-e4d256-prod-github-runner-207 kernel: [75352.579011] ? watchdog_timer_fn+0x1be/0x220 Aug 23 02:19:38 juju-e4d256-prod-github-runner-207 kernel: [75352.580025] ? lockup_detector_update_enable+0x60/0x60 Aug 23 02:19:38 juju-e4d256-prod-github-runner-207 kernel: [75352.581093] ? __hrtimer_run_queues+0x107/0x230 Aug 23 02:19:38 juju-e4d256-prod-github-runner-207 kernel: [75352.582133] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 02:19:38 juju-e4d256-prod-github-runner-207 kernel: [75352.583155] ? hrtimer_interrupt+0x101/0x220 Aug 23 02:19:38 juju-e4d256-prod-github-runner-207 kernel: [75352.584169] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 02:19:38 juju-e4d256-prod-github-runner-207 kernel: [75352.585242] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 02:19:38 juju-e4d256-prod-github-runner-207 kernel: [75352.586306] Aug 23 02:19:38 juju-e4d256-prod-github-runner-207 kernel: [75352.587158] Aug 23 02:19:38 juju-e4d256-prod-github-runner-207 kernel: [75352.588000] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 02:19:38 juju-e4d256-prod-github-runner-207 kernel: [75352.589055] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:19:38 juju-e4d256-prod-github-runner-207 kernel: [75352.590107] ? _raw_spin_lock+0x22/0x30 Aug 23 02:19:38 juju-e4d256-prod-github-runner-207 kernel: [75352.591051] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:19:38 juju-e4d256-prod-github-runner-207 kernel: [75352.592063] direct_page_fault+0x206/0x310 [kvm] Aug 23 02:19:38 juju-e4d256-prod-github-runner-207 kernel: [75352.593082] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 02:19:38 juju-e4d256-prod-github-runner-207 kernel: [75352.594101] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 02:19:38 juju-e4d256-prod-github-runner-207 kernel: [75352.595104] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 02:19:38 juju-e4d256-prod-github-runner-207 kernel: [75352.596073] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 02:19:38 juju-e4d256-prod-github-runner-207 kernel: [75352.597021] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 02:19:38 juju-e4d256-prod-github-runner-207 kernel: [75352.598005] handle_exit+0x98/0x230 [kvm_amd] Aug 23 02:19:38 juju-e4d256-prod-github-runner-207 kernel: [75352.598895] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 02:19:38 juju-e4d256-prod-github-runner-207 kernel: [75352.599807] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 02:19:38 juju-e4d256-prod-github-runner-207 kernel: [75352.600731] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 02:19:38 juju-e4d256-prod-github-runner-207 kernel: [75352.601663] vcpu_run+0x62/0x2c0 [kvm] Aug 23 02:19:38 juju-e4d256-prod-github-runner-207 kernel: [75352.602479] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 02:19:38 juju-e4d256-prod-github-runner-207 kernel: [75352.603283] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 02:19:38 juju-e4d256-prod-github-runner-207 kernel: [75352.604135] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 02:19:38 juju-e4d256-prod-github-runner-207 kernel: [75352.604935] ? __seccomp_filter+0x4a/0x4a0 Aug 23 02:19:38 juju-e4d256-prod-github-runner-207 kernel: [75352.605693] ? __fget_files+0x86/0xc0 Aug 23 02:19:38 juju-e4d256-prod-github-runner-207 kernel: [75352.606396] __x64_sys_ioctl+0x95/0xd0 Aug 23 02:19:38 juju-e4d256-prod-github-runner-207 kernel: [75352.607092] do_syscall_64+0x5c/0xc0 Aug 23 02:19:38 juju-e4d256-prod-github-runner-207 kernel: [75352.607754] ? do_futex+0x162/0x1f0 Aug 23 02:19:38 juju-e4d256-prod-github-runner-207 kernel: [75352.608405] ? __x64_sys_futex+0x78/0x1e0 Aug 23 02:19:38 juju-e4d256-prod-github-runner-207 kernel: [75352.609075] ? __secure_computing+0xa9/0x120 Aug 23 02:19:38 juju-e4d256-prod-github-runner-207 kernel: [75352.609781] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 02:19:38 juju-e4d256-prod-github-runner-207 kernel: [75352.610540] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:19:38 juju-e4d256-prod-github-runner-207 kernel: [75352.611264] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:19:38 juju-e4d256-prod-github-runner-207 kernel: [75352.611984] ? do_syscall_64+0x69/0xc0 Aug 23 02:19:38 juju-e4d256-prod-github-runner-207 kernel: [75352.612626] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:19:38 juju-e4d256-prod-github-runner-207 kernel: [75352.613327] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:19:38 juju-e4d256-prod-github-runner-207 kernel: [75352.614030] ? do_syscall_64+0x69/0xc0 Aug 23 02:19:38 juju-e4d256-prod-github-runner-207 kernel: [75352.614651] ? do_syscall_64+0x69/0xc0 Aug 23 02:19:38 juju-e4d256-prod-github-runner-207 kernel: [75352.615273] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 02:19:38 juju-e4d256-prod-github-runner-207 kernel: [75352.615974] RIP: 0033:0x7faa5d0edaff Aug 23 02:19:38 juju-e4d256-prod-github-runner-207 kernel: [75352.616596] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 02:19:38 juju-e4d256-prod-github-runner-207 kernel: [75352.618597] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 02:19:38 juju-e4d256-prod-github-runner-207 kernel: [75352.619504] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 02:19:38 juju-e4d256-prod-github-runner-207 kernel: [75352.620393] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 02:19:38 juju-e4d256-prod-github-runner-207 kernel: [75352.621279] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 02:19:38 juju-e4d256-prod-github-runner-207 kernel: [75352.622175] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 02:19:38 juju-e4d256-prod-github-runner-207 kernel: [75352.623061] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 02:19:38 juju-e4d256-prod-github-runner-207 kernel: [75352.623954] Aug 23 02:20:06 juju-e4d256-prod-github-runner-207 kernel: [75380.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 70095s! [qemu-system-x86:6715] Aug 23 02:20:06 juju-e4d256-prod-github-runner-207 kernel: [75380.543717] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 02:20:06 juju-e4d256-prod-github-runner-207 kernel: [75380.543960] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 02:20:06 juju-e4d256-prod-github-runner-207 kernel: [75380.556019] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 02:20:06 juju-e4d256-prod-github-runner-207 kernel: [75380.557294] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 02:20:06 juju-e4d256-prod-github-runner-207 kernel: [75380.558519] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:20:06 juju-e4d256-prod-github-runner-207 kernel: [75380.559575] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 02:20:06 juju-e4d256-prod-github-runner-207 kernel: [75380.562135] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 02:20:06 juju-e4d256-prod-github-runner-207 kernel: [75380.563177] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 02:20:06 juju-e4d256-prod-github-runner-207 kernel: [75380.564338] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 02:20:06 juju-e4d256-prod-github-runner-207 kernel: [75380.565506] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 02:20:06 juju-e4d256-prod-github-runner-207 kernel: [75380.566666] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 02:20:06 juju-e4d256-prod-github-runner-207 kernel: [75380.567825] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 02:20:06 juju-e4d256-prod-github-runner-207 kernel: [75380.568990] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 02:20:06 juju-e4d256-prod-github-runner-207 kernel: [75380.570234] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 02:20:06 juju-e4d256-prod-github-runner-207 kernel: [75380.571330] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 02:20:06 juju-e4d256-prod-github-runner-207 kernel: [75380.572520] Call Trace: Aug 23 02:20:06 juju-e4d256-prod-github-runner-207 kernel: [75380.573439] Aug 23 02:20:06 juju-e4d256-prod-github-runner-207 kernel: [75380.574331] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:20:06 juju-e4d256-prod-github-runner-207 kernel: [75380.575360] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:20:06 juju-e4d256-prod-github-runner-207 kernel: [75380.576385] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:20:06 juju-e4d256-prod-github-runner-207 kernel: [75380.577495] ? show_regs.part.0+0x23/0x29 Aug 23 02:20:06 juju-e4d256-prod-github-runner-207 kernel: [75380.578490] ? show_regs.cold+0x8/0xd Aug 23 02:20:06 juju-e4d256-prod-github-runner-207 kernel: [75380.579463] ? watchdog_timer_fn+0x1be/0x220 Aug 23 02:20:06 juju-e4d256-prod-github-runner-207 kernel: [75380.580474] ? lockup_detector_update_enable+0x60/0x60 Aug 23 02:20:06 juju-e4d256-prod-github-runner-207 kernel: [75380.581548] ? __hrtimer_run_queues+0x107/0x230 Aug 23 02:20:06 juju-e4d256-prod-github-runner-207 kernel: [75380.582574] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 02:20:06 juju-e4d256-prod-github-runner-207 kernel: [75380.583611] ? hrtimer_interrupt+0x101/0x220 Aug 23 02:20:06 juju-e4d256-prod-github-runner-207 kernel: [75380.584625] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 02:20:06 juju-e4d256-prod-github-runner-207 kernel: [75380.585721] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 02:20:06 juju-e4d256-prod-github-runner-207 kernel: [75380.586767] Aug 23 02:20:06 juju-e4d256-prod-github-runner-207 kernel: [75380.587617] Aug 23 02:20:06 juju-e4d256-prod-github-runner-207 kernel: [75380.588473] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 02:20:06 juju-e4d256-prod-github-runner-207 kernel: [75380.589528] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:20:06 juju-e4d256-prod-github-runner-207 kernel: [75380.590564] ? _raw_spin_lock+0x22/0x30 Aug 23 02:20:06 juju-e4d256-prod-github-runner-207 kernel: [75380.591507] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:20:06 juju-e4d256-prod-github-runner-207 kernel: [75380.592522] direct_page_fault+0x206/0x310 [kvm] Aug 23 02:20:06 juju-e4d256-prod-github-runner-207 kernel: [75380.593558] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 02:20:06 juju-e4d256-prod-github-runner-207 kernel: [75380.594563] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 02:20:06 juju-e4d256-prod-github-runner-207 kernel: [75380.595562] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 02:20:06 juju-e4d256-prod-github-runner-207 kernel: [75380.596573] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 02:20:06 juju-e4d256-prod-github-runner-207 kernel: [75380.597529] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 02:20:06 juju-e4d256-prod-github-runner-207 kernel: [75380.598504] handle_exit+0x98/0x230 [kvm_amd] Aug 23 02:20:06 juju-e4d256-prod-github-runner-207 kernel: [75380.599397] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 02:20:06 juju-e4d256-prod-github-runner-207 kernel: [75380.600307] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 02:20:06 juju-e4d256-prod-github-runner-207 kernel: [75380.601242] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 02:20:06 juju-e4d256-prod-github-runner-207 kernel: [75380.602147] vcpu_run+0x62/0x2c0 [kvm] Aug 23 02:20:06 juju-e4d256-prod-github-runner-207 kernel: [75380.602954] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 02:20:06 juju-e4d256-prod-github-runner-207 kernel: [75380.603758] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 02:20:06 juju-e4d256-prod-github-runner-207 kernel: [75380.604608] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 02:20:06 juju-e4d256-prod-github-runner-207 kernel: [75380.605491] ? __seccomp_filter+0x4a/0x4a0 Aug 23 02:20:06 juju-e4d256-prod-github-runner-207 kernel: [75380.606265] ? __fget_files+0x86/0xc0 Aug 23 02:20:06 juju-e4d256-prod-github-runner-207 kernel: [75380.606977] __x64_sys_ioctl+0x95/0xd0 Aug 23 02:20:06 juju-e4d256-prod-github-runner-207 kernel: [75380.607666] do_syscall_64+0x5c/0xc0 Aug 23 02:20:06 juju-e4d256-prod-github-runner-207 kernel: [75380.608326] ? do_futex+0x162/0x1f0 Aug 23 02:20:06 juju-e4d256-prod-github-runner-207 kernel: [75380.608971] ? __x64_sys_futex+0x78/0x1e0 Aug 23 02:20:06 juju-e4d256-prod-github-runner-207 kernel: [75380.609650] ? __secure_computing+0xa9/0x120 Aug 23 02:20:06 juju-e4d256-prod-github-runner-207 kernel: [75380.610337] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 02:20:06 juju-e4d256-prod-github-runner-207 kernel: [75380.611095] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:20:06 juju-e4d256-prod-github-runner-207 kernel: [75380.611813] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:20:06 juju-e4d256-prod-github-runner-207 kernel: [75380.612533] ? do_syscall_64+0x69/0xc0 Aug 23 02:20:06 juju-e4d256-prod-github-runner-207 kernel: [75380.613185] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:20:06 juju-e4d256-prod-github-runner-207 kernel: [75380.613885] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:20:06 juju-e4d256-prod-github-runner-207 kernel: [75380.614577] ? do_syscall_64+0x69/0xc0 Aug 23 02:20:06 juju-e4d256-prod-github-runner-207 kernel: [75380.615203] ? do_syscall_64+0x69/0xc0 Aug 23 02:20:06 juju-e4d256-prod-github-runner-207 kernel: [75380.615822] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 02:20:06 juju-e4d256-prod-github-runner-207 kernel: [75380.616524] RIP: 0033:0x7faa5d0edaff Aug 23 02:20:06 juju-e4d256-prod-github-runner-207 kernel: [75380.617172] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 02:20:06 juju-e4d256-prod-github-runner-207 kernel: [75380.619153] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 02:20:06 juju-e4d256-prod-github-runner-207 kernel: [75380.620061] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 02:20:06 juju-e4d256-prod-github-runner-207 kernel: [75380.620949] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 02:20:06 juju-e4d256-prod-github-runner-207 kernel: [75380.621853] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 02:20:06 juju-e4d256-prod-github-runner-207 kernel: [75380.622739] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 02:20:06 juju-e4d256-prod-github-runner-207 kernel: [75380.623753] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 02:20:06 juju-e4d256-prod-github-runner-207 kernel: [75380.624647] Aug 23 02:20:34 juju-e4d256-prod-github-runner-207 kernel: [75408.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 70121s! [qemu-system-x86:6715] Aug 23 02:20:34 juju-e4d256-prod-github-runner-207 kernel: [75408.543100] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 02:20:34 juju-e4d256-prod-github-runner-207 kernel: [75408.543173] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 02:20:34 juju-e4d256-prod-github-runner-207 kernel: [75408.555311] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 02:20:34 juju-e4d256-prod-github-runner-207 kernel: [75408.556582] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 02:20:34 juju-e4d256-prod-github-runner-207 kernel: [75408.557817] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:20:34 juju-e4d256-prod-github-runner-207 kernel: [75408.558874] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 02:20:34 juju-e4d256-prod-github-runner-207 kernel: [75408.561431] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 02:20:34 juju-e4d256-prod-github-runner-207 kernel: [75408.562474] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 02:20:34 juju-e4d256-prod-github-runner-207 kernel: [75408.563640] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 02:20:34 juju-e4d256-prod-github-runner-207 kernel: [75408.564808] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 02:20:34 juju-e4d256-prod-github-runner-207 kernel: [75408.565966] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 02:20:34 juju-e4d256-prod-github-runner-207 kernel: [75408.567131] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 02:20:34 juju-e4d256-prod-github-runner-207 kernel: [75408.568297] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 02:20:34 juju-e4d256-prod-github-runner-207 kernel: [75408.569538] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 02:20:34 juju-e4d256-prod-github-runner-207 kernel: [75408.570637] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 02:20:34 juju-e4d256-prod-github-runner-207 kernel: [75408.571828] Call Trace: Aug 23 02:20:34 juju-e4d256-prod-github-runner-207 kernel: [75408.572747] Aug 23 02:20:34 juju-e4d256-prod-github-runner-207 kernel: [75408.573631] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:20:34 juju-e4d256-prod-github-runner-207 kernel: [75408.574665] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:20:34 juju-e4d256-prod-github-runner-207 kernel: [75408.575685] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:20:34 juju-e4d256-prod-github-runner-207 kernel: [75408.576772] ? show_regs.part.0+0x23/0x29 Aug 23 02:20:34 juju-e4d256-prod-github-runner-207 kernel: [75408.577771] ? show_regs.cold+0x8/0xd Aug 23 02:20:34 juju-e4d256-prod-github-runner-207 kernel: [75408.578744] ? watchdog_timer_fn+0x1be/0x220 Aug 23 02:20:34 juju-e4d256-prod-github-runner-207 kernel: [75408.579750] ? lockup_detector_update_enable+0x60/0x60 Aug 23 02:20:34 juju-e4d256-prod-github-runner-207 kernel: [75408.580824] ? __hrtimer_run_queues+0x107/0x230 Aug 23 02:20:34 juju-e4d256-prod-github-runner-207 kernel: [75408.581852] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 02:20:34 juju-e4d256-prod-github-runner-207 kernel: [75408.582877] ? hrtimer_interrupt+0x101/0x220 Aug 23 02:20:34 juju-e4d256-prod-github-runner-207 kernel: [75408.583893] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 02:20:34 juju-e4d256-prod-github-runner-207 kernel: [75408.584969] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 02:20:34 juju-e4d256-prod-github-runner-207 kernel: [75408.586016] Aug 23 02:20:34 juju-e4d256-prod-github-runner-207 kernel: [75408.586868] Aug 23 02:20:34 juju-e4d256-prod-github-runner-207 kernel: [75408.587705] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 02:20:34 juju-e4d256-prod-github-runner-207 kernel: [75408.588747] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:20:34 juju-e4d256-prod-github-runner-207 kernel: [75408.589791] ? _raw_spin_lock+0x22/0x30 Aug 23 02:20:34 juju-e4d256-prod-github-runner-207 kernel: [75408.590758] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:20:34 juju-e4d256-prod-github-runner-207 kernel: [75408.591778] direct_page_fault+0x206/0x310 [kvm] Aug 23 02:20:34 juju-e4d256-prod-github-runner-207 kernel: [75408.592816] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 02:20:34 juju-e4d256-prod-github-runner-207 kernel: [75408.593825] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 02:20:34 juju-e4d256-prod-github-runner-207 kernel: [75408.594823] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 02:20:34 juju-e4d256-prod-github-runner-207 kernel: [75408.595792] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 02:20:34 juju-e4d256-prod-github-runner-207 kernel: [75408.596745] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 02:20:34 juju-e4d256-prod-github-runner-207 kernel: [75408.597729] handle_exit+0x98/0x230 [kvm_amd] Aug 23 02:20:34 juju-e4d256-prod-github-runner-207 kernel: [75408.598620] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 02:20:34 juju-e4d256-prod-github-runner-207 kernel: [75408.599533] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 02:20:34 juju-e4d256-prod-github-runner-207 kernel: [75408.600456] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 02:20:34 juju-e4d256-prod-github-runner-207 kernel: [75408.601372] vcpu_run+0x62/0x2c0 [kvm] Aug 23 02:20:34 juju-e4d256-prod-github-runner-207 kernel: [75408.602180] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 02:20:34 juju-e4d256-prod-github-runner-207 kernel: [75408.602986] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 02:20:34 juju-e4d256-prod-github-runner-207 kernel: [75408.603837] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 02:20:34 juju-e4d256-prod-github-runner-207 kernel: [75408.604646] ? __seccomp_filter+0x4a/0x4a0 Aug 23 02:20:34 juju-e4d256-prod-github-runner-207 kernel: [75408.605399] ? __fget_files+0x86/0xc0 Aug 23 02:20:34 juju-e4d256-prod-github-runner-207 kernel: [75408.606102] __x64_sys_ioctl+0x95/0xd0 Aug 23 02:20:34 juju-e4d256-prod-github-runner-207 kernel: [75408.606794] do_syscall_64+0x5c/0xc0 Aug 23 02:20:34 juju-e4d256-prod-github-runner-207 kernel: [75408.607456] ? do_futex+0x162/0x1f0 Aug 23 02:20:34 juju-e4d256-prod-github-runner-207 kernel: [75408.608103] ? __x64_sys_futex+0x78/0x1e0 Aug 23 02:20:34 juju-e4d256-prod-github-runner-207 kernel: [75408.608784] ? __secure_computing+0xa9/0x120 Aug 23 02:20:34 juju-e4d256-prod-github-runner-207 kernel: [75408.609482] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 02:20:34 juju-e4d256-prod-github-runner-207 kernel: [75408.610241] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:20:34 juju-e4d256-prod-github-runner-207 kernel: [75408.610962] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:20:34 juju-e4d256-prod-github-runner-207 kernel: [75408.611685] ? do_syscall_64+0x69/0xc0 Aug 23 02:20:34 juju-e4d256-prod-github-runner-207 kernel: [75408.612328] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:20:34 juju-e4d256-prod-github-runner-207 kernel: [75408.613038] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:20:34 juju-e4d256-prod-github-runner-207 kernel: [75408.613734] ? do_syscall_64+0x69/0xc0 Aug 23 02:20:34 juju-e4d256-prod-github-runner-207 kernel: [75408.614356] ? do_syscall_64+0x69/0xc0 Aug 23 02:20:34 juju-e4d256-prod-github-runner-207 kernel: [75408.614978] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 02:20:34 juju-e4d256-prod-github-runner-207 kernel: [75408.615683] RIP: 0033:0x7faa5d0edaff Aug 23 02:20:34 juju-e4d256-prod-github-runner-207 kernel: [75408.616306] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 02:20:34 juju-e4d256-prod-github-runner-207 kernel: [75408.618306] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 02:20:34 juju-e4d256-prod-github-runner-207 kernel: [75408.619214] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 02:20:34 juju-e4d256-prod-github-runner-207 kernel: [75408.620103] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 02:20:34 juju-e4d256-prod-github-runner-207 kernel: [75408.621002] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 02:20:34 juju-e4d256-prod-github-runner-207 kernel: [75408.621894] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 02:20:34 juju-e4d256-prod-github-runner-207 kernel: [75408.622787] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 02:20:34 juju-e4d256-prod-github-runner-207 kernel: [75408.623686] Aug 23 02:20:48 juju-e4d256-prod-github-runner-207 kernel: [75422.216707] rcu: INFO: rcu_sched self-detected stall on CPU Aug 23 02:20:48 juju-e4d256-prod-github-runner-207 kernel: [75422.217679] rcu: 1-....: (18767104 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=9071294 Aug 23 02:20:48 juju-e4d256-prod-github-runner-207 kernel: [75422.218804] (t=18826254 jiffies g=23269 q=63844) Aug 23 02:20:48 juju-e4d256-prod-github-runner-207 kernel: [75422.219590] NMI backtrace for cpu 1 Aug 23 02:20:48 juju-e4d256-prod-github-runner-207 kernel: [75422.220299] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 02:20:48 juju-e4d256-prod-github-runner-207 kernel: [75422.221412] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 02:20:48 juju-e4d256-prod-github-runner-207 kernel: [75422.222478] Call Trace: Aug 23 02:20:48 juju-e4d256-prod-github-runner-207 kernel: [75422.223153] Aug 23 02:20:48 juju-e4d256-prod-github-runner-207 kernel: [75422.223798] show_stack+0x52/0x5c Aug 23 02:20:48 juju-e4d256-prod-github-runner-207 kernel: [75422.224522] dump_stack_lvl+0x4a/0x63 Aug 23 02:20:48 juju-e4d256-prod-github-runner-207 kernel: [75422.225278] dump_stack+0x10/0x16 Aug 23 02:20:48 juju-e4d256-prod-github-runner-207 kernel: [75422.225995] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 23 02:20:48 juju-e4d256-prod-github-runner-207 kernel: [75422.226773] ? lapic_can_unplug_cpu+0x90/0x90 Aug 23 02:20:48 juju-e4d256-prod-github-runner-207 kernel: [75422.227551] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 23 02:20:48 juju-e4d256-prod-github-runner-207 kernel: [75422.228369] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 23 02:20:48 juju-e4d256-prod-github-runner-207 kernel: [75422.229202] trigger_single_cpu_backtrace+0x44/0x4f Aug 23 02:20:48 juju-e4d256-prod-github-runner-207 kernel: [75422.230008] rcu_dump_cpu_stacks+0x102/0x149 Aug 23 02:20:48 juju-e4d256-prod-github-runner-207 kernel: [75422.230784] print_cpu_stall.cold+0x2f/0xe2 Aug 23 02:20:48 juju-e4d256-prod-github-runner-207 kernel: [75422.231547] ? timekeeping_update+0xf7/0x150 Aug 23 02:20:48 juju-e4d256-prod-github-runner-207 kernel: [75422.232317] check_cpu_stall+0x109/0x270 Aug 23 02:20:48 juju-e4d256-prod-github-runner-207 kernel: [75422.233074] rcu_sched_clock_irq+0x9a/0x250 Aug 23 02:20:48 juju-e4d256-prod-github-runner-207 kernel: [75422.233841] update_process_times+0x94/0xd0 Aug 23 02:20:48 juju-e4d256-prod-github-runner-207 kernel: [75422.234599] tick_sched_handle+0x29/0x70 Aug 23 02:20:48 juju-e4d256-prod-github-runner-207 kernel: [75422.235343] tick_sched_timer+0x8c/0xc0 Aug 23 02:20:48 juju-e4d256-prod-github-runner-207 kernel: [75422.236078] ? tick_nohz_handler+0xb0/0xb0 Aug 23 02:20:48 juju-e4d256-prod-github-runner-207 kernel: [75422.236844] __hrtimer_run_queues+0x107/0x230 Aug 23 02:20:48 juju-e4d256-prod-github-runner-207 kernel: [75422.237618] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 02:20:48 juju-e4d256-prod-github-runner-207 kernel: [75422.238392] hrtimer_interrupt+0x101/0x220 Aug 23 02:20:48 juju-e4d256-prod-github-runner-207 kernel: [75422.239149] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 02:20:48 juju-e4d256-prod-github-runner-207 kernel: [75422.239967] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 02:20:48 juju-e4d256-prod-github-runner-207 kernel: [75422.240776] Aug 23 02:20:48 juju-e4d256-prod-github-runner-207 kernel: [75422.241413] Aug 23 02:20:48 juju-e4d256-prod-github-runner-207 kernel: [75422.242046] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 02:20:48 juju-e4d256-prod-github-runner-207 kernel: [75422.242869] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:20:48 juju-e4d256-prod-github-runner-207 kernel: [75422.243747] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 02:20:48 juju-e4d256-prod-github-runner-207 kernel: [75422.246053] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 02:20:48 juju-e4d256-prod-github-runner-207 kernel: [75422.246924] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 02:20:48 juju-e4d256-prod-github-runner-207 kernel: [75422.247912] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 02:20:48 juju-e4d256-prod-github-runner-207 kernel: [75422.248896] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 02:20:48 juju-e4d256-prod-github-runner-207 kernel: [75422.249863] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 02:20:48 juju-e4d256-prod-github-runner-207 kernel: [75422.250851] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 02:20:48 juju-e4d256-prod-github-runner-207 kernel: [75422.251858] ? _raw_spin_lock+0x22/0x30 Aug 23 02:20:48 juju-e4d256-prod-github-runner-207 kernel: [75422.252625] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:20:48 juju-e4d256-prod-github-runner-207 kernel: [75422.253463] direct_page_fault+0x206/0x310 [kvm] Aug 23 02:20:48 juju-e4d256-prod-github-runner-207 kernel: [75422.254305] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 02:20:48 juju-e4d256-prod-github-runner-207 kernel: [75422.255130] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 02:20:48 juju-e4d256-prod-github-runner-207 kernel: [75422.255956] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 02:20:48 juju-e4d256-prod-github-runner-207 kernel: [75422.256769] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 02:20:48 juju-e4d256-prod-github-runner-207 kernel: [75422.257554] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 02:20:48 juju-e4d256-prod-github-runner-207 kernel: [75422.258376] handle_exit+0x98/0x230 [kvm_amd] Aug 23 02:20:48 juju-e4d256-prod-github-runner-207 kernel: [75422.259134] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 02:20:48 juju-e4d256-prod-github-runner-207 kernel: [75422.259920] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 02:20:48 juju-e4d256-prod-github-runner-207 kernel: [75422.260759] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 02:20:48 juju-e4d256-prod-github-runner-207 kernel: [75422.261551] vcpu_run+0x62/0x2c0 [kvm] Aug 23 02:20:48 juju-e4d256-prod-github-runner-207 kernel: [75422.262268] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 02:20:48 juju-e4d256-prod-github-runner-207 kernel: [75422.263007] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 02:20:48 juju-e4d256-prod-github-runner-207 kernel: [75422.263808] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 02:20:48 juju-e4d256-prod-github-runner-207 kernel: [75422.264581] ? __seccomp_filter+0x4a/0x4a0 Aug 23 02:20:48 juju-e4d256-prod-github-runner-207 kernel: [75422.265301] ? __fget_files+0x86/0xc0 Aug 23 02:20:48 juju-e4d256-prod-github-runner-207 kernel: [75422.265993] __x64_sys_ioctl+0x95/0xd0 Aug 23 02:20:48 juju-e4d256-prod-github-runner-207 kernel: [75422.266687] do_syscall_64+0x5c/0xc0 Aug 23 02:20:48 juju-e4d256-prod-github-runner-207 kernel: [75422.267367] ? do_futex+0x162/0x1f0 Aug 23 02:20:48 juju-e4d256-prod-github-runner-207 kernel: [75422.268037] ? __x64_sys_futex+0x78/0x1e0 Aug 23 02:20:48 juju-e4d256-prod-github-runner-207 kernel: [75422.268750] ? __secure_computing+0xa9/0x120 Aug 23 02:20:48 juju-e4d256-prod-github-runner-207 kernel: [75422.269467] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 02:20:48 juju-e4d256-prod-github-runner-207 kernel: [75422.270255] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:20:48 juju-e4d256-prod-github-runner-207 kernel: [75422.271013] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:20:48 juju-e4d256-prod-github-runner-207 kernel: [75422.271770] ? do_syscall_64+0x69/0xc0 Aug 23 02:20:48 juju-e4d256-prod-github-runner-207 kernel: [75422.272461] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:20:48 juju-e4d256-prod-github-runner-207 kernel: [75422.273235] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:20:48 juju-e4d256-prod-github-runner-207 kernel: [75422.273993] ? do_syscall_64+0x69/0xc0 Aug 23 02:20:48 juju-e4d256-prod-github-runner-207 kernel: [75422.274753] ? do_syscall_64+0x69/0xc0 Aug 23 02:20:48 juju-e4d256-prod-github-runner-207 kernel: [75422.275450] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 02:20:48 juju-e4d256-prod-github-runner-207 kernel: [75422.276217] RIP: 0033:0x7faa5d0edaff Aug 23 02:20:48 juju-e4d256-prod-github-runner-207 kernel: [75422.276907] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 02:20:48 juju-e4d256-prod-github-runner-207 kernel: [75422.278999] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 02:20:48 juju-e4d256-prod-github-runner-207 kernel: [75422.279954] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 02:20:48 juju-e4d256-prod-github-runner-207 kernel: [75422.280901] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 02:20:48 juju-e4d256-prod-github-runner-207 kernel: [75422.281841] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 02:20:48 juju-e4d256-prod-github-runner-207 kernel: [75422.282774] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 02:20:48 juju-e4d256-prod-github-runner-207 kernel: [75422.283694] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 02:20:48 juju-e4d256-prod-github-runner-207 kernel: [75422.284615] Aug 23 02:21:14 juju-e4d256-prod-github-runner-207 kernel: [75448.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 70158s! [qemu-system-x86:6715] Aug 23 02:21:14 juju-e4d256-prod-github-runner-207 kernel: [75448.543132] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 02:21:14 juju-e4d256-prod-github-runner-207 kernel: [75448.543200] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 02:21:14 juju-e4d256-prod-github-runner-207 kernel: [75448.555293] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 02:21:14 juju-e4d256-prod-github-runner-207 kernel: [75448.556565] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 02:21:14 juju-e4d256-prod-github-runner-207 kernel: [75448.557847] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:21:14 juju-e4d256-prod-github-runner-207 kernel: [75448.558918] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 02:21:14 juju-e4d256-prod-github-runner-207 kernel: [75448.561477] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 02:21:14 juju-e4d256-prod-github-runner-207 kernel: [75448.562525] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 02:21:14 juju-e4d256-prod-github-runner-207 kernel: [75448.563683] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 02:21:14 juju-e4d256-prod-github-runner-207 kernel: [75448.564863] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 02:21:14 juju-e4d256-prod-github-runner-207 kernel: [75448.566030] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 02:21:14 juju-e4d256-prod-github-runner-207 kernel: [75448.567189] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 02:21:14 juju-e4d256-prod-github-runner-207 kernel: [75448.568369] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 02:21:14 juju-e4d256-prod-github-runner-207 kernel: [75448.569603] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 02:21:14 juju-e4d256-prod-github-runner-207 kernel: [75448.570699] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 02:21:14 juju-e4d256-prod-github-runner-207 kernel: [75448.571887] Call Trace: Aug 23 02:21:14 juju-e4d256-prod-github-runner-207 kernel: [75448.572813] Aug 23 02:21:14 juju-e4d256-prod-github-runner-207 kernel: [75448.573696] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:21:14 juju-e4d256-prod-github-runner-207 kernel: [75448.574787] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:21:14 juju-e4d256-prod-github-runner-207 kernel: [75448.575814] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:21:14 juju-e4d256-prod-github-runner-207 kernel: [75448.576899] ? show_regs.part.0+0x23/0x29 Aug 23 02:21:14 juju-e4d256-prod-github-runner-207 kernel: [75448.577902] ? show_regs.cold+0x8/0xd Aug 23 02:21:14 juju-e4d256-prod-github-runner-207 kernel: [75448.578877] ? watchdog_timer_fn+0x1be/0x220 Aug 23 02:21:14 juju-e4d256-prod-github-runner-207 kernel: [75448.579886] ? lockup_detector_update_enable+0x60/0x60 Aug 23 02:21:14 juju-e4d256-prod-github-runner-207 kernel: [75448.580957] ? __hrtimer_run_queues+0x107/0x230 Aug 23 02:21:14 juju-e4d256-prod-github-runner-207 kernel: [75448.581986] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 02:21:14 juju-e4d256-prod-github-runner-207 kernel: [75448.583014] ? hrtimer_interrupt+0x101/0x220 Aug 23 02:21:14 juju-e4d256-prod-github-runner-207 kernel: [75448.584028] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 02:21:14 juju-e4d256-prod-github-runner-207 kernel: [75448.585143] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 02:21:14 juju-e4d256-prod-github-runner-207 kernel: [75448.586194] Aug 23 02:21:14 juju-e4d256-prod-github-runner-207 kernel: [75448.587046] Aug 23 02:21:14 juju-e4d256-prod-github-runner-207 kernel: [75448.587883] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 02:21:14 juju-e4d256-prod-github-runner-207 kernel: [75448.588926] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:21:14 juju-e4d256-prod-github-runner-207 kernel: [75448.589965] ? _raw_spin_lock+0x22/0x30 Aug 23 02:21:14 juju-e4d256-prod-github-runner-207 kernel: [75448.590909] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:21:14 juju-e4d256-prod-github-runner-207 kernel: [75448.591924] direct_page_fault+0x206/0x310 [kvm] Aug 23 02:21:14 juju-e4d256-prod-github-runner-207 kernel: [75448.592950] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 02:21:14 juju-e4d256-prod-github-runner-207 kernel: [75448.593959] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 02:21:14 juju-e4d256-prod-github-runner-207 kernel: [75448.594962] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 02:21:14 juju-e4d256-prod-github-runner-207 kernel: [75448.595939] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 02:21:14 juju-e4d256-prod-github-runner-207 kernel: [75448.596896] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 02:21:14 juju-e4d256-prod-github-runner-207 kernel: [75448.597881] handle_exit+0x98/0x230 [kvm_amd] Aug 23 02:21:14 juju-e4d256-prod-github-runner-207 kernel: [75448.598774] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 02:21:14 juju-e4d256-prod-github-runner-207 kernel: [75448.599689] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 02:21:14 juju-e4d256-prod-github-runner-207 kernel: [75448.600623] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 02:21:14 juju-e4d256-prod-github-runner-207 kernel: [75448.601531] vcpu_run+0x62/0x2c0 [kvm] Aug 23 02:21:14 juju-e4d256-prod-github-runner-207 kernel: [75448.602347] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 02:21:14 juju-e4d256-prod-github-runner-207 kernel: [75448.603154] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 02:21:14 juju-e4d256-prod-github-runner-207 kernel: [75448.604009] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 02:21:14 juju-e4d256-prod-github-runner-207 kernel: [75448.604812] ? __seccomp_filter+0x4a/0x4a0 Aug 23 02:21:14 juju-e4d256-prod-github-runner-207 kernel: [75448.605555] ? __fget_files+0x86/0xc0 Aug 23 02:21:14 juju-e4d256-prod-github-runner-207 kernel: [75448.606265] __x64_sys_ioctl+0x95/0xd0 Aug 23 02:21:14 juju-e4d256-prod-github-runner-207 kernel: [75448.606957] do_syscall_64+0x5c/0xc0 Aug 23 02:21:14 juju-e4d256-prod-github-runner-207 kernel: [75448.607620] ? do_futex+0x162/0x1f0 Aug 23 02:21:14 juju-e4d256-prod-github-runner-207 kernel: [75448.608284] ? __x64_sys_futex+0x78/0x1e0 Aug 23 02:21:14 juju-e4d256-prod-github-runner-207 kernel: [75448.608958] ? __secure_computing+0xa9/0x120 Aug 23 02:21:14 juju-e4d256-prod-github-runner-207 kernel: [75448.609647] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 02:21:14 juju-e4d256-prod-github-runner-207 kernel: [75448.610408] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:21:14 juju-e4d256-prod-github-runner-207 kernel: [75448.611129] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:21:14 juju-e4d256-prod-github-runner-207 kernel: [75448.611852] ? do_syscall_64+0x69/0xc0 Aug 23 02:21:14 juju-e4d256-prod-github-runner-207 kernel: [75448.612505] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:21:14 juju-e4d256-prod-github-runner-207 kernel: [75448.613244] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:21:14 juju-e4d256-prod-github-runner-207 kernel: [75448.613945] ? do_syscall_64+0x69/0xc0 Aug 23 02:21:14 juju-e4d256-prod-github-runner-207 kernel: [75448.614569] ? do_syscall_64+0x69/0xc0 Aug 23 02:21:14 juju-e4d256-prod-github-runner-207 kernel: [75448.615189] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 02:21:14 juju-e4d256-prod-github-runner-207 kernel: [75448.615894] RIP: 0033:0x7faa5d0edaff Aug 23 02:21:14 juju-e4d256-prod-github-runner-207 kernel: [75448.616530] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 02:21:14 juju-e4d256-prod-github-runner-207 kernel: [75448.618518] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 02:21:14 juju-e4d256-prod-github-runner-207 kernel: [75448.619428] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 02:21:14 juju-e4d256-prod-github-runner-207 kernel: [75448.620327] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 02:21:14 juju-e4d256-prod-github-runner-207 kernel: [75448.621218] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 02:21:14 juju-e4d256-prod-github-runner-207 kernel: [75448.622140] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 02:21:14 juju-e4d256-prod-github-runner-207 kernel: [75448.623028] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 02:21:14 juju-e4d256-prod-github-runner-207 kernel: [75448.623919] Aug 23 02:21:42 juju-e4d256-prod-github-runner-207 kernel: [75476.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 70185s! [qemu-system-x86:6715] Aug 23 02:21:42 juju-e4d256-prod-github-runner-207 kernel: [75476.543702] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 02:21:42 juju-e4d256-prod-github-runner-207 kernel: [75476.543965] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 02:21:42 juju-e4d256-prod-github-runner-207 kernel: [75476.556175] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 02:21:42 juju-e4d256-prod-github-runner-207 kernel: [75476.557446] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 02:21:42 juju-e4d256-prod-github-runner-207 kernel: [75476.558666] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:21:42 juju-e4d256-prod-github-runner-207 kernel: [75476.559722] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 02:21:42 juju-e4d256-prod-github-runner-207 kernel: [75476.562360] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 02:21:42 juju-e4d256-prod-github-runner-207 kernel: [75476.563406] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 02:21:42 juju-e4d256-prod-github-runner-207 kernel: [75476.564593] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 02:21:42 juju-e4d256-prod-github-runner-207 kernel: [75476.565771] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 02:21:42 juju-e4d256-prod-github-runner-207 kernel: [75476.566963] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 02:21:42 juju-e4d256-prod-github-runner-207 kernel: [75476.568146] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 02:21:42 juju-e4d256-prod-github-runner-207 kernel: [75476.569316] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 02:21:42 juju-e4d256-prod-github-runner-207 kernel: [75476.570560] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 02:21:42 juju-e4d256-prod-github-runner-207 kernel: [75476.571707] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 02:21:42 juju-e4d256-prod-github-runner-207 kernel: [75476.572918] Call Trace: Aug 23 02:21:42 juju-e4d256-prod-github-runner-207 kernel: [75476.573834] Aug 23 02:21:42 juju-e4d256-prod-github-runner-207 kernel: [75476.574731] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:21:42 juju-e4d256-prod-github-runner-207 kernel: [75476.575773] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:21:42 juju-e4d256-prod-github-runner-207 kernel: [75476.576826] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:21:42 juju-e4d256-prod-github-runner-207 kernel: [75476.577919] ? show_regs.part.0+0x23/0x29 Aug 23 02:21:42 juju-e4d256-prod-github-runner-207 kernel: [75476.578924] ? show_regs.cold+0x8/0xd Aug 23 02:21:42 juju-e4d256-prod-github-runner-207 kernel: [75476.579894] ? watchdog_timer_fn+0x1be/0x220 Aug 23 02:21:42 juju-e4d256-prod-github-runner-207 kernel: [75476.580937] ? lockup_detector_update_enable+0x60/0x60 Aug 23 02:21:42 juju-e4d256-prod-github-runner-207 kernel: [75476.582047] ? __hrtimer_run_queues+0x107/0x230 Aug 23 02:21:42 juju-e4d256-prod-github-runner-207 kernel: [75476.583101] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 02:21:42 juju-e4d256-prod-github-runner-207 kernel: [75476.584158] ? hrtimer_interrupt+0x101/0x220 Aug 23 02:21:42 juju-e4d256-prod-github-runner-207 kernel: [75476.585186] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 02:21:42 juju-e4d256-prod-github-runner-207 kernel: [75476.586276] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 02:21:42 juju-e4d256-prod-github-runner-207 kernel: [75476.587339] Aug 23 02:21:42 juju-e4d256-prod-github-runner-207 kernel: [75476.588218] Aug 23 02:21:42 juju-e4d256-prod-github-runner-207 kernel: [75476.589060] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 02:21:42 juju-e4d256-prod-github-runner-207 kernel: [75476.590098] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:21:42 juju-e4d256-prod-github-runner-207 kernel: [75476.591159] ? _raw_spin_lock+0x22/0x30 Aug 23 02:21:42 juju-e4d256-prod-github-runner-207 kernel: [75476.592181] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:21:42 juju-e4d256-prod-github-runner-207 kernel: [75476.593213] direct_page_fault+0x206/0x310 [kvm] Aug 23 02:21:42 juju-e4d256-prod-github-runner-207 kernel: [75476.594243] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 02:21:42 juju-e4d256-prod-github-runner-207 kernel: [75476.595261] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 02:21:42 juju-e4d256-prod-github-runner-207 kernel: [75476.596299] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 02:21:42 juju-e4d256-prod-github-runner-207 kernel: [75476.597321] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 02:21:42 juju-e4d256-prod-github-runner-207 kernel: [75476.598274] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 02:21:42 juju-e4d256-prod-github-runner-207 kernel: [75476.599261] handle_exit+0x98/0x230 [kvm_amd] Aug 23 02:21:42 juju-e4d256-prod-github-runner-207 kernel: [75476.600172] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 02:21:42 juju-e4d256-prod-github-runner-207 kernel: [75476.601096] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 02:21:42 juju-e4d256-prod-github-runner-207 kernel: [75476.602039] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 02:21:42 juju-e4d256-prod-github-runner-207 kernel: [75476.602971] vcpu_run+0x62/0x2c0 [kvm] Aug 23 02:21:42 juju-e4d256-prod-github-runner-207 kernel: [75476.603791] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 02:21:42 juju-e4d256-prod-github-runner-207 kernel: [75476.604626] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 02:21:42 juju-e4d256-prod-github-runner-207 kernel: [75476.605484] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 02:21:42 juju-e4d256-prod-github-runner-207 kernel: [75476.606292] ? __seccomp_filter+0x4a/0x4a0 Aug 23 02:21:42 juju-e4d256-prod-github-runner-207 kernel: [75476.607042] ? __fget_files+0x86/0xc0 Aug 23 02:21:42 juju-e4d256-prod-github-runner-207 kernel: [75476.607768] __x64_sys_ioctl+0x95/0xd0 Aug 23 02:21:42 juju-e4d256-prod-github-runner-207 kernel: [75476.608487] do_syscall_64+0x5c/0xc0 Aug 23 02:21:42 juju-e4d256-prod-github-runner-207 kernel: [75476.609156] ? do_futex+0x162/0x1f0 Aug 23 02:21:42 juju-e4d256-prod-github-runner-207 kernel: [75476.609807] ? __x64_sys_futex+0x78/0x1e0 Aug 23 02:21:42 juju-e4d256-prod-github-runner-207 kernel: [75476.610488] ? __secure_computing+0xa9/0x120 Aug 23 02:21:42 juju-e4d256-prod-github-runner-207 kernel: [75476.611194] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 02:21:42 juju-e4d256-prod-github-runner-207 kernel: [75476.611978] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:21:42 juju-e4d256-prod-github-runner-207 kernel: [75476.612741] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:21:42 juju-e4d256-prod-github-runner-207 kernel: [75476.613466] ? do_syscall_64+0x69/0xc0 Aug 23 02:21:42 juju-e4d256-prod-github-runner-207 kernel: [75476.614119] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:21:42 juju-e4d256-prod-github-runner-207 kernel: [75476.614828] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:21:42 juju-e4d256-prod-github-runner-207 kernel: [75476.615531] ? do_syscall_64+0x69/0xc0 Aug 23 02:21:42 juju-e4d256-prod-github-runner-207 kernel: [75476.616172] ? do_syscall_64+0x69/0xc0 Aug 23 02:21:42 juju-e4d256-prod-github-runner-207 kernel: [75476.616811] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 02:21:42 juju-e4d256-prod-github-runner-207 kernel: [75476.617529] RIP: 0033:0x7faa5d0edaff Aug 23 02:21:42 juju-e4d256-prod-github-runner-207 kernel: [75476.618209] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 02:21:42 juju-e4d256-prod-github-runner-207 kernel: [75476.620212] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 02:21:42 juju-e4d256-prod-github-runner-207 kernel: [75476.621121] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 02:21:42 juju-e4d256-prod-github-runner-207 kernel: [75476.622041] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 02:21:42 juju-e4d256-prod-github-runner-207 kernel: [75476.623086] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 02:21:42 juju-e4d256-prod-github-runner-207 kernel: [75476.623986] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 02:21:42 juju-e4d256-prod-github-runner-207 kernel: [75476.624876] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 02:21:42 juju-e4d256-prod-github-runner-207 kernel: [75476.625771] Aug 23 02:22:10 juju-e4d256-prod-github-runner-207 kernel: [75504.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 70211s! [qemu-system-x86:6715] Aug 23 02:22:10 juju-e4d256-prod-github-runner-207 kernel: [75504.543085] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 02:22:10 juju-e4d256-prod-github-runner-207 kernel: [75504.543153] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 02:22:10 juju-e4d256-prod-github-runner-207 kernel: [75504.555188] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 02:22:10 juju-e4d256-prod-github-runner-207 kernel: [75504.556461] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 02:22:10 juju-e4d256-prod-github-runner-207 kernel: [75504.557683] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:22:10 juju-e4d256-prod-github-runner-207 kernel: [75504.558737] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 02:22:10 juju-e4d256-prod-github-runner-207 kernel: [75504.561307] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 02:22:10 juju-e4d256-prod-github-runner-207 kernel: [75504.562348] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 02:22:10 juju-e4d256-prod-github-runner-207 kernel: [75504.563507] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 02:22:10 juju-e4d256-prod-github-runner-207 kernel: [75504.564680] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 02:22:10 juju-e4d256-prod-github-runner-207 kernel: [75504.565836] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 02:22:10 juju-e4d256-prod-github-runner-207 kernel: [75504.566998] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 02:22:10 juju-e4d256-prod-github-runner-207 kernel: [75504.568170] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 02:22:10 juju-e4d256-prod-github-runner-207 kernel: [75504.569408] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 02:22:10 juju-e4d256-prod-github-runner-207 kernel: [75504.570573] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 02:22:10 juju-e4d256-prod-github-runner-207 kernel: [75504.571776] Call Trace: Aug 23 02:22:10 juju-e4d256-prod-github-runner-207 kernel: [75504.572686] Aug 23 02:22:10 juju-e4d256-prod-github-runner-207 kernel: [75504.573569] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:22:10 juju-e4d256-prod-github-runner-207 kernel: [75504.574599] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:22:10 juju-e4d256-prod-github-runner-207 kernel: [75504.575618] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:22:10 juju-e4d256-prod-github-runner-207 kernel: [75504.576703] ? show_regs.part.0+0x23/0x29 Aug 23 02:22:10 juju-e4d256-prod-github-runner-207 kernel: [75504.577716] ? show_regs.cold+0x8/0xd Aug 23 02:22:10 juju-e4d256-prod-github-runner-207 kernel: [75504.578684] ? watchdog_timer_fn+0x1be/0x220 Aug 23 02:22:10 juju-e4d256-prod-github-runner-207 kernel: [75504.579698] ? lockup_detector_update_enable+0x60/0x60 Aug 23 02:22:10 juju-e4d256-prod-github-runner-207 kernel: [75504.580761] ? __hrtimer_run_queues+0x107/0x230 Aug 23 02:22:10 juju-e4d256-prod-github-runner-207 kernel: [75504.581788] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 02:22:10 juju-e4d256-prod-github-runner-207 kernel: [75504.582809] ? hrtimer_interrupt+0x101/0x220 Aug 23 02:22:10 juju-e4d256-prod-github-runner-207 kernel: [75504.583831] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 02:22:10 juju-e4d256-prod-github-runner-207 kernel: [75504.584899] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 02:22:10 juju-e4d256-prod-github-runner-207 kernel: [75504.585944] Aug 23 02:22:10 juju-e4d256-prod-github-runner-207 kernel: [75504.586794] Aug 23 02:22:10 juju-e4d256-prod-github-runner-207 kernel: [75504.587638] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 02:22:10 juju-e4d256-prod-github-runner-207 kernel: [75504.588678] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:22:10 juju-e4d256-prod-github-runner-207 kernel: [75504.589716] ? _raw_spin_lock+0x22/0x30 Aug 23 02:22:10 juju-e4d256-prod-github-runner-207 kernel: [75504.590660] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:22:10 juju-e4d256-prod-github-runner-207 kernel: [75504.591687] direct_page_fault+0x206/0x310 [kvm] Aug 23 02:22:10 juju-e4d256-prod-github-runner-207 kernel: [75504.592710] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 02:22:10 juju-e4d256-prod-github-runner-207 kernel: [75504.593724] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 02:22:10 juju-e4d256-prod-github-runner-207 kernel: [75504.594722] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 02:22:10 juju-e4d256-prod-github-runner-207 kernel: [75504.595698] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 02:22:10 juju-e4d256-prod-github-runner-207 kernel: [75504.596642] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 02:22:10 juju-e4d256-prod-github-runner-207 kernel: [75504.597618] handle_exit+0x98/0x230 [kvm_amd] Aug 23 02:22:10 juju-e4d256-prod-github-runner-207 kernel: [75504.598507] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 02:22:10 juju-e4d256-prod-github-runner-207 kernel: [75504.599425] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 02:22:10 juju-e4d256-prod-github-runner-207 kernel: [75504.600357] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 02:22:10 juju-e4d256-prod-github-runner-207 kernel: [75504.601268] vcpu_run+0x62/0x2c0 [kvm] Aug 23 02:22:10 juju-e4d256-prod-github-runner-207 kernel: [75504.602078] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 02:22:10 juju-e4d256-prod-github-runner-207 kernel: [75504.602883] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 02:22:10 juju-e4d256-prod-github-runner-207 kernel: [75504.603742] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 02:22:10 juju-e4d256-prod-github-runner-207 kernel: [75504.604538] ? __seccomp_filter+0x4a/0x4a0 Aug 23 02:22:10 juju-e4d256-prod-github-runner-207 kernel: [75504.605281] ? __fget_files+0x86/0xc0 Aug 23 02:22:10 juju-e4d256-prod-github-runner-207 kernel: [75504.605984] __x64_sys_ioctl+0x95/0xd0 Aug 23 02:22:10 juju-e4d256-prod-github-runner-207 kernel: [75504.606675] do_syscall_64+0x5c/0xc0 Aug 23 02:22:10 juju-e4d256-prod-github-runner-207 kernel: [75504.607337] ? do_futex+0x162/0x1f0 Aug 23 02:22:10 juju-e4d256-prod-github-runner-207 kernel: [75504.607996] ? __x64_sys_futex+0x78/0x1e0 Aug 23 02:22:10 juju-e4d256-prod-github-runner-207 kernel: [75504.608668] ? __secure_computing+0xa9/0x120 Aug 23 02:22:10 juju-e4d256-prod-github-runner-207 kernel: [75504.609357] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 02:22:10 juju-e4d256-prod-github-runner-207 kernel: [75504.610115] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:22:10 juju-e4d256-prod-github-runner-207 kernel: [75504.610834] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:22:10 juju-e4d256-prod-github-runner-207 kernel: [75504.611551] ? do_syscall_64+0x69/0xc0 Aug 23 02:22:10 juju-e4d256-prod-github-runner-207 kernel: [75504.612202] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:22:10 juju-e4d256-prod-github-runner-207 kernel: [75504.612903] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:22:10 juju-e4d256-prod-github-runner-207 kernel: [75504.613596] ? do_syscall_64+0x69/0xc0 Aug 23 02:22:10 juju-e4d256-prod-github-runner-207 kernel: [75504.614219] ? do_syscall_64+0x69/0xc0 Aug 23 02:22:10 juju-e4d256-prod-github-runner-207 kernel: [75504.614838] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 02:22:10 juju-e4d256-prod-github-runner-207 kernel: [75504.615548] RIP: 0033:0x7faa5d0edaff Aug 23 02:22:10 juju-e4d256-prod-github-runner-207 kernel: [75504.616184] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 02:22:10 juju-e4d256-prod-github-runner-207 kernel: [75504.618163] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 02:22:10 juju-e4d256-prod-github-runner-207 kernel: [75504.619074] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 02:22:10 juju-e4d256-prod-github-runner-207 kernel: [75504.619975] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 02:22:10 juju-e4d256-prod-github-runner-207 kernel: [75504.620863] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 02:22:10 juju-e4d256-prod-github-runner-207 kernel: [75504.621750] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 02:22:10 juju-e4d256-prod-github-runner-207 kernel: [75504.622635] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 02:22:10 juju-e4d256-prod-github-runner-207 kernel: [75504.623524] Aug 23 02:22:38 juju-e4d256-prod-github-runner-207 kernel: [75532.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 70237s! [qemu-system-x86:6715] Aug 23 02:22:38 juju-e4d256-prod-github-runner-207 kernel: [75532.543131] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 02:22:38 juju-e4d256-prod-github-runner-207 kernel: [75532.543200] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 02:22:38 juju-e4d256-prod-github-runner-207 kernel: [75532.555299] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 02:22:38 juju-e4d256-prod-github-runner-207 kernel: [75532.556581] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 02:22:38 juju-e4d256-prod-github-runner-207 kernel: [75532.557803] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:22:38 juju-e4d256-prod-github-runner-207 kernel: [75532.558865] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 02:22:38 juju-e4d256-prod-github-runner-207 kernel: [75532.561427] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 02:22:38 juju-e4d256-prod-github-runner-207 kernel: [75532.562475] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 02:22:38 juju-e4d256-prod-github-runner-207 kernel: [75532.563649] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 02:22:38 juju-e4d256-prod-github-runner-207 kernel: [75532.564811] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 02:22:38 juju-e4d256-prod-github-runner-207 kernel: [75532.565976] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 02:22:38 juju-e4d256-prod-github-runner-207 kernel: [75532.567222] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 02:22:38 juju-e4d256-prod-github-runner-207 kernel: [75532.568394] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 02:22:38 juju-e4d256-prod-github-runner-207 kernel: [75532.569631] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 02:22:38 juju-e4d256-prod-github-runner-207 kernel: [75532.570733] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 02:22:38 juju-e4d256-prod-github-runner-207 kernel: [75532.571935] Call Trace: Aug 23 02:22:38 juju-e4d256-prod-github-runner-207 kernel: [75532.572962] Aug 23 02:22:38 juju-e4d256-prod-github-runner-207 kernel: [75532.573850] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:22:38 juju-e4d256-prod-github-runner-207 kernel: [75532.574878] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:22:38 juju-e4d256-prod-github-runner-207 kernel: [75532.575910] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:22:38 juju-e4d256-prod-github-runner-207 kernel: [75532.576989] ? show_regs.part.0+0x23/0x29 Aug 23 02:22:38 juju-e4d256-prod-github-runner-207 kernel: [75532.578015] ? show_regs.cold+0x8/0xd Aug 23 02:22:38 juju-e4d256-prod-github-runner-207 kernel: [75532.578984] ? watchdog_timer_fn+0x1be/0x220 Aug 23 02:22:38 juju-e4d256-prod-github-runner-207 kernel: [75532.579999] ? lockup_detector_update_enable+0x60/0x60 Aug 23 02:22:38 juju-e4d256-prod-github-runner-207 kernel: [75532.581066] ? __hrtimer_run_queues+0x107/0x230 Aug 23 02:22:38 juju-e4d256-prod-github-runner-207 kernel: [75532.582093] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 02:22:38 juju-e4d256-prod-github-runner-207 kernel: [75532.583120] ? hrtimer_interrupt+0x101/0x220 Aug 23 02:22:38 juju-e4d256-prod-github-runner-207 kernel: [75532.584145] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 02:22:38 juju-e4d256-prod-github-runner-207 kernel: [75532.585213] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 02:22:38 juju-e4d256-prod-github-runner-207 kernel: [75532.586257] Aug 23 02:22:38 juju-e4d256-prod-github-runner-207 kernel: [75532.587109] Aug 23 02:22:38 juju-e4d256-prod-github-runner-207 kernel: [75532.587961] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 02:22:38 juju-e4d256-prod-github-runner-207 kernel: [75532.588999] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:22:38 juju-e4d256-prod-github-runner-207 kernel: [75532.590036] ? _raw_spin_lock+0x22/0x30 Aug 23 02:22:38 juju-e4d256-prod-github-runner-207 kernel: [75532.590984] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:22:38 juju-e4d256-prod-github-runner-207 kernel: [75532.592014] direct_page_fault+0x206/0x310 [kvm] Aug 23 02:22:38 juju-e4d256-prod-github-runner-207 kernel: [75532.593042] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 02:22:38 juju-e4d256-prod-github-runner-207 kernel: [75532.594054] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 02:22:38 juju-e4d256-prod-github-runner-207 kernel: [75532.595051] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 02:22:38 juju-e4d256-prod-github-runner-207 kernel: [75532.596042] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 02:22:38 juju-e4d256-prod-github-runner-207 kernel: [75532.596993] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 02:22:38 juju-e4d256-prod-github-runner-207 kernel: [75532.597970] handle_exit+0x98/0x230 [kvm_amd] Aug 23 02:22:38 juju-e4d256-prod-github-runner-207 kernel: [75532.598862] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 02:22:38 juju-e4d256-prod-github-runner-207 kernel: [75532.599782] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 02:22:38 juju-e4d256-prod-github-runner-207 kernel: [75532.600704] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 02:22:38 juju-e4d256-prod-github-runner-207 kernel: [75532.601607] vcpu_run+0x62/0x2c0 [kvm] Aug 23 02:22:38 juju-e4d256-prod-github-runner-207 kernel: [75532.602419] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 02:22:38 juju-e4d256-prod-github-runner-207 kernel: [75532.603224] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 02:22:38 juju-e4d256-prod-github-runner-207 kernel: [75532.604088] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 02:22:38 juju-e4d256-prod-github-runner-207 kernel: [75532.604887] ? __seccomp_filter+0x4a/0x4a0 Aug 23 02:22:38 juju-e4d256-prod-github-runner-207 kernel: [75532.605626] ? __fget_files+0x86/0xc0 Aug 23 02:22:38 juju-e4d256-prod-github-runner-207 kernel: [75532.606326] __x64_sys_ioctl+0x95/0xd0 Aug 23 02:22:38 juju-e4d256-prod-github-runner-207 kernel: [75532.607022] do_syscall_64+0x5c/0xc0 Aug 23 02:22:38 juju-e4d256-prod-github-runner-207 kernel: [75532.607692] ? do_futex+0x162/0x1f0 Aug 23 02:22:38 juju-e4d256-prod-github-runner-207 kernel: [75532.608339] ? __x64_sys_futex+0x78/0x1e0 Aug 23 02:22:38 juju-e4d256-prod-github-runner-207 kernel: [75532.609010] ? __secure_computing+0xa9/0x120 Aug 23 02:22:38 juju-e4d256-prod-github-runner-207 kernel: [75532.609701] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 02:22:38 juju-e4d256-prod-github-runner-207 kernel: [75532.610456] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:22:38 juju-e4d256-prod-github-runner-207 kernel: [75532.611175] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:22:38 juju-e4d256-prod-github-runner-207 kernel: [75532.611902] ? do_syscall_64+0x69/0xc0 Aug 23 02:22:38 juju-e4d256-prod-github-runner-207 kernel: [75532.612543] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:22:38 juju-e4d256-prod-github-runner-207 kernel: [75532.613246] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:22:38 juju-e4d256-prod-github-runner-207 kernel: [75532.613943] ? do_syscall_64+0x69/0xc0 Aug 23 02:22:38 juju-e4d256-prod-github-runner-207 kernel: [75532.614564] ? do_syscall_64+0x69/0xc0 Aug 23 02:22:38 juju-e4d256-prod-github-runner-207 kernel: [75532.615183] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 02:22:38 juju-e4d256-prod-github-runner-207 kernel: [75532.615897] RIP: 0033:0x7faa5d0edaff Aug 23 02:22:38 juju-e4d256-prod-github-runner-207 kernel: [75532.616518] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 02:22:38 juju-e4d256-prod-github-runner-207 kernel: [75532.618582] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 02:22:38 juju-e4d256-prod-github-runner-207 kernel: [75532.619541] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 02:22:38 juju-e4d256-prod-github-runner-207 kernel: [75532.620433] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 02:22:38 juju-e4d256-prod-github-runner-207 kernel: [75532.621324] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 02:22:38 juju-e4d256-prod-github-runner-207 kernel: [75532.622207] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 02:22:38 juju-e4d256-prod-github-runner-207 kernel: [75532.623097] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 02:22:38 juju-e4d256-prod-github-runner-207 kernel: [75532.623994] Aug 23 02:23:06 juju-e4d256-prod-github-runner-207 kernel: [75560.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 70263s! [qemu-system-x86:6715] Aug 23 02:23:06 juju-e4d256-prod-github-runner-207 kernel: [75560.543723] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 02:23:06 juju-e4d256-prod-github-runner-207 kernel: [75560.543959] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 02:23:06 juju-e4d256-prod-github-runner-207 kernel: [75560.556083] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 02:23:06 juju-e4d256-prod-github-runner-207 kernel: [75560.557349] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 02:23:06 juju-e4d256-prod-github-runner-207 kernel: [75560.558574] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:23:06 juju-e4d256-prod-github-runner-207 kernel: [75560.559643] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 02:23:06 juju-e4d256-prod-github-runner-207 kernel: [75560.562196] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 02:23:06 juju-e4d256-prod-github-runner-207 kernel: [75560.563261] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 02:23:06 juju-e4d256-prod-github-runner-207 kernel: [75560.564423] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 02:23:06 juju-e4d256-prod-github-runner-207 kernel: [75560.565585] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 02:23:06 juju-e4d256-prod-github-runner-207 kernel: [75560.566878] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 02:23:06 juju-e4d256-prod-github-runner-207 kernel: [75560.568058] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 02:23:06 juju-e4d256-prod-github-runner-207 kernel: [75560.569220] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 02:23:06 juju-e4d256-prod-github-runner-207 kernel: [75560.570447] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 02:23:06 juju-e4d256-prod-github-runner-207 kernel: [75560.571562] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 02:23:06 juju-e4d256-prod-github-runner-207 kernel: [75560.572753] Call Trace: Aug 23 02:23:06 juju-e4d256-prod-github-runner-207 kernel: [75560.573666] Aug 23 02:23:06 juju-e4d256-prod-github-runner-207 kernel: [75560.574607] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:23:06 juju-e4d256-prod-github-runner-207 kernel: [75560.575652] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:23:06 juju-e4d256-prod-github-runner-207 kernel: [75560.576681] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:23:06 juju-e4d256-prod-github-runner-207 kernel: [75560.577775] ? show_regs.part.0+0x23/0x29 Aug 23 02:23:06 juju-e4d256-prod-github-runner-207 kernel: [75560.578784] ? show_regs.cold+0x8/0xd Aug 23 02:23:06 juju-e4d256-prod-github-runner-207 kernel: [75560.579787] ? watchdog_timer_fn+0x1be/0x220 Aug 23 02:23:06 juju-e4d256-prod-github-runner-207 kernel: [75560.580794] ? lockup_detector_update_enable+0x60/0x60 Aug 23 02:23:06 juju-e4d256-prod-github-runner-207 kernel: [75560.581874] ? __hrtimer_run_queues+0x107/0x230 Aug 23 02:23:06 juju-e4d256-prod-github-runner-207 kernel: [75560.582902] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 02:23:06 juju-e4d256-prod-github-runner-207 kernel: [75560.583954] ? hrtimer_interrupt+0x101/0x220 Aug 23 02:23:06 juju-e4d256-prod-github-runner-207 kernel: [75560.584966] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 02:23:06 juju-e4d256-prod-github-runner-207 kernel: [75560.586033] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 02:23:06 juju-e4d256-prod-github-runner-207 kernel: [75560.587113] Aug 23 02:23:06 juju-e4d256-prod-github-runner-207 kernel: [75560.587965] Aug 23 02:23:06 juju-e4d256-prod-github-runner-207 kernel: [75560.588800] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 02:23:06 juju-e4d256-prod-github-runner-207 kernel: [75560.589830] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:23:06 juju-e4d256-prod-github-runner-207 kernel: [75560.590871] ? _raw_spin_lock+0x22/0x30 Aug 23 02:23:06 juju-e4d256-prod-github-runner-207 kernel: [75560.592700] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:23:06 juju-e4d256-prod-github-runner-207 kernel: [75560.593720] direct_page_fault+0x206/0x310 [kvm] Aug 23 02:23:06 juju-e4d256-prod-github-runner-207 kernel: [75560.594742] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 02:23:06 juju-e4d256-prod-github-runner-207 kernel: [75560.595774] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 02:23:06 juju-e4d256-prod-github-runner-207 kernel: [75560.596781] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 02:23:06 juju-e4d256-prod-github-runner-207 kernel: [75560.597788] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 02:23:06 juju-e4d256-prod-github-runner-207 kernel: [75560.598740] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 02:23:06 juju-e4d256-prod-github-runner-207 kernel: [75560.599733] handle_exit+0x98/0x230 [kvm_amd] Aug 23 02:23:06 juju-e4d256-prod-github-runner-207 kernel: [75560.600622] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 02:23:06 juju-e4d256-prod-github-runner-207 kernel: [75560.601535] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 02:23:06 juju-e4d256-prod-github-runner-207 kernel: [75560.602509] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 02:23:06 juju-e4d256-prod-github-runner-207 kernel: [75560.603549] vcpu_run+0x62/0x2c0 [kvm] Aug 23 02:23:06 juju-e4d256-prod-github-runner-207 kernel: [75560.604371] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 02:23:06 juju-e4d256-prod-github-runner-207 kernel: [75560.605177] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 02:23:06 juju-e4d256-prod-github-runner-207 kernel: [75560.606034] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 02:23:06 juju-e4d256-prod-github-runner-207 kernel: [75560.606827] ? __seccomp_filter+0x4a/0x4a0 Aug 23 02:23:06 juju-e4d256-prod-github-runner-207 kernel: [75560.607607] ? __fget_files+0x86/0xc0 Aug 23 02:23:06 juju-e4d256-prod-github-runner-207 kernel: [75560.608316] __x64_sys_ioctl+0x95/0xd0 Aug 23 02:23:06 juju-e4d256-prod-github-runner-207 kernel: [75560.609026] do_syscall_64+0x5c/0xc0 Aug 23 02:23:06 juju-e4d256-prod-github-runner-207 kernel: [75560.609699] ? do_futex+0x162/0x1f0 Aug 23 02:23:06 juju-e4d256-prod-github-runner-207 kernel: [75560.610344] ? __x64_sys_futex+0x78/0x1e0 Aug 23 02:23:06 juju-e4d256-prod-github-runner-207 kernel: [75560.611040] ? __secure_computing+0xa9/0x120 Aug 23 02:23:06 juju-e4d256-prod-github-runner-207 kernel: [75560.611727] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 02:23:06 juju-e4d256-prod-github-runner-207 kernel: [75560.612499] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:23:06 juju-e4d256-prod-github-runner-207 kernel: [75560.613227] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:23:06 juju-e4d256-prod-github-runner-207 kernel: [75560.613943] ? do_syscall_64+0x69/0xc0 Aug 23 02:23:06 juju-e4d256-prod-github-runner-207 kernel: [75560.614585] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:23:06 juju-e4d256-prod-github-runner-207 kernel: [75560.615307] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:23:06 juju-e4d256-prod-github-runner-207 kernel: [75560.615998] ? do_syscall_64+0x69/0xc0 Aug 23 02:23:06 juju-e4d256-prod-github-runner-207 kernel: [75560.616619] ? do_syscall_64+0x69/0xc0 Aug 23 02:23:06 juju-e4d256-prod-github-runner-207 kernel: [75560.617245] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 02:23:06 juju-e4d256-prod-github-runner-207 kernel: [75560.617956] RIP: 0033:0x7faa5d0edaff Aug 23 02:23:06 juju-e4d256-prod-github-runner-207 kernel: [75560.618609] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 02:23:06 juju-e4d256-prod-github-runner-207 kernel: [75560.620603] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 02:23:06 juju-e4d256-prod-github-runner-207 kernel: [75560.621515] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 02:23:06 juju-e4d256-prod-github-runner-207 kernel: [75560.622415] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 02:23:06 juju-e4d256-prod-github-runner-207 kernel: [75560.623316] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 02:23:06 juju-e4d256-prod-github-runner-207 kernel: [75560.624207] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 02:23:06 juju-e4d256-prod-github-runner-207 kernel: [75560.625093] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 02:23:06 juju-e4d256-prod-github-runner-207 kernel: [75560.625988] Aug 23 02:23:34 juju-e4d256-prod-github-runner-207 kernel: [75588.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 70289s! [qemu-system-x86:6715] Aug 23 02:23:34 juju-e4d256-prod-github-runner-207 kernel: [75588.543117] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 02:23:34 juju-e4d256-prod-github-runner-207 kernel: [75588.543187] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 02:23:34 juju-e4d256-prod-github-runner-207 kernel: [75588.555233] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 02:23:34 juju-e4d256-prod-github-runner-207 kernel: [75588.556502] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 02:23:34 juju-e4d256-prod-github-runner-207 kernel: [75588.557721] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:23:34 juju-e4d256-prod-github-runner-207 kernel: [75588.558932] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 02:23:34 juju-e4d256-prod-github-runner-207 kernel: [75588.561471] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 02:23:34 juju-e4d256-prod-github-runner-207 kernel: [75588.562510] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 02:23:34 juju-e4d256-prod-github-runner-207 kernel: [75588.563682] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 02:23:34 juju-e4d256-prod-github-runner-207 kernel: [75588.564842] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 02:23:34 juju-e4d256-prod-github-runner-207 kernel: [75588.566084] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 02:23:34 juju-e4d256-prod-github-runner-207 kernel: [75588.567264] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 02:23:34 juju-e4d256-prod-github-runner-207 kernel: [75588.568435] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 02:23:34 juju-e4d256-prod-github-runner-207 kernel: [75588.569683] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 02:23:34 juju-e4d256-prod-github-runner-207 kernel: [75588.570794] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 02:23:34 juju-e4d256-prod-github-runner-207 kernel: [75588.571987] Call Trace: Aug 23 02:23:34 juju-e4d256-prod-github-runner-207 kernel: [75588.572896] Aug 23 02:23:34 juju-e4d256-prod-github-runner-207 kernel: [75588.573777] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:23:34 juju-e4d256-prod-github-runner-207 kernel: [75588.574818] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:23:34 juju-e4d256-prod-github-runner-207 kernel: [75588.575836] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:23:34 juju-e4d256-prod-github-runner-207 kernel: [75588.576906] ? show_regs.part.0+0x23/0x29 Aug 23 02:23:34 juju-e4d256-prod-github-runner-207 kernel: [75588.577905] ? show_regs.cold+0x8/0xd Aug 23 02:23:34 juju-e4d256-prod-github-runner-207 kernel: [75588.578881] ? watchdog_timer_fn+0x1be/0x220 Aug 23 02:23:34 juju-e4d256-prod-github-runner-207 kernel: [75588.579888] ? lockup_detector_update_enable+0x60/0x60 Aug 23 02:23:34 juju-e4d256-prod-github-runner-207 kernel: [75588.580949] ? __hrtimer_run_queues+0x107/0x230 Aug 23 02:23:34 juju-e4d256-prod-github-runner-207 kernel: [75588.581979] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 02:23:34 juju-e4d256-prod-github-runner-207 kernel: [75588.583040] ? hrtimer_interrupt+0x101/0x220 Aug 23 02:23:34 juju-e4d256-prod-github-runner-207 kernel: [75588.584060] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 02:23:34 juju-e4d256-prod-github-runner-207 kernel: [75588.585125] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 02:23:34 juju-e4d256-prod-github-runner-207 kernel: [75588.586167] Aug 23 02:23:34 juju-e4d256-prod-github-runner-207 kernel: [75588.587038] Aug 23 02:23:34 juju-e4d256-prod-github-runner-207 kernel: [75588.587873] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 02:23:34 juju-e4d256-prod-github-runner-207 kernel: [75588.589030] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:23:34 juju-e4d256-prod-github-runner-207 kernel: [75588.590087] ? _raw_spin_lock+0x22/0x30 Aug 23 02:23:34 juju-e4d256-prod-github-runner-207 kernel: [75588.591049] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:23:34 juju-e4d256-prod-github-runner-207 kernel: [75588.592069] direct_page_fault+0x206/0x310 [kvm] Aug 23 02:23:34 juju-e4d256-prod-github-runner-207 kernel: [75588.593093] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 02:23:34 juju-e4d256-prod-github-runner-207 kernel: [75588.594107] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 02:23:34 juju-e4d256-prod-github-runner-207 kernel: [75588.595122] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 02:23:34 juju-e4d256-prod-github-runner-207 kernel: [75588.596094] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 02:23:34 juju-e4d256-prod-github-runner-207 kernel: [75588.597040] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 02:23:34 juju-e4d256-prod-github-runner-207 kernel: [75588.598019] handle_exit+0x98/0x230 [kvm_amd] Aug 23 02:23:34 juju-e4d256-prod-github-runner-207 kernel: [75588.598959] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 02:23:34 juju-e4d256-prod-github-runner-207 kernel: [75588.599894] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 02:23:34 juju-e4d256-prod-github-runner-207 kernel: [75588.600817] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 02:23:34 juju-e4d256-prod-github-runner-207 kernel: [75588.601722] vcpu_run+0x62/0x2c0 [kvm] Aug 23 02:23:34 juju-e4d256-prod-github-runner-207 kernel: [75588.602534] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 02:23:34 juju-e4d256-prod-github-runner-207 kernel: [75588.603359] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 02:23:34 juju-e4d256-prod-github-runner-207 kernel: [75588.604207] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 02:23:34 juju-e4d256-prod-github-runner-207 kernel: [75588.605003] ? __seccomp_filter+0x4a/0x4a0 Aug 23 02:23:34 juju-e4d256-prod-github-runner-207 kernel: [75588.605742] ? __fget_files+0x86/0xc0 Aug 23 02:23:34 juju-e4d256-prod-github-runner-207 kernel: [75588.606845] __x64_sys_ioctl+0x95/0xd0 Aug 23 02:23:34 juju-e4d256-prod-github-runner-207 kernel: [75588.607538] do_syscall_64+0x5c/0xc0 Aug 23 02:23:34 juju-e4d256-prod-github-runner-207 kernel: [75588.608199] ? do_futex+0x162/0x1f0 Aug 23 02:23:34 juju-e4d256-prod-github-runner-207 kernel: [75588.608844] ? __x64_sys_futex+0x78/0x1e0 Aug 23 02:23:34 juju-e4d256-prod-github-runner-207 kernel: [75588.609518] ? __secure_computing+0xa9/0x120 Aug 23 02:23:34 juju-e4d256-prod-github-runner-207 kernel: [75588.610203] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 02:23:34 juju-e4d256-prod-github-runner-207 kernel: [75588.610973] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:23:34 juju-e4d256-prod-github-runner-207 kernel: [75588.611697] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:23:34 juju-e4d256-prod-github-runner-207 kernel: [75588.612421] ? do_syscall_64+0x69/0xc0 Aug 23 02:23:34 juju-e4d256-prod-github-runner-207 kernel: [75588.613074] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:23:34 juju-e4d256-prod-github-runner-207 kernel: [75588.613775] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:23:34 juju-e4d256-prod-github-runner-207 kernel: [75588.614471] ? do_syscall_64+0x69/0xc0 Aug 23 02:23:34 juju-e4d256-prod-github-runner-207 kernel: [75588.615106] ? do_syscall_64+0x69/0xc0 Aug 23 02:23:34 juju-e4d256-prod-github-runner-207 kernel: [75588.615726] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 02:23:34 juju-e4d256-prod-github-runner-207 kernel: [75588.616428] RIP: 0033:0x7faa5d0edaff Aug 23 02:23:34 juju-e4d256-prod-github-runner-207 kernel: [75588.617049] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 02:23:34 juju-e4d256-prod-github-runner-207 kernel: [75588.619046] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 02:23:34 juju-e4d256-prod-github-runner-207 kernel: [75588.620003] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 02:23:34 juju-e4d256-prod-github-runner-207 kernel: [75588.620904] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 02:23:34 juju-e4d256-prod-github-runner-207 kernel: [75588.621795] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 02:23:34 juju-e4d256-prod-github-runner-207 kernel: [75588.622723] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 02:23:34 juju-e4d256-prod-github-runner-207 kernel: [75588.623645] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 02:23:34 juju-e4d256-prod-github-runner-207 kernel: [75588.624538] Aug 23 02:23:48 juju-e4d256-prod-github-runner-207 kernel: [75602.228709] rcu: INFO: rcu_sched self-detected stall on CPU Aug 23 02:23:48 juju-e4d256-prod-github-runner-207 kernel: [75602.229664] rcu: 1-....: (18811974 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=9093415 Aug 23 02:23:48 juju-e4d256-prod-github-runner-207 kernel: [75602.230806] (t=18871257 jiffies g=23269 q=63959) Aug 23 02:23:48 juju-e4d256-prod-github-runner-207 kernel: [75602.231613] NMI backtrace for cpu 1 Aug 23 02:23:48 juju-e4d256-prod-github-runner-207 kernel: [75602.232327] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 02:23:48 juju-e4d256-prod-github-runner-207 kernel: [75602.233459] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 02:23:48 juju-e4d256-prod-github-runner-207 kernel: [75602.234536] Call Trace: Aug 23 02:23:48 juju-e4d256-prod-github-runner-207 kernel: [75602.235212] Aug 23 02:23:48 juju-e4d256-prod-github-runner-207 kernel: [75602.235857] show_stack+0x52/0x5c Aug 23 02:23:48 juju-e4d256-prod-github-runner-207 kernel: [75602.236584] dump_stack_lvl+0x4a/0x63 Aug 23 02:23:48 juju-e4d256-prod-github-runner-207 kernel: [75602.237338] dump_stack+0x10/0x16 Aug 23 02:23:48 juju-e4d256-prod-github-runner-207 kernel: [75602.238057] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 23 02:23:48 juju-e4d256-prod-github-runner-207 kernel: [75602.238859] ? lapic_can_unplug_cpu+0x90/0x90 Aug 23 02:23:48 juju-e4d256-prod-github-runner-207 kernel: [75602.239645] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 23 02:23:48 juju-e4d256-prod-github-runner-207 kernel: [75602.240467] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 23 02:23:48 juju-e4d256-prod-github-runner-207 kernel: [75602.241289] trigger_single_cpu_backtrace+0x44/0x4f Aug 23 02:23:48 juju-e4d256-prod-github-runner-207 kernel: [75602.242100] rcu_dump_cpu_stacks+0x102/0x149 Aug 23 02:23:48 juju-e4d256-prod-github-runner-207 kernel: [75602.242890] print_cpu_stall.cold+0x2f/0xe2 Aug 23 02:23:48 juju-e4d256-prod-github-runner-207 kernel: [75602.243654] ? timekeeping_update+0xf7/0x150 Aug 23 02:23:48 juju-e4d256-prod-github-runner-207 kernel: [75602.244441] check_cpu_stall+0x109/0x270 Aug 23 02:23:48 juju-e4d256-prod-github-runner-207 kernel: [75602.245192] rcu_sched_clock_irq+0x9a/0x250 Aug 23 02:23:48 juju-e4d256-prod-github-runner-207 kernel: [75602.245960] update_process_times+0x94/0xd0 Aug 23 02:23:48 juju-e4d256-prod-github-runner-207 kernel: [75602.246750] tick_sched_handle+0x29/0x70 Aug 23 02:23:48 juju-e4d256-prod-github-runner-207 kernel: [75602.247498] tick_sched_timer+0x8c/0xc0 Aug 23 02:23:48 juju-e4d256-prod-github-runner-207 kernel: [75602.248235] ? tick_nohz_handler+0xb0/0xb0 Aug 23 02:23:48 juju-e4d256-prod-github-runner-207 kernel: [75602.248989] __hrtimer_run_queues+0x107/0x230 Aug 23 02:23:48 juju-e4d256-prod-github-runner-207 kernel: [75602.249762] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 02:23:48 juju-e4d256-prod-github-runner-207 kernel: [75602.250549] hrtimer_interrupt+0x101/0x220 Aug 23 02:23:48 juju-e4d256-prod-github-runner-207 kernel: [75602.251308] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 02:23:48 juju-e4d256-prod-github-runner-207 kernel: [75602.252133] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 02:23:48 juju-e4d256-prod-github-runner-207 kernel: [75602.252942] Aug 23 02:23:48 juju-e4d256-prod-github-runner-207 kernel: [75602.253578] Aug 23 02:23:48 juju-e4d256-prod-github-runner-207 kernel: [75602.254219] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 02:23:48 juju-e4d256-prod-github-runner-207 kernel: [75602.255053] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:23:48 juju-e4d256-prod-github-runner-207 kernel: [75602.255935] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 02:23:48 juju-e4d256-prod-github-runner-207 kernel: [75602.258141] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 02:23:48 juju-e4d256-prod-github-runner-207 kernel: [75602.259041] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 02:23:48 juju-e4d256-prod-github-runner-207 kernel: [75602.260040] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 02:23:48 juju-e4d256-prod-github-runner-207 kernel: [75602.261026] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 02:23:48 juju-e4d256-prod-github-runner-207 kernel: [75602.261995] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 02:23:48 juju-e4d256-prod-github-runner-207 kernel: [75602.262966] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 02:23:48 juju-e4d256-prod-github-runner-207 kernel: [75602.263918] ? _raw_spin_lock+0x22/0x30 Aug 23 02:23:48 juju-e4d256-prod-github-runner-207 kernel: [75602.264691] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:23:48 juju-e4d256-prod-github-runner-207 kernel: [75602.265527] direct_page_fault+0x206/0x310 [kvm] Aug 23 02:23:48 juju-e4d256-prod-github-runner-207 kernel: [75602.266363] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 02:23:48 juju-e4d256-prod-github-runner-207 kernel: [75602.267212] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 02:23:48 juju-e4d256-prod-github-runner-207 kernel: [75602.268041] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 02:23:48 juju-e4d256-prod-github-runner-207 kernel: [75602.268844] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 02:23:48 juju-e4d256-prod-github-runner-207 kernel: [75602.269645] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 02:23:48 juju-e4d256-prod-github-runner-207 kernel: [75602.270468] handle_exit+0x98/0x230 [kvm_amd] Aug 23 02:23:48 juju-e4d256-prod-github-runner-207 kernel: [75602.271228] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 02:23:48 juju-e4d256-prod-github-runner-207 kernel: [75602.272014] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 02:23:48 juju-e4d256-prod-github-runner-207 kernel: [75602.272823] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 02:23:48 juju-e4d256-prod-github-runner-207 kernel: [75602.273609] vcpu_run+0x62/0x2c0 [kvm] Aug 23 02:23:48 juju-e4d256-prod-github-runner-207 kernel: [75602.274323] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 02:23:48 juju-e4d256-prod-github-runner-207 kernel: [75602.275060] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 02:23:48 juju-e4d256-prod-github-runner-207 kernel: [75602.275859] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 02:23:48 juju-e4d256-prod-github-runner-207 kernel: [75602.276617] ? __seccomp_filter+0x4a/0x4a0 Aug 23 02:23:48 juju-e4d256-prod-github-runner-207 kernel: [75602.277341] ? __fget_files+0x86/0xc0 Aug 23 02:23:48 juju-e4d256-prod-github-runner-207 kernel: [75602.278033] __x64_sys_ioctl+0x95/0xd0 Aug 23 02:23:48 juju-e4d256-prod-github-runner-207 kernel: [75602.278738] do_syscall_64+0x5c/0xc0 Aug 23 02:23:48 juju-e4d256-prod-github-runner-207 kernel: [75602.279417] ? do_futex+0x162/0x1f0 Aug 23 02:23:48 juju-e4d256-prod-github-runner-207 kernel: [75602.280086] ? __x64_sys_futex+0x78/0x1e0 Aug 23 02:23:48 juju-e4d256-prod-github-runner-207 kernel: [75602.280806] ? __secure_computing+0xa9/0x120 Aug 23 02:23:48 juju-e4d256-prod-github-runner-207 kernel: [75602.281534] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 02:23:48 juju-e4d256-prod-github-runner-207 kernel: [75602.282325] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:23:48 juju-e4d256-prod-github-runner-207 kernel: [75602.283081] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:23:48 juju-e4d256-prod-github-runner-207 kernel: [75602.283838] ? do_syscall_64+0x69/0xc0 Aug 23 02:23:48 juju-e4d256-prod-github-runner-207 kernel: [75602.284529] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:23:48 juju-e4d256-prod-github-runner-207 kernel: [75602.285285] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:23:48 juju-e4d256-prod-github-runner-207 kernel: [75602.286038] ? do_syscall_64+0x69/0xc0 Aug 23 02:23:48 juju-e4d256-prod-github-runner-207 kernel: [75602.286754] ? do_syscall_64+0x69/0xc0 Aug 23 02:23:48 juju-e4d256-prod-github-runner-207 kernel: [75602.287453] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 02:23:48 juju-e4d256-prod-github-runner-207 kernel: [75602.288222] RIP: 0033:0x7faa5d0edaff Aug 23 02:23:48 juju-e4d256-prod-github-runner-207 kernel: [75602.288914] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 02:23:48 juju-e4d256-prod-github-runner-207 kernel: [75602.291046] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 02:23:48 juju-e4d256-prod-github-runner-207 kernel: [75602.292010] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 02:23:48 juju-e4d256-prod-github-runner-207 kernel: [75602.292959] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 02:23:48 juju-e4d256-prod-github-runner-207 kernel: [75602.293905] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 02:23:48 juju-e4d256-prod-github-runner-207 kernel: [75602.294867] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 02:23:48 juju-e4d256-prod-github-runner-207 kernel: [75602.295798] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 02:23:48 juju-e4d256-prod-github-runner-207 kernel: [75602.296710] Aug 23 02:24:14 juju-e4d256-prod-github-runner-207 kernel: [75628.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 70326s! [qemu-system-x86:6715] Aug 23 02:24:14 juju-e4d256-prod-github-runner-207 kernel: [75628.543169] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 02:24:14 juju-e4d256-prod-github-runner-207 kernel: [75628.543371] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 02:24:14 juju-e4d256-prod-github-runner-207 kernel: [75628.555470] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 02:24:14 juju-e4d256-prod-github-runner-207 kernel: [75628.556737] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 02:24:14 juju-e4d256-prod-github-runner-207 kernel: [75628.557957] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:24:14 juju-e4d256-prod-github-runner-207 kernel: [75628.559019] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 02:24:14 juju-e4d256-prod-github-runner-207 kernel: [75628.561572] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 02:24:14 juju-e4d256-prod-github-runner-207 kernel: [75628.562622] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 02:24:14 juju-e4d256-prod-github-runner-207 kernel: [75628.563788] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 02:24:14 juju-e4d256-prod-github-runner-207 kernel: [75628.564952] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 02:24:14 juju-e4d256-prod-github-runner-207 kernel: [75628.566118] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 02:24:14 juju-e4d256-prod-github-runner-207 kernel: [75628.567291] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 02:24:14 juju-e4d256-prod-github-runner-207 kernel: [75628.568461] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 02:24:14 juju-e4d256-prod-github-runner-207 kernel: [75628.569705] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 02:24:14 juju-e4d256-prod-github-runner-207 kernel: [75628.570815] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 02:24:14 juju-e4d256-prod-github-runner-207 kernel: [75628.572014] Call Trace: Aug 23 02:24:14 juju-e4d256-prod-github-runner-207 kernel: [75628.572927] Aug 23 02:24:14 juju-e4d256-prod-github-runner-207 kernel: [75628.573815] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:24:14 juju-e4d256-prod-github-runner-207 kernel: [75628.574854] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:24:14 juju-e4d256-prod-github-runner-207 kernel: [75628.575875] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:24:14 juju-e4d256-prod-github-runner-207 kernel: [75628.576965] ? show_regs.part.0+0x23/0x29 Aug 23 02:24:14 juju-e4d256-prod-github-runner-207 kernel: [75628.577966] ? show_regs.cold+0x8/0xd Aug 23 02:24:14 juju-e4d256-prod-github-runner-207 kernel: [75628.578943] ? watchdog_timer_fn+0x1be/0x220 Aug 23 02:24:14 juju-e4d256-prod-github-runner-207 kernel: [75628.579951] ? lockup_detector_update_enable+0x60/0x60 Aug 23 02:24:14 juju-e4d256-prod-github-runner-207 kernel: [75628.581017] ? __hrtimer_run_queues+0x107/0x230 Aug 23 02:24:14 juju-e4d256-prod-github-runner-207 kernel: [75628.582047] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 02:24:14 juju-e4d256-prod-github-runner-207 kernel: [75628.583081] ? hrtimer_interrupt+0x101/0x220 Aug 23 02:24:14 juju-e4d256-prod-github-runner-207 kernel: [75628.584095] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 02:24:14 juju-e4d256-prod-github-runner-207 kernel: [75628.585166] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 02:24:14 juju-e4d256-prod-github-runner-207 kernel: [75628.586209] Aug 23 02:24:14 juju-e4d256-prod-github-runner-207 kernel: [75628.587067] Aug 23 02:24:14 juju-e4d256-prod-github-runner-207 kernel: [75628.587907] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 02:24:14 juju-e4d256-prod-github-runner-207 kernel: [75628.588960] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:24:14 juju-e4d256-prod-github-runner-207 kernel: [75628.589996] ? _raw_spin_lock+0x22/0x30 Aug 23 02:24:14 juju-e4d256-prod-github-runner-207 kernel: [75628.590950] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:24:14 juju-e4d256-prod-github-runner-207 kernel: [75628.591963] direct_page_fault+0x206/0x310 [kvm] Aug 23 02:24:14 juju-e4d256-prod-github-runner-207 kernel: [75628.592985] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 02:24:14 juju-e4d256-prod-github-runner-207 kernel: [75628.593991] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 02:24:14 juju-e4d256-prod-github-runner-207 kernel: [75628.594994] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 02:24:14 juju-e4d256-prod-github-runner-207 kernel: [75628.595973] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 02:24:14 juju-e4d256-prod-github-runner-207 kernel: [75628.596920] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 02:24:14 juju-e4d256-prod-github-runner-207 kernel: [75628.597897] handle_exit+0x98/0x230 [kvm_amd] Aug 23 02:24:14 juju-e4d256-prod-github-runner-207 kernel: [75628.598794] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 02:24:14 juju-e4d256-prod-github-runner-207 kernel: [75628.599705] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 02:24:14 juju-e4d256-prod-github-runner-207 kernel: [75628.600629] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 02:24:14 juju-e4d256-prod-github-runner-207 kernel: [75628.601532] vcpu_run+0x62/0x2c0 [kvm] Aug 23 02:24:14 juju-e4d256-prod-github-runner-207 kernel: [75628.602357] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 02:24:14 juju-e4d256-prod-github-runner-207 kernel: [75628.603163] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 02:24:14 juju-e4d256-prod-github-runner-207 kernel: [75628.604021] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 02:24:14 juju-e4d256-prod-github-runner-207 kernel: [75628.604819] ? __seccomp_filter+0x4a/0x4a0 Aug 23 02:24:14 juju-e4d256-prod-github-runner-207 kernel: [75628.605557] ? __fget_files+0x86/0xc0 Aug 23 02:24:14 juju-e4d256-prod-github-runner-207 kernel: [75628.606264] __x64_sys_ioctl+0x95/0xd0 Aug 23 02:24:14 juju-e4d256-prod-github-runner-207 kernel: [75628.606958] do_syscall_64+0x5c/0xc0 Aug 23 02:24:14 juju-e4d256-prod-github-runner-207 kernel: [75628.607621] ? do_futex+0x162/0x1f0 Aug 23 02:24:14 juju-e4d256-prod-github-runner-207 kernel: [75628.608266] ? __x64_sys_futex+0x78/0x1e0 Aug 23 02:24:14 juju-e4d256-prod-github-runner-207 kernel: [75628.608943] ? __secure_computing+0xa9/0x120 Aug 23 02:24:14 juju-e4d256-prod-github-runner-207 kernel: [75628.609636] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 02:24:14 juju-e4d256-prod-github-runner-207 kernel: [75628.610399] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:24:14 juju-e4d256-prod-github-runner-207 kernel: [75628.611124] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:24:14 juju-e4d256-prod-github-runner-207 kernel: [75628.611839] ? do_syscall_64+0x69/0xc0 Aug 23 02:24:14 juju-e4d256-prod-github-runner-207 kernel: [75628.612482] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:24:14 juju-e4d256-prod-github-runner-207 kernel: [75628.613184] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:24:14 juju-e4d256-prod-github-runner-207 kernel: [75628.613877] ? do_syscall_64+0x69/0xc0 Aug 23 02:24:14 juju-e4d256-prod-github-runner-207 kernel: [75628.614505] ? do_syscall_64+0x69/0xc0 Aug 23 02:24:14 juju-e4d256-prod-github-runner-207 kernel: [75628.615132] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 02:24:14 juju-e4d256-prod-github-runner-207 kernel: [75628.615834] RIP: 0033:0x7faa5d0edaff Aug 23 02:24:14 juju-e4d256-prod-github-runner-207 kernel: [75628.616475] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 02:24:14 juju-e4d256-prod-github-runner-207 kernel: [75628.618467] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 02:24:14 juju-e4d256-prod-github-runner-207 kernel: [75628.619379] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 02:24:14 juju-e4d256-prod-github-runner-207 kernel: [75628.620271] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 02:24:14 juju-e4d256-prod-github-runner-207 kernel: [75628.621162] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 02:24:14 juju-e4d256-prod-github-runner-207 kernel: [75628.622049] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 02:24:14 juju-e4d256-prod-github-runner-207 kernel: [75628.622946] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 02:24:14 juju-e4d256-prod-github-runner-207 kernel: [75628.623842] Aug 23 02:24:42 juju-e4d256-prod-github-runner-207 kernel: [75656.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 70352s! [qemu-system-x86:6715] Aug 23 02:24:42 juju-e4d256-prod-github-runner-207 kernel: [75656.543679] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 02:24:42 juju-e4d256-prod-github-runner-207 kernel: [75656.543850] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 02:24:42 juju-e4d256-prod-github-runner-207 kernel: [75656.555997] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 02:24:42 juju-e4d256-prod-github-runner-207 kernel: [75656.557267] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 02:24:42 juju-e4d256-prod-github-runner-207 kernel: [75656.558500] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:24:42 juju-e4d256-prod-github-runner-207 kernel: [75656.559563] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 02:24:42 juju-e4d256-prod-github-runner-207 kernel: [75656.562123] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 02:24:42 juju-e4d256-prod-github-runner-207 kernel: [75656.563165] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 02:24:42 juju-e4d256-prod-github-runner-207 kernel: [75656.564332] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 02:24:42 juju-e4d256-prod-github-runner-207 kernel: [75656.565491] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 02:24:42 juju-e4d256-prod-github-runner-207 kernel: [75656.566664] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 02:24:42 juju-e4d256-prod-github-runner-207 kernel: [75656.567824] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 02:24:42 juju-e4d256-prod-github-runner-207 kernel: [75656.568986] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 02:24:42 juju-e4d256-prod-github-runner-207 kernel: [75656.570234] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 02:24:42 juju-e4d256-prod-github-runner-207 kernel: [75656.571330] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 02:24:42 juju-e4d256-prod-github-runner-207 kernel: [75656.572521] Call Trace: Aug 23 02:24:42 juju-e4d256-prod-github-runner-207 kernel: [75656.573437] Aug 23 02:24:42 juju-e4d256-prod-github-runner-207 kernel: [75656.574353] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:24:42 juju-e4d256-prod-github-runner-207 kernel: [75656.575383] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:24:42 juju-e4d256-prod-github-runner-207 kernel: [75656.576407] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:24:42 juju-e4d256-prod-github-runner-207 kernel: [75656.577481] ? show_regs.part.0+0x23/0x29 Aug 23 02:24:42 juju-e4d256-prod-github-runner-207 kernel: [75656.578497] ? show_regs.cold+0x8/0xd Aug 23 02:24:42 juju-e4d256-prod-github-runner-207 kernel: [75656.579469] ? watchdog_timer_fn+0x1be/0x220 Aug 23 02:24:42 juju-e4d256-prod-github-runner-207 kernel: [75656.580480] ? lockup_detector_update_enable+0x60/0x60 Aug 23 02:24:42 juju-e4d256-prod-github-runner-207 kernel: [75656.581541] ? __hrtimer_run_queues+0x107/0x230 Aug 23 02:24:42 juju-e4d256-prod-github-runner-207 kernel: [75656.582702] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 02:24:42 juju-e4d256-prod-github-runner-207 kernel: [75656.583877] ? hrtimer_interrupt+0x101/0x220 Aug 23 02:24:42 juju-e4d256-prod-github-runner-207 kernel: [75656.584895] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 02:24:42 juju-e4d256-prod-github-runner-207 kernel: [75656.585978] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 02:24:42 juju-e4d256-prod-github-runner-207 kernel: [75656.587020] Aug 23 02:24:42 juju-e4d256-prod-github-runner-207 kernel: [75656.587872] Aug 23 02:24:42 juju-e4d256-prod-github-runner-207 kernel: [75656.588709] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 02:24:42 juju-e4d256-prod-github-runner-207 kernel: [75656.589740] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:24:42 juju-e4d256-prod-github-runner-207 kernel: [75656.590792] ? _raw_spin_lock+0x22/0x30 Aug 23 02:24:42 juju-e4d256-prod-github-runner-207 kernel: [75656.591735] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:24:42 juju-e4d256-prod-github-runner-207 kernel: [75656.592753] direct_page_fault+0x206/0x310 [kvm] Aug 23 02:24:42 juju-e4d256-prod-github-runner-207 kernel: [75656.593776] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 02:24:42 juju-e4d256-prod-github-runner-207 kernel: [75656.594793] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 02:24:42 juju-e4d256-prod-github-runner-207 kernel: [75656.595791] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 02:24:42 juju-e4d256-prod-github-runner-207 kernel: [75656.596769] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 02:24:42 juju-e4d256-prod-github-runner-207 kernel: [75656.597712] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 02:24:42 juju-e4d256-prod-github-runner-207 kernel: [75656.598702] handle_exit+0x98/0x230 [kvm_amd] Aug 23 02:24:42 juju-e4d256-prod-github-runner-207 kernel: [75656.599597] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 02:24:42 juju-e4d256-prod-github-runner-207 kernel: [75656.600508] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 02:24:42 juju-e4d256-prod-github-runner-207 kernel: [75656.601433] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 02:24:42 juju-e4d256-prod-github-runner-207 kernel: [75656.602346] vcpu_run+0x62/0x2c0 [kvm] Aug 23 02:24:42 juju-e4d256-prod-github-runner-207 kernel: [75656.603154] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 02:24:42 juju-e4d256-prod-github-runner-207 kernel: [75656.603959] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 02:24:42 juju-e4d256-prod-github-runner-207 kernel: [75656.604812] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 02:24:42 juju-e4d256-prod-github-runner-207 kernel: [75656.605609] ? __seccomp_filter+0x4a/0x4a0 Aug 23 02:24:42 juju-e4d256-prod-github-runner-207 kernel: [75656.606365] ? __fget_files+0x86/0xc0 Aug 23 02:24:42 juju-e4d256-prod-github-runner-207 kernel: [75656.607068] __x64_sys_ioctl+0x95/0xd0 Aug 23 02:24:42 juju-e4d256-prod-github-runner-207 kernel: [75656.607758] do_syscall_64+0x5c/0xc0 Aug 23 02:24:42 juju-e4d256-prod-github-runner-207 kernel: [75656.608420] ? do_futex+0x162/0x1f0 Aug 23 02:24:42 juju-e4d256-prod-github-runner-207 kernel: [75656.609066] ? __x64_sys_futex+0x78/0x1e0 Aug 23 02:24:42 juju-e4d256-prod-github-runner-207 kernel: [75656.609737] ? __secure_computing+0xa9/0x120 Aug 23 02:24:42 juju-e4d256-prod-github-runner-207 kernel: [75656.610438] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 02:24:42 juju-e4d256-prod-github-runner-207 kernel: [75656.611203] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:24:42 juju-e4d256-prod-github-runner-207 kernel: [75656.611923] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:24:42 juju-e4d256-prod-github-runner-207 kernel: [75656.612639] ? do_syscall_64+0x69/0xc0 Aug 23 02:24:42 juju-e4d256-prod-github-runner-207 kernel: [75656.613283] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:24:42 juju-e4d256-prod-github-runner-207 kernel: [75656.614003] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:24:42 juju-e4d256-prod-github-runner-207 kernel: [75656.614698] ? do_syscall_64+0x69/0xc0 Aug 23 02:24:42 juju-e4d256-prod-github-runner-207 kernel: [75656.615322] ? do_syscall_64+0x69/0xc0 Aug 23 02:24:42 juju-e4d256-prod-github-runner-207 kernel: [75656.615942] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 02:24:42 juju-e4d256-prod-github-runner-207 kernel: [75656.616645] RIP: 0033:0x7faa5d0edaff Aug 23 02:24:42 juju-e4d256-prod-github-runner-207 kernel: [75656.617279] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 02:24:42 juju-e4d256-prod-github-runner-207 kernel: [75656.619283] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 02:24:42 juju-e4d256-prod-github-runner-207 kernel: [75656.620197] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 02:24:42 juju-e4d256-prod-github-runner-207 kernel: [75656.621088] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 02:24:42 juju-e4d256-prod-github-runner-207 kernel: [75656.621992] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 02:24:42 juju-e4d256-prod-github-runner-207 kernel: [75656.622881] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 02:24:42 juju-e4d256-prod-github-runner-207 kernel: [75656.623770] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 02:24:42 juju-e4d256-prod-github-runner-207 kernel: [75656.624668] Aug 23 02:25:10 juju-e4d256-prod-github-runner-207 kernel: [75684.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 70378s! [qemu-system-x86:6715] Aug 23 02:25:10 juju-e4d256-prod-github-runner-207 kernel: [75684.543077] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 02:25:10 juju-e4d256-prod-github-runner-207 kernel: [75684.543142] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 02:25:10 juju-e4d256-prod-github-runner-207 kernel: [75684.555409] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 02:25:10 juju-e4d256-prod-github-runner-207 kernel: [75684.556700] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 02:25:10 juju-e4d256-prod-github-runner-207 kernel: [75684.557977] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:25:10 juju-e4d256-prod-github-runner-207 kernel: [75684.559090] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 02:25:10 juju-e4d256-prod-github-runner-207 kernel: [75684.561750] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 02:25:10 juju-e4d256-prod-github-runner-207 kernel: [75684.562815] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 02:25:10 juju-e4d256-prod-github-runner-207 kernel: [75684.564122] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 02:25:10 juju-e4d256-prod-github-runner-207 kernel: [75684.565389] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 02:25:10 juju-e4d256-prod-github-runner-207 kernel: [75684.566580] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 02:25:10 juju-e4d256-prod-github-runner-207 kernel: [75684.567745] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 02:25:10 juju-e4d256-prod-github-runner-207 kernel: [75684.568917] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 02:25:10 juju-e4d256-prod-github-runner-207 kernel: [75684.570185] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 02:25:10 juju-e4d256-prod-github-runner-207 kernel: [75684.571306] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 02:25:10 juju-e4d256-prod-github-runner-207 kernel: [75684.572504] Call Trace: Aug 23 02:25:10 juju-e4d256-prod-github-runner-207 kernel: [75684.573415] Aug 23 02:25:10 juju-e4d256-prod-github-runner-207 kernel: [75684.574325] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:25:10 juju-e4d256-prod-github-runner-207 kernel: [75684.575371] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:25:10 juju-e4d256-prod-github-runner-207 kernel: [75684.576460] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:25:10 juju-e4d256-prod-github-runner-207 kernel: [75684.577645] ? show_regs.part.0+0x23/0x29 Aug 23 02:25:10 juju-e4d256-prod-github-runner-207 kernel: [75684.578654] ? show_regs.cold+0x8/0xd Aug 23 02:25:10 juju-e4d256-prod-github-runner-207 kernel: [75684.579628] ? watchdog_timer_fn+0x1be/0x220 Aug 23 02:25:10 juju-e4d256-prod-github-runner-207 kernel: [75684.580651] ? lockup_detector_update_enable+0x60/0x60 Aug 23 02:25:10 juju-e4d256-prod-github-runner-207 kernel: [75684.581751] ? __hrtimer_run_queues+0x107/0x230 Aug 23 02:25:10 juju-e4d256-prod-github-runner-207 kernel: [75684.582810] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 02:25:10 juju-e4d256-prod-github-runner-207 kernel: [75684.583848] ? hrtimer_interrupt+0x101/0x220 Aug 23 02:25:10 juju-e4d256-prod-github-runner-207 kernel: [75684.584862] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 02:25:10 juju-e4d256-prod-github-runner-207 kernel: [75684.585973] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 02:25:10 juju-e4d256-prod-github-runner-207 kernel: [75684.587038] Aug 23 02:25:10 juju-e4d256-prod-github-runner-207 kernel: [75684.587891] Aug 23 02:25:10 juju-e4d256-prod-github-runner-207 kernel: [75684.588729] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 02:25:10 juju-e4d256-prod-github-runner-207 kernel: [75684.589787] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:25:10 juju-e4d256-prod-github-runner-207 kernel: [75684.590867] ? _raw_spin_lock+0x22/0x30 Aug 23 02:25:10 juju-e4d256-prod-github-runner-207 kernel: [75684.591900] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:25:10 juju-e4d256-prod-github-runner-207 kernel: [75684.592949] direct_page_fault+0x206/0x310 [kvm] Aug 23 02:25:10 juju-e4d256-prod-github-runner-207 kernel: [75684.593991] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 02:25:10 juju-e4d256-prod-github-runner-207 kernel: [75684.595168] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 02:25:10 juju-e4d256-prod-github-runner-207 kernel: [75684.596183] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 02:25:10 juju-e4d256-prod-github-runner-207 kernel: [75684.597183] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 02:25:10 juju-e4d256-prod-github-runner-207 kernel: [75684.598148] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 02:25:10 juju-e4d256-prod-github-runner-207 kernel: [75684.599128] handle_exit+0x98/0x230 [kvm_amd] Aug 23 02:25:10 juju-e4d256-prod-github-runner-207 kernel: [75684.600024] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 02:25:10 juju-e4d256-prod-github-runner-207 kernel: [75684.600952] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 02:25:10 juju-e4d256-prod-github-runner-207 kernel: [75684.601908] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 02:25:10 juju-e4d256-prod-github-runner-207 kernel: [75684.602816] vcpu_run+0x62/0x2c0 [kvm] Aug 23 02:25:10 juju-e4d256-prod-github-runner-207 kernel: [75684.603627] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 02:25:10 juju-e4d256-prod-github-runner-207 kernel: [75684.604433] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 02:25:10 juju-e4d256-prod-github-runner-207 kernel: [75684.605295] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 02:25:10 juju-e4d256-prod-github-runner-207 kernel: [75684.606132] ? __seccomp_filter+0x4a/0x4a0 Aug 23 02:25:10 juju-e4d256-prod-github-runner-207 kernel: [75684.606951] ? __fget_files+0x86/0xc0 Aug 23 02:25:10 juju-e4d256-prod-github-runner-207 kernel: [75684.607683] __x64_sys_ioctl+0x95/0xd0 Aug 23 02:25:10 juju-e4d256-prod-github-runner-207 kernel: [75684.608381] do_syscall_64+0x5c/0xc0 Aug 23 02:25:10 juju-e4d256-prod-github-runner-207 kernel: [75684.609046] ? do_futex+0x162/0x1f0 Aug 23 02:25:10 juju-e4d256-prod-github-runner-207 kernel: [75684.609712] ? __x64_sys_futex+0x78/0x1e0 Aug 23 02:25:10 juju-e4d256-prod-github-runner-207 kernel: [75684.610387] ? __secure_computing+0xa9/0x120 Aug 23 02:25:10 juju-e4d256-prod-github-runner-207 kernel: [75684.611087] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 02:25:10 juju-e4d256-prod-github-runner-207 kernel: [75684.611854] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:25:10 juju-e4d256-prod-github-runner-207 kernel: [75684.612586] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:25:10 juju-e4d256-prod-github-runner-207 kernel: [75684.613306] ? do_syscall_64+0x69/0xc0 Aug 23 02:25:10 juju-e4d256-prod-github-runner-207 kernel: [75684.613965] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:25:10 juju-e4d256-prod-github-runner-207 kernel: [75684.614677] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:25:10 juju-e4d256-prod-github-runner-207 kernel: [75684.615415] ? do_syscall_64+0x69/0xc0 Aug 23 02:25:10 juju-e4d256-prod-github-runner-207 kernel: [75684.616045] ? do_syscall_64+0x69/0xc0 Aug 23 02:25:10 juju-e4d256-prod-github-runner-207 kernel: [75684.616679] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 02:25:10 juju-e4d256-prod-github-runner-207 kernel: [75684.617405] RIP: 0033:0x7faa5d0edaff Aug 23 02:25:10 juju-e4d256-prod-github-runner-207 kernel: [75684.618050] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 02:25:10 juju-e4d256-prod-github-runner-207 kernel: [75684.620037] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 02:25:10 juju-e4d256-prod-github-runner-207 kernel: [75684.620958] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 02:25:10 juju-e4d256-prod-github-runner-207 kernel: [75684.621877] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 02:25:10 juju-e4d256-prod-github-runner-207 kernel: [75684.622787] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 02:25:10 juju-e4d256-prod-github-runner-207 kernel: [75684.623677] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 02:25:10 juju-e4d256-prod-github-runner-207 kernel: [75684.624571] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 02:25:10 juju-e4d256-prod-github-runner-207 kernel: [75684.625464] Aug 23 02:25:38 juju-e4d256-prod-github-runner-207 kernel: [75712.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 70404s! [qemu-system-x86:6715] Aug 23 02:25:38 juju-e4d256-prod-github-runner-207 kernel: [75712.543132] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 02:25:38 juju-e4d256-prod-github-runner-207 kernel: [75712.543201] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 02:25:38 juju-e4d256-prod-github-runner-207 kernel: [75712.555310] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 02:25:38 juju-e4d256-prod-github-runner-207 kernel: [75712.556627] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 02:25:38 juju-e4d256-prod-github-runner-207 kernel: [75712.557896] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:25:38 juju-e4d256-prod-github-runner-207 kernel: [75712.558970] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 02:25:38 juju-e4d256-prod-github-runner-207 kernel: [75712.561531] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 02:25:38 juju-e4d256-prod-github-runner-207 kernel: [75712.562579] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 02:25:38 juju-e4d256-prod-github-runner-207 kernel: [75712.563761] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 02:25:38 juju-e4d256-prod-github-runner-207 kernel: [75712.564925] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 02:25:38 juju-e4d256-prod-github-runner-207 kernel: [75712.566109] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 02:25:38 juju-e4d256-prod-github-runner-207 kernel: [75712.567287] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 02:25:38 juju-e4d256-prod-github-runner-207 kernel: [75712.568467] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 02:25:38 juju-e4d256-prod-github-runner-207 kernel: [75712.569709] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 02:25:38 juju-e4d256-prod-github-runner-207 kernel: [75712.570805] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 02:25:38 juju-e4d256-prod-github-runner-207 kernel: [75712.572000] Call Trace: Aug 23 02:25:38 juju-e4d256-prod-github-runner-207 kernel: [75712.572910] Aug 23 02:25:38 juju-e4d256-prod-github-runner-207 kernel: [75712.573824] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:25:38 juju-e4d256-prod-github-runner-207 kernel: [75712.574871] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:25:38 juju-e4d256-prod-github-runner-207 kernel: [75712.575925] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:25:38 juju-e4d256-prod-github-runner-207 kernel: [75712.577013] ? show_regs.part.0+0x23/0x29 Aug 23 02:25:38 juju-e4d256-prod-github-runner-207 kernel: [75712.578027] ? show_regs.cold+0x8/0xd Aug 23 02:25:38 juju-e4d256-prod-github-runner-207 kernel: [75712.578999] ? watchdog_timer_fn+0x1be/0x220 Aug 23 02:25:38 juju-e4d256-prod-github-runner-207 kernel: [75712.580013] ? lockup_detector_update_enable+0x60/0x60 Aug 23 02:25:38 juju-e4d256-prod-github-runner-207 kernel: [75712.581075] ? __hrtimer_run_queues+0x107/0x230 Aug 23 02:25:38 juju-e4d256-prod-github-runner-207 kernel: [75712.582114] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 02:25:38 juju-e4d256-prod-github-runner-207 kernel: [75712.583136] ? hrtimer_interrupt+0x101/0x220 Aug 23 02:25:38 juju-e4d256-prod-github-runner-207 kernel: [75712.584171] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 02:25:38 juju-e4d256-prod-github-runner-207 kernel: [75712.585252] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 02:25:38 juju-e4d256-prod-github-runner-207 kernel: [75712.586321] Aug 23 02:25:38 juju-e4d256-prod-github-runner-207 kernel: [75712.587194] Aug 23 02:25:38 juju-e4d256-prod-github-runner-207 kernel: [75712.588041] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 02:25:38 juju-e4d256-prod-github-runner-207 kernel: [75712.589075] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:25:38 juju-e4d256-prod-github-runner-207 kernel: [75712.590163] ? _raw_spin_lock+0x22/0x30 Aug 23 02:25:38 juju-e4d256-prod-github-runner-207 kernel: [75712.591113] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:25:38 juju-e4d256-prod-github-runner-207 kernel: [75712.592129] direct_page_fault+0x206/0x310 [kvm] Aug 23 02:25:38 juju-e4d256-prod-github-runner-207 kernel: [75712.593158] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 02:25:38 juju-e4d256-prod-github-runner-207 kernel: [75712.594194] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 02:25:38 juju-e4d256-prod-github-runner-207 kernel: [75712.595220] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 02:25:38 juju-e4d256-prod-github-runner-207 kernel: [75712.596323] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 02:25:38 juju-e4d256-prod-github-runner-207 kernel: [75712.597304] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 02:25:38 juju-e4d256-prod-github-runner-207 kernel: [75712.598299] handle_exit+0x98/0x230 [kvm_amd] Aug 23 02:25:38 juju-e4d256-prod-github-runner-207 kernel: [75712.599198] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 02:25:38 juju-e4d256-prod-github-runner-207 kernel: [75712.600113] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 02:25:38 juju-e4d256-prod-github-runner-207 kernel: [75712.601038] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 02:25:38 juju-e4d256-prod-github-runner-207 kernel: [75712.601955] vcpu_run+0x62/0x2c0 [kvm] Aug 23 02:25:38 juju-e4d256-prod-github-runner-207 kernel: [75712.602765] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 02:25:38 juju-e4d256-prod-github-runner-207 kernel: [75712.603610] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 02:25:38 juju-e4d256-prod-github-runner-207 kernel: [75712.604470] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 02:25:38 juju-e4d256-prod-github-runner-207 kernel: [75712.605308] ? __seccomp_filter+0x4a/0x4a0 Aug 23 02:25:38 juju-e4d256-prod-github-runner-207 kernel: [75712.606064] ? __fget_files+0x86/0xc0 Aug 23 02:25:38 juju-e4d256-prod-github-runner-207 kernel: [75712.606777] __x64_sys_ioctl+0x95/0xd0 Aug 23 02:25:38 juju-e4d256-prod-github-runner-207 kernel: [75712.607491] do_syscall_64+0x5c/0xc0 Aug 23 02:25:38 juju-e4d256-prod-github-runner-207 kernel: [75712.608176] ? do_futex+0x162/0x1f0 Aug 23 02:25:38 juju-e4d256-prod-github-runner-207 kernel: [75712.608830] ? __x64_sys_futex+0x78/0x1e0 Aug 23 02:25:38 juju-e4d256-prod-github-runner-207 kernel: [75712.609515] ? __secure_computing+0xa9/0x120 Aug 23 02:25:38 juju-e4d256-prod-github-runner-207 kernel: [75712.610203] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 02:25:38 juju-e4d256-prod-github-runner-207 kernel: [75712.610960] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:25:38 juju-e4d256-prod-github-runner-207 kernel: [75712.611685] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:25:38 juju-e4d256-prod-github-runner-207 kernel: [75712.612400] ? do_syscall_64+0x69/0xc0 Aug 23 02:25:38 juju-e4d256-prod-github-runner-207 kernel: [75712.613043] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:25:38 juju-e4d256-prod-github-runner-207 kernel: [75712.613768] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:25:38 juju-e4d256-prod-github-runner-207 kernel: [75712.614482] ? do_syscall_64+0x69/0xc0 Aug 23 02:25:38 juju-e4d256-prod-github-runner-207 kernel: [75712.615138] ? do_syscall_64+0x69/0xc0 Aug 23 02:25:38 juju-e4d256-prod-github-runner-207 kernel: [75712.615774] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 02:25:38 juju-e4d256-prod-github-runner-207 kernel: [75712.616483] RIP: 0033:0x7faa5d0edaff Aug 23 02:25:38 juju-e4d256-prod-github-runner-207 kernel: [75712.617127] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 02:25:38 juju-e4d256-prod-github-runner-207 kernel: [75712.619247] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 02:25:38 juju-e4d256-prod-github-runner-207 kernel: [75712.620194] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 02:25:38 juju-e4d256-prod-github-runner-207 kernel: [75712.621089] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 02:25:38 juju-e4d256-prod-github-runner-207 kernel: [75712.621990] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 02:25:38 juju-e4d256-prod-github-runner-207 kernel: [75712.622877] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 02:25:38 juju-e4d256-prod-github-runner-207 kernel: [75712.623802] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 02:25:38 juju-e4d256-prod-github-runner-207 kernel: [75712.624738] Aug 23 02:26:06 juju-e4d256-prod-github-runner-207 kernel: [75740.541981] watchdog: BUG: soft lockup - CPU#1 stuck for 70430s! [qemu-system-x86:6715] Aug 23 02:26:06 juju-e4d256-prod-github-runner-207 kernel: [75740.543885] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 02:26:06 juju-e4d256-prod-github-runner-207 kernel: [75740.544131] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 02:26:06 juju-e4d256-prod-github-runner-207 kernel: [75740.556202] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 02:26:06 juju-e4d256-prod-github-runner-207 kernel: [75740.557650] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 02:26:06 juju-e4d256-prod-github-runner-207 kernel: [75740.559190] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:26:06 juju-e4d256-prod-github-runner-207 kernel: [75740.560295] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 02:26:06 juju-e4d256-prod-github-runner-207 kernel: [75740.563104] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 02:26:06 juju-e4d256-prod-github-runner-207 kernel: [75740.564215] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 02:26:06 juju-e4d256-prod-github-runner-207 kernel: [75740.565438] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 02:26:06 juju-e4d256-prod-github-runner-207 kernel: [75740.566678] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 02:26:06 juju-e4d256-prod-github-runner-207 kernel: [75740.567873] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 02:26:06 juju-e4d256-prod-github-runner-207 kernel: [75740.569077] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 02:26:06 juju-e4d256-prod-github-runner-207 kernel: [75740.570258] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 02:26:06 juju-e4d256-prod-github-runner-207 kernel: [75740.571540] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 02:26:06 juju-e4d256-prod-github-runner-207 kernel: [75740.572670] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 02:26:06 juju-e4d256-prod-github-runner-207 kernel: [75740.573894] Call Trace: Aug 23 02:26:06 juju-e4d256-prod-github-runner-207 kernel: [75740.574822] Aug 23 02:26:06 juju-e4d256-prod-github-runner-207 kernel: [75740.575730] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:26:06 juju-e4d256-prod-github-runner-207 kernel: [75740.576797] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:26:06 juju-e4d256-prod-github-runner-207 kernel: [75740.577860] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:26:06 juju-e4d256-prod-github-runner-207 kernel: [75740.578973] ? show_regs.part.0+0x23/0x29 Aug 23 02:26:06 juju-e4d256-prod-github-runner-207 kernel: [75740.580009] ? show_regs.cold+0x8/0xd Aug 23 02:26:06 juju-e4d256-prod-github-runner-207 kernel: [75740.581046] ? watchdog_timer_fn+0x1be/0x220 Aug 23 02:26:06 juju-e4d256-prod-github-runner-207 kernel: [75740.582087] ? lockup_detector_update_enable+0x60/0x60 Aug 23 02:26:06 juju-e4d256-prod-github-runner-207 kernel: [75740.583166] ? __hrtimer_run_queues+0x107/0x230 Aug 23 02:26:06 juju-e4d256-prod-github-runner-207 kernel: [75740.584210] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 02:26:06 juju-e4d256-prod-github-runner-207 kernel: [75740.585265] ? hrtimer_interrupt+0x101/0x220 Aug 23 02:26:06 juju-e4d256-prod-github-runner-207 kernel: [75740.586297] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 02:26:06 juju-e4d256-prod-github-runner-207 kernel: [75740.587396] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 02:26:06 juju-e4d256-prod-github-runner-207 kernel: [75740.588441] Aug 23 02:26:06 juju-e4d256-prod-github-runner-207 kernel: [75740.589306] Aug 23 02:26:06 juju-e4d256-prod-github-runner-207 kernel: [75740.590146] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 02:26:06 juju-e4d256-prod-github-runner-207 kernel: [75740.591276] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:26:06 juju-e4d256-prod-github-runner-207 kernel: [75740.592409] ? _raw_spin_lock+0x22/0x30 Aug 23 02:26:06 juju-e4d256-prod-github-runner-207 kernel: [75740.593377] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:26:06 juju-e4d256-prod-github-runner-207 kernel: [75740.594438] direct_page_fault+0x206/0x310 [kvm] Aug 23 02:26:06 juju-e4d256-prod-github-runner-207 kernel: [75740.595466] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 02:26:06 juju-e4d256-prod-github-runner-207 kernel: [75740.596536] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 02:26:06 juju-e4d256-prod-github-runner-207 kernel: [75740.597566] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 02:26:06 juju-e4d256-prod-github-runner-207 kernel: [75740.598585] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 02:26:06 juju-e4d256-prod-github-runner-207 kernel: [75740.599539] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 02:26:06 juju-e4d256-prod-github-runner-207 kernel: [75740.600514] handle_exit+0x98/0x230 [kvm_amd] Aug 23 02:26:06 juju-e4d256-prod-github-runner-207 kernel: [75740.601445] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 02:26:06 juju-e4d256-prod-github-runner-207 kernel: [75740.602403] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 02:26:06 juju-e4d256-prod-github-runner-207 kernel: [75740.603341] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 02:26:06 juju-e4d256-prod-github-runner-207 kernel: [75740.604247] vcpu_run+0x62/0x2c0 [kvm] Aug 23 02:26:06 juju-e4d256-prod-github-runner-207 kernel: [75740.605079] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 02:26:06 juju-e4d256-prod-github-runner-207 kernel: [75740.605890] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 02:26:06 juju-e4d256-prod-github-runner-207 kernel: [75740.606770] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 02:26:06 juju-e4d256-prod-github-runner-207 kernel: [75740.607578] ? __seccomp_filter+0x4a/0x4a0 Aug 23 02:26:06 juju-e4d256-prod-github-runner-207 kernel: [75740.608340] ? __fget_files+0x86/0xc0 Aug 23 02:26:06 juju-e4d256-prod-github-runner-207 kernel: [75740.609111] __x64_sys_ioctl+0x95/0xd0 Aug 23 02:26:06 juju-e4d256-prod-github-runner-207 kernel: [75740.609831] do_syscall_64+0x5c/0xc0 Aug 23 02:26:06 juju-e4d256-prod-github-runner-207 kernel: [75740.610558] ? do_futex+0x162/0x1f0 Aug 23 02:26:06 juju-e4d256-prod-github-runner-207 kernel: [75740.611213] ? __x64_sys_futex+0x78/0x1e0 Aug 23 02:26:06 juju-e4d256-prod-github-runner-207 kernel: [75740.611889] ? __secure_computing+0xa9/0x120 Aug 23 02:26:06 juju-e4d256-prod-github-runner-207 kernel: [75740.612599] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 02:26:06 juju-e4d256-prod-github-runner-207 kernel: [75740.613374] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:26:06 juju-e4d256-prod-github-runner-207 kernel: [75740.614098] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:26:06 juju-e4d256-prod-github-runner-207 kernel: [75740.614818] ? do_syscall_64+0x69/0xc0 Aug 23 02:26:06 juju-e4d256-prod-github-runner-207 kernel: [75740.615462] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:26:06 juju-e4d256-prod-github-runner-207 kernel: [75740.616165] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:26:06 juju-e4d256-prod-github-runner-207 kernel: [75740.616876] ? do_syscall_64+0x69/0xc0 Aug 23 02:26:06 juju-e4d256-prod-github-runner-207 kernel: [75740.617525] ? do_syscall_64+0x69/0xc0 Aug 23 02:26:06 juju-e4d256-prod-github-runner-207 kernel: [75740.618148] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 02:26:06 juju-e4d256-prod-github-runner-207 kernel: [75740.618854] RIP: 0033:0x7faa5d0edaff Aug 23 02:26:06 juju-e4d256-prod-github-runner-207 kernel: [75740.619496] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 02:26:06 juju-e4d256-prod-github-runner-207 kernel: [75740.621624] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 02:26:06 juju-e4d256-prod-github-runner-207 kernel: [75740.622571] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 02:26:06 juju-e4d256-prod-github-runner-207 kernel: [75740.623492] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 02:26:06 juju-e4d256-prod-github-runner-207 kernel: [75740.624406] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 02:26:06 juju-e4d256-prod-github-runner-207 kernel: [75740.625314] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 02:26:06 juju-e4d256-prod-github-runner-207 kernel: [75740.626235] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 02:26:06 juju-e4d256-prod-github-runner-207 kernel: [75740.627157] Aug 23 02:26:34 juju-e4d256-prod-github-runner-207 kernel: [75768.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 70456s! [qemu-system-x86:6715] Aug 23 02:26:34 juju-e4d256-prod-github-runner-207 kernel: [75768.543094] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 02:26:34 juju-e4d256-prod-github-runner-207 kernel: [75768.543162] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 02:26:34 juju-e4d256-prod-github-runner-207 kernel: [75768.555238] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 02:26:34 juju-e4d256-prod-github-runner-207 kernel: [75768.556502] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 02:26:34 juju-e4d256-prod-github-runner-207 kernel: [75768.557730] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:26:34 juju-e4d256-prod-github-runner-207 kernel: [75768.558785] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 02:26:34 juju-e4d256-prod-github-runner-207 kernel: [75768.561337] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 02:26:34 juju-e4d256-prod-github-runner-207 kernel: [75768.562378] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 02:26:34 juju-e4d256-prod-github-runner-207 kernel: [75768.563537] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 02:26:34 juju-e4d256-prod-github-runner-207 kernel: [75768.564706] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 02:26:34 juju-e4d256-prod-github-runner-207 kernel: [75768.565863] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 02:26:34 juju-e4d256-prod-github-runner-207 kernel: [75768.567028] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 02:26:34 juju-e4d256-prod-github-runner-207 kernel: [75768.568191] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 02:26:34 juju-e4d256-prod-github-runner-207 kernel: [75768.569434] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 02:26:34 juju-e4d256-prod-github-runner-207 kernel: [75768.570537] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 02:26:34 juju-e4d256-prod-github-runner-207 kernel: [75768.571732] Call Trace: Aug 23 02:26:34 juju-e4d256-prod-github-runner-207 kernel: [75768.572654] Aug 23 02:26:34 juju-e4d256-prod-github-runner-207 kernel: [75768.573542] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:26:34 juju-e4d256-prod-github-runner-207 kernel: [75768.574571] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:26:34 juju-e4d256-prod-github-runner-207 kernel: [75768.575590] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:26:34 juju-e4d256-prod-github-runner-207 kernel: [75768.576681] ? show_regs.part.0+0x23/0x29 Aug 23 02:26:34 juju-e4d256-prod-github-runner-207 kernel: [75768.577677] ? show_regs.cold+0x8/0xd Aug 23 02:26:34 juju-e4d256-prod-github-runner-207 kernel: [75768.578651] ? watchdog_timer_fn+0x1be/0x220 Aug 23 02:26:34 juju-e4d256-prod-github-runner-207 kernel: [75768.579665] ? lockup_detector_update_enable+0x60/0x60 Aug 23 02:26:34 juju-e4d256-prod-github-runner-207 kernel: [75768.580739] ? __hrtimer_run_queues+0x107/0x230 Aug 23 02:26:34 juju-e4d256-prod-github-runner-207 kernel: [75768.581769] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 02:26:34 juju-e4d256-prod-github-runner-207 kernel: [75768.582791] ? hrtimer_interrupt+0x101/0x220 Aug 23 02:26:34 juju-e4d256-prod-github-runner-207 kernel: [75768.583803] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 02:26:34 juju-e4d256-prod-github-runner-207 kernel: [75768.584883] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 02:26:34 juju-e4d256-prod-github-runner-207 kernel: [75768.585929] Aug 23 02:26:34 juju-e4d256-prod-github-runner-207 kernel: [75768.586779] Aug 23 02:26:34 juju-e4d256-prod-github-runner-207 kernel: [75768.587615] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 02:26:34 juju-e4d256-prod-github-runner-207 kernel: [75768.588660] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:26:34 juju-e4d256-prod-github-runner-207 kernel: [75768.589698] ? _raw_spin_lock+0x22/0x30 Aug 23 02:26:34 juju-e4d256-prod-github-runner-207 kernel: [75768.590640] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:26:34 juju-e4d256-prod-github-runner-207 kernel: [75768.591653] direct_page_fault+0x206/0x310 [kvm] Aug 23 02:26:34 juju-e4d256-prod-github-runner-207 kernel: [75768.592690] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 02:26:34 juju-e4d256-prod-github-runner-207 kernel: [75768.593698] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 02:26:34 juju-e4d256-prod-github-runner-207 kernel: [75768.594696] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 02:26:34 juju-e4d256-prod-github-runner-207 kernel: [75768.595664] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 02:26:34 juju-e4d256-prod-github-runner-207 kernel: [75768.596613] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 02:26:34 juju-e4d256-prod-github-runner-207 kernel: [75768.597604] handle_exit+0x98/0x230 [kvm_amd] Aug 23 02:26:34 juju-e4d256-prod-github-runner-207 kernel: [75768.598500] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 02:26:34 juju-e4d256-prod-github-runner-207 kernel: [75768.599412] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 02:26:34 juju-e4d256-prod-github-runner-207 kernel: [75768.600332] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 02:26:34 juju-e4d256-prod-github-runner-207 kernel: [75768.601246] vcpu_run+0x62/0x2c0 [kvm] Aug 23 02:26:34 juju-e4d256-prod-github-runner-207 kernel: [75768.602054] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 02:26:34 juju-e4d256-prod-github-runner-207 kernel: [75768.602858] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 02:26:34 juju-e4d256-prod-github-runner-207 kernel: [75768.603709] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 02:26:34 juju-e4d256-prod-github-runner-207 kernel: [75768.604503] ? __seccomp_filter+0x4a/0x4a0 Aug 23 02:26:34 juju-e4d256-prod-github-runner-207 kernel: [75768.605256] ? __fget_files+0x86/0xc0 Aug 23 02:26:34 juju-e4d256-prod-github-runner-207 kernel: [75768.605957] __x64_sys_ioctl+0x95/0xd0 Aug 23 02:26:34 juju-e4d256-prod-github-runner-207 kernel: [75768.606647] do_syscall_64+0x5c/0xc0 Aug 23 02:26:34 juju-e4d256-prod-github-runner-207 kernel: [75768.607316] ? do_futex+0x162/0x1f0 Aug 23 02:26:34 juju-e4d256-prod-github-runner-207 kernel: [75768.607962] ? __x64_sys_futex+0x78/0x1e0 Aug 23 02:26:34 juju-e4d256-prod-github-runner-207 kernel: [75768.608632] ? __secure_computing+0xa9/0x120 Aug 23 02:26:34 juju-e4d256-prod-github-runner-207 kernel: [75768.609336] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 02:26:34 juju-e4d256-prod-github-runner-207 kernel: [75768.610093] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:26:34 juju-e4d256-prod-github-runner-207 kernel: [75768.610812] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:26:34 juju-e4d256-prod-github-runner-207 kernel: [75768.611532] ? do_syscall_64+0x69/0xc0 Aug 23 02:26:34 juju-e4d256-prod-github-runner-207 kernel: [75768.612174] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:26:34 juju-e4d256-prod-github-runner-207 kernel: [75768.612887] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:26:34 juju-e4d256-prod-github-runner-207 kernel: [75768.613580] ? do_syscall_64+0x69/0xc0 Aug 23 02:26:34 juju-e4d256-prod-github-runner-207 kernel: [75768.614209] ? do_syscall_64+0x69/0xc0 Aug 23 02:26:34 juju-e4d256-prod-github-runner-207 kernel: [75768.614827] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 02:26:34 juju-e4d256-prod-github-runner-207 kernel: [75768.615528] RIP: 0033:0x7faa5d0edaff Aug 23 02:26:34 juju-e4d256-prod-github-runner-207 kernel: [75768.616150] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 02:26:34 juju-e4d256-prod-github-runner-207 kernel: [75768.618145] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 02:26:34 juju-e4d256-prod-github-runner-207 kernel: [75768.619053] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 02:26:34 juju-e4d256-prod-github-runner-207 kernel: [75768.619939] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 02:26:34 juju-e4d256-prod-github-runner-207 kernel: [75768.620839] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 02:26:34 juju-e4d256-prod-github-runner-207 kernel: [75768.621727] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 02:26:34 juju-e4d256-prod-github-runner-207 kernel: [75768.622614] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 02:26:34 juju-e4d256-prod-github-runner-207 kernel: [75768.623503] Aug 23 02:26:48 juju-e4d256-prod-github-runner-207 kernel: [75782.240705] rcu: INFO: rcu_sched self-detected stall on CPU Aug 23 02:26:48 juju-e4d256-prod-github-runner-207 kernel: [75782.241670] rcu: 1-....: (18856843 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=9115336 Aug 23 02:26:48 juju-e4d256-prod-github-runner-207 kernel: [75782.242792] (t=18916260 jiffies g=23269 q=64059) Aug 23 02:26:48 juju-e4d256-prod-github-runner-207 kernel: [75782.243583] NMI backtrace for cpu 1 Aug 23 02:26:48 juju-e4d256-prod-github-runner-207 kernel: [75782.244430] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 02:26:48 juju-e4d256-prod-github-runner-207 kernel: [75782.245551] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 02:26:48 juju-e4d256-prod-github-runner-207 kernel: [75782.246612] Call Trace: Aug 23 02:26:48 juju-e4d256-prod-github-runner-207 kernel: [75782.247284] Aug 23 02:26:48 juju-e4d256-prod-github-runner-207 kernel: [75782.247927] show_stack+0x52/0x5c Aug 23 02:26:48 juju-e4d256-prod-github-runner-207 kernel: [75782.248664] dump_stack_lvl+0x4a/0x63 Aug 23 02:26:48 juju-e4d256-prod-github-runner-207 kernel: [75782.249410] dump_stack+0x10/0x16 Aug 23 02:26:48 juju-e4d256-prod-github-runner-207 kernel: [75782.250126] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 23 02:26:48 juju-e4d256-prod-github-runner-207 kernel: [75782.250906] ? lapic_can_unplug_cpu+0x90/0x90 Aug 23 02:26:48 juju-e4d256-prod-github-runner-207 kernel: [75782.251681] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 23 02:26:48 juju-e4d256-prod-github-runner-207 kernel: [75782.252507] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 23 02:26:48 juju-e4d256-prod-github-runner-207 kernel: [75782.253326] trigger_single_cpu_backtrace+0x44/0x4f Aug 23 02:26:48 juju-e4d256-prod-github-runner-207 kernel: [75782.254135] rcu_dump_cpu_stacks+0x102/0x149 Aug 23 02:26:48 juju-e4d256-prod-github-runner-207 kernel: [75782.254907] print_cpu_stall.cold+0x2f/0xe2 Aug 23 02:26:48 juju-e4d256-prod-github-runner-207 kernel: [75782.255668] ? timekeeping_update+0xf7/0x150 Aug 23 02:26:48 juju-e4d256-prod-github-runner-207 kernel: [75782.256441] check_cpu_stall+0x109/0x270 Aug 23 02:26:48 juju-e4d256-prod-github-runner-207 kernel: [75782.257195] rcu_sched_clock_irq+0x9a/0x250 Aug 23 02:26:48 juju-e4d256-prod-github-runner-207 kernel: [75782.257954] update_process_times+0x94/0xd0 Aug 23 02:26:48 juju-e4d256-prod-github-runner-207 kernel: [75782.258713] tick_sched_handle+0x29/0x70 Aug 23 02:26:48 juju-e4d256-prod-github-runner-207 kernel: [75782.259462] tick_sched_timer+0x8c/0xc0 Aug 23 02:26:48 juju-e4d256-prod-github-runner-207 kernel: [75782.260197] ? tick_nohz_handler+0xb0/0xb0 Aug 23 02:26:48 juju-e4d256-prod-github-runner-207 kernel: [75782.260964] __hrtimer_run_queues+0x107/0x230 Aug 23 02:26:48 juju-e4d256-prod-github-runner-207 kernel: [75782.261775] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 02:26:48 juju-e4d256-prod-github-runner-207 kernel: [75782.262554] hrtimer_interrupt+0x101/0x220 Aug 23 02:26:48 juju-e4d256-prod-github-runner-207 kernel: [75782.263312] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 02:26:48 juju-e4d256-prod-github-runner-207 kernel: [75782.264123] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 02:26:48 juju-e4d256-prod-github-runner-207 kernel: [75782.264934] Aug 23 02:26:48 juju-e4d256-prod-github-runner-207 kernel: [75782.265576] Aug 23 02:26:48 juju-e4d256-prod-github-runner-207 kernel: [75782.266203] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 02:26:48 juju-e4d256-prod-github-runner-207 kernel: [75782.267020] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:26:48 juju-e4d256-prod-github-runner-207 kernel: [75782.267977] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 02:26:48 juju-e4d256-prod-github-runner-207 kernel: [75782.270208] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 02:26:48 juju-e4d256-prod-github-runner-207 kernel: [75782.271081] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 02:26:48 juju-e4d256-prod-github-runner-207 kernel: [75782.272074] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 02:26:48 juju-e4d256-prod-github-runner-207 kernel: [75782.273059] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 02:26:48 juju-e4d256-prod-github-runner-207 kernel: [75782.274024] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 02:26:48 juju-e4d256-prod-github-runner-207 kernel: [75782.274980] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 02:26:48 juju-e4d256-prod-github-runner-207 kernel: [75782.275936] ? _raw_spin_lock+0x22/0x30 Aug 23 02:26:48 juju-e4d256-prod-github-runner-207 kernel: [75782.276706] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:26:48 juju-e4d256-prod-github-runner-207 kernel: [75782.277541] direct_page_fault+0x206/0x310 [kvm] Aug 23 02:26:48 juju-e4d256-prod-github-runner-207 kernel: [75782.278383] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 02:26:48 juju-e4d256-prod-github-runner-207 kernel: [75782.279233] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 02:26:48 juju-e4d256-prod-github-runner-207 kernel: [75782.280222] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 02:26:48 juju-e4d256-prod-github-runner-207 kernel: [75782.281043] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 02:26:48 juju-e4d256-prod-github-runner-207 kernel: [75782.281870] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 02:26:48 juju-e4d256-prod-github-runner-207 kernel: [75782.282690] handle_exit+0x98/0x230 [kvm_amd] Aug 23 02:26:48 juju-e4d256-prod-github-runner-207 kernel: [75782.283442] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 02:26:48 juju-e4d256-prod-github-runner-207 kernel: [75782.284228] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 02:26:48 juju-e4d256-prod-github-runner-207 kernel: [75782.285033] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 02:26:48 juju-e4d256-prod-github-runner-207 kernel: [75782.285818] vcpu_run+0x62/0x2c0 [kvm] Aug 23 02:26:48 juju-e4d256-prod-github-runner-207 kernel: [75782.286537] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 02:26:48 juju-e4d256-prod-github-runner-207 kernel: [75782.287274] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 02:26:48 juju-e4d256-prod-github-runner-207 kernel: [75782.288074] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 02:26:48 juju-e4d256-prod-github-runner-207 kernel: [75782.288845] ? __seccomp_filter+0x4a/0x4a0 Aug 23 02:26:48 juju-e4d256-prod-github-runner-207 kernel: [75782.289564] ? __fget_files+0x86/0xc0 Aug 23 02:26:48 juju-e4d256-prod-github-runner-207 kernel: [75782.290257] __x64_sys_ioctl+0x95/0xd0 Aug 23 02:26:48 juju-e4d256-prod-github-runner-207 kernel: [75782.290950] do_syscall_64+0x5c/0xc0 Aug 23 02:26:48 juju-e4d256-prod-github-runner-207 kernel: [75782.291633] ? do_futex+0x162/0x1f0 Aug 23 02:26:48 juju-e4d256-prod-github-runner-207 kernel: [75782.292302] ? __x64_sys_futex+0x78/0x1e0 Aug 23 02:26:48 juju-e4d256-prod-github-runner-207 kernel: [75782.293014] ? __secure_computing+0xa9/0x120 Aug 23 02:26:48 juju-e4d256-prod-github-runner-207 kernel: [75782.293734] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 02:26:48 juju-e4d256-prod-github-runner-207 kernel: [75782.294523] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:26:48 juju-e4d256-prod-github-runner-207 kernel: [75782.295276] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:26:48 juju-e4d256-prod-github-runner-207 kernel: [75782.296027] ? do_syscall_64+0x69/0xc0 Aug 23 02:26:48 juju-e4d256-prod-github-runner-207 kernel: [75782.296731] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:26:48 juju-e4d256-prod-github-runner-207 kernel: [75782.297485] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:26:48 juju-e4d256-prod-github-runner-207 kernel: [75782.298242] ? do_syscall_64+0x69/0xc0 Aug 23 02:26:48 juju-e4d256-prod-github-runner-207 kernel: [75782.298933] ? do_syscall_64+0x69/0xc0 Aug 23 02:26:48 juju-e4d256-prod-github-runner-207 kernel: [75782.299619] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 02:26:48 juju-e4d256-prod-github-runner-207 kernel: [75782.300394] RIP: 0033:0x7faa5d0edaff Aug 23 02:26:48 juju-e4d256-prod-github-runner-207 kernel: [75782.301084] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 02:26:48 juju-e4d256-prod-github-runner-207 kernel: [75782.303184] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 02:26:48 juju-e4d256-prod-github-runner-207 kernel: [75782.304143] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 02:26:48 juju-e4d256-prod-github-runner-207 kernel: [75782.305096] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 02:26:48 juju-e4d256-prod-github-runner-207 kernel: [75782.306040] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 02:26:48 juju-e4d256-prod-github-runner-207 kernel: [75782.306984] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 02:26:48 juju-e4d256-prod-github-runner-207 kernel: [75782.307907] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 02:26:48 juju-e4d256-prod-github-runner-207 kernel: [75782.308831] Aug 23 02:27:14 juju-e4d256-prod-github-runner-207 kernel: [75808.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 70494s! [qemu-system-x86:6715] Aug 23 02:27:14 juju-e4d256-prod-github-runner-207 kernel: [75808.543148] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 02:27:14 juju-e4d256-prod-github-runner-207 kernel: [75808.543218] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 02:27:14 juju-e4d256-prod-github-runner-207 kernel: [75808.555410] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 02:27:14 juju-e4d256-prod-github-runner-207 kernel: [75808.556687] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 02:27:14 juju-e4d256-prod-github-runner-207 kernel: [75808.557907] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:27:14 juju-e4d256-prod-github-runner-207 kernel: [75808.558968] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 02:27:14 juju-e4d256-prod-github-runner-207 kernel: [75808.561538] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 02:27:14 juju-e4d256-prod-github-runner-207 kernel: [75808.562586] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 02:27:14 juju-e4d256-prod-github-runner-207 kernel: [75808.563754] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 02:27:14 juju-e4d256-prod-github-runner-207 kernel: [75808.564984] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 02:27:14 juju-e4d256-prod-github-runner-207 kernel: [75808.566145] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 02:27:14 juju-e4d256-prod-github-runner-207 kernel: [75808.567306] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 02:27:14 juju-e4d256-prod-github-runner-207 kernel: [75808.568505] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 02:27:14 juju-e4d256-prod-github-runner-207 kernel: [75808.569744] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 02:27:14 juju-e4d256-prod-github-runner-207 kernel: [75808.570841] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 02:27:14 juju-e4d256-prod-github-runner-207 kernel: [75808.572034] Call Trace: Aug 23 02:27:14 juju-e4d256-prod-github-runner-207 kernel: [75808.572955] Aug 23 02:27:14 juju-e4d256-prod-github-runner-207 kernel: [75808.573839] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:27:14 juju-e4d256-prod-github-runner-207 kernel: [75808.574915] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:27:14 juju-e4d256-prod-github-runner-207 kernel: [75808.575940] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:27:14 juju-e4d256-prod-github-runner-207 kernel: [75808.577029] ? show_regs.part.0+0x23/0x29 Aug 23 02:27:14 juju-e4d256-prod-github-runner-207 kernel: [75808.578026] ? show_regs.cold+0x8/0xd Aug 23 02:27:14 juju-e4d256-prod-github-runner-207 kernel: [75808.578996] ? watchdog_timer_fn+0x1be/0x220 Aug 23 02:27:14 juju-e4d256-prod-github-runner-207 kernel: [75808.580002] ? lockup_detector_update_enable+0x60/0x60 Aug 23 02:27:14 juju-e4d256-prod-github-runner-207 kernel: [75808.581079] ? __hrtimer_run_queues+0x107/0x230 Aug 23 02:27:14 juju-e4d256-prod-github-runner-207 kernel: [75808.582110] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 02:27:14 juju-e4d256-prod-github-runner-207 kernel: [75808.583139] ? hrtimer_interrupt+0x101/0x220 Aug 23 02:27:14 juju-e4d256-prod-github-runner-207 kernel: [75808.584152] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 02:27:14 juju-e4d256-prod-github-runner-207 kernel: [75808.585234] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 02:27:14 juju-e4d256-prod-github-runner-207 kernel: [75808.586278] Aug 23 02:27:14 juju-e4d256-prod-github-runner-207 kernel: [75808.587135] Aug 23 02:27:14 juju-e4d256-prod-github-runner-207 kernel: [75808.587975] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 02:27:14 juju-e4d256-prod-github-runner-207 kernel: [75808.589023] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:27:14 juju-e4d256-prod-github-runner-207 kernel: [75808.590058] ? _raw_spin_lock+0x22/0x30 Aug 23 02:27:14 juju-e4d256-prod-github-runner-207 kernel: [75808.590999] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:27:14 juju-e4d256-prod-github-runner-207 kernel: [75808.592012] direct_page_fault+0x206/0x310 [kvm] Aug 23 02:27:14 juju-e4d256-prod-github-runner-207 kernel: [75808.593048] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 02:27:14 juju-e4d256-prod-github-runner-207 kernel: [75808.594054] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 02:27:14 juju-e4d256-prod-github-runner-207 kernel: [75808.595051] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 02:27:14 juju-e4d256-prod-github-runner-207 kernel: [75808.596017] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 02:27:14 juju-e4d256-prod-github-runner-207 kernel: [75808.596977] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 02:27:14 juju-e4d256-prod-github-runner-207 kernel: [75808.597953] handle_exit+0x98/0x230 [kvm_amd] Aug 23 02:27:14 juju-e4d256-prod-github-runner-207 kernel: [75808.598847] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 02:27:14 juju-e4d256-prod-github-runner-207 kernel: [75808.599756] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 02:27:14 juju-e4d256-prod-github-runner-207 kernel: [75808.600689] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 02:27:14 juju-e4d256-prod-github-runner-207 kernel: [75808.601596] vcpu_run+0x62/0x2c0 [kvm] Aug 23 02:27:14 juju-e4d256-prod-github-runner-207 kernel: [75808.602404] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 02:27:14 juju-e4d256-prod-github-runner-207 kernel: [75808.603209] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 02:27:14 juju-e4d256-prod-github-runner-207 kernel: [75808.604059] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 02:27:14 juju-e4d256-prod-github-runner-207 kernel: [75808.604873] ? __seccomp_filter+0x4a/0x4a0 Aug 23 02:27:14 juju-e4d256-prod-github-runner-207 kernel: [75808.605613] ? __fget_files+0x86/0xc0 Aug 23 02:27:14 juju-e4d256-prod-github-runner-207 kernel: [75808.606313] __x64_sys_ioctl+0x95/0xd0 Aug 23 02:27:14 juju-e4d256-prod-github-runner-207 kernel: [75808.607004] do_syscall_64+0x5c/0xc0 Aug 23 02:27:14 juju-e4d256-prod-github-runner-207 kernel: [75808.607668] ? do_futex+0x162/0x1f0 Aug 23 02:27:14 juju-e4d256-prod-github-runner-207 kernel: [75808.608326] ? __x64_sys_futex+0x78/0x1e0 Aug 23 02:27:14 juju-e4d256-prod-github-runner-207 kernel: [75808.609003] ? __secure_computing+0xa9/0x120 Aug 23 02:27:14 juju-e4d256-prod-github-runner-207 kernel: [75808.609691] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 02:27:14 juju-e4d256-prod-github-runner-207 kernel: [75808.610452] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:27:14 juju-e4d256-prod-github-runner-207 kernel: [75808.611171] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:27:14 juju-e4d256-prod-github-runner-207 kernel: [75808.611886] ? do_syscall_64+0x69/0xc0 Aug 23 02:27:14 juju-e4d256-prod-github-runner-207 kernel: [75808.612542] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:27:14 juju-e4d256-prod-github-runner-207 kernel: [75808.613244] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:27:14 juju-e4d256-prod-github-runner-207 kernel: [75808.613936] ? do_syscall_64+0x69/0xc0 Aug 23 02:27:14 juju-e4d256-prod-github-runner-207 kernel: [75808.614558] ? do_syscall_64+0x69/0xc0 Aug 23 02:27:14 juju-e4d256-prod-github-runner-207 kernel: [75808.615322] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 02:27:14 juju-e4d256-prod-github-runner-207 kernel: [75808.616024] RIP: 0033:0x7faa5d0edaff Aug 23 02:27:14 juju-e4d256-prod-github-runner-207 kernel: [75808.616658] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 02:27:14 juju-e4d256-prod-github-runner-207 kernel: [75808.618652] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 02:27:14 juju-e4d256-prod-github-runner-207 kernel: [75808.619557] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 02:27:14 juju-e4d256-prod-github-runner-207 kernel: [75808.620459] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 02:27:14 juju-e4d256-prod-github-runner-207 kernel: [75808.621347] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 02:27:14 juju-e4d256-prod-github-runner-207 kernel: [75808.622234] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 02:27:14 juju-e4d256-prod-github-runner-207 kernel: [75808.623122] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 02:27:14 juju-e4d256-prod-github-runner-207 kernel: [75808.624017] Aug 23 02:27:42 juju-e4d256-prod-github-runner-207 kernel: [75836.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 70520s! [qemu-system-x86:6715] Aug 23 02:27:42 juju-e4d256-prod-github-runner-207 kernel: [75836.543706] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 02:27:42 juju-e4d256-prod-github-runner-207 kernel: [75836.543962] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 02:27:42 juju-e4d256-prod-github-runner-207 kernel: [75836.555997] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 02:27:42 juju-e4d256-prod-github-runner-207 kernel: [75836.557306] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 02:27:42 juju-e4d256-prod-github-runner-207 kernel: [75836.558532] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:27:42 juju-e4d256-prod-github-runner-207 kernel: [75836.559596] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 02:27:42 juju-e4d256-prod-github-runner-207 kernel: [75836.562159] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 02:27:42 juju-e4d256-prod-github-runner-207 kernel: [75836.563202] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 02:27:42 juju-e4d256-prod-github-runner-207 kernel: [75836.564374] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 02:27:42 juju-e4d256-prod-github-runner-207 kernel: [75836.565541] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 02:27:42 juju-e4d256-prod-github-runner-207 kernel: [75836.566699] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 02:27:42 juju-e4d256-prod-github-runner-207 kernel: [75836.567859] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 02:27:42 juju-e4d256-prod-github-runner-207 kernel: [75836.569033] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 02:27:42 juju-e4d256-prod-github-runner-207 kernel: [75836.570265] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 02:27:42 juju-e4d256-prod-github-runner-207 kernel: [75836.571361] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 02:27:42 juju-e4d256-prod-github-runner-207 kernel: [75836.572558] Call Trace: Aug 23 02:27:42 juju-e4d256-prod-github-runner-207 kernel: [75836.573473] Aug 23 02:27:42 juju-e4d256-prod-github-runner-207 kernel: [75836.574365] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:27:42 juju-e4d256-prod-github-runner-207 kernel: [75836.575492] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:27:42 juju-e4d256-prod-github-runner-207 kernel: [75836.576522] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:27:42 juju-e4d256-prod-github-runner-207 kernel: [75836.577611] ? show_regs.part.0+0x23/0x29 Aug 23 02:27:42 juju-e4d256-prod-github-runner-207 kernel: [75836.578608] ? show_regs.cold+0x8/0xd Aug 23 02:27:42 juju-e4d256-prod-github-runner-207 kernel: [75836.579579] ? watchdog_timer_fn+0x1be/0x220 Aug 23 02:27:42 juju-e4d256-prod-github-runner-207 kernel: [75836.580593] ? lockup_detector_update_enable+0x60/0x60 Aug 23 02:27:42 juju-e4d256-prod-github-runner-207 kernel: [75836.581712] ? __hrtimer_run_queues+0x107/0x230 Aug 23 02:27:42 juju-e4d256-prod-github-runner-207 kernel: [75836.582741] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 02:27:42 juju-e4d256-prod-github-runner-207 kernel: [75836.583767] ? hrtimer_interrupt+0x101/0x220 Aug 23 02:27:42 juju-e4d256-prod-github-runner-207 kernel: [75836.584788] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 02:27:42 juju-e4d256-prod-github-runner-207 kernel: [75836.585887] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 02:27:42 juju-e4d256-prod-github-runner-207 kernel: [75836.586937] Aug 23 02:27:42 juju-e4d256-prod-github-runner-207 kernel: [75836.587789] Aug 23 02:27:42 juju-e4d256-prod-github-runner-207 kernel: [75836.588633] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 02:27:42 juju-e4d256-prod-github-runner-207 kernel: [75836.589665] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:27:42 juju-e4d256-prod-github-runner-207 kernel: [75836.590707] ? _raw_spin_lock+0x22/0x30 Aug 23 02:27:42 juju-e4d256-prod-github-runner-207 kernel: [75836.591651] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:27:42 juju-e4d256-prod-github-runner-207 kernel: [75836.592674] direct_page_fault+0x206/0x310 [kvm] Aug 23 02:27:42 juju-e4d256-prod-github-runner-207 kernel: [75836.593697] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 02:27:42 juju-e4d256-prod-github-runner-207 kernel: [75836.594708] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 02:27:42 juju-e4d256-prod-github-runner-207 kernel: [75836.595708] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 02:27:42 juju-e4d256-prod-github-runner-207 kernel: [75836.596727] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 02:27:42 juju-e4d256-prod-github-runner-207 kernel: [75836.597683] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 02:27:42 juju-e4d256-prod-github-runner-207 kernel: [75836.598660] handle_exit+0x98/0x230 [kvm_amd] Aug 23 02:27:42 juju-e4d256-prod-github-runner-207 kernel: [75836.599553] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 02:27:42 juju-e4d256-prod-github-runner-207 kernel: [75836.600472] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 02:27:42 juju-e4d256-prod-github-runner-207 kernel: [75836.601404] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 02:27:42 juju-e4d256-prod-github-runner-207 kernel: [75836.602307] vcpu_run+0x62/0x2c0 [kvm] Aug 23 02:27:42 juju-e4d256-prod-github-runner-207 kernel: [75836.603123] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 02:27:42 juju-e4d256-prod-github-runner-207 kernel: [75836.603940] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 02:27:42 juju-e4d256-prod-github-runner-207 kernel: [75836.604794] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 02:27:42 juju-e4d256-prod-github-runner-207 kernel: [75836.605591] ? __seccomp_filter+0x4a/0x4a0 Aug 23 02:27:42 juju-e4d256-prod-github-runner-207 kernel: [75836.606339] ? __fget_files+0x86/0xc0 Aug 23 02:27:42 juju-e4d256-prod-github-runner-207 kernel: [75836.607042] __x64_sys_ioctl+0x95/0xd0 Aug 23 02:27:42 juju-e4d256-prod-github-runner-207 kernel: [75836.607740] do_syscall_64+0x5c/0xc0 Aug 23 02:27:42 juju-e4d256-prod-github-runner-207 kernel: [75836.608413] ? do_futex+0x162/0x1f0 Aug 23 02:27:42 juju-e4d256-prod-github-runner-207 kernel: [75836.609062] ? __x64_sys_futex+0x78/0x1e0 Aug 23 02:27:42 juju-e4d256-prod-github-runner-207 kernel: [75836.609741] ? __secure_computing+0xa9/0x120 Aug 23 02:27:42 juju-e4d256-prod-github-runner-207 kernel: [75836.610431] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 02:27:42 juju-e4d256-prod-github-runner-207 kernel: [75836.611223] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:27:42 juju-e4d256-prod-github-runner-207 kernel: [75836.611992] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:27:42 juju-e4d256-prod-github-runner-207 kernel: [75836.612715] ? do_syscall_64+0x69/0xc0 Aug 23 02:27:42 juju-e4d256-prod-github-runner-207 kernel: [75836.613360] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:27:42 juju-e4d256-prod-github-runner-207 kernel: [75836.614062] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:27:42 juju-e4d256-prod-github-runner-207 kernel: [75836.614757] ? do_syscall_64+0x69/0xc0 Aug 23 02:27:42 juju-e4d256-prod-github-runner-207 kernel: [75836.615384] ? do_syscall_64+0x69/0xc0 Aug 23 02:27:42 juju-e4d256-prod-github-runner-207 kernel: [75836.616021] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 02:27:42 juju-e4d256-prod-github-runner-207 kernel: [75836.616728] RIP: 0033:0x7faa5d0edaff Aug 23 02:27:42 juju-e4d256-prod-github-runner-207 kernel: [75836.617370] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 02:27:42 juju-e4d256-prod-github-runner-207 kernel: [75836.619357] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 02:27:42 juju-e4d256-prod-github-runner-207 kernel: [75836.620276] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 02:27:42 juju-e4d256-prod-github-runner-207 kernel: [75836.621166] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 02:27:42 juju-e4d256-prod-github-runner-207 kernel: [75836.622053] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 02:27:42 juju-e4d256-prod-github-runner-207 kernel: [75836.622938] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 02:27:42 juju-e4d256-prod-github-runner-207 kernel: [75836.623824] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 02:27:42 juju-e4d256-prod-github-runner-207 kernel: [75836.624723] Aug 23 02:28:10 juju-e4d256-prod-github-runner-207 kernel: [75864.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 70546s! [qemu-system-x86:6715] Aug 23 02:28:10 juju-e4d256-prod-github-runner-207 kernel: [75864.543112] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 02:28:10 juju-e4d256-prod-github-runner-207 kernel: [75864.543182] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 02:28:10 juju-e4d256-prod-github-runner-207 kernel: [75864.555542] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 02:28:10 juju-e4d256-prod-github-runner-207 kernel: [75864.556827] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 02:28:10 juju-e4d256-prod-github-runner-207 kernel: [75864.558056] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:28:10 juju-e4d256-prod-github-runner-207 kernel: [75864.559135] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 02:28:10 juju-e4d256-prod-github-runner-207 kernel: [75864.561725] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 02:28:10 juju-e4d256-prod-github-runner-207 kernel: [75864.562775] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 02:28:10 juju-e4d256-prod-github-runner-207 kernel: [75864.563960] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 02:28:10 juju-e4d256-prod-github-runner-207 kernel: [75864.565141] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 02:28:10 juju-e4d256-prod-github-runner-207 kernel: [75864.566300] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 02:28:10 juju-e4d256-prod-github-runner-207 kernel: [75864.567460] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 02:28:10 juju-e4d256-prod-github-runner-207 kernel: [75864.568653] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 02:28:10 juju-e4d256-prod-github-runner-207 kernel: [75864.569885] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 02:28:10 juju-e4d256-prod-github-runner-207 kernel: [75864.570981] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 02:28:10 juju-e4d256-prod-github-runner-207 kernel: [75864.572186] Call Trace: Aug 23 02:28:10 juju-e4d256-prod-github-runner-207 kernel: [75864.573102] Aug 23 02:28:10 juju-e4d256-prod-github-runner-207 kernel: [75864.574001] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:28:10 juju-e4d256-prod-github-runner-207 kernel: [75864.575052] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:28:10 juju-e4d256-prod-github-runner-207 kernel: [75864.576094] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:28:10 juju-e4d256-prod-github-runner-207 kernel: [75864.577172] ? show_regs.part.0+0x23/0x29 Aug 23 02:28:10 juju-e4d256-prod-github-runner-207 kernel: [75864.578170] ? show_regs.cold+0x8/0xd Aug 23 02:28:10 juju-e4d256-prod-github-runner-207 kernel: [75864.579149] ? watchdog_timer_fn+0x1be/0x220 Aug 23 02:28:10 juju-e4d256-prod-github-runner-207 kernel: [75864.580173] ? lockup_detector_update_enable+0x60/0x60 Aug 23 02:28:10 juju-e4d256-prod-github-runner-207 kernel: [75864.581236] ? __hrtimer_run_queues+0x107/0x230 Aug 23 02:28:10 juju-e4d256-prod-github-runner-207 kernel: [75864.582265] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 02:28:10 juju-e4d256-prod-github-runner-207 kernel: [75864.583289] ? hrtimer_interrupt+0x101/0x220 Aug 23 02:28:10 juju-e4d256-prod-github-runner-207 kernel: [75864.584321] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 02:28:10 juju-e4d256-prod-github-runner-207 kernel: [75864.585392] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 02:28:10 juju-e4d256-prod-github-runner-207 kernel: [75864.586438] Aug 23 02:28:10 juju-e4d256-prod-github-runner-207 kernel: [75864.587291] Aug 23 02:28:10 juju-e4d256-prod-github-runner-207 kernel: [75864.588144] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 02:28:10 juju-e4d256-prod-github-runner-207 kernel: [75864.589198] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:28:10 juju-e4d256-prod-github-runner-207 kernel: [75864.590249] ? _raw_spin_lock+0x22/0x30 Aug 23 02:28:10 juju-e4d256-prod-github-runner-207 kernel: [75864.591192] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:28:10 juju-e4d256-prod-github-runner-207 kernel: [75864.592295] direct_page_fault+0x206/0x310 [kvm] Aug 23 02:28:10 juju-e4d256-prod-github-runner-207 kernel: [75864.593369] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 02:28:10 juju-e4d256-prod-github-runner-207 kernel: [75864.594620] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 02:28:10 juju-e4d256-prod-github-runner-207 kernel: [75864.595751] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 02:28:10 juju-e4d256-prod-github-runner-207 kernel: [75864.596818] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 02:28:10 juju-e4d256-prod-github-runner-207 kernel: [75864.597859] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 02:28:10 juju-e4d256-prod-github-runner-207 kernel: [75864.598938] handle_exit+0x98/0x230 [kvm_amd] Aug 23 02:28:10 juju-e4d256-prod-github-runner-207 kernel: [75864.599939] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 02:28:10 juju-e4d256-prod-github-runner-207 kernel: [75864.600957] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 02:28:10 juju-e4d256-prod-github-runner-207 kernel: [75864.601997] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 02:28:10 juju-e4d256-prod-github-runner-207 kernel: [75864.602999] vcpu_run+0x62/0x2c0 [kvm] Aug 23 02:28:10 juju-e4d256-prod-github-runner-207 kernel: [75864.603925] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 02:28:10 juju-e4d256-prod-github-runner-207 kernel: [75864.604825] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 02:28:10 juju-e4d256-prod-github-runner-207 kernel: [75864.605804] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 02:28:10 juju-e4d256-prod-github-runner-207 kernel: [75864.606695] ? __seccomp_filter+0x4a/0x4a0 Aug 23 02:28:10 juju-e4d256-prod-github-runner-207 kernel: [75864.607521] ? __fget_files+0x86/0xc0 Aug 23 02:28:10 juju-e4d256-prod-github-runner-207 kernel: [75864.608325] __x64_sys_ioctl+0x95/0xd0 Aug 23 02:28:10 juju-e4d256-prod-github-runner-207 kernel: [75864.609104] do_syscall_64+0x5c/0xc0 Aug 23 02:28:10 juju-e4d256-prod-github-runner-207 kernel: [75864.609855] ? do_futex+0x162/0x1f0 Aug 23 02:28:10 juju-e4d256-prod-github-runner-207 kernel: [75864.610580] ? __x64_sys_futex+0x78/0x1e0 Aug 23 02:28:10 juju-e4d256-prod-github-runner-207 kernel: [75864.611330] ? __secure_computing+0xa9/0x120 Aug 23 02:28:10 juju-e4d256-prod-github-runner-207 kernel: [75864.612140] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 02:28:10 juju-e4d256-prod-github-runner-207 kernel: [75864.612913] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:28:10 juju-e4d256-prod-github-runner-207 kernel: [75864.613643] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:28:10 juju-e4d256-prod-github-runner-207 kernel: [75864.614362] ? do_syscall_64+0x69/0xc0 Aug 23 02:28:10 juju-e4d256-prod-github-runner-207 kernel: [75864.615008] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:28:10 juju-e4d256-prod-github-runner-207 kernel: [75864.615739] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:28:10 juju-e4d256-prod-github-runner-207 kernel: [75864.616438] ? do_syscall_64+0x69/0xc0 Aug 23 02:28:10 juju-e4d256-prod-github-runner-207 kernel: [75864.617065] ? do_syscall_64+0x69/0xc0 Aug 23 02:28:10 juju-e4d256-prod-github-runner-207 kernel: [75864.617690] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 02:28:10 juju-e4d256-prod-github-runner-207 kernel: [75864.618397] RIP: 0033:0x7faa5d0edaff Aug 23 02:28:10 juju-e4d256-prod-github-runner-207 kernel: [75864.619023] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 02:28:10 juju-e4d256-prod-github-runner-207 kernel: [75864.621041] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 02:28:10 juju-e4d256-prod-github-runner-207 kernel: [75864.621957] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 02:28:10 juju-e4d256-prod-github-runner-207 kernel: [75864.622851] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 02:28:10 juju-e4d256-prod-github-runner-207 kernel: [75864.623762] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 02:28:10 juju-e4d256-prod-github-runner-207 kernel: [75864.624686] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 02:28:10 juju-e4d256-prod-github-runner-207 kernel: [75864.625575] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 02:28:10 juju-e4d256-prod-github-runner-207 kernel: [75864.626469] Aug 23 02:28:38 juju-e4d256-prod-github-runner-207 kernel: [75892.541976] watchdog: BUG: soft lockup - CPU#1 stuck for 70572s! [qemu-system-x86:6715] Aug 23 02:28:38 juju-e4d256-prod-github-runner-207 kernel: [75892.543097] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 02:28:38 juju-e4d256-prod-github-runner-207 kernel: [75892.543163] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 02:28:38 juju-e4d256-prod-github-runner-207 kernel: [75892.555493] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 02:28:38 juju-e4d256-prod-github-runner-207 kernel: [75892.556762] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 02:28:38 juju-e4d256-prod-github-runner-207 kernel: [75892.558027] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:28:38 juju-e4d256-prod-github-runner-207 kernel: [75892.559083] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 02:28:38 juju-e4d256-prod-github-runner-207 kernel: [75892.561678] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 02:28:38 juju-e4d256-prod-github-runner-207 kernel: [75892.562718] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 02:28:38 juju-e4d256-prod-github-runner-207 kernel: [75892.563894] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 02:28:38 juju-e4d256-prod-github-runner-207 kernel: [75892.565055] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 02:28:38 juju-e4d256-prod-github-runner-207 kernel: [75892.566214] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 02:28:38 juju-e4d256-prod-github-runner-207 kernel: [75892.567385] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 02:28:38 juju-e4d256-prod-github-runner-207 kernel: [75892.568550] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 02:28:38 juju-e4d256-prod-github-runner-207 kernel: [75892.569781] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 02:28:38 juju-e4d256-prod-github-runner-207 kernel: [75892.570877] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 02:28:38 juju-e4d256-prod-github-runner-207 kernel: [75892.572076] Call Trace: Aug 23 02:28:38 juju-e4d256-prod-github-runner-207 kernel: [75892.573025] Aug 23 02:28:38 juju-e4d256-prod-github-runner-207 kernel: [75892.573908] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:28:38 juju-e4d256-prod-github-runner-207 kernel: [75892.574938] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:28:38 juju-e4d256-prod-github-runner-207 kernel: [75892.575967] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:28:38 juju-e4d256-prod-github-runner-207 kernel: [75892.577041] ? show_regs.part.0+0x23/0x29 Aug 23 02:28:38 juju-e4d256-prod-github-runner-207 kernel: [75892.578037] ? show_regs.cold+0x8/0xd Aug 23 02:28:38 juju-e4d256-prod-github-runner-207 kernel: [75892.579008] ? watchdog_timer_fn+0x1be/0x220 Aug 23 02:28:38 juju-e4d256-prod-github-runner-207 kernel: [75892.580026] ? lockup_detector_update_enable+0x60/0x60 Aug 23 02:28:38 juju-e4d256-prod-github-runner-207 kernel: [75892.581092] ? __hrtimer_run_queues+0x107/0x230 Aug 23 02:28:38 juju-e4d256-prod-github-runner-207 kernel: [75892.582118] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 02:28:38 juju-e4d256-prod-github-runner-207 kernel: [75892.583156] ? hrtimer_interrupt+0x101/0x220 Aug 23 02:28:38 juju-e4d256-prod-github-runner-207 kernel: [75892.584183] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 02:28:38 juju-e4d256-prod-github-runner-207 kernel: [75892.585272] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 02:28:38 juju-e4d256-prod-github-runner-207 kernel: [75892.586335] Aug 23 02:28:38 juju-e4d256-prod-github-runner-207 kernel: [75892.587187] Aug 23 02:28:38 juju-e4d256-prod-github-runner-207 kernel: [75892.588033] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 02:28:38 juju-e4d256-prod-github-runner-207 kernel: [75892.589062] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:28:38 juju-e4d256-prod-github-runner-207 kernel: [75892.590097] ? _raw_spin_lock+0x22/0x30 Aug 23 02:28:38 juju-e4d256-prod-github-runner-207 kernel: [75892.591045] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:28:38 juju-e4d256-prod-github-runner-207 kernel: [75892.592067] direct_page_fault+0x206/0x310 [kvm] Aug 23 02:28:38 juju-e4d256-prod-github-runner-207 kernel: [75892.593088] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 02:28:38 juju-e4d256-prod-github-runner-207 kernel: [75892.594095] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 02:28:38 juju-e4d256-prod-github-runner-207 kernel: [75892.595103] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 02:28:38 juju-e4d256-prod-github-runner-207 kernel: [75892.596084] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 02:28:38 juju-e4d256-prod-github-runner-207 kernel: [75892.597033] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 02:28:38 juju-e4d256-prod-github-runner-207 kernel: [75892.598009] handle_exit+0x98/0x230 [kvm_amd] Aug 23 02:28:38 juju-e4d256-prod-github-runner-207 kernel: [75892.598905] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 02:28:38 juju-e4d256-prod-github-runner-207 kernel: [75892.599831] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 02:28:38 juju-e4d256-prod-github-runner-207 kernel: [75892.600754] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 02:28:38 juju-e4d256-prod-github-runner-207 kernel: [75892.601656] vcpu_run+0x62/0x2c0 [kvm] Aug 23 02:28:38 juju-e4d256-prod-github-runner-207 kernel: [75892.602470] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 02:28:38 juju-e4d256-prod-github-runner-207 kernel: [75892.603286] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 02:28:38 juju-e4d256-prod-github-runner-207 kernel: [75892.604140] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 02:28:38 juju-e4d256-prod-github-runner-207 kernel: [75892.604938] ? __seccomp_filter+0x4a/0x4a0 Aug 23 02:28:38 juju-e4d256-prod-github-runner-207 kernel: [75892.605679] ? __fget_files+0x86/0xc0 Aug 23 02:28:38 juju-e4d256-prod-github-runner-207 kernel: [75892.606380] __x64_sys_ioctl+0x95/0xd0 Aug 23 02:28:38 juju-e4d256-prod-github-runner-207 kernel: [75892.607071] do_syscall_64+0x5c/0xc0 Aug 23 02:28:38 juju-e4d256-prod-github-runner-207 kernel: [75892.607747] ? do_futex+0x162/0x1f0 Aug 23 02:28:38 juju-e4d256-prod-github-runner-207 kernel: [75892.608394] ? __x64_sys_futex+0x78/0x1e0 Aug 23 02:28:38 juju-e4d256-prod-github-runner-207 kernel: [75892.609067] ? __secure_computing+0xa9/0x120 Aug 23 02:28:38 juju-e4d256-prod-github-runner-207 kernel: [75892.609754] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 02:28:38 juju-e4d256-prod-github-runner-207 kernel: [75892.610518] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:28:38 juju-e4d256-prod-github-runner-207 kernel: [75892.611248] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:28:38 juju-e4d256-prod-github-runner-207 kernel: [75892.611966] ? do_syscall_64+0x69/0xc0 Aug 23 02:28:38 juju-e4d256-prod-github-runner-207 kernel: [75892.612615] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:28:38 juju-e4d256-prod-github-runner-207 kernel: [75892.613318] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:28:38 juju-e4d256-prod-github-runner-207 kernel: [75892.614013] ? do_syscall_64+0x69/0xc0 Aug 23 02:28:38 juju-e4d256-prod-github-runner-207 kernel: [75892.614637] ? do_syscall_64+0x69/0xc0 Aug 23 02:28:38 juju-e4d256-prod-github-runner-207 kernel: [75892.615276] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 02:28:38 juju-e4d256-prod-github-runner-207 kernel: [75892.615981] RIP: 0033:0x7faa5d0edaff Aug 23 02:28:38 juju-e4d256-prod-github-runner-207 kernel: [75892.616611] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 02:28:38 juju-e4d256-prod-github-runner-207 kernel: [75892.618640] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 02:28:38 juju-e4d256-prod-github-runner-207 kernel: [75892.619563] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 02:28:38 juju-e4d256-prod-github-runner-207 kernel: [75892.620455] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 02:28:38 juju-e4d256-prod-github-runner-207 kernel: [75892.621346] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 02:28:38 juju-e4d256-prod-github-runner-207 kernel: [75892.622235] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 02:28:38 juju-e4d256-prod-github-runner-207 kernel: [75892.623125] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 02:28:38 juju-e4d256-prod-github-runner-207 kernel: [75892.624025] Aug 23 02:29:06 juju-e4d256-prod-github-runner-207 kernel: [75920.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 70598s! [qemu-system-x86:6715] Aug 23 02:29:06 juju-e4d256-prod-github-runner-207 kernel: [75920.543721] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 02:29:06 juju-e4d256-prod-github-runner-207 kernel: [75920.543958] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 02:29:06 juju-e4d256-prod-github-runner-207 kernel: [75920.556109] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 02:29:06 juju-e4d256-prod-github-runner-207 kernel: [75920.557370] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 02:29:06 juju-e4d256-prod-github-runner-207 kernel: [75920.558605] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:29:06 juju-e4d256-prod-github-runner-207 kernel: [75920.559674] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 02:29:06 juju-e4d256-prod-github-runner-207 kernel: [75920.562223] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 02:29:06 juju-e4d256-prod-github-runner-207 kernel: [75920.563274] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 02:29:06 juju-e4d256-prod-github-runner-207 kernel: [75920.564438] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 02:29:06 juju-e4d256-prod-github-runner-207 kernel: [75920.565606] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 02:29:06 juju-e4d256-prod-github-runner-207 kernel: [75920.566762] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 02:29:06 juju-e4d256-prod-github-runner-207 kernel: [75920.567936] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 02:29:06 juju-e4d256-prod-github-runner-207 kernel: [75920.569106] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 02:29:06 juju-e4d256-prod-github-runner-207 kernel: [75920.570336] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 02:29:06 juju-e4d256-prod-github-runner-207 kernel: [75920.571448] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 02:29:06 juju-e4d256-prod-github-runner-207 kernel: [75920.572638] Call Trace: Aug 23 02:29:06 juju-e4d256-prod-github-runner-207 kernel: [75920.573550] Aug 23 02:29:06 juju-e4d256-prod-github-runner-207 kernel: [75920.574441] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:29:06 juju-e4d256-prod-github-runner-207 kernel: [75920.575480] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:29:06 juju-e4d256-prod-github-runner-207 kernel: [75920.576499] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:29:06 juju-e4d256-prod-github-runner-207 kernel: [75920.577595] ? show_regs.part.0+0x23/0x29 Aug 23 02:29:06 juju-e4d256-prod-github-runner-207 kernel: [75920.578590] ? show_regs.cold+0x8/0xd Aug 23 02:29:06 juju-e4d256-prod-github-runner-207 kernel: [75920.579566] ? watchdog_timer_fn+0x1be/0x220 Aug 23 02:29:06 juju-e4d256-prod-github-runner-207 kernel: [75920.580574] ? lockup_detector_update_enable+0x60/0x60 Aug 23 02:29:06 juju-e4d256-prod-github-runner-207 kernel: [75920.581673] ? __hrtimer_run_queues+0x107/0x230 Aug 23 02:29:06 juju-e4d256-prod-github-runner-207 kernel: [75920.582700] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 02:29:06 juju-e4d256-prod-github-runner-207 kernel: [75920.583730] ? hrtimer_interrupt+0x101/0x220 Aug 23 02:29:06 juju-e4d256-prod-github-runner-207 kernel: [75920.584744] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 02:29:06 juju-e4d256-prod-github-runner-207 kernel: [75920.585810] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 02:29:06 juju-e4d256-prod-github-runner-207 kernel: [75920.586853] Aug 23 02:29:06 juju-e4d256-prod-github-runner-207 kernel: [75920.587712] Aug 23 02:29:06 juju-e4d256-prod-github-runner-207 kernel: [75920.588548] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 02:29:06 juju-e4d256-prod-github-runner-207 kernel: [75920.589586] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:29:06 juju-e4d256-prod-github-runner-207 kernel: [75920.590634] ? _raw_spin_lock+0x22/0x30 Aug 23 02:29:06 juju-e4d256-prod-github-runner-207 kernel: [75920.591596] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:29:06 juju-e4d256-prod-github-runner-207 kernel: [75920.592615] direct_page_fault+0x206/0x310 [kvm] Aug 23 02:29:06 juju-e4d256-prod-github-runner-207 kernel: [75920.593644] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 02:29:06 juju-e4d256-prod-github-runner-207 kernel: [75920.594672] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 02:29:06 juju-e4d256-prod-github-runner-207 kernel: [75920.595686] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 02:29:06 juju-e4d256-prod-github-runner-207 kernel: [75920.596675] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 02:29:06 juju-e4d256-prod-github-runner-207 kernel: [75920.597617] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 02:29:06 juju-e4d256-prod-github-runner-207 kernel: [75920.598592] handle_exit+0x98/0x230 [kvm_amd] Aug 23 02:29:06 juju-e4d256-prod-github-runner-207 kernel: [75920.599518] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 02:29:06 juju-e4d256-prod-github-runner-207 kernel: [75920.600433] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 02:29:06 juju-e4d256-prod-github-runner-207 kernel: [75920.601358] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 02:29:06 juju-e4d256-prod-github-runner-207 kernel: [75920.602258] vcpu_run+0x62/0x2c0 [kvm] Aug 23 02:29:06 juju-e4d256-prod-github-runner-207 kernel: [75920.603077] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 02:29:06 juju-e4d256-prod-github-runner-207 kernel: [75920.603887] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 02:29:06 juju-e4d256-prod-github-runner-207 kernel: [75920.604739] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 02:29:06 juju-e4d256-prod-github-runner-207 kernel: [75920.605538] ? __seccomp_filter+0x4a/0x4a0 Aug 23 02:29:06 juju-e4d256-prod-github-runner-207 kernel: [75920.606277] ? __fget_files+0x86/0xc0 Aug 23 02:29:06 juju-e4d256-prod-github-runner-207 kernel: [75920.606986] __x64_sys_ioctl+0x95/0xd0 Aug 23 02:29:06 juju-e4d256-prod-github-runner-207 kernel: [75920.607677] do_syscall_64+0x5c/0xc0 Aug 23 02:29:06 juju-e4d256-prod-github-runner-207 kernel: [75920.608338] ? do_futex+0x162/0x1f0 Aug 23 02:29:06 juju-e4d256-prod-github-runner-207 kernel: [75920.608989] ? __x64_sys_futex+0x78/0x1e0 Aug 23 02:29:06 juju-e4d256-prod-github-runner-207 kernel: [75920.609661] ? __secure_computing+0xa9/0x120 Aug 23 02:29:06 juju-e4d256-prod-github-runner-207 kernel: [75920.610347] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 02:29:06 juju-e4d256-prod-github-runner-207 kernel: [75920.611111] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:29:06 juju-e4d256-prod-github-runner-207 kernel: [75920.611836] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:29:06 juju-e4d256-prod-github-runner-207 kernel: [75920.612551] ? do_syscall_64+0x69/0xc0 Aug 23 02:29:06 juju-e4d256-prod-github-runner-207 kernel: [75920.613194] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:29:06 juju-e4d256-prod-github-runner-207 kernel: [75920.613899] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:29:06 juju-e4d256-prod-github-runner-207 kernel: [75920.614597] ? do_syscall_64+0x69/0xc0 Aug 23 02:29:06 juju-e4d256-prod-github-runner-207 kernel: [75920.615226] ? do_syscall_64+0x69/0xc0 Aug 23 02:29:06 juju-e4d256-prod-github-runner-207 kernel: [75920.615853] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 02:29:06 juju-e4d256-prod-github-runner-207 kernel: [75920.616556] RIP: 0033:0x7faa5d0edaff Aug 23 02:29:06 juju-e4d256-prod-github-runner-207 kernel: [75920.617196] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 02:29:06 juju-e4d256-prod-github-runner-207 kernel: [75920.619188] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 02:29:06 juju-e4d256-prod-github-runner-207 kernel: [75920.620100] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 02:29:06 juju-e4d256-prod-github-runner-207 kernel: [75920.620992] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 02:29:06 juju-e4d256-prod-github-runner-207 kernel: [75920.621881] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 02:29:06 juju-e4d256-prod-github-runner-207 kernel: [75920.622764] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 02:29:06 juju-e4d256-prod-github-runner-207 kernel: [75920.623655] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 02:29:06 juju-e4d256-prod-github-runner-207 kernel: [75920.624545] Aug 23 02:29:34 juju-e4d256-prod-github-runner-207 kernel: [75948.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 70624s! [qemu-system-x86:6715] Aug 23 02:29:34 juju-e4d256-prod-github-runner-207 kernel: [75948.543110] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 02:29:34 juju-e4d256-prod-github-runner-207 kernel: [75948.543184] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 02:29:34 juju-e4d256-prod-github-runner-207 kernel: [75948.555354] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 02:29:34 juju-e4d256-prod-github-runner-207 kernel: [75948.556621] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 02:29:34 juju-e4d256-prod-github-runner-207 kernel: [75948.557849] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:29:34 juju-e4d256-prod-github-runner-207 kernel: [75948.558915] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 02:29:34 juju-e4d256-prod-github-runner-207 kernel: [75948.561458] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 02:29:34 juju-e4d256-prod-github-runner-207 kernel: [75948.562503] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 02:29:34 juju-e4d256-prod-github-runner-207 kernel: [75948.563673] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 02:29:34 juju-e4d256-prod-github-runner-207 kernel: [75948.564840] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 02:29:34 juju-e4d256-prod-github-runner-207 kernel: [75948.566002] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 02:29:34 juju-e4d256-prod-github-runner-207 kernel: [75948.567184] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 02:29:34 juju-e4d256-prod-github-runner-207 kernel: [75948.568354] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 02:29:34 juju-e4d256-prod-github-runner-207 kernel: [75948.569590] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 02:29:34 juju-e4d256-prod-github-runner-207 kernel: [75948.570706] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 02:29:34 juju-e4d256-prod-github-runner-207 kernel: [75948.571906] Call Trace: Aug 23 02:29:34 juju-e4d256-prod-github-runner-207 kernel: [75948.572820] Aug 23 02:29:34 juju-e4d256-prod-github-runner-207 kernel: [75948.573703] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:29:34 juju-e4d256-prod-github-runner-207 kernel: [75948.574742] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:29:34 juju-e4d256-prod-github-runner-207 kernel: [75948.575765] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:29:34 juju-e4d256-prod-github-runner-207 kernel: [75948.576835] ? show_regs.part.0+0x23/0x29 Aug 23 02:29:34 juju-e4d256-prod-github-runner-207 kernel: [75948.577829] ? show_regs.cold+0x8/0xd Aug 23 02:29:34 juju-e4d256-prod-github-runner-207 kernel: [75948.578807] ? watchdog_timer_fn+0x1be/0x220 Aug 23 02:29:34 juju-e4d256-prod-github-runner-207 kernel: [75948.579812] ? lockup_detector_update_enable+0x60/0x60 Aug 23 02:29:34 juju-e4d256-prod-github-runner-207 kernel: [75948.580883] ? __hrtimer_run_queues+0x107/0x230 Aug 23 02:29:34 juju-e4d256-prod-github-runner-207 kernel: [75948.581912] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 02:29:34 juju-e4d256-prod-github-runner-207 kernel: [75948.583001] ? hrtimer_interrupt+0x101/0x220 Aug 23 02:29:34 juju-e4d256-prod-github-runner-207 kernel: [75948.584054] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 02:29:34 juju-e4d256-prod-github-runner-207 kernel: [75948.585159] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 02:29:34 juju-e4d256-prod-github-runner-207 kernel: [75948.586222] Aug 23 02:29:34 juju-e4d256-prod-github-runner-207 kernel: [75948.587091] Aug 23 02:29:34 juju-e4d256-prod-github-runner-207 kernel: [75948.587933] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 02:29:34 juju-e4d256-prod-github-runner-207 kernel: [75948.588969] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:29:34 juju-e4d256-prod-github-runner-207 kernel: [75948.590047] ? _raw_spin_lock+0x22/0x30 Aug 23 02:29:34 juju-e4d256-prod-github-runner-207 kernel: [75948.591003] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:29:34 juju-e4d256-prod-github-runner-207 kernel: [75948.592018] direct_page_fault+0x206/0x310 [kvm] Aug 23 02:29:34 juju-e4d256-prod-github-runner-207 kernel: [75948.593047] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 02:29:34 juju-e4d256-prod-github-runner-207 kernel: [75948.594059] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 02:29:34 juju-e4d256-prod-github-runner-207 kernel: [75948.595072] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 02:29:34 juju-e4d256-prod-github-runner-207 kernel: [75948.596048] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 02:29:34 juju-e4d256-prod-github-runner-207 kernel: [75948.596999] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 02:29:34 juju-e4d256-prod-github-runner-207 kernel: [75948.597980] handle_exit+0x98/0x230 [kvm_amd] Aug 23 02:29:34 juju-e4d256-prod-github-runner-207 kernel: [75948.598892] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 02:29:34 juju-e4d256-prod-github-runner-207 kernel: [75948.599808] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 02:29:34 juju-e4d256-prod-github-runner-207 kernel: [75948.600731] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 02:29:34 juju-e4d256-prod-github-runner-207 kernel: [75948.601639] vcpu_run+0x62/0x2c0 [kvm] Aug 23 02:29:34 juju-e4d256-prod-github-runner-207 kernel: [75948.602452] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 02:29:34 juju-e4d256-prod-github-runner-207 kernel: [75948.603277] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 02:29:34 juju-e4d256-prod-github-runner-207 kernel: [75948.604127] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 02:29:34 juju-e4d256-prod-github-runner-207 kernel: [75948.604969] ? __seccomp_filter+0x4a/0x4a0 Aug 23 02:29:34 juju-e4d256-prod-github-runner-207 kernel: [75948.605708] ? __fget_files+0x86/0xc0 Aug 23 02:29:34 juju-e4d256-prod-github-runner-207 kernel: [75948.606414] __x64_sys_ioctl+0x95/0xd0 Aug 23 02:29:34 juju-e4d256-prod-github-runner-207 kernel: [75948.607116] do_syscall_64+0x5c/0xc0 Aug 23 02:29:34 juju-e4d256-prod-github-runner-207 kernel: [75948.607778] ? do_futex+0x162/0x1f0 Aug 23 02:29:34 juju-e4d256-prod-github-runner-207 kernel: [75948.608424] ? __x64_sys_futex+0x78/0x1e0 Aug 23 02:29:34 juju-e4d256-prod-github-runner-207 kernel: [75948.609100] ? __secure_computing+0xa9/0x120 Aug 23 02:29:34 juju-e4d256-prod-github-runner-207 kernel: [75948.609788] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 02:29:34 juju-e4d256-prod-github-runner-207 kernel: [75948.610544] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:29:34 juju-e4d256-prod-github-runner-207 kernel: [75948.611278] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:29:34 juju-e4d256-prod-github-runner-207 kernel: [75948.611999] ? do_syscall_64+0x69/0xc0 Aug 23 02:29:34 juju-e4d256-prod-github-runner-207 kernel: [75948.612672] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:29:34 juju-e4d256-prod-github-runner-207 kernel: [75948.613396] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:29:34 juju-e4d256-prod-github-runner-207 kernel: [75948.614094] ? do_syscall_64+0x69/0xc0 Aug 23 02:29:34 juju-e4d256-prod-github-runner-207 kernel: [75948.614793] ? do_syscall_64+0x69/0xc0 Aug 23 02:29:34 juju-e4d256-prod-github-runner-207 kernel: [75948.615439] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 02:29:34 juju-e4d256-prod-github-runner-207 kernel: [75948.616149] RIP: 0033:0x7faa5d0edaff Aug 23 02:29:34 juju-e4d256-prod-github-runner-207 kernel: [75948.616773] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 02:29:34 juju-e4d256-prod-github-runner-207 kernel: [75948.618800] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 02:29:34 juju-e4d256-prod-github-runner-207 kernel: [75948.619717] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 02:29:34 juju-e4d256-prod-github-runner-207 kernel: [75948.620644] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 02:29:34 juju-e4d256-prod-github-runner-207 kernel: [75948.621535] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 02:29:34 juju-e4d256-prod-github-runner-207 kernel: [75948.622431] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 02:29:34 juju-e4d256-prod-github-runner-207 kernel: [75948.623349] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 02:29:34 juju-e4d256-prod-github-runner-207 kernel: [75948.624242] Aug 23 02:29:48 juju-e4d256-prod-github-runner-207 kernel: [75962.252705] rcu: INFO: rcu_sched self-detected stall on CPU Aug 23 02:29:48 juju-e4d256-prod-github-runner-207 kernel: [75962.253673] rcu: 1-....: (18901712 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=9137430 Aug 23 02:29:48 juju-e4d256-prod-github-runner-207 kernel: [75962.254802] (t=18961263 jiffies g=23269 q=64184) Aug 23 02:29:48 juju-e4d256-prod-github-runner-207 kernel: [75962.255596] NMI backtrace for cpu 1 Aug 23 02:29:48 juju-e4d256-prod-github-runner-207 kernel: [75962.256304] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 02:29:48 juju-e4d256-prod-github-runner-207 kernel: [75962.257406] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 02:29:48 juju-e4d256-prod-github-runner-207 kernel: [75962.258470] Call Trace: Aug 23 02:29:48 juju-e4d256-prod-github-runner-207 kernel: [75962.259146] Aug 23 02:29:48 juju-e4d256-prod-github-runner-207 kernel: [75962.259791] show_stack+0x52/0x5c Aug 23 02:29:48 juju-e4d256-prod-github-runner-207 kernel: [75962.260516] dump_stack_lvl+0x4a/0x63 Aug 23 02:29:48 juju-e4d256-prod-github-runner-207 kernel: [75962.261263] dump_stack+0x10/0x16 Aug 23 02:29:48 juju-e4d256-prod-github-runner-207 kernel: [75962.261980] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 23 02:29:48 juju-e4d256-prod-github-runner-207 kernel: [75962.262769] ? lapic_can_unplug_cpu+0x90/0x90 Aug 23 02:29:48 juju-e4d256-prod-github-runner-207 kernel: [75962.263549] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 23 02:29:48 juju-e4d256-prod-github-runner-207 kernel: [75962.264367] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 23 02:29:48 juju-e4d256-prod-github-runner-207 kernel: [75962.265191] trigger_single_cpu_backtrace+0x44/0x4f Aug 23 02:29:48 juju-e4d256-prod-github-runner-207 kernel: [75962.266000] rcu_dump_cpu_stacks+0x102/0x149 Aug 23 02:29:48 juju-e4d256-prod-github-runner-207 kernel: [75962.266778] print_cpu_stall.cold+0x2f/0xe2 Aug 23 02:29:48 juju-e4d256-prod-github-runner-207 kernel: [75962.267543] ? timekeeping_update+0xf7/0x150 Aug 23 02:29:48 juju-e4d256-prod-github-runner-207 kernel: [75962.268319] check_cpu_stall+0x109/0x270 Aug 23 02:29:48 juju-e4d256-prod-github-runner-207 kernel: [75962.269066] rcu_sched_clock_irq+0x9a/0x250 Aug 23 02:29:48 juju-e4d256-prod-github-runner-207 kernel: [75962.269827] update_process_times+0x94/0xd0 Aug 23 02:29:48 juju-e4d256-prod-github-runner-207 kernel: [75962.270593] tick_sched_handle+0x29/0x70 Aug 23 02:29:48 juju-e4d256-prod-github-runner-207 kernel: [75962.271353] tick_sched_timer+0x8c/0xc0 Aug 23 02:29:48 juju-e4d256-prod-github-runner-207 kernel: [75962.272093] ? tick_nohz_handler+0xb0/0xb0 Aug 23 02:29:48 juju-e4d256-prod-github-runner-207 kernel: [75962.272846] __hrtimer_run_queues+0x107/0x230 Aug 23 02:29:48 juju-e4d256-prod-github-runner-207 kernel: [75962.273618] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 02:29:48 juju-e4d256-prod-github-runner-207 kernel: [75962.274399] hrtimer_interrupt+0x101/0x220 Aug 23 02:29:48 juju-e4d256-prod-github-runner-207 kernel: [75962.275167] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 02:29:48 juju-e4d256-prod-github-runner-207 kernel: [75962.275979] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 02:29:48 juju-e4d256-prod-github-runner-207 kernel: [75962.276778] Aug 23 02:29:48 juju-e4d256-prod-github-runner-207 kernel: [75962.277413] Aug 23 02:29:48 juju-e4d256-prod-github-runner-207 kernel: [75962.278042] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 02:29:48 juju-e4d256-prod-github-runner-207 kernel: [75962.278867] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:29:48 juju-e4d256-prod-github-runner-207 kernel: [75962.279748] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 02:29:48 juju-e4d256-prod-github-runner-207 kernel: [75962.281949] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 02:29:48 juju-e4d256-prod-github-runner-207 kernel: [75962.282828] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 02:29:48 juju-e4d256-prod-github-runner-207 kernel: [75962.283821] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 02:29:48 juju-e4d256-prod-github-runner-207 kernel: [75962.284802] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 02:29:48 juju-e4d256-prod-github-runner-207 kernel: [75962.285765] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 02:29:48 juju-e4d256-prod-github-runner-207 kernel: [75962.286726] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 02:29:48 juju-e4d256-prod-github-runner-207 kernel: [75962.287678] ? _raw_spin_lock+0x22/0x30 Aug 23 02:29:48 juju-e4d256-prod-github-runner-207 kernel: [75962.288441] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:29:48 juju-e4d256-prod-github-runner-207 kernel: [75962.289282] direct_page_fault+0x206/0x310 [kvm] Aug 23 02:29:48 juju-e4d256-prod-github-runner-207 kernel: [75962.290126] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 02:29:48 juju-e4d256-prod-github-runner-207 kernel: [75962.290964] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 02:29:48 juju-e4d256-prod-github-runner-207 kernel: [75962.291785] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 02:29:48 juju-e4d256-prod-github-runner-207 kernel: [75962.292586] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 02:29:48 juju-e4d256-prod-github-runner-207 kernel: [75962.293377] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 02:29:48 juju-e4d256-prod-github-runner-207 kernel: [75962.294198] handle_exit+0x98/0x230 [kvm_amd] Aug 23 02:29:48 juju-e4d256-prod-github-runner-207 kernel: [75962.294961] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 02:29:48 juju-e4d256-prod-github-runner-207 kernel: [75962.295742] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 02:29:48 juju-e4d256-prod-github-runner-207 kernel: [75962.296539] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 02:29:48 juju-e4d256-prod-github-runner-207 kernel: [75962.297325] vcpu_run+0x62/0x2c0 [kvm] Aug 23 02:29:48 juju-e4d256-prod-github-runner-207 kernel: [75962.298039] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 02:29:48 juju-e4d256-prod-github-runner-207 kernel: [75962.298775] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 02:29:48 juju-e4d256-prod-github-runner-207 kernel: [75962.299577] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 02:29:48 juju-e4d256-prod-github-runner-207 kernel: [75962.300343] ? __seccomp_filter+0x4a/0x4a0 Aug 23 02:29:48 juju-e4d256-prod-github-runner-207 kernel: [75962.301067] ? __fget_files+0x86/0xc0 Aug 23 02:29:48 juju-e4d256-prod-github-runner-207 kernel: [75962.301762] __x64_sys_ioctl+0x95/0xd0 Aug 23 02:29:48 juju-e4d256-prod-github-runner-207 kernel: [75962.302464] do_syscall_64+0x5c/0xc0 Aug 23 02:29:48 juju-e4d256-prod-github-runner-207 kernel: [75962.303149] ? do_futex+0x162/0x1f0 Aug 23 02:29:48 juju-e4d256-prod-github-runner-207 kernel: [75962.303821] ? __x64_sys_futex+0x78/0x1e0 Aug 23 02:29:48 juju-e4d256-prod-github-runner-207 kernel: [75962.304523] ? __secure_computing+0xa9/0x120 Aug 23 02:29:48 juju-e4d256-prod-github-runner-207 kernel: [75962.305240] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 02:29:48 juju-e4d256-prod-github-runner-207 kernel: [75962.306032] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:29:48 juju-e4d256-prod-github-runner-207 kernel: [75962.306792] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:29:48 juju-e4d256-prod-github-runner-207 kernel: [75962.307545] ? do_syscall_64+0x69/0xc0 Aug 23 02:29:48 juju-e4d256-prod-github-runner-207 kernel: [75962.308239] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:29:48 juju-e4d256-prod-github-runner-207 kernel: [75962.308993] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:29:48 juju-e4d256-prod-github-runner-207 kernel: [75962.309753] ? do_syscall_64+0x69/0xc0 Aug 23 02:29:48 juju-e4d256-prod-github-runner-207 kernel: [75962.310454] ? do_syscall_64+0x69/0xc0 Aug 23 02:29:48 juju-e4d256-prod-github-runner-207 kernel: [75962.311140] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 02:29:48 juju-e4d256-prod-github-runner-207 kernel: [75962.311910] RIP: 0033:0x7faa5d0edaff Aug 23 02:29:48 juju-e4d256-prod-github-runner-207 kernel: [75962.312595] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 02:29:48 juju-e4d256-prod-github-runner-207 kernel: [75962.314699] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 02:29:48 juju-e4d256-prod-github-runner-207 kernel: [75962.315667] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 02:29:48 juju-e4d256-prod-github-runner-207 kernel: [75962.316612] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 02:29:48 juju-e4d256-prod-github-runner-207 kernel: [75962.317563] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 02:29:48 juju-e4d256-prod-github-runner-207 kernel: [75962.318510] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 02:29:48 juju-e4d256-prod-github-runner-207 kernel: [75962.319436] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 02:29:48 juju-e4d256-prod-github-runner-207 kernel: [75962.320351] Aug 23 02:30:14 juju-e4d256-prod-github-runner-207 kernel: [75988.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 70661s! [qemu-system-x86:6715] Aug 23 02:30:14 juju-e4d256-prod-github-runner-207 kernel: [75988.543153] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 02:30:14 juju-e4d256-prod-github-runner-207 kernel: [75988.543225] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 02:30:14 juju-e4d256-prod-github-runner-207 kernel: [75988.555506] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 02:30:14 juju-e4d256-prod-github-runner-207 kernel: [75988.556774] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 02:30:14 juju-e4d256-prod-github-runner-207 kernel: [75988.557998] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:30:14 juju-e4d256-prod-github-runner-207 kernel: [75988.559077] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 02:30:14 juju-e4d256-prod-github-runner-207 kernel: [75988.561648] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 02:30:14 juju-e4d256-prod-github-runner-207 kernel: [75988.562713] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 02:30:14 juju-e4d256-prod-github-runner-207 kernel: [75988.563892] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 02:30:14 juju-e4d256-prod-github-runner-207 kernel: [75988.565075] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 02:30:14 juju-e4d256-prod-github-runner-207 kernel: [75988.566259] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 02:30:14 juju-e4d256-prod-github-runner-207 kernel: [75988.567420] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 02:30:14 juju-e4d256-prod-github-runner-207 kernel: [75988.568599] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 02:30:14 juju-e4d256-prod-github-runner-207 kernel: [75988.569852] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 02:30:14 juju-e4d256-prod-github-runner-207 kernel: [75988.570973] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 02:30:14 juju-e4d256-prod-github-runner-207 kernel: [75988.572168] Call Trace: Aug 23 02:30:14 juju-e4d256-prod-github-runner-207 kernel: [75988.573080] Aug 23 02:30:14 juju-e4d256-prod-github-runner-207 kernel: [75988.573976] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:30:14 juju-e4d256-prod-github-runner-207 kernel: [75988.575042] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:30:14 juju-e4d256-prod-github-runner-207 kernel: [75988.576065] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:30:14 juju-e4d256-prod-github-runner-207 kernel: [75988.577144] ? show_regs.part.0+0x23/0x29 Aug 23 02:30:14 juju-e4d256-prod-github-runner-207 kernel: [75988.578142] ? show_regs.cold+0x8/0xd Aug 23 02:30:14 juju-e4d256-prod-github-runner-207 kernel: [75988.579145] ? watchdog_timer_fn+0x1be/0x220 Aug 23 02:30:14 juju-e4d256-prod-github-runner-207 kernel: [75988.580167] ? lockup_detector_update_enable+0x60/0x60 Aug 23 02:30:14 juju-e4d256-prod-github-runner-207 kernel: [75988.581233] ? __hrtimer_run_queues+0x107/0x230 Aug 23 02:30:14 juju-e4d256-prod-github-runner-207 kernel: [75988.582286] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 02:30:14 juju-e4d256-prod-github-runner-207 kernel: [75988.583315] ? hrtimer_interrupt+0x101/0x220 Aug 23 02:30:14 juju-e4d256-prod-github-runner-207 kernel: [75988.584351] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 02:30:14 juju-e4d256-prod-github-runner-207 kernel: [75988.585438] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 02:30:14 juju-e4d256-prod-github-runner-207 kernel: [75988.586502] Aug 23 02:30:14 juju-e4d256-prod-github-runner-207 kernel: [75988.587356] Aug 23 02:30:14 juju-e4d256-prod-github-runner-207 kernel: [75988.588194] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 02:30:14 juju-e4d256-prod-github-runner-207 kernel: [75988.589239] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:30:14 juju-e4d256-prod-github-runner-207 kernel: [75988.590307] ? _raw_spin_lock+0x22/0x30 Aug 23 02:30:14 juju-e4d256-prod-github-runner-207 kernel: [75988.591255] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:30:14 juju-e4d256-prod-github-runner-207 kernel: [75988.592274] direct_page_fault+0x206/0x310 [kvm] Aug 23 02:30:14 juju-e4d256-prod-github-runner-207 kernel: [75988.593299] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 02:30:14 juju-e4d256-prod-github-runner-207 kernel: [75988.594337] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 02:30:14 juju-e4d256-prod-github-runner-207 kernel: [75988.595362] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 02:30:14 juju-e4d256-prod-github-runner-207 kernel: [75988.596345] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 02:30:14 juju-e4d256-prod-github-runner-207 kernel: [75988.597294] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 02:30:14 juju-e4d256-prod-github-runner-207 kernel: [75988.598292] handle_exit+0x98/0x230 [kvm_amd] Aug 23 02:30:14 juju-e4d256-prod-github-runner-207 kernel: [75988.599189] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 02:30:14 juju-e4d256-prod-github-runner-207 kernel: [75988.600116] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 02:30:14 juju-e4d256-prod-github-runner-207 kernel: [75988.601054] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 02:30:14 juju-e4d256-prod-github-runner-207 kernel: [75988.601962] vcpu_run+0x62/0x2c0 [kvm] Aug 23 02:30:14 juju-e4d256-prod-github-runner-207 kernel: [75988.602792] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 02:30:14 juju-e4d256-prod-github-runner-207 kernel: [75988.603601] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 02:30:14 juju-e4d256-prod-github-runner-207 kernel: [75988.604455] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 02:30:14 juju-e4d256-prod-github-runner-207 kernel: [75988.605271] ? __seccomp_filter+0x4a/0x4a0 Aug 23 02:30:14 juju-e4d256-prod-github-runner-207 kernel: [75988.606024] ? __fget_files+0x86/0xc0 Aug 23 02:30:14 juju-e4d256-prod-github-runner-207 kernel: [75988.606748] __x64_sys_ioctl+0x95/0xd0 Aug 23 02:30:14 juju-e4d256-prod-github-runner-207 kernel: [75988.607445] do_syscall_64+0x5c/0xc0 Aug 23 02:30:14 juju-e4d256-prod-github-runner-207 kernel: [75988.608109] ? do_futex+0x162/0x1f0 Aug 23 02:30:14 juju-e4d256-prod-github-runner-207 kernel: [75988.608760] ? __x64_sys_futex+0x78/0x1e0 Aug 23 02:30:14 juju-e4d256-prod-github-runner-207 kernel: [75988.609436] ? __secure_computing+0xa9/0x120 Aug 23 02:30:14 juju-e4d256-prod-github-runner-207 kernel: [75988.610137] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 02:30:14 juju-e4d256-prod-github-runner-207 kernel: [75988.610925] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:30:14 juju-e4d256-prod-github-runner-207 kernel: [75988.611652] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:30:14 juju-e4d256-prod-github-runner-207 kernel: [75988.612375] ? do_syscall_64+0x69/0xc0 Aug 23 02:30:14 juju-e4d256-prod-github-runner-207 kernel: [75988.613021] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:30:14 juju-e4d256-prod-github-runner-207 kernel: [75988.613727] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:30:14 juju-e4d256-prod-github-runner-207 kernel: [75988.614441] ? do_syscall_64+0x69/0xc0 Aug 23 02:30:14 juju-e4d256-prod-github-runner-207 kernel: [75988.615077] ? do_syscall_64+0x69/0xc0 Aug 23 02:30:14 juju-e4d256-prod-github-runner-207 kernel: [75988.615708] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 02:30:14 juju-e4d256-prod-github-runner-207 kernel: [75988.616434] RIP: 0033:0x7faa5d0edaff Aug 23 02:30:14 juju-e4d256-prod-github-runner-207 kernel: [75988.617059] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 02:30:14 juju-e4d256-prod-github-runner-207 kernel: [75988.619066] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 02:30:14 juju-e4d256-prod-github-runner-207 kernel: [75988.619979] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 02:30:14 juju-e4d256-prod-github-runner-207 kernel: [75988.620883] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 02:30:14 juju-e4d256-prod-github-runner-207 kernel: [75988.621787] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 02:30:14 juju-e4d256-prod-github-runner-207 kernel: [75988.622689] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 02:30:14 juju-e4d256-prod-github-runner-207 kernel: [75988.623584] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 02:30:14 juju-e4d256-prod-github-runner-207 kernel: [75988.624480] Aug 23 02:30:42 juju-e4d256-prod-github-runner-207 kernel: [76016.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 70687s! [qemu-system-x86:6715] Aug 23 02:30:42 juju-e4d256-prod-github-runner-207 kernel: [76016.543719] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 02:30:42 juju-e4d256-prod-github-runner-207 kernel: [76016.543975] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 02:30:42 juju-e4d256-prod-github-runner-207 kernel: [76016.556096] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 02:30:42 juju-e4d256-prod-github-runner-207 kernel: [76016.557356] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 02:30:42 juju-e4d256-prod-github-runner-207 kernel: [76016.558581] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:30:42 juju-e4d256-prod-github-runner-207 kernel: [76016.559637] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 02:30:42 juju-e4d256-prod-github-runner-207 kernel: [76016.562193] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 02:30:42 juju-e4d256-prod-github-runner-207 kernel: [76016.563239] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 02:30:42 juju-e4d256-prod-github-runner-207 kernel: [76016.564401] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 02:30:42 juju-e4d256-prod-github-runner-207 kernel: [76016.565570] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 02:30:42 juju-e4d256-prod-github-runner-207 kernel: [76016.566742] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 02:30:42 juju-e4d256-prod-github-runner-207 kernel: [76016.567900] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 02:30:42 juju-e4d256-prod-github-runner-207 kernel: [76016.569064] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 02:30:42 juju-e4d256-prod-github-runner-207 kernel: [76016.570302] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 02:30:42 juju-e4d256-prod-github-runner-207 kernel: [76016.571398] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 02:30:42 juju-e4d256-prod-github-runner-207 kernel: [76016.572597] Call Trace: Aug 23 02:30:42 juju-e4d256-prod-github-runner-207 kernel: [76016.573510] Aug 23 02:30:42 juju-e4d256-prod-github-runner-207 kernel: [76016.574410] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:30:42 juju-e4d256-prod-github-runner-207 kernel: [76016.575445] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:30:42 juju-e4d256-prod-github-runner-207 kernel: [76016.576464] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:30:42 juju-e4d256-prod-github-runner-207 kernel: [76016.577556] ? show_regs.part.0+0x23/0x29 Aug 23 02:30:42 juju-e4d256-prod-github-runner-207 kernel: [76016.578565] ? show_regs.cold+0x8/0xd Aug 23 02:30:42 juju-e4d256-prod-github-runner-207 kernel: [76016.579537] ? watchdog_timer_fn+0x1be/0x220 Aug 23 02:30:42 juju-e4d256-prod-github-runner-207 kernel: [76016.580549] ? lockup_detector_update_enable+0x60/0x60 Aug 23 02:30:42 juju-e4d256-prod-github-runner-207 kernel: [76016.581612] ? __hrtimer_run_queues+0x107/0x230 Aug 23 02:30:42 juju-e4d256-prod-github-runner-207 kernel: [76016.582649] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 02:30:42 juju-e4d256-prod-github-runner-207 kernel: [76016.583677] ? hrtimer_interrupt+0x101/0x220 Aug 23 02:30:42 juju-e4d256-prod-github-runner-207 kernel: [76016.584691] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 02:30:42 juju-e4d256-prod-github-runner-207 kernel: [76016.585760] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 02:30:42 juju-e4d256-prod-github-runner-207 kernel: [76016.586808] Aug 23 02:30:42 juju-e4d256-prod-github-runner-207 kernel: [76016.587660] Aug 23 02:30:42 juju-e4d256-prod-github-runner-207 kernel: [76016.588496] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 02:30:42 juju-e4d256-prod-github-runner-207 kernel: [76016.589529] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:30:42 juju-e4d256-prod-github-runner-207 kernel: [76016.590582] ? _raw_spin_lock+0x22/0x30 Aug 23 02:30:42 juju-e4d256-prod-github-runner-207 kernel: [76016.591532] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:30:42 juju-e4d256-prod-github-runner-207 kernel: [76016.592545] direct_page_fault+0x206/0x310 [kvm] Aug 23 02:30:42 juju-e4d256-prod-github-runner-207 kernel: [76016.593568] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 02:30:42 juju-e4d256-prod-github-runner-207 kernel: [76016.594584] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 02:30:42 juju-e4d256-prod-github-runner-207 kernel: [76016.595583] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 02:30:42 juju-e4d256-prod-github-runner-207 kernel: [76016.596571] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 02:30:42 juju-e4d256-prod-github-runner-207 kernel: [76016.597516] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 02:30:42 juju-e4d256-prod-github-runner-207 kernel: [76016.598502] handle_exit+0x98/0x230 [kvm_amd] Aug 23 02:30:42 juju-e4d256-prod-github-runner-207 kernel: [76016.599393] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 02:30:42 juju-e4d256-prod-github-runner-207 kernel: [76016.600310] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 02:30:42 juju-e4d256-prod-github-runner-207 kernel: [76016.601235] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 02:30:42 juju-e4d256-prod-github-runner-207 kernel: [76016.602145] vcpu_run+0x62/0x2c0 [kvm] Aug 23 02:30:42 juju-e4d256-prod-github-runner-207 kernel: [76016.602959] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 02:30:42 juju-e4d256-prod-github-runner-207 kernel: [76016.603768] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 02:30:42 juju-e4d256-prod-github-runner-207 kernel: [76016.604619] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 02:30:42 juju-e4d256-prod-github-runner-207 kernel: [76016.605415] ? __seccomp_filter+0x4a/0x4a0 Aug 23 02:30:42 juju-e4d256-prod-github-runner-207 kernel: [76016.606162] ? __fget_files+0x86/0xc0 Aug 23 02:30:42 juju-e4d256-prod-github-runner-207 kernel: [76016.606863] __x64_sys_ioctl+0x95/0xd0 Aug 23 02:30:42 juju-e4d256-prod-github-runner-207 kernel: [76016.607552] do_syscall_64+0x5c/0xc0 Aug 23 02:30:42 juju-e4d256-prod-github-runner-207 kernel: [76016.608214] ? do_futex+0x162/0x1f0 Aug 23 02:30:42 juju-e4d256-prod-github-runner-207 kernel: [76016.608860] ? __x64_sys_futex+0x78/0x1e0 Aug 23 02:30:42 juju-e4d256-prod-github-runner-207 kernel: [76016.609532] ? __secure_computing+0xa9/0x120 Aug 23 02:30:42 juju-e4d256-prod-github-runner-207 kernel: [76016.610225] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 02:30:42 juju-e4d256-prod-github-runner-207 kernel: [76016.610989] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:30:42 juju-e4d256-prod-github-runner-207 kernel: [76016.611718] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:30:42 juju-e4d256-prod-github-runner-207 kernel: [76016.612433] ? do_syscall_64+0x69/0xc0 Aug 23 02:30:42 juju-e4d256-prod-github-runner-207 kernel: [76016.613080] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:30:42 juju-e4d256-prod-github-runner-207 kernel: [76016.613781] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:30:42 juju-e4d256-prod-github-runner-207 kernel: [76016.614481] ? do_syscall_64+0x69/0xc0 Aug 23 02:30:42 juju-e4d256-prod-github-runner-207 kernel: [76016.615104] ? do_syscall_64+0x69/0xc0 Aug 23 02:30:42 juju-e4d256-prod-github-runner-207 kernel: [76016.615727] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 02:30:42 juju-e4d256-prod-github-runner-207 kernel: [76016.616428] RIP: 0033:0x7faa5d0edaff Aug 23 02:30:42 juju-e4d256-prod-github-runner-207 kernel: [76016.617067] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 02:30:42 juju-e4d256-prod-github-runner-207 kernel: [76016.619061] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 02:30:42 juju-e4d256-prod-github-runner-207 kernel: [76016.619966] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 02:30:42 juju-e4d256-prod-github-runner-207 kernel: [76016.620851] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 02:30:42 juju-e4d256-prod-github-runner-207 kernel: [76016.621736] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 02:30:42 juju-e4d256-prod-github-runner-207 kernel: [76016.622630] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 02:30:42 juju-e4d256-prod-github-runner-207 kernel: [76016.623519] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 02:30:42 juju-e4d256-prod-github-runner-207 kernel: [76016.624405] Aug 23 02:31:10 juju-e4d256-prod-github-runner-207 kernel: [76044.541976] watchdog: BUG: soft lockup - CPU#1 stuck for 70713s! [qemu-system-x86:6715] Aug 23 02:31:10 juju-e4d256-prod-github-runner-207 kernel: [76044.543084] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 02:31:10 juju-e4d256-prod-github-runner-207 kernel: [76044.543151] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 02:31:10 juju-e4d256-prod-github-runner-207 kernel: [76044.555202] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 02:31:10 juju-e4d256-prod-github-runner-207 kernel: [76044.556464] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 02:31:10 juju-e4d256-prod-github-runner-207 kernel: [76044.557694] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:31:10 juju-e4d256-prod-github-runner-207 kernel: [76044.558762] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 02:31:10 juju-e4d256-prod-github-runner-207 kernel: [76044.561306] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 02:31:10 juju-e4d256-prod-github-runner-207 kernel: [76044.562359] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 02:31:10 juju-e4d256-prod-github-runner-207 kernel: [76044.563520] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 02:31:10 juju-e4d256-prod-github-runner-207 kernel: [76044.564685] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 02:31:10 juju-e4d256-prod-github-runner-207 kernel: [76044.565857] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 02:31:10 juju-e4d256-prod-github-runner-207 kernel: [76044.567017] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 02:31:10 juju-e4d256-prod-github-runner-207 kernel: [76044.568182] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 02:31:10 juju-e4d256-prod-github-runner-207 kernel: [76044.569456] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 02:31:10 juju-e4d256-prod-github-runner-207 kernel: [76044.570565] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 02:31:10 juju-e4d256-prod-github-runner-207 kernel: [76044.571791] Call Trace: Aug 23 02:31:10 juju-e4d256-prod-github-runner-207 kernel: [76044.572714] Aug 23 02:31:10 juju-e4d256-prod-github-runner-207 kernel: [76044.573625] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:31:10 juju-e4d256-prod-github-runner-207 kernel: [76044.574658] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:31:10 juju-e4d256-prod-github-runner-207 kernel: [76044.575678] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:31:10 juju-e4d256-prod-github-runner-207 kernel: [76044.576754] ? show_regs.part.0+0x23/0x29 Aug 23 02:31:10 juju-e4d256-prod-github-runner-207 kernel: [76044.577770] ? show_regs.cold+0x8/0xd Aug 23 02:31:10 juju-e4d256-prod-github-runner-207 kernel: [76044.578740] ? watchdog_timer_fn+0x1be/0x220 Aug 23 02:31:10 juju-e4d256-prod-github-runner-207 kernel: [76044.579879] ? lockup_detector_update_enable+0x60/0x60 Aug 23 02:31:10 juju-e4d256-prod-github-runner-207 kernel: [76044.580940] ? __hrtimer_run_queues+0x107/0x230 Aug 23 02:31:10 juju-e4d256-prod-github-runner-207 kernel: [76044.581975] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 02:31:10 juju-e4d256-prod-github-runner-207 kernel: [76044.583004] ? hrtimer_interrupt+0x101/0x220 Aug 23 02:31:10 juju-e4d256-prod-github-runner-207 kernel: [76044.584022] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 02:31:10 juju-e4d256-prod-github-runner-207 kernel: [76044.585089] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 02:31:10 juju-e4d256-prod-github-runner-207 kernel: [76044.586151] Aug 23 02:31:10 juju-e4d256-prod-github-runner-207 kernel: [76044.587003] Aug 23 02:31:10 juju-e4d256-prod-github-runner-207 kernel: [76044.587839] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 02:31:10 juju-e4d256-prod-github-runner-207 kernel: [76044.588870] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:31:10 juju-e4d256-prod-github-runner-207 kernel: [76044.589931] ? _raw_spin_lock+0x22/0x30 Aug 23 02:31:10 juju-e4d256-prod-github-runner-207 kernel: [76044.590876] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:31:10 juju-e4d256-prod-github-runner-207 kernel: [76044.591893] direct_page_fault+0x206/0x310 [kvm] Aug 23 02:31:10 juju-e4d256-prod-github-runner-207 kernel: [76044.592914] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 02:31:10 juju-e4d256-prod-github-runner-207 kernel: [76044.593937] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 02:31:10 juju-e4d256-prod-github-runner-207 kernel: [76044.594937] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 02:31:10 juju-e4d256-prod-github-runner-207 kernel: [76044.595904] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 02:31:10 juju-e4d256-prod-github-runner-207 kernel: [76044.596847] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 02:31:10 juju-e4d256-prod-github-runner-207 kernel: [76044.597838] handle_exit+0x98/0x230 [kvm_amd] Aug 23 02:31:10 juju-e4d256-prod-github-runner-207 kernel: [76044.598730] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 02:31:10 juju-e4d256-prod-github-runner-207 kernel: [76044.599642] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 02:31:10 juju-e4d256-prod-github-runner-207 kernel: [76044.600562] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 02:31:10 juju-e4d256-prod-github-runner-207 kernel: [76044.601463] vcpu_run+0x62/0x2c0 [kvm] Aug 23 02:31:10 juju-e4d256-prod-github-runner-207 kernel: [76044.602294] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 02:31:10 juju-e4d256-prod-github-runner-207 kernel: [76044.603101] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 02:31:10 juju-e4d256-prod-github-runner-207 kernel: [76044.603954] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 02:31:10 juju-e4d256-prod-github-runner-207 kernel: [76044.604750] ? __seccomp_filter+0x4a/0x4a0 Aug 23 02:31:10 juju-e4d256-prod-github-runner-207 kernel: [76044.605491] ? __fget_files+0x86/0xc0 Aug 23 02:31:10 juju-e4d256-prod-github-runner-207 kernel: [76044.606207] __x64_sys_ioctl+0x95/0xd0 Aug 23 02:31:10 juju-e4d256-prod-github-runner-207 kernel: [76044.606899] do_syscall_64+0x5c/0xc0 Aug 23 02:31:10 juju-e4d256-prod-github-runner-207 kernel: [76044.607566] ? do_futex+0x162/0x1f0 Aug 23 02:31:10 juju-e4d256-prod-github-runner-207 kernel: [76044.608219] ? __x64_sys_futex+0x78/0x1e0 Aug 23 02:31:10 juju-e4d256-prod-github-runner-207 kernel: [76044.608891] ? __secure_computing+0xa9/0x120 Aug 23 02:31:10 juju-e4d256-prod-github-runner-207 kernel: [76044.609594] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 02:31:10 juju-e4d256-prod-github-runner-207 kernel: [76044.610360] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:31:10 juju-e4d256-prod-github-runner-207 kernel: [76044.611113] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:31:10 juju-e4d256-prod-github-runner-207 kernel: [76044.611880] ? do_syscall_64+0x69/0xc0 Aug 23 02:31:10 juju-e4d256-prod-github-runner-207 kernel: [76044.612538] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:31:10 juju-e4d256-prod-github-runner-207 kernel: [76044.613242] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:31:10 juju-e4d256-prod-github-runner-207 kernel: [76044.613955] ? do_syscall_64+0x69/0xc0 Aug 23 02:31:10 juju-e4d256-prod-github-runner-207 kernel: [76044.614581] ? do_syscall_64+0x69/0xc0 Aug 23 02:31:10 juju-e4d256-prod-github-runner-207 kernel: [76044.615209] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 02:31:10 juju-e4d256-prod-github-runner-207 kernel: [76044.615916] RIP: 0033:0x7faa5d0edaff Aug 23 02:31:10 juju-e4d256-prod-github-runner-207 kernel: [76044.616540] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 02:31:10 juju-e4d256-prod-github-runner-207 kernel: [76044.618546] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 02:31:10 juju-e4d256-prod-github-runner-207 kernel: [76044.619465] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 02:31:10 juju-e4d256-prod-github-runner-207 kernel: [76044.620363] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 02:31:10 juju-e4d256-prod-github-runner-207 kernel: [76044.621253] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 02:31:10 juju-e4d256-prod-github-runner-207 kernel: [76044.622162] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 02:31:10 juju-e4d256-prod-github-runner-207 kernel: [76044.623058] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 02:31:10 juju-e4d256-prod-github-runner-207 kernel: [76044.623956] Aug 23 02:31:38 juju-e4d256-prod-github-runner-207 kernel: [76072.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 70740s! [qemu-system-x86:6715] Aug 23 02:31:38 juju-e4d256-prod-github-runner-207 kernel: [76072.543111] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 02:31:38 juju-e4d256-prod-github-runner-207 kernel: [76072.543178] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 02:31:38 juju-e4d256-prod-github-runner-207 kernel: [76072.555236] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 02:31:38 juju-e4d256-prod-github-runner-207 kernel: [76072.556501] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 02:31:38 juju-e4d256-prod-github-runner-207 kernel: [76072.557732] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:31:38 juju-e4d256-prod-github-runner-207 kernel: [76072.558788] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 02:31:38 juju-e4d256-prod-github-runner-207 kernel: [76072.561432] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 02:31:38 juju-e4d256-prod-github-runner-207 kernel: [76072.562480] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 02:31:38 juju-e4d256-prod-github-runner-207 kernel: [76072.563641] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 02:31:38 juju-e4d256-prod-github-runner-207 kernel: [76072.564800] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 02:31:38 juju-e4d256-prod-github-runner-207 kernel: [76072.565967] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 02:31:38 juju-e4d256-prod-github-runner-207 kernel: [76072.567134] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 02:31:38 juju-e4d256-prod-github-runner-207 kernel: [76072.568299] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 02:31:38 juju-e4d256-prod-github-runner-207 kernel: [76072.569544] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 02:31:38 juju-e4d256-prod-github-runner-207 kernel: [76072.570650] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 02:31:38 juju-e4d256-prod-github-runner-207 kernel: [76072.571844] Call Trace: Aug 23 02:31:38 juju-e4d256-prod-github-runner-207 kernel: [76072.572760] Aug 23 02:31:38 juju-e4d256-prod-github-runner-207 kernel: [76072.573656] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:31:38 juju-e4d256-prod-github-runner-207 kernel: [76072.574693] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:31:38 juju-e4d256-prod-github-runner-207 kernel: [76072.575712] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:31:38 juju-e4d256-prod-github-runner-207 kernel: [76072.576789] ? show_regs.part.0+0x23/0x29 Aug 23 02:31:38 juju-e4d256-prod-github-runner-207 kernel: [76072.577796] ? show_regs.cold+0x8/0xd Aug 23 02:31:38 juju-e4d256-prod-github-runner-207 kernel: [76072.578776] ? watchdog_timer_fn+0x1be/0x220 Aug 23 02:31:38 juju-e4d256-prod-github-runner-207 kernel: [76072.579794] ? lockup_detector_update_enable+0x60/0x60 Aug 23 02:31:38 juju-e4d256-prod-github-runner-207 kernel: [76072.580859] ? __hrtimer_run_queues+0x107/0x230 Aug 23 02:31:38 juju-e4d256-prod-github-runner-207 kernel: [76072.581899] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 02:31:38 juju-e4d256-prod-github-runner-207 kernel: [76072.582939] ? hrtimer_interrupt+0x101/0x220 Aug 23 02:31:38 juju-e4d256-prod-github-runner-207 kernel: [76072.584044] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 02:31:38 juju-e4d256-prod-github-runner-207 kernel: [76072.585123] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 02:31:38 juju-e4d256-prod-github-runner-207 kernel: [76072.586182] Aug 23 02:31:38 juju-e4d256-prod-github-runner-207 kernel: [76072.587035] Aug 23 02:31:38 juju-e4d256-prod-github-runner-207 kernel: [76072.587870] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 02:31:38 juju-e4d256-prod-github-runner-207 kernel: [76072.588906] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:31:38 juju-e4d256-prod-github-runner-207 kernel: [76072.589956] ? _raw_spin_lock+0x22/0x30 Aug 23 02:31:38 juju-e4d256-prod-github-runner-207 kernel: [76072.590905] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:31:38 juju-e4d256-prod-github-runner-207 kernel: [76072.591921] direct_page_fault+0x206/0x310 [kvm] Aug 23 02:31:38 juju-e4d256-prod-github-runner-207 kernel: [76072.592948] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 02:31:38 juju-e4d256-prod-github-runner-207 kernel: [76072.593969] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 02:31:38 juju-e4d256-prod-github-runner-207 kernel: [76072.594973] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 02:31:38 juju-e4d256-prod-github-runner-207 kernel: [76072.595947] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 02:31:38 juju-e4d256-prod-github-runner-207 kernel: [76072.596896] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 02:31:38 juju-e4d256-prod-github-runner-207 kernel: [76072.597883] handle_exit+0x98/0x230 [kvm_amd] Aug 23 02:31:38 juju-e4d256-prod-github-runner-207 kernel: [76072.598774] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 02:31:38 juju-e4d256-prod-github-runner-207 kernel: [76072.599687] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 02:31:38 juju-e4d256-prod-github-runner-207 kernel: [76072.600615] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 02:31:38 juju-e4d256-prod-github-runner-207 kernel: [76072.601532] vcpu_run+0x62/0x2c0 [kvm] Aug 23 02:31:38 juju-e4d256-prod-github-runner-207 kernel: [76072.602348] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 02:31:38 juju-e4d256-prod-github-runner-207 kernel: [76072.603159] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 02:31:38 juju-e4d256-prod-github-runner-207 kernel: [76072.604011] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 02:31:38 juju-e4d256-prod-github-runner-207 kernel: [76072.604806] ? __seccomp_filter+0x4a/0x4a0 Aug 23 02:31:38 juju-e4d256-prod-github-runner-207 kernel: [76072.605559] ? __fget_files+0x86/0xc0 Aug 23 02:31:38 juju-e4d256-prod-github-runner-207 kernel: [76072.606269] __x64_sys_ioctl+0x95/0xd0 Aug 23 02:31:38 juju-e4d256-prod-github-runner-207 kernel: [76072.606960] do_syscall_64+0x5c/0xc0 Aug 23 02:31:38 juju-e4d256-prod-github-runner-207 kernel: [76072.607622] ? do_futex+0x162/0x1f0 Aug 23 02:31:38 juju-e4d256-prod-github-runner-207 kernel: [76072.608273] ? __x64_sys_futex+0x78/0x1e0 Aug 23 02:31:38 juju-e4d256-prod-github-runner-207 kernel: [76072.608956] ? __secure_computing+0xa9/0x120 Aug 23 02:31:38 juju-e4d256-prod-github-runner-207 kernel: [76072.609662] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 02:31:38 juju-e4d256-prod-github-runner-207 kernel: [76072.610423] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:31:38 juju-e4d256-prod-github-runner-207 kernel: [76072.611141] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:31:38 juju-e4d256-prod-github-runner-207 kernel: [76072.611855] ? do_syscall_64+0x69/0xc0 Aug 23 02:31:38 juju-e4d256-prod-github-runner-207 kernel: [76072.612497] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:31:38 juju-e4d256-prod-github-runner-207 kernel: [76072.613218] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:31:38 juju-e4d256-prod-github-runner-207 kernel: [76072.613910] ? do_syscall_64+0x69/0xc0 Aug 23 02:31:38 juju-e4d256-prod-github-runner-207 kernel: [76072.614536] ? do_syscall_64+0x69/0xc0 Aug 23 02:31:38 juju-e4d256-prod-github-runner-207 kernel: [76072.615161] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 02:31:38 juju-e4d256-prod-github-runner-207 kernel: [76072.615862] RIP: 0033:0x7faa5d0edaff Aug 23 02:31:38 juju-e4d256-prod-github-runner-207 kernel: [76072.616488] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 02:31:38 juju-e4d256-prod-github-runner-207 kernel: [76072.618475] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 02:31:38 juju-e4d256-prod-github-runner-207 kernel: [76072.619386] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 02:31:38 juju-e4d256-prod-github-runner-207 kernel: [76072.620276] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 02:31:38 juju-e4d256-prod-github-runner-207 kernel: [76072.621160] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 02:31:38 juju-e4d256-prod-github-runner-207 kernel: [76072.622059] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 02:31:38 juju-e4d256-prod-github-runner-207 kernel: [76072.622945] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 02:31:38 juju-e4d256-prod-github-runner-207 kernel: [76072.623833] Aug 23 02:32:06 juju-e4d256-prod-github-runner-207 kernel: [76100.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 70766s! [qemu-system-x86:6715] Aug 23 02:32:06 juju-e4d256-prod-github-runner-207 kernel: [76100.543717] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 02:32:06 juju-e4d256-prod-github-runner-207 kernel: [76100.543969] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 02:32:06 juju-e4d256-prod-github-runner-207 kernel: [76100.556083] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 02:32:06 juju-e4d256-prod-github-runner-207 kernel: [76100.557367] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 02:32:06 juju-e4d256-prod-github-runner-207 kernel: [76100.558611] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:32:06 juju-e4d256-prod-github-runner-207 kernel: [76100.559668] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 02:32:06 juju-e4d256-prod-github-runner-207 kernel: [76100.562230] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 02:32:06 juju-e4d256-prod-github-runner-207 kernel: [76100.563272] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 02:32:06 juju-e4d256-prod-github-runner-207 kernel: [76100.564437] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 02:32:06 juju-e4d256-prod-github-runner-207 kernel: [76100.565605] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 02:32:06 juju-e4d256-prod-github-runner-207 kernel: [76100.566764] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 02:32:06 juju-e4d256-prod-github-runner-207 kernel: [76100.567925] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 02:32:06 juju-e4d256-prod-github-runner-207 kernel: [76100.569101] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 02:32:06 juju-e4d256-prod-github-runner-207 kernel: [76100.570335] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 02:32:06 juju-e4d256-prod-github-runner-207 kernel: [76100.571430] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 02:32:06 juju-e4d256-prod-github-runner-207 kernel: [76100.572627] Call Trace: Aug 23 02:32:06 juju-e4d256-prod-github-runner-207 kernel: [76100.573549] Aug 23 02:32:06 juju-e4d256-prod-github-runner-207 kernel: [76100.574444] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:32:06 juju-e4d256-prod-github-runner-207 kernel: [76100.575478] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:32:06 juju-e4d256-prod-github-runner-207 kernel: [76100.576505] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:32:06 juju-e4d256-prod-github-runner-207 kernel: [76100.577615] ? show_regs.part.0+0x23/0x29 Aug 23 02:32:06 juju-e4d256-prod-github-runner-207 kernel: [76100.578612] ? show_regs.cold+0x8/0xd Aug 23 02:32:06 juju-e4d256-prod-github-runner-207 kernel: [76100.579580] ? watchdog_timer_fn+0x1be/0x220 Aug 23 02:32:06 juju-e4d256-prod-github-runner-207 kernel: [76100.580586] ? lockup_detector_update_enable+0x60/0x60 Aug 23 02:32:06 juju-e4d256-prod-github-runner-207 kernel: [76100.581657] ? __hrtimer_run_queues+0x107/0x230 Aug 23 02:32:06 juju-e4d256-prod-github-runner-207 kernel: [76100.582688] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 02:32:06 juju-e4d256-prod-github-runner-207 kernel: [76100.583709] ? hrtimer_interrupt+0x101/0x220 Aug 23 02:32:06 juju-e4d256-prod-github-runner-207 kernel: [76100.584727] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 02:32:06 juju-e4d256-prod-github-runner-207 kernel: [76100.585808] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 02:32:06 juju-e4d256-prod-github-runner-207 kernel: [76100.586849] Aug 23 02:32:06 juju-e4d256-prod-github-runner-207 kernel: [76100.587703] Aug 23 02:32:06 juju-e4d256-prod-github-runner-207 kernel: [76100.588547] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 02:32:06 juju-e4d256-prod-github-runner-207 kernel: [76100.589586] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:32:06 juju-e4d256-prod-github-runner-207 kernel: [76100.590631] ? _raw_spin_lock+0x22/0x30 Aug 23 02:32:06 juju-e4d256-prod-github-runner-207 kernel: [76100.591580] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:32:06 juju-e4d256-prod-github-runner-207 kernel: [76100.592600] direct_page_fault+0x206/0x310 [kvm] Aug 23 02:32:06 juju-e4d256-prod-github-runner-207 kernel: [76100.593645] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 02:32:06 juju-e4d256-prod-github-runner-207 kernel: [76100.594652] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 02:32:06 juju-e4d256-prod-github-runner-207 kernel: [76100.595650] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 02:32:06 juju-e4d256-prod-github-runner-207 kernel: [76100.596646] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 02:32:06 juju-e4d256-prod-github-runner-207 kernel: [76100.597614] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 02:32:06 juju-e4d256-prod-github-runner-207 kernel: [76100.598589] handle_exit+0x98/0x230 [kvm_amd] Aug 23 02:32:06 juju-e4d256-prod-github-runner-207 kernel: [76100.599479] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 02:32:06 juju-e4d256-prod-github-runner-207 kernel: [76100.600389] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 02:32:06 juju-e4d256-prod-github-runner-207 kernel: [76100.601325] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 02:32:06 juju-e4d256-prod-github-runner-207 kernel: [76100.602226] vcpu_run+0x62/0x2c0 [kvm] Aug 23 02:32:06 juju-e4d256-prod-github-runner-207 kernel: [76100.603035] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 02:32:06 juju-e4d256-prod-github-runner-207 kernel: [76100.603846] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 02:32:06 juju-e4d256-prod-github-runner-207 kernel: [76100.604705] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 02:32:06 juju-e4d256-prod-github-runner-207 kernel: [76100.605508] ? __seccomp_filter+0x4a/0x4a0 Aug 23 02:32:06 juju-e4d256-prod-github-runner-207 kernel: [76100.606247] ? __fget_files+0x86/0xc0 Aug 23 02:32:06 juju-e4d256-prod-github-runner-207 kernel: [76100.606949] __x64_sys_ioctl+0x95/0xd0 Aug 23 02:32:06 juju-e4d256-prod-github-runner-207 kernel: [76100.607643] do_syscall_64+0x5c/0xc0 Aug 23 02:32:06 juju-e4d256-prod-github-runner-207 kernel: [76100.608307] ? do_futex+0x162/0x1f0 Aug 23 02:32:06 juju-e4d256-prod-github-runner-207 kernel: [76100.608968] ? __x64_sys_futex+0x78/0x1e0 Aug 23 02:32:06 juju-e4d256-prod-github-runner-207 kernel: [76100.609639] ? __secure_computing+0xa9/0x120 Aug 23 02:32:06 juju-e4d256-prod-github-runner-207 kernel: [76100.610331] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 02:32:06 juju-e4d256-prod-github-runner-207 kernel: [76100.611088] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:32:06 juju-e4d256-prod-github-runner-207 kernel: [76100.611807] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:32:06 juju-e4d256-prod-github-runner-207 kernel: [76100.612522] ? do_syscall_64+0x69/0xc0 Aug 23 02:32:06 juju-e4d256-prod-github-runner-207 kernel: [76100.613179] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:32:06 juju-e4d256-prod-github-runner-207 kernel: [76100.613885] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:32:06 juju-e4d256-prod-github-runner-207 kernel: [76100.614578] ? do_syscall_64+0x69/0xc0 Aug 23 02:32:06 juju-e4d256-prod-github-runner-207 kernel: [76100.615202] ? do_syscall_64+0x69/0xc0 Aug 23 02:32:06 juju-e4d256-prod-github-runner-207 kernel: [76100.615822] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 02:32:06 juju-e4d256-prod-github-runner-207 kernel: [76100.616524] RIP: 0033:0x7faa5d0edaff Aug 23 02:32:06 juju-e4d256-prod-github-runner-207 kernel: [76100.617177] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 02:32:06 juju-e4d256-prod-github-runner-207 kernel: [76100.619162] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 02:32:06 juju-e4d256-prod-github-runner-207 kernel: [76100.620070] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 02:32:06 juju-e4d256-prod-github-runner-207 kernel: [76100.620968] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 02:32:06 juju-e4d256-prod-github-runner-207 kernel: [76100.621859] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 02:32:06 juju-e4d256-prod-github-runner-207 kernel: [76100.622744] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 02:32:06 juju-e4d256-prod-github-runner-207 kernel: [76100.623639] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 02:32:06 juju-e4d256-prod-github-runner-207 kernel: [76100.624530] Aug 23 02:32:34 juju-e4d256-prod-github-runner-207 kernel: [76128.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 70792s! [qemu-system-x86:6715] Aug 23 02:32:34 juju-e4d256-prod-github-runner-207 kernel: [76128.543099] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 02:32:34 juju-e4d256-prod-github-runner-207 kernel: [76128.543168] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 02:32:34 juju-e4d256-prod-github-runner-207 kernel: [76128.555327] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 02:32:34 juju-e4d256-prod-github-runner-207 kernel: [76128.556602] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 02:32:34 juju-e4d256-prod-github-runner-207 kernel: [76128.557824] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:32:34 juju-e4d256-prod-github-runner-207 kernel: [76128.558881] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 02:32:34 juju-e4d256-prod-github-runner-207 kernel: [76128.561430] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 02:32:34 juju-e4d256-prod-github-runner-207 kernel: [76128.562476] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 02:32:34 juju-e4d256-prod-github-runner-207 kernel: [76128.563633] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 02:32:34 juju-e4d256-prod-github-runner-207 kernel: [76128.564858] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 02:32:34 juju-e4d256-prod-github-runner-207 kernel: [76128.566017] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 02:32:34 juju-e4d256-prod-github-runner-207 kernel: [76128.567175] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 02:32:34 juju-e4d256-prod-github-runner-207 kernel: [76128.568338] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 02:32:34 juju-e4d256-prod-github-runner-207 kernel: [76128.569574] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 02:32:34 juju-e4d256-prod-github-runner-207 kernel: [76128.570675] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 02:32:34 juju-e4d256-prod-github-runner-207 kernel: [76128.571866] Call Trace: Aug 23 02:32:34 juju-e4d256-prod-github-runner-207 kernel: [76128.572793] Aug 23 02:32:34 juju-e4d256-prod-github-runner-207 kernel: [76128.573681] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:32:34 juju-e4d256-prod-github-runner-207 kernel: [76128.574708] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:32:34 juju-e4d256-prod-github-runner-207 kernel: [76128.575726] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:32:34 juju-e4d256-prod-github-runner-207 kernel: [76128.576816] ? show_regs.part.0+0x23/0x29 Aug 23 02:32:34 juju-e4d256-prod-github-runner-207 kernel: [76128.577818] ? show_regs.cold+0x8/0xd Aug 23 02:32:34 juju-e4d256-prod-github-runner-207 kernel: [76128.578788] ? watchdog_timer_fn+0x1be/0x220 Aug 23 02:32:34 juju-e4d256-prod-github-runner-207 kernel: [76128.579800] ? lockup_detector_update_enable+0x60/0x60 Aug 23 02:32:34 juju-e4d256-prod-github-runner-207 kernel: [76128.580898] ? __hrtimer_run_queues+0x107/0x230 Aug 23 02:32:34 juju-e4d256-prod-github-runner-207 kernel: [76128.582002] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 02:32:34 juju-e4d256-prod-github-runner-207 kernel: [76128.583085] ? hrtimer_interrupt+0x101/0x220 Aug 23 02:32:34 juju-e4d256-prod-github-runner-207 kernel: [76128.584210] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 02:32:34 juju-e4d256-prod-github-runner-207 kernel: [76128.585391] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 02:32:34 juju-e4d256-prod-github-runner-207 kernel: [76128.586537] Aug 23 02:32:34 juju-e4d256-prod-github-runner-207 kernel: [76128.587451] Aug 23 02:32:34 juju-e4d256-prod-github-runner-207 kernel: [76128.588344] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 02:32:34 juju-e4d256-prod-github-runner-207 kernel: [76128.589503] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:32:34 juju-e4d256-prod-github-runner-207 kernel: [76128.590657] ? _raw_spin_lock+0x22/0x30 Aug 23 02:32:34 juju-e4d256-prod-github-runner-207 kernel: [76128.591679] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:32:34 juju-e4d256-prod-github-runner-207 kernel: [76128.592826] direct_page_fault+0x206/0x310 [kvm] Aug 23 02:32:34 juju-e4d256-prod-github-runner-207 kernel: [76128.593948] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 02:32:34 juju-e4d256-prod-github-runner-207 kernel: [76128.595043] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 02:32:34 juju-e4d256-prod-github-runner-207 kernel: [76128.596130] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 02:32:34 juju-e4d256-prod-github-runner-207 kernel: [76128.597202] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 02:32:34 juju-e4d256-prod-github-runner-207 kernel: [76128.598242] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 02:32:34 juju-e4d256-prod-github-runner-207 kernel: [76128.599339] handle_exit+0x98/0x230 [kvm_amd] Aug 23 02:32:34 juju-e4d256-prod-github-runner-207 kernel: [76128.600313] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 02:32:34 juju-e4d256-prod-github-runner-207 kernel: [76128.601326] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 02:32:34 juju-e4d256-prod-github-runner-207 kernel: [76128.602348] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 02:32:34 juju-e4d256-prod-github-runner-207 kernel: [76128.603427] vcpu_run+0x62/0x2c0 [kvm] Aug 23 02:32:34 juju-e4d256-prod-github-runner-207 kernel: [76128.604307] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 02:32:34 juju-e4d256-prod-github-runner-207 kernel: [76128.605215] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 02:32:34 juju-e4d256-prod-github-runner-207 kernel: [76128.606164] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 02:32:34 juju-e4d256-prod-github-runner-207 kernel: [76128.607046] ? __seccomp_filter+0x4a/0x4a0 Aug 23 02:32:34 juju-e4d256-prod-github-runner-207 kernel: [76128.607867] ? __fget_files+0x86/0xc0 Aug 23 02:32:34 juju-e4d256-prod-github-runner-207 kernel: [76128.608659] __x64_sys_ioctl+0x95/0xd0 Aug 23 02:32:34 juju-e4d256-prod-github-runner-207 kernel: [76128.609426] do_syscall_64+0x5c/0xc0 Aug 23 02:32:34 juju-e4d256-prod-github-runner-207 kernel: [76128.610172] ? do_futex+0x162/0x1f0 Aug 23 02:32:34 juju-e4d256-prod-github-runner-207 kernel: [76128.610926] ? __x64_sys_futex+0x78/0x1e0 Aug 23 02:32:34 juju-e4d256-prod-github-runner-207 kernel: [76128.611729] ? __secure_computing+0xa9/0x120 Aug 23 02:32:34 juju-e4d256-prod-github-runner-207 kernel: [76128.612518] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 02:32:34 juju-e4d256-prod-github-runner-207 kernel: [76128.613398] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:32:34 juju-e4d256-prod-github-runner-207 kernel: [76128.614210] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:32:34 juju-e4d256-prod-github-runner-207 kernel: [76128.615019] ? do_syscall_64+0x69/0xc0 Aug 23 02:32:34 juju-e4d256-prod-github-runner-207 kernel: [76128.615733] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:32:34 juju-e4d256-prod-github-runner-207 kernel: [76128.616525] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:32:34 juju-e4d256-prod-github-runner-207 kernel: [76128.617321] ? do_syscall_64+0x69/0xc0 Aug 23 02:32:34 juju-e4d256-prod-github-runner-207 kernel: [76128.618014] ? do_syscall_64+0x69/0xc0 Aug 23 02:32:34 juju-e4d256-prod-github-runner-207 kernel: [76128.618706] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 02:32:34 juju-e4d256-prod-github-runner-207 kernel: [76128.619503] RIP: 0033:0x7faa5d0edaff Aug 23 02:32:34 juju-e4d256-prod-github-runner-207 kernel: [76128.620214] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 02:32:34 juju-e4d256-prod-github-runner-207 kernel: [76128.622538] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 02:32:34 juju-e4d256-prod-github-runner-207 kernel: [76128.623589] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 02:32:34 juju-e4d256-prod-github-runner-207 kernel: [76128.624622] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 02:32:34 juju-e4d256-prod-github-runner-207 kernel: [76128.625641] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 02:32:34 juju-e4d256-prod-github-runner-207 kernel: [76128.626657] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 02:32:34 juju-e4d256-prod-github-runner-207 kernel: [76128.627679] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 02:32:34 juju-e4d256-prod-github-runner-207 kernel: [76128.628709] Aug 23 02:32:48 juju-e4d256-prod-github-runner-207 kernel: [76142.264705] rcu: INFO: rcu_sched self-detected stall on CPU Aug 23 02:32:48 juju-e4d256-prod-github-runner-207 kernel: [76142.265665] rcu: 1-....: (18946580 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=9159460 Aug 23 02:32:48 juju-e4d256-prod-github-runner-207 kernel: [76142.266806] (t=19006266 jiffies g=23269 q=64274) Aug 23 02:32:48 juju-e4d256-prod-github-runner-207 kernel: [76142.267593] NMI backtrace for cpu 1 Aug 23 02:32:48 juju-e4d256-prod-github-runner-207 kernel: [76142.268298] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 02:32:48 juju-e4d256-prod-github-runner-207 kernel: [76142.269412] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 02:32:48 juju-e4d256-prod-github-runner-207 kernel: [76142.270467] Call Trace: Aug 23 02:32:48 juju-e4d256-prod-github-runner-207 kernel: [76142.271141] Aug 23 02:32:48 juju-e4d256-prod-github-runner-207 kernel: [76142.271785] show_stack+0x52/0x5c Aug 23 02:32:48 juju-e4d256-prod-github-runner-207 kernel: [76142.272530] dump_stack_lvl+0x4a/0x63 Aug 23 02:32:48 juju-e4d256-prod-github-runner-207 kernel: [76142.273274] dump_stack+0x10/0x16 Aug 23 02:32:48 juju-e4d256-prod-github-runner-207 kernel: [76142.273990] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 23 02:32:48 juju-e4d256-prod-github-runner-207 kernel: [76142.274772] ? lapic_can_unplug_cpu+0x90/0x90 Aug 23 02:32:48 juju-e4d256-prod-github-runner-207 kernel: [76142.275547] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 23 02:32:48 juju-e4d256-prod-github-runner-207 kernel: [76142.276365] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 23 02:32:48 juju-e4d256-prod-github-runner-207 kernel: [76142.277198] trigger_single_cpu_backtrace+0x44/0x4f Aug 23 02:32:48 juju-e4d256-prod-github-runner-207 kernel: [76142.278002] rcu_dump_cpu_stacks+0x102/0x149 Aug 23 02:32:48 juju-e4d256-prod-github-runner-207 kernel: [76142.278770] print_cpu_stall.cold+0x2f/0xe2 Aug 23 02:32:48 juju-e4d256-prod-github-runner-207 kernel: [76142.279530] ? timekeeping_update+0xf7/0x150 Aug 23 02:32:48 juju-e4d256-prod-github-runner-207 kernel: [76142.280296] check_cpu_stall+0x109/0x270 Aug 23 02:32:48 juju-e4d256-prod-github-runner-207 kernel: [76142.281050] rcu_sched_clock_irq+0x9a/0x250 Aug 23 02:32:48 juju-e4d256-prod-github-runner-207 kernel: [76142.281808] update_process_times+0x94/0xd0 Aug 23 02:32:48 juju-e4d256-prod-github-runner-207 kernel: [76142.282564] tick_sched_handle+0x29/0x70 Aug 23 02:32:48 juju-e4d256-prod-github-runner-207 kernel: [76142.283307] tick_sched_timer+0x8c/0xc0 Aug 23 02:32:48 juju-e4d256-prod-github-runner-207 kernel: [76142.284055] ? tick_nohz_handler+0xb0/0xb0 Aug 23 02:32:48 juju-e4d256-prod-github-runner-207 kernel: [76142.284826] __hrtimer_run_queues+0x107/0x230 Aug 23 02:32:48 juju-e4d256-prod-github-runner-207 kernel: [76142.285594] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 02:32:48 juju-e4d256-prod-github-runner-207 kernel: [76142.286366] hrtimer_interrupt+0x101/0x220 Aug 23 02:32:48 juju-e4d256-prod-github-runner-207 kernel: [76142.287120] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 02:32:48 juju-e4d256-prod-github-runner-207 kernel: [76142.287943] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 02:32:48 juju-e4d256-prod-github-runner-207 kernel: [76142.288761] Aug 23 02:32:48 juju-e4d256-prod-github-runner-207 kernel: [76142.289397] Aug 23 02:32:48 juju-e4d256-prod-github-runner-207 kernel: [76142.290025] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 02:32:48 juju-e4d256-prod-github-runner-207 kernel: [76142.290842] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:32:48 juju-e4d256-prod-github-runner-207 kernel: [76142.291719] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 02:32:48 juju-e4d256-prod-github-runner-207 kernel: [76142.293933] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 02:32:48 juju-e4d256-prod-github-runner-207 kernel: [76142.294809] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 02:32:48 juju-e4d256-prod-github-runner-207 kernel: [76142.295797] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 02:32:48 juju-e4d256-prod-github-runner-207 kernel: [76142.296783] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 02:32:48 juju-e4d256-prod-github-runner-207 kernel: [76142.297757] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 02:32:48 juju-e4d256-prod-github-runner-207 kernel: [76142.298712] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 02:32:48 juju-e4d256-prod-github-runner-207 kernel: [76142.299662] ? _raw_spin_lock+0x22/0x30 Aug 23 02:32:48 juju-e4d256-prod-github-runner-207 kernel: [76142.300432] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:32:48 juju-e4d256-prod-github-runner-207 kernel: [76142.301267] direct_page_fault+0x206/0x310 [kvm] Aug 23 02:32:48 juju-e4d256-prod-github-runner-207 kernel: [76142.302102] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 02:32:48 juju-e4d256-prod-github-runner-207 kernel: [76142.302928] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 02:32:48 juju-e4d256-prod-github-runner-207 kernel: [76142.303750] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 02:32:48 juju-e4d256-prod-github-runner-207 kernel: [76142.304576] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 02:32:48 juju-e4d256-prod-github-runner-207 kernel: [76142.305359] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 02:32:48 juju-e4d256-prod-github-runner-207 kernel: [76142.306178] handle_exit+0x98/0x230 [kvm_amd] Aug 23 02:32:48 juju-e4d256-prod-github-runner-207 kernel: [76142.306934] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 02:32:48 juju-e4d256-prod-github-runner-207 kernel: [76142.307715] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 02:32:48 juju-e4d256-prod-github-runner-207 kernel: [76142.308526] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 02:32:48 juju-e4d256-prod-github-runner-207 kernel: [76142.309311] vcpu_run+0x62/0x2c0 [kvm] Aug 23 02:32:48 juju-e4d256-prod-github-runner-207 kernel: [76142.310060] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 02:32:48 juju-e4d256-prod-github-runner-207 kernel: [76142.310796] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 02:32:48 juju-e4d256-prod-github-runner-207 kernel: [76142.311596] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 02:32:48 juju-e4d256-prod-github-runner-207 kernel: [76142.312354] ? __seccomp_filter+0x4a/0x4a0 Aug 23 02:32:48 juju-e4d256-prod-github-runner-207 kernel: [76142.313090] ? __fget_files+0x86/0xc0 Aug 23 02:32:48 juju-e4d256-prod-github-runner-207 kernel: [76142.313782] __x64_sys_ioctl+0x95/0xd0 Aug 23 02:32:48 juju-e4d256-prod-github-runner-207 kernel: [76142.314474] do_syscall_64+0x5c/0xc0 Aug 23 02:32:48 juju-e4d256-prod-github-runner-207 kernel: [76142.315153] ? do_futex+0x162/0x1f0 Aug 23 02:32:48 juju-e4d256-prod-github-runner-207 kernel: [76142.315828] ? __x64_sys_futex+0x78/0x1e0 Aug 23 02:32:48 juju-e4d256-prod-github-runner-207 kernel: [76142.316539] ? __secure_computing+0xa9/0x120 Aug 23 02:32:48 juju-e4d256-prod-github-runner-207 kernel: [76142.317254] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 02:32:48 juju-e4d256-prod-github-runner-207 kernel: [76142.318044] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:32:48 juju-e4d256-prod-github-runner-207 kernel: [76142.318798] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:32:48 juju-e4d256-prod-github-runner-207 kernel: [76142.319551] ? do_syscall_64+0x69/0xc0 Aug 23 02:32:48 juju-e4d256-prod-github-runner-207 kernel: [76142.320240] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:32:48 juju-e4d256-prod-github-runner-207 kernel: [76142.321006] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:32:48 juju-e4d256-prod-github-runner-207 kernel: [76142.321774] ? do_syscall_64+0x69/0xc0 Aug 23 02:32:48 juju-e4d256-prod-github-runner-207 kernel: [76142.322467] ? do_syscall_64+0x69/0xc0 Aug 23 02:32:48 juju-e4d256-prod-github-runner-207 kernel: [76142.323154] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 02:32:48 juju-e4d256-prod-github-runner-207 kernel: [76142.323928] RIP: 0033:0x7faa5d0edaff Aug 23 02:32:48 juju-e4d256-prod-github-runner-207 kernel: [76142.324632] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 02:32:48 juju-e4d256-prod-github-runner-207 kernel: [76142.326736] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 02:32:48 juju-e4d256-prod-github-runner-207 kernel: [76142.327698] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 02:32:48 juju-e4d256-prod-github-runner-207 kernel: [76142.328670] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 02:32:48 juju-e4d256-prod-github-runner-207 kernel: [76142.329619] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 02:32:48 juju-e4d256-prod-github-runner-207 kernel: [76142.330557] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 02:32:48 juju-e4d256-prod-github-runner-207 kernel: [76142.331480] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 02:32:48 juju-e4d256-prod-github-runner-207 kernel: [76142.332397] Aug 23 02:33:14 juju-e4d256-prod-github-runner-207 kernel: [76168.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 70829s! [qemu-system-x86:6715] Aug 23 02:33:14 juju-e4d256-prod-github-runner-207 kernel: [76168.543106] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 02:33:14 juju-e4d256-prod-github-runner-207 kernel: [76168.543174] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 02:33:14 juju-e4d256-prod-github-runner-207 kernel: [76168.555356] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 02:33:14 juju-e4d256-prod-github-runner-207 kernel: [76168.556653] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 02:33:14 juju-e4d256-prod-github-runner-207 kernel: [76168.557968] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:33:14 juju-e4d256-prod-github-runner-207 kernel: [76168.559025] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 02:33:14 juju-e4d256-prod-github-runner-207 kernel: [76168.561659] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 02:33:14 juju-e4d256-prod-github-runner-207 kernel: [76168.562717] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 02:33:14 juju-e4d256-prod-github-runner-207 kernel: [76168.563884] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 02:33:14 juju-e4d256-prod-github-runner-207 kernel: [76168.565075] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 02:33:14 juju-e4d256-prod-github-runner-207 kernel: [76168.566239] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 02:33:14 juju-e4d256-prod-github-runner-207 kernel: [76168.567434] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 02:33:14 juju-e4d256-prod-github-runner-207 kernel: [76168.568623] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 02:33:14 juju-e4d256-prod-github-runner-207 kernel: [76168.569867] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 02:33:14 juju-e4d256-prod-github-runner-207 kernel: [76168.570974] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 02:33:14 juju-e4d256-prod-github-runner-207 kernel: [76168.572192] Call Trace: Aug 23 02:33:14 juju-e4d256-prod-github-runner-207 kernel: [76168.573123] Aug 23 02:33:14 juju-e4d256-prod-github-runner-207 kernel: [76168.574014] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:33:14 juju-e4d256-prod-github-runner-207 kernel: [76168.575052] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:33:14 juju-e4d256-prod-github-runner-207 kernel: [76168.576077] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:33:14 juju-e4d256-prod-github-runner-207 kernel: [76168.577203] ? show_regs.part.0+0x23/0x29 Aug 23 02:33:14 juju-e4d256-prod-github-runner-207 kernel: [76168.578216] ? show_regs.cold+0x8/0xd Aug 23 02:33:14 juju-e4d256-prod-github-runner-207 kernel: [76168.579194] ? watchdog_timer_fn+0x1be/0x220 Aug 23 02:33:14 juju-e4d256-prod-github-runner-207 kernel: [76168.580227] ? lockup_detector_update_enable+0x60/0x60 Aug 23 02:33:14 juju-e4d256-prod-github-runner-207 kernel: [76168.581295] ? __hrtimer_run_queues+0x107/0x230 Aug 23 02:33:14 juju-e4d256-prod-github-runner-207 kernel: [76168.582335] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 02:33:14 juju-e4d256-prod-github-runner-207 kernel: [76168.583380] ? hrtimer_interrupt+0x101/0x220 Aug 23 02:33:14 juju-e4d256-prod-github-runner-207 kernel: [76168.584461] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 02:33:14 juju-e4d256-prod-github-runner-207 kernel: [76168.585550] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 02:33:14 juju-e4d256-prod-github-runner-207 kernel: [76168.586604] Aug 23 02:33:14 juju-e4d256-prod-github-runner-207 kernel: [76168.587485] Aug 23 02:33:14 juju-e4d256-prod-github-runner-207 kernel: [76168.588377] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 02:33:14 juju-e4d256-prod-github-runner-207 kernel: [76168.589420] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:33:14 juju-e4d256-prod-github-runner-207 kernel: [76168.590465] ? _raw_spin_lock+0x22/0x30 Aug 23 02:33:14 juju-e4d256-prod-github-runner-207 kernel: [76168.591415] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:33:14 juju-e4d256-prod-github-runner-207 kernel: [76168.592460] direct_page_fault+0x206/0x310 [kvm] Aug 23 02:33:14 juju-e4d256-prod-github-runner-207 kernel: [76168.593506] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 02:33:14 juju-e4d256-prod-github-runner-207 kernel: [76168.594533] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 02:33:14 juju-e4d256-prod-github-runner-207 kernel: [76168.595548] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 02:33:14 juju-e4d256-prod-github-runner-207 kernel: [76168.596571] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 02:33:14 juju-e4d256-prod-github-runner-207 kernel: [76168.597534] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 02:33:14 juju-e4d256-prod-github-runner-207 kernel: [76168.598535] handle_exit+0x98/0x230 [kvm_amd] Aug 23 02:33:14 juju-e4d256-prod-github-runner-207 kernel: [76168.599435] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 02:33:14 juju-e4d256-prod-github-runner-207 kernel: [76168.600369] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 02:33:14 juju-e4d256-prod-github-runner-207 kernel: [76168.601298] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 02:33:14 juju-e4d256-prod-github-runner-207 kernel: [76168.602210] vcpu_run+0x62/0x2c0 [kvm] Aug 23 02:33:14 juju-e4d256-prod-github-runner-207 kernel: [76168.603032] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 02:33:14 juju-e4d256-prod-github-runner-207 kernel: [76168.603850] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 02:33:14 juju-e4d256-prod-github-runner-207 kernel: [76168.604735] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 02:33:14 juju-e4d256-prod-github-runner-207 kernel: [76168.605541] ? __seccomp_filter+0x4a/0x4a0 Aug 23 02:33:14 juju-e4d256-prod-github-runner-207 kernel: [76168.606286] ? __fget_files+0x86/0xc0 Aug 23 02:33:14 juju-e4d256-prod-github-runner-207 kernel: [76168.606994] __x64_sys_ioctl+0x95/0xd0 Aug 23 02:33:14 juju-e4d256-prod-github-runner-207 kernel: [76168.607696] do_syscall_64+0x5c/0xc0 Aug 23 02:33:14 juju-e4d256-prod-github-runner-207 kernel: [76168.608379] ? do_futex+0x162/0x1f0 Aug 23 02:33:14 juju-e4d256-prod-github-runner-207 kernel: [76168.609081] ? __x64_sys_futex+0x78/0x1e0 Aug 23 02:33:14 juju-e4d256-prod-github-runner-207 kernel: [76168.609766] ? __secure_computing+0xa9/0x120 Aug 23 02:33:14 juju-e4d256-prod-github-runner-207 kernel: [76168.610457] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 02:33:14 juju-e4d256-prod-github-runner-207 kernel: [76168.611218] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:33:14 juju-e4d256-prod-github-runner-207 kernel: [76168.611941] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:33:14 juju-e4d256-prod-github-runner-207 kernel: [76168.612673] ? do_syscall_64+0x69/0xc0 Aug 23 02:33:14 juju-e4d256-prod-github-runner-207 kernel: [76168.613319] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:33:14 juju-e4d256-prod-github-runner-207 kernel: [76168.614057] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:33:14 juju-e4d256-prod-github-runner-207 kernel: [76168.614762] ? do_syscall_64+0x69/0xc0 Aug 23 02:33:14 juju-e4d256-prod-github-runner-207 kernel: [76168.615386] ? do_syscall_64+0x69/0xc0 Aug 23 02:33:14 juju-e4d256-prod-github-runner-207 kernel: [76168.616006] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 02:33:14 juju-e4d256-prod-github-runner-207 kernel: [76168.616721] RIP: 0033:0x7faa5d0edaff Aug 23 02:33:14 juju-e4d256-prod-github-runner-207 kernel: [76168.617343] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 02:33:14 juju-e4d256-prod-github-runner-207 kernel: [76168.619336] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 02:33:14 juju-e4d256-prod-github-runner-207 kernel: [76168.620264] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 02:33:14 juju-e4d256-prod-github-runner-207 kernel: [76168.621161] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 02:33:14 juju-e4d256-prod-github-runner-207 kernel: [76168.622051] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 02:33:14 juju-e4d256-prod-github-runner-207 kernel: [76168.622938] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 02:33:14 juju-e4d256-prod-github-runner-207 kernel: [76168.623826] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 02:33:14 juju-e4d256-prod-github-runner-207 kernel: [76168.624748] Aug 23 02:33:42 juju-e4d256-prod-github-runner-207 kernel: [76196.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 70855s! [qemu-system-x86:6715] Aug 23 02:33:42 juju-e4d256-prod-github-runner-207 kernel: [76196.543742] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 02:33:42 juju-e4d256-prod-github-runner-207 kernel: [76196.544032] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 02:33:42 juju-e4d256-prod-github-runner-207 kernel: [76196.556280] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 02:33:42 juju-e4d256-prod-github-runner-207 kernel: [76196.557547] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 02:33:42 juju-e4d256-prod-github-runner-207 kernel: [76196.558773] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:33:42 juju-e4d256-prod-github-runner-207 kernel: [76196.559914] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 02:33:42 juju-e4d256-prod-github-runner-207 kernel: [76196.562464] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 02:33:42 juju-e4d256-prod-github-runner-207 kernel: [76196.563505] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 02:33:42 juju-e4d256-prod-github-runner-207 kernel: [76196.564679] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 02:33:42 juju-e4d256-prod-github-runner-207 kernel: [76196.565841] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 02:33:42 juju-e4d256-prod-github-runner-207 kernel: [76196.567012] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 02:33:42 juju-e4d256-prod-github-runner-207 kernel: [76196.568195] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 02:33:42 juju-e4d256-prod-github-runner-207 kernel: [76196.569367] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 02:33:42 juju-e4d256-prod-github-runner-207 kernel: [76196.570611] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 02:33:42 juju-e4d256-prod-github-runner-207 kernel: [76196.571708] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 02:33:42 juju-e4d256-prod-github-runner-207 kernel: [76196.572915] Call Trace: Aug 23 02:33:42 juju-e4d256-prod-github-runner-207 kernel: [76196.573832] Aug 23 02:33:42 juju-e4d256-prod-github-runner-207 kernel: [76196.574725] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:33:42 juju-e4d256-prod-github-runner-207 kernel: [76196.575759] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:33:42 juju-e4d256-prod-github-runner-207 kernel: [76196.576792] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:33:42 juju-e4d256-prod-github-runner-207 kernel: [76196.577886] ? show_regs.part.0+0x23/0x29 Aug 23 02:33:42 juju-e4d256-prod-github-runner-207 kernel: [76196.578884] ? show_regs.cold+0x8/0xd Aug 23 02:33:42 juju-e4d256-prod-github-runner-207 kernel: [76196.579868] ? watchdog_timer_fn+0x1be/0x220 Aug 23 02:33:42 juju-e4d256-prod-github-runner-207 kernel: [76196.580880] ? lockup_detector_update_enable+0x60/0x60 Aug 23 02:33:42 juju-e4d256-prod-github-runner-207 kernel: [76196.581948] ? __hrtimer_run_queues+0x107/0x230 Aug 23 02:33:42 juju-e4d256-prod-github-runner-207 kernel: [76196.582974] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 02:33:42 juju-e4d256-prod-github-runner-207 kernel: [76196.584015] ? hrtimer_interrupt+0x101/0x220 Aug 23 02:33:42 juju-e4d256-prod-github-runner-207 kernel: [76196.585034] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 02:33:42 juju-e4d256-prod-github-runner-207 kernel: [76196.586107] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 02:33:42 juju-e4d256-prod-github-runner-207 kernel: [76196.587151] Aug 23 02:33:42 juju-e4d256-prod-github-runner-207 kernel: [76196.588011] Aug 23 02:33:42 juju-e4d256-prod-github-runner-207 kernel: [76196.588849] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 02:33:42 juju-e4d256-prod-github-runner-207 kernel: [76196.589882] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:33:42 juju-e4d256-prod-github-runner-207 kernel: [76196.590924] ? _raw_spin_lock+0x22/0x30 Aug 23 02:33:42 juju-e4d256-prod-github-runner-207 kernel: [76196.591883] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:33:42 juju-e4d256-prod-github-runner-207 kernel: [76196.592898] direct_page_fault+0x206/0x310 [kvm] Aug 23 02:33:42 juju-e4d256-prod-github-runner-207 kernel: [76196.593922] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 02:33:42 juju-e4d256-prod-github-runner-207 kernel: [76196.594930] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 02:33:42 juju-e4d256-prod-github-runner-207 kernel: [76196.595940] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 02:33:42 juju-e4d256-prod-github-runner-207 kernel: [76196.596931] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 02:33:42 juju-e4d256-prod-github-runner-207 kernel: [76196.597882] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 02:33:42 juju-e4d256-prod-github-runner-207 kernel: [76196.598859] handle_exit+0x98/0x230 [kvm_amd] Aug 23 02:33:42 juju-e4d256-prod-github-runner-207 kernel: [76196.599752] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 02:33:42 juju-e4d256-prod-github-runner-207 kernel: [76196.600678] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 02:33:42 juju-e4d256-prod-github-runner-207 kernel: [76196.601607] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 02:33:42 juju-e4d256-prod-github-runner-207 kernel: [76196.602509] vcpu_run+0x62/0x2c0 [kvm] Aug 23 02:33:42 juju-e4d256-prod-github-runner-207 kernel: [76196.603323] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 02:33:42 juju-e4d256-prod-github-runner-207 kernel: [76196.604146] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 02:33:42 juju-e4d256-prod-github-runner-207 kernel: [76196.605006] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 02:33:42 juju-e4d256-prod-github-runner-207 kernel: [76196.605808] ? __seccomp_filter+0x4a/0x4a0 Aug 23 02:33:42 juju-e4d256-prod-github-runner-207 kernel: [76196.606552] ? __fget_files+0x86/0xc0 Aug 23 02:33:42 juju-e4d256-prod-github-runner-207 kernel: [76196.607255] __x64_sys_ioctl+0x95/0xd0 Aug 23 02:33:42 juju-e4d256-prod-github-runner-207 kernel: [76196.607965] do_syscall_64+0x5c/0xc0 Aug 23 02:33:42 juju-e4d256-prod-github-runner-207 kernel: [76196.608636] ? do_futex+0x162/0x1f0 Aug 23 02:33:42 juju-e4d256-prod-github-runner-207 kernel: [76196.609288] ? __x64_sys_futex+0x78/0x1e0 Aug 23 02:33:42 juju-e4d256-prod-github-runner-207 kernel: [76196.609965] ? __secure_computing+0xa9/0x120 Aug 23 02:33:42 juju-e4d256-prod-github-runner-207 kernel: [76196.610654] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 02:33:42 juju-e4d256-prod-github-runner-207 kernel: [76196.611414] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:33:42 juju-e4d256-prod-github-runner-207 kernel: [76196.612146] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:33:42 juju-e4d256-prod-github-runner-207 kernel: [76196.612864] ? do_syscall_64+0x69/0xc0 Aug 23 02:33:42 juju-e4d256-prod-github-runner-207 kernel: [76196.613514] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:33:42 juju-e4d256-prod-github-runner-207 kernel: [76196.614217] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:33:42 juju-e4d256-prod-github-runner-207 kernel: [76196.614913] ? do_syscall_64+0x69/0xc0 Aug 23 02:33:42 juju-e4d256-prod-github-runner-207 kernel: [76196.615542] ? do_syscall_64+0x69/0xc0 Aug 23 02:33:42 juju-e4d256-prod-github-runner-207 kernel: [76196.616172] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 02:33:42 juju-e4d256-prod-github-runner-207 kernel: [76196.616882] RIP: 0033:0x7faa5d0edaff Aug 23 02:33:42 juju-e4d256-prod-github-runner-207 kernel: [76196.617533] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 02:33:42 juju-e4d256-prod-github-runner-207 kernel: [76196.619519] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 02:33:42 juju-e4d256-prod-github-runner-207 kernel: [76196.620442] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 02:33:42 juju-e4d256-prod-github-runner-207 kernel: [76196.621338] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 02:33:42 juju-e4d256-prod-github-runner-207 kernel: [76196.622225] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 02:33:42 juju-e4d256-prod-github-runner-207 kernel: [76196.623112] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 02:33:42 juju-e4d256-prod-github-runner-207 kernel: [76196.624028] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 02:33:42 juju-e4d256-prod-github-runner-207 kernel: [76196.624925] Aug 23 02:34:10 juju-e4d256-prod-github-runner-207 kernel: [76224.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 70881s! [qemu-system-x86:6715] Aug 23 02:34:10 juju-e4d256-prod-github-runner-207 kernel: [76224.544042] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 02:34:10 juju-e4d256-prod-github-runner-207 kernel: [76224.544392] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 02:34:10 juju-e4d256-prod-github-runner-207 kernel: [76224.556568] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 02:34:10 juju-e4d256-prod-github-runner-207 kernel: [76224.557836] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 02:34:10 juju-e4d256-prod-github-runner-207 kernel: [76224.559060] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:34:10 juju-e4d256-prod-github-runner-207 kernel: [76224.560170] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 02:34:10 juju-e4d256-prod-github-runner-207 kernel: [76224.562742] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 02:34:10 juju-e4d256-prod-github-runner-207 kernel: [76224.563804] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 02:34:10 juju-e4d256-prod-github-runner-207 kernel: [76224.564965] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 02:34:10 juju-e4d256-prod-github-runner-207 kernel: [76224.566126] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 02:34:10 juju-e4d256-prod-github-runner-207 kernel: [76224.567286] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 02:34:10 juju-e4d256-prod-github-runner-207 kernel: [76224.568458] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 02:34:10 juju-e4d256-prod-github-runner-207 kernel: [76224.569633] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 02:34:10 juju-e4d256-prod-github-runner-207 kernel: [76224.570867] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 02:34:10 juju-e4d256-prod-github-runner-207 kernel: [76224.571979] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 02:34:10 juju-e4d256-prod-github-runner-207 kernel: [76224.573179] Call Trace: Aug 23 02:34:10 juju-e4d256-prod-github-runner-207 kernel: [76224.574092] Aug 23 02:34:10 juju-e4d256-prod-github-runner-207 kernel: [76224.574989] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:34:10 juju-e4d256-prod-github-runner-207 kernel: [76224.576037] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:34:10 juju-e4d256-prod-github-runner-207 kernel: [76224.577061] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:34:10 juju-e4d256-prod-github-runner-207 kernel: [76224.578163] ? show_regs.part.0+0x23/0x29 Aug 23 02:34:10 juju-e4d256-prod-github-runner-207 kernel: [76224.579158] ? show_regs.cold+0x8/0xd Aug 23 02:34:10 juju-e4d256-prod-github-runner-207 kernel: [76224.580142] ? watchdog_timer_fn+0x1be/0x220 Aug 23 02:34:10 juju-e4d256-prod-github-runner-207 kernel: [76224.581152] ? lockup_detector_update_enable+0x60/0x60 Aug 23 02:34:10 juju-e4d256-prod-github-runner-207 kernel: [76224.582215] ? __hrtimer_run_queues+0x107/0x230 Aug 23 02:34:10 juju-e4d256-prod-github-runner-207 kernel: [76224.583259] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 02:34:10 juju-e4d256-prod-github-runner-207 kernel: [76224.584316] ? hrtimer_interrupt+0x101/0x220 Aug 23 02:34:10 juju-e4d256-prod-github-runner-207 kernel: [76224.585334] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 02:34:10 juju-e4d256-prod-github-runner-207 kernel: [76224.586405] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 02:34:10 juju-e4d256-prod-github-runner-207 kernel: [76224.587457] Aug 23 02:34:10 juju-e4d256-prod-github-runner-207 kernel: [76224.588327] Aug 23 02:34:10 juju-e4d256-prod-github-runner-207 kernel: [76224.589164] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 02:34:10 juju-e4d256-prod-github-runner-207 kernel: [76224.590256] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:34:10 juju-e4d256-prod-github-runner-207 kernel: [76224.591332] ? _raw_spin_lock+0x22/0x30 Aug 23 02:34:10 juju-e4d256-prod-github-runner-207 kernel: [76224.592304] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:34:10 juju-e4d256-prod-github-runner-207 kernel: [76224.593335] direct_page_fault+0x206/0x310 [kvm] Aug 23 02:34:10 juju-e4d256-prod-github-runner-207 kernel: [76224.594363] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 02:34:10 juju-e4d256-prod-github-runner-207 kernel: [76224.595370] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 02:34:10 juju-e4d256-prod-github-runner-207 kernel: [76224.596392] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 02:34:10 juju-e4d256-prod-github-runner-207 kernel: [76224.597412] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 02:34:10 juju-e4d256-prod-github-runner-207 kernel: [76224.598358] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 02:34:10 juju-e4d256-prod-github-runner-207 kernel: [76224.599337] handle_exit+0x98/0x230 [kvm_amd] Aug 23 02:34:10 juju-e4d256-prod-github-runner-207 kernel: [76224.600237] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 02:34:10 juju-e4d256-prod-github-runner-207 kernel: [76224.601152] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 02:34:10 juju-e4d256-prod-github-runner-207 kernel: [76224.602107] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 02:34:10 juju-e4d256-prod-github-runner-207 kernel: [76224.603012] vcpu_run+0x62/0x2c0 [kvm] Aug 23 02:34:10 juju-e4d256-prod-github-runner-207 kernel: [76224.603867] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 02:34:10 juju-e4d256-prod-github-runner-207 kernel: [76224.604693] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 02:34:10 juju-e4d256-prod-github-runner-207 kernel: [76224.605547] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 02:34:10 juju-e4d256-prod-github-runner-207 kernel: [76224.606342] ? __seccomp_filter+0x4a/0x4a0 Aug 23 02:34:10 juju-e4d256-prod-github-runner-207 kernel: [76224.607091] ? __fget_files+0x86/0xc0 Aug 23 02:34:10 juju-e4d256-prod-github-runner-207 kernel: [76224.607806] __x64_sys_ioctl+0x95/0xd0 Aug 23 02:34:10 juju-e4d256-prod-github-runner-207 kernel: [76224.608500] do_syscall_64+0x5c/0xc0 Aug 23 02:34:10 juju-e4d256-prod-github-runner-207 kernel: [76224.609170] ? do_futex+0x162/0x1f0 Aug 23 02:34:10 juju-e4d256-prod-github-runner-207 kernel: [76224.609823] ? __x64_sys_futex+0x78/0x1e0 Aug 23 02:34:10 juju-e4d256-prod-github-runner-207 kernel: [76224.610494] ? __secure_computing+0xa9/0x120 Aug 23 02:34:10 juju-e4d256-prod-github-runner-207 kernel: [76224.611187] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 02:34:10 juju-e4d256-prod-github-runner-207 kernel: [76224.611964] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:34:10 juju-e4d256-prod-github-runner-207 kernel: [76224.612703] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:34:10 juju-e4d256-prod-github-runner-207 kernel: [76224.613441] ? do_syscall_64+0x69/0xc0 Aug 23 02:34:10 juju-e4d256-prod-github-runner-207 kernel: [76224.614093] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:34:10 juju-e4d256-prod-github-runner-207 kernel: [76224.614808] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:34:10 juju-e4d256-prod-github-runner-207 kernel: [76224.615520] ? do_syscall_64+0x69/0xc0 Aug 23 02:34:10 juju-e4d256-prod-github-runner-207 kernel: [76224.616149] ? do_syscall_64+0x69/0xc0 Aug 23 02:34:10 juju-e4d256-prod-github-runner-207 kernel: [76224.616892] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 02:34:10 juju-e4d256-prod-github-runner-207 kernel: [76224.617602] RIP: 0033:0x7faa5d0edaff Aug 23 02:34:10 juju-e4d256-prod-github-runner-207 kernel: [76224.618289] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 02:34:10 juju-e4d256-prod-github-runner-207 kernel: [76224.620306] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 02:34:10 juju-e4d256-prod-github-runner-207 kernel: [76224.621277] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 02:34:10 juju-e4d256-prod-github-runner-207 kernel: [76224.622171] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 02:34:10 juju-e4d256-prod-github-runner-207 kernel: [76224.623067] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 02:34:10 juju-e4d256-prod-github-runner-207 kernel: [76224.623968] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 02:34:10 juju-e4d256-prod-github-runner-207 kernel: [76224.624858] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 02:34:10 juju-e4d256-prod-github-runner-207 kernel: [76224.625802] Aug 23 02:34:38 juju-e4d256-prod-github-runner-207 kernel: [76252.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 70907s! [qemu-system-x86:6715] Aug 23 02:34:38 juju-e4d256-prod-github-runner-207 kernel: [76252.543797] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 02:34:38 juju-e4d256-prod-github-runner-207 kernel: [76252.544097] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 02:34:38 juju-e4d256-prod-github-runner-207 kernel: [76252.556278] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 02:34:38 juju-e4d256-prod-github-runner-207 kernel: [76252.557554] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 02:34:38 juju-e4d256-prod-github-runner-207 kernel: [76252.558776] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:34:38 juju-e4d256-prod-github-runner-207 kernel: [76252.559864] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 02:34:38 juju-e4d256-prod-github-runner-207 kernel: [76252.562421] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 02:34:38 juju-e4d256-prod-github-runner-207 kernel: [76252.563477] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 02:34:38 juju-e4d256-prod-github-runner-207 kernel: [76252.564661] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 02:34:38 juju-e4d256-prod-github-runner-207 kernel: [76252.565855] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 02:34:38 juju-e4d256-prod-github-runner-207 kernel: [76252.567024] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 02:34:38 juju-e4d256-prod-github-runner-207 kernel: [76252.568203] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 02:34:38 juju-e4d256-prod-github-runner-207 kernel: [76252.569375] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 02:34:38 juju-e4d256-prod-github-runner-207 kernel: [76252.570615] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 02:34:38 juju-e4d256-prod-github-runner-207 kernel: [76252.571741] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 02:34:38 juju-e4d256-prod-github-runner-207 kernel: [76252.572939] Call Trace: Aug 23 02:34:38 juju-e4d256-prod-github-runner-207 kernel: [76252.573850] Aug 23 02:34:38 juju-e4d256-prod-github-runner-207 kernel: [76252.574743] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:34:38 juju-e4d256-prod-github-runner-207 kernel: [76252.575819] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:34:38 juju-e4d256-prod-github-runner-207 kernel: [76252.576877] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:34:38 juju-e4d256-prod-github-runner-207 kernel: [76252.577986] ? show_regs.part.0+0x23/0x29 Aug 23 02:34:38 juju-e4d256-prod-github-runner-207 kernel: [76252.578982] ? show_regs.cold+0x8/0xd Aug 23 02:34:38 juju-e4d256-prod-github-runner-207 kernel: [76252.579978] ? watchdog_timer_fn+0x1be/0x220 Aug 23 02:34:38 juju-e4d256-prod-github-runner-207 kernel: [76252.580987] ? lockup_detector_update_enable+0x60/0x60 Aug 23 02:34:38 juju-e4d256-prod-github-runner-207 kernel: [76252.582057] ? __hrtimer_run_queues+0x107/0x230 Aug 23 02:34:38 juju-e4d256-prod-github-runner-207 kernel: [76252.583090] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 02:34:38 juju-e4d256-prod-github-runner-207 kernel: [76252.584130] ? hrtimer_interrupt+0x101/0x220 Aug 23 02:34:38 juju-e4d256-prod-github-runner-207 kernel: [76252.585157] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 02:34:38 juju-e4d256-prod-github-runner-207 kernel: [76252.586253] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 02:34:38 juju-e4d256-prod-github-runner-207 kernel: [76252.587316] Aug 23 02:34:38 juju-e4d256-prod-github-runner-207 kernel: [76252.588170] Aug 23 02:34:38 juju-e4d256-prod-github-runner-207 kernel: [76252.589011] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 02:34:38 juju-e4d256-prod-github-runner-207 kernel: [76252.590043] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:34:38 juju-e4d256-prod-github-runner-207 kernel: [76252.591091] ? _raw_spin_lock+0x22/0x30 Aug 23 02:34:38 juju-e4d256-prod-github-runner-207 kernel: [76252.592076] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:34:38 juju-e4d256-prod-github-runner-207 kernel: [76252.593135] direct_page_fault+0x206/0x310 [kvm] Aug 23 02:34:38 juju-e4d256-prod-github-runner-207 kernel: [76252.594160] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 02:34:38 juju-e4d256-prod-github-runner-207 kernel: [76252.595181] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 02:34:38 juju-e4d256-prod-github-runner-207 kernel: [76252.596207] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 02:34:38 juju-e4d256-prod-github-runner-207 kernel: [76252.597231] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 02:34:38 juju-e4d256-prod-github-runner-207 kernel: [76252.598177] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 02:34:38 juju-e4d256-prod-github-runner-207 kernel: [76252.599176] handle_exit+0x98/0x230 [kvm_amd] Aug 23 02:34:38 juju-e4d256-prod-github-runner-207 kernel: [76252.600069] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 02:34:38 juju-e4d256-prod-github-runner-207 kernel: [76252.601000] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 02:34:38 juju-e4d256-prod-github-runner-207 kernel: [76252.601944] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 02:34:38 juju-e4d256-prod-github-runner-207 kernel: [76252.602851] vcpu_run+0x62/0x2c0 [kvm] Aug 23 02:34:38 juju-e4d256-prod-github-runner-207 kernel: [76252.603688] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 02:34:38 juju-e4d256-prod-github-runner-207 kernel: [76252.604497] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 02:34:38 juju-e4d256-prod-github-runner-207 kernel: [76252.605357] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 02:34:38 juju-e4d256-prod-github-runner-207 kernel: [76252.606164] ? __seccomp_filter+0x4a/0x4a0 Aug 23 02:34:38 juju-e4d256-prod-github-runner-207 kernel: [76252.606936] ? __fget_files+0x86/0xc0 Aug 23 02:34:38 juju-e4d256-prod-github-runner-207 kernel: [76252.607662] __x64_sys_ioctl+0x95/0xd0 Aug 23 02:34:38 juju-e4d256-prod-github-runner-207 kernel: [76252.608361] do_syscall_64+0x5c/0xc0 Aug 23 02:34:38 juju-e4d256-prod-github-runner-207 kernel: [76252.609027] ? do_futex+0x162/0x1f0 Aug 23 02:34:38 juju-e4d256-prod-github-runner-207 kernel: [76252.609678] ? __x64_sys_futex+0x78/0x1e0 Aug 23 02:34:38 juju-e4d256-prod-github-runner-207 kernel: [76252.610357] ? __secure_computing+0xa9/0x120 Aug 23 02:34:38 juju-e4d256-prod-github-runner-207 kernel: [76252.611064] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 02:34:38 juju-e4d256-prod-github-runner-207 kernel: [76252.611843] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:34:38 juju-e4d256-prod-github-runner-207 kernel: [76252.612577] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:34:38 juju-e4d256-prod-github-runner-207 kernel: [76252.613301] ? do_syscall_64+0x69/0xc0 Aug 23 02:34:38 juju-e4d256-prod-github-runner-207 kernel: [76252.613952] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:34:38 juju-e4d256-prod-github-runner-207 kernel: [76252.614655] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:34:38 juju-e4d256-prod-github-runner-207 kernel: [76252.615372] ? do_syscall_64+0x69/0xc0 Aug 23 02:34:38 juju-e4d256-prod-github-runner-207 kernel: [76252.616006] ? do_syscall_64+0x69/0xc0 Aug 23 02:34:38 juju-e4d256-prod-github-runner-207 kernel: [76252.616639] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 02:34:38 juju-e4d256-prod-github-runner-207 kernel: [76252.617389] RIP: 0033:0x7faa5d0edaff Aug 23 02:34:38 juju-e4d256-prod-github-runner-207 kernel: [76252.618066] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 02:34:38 juju-e4d256-prod-github-runner-207 kernel: [76252.620091] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 02:34:38 juju-e4d256-prod-github-runner-207 kernel: [76252.621009] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 02:34:38 juju-e4d256-prod-github-runner-207 kernel: [76252.621913] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 02:34:38 juju-e4d256-prod-github-runner-207 kernel: [76252.622819] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 02:34:38 juju-e4d256-prod-github-runner-207 kernel: [76252.623726] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 02:34:38 juju-e4d256-prod-github-runner-207 kernel: [76252.624618] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 02:34:38 juju-e4d256-prod-github-runner-207 kernel: [76252.625515] Aug 23 02:35:06 juju-e4d256-prod-github-runner-207 kernel: [76280.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 70933s! [qemu-system-x86:6715] Aug 23 02:35:06 juju-e4d256-prod-github-runner-207 kernel: [76280.543738] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 02:35:06 juju-e4d256-prod-github-runner-207 kernel: [76280.543981] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 02:35:06 juju-e4d256-prod-github-runner-207 kernel: [76280.556122] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 02:35:06 juju-e4d256-prod-github-runner-207 kernel: [76280.557390] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 02:35:06 juju-e4d256-prod-github-runner-207 kernel: [76280.558607] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:35:06 juju-e4d256-prod-github-runner-207 kernel: [76280.559696] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 02:35:06 juju-e4d256-prod-github-runner-207 kernel: [76280.562232] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 02:35:06 juju-e4d256-prod-github-runner-207 kernel: [76280.563287] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 02:35:06 juju-e4d256-prod-github-runner-207 kernel: [76280.564569] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 02:35:06 juju-e4d256-prod-github-runner-207 kernel: [76280.565740] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 02:35:06 juju-e4d256-prod-github-runner-207 kernel: [76280.566917] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 02:35:06 juju-e4d256-prod-github-runner-207 kernel: [76280.568094] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 02:35:06 juju-e4d256-prod-github-runner-207 kernel: [76280.569269] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 02:35:06 juju-e4d256-prod-github-runner-207 kernel: [76280.570507] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 02:35:06 juju-e4d256-prod-github-runner-207 kernel: [76280.571618] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 02:35:06 juju-e4d256-prod-github-runner-207 kernel: [76280.572807] Call Trace: Aug 23 02:35:06 juju-e4d256-prod-github-runner-207 kernel: [76280.573723] Aug 23 02:35:06 juju-e4d256-prod-github-runner-207 kernel: [76280.574626] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:35:06 juju-e4d256-prod-github-runner-207 kernel: [76280.575680] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:35:06 juju-e4d256-prod-github-runner-207 kernel: [76280.576699] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:35:06 juju-e4d256-prod-github-runner-207 kernel: [76280.577788] ? show_regs.part.0+0x23/0x29 Aug 23 02:35:06 juju-e4d256-prod-github-runner-207 kernel: [76280.578786] ? show_regs.cold+0x8/0xd Aug 23 02:35:06 juju-e4d256-prod-github-runner-207 kernel: [76280.579780] ? watchdog_timer_fn+0x1be/0x220 Aug 23 02:35:06 juju-e4d256-prod-github-runner-207 kernel: [76280.580793] ? lockup_detector_update_enable+0x60/0x60 Aug 23 02:35:06 juju-e4d256-prod-github-runner-207 kernel: [76280.581878] ? __hrtimer_run_queues+0x107/0x230 Aug 23 02:35:06 juju-e4d256-prod-github-runner-207 kernel: [76280.582925] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 02:35:06 juju-e4d256-prod-github-runner-207 kernel: [76280.583950] ? hrtimer_interrupt+0x101/0x220 Aug 23 02:35:06 juju-e4d256-prod-github-runner-207 kernel: [76280.584977] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 02:35:06 juju-e4d256-prod-github-runner-207 kernel: [76280.586048] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 02:35:06 juju-e4d256-prod-github-runner-207 kernel: [76280.587106] Aug 23 02:35:06 juju-e4d256-prod-github-runner-207 kernel: [76280.587959] Aug 23 02:35:06 juju-e4d256-prod-github-runner-207 kernel: [76280.588800] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 02:35:06 juju-e4d256-prod-github-runner-207 kernel: [76280.589847] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:35:06 juju-e4d256-prod-github-runner-207 kernel: [76280.590937] ? _raw_spin_lock+0x22/0x30 Aug 23 02:35:06 juju-e4d256-prod-github-runner-207 kernel: [76280.591921] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:35:06 juju-e4d256-prod-github-runner-207 kernel: [76280.592939] direct_page_fault+0x206/0x310 [kvm] Aug 23 02:35:06 juju-e4d256-prod-github-runner-207 kernel: [76280.594001] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 02:35:06 juju-e4d256-prod-github-runner-207 kernel: [76280.595098] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 02:35:06 juju-e4d256-prod-github-runner-207 kernel: [76280.596110] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 02:35:06 juju-e4d256-prod-github-runner-207 kernel: [76280.597099] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 02:35:06 juju-e4d256-prod-github-runner-207 kernel: [76280.598046] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 02:35:06 juju-e4d256-prod-github-runner-207 kernel: [76280.599045] handle_exit+0x98/0x230 [kvm_amd] Aug 23 02:35:06 juju-e4d256-prod-github-runner-207 kernel: [76280.599941] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 02:35:06 juju-e4d256-prod-github-runner-207 kernel: [76280.600871] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 02:35:06 juju-e4d256-prod-github-runner-207 kernel: [76280.601793] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 02:35:06 juju-e4d256-prod-github-runner-207 kernel: [76280.602694] vcpu_run+0x62/0x2c0 [kvm] Aug 23 02:35:06 juju-e4d256-prod-github-runner-207 kernel: [76280.603524] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 02:35:06 juju-e4d256-prod-github-runner-207 kernel: [76280.604332] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 02:35:06 juju-e4d256-prod-github-runner-207 kernel: [76280.605187] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 02:35:06 juju-e4d256-prod-github-runner-207 kernel: [76280.606001] ? __seccomp_filter+0x4a/0x4a0 Aug 23 02:35:06 juju-e4d256-prod-github-runner-207 kernel: [76280.606742] ? __fget_files+0x86/0xc0 Aug 23 02:35:06 juju-e4d256-prod-github-runner-207 kernel: [76280.607452] __x64_sys_ioctl+0x95/0xd0 Aug 23 02:35:06 juju-e4d256-prod-github-runner-207 kernel: [76280.608142] do_syscall_64+0x5c/0xc0 Aug 23 02:35:06 juju-e4d256-prod-github-runner-207 kernel: [76280.608803] ? do_futex+0x162/0x1f0 Aug 23 02:35:06 juju-e4d256-prod-github-runner-207 kernel: [76280.609452] ? __x64_sys_futex+0x78/0x1e0 Aug 23 02:35:06 juju-e4d256-prod-github-runner-207 kernel: [76280.610124] ? __secure_computing+0xa9/0x120 Aug 23 02:35:06 juju-e4d256-prod-github-runner-207 kernel: [76280.610823] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 02:35:06 juju-e4d256-prod-github-runner-207 kernel: [76280.611595] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:35:06 juju-e4d256-prod-github-runner-207 kernel: [76280.612314] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:35:06 juju-e4d256-prod-github-runner-207 kernel: [76280.613029] ? do_syscall_64+0x69/0xc0 Aug 23 02:35:06 juju-e4d256-prod-github-runner-207 kernel: [76280.613671] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:35:06 juju-e4d256-prod-github-runner-207 kernel: [76280.614370] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:35:06 juju-e4d256-prod-github-runner-207 kernel: [76280.615080] ? do_syscall_64+0x69/0xc0 Aug 23 02:35:06 juju-e4d256-prod-github-runner-207 kernel: [76280.615715] ? do_syscall_64+0x69/0xc0 Aug 23 02:35:06 juju-e4d256-prod-github-runner-207 kernel: [76280.616343] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 02:35:06 juju-e4d256-prod-github-runner-207 kernel: [76280.617044] RIP: 0033:0x7faa5d0edaff Aug 23 02:35:06 juju-e4d256-prod-github-runner-207 kernel: [76280.617685] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 02:35:06 juju-e4d256-prod-github-runner-207 kernel: [76280.619682] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 02:35:06 juju-e4d256-prod-github-runner-207 kernel: [76280.620592] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 02:35:06 juju-e4d256-prod-github-runner-207 kernel: [76280.621493] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 02:35:06 juju-e4d256-prod-github-runner-207 kernel: [76280.622383] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 02:35:06 juju-e4d256-prod-github-runner-207 kernel: [76280.623276] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 02:35:06 juju-e4d256-prod-github-runner-207 kernel: [76280.624240] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 02:35:06 juju-e4d256-prod-github-runner-207 kernel: [76280.625138] Aug 23 02:35:34 juju-e4d256-prod-github-runner-207 kernel: [76308.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 70959s! [qemu-system-x86:6715] Aug 23 02:35:34 juju-e4d256-prod-github-runner-207 kernel: [76308.543755] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 02:35:34 juju-e4d256-prod-github-runner-207 kernel: [76308.544007] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 02:35:34 juju-e4d256-prod-github-runner-207 kernel: [76308.556211] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 02:35:34 juju-e4d256-prod-github-runner-207 kernel: [76308.557507] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 02:35:34 juju-e4d256-prod-github-runner-207 kernel: [76308.558742] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:35:34 juju-e4d256-prod-github-runner-207 kernel: [76308.559805] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 02:35:34 juju-e4d256-prod-github-runner-207 kernel: [76308.562380] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 02:35:34 juju-e4d256-prod-github-runner-207 kernel: [76308.563445] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 02:35:34 juju-e4d256-prod-github-runner-207 kernel: [76308.564607] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 02:35:34 juju-e4d256-prod-github-runner-207 kernel: [76308.565768] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 02:35:34 juju-e4d256-prod-github-runner-207 kernel: [76308.566988] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 02:35:34 juju-e4d256-prod-github-runner-207 kernel: [76308.568155] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 02:35:34 juju-e4d256-prod-github-runner-207 kernel: [76308.569323] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 02:35:34 juju-e4d256-prod-github-runner-207 kernel: [76308.570582] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 02:35:34 juju-e4d256-prod-github-runner-207 kernel: [76308.571701] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 02:35:34 juju-e4d256-prod-github-runner-207 kernel: [76308.572909] Call Trace: Aug 23 02:35:34 juju-e4d256-prod-github-runner-207 kernel: [76308.573821] Aug 23 02:35:34 juju-e4d256-prod-github-runner-207 kernel: [76308.574733] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:35:34 juju-e4d256-prod-github-runner-207 kernel: [76308.575765] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:35:34 juju-e4d256-prod-github-runner-207 kernel: [76308.576804] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:35:34 juju-e4d256-prod-github-runner-207 kernel: [76308.577937] ? show_regs.part.0+0x23/0x29 Aug 23 02:35:34 juju-e4d256-prod-github-runner-207 kernel: [76308.578957] ? show_regs.cold+0x8/0xd Aug 23 02:35:34 juju-e4d256-prod-github-runner-207 kernel: [76308.579932] ? watchdog_timer_fn+0x1be/0x220 Aug 23 02:35:34 juju-e4d256-prod-github-runner-207 kernel: [76308.580941] ? lockup_detector_update_enable+0x60/0x60 Aug 23 02:35:34 juju-e4d256-prod-github-runner-207 kernel: [76308.582021] ? __hrtimer_run_queues+0x107/0x230 Aug 23 02:35:34 juju-e4d256-prod-github-runner-207 kernel: [76308.583075] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 02:35:34 juju-e4d256-prod-github-runner-207 kernel: [76308.584105] ? hrtimer_interrupt+0x101/0x220 Aug 23 02:35:34 juju-e4d256-prod-github-runner-207 kernel: [76308.585124] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 02:35:34 juju-e4d256-prod-github-runner-207 kernel: [76308.586192] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 02:35:34 juju-e4d256-prod-github-runner-207 kernel: [76308.587280] Aug 23 02:35:34 juju-e4d256-prod-github-runner-207 kernel: [76308.588158] Aug 23 02:35:34 juju-e4d256-prod-github-runner-207 kernel: [76308.588999] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 02:35:34 juju-e4d256-prod-github-runner-207 kernel: [76308.590033] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:35:34 juju-e4d256-prod-github-runner-207 kernel: [76308.591095] ? _raw_spin_lock+0x22/0x30 Aug 23 02:35:34 juju-e4d256-prod-github-runner-207 kernel: [76308.592052] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:35:34 juju-e4d256-prod-github-runner-207 kernel: [76308.593089] direct_page_fault+0x206/0x310 [kvm] Aug 23 02:35:34 juju-e4d256-prod-github-runner-207 kernel: [76308.594118] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 02:35:34 juju-e4d256-prod-github-runner-207 kernel: [76308.595143] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 02:35:34 juju-e4d256-prod-github-runner-207 kernel: [76308.596145] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 02:35:34 juju-e4d256-prod-github-runner-207 kernel: [76308.597143] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 02:35:34 juju-e4d256-prod-github-runner-207 kernel: [76308.598127] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 02:35:34 juju-e4d256-prod-github-runner-207 kernel: [76308.599128] handle_exit+0x98/0x230 [kvm_amd] Aug 23 02:35:34 juju-e4d256-prod-github-runner-207 kernel: [76308.600022] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 02:35:34 juju-e4d256-prod-github-runner-207 kernel: [76308.600941] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 02:35:34 juju-e4d256-prod-github-runner-207 kernel: [76308.601870] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 02:35:34 juju-e4d256-prod-github-runner-207 kernel: [76308.602808] vcpu_run+0x62/0x2c0 [kvm] Aug 23 02:35:34 juju-e4d256-prod-github-runner-207 kernel: [76308.603632] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 02:35:34 juju-e4d256-prod-github-runner-207 kernel: [76308.604441] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 02:35:34 juju-e4d256-prod-github-runner-207 kernel: [76308.605294] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 02:35:34 juju-e4d256-prod-github-runner-207 kernel: [76308.606089] ? __seccomp_filter+0x4a/0x4a0 Aug 23 02:35:34 juju-e4d256-prod-github-runner-207 kernel: [76308.606853] ? __fget_files+0x86/0xc0 Aug 23 02:35:34 juju-e4d256-prod-github-runner-207 kernel: [76308.607566] __x64_sys_ioctl+0x95/0xd0 Aug 23 02:35:34 juju-e4d256-prod-github-runner-207 kernel: [76308.608284] do_syscall_64+0x5c/0xc0 Aug 23 02:35:34 juju-e4d256-prod-github-runner-207 kernel: [76308.608953] ? do_futex+0x162/0x1f0 Aug 23 02:35:34 juju-e4d256-prod-github-runner-207 kernel: [76308.609602] ? __x64_sys_futex+0x78/0x1e0 Aug 23 02:35:34 juju-e4d256-prod-github-runner-207 kernel: [76308.610276] ? __secure_computing+0xa9/0x120 Aug 23 02:35:34 juju-e4d256-prod-github-runner-207 kernel: [76308.610991] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 02:35:34 juju-e4d256-prod-github-runner-207 kernel: [76308.611750] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:35:34 juju-e4d256-prod-github-runner-207 kernel: [76308.612482] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:35:34 juju-e4d256-prod-github-runner-207 kernel: [76308.613208] ? do_syscall_64+0x69/0xc0 Aug 23 02:35:34 juju-e4d256-prod-github-runner-207 kernel: [76308.613948] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:35:34 juju-e4d256-prod-github-runner-207 kernel: [76308.614669] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:35:34 juju-e4d256-prod-github-runner-207 kernel: [76308.615366] ? do_syscall_64+0x69/0xc0 Aug 23 02:35:34 juju-e4d256-prod-github-runner-207 kernel: [76308.615991] ? do_syscall_64+0x69/0xc0 Aug 23 02:35:34 juju-e4d256-prod-github-runner-207 kernel: [76308.616618] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 02:35:34 juju-e4d256-prod-github-runner-207 kernel: [76308.617323] RIP: 0033:0x7faa5d0edaff Aug 23 02:35:34 juju-e4d256-prod-github-runner-207 kernel: [76308.617977] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 02:35:34 juju-e4d256-prod-github-runner-207 kernel: [76308.620004] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 02:35:34 juju-e4d256-prod-github-runner-207 kernel: [76308.620920] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 02:35:34 juju-e4d256-prod-github-runner-207 kernel: [76308.621808] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 02:35:34 juju-e4d256-prod-github-runner-207 kernel: [76308.622728] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 02:35:34 juju-e4d256-prod-github-runner-207 kernel: [76308.623628] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 02:35:34 juju-e4d256-prod-github-runner-207 kernel: [76308.624521] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 02:35:34 juju-e4d256-prod-github-runner-207 kernel: [76308.625417] Aug 23 02:35:48 juju-e4d256-prod-github-runner-207 kernel: [76322.276705] rcu: INFO: rcu_sched self-detected stall on CPU Aug 23 02:35:48 juju-e4d256-prod-github-runner-207 kernel: [76322.277666] rcu: 1-....: (18991438 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=9181344 Aug 23 02:35:48 juju-e4d256-prod-github-runner-207 kernel: [76322.278817] (t=19051269 jiffies g=23269 q=64374) Aug 23 02:35:48 juju-e4d256-prod-github-runner-207 kernel: [76322.279601] NMI backtrace for cpu 1 Aug 23 02:35:48 juju-e4d256-prod-github-runner-207 kernel: [76322.280309] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 02:35:48 juju-e4d256-prod-github-runner-207 kernel: [76322.281416] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 02:35:48 juju-e4d256-prod-github-runner-207 kernel: [76322.282484] Call Trace: Aug 23 02:35:48 juju-e4d256-prod-github-runner-207 kernel: [76322.283158] Aug 23 02:35:48 juju-e4d256-prod-github-runner-207 kernel: [76322.283801] show_stack+0x52/0x5c Aug 23 02:35:48 juju-e4d256-prod-github-runner-207 kernel: [76322.284524] dump_stack_lvl+0x4a/0x63 Aug 23 02:35:48 juju-e4d256-prod-github-runner-207 kernel: [76322.285280] dump_stack+0x10/0x16 Aug 23 02:35:48 juju-e4d256-prod-github-runner-207 kernel: [76322.286005] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 23 02:35:48 juju-e4d256-prod-github-runner-207 kernel: [76322.286812] ? lapic_can_unplug_cpu+0x90/0x90 Aug 23 02:35:48 juju-e4d256-prod-github-runner-207 kernel: [76322.287630] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 23 02:35:48 juju-e4d256-prod-github-runner-207 kernel: [76322.288466] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 23 02:35:48 juju-e4d256-prod-github-runner-207 kernel: [76322.289285] trigger_single_cpu_backtrace+0x44/0x4f Aug 23 02:35:48 juju-e4d256-prod-github-runner-207 kernel: [76322.290092] rcu_dump_cpu_stacks+0x102/0x149 Aug 23 02:35:48 juju-e4d256-prod-github-runner-207 kernel: [76322.290882] print_cpu_stall.cold+0x2f/0xe2 Aug 23 02:35:48 juju-e4d256-prod-github-runner-207 kernel: [76322.291653] ? timekeeping_update+0xf7/0x150 Aug 23 02:35:48 juju-e4d256-prod-github-runner-207 kernel: [76322.292422] check_cpu_stall+0x109/0x270 Aug 23 02:35:48 juju-e4d256-prod-github-runner-207 kernel: [76322.293168] rcu_sched_clock_irq+0x9a/0x250 Aug 23 02:35:48 juju-e4d256-prod-github-runner-207 kernel: [76322.293928] update_process_times+0x94/0xd0 Aug 23 02:35:48 juju-e4d256-prod-github-runner-207 kernel: [76322.294698] tick_sched_handle+0x29/0x70 Aug 23 02:35:48 juju-e4d256-prod-github-runner-207 kernel: [76322.295442] tick_sched_timer+0x8c/0xc0 Aug 23 02:35:48 juju-e4d256-prod-github-runner-207 kernel: [76322.296178] ? tick_nohz_handler+0xb0/0xb0 Aug 23 02:35:48 juju-e4d256-prod-github-runner-207 kernel: [76322.296937] __hrtimer_run_queues+0x107/0x230 Aug 23 02:35:48 juju-e4d256-prod-github-runner-207 kernel: [76322.297707] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 02:35:48 juju-e4d256-prod-github-runner-207 kernel: [76322.298495] hrtimer_interrupt+0x101/0x220 Aug 23 02:35:48 juju-e4d256-prod-github-runner-207 kernel: [76322.299255] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 02:35:48 juju-e4d256-prod-github-runner-207 kernel: [76322.300069] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 02:35:48 juju-e4d256-prod-github-runner-207 kernel: [76322.300870] Aug 23 02:35:48 juju-e4d256-prod-github-runner-207 kernel: [76322.301506] Aug 23 02:35:48 juju-e4d256-prod-github-runner-207 kernel: [76322.302135] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 02:35:48 juju-e4d256-prod-github-runner-207 kernel: [76322.302972] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:35:48 juju-e4d256-prod-github-runner-207 kernel: [76322.303849] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 02:35:48 juju-e4d256-prod-github-runner-207 kernel: [76322.306051] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 02:35:48 juju-e4d256-prod-github-runner-207 kernel: [76322.306936] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 02:35:48 juju-e4d256-prod-github-runner-207 kernel: [76322.308020] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 02:35:48 juju-e4d256-prod-github-runner-207 kernel: [76322.308994] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 02:35:48 juju-e4d256-prod-github-runner-207 kernel: [76322.309960] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 02:35:48 juju-e4d256-prod-github-runner-207 kernel: [76322.310924] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 02:35:48 juju-e4d256-prod-github-runner-207 kernel: [76322.311892] ? _raw_spin_lock+0x22/0x30 Aug 23 02:35:48 juju-e4d256-prod-github-runner-207 kernel: [76322.312793] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:35:48 juju-e4d256-prod-github-runner-207 kernel: [76322.313626] direct_page_fault+0x206/0x310 [kvm] Aug 23 02:35:48 juju-e4d256-prod-github-runner-207 kernel: [76322.314476] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 02:35:48 juju-e4d256-prod-github-runner-207 kernel: [76322.315329] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 02:35:48 juju-e4d256-prod-github-runner-207 kernel: [76322.316164] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 02:35:48 juju-e4d256-prod-github-runner-207 kernel: [76322.316965] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 02:35:48 juju-e4d256-prod-github-runner-207 kernel: [76322.317797] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 02:35:48 juju-e4d256-prod-github-runner-207 kernel: [76322.318655] handle_exit+0x98/0x230 [kvm_amd] Aug 23 02:35:48 juju-e4d256-prod-github-runner-207 kernel: [76322.319414] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 02:35:48 juju-e4d256-prod-github-runner-207 kernel: [76322.320195] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 02:35:48 juju-e4d256-prod-github-runner-207 kernel: [76322.320992] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 02:35:48 juju-e4d256-prod-github-runner-207 kernel: [76322.321774] vcpu_run+0x62/0x2c0 [kvm] Aug 23 02:35:48 juju-e4d256-prod-github-runner-207 kernel: [76322.322499] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 02:35:48 juju-e4d256-prod-github-runner-207 kernel: [76322.323230] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 02:35:48 juju-e4d256-prod-github-runner-207 kernel: [76322.324029] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 02:35:48 juju-e4d256-prod-github-runner-207 kernel: [76322.324787] ? __seccomp_filter+0x4a/0x4a0 Aug 23 02:35:48 juju-e4d256-prod-github-runner-207 kernel: [76322.325518] ? __fget_files+0x86/0xc0 Aug 23 02:35:48 juju-e4d256-prod-github-runner-207 kernel: [76322.326210] __x64_sys_ioctl+0x95/0xd0 Aug 23 02:35:48 juju-e4d256-prod-github-runner-207 kernel: [76322.326919] do_syscall_64+0x5c/0xc0 Aug 23 02:35:48 juju-e4d256-prod-github-runner-207 kernel: [76322.327597] ? do_futex+0x162/0x1f0 Aug 23 02:35:48 juju-e4d256-prod-github-runner-207 kernel: [76322.328267] ? __x64_sys_futex+0x78/0x1e0 Aug 23 02:35:48 juju-e4d256-prod-github-runner-207 kernel: [76322.328969] ? __secure_computing+0xa9/0x120 Aug 23 02:35:48 juju-e4d256-prod-github-runner-207 kernel: [76322.329680] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 02:35:48 juju-e4d256-prod-github-runner-207 kernel: [76322.330488] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:35:48 juju-e4d256-prod-github-runner-207 kernel: [76322.331244] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:35:48 juju-e4d256-prod-github-runner-207 kernel: [76322.331998] ? do_syscall_64+0x69/0xc0 Aug 23 02:35:48 juju-e4d256-prod-github-runner-207 kernel: [76322.332690] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:35:48 juju-e4d256-prod-github-runner-207 kernel: [76322.333442] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:35:48 juju-e4d256-prod-github-runner-207 kernel: [76322.334195] ? do_syscall_64+0x69/0xc0 Aug 23 02:35:48 juju-e4d256-prod-github-runner-207 kernel: [76322.334953] ? do_syscall_64+0x69/0xc0 Aug 23 02:35:48 juju-e4d256-prod-github-runner-207 kernel: [76322.335654] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 02:35:48 juju-e4d256-prod-github-runner-207 kernel: [76322.336425] RIP: 0033:0x7faa5d0edaff Aug 23 02:35:48 juju-e4d256-prod-github-runner-207 kernel: [76322.337108] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 02:35:48 juju-e4d256-prod-github-runner-207 kernel: [76322.339222] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 02:35:48 juju-e4d256-prod-github-runner-207 kernel: [76322.340186] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 02:35:48 juju-e4d256-prod-github-runner-207 kernel: [76322.341128] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 02:35:48 juju-e4d256-prod-github-runner-207 kernel: [76322.342070] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 02:35:48 juju-e4d256-prod-github-runner-207 kernel: [76322.343025] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 02:35:48 juju-e4d256-prod-github-runner-207 kernel: [76322.343952] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 02:35:48 juju-e4d256-prod-github-runner-207 kernel: [76322.344862] Aug 23 02:36:14 juju-e4d256-prod-github-runner-207 kernel: [76348.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 70997s! [qemu-system-x86:6715] Aug 23 02:36:14 juju-e4d256-prod-github-runner-207 kernel: [76348.543121] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 02:36:14 juju-e4d256-prod-github-runner-207 kernel: [76348.543189] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 02:36:14 juju-e4d256-prod-github-runner-207 kernel: [76348.555271] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 02:36:14 juju-e4d256-prod-github-runner-207 kernel: [76348.556535] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 02:36:14 juju-e4d256-prod-github-runner-207 kernel: [76348.557759] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:36:14 juju-e4d256-prod-github-runner-207 kernel: [76348.558846] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 02:36:14 juju-e4d256-prod-github-runner-207 kernel: [76348.561404] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 02:36:14 juju-e4d256-prod-github-runner-207 kernel: [76348.562463] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 02:36:14 juju-e4d256-prod-github-runner-207 kernel: [76348.563630] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 02:36:14 juju-e4d256-prod-github-runner-207 kernel: [76348.564793] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 02:36:14 juju-e4d256-prod-github-runner-207 kernel: [76348.565958] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 02:36:14 juju-e4d256-prod-github-runner-207 kernel: [76348.567136] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 02:36:14 juju-e4d256-prod-github-runner-207 kernel: [76348.568300] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 02:36:14 juju-e4d256-prod-github-runner-207 kernel: [76348.569684] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 02:36:14 juju-e4d256-prod-github-runner-207 kernel: [76348.570906] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 02:36:14 juju-e4d256-prod-github-runner-207 kernel: [76348.572106] Call Trace: Aug 23 02:36:14 juju-e4d256-prod-github-runner-207 kernel: [76348.573023] Aug 23 02:36:14 juju-e4d256-prod-github-runner-207 kernel: [76348.573905] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:36:14 juju-e4d256-prod-github-runner-207 kernel: [76348.574957] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:36:14 juju-e4d256-prod-github-runner-207 kernel: [76348.575982] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:36:14 juju-e4d256-prod-github-runner-207 kernel: [76348.577060] ? show_regs.part.0+0x23/0x29 Aug 23 02:36:14 juju-e4d256-prod-github-runner-207 kernel: [76348.578056] ? show_regs.cold+0x8/0xd Aug 23 02:36:14 juju-e4d256-prod-github-runner-207 kernel: [76348.579038] ? watchdog_timer_fn+0x1be/0x220 Aug 23 02:36:14 juju-e4d256-prod-github-runner-207 kernel: [76348.580046] ? lockup_detector_update_enable+0x60/0x60 Aug 23 02:36:14 juju-e4d256-prod-github-runner-207 kernel: [76348.581108] ? __hrtimer_run_queues+0x107/0x230 Aug 23 02:36:14 juju-e4d256-prod-github-runner-207 kernel: [76348.582145] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 02:36:14 juju-e4d256-prod-github-runner-207 kernel: [76348.583168] ? hrtimer_interrupt+0x101/0x220 Aug 23 02:36:14 juju-e4d256-prod-github-runner-207 kernel: [76348.584182] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 02:36:14 juju-e4d256-prod-github-runner-207 kernel: [76348.585248] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 02:36:14 juju-e4d256-prod-github-runner-207 kernel: [76348.586303] Aug 23 02:36:14 juju-e4d256-prod-github-runner-207 kernel: [76348.587163] Aug 23 02:36:14 juju-e4d256-prod-github-runner-207 kernel: [76348.588006] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 02:36:14 juju-e4d256-prod-github-runner-207 kernel: [76348.589036] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:36:14 juju-e4d256-prod-github-runner-207 kernel: [76348.590090] ? _raw_spin_lock+0x22/0x30 Aug 23 02:36:14 juju-e4d256-prod-github-runner-207 kernel: [76348.591038] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:36:14 juju-e4d256-prod-github-runner-207 kernel: [76348.592054] direct_page_fault+0x206/0x310 [kvm] Aug 23 02:36:14 juju-e4d256-prod-github-runner-207 kernel: [76348.593081] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 02:36:14 juju-e4d256-prod-github-runner-207 kernel: [76348.594097] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 02:36:14 juju-e4d256-prod-github-runner-207 kernel: [76348.595102] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 02:36:14 juju-e4d256-prod-github-runner-207 kernel: [76348.596075] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 02:36:14 juju-e4d256-prod-github-runner-207 kernel: [76348.597036] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 02:36:14 juju-e4d256-prod-github-runner-207 kernel: [76348.598017] handle_exit+0x98/0x230 [kvm_amd] Aug 23 02:36:14 juju-e4d256-prod-github-runner-207 kernel: [76348.598923] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 02:36:14 juju-e4d256-prod-github-runner-207 kernel: [76348.599837] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 02:36:14 juju-e4d256-prod-github-runner-207 kernel: [76348.600964] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 02:36:14 juju-e4d256-prod-github-runner-207 kernel: [76348.601889] vcpu_run+0x62/0x2c0 [kvm] Aug 23 02:36:14 juju-e4d256-prod-github-runner-207 kernel: [76348.602719] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 02:36:14 juju-e4d256-prod-github-runner-207 kernel: [76348.603528] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 02:36:14 juju-e4d256-prod-github-runner-207 kernel: [76348.604383] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 02:36:14 juju-e4d256-prod-github-runner-207 kernel: [76348.605180] ? __seccomp_filter+0x4a/0x4a0 Aug 23 02:36:14 juju-e4d256-prod-github-runner-207 kernel: [76348.605923] ? __fget_files+0x86/0xc0 Aug 23 02:36:14 juju-e4d256-prod-github-runner-207 kernel: [76348.606643] __x64_sys_ioctl+0x95/0xd0 Aug 23 02:36:14 juju-e4d256-prod-github-runner-207 kernel: [76348.607340] do_syscall_64+0x5c/0xc0 Aug 23 02:36:14 juju-e4d256-prod-github-runner-207 kernel: [76348.608005] ? do_futex+0x162/0x1f0 Aug 23 02:36:14 juju-e4d256-prod-github-runner-207 kernel: [76348.608652] ? __x64_sys_futex+0x78/0x1e0 Aug 23 02:36:14 juju-e4d256-prod-github-runner-207 kernel: [76348.609325] ? __secure_computing+0xa9/0x120 Aug 23 02:36:14 juju-e4d256-prod-github-runner-207 kernel: [76348.610017] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 02:36:14 juju-e4d256-prod-github-runner-207 kernel: [76348.610783] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:36:14 juju-e4d256-prod-github-runner-207 kernel: [76348.611507] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:36:14 juju-e4d256-prod-github-runner-207 kernel: [76348.612229] ? do_syscall_64+0x69/0xc0 Aug 23 02:36:14 juju-e4d256-prod-github-runner-207 kernel: [76348.612873] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:36:14 juju-e4d256-prod-github-runner-207 kernel: [76348.613575] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:36:14 juju-e4d256-prod-github-runner-207 kernel: [76348.614277] ? do_syscall_64+0x69/0xc0 Aug 23 02:36:14 juju-e4d256-prod-github-runner-207 kernel: [76348.614903] ? do_syscall_64+0x69/0xc0 Aug 23 02:36:14 juju-e4d256-prod-github-runner-207 kernel: [76348.615531] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 02:36:14 juju-e4d256-prod-github-runner-207 kernel: [76348.616239] RIP: 0033:0x7faa5d0edaff Aug 23 02:36:14 juju-e4d256-prod-github-runner-207 kernel: [76348.616864] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 02:36:14 juju-e4d256-prod-github-runner-207 kernel: [76348.618882] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 02:36:14 juju-e4d256-prod-github-runner-207 kernel: [76348.619791] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 02:36:14 juju-e4d256-prod-github-runner-207 kernel: [76348.620679] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 02:36:14 juju-e4d256-prod-github-runner-207 kernel: [76348.621568] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 02:36:14 juju-e4d256-prod-github-runner-207 kernel: [76348.622460] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 02:36:14 juju-e4d256-prod-github-runner-207 kernel: [76348.623347] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 02:36:14 juju-e4d256-prod-github-runner-207 kernel: [76348.624236] Aug 23 02:36:42 juju-e4d256-prod-github-runner-207 kernel: [76376.541980] watchdog: BUG: soft lockup - CPU#1 stuck for 71023s! [qemu-system-x86:6715] Aug 23 02:36:42 juju-e4d256-prod-github-runner-207 kernel: [76376.543688] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 02:36:42 juju-e4d256-prod-github-runner-207 kernel: [76376.543928] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 02:36:42 juju-e4d256-prod-github-runner-207 kernel: [76376.557089] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 02:36:42 juju-e4d256-prod-github-runner-207 kernel: [76376.558677] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 02:36:42 juju-e4d256-prod-github-runner-207 kernel: [76376.559933] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:36:42 juju-e4d256-prod-github-runner-207 kernel: [76376.560999] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 02:36:42 juju-e4d256-prod-github-runner-207 kernel: [76376.563586] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 02:36:42 juju-e4d256-prod-github-runner-207 kernel: [76376.564635] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 02:36:42 juju-e4d256-prod-github-runner-207 kernel: [76376.565819] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 02:36:42 juju-e4d256-prod-github-runner-207 kernel: [76376.566986] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 02:36:42 juju-e4d256-prod-github-runner-207 kernel: [76376.568164] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 02:36:42 juju-e4d256-prod-github-runner-207 kernel: [76376.569335] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 02:36:42 juju-e4d256-prod-github-runner-207 kernel: [76376.570562] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 02:36:42 juju-e4d256-prod-github-runner-207 kernel: [76376.571839] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 02:36:42 juju-e4d256-prod-github-runner-207 kernel: [76376.573076] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 02:36:42 juju-e4d256-prod-github-runner-207 kernel: [76376.574342] Call Trace: Aug 23 02:36:42 juju-e4d256-prod-github-runner-207 kernel: [76376.575289] Aug 23 02:36:42 juju-e4d256-prod-github-runner-207 kernel: [76376.576343] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:36:42 juju-e4d256-prod-github-runner-207 kernel: [76376.577405] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:36:42 juju-e4d256-prod-github-runner-207 kernel: [76376.578518] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:36:42 juju-e4d256-prod-github-runner-207 kernel: [76376.579760] ? show_regs.part.0+0x23/0x29 Aug 23 02:36:42 juju-e4d256-prod-github-runner-207 kernel: [76376.580863] ? show_regs.cold+0x8/0xd Aug 23 02:36:42 juju-e4d256-prod-github-runner-207 kernel: [76376.581867] ? watchdog_timer_fn+0x1be/0x220 Aug 23 02:36:42 juju-e4d256-prod-github-runner-207 kernel: [76376.583130] ? lockup_detector_update_enable+0x60/0x60 Aug 23 02:36:42 juju-e4d256-prod-github-runner-207 kernel: [76376.584223] ? __hrtimer_run_queues+0x107/0x230 Aug 23 02:36:42 juju-e4d256-prod-github-runner-207 kernel: [76376.585387] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 02:36:42 juju-e4d256-prod-github-runner-207 kernel: [76376.586450] ? hrtimer_interrupt+0x101/0x220 Aug 23 02:36:42 juju-e4d256-prod-github-runner-207 kernel: [76376.587882] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 02:36:42 juju-e4d256-prod-github-runner-207 kernel: [76376.589559] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 02:36:42 juju-e4d256-prod-github-runner-207 kernel: [76376.591123] Aug 23 02:36:42 juju-e4d256-prod-github-runner-207 kernel: [76376.592068] Aug 23 02:36:42 juju-e4d256-prod-github-runner-207 kernel: [76376.592932] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 02:36:42 juju-e4d256-prod-github-runner-207 kernel: [76376.594068] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:36:42 juju-e4d256-prod-github-runner-207 kernel: [76376.595318] ? _raw_spin_lock+0x22/0x30 Aug 23 02:36:42 juju-e4d256-prod-github-runner-207 kernel: [76376.596445] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:36:42 juju-e4d256-prod-github-runner-207 kernel: [76376.597696] direct_page_fault+0x206/0x310 [kvm] Aug 23 02:36:42 juju-e4d256-prod-github-runner-207 kernel: [76376.598887] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 02:36:42 juju-e4d256-prod-github-runner-207 kernel: [76376.600136] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 02:36:42 juju-e4d256-prod-github-runner-207 kernel: [76376.601812] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 02:36:42 juju-e4d256-prod-github-runner-207 kernel: [76376.603454] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 02:36:42 juju-e4d256-prod-github-runner-207 kernel: [76376.604782] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 02:36:42 juju-e4d256-prod-github-runner-207 kernel: [76376.606183] handle_exit+0x98/0x230 [kvm_amd] Aug 23 02:36:42 juju-e4d256-prod-github-runner-207 kernel: [76376.607436] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 02:36:42 juju-e4d256-prod-github-runner-207 kernel: [76376.608730] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 02:36:42 juju-e4d256-prod-github-runner-207 kernel: [76376.610025] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 02:36:42 juju-e4d256-prod-github-runner-207 kernel: [76376.610987] vcpu_run+0x62/0x2c0 [kvm] Aug 23 02:36:42 juju-e4d256-prod-github-runner-207 kernel: [76376.612106] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 02:36:42 juju-e4d256-prod-github-runner-207 kernel: [76376.612929] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 02:36:42 juju-e4d256-prod-github-runner-207 kernel: [76376.613816] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 02:36:42 juju-e4d256-prod-github-runner-207 kernel: [76376.614627] ? __seccomp_filter+0x4a/0x4a0 Aug 23 02:36:42 juju-e4d256-prod-github-runner-207 kernel: [76376.615496] ? __fget_files+0x86/0xc0 Aug 23 02:36:42 juju-e4d256-prod-github-runner-207 kernel: [76376.616428] __x64_sys_ioctl+0x95/0xd0 Aug 23 02:36:42 juju-e4d256-prod-github-runner-207 kernel: [76376.617452] do_syscall_64+0x5c/0xc0 Aug 23 02:36:42 juju-e4d256-prod-github-runner-207 kernel: [76376.618192] ? do_futex+0x162/0x1f0 Aug 23 02:36:42 juju-e4d256-prod-github-runner-207 kernel: [76376.618945] ? __x64_sys_futex+0x78/0x1e0 Aug 23 02:36:42 juju-e4d256-prod-github-runner-207 kernel: [76376.619682] ? __secure_computing+0xa9/0x120 Aug 23 02:36:42 juju-e4d256-prod-github-runner-207 kernel: [76376.620390] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 02:36:42 juju-e4d256-prod-github-runner-207 kernel: [76376.621177] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:36:42 juju-e4d256-prod-github-runner-207 kernel: [76376.621990] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:36:42 juju-e4d256-prod-github-runner-207 kernel: [76376.622725] ? do_syscall_64+0x69/0xc0 Aug 23 02:36:42 juju-e4d256-prod-github-runner-207 kernel: [76376.623397] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:36:42 juju-e4d256-prod-github-runner-207 kernel: [76376.624231] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:36:42 juju-e4d256-prod-github-runner-207 kernel: [76376.625088] ? do_syscall_64+0x69/0xc0 Aug 23 02:36:42 juju-e4d256-prod-github-runner-207 kernel: [76376.625717] ? do_syscall_64+0x69/0xc0 Aug 23 02:36:42 juju-e4d256-prod-github-runner-207 kernel: [76376.626371] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 02:36:42 juju-e4d256-prod-github-runner-207 kernel: [76376.627087] RIP: 0033:0x7faa5d0edaff Aug 23 02:36:42 juju-e4d256-prod-github-runner-207 kernel: [76376.627783] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 02:36:42 juju-e4d256-prod-github-runner-207 kernel: [76376.629884] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 02:36:42 juju-e4d256-prod-github-runner-207 kernel: [76376.630804] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 02:36:42 juju-e4d256-prod-github-runner-207 kernel: [76376.631710] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 02:36:42 juju-e4d256-prod-github-runner-207 kernel: [76376.632617] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 02:36:42 juju-e4d256-prod-github-runner-207 kernel: [76376.633579] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 02:36:42 juju-e4d256-prod-github-runner-207 kernel: [76376.634516] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 02:36:42 juju-e4d256-prod-github-runner-207 kernel: [76376.635444] Aug 23 02:37:10 juju-e4d256-prod-github-runner-207 kernel: [76404.541976] watchdog: BUG: soft lockup - CPU#1 stuck for 71049s! [qemu-system-x86:6715] Aug 23 02:37:10 juju-e4d256-prod-github-runner-207 kernel: [76404.543077] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 02:37:10 juju-e4d256-prod-github-runner-207 kernel: [76404.543142] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 02:37:10 juju-e4d256-prod-github-runner-207 kernel: [76404.555240] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 02:37:10 juju-e4d256-prod-github-runner-207 kernel: [76404.556505] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 02:37:10 juju-e4d256-prod-github-runner-207 kernel: [76404.557744] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:37:10 juju-e4d256-prod-github-runner-207 kernel: [76404.558801] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 02:37:10 juju-e4d256-prod-github-runner-207 kernel: [76404.561349] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 02:37:10 juju-e4d256-prod-github-runner-207 kernel: [76404.562406] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 02:37:10 juju-e4d256-prod-github-runner-207 kernel: [76404.563568] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 02:37:10 juju-e4d256-prod-github-runner-207 kernel: [76404.564734] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 02:37:10 juju-e4d256-prod-github-runner-207 kernel: [76404.565916] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 02:37:10 juju-e4d256-prod-github-runner-207 kernel: [76404.567084] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 02:37:10 juju-e4d256-prod-github-runner-207 kernel: [76404.568255] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 02:37:10 juju-e4d256-prod-github-runner-207 kernel: [76404.569505] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 02:37:10 juju-e4d256-prod-github-runner-207 kernel: [76404.570603] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 02:37:10 juju-e4d256-prod-github-runner-207 kernel: [76404.571796] Call Trace: Aug 23 02:37:10 juju-e4d256-prod-github-runner-207 kernel: [76404.572709] Aug 23 02:37:10 juju-e4d256-prod-github-runner-207 kernel: [76404.573607] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:37:10 juju-e4d256-prod-github-runner-207 kernel: [76404.574637] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:37:10 juju-e4d256-prod-github-runner-207 kernel: [76404.575663] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:37:10 juju-e4d256-prod-github-runner-207 kernel: [76404.576742] ? show_regs.part.0+0x23/0x29 Aug 23 02:37:10 juju-e4d256-prod-github-runner-207 kernel: [76404.577757] ? show_regs.cold+0x8/0xd Aug 23 02:37:10 juju-e4d256-prod-github-runner-207 kernel: [76404.578729] ? watchdog_timer_fn+0x1be/0x220 Aug 23 02:37:10 juju-e4d256-prod-github-runner-207 kernel: [76404.579737] ? lockup_detector_update_enable+0x60/0x60 Aug 23 02:37:10 juju-e4d256-prod-github-runner-207 kernel: [76404.580799] ? __hrtimer_run_queues+0x107/0x230 Aug 23 02:37:10 juju-e4d256-prod-github-runner-207 kernel: [76404.581852] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 02:37:10 juju-e4d256-prod-github-runner-207 kernel: [76404.582883] ? hrtimer_interrupt+0x101/0x220 Aug 23 02:37:10 juju-e4d256-prod-github-runner-207 kernel: [76404.583898] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 02:37:10 juju-e4d256-prod-github-runner-207 kernel: [76404.584966] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 02:37:10 juju-e4d256-prod-github-runner-207 kernel: [76404.586030] Aug 23 02:37:10 juju-e4d256-prod-github-runner-207 kernel: [76404.586886] Aug 23 02:37:10 juju-e4d256-prod-github-runner-207 kernel: [76404.587722] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 02:37:10 juju-e4d256-prod-github-runner-207 kernel: [76404.588760] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:37:10 juju-e4d256-prod-github-runner-207 kernel: [76404.589810] ? _raw_spin_lock+0x22/0x30 Aug 23 02:37:10 juju-e4d256-prod-github-runner-207 kernel: [76404.590755] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:37:10 juju-e4d256-prod-github-runner-207 kernel: [76404.591769] direct_page_fault+0x206/0x310 [kvm] Aug 23 02:37:10 juju-e4d256-prod-github-runner-207 kernel: [76404.592793] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 02:37:10 juju-e4d256-prod-github-runner-207 kernel: [76404.593816] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 02:37:10 juju-e4d256-prod-github-runner-207 kernel: [76404.594821] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 02:37:10 juju-e4d256-prod-github-runner-207 kernel: [76404.595792] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 02:37:10 juju-e4d256-prod-github-runner-207 kernel: [76404.596738] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 02:37:10 juju-e4d256-prod-github-runner-207 kernel: [76404.597736] handle_exit+0x98/0x230 [kvm_amd] Aug 23 02:37:10 juju-e4d256-prod-github-runner-207 kernel: [76404.598629] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 02:37:10 juju-e4d256-prod-github-runner-207 kernel: [76404.599543] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 02:37:10 juju-e4d256-prod-github-runner-207 kernel: [76404.600472] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 02:37:10 juju-e4d256-prod-github-runner-207 kernel: [76404.601375] vcpu_run+0x62/0x2c0 [kvm] Aug 23 02:37:10 juju-e4d256-prod-github-runner-207 kernel: [76404.602201] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 02:37:10 juju-e4d256-prod-github-runner-207 kernel: [76404.603008] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 02:37:10 juju-e4d256-prod-github-runner-207 kernel: [76404.603863] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 02:37:10 juju-e4d256-prod-github-runner-207 kernel: [76404.604664] ? __seccomp_filter+0x4a/0x4a0 Aug 23 02:37:10 juju-e4d256-prod-github-runner-207 kernel: [76404.605406] ? __fget_files+0x86/0xc0 Aug 23 02:37:10 juju-e4d256-prod-github-runner-207 kernel: [76404.606121] __x64_sys_ioctl+0x95/0xd0 Aug 23 02:37:10 juju-e4d256-prod-github-runner-207 kernel: [76404.606815] do_syscall_64+0x5c/0xc0 Aug 23 02:37:10 juju-e4d256-prod-github-runner-207 kernel: [76404.607483] ? do_futex+0x162/0x1f0 Aug 23 02:37:10 juju-e4d256-prod-github-runner-207 kernel: [76404.608131] ? __x64_sys_futex+0x78/0x1e0 Aug 23 02:37:10 juju-e4d256-prod-github-runner-207 kernel: [76404.608809] ? __secure_computing+0xa9/0x120 Aug 23 02:37:10 juju-e4d256-prod-github-runner-207 kernel: [76404.609513] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 02:37:10 juju-e4d256-prod-github-runner-207 kernel: [76404.610391] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:37:10 juju-e4d256-prod-github-runner-207 kernel: [76404.611210] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:37:10 juju-e4d256-prod-github-runner-207 kernel: [76404.612025] ? do_syscall_64+0x69/0xc0 Aug 23 02:37:10 juju-e4d256-prod-github-runner-207 kernel: [76404.612747] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:37:10 juju-e4d256-prod-github-runner-207 kernel: [76404.613571] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:37:10 juju-e4d256-prod-github-runner-207 kernel: [76404.614368] ? do_syscall_64+0x69/0xc0 Aug 23 02:37:10 juju-e4d256-prod-github-runner-207 kernel: [76404.615183] ? do_syscall_64+0x69/0xc0 Aug 23 02:37:10 juju-e4d256-prod-github-runner-207 kernel: [76404.615879] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 02:37:10 juju-e4d256-prod-github-runner-207 kernel: [76404.616683] RIP: 0033:0x7faa5d0edaff Aug 23 02:37:10 juju-e4d256-prod-github-runner-207 kernel: [76404.617377] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 02:37:10 juju-e4d256-prod-github-runner-207 kernel: [76404.619715] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 02:37:10 juju-e4d256-prod-github-runner-207 kernel: [76404.620773] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 02:37:10 juju-e4d256-prod-github-runner-207 kernel: [76404.621814] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 02:37:10 juju-e4d256-prod-github-runner-207 kernel: [76404.622842] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 02:37:10 juju-e4d256-prod-github-runner-207 kernel: [76404.623865] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 02:37:10 juju-e4d256-prod-github-runner-207 kernel: [76404.624883] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 02:37:10 juju-e4d256-prod-github-runner-207 kernel: [76404.625934] Aug 23 02:37:38 juju-e4d256-prod-github-runner-207 kernel: [76432.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 71075s! [qemu-system-x86:6715] Aug 23 02:37:38 juju-e4d256-prod-github-runner-207 kernel: [76432.543120] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 02:37:38 juju-e4d256-prod-github-runner-207 kernel: [76432.543187] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 02:37:38 juju-e4d256-prod-github-runner-207 kernel: [76432.555666] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 02:37:38 juju-e4d256-prod-github-runner-207 kernel: [76432.557139] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 02:37:38 juju-e4d256-prod-github-runner-207 kernel: [76432.558535] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:37:38 juju-e4d256-prod-github-runner-207 kernel: [76432.559719] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 02:37:38 juju-e4d256-prod-github-runner-207 kernel: [76432.562612] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 02:37:38 juju-e4d256-prod-github-runner-207 kernel: [76432.563764] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 02:37:38 juju-e4d256-prod-github-runner-207 kernel: [76432.565064] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 02:37:38 juju-e4d256-prod-github-runner-207 kernel: [76432.566381] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 02:37:38 juju-e4d256-prod-github-runner-207 kernel: [76432.567685] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 02:37:38 juju-e4d256-prod-github-runner-207 kernel: [76432.568986] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 02:37:38 juju-e4d256-prod-github-runner-207 kernel: [76432.570313] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 02:37:38 juju-e4d256-prod-github-runner-207 kernel: [76432.571697] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 02:37:38 juju-e4d256-prod-github-runner-207 kernel: [76432.572905] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 02:37:38 juju-e4d256-prod-github-runner-207 kernel: [76432.574251] Call Trace: Aug 23 02:37:38 juju-e4d256-prod-github-runner-207 kernel: [76432.575216] Aug 23 02:37:38 juju-e4d256-prod-github-runner-207 kernel: [76432.576145] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:37:38 juju-e4d256-prod-github-runner-207 kernel: [76432.577283] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:37:38 juju-e4d256-prod-github-runner-207 kernel: [76432.578392] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:37:38 juju-e4d256-prod-github-runner-207 kernel: [76432.579566] ? show_regs.part.0+0x23/0x29 Aug 23 02:37:38 juju-e4d256-prod-github-runner-207 kernel: [76432.580643] ? show_regs.cold+0x8/0xd Aug 23 02:37:38 juju-e4d256-prod-github-runner-207 kernel: [76432.581703] ? watchdog_timer_fn+0x1be/0x220 Aug 23 02:37:38 juju-e4d256-prod-github-runner-207 kernel: [76432.582796] ? lockup_detector_update_enable+0x60/0x60 Aug 23 02:37:38 juju-e4d256-prod-github-runner-207 kernel: [76432.583957] ? __hrtimer_run_queues+0x107/0x230 Aug 23 02:37:38 juju-e4d256-prod-github-runner-207 kernel: [76432.585071] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 02:37:38 juju-e4d256-prod-github-runner-207 kernel: [76432.586219] ? hrtimer_interrupt+0x101/0x220 Aug 23 02:37:38 juju-e4d256-prod-github-runner-207 kernel: [76432.587326] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 02:37:38 juju-e4d256-prod-github-runner-207 kernel: [76432.588426] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 02:37:38 juju-e4d256-prod-github-runner-207 kernel: [76432.589490] Aug 23 02:37:38 juju-e4d256-prod-github-runner-207 kernel: [76432.590346] Aug 23 02:37:38 juju-e4d256-prod-github-runner-207 kernel: [76432.591190] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 02:37:38 juju-e4d256-prod-github-runner-207 kernel: [76432.592224] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:37:38 juju-e4d256-prod-github-runner-207 kernel: [76432.593283] ? _raw_spin_lock+0x22/0x30 Aug 23 02:37:38 juju-e4d256-prod-github-runner-207 kernel: [76432.594231] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:37:38 juju-e4d256-prod-github-runner-207 kernel: [76432.595253] direct_page_fault+0x206/0x310 [kvm] Aug 23 02:37:38 juju-e4d256-prod-github-runner-207 kernel: [76432.596283] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 02:37:38 juju-e4d256-prod-github-runner-207 kernel: [76432.597317] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 02:37:38 juju-e4d256-prod-github-runner-207 kernel: [76432.598322] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 02:37:38 juju-e4d256-prod-github-runner-207 kernel: [76432.599393] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 02:37:38 juju-e4d256-prod-github-runner-207 kernel: [76432.600338] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 02:37:38 juju-e4d256-prod-github-runner-207 kernel: [76432.601338] handle_exit+0x98/0x230 [kvm_amd] Aug 23 02:37:38 juju-e4d256-prod-github-runner-207 kernel: [76432.602237] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 02:37:38 juju-e4d256-prod-github-runner-207 kernel: [76432.603173] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 02:37:38 juju-e4d256-prod-github-runner-207 kernel: [76432.604142] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 02:37:38 juju-e4d256-prod-github-runner-207 kernel: [76432.605060] vcpu_run+0x62/0x2c0 [kvm] Aug 23 02:37:38 juju-e4d256-prod-github-runner-207 kernel: [76432.606003] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 02:37:38 juju-e4d256-prod-github-runner-207 kernel: [76432.606815] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 02:37:38 juju-e4d256-prod-github-runner-207 kernel: [76432.607669] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 02:37:38 juju-e4d256-prod-github-runner-207 kernel: [76432.608466] ? __seccomp_filter+0x4a/0x4a0 Aug 23 02:37:38 juju-e4d256-prod-github-runner-207 kernel: [76432.609365] ? __fget_files+0x86/0xc0 Aug 23 02:37:38 juju-e4d256-prod-github-runner-207 kernel: [76432.610112] __x64_sys_ioctl+0x95/0xd0 Aug 23 02:37:38 juju-e4d256-prod-github-runner-207 kernel: [76432.610809] do_syscall_64+0x5c/0xc0 Aug 23 02:37:38 juju-e4d256-prod-github-runner-207 kernel: [76432.611474] ? do_futex+0x162/0x1f0 Aug 23 02:37:38 juju-e4d256-prod-github-runner-207 kernel: [76432.612129] ? __x64_sys_futex+0x78/0x1e0 Aug 23 02:37:38 juju-e4d256-prod-github-runner-207 kernel: [76432.612804] ? __secure_computing+0xa9/0x120 Aug 23 02:37:38 juju-e4d256-prod-github-runner-207 kernel: [76432.613522] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 02:37:38 juju-e4d256-prod-github-runner-207 kernel: [76432.614298] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:37:38 juju-e4d256-prod-github-runner-207 kernel: [76432.615020] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:37:38 juju-e4d256-prod-github-runner-207 kernel: [76432.615744] ? do_syscall_64+0x69/0xc0 Aug 23 02:37:38 juju-e4d256-prod-github-runner-207 kernel: [76432.616387] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:37:38 juju-e4d256-prod-github-runner-207 kernel: [76432.617088] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:37:38 juju-e4d256-prod-github-runner-207 kernel: [76432.617828] ? do_syscall_64+0x69/0xc0 Aug 23 02:37:38 juju-e4d256-prod-github-runner-207 kernel: [76432.618463] ? do_syscall_64+0x69/0xc0 Aug 23 02:37:38 juju-e4d256-prod-github-runner-207 kernel: [76432.619089] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 02:37:38 juju-e4d256-prod-github-runner-207 kernel: [76432.619794] RIP: 0033:0x7faa5d0edaff Aug 23 02:37:38 juju-e4d256-prod-github-runner-207 kernel: [76432.620420] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 02:37:38 juju-e4d256-prod-github-runner-207 kernel: [76432.622441] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 02:37:38 juju-e4d256-prod-github-runner-207 kernel: [76432.623355] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 02:37:38 juju-e4d256-prod-github-runner-207 kernel: [76432.624248] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 02:37:38 juju-e4d256-prod-github-runner-207 kernel: [76432.625155] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 02:37:38 juju-e4d256-prod-github-runner-207 kernel: [76432.626045] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 02:37:38 juju-e4d256-prod-github-runner-207 kernel: [76432.626937] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 02:37:38 juju-e4d256-prod-github-runner-207 kernel: [76432.627832] Aug 23 02:38:06 juju-e4d256-prod-github-runner-207 kernel: [76460.541981] watchdog: BUG: soft lockup - CPU#1 stuck for 71101s! [qemu-system-x86:6715] Aug 23 02:38:06 juju-e4d256-prod-github-runner-207 kernel: [76460.543696] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 02:38:06 juju-e4d256-prod-github-runner-207 kernel: [76460.543952] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 02:38:06 juju-e4d256-prod-github-runner-207 kernel: [76460.555985] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 02:38:06 juju-e4d256-prod-github-runner-207 kernel: [76460.557257] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 02:38:06 juju-e4d256-prod-github-runner-207 kernel: [76460.558473] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:38:06 juju-e4d256-prod-github-runner-207 kernel: [76460.559526] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 02:38:06 juju-e4d256-prod-github-runner-207 kernel: [76460.562068] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 02:38:06 juju-e4d256-prod-github-runner-207 kernel: [76460.563111] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 02:38:06 juju-e4d256-prod-github-runner-207 kernel: [76460.564276] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 02:38:06 juju-e4d256-prod-github-runner-207 kernel: [76460.565436] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 02:38:06 juju-e4d256-prod-github-runner-207 kernel: [76460.566594] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 02:38:06 juju-e4d256-prod-github-runner-207 kernel: [76460.567760] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 02:38:06 juju-e4d256-prod-github-runner-207 kernel: [76460.568929] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 02:38:06 juju-e4d256-prod-github-runner-207 kernel: [76460.570159] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 02:38:06 juju-e4d256-prod-github-runner-207 kernel: [76460.571334] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 02:38:06 juju-e4d256-prod-github-runner-207 kernel: [76460.572544] Call Trace: Aug 23 02:38:06 juju-e4d256-prod-github-runner-207 kernel: [76460.573472] Aug 23 02:38:06 juju-e4d256-prod-github-runner-207 kernel: [76460.574371] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:38:06 juju-e4d256-prod-github-runner-207 kernel: [76460.575412] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:38:06 juju-e4d256-prod-github-runner-207 kernel: [76460.576445] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:38:06 juju-e4d256-prod-github-runner-207 kernel: [76460.577560] ? show_regs.part.0+0x23/0x29 Aug 23 02:38:06 juju-e4d256-prod-github-runner-207 kernel: [76460.578721] ? show_regs.cold+0x8/0xd Aug 23 02:38:06 juju-e4d256-prod-github-runner-207 kernel: [76460.579704] ? watchdog_timer_fn+0x1be/0x220 Aug 23 02:38:06 juju-e4d256-prod-github-runner-207 kernel: [76460.580712] ? lockup_detector_update_enable+0x60/0x60 Aug 23 02:38:06 juju-e4d256-prod-github-runner-207 kernel: [76460.581786] ? __hrtimer_run_queues+0x107/0x230 Aug 23 02:38:06 juju-e4d256-prod-github-runner-207 kernel: [76460.582813] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 02:38:06 juju-e4d256-prod-github-runner-207 kernel: [76460.583839] ? hrtimer_interrupt+0x101/0x220 Aug 23 02:38:06 juju-e4d256-prod-github-runner-207 kernel: [76460.584925] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 02:38:06 juju-e4d256-prod-github-runner-207 kernel: [76460.586036] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 02:38:06 juju-e4d256-prod-github-runner-207 kernel: [76460.587112] Aug 23 02:38:06 juju-e4d256-prod-github-runner-207 kernel: [76460.588031] Aug 23 02:38:06 juju-e4d256-prod-github-runner-207 kernel: [76460.588946] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 02:38:06 juju-e4d256-prod-github-runner-207 kernel: [76460.590050] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:38:06 juju-e4d256-prod-github-runner-207 kernel: [76460.591111] ? _raw_spin_lock+0x22/0x30 Aug 23 02:38:06 juju-e4d256-prod-github-runner-207 kernel: [76460.592063] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:38:06 juju-e4d256-prod-github-runner-207 kernel: [76460.593101] direct_page_fault+0x206/0x310 [kvm] Aug 23 02:38:06 juju-e4d256-prod-github-runner-207 kernel: [76460.594128] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 02:38:06 juju-e4d256-prod-github-runner-207 kernel: [76460.595137] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 02:38:06 juju-e4d256-prod-github-runner-207 kernel: [76460.596137] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 02:38:06 juju-e4d256-prod-github-runner-207 kernel: [76460.597141] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 02:38:06 juju-e4d256-prod-github-runner-207 kernel: [76460.598086] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 02:38:06 juju-e4d256-prod-github-runner-207 kernel: [76460.599124] handle_exit+0x98/0x230 [kvm_amd] Aug 23 02:38:06 juju-e4d256-prod-github-runner-207 kernel: [76460.600022] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 02:38:06 juju-e4d256-prod-github-runner-207 kernel: [76460.600954] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 02:38:06 juju-e4d256-prod-github-runner-207 kernel: [76460.601880] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 02:38:06 juju-e4d256-prod-github-runner-207 kernel: [76460.602787] vcpu_run+0x62/0x2c0 [kvm] Aug 23 02:38:06 juju-e4d256-prod-github-runner-207 kernel: [76460.603597] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 02:38:06 juju-e4d256-prod-github-runner-207 kernel: [76460.604583] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 02:38:06 juju-e4d256-prod-github-runner-207 kernel: [76460.605472] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 02:38:06 juju-e4d256-prod-github-runner-207 kernel: [76460.606277] ? __seccomp_filter+0x4a/0x4a0 Aug 23 02:38:06 juju-e4d256-prod-github-runner-207 kernel: [76460.607022] ? __fget_files+0x86/0xc0 Aug 23 02:38:06 juju-e4d256-prod-github-runner-207 kernel: [76460.607724] __x64_sys_ioctl+0x95/0xd0 Aug 23 02:38:06 juju-e4d256-prod-github-runner-207 kernel: [76460.608416] do_syscall_64+0x5c/0xc0 Aug 23 02:38:06 juju-e4d256-prod-github-runner-207 kernel: [76460.609104] ? do_futex+0x162/0x1f0 Aug 23 02:38:06 juju-e4d256-prod-github-runner-207 kernel: [76460.609752] ? __x64_sys_futex+0x78/0x1e0 Aug 23 02:38:06 juju-e4d256-prod-github-runner-207 kernel: [76460.610424] ? __secure_computing+0xa9/0x120 Aug 23 02:38:06 juju-e4d256-prod-github-runner-207 kernel: [76460.611117] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 02:38:06 juju-e4d256-prod-github-runner-207 kernel: [76460.611875] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:38:06 juju-e4d256-prod-github-runner-207 kernel: [76460.612597] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:38:06 juju-e4d256-prod-github-runner-207 kernel: [76460.613330] ? do_syscall_64+0x69/0xc0 Aug 23 02:38:06 juju-e4d256-prod-github-runner-207 kernel: [76460.613976] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:38:06 juju-e4d256-prod-github-runner-207 kernel: [76460.614678] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:38:06 juju-e4d256-prod-github-runner-207 kernel: [76460.615380] ? do_syscall_64+0x69/0xc0 Aug 23 02:38:06 juju-e4d256-prod-github-runner-207 kernel: [76460.616010] ? do_syscall_64+0x69/0xc0 Aug 23 02:38:06 juju-e4d256-prod-github-runner-207 kernel: [76460.616632] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 02:38:06 juju-e4d256-prod-github-runner-207 kernel: [76460.617350] RIP: 0033:0x7faa5d0edaff Aug 23 02:38:06 juju-e4d256-prod-github-runner-207 kernel: [76460.617990] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 02:38:06 juju-e4d256-prod-github-runner-207 kernel: [76460.619984] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 02:38:06 juju-e4d256-prod-github-runner-207 kernel: [76460.620904] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 02:38:06 juju-e4d256-prod-github-runner-207 kernel: [76460.621801] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 02:38:06 juju-e4d256-prod-github-runner-207 kernel: [76460.622690] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 02:38:06 juju-e4d256-prod-github-runner-207 kernel: [76460.623593] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 02:38:06 juju-e4d256-prod-github-runner-207 kernel: [76460.624513] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 02:38:06 juju-e4d256-prod-github-runner-207 kernel: [76460.625418] Aug 23 02:38:34 juju-e4d256-prod-github-runner-207 kernel: [76488.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 71127s! [qemu-system-x86:6715] Aug 23 02:38:34 juju-e4d256-prod-github-runner-207 kernel: [76488.543110] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 02:38:34 juju-e4d256-prod-github-runner-207 kernel: [76488.543180] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 02:38:34 juju-e4d256-prod-github-runner-207 kernel: [76488.555300] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 02:38:34 juju-e4d256-prod-github-runner-207 kernel: [76488.556584] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 02:38:34 juju-e4d256-prod-github-runner-207 kernel: [76488.557808] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:38:34 juju-e4d256-prod-github-runner-207 kernel: [76488.558865] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 02:38:34 juju-e4d256-prod-github-runner-207 kernel: [76488.561431] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 02:38:34 juju-e4d256-prod-github-runner-207 kernel: [76488.562481] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 02:38:34 juju-e4d256-prod-github-runner-207 kernel: [76488.563645] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 02:38:34 juju-e4d256-prod-github-runner-207 kernel: [76488.564818] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 02:38:34 juju-e4d256-prod-github-runner-207 kernel: [76488.565978] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 02:38:34 juju-e4d256-prod-github-runner-207 kernel: [76488.567142] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 02:38:34 juju-e4d256-prod-github-runner-207 kernel: [76488.568311] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 02:38:34 juju-e4d256-prod-github-runner-207 kernel: [76488.569557] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 02:38:34 juju-e4d256-prod-github-runner-207 kernel: [76488.570659] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 02:38:34 juju-e4d256-prod-github-runner-207 kernel: [76488.571855] Call Trace: Aug 23 02:38:34 juju-e4d256-prod-github-runner-207 kernel: [76488.572783] Aug 23 02:38:34 juju-e4d256-prod-github-runner-207 kernel: [76488.573672] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:38:34 juju-e4d256-prod-github-runner-207 kernel: [76488.574703] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:38:34 juju-e4d256-prod-github-runner-207 kernel: [76488.575721] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:38:34 juju-e4d256-prod-github-runner-207 kernel: [76488.576816] ? show_regs.part.0+0x23/0x29 Aug 23 02:38:34 juju-e4d256-prod-github-runner-207 kernel: [76488.577816] ? show_regs.cold+0x8/0xd Aug 23 02:38:34 juju-e4d256-prod-github-runner-207 kernel: [76488.578897] ? watchdog_timer_fn+0x1be/0x220 Aug 23 02:38:34 juju-e4d256-prod-github-runner-207 kernel: [76488.579984] ? lockup_detector_update_enable+0x60/0x60 Aug 23 02:38:34 juju-e4d256-prod-github-runner-207 kernel: [76488.581070] ? __hrtimer_run_queues+0x107/0x230 Aug 23 02:38:34 juju-e4d256-prod-github-runner-207 kernel: [76488.582098] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 02:38:34 juju-e4d256-prod-github-runner-207 kernel: [76488.583126] ? hrtimer_interrupt+0x101/0x220 Aug 23 02:38:34 juju-e4d256-prod-github-runner-207 kernel: [76488.584139] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 02:38:34 juju-e4d256-prod-github-runner-207 kernel: [76488.585221] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 02:38:34 juju-e4d256-prod-github-runner-207 kernel: [76488.586268] Aug 23 02:38:34 juju-e4d256-prod-github-runner-207 kernel: [76488.587120] Aug 23 02:38:34 juju-e4d256-prod-github-runner-207 kernel: [76488.587956] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 02:38:34 juju-e4d256-prod-github-runner-207 kernel: [76488.589008] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:38:34 juju-e4d256-prod-github-runner-207 kernel: [76488.590055] ? _raw_spin_lock+0x22/0x30 Aug 23 02:38:34 juju-e4d256-prod-github-runner-207 kernel: [76488.591008] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:38:34 juju-e4d256-prod-github-runner-207 kernel: [76488.592030] direct_page_fault+0x206/0x310 [kvm] Aug 23 02:38:34 juju-e4d256-prod-github-runner-207 kernel: [76488.593070] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 02:38:34 juju-e4d256-prod-github-runner-207 kernel: [76488.594084] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 02:38:34 juju-e4d256-prod-github-runner-207 kernel: [76488.595087] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 02:38:34 juju-e4d256-prod-github-runner-207 kernel: [76488.596057] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 02:38:34 juju-e4d256-prod-github-runner-207 kernel: [76488.597014] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 02:38:34 juju-e4d256-prod-github-runner-207 kernel: [76488.597993] handle_exit+0x98/0x230 [kvm_amd] Aug 23 02:38:34 juju-e4d256-prod-github-runner-207 kernel: [76488.598890] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 02:38:34 juju-e4d256-prod-github-runner-207 kernel: [76488.599807] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 02:38:34 juju-e4d256-prod-github-runner-207 kernel: [76488.600753] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 02:38:34 juju-e4d256-prod-github-runner-207 kernel: [76488.601664] vcpu_run+0x62/0x2c0 [kvm] Aug 23 02:38:34 juju-e4d256-prod-github-runner-207 kernel: [76488.602477] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 02:38:34 juju-e4d256-prod-github-runner-207 kernel: [76488.603287] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 02:38:34 juju-e4d256-prod-github-runner-207 kernel: [76488.604143] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 02:38:34 juju-e4d256-prod-github-runner-207 kernel: [76488.604969] ? __seccomp_filter+0x4a/0x4a0 Aug 23 02:38:34 juju-e4d256-prod-github-runner-207 kernel: [76488.605724] ? __fget_files+0x86/0xc0 Aug 23 02:38:34 juju-e4d256-prod-github-runner-207 kernel: [76488.606434] __x64_sys_ioctl+0x95/0xd0 Aug 23 02:38:34 juju-e4d256-prod-github-runner-207 kernel: [76488.607128] do_syscall_64+0x5c/0xc0 Aug 23 02:38:34 juju-e4d256-prod-github-runner-207 kernel: [76488.607801] ? do_futex+0x162/0x1f0 Aug 23 02:38:34 juju-e4d256-prod-github-runner-207 kernel: [76488.608455] ? __x64_sys_futex+0x78/0x1e0 Aug 23 02:38:34 juju-e4d256-prod-github-runner-207 kernel: [76488.609148] ? __secure_computing+0xa9/0x120 Aug 23 02:38:34 juju-e4d256-prod-github-runner-207 kernel: [76488.609847] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 02:38:34 juju-e4d256-prod-github-runner-207 kernel: [76488.610615] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:38:34 juju-e4d256-prod-github-runner-207 kernel: [76488.611345] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:38:34 juju-e4d256-prod-github-runner-207 kernel: [76488.612200] ? do_syscall_64+0x69/0xc0 Aug 23 02:38:34 juju-e4d256-prod-github-runner-207 kernel: [76488.612856] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:38:34 juju-e4d256-prod-github-runner-207 kernel: [76488.613567] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:38:34 juju-e4d256-prod-github-runner-207 kernel: [76488.614264] ? do_syscall_64+0x69/0xc0 Aug 23 02:38:34 juju-e4d256-prod-github-runner-207 kernel: [76488.614890] ? do_syscall_64+0x69/0xc0 Aug 23 02:38:34 juju-e4d256-prod-github-runner-207 kernel: [76488.615524] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 02:38:34 juju-e4d256-prod-github-runner-207 kernel: [76488.616238] RIP: 0033:0x7faa5d0edaff Aug 23 02:38:34 juju-e4d256-prod-github-runner-207 kernel: [76488.616903] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 02:38:34 juju-e4d256-prod-github-runner-207 kernel: [76488.618900] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 02:38:34 juju-e4d256-prod-github-runner-207 kernel: [76488.619821] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 02:38:34 juju-e4d256-prod-github-runner-207 kernel: [76488.620739] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 02:38:34 juju-e4d256-prod-github-runner-207 kernel: [76488.621633] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 02:38:34 juju-e4d256-prod-github-runner-207 kernel: [76488.622533] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 02:38:34 juju-e4d256-prod-github-runner-207 kernel: [76488.623423] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 02:38:34 juju-e4d256-prod-github-runner-207 kernel: [76488.624318] Aug 23 02:38:48 juju-e4d256-prod-github-runner-207 kernel: [76502.288705] rcu: INFO: rcu_sched self-detected stall on CPU Aug 23 02:38:48 juju-e4d256-prod-github-runner-207 kernel: [76502.289681] rcu: 1-....: (19036303 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=9203233 Aug 23 02:38:48 juju-e4d256-prod-github-runner-207 kernel: [76502.290801] (t=19096272 jiffies g=23269 q=64488) Aug 23 02:38:48 juju-e4d256-prod-github-runner-207 kernel: [76502.291751] NMI backtrace for cpu 1 Aug 23 02:38:48 juju-e4d256-prod-github-runner-207 kernel: [76502.292472] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 02:38:48 juju-e4d256-prod-github-runner-207 kernel: [76502.293571] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 02:38:48 juju-e4d256-prod-github-runner-207 kernel: [76502.294629] Call Trace: Aug 23 02:38:48 juju-e4d256-prod-github-runner-207 kernel: [76502.295304] Aug 23 02:38:48 juju-e4d256-prod-github-runner-207 kernel: [76502.295950] show_stack+0x52/0x5c Aug 23 02:38:48 juju-e4d256-prod-github-runner-207 kernel: [76502.296686] dump_stack_lvl+0x4a/0x63 Aug 23 02:38:48 juju-e4d256-prod-github-runner-207 kernel: [76502.297432] dump_stack+0x10/0x16 Aug 23 02:38:48 juju-e4d256-prod-github-runner-207 kernel: [76502.298148] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 23 02:38:48 juju-e4d256-prod-github-runner-207 kernel: [76502.298925] ? lapic_can_unplug_cpu+0x90/0x90 Aug 23 02:38:48 juju-e4d256-prod-github-runner-207 kernel: [76502.299699] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 23 02:38:48 juju-e4d256-prod-github-runner-207 kernel: [76502.300532] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 23 02:38:48 juju-e4d256-prod-github-runner-207 kernel: [76502.301354] trigger_single_cpu_backtrace+0x44/0x4f Aug 23 02:38:48 juju-e4d256-prod-github-runner-207 kernel: [76502.302161] rcu_dump_cpu_stacks+0x102/0x149 Aug 23 02:38:48 juju-e4d256-prod-github-runner-207 kernel: [76502.302936] print_cpu_stall.cold+0x2f/0xe2 Aug 23 02:38:48 juju-e4d256-prod-github-runner-207 kernel: [76502.303698] ? timekeeping_update+0xf7/0x150 Aug 23 02:38:48 juju-e4d256-prod-github-runner-207 kernel: [76502.304484] check_cpu_stall+0x109/0x270 Aug 23 02:38:48 juju-e4d256-prod-github-runner-207 kernel: [76502.305232] rcu_sched_clock_irq+0x9a/0x250 Aug 23 02:38:48 juju-e4d256-prod-github-runner-207 kernel: [76502.306001] update_process_times+0x94/0xd0 Aug 23 02:38:48 juju-e4d256-prod-github-runner-207 kernel: [76502.306761] tick_sched_handle+0x29/0x70 Aug 23 02:38:48 juju-e4d256-prod-github-runner-207 kernel: [76502.307505] tick_sched_timer+0x8c/0xc0 Aug 23 02:38:48 juju-e4d256-prod-github-runner-207 kernel: [76502.308243] ? tick_nohz_handler+0xb0/0xb0 Aug 23 02:38:48 juju-e4d256-prod-github-runner-207 kernel: [76502.309005] __hrtimer_run_queues+0x107/0x230 Aug 23 02:38:48 juju-e4d256-prod-github-runner-207 kernel: [76502.309777] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 02:38:48 juju-e4d256-prod-github-runner-207 kernel: [76502.310551] hrtimer_interrupt+0x101/0x220 Aug 23 02:38:48 juju-e4d256-prod-github-runner-207 kernel: [76502.311312] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 02:38:48 juju-e4d256-prod-github-runner-207 kernel: [76502.312126] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 02:38:48 juju-e4d256-prod-github-runner-207 kernel: [76502.312940] Aug 23 02:38:48 juju-e4d256-prod-github-runner-207 kernel: [76502.313575] Aug 23 02:38:48 juju-e4d256-prod-github-runner-207 kernel: [76502.314203] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 02:38:48 juju-e4d256-prod-github-runner-207 kernel: [76502.315025] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:38:48 juju-e4d256-prod-github-runner-207 kernel: [76502.316007] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 02:38:48 juju-e4d256-prod-github-runner-207 kernel: [76502.318223] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 02:38:48 juju-e4d256-prod-github-runner-207 kernel: [76502.319106] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 02:38:48 juju-e4d256-prod-github-runner-207 kernel: [76502.320103] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 02:38:48 juju-e4d256-prod-github-runner-207 kernel: [76502.321102] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 02:38:48 juju-e4d256-prod-github-runner-207 kernel: [76502.322071] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 02:38:48 juju-e4d256-prod-github-runner-207 kernel: [76502.323025] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 02:38:48 juju-e4d256-prod-github-runner-207 kernel: [76502.323984] ? _raw_spin_lock+0x22/0x30 Aug 23 02:38:48 juju-e4d256-prod-github-runner-207 kernel: [76502.324787] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:38:48 juju-e4d256-prod-github-runner-207 kernel: [76502.325624] direct_page_fault+0x206/0x310 [kvm] Aug 23 02:38:48 juju-e4d256-prod-github-runner-207 kernel: [76502.326460] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 02:38:48 juju-e4d256-prod-github-runner-207 kernel: [76502.327291] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 02:38:48 juju-e4d256-prod-github-runner-207 kernel: [76502.328119] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 02:38:48 juju-e4d256-prod-github-runner-207 kernel: [76502.328933] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 02:38:48 juju-e4d256-prod-github-runner-207 kernel: [76502.329718] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 02:38:48 juju-e4d256-prod-github-runner-207 kernel: [76502.330559] handle_exit+0x98/0x230 [kvm_amd] Aug 23 02:38:48 juju-e4d256-prod-github-runner-207 kernel: [76502.331316] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 02:38:48 juju-e4d256-prod-github-runner-207 kernel: [76502.332098] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 02:38:48 juju-e4d256-prod-github-runner-207 kernel: [76502.332905] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 02:38:48 juju-e4d256-prod-github-runner-207 kernel: [76502.333691] vcpu_run+0x62/0x2c0 [kvm] Aug 23 02:38:48 juju-e4d256-prod-github-runner-207 kernel: [76502.334405] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 02:38:48 juju-e4d256-prod-github-runner-207 kernel: [76502.335138] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 02:38:48 juju-e4d256-prod-github-runner-207 kernel: [76502.335940] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 02:38:48 juju-e4d256-prod-github-runner-207 kernel: [76502.336719] ? __seccomp_filter+0x4a/0x4a0 Aug 23 02:38:48 juju-e4d256-prod-github-runner-207 kernel: [76502.337444] ? __fget_files+0x86/0xc0 Aug 23 02:38:48 juju-e4d256-prod-github-runner-207 kernel: [76502.338137] __x64_sys_ioctl+0x95/0xd0 Aug 23 02:38:48 juju-e4d256-prod-github-runner-207 kernel: [76502.338831] do_syscall_64+0x5c/0xc0 Aug 23 02:38:48 juju-e4d256-prod-github-runner-207 kernel: [76502.339515] ? do_futex+0x162/0x1f0 Aug 23 02:38:48 juju-e4d256-prod-github-runner-207 kernel: [76502.340185] ? __x64_sys_futex+0x78/0x1e0 Aug 23 02:38:48 juju-e4d256-prod-github-runner-207 kernel: [76502.340897] ? __secure_computing+0xa9/0x120 Aug 23 02:38:48 juju-e4d256-prod-github-runner-207 kernel: [76502.341615] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 02:38:48 juju-e4d256-prod-github-runner-207 kernel: [76502.342435] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:38:48 juju-e4d256-prod-github-runner-207 kernel: [76502.343256] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:38:48 juju-e4d256-prod-github-runner-207 kernel: [76502.344010] ? do_syscall_64+0x69/0xc0 Aug 23 02:38:48 juju-e4d256-prod-github-runner-207 kernel: [76502.344722] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:38:48 juju-e4d256-prod-github-runner-207 kernel: [76502.345481] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:38:48 juju-e4d256-prod-github-runner-207 kernel: [76502.346239] ? do_syscall_64+0x69/0xc0 Aug 23 02:38:48 juju-e4d256-prod-github-runner-207 kernel: [76502.346934] ? do_syscall_64+0x69/0xc0 Aug 23 02:38:48 juju-e4d256-prod-github-runner-207 kernel: [76502.347622] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 02:38:48 juju-e4d256-prod-github-runner-207 kernel: [76502.348405] RIP: 0033:0x7faa5d0edaff Aug 23 02:38:48 juju-e4d256-prod-github-runner-207 kernel: [76502.349110] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 02:38:48 juju-e4d256-prod-github-runner-207 kernel: [76502.351224] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 02:38:48 juju-e4d256-prod-github-runner-207 kernel: [76502.352190] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 02:38:48 juju-e4d256-prod-github-runner-207 kernel: [76502.353154] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 02:38:48 juju-e4d256-prod-github-runner-207 kernel: [76502.354097] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 02:38:48 juju-e4d256-prod-github-runner-207 kernel: [76502.355035] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 02:38:48 juju-e4d256-prod-github-runner-207 kernel: [76502.355958] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 02:38:48 juju-e4d256-prod-github-runner-207 kernel: [76502.356880] Aug 23 02:39:14 juju-e4d256-prod-github-runner-207 kernel: [76528.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 71164s! [qemu-system-x86:6715] Aug 23 02:39:14 juju-e4d256-prod-github-runner-207 kernel: [76528.543113] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 02:39:14 juju-e4d256-prod-github-runner-207 kernel: [76528.543184] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 02:39:14 juju-e4d256-prod-github-runner-207 kernel: [76528.555525] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 02:39:14 juju-e4d256-prod-github-runner-207 kernel: [76528.556801] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 02:39:14 juju-e4d256-prod-github-runner-207 kernel: [76528.558018] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:39:14 juju-e4d256-prod-github-runner-207 kernel: [76528.559082] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 02:39:14 juju-e4d256-prod-github-runner-207 kernel: [76528.561642] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 02:39:14 juju-e4d256-prod-github-runner-207 kernel: [76528.562689] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 02:39:14 juju-e4d256-prod-github-runner-207 kernel: [76528.563851] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 02:39:14 juju-e4d256-prod-github-runner-207 kernel: [76528.565060] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 02:39:14 juju-e4d256-prod-github-runner-207 kernel: [76528.566217] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 02:39:14 juju-e4d256-prod-github-runner-207 kernel: [76528.567384] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 02:39:14 juju-e4d256-prod-github-runner-207 kernel: [76528.568584] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 02:39:14 juju-e4d256-prod-github-runner-207 kernel: [76528.569926] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 02:39:14 juju-e4d256-prod-github-runner-207 kernel: [76528.571066] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 02:39:14 juju-e4d256-prod-github-runner-207 kernel: [76528.572274] Call Trace: Aug 23 02:39:14 juju-e4d256-prod-github-runner-207 kernel: [76528.573192] Aug 23 02:39:14 juju-e4d256-prod-github-runner-207 kernel: [76528.574076] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:39:14 juju-e4d256-prod-github-runner-207 kernel: [76528.575141] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:39:14 juju-e4d256-prod-github-runner-207 kernel: [76528.576211] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:39:14 juju-e4d256-prod-github-runner-207 kernel: [76528.577287] ? show_regs.part.0+0x23/0x29 Aug 23 02:39:14 juju-e4d256-prod-github-runner-207 kernel: [76528.578319] ? show_regs.cold+0x8/0xd Aug 23 02:39:14 juju-e4d256-prod-github-runner-207 kernel: [76528.579290] ? watchdog_timer_fn+0x1be/0x220 Aug 23 02:39:14 juju-e4d256-prod-github-runner-207 kernel: [76528.580304] ? lockup_detector_update_enable+0x60/0x60 Aug 23 02:39:14 juju-e4d256-prod-github-runner-207 kernel: [76528.581370] ? __hrtimer_run_queues+0x107/0x230 Aug 23 02:39:14 juju-e4d256-prod-github-runner-207 kernel: [76528.582398] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 02:39:14 juju-e4d256-prod-github-runner-207 kernel: [76528.583425] ? hrtimer_interrupt+0x101/0x220 Aug 23 02:39:14 juju-e4d256-prod-github-runner-207 kernel: [76528.584444] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 02:39:14 juju-e4d256-prod-github-runner-207 kernel: [76528.585552] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 02:39:14 juju-e4d256-prod-github-runner-207 kernel: [76528.586594] Aug 23 02:39:14 juju-e4d256-prod-github-runner-207 kernel: [76528.587445] Aug 23 02:39:14 juju-e4d256-prod-github-runner-207 kernel: [76528.588301] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 02:39:14 juju-e4d256-prod-github-runner-207 kernel: [76528.589373] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:39:14 juju-e4d256-prod-github-runner-207 kernel: [76528.590415] ? _raw_spin_lock+0x22/0x30 Aug 23 02:39:14 juju-e4d256-prod-github-runner-207 kernel: [76528.591356] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:39:14 juju-e4d256-prod-github-runner-207 kernel: [76528.592404] direct_page_fault+0x206/0x310 [kvm] Aug 23 02:39:14 juju-e4d256-prod-github-runner-207 kernel: [76528.593513] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 02:39:14 juju-e4d256-prod-github-runner-207 kernel: [76528.594534] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 02:39:14 juju-e4d256-prod-github-runner-207 kernel: [76528.595550] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 02:39:14 juju-e4d256-prod-github-runner-207 kernel: [76528.596593] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 02:39:14 juju-e4d256-prod-github-runner-207 kernel: [76528.597540] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 02:39:14 juju-e4d256-prod-github-runner-207 kernel: [76528.598522] handle_exit+0x98/0x230 [kvm_amd] Aug 23 02:39:14 juju-e4d256-prod-github-runner-207 kernel: [76528.599450] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 02:39:14 juju-e4d256-prod-github-runner-207 kernel: [76528.600369] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 02:39:14 juju-e4d256-prod-github-runner-207 kernel: [76528.601297] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 02:39:14 juju-e4d256-prod-github-runner-207 kernel: [76528.602197] vcpu_run+0x62/0x2c0 [kvm] Aug 23 02:39:14 juju-e4d256-prod-github-runner-207 kernel: [76528.603019] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 02:39:14 juju-e4d256-prod-github-runner-207 kernel: [76528.603841] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 02:39:14 juju-e4d256-prod-github-runner-207 kernel: [76528.604713] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 02:39:14 juju-e4d256-prod-github-runner-207 kernel: [76528.605510] ? __seccomp_filter+0x4a/0x4a0 Aug 23 02:39:14 juju-e4d256-prod-github-runner-207 kernel: [76528.606256] ? __fget_files+0x86/0xc0 Aug 23 02:39:14 juju-e4d256-prod-github-runner-207 kernel: [76528.606958] __x64_sys_ioctl+0x95/0xd0 Aug 23 02:39:14 juju-e4d256-prod-github-runner-207 kernel: [76528.607649] do_syscall_64+0x5c/0xc0 Aug 23 02:39:14 juju-e4d256-prod-github-runner-207 kernel: [76528.608334] ? do_futex+0x162/0x1f0 Aug 23 02:39:14 juju-e4d256-prod-github-runner-207 kernel: [76528.609072] ? __x64_sys_futex+0x78/0x1e0 Aug 23 02:39:14 juju-e4d256-prod-github-runner-207 kernel: [76528.609785] ? __secure_computing+0xa9/0x120 Aug 23 02:39:14 juju-e4d256-prod-github-runner-207 kernel: [76528.610478] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 02:39:14 juju-e4d256-prod-github-runner-207 kernel: [76528.611237] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:39:14 juju-e4d256-prod-github-runner-207 kernel: [76528.611984] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:39:14 juju-e4d256-prod-github-runner-207 kernel: [76528.612722] ? do_syscall_64+0x69/0xc0 Aug 23 02:39:14 juju-e4d256-prod-github-runner-207 kernel: [76528.613367] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:39:14 juju-e4d256-prod-github-runner-207 kernel: [76528.614079] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:39:14 juju-e4d256-prod-github-runner-207 kernel: [76528.614774] ? do_syscall_64+0x69/0xc0 Aug 23 02:39:14 juju-e4d256-prod-github-runner-207 kernel: [76528.615397] ? do_syscall_64+0x69/0xc0 Aug 23 02:39:14 juju-e4d256-prod-github-runner-207 kernel: [76528.616029] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 02:39:14 juju-e4d256-prod-github-runner-207 kernel: [76528.616733] RIP: 0033:0x7faa5d0edaff Aug 23 02:39:14 juju-e4d256-prod-github-runner-207 kernel: [76528.617359] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 02:39:14 juju-e4d256-prod-github-runner-207 kernel: [76528.619345] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 02:39:14 juju-e4d256-prod-github-runner-207 kernel: [76528.620270] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 02:39:14 juju-e4d256-prod-github-runner-207 kernel: [76528.621165] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 02:39:14 juju-e4d256-prod-github-runner-207 kernel: [76528.622052] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 02:39:14 juju-e4d256-prod-github-runner-207 kernel: [76528.622939] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 02:39:14 juju-e4d256-prod-github-runner-207 kernel: [76528.623831] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 02:39:14 juju-e4d256-prod-github-runner-207 kernel: [76528.624734] Aug 23 02:39:42 juju-e4d256-prod-github-runner-207 kernel: [76556.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 71190s! [qemu-system-x86:6715] Aug 23 02:39:42 juju-e4d256-prod-github-runner-207 kernel: [76556.543710] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 02:39:42 juju-e4d256-prod-github-runner-207 kernel: [76556.543972] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 02:39:42 juju-e4d256-prod-github-runner-207 kernel: [76556.556050] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 02:39:42 juju-e4d256-prod-github-runner-207 kernel: [76556.557314] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 02:39:42 juju-e4d256-prod-github-runner-207 kernel: [76556.558535] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:39:42 juju-e4d256-prod-github-runner-207 kernel: [76556.559595] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 02:39:42 juju-e4d256-prod-github-runner-207 kernel: [76556.562156] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 02:39:42 juju-e4d256-prod-github-runner-207 kernel: [76556.563196] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 02:39:42 juju-e4d256-prod-github-runner-207 kernel: [76556.564408] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 02:39:42 juju-e4d256-prod-github-runner-207 kernel: [76556.565568] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 02:39:42 juju-e4d256-prod-github-runner-207 kernel: [76556.566728] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 02:39:42 juju-e4d256-prod-github-runner-207 kernel: [76556.567908] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 02:39:42 juju-e4d256-prod-github-runner-207 kernel: [76556.569076] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 02:39:42 juju-e4d256-prod-github-runner-207 kernel: [76556.570306] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 02:39:42 juju-e4d256-prod-github-runner-207 kernel: [76556.571405] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 02:39:42 juju-e4d256-prod-github-runner-207 kernel: [76556.572623] Call Trace: Aug 23 02:39:42 juju-e4d256-prod-github-runner-207 kernel: [76556.573535] Aug 23 02:39:42 juju-e4d256-prod-github-runner-207 kernel: [76556.574430] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:39:42 juju-e4d256-prod-github-runner-207 kernel: [76556.575457] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:39:42 juju-e4d256-prod-github-runner-207 kernel: [76556.576485] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:39:42 juju-e4d256-prod-github-runner-207 kernel: [76556.577571] ? show_regs.part.0+0x23/0x29 Aug 23 02:39:42 juju-e4d256-prod-github-runner-207 kernel: [76556.578565] ? show_regs.cold+0x8/0xd Aug 23 02:39:42 juju-e4d256-prod-github-runner-207 kernel: [76556.579534] ? watchdog_timer_fn+0x1be/0x220 Aug 23 02:39:42 juju-e4d256-prod-github-runner-207 kernel: [76556.580549] ? lockup_detector_update_enable+0x60/0x60 Aug 23 02:39:42 juju-e4d256-prod-github-runner-207 kernel: [76556.581613] ? __hrtimer_run_queues+0x107/0x230 Aug 23 02:39:42 juju-e4d256-prod-github-runner-207 kernel: [76556.582638] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 02:39:42 juju-e4d256-prod-github-runner-207 kernel: [76556.583658] ? hrtimer_interrupt+0x101/0x220 Aug 23 02:39:42 juju-e4d256-prod-github-runner-207 kernel: [76556.584679] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 02:39:42 juju-e4d256-prod-github-runner-207 kernel: [76556.585745] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 02:39:42 juju-e4d256-prod-github-runner-207 kernel: [76556.586787] Aug 23 02:39:42 juju-e4d256-prod-github-runner-207 kernel: [76556.587643] Aug 23 02:39:42 juju-e4d256-prod-github-runner-207 kernel: [76556.588494] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 02:39:42 juju-e4d256-prod-github-runner-207 kernel: [76556.589523] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:39:42 juju-e4d256-prod-github-runner-207 kernel: [76556.590562] ? _raw_spin_lock+0x22/0x30 Aug 23 02:39:42 juju-e4d256-prod-github-runner-207 kernel: [76556.591503] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:39:42 juju-e4d256-prod-github-runner-207 kernel: [76556.592526] direct_page_fault+0x206/0x310 [kvm] Aug 23 02:39:42 juju-e4d256-prod-github-runner-207 kernel: [76556.593555] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 02:39:42 juju-e4d256-prod-github-runner-207 kernel: [76556.594560] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 02:39:42 juju-e4d256-prod-github-runner-207 kernel: [76556.595556] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 02:39:42 juju-e4d256-prod-github-runner-207 kernel: [76556.596552] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 02:39:42 juju-e4d256-prod-github-runner-207 kernel: [76556.597495] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 02:39:42 juju-e4d256-prod-github-runner-207 kernel: [76556.598471] handle_exit+0x98/0x230 [kvm_amd] Aug 23 02:39:42 juju-e4d256-prod-github-runner-207 kernel: [76556.599359] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 02:39:42 juju-e4d256-prod-github-runner-207 kernel: [76556.600285] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 02:39:42 juju-e4d256-prod-github-runner-207 kernel: [76556.601211] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 02:39:42 juju-e4d256-prod-github-runner-207 kernel: [76556.602112] vcpu_run+0x62/0x2c0 [kvm] Aug 23 02:39:42 juju-e4d256-prod-github-runner-207 kernel: [76556.602924] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 02:39:42 juju-e4d256-prod-github-runner-207 kernel: [76556.603744] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 02:39:42 juju-e4d256-prod-github-runner-207 kernel: [76556.604600] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 02:39:42 juju-e4d256-prod-github-runner-207 kernel: [76556.605394] ? __seccomp_filter+0x4a/0x4a0 Aug 23 02:39:42 juju-e4d256-prod-github-runner-207 kernel: [76556.606139] ? __fget_files+0x86/0xc0 Aug 23 02:39:42 juju-e4d256-prod-github-runner-207 kernel: [76556.606839] __x64_sys_ioctl+0x95/0xd0 Aug 23 02:39:42 juju-e4d256-prod-github-runner-207 kernel: [76556.607529] do_syscall_64+0x5c/0xc0 Aug 23 02:39:42 juju-e4d256-prod-github-runner-207 kernel: [76556.608204] ? do_futex+0x162/0x1f0 Aug 23 02:39:42 juju-e4d256-prod-github-runner-207 kernel: [76556.608851] ? __x64_sys_futex+0x78/0x1e0 Aug 23 02:39:42 juju-e4d256-prod-github-runner-207 kernel: [76556.609522] ? __secure_computing+0xa9/0x120 Aug 23 02:39:42 juju-e4d256-prod-github-runner-207 kernel: [76556.610209] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 02:39:42 juju-e4d256-prod-github-runner-207 kernel: [76556.610965] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:39:42 juju-e4d256-prod-github-runner-207 kernel: [76556.611685] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:39:42 juju-e4d256-prod-github-runner-207 kernel: [76556.612412] ? do_syscall_64+0x69/0xc0 Aug 23 02:39:42 juju-e4d256-prod-github-runner-207 kernel: [76556.613059] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:39:42 juju-e4d256-prod-github-runner-207 kernel: [76556.613762] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:39:42 juju-e4d256-prod-github-runner-207 kernel: [76556.614453] ? do_syscall_64+0x69/0xc0 Aug 23 02:39:42 juju-e4d256-prod-github-runner-207 kernel: [76556.615074] ? do_syscall_64+0x69/0xc0 Aug 23 02:39:42 juju-e4d256-prod-github-runner-207 kernel: [76556.615710] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 02:39:42 juju-e4d256-prod-github-runner-207 kernel: [76556.616418] RIP: 0033:0x7faa5d0edaff Aug 23 02:39:42 juju-e4d256-prod-github-runner-207 kernel: [76556.617053] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 02:39:42 juju-e4d256-prod-github-runner-207 kernel: [76556.619036] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 02:39:42 juju-e4d256-prod-github-runner-207 kernel: [76556.619956] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 02:39:42 juju-e4d256-prod-github-runner-207 kernel: [76556.620844] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 02:39:42 juju-e4d256-prod-github-runner-207 kernel: [76556.621791] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 02:39:42 juju-e4d256-prod-github-runner-207 kernel: [76556.622681] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 02:39:42 juju-e4d256-prod-github-runner-207 kernel: [76556.623572] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 02:39:42 juju-e4d256-prod-github-runner-207 kernel: [76556.624479] Aug 23 02:40:10 juju-e4d256-prod-github-runner-207 kernel: [76584.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 71216s! [qemu-system-x86:6715] Aug 23 02:40:10 juju-e4d256-prod-github-runner-207 kernel: [76584.543105] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 02:40:10 juju-e4d256-prod-github-runner-207 kernel: [76584.543173] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 02:40:10 juju-e4d256-prod-github-runner-207 kernel: [76584.555269] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 02:40:10 juju-e4d256-prod-github-runner-207 kernel: [76584.556734] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 02:40:10 juju-e4d256-prod-github-runner-207 kernel: [76584.557947] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:40:10 juju-e4d256-prod-github-runner-207 kernel: [76584.559003] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 02:40:10 juju-e4d256-prod-github-runner-207 kernel: [76584.561565] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 02:40:10 juju-e4d256-prod-github-runner-207 kernel: [76584.562609] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 02:40:10 juju-e4d256-prod-github-runner-207 kernel: [76584.563786] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 02:40:10 juju-e4d256-prod-github-runner-207 kernel: [76584.564955] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 02:40:10 juju-e4d256-prod-github-runner-207 kernel: [76584.566118] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 02:40:10 juju-e4d256-prod-github-runner-207 kernel: [76584.567282] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 02:40:10 juju-e4d256-prod-github-runner-207 kernel: [76584.568472] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 02:40:10 juju-e4d256-prod-github-runner-207 kernel: [76584.569702] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 02:40:10 juju-e4d256-prod-github-runner-207 kernel: [76584.570802] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 02:40:10 juju-e4d256-prod-github-runner-207 kernel: [76584.572011] Call Trace: Aug 23 02:40:10 juju-e4d256-prod-github-runner-207 kernel: [76584.572923] Aug 23 02:40:10 juju-e4d256-prod-github-runner-207 kernel: [76584.573805] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:40:10 juju-e4d256-prod-github-runner-207 kernel: [76584.574836] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:40:10 juju-e4d256-prod-github-runner-207 kernel: [76584.575880] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:40:10 juju-e4d256-prod-github-runner-207 kernel: [76584.576966] ? show_regs.part.0+0x23/0x29 Aug 23 02:40:10 juju-e4d256-prod-github-runner-207 kernel: [76584.577961] ? show_regs.cold+0x8/0xd Aug 23 02:40:10 juju-e4d256-prod-github-runner-207 kernel: [76584.578932] ? watchdog_timer_fn+0x1be/0x220 Aug 23 02:40:10 juju-e4d256-prod-github-runner-207 kernel: [76584.579971] ? lockup_detector_update_enable+0x60/0x60 Aug 23 02:40:10 juju-e4d256-prod-github-runner-207 kernel: [76584.581032] ? __hrtimer_run_queues+0x107/0x230 Aug 23 02:40:10 juju-e4d256-prod-github-runner-207 kernel: [76584.582065] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 02:40:10 juju-e4d256-prod-github-runner-207 kernel: [76584.583085] ? hrtimer_interrupt+0x101/0x220 Aug 23 02:40:10 juju-e4d256-prod-github-runner-207 kernel: [76584.584113] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 02:40:10 juju-e4d256-prod-github-runner-207 kernel: [76584.585182] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 02:40:10 juju-e4d256-prod-github-runner-207 kernel: [76584.586225] Aug 23 02:40:10 juju-e4d256-prod-github-runner-207 kernel: [76584.587078] Aug 23 02:40:10 juju-e4d256-prod-github-runner-207 kernel: [76584.587993] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 02:40:10 juju-e4d256-prod-github-runner-207 kernel: [76584.589029] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:40:10 juju-e4d256-prod-github-runner-207 kernel: [76584.590066] ? _raw_spin_lock+0x22/0x30 Aug 23 02:40:10 juju-e4d256-prod-github-runner-207 kernel: [76584.591008] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:40:10 juju-e4d256-prod-github-runner-207 kernel: [76584.592047] direct_page_fault+0x206/0x310 [kvm] Aug 23 02:40:10 juju-e4d256-prod-github-runner-207 kernel: [76584.593079] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 02:40:10 juju-e4d256-prod-github-runner-207 kernel: [76584.594097] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 02:40:10 juju-e4d256-prod-github-runner-207 kernel: [76584.595106] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 02:40:10 juju-e4d256-prod-github-runner-207 kernel: [76584.596094] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 02:40:10 juju-e4d256-prod-github-runner-207 kernel: [76584.597049] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 02:40:10 juju-e4d256-prod-github-runner-207 kernel: [76584.598039] handle_exit+0x98/0x230 [kvm_amd] Aug 23 02:40:10 juju-e4d256-prod-github-runner-207 kernel: [76584.598927] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 02:40:10 juju-e4d256-prod-github-runner-207 kernel: [76584.599890] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 02:40:10 juju-e4d256-prod-github-runner-207 kernel: [76584.600823] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 02:40:10 juju-e4d256-prod-github-runner-207 kernel: [76584.601741] vcpu_run+0x62/0x2c0 [kvm] Aug 23 02:40:10 juju-e4d256-prod-github-runner-207 kernel: [76584.602562] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 02:40:10 juju-e4d256-prod-github-runner-207 kernel: [76584.603403] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 02:40:10 juju-e4d256-prod-github-runner-207 kernel: [76584.604266] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 02:40:10 juju-e4d256-prod-github-runner-207 kernel: [76584.605122] ? __seccomp_filter+0x4a/0x4a0 Aug 23 02:40:10 juju-e4d256-prod-github-runner-207 kernel: [76584.605879] ? __fget_files+0x86/0xc0 Aug 23 02:40:10 juju-e4d256-prod-github-runner-207 kernel: [76584.606595] __x64_sys_ioctl+0x95/0xd0 Aug 23 02:40:10 juju-e4d256-prod-github-runner-207 kernel: [76584.607307] do_syscall_64+0x5c/0xc0 Aug 23 02:40:10 juju-e4d256-prod-github-runner-207 kernel: [76584.607994] ? do_futex+0x162/0x1f0 Aug 23 02:40:10 juju-e4d256-prod-github-runner-207 kernel: [76584.608658] ? __x64_sys_futex+0x78/0x1e0 Aug 23 02:40:10 juju-e4d256-prod-github-runner-207 kernel: [76584.609344] ? __secure_computing+0xa9/0x120 Aug 23 02:40:10 juju-e4d256-prod-github-runner-207 kernel: [76584.610032] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 02:40:10 juju-e4d256-prod-github-runner-207 kernel: [76584.610790] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:40:10 juju-e4d256-prod-github-runner-207 kernel: [76584.611546] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:40:10 juju-e4d256-prod-github-runner-207 kernel: [76584.612268] ? do_syscall_64+0x69/0xc0 Aug 23 02:40:10 juju-e4d256-prod-github-runner-207 kernel: [76584.612911] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:40:10 juju-e4d256-prod-github-runner-207 kernel: [76584.613625] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:40:10 juju-e4d256-prod-github-runner-207 kernel: [76584.614331] ? do_syscall_64+0x69/0xc0 Aug 23 02:40:10 juju-e4d256-prod-github-runner-207 kernel: [76584.614956] ? do_syscall_64+0x69/0xc0 Aug 23 02:40:10 juju-e4d256-prod-github-runner-207 kernel: [76584.615610] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 02:40:10 juju-e4d256-prod-github-runner-207 kernel: [76584.616315] RIP: 0033:0x7faa5d0edaff Aug 23 02:40:10 juju-e4d256-prod-github-runner-207 kernel: [76584.616940] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 02:40:10 juju-e4d256-prod-github-runner-207 kernel: [76584.618942] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 02:40:10 juju-e4d256-prod-github-runner-207 kernel: [76584.619872] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 02:40:10 juju-e4d256-prod-github-runner-207 kernel: [76584.620764] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 02:40:10 juju-e4d256-prod-github-runner-207 kernel: [76584.621658] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 02:40:10 juju-e4d256-prod-github-runner-207 kernel: [76584.622545] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 02:40:10 juju-e4d256-prod-github-runner-207 kernel: [76584.623453] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 02:40:10 juju-e4d256-prod-github-runner-207 kernel: [76584.624362] Aug 23 02:40:38 juju-e4d256-prod-github-runner-207 kernel: [76612.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 71242s! [qemu-system-x86:6715] Aug 23 02:40:38 juju-e4d256-prod-github-runner-207 kernel: [76612.543124] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 02:40:38 juju-e4d256-prod-github-runner-207 kernel: [76612.543191] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 02:40:38 juju-e4d256-prod-github-runner-207 kernel: [76612.555403] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 02:40:38 juju-e4d256-prod-github-runner-207 kernel: [76612.556667] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 02:40:38 juju-e4d256-prod-github-runner-207 kernel: [76612.557894] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:40:38 juju-e4d256-prod-github-runner-207 kernel: [76612.558950] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 02:40:38 juju-e4d256-prod-github-runner-207 kernel: [76612.561512] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 02:40:38 juju-e4d256-prod-github-runner-207 kernel: [76612.562555] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 02:40:38 juju-e4d256-prod-github-runner-207 kernel: [76612.563730] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 02:40:38 juju-e4d256-prod-github-runner-207 kernel: [76612.564894] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 02:40:38 juju-e4d256-prod-github-runner-207 kernel: [76612.566057] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 02:40:38 juju-e4d256-prod-github-runner-207 kernel: [76612.567228] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 02:40:38 juju-e4d256-prod-github-runner-207 kernel: [76612.568398] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 02:40:38 juju-e4d256-prod-github-runner-207 kernel: [76612.569635] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 02:40:38 juju-e4d256-prod-github-runner-207 kernel: [76612.570730] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 02:40:38 juju-e4d256-prod-github-runner-207 kernel: [76612.571932] Call Trace: Aug 23 02:40:38 juju-e4d256-prod-github-runner-207 kernel: [76612.572849] Aug 23 02:40:38 juju-e4d256-prod-github-runner-207 kernel: [76612.573737] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:40:38 juju-e4d256-prod-github-runner-207 kernel: [76612.574801] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:40:38 juju-e4d256-prod-github-runner-207 kernel: [76612.575864] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:40:38 juju-e4d256-prod-github-runner-207 kernel: [76612.576935] ? show_regs.part.0+0x23/0x29 Aug 23 02:40:38 juju-e4d256-prod-github-runner-207 kernel: [76612.577931] ? show_regs.cold+0x8/0xd Aug 23 02:40:38 juju-e4d256-prod-github-runner-207 kernel: [76612.578906] ? watchdog_timer_fn+0x1be/0x220 Aug 23 02:40:38 juju-e4d256-prod-github-runner-207 kernel: [76612.579930] ? lockup_detector_update_enable+0x60/0x60 Aug 23 02:40:38 juju-e4d256-prod-github-runner-207 kernel: [76612.580991] ? __hrtimer_run_queues+0x107/0x230 Aug 23 02:40:38 juju-e4d256-prod-github-runner-207 kernel: [76612.582053] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 02:40:38 juju-e4d256-prod-github-runner-207 kernel: [76612.583089] ? hrtimer_interrupt+0x101/0x220 Aug 23 02:40:38 juju-e4d256-prod-github-runner-207 kernel: [76612.584140] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 02:40:38 juju-e4d256-prod-github-runner-207 kernel: [76612.585207] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 02:40:38 juju-e4d256-prod-github-runner-207 kernel: [76612.586251] Aug 23 02:40:38 juju-e4d256-prod-github-runner-207 kernel: [76612.587125] Aug 23 02:40:38 juju-e4d256-prod-github-runner-207 kernel: [76612.587969] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 02:40:38 juju-e4d256-prod-github-runner-207 kernel: [76612.589000] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:40:38 juju-e4d256-prod-github-runner-207 kernel: [76612.590041] ? _raw_spin_lock+0x22/0x30 Aug 23 02:40:38 juju-e4d256-prod-github-runner-207 kernel: [76612.590984] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:40:38 juju-e4d256-prod-github-runner-207 kernel: [76612.592040] direct_page_fault+0x206/0x310 [kvm] Aug 23 02:40:38 juju-e4d256-prod-github-runner-207 kernel: [76612.593063] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 02:40:38 juju-e4d256-prod-github-runner-207 kernel: [76612.594068] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 02:40:38 juju-e4d256-prod-github-runner-207 kernel: [76612.595117] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 02:40:38 juju-e4d256-prod-github-runner-207 kernel: [76612.596095] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 02:40:38 juju-e4d256-prod-github-runner-207 kernel: [76612.597044] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 02:40:38 juju-e4d256-prod-github-runner-207 kernel: [76612.598027] handle_exit+0x98/0x230 [kvm_amd] Aug 23 02:40:38 juju-e4d256-prod-github-runner-207 kernel: [76612.598917] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 02:40:38 juju-e4d256-prod-github-runner-207 kernel: [76612.599846] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 02:40:38 juju-e4d256-prod-github-runner-207 kernel: [76612.600772] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 02:40:38 juju-e4d256-prod-github-runner-207 kernel: [76612.601671] vcpu_run+0x62/0x2c0 [kvm] Aug 23 02:40:38 juju-e4d256-prod-github-runner-207 kernel: [76612.602480] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 02:40:38 juju-e4d256-prod-github-runner-207 kernel: [76612.603300] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 02:40:38 juju-e4d256-prod-github-runner-207 kernel: [76612.604152] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 02:40:38 juju-e4d256-prod-github-runner-207 kernel: [76612.604953] ? __seccomp_filter+0x4a/0x4a0 Aug 23 02:40:38 juju-e4d256-prod-github-runner-207 kernel: [76612.605722] ? __fget_files+0x86/0xc0 Aug 23 02:40:38 juju-e4d256-prod-github-runner-207 kernel: [76612.606422] __x64_sys_ioctl+0x95/0xd0 Aug 23 02:40:38 juju-e4d256-prod-github-runner-207 kernel: [76612.607125] do_syscall_64+0x5c/0xc0 Aug 23 02:40:38 juju-e4d256-prod-github-runner-207 kernel: [76612.607815] ? do_futex+0x162/0x1f0 Aug 23 02:40:38 juju-e4d256-prod-github-runner-207 kernel: [76612.608461] ? __x64_sys_futex+0x78/0x1e0 Aug 23 02:40:38 juju-e4d256-prod-github-runner-207 kernel: [76612.609131] ? __secure_computing+0xa9/0x120 Aug 23 02:40:38 juju-e4d256-prod-github-runner-207 kernel: [76612.609819] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 02:40:38 juju-e4d256-prod-github-runner-207 kernel: [76612.610579] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:40:38 juju-e4d256-prod-github-runner-207 kernel: [76612.611310] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:40:38 juju-e4d256-prod-github-runner-207 kernel: [76612.612025] ? do_syscall_64+0x69/0xc0 Aug 23 02:40:38 juju-e4d256-prod-github-runner-207 kernel: [76612.612672] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:40:38 juju-e4d256-prod-github-runner-207 kernel: [76612.613371] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:40:38 juju-e4d256-prod-github-runner-207 kernel: [76612.614069] ? do_syscall_64+0x69/0xc0 Aug 23 02:40:38 juju-e4d256-prod-github-runner-207 kernel: [76612.614690] ? do_syscall_64+0x69/0xc0 Aug 23 02:40:38 juju-e4d256-prod-github-runner-207 kernel: [76612.615325] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 02:40:38 juju-e4d256-prod-github-runner-207 kernel: [76612.616027] RIP: 0033:0x7faa5d0edaff Aug 23 02:40:38 juju-e4d256-prod-github-runner-207 kernel: [76612.616653] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 02:40:38 juju-e4d256-prod-github-runner-207 kernel: [76612.618632] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 02:40:38 juju-e4d256-prod-github-runner-207 kernel: [76612.619559] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 02:40:38 juju-e4d256-prod-github-runner-207 kernel: [76612.620446] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 02:40:38 juju-e4d256-prod-github-runner-207 kernel: [76612.621331] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 02:40:38 juju-e4d256-prod-github-runner-207 kernel: [76612.622214] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 02:40:38 juju-e4d256-prod-github-runner-207 kernel: [76612.623113] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 02:40:38 juju-e4d256-prod-github-runner-207 kernel: [76612.624007] Aug 23 02:41:06 juju-e4d256-prod-github-runner-207 kernel: [76640.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 71269s! [qemu-system-x86:6715] Aug 23 02:41:06 juju-e4d256-prod-github-runner-207 kernel: [76640.543761] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 02:41:06 juju-e4d256-prod-github-runner-207 kernel: [76640.544023] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 02:41:06 juju-e4d256-prod-github-runner-207 kernel: [76640.556383] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 02:41:06 juju-e4d256-prod-github-runner-207 kernel: [76640.557664] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 02:41:06 juju-e4d256-prod-github-runner-207 kernel: [76640.558893] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:41:06 juju-e4d256-prod-github-runner-207 kernel: [76640.559958] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 02:41:06 juju-e4d256-prod-github-runner-207 kernel: [76640.562528] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 02:41:06 juju-e4d256-prod-github-runner-207 kernel: [76640.563590] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 02:41:06 juju-e4d256-prod-github-runner-207 kernel: [76640.564757] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 02:41:06 juju-e4d256-prod-github-runner-207 kernel: [76640.565952] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 02:41:06 juju-e4d256-prod-github-runner-207 kernel: [76640.567119] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 02:41:06 juju-e4d256-prod-github-runner-207 kernel: [76640.568280] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 02:41:06 juju-e4d256-prod-github-runner-207 kernel: [76640.569448] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 02:41:06 juju-e4d256-prod-github-runner-207 kernel: [76640.570722] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 02:41:06 juju-e4d256-prod-github-runner-207 kernel: [76640.571830] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 02:41:06 juju-e4d256-prod-github-runner-207 kernel: [76640.573041] Call Trace: Aug 23 02:41:06 juju-e4d256-prod-github-runner-207 kernel: [76640.573955] Aug 23 02:41:06 juju-e4d256-prod-github-runner-207 kernel: [76640.574864] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:41:06 juju-e4d256-prod-github-runner-207 kernel: [76640.575900] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:41:06 juju-e4d256-prod-github-runner-207 kernel: [76640.576925] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:41:06 juju-e4d256-prod-github-runner-207 kernel: [76640.578018] ? show_regs.part.0+0x23/0x29 Aug 23 02:41:06 juju-e4d256-prod-github-runner-207 kernel: [76640.579027] ? show_regs.cold+0x8/0xd Aug 23 02:41:06 juju-e4d256-prod-github-runner-207 kernel: [76640.580031] ? watchdog_timer_fn+0x1be/0x220 Aug 23 02:41:06 juju-e4d256-prod-github-runner-207 kernel: [76640.581069] ? lockup_detector_update_enable+0x60/0x60 Aug 23 02:41:06 juju-e4d256-prod-github-runner-207 kernel: [76640.582138] ? __hrtimer_run_queues+0x107/0x230 Aug 23 02:41:06 juju-e4d256-prod-github-runner-207 kernel: [76640.583192] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 02:41:06 juju-e4d256-prod-github-runner-207 kernel: [76640.584221] ? hrtimer_interrupt+0x101/0x220 Aug 23 02:41:06 juju-e4d256-prod-github-runner-207 kernel: [76640.585249] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 02:41:06 juju-e4d256-prod-github-runner-207 kernel: [76640.586325] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 02:41:06 juju-e4d256-prod-github-runner-207 kernel: [76640.587416] Aug 23 02:41:06 juju-e4d256-prod-github-runner-207 kernel: [76640.588273] Aug 23 02:41:06 juju-e4d256-prod-github-runner-207 kernel: [76640.589110] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 02:41:06 juju-e4d256-prod-github-runner-207 kernel: [76640.590146] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:41:06 juju-e4d256-prod-github-runner-207 kernel: [76640.591195] ? _raw_spin_lock+0x22/0x30 Aug 23 02:41:06 juju-e4d256-prod-github-runner-207 kernel: [76640.592140] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:41:06 juju-e4d256-prod-github-runner-207 kernel: [76640.593173] direct_page_fault+0x206/0x310 [kvm] Aug 23 02:41:06 juju-e4d256-prod-github-runner-207 kernel: [76640.594210] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 02:41:06 juju-e4d256-prod-github-runner-207 kernel: [76640.595258] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 02:41:06 juju-e4d256-prod-github-runner-207 kernel: [76640.596301] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 02:41:06 juju-e4d256-prod-github-runner-207 kernel: [76640.597338] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 02:41:06 juju-e4d256-prod-github-runner-207 kernel: [76640.598283] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 02:41:06 juju-e4d256-prod-github-runner-207 kernel: [76640.599273] handle_exit+0x98/0x230 [kvm_amd] Aug 23 02:41:06 juju-e4d256-prod-github-runner-207 kernel: [76640.600167] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 02:41:06 juju-e4d256-prod-github-runner-207 kernel: [76640.601083] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 02:41:06 juju-e4d256-prod-github-runner-207 kernel: [76640.602013] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 02:41:06 juju-e4d256-prod-github-runner-207 kernel: [76640.602941] vcpu_run+0x62/0x2c0 [kvm] Aug 23 02:41:06 juju-e4d256-prod-github-runner-207 kernel: [76640.603757] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 02:41:06 juju-e4d256-prod-github-runner-207 kernel: [76640.604565] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 02:41:06 juju-e4d256-prod-github-runner-207 kernel: [76640.605428] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 02:41:06 juju-e4d256-prod-github-runner-207 kernel: [76640.606232] ? __seccomp_filter+0x4a/0x4a0 Aug 23 02:41:06 juju-e4d256-prod-github-runner-207 kernel: [76640.606986] ? __fget_files+0x86/0xc0 Aug 23 02:41:06 juju-e4d256-prod-github-runner-207 kernel: [76640.607695] __x64_sys_ioctl+0x95/0xd0 Aug 23 02:41:06 juju-e4d256-prod-github-runner-207 kernel: [76640.608393] do_syscall_64+0x5c/0xc0 Aug 23 02:41:06 juju-e4d256-prod-github-runner-207 kernel: [76640.609058] ? do_futex+0x162/0x1f0 Aug 23 02:41:06 juju-e4d256-prod-github-runner-207 kernel: [76640.609708] ? __x64_sys_futex+0x78/0x1e0 Aug 23 02:41:06 juju-e4d256-prod-github-runner-207 kernel: [76640.610383] ? __secure_computing+0xa9/0x120 Aug 23 02:41:06 juju-e4d256-prod-github-runner-207 kernel: [76640.611108] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 02:41:06 juju-e4d256-prod-github-runner-207 kernel: [76640.611874] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:41:06 juju-e4d256-prod-github-runner-207 kernel: [76640.612596] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:41:06 juju-e4d256-prod-github-runner-207 kernel: [76640.613365] ? do_syscall_64+0x69/0xc0 Aug 23 02:41:06 juju-e4d256-prod-github-runner-207 kernel: [76640.614364] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:41:06 juju-e4d256-prod-github-runner-207 kernel: [76640.615100] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:41:06 juju-e4d256-prod-github-runner-207 kernel: [76640.615801] ? do_syscall_64+0x69/0xc0 Aug 23 02:41:06 juju-e4d256-prod-github-runner-207 kernel: [76640.616437] ? do_syscall_64+0x69/0xc0 Aug 23 02:41:06 juju-e4d256-prod-github-runner-207 kernel: [76640.617075] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 02:41:06 juju-e4d256-prod-github-runner-207 kernel: [76640.617783] RIP: 0033:0x7faa5d0edaff Aug 23 02:41:06 juju-e4d256-prod-github-runner-207 kernel: [76640.618434] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 02:41:06 juju-e4d256-prod-github-runner-207 kernel: [76640.620433] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 02:41:06 juju-e4d256-prod-github-runner-207 kernel: [76640.621351] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 02:41:06 juju-e4d256-prod-github-runner-207 kernel: [76640.622243] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 02:41:06 juju-e4d256-prod-github-runner-207 kernel: [76640.623177] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 02:41:06 juju-e4d256-prod-github-runner-207 kernel: [76640.624096] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 02:41:06 juju-e4d256-prod-github-runner-207 kernel: [76640.624992] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 02:41:06 juju-e4d256-prod-github-runner-207 kernel: [76640.625888] Aug 23 02:41:34 juju-e4d256-prod-github-runner-207 kernel: [76668.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 71295s! [qemu-system-x86:6715] Aug 23 02:41:34 juju-e4d256-prod-github-runner-207 kernel: [76668.543331] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 02:41:34 juju-e4d256-prod-github-runner-207 kernel: [76668.543398] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 02:41:34 juju-e4d256-prod-github-runner-207 kernel: [76668.555860] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 02:41:34 juju-e4d256-prod-github-runner-207 kernel: [76668.557230] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 02:41:34 juju-e4d256-prod-github-runner-207 kernel: [76668.558532] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:41:34 juju-e4d256-prod-github-runner-207 kernel: [76668.559591] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 02:41:34 juju-e4d256-prod-github-runner-207 kernel: [76668.562171] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 02:41:34 juju-e4d256-prod-github-runner-207 kernel: [76668.563231] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 02:41:34 juju-e4d256-prod-github-runner-207 kernel: [76668.564417] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 02:41:34 juju-e4d256-prod-github-runner-207 kernel: [76668.565600] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 02:41:34 juju-e4d256-prod-github-runner-207 kernel: [76668.566806] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 02:41:34 juju-e4d256-prod-github-runner-207 kernel: [76668.567962] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 02:41:34 juju-e4d256-prod-github-runner-207 kernel: [76668.569125] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 02:41:34 juju-e4d256-prod-github-runner-207 kernel: [76668.570353] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 02:41:34 juju-e4d256-prod-github-runner-207 kernel: [76668.571469] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 02:41:34 juju-e4d256-prod-github-runner-207 kernel: [76668.572659] Call Trace: Aug 23 02:41:34 juju-e4d256-prod-github-runner-207 kernel: [76668.573579] Aug 23 02:41:34 juju-e4d256-prod-github-runner-207 kernel: [76668.574486] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:41:34 juju-e4d256-prod-github-runner-207 kernel: [76668.575549] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:41:34 juju-e4d256-prod-github-runner-207 kernel: [76668.576567] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:41:34 juju-e4d256-prod-github-runner-207 kernel: [76668.577644] ? show_regs.part.0+0x23/0x29 Aug 23 02:41:34 juju-e4d256-prod-github-runner-207 kernel: [76668.578684] ? show_regs.cold+0x8/0xd Aug 23 02:41:34 juju-e4d256-prod-github-runner-207 kernel: [76668.579693] ? watchdog_timer_fn+0x1be/0x220 Aug 23 02:41:34 juju-e4d256-prod-github-runner-207 kernel: [76668.580703] ? lockup_detector_update_enable+0x60/0x60 Aug 23 02:41:34 juju-e4d256-prod-github-runner-207 kernel: [76668.581768] ? __hrtimer_run_queues+0x107/0x230 Aug 23 02:41:34 juju-e4d256-prod-github-runner-207 kernel: [76668.582811] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 02:41:34 juju-e4d256-prod-github-runner-207 kernel: [76668.583833] ? hrtimer_interrupt+0x101/0x220 Aug 23 02:41:34 juju-e4d256-prod-github-runner-207 kernel: [76668.584845] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 02:41:34 juju-e4d256-prod-github-runner-207 kernel: [76668.585935] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 02:41:34 juju-e4d256-prod-github-runner-207 kernel: [76668.586999] Aug 23 02:41:34 juju-e4d256-prod-github-runner-207 kernel: [76668.587849] Aug 23 02:41:34 juju-e4d256-prod-github-runner-207 kernel: [76668.588688] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 02:41:34 juju-e4d256-prod-github-runner-207 kernel: [76668.589716] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:41:34 juju-e4d256-prod-github-runner-207 kernel: [76668.590760] ? _raw_spin_lock+0x22/0x30 Aug 23 02:41:34 juju-e4d256-prod-github-runner-207 kernel: [76668.591707] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:41:34 juju-e4d256-prod-github-runner-207 kernel: [76668.592718] direct_page_fault+0x206/0x310 [kvm] Aug 23 02:41:34 juju-e4d256-prod-github-runner-207 kernel: [76668.593741] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 02:41:34 juju-e4d256-prod-github-runner-207 kernel: [76668.594770] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 02:41:34 juju-e4d256-prod-github-runner-207 kernel: [76668.595767] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 02:41:34 juju-e4d256-prod-github-runner-207 kernel: [76668.596773] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 02:41:34 juju-e4d256-prod-github-runner-207 kernel: [76668.597734] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 02:41:34 juju-e4d256-prod-github-runner-207 kernel: [76668.598743] handle_exit+0x98/0x230 [kvm_amd] Aug 23 02:41:34 juju-e4d256-prod-github-runner-207 kernel: [76668.599663] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 02:41:34 juju-e4d256-prod-github-runner-207 kernel: [76668.600592] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 02:41:34 juju-e4d256-prod-github-runner-207 kernel: [76668.601541] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 02:41:34 juju-e4d256-prod-github-runner-207 kernel: [76668.602460] vcpu_run+0x62/0x2c0 [kvm] Aug 23 02:41:34 juju-e4d256-prod-github-runner-207 kernel: [76668.603282] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 02:41:34 juju-e4d256-prod-github-runner-207 kernel: [76668.604097] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 02:41:34 juju-e4d256-prod-github-runner-207 kernel: [76668.604947] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 02:41:34 juju-e4d256-prod-github-runner-207 kernel: [76668.605739] ? __seccomp_filter+0x4a/0x4a0 Aug 23 02:41:34 juju-e4d256-prod-github-runner-207 kernel: [76668.606503] ? __fget_files+0x86/0xc0 Aug 23 02:41:34 juju-e4d256-prod-github-runner-207 kernel: [76668.607204] __x64_sys_ioctl+0x95/0xd0 Aug 23 02:41:34 juju-e4d256-prod-github-runner-207 kernel: [76668.607892] do_syscall_64+0x5c/0xc0 Aug 23 02:41:34 juju-e4d256-prod-github-runner-207 kernel: [76668.608551] ? do_futex+0x162/0x1f0 Aug 23 02:41:34 juju-e4d256-prod-github-runner-207 kernel: [76668.609195] ? __x64_sys_futex+0x78/0x1e0 Aug 23 02:41:34 juju-e4d256-prod-github-runner-207 kernel: [76668.609864] ? __secure_computing+0xa9/0x120 Aug 23 02:41:34 juju-e4d256-prod-github-runner-207 kernel: [76668.610572] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 02:41:34 juju-e4d256-prod-github-runner-207 kernel: [76668.611330] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:41:34 juju-e4d256-prod-github-runner-207 kernel: [76668.612053] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:41:34 juju-e4d256-prod-github-runner-207 kernel: [76668.612767] ? do_syscall_64+0x69/0xc0 Aug 23 02:41:34 juju-e4d256-prod-github-runner-207 kernel: [76668.613408] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:41:34 juju-e4d256-prod-github-runner-207 kernel: [76668.614107] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:41:34 juju-e4d256-prod-github-runner-207 kernel: [76668.614811] ? do_syscall_64+0x69/0xc0 Aug 23 02:41:34 juju-e4d256-prod-github-runner-207 kernel: [76668.615464] ? do_syscall_64+0x69/0xc0 Aug 23 02:41:34 juju-e4d256-prod-github-runner-207 kernel: [76668.616093] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 02:41:34 juju-e4d256-prod-github-runner-207 kernel: [76668.616795] RIP: 0033:0x7faa5d0edaff Aug 23 02:41:34 juju-e4d256-prod-github-runner-207 kernel: [76668.617445] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 02:41:34 juju-e4d256-prod-github-runner-207 kernel: [76668.619446] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 02:41:34 juju-e4d256-prod-github-runner-207 kernel: [76668.620353] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 02:41:34 juju-e4d256-prod-github-runner-207 kernel: [76668.621244] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 02:41:34 juju-e4d256-prod-github-runner-207 kernel: [76668.622140] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 02:41:34 juju-e4d256-prod-github-runner-207 kernel: [76668.623041] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 02:41:34 juju-e4d256-prod-github-runner-207 kernel: [76668.623922] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 02:41:34 juju-e4d256-prod-github-runner-207 kernel: [76668.624831] Aug 23 02:41:48 juju-e4d256-prod-github-runner-207 kernel: [76682.300709] rcu: INFO: rcu_sched self-detected stall on CPU Aug 23 02:41:48 juju-e4d256-prod-github-runner-207 kernel: [76682.301730] rcu: 1-....: (19081171 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=9225207 Aug 23 02:41:48 juju-e4d256-prod-github-runner-207 kernel: [76682.302929] (t=19141275 jiffies g=23269 q=64588) Aug 23 02:41:48 juju-e4d256-prod-github-runner-207 kernel: [76682.303730] NMI backtrace for cpu 1 Aug 23 02:41:48 juju-e4d256-prod-github-runner-207 kernel: [76682.304445] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 02:41:48 juju-e4d256-prod-github-runner-207 kernel: [76682.305550] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 02:41:48 juju-e4d256-prod-github-runner-207 kernel: [76682.306628] Call Trace: Aug 23 02:41:48 juju-e4d256-prod-github-runner-207 kernel: [76682.307324] Aug 23 02:41:48 juju-e4d256-prod-github-runner-207 kernel: [76682.307986] show_stack+0x52/0x5c Aug 23 02:41:48 juju-e4d256-prod-github-runner-207 kernel: [76682.308739] dump_stack_lvl+0x4a/0x63 Aug 23 02:41:48 juju-e4d256-prod-github-runner-207 kernel: [76682.309503] dump_stack+0x10/0x16 Aug 23 02:41:48 juju-e4d256-prod-github-runner-207 kernel: [76682.310245] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 23 02:41:48 juju-e4d256-prod-github-runner-207 kernel: [76682.311114] ? lapic_can_unplug_cpu+0x90/0x90 Aug 23 02:41:48 juju-e4d256-prod-github-runner-207 kernel: [76682.311934] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 23 02:41:48 juju-e4d256-prod-github-runner-207 kernel: [76682.312781] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 23 02:41:48 juju-e4d256-prod-github-runner-207 kernel: [76682.313640] trigger_single_cpu_backtrace+0x44/0x4f Aug 23 02:41:48 juju-e4d256-prod-github-runner-207 kernel: [76682.314537] rcu_dump_cpu_stacks+0x102/0x149 Aug 23 02:41:48 juju-e4d256-prod-github-runner-207 kernel: [76682.315316] print_cpu_stall.cold+0x2f/0xe2 Aug 23 02:41:48 juju-e4d256-prod-github-runner-207 kernel: [76682.316095] ? timekeeping_update+0xf7/0x150 Aug 23 02:41:48 juju-e4d256-prod-github-runner-207 kernel: [76682.316876] check_cpu_stall+0x109/0x270 Aug 23 02:41:48 juju-e4d256-prod-github-runner-207 kernel: [76682.317639] rcu_sched_clock_irq+0x9a/0x250 Aug 23 02:41:48 juju-e4d256-prod-github-runner-207 kernel: [76682.318450] update_process_times+0x94/0xd0 Aug 23 02:41:48 juju-e4d256-prod-github-runner-207 kernel: [76682.319242] tick_sched_handle+0x29/0x70 Aug 23 02:41:48 juju-e4d256-prod-github-runner-207 kernel: [76682.319997] tick_sched_timer+0x8c/0xc0 Aug 23 02:41:48 juju-e4d256-prod-github-runner-207 kernel: [76682.320736] ? tick_nohz_handler+0xb0/0xb0 Aug 23 02:41:48 juju-e4d256-prod-github-runner-207 kernel: [76682.321496] __hrtimer_run_queues+0x107/0x230 Aug 23 02:41:48 juju-e4d256-prod-github-runner-207 kernel: [76682.322287] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 02:41:48 juju-e4d256-prod-github-runner-207 kernel: [76682.323076] hrtimer_interrupt+0x101/0x220 Aug 23 02:41:48 juju-e4d256-prod-github-runner-207 kernel: [76682.323851] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 02:41:48 juju-e4d256-prod-github-runner-207 kernel: [76682.324683] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 02:41:48 juju-e4d256-prod-github-runner-207 kernel: [76682.325489] Aug 23 02:41:48 juju-e4d256-prod-github-runner-207 kernel: [76682.326125] Aug 23 02:41:48 juju-e4d256-prod-github-runner-207 kernel: [76682.326772] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 02:41:48 juju-e4d256-prod-github-runner-207 kernel: [76682.327624] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:41:48 juju-e4d256-prod-github-runner-207 kernel: [76682.328524] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 02:41:48 juju-e4d256-prod-github-runner-207 kernel: [76682.330775] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 02:41:48 juju-e4d256-prod-github-runner-207 kernel: [76682.331651] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 02:41:48 juju-e4d256-prod-github-runner-207 kernel: [76682.332644] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 02:41:48 juju-e4d256-prod-github-runner-207 kernel: [76682.333629] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 02:41:48 juju-e4d256-prod-github-runner-207 kernel: [76682.334609] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 02:41:48 juju-e4d256-prod-github-runner-207 kernel: [76682.335569] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 02:41:48 juju-e4d256-prod-github-runner-207 kernel: [76682.336546] ? _raw_spin_lock+0x22/0x30 Aug 23 02:41:48 juju-e4d256-prod-github-runner-207 kernel: [76682.337313] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:41:48 juju-e4d256-prod-github-runner-207 kernel: [76682.338150] direct_page_fault+0x206/0x310 [kvm] Aug 23 02:41:48 juju-e4d256-prod-github-runner-207 kernel: [76682.339026] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 02:41:48 juju-e4d256-prod-github-runner-207 kernel: [76682.339893] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 02:41:48 juju-e4d256-prod-github-runner-207 kernel: [76682.340716] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 02:41:48 juju-e4d256-prod-github-runner-207 kernel: [76682.341568] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 02:41:48 juju-e4d256-prod-github-runner-207 kernel: [76682.342385] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 02:41:48 juju-e4d256-prod-github-runner-207 kernel: [76682.343209] handle_exit+0x98/0x230 [kvm_amd] Aug 23 02:41:48 juju-e4d256-prod-github-runner-207 kernel: [76682.343992] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 02:41:48 juju-e4d256-prod-github-runner-207 kernel: [76682.344793] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 02:41:48 juju-e4d256-prod-github-runner-207 kernel: [76682.345595] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 02:41:48 juju-e4d256-prod-github-runner-207 kernel: [76682.346394] vcpu_run+0x62/0x2c0 [kvm] Aug 23 02:41:48 juju-e4d256-prod-github-runner-207 kernel: [76682.347112] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 02:41:48 juju-e4d256-prod-github-runner-207 kernel: [76682.347846] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 02:41:48 juju-e4d256-prod-github-runner-207 kernel: [76682.348660] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 02:41:48 juju-e4d256-prod-github-runner-207 kernel: [76682.349428] ? __seccomp_filter+0x4a/0x4a0 Aug 23 02:41:48 juju-e4d256-prod-github-runner-207 kernel: [76682.350159] ? __fget_files+0x86/0xc0 Aug 23 02:41:48 juju-e4d256-prod-github-runner-207 kernel: [76682.350884] __x64_sys_ioctl+0x95/0xd0 Aug 23 02:41:48 juju-e4d256-prod-github-runner-207 kernel: [76682.351678] do_syscall_64+0x5c/0xc0 Aug 23 02:41:48 juju-e4d256-prod-github-runner-207 kernel: [76682.352408] ? do_futex+0x162/0x1f0 Aug 23 02:41:48 juju-e4d256-prod-github-runner-207 kernel: [76682.353094] ? __x64_sys_futex+0x78/0x1e0 Aug 23 02:41:48 juju-e4d256-prod-github-runner-207 kernel: [76682.353823] ? __secure_computing+0xa9/0x120 Aug 23 02:41:48 juju-e4d256-prod-github-runner-207 kernel: [76682.354566] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 02:41:48 juju-e4d256-prod-github-runner-207 kernel: [76682.355371] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:41:48 juju-e4d256-prod-github-runner-207 kernel: [76682.356141] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:41:48 juju-e4d256-prod-github-runner-207 kernel: [76682.356899] ? do_syscall_64+0x69/0xc0 Aug 23 02:41:48 juju-e4d256-prod-github-runner-207 kernel: [76682.357590] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:41:48 juju-e4d256-prod-github-runner-207 kernel: [76682.358361] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:41:48 juju-e4d256-prod-github-runner-207 kernel: [76682.359129] ? do_syscall_64+0x69/0xc0 Aug 23 02:41:48 juju-e4d256-prod-github-runner-207 kernel: [76682.359826] ? do_syscall_64+0x69/0xc0 Aug 23 02:41:48 juju-e4d256-prod-github-runner-207 kernel: [76682.360524] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 02:41:48 juju-e4d256-prod-github-runner-207 kernel: [76682.361320] RIP: 0033:0x7faa5d0edaff Aug 23 02:41:48 juju-e4d256-prod-github-runner-207 kernel: [76682.362020] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 02:41:48 juju-e4d256-prod-github-runner-207 kernel: [76682.364155] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 02:41:48 juju-e4d256-prod-github-runner-207 kernel: [76682.365135] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 02:41:48 juju-e4d256-prod-github-runner-207 kernel: [76682.366090] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 02:41:48 juju-e4d256-prod-github-runner-207 kernel: [76682.367048] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 02:41:48 juju-e4d256-prod-github-runner-207 kernel: [76682.367989] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 02:41:48 juju-e4d256-prod-github-runner-207 kernel: [76682.368917] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 02:41:48 juju-e4d256-prod-github-runner-207 kernel: [76682.369841] Aug 23 02:42:14 juju-e4d256-prod-github-runner-207 kernel: [76708.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 71332s! [qemu-system-x86:6715] Aug 23 02:42:14 juju-e4d256-prod-github-runner-207 kernel: [76708.543121] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 02:42:14 juju-e4d256-prod-github-runner-207 kernel: [76708.543189] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 02:42:14 juju-e4d256-prod-github-runner-207 kernel: [76708.555422] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 02:42:14 juju-e4d256-prod-github-runner-207 kernel: [76708.556684] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 02:42:14 juju-e4d256-prod-github-runner-207 kernel: [76708.557900] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:42:14 juju-e4d256-prod-github-runner-207 kernel: [76708.558968] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 02:42:14 juju-e4d256-prod-github-runner-207 kernel: [76708.561558] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 02:42:14 juju-e4d256-prod-github-runner-207 kernel: [76708.562632] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 02:42:14 juju-e4d256-prod-github-runner-207 kernel: [76708.563796] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 02:42:14 juju-e4d256-prod-github-runner-207 kernel: [76708.564954] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 02:42:14 juju-e4d256-prod-github-runner-207 kernel: [76708.566123] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 02:42:14 juju-e4d256-prod-github-runner-207 kernel: [76708.567284] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 02:42:14 juju-e4d256-prod-github-runner-207 kernel: [76708.568449] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 02:42:14 juju-e4d256-prod-github-runner-207 kernel: [76708.569681] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 02:42:14 juju-e4d256-prod-github-runner-207 kernel: [76708.570798] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 02:42:14 juju-e4d256-prod-github-runner-207 kernel: [76708.571990] Call Trace: Aug 23 02:42:14 juju-e4d256-prod-github-runner-207 kernel: [76708.572903] Aug 23 02:42:14 juju-e4d256-prod-github-runner-207 kernel: [76708.573786] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:42:14 juju-e4d256-prod-github-runner-207 kernel: [76708.574824] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:42:14 juju-e4d256-prod-github-runner-207 kernel: [76708.575845] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:42:14 juju-e4d256-prod-github-runner-207 kernel: [76708.576922] ? show_regs.part.0+0x23/0x29 Aug 23 02:42:14 juju-e4d256-prod-github-runner-207 kernel: [76708.577919] ? show_regs.cold+0x8/0xd Aug 23 02:42:14 juju-e4d256-prod-github-runner-207 kernel: [76708.578902] ? watchdog_timer_fn+0x1be/0x220 Aug 23 02:42:14 juju-e4d256-prod-github-runner-207 kernel: [76708.579909] ? lockup_detector_update_enable+0x60/0x60 Aug 23 02:42:14 juju-e4d256-prod-github-runner-207 kernel: [76708.580977] ? __hrtimer_run_queues+0x107/0x230 Aug 23 02:42:14 juju-e4d256-prod-github-runner-207 kernel: [76708.582014] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 02:42:14 juju-e4d256-prod-github-runner-207 kernel: [76708.583040] ? hrtimer_interrupt+0x101/0x220 Aug 23 02:42:14 juju-e4d256-prod-github-runner-207 kernel: [76708.584059] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 02:42:14 juju-e4d256-prod-github-runner-207 kernel: [76708.585126] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 02:42:14 juju-e4d256-prod-github-runner-207 kernel: [76708.586181] Aug 23 02:42:14 juju-e4d256-prod-github-runner-207 kernel: [76708.587040] Aug 23 02:42:14 juju-e4d256-prod-github-runner-207 kernel: [76708.587881] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 02:42:14 juju-e4d256-prod-github-runner-207 kernel: [76708.588913] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:42:14 juju-e4d256-prod-github-runner-207 kernel: [76708.589977] ? _raw_spin_lock+0x22/0x30 Aug 23 02:42:14 juju-e4d256-prod-github-runner-207 kernel: [76708.590921] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:42:14 juju-e4d256-prod-github-runner-207 kernel: [76708.591934] direct_page_fault+0x206/0x310 [kvm] Aug 23 02:42:14 juju-e4d256-prod-github-runner-207 kernel: [76708.592958] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 02:42:14 juju-e4d256-prod-github-runner-207 kernel: [76708.593978] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 02:42:14 juju-e4d256-prod-github-runner-207 kernel: [76708.594983] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 02:42:14 juju-e4d256-prod-github-runner-207 kernel: [76708.595995] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 02:42:14 juju-e4d256-prod-github-runner-207 kernel: [76708.596959] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 02:42:14 juju-e4d256-prod-github-runner-207 kernel: [76708.597959] handle_exit+0x98/0x230 [kvm_amd] Aug 23 02:42:14 juju-e4d256-prod-github-runner-207 kernel: [76708.598940] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 02:42:14 juju-e4d256-prod-github-runner-207 kernel: [76708.599855] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 02:42:14 juju-e4d256-prod-github-runner-207 kernel: [76708.600782] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 02:42:14 juju-e4d256-prod-github-runner-207 kernel: [76708.601752] vcpu_run+0x62/0x2c0 [kvm] Aug 23 02:42:14 juju-e4d256-prod-github-runner-207 kernel: [76708.602582] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 02:42:14 juju-e4d256-prod-github-runner-207 kernel: [76708.603395] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 02:42:14 juju-e4d256-prod-github-runner-207 kernel: [76708.604247] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 02:42:14 juju-e4d256-prod-github-runner-207 kernel: [76708.605041] ? __seccomp_filter+0x4a/0x4a0 Aug 23 02:42:14 juju-e4d256-prod-github-runner-207 kernel: [76708.605782] ? __fget_files+0x86/0xc0 Aug 23 02:42:14 juju-e4d256-prod-github-runner-207 kernel: [76708.606506] __x64_sys_ioctl+0x95/0xd0 Aug 23 02:42:14 juju-e4d256-prod-github-runner-207 kernel: [76708.607201] do_syscall_64+0x5c/0xc0 Aug 23 02:42:14 juju-e4d256-prod-github-runner-207 kernel: [76708.607872] ? do_futex+0x162/0x1f0 Aug 23 02:42:14 juju-e4d256-prod-github-runner-207 kernel: [76708.608519] ? __x64_sys_futex+0x78/0x1e0 Aug 23 02:42:14 juju-e4d256-prod-github-runner-207 kernel: [76708.609210] ? __secure_computing+0xa9/0x120 Aug 23 02:42:14 juju-e4d256-prod-github-runner-207 kernel: [76708.609906] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 02:42:14 juju-e4d256-prod-github-runner-207 kernel: [76708.610697] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:42:14 juju-e4d256-prod-github-runner-207 kernel: [76708.611422] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:42:14 juju-e4d256-prod-github-runner-207 kernel: [76708.612137] ? do_syscall_64+0x69/0xc0 Aug 23 02:42:14 juju-e4d256-prod-github-runner-207 kernel: [76708.612816] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:42:14 juju-e4d256-prod-github-runner-207 kernel: [76708.613521] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:42:14 juju-e4d256-prod-github-runner-207 kernel: [76708.614230] ? do_syscall_64+0x69/0xc0 Aug 23 02:42:14 juju-e4d256-prod-github-runner-207 kernel: [76708.614866] ? do_syscall_64+0x69/0xc0 Aug 23 02:42:14 juju-e4d256-prod-github-runner-207 kernel: [76708.615506] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 02:42:14 juju-e4d256-prod-github-runner-207 kernel: [76708.616208] RIP: 0033:0x7faa5d0edaff Aug 23 02:42:14 juju-e4d256-prod-github-runner-207 kernel: [76708.616828] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 02:42:14 juju-e4d256-prod-github-runner-207 kernel: [76708.618831] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 02:42:14 juju-e4d256-prod-github-runner-207 kernel: [76708.619734] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 02:42:14 juju-e4d256-prod-github-runner-207 kernel: [76708.620619] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 02:42:14 juju-e4d256-prod-github-runner-207 kernel: [76708.621504] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 02:42:14 juju-e4d256-prod-github-runner-207 kernel: [76708.622401] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 02:42:14 juju-e4d256-prod-github-runner-207 kernel: [76708.623294] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 02:42:14 juju-e4d256-prod-github-runner-207 kernel: [76708.624183] Aug 23 02:42:42 juju-e4d256-prod-github-runner-207 kernel: [76736.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 71358s! [qemu-system-x86:6715] Aug 23 02:42:42 juju-e4d256-prod-github-runner-207 kernel: [76736.543814] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 02:42:42 juju-e4d256-prod-github-runner-207 kernel: [76736.544093] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 02:42:42 juju-e4d256-prod-github-runner-207 kernel: [76736.556466] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 02:42:42 juju-e4d256-prod-github-runner-207 kernel: [76736.557800] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 02:42:42 juju-e4d256-prod-github-runner-207 kernel: [76736.559028] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:42:42 juju-e4d256-prod-github-runner-207 kernel: [76736.560083] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 02:42:42 juju-e4d256-prod-github-runner-207 kernel: [76736.562734] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 02:42:42 juju-e4d256-prod-github-runner-207 kernel: [76736.563785] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 02:42:42 juju-e4d256-prod-github-runner-207 kernel: [76736.564972] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 02:42:42 juju-e4d256-prod-github-runner-207 kernel: [76736.566216] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 02:42:42 juju-e4d256-prod-github-runner-207 kernel: [76736.567444] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 02:42:42 juju-e4d256-prod-github-runner-207 kernel: [76736.568651] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 02:42:42 juju-e4d256-prod-github-runner-207 kernel: [76736.569852] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 02:42:42 juju-e4d256-prod-github-runner-207 kernel: [76736.571101] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 02:42:42 juju-e4d256-prod-github-runner-207 kernel: [76736.572264] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 02:42:42 juju-e4d256-prod-github-runner-207 kernel: [76736.573499] Call Trace: Aug 23 02:42:42 juju-e4d256-prod-github-runner-207 kernel: [76736.574428] Aug 23 02:42:42 juju-e4d256-prod-github-runner-207 kernel: [76736.575326] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:42:42 juju-e4d256-prod-github-runner-207 kernel: [76736.576372] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:42:42 juju-e4d256-prod-github-runner-207 kernel: [76736.577442] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:42:42 juju-e4d256-prod-github-runner-207 kernel: [76736.578605] ? show_regs.part.0+0x23/0x29 Aug 23 02:42:42 juju-e4d256-prod-github-runner-207 kernel: [76736.579602] ? show_regs.cold+0x8/0xd Aug 23 02:42:42 juju-e4d256-prod-github-runner-207 kernel: [76736.580570] ? watchdog_timer_fn+0x1be/0x220 Aug 23 02:42:42 juju-e4d256-prod-github-runner-207 kernel: [76736.581590] ? lockup_detector_update_enable+0x60/0x60 Aug 23 02:42:42 juju-e4d256-prod-github-runner-207 kernel: [76736.582741] ? __hrtimer_run_queues+0x107/0x230 Aug 23 02:42:42 juju-e4d256-prod-github-runner-207 kernel: [76736.583780] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 02:42:42 juju-e4d256-prod-github-runner-207 kernel: [76736.584802] ? hrtimer_interrupt+0x101/0x220 Aug 23 02:42:42 juju-e4d256-prod-github-runner-207 kernel: [76736.585855] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 02:42:42 juju-e4d256-prod-github-runner-207 kernel: [76736.586966] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 02:42:42 juju-e4d256-prod-github-runner-207 kernel: [76736.588059] Aug 23 02:42:42 juju-e4d256-prod-github-runner-207 kernel: [76736.588922] Aug 23 02:42:42 juju-e4d256-prod-github-runner-207 kernel: [76736.589773] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 02:42:42 juju-e4d256-prod-github-runner-207 kernel: [76736.590811] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:42:42 juju-e4d256-prod-github-runner-207 kernel: [76736.591867] ? _raw_spin_lock+0x22/0x30 Aug 23 02:42:42 juju-e4d256-prod-github-runner-207 kernel: [76736.592879] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:42:42 juju-e4d256-prod-github-runner-207 kernel: [76736.593955] direct_page_fault+0x206/0x310 [kvm] Aug 23 02:42:42 juju-e4d256-prod-github-runner-207 kernel: [76736.594985] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 02:42:42 juju-e4d256-prod-github-runner-207 kernel: [76736.595994] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 02:42:42 juju-e4d256-prod-github-runner-207 kernel: [76736.597010] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 02:42:42 juju-e4d256-prod-github-runner-207 kernel: [76736.598083] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 02:42:42 juju-e4d256-prod-github-runner-207 kernel: [76736.599129] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 02:42:42 juju-e4d256-prod-github-runner-207 kernel: [76736.600122] handle_exit+0x98/0x230 [kvm_amd] Aug 23 02:42:42 juju-e4d256-prod-github-runner-207 kernel: [76736.601022] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 02:42:42 juju-e4d256-prod-github-runner-207 kernel: [76736.601984] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 02:42:42 juju-e4d256-prod-github-runner-207 kernel: [76736.602943] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 02:42:42 juju-e4d256-prod-github-runner-207 kernel: [76736.603869] vcpu_run+0x62/0x2c0 [kvm] Aug 23 02:42:42 juju-e4d256-prod-github-runner-207 kernel: [76736.604682] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 02:42:42 juju-e4d256-prod-github-runner-207 kernel: [76736.605493] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 02:42:42 juju-e4d256-prod-github-runner-207 kernel: [76736.606371] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 02:42:42 juju-e4d256-prod-github-runner-207 kernel: [76736.607180] ? __seccomp_filter+0x4a/0x4a0 Aug 23 02:42:42 juju-e4d256-prod-github-runner-207 kernel: [76736.607936] ? __fget_files+0x86/0xc0 Aug 23 02:42:42 juju-e4d256-prod-github-runner-207 kernel: [76736.608663] __x64_sys_ioctl+0x95/0xd0 Aug 23 02:42:42 juju-e4d256-prod-github-runner-207 kernel: [76736.609365] do_syscall_64+0x5c/0xc0 Aug 23 02:42:42 juju-e4d256-prod-github-runner-207 kernel: [76736.610053] ? do_futex+0x162/0x1f0 Aug 23 02:42:42 juju-e4d256-prod-github-runner-207 kernel: [76736.610712] ? __x64_sys_futex+0x78/0x1e0 Aug 23 02:42:42 juju-e4d256-prod-github-runner-207 kernel: [76736.611389] ? __secure_computing+0xa9/0x120 Aug 23 02:42:42 juju-e4d256-prod-github-runner-207 kernel: [76736.612104] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 02:42:42 juju-e4d256-prod-github-runner-207 kernel: [76736.612925] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:42:42 juju-e4d256-prod-github-runner-207 kernel: [76736.613737] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:42:42 juju-e4d256-prod-github-runner-207 kernel: [76736.614467] ? do_syscall_64+0x69/0xc0 Aug 23 02:42:42 juju-e4d256-prod-github-runner-207 kernel: [76736.615115] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:42:42 juju-e4d256-prod-github-runner-207 kernel: [76736.615844] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:42:42 juju-e4d256-prod-github-runner-207 kernel: [76736.616544] ? do_syscall_64+0x69/0xc0 Aug 23 02:42:42 juju-e4d256-prod-github-runner-207 kernel: [76736.617172] ? do_syscall_64+0x69/0xc0 Aug 23 02:42:42 juju-e4d256-prod-github-runner-207 kernel: [76736.617843] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 02:42:42 juju-e4d256-prod-github-runner-207 kernel: [76736.618580] RIP: 0033:0x7faa5d0edaff Aug 23 02:42:42 juju-e4d256-prod-github-runner-207 kernel: [76736.619256] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 02:42:42 juju-e4d256-prod-github-runner-207 kernel: [76736.621256] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 02:42:42 juju-e4d256-prod-github-runner-207 kernel: [76736.622197] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 02:42:42 juju-e4d256-prod-github-runner-207 kernel: [76736.623115] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 02:42:42 juju-e4d256-prod-github-runner-207 kernel: [76736.624044] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 02:42:42 juju-e4d256-prod-github-runner-207 kernel: [76736.624944] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 02:42:42 juju-e4d256-prod-github-runner-207 kernel: [76736.625856] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 02:42:42 juju-e4d256-prod-github-runner-207 kernel: [76736.626756] Aug 23 02:43:10 juju-e4d256-prod-github-runner-207 kernel: [76764.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 71384s! [qemu-system-x86:6715] Aug 23 02:43:10 juju-e4d256-prod-github-runner-207 kernel: [76764.543319] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 02:43:10 juju-e4d256-prod-github-runner-207 kernel: [76764.543399] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 02:43:10 juju-e4d256-prod-github-runner-207 kernel: [76764.555547] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 02:43:10 juju-e4d256-prod-github-runner-207 kernel: [76764.556817] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 02:43:10 juju-e4d256-prod-github-runner-207 kernel: [76764.558070] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:43:10 juju-e4d256-prod-github-runner-207 kernel: [76764.559129] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 02:43:10 juju-e4d256-prod-github-runner-207 kernel: [76764.561700] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 02:43:10 juju-e4d256-prod-github-runner-207 kernel: [76764.562750] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 02:43:10 juju-e4d256-prod-github-runner-207 kernel: [76764.563913] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 02:43:10 juju-e4d256-prod-github-runner-207 kernel: [76764.565093] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 02:43:10 juju-e4d256-prod-github-runner-207 kernel: [76764.566288] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 02:43:10 juju-e4d256-prod-github-runner-207 kernel: [76764.567459] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 02:43:10 juju-e4d256-prod-github-runner-207 kernel: [76764.568637] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 02:43:10 juju-e4d256-prod-github-runner-207 kernel: [76764.569908] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 02:43:10 juju-e4d256-prod-github-runner-207 kernel: [76764.571028] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 02:43:10 juju-e4d256-prod-github-runner-207 kernel: [76764.572232] Call Trace: Aug 23 02:43:10 juju-e4d256-prod-github-runner-207 kernel: [76764.573154] Aug 23 02:43:10 juju-e4d256-prod-github-runner-207 kernel: [76764.574067] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:43:10 juju-e4d256-prod-github-runner-207 kernel: [76764.575112] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:43:10 juju-e4d256-prod-github-runner-207 kernel: [76764.576146] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:43:10 juju-e4d256-prod-github-runner-207 kernel: [76764.577367] ? show_regs.part.0+0x23/0x29 Aug 23 02:43:10 juju-e4d256-prod-github-runner-207 kernel: [76764.578531] ? show_regs.cold+0x8/0xd Aug 23 02:43:10 juju-e4d256-prod-github-runner-207 kernel: [76764.579838] ? watchdog_timer_fn+0x1be/0x220 Aug 23 02:43:10 juju-e4d256-prod-github-runner-207 kernel: [76764.580971] ? lockup_detector_update_enable+0x60/0x60 Aug 23 02:43:10 juju-e4d256-prod-github-runner-207 kernel: [76764.582084] ? __hrtimer_run_queues+0x107/0x230 Aug 23 02:43:10 juju-e4d256-prod-github-runner-207 kernel: [76764.583122] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 02:43:10 juju-e4d256-prod-github-runner-207 kernel: [76764.584148] ? hrtimer_interrupt+0x101/0x220 Aug 23 02:43:10 juju-e4d256-prod-github-runner-207 kernel: [76764.585170] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 02:43:10 juju-e4d256-prod-github-runner-207 kernel: [76764.586262] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 02:43:10 juju-e4d256-prod-github-runner-207 kernel: [76764.587310] Aug 23 02:43:10 juju-e4d256-prod-github-runner-207 kernel: [76764.588164] Aug 23 02:43:10 juju-e4d256-prod-github-runner-207 kernel: [76764.589012] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 02:43:10 juju-e4d256-prod-github-runner-207 kernel: [76764.590069] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:43:10 juju-e4d256-prod-github-runner-207 kernel: [76764.591110] ? _raw_spin_lock+0x22/0x30 Aug 23 02:43:10 juju-e4d256-prod-github-runner-207 kernel: [76764.592062] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:43:10 juju-e4d256-prod-github-runner-207 kernel: [76764.593094] direct_page_fault+0x206/0x310 [kvm] Aug 23 02:43:10 juju-e4d256-prod-github-runner-207 kernel: [76764.594137] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 02:43:10 juju-e4d256-prod-github-runner-207 kernel: [76764.595150] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 02:43:10 juju-e4d256-prod-github-runner-207 kernel: [76764.596159] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 02:43:10 juju-e4d256-prod-github-runner-207 kernel: [76764.597135] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 02:43:10 juju-e4d256-prod-github-runner-207 kernel: [76764.598102] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 02:43:10 juju-e4d256-prod-github-runner-207 kernel: [76764.599088] handle_exit+0x98/0x230 [kvm_amd] Aug 23 02:43:10 juju-e4d256-prod-github-runner-207 kernel: [76764.599985] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 02:43:10 juju-e4d256-prod-github-runner-207 kernel: [76764.600901] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 02:43:10 juju-e4d256-prod-github-runner-207 kernel: [76764.601843] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 02:43:10 juju-e4d256-prod-github-runner-207 kernel: [76764.602758] vcpu_run+0x62/0x2c0 [kvm] Aug 23 02:43:10 juju-e4d256-prod-github-runner-207 kernel: [76764.603576] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 02:43:10 juju-e4d256-prod-github-runner-207 kernel: [76764.604387] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 02:43:10 juju-e4d256-prod-github-runner-207 kernel: [76764.605250] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 02:43:10 juju-e4d256-prod-github-runner-207 kernel: [76764.606073] ? __seccomp_filter+0x4a/0x4a0 Aug 23 02:43:10 juju-e4d256-prod-github-runner-207 kernel: [76764.606817] ? __fget_files+0x86/0xc0 Aug 23 02:43:10 juju-e4d256-prod-github-runner-207 kernel: [76764.607527] __x64_sys_ioctl+0x95/0xd0 Aug 23 02:43:10 juju-e4d256-prod-github-runner-207 kernel: [76764.608221] do_syscall_64+0x5c/0xc0 Aug 23 02:43:10 juju-e4d256-prod-github-runner-207 kernel: [76764.608885] ? do_futex+0x162/0x1f0 Aug 23 02:43:10 juju-e4d256-prod-github-runner-207 kernel: [76764.609562] ? __x64_sys_futex+0x78/0x1e0 Aug 23 02:43:10 juju-e4d256-prod-github-runner-207 kernel: [76764.610241] ? __secure_computing+0xa9/0x120 Aug 23 02:43:10 juju-e4d256-prod-github-runner-207 kernel: [76764.610933] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 02:43:10 juju-e4d256-prod-github-runner-207 kernel: [76764.611692] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:43:10 juju-e4d256-prod-github-runner-207 kernel: [76764.612420] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:43:10 juju-e4d256-prod-github-runner-207 kernel: [76764.613146] ? do_syscall_64+0x69/0xc0 Aug 23 02:43:10 juju-e4d256-prod-github-runner-207 kernel: [76764.613807] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:43:10 juju-e4d256-prod-github-runner-207 kernel: [76764.614510] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:43:10 juju-e4d256-prod-github-runner-207 kernel: [76764.615209] ? do_syscall_64+0x69/0xc0 Aug 23 02:43:10 juju-e4d256-prod-github-runner-207 kernel: [76764.615836] ? do_syscall_64+0x69/0xc0 Aug 23 02:43:10 juju-e4d256-prod-github-runner-207 kernel: [76764.616550] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 02:43:10 juju-e4d256-prod-github-runner-207 kernel: [76764.617258] RIP: 0033:0x7faa5d0edaff Aug 23 02:43:10 juju-e4d256-prod-github-runner-207 kernel: [76764.617899] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 02:43:10 juju-e4d256-prod-github-runner-207 kernel: [76764.619892] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 02:43:10 juju-e4d256-prod-github-runner-207 kernel: [76764.620807] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 02:43:10 juju-e4d256-prod-github-runner-207 kernel: [76764.621722] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 02:43:10 juju-e4d256-prod-github-runner-207 kernel: [76764.622613] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 02:43:10 juju-e4d256-prod-github-runner-207 kernel: [76764.623504] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 02:43:10 juju-e4d256-prod-github-runner-207 kernel: [76764.624497] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 02:43:10 juju-e4d256-prod-github-runner-207 kernel: [76764.625416] Aug 23 02:43:38 juju-e4d256-prod-github-runner-207 kernel: [76792.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 71410s! [qemu-system-x86:6715] Aug 23 02:43:38 juju-e4d256-prod-github-runner-207 kernel: [76792.543150] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 02:43:38 juju-e4d256-prod-github-runner-207 kernel: [76792.543236] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 02:43:38 juju-e4d256-prod-github-runner-207 kernel: [76792.555010] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 02:43:38 juju-e4d256-prod-github-runner-207 kernel: [76792.556250] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 02:43:38 juju-e4d256-prod-github-runner-207 kernel: [76792.557458] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:43:38 juju-e4d256-prod-github-runner-207 kernel: [76792.558493] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 02:43:38 juju-e4d256-prod-github-runner-207 kernel: [76792.560982] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 02:43:38 juju-e4d256-prod-github-runner-207 kernel: [76792.562003] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 02:43:38 juju-e4d256-prod-github-runner-207 kernel: [76792.563133] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 02:43:38 juju-e4d256-prod-github-runner-207 kernel: [76792.564267] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 02:43:38 juju-e4d256-prod-github-runner-207 kernel: [76792.565416] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 02:43:38 juju-e4d256-prod-github-runner-207 kernel: [76792.566548] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 02:43:38 juju-e4d256-prod-github-runner-207 kernel: [76792.567843] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 02:43:38 juju-e4d256-prod-github-runner-207 kernel: [76792.569374] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 02:43:38 juju-e4d256-prod-github-runner-207 kernel: [76792.570454] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 02:43:38 juju-e4d256-prod-github-runner-207 kernel: [76792.571627] Call Trace: Aug 23 02:43:38 juju-e4d256-prod-github-runner-207 kernel: [76792.572534] Aug 23 02:43:38 juju-e4d256-prod-github-runner-207 kernel: [76792.573429] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:43:38 juju-e4d256-prod-github-runner-207 kernel: [76792.574441] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:43:38 juju-e4d256-prod-github-runner-207 kernel: [76792.575469] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:43:38 juju-e4d256-prod-github-runner-207 kernel: [76792.576529] ? show_regs.part.0+0x23/0x29 Aug 23 02:43:38 juju-e4d256-prod-github-runner-207 kernel: [76792.577528] ? show_regs.cold+0x8/0xd Aug 23 02:43:38 juju-e4d256-prod-github-runner-207 kernel: [76792.578484] ? watchdog_timer_fn+0x1be/0x220 Aug 23 02:43:38 juju-e4d256-prod-github-runner-207 kernel: [76792.579479] ? lockup_detector_update_enable+0x60/0x60 Aug 23 02:43:38 juju-e4d256-prod-github-runner-207 kernel: [76792.580521] ? __hrtimer_run_queues+0x107/0x230 Aug 23 02:43:38 juju-e4d256-prod-github-runner-207 kernel: [76792.581545] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 02:43:38 juju-e4d256-prod-github-runner-207 kernel: [76792.582556] ? hrtimer_interrupt+0x101/0x220 Aug 23 02:43:38 juju-e4d256-prod-github-runner-207 kernel: [76792.583557] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 02:43:38 juju-e4d256-prod-github-runner-207 kernel: [76792.584608] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 02:43:38 juju-e4d256-prod-github-runner-207 kernel: [76792.585652] Aug 23 02:43:38 juju-e4d256-prod-github-runner-207 kernel: [76792.586495] Aug 23 02:43:38 juju-e4d256-prod-github-runner-207 kernel: [76792.587326] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 02:43:38 juju-e4d256-prod-github-runner-207 kernel: [76792.588346] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:43:38 juju-e4d256-prod-github-runner-207 kernel: [76792.589384] ? _raw_spin_lock+0x22/0x30 Aug 23 02:43:38 juju-e4d256-prod-github-runner-207 kernel: [76792.590318] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:43:38 juju-e4d256-prod-github-runner-207 kernel: [76792.591321] direct_page_fault+0x206/0x310 [kvm] Aug 23 02:43:38 juju-e4d256-prod-github-runner-207 kernel: [76792.592331] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 02:43:38 juju-e4d256-prod-github-runner-207 kernel: [76792.593333] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 02:43:38 juju-e4d256-prod-github-runner-207 kernel: [76792.594315] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 02:43:38 juju-e4d256-prod-github-runner-207 kernel: [76792.595268] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 02:43:38 juju-e4d256-prod-github-runner-207 kernel: [76792.596193] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 02:43:38 juju-e4d256-prod-github-runner-207 kernel: [76792.597174] handle_exit+0x98/0x230 [kvm_amd] Aug 23 02:43:38 juju-e4d256-prod-github-runner-207 kernel: [76792.598049] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 02:43:38 juju-e4d256-prod-github-runner-207 kernel: [76792.598941] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 02:43:38 juju-e4d256-prod-github-runner-207 kernel: [76792.599848] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 02:43:38 juju-e4d256-prod-github-runner-207 kernel: [76792.600726] vcpu_run+0x62/0x2c0 [kvm] Aug 23 02:43:38 juju-e4d256-prod-github-runner-207 kernel: [76792.601542] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 02:43:38 juju-e4d256-prod-github-runner-207 kernel: [76792.602330] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 02:43:38 juju-e4d256-prod-github-runner-207 kernel: [76792.603159] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 02:43:38 juju-e4d256-prod-github-runner-207 kernel: [76792.603948] ? __seccomp_filter+0x4a/0x4a0 Aug 23 02:43:38 juju-e4d256-prod-github-runner-207 kernel: [76792.604675] ? __fget_files+0x86/0xc0 Aug 23 02:43:38 juju-e4d256-prod-github-runner-207 kernel: [76792.605377] __x64_sys_ioctl+0x95/0xd0 Aug 23 02:43:38 juju-e4d256-prod-github-runner-207 kernel: [76792.606052] do_syscall_64+0x5c/0xc0 Aug 23 02:43:38 juju-e4d256-prod-github-runner-207 kernel: [76792.606699] ? do_futex+0x162/0x1f0 Aug 23 02:43:38 juju-e4d256-prod-github-runner-207 kernel: [76792.607340] ? __x64_sys_futex+0x78/0x1e0 Aug 23 02:43:38 juju-e4d256-prod-github-runner-207 kernel: [76792.607997] ? __secure_computing+0xa9/0x120 Aug 23 02:43:38 juju-e4d256-prod-github-runner-207 kernel: [76792.608676] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 02:43:38 juju-e4d256-prod-github-runner-207 kernel: [76792.609428] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:43:38 juju-e4d256-prod-github-runner-207 kernel: [76792.610128] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:43:38 juju-e4d256-prod-github-runner-207 kernel: [76792.610823] ? do_syscall_64+0x69/0xc0 Aug 23 02:43:38 juju-e4d256-prod-github-runner-207 kernel: [76792.611466] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:43:38 juju-e4d256-prod-github-runner-207 kernel: [76792.612149] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:43:38 juju-e4d256-prod-github-runner-207 kernel: [76792.612822] ? do_syscall_64+0x69/0xc0 Aug 23 02:43:38 juju-e4d256-prod-github-runner-207 kernel: [76792.613443] ? do_syscall_64+0x69/0xc0 Aug 23 02:43:38 juju-e4d256-prod-github-runner-207 kernel: [76792.614049] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 02:43:38 juju-e4d256-prod-github-runner-207 kernel: [76792.614736] RIP: 0033:0x7faa5d0edaff Aug 23 02:43:38 juju-e4d256-prod-github-runner-207 kernel: [76792.615351] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 02:43:38 juju-e4d256-prod-github-runner-207 kernel: [76792.617410] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 02:43:38 juju-e4d256-prod-github-runner-207 kernel: [76792.618297] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 02:43:38 juju-e4d256-prod-github-runner-207 kernel: [76792.619157] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 02:43:38 juju-e4d256-prod-github-runner-207 kernel: [76792.620023] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 02:43:38 juju-e4d256-prod-github-runner-207 kernel: [76792.620878] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 02:43:38 juju-e4d256-prod-github-runner-207 kernel: [76792.621758] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 02:43:38 juju-e4d256-prod-github-runner-207 kernel: [76792.622660] Aug 23 02:44:06 juju-e4d256-prod-github-runner-207 kernel: [76820.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 71436s! [qemu-system-x86:6715] Aug 23 02:44:06 juju-e4d256-prod-github-runner-207 kernel: [76820.543743] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 02:44:06 juju-e4d256-prod-github-runner-207 kernel: [76820.543999] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 02:44:06 juju-e4d256-prod-github-runner-207 kernel: [76820.556410] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 02:44:06 juju-e4d256-prod-github-runner-207 kernel: [76820.557682] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 02:44:06 juju-e4d256-prod-github-runner-207 kernel: [76820.558903] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:44:06 juju-e4d256-prod-github-runner-207 kernel: [76820.559961] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 02:44:06 juju-e4d256-prod-github-runner-207 kernel: [76820.562529] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 02:44:06 juju-e4d256-prod-github-runner-207 kernel: [76820.563602] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 02:44:06 juju-e4d256-prod-github-runner-207 kernel: [76820.564775] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 02:44:06 juju-e4d256-prod-github-runner-207 kernel: [76820.565932] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 02:44:06 juju-e4d256-prod-github-runner-207 kernel: [76820.567090] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 02:44:06 juju-e4d256-prod-github-runner-207 kernel: [76820.568252] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 02:44:06 juju-e4d256-prod-github-runner-207 kernel: [76820.569431] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 02:44:06 juju-e4d256-prod-github-runner-207 kernel: [76820.570662] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 02:44:06 juju-e4d256-prod-github-runner-207 kernel: [76820.571775] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 02:44:06 juju-e4d256-prod-github-runner-207 kernel: [76820.573002] Call Trace: Aug 23 02:44:06 juju-e4d256-prod-github-runner-207 kernel: [76820.573921] Aug 23 02:44:06 juju-e4d256-prod-github-runner-207 kernel: [76820.574817] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:44:06 juju-e4d256-prod-github-runner-207 kernel: [76820.575850] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:44:06 juju-e4d256-prod-github-runner-207 kernel: [76820.576884] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:44:06 juju-e4d256-prod-github-runner-207 kernel: [76820.577976] ? show_regs.part.0+0x23/0x29 Aug 23 02:44:06 juju-e4d256-prod-github-runner-207 kernel: [76820.578973] ? show_regs.cold+0x8/0xd Aug 23 02:44:06 juju-e4d256-prod-github-runner-207 kernel: [76820.579952] ? watchdog_timer_fn+0x1be/0x220 Aug 23 02:44:06 juju-e4d256-prod-github-runner-207 kernel: [76820.580966] ? lockup_detector_update_enable+0x60/0x60 Aug 23 02:44:06 juju-e4d256-prod-github-runner-207 kernel: [76820.582030] ? __hrtimer_run_queues+0x107/0x230 Aug 23 02:44:06 juju-e4d256-prod-github-runner-207 kernel: [76820.583056] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 02:44:06 juju-e4d256-prod-github-runner-207 kernel: [76820.584079] ? hrtimer_interrupt+0x101/0x220 Aug 23 02:44:06 juju-e4d256-prod-github-runner-207 kernel: [76820.585103] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 02:44:06 juju-e4d256-prod-github-runner-207 kernel: [76820.586172] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 02:44:06 juju-e4d256-prod-github-runner-207 kernel: [76820.587304] Aug 23 02:44:06 juju-e4d256-prod-github-runner-207 kernel: [76820.588157] Aug 23 02:44:06 juju-e4d256-prod-github-runner-207 kernel: [76820.589001] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 02:44:06 juju-e4d256-prod-github-runner-207 kernel: [76820.590043] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:44:06 juju-e4d256-prod-github-runner-207 kernel: [76820.591082] ? _raw_spin_lock+0x22/0x30 Aug 23 02:44:06 juju-e4d256-prod-github-runner-207 kernel: [76820.592031] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:44:06 juju-e4d256-prod-github-runner-207 kernel: [76820.593052] direct_page_fault+0x206/0x310 [kvm] Aug 23 02:44:06 juju-e4d256-prod-github-runner-207 kernel: [76820.594079] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 02:44:06 juju-e4d256-prod-github-runner-207 kernel: [76820.595088] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 02:44:06 juju-e4d256-prod-github-runner-207 kernel: [76820.596087] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 02:44:06 juju-e4d256-prod-github-runner-207 kernel: [76820.597113] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 02:44:06 juju-e4d256-prod-github-runner-207 kernel: [76820.598067] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 02:44:06 juju-e4d256-prod-github-runner-207 kernel: [76820.599045] handle_exit+0x98/0x230 [kvm_amd] Aug 23 02:44:06 juju-e4d256-prod-github-runner-207 kernel: [76820.599939] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 02:44:06 juju-e4d256-prod-github-runner-207 kernel: [76820.600861] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 02:44:06 juju-e4d256-prod-github-runner-207 kernel: [76820.601793] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 02:44:06 juju-e4d256-prod-github-runner-207 kernel: [76820.602694] vcpu_run+0x62/0x2c0 [kvm] Aug 23 02:44:06 juju-e4d256-prod-github-runner-207 kernel: [76820.603504] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 02:44:06 juju-e4d256-prod-github-runner-207 kernel: [76820.604311] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 02:44:06 juju-e4d256-prod-github-runner-207 kernel: [76820.605178] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 02:44:06 juju-e4d256-prod-github-runner-207 kernel: [76820.605987] ? __seccomp_filter+0x4a/0x4a0 Aug 23 02:44:06 juju-e4d256-prod-github-runner-207 kernel: [76820.606729] ? __fget_files+0x86/0xc0 Aug 23 02:44:06 juju-e4d256-prod-github-runner-207 kernel: [76820.607429] __x64_sys_ioctl+0x95/0xd0 Aug 23 02:44:06 juju-e4d256-prod-github-runner-207 kernel: [76820.608134] do_syscall_64+0x5c/0xc0 Aug 23 02:44:06 juju-e4d256-prod-github-runner-207 kernel: [76820.608823] ? do_futex+0x162/0x1f0 Aug 23 02:44:06 juju-e4d256-prod-github-runner-207 kernel: [76820.609471] ? __x64_sys_futex+0x78/0x1e0 Aug 23 02:44:06 juju-e4d256-prod-github-runner-207 kernel: [76820.610145] ? __secure_computing+0xa9/0x120 Aug 23 02:44:06 juju-e4d256-prod-github-runner-207 kernel: [76820.610832] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 02:44:06 juju-e4d256-prod-github-runner-207 kernel: [76820.611590] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:44:06 juju-e4d256-prod-github-runner-207 kernel: [76820.612309] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:44:06 juju-e4d256-prod-github-runner-207 kernel: [76820.613034] ? do_syscall_64+0x69/0xc0 Aug 23 02:44:06 juju-e4d256-prod-github-runner-207 kernel: [76820.613678] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:44:06 juju-e4d256-prod-github-runner-207 kernel: [76820.614380] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:44:06 juju-e4d256-prod-github-runner-207 kernel: [76820.615076] ? do_syscall_64+0x69/0xc0 Aug 23 02:44:06 juju-e4d256-prod-github-runner-207 kernel: [76820.615699] ? do_syscall_64+0x69/0xc0 Aug 23 02:44:06 juju-e4d256-prod-github-runner-207 kernel: [76820.616318] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 02:44:06 juju-e4d256-prod-github-runner-207 kernel: [76820.617029] RIP: 0033:0x7faa5d0edaff Aug 23 02:44:06 juju-e4d256-prod-github-runner-207 kernel: [76820.617672] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 02:44:06 juju-e4d256-prod-github-runner-207 kernel: [76820.619670] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 02:44:06 juju-e4d256-prod-github-runner-207 kernel: [76820.620607] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 02:44:06 juju-e4d256-prod-github-runner-207 kernel: [76820.621500] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 02:44:06 juju-e4d256-prod-github-runner-207 kernel: [76820.622387] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 02:44:06 juju-e4d256-prod-github-runner-207 kernel: [76820.623273] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 02:44:06 juju-e4d256-prod-github-runner-207 kernel: [76820.624161] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 02:44:06 juju-e4d256-prod-github-runner-207 kernel: [76820.625070] Aug 23 02:44:34 juju-e4d256-prod-github-runner-207 kernel: [76848.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 71462s! [qemu-system-x86:6715] Aug 23 02:44:34 juju-e4d256-prod-github-runner-207 kernel: [76848.543966] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 02:44:34 juju-e4d256-prod-github-runner-207 kernel: [76848.544298] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 02:44:34 juju-e4d256-prod-github-runner-207 kernel: [76848.556650] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 02:44:34 juju-e4d256-prod-github-runner-207 kernel: [76848.557922] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 02:44:34 juju-e4d256-prod-github-runner-207 kernel: [76848.559157] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:44:34 juju-e4d256-prod-github-runner-207 kernel: [76848.560213] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 02:44:34 juju-e4d256-prod-github-runner-207 kernel: [76848.562774] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 02:44:34 juju-e4d256-prod-github-runner-207 kernel: [76848.563822] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 02:44:34 juju-e4d256-prod-github-runner-207 kernel: [76848.564998] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 02:44:34 juju-e4d256-prod-github-runner-207 kernel: [76848.566165] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 02:44:34 juju-e4d256-prod-github-runner-207 kernel: [76848.567325] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 02:44:34 juju-e4d256-prod-github-runner-207 kernel: [76848.568507] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 02:44:34 juju-e4d256-prod-github-runner-207 kernel: [76848.569680] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 02:44:34 juju-e4d256-prod-github-runner-207 kernel: [76848.570953] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 02:44:34 juju-e4d256-prod-github-runner-207 kernel: [76848.572094] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 02:44:34 juju-e4d256-prod-github-runner-207 kernel: [76848.573296] Call Trace: Aug 23 02:44:34 juju-e4d256-prod-github-runner-207 kernel: [76848.574208] Aug 23 02:44:34 juju-e4d256-prod-github-runner-207 kernel: [76848.575118] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:44:34 juju-e4d256-prod-github-runner-207 kernel: [76848.576153] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:44:34 juju-e4d256-prod-github-runner-207 kernel: [76848.577188] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:44:34 juju-e4d256-prod-github-runner-207 kernel: [76848.578287] ? show_regs.part.0+0x23/0x29 Aug 23 02:44:34 juju-e4d256-prod-github-runner-207 kernel: [76848.579287] ? show_regs.cold+0x8/0xd Aug 23 02:44:34 juju-e4d256-prod-github-runner-207 kernel: [76848.580272] ? watchdog_timer_fn+0x1be/0x220 Aug 23 02:44:34 juju-e4d256-prod-github-runner-207 kernel: [76848.581280] ? lockup_detector_update_enable+0x60/0x60 Aug 23 02:44:34 juju-e4d256-prod-github-runner-207 kernel: [76848.582364] ? __hrtimer_run_queues+0x107/0x230 Aug 23 02:44:34 juju-e4d256-prod-github-runner-207 kernel: [76848.583393] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 02:44:34 juju-e4d256-prod-github-runner-207 kernel: [76848.584433] ? hrtimer_interrupt+0x101/0x220 Aug 23 02:44:34 juju-e4d256-prod-github-runner-207 kernel: [76848.585449] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 02:44:34 juju-e4d256-prod-github-runner-207 kernel: [76848.586516] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 02:44:34 juju-e4d256-prod-github-runner-207 kernel: [76848.587565] Aug 23 02:44:34 juju-e4d256-prod-github-runner-207 kernel: [76848.588425] Aug 23 02:44:34 juju-e4d256-prod-github-runner-207 kernel: [76848.589260] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 02:44:34 juju-e4d256-prod-github-runner-207 kernel: [76848.590321] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:44:34 juju-e4d256-prod-github-runner-207 kernel: [76848.591361] ? _raw_spin_lock+0x22/0x30 Aug 23 02:44:34 juju-e4d256-prod-github-runner-207 kernel: [76848.593268] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:44:34 juju-e4d256-prod-github-runner-207 kernel: [76848.594301] direct_page_fault+0x206/0x310 [kvm] Aug 23 02:44:34 juju-e4d256-prod-github-runner-207 kernel: [76848.595346] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 02:44:34 juju-e4d256-prod-github-runner-207 kernel: [76848.596370] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 02:44:34 juju-e4d256-prod-github-runner-207 kernel: [76848.597414] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 02:44:34 juju-e4d256-prod-github-runner-207 kernel: [76848.598654] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 02:44:34 juju-e4d256-prod-github-runner-207 kernel: [76848.599952] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 02:44:34 juju-e4d256-prod-github-runner-207 kernel: [76848.601314] handle_exit+0x98/0x230 [kvm_amd] Aug 23 02:44:34 juju-e4d256-prod-github-runner-207 kernel: [76848.602367] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 02:44:34 juju-e4d256-prod-github-runner-207 kernel: [76848.603299] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 02:44:34 juju-e4d256-prod-github-runner-207 kernel: [76848.604223] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 02:44:34 juju-e4d256-prod-github-runner-207 kernel: [76848.605459] vcpu_run+0x62/0x2c0 [kvm] Aug 23 02:44:34 juju-e4d256-prod-github-runner-207 kernel: [76848.606278] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 02:44:34 juju-e4d256-prod-github-runner-207 kernel: [76848.607089] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 02:44:34 juju-e4d256-prod-github-runner-207 kernel: [76848.607964] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 02:44:34 juju-e4d256-prod-github-runner-207 kernel: [76848.608787] ? __seccomp_filter+0x4a/0x4a0 Aug 23 02:44:34 juju-e4d256-prod-github-runner-207 kernel: [76848.609535] ? __fget_files+0x86/0xc0 Aug 23 02:44:34 juju-e4d256-prod-github-runner-207 kernel: [76848.610246] __x64_sys_ioctl+0x95/0xd0 Aug 23 02:44:34 juju-e4d256-prod-github-runner-207 kernel: [76848.610942] do_syscall_64+0x5c/0xc0 Aug 23 02:44:34 juju-e4d256-prod-github-runner-207 kernel: [76848.611646] ? do_futex+0x162/0x1f0 Aug 23 02:44:34 juju-e4d256-prod-github-runner-207 kernel: [76848.612305] ? __x64_sys_futex+0x78/0x1e0 Aug 23 02:44:34 juju-e4d256-prod-github-runner-207 kernel: [76848.612979] ? __secure_computing+0xa9/0x120 Aug 23 02:44:34 juju-e4d256-prod-github-runner-207 kernel: [76848.613670] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 02:44:34 juju-e4d256-prod-github-runner-207 kernel: [76848.614439] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:44:34 juju-e4d256-prod-github-runner-207 kernel: [76848.615172] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:44:34 juju-e4d256-prod-github-runner-207 kernel: [76848.615893] ? do_syscall_64+0x69/0xc0 Aug 23 02:44:34 juju-e4d256-prod-github-runner-207 kernel: [76848.616559] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:44:34 juju-e4d256-prod-github-runner-207 kernel: [76848.617267] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:44:34 juju-e4d256-prod-github-runner-207 kernel: [76848.617969] ? do_syscall_64+0x69/0xc0 Aug 23 02:44:34 juju-e4d256-prod-github-runner-207 kernel: [76848.618596] ? do_syscall_64+0x69/0xc0 Aug 23 02:44:34 juju-e4d256-prod-github-runner-207 kernel: [76848.619223] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 02:44:34 juju-e4d256-prod-github-runner-207 kernel: [76848.619931] RIP: 0033:0x7faa5d0edaff Aug 23 02:44:34 juju-e4d256-prod-github-runner-207 kernel: [76848.620613] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 02:44:34 juju-e4d256-prod-github-runner-207 kernel: [76848.622604] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 02:44:34 juju-e4d256-prod-github-runner-207 kernel: [76848.623518] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 02:44:34 juju-e4d256-prod-github-runner-207 kernel: [76848.624415] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 02:44:34 juju-e4d256-prod-github-runner-207 kernel: [76848.625305] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 02:44:34 juju-e4d256-prod-github-runner-207 kernel: [76848.626198] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 02:44:34 juju-e4d256-prod-github-runner-207 kernel: [76848.627089] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 02:44:34 juju-e4d256-prod-github-runner-207 kernel: [76848.628008] Aug 23 02:44:48 juju-e4d256-prod-github-runner-207 kernel: [76862.312707] rcu: INFO: rcu_sched self-detected stall on CPU Aug 23 02:44:48 juju-e4d256-prod-github-runner-207 kernel: [76862.314876] rcu: 1-....: (19126034 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=9247039 Aug 23 02:44:48 juju-e4d256-prod-github-runner-207 kernel: [76862.315998] (t=19186278 jiffies g=23269 q=64712) Aug 23 02:44:48 juju-e4d256-prod-github-runner-207 kernel: [76862.316802] NMI backtrace for cpu 1 Aug 23 02:44:48 juju-e4d256-prod-github-runner-207 kernel: [76862.317515] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 02:44:48 juju-e4d256-prod-github-runner-207 kernel: [76862.318622] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 02:44:48 juju-e4d256-prod-github-runner-207 kernel: [76862.319703] Call Trace: Aug 23 02:44:48 juju-e4d256-prod-github-runner-207 kernel: [76862.320387] Aug 23 02:44:48 juju-e4d256-prod-github-runner-207 kernel: [76862.321053] show_stack+0x52/0x5c Aug 23 02:44:48 juju-e4d256-prod-github-runner-207 kernel: [76862.321780] dump_stack_lvl+0x4a/0x63 Aug 23 02:44:48 juju-e4d256-prod-github-runner-207 kernel: [76862.322530] dump_stack+0x10/0x16 Aug 23 02:44:48 juju-e4d256-prod-github-runner-207 kernel: [76862.323252] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 23 02:44:48 juju-e4d256-prod-github-runner-207 kernel: [76862.324037] ? lapic_can_unplug_cpu+0x90/0x90 Aug 23 02:44:48 juju-e4d256-prod-github-runner-207 kernel: [76862.324823] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 23 02:44:48 juju-e4d256-prod-github-runner-207 kernel: [76862.325641] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 23 02:44:48 juju-e4d256-prod-github-runner-207 kernel: [76862.326457] trigger_single_cpu_backtrace+0x44/0x4f Aug 23 02:44:48 juju-e4d256-prod-github-runner-207 kernel: [76862.327266] rcu_dump_cpu_stacks+0x102/0x149 Aug 23 02:44:48 juju-e4d256-prod-github-runner-207 kernel: [76862.328044] print_cpu_stall.cold+0x2f/0xe2 Aug 23 02:44:48 juju-e4d256-prod-github-runner-207 kernel: [76862.328816] ? timekeeping_update+0xf7/0x150 Aug 23 02:44:48 juju-e4d256-prod-github-runner-207 kernel: [76862.329587] check_cpu_stall+0x109/0x270 Aug 23 02:44:48 juju-e4d256-prod-github-runner-207 kernel: [76862.330334] rcu_sched_clock_irq+0x9a/0x250 Aug 23 02:44:48 juju-e4d256-prod-github-runner-207 kernel: [76862.331097] update_process_times+0x94/0xd0 Aug 23 02:44:48 juju-e4d256-prod-github-runner-207 kernel: [76862.331857] tick_sched_handle+0x29/0x70 Aug 23 02:44:48 juju-e4d256-prod-github-runner-207 kernel: [76862.332626] tick_sched_timer+0x8c/0xc0 Aug 23 02:44:48 juju-e4d256-prod-github-runner-207 kernel: [76862.333371] ? tick_nohz_handler+0xb0/0xb0 Aug 23 02:44:48 juju-e4d256-prod-github-runner-207 kernel: [76862.334130] __hrtimer_run_queues+0x107/0x230 Aug 23 02:44:48 juju-e4d256-prod-github-runner-207 kernel: [76862.334910] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 02:44:48 juju-e4d256-prod-github-runner-207 kernel: [76862.335684] hrtimer_interrupt+0x101/0x220 Aug 23 02:44:48 juju-e4d256-prod-github-runner-207 kernel: [76862.336459] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 02:44:48 juju-e4d256-prod-github-runner-207 kernel: [76862.337279] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 02:44:48 juju-e4d256-prod-github-runner-207 kernel: [76862.338087] Aug 23 02:44:48 juju-e4d256-prod-github-runner-207 kernel: [76862.338722] Aug 23 02:44:48 juju-e4d256-prod-github-runner-207 kernel: [76862.339350] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 02:44:48 juju-e4d256-prod-github-runner-207 kernel: [76862.340182] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:44:48 juju-e4d256-prod-github-runner-207 kernel: [76862.341062] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 02:44:48 juju-e4d256-prod-github-runner-207 kernel: [76862.343280] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 02:44:48 juju-e4d256-prod-github-runner-207 kernel: [76862.344167] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 02:44:48 juju-e4d256-prod-github-runner-207 kernel: [76862.345340] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 02:44:48 juju-e4d256-prod-github-runner-207 kernel: [76862.346316] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 02:44:48 juju-e4d256-prod-github-runner-207 kernel: [76862.347282] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 02:44:48 juju-e4d256-prod-github-runner-207 kernel: [76862.348254] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 02:44:48 juju-e4d256-prod-github-runner-207 kernel: [76862.349214] ? _raw_spin_lock+0x22/0x30 Aug 23 02:44:48 juju-e4d256-prod-github-runner-207 kernel: [76862.350017] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:44:48 juju-e4d256-prod-github-runner-207 kernel: [76862.350877] direct_page_fault+0x206/0x310 [kvm] Aug 23 02:44:48 juju-e4d256-prod-github-runner-207 kernel: [76862.351714] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 02:44:48 juju-e4d256-prod-github-runner-207 kernel: [76862.352557] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 02:44:48 juju-e4d256-prod-github-runner-207 kernel: [76862.353404] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 02:44:48 juju-e4d256-prod-github-runner-207 kernel: [76862.354234] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 02:44:48 juju-e4d256-prod-github-runner-207 kernel: [76862.355018] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 02:44:48 juju-e4d256-prod-github-runner-207 kernel: [76862.355838] handle_exit+0x98/0x230 [kvm_amd] Aug 23 02:44:48 juju-e4d256-prod-github-runner-207 kernel: [76862.356609] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 02:44:48 juju-e4d256-prod-github-runner-207 kernel: [76862.357393] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 02:44:48 juju-e4d256-prod-github-runner-207 kernel: [76862.358189] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 02:44:48 juju-e4d256-prod-github-runner-207 kernel: [76862.358974] vcpu_run+0x62/0x2c0 [kvm] Aug 23 02:44:48 juju-e4d256-prod-github-runner-207 kernel: [76862.359688] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 02:44:48 juju-e4d256-prod-github-runner-207 kernel: [76862.360436] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 02:44:48 juju-e4d256-prod-github-runner-207 kernel: [76862.361237] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 02:44:48 juju-e4d256-prod-github-runner-207 kernel: [76862.362002] ? __seccomp_filter+0x4a/0x4a0 Aug 23 02:44:48 juju-e4d256-prod-github-runner-207 kernel: [76862.362721] ? __fget_files+0x86/0xc0 Aug 23 02:44:48 juju-e4d256-prod-github-runner-207 kernel: [76862.363414] __x64_sys_ioctl+0x95/0xd0 Aug 23 02:44:48 juju-e4d256-prod-github-runner-207 kernel: [76862.364117] do_syscall_64+0x5c/0xc0 Aug 23 02:44:48 juju-e4d256-prod-github-runner-207 kernel: [76862.364796] ? do_futex+0x162/0x1f0 Aug 23 02:44:48 juju-e4d256-prod-github-runner-207 kernel: [76862.365481] ? __x64_sys_futex+0x78/0x1e0 Aug 23 02:44:48 juju-e4d256-prod-github-runner-207 kernel: [76862.366181] ? __secure_computing+0xa9/0x120 Aug 23 02:44:48 juju-e4d256-prod-github-runner-207 kernel: [76862.366896] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 02:44:48 juju-e4d256-prod-github-runner-207 kernel: [76862.367685] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:44:48 juju-e4d256-prod-github-runner-207 kernel: [76862.368453] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:44:48 juju-e4d256-prod-github-runner-207 kernel: [76862.369211] ? do_syscall_64+0x69/0xc0 Aug 23 02:44:48 juju-e4d256-prod-github-runner-207 kernel: [76862.369899] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:44:48 juju-e4d256-prod-github-runner-207 kernel: [76862.370651] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:44:48 juju-e4d256-prod-github-runner-207 kernel: [76862.371407] ? do_syscall_64+0x69/0xc0 Aug 23 02:44:48 juju-e4d256-prod-github-runner-207 kernel: [76862.372983] ? do_syscall_64+0x69/0xc0 Aug 23 02:44:48 juju-e4d256-prod-github-runner-207 kernel: [76862.373684] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 02:44:48 juju-e4d256-prod-github-runner-207 kernel: [76862.374454] RIP: 0033:0x7faa5d0edaff Aug 23 02:44:48 juju-e4d256-prod-github-runner-207 kernel: [76862.375173] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 02:44:48 juju-e4d256-prod-github-runner-207 kernel: [76862.377318] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 02:44:48 juju-e4d256-prod-github-runner-207 kernel: [76862.378286] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 02:44:48 juju-e4d256-prod-github-runner-207 kernel: [76862.379231] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 02:44:48 juju-e4d256-prod-github-runner-207 kernel: [76862.380195] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 02:44:48 juju-e4d256-prod-github-runner-207 kernel: [76862.381140] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 02:44:48 juju-e4d256-prod-github-runner-207 kernel: [76862.382066] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 02:44:48 juju-e4d256-prod-github-runner-207 kernel: [76862.382981] Aug 23 02:45:14 juju-e4d256-prod-github-runner-207 kernel: [76888.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 71500s! [qemu-system-x86:6715] Aug 23 02:45:14 juju-e4d256-prod-github-runner-207 kernel: [76888.543904] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 02:45:14 juju-e4d256-prod-github-runner-207 kernel: [76888.544222] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 02:45:14 juju-e4d256-prod-github-runner-207 kernel: [76888.556332] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 02:45:14 juju-e4d256-prod-github-runner-207 kernel: [76888.557607] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 02:45:14 juju-e4d256-prod-github-runner-207 kernel: [76888.558817] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:45:14 juju-e4d256-prod-github-runner-207 kernel: [76888.559893] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 02:45:14 juju-e4d256-prod-github-runner-207 kernel: [76888.562431] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 02:45:14 juju-e4d256-prod-github-runner-207 kernel: [76888.563470] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 02:45:14 juju-e4d256-prod-github-runner-207 kernel: [76888.564641] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 02:45:14 juju-e4d256-prod-github-runner-207 kernel: [76888.565805] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 02:45:14 juju-e4d256-prod-github-runner-207 kernel: [76888.566980] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 02:45:14 juju-e4d256-prod-github-runner-207 kernel: [76888.568164] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 02:45:14 juju-e4d256-prod-github-runner-207 kernel: [76888.569353] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 02:45:14 juju-e4d256-prod-github-runner-207 kernel: [76888.570600] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 02:45:14 juju-e4d256-prod-github-runner-207 kernel: [76888.571701] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 02:45:14 juju-e4d256-prod-github-runner-207 kernel: [76888.572918] Call Trace: Aug 23 02:45:14 juju-e4d256-prod-github-runner-207 kernel: [76888.573828] Aug 23 02:45:14 juju-e4d256-prod-github-runner-207 kernel: [76888.574717] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:45:14 juju-e4d256-prod-github-runner-207 kernel: [76888.575746] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:45:14 juju-e4d256-prod-github-runner-207 kernel: [76888.576776] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:45:14 juju-e4d256-prod-github-runner-207 kernel: [76888.577864] ? show_regs.part.0+0x23/0x29 Aug 23 02:45:14 juju-e4d256-prod-github-runner-207 kernel: [76888.578863] ? show_regs.cold+0x8/0xd Aug 23 02:45:14 juju-e4d256-prod-github-runner-207 kernel: [76888.579854] ? watchdog_timer_fn+0x1be/0x220 Aug 23 02:45:14 juju-e4d256-prod-github-runner-207 kernel: [76888.580860] ? lockup_detector_update_enable+0x60/0x60 Aug 23 02:45:14 juju-e4d256-prod-github-runner-207 kernel: [76888.581920] ? __hrtimer_run_queues+0x107/0x230 Aug 23 02:45:14 juju-e4d256-prod-github-runner-207 kernel: [76888.582944] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 02:45:14 juju-e4d256-prod-github-runner-207 kernel: [76888.583979] ? hrtimer_interrupt+0x101/0x220 Aug 23 02:45:14 juju-e4d256-prod-github-runner-207 kernel: [76888.584996] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 02:45:14 juju-e4d256-prod-github-runner-207 kernel: [76888.586063] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 02:45:14 juju-e4d256-prod-github-runner-207 kernel: [76888.587110] Aug 23 02:45:14 juju-e4d256-prod-github-runner-207 kernel: [76888.587980] Aug 23 02:45:14 juju-e4d256-prod-github-runner-207 kernel: [76888.588829] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 02:45:14 juju-e4d256-prod-github-runner-207 kernel: [76888.589860] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:45:14 juju-e4d256-prod-github-runner-207 kernel: [76888.590902] ? _raw_spin_lock+0x22/0x30 Aug 23 02:45:14 juju-e4d256-prod-github-runner-207 kernel: [76888.591862] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:45:14 juju-e4d256-prod-github-runner-207 kernel: [76888.592876] direct_page_fault+0x206/0x310 [kvm] Aug 23 02:45:14 juju-e4d256-prod-github-runner-207 kernel: [76888.593897] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 02:45:14 juju-e4d256-prod-github-runner-207 kernel: [76888.594902] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 02:45:14 juju-e4d256-prod-github-runner-207 kernel: [76888.595913] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 02:45:14 juju-e4d256-prod-github-runner-207 kernel: [76888.596911] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 02:45:14 juju-e4d256-prod-github-runner-207 kernel: [76888.597854] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 02:45:14 juju-e4d256-prod-github-runner-207 kernel: [76888.598828] handle_exit+0x98/0x230 [kvm_amd] Aug 23 02:45:14 juju-e4d256-prod-github-runner-207 kernel: [76888.599717] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 02:45:14 juju-e4d256-prod-github-runner-207 kernel: [76888.600644] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 02:45:14 juju-e4d256-prod-github-runner-207 kernel: [76888.601570] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 02:45:14 juju-e4d256-prod-github-runner-207 kernel: [76888.602470] vcpu_run+0x62/0x2c0 [kvm] Aug 23 02:45:14 juju-e4d256-prod-github-runner-207 kernel: [76888.603282] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 02:45:14 juju-e4d256-prod-github-runner-207 kernel: [76888.604104] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 02:45:14 juju-e4d256-prod-github-runner-207 kernel: [76888.604961] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 02:45:14 juju-e4d256-prod-github-runner-207 kernel: [76888.605757] ? __seccomp_filter+0x4a/0x4a0 Aug 23 02:45:14 juju-e4d256-prod-github-runner-207 kernel: [76888.606517] ? __fget_files+0x86/0xc0 Aug 23 02:45:14 juju-e4d256-prod-github-runner-207 kernel: [76888.607225] __x64_sys_ioctl+0x95/0xd0 Aug 23 02:45:14 juju-e4d256-prod-github-runner-207 kernel: [76888.607928] do_syscall_64+0x5c/0xc0 Aug 23 02:45:14 juju-e4d256-prod-github-runner-207 kernel: [76888.608592] ? do_futex+0x162/0x1f0 Aug 23 02:45:14 juju-e4d256-prod-github-runner-207 kernel: [76888.609245] ? __x64_sys_futex+0x78/0x1e0 Aug 23 02:45:14 juju-e4d256-prod-github-runner-207 kernel: [76888.609917] ? __secure_computing+0xa9/0x120 Aug 23 02:45:14 juju-e4d256-prod-github-runner-207 kernel: [76888.610605] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 02:45:14 juju-e4d256-prod-github-runner-207 kernel: [76888.611362] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:45:14 juju-e4d256-prod-github-runner-207 kernel: [76888.612101] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:45:14 juju-e4d256-prod-github-runner-207 kernel: [76888.612828] ? do_syscall_64+0x69/0xc0 Aug 23 02:45:14 juju-e4d256-prod-github-runner-207 kernel: [76888.613519] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:45:14 juju-e4d256-prod-github-runner-207 kernel: [76888.614257] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:45:14 juju-e4d256-prod-github-runner-207 kernel: [76888.614988] ? do_syscall_64+0x69/0xc0 Aug 23 02:45:14 juju-e4d256-prod-github-runner-207 kernel: [76888.615622] ? do_syscall_64+0x69/0xc0 Aug 23 02:45:14 juju-e4d256-prod-github-runner-207 kernel: [76888.616276] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 02:45:14 juju-e4d256-prod-github-runner-207 kernel: [76888.616979] RIP: 0033:0x7faa5d0edaff Aug 23 02:45:14 juju-e4d256-prod-github-runner-207 kernel: [76888.617678] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 02:45:14 juju-e4d256-prod-github-runner-207 kernel: [76888.619652] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 02:45:14 juju-e4d256-prod-github-runner-207 kernel: [76888.620581] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 02:45:14 juju-e4d256-prod-github-runner-207 kernel: [76888.621469] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 02:45:14 juju-e4d256-prod-github-runner-207 kernel: [76888.622364] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 02:45:14 juju-e4d256-prod-github-runner-207 kernel: [76888.623248] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 02:45:14 juju-e4d256-prod-github-runner-207 kernel: [76888.624148] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 02:45:14 juju-e4d256-prod-github-runner-207 kernel: [76888.625038] Aug 23 02:45:42 juju-e4d256-prod-github-runner-207 kernel: [76916.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 71526s! [qemu-system-x86:6715] Aug 23 02:45:42 juju-e4d256-prod-github-runner-207 kernel: [76916.543906] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 02:45:42 juju-e4d256-prod-github-runner-207 kernel: [76916.544219] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 02:45:42 juju-e4d256-prod-github-runner-207 kernel: [76916.556287] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 02:45:42 juju-e4d256-prod-github-runner-207 kernel: [76916.557612] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 02:45:42 juju-e4d256-prod-github-runner-207 kernel: [76916.558828] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:45:42 juju-e4d256-prod-github-runner-207 kernel: [76916.559910] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 02:45:42 juju-e4d256-prod-github-runner-207 kernel: [76916.562452] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 02:45:42 juju-e4d256-prod-github-runner-207 kernel: [76916.563505] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 02:45:42 juju-e4d256-prod-github-runner-207 kernel: [76916.564755] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 02:45:42 juju-e4d256-prod-github-runner-207 kernel: [76916.565936] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 02:45:42 juju-e4d256-prod-github-runner-207 kernel: [76916.567097] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 02:45:42 juju-e4d256-prod-github-runner-207 kernel: [76916.568265] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 02:45:42 juju-e4d256-prod-github-runner-207 kernel: [76916.569431] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 02:45:42 juju-e4d256-prod-github-runner-207 kernel: [76916.570660] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 02:45:42 juju-e4d256-prod-github-runner-207 kernel: [76916.571767] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 02:45:42 juju-e4d256-prod-github-runner-207 kernel: [76916.572960] Call Trace: Aug 23 02:45:42 juju-e4d256-prod-github-runner-207 kernel: [76916.573874] Aug 23 02:45:42 juju-e4d256-prod-github-runner-207 kernel: [76916.574774] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:45:42 juju-e4d256-prod-github-runner-207 kernel: [76916.575821] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:45:42 juju-e4d256-prod-github-runner-207 kernel: [76916.576841] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:45:42 juju-e4d256-prod-github-runner-207 kernel: [76916.577940] ? show_regs.part.0+0x23/0x29 Aug 23 02:45:42 juju-e4d256-prod-github-runner-207 kernel: [76916.578938] ? show_regs.cold+0x8/0xd Aug 23 02:45:42 juju-e4d256-prod-github-runner-207 kernel: [76916.579938] ? watchdog_timer_fn+0x1be/0x220 Aug 23 02:45:42 juju-e4d256-prod-github-runner-207 kernel: [76916.580969] ? lockup_detector_update_enable+0x60/0x60 Aug 23 02:45:42 juju-e4d256-prod-github-runner-207 kernel: [76916.582032] ? __hrtimer_run_queues+0x107/0x230 Aug 23 02:45:42 juju-e4d256-prod-github-runner-207 kernel: [76916.583060] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 02:45:42 juju-e4d256-prod-github-runner-207 kernel: [76916.584094] ? hrtimer_interrupt+0x101/0x220 Aug 23 02:45:42 juju-e4d256-prod-github-runner-207 kernel: [76916.585113] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 02:45:42 juju-e4d256-prod-github-runner-207 kernel: [76916.586180] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 02:45:42 juju-e4d256-prod-github-runner-207 kernel: [76916.587231] Aug 23 02:45:42 juju-e4d256-prod-github-runner-207 kernel: [76916.588103] Aug 23 02:45:42 juju-e4d256-prod-github-runner-207 kernel: [76916.588940] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 02:45:42 juju-e4d256-prod-github-runner-207 kernel: [76916.589972] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:45:42 juju-e4d256-prod-github-runner-207 kernel: [76916.591014] ? _raw_spin_lock+0x22/0x30 Aug 23 02:45:42 juju-e4d256-prod-github-runner-207 kernel: [76916.591973] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:45:42 juju-e4d256-prod-github-runner-207 kernel: [76916.593001] direct_page_fault+0x206/0x310 [kvm] Aug 23 02:45:42 juju-e4d256-prod-github-runner-207 kernel: [76916.594024] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 02:45:42 juju-e4d256-prod-github-runner-207 kernel: [76916.595078] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 02:45:42 juju-e4d256-prod-github-runner-207 kernel: [76916.596108] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 02:45:42 juju-e4d256-prod-github-runner-207 kernel: [76916.597117] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 02:45:42 juju-e4d256-prod-github-runner-207 kernel: [76916.598067] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 02:45:42 juju-e4d256-prod-github-runner-207 kernel: [76916.599058] handle_exit+0x98/0x230 [kvm_amd] Aug 23 02:45:42 juju-e4d256-prod-github-runner-207 kernel: [76916.599970] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 02:45:42 juju-e4d256-prod-github-runner-207 kernel: [76916.600882] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 02:45:42 juju-e4d256-prod-github-runner-207 kernel: [76916.601807] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 02:45:42 juju-e4d256-prod-github-runner-207 kernel: [76916.602713] vcpu_run+0x62/0x2c0 [kvm] Aug 23 02:45:42 juju-e4d256-prod-github-runner-207 kernel: [76916.603554] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 02:45:42 juju-e4d256-prod-github-runner-207 kernel: [76916.604360] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 02:45:42 juju-e4d256-prod-github-runner-207 kernel: [76916.605221] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 02:45:42 juju-e4d256-prod-github-runner-207 kernel: [76916.606026] ? __seccomp_filter+0x4a/0x4a0 Aug 23 02:45:42 juju-e4d256-prod-github-runner-207 kernel: [76916.606926] ? __fget_files+0x86/0xc0 Aug 23 02:45:42 juju-e4d256-prod-github-runner-207 kernel: [76916.607643] __x64_sys_ioctl+0x95/0xd0 Aug 23 02:45:42 juju-e4d256-prod-github-runner-207 kernel: [76916.608336] do_syscall_64+0x5c/0xc0 Aug 23 02:45:42 juju-e4d256-prod-github-runner-207 kernel: [76916.609006] ? do_futex+0x162/0x1f0 Aug 23 02:45:42 juju-e4d256-prod-github-runner-207 kernel: [76916.609653] ? __x64_sys_futex+0x78/0x1e0 Aug 23 02:45:42 juju-e4d256-prod-github-runner-207 kernel: [76916.610326] ? __secure_computing+0xa9/0x120 Aug 23 02:45:42 juju-e4d256-prod-github-runner-207 kernel: [76916.611015] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 02:45:42 juju-e4d256-prod-github-runner-207 kernel: [76916.611781] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:45:42 juju-e4d256-prod-github-runner-207 kernel: [76916.612511] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:45:42 juju-e4d256-prod-github-runner-207 kernel: [76916.613261] ? do_syscall_64+0x69/0xc0 Aug 23 02:45:42 juju-e4d256-prod-github-runner-207 kernel: [76916.613910] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:45:42 juju-e4d256-prod-github-runner-207 kernel: [76916.614613] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:45:42 juju-e4d256-prod-github-runner-207 kernel: [76916.615318] ? do_syscall_64+0x69/0xc0 Aug 23 02:45:42 juju-e4d256-prod-github-runner-207 kernel: [76916.615954] ? do_syscall_64+0x69/0xc0 Aug 23 02:45:42 juju-e4d256-prod-github-runner-207 kernel: [76916.616588] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 02:45:42 juju-e4d256-prod-github-runner-207 kernel: [76916.617295] RIP: 0033:0x7faa5d0edaff Aug 23 02:45:42 juju-e4d256-prod-github-runner-207 kernel: [76916.617963] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 02:45:42 juju-e4d256-prod-github-runner-207 kernel: [76916.619993] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 02:45:42 juju-e4d256-prod-github-runner-207 kernel: [76916.620910] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 02:45:42 juju-e4d256-prod-github-runner-207 kernel: [76916.621806] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 02:45:42 juju-e4d256-prod-github-runner-207 kernel: [76916.622814] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 02:45:42 juju-e4d256-prod-github-runner-207 kernel: [76916.623710] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 02:45:42 juju-e4d256-prod-github-runner-207 kernel: [76916.624600] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 02:45:42 juju-e4d256-prod-github-runner-207 kernel: [76916.625515] Aug 23 02:46:10 juju-e4d256-prod-github-runner-207 kernel: [76944.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 71552s! [qemu-system-x86:6715] Aug 23 02:46:10 juju-e4d256-prod-github-runner-207 kernel: [76944.543879] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 02:46:10 juju-e4d256-prod-github-runner-207 kernel: [76944.544164] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 02:46:10 juju-e4d256-prod-github-runner-207 kernel: [76944.557170] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 02:46:10 juju-e4d256-prod-github-runner-207 kernel: [76944.558529] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 02:46:10 juju-e4d256-prod-github-runner-207 kernel: [76944.559797] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:46:10 juju-e4d256-prod-github-runner-207 kernel: [76944.560867] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 02:46:10 juju-e4d256-prod-github-runner-207 kernel: [76944.563509] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 02:46:10 juju-e4d256-prod-github-runner-207 kernel: [76944.564601] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 02:46:10 juju-e4d256-prod-github-runner-207 kernel: [76944.565887] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 02:46:10 juju-e4d256-prod-github-runner-207 kernel: [76944.567202] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 02:46:10 juju-e4d256-prod-github-runner-207 kernel: [76944.568390] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 02:46:10 juju-e4d256-prod-github-runner-207 kernel: [76944.569581] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 02:46:10 juju-e4d256-prod-github-runner-207 kernel: [76944.570756] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 02:46:10 juju-e4d256-prod-github-runner-207 kernel: [76944.572011] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 02:46:10 juju-e4d256-prod-github-runner-207 kernel: [76944.573125] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 02:46:10 juju-e4d256-prod-github-runner-207 kernel: [76944.574348] Call Trace: Aug 23 02:46:10 juju-e4d256-prod-github-runner-207 kernel: [76944.575288] Aug 23 02:46:10 juju-e4d256-prod-github-runner-207 kernel: [76944.576186] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:46:10 juju-e4d256-prod-github-runner-207 kernel: [76944.577232] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:46:10 juju-e4d256-prod-github-runner-207 kernel: [76944.578254] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:46:10 juju-e4d256-prod-github-runner-207 kernel: [76944.579394] ? show_regs.part.0+0x23/0x29 Aug 23 02:46:10 juju-e4d256-prod-github-runner-207 kernel: [76944.580419] ? show_regs.cold+0x8/0xd Aug 23 02:46:10 juju-e4d256-prod-github-runner-207 kernel: [76944.581396] ? watchdog_timer_fn+0x1be/0x220 Aug 23 02:46:10 juju-e4d256-prod-github-runner-207 kernel: [76944.582414] ? lockup_detector_update_enable+0x60/0x60 Aug 23 02:46:10 juju-e4d256-prod-github-runner-207 kernel: [76944.583507] ? __hrtimer_run_queues+0x107/0x230 Aug 23 02:46:10 juju-e4d256-prod-github-runner-207 kernel: [76944.584575] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 02:46:10 juju-e4d256-prod-github-runner-207 kernel: [76944.585627] ? hrtimer_interrupt+0x101/0x220 Aug 23 02:46:10 juju-e4d256-prod-github-runner-207 kernel: [76944.586644] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 02:46:10 juju-e4d256-prod-github-runner-207 kernel: [76944.587735] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 02:46:10 juju-e4d256-prod-github-runner-207 kernel: [76944.588812] Aug 23 02:46:10 juju-e4d256-prod-github-runner-207 kernel: [76944.589672] Aug 23 02:46:10 juju-e4d256-prod-github-runner-207 kernel: [76944.590522] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 02:46:10 juju-e4d256-prod-github-runner-207 kernel: [76944.591630] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:46:10 juju-e4d256-prod-github-runner-207 kernel: [76944.592705] ? _raw_spin_lock+0x22/0x30 Aug 23 02:46:10 juju-e4d256-prod-github-runner-207 kernel: [76944.593661] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:46:10 juju-e4d256-prod-github-runner-207 kernel: [76944.594696] direct_page_fault+0x206/0x310 [kvm] Aug 23 02:46:10 juju-e4d256-prod-github-runner-207 kernel: [76944.595800] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 02:46:10 juju-e4d256-prod-github-runner-207 kernel: [76944.596893] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 02:46:10 juju-e4d256-prod-github-runner-207 kernel: [76944.597917] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 02:46:10 juju-e4d256-prod-github-runner-207 kernel: [76944.598970] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 02:46:10 juju-e4d256-prod-github-runner-207 kernel: [76944.599978] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 02:46:10 juju-e4d256-prod-github-runner-207 kernel: [76944.601004] handle_exit+0x98/0x230 [kvm_amd] Aug 23 02:46:10 juju-e4d256-prod-github-runner-207 kernel: [76944.601918] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 02:46:10 juju-e4d256-prod-github-runner-207 kernel: [76944.602849] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 02:46:10 juju-e4d256-prod-github-runner-207 kernel: [76944.603836] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 02:46:10 juju-e4d256-prod-github-runner-207 kernel: [76944.604787] vcpu_run+0x62/0x2c0 [kvm] Aug 23 02:46:10 juju-e4d256-prod-github-runner-207 kernel: [76944.605617] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 02:46:10 juju-e4d256-prod-github-runner-207 kernel: [76944.606430] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 02:46:10 juju-e4d256-prod-github-runner-207 kernel: [76944.607306] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 02:46:10 juju-e4d256-prod-github-runner-207 kernel: [76944.608113] ? __seccomp_filter+0x4a/0x4a0 Aug 23 02:46:10 juju-e4d256-prod-github-runner-207 kernel: [76944.608879] ? __fget_files+0x86/0xc0 Aug 23 02:46:10 juju-e4d256-prod-github-runner-207 kernel: [76944.609603] __x64_sys_ioctl+0x95/0xd0 Aug 23 02:46:10 juju-e4d256-prod-github-runner-207 kernel: [76944.610472] do_syscall_64+0x5c/0xc0 Aug 23 02:46:10 juju-e4d256-prod-github-runner-207 kernel: [76944.611204] ? do_futex+0x162/0x1f0 Aug 23 02:46:10 juju-e4d256-prod-github-runner-207 kernel: [76944.611869] ? __x64_sys_futex+0x78/0x1e0 Aug 23 02:46:10 juju-e4d256-prod-github-runner-207 kernel: [76944.612561] ? __secure_computing+0xa9/0x120 Aug 23 02:46:10 juju-e4d256-prod-github-runner-207 kernel: [76944.613297] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 02:46:10 juju-e4d256-prod-github-runner-207 kernel: [76944.614074] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:46:10 juju-e4d256-prod-github-runner-207 kernel: [76944.614841] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:46:10 juju-e4d256-prod-github-runner-207 kernel: [76944.615618] ? do_syscall_64+0x69/0xc0 Aug 23 02:46:10 juju-e4d256-prod-github-runner-207 kernel: [76944.616288] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:46:10 juju-e4d256-prod-github-runner-207 kernel: [76944.617033] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:46:10 juju-e4d256-prod-github-runner-207 kernel: [76944.617752] ? do_syscall_64+0x69/0xc0 Aug 23 02:46:10 juju-e4d256-prod-github-runner-207 kernel: [76944.618386] ? do_syscall_64+0x69/0xc0 Aug 23 02:46:10 juju-e4d256-prod-github-runner-207 kernel: [76944.619047] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 02:46:10 juju-e4d256-prod-github-runner-207 kernel: [76944.619812] RIP: 0033:0x7faa5d0edaff Aug 23 02:46:10 juju-e4d256-prod-github-runner-207 kernel: [76944.620528] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 02:46:10 juju-e4d256-prod-github-runner-207 kernel: [76944.622574] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 02:46:10 juju-e4d256-prod-github-runner-207 kernel: [76944.623523] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 02:46:10 juju-e4d256-prod-github-runner-207 kernel: [76944.624459] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 02:46:10 juju-e4d256-prod-github-runner-207 kernel: [76944.625384] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 02:46:10 juju-e4d256-prod-github-runner-207 kernel: [76944.626333] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 02:46:10 juju-e4d256-prod-github-runner-207 kernel: [76944.627352] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 02:46:10 juju-e4d256-prod-github-runner-207 kernel: [76944.628276] Aug 23 02:46:38 juju-e4d256-prod-github-runner-207 kernel: [76972.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 71578s! [qemu-system-x86:6715] Aug 23 02:46:38 juju-e4d256-prod-github-runner-207 kernel: [76972.543165] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 02:46:38 juju-e4d256-prod-github-runner-207 kernel: [76972.543240] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 02:46:38 juju-e4d256-prod-github-runner-207 kernel: [76972.555549] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 02:46:38 juju-e4d256-prod-github-runner-207 kernel: [76972.556820] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 02:46:38 juju-e4d256-prod-github-runner-207 kernel: [76972.558048] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:46:38 juju-e4d256-prod-github-runner-207 kernel: [76972.559116] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 02:46:38 juju-e4d256-prod-github-runner-207 kernel: [76972.561676] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 02:46:38 juju-e4d256-prod-github-runner-207 kernel: [76972.562720] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 02:46:38 juju-e4d256-prod-github-runner-207 kernel: [76972.563915] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 02:46:38 juju-e4d256-prod-github-runner-207 kernel: [76972.565200] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 02:46:38 juju-e4d256-prod-github-runner-207 kernel: [76972.566390] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 02:46:38 juju-e4d256-prod-github-runner-207 kernel: [76972.567575] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 02:46:38 juju-e4d256-prod-github-runner-207 kernel: [76972.568759] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 02:46:38 juju-e4d256-prod-github-runner-207 kernel: [76972.569991] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 02:46:38 juju-e4d256-prod-github-runner-207 kernel: [76972.571113] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 02:46:38 juju-e4d256-prod-github-runner-207 kernel: [76972.572307] Call Trace: Aug 23 02:46:38 juju-e4d256-prod-github-runner-207 kernel: [76972.573223] Aug 23 02:46:38 juju-e4d256-prod-github-runner-207 kernel: [76972.574136] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:46:38 juju-e4d256-prod-github-runner-207 kernel: [76972.575197] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:46:38 juju-e4d256-prod-github-runner-207 kernel: [76972.576226] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:46:38 juju-e4d256-prod-github-runner-207 kernel: [76972.577300] ? show_regs.part.0+0x23/0x29 Aug 23 02:46:38 juju-e4d256-prod-github-runner-207 kernel: [76972.578297] ? show_regs.cold+0x8/0xd Aug 23 02:46:38 juju-e4d256-prod-github-runner-207 kernel: [76972.579278] ? watchdog_timer_fn+0x1be/0x220 Aug 23 02:46:38 juju-e4d256-prod-github-runner-207 kernel: [76972.580286] ? lockup_detector_update_enable+0x60/0x60 Aug 23 02:46:38 juju-e4d256-prod-github-runner-207 kernel: [76972.581353] ? __hrtimer_run_queues+0x107/0x230 Aug 23 02:46:38 juju-e4d256-prod-github-runner-207 kernel: [76972.582381] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 02:46:38 juju-e4d256-prod-github-runner-207 kernel: [76972.583410] ? hrtimer_interrupt+0x101/0x220 Aug 23 02:46:38 juju-e4d256-prod-github-runner-207 kernel: [76972.584442] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 02:46:38 juju-e4d256-prod-github-runner-207 kernel: [76972.585513] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 02:46:38 juju-e4d256-prod-github-runner-207 kernel: [76972.586565] Aug 23 02:46:38 juju-e4d256-prod-github-runner-207 kernel: [76972.587430] Aug 23 02:46:38 juju-e4d256-prod-github-runner-207 kernel: [76972.588267] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 02:46:38 juju-e4d256-prod-github-runner-207 kernel: [76972.589305] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:46:38 juju-e4d256-prod-github-runner-207 kernel: [76972.590351] ? _raw_spin_lock+0x22/0x30 Aug 23 02:46:38 juju-e4d256-prod-github-runner-207 kernel: [76972.591311] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:46:38 juju-e4d256-prod-github-runner-207 kernel: [76972.592490] direct_page_fault+0x206/0x310 [kvm] Aug 23 02:46:38 juju-e4d256-prod-github-runner-207 kernel: [76972.593574] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 02:46:38 juju-e4d256-prod-github-runner-207 kernel: [76972.594679] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 02:46:38 juju-e4d256-prod-github-runner-207 kernel: [76972.595721] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 02:46:38 juju-e4d256-prod-github-runner-207 kernel: [76972.596694] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 02:46:38 juju-e4d256-prod-github-runner-207 kernel: [76972.597644] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 02:46:38 juju-e4d256-prod-github-runner-207 kernel: [76972.598629] handle_exit+0x98/0x230 [kvm_amd] Aug 23 02:46:38 juju-e4d256-prod-github-runner-207 kernel: [76972.599541] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 02:46:38 juju-e4d256-prod-github-runner-207 kernel: [76972.600498] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 02:46:38 juju-e4d256-prod-github-runner-207 kernel: [76972.601601] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 02:46:38 juju-e4d256-prod-github-runner-207 kernel: [76972.602551] vcpu_run+0x62/0x2c0 [kvm] Aug 23 02:46:38 juju-e4d256-prod-github-runner-207 kernel: [76972.603441] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 02:46:38 juju-e4d256-prod-github-runner-207 kernel: [76972.604286] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 02:46:38 juju-e4d256-prod-github-runner-207 kernel: [76972.605150] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 02:46:38 juju-e4d256-prod-github-runner-207 kernel: [76972.606051] ? __seccomp_filter+0x4a/0x4a0 Aug 23 02:46:38 juju-e4d256-prod-github-runner-207 kernel: [76972.606808] ? __fget_files+0x86/0xc0 Aug 23 02:46:38 juju-e4d256-prod-github-runner-207 kernel: [76972.607530] __x64_sys_ioctl+0x95/0xd0 Aug 23 02:46:38 juju-e4d256-prod-github-runner-207 kernel: [76972.608231] do_syscall_64+0x5c/0xc0 Aug 23 02:46:38 juju-e4d256-prod-github-runner-207 kernel: [76972.608922] ? do_futex+0x162/0x1f0 Aug 23 02:46:38 juju-e4d256-prod-github-runner-207 kernel: [76972.609576] ? __x64_sys_futex+0x78/0x1e0 Aug 23 02:46:38 juju-e4d256-prod-github-runner-207 kernel: [76972.610252] ? __secure_computing+0xa9/0x120 Aug 23 02:46:38 juju-e4d256-prod-github-runner-207 kernel: [76972.610954] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 02:46:38 juju-e4d256-prod-github-runner-207 kernel: [76972.611717] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:46:38 juju-e4d256-prod-github-runner-207 kernel: [76972.612440] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:46:38 juju-e4d256-prod-github-runner-207 kernel: [76972.613178] ? do_syscall_64+0x69/0xc0 Aug 23 02:46:38 juju-e4d256-prod-github-runner-207 kernel: [76972.613825] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:46:38 juju-e4d256-prod-github-runner-207 kernel: [76972.614528] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:46:38 juju-e4d256-prod-github-runner-207 kernel: [76972.615244] ? do_syscall_64+0x69/0xc0 Aug 23 02:46:38 juju-e4d256-prod-github-runner-207 kernel: [76972.615884] ? do_syscall_64+0x69/0xc0 Aug 23 02:46:38 juju-e4d256-prod-github-runner-207 kernel: [76972.616528] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 02:46:38 juju-e4d256-prod-github-runner-207 kernel: [76972.617252] RIP: 0033:0x7faa5d0edaff Aug 23 02:46:38 juju-e4d256-prod-github-runner-207 kernel: [76972.617882] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 02:46:38 juju-e4d256-prod-github-runner-207 kernel: [76972.619898] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 02:46:38 juju-e4d256-prod-github-runner-207 kernel: [76972.620813] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 02:46:38 juju-e4d256-prod-github-runner-207 kernel: [76972.621706] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 02:46:38 juju-e4d256-prod-github-runner-207 kernel: [76972.622604] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 02:46:38 juju-e4d256-prod-github-runner-207 kernel: [76972.623508] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 02:46:38 juju-e4d256-prod-github-runner-207 kernel: [76972.624401] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 02:46:38 juju-e4d256-prod-github-runner-207 kernel: [76972.625322] Aug 23 02:47:06 juju-e4d256-prod-github-runner-207 kernel: [77000.541983] watchdog: BUG: soft lockup - CPU#1 stuck for 71604s! [qemu-system-x86:6715] Aug 23 02:47:06 juju-e4d256-prod-github-runner-207 kernel: [77000.543222] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 02:47:06 juju-e4d256-prod-github-runner-207 kernel: [77000.543502] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 02:47:06 juju-e4d256-prod-github-runner-207 kernel: [77000.555614] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 02:47:06 juju-e4d256-prod-github-runner-207 kernel: [77000.556916] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 02:47:06 juju-e4d256-prod-github-runner-207 kernel: [77000.558318] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:47:06 juju-e4d256-prod-github-runner-207 kernel: [77000.559466] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 02:47:06 juju-e4d256-prod-github-runner-207 kernel: [77000.562038] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 02:47:06 juju-e4d256-prod-github-runner-207 kernel: [77000.563104] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 02:47:06 juju-e4d256-prod-github-runner-207 kernel: [77000.564275] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 02:47:06 juju-e4d256-prod-github-runner-207 kernel: [77000.565441] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 02:47:06 juju-e4d256-prod-github-runner-207 kernel: [77000.566642] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 02:47:06 juju-e4d256-prod-github-runner-207 kernel: [77000.567805] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 02:47:06 juju-e4d256-prod-github-runner-207 kernel: [77000.568970] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 02:47:06 juju-e4d256-prod-github-runner-207 kernel: [77000.570208] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 02:47:06 juju-e4d256-prod-github-runner-207 kernel: [77000.571350] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 02:47:06 juju-e4d256-prod-github-runner-207 kernel: [77000.572549] Call Trace: Aug 23 02:47:06 juju-e4d256-prod-github-runner-207 kernel: [77000.573461] Aug 23 02:47:06 juju-e4d256-prod-github-runner-207 kernel: [77000.574365] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:47:06 juju-e4d256-prod-github-runner-207 kernel: [77000.575413] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:47:06 juju-e4d256-prod-github-runner-207 kernel: [77000.576436] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:47:06 juju-e4d256-prod-github-runner-207 kernel: [77000.577536] ? show_regs.part.0+0x23/0x29 Aug 23 02:47:06 juju-e4d256-prod-github-runner-207 kernel: [77000.578546] ? show_regs.cold+0x8/0xd Aug 23 02:47:06 juju-e4d256-prod-github-runner-207 kernel: [77000.579524] ? watchdog_timer_fn+0x1be/0x220 Aug 23 02:47:06 juju-e4d256-prod-github-runner-207 kernel: [77000.580532] ? lockup_detector_update_enable+0x60/0x60 Aug 23 02:47:06 juju-e4d256-prod-github-runner-207 kernel: [77000.581595] ? __hrtimer_run_queues+0x107/0x230 Aug 23 02:47:06 juju-e4d256-prod-github-runner-207 kernel: [77000.582633] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 02:47:06 juju-e4d256-prod-github-runner-207 kernel: [77000.583664] ? hrtimer_interrupt+0x101/0x220 Aug 23 02:47:06 juju-e4d256-prod-github-runner-207 kernel: [77000.584691] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 02:47:06 juju-e4d256-prod-github-runner-207 kernel: [77000.585767] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 02:47:06 juju-e4d256-prod-github-runner-207 kernel: [77000.586835] Aug 23 02:47:06 juju-e4d256-prod-github-runner-207 kernel: [77000.587688] Aug 23 02:47:06 juju-e4d256-prod-github-runner-207 kernel: [77000.588577] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 02:47:06 juju-e4d256-prod-github-runner-207 kernel: [77000.589697] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:47:06 juju-e4d256-prod-github-runner-207 kernel: [77000.590770] ? _raw_spin_lock+0x22/0x30 Aug 23 02:47:06 juju-e4d256-prod-github-runner-207 kernel: [77000.591722] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:47:06 juju-e4d256-prod-github-runner-207 kernel: [77000.592741] direct_page_fault+0x206/0x310 [kvm] Aug 23 02:47:06 juju-e4d256-prod-github-runner-207 kernel: [77000.593818] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 02:47:06 juju-e4d256-prod-github-runner-207 kernel: [77000.596823] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 02:47:06 juju-e4d256-prod-github-runner-207 kernel: [77000.597996] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 02:47:06 juju-e4d256-prod-github-runner-207 kernel: [77000.599015] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 02:47:06 juju-e4d256-prod-github-runner-207 kernel: [77000.599968] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 02:47:06 juju-e4d256-prod-github-runner-207 kernel: [77000.600949] handle_exit+0x98/0x230 [kvm_amd] Aug 23 02:47:06 juju-e4d256-prod-github-runner-207 kernel: [77000.601846] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 02:47:06 juju-e4d256-prod-github-runner-207 kernel: [77000.602787] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 02:47:06 juju-e4d256-prod-github-runner-207 kernel: [77000.603714] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 02:47:06 juju-e4d256-prod-github-runner-207 kernel: [77000.604624] vcpu_run+0x62/0x2c0 [kvm] Aug 23 02:47:06 juju-e4d256-prod-github-runner-207 kernel: [77000.605441] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 02:47:06 juju-e4d256-prod-github-runner-207 kernel: [77000.606271] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 02:47:06 juju-e4d256-prod-github-runner-207 kernel: [77000.607145] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 02:47:06 juju-e4d256-prod-github-runner-207 kernel: [77000.607951] ? __seccomp_filter+0x4a/0x4a0 Aug 23 02:47:06 juju-e4d256-prod-github-runner-207 kernel: [77000.608695] ? __fget_files+0x86/0xc0 Aug 23 02:47:06 juju-e4d256-prod-github-runner-207 kernel: [77000.609401] __x64_sys_ioctl+0x95/0xd0 Aug 23 02:47:06 juju-e4d256-prod-github-runner-207 kernel: [77000.610096] do_syscall_64+0x5c/0xc0 Aug 23 02:47:06 juju-e4d256-prod-github-runner-207 kernel: [77000.610776] ? do_futex+0x162/0x1f0 Aug 23 02:47:06 juju-e4d256-prod-github-runner-207 kernel: [77000.611426] ? __x64_sys_futex+0x78/0x1e0 Aug 23 02:47:06 juju-e4d256-prod-github-runner-207 kernel: [77000.612102] ? __secure_computing+0xa9/0x120 Aug 23 02:47:06 juju-e4d256-prod-github-runner-207 kernel: [77000.612793] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 02:47:06 juju-e4d256-prod-github-runner-207 kernel: [77000.613555] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:47:06 juju-e4d256-prod-github-runner-207 kernel: [77000.614279] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:47:06 juju-e4d256-prod-github-runner-207 kernel: [77000.615013] ? do_syscall_64+0x69/0xc0 Aug 23 02:47:06 juju-e4d256-prod-github-runner-207 kernel: [77000.615671] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:47:06 juju-e4d256-prod-github-runner-207 kernel: [77000.616392] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:47:06 juju-e4d256-prod-github-runner-207 kernel: [77000.617089] ? do_syscall_64+0x69/0xc0 Aug 23 02:47:06 juju-e4d256-prod-github-runner-207 kernel: [77000.617727] ? do_syscall_64+0x69/0xc0 Aug 23 02:47:06 juju-e4d256-prod-github-runner-207 kernel: [77000.618369] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 02:47:06 juju-e4d256-prod-github-runner-207 kernel: [77000.619105] RIP: 0033:0x7faa5d0edaff Aug 23 02:47:06 juju-e4d256-prod-github-runner-207 kernel: [77000.619753] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 02:47:06 juju-e4d256-prod-github-runner-207 kernel: [77000.621732] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 02:47:06 juju-e4d256-prod-github-runner-207 kernel: [77000.622661] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 02:47:06 juju-e4d256-prod-github-runner-207 kernel: [77000.623549] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 02:47:06 juju-e4d256-prod-github-runner-207 kernel: [77000.624513] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 02:47:06 juju-e4d256-prod-github-runner-207 kernel: [77000.625397] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 02:47:06 juju-e4d256-prod-github-runner-207 kernel: [77000.626293] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 02:47:06 juju-e4d256-prod-github-runner-207 kernel: [77000.627212] Aug 23 02:47:34 juju-e4d256-prod-github-runner-207 kernel: [77028.541976] watchdog: BUG: soft lockup - CPU#1 stuck for 71630s! [qemu-system-x86:6715] Aug 23 02:47:34 juju-e4d256-prod-github-runner-207 kernel: [77028.543084] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 02:47:34 juju-e4d256-prod-github-runner-207 kernel: [77028.543294] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 02:47:34 juju-e4d256-prod-github-runner-207 kernel: [77028.555375] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 02:47:34 juju-e4d256-prod-github-runner-207 kernel: [77028.556643] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 02:47:34 juju-e4d256-prod-github-runner-207 kernel: [77028.557860] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:47:34 juju-e4d256-prod-github-runner-207 kernel: [77028.558938] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 02:47:34 juju-e4d256-prod-github-runner-207 kernel: [77028.561497] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 02:47:34 juju-e4d256-prod-github-runner-207 kernel: [77028.562567] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 02:47:34 juju-e4d256-prod-github-runner-207 kernel: [77028.563753] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 02:47:34 juju-e4d256-prod-github-runner-207 kernel: [77028.564940] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 02:47:34 juju-e4d256-prod-github-runner-207 kernel: [77028.566106] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 02:47:34 juju-e4d256-prod-github-runner-207 kernel: [77028.567290] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 02:47:34 juju-e4d256-prod-github-runner-207 kernel: [77028.568454] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 02:47:34 juju-e4d256-prod-github-runner-207 kernel: [77028.569704] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 02:47:34 juju-e4d256-prod-github-runner-207 kernel: [77028.570821] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 02:47:34 juju-e4d256-prod-github-runner-207 kernel: [77028.572012] Call Trace: Aug 23 02:47:34 juju-e4d256-prod-github-runner-207 kernel: [77028.572921] Aug 23 02:47:34 juju-e4d256-prod-github-runner-207 kernel: [77028.573820] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:47:34 juju-e4d256-prod-github-runner-207 kernel: [77028.574877] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:47:34 juju-e4d256-prod-github-runner-207 kernel: [77028.575899] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:47:34 juju-e4d256-prod-github-runner-207 kernel: [77028.576972] ? show_regs.part.0+0x23/0x29 Aug 23 02:47:34 juju-e4d256-prod-github-runner-207 kernel: [77028.577973] ? show_regs.cold+0x8/0xd Aug 23 02:47:34 juju-e4d256-prod-github-runner-207 kernel: [77028.578955] ? watchdog_timer_fn+0x1be/0x220 Aug 23 02:47:34 juju-e4d256-prod-github-runner-207 kernel: [77028.579971] ? lockup_detector_update_enable+0x60/0x60 Aug 23 02:47:34 juju-e4d256-prod-github-runner-207 kernel: [77028.581036] ? __hrtimer_run_queues+0x107/0x230 Aug 23 02:47:34 juju-e4d256-prod-github-runner-207 kernel: [77028.582062] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 02:47:34 juju-e4d256-prod-github-runner-207 kernel: [77028.583105] ? hrtimer_interrupt+0x101/0x220 Aug 23 02:47:34 juju-e4d256-prod-github-runner-207 kernel: [77028.584135] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 02:47:34 juju-e4d256-prod-github-runner-207 kernel: [77028.585206] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 02:47:34 juju-e4d256-prod-github-runner-207 kernel: [77028.586267] Aug 23 02:47:34 juju-e4d256-prod-github-runner-207 kernel: [77028.587117] Aug 23 02:47:34 juju-e4d256-prod-github-runner-207 kernel: [77028.587957] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 02:47:34 juju-e4d256-prod-github-runner-207 kernel: [77028.588984] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:47:34 juju-e4d256-prod-github-runner-207 kernel: [77028.590029] ? _raw_spin_lock+0x22/0x30 Aug 23 02:47:34 juju-e4d256-prod-github-runner-207 kernel: [77028.591002] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:47:34 juju-e4d256-prod-github-runner-207 kernel: [77028.592051] direct_page_fault+0x206/0x310 [kvm] Aug 23 02:47:34 juju-e4d256-prod-github-runner-207 kernel: [77028.593092] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 02:47:34 juju-e4d256-prod-github-runner-207 kernel: [77028.594142] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 02:47:34 juju-e4d256-prod-github-runner-207 kernel: [77028.595187] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 02:47:34 juju-e4d256-prod-github-runner-207 kernel: [77028.596157] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 02:47:34 juju-e4d256-prod-github-runner-207 kernel: [77028.597108] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 02:47:34 juju-e4d256-prod-github-runner-207 kernel: [77028.598085] handle_exit+0x98/0x230 [kvm_amd] Aug 23 02:47:34 juju-e4d256-prod-github-runner-207 kernel: [77028.599029] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 02:47:34 juju-e4d256-prod-github-runner-207 kernel: [77028.599961] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 02:47:34 juju-e4d256-prod-github-runner-207 kernel: [77028.600914] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 02:47:34 juju-e4d256-prod-github-runner-207 kernel: [77028.601818] vcpu_run+0x62/0x2c0 [kvm] Aug 23 02:47:34 juju-e4d256-prod-github-runner-207 kernel: [77028.602663] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 02:47:34 juju-e4d256-prod-github-runner-207 kernel: [77028.603482] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 02:47:34 juju-e4d256-prod-github-runner-207 kernel: [77028.604344] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 02:47:34 juju-e4d256-prod-github-runner-207 kernel: [77028.605141] ? __seccomp_filter+0x4a/0x4a0 Aug 23 02:47:34 juju-e4d256-prod-github-runner-207 kernel: [77028.605890] ? __fget_files+0x86/0xc0 Aug 23 02:47:34 juju-e4d256-prod-github-runner-207 kernel: [77028.606619] __x64_sys_ioctl+0x95/0xd0 Aug 23 02:47:34 juju-e4d256-prod-github-runner-207 kernel: [77028.607316] do_syscall_64+0x5c/0xc0 Aug 23 02:47:34 juju-e4d256-prod-github-runner-207 kernel: [77028.607983] ? do_futex+0x162/0x1f0 Aug 23 02:47:34 juju-e4d256-prod-github-runner-207 kernel: [77028.608635] ? __x64_sys_futex+0x78/0x1e0 Aug 23 02:47:34 juju-e4d256-prod-github-runner-207 kernel: [77028.609323] ? __secure_computing+0xa9/0x120 Aug 23 02:47:34 juju-e4d256-prod-github-runner-207 kernel: [77028.610017] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 02:47:34 juju-e4d256-prod-github-runner-207 kernel: [77028.610795] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:47:34 juju-e4d256-prod-github-runner-207 kernel: [77028.611515] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:47:34 juju-e4d256-prod-github-runner-207 kernel: [77028.612265] ? do_syscall_64+0x69/0xc0 Aug 23 02:47:34 juju-e4d256-prod-github-runner-207 kernel: [77028.612919] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:47:34 juju-e4d256-prod-github-runner-207 kernel: [77028.613637] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:47:34 juju-e4d256-prod-github-runner-207 kernel: [77028.614358] ? do_syscall_64+0x69/0xc0 Aug 23 02:47:34 juju-e4d256-prod-github-runner-207 kernel: [77028.614983] ? do_syscall_64+0x69/0xc0 Aug 23 02:47:34 juju-e4d256-prod-github-runner-207 kernel: [77028.615605] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 02:47:34 juju-e4d256-prod-github-runner-207 kernel: [77028.616308] RIP: 0033:0x7faa5d0edaff Aug 23 02:47:34 juju-e4d256-prod-github-runner-207 kernel: [77028.616949] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 02:47:34 juju-e4d256-prod-github-runner-207 kernel: [77028.618991] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 02:47:34 juju-e4d256-prod-github-runner-207 kernel: [77028.619905] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 02:47:34 juju-e4d256-prod-github-runner-207 kernel: [77028.620798] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 02:47:34 juju-e4d256-prod-github-runner-207 kernel: [77028.621684] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 02:47:34 juju-e4d256-prod-github-runner-207 kernel: [77028.622590] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 02:47:34 juju-e4d256-prod-github-runner-207 kernel: [77028.623485] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 02:47:34 juju-e4d256-prod-github-runner-207 kernel: [77028.624428] Aug 23 02:47:48 juju-e4d256-prod-github-runner-207 kernel: [77042.324710] rcu: INFO: rcu_sched self-detected stall on CPU Aug 23 02:47:48 juju-e4d256-prod-github-runner-207 kernel: [77042.325677] rcu: 1-....: (19170895 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=9268714 Aug 23 02:47:48 juju-e4d256-prod-github-runner-207 kernel: [77042.326823] (t=19231281 jiffies g=23269 q=64802) Aug 23 02:47:48 juju-e4d256-prod-github-runner-207 kernel: [77042.327615] NMI backtrace for cpu 1 Aug 23 02:47:48 juju-e4d256-prod-github-runner-207 kernel: [77042.328325] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 02:47:48 juju-e4d256-prod-github-runner-207 kernel: [77042.329435] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 02:47:48 juju-e4d256-prod-github-runner-207 kernel: [77042.330504] Call Trace: Aug 23 02:47:48 juju-e4d256-prod-github-runner-207 kernel: [77042.331182] Aug 23 02:47:48 juju-e4d256-prod-github-runner-207 kernel: [77042.331830] show_stack+0x52/0x5c Aug 23 02:47:48 juju-e4d256-prod-github-runner-207 kernel: [77042.332560] dump_stack_lvl+0x4a/0x63 Aug 23 02:47:48 juju-e4d256-prod-github-runner-207 kernel: [77042.333311] dump_stack+0x10/0x16 Aug 23 02:47:48 juju-e4d256-prod-github-runner-207 kernel: [77042.334047] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 23 02:47:48 juju-e4d256-prod-github-runner-207 kernel: [77042.334831] ? lapic_can_unplug_cpu+0x90/0x90 Aug 23 02:47:48 juju-e4d256-prod-github-runner-207 kernel: [77042.335608] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 23 02:47:48 juju-e4d256-prod-github-runner-207 kernel: [77042.336425] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 23 02:47:48 juju-e4d256-prod-github-runner-207 kernel: [77042.337263] trigger_single_cpu_backtrace+0x44/0x4f Aug 23 02:47:48 juju-e4d256-prod-github-runner-207 kernel: [77042.338092] rcu_dump_cpu_stacks+0x102/0x149 Aug 23 02:47:48 juju-e4d256-prod-github-runner-207 kernel: [77042.338868] print_cpu_stall.cold+0x2f/0xe2 Aug 23 02:47:48 juju-e4d256-prod-github-runner-207 kernel: [77042.339633] ? timekeeping_update+0xf7/0x150 Aug 23 02:47:48 juju-e4d256-prod-github-runner-207 kernel: [77042.340404] check_cpu_stall+0x109/0x270 Aug 23 02:47:48 juju-e4d256-prod-github-runner-207 kernel: [77042.341151] rcu_sched_clock_irq+0x9a/0x250 Aug 23 02:47:48 juju-e4d256-prod-github-runner-207 kernel: [77042.341918] update_process_times+0x94/0xd0 Aug 23 02:47:48 juju-e4d256-prod-github-runner-207 kernel: [77042.342695] tick_sched_handle+0x29/0x70 Aug 23 02:47:48 juju-e4d256-prod-github-runner-207 kernel: [77042.343450] tick_sched_timer+0x8c/0xc0 Aug 23 02:47:48 juju-e4d256-prod-github-runner-207 kernel: [77042.344188] ? tick_nohz_handler+0xb0/0xb0 Aug 23 02:47:48 juju-e4d256-prod-github-runner-207 kernel: [77042.344947] __hrtimer_run_queues+0x107/0x230 Aug 23 02:47:48 juju-e4d256-prod-github-runner-207 kernel: [77042.345726] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 02:47:48 juju-e4d256-prod-github-runner-207 kernel: [77042.346525] hrtimer_interrupt+0x101/0x220 Aug 23 02:47:48 juju-e4d256-prod-github-runner-207 kernel: [77042.347288] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 02:47:48 juju-e4d256-prod-github-runner-207 kernel: [77042.348176] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 02:47:48 juju-e4d256-prod-github-runner-207 kernel: [77042.349126] Aug 23 02:47:48 juju-e4d256-prod-github-runner-207 kernel: [77042.349793] Aug 23 02:47:48 juju-e4d256-prod-github-runner-207 kernel: [77042.350468] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 02:47:48 juju-e4d256-prod-github-runner-207 kernel: [77042.351387] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:47:48 juju-e4d256-prod-github-runner-207 kernel: [77042.352288] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 02:47:48 juju-e4d256-prod-github-runner-207 kernel: [77042.354521] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 02:47:48 juju-e4d256-prod-github-runner-207 kernel: [77042.355403] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 02:47:48 juju-e4d256-prod-github-runner-207 kernel: [77042.356400] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 02:47:48 juju-e4d256-prod-github-runner-207 kernel: [77042.357386] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 02:47:48 juju-e4d256-prod-github-runner-207 kernel: [77042.358371] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 02:47:48 juju-e4d256-prod-github-runner-207 kernel: [77042.359328] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 02:47:48 juju-e4d256-prod-github-runner-207 kernel: [77042.360306] ? _raw_spin_lock+0x22/0x30 Aug 23 02:47:48 juju-e4d256-prod-github-runner-207 kernel: [77042.361072] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:47:48 juju-e4d256-prod-github-runner-207 kernel: [77042.361926] direct_page_fault+0x206/0x310 [kvm] Aug 23 02:47:48 juju-e4d256-prod-github-runner-207 kernel: [77042.362794] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 02:47:48 juju-e4d256-prod-github-runner-207 kernel: [77042.363623] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 02:47:48 juju-e4d256-prod-github-runner-207 kernel: [77042.364446] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 02:47:48 juju-e4d256-prod-github-runner-207 kernel: [77042.365307] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 02:47:48 juju-e4d256-prod-github-runner-207 kernel: [77042.366112] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 02:47:48 juju-e4d256-prod-github-runner-207 kernel: [77042.366945] handle_exit+0x98/0x230 [kvm_amd] Aug 23 02:47:48 juju-e4d256-prod-github-runner-207 kernel: [77042.367699] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 02:47:48 juju-e4d256-prod-github-runner-207 kernel: [77042.368483] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 02:47:48 juju-e4d256-prod-github-runner-207 kernel: [77042.369305] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 02:47:48 juju-e4d256-prod-github-runner-207 kernel: [77042.370114] vcpu_run+0x62/0x2c0 [kvm] Aug 23 02:47:48 juju-e4d256-prod-github-runner-207 kernel: [77042.370836] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 02:47:48 juju-e4d256-prod-github-runner-207 kernel: [77042.371572] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 02:47:48 juju-e4d256-prod-github-runner-207 kernel: [77042.372377] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 02:47:48 juju-e4d256-prod-github-runner-207 kernel: [77042.373155] ? __seccomp_filter+0x4a/0x4a0 Aug 23 02:47:48 juju-e4d256-prod-github-runner-207 kernel: [77042.373879] ? __fget_files+0x86/0xc0 Aug 23 02:47:48 juju-e4d256-prod-github-runner-207 kernel: [77042.374587] __x64_sys_ioctl+0x95/0xd0 Aug 23 02:47:48 juju-e4d256-prod-github-runner-207 kernel: [77042.375281] do_syscall_64+0x5c/0xc0 Aug 23 02:47:48 juju-e4d256-prod-github-runner-207 kernel: [77042.375961] ? do_futex+0x162/0x1f0 Aug 23 02:47:48 juju-e4d256-prod-github-runner-207 kernel: [77042.376632] ? __x64_sys_futex+0x78/0x1e0 Aug 23 02:47:48 juju-e4d256-prod-github-runner-207 kernel: [77042.377333] ? __secure_computing+0xa9/0x120 Aug 23 02:47:48 juju-e4d256-prod-github-runner-207 kernel: [77042.378068] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 02:47:48 juju-e4d256-prod-github-runner-207 kernel: [77042.378867] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:47:48 juju-e4d256-prod-github-runner-207 kernel: [77042.379666] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:47:48 juju-e4d256-prod-github-runner-207 kernel: [77042.380427] ? do_syscall_64+0x69/0xc0 Aug 23 02:47:48 juju-e4d256-prod-github-runner-207 kernel: [77042.381150] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:47:48 juju-e4d256-prod-github-runner-207 kernel: [77042.381917] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:47:48 juju-e4d256-prod-github-runner-207 kernel: [77042.382720] ? do_syscall_64+0x69/0xc0 Aug 23 02:47:48 juju-e4d256-prod-github-runner-207 kernel: [77042.383425] ? do_syscall_64+0x69/0xc0 Aug 23 02:47:48 juju-e4d256-prod-github-runner-207 kernel: [77042.384117] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 02:47:48 juju-e4d256-prod-github-runner-207 kernel: [77042.384888] RIP: 0033:0x7faa5d0edaff Aug 23 02:47:48 juju-e4d256-prod-github-runner-207 kernel: [77042.385569] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 02:47:48 juju-e4d256-prod-github-runner-207 kernel: [77042.387704] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 02:47:48 juju-e4d256-prod-github-runner-207 kernel: [77042.388672] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 02:47:48 juju-e4d256-prod-github-runner-207 kernel: [77042.389623] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 02:47:48 juju-e4d256-prod-github-runner-207 kernel: [77042.390591] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 02:47:48 juju-e4d256-prod-github-runner-207 kernel: [77042.391545] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 02:47:48 juju-e4d256-prod-github-runner-207 kernel: [77042.392484] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 02:47:48 juju-e4d256-prod-github-runner-207 kernel: [77042.393406] Aug 23 02:48:14 juju-e4d256-prod-github-runner-207 kernel: [77068.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 71667s! [qemu-system-x86:6715] Aug 23 02:48:14 juju-e4d256-prod-github-runner-207 kernel: [77068.543144] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 02:48:14 juju-e4d256-prod-github-runner-207 kernel: [77068.543219] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 02:48:14 juju-e4d256-prod-github-runner-207 kernel: [77068.555717] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 02:48:14 juju-e4d256-prod-github-runner-207 kernel: [77068.557027] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 02:48:14 juju-e4d256-prod-github-runner-207 kernel: [77068.558463] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:48:14 juju-e4d256-prod-github-runner-207 kernel: [77068.559900] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 02:48:14 juju-e4d256-prod-github-runner-207 kernel: [77068.562678] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 02:48:14 juju-e4d256-prod-github-runner-207 kernel: [77068.563825] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 02:48:14 juju-e4d256-prod-github-runner-207 kernel: [77068.564995] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 02:48:14 juju-e4d256-prod-github-runner-207 kernel: [77068.566432] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 02:48:14 juju-e4d256-prod-github-runner-207 kernel: [77068.567698] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 02:48:14 juju-e4d256-prod-github-runner-207 kernel: [77068.568869] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 02:48:14 juju-e4d256-prod-github-runner-207 kernel: [77068.570062] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 02:48:14 juju-e4d256-prod-github-runner-207 kernel: [77068.571330] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 02:48:14 juju-e4d256-prod-github-runner-207 kernel: [77068.572430] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 02:48:14 juju-e4d256-prod-github-runner-207 kernel: [77068.573631] Call Trace: Aug 23 02:48:14 juju-e4d256-prod-github-runner-207 kernel: [77068.574732] Aug 23 02:48:14 juju-e4d256-prod-github-runner-207 kernel: [77068.575877] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:48:14 juju-e4d256-prod-github-runner-207 kernel: [77068.577241] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:48:14 juju-e4d256-prod-github-runner-207 kernel: [77068.578285] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:48:14 juju-e4d256-prod-github-runner-207 kernel: [77068.579370] ? show_regs.part.0+0x23/0x29 Aug 23 02:48:14 juju-e4d256-prod-github-runner-207 kernel: [77068.580371] ? show_regs.cold+0x8/0xd Aug 23 02:48:14 juju-e4d256-prod-github-runner-207 kernel: [77068.581376] ? watchdog_timer_fn+0x1be/0x220 Aug 23 02:48:14 juju-e4d256-prod-github-runner-207 kernel: [77068.582427] ? lockup_detector_update_enable+0x60/0x60 Aug 23 02:48:14 juju-e4d256-prod-github-runner-207 kernel: [77068.583492] ? __hrtimer_run_queues+0x107/0x230 Aug 23 02:48:14 juju-e4d256-prod-github-runner-207 kernel: [77068.584549] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 02:48:14 juju-e4d256-prod-github-runner-207 kernel: [77068.585582] ? hrtimer_interrupt+0x101/0x220 Aug 23 02:48:14 juju-e4d256-prod-github-runner-207 kernel: [77068.586662] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 02:48:14 juju-e4d256-prod-github-runner-207 kernel: [77068.587731] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 02:48:14 juju-e4d256-prod-github-runner-207 kernel: [77068.588794] Aug 23 02:48:14 juju-e4d256-prod-github-runner-207 kernel: [77068.589659] Aug 23 02:48:14 juju-e4d256-prod-github-runner-207 kernel: [77068.590534] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 02:48:14 juju-e4d256-prod-github-runner-207 kernel: [77068.591576] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:48:14 juju-e4d256-prod-github-runner-207 kernel: [77068.592632] ? _raw_spin_lock+0x22/0x30 Aug 23 02:48:14 juju-e4d256-prod-github-runner-207 kernel: [77068.593581] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:48:14 juju-e4d256-prod-github-runner-207 kernel: [77068.594625] direct_page_fault+0x206/0x310 [kvm] Aug 23 02:48:14 juju-e4d256-prod-github-runner-207 kernel: [77068.595654] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 02:48:14 juju-e4d256-prod-github-runner-207 kernel: [77068.596665] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 02:48:14 juju-e4d256-prod-github-runner-207 kernel: [77068.597670] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 02:48:14 juju-e4d256-prod-github-runner-207 kernel: [77068.598663] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 02:48:14 juju-e4d256-prod-github-runner-207 kernel: [77068.599610] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 02:48:14 juju-e4d256-prod-github-runner-207 kernel: [77068.600726] handle_exit+0x98/0x230 [kvm_amd] Aug 23 02:48:14 juju-e4d256-prod-github-runner-207 kernel: [77068.601895] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 02:48:14 juju-e4d256-prod-github-runner-207 kernel: [77068.602896] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 02:48:14 juju-e4d256-prod-github-runner-207 kernel: [77068.604328] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 02:48:14 juju-e4d256-prod-github-runner-207 kernel: [77068.605333] vcpu_run+0x62/0x2c0 [kvm] Aug 23 02:48:14 juju-e4d256-prod-github-runner-207 kernel: [77068.606333] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 02:48:14 juju-e4d256-prod-github-runner-207 kernel: [77068.607575] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 02:48:14 juju-e4d256-prod-github-runner-207 kernel: [77068.608429] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 02:48:14 juju-e4d256-prod-github-runner-207 kernel: [77068.609232] ? __seccomp_filter+0x4a/0x4a0 Aug 23 02:48:14 juju-e4d256-prod-github-runner-207 kernel: [77068.609988] ? __fget_files+0x86/0xc0 Aug 23 02:48:14 juju-e4d256-prod-github-runner-207 kernel: [77068.610693] __x64_sys_ioctl+0x95/0xd0 Aug 23 02:48:14 juju-e4d256-prod-github-runner-207 kernel: [77068.611385] do_syscall_64+0x5c/0xc0 Aug 23 02:48:14 juju-e4d256-prod-github-runner-207 kernel: [77068.612048] ? do_futex+0x162/0x1f0 Aug 23 02:48:14 juju-e4d256-prod-github-runner-207 kernel: [77068.612695] ? __x64_sys_futex+0x78/0x1e0 Aug 23 02:48:14 juju-e4d256-prod-github-runner-207 kernel: [77068.613371] ? __secure_computing+0xa9/0x120 Aug 23 02:48:14 juju-e4d256-prod-github-runner-207 kernel: [77068.614091] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 02:48:14 juju-e4d256-prod-github-runner-207 kernel: [77068.614853] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:48:14 juju-e4d256-prod-github-runner-207 kernel: [77068.615575] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:48:14 juju-e4d256-prod-github-runner-207 kernel: [77068.616296] ? do_syscall_64+0x69/0xc0 Aug 23 02:48:14 juju-e4d256-prod-github-runner-207 kernel: [77068.616940] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:48:14 juju-e4d256-prod-github-runner-207 kernel: [77068.617650] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:48:14 juju-e4d256-prod-github-runner-207 kernel: [77068.618368] ? do_syscall_64+0x69/0xc0 Aug 23 02:48:14 juju-e4d256-prod-github-runner-207 kernel: [77068.619001] ? do_syscall_64+0x69/0xc0 Aug 23 02:48:14 juju-e4d256-prod-github-runner-207 kernel: [77068.619626] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 02:48:14 juju-e4d256-prod-github-runner-207 kernel: [77068.620337] RIP: 0033:0x7faa5d0edaff Aug 23 02:48:14 juju-e4d256-prod-github-runner-207 kernel: [77068.620961] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 02:48:14 juju-e4d256-prod-github-runner-207 kernel: [77068.622967] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 02:48:14 juju-e4d256-prod-github-runner-207 kernel: [77068.623878] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 02:48:14 juju-e4d256-prod-github-runner-207 kernel: [77068.624768] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 02:48:14 juju-e4d256-prod-github-runner-207 kernel: [77068.625660] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 02:48:14 juju-e4d256-prod-github-runner-207 kernel: [77068.626570] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 02:48:14 juju-e4d256-prod-github-runner-207 kernel: [77068.627459] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 02:48:14 juju-e4d256-prod-github-runner-207 kernel: [77068.628351] Aug 23 02:48:42 juju-e4d256-prod-github-runner-207 kernel: [77096.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 71693s! [qemu-system-x86:6715] Aug 23 02:48:42 juju-e4d256-prod-github-runner-207 kernel: [77096.543901] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 02:48:42 juju-e4d256-prod-github-runner-207 kernel: [77096.544221] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 02:48:42 juju-e4d256-prod-github-runner-207 kernel: [77096.556487] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 02:48:42 juju-e4d256-prod-github-runner-207 kernel: [77096.557767] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 02:48:42 juju-e4d256-prod-github-runner-207 kernel: [77096.558985] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:48:42 juju-e4d256-prod-github-runner-207 kernel: [77096.560045] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 02:48:42 juju-e4d256-prod-github-runner-207 kernel: [77096.562637] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 02:48:42 juju-e4d256-prod-github-runner-207 kernel: [77096.563691] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 02:48:42 juju-e4d256-prod-github-runner-207 kernel: [77096.564850] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 02:48:42 juju-e4d256-prod-github-runner-207 kernel: [77096.566021] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 02:48:42 juju-e4d256-prod-github-runner-207 kernel: [77096.567187] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 02:48:42 juju-e4d256-prod-github-runner-207 kernel: [77096.568370] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 02:48:42 juju-e4d256-prod-github-runner-207 kernel: [77096.569555] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 02:48:42 juju-e4d256-prod-github-runner-207 kernel: [77096.570828] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 02:48:42 juju-e4d256-prod-github-runner-207 kernel: [77096.571929] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 02:48:42 juju-e4d256-prod-github-runner-207 kernel: [77096.573150] Call Trace: Aug 23 02:48:42 juju-e4d256-prod-github-runner-207 kernel: [77096.574252] Aug 23 02:48:42 juju-e4d256-prod-github-runner-207 kernel: [77096.575299] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:48:42 juju-e4d256-prod-github-runner-207 kernel: [77096.576332] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:48:42 juju-e4d256-prod-github-runner-207 kernel: [77096.577352] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:48:42 juju-e4d256-prod-github-runner-207 kernel: [77096.578468] ? show_regs.part.0+0x23/0x29 Aug 23 02:48:42 juju-e4d256-prod-github-runner-207 kernel: [77096.579470] ? show_regs.cold+0x8/0xd Aug 23 02:48:42 juju-e4d256-prod-github-runner-207 kernel: [77096.580440] ? watchdog_timer_fn+0x1be/0x220 Aug 23 02:48:42 juju-e4d256-prod-github-runner-207 kernel: [77096.581486] ? lockup_detector_update_enable+0x60/0x60 Aug 23 02:48:42 juju-e4d256-prod-github-runner-207 kernel: [77096.582596] ? __hrtimer_run_queues+0x107/0x230 Aug 23 02:48:42 juju-e4d256-prod-github-runner-207 kernel: [77096.583632] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 02:48:42 juju-e4d256-prod-github-runner-207 kernel: [77096.584658] ? hrtimer_interrupt+0x101/0x220 Aug 23 02:48:42 juju-e4d256-prod-github-runner-207 kernel: [77096.585693] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 02:48:42 juju-e4d256-prod-github-runner-207 kernel: [77096.586760] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 02:48:42 juju-e4d256-prod-github-runner-207 kernel: [77096.587803] Aug 23 02:48:42 juju-e4d256-prod-github-runner-207 kernel: [77096.588656] Aug 23 02:48:42 juju-e4d256-prod-github-runner-207 kernel: [77096.589510] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 02:48:42 juju-e4d256-prod-github-runner-207 kernel: [77096.590540] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:48:42 juju-e4d256-prod-github-runner-207 kernel: [77096.591576] ? _raw_spin_lock+0x22/0x30 Aug 23 02:48:42 juju-e4d256-prod-github-runner-207 kernel: [77096.592519] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:48:42 juju-e4d256-prod-github-runner-207 kernel: [77096.593560] direct_page_fault+0x206/0x310 [kvm] Aug 23 02:48:42 juju-e4d256-prod-github-runner-207 kernel: [77096.594584] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 02:48:42 juju-e4d256-prod-github-runner-207 kernel: [77096.595597] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 02:48:42 juju-e4d256-prod-github-runner-207 kernel: [77096.596596] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 02:48:42 juju-e4d256-prod-github-runner-207 kernel: [77096.597616] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 02:48:42 juju-e4d256-prod-github-runner-207 kernel: [77096.598568] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 02:48:42 juju-e4d256-prod-github-runner-207 kernel: [77096.599589] handle_exit+0x98/0x230 [kvm_amd] Aug 23 02:48:42 juju-e4d256-prod-github-runner-207 kernel: [77096.600485] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 02:48:42 juju-e4d256-prod-github-runner-207 kernel: [77096.601424] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 02:48:42 juju-e4d256-prod-github-runner-207 kernel: [77096.602352] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 02:48:42 juju-e4d256-prod-github-runner-207 kernel: [77096.603264] vcpu_run+0x62/0x2c0 [kvm] Aug 23 02:48:42 juju-e4d256-prod-github-runner-207 kernel: [77096.604084] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 02:48:42 juju-e4d256-prod-github-runner-207 kernel: [77096.604888] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 02:48:42 juju-e4d256-prod-github-runner-207 kernel: [77096.605760] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 02:48:42 juju-e4d256-prod-github-runner-207 kernel: [77096.606554] ? __seccomp_filter+0x4a/0x4a0 Aug 23 02:48:42 juju-e4d256-prod-github-runner-207 kernel: [77096.607298] ? __fget_files+0x86/0xc0 Aug 23 02:48:42 juju-e4d256-prod-github-runner-207 kernel: [77096.608000] __x64_sys_ioctl+0x95/0xd0 Aug 23 02:48:42 juju-e4d256-prod-github-runner-207 kernel: [77096.608723] do_syscall_64+0x5c/0xc0 Aug 23 02:48:42 juju-e4d256-prod-github-runner-207 kernel: [77096.609386] ? do_futex+0x162/0x1f0 Aug 23 02:48:42 juju-e4d256-prod-github-runner-207 kernel: [77096.610074] ? __x64_sys_futex+0x78/0x1e0 Aug 23 02:48:42 juju-e4d256-prod-github-runner-207 kernel: [77096.610757] ? __secure_computing+0xa9/0x120 Aug 23 02:48:42 juju-e4d256-prod-github-runner-207 kernel: [77096.611464] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 02:48:42 juju-e4d256-prod-github-runner-207 kernel: [77096.612226] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:48:42 juju-e4d256-prod-github-runner-207 kernel: [77096.612947] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:48:42 juju-e4d256-prod-github-runner-207 kernel: [77096.613691] ? do_syscall_64+0x69/0xc0 Aug 23 02:48:42 juju-e4d256-prod-github-runner-207 kernel: [77096.614343] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:48:42 juju-e4d256-prod-github-runner-207 kernel: [77096.615047] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:48:42 juju-e4d256-prod-github-runner-207 kernel: [77096.615750] ? do_syscall_64+0x69/0xc0 Aug 23 02:48:42 juju-e4d256-prod-github-runner-207 kernel: [77096.616380] ? do_syscall_64+0x69/0xc0 Aug 23 02:48:42 juju-e4d256-prod-github-runner-207 kernel: [77096.617003] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 02:48:42 juju-e4d256-prod-github-runner-207 kernel: [77096.617737] RIP: 0033:0x7faa5d0edaff Aug 23 02:48:42 juju-e4d256-prod-github-runner-207 kernel: [77096.618398] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 02:48:42 juju-e4d256-prod-github-runner-207 kernel: [77096.620393] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 02:48:42 juju-e4d256-prod-github-runner-207 kernel: [77096.621305] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 02:48:42 juju-e4d256-prod-github-runner-207 kernel: [77096.622210] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 02:48:42 juju-e4d256-prod-github-runner-207 kernel: [77096.623101] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 02:48:42 juju-e4d256-prod-github-runner-207 kernel: [77096.623988] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 02:48:42 juju-e4d256-prod-github-runner-207 kernel: [77096.624876] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 02:48:42 juju-e4d256-prod-github-runner-207 kernel: [77096.625780] Aug 23 02:49:10 juju-e4d256-prod-github-runner-207 kernel: [77124.541983] watchdog: BUG: soft lockup - CPU#1 stuck for 71719s! [qemu-system-x86:6715] Aug 23 02:49:10 juju-e4d256-prod-github-runner-207 kernel: [77124.543502] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 02:49:10 juju-e4d256-prod-github-runner-207 kernel: [77124.543586] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 02:49:10 juju-e4d256-prod-github-runner-207 kernel: [77124.557167] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 02:49:10 juju-e4d256-prod-github-runner-207 kernel: [77124.558614] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 02:49:10 juju-e4d256-prod-github-runner-207 kernel: [77124.559840] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:49:10 juju-e4d256-prod-github-runner-207 kernel: [77124.560898] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 02:49:10 juju-e4d256-prod-github-runner-207 kernel: [77124.563467] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 02:49:10 juju-e4d256-prod-github-runner-207 kernel: [77124.564509] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 02:49:10 juju-e4d256-prod-github-runner-207 kernel: [77124.565710] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 02:49:10 juju-e4d256-prod-github-runner-207 kernel: [77124.566895] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 02:49:10 juju-e4d256-prod-github-runner-207 kernel: [77124.568062] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 02:49:10 juju-e4d256-prod-github-runner-207 kernel: [77124.569260] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 02:49:10 juju-e4d256-prod-github-runner-207 kernel: [77124.570440] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 02:49:10 juju-e4d256-prod-github-runner-207 kernel: [77124.571680] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 02:49:10 juju-e4d256-prod-github-runner-207 kernel: [77124.572787] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 02:49:10 juju-e4d256-prod-github-runner-207 kernel: [77124.574001] Call Trace: Aug 23 02:49:10 juju-e4d256-prod-github-runner-207 kernel: [77124.574923] Aug 23 02:49:10 juju-e4d256-prod-github-runner-207 kernel: [77124.575807] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:49:10 juju-e4d256-prod-github-runner-207 kernel: [77124.576837] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:49:10 juju-e4d256-prod-github-runner-207 kernel: [77124.577887] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:49:10 juju-e4d256-prod-github-runner-207 kernel: [77124.578968] ? show_regs.part.0+0x23/0x29 Aug 23 02:49:10 juju-e4d256-prod-github-runner-207 kernel: [77124.579986] ? show_regs.cold+0x8/0xd Aug 23 02:49:10 juju-e4d256-prod-github-runner-207 kernel: [77124.580957] ? watchdog_timer_fn+0x1be/0x220 Aug 23 02:49:10 juju-e4d256-prod-github-runner-207 kernel: [77124.581991] ? lockup_detector_update_enable+0x60/0x60 Aug 23 02:49:10 juju-e4d256-prod-github-runner-207 kernel: [77124.583063] ? __hrtimer_run_queues+0x107/0x230 Aug 23 02:49:10 juju-e4d256-prod-github-runner-207 kernel: [77124.584093] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 02:49:10 juju-e4d256-prod-github-runner-207 kernel: [77124.585134] ? hrtimer_interrupt+0x101/0x220 Aug 23 02:49:10 juju-e4d256-prod-github-runner-207 kernel: [77124.586160] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 02:49:10 juju-e4d256-prod-github-runner-207 kernel: [77124.587235] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 02:49:10 juju-e4d256-prod-github-runner-207 kernel: [77124.588286] Aug 23 02:49:10 juju-e4d256-prod-github-runner-207 kernel: [77124.589171] Aug 23 02:49:10 juju-e4d256-prod-github-runner-207 kernel: [77124.590015] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 02:49:10 juju-e4d256-prod-github-runner-207 kernel: [77124.591054] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:49:10 juju-e4d256-prod-github-runner-207 kernel: [77124.592097] ? _raw_spin_lock+0x22/0x30 Aug 23 02:49:10 juju-e4d256-prod-github-runner-207 kernel: [77124.593042] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:49:10 juju-e4d256-prod-github-runner-207 kernel: [77124.594085] direct_page_fault+0x206/0x310 [kvm] Aug 23 02:49:10 juju-e4d256-prod-github-runner-207 kernel: [77124.595115] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 02:49:10 juju-e4d256-prod-github-runner-207 kernel: [77124.596123] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 02:49:10 juju-e4d256-prod-github-runner-207 kernel: [77124.597137] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 02:49:10 juju-e4d256-prod-github-runner-207 kernel: [77124.598115] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 02:49:10 juju-e4d256-prod-github-runner-207 kernel: [77124.599066] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 02:49:10 juju-e4d256-prod-github-runner-207 kernel: [77124.600064] handle_exit+0x98/0x230 [kvm_amd] Aug 23 02:49:10 juju-e4d256-prod-github-runner-207 kernel: [77124.600966] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 02:49:10 juju-e4d256-prod-github-runner-207 kernel: [77124.601897] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 02:49:10 juju-e4d256-prod-github-runner-207 kernel: [77124.602824] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 02:49:10 juju-e4d256-prod-github-runner-207 kernel: [77124.603754] vcpu_run+0x62/0x2c0 [kvm] Aug 23 02:49:10 juju-e4d256-prod-github-runner-207 kernel: [77124.604571] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 02:49:10 juju-e4d256-prod-github-runner-207 kernel: [77124.605399] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 02:49:10 juju-e4d256-prod-github-runner-207 kernel: [77124.606260] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 02:49:10 juju-e4d256-prod-github-runner-207 kernel: [77124.607062] ? __seccomp_filter+0x4a/0x4a0 Aug 23 02:49:10 juju-e4d256-prod-github-runner-207 kernel: [77124.607809] ? __fget_files+0x86/0xc0 Aug 23 02:49:10 juju-e4d256-prod-github-runner-207 kernel: [77124.608512] __x64_sys_ioctl+0x95/0xd0 Aug 23 02:49:10 juju-e4d256-prod-github-runner-207 kernel: [77124.609214] do_syscall_64+0x5c/0xc0 Aug 23 02:49:10 juju-e4d256-prod-github-runner-207 kernel: [77124.609888] ? do_futex+0x162/0x1f0 Aug 23 02:49:10 juju-e4d256-prod-github-runner-207 kernel: [77124.610536] ? __x64_sys_futex+0x78/0x1e0 Aug 23 02:49:10 juju-e4d256-prod-github-runner-207 kernel: [77124.611209] ? __secure_computing+0xa9/0x120 Aug 23 02:49:10 juju-e4d256-prod-github-runner-207 kernel: [77124.611903] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 02:49:10 juju-e4d256-prod-github-runner-207 kernel: [77124.612664] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:49:10 juju-e4d256-prod-github-runner-207 kernel: [77124.613398] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:49:10 juju-e4d256-prod-github-runner-207 kernel: [77124.614122] ? do_syscall_64+0x69/0xc0 Aug 23 02:49:10 juju-e4d256-prod-github-runner-207 kernel: [77124.614766] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:49:10 juju-e4d256-prod-github-runner-207 kernel: [77124.615469] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:49:10 juju-e4d256-prod-github-runner-207 kernel: [77124.616165] ? do_syscall_64+0x69/0xc0 Aug 23 02:49:10 juju-e4d256-prod-github-runner-207 kernel: [77124.616795] ? do_syscall_64+0x69/0xc0 Aug 23 02:49:10 juju-e4d256-prod-github-runner-207 kernel: [77124.617426] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 02:49:10 juju-e4d256-prod-github-runner-207 kernel: [77124.618137] RIP: 0033:0x7faa5d0edaff Aug 23 02:49:10 juju-e4d256-prod-github-runner-207 kernel: [77124.618764] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 02:49:10 juju-e4d256-prod-github-runner-207 kernel: [77124.620749] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 02:49:10 juju-e4d256-prod-github-runner-207 kernel: [77124.621674] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 02:49:10 juju-e4d256-prod-github-runner-207 kernel: [77124.622563] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 02:49:10 juju-e4d256-prod-github-runner-207 kernel: [77124.623450] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 02:49:10 juju-e4d256-prod-github-runner-207 kernel: [77124.624342] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 02:49:10 juju-e4d256-prod-github-runner-207 kernel: [77124.625239] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 02:49:10 juju-e4d256-prod-github-runner-207 kernel: [77124.626134] Aug 23 02:49:38 juju-e4d256-prod-github-runner-207 kernel: [77152.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 71745s! [qemu-system-x86:6715] Aug 23 02:49:38 juju-e4d256-prod-github-runner-207 kernel: [77152.543106] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 02:49:38 juju-e4d256-prod-github-runner-207 kernel: [77152.543183] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 02:49:38 juju-e4d256-prod-github-runner-207 kernel: [77152.555369] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 02:49:38 juju-e4d256-prod-github-runner-207 kernel: [77152.556632] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 02:49:38 juju-e4d256-prod-github-runner-207 kernel: [77152.557885] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:49:38 juju-e4d256-prod-github-runner-207 kernel: [77152.558943] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 02:49:38 juju-e4d256-prod-github-runner-207 kernel: [77152.561494] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 02:49:38 juju-e4d256-prod-github-runner-207 kernel: [77152.562536] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 02:49:38 juju-e4d256-prod-github-runner-207 kernel: [77152.563694] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 02:49:38 juju-e4d256-prod-github-runner-207 kernel: [77152.564874] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 02:49:38 juju-e4d256-prod-github-runner-207 kernel: [77152.566032] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 02:49:38 juju-e4d256-prod-github-runner-207 kernel: [77152.567192] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 02:49:38 juju-e4d256-prod-github-runner-207 kernel: [77152.568355] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 02:49:38 juju-e4d256-prod-github-runner-207 kernel: [77152.569594] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 02:49:38 juju-e4d256-prod-github-runner-207 kernel: [77152.570694] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 02:49:38 juju-e4d256-prod-github-runner-207 kernel: [77152.571892] Call Trace: Aug 23 02:49:38 juju-e4d256-prod-github-runner-207 kernel: [77152.572816] Aug 23 02:49:38 juju-e4d256-prod-github-runner-207 kernel: [77152.573705] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:49:38 juju-e4d256-prod-github-runner-207 kernel: [77152.574757] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:49:38 juju-e4d256-prod-github-runner-207 kernel: [77152.575787] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:49:38 juju-e4d256-prod-github-runner-207 kernel: [77152.576882] ? show_regs.part.0+0x23/0x29 Aug 23 02:49:38 juju-e4d256-prod-github-runner-207 kernel: [77152.577876] ? show_regs.cold+0x8/0xd Aug 23 02:49:38 juju-e4d256-prod-github-runner-207 kernel: [77152.578853] ? watchdog_timer_fn+0x1be/0x220 Aug 23 02:49:38 juju-e4d256-prod-github-runner-207 kernel: [77152.579866] ? lockup_detector_update_enable+0x60/0x60 Aug 23 02:49:38 juju-e4d256-prod-github-runner-207 kernel: [77152.580940] ? __hrtimer_run_queues+0x107/0x230 Aug 23 02:49:38 juju-e4d256-prod-github-runner-207 kernel: [77152.581966] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 02:49:38 juju-e4d256-prod-github-runner-207 kernel: [77152.582992] ? hrtimer_interrupt+0x101/0x220 Aug 23 02:49:38 juju-e4d256-prod-github-runner-207 kernel: [77152.584010] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 02:49:38 juju-e4d256-prod-github-runner-207 kernel: [77152.585095] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 02:49:38 juju-e4d256-prod-github-runner-207 kernel: [77152.586144] Aug 23 02:49:38 juju-e4d256-prod-github-runner-207 kernel: [77152.586995] Aug 23 02:49:38 juju-e4d256-prod-github-runner-207 kernel: [77152.587830] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 02:49:38 juju-e4d256-prod-github-runner-207 kernel: [77152.588876] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:49:38 juju-e4d256-prod-github-runner-207 kernel: [77152.589918] ? _raw_spin_lock+0x22/0x30 Aug 23 02:49:38 juju-e4d256-prod-github-runner-207 kernel: [77152.590861] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:49:38 juju-e4d256-prod-github-runner-207 kernel: [77152.591875] direct_page_fault+0x206/0x310 [kvm] Aug 23 02:49:38 juju-e4d256-prod-github-runner-207 kernel: [77152.592913] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 02:49:38 juju-e4d256-prod-github-runner-207 kernel: [77152.593926] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 02:49:38 juju-e4d256-prod-github-runner-207 kernel: [77152.594929] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 02:49:38 juju-e4d256-prod-github-runner-207 kernel: [77152.595902] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 02:49:38 juju-e4d256-prod-github-runner-207 kernel: [77152.596873] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 02:49:38 juju-e4d256-prod-github-runner-207 kernel: [77152.597856] handle_exit+0x98/0x230 [kvm_amd] Aug 23 02:49:38 juju-e4d256-prod-github-runner-207 kernel: [77152.598752] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 02:49:38 juju-e4d256-prod-github-runner-207 kernel: [77152.599669] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 02:49:38 juju-e4d256-prod-github-runner-207 kernel: [77152.600591] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 02:49:38 juju-e4d256-prod-github-runner-207 kernel: [77152.601504] vcpu_run+0x62/0x2c0 [kvm] Aug 23 02:49:38 juju-e4d256-prod-github-runner-207 kernel: [77152.602312] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 02:49:38 juju-e4d256-prod-github-runner-207 kernel: [77152.603122] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 02:49:38 juju-e4d256-prod-github-runner-207 kernel: [77152.603973] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 02:49:38 juju-e4d256-prod-github-runner-207 kernel: [77152.604778] ? __seccomp_filter+0x4a/0x4a0 Aug 23 02:49:38 juju-e4d256-prod-github-runner-207 kernel: [77152.605523] ? __fget_files+0x86/0xc0 Aug 23 02:49:38 juju-e4d256-prod-github-runner-207 kernel: [77152.606225] __x64_sys_ioctl+0x95/0xd0 Aug 23 02:49:38 juju-e4d256-prod-github-runner-207 kernel: [77152.606917] do_syscall_64+0x5c/0xc0 Aug 23 02:49:38 juju-e4d256-prod-github-runner-207 kernel: [77152.607609] ? do_futex+0x162/0x1f0 Aug 23 02:49:38 juju-e4d256-prod-github-runner-207 kernel: [77152.608261] ? __x64_sys_futex+0x78/0x1e0 Aug 23 02:49:38 juju-e4d256-prod-github-runner-207 kernel: [77152.608966] ? __secure_computing+0xa9/0x120 Aug 23 02:49:38 juju-e4d256-prod-github-runner-207 kernel: [77152.609657] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 02:49:38 juju-e4d256-prod-github-runner-207 kernel: [77152.610416] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:49:38 juju-e4d256-prod-github-runner-207 kernel: [77152.611141] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:49:38 juju-e4d256-prod-github-runner-207 kernel: [77152.611858] ? do_syscall_64+0x69/0xc0 Aug 23 02:49:38 juju-e4d256-prod-github-runner-207 kernel: [77152.612633] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:49:38 juju-e4d256-prod-github-runner-207 kernel: [77152.613343] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:49:38 juju-e4d256-prod-github-runner-207 kernel: [77152.614035] ? do_syscall_64+0x69/0xc0 Aug 23 02:49:38 juju-e4d256-prod-github-runner-207 kernel: [77152.614658] ? do_syscall_64+0x69/0xc0 Aug 23 02:49:38 juju-e4d256-prod-github-runner-207 kernel: [77152.615283] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 02:49:38 juju-e4d256-prod-github-runner-207 kernel: [77152.615992] RIP: 0033:0x7faa5d0edaff Aug 23 02:49:38 juju-e4d256-prod-github-runner-207 kernel: [77152.616616] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 02:49:38 juju-e4d256-prod-github-runner-207 kernel: [77152.618609] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 02:49:38 juju-e4d256-prod-github-runner-207 kernel: [77152.619516] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 02:49:38 juju-e4d256-prod-github-runner-207 kernel: [77152.620403] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 02:49:38 juju-e4d256-prod-github-runner-207 kernel: [77152.621327] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 02:49:38 juju-e4d256-prod-github-runner-207 kernel: [77152.622216] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 02:49:38 juju-e4d256-prod-github-runner-207 kernel: [77152.623108] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 02:49:38 juju-e4d256-prod-github-runner-207 kernel: [77152.624004] Aug 23 02:50:06 juju-e4d256-prod-github-runner-207 kernel: [77180.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 71771s! [qemu-system-x86:6715] Aug 23 02:50:06 juju-e4d256-prod-github-runner-207 kernel: [77180.543159] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 02:50:06 juju-e4d256-prod-github-runner-207 kernel: [77180.543234] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 02:50:06 juju-e4d256-prod-github-runner-207 kernel: [77180.555943] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 02:50:06 juju-e4d256-prod-github-runner-207 kernel: [77180.557236] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 02:50:06 juju-e4d256-prod-github-runner-207 kernel: [77180.558464] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:50:06 juju-e4d256-prod-github-runner-207 kernel: [77180.559528] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 02:50:06 juju-e4d256-prod-github-runner-207 kernel: [77180.562177] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 02:50:06 juju-e4d256-prod-github-runner-207 kernel: [77180.563227] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 02:50:06 juju-e4d256-prod-github-runner-207 kernel: [77180.564391] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 02:50:06 juju-e4d256-prod-github-runner-207 kernel: [77180.565586] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 02:50:06 juju-e4d256-prod-github-runner-207 kernel: [77180.566745] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 02:50:06 juju-e4d256-prod-github-runner-207 kernel: [77180.567906] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 02:50:06 juju-e4d256-prod-github-runner-207 kernel: [77180.569105] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 02:50:06 juju-e4d256-prod-github-runner-207 kernel: [77180.570353] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 02:50:06 juju-e4d256-prod-github-runner-207 kernel: [77180.571455] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 02:50:06 juju-e4d256-prod-github-runner-207 kernel: [77180.572671] Call Trace: Aug 23 02:50:06 juju-e4d256-prod-github-runner-207 kernel: [77180.573608] Aug 23 02:50:06 juju-e4d256-prod-github-runner-207 kernel: [77180.574504] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:50:06 juju-e4d256-prod-github-runner-207 kernel: [77180.575559] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:50:06 juju-e4d256-prod-github-runner-207 kernel: [77180.576614] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:50:06 juju-e4d256-prod-github-runner-207 kernel: [77180.577716] ? show_regs.part.0+0x23/0x29 Aug 23 02:50:06 juju-e4d256-prod-github-runner-207 kernel: [77180.578777] ? show_regs.cold+0x8/0xd Aug 23 02:50:06 juju-e4d256-prod-github-runner-207 kernel: [77180.579756] ? watchdog_timer_fn+0x1be/0x220 Aug 23 02:50:06 juju-e4d256-prod-github-runner-207 kernel: [77180.580789] ? lockup_detector_update_enable+0x60/0x60 Aug 23 02:50:06 juju-e4d256-prod-github-runner-207 kernel: [77180.581862] ? __hrtimer_run_queues+0x107/0x230 Aug 23 02:50:06 juju-e4d256-prod-github-runner-207 kernel: [77180.582899] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 02:50:06 juju-e4d256-prod-github-runner-207 kernel: [77180.583923] ? hrtimer_interrupt+0x101/0x220 Aug 23 02:50:06 juju-e4d256-prod-github-runner-207 kernel: [77180.584953] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 02:50:06 juju-e4d256-prod-github-runner-207 kernel: [77180.586026] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 02:50:06 juju-e4d256-prod-github-runner-207 kernel: [77180.587072] Aug 23 02:50:06 juju-e4d256-prod-github-runner-207 kernel: [77180.587931] Aug 23 02:50:06 juju-e4d256-prod-github-runner-207 kernel: [77180.588791] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 02:50:06 juju-e4d256-prod-github-runner-207 kernel: [77180.589828] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:50:06 juju-e4d256-prod-github-runner-207 kernel: [77180.590897] ? _raw_spin_lock+0x22/0x30 Aug 23 02:50:06 juju-e4d256-prod-github-runner-207 kernel: [77180.591986] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:50:06 juju-e4d256-prod-github-runner-207 kernel: [77180.593099] direct_page_fault+0x206/0x310 [kvm] Aug 23 02:50:06 juju-e4d256-prod-github-runner-207 kernel: [77180.594128] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 02:50:06 juju-e4d256-prod-github-runner-207 kernel: [77180.595144] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 02:50:06 juju-e4d256-prod-github-runner-207 kernel: [77180.596149] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 02:50:06 juju-e4d256-prod-github-runner-207 kernel: [77180.597146] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 02:50:06 juju-e4d256-prod-github-runner-207 kernel: [77180.598091] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 02:50:06 juju-e4d256-prod-github-runner-207 kernel: [77180.599067] handle_exit+0x98/0x230 [kvm_amd] Aug 23 02:50:06 juju-e4d256-prod-github-runner-207 kernel: [77180.599961] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 02:50:06 juju-e4d256-prod-github-runner-207 kernel: [77180.600893] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 02:50:06 juju-e4d256-prod-github-runner-207 kernel: [77180.601822] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 02:50:06 juju-e4d256-prod-github-runner-207 kernel: [77180.602724] vcpu_run+0x62/0x2c0 [kvm] Aug 23 02:50:06 juju-e4d256-prod-github-runner-207 kernel: [77180.603542] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 02:50:06 juju-e4d256-prod-github-runner-207 kernel: [77180.604350] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 02:50:06 juju-e4d256-prod-github-runner-207 kernel: [77180.605233] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 02:50:06 juju-e4d256-prod-github-runner-207 kernel: [77180.606032] ? __seccomp_filter+0x4a/0x4a0 Aug 23 02:50:06 juju-e4d256-prod-github-runner-207 kernel: [77180.606775] ? __fget_files+0x86/0xc0 Aug 23 02:50:06 juju-e4d256-prod-github-runner-207 kernel: [77180.607477] __x64_sys_ioctl+0x95/0xd0 Aug 23 02:50:06 juju-e4d256-prod-github-runner-207 kernel: [77180.608168] do_syscall_64+0x5c/0xc0 Aug 23 02:50:06 juju-e4d256-prod-github-runner-207 kernel: [77180.608853] ? do_futex+0x162/0x1f0 Aug 23 02:50:06 juju-e4d256-prod-github-runner-207 kernel: [77180.609507] ? __x64_sys_futex+0x78/0x1e0 Aug 23 02:50:06 juju-e4d256-prod-github-runner-207 kernel: [77180.610181] ? __secure_computing+0xa9/0x120 Aug 23 02:50:06 juju-e4d256-prod-github-runner-207 kernel: [77180.610887] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 02:50:06 juju-e4d256-prod-github-runner-207 kernel: [77180.611651] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:50:06 juju-e4d256-prod-github-runner-207 kernel: [77180.612394] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:50:06 juju-e4d256-prod-github-runner-207 kernel: [77180.613133] ? do_syscall_64+0x69/0xc0 Aug 23 02:50:06 juju-e4d256-prod-github-runner-207 kernel: [77180.613783] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:50:06 juju-e4d256-prod-github-runner-207 kernel: [77180.614484] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:50:06 juju-e4d256-prod-github-runner-207 kernel: [77180.615179] ? do_syscall_64+0x69/0xc0 Aug 23 02:50:06 juju-e4d256-prod-github-runner-207 kernel: [77180.615806] ? do_syscall_64+0x69/0xc0 Aug 23 02:50:06 juju-e4d256-prod-github-runner-207 kernel: [77180.616460] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 02:50:06 juju-e4d256-prod-github-runner-207 kernel: [77180.617168] RIP: 0033:0x7faa5d0edaff Aug 23 02:50:06 juju-e4d256-prod-github-runner-207 kernel: [77180.617795] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 02:50:06 juju-e4d256-prod-github-runner-207 kernel: [77180.619783] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 02:50:06 juju-e4d256-prod-github-runner-207 kernel: [77180.620711] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 02:50:06 juju-e4d256-prod-github-runner-207 kernel: [77180.621601] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 02:50:06 juju-e4d256-prod-github-runner-207 kernel: [77180.622493] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 02:50:06 juju-e4d256-prod-github-runner-207 kernel: [77180.623379] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 02:50:06 juju-e4d256-prod-github-runner-207 kernel: [77180.624265] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 02:50:06 juju-e4d256-prod-github-runner-207 kernel: [77180.625178] Aug 23 02:50:34 juju-e4d256-prod-github-runner-207 kernel: [77208.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 71798s! [qemu-system-x86:6715] Aug 23 02:50:34 juju-e4d256-prod-github-runner-207 kernel: [77208.543858] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 02:50:34 juju-e4d256-prod-github-runner-207 kernel: [77208.544168] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 02:50:34 juju-e4d256-prod-github-runner-207 kernel: [77208.558706] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 02:50:34 juju-e4d256-prod-github-runner-207 kernel: [77208.559982] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 02:50:34 juju-e4d256-prod-github-runner-207 kernel: [77208.561231] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:50:34 juju-e4d256-prod-github-runner-207 kernel: [77208.562292] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 02:50:34 juju-e4d256-prod-github-runner-207 kernel: [77208.564909] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 02:50:34 juju-e4d256-prod-github-runner-207 kernel: [77208.565988] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 02:50:34 juju-e4d256-prod-github-runner-207 kernel: [77208.567176] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 02:50:34 juju-e4d256-prod-github-runner-207 kernel: [77208.568360] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 02:50:34 juju-e4d256-prod-github-runner-207 kernel: [77208.569534] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 02:50:34 juju-e4d256-prod-github-runner-207 kernel: [77208.570699] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 02:50:34 juju-e4d256-prod-github-runner-207 kernel: [77208.571883] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 02:50:34 juju-e4d256-prod-github-runner-207 kernel: [77208.573149] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 02:50:34 juju-e4d256-prod-github-runner-207 kernel: [77208.574255] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 02:50:34 juju-e4d256-prod-github-runner-207 kernel: [77208.575448] Call Trace: Aug 23 02:50:34 juju-e4d256-prod-github-runner-207 kernel: [77208.576418] Aug 23 02:50:34 juju-e4d256-prod-github-runner-207 kernel: [77208.577325] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:50:34 juju-e4d256-prod-github-runner-207 kernel: [77208.578360] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:50:34 juju-e4d256-prod-github-runner-207 kernel: [77208.579381] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:50:34 juju-e4d256-prod-github-runner-207 kernel: [77208.580500] ? show_regs.part.0+0x23/0x29 Aug 23 02:50:34 juju-e4d256-prod-github-runner-207 kernel: [77208.581519] ? show_regs.cold+0x8/0xd Aug 23 02:50:34 juju-e4d256-prod-github-runner-207 kernel: [77208.582494] ? watchdog_timer_fn+0x1be/0x220 Aug 23 02:50:34 juju-e4d256-prod-github-runner-207 kernel: [77208.583556] ? lockup_detector_update_enable+0x60/0x60 Aug 23 02:50:34 juju-e4d256-prod-github-runner-207 kernel: [77208.584660] ? __hrtimer_run_queues+0x107/0x230 Aug 23 02:50:34 juju-e4d256-prod-github-runner-207 kernel: [77208.585704] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 02:50:34 juju-e4d256-prod-github-runner-207 kernel: [77208.586729] ? hrtimer_interrupt+0x101/0x220 Aug 23 02:50:34 juju-e4d256-prod-github-runner-207 kernel: [77208.587743] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 02:50:34 juju-e4d256-prod-github-runner-207 kernel: [77208.588825] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 02:50:34 juju-e4d256-prod-github-runner-207 kernel: [77208.589872] Aug 23 02:50:34 juju-e4d256-prod-github-runner-207 kernel: [77208.590732] Aug 23 02:50:34 juju-e4d256-prod-github-runner-207 kernel: [77208.591569] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 02:50:34 juju-e4d256-prod-github-runner-207 kernel: [77208.592639] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:50:34 juju-e4d256-prod-github-runner-207 kernel: [77208.593679] ? _raw_spin_lock+0x22/0x30 Aug 23 02:50:34 juju-e4d256-prod-github-runner-207 kernel: [77208.594623] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:50:34 juju-e4d256-prod-github-runner-207 kernel: [77208.595660] direct_page_fault+0x206/0x310 [kvm] Aug 23 02:50:34 juju-e4d256-prod-github-runner-207 kernel: [77208.596705] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 02:50:34 juju-e4d256-prod-github-runner-207 kernel: [77208.597726] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 02:50:34 juju-e4d256-prod-github-runner-207 kernel: [77208.598741] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 02:50:34 juju-e4d256-prod-github-runner-207 kernel: [77208.599785] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 02:50:34 juju-e4d256-prod-github-runner-207 kernel: [77208.600853] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 02:50:34 juju-e4d256-prod-github-runner-207 kernel: [77208.601861] handle_exit+0x98/0x230 [kvm_amd] Aug 23 02:50:34 juju-e4d256-prod-github-runner-207 kernel: [77208.602787] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 02:50:34 juju-e4d256-prod-github-runner-207 kernel: [77208.603712] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 02:50:34 juju-e4d256-prod-github-runner-207 kernel: [77208.604672] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 02:50:34 juju-e4d256-prod-github-runner-207 kernel: [77208.605696] vcpu_run+0x62/0x2c0 [kvm] Aug 23 02:50:34 juju-e4d256-prod-github-runner-207 kernel: [77208.606514] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 02:50:34 juju-e4d256-prod-github-runner-207 kernel: [77208.607322] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 02:50:34 juju-e4d256-prod-github-runner-207 kernel: [77208.608257] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 02:50:34 juju-e4d256-prod-github-runner-207 kernel: [77208.609089] ? __seccomp_filter+0x4a/0x4a0 Aug 23 02:50:34 juju-e4d256-prod-github-runner-207 kernel: [77208.609846] ? __fget_files+0x86/0xc0 Aug 23 02:50:34 juju-e4d256-prod-github-runner-207 kernel: [77208.610555] __x64_sys_ioctl+0x95/0xd0 Aug 23 02:50:34 juju-e4d256-prod-github-runner-207 kernel: [77208.611248] do_syscall_64+0x5c/0xc0 Aug 23 02:50:34 juju-e4d256-prod-github-runner-207 kernel: [77208.611919] ? do_futex+0x162/0x1f0 Aug 23 02:50:34 juju-e4d256-prod-github-runner-207 kernel: [77208.612583] ? __x64_sys_futex+0x78/0x1e0 Aug 23 02:50:34 juju-e4d256-prod-github-runner-207 kernel: [77208.613257] ? __secure_computing+0xa9/0x120 Aug 23 02:50:34 juju-e4d256-prod-github-runner-207 kernel: [77208.613952] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 02:50:34 juju-e4d256-prod-github-runner-207 kernel: [77208.614711] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:50:34 juju-e4d256-prod-github-runner-207 kernel: [77208.615432] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:50:34 juju-e4d256-prod-github-runner-207 kernel: [77208.616165] ? do_syscall_64+0x69/0xc0 Aug 23 02:50:34 juju-e4d256-prod-github-runner-207 kernel: [77208.616814] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:50:34 juju-e4d256-prod-github-runner-207 kernel: [77208.617517] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:50:34 juju-e4d256-prod-github-runner-207 kernel: [77208.618213] ? do_syscall_64+0x69/0xc0 Aug 23 02:50:34 juju-e4d256-prod-github-runner-207 kernel: [77208.618838] ? do_syscall_64+0x69/0xc0 Aug 23 02:50:34 juju-e4d256-prod-github-runner-207 kernel: [77208.619484] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 02:50:34 juju-e4d256-prod-github-runner-207 kernel: [77208.620498] RIP: 0033:0x7faa5d0edaff Aug 23 02:50:34 juju-e4d256-prod-github-runner-207 kernel: [77208.621261] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 02:50:34 juju-e4d256-prod-github-runner-207 kernel: [77208.623352] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 02:50:34 juju-e4d256-prod-github-runner-207 kernel: [77208.624295] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 02:50:34 juju-e4d256-prod-github-runner-207 kernel: [77208.625198] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 02:50:34 juju-e4d256-prod-github-runner-207 kernel: [77208.626088] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 02:50:34 juju-e4d256-prod-github-runner-207 kernel: [77208.627005] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 02:50:34 juju-e4d256-prod-github-runner-207 kernel: [77208.627896] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 02:50:34 juju-e4d256-prod-github-runner-207 kernel: [77208.628821] Aug 23 02:50:48 juju-e4d256-prod-github-runner-207 kernel: [77222.336707] rcu: INFO: rcu_sched self-detected stall on CPU Aug 23 02:50:48 juju-e4d256-prod-github-runner-207 kernel: [77222.337674] rcu: 1-....: (19215761 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=9290427 Aug 23 02:50:48 juju-e4d256-prod-github-runner-207 kernel: [77222.338805] (t=19276284 jiffies g=23269 q=64926) Aug 23 02:50:48 juju-e4d256-prod-github-runner-207 kernel: [77222.339617] NMI backtrace for cpu 1 Aug 23 02:50:48 juju-e4d256-prod-github-runner-207 kernel: [77222.340349] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 02:50:48 juju-e4d256-prod-github-runner-207 kernel: [77222.341469] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 02:50:48 juju-e4d256-prod-github-runner-207 kernel: [77222.342528] Call Trace: Aug 23 02:50:48 juju-e4d256-prod-github-runner-207 kernel: [77222.343202] Aug 23 02:50:48 juju-e4d256-prod-github-runner-207 kernel: [77222.343847] show_stack+0x52/0x5c Aug 23 02:50:48 juju-e4d256-prod-github-runner-207 kernel: [77222.344607] dump_stack_lvl+0x4a/0x63 Aug 23 02:50:48 juju-e4d256-prod-github-runner-207 kernel: [77222.345360] dump_stack+0x10/0x16 Aug 23 02:50:48 juju-e4d256-prod-github-runner-207 kernel: [77222.346098] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 23 02:50:48 juju-e4d256-prod-github-runner-207 kernel: [77222.346880] ? lapic_can_unplug_cpu+0x90/0x90 Aug 23 02:50:48 juju-e4d256-prod-github-runner-207 kernel: [77222.347667] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 23 02:50:48 juju-e4d256-prod-github-runner-207 kernel: [77222.348502] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 23 02:50:48 juju-e4d256-prod-github-runner-207 kernel: [77222.349323] trigger_single_cpu_backtrace+0x44/0x4f Aug 23 02:50:48 juju-e4d256-prod-github-runner-207 kernel: [77222.350175] rcu_dump_cpu_stacks+0x102/0x149 Aug 23 02:50:48 juju-e4d256-prod-github-runner-207 kernel: [77222.350997] print_cpu_stall.cold+0x2f/0xe2 Aug 23 02:50:48 juju-e4d256-prod-github-runner-207 kernel: [77222.351850] ? timekeeping_update+0xf7/0x150 Aug 23 02:50:48 juju-e4d256-prod-github-runner-207 kernel: [77222.352698] check_cpu_stall+0x109/0x270 Aug 23 02:50:48 juju-e4d256-prod-github-runner-207 kernel: [77222.353468] rcu_sched_clock_irq+0x9a/0x250 Aug 23 02:50:48 juju-e4d256-prod-github-runner-207 kernel: [77222.354251] update_process_times+0x94/0xd0 Aug 23 02:50:48 juju-e4d256-prod-github-runner-207 kernel: [77222.355036] tick_sched_handle+0x29/0x70 Aug 23 02:50:48 juju-e4d256-prod-github-runner-207 kernel: [77222.355798] tick_sched_timer+0x8c/0xc0 Aug 23 02:50:48 juju-e4d256-prod-github-runner-207 kernel: [77222.356643] ? tick_nohz_handler+0xb0/0xb0 Aug 23 02:50:48 juju-e4d256-prod-github-runner-207 kernel: [77222.357407] __hrtimer_run_queues+0x107/0x230 Aug 23 02:50:48 juju-e4d256-prod-github-runner-207 kernel: [77222.358257] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 02:50:48 juju-e4d256-prod-github-runner-207 kernel: [77222.359036] hrtimer_interrupt+0x101/0x220 Aug 23 02:50:48 juju-e4d256-prod-github-runner-207 kernel: [77222.359839] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 02:50:48 juju-e4d256-prod-github-runner-207 kernel: [77222.360709] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 02:50:48 juju-e4d256-prod-github-runner-207 kernel: [77222.361541] Aug 23 02:50:48 juju-e4d256-prod-github-runner-207 kernel: [77222.362183] Aug 23 02:50:48 juju-e4d256-prod-github-runner-207 kernel: [77222.362833] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 02:50:48 juju-e4d256-prod-github-runner-207 kernel: [77222.363659] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:50:48 juju-e4d256-prod-github-runner-207 kernel: [77222.364579] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 02:50:48 juju-e4d256-prod-github-runner-207 kernel: [77222.366971] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 02:50:48 juju-e4d256-prod-github-runner-207 kernel: [77222.367922] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 02:50:48 juju-e4d256-prod-github-runner-207 kernel: [77222.369007] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 02:50:48 juju-e4d256-prod-github-runner-207 kernel: [77222.370114] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 02:50:48 juju-e4d256-prod-github-runner-207 kernel: [77222.371132] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 02:50:48 juju-e4d256-prod-github-runner-207 kernel: [77222.372161] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 02:50:48 juju-e4d256-prod-github-runner-207 kernel: [77222.373169] ? _raw_spin_lock+0x22/0x30 Aug 23 02:50:48 juju-e4d256-prod-github-runner-207 kernel: [77222.373968] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:50:48 juju-e4d256-prod-github-runner-207 kernel: [77222.374834] direct_page_fault+0x206/0x310 [kvm] Aug 23 02:50:48 juju-e4d256-prod-github-runner-207 kernel: [77222.375797] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 02:50:48 juju-e4d256-prod-github-runner-207 kernel: [77222.376726] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 02:50:48 juju-e4d256-prod-github-runner-207 kernel: [77222.377604] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 02:50:48 juju-e4d256-prod-github-runner-207 kernel: [77222.378455] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 02:50:48 juju-e4d256-prod-github-runner-207 kernel: [77222.379264] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 02:50:48 juju-e4d256-prod-github-runner-207 kernel: [77222.380151] handle_exit+0x98/0x230 [kvm_amd] Aug 23 02:50:48 juju-e4d256-prod-github-runner-207 kernel: [77222.381063] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 02:50:48 juju-e4d256-prod-github-runner-207 kernel: [77222.381966] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 02:50:48 juju-e4d256-prod-github-runner-207 kernel: [77222.383124] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 02:50:48 juju-e4d256-prod-github-runner-207 kernel: [77222.384036] vcpu_run+0x62/0x2c0 [kvm] Aug 23 02:50:48 juju-e4d256-prod-github-runner-207 kernel: [77222.384840] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 02:50:48 juju-e4d256-prod-github-runner-207 kernel: [77222.385729] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 02:50:48 juju-e4d256-prod-github-runner-207 kernel: [77222.386643] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 02:50:48 juju-e4d256-prod-github-runner-207 kernel: [77222.387463] ? __seccomp_filter+0x4a/0x4a0 Aug 23 02:50:48 juju-e4d256-prod-github-runner-207 kernel: [77222.388207] ? __fget_files+0x86/0xc0 Aug 23 02:50:48 juju-e4d256-prod-github-runner-207 kernel: [77222.389095] __x64_sys_ioctl+0x95/0xd0 Aug 23 02:50:48 juju-e4d256-prod-github-runner-207 kernel: [77222.389816] do_syscall_64+0x5c/0xc0 Aug 23 02:50:48 juju-e4d256-prod-github-runner-207 kernel: [77222.390506] ? do_futex+0x162/0x1f0 Aug 23 02:50:48 juju-e4d256-prod-github-runner-207 kernel: [77222.391214] ? __x64_sys_futex+0x78/0x1e0 Aug 23 02:50:48 juju-e4d256-prod-github-runner-207 kernel: [77222.392124] ? __secure_computing+0xa9/0x120 Aug 23 02:50:48 juju-e4d256-prod-github-runner-207 kernel: [77222.392889] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 02:50:48 juju-e4d256-prod-github-runner-207 kernel: [77222.393686] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:50:48 juju-e4d256-prod-github-runner-207 kernel: [77222.394475] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:50:48 juju-e4d256-prod-github-runner-207 kernel: [77222.395239] ? do_syscall_64+0x69/0xc0 Aug 23 02:50:48 juju-e4d256-prod-github-runner-207 kernel: [77222.396016] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:50:48 juju-e4d256-prod-github-runner-207 kernel: [77222.396806] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:50:48 juju-e4d256-prod-github-runner-207 kernel: [77222.397610] ? do_syscall_64+0x69/0xc0 Aug 23 02:50:48 juju-e4d256-prod-github-runner-207 kernel: [77222.398384] ? do_syscall_64+0x69/0xc0 Aug 23 02:50:48 juju-e4d256-prod-github-runner-207 kernel: [77222.399083] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 02:50:48 juju-e4d256-prod-github-runner-207 kernel: [77222.399929] RIP: 0033:0x7faa5d0edaff Aug 23 02:50:48 juju-e4d256-prod-github-runner-207 kernel: [77222.400624] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 02:50:48 juju-e4d256-prod-github-runner-207 kernel: [77222.403023] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 02:50:48 juju-e4d256-prod-github-runner-207 kernel: [77222.404020] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 02:50:48 juju-e4d256-prod-github-runner-207 kernel: [77222.405057] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 02:50:48 juju-e4d256-prod-github-runner-207 kernel: [77222.406014] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 02:50:48 juju-e4d256-prod-github-runner-207 kernel: [77222.406988] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 02:50:48 juju-e4d256-prod-github-runner-207 kernel: [77222.407987] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 02:50:48 juju-e4d256-prod-github-runner-207 kernel: [77222.408939] Aug 23 02:51:14 juju-e4d256-prod-github-runner-207 kernel: [77248.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 71835s! [qemu-system-x86:6715] Aug 23 02:51:14 juju-e4d256-prod-github-runner-207 kernel: [77248.543141] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 02:51:14 juju-e4d256-prod-github-runner-207 kernel: [77248.543213] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 02:51:14 juju-e4d256-prod-github-runner-207 kernel: [77248.555911] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 02:51:14 juju-e4d256-prod-github-runner-207 kernel: [77248.557227] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 02:51:14 juju-e4d256-prod-github-runner-207 kernel: [77248.558496] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:51:14 juju-e4d256-prod-github-runner-207 kernel: [77248.559574] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 02:51:14 juju-e4d256-prod-github-runner-207 kernel: [77248.562230] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 02:51:14 juju-e4d256-prod-github-runner-207 kernel: [77248.563300] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 02:51:14 juju-e4d256-prod-github-runner-207 kernel: [77248.564494] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 02:51:14 juju-e4d256-prod-github-runner-207 kernel: [77248.565676] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 02:51:14 juju-e4d256-prod-github-runner-207 kernel: [77248.566858] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 02:51:14 juju-e4d256-prod-github-runner-207 kernel: [77248.568057] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 02:51:14 juju-e4d256-prod-github-runner-207 kernel: [77248.569266] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 02:51:14 juju-e4d256-prod-github-runner-207 kernel: [77248.570535] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 02:51:14 juju-e4d256-prod-github-runner-207 kernel: [77248.571675] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 02:51:14 juju-e4d256-prod-github-runner-207 kernel: [77248.572892] Call Trace: Aug 23 02:51:14 juju-e4d256-prod-github-runner-207 kernel: [77248.573811] Aug 23 02:51:14 juju-e4d256-prod-github-runner-207 kernel: [77248.574705] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:51:14 juju-e4d256-prod-github-runner-207 kernel: [77248.575766] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:51:14 juju-e4d256-prod-github-runner-207 kernel: [77248.576802] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:51:14 juju-e4d256-prod-github-runner-207 kernel: [77248.577931] ? show_regs.part.0+0x23/0x29 Aug 23 02:51:14 juju-e4d256-prod-github-runner-207 kernel: [77248.578943] ? show_regs.cold+0x8/0xd Aug 23 02:51:14 juju-e4d256-prod-github-runner-207 kernel: [77248.579950] ? watchdog_timer_fn+0x1be/0x220 Aug 23 02:51:14 juju-e4d256-prod-github-runner-207 kernel: [77248.580984] ? lockup_detector_update_enable+0x60/0x60 Aug 23 02:51:14 juju-e4d256-prod-github-runner-207 kernel: [77248.582064] ? __hrtimer_run_queues+0x107/0x230 Aug 23 02:51:14 juju-e4d256-prod-github-runner-207 kernel: [77248.583098] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 02:51:14 juju-e4d256-prod-github-runner-207 kernel: [77248.584142] ? hrtimer_interrupt+0x101/0x220 Aug 23 02:51:14 juju-e4d256-prod-github-runner-207 kernel: [77248.585195] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 02:51:14 juju-e4d256-prod-github-runner-207 kernel: [77248.586278] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 02:51:14 juju-e4d256-prod-github-runner-207 kernel: [77248.587337] Aug 23 02:51:14 juju-e4d256-prod-github-runner-207 kernel: [77248.588208] Aug 23 02:51:14 juju-e4d256-prod-github-runner-207 kernel: [77248.589052] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 02:51:14 juju-e4d256-prod-github-runner-207 kernel: [77248.590100] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:51:14 juju-e4d256-prod-github-runner-207 kernel: [77248.591154] ? _raw_spin_lock+0x22/0x30 Aug 23 02:51:14 juju-e4d256-prod-github-runner-207 kernel: [77248.592124] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:51:14 juju-e4d256-prod-github-runner-207 kernel: [77248.593158] direct_page_fault+0x206/0x310 [kvm] Aug 23 02:51:14 juju-e4d256-prod-github-runner-207 kernel: [77248.594192] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 02:51:14 juju-e4d256-prod-github-runner-207 kernel: [77248.595212] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 02:51:14 juju-e4d256-prod-github-runner-207 kernel: [77248.596238] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 02:51:14 juju-e4d256-prod-github-runner-207 kernel: [77248.597219] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 02:51:14 juju-e4d256-prod-github-runner-207 kernel: [77248.598177] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 02:51:14 juju-e4d256-prod-github-runner-207 kernel: [77248.599170] handle_exit+0x98/0x230 [kvm_amd] Aug 23 02:51:14 juju-e4d256-prod-github-runner-207 kernel: [77248.600111] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 02:51:14 juju-e4d256-prod-github-runner-207 kernel: [77248.601105] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 02:51:14 juju-e4d256-prod-github-runner-207 kernel: [77248.602069] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 02:51:14 juju-e4d256-prod-github-runner-207 kernel: [77248.603028] vcpu_run+0x62/0x2c0 [kvm] Aug 23 02:51:14 juju-e4d256-prod-github-runner-207 kernel: [77248.603867] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 02:51:14 juju-e4d256-prod-github-runner-207 kernel: [77248.604697] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 02:51:14 juju-e4d256-prod-github-runner-207 kernel: [77248.605564] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 02:51:14 juju-e4d256-prod-github-runner-207 kernel: [77248.606379] ? __seccomp_filter+0x4a/0x4a0 Aug 23 02:51:14 juju-e4d256-prod-github-runner-207 kernel: [77248.607130] ? __fget_files+0x86/0xc0 Aug 23 02:51:14 juju-e4d256-prod-github-runner-207 kernel: [77248.607850] __x64_sys_ioctl+0x95/0xd0 Aug 23 02:51:14 juju-e4d256-prod-github-runner-207 kernel: [77248.608552] do_syscall_64+0x5c/0xc0 Aug 23 02:51:14 juju-e4d256-prod-github-runner-207 kernel: [77248.609227] ? do_futex+0x162/0x1f0 Aug 23 02:51:14 juju-e4d256-prod-github-runner-207 kernel: [77248.609885] ? __x64_sys_futex+0x78/0x1e0 Aug 23 02:51:14 juju-e4d256-prod-github-runner-207 kernel: [77248.610727] ? __secure_computing+0xa9/0x120 Aug 23 02:51:14 juju-e4d256-prod-github-runner-207 kernel: [77248.611428] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 02:51:14 juju-e4d256-prod-github-runner-207 kernel: [77248.612282] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:51:14 juju-e4d256-prod-github-runner-207 kernel: [77248.613014] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:51:14 juju-e4d256-prod-github-runner-207 kernel: [77248.613742] ? do_syscall_64+0x69/0xc0 Aug 23 02:51:14 juju-e4d256-prod-github-runner-207 kernel: [77248.614417] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:51:14 juju-e4d256-prod-github-runner-207 kernel: [77248.615144] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:51:14 juju-e4d256-prod-github-runner-207 kernel: [77248.615865] ? do_syscall_64+0x69/0xc0 Aug 23 02:51:14 juju-e4d256-prod-github-runner-207 kernel: [77248.616501] ? do_syscall_64+0x69/0xc0 Aug 23 02:51:14 juju-e4d256-prod-github-runner-207 kernel: [77248.617132] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 02:51:14 juju-e4d256-prod-github-runner-207 kernel: [77248.617850] RIP: 0033:0x7faa5d0edaff Aug 23 02:51:14 juju-e4d256-prod-github-runner-207 kernel: [77248.618481] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 02:51:14 juju-e4d256-prod-github-runner-207 kernel: [77248.620537] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 02:51:14 juju-e4d256-prod-github-runner-207 kernel: [77248.621463] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 02:51:14 juju-e4d256-prod-github-runner-207 kernel: [77248.622392] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 02:51:14 juju-e4d256-prod-github-runner-207 kernel: [77248.623301] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 02:51:14 juju-e4d256-prod-github-runner-207 kernel: [77248.624228] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 02:51:14 juju-e4d256-prod-github-runner-207 kernel: [77248.625144] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 02:51:14 juju-e4d256-prod-github-runner-207 kernel: [77248.626048] Aug 23 02:51:42 juju-e4d256-prod-github-runner-207 kernel: [77276.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 71861s! [qemu-system-x86:6715] Aug 23 02:51:42 juju-e4d256-prod-github-runner-207 kernel: [77276.543133] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 02:51:42 juju-e4d256-prod-github-runner-207 kernel: [77276.543211] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 02:51:42 juju-e4d256-prod-github-runner-207 kernel: [77276.555488] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 02:51:42 juju-e4d256-prod-github-runner-207 kernel: [77276.556778] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 02:51:42 juju-e4d256-prod-github-runner-207 kernel: [77276.558003] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:51:42 juju-e4d256-prod-github-runner-207 kernel: [77276.559072] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 02:51:42 juju-e4d256-prod-github-runner-207 kernel: [77276.561658] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 02:51:42 juju-e4d256-prod-github-runner-207 kernel: [77276.562699] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 02:51:42 juju-e4d256-prod-github-runner-207 kernel: [77276.563898] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 02:51:42 juju-e4d256-prod-github-runner-207 kernel: [77276.565102] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 02:51:42 juju-e4d256-prod-github-runner-207 kernel: [77276.566278] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 02:51:42 juju-e4d256-prod-github-runner-207 kernel: [77276.567475] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 02:51:42 juju-e4d256-prod-github-runner-207 kernel: [77276.568641] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 02:51:42 juju-e4d256-prod-github-runner-207 kernel: [77276.569886] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 02:51:42 juju-e4d256-prod-github-runner-207 kernel: [77276.571151] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 02:51:42 juju-e4d256-prod-github-runner-207 kernel: [77276.572363] Call Trace: Aug 23 02:51:42 juju-e4d256-prod-github-runner-207 kernel: [77276.573293] Aug 23 02:51:42 juju-e4d256-prod-github-runner-207 kernel: [77276.574196] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:51:42 juju-e4d256-prod-github-runner-207 kernel: [77276.575254] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:51:42 juju-e4d256-prod-github-runner-207 kernel: [77276.576301] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:51:42 juju-e4d256-prod-github-runner-207 kernel: [77276.577384] ? show_regs.part.0+0x23/0x29 Aug 23 02:51:42 juju-e4d256-prod-github-runner-207 kernel: [77276.578380] ? show_regs.cold+0x8/0xd Aug 23 02:51:42 juju-e4d256-prod-github-runner-207 kernel: [77276.579359] ? watchdog_timer_fn+0x1be/0x220 Aug 23 02:51:42 juju-e4d256-prod-github-runner-207 kernel: [77276.580381] ? lockup_detector_update_enable+0x60/0x60 Aug 23 02:51:42 juju-e4d256-prod-github-runner-207 kernel: [77276.581447] ? __hrtimer_run_queues+0x107/0x230 Aug 23 02:51:42 juju-e4d256-prod-github-runner-207 kernel: [77276.582475] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 02:51:42 juju-e4d256-prod-github-runner-207 kernel: [77276.583509] ? hrtimer_interrupt+0x101/0x220 Aug 23 02:51:42 juju-e4d256-prod-github-runner-207 kernel: [77276.584525] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 02:51:42 juju-e4d256-prod-github-runner-207 kernel: [77276.585602] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 02:51:42 juju-e4d256-prod-github-runner-207 kernel: [77276.586649] Aug 23 02:51:42 juju-e4d256-prod-github-runner-207 kernel: [77276.587521] Aug 23 02:51:42 juju-e4d256-prod-github-runner-207 kernel: [77276.588359] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 02:51:42 juju-e4d256-prod-github-runner-207 kernel: [77276.589390] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:51:42 juju-e4d256-prod-github-runner-207 kernel: [77276.590441] ? _raw_spin_lock+0x22/0x30 Aug 23 02:51:42 juju-e4d256-prod-github-runner-207 kernel: [77276.591404] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:51:42 juju-e4d256-prod-github-runner-207 kernel: [77276.592424] direct_page_fault+0x206/0x310 [kvm] Aug 23 02:51:42 juju-e4d256-prod-github-runner-207 kernel: [77276.593456] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 02:51:42 juju-e4d256-prod-github-runner-207 kernel: [77276.594594] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 02:51:42 juju-e4d256-prod-github-runner-207 kernel: [77276.595765] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 02:51:42 juju-e4d256-prod-github-runner-207 kernel: [77276.596871] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 02:51:42 juju-e4d256-prod-github-runner-207 kernel: [77276.597917] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 02:51:42 juju-e4d256-prod-github-runner-207 kernel: [77276.599002] handle_exit+0x98/0x230 [kvm_amd] Aug 23 02:51:42 juju-e4d256-prod-github-runner-207 kernel: [77276.600007] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 02:51:42 juju-e4d256-prod-github-runner-207 kernel: [77276.601053] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 02:51:42 juju-e4d256-prod-github-runner-207 kernel: [77276.602164] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 02:51:42 juju-e4d256-prod-github-runner-207 kernel: [77276.603170] vcpu_run+0x62/0x2c0 [kvm] Aug 23 02:51:42 juju-e4d256-prod-github-runner-207 kernel: [77276.604072] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 02:51:42 juju-e4d256-prod-github-runner-207 kernel: [77276.604969] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 02:51:42 juju-e4d256-prod-github-runner-207 kernel: [77276.605934] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 02:51:42 juju-e4d256-prod-github-runner-207 kernel: [77276.606843] ? __seccomp_filter+0x4a/0x4a0 Aug 23 02:51:42 juju-e4d256-prod-github-runner-207 kernel: [77276.607678] ? __fget_files+0x86/0xc0 Aug 23 02:51:42 juju-e4d256-prod-github-runner-207 kernel: [77276.608463] __x64_sys_ioctl+0x95/0xd0 Aug 23 02:51:42 juju-e4d256-prod-github-runner-207 kernel: [77276.609232] do_syscall_64+0x5c/0xc0 Aug 23 02:51:42 juju-e4d256-prod-github-runner-207 kernel: [77276.609970] ? do_futex+0x162/0x1f0 Aug 23 02:51:42 juju-e4d256-prod-github-runner-207 kernel: [77276.610687] ? __x64_sys_futex+0x78/0x1e0 Aug 23 02:51:42 juju-e4d256-prod-github-runner-207 kernel: [77276.611470] ? __secure_computing+0xa9/0x120 Aug 23 02:51:42 juju-e4d256-prod-github-runner-207 kernel: [77276.612268] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 02:51:42 juju-e4d256-prod-github-runner-207 kernel: [77276.613132] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:51:42 juju-e4d256-prod-github-runner-207 kernel: [77276.613946] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:51:42 juju-e4d256-prod-github-runner-207 kernel: [77276.614759] ? do_syscall_64+0x69/0xc0 Aug 23 02:51:42 juju-e4d256-prod-github-runner-207 kernel: [77276.615493] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:51:42 juju-e4d256-prod-github-runner-207 kernel: [77276.616305] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:51:42 juju-e4d256-prod-github-runner-207 kernel: [77276.617112] ? do_syscall_64+0x69/0xc0 Aug 23 02:51:42 juju-e4d256-prod-github-runner-207 kernel: [77276.617811] ? do_syscall_64+0x69/0xc0 Aug 23 02:51:42 juju-e4d256-prod-github-runner-207 kernel: [77276.618509] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 02:51:42 juju-e4d256-prod-github-runner-207 kernel: [77276.619327] RIP: 0033:0x7faa5d0edaff Aug 23 02:51:42 juju-e4d256-prod-github-runner-207 kernel: [77276.620026] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 02:51:42 juju-e4d256-prod-github-runner-207 kernel: [77276.622352] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 02:51:42 juju-e4d256-prod-github-runner-207 kernel: [77276.623435] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 02:51:42 juju-e4d256-prod-github-runner-207 kernel: [77276.624465] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 02:51:42 juju-e4d256-prod-github-runner-207 kernel: [77276.625489] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 02:51:42 juju-e4d256-prod-github-runner-207 kernel: [77276.626510] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 02:51:42 juju-e4d256-prod-github-runner-207 kernel: [77276.627557] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 02:51:42 juju-e4d256-prod-github-runner-207 kernel: [77276.628599] Aug 23 02:52:10 juju-e4d256-prod-github-runner-207 kernel: [77304.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 71887s! [qemu-system-x86:6715] Aug 23 02:52:10 juju-e4d256-prod-github-runner-207 kernel: [77304.543868] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 02:52:10 juju-e4d256-prod-github-runner-207 kernel: [77304.544146] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 02:52:10 juju-e4d256-prod-github-runner-207 kernel: [77304.556592] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 02:52:10 juju-e4d256-prod-github-runner-207 kernel: [77304.557863] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 02:52:10 juju-e4d256-prod-github-runner-207 kernel: [77304.559120] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:52:10 juju-e4d256-prod-github-runner-207 kernel: [77304.560182] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 02:52:10 juju-e4d256-prod-github-runner-207 kernel: [77304.562755] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 02:52:10 juju-e4d256-prod-github-runner-207 kernel: [77304.564006] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 02:52:10 juju-e4d256-prod-github-runner-207 kernel: [77304.565310] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 02:52:10 juju-e4d256-prod-github-runner-207 kernel: [77304.566554] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 02:52:10 juju-e4d256-prod-github-runner-207 kernel: [77304.567736] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 02:52:10 juju-e4d256-prod-github-runner-207 kernel: [77304.568905] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 02:52:10 juju-e4d256-prod-github-runner-207 kernel: [77304.570155] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 02:52:10 juju-e4d256-prod-github-runner-207 kernel: [77304.571417] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 02:52:10 juju-e4d256-prod-github-runner-207 kernel: [77304.572528] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 02:52:10 juju-e4d256-prod-github-runner-207 kernel: [77304.573728] Call Trace: Aug 23 02:52:10 juju-e4d256-prod-github-runner-207 kernel: [77304.574641] Aug 23 02:52:10 juju-e4d256-prod-github-runner-207 kernel: [77304.575565] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:52:10 juju-e4d256-prod-github-runner-207 kernel: [77304.576599] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:52:10 juju-e4d256-prod-github-runner-207 kernel: [77304.577643] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:52:10 juju-e4d256-prod-github-runner-207 kernel: [77304.578770] ? show_regs.part.0+0x23/0x29 Aug 23 02:52:10 juju-e4d256-prod-github-runner-207 kernel: [77304.579802] ? show_regs.cold+0x8/0xd Aug 23 02:52:10 juju-e4d256-prod-github-runner-207 kernel: [77304.580777] ? watchdog_timer_fn+0x1be/0x220 Aug 23 02:52:10 juju-e4d256-prod-github-runner-207 kernel: [77304.581792] ? lockup_detector_update_enable+0x60/0x60 Aug 23 02:52:10 juju-e4d256-prod-github-runner-207 kernel: [77304.582873] ? __hrtimer_run_queues+0x107/0x230 Aug 23 02:52:10 juju-e4d256-prod-github-runner-207 kernel: [77304.584159] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 02:52:10 juju-e4d256-prod-github-runner-207 kernel: [77304.585222] ? hrtimer_interrupt+0x101/0x220 Aug 23 02:52:10 juju-e4d256-prod-github-runner-207 kernel: [77304.586258] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 02:52:10 juju-e4d256-prod-github-runner-207 kernel: [77304.587352] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 02:52:10 juju-e4d256-prod-github-runner-207 kernel: [77304.588399] Aug 23 02:52:10 juju-e4d256-prod-github-runner-207 kernel: [77304.589254] Aug 23 02:52:10 juju-e4d256-prod-github-runner-207 kernel: [77304.590096] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 02:52:10 juju-e4d256-prod-github-runner-207 kernel: [77304.591168] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:52:10 juju-e4d256-prod-github-runner-207 kernel: [77304.592209] ? _raw_spin_lock+0x22/0x30 Aug 23 02:52:10 juju-e4d256-prod-github-runner-207 kernel: [77304.593166] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:52:10 juju-e4d256-prod-github-runner-207 kernel: [77304.594193] direct_page_fault+0x206/0x310 [kvm] Aug 23 02:52:10 juju-e4d256-prod-github-runner-207 kernel: [77304.595241] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 02:52:10 juju-e4d256-prod-github-runner-207 kernel: [77304.596251] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 02:52:10 juju-e4d256-prod-github-runner-207 kernel: [77304.597259] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 02:52:10 juju-e4d256-prod-github-runner-207 kernel: [77304.598292] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 02:52:10 juju-e4d256-prod-github-runner-207 kernel: [77304.599255] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 02:52:10 juju-e4d256-prod-github-runner-207 kernel: [77304.600243] handle_exit+0x98/0x230 [kvm_amd] Aug 23 02:52:10 juju-e4d256-prod-github-runner-207 kernel: [77304.601140] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 02:52:10 juju-e4d256-prod-github-runner-207 kernel: [77304.602057] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 02:52:10 juju-e4d256-prod-github-runner-207 kernel: [77304.603017] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 02:52:10 juju-e4d256-prod-github-runner-207 kernel: [77304.603929] vcpu_run+0x62/0x2c0 [kvm] Aug 23 02:52:10 juju-e4d256-prod-github-runner-207 kernel: [77304.604742] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 02:52:10 juju-e4d256-prod-github-runner-207 kernel: [77304.605552] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 02:52:10 juju-e4d256-prod-github-runner-207 kernel: [77304.606412] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 02:52:10 juju-e4d256-prod-github-runner-207 kernel: [77304.607224] ? __seccomp_filter+0x4a/0x4a0 Aug 23 02:52:10 juju-e4d256-prod-github-runner-207 kernel: [77304.607970] ? __fget_files+0x86/0xc0 Aug 23 02:52:10 juju-e4d256-prod-github-runner-207 kernel: [77304.608680] __x64_sys_ioctl+0x95/0xd0 Aug 23 02:52:10 juju-e4d256-prod-github-runner-207 kernel: [77304.609375] do_syscall_64+0x5c/0xc0 Aug 23 02:52:10 juju-e4d256-prod-github-runner-207 kernel: [77304.610044] ? do_futex+0x162/0x1f0 Aug 23 02:52:10 juju-e4d256-prod-github-runner-207 kernel: [77304.610702] ? __x64_sys_futex+0x78/0x1e0 Aug 23 02:52:10 juju-e4d256-prod-github-runner-207 kernel: [77304.611401] ? __secure_computing+0xa9/0x120 Aug 23 02:52:10 juju-e4d256-prod-github-runner-207 kernel: [77304.612092] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 02:52:10 juju-e4d256-prod-github-runner-207 kernel: [77304.612853] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:52:10 juju-e4d256-prod-github-runner-207 kernel: [77304.613580] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:52:10 juju-e4d256-prod-github-runner-207 kernel: [77304.614387] ? do_syscall_64+0x69/0xc0 Aug 23 02:52:10 juju-e4d256-prod-github-runner-207 kernel: [77304.615273] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:52:10 juju-e4d256-prod-github-runner-207 kernel: [77304.615996] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:52:10 juju-e4d256-prod-github-runner-207 kernel: [77304.616692] ? do_syscall_64+0x69/0xc0 Aug 23 02:52:10 juju-e4d256-prod-github-runner-207 kernel: [77304.617323] ? do_syscall_64+0x69/0xc0 Aug 23 02:52:10 juju-e4d256-prod-github-runner-207 kernel: [77304.617950] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 02:52:10 juju-e4d256-prod-github-runner-207 kernel: [77304.618663] RIP: 0033:0x7faa5d0edaff Aug 23 02:52:10 juju-e4d256-prod-github-runner-207 kernel: [77304.619349] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 02:52:10 juju-e4d256-prod-github-runner-207 kernel: [77304.621345] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 02:52:10 juju-e4d256-prod-github-runner-207 kernel: [77304.622259] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 02:52:10 juju-e4d256-prod-github-runner-207 kernel: [77304.623165] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 02:52:10 juju-e4d256-prod-github-runner-207 kernel: [77304.624060] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 02:52:10 juju-e4d256-prod-github-runner-207 kernel: [77304.624955] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 02:52:10 juju-e4d256-prod-github-runner-207 kernel: [77304.625843] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 02:52:10 juju-e4d256-prod-github-runner-207 kernel: [77304.626735] Aug 23 02:52:38 juju-e4d256-prod-github-runner-207 kernel: [77332.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 71913s! [qemu-system-x86:6715] Aug 23 02:52:38 juju-e4d256-prod-github-runner-207 kernel: [77332.543098] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 02:52:38 juju-e4d256-prod-github-runner-207 kernel: [77332.543172] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 02:52:38 juju-e4d256-prod-github-runner-207 kernel: [77332.555683] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 02:52:38 juju-e4d256-prod-github-runner-207 kernel: [77332.556953] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 02:52:38 juju-e4d256-prod-github-runner-207 kernel: [77332.558326] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:52:38 juju-e4d256-prod-github-runner-207 kernel: [77332.559430] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 02:52:38 juju-e4d256-prod-github-runner-207 kernel: [77332.561996] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 02:52:38 juju-e4d256-prod-github-runner-207 kernel: [77332.563056] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 02:52:38 juju-e4d256-prod-github-runner-207 kernel: [77332.564233] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 02:52:38 juju-e4d256-prod-github-runner-207 kernel: [77332.565402] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 02:52:38 juju-e4d256-prod-github-runner-207 kernel: [77332.566571] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 02:52:38 juju-e4d256-prod-github-runner-207 kernel: [77332.567750] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 02:52:38 juju-e4d256-prod-github-runner-207 kernel: [77332.568920] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 02:52:38 juju-e4d256-prod-github-runner-207 kernel: [77332.570156] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 02:52:38 juju-e4d256-prod-github-runner-207 kernel: [77332.571280] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 02:52:38 juju-e4d256-prod-github-runner-207 kernel: [77332.572491] Call Trace: Aug 23 02:52:38 juju-e4d256-prod-github-runner-207 kernel: [77332.573407] Aug 23 02:52:38 juju-e4d256-prod-github-runner-207 kernel: [77332.574294] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:52:38 juju-e4d256-prod-github-runner-207 kernel: [77332.575343] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:52:38 juju-e4d256-prod-github-runner-207 kernel: [77332.576367] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:52:38 juju-e4d256-prod-github-runner-207 kernel: [77332.577451] ? show_regs.part.0+0x23/0x29 Aug 23 02:52:38 juju-e4d256-prod-github-runner-207 kernel: [77332.578452] ? show_regs.cold+0x8/0xd Aug 23 02:52:38 juju-e4d256-prod-github-runner-207 kernel: [77332.579436] ? watchdog_timer_fn+0x1be/0x220 Aug 23 02:52:38 juju-e4d256-prod-github-runner-207 kernel: [77332.580447] ? lockup_detector_update_enable+0x60/0x60 Aug 23 02:52:38 juju-e4d256-prod-github-runner-207 kernel: [77332.581518] ? __hrtimer_run_queues+0x107/0x230 Aug 23 02:52:38 juju-e4d256-prod-github-runner-207 kernel: [77332.582549] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 02:52:38 juju-e4d256-prod-github-runner-207 kernel: [77332.583623] ? hrtimer_interrupt+0x101/0x220 Aug 23 02:52:38 juju-e4d256-prod-github-runner-207 kernel: [77332.584659] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 02:52:38 juju-e4d256-prod-github-runner-207 kernel: [77332.585734] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 02:52:38 juju-e4d256-prod-github-runner-207 kernel: [77332.586793] Aug 23 02:52:38 juju-e4d256-prod-github-runner-207 kernel: [77332.587647] Aug 23 02:52:38 juju-e4d256-prod-github-runner-207 kernel: [77332.588482] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 02:52:38 juju-e4d256-prod-github-runner-207 kernel: [77332.589515] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:52:38 juju-e4d256-prod-github-runner-207 kernel: [77332.590556] ? _raw_spin_lock+0x22/0x30 Aug 23 02:52:38 juju-e4d256-prod-github-runner-207 kernel: [77332.591506] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:52:38 juju-e4d256-prod-github-runner-207 kernel: [77332.592521] direct_page_fault+0x206/0x310 [kvm] Aug 23 02:52:38 juju-e4d256-prod-github-runner-207 kernel: [77332.593548] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 02:52:38 juju-e4d256-prod-github-runner-207 kernel: [77332.594557] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 02:52:38 juju-e4d256-prod-github-runner-207 kernel: [77332.595564] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 02:52:38 juju-e4d256-prod-github-runner-207 kernel: [77332.596533] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 02:52:38 juju-e4d256-prod-github-runner-207 kernel: [77332.597477] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 02:52:38 juju-e4d256-prod-github-runner-207 kernel: [77332.598491] handle_exit+0x98/0x230 [kvm_amd] Aug 23 02:52:38 juju-e4d256-prod-github-runner-207 kernel: [77332.599400] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 02:52:38 juju-e4d256-prod-github-runner-207 kernel: [77332.600314] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 02:52:38 juju-e4d256-prod-github-runner-207 kernel: [77332.601236] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 02:52:38 juju-e4d256-prod-github-runner-207 kernel: [77332.602197] vcpu_run+0x62/0x2c0 [kvm] Aug 23 02:52:38 juju-e4d256-prod-github-runner-207 kernel: [77332.603064] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 02:52:38 juju-e4d256-prod-github-runner-207 kernel: [77332.603886] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 02:52:38 juju-e4d256-prod-github-runner-207 kernel: [77332.604751] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 02:52:38 juju-e4d256-prod-github-runner-207 kernel: [77332.605548] ? __seccomp_filter+0x4a/0x4a0 Aug 23 02:52:38 juju-e4d256-prod-github-runner-207 kernel: [77332.606296] ? __fget_files+0x86/0xc0 Aug 23 02:52:38 juju-e4d256-prod-github-runner-207 kernel: [77332.607017] __x64_sys_ioctl+0x95/0xd0 Aug 23 02:52:38 juju-e4d256-prod-github-runner-207 kernel: [77332.607709] do_syscall_64+0x5c/0xc0 Aug 23 02:52:38 juju-e4d256-prod-github-runner-207 kernel: [77332.608372] ? do_futex+0x162/0x1f0 Aug 23 02:52:38 juju-e4d256-prod-github-runner-207 kernel: [77332.609044] ? __x64_sys_futex+0x78/0x1e0 Aug 23 02:52:38 juju-e4d256-prod-github-runner-207 kernel: [77332.609722] ? __secure_computing+0xa9/0x120 Aug 23 02:52:38 juju-e4d256-prod-github-runner-207 kernel: [77332.610424] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 02:52:38 juju-e4d256-prod-github-runner-207 kernel: [77332.611198] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:52:38 juju-e4d256-prod-github-runner-207 kernel: [77332.611922] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:52:38 juju-e4d256-prod-github-runner-207 kernel: [77332.612642] ? do_syscall_64+0x69/0xc0 Aug 23 02:52:38 juju-e4d256-prod-github-runner-207 kernel: [77332.613288] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:52:38 juju-e4d256-prod-github-runner-207 kernel: [77332.613992] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:52:38 juju-e4d256-prod-github-runner-207 kernel: [77332.614710] ? do_syscall_64+0x69/0xc0 Aug 23 02:52:38 juju-e4d256-prod-github-runner-207 kernel: [77332.615337] ? do_syscall_64+0x69/0xc0 Aug 23 02:52:38 juju-e4d256-prod-github-runner-207 kernel: [77332.615961] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 02:52:38 juju-e4d256-prod-github-runner-207 kernel: [77332.616664] RIP: 0033:0x7faa5d0edaff Aug 23 02:52:38 juju-e4d256-prod-github-runner-207 kernel: [77332.617287] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 02:52:38 juju-e4d256-prod-github-runner-207 kernel: [77332.619284] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 02:52:38 juju-e4d256-prod-github-runner-207 kernel: [77332.620246] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 02:52:38 juju-e4d256-prod-github-runner-207 kernel: [77332.621142] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 02:52:38 juju-e4d256-prod-github-runner-207 kernel: [77332.622051] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 02:52:38 juju-e4d256-prod-github-runner-207 kernel: [77332.622984] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 02:52:38 juju-e4d256-prod-github-runner-207 kernel: [77332.623874] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 02:52:38 juju-e4d256-prod-github-runner-207 kernel: [77332.624764] Aug 23 02:53:06 juju-e4d256-prod-github-runner-207 kernel: [77360.541976] watchdog: BUG: soft lockup - CPU#1 stuck for 71939s! [qemu-system-x86:6715] Aug 23 02:53:06 juju-e4d256-prod-github-runner-207 kernel: [77360.543105] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 02:53:06 juju-e4d256-prod-github-runner-207 kernel: [77360.543179] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 02:53:06 juju-e4d256-prod-github-runner-207 kernel: [77360.555424] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 02:53:06 juju-e4d256-prod-github-runner-207 kernel: [77360.556685] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 02:53:06 juju-e4d256-prod-github-runner-207 kernel: [77360.557907] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:53:06 juju-e4d256-prod-github-runner-207 kernel: [77360.558973] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 02:53:06 juju-e4d256-prod-github-runner-207 kernel: [77360.561540] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 02:53:06 juju-e4d256-prod-github-runner-207 kernel: [77360.562594] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 02:53:06 juju-e4d256-prod-github-runner-207 kernel: [77360.563759] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 02:53:06 juju-e4d256-prod-github-runner-207 kernel: [77360.564942] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 02:53:06 juju-e4d256-prod-github-runner-207 kernel: [77360.566103] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 02:53:06 juju-e4d256-prod-github-runner-207 kernel: [77360.567284] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 02:53:06 juju-e4d256-prod-github-runner-207 kernel: [77360.568454] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 02:53:06 juju-e4d256-prod-github-runner-207 kernel: [77360.569683] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 02:53:06 juju-e4d256-prod-github-runner-207 kernel: [77360.570793] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 02:53:06 juju-e4d256-prod-github-runner-207 kernel: [77360.571992] Call Trace: Aug 23 02:53:06 juju-e4d256-prod-github-runner-207 kernel: [77360.572904] Aug 23 02:53:06 juju-e4d256-prod-github-runner-207 kernel: [77360.573794] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:53:06 juju-e4d256-prod-github-runner-207 kernel: [77360.574833] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:53:06 juju-e4d256-prod-github-runner-207 kernel: [77360.575853] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:53:06 juju-e4d256-prod-github-runner-207 kernel: [77360.576930] ? show_regs.part.0+0x23/0x29 Aug 23 02:53:06 juju-e4d256-prod-github-runner-207 kernel: [77360.577947] ? show_regs.cold+0x8/0xd Aug 23 02:53:06 juju-e4d256-prod-github-runner-207 kernel: [77360.578945] ? watchdog_timer_fn+0x1be/0x220 Aug 23 02:53:06 juju-e4d256-prod-github-runner-207 kernel: [77360.579954] ? lockup_detector_update_enable+0x60/0x60 Aug 23 02:53:06 juju-e4d256-prod-github-runner-207 kernel: [77360.581015] ? __hrtimer_run_queues+0x107/0x230 Aug 23 02:53:06 juju-e4d256-prod-github-runner-207 kernel: [77360.582042] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 02:53:06 juju-e4d256-prod-github-runner-207 kernel: [77360.583075] ? hrtimer_interrupt+0x101/0x220 Aug 23 02:53:06 juju-e4d256-prod-github-runner-207 kernel: [77360.584094] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 02:53:06 juju-e4d256-prod-github-runner-207 kernel: [77360.585170] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 02:53:06 juju-e4d256-prod-github-runner-207 kernel: [77360.586218] Aug 23 02:53:06 juju-e4d256-prod-github-runner-207 kernel: [77360.587079] Aug 23 02:53:06 juju-e4d256-prod-github-runner-207 kernel: [77360.587931] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 02:53:06 juju-e4d256-prod-github-runner-207 kernel: [77360.588975] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:53:06 juju-e4d256-prod-github-runner-207 kernel: [77360.590017] ? _raw_spin_lock+0x22/0x30 Aug 23 02:53:06 juju-e4d256-prod-github-runner-207 kernel: [77360.590975] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:53:06 juju-e4d256-prod-github-runner-207 kernel: [77360.591995] direct_page_fault+0x206/0x310 [kvm] Aug 23 02:53:06 juju-e4d256-prod-github-runner-207 kernel: [77360.593023] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 02:53:06 juju-e4d256-prod-github-runner-207 kernel: [77360.594032] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 02:53:06 juju-e4d256-prod-github-runner-207 kernel: [77360.595048] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 02:53:06 juju-e4d256-prod-github-runner-207 kernel: [77360.596020] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 02:53:06 juju-e4d256-prod-github-runner-207 kernel: [77360.596966] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 02:53:06 juju-e4d256-prod-github-runner-207 kernel: [77360.597951] handle_exit+0x98/0x230 [kvm_amd] Aug 23 02:53:06 juju-e4d256-prod-github-runner-207 kernel: [77360.598849] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 02:53:06 juju-e4d256-prod-github-runner-207 kernel: [77360.599774] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 02:53:06 juju-e4d256-prod-github-runner-207 kernel: [77360.600695] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 02:53:06 juju-e4d256-prod-github-runner-207 kernel: [77360.601603] vcpu_run+0x62/0x2c0 [kvm] Aug 23 02:53:06 juju-e4d256-prod-github-runner-207 kernel: [77360.602419] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 02:53:06 juju-e4d256-prod-github-runner-207 kernel: [77360.603226] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 02:53:06 juju-e4d256-prod-github-runner-207 kernel: [77360.604101] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 02:53:06 juju-e4d256-prod-github-runner-207 kernel: [77360.604904] ? __seccomp_filter+0x4a/0x4a0 Aug 23 02:53:06 juju-e4d256-prod-github-runner-207 kernel: [77360.605657] ? __fget_files+0x86/0xc0 Aug 23 02:53:06 juju-e4d256-prod-github-runner-207 kernel: [77360.606369] __x64_sys_ioctl+0x95/0xd0 Aug 23 02:53:06 juju-e4d256-prod-github-runner-207 kernel: [77360.607061] do_syscall_64+0x5c/0xc0 Aug 23 02:53:06 juju-e4d256-prod-github-runner-207 kernel: [77360.607725] ? do_futex+0x162/0x1f0 Aug 23 02:53:06 juju-e4d256-prod-github-runner-207 kernel: [77360.608378] ? __x64_sys_futex+0x78/0x1e0 Aug 23 02:53:06 juju-e4d256-prod-github-runner-207 kernel: [77360.609050] ? __secure_computing+0xa9/0x120 Aug 23 02:53:06 juju-e4d256-prod-github-runner-207 kernel: [77360.609739] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 02:53:06 juju-e4d256-prod-github-runner-207 kernel: [77360.610509] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:53:06 juju-e4d256-prod-github-runner-207 kernel: [77360.611235] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:53:06 juju-e4d256-prod-github-runner-207 kernel: [77360.611969] ? do_syscall_64+0x69/0xc0 Aug 23 02:53:06 juju-e4d256-prod-github-runner-207 kernel: [77360.612621] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:53:06 juju-e4d256-prod-github-runner-207 kernel: [77360.613324] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:53:06 juju-e4d256-prod-github-runner-207 kernel: [77360.614024] ? do_syscall_64+0x69/0xc0 Aug 23 02:53:06 juju-e4d256-prod-github-runner-207 kernel: [77360.614655] ? do_syscall_64+0x69/0xc0 Aug 23 02:53:06 juju-e4d256-prod-github-runner-207 kernel: [77360.615278] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 02:53:06 juju-e4d256-prod-github-runner-207 kernel: [77360.615981] RIP: 0033:0x7faa5d0edaff Aug 23 02:53:06 juju-e4d256-prod-github-runner-207 kernel: [77360.616604] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 02:53:06 juju-e4d256-prod-github-runner-207 kernel: [77360.618599] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 02:53:06 juju-e4d256-prod-github-runner-207 kernel: [77360.619510] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 02:53:06 juju-e4d256-prod-github-runner-207 kernel: [77360.620403] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 02:53:06 juju-e4d256-prod-github-runner-207 kernel: [77360.621295] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 02:53:06 juju-e4d256-prod-github-runner-207 kernel: [77360.622183] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 02:53:06 juju-e4d256-prod-github-runner-207 kernel: [77360.623079] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 02:53:06 juju-e4d256-prod-github-runner-207 kernel: [77360.623976] Aug 23 02:53:34 juju-e4d256-prod-github-runner-207 kernel: [77388.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 71965s! [qemu-system-x86:6715] Aug 23 02:53:34 juju-e4d256-prod-github-runner-207 kernel: [77388.543848] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 02:53:34 juju-e4d256-prod-github-runner-207 kernel: [77388.544156] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 02:53:34 juju-e4d256-prod-github-runner-207 kernel: [77388.556241] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 02:53:34 juju-e4d256-prod-github-runner-207 kernel: [77388.557509] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 02:53:34 juju-e4d256-prod-github-runner-207 kernel: [77388.558736] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:53:34 juju-e4d256-prod-github-runner-207 kernel: [77388.559795] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 02:53:34 juju-e4d256-prod-github-runner-207 kernel: [77388.562369] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 02:53:34 juju-e4d256-prod-github-runner-207 kernel: [77388.563417] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 02:53:34 juju-e4d256-prod-github-runner-207 kernel: [77388.564583] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 02:53:34 juju-e4d256-prod-github-runner-207 kernel: [77388.565750] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 02:53:34 juju-e4d256-prod-github-runner-207 kernel: [77388.566921] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 02:53:34 juju-e4d256-prod-github-runner-207 kernel: [77388.568093] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 02:53:34 juju-e4d256-prod-github-runner-207 kernel: [77388.569266] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 02:53:34 juju-e4d256-prod-github-runner-207 kernel: [77388.570514] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 02:53:34 juju-e4d256-prod-github-runner-207 kernel: [77388.571610] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 02:53:34 juju-e4d256-prod-github-runner-207 kernel: [77388.572800] Call Trace: Aug 23 02:53:34 juju-e4d256-prod-github-runner-207 kernel: [77388.573713] Aug 23 02:53:34 juju-e4d256-prod-github-runner-207 kernel: [77388.574623] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:53:34 juju-e4d256-prod-github-runner-207 kernel: [77388.575653] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:53:34 juju-e4d256-prod-github-runner-207 kernel: [77388.576682] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:53:34 juju-e4d256-prod-github-runner-207 kernel: [77388.577783] ? show_regs.part.0+0x23/0x29 Aug 23 02:53:34 juju-e4d256-prod-github-runner-207 kernel: [77388.578783] ? show_regs.cold+0x8/0xd Aug 23 02:53:34 juju-e4d256-prod-github-runner-207 kernel: [77388.579753] ? watchdog_timer_fn+0x1be/0x220 Aug 23 02:53:34 juju-e4d256-prod-github-runner-207 kernel: [77388.580763] ? lockup_detector_update_enable+0x60/0x60 Aug 23 02:53:34 juju-e4d256-prod-github-runner-207 kernel: [77388.581826] ? __hrtimer_run_queues+0x107/0x230 Aug 23 02:53:34 juju-e4d256-prod-github-runner-207 kernel: [77388.582861] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 02:53:34 juju-e4d256-prod-github-runner-207 kernel: [77388.583881] ? hrtimer_interrupt+0x101/0x220 Aug 23 02:53:34 juju-e4d256-prod-github-runner-207 kernel: [77388.584895] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 02:53:34 juju-e4d256-prod-github-runner-207 kernel: [77388.585961] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 02:53:34 juju-e4d256-prod-github-runner-207 kernel: [77388.587015] Aug 23 02:53:34 juju-e4d256-prod-github-runner-207 kernel: [77388.587869] Aug 23 02:53:34 juju-e4d256-prod-github-runner-207 kernel: [77388.588702] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 02:53:34 juju-e4d256-prod-github-runner-207 kernel: [77388.589729] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:53:34 juju-e4d256-prod-github-runner-207 kernel: [77388.590768] ? _raw_spin_lock+0x22/0x30 Aug 23 02:53:34 juju-e4d256-prod-github-runner-207 kernel: [77388.591716] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:53:34 juju-e4d256-prod-github-runner-207 kernel: [77388.592733] direct_page_fault+0x206/0x310 [kvm] Aug 23 02:53:34 juju-e4d256-prod-github-runner-207 kernel: [77388.593768] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 02:53:34 juju-e4d256-prod-github-runner-207 kernel: [77388.594783] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 02:53:34 juju-e4d256-prod-github-runner-207 kernel: [77388.595786] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 02:53:34 juju-e4d256-prod-github-runner-207 kernel: [77388.596776] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 02:53:34 juju-e4d256-prod-github-runner-207 kernel: [77388.597718] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 02:53:34 juju-e4d256-prod-github-runner-207 kernel: [77388.598711] handle_exit+0x98/0x230 [kvm_amd] Aug 23 02:53:34 juju-e4d256-prod-github-runner-207 kernel: [77388.599613] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 02:53:34 juju-e4d256-prod-github-runner-207 kernel: [77388.600528] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 02:53:34 juju-e4d256-prod-github-runner-207 kernel: [77388.601489] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 02:53:34 juju-e4d256-prod-github-runner-207 kernel: [77388.602411] vcpu_run+0x62/0x2c0 [kvm] Aug 23 02:53:34 juju-e4d256-prod-github-runner-207 kernel: [77388.603229] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 02:53:34 juju-e4d256-prod-github-runner-207 kernel: [77388.604033] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 02:53:34 juju-e4d256-prod-github-runner-207 kernel: [77388.604883] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 02:53:34 juju-e4d256-prod-github-runner-207 kernel: [77388.605681] ? __seccomp_filter+0x4a/0x4a0 Aug 23 02:53:34 juju-e4d256-prod-github-runner-207 kernel: [77388.606437] ? __fget_files+0x86/0xc0 Aug 23 02:53:34 juju-e4d256-prod-github-runner-207 kernel: [77388.607137] __x64_sys_ioctl+0x95/0xd0 Aug 23 02:53:34 juju-e4d256-prod-github-runner-207 kernel: [77388.607825] do_syscall_64+0x5c/0xc0 Aug 23 02:53:34 juju-e4d256-prod-github-runner-207 kernel: [77388.608484] ? do_futex+0x162/0x1f0 Aug 23 02:53:34 juju-e4d256-prod-github-runner-207 kernel: [77388.609128] ? __x64_sys_futex+0x78/0x1e0 Aug 23 02:53:34 juju-e4d256-prod-github-runner-207 kernel: [77388.609796] ? __secure_computing+0xa9/0x120 Aug 23 02:53:34 juju-e4d256-prod-github-runner-207 kernel: [77388.610489] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 02:53:34 juju-e4d256-prod-github-runner-207 kernel: [77388.611250] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:53:34 juju-e4d256-prod-github-runner-207 kernel: [77388.611967] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:53:34 juju-e4d256-prod-github-runner-207 kernel: [77388.612683] ? do_syscall_64+0x69/0xc0 Aug 23 02:53:34 juju-e4d256-prod-github-runner-207 kernel: [77388.613322] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:53:34 juju-e4d256-prod-github-runner-207 kernel: [77388.614027] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:53:34 juju-e4d256-prod-github-runner-207 kernel: [77388.614722] ? do_syscall_64+0x69/0xc0 Aug 23 02:53:34 juju-e4d256-prod-github-runner-207 kernel: [77388.615347] ? do_syscall_64+0x69/0xc0 Aug 23 02:53:34 juju-e4d256-prod-github-runner-207 kernel: [77388.615964] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 02:53:34 juju-e4d256-prod-github-runner-207 kernel: [77388.616667] RIP: 0033:0x7faa5d0edaff Aug 23 02:53:34 juju-e4d256-prod-github-runner-207 kernel: [77388.617302] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 02:53:34 juju-e4d256-prod-github-runner-207 kernel: [77388.619286] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 02:53:34 juju-e4d256-prod-github-runner-207 kernel: [77388.620236] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 02:53:34 juju-e4d256-prod-github-runner-207 kernel: [77388.621128] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 02:53:34 juju-e4d256-prod-github-runner-207 kernel: [77388.622048] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 02:53:34 juju-e4d256-prod-github-runner-207 kernel: [77388.622946] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 02:53:34 juju-e4d256-prod-github-runner-207 kernel: [77388.623828] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 02:53:34 juju-e4d256-prod-github-runner-207 kernel: [77388.624753] Aug 23 02:53:48 juju-e4d256-prod-github-runner-207 kernel: [77402.348705] rcu: INFO: rcu_sched self-detected stall on CPU Aug 23 02:53:48 juju-e4d256-prod-github-runner-207 kernel: [77402.349697] rcu: 1-....: (19260627 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=9312250 Aug 23 02:53:48 juju-e4d256-prod-github-runner-207 kernel: [77402.350865] (t=19321287 jiffies g=23269 q=65016) Aug 23 02:53:48 juju-e4d256-prod-github-runner-207 kernel: [77402.351665] NMI backtrace for cpu 1 Aug 23 02:53:48 juju-e4d256-prod-github-runner-207 kernel: [77402.352389] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 02:53:48 juju-e4d256-prod-github-runner-207 kernel: [77402.353494] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 02:53:48 juju-e4d256-prod-github-runner-207 kernel: [77402.354574] Call Trace: Aug 23 02:53:48 juju-e4d256-prod-github-runner-207 kernel: [77402.355249] Aug 23 02:53:48 juju-e4d256-prod-github-runner-207 kernel: [77402.355896] show_stack+0x52/0x5c Aug 23 02:53:48 juju-e4d256-prod-github-runner-207 kernel: [77402.356617] dump_stack_lvl+0x4a/0x63 Aug 23 02:53:48 juju-e4d256-prod-github-runner-207 kernel: [77402.357365] dump_stack+0x10/0x16 Aug 23 02:53:48 juju-e4d256-prod-github-runner-207 kernel: [77402.358087] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 23 02:53:48 juju-e4d256-prod-github-runner-207 kernel: [77402.358867] ? lapic_can_unplug_cpu+0x90/0x90 Aug 23 02:53:48 juju-e4d256-prod-github-runner-207 kernel: [77402.359649] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 23 02:53:48 juju-e4d256-prod-github-runner-207 kernel: [77402.360467] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 23 02:53:48 juju-e4d256-prod-github-runner-207 kernel: [77402.361285] trigger_single_cpu_backtrace+0x44/0x4f Aug 23 02:53:48 juju-e4d256-prod-github-runner-207 kernel: [77402.362124] rcu_dump_cpu_stacks+0x102/0x149 Aug 23 02:53:48 juju-e4d256-prod-github-runner-207 kernel: [77402.362896] print_cpu_stall.cold+0x2f/0xe2 Aug 23 02:53:48 juju-e4d256-prod-github-runner-207 kernel: [77402.363661] ? timekeeping_update+0xf7/0x150 Aug 23 02:53:48 juju-e4d256-prod-github-runner-207 kernel: [77402.364434] check_cpu_stall+0x109/0x270 Aug 23 02:53:48 juju-e4d256-prod-github-runner-207 kernel: [77402.365179] rcu_sched_clock_irq+0x9a/0x250 Aug 23 02:53:48 juju-e4d256-prod-github-runner-207 kernel: [77402.365949] update_process_times+0x94/0xd0 Aug 23 02:53:48 juju-e4d256-prod-github-runner-207 kernel: [77402.366709] tick_sched_handle+0x29/0x70 Aug 23 02:53:48 juju-e4d256-prod-github-runner-207 kernel: [77402.367451] tick_sched_timer+0x8c/0xc0 Aug 23 02:53:48 juju-e4d256-prod-github-runner-207 kernel: [77402.368188] ? tick_nohz_handler+0xb0/0xb0 Aug 23 02:53:48 juju-e4d256-prod-github-runner-207 kernel: [77402.368948] __hrtimer_run_queues+0x107/0x230 Aug 23 02:53:48 juju-e4d256-prod-github-runner-207 kernel: [77402.369718] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 02:53:48 juju-e4d256-prod-github-runner-207 kernel: [77402.370498] hrtimer_interrupt+0x101/0x220 Aug 23 02:53:48 juju-e4d256-prod-github-runner-207 kernel: [77402.371254] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 02:53:48 juju-e4d256-prod-github-runner-207 kernel: [77402.372060] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 02:53:48 juju-e4d256-prod-github-runner-207 kernel: [77402.372862] Aug 23 02:53:48 juju-e4d256-prod-github-runner-207 kernel: [77402.373494] Aug 23 02:53:48 juju-e4d256-prod-github-runner-207 kernel: [77402.374129] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 02:53:48 juju-e4d256-prod-github-runner-207 kernel: [77402.375073] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:53:48 juju-e4d256-prod-github-runner-207 kernel: [77402.375954] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 02:53:48 juju-e4d256-prod-github-runner-207 kernel: [77402.378160] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 02:53:48 juju-e4d256-prod-github-runner-207 kernel: [77402.379037] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 02:53:48 juju-e4d256-prod-github-runner-207 kernel: [77402.380038] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 02:53:48 juju-e4d256-prod-github-runner-207 kernel: [77402.381009] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 02:53:48 juju-e4d256-prod-github-runner-207 kernel: [77402.381979] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 02:53:48 juju-e4d256-prod-github-runner-207 kernel: [77402.382932] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 02:53:48 juju-e4d256-prod-github-runner-207 kernel: [77402.383879] ? _raw_spin_lock+0x22/0x30 Aug 23 02:53:48 juju-e4d256-prod-github-runner-207 kernel: [77402.384646] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:53:48 juju-e4d256-prod-github-runner-207 kernel: [77402.385478] direct_page_fault+0x206/0x310 [kvm] Aug 23 02:53:48 juju-e4d256-prod-github-runner-207 kernel: [77402.386321] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 02:53:48 juju-e4d256-prod-github-runner-207 kernel: [77402.387148] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 02:53:48 juju-e4d256-prod-github-runner-207 kernel: [77402.387966] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 02:53:48 juju-e4d256-prod-github-runner-207 kernel: [77402.388936] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 02:53:48 juju-e4d256-prod-github-runner-207 kernel: [77402.389729] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 02:53:48 juju-e4d256-prod-github-runner-207 kernel: [77402.390556] handle_exit+0x98/0x230 [kvm_amd] Aug 23 02:53:48 juju-e4d256-prod-github-runner-207 kernel: [77402.391307] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 02:53:48 juju-e4d256-prod-github-runner-207 kernel: [77402.392087] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 02:53:48 juju-e4d256-prod-github-runner-207 kernel: [77402.392894] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 02:53:48 juju-e4d256-prod-github-runner-207 kernel: [77402.393677] vcpu_run+0x62/0x2c0 [kvm] Aug 23 02:53:48 juju-e4d256-prod-github-runner-207 kernel: [77402.394402] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 02:53:48 juju-e4d256-prod-github-runner-207 kernel: [77402.395131] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 02:53:48 juju-e4d256-prod-github-runner-207 kernel: [77402.395927] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 02:53:48 juju-e4d256-prod-github-runner-207 kernel: [77402.396684] ? __seccomp_filter+0x4a/0x4a0 Aug 23 02:53:48 juju-e4d256-prod-github-runner-207 kernel: [77402.397420] ? __fget_files+0x86/0xc0 Aug 23 02:53:48 juju-e4d256-prod-github-runner-207 kernel: [77402.398136] __x64_sys_ioctl+0x95/0xd0 Aug 23 02:53:48 juju-e4d256-prod-github-runner-207 kernel: [77402.398831] do_syscall_64+0x5c/0xc0 Aug 23 02:53:48 juju-e4d256-prod-github-runner-207 kernel: [77402.399535] ? do_futex+0x162/0x1f0 Aug 23 02:53:48 juju-e4d256-prod-github-runner-207 kernel: [77402.400205] ? __x64_sys_futex+0x78/0x1e0 Aug 23 02:53:48 juju-e4d256-prod-github-runner-207 kernel: [77402.400904] ? __secure_computing+0xa9/0x120 Aug 23 02:53:48 juju-e4d256-prod-github-runner-207 kernel: [77402.401630] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 02:53:48 juju-e4d256-prod-github-runner-207 kernel: [77402.402424] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:53:48 juju-e4d256-prod-github-runner-207 kernel: [77402.403175] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:53:48 juju-e4d256-prod-github-runner-207 kernel: [77402.403924] ? do_syscall_64+0x69/0xc0 Aug 23 02:53:48 juju-e4d256-prod-github-runner-207 kernel: [77402.404612] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:53:48 juju-e4d256-prod-github-runner-207 kernel: [77402.405368] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:53:48 juju-e4d256-prod-github-runner-207 kernel: [77402.406132] ? do_syscall_64+0x69/0xc0 Aug 23 02:53:48 juju-e4d256-prod-github-runner-207 kernel: [77402.406826] ? do_syscall_64+0x69/0xc0 Aug 23 02:53:48 juju-e4d256-prod-github-runner-207 kernel: [77402.407511] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 02:53:48 juju-e4d256-prod-github-runner-207 kernel: [77402.408278] RIP: 0033:0x7faa5d0edaff Aug 23 02:53:48 juju-e4d256-prod-github-runner-207 kernel: [77402.408981] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 02:53:48 juju-e4d256-prod-github-runner-207 kernel: [77402.411093] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 02:53:48 juju-e4d256-prod-github-runner-207 kernel: [77402.412062] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 02:53:48 juju-e4d256-prod-github-runner-207 kernel: [77402.413017] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 02:53:48 juju-e4d256-prod-github-runner-207 kernel: [77402.413974] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 02:53:48 juju-e4d256-prod-github-runner-207 kernel: [77402.414915] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 02:53:48 juju-e4d256-prod-github-runner-207 kernel: [77402.415838] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 02:53:48 juju-e4d256-prod-github-runner-207 kernel: [77402.416764] Aug 23 02:54:14 juju-e4d256-prod-github-runner-207 kernel: [77428.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 72002s! [qemu-system-x86:6715] Aug 23 02:54:14 juju-e4d256-prod-github-runner-207 kernel: [77428.543125] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 02:54:14 juju-e4d256-prod-github-runner-207 kernel: [77428.543201] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 02:54:14 juju-e4d256-prod-github-runner-207 kernel: [77428.555326] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 02:54:14 juju-e4d256-prod-github-runner-207 kernel: [77428.556597] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 02:54:14 juju-e4d256-prod-github-runner-207 kernel: [77428.557830] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:54:14 juju-e4d256-prod-github-runner-207 kernel: [77428.558887] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 02:54:14 juju-e4d256-prod-github-runner-207 kernel: [77428.561432] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 02:54:14 juju-e4d256-prod-github-runner-207 kernel: [77428.562489] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 02:54:14 juju-e4d256-prod-github-runner-207 kernel: [77428.563705] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 02:54:14 juju-e4d256-prod-github-runner-207 kernel: [77428.564941] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 02:54:14 juju-e4d256-prod-github-runner-207 kernel: [77428.566122] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 02:54:14 juju-e4d256-prod-github-runner-207 kernel: [77428.567295] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 02:54:14 juju-e4d256-prod-github-runner-207 kernel: [77428.568469] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 02:54:14 juju-e4d256-prod-github-runner-207 kernel: [77428.569710] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 02:54:14 juju-e4d256-prod-github-runner-207 kernel: [77428.570816] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 02:54:14 juju-e4d256-prod-github-runner-207 kernel: [77428.572024] Call Trace: Aug 23 02:54:14 juju-e4d256-prod-github-runner-207 kernel: [77428.572941] Aug 23 02:54:14 juju-e4d256-prod-github-runner-207 kernel: [77428.573835] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:54:14 juju-e4d256-prod-github-runner-207 kernel: [77428.574872] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:54:14 juju-e4d256-prod-github-runner-207 kernel: [77428.575903] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:54:14 juju-e4d256-prod-github-runner-207 kernel: [77428.576976] ? show_regs.part.0+0x23/0x29 Aug 23 02:54:14 juju-e4d256-prod-github-runner-207 kernel: [77428.578038] ? show_regs.cold+0x8/0xd Aug 23 02:54:14 juju-e4d256-prod-github-runner-207 kernel: [77428.579107] ? watchdog_timer_fn+0x1be/0x220 Aug 23 02:54:14 juju-e4d256-prod-github-runner-207 kernel: [77428.580120] ? lockup_detector_update_enable+0x60/0x60 Aug 23 02:54:14 juju-e4d256-prod-github-runner-207 kernel: [77428.581183] ? __hrtimer_run_queues+0x107/0x230 Aug 23 02:54:14 juju-e4d256-prod-github-runner-207 kernel: [77428.582233] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 02:54:14 juju-e4d256-prod-github-runner-207 kernel: [77428.583262] ? hrtimer_interrupt+0x101/0x220 Aug 23 02:54:14 juju-e4d256-prod-github-runner-207 kernel: [77428.584279] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 02:54:14 juju-e4d256-prod-github-runner-207 kernel: [77428.585351] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 02:54:14 juju-e4d256-prod-github-runner-207 kernel: [77428.586414] Aug 23 02:54:14 juju-e4d256-prod-github-runner-207 kernel: [77428.587271] Aug 23 02:54:14 juju-e4d256-prod-github-runner-207 kernel: [77428.588106] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 02:54:14 juju-e4d256-prod-github-runner-207 kernel: [77428.589143] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:54:14 juju-e4d256-prod-github-runner-207 kernel: [77428.590196] ? _raw_spin_lock+0x22/0x30 Aug 23 02:54:14 juju-e4d256-prod-github-runner-207 kernel: [77428.591154] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:54:14 juju-e4d256-prod-github-runner-207 kernel: [77428.592174] direct_page_fault+0x206/0x310 [kvm] Aug 23 02:54:14 juju-e4d256-prod-github-runner-207 kernel: [77428.593205] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 02:54:14 juju-e4d256-prod-github-runner-207 kernel: [77428.594227] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 02:54:14 juju-e4d256-prod-github-runner-207 kernel: [77428.595227] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 02:54:14 juju-e4d256-prod-github-runner-207 kernel: [77428.596197] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 02:54:14 juju-e4d256-prod-github-runner-207 kernel: [77428.597145] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 02:54:14 juju-e4d256-prod-github-runner-207 kernel: [77428.598146] handle_exit+0x98/0x230 [kvm_amd] Aug 23 02:54:14 juju-e4d256-prod-github-runner-207 kernel: [77428.599060] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 02:54:14 juju-e4d256-prod-github-runner-207 kernel: [77428.599987] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 02:54:14 juju-e4d256-prod-github-runner-207 kernel: [77428.600909] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 02:54:14 juju-e4d256-prod-github-runner-207 kernel: [77428.601828] vcpu_run+0x62/0x2c0 [kvm] Aug 23 02:54:14 juju-e4d256-prod-github-runner-207 kernel: [77428.602645] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 02:54:14 juju-e4d256-prod-github-runner-207 kernel: [77428.603450] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 02:54:14 juju-e4d256-prod-github-runner-207 kernel: [77428.604310] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 02:54:14 juju-e4d256-prod-github-runner-207 kernel: [77428.605325] ? __seccomp_filter+0x4a/0x4a0 Aug 23 02:54:14 juju-e4d256-prod-github-runner-207 kernel: [77428.606102] ? __fget_files+0x86/0xc0 Aug 23 02:54:14 juju-e4d256-prod-github-runner-207 kernel: [77428.606860] __x64_sys_ioctl+0x95/0xd0 Aug 23 02:54:14 juju-e4d256-prod-github-runner-207 kernel: [77428.607553] do_syscall_64+0x5c/0xc0 Aug 23 02:54:14 juju-e4d256-prod-github-runner-207 kernel: [77428.608363] ? do_futex+0x162/0x1f0 Aug 23 02:54:14 juju-e4d256-prod-github-runner-207 kernel: [77428.609016] ? __x64_sys_futex+0x78/0x1e0 Aug 23 02:54:14 juju-e4d256-prod-github-runner-207 kernel: [77428.609706] ? __secure_computing+0xa9/0x120 Aug 23 02:54:14 juju-e4d256-prod-github-runner-207 kernel: [77428.610395] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 02:54:14 juju-e4d256-prod-github-runner-207 kernel: [77428.611155] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:54:14 juju-e4d256-prod-github-runner-207 kernel: [77428.611881] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:54:14 juju-e4d256-prod-github-runner-207 kernel: [77428.612598] ? do_syscall_64+0x69/0xc0 Aug 23 02:54:14 juju-e4d256-prod-github-runner-207 kernel: [77428.613242] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:54:14 juju-e4d256-prod-github-runner-207 kernel: [77428.613957] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:54:14 juju-e4d256-prod-github-runner-207 kernel: [77428.614657] ? do_syscall_64+0x69/0xc0 Aug 23 02:54:14 juju-e4d256-prod-github-runner-207 kernel: [77428.615478] ? do_syscall_64+0x69/0xc0 Aug 23 02:54:14 juju-e4d256-prod-github-runner-207 kernel: [77428.616100] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 02:54:14 juju-e4d256-prod-github-runner-207 kernel: [77428.616803] RIP: 0033:0x7faa5d0edaff Aug 23 02:54:14 juju-e4d256-prod-github-runner-207 kernel: [77428.617427] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 02:54:14 juju-e4d256-prod-github-runner-207 kernel: [77428.619433] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 02:54:14 juju-e4d256-prod-github-runner-207 kernel: [77428.620340] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 02:54:14 juju-e4d256-prod-github-runner-207 kernel: [77428.621230] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 02:54:14 juju-e4d256-prod-github-runner-207 kernel: [77428.622128] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 02:54:14 juju-e4d256-prod-github-runner-207 kernel: [77428.623022] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 02:54:14 juju-e4d256-prod-github-runner-207 kernel: [77428.623912] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 02:54:14 juju-e4d256-prod-github-runner-207 kernel: [77428.624799] Aug 23 02:54:42 juju-e4d256-prod-github-runner-207 kernel: [77456.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 72029s! [qemu-system-x86:6715] Aug 23 02:54:42 juju-e4d256-prod-github-runner-207 kernel: [77456.543151] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 02:54:42 juju-e4d256-prod-github-runner-207 kernel: [77456.543228] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 02:54:42 juju-e4d256-prod-github-runner-207 kernel: [77456.555306] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 02:54:42 juju-e4d256-prod-github-runner-207 kernel: [77456.556570] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 02:54:42 juju-e4d256-prod-github-runner-207 kernel: [77456.557809] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:54:42 juju-e4d256-prod-github-runner-207 kernel: [77456.558868] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 02:54:42 juju-e4d256-prod-github-runner-207 kernel: [77456.561432] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 02:54:42 juju-e4d256-prod-github-runner-207 kernel: [77456.562475] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 02:54:42 juju-e4d256-prod-github-runner-207 kernel: [77456.563640] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 02:54:42 juju-e4d256-prod-github-runner-207 kernel: [77456.564797] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 02:54:42 juju-e4d256-prod-github-runner-207 kernel: [77456.565976] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 02:54:42 juju-e4d256-prod-github-runner-207 kernel: [77456.567142] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 02:54:42 juju-e4d256-prod-github-runner-207 kernel: [77456.568306] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 02:54:42 juju-e4d256-prod-github-runner-207 kernel: [77456.569552] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 02:54:42 juju-e4d256-prod-github-runner-207 kernel: [77456.570649] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 02:54:42 juju-e4d256-prod-github-runner-207 kernel: [77456.571846] Call Trace: Aug 23 02:54:42 juju-e4d256-prod-github-runner-207 kernel: [77456.572756] Aug 23 02:54:42 juju-e4d256-prod-github-runner-207 kernel: [77456.573649] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:54:42 juju-e4d256-prod-github-runner-207 kernel: [77456.574677] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:54:42 juju-e4d256-prod-github-runner-207 kernel: [77456.575695] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:54:42 juju-e4d256-prod-github-runner-207 kernel: [77456.576769] ? show_regs.part.0+0x23/0x29 Aug 23 02:54:42 juju-e4d256-prod-github-runner-207 kernel: [77456.577789] ? show_regs.cold+0x8/0xd Aug 23 02:54:42 juju-e4d256-prod-github-runner-207 kernel: [77456.578762] ? watchdog_timer_fn+0x1be/0x220 Aug 23 02:54:42 juju-e4d256-prod-github-runner-207 kernel: [77456.579767] ? lockup_detector_update_enable+0x60/0x60 Aug 23 02:54:42 juju-e4d256-prod-github-runner-207 kernel: [77456.580856] ? __hrtimer_run_queues+0x107/0x230 Aug 23 02:54:42 juju-e4d256-prod-github-runner-207 kernel: [77456.581895] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 02:54:42 juju-e4d256-prod-github-runner-207 kernel: [77456.582919] ? hrtimer_interrupt+0x101/0x220 Aug 23 02:54:42 juju-e4d256-prod-github-runner-207 kernel: [77456.583939] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 02:54:42 juju-e4d256-prod-github-runner-207 kernel: [77456.585016] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 02:54:42 juju-e4d256-prod-github-runner-207 kernel: [77456.586076] Aug 23 02:54:42 juju-e4d256-prod-github-runner-207 kernel: [77456.586931] Aug 23 02:54:42 juju-e4d256-prod-github-runner-207 kernel: [77456.587782] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 02:54:42 juju-e4d256-prod-github-runner-207 kernel: [77456.588830] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:54:42 juju-e4d256-prod-github-runner-207 kernel: [77456.589878] ? _raw_spin_lock+0x22/0x30 Aug 23 02:54:42 juju-e4d256-prod-github-runner-207 kernel: [77456.590917] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:54:42 juju-e4d256-prod-github-runner-207 kernel: [77456.592027] direct_page_fault+0x206/0x310 [kvm] Aug 23 02:54:42 juju-e4d256-prod-github-runner-207 kernel: [77456.593142] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 02:54:42 juju-e4d256-prod-github-runner-207 kernel: [77456.594259] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 02:54:42 juju-e4d256-prod-github-runner-207 kernel: [77456.595355] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 02:54:42 juju-e4d256-prod-github-runner-207 kernel: [77456.596430] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 02:54:42 juju-e4d256-prod-github-runner-207 kernel: [77456.597485] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 02:54:42 juju-e4d256-prod-github-runner-207 kernel: [77456.598570] handle_exit+0x98/0x230 [kvm_amd] Aug 23 02:54:42 juju-e4d256-prod-github-runner-207 kernel: [77456.599553] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 02:54:42 juju-e4d256-prod-github-runner-207 kernel: [77456.600556] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 02:54:42 juju-e4d256-prod-github-runner-207 kernel: [77456.601594] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 02:54:42 juju-e4d256-prod-github-runner-207 kernel: [77456.602599] vcpu_run+0x62/0x2c0 [kvm] Aug 23 02:54:42 juju-e4d256-prod-github-runner-207 kernel: [77456.603489] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 02:54:42 juju-e4d256-prod-github-runner-207 kernel: [77456.604383] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 02:54:42 juju-e4d256-prod-github-runner-207 kernel: [77456.605375] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 02:54:42 juju-e4d256-prod-github-runner-207 kernel: [77456.606222] ? __seccomp_filter+0x4a/0x4a0 Aug 23 02:54:42 juju-e4d256-prod-github-runner-207 kernel: [77456.606969] ? __fget_files+0x86/0xc0 Aug 23 02:54:42 juju-e4d256-prod-github-runner-207 kernel: [77456.607675] __x64_sys_ioctl+0x95/0xd0 Aug 23 02:54:42 juju-e4d256-prod-github-runner-207 kernel: [77456.608368] do_syscall_64+0x5c/0xc0 Aug 23 02:54:42 juju-e4d256-prod-github-runner-207 kernel: [77456.609036] ? do_futex+0x162/0x1f0 Aug 23 02:54:42 juju-e4d256-prod-github-runner-207 kernel: [77456.609705] ? __x64_sys_futex+0x78/0x1e0 Aug 23 02:54:42 juju-e4d256-prod-github-runner-207 kernel: [77456.610389] ? __secure_computing+0xa9/0x120 Aug 23 02:54:42 juju-e4d256-prod-github-runner-207 kernel: [77456.611080] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 02:54:42 juju-e4d256-prod-github-runner-207 kernel: [77456.611843] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:54:42 juju-e4d256-prod-github-runner-207 kernel: [77456.612566] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:54:42 juju-e4d256-prod-github-runner-207 kernel: [77456.613302] ? do_syscall_64+0x69/0xc0 Aug 23 02:54:42 juju-e4d256-prod-github-runner-207 kernel: [77456.613947] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:54:42 juju-e4d256-prod-github-runner-207 kernel: [77456.614651] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:54:42 juju-e4d256-prod-github-runner-207 kernel: [77456.615345] ? do_syscall_64+0x69/0xc0 Aug 23 02:54:42 juju-e4d256-prod-github-runner-207 kernel: [77456.615968] ? do_syscall_64+0x69/0xc0 Aug 23 02:54:42 juju-e4d256-prod-github-runner-207 kernel: [77456.616588] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 02:54:42 juju-e4d256-prod-github-runner-207 kernel: [77456.617301] RIP: 0033:0x7faa5d0edaff Aug 23 02:54:42 juju-e4d256-prod-github-runner-207 kernel: [77456.617945] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 02:54:42 juju-e4d256-prod-github-runner-207 kernel: [77456.619947] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 02:54:42 juju-e4d256-prod-github-runner-207 kernel: [77456.620858] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 02:54:42 juju-e4d256-prod-github-runner-207 kernel: [77456.621766] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 02:54:42 juju-e4d256-prod-github-runner-207 kernel: [77456.622663] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 02:54:42 juju-e4d256-prod-github-runner-207 kernel: [77456.623552] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 02:54:42 juju-e4d256-prod-github-runner-207 kernel: [77456.624443] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 02:54:42 juju-e4d256-prod-github-runner-207 kernel: [77456.625349] Aug 23 02:55:10 juju-e4d256-prod-github-runner-207 kernel: [77484.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 72055s! [qemu-system-x86:6715] Aug 23 02:55:10 juju-e4d256-prod-github-runner-207 kernel: [77484.543825] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 02:55:10 juju-e4d256-prod-github-runner-207 kernel: [77484.544107] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 02:55:10 juju-e4d256-prod-github-runner-207 kernel: [77484.556316] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 02:55:10 juju-e4d256-prod-github-runner-207 kernel: [77484.557599] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 02:55:10 juju-e4d256-prod-github-runner-207 kernel: [77484.558818] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:55:10 juju-e4d256-prod-github-runner-207 kernel: [77484.559876] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 02:55:10 juju-e4d256-prod-github-runner-207 kernel: [77484.562443] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 02:55:10 juju-e4d256-prod-github-runner-207 kernel: [77484.563561] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 02:55:10 juju-e4d256-prod-github-runner-207 kernel: [77484.564826] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 02:55:10 juju-e4d256-prod-github-runner-207 kernel: [77484.566056] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 02:55:10 juju-e4d256-prod-github-runner-207 kernel: [77484.567580] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 02:55:10 juju-e4d256-prod-github-runner-207 kernel: [77484.568742] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 02:55:10 juju-e4d256-prod-github-runner-207 kernel: [77484.569929] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 02:55:10 juju-e4d256-prod-github-runner-207 kernel: [77484.571171] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 02:55:10 juju-e4d256-prod-github-runner-207 kernel: [77484.572277] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 02:55:10 juju-e4d256-prod-github-runner-207 kernel: [77484.573493] Call Trace: Aug 23 02:55:10 juju-e4d256-prod-github-runner-207 kernel: [77484.574405] Aug 23 02:55:10 juju-e4d256-prod-github-runner-207 kernel: [77484.575301] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:55:10 juju-e4d256-prod-github-runner-207 kernel: [77484.576335] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:55:10 juju-e4d256-prod-github-runner-207 kernel: [77484.577372] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:55:10 juju-e4d256-prod-github-runner-207 kernel: [77484.578470] ? show_regs.part.0+0x23/0x29 Aug 23 02:55:10 juju-e4d256-prod-github-runner-207 kernel: [77484.579473] ? show_regs.cold+0x8/0xd Aug 23 02:55:10 juju-e4d256-prod-github-runner-207 kernel: [77484.580447] ? watchdog_timer_fn+0x1be/0x220 Aug 23 02:55:10 juju-e4d256-prod-github-runner-207 kernel: [77484.581467] ? lockup_detector_update_enable+0x60/0x60 Aug 23 02:55:10 juju-e4d256-prod-github-runner-207 kernel: [77484.582534] ? __hrtimer_run_queues+0x107/0x230 Aug 23 02:55:10 juju-e4d256-prod-github-runner-207 kernel: [77484.583588] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 02:55:10 juju-e4d256-prod-github-runner-207 kernel: [77484.584622] ? hrtimer_interrupt+0x101/0x220 Aug 23 02:55:10 juju-e4d256-prod-github-runner-207 kernel: [77484.585663] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 02:55:10 juju-e4d256-prod-github-runner-207 kernel: [77484.586799] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 02:55:10 juju-e4d256-prod-github-runner-207 kernel: [77484.587887] Aug 23 02:55:10 juju-e4d256-prod-github-runner-207 kernel: [77484.588770] Aug 23 02:55:10 juju-e4d256-prod-github-runner-207 kernel: [77484.589651] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 02:55:10 juju-e4d256-prod-github-runner-207 kernel: [77484.590702] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:55:10 juju-e4d256-prod-github-runner-207 kernel: [77484.591833] ? _raw_spin_lock+0x22/0x30 Aug 23 02:55:10 juju-e4d256-prod-github-runner-207 kernel: [77484.592869] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:55:10 juju-e4d256-prod-github-runner-207 kernel: [77484.593904] direct_page_fault+0x206/0x310 [kvm] Aug 23 02:55:10 juju-e4d256-prod-github-runner-207 kernel: [77484.595031] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 02:55:10 juju-e4d256-prod-github-runner-207 kernel: [77484.596048] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 02:55:10 juju-e4d256-prod-github-runner-207 kernel: [77484.597098] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 02:55:10 juju-e4d256-prod-github-runner-207 kernel: [77484.598113] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 02:55:10 juju-e4d256-prod-github-runner-207 kernel: [77484.599058] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 02:55:10 juju-e4d256-prod-github-runner-207 kernel: [77484.600034] handle_exit+0x98/0x230 [kvm_amd] Aug 23 02:55:10 juju-e4d256-prod-github-runner-207 kernel: [77484.600938] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 02:55:10 juju-e4d256-prod-github-runner-207 kernel: [77484.601860] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 02:55:10 juju-e4d256-prod-github-runner-207 kernel: [77484.602961] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 02:55:10 juju-e4d256-prod-github-runner-207 kernel: [77484.603951] vcpu_run+0x62/0x2c0 [kvm] Aug 23 02:55:10 juju-e4d256-prod-github-runner-207 kernel: [77484.604945] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 02:55:10 juju-e4d256-prod-github-runner-207 kernel: [77484.605751] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 02:55:10 juju-e4d256-prod-github-runner-207 kernel: [77484.606633] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 02:55:10 juju-e4d256-prod-github-runner-207 kernel: [77484.607442] ? __seccomp_filter+0x4a/0x4a0 Aug 23 02:55:10 juju-e4d256-prod-github-runner-207 kernel: [77484.608191] ? __fget_files+0x86/0xc0 Aug 23 02:55:10 juju-e4d256-prod-github-runner-207 kernel: [77484.608902] __x64_sys_ioctl+0x95/0xd0 Aug 23 02:55:10 juju-e4d256-prod-github-runner-207 kernel: [77484.609593] do_syscall_64+0x5c/0xc0 Aug 23 02:55:10 juju-e4d256-prod-github-runner-207 kernel: [77484.610265] ? do_futex+0x162/0x1f0 Aug 23 02:55:10 juju-e4d256-prod-github-runner-207 kernel: [77484.610921] ? __x64_sys_futex+0x78/0x1e0 Aug 23 02:55:10 juju-e4d256-prod-github-runner-207 kernel: [77484.611622] ? __secure_computing+0xa9/0x120 Aug 23 02:55:10 juju-e4d256-prod-github-runner-207 kernel: [77484.612337] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 02:55:10 juju-e4d256-prod-github-runner-207 kernel: [77484.613121] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:55:10 juju-e4d256-prod-github-runner-207 kernel: [77484.613910] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:55:10 juju-e4d256-prod-github-runner-207 kernel: [77484.614641] ? do_syscall_64+0x69/0xc0 Aug 23 02:55:10 juju-e4d256-prod-github-runner-207 kernel: [77484.615321] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:55:10 juju-e4d256-prod-github-runner-207 kernel: [77484.616086] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:55:10 juju-e4d256-prod-github-runner-207 kernel: [77484.616824] ? do_syscall_64+0x69/0xc0 Aug 23 02:55:10 juju-e4d256-prod-github-runner-207 kernel: [77484.617501] ? do_syscall_64+0x69/0xc0 Aug 23 02:55:10 juju-e4d256-prod-github-runner-207 kernel: [77484.618194] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 02:55:10 juju-e4d256-prod-github-runner-207 kernel: [77484.618939] RIP: 0033:0x7faa5d0edaff Aug 23 02:55:10 juju-e4d256-prod-github-runner-207 kernel: [77484.619606] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 02:55:10 juju-e4d256-prod-github-runner-207 kernel: [77484.621615] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 02:55:10 juju-e4d256-prod-github-runner-207 kernel: [77484.622555] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 02:55:10 juju-e4d256-prod-github-runner-207 kernel: [77484.623444] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 02:55:10 juju-e4d256-prod-github-runner-207 kernel: [77484.624335] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 02:55:10 juju-e4d256-prod-github-runner-207 kernel: [77484.625233] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 02:55:10 juju-e4d256-prod-github-runner-207 kernel: [77484.626120] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 02:55:10 juju-e4d256-prod-github-runner-207 kernel: [77484.627010] Aug 23 02:55:38 juju-e4d256-prod-github-runner-207 kernel: [77512.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 72081s! [qemu-system-x86:6715] Aug 23 02:55:38 juju-e4d256-prod-github-runner-207 kernel: [77512.543103] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 02:55:38 juju-e4d256-prod-github-runner-207 kernel: [77512.543178] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 02:55:38 juju-e4d256-prod-github-runner-207 kernel: [77512.555243] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 02:55:38 juju-e4d256-prod-github-runner-207 kernel: [77512.556510] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 02:55:38 juju-e4d256-prod-github-runner-207 kernel: [77512.557752] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:55:38 juju-e4d256-prod-github-runner-207 kernel: [77512.558812] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 02:55:38 juju-e4d256-prod-github-runner-207 kernel: [77512.561364] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 02:55:38 juju-e4d256-prod-github-runner-207 kernel: [77512.562410] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 02:55:38 juju-e4d256-prod-github-runner-207 kernel: [77512.563578] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 02:55:38 juju-e4d256-prod-github-runner-207 kernel: [77512.564755] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 02:55:38 juju-e4d256-prod-github-runner-207 kernel: [77512.565916] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 02:55:38 juju-e4d256-prod-github-runner-207 kernel: [77512.567085] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 02:55:38 juju-e4d256-prod-github-runner-207 kernel: [77512.568260] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 02:55:38 juju-e4d256-prod-github-runner-207 kernel: [77512.569704] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 02:55:38 juju-e4d256-prod-github-runner-207 kernel: [77512.570826] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 02:55:38 juju-e4d256-prod-github-runner-207 kernel: [77512.572022] Call Trace: Aug 23 02:55:38 juju-e4d256-prod-github-runner-207 kernel: [77512.572950] Aug 23 02:55:38 juju-e4d256-prod-github-runner-207 kernel: [77512.573833] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:55:38 juju-e4d256-prod-github-runner-207 kernel: [77512.574864] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:55:38 juju-e4d256-prod-github-runner-207 kernel: [77512.575888] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:55:38 juju-e4d256-prod-github-runner-207 kernel: [77512.576975] ? show_regs.part.0+0x23/0x29 Aug 23 02:55:38 juju-e4d256-prod-github-runner-207 kernel: [77512.577977] ? show_regs.cold+0x8/0xd Aug 23 02:55:38 juju-e4d256-prod-github-runner-207 kernel: [77512.578949] ? watchdog_timer_fn+0x1be/0x220 Aug 23 02:55:38 juju-e4d256-prod-github-runner-207 kernel: [77512.579956] ? lockup_detector_update_enable+0x60/0x60 Aug 23 02:55:38 juju-e4d256-prod-github-runner-207 kernel: [77512.581050] ? __hrtimer_run_queues+0x107/0x230 Aug 23 02:55:38 juju-e4d256-prod-github-runner-207 kernel: [77512.582078] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 02:55:38 juju-e4d256-prod-github-runner-207 kernel: [77512.583104] ? hrtimer_interrupt+0x101/0x220 Aug 23 02:55:38 juju-e4d256-prod-github-runner-207 kernel: [77512.584121] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 02:55:38 juju-e4d256-prod-github-runner-207 kernel: [77512.585200] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 02:55:38 juju-e4d256-prod-github-runner-207 kernel: [77512.586251] Aug 23 02:55:38 juju-e4d256-prod-github-runner-207 kernel: [77512.587107] Aug 23 02:55:38 juju-e4d256-prod-github-runner-207 kernel: [77512.587943] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 02:55:38 juju-e4d256-prod-github-runner-207 kernel: [77512.588986] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:55:38 juju-e4d256-prod-github-runner-207 kernel: [77512.590025] ? _raw_spin_lock+0x22/0x30 Aug 23 02:55:38 juju-e4d256-prod-github-runner-207 kernel: [77512.590967] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:55:38 juju-e4d256-prod-github-runner-207 kernel: [77512.591985] direct_page_fault+0x206/0x310 [kvm] Aug 23 02:55:38 juju-e4d256-prod-github-runner-207 kernel: [77512.593015] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 02:55:38 juju-e4d256-prod-github-runner-207 kernel: [77512.594024] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 02:55:38 juju-e4d256-prod-github-runner-207 kernel: [77512.595032] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 02:55:38 juju-e4d256-prod-github-runner-207 kernel: [77512.596005] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 02:55:38 juju-e4d256-prod-github-runner-207 kernel: [77512.596964] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 02:55:38 juju-e4d256-prod-github-runner-207 kernel: [77512.597941] handle_exit+0x98/0x230 [kvm_amd] Aug 23 02:55:38 juju-e4d256-prod-github-runner-207 kernel: [77512.598908] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 02:55:38 juju-e4d256-prod-github-runner-207 kernel: [77512.599889] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 02:55:38 juju-e4d256-prod-github-runner-207 kernel: [77512.600828] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 02:55:38 juju-e4d256-prod-github-runner-207 kernel: [77512.601737] vcpu_run+0x62/0x2c0 [kvm] Aug 23 02:55:38 juju-e4d256-prod-github-runner-207 kernel: [77512.602550] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 02:55:38 juju-e4d256-prod-github-runner-207 kernel: [77512.603357] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 02:55:38 juju-e4d256-prod-github-runner-207 kernel: [77512.604212] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 02:55:38 juju-e4d256-prod-github-runner-207 kernel: [77512.605025] ? __seccomp_filter+0x4a/0x4a0 Aug 23 02:55:38 juju-e4d256-prod-github-runner-207 kernel: [77512.605769] ? __fget_files+0x86/0xc0 Aug 23 02:55:38 juju-e4d256-prod-github-runner-207 kernel: [77512.606474] __x64_sys_ioctl+0x95/0xd0 Aug 23 02:55:38 juju-e4d256-prod-github-runner-207 kernel: [77512.607166] do_syscall_64+0x5c/0xc0 Aug 23 02:55:38 juju-e4d256-prod-github-runner-207 kernel: [77512.607831] ? do_futex+0x162/0x1f0 Aug 23 02:55:38 juju-e4d256-prod-github-runner-207 kernel: [77512.608479] ? __x64_sys_futex+0x78/0x1e0 Aug 23 02:55:38 juju-e4d256-prod-github-runner-207 kernel: [77512.609163] ? __secure_computing+0xa9/0x120 Aug 23 02:55:38 juju-e4d256-prod-github-runner-207 kernel: [77512.609853] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 02:55:38 juju-e4d256-prod-github-runner-207 kernel: [77512.610616] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:55:38 juju-e4d256-prod-github-runner-207 kernel: [77512.611339] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:55:38 juju-e4d256-prod-github-runner-207 kernel: [77512.612056] ? do_syscall_64+0x69/0xc0 Aug 23 02:55:38 juju-e4d256-prod-github-runner-207 kernel: [77512.612707] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:55:38 juju-e4d256-prod-github-runner-207 kernel: [77512.613412] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:55:38 juju-e4d256-prod-github-runner-207 kernel: [77512.614122] ? do_syscall_64+0x69/0xc0 Aug 23 02:55:38 juju-e4d256-prod-github-runner-207 kernel: [77512.614751] ? do_syscall_64+0x69/0xc0 Aug 23 02:55:38 juju-e4d256-prod-github-runner-207 kernel: [77512.615370] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 02:55:38 juju-e4d256-prod-github-runner-207 kernel: [77512.616076] RIP: 0033:0x7faa5d0edaff Aug 23 02:55:38 juju-e4d256-prod-github-runner-207 kernel: [77512.616711] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 02:55:38 juju-e4d256-prod-github-runner-207 kernel: [77512.618693] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 02:55:38 juju-e4d256-prod-github-runner-207 kernel: [77512.619603] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 02:55:38 juju-e4d256-prod-github-runner-207 kernel: [77512.620497] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 02:55:38 juju-e4d256-prod-github-runner-207 kernel: [77512.621391] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 02:55:38 juju-e4d256-prod-github-runner-207 kernel: [77512.622274] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 02:55:38 juju-e4d256-prod-github-runner-207 kernel: [77512.623161] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 02:55:38 juju-e4d256-prod-github-runner-207 kernel: [77512.624053] Aug 23 02:56:06 juju-e4d256-prod-github-runner-207 kernel: [77540.542217] watchdog: BUG: soft lockup - CPU#1 stuck for 72107s! [qemu-system-x86:6715] Aug 23 02:56:06 juju-e4d256-prod-github-runner-207 kernel: [77540.544501] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 02:56:06 juju-e4d256-prod-github-runner-207 kernel: [77540.544575] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 02:56:06 juju-e4d256-prod-github-runner-207 kernel: [77540.563740] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 02:56:06 juju-e4d256-prod-github-runner-207 kernel: [77540.565040] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 02:56:06 juju-e4d256-prod-github-runner-207 kernel: [77540.566259] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:56:06 juju-e4d256-prod-github-runner-207 kernel: [77540.567322] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 02:56:06 juju-e4d256-prod-github-runner-207 kernel: [77540.569882] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 02:56:06 juju-e4d256-prod-github-runner-207 kernel: [77540.570926] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 02:56:06 juju-e4d256-prod-github-runner-207 kernel: [77540.572084] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 02:56:06 juju-e4d256-prod-github-runner-207 kernel: [77540.573259] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 02:56:06 juju-e4d256-prod-github-runner-207 kernel: [77540.574417] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 02:56:06 juju-e4d256-prod-github-runner-207 kernel: [77540.575577] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 02:56:06 juju-e4d256-prod-github-runner-207 kernel: [77540.576764] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 02:56:06 juju-e4d256-prod-github-runner-207 kernel: [77540.578000] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 02:56:06 juju-e4d256-prod-github-runner-207 kernel: [77540.579099] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 02:56:06 juju-e4d256-prod-github-runner-207 kernel: [77540.580301] Call Trace: Aug 23 02:56:06 juju-e4d256-prod-github-runner-207 kernel: [77540.581218] Aug 23 02:56:06 juju-e4d256-prod-github-runner-207 kernel: [77540.582099] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:56:06 juju-e4d256-prod-github-runner-207 kernel: [77540.583130] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:56:06 juju-e4d256-prod-github-runner-207 kernel: [77540.584150] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:56:06 juju-e4d256-prod-github-runner-207 kernel: [77540.585312] ? show_regs.part.0+0x23/0x29 Aug 23 02:56:06 juju-e4d256-prod-github-runner-207 kernel: [77540.586309] ? show_regs.cold+0x8/0xd Aug 23 02:56:06 juju-e4d256-prod-github-runner-207 kernel: [77540.587280] ? watchdog_timer_fn+0x1be/0x220 Aug 23 02:56:06 juju-e4d256-prod-github-runner-207 kernel: [77540.588309] ? lockup_detector_update_enable+0x60/0x60 Aug 23 02:56:06 juju-e4d256-prod-github-runner-207 kernel: [77540.589379] ? __hrtimer_run_queues+0x107/0x230 Aug 23 02:56:06 juju-e4d256-prod-github-runner-207 kernel: [77540.590424] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 02:56:06 juju-e4d256-prod-github-runner-207 kernel: [77540.591450] ? hrtimer_interrupt+0x101/0x220 Aug 23 02:56:06 juju-e4d256-prod-github-runner-207 kernel: [77540.592499] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 02:56:06 juju-e4d256-prod-github-runner-207 kernel: [77540.593591] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 02:56:06 juju-e4d256-prod-github-runner-207 kernel: [77540.594643] Aug 23 02:56:06 juju-e4d256-prod-github-runner-207 kernel: [77540.595495] Aug 23 02:56:06 juju-e4d256-prod-github-runner-207 kernel: [77540.596349] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 02:56:06 juju-e4d256-prod-github-runner-207 kernel: [77540.597385] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:56:06 juju-e4d256-prod-github-runner-207 kernel: [77540.598424] ? _raw_spin_lock+0x22/0x30 Aug 23 02:56:06 juju-e4d256-prod-github-runner-207 kernel: [77540.599381] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:56:06 juju-e4d256-prod-github-runner-207 kernel: [77540.600427] direct_page_fault+0x206/0x310 [kvm] Aug 23 02:56:06 juju-e4d256-prod-github-runner-207 kernel: [77540.601452] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 02:56:06 juju-e4d256-prod-github-runner-207 kernel: [77540.602475] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 02:56:06 juju-e4d256-prod-github-runner-207 kernel: [77540.603502] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 02:56:06 juju-e4d256-prod-github-runner-207 kernel: [77540.604526] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 02:56:06 juju-e4d256-prod-github-runner-207 kernel: [77540.605481] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 02:56:06 juju-e4d256-prod-github-runner-207 kernel: [77540.606460] handle_exit+0x98/0x230 [kvm_amd] Aug 23 02:56:06 juju-e4d256-prod-github-runner-207 kernel: [77540.607353] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 02:56:06 juju-e4d256-prod-github-runner-207 kernel: [77540.608292] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 02:56:06 juju-e4d256-prod-github-runner-207 kernel: [77540.609218] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 02:56:06 juju-e4d256-prod-github-runner-207 kernel: [77540.610122] vcpu_run+0x62/0x2c0 [kvm] Aug 23 02:56:06 juju-e4d256-prod-github-runner-207 kernel: [77540.610944] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 02:56:06 juju-e4d256-prod-github-runner-207 kernel: [77540.611750] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 02:56:06 juju-e4d256-prod-github-runner-207 kernel: [77540.612618] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 02:56:06 juju-e4d256-prod-github-runner-207 kernel: [77540.613421] ? __seccomp_filter+0x4a/0x4a0 Aug 23 02:56:06 juju-e4d256-prod-github-runner-207 kernel: [77540.614162] ? __fget_files+0x86/0xc0 Aug 23 02:56:06 juju-e4d256-prod-github-runner-207 kernel: [77540.614875] __x64_sys_ioctl+0x95/0xd0 Aug 23 02:56:06 juju-e4d256-prod-github-runner-207 kernel: [77540.615566] do_syscall_64+0x5c/0xc0 Aug 23 02:56:06 juju-e4d256-prod-github-runner-207 kernel: [77540.616240] ? do_futex+0x162/0x1f0 Aug 23 02:56:06 juju-e4d256-prod-github-runner-207 kernel: [77540.616889] ? __x64_sys_futex+0x78/0x1e0 Aug 23 02:56:06 juju-e4d256-prod-github-runner-207 kernel: [77540.617561] ? __secure_computing+0xa9/0x120 Aug 23 02:56:06 juju-e4d256-prod-github-runner-207 kernel: [77540.618257] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 02:56:06 juju-e4d256-prod-github-runner-207 kernel: [77540.619016] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:56:06 juju-e4d256-prod-github-runner-207 kernel: [77540.619754] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:56:06 juju-e4d256-prod-github-runner-207 kernel: [77540.620484] ? do_syscall_64+0x69/0xc0 Aug 23 02:56:06 juju-e4d256-prod-github-runner-207 kernel: [77540.621134] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:56:06 juju-e4d256-prod-github-runner-207 kernel: [77540.621836] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:56:06 juju-e4d256-prod-github-runner-207 kernel: [77540.622528] ? do_syscall_64+0x69/0xc0 Aug 23 02:56:06 juju-e4d256-prod-github-runner-207 kernel: [77540.623151] ? do_syscall_64+0x69/0xc0 Aug 23 02:56:06 juju-e4d256-prod-github-runner-207 kernel: [77540.623778] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 02:56:06 juju-e4d256-prod-github-runner-207 kernel: [77540.624490] RIP: 0033:0x7faa5d0edaff Aug 23 02:56:06 juju-e4d256-prod-github-runner-207 kernel: [77540.625115] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 02:56:06 juju-e4d256-prod-github-runner-207 kernel: [77540.627095] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 02:56:06 juju-e4d256-prod-github-runner-207 kernel: [77540.628138] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 02:56:06 juju-e4d256-prod-github-runner-207 kernel: [77540.629072] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 02:56:06 juju-e4d256-prod-github-runner-207 kernel: [77540.629962] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 02:56:06 juju-e4d256-prod-github-runner-207 kernel: [77540.630849] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 02:56:06 juju-e4d256-prod-github-runner-207 kernel: [77540.631737] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 02:56:06 juju-e4d256-prod-github-runner-207 kernel: [77540.632655] Aug 23 02:56:34 juju-e4d256-prod-github-runner-207 kernel: [77568.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 72133s! [qemu-system-x86:6715] Aug 23 02:56:34 juju-e4d256-prod-github-runner-207 kernel: [77568.544063] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 02:56:34 juju-e4d256-prod-github-runner-207 kernel: [77568.544342] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 02:56:34 juju-e4d256-prod-github-runner-207 kernel: [77568.556442] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 02:56:34 juju-e4d256-prod-github-runner-207 kernel: [77568.557713] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 02:56:34 juju-e4d256-prod-github-runner-207 kernel: [77568.558934] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:56:34 juju-e4d256-prod-github-runner-207 kernel: [77568.559994] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 02:56:34 juju-e4d256-prod-github-runner-207 kernel: [77568.562539] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 02:56:34 juju-e4d256-prod-github-runner-207 kernel: [77568.563579] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 02:56:34 juju-e4d256-prod-github-runner-207 kernel: [77568.564764] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 02:56:34 juju-e4d256-prod-github-runner-207 kernel: [77568.565925] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 02:56:34 juju-e4d256-prod-github-runner-207 kernel: [77568.567088] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 02:56:34 juju-e4d256-prod-github-runner-207 kernel: [77568.568252] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 02:56:34 juju-e4d256-prod-github-runner-207 kernel: [77568.569422] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 02:56:34 juju-e4d256-prod-github-runner-207 kernel: [77568.570655] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 02:56:34 juju-e4d256-prod-github-runner-207 kernel: [77568.571751] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 02:56:34 juju-e4d256-prod-github-runner-207 kernel: [77568.572952] Call Trace: Aug 23 02:56:34 juju-e4d256-prod-github-runner-207 kernel: [77568.573861] Aug 23 02:56:34 juju-e4d256-prod-github-runner-207 kernel: [77568.574753] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:56:34 juju-e4d256-prod-github-runner-207 kernel: [77568.575780] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:56:34 juju-e4d256-prod-github-runner-207 kernel: [77568.576810] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:56:34 juju-e4d256-prod-github-runner-207 kernel: [77568.577900] ? show_regs.part.0+0x23/0x29 Aug 23 02:56:34 juju-e4d256-prod-github-runner-207 kernel: [77568.578899] ? show_regs.cold+0x8/0xd Aug 23 02:56:34 juju-e4d256-prod-github-runner-207 kernel: [77568.579896] ? watchdog_timer_fn+0x1be/0x220 Aug 23 02:56:34 juju-e4d256-prod-github-runner-207 kernel: [77568.580915] ? lockup_detector_update_enable+0x60/0x60 Aug 23 02:56:34 juju-e4d256-prod-github-runner-207 kernel: [77568.581981] ? __hrtimer_run_queues+0x107/0x230 Aug 23 02:56:34 juju-e4d256-prod-github-runner-207 kernel: [77568.583005] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 02:56:34 juju-e4d256-prod-github-runner-207 kernel: [77568.584032] ? hrtimer_interrupt+0x101/0x220 Aug 23 02:56:34 juju-e4d256-prod-github-runner-207 kernel: [77568.585051] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 02:56:34 juju-e4d256-prod-github-runner-207 kernel: [77568.586117] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 02:56:34 juju-e4d256-prod-github-runner-207 kernel: [77568.587164] Aug 23 02:56:34 juju-e4d256-prod-github-runner-207 kernel: [77568.588025] Aug 23 02:56:34 juju-e4d256-prod-github-runner-207 kernel: [77568.588862] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 02:56:34 juju-e4d256-prod-github-runner-207 kernel: [77568.589906] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:56:34 juju-e4d256-prod-github-runner-207 kernel: [77568.590968] ? _raw_spin_lock+0x22/0x30 Aug 23 02:56:34 juju-e4d256-prod-github-runner-207 kernel: [77568.591937] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:56:34 juju-e4d256-prod-github-runner-207 kernel: [77568.592961] direct_page_fault+0x206/0x310 [kvm] Aug 23 02:56:34 juju-e4d256-prod-github-runner-207 kernel: [77568.593996] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 02:56:34 juju-e4d256-prod-github-runner-207 kernel: [77568.595006] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 02:56:34 juju-e4d256-prod-github-runner-207 kernel: [77568.596015] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 02:56:34 juju-e4d256-prod-github-runner-207 kernel: [77568.597025] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 02:56:34 juju-e4d256-prod-github-runner-207 kernel: [77568.597975] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 02:56:34 juju-e4d256-prod-github-runner-207 kernel: [77568.598952] handle_exit+0x98/0x230 [kvm_amd] Aug 23 02:56:34 juju-e4d256-prod-github-runner-207 kernel: [77568.599844] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 02:56:34 juju-e4d256-prod-github-runner-207 kernel: [77568.600769] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 02:56:34 juju-e4d256-prod-github-runner-207 kernel: [77568.601697] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 02:56:34 juju-e4d256-prod-github-runner-207 kernel: [77568.602605] vcpu_run+0x62/0x2c0 [kvm] Aug 23 02:56:34 juju-e4d256-prod-github-runner-207 kernel: [77568.603414] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 02:56:34 juju-e4d256-prod-github-runner-207 kernel: [77568.604234] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 02:56:34 juju-e4d256-prod-github-runner-207 kernel: [77568.605087] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 02:56:34 juju-e4d256-prod-github-runner-207 kernel: [77568.605883] ? __seccomp_filter+0x4a/0x4a0 Aug 23 02:56:34 juju-e4d256-prod-github-runner-207 kernel: [77568.606624] ? __fget_files+0x86/0xc0 Aug 23 02:56:34 juju-e4d256-prod-github-runner-207 kernel: [77568.607330] __x64_sys_ioctl+0x95/0xd0 Aug 23 02:56:34 juju-e4d256-prod-github-runner-207 kernel: [77568.608031] do_syscall_64+0x5c/0xc0 Aug 23 02:56:34 juju-e4d256-prod-github-runner-207 kernel: [77568.608694] ? do_futex+0x162/0x1f0 Aug 23 02:56:34 juju-e4d256-prod-github-runner-207 kernel: [77568.609344] ? __x64_sys_futex+0x78/0x1e0 Aug 23 02:56:34 juju-e4d256-prod-github-runner-207 kernel: [77568.610043] ? __secure_computing+0xa9/0x120 Aug 23 02:56:34 juju-e4d256-prod-github-runner-207 kernel: [77568.610736] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 02:56:34 juju-e4d256-prod-github-runner-207 kernel: [77568.611492] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:56:34 juju-e4d256-prod-github-runner-207 kernel: [77568.612222] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:56:34 juju-e4d256-prod-github-runner-207 kernel: [77568.612946] ? do_syscall_64+0x69/0xc0 Aug 23 02:56:34 juju-e4d256-prod-github-runner-207 kernel: [77568.613604] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:56:34 juju-e4d256-prod-github-runner-207 kernel: [77568.614309] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:56:34 juju-e4d256-prod-github-runner-207 kernel: [77568.615011] ? do_syscall_64+0x69/0xc0 Aug 23 02:56:34 juju-e4d256-prod-github-runner-207 kernel: [77568.615637] ? do_syscall_64+0x69/0xc0 Aug 23 02:56:34 juju-e4d256-prod-github-runner-207 kernel: [77568.616274] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 02:56:34 juju-e4d256-prod-github-runner-207 kernel: [77568.616977] RIP: 0033:0x7faa5d0edaff Aug 23 02:56:34 juju-e4d256-prod-github-runner-207 kernel: [77568.617628] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 02:56:34 juju-e4d256-prod-github-runner-207 kernel: [77568.619618] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 02:56:34 juju-e4d256-prod-github-runner-207 kernel: [77568.620537] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 02:56:34 juju-e4d256-prod-github-runner-207 kernel: [77568.621694] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 02:56:34 juju-e4d256-prod-github-runner-207 kernel: [77568.622622] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 02:56:34 juju-e4d256-prod-github-runner-207 kernel: [77568.623519] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 02:56:34 juju-e4d256-prod-github-runner-207 kernel: [77568.624461] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 02:56:34 juju-e4d256-prod-github-runner-207 kernel: [77568.625356] Aug 23 02:56:48 juju-e4d256-prod-github-runner-207 kernel: [77582.360704] rcu: INFO: rcu_sched self-detected stall on CPU Aug 23 02:56:48 juju-e4d256-prod-github-runner-207 kernel: [77582.361675] rcu: 1-....: (19305493 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=9334109 Aug 23 02:56:48 juju-e4d256-prod-github-runner-207 kernel: [77582.362800] (t=19366290 jiffies g=23269 q=65140) Aug 23 02:56:48 juju-e4d256-prod-github-runner-207 kernel: [77582.363594] NMI backtrace for cpu 1 Aug 23 02:56:48 juju-e4d256-prod-github-runner-207 kernel: [77582.364314] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 02:56:48 juju-e4d256-prod-github-runner-207 kernel: [77582.365423] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 02:56:48 juju-e4d256-prod-github-runner-207 kernel: [77582.366494] Call Trace: Aug 23 02:56:48 juju-e4d256-prod-github-runner-207 kernel: [77582.367173] Aug 23 02:56:48 juju-e4d256-prod-github-runner-207 kernel: [77582.367827] show_stack+0x52/0x5c Aug 23 02:56:48 juju-e4d256-prod-github-runner-207 kernel: [77582.368555] dump_stack_lvl+0x4a/0x63 Aug 23 02:56:48 juju-e4d256-prod-github-runner-207 kernel: [77582.369306] dump_stack+0x10/0x16 Aug 23 02:56:48 juju-e4d256-prod-github-runner-207 kernel: [77582.370029] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 23 02:56:48 juju-e4d256-prod-github-runner-207 kernel: [77582.370814] ? lapic_can_unplug_cpu+0x90/0x90 Aug 23 02:56:48 juju-e4d256-prod-github-runner-207 kernel: [77582.371602] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 23 02:56:48 juju-e4d256-prod-github-runner-207 kernel: [77582.372432] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 23 02:56:48 juju-e4d256-prod-github-runner-207 kernel: [77582.373256] trigger_single_cpu_backtrace+0x44/0x4f Aug 23 02:56:48 juju-e4d256-prod-github-runner-207 kernel: [77582.374065] rcu_dump_cpu_stacks+0x102/0x149 Aug 23 02:56:48 juju-e4d256-prod-github-runner-207 kernel: [77582.374837] print_cpu_stall.cold+0x2f/0xe2 Aug 23 02:56:48 juju-e4d256-prod-github-runner-207 kernel: [77582.375602] ? timekeeping_update+0xf7/0x150 Aug 23 02:56:48 juju-e4d256-prod-github-runner-207 kernel: [77582.376382] check_cpu_stall+0x109/0x270 Aug 23 02:56:48 juju-e4d256-prod-github-runner-207 kernel: [77582.377131] rcu_sched_clock_irq+0x9a/0x250 Aug 23 02:56:48 juju-e4d256-prod-github-runner-207 kernel: [77582.377900] update_process_times+0x94/0xd0 Aug 23 02:56:48 juju-e4d256-prod-github-runner-207 kernel: [77582.378663] tick_sched_handle+0x29/0x70 Aug 23 02:56:48 juju-e4d256-prod-github-runner-207 kernel: [77582.379411] tick_sched_timer+0x8c/0xc0 Aug 23 02:56:48 juju-e4d256-prod-github-runner-207 kernel: [77582.380163] ? tick_nohz_handler+0xb0/0xb0 Aug 23 02:56:48 juju-e4d256-prod-github-runner-207 kernel: [77582.380920] __hrtimer_run_queues+0x107/0x230 Aug 23 02:56:48 juju-e4d256-prod-github-runner-207 kernel: [77582.381696] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 02:56:48 juju-e4d256-prod-github-runner-207 kernel: [77582.382475] hrtimer_interrupt+0x101/0x220 Aug 23 02:56:48 juju-e4d256-prod-github-runner-207 kernel: [77582.383233] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 02:56:48 juju-e4d256-prod-github-runner-207 kernel: [77582.384052] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 02:56:48 juju-e4d256-prod-github-runner-207 kernel: [77582.384854] Aug 23 02:56:48 juju-e4d256-prod-github-runner-207 kernel: [77582.385488] Aug 23 02:56:48 juju-e4d256-prod-github-runner-207 kernel: [77582.386116] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 02:56:48 juju-e4d256-prod-github-runner-207 kernel: [77582.386941] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:56:48 juju-e4d256-prod-github-runner-207 kernel: [77582.387828] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 02:56:48 juju-e4d256-prod-github-runner-207 kernel: [77582.390045] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 02:56:48 juju-e4d256-prod-github-runner-207 kernel: [77582.390930] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 02:56:48 juju-e4d256-prod-github-runner-207 kernel: [77582.391939] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 02:56:48 juju-e4d256-prod-github-runner-207 kernel: [77582.392916] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 02:56:48 juju-e4d256-prod-github-runner-207 kernel: [77582.393939] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 02:56:48 juju-e4d256-prod-github-runner-207 kernel: [77582.394896] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 02:56:48 juju-e4d256-prod-github-runner-207 kernel: [77582.395863] ? _raw_spin_lock+0x22/0x30 Aug 23 02:56:48 juju-e4d256-prod-github-runner-207 kernel: [77582.396622] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:56:48 juju-e4d256-prod-github-runner-207 kernel: [77582.397457] direct_page_fault+0x206/0x310 [kvm] Aug 23 02:56:48 juju-e4d256-prod-github-runner-207 kernel: [77582.398296] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 02:56:48 juju-e4d256-prod-github-runner-207 kernel: [77582.399124] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 02:56:48 juju-e4d256-prod-github-runner-207 kernel: [77582.399958] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 02:56:48 juju-e4d256-prod-github-runner-207 kernel: [77582.400762] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 02:56:48 juju-e4d256-prod-github-runner-207 kernel: [77582.401554] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 02:56:48 juju-e4d256-prod-github-runner-207 kernel: [77582.402383] handle_exit+0x98/0x230 [kvm_amd] Aug 23 02:56:48 juju-e4d256-prod-github-runner-207 kernel: [77582.403209] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 02:56:48 juju-e4d256-prod-github-runner-207 kernel: [77582.404003] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 02:56:48 juju-e4d256-prod-github-runner-207 kernel: [77582.404806] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 02:56:48 juju-e4d256-prod-github-runner-207 kernel: [77582.405590] vcpu_run+0x62/0x2c0 [kvm] Aug 23 02:56:48 juju-e4d256-prod-github-runner-207 kernel: [77582.406310] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 02:56:48 juju-e4d256-prod-github-runner-207 kernel: [77582.407042] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 02:56:48 juju-e4d256-prod-github-runner-207 kernel: [77582.407853] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 02:56:48 juju-e4d256-prod-github-runner-207 kernel: [77582.408614] ? __seccomp_filter+0x4a/0x4a0 Aug 23 02:56:48 juju-e4d256-prod-github-runner-207 kernel: [77582.409333] ? __fget_files+0x86/0xc0 Aug 23 02:56:48 juju-e4d256-prod-github-runner-207 kernel: [77582.410028] __x64_sys_ioctl+0x95/0xd0 Aug 23 02:56:48 juju-e4d256-prod-github-runner-207 kernel: [77582.410722] do_syscall_64+0x5c/0xc0 Aug 23 02:56:48 juju-e4d256-prod-github-runner-207 kernel: [77582.411402] ? do_futex+0x162/0x1f0 Aug 23 02:56:48 juju-e4d256-prod-github-runner-207 kernel: [77582.412089] ? __x64_sys_futex+0x78/0x1e0 Aug 23 02:56:48 juju-e4d256-prod-github-runner-207 kernel: [77582.412790] ? __secure_computing+0xa9/0x120 Aug 23 02:56:48 juju-e4d256-prod-github-runner-207 kernel: [77582.413504] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 02:56:48 juju-e4d256-prod-github-runner-207 kernel: [77582.414293] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:56:48 juju-e4d256-prod-github-runner-207 kernel: [77582.415047] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:56:48 juju-e4d256-prod-github-runner-207 kernel: [77582.415809] ? do_syscall_64+0x69/0xc0 Aug 23 02:56:48 juju-e4d256-prod-github-runner-207 kernel: [77582.416500] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:56:48 juju-e4d256-prod-github-runner-207 kernel: [77582.417259] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:56:48 juju-e4d256-prod-github-runner-207 kernel: [77582.418021] ? do_syscall_64+0x69/0xc0 Aug 23 02:56:48 juju-e4d256-prod-github-runner-207 kernel: [77582.418717] ? do_syscall_64+0x69/0xc0 Aug 23 02:56:48 juju-e4d256-prod-github-runner-207 kernel: [77582.419403] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 02:56:48 juju-e4d256-prod-github-runner-207 kernel: [77582.420179] RIP: 0033:0x7faa5d0edaff Aug 23 02:56:48 juju-e4d256-prod-github-runner-207 kernel: [77582.420880] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 02:56:48 juju-e4d256-prod-github-runner-207 kernel: [77582.422980] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 02:56:48 juju-e4d256-prod-github-runner-207 kernel: [77582.423962] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 02:56:48 juju-e4d256-prod-github-runner-207 kernel: [77582.424916] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 02:56:48 juju-e4d256-prod-github-runner-207 kernel: [77582.425868] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 02:56:48 juju-e4d256-prod-github-runner-207 kernel: [77582.426814] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 02:56:48 juju-e4d256-prod-github-runner-207 kernel: [77582.427752] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 02:56:48 juju-e4d256-prod-github-runner-207 kernel: [77582.428673] Aug 23 02:57:14 juju-e4d256-prod-github-runner-207 kernel: [77608.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 72170s! [qemu-system-x86:6715] Aug 23 02:57:14 juju-e4d256-prod-github-runner-207 kernel: [77608.543120] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 02:57:14 juju-e4d256-prod-github-runner-207 kernel: [77608.543193] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 02:57:14 juju-e4d256-prod-github-runner-207 kernel: [77608.555423] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 02:57:14 juju-e4d256-prod-github-runner-207 kernel: [77608.556714] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 02:57:14 juju-e4d256-prod-github-runner-207 kernel: [77608.557953] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:57:14 juju-e4d256-prod-github-runner-207 kernel: [77608.559026] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 02:57:14 juju-e4d256-prod-github-runner-207 kernel: [77608.561666] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 02:57:14 juju-e4d256-prod-github-runner-207 kernel: [77608.562726] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 02:57:14 juju-e4d256-prod-github-runner-207 kernel: [77608.563912] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 02:57:14 juju-e4d256-prod-github-runner-207 kernel: [77608.565074] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 02:57:14 juju-e4d256-prod-github-runner-207 kernel: [77608.566251] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 02:57:14 juju-e4d256-prod-github-runner-207 kernel: [77608.567453] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 02:57:14 juju-e4d256-prod-github-runner-207 kernel: [77608.568651] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 02:57:14 juju-e4d256-prod-github-runner-207 kernel: [77608.569894] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 02:57:14 juju-e4d256-prod-github-runner-207 kernel: [77608.571009] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 02:57:14 juju-e4d256-prod-github-runner-207 kernel: [77608.572245] Call Trace: Aug 23 02:57:14 juju-e4d256-prod-github-runner-207 kernel: [77608.573179] Aug 23 02:57:14 juju-e4d256-prod-github-runner-207 kernel: [77608.574072] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:57:14 juju-e4d256-prod-github-runner-207 kernel: [77608.575108] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:57:14 juju-e4d256-prod-github-runner-207 kernel: [77608.576182] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:57:14 juju-e4d256-prod-github-runner-207 kernel: [77608.577286] ? show_regs.part.0+0x23/0x29 Aug 23 02:57:14 juju-e4d256-prod-github-runner-207 kernel: [77608.578289] ? show_regs.cold+0x8/0xd Aug 23 02:57:14 juju-e4d256-prod-github-runner-207 kernel: [77608.579269] ? watchdog_timer_fn+0x1be/0x220 Aug 23 02:57:14 juju-e4d256-prod-github-runner-207 kernel: [77608.580334] ? lockup_detector_update_enable+0x60/0x60 Aug 23 02:57:14 juju-e4d256-prod-github-runner-207 kernel: [77608.581435] ? __hrtimer_run_queues+0x107/0x230 Aug 23 02:57:14 juju-e4d256-prod-github-runner-207 kernel: [77608.582559] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 02:57:14 juju-e4d256-prod-github-runner-207 kernel: [77608.583656] ? hrtimer_interrupt+0x101/0x220 Aug 23 02:57:14 juju-e4d256-prod-github-runner-207 kernel: [77608.584766] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 02:57:14 juju-e4d256-prod-github-runner-207 kernel: [77608.585926] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 02:57:14 juju-e4d256-prod-github-runner-207 kernel: [77608.587019] Aug 23 02:57:14 juju-e4d256-prod-github-runner-207 kernel: [77608.587944] Aug 23 02:57:14 juju-e4d256-prod-github-runner-207 kernel: [77608.588791] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 02:57:14 juju-e4d256-prod-github-runner-207 kernel: [77608.589827] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:57:14 juju-e4d256-prod-github-runner-207 kernel: [77608.590906] ? _raw_spin_lock+0x22/0x30 Aug 23 02:57:14 juju-e4d256-prod-github-runner-207 kernel: [77608.591899] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:57:14 juju-e4d256-prod-github-runner-207 kernel: [77608.592984] direct_page_fault+0x206/0x310 [kvm] Aug 23 02:57:14 juju-e4d256-prod-github-runner-207 kernel: [77608.594016] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 02:57:14 juju-e4d256-prod-github-runner-207 kernel: [77608.595026] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 02:57:14 juju-e4d256-prod-github-runner-207 kernel: [77608.596050] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 02:57:14 juju-e4d256-prod-github-runner-207 kernel: [77608.597045] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 02:57:14 juju-e4d256-prod-github-runner-207 kernel: [77608.598027] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 02:57:14 juju-e4d256-prod-github-runner-207 kernel: [77608.599017] handle_exit+0x98/0x230 [kvm_amd] Aug 23 02:57:14 juju-e4d256-prod-github-runner-207 kernel: [77608.599925] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 02:57:14 juju-e4d256-prod-github-runner-207 kernel: [77608.600858] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 02:57:14 juju-e4d256-prod-github-runner-207 kernel: [77608.601880] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 02:57:14 juju-e4d256-prod-github-runner-207 kernel: [77608.602822] vcpu_run+0x62/0x2c0 [kvm] Aug 23 02:57:14 juju-e4d256-prod-github-runner-207 kernel: [77608.603684] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 02:57:14 juju-e4d256-prod-github-runner-207 kernel: [77608.604510] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 02:57:14 juju-e4d256-prod-github-runner-207 kernel: [77608.605368] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 02:57:14 juju-e4d256-prod-github-runner-207 kernel: [77608.606167] ? __seccomp_filter+0x4a/0x4a0 Aug 23 02:57:14 juju-e4d256-prod-github-runner-207 kernel: [77608.606941] ? __fget_files+0x86/0xc0 Aug 23 02:57:14 juju-e4d256-prod-github-runner-207 kernel: [77608.607673] __x64_sys_ioctl+0x95/0xd0 Aug 23 02:57:14 juju-e4d256-prod-github-runner-207 kernel: [77608.608388] do_syscall_64+0x5c/0xc0 Aug 23 02:57:14 juju-e4d256-prod-github-runner-207 kernel: [77608.609057] ? do_futex+0x162/0x1f0 Aug 23 02:57:14 juju-e4d256-prod-github-runner-207 kernel: [77608.609726] ? __x64_sys_futex+0x78/0x1e0 Aug 23 02:57:14 juju-e4d256-prod-github-runner-207 kernel: [77608.610408] ? __secure_computing+0xa9/0x120 Aug 23 02:57:14 juju-e4d256-prod-github-runner-207 kernel: [77608.611104] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 02:57:14 juju-e4d256-prod-github-runner-207 kernel: [77608.611876] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:57:14 juju-e4d256-prod-github-runner-207 kernel: [77608.612609] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:57:14 juju-e4d256-prod-github-runner-207 kernel: [77608.613343] ? do_syscall_64+0x69/0xc0 Aug 23 02:57:14 juju-e4d256-prod-github-runner-207 kernel: [77608.613992] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:57:14 juju-e4d256-prod-github-runner-207 kernel: [77608.614696] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:57:14 juju-e4d256-prod-github-runner-207 kernel: [77608.615407] ? do_syscall_64+0x69/0xc0 Aug 23 02:57:14 juju-e4d256-prod-github-runner-207 kernel: [77608.616036] ? do_syscall_64+0x69/0xc0 Aug 23 02:57:14 juju-e4d256-prod-github-runner-207 kernel: [77608.616660] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 02:57:14 juju-e4d256-prod-github-runner-207 kernel: [77608.617379] RIP: 0033:0x7faa5d0edaff Aug 23 02:57:14 juju-e4d256-prod-github-runner-207 kernel: [77608.618006] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 02:57:14 juju-e4d256-prod-github-runner-207 kernel: [77608.620031] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 02:57:14 juju-e4d256-prod-github-runner-207 kernel: [77608.621008] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 02:57:14 juju-e4d256-prod-github-runner-207 kernel: [77608.621930] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 02:57:14 juju-e4d256-prod-github-runner-207 kernel: [77608.622848] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 02:57:14 juju-e4d256-prod-github-runner-207 kernel: [77608.623763] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 02:57:14 juju-e4d256-prod-github-runner-207 kernel: [77608.624671] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 02:57:14 juju-e4d256-prod-github-runner-207 kernel: [77608.625565] Aug 23 02:57:42 juju-e4d256-prod-github-runner-207 kernel: [77636.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 72196s! [qemu-system-x86:6715] Aug 23 02:57:42 juju-e4d256-prod-github-runner-207 kernel: [77636.543141] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 02:57:42 juju-e4d256-prod-github-runner-207 kernel: [77636.543217] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 02:57:42 juju-e4d256-prod-github-runner-207 kernel: [77636.555535] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 02:57:42 juju-e4d256-prod-github-runner-207 kernel: [77636.556804] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 02:57:42 juju-e4d256-prod-github-runner-207 kernel: [77636.558022] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:57:42 juju-e4d256-prod-github-runner-207 kernel: [77636.559089] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 02:57:42 juju-e4d256-prod-github-runner-207 kernel: [77636.561628] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 02:57:42 juju-e4d256-prod-github-runner-207 kernel: [77636.562668] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 02:57:42 juju-e4d256-prod-github-runner-207 kernel: [77636.563837] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 02:57:42 juju-e4d256-prod-github-runner-207 kernel: [77636.565007] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 02:57:42 juju-e4d256-prod-github-runner-207 kernel: [77636.566178] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 02:57:42 juju-e4d256-prod-github-runner-207 kernel: [77636.567377] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 02:57:42 juju-e4d256-prod-github-runner-207 kernel: [77636.568608] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 02:57:42 juju-e4d256-prod-github-runner-207 kernel: [77636.569871] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 02:57:42 juju-e4d256-prod-github-runner-207 kernel: [77636.570982] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 02:57:42 juju-e4d256-prod-github-runner-207 kernel: [77636.572193] Call Trace: Aug 23 02:57:42 juju-e4d256-prod-github-runner-207 kernel: [77636.573124] Aug 23 02:57:42 juju-e4d256-prod-github-runner-207 kernel: [77636.574031] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:57:42 juju-e4d256-prod-github-runner-207 kernel: [77636.575101] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:57:42 juju-e4d256-prod-github-runner-207 kernel: [77636.576122] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:57:42 juju-e4d256-prod-github-runner-207 kernel: [77636.577204] ? show_regs.part.0+0x23/0x29 Aug 23 02:57:42 juju-e4d256-prod-github-runner-207 kernel: [77636.578199] ? show_regs.cold+0x8/0xd Aug 23 02:57:42 juju-e4d256-prod-github-runner-207 kernel: [77636.579181] ? watchdog_timer_fn+0x1be/0x220 Aug 23 02:57:42 juju-e4d256-prod-github-runner-207 kernel: [77636.580188] ? lockup_detector_update_enable+0x60/0x60 Aug 23 02:57:42 juju-e4d256-prod-github-runner-207 kernel: [77636.581248] ? __hrtimer_run_queues+0x107/0x230 Aug 23 02:57:42 juju-e4d256-prod-github-runner-207 kernel: [77636.582274] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 02:57:42 juju-e4d256-prod-github-runner-207 kernel: [77636.583305] ? hrtimer_interrupt+0x101/0x220 Aug 23 02:57:42 juju-e4d256-prod-github-runner-207 kernel: [77636.584319] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 02:57:42 juju-e4d256-prod-github-runner-207 kernel: [77636.585385] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 02:57:42 juju-e4d256-prod-github-runner-207 kernel: [77636.586434] Aug 23 02:57:42 juju-e4d256-prod-github-runner-207 kernel: [77636.587295] Aug 23 02:57:42 juju-e4d256-prod-github-runner-207 kernel: [77636.588140] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 02:57:42 juju-e4d256-prod-github-runner-207 kernel: [77636.589172] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:57:42 juju-e4d256-prod-github-runner-207 kernel: [77636.590214] ? _raw_spin_lock+0x22/0x30 Aug 23 02:57:42 juju-e4d256-prod-github-runner-207 kernel: [77636.591184] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:57:42 juju-e4d256-prod-github-runner-207 kernel: [77636.592215] direct_page_fault+0x206/0x310 [kvm] Aug 23 02:57:42 juju-e4d256-prod-github-runner-207 kernel: [77636.593241] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 02:57:42 juju-e4d256-prod-github-runner-207 kernel: [77636.594245] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 02:57:42 juju-e4d256-prod-github-runner-207 kernel: [77636.595253] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 02:57:42 juju-e4d256-prod-github-runner-207 kernel: [77636.596222] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 02:57:42 juju-e4d256-prod-github-runner-207 kernel: [77636.597167] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 02:57:42 juju-e4d256-prod-github-runner-207 kernel: [77636.598142] handle_exit+0x98/0x230 [kvm_amd] Aug 23 02:57:42 juju-e4d256-prod-github-runner-207 kernel: [77636.599033] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 02:57:42 juju-e4d256-prod-github-runner-207 kernel: [77636.600004] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 02:57:42 juju-e4d256-prod-github-runner-207 kernel: [77636.600939] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 02:57:42 juju-e4d256-prod-github-runner-207 kernel: [77636.601841] vcpu_run+0x62/0x2c0 [kvm] Aug 23 02:57:42 juju-e4d256-prod-github-runner-207 kernel: [77636.602650] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 02:57:42 juju-e4d256-prod-github-runner-207 kernel: [77636.603472] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 02:57:42 juju-e4d256-prod-github-runner-207 kernel: [77636.604333] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 02:57:42 juju-e4d256-prod-github-runner-207 kernel: [77636.605135] ? __seccomp_filter+0x4a/0x4a0 Aug 23 02:57:42 juju-e4d256-prod-github-runner-207 kernel: [77636.605884] ? __fget_files+0x86/0xc0 Aug 23 02:57:42 juju-e4d256-prod-github-runner-207 kernel: [77636.606589] __x64_sys_ioctl+0x95/0xd0 Aug 23 02:57:42 juju-e4d256-prod-github-runner-207 kernel: [77636.607305] do_syscall_64+0x5c/0xc0 Aug 23 02:57:42 juju-e4d256-prod-github-runner-207 kernel: [77636.607977] ? do_futex+0x162/0x1f0 Aug 23 02:57:42 juju-e4d256-prod-github-runner-207 kernel: [77636.608626] ? __x64_sys_futex+0x78/0x1e0 Aug 23 02:57:42 juju-e4d256-prod-github-runner-207 kernel: [77636.609299] ? __secure_computing+0xa9/0x120 Aug 23 02:57:42 juju-e4d256-prod-github-runner-207 kernel: [77636.609991] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 02:57:42 juju-e4d256-prod-github-runner-207 kernel: [77636.610751] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:57:42 juju-e4d256-prod-github-runner-207 kernel: [77636.611503] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:57:42 juju-e4d256-prod-github-runner-207 kernel: [77636.612220] ? do_syscall_64+0x69/0xc0 Aug 23 02:57:42 juju-e4d256-prod-github-runner-207 kernel: [77636.612868] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:57:42 juju-e4d256-prod-github-runner-207 kernel: [77636.613593] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:57:42 juju-e4d256-prod-github-runner-207 kernel: [77636.614296] ? do_syscall_64+0x69/0xc0 Aug 23 02:57:42 juju-e4d256-prod-github-runner-207 kernel: [77636.615087] ? do_syscall_64+0x69/0xc0 Aug 23 02:57:42 juju-e4d256-prod-github-runner-207 kernel: [77636.615716] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 02:57:42 juju-e4d256-prod-github-runner-207 kernel: [77636.616423] RIP: 0033:0x7faa5d0edaff Aug 23 02:57:42 juju-e4d256-prod-github-runner-207 kernel: [77636.617048] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 02:57:42 juju-e4d256-prod-github-runner-207 kernel: [77636.619042] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 02:57:42 juju-e4d256-prod-github-runner-207 kernel: [77636.619961] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 02:57:42 juju-e4d256-prod-github-runner-207 kernel: [77636.620851] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 02:57:42 juju-e4d256-prod-github-runner-207 kernel: [77636.621746] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 02:57:42 juju-e4d256-prod-github-runner-207 kernel: [77636.622633] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 02:57:42 juju-e4d256-prod-github-runner-207 kernel: [77636.623536] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 02:57:42 juju-e4d256-prod-github-runner-207 kernel: [77636.624453] Aug 23 02:58:10 juju-e4d256-prod-github-runner-207 kernel: [77664.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 72222s! [qemu-system-x86:6715] Aug 23 02:58:10 juju-e4d256-prod-github-runner-207 kernel: [77664.543853] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 02:58:10 juju-e4d256-prod-github-runner-207 kernel: [77664.544138] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 02:58:10 juju-e4d256-prod-github-runner-207 kernel: [77664.556300] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 02:58:10 juju-e4d256-prod-github-runner-207 kernel: [77664.557566] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 02:58:10 juju-e4d256-prod-github-runner-207 kernel: [77664.558805] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:58:10 juju-e4d256-prod-github-runner-207 kernel: [77664.559866] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 02:58:10 juju-e4d256-prod-github-runner-207 kernel: [77664.562456] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 02:58:10 juju-e4d256-prod-github-runner-207 kernel: [77664.563505] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 02:58:10 juju-e4d256-prod-github-runner-207 kernel: [77664.564687] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 02:58:10 juju-e4d256-prod-github-runner-207 kernel: [77664.565852] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 02:58:10 juju-e4d256-prod-github-runner-207 kernel: [77664.567021] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 02:58:10 juju-e4d256-prod-github-runner-207 kernel: [77664.568186] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 02:58:10 juju-e4d256-prod-github-runner-207 kernel: [77664.569511] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 02:58:10 juju-e4d256-prod-github-runner-207 kernel: [77664.571014] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 02:58:10 juju-e4d256-prod-github-runner-207 kernel: [77664.572222] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 02:58:10 juju-e4d256-prod-github-runner-207 kernel: [77664.573549] Call Trace: Aug 23 02:58:10 juju-e4d256-prod-github-runner-207 kernel: [77664.574522] Aug 23 02:58:10 juju-e4d256-prod-github-runner-207 kernel: [77664.575492] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:58:10 juju-e4d256-prod-github-runner-207 kernel: [77664.576624] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:58:10 juju-e4d256-prod-github-runner-207 kernel: [77664.577741] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:58:10 juju-e4d256-prod-github-runner-207 kernel: [77664.578947] ? show_regs.part.0+0x23/0x29 Aug 23 02:58:10 juju-e4d256-prod-github-runner-207 kernel: [77664.580026] ? show_regs.cold+0x8/0xd Aug 23 02:58:10 juju-e4d256-prod-github-runner-207 kernel: [77664.581074] ? watchdog_timer_fn+0x1be/0x220 Aug 23 02:58:10 juju-e4d256-prod-github-runner-207 kernel: [77664.582171] ? lockup_detector_update_enable+0x60/0x60 Aug 23 02:58:10 juju-e4d256-prod-github-runner-207 kernel: [77664.583360] ? __hrtimer_run_queues+0x107/0x230 Aug 23 02:58:10 juju-e4d256-prod-github-runner-207 kernel: [77664.584484] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 02:58:10 juju-e4d256-prod-github-runner-207 kernel: [77664.585602] ? hrtimer_interrupt+0x101/0x220 Aug 23 02:58:10 juju-e4d256-prod-github-runner-207 kernel: [77664.586706] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 02:58:10 juju-e4d256-prod-github-runner-207 kernel: [77664.587923] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 02:58:10 juju-e4d256-prod-github-runner-207 kernel: [77664.589075] Aug 23 02:58:10 juju-e4d256-prod-github-runner-207 kernel: [77664.589981] Aug 23 02:58:10 juju-e4d256-prod-github-runner-207 kernel: [77664.590886] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 02:58:10 juju-e4d256-prod-github-runner-207 kernel: [77664.592041] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:58:10 juju-e4d256-prod-github-runner-207 kernel: [77664.593191] ? _raw_spin_lock+0x22/0x30 Aug 23 02:58:10 juju-e4d256-prod-github-runner-207 kernel: [77664.594216] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:58:10 juju-e4d256-prod-github-runner-207 kernel: [77664.595346] direct_page_fault+0x206/0x310 [kvm] Aug 23 02:58:10 juju-e4d256-prod-github-runner-207 kernel: [77664.596524] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 02:58:10 juju-e4d256-prod-github-runner-207 kernel: [77664.597662] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 02:58:10 juju-e4d256-prod-github-runner-207 kernel: [77664.598774] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 02:58:10 juju-e4d256-prod-github-runner-207 kernel: [77664.599890] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 02:58:10 juju-e4d256-prod-github-runner-207 kernel: [77664.600930] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 02:58:10 juju-e4d256-prod-github-runner-207 kernel: [77664.602014] handle_exit+0x98/0x230 [kvm_amd] Aug 23 02:58:10 juju-e4d256-prod-github-runner-207 kernel: [77664.603038] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 02:58:10 juju-e4d256-prod-github-runner-207 kernel: [77664.604050] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 02:58:10 juju-e4d256-prod-github-runner-207 kernel: [77664.605097] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 02:58:10 juju-e4d256-prod-github-runner-207 kernel: [77664.606145] vcpu_run+0x62/0x2c0 [kvm] Aug 23 02:58:10 juju-e4d256-prod-github-runner-207 kernel: [77664.607058] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 02:58:10 juju-e4d256-prod-github-runner-207 kernel: [77664.607956] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 02:58:10 juju-e4d256-prod-github-runner-207 kernel: [77664.608916] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 02:58:10 juju-e4d256-prod-github-runner-207 kernel: [77664.609803] ? __seccomp_filter+0x4a/0x4a0 Aug 23 02:58:10 juju-e4d256-prod-github-runner-207 kernel: [77664.610629] ? __fget_files+0x86/0xc0 Aug 23 02:58:10 juju-e4d256-prod-github-runner-207 kernel: [77664.611436] __x64_sys_ioctl+0x95/0xd0 Aug 23 02:58:10 juju-e4d256-prod-github-runner-207 kernel: [77664.612209] do_syscall_64+0x5c/0xc0 Aug 23 02:58:10 juju-e4d256-prod-github-runner-207 kernel: [77664.612954] ? do_futex+0x162/0x1f0 Aug 23 02:58:10 juju-e4d256-prod-github-runner-207 kernel: [77664.613673] ? __x64_sys_futex+0x78/0x1e0 Aug 23 02:58:10 juju-e4d256-prod-github-runner-207 kernel: [77664.614425] ? __secure_computing+0xa9/0x120 Aug 23 02:58:10 juju-e4d256-prod-github-runner-207 kernel: [77664.615242] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 02:58:10 juju-e4d256-prod-github-runner-207 kernel: [77664.616109] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:58:10 juju-e4d256-prod-github-runner-207 kernel: [77664.616924] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:58:10 juju-e4d256-prod-github-runner-207 kernel: [77664.617745] ? do_syscall_64+0x69/0xc0 Aug 23 02:58:10 juju-e4d256-prod-github-runner-207 kernel: [77664.618477] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:58:10 juju-e4d256-prod-github-runner-207 kernel: [77664.619293] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:58:10 juju-e4d256-prod-github-runner-207 kernel: [77664.620085] ? do_syscall_64+0x69/0xc0 Aug 23 02:58:10 juju-e4d256-prod-github-runner-207 kernel: [77664.620788] ? do_syscall_64+0x69/0xc0 Aug 23 02:58:10 juju-e4d256-prod-github-runner-207 kernel: [77664.621491] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 02:58:10 juju-e4d256-prod-github-runner-207 kernel: [77664.622297] RIP: 0033:0x7faa5d0edaff Aug 23 02:58:10 juju-e4d256-prod-github-runner-207 kernel: [77664.623052] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 02:58:10 juju-e4d256-prod-github-runner-207 kernel: [77664.625407] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 02:58:10 juju-e4d256-prod-github-runner-207 kernel: [77664.626480] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 02:58:10 juju-e4d256-prod-github-runner-207 kernel: [77664.627527] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 02:58:10 juju-e4d256-prod-github-runner-207 kernel: [77664.628558] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 02:58:10 juju-e4d256-prod-github-runner-207 kernel: [77664.629578] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 02:58:10 juju-e4d256-prod-github-runner-207 kernel: [77664.630602] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 02:58:10 juju-e4d256-prod-github-runner-207 kernel: [77664.631667] Aug 23 02:58:38 juju-e4d256-prod-github-runner-207 kernel: [77692.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 72248s! [qemu-system-x86:6715] Aug 23 02:58:38 juju-e4d256-prod-github-runner-207 kernel: [77692.543144] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 02:58:38 juju-e4d256-prod-github-runner-207 kernel: [77692.543222] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 02:58:38 juju-e4d256-prod-github-runner-207 kernel: [77692.555683] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 02:58:38 juju-e4d256-prod-github-runner-207 kernel: [77692.556982] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 02:58:38 juju-e4d256-prod-github-runner-207 kernel: [77692.558226] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:58:38 juju-e4d256-prod-github-runner-207 kernel: [77692.559321] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 02:58:38 juju-e4d256-prod-github-runner-207 kernel: [77692.561919] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 02:58:38 juju-e4d256-prod-github-runner-207 kernel: [77692.562991] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 02:58:38 juju-e4d256-prod-github-runner-207 kernel: [77692.564180] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 02:58:38 juju-e4d256-prod-github-runner-207 kernel: [77692.565415] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 02:58:38 juju-e4d256-prod-github-runner-207 kernel: [77692.566591] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 02:58:38 juju-e4d256-prod-github-runner-207 kernel: [77692.567798] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 02:58:38 juju-e4d256-prod-github-runner-207 kernel: [77692.568987] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 02:58:38 juju-e4d256-prod-github-runner-207 kernel: [77692.570225] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 02:58:38 juju-e4d256-prod-github-runner-207 kernel: [77692.571339] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 02:58:38 juju-e4d256-prod-github-runner-207 kernel: [77692.572561] Call Trace: Aug 23 02:58:38 juju-e4d256-prod-github-runner-207 kernel: [77692.573475] Aug 23 02:58:38 juju-e4d256-prod-github-runner-207 kernel: [77692.574359] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:58:38 juju-e4d256-prod-github-runner-207 kernel: [77692.575399] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:58:38 juju-e4d256-prod-github-runner-207 kernel: [77692.576646] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:58:38 juju-e4d256-prod-github-runner-207 kernel: [77692.577739] ? show_regs.part.0+0x23/0x29 Aug 23 02:58:38 juju-e4d256-prod-github-runner-207 kernel: [77692.578768] ? show_regs.cold+0x8/0xd Aug 23 02:58:38 juju-e4d256-prod-github-runner-207 kernel: [77692.579741] ? watchdog_timer_fn+0x1be/0x220 Aug 23 02:58:38 juju-e4d256-prod-github-runner-207 kernel: [77692.580753] ? lockup_detector_update_enable+0x60/0x60 Aug 23 02:58:38 juju-e4d256-prod-github-runner-207 kernel: [77692.581815] ? __hrtimer_run_queues+0x107/0x230 Aug 23 02:58:38 juju-e4d256-prod-github-runner-207 kernel: [77692.582849] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 02:58:38 juju-e4d256-prod-github-runner-207 kernel: [77692.583872] ? hrtimer_interrupt+0x101/0x220 Aug 23 02:58:38 juju-e4d256-prod-github-runner-207 kernel: [77692.584894] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 02:58:38 juju-e4d256-prod-github-runner-207 kernel: [77692.586147] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 02:58:38 juju-e4d256-prod-github-runner-207 kernel: [77692.587377] Aug 23 02:58:38 juju-e4d256-prod-github-runner-207 kernel: [77692.588230] Aug 23 02:58:38 juju-e4d256-prod-github-runner-207 kernel: [77692.589067] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 02:58:38 juju-e4d256-prod-github-runner-207 kernel: [77692.590103] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:58:38 juju-e4d256-prod-github-runner-207 kernel: [77692.591159] ? _raw_spin_lock+0x22/0x30 Aug 23 02:58:38 juju-e4d256-prod-github-runner-207 kernel: [77692.592108] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:58:38 juju-e4d256-prod-github-runner-207 kernel: [77692.593127] direct_page_fault+0x206/0x310 [kvm] Aug 23 02:58:38 juju-e4d256-prod-github-runner-207 kernel: [77692.594149] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 02:58:38 juju-e4d256-prod-github-runner-207 kernel: [77692.595173] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 02:58:38 juju-e4d256-prod-github-runner-207 kernel: [77692.596175] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 02:58:38 juju-e4d256-prod-github-runner-207 kernel: [77692.597147] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 02:58:38 juju-e4d256-prod-github-runner-207 kernel: [77692.598091] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 02:58:38 juju-e4d256-prod-github-runner-207 kernel: [77692.599076] handle_exit+0x98/0x230 [kvm_amd] Aug 23 02:58:38 juju-e4d256-prod-github-runner-207 kernel: [77692.599968] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 02:58:38 juju-e4d256-prod-github-runner-207 kernel: [77692.600886] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 02:58:38 juju-e4d256-prod-github-runner-207 kernel: [77692.601808] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 02:58:38 juju-e4d256-prod-github-runner-207 kernel: [77692.602724] vcpu_run+0x62/0x2c0 [kvm] Aug 23 02:58:38 juju-e4d256-prod-github-runner-207 kernel: [77692.603546] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 02:58:38 juju-e4d256-prod-github-runner-207 kernel: [77692.604352] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 02:58:38 juju-e4d256-prod-github-runner-207 kernel: [77692.605209] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 02:58:38 juju-e4d256-prod-github-runner-207 kernel: [77692.606006] ? __seccomp_filter+0x4a/0x4a0 Aug 23 02:58:38 juju-e4d256-prod-github-runner-207 kernel: [77692.606767] ? __fget_files+0x86/0xc0 Aug 23 02:58:38 juju-e4d256-prod-github-runner-207 kernel: [77692.607662] __x64_sys_ioctl+0x95/0xd0 Aug 23 02:58:38 juju-e4d256-prod-github-runner-207 kernel: [77692.608362] do_syscall_64+0x5c/0xc0 Aug 23 02:58:38 juju-e4d256-prod-github-runner-207 kernel: [77692.609025] ? do_futex+0x162/0x1f0 Aug 23 02:58:38 juju-e4d256-prod-github-runner-207 kernel: [77692.609677] ? __x64_sys_futex+0x78/0x1e0 Aug 23 02:58:38 juju-e4d256-prod-github-runner-207 kernel: [77692.610349] ? __secure_computing+0xa9/0x120 Aug 23 02:58:38 juju-e4d256-prod-github-runner-207 kernel: [77692.611054] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 02:58:38 juju-e4d256-prod-github-runner-207 kernel: [77692.611820] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:58:38 juju-e4d256-prod-github-runner-207 kernel: [77692.612540] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:58:38 juju-e4d256-prod-github-runner-207 kernel: [77692.613257] ? do_syscall_64+0x69/0xc0 Aug 23 02:58:38 juju-e4d256-prod-github-runner-207 kernel: [77692.613901] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:58:38 juju-e4d256-prod-github-runner-207 kernel: [77692.614615] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:58:38 juju-e4d256-prod-github-runner-207 kernel: [77692.615316] ? do_syscall_64+0x69/0xc0 Aug 23 02:58:38 juju-e4d256-prod-github-runner-207 kernel: [77692.615947] ? do_syscall_64+0x69/0xc0 Aug 23 02:58:38 juju-e4d256-prod-github-runner-207 kernel: [77692.616570] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 02:58:38 juju-e4d256-prod-github-runner-207 kernel: [77692.617275] RIP: 0033:0x7faa5d0edaff Aug 23 02:58:38 juju-e4d256-prod-github-runner-207 kernel: [77692.617898] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 02:58:38 juju-e4d256-prod-github-runner-207 kernel: [77692.619924] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 02:58:38 juju-e4d256-prod-github-runner-207 kernel: [77692.620840] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 02:58:38 juju-e4d256-prod-github-runner-207 kernel: [77692.621735] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 02:58:38 juju-e4d256-prod-github-runner-207 kernel: [77692.622638] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 02:58:38 juju-e4d256-prod-github-runner-207 kernel: [77692.623532] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 02:58:38 juju-e4d256-prod-github-runner-207 kernel: [77692.624424] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 02:58:38 juju-e4d256-prod-github-runner-207 kernel: [77692.625318] Aug 23 02:59:06 juju-e4d256-prod-github-runner-207 kernel: [77720.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 72274s! [qemu-system-x86:6715] Aug 23 02:59:06 juju-e4d256-prod-github-runner-207 kernel: [77720.543118] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 02:59:06 juju-e4d256-prod-github-runner-207 kernel: [77720.543196] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 02:59:06 juju-e4d256-prod-github-runner-207 kernel: [77720.555303] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 02:59:06 juju-e4d256-prod-github-runner-207 kernel: [77720.556584] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 02:59:06 juju-e4d256-prod-github-runner-207 kernel: [77720.557806] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:59:06 juju-e4d256-prod-github-runner-207 kernel: [77720.558873] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 02:59:06 juju-e4d256-prod-github-runner-207 kernel: [77720.561406] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 02:59:06 juju-e4d256-prod-github-runner-207 kernel: [77720.562463] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 02:59:06 juju-e4d256-prod-github-runner-207 kernel: [77720.563623] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 02:59:06 juju-e4d256-prod-github-runner-207 kernel: [77720.564957] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 02:59:06 juju-e4d256-prod-github-runner-207 kernel: [77720.566132] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 02:59:06 juju-e4d256-prod-github-runner-207 kernel: [77720.567292] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 02:59:06 juju-e4d256-prod-github-runner-207 kernel: [77720.568517] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 02:59:06 juju-e4d256-prod-github-runner-207 kernel: [77720.569770] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 02:59:06 juju-e4d256-prod-github-runner-207 kernel: [77720.570907] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 02:59:06 juju-e4d256-prod-github-runner-207 kernel: [77720.572108] Call Trace: Aug 23 02:59:06 juju-e4d256-prod-github-runner-207 kernel: [77720.573018] Aug 23 02:59:06 juju-e4d256-prod-github-runner-207 kernel: [77720.573902] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:59:06 juju-e4d256-prod-github-runner-207 kernel: [77720.574942] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:59:06 juju-e4d256-prod-github-runner-207 kernel: [77720.575967] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:59:06 juju-e4d256-prod-github-runner-207 kernel: [77720.577051] ? show_regs.part.0+0x23/0x29 Aug 23 02:59:06 juju-e4d256-prod-github-runner-207 kernel: [77720.578045] ? show_regs.cold+0x8/0xd Aug 23 02:59:06 juju-e4d256-prod-github-runner-207 kernel: [77720.579030] ? watchdog_timer_fn+0x1be/0x220 Aug 23 02:59:06 juju-e4d256-prod-github-runner-207 kernel: [77720.580034] ? lockup_detector_update_enable+0x60/0x60 Aug 23 02:59:06 juju-e4d256-prod-github-runner-207 kernel: [77720.581091] ? __hrtimer_run_queues+0x107/0x230 Aug 23 02:59:06 juju-e4d256-prod-github-runner-207 kernel: [77720.582129] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 02:59:06 juju-e4d256-prod-github-runner-207 kernel: [77720.583160] ? hrtimer_interrupt+0x101/0x220 Aug 23 02:59:06 juju-e4d256-prod-github-runner-207 kernel: [77720.584183] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 02:59:06 juju-e4d256-prod-github-runner-207 kernel: [77720.585253] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 02:59:06 juju-e4d256-prod-github-runner-207 kernel: [77720.586344] Aug 23 02:59:06 juju-e4d256-prod-github-runner-207 kernel: [77720.587206] Aug 23 02:59:06 juju-e4d256-prod-github-runner-207 kernel: [77720.588041] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 02:59:06 juju-e4d256-prod-github-runner-207 kernel: [77720.589077] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:59:06 juju-e4d256-prod-github-runner-207 kernel: [77720.590143] ? _raw_spin_lock+0x22/0x30 Aug 23 02:59:06 juju-e4d256-prod-github-runner-207 kernel: [77720.591095] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:59:06 juju-e4d256-prod-github-runner-207 kernel: [77720.592144] direct_page_fault+0x206/0x310 [kvm] Aug 23 02:59:06 juju-e4d256-prod-github-runner-207 kernel: [77720.593231] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 02:59:06 juju-e4d256-prod-github-runner-207 kernel: [77720.594339] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 02:59:06 juju-e4d256-prod-github-runner-207 kernel: [77720.595389] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 02:59:06 juju-e4d256-prod-github-runner-207 kernel: [77720.596371] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 02:59:06 juju-e4d256-prod-github-runner-207 kernel: [77720.597348] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 02:59:06 juju-e4d256-prod-github-runner-207 kernel: [77720.598353] handle_exit+0x98/0x230 [kvm_amd] Aug 23 02:59:06 juju-e4d256-prod-github-runner-207 kernel: [77720.599249] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 02:59:06 juju-e4d256-prod-github-runner-207 kernel: [77720.600175] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 02:59:06 juju-e4d256-prod-github-runner-207 kernel: [77720.601111] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 02:59:06 juju-e4d256-prod-github-runner-207 kernel: [77720.602028] vcpu_run+0x62/0x2c0 [kvm] Aug 23 02:59:06 juju-e4d256-prod-github-runner-207 kernel: [77720.602854] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 02:59:06 juju-e4d256-prod-github-runner-207 kernel: [77720.603660] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 02:59:06 juju-e4d256-prod-github-runner-207 kernel: [77720.604552] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 02:59:06 juju-e4d256-prod-github-runner-207 kernel: [77720.605371] ? __seccomp_filter+0x4a/0x4a0 Aug 23 02:59:06 juju-e4d256-prod-github-runner-207 kernel: [77720.606126] ? __fget_files+0x86/0xc0 Aug 23 02:59:06 juju-e4d256-prod-github-runner-207 kernel: [77720.606830] __x64_sys_ioctl+0x95/0xd0 Aug 23 02:59:06 juju-e4d256-prod-github-runner-207 kernel: [77720.607520] do_syscall_64+0x5c/0xc0 Aug 23 02:59:06 juju-e4d256-prod-github-runner-207 kernel: [77720.608182] ? do_futex+0x162/0x1f0 Aug 23 02:59:06 juju-e4d256-prod-github-runner-207 kernel: [77720.608828] ? __x64_sys_futex+0x78/0x1e0 Aug 23 02:59:06 juju-e4d256-prod-github-runner-207 kernel: [77720.609505] ? __secure_computing+0xa9/0x120 Aug 23 02:59:06 juju-e4d256-prod-github-runner-207 kernel: [77720.610208] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 02:59:06 juju-e4d256-prod-github-runner-207 kernel: [77720.610967] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:59:06 juju-e4d256-prod-github-runner-207 kernel: [77720.611685] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:59:06 juju-e4d256-prod-github-runner-207 kernel: [77720.612400] ? do_syscall_64+0x69/0xc0 Aug 23 02:59:06 juju-e4d256-prod-github-runner-207 kernel: [77720.613051] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:59:06 juju-e4d256-prod-github-runner-207 kernel: [77720.613759] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:59:06 juju-e4d256-prod-github-runner-207 kernel: [77720.614478] ? do_syscall_64+0x69/0xc0 Aug 23 02:59:06 juju-e4d256-prod-github-runner-207 kernel: [77720.615109] ? do_syscall_64+0x69/0xc0 Aug 23 02:59:06 juju-e4d256-prod-github-runner-207 kernel: [77720.615736] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 02:59:06 juju-e4d256-prod-github-runner-207 kernel: [77720.616441] RIP: 0033:0x7faa5d0edaff Aug 23 02:59:06 juju-e4d256-prod-github-runner-207 kernel: [77720.617071] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 02:59:06 juju-e4d256-prod-github-runner-207 kernel: [77720.619082] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 02:59:06 juju-e4d256-prod-github-runner-207 kernel: [77720.620002] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 02:59:06 juju-e4d256-prod-github-runner-207 kernel: [77720.620894] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 02:59:06 juju-e4d256-prod-github-runner-207 kernel: [77720.621781] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 02:59:06 juju-e4d256-prod-github-runner-207 kernel: [77720.622669] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 02:59:06 juju-e4d256-prod-github-runner-207 kernel: [77720.623551] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 02:59:06 juju-e4d256-prod-github-runner-207 kernel: [77720.624435] Aug 23 02:59:34 juju-e4d256-prod-github-runner-207 kernel: [77748.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 72300s! [qemu-system-x86:6715] Aug 23 02:59:34 juju-e4d256-prod-github-runner-207 kernel: [77748.543856] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 02:59:34 juju-e4d256-prod-github-runner-207 kernel: [77748.544161] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 02:59:34 juju-e4d256-prod-github-runner-207 kernel: [77748.556266] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 02:59:34 juju-e4d256-prod-github-runner-207 kernel: [77748.557538] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 02:59:34 juju-e4d256-prod-github-runner-207 kernel: [77748.558780] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:59:34 juju-e4d256-prod-github-runner-207 kernel: [77748.559844] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 02:59:34 juju-e4d256-prod-github-runner-207 kernel: [77748.562400] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 02:59:34 juju-e4d256-prod-github-runner-207 kernel: [77748.563444] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 02:59:34 juju-e4d256-prod-github-runner-207 kernel: [77748.564610] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 02:59:34 juju-e4d256-prod-github-runner-207 kernel: [77748.565780] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 02:59:34 juju-e4d256-prod-github-runner-207 kernel: [77748.566951] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 02:59:34 juju-e4d256-prod-github-runner-207 kernel: [77748.568111] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 02:59:34 juju-e4d256-prod-github-runner-207 kernel: [77748.569277] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 02:59:34 juju-e4d256-prod-github-runner-207 kernel: [77748.570529] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 02:59:34 juju-e4d256-prod-github-runner-207 kernel: [77748.571627] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 02:59:34 juju-e4d256-prod-github-runner-207 kernel: [77748.572824] Call Trace: Aug 23 02:59:34 juju-e4d256-prod-github-runner-207 kernel: [77748.573735] Aug 23 02:59:34 juju-e4d256-prod-github-runner-207 kernel: [77748.574641] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:59:34 juju-e4d256-prod-github-runner-207 kernel: [77748.575677] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 02:59:34 juju-e4d256-prod-github-runner-207 kernel: [77748.576697] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:59:34 juju-e4d256-prod-github-runner-207 kernel: [77748.577796] ? show_regs.part.0+0x23/0x29 Aug 23 02:59:34 juju-e4d256-prod-github-runner-207 kernel: [77748.578792] ? show_regs.cold+0x8/0xd Aug 23 02:59:34 juju-e4d256-prod-github-runner-207 kernel: [77748.579762] ? watchdog_timer_fn+0x1be/0x220 Aug 23 02:59:34 juju-e4d256-prod-github-runner-207 kernel: [77748.580768] ? lockup_detector_update_enable+0x60/0x60 Aug 23 02:59:34 juju-e4d256-prod-github-runner-207 kernel: [77748.581853] ? __hrtimer_run_queues+0x107/0x230 Aug 23 02:59:34 juju-e4d256-prod-github-runner-207 kernel: [77748.582881] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 02:59:34 juju-e4d256-prod-github-runner-207 kernel: [77748.583908] ? hrtimer_interrupt+0x101/0x220 Aug 23 02:59:34 juju-e4d256-prod-github-runner-207 kernel: [77748.584926] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 02:59:34 juju-e4d256-prod-github-runner-207 kernel: [77748.586003] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 02:59:34 juju-e4d256-prod-github-runner-207 kernel: [77748.587143] Aug 23 02:59:34 juju-e4d256-prod-github-runner-207 kernel: [77748.588000] Aug 23 02:59:34 juju-e4d256-prod-github-runner-207 kernel: [77748.588837] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 02:59:34 juju-e4d256-prod-github-runner-207 kernel: [77748.589881] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:59:34 juju-e4d256-prod-github-runner-207 kernel: [77748.590926] ? _raw_spin_lock+0x22/0x30 Aug 23 02:59:34 juju-e4d256-prod-github-runner-207 kernel: [77748.591871] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:59:34 juju-e4d256-prod-github-runner-207 kernel: [77748.592886] direct_page_fault+0x206/0x310 [kvm] Aug 23 02:59:34 juju-e4d256-prod-github-runner-207 kernel: [77748.593922] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 02:59:34 juju-e4d256-prod-github-runner-207 kernel: [77748.594930] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 02:59:34 juju-e4d256-prod-github-runner-207 kernel: [77748.595931] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 02:59:34 juju-e4d256-prod-github-runner-207 kernel: [77748.596929] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 02:59:34 juju-e4d256-prod-github-runner-207 kernel: [77748.597883] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 02:59:34 juju-e4d256-prod-github-runner-207 kernel: [77748.598860] handle_exit+0x98/0x230 [kvm_amd] Aug 23 02:59:34 juju-e4d256-prod-github-runner-207 kernel: [77748.599751] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 02:59:34 juju-e4d256-prod-github-runner-207 kernel: [77748.600663] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 02:59:34 juju-e4d256-prod-github-runner-207 kernel: [77748.601593] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 02:59:34 juju-e4d256-prod-github-runner-207 kernel: [77748.602513] vcpu_run+0x62/0x2c0 [kvm] Aug 23 02:59:34 juju-e4d256-prod-github-runner-207 kernel: [77748.603421] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 02:59:34 juju-e4d256-prod-github-runner-207 kernel: [77748.604324] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 02:59:34 juju-e4d256-prod-github-runner-207 kernel: [77748.605277] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 02:59:34 juju-e4d256-prod-github-runner-207 kernel: [77748.606172] ? __seccomp_filter+0x4a/0x4a0 Aug 23 02:59:34 juju-e4d256-prod-github-runner-207 kernel: [77748.606994] ? __fget_files+0x86/0xc0 Aug 23 02:59:34 juju-e4d256-prod-github-runner-207 kernel: [77748.607767] __x64_sys_ioctl+0x95/0xd0 Aug 23 02:59:34 juju-e4d256-prod-github-runner-207 kernel: [77748.608534] do_syscall_64+0x5c/0xc0 Aug 23 02:59:34 juju-e4d256-prod-github-runner-207 kernel: [77748.609268] ? do_futex+0x162/0x1f0 Aug 23 02:59:34 juju-e4d256-prod-github-runner-207 kernel: [77748.609996] ? __x64_sys_futex+0x78/0x1e0 Aug 23 02:59:34 juju-e4d256-prod-github-runner-207 kernel: [77748.610746] ? __secure_computing+0xa9/0x120 Aug 23 02:59:34 juju-e4d256-prod-github-runner-207 kernel: [77748.611525] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 02:59:34 juju-e4d256-prod-github-runner-207 kernel: [77748.612390] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:59:34 juju-e4d256-prod-github-runner-207 kernel: [77748.613203] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:59:34 juju-e4d256-prod-github-runner-207 kernel: [77748.614099] ? do_syscall_64+0x69/0xc0 Aug 23 02:59:34 juju-e4d256-prod-github-runner-207 kernel: [77748.614821] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:59:34 juju-e4d256-prod-github-runner-207 kernel: [77748.615771] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:59:34 juju-e4d256-prod-github-runner-207 kernel: [77748.616561] ? do_syscall_64+0x69/0xc0 Aug 23 02:59:34 juju-e4d256-prod-github-runner-207 kernel: [77748.617266] ? do_syscall_64+0x69/0xc0 Aug 23 02:59:34 juju-e4d256-prod-github-runner-207 kernel: [77748.617983] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 02:59:34 juju-e4d256-prod-github-runner-207 kernel: [77748.618783] RIP: 0033:0x7faa5d0edaff Aug 23 02:59:34 juju-e4d256-prod-github-runner-207 kernel: [77748.619509] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 02:59:34 juju-e4d256-prod-github-runner-207 kernel: [77748.621848] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 02:59:34 juju-e4d256-prod-github-runner-207 kernel: [77748.622897] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 02:59:34 juju-e4d256-prod-github-runner-207 kernel: [77748.623915] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 02:59:34 juju-e4d256-prod-github-runner-207 kernel: [77748.624932] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 02:59:34 juju-e4d256-prod-github-runner-207 kernel: [77748.625972] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 02:59:34 juju-e4d256-prod-github-runner-207 kernel: [77748.626990] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 02:59:34 juju-e4d256-prod-github-runner-207 kernel: [77748.628018] Aug 23 02:59:48 juju-e4d256-prod-github-runner-207 kernel: [77762.372705] rcu: INFO: rcu_sched self-detected stall on CPU Aug 23 02:59:48 juju-e4d256-prod-github-runner-207 kernel: [77762.373691] rcu: 1-....: (19350359 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=9355860 Aug 23 02:59:48 juju-e4d256-prod-github-runner-207 kernel: [77762.374817] (t=19411293 jiffies g=23269 q=65240) Aug 23 02:59:48 juju-e4d256-prod-github-runner-207 kernel: [77762.375601] NMI backtrace for cpu 1 Aug 23 02:59:48 juju-e4d256-prod-github-runner-207 kernel: [77762.376314] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 02:59:48 juju-e4d256-prod-github-runner-207 kernel: [77762.377424] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 02:59:48 juju-e4d256-prod-github-runner-207 kernel: [77762.378493] Call Trace: Aug 23 02:59:48 juju-e4d256-prod-github-runner-207 kernel: [77762.379171] Aug 23 02:59:48 juju-e4d256-prod-github-runner-207 kernel: [77762.379814] show_stack+0x52/0x5c Aug 23 02:59:48 juju-e4d256-prod-github-runner-207 kernel: [77762.380542] dump_stack_lvl+0x4a/0x63 Aug 23 02:59:48 juju-e4d256-prod-github-runner-207 kernel: [77762.381285] dump_stack+0x10/0x16 Aug 23 02:59:48 juju-e4d256-prod-github-runner-207 kernel: [77762.382014] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 23 02:59:48 juju-e4d256-prod-github-runner-207 kernel: [77762.382976] ? lapic_can_unplug_cpu+0x90/0x90 Aug 23 02:59:48 juju-e4d256-prod-github-runner-207 kernel: [77762.383754] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 23 02:59:48 juju-e4d256-prod-github-runner-207 kernel: [77762.384571] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 23 02:59:48 juju-e4d256-prod-github-runner-207 kernel: [77762.385394] trigger_single_cpu_backtrace+0x44/0x4f Aug 23 02:59:48 juju-e4d256-prod-github-runner-207 kernel: [77762.386215] rcu_dump_cpu_stacks+0x102/0x149 Aug 23 02:59:48 juju-e4d256-prod-github-runner-207 kernel: [77762.386985] print_cpu_stall.cold+0x2f/0xe2 Aug 23 02:59:48 juju-e4d256-prod-github-runner-207 kernel: [77762.387748] ? timekeeping_update+0xf7/0x150 Aug 23 02:59:48 juju-e4d256-prod-github-runner-207 kernel: [77762.388515] check_cpu_stall+0x109/0x270 Aug 23 02:59:48 juju-e4d256-prod-github-runner-207 kernel: [77762.389266] rcu_sched_clock_irq+0x9a/0x250 Aug 23 02:59:48 juju-e4d256-prod-github-runner-207 kernel: [77762.390037] update_process_times+0x94/0xd0 Aug 23 02:59:48 juju-e4d256-prod-github-runner-207 kernel: [77762.390797] tick_sched_handle+0x29/0x70 Aug 23 02:59:48 juju-e4d256-prod-github-runner-207 kernel: [77762.391541] tick_sched_timer+0x8c/0xc0 Aug 23 02:59:48 juju-e4d256-prod-github-runner-207 kernel: [77762.392278] ? tick_nohz_handler+0xb0/0xb0 Aug 23 02:59:48 juju-e4d256-prod-github-runner-207 kernel: [77762.393030] __hrtimer_run_queues+0x107/0x230 Aug 23 02:59:48 juju-e4d256-prod-github-runner-207 kernel: [77762.393808] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 02:59:48 juju-e4d256-prod-github-runner-207 kernel: [77762.394581] hrtimer_interrupt+0x101/0x220 Aug 23 02:59:48 juju-e4d256-prod-github-runner-207 kernel: [77762.395431] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 02:59:48 juju-e4d256-prod-github-runner-207 kernel: [77762.396241] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 02:59:48 juju-e4d256-prod-github-runner-207 kernel: [77762.397038] Aug 23 02:59:48 juju-e4d256-prod-github-runner-207 kernel: [77762.397678] Aug 23 02:59:48 juju-e4d256-prod-github-runner-207 kernel: [77762.398304] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 02:59:48 juju-e4d256-prod-github-runner-207 kernel: [77762.399125] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 02:59:48 juju-e4d256-prod-github-runner-207 kernel: [77762.400001] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 02:59:48 juju-e4d256-prod-github-runner-207 kernel: [77762.402214] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 02:59:48 juju-e4d256-prod-github-runner-207 kernel: [77762.403087] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 02:59:48 juju-e4d256-prod-github-runner-207 kernel: [77762.404084] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 02:59:48 juju-e4d256-prod-github-runner-207 kernel: [77762.405064] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 02:59:48 juju-e4d256-prod-github-runner-207 kernel: [77762.406037] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 02:59:48 juju-e4d256-prod-github-runner-207 kernel: [77762.406992] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 02:59:48 juju-e4d256-prod-github-runner-207 kernel: [77762.407948] ? _raw_spin_lock+0x22/0x30 Aug 23 02:59:48 juju-e4d256-prod-github-runner-207 kernel: [77762.408705] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 02:59:48 juju-e4d256-prod-github-runner-207 kernel: [77762.409551] direct_page_fault+0x206/0x310 [kvm] Aug 23 02:59:48 juju-e4d256-prod-github-runner-207 kernel: [77762.410398] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 02:59:48 juju-e4d256-prod-github-runner-207 kernel: [77762.411229] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 02:59:48 juju-e4d256-prod-github-runner-207 kernel: [77762.412059] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 02:59:48 juju-e4d256-prod-github-runner-207 kernel: [77762.412864] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 02:59:48 juju-e4d256-prod-github-runner-207 kernel: [77762.413654] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 02:59:48 juju-e4d256-prod-github-runner-207 kernel: [77762.414475] handle_exit+0x98/0x230 [kvm_amd] Aug 23 02:59:48 juju-e4d256-prod-github-runner-207 kernel: [77762.415251] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 02:59:48 juju-e4d256-prod-github-runner-207 kernel: [77762.416038] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 02:59:48 juju-e4d256-prod-github-runner-207 kernel: [77762.416862] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 02:59:48 juju-e4d256-prod-github-runner-207 kernel: [77762.417661] vcpu_run+0x62/0x2c0 [kvm] Aug 23 02:59:48 juju-e4d256-prod-github-runner-207 kernel: [77762.418382] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 02:59:48 juju-e4d256-prod-github-runner-207 kernel: [77762.419116] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 02:59:48 juju-e4d256-prod-github-runner-207 kernel: [77762.419914] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 02:59:48 juju-e4d256-prod-github-runner-207 kernel: [77762.420672] ? __seccomp_filter+0x4a/0x4a0 Aug 23 02:59:48 juju-e4d256-prod-github-runner-207 kernel: [77762.421389] ? __fget_files+0x86/0xc0 Aug 23 02:59:48 juju-e4d256-prod-github-runner-207 kernel: [77762.422087] __x64_sys_ioctl+0x95/0xd0 Aug 23 02:59:48 juju-e4d256-prod-github-runner-207 kernel: [77762.422779] do_syscall_64+0x5c/0xc0 Aug 23 02:59:48 juju-e4d256-prod-github-runner-207 kernel: [77762.423459] ? do_futex+0x162/0x1f0 Aug 23 02:59:48 juju-e4d256-prod-github-runner-207 kernel: [77762.424133] ? __x64_sys_futex+0x78/0x1e0 Aug 23 02:59:48 juju-e4d256-prod-github-runner-207 kernel: [77762.424842] ? __secure_computing+0xa9/0x120 Aug 23 02:59:48 juju-e4d256-prod-github-runner-207 kernel: [77762.425558] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 02:59:48 juju-e4d256-prod-github-runner-207 kernel: [77762.426358] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:59:48 juju-e4d256-prod-github-runner-207 kernel: [77762.427114] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:59:48 juju-e4d256-prod-github-runner-207 kernel: [77762.427864] ? do_syscall_64+0x69/0xc0 Aug 23 02:59:48 juju-e4d256-prod-github-runner-207 kernel: [77762.428556] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 02:59:48 juju-e4d256-prod-github-runner-207 kernel: [77762.429308] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 02:59:48 juju-e4d256-prod-github-runner-207 kernel: [77762.430077] ? do_syscall_64+0x69/0xc0 Aug 23 02:59:48 juju-e4d256-prod-github-runner-207 kernel: [77762.430768] ? do_syscall_64+0x69/0xc0 Aug 23 02:59:48 juju-e4d256-prod-github-runner-207 kernel: [77762.431452] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 02:59:48 juju-e4d256-prod-github-runner-207 kernel: [77762.432220] RIP: 0033:0x7faa5d0edaff Aug 23 02:59:48 juju-e4d256-prod-github-runner-207 kernel: [77762.432935] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 02:59:48 juju-e4d256-prod-github-runner-207 kernel: [77762.435042] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 02:59:48 juju-e4d256-prod-github-runner-207 kernel: [77762.436001] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 02:59:48 juju-e4d256-prod-github-runner-207 kernel: [77762.436948] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 02:59:48 juju-e4d256-prod-github-runner-207 kernel: [77762.437901] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 02:59:48 juju-e4d256-prod-github-runner-207 kernel: [77762.438842] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 02:59:48 juju-e4d256-prod-github-runner-207 kernel: [77762.439770] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 02:59:48 juju-e4d256-prod-github-runner-207 kernel: [77762.440681] Aug 23 03:00:14 juju-e4d256-prod-github-runner-207 kernel: [77788.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 72338s! [qemu-system-x86:6715] Aug 23 03:00:14 juju-e4d256-prod-github-runner-207 kernel: [77788.543204] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 03:00:14 juju-e4d256-prod-github-runner-207 kernel: [77788.543290] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 03:00:14 juju-e4d256-prod-github-runner-207 kernel: [77788.556028] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 03:00:14 juju-e4d256-prod-github-runner-207 kernel: [77788.557288] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 03:00:14 juju-e4d256-prod-github-runner-207 kernel: [77788.558530] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 03:00:14 juju-e4d256-prod-github-runner-207 kernel: [77788.559653] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 03:00:14 juju-e4d256-prod-github-runner-207 kernel: [77788.562467] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 03:00:14 juju-e4d256-prod-github-runner-207 kernel: [77788.563577] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 03:00:14 juju-e4d256-prod-github-runner-207 kernel: [77788.564759] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 03:00:14 juju-e4d256-prod-github-runner-207 kernel: [77788.565939] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 03:00:14 juju-e4d256-prod-github-runner-207 kernel: [77788.567155] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 03:00:14 juju-e4d256-prod-github-runner-207 kernel: [77788.568374] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 03:00:14 juju-e4d256-prod-github-runner-207 kernel: [77788.569588] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 03:00:14 juju-e4d256-prod-github-runner-207 kernel: [77788.570862] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 03:00:14 juju-e4d256-prod-github-runner-207 kernel: [77788.572148] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 03:00:14 juju-e4d256-prod-github-runner-207 kernel: [77788.573350] Call Trace: Aug 23 03:00:14 juju-e4d256-prod-github-runner-207 kernel: [77788.574262] Aug 23 03:00:14 juju-e4d256-prod-github-runner-207 kernel: [77788.575146] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 03:00:14 juju-e4d256-prod-github-runner-207 kernel: [77788.576175] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 03:00:14 juju-e4d256-prod-github-runner-207 kernel: [77788.577216] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 03:00:14 juju-e4d256-prod-github-runner-207 kernel: [77788.578297] ? show_regs.part.0+0x23/0x29 Aug 23 03:00:14 juju-e4d256-prod-github-runner-207 kernel: [77788.579294] ? show_regs.cold+0x8/0xd Aug 23 03:00:14 juju-e4d256-prod-github-runner-207 kernel: [77788.580264] ? watchdog_timer_fn+0x1be/0x220 Aug 23 03:00:14 juju-e4d256-prod-github-runner-207 kernel: [77788.581270] ? lockup_detector_update_enable+0x60/0x60 Aug 23 03:00:14 juju-e4d256-prod-github-runner-207 kernel: [77788.582353] ? __hrtimer_run_queues+0x107/0x230 Aug 23 03:00:14 juju-e4d256-prod-github-runner-207 kernel: [77788.583386] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 03:00:14 juju-e4d256-prod-github-runner-207 kernel: [77788.584409] ? hrtimer_interrupt+0x101/0x220 Aug 23 03:00:14 juju-e4d256-prod-github-runner-207 kernel: [77788.585552] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 03:00:14 juju-e4d256-prod-github-runner-207 kernel: [77788.586619] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 03:00:14 juju-e4d256-prod-github-runner-207 kernel: [77788.587668] Aug 23 03:00:14 juju-e4d256-prod-github-runner-207 kernel: [77788.588520] Aug 23 03:00:14 juju-e4d256-prod-github-runner-207 kernel: [77788.589367] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 03:00:14 juju-e4d256-prod-github-runner-207 kernel: [77788.590404] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 03:00:14 juju-e4d256-prod-github-runner-207 kernel: [77788.591441] ? _raw_spin_lock+0x22/0x30 Aug 23 03:00:14 juju-e4d256-prod-github-runner-207 kernel: [77788.592385] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 03:00:14 juju-e4d256-prod-github-runner-207 kernel: [77788.593409] direct_page_fault+0x206/0x310 [kvm] Aug 23 03:00:14 juju-e4d256-prod-github-runner-207 kernel: [77788.594433] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 03:00:14 juju-e4d256-prod-github-runner-207 kernel: [77788.595440] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 03:00:14 juju-e4d256-prod-github-runner-207 kernel: [77788.596439] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 03:00:14 juju-e4d256-prod-github-runner-207 kernel: [77788.597417] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 03:00:14 juju-e4d256-prod-github-runner-207 kernel: [77788.598361] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 03:00:14 juju-e4d256-prod-github-runner-207 kernel: [77788.599338] handle_exit+0x98/0x230 [kvm_amd] Aug 23 03:00:14 juju-e4d256-prod-github-runner-207 kernel: [77788.600230] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 03:00:14 juju-e4d256-prod-github-runner-207 kernel: [77788.601142] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 03:00:14 juju-e4d256-prod-github-runner-207 kernel: [77788.602070] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 03:00:14 juju-e4d256-prod-github-runner-207 kernel: [77788.602972] vcpu_run+0x62/0x2c0 [kvm] Aug 23 03:00:14 juju-e4d256-prod-github-runner-207 kernel: [77788.603783] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 03:00:14 juju-e4d256-prod-github-runner-207 kernel: [77788.604590] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 03:00:14 juju-e4d256-prod-github-runner-207 kernel: [77788.605453] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 03:00:14 juju-e4d256-prod-github-runner-207 kernel: [77788.606293] ? __seccomp_filter+0x4a/0x4a0 Aug 23 03:00:14 juju-e4d256-prod-github-runner-207 kernel: [77788.607041] ? __fget_files+0x86/0xc0 Aug 23 03:00:14 juju-e4d256-prod-github-runner-207 kernel: [77788.607745] __x64_sys_ioctl+0x95/0xd0 Aug 23 03:00:14 juju-e4d256-prod-github-runner-207 kernel: [77788.608437] do_syscall_64+0x5c/0xc0 Aug 23 03:00:14 juju-e4d256-prod-github-runner-207 kernel: [77788.609101] ? do_futex+0x162/0x1f0 Aug 23 03:00:14 juju-e4d256-prod-github-runner-207 kernel: [77788.609774] ? __x64_sys_futex+0x78/0x1e0 Aug 23 03:00:14 juju-e4d256-prod-github-runner-207 kernel: [77788.610448] ? __secure_computing+0xa9/0x120 Aug 23 03:00:14 juju-e4d256-prod-github-runner-207 kernel: [77788.611144] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 03:00:14 juju-e4d256-prod-github-runner-207 kernel: [77788.611947] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 03:00:14 juju-e4d256-prod-github-runner-207 kernel: [77788.612675] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 03:00:14 juju-e4d256-prod-github-runner-207 kernel: [77788.613406] ? do_syscall_64+0x69/0xc0 Aug 23 03:00:14 juju-e4d256-prod-github-runner-207 kernel: [77788.614052] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 03:00:14 juju-e4d256-prod-github-runner-207 kernel: [77788.614757] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 03:00:14 juju-e4d256-prod-github-runner-207 kernel: [77788.615453] ? do_syscall_64+0x69/0xc0 Aug 23 03:00:14 juju-e4d256-prod-github-runner-207 kernel: [77788.616078] ? do_syscall_64+0x69/0xc0 Aug 23 03:00:14 juju-e4d256-prod-github-runner-207 kernel: [77788.616700] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 03:00:14 juju-e4d256-prod-github-runner-207 kernel: [77788.617422] RIP: 0033:0x7faa5d0edaff Aug 23 03:00:14 juju-e4d256-prod-github-runner-207 kernel: [77788.618048] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 03:00:14 juju-e4d256-prod-github-runner-207 kernel: [77788.620030] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 03:00:14 juju-e4d256-prod-github-runner-207 kernel: [77788.620940] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 03:00:14 juju-e4d256-prod-github-runner-207 kernel: [77788.621853] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 03:00:14 juju-e4d256-prod-github-runner-207 kernel: [77788.622742] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 03:00:14 juju-e4d256-prod-github-runner-207 kernel: [77788.623718] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 03:00:14 juju-e4d256-prod-github-runner-207 kernel: [77788.624661] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 03:00:14 juju-e4d256-prod-github-runner-207 kernel: [77788.625568] Aug 23 03:00:42 juju-e4d256-prod-github-runner-207 kernel: [77816.541982] watchdog: BUG: soft lockup - CPU#1 stuck for 72364s! [qemu-system-x86:6715] Aug 23 03:00:42 juju-e4d256-prod-github-runner-207 kernel: [77816.543133] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 03:00:42 juju-e4d256-prod-github-runner-207 kernel: [77816.543208] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 03:00:42 juju-e4d256-prod-github-runner-207 kernel: [77816.555440] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 03:00:42 juju-e4d256-prod-github-runner-207 kernel: [77816.556707] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 03:00:42 juju-e4d256-prod-github-runner-207 kernel: [77816.557957] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 03:00:42 juju-e4d256-prod-github-runner-207 kernel: [77816.559024] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 03:00:42 juju-e4d256-prod-github-runner-207 kernel: [77816.561579] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 03:00:42 juju-e4d256-prod-github-runner-207 kernel: [77816.562652] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 03:00:42 juju-e4d256-prod-github-runner-207 kernel: [77816.563818] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 03:00:42 juju-e4d256-prod-github-runner-207 kernel: [77816.565007] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 03:00:42 juju-e4d256-prod-github-runner-207 kernel: [77816.566196] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 03:00:42 juju-e4d256-prod-github-runner-207 kernel: [77816.567366] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 03:00:42 juju-e4d256-prod-github-runner-207 kernel: [77816.568561] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 03:00:42 juju-e4d256-prod-github-runner-207 kernel: [77816.569867] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 03:00:42 juju-e4d256-prod-github-runner-207 kernel: [77816.571164] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 03:00:42 juju-e4d256-prod-github-runner-207 kernel: [77816.572399] Call Trace: Aug 23 03:00:42 juju-e4d256-prod-github-runner-207 kernel: [77816.573410] Aug 23 03:00:42 juju-e4d256-prod-github-runner-207 kernel: [77816.574406] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 03:00:42 juju-e4d256-prod-github-runner-207 kernel: [77816.575444] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 03:00:42 juju-e4d256-prod-github-runner-207 kernel: [77816.576503] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 03:00:42 juju-e4d256-prod-github-runner-207 kernel: [77816.577622] ? show_regs.part.0+0x23/0x29 Aug 23 03:00:42 juju-e4d256-prod-github-runner-207 kernel: [77816.578623] ? show_regs.cold+0x8/0xd Aug 23 03:00:42 juju-e4d256-prod-github-runner-207 kernel: [77816.579595] ? watchdog_timer_fn+0x1be/0x220 Aug 23 03:00:42 juju-e4d256-prod-github-runner-207 kernel: [77816.580606] ? lockup_detector_update_enable+0x60/0x60 Aug 23 03:00:42 juju-e4d256-prod-github-runner-207 kernel: [77816.581694] ? __hrtimer_run_queues+0x107/0x230 Aug 23 03:00:42 juju-e4d256-prod-github-runner-207 kernel: [77816.582726] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 03:00:42 juju-e4d256-prod-github-runner-207 kernel: [77816.583752] ? hrtimer_interrupt+0x101/0x220 Aug 23 03:00:42 juju-e4d256-prod-github-runner-207 kernel: [77816.584771] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 03:00:42 juju-e4d256-prod-github-runner-207 kernel: [77816.585853] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 03:00:42 juju-e4d256-prod-github-runner-207 kernel: [77816.586902] Aug 23 03:00:42 juju-e4d256-prod-github-runner-207 kernel: [77816.587754] Aug 23 03:00:42 juju-e4d256-prod-github-runner-207 kernel: [77816.588598] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 03:00:42 juju-e4d256-prod-github-runner-207 kernel: [77816.589646] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 03:00:42 juju-e4d256-prod-github-runner-207 kernel: [77816.590687] ? _raw_spin_lock+0x22/0x30 Aug 23 03:00:42 juju-e4d256-prod-github-runner-207 kernel: [77816.591638] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 03:00:42 juju-e4d256-prod-github-runner-207 kernel: [77816.592703] direct_page_fault+0x206/0x310 [kvm] Aug 23 03:00:42 juju-e4d256-prod-github-runner-207 kernel: [77816.593769] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 03:00:42 juju-e4d256-prod-github-runner-207 kernel: [77816.594780] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 03:00:42 juju-e4d256-prod-github-runner-207 kernel: [77816.595779] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 03:00:42 juju-e4d256-prod-github-runner-207 kernel: [77816.596755] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 03:00:42 juju-e4d256-prod-github-runner-207 kernel: [77816.597731] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 03:00:42 juju-e4d256-prod-github-runner-207 kernel: [77816.598708] handle_exit+0x98/0x230 [kvm_amd] Aug 23 03:00:42 juju-e4d256-prod-github-runner-207 kernel: [77816.599604] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 03:00:42 juju-e4d256-prod-github-runner-207 kernel: [77816.600587] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 03:00:42 juju-e4d256-prod-github-runner-207 kernel: [77816.601703] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 03:00:42 juju-e4d256-prod-github-runner-207 kernel: [77816.602627] vcpu_run+0x62/0x2c0 [kvm] Aug 23 03:00:42 juju-e4d256-prod-github-runner-207 kernel: [77816.603448] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 03:00:42 juju-e4d256-prod-github-runner-207 kernel: [77816.604260] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 03:00:42 juju-e4d256-prod-github-runner-207 kernel: [77816.605129] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 03:00:42 juju-e4d256-prod-github-runner-207 kernel: [77816.605934] ? __seccomp_filter+0x4a/0x4a0 Aug 23 03:00:42 juju-e4d256-prod-github-runner-207 kernel: [77816.606678] ? __fget_files+0x86/0xc0 Aug 23 03:00:42 juju-e4d256-prod-github-runner-207 kernel: [77816.607384] __x64_sys_ioctl+0x95/0xd0 Aug 23 03:00:42 juju-e4d256-prod-github-runner-207 kernel: [77816.608079] do_syscall_64+0x5c/0xc0 Aug 23 03:00:42 juju-e4d256-prod-github-runner-207 kernel: [77816.608751] ? do_futex+0x162/0x1f0 Aug 23 03:00:42 juju-e4d256-prod-github-runner-207 kernel: [77816.609414] ? __x64_sys_futex+0x78/0x1e0 Aug 23 03:00:42 juju-e4d256-prod-github-runner-207 kernel: [77816.610089] ? __secure_computing+0xa9/0x120 Aug 23 03:00:42 juju-e4d256-prod-github-runner-207 kernel: [77816.610780] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 03:00:42 juju-e4d256-prod-github-runner-207 kernel: [77816.611547] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 03:00:42 juju-e4d256-prod-github-runner-207 kernel: [77816.612270] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 03:00:42 juju-e4d256-prod-github-runner-207 kernel: [77816.613003] ? do_syscall_64+0x69/0xc0 Aug 23 03:00:42 juju-e4d256-prod-github-runner-207 kernel: [77816.613652] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 03:00:42 juju-e4d256-prod-github-runner-207 kernel: [77816.614358] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 03:00:42 juju-e4d256-prod-github-runner-207 kernel: [77816.615057] ? do_syscall_64+0x69/0xc0 Aug 23 03:00:42 juju-e4d256-prod-github-runner-207 kernel: [77816.615688] ? do_syscall_64+0x69/0xc0 Aug 23 03:00:42 juju-e4d256-prod-github-runner-207 kernel: [77816.616311] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 03:00:42 juju-e4d256-prod-github-runner-207 kernel: [77816.617044] RIP: 0033:0x7faa5d0edaff Aug 23 03:00:42 juju-e4d256-prod-github-runner-207 kernel: [77816.617673] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 03:00:42 juju-e4d256-prod-github-runner-207 kernel: [77816.619669] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 03:00:42 juju-e4d256-prod-github-runner-207 kernel: [77816.620585] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 03:00:42 juju-e4d256-prod-github-runner-207 kernel: [77816.621493] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 03:00:42 juju-e4d256-prod-github-runner-207 kernel: [77816.622384] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 03:00:42 juju-e4d256-prod-github-runner-207 kernel: [77816.623327] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 03:00:42 juju-e4d256-prod-github-runner-207 kernel: [77816.624241] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 03:00:42 juju-e4d256-prod-github-runner-207 kernel: [77816.625154] Aug 23 03:01:10 juju-e4d256-prod-github-runner-207 kernel: [77844.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 72390s! [qemu-system-x86:6715] Aug 23 03:01:10 juju-e4d256-prod-github-runner-207 kernel: [77844.543895] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 03:01:10 juju-e4d256-prod-github-runner-207 kernel: [77844.544170] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 03:01:10 juju-e4d256-prod-github-runner-207 kernel: [77844.556517] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 03:01:10 juju-e4d256-prod-github-runner-207 kernel: [77844.557836] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 03:01:10 juju-e4d256-prod-github-runner-207 kernel: [77844.559108] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 03:01:10 juju-e4d256-prod-github-runner-207 kernel: [77844.560176] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 03:01:10 juju-e4d256-prod-github-runner-207 kernel: [77844.562763] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 03:01:10 juju-e4d256-prod-github-runner-207 kernel: [77844.563836] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 03:01:10 juju-e4d256-prod-github-runner-207 kernel: [77844.565060] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 03:01:10 juju-e4d256-prod-github-runner-207 kernel: [77844.566248] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 03:01:10 juju-e4d256-prod-github-runner-207 kernel: [77844.567433] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 03:01:10 juju-e4d256-prod-github-runner-207 kernel: [77844.568615] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 03:01:10 juju-e4d256-prod-github-runner-207 kernel: [77844.569847] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 03:01:10 juju-e4d256-prod-github-runner-207 kernel: [77844.571092] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 03:01:10 juju-e4d256-prod-github-runner-207 kernel: [77844.572201] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 03:01:10 juju-e4d256-prod-github-runner-207 kernel: [77844.573415] Call Trace: Aug 23 03:01:10 juju-e4d256-prod-github-runner-207 kernel: [77844.574348] Aug 23 03:01:10 juju-e4d256-prod-github-runner-207 kernel: [77844.575266] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 03:01:10 juju-e4d256-prod-github-runner-207 kernel: [77844.576306] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 03:01:10 juju-e4d256-prod-github-runner-207 kernel: [77844.577353] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 03:01:10 juju-e4d256-prod-github-runner-207 kernel: [77844.578462] ? show_regs.part.0+0x23/0x29 Aug 23 03:01:10 juju-e4d256-prod-github-runner-207 kernel: [77844.579478] ? show_regs.cold+0x8/0xd Aug 23 03:01:10 juju-e4d256-prod-github-runner-207 kernel: [77844.580503] ? watchdog_timer_fn+0x1be/0x220 Aug 23 03:01:10 juju-e4d256-prod-github-runner-207 kernel: [77844.581552] ? lockup_detector_update_enable+0x60/0x60 Aug 23 03:01:10 juju-e4d256-prod-github-runner-207 kernel: [77844.582633] ? __hrtimer_run_queues+0x107/0x230 Aug 23 03:01:10 juju-e4d256-prod-github-runner-207 kernel: [77844.583684] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 03:01:10 juju-e4d256-prod-github-runner-207 kernel: [77844.584757] ? hrtimer_interrupt+0x101/0x220 Aug 23 03:01:10 juju-e4d256-prod-github-runner-207 kernel: [77844.585819] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 03:01:10 juju-e4d256-prod-github-runner-207 kernel: [77844.586890] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 03:01:10 juju-e4d256-prod-github-runner-207 kernel: [77844.587938] Aug 23 03:01:10 juju-e4d256-prod-github-runner-207 kernel: [77844.588818] Aug 23 03:01:10 juju-e4d256-prod-github-runner-207 kernel: [77844.589679] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 03:01:10 juju-e4d256-prod-github-runner-207 kernel: [77844.590736] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 03:01:10 juju-e4d256-prod-github-runner-207 kernel: [77844.591789] ? _raw_spin_lock+0x22/0x30 Aug 23 03:01:10 juju-e4d256-prod-github-runner-207 kernel: [77844.592770] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 03:01:10 juju-e4d256-prod-github-runner-207 kernel: [77844.593808] direct_page_fault+0x206/0x310 [kvm] Aug 23 03:01:10 juju-e4d256-prod-github-runner-207 kernel: [77844.594871] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 03:01:10 juju-e4d256-prod-github-runner-207 kernel: [77844.595910] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 03:01:10 juju-e4d256-prod-github-runner-207 kernel: [77844.596940] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 03:01:10 juju-e4d256-prod-github-runner-207 kernel: [77844.597950] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 03:01:10 juju-e4d256-prod-github-runner-207 kernel: [77844.598901] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 03:01:10 juju-e4d256-prod-github-runner-207 kernel: [77844.599893] handle_exit+0x98/0x230 [kvm_amd] Aug 23 03:01:10 juju-e4d256-prod-github-runner-207 kernel: [77844.600830] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 03:01:10 juju-e4d256-prod-github-runner-207 kernel: [77844.601895] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 03:01:10 juju-e4d256-prod-github-runner-207 kernel: [77844.602827] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 03:01:10 juju-e4d256-prod-github-runner-207 kernel: [77844.603736] vcpu_run+0x62/0x2c0 [kvm] Aug 23 03:01:10 juju-e4d256-prod-github-runner-207 kernel: [77844.604562] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 03:01:10 juju-e4d256-prod-github-runner-207 kernel: [77844.605398] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 03:01:10 juju-e4d256-prod-github-runner-207 kernel: [77844.606341] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 03:01:10 juju-e4d256-prod-github-runner-207 kernel: [77844.607162] ? __seccomp_filter+0x4a/0x4a0 Aug 23 03:01:10 juju-e4d256-prod-github-runner-207 kernel: [77844.607916] ? __fget_files+0x86/0xc0 Aug 23 03:01:10 juju-e4d256-prod-github-runner-207 kernel: [77844.608627] __x64_sys_ioctl+0x95/0xd0 Aug 23 03:01:10 juju-e4d256-prod-github-runner-207 kernel: [77844.609336] do_syscall_64+0x5c/0xc0 Aug 23 03:01:10 juju-e4d256-prod-github-runner-207 kernel: [77844.610031] ? do_futex+0x162/0x1f0 Aug 23 03:01:10 juju-e4d256-prod-github-runner-207 kernel: [77844.610696] ? __x64_sys_futex+0x78/0x1e0 Aug 23 03:01:10 juju-e4d256-prod-github-runner-207 kernel: [77844.611411] ? __secure_computing+0xa9/0x120 Aug 23 03:01:10 juju-e4d256-prod-github-runner-207 kernel: [77844.612139] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 03:01:10 juju-e4d256-prod-github-runner-207 kernel: [77844.612983] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 03:01:10 juju-e4d256-prod-github-runner-207 kernel: [77844.613801] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 03:01:10 juju-e4d256-prod-github-runner-207 kernel: [77844.614588] ? do_syscall_64+0x69/0xc0 Aug 23 03:01:10 juju-e4d256-prod-github-runner-207 kernel: [77844.615246] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 03:01:10 juju-e4d256-prod-github-runner-207 kernel: [77844.616018] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 03:01:10 juju-e4d256-prod-github-runner-207 kernel: [77844.616749] ? do_syscall_64+0x69/0xc0 Aug 23 03:01:10 juju-e4d256-prod-github-runner-207 kernel: [77844.617391] ? do_syscall_64+0x69/0xc0 Aug 23 03:01:10 juju-e4d256-prod-github-runner-207 kernel: [77844.618020] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 03:01:10 juju-e4d256-prod-github-runner-207 kernel: [77844.618744] RIP: 0033:0x7faa5d0edaff Aug 23 03:01:10 juju-e4d256-prod-github-runner-207 kernel: [77844.619416] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 03:01:10 juju-e4d256-prod-github-runner-207 kernel: [77844.621548] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 03:01:10 juju-e4d256-prod-github-runner-207 kernel: [77844.622557] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 03:01:10 juju-e4d256-prod-github-runner-207 kernel: [77844.623489] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 03:01:10 juju-e4d256-prod-github-runner-207 kernel: [77844.624395] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 03:01:10 juju-e4d256-prod-github-runner-207 kernel: [77844.625417] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 03:01:10 juju-e4d256-prod-github-runner-207 kernel: [77844.626332] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 03:01:10 juju-e4d256-prod-github-runner-207 kernel: [77844.627237] Aug 23 03:01:38 juju-e4d256-prod-github-runner-207 kernel: [77872.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 72416s! [qemu-system-x86:6715] Aug 23 03:01:38 juju-e4d256-prod-github-runner-207 kernel: [77872.543076] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 03:01:38 juju-e4d256-prod-github-runner-207 kernel: [77872.543147] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 03:01:38 juju-e4d256-prod-github-runner-207 kernel: [77872.555214] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 03:01:38 juju-e4d256-prod-github-runner-207 kernel: [77872.556521] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 03:01:38 juju-e4d256-prod-github-runner-207 kernel: [77872.557747] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 03:01:38 juju-e4d256-prod-github-runner-207 kernel: [77872.558821] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 03:01:38 juju-e4d256-prod-github-runner-207 kernel: [77872.561409] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 03:01:38 juju-e4d256-prod-github-runner-207 kernel: [77872.562452] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 03:01:38 juju-e4d256-prod-github-runner-207 kernel: [77872.563612] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 03:01:38 juju-e4d256-prod-github-runner-207 kernel: [77872.564780] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 03:01:38 juju-e4d256-prod-github-runner-207 kernel: [77872.565941] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 03:01:38 juju-e4d256-prod-github-runner-207 kernel: [77872.567108] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 03:01:38 juju-e4d256-prod-github-runner-207 kernel: [77872.568274] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 03:01:38 juju-e4d256-prod-github-runner-207 kernel: [77872.569521] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 03:01:38 juju-e4d256-prod-github-runner-207 kernel: [77872.570614] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 03:01:38 juju-e4d256-prod-github-runner-207 kernel: [77872.571803] Call Trace: Aug 23 03:01:38 juju-e4d256-prod-github-runner-207 kernel: [77872.572817] Aug 23 03:01:38 juju-e4d256-prod-github-runner-207 kernel: [77872.573727] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 03:01:38 juju-e4d256-prod-github-runner-207 kernel: [77872.574759] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 03:01:38 juju-e4d256-prod-github-runner-207 kernel: [77872.575782] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 03:01:38 juju-e4d256-prod-github-runner-207 kernel: [77872.576897] ? show_regs.part.0+0x23/0x29 Aug 23 03:01:38 juju-e4d256-prod-github-runner-207 kernel: [77872.577898] ? show_regs.cold+0x8/0xd Aug 23 03:01:38 juju-e4d256-prod-github-runner-207 kernel: [77872.578870] ? watchdog_timer_fn+0x1be/0x220 Aug 23 03:01:38 juju-e4d256-prod-github-runner-207 kernel: [77872.579878] ? lockup_detector_update_enable+0x60/0x60 Aug 23 03:01:38 juju-e4d256-prod-github-runner-207 kernel: [77872.580970] ? __hrtimer_run_queues+0x107/0x230 Aug 23 03:01:38 juju-e4d256-prod-github-runner-207 kernel: [77872.582005] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 03:01:38 juju-e4d256-prod-github-runner-207 kernel: [77872.583032] ? hrtimer_interrupt+0x101/0x220 Aug 23 03:01:38 juju-e4d256-prod-github-runner-207 kernel: [77872.584049] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 03:01:38 juju-e4d256-prod-github-runner-207 kernel: [77872.585141] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 03:01:38 juju-e4d256-prod-github-runner-207 kernel: [77872.586189] Aug 23 03:01:38 juju-e4d256-prod-github-runner-207 kernel: [77872.587040] Aug 23 03:01:38 juju-e4d256-prod-github-runner-207 kernel: [77872.587903] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 03:01:38 juju-e4d256-prod-github-runner-207 kernel: [77872.589016] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 03:01:38 juju-e4d256-prod-github-runner-207 kernel: [77872.590063] ? _raw_spin_lock+0x22/0x30 Aug 23 03:01:38 juju-e4d256-prod-github-runner-207 kernel: [77872.591563] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 03:01:38 juju-e4d256-prod-github-runner-207 kernel: [77872.594602] direct_page_fault+0x206/0x310 [kvm] Aug 23 03:01:38 juju-e4d256-prod-github-runner-207 kernel: [77872.595707] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 03:01:38 juju-e4d256-prod-github-runner-207 kernel: [77872.596747] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 03:01:38 juju-e4d256-prod-github-runner-207 kernel: [77872.597746] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 03:01:38 juju-e4d256-prod-github-runner-207 kernel: [77872.598713] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 03:01:38 juju-e4d256-prod-github-runner-207 kernel: [77872.599654] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 03:01:38 juju-e4d256-prod-github-runner-207 kernel: [77872.600656] handle_exit+0x98/0x230 [kvm_amd] Aug 23 03:01:38 juju-e4d256-prod-github-runner-207 kernel: [77872.601571] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 03:01:38 juju-e4d256-prod-github-runner-207 kernel: [77872.602489] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 03:01:38 juju-e4d256-prod-github-runner-207 kernel: [77872.603417] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 03:01:38 juju-e4d256-prod-github-runner-207 kernel: [77872.604333] vcpu_run+0x62/0x2c0 [kvm] Aug 23 03:01:38 juju-e4d256-prod-github-runner-207 kernel: [77872.605177] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 03:01:38 juju-e4d256-prod-github-runner-207 kernel: [77872.605985] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 03:01:38 juju-e4d256-prod-github-runner-207 kernel: [77872.606842] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 03:01:38 juju-e4d256-prod-github-runner-207 kernel: [77872.607644] ? __seccomp_filter+0x4a/0x4a0 Aug 23 03:01:38 juju-e4d256-prod-github-runner-207 kernel: [77872.608427] ? __fget_files+0x86/0xc0 Aug 23 03:01:38 juju-e4d256-prod-github-runner-207 kernel: [77872.609131] __x64_sys_ioctl+0x95/0xd0 Aug 23 03:01:38 juju-e4d256-prod-github-runner-207 kernel: [77872.609824] do_syscall_64+0x5c/0xc0 Aug 23 03:01:38 juju-e4d256-prod-github-runner-207 kernel: [77872.610489] ? do_futex+0x162/0x1f0 Aug 23 03:01:38 juju-e4d256-prod-github-runner-207 kernel: [77872.611137] ? __x64_sys_futex+0x78/0x1e0 Aug 23 03:01:38 juju-e4d256-prod-github-runner-207 kernel: [77872.611816] ? __secure_computing+0xa9/0x120 Aug 23 03:01:38 juju-e4d256-prod-github-runner-207 kernel: [77872.612523] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 03:01:38 juju-e4d256-prod-github-runner-207 kernel: [77872.613289] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 03:01:38 juju-e4d256-prod-github-runner-207 kernel: [77872.614008] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 03:01:38 juju-e4d256-prod-github-runner-207 kernel: [77872.614730] ? do_syscall_64+0x69/0xc0 Aug 23 03:01:38 juju-e4d256-prod-github-runner-207 kernel: [77872.615373] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 03:01:38 juju-e4d256-prod-github-runner-207 kernel: [77872.616074] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 03:01:38 juju-e4d256-prod-github-runner-207 kernel: [77872.616782] ? do_syscall_64+0x69/0xc0 Aug 23 03:01:38 juju-e4d256-prod-github-runner-207 kernel: [77872.617419] ? do_syscall_64+0x69/0xc0 Aug 23 03:01:38 juju-e4d256-prod-github-runner-207 kernel: [77872.618076] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 03:01:38 juju-e4d256-prod-github-runner-207 kernel: [77872.618810] RIP: 0033:0x7faa5d0edaff Aug 23 03:01:38 juju-e4d256-prod-github-runner-207 kernel: [77872.619492] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 03:01:38 juju-e4d256-prod-github-runner-207 kernel: [77872.621514] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 03:01:38 juju-e4d256-prod-github-runner-207 kernel: [77872.622430] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 03:01:38 juju-e4d256-prod-github-runner-207 kernel: [77872.623325] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 03:01:38 juju-e4d256-prod-github-runner-207 kernel: [77872.624247] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 03:01:38 juju-e4d256-prod-github-runner-207 kernel: [77872.625218] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 03:01:38 juju-e4d256-prod-github-runner-207 kernel: [77872.626127] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 03:01:38 juju-e4d256-prod-github-runner-207 kernel: [77872.627023] Aug 23 03:02:06 juju-e4d256-prod-github-runner-207 kernel: [77900.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 72442s! [qemu-system-x86:6715] Aug 23 03:02:06 juju-e4d256-prod-github-runner-207 kernel: [77900.543108] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 03:02:06 juju-e4d256-prod-github-runner-207 kernel: [77900.543182] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 03:02:06 juju-e4d256-prod-github-runner-207 kernel: [77900.555654] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 03:02:06 juju-e4d256-prod-github-runner-207 kernel: [77900.556944] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 03:02:06 juju-e4d256-prod-github-runner-207 kernel: [77900.558173] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 03:02:06 juju-e4d256-prod-github-runner-207 kernel: [77900.559235] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 03:02:06 juju-e4d256-prod-github-runner-207 kernel: [77900.561816] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 03:02:06 juju-e4d256-prod-github-runner-207 kernel: [77900.562865] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 03:02:06 juju-e4d256-prod-github-runner-207 kernel: [77900.564047] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 03:02:06 juju-e4d256-prod-github-runner-207 kernel: [77900.565219] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 03:02:06 juju-e4d256-prod-github-runner-207 kernel: [77900.566464] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 03:02:06 juju-e4d256-prod-github-runner-207 kernel: [77900.567765] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 03:02:06 juju-e4d256-prod-github-runner-207 kernel: [77900.569006] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 03:02:06 juju-e4d256-prod-github-runner-207 kernel: [77900.570275] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 03:02:06 juju-e4d256-prod-github-runner-207 kernel: [77900.571383] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 03:02:06 juju-e4d256-prod-github-runner-207 kernel: [77900.572644] Call Trace: Aug 23 03:02:06 juju-e4d256-prod-github-runner-207 kernel: [77900.573573] Aug 23 03:02:06 juju-e4d256-prod-github-runner-207 kernel: [77900.574460] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 03:02:06 juju-e4d256-prod-github-runner-207 kernel: [77900.575506] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 03:02:06 juju-e4d256-prod-github-runner-207 kernel: [77900.576582] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 03:02:06 juju-e4d256-prod-github-runner-207 kernel: [77900.577673] ? show_regs.part.0+0x23/0x29 Aug 23 03:02:06 juju-e4d256-prod-github-runner-207 kernel: [77900.578700] ? show_regs.cold+0x8/0xd Aug 23 03:02:06 juju-e4d256-prod-github-runner-207 kernel: [77900.579690] ? watchdog_timer_fn+0x1be/0x220 Aug 23 03:02:06 juju-e4d256-prod-github-runner-207 kernel: [77900.580746] ? lockup_detector_update_enable+0x60/0x60 Aug 23 03:02:06 juju-e4d256-prod-github-runner-207 kernel: [77900.581885] ? __hrtimer_run_queues+0x107/0x230 Aug 23 03:02:06 juju-e4d256-prod-github-runner-207 kernel: [77900.583012] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 03:02:06 juju-e4d256-prod-github-runner-207 kernel: [77900.584210] ? hrtimer_interrupt+0x101/0x220 Aug 23 03:02:06 juju-e4d256-prod-github-runner-207 kernel: [77900.585279] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 03:02:06 juju-e4d256-prod-github-runner-207 kernel: [77900.586401] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 03:02:06 juju-e4d256-prod-github-runner-207 kernel: [77900.587477] Aug 23 03:02:06 juju-e4d256-prod-github-runner-207 kernel: [77900.588348] Aug 23 03:02:06 juju-e4d256-prod-github-runner-207 kernel: [77900.589191] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 03:02:06 juju-e4d256-prod-github-runner-207 kernel: [77900.590229] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 03:02:06 juju-e4d256-prod-github-runner-207 kernel: [77900.591290] ? _raw_spin_lock+0x22/0x30 Aug 23 03:02:06 juju-e4d256-prod-github-runner-207 kernel: [77900.592259] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 03:02:06 juju-e4d256-prod-github-runner-207 kernel: [77900.593295] direct_page_fault+0x206/0x310 [kvm] Aug 23 03:02:06 juju-e4d256-prod-github-runner-207 kernel: [77900.594334] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 03:02:06 juju-e4d256-prod-github-runner-207 kernel: [77900.595362] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 03:02:06 juju-e4d256-prod-github-runner-207 kernel: [77900.596417] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 03:02:06 juju-e4d256-prod-github-runner-207 kernel: [77900.597479] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 03:02:06 juju-e4d256-prod-github-runner-207 kernel: [77900.598535] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 03:02:06 juju-e4d256-prod-github-runner-207 kernel: [77900.599586] handle_exit+0x98/0x230 [kvm_amd] Aug 23 03:02:06 juju-e4d256-prod-github-runner-207 kernel: [77900.600682] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 03:02:06 juju-e4d256-prod-github-runner-207 kernel: [77900.601641] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 03:02:06 juju-e4d256-prod-github-runner-207 kernel: [77900.602572] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 03:02:06 juju-e4d256-prod-github-runner-207 kernel: [77900.603499] vcpu_run+0x62/0x2c0 [kvm] Aug 23 03:02:06 juju-e4d256-prod-github-runner-207 kernel: [77900.604328] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 03:02:06 juju-e4d256-prod-github-runner-207 kernel: [77900.605158] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 03:02:06 juju-e4d256-prod-github-runner-207 kernel: [77900.606034] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 03:02:06 juju-e4d256-prod-github-runner-207 kernel: [77900.606849] ? __seccomp_filter+0x4a/0x4a0 Aug 23 03:02:06 juju-e4d256-prod-github-runner-207 kernel: [77900.607624] ? __fget_files+0x86/0xc0 Aug 23 03:02:06 juju-e4d256-prod-github-runner-207 kernel: [77900.608373] __x64_sys_ioctl+0x95/0xd0 Aug 23 03:02:06 juju-e4d256-prod-github-runner-207 kernel: [77900.609137] do_syscall_64+0x5c/0xc0 Aug 23 03:02:06 juju-e4d256-prod-github-runner-207 kernel: [77900.609984] ? do_futex+0x162/0x1f0 Aug 23 03:02:06 juju-e4d256-prod-github-runner-207 kernel: [77900.610675] ? __x64_sys_futex+0x78/0x1e0 Aug 23 03:02:06 juju-e4d256-prod-github-runner-207 kernel: [77900.611370] ? __secure_computing+0xa9/0x120 Aug 23 03:02:06 juju-e4d256-prod-github-runner-207 kernel: [77900.612090] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 03:02:06 juju-e4d256-prod-github-runner-207 kernel: [77900.612898] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 03:02:06 juju-e4d256-prod-github-runner-207 kernel: [77900.613659] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 03:02:06 juju-e4d256-prod-github-runner-207 kernel: [77900.614406] ? do_syscall_64+0x69/0xc0 Aug 23 03:02:06 juju-e4d256-prod-github-runner-207 kernel: [77900.615071] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 03:02:06 juju-e4d256-prod-github-runner-207 kernel: [77900.615773] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 03:02:06 juju-e4d256-prod-github-runner-207 kernel: [77900.616505] ? do_syscall_64+0x69/0xc0 Aug 23 03:02:06 juju-e4d256-prod-github-runner-207 kernel: [77900.617133] ? do_syscall_64+0x69/0xc0 Aug 23 03:02:06 juju-e4d256-prod-github-runner-207 kernel: [77900.617778] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 03:02:06 juju-e4d256-prod-github-runner-207 kernel: [77900.618574] RIP: 0033:0x7faa5d0edaff Aug 23 03:02:06 juju-e4d256-prod-github-runner-207 kernel: [77900.619260] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 03:02:06 juju-e4d256-prod-github-runner-207 kernel: [77900.621541] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 03:02:06 juju-e4d256-prod-github-runner-207 kernel: [77900.622534] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 03:02:06 juju-e4d256-prod-github-runner-207 kernel: [77900.623435] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 03:02:06 juju-e4d256-prod-github-runner-207 kernel: [77900.624340] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 03:02:06 juju-e4d256-prod-github-runner-207 kernel: [77900.625240] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 03:02:06 juju-e4d256-prod-github-runner-207 kernel: [77900.626150] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 03:02:06 juju-e4d256-prod-github-runner-207 kernel: [77900.627050] Aug 23 03:02:34 juju-e4d256-prod-github-runner-207 kernel: [77928.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 72468s! [qemu-system-x86:6715] Aug 23 03:02:34 juju-e4d256-prod-github-runner-207 kernel: [77928.543890] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 03:02:34 juju-e4d256-prod-github-runner-207 kernel: [77928.544180] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 03:02:34 juju-e4d256-prod-github-runner-207 kernel: [77928.556572] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 03:02:34 juju-e4d256-prod-github-runner-207 kernel: [77928.557844] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 03:02:34 juju-e4d256-prod-github-runner-207 kernel: [77928.559076] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 03:02:34 juju-e4d256-prod-github-runner-207 kernel: [77928.560144] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 03:02:34 juju-e4d256-prod-github-runner-207 kernel: [77928.562761] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 03:02:34 juju-e4d256-prod-github-runner-207 kernel: [77928.563832] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 03:02:34 juju-e4d256-prod-github-runner-207 kernel: [77928.564994] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 03:02:34 juju-e4d256-prod-github-runner-207 kernel: [77928.566168] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 03:02:34 juju-e4d256-prod-github-runner-207 kernel: [77928.567327] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 03:02:34 juju-e4d256-prod-github-runner-207 kernel: [77928.568496] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 03:02:34 juju-e4d256-prod-github-runner-207 kernel: [77928.569671] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 03:02:34 juju-e4d256-prod-github-runner-207 kernel: [77928.570907] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 03:02:34 juju-e4d256-prod-github-runner-207 kernel: [77928.572031] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 03:02:34 juju-e4d256-prod-github-runner-207 kernel: [77928.573226] Call Trace: Aug 23 03:02:34 juju-e4d256-prod-github-runner-207 kernel: [77928.574221] Aug 23 03:02:34 juju-e4d256-prod-github-runner-207 kernel: [77928.575143] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 03:02:34 juju-e4d256-prod-github-runner-207 kernel: [77928.576190] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 03:02:34 juju-e4d256-prod-github-runner-207 kernel: [77928.577222] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 03:02:34 juju-e4d256-prod-github-runner-207 kernel: [77928.578320] ? show_regs.part.0+0x23/0x29 Aug 23 03:02:34 juju-e4d256-prod-github-runner-207 kernel: [77928.579321] ? show_regs.cold+0x8/0xd Aug 23 03:02:34 juju-e4d256-prod-github-runner-207 kernel: [77928.580321] ? watchdog_timer_fn+0x1be/0x220 Aug 23 03:02:34 juju-e4d256-prod-github-runner-207 kernel: [77928.581332] ? lockup_detector_update_enable+0x60/0x60 Aug 23 03:02:34 juju-e4d256-prod-github-runner-207 kernel: [77928.582395] ? __hrtimer_run_queues+0x107/0x230 Aug 23 03:02:34 juju-e4d256-prod-github-runner-207 kernel: [77928.583424] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 03:02:34 juju-e4d256-prod-github-runner-207 kernel: [77928.584460] ? hrtimer_interrupt+0x101/0x220 Aug 23 03:02:34 juju-e4d256-prod-github-runner-207 kernel: [77928.585479] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 03:02:34 juju-e4d256-prod-github-runner-207 kernel: [77928.586547] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 03:02:34 juju-e4d256-prod-github-runner-207 kernel: [77928.587592] Aug 23 03:02:34 juju-e4d256-prod-github-runner-207 kernel: [77928.588451] Aug 23 03:02:34 juju-e4d256-prod-github-runner-207 kernel: [77928.589297] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 03:02:34 juju-e4d256-prod-github-runner-207 kernel: [77928.590333] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 03:02:34 juju-e4d256-prod-github-runner-207 kernel: [77928.591379] ? _raw_spin_lock+0x22/0x30 Aug 23 03:02:34 juju-e4d256-prod-github-runner-207 kernel: [77928.592342] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 03:02:34 juju-e4d256-prod-github-runner-207 kernel: [77928.593360] direct_page_fault+0x206/0x310 [kvm] Aug 23 03:02:34 juju-e4d256-prod-github-runner-207 kernel: [77928.594386] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 03:02:34 juju-e4d256-prod-github-runner-207 kernel: [77928.595408] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 03:02:34 juju-e4d256-prod-github-runner-207 kernel: [77928.596418] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 03:02:34 juju-e4d256-prod-github-runner-207 kernel: [77928.597428] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 03:02:34 juju-e4d256-prod-github-runner-207 kernel: [77928.598380] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 03:02:34 juju-e4d256-prod-github-runner-207 kernel: [77928.599361] handle_exit+0x98/0x230 [kvm_amd] Aug 23 03:02:34 juju-e4d256-prod-github-runner-207 kernel: [77928.600265] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 03:02:34 juju-e4d256-prod-github-runner-207 kernel: [77928.601181] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 03:02:34 juju-e4d256-prod-github-runner-207 kernel: [77928.602107] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 03:02:34 juju-e4d256-prod-github-runner-207 kernel: [77928.603010] vcpu_run+0x62/0x2c0 [kvm] Aug 23 03:02:34 juju-e4d256-prod-github-runner-207 kernel: [77928.603832] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 03:02:34 juju-e4d256-prod-github-runner-207 kernel: [77928.604642] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 03:02:34 juju-e4d256-prod-github-runner-207 kernel: [77928.605498] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 03:02:34 juju-e4d256-prod-github-runner-207 kernel: [77928.606301] ? __seccomp_filter+0x4a/0x4a0 Aug 23 03:02:34 juju-e4d256-prod-github-runner-207 kernel: [77928.607044] ? __fget_files+0x86/0xc0 Aug 23 03:02:34 juju-e4d256-prod-github-runner-207 kernel: [77928.607786] __x64_sys_ioctl+0x95/0xd0 Aug 23 03:02:34 juju-e4d256-prod-github-runner-207 kernel: [77928.608609] do_syscall_64+0x5c/0xc0 Aug 23 03:02:34 juju-e4d256-prod-github-runner-207 kernel: [77928.609277] ? do_futex+0x162/0x1f0 Aug 23 03:02:34 juju-e4d256-prod-github-runner-207 kernel: [77928.609924] ? __x64_sys_futex+0x78/0x1e0 Aug 23 03:02:34 juju-e4d256-prod-github-runner-207 kernel: [77928.610596] ? __secure_computing+0xa9/0x120 Aug 23 03:02:34 juju-e4d256-prod-github-runner-207 kernel: [77928.611284] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 03:02:34 juju-e4d256-prod-github-runner-207 kernel: [77928.612074] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 03:02:34 juju-e4d256-prod-github-runner-207 kernel: [77928.612802] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 03:02:34 juju-e4d256-prod-github-runner-207 kernel: [77928.613519] ? do_syscall_64+0x69/0xc0 Aug 23 03:02:34 juju-e4d256-prod-github-runner-207 kernel: [77928.614171] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 03:02:34 juju-e4d256-prod-github-runner-207 kernel: [77928.614873] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 03:02:34 juju-e4d256-prod-github-runner-207 kernel: [77928.615611] ? do_syscall_64+0x69/0xc0 Aug 23 03:02:34 juju-e4d256-prod-github-runner-207 kernel: [77928.616369] ? do_syscall_64+0x69/0xc0 Aug 23 03:02:34 juju-e4d256-prod-github-runner-207 kernel: [77928.617090] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 03:02:34 juju-e4d256-prod-github-runner-207 kernel: [77928.617810] RIP: 0033:0x7faa5d0edaff Aug 23 03:02:34 juju-e4d256-prod-github-runner-207 kernel: [77928.618478] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 03:02:34 juju-e4d256-prod-github-runner-207 kernel: [77928.620975] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 03:02:34 juju-e4d256-prod-github-runner-207 kernel: [77928.622040] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 03:02:34 juju-e4d256-prod-github-runner-207 kernel: [77928.622930] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 03:02:34 juju-e4d256-prod-github-runner-207 kernel: [77928.623845] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 03:02:34 juju-e4d256-prod-github-runner-207 kernel: [77928.624736] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 03:02:34 juju-e4d256-prod-github-runner-207 kernel: [77928.625630] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 03:02:34 juju-e4d256-prod-github-runner-207 kernel: [77928.626522] Aug 23 03:02:48 juju-e4d256-prod-github-runner-207 kernel: [77942.384707] rcu: INFO: rcu_sched self-detected stall on CPU Aug 23 03:02:48 juju-e4d256-prod-github-runner-207 kernel: [77942.385753] rcu: 1-....: (19395226 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=9377683 Aug 23 03:02:48 juju-e4d256-prod-github-runner-207 kernel: [77942.386890] (t=19456296 jiffies g=23269 q=65354) Aug 23 03:02:48 juju-e4d256-prod-github-runner-207 kernel: [77942.387715] NMI backtrace for cpu 1 Aug 23 03:02:48 juju-e4d256-prod-github-runner-207 kernel: [77942.388425] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 03:02:48 juju-e4d256-prod-github-runner-207 kernel: [77942.389536] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 03:02:48 juju-e4d256-prod-github-runner-207 kernel: [77942.390616] Call Trace: Aug 23 03:02:48 juju-e4d256-prod-github-runner-207 kernel: [77942.391298] Aug 23 03:02:48 juju-e4d256-prod-github-runner-207 kernel: [77942.391956] show_stack+0x52/0x5c Aug 23 03:02:48 juju-e4d256-prod-github-runner-207 kernel: [77942.392680] dump_stack_lvl+0x4a/0x63 Aug 23 03:02:48 juju-e4d256-prod-github-runner-207 kernel: [77942.393423] dump_stack+0x10/0x16 Aug 23 03:02:48 juju-e4d256-prod-github-runner-207 kernel: [77942.394144] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 23 03:02:48 juju-e4d256-prod-github-runner-207 kernel: [77942.394929] ? lapic_can_unplug_cpu+0x90/0x90 Aug 23 03:02:48 juju-e4d256-prod-github-runner-207 kernel: [77942.395767] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 23 03:02:48 juju-e4d256-prod-github-runner-207 kernel: [77942.396588] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 23 03:02:48 juju-e4d256-prod-github-runner-207 kernel: [77942.397405] trigger_single_cpu_backtrace+0x44/0x4f Aug 23 03:02:48 juju-e4d256-prod-github-runner-207 kernel: [77942.398211] rcu_dump_cpu_stacks+0x102/0x149 Aug 23 03:02:48 juju-e4d256-prod-github-runner-207 kernel: [77942.398986] print_cpu_stall.cold+0x2f/0xe2 Aug 23 03:02:48 juju-e4d256-prod-github-runner-207 kernel: [77942.399764] ? timekeeping_update+0xf7/0x150 Aug 23 03:02:48 juju-e4d256-prod-github-runner-207 kernel: [77942.400551] check_cpu_stall+0x109/0x270 Aug 23 03:02:48 juju-e4d256-prod-github-runner-207 kernel: [77942.401301] rcu_sched_clock_irq+0x9a/0x250 Aug 23 03:02:48 juju-e4d256-prod-github-runner-207 kernel: [77942.402067] update_process_times+0x94/0xd0 Aug 23 03:02:48 juju-e4d256-prod-github-runner-207 kernel: [77942.402827] tick_sched_handle+0x29/0x70 Aug 23 03:02:48 juju-e4d256-prod-github-runner-207 kernel: [77942.403608] tick_sched_timer+0x8c/0xc0 Aug 23 03:02:48 juju-e4d256-prod-github-runner-207 kernel: [77942.404362] ? tick_nohz_handler+0xb0/0xb0 Aug 23 03:02:48 juju-e4d256-prod-github-runner-207 kernel: [77942.405125] __hrtimer_run_queues+0x107/0x230 Aug 23 03:02:48 juju-e4d256-prod-github-runner-207 kernel: [77942.405948] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 03:02:48 juju-e4d256-prod-github-runner-207 kernel: [77942.406739] hrtimer_interrupt+0x101/0x220 Aug 23 03:02:48 juju-e4d256-prod-github-runner-207 kernel: [77942.407522] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 03:02:48 juju-e4d256-prod-github-runner-207 kernel: [77942.408357] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 03:02:48 juju-e4d256-prod-github-runner-207 kernel: [77942.409157] Aug 23 03:02:48 juju-e4d256-prod-github-runner-207 kernel: [77942.409791] Aug 23 03:02:48 juju-e4d256-prod-github-runner-207 kernel: [77942.410417] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 03:02:48 juju-e4d256-prod-github-runner-207 kernel: [77942.411238] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 03:02:48 juju-e4d256-prod-github-runner-207 kernel: [77942.412194] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 03:02:48 juju-e4d256-prod-github-runner-207 kernel: [77942.414426] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 03:02:48 juju-e4d256-prod-github-runner-207 kernel: [77942.415624] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 03:02:48 juju-e4d256-prod-github-runner-207 kernel: [77942.416625] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 03:02:48 juju-e4d256-prod-github-runner-207 kernel: [77942.417608] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 03:02:48 juju-e4d256-prod-github-runner-207 kernel: [77942.418571] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 03:02:48 juju-e4d256-prod-github-runner-207 kernel: [77942.419563] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 03:02:48 juju-e4d256-prod-github-runner-207 kernel: [77942.420560] ? _raw_spin_lock+0x22/0x30 Aug 23 03:02:48 juju-e4d256-prod-github-runner-207 kernel: [77942.421329] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 03:02:48 juju-e4d256-prod-github-runner-207 kernel: [77942.422178] direct_page_fault+0x206/0x310 [kvm] Aug 23 03:02:48 juju-e4d256-prod-github-runner-207 kernel: [77942.423014] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 03:02:48 juju-e4d256-prod-github-runner-207 kernel: [77942.423862] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 03:02:48 juju-e4d256-prod-github-runner-207 kernel: [77942.424717] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 03:02:48 juju-e4d256-prod-github-runner-207 kernel: [77942.425532] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 03:02:48 juju-e4d256-prod-github-runner-207 kernel: [77942.426318] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 03:02:48 juju-e4d256-prod-github-runner-207 kernel: [77942.427141] handle_exit+0x98/0x230 [kvm_amd] Aug 23 03:02:48 juju-e4d256-prod-github-runner-207 kernel: [77942.427909] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 03:02:48 juju-e4d256-prod-github-runner-207 kernel: [77942.428693] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 03:02:48 juju-e4d256-prod-github-runner-207 kernel: [77942.429501] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 03:02:48 juju-e4d256-prod-github-runner-207 kernel: [77942.430314] vcpu_run+0x62/0x2c0 [kvm] Aug 23 03:02:48 juju-e4d256-prod-github-runner-207 kernel: [77942.431059] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 03:02:48 juju-e4d256-prod-github-runner-207 kernel: [77942.431808] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 03:02:48 juju-e4d256-prod-github-runner-207 kernel: [77942.432610] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 03:02:48 juju-e4d256-prod-github-runner-207 kernel: [77942.433371] ? __seccomp_filter+0x4a/0x4a0 Aug 23 03:02:48 juju-e4d256-prod-github-runner-207 kernel: [77942.434096] ? __fget_files+0x86/0xc0 Aug 23 03:02:48 juju-e4d256-prod-github-runner-207 kernel: [77942.434804] __x64_sys_ioctl+0x95/0xd0 Aug 23 03:02:48 juju-e4d256-prod-github-runner-207 kernel: [77942.435511] do_syscall_64+0x5c/0xc0 Aug 23 03:02:48 juju-e4d256-prod-github-runner-207 kernel: [77942.436215] ? do_futex+0x162/0x1f0 Aug 23 03:02:48 juju-e4d256-prod-github-runner-207 kernel: [77942.436891] ? __x64_sys_futex+0x78/0x1e0 Aug 23 03:02:48 juju-e4d256-prod-github-runner-207 kernel: [77942.437592] ? __secure_computing+0xa9/0x120 Aug 23 03:02:48 juju-e4d256-prod-github-runner-207 kernel: [77942.438307] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 03:02:48 juju-e4d256-prod-github-runner-207 kernel: [77942.439096] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 03:02:48 juju-e4d256-prod-github-runner-207 kernel: [77942.439878] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 03:02:48 juju-e4d256-prod-github-runner-207 kernel: [77942.440644] ? do_syscall_64+0x69/0xc0 Aug 23 03:02:48 juju-e4d256-prod-github-runner-207 kernel: [77942.441337] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 03:02:48 juju-e4d256-prod-github-runner-207 kernel: [77942.442095] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 03:02:48 juju-e4d256-prod-github-runner-207 kernel: [77942.442852] ? do_syscall_64+0x69/0xc0 Aug 23 03:02:48 juju-e4d256-prod-github-runner-207 kernel: [77942.443556] ? do_syscall_64+0x69/0xc0 Aug 23 03:02:48 juju-e4d256-prod-github-runner-207 kernel: [77942.444244] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 03:02:48 juju-e4d256-prod-github-runner-207 kernel: [77942.445204] RIP: 0033:0x7faa5d0edaff Aug 23 03:02:48 juju-e4d256-prod-github-runner-207 kernel: [77942.445923] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 03:02:48 juju-e4d256-prod-github-runner-207 kernel: [77942.448042] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 03:02:48 juju-e4d256-prod-github-runner-207 kernel: [77942.449005] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 03:02:48 juju-e4d256-prod-github-runner-207 kernel: [77942.449972] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 03:02:48 juju-e4d256-prod-github-runner-207 kernel: [77942.450929] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 03:02:48 juju-e4d256-prod-github-runner-207 kernel: [77942.451889] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 03:02:48 juju-e4d256-prod-github-runner-207 kernel: [77942.452825] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 03:02:48 juju-e4d256-prod-github-runner-207 kernel: [77942.453740] Aug 23 03:03:14 juju-e4d256-prod-github-runner-207 kernel: [77968.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 72505s! [qemu-system-x86:6715] Aug 23 03:03:14 juju-e4d256-prod-github-runner-207 kernel: [77968.543117] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 03:03:14 juju-e4d256-prod-github-runner-207 kernel: [77968.543189] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 03:03:14 juju-e4d256-prod-github-runner-207 kernel: [77968.555441] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 03:03:14 juju-e4d256-prod-github-runner-207 kernel: [77968.556725] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 03:03:14 juju-e4d256-prod-github-runner-207 kernel: [77968.557956] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 03:03:14 juju-e4d256-prod-github-runner-207 kernel: [77968.559023] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 03:03:14 juju-e4d256-prod-github-runner-207 kernel: [77968.561580] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 03:03:14 juju-e4d256-prod-github-runner-207 kernel: [77968.562652] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 03:03:14 juju-e4d256-prod-github-runner-207 kernel: [77968.563832] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 03:03:14 juju-e4d256-prod-github-runner-207 kernel: [77968.564990] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 03:03:14 juju-e4d256-prod-github-runner-207 kernel: [77968.566163] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 03:03:14 juju-e4d256-prod-github-runner-207 kernel: [77968.567358] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 03:03:14 juju-e4d256-prod-github-runner-207 kernel: [77968.568524] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 03:03:14 juju-e4d256-prod-github-runner-207 kernel: [77968.569756] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 03:03:14 juju-e4d256-prod-github-runner-207 kernel: [77968.570875] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 03:03:14 juju-e4d256-prod-github-runner-207 kernel: [77968.572133] Call Trace: Aug 23 03:03:14 juju-e4d256-prod-github-runner-207 kernel: [77968.573060] Aug 23 03:03:14 juju-e4d256-prod-github-runner-207 kernel: [77968.573943] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 03:03:14 juju-e4d256-prod-github-runner-207 kernel: [77968.574974] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 03:03:14 juju-e4d256-prod-github-runner-207 kernel: [77968.576031] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 03:03:14 juju-e4d256-prod-github-runner-207 kernel: [77968.577123] ? show_regs.part.0+0x23/0x29 Aug 23 03:03:14 juju-e4d256-prod-github-runner-207 kernel: [77968.578132] ? show_regs.cold+0x8/0xd Aug 23 03:03:14 juju-e4d256-prod-github-runner-207 kernel: [77968.579103] ? watchdog_timer_fn+0x1be/0x220 Aug 23 03:03:14 juju-e4d256-prod-github-runner-207 kernel: [77968.580285] ? lockup_detector_update_enable+0x60/0x60 Aug 23 03:03:14 juju-e4d256-prod-github-runner-207 kernel: [77968.581345] ? __hrtimer_run_queues+0x107/0x230 Aug 23 03:03:14 juju-e4d256-prod-github-runner-207 kernel: [77968.582377] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 03:03:14 juju-e4d256-prod-github-runner-207 kernel: [77968.583447] ? hrtimer_interrupt+0x101/0x220 Aug 23 03:03:14 juju-e4d256-prod-github-runner-207 kernel: [77968.584462] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 03:03:14 juju-e4d256-prod-github-runner-207 kernel: [77968.585530] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 03:03:14 juju-e4d256-prod-github-runner-207 kernel: [77968.586591] Aug 23 03:03:14 juju-e4d256-prod-github-runner-207 kernel: [77968.587502] Aug 23 03:03:14 juju-e4d256-prod-github-runner-207 kernel: [77968.588359] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 03:03:14 juju-e4d256-prod-github-runner-207 kernel: [77968.589390] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 03:03:14 juju-e4d256-prod-github-runner-207 kernel: [77968.590432] ? _raw_spin_lock+0x22/0x30 Aug 23 03:03:14 juju-e4d256-prod-github-runner-207 kernel: [77968.591388] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 03:03:14 juju-e4d256-prod-github-runner-207 kernel: [77968.592419] direct_page_fault+0x206/0x310 [kvm] Aug 23 03:03:14 juju-e4d256-prod-github-runner-207 kernel: [77968.593453] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 03:03:14 juju-e4d256-prod-github-runner-207 kernel: [77968.594461] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 03:03:14 juju-e4d256-prod-github-runner-207 kernel: [77968.595477] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 03:03:14 juju-e4d256-prod-github-runner-207 kernel: [77968.596448] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 03:03:14 juju-e4d256-prod-github-runner-207 kernel: [77968.597396] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 03:03:14 juju-e4d256-prod-github-runner-207 kernel: [77968.598382] handle_exit+0x98/0x230 [kvm_amd] Aug 23 03:03:14 juju-e4d256-prod-github-runner-207 kernel: [77968.599298] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 03:03:14 juju-e4d256-prod-github-runner-207 kernel: [77968.600217] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 03:03:14 juju-e4d256-prod-github-runner-207 kernel: [77968.601164] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 03:03:14 juju-e4d256-prod-github-runner-207 kernel: [77968.602076] vcpu_run+0x62/0x2c0 [kvm] Aug 23 03:03:14 juju-e4d256-prod-github-runner-207 kernel: [77968.602889] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 03:03:14 juju-e4d256-prod-github-runner-207 kernel: [77968.603726] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 03:03:14 juju-e4d256-prod-github-runner-207 kernel: [77968.604585] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 03:03:14 juju-e4d256-prod-github-runner-207 kernel: [77968.605381] ? __seccomp_filter+0x4a/0x4a0 Aug 23 03:03:14 juju-e4d256-prod-github-runner-207 kernel: [77968.606124] ? __fget_files+0x86/0xc0 Aug 23 03:03:14 juju-e4d256-prod-github-runner-207 kernel: [77968.606833] __x64_sys_ioctl+0x95/0xd0 Aug 23 03:03:14 juju-e4d256-prod-github-runner-207 kernel: [77968.607536] do_syscall_64+0x5c/0xc0 Aug 23 03:03:14 juju-e4d256-prod-github-runner-207 kernel: [77968.608209] ? do_futex+0x162/0x1f0 Aug 23 03:03:14 juju-e4d256-prod-github-runner-207 kernel: [77968.608860] ? __x64_sys_futex+0x78/0x1e0 Aug 23 03:03:14 juju-e4d256-prod-github-runner-207 kernel: [77968.609565] ? __secure_computing+0xa9/0x120 Aug 23 03:03:14 juju-e4d256-prod-github-runner-207 kernel: [77968.610258] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 03:03:14 juju-e4d256-prod-github-runner-207 kernel: [77968.611018] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 03:03:14 juju-e4d256-prod-github-runner-207 kernel: [77968.611757] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 03:03:14 juju-e4d256-prod-github-runner-207 kernel: [77968.612492] ? do_syscall_64+0x69/0xc0 Aug 23 03:03:14 juju-e4d256-prod-github-runner-207 kernel: [77968.613143] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 03:03:14 juju-e4d256-prod-github-runner-207 kernel: [77968.613859] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 03:03:14 juju-e4d256-prod-github-runner-207 kernel: [77968.614555] ? do_syscall_64+0x69/0xc0 Aug 23 03:03:14 juju-e4d256-prod-github-runner-207 kernel: [77968.615180] ? do_syscall_64+0x69/0xc0 Aug 23 03:03:14 juju-e4d256-prod-github-runner-207 kernel: [77968.615845] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 03:03:14 juju-e4d256-prod-github-runner-207 kernel: [77968.616559] RIP: 0033:0x7faa5d0edaff Aug 23 03:03:14 juju-e4d256-prod-github-runner-207 kernel: [77968.617194] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 03:03:14 juju-e4d256-prod-github-runner-207 kernel: [77968.619208] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 03:03:14 juju-e4d256-prod-github-runner-207 kernel: [77968.620150] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 03:03:14 juju-e4d256-prod-github-runner-207 kernel: [77968.621049] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 03:03:14 juju-e4d256-prod-github-runner-207 kernel: [77968.621935] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 03:03:14 juju-e4d256-prod-github-runner-207 kernel: [77968.622821] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 03:03:14 juju-e4d256-prod-github-runner-207 kernel: [77968.623730] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 03:03:14 juju-e4d256-prod-github-runner-207 kernel: [77968.624626] Aug 23 03:03:42 juju-e4d256-prod-github-runner-207 kernel: [77996.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 72531s! [qemu-system-x86:6715] Aug 23 03:03:42 juju-e4d256-prod-github-runner-207 kernel: [77996.543124] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 03:03:42 juju-e4d256-prod-github-runner-207 kernel: [77996.543199] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 03:03:42 juju-e4d256-prod-github-runner-207 kernel: [77996.555311] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 03:03:42 juju-e4d256-prod-github-runner-207 kernel: [77996.556579] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 03:03:42 juju-e4d256-prod-github-runner-207 kernel: [77996.557803] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 03:03:42 juju-e4d256-prod-github-runner-207 kernel: [77996.558897] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 03:03:42 juju-e4d256-prod-github-runner-207 kernel: [77996.561812] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 03:03:42 juju-e4d256-prod-github-runner-207 kernel: [77996.562865] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 03:03:42 juju-e4d256-prod-github-runner-207 kernel: [77996.564056] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 03:03:42 juju-e4d256-prod-github-runner-207 kernel: [77996.565230] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 03:03:42 juju-e4d256-prod-github-runner-207 kernel: [77996.566544] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 03:03:42 juju-e4d256-prod-github-runner-207 kernel: [77996.568117] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 03:03:42 juju-e4d256-prod-github-runner-207 kernel: [77996.569652] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 03:03:42 juju-e4d256-prod-github-runner-207 kernel: [77996.571414] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 03:03:42 juju-e4d256-prod-github-runner-207 kernel: [77996.572868] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 03:03:42 juju-e4d256-prod-github-runner-207 kernel: [77996.574387] Call Trace: Aug 23 03:03:42 juju-e4d256-prod-github-runner-207 kernel: [77996.575421] Aug 23 03:03:42 juju-e4d256-prod-github-runner-207 kernel: [77996.576621] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 03:03:42 juju-e4d256-prod-github-runner-207 kernel: [77996.577657] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 03:03:42 juju-e4d256-prod-github-runner-207 kernel: [77996.578682] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 03:03:42 juju-e4d256-prod-github-runner-207 kernel: [77996.579772] ? show_regs.part.0+0x23/0x29 Aug 23 03:03:42 juju-e4d256-prod-github-runner-207 kernel: [77996.580771] ? show_regs.cold+0x8/0xd Aug 23 03:03:42 juju-e4d256-prod-github-runner-207 kernel: [77996.581739] ? watchdog_timer_fn+0x1be/0x220 Aug 23 03:03:42 juju-e4d256-prod-github-runner-207 kernel: [77996.582747] ? lockup_detector_update_enable+0x60/0x60 Aug 23 03:03:42 juju-e4d256-prod-github-runner-207 kernel: [77996.583824] ? __hrtimer_run_queues+0x107/0x230 Aug 23 03:03:42 juju-e4d256-prod-github-runner-207 kernel: [77996.584849] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 03:03:42 juju-e4d256-prod-github-runner-207 kernel: [77996.585891] ? hrtimer_interrupt+0x101/0x220 Aug 23 03:03:42 juju-e4d256-prod-github-runner-207 kernel: [77996.587016] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 03:03:42 juju-e4d256-prod-github-runner-207 kernel: [77996.588084] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 03:03:42 juju-e4d256-prod-github-runner-207 kernel: [77996.589126] Aug 23 03:03:42 juju-e4d256-prod-github-runner-207 kernel: [77996.589982] Aug 23 03:03:42 juju-e4d256-prod-github-runner-207 kernel: [77996.590821] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 03:03:42 juju-e4d256-prod-github-runner-207 kernel: [77996.591878] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 03:03:42 juju-e4d256-prod-github-runner-207 kernel: [77996.592921] ? _raw_spin_lock+0x22/0x30 Aug 23 03:03:42 juju-e4d256-prod-github-runner-207 kernel: [77996.593867] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 03:03:42 juju-e4d256-prod-github-runner-207 kernel: [77996.594881] direct_page_fault+0x206/0x310 [kvm] Aug 23 03:03:42 juju-e4d256-prod-github-runner-207 kernel: [77996.595916] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 03:03:42 juju-e4d256-prod-github-runner-207 kernel: [77996.596922] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 03:03:42 juju-e4d256-prod-github-runner-207 kernel: [77996.597920] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 03:03:42 juju-e4d256-prod-github-runner-207 kernel: [77996.598886] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 03:03:42 juju-e4d256-prod-github-runner-207 kernel: [77996.599846] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 03:03:42 juju-e4d256-prod-github-runner-207 kernel: [77996.600825] handle_exit+0x98/0x230 [kvm_amd] Aug 23 03:03:42 juju-e4d256-prod-github-runner-207 kernel: [77996.601739] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 03:03:42 juju-e4d256-prod-github-runner-207 kernel: [77996.602678] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 03:03:42 juju-e4d256-prod-github-runner-207 kernel: [77996.603652] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 03:03:42 juju-e4d256-prod-github-runner-207 kernel: [77996.604584] vcpu_run+0x62/0x2c0 [kvm] Aug 23 03:03:42 juju-e4d256-prod-github-runner-207 kernel: [77996.605394] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 03:03:42 juju-e4d256-prod-github-runner-207 kernel: [77996.606201] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 03:03:42 juju-e4d256-prod-github-runner-207 kernel: [77996.607070] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 03:03:42 juju-e4d256-prod-github-runner-207 kernel: [77996.607902] ? __seccomp_filter+0x4a/0x4a0 Aug 23 03:03:42 juju-e4d256-prod-github-runner-207 kernel: [77996.608649] ? __fget_files+0x86/0xc0 Aug 23 03:03:42 juju-e4d256-prod-github-runner-207 kernel: [77996.609359] __x64_sys_ioctl+0x95/0xd0 Aug 23 03:03:42 juju-e4d256-prod-github-runner-207 kernel: [77996.610051] do_syscall_64+0x5c/0xc0 Aug 23 03:03:42 juju-e4d256-prod-github-runner-207 kernel: [77996.610718] ? do_futex+0x162/0x1f0 Aug 23 03:03:42 juju-e4d256-prod-github-runner-207 kernel: [77996.611385] ? __x64_sys_futex+0x78/0x1e0 Aug 23 03:03:42 juju-e4d256-prod-github-runner-207 kernel: [77996.612303] ? __secure_computing+0xa9/0x120 Aug 23 03:03:42 juju-e4d256-prod-github-runner-207 kernel: [77996.612996] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 03:03:42 juju-e4d256-prod-github-runner-207 kernel: [77996.613808] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 03:03:42 juju-e4d256-prod-github-runner-207 kernel: [77996.614536] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 03:03:42 juju-e4d256-prod-github-runner-207 kernel: [77996.615273] ? do_syscall_64+0x69/0xc0 Aug 23 03:03:42 juju-e4d256-prod-github-runner-207 kernel: [77996.615917] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 03:03:42 juju-e4d256-prod-github-runner-207 kernel: [77996.616619] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 03:03:42 juju-e4d256-prod-github-runner-207 kernel: [77996.617319] ? do_syscall_64+0x69/0xc0 Aug 23 03:03:42 juju-e4d256-prod-github-runner-207 kernel: [77996.617945] ? do_syscall_64+0x69/0xc0 Aug 23 03:03:42 juju-e4d256-prod-github-runner-207 kernel: [77996.618569] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 03:03:42 juju-e4d256-prod-github-runner-207 kernel: [77996.619294] RIP: 0033:0x7faa5d0edaff Aug 23 03:03:42 juju-e4d256-prod-github-runner-207 kernel: [77996.619919] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 03:03:42 juju-e4d256-prod-github-runner-207 kernel: [77996.621909] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 03:03:42 juju-e4d256-prod-github-runner-207 kernel: [77996.622821] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 03:03:42 juju-e4d256-prod-github-runner-207 kernel: [77996.623721] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 03:03:42 juju-e4d256-prod-github-runner-207 kernel: [77996.624615] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 03:03:42 juju-e4d256-prod-github-runner-207 kernel: [77996.625506] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 03:03:42 juju-e4d256-prod-github-runner-207 kernel: [77996.626414] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 03:03:42 juju-e4d256-prod-github-runner-207 kernel: [77996.627327] Aug 23 03:04:10 juju-e4d256-prod-github-runner-207 kernel: [78024.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 72558s! [qemu-system-x86:6715] Aug 23 03:04:10 juju-e4d256-prod-github-runner-207 kernel: [78024.543882] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 03:04:10 juju-e4d256-prod-github-runner-207 kernel: [78024.544183] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 03:04:10 juju-e4d256-prod-github-runner-207 kernel: [78024.556628] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 03:04:10 juju-e4d256-prod-github-runner-207 kernel: [78024.557894] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 03:04:10 juju-e4d256-prod-github-runner-207 kernel: [78024.559138] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 03:04:10 juju-e4d256-prod-github-runner-207 kernel: [78024.560196] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 03:04:10 juju-e4d256-prod-github-runner-207 kernel: [78024.562761] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 03:04:10 juju-e4d256-prod-github-runner-207 kernel: [78024.563803] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 03:04:10 juju-e4d256-prod-github-runner-207 kernel: [78024.564979] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 03:04:10 juju-e4d256-prod-github-runner-207 kernel: [78024.566137] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 03:04:10 juju-e4d256-prod-github-runner-207 kernel: [78024.567308] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 03:04:10 juju-e4d256-prod-github-runner-207 kernel: [78024.568519] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 03:04:10 juju-e4d256-prod-github-runner-207 kernel: [78024.569697] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 03:04:10 juju-e4d256-prod-github-runner-207 kernel: [78024.570976] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 03:04:10 juju-e4d256-prod-github-runner-207 kernel: [78024.572074] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 03:04:10 juju-e4d256-prod-github-runner-207 kernel: [78024.573266] Call Trace: Aug 23 03:04:10 juju-e4d256-prod-github-runner-207 kernel: [78024.574178] Aug 23 03:04:10 juju-e4d256-prod-github-runner-207 kernel: [78024.575081] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 03:04:10 juju-e4d256-prod-github-runner-207 kernel: [78024.576115] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 03:04:10 juju-e4d256-prod-github-runner-207 kernel: [78024.577141] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 03:04:10 juju-e4d256-prod-github-runner-207 kernel: [78024.578232] ? show_regs.part.0+0x23/0x29 Aug 23 03:04:10 juju-e4d256-prod-github-runner-207 kernel: [78024.579239] ? show_regs.cold+0x8/0xd Aug 23 03:04:10 juju-e4d256-prod-github-runner-207 kernel: [78024.580210] ? watchdog_timer_fn+0x1be/0x220 Aug 23 03:04:10 juju-e4d256-prod-github-runner-207 kernel: [78024.581224] ? lockup_detector_update_enable+0x60/0x60 Aug 23 03:04:10 juju-e4d256-prod-github-runner-207 kernel: [78024.582287] ? __hrtimer_run_queues+0x107/0x230 Aug 23 03:04:10 juju-e4d256-prod-github-runner-207 kernel: [78024.583325] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 03:04:10 juju-e4d256-prod-github-runner-207 kernel: [78024.584349] ? hrtimer_interrupt+0x101/0x220 Aug 23 03:04:10 juju-e4d256-prod-github-runner-207 kernel: [78024.585497] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 03:04:10 juju-e4d256-prod-github-runner-207 kernel: [78024.586575] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 03:04:10 juju-e4d256-prod-github-runner-207 kernel: [78024.587638] Aug 23 03:04:10 juju-e4d256-prod-github-runner-207 kernel: [78024.588522] Aug 23 03:04:10 juju-e4d256-prod-github-runner-207 kernel: [78024.589383] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 03:04:10 juju-e4d256-prod-github-runner-207 kernel: [78024.590414] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 03:04:10 juju-e4d256-prod-github-runner-207 kernel: [78024.591475] ? _raw_spin_lock+0x22/0x30 Aug 23 03:04:10 juju-e4d256-prod-github-runner-207 kernel: [78024.592452] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 03:04:10 juju-e4d256-prod-github-runner-207 kernel: [78024.593469] direct_page_fault+0x206/0x310 [kvm] Aug 23 03:04:10 juju-e4d256-prod-github-runner-207 kernel: [78024.594494] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 03:04:10 juju-e4d256-prod-github-runner-207 kernel: [78024.595512] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 03:04:10 juju-e4d256-prod-github-runner-207 kernel: [78024.596515] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 03:04:10 juju-e4d256-prod-github-runner-207 kernel: [78024.597514] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 03:04:10 juju-e4d256-prod-github-runner-207 kernel: [78024.598459] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 03:04:10 juju-e4d256-prod-github-runner-207 kernel: [78024.599446] handle_exit+0x98/0x230 [kvm_amd] Aug 23 03:04:10 juju-e4d256-prod-github-runner-207 kernel: [78024.600365] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 03:04:10 juju-e4d256-prod-github-runner-207 kernel: [78024.601291] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 03:04:10 juju-e4d256-prod-github-runner-207 kernel: [78024.602219] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 03:04:10 juju-e4d256-prod-github-runner-207 kernel: [78024.603137] vcpu_run+0x62/0x2c0 [kvm] Aug 23 03:04:10 juju-e4d256-prod-github-runner-207 kernel: [78024.603955] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 03:04:10 juju-e4d256-prod-github-runner-207 kernel: [78024.604762] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 03:04:10 juju-e4d256-prod-github-runner-207 kernel: [78024.605616] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 03:04:10 juju-e4d256-prod-github-runner-207 kernel: [78024.606413] ? __seccomp_filter+0x4a/0x4a0 Aug 23 03:04:10 juju-e4d256-prod-github-runner-207 kernel: [78024.607167] ? __fget_files+0x86/0xc0 Aug 23 03:04:10 juju-e4d256-prod-github-runner-207 kernel: [78024.607880] __x64_sys_ioctl+0x95/0xd0 Aug 23 03:04:10 juju-e4d256-prod-github-runner-207 kernel: [78024.608586] do_syscall_64+0x5c/0xc0 Aug 23 03:04:10 juju-e4d256-prod-github-runner-207 kernel: [78024.609250] ? do_futex+0x162/0x1f0 Aug 23 03:04:10 juju-e4d256-prod-github-runner-207 kernel: [78024.609902] ? __x64_sys_futex+0x78/0x1e0 Aug 23 03:04:10 juju-e4d256-prod-github-runner-207 kernel: [78024.610573] ? __secure_computing+0xa9/0x120 Aug 23 03:04:10 juju-e4d256-prod-github-runner-207 kernel: [78024.611290] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 03:04:10 juju-e4d256-prod-github-runner-207 kernel: [78024.612056] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 03:04:10 juju-e4d256-prod-github-runner-207 kernel: [78024.612775] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 03:04:10 juju-e4d256-prod-github-runner-207 kernel: [78024.613496] ? do_syscall_64+0x69/0xc0 Aug 23 03:04:10 juju-e4d256-prod-github-runner-207 kernel: [78024.614140] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 03:04:10 juju-e4d256-prod-github-runner-207 kernel: [78024.614927] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 03:04:10 juju-e4d256-prod-github-runner-207 kernel: [78024.615634] ? do_syscall_64+0x69/0xc0 Aug 23 03:04:10 juju-e4d256-prod-github-runner-207 kernel: [78024.616260] ? do_syscall_64+0x69/0xc0 Aug 23 03:04:10 juju-e4d256-prod-github-runner-207 kernel: [78024.616884] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 03:04:10 juju-e4d256-prod-github-runner-207 kernel: [78024.617588] RIP: 0033:0x7faa5d0edaff Aug 23 03:04:10 juju-e4d256-prod-github-runner-207 kernel: [78024.618323] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 03:04:10 juju-e4d256-prod-github-runner-207 kernel: [78024.620464] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 03:04:10 juju-e4d256-prod-github-runner-207 kernel: [78024.621376] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 03:04:10 juju-e4d256-prod-github-runner-207 kernel: [78024.622264] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 03:04:10 juju-e4d256-prod-github-runner-207 kernel: [78024.623192] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 03:04:10 juju-e4d256-prod-github-runner-207 kernel: [78024.624084] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 03:04:10 juju-e4d256-prod-github-runner-207 kernel: [78024.624978] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 03:04:10 juju-e4d256-prod-github-runner-207 kernel: [78024.625868] Aug 23 03:04:38 juju-e4d256-prod-github-runner-207 kernel: [78052.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 72584s! [qemu-system-x86:6715] Aug 23 03:04:38 juju-e4d256-prod-github-runner-207 kernel: [78052.543126] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 03:04:38 juju-e4d256-prod-github-runner-207 kernel: [78052.543200] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 03:04:38 juju-e4d256-prod-github-runner-207 kernel: [78052.555327] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 03:04:38 juju-e4d256-prod-github-runner-207 kernel: [78052.556632] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 03:04:38 juju-e4d256-prod-github-runner-207 kernel: [78052.557924] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 03:04:38 juju-e4d256-prod-github-runner-207 kernel: [78052.559029] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 03:04:38 juju-e4d256-prod-github-runner-207 kernel: [78052.561602] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 03:04:38 juju-e4d256-prod-github-runner-207 kernel: [78052.562654] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 03:04:38 juju-e4d256-prod-github-runner-207 kernel: [78052.563814] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 03:04:38 juju-e4d256-prod-github-runner-207 kernel: [78052.564971] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 03:04:38 juju-e4d256-prod-github-runner-207 kernel: [78052.566127] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 03:04:38 juju-e4d256-prod-github-runner-207 kernel: [78052.567298] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 03:04:38 juju-e4d256-prod-github-runner-207 kernel: [78052.568460] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 03:04:38 juju-e4d256-prod-github-runner-207 kernel: [78052.569690] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 03:04:38 juju-e4d256-prod-github-runner-207 kernel: [78052.570815] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 03:04:38 juju-e4d256-prod-github-runner-207 kernel: [78052.572009] Call Trace: Aug 23 03:04:38 juju-e4d256-prod-github-runner-207 kernel: [78052.572923] Aug 23 03:04:38 juju-e4d256-prod-github-runner-207 kernel: [78052.573808] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 03:04:38 juju-e4d256-prod-github-runner-207 kernel: [78052.574878] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 03:04:38 juju-e4d256-prod-github-runner-207 kernel: [78052.575903] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 03:04:38 juju-e4d256-prod-github-runner-207 kernel: [78052.576979] ? show_regs.part.0+0x23/0x29 Aug 23 03:04:38 juju-e4d256-prod-github-runner-207 kernel: [78052.577977] ? show_regs.cold+0x8/0xd Aug 23 03:04:38 juju-e4d256-prod-github-runner-207 kernel: [78052.578963] ? watchdog_timer_fn+0x1be/0x220 Aug 23 03:04:38 juju-e4d256-prod-github-runner-207 kernel: [78052.579969] ? lockup_detector_update_enable+0x60/0x60 Aug 23 03:04:38 juju-e4d256-prod-github-runner-207 kernel: [78052.581030] ? __hrtimer_run_queues+0x107/0x230 Aug 23 03:04:38 juju-e4d256-prod-github-runner-207 kernel: [78052.582055] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 03:04:38 juju-e4d256-prod-github-runner-207 kernel: [78052.583099] ? hrtimer_interrupt+0x101/0x220 Aug 23 03:04:38 juju-e4d256-prod-github-runner-207 kernel: [78052.584201] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 03:04:38 juju-e4d256-prod-github-runner-207 kernel: [78052.585272] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 03:04:38 juju-e4d256-prod-github-runner-207 kernel: [78052.586331] Aug 23 03:04:38 juju-e4d256-prod-github-runner-207 kernel: [78052.587183] Aug 23 03:04:38 juju-e4d256-prod-github-runner-207 kernel: [78052.588023] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 03:04:38 juju-e4d256-prod-github-runner-207 kernel: [78052.589078] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 03:04:38 juju-e4d256-prod-github-runner-207 kernel: [78052.590120] ? _raw_spin_lock+0x22/0x30 Aug 23 03:04:38 juju-e4d256-prod-github-runner-207 kernel: [78052.591075] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 03:04:38 juju-e4d256-prod-github-runner-207 kernel: [78052.592088] direct_page_fault+0x206/0x310 [kvm] Aug 23 03:04:38 juju-e4d256-prod-github-runner-207 kernel: [78052.593118] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 03:04:38 juju-e4d256-prod-github-runner-207 kernel: [78052.594134] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 03:04:38 juju-e4d256-prod-github-runner-207 kernel: [78052.595177] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 03:04:38 juju-e4d256-prod-github-runner-207 kernel: [78052.596168] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 03:04:38 juju-e4d256-prod-github-runner-207 kernel: [78052.597118] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 03:04:38 juju-e4d256-prod-github-runner-207 kernel: [78052.598096] handle_exit+0x98/0x230 [kvm_amd] Aug 23 03:04:38 juju-e4d256-prod-github-runner-207 kernel: [78052.598999] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 03:04:38 juju-e4d256-prod-github-runner-207 kernel: [78052.599916] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 03:04:38 juju-e4d256-prod-github-runner-207 kernel: [78052.600848] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 03:04:38 juju-e4d256-prod-github-runner-207 kernel: [78052.601752] vcpu_run+0x62/0x2c0 [kvm] Aug 23 03:04:38 juju-e4d256-prod-github-runner-207 kernel: [78052.602592] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 03:04:38 juju-e4d256-prod-github-runner-207 kernel: [78052.603427] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 03:04:38 juju-e4d256-prod-github-runner-207 kernel: [78052.604292] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 03:04:38 juju-e4d256-prod-github-runner-207 kernel: [78052.605102] ? __seccomp_filter+0x4a/0x4a0 Aug 23 03:04:38 juju-e4d256-prod-github-runner-207 kernel: [78052.605844] ? __fget_files+0x86/0xc0 Aug 23 03:04:38 juju-e4d256-prod-github-runner-207 kernel: [78052.606591] __x64_sys_ioctl+0x95/0xd0 Aug 23 03:04:38 juju-e4d256-prod-github-runner-207 kernel: [78052.607285] do_syscall_64+0x5c/0xc0 Aug 23 03:04:38 juju-e4d256-prod-github-runner-207 kernel: [78052.607955] ? do_futex+0x162/0x1f0 Aug 23 03:04:38 juju-e4d256-prod-github-runner-207 kernel: [78052.608642] ? __x64_sys_futex+0x78/0x1e0 Aug 23 03:04:38 juju-e4d256-prod-github-runner-207 kernel: [78052.609321] ? __secure_computing+0xa9/0x120 Aug 23 03:04:38 juju-e4d256-prod-github-runner-207 kernel: [78052.610016] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 03:04:38 juju-e4d256-prod-github-runner-207 kernel: [78052.610787] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 03:04:38 juju-e4d256-prod-github-runner-207 kernel: [78052.611516] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 03:04:38 juju-e4d256-prod-github-runner-207 kernel: [78052.612243] ? do_syscall_64+0x69/0xc0 Aug 23 03:04:38 juju-e4d256-prod-github-runner-207 kernel: [78052.612887] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 03:04:38 juju-e4d256-prod-github-runner-207 kernel: [78052.613594] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 03:04:38 juju-e4d256-prod-github-runner-207 kernel: [78052.614405] ? do_syscall_64+0x69/0xc0 Aug 23 03:04:38 juju-e4d256-prod-github-runner-207 kernel: [78052.615028] ? do_syscall_64+0x69/0xc0 Aug 23 03:04:38 juju-e4d256-prod-github-runner-207 kernel: [78052.615655] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 03:04:38 juju-e4d256-prod-github-runner-207 kernel: [78052.616363] RIP: 0033:0x7faa5d0edaff Aug 23 03:04:38 juju-e4d256-prod-github-runner-207 kernel: [78052.617006] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 03:04:38 juju-e4d256-prod-github-runner-207 kernel: [78052.619007] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 03:04:38 juju-e4d256-prod-github-runner-207 kernel: [78052.619917] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 03:04:38 juju-e4d256-prod-github-runner-207 kernel: [78052.620808] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 03:04:38 juju-e4d256-prod-github-runner-207 kernel: [78052.621697] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 03:04:38 juju-e4d256-prod-github-runner-207 kernel: [78052.622592] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 03:04:38 juju-e4d256-prod-github-runner-207 kernel: [78052.623486] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 03:04:38 juju-e4d256-prod-github-runner-207 kernel: [78052.624394] Aug 23 03:05:06 juju-e4d256-prod-github-runner-207 kernel: [78080.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 72610s! [qemu-system-x86:6715] Aug 23 03:05:06 juju-e4d256-prod-github-runner-207 kernel: [78080.543134] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 03:05:06 juju-e4d256-prod-github-runner-207 kernel: [78080.543215] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 03:05:06 juju-e4d256-prod-github-runner-207 kernel: [78080.555496] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 03:05:06 juju-e4d256-prod-github-runner-207 kernel: [78080.556772] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 03:05:06 juju-e4d256-prod-github-runner-207 kernel: [78080.558015] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 03:05:06 juju-e4d256-prod-github-runner-207 kernel: [78080.559087] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 03:05:06 juju-e4d256-prod-github-runner-207 kernel: [78080.561658] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 03:05:06 juju-e4d256-prod-github-runner-207 kernel: [78080.562752] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 03:05:06 juju-e4d256-prod-github-runner-207 kernel: [78080.563962] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 03:05:06 juju-e4d256-prod-github-runner-207 kernel: [78080.565155] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 03:05:06 juju-e4d256-prod-github-runner-207 kernel: [78080.566465] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 03:05:06 juju-e4d256-prod-github-runner-207 kernel: [78080.567657] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 03:05:06 juju-e4d256-prod-github-runner-207 kernel: [78080.568876] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 03:05:06 juju-e4d256-prod-github-runner-207 kernel: [78080.570231] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 03:05:06 juju-e4d256-prod-github-runner-207 kernel: [78080.571348] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 03:05:06 juju-e4d256-prod-github-runner-207 kernel: [78080.572567] Call Trace: Aug 23 03:05:06 juju-e4d256-prod-github-runner-207 kernel: [78080.573502] Aug 23 03:05:06 juju-e4d256-prod-github-runner-207 kernel: [78080.574493] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 03:05:06 juju-e4d256-prod-github-runner-207 kernel: [78080.575578] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 03:05:06 juju-e4d256-prod-github-runner-207 kernel: [78080.576619] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 03:05:06 juju-e4d256-prod-github-runner-207 kernel: [78080.577708] ? show_regs.part.0+0x23/0x29 Aug 23 03:05:06 juju-e4d256-prod-github-runner-207 kernel: [78080.578733] ? show_regs.cold+0x8/0xd Aug 23 03:05:06 juju-e4d256-prod-github-runner-207 kernel: [78080.579742] ? watchdog_timer_fn+0x1be/0x220 Aug 23 03:05:06 juju-e4d256-prod-github-runner-207 kernel: [78080.580784] ? lockup_detector_update_enable+0x60/0x60 Aug 23 03:05:06 juju-e4d256-prod-github-runner-207 kernel: [78080.581877] ? __hrtimer_run_queues+0x107/0x230 Aug 23 03:05:06 juju-e4d256-prod-github-runner-207 kernel: [78080.582951] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 03:05:06 juju-e4d256-prod-github-runner-207 kernel: [78080.583988] ? hrtimer_interrupt+0x101/0x220 Aug 23 03:05:06 juju-e4d256-prod-github-runner-207 kernel: [78080.585034] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 03:05:06 juju-e4d256-prod-github-runner-207 kernel: [78080.586127] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 03:05:06 juju-e4d256-prod-github-runner-207 kernel: [78080.587185] Aug 23 03:05:06 juju-e4d256-prod-github-runner-207 kernel: [78080.588137] Aug 23 03:05:06 juju-e4d256-prod-github-runner-207 kernel: [78080.589135] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 03:05:06 juju-e4d256-prod-github-runner-207 kernel: [78080.590257] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 03:05:06 juju-e4d256-prod-github-runner-207 kernel: [78080.591305] ? _raw_spin_lock+0x22/0x30 Aug 23 03:05:06 juju-e4d256-prod-github-runner-207 kernel: [78080.592257] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 03:05:06 juju-e4d256-prod-github-runner-207 kernel: [78080.593286] direct_page_fault+0x206/0x310 [kvm] Aug 23 03:05:06 juju-e4d256-prod-github-runner-207 kernel: [78080.594357] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 03:05:06 juju-e4d256-prod-github-runner-207 kernel: [78080.595437] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 03:05:06 juju-e4d256-prod-github-runner-207 kernel: [78080.596457] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 03:05:06 juju-e4d256-prod-github-runner-207 kernel: [78080.597436] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 03:05:06 juju-e4d256-prod-github-runner-207 kernel: [78080.598417] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 03:05:06 juju-e4d256-prod-github-runner-207 kernel: [78080.599415] handle_exit+0x98/0x230 [kvm_amd] Aug 23 03:05:06 juju-e4d256-prod-github-runner-207 kernel: [78080.600325] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 03:05:06 juju-e4d256-prod-github-runner-207 kernel: [78080.601255] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 03:05:06 juju-e4d256-prod-github-runner-207 kernel: [78080.602367] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 03:05:06 juju-e4d256-prod-github-runner-207 kernel: [78080.603282] vcpu_run+0x62/0x2c0 [kvm] Aug 23 03:05:06 juju-e4d256-prod-github-runner-207 kernel: [78080.604105] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 03:05:06 juju-e4d256-prod-github-runner-207 kernel: [78080.604926] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 03:05:06 juju-e4d256-prod-github-runner-207 kernel: [78080.605816] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 03:05:06 juju-e4d256-prod-github-runner-207 kernel: [78080.606650] ? __seccomp_filter+0x4a/0x4a0 Aug 23 03:05:06 juju-e4d256-prod-github-runner-207 kernel: [78080.607507] ? __fget_files+0x86/0xc0 Aug 23 03:05:06 juju-e4d256-prod-github-runner-207 kernel: [78080.608221] __x64_sys_ioctl+0x95/0xd0 Aug 23 03:05:06 juju-e4d256-prod-github-runner-207 kernel: [78080.608915] do_syscall_64+0x5c/0xc0 Aug 23 03:05:06 juju-e4d256-prod-github-runner-207 kernel: [78080.609607] ? do_futex+0x162/0x1f0 Aug 23 03:05:06 juju-e4d256-prod-github-runner-207 kernel: [78080.610337] ? __x64_sys_futex+0x78/0x1e0 Aug 23 03:05:06 juju-e4d256-prod-github-runner-207 kernel: [78080.611020] ? __secure_computing+0xa9/0x120 Aug 23 03:05:06 juju-e4d256-prod-github-runner-207 kernel: [78080.611718] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 03:05:06 juju-e4d256-prod-github-runner-207 kernel: [78080.612483] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 03:05:06 juju-e4d256-prod-github-runner-207 kernel: [78080.613208] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 03:05:06 juju-e4d256-prod-github-runner-207 kernel: [78080.613942] ? do_syscall_64+0x69/0xc0 Aug 23 03:05:06 juju-e4d256-prod-github-runner-207 kernel: [78080.614635] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 03:05:06 juju-e4d256-prod-github-runner-207 kernel: [78080.615356] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 03:05:06 juju-e4d256-prod-github-runner-207 kernel: [78080.616066] ? do_syscall_64+0x69/0xc0 Aug 23 03:05:06 juju-e4d256-prod-github-runner-207 kernel: [78080.616694] ? do_syscall_64+0x69/0xc0 Aug 23 03:05:06 juju-e4d256-prod-github-runner-207 kernel: [78080.617330] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 03:05:06 juju-e4d256-prod-github-runner-207 kernel: [78080.618064] RIP: 0033:0x7faa5d0edaff Aug 23 03:05:06 juju-e4d256-prod-github-runner-207 kernel: [78080.618698] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 03:05:06 juju-e4d256-prod-github-runner-207 kernel: [78080.620713] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 03:05:06 juju-e4d256-prod-github-runner-207 kernel: [78080.621642] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 03:05:06 juju-e4d256-prod-github-runner-207 kernel: [78080.622555] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 03:05:06 juju-e4d256-prod-github-runner-207 kernel: [78080.623448] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 03:05:06 juju-e4d256-prod-github-runner-207 kernel: [78080.624351] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 03:05:06 juju-e4d256-prod-github-runner-207 kernel: [78080.625253] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 03:05:06 juju-e4d256-prod-github-runner-207 kernel: [78080.626218] Aug 23 03:05:34 juju-e4d256-prod-github-runner-207 kernel: [78108.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 72636s! [qemu-system-x86:6715] Aug 23 03:05:34 juju-e4d256-prod-github-runner-207 kernel: [78108.543940] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 03:05:34 juju-e4d256-prod-github-runner-207 kernel: [78108.544259] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 03:05:34 juju-e4d256-prod-github-runner-207 kernel: [78108.556386] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 03:05:34 juju-e4d256-prod-github-runner-207 kernel: [78108.557689] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 03:05:34 juju-e4d256-prod-github-runner-207 kernel: [78108.558908] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 03:05:34 juju-e4d256-prod-github-runner-207 kernel: [78108.559964] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 03:05:34 juju-e4d256-prod-github-runner-207 kernel: [78108.562570] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 03:05:34 juju-e4d256-prod-github-runner-207 kernel: [78108.563619] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 03:05:34 juju-e4d256-prod-github-runner-207 kernel: [78108.564792] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 03:05:34 juju-e4d256-prod-github-runner-207 kernel: [78108.565965] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 03:05:34 juju-e4d256-prod-github-runner-207 kernel: [78108.567127] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 03:05:34 juju-e4d256-prod-github-runner-207 kernel: [78108.568370] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 03:05:34 juju-e4d256-prod-github-runner-207 kernel: [78108.569561] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 03:05:34 juju-e4d256-prod-github-runner-207 kernel: [78108.570838] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 03:05:34 juju-e4d256-prod-github-runner-207 kernel: [78108.571937] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 03:05:34 juju-e4d256-prod-github-runner-207 kernel: [78108.573175] Call Trace: Aug 23 03:05:34 juju-e4d256-prod-github-runner-207 kernel: [78108.574114] Aug 23 03:05:34 juju-e4d256-prod-github-runner-207 kernel: [78108.575017] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 03:05:34 juju-e4d256-prod-github-runner-207 kernel: [78108.576047] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 03:05:34 juju-e4d256-prod-github-runner-207 kernel: [78108.577070] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 03:05:34 juju-e4d256-prod-github-runner-207 kernel: [78108.578175] ? show_regs.part.0+0x23/0x29 Aug 23 03:05:34 juju-e4d256-prod-github-runner-207 kernel: [78108.579171] ? show_regs.cold+0x8/0xd Aug 23 03:05:34 juju-e4d256-prod-github-runner-207 kernel: [78108.580142] ? watchdog_timer_fn+0x1be/0x220 Aug 23 03:05:34 juju-e4d256-prod-github-runner-207 kernel: [78108.581204] ? lockup_detector_update_enable+0x60/0x60 Aug 23 03:05:34 juju-e4d256-prod-github-runner-207 kernel: [78108.582331] ? __hrtimer_run_queues+0x107/0x230 Aug 23 03:05:34 juju-e4d256-prod-github-runner-207 kernel: [78108.583364] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 03:05:34 juju-e4d256-prod-github-runner-207 kernel: [78108.584409] ? hrtimer_interrupt+0x101/0x220 Aug 23 03:05:34 juju-e4d256-prod-github-runner-207 kernel: [78108.585493] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 03:05:34 juju-e4d256-prod-github-runner-207 kernel: [78108.586600] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 03:05:34 juju-e4d256-prod-github-runner-207 kernel: [78108.587647] Aug 23 03:05:34 juju-e4d256-prod-github-runner-207 kernel: [78108.588503] Aug 23 03:05:34 juju-e4d256-prod-github-runner-207 kernel: [78108.589339] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 03:05:34 juju-e4d256-prod-github-runner-207 kernel: [78108.590403] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 03:05:34 juju-e4d256-prod-github-runner-207 kernel: [78108.591451] ? _raw_spin_lock+0x22/0x30 Aug 23 03:05:34 juju-e4d256-prod-github-runner-207 kernel: [78108.592399] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 03:05:34 juju-e4d256-prod-github-runner-207 kernel: [78108.593419] direct_page_fault+0x206/0x310 [kvm] Aug 23 03:05:34 juju-e4d256-prod-github-runner-207 kernel: [78108.594456] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 03:05:34 juju-e4d256-prod-github-runner-207 kernel: [78108.595462] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 03:05:34 juju-e4d256-prod-github-runner-207 kernel: [78108.596459] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 03:05:34 juju-e4d256-prod-github-runner-207 kernel: [78108.597460] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 03:05:34 juju-e4d256-prod-github-runner-207 kernel: [78108.598417] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 03:05:34 juju-e4d256-prod-github-runner-207 kernel: [78108.599396] handle_exit+0x98/0x230 [kvm_amd] Aug 23 03:05:34 juju-e4d256-prod-github-runner-207 kernel: [78108.600286] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 03:05:34 juju-e4d256-prod-github-runner-207 kernel: [78108.601197] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 03:05:34 juju-e4d256-prod-github-runner-207 kernel: [78108.602157] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 03:05:34 juju-e4d256-prod-github-runner-207 kernel: [78108.603120] vcpu_run+0x62/0x2c0 [kvm] Aug 23 03:05:34 juju-e4d256-prod-github-runner-207 kernel: [78108.604073] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 03:05:34 juju-e4d256-prod-github-runner-207 kernel: [78108.604893] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 03:05:34 juju-e4d256-prod-github-runner-207 kernel: [78108.605762] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 03:05:34 juju-e4d256-prod-github-runner-207 kernel: [78108.606556] ? __seccomp_filter+0x4a/0x4a0 Aug 23 03:05:34 juju-e4d256-prod-github-runner-207 kernel: [78108.607297] ? __fget_files+0x86/0xc0 Aug 23 03:05:34 juju-e4d256-prod-github-runner-207 kernel: [78108.607998] __x64_sys_ioctl+0x95/0xd0 Aug 23 03:05:34 juju-e4d256-prod-github-runner-207 kernel: [78108.608725] do_syscall_64+0x5c/0xc0 Aug 23 03:05:34 juju-e4d256-prod-github-runner-207 kernel: [78108.609386] ? do_futex+0x162/0x1f0 Aug 23 03:05:34 juju-e4d256-prod-github-runner-207 kernel: [78108.610068] ? __x64_sys_futex+0x78/0x1e0 Aug 23 03:05:34 juju-e4d256-prod-github-runner-207 kernel: [78108.610817] ? __secure_computing+0xa9/0x120 Aug 23 03:05:34 juju-e4d256-prod-github-runner-207 kernel: [78108.611552] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 03:05:34 juju-e4d256-prod-github-runner-207 kernel: [78108.612346] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 03:05:34 juju-e4d256-prod-github-runner-207 kernel: [78108.613084] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 03:05:34 juju-e4d256-prod-github-runner-207 kernel: [78108.613837] ? do_syscall_64+0x69/0xc0 Aug 23 03:05:34 juju-e4d256-prod-github-runner-207 kernel: [78108.614489] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 03:05:34 juju-e4d256-prod-github-runner-207 kernel: [78108.615190] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 03:05:34 juju-e4d256-prod-github-runner-207 kernel: [78108.615904] ? do_syscall_64+0x69/0xc0 Aug 23 03:05:34 juju-e4d256-prod-github-runner-207 kernel: [78108.616595] ? do_syscall_64+0x69/0xc0 Aug 23 03:05:34 juju-e4d256-prod-github-runner-207 kernel: [78108.617272] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 03:05:34 juju-e4d256-prod-github-runner-207 kernel: [78108.618012] RIP: 0033:0x7faa5d0edaff Aug 23 03:05:34 juju-e4d256-prod-github-runner-207 kernel: [78108.618666] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 03:05:34 juju-e4d256-prod-github-runner-207 kernel: [78108.620647] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 03:05:34 juju-e4d256-prod-github-runner-207 kernel: [78108.621557] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 03:05:34 juju-e4d256-prod-github-runner-207 kernel: [78108.622459] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 03:05:34 juju-e4d256-prod-github-runner-207 kernel: [78108.623347] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 03:05:34 juju-e4d256-prod-github-runner-207 kernel: [78108.624244] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 03:05:34 juju-e4d256-prod-github-runner-207 kernel: [78108.625138] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 03:05:34 juju-e4d256-prod-github-runner-207 kernel: [78108.626039] Aug 23 03:05:48 juju-e4d256-prod-github-runner-207 kernel: [78122.396710] rcu: INFO: rcu_sched self-detected stall on CPU Aug 23 03:05:48 juju-e4d256-prod-github-runner-207 kernel: [78122.397764] rcu: 1-....: (19440093 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=9399394 Aug 23 03:05:48 juju-e4d256-prod-github-runner-207 kernel: [78122.398917] (t=19501299 jiffies g=23269 q=65454) Aug 23 03:05:48 juju-e4d256-prod-github-runner-207 kernel: [78122.399721] NMI backtrace for cpu 1 Aug 23 03:05:48 juju-e4d256-prod-github-runner-207 kernel: [78122.400433] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 03:05:48 juju-e4d256-prod-github-runner-207 kernel: [78122.401586] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 03:05:48 juju-e4d256-prod-github-runner-207 kernel: [78122.402650] Call Trace: Aug 23 03:05:48 juju-e4d256-prod-github-runner-207 kernel: [78122.403390] Aug 23 03:05:48 juju-e4d256-prod-github-runner-207 kernel: [78122.404165] show_stack+0x52/0x5c Aug 23 03:05:48 juju-e4d256-prod-github-runner-207 kernel: [78122.404898] dump_stack_lvl+0x4a/0x63 Aug 23 03:05:48 juju-e4d256-prod-github-runner-207 kernel: [78122.405662] dump_stack+0x10/0x16 Aug 23 03:05:48 juju-e4d256-prod-github-runner-207 kernel: [78122.406379] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 23 03:05:48 juju-e4d256-prod-github-runner-207 kernel: [78122.407156] ? lapic_can_unplug_cpu+0x90/0x90 Aug 23 03:05:48 juju-e4d256-prod-github-runner-207 kernel: [78122.407936] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 23 03:05:48 juju-e4d256-prod-github-runner-207 kernel: [78122.408775] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 23 03:05:48 juju-e4d256-prod-github-runner-207 kernel: [78122.409615] trigger_single_cpu_backtrace+0x44/0x4f Aug 23 03:05:48 juju-e4d256-prod-github-runner-207 kernel: [78122.410425] rcu_dump_cpu_stacks+0x102/0x149 Aug 23 03:05:48 juju-e4d256-prod-github-runner-207 kernel: [78122.411220] print_cpu_stall.cold+0x2f/0xe2 Aug 23 03:05:48 juju-e4d256-prod-github-runner-207 kernel: [78122.412002] ? timekeeping_update+0xf7/0x150 Aug 23 03:05:48 juju-e4d256-prod-github-runner-207 kernel: [78122.412771] check_cpu_stall+0x109/0x270 Aug 23 03:05:48 juju-e4d256-prod-github-runner-207 kernel: [78122.413561] rcu_sched_clock_irq+0x9a/0x250 Aug 23 03:05:48 juju-e4d256-prod-github-runner-207 kernel: [78122.414323] update_process_times+0x94/0xd0 Aug 23 03:05:48 juju-e4d256-prod-github-runner-207 kernel: [78122.415081] tick_sched_handle+0x29/0x70 Aug 23 03:05:48 juju-e4d256-prod-github-runner-207 kernel: [78122.415823] tick_sched_timer+0x8c/0xc0 Aug 23 03:05:48 juju-e4d256-prod-github-runner-207 kernel: [78122.416558] ? tick_nohz_handler+0xb0/0xb0 Aug 23 03:05:48 juju-e4d256-prod-github-runner-207 kernel: [78122.417314] __hrtimer_run_queues+0x107/0x230 Aug 23 03:05:48 juju-e4d256-prod-github-runner-207 kernel: [78122.418113] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 03:05:48 juju-e4d256-prod-github-runner-207 kernel: [78122.419112] hrtimer_interrupt+0x101/0x220 Aug 23 03:05:48 juju-e4d256-prod-github-runner-207 kernel: [78122.419875] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 03:05:48 juju-e4d256-prod-github-runner-207 kernel: [78122.420688] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 03:05:48 juju-e4d256-prod-github-runner-207 kernel: [78122.421525] Aug 23 03:05:48 juju-e4d256-prod-github-runner-207 kernel: [78122.422179] Aug 23 03:05:48 juju-e4d256-prod-github-runner-207 kernel: [78122.422812] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 03:05:48 juju-e4d256-prod-github-runner-207 kernel: [78122.423638] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 03:05:48 juju-e4d256-prod-github-runner-207 kernel: [78122.424527] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 03:05:48 juju-e4d256-prod-github-runner-207 kernel: [78122.426891] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 03:05:48 juju-e4d256-prod-github-runner-207 kernel: [78122.427779] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 03:05:48 juju-e4d256-prod-github-runner-207 kernel: [78122.428778] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 03:05:48 juju-e4d256-prod-github-runner-207 kernel: [78122.429818] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 03:05:48 juju-e4d256-prod-github-runner-207 kernel: [78122.430790] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 03:05:48 juju-e4d256-prod-github-runner-207 kernel: [78122.431747] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 03:05:48 juju-e4d256-prod-github-runner-207 kernel: [78122.432852] ? _raw_spin_lock+0x22/0x30 Aug 23 03:05:48 juju-e4d256-prod-github-runner-207 kernel: [78122.433842] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 03:05:48 juju-e4d256-prod-github-runner-207 kernel: [78122.434770] direct_page_fault+0x206/0x310 [kvm] Aug 23 03:05:48 juju-e4d256-prod-github-runner-207 kernel: [78122.435783] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 03:05:48 juju-e4d256-prod-github-runner-207 kernel: [78122.436622] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 03:05:48 juju-e4d256-prod-github-runner-207 kernel: [78122.437465] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 03:05:48 juju-e4d256-prod-github-runner-207 kernel: [78122.438302] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 03:05:48 juju-e4d256-prod-github-runner-207 kernel: [78122.439088] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 03:05:48 juju-e4d256-prod-github-runner-207 kernel: [78122.439916] handle_exit+0x98/0x230 [kvm_amd] Aug 23 03:05:48 juju-e4d256-prod-github-runner-207 kernel: [78122.440676] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 03:05:48 juju-e4d256-prod-github-runner-207 kernel: [78122.441492] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 03:05:48 juju-e4d256-prod-github-runner-207 kernel: [78122.442312] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 03:05:48 juju-e4d256-prod-github-runner-207 kernel: [78122.443113] vcpu_run+0x62/0x2c0 [kvm] Aug 23 03:05:48 juju-e4d256-prod-github-runner-207 kernel: [78122.443833] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 03:05:48 juju-e4d256-prod-github-runner-207 kernel: [78122.444570] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 03:05:48 juju-e4d256-prod-github-runner-207 kernel: [78122.445372] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 03:05:48 juju-e4d256-prod-github-runner-207 kernel: [78122.446151] ? __seccomp_filter+0x4a/0x4a0 Aug 23 03:05:48 juju-e4d256-prod-github-runner-207 kernel: [78122.446874] ? __fget_files+0x86/0xc0 Aug 23 03:05:48 juju-e4d256-prod-github-runner-207 kernel: [78122.447591] __x64_sys_ioctl+0x95/0xd0 Aug 23 03:05:48 juju-e4d256-prod-github-runner-207 kernel: [78122.448286] do_syscall_64+0x5c/0xc0 Aug 23 03:05:48 juju-e4d256-prod-github-runner-207 kernel: [78122.448975] ? do_futex+0x162/0x1f0 Aug 23 03:05:48 juju-e4d256-prod-github-runner-207 kernel: [78122.449671] ? __x64_sys_futex+0x78/0x1e0 Aug 23 03:05:48 juju-e4d256-prod-github-runner-207 kernel: [78122.450372] ? __secure_computing+0xa9/0x120 Aug 23 03:05:48 juju-e4d256-prod-github-runner-207 kernel: [78122.451092] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 03:05:48 juju-e4d256-prod-github-runner-207 kernel: [78122.451880] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 03:05:48 juju-e4d256-prod-github-runner-207 kernel: [78122.452651] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 03:05:48 juju-e4d256-prod-github-runner-207 kernel: [78122.453422] ? do_syscall_64+0x69/0xc0 Aug 23 03:05:48 juju-e4d256-prod-github-runner-207 kernel: [78122.454131] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 03:05:48 juju-e4d256-prod-github-runner-207 kernel: [78122.454902] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 03:05:48 juju-e4d256-prod-github-runner-207 kernel: [78122.455661] ? do_syscall_64+0x69/0xc0 Aug 23 03:05:48 juju-e4d256-prod-github-runner-207 kernel: [78122.456361] ? do_syscall_64+0x69/0xc0 Aug 23 03:05:48 juju-e4d256-prod-github-runner-207 kernel: [78122.457053] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 03:05:48 juju-e4d256-prod-github-runner-207 kernel: [78122.457844] RIP: 0033:0x7faa5d0edaff Aug 23 03:05:48 juju-e4d256-prod-github-runner-207 kernel: [78122.458553] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 03:05:48 juju-e4d256-prod-github-runner-207 kernel: [78122.460650] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 03:05:48 juju-e4d256-prod-github-runner-207 kernel: [78122.461626] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 03:05:48 juju-e4d256-prod-github-runner-207 kernel: [78122.462575] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 03:05:48 juju-e4d256-prod-github-runner-207 kernel: [78122.463549] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 03:05:48 juju-e4d256-prod-github-runner-207 kernel: [78122.464495] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 03:05:48 juju-e4d256-prod-github-runner-207 kernel: [78122.465428] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 03:05:48 juju-e4d256-prod-github-runner-207 kernel: [78122.466362] Aug 23 03:06:14 juju-e4d256-prod-github-runner-207 kernel: [78148.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 72673s! [qemu-system-x86:6715] Aug 23 03:06:14 juju-e4d256-prod-github-runner-207 kernel: [78148.543127] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 03:06:14 juju-e4d256-prod-github-runner-207 kernel: [78148.543201] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 03:06:14 juju-e4d256-prod-github-runner-207 kernel: [78148.555769] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 03:06:14 juju-e4d256-prod-github-runner-207 kernel: [78148.557057] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 03:06:14 juju-e4d256-prod-github-runner-207 kernel: [78148.558308] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 03:06:14 juju-e4d256-prod-github-runner-207 kernel: [78148.559381] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 03:06:14 juju-e4d256-prod-github-runner-207 kernel: [78148.562201] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 03:06:14 juju-e4d256-prod-github-runner-207 kernel: [78148.563396] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 03:06:14 juju-e4d256-prod-github-runner-207 kernel: [78148.564562] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 03:06:14 juju-e4d256-prod-github-runner-207 kernel: [78148.565733] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 03:06:14 juju-e4d256-prod-github-runner-207 kernel: [78148.566897] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 03:06:14 juju-e4d256-prod-github-runner-207 kernel: [78148.568057] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 03:06:14 juju-e4d256-prod-github-runner-207 kernel: [78148.569238] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 03:06:14 juju-e4d256-prod-github-runner-207 kernel: [78148.570476] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 03:06:14 juju-e4d256-prod-github-runner-207 kernel: [78148.571571] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 03:06:14 juju-e4d256-prod-github-runner-207 kernel: [78148.572760] Call Trace: Aug 23 03:06:14 juju-e4d256-prod-github-runner-207 kernel: [78148.573677] Aug 23 03:06:14 juju-e4d256-prod-github-runner-207 kernel: [78148.574566] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 03:06:14 juju-e4d256-prod-github-runner-207 kernel: [78148.575598] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 03:06:14 juju-e4d256-prod-github-runner-207 kernel: [78148.576636] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 03:06:14 juju-e4d256-prod-github-runner-207 kernel: [78148.577762] ? show_regs.part.0+0x23/0x29 Aug 23 03:06:14 juju-e4d256-prod-github-runner-207 kernel: [78148.578768] ? show_regs.cold+0x8/0xd Aug 23 03:06:14 juju-e4d256-prod-github-runner-207 kernel: [78148.579741] ? watchdog_timer_fn+0x1be/0x220 Aug 23 03:06:14 juju-e4d256-prod-github-runner-207 kernel: [78148.580751] ? lockup_detector_update_enable+0x60/0x60 Aug 23 03:06:14 juju-e4d256-prod-github-runner-207 kernel: [78148.581828] ? __hrtimer_run_queues+0x107/0x230 Aug 23 03:06:14 juju-e4d256-prod-github-runner-207 kernel: [78148.582859] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 03:06:14 juju-e4d256-prod-github-runner-207 kernel: [78148.583881] ? hrtimer_interrupt+0x101/0x220 Aug 23 03:06:14 juju-e4d256-prod-github-runner-207 kernel: [78148.584896] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 03:06:14 juju-e4d256-prod-github-runner-207 kernel: [78148.585983] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 03:06:14 juju-e4d256-prod-github-runner-207 kernel: [78148.587028] Aug 23 03:06:14 juju-e4d256-prod-github-runner-207 kernel: [78148.587879] Aug 23 03:06:14 juju-e4d256-prod-github-runner-207 kernel: [78148.588714] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 03:06:14 juju-e4d256-prod-github-runner-207 kernel: [78148.589762] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 03:06:14 juju-e4d256-prod-github-runner-207 kernel: [78148.590805] ? _raw_spin_lock+0x22/0x30 Aug 23 03:06:14 juju-e4d256-prod-github-runner-207 kernel: [78148.591749] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 03:06:14 juju-e4d256-prod-github-runner-207 kernel: [78148.592763] direct_page_fault+0x206/0x310 [kvm] Aug 23 03:06:14 juju-e4d256-prod-github-runner-207 kernel: [78148.593793] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 03:06:14 juju-e4d256-prod-github-runner-207 kernel: [78148.594805] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 03:06:14 juju-e4d256-prod-github-runner-207 kernel: [78148.595808] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 03:06:14 juju-e4d256-prod-github-runner-207 kernel: [78148.596776] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 03:06:14 juju-e4d256-prod-github-runner-207 kernel: [78148.597727] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 03:06:14 juju-e4d256-prod-github-runner-207 kernel: [78148.598704] handle_exit+0x98/0x230 [kvm_amd] Aug 23 03:06:14 juju-e4d256-prod-github-runner-207 kernel: [78148.599595] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 03:06:14 juju-e4d256-prod-github-runner-207 kernel: [78148.600506] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 03:06:14 juju-e4d256-prod-github-runner-207 kernel: [78148.601438] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 03:06:14 juju-e4d256-prod-github-runner-207 kernel: [78148.602342] vcpu_run+0x62/0x2c0 [kvm] Aug 23 03:06:14 juju-e4d256-prod-github-runner-207 kernel: [78148.603152] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 03:06:14 juju-e4d256-prod-github-runner-207 kernel: [78148.603960] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 03:06:14 juju-e4d256-prod-github-runner-207 kernel: [78148.604815] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 03:06:14 juju-e4d256-prod-github-runner-207 kernel: [78148.605621] ? __seccomp_filter+0x4a/0x4a0 Aug 23 03:06:14 juju-e4d256-prod-github-runner-207 kernel: [78148.606442] ? __fget_files+0x86/0xc0 Aug 23 03:06:14 juju-e4d256-prod-github-runner-207 kernel: [78148.607151] __x64_sys_ioctl+0x95/0xd0 Aug 23 03:06:14 juju-e4d256-prod-github-runner-207 kernel: [78148.607844] do_syscall_64+0x5c/0xc0 Aug 23 03:06:14 juju-e4d256-prod-github-runner-207 kernel: [78148.608509] ? do_futex+0x162/0x1f0 Aug 23 03:06:14 juju-e4d256-prod-github-runner-207 kernel: [78148.609184] ? __x64_sys_futex+0x78/0x1e0 Aug 23 03:06:14 juju-e4d256-prod-github-runner-207 kernel: [78148.609861] ? __secure_computing+0xa9/0x120 Aug 23 03:06:14 juju-e4d256-prod-github-runner-207 kernel: [78148.610550] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 03:06:14 juju-e4d256-prod-github-runner-207 kernel: [78148.611315] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 03:06:14 juju-e4d256-prod-github-runner-207 kernel: [78148.612036] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 03:06:14 juju-e4d256-prod-github-runner-207 kernel: [78148.612754] ? do_syscall_64+0x69/0xc0 Aug 23 03:06:14 juju-e4d256-prod-github-runner-207 kernel: [78148.613407] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 03:06:14 juju-e4d256-prod-github-runner-207 kernel: [78148.614111] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 03:06:14 juju-e4d256-prod-github-runner-207 kernel: [78148.614811] ? do_syscall_64+0x69/0xc0 Aug 23 03:06:14 juju-e4d256-prod-github-runner-207 kernel: [78148.615437] ? do_syscall_64+0x69/0xc0 Aug 23 03:06:14 juju-e4d256-prod-github-runner-207 kernel: [78148.616070] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 03:06:14 juju-e4d256-prod-github-runner-207 kernel: [78148.616780] RIP: 0033:0x7faa5d0edaff Aug 23 03:06:14 juju-e4d256-prod-github-runner-207 kernel: [78148.617413] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 03:06:14 juju-e4d256-prod-github-runner-207 kernel: [78148.619395] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 03:06:14 juju-e4d256-prod-github-runner-207 kernel: [78148.620310] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 03:06:14 juju-e4d256-prod-github-runner-207 kernel: [78148.621216] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 03:06:14 juju-e4d256-prod-github-runner-207 kernel: [78148.622110] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 03:06:14 juju-e4d256-prod-github-runner-207 kernel: [78148.623035] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 03:06:14 juju-e4d256-prod-github-runner-207 kernel: [78148.623931] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 03:06:14 juju-e4d256-prod-github-runner-207 kernel: [78148.624841] Aug 23 03:06:42 juju-e4d256-prod-github-runner-207 kernel: [78176.541981] watchdog: BUG: soft lockup - CPU#1 stuck for 72699s! [qemu-system-x86:6715] Aug 23 03:06:42 juju-e4d256-prod-github-runner-207 kernel: [78176.543102] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 03:06:42 juju-e4d256-prod-github-runner-207 kernel: [78176.543176] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 03:06:42 juju-e4d256-prod-github-runner-207 kernel: [78176.555443] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 03:06:42 juju-e4d256-prod-github-runner-207 kernel: [78176.556746] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 03:06:42 juju-e4d256-prod-github-runner-207 kernel: [78176.557989] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 03:06:42 juju-e4d256-prod-github-runner-207 kernel: [78176.559055] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 03:06:42 juju-e4d256-prod-github-runner-207 kernel: [78176.561644] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 03:06:42 juju-e4d256-prod-github-runner-207 kernel: [78176.562722] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 03:06:42 juju-e4d256-prod-github-runner-207 kernel: [78176.563880] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 03:06:42 juju-e4d256-prod-github-runner-207 kernel: [78176.565057] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 03:06:42 juju-e4d256-prod-github-runner-207 kernel: [78176.566268] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 03:06:42 juju-e4d256-prod-github-runner-207 kernel: [78176.567481] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 03:06:42 juju-e4d256-prod-github-runner-207 kernel: [78176.568669] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 03:06:42 juju-e4d256-prod-github-runner-207 kernel: [78176.569930] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 03:06:42 juju-e4d256-prod-github-runner-207 kernel: [78176.571027] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 03:06:42 juju-e4d256-prod-github-runner-207 kernel: [78176.572255] Call Trace: Aug 23 03:06:42 juju-e4d256-prod-github-runner-207 kernel: [78176.573225] Aug 23 03:06:42 juju-e4d256-prod-github-runner-207 kernel: [78176.574113] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 03:06:42 juju-e4d256-prod-github-runner-207 kernel: [78176.575145] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 03:06:42 juju-e4d256-prod-github-runner-207 kernel: [78176.576170] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 03:06:42 juju-e4d256-prod-github-runner-207 kernel: [78176.577317] ? show_regs.part.0+0x23/0x29 Aug 23 03:06:42 juju-e4d256-prod-github-runner-207 kernel: [78176.578338] ? show_regs.cold+0x8/0xd Aug 23 03:06:42 juju-e4d256-prod-github-runner-207 kernel: [78176.579314] ? watchdog_timer_fn+0x1be/0x220 Aug 23 03:06:42 juju-e4d256-prod-github-runner-207 kernel: [78176.580324] ? lockup_detector_update_enable+0x60/0x60 Aug 23 03:06:42 juju-e4d256-prod-github-runner-207 kernel: [78176.581424] ? __hrtimer_run_queues+0x107/0x230 Aug 23 03:06:42 juju-e4d256-prod-github-runner-207 kernel: [78176.582491] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 03:06:42 juju-e4d256-prod-github-runner-207 kernel: [78176.583525] ? hrtimer_interrupt+0x101/0x220 Aug 23 03:06:42 juju-e4d256-prod-github-runner-207 kernel: [78176.584575] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 03:06:42 juju-e4d256-prod-github-runner-207 kernel: [78176.585680] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 03:06:42 juju-e4d256-prod-github-runner-207 kernel: [78176.586757] Aug 23 03:06:42 juju-e4d256-prod-github-runner-207 kernel: [78176.587625] Aug 23 03:06:42 juju-e4d256-prod-github-runner-207 kernel: [78176.588473] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 03:06:42 juju-e4d256-prod-github-runner-207 kernel: [78176.589533] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 03:06:42 juju-e4d256-prod-github-runner-207 kernel: [78176.590576] ? _raw_spin_lock+0x22/0x30 Aug 23 03:06:42 juju-e4d256-prod-github-runner-207 kernel: [78176.591523] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 03:06:42 juju-e4d256-prod-github-runner-207 kernel: [78176.592571] direct_page_fault+0x206/0x310 [kvm] Aug 23 03:06:42 juju-e4d256-prod-github-runner-207 kernel: [78176.593654] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 03:06:42 juju-e4d256-prod-github-runner-207 kernel: [78176.594674] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 03:06:42 juju-e4d256-prod-github-runner-207 kernel: [78176.595680] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 03:06:42 juju-e4d256-prod-github-runner-207 kernel: [78176.596810] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 03:06:42 juju-e4d256-prod-github-runner-207 kernel: [78176.597783] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 03:06:42 juju-e4d256-prod-github-runner-207 kernel: [78176.598803] handle_exit+0x98/0x230 [kvm_amd] Aug 23 03:06:42 juju-e4d256-prod-github-runner-207 kernel: [78176.599708] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 03:06:42 juju-e4d256-prod-github-runner-207 kernel: [78176.600634] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 03:06:42 juju-e4d256-prod-github-runner-207 kernel: [78176.601586] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 03:06:42 juju-e4d256-prod-github-runner-207 kernel: [78176.602512] vcpu_run+0x62/0x2c0 [kvm] Aug 23 03:06:42 juju-e4d256-prod-github-runner-207 kernel: [78176.603367] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 03:06:42 juju-e4d256-prod-github-runner-207 kernel: [78176.604186] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 03:06:42 juju-e4d256-prod-github-runner-207 kernel: [78176.605078] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 03:06:42 juju-e4d256-prod-github-runner-207 kernel: [78176.605885] ? __seccomp_filter+0x4a/0x4a0 Aug 23 03:06:42 juju-e4d256-prod-github-runner-207 kernel: [78176.606681] ? __fget_files+0x86/0xc0 Aug 23 03:06:42 juju-e4d256-prod-github-runner-207 kernel: [78176.607443] __x64_sys_ioctl+0x95/0xd0 Aug 23 03:06:42 juju-e4d256-prod-github-runner-207 kernel: [78176.608560] do_syscall_64+0x5c/0xc0 Aug 23 03:06:42 juju-e4d256-prod-github-runner-207 kernel: [78176.609301] ? do_futex+0x162/0x1f0 Aug 23 03:06:42 juju-e4d256-prod-github-runner-207 kernel: [78176.609961] ? __x64_sys_futex+0x78/0x1e0 Aug 23 03:06:42 juju-e4d256-prod-github-runner-207 kernel: [78176.610841] ? __secure_computing+0xa9/0x120 Aug 23 03:06:42 juju-e4d256-prod-github-runner-207 kernel: [78176.611642] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 03:06:42 juju-e4d256-prod-github-runner-207 kernel: [78176.612553] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 03:06:42 juju-e4d256-prod-github-runner-207 kernel: [78176.613406] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 03:06:42 juju-e4d256-prod-github-runner-207 kernel: [78176.614221] ? do_syscall_64+0x69/0xc0 Aug 23 03:06:42 juju-e4d256-prod-github-runner-207 kernel: [78176.614948] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 03:06:42 juju-e4d256-prod-github-runner-207 kernel: [78176.615745] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 03:06:42 juju-e4d256-prod-github-runner-207 kernel: [78176.616534] ? do_syscall_64+0x69/0xc0 Aug 23 03:06:42 juju-e4d256-prod-github-runner-207 kernel: [78176.617259] ? do_syscall_64+0x69/0xc0 Aug 23 03:06:42 juju-e4d256-prod-github-runner-207 kernel: [78176.617963] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 03:06:42 juju-e4d256-prod-github-runner-207 kernel: [78176.618776] RIP: 0033:0x7faa5d0edaff Aug 23 03:06:42 juju-e4d256-prod-github-runner-207 kernel: [78176.619487] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 03:06:42 juju-e4d256-prod-github-runner-207 kernel: [78176.621856] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 03:06:42 juju-e4d256-prod-github-runner-207 kernel: [78176.623090] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 03:06:42 juju-e4d256-prod-github-runner-207 kernel: [78176.624120] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 03:06:42 juju-e4d256-prod-github-runner-207 kernel: [78176.625167] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 03:06:42 juju-e4d256-prod-github-runner-207 kernel: [78176.626215] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 03:06:42 juju-e4d256-prod-github-runner-207 kernel: [78176.627272] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 03:06:42 juju-e4d256-prod-github-runner-207 kernel: [78176.628318] Aug 23 03:07:10 juju-e4d256-prod-github-runner-207 kernel: [78204.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 72725s! [qemu-system-x86:6715] Aug 23 03:07:10 juju-e4d256-prod-github-runner-207 kernel: [78204.543885] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 03:07:10 juju-e4d256-prod-github-runner-207 kernel: [78204.544184] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 03:07:10 juju-e4d256-prod-github-runner-207 kernel: [78204.556500] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 03:07:10 juju-e4d256-prod-github-runner-207 kernel: [78204.557810] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 03:07:10 juju-e4d256-prod-github-runner-207 kernel: [78204.559055] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 03:07:10 juju-e4d256-prod-github-runner-207 kernel: [78204.560133] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 03:07:10 juju-e4d256-prod-github-runner-207 kernel: [78204.562684] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 03:07:10 juju-e4d256-prod-github-runner-207 kernel: [78204.563785] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 03:07:10 juju-e4d256-prod-github-runner-207 kernel: [78204.565176] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 03:07:10 juju-e4d256-prod-github-runner-207 kernel: [78204.566429] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 03:07:10 juju-e4d256-prod-github-runner-207 kernel: [78204.567588] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 03:07:10 juju-e4d256-prod-github-runner-207 kernel: [78204.568770] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 03:07:10 juju-e4d256-prod-github-runner-207 kernel: [78204.569965] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 03:07:10 juju-e4d256-prod-github-runner-207 kernel: [78204.571205] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 03:07:10 juju-e4d256-prod-github-runner-207 kernel: [78204.572308] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 03:07:10 juju-e4d256-prod-github-runner-207 kernel: [78204.573518] Call Trace: Aug 23 03:07:10 juju-e4d256-prod-github-runner-207 kernel: [78204.574437] Aug 23 03:07:10 juju-e4d256-prod-github-runner-207 kernel: [78204.575332] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 03:07:10 juju-e4d256-prod-github-runner-207 kernel: [78204.576361] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 03:07:10 juju-e4d256-prod-github-runner-207 kernel: [78204.577393] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 03:07:10 juju-e4d256-prod-github-runner-207 kernel: [78204.578504] ? show_regs.part.0+0x23/0x29 Aug 23 03:07:10 juju-e4d256-prod-github-runner-207 kernel: [78204.579515] ? show_regs.cold+0x8/0xd Aug 23 03:07:10 juju-e4d256-prod-github-runner-207 kernel: [78204.580489] ? watchdog_timer_fn+0x1be/0x220 Aug 23 03:07:10 juju-e4d256-prod-github-runner-207 kernel: [78204.581507] ? lockup_detector_update_enable+0x60/0x60 Aug 23 03:07:10 juju-e4d256-prod-github-runner-207 kernel: [78204.582568] ? __hrtimer_run_queues+0x107/0x230 Aug 23 03:07:10 juju-e4d256-prod-github-runner-207 kernel: [78204.583594] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 03:07:10 juju-e4d256-prod-github-runner-207 kernel: [78204.584636] ? hrtimer_interrupt+0x101/0x220 Aug 23 03:07:10 juju-e4d256-prod-github-runner-207 kernel: [78204.585664] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 03:07:10 juju-e4d256-prod-github-runner-207 kernel: [78204.586763] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 03:07:10 juju-e4d256-prod-github-runner-207 kernel: [78204.587820] Aug 23 03:07:10 juju-e4d256-prod-github-runner-207 kernel: [78204.588702] Aug 23 03:07:10 juju-e4d256-prod-github-runner-207 kernel: [78204.589558] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 03:07:10 juju-e4d256-prod-github-runner-207 kernel: [78204.590601] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 03:07:10 juju-e4d256-prod-github-runner-207 kernel: [78204.591639] ? _raw_spin_lock+0x22/0x30 Aug 23 03:07:10 juju-e4d256-prod-github-runner-207 kernel: [78204.592613] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 03:07:10 juju-e4d256-prod-github-runner-207 kernel: [78204.593636] direct_page_fault+0x206/0x310 [kvm] Aug 23 03:07:10 juju-e4d256-prod-github-runner-207 kernel: [78204.594663] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 03:07:10 juju-e4d256-prod-github-runner-207 kernel: [78204.595815] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 03:07:10 juju-e4d256-prod-github-runner-207 kernel: [78204.596832] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 03:07:10 juju-e4d256-prod-github-runner-207 kernel: [78204.597876] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 03:07:10 juju-e4d256-prod-github-runner-207 kernel: [78204.598971] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 03:07:10 juju-e4d256-prod-github-runner-207 kernel: [78204.599954] handle_exit+0x98/0x230 [kvm_amd] Aug 23 03:07:10 juju-e4d256-prod-github-runner-207 kernel: [78204.600865] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 03:07:10 juju-e4d256-prod-github-runner-207 kernel: [78204.601779] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 03:07:10 juju-e4d256-prod-github-runner-207 kernel: [78204.602701] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 03:07:10 juju-e4d256-prod-github-runner-207 kernel: [78204.603601] vcpu_run+0x62/0x2c0 [kvm] Aug 23 03:07:10 juju-e4d256-prod-github-runner-207 kernel: [78204.604430] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 03:07:10 juju-e4d256-prod-github-runner-207 kernel: [78204.605246] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 03:07:10 juju-e4d256-prod-github-runner-207 kernel: [78204.606114] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 03:07:10 juju-e4d256-prod-github-runner-207 kernel: [78204.606932] ? __seccomp_filter+0x4a/0x4a0 Aug 23 03:07:10 juju-e4d256-prod-github-runner-207 kernel: [78204.607675] ? __fget_files+0x86/0xc0 Aug 23 03:07:10 juju-e4d256-prod-github-runner-207 kernel: [78204.608377] __x64_sys_ioctl+0x95/0xd0 Aug 23 03:07:10 juju-e4d256-prod-github-runner-207 kernel: [78204.609079] do_syscall_64+0x5c/0xc0 Aug 23 03:07:10 juju-e4d256-prod-github-runner-207 kernel: [78204.609750] ? do_futex+0x162/0x1f0 Aug 23 03:07:10 juju-e4d256-prod-github-runner-207 kernel: [78204.610398] ? __x64_sys_futex+0x78/0x1e0 Aug 23 03:07:10 juju-e4d256-prod-github-runner-207 kernel: [78204.611070] ? __secure_computing+0xa9/0x120 Aug 23 03:07:10 juju-e4d256-prod-github-runner-207 kernel: [78204.611758] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 03:07:10 juju-e4d256-prod-github-runner-207 kernel: [78204.612521] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 03:07:10 juju-e4d256-prod-github-runner-207 kernel: [78204.613257] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 03:07:10 juju-e4d256-prod-github-runner-207 kernel: [78204.613974] ? do_syscall_64+0x69/0xc0 Aug 23 03:07:10 juju-e4d256-prod-github-runner-207 kernel: [78204.614618] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 03:07:10 juju-e4d256-prod-github-runner-207 kernel: [78204.615321] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 03:07:10 juju-e4d256-prod-github-runner-207 kernel: [78204.616016] ? do_syscall_64+0x69/0xc0 Aug 23 03:07:10 juju-e4d256-prod-github-runner-207 kernel: [78204.616677] ? do_syscall_64+0x69/0xc0 Aug 23 03:07:10 juju-e4d256-prod-github-runner-207 kernel: [78204.617319] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 03:07:10 juju-e4d256-prod-github-runner-207 kernel: [78204.618093] RIP: 0033:0x7faa5d0edaff Aug 23 03:07:10 juju-e4d256-prod-github-runner-207 kernel: [78204.618944] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 03:07:10 juju-e4d256-prod-github-runner-207 kernel: [78204.620974] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 03:07:10 juju-e4d256-prod-github-runner-207 kernel: [78204.621888] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 03:07:10 juju-e4d256-prod-github-runner-207 kernel: [78204.622779] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 03:07:10 juju-e4d256-prod-github-runner-207 kernel: [78204.623669] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 03:07:10 juju-e4d256-prod-github-runner-207 kernel: [78204.624572] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 03:07:10 juju-e4d256-prod-github-runner-207 kernel: [78204.625463] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 03:07:10 juju-e4d256-prod-github-runner-207 kernel: [78204.626361] Aug 23 03:07:38 juju-e4d256-prod-github-runner-207 kernel: [78232.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 72751s! [qemu-system-x86:6715] Aug 23 03:07:38 juju-e4d256-prod-github-runner-207 kernel: [78232.543100] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 03:07:38 juju-e4d256-prod-github-runner-207 kernel: [78232.543176] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 03:07:38 juju-e4d256-prod-github-runner-207 kernel: [78232.555377] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 03:07:38 juju-e4d256-prod-github-runner-207 kernel: [78232.556684] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 03:07:38 juju-e4d256-prod-github-runner-207 kernel: [78232.557902] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 03:07:38 juju-e4d256-prod-github-runner-207 kernel: [78232.558957] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 03:07:38 juju-e4d256-prod-github-runner-207 kernel: [78232.561497] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 03:07:38 juju-e4d256-prod-github-runner-207 kernel: [78232.562543] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 03:07:38 juju-e4d256-prod-github-runner-207 kernel: [78232.563703] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 03:07:38 juju-e4d256-prod-github-runner-207 kernel: [78232.564885] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 03:07:38 juju-e4d256-prod-github-runner-207 kernel: [78232.566044] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 03:07:38 juju-e4d256-prod-github-runner-207 kernel: [78232.567202] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 03:07:38 juju-e4d256-prod-github-runner-207 kernel: [78232.568377] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 03:07:38 juju-e4d256-prod-github-runner-207 kernel: [78232.569613] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 03:07:38 juju-e4d256-prod-github-runner-207 kernel: [78232.570708] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 03:07:38 juju-e4d256-prod-github-runner-207 kernel: [78232.571903] Call Trace: Aug 23 03:07:38 juju-e4d256-prod-github-runner-207 kernel: [78232.572820] Aug 23 03:07:38 juju-e4d256-prod-github-runner-207 kernel: [78232.573713] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 03:07:38 juju-e4d256-prod-github-runner-207 kernel: [78232.574742] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 03:07:38 juju-e4d256-prod-github-runner-207 kernel: [78232.575770] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 03:07:38 juju-e4d256-prod-github-runner-207 kernel: [78232.576860] ? show_regs.part.0+0x23/0x29 Aug 23 03:07:38 juju-e4d256-prod-github-runner-207 kernel: [78232.577861] ? show_regs.cold+0x8/0xd Aug 23 03:07:38 juju-e4d256-prod-github-runner-207 kernel: [78232.578830] ? watchdog_timer_fn+0x1be/0x220 Aug 23 03:07:38 juju-e4d256-prod-github-runner-207 kernel: [78232.579835] ? lockup_detector_update_enable+0x60/0x60 Aug 23 03:07:38 juju-e4d256-prod-github-runner-207 kernel: [78232.580911] ? __hrtimer_run_queues+0x107/0x230 Aug 23 03:07:38 juju-e4d256-prod-github-runner-207 kernel: [78232.581962] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 03:07:38 juju-e4d256-prod-github-runner-207 kernel: [78232.582997] ? hrtimer_interrupt+0x101/0x220 Aug 23 03:07:38 juju-e4d256-prod-github-runner-207 kernel: [78232.584010] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 03:07:38 juju-e4d256-prod-github-runner-207 kernel: [78232.585093] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 03:07:38 juju-e4d256-prod-github-runner-207 kernel: [78232.586137] Aug 23 03:07:38 juju-e4d256-prod-github-runner-207 kernel: [78232.586994] Aug 23 03:07:38 juju-e4d256-prod-github-runner-207 kernel: [78232.587831] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 03:07:38 juju-e4d256-prod-github-runner-207 kernel: [78232.588884] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 03:07:38 juju-e4d256-prod-github-runner-207 kernel: [78232.589926] ? _raw_spin_lock+0x22/0x30 Aug 23 03:07:38 juju-e4d256-prod-github-runner-207 kernel: [78232.590867] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 03:07:38 juju-e4d256-prod-github-runner-207 kernel: [78232.591885] direct_page_fault+0x206/0x310 [kvm] Aug 23 03:07:38 juju-e4d256-prod-github-runner-207 kernel: [78232.592912] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 03:07:38 juju-e4d256-prod-github-runner-207 kernel: [78232.593925] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 03:07:38 juju-e4d256-prod-github-runner-207 kernel: [78232.594923] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 03:07:38 juju-e4d256-prod-github-runner-207 kernel: [78232.595890] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 03:07:38 juju-e4d256-prod-github-runner-207 kernel: [78232.596841] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 03:07:38 juju-e4d256-prod-github-runner-207 kernel: [78232.597818] handle_exit+0x98/0x230 [kvm_amd] Aug 23 03:07:38 juju-e4d256-prod-github-runner-207 kernel: [78232.598709] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 03:07:38 juju-e4d256-prod-github-runner-207 kernel: [78232.599625] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 03:07:38 juju-e4d256-prod-github-runner-207 kernel: [78232.600554] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 03:07:38 juju-e4d256-prod-github-runner-207 kernel: [78232.601457] vcpu_run+0x62/0x2c0 [kvm] Aug 23 03:07:38 juju-e4d256-prod-github-runner-207 kernel: [78232.602266] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 03:07:38 juju-e4d256-prod-github-runner-207 kernel: [78232.603081] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 03:07:38 juju-e4d256-prod-github-runner-207 kernel: [78232.603957] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 03:07:38 juju-e4d256-prod-github-runner-207 kernel: [78232.604774] ? __seccomp_filter+0x4a/0x4a0 Aug 23 03:07:38 juju-e4d256-prod-github-runner-207 kernel: [78232.605515] ? __fget_files+0x86/0xc0 Aug 23 03:07:38 juju-e4d256-prod-github-runner-207 kernel: [78232.606221] __x64_sys_ioctl+0x95/0xd0 Aug 23 03:07:38 juju-e4d256-prod-github-runner-207 kernel: [78232.606911] do_syscall_64+0x5c/0xc0 Aug 23 03:07:38 juju-e4d256-prod-github-runner-207 kernel: [78232.607577] ? do_futex+0x162/0x1f0 Aug 23 03:07:38 juju-e4d256-prod-github-runner-207 kernel: [78232.608246] ? __x64_sys_futex+0x78/0x1e0 Aug 23 03:07:38 juju-e4d256-prod-github-runner-207 kernel: [78232.608918] ? __secure_computing+0xa9/0x120 Aug 23 03:07:38 juju-e4d256-prod-github-runner-207 kernel: [78232.609610] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 03:07:38 juju-e4d256-prod-github-runner-207 kernel: [78232.610369] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 03:07:38 juju-e4d256-prod-github-runner-207 kernel: [78232.611099] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 03:07:38 juju-e4d256-prod-github-runner-207 kernel: [78232.611826] ? do_syscall_64+0x69/0xc0 Aug 23 03:07:38 juju-e4d256-prod-github-runner-207 kernel: [78232.612585] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 03:07:38 juju-e4d256-prod-github-runner-207 kernel: [78232.613290] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 03:07:38 juju-e4d256-prod-github-runner-207 kernel: [78232.613989] ? do_syscall_64+0x69/0xc0 Aug 23 03:07:38 juju-e4d256-prod-github-runner-207 kernel: [78232.614614] ? do_syscall_64+0x69/0xc0 Aug 23 03:07:38 juju-e4d256-prod-github-runner-207 kernel: [78232.615232] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 03:07:38 juju-e4d256-prod-github-runner-207 kernel: [78232.615935] RIP: 0033:0x7faa5d0edaff Aug 23 03:07:38 juju-e4d256-prod-github-runner-207 kernel: [78232.616568] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 03:07:38 juju-e4d256-prod-github-runner-207 kernel: [78232.618543] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 03:07:38 juju-e4d256-prod-github-runner-207 kernel: [78232.619454] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 03:07:38 juju-e4d256-prod-github-runner-207 kernel: [78232.620411] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 03:07:38 juju-e4d256-prod-github-runner-207 kernel: [78232.621309] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 03:07:38 juju-e4d256-prod-github-runner-207 kernel: [78232.622293] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 03:07:38 juju-e4d256-prod-github-runner-207 kernel: [78232.623178] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 03:07:38 juju-e4d256-prod-github-runner-207 kernel: [78232.624067] Aug 23 03:08:06 juju-e4d256-prod-github-runner-207 kernel: [78260.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 72777s! [qemu-system-x86:6715] Aug 23 03:08:06 juju-e4d256-prod-github-runner-207 kernel: [78260.543116] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 03:08:06 juju-e4d256-prod-github-runner-207 kernel: [78260.543190] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 03:08:06 juju-e4d256-prod-github-runner-207 kernel: [78260.555526] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 03:08:06 juju-e4d256-prod-github-runner-207 kernel: [78260.556830] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 03:08:06 juju-e4d256-prod-github-runner-207 kernel: [78260.558058] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 03:08:06 juju-e4d256-prod-github-runner-207 kernel: [78260.559126] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 03:08:06 juju-e4d256-prod-github-runner-207 kernel: [78260.561715] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 03:08:06 juju-e4d256-prod-github-runner-207 kernel: [78260.562764] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 03:08:06 juju-e4d256-prod-github-runner-207 kernel: [78260.563946] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 03:08:06 juju-e4d256-prod-github-runner-207 kernel: [78260.565147] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 03:08:06 juju-e4d256-prod-github-runner-207 kernel: [78260.566315] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 03:08:06 juju-e4d256-prod-github-runner-207 kernel: [78260.567478] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 03:08:06 juju-e4d256-prod-github-runner-207 kernel: [78260.568672] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 03:08:06 juju-e4d256-prod-github-runner-207 kernel: [78260.569907] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 03:08:06 juju-e4d256-prod-github-runner-207 kernel: [78260.571010] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 03:08:06 juju-e4d256-prod-github-runner-207 kernel: [78260.572219] Call Trace: Aug 23 03:08:06 juju-e4d256-prod-github-runner-207 kernel: [78260.573133] Aug 23 03:08:06 juju-e4d256-prod-github-runner-207 kernel: [78260.574023] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 03:08:06 juju-e4d256-prod-github-runner-207 kernel: [78260.575256] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 03:08:06 juju-e4d256-prod-github-runner-207 kernel: [78260.576343] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 03:08:06 juju-e4d256-prod-github-runner-207 kernel: [78260.577492] ? show_regs.part.0+0x23/0x29 Aug 23 03:08:06 juju-e4d256-prod-github-runner-207 kernel: [78260.578516] ? show_regs.cold+0x8/0xd Aug 23 03:08:06 juju-e4d256-prod-github-runner-207 kernel: [78260.579497] ? watchdog_timer_fn+0x1be/0x220 Aug 23 03:08:06 juju-e4d256-prod-github-runner-207 kernel: [78260.580530] ? lockup_detector_update_enable+0x60/0x60 Aug 23 03:08:06 juju-e4d256-prod-github-runner-207 kernel: [78260.581688] ? __hrtimer_run_queues+0x107/0x230 Aug 23 03:08:06 juju-e4d256-prod-github-runner-207 kernel: [78260.582722] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 03:08:06 juju-e4d256-prod-github-runner-207 kernel: [78260.583749] ? hrtimer_interrupt+0x101/0x220 Aug 23 03:08:06 juju-e4d256-prod-github-runner-207 kernel: [78260.584790] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 03:08:06 juju-e4d256-prod-github-runner-207 kernel: [78260.585883] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 03:08:06 juju-e4d256-prod-github-runner-207 kernel: [78260.586941] Aug 23 03:08:06 juju-e4d256-prod-github-runner-207 kernel: [78260.587799] Aug 23 03:08:06 juju-e4d256-prod-github-runner-207 kernel: [78260.588660] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 03:08:06 juju-e4d256-prod-github-runner-207 kernel: [78260.589704] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 03:08:06 juju-e4d256-prod-github-runner-207 kernel: [78260.590766] ? _raw_spin_lock+0x22/0x30 Aug 23 03:08:06 juju-e4d256-prod-github-runner-207 kernel: [78260.591754] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 03:08:06 juju-e4d256-prod-github-runner-207 kernel: [78260.592808] direct_page_fault+0x206/0x310 [kvm] Aug 23 03:08:06 juju-e4d256-prod-github-runner-207 kernel: [78260.593836] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 03:08:06 juju-e4d256-prod-github-runner-207 kernel: [78260.594851] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 03:08:06 juju-e4d256-prod-github-runner-207 kernel: [78260.595984] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 03:08:06 juju-e4d256-prod-github-runner-207 kernel: [78260.596995] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 03:08:06 juju-e4d256-prod-github-runner-207 kernel: [78260.598085] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 03:08:06 juju-e4d256-prod-github-runner-207 kernel: [78260.599240] handle_exit+0x98/0x230 [kvm_amd] Aug 23 03:08:06 juju-e4d256-prod-github-runner-207 kernel: [78260.600209] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 03:08:06 juju-e4d256-prod-github-runner-207 kernel: [78260.601173] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 03:08:06 juju-e4d256-prod-github-runner-207 kernel: [78260.602104] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 03:08:06 juju-e4d256-prod-github-runner-207 kernel: [78260.603014] vcpu_run+0x62/0x2c0 [kvm] Aug 23 03:08:06 juju-e4d256-prod-github-runner-207 kernel: [78260.603831] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 03:08:06 juju-e4d256-prod-github-runner-207 kernel: [78260.604661] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 03:08:06 juju-e4d256-prod-github-runner-207 kernel: [78260.605550] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 03:08:06 juju-e4d256-prod-github-runner-207 kernel: [78260.606392] ? __seccomp_filter+0x4a/0x4a0 Aug 23 03:08:06 juju-e4d256-prod-github-runner-207 kernel: [78260.607239] ? __fget_files+0x86/0xc0 Aug 23 03:08:06 juju-e4d256-prod-github-runner-207 kernel: [78260.607979] __x64_sys_ioctl+0x95/0xd0 Aug 23 03:08:06 juju-e4d256-prod-github-runner-207 kernel: [78260.608674] do_syscall_64+0x5c/0xc0 Aug 23 03:08:06 juju-e4d256-prod-github-runner-207 kernel: [78260.609346] ? do_futex+0x162/0x1f0 Aug 23 03:08:06 juju-e4d256-prod-github-runner-207 kernel: [78260.610094] ? __x64_sys_futex+0x78/0x1e0 Aug 23 03:08:06 juju-e4d256-prod-github-runner-207 kernel: [78260.610803] ? __secure_computing+0xa9/0x120 Aug 23 03:08:06 juju-e4d256-prod-github-runner-207 kernel: [78260.611500] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 03:08:06 juju-e4d256-prod-github-runner-207 kernel: [78260.612287] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 03:08:06 juju-e4d256-prod-github-runner-207 kernel: [78260.613015] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 03:08:06 juju-e4d256-prod-github-runner-207 kernel: [78260.613763] ? do_syscall_64+0x69/0xc0 Aug 23 03:08:06 juju-e4d256-prod-github-runner-207 kernel: [78260.614413] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 03:08:06 juju-e4d256-prod-github-runner-207 kernel: [78260.615126] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 03:08:06 juju-e4d256-prod-github-runner-207 kernel: [78260.615827] ? do_syscall_64+0x69/0xc0 Aug 23 03:08:06 juju-e4d256-prod-github-runner-207 kernel: [78260.616515] ? do_syscall_64+0x69/0xc0 Aug 23 03:08:06 juju-e4d256-prod-github-runner-207 kernel: [78260.617149] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 03:08:06 juju-e4d256-prod-github-runner-207 kernel: [78260.617860] RIP: 0033:0x7faa5d0edaff Aug 23 03:08:06 juju-e4d256-prod-github-runner-207 kernel: [78260.618489] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 03:08:06 juju-e4d256-prod-github-runner-207 kernel: [78260.620505] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 03:08:06 juju-e4d256-prod-github-runner-207 kernel: [78260.621425] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 03:08:06 juju-e4d256-prod-github-runner-207 kernel: [78260.622393] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 03:08:06 juju-e4d256-prod-github-runner-207 kernel: [78260.623298] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 03:08:06 juju-e4d256-prod-github-runner-207 kernel: [78260.624209] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 03:08:06 juju-e4d256-prod-github-runner-207 kernel: [78260.625107] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 03:08:06 juju-e4d256-prod-github-runner-207 kernel: [78260.626007] Aug 23 03:08:34 juju-e4d256-prod-github-runner-207 kernel: [78288.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 72803s! [qemu-system-x86:6715] Aug 23 03:08:34 juju-e4d256-prod-github-runner-207 kernel: [78288.543894] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 03:08:34 juju-e4d256-prod-github-runner-207 kernel: [78288.544214] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 03:08:34 juju-e4d256-prod-github-runner-207 kernel: [78288.556864] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 03:08:34 juju-e4d256-prod-github-runner-207 kernel: [78288.558131] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 03:08:34 juju-e4d256-prod-github-runner-207 kernel: [78288.559351] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 03:08:34 juju-e4d256-prod-github-runner-207 kernel: [78288.560418] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 03:08:34 juju-e4d256-prod-github-runner-207 kernel: [78288.563009] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 03:08:34 juju-e4d256-prod-github-runner-207 kernel: [78288.564112] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 03:08:34 juju-e4d256-prod-github-runner-207 kernel: [78288.565283] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 03:08:34 juju-e4d256-prod-github-runner-207 kernel: [78288.566436] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 03:08:34 juju-e4d256-prod-github-runner-207 kernel: [78288.567619] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 03:08:34 juju-e4d256-prod-github-runner-207 kernel: [78288.568781] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 03:08:34 juju-e4d256-prod-github-runner-207 kernel: [78288.569944] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 03:08:34 juju-e4d256-prod-github-runner-207 kernel: [78288.571174] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 03:08:34 juju-e4d256-prod-github-runner-207 kernel: [78288.572277] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 03:08:34 juju-e4d256-prod-github-runner-207 kernel: [78288.573521] Call Trace: Aug 23 03:08:34 juju-e4d256-prod-github-runner-207 kernel: [78288.574435] Aug 23 03:08:34 juju-e4d256-prod-github-runner-207 kernel: [78288.575329] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 03:08:34 juju-e4d256-prod-github-runner-207 kernel: [78288.576365] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 03:08:34 juju-e4d256-prod-github-runner-207 kernel: [78288.577398] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 03:08:34 juju-e4d256-prod-github-runner-207 kernel: [78288.578507] ? show_regs.part.0+0x23/0x29 Aug 23 03:08:34 juju-e4d256-prod-github-runner-207 kernel: [78288.579506] ? show_regs.cold+0x8/0xd Aug 23 03:08:34 juju-e4d256-prod-github-runner-207 kernel: [78288.580508] ? watchdog_timer_fn+0x1be/0x220 Aug 23 03:08:34 juju-e4d256-prod-github-runner-207 kernel: [78288.581515] ? lockup_detector_update_enable+0x60/0x60 Aug 23 03:08:34 juju-e4d256-prod-github-runner-207 kernel: [78288.582604] ? __hrtimer_run_queues+0x107/0x230 Aug 23 03:08:34 juju-e4d256-prod-github-runner-207 kernel: [78288.583643] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 03:08:34 juju-e4d256-prod-github-runner-207 kernel: [78288.584671] ? hrtimer_interrupt+0x101/0x220 Aug 23 03:08:34 juju-e4d256-prod-github-runner-207 kernel: [78288.586077] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 03:08:34 juju-e4d256-prod-github-runner-207 kernel: [78288.587228] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 03:08:34 juju-e4d256-prod-github-runner-207 kernel: [78288.588350] Aug 23 03:08:34 juju-e4d256-prod-github-runner-207 kernel: [78288.589257] Aug 23 03:08:34 juju-e4d256-prod-github-runner-207 kernel: [78288.590188] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 03:08:34 juju-e4d256-prod-github-runner-207 kernel: [78288.591362] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 03:08:34 juju-e4d256-prod-github-runner-207 kernel: [78288.592522] ? _raw_spin_lock+0x22/0x30 Aug 23 03:08:34 juju-e4d256-prod-github-runner-207 kernel: [78288.593618] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 03:08:34 juju-e4d256-prod-github-runner-207 kernel: [78288.594752] direct_page_fault+0x206/0x310 [kvm] Aug 23 03:08:34 juju-e4d256-prod-github-runner-207 kernel: [78288.596000] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 03:08:34 juju-e4d256-prod-github-runner-207 kernel: [78288.597277] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 03:08:34 juju-e4d256-prod-github-runner-207 kernel: [78288.598439] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 03:08:34 juju-e4d256-prod-github-runner-207 kernel: [78288.599523] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 03:08:34 juju-e4d256-prod-github-runner-207 kernel: [78288.600514] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 03:08:34 juju-e4d256-prod-github-runner-207 kernel: [78288.601536] handle_exit+0x98/0x230 [kvm_amd] Aug 23 03:08:34 juju-e4d256-prod-github-runner-207 kernel: [78288.602433] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 03:08:34 juju-e4d256-prod-github-runner-207 kernel: [78288.603372] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 03:08:34 juju-e4d256-prod-github-runner-207 kernel: [78288.604322] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 03:08:34 juju-e4d256-prod-github-runner-207 kernel: [78288.605240] vcpu_run+0x62/0x2c0 [kvm] Aug 23 03:08:34 juju-e4d256-prod-github-runner-207 kernel: [78288.606102] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 03:08:34 juju-e4d256-prod-github-runner-207 kernel: [78288.606975] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 03:08:34 juju-e4d256-prod-github-runner-207 kernel: [78288.607882] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 03:08:34 juju-e4d256-prod-github-runner-207 kernel: [78288.608740] ? __seccomp_filter+0x4a/0x4a0 Aug 23 03:08:34 juju-e4d256-prod-github-runner-207 kernel: [78288.609491] ? __fget_files+0x86/0xc0 Aug 23 03:08:34 juju-e4d256-prod-github-runner-207 kernel: [78288.610219] __x64_sys_ioctl+0x95/0xd0 Aug 23 03:08:34 juju-e4d256-prod-github-runner-207 kernel: [78288.610954] do_syscall_64+0x5c/0xc0 Aug 23 03:08:34 juju-e4d256-prod-github-runner-207 kernel: [78288.611699] ? do_futex+0x162/0x1f0 Aug 23 03:08:34 juju-e4d256-prod-github-runner-207 kernel: [78288.612377] ? __x64_sys_futex+0x78/0x1e0 Aug 23 03:08:34 juju-e4d256-prod-github-runner-207 kernel: [78288.613091] ? __secure_computing+0xa9/0x120 Aug 23 03:08:34 juju-e4d256-prod-github-runner-207 kernel: [78288.613828] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 03:08:34 juju-e4d256-prod-github-runner-207 kernel: [78288.614685] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 03:08:34 juju-e4d256-prod-github-runner-207 kernel: [78288.615532] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 03:08:34 juju-e4d256-prod-github-runner-207 kernel: [78288.616322] ? do_syscall_64+0x69/0xc0 Aug 23 03:08:34 juju-e4d256-prod-github-runner-207 kernel: [78288.617030] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 03:08:34 juju-e4d256-prod-github-runner-207 kernel: [78288.617802] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 03:08:34 juju-e4d256-prod-github-runner-207 kernel: [78288.618548] ? do_syscall_64+0x69/0xc0 Aug 23 03:08:34 juju-e4d256-prod-github-runner-207 kernel: [78288.619275] ? do_syscall_64+0x69/0xc0 Aug 23 03:08:34 juju-e4d256-prod-github-runner-207 kernel: [78288.619987] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 03:08:34 juju-e4d256-prod-github-runner-207 kernel: [78288.620817] RIP: 0033:0x7faa5d0edaff Aug 23 03:08:34 juju-e4d256-prod-github-runner-207 kernel: [78288.621529] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 03:08:34 juju-e4d256-prod-github-runner-207 kernel: [78288.623797] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 03:08:34 juju-e4d256-prod-github-runner-207 kernel: [78288.624804] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 03:08:34 juju-e4d256-prod-github-runner-207 kernel: [78288.625703] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 03:08:34 juju-e4d256-prod-github-runner-207 kernel: [78288.626598] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 03:08:34 juju-e4d256-prod-github-runner-207 kernel: [78288.627491] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 03:08:34 juju-e4d256-prod-github-runner-207 kernel: [78288.628451] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 03:08:34 juju-e4d256-prod-github-runner-207 kernel: [78288.629354] Aug 23 03:08:48 juju-e4d256-prod-github-runner-207 kernel: [78302.408706] rcu: INFO: rcu_sched self-detected stall on CPU Aug 23 03:08:48 juju-e4d256-prod-github-runner-207 kernel: [78302.409663] rcu: 1-....: (19484959 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=9421219 Aug 23 03:08:48 juju-e4d256-prod-github-runner-207 kernel: [78302.410806] (t=19546302 jiffies g=23269 q=65568) Aug 23 03:08:48 juju-e4d256-prod-github-runner-207 kernel: [78302.411619] NMI backtrace for cpu 1 Aug 23 03:08:48 juju-e4d256-prod-github-runner-207 kernel: [78302.412339] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 03:08:48 juju-e4d256-prod-github-runner-207 kernel: [78302.413479] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 03:08:48 juju-e4d256-prod-github-runner-207 kernel: [78302.414562] Call Trace: Aug 23 03:08:48 juju-e4d256-prod-github-runner-207 kernel: [78302.415241] Aug 23 03:08:48 juju-e4d256-prod-github-runner-207 kernel: [78302.415911] show_stack+0x52/0x5c Aug 23 03:08:48 juju-e4d256-prod-github-runner-207 kernel: [78302.416653] dump_stack_lvl+0x4a/0x63 Aug 23 03:08:48 juju-e4d256-prod-github-runner-207 kernel: [78302.417412] dump_stack+0x10/0x16 Aug 23 03:08:48 juju-e4d256-prod-github-runner-207 kernel: [78302.418136] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 23 03:08:48 juju-e4d256-prod-github-runner-207 kernel: [78302.418926] ? lapic_can_unplug_cpu+0x90/0x90 Aug 23 03:08:48 juju-e4d256-prod-github-runner-207 kernel: [78302.419746] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 23 03:08:48 juju-e4d256-prod-github-runner-207 kernel: [78302.420576] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 23 03:08:48 juju-e4d256-prod-github-runner-207 kernel: [78302.421407] trigger_single_cpu_backtrace+0x44/0x4f Aug 23 03:08:48 juju-e4d256-prod-github-runner-207 kernel: [78302.422230] rcu_dump_cpu_stacks+0x102/0x149 Aug 23 03:08:48 juju-e4d256-prod-github-runner-207 kernel: [78302.423010] print_cpu_stall.cold+0x2f/0xe2 Aug 23 03:08:48 juju-e4d256-prod-github-runner-207 kernel: [78302.423807] ? timekeeping_update+0xf7/0x150 Aug 23 03:08:48 juju-e4d256-prod-github-runner-207 kernel: [78302.424587] check_cpu_stall+0x109/0x270 Aug 23 03:08:48 juju-e4d256-prod-github-runner-207 kernel: [78302.425348] rcu_sched_clock_irq+0x9a/0x250 Aug 23 03:08:48 juju-e4d256-prod-github-runner-207 kernel: [78302.426136] update_process_times+0x94/0xd0 Aug 23 03:08:48 juju-e4d256-prod-github-runner-207 kernel: [78302.426915] tick_sched_handle+0x29/0x70 Aug 23 03:08:48 juju-e4d256-prod-github-runner-207 kernel: [78302.427683] tick_sched_timer+0x8c/0xc0 Aug 23 03:08:48 juju-e4d256-prod-github-runner-207 kernel: [78302.428431] ? tick_nohz_handler+0xb0/0xb0 Aug 23 03:08:48 juju-e4d256-prod-github-runner-207 kernel: [78302.429196] __hrtimer_run_queues+0x107/0x230 Aug 23 03:08:48 juju-e4d256-prod-github-runner-207 kernel: [78302.429984] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 03:08:48 juju-e4d256-prod-github-runner-207 kernel: [78302.430772] hrtimer_interrupt+0x101/0x220 Aug 23 03:08:48 juju-e4d256-prod-github-runner-207 kernel: [78302.431554] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 03:08:48 juju-e4d256-prod-github-runner-207 kernel: [78302.432445] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 03:08:48 juju-e4d256-prod-github-runner-207 kernel: [78302.433267] Aug 23 03:08:48 juju-e4d256-prod-github-runner-207 kernel: [78302.433910] Aug 23 03:08:48 juju-e4d256-prod-github-runner-207 kernel: [78302.434546] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 03:08:48 juju-e4d256-prod-github-runner-207 kernel: [78302.435386] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 03:08:48 juju-e4d256-prod-github-runner-207 kernel: [78302.436311] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 03:08:48 juju-e4d256-prod-github-runner-207 kernel: [78302.438580] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 03:08:48 juju-e4d256-prod-github-runner-207 kernel: [78302.439488] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 03:08:48 juju-e4d256-prod-github-runner-207 kernel: [78302.440509] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 03:08:48 juju-e4d256-prod-github-runner-207 kernel: [78302.441512] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 03:08:48 juju-e4d256-prod-github-runner-207 kernel: [78302.442493] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 03:08:48 juju-e4d256-prod-github-runner-207 kernel: [78302.443481] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 03:08:48 juju-e4d256-prod-github-runner-207 kernel: [78302.444462] ? _raw_spin_lock+0x22/0x30 Aug 23 03:08:48 juju-e4d256-prod-github-runner-207 kernel: [78302.445238] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 03:08:48 juju-e4d256-prod-github-runner-207 kernel: [78302.446092] direct_page_fault+0x206/0x310 [kvm] Aug 23 03:08:48 juju-e4d256-prod-github-runner-207 kernel: [78302.446945] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 03:08:48 juju-e4d256-prod-github-runner-207 kernel: [78302.447801] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 03:08:48 juju-e4d256-prod-github-runner-207 kernel: [78302.448646] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 03:08:48 juju-e4d256-prod-github-runner-207 kernel: [78302.449469] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 03:08:48 juju-e4d256-prod-github-runner-207 kernel: [78302.450268] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 03:08:48 juju-e4d256-prod-github-runner-207 kernel: [78302.451107] handle_exit+0x98/0x230 [kvm_amd] Aug 23 03:08:48 juju-e4d256-prod-github-runner-207 kernel: [78302.451895] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 03:08:48 juju-e4d256-prod-github-runner-207 kernel: [78302.452690] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 03:08:48 juju-e4d256-prod-github-runner-207 kernel: [78302.453502] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 03:08:48 juju-e4d256-prod-github-runner-207 kernel: [78302.454300] vcpu_run+0x62/0x2c0 [kvm] Aug 23 03:08:48 juju-e4d256-prod-github-runner-207 kernel: [78302.455027] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 03:08:48 juju-e4d256-prod-github-runner-207 kernel: [78302.455782] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 03:08:48 juju-e4d256-prod-github-runner-207 kernel: [78302.456595] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 03:08:48 juju-e4d256-prod-github-runner-207 kernel: [78302.457368] ? __seccomp_filter+0x4a/0x4a0 Aug 23 03:08:48 juju-e4d256-prod-github-runner-207 kernel: [78302.458097] ? __fget_files+0x86/0xc0 Aug 23 03:08:48 juju-e4d256-prod-github-runner-207 kernel: [78302.458796] __x64_sys_ioctl+0x95/0xd0 Aug 23 03:08:48 juju-e4d256-prod-github-runner-207 kernel: [78302.459508] do_syscall_64+0x5c/0xc0 Aug 23 03:08:48 juju-e4d256-prod-github-runner-207 kernel: [78302.460198] ? do_futex+0x162/0x1f0 Aug 23 03:08:48 juju-e4d256-prod-github-runner-207 kernel: [78302.460885] ? __x64_sys_futex+0x78/0x1e0 Aug 23 03:08:48 juju-e4d256-prod-github-runner-207 kernel: [78302.461595] ? __secure_computing+0xa9/0x120 Aug 23 03:08:48 juju-e4d256-prod-github-runner-207 kernel: [78302.462321] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 03:08:48 juju-e4d256-prod-github-runner-207 kernel: [78302.463124] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 03:08:48 juju-e4d256-prod-github-runner-207 kernel: [78302.463904] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 03:08:48 juju-e4d256-prod-github-runner-207 kernel: [78302.464667] ? do_syscall_64+0x69/0xc0 Aug 23 03:08:48 juju-e4d256-prod-github-runner-207 kernel: [78302.465367] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 03:08:48 juju-e4d256-prod-github-runner-207 kernel: [78302.466136] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 03:08:48 juju-e4d256-prod-github-runner-207 kernel: [78302.466904] ? do_syscall_64+0x69/0xc0 Aug 23 03:08:48 juju-e4d256-prod-github-runner-207 kernel: [78302.467624] ? do_syscall_64+0x69/0xc0 Aug 23 03:08:48 juju-e4d256-prod-github-runner-207 kernel: [78302.468323] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 03:08:48 juju-e4d256-prod-github-runner-207 kernel: [78302.469098] RIP: 0033:0x7faa5d0edaff Aug 23 03:08:48 juju-e4d256-prod-github-runner-207 kernel: [78302.469815] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 03:08:48 juju-e4d256-prod-github-runner-207 kernel: [78302.472022] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 03:08:48 juju-e4d256-prod-github-runner-207 kernel: [78302.473013] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 03:08:48 juju-e4d256-prod-github-runner-207 kernel: [78302.473990] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 03:08:48 juju-e4d256-prod-github-runner-207 kernel: [78302.474957] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 03:08:48 juju-e4d256-prod-github-runner-207 kernel: [78302.475946] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 03:08:48 juju-e4d256-prod-github-runner-207 kernel: [78302.477042] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 03:08:48 juju-e4d256-prod-github-runner-207 kernel: [78302.477981] Aug 23 03:09:14 juju-e4d256-prod-github-runner-207 kernel: [78328.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 72841s! [qemu-system-x86:6715] Aug 23 03:09:14 juju-e4d256-prod-github-runner-207 kernel: [78328.543134] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 03:09:14 juju-e4d256-prod-github-runner-207 kernel: [78328.543212] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 03:09:14 juju-e4d256-prod-github-runner-207 kernel: [78328.555268] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 03:09:14 juju-e4d256-prod-github-runner-207 kernel: [78328.556528] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 03:09:14 juju-e4d256-prod-github-runner-207 kernel: [78328.557749] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 03:09:14 juju-e4d256-prod-github-runner-207 kernel: [78328.558813] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 03:09:14 juju-e4d256-prod-github-runner-207 kernel: [78328.561384] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 03:09:14 juju-e4d256-prod-github-runner-207 kernel: [78328.562426] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 03:09:14 juju-e4d256-prod-github-runner-207 kernel: [78328.563627] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 03:09:14 juju-e4d256-prod-github-runner-207 kernel: [78328.564793] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 03:09:14 juju-e4d256-prod-github-runner-207 kernel: [78328.565955] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 03:09:14 juju-e4d256-prod-github-runner-207 kernel: [78328.567130] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 03:09:14 juju-e4d256-prod-github-runner-207 kernel: [78328.568295] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 03:09:14 juju-e4d256-prod-github-runner-207 kernel: [78328.569525] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 03:09:14 juju-e4d256-prod-github-runner-207 kernel: [78328.570626] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 03:09:14 juju-e4d256-prod-github-runner-207 kernel: [78328.571830] Call Trace: Aug 23 03:09:14 juju-e4d256-prod-github-runner-207 kernel: [78328.572745] Aug 23 03:09:14 juju-e4d256-prod-github-runner-207 kernel: [78328.573815] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 03:09:14 juju-e4d256-prod-github-runner-207 kernel: [78328.574841] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 03:09:14 juju-e4d256-prod-github-runner-207 kernel: [78328.575867] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 03:09:14 juju-e4d256-prod-github-runner-207 kernel: [78328.576937] ? show_regs.part.0+0x23/0x29 Aug 23 03:09:14 juju-e4d256-prod-github-runner-207 kernel: [78328.577931] ? show_regs.cold+0x8/0xd Aug 23 03:09:14 juju-e4d256-prod-github-runner-207 kernel: [78328.578902] ? watchdog_timer_fn+0x1be/0x220 Aug 23 03:09:14 juju-e4d256-prod-github-runner-207 kernel: [78328.579927] ? lockup_detector_update_enable+0x60/0x60 Aug 23 03:09:14 juju-e4d256-prod-github-runner-207 kernel: [78328.580990] ? __hrtimer_run_queues+0x107/0x230 Aug 23 03:09:14 juju-e4d256-prod-github-runner-207 kernel: [78328.582018] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 03:09:14 juju-e4d256-prod-github-runner-207 kernel: [78328.583040] ? hrtimer_interrupt+0x101/0x220 Aug 23 03:09:14 juju-e4d256-prod-github-runner-207 kernel: [78328.584063] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 03:09:14 juju-e4d256-prod-github-runner-207 kernel: [78328.585134] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 03:09:14 juju-e4d256-prod-github-runner-207 kernel: [78328.586176] Aug 23 03:09:14 juju-e4d256-prod-github-runner-207 kernel: [78328.587068] Aug 23 03:09:14 juju-e4d256-prod-github-runner-207 kernel: [78328.587920] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 03:09:14 juju-e4d256-prod-github-runner-207 kernel: [78328.588960] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 03:09:14 juju-e4d256-prod-github-runner-207 kernel: [78328.590005] ? _raw_spin_lock+0x22/0x30 Aug 23 03:09:14 juju-e4d256-prod-github-runner-207 kernel: [78328.590951] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 03:09:14 juju-e4d256-prod-github-runner-207 kernel: [78328.592012] direct_page_fault+0x206/0x310 [kvm] Aug 23 03:09:14 juju-e4d256-prod-github-runner-207 kernel: [78328.593034] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 03:09:14 juju-e4d256-prod-github-runner-207 kernel: [78328.594052] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 03:09:14 juju-e4d256-prod-github-runner-207 kernel: [78328.595066] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 03:09:14 juju-e4d256-prod-github-runner-207 kernel: [78328.596053] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 03:09:14 juju-e4d256-prod-github-runner-207 kernel: [78328.597004] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 03:09:14 juju-e4d256-prod-github-runner-207 kernel: [78328.597997] handle_exit+0x98/0x230 [kvm_amd] Aug 23 03:09:14 juju-e4d256-prod-github-runner-207 kernel: [78328.598890] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 03:09:14 juju-e4d256-prod-github-runner-207 kernel: [78328.599858] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 03:09:14 juju-e4d256-prod-github-runner-207 kernel: [78328.600795] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 03:09:14 juju-e4d256-prod-github-runner-207 kernel: [78328.601696] vcpu_run+0x62/0x2c0 [kvm] Aug 23 03:09:14 juju-e4d256-prod-github-runner-207 kernel: [78328.602504] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 03:09:14 juju-e4d256-prod-github-runner-207 kernel: [78328.603330] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 03:09:14 juju-e4d256-prod-github-runner-207 kernel: [78328.604190] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 03:09:14 juju-e4d256-prod-github-runner-207 kernel: [78328.604984] ? __seccomp_filter+0x4a/0x4a0 Aug 23 03:09:14 juju-e4d256-prod-github-runner-207 kernel: [78328.605725] ? __fget_files+0x86/0xc0 Aug 23 03:09:14 juju-e4d256-prod-github-runner-207 kernel: [78328.606425] __x64_sys_ioctl+0x95/0xd0 Aug 23 03:09:14 juju-e4d256-prod-github-runner-207 kernel: [78328.607130] do_syscall_64+0x5c/0xc0 Aug 23 03:09:14 juju-e4d256-prod-github-runner-207 kernel: [78328.607791] ? do_futex+0x162/0x1f0 Aug 23 03:09:14 juju-e4d256-prod-github-runner-207 kernel: [78328.608436] ? __x64_sys_futex+0x78/0x1e0 Aug 23 03:09:14 juju-e4d256-prod-github-runner-207 kernel: [78328.609107] ? __secure_computing+0xa9/0x120 Aug 23 03:09:14 juju-e4d256-prod-github-runner-207 kernel: [78328.609800] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 03:09:14 juju-e4d256-prod-github-runner-207 kernel: [78328.610560] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 03:09:14 juju-e4d256-prod-github-runner-207 kernel: [78328.611294] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 03:09:14 juju-e4d256-prod-github-runner-207 kernel: [78328.612032] ? do_syscall_64+0x69/0xc0 Aug 23 03:09:14 juju-e4d256-prod-github-runner-207 kernel: [78328.612675] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 03:09:14 juju-e4d256-prod-github-runner-207 kernel: [78328.613377] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 03:09:14 juju-e4d256-prod-github-runner-207 kernel: [78328.614075] ? do_syscall_64+0x69/0xc0 Aug 23 03:09:14 juju-e4d256-prod-github-runner-207 kernel: [78328.614700] ? do_syscall_64+0x69/0xc0 Aug 23 03:09:14 juju-e4d256-prod-github-runner-207 kernel: [78328.615385] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 03:09:14 juju-e4d256-prod-github-runner-207 kernel: [78328.616352] RIP: 0033:0x7faa5d0edaff Aug 23 03:09:14 juju-e4d256-prod-github-runner-207 kernel: [78328.616980] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 03:09:14 juju-e4d256-prod-github-runner-207 kernel: [78328.618984] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 03:09:14 juju-e4d256-prod-github-runner-207 kernel: [78328.619929] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 03:09:14 juju-e4d256-prod-github-runner-207 kernel: [78328.620815] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 03:09:14 juju-e4d256-prod-github-runner-207 kernel: [78328.621703] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 03:09:14 juju-e4d256-prod-github-runner-207 kernel: [78328.622589] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 03:09:14 juju-e4d256-prod-github-runner-207 kernel: [78328.623485] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 03:09:14 juju-e4d256-prod-github-runner-207 kernel: [78328.624544] Aug 23 03:09:42 juju-e4d256-prod-github-runner-207 kernel: [78356.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 72867s! [qemu-system-x86:6715] Aug 23 03:09:42 juju-e4d256-prod-github-runner-207 kernel: [78356.543108] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 03:09:42 juju-e4d256-prod-github-runner-207 kernel: [78356.543180] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 03:09:42 juju-e4d256-prod-github-runner-207 kernel: [78356.555573] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 03:09:42 juju-e4d256-prod-github-runner-207 kernel: [78356.556849] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 03:09:42 juju-e4d256-prod-github-runner-207 kernel: [78356.558069] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 03:09:42 juju-e4d256-prod-github-runner-207 kernel: [78356.559140] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 03:09:42 juju-e4d256-prod-github-runner-207 kernel: [78356.561689] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 03:09:42 juju-e4d256-prod-github-runner-207 kernel: [78356.562894] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 03:09:42 juju-e4d256-prod-github-runner-207 kernel: [78356.564055] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 03:09:42 juju-e4d256-prod-github-runner-207 kernel: [78356.565213] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 03:09:42 juju-e4d256-prod-github-runner-207 kernel: [78356.566374] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 03:09:42 juju-e4d256-prod-github-runner-207 kernel: [78356.567555] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 03:09:42 juju-e4d256-prod-github-runner-207 kernel: [78356.568720] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 03:09:42 juju-e4d256-prod-github-runner-207 kernel: [78356.569957] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 03:09:42 juju-e4d256-prod-github-runner-207 kernel: [78356.571074] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 03:09:42 juju-e4d256-prod-github-runner-207 kernel: [78356.572268] Call Trace: Aug 23 03:09:42 juju-e4d256-prod-github-runner-207 kernel: [78356.573180] Aug 23 03:09:42 juju-e4d256-prod-github-runner-207 kernel: [78356.574063] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 03:09:42 juju-e4d256-prod-github-runner-207 kernel: [78356.575103] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 03:09:42 juju-e4d256-prod-github-runner-207 kernel: [78356.576124] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 03:09:42 juju-e4d256-prod-github-runner-207 kernel: [78356.577203] ? show_regs.part.0+0x23/0x29 Aug 23 03:09:42 juju-e4d256-prod-github-runner-207 kernel: [78356.578198] ? show_regs.cold+0x8/0xd Aug 23 03:09:42 juju-e4d256-prod-github-runner-207 kernel: [78356.579186] ? watchdog_timer_fn+0x1be/0x220 Aug 23 03:09:42 juju-e4d256-prod-github-runner-207 kernel: [78356.580200] ? lockup_detector_update_enable+0x60/0x60 Aug 23 03:09:42 juju-e4d256-prod-github-runner-207 kernel: [78356.581263] ? __hrtimer_run_queues+0x107/0x230 Aug 23 03:09:42 juju-e4d256-prod-github-runner-207 kernel: [78356.582330] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 03:09:42 juju-e4d256-prod-github-runner-207 kernel: [78356.583389] ? hrtimer_interrupt+0x101/0x220 Aug 23 03:09:42 juju-e4d256-prod-github-runner-207 kernel: [78356.584404] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 03:09:42 juju-e4d256-prod-github-runner-207 kernel: [78356.585472] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 03:09:42 juju-e4d256-prod-github-runner-207 kernel: [78356.586515] Aug 23 03:09:42 juju-e4d256-prod-github-runner-207 kernel: [78356.587378] Aug 23 03:09:42 juju-e4d256-prod-github-runner-207 kernel: [78356.588215] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 03:09:42 juju-e4d256-prod-github-runner-207 kernel: [78356.589244] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 03:09:42 juju-e4d256-prod-github-runner-207 kernel: [78356.590282] ? _raw_spin_lock+0x22/0x30 Aug 23 03:09:42 juju-e4d256-prod-github-runner-207 kernel: [78356.591239] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 03:09:42 juju-e4d256-prod-github-runner-207 kernel: [78356.592261] direct_page_fault+0x206/0x310 [kvm] Aug 23 03:09:42 juju-e4d256-prod-github-runner-207 kernel: [78356.593287] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 03:09:42 juju-e4d256-prod-github-runner-207 kernel: [78356.594292] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 03:09:42 juju-e4d256-prod-github-runner-207 kernel: [78356.595301] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 03:09:42 juju-e4d256-prod-github-runner-207 kernel: [78356.596272] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 03:09:42 juju-e4d256-prod-github-runner-207 kernel: [78356.597242] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 03:09:42 juju-e4d256-prod-github-runner-207 kernel: [78356.598554] handle_exit+0x98/0x230 [kvm_amd] Aug 23 03:09:42 juju-e4d256-prod-github-runner-207 kernel: [78356.599909] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 03:09:42 juju-e4d256-prod-github-runner-207 kernel: [78356.601187] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 03:09:42 juju-e4d256-prod-github-runner-207 kernel: [78356.602493] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 03:09:42 juju-e4d256-prod-github-runner-207 kernel: [78356.603791] vcpu_run+0x62/0x2c0 [kvm] Aug 23 03:09:42 juju-e4d256-prod-github-runner-207 kernel: [78356.604969] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 03:09:42 juju-e4d256-prod-github-runner-207 kernel: [78356.606159] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 03:09:42 juju-e4d256-prod-github-runner-207 kernel: [78356.607400] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 03:09:42 juju-e4d256-prod-github-runner-207 kernel: [78356.608555] ? __seccomp_filter+0x4a/0x4a0 Aug 23 03:09:42 juju-e4d256-prod-github-runner-207 kernel: [78356.609635] ? __fget_files+0x86/0xc0 Aug 23 03:09:42 juju-e4d256-prod-github-runner-207 kernel: [78356.610675] __x64_sys_ioctl+0x95/0xd0 Aug 23 03:09:42 juju-e4d256-prod-github-runner-207 kernel: [78356.611675] do_syscall_64+0x5c/0xc0 Aug 23 03:09:42 juju-e4d256-prod-github-runner-207 kernel: [78356.612551] ? do_futex+0x162/0x1f0 Aug 23 03:09:42 juju-e4d256-prod-github-runner-207 kernel: [78356.613500] ? __x64_sys_futex+0x78/0x1e0 Aug 23 03:09:42 juju-e4d256-prod-github-runner-207 kernel: [78356.614481] ? __secure_computing+0xa9/0x120 Aug 23 03:09:42 juju-e4d256-prod-github-runner-207 kernel: [78356.615469] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 03:09:42 juju-e4d256-prod-github-runner-207 kernel: [78356.616597] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 03:09:42 juju-e4d256-prod-github-runner-207 kernel: [78356.617666] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 03:09:42 juju-e4d256-prod-github-runner-207 kernel: [78356.618723] ? do_syscall_64+0x69/0xc0 Aug 23 03:09:42 juju-e4d256-prod-github-runner-207 kernel: [78356.619662] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 03:09:42 juju-e4d256-prod-github-runner-207 kernel: [78356.620614] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 03:09:42 juju-e4d256-prod-github-runner-207 kernel: [78356.621558] ? do_syscall_64+0x69/0xc0 Aug 23 03:09:42 juju-e4d256-prod-github-runner-207 kernel: [78356.622446] ? do_syscall_64+0x69/0xc0 Aug 23 03:09:42 juju-e4d256-prod-github-runner-207 kernel: [78356.623373] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 03:09:42 juju-e4d256-prod-github-runner-207 kernel: [78356.624392] RIP: 0033:0x7faa5d0edaff Aug 23 03:09:42 juju-e4d256-prod-github-runner-207 kernel: [78356.625296] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 03:09:42 juju-e4d256-prod-github-runner-207 kernel: [78356.628324] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 03:09:42 juju-e4d256-prod-github-runner-207 kernel: [78356.629639] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 03:09:42 juju-e4d256-prod-github-runner-207 kernel: [78356.630988] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 03:09:42 juju-e4d256-prod-github-runner-207 kernel: [78356.631913] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 03:09:42 juju-e4d256-prod-github-runner-207 kernel: [78356.632861] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 03:09:42 juju-e4d256-prod-github-runner-207 kernel: [78356.633766] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 03:09:42 juju-e4d256-prod-github-runner-207 kernel: [78356.634708] Aug 23 03:10:10 juju-e4d256-prod-github-runner-207 kernel: [78384.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 72893s! [qemu-system-x86:6715] Aug 23 03:10:10 juju-e4d256-prod-github-runner-207 kernel: [78384.543890] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 03:10:10 juju-e4d256-prod-github-runner-207 kernel: [78384.544187] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 03:10:10 juju-e4d256-prod-github-runner-207 kernel: [78384.556440] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 03:10:10 juju-e4d256-prod-github-runner-207 kernel: [78384.557705] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 03:10:10 juju-e4d256-prod-github-runner-207 kernel: [78384.558938] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 03:10:10 juju-e4d256-prod-github-runner-207 kernel: [78384.560004] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 03:10:10 juju-e4d256-prod-github-runner-207 kernel: [78384.562570] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 03:10:10 juju-e4d256-prod-github-runner-207 kernel: [78384.563612] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 03:10:10 juju-e4d256-prod-github-runner-207 kernel: [78384.564775] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 03:10:10 juju-e4d256-prod-github-runner-207 kernel: [78384.565936] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 03:10:10 juju-e4d256-prod-github-runner-207 kernel: [78384.567135] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 03:10:10 juju-e4d256-prod-github-runner-207 kernel: [78384.568302] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 03:10:10 juju-e4d256-prod-github-runner-207 kernel: [78384.569464] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 03:10:10 juju-e4d256-prod-github-runner-207 kernel: [78384.570712] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 03:10:10 juju-e4d256-prod-github-runner-207 kernel: [78384.571808] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 03:10:10 juju-e4d256-prod-github-runner-207 kernel: [78384.572997] Call Trace: Aug 23 03:10:10 juju-e4d256-prod-github-runner-207 kernel: [78384.573944] Aug 23 03:10:10 juju-e4d256-prod-github-runner-207 kernel: [78384.574878] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 03:10:10 juju-e4d256-prod-github-runner-207 kernel: [78384.575915] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 03:10:10 juju-e4d256-prod-github-runner-207 kernel: [78384.576941] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 03:10:10 juju-e4d256-prod-github-runner-207 kernel: [78384.578236] ? show_regs.part.0+0x23/0x29 Aug 23 03:10:10 juju-e4d256-prod-github-runner-207 kernel: [78384.579459] ? show_regs.cold+0x8/0xd Aug 23 03:10:10 juju-e4d256-prod-github-runner-207 kernel: [78384.580622] ? watchdog_timer_fn+0x1be/0x220 Aug 23 03:10:10 juju-e4d256-prod-github-runner-207 kernel: [78384.581632] ? lockup_detector_update_enable+0x60/0x60 Aug 23 03:10:10 juju-e4d256-prod-github-runner-207 kernel: [78384.582722] ? __hrtimer_run_queues+0x107/0x230 Aug 23 03:10:10 juju-e4d256-prod-github-runner-207 kernel: [78384.583753] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 03:10:10 juju-e4d256-prod-github-runner-207 kernel: [78384.584779] ? hrtimer_interrupt+0x101/0x220 Aug 23 03:10:10 juju-e4d256-prod-github-runner-207 kernel: [78384.585816] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 03:10:10 juju-e4d256-prod-github-runner-207 kernel: [78384.586974] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 03:10:10 juju-e4d256-prod-github-runner-207 kernel: [78384.588061] Aug 23 03:10:10 juju-e4d256-prod-github-runner-207 kernel: [78384.588918] Aug 23 03:10:10 juju-e4d256-prod-github-runner-207 kernel: [78384.589759] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 03:10:10 juju-e4d256-prod-github-runner-207 kernel: [78384.590846] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 03:10:10 juju-e4d256-prod-github-runner-207 kernel: [78384.591892] ? _raw_spin_lock+0x22/0x30 Aug 23 03:10:10 juju-e4d256-prod-github-runner-207 kernel: [78384.592857] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 03:10:10 juju-e4d256-prod-github-runner-207 kernel: [78384.593891] direct_page_fault+0x206/0x310 [kvm] Aug 23 03:10:10 juju-e4d256-prod-github-runner-207 kernel: [78384.594937] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 03:10:10 juju-e4d256-prod-github-runner-207 kernel: [78384.595953] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 03:10:10 juju-e4d256-prod-github-runner-207 kernel: [78384.596988] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 03:10:10 juju-e4d256-prod-github-runner-207 kernel: [78384.598077] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 03:10:10 juju-e4d256-prod-github-runner-207 kernel: [78384.599070] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 03:10:10 juju-e4d256-prod-github-runner-207 kernel: [78384.600066] handle_exit+0x98/0x230 [kvm_amd] Aug 23 03:10:10 juju-e4d256-prod-github-runner-207 kernel: [78384.600967] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 03:10:10 juju-e4d256-prod-github-runner-207 kernel: [78384.601887] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 03:10:10 juju-e4d256-prod-github-runner-207 kernel: [78384.602839] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 03:10:10 juju-e4d256-prod-github-runner-207 kernel: [78384.603755] vcpu_run+0x62/0x2c0 [kvm] Aug 23 03:10:10 juju-e4d256-prod-github-runner-207 kernel: [78384.604575] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 03:10:10 juju-e4d256-prod-github-runner-207 kernel: [78384.605388] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 03:10:10 juju-e4d256-prod-github-runner-207 kernel: [78384.606261] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 03:10:10 juju-e4d256-prod-github-runner-207 kernel: [78384.607079] ? __seccomp_filter+0x4a/0x4a0 Aug 23 03:10:10 juju-e4d256-prod-github-runner-207 kernel: [78384.607833] ? __fget_files+0x86/0xc0 Aug 23 03:10:10 juju-e4d256-prod-github-runner-207 kernel: [78384.608586] __x64_sys_ioctl+0x95/0xd0 Aug 23 03:10:10 juju-e4d256-prod-github-runner-207 kernel: [78384.609290] do_syscall_64+0x5c/0xc0 Aug 23 03:10:10 juju-e4d256-prod-github-runner-207 kernel: [78384.609959] ? do_futex+0x162/0x1f0 Aug 23 03:10:10 juju-e4d256-prod-github-runner-207 kernel: [78384.610654] ? __x64_sys_futex+0x78/0x1e0 Aug 23 03:10:10 juju-e4d256-prod-github-runner-207 kernel: [78384.611332] ? __secure_computing+0xa9/0x120 Aug 23 03:10:10 juju-e4d256-prod-github-runner-207 kernel: [78384.612025] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 03:10:10 juju-e4d256-prod-github-runner-207 kernel: [78384.612791] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 03:10:10 juju-e4d256-prod-github-runner-207 kernel: [78384.613512] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 03:10:10 juju-e4d256-prod-github-runner-207 kernel: [78384.614252] ? do_syscall_64+0x69/0xc0 Aug 23 03:10:10 juju-e4d256-prod-github-runner-207 kernel: [78384.614948] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 03:10:10 juju-e4d256-prod-github-runner-207 kernel: [78384.615688] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 03:10:10 juju-e4d256-prod-github-runner-207 kernel: [78384.616391] ? do_syscall_64+0x69/0xc0 Aug 23 03:10:10 juju-e4d256-prod-github-runner-207 kernel: [78384.617029] ? do_syscall_64+0x69/0xc0 Aug 23 03:10:10 juju-e4d256-prod-github-runner-207 kernel: [78384.617653] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 03:10:10 juju-e4d256-prod-github-runner-207 kernel: [78384.618361] RIP: 0033:0x7faa5d0edaff Aug 23 03:10:10 juju-e4d256-prod-github-runner-207 kernel: [78384.619037] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 03:10:10 juju-e4d256-prod-github-runner-207 kernel: [78384.621025] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 03:10:10 juju-e4d256-prod-github-runner-207 kernel: [78384.621936] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 03:10:10 juju-e4d256-prod-github-runner-207 kernel: [78384.622845] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 03:10:10 juju-e4d256-prod-github-runner-207 kernel: [78384.623741] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 03:10:10 juju-e4d256-prod-github-runner-207 kernel: [78384.624646] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 03:10:10 juju-e4d256-prod-github-runner-207 kernel: [78384.625542] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 03:10:10 juju-e4d256-prod-github-runner-207 kernel: [78384.626499] Aug 23 03:10:38 juju-e4d256-prod-github-runner-207 kernel: [78412.541976] watchdog: BUG: soft lockup - CPU#1 stuck for 72919s! [qemu-system-x86:6715] Aug 23 03:10:38 juju-e4d256-prod-github-runner-207 kernel: [78412.543096] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 03:10:38 juju-e4d256-prod-github-runner-207 kernel: [78412.543166] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 03:10:38 juju-e4d256-prod-github-runner-207 kernel: [78412.555707] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 03:10:38 juju-e4d256-prod-github-runner-207 kernel: [78412.557081] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 03:10:38 juju-e4d256-prod-github-runner-207 kernel: [78412.558312] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 03:10:38 juju-e4d256-prod-github-runner-207 kernel: [78412.559367] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 03:10:38 juju-e4d256-prod-github-runner-207 kernel: [78412.561912] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 03:10:38 juju-e4d256-prod-github-runner-207 kernel: [78412.563012] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 03:10:38 juju-e4d256-prod-github-runner-207 kernel: [78412.564185] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 03:10:38 juju-e4d256-prod-github-runner-207 kernel: [78412.565386] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 03:10:38 juju-e4d256-prod-github-runner-207 kernel: [78412.566578] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 03:10:38 juju-e4d256-prod-github-runner-207 kernel: [78412.567742] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 03:10:38 juju-e4d256-prod-github-runner-207 kernel: [78412.568925] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 03:10:38 juju-e4d256-prod-github-runner-207 kernel: [78412.570216] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 03:10:38 juju-e4d256-prod-github-runner-207 kernel: [78412.571316] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 03:10:38 juju-e4d256-prod-github-runner-207 kernel: [78412.572524] Call Trace: Aug 23 03:10:38 juju-e4d256-prod-github-runner-207 kernel: [78412.573447] Aug 23 03:10:38 juju-e4d256-prod-github-runner-207 kernel: [78412.574347] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 03:10:38 juju-e4d256-prod-github-runner-207 kernel: [78412.575377] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 03:10:38 juju-e4d256-prod-github-runner-207 kernel: [78412.576395] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 03:10:38 juju-e4d256-prod-github-runner-207 kernel: [78412.577467] ? show_regs.part.0+0x23/0x29 Aug 23 03:10:38 juju-e4d256-prod-github-runner-207 kernel: [78412.578487] ? show_regs.cold+0x8/0xd Aug 23 03:10:38 juju-e4d256-prod-github-runner-207 kernel: [78412.579457] ? watchdog_timer_fn+0x1be/0x220 Aug 23 03:10:38 juju-e4d256-prod-github-runner-207 kernel: [78412.580473] ? lockup_detector_update_enable+0x60/0x60 Aug 23 03:10:38 juju-e4d256-prod-github-runner-207 kernel: [78412.581535] ? __hrtimer_run_queues+0x107/0x230 Aug 23 03:10:38 juju-e4d256-prod-github-runner-207 kernel: [78412.582580] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 03:10:38 juju-e4d256-prod-github-runner-207 kernel: [78412.583602] ? hrtimer_interrupt+0x101/0x220 Aug 23 03:10:38 juju-e4d256-prod-github-runner-207 kernel: [78412.584620] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 03:10:38 juju-e4d256-prod-github-runner-207 kernel: [78412.585685] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 03:10:38 juju-e4d256-prod-github-runner-207 kernel: [78412.586739] Aug 23 03:10:38 juju-e4d256-prod-github-runner-207 kernel: [78412.587590] Aug 23 03:10:38 juju-e4d256-prod-github-runner-207 kernel: [78412.588429] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 03:10:38 juju-e4d256-prod-github-runner-207 kernel: [78412.589459] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 03:10:38 juju-e4d256-prod-github-runner-207 kernel: [78412.590517] ? _raw_spin_lock+0x22/0x30 Aug 23 03:10:38 juju-e4d256-prod-github-runner-207 kernel: [78412.591471] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 03:10:38 juju-e4d256-prod-github-runner-207 kernel: [78412.592488] direct_page_fault+0x206/0x310 [kvm] Aug 23 03:10:38 juju-e4d256-prod-github-runner-207 kernel: [78412.593510] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 03:10:38 juju-e4d256-prod-github-runner-207 kernel: [78412.594533] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 03:10:38 juju-e4d256-prod-github-runner-207 kernel: [78412.595534] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 03:10:38 juju-e4d256-prod-github-runner-207 kernel: [78412.596529] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 03:10:38 juju-e4d256-prod-github-runner-207 kernel: [78412.597483] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 03:10:38 juju-e4d256-prod-github-runner-207 kernel: [78412.598526] handle_exit+0x98/0x230 [kvm_amd] Aug 23 03:10:38 juju-e4d256-prod-github-runner-207 kernel: [78412.599418] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 03:10:38 juju-e4d256-prod-github-runner-207 kernel: [78412.600331] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 03:10:38 juju-e4d256-prod-github-runner-207 kernel: [78412.601259] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 03:10:38 juju-e4d256-prod-github-runner-207 kernel: [78412.602174] vcpu_run+0x62/0x2c0 [kvm] Aug 23 03:10:38 juju-e4d256-prod-github-runner-207 kernel: [78412.602985] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 03:10:38 juju-e4d256-prod-github-runner-207 kernel: [78412.603791] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 03:10:38 juju-e4d256-prod-github-runner-207 kernel: [78412.604644] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 03:10:38 juju-e4d256-prod-github-runner-207 kernel: [78412.605440] ? __seccomp_filter+0x4a/0x4a0 Aug 23 03:10:38 juju-e4d256-prod-github-runner-207 kernel: [78412.606213] ? __fget_files+0x86/0xc0 Aug 23 03:10:38 juju-e4d256-prod-github-runner-207 kernel: [78412.606945] __x64_sys_ioctl+0x95/0xd0 Aug 23 03:10:38 juju-e4d256-prod-github-runner-207 kernel: [78412.607657] do_syscall_64+0x5c/0xc0 Aug 23 03:10:38 juju-e4d256-prod-github-runner-207 kernel: [78412.608322] ? do_futex+0x162/0x1f0 Aug 23 03:10:38 juju-e4d256-prod-github-runner-207 kernel: [78412.608969] ? __x64_sys_futex+0x78/0x1e0 Aug 23 03:10:38 juju-e4d256-prod-github-runner-207 kernel: [78412.609641] ? __secure_computing+0xa9/0x120 Aug 23 03:10:38 juju-e4d256-prod-github-runner-207 kernel: [78412.610342] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 03:10:38 juju-e4d256-prod-github-runner-207 kernel: [78412.611145] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 03:10:38 juju-e4d256-prod-github-runner-207 kernel: [78412.611866] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 03:10:38 juju-e4d256-prod-github-runner-207 kernel: [78412.612583] ? do_syscall_64+0x69/0xc0 Aug 23 03:10:38 juju-e4d256-prod-github-runner-207 kernel: [78412.613225] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 03:10:38 juju-e4d256-prod-github-runner-207 kernel: [78412.613931] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 03:10:38 juju-e4d256-prod-github-runner-207 kernel: [78412.614637] ? do_syscall_64+0x69/0xc0 Aug 23 03:10:38 juju-e4d256-prod-github-runner-207 kernel: [78412.615262] ? do_syscall_64+0x69/0xc0 Aug 23 03:10:38 juju-e4d256-prod-github-runner-207 kernel: [78412.615883] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 03:10:38 juju-e4d256-prod-github-runner-207 kernel: [78412.616592] RIP: 0033:0x7faa5d0edaff Aug 23 03:10:38 juju-e4d256-prod-github-runner-207 kernel: [78412.617235] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 03:10:38 juju-e4d256-prod-github-runner-207 kernel: [78412.619228] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 03:10:38 juju-e4d256-prod-github-runner-207 kernel: [78412.620139] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 03:10:38 juju-e4d256-prod-github-runner-207 kernel: [78412.621030] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 03:10:38 juju-e4d256-prod-github-runner-207 kernel: [78412.621923] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 03:10:38 juju-e4d256-prod-github-runner-207 kernel: [78412.622822] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 03:10:38 juju-e4d256-prod-github-runner-207 kernel: [78412.623708] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 03:10:38 juju-e4d256-prod-github-runner-207 kernel: [78412.624599] Aug 23 03:11:06 juju-e4d256-prod-github-runner-207 kernel: [78440.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 72945s! [qemu-system-x86:6715] Aug 23 03:11:06 juju-e4d256-prod-github-runner-207 kernel: [78440.543105] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 03:11:06 juju-e4d256-prod-github-runner-207 kernel: [78440.543185] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 03:11:06 juju-e4d256-prod-github-runner-207 kernel: [78440.555270] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 03:11:06 juju-e4d256-prod-github-runner-207 kernel: [78440.556536] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 03:11:06 juju-e4d256-prod-github-runner-207 kernel: [78440.557774] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 03:11:06 juju-e4d256-prod-github-runner-207 kernel: [78440.558845] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 03:11:06 juju-e4d256-prod-github-runner-207 kernel: [78440.561397] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 03:11:06 juju-e4d256-prod-github-runner-207 kernel: [78440.562458] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 03:11:06 juju-e4d256-prod-github-runner-207 kernel: [78440.563621] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 03:11:06 juju-e4d256-prod-github-runner-207 kernel: [78440.564787] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 03:11:06 juju-e4d256-prod-github-runner-207 kernel: [78440.565962] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 03:11:06 juju-e4d256-prod-github-runner-207 kernel: [78440.567132] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 03:11:06 juju-e4d256-prod-github-runner-207 kernel: [78440.568301] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 03:11:06 juju-e4d256-prod-github-runner-207 kernel: [78440.569538] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 03:11:06 juju-e4d256-prod-github-runner-207 kernel: [78440.570643] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 03:11:06 juju-e4d256-prod-github-runner-207 kernel: [78440.571841] Call Trace: Aug 23 03:11:06 juju-e4d256-prod-github-runner-207 kernel: [78440.572765] Aug 23 03:11:06 juju-e4d256-prod-github-runner-207 kernel: [78440.573649] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 03:11:06 juju-e4d256-prod-github-runner-207 kernel: [78440.574686] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 03:11:06 juju-e4d256-prod-github-runner-207 kernel: [78440.575705] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 03:11:06 juju-e4d256-prod-github-runner-207 kernel: [78440.576778] ? show_regs.part.0+0x23/0x29 Aug 23 03:11:06 juju-e4d256-prod-github-runner-207 kernel: [78440.577776] ? show_regs.cold+0x8/0xd Aug 23 03:11:06 juju-e4d256-prod-github-runner-207 kernel: [78440.578752] ? watchdog_timer_fn+0x1be/0x220 Aug 23 03:11:06 juju-e4d256-prod-github-runner-207 kernel: [78440.579758] ? lockup_detector_update_enable+0x60/0x60 Aug 23 03:11:06 juju-e4d256-prod-github-runner-207 kernel: [78440.580822] ? __hrtimer_run_queues+0x107/0x230 Aug 23 03:11:06 juju-e4d256-prod-github-runner-207 kernel: [78440.581866] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 03:11:06 juju-e4d256-prod-github-runner-207 kernel: [78440.582889] ? hrtimer_interrupt+0x101/0x220 Aug 23 03:11:06 juju-e4d256-prod-github-runner-207 kernel: [78440.583903] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 03:11:06 juju-e4d256-prod-github-runner-207 kernel: [78440.584971] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 03:11:06 juju-e4d256-prod-github-runner-207 kernel: [78440.586059] Aug 23 03:11:06 juju-e4d256-prod-github-runner-207 kernel: [78440.586926] Aug 23 03:11:06 juju-e4d256-prod-github-runner-207 kernel: [78440.587802] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 03:11:06 juju-e4d256-prod-github-runner-207 kernel: [78440.588842] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 03:11:06 juju-e4d256-prod-github-runner-207 kernel: [78440.589896] ? _raw_spin_lock+0x22/0x30 Aug 23 03:11:06 juju-e4d256-prod-github-runner-207 kernel: [78440.590839] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 03:11:06 juju-e4d256-prod-github-runner-207 kernel: [78440.591857] direct_page_fault+0x206/0x310 [kvm] Aug 23 03:11:06 juju-e4d256-prod-github-runner-207 kernel: [78440.592892] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 03:11:06 juju-e4d256-prod-github-runner-207 kernel: [78440.593912] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 03:11:06 juju-e4d256-prod-github-runner-207 kernel: [78440.594912] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 03:11:06 juju-e4d256-prod-github-runner-207 kernel: [78440.595884] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 03:11:06 juju-e4d256-prod-github-runner-207 kernel: [78440.596827] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 03:11:06 juju-e4d256-prod-github-runner-207 kernel: [78440.597804] handle_exit+0x98/0x230 [kvm_amd] Aug 23 03:11:06 juju-e4d256-prod-github-runner-207 kernel: [78440.598702] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 03:11:06 juju-e4d256-prod-github-runner-207 kernel: [78440.599969] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 03:11:06 juju-e4d256-prod-github-runner-207 kernel: [78440.600894] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 03:11:06 juju-e4d256-prod-github-runner-207 kernel: [78440.601794] vcpu_run+0x62/0x2c0 [kvm] Aug 23 03:11:06 juju-e4d256-prod-github-runner-207 kernel: [78440.602616] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 03:11:06 juju-e4d256-prod-github-runner-207 kernel: [78440.603428] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 03:11:06 juju-e4d256-prod-github-runner-207 kernel: [78440.604279] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 03:11:06 juju-e4d256-prod-github-runner-207 kernel: [78440.605085] ? __seccomp_filter+0x4a/0x4a0 Aug 23 03:11:06 juju-e4d256-prod-github-runner-207 kernel: [78440.605831] ? __fget_files+0x86/0xc0 Aug 23 03:11:06 juju-e4d256-prod-github-runner-207 kernel: [78440.606533] __x64_sys_ioctl+0x95/0xd0 Aug 23 03:11:06 juju-e4d256-prod-github-runner-207 kernel: [78440.607223] do_syscall_64+0x5c/0xc0 Aug 23 03:11:06 juju-e4d256-prod-github-runner-207 kernel: [78440.607891] ? do_futex+0x162/0x1f0 Aug 23 03:11:06 juju-e4d256-prod-github-runner-207 kernel: [78440.608536] ? __x64_sys_futex+0x78/0x1e0 Aug 23 03:11:06 juju-e4d256-prod-github-runner-207 kernel: [78440.609208] ? __secure_computing+0xa9/0x120 Aug 23 03:11:06 juju-e4d256-prod-github-runner-207 kernel: [78440.609909] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 03:11:06 juju-e4d256-prod-github-runner-207 kernel: [78440.610667] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 03:11:06 juju-e4d256-prod-github-runner-207 kernel: [78440.611386] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 03:11:06 juju-e4d256-prod-github-runner-207 kernel: [78440.612105] ? do_syscall_64+0x69/0xc0 Aug 23 03:11:06 juju-e4d256-prod-github-runner-207 kernel: [78440.612748] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 03:11:06 juju-e4d256-prod-github-runner-207 kernel: [78440.613552] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 03:11:06 juju-e4d256-prod-github-runner-207 kernel: [78440.614348] ? do_syscall_64+0x69/0xc0 Aug 23 03:11:06 juju-e4d256-prod-github-runner-207 kernel: [78440.614977] ? do_syscall_64+0x69/0xc0 Aug 23 03:11:06 juju-e4d256-prod-github-runner-207 kernel: [78440.615605] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 03:11:06 juju-e4d256-prod-github-runner-207 kernel: [78440.616307] RIP: 0033:0x7faa5d0edaff Aug 23 03:11:06 juju-e4d256-prod-github-runner-207 kernel: [78440.616933] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 03:11:06 juju-e4d256-prod-github-runner-207 kernel: [78440.618925] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 03:11:06 juju-e4d256-prod-github-runner-207 kernel: [78440.619832] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 03:11:06 juju-e4d256-prod-github-runner-207 kernel: [78440.620718] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 03:11:06 juju-e4d256-prod-github-runner-207 kernel: [78440.621607] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 03:11:06 juju-e4d256-prod-github-runner-207 kernel: [78440.622506] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 03:11:06 juju-e4d256-prod-github-runner-207 kernel: [78440.623397] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 03:11:06 juju-e4d256-prod-github-runner-207 kernel: [78440.624293] Aug 23 03:11:34 juju-e4d256-prod-github-runner-207 kernel: [78468.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 72971s! [qemu-system-x86:6715] Aug 23 03:11:34 juju-e4d256-prod-github-runner-207 kernel: [78468.543904] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 03:11:34 juju-e4d256-prod-github-runner-207 kernel: [78468.544227] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 03:11:34 juju-e4d256-prod-github-runner-207 kernel: [78468.557320] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 03:11:34 juju-e4d256-prod-github-runner-207 kernel: [78468.558716] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 03:11:34 juju-e4d256-prod-github-runner-207 kernel: [78468.559941] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 03:11:34 juju-e4d256-prod-github-runner-207 kernel: [78468.561000] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 03:11:34 juju-e4d256-prod-github-runner-207 kernel: [78468.563580] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 03:11:34 juju-e4d256-prod-github-runner-207 kernel: [78468.564633] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 03:11:34 juju-e4d256-prod-github-runner-207 kernel: [78468.565805] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 03:11:34 juju-e4d256-prod-github-runner-207 kernel: [78468.566976] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 03:11:34 juju-e4d256-prod-github-runner-207 kernel: [78468.568149] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 03:11:34 juju-e4d256-prod-github-runner-207 kernel: [78468.569308] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 03:11:34 juju-e4d256-prod-github-runner-207 kernel: [78468.570490] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 03:11:34 juju-e4d256-prod-github-runner-207 kernel: [78468.571723] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 03:11:34 juju-e4d256-prod-github-runner-207 kernel: [78468.572824] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 03:11:34 juju-e4d256-prod-github-runner-207 kernel: [78468.574031] Call Trace: Aug 23 03:11:34 juju-e4d256-prod-github-runner-207 kernel: [78468.574946] Aug 23 03:11:34 juju-e4d256-prod-github-runner-207 kernel: [78468.575851] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 03:11:34 juju-e4d256-prod-github-runner-207 kernel: [78468.576880] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 03:11:34 juju-e4d256-prod-github-runner-207 kernel: [78468.577924] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 03:11:34 juju-e4d256-prod-github-runner-207 kernel: [78468.579026] ? show_regs.part.0+0x23/0x29 Aug 23 03:11:34 juju-e4d256-prod-github-runner-207 kernel: [78468.580026] ? show_regs.cold+0x8/0xd Aug 23 03:11:34 juju-e4d256-prod-github-runner-207 kernel: [78468.580995] ? watchdog_timer_fn+0x1be/0x220 Aug 23 03:11:34 juju-e4d256-prod-github-runner-207 kernel: [78468.582018] ? lockup_detector_update_enable+0x60/0x60 Aug 23 03:11:34 juju-e4d256-prod-github-runner-207 kernel: [78468.583086] ? __hrtimer_run_queues+0x107/0x230 Aug 23 03:11:34 juju-e4d256-prod-github-runner-207 kernel: [78468.584131] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 03:11:34 juju-e4d256-prod-github-runner-207 kernel: [78468.585159] ? hrtimer_interrupt+0x101/0x220 Aug 23 03:11:34 juju-e4d256-prod-github-runner-207 kernel: [78468.586190] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 03:11:34 juju-e4d256-prod-github-runner-207 kernel: [78468.587270] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 03:11:34 juju-e4d256-prod-github-runner-207 kernel: [78468.588317] Aug 23 03:11:34 juju-e4d256-prod-github-runner-207 kernel: [78468.589169] Aug 23 03:11:34 juju-e4d256-prod-github-runner-207 kernel: [78468.590027] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 03:11:34 juju-e4d256-prod-github-runner-207 kernel: [78468.591060] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 03:11:34 juju-e4d256-prod-github-runner-207 kernel: [78468.592109] ? _raw_spin_lock+0x22/0x30 Aug 23 03:11:34 juju-e4d256-prod-github-runner-207 kernel: [78468.593078] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 03:11:34 juju-e4d256-prod-github-runner-207 kernel: [78468.594122] direct_page_fault+0x206/0x310 [kvm] Aug 23 03:11:34 juju-e4d256-prod-github-runner-207 kernel: [78468.595149] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 03:11:34 juju-e4d256-prod-github-runner-207 kernel: [78468.596161] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 03:11:34 juju-e4d256-prod-github-runner-207 kernel: [78468.597160] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 03:11:34 juju-e4d256-prod-github-runner-207 kernel: [78468.598171] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 03:11:34 juju-e4d256-prod-github-runner-207 kernel: [78468.599136] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 03:11:34 juju-e4d256-prod-github-runner-207 kernel: [78468.600118] handle_exit+0x98/0x230 [kvm_amd] Aug 23 03:11:34 juju-e4d256-prod-github-runner-207 kernel: [78468.601014] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 03:11:34 juju-e4d256-prod-github-runner-207 kernel: [78468.601939] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 03:11:34 juju-e4d256-prod-github-runner-207 kernel: [78468.602867] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 03:11:34 juju-e4d256-prod-github-runner-207 kernel: [78468.603774] vcpu_run+0x62/0x2c0 [kvm] Aug 23 03:11:34 juju-e4d256-prod-github-runner-207 kernel: [78468.604583] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 03:11:34 juju-e4d256-prod-github-runner-207 kernel: [78468.605389] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 03:11:34 juju-e4d256-prod-github-runner-207 kernel: [78468.606253] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 03:11:34 juju-e4d256-prod-github-runner-207 kernel: [78468.607049] ? __seccomp_filter+0x4a/0x4a0 Aug 23 03:11:34 juju-e4d256-prod-github-runner-207 kernel: [78468.607790] ? __fget_files+0x86/0xc0 Aug 23 03:11:34 juju-e4d256-prod-github-runner-207 kernel: [78468.608496] __x64_sys_ioctl+0x95/0xd0 Aug 23 03:11:34 juju-e4d256-prod-github-runner-207 kernel: [78468.609187] do_syscall_64+0x5c/0xc0 Aug 23 03:11:34 juju-e4d256-prod-github-runner-207 kernel: [78468.609863] ? do_futex+0x162/0x1f0 Aug 23 03:11:34 juju-e4d256-prod-github-runner-207 kernel: [78468.610511] ? __x64_sys_futex+0x78/0x1e0 Aug 23 03:11:34 juju-e4d256-prod-github-runner-207 kernel: [78468.611188] ? __secure_computing+0xa9/0x120 Aug 23 03:11:34 juju-e4d256-prod-github-runner-207 kernel: [78468.611943] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 03:11:34 juju-e4d256-prod-github-runner-207 kernel: [78468.612724] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 03:11:34 juju-e4d256-prod-github-runner-207 kernel: [78468.613451] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 03:11:34 juju-e4d256-prod-github-runner-207 kernel: [78468.614185] ? do_syscall_64+0x69/0xc0 Aug 23 03:11:34 juju-e4d256-prod-github-runner-207 kernel: [78468.614834] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 03:11:34 juju-e4d256-prod-github-runner-207 kernel: [78468.615536] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 03:11:34 juju-e4d256-prod-github-runner-207 kernel: [78468.616233] ? do_syscall_64+0x69/0xc0 Aug 23 03:11:34 juju-e4d256-prod-github-runner-207 kernel: [78468.616855] ? do_syscall_64+0x69/0xc0 Aug 23 03:11:34 juju-e4d256-prod-github-runner-207 kernel: [78468.617476] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 03:11:34 juju-e4d256-prod-github-runner-207 kernel: [78468.618200] RIP: 0033:0x7faa5d0edaff Aug 23 03:11:34 juju-e4d256-prod-github-runner-207 kernel: [78468.618870] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 03:11:34 juju-e4d256-prod-github-runner-207 kernel: [78468.620885] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 03:11:34 juju-e4d256-prod-github-runner-207 kernel: [78468.621826] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 03:11:34 juju-e4d256-prod-github-runner-207 kernel: [78468.622744] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 03:11:34 juju-e4d256-prod-github-runner-207 kernel: [78468.623632] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 03:11:34 juju-e4d256-prod-github-runner-207 kernel: [78468.624519] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 03:11:34 juju-e4d256-prod-github-runner-207 kernel: [78468.625462] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 03:11:34 juju-e4d256-prod-github-runner-207 kernel: [78468.626371] Aug 23 03:11:48 juju-e4d256-prod-github-runner-207 kernel: [78482.420706] rcu: INFO: rcu_sched self-detected stall on CPU Aug 23 03:11:48 juju-e4d256-prod-github-runner-207 kernel: [78482.422483] rcu: 1-....: (19529823 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=9442905 Aug 23 03:11:48 juju-e4d256-prod-github-runner-207 kernel: [78482.423612] (t=19591305 jiffies g=23269 q=65790) Aug 23 03:11:48 juju-e4d256-prod-github-runner-207 kernel: [78482.424403] NMI backtrace for cpu 1 Aug 23 03:11:48 juju-e4d256-prod-github-runner-207 kernel: [78482.425145] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 03:11:48 juju-e4d256-prod-github-runner-207 kernel: [78482.426303] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 03:11:48 juju-e4d256-prod-github-runner-207 kernel: [78482.427469] Call Trace: Aug 23 03:11:48 juju-e4d256-prod-github-runner-207 kernel: [78482.428160] Aug 23 03:11:48 juju-e4d256-prod-github-runner-207 kernel: [78482.428831] show_stack+0x52/0x5c Aug 23 03:11:48 juju-e4d256-prod-github-runner-207 kernel: [78482.429589] dump_stack_lvl+0x4a/0x63 Aug 23 03:11:48 juju-e4d256-prod-github-runner-207 kernel: [78482.430413] dump_stack+0x10/0x16 Aug 23 03:11:48 juju-e4d256-prod-github-runner-207 kernel: [78482.431140] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 23 03:11:48 juju-e4d256-prod-github-runner-207 kernel: [78482.431927] ? lapic_can_unplug_cpu+0x90/0x90 Aug 23 03:11:48 juju-e4d256-prod-github-runner-207 kernel: [78482.432707] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 23 03:11:48 juju-e4d256-prod-github-runner-207 kernel: [78482.433549] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 23 03:11:48 juju-e4d256-prod-github-runner-207 kernel: [78482.434372] trigger_single_cpu_backtrace+0x44/0x4f Aug 23 03:11:48 juju-e4d256-prod-github-runner-207 kernel: [78482.435180] rcu_dump_cpu_stacks+0x102/0x149 Aug 23 03:11:48 juju-e4d256-prod-github-runner-207 kernel: [78482.435953] print_cpu_stall.cold+0x2f/0xe2 Aug 23 03:11:48 juju-e4d256-prod-github-runner-207 kernel: [78482.436716] ? timekeeping_update+0xf7/0x150 Aug 23 03:11:48 juju-e4d256-prod-github-runner-207 kernel: [78482.437510] check_cpu_stall+0x109/0x270 Aug 23 03:11:48 juju-e4d256-prod-github-runner-207 kernel: [78482.438263] rcu_sched_clock_irq+0x9a/0x250 Aug 23 03:11:48 juju-e4d256-prod-github-runner-207 kernel: [78482.439024] update_process_times+0x94/0xd0 Aug 23 03:11:48 juju-e4d256-prod-github-runner-207 kernel: [78482.439784] tick_sched_handle+0x29/0x70 Aug 23 03:11:48 juju-e4d256-prod-github-runner-207 kernel: [78482.440528] tick_sched_timer+0x8c/0xc0 Aug 23 03:11:48 juju-e4d256-prod-github-runner-207 kernel: [78482.441264] ? tick_nohz_handler+0xb0/0xb0 Aug 23 03:11:48 juju-e4d256-prod-github-runner-207 kernel: [78482.442044] __hrtimer_run_queues+0x107/0x230 Aug 23 03:11:48 juju-e4d256-prod-github-runner-207 kernel: [78482.442823] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 03:11:48 juju-e4d256-prod-github-runner-207 kernel: [78482.443886] hrtimer_interrupt+0x101/0x220 Aug 23 03:11:48 juju-e4d256-prod-github-runner-207 kernel: [78482.444656] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 03:11:48 juju-e4d256-prod-github-runner-207 kernel: [78482.445550] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 03:11:48 juju-e4d256-prod-github-runner-207 kernel: [78482.446361] Aug 23 03:11:48 juju-e4d256-prod-github-runner-207 kernel: [78482.446995] Aug 23 03:11:48 juju-e4d256-prod-github-runner-207 kernel: [78482.447831] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 03:11:48 juju-e4d256-prod-github-runner-207 kernel: [78482.448650] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 03:11:48 juju-e4d256-prod-github-runner-207 kernel: [78482.449547] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 03:11:48 juju-e4d256-prod-github-runner-207 kernel: [78482.451753] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 03:11:48 juju-e4d256-prod-github-runner-207 kernel: [78482.452625] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 03:11:48 juju-e4d256-prod-github-runner-207 kernel: [78482.453638] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 03:11:48 juju-e4d256-prod-github-runner-207 kernel: [78482.454613] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 03:11:48 juju-e4d256-prod-github-runner-207 kernel: [78482.455574] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 03:11:48 juju-e4d256-prod-github-runner-207 kernel: [78482.456527] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 03:11:48 juju-e4d256-prod-github-runner-207 kernel: [78482.457507] ? _raw_spin_lock+0x22/0x30 Aug 23 03:11:48 juju-e4d256-prod-github-runner-207 kernel: [78482.458282] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 03:11:48 juju-e4d256-prod-github-runner-207 kernel: [78482.459141] direct_page_fault+0x206/0x310 [kvm] Aug 23 03:11:48 juju-e4d256-prod-github-runner-207 kernel: [78482.459977] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 03:11:48 juju-e4d256-prod-github-runner-207 kernel: [78482.460873] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 03:11:48 juju-e4d256-prod-github-runner-207 kernel: [78482.461837] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 03:11:48 juju-e4d256-prod-github-runner-207 kernel: [78482.462688] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 03:11:48 juju-e4d256-prod-github-runner-207 kernel: [78482.463470] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 03:11:48 juju-e4d256-prod-github-runner-207 kernel: [78482.464294] handle_exit+0x98/0x230 [kvm_amd] Aug 23 03:11:48 juju-e4d256-prod-github-runner-207 kernel: [78482.465044] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 03:11:48 juju-e4d256-prod-github-runner-207 kernel: [78482.465853] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 03:11:48 juju-e4d256-prod-github-runner-207 kernel: [78482.466661] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 03:11:48 juju-e4d256-prod-github-runner-207 kernel: [78482.467451] vcpu_run+0x62/0x2c0 [kvm] Aug 23 03:11:48 juju-e4d256-prod-github-runner-207 kernel: [78482.468165] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 03:11:48 juju-e4d256-prod-github-runner-207 kernel: [78482.468896] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 03:11:48 juju-e4d256-prod-github-runner-207 kernel: [78482.469709] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 03:11:48 juju-e4d256-prod-github-runner-207 kernel: [78482.470472] ? __seccomp_filter+0x4a/0x4a0 Aug 23 03:11:48 juju-e4d256-prod-github-runner-207 kernel: [78482.471191] ? __fget_files+0x86/0xc0 Aug 23 03:11:48 juju-e4d256-prod-github-runner-207 kernel: [78482.471893] __x64_sys_ioctl+0x95/0xd0 Aug 23 03:11:48 juju-e4d256-prod-github-runner-207 kernel: [78482.472591] do_syscall_64+0x5c/0xc0 Aug 23 03:11:48 juju-e4d256-prod-github-runner-207 kernel: [78482.473278] ? do_futex+0x162/0x1f0 Aug 23 03:11:48 juju-e4d256-prod-github-runner-207 kernel: [78482.474033] ? __x64_sys_futex+0x78/0x1e0 Aug 23 03:11:48 juju-e4d256-prod-github-runner-207 kernel: [78482.474737] ? __secure_computing+0xa9/0x120 Aug 23 03:11:48 juju-e4d256-prod-github-runner-207 kernel: [78482.475499] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 03:11:48 juju-e4d256-prod-github-runner-207 kernel: [78482.476292] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 03:11:48 juju-e4d256-prod-github-runner-207 kernel: [78482.477043] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 03:11:48 juju-e4d256-prod-github-runner-207 kernel: [78482.477811] ? do_syscall_64+0x69/0xc0 Aug 23 03:11:48 juju-e4d256-prod-github-runner-207 kernel: [78482.478497] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 03:11:48 juju-e4d256-prod-github-runner-207 kernel: [78482.479254] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 03:11:48 juju-e4d256-prod-github-runner-207 kernel: [78482.480016] ? do_syscall_64+0x69/0xc0 Aug 23 03:11:48 juju-e4d256-prod-github-runner-207 kernel: [78482.480711] ? do_syscall_64+0x69/0xc0 Aug 23 03:11:48 juju-e4d256-prod-github-runner-207 kernel: [78482.481408] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 03:11:48 juju-e4d256-prod-github-runner-207 kernel: [78482.482179] RIP: 0033:0x7faa5d0edaff Aug 23 03:11:48 juju-e4d256-prod-github-runner-207 kernel: [78482.482899] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 03:11:48 juju-e4d256-prod-github-runner-207 kernel: [78482.485004] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 03:11:48 juju-e4d256-prod-github-runner-207 kernel: [78482.485992] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 03:11:48 juju-e4d256-prod-github-runner-207 kernel: [78482.486941] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 03:11:48 juju-e4d256-prod-github-runner-207 kernel: [78482.487881] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 03:11:48 juju-e4d256-prod-github-runner-207 kernel: [78482.488821] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 03:11:48 juju-e4d256-prod-github-runner-207 kernel: [78482.489760] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 03:11:48 juju-e4d256-prod-github-runner-207 kernel: [78482.490670] Aug 23 03:12:14 juju-e4d256-prod-github-runner-207 kernel: [78508.541981] watchdog: BUG: soft lockup - CPU#1 stuck for 73008s! [qemu-system-x86:6715] Aug 23 03:12:14 juju-e4d256-prod-github-runner-207 kernel: [78508.543933] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 03:12:14 juju-e4d256-prod-github-runner-207 kernel: [78508.544242] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 03:12:14 juju-e4d256-prod-github-runner-207 kernel: [78508.556735] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 03:12:14 juju-e4d256-prod-github-runner-207 kernel: [78508.558025] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 03:12:14 juju-e4d256-prod-github-runner-207 kernel: [78508.559265] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 03:12:14 juju-e4d256-prod-github-runner-207 kernel: [78508.560394] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 03:12:14 juju-e4d256-prod-github-runner-207 kernel: [78508.562973] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 03:12:14 juju-e4d256-prod-github-runner-207 kernel: [78508.564027] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 03:12:14 juju-e4d256-prod-github-runner-207 kernel: [78508.565220] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 03:12:14 juju-e4d256-prod-github-runner-207 kernel: [78508.566401] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 03:12:14 juju-e4d256-prod-github-runner-207 kernel: [78508.567558] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 03:12:14 juju-e4d256-prod-github-runner-207 kernel: [78508.568727] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 03:12:14 juju-e4d256-prod-github-runner-207 kernel: [78508.569916] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 03:12:14 juju-e4d256-prod-github-runner-207 kernel: [78508.571149] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 03:12:14 juju-e4d256-prod-github-runner-207 kernel: [78508.572247] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 03:12:14 juju-e4d256-prod-github-runner-207 kernel: [78508.573463] Call Trace: Aug 23 03:12:14 juju-e4d256-prod-github-runner-207 kernel: [78508.574382] Aug 23 03:12:14 juju-e4d256-prod-github-runner-207 kernel: [78508.575281] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 03:12:14 juju-e4d256-prod-github-runner-207 kernel: [78508.576314] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 03:12:14 juju-e4d256-prod-github-runner-207 kernel: [78508.577428] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 03:12:14 juju-e4d256-prod-github-runner-207 kernel: [78508.578614] ? show_regs.part.0+0x23/0x29 Aug 23 03:12:14 juju-e4d256-prod-github-runner-207 kernel: [78508.579691] ? show_regs.cold+0x8/0xd Aug 23 03:12:14 juju-e4d256-prod-github-runner-207 kernel: [78508.580710] ? watchdog_timer_fn+0x1be/0x220 Aug 23 03:12:14 juju-e4d256-prod-github-runner-207 kernel: [78508.581737] ? lockup_detector_update_enable+0x60/0x60 Aug 23 03:12:14 juju-e4d256-prod-github-runner-207 kernel: [78508.582801] ? __hrtimer_run_queues+0x107/0x230 Aug 23 03:12:14 juju-e4d256-prod-github-runner-207 kernel: [78508.583831] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 03:12:14 juju-e4d256-prod-github-runner-207 kernel: [78508.584863] ? hrtimer_interrupt+0x101/0x220 Aug 23 03:12:14 juju-e4d256-prod-github-runner-207 kernel: [78508.585992] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 03:12:14 juju-e4d256-prod-github-runner-207 kernel: [78508.587095] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 03:12:14 juju-e4d256-prod-github-runner-207 kernel: [78508.588144] Aug 23 03:12:14 juju-e4d256-prod-github-runner-207 kernel: [78508.589009] Aug 23 03:12:14 juju-e4d256-prod-github-runner-207 kernel: [78508.589863] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 03:12:14 juju-e4d256-prod-github-runner-207 kernel: [78508.590893] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 03:12:14 juju-e4d256-prod-github-runner-207 kernel: [78508.591933] ? _raw_spin_lock+0x22/0x30 Aug 23 03:12:14 juju-e4d256-prod-github-runner-207 kernel: [78508.592907] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 03:12:14 juju-e4d256-prod-github-runner-207 kernel: [78508.594049] direct_page_fault+0x206/0x310 [kvm] Aug 23 03:12:14 juju-e4d256-prod-github-runner-207 kernel: [78508.595084] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 03:12:14 juju-e4d256-prod-github-runner-207 kernel: [78508.596098] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 03:12:14 juju-e4d256-prod-github-runner-207 kernel: [78508.597115] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 03:12:14 juju-e4d256-prod-github-runner-207 kernel: [78508.598110] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 03:12:14 juju-e4d256-prod-github-runner-207 kernel: [78508.599055] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 03:12:14 juju-e4d256-prod-github-runner-207 kernel: [78508.600038] handle_exit+0x98/0x230 [kvm_amd] Aug 23 03:12:14 juju-e4d256-prod-github-runner-207 kernel: [78508.600930] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 03:12:14 juju-e4d256-prod-github-runner-207 kernel: [78508.601864] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 03:12:14 juju-e4d256-prod-github-runner-207 kernel: [78508.602813] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 03:12:14 juju-e4d256-prod-github-runner-207 kernel: [78508.603749] vcpu_run+0x62/0x2c0 [kvm] Aug 23 03:12:14 juju-e4d256-prod-github-runner-207 kernel: [78508.604564] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 03:12:14 juju-e4d256-prod-github-runner-207 kernel: [78508.605395] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 03:12:14 juju-e4d256-prod-github-runner-207 kernel: [78508.606250] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 03:12:14 juju-e4d256-prod-github-runner-207 kernel: [78508.607052] ? __seccomp_filter+0x4a/0x4a0 Aug 23 03:12:14 juju-e4d256-prod-github-runner-207 kernel: [78508.607797] ? __fget_files+0x86/0xc0 Aug 23 03:12:14 juju-e4d256-prod-github-runner-207 kernel: [78508.608505] __x64_sys_ioctl+0x95/0xd0 Aug 23 03:12:14 juju-e4d256-prod-github-runner-207 kernel: [78508.609223] do_syscall_64+0x5c/0xc0 Aug 23 03:12:14 juju-e4d256-prod-github-runner-207 kernel: [78508.609896] ? do_futex+0x162/0x1f0 Aug 23 03:12:14 juju-e4d256-prod-github-runner-207 kernel: [78508.610548] ? __x64_sys_futex+0x78/0x1e0 Aug 23 03:12:14 juju-e4d256-prod-github-runner-207 kernel: [78508.611228] ? __secure_computing+0xa9/0x120 Aug 23 03:12:14 juju-e4d256-prod-github-runner-207 kernel: [78508.611932] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 03:12:14 juju-e4d256-prod-github-runner-207 kernel: [78508.612706] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 03:12:14 juju-e4d256-prod-github-runner-207 kernel: [78508.613483] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 03:12:14 juju-e4d256-prod-github-runner-207 kernel: [78508.614216] ? do_syscall_64+0x69/0xc0 Aug 23 03:12:14 juju-e4d256-prod-github-runner-207 kernel: [78508.614877] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 03:12:14 juju-e4d256-prod-github-runner-207 kernel: [78508.615588] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 03:12:14 juju-e4d256-prod-github-runner-207 kernel: [78508.616281] ? do_syscall_64+0x69/0xc0 Aug 23 03:12:14 juju-e4d256-prod-github-runner-207 kernel: [78508.616904] ? do_syscall_64+0x69/0xc0 Aug 23 03:12:14 juju-e4d256-prod-github-runner-207 kernel: [78508.617538] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 03:12:14 juju-e4d256-prod-github-runner-207 kernel: [78508.618241] RIP: 0033:0x7faa5d0edaff Aug 23 03:12:14 juju-e4d256-prod-github-runner-207 kernel: [78508.618900] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 03:12:14 juju-e4d256-prod-github-runner-207 kernel: [78508.620930] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 03:12:14 juju-e4d256-prod-github-runner-207 kernel: [78508.621928] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 03:12:14 juju-e4d256-prod-github-runner-207 kernel: [78508.622816] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 03:12:14 juju-e4d256-prod-github-runner-207 kernel: [78508.623704] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 03:12:14 juju-e4d256-prod-github-runner-207 kernel: [78508.624589] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 03:12:14 juju-e4d256-prod-github-runner-207 kernel: [78508.625487] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 03:12:14 juju-e4d256-prod-github-runner-207 kernel: [78508.626391] Aug 23 03:12:42 juju-e4d256-prod-github-runner-207 kernel: [78536.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 73034s! [qemu-system-x86:6715] Aug 23 03:12:42 juju-e4d256-prod-github-runner-207 kernel: [78536.544092] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 03:12:42 juju-e4d256-prod-github-runner-207 kernel: [78536.544409] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 03:12:42 juju-e4d256-prod-github-runner-207 kernel: [78536.556805] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 03:12:42 juju-e4d256-prod-github-runner-207 kernel: [78536.558070] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 03:12:42 juju-e4d256-prod-github-runner-207 kernel: [78536.559290] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 03:12:42 juju-e4d256-prod-github-runner-207 kernel: [78536.560370] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 03:12:42 juju-e4d256-prod-github-runner-207 kernel: [78536.562956] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 03:12:42 juju-e4d256-prod-github-runner-207 kernel: [78536.564079] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 03:12:42 juju-e4d256-prod-github-runner-207 kernel: [78536.565338] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 03:12:42 juju-e4d256-prod-github-runner-207 kernel: [78536.566543] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 03:12:42 juju-e4d256-prod-github-runner-207 kernel: [78536.567737] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 03:12:42 juju-e4d256-prod-github-runner-207 kernel: [78536.568929] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 03:12:42 juju-e4d256-prod-github-runner-207 kernel: [78536.570409] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 03:12:42 juju-e4d256-prod-github-runner-207 kernel: [78536.571670] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 03:12:42 juju-e4d256-prod-github-runner-207 kernel: [78536.572809] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 03:12:42 juju-e4d256-prod-github-runner-207 kernel: [78536.574052] Call Trace: Aug 23 03:12:42 juju-e4d256-prod-github-runner-207 kernel: [78536.574988] Aug 23 03:12:42 juju-e4d256-prod-github-runner-207 kernel: [78536.575900] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 03:12:42 juju-e4d256-prod-github-runner-207 kernel: [78536.576964] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 03:12:42 juju-e4d256-prod-github-runner-207 kernel: [78536.577985] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 03:12:42 juju-e4d256-prod-github-runner-207 kernel: [78536.579078] ? show_regs.part.0+0x23/0x29 Aug 23 03:12:42 juju-e4d256-prod-github-runner-207 kernel: [78536.580081] ? show_regs.cold+0x8/0xd Aug 23 03:12:42 juju-e4d256-prod-github-runner-207 kernel: [78536.581064] ? watchdog_timer_fn+0x1be/0x220 Aug 23 03:12:42 juju-e4d256-prod-github-runner-207 kernel: [78536.582079] ? lockup_detector_update_enable+0x60/0x60 Aug 23 03:12:42 juju-e4d256-prod-github-runner-207 kernel: [78536.583197] ? __hrtimer_run_queues+0x107/0x230 Aug 23 03:12:42 juju-e4d256-prod-github-runner-207 kernel: [78536.584234] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 03:12:42 juju-e4d256-prod-github-runner-207 kernel: [78536.585281] ? hrtimer_interrupt+0x101/0x220 Aug 23 03:12:42 juju-e4d256-prod-github-runner-207 kernel: [78536.586302] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 03:12:42 juju-e4d256-prod-github-runner-207 kernel: [78536.587391] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 03:12:42 juju-e4d256-prod-github-runner-207 kernel: [78536.588446] Aug 23 03:12:42 juju-e4d256-prod-github-runner-207 kernel: [78536.589349] Aug 23 03:12:42 juju-e4d256-prod-github-runner-207 kernel: [78536.590219] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 03:12:42 juju-e4d256-prod-github-runner-207 kernel: [78536.591301] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 03:12:42 juju-e4d256-prod-github-runner-207 kernel: [78536.592421] ? _raw_spin_lock+0x22/0x30 Aug 23 03:12:42 juju-e4d256-prod-github-runner-207 kernel: [78536.593414] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 03:12:42 juju-e4d256-prod-github-runner-207 kernel: [78536.594467] direct_page_fault+0x206/0x310 [kvm] Aug 23 03:12:42 juju-e4d256-prod-github-runner-207 kernel: [78536.595542] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 03:12:42 juju-e4d256-prod-github-runner-207 kernel: [78536.596580] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 03:12:42 juju-e4d256-prod-github-runner-207 kernel: [78536.597596] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 03:12:42 juju-e4d256-prod-github-runner-207 kernel: [78536.598592] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 03:12:42 juju-e4d256-prod-github-runner-207 kernel: [78536.599541] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 03:12:42 juju-e4d256-prod-github-runner-207 kernel: [78536.600518] handle_exit+0x98/0x230 [kvm_amd] Aug 23 03:12:42 juju-e4d256-prod-github-runner-207 kernel: [78536.601422] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 03:12:42 juju-e4d256-prod-github-runner-207 kernel: [78536.602340] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 03:12:42 juju-e4d256-prod-github-runner-207 kernel: [78536.603263] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 03:12:42 juju-e4d256-prod-github-runner-207 kernel: [78536.604163] vcpu_run+0x62/0x2c0 [kvm] Aug 23 03:12:42 juju-e4d256-prod-github-runner-207 kernel: [78536.605013] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 03:12:42 juju-e4d256-prod-github-runner-207 kernel: [78536.605825] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 03:12:42 juju-e4d256-prod-github-runner-207 kernel: [78536.606686] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 03:12:42 juju-e4d256-prod-github-runner-207 kernel: [78536.607481] ? __seccomp_filter+0x4a/0x4a0 Aug 23 03:12:42 juju-e4d256-prod-github-runner-207 kernel: [78536.608230] ? __fget_files+0x86/0xc0 Aug 23 03:12:42 juju-e4d256-prod-github-runner-207 kernel: [78536.608957] __x64_sys_ioctl+0x95/0xd0 Aug 23 03:12:42 juju-e4d256-prod-github-runner-207 kernel: [78536.609649] do_syscall_64+0x5c/0xc0 Aug 23 03:12:42 juju-e4d256-prod-github-runner-207 kernel: [78536.610311] ? do_futex+0x162/0x1f0 Aug 23 03:12:42 juju-e4d256-prod-github-runner-207 kernel: [78536.610961] ? __x64_sys_futex+0x78/0x1e0 Aug 23 03:12:42 juju-e4d256-prod-github-runner-207 kernel: [78536.611633] ? __secure_computing+0xa9/0x120 Aug 23 03:12:42 juju-e4d256-prod-github-runner-207 kernel: [78536.612321] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 03:12:42 juju-e4d256-prod-github-runner-207 kernel: [78536.613099] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 03:12:42 juju-e4d256-prod-github-runner-207 kernel: [78536.613819] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 03:12:42 juju-e4d256-prod-github-runner-207 kernel: [78536.614533] ? do_syscall_64+0x69/0xc0 Aug 23 03:12:42 juju-e4d256-prod-github-runner-207 kernel: [78536.615208] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 03:12:42 juju-e4d256-prod-github-runner-207 kernel: [78536.615937] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 03:12:42 juju-e4d256-prod-github-runner-207 kernel: [78536.616643] ? do_syscall_64+0x69/0xc0 Aug 23 03:12:42 juju-e4d256-prod-github-runner-207 kernel: [78536.617290] ? do_syscall_64+0x69/0xc0 Aug 23 03:12:42 juju-e4d256-prod-github-runner-207 kernel: [78536.617912] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 03:12:42 juju-e4d256-prod-github-runner-207 kernel: [78536.618616] RIP: 0033:0x7faa5d0edaff Aug 23 03:12:42 juju-e4d256-prod-github-runner-207 kernel: [78536.619262] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 03:12:42 juju-e4d256-prod-github-runner-207 kernel: [78536.621377] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 03:12:42 juju-e4d256-prod-github-runner-207 kernel: [78536.622391] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 03:12:42 juju-e4d256-prod-github-runner-207 kernel: [78536.623355] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 03:12:42 juju-e4d256-prod-github-runner-207 kernel: [78536.624334] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 03:12:42 juju-e4d256-prod-github-runner-207 kernel: [78536.625322] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 03:12:42 juju-e4d256-prod-github-runner-207 kernel: [78536.626298] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 03:12:42 juju-e4d256-prod-github-runner-207 kernel: [78536.627224] Aug 23 03:13:10 juju-e4d256-prod-github-runner-207 kernel: [78564.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 73060s! [qemu-system-x86:6715] Aug 23 03:13:10 juju-e4d256-prod-github-runner-207 kernel: [78564.543120] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 03:13:10 juju-e4d256-prod-github-runner-207 kernel: [78564.543196] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 03:13:10 juju-e4d256-prod-github-runner-207 kernel: [78564.555600] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 03:13:10 juju-e4d256-prod-github-runner-207 kernel: [78564.556884] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 03:13:10 juju-e4d256-prod-github-runner-207 kernel: [78564.558120] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 03:13:10 juju-e4d256-prod-github-runner-207 kernel: [78564.559179] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 03:13:10 juju-e4d256-prod-github-runner-207 kernel: [78564.561732] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 03:13:10 juju-e4d256-prod-github-runner-207 kernel: [78564.562774] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 03:13:10 juju-e4d256-prod-github-runner-207 kernel: [78564.563944] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 03:13:10 juju-e4d256-prod-github-runner-207 kernel: [78564.565143] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 03:13:10 juju-e4d256-prod-github-runner-207 kernel: [78564.566308] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 03:13:10 juju-e4d256-prod-github-runner-207 kernel: [78564.567502] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 03:13:10 juju-e4d256-prod-github-runner-207 kernel: [78564.568682] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 03:13:10 juju-e4d256-prod-github-runner-207 kernel: [78564.569925] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 03:13:10 juju-e4d256-prod-github-runner-207 kernel: [78564.571032] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 03:13:10 juju-e4d256-prod-github-runner-207 kernel: [78564.572230] Call Trace: Aug 23 03:13:10 juju-e4d256-prod-github-runner-207 kernel: [78564.573163] Aug 23 03:13:10 juju-e4d256-prod-github-runner-207 kernel: [78564.574047] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 03:13:10 juju-e4d256-prod-github-runner-207 kernel: [78564.575083] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 03:13:10 juju-e4d256-prod-github-runner-207 kernel: [78564.576103] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 03:13:10 juju-e4d256-prod-github-runner-207 kernel: [78564.577198] ? show_regs.part.0+0x23/0x29 Aug 23 03:13:10 juju-e4d256-prod-github-runner-207 kernel: [78564.578259] ? show_regs.cold+0x8/0xd Aug 23 03:13:10 juju-e4d256-prod-github-runner-207 kernel: [78564.579230] ? watchdog_timer_fn+0x1be/0x220 Aug 23 03:13:10 juju-e4d256-prod-github-runner-207 kernel: [78564.580264] ? lockup_detector_update_enable+0x60/0x60 Aug 23 03:13:10 juju-e4d256-prod-github-runner-207 kernel: [78564.581377] ? __hrtimer_run_queues+0x107/0x230 Aug 23 03:13:10 juju-e4d256-prod-github-runner-207 kernel: [78564.582413] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 03:13:10 juju-e4d256-prod-github-runner-207 kernel: [78564.583437] ? hrtimer_interrupt+0x101/0x220 Aug 23 03:13:10 juju-e4d256-prod-github-runner-207 kernel: [78564.584602] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 03:13:10 juju-e4d256-prod-github-runner-207 kernel: [78564.585787] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 03:13:10 juju-e4d256-prod-github-runner-207 kernel: [78564.586952] Aug 23 03:13:10 juju-e4d256-prod-github-runner-207 kernel: [78564.587859] Aug 23 03:13:10 juju-e4d256-prod-github-runner-207 kernel: [78564.588775] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 03:13:10 juju-e4d256-prod-github-runner-207 kernel: [78564.589918] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 03:13:10 juju-e4d256-prod-github-runner-207 kernel: [78564.591064] ? _raw_spin_lock+0x22/0x30 Aug 23 03:13:10 juju-e4d256-prod-github-runner-207 kernel: [78564.592106] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 03:13:10 juju-e4d256-prod-github-runner-207 kernel: [78564.593274] direct_page_fault+0x206/0x310 [kvm] Aug 23 03:13:10 juju-e4d256-prod-github-runner-207 kernel: [78564.594395] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 03:13:10 juju-e4d256-prod-github-runner-207 kernel: [78564.595495] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 03:13:10 juju-e4d256-prod-github-runner-207 kernel: [78564.596650] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 03:13:10 juju-e4d256-prod-github-runner-207 kernel: [78564.597747] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 03:13:10 juju-e4d256-prod-github-runner-207 kernel: [78564.598803] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 03:13:10 juju-e4d256-prod-github-runner-207 kernel: [78564.599891] handle_exit+0x98/0x230 [kvm_amd] Aug 23 03:13:10 juju-e4d256-prod-github-runner-207 kernel: [78564.600895] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 03:13:10 juju-e4d256-prod-github-runner-207 kernel: [78564.601904] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 03:13:10 juju-e4d256-prod-github-runner-207 kernel: [78564.602923] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 03:13:10 juju-e4d256-prod-github-runner-207 kernel: [78564.603947] vcpu_run+0x62/0x2c0 [kvm] Aug 23 03:13:10 juju-e4d256-prod-github-runner-207 kernel: [78564.604924] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 03:13:10 juju-e4d256-prod-github-runner-207 kernel: [78564.605823] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 03:13:10 juju-e4d256-prod-github-runner-207 kernel: [78564.606775] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 03:13:10 juju-e4d256-prod-github-runner-207 kernel: [78564.607679] ? __seccomp_filter+0x4a/0x4a0 Aug 23 03:13:10 juju-e4d256-prod-github-runner-207 kernel: [78564.608527] ? __fget_files+0x86/0xc0 Aug 23 03:13:10 juju-e4d256-prod-github-runner-207 kernel: [78564.609308] __x64_sys_ioctl+0x95/0xd0 Aug 23 03:13:10 juju-e4d256-prod-github-runner-207 kernel: [78564.610078] do_syscall_64+0x5c/0xc0 Aug 23 03:13:10 juju-e4d256-prod-github-runner-207 kernel: [78564.610821] ? do_futex+0x162/0x1f0 Aug 23 03:13:10 juju-e4d256-prod-github-runner-207 kernel: [78564.611555] ? __x64_sys_futex+0x78/0x1e0 Aug 23 03:13:10 juju-e4d256-prod-github-runner-207 kernel: [78564.612484] ? __secure_computing+0xa9/0x120 Aug 23 03:13:10 juju-e4d256-prod-github-runner-207 kernel: [78564.613268] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 03:13:10 juju-e4d256-prod-github-runner-207 kernel: [78564.614139] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 03:13:10 juju-e4d256-prod-github-runner-207 kernel: [78564.614954] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 03:13:10 juju-e4d256-prod-github-runner-207 kernel: [78564.615765] ? do_syscall_64+0x69/0xc0 Aug 23 03:13:10 juju-e4d256-prod-github-runner-207 kernel: [78564.616502] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 03:13:10 juju-e4d256-prod-github-runner-207 kernel: [78564.617310] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 03:13:10 juju-e4d256-prod-github-runner-207 kernel: [78564.618103] ? do_syscall_64+0x69/0xc0 Aug 23 03:13:10 juju-e4d256-prod-github-runner-207 kernel: [78564.618808] ? do_syscall_64+0x69/0xc0 Aug 23 03:13:10 juju-e4d256-prod-github-runner-207 kernel: [78564.619509] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 03:13:10 juju-e4d256-prod-github-runner-207 kernel: [78564.620319] RIP: 0033:0x7faa5d0edaff Aug 23 03:13:10 juju-e4d256-prod-github-runner-207 kernel: [78564.621039] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 03:13:10 juju-e4d256-prod-github-runner-207 kernel: [78564.623373] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 03:13:10 juju-e4d256-prod-github-runner-207 kernel: [78564.624451] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 03:13:10 juju-e4d256-prod-github-runner-207 kernel: [78564.625478] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 03:13:10 juju-e4d256-prod-github-runner-207 kernel: [78564.626502] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 03:13:10 juju-e4d256-prod-github-runner-207 kernel: [78564.627561] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 03:13:10 juju-e4d256-prod-github-runner-207 kernel: [78564.628620] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 03:13:10 juju-e4d256-prod-github-runner-207 kernel: [78564.629649] Aug 23 03:13:38 juju-e4d256-prod-github-runner-207 kernel: [78592.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 73087s! [qemu-system-x86:6715] Aug 23 03:13:38 juju-e4d256-prod-github-runner-207 kernel: [78592.543919] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 03:13:38 juju-e4d256-prod-github-runner-207 kernel: [78592.544252] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 03:13:38 juju-e4d256-prod-github-runner-207 kernel: [78592.556658] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 03:13:38 juju-e4d256-prod-github-runner-207 kernel: [78592.557976] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 03:13:38 juju-e4d256-prod-github-runner-207 kernel: [78592.559230] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 03:13:38 juju-e4d256-prod-github-runner-207 kernel: [78592.560313] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 03:13:38 juju-e4d256-prod-github-runner-207 kernel: [78592.562924] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 03:13:38 juju-e4d256-prod-github-runner-207 kernel: [78592.563991] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 03:13:38 juju-e4d256-prod-github-runner-207 kernel: [78592.565187] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 03:13:38 juju-e4d256-prod-github-runner-207 kernel: [78592.566416] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 03:13:38 juju-e4d256-prod-github-runner-207 kernel: [78592.567604] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 03:13:38 juju-e4d256-prod-github-runner-207 kernel: [78592.568797] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 03:13:38 juju-e4d256-prod-github-runner-207 kernel: [78592.570024] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 03:13:38 juju-e4d256-prod-github-runner-207 kernel: [78592.571291] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 03:13:38 juju-e4d256-prod-github-runner-207 kernel: [78592.572416] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 03:13:38 juju-e4d256-prod-github-runner-207 kernel: [78592.573633] Call Trace: Aug 23 03:13:38 juju-e4d256-prod-github-runner-207 kernel: [78592.574560] Aug 23 03:13:38 juju-e4d256-prod-github-runner-207 kernel: [78592.575466] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 03:13:38 juju-e4d256-prod-github-runner-207 kernel: [78592.576522] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 03:13:38 juju-e4d256-prod-github-runner-207 kernel: [78592.577557] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 03:13:38 juju-e4d256-prod-github-runner-207 kernel: [78592.578683] ? show_regs.part.0+0x23/0x29 Aug 23 03:13:38 juju-e4d256-prod-github-runner-207 kernel: [78592.579693] ? show_regs.cold+0x8/0xd Aug 23 03:13:38 juju-e4d256-prod-github-runner-207 kernel: [78592.580703] ? watchdog_timer_fn+0x1be/0x220 Aug 23 03:13:38 juju-e4d256-prod-github-runner-207 kernel: [78592.581727] ? lockup_detector_update_enable+0x60/0x60 Aug 23 03:13:38 juju-e4d256-prod-github-runner-207 kernel: [78592.582807] ? __hrtimer_run_queues+0x107/0x230 Aug 23 03:13:38 juju-e4d256-prod-github-runner-207 kernel: [78592.583851] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 03:13:38 juju-e4d256-prod-github-runner-207 kernel: [78592.584899] ? hrtimer_interrupt+0x101/0x220 Aug 23 03:13:38 juju-e4d256-prod-github-runner-207 kernel: [78592.585930] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 03:13:38 juju-e4d256-prod-github-runner-207 kernel: [78592.587028] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 03:13:38 juju-e4d256-prod-github-runner-207 kernel: [78592.588099] Aug 23 03:13:38 juju-e4d256-prod-github-runner-207 kernel: [78592.588958] Aug 23 03:13:38 juju-e4d256-prod-github-runner-207 kernel: [78592.589809] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 03:13:38 juju-e4d256-prod-github-runner-207 kernel: [78592.590873] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 03:13:38 juju-e4d256-prod-github-runner-207 kernel: [78592.591929] ? _raw_spin_lock+0x22/0x30 Aug 23 03:13:38 juju-e4d256-prod-github-runner-207 kernel: [78592.592914] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 03:13:38 juju-e4d256-prod-github-runner-207 kernel: [78592.593942] direct_page_fault+0x206/0x310 [kvm] Aug 23 03:13:38 juju-e4d256-prod-github-runner-207 kernel: [78592.594999] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 03:13:38 juju-e4d256-prod-github-runner-207 kernel: [78592.596062] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 03:13:38 juju-e4d256-prod-github-runner-207 kernel: [78592.597086] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 03:13:38 juju-e4d256-prod-github-runner-207 kernel: [78592.598095] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 03:13:38 juju-e4d256-prod-github-runner-207 kernel: [78592.599081] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 03:13:38 juju-e4d256-prod-github-runner-207 kernel: [78592.600111] handle_exit+0x98/0x230 [kvm_amd] Aug 23 03:13:38 juju-e4d256-prod-github-runner-207 kernel: [78592.601030] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 03:13:38 juju-e4d256-prod-github-runner-207 kernel: [78592.602041] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 03:13:38 juju-e4d256-prod-github-runner-207 kernel: [78592.602982] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 03:13:38 juju-e4d256-prod-github-runner-207 kernel: [78592.603900] vcpu_run+0x62/0x2c0 [kvm] Aug 23 03:13:38 juju-e4d256-prod-github-runner-207 kernel: [78592.604740] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 03:13:38 juju-e4d256-prod-github-runner-207 kernel: [78592.605604] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 03:13:38 juju-e4d256-prod-github-runner-207 kernel: [78592.606480] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 03:13:38 juju-e4d256-prod-github-runner-207 kernel: [78592.607291] ? __seccomp_filter+0x4a/0x4a0 Aug 23 03:13:38 juju-e4d256-prod-github-runner-207 kernel: [78592.608046] ? __fget_files+0x86/0xc0 Aug 23 03:13:38 juju-e4d256-prod-github-runner-207 kernel: [78592.608773] __x64_sys_ioctl+0x95/0xd0 Aug 23 03:13:38 juju-e4d256-prod-github-runner-207 kernel: [78592.609500] do_syscall_64+0x5c/0xc0 Aug 23 03:13:38 juju-e4d256-prod-github-runner-207 kernel: [78592.610193] ? do_futex+0x162/0x1f0 Aug 23 03:13:38 juju-e4d256-prod-github-runner-207 kernel: [78592.610852] ? __x64_sys_futex+0x78/0x1e0 Aug 23 03:13:38 juju-e4d256-prod-github-runner-207 kernel: [78592.611536] ? __secure_computing+0xa9/0x120 Aug 23 03:13:38 juju-e4d256-prod-github-runner-207 kernel: [78592.612254] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 03:13:38 juju-e4d256-prod-github-runner-207 kernel: [78592.613034] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 03:13:38 juju-e4d256-prod-github-runner-207 kernel: [78592.613785] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 03:13:38 juju-e4d256-prod-github-runner-207 kernel: [78592.614524] ? do_syscall_64+0x69/0xc0 Aug 23 03:13:38 juju-e4d256-prod-github-runner-207 kernel: [78592.615259] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 03:13:38 juju-e4d256-prod-github-runner-207 kernel: [78592.615978] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 03:13:38 juju-e4d256-prod-github-runner-207 kernel: [78592.616701] ? do_syscall_64+0x69/0xc0 Aug 23 03:13:38 juju-e4d256-prod-github-runner-207 kernel: [78592.617379] ? do_syscall_64+0x69/0xc0 Aug 23 03:13:38 juju-e4d256-prod-github-runner-207 kernel: [78592.618013] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 03:13:38 juju-e4d256-prod-github-runner-207 kernel: [78592.618742] RIP: 0033:0x7faa5d0edaff Aug 23 03:13:38 juju-e4d256-prod-github-runner-207 kernel: [78592.619400] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 03:13:38 juju-e4d256-prod-github-runner-207 kernel: [78592.621478] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 03:13:38 juju-e4d256-prod-github-runner-207 kernel: [78592.622420] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 03:13:38 juju-e4d256-prod-github-runner-207 kernel: [78592.623327] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 03:13:38 juju-e4d256-prod-github-runner-207 kernel: [78592.624278] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 03:13:38 juju-e4d256-prod-github-runner-207 kernel: [78592.625221] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 03:13:38 juju-e4d256-prod-github-runner-207 kernel: [78592.626139] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 03:13:38 juju-e4d256-prod-github-runner-207 kernel: [78592.627056] Aug 23 03:14:06 juju-e4d256-prod-github-runner-207 kernel: [78620.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 73113s! [qemu-system-x86:6715] Aug 23 03:14:06 juju-e4d256-prod-github-runner-207 kernel: [78620.543155] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 03:14:06 juju-e4d256-prod-github-runner-207 kernel: [78620.543230] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 03:14:06 juju-e4d256-prod-github-runner-207 kernel: [78620.555640] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 03:14:06 juju-e4d256-prod-github-runner-207 kernel: [78620.556959] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 03:14:06 juju-e4d256-prod-github-runner-207 kernel: [78620.558202] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 03:14:06 juju-e4d256-prod-github-runner-207 kernel: [78620.559277] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 03:14:06 juju-e4d256-prod-github-runner-207 kernel: [78620.561902] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 03:14:06 juju-e4d256-prod-github-runner-207 kernel: [78620.562964] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 03:14:06 juju-e4d256-prod-github-runner-207 kernel: [78620.564176] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 03:14:06 juju-e4d256-prod-github-runner-207 kernel: [78620.565371] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 03:14:06 juju-e4d256-prod-github-runner-207 kernel: [78620.566562] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 03:14:06 juju-e4d256-prod-github-runner-207 kernel: [78620.567777] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 03:14:06 juju-e4d256-prod-github-runner-207 kernel: [78620.568968] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 03:14:06 juju-e4d256-prod-github-runner-207 kernel: [78620.570224] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 03:14:06 juju-e4d256-prod-github-runner-207 kernel: [78620.571359] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 03:14:06 juju-e4d256-prod-github-runner-207 kernel: [78620.572598] Call Trace: Aug 23 03:14:06 juju-e4d256-prod-github-runner-207 kernel: [78620.573520] Aug 23 03:14:06 juju-e4d256-prod-github-runner-207 kernel: [78620.574449] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 03:14:06 juju-e4d256-prod-github-runner-207 kernel: [78620.575505] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 03:14:06 juju-e4d256-prod-github-runner-207 kernel: [78620.576569] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 03:14:06 juju-e4d256-prod-github-runner-207 kernel: [78620.577669] ? show_regs.part.0+0x23/0x29 Aug 23 03:14:06 juju-e4d256-prod-github-runner-207 kernel: [78620.578675] ? show_regs.cold+0x8/0xd Aug 23 03:14:06 juju-e4d256-prod-github-runner-207 kernel: [78620.579661] ? watchdog_timer_fn+0x1be/0x220 Aug 23 03:14:06 juju-e4d256-prod-github-runner-207 kernel: [78620.580705] ? lockup_detector_update_enable+0x60/0x60 Aug 23 03:14:06 juju-e4d256-prod-github-runner-207 kernel: [78620.581787] ? __hrtimer_run_queues+0x107/0x230 Aug 23 03:14:06 juju-e4d256-prod-github-runner-207 kernel: [78620.582831] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 03:14:06 juju-e4d256-prod-github-runner-207 kernel: [78620.583877] ? hrtimer_interrupt+0x101/0x220 Aug 23 03:14:06 juju-e4d256-prod-github-runner-207 kernel: [78620.584906] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 03:14:06 juju-e4d256-prod-github-runner-207 kernel: [78620.585986] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 03:14:06 juju-e4d256-prod-github-runner-207 kernel: [78620.587046] Aug 23 03:14:06 juju-e4d256-prod-github-runner-207 kernel: [78620.587912] Aug 23 03:14:06 juju-e4d256-prod-github-runner-207 kernel: [78620.588788] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 03:14:06 juju-e4d256-prod-github-runner-207 kernel: [78620.589839] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 03:14:06 juju-e4d256-prod-github-runner-207 kernel: [78620.590935] ? _raw_spin_lock+0x22/0x30 Aug 23 03:14:06 juju-e4d256-prod-github-runner-207 kernel: [78620.591906] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 03:14:06 juju-e4d256-prod-github-runner-207 kernel: [78620.592936] direct_page_fault+0x206/0x310 [kvm] Aug 23 03:14:06 juju-e4d256-prod-github-runner-207 kernel: [78620.593977] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 03:14:06 juju-e4d256-prod-github-runner-207 kernel: [78620.594995] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 03:14:06 juju-e4d256-prod-github-runner-207 kernel: [78620.596028] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 03:14:06 juju-e4d256-prod-github-runner-207 kernel: [78620.597017] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 03:14:06 juju-e4d256-prod-github-runner-207 kernel: [78620.597979] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 03:14:06 juju-e4d256-prod-github-runner-207 kernel: [78620.598969] handle_exit+0x98/0x230 [kvm_amd] Aug 23 03:14:06 juju-e4d256-prod-github-runner-207 kernel: [78620.599880] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 03:14:06 juju-e4d256-prod-github-runner-207 kernel: [78620.600805] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 03:14:06 juju-e4d256-prod-github-runner-207 kernel: [78620.601731] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 03:14:06 juju-e4d256-prod-github-runner-207 kernel: [78620.602634] vcpu_run+0x62/0x2c0 [kvm] Aug 23 03:14:06 juju-e4d256-prod-github-runner-207 kernel: [78620.603447] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 03:14:06 juju-e4d256-prod-github-runner-207 kernel: [78620.604263] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 03:14:06 juju-e4d256-prod-github-runner-207 kernel: [78620.605116] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 03:14:06 juju-e4d256-prod-github-runner-207 kernel: [78620.605913] ? __seccomp_filter+0x4a/0x4a0 Aug 23 03:14:06 juju-e4d256-prod-github-runner-207 kernel: [78620.606656] ? __fget_files+0x86/0xc0 Aug 23 03:14:06 juju-e4d256-prod-github-runner-207 kernel: [78620.607359] __x64_sys_ioctl+0x95/0xd0 Aug 23 03:14:06 juju-e4d256-prod-github-runner-207 kernel: [78620.608063] do_syscall_64+0x5c/0xc0 Aug 23 03:14:06 juju-e4d256-prod-github-runner-207 kernel: [78620.608727] ? do_futex+0x162/0x1f0 Aug 23 03:14:06 juju-e4d256-prod-github-runner-207 kernel: [78620.609374] ? __x64_sys_futex+0x78/0x1e0 Aug 23 03:14:06 juju-e4d256-prod-github-runner-207 kernel: [78620.610047] ? __secure_computing+0xa9/0x120 Aug 23 03:14:06 juju-e4d256-prod-github-runner-207 kernel: [78620.610739] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 03:14:06 juju-e4d256-prod-github-runner-207 kernel: [78620.611496] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 03:14:06 juju-e4d256-prod-github-runner-207 kernel: [78620.612221] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 03:14:06 juju-e4d256-prod-github-runner-207 kernel: [78620.612975] ? do_syscall_64+0x69/0xc0 Aug 23 03:14:06 juju-e4d256-prod-github-runner-207 kernel: [78620.613648] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 03:14:06 juju-e4d256-prod-github-runner-207 kernel: [78620.614350] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 03:14:06 juju-e4d256-prod-github-runner-207 kernel: [78620.615044] ? do_syscall_64+0x69/0xc0 Aug 23 03:14:06 juju-e4d256-prod-github-runner-207 kernel: [78620.615669] ? do_syscall_64+0x69/0xc0 Aug 23 03:14:06 juju-e4d256-prod-github-runner-207 kernel: [78620.616303] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 03:14:06 juju-e4d256-prod-github-runner-207 kernel: [78620.617024] RIP: 0033:0x7faa5d0edaff Aug 23 03:14:06 juju-e4d256-prod-github-runner-207 kernel: [78620.617654] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 03:14:06 juju-e4d256-prod-github-runner-207 kernel: [78620.619640] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 03:14:06 juju-e4d256-prod-github-runner-207 kernel: [78620.620565] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 03:14:06 juju-e4d256-prod-github-runner-207 kernel: [78620.621455] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 03:14:06 juju-e4d256-prod-github-runner-207 kernel: [78620.622344] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 03:14:06 juju-e4d256-prod-github-runner-207 kernel: [78620.623289] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 03:14:06 juju-e4d256-prod-github-runner-207 kernel: [78620.624196] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 03:14:06 juju-e4d256-prod-github-runner-207 kernel: [78620.625089] Aug 23 03:14:34 juju-e4d256-prod-github-runner-207 kernel: [78648.542104] watchdog: BUG: soft lockup - CPU#1 stuck for 73139s! [qemu-system-x86:6715] Aug 23 03:14:34 juju-e4d256-prod-github-runner-207 kernel: [78648.543231] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 03:14:34 juju-e4d256-prod-github-runner-207 kernel: [78648.543307] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 03:14:34 juju-e4d256-prod-github-runner-207 kernel: [78648.555336] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 03:14:34 juju-e4d256-prod-github-runner-207 kernel: [78648.556610] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 03:14:34 juju-e4d256-prod-github-runner-207 kernel: [78648.557826] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 03:14:34 juju-e4d256-prod-github-runner-207 kernel: [78648.558880] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 03:14:34 juju-e4d256-prod-github-runner-207 kernel: [78648.561438] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 03:14:34 juju-e4d256-prod-github-runner-207 kernel: [78648.562484] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 03:14:34 juju-e4d256-prod-github-runner-207 kernel: [78648.563661] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 03:14:34 juju-e4d256-prod-github-runner-207 kernel: [78648.564824] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 03:14:34 juju-e4d256-prod-github-runner-207 kernel: [78648.565987] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 03:14:34 juju-e4d256-prod-github-runner-207 kernel: [78648.567147] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 03:14:34 juju-e4d256-prod-github-runner-207 kernel: [78648.568335] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 03:14:34 juju-e4d256-prod-github-runner-207 kernel: [78648.569566] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 03:14:34 juju-e4d256-prod-github-runner-207 kernel: [78648.570662] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 03:14:34 juju-e4d256-prod-github-runner-207 kernel: [78648.571869] Call Trace: Aug 23 03:14:34 juju-e4d256-prod-github-runner-207 kernel: [78648.572782] Aug 23 03:14:34 juju-e4d256-prod-github-runner-207 kernel: [78648.573665] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 03:14:34 juju-e4d256-prod-github-runner-207 kernel: [78648.574692] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 03:14:34 juju-e4d256-prod-github-runner-207 kernel: [78648.575720] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 03:14:34 juju-e4d256-prod-github-runner-207 kernel: [78648.576799] ? show_regs.part.0+0x23/0x29 Aug 23 03:14:34 juju-e4d256-prod-github-runner-207 kernel: [78648.577799] ? show_regs.cold+0x8/0xd Aug 23 03:14:34 juju-e4d256-prod-github-runner-207 kernel: [78648.578768] ? watchdog_timer_fn+0x1be/0x220 Aug 23 03:14:34 juju-e4d256-prod-github-runner-207 kernel: [78648.579781] ? lockup_detector_update_enable+0x60/0x60 Aug 23 03:14:34 juju-e4d256-prod-github-runner-207 kernel: [78648.580847] ? __hrtimer_run_queues+0x107/0x230 Aug 23 03:14:34 juju-e4d256-prod-github-runner-207 kernel: [78648.581873] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 03:14:34 juju-e4d256-prod-github-runner-207 kernel: [78648.582898] ? hrtimer_interrupt+0x101/0x220 Aug 23 03:14:34 juju-e4d256-prod-github-runner-207 kernel: [78648.583926] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 03:14:34 juju-e4d256-prod-github-runner-207 kernel: [78648.584997] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 03:14:34 juju-e4d256-prod-github-runner-207 kernel: [78648.586040] Aug 23 03:14:34 juju-e4d256-prod-github-runner-207 kernel: [78648.586892] Aug 23 03:14:34 juju-e4d256-prod-github-runner-207 kernel: [78648.587740] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 03:14:34 juju-e4d256-prod-github-runner-207 kernel: [78648.588776] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 03:14:34 juju-e4d256-prod-github-runner-207 kernel: [78648.589811] ? _raw_spin_lock+0x22/0x30 Aug 23 03:14:34 juju-e4d256-prod-github-runner-207 kernel: [78648.590754] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 03:14:34 juju-e4d256-prod-github-runner-207 kernel: [78648.591775] direct_page_fault+0x206/0x310 [kvm] Aug 23 03:14:34 juju-e4d256-prod-github-runner-207 kernel: [78648.592797] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 03:14:34 juju-e4d256-prod-github-runner-207 kernel: [78648.593807] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 03:14:34 juju-e4d256-prod-github-runner-207 kernel: [78648.594805] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 03:14:34 juju-e4d256-prod-github-runner-207 kernel: [78648.595788] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 03:14:34 juju-e4d256-prod-github-runner-207 kernel: [78648.596733] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 03:14:34 juju-e4d256-prod-github-runner-207 kernel: [78648.597708] handle_exit+0x98/0x230 [kvm_amd] Aug 23 03:14:34 juju-e4d256-prod-github-runner-207 kernel: [78648.598597] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 03:14:34 juju-e4d256-prod-github-runner-207 kernel: [78648.599519] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 03:14:34 juju-e4d256-prod-github-runner-207 kernel: [78648.600445] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 03:14:34 juju-e4d256-prod-github-runner-207 kernel: [78648.601346] vcpu_run+0x62/0x2c0 [kvm] Aug 23 03:14:34 juju-e4d256-prod-github-runner-207 kernel: [78648.602155] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 03:14:34 juju-e4d256-prod-github-runner-207 kernel: [78648.602959] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 03:14:34 juju-e4d256-prod-github-runner-207 kernel: [78648.603820] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 03:14:34 juju-e4d256-prod-github-runner-207 kernel: [78648.604614] ? __seccomp_filter+0x4a/0x4a0 Aug 23 03:14:34 juju-e4d256-prod-github-runner-207 kernel: [78648.605360] ? __fget_files+0x86/0xc0 Aug 23 03:14:34 juju-e4d256-prod-github-runner-207 kernel: [78648.606060] __x64_sys_ioctl+0x95/0xd0 Aug 23 03:14:34 juju-e4d256-prod-github-runner-207 kernel: [78648.606749] do_syscall_64+0x5c/0xc0 Aug 23 03:14:34 juju-e4d256-prod-github-runner-207 kernel: [78648.607410] ? do_futex+0x162/0x1f0 Aug 23 03:14:34 juju-e4d256-prod-github-runner-207 kernel: [78648.608063] ? __x64_sys_futex+0x78/0x1e0 Aug 23 03:14:34 juju-e4d256-prod-github-runner-207 kernel: [78648.608733] ? __secure_computing+0xa9/0x120 Aug 23 03:14:34 juju-e4d256-prod-github-runner-207 kernel: [78648.609424] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 03:14:34 juju-e4d256-prod-github-runner-207 kernel: [78648.610184] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 03:14:34 juju-e4d256-prod-github-runner-207 kernel: [78648.610901] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 03:14:34 juju-e4d256-prod-github-runner-207 kernel: [78648.611621] ? do_syscall_64+0x69/0xc0 Aug 23 03:14:34 juju-e4d256-prod-github-runner-207 kernel: [78648.612266] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 03:14:34 juju-e4d256-prod-github-runner-207 kernel: [78648.612970] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 03:14:34 juju-e4d256-prod-github-runner-207 kernel: [78648.613660] ? do_syscall_64+0x69/0xc0 Aug 23 03:14:34 juju-e4d256-prod-github-runner-207 kernel: [78648.614286] ? do_syscall_64+0x69/0xc0 Aug 23 03:14:34 juju-e4d256-prod-github-runner-207 kernel: [78648.614950] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 03:14:34 juju-e4d256-prod-github-runner-207 kernel: [78648.615738] RIP: 0033:0x7faa5d0edaff Aug 23 03:14:34 juju-e4d256-prod-github-runner-207 kernel: [78648.616393] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 03:14:34 juju-e4d256-prod-github-runner-207 kernel: [78648.618400] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 03:14:34 juju-e4d256-prod-github-runner-207 kernel: [78648.619308] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 03:14:34 juju-e4d256-prod-github-runner-207 kernel: [78648.620237] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 03:14:34 juju-e4d256-prod-github-runner-207 kernel: [78648.621137] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 03:14:34 juju-e4d256-prod-github-runner-207 kernel: [78648.622029] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 03:14:34 juju-e4d256-prod-github-runner-207 kernel: [78648.622920] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 03:14:34 juju-e4d256-prod-github-runner-207 kernel: [78648.623824] Aug 23 03:14:48 juju-e4d256-prod-github-runner-207 kernel: [78662.432706] rcu: INFO: rcu_sched self-detected stall on CPU Aug 23 03:14:48 juju-e4d256-prod-github-runner-207 kernel: [78662.433724] rcu: 1-....: (19574689 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=9464664 Aug 23 03:14:48 juju-e4d256-prod-github-runner-207 kernel: [78662.434889] (t=19636308 jiffies g=23269 q=65914) Aug 23 03:14:48 juju-e4d256-prod-github-runner-207 kernel: [78662.435708] NMI backtrace for cpu 1 Aug 23 03:14:48 juju-e4d256-prod-github-runner-207 kernel: [78662.436434] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 03:14:48 juju-e4d256-prod-github-runner-207 kernel: [78662.437565] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 03:14:48 juju-e4d256-prod-github-runner-207 kernel: [78662.438669] Call Trace: Aug 23 03:14:48 juju-e4d256-prod-github-runner-207 kernel: [78662.439397] Aug 23 03:14:48 juju-e4d256-prod-github-runner-207 kernel: [78662.440082] show_stack+0x52/0x5c Aug 23 03:14:48 juju-e4d256-prod-github-runner-207 kernel: [78662.440824] dump_stack_lvl+0x4a/0x63 Aug 23 03:14:48 juju-e4d256-prod-github-runner-207 kernel: [78662.441582] dump_stack+0x10/0x16 Aug 23 03:14:48 juju-e4d256-prod-github-runner-207 kernel: [78662.442415] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 23 03:14:48 juju-e4d256-prod-github-runner-207 kernel: [78662.443206] ? lapic_can_unplug_cpu+0x90/0x90 Aug 23 03:14:48 juju-e4d256-prod-github-runner-207 kernel: [78662.444029] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 23 03:14:48 juju-e4d256-prod-github-runner-207 kernel: [78662.444847] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 23 03:14:48 juju-e4d256-prod-github-runner-207 kernel: [78662.445662] trigger_single_cpu_backtrace+0x44/0x4f Aug 23 03:14:48 juju-e4d256-prod-github-runner-207 kernel: [78662.446466] rcu_dump_cpu_stacks+0x102/0x149 Aug 23 03:14:48 juju-e4d256-prod-github-runner-207 kernel: [78662.447234] print_cpu_stall.cold+0x2f/0xe2 Aug 23 03:14:48 juju-e4d256-prod-github-runner-207 kernel: [78662.448006] ? timekeeping_update+0xf7/0x150 Aug 23 03:14:48 juju-e4d256-prod-github-runner-207 kernel: [78662.448841] check_cpu_stall+0x109/0x270 Aug 23 03:14:48 juju-e4d256-prod-github-runner-207 kernel: [78662.449592] rcu_sched_clock_irq+0x9a/0x250 Aug 23 03:14:48 juju-e4d256-prod-github-runner-207 kernel: [78662.450354] update_process_times+0x94/0xd0 Aug 23 03:14:48 juju-e4d256-prod-github-runner-207 kernel: [78662.451156] tick_sched_handle+0x29/0x70 Aug 23 03:14:48 juju-e4d256-prod-github-runner-207 kernel: [78662.451922] tick_sched_timer+0x8c/0xc0 Aug 23 03:14:48 juju-e4d256-prod-github-runner-207 kernel: [78662.452655] ? tick_nohz_handler+0xb0/0xb0 Aug 23 03:14:48 juju-e4d256-prod-github-runner-207 kernel: [78662.453413] __hrtimer_run_queues+0x107/0x230 Aug 23 03:14:48 juju-e4d256-prod-github-runner-207 kernel: [78662.454204] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 03:14:48 juju-e4d256-prod-github-runner-207 kernel: [78662.454977] hrtimer_interrupt+0x101/0x220 Aug 23 03:14:48 juju-e4d256-prod-github-runner-207 kernel: [78662.455752] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 03:14:48 juju-e4d256-prod-github-runner-207 kernel: [78662.456567] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 03:14:48 juju-e4d256-prod-github-runner-207 kernel: [78662.457366] Aug 23 03:14:48 juju-e4d256-prod-github-runner-207 kernel: [78662.458000] Aug 23 03:14:48 juju-e4d256-prod-github-runner-207 kernel: [78662.458647] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 03:14:48 juju-e4d256-prod-github-runner-207 kernel: [78662.459517] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 03:14:48 juju-e4d256-prod-github-runner-207 kernel: [78662.460404] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 03:14:48 juju-e4d256-prod-github-runner-207 kernel: [78662.462653] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 03:14:48 juju-e4d256-prod-github-runner-207 kernel: [78662.463548] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 03:14:48 juju-e4d256-prod-github-runner-207 kernel: [78662.464560] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 03:14:48 juju-e4d256-prod-github-runner-207 kernel: [78662.465542] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 03:14:48 juju-e4d256-prod-github-runner-207 kernel: [78662.466515] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 03:14:48 juju-e4d256-prod-github-runner-207 kernel: [78662.467492] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 03:14:48 juju-e4d256-prod-github-runner-207 kernel: [78662.468453] ? _raw_spin_lock+0x22/0x30 Aug 23 03:14:48 juju-e4d256-prod-github-runner-207 kernel: [78662.469231] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 03:14:48 juju-e4d256-prod-github-runner-207 kernel: [78662.470091] direct_page_fault+0x206/0x310 [kvm] Aug 23 03:14:48 juju-e4d256-prod-github-runner-207 kernel: [78662.470937] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 03:14:48 juju-e4d256-prod-github-runner-207 kernel: [78662.471807] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 03:14:48 juju-e4d256-prod-github-runner-207 kernel: [78662.472653] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 03:14:48 juju-e4d256-prod-github-runner-207 kernel: [78662.473467] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 03:14:48 juju-e4d256-prod-github-runner-207 kernel: [78662.474274] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 03:14:48 juju-e4d256-prod-github-runner-207 kernel: [78662.475128] handle_exit+0x98/0x230 [kvm_amd] Aug 23 03:14:48 juju-e4d256-prod-github-runner-207 kernel: [78662.475895] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 03:14:48 juju-e4d256-prod-github-runner-207 kernel: [78662.476677] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 03:14:48 juju-e4d256-prod-github-runner-207 kernel: [78662.477497] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 03:14:48 juju-e4d256-prod-github-runner-207 kernel: [78662.478285] vcpu_run+0x62/0x2c0 [kvm] Aug 23 03:14:48 juju-e4d256-prod-github-runner-207 kernel: [78662.479007] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 03:14:48 juju-e4d256-prod-github-runner-207 kernel: [78662.479753] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 03:14:48 juju-e4d256-prod-github-runner-207 kernel: [78662.480550] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 03:14:48 juju-e4d256-prod-github-runner-207 kernel: [78662.481326] ? __seccomp_filter+0x4a/0x4a0 Aug 23 03:14:48 juju-e4d256-prod-github-runner-207 kernel: [78662.482056] ? __fget_files+0x86/0xc0 Aug 23 03:14:48 juju-e4d256-prod-github-runner-207 kernel: [78662.482748] __x64_sys_ioctl+0x95/0xd0 Aug 23 03:14:48 juju-e4d256-prod-github-runner-207 kernel: [78662.483459] do_syscall_64+0x5c/0xc0 Aug 23 03:14:48 juju-e4d256-prod-github-runner-207 kernel: [78662.484185] ? do_futex+0x162/0x1f0 Aug 23 03:14:48 juju-e4d256-prod-github-runner-207 kernel: [78662.484874] ? __x64_sys_futex+0x78/0x1e0 Aug 23 03:14:48 juju-e4d256-prod-github-runner-207 kernel: [78662.485579] ? __secure_computing+0xa9/0x120 Aug 23 03:14:48 juju-e4d256-prod-github-runner-207 kernel: [78662.486303] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 03:14:48 juju-e4d256-prod-github-runner-207 kernel: [78662.487095] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 03:14:48 juju-e4d256-prod-github-runner-207 kernel: [78662.487867] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 03:14:48 juju-e4d256-prod-github-runner-207 kernel: [78662.488623] ? do_syscall_64+0x69/0xc0 Aug 23 03:14:48 juju-e4d256-prod-github-runner-207 kernel: [78662.489316] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 03:14:48 juju-e4d256-prod-github-runner-207 kernel: [78662.490079] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 03:14:48 juju-e4d256-prod-github-runner-207 kernel: [78662.490837] ? do_syscall_64+0x69/0xc0 Aug 23 03:14:48 juju-e4d256-prod-github-runner-207 kernel: [78662.491555] ? do_syscall_64+0x69/0xc0 Aug 23 03:14:48 juju-e4d256-prod-github-runner-207 kernel: [78662.492252] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 03:14:48 juju-e4d256-prod-github-runner-207 kernel: [78662.493038] RIP: 0033:0x7faa5d0edaff Aug 23 03:14:48 juju-e4d256-prod-github-runner-207 kernel: [78662.493756] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 03:14:48 juju-e4d256-prod-github-runner-207 kernel: [78662.495906] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 03:14:48 juju-e4d256-prod-github-runner-207 kernel: [78662.496867] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 03:14:48 juju-e4d256-prod-github-runner-207 kernel: [78662.497816] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 03:14:48 juju-e4d256-prod-github-runner-207 kernel: [78662.498758] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 03:14:48 juju-e4d256-prod-github-runner-207 kernel: [78662.499715] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 03:14:48 juju-e4d256-prod-github-runner-207 kernel: [78662.500677] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 03:14:48 juju-e4d256-prod-github-runner-207 kernel: [78662.501612] Aug 23 03:15:14 juju-e4d256-prod-github-runner-207 kernel: [78688.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 73176s! [qemu-system-x86:6715] Aug 23 03:15:14 juju-e4d256-prod-github-runner-207 kernel: [78688.543826] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 03:15:14 juju-e4d256-prod-github-runner-207 kernel: [78688.544113] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 03:15:14 juju-e4d256-prod-github-runner-207 kernel: [78688.556365] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 03:15:14 juju-e4d256-prod-github-runner-207 kernel: [78688.557631] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 03:15:14 juju-e4d256-prod-github-runner-207 kernel: [78688.558886] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 03:15:14 juju-e4d256-prod-github-runner-207 kernel: [78688.560027] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 03:15:14 juju-e4d256-prod-github-runner-207 kernel: [78688.562686] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 03:15:14 juju-e4d256-prod-github-runner-207 kernel: [78688.563832] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 03:15:14 juju-e4d256-prod-github-runner-207 kernel: [78688.565009] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 03:15:14 juju-e4d256-prod-github-runner-207 kernel: [78688.566176] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 03:15:14 juju-e4d256-prod-github-runner-207 kernel: [78688.567349] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 03:15:14 juju-e4d256-prod-github-runner-207 kernel: [78688.568518] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 03:15:14 juju-e4d256-prod-github-runner-207 kernel: [78688.569851] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 03:15:14 juju-e4d256-prod-github-runner-207 kernel: [78688.571140] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 03:15:14 juju-e4d256-prod-github-runner-207 kernel: [78688.572716] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 03:15:14 juju-e4d256-prod-github-runner-207 kernel: [78688.573939] Call Trace: Aug 23 03:15:14 juju-e4d256-prod-github-runner-207 kernel: [78688.574929] Aug 23 03:15:14 juju-e4d256-prod-github-runner-207 kernel: [78688.575970] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 03:15:14 juju-e4d256-prod-github-runner-207 kernel: [78688.577070] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 03:15:14 juju-e4d256-prod-github-runner-207 kernel: [78688.578168] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 03:15:14 juju-e4d256-prod-github-runner-207 kernel: [78688.579425] ? show_regs.part.0+0x23/0x29 Aug 23 03:15:14 juju-e4d256-prod-github-runner-207 kernel: [78688.580502] ? show_regs.cold+0x8/0xd Aug 23 03:15:14 juju-e4d256-prod-github-runner-207 kernel: [78688.581526] ? watchdog_timer_fn+0x1be/0x220 Aug 23 03:15:14 juju-e4d256-prod-github-runner-207 kernel: [78688.582572] ? lockup_detector_update_enable+0x60/0x60 Aug 23 03:15:14 juju-e4d256-prod-github-runner-207 kernel: [78688.583684] ? __hrtimer_run_queues+0x107/0x230 Aug 23 03:15:14 juju-e4d256-prod-github-runner-207 kernel: [78688.584807] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 03:15:14 juju-e4d256-prod-github-runner-207 kernel: [78688.585911] ? hrtimer_interrupt+0x101/0x220 Aug 23 03:15:14 juju-e4d256-prod-github-runner-207 kernel: [78688.586991] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 03:15:14 juju-e4d256-prod-github-runner-207 kernel: [78688.588091] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 03:15:14 juju-e4d256-prod-github-runner-207 kernel: [78688.589166] Aug 23 03:15:14 juju-e4d256-prod-github-runner-207 kernel: [78688.590024] Aug 23 03:15:14 juju-e4d256-prod-github-runner-207 kernel: [78688.590865] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 03:15:14 juju-e4d256-prod-github-runner-207 kernel: [78688.591914] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 03:15:14 juju-e4d256-prod-github-runner-207 kernel: [78688.592958] ? _raw_spin_lock+0x22/0x30 Aug 23 03:15:14 juju-e4d256-prod-github-runner-207 kernel: [78688.593907] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 03:15:14 juju-e4d256-prod-github-runner-207 kernel: [78688.594947] direct_page_fault+0x206/0x310 [kvm] Aug 23 03:15:14 juju-e4d256-prod-github-runner-207 kernel: [78688.595996] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 03:15:14 juju-e4d256-prod-github-runner-207 kernel: [78688.597008] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 03:15:14 juju-e4d256-prod-github-runner-207 kernel: [78688.598015] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 03:15:14 juju-e4d256-prod-github-runner-207 kernel: [78688.599044] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 03:15:14 juju-e4d256-prod-github-runner-207 kernel: [78688.599995] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 03:15:14 juju-e4d256-prod-github-runner-207 kernel: [78688.600982] handle_exit+0x98/0x230 [kvm_amd] Aug 23 03:15:14 juju-e4d256-prod-github-runner-207 kernel: [78688.601881] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 03:15:14 juju-e4d256-prod-github-runner-207 kernel: [78688.602799] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 03:15:14 juju-e4d256-prod-github-runner-207 kernel: [78688.603745] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 03:15:14 juju-e4d256-prod-github-runner-207 kernel: [78688.604650] vcpu_run+0x62/0x2c0 [kvm] Aug 23 03:15:14 juju-e4d256-prod-github-runner-207 kernel: [78688.605464] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 03:15:14 juju-e4d256-prod-github-runner-207 kernel: [78688.606273] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 03:15:14 juju-e4d256-prod-github-runner-207 kernel: [78688.607167] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 03:15:14 juju-e4d256-prod-github-runner-207 kernel: [78688.607971] ? __seccomp_filter+0x4a/0x4a0 Aug 23 03:15:14 juju-e4d256-prod-github-runner-207 kernel: [78688.608714] ? __fget_files+0x86/0xc0 Aug 23 03:15:14 juju-e4d256-prod-github-runner-207 kernel: [78688.609423] __x64_sys_ioctl+0x95/0xd0 Aug 23 03:15:14 juju-e4d256-prod-github-runner-207 kernel: [78688.610115] do_syscall_64+0x5c/0xc0 Aug 23 03:15:14 juju-e4d256-prod-github-runner-207 kernel: [78688.610779] ? do_futex+0x162/0x1f0 Aug 23 03:15:14 juju-e4d256-prod-github-runner-207 kernel: [78688.611442] ? __x64_sys_futex+0x78/0x1e0 Aug 23 03:15:14 juju-e4d256-prod-github-runner-207 kernel: [78688.612114] ? __secure_computing+0xa9/0x120 Aug 23 03:15:14 juju-e4d256-prod-github-runner-207 kernel: [78688.612802] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 03:15:14 juju-e4d256-prod-github-runner-207 kernel: [78688.613561] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 03:15:14 juju-e4d256-prod-github-runner-207 kernel: [78688.614285] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 03:15:14 juju-e4d256-prod-github-runner-207 kernel: [78688.615015] ? do_syscall_64+0x69/0xc0 Aug 23 03:15:14 juju-e4d256-prod-github-runner-207 kernel: [78688.615689] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 03:15:14 juju-e4d256-prod-github-runner-207 kernel: [78688.616392] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 03:15:14 juju-e4d256-prod-github-runner-207 kernel: [78688.617143] ? do_syscall_64+0x69/0xc0 Aug 23 03:15:14 juju-e4d256-prod-github-runner-207 kernel: [78688.617921] ? do_syscall_64+0x69/0xc0 Aug 23 03:15:14 juju-e4d256-prod-github-runner-207 kernel: [78688.618545] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 03:15:14 juju-e4d256-prod-github-runner-207 kernel: [78688.619258] RIP: 0033:0x7faa5d0edaff Aug 23 03:15:14 juju-e4d256-prod-github-runner-207 kernel: [78688.619927] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 03:15:14 juju-e4d256-prod-github-runner-207 kernel: [78688.621959] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 03:15:14 juju-e4d256-prod-github-runner-207 kernel: [78688.622881] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 03:15:14 juju-e4d256-prod-github-runner-207 kernel: [78688.623787] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 03:15:14 juju-e4d256-prod-github-runner-207 kernel: [78688.624678] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 03:15:14 juju-e4d256-prod-github-runner-207 kernel: [78688.625565] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 03:15:14 juju-e4d256-prod-github-runner-207 kernel: [78688.626451] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 03:15:14 juju-e4d256-prod-github-runner-207 kernel: [78688.627363] Aug 23 03:15:42 juju-e4d256-prod-github-runner-207 kernel: [78716.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 73202s! [qemu-system-x86:6715] Aug 23 03:15:42 juju-e4d256-prod-github-runner-207 kernel: [78716.543131] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 03:15:42 juju-e4d256-prod-github-runner-207 kernel: [78716.543209] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 03:15:42 juju-e4d256-prod-github-runner-207 kernel: [78716.555648] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 03:15:42 juju-e4d256-prod-github-runner-207 kernel: [78716.556955] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 03:15:42 juju-e4d256-prod-github-runner-207 kernel: [78716.558265] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 03:15:42 juju-e4d256-prod-github-runner-207 kernel: [78716.559366] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 03:15:42 juju-e4d256-prod-github-runner-207 kernel: [78716.561964] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 03:15:42 juju-e4d256-prod-github-runner-207 kernel: [78716.563035] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 03:15:42 juju-e4d256-prod-github-runner-207 kernel: [78716.564212] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 03:15:42 juju-e4d256-prod-github-runner-207 kernel: [78716.565370] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 03:15:42 juju-e4d256-prod-github-runner-207 kernel: [78716.566611] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 03:15:42 juju-e4d256-prod-github-runner-207 kernel: [78716.567888] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 03:15:42 juju-e4d256-prod-github-runner-207 kernel: [78716.569064] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 03:15:42 juju-e4d256-prod-github-runner-207 kernel: [78716.570297] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 03:15:42 juju-e4d256-prod-github-runner-207 kernel: [78716.571423] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 03:15:42 juju-e4d256-prod-github-runner-207 kernel: [78716.572648] Call Trace: Aug 23 03:15:42 juju-e4d256-prod-github-runner-207 kernel: [78716.573561] Aug 23 03:15:42 juju-e4d256-prod-github-runner-207 kernel: [78716.574445] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 03:15:42 juju-e4d256-prod-github-runner-207 kernel: [78716.575507] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 03:15:42 juju-e4d256-prod-github-runner-207 kernel: [78716.576537] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 03:15:42 juju-e4d256-prod-github-runner-207 kernel: [78716.577650] ? show_regs.part.0+0x23/0x29 Aug 23 03:15:42 juju-e4d256-prod-github-runner-207 kernel: [78716.578669] ? show_regs.cold+0x8/0xd Aug 23 03:15:42 juju-e4d256-prod-github-runner-207 kernel: [78716.579640] ? watchdog_timer_fn+0x1be/0x220 Aug 23 03:15:42 juju-e4d256-prod-github-runner-207 kernel: [78716.580652] ? lockup_detector_update_enable+0x60/0x60 Aug 23 03:15:42 juju-e4d256-prod-github-runner-207 kernel: [78716.581720] ? __hrtimer_run_queues+0x107/0x230 Aug 23 03:15:42 juju-e4d256-prod-github-runner-207 kernel: [78716.582757] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 03:15:42 juju-e4d256-prod-github-runner-207 kernel: [78716.583805] ? hrtimer_interrupt+0x101/0x220 Aug 23 03:15:42 juju-e4d256-prod-github-runner-207 kernel: [78716.584858] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 03:15:42 juju-e4d256-prod-github-runner-207 kernel: [78716.585962] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 03:15:42 juju-e4d256-prod-github-runner-207 kernel: [78716.587081] Aug 23 03:15:42 juju-e4d256-prod-github-runner-207 kernel: [78716.587937] Aug 23 03:15:42 juju-e4d256-prod-github-runner-207 kernel: [78716.588775] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 03:15:42 juju-e4d256-prod-github-runner-207 kernel: [78716.589811] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 03:15:42 juju-e4d256-prod-github-runner-207 kernel: [78716.590870] ? _raw_spin_lock+0x22/0x30 Aug 23 03:15:42 juju-e4d256-prod-github-runner-207 kernel: [78716.591834] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 03:15:42 juju-e4d256-prod-github-runner-207 kernel: [78716.592861] direct_page_fault+0x206/0x310 [kvm] Aug 23 03:15:42 juju-e4d256-prod-github-runner-207 kernel: [78716.593939] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 03:15:42 juju-e4d256-prod-github-runner-207 kernel: [78716.595000] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 03:15:42 juju-e4d256-prod-github-runner-207 kernel: [78716.596005] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 03:15:42 juju-e4d256-prod-github-runner-207 kernel: [78716.596976] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 03:15:42 juju-e4d256-prod-github-runner-207 kernel: [78716.597929] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 03:15:42 juju-e4d256-prod-github-runner-207 kernel: [78716.598924] handle_exit+0x98/0x230 [kvm_amd] Aug 23 03:15:42 juju-e4d256-prod-github-runner-207 kernel: [78716.599821] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 03:15:42 juju-e4d256-prod-github-runner-207 kernel: [78716.600736] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 03:15:42 juju-e4d256-prod-github-runner-207 kernel: [78716.601668] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 03:15:42 juju-e4d256-prod-github-runner-207 kernel: [78716.602573] vcpu_run+0x62/0x2c0 [kvm] Aug 23 03:15:42 juju-e4d256-prod-github-runner-207 kernel: [78716.603403] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 03:15:42 juju-e4d256-prod-github-runner-207 kernel: [78716.604217] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 03:15:42 juju-e4d256-prod-github-runner-207 kernel: [78716.605075] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 03:15:42 juju-e4d256-prod-github-runner-207 kernel: [78716.605873] ? __seccomp_filter+0x4a/0x4a0 Aug 23 03:15:42 juju-e4d256-prod-github-runner-207 kernel: [78716.606624] ? __fget_files+0x86/0xc0 Aug 23 03:15:42 juju-e4d256-prod-github-runner-207 kernel: [78716.607341] __x64_sys_ioctl+0x95/0xd0 Aug 23 03:15:42 juju-e4d256-prod-github-runner-207 kernel: [78716.608035] do_syscall_64+0x5c/0xc0 Aug 23 03:15:42 juju-e4d256-prod-github-runner-207 kernel: [78716.608702] ? do_futex+0x162/0x1f0 Aug 23 03:15:42 juju-e4d256-prod-github-runner-207 kernel: [78716.609391] ? __x64_sys_futex+0x78/0x1e0 Aug 23 03:15:42 juju-e4d256-prod-github-runner-207 kernel: [78716.610082] ? __secure_computing+0xa9/0x120 Aug 23 03:15:42 juju-e4d256-prod-github-runner-207 kernel: [78716.610802] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 03:15:42 juju-e4d256-prod-github-runner-207 kernel: [78716.611565] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 03:15:42 juju-e4d256-prod-github-runner-207 kernel: [78716.612290] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 03:15:42 juju-e4d256-prod-github-runner-207 kernel: [78716.613040] ? do_syscall_64+0x69/0xc0 Aug 23 03:15:42 juju-e4d256-prod-github-runner-207 kernel: [78716.613712] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 03:15:42 juju-e4d256-prod-github-runner-207 kernel: [78716.614482] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 03:15:42 juju-e4d256-prod-github-runner-207 kernel: [78716.615239] ? do_syscall_64+0x69/0xc0 Aug 23 03:15:42 juju-e4d256-prod-github-runner-207 kernel: [78716.615890] ? do_syscall_64+0x69/0xc0 Aug 23 03:15:42 juju-e4d256-prod-github-runner-207 kernel: [78716.616520] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 03:15:42 juju-e4d256-prod-github-runner-207 kernel: [78716.617228] RIP: 0033:0x7faa5d0edaff Aug 23 03:15:42 juju-e4d256-prod-github-runner-207 kernel: [78716.617856] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 03:15:42 juju-e4d256-prod-github-runner-207 kernel: [78716.619887] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 03:15:42 juju-e4d256-prod-github-runner-207 kernel: [78716.620814] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 03:15:42 juju-e4d256-prod-github-runner-207 kernel: [78716.621747] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 03:15:42 juju-e4d256-prod-github-runner-207 kernel: [78716.622662] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 03:15:42 juju-e4d256-prod-github-runner-207 kernel: [78716.623572] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 03:15:42 juju-e4d256-prod-github-runner-207 kernel: [78716.624475] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 03:15:42 juju-e4d256-prod-github-runner-207 kernel: [78716.625369] Aug 23 03:16:10 juju-e4d256-prod-github-runner-207 kernel: [78744.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 73228s! [qemu-system-x86:6715] Aug 23 03:16:10 juju-e4d256-prod-github-runner-207 kernel: [78744.543126] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 03:16:10 juju-e4d256-prod-github-runner-207 kernel: [78744.543201] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 03:16:10 juju-e4d256-prod-github-runner-207 kernel: [78744.555332] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 03:16:10 juju-e4d256-prod-github-runner-207 kernel: [78744.556630] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 03:16:10 juju-e4d256-prod-github-runner-207 kernel: [78744.557857] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 03:16:10 juju-e4d256-prod-github-runner-207 kernel: [78744.558927] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 03:16:10 juju-e4d256-prod-github-runner-207 kernel: [78744.561482] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 03:16:10 juju-e4d256-prod-github-runner-207 kernel: [78744.562563] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 03:16:10 juju-e4d256-prod-github-runner-207 kernel: [78744.563740] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 03:16:10 juju-e4d256-prod-github-runner-207 kernel: [78744.564907] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 03:16:10 juju-e4d256-prod-github-runner-207 kernel: [78744.566069] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 03:16:10 juju-e4d256-prod-github-runner-207 kernel: [78744.567249] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 03:16:10 juju-e4d256-prod-github-runner-207 kernel: [78744.568423] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 03:16:10 juju-e4d256-prod-github-runner-207 kernel: [78744.569663] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 03:16:10 juju-e4d256-prod-github-runner-207 kernel: [78744.570799] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 03:16:10 juju-e4d256-prod-github-runner-207 kernel: [78744.572002] Call Trace: Aug 23 03:16:10 juju-e4d256-prod-github-runner-207 kernel: [78744.572913] Aug 23 03:16:10 juju-e4d256-prod-github-runner-207 kernel: [78744.573802] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 03:16:10 juju-e4d256-prod-github-runner-207 kernel: [78744.574853] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 03:16:10 juju-e4d256-prod-github-runner-207 kernel: [78744.575880] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 03:16:10 juju-e4d256-prod-github-runner-207 kernel: [78744.576956] ? show_regs.part.0+0x23/0x29 Aug 23 03:16:10 juju-e4d256-prod-github-runner-207 kernel: [78744.577960] ? show_regs.cold+0x8/0xd Aug 23 03:16:10 juju-e4d256-prod-github-runner-207 kernel: [78744.578944] ? watchdog_timer_fn+0x1be/0x220 Aug 23 03:16:10 juju-e4d256-prod-github-runner-207 kernel: [78744.579963] ? lockup_detector_update_enable+0x60/0x60 Aug 23 03:16:10 juju-e4d256-prod-github-runner-207 kernel: [78744.581037] ? __hrtimer_run_queues+0x107/0x230 Aug 23 03:16:10 juju-e4d256-prod-github-runner-207 kernel: [78744.582083] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 03:16:10 juju-e4d256-prod-github-runner-207 kernel: [78744.583129] ? hrtimer_interrupt+0x101/0x220 Aug 23 03:16:10 juju-e4d256-prod-github-runner-207 kernel: [78744.584162] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 03:16:10 juju-e4d256-prod-github-runner-207 kernel: [78744.585230] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 03:16:10 juju-e4d256-prod-github-runner-207 kernel: [78744.586275] Aug 23 03:16:10 juju-e4d256-prod-github-runner-207 kernel: [78744.587152] Aug 23 03:16:10 juju-e4d256-prod-github-runner-207 kernel: [78744.587987] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 03:16:10 juju-e4d256-prod-github-runner-207 kernel: [78744.589016] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 03:16:10 juju-e4d256-prod-github-runner-207 kernel: [78744.590052] ? _raw_spin_lock+0x22/0x30 Aug 23 03:16:10 juju-e4d256-prod-github-runner-207 kernel: [78744.591148] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 03:16:10 juju-e4d256-prod-github-runner-207 kernel: [78744.592163] direct_page_fault+0x206/0x310 [kvm] Aug 23 03:16:10 juju-e4d256-prod-github-runner-207 kernel: [78744.593183] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 03:16:10 juju-e4d256-prod-github-runner-207 kernel: [78744.594187] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 03:16:10 juju-e4d256-prod-github-runner-207 kernel: [78744.595201] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 03:16:10 juju-e4d256-prod-github-runner-207 kernel: [78744.596172] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 03:16:10 juju-e4d256-prod-github-runner-207 kernel: [78744.597118] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 03:16:10 juju-e4d256-prod-github-runner-207 kernel: [78744.598091] handle_exit+0x98/0x230 [kvm_amd] Aug 23 03:16:10 juju-e4d256-prod-github-runner-207 kernel: [78744.598993] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 03:16:10 juju-e4d256-prod-github-runner-207 kernel: [78744.599908] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 03:16:10 juju-e4d256-prod-github-runner-207 kernel: [78744.600908] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 03:16:10 juju-e4d256-prod-github-runner-207 kernel: [78744.601812] vcpu_run+0x62/0x2c0 [kvm] Aug 23 03:16:10 juju-e4d256-prod-github-runner-207 kernel: [78744.602641] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 03:16:10 juju-e4d256-prod-github-runner-207 kernel: [78744.603453] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 03:16:10 juju-e4d256-prod-github-runner-207 kernel: [78744.604303] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 03:16:10 juju-e4d256-prod-github-runner-207 kernel: [78744.605097] ? __seccomp_filter+0x4a/0x4a0 Aug 23 03:16:10 juju-e4d256-prod-github-runner-207 kernel: [78744.605843] ? __fget_files+0x86/0xc0 Aug 23 03:16:10 juju-e4d256-prod-github-runner-207 kernel: [78744.606563] __x64_sys_ioctl+0x95/0xd0 Aug 23 03:16:10 juju-e4d256-prod-github-runner-207 kernel: [78744.607253] do_syscall_64+0x5c/0xc0 Aug 23 03:16:10 juju-e4d256-prod-github-runner-207 kernel: [78744.607914] ? do_futex+0x162/0x1f0 Aug 23 03:16:10 juju-e4d256-prod-github-runner-207 kernel: [78744.608560] ? __x64_sys_futex+0x78/0x1e0 Aug 23 03:16:10 juju-e4d256-prod-github-runner-207 kernel: [78744.609231] ? __secure_computing+0xa9/0x120 Aug 23 03:16:10 juju-e4d256-prod-github-runner-207 kernel: [78744.609916] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 03:16:10 juju-e4d256-prod-github-runner-207 kernel: [78744.610684] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 03:16:10 juju-e4d256-prod-github-runner-207 kernel: [78744.611404] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 03:16:10 juju-e4d256-prod-github-runner-207 kernel: [78744.612122] ? do_syscall_64+0x69/0xc0 Aug 23 03:16:10 juju-e4d256-prod-github-runner-207 kernel: [78744.612764] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 03:16:10 juju-e4d256-prod-github-runner-207 kernel: [78744.613466] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 03:16:10 juju-e4d256-prod-github-runner-207 kernel: [78744.614161] ? do_syscall_64+0x69/0xc0 Aug 23 03:16:10 juju-e4d256-prod-github-runner-207 kernel: [78744.614800] ? do_syscall_64+0x69/0xc0 Aug 23 03:16:10 juju-e4d256-prod-github-runner-207 kernel: [78744.615420] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 03:16:10 juju-e4d256-prod-github-runner-207 kernel: [78744.616121] RIP: 0033:0x7faa5d0edaff Aug 23 03:16:10 juju-e4d256-prod-github-runner-207 kernel: [78744.616751] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 03:16:10 juju-e4d256-prod-github-runner-207 kernel: [78744.618743] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 03:16:10 juju-e4d256-prod-github-runner-207 kernel: [78744.619651] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 03:16:10 juju-e4d256-prod-github-runner-207 kernel: [78744.620537] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 03:16:10 juju-e4d256-prod-github-runner-207 kernel: [78744.621460] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 03:16:10 juju-e4d256-prod-github-runner-207 kernel: [78744.622369] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 03:16:10 juju-e4d256-prod-github-runner-207 kernel: [78744.623276] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 03:16:10 juju-e4d256-prod-github-runner-207 kernel: [78744.624169] Aug 23 03:16:38 juju-e4d256-prod-github-runner-207 kernel: [78772.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 73254s! [qemu-system-x86:6715] Aug 23 03:16:38 juju-e4d256-prod-github-runner-207 kernel: [78772.543866] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 03:16:38 juju-e4d256-prod-github-runner-207 kernel: [78772.544170] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 03:16:38 juju-e4d256-prod-github-runner-207 kernel: [78772.556381] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 03:16:38 juju-e4d256-prod-github-runner-207 kernel: [78772.557646] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 03:16:38 juju-e4d256-prod-github-runner-207 kernel: [78772.558882] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 03:16:38 juju-e4d256-prod-github-runner-207 kernel: [78772.560015] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 03:16:38 juju-e4d256-prod-github-runner-207 kernel: [78772.562729] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 03:16:38 juju-e4d256-prod-github-runner-207 kernel: [78772.563793] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 03:16:38 juju-e4d256-prod-github-runner-207 kernel: [78772.564951] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 03:16:38 juju-e4d256-prod-github-runner-207 kernel: [78772.566175] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 03:16:38 juju-e4d256-prod-github-runner-207 kernel: [78772.567347] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 03:16:38 juju-e4d256-prod-github-runner-207 kernel: [78772.568505] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 03:16:38 juju-e4d256-prod-github-runner-207 kernel: [78772.569675] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 03:16:38 juju-e4d256-prod-github-runner-207 kernel: [78772.570917] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 03:16:38 juju-e4d256-prod-github-runner-207 kernel: [78772.572017] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 03:16:38 juju-e4d256-prod-github-runner-207 kernel: [78772.573206] Call Trace: Aug 23 03:16:38 juju-e4d256-prod-github-runner-207 kernel: [78772.574128] Aug 23 03:16:38 juju-e4d256-prod-github-runner-207 kernel: [78772.575036] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 03:16:38 juju-e4d256-prod-github-runner-207 kernel: [78772.576071] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 03:16:38 juju-e4d256-prod-github-runner-207 kernel: [78772.577095] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 03:16:38 juju-e4d256-prod-github-runner-207 kernel: [78772.578203] ? show_regs.part.0+0x23/0x29 Aug 23 03:16:38 juju-e4d256-prod-github-runner-207 kernel: [78772.579198] ? show_regs.cold+0x8/0xd Aug 23 03:16:38 juju-e4d256-prod-github-runner-207 kernel: [78772.580166] ? watchdog_timer_fn+0x1be/0x220 Aug 23 03:16:38 juju-e4d256-prod-github-runner-207 kernel: [78772.581173] ? lockup_detector_update_enable+0x60/0x60 Aug 23 03:16:38 juju-e4d256-prod-github-runner-207 kernel: [78772.582255] ? __hrtimer_run_queues+0x107/0x230 Aug 23 03:16:38 juju-e4d256-prod-github-runner-207 kernel: [78772.583280] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 03:16:38 juju-e4d256-prod-github-runner-207 kernel: [78772.584301] ? hrtimer_interrupt+0x101/0x220 Aug 23 03:16:38 juju-e4d256-prod-github-runner-207 kernel: [78772.585315] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 03:16:38 juju-e4d256-prod-github-runner-207 kernel: [78772.586392] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 03:16:38 juju-e4d256-prod-github-runner-207 kernel: [78772.587436] Aug 23 03:16:38 juju-e4d256-prod-github-runner-207 kernel: [78772.588288] Aug 23 03:16:38 juju-e4d256-prod-github-runner-207 kernel: [78772.589125] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 03:16:38 juju-e4d256-prod-github-runner-207 kernel: [78772.590176] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 03:16:38 juju-e4d256-prod-github-runner-207 kernel: [78772.591224] ? _raw_spin_lock+0x22/0x30 Aug 23 03:16:38 juju-e4d256-prod-github-runner-207 kernel: [78772.592171] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 03:16:38 juju-e4d256-prod-github-runner-207 kernel: [78772.593189] direct_page_fault+0x206/0x310 [kvm] Aug 23 03:16:38 juju-e4d256-prod-github-runner-207 kernel: [78772.594240] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 03:16:38 juju-e4d256-prod-github-runner-207 kernel: [78772.595253] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 03:16:38 juju-e4d256-prod-github-runner-207 kernel: [78772.596259] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 03:16:38 juju-e4d256-prod-github-runner-207 kernel: [78772.597270] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 03:16:38 juju-e4d256-prod-github-runner-207 kernel: [78772.598226] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 03:16:38 juju-e4d256-prod-github-runner-207 kernel: [78772.599205] handle_exit+0x98/0x230 [kvm_amd] Aug 23 03:16:38 juju-e4d256-prod-github-runner-207 kernel: [78772.600101] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 03:16:38 juju-e4d256-prod-github-runner-207 kernel: [78772.601015] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 03:16:38 juju-e4d256-prod-github-runner-207 kernel: [78772.601940] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 03:16:38 juju-e4d256-prod-github-runner-207 kernel: [78772.602853] vcpu_run+0x62/0x2c0 [kvm] Aug 23 03:16:38 juju-e4d256-prod-github-runner-207 kernel: [78772.603668] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 03:16:38 juju-e4d256-prod-github-runner-207 kernel: [78772.604477] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 03:16:38 juju-e4d256-prod-github-runner-207 kernel: [78772.605335] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 03:16:38 juju-e4d256-prod-github-runner-207 kernel: [78772.606147] ? __seccomp_filter+0x4a/0x4a0 Aug 23 03:16:38 juju-e4d256-prod-github-runner-207 kernel: [78772.606893] ? __fget_files+0x86/0xc0 Aug 23 03:16:38 juju-e4d256-prod-github-runner-207 kernel: [78772.607599] __x64_sys_ioctl+0x95/0xd0 Aug 23 03:16:38 juju-e4d256-prod-github-runner-207 kernel: [78772.608292] do_syscall_64+0x5c/0xc0 Aug 23 03:16:38 juju-e4d256-prod-github-runner-207 kernel: [78772.608960] ? do_futex+0x162/0x1f0 Aug 23 03:16:38 juju-e4d256-prod-github-runner-207 kernel: [78772.609608] ? __x64_sys_futex+0x78/0x1e0 Aug 23 03:16:38 juju-e4d256-prod-github-runner-207 kernel: [78772.610310] ? __secure_computing+0xa9/0x120 Aug 23 03:16:38 juju-e4d256-prod-github-runner-207 kernel: [78772.611017] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 03:16:38 juju-e4d256-prod-github-runner-207 kernel: [78772.611777] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 03:16:38 juju-e4d256-prod-github-runner-207 kernel: [78772.612522] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 03:16:38 juju-e4d256-prod-github-runner-207 kernel: [78772.613247] ? do_syscall_64+0x69/0xc0 Aug 23 03:16:38 juju-e4d256-prod-github-runner-207 kernel: [78772.613891] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 03:16:38 juju-e4d256-prod-github-runner-207 kernel: [78772.614604] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 03:16:38 juju-e4d256-prod-github-runner-207 kernel: [78772.615299] ? do_syscall_64+0x69/0xc0 Aug 23 03:16:38 juju-e4d256-prod-github-runner-207 kernel: [78772.615922] ? do_syscall_64+0x69/0xc0 Aug 23 03:16:38 juju-e4d256-prod-github-runner-207 kernel: [78772.616547] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 03:16:38 juju-e4d256-prod-github-runner-207 kernel: [78772.617254] RIP: 0033:0x7faa5d0edaff Aug 23 03:16:38 juju-e4d256-prod-github-runner-207 kernel: [78772.617983] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 03:16:38 juju-e4d256-prod-github-runner-207 kernel: [78772.619989] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 03:16:38 juju-e4d256-prod-github-runner-207 kernel: [78772.620897] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 03:16:38 juju-e4d256-prod-github-runner-207 kernel: [78772.621788] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 03:16:38 juju-e4d256-prod-github-runner-207 kernel: [78772.622687] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 03:16:38 juju-e4d256-prod-github-runner-207 kernel: [78772.623575] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 03:16:38 juju-e4d256-prod-github-runner-207 kernel: [78772.624462] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 03:16:38 juju-e4d256-prod-github-runner-207 kernel: [78772.625359] Aug 23 03:17:06 juju-e4d256-prod-github-runner-207 kernel: [78800.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 73280s! [qemu-system-x86:6715] Aug 23 03:17:06 juju-e4d256-prod-github-runner-207 kernel: [78800.543112] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 03:17:06 juju-e4d256-prod-github-runner-207 kernel: [78800.543188] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 03:17:06 juju-e4d256-prod-github-runner-207 kernel: [78800.555330] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 03:17:06 juju-e4d256-prod-github-runner-207 kernel: [78800.556666] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 03:17:06 juju-e4d256-prod-github-runner-207 kernel: [78800.557947] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 03:17:06 juju-e4d256-prod-github-runner-207 kernel: [78800.559037] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 03:17:06 juju-e4d256-prod-github-runner-207 kernel: [78800.561609] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 03:17:06 juju-e4d256-prod-github-runner-207 kernel: [78800.562683] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 03:17:06 juju-e4d256-prod-github-runner-207 kernel: [78800.563887] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 03:17:06 juju-e4d256-prod-github-runner-207 kernel: [78800.565068] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 03:17:06 juju-e4d256-prod-github-runner-207 kernel: [78800.566385] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 03:17:06 juju-e4d256-prod-github-runner-207 kernel: [78800.567779] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 03:17:06 juju-e4d256-prod-github-runner-207 kernel: [78800.568993] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 03:17:06 juju-e4d256-prod-github-runner-207 kernel: [78800.570267] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 03:17:06 juju-e4d256-prod-github-runner-207 kernel: [78800.571430] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 03:17:06 juju-e4d256-prod-github-runner-207 kernel: [78800.572643] Call Trace: Aug 23 03:17:06 juju-e4d256-prod-github-runner-207 kernel: [78800.573574] Aug 23 03:17:06 juju-e4d256-prod-github-runner-207 kernel: [78800.574491] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 03:17:06 juju-e4d256-prod-github-runner-207 kernel: [78800.575536] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 03:17:06 juju-e4d256-prod-github-runner-207 kernel: [78800.576557] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 03:17:06 juju-e4d256-prod-github-runner-207 kernel: [78800.577666] ? show_regs.part.0+0x23/0x29 Aug 23 03:17:06 juju-e4d256-prod-github-runner-207 kernel: [78800.578676] ? show_regs.cold+0x8/0xd Aug 23 03:17:06 juju-e4d256-prod-github-runner-207 kernel: [78800.579656] ? watchdog_timer_fn+0x1be/0x220 Aug 23 03:17:06 juju-e4d256-prod-github-runner-207 kernel: [78800.580668] ? lockup_detector_update_enable+0x60/0x60 Aug 23 03:17:06 juju-e4d256-prod-github-runner-207 kernel: [78800.581774] ? __hrtimer_run_queues+0x107/0x230 Aug 23 03:17:06 juju-e4d256-prod-github-runner-207 kernel: [78800.582913] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 03:17:06 juju-e4d256-prod-github-runner-207 kernel: [78800.583988] ? hrtimer_interrupt+0x101/0x220 Aug 23 03:17:06 juju-e4d256-prod-github-runner-207 kernel: [78800.585116] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 03:17:06 juju-e4d256-prod-github-runner-207 kernel: [78800.586342] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 03:17:06 juju-e4d256-prod-github-runner-207 kernel: [78800.587533] Aug 23 03:17:06 juju-e4d256-prod-github-runner-207 kernel: [78800.588499] Aug 23 03:17:06 juju-e4d256-prod-github-runner-207 kernel: [78800.589463] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 03:17:06 juju-e4d256-prod-github-runner-207 kernel: [78800.590689] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 03:17:06 juju-e4d256-prod-github-runner-207 kernel: [78800.591873] ? _raw_spin_lock+0x22/0x30 Aug 23 03:17:06 juju-e4d256-prod-github-runner-207 kernel: [78800.592856] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 03:17:06 juju-e4d256-prod-github-runner-207 kernel: [78800.593980] direct_page_fault+0x206/0x310 [kvm] Aug 23 03:17:06 juju-e4d256-prod-github-runner-207 kernel: [78800.595035] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 03:17:06 juju-e4d256-prod-github-runner-207 kernel: [78800.596079] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 03:17:06 juju-e4d256-prod-github-runner-207 kernel: [78800.597085] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 03:17:06 juju-e4d256-prod-github-runner-207 kernel: [78800.598092] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 03:17:06 juju-e4d256-prod-github-runner-207 kernel: [78800.599109] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 03:17:06 juju-e4d256-prod-github-runner-207 kernel: [78800.601004] handle_exit+0x98/0x230 [kvm_amd] Aug 23 03:17:06 juju-e4d256-prod-github-runner-207 kernel: [78800.601949] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 03:17:06 juju-e4d256-prod-github-runner-207 kernel: [78800.602882] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 03:17:06 juju-e4d256-prod-github-runner-207 kernel: [78800.603842] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 03:17:06 juju-e4d256-prod-github-runner-207 kernel: [78800.604766] vcpu_run+0x62/0x2c0 [kvm] Aug 23 03:17:06 juju-e4d256-prod-github-runner-207 kernel: [78800.605617] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 03:17:06 juju-e4d256-prod-github-runner-207 kernel: [78800.606467] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 03:17:06 juju-e4d256-prod-github-runner-207 kernel: [78800.607328] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 03:17:06 juju-e4d256-prod-github-runner-207 kernel: [78800.608131] ? __seccomp_filter+0x4a/0x4a0 Aug 23 03:17:06 juju-e4d256-prod-github-runner-207 kernel: [78800.608912] ? __fget_files+0x86/0xc0 Aug 23 03:17:06 juju-e4d256-prod-github-runner-207 kernel: [78800.609652] __x64_sys_ioctl+0x95/0xd0 Aug 23 03:17:06 juju-e4d256-prod-github-runner-207 kernel: [78800.610376] do_syscall_64+0x5c/0xc0 Aug 23 03:17:06 juju-e4d256-prod-github-runner-207 kernel: [78800.611048] ? do_futex+0x162/0x1f0 Aug 23 03:17:06 juju-e4d256-prod-github-runner-207 kernel: [78800.611706] ? __x64_sys_futex+0x78/0x1e0 Aug 23 03:17:06 juju-e4d256-prod-github-runner-207 kernel: [78800.612386] ? __secure_computing+0xa9/0x120 Aug 23 03:17:06 juju-e4d256-prod-github-runner-207 kernel: [78800.613081] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 03:17:06 juju-e4d256-prod-github-runner-207 kernel: [78800.613880] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 03:17:06 juju-e4d256-prod-github-runner-207 kernel: [78800.614621] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 03:17:06 juju-e4d256-prod-github-runner-207 kernel: [78800.615349] ? do_syscall_64+0x69/0xc0 Aug 23 03:17:06 juju-e4d256-prod-github-runner-207 kernel: [78800.615998] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 03:17:06 juju-e4d256-prod-github-runner-207 kernel: [78800.616709] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 03:17:06 juju-e4d256-prod-github-runner-207 kernel: [78800.617415] ? do_syscall_64+0x69/0xc0 Aug 23 03:17:06 juju-e4d256-prod-github-runner-207 kernel: [78800.618080] ? do_syscall_64+0x69/0xc0 Aug 23 03:17:06 juju-e4d256-prod-github-runner-207 kernel: [78800.618716] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 03:17:06 juju-e4d256-prod-github-runner-207 kernel: [78800.619440] RIP: 0033:0x7faa5d0edaff Aug 23 03:17:06 juju-e4d256-prod-github-runner-207 kernel: [78800.620110] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 03:17:06 juju-e4d256-prod-github-runner-207 kernel: [78800.622124] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 03:17:06 juju-e4d256-prod-github-runner-207 kernel: [78800.623040] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 03:17:06 juju-e4d256-prod-github-runner-207 kernel: [78800.623958] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 03:17:06 juju-e4d256-prod-github-runner-207 kernel: [78800.624871] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 03:17:06 juju-e4d256-prod-github-runner-207 kernel: [78800.625804] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 03:17:06 juju-e4d256-prod-github-runner-207 kernel: [78800.626704] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 03:17:06 juju-e4d256-prod-github-runner-207 kernel: [78800.627604] Aug 23 03:17:34 juju-e4d256-prod-github-runner-207 kernel: [78828.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 73306s! [qemu-system-x86:6715] Aug 23 03:17:34 juju-e4d256-prod-github-runner-207 kernel: [78828.543114] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 03:17:34 juju-e4d256-prod-github-runner-207 kernel: [78828.543189] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 03:17:34 juju-e4d256-prod-github-runner-207 kernel: [78828.555548] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 03:17:34 juju-e4d256-prod-github-runner-207 kernel: [78828.556820] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 03:17:34 juju-e4d256-prod-github-runner-207 kernel: [78828.558049] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 03:17:34 juju-e4d256-prod-github-runner-207 kernel: [78828.559103] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 03:17:34 juju-e4d256-prod-github-runner-207 kernel: [78828.561657] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 03:17:34 juju-e4d256-prod-github-runner-207 kernel: [78828.562704] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 03:17:34 juju-e4d256-prod-github-runner-207 kernel: [78828.563888] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 03:17:34 juju-e4d256-prod-github-runner-207 kernel: [78828.565050] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 03:17:34 juju-e4d256-prod-github-runner-207 kernel: [78828.566227] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 03:17:34 juju-e4d256-prod-github-runner-207 kernel: [78828.567387] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 03:17:34 juju-e4d256-prod-github-runner-207 kernel: [78828.568605] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 03:17:34 juju-e4d256-prod-github-runner-207 kernel: [78828.569862] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 03:17:34 juju-e4d256-prod-github-runner-207 kernel: [78828.571017] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 03:17:34 juju-e4d256-prod-github-runner-207 kernel: [78828.572209] Call Trace: Aug 23 03:17:34 juju-e4d256-prod-github-runner-207 kernel: [78828.573119] Aug 23 03:17:34 juju-e4d256-prod-github-runner-207 kernel: [78828.574011] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 03:17:34 juju-e4d256-prod-github-runner-207 kernel: [78828.575039] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 03:17:34 juju-e4d256-prod-github-runner-207 kernel: [78828.576093] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 03:17:34 juju-e4d256-prod-github-runner-207 kernel: [78828.577181] ? show_regs.part.0+0x23/0x29 Aug 23 03:17:34 juju-e4d256-prod-github-runner-207 kernel: [78828.578439] ? show_regs.cold+0x8/0xd Aug 23 03:17:34 juju-e4d256-prod-github-runner-207 kernel: [78828.579671] ? watchdog_timer_fn+0x1be/0x220 Aug 23 03:17:34 juju-e4d256-prod-github-runner-207 kernel: [78828.580809] ? lockup_detector_update_enable+0x60/0x60 Aug 23 03:17:34 juju-e4d256-prod-github-runner-207 kernel: [78828.582082] ? __hrtimer_run_queues+0x107/0x230 Aug 23 03:17:34 juju-e4d256-prod-github-runner-207 kernel: [78828.583229] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 03:17:34 juju-e4d256-prod-github-runner-207 kernel: [78828.584367] ? hrtimer_interrupt+0x101/0x220 Aug 23 03:17:34 juju-e4d256-prod-github-runner-207 kernel: [78828.585498] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 03:17:34 juju-e4d256-prod-github-runner-207 kernel: [78828.586691] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 03:17:34 juju-e4d256-prod-github-runner-207 kernel: [78828.587839] Aug 23 03:17:34 juju-e4d256-prod-github-runner-207 kernel: [78828.588741] Aug 23 03:17:34 juju-e4d256-prod-github-runner-207 kernel: [78828.589643] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 03:17:34 juju-e4d256-prod-github-runner-207 kernel: [78828.590789] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 03:17:34 juju-e4d256-prod-github-runner-207 kernel: [78828.591940] ? _raw_spin_lock+0x22/0x30 Aug 23 03:17:34 juju-e4d256-prod-github-runner-207 kernel: [78828.592966] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 03:17:34 juju-e4d256-prod-github-runner-207 kernel: [78828.594095] direct_page_fault+0x206/0x310 [kvm] Aug 23 03:17:34 juju-e4d256-prod-github-runner-207 kernel: [78828.595221] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 03:17:34 juju-e4d256-prod-github-runner-207 kernel: [78828.596353] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 03:17:34 juju-e4d256-prod-github-runner-207 kernel: [78828.597511] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 03:17:34 juju-e4d256-prod-github-runner-207 kernel: [78828.598584] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 03:17:34 juju-e4d256-prod-github-runner-207 kernel: [78828.599628] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 03:17:34 juju-e4d256-prod-github-runner-207 kernel: [78828.600714] handle_exit+0x98/0x230 [kvm_amd] Aug 23 03:17:34 juju-e4d256-prod-github-runner-207 kernel: [78828.601714] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 03:17:34 juju-e4d256-prod-github-runner-207 kernel: [78828.602730] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 03:17:34 juju-e4d256-prod-github-runner-207 kernel: [78828.603805] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 03:17:34 juju-e4d256-prod-github-runner-207 kernel: [78828.604811] vcpu_run+0x62/0x2c0 [kvm] Aug 23 03:17:34 juju-e4d256-prod-github-runner-207 kernel: [78828.605719] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 03:17:34 juju-e4d256-prod-github-runner-207 kernel: [78828.606627] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 03:17:34 juju-e4d256-prod-github-runner-207 kernel: [78828.607585] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 03:17:34 juju-e4d256-prod-github-runner-207 kernel: [78828.608473] ? __seccomp_filter+0x4a/0x4a0 Aug 23 03:17:34 juju-e4d256-prod-github-runner-207 kernel: [78828.609301] ? __fget_files+0x86/0xc0 Aug 23 03:17:34 juju-e4d256-prod-github-runner-207 kernel: [78828.610090] __x64_sys_ioctl+0x95/0xd0 Aug 23 03:17:34 juju-e4d256-prod-github-runner-207 kernel: [78828.610865] do_syscall_64+0x5c/0xc0 Aug 23 03:17:34 juju-e4d256-prod-github-runner-207 kernel: [78828.611605] ? do_futex+0x162/0x1f0 Aug 23 03:17:34 juju-e4d256-prod-github-runner-207 kernel: [78828.612328] ? __x64_sys_futex+0x78/0x1e0 Aug 23 03:17:34 juju-e4d256-prod-github-runner-207 kernel: [78828.613082] ? __secure_computing+0xa9/0x120 Aug 23 03:17:34 juju-e4d256-prod-github-runner-207 kernel: [78828.613866] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 03:17:34 juju-e4d256-prod-github-runner-207 kernel: [78828.614734] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 03:17:34 juju-e4d256-prod-github-runner-207 kernel: [78828.615551] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 03:17:34 juju-e4d256-prod-github-runner-207 kernel: [78828.616362] ? do_syscall_64+0x69/0xc0 Aug 23 03:17:34 juju-e4d256-prod-github-runner-207 kernel: [78828.617085] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 03:17:34 juju-e4d256-prod-github-runner-207 kernel: [78828.617897] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 03:17:34 juju-e4d256-prod-github-runner-207 kernel: [78828.618709] ? do_syscall_64+0x69/0xc0 Aug 23 03:17:34 juju-e4d256-prod-github-runner-207 kernel: [78828.619414] ? do_syscall_64+0x69/0xc0 Aug 23 03:17:34 juju-e4d256-prod-github-runner-207 kernel: [78828.620141] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 03:17:34 juju-e4d256-prod-github-runner-207 kernel: [78828.620965] RIP: 0033:0x7faa5d0edaff Aug 23 03:17:34 juju-e4d256-prod-github-runner-207 kernel: [78828.621745] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 03:17:34 juju-e4d256-prod-github-runner-207 kernel: [78828.624108] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 03:17:34 juju-e4d256-prod-github-runner-207 kernel: [78828.625179] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 03:17:34 juju-e4d256-prod-github-runner-207 kernel: [78828.626240] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 03:17:34 juju-e4d256-prod-github-runner-207 kernel: [78828.627276] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 03:17:34 juju-e4d256-prod-github-runner-207 kernel: [78828.628308] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 03:17:34 juju-e4d256-prod-github-runner-207 kernel: [78828.629349] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 03:17:34 juju-e4d256-prod-github-runner-207 kernel: [78828.630389] Aug 23 03:17:48 juju-e4d256-prod-github-runner-207 kernel: [78842.444706] rcu: INFO: rcu_sched self-detected stall on CPU Aug 23 03:17:48 juju-e4d256-prod-github-runner-207 kernel: [78842.445688] rcu: 1-....: (19619555 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=9486345 Aug 23 03:17:48 juju-e4d256-prod-github-runner-207 kernel: [78842.446853] (t=19681311 jiffies g=23269 q=66133) Aug 23 03:17:48 juju-e4d256-prod-github-runner-207 kernel: [78842.447649] NMI backtrace for cpu 1 Aug 23 03:17:48 juju-e4d256-prod-github-runner-207 kernel: [78842.448368] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 03:17:48 juju-e4d256-prod-github-runner-207 kernel: [78842.449541] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 03:17:48 juju-e4d256-prod-github-runner-207 kernel: [78842.450652] Call Trace: Aug 23 03:17:48 juju-e4d256-prod-github-runner-207 kernel: [78842.451338] Aug 23 03:17:48 juju-e4d256-prod-github-runner-207 kernel: [78842.451983] show_stack+0x52/0x5c Aug 23 03:17:48 juju-e4d256-prod-github-runner-207 kernel: [78842.452718] dump_stack_lvl+0x4a/0x63 Aug 23 03:17:48 juju-e4d256-prod-github-runner-207 kernel: [78842.453482] dump_stack+0x10/0x16 Aug 23 03:17:48 juju-e4d256-prod-github-runner-207 kernel: [78842.454235] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 23 03:17:48 juju-e4d256-prod-github-runner-207 kernel: [78842.455030] ? lapic_can_unplug_cpu+0x90/0x90 Aug 23 03:17:48 juju-e4d256-prod-github-runner-207 kernel: [78842.455843] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 23 03:17:48 juju-e4d256-prod-github-runner-207 kernel: [78842.456685] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 23 03:17:48 juju-e4d256-prod-github-runner-207 kernel: [78842.457546] trigger_single_cpu_backtrace+0x44/0x4f Aug 23 03:17:48 juju-e4d256-prod-github-runner-207 kernel: [78842.458354] rcu_dump_cpu_stacks+0x102/0x149 Aug 23 03:17:48 juju-e4d256-prod-github-runner-207 kernel: [78842.459131] print_cpu_stall.cold+0x2f/0xe2 Aug 23 03:17:48 juju-e4d256-prod-github-runner-207 kernel: [78842.459898] ? timekeeping_update+0xf7/0x150 Aug 23 03:17:48 juju-e4d256-prod-github-runner-207 kernel: [78842.460673] check_cpu_stall+0x109/0x270 Aug 23 03:17:48 juju-e4d256-prod-github-runner-207 kernel: [78842.461438] rcu_sched_clock_irq+0x9a/0x250 Aug 23 03:17:48 juju-e4d256-prod-github-runner-207 kernel: [78842.462207] update_process_times+0x94/0xd0 Aug 23 03:17:48 juju-e4d256-prod-github-runner-207 kernel: [78842.462970] tick_sched_handle+0x29/0x70 Aug 23 03:17:48 juju-e4d256-prod-github-runner-207 kernel: [78842.463728] tick_sched_timer+0x8c/0xc0 Aug 23 03:17:48 juju-e4d256-prod-github-runner-207 kernel: [78842.464475] ? tick_nohz_handler+0xb0/0xb0 Aug 23 03:17:48 juju-e4d256-prod-github-runner-207 kernel: [78842.465254] __hrtimer_run_queues+0x107/0x230 Aug 23 03:17:48 juju-e4d256-prod-github-runner-207 kernel: [78842.466028] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 03:17:48 juju-e4d256-prod-github-runner-207 kernel: [78842.466801] hrtimer_interrupt+0x101/0x220 Aug 23 03:17:48 juju-e4d256-prod-github-runner-207 kernel: [78842.467557] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 03:17:48 juju-e4d256-prod-github-runner-207 kernel: [78842.468386] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 03:17:48 juju-e4d256-prod-github-runner-207 kernel: [78842.469217] Aug 23 03:17:48 juju-e4d256-prod-github-runner-207 kernel: [78842.469860] Aug 23 03:17:48 juju-e4d256-prod-github-runner-207 kernel: [78842.470488] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 03:17:48 juju-e4d256-prod-github-runner-207 kernel: [78842.471312] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 03:17:48 juju-e4d256-prod-github-runner-207 kernel: [78842.472193] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 03:17:48 juju-e4d256-prod-github-runner-207 kernel: [78842.474410] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 03:17:48 juju-e4d256-prod-github-runner-207 kernel: [78842.475286] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 03:17:48 juju-e4d256-prod-github-runner-207 kernel: [78842.476284] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 03:17:48 juju-e4d256-prod-github-runner-207 kernel: [78842.477273] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 03:17:48 juju-e4d256-prod-github-runner-207 kernel: [78842.478237] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 03:17:48 juju-e4d256-prod-github-runner-207 kernel: [78842.479222] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 03:17:48 juju-e4d256-prod-github-runner-207 kernel: [78842.480172] ? _raw_spin_lock+0x22/0x30 Aug 23 03:17:48 juju-e4d256-prod-github-runner-207 kernel: [78842.480933] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 03:17:48 juju-e4d256-prod-github-runner-207 kernel: [78842.481787] direct_page_fault+0x206/0x310 [kvm] Aug 23 03:17:48 juju-e4d256-prod-github-runner-207 kernel: [78842.482623] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 03:17:48 juju-e4d256-prod-github-runner-207 kernel: [78842.483464] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 03:17:48 juju-e4d256-prod-github-runner-207 kernel: [78842.484331] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 03:17:48 juju-e4d256-prod-github-runner-207 kernel: [78842.485142] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 03:17:48 juju-e4d256-prod-github-runner-207 kernel: [78842.485963] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 03:17:48 juju-e4d256-prod-github-runner-207 kernel: [78842.486788] handle_exit+0x98/0x230 [kvm_amd] Aug 23 03:17:48 juju-e4d256-prod-github-runner-207 kernel: [78842.487541] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 03:17:48 juju-e4d256-prod-github-runner-207 kernel: [78842.488326] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 03:17:48 juju-e4d256-prod-github-runner-207 kernel: [78842.489135] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 03:17:48 juju-e4d256-prod-github-runner-207 kernel: [78842.489955] vcpu_run+0x62/0x2c0 [kvm] Aug 23 03:17:48 juju-e4d256-prod-github-runner-207 kernel: [78842.490677] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 03:17:48 juju-e4d256-prod-github-runner-207 kernel: [78842.491410] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 03:17:48 juju-e4d256-prod-github-runner-207 kernel: [78842.492206] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 03:17:48 juju-e4d256-prod-github-runner-207 kernel: [78842.492965] ? __seccomp_filter+0x4a/0x4a0 Aug 23 03:17:48 juju-e4d256-prod-github-runner-207 kernel: [78842.493698] ? __fget_files+0x86/0xc0 Aug 23 03:17:48 juju-e4d256-prod-github-runner-207 kernel: [78842.494392] __x64_sys_ioctl+0x95/0xd0 Aug 23 03:17:48 juju-e4d256-prod-github-runner-207 kernel: [78842.495083] do_syscall_64+0x5c/0xc0 Aug 23 03:17:48 juju-e4d256-prod-github-runner-207 kernel: [78842.495761] ? do_futex+0x162/0x1f0 Aug 23 03:17:48 juju-e4d256-prod-github-runner-207 kernel: [78842.496431] ? __x64_sys_futex+0x78/0x1e0 Aug 23 03:17:48 juju-e4d256-prod-github-runner-207 kernel: [78842.497129] ? __secure_computing+0xa9/0x120 Aug 23 03:17:48 juju-e4d256-prod-github-runner-207 kernel: [78842.497853] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 03:17:48 juju-e4d256-prod-github-runner-207 kernel: [78842.498638] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 03:17:48 juju-e4d256-prod-github-runner-207 kernel: [78842.499387] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 03:17:48 juju-e4d256-prod-github-runner-207 kernel: [78842.500137] ? do_syscall_64+0x69/0xc0 Aug 23 03:17:48 juju-e4d256-prod-github-runner-207 kernel: [78842.500826] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 03:17:48 juju-e4d256-prod-github-runner-207 kernel: [78842.501593] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 03:17:48 juju-e4d256-prod-github-runner-207 kernel: [78842.502351] ? do_syscall_64+0x69/0xc0 Aug 23 03:17:48 juju-e4d256-prod-github-runner-207 kernel: [78842.503057] ? do_syscall_64+0x69/0xc0 Aug 23 03:17:48 juju-e4d256-prod-github-runner-207 kernel: [78842.503762] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 03:17:48 juju-e4d256-prod-github-runner-207 kernel: [78842.504535] RIP: 0033:0x7faa5d0edaff Aug 23 03:17:48 juju-e4d256-prod-github-runner-207 kernel: [78842.505238] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 03:17:48 juju-e4d256-prod-github-runner-207 kernel: [78842.507344] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 03:17:48 juju-e4d256-prod-github-runner-207 kernel: [78842.508314] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 03:17:48 juju-e4d256-prod-github-runner-207 kernel: [78842.509282] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 03:17:48 juju-e4d256-prod-github-runner-207 kernel: [78842.510235] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 03:17:48 juju-e4d256-prod-github-runner-207 kernel: [78842.511176] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 03:17:48 juju-e4d256-prod-github-runner-207 kernel: [78842.512125] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 03:17:48 juju-e4d256-prod-github-runner-207 kernel: [78842.513082] Aug 23 03:18:14 juju-e4d256-prod-github-runner-207 kernel: [78868.541983] watchdog: BUG: soft lockup - CPU#1 stuck for 73344s! [qemu-system-x86:6715] Aug 23 03:18:14 juju-e4d256-prod-github-runner-207 kernel: [78868.545396] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 03:18:14 juju-e4d256-prod-github-runner-207 kernel: [78868.545739] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 03:18:14 juju-e4d256-prod-github-runner-207 kernel: [78868.558088] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 03:18:14 juju-e4d256-prod-github-runner-207 kernel: [78868.559387] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 03:18:14 juju-e4d256-prod-github-runner-207 kernel: [78868.560631] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 03:18:14 juju-e4d256-prod-github-runner-207 kernel: [78868.561716] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 03:18:14 juju-e4d256-prod-github-runner-207 kernel: [78868.564281] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 03:18:14 juju-e4d256-prod-github-runner-207 kernel: [78868.565337] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 03:18:14 juju-e4d256-prod-github-runner-207 kernel: [78868.566502] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 03:18:14 juju-e4d256-prod-github-runner-207 kernel: [78868.567694] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 03:18:14 juju-e4d256-prod-github-runner-207 kernel: [78868.568908] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 03:18:14 juju-e4d256-prod-github-runner-207 kernel: [78868.570074] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 03:18:14 juju-e4d256-prod-github-runner-207 kernel: [78868.571275] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 03:18:14 juju-e4d256-prod-github-runner-207 kernel: [78868.572551] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 03:18:14 juju-e4d256-prod-github-runner-207 kernel: [78868.573727] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 03:18:14 juju-e4d256-prod-github-runner-207 kernel: [78868.574969] Call Trace: Aug 23 03:18:14 juju-e4d256-prod-github-runner-207 kernel: [78868.575901] Aug 23 03:18:14 juju-e4d256-prod-github-runner-207 kernel: [78868.576798] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 03:18:14 juju-e4d256-prod-github-runner-207 kernel: [78868.577854] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 03:18:14 juju-e4d256-prod-github-runner-207 kernel: [78868.578877] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 03:18:14 juju-e4d256-prod-github-runner-207 kernel: [78868.580008] ? show_regs.part.0+0x23/0x29 Aug 23 03:18:14 juju-e4d256-prod-github-runner-207 kernel: [78868.581086] ? show_regs.cold+0x8/0xd Aug 23 03:18:14 juju-e4d256-prod-github-runner-207 kernel: [78868.582072] ? watchdog_timer_fn+0x1be/0x220 Aug 23 03:18:14 juju-e4d256-prod-github-runner-207 kernel: [78868.583086] ? lockup_detector_update_enable+0x60/0x60 Aug 23 03:18:14 juju-e4d256-prod-github-runner-207 kernel: [78868.584184] ? __hrtimer_run_queues+0x107/0x230 Aug 23 03:18:14 juju-e4d256-prod-github-runner-207 kernel: [78868.585227] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 03:18:14 juju-e4d256-prod-github-runner-207 kernel: [78868.586256] ? hrtimer_interrupt+0x101/0x220 Aug 23 03:18:14 juju-e4d256-prod-github-runner-207 kernel: [78868.587272] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 03:18:14 juju-e4d256-prod-github-runner-207 kernel: [78868.588340] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 03:18:14 juju-e4d256-prod-github-runner-207 kernel: [78868.589389] Aug 23 03:18:14 juju-e4d256-prod-github-runner-207 kernel: [78868.590247] Aug 23 03:18:14 juju-e4d256-prod-github-runner-207 kernel: [78868.591140] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 03:18:14 juju-e4d256-prod-github-runner-207 kernel: [78868.592174] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 03:18:14 juju-e4d256-prod-github-runner-207 kernel: [78868.593231] ? _raw_spin_lock+0x22/0x30 Aug 23 03:18:14 juju-e4d256-prod-github-runner-207 kernel: [78868.594177] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 03:18:14 juju-e4d256-prod-github-runner-207 kernel: [78868.595196] direct_page_fault+0x206/0x310 [kvm] Aug 23 03:18:14 juju-e4d256-prod-github-runner-207 kernel: [78868.596220] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 03:18:14 juju-e4d256-prod-github-runner-207 kernel: [78868.597235] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 03:18:14 juju-e4d256-prod-github-runner-207 kernel: [78868.598236] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 03:18:14 juju-e4d256-prod-github-runner-207 kernel: [78868.599247] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 03:18:14 juju-e4d256-prod-github-runner-207 kernel: [78868.600227] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 03:18:14 juju-e4d256-prod-github-runner-207 kernel: [78868.601230] handle_exit+0x98/0x230 [kvm_amd] Aug 23 03:18:14 juju-e4d256-prod-github-runner-207 kernel: [78868.602125] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 03:18:14 juju-e4d256-prod-github-runner-207 kernel: [78868.603040] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 03:18:14 juju-e4d256-prod-github-runner-207 kernel: [78868.603964] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 03:18:14 juju-e4d256-prod-github-runner-207 kernel: [78868.604874] vcpu_run+0x62/0x2c0 [kvm] Aug 23 03:18:14 juju-e4d256-prod-github-runner-207 kernel: [78868.605687] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 03:18:14 juju-e4d256-prod-github-runner-207 kernel: [78868.606765] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 03:18:14 juju-e4d256-prod-github-runner-207 kernel: [78868.607622] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 03:18:14 juju-e4d256-prod-github-runner-207 kernel: [78868.608421] ? __seccomp_filter+0x4a/0x4a0 Aug 23 03:18:14 juju-e4d256-prod-github-runner-207 kernel: [78868.609199] ? __fget_files+0x86/0xc0 Aug 23 03:18:14 juju-e4d256-prod-github-runner-207 kernel: [78868.609913] __x64_sys_ioctl+0x95/0xd0 Aug 23 03:18:14 juju-e4d256-prod-github-runner-207 kernel: [78868.610606] do_syscall_64+0x5c/0xc0 Aug 23 03:18:14 juju-e4d256-prod-github-runner-207 kernel: [78868.611270] ? do_futex+0x162/0x1f0 Aug 23 03:18:14 juju-e4d256-prod-github-runner-207 kernel: [78868.611919] ? __x64_sys_futex+0x78/0x1e0 Aug 23 03:18:14 juju-e4d256-prod-github-runner-207 kernel: [78868.612591] ? __secure_computing+0xa9/0x120 Aug 23 03:18:14 juju-e4d256-prod-github-runner-207 kernel: [78868.613327] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 03:18:14 juju-e4d256-prod-github-runner-207 kernel: [78868.614089] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 03:18:14 juju-e4d256-prod-github-runner-207 kernel: [78868.614833] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 03:18:14 juju-e4d256-prod-github-runner-207 kernel: [78868.615603] ? do_syscall_64+0x69/0xc0 Aug 23 03:18:14 juju-e4d256-prod-github-runner-207 kernel: [78868.616324] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 03:18:14 juju-e4d256-prod-github-runner-207 kernel: [78868.617047] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 03:18:14 juju-e4d256-prod-github-runner-207 kernel: [78868.617744] ? do_syscall_64+0x69/0xc0 Aug 23 03:18:14 juju-e4d256-prod-github-runner-207 kernel: [78868.618367] ? do_syscall_64+0x69/0xc0 Aug 23 03:18:14 juju-e4d256-prod-github-runner-207 kernel: [78868.618988] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 03:18:14 juju-e4d256-prod-github-runner-207 kernel: [78868.619694] RIP: 0033:0x7faa5d0edaff Aug 23 03:18:14 juju-e4d256-prod-github-runner-207 kernel: [78868.620358] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 03:18:14 juju-e4d256-prod-github-runner-207 kernel: [78868.622697] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 03:18:14 juju-e4d256-prod-github-runner-207 kernel: [78868.624199] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 03:18:14 juju-e4d256-prod-github-runner-207 kernel: [78868.625787] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 03:18:14 juju-e4d256-prod-github-runner-207 kernel: [78868.627223] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 03:18:14 juju-e4d256-prod-github-runner-207 kernel: [78868.628701] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 03:18:14 juju-e4d256-prod-github-runner-207 kernel: [78868.630168] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 03:18:14 juju-e4d256-prod-github-runner-207 kernel: [78868.631454] Aug 23 03:18:42 juju-e4d256-prod-github-runner-207 kernel: [78896.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 73370s! [qemu-system-x86:6715] Aug 23 03:18:42 juju-e4d256-prod-github-runner-207 kernel: [78896.543087] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 03:18:42 juju-e4d256-prod-github-runner-207 kernel: [78896.543159] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 03:18:42 juju-e4d256-prod-github-runner-207 kernel: [78896.555531] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 03:18:42 juju-e4d256-prod-github-runner-207 kernel: [78896.556810] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 03:18:42 juju-e4d256-prod-github-runner-207 kernel: [78896.558034] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 03:18:42 juju-e4d256-prod-github-runner-207 kernel: [78896.559290] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 03:18:42 juju-e4d256-prod-github-runner-207 kernel: [78896.562026] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 03:18:42 juju-e4d256-prod-github-runner-207 kernel: [78896.563096] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 03:18:42 juju-e4d256-prod-github-runner-207 kernel: [78896.564318] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 03:18:42 juju-e4d256-prod-github-runner-207 kernel: [78896.565493] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 03:18:42 juju-e4d256-prod-github-runner-207 kernel: [78896.566651] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 03:18:42 juju-e4d256-prod-github-runner-207 kernel: [78896.567809] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 03:18:42 juju-e4d256-prod-github-runner-207 kernel: [78896.568986] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 03:18:42 juju-e4d256-prod-github-runner-207 kernel: [78896.570214] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 03:18:42 juju-e4d256-prod-github-runner-207 kernel: [78896.571309] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 03:18:42 juju-e4d256-prod-github-runner-207 kernel: [78896.572498] Call Trace: Aug 23 03:18:42 juju-e4d256-prod-github-runner-207 kernel: [78896.573424] Aug 23 03:18:42 juju-e4d256-prod-github-runner-207 kernel: [78896.574333] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 03:18:42 juju-e4d256-prod-github-runner-207 kernel: [78896.575378] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 03:18:42 juju-e4d256-prod-github-runner-207 kernel: [78896.576397] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 03:18:42 juju-e4d256-prod-github-runner-207 kernel: [78896.577489] ? show_regs.part.0+0x23/0x29 Aug 23 03:18:42 juju-e4d256-prod-github-runner-207 kernel: [78896.578489] ? show_regs.cold+0x8/0xd Aug 23 03:18:42 juju-e4d256-prod-github-runner-207 kernel: [78896.579463] ? watchdog_timer_fn+0x1be/0x220 Aug 23 03:18:42 juju-e4d256-prod-github-runner-207 kernel: [78896.580471] ? lockup_detector_update_enable+0x60/0x60 Aug 23 03:18:42 juju-e4d256-prod-github-runner-207 kernel: [78896.581549] ? __hrtimer_run_queues+0x107/0x230 Aug 23 03:18:42 juju-e4d256-prod-github-runner-207 kernel: [78896.582611] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 03:18:42 juju-e4d256-prod-github-runner-207 kernel: [78896.583643] ? hrtimer_interrupt+0x101/0x220 Aug 23 03:18:42 juju-e4d256-prod-github-runner-207 kernel: [78896.584677] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 03:18:42 juju-e4d256-prod-github-runner-207 kernel: [78896.585746] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 03:18:42 juju-e4d256-prod-github-runner-207 kernel: [78896.586788] Aug 23 03:18:42 juju-e4d256-prod-github-runner-207 kernel: [78896.587681] Aug 23 03:18:42 juju-e4d256-prod-github-runner-207 kernel: [78896.588547] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 03:18:42 juju-e4d256-prod-github-runner-207 kernel: [78896.589580] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 03:18:42 juju-e4d256-prod-github-runner-207 kernel: [78896.590617] ? _raw_spin_lock+0x22/0x30 Aug 23 03:18:42 juju-e4d256-prod-github-runner-207 kernel: [78896.591569] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 03:18:42 juju-e4d256-prod-github-runner-207 kernel: [78896.592620] direct_page_fault+0x206/0x310 [kvm] Aug 23 03:18:42 juju-e4d256-prod-github-runner-207 kernel: [78896.593654] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 03:18:42 juju-e4d256-prod-github-runner-207 kernel: [78896.594694] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 03:18:42 juju-e4d256-prod-github-runner-207 kernel: [78896.595693] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 03:18:42 juju-e4d256-prod-github-runner-207 kernel: [78896.596690] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 03:18:42 juju-e4d256-prod-github-runner-207 kernel: [78896.597640] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 03:18:42 juju-e4d256-prod-github-runner-207 kernel: [78896.598614] handle_exit+0x98/0x230 [kvm_amd] Aug 23 03:18:42 juju-e4d256-prod-github-runner-207 kernel: [78896.599503] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 03:18:42 juju-e4d256-prod-github-runner-207 kernel: [78896.600433] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 03:18:42 juju-e4d256-prod-github-runner-207 kernel: [78896.601370] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 03:18:42 juju-e4d256-prod-github-runner-207 kernel: [78896.602271] vcpu_run+0x62/0x2c0 [kvm] Aug 23 03:18:42 juju-e4d256-prod-github-runner-207 kernel: [78896.603080] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 03:18:42 juju-e4d256-prod-github-runner-207 kernel: [78896.603890] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 03:18:42 juju-e4d256-prod-github-runner-207 kernel: [78896.604798] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 03:18:42 juju-e4d256-prod-github-runner-207 kernel: [78896.605604] ? __seccomp_filter+0x4a/0x4a0 Aug 23 03:18:42 juju-e4d256-prod-github-runner-207 kernel: [78896.606359] ? __fget_files+0x86/0xc0 Aug 23 03:18:42 juju-e4d256-prod-github-runner-207 kernel: [78896.607060] __x64_sys_ioctl+0x95/0xd0 Aug 23 03:18:42 juju-e4d256-prod-github-runner-207 kernel: [78896.607756] do_syscall_64+0x5c/0xc0 Aug 23 03:18:42 juju-e4d256-prod-github-runner-207 kernel: [78896.608418] ? do_futex+0x162/0x1f0 Aug 23 03:18:42 juju-e4d256-prod-github-runner-207 kernel: [78896.609075] ? __x64_sys_futex+0x78/0x1e0 Aug 23 03:18:42 juju-e4d256-prod-github-runner-207 kernel: [78896.609751] ? __secure_computing+0xa9/0x120 Aug 23 03:18:42 juju-e4d256-prod-github-runner-207 kernel: [78896.610442] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 03:18:42 juju-e4d256-prod-github-runner-207 kernel: [78896.611198] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 03:18:42 juju-e4d256-prod-github-runner-207 kernel: [78896.611916] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 03:18:42 juju-e4d256-prod-github-runner-207 kernel: [78896.612641] ? do_syscall_64+0x69/0xc0 Aug 23 03:18:42 juju-e4d256-prod-github-runner-207 kernel: [78896.613284] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 03:18:42 juju-e4d256-prod-github-runner-207 kernel: [78896.613983] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 03:18:42 juju-e4d256-prod-github-runner-207 kernel: [78896.614675] ? do_syscall_64+0x69/0xc0 Aug 23 03:18:42 juju-e4d256-prod-github-runner-207 kernel: [78896.615298] ? do_syscall_64+0x69/0xc0 Aug 23 03:18:42 juju-e4d256-prod-github-runner-207 kernel: [78896.615917] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 03:18:42 juju-e4d256-prod-github-runner-207 kernel: [78896.616634] RIP: 0033:0x7faa5d0edaff Aug 23 03:18:42 juju-e4d256-prod-github-runner-207 kernel: [78896.617282] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 03:18:42 juju-e4d256-prod-github-runner-207 kernel: [78896.619259] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 03:18:42 juju-e4d256-prod-github-runner-207 kernel: [78896.620165] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 03:18:42 juju-e4d256-prod-github-runner-207 kernel: [78896.621057] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 03:18:42 juju-e4d256-prod-github-runner-207 kernel: [78896.621941] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 03:18:42 juju-e4d256-prod-github-runner-207 kernel: [78896.622827] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 03:18:42 juju-e4d256-prod-github-runner-207 kernel: [78896.623709] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 03:18:42 juju-e4d256-prod-github-runner-207 kernel: [78896.624611] Aug 23 03:19:10 juju-e4d256-prod-github-runner-207 kernel: [78924.541978] watchdog: BUG: soft lockup - CPU#1 stuck for 73396s! [qemu-system-x86:6715] Aug 23 03:19:10 juju-e4d256-prod-github-runner-207 kernel: [78924.543128] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 03:19:10 juju-e4d256-prod-github-runner-207 kernel: [78924.543204] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 03:19:10 juju-e4d256-prod-github-runner-207 kernel: [78924.555695] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 03:19:10 juju-e4d256-prod-github-runner-207 kernel: [78924.557063] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 03:19:10 juju-e4d256-prod-github-runner-207 kernel: [78924.558367] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 03:19:10 juju-e4d256-prod-github-runner-207 kernel: [78924.559523] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 03:19:10 juju-e4d256-prod-github-runner-207 kernel: [78924.562180] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 03:19:10 juju-e4d256-prod-github-runner-207 kernel: [78924.563276] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 03:19:10 juju-e4d256-prod-github-runner-207 kernel: [78924.564502] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 03:19:10 juju-e4d256-prod-github-runner-207 kernel: [78924.565715] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 03:19:10 juju-e4d256-prod-github-runner-207 kernel: [78924.566911] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 03:19:10 juju-e4d256-prod-github-runner-207 kernel: [78924.568102] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 03:19:10 juju-e4d256-prod-github-runner-207 kernel: [78924.569320] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 03:19:10 juju-e4d256-prod-github-runner-207 kernel: [78924.570619] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 03:19:10 juju-e4d256-prod-github-runner-207 kernel: [78924.571750] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 03:19:10 juju-e4d256-prod-github-runner-207 kernel: [78924.572999] Call Trace: Aug 23 03:19:10 juju-e4d256-prod-github-runner-207 kernel: [78924.573966] Aug 23 03:19:10 juju-e4d256-prod-github-runner-207 kernel: [78924.574888] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 03:19:10 juju-e4d256-prod-github-runner-207 kernel: [78924.575953] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 03:19:10 juju-e4d256-prod-github-runner-207 kernel: [78924.577225] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 03:19:10 juju-e4d256-prod-github-runner-207 kernel: [78924.578539] ? show_regs.part.0+0x23/0x29 Aug 23 03:19:10 juju-e4d256-prod-github-runner-207 kernel: [78924.579574] ? show_regs.cold+0x8/0xd Aug 23 03:19:10 juju-e4d256-prod-github-runner-207 kernel: [78924.580607] ? watchdog_timer_fn+0x1be/0x220 Aug 23 03:19:10 juju-e4d256-prod-github-runner-207 kernel: [78924.581660] ? lockup_detector_update_enable+0x60/0x60 Aug 23 03:19:10 juju-e4d256-prod-github-runner-207 kernel: [78924.582952] ? __hrtimer_run_queues+0x107/0x230 Aug 23 03:19:10 juju-e4d256-prod-github-runner-207 kernel: [78924.584232] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 03:19:10 juju-e4d256-prod-github-runner-207 kernel: [78924.585322] ? hrtimer_interrupt+0x101/0x220 Aug 23 03:19:10 juju-e4d256-prod-github-runner-207 kernel: [78924.586554] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 03:19:10 juju-e4d256-prod-github-runner-207 kernel: [78924.587671] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 03:19:10 juju-e4d256-prod-github-runner-207 kernel: [78924.588747] Aug 23 03:19:10 juju-e4d256-prod-github-runner-207 kernel: [78924.589609] Aug 23 03:19:10 juju-e4d256-prod-github-runner-207 kernel: [78924.590452] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 03:19:10 juju-e4d256-prod-github-runner-207 kernel: [78924.591499] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 03:19:10 juju-e4d256-prod-github-runner-207 kernel: [78924.592570] ? _raw_spin_lock+0x22/0x30 Aug 23 03:19:10 juju-e4d256-prod-github-runner-207 kernel: [78924.593528] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 03:19:10 juju-e4d256-prod-github-runner-207 kernel: [78924.594563] direct_page_fault+0x206/0x310 [kvm] Aug 23 03:19:10 juju-e4d256-prod-github-runner-207 kernel: [78924.595608] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 03:19:10 juju-e4d256-prod-github-runner-207 kernel: [78924.596683] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 03:19:10 juju-e4d256-prod-github-runner-207 kernel: [78924.597699] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 03:19:10 juju-e4d256-prod-github-runner-207 kernel: [78924.598672] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 03:19:10 juju-e4d256-prod-github-runner-207 kernel: [78924.599659] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 03:19:10 juju-e4d256-prod-github-runner-207 kernel: [78924.600665] handle_exit+0x98/0x230 [kvm_amd] Aug 23 03:19:10 juju-e4d256-prod-github-runner-207 kernel: [78924.601566] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 03:19:10 juju-e4d256-prod-github-runner-207 kernel: [78924.602485] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 03:19:10 juju-e4d256-prod-github-runner-207 kernel: [78924.603413] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 03:19:10 juju-e4d256-prod-github-runner-207 kernel: [78924.604336] vcpu_run+0x62/0x2c0 [kvm] Aug 23 03:19:10 juju-e4d256-prod-github-runner-207 kernel: [78924.605182] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 03:19:10 juju-e4d256-prod-github-runner-207 kernel: [78924.605999] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 03:19:10 juju-e4d256-prod-github-runner-207 kernel: [78924.606860] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 03:19:10 juju-e4d256-prod-github-runner-207 kernel: [78924.607669] ? __seccomp_filter+0x4a/0x4a0 Aug 23 03:19:10 juju-e4d256-prod-github-runner-207 kernel: [78924.608432] ? __fget_files+0x86/0xc0 Aug 23 03:19:10 juju-e4d256-prod-github-runner-207 kernel: [78924.609139] __x64_sys_ioctl+0x95/0xd0 Aug 23 03:19:10 juju-e4d256-prod-github-runner-207 kernel: [78924.609837] do_syscall_64+0x5c/0xc0 Aug 23 03:19:10 juju-e4d256-prod-github-runner-207 kernel: [78924.610508] ? do_futex+0x162/0x1f0 Aug 23 03:19:10 juju-e4d256-prod-github-runner-207 kernel: [78924.611158] ? __x64_sys_futex+0x78/0x1e0 Aug 23 03:19:10 juju-e4d256-prod-github-runner-207 kernel: [78924.611838] ? __secure_computing+0xa9/0x120 Aug 23 03:19:10 juju-e4d256-prod-github-runner-207 kernel: [78924.612539] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 03:19:10 juju-e4d256-prod-github-runner-207 kernel: [78924.613303] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 03:19:10 juju-e4d256-prod-github-runner-207 kernel: [78924.614026] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 03:19:10 juju-e4d256-prod-github-runner-207 kernel: [78924.614748] ? do_syscall_64+0x69/0xc0 Aug 23 03:19:10 juju-e4d256-prod-github-runner-207 kernel: [78924.615393] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 03:19:10 juju-e4d256-prod-github-runner-207 kernel: [78924.616115] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 03:19:10 juju-e4d256-prod-github-runner-207 kernel: [78924.616846] ? do_syscall_64+0x69/0xc0 Aug 23 03:19:10 juju-e4d256-prod-github-runner-207 kernel: [78924.617504] ? do_syscall_64+0x69/0xc0 Aug 23 03:19:10 juju-e4d256-prod-github-runner-207 kernel: [78924.618147] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 03:19:10 juju-e4d256-prod-github-runner-207 kernel: [78924.618853] RIP: 0033:0x7faa5d0edaff Aug 23 03:19:10 juju-e4d256-prod-github-runner-207 kernel: [78924.619507] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 03:19:10 juju-e4d256-prod-github-runner-207 kernel: [78924.621525] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 03:19:10 juju-e4d256-prod-github-runner-207 kernel: [78924.622434] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 03:19:10 juju-e4d256-prod-github-runner-207 kernel: [78924.623322] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 03:19:10 juju-e4d256-prod-github-runner-207 kernel: [78924.624221] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 03:19:10 juju-e4d256-prod-github-runner-207 kernel: [78924.625117] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 03:19:10 juju-e4d256-prod-github-runner-207 kernel: [78924.626008] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 03:19:10 juju-e4d256-prod-github-runner-207 kernel: [78924.626901] Aug 23 03:19:38 juju-e4d256-prod-github-runner-207 kernel: [78952.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 73422s! [qemu-system-x86:6715] Aug 23 03:19:38 juju-e4d256-prod-github-runner-207 kernel: [78952.543140] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 03:19:38 juju-e4d256-prod-github-runner-207 kernel: [78952.543215] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 03:19:38 juju-e4d256-prod-github-runner-207 kernel: [78952.555261] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 03:19:38 juju-e4d256-prod-github-runner-207 kernel: [78952.556553] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 03:19:38 juju-e4d256-prod-github-runner-207 kernel: [78952.557838] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 03:19:38 juju-e4d256-prod-github-runner-207 kernel: [78952.558892] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 03:19:38 juju-e4d256-prod-github-runner-207 kernel: [78952.561458] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 03:19:38 juju-e4d256-prod-github-runner-207 kernel: [78952.562502] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 03:19:38 juju-e4d256-prod-github-runner-207 kernel: [78952.563666] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 03:19:38 juju-e4d256-prod-github-runner-207 kernel: [78952.564841] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 03:19:38 juju-e4d256-prod-github-runner-207 kernel: [78952.566011] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 03:19:38 juju-e4d256-prod-github-runner-207 kernel: [78952.567176] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 03:19:38 juju-e4d256-prod-github-runner-207 kernel: [78952.568360] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 03:19:38 juju-e4d256-prod-github-runner-207 kernel: [78952.569592] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 03:19:38 juju-e4d256-prod-github-runner-207 kernel: [78952.570687] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 03:19:38 juju-e4d256-prod-github-runner-207 kernel: [78952.571890] Call Trace: Aug 23 03:19:38 juju-e4d256-prod-github-runner-207 kernel: [78952.572801] Aug 23 03:19:38 juju-e4d256-prod-github-runner-207 kernel: [78952.573684] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 03:19:38 juju-e4d256-prod-github-runner-207 kernel: [78952.574713] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 03:19:38 juju-e4d256-prod-github-runner-207 kernel: [78952.575806] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 03:19:38 juju-e4d256-prod-github-runner-207 kernel: [78952.576894] ? show_regs.part.0+0x23/0x29 Aug 23 03:19:38 juju-e4d256-prod-github-runner-207 kernel: [78952.577889] ? show_regs.cold+0x8/0xd Aug 23 03:19:38 juju-e4d256-prod-github-runner-207 kernel: [78952.578859] ? watchdog_timer_fn+0x1be/0x220 Aug 23 03:19:38 juju-e4d256-prod-github-runner-207 kernel: [78952.579880] ? lockup_detector_update_enable+0x60/0x60 Aug 23 03:19:38 juju-e4d256-prod-github-runner-207 kernel: [78952.580942] ? __hrtimer_run_queues+0x107/0x230 Aug 23 03:19:38 juju-e4d256-prod-github-runner-207 kernel: [78952.581968] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 03:19:38 juju-e4d256-prod-github-runner-207 kernel: [78952.582998] ? hrtimer_interrupt+0x101/0x220 Aug 23 03:19:38 juju-e4d256-prod-github-runner-207 kernel: [78952.584020] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 03:19:38 juju-e4d256-prod-github-runner-207 kernel: [78952.585087] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 03:19:38 juju-e4d256-prod-github-runner-207 kernel: [78952.586136] Aug 23 03:19:38 juju-e4d256-prod-github-runner-207 kernel: [78952.586988] Aug 23 03:19:38 juju-e4d256-prod-github-runner-207 kernel: [78952.587829] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 03:19:38 juju-e4d256-prod-github-runner-207 kernel: [78952.588870] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 03:19:38 juju-e4d256-prod-github-runner-207 kernel: [78952.589914] ? _raw_spin_lock+0x22/0x30 Aug 23 03:19:38 juju-e4d256-prod-github-runner-207 kernel: [78952.590856] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 03:19:38 juju-e4d256-prod-github-runner-207 kernel: [78952.591883] direct_page_fault+0x206/0x310 [kvm] Aug 23 03:19:38 juju-e4d256-prod-github-runner-207 kernel: [78952.593099] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 03:19:38 juju-e4d256-prod-github-runner-207 kernel: [78952.594109] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 03:19:38 juju-e4d256-prod-github-runner-207 kernel: [78952.595109] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 03:19:38 juju-e4d256-prod-github-runner-207 kernel: [78952.596094] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 03:19:38 juju-e4d256-prod-github-runner-207 kernel: [78952.597049] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 03:19:38 juju-e4d256-prod-github-runner-207 kernel: [78952.598031] handle_exit+0x98/0x230 [kvm_amd] Aug 23 03:19:38 juju-e4d256-prod-github-runner-207 kernel: [78952.598927] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 03:19:38 juju-e4d256-prod-github-runner-207 kernel: [78952.599843] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 03:19:38 juju-e4d256-prod-github-runner-207 kernel: [78952.600775] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 03:19:38 juju-e4d256-prod-github-runner-207 kernel: [78952.601676] vcpu_run+0x62/0x2c0 [kvm] Aug 23 03:19:38 juju-e4d256-prod-github-runner-207 kernel: [78952.602486] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 03:19:38 juju-e4d256-prod-github-runner-207 kernel: [78952.603292] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 03:19:38 juju-e4d256-prod-github-runner-207 kernel: [78952.604155] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 03:19:38 juju-e4d256-prod-github-runner-207 kernel: [78952.604951] ? __seccomp_filter+0x4a/0x4a0 Aug 23 03:19:38 juju-e4d256-prod-github-runner-207 kernel: [78952.605692] ? __fget_files+0x86/0xc0 Aug 23 03:19:38 juju-e4d256-prod-github-runner-207 kernel: [78952.606394] __x64_sys_ioctl+0x95/0xd0 Aug 23 03:19:38 juju-e4d256-prod-github-runner-207 kernel: [78952.607086] do_syscall_64+0x5c/0xc0 Aug 23 03:19:38 juju-e4d256-prod-github-runner-207 kernel: [78952.607749] ? do_futex+0x162/0x1f0 Aug 23 03:19:38 juju-e4d256-prod-github-runner-207 kernel: [78952.608406] ? __x64_sys_futex+0x78/0x1e0 Aug 23 03:19:38 juju-e4d256-prod-github-runner-207 kernel: [78952.609078] ? __secure_computing+0xa9/0x120 Aug 23 03:19:38 juju-e4d256-prod-github-runner-207 kernel: [78952.609766] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 03:19:38 juju-e4d256-prod-github-runner-207 kernel: [78952.610525] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 03:19:38 juju-e4d256-prod-github-runner-207 kernel: [78952.611245] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 03:19:38 juju-e4d256-prod-github-runner-207 kernel: [78952.611976] ? do_syscall_64+0x69/0xc0 Aug 23 03:19:38 juju-e4d256-prod-github-runner-207 kernel: [78952.612619] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 03:19:38 juju-e4d256-prod-github-runner-207 kernel: [78952.613326] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 03:19:38 juju-e4d256-prod-github-runner-207 kernel: [78952.614031] ? do_syscall_64+0x69/0xc0 Aug 23 03:19:38 juju-e4d256-prod-github-runner-207 kernel: [78952.614657] ? do_syscall_64+0x69/0xc0 Aug 23 03:19:38 juju-e4d256-prod-github-runner-207 kernel: [78952.615278] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 03:19:38 juju-e4d256-prod-github-runner-207 kernel: [78952.615995] RIP: 0033:0x7faa5d0edaff Aug 23 03:19:38 juju-e4d256-prod-github-runner-207 kernel: [78952.616619] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 03:19:38 juju-e4d256-prod-github-runner-207 kernel: [78952.618605] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 03:19:38 juju-e4d256-prod-github-runner-207 kernel: [78952.619524] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 03:19:38 juju-e4d256-prod-github-runner-207 kernel: [78952.620436] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 03:19:38 juju-e4d256-prod-github-runner-207 kernel: [78952.621324] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 03:19:38 juju-e4d256-prod-github-runner-207 kernel: [78952.622215] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 03:19:38 juju-e4d256-prod-github-runner-207 kernel: [78952.623105] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 03:19:38 juju-e4d256-prod-github-runner-207 kernel: [78952.624015] Aug 23 03:20:06 juju-e4d256-prod-github-runner-207 kernel: [78980.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 73448s! [qemu-system-x86:6715] Aug 23 03:20:06 juju-e4d256-prod-github-runner-207 kernel: [78980.543888] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 03:20:06 juju-e4d256-prod-github-runner-207 kernel: [78980.544197] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 03:20:06 juju-e4d256-prod-github-runner-207 kernel: [78980.556302] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 03:20:06 juju-e4d256-prod-github-runner-207 kernel: [78980.557572] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 03:20:06 juju-e4d256-prod-github-runner-207 kernel: [78980.558797] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 03:20:06 juju-e4d256-prod-github-runner-207 kernel: [78980.559862] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 03:20:06 juju-e4d256-prod-github-runner-207 kernel: [78980.562411] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 03:20:06 juju-e4d256-prod-github-runner-207 kernel: [78980.563452] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 03:20:06 juju-e4d256-prod-github-runner-207 kernel: [78980.564641] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 03:20:06 juju-e4d256-prod-github-runner-207 kernel: [78980.565800] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 03:20:06 juju-e4d256-prod-github-runner-207 kernel: [78980.566965] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 03:20:06 juju-e4d256-prod-github-runner-207 kernel: [78980.568143] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 03:20:06 juju-e4d256-prod-github-runner-207 kernel: [78980.569314] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 03:20:06 juju-e4d256-prod-github-runner-207 kernel: [78980.570545] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 03:20:06 juju-e4d256-prod-github-runner-207 kernel: [78980.571648] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 03:20:06 juju-e4d256-prod-github-runner-207 kernel: [78980.572840] Call Trace: Aug 23 03:20:06 juju-e4d256-prod-github-runner-207 kernel: [78980.573754] Aug 23 03:20:06 juju-e4d256-prod-github-runner-207 kernel: [78980.574654] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 03:20:06 juju-e4d256-prod-github-runner-207 kernel: [78980.575825] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 03:20:06 juju-e4d256-prod-github-runner-207 kernel: [78980.577072] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 03:20:06 juju-e4d256-prod-github-runner-207 kernel: [78980.578259] ? show_regs.part.0+0x23/0x29 Aug 23 03:20:06 juju-e4d256-prod-github-runner-207 kernel: [78980.579270] ? show_regs.cold+0x8/0xd Aug 23 03:20:06 juju-e4d256-prod-github-runner-207 kernel: [78980.580268] ? watchdog_timer_fn+0x1be/0x220 Aug 23 03:20:06 juju-e4d256-prod-github-runner-207 kernel: [78980.581285] ? lockup_detector_update_enable+0x60/0x60 Aug 23 03:20:06 juju-e4d256-prod-github-runner-207 kernel: [78980.582359] ? __hrtimer_run_queues+0x107/0x230 Aug 23 03:20:06 juju-e4d256-prod-github-runner-207 kernel: [78980.583389] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 03:20:06 juju-e4d256-prod-github-runner-207 kernel: [78980.584435] ? hrtimer_interrupt+0x101/0x220 Aug 23 03:20:06 juju-e4d256-prod-github-runner-207 kernel: [78980.585462] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 03:20:06 juju-e4d256-prod-github-runner-207 kernel: [78980.586533] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 03:20:06 juju-e4d256-prod-github-runner-207 kernel: [78980.587596] Aug 23 03:20:06 juju-e4d256-prod-github-runner-207 kernel: [78980.588452] Aug 23 03:20:06 juju-e4d256-prod-github-runner-207 kernel: [78980.589315] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 03:20:06 juju-e4d256-prod-github-runner-207 kernel: [78980.590356] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 03:20:06 juju-e4d256-prod-github-runner-207 kernel: [78980.591398] ? _raw_spin_lock+0x22/0x30 Aug 23 03:20:06 juju-e4d256-prod-github-runner-207 kernel: [78980.592497] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 03:20:06 juju-e4d256-prod-github-runner-207 kernel: [78980.593547] direct_page_fault+0x206/0x310 [kvm] Aug 23 03:20:06 juju-e4d256-prod-github-runner-207 kernel: [78980.594571] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 03:20:06 juju-e4d256-prod-github-runner-207 kernel: [78980.595593] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 03:20:06 juju-e4d256-prod-github-runner-207 kernel: [78980.596602] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 03:20:06 juju-e4d256-prod-github-runner-207 kernel: [78980.597649] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 03:20:06 juju-e4d256-prod-github-runner-207 kernel: [78980.598604] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 03:20:06 juju-e4d256-prod-github-runner-207 kernel: [78980.599603] handle_exit+0x98/0x230 [kvm_amd] Aug 23 03:20:06 juju-e4d256-prod-github-runner-207 kernel: [78980.600498] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 03:20:06 juju-e4d256-prod-github-runner-207 kernel: [78980.601422] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 03:20:06 juju-e4d256-prod-github-runner-207 kernel: [78980.602345] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 03:20:06 juju-e4d256-prod-github-runner-207 kernel: [78980.603253] vcpu_run+0x62/0x2c0 [kvm] Aug 23 03:20:06 juju-e4d256-prod-github-runner-207 kernel: [78980.604084] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 03:20:06 juju-e4d256-prod-github-runner-207 kernel: [78980.604894] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 03:20:06 juju-e4d256-prod-github-runner-207 kernel: [78980.605778] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 03:20:06 juju-e4d256-prod-github-runner-207 kernel: [78980.606589] ? __seccomp_filter+0x4a/0x4a0 Aug 23 03:20:06 juju-e4d256-prod-github-runner-207 kernel: [78980.607335] ? __fget_files+0x86/0xc0 Aug 23 03:20:06 juju-e4d256-prod-github-runner-207 kernel: [78980.608059] __x64_sys_ioctl+0x95/0xd0 Aug 23 03:20:06 juju-e4d256-prod-github-runner-207 kernel: [78980.608759] do_syscall_64+0x5c/0xc0 Aug 23 03:20:06 juju-e4d256-prod-github-runner-207 kernel: [78980.609425] ? do_futex+0x162/0x1f0 Aug 23 03:20:06 juju-e4d256-prod-github-runner-207 kernel: [78980.610078] ? __x64_sys_futex+0x78/0x1e0 Aug 23 03:20:06 juju-e4d256-prod-github-runner-207 kernel: [78980.610754] ? __secure_computing+0xa9/0x120 Aug 23 03:20:06 juju-e4d256-prod-github-runner-207 kernel: [78980.611444] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 03:20:06 juju-e4d256-prod-github-runner-207 kernel: [78980.612218] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 03:20:06 juju-e4d256-prod-github-runner-207 kernel: [78980.612940] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 03:20:06 juju-e4d256-prod-github-runner-207 kernel: [78980.613658] ? do_syscall_64+0x69/0xc0 Aug 23 03:20:06 juju-e4d256-prod-github-runner-207 kernel: [78980.614315] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 03:20:06 juju-e4d256-prod-github-runner-207 kernel: [78980.615041] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 03:20:06 juju-e4d256-prod-github-runner-207 kernel: [78980.615755] ? do_syscall_64+0x69/0xc0 Aug 23 03:20:06 juju-e4d256-prod-github-runner-207 kernel: [78980.616386] ? do_syscall_64+0x69/0xc0 Aug 23 03:20:06 juju-e4d256-prod-github-runner-207 kernel: [78980.617008] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 03:20:06 juju-e4d256-prod-github-runner-207 kernel: [78980.617720] RIP: 0033:0x7faa5d0edaff Aug 23 03:20:06 juju-e4d256-prod-github-runner-207 kernel: [78980.618376] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 03:20:06 juju-e4d256-prod-github-runner-207 kernel: [78980.620388] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 03:20:06 juju-e4d256-prod-github-runner-207 kernel: [78980.621302] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 03:20:06 juju-e4d256-prod-github-runner-207 kernel: [78980.622193] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 03:20:06 juju-e4d256-prod-github-runner-207 kernel: [78980.623087] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 03:20:06 juju-e4d256-prod-github-runner-207 kernel: [78980.623991] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 03:20:06 juju-e4d256-prod-github-runner-207 kernel: [78980.624881] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 03:20:06 juju-e4d256-prod-github-runner-207 kernel: [78980.625774] Aug 23 03:20:34 juju-e4d256-prod-github-runner-207 kernel: [79008.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 73474s! [qemu-system-x86:6715] Aug 23 03:20:34 juju-e4d256-prod-github-runner-207 kernel: [79008.543107] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 03:20:34 juju-e4d256-prod-github-runner-207 kernel: [79008.543184] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 03:20:34 juju-e4d256-prod-github-runner-207 kernel: [79008.555565] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 03:20:34 juju-e4d256-prod-github-runner-207 kernel: [79008.556826] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 03:20:34 juju-e4d256-prod-github-runner-207 kernel: [79008.558046] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 03:20:34 juju-e4d256-prod-github-runner-207 kernel: [79008.559100] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 03:20:34 juju-e4d256-prod-github-runner-207 kernel: [79008.561651] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 03:20:34 juju-e4d256-prod-github-runner-207 kernel: [79008.562689] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 03:20:34 juju-e4d256-prod-github-runner-207 kernel: [79008.563857] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 03:20:34 juju-e4d256-prod-github-runner-207 kernel: [79008.565031] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 03:20:34 juju-e4d256-prod-github-runner-207 kernel: [79008.566186] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 03:20:34 juju-e4d256-prod-github-runner-207 kernel: [79008.567361] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 03:20:34 juju-e4d256-prod-github-runner-207 kernel: [79008.568526] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 03:20:34 juju-e4d256-prod-github-runner-207 kernel: [79008.569754] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 03:20:34 juju-e4d256-prod-github-runner-207 kernel: [79008.571113] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 03:20:34 juju-e4d256-prod-github-runner-207 kernel: [79008.572323] Call Trace: Aug 23 03:20:34 juju-e4d256-prod-github-runner-207 kernel: [79008.573235] Aug 23 03:20:34 juju-e4d256-prod-github-runner-207 kernel: [79008.574116] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 03:20:34 juju-e4d256-prod-github-runner-207 kernel: [79008.575156] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 03:20:34 juju-e4d256-prod-github-runner-207 kernel: [79008.576214] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 03:20:34 juju-e4d256-prod-github-runner-207 kernel: [79008.577296] ? show_regs.part.0+0x23/0x29 Aug 23 03:20:34 juju-e4d256-prod-github-runner-207 kernel: [79008.578294] ? show_regs.cold+0x8/0xd Aug 23 03:20:34 juju-e4d256-prod-github-runner-207 kernel: [79008.579284] ? watchdog_timer_fn+0x1be/0x220 Aug 23 03:20:34 juju-e4d256-prod-github-runner-207 kernel: [79008.580295] ? lockup_detector_update_enable+0x60/0x60 Aug 23 03:20:34 juju-e4d256-prod-github-runner-207 kernel: [79008.581358] ? __hrtimer_run_queues+0x107/0x230 Aug 23 03:20:34 juju-e4d256-prod-github-runner-207 kernel: [79008.582385] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 03:20:34 juju-e4d256-prod-github-runner-207 kernel: [79008.583419] ? hrtimer_interrupt+0x101/0x220 Aug 23 03:20:34 juju-e4d256-prod-github-runner-207 kernel: [79008.584438] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 03:20:34 juju-e4d256-prod-github-runner-207 kernel: [79008.585505] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 03:20:34 juju-e4d256-prod-github-runner-207 kernel: [79008.586549] Aug 23 03:20:34 juju-e4d256-prod-github-runner-207 kernel: [79008.587410] Aug 23 03:20:34 juju-e4d256-prod-github-runner-207 kernel: [79008.588248] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 03:20:34 juju-e4d256-prod-github-runner-207 kernel: [79008.589290] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 03:20:34 juju-e4d256-prod-github-runner-207 kernel: [79008.590328] ? _raw_spin_lock+0x22/0x30 Aug 23 03:20:34 juju-e4d256-prod-github-runner-207 kernel: [79008.591284] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 03:20:34 juju-e4d256-prod-github-runner-207 kernel: [79008.592303] direct_page_fault+0x206/0x310 [kvm] Aug 23 03:20:34 juju-e4d256-prod-github-runner-207 kernel: [79008.593327] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 03:20:34 juju-e4d256-prod-github-runner-207 kernel: [79008.594337] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 03:20:34 juju-e4d256-prod-github-runner-207 kernel: [79008.595344] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 03:20:34 juju-e4d256-prod-github-runner-207 kernel: [79008.596313] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 03:20:34 juju-e4d256-prod-github-runner-207 kernel: [79008.597259] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 03:20:34 juju-e4d256-prod-github-runner-207 kernel: [79008.598242] handle_exit+0x98/0x230 [kvm_amd] Aug 23 03:20:34 juju-e4d256-prod-github-runner-207 kernel: [79008.599136] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 03:20:34 juju-e4d256-prod-github-runner-207 kernel: [79008.600065] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 03:20:34 juju-e4d256-prod-github-runner-207 kernel: [79008.600986] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 03:20:34 juju-e4d256-prod-github-runner-207 kernel: [79008.601898] vcpu_run+0x62/0x2c0 [kvm] Aug 23 03:20:34 juju-e4d256-prod-github-runner-207 kernel: [79008.602710] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 03:20:34 juju-e4d256-prod-github-runner-207 kernel: [79008.603550] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 03:20:34 juju-e4d256-prod-github-runner-207 kernel: [79008.604413] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 03:20:34 juju-e4d256-prod-github-runner-207 kernel: [79008.605209] ? __seccomp_filter+0x4a/0x4a0 Aug 23 03:20:34 juju-e4d256-prod-github-runner-207 kernel: [79008.605964] ? __fget_files+0x86/0xc0 Aug 23 03:20:34 juju-e4d256-prod-github-runner-207 kernel: [79008.606673] __x64_sys_ioctl+0x95/0xd0 Aug 23 03:20:34 juju-e4d256-prod-github-runner-207 kernel: [79008.607386] do_syscall_64+0x5c/0xc0 Aug 23 03:20:34 juju-e4d256-prod-github-runner-207 kernel: [79008.608202] ? do_futex+0x162/0x1f0 Aug 23 03:20:34 juju-e4d256-prod-github-runner-207 kernel: [79008.609073] ? __x64_sys_futex+0x78/0x1e0 Aug 23 03:20:34 juju-e4d256-prod-github-runner-207 kernel: [79008.609900] ? __secure_computing+0xa9/0x120 Aug 23 03:20:34 juju-e4d256-prod-github-runner-207 kernel: [79008.610641] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 03:20:34 juju-e4d256-prod-github-runner-207 kernel: [79008.611596] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 03:20:34 juju-e4d256-prod-github-runner-207 kernel: [79008.612334] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 03:20:34 juju-e4d256-prod-github-runner-207 kernel: [79008.613060] ? do_syscall_64+0x69/0xc0 Aug 23 03:20:34 juju-e4d256-prod-github-runner-207 kernel: [79008.613754] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 03:20:34 juju-e4d256-prod-github-runner-207 kernel: [79008.614530] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 03:20:34 juju-e4d256-prod-github-runner-207 kernel: [79008.615305] ? do_syscall_64+0x69/0xc0 Aug 23 03:20:34 juju-e4d256-prod-github-runner-207 kernel: [79008.615984] ? do_syscall_64+0x69/0xc0 Aug 23 03:20:34 juju-e4d256-prod-github-runner-207 kernel: [79008.616674] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 03:20:34 juju-e4d256-prod-github-runner-207 kernel: [79008.617397] RIP: 0033:0x7faa5d0edaff Aug 23 03:20:34 juju-e4d256-prod-github-runner-207 kernel: [79008.618024] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 03:20:34 juju-e4d256-prod-github-runner-207 kernel: [79008.620457] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 03:20:34 juju-e4d256-prod-github-runner-207 kernel: [79008.621370] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 03:20:34 juju-e4d256-prod-github-runner-207 kernel: [79008.622260] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 03:20:34 juju-e4d256-prod-github-runner-207 kernel: [79008.623440] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 03:20:34 juju-e4d256-prod-github-runner-207 kernel: [79008.624334] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 03:20:34 juju-e4d256-prod-github-runner-207 kernel: [79008.625225] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 03:20:34 juju-e4d256-prod-github-runner-207 kernel: [79008.626115] Aug 23 03:20:48 juju-e4d256-prod-github-runner-207 kernel: [79022.456707] rcu: INFO: rcu_sched self-detected stall on CPU Aug 23 03:20:48 juju-e4d256-prod-github-runner-207 kernel: [79022.457836] rcu: 1-....: (19664422 ticks this GP) idle=abd/1/0x4000000000000000 softirq=34521/34521 fqs=9508160 Aug 23 03:20:48 juju-e4d256-prod-github-runner-207 kernel: [79022.459200] (t=19726314 jiffies g=23269 q=66234) Aug 23 03:20:48 juju-e4d256-prod-github-runner-207 kernel: [79022.460236] NMI backtrace for cpu 1 Aug 23 03:20:48 juju-e4d256-prod-github-runner-207 kernel: [79022.461029] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 03:20:48 juju-e4d256-prod-github-runner-207 kernel: [79022.462310] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 03:20:48 juju-e4d256-prod-github-runner-207 kernel: [79022.463552] Call Trace: Aug 23 03:20:48 juju-e4d256-prod-github-runner-207 kernel: [79022.464282] Aug 23 03:20:48 juju-e4d256-prod-github-runner-207 kernel: [79022.464975] show_stack+0x52/0x5c Aug 23 03:20:48 juju-e4d256-prod-github-runner-207 kernel: [79022.465782] dump_stack_lvl+0x4a/0x63 Aug 23 03:20:48 juju-e4d256-prod-github-runner-207 kernel: [79022.466612] dump_stack+0x10/0x16 Aug 23 03:20:48 juju-e4d256-prod-github-runner-207 kernel: [79022.467410] nmi_cpu_backtrace.cold+0x4d/0x93 Aug 23 03:20:48 juju-e4d256-prod-github-runner-207 kernel: [79022.468278] ? lapic_can_unplug_cpu+0x90/0x90 Aug 23 03:20:48 juju-e4d256-prod-github-runner-207 kernel: [79022.469160] nmi_trigger_cpumask_backtrace+0xec/0x100 Aug 23 03:20:48 juju-e4d256-prod-github-runner-207 kernel: [79022.470096] arch_trigger_cpumask_backtrace+0x19/0x20 Aug 23 03:20:48 juju-e4d256-prod-github-runner-207 kernel: [79022.471014] trigger_single_cpu_backtrace+0x44/0x4f Aug 23 03:20:48 juju-e4d256-prod-github-runner-207 kernel: [79022.471937] rcu_dump_cpu_stacks+0x102/0x149 Aug 23 03:20:48 juju-e4d256-prod-github-runner-207 kernel: [79022.472815] print_cpu_stall.cold+0x2f/0xe2 Aug 23 03:20:48 juju-e4d256-prod-github-runner-207 kernel: [79022.473674] ? timekeeping_update+0xf7/0x150 Aug 23 03:20:48 juju-e4d256-prod-github-runner-207 kernel: [79022.474534] check_cpu_stall+0x109/0x270 Aug 23 03:20:48 juju-e4d256-prod-github-runner-207 kernel: [79022.475380] rcu_sched_clock_irq+0x9a/0x250 Aug 23 03:20:48 juju-e4d256-prod-github-runner-207 kernel: [79022.476231] update_process_times+0x94/0xd0 Aug 23 03:20:48 juju-e4d256-prod-github-runner-207 kernel: [79022.477080] tick_sched_handle+0x29/0x70 Aug 23 03:20:48 juju-e4d256-prod-github-runner-207 kernel: [79022.477904] tick_sched_timer+0x8c/0xc0 Aug 23 03:20:48 juju-e4d256-prod-github-runner-207 kernel: [79022.478729] ? tick_nohz_handler+0xb0/0xb0 Aug 23 03:20:48 juju-e4d256-prod-github-runner-207 kernel: [79022.479585] __hrtimer_run_queues+0x107/0x230 Aug 23 03:20:48 juju-e4d256-prod-github-runner-207 kernel: [79022.480452] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 03:20:48 juju-e4d256-prod-github-runner-207 kernel: [79022.481318] hrtimer_interrupt+0x101/0x220 Aug 23 03:20:48 juju-e4d256-prod-github-runner-207 kernel: [79022.482165] __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 03:20:48 juju-e4d256-prod-github-runner-207 kernel: [79022.483094] sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 03:20:48 juju-e4d256-prod-github-runner-207 kernel: [79022.483995] Aug 23 03:20:48 juju-e4d256-prod-github-runner-207 kernel: [79022.484700] Aug 23 03:20:48 juju-e4d256-prod-github-runner-207 kernel: [79022.485383] asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 03:20:48 juju-e4d256-prod-github-runner-207 kernel: [79022.486304] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 03:20:48 juju-e4d256-prod-github-runner-207 kernel: [79022.487309] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 03:20:48 juju-e4d256-prod-github-runner-207 kernel: [79022.489878] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 03:20:48 juju-e4d256-prod-github-runner-207 kernel: [79022.490860] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 03:20:48 juju-e4d256-prod-github-runner-207 kernel: [79022.492036] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 03:20:48 juju-e4d256-prod-github-runner-207 kernel: [79022.493156] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 03:20:48 juju-e4d256-prod-github-runner-207 kernel: [79022.494304] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 03:20:48 juju-e4d256-prod-github-runner-207 kernel: [79022.495456] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 03:20:48 juju-e4d256-prod-github-runner-207 kernel: [79022.496551] ? _raw_spin_lock+0x22/0x30 Aug 23 03:20:48 juju-e4d256-prod-github-runner-207 kernel: [79022.497394] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 03:20:48 juju-e4d256-prod-github-runner-207 kernel: [79022.498324] direct_page_fault+0x206/0x310 [kvm] Aug 23 03:20:48 juju-e4d256-prod-github-runner-207 kernel: [79022.499284] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 03:20:48 juju-e4d256-prod-github-runner-207 kernel: [79022.500249] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 03:20:48 juju-e4d256-prod-github-runner-207 kernel: [79022.501164] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 03:20:48 juju-e4d256-prod-github-runner-207 kernel: [79022.502060] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 03:20:48 juju-e4d256-prod-github-runner-207 kernel: [79022.502942] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 03:20:48 juju-e4d256-prod-github-runner-207 kernel: [79022.503889] handle_exit+0x98/0x230 [kvm_amd] Aug 23 03:20:48 juju-e4d256-prod-github-runner-207 kernel: [79022.504733] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 03:20:48 juju-e4d256-prod-github-runner-207 kernel: [79022.505615] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 03:20:48 juju-e4d256-prod-github-runner-207 kernel: [79022.506552] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 03:20:48 juju-e4d256-prod-github-runner-207 kernel: [79022.507469] vcpu_run+0x62/0x2c0 [kvm] Aug 23 03:20:48 juju-e4d256-prod-github-runner-207 kernel: [79022.508263] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 03:20:48 juju-e4d256-prod-github-runner-207 kernel: [79022.509081] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 03:20:48 juju-e4d256-prod-github-runner-207 kernel: [79022.509990] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 03:20:48 juju-e4d256-prod-github-runner-207 kernel: [79022.510847] ? __seccomp_filter+0x4a/0x4a0 Aug 23 03:20:48 juju-e4d256-prod-github-runner-207 kernel: [79022.511681] ? __fget_files+0x86/0xc0 Aug 23 03:20:48 juju-e4d256-prod-github-runner-207 kernel: [79022.512450] __x64_sys_ioctl+0x95/0xd0 Aug 23 03:20:48 juju-e4d256-prod-github-runner-207 kernel: [79022.513229] do_syscall_64+0x5c/0xc0 Aug 23 03:20:48 juju-e4d256-prod-github-runner-207 kernel: [79022.513986] ? do_futex+0x162/0x1f0 Aug 23 03:20:48 juju-e4d256-prod-github-runner-207 kernel: [79022.514733] ? __x64_sys_futex+0x78/0x1e0 Aug 23 03:20:48 juju-e4d256-prod-github-runner-207 kernel: [79022.515535] ? __secure_computing+0xa9/0x120 Aug 23 03:20:48 juju-e4d256-prod-github-runner-207 kernel: [79022.516337] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 03:20:48 juju-e4d256-prod-github-runner-207 kernel: [79022.517245] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 03:20:48 juju-e4d256-prod-github-runner-207 kernel: [79022.518110] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 03:20:48 juju-e4d256-prod-github-runner-207 kernel: [79022.518965] ? do_syscall_64+0x69/0xc0 Aug 23 03:20:48 juju-e4d256-prod-github-runner-207 kernel: [79022.519754] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 03:20:48 juju-e4d256-prod-github-runner-207 kernel: [79022.520604] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 03:20:48 juju-e4d256-prod-github-runner-207 kernel: [79022.521456] ? do_syscall_64+0x69/0xc0 Aug 23 03:20:48 juju-e4d256-prod-github-runner-207 kernel: [79022.522241] ? do_syscall_64+0x69/0xc0 Aug 23 03:20:48 juju-e4d256-prod-github-runner-207 kernel: [79022.523041] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 03:20:48 juju-e4d256-prod-github-runner-207 kernel: [79022.523951] RIP: 0033:0x7faa5d0edaff Aug 23 03:20:48 juju-e4d256-prod-github-runner-207 kernel: [79022.524709] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 03:20:48 juju-e4d256-prod-github-runner-207 kernel: [79022.527215] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 03:20:48 juju-e4d256-prod-github-runner-207 kernel: [79022.528390] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 03:20:48 juju-e4d256-prod-github-runner-207 kernel: [79022.529864] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 03:20:48 juju-e4d256-prod-github-runner-207 kernel: [79022.530818] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 03:20:48 juju-e4d256-prod-github-runner-207 kernel: [79022.531785] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 03:20:48 juju-e4d256-prod-github-runner-207 kernel: [79022.532713] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 03:20:48 juju-e4d256-prod-github-runner-207 kernel: [79022.533632] Aug 23 03:21:14 juju-e4d256-prod-github-runner-207 kernel: [79048.541979] watchdog: BUG: soft lockup - CPU#1 stuck for 73511s! [qemu-system-x86:6715] Aug 23 03:21:14 juju-e4d256-prod-github-runner-207 kernel: [79048.543206] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 03:21:14 juju-e4d256-prod-github-runner-207 kernel: [79048.543282] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 03:21:14 juju-e4d256-prod-github-runner-207 kernel: [79048.555841] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 03:21:14 juju-e4d256-prod-github-runner-207 kernel: [79048.557171] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 03:21:14 juju-e4d256-prod-github-runner-207 kernel: [79048.558433] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 03:21:14 juju-e4d256-prod-github-runner-207 kernel: [79048.559529] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 03:21:14 juju-e4d256-prod-github-runner-207 kernel: [79048.562174] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 03:21:14 juju-e4d256-prod-github-runner-207 kernel: [79048.563255] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 03:21:14 juju-e4d256-prod-github-runner-207 kernel: [79048.564448] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 03:21:14 juju-e4d256-prod-github-runner-207 kernel: [79048.565636] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 03:21:14 juju-e4d256-prod-github-runner-207 kernel: [79048.566826] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 03:21:14 juju-e4d256-prod-github-runner-207 kernel: [79048.568021] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 03:21:14 juju-e4d256-prod-github-runner-207 kernel: [79048.569217] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 03:21:14 juju-e4d256-prod-github-runner-207 kernel: [79048.570484] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 03:21:14 juju-e4d256-prod-github-runner-207 kernel: [79048.571657] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 03:21:14 juju-e4d256-prod-github-runner-207 kernel: [79048.572897] Call Trace: Aug 23 03:21:14 juju-e4d256-prod-github-runner-207 kernel: [79048.573826] Aug 23 03:21:14 juju-e4d256-prod-github-runner-207 kernel: [79048.574770] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 03:21:14 juju-e4d256-prod-github-runner-207 kernel: [79048.575868] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 03:21:14 juju-e4d256-prod-github-runner-207 kernel: [79048.576908] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 03:21:14 juju-e4d256-prod-github-runner-207 kernel: [79048.578008] ? show_regs.part.0+0x23/0x29 Aug 23 03:21:14 juju-e4d256-prod-github-runner-207 kernel: [79048.579044] ? show_regs.cold+0x8/0xd Aug 23 03:21:14 juju-e4d256-prod-github-runner-207 kernel: [79048.580035] ? watchdog_timer_fn+0x1be/0x220 Aug 23 03:21:14 juju-e4d256-prod-github-runner-207 kernel: [79048.581062] ? lockup_detector_update_enable+0x60/0x60 Aug 23 03:21:14 juju-e4d256-prod-github-runner-207 kernel: [79048.582188] ? __hrtimer_run_queues+0x107/0x230 Aug 23 03:21:14 juju-e4d256-prod-github-runner-207 kernel: [79048.583257] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 03:21:14 juju-e4d256-prod-github-runner-207 kernel: [79048.584334] ? hrtimer_interrupt+0x101/0x220 Aug 23 03:21:14 juju-e4d256-prod-github-runner-207 kernel: [79048.585369] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 03:21:14 juju-e4d256-prod-github-runner-207 kernel: [79048.586459] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 03:21:14 juju-e4d256-prod-github-runner-207 kernel: [79048.587580] Aug 23 03:21:14 juju-e4d256-prod-github-runner-207 kernel: [79048.588559] Aug 23 03:21:14 juju-e4d256-prod-github-runner-207 kernel: [79048.589534] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 03:21:14 juju-e4d256-prod-github-runner-207 kernel: [79048.590617] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 03:21:14 juju-e4d256-prod-github-runner-207 kernel: [79048.591705] ? _raw_spin_lock+0x22/0x30 Aug 23 03:21:14 juju-e4d256-prod-github-runner-207 kernel: [79048.592694] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 03:21:14 juju-e4d256-prod-github-runner-207 kernel: [79048.593830] direct_page_fault+0x206/0x310 [kvm] Aug 23 03:21:14 juju-e4d256-prod-github-runner-207 kernel: [79048.595008] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 03:21:14 juju-e4d256-prod-github-runner-207 kernel: [79048.596148] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 03:21:14 juju-e4d256-prod-github-runner-207 kernel: [79048.597155] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 03:21:14 juju-e4d256-prod-github-runner-207 kernel: [79048.598134] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 03:21:14 juju-e4d256-prod-github-runner-207 kernel: [79048.599130] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 03:21:14 juju-e4d256-prod-github-runner-207 kernel: [79048.600233] handle_exit+0x98/0x230 [kvm_amd] Aug 23 03:21:14 juju-e4d256-prod-github-runner-207 kernel: [79048.601395] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 03:21:14 juju-e4d256-prod-github-runner-207 kernel: [79048.602328] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 03:21:14 juju-e4d256-prod-github-runner-207 kernel: [79048.603281] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 03:21:14 juju-e4d256-prod-github-runner-207 kernel: [79048.604214] vcpu_run+0x62/0x2c0 [kvm] Aug 23 03:21:14 juju-e4d256-prod-github-runner-207 kernel: [79048.605084] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 03:21:14 juju-e4d256-prod-github-runner-207 kernel: [79048.605904] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 03:21:14 juju-e4d256-prod-github-runner-207 kernel: [79048.606785] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 03:21:14 juju-e4d256-prod-github-runner-207 kernel: [79048.607583] ? __seccomp_filter+0x4a/0x4a0 Aug 23 03:21:14 juju-e4d256-prod-github-runner-207 kernel: [79048.608380] ? __fget_files+0x86/0xc0 Aug 23 03:21:14 juju-e4d256-prod-github-runner-207 kernel: [79048.609748] __x64_sys_ioctl+0x95/0xd0 Aug 23 03:21:14 juju-e4d256-prod-github-runner-207 kernel: [79048.610475] do_syscall_64+0x5c/0xc0 Aug 23 03:21:14 juju-e4d256-prod-github-runner-207 kernel: [79048.611162] ? do_futex+0x162/0x1f0 Aug 23 03:21:14 juju-e4d256-prod-github-runner-207 kernel: [79048.611819] ? __x64_sys_futex+0x78/0x1e0 Aug 23 03:21:14 juju-e4d256-prod-github-runner-207 kernel: [79048.612518] ? __secure_computing+0xa9/0x120 Aug 23 03:21:14 juju-e4d256-prod-github-runner-207 kernel: [79048.613209] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 03:21:14 juju-e4d256-prod-github-runner-207 kernel: [79048.614040] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 03:21:14 juju-e4d256-prod-github-runner-207 kernel: [79048.614816] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 03:21:14 juju-e4d256-prod-github-runner-207 kernel: [79048.615550] ? do_syscall_64+0x69/0xc0 Aug 23 03:21:14 juju-e4d256-prod-github-runner-207 kernel: [79048.616198] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 03:21:14 juju-e4d256-prod-github-runner-207 kernel: [79048.616899] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 03:21:14 juju-e4d256-prod-github-runner-207 kernel: [79048.617592] ? do_syscall_64+0x69/0xc0 Aug 23 03:21:14 juju-e4d256-prod-github-runner-207 kernel: [79048.618215] ? do_syscall_64+0x69/0xc0 Aug 23 03:21:14 juju-e4d256-prod-github-runner-207 kernel: [79048.618857] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 03:21:14 juju-e4d256-prod-github-runner-207 kernel: [79048.619599] RIP: 0033:0x7faa5d0edaff Aug 23 03:21:14 juju-e4d256-prod-github-runner-207 kernel: [79048.620239] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 03:21:14 juju-e4d256-prod-github-runner-207 kernel: [79048.622239] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 03:21:14 juju-e4d256-prod-github-runner-207 kernel: [79048.623165] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 03:21:14 juju-e4d256-prod-github-runner-207 kernel: [79048.624107] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 03:21:14 juju-e4d256-prod-github-runner-207 kernel: [79048.625084] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 03:21:14 juju-e4d256-prod-github-runner-207 kernel: [79048.626009] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 03:21:14 juju-e4d256-prod-github-runner-207 kernel: [79048.626962] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 03:21:14 juju-e4d256-prod-github-runner-207 kernel: [79048.627919] Aug 23 03:21:42 juju-e4d256-prod-github-runner-207 kernel: [79076.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 73537s! [qemu-system-x86:6715] Aug 23 03:21:42 juju-e4d256-prod-github-runner-207 kernel: [79076.543797] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 03:21:42 juju-e4d256-prod-github-runner-207 kernel: [79076.544085] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 03:21:42 juju-e4d256-prod-github-runner-207 kernel: [79076.556150] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 03:21:42 juju-e4d256-prod-github-runner-207 kernel: [79076.557422] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 03:21:42 juju-e4d256-prod-github-runner-207 kernel: [79076.558660] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 03:21:42 juju-e4d256-prod-github-runner-207 kernel: [79076.559719] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 03:21:42 juju-e4d256-prod-github-runner-207 kernel: [79076.562265] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 03:21:42 juju-e4d256-prod-github-runner-207 kernel: [79076.563350] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 03:21:42 juju-e4d256-prod-github-runner-207 kernel: [79076.564516] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 03:21:42 juju-e4d256-prod-github-runner-207 kernel: [79076.565673] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 03:21:42 juju-e4d256-prod-github-runner-207 kernel: [79076.566849] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 03:21:42 juju-e4d256-prod-github-runner-207 kernel: [79076.568010] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 03:21:42 juju-e4d256-prod-github-runner-207 kernel: [79076.569178] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 03:21:42 juju-e4d256-prod-github-runner-207 kernel: [79076.570422] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 03:21:42 juju-e4d256-prod-github-runner-207 kernel: [79076.571520] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 03:21:42 juju-e4d256-prod-github-runner-207 kernel: [79076.572711] Call Trace: Aug 23 03:21:42 juju-e4d256-prod-github-runner-207 kernel: [79076.573621] Aug 23 03:21:42 juju-e4d256-prod-github-runner-207 kernel: [79076.574534] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 03:21:42 juju-e4d256-prod-github-runner-207 kernel: [79076.575563] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 03:21:42 juju-e4d256-prod-github-runner-207 kernel: [79076.576587] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 03:21:42 juju-e4d256-prod-github-runner-207 kernel: [79076.577680] ? show_regs.part.0+0x23/0x29 Aug 23 03:21:42 juju-e4d256-prod-github-runner-207 kernel: [79076.578683] ? show_regs.cold+0x8/0xd Aug 23 03:21:42 juju-e4d256-prod-github-runner-207 kernel: [79076.579653] ? watchdog_timer_fn+0x1be/0x220 Aug 23 03:21:42 juju-e4d256-prod-github-runner-207 kernel: [79076.580657] ? lockup_detector_update_enable+0x60/0x60 Aug 23 03:21:42 juju-e4d256-prod-github-runner-207 kernel: [79076.581722] ? __hrtimer_run_queues+0x107/0x230 Aug 23 03:21:42 juju-e4d256-prod-github-runner-207 kernel: [79076.582761] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 03:21:42 juju-e4d256-prod-github-runner-207 kernel: [79076.583788] ? hrtimer_interrupt+0x101/0x220 Aug 23 03:21:42 juju-e4d256-prod-github-runner-207 kernel: [79076.584805] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 03:21:42 juju-e4d256-prod-github-runner-207 kernel: [79076.585870] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 03:21:42 juju-e4d256-prod-github-runner-207 kernel: [79076.586926] Aug 23 03:21:42 juju-e4d256-prod-github-runner-207 kernel: [79076.587796] Aug 23 03:21:42 juju-e4d256-prod-github-runner-207 kernel: [79076.588631] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 03:21:42 juju-e4d256-prod-github-runner-207 kernel: [79076.589665] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 03:21:42 juju-e4d256-prod-github-runner-207 kernel: [79076.590716] ? _raw_spin_lock+0x22/0x30 Aug 23 03:21:42 juju-e4d256-prod-github-runner-207 kernel: [79076.591665] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 03:21:42 juju-e4d256-prod-github-runner-207 kernel: [79076.592684] direct_page_fault+0x206/0x310 [kvm] Aug 23 03:21:42 juju-e4d256-prod-github-runner-207 kernel: [79076.593705] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 03:21:42 juju-e4d256-prod-github-runner-207 kernel: [79076.597163] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 03:21:42 juju-e4d256-prod-github-runner-207 kernel: [79076.598179] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 03:21:42 juju-e4d256-prod-github-runner-207 kernel: [79076.599187] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 03:21:42 juju-e4d256-prod-github-runner-207 kernel: [79076.600130] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 03:21:42 juju-e4d256-prod-github-runner-207 kernel: [79076.601112] handle_exit+0x98/0x230 [kvm_amd] Aug 23 03:21:42 juju-e4d256-prod-github-runner-207 kernel: [79076.602004] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 03:21:42 juju-e4d256-prod-github-runner-207 kernel: [79076.602927] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 03:21:42 juju-e4d256-prod-github-runner-207 kernel: [79076.603851] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 03:21:42 juju-e4d256-prod-github-runner-207 kernel: [79076.604753] vcpu_run+0x62/0x2c0 [kvm] Aug 23 03:21:42 juju-e4d256-prod-github-runner-207 kernel: [79076.605568] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 03:21:42 juju-e4d256-prod-github-runner-207 kernel: [79076.606376] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 03:21:42 juju-e4d256-prod-github-runner-207 kernel: [79076.607249] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 03:21:42 juju-e4d256-prod-github-runner-207 kernel: [79076.608050] ? __seccomp_filter+0x4a/0x4a0 Aug 23 03:21:42 juju-e4d256-prod-github-runner-207 kernel: [79076.608793] ? __fget_files+0x86/0xc0 Aug 23 03:21:42 juju-e4d256-prod-github-runner-207 kernel: [79076.609494] __x64_sys_ioctl+0x95/0xd0 Aug 23 03:21:42 juju-e4d256-prod-github-runner-207 kernel: [79076.610184] do_syscall_64+0x5c/0xc0 Aug 23 03:21:42 juju-e4d256-prod-github-runner-207 kernel: [79076.610853] ? do_futex+0x162/0x1f0 Aug 23 03:21:42 juju-e4d256-prod-github-runner-207 kernel: [79076.611505] ? __x64_sys_futex+0x78/0x1e0 Aug 23 03:21:42 juju-e4d256-prod-github-runner-207 kernel: [79076.612181] ? __secure_computing+0xa9/0x120 Aug 23 03:21:42 juju-e4d256-prod-github-runner-207 kernel: [79076.612867] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 03:21:42 juju-e4d256-prod-github-runner-207 kernel: [79076.613624] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 03:21:42 juju-e4d256-prod-github-runner-207 kernel: [79076.614348] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 03:21:42 juju-e4d256-prod-github-runner-207 kernel: [79076.615078] ? do_syscall_64+0x69/0xc0 Aug 23 03:21:42 juju-e4d256-prod-github-runner-207 kernel: [79076.615727] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 03:21:42 juju-e4d256-prod-github-runner-207 kernel: [79076.616427] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 03:21:42 juju-e4d256-prod-github-runner-207 kernel: [79076.617120] ? do_syscall_64+0x69/0xc0 Aug 23 03:21:42 juju-e4d256-prod-github-runner-207 kernel: [79076.617743] ? do_syscall_64+0x69/0xc0 Aug 23 03:21:42 juju-e4d256-prod-github-runner-207 kernel: [79076.618367] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 03:21:42 juju-e4d256-prod-github-runner-207 kernel: [79076.619077] RIP: 0033:0x7faa5d0edaff Aug 23 03:21:42 juju-e4d256-prod-github-runner-207 kernel: [79076.619734] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 03:21:42 juju-e4d256-prod-github-runner-207 kernel: [79076.621723] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 03:21:42 juju-e4d256-prod-github-runner-207 kernel: [79076.622737] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 03:21:42 juju-e4d256-prod-github-runner-207 kernel: [79076.623635] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 03:21:42 juju-e4d256-prod-github-runner-207 kernel: [79076.624530] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 03:21:42 juju-e4d256-prod-github-runner-207 kernel: [79076.625417] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 03:21:42 juju-e4d256-prod-github-runner-207 kernel: [79076.626303] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 03:21:42 juju-e4d256-prod-github-runner-207 kernel: [79076.627206] Aug 23 03:22:10 juju-e4d256-prod-github-runner-207 kernel: [79104.541976] watchdog: BUG: soft lockup - CPU#1 stuck for 73563s! [qemu-system-x86:6715] Aug 23 03:22:10 juju-e4d256-prod-github-runner-207 kernel: [79104.543101] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 03:22:10 juju-e4d256-prod-github-runner-207 kernel: [79104.543174] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 03:22:10 juju-e4d256-prod-github-runner-207 kernel: [79104.555287] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 03:22:10 juju-e4d256-prod-github-runner-207 kernel: [79104.556554] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 03:22:10 juju-e4d256-prod-github-runner-207 kernel: [79104.557779] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 03:22:10 juju-e4d256-prod-github-runner-207 kernel: [79104.558843] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 03:22:10 juju-e4d256-prod-github-runner-207 kernel: [79104.561385] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 03:22:10 juju-e4d256-prod-github-runner-207 kernel: [79104.563102] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 03:22:10 juju-e4d256-prod-github-runner-207 kernel: [79104.564268] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 03:22:10 juju-e4d256-prod-github-runner-207 kernel: [79104.565430] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 03:22:10 juju-e4d256-prod-github-runner-207 kernel: [79104.566606] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 03:22:10 juju-e4d256-prod-github-runner-207 kernel: [79104.567773] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 03:22:10 juju-e4d256-prod-github-runner-207 kernel: [79104.568943] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 03:22:10 juju-e4d256-prod-github-runner-207 kernel: [79104.570181] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 03:22:10 juju-e4d256-prod-github-runner-207 kernel: [79104.571285] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 03:22:10 juju-e4d256-prod-github-runner-207 kernel: [79104.572491] Call Trace: Aug 23 03:22:10 juju-e4d256-prod-github-runner-207 kernel: [79104.573404] Aug 23 03:22:10 juju-e4d256-prod-github-runner-207 kernel: [79104.574304] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 03:22:10 juju-e4d256-prod-github-runner-207 kernel: [79104.575348] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 03:22:10 juju-e4d256-prod-github-runner-207 kernel: [79104.576371] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 03:22:10 juju-e4d256-prod-github-runner-207 kernel: [79104.577452] ? show_regs.part.0+0x23/0x29 Aug 23 03:22:10 juju-e4d256-prod-github-runner-207 kernel: [79104.578458] ? show_regs.cold+0x8/0xd Aug 23 03:22:10 juju-e4d256-prod-github-runner-207 kernel: [79104.579431] ? watchdog_timer_fn+0x1be/0x220 Aug 23 03:22:10 juju-e4d256-prod-github-runner-207 kernel: [79104.580452] ? lockup_detector_update_enable+0x60/0x60 Aug 23 03:22:10 juju-e4d256-prod-github-runner-207 kernel: [79104.581527] ? __hrtimer_run_queues+0x107/0x230 Aug 23 03:22:10 juju-e4d256-prod-github-runner-207 kernel: [79104.582574] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 03:22:10 juju-e4d256-prod-github-runner-207 kernel: [79104.583597] ? hrtimer_interrupt+0x101/0x220 Aug 23 03:22:10 juju-e4d256-prod-github-runner-207 kernel: [79104.584619] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 03:22:10 juju-e4d256-prod-github-runner-207 kernel: [79104.585688] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 03:22:10 juju-e4d256-prod-github-runner-207 kernel: [79104.586766] Aug 23 03:22:10 juju-e4d256-prod-github-runner-207 kernel: [79104.587633] Aug 23 03:22:10 juju-e4d256-prod-github-runner-207 kernel: [79104.588483] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 03:22:10 juju-e4d256-prod-github-runner-207 kernel: [79104.589521] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 03:22:10 juju-e4d256-prod-github-runner-207 kernel: [79104.590598] ? _raw_spin_lock+0x22/0x30 Aug 23 03:22:10 juju-e4d256-prod-github-runner-207 kernel: [79104.591543] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 03:22:10 juju-e4d256-prod-github-runner-207 kernel: [79104.592574] direct_page_fault+0x206/0x310 [kvm] Aug 23 03:22:10 juju-e4d256-prod-github-runner-207 kernel: [79104.593601] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 03:22:10 juju-e4d256-prod-github-runner-207 kernel: [79104.594621] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 03:22:10 juju-e4d256-prod-github-runner-207 kernel: [79104.595629] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 03:22:10 juju-e4d256-prod-github-runner-207 kernel: [79104.596608] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 03:22:10 juju-e4d256-prod-github-runner-207 kernel: [79104.597553] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 03:22:10 juju-e4d256-prod-github-runner-207 kernel: [79104.598544] handle_exit+0x98/0x230 [kvm_amd] Aug 23 03:22:10 juju-e4d256-prod-github-runner-207 kernel: [79104.599441] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 03:22:10 juju-e4d256-prod-github-runner-207 kernel: [79104.600358] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 03:22:10 juju-e4d256-prod-github-runner-207 kernel: [79104.601285] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 03:22:10 juju-e4d256-prod-github-runner-207 kernel: [79104.602212] vcpu_run+0x62/0x2c0 [kvm] Aug 23 03:22:10 juju-e4d256-prod-github-runner-207 kernel: [79104.603037] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 03:22:10 juju-e4d256-prod-github-runner-207 kernel: [79104.603853] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 03:22:10 juju-e4d256-prod-github-runner-207 kernel: [79104.604707] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 03:22:10 juju-e4d256-prod-github-runner-207 kernel: [79104.605509] ? __seccomp_filter+0x4a/0x4a0 Aug 23 03:22:10 juju-e4d256-prod-github-runner-207 kernel: [79104.606264] ? __fget_files+0x86/0xc0 Aug 23 03:22:10 juju-e4d256-prod-github-runner-207 kernel: [79104.606966] __x64_sys_ioctl+0x95/0xd0 Aug 23 03:22:10 juju-e4d256-prod-github-runner-207 kernel: [79104.607689] do_syscall_64+0x5c/0xc0 Aug 23 03:22:10 juju-e4d256-prod-github-runner-207 kernel: [79104.608360] ? do_futex+0x162/0x1f0 Aug 23 03:22:10 juju-e4d256-prod-github-runner-207 kernel: [79104.609008] ? __x64_sys_futex+0x78/0x1e0 Aug 23 03:22:10 juju-e4d256-prod-github-runner-207 kernel: [79104.609685] ? __secure_computing+0xa9/0x120 Aug 23 03:22:10 juju-e4d256-prod-github-runner-207 kernel: [79104.610382] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 03:22:10 juju-e4d256-prod-github-runner-207 kernel: [79104.611139] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 03:22:10 juju-e4d256-prod-github-runner-207 kernel: [79104.611862] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 03:22:10 juju-e4d256-prod-github-runner-207 kernel: [79104.612577] ? do_syscall_64+0x69/0xc0 Aug 23 03:22:10 juju-e4d256-prod-github-runner-207 kernel: [79104.613223] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 03:22:10 juju-e4d256-prod-github-runner-207 kernel: [79104.613923] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 03:22:10 juju-e4d256-prod-github-runner-207 kernel: [79104.614633] ? do_syscall_64+0x69/0xc0 Aug 23 03:22:10 juju-e4d256-prod-github-runner-207 kernel: [79104.615258] ? do_syscall_64+0x69/0xc0 Aug 23 03:22:10 juju-e4d256-prod-github-runner-207 kernel: [79104.615888] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 03:22:10 juju-e4d256-prod-github-runner-207 kernel: [79104.616593] RIP: 0033:0x7faa5d0edaff Aug 23 03:22:10 juju-e4d256-prod-github-runner-207 kernel: [79104.617217] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 03:22:10 juju-e4d256-prod-github-runner-207 kernel: [79104.619212] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 03:22:10 juju-e4d256-prod-github-runner-207 kernel: [79104.620120] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 03:22:10 juju-e4d256-prod-github-runner-207 kernel: [79104.621010] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 03:22:10 juju-e4d256-prod-github-runner-207 kernel: [79104.621904] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 03:22:10 juju-e4d256-prod-github-runner-207 kernel: [79104.622818] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 03:22:10 juju-e4d256-prod-github-runner-207 kernel: [79104.623721] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 03:22:10 juju-e4d256-prod-github-runner-207 kernel: [79104.624617] Aug 23 03:22:38 juju-e4d256-prod-github-runner-207 kernel: [79132.541977] watchdog: BUG: soft lockup - CPU#1 stuck for 73589s! [qemu-system-x86:6715] Aug 23 03:22:38 juju-e4d256-prod-github-runner-207 kernel: [79132.543144] Modules linked in: vhost_net tap nft_meta_bridge nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nft_ct br_netfilter nft_masq zfs(PO) zunicode(PO) zzstd(O) zlua(O) zavl(PO) icp(PO) zcommon(PO) znvpair(PO) spl(O) vhost_vsock vmw_vsock_virtio_transport_common vhost vhost_iotlb vsock unix_diag tls xt_nat nft_compat nft_chain_nat nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_counter nf_tables nfnetlink vxlan ip6_udp_tunnel udp_tunnel bridge stp llc intel_rapl_msr binfmt_misc nls_iso8859_1 intel_rapl_common kvm_amd ccp kvm joydev input_leds serio_raw qemu_fw_cfg mac_hid dm_multipath sch_fq_codel scsi_dh_rdac scsi_dh_emc scsi_dh_alua ramoops pstore_blk reed_solomon pstore_zone efi_pstore ip_tables x_tables autofs4 btrfs blake2b_generic zstd_compress raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 raid0 multipath linear crct10dif_pclmul crc32_pclmul ghash_clmulni_intel qxl drm_ttm_helper ttm drm_kms_helper Aug 23 03:22:38 juju-e4d256-prod-github-runner-207 kernel: [79132.543222] syscopyarea sysfillrect sysimgblt fb_sys_fops aesni_intel crypto_simd cec rc_core virtio_net net_failover psmouse cryptd drm virtio_rng pata_acpi virtio_blk failover i2c_piix4 floppy Aug 23 03:22:38 juju-e4d256-prod-github-runner-207 kernel: [79132.555879] CPU: 1 PID: 6715 Comm: qemu-system-x86 Tainted: P D O L 5.15.0-83-generic #92-Ubuntu Aug 23 03:22:38 juju-e4d256-prod-github-runner-207 kernel: [79132.557223] Hardware name: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 03:22:38 juju-e4d256-prod-github-runner-207 kernel: [79132.558469] RIP: 0010:native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 03:22:38 juju-e4d256-prod-github-runner-207 kernel: [79132.559524] Code: 44 ff ff ff 0f 1f 44 00 00 0f 1f 44 00 00 66 90 ba 01 00 00 00 8b 07 85 c0 75 0d f0 0f b1 17 85 c0 75 f2 e9 91 75 ec 00 f3 90 e9 55 48 89 e5 e8 d4 fd ff ff 5d e9 7e 75 ec 00 66 66 2e 0f 1f Aug 23 03:22:38 juju-e4d256-prod-github-runner-207 kernel: [79132.562085] RSP: 0018:ffffa853817679d0 EFLAGS: 00000202 Aug 23 03:22:38 juju-e4d256-prod-github-runner-207 kernel: [79132.563124] RAX: 0000000000000001 RBX: 0000000000000000 RCX: 000000000000001e Aug 23 03:22:38 juju-e4d256-prod-github-runner-207 kernel: [79132.564288] RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffffa85381797a58 Aug 23 03:22:38 juju-e4d256-prod-github-runner-207 kernel: [79132.565443] RBP: ffffa853817679d8 R08: 0000000000000000 R09: 0000000000000003 Aug 23 03:22:38 juju-e4d256-prod-github-runner-207 kernel: [79132.566611] R10: 0000000000000000 R11: 0000000000000800 R12: ffff8e4e0f83a6f0 Aug 23 03:22:38 juju-e4d256-prod-github-runner-207 kernel: [79132.567777] R13: ffffa85381797a58 R14: ffffa85381781000 R15: ffff8e4e0caf5398 Aug 23 03:22:38 juju-e4d256-prod-github-runner-207 kernel: [79132.568940] FS: 00007faa59867640(0000) GS:ffff8e5813d00000(0000) knlGS:0000000000000000 Aug 23 03:22:38 juju-e4d256-prod-github-runner-207 kernel: [79132.570183] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Aug 23 03:22:38 juju-e4d256-prod-github-runner-207 kernel: [79132.571278] CR2: ffff8aef3ffff000 CR3: 00000001101fa000 CR4: 0000000000350ee0 Aug 23 03:22:38 juju-e4d256-prod-github-runner-207 kernel: [79132.572466] Call Trace: Aug 23 03:22:38 juju-e4d256-prod-github-runner-207 kernel: [79132.573381] Aug 23 03:22:38 juju-e4d256-prod-github-runner-207 kernel: [79132.574297] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 03:22:38 juju-e4d256-prod-github-runner-207 kernel: [79132.575326] ? show_trace_log_lvl+0x1d6/0x2ea Aug 23 03:22:38 juju-e4d256-prod-github-runner-207 kernel: [79132.576344] ? kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 03:22:38 juju-e4d256-prod-github-runner-207 kernel: [79132.577417] ? show_regs.part.0+0x23/0x29 Aug 23 03:22:38 juju-e4d256-prod-github-runner-207 kernel: [79132.578428] ? show_regs.cold+0x8/0xd Aug 23 03:22:38 juju-e4d256-prod-github-runner-207 kernel: [79132.579402] ? watchdog_timer_fn+0x1be/0x220 Aug 23 03:22:38 juju-e4d256-prod-github-runner-207 kernel: [79132.580410] ? lockup_detector_update_enable+0x60/0x60 Aug 23 03:22:38 juju-e4d256-prod-github-runner-207 kernel: [79132.581472] ? __hrtimer_run_queues+0x107/0x230 Aug 23 03:22:38 juju-e4d256-prod-github-runner-207 kernel: [79132.582513] ? kvm_clock_get_cycles+0x11/0x20 Aug 23 03:22:38 juju-e4d256-prod-github-runner-207 kernel: [79132.583540] ? hrtimer_interrupt+0x101/0x220 Aug 23 03:22:38 juju-e4d256-prod-github-runner-207 kernel: [79132.584556] ? __sysvec_apic_timer_interrupt+0x61/0xe0 Aug 23 03:22:38 juju-e4d256-prod-github-runner-207 kernel: [79132.585626] ? sysvec_apic_timer_interrupt+0x7b/0x90 Aug 23 03:22:38 juju-e4d256-prod-github-runner-207 kernel: [79132.586697] Aug 23 03:22:38 juju-e4d256-prod-github-runner-207 kernel: [79132.587551] Aug 23 03:22:38 juju-e4d256-prod-github-runner-207 kernel: [79132.588388] ? asm_sysvec_apic_timer_interrupt+0x1b/0x20 Aug 23 03:22:38 juju-e4d256-prod-github-runner-207 kernel: [79132.589426] ? native_queued_spin_lock_slowpath+0x21/0x40 Aug 23 03:22:38 juju-e4d256-prod-github-runner-207 kernel: [79132.591353] ? _raw_spin_lock+0x22/0x30 Aug 23 03:22:38 juju-e4d256-prod-github-runner-207 kernel: [79132.592313] kvm_tdp_mmu_map+0x2b1/0x490 [kvm] Aug 23 03:22:38 juju-e4d256-prod-github-runner-207 kernel: [79132.593371] direct_page_fault+0x206/0x310 [kvm] Aug 23 03:22:38 juju-e4d256-prod-github-runner-207 kernel: [79132.594414] kvm_tdp_page_fault+0x72/0x90 [kvm] Aug 23 03:22:38 juju-e4d256-prod-github-runner-207 kernel: [79132.595425] kvm_mmu_page_fault+0x73/0x1c0 [kvm] Aug 23 03:22:38 juju-e4d256-prod-github-runner-207 kernel: [79132.596427] ? svm_smi_allowed+0xa0/0xa0 [kvm_amd] Aug 23 03:22:38 juju-e4d256-prod-github-runner-207 kernel: [79132.597398] npf_interception+0x47/0xa0 [kvm_amd] Aug 23 03:22:38 juju-e4d256-prod-github-runner-207 kernel: [79132.598383] svm_invoke_exit_handler+0x14b/0x1b0 [kvm_amd] Aug 23 03:22:38 juju-e4d256-prod-github-runner-207 kernel: [79132.599367] handle_exit+0x98/0x230 [kvm_amd] Aug 23 03:22:38 juju-e4d256-prod-github-runner-207 kernel: [79132.600260] vcpu_enter_guest+0x818/0xf90 [kvm] Aug 23 03:22:38 juju-e4d256-prod-github-runner-207 kernel: [79132.601187] ? kvm_cpu_has_interrupt+0x28/0x40 [kvm] Aug 23 03:22:38 juju-e4d256-prod-github-runner-207 kernel: [79132.602139] ? kvm_vcpu_has_events+0x15f/0x1e0 [kvm] Aug 23 03:22:38 juju-e4d256-prod-github-runner-207 kernel: [79132.603042] vcpu_run+0x62/0x2c0 [kvm] Aug 23 03:22:38 juju-e4d256-prod-github-runner-207 kernel: [79132.603851] ? fpu_swap_kvm_fpstate+0x80/0x110 Aug 23 03:22:38 juju-e4d256-prod-github-runner-207 kernel: [79132.604656] kvm_arch_vcpu_ioctl_run+0xd7/0x570 [kvm] Aug 23 03:22:38 juju-e4d256-prod-github-runner-207 kernel: [79132.605513] kvm_vcpu_ioctl+0x29e/0x6d0 [kvm] Aug 23 03:22:38 juju-e4d256-prod-github-runner-207 kernel: [79132.606323] ? __seccomp_filter+0x4a/0x4a0 Aug 23 03:22:38 juju-e4d256-prod-github-runner-207 kernel: [79132.607156] ? __fget_files+0x86/0xc0 Aug 23 03:22:38 juju-e4d256-prod-github-runner-207 kernel: [79132.607938] __x64_sys_ioctl+0x95/0xd0 Aug 23 03:22:38 juju-e4d256-prod-github-runner-207 kernel: [79132.608709] do_syscall_64+0x5c/0xc0 Aug 23 03:22:38 juju-e4d256-prod-github-runner-207 kernel: [79132.609451] ? do_futex+0x162/0x1f0 Aug 23 03:22:38 juju-e4d256-prod-github-runner-207 kernel: [79132.610187] ? __x64_sys_futex+0x78/0x1e0 Aug 23 03:22:38 juju-e4d256-prod-github-runner-207 kernel: [79132.610946] ? __secure_computing+0xa9/0x120 Aug 23 03:22:38 juju-e4d256-prod-github-runner-207 kernel: [79132.611722] ? syscall_trace_enter.constprop.0+0xa7/0x1c0 Aug 23 03:22:38 juju-e4d256-prod-github-runner-207 kernel: [79132.612583] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 03:22:38 juju-e4d256-prod-github-runner-207 kernel: [79132.613399] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 03:22:38 juju-e4d256-prod-github-runner-207 kernel: [79132.614219] ? do_syscall_64+0x69/0xc0 Aug 23 03:22:38 juju-e4d256-prod-github-runner-207 kernel: [79132.614950] ? exit_to_user_mode_prepare+0x37/0xb0 Aug 23 03:22:38 juju-e4d256-prod-github-runner-207 kernel: [79132.615752] ? syscall_exit_to_user_mode+0x27/0x50 Aug 23 03:22:38 juju-e4d256-prod-github-runner-207 kernel: [79132.616555] ? do_syscall_64+0x69/0xc0 Aug 23 03:22:38 juju-e4d256-prod-github-runner-207 kernel: [79132.617274] ? do_syscall_64+0x69/0xc0 Aug 23 03:22:38 juju-e4d256-prod-github-runner-207 kernel: [79132.617995] entry_SYSCALL_64_after_hwframe+0x61/0xcb Aug 23 03:22:38 juju-e4d256-prod-github-runner-207 kernel: [79132.618805] RIP: 0033:0x7faa5d0edaff Aug 23 03:22:38 juju-e4d256-prod-github-runner-207 kernel: [79132.619502] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <41> 89 c0 3d 00 f0 ff ff 77 1f 48 8b 44 24 18 64 48 2b 04 25 28 00 Aug 23 03:22:38 juju-e4d256-prod-github-runner-207 kernel: [79132.621850] RSP: 002b:00007faa598630a0 EFLAGS: 00000246 ORIG_RAX: 0000000000000010 Aug 23 03:22:38 juju-e4d256-prod-github-runner-207 kernel: [79132.622896] RAX: ffffffffffffffda RBX: 000000000000ae80 RCX: 00007faa5d0edaff Aug 23 03:22:38 juju-e4d256-prod-github-runner-207 kernel: [79132.623915] RDX: 0000000000000000 RSI: 000000000000ae80 RDI: 0000000000000017 Aug 23 03:22:38 juju-e4d256-prod-github-runner-207 kernel: [79132.624936] RBP: 00005563cb913d40 R08: 00005563c9788f40 R09: 0000000000000000 Aug 23 03:22:38 juju-e4d256-prod-github-runner-207 kernel: [79132.625976] R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000 Aug 23 03:22:38 juju-e4d256-prod-github-runner-207 kernel: [79132.627000] R13: 00005563c97c9310 R14: 00007faa5d067850 R15: 00007ffea68ca3d0 Aug 23 03:22:38 juju-e4d256-prod-github-runner-207 kernel: [79132.628021] Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.000000] Linux version 5.15.0-83-generic (buildd@lcy02-amd64-027) (gcc (Ubuntu 11.4.0-1ubuntu1~22.04) 11.4.0, GNU ld (GNU Binutils for Ubuntu) 2.38) #92-Ubuntu SMP Mon Aug 14 09:30:42 UTC 2023 (Ubuntu 5.15.0-83.92-generic 5.15.116) Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.000000] Command line: BOOT_IMAGE=/boot/vmlinuz-5.15.0-83-generic root=UUID=a6de04b8-3631-4ce4-bb96-48076f4a56bf ro console=tty1 console=ttyS0 Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.000000] KERNEL supported cpus: Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.000000] Intel GenuineIntel Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.000000] AMD AuthenticAMD Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.000000] Hygon HygonGenuine Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.000000] Centaur CentaurHauls Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.000000] zhaoxin Shanghai Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.000000] BIOS-provided physical RAM map: Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000bffdafff] usable Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.000000] BIOS-e820: [mem 0x00000000bffdb000-0x00000000bfffffff] reserved Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x0000000b3fffffff] usable Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.000000] NX (Execute Disable) protection: active Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.000000] SMBIOS 2.8 present. Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.000000] DMI: OpenStack Foundation OpenStack Nova, BIOS 1.13.0-1ubuntu1.1 04/01/2014 Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.000000] Hypervisor detected: KVM Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00 Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.000000] kvm-clock: cpu 0, msr 7c4e01001, primary cpu clock Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.000002] kvm-clock: using sched offset of 2902226214 cycles Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.000004] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.000007] tsc: Detected 2500.000 MHz processor Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.001189] e820: update [mem 0x00000000-0x00000fff] usable ==> reserved Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.001193] e820: remove [mem 0x000a0000-0x000fffff] usable Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.001199] last_pfn = 0xb40000 max_arch_pfn = 0x400000000 Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.001246] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.001256] last_pfn = 0xbffdb max_arch_pfn = 0x400000000 Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.004153] found SMP MP-table at [mem 0x000f5c50-0x000f5c5f] Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.004174] Using GB pages for direct mapping Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.004301] RAMDISK: [mem 0x2aee5000-0x31769fff] Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.004330] ACPI: Early table checksum verification disabled Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.004335] ACPI: RSDP 0x00000000000F5C10 000014 (v00 BOCHS ) Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.004340] ACPI: RSDT 0x00000000BFFE12DF 00002C (v01 BOCHS BXPCRSDT 00000001 BXPC 00000001) Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.004346] ACPI: FACP 0x00000000BFFE11EB 000074 (v01 BOCHS BXPCFACP 00000001 BXPC 00000001) Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.004352] ACPI: DSDT 0x00000000BFFDFDC0 00142B (v01 BOCHS BXPCDSDT 00000001 BXPC 00000001) Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.004356] ACPI: FACS 0x00000000BFFDFD80 000040 Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.004360] ACPI: APIC 0x00000000BFFE125F 000080 (v01 BOCHS BXPCAPIC 00000001 BXPC 00000001) Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.004363] ACPI: Reserving FACP table memory at [mem 0xbffe11eb-0xbffe125e] Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.004365] ACPI: Reserving DSDT table memory at [mem 0xbffdfdc0-0xbffe11ea] Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.004366] ACPI: Reserving FACS table memory at [mem 0xbffdfd80-0xbffdfdbf] Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.004368] ACPI: Reserving APIC table memory at [mem 0xbffe125f-0xbffe12de] Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.004711] No NUMA configuration found Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.004715] Faking a node at [mem 0x0000000000000000-0x0000000b3fffffff] Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.004726] NODE_DATA(0) allocated [mem 0xb3ffd6000-0xb3fffffff] Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.005276] Zone ranges: Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.005277] DMA [mem 0x0000000000001000-0x0000000000ffffff] Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.005280] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.005282] Normal [mem 0x0000000100000000-0x0000000b3fffffff] Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.005284] Device empty Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.005285] Movable zone start for each node Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.005289] Early memory node ranges Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.005290] node 0: [mem 0x0000000000001000-0x000000000009efff] Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.005292] node 0: [mem 0x0000000000100000-0x00000000bffdafff] Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.005294] node 0: [mem 0x0000000100000000-0x0000000b3fffffff] Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.005301] Initmem setup node 0 [mem 0x0000000000001000-0x0000000b3fffffff] Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.005470] On node 0, zone DMA: 1 pages in unavailable ranges Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.005498] On node 0, zone DMA: 97 pages in unavailable ranges Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.146816] On node 0, zone Normal: 37 pages in unavailable ranges Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.147108] ACPI: PM-Timer IO Port: 0x608 Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.147122] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1]) Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.147156] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23 Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.147159] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.147161] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level) Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.147163] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.147165] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level) Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.147167] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level) Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.147170] ACPI: Using ACPI (MADT) for SMP configuration information Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.147175] smpboot: Allowing 2 CPUs, 0 hotplug CPUs Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.147198] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff] Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.147200] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x0009ffff] Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.147201] PM: hibernation: Registered nosave memory: [mem 0x000a0000-0x000effff] Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.147203] PM: hibernation: Registered nosave memory: [mem 0x000f0000-0x000fffff] Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.147204] PM: hibernation: Registered nosave memory: [mem 0xbffdb000-0xbfffffff] Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.147205] PM: hibernation: Registered nosave memory: [mem 0xc0000000-0xfeffbfff] Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.147207] PM: hibernation: Registered nosave memory: [mem 0xfeffc000-0xfeffffff] Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.147208] PM: hibernation: Registered nosave memory: [mem 0xff000000-0xfffbffff] Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.147209] PM: hibernation: Registered nosave memory: [mem 0xfffc0000-0xffffffff] Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.147211] [mem 0xc0000000-0xfeffbfff] available for PCI devices Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.147213] Booting paravirtualized kernel on KVM Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.147216] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645519600211568 ns Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.147291] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:2 nr_cpu_ids:2 nr_node_ids:1 Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.147538] percpu: Embedded 61 pages/cpu s212992 r8192 d28672 u1048576 Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.147543] pcpu-alloc: s212992 r8192 d28672 u1048576 alloc=1*2097152 Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.147546] pcpu-alloc: [0] 0 1 Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.147567] kvm-guest: stealtime: cpu 0, msr b13c33080 Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.147570] kvm-guest: PV spinlocks disabled, no host support Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.147575] Built 1 zonelists, mobility grouping on. Total pages: 11353819 Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.147577] Policy zone: Normal Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.147578] Kernel command line: BOOT_IMAGE=/boot/vmlinuz-5.15.0-83-generic root=UUID=a6de04b8-3631-4ce4-bb96-48076f4a56bf ro console=tty1 console=ttyS0 Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.147642] Unknown kernel command line parameters "BOOT_IMAGE=/boot/vmlinuz-5.15.0-83-generic", will be passed to user space. Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.154104] Dentry cache hash table entries: 8388608 (order: 14, 67108864 bytes, linear) Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.157422] Inode-cache hash table entries: 4194304 (order: 13, 33554432 bytes, linear) Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.157463] mem auto-init: stack:off, heap alloc:on, heap free:off Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.235218] Memory: 45085232K/46136804K available (16393K kernel code, 4391K rwdata, 10864K rodata, 3352K init, 18720K bss, 1051312K reserved, 0K cma-reserved) Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.235970] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=2, Nodes=1 Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.236026] ftrace: allocating 50648 entries in 198 pages Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.260823] ftrace: allocated 198 pages with 4 groups Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.261144] rcu: Hierarchical RCU implementation. Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.261146] rcu: RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=2. Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.261147] Rude variant of Tasks RCU enabled. Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.261148] Tracing variant of Tasks RCU enabled. Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.261149] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies. Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.261151] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=2 Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.265162] NR_IRQS: 524544, nr_irqs: 440, preallocated irqs: 16 Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.265355] random: crng init done Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.271782] Console: colour VGA+ 80x25 Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.294736] printk: console [tty1] enabled Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.339062] printk: console [ttyS0] enabled Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.339533] ACPI: Core revision 20210730 Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.340004] APIC: Switch to symmetric I/O mode setup Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.340603] x2apic enabled Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.341034] Switched APIC routing to physical x2apic. Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.342201] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.342763] tsc: Marking TSC unstable due to TSCs unsynchronized Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.343298] Calibrating delay loop (skipped) preset value.. 5000.00 BogoMIPS (lpj=10000000) Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.347363] x86/cpu: User Mode Instruction Prevention (UMIP) activated Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.347995] Last level iTLB entries: 4KB 512, 2MB 255, 4MB 127 Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.348515] Last level dTLB entries: 4KB 512, 2MB 255, 4MB 127, 1GB 0 Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.349075] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.349829] Spectre V2 : Mitigation: Retpolines Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.350256] Spectre V2 : Spectre v2 / SpectreRSB mitigation: Filling RSB on context switch Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.350985] Spectre V2 : Spectre v2 / SpectreRSB : Filling RSB on VMEXIT Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.351294] Spectre V2 : Enabling Speculation Barrier for firmware calls Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.351888] RETBleed: Mitigation: untrained return thunk Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.352365] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.353124] Speculative Store Bypass: Vulnerable Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.353573] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.355294] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.355836] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.356401] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.356936] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format. Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.371093] Freeing SMP alternatives memory: 44K Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.371294] pid_max: default: 32768 minimum: 301 Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.371742] LSM: Security Framework initializing Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.372178] landlock: Up and running. Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.372531] Yama: becoming mindful. Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.373094] AppArmor: AppArmor initialized Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.373538] Mount-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.374437] Mountpoint-cache hash table entries: 131072 (order: 8, 1048576 bytes, linear) Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.483696] smpboot: CPU0: AMD EPYC-Rome Processor (family: 0x17, model: 0x31, stepping: 0x0) Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.484814] Performance Events: Fam17h+ core perfctr, AMD PMU driver. Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.485405] ... version: 0 Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.485789] ... bit width: 48 Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.486188] ... generic registers: 6 Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.486569] ... value mask: 0000ffffffffffff Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.487062] ... max period: 00007fffffffffff Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.487293] ... fixed-purpose events: 0 Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.487294] ... event mask: 000000000000003f Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.487833] signal: max sigframe size: 1776 Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.488265] rcu: Hierarchical SRCU implementation. Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.489295] smp: Bringing up secondary CPUs ... Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.489863] x86: Booting SMP configuration: Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.490262] .... node #0, CPUs: #1 Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.077956] kvm-clock: cpu 1, msr 7c4e01041, secondary cpu clock Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.077956] smpboot: CPU 1 Converting physical 4 to logical die 1 Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.491976] kvm-guest: stealtime: cpu 1, msr b13d33080 Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.491976] smp: Brought up 1 node, 2 CPUs Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.491976] smpboot: Max logical packages: 2 Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.492141] smpboot: Total of 2 processors activated (10000.00 BogoMIPS) Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.497063] devtmpfs: initialized Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.497063] x86/mm: Memory block size: 128MB Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.500695] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.503308] futex hash table entries: 512 (order: 3, 32768 bytes, linear) Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.503990] pinctrl core: initialized pinctrl subsystem Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.504599] PM: RTC time: 03:23:02, date: 2023-08-23 Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.505255] NET: Registered PF_NETLINK/PF_ROUTE protocol family Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.506310] DMA: preallocated 4096 KiB GFP_KERNEL pool for atomic allocations Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.507675] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.510941] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.511325] audit: initializing netlink subsys (disabled) Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.511902] audit: type=2000 audit(1692760982.594:1): state=initialized audit_enabled=0 res=1 Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.511902] thermal_sys: Registered thermal governor 'fair_share' Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.512167] thermal_sys: Registered thermal governor 'bang_bang' Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.512887] thermal_sys: Registered thermal governor 'step_wise' Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.513522] thermal_sys: Registered thermal governor 'user_space' Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.514168] thermal_sys: Registered thermal governor 'power_allocator' Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.515307] EISA bus registered Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.516378] cpuidle: using governor ladder Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.516847] cpuidle: using governor menu Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.517643] ACPI: bus type PCI registered Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.517643] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.519413] PCI: Using configuration type 1 for base access Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.520013] PCI: Using configuration type 1 for extended access Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.522474] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible. Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.523334] HugeTLB registered 1.00 GiB page size, pre-allocated 0 pages Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.524010] HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.527375] ACPI: Added _OSI(Module Device) Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.527864] ACPI: Added _OSI(Processor Device) Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.528359] ACPI: Added _OSI(3.0 _SCP Extensions) Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.528878] ACPI: Added _OSI(Processor Aggregator Device) Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.529469] ACPI: Added _OSI(Linux-Dell-Video) Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.529959] ACPI: Added _OSI(Linux-Lenovo-NV-HDMI-Audio) Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.530528] ACPI: Added _OSI(Linux-HPI-Hybrid-Graphics) Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.532172] ACPI: 1 ACPI AML tables successfully acquired and loaded Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.534616] ACPI: Interpreter enabled Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.535325] ACPI: PM: (supports S0 S3 S4 S5) Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.535805] ACPI: Using IOAPIC for interrupt routing Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.536367] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.537317] PCI: Using E820 reservations for host bridge windows Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.538044] ACPI: Enabled 2 GPEs in block 00 to 0F Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.540630] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff]) Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.541294] acpi PNP0A03:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.542543] acpiphp: Slot [3] registered Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.543022] acpiphp: Slot [4] registered Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.543311] acpiphp: Slot [5] registered Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.543775] acpiphp: Slot [6] registered Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.544241] acpiphp: Slot [7] registered Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.544705] acpiphp: Slot [8] registered Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.545169] acpiphp: Slot [9] registered Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.545644] acpiphp: Slot [10] registered Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.546113] acpiphp: Slot [11] registered Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.546586] acpiphp: Slot [12] registered Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.547058] acpiphp: Slot [13] registered Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.547310] acpiphp: Slot [14] registered Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.547781] acpiphp: Slot [15] registered Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.548251] acpiphp: Slot [16] registered Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.548720] acpiphp: Slot [17] registered Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.549199] acpiphp: Slot [18] registered Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.549672] acpiphp: Slot [19] registered Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.550145] acpiphp: Slot [20] registered Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.550615] acpiphp: Slot [21] registered Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.551310] acpiphp: Slot [22] registered Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.551781] acpiphp: Slot [23] registered Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.552253] acpiphp: Slot [24] registered Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.552721] acpiphp: Slot [25] registered Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.553189] acpiphp: Slot [26] registered Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.553678] acpiphp: Slot [27] registered Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.554151] acpiphp: Slot [28] registered Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.554619] acpiphp: Slot [29] registered Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.555302] acpiphp: Slot [30] registered Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.555773] acpiphp: Slot [31] registered Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.556240] PCI host bridge to bus 0000:00 Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.556701] pci_bus 0000:00: root bus resource [bus 00-ff] Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.557286] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.558009] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window] Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.558704] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.559295] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window] Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.560290] pci_bus 0000:00: root bus resource [mem 0xb40000000-0xbbfffffff window] Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.561290] pci 0000:00:00.0: [8086:1237] type 00 class 0x060000 Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.562476] pci 0000:00:01.0: [8086:7000] type 00 class 0x060100 Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.563676] pci 0000:00:01.1: [8086:7010] type 00 class 0x010180 Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.566078] pci 0000:00:01.1: reg 0x20: [io 0xc180-0xc18f] Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.567986] pci 0000:00:01.1: legacy IDE quirk: reg 0x10: [io 0x01f0-0x01f7] Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.568736] pci 0000:00:01.1: legacy IDE quirk: reg 0x14: [io 0x03f6] Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.569433] pci 0000:00:01.1: legacy IDE quirk: reg 0x18: [io 0x0170-0x0177] Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.570161] pci 0000:00:01.1: legacy IDE quirk: reg 0x1c: [io 0x0376] Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.571494] pci 0000:00:01.2: [8086:7020] type 00 class 0x0c0300 Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.573954] pci 0000:00:01.2: reg 0x20: [io 0xc100-0xc11f] Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.576036] pci 0000:00:01.3: [8086:7113] type 00 class 0x068000 Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.576930] pci 0000:00:01.3: quirk: [io 0x0600-0x063f] claimed by PIIX4 ACPI Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.577735] pci 0000:00:01.3: quirk: [io 0x0700-0x070f] claimed by PIIX4 SMB Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.578857] pci 0000:00:02.0: [1b36:0100] type 00 class 0x030000 Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.588083] pci 0000:00:02.0: reg 0x10: [mem 0xf4000000-0xf7ffffff] Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.590393] pci 0000:00:02.0: reg 0x14: [mem 0xf8000000-0xfbffffff] Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.592075] pci 0000:00:02.0: reg 0x18: [mem 0xfc090000-0xfc091fff] Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.595301] pci 0000:00:02.0: reg 0x1c: [io 0xc120-0xc13f] Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.602705] pci 0000:00:02.0: reg 0x30: [mem 0xfc080000-0xfc08ffff pref] Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.603356] pci 0000:00:02.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.604617] pci 0000:00:03.0: [1af4:1000] type 00 class 0x020000 Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.606173] pci 0000:00:03.0: reg 0x10: [io 0xc080-0xc0bf] Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.607929] pci 0000:00:03.0: reg 0x14: [mem 0xfc092000-0xfc092fff] Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.612065] pci 0000:00:03.0: reg 0x20: [mem 0xfebec000-0xfebeffff 64bit pref] Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.613588] pci 0000:00:03.0: reg 0x30: [mem 0xfc000000-0xfc07ffff pref] Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.614840] pci 0000:00:04.0: [1af4:1003] type 00 class 0x078000 Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.616202] pci 0000:00:04.0: reg 0x10: [io 0xc0c0-0xc0ff] Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.617436] pci 0000:00:04.0: reg 0x14: [mem 0xfc093000-0xfc093fff] Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.622340] pci 0000:00:04.0: reg 0x20: [mem 0xfebf0000-0xfebf3fff 64bit pref] Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.624796] pci 0000:00:05.0: [1af4:1001] type 00 class 0x010000 Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.626232] pci 0000:00:05.0: reg 0x10: [io 0xc000-0xc07f] Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.628190] pci 0000:00:05.0: reg 0x14: [mem 0xfc094000-0xfc094fff] Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.631723] pci 0000:00:05.0: reg 0x20: [mem 0xfebf4000-0xfebf7fff 64bit pref] Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.635145] pci 0000:00:06.0: [1af4:1002] type 00 class 0x00ff00 Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.635903] pci 0000:00:06.0: reg 0x10: [io 0xc140-0xc15f] Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.638651] pci 0000:00:06.0: reg 0x20: [mem 0xfebf8000-0xfebfbfff 64bit pref] Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.640427] pci 0000:00:07.0: [1af4:1005] type 00 class 0x00ff00 Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.641537] pci 0000:00:07.0: reg 0x10: [io 0xc160-0xc17f] Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.646061] pci 0000:00:07.0: reg 0x20: [mem 0xfebfc000-0xfebfffff 64bit pref] Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.652037] ACPI: PCI: Interrupt link LNKA configured for IRQ 10 Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.652681] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.654214] ACPI: PCI: Interrupt link LNKC configured for IRQ 11 Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.654812] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.655336] ACPI: PCI: Interrupt link LNKS configured for IRQ 9 Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.656180] iommu: Default domain type: Translated Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.656180] iommu: DMA domain TLB invalidation policy: lazy mode Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.656519] SCSI subsystem initialized Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.656916] libata version 3.00 loaded. Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.656916] pci 0000:00:02.0: vgaarb: setting as boot VGA device Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.656916] pci 0000:00:02.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.659301] pci 0000:00:02.0: vgaarb: bridge control possible Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.659808] vgaarb: loaded Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.660129] ACPI: bus type USB registered Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.660519] usbcore: registered new interface driver usbfs Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.661009] usbcore: registered new interface driver hub Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.661528] usbcore: registered new device driver usb Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.662029] pps_core: LinuxPPS API ver. 1 registered Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.662477] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.663297] PTP clock support registered Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.663718] EDAC MC: Ver: 3.0.0 Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.663771] NetLabel: Initializing Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.663822] NetLabel: domain hash size = 128 Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.664227] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.664761] NetLabel: unlabeled traffic allowed by default Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.665266] PCI: Using ACPI for IRQ routing Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.665266] PCI: pci_cache_line_size set to 64 bytes Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.665266] e820: reserve RAM buffer [mem 0x0009fc00-0x0009ffff] Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.665266] e820: reserve RAM buffer [mem 0xbffdb000-0xbfffffff] Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.665266] clocksource: Switched to clocksource kvm-clock Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.680324] VFS: Disk quotas dquot_6.6.0 Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.680795] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.681516] AppArmor: AppArmor Filesystem Enabled Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.682030] pnp: PnP ACPI init Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.682505] pnp 00:03: [dma 2] Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.682759] pnp: PnP ACPI: found 5 devices Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.690052] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.690911] NET: Registered PF_INET protocol family Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.691621] IP idents hash table entries: 262144 (order: 9, 2097152 bytes, linear) Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.694433] tcp_listen_portaddr_hash hash table entries: 32768 (order: 7, 524288 bytes, linear) Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.695456] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.696637] TCP established hash table entries: 524288 (order: 10, 4194304 bytes, linear) Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.698864] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes, linear) Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.699868] TCP: Hash tables configured (established 524288 bind 65536) Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.700773] MPTCP token hash table entries: 65536 (order: 8, 1572864 bytes, linear) Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.702885] UDP hash table entries: 32768 (order: 8, 1048576 bytes, linear) Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.704165] UDP-Lite hash table entries: 32768 (order: 8, 1048576 bytes, linear) Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.705381] NET: Registered PF_UNIX/PF_LOCAL protocol family Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.705930] NET: Registered PF_XDP protocol family Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.706399] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.706940] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window] Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.707476] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.708066] pci_bus 0000:00: resource 7 [mem 0xc0000000-0xfebfffff window] Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.708823] pci_bus 0000:00: resource 8 [mem 0xb40000000-0xbbfffffff window] Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.710611] pci 0000:00:01.0: PIIX3: Enabling Passive Release Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.711256] pci 0000:00:00.0: Limiting direct PCI/PCI transfers Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.711898] pci 0000:00:01.0: Activating ISA DMA hang workarounds Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.732959] ACPI: \_SB_.LNKD: Enabled at IRQ 11 Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.754116] pci 0000:00:01.2: quirk_usb_early_handoff+0x0/0x160 took 40526 usecs Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.754957] PCI: CLS 0 bytes, default 64 Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.755451] Trying to unpack rootfs image as initramfs... Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.762212] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.762858] software IO TLB: mapped [mem 0x00000000bbfdb000-0x00000000bffdb000] (64MB) Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.770417] Initialise system trusted keyrings Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.770926] Key type blacklist registered Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.771364] workingset: timestamp_bits=36 max_order=24 bucket_order=0 Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.773093] zbud: loaded Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.773631] squashfs: version 4.0 (2009/01/31) Phillip Lougher Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.778144] fuse: init (API version 7.34) Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.778731] integrity: Platform Keyring initialized Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.790063] Key type asymmetric registered Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.790470] Asymmetric key parser 'x509' registered Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.790931] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 243) Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.793990] io scheduler mq-deadline registered Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.794853] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.795548] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0 Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.796258] ACPI: button: Power Button [PWRF] Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.816993] ACPI: \_SB_.LNKC: Enabled at IRQ 10 Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.858484] ACPI: \_SB_.LNKA: Enabled at IRQ 10 Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.880698] ACPI: \_SB_.LNKB: Enabled at IRQ 11 Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.902847] Serial: 8250/16550 driver, 32 ports, IRQ sharing enabled Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.925675] 00:04: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.939642] Linux agpgart interface v0.103 Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.942540] loop: module loaded Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.943431] ata_piix 0000:00:01.1: version 2.13 Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.946047] scsi host0: ata_piix Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.950047] scsi host1: ata_piix Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.950446] ata1: PATA max MWDMA2 cmd 0x1f0 ctl 0x3f6 bmdma 0xc180 irq 14 Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.951043] ata2: PATA max MWDMA2 cmd 0x170 ctl 0x376 bmdma 0xc188 irq 15 Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.951928] tun: Universal TUN/TAP device driver, 1.6 Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.953806] PPP generic driver version 2.4.2 Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.954396] VFIO - User Level meta-driver version: 0.3 Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.955126] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.955837] ehci-pci: EHCI PCI platform driver Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.956359] ehci-platform: EHCI generic platform driver Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.956950] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.957645] ohci-pci: OHCI PCI platform driver Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.958187] ohci-platform: OHCI generic platform driver Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.958691] uhci_hcd: USB Universal Host Controller Interface driver Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.979805] uhci_hcd 0000:00:01.2: UHCI Host Controller Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.980389] uhci_hcd 0000:00:01.2: new USB bus registered, assigned bus number 1 Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.981098] uhci_hcd 0000:00:01.2: detected 2 ports Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.981614] uhci_hcd 0000:00:01.2: irq 11, io base 0x0000c100 Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.983519] usb usb1: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 5.15 Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.984321] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.985045] usb usb1: Product: UHCI Host Controller Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.985512] usb usb1: Manufacturer: Linux 5.15.0-83-generic uhci_hcd Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.986235] usb usb1: SerialNumber: 0000:00:01.2 Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.986814] hub 1-0:1.0: USB hub found Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.987203] hub 1-0:1.0: 2 ports detected Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.987773] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12 Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.989330] serio: i8042 KBD port at 0x60,0x64 irq 1 Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.989999] serio: i8042 AUX port at 0x60,0x64 irq 12 Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.990706] mousedev: PS/2 mouse device common for all mice Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.991521] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input1 Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.992643] rtc_cmos 00:00: RTC can wake from S4 Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.993511] rtc_cmos 00:00: registered as rtc0 Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.994204] rtc_cmos 00:00: setting system clock to 2023-08-23T03:23:03 UTC (1692760983) Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.995183] rtc_cmos 00:00: alarms up to one day, y3k, 114 bytes nvram Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.995873] i2c_dev: i2c /dev entries driver Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.996423] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.997791] device-mapper: uevent: version 1.0.3 Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.998306] device-mapper: ioctl: 4.45.0-ioctl (2021-03-22) initialised: dm-devel@redhat.com Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.999279] platform eisa.0: Probing EISA bus 0 Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 0.999835] platform eisa.0: EISA: Cannot allocate resource for mainboard Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 1.000609] platform eisa.0: Cannot allocate resource for EISA slot 1 Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 1.001327] platform eisa.0: Cannot allocate resource for EISA slot 2 Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 1.002058] platform eisa.0: Cannot allocate resource for EISA slot 3 Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 1.002739] platform eisa.0: Cannot allocate resource for EISA slot 4 Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 1.003453] platform eisa.0: Cannot allocate resource for EISA slot 5 Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 1.004155] platform eisa.0: Cannot allocate resource for EISA slot 6 Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 1.004880] platform eisa.0: Cannot allocate resource for EISA slot 7 Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 1.005578] platform eisa.0: Cannot allocate resource for EISA slot 8 Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 1.006303] platform eisa.0: EISA: Detected 0 cards Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 1.007039] ledtrig-cpu: registered to indicate activity on CPUs Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 1.007824] drop_monitor: Initializing network drop monitor service Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 1.008680] NET: Registered PF_INET6 protocol family Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 1.424633] Freeing initrd memory: 107028K Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 1.429894] Segment Routing with IPv6 Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 1.430390] In-situ OAM (IOAM) with IPv6 Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 1.430823] NET: Registered PF_PACKET protocol family Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 1.431357] Key type dns_resolver registered Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 1.432068] IPI shorthand broadcast: enabled Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 1.432589] sched_clock: Marking stable (1357988811, 73956269)->(1433002600, -1057520) Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 1.433469] registered taskstats version 1 Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 1.434001] Loading compiled-in X.509 certificates Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 1.435936] Loaded X.509 cert 'Build time autogenerated kernel key: ced9953b39166bc6a497e5fc5420fc29069a55cd' Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 1.437252] Loaded X.509 cert 'Canonical Ltd. Live Patch Signing: 14df34d1a87cf37625abec039ef2bf521249b969' Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 1.438595] Loaded X.509 cert 'Canonical Ltd. Kernel Module Signing: 88f752e560a1e0737e31163a466ad7b70a850c19' Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 1.439496] blacklist: Loading compiled-in revocation X.509 certificates Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 1.440116] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing: 61482aa2830d0ab2ad5af10b7250da9033ddcef0' Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 1.441033] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2017): 242ade75ac4a15e50d50c84b0d45ff3eae707a03' Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 1.442002] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (ESM 2018): 365188c1d374d6b07c3c8f240f8ef722433d6a8b' Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 1.442950] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2019): c0746fd6c5da3ae827864651ad66ae47fe24b3e8' Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 1.443865] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2021 v1): a8d54bbb3825cfb94fa13c9f8a594a195c107b8d' Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 1.444807] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2021 v2): 4cf046892d6fd3c9a5b03f98d845f90851dc6a8c' Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 1.445934] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2021 v3): 100437bb6de6e469b581e61cd66bce3ef4ed53af' Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 1.446992] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (Ubuntu Core 2019): c1d57b8f6b743f23ee41f4f7ee292f06eecadfb9' Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 1.448392] zswap: loaded using pool lzo/zbud Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 1.449146] Key type .fscrypt registered Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 1.449618] Key type fscrypt-provisioning registered Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 1.452584] Key type encrypted registered Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 1.453002] AppArmor: AppArmor sha1 policy hashing enabled Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 1.453592] ima: No TPM chip found, activating TPM-bypass! Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 1.454164] Loading compiled-in module X.509 certificates Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 1.455201] Loaded X.509 cert 'Build time autogenerated kernel key: ced9953b39166bc6a497e5fc5420fc29069a55cd' Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 1.456181] ima: Allocated hash algorithm: sha1 Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 1.456682] ima: No architecture policies found Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 1.457165] evm: Initialising EVM extended attributes: Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 1.457704] evm: security.selinux Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 1.458115] evm: security.SMACK64 Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 1.458514] evm: security.SMACK64EXEC Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 1.458918] evm: security.SMACK64TRANSMUTE Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 1.459374] evm: security.SMACK64MMAP Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 1.459785] evm: security.apparmor Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 1.460189] evm: security.ima Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 1.460545] evm: security.capability Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 1.460975] evm: HMAC attrs: 0x1 Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 1.461643] PM: Magic number: 3:878:361 Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 1.462413] RAS: Correctable Errors collector initialized. Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 1.464660] Freeing unused decrypted memory: 2036K Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 1.466000] Freeing unused kernel image (initmem) memory: 3352K Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 1.482033] Write protecting the kernel read-only data: 30720k Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 1.483189] Freeing unused kernel image (text/rodata gap) memory: 2036K Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 1.484122] Freeing unused kernel image (rodata/data gap) memory: 1424K Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 1.538937] x86/mm: Checked W+X mappings: passed, no W+X pages found. Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 1.539648] Run /init as init process Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 1.540067] with arguments: Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 1.540069] /init Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 1.540070] with environment: Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 1.540071] HOME=/ Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 1.540072] TERM=linux Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 1.540072] BOOT_IMAGE=/boot/vmlinuz-5.15.0-83-generic Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 1.670611] virtio_blk virtio2: [vda] 41943040 512-byte logical blocks (21.5 GB/20.0 GiB) Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 1.673643] piix4_smbus 0000:00:01.3: SMBus Host Controller at 0x700, revision 0 Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 1.676892] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input4 Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 1.677998] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input3 Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 1.681459] cryptd: max_cpu_qlen set to 1000 Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 1.686295] vda: vda1 vda14 vda15 Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 1.687817] AVX2 version of gcm_enc/dec engaged. Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 1.689472] AES CTR mode by8 optimization enabled Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 1.690231] FDC 0 is a S82078B Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 1.748495] virtio_net virtio0 ens3: renamed from eth0 Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 1.790614] qxl 0000:00:02.0: vgaarb: deactivate vga console Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 1.792448] Console: switching to colour dummy device 80x25 Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 1.792892] [drm] Device Version 0.0 Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 1.793176] [drm] Compression level 0 log level 0 Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 1.793502] [drm] 12286 io pages at offset 0x1000000 Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 1.793851] [drm] 16777216 byte draw area at offset 0x0 Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 1.794228] [drm] RAM header offset: 0x3ffe000 Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 1.794616] [drm] qxl: 16M of VRAM memory size Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 1.794934] [drm] qxl: 63M of IO pages memory ready (VRAM domain) Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 1.795339] [drm] qxl: 64M of Surface memory size Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 1.802804] [drm] slot 0 (main): base 0xf4000000, size 0x03ffe000 Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 1.803535] [drm] slot 1 (surfaces): base 0xf8000000, size 0x04000000 Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 1.804724] [drm] Initialized qxl 0.1.0 20120117 for 0000:00:02.0 on minor 0 Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 1.806368] fbcon: qxldrmfb (fb0) is primary device Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 1.827563] Console: switching to colour frame buffer device 128x48 Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 1.834455] qxl 0000:00:02.0: [drm] fb0: qxldrmfb frame buffer device Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 1.989964] raid6: avx2x4 gen() 27089 MB/s Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 2.057964] raid6: avx2x4 xor() 8073 MB/s Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 2.125964] raid6: avx2x2 gen() 32302 MB/s Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 2.193964] raid6: avx2x2 xor() 19131 MB/s Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 2.261969] raid6: avx2x1 gen() 23619 MB/s Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 2.329965] raid6: avx2x1 xor() 14271 MB/s Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 2.397985] raid6: sse2x4 gen() 14837 MB/s Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 2.465965] raid6: sse2x4 xor() 7285 MB/s Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 2.533969] raid6: sse2x2 gen() 15919 MB/s Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 2.601967] raid6: sse2x2 xor() 9665 MB/s Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 2.669974] raid6: sse2x1 gen() 12176 MB/s Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 2.737965] raid6: sse2x1 xor() 7335 MB/s Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 2.738310] raid6: using algorithm avx2x2 gen() 32302 MB/s Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 2.738670] raid6: .... xor() 19131 MB/s, rmw enabled Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 2.739003] raid6: using avx2x2 recovery algorithm Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 2.741557] xor: measuring software checksum speed Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 2.742380] prefetch64-sse : 21136 MB/sec Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 2.743182] generic_sse : 19237 MB/sec Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 2.743489] xor: using function: prefetch64-sse (21136 MB/sec) Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 2.745317] async_tx: api initialized (async) Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 2.804433] Btrfs loaded, crc32c=crc32c-intel, zoned=yes, fsverity=yes Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 3.193927] EXT4-fs (vda1): mounted filesystem with ordered data mode. Opts: (null). Quota mode: none. Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 3.760154] EXT4-fs (vda1): re-mounted. Opts: discard,errors=remount-ro. Quota mode: none. Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 3.802717] alua: device handler registered Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 3.805362] emc: device handler registered Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 3.807134] rdac: device handler registered Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 3.871463] loop0: detected capacity change from 0 to 109072 Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 3.871885] loop1: detected capacity change from 0 to 229272 Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 3.871978] loop2: detected capacity change from 0 to 355240 Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 3.872677] loop3: detected capacity change from 0 to 129944 Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 3.872831] loop4: detected capacity change from 0 to 151296 Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 4.139363] kvm: Nested Virtualization enabled Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 4.139367] SVM: kvm: Nested Paging enabled Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 4.315061] audit: type=1400 audit(1692760986.816:2): apparmor="STATUS" operation="profile_load" profile="unconfined" name="lsb_release" pid=474 comm="apparmor_parser" Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 4.315952] audit: type=1400 audit(1692760986.816:3): apparmor="STATUS" operation="profile_load" profile="unconfined" name="nvidia_modprobe" pid=475 comm="apparmor_parser" Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 4.315956] audit: type=1400 audit(1692760986.816:4): apparmor="STATUS" operation="profile_load" profile="unconfined" name="nvidia_modprobe//kmod" pid=475 comm="apparmor_parser" Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 4.334524] audit: type=1400 audit(1692760986.836:5): apparmor="STATUS" operation="profile_load" profile="unconfined" name="/usr/lib/NetworkManager/nm-dhcp-client.action" pid=480 comm="apparmor_parser" Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 4.334530] audit: type=1400 audit(1692760986.836:6): apparmor="STATUS" operation="profile_load" profile="unconfined" name="/usr/lib/NetworkManager/nm-dhcp-helper" pid=480 comm="apparmor_parser" Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 4.334533] audit: type=1400 audit(1692760986.836:7): apparmor="STATUS" operation="profile_load" profile="unconfined" name="/usr/lib/connman/scripts/dhclient-script" pid=480 comm="apparmor_parser" Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 4.334536] audit: type=1400 audit(1692760986.836:8): apparmor="STATUS" operation="profile_load" profile="unconfined" name="/{,usr/}sbin/dhclient" pid=480 comm="apparmor_parser" Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 4.334874] audit: type=1400 audit(1692760986.836:9): apparmor="STATUS" operation="profile_load" profile="unconfined" name="/usr/bin/man" pid=481 comm="apparmor_parser" Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 4.334878] audit: type=1400 audit(1692760986.836:10): apparmor="STATUS" operation="profile_load" profile="unconfined" name="man_filter" pid=481 comm="apparmor_parser" Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 7.767354] bridge: filtering via arp/ip/ip6tables is no longer available by default. Update your scripts to load br_netfilter if you need this. Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 7.797851] fan-252: port 1(ftun0) entered blocking state Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 7.797856] fan-252: port 1(ftun0) entered disabled state Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 7.799098] device ftun0 entered promiscuous mode Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 7.929849] fan-252: port 1(ftun0) entered blocking state Aug 23 03:23:10 juju-e4d256-prod-github-runner-207 kernel: [ 7.929855] fan-252: port 1(ftun0) entered forwarding state Aug 23 03:23:11 juju-e4d256-prod-github-runner-207 kernel: [ 8.791950] IPv6: ADDRCONF(NETDEV_CHANGE): fan-252: link becomes ready Aug 23 03:23:15 juju-e4d256-prod-github-runner-207 kernel: [ 13.027758] loop5: detected capacity change from 0 to 8 Aug 23 03:23:48 juju-e4d256-prod-github-runner-207 kernel: [ 46.571583] NET: Registered PF_VSOCK protocol family Aug 23 03:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 48.753013] spl: loading out-of-tree module taints kernel. Aug 23 03:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 48.756929] znvpair: module license 'CDDL' taints kernel. Aug 23 03:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 48.756931] Disabling lock debugging due to kernel taint Aug 23 03:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 48.916721] ZFS: Loaded module v2.1.5-1ubuntu6~22.04.1, ZFS pool version 5000, ZFS filesystem version 5 Aug 23 03:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 49.127324] kauditd_printk_skb: 20 callbacks suppressed Aug 23 03:23:51 juju-e4d256-prod-github-runner-207 kernel: [ 49.127327] audit: type=1400 audit(1692761031.407:31): apparmor="STATUS" operation="profile_load" profile="unconfined" name="lxd_dnsmasq-lxdbr0_" pid=3928 comm="apparmor_parser" Aug 23 03:24:04 juju-e4d256-prod-github-runner-207 kernel: [ 62.488677] Bridge firewalling registered